May 28 12:35:52 l75lg1-v1 systemd[1]: Created slice Slice /system/devstack. May 28 12:35:53 l75lg1-v1 dstat.sh[49771]: ----system---- ----total-usage---- ------memory-usage----- -net/total- -dsk/total- --io/total- ---system-- ---load-avg--- ---procs--- ---paging-- ----swap--- ------tcp-sockets------- May 28 12:35:53 l75lg1-v1 dstat.sh[49771]: time |usr sys idl wai stl| used free buf cach| recv send| read writ| read writ| int csw | 1m 5m 15m |run blk new| in out | used free|lis act syn tim clo May 28 12:35:53 l75lg1-v1 dstat.sh[49771]: 28-05 12:35:53| |1038M 8727M 230M 5586M| | | | |0.55 0.59 0.54|1.0 0 | | 0 2048M| 18 3 0 6 0 May 28 12:35:54 l75lg1-v1 dstat.sh[49771]: 28-05 12:35:54| 5 8 86 0 0|1043M 8722M 230M 5587M| 21k 21k| 52k 1223k|13.0 66.9 |6033 7912 |0.55 0.59 0.54|1.0 0 393| 0 0 | 0 2048M| 18 3 0 6 0 May 28 12:35:55 l75lg1-v1 dstat.sh[49771]: 28-05 12:35:55| 7 6 86 0 0|1052M 8712M 230M 5587M| 17k 5522B| 104k 2424k|19.5 191 |6694 9932 |0.55 0.59 0.54|1.0 0 291| 0 0 | 0 2048M| 18 3 0 6 0 May 28 12:35:55 l75lg1-v1 etcd[50438]: WARNING: Package "github.com/golang/protobuf/protoc-gen-go/generator" is deprecated. May 28 12:35:55 l75lg1-v1 etcd[50438]: A future release of golang/protobuf will delete this package, May 28 12:35:55 l75lg1-v1 etcd[50438]: which has long been excluded from the compatibility promise. May 28 12:35:55 l75lg1-v1 etcd[50438]: [WARNING] Deprecated '--debug' flag is set to true (use '--log-level=debug' instead May 28 12:35:55 l75lg1-v1 etcd[50438]: [WARNING] Deprecated '--debug' flag is set to true with inconsistent '--log-level=info' flag May 28 12:35:55 l75lg1-v1 etcd[50438]: [WARNING] Deprecated '--logger=capnslog' flag is set; use '--logger=zap' flag instead May 28 12:35:55 l75lg1-v1 etcd[50438]: [WARNING] Deprecated '--debug' flag is set to true (use '--log-level=debug' instead May 28 12:35:55 l75lg1-v1 etcd[50438]: [WARNING] Deprecated '--debug' flag is set to true with inconsistent '--log-level=info' flag May 28 12:35:55 l75lg1-v1 etcd[50438]: [WARNING] Deprecated '--logger=capnslog' flag is set; use '--logger=zap' flag instead May 28 12:35:55 l75lg1-v1 etcd[50438]: Running http and grpc server on single port. This is not recommended for production. May 28 12:35:55 l75lg1-v1 etcd[50438]: etcd Version: 3.4.27 May 28 12:35:55 l75lg1-v1 etcd[50438]: Git SHA: c92fb80f3 May 28 12:35:55 l75lg1-v1 etcd[50438]: Go Version: go1.19.10 May 28 12:35:55 l75lg1-v1 etcd[50438]: Go OS/Arch: linux/amd64 May 28 12:35:55 l75lg1-v1 etcd[50438]: setting maximum number of CPUs to 10, total number of available CPUs is 10 May 28 12:35:55 l75lg1-v1 etcd[50438]: Running http and grpc server on single port. This is not recommended for production. May 28 12:35:55 l75lg1-v1 etcd[50438]: name = l75lg1-v1 May 28 12:35:55 l75lg1-v1 etcd[50438]: data dir = /opt/stack/data/etcd May 28 12:35:55 l75lg1-v1 etcd[50438]: member dir = /opt/stack/data/etcd/member May 28 12:35:55 l75lg1-v1 etcd[50438]: heartbeat = 100ms May 28 12:35:55 l75lg1-v1 etcd[50438]: election = 1000ms May 28 12:35:55 l75lg1-v1 etcd[50438]: snapshot count = 100000 May 28 12:35:55 l75lg1-v1 etcd[50438]: advertise client URLs = http://10.27.203.238:2379 May 28 12:35:55 l75lg1-v1 etcd[50438]: check file permission: directory "/opt/stack/data/etcd" exist, but the permission is "dtrwxrwxrwx". The recommended permission is "-rwx------" to prevent possible unprivileged access to the data. May 28 12:35:55 l75lg1-v1 etcd[50438]: starting member 700662d7df116a5d in cluster 77affd7a1ad99a66 May 28 12:35:55 l75lg1-v1 etcd[50438]: raft2024/05/28 12:35:55 INFO: 700662d7df116a5d switched to configuration voters=() May 28 12:35:55 l75lg1-v1 etcd[50438]: raft2024/05/28 12:35:55 INFO: 700662d7df116a5d became follower at term 0 May 28 12:35:55 l75lg1-v1 etcd[50438]: raft2024/05/28 12:35:55 INFO: newRaft 700662d7df116a5d [peers: [], term: 0, commit: 0, applied: 0, lastindex: 0, lastterm: 0] May 28 12:35:55 l75lg1-v1 etcd[50438]: raft2024/05/28 12:35:55 INFO: 700662d7df116a5d became follower at term 1 May 28 12:35:55 l75lg1-v1 etcd[50438]: raft2024/05/28 12:35:55 INFO: 700662d7df116a5d switched to configuration voters=(8072248061408143965) May 28 12:35:55 l75lg1-v1 etcd[50438]: simple token is not cryptographically signed May 28 12:35:55 l75lg1-v1 etcd[50438]: starting server... [version: 3.4.27, cluster version: to_be_decided] May 28 12:35:55 l75lg1-v1 etcd[50438]: started to purge file, dir: /opt/stack/data/etcd/member/snap, suffix: snap.db, max: 5, interval: 30s May 28 12:35:55 l75lg1-v1 etcd[50438]: started to purge file, dir: /opt/stack/data/etcd/member/snap, suffix: snap, max: 5, interval: 30s May 28 12:35:55 l75lg1-v1 etcd[50438]: started to purge file, dir: /opt/stack/data/etcd/member/wal, suffix: wal, max: 5, interval: 30s May 28 12:35:55 l75lg1-v1 etcd[50438]: raft2024/05/28 12:35:55 INFO: 700662d7df116a5d switched to configuration voters=(8072248061408143965) May 28 12:35:55 l75lg1-v1 etcd[50438]: added member 700662d7df116a5d [http://10.27.203.238:2380] to cluster 77affd7a1ad99a66 May 28 12:35:55 l75lg1-v1 etcd[50438]: 700662d7df116a5d as single-node; fast-forwarding 9 ticks (election ticks 10) May 28 12:35:55 l75lg1-v1 etcd[50438]: listening for peers on [::]:2380 May 28 12:35:56 l75lg1-v1 etcd[50438]: raft2024/05/28 12:35:56 INFO: 700662d7df116a5d is starting a new election at term 1 May 28 12:35:56 l75lg1-v1 etcd[50438]: raft2024/05/28 12:35:56 INFO: 700662d7df116a5d became candidate at term 2 May 28 12:35:56 l75lg1-v1 etcd[50438]: raft2024/05/28 12:35:56 INFO: 700662d7df116a5d received MsgVoteResp from 700662d7df116a5d at term 2 May 28 12:35:56 l75lg1-v1 etcd[50438]: raft2024/05/28 12:35:56 INFO: 700662d7df116a5d became leader at term 2 May 28 12:35:56 l75lg1-v1 etcd[50438]: raft2024/05/28 12:35:56 INFO: raft.node: 700662d7df116a5d elected leader 700662d7df116a5d at term 2 May 28 12:35:56 l75lg1-v1 etcd[50438]: published {Name:l75lg1-v1 ClientURLs:[http://10.27.203.238:2379]} to cluster 77affd7a1ad99a66 May 28 12:35:56 l75lg1-v1 etcd[50438]: ready to serve client requests May 28 12:35:56 l75lg1-v1 etcd[50438]: INFO: 2024/05/28 12:35:56 parsed scheme: "" May 28 12:35:56 l75lg1-v1 etcd[50438]: INFO: 2024/05/28 12:35:56 scheme "" not registered, fallback to default scheme May 28 12:35:56 l75lg1-v1 etcd[50438]: INFO: 2024/05/28 12:35:56 ccResolverWrapper: sending update to cc: {[{10.27.203.238:2379 0 }] } May 28 12:35:56 l75lg1-v1 etcd[50438]: INFO: 2024/05/28 12:35:56 ClientConn switching balancer to "pick_first" May 28 12:35:56 l75lg1-v1 etcd[50438]: setting up the initial cluster version to 3.4 May 28 12:35:56 l75lg1-v1 etcd[50438]: set the initial cluster version to 3.4 May 28 12:35:56 l75lg1-v1 etcd[50438]: enabled capabilities for version 3.4 May 28 12:35:56 l75lg1-v1 etcd[50438]: serving insecure client requests on 10.27.203.238:2379, this is strongly discouraged! May 28 12:35:56 l75lg1-v1 dstat.sh[49771]: 28-05 12:35:56| 2 2 96 0 0|1173M 8591M 230M 5709M| 15k 1470B| 0 0 | 0 0 |2945 3866 |0.51 0.58 0.54|2.0 0 37| 0 0 | 0 2048M| 19 5 0 6 0 May 28 12:35:57 l75lg1-v1 dstat.sh[49771]: 28-05 12:35:57| 9 1 89 0 0|1174M 8590M 230M 5709M| 12k 5046B| 0 24k| 0 6.00 |1605 1585 |0.51 0.58 0.54|1.0 0 41| 0 0 | 0 2048M| 19 5 0 6 0 May 28 12:35:58 l75lg1-v1 dstat.sh[49771]: 28-05 12:35:58| 8 3 89 0 0|1191M 8574M 230M 5709M| 20k 8517B| 0 252k| 0 24.0 |2414 2573 |0.51 0.58 0.54|1.0 0 100| 0 0 | 0 2048M| 19 5 0 8 0 May 28 12:35:59 l75lg1-v1 dstat.sh[49771]: 28-05 12:35:59| 9 1 90 0 0|1236M 8527M 230M 5709M| 14k 258B| 120k 1228k|9.00 25.0 |1250 1508 |0.51 0.58 0.54|1.0 0 0| 0 0 | 0 2048M| 19 5 0 8 0 May 28 12:36:00 l75lg1-v1 dstat.sh[49771]: 28-05 12:36:00| 10 0 90 0 0|1259M 8504M 230M 5710M| 15k 86B| 0 20k| 0 2.00 |1099 1176 |0.51 0.58 0.54|1.0 0 0| 0 0 | 0 2048M| 19 5 0 8 0 May 28 12:36:01 l75lg1-v1 dstat.sh[49771]: 28-05 12:36:01| 2 1 86 11 0|1271M 8491M 230M 5711M| 19k 1770B| 0 11M| 0 951 |6426 11k|0.87 0.65 0.56|1.0 0 10| 0 0 | 0 2048M| 19 7 0 8 0 May 28 12:36:02 l75lg1-v1 dstat.sh[49771]: 28-05 12:36:02| 1 1 88 10 0|1268M 8490M 231M 5714M| 14k 86B| 0 8943k| 0 890 |6230 11k|0.87 0.65 0.56| 0 1.0 0| 0 0 | 0 2048M| 19 7 0 8 0 May 28 12:36:03 l75lg1-v1 dstat.sh[49771]: 28-05 12:36:03| 1 1 87 11 0|1273M 8484M 231M 5715M| 16k 86B| 0 10M| 0 1001 |6296 11k|0.87 0.65 0.56|1.0 1.0 18| 0 0 | 0 2048M| 19 7 0 8 0 May 28 12:36:04 l75lg1-v1 dstat.sh[49771]: 28-05 12:36:04| 1 1 85 13 0|1272M 8484M 231M 5716M| 17k 86B| 0 13M| 0 1178 |6336 11k|0.87 0.65 0.56|2.0 1.0 12| 0 0 | 0 2048M| 19 7 0 8 0 May 28 12:36:05 l75lg1-v1 dstat.sh[49771]: 28-05 12:36:05| 1 1 85 12 0|1271M 8483M 232M 5717M| 11k 258B| 0 13M| 0 1111 |6432 11k|0.87 0.65 0.56|1.0 1.0 12| 0 0 | 0 2048M| 19 7 0 6 0 May 28 12:36:06 l75lg1-v1 dstat.sh[49771]: 28-05 12:36:06| 1 1 87 10 0|1270M 8482M 232M 5719M| 14k 86B| 0 8056k| 0 899 |6307 11k|0.96 0.68 0.57| 0 2.0 3.0| 0 0 | 0 2048M| 19 7 0 6 0 May 28 12:36:07 l75lg1-v1 dstat.sh[49771]: 28-05 12:36:07| 2 0 85 12 0|1270M 8481M 233M 5719M| 15k 1404B| 0 12M| 0 1127 |6401 11k|0.96 0.68 0.57| 0 1.0 15| 0 0 | 0 2048M| 19 7 0 6 0 May 28 12:36:08 l75lg1-v1 dstat.sh[49771]: 28-05 12:36:08| 5 1 84 9 0|1181M 8569M 233M 5719M| 20k 6762B| 0 10M| 0 848 |5572 9139 |0.96 0.68 0.57|1.0 1.0 41| 0 0 | 0 2048M| 19 5 0 6 0 May 28 12:36:09 l75lg1-v1 dstat.sh[49771]: 28-05 12:36:09| 10 1 87 2 0|1222M 8528M 233M 5719M| 14k 86B| 0 3625k| 0 273 |1845 2578 |0.96 0.68 0.57|1.0 0 0| 0 0 | 0 2048M| 19 5 0 6 0 May 28 12:36:10 l75lg1-v1 dstat.sh[49771]: 28-05 12:36:10| 10 1 88 2 0|1261M 8490M 233M 5719M| 11k 86B| 0 4724k| 0 416 |1415 1875 |0.96 0.68 0.57|1.0 0 0| 0 0 | 0 2048M| 19 5 0 6 0 May 28 12:36:11 l75lg1-v1 dstat.sh[49771]: 28-05 12:36:11| 10 1 90 0 0|1198M 8552M 233M 5719M| 21k 2720B| 0 60k| 0 5.00 |1160 1158 |0.96 0.68 0.57|2.0 0 6.0| 0 0 | 0 2048M| 19 5 0 6 0 May 28 12:36:12 l75lg1-v1 dstat.sh[49771]: 28-05 12:36:12| 9 1 90 0 0|1249M 8501M 233M 5719M| 17k 86B| 0 4094B| 0 1.00 | 964 1138 |0.96 0.68 0.57|1.0 0 0| 0 0 | 0 2048M| 19 5 0 6 0 May 28 12:36:13 l75lg1-v1 dstat.sh[49771]: 28-05 12:36:13| 10 0 89 0 0|1266M 8484M 233M 5719M| 15k 2285B| 0 0 | 0 0 |1040 1136 |0.96 0.68 0.57|1.0 0 0| 0 0 | 0 2048M| 19 5 0 6 0 May 28 12:36:14 l75lg1-v1 dstat.sh[49771]: 28-05 12:36:14| 4 7 88 0 0|1193M 8557M 233M 5719M| 25k 22k| 0 36k| 0 9.00 |4308 4470 |0.96 0.68 0.57|1.0 0 393| 0 0 | 0 2048M| 19 5 0 6 0 May 28 12:36:15 l75lg1-v1 devstack@keystone.service[51265]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini May 28 12:36:15 l75lg1-v1 devstack@keystone.service[51265]: *** Starting uWSGI 2.0.20-debian (64bit) on [Tue May 28 12:36:15 2024] *** May 28 12:36:15 l75lg1-v1 devstack@keystone.service[51265]: compiled with version: 11.2.0 on 21 March 2022 11:00:44 May 28 12:36:15 l75lg1-v1 devstack@keystone.service[51265]: os: Linux-5.15.0-56-generic #62-Ubuntu SMP Tue Nov 22 19:54:14 UTC 2022 May 28 12:36:15 l75lg1-v1 devstack@keystone.service[51265]: nodename: l75lg1-v1 May 28 12:36:15 l75lg1-v1 devstack@keystone.service[51265]: machine: x86_64 May 28 12:36:15 l75lg1-v1 devstack@keystone.service[51265]: clock source: unix May 28 12:36:15 l75lg1-v1 devstack@keystone.service[51265]: pcre jit disabled May 28 12:36:15 l75lg1-v1 devstack@keystone.service[51265]: detected number of CPU cores: 10 May 28 12:36:15 l75lg1-v1 devstack@keystone.service[51265]: current working directory: / May 28 12:36:15 l75lg1-v1 devstack@keystone.service[51265]: detected binary path: /usr/bin/uwsgi-core May 28 12:36:15 l75lg1-v1 devstack@keystone.service[51265]: your processes number limit is 63557 May 28 12:36:15 l75lg1-v1 devstack@keystone.service[51265]: your memory page size is 4096 bytes May 28 12:36:15 l75lg1-v1 devstack@keystone.service[51265]: detected max file descriptor number: 2048 May 28 12:36:15 l75lg1-v1 devstack@keystone.service[51265]: lock engine: pthread robust mutexes May 28 12:36:15 l75lg1-v1 devstack@keystone.service[51265]: thunder lock: enabled May 28 12:36:15 l75lg1-v1 devstack@keystone.service[51265]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 May 28 12:36:15 l75lg1-v1 devstack@keystone.service[51265]: Python version: 3.10.12 (main, Nov 20 2023, 15:14:05) [GCC 11.4.0] May 28 12:36:15 l75lg1-v1 devstack@keystone.service[51265]: PEP 405 virtualenv detected: /opt/stack/data/venv May 28 12:36:15 l75lg1-v1 devstack@keystone.service[51265]: Set PythonHome to /opt/stack/data/venv May 28 12:36:15 l75lg1-v1 dstat.sh[49771]: 28-05 12:36:15| 8 5 86 0 0|1199M 8551M 233M 5720M| 19k 3632B| 104k 12k|26.0 3.00 |6917 9660 |0.96 0.68 0.57|1.0 0 144| 0 0 | 0 2048M| 19 5 0 6 0 May 28 12:36:15 l75lg1-v1 devstack@keystone.service[51265]: Python main interpreter initialized at 0x5602523399e0 May 28 12:36:15 l75lg1-v1 devstack@keystone.service[51265]: python threads support enabled May 28 12:36:15 l75lg1-v1 devstack@keystone.service[51265]: your server socket listen backlog is limited to 100 connections May 28 12:36:15 l75lg1-v1 devstack@keystone.service[51265]: your mercy for graceful operations on workers is 80 seconds May 28 12:36:15 l75lg1-v1 devstack@keystone.service[51265]: mapped 403077 bytes (393 KB) for 2 cores May 28 12:36:15 l75lg1-v1 devstack@keystone.service[51265]: *** Operational MODE: preforking *** May 28 12:36:15 l75lg1-v1 devstack@keystone.service[51265]: *** uWSGI is running in multiple interpreter mode *** May 28 12:36:15 l75lg1-v1 devstack@keystone.service[51265]: spawned uWSGI master process (pid: 51265) May 28 12:36:15 l75lg1-v1 devstack@keystone.service[51265]: spawned uWSGI worker 1 (pid: 51266, cores: 1) May 28 12:36:15 l75lg1-v1 devstack@keystone.service[51265]: spawned uWSGI worker 2 (pid: 51267, cores: 1) May 28 12:36:15 l75lg1-v1 devstack@keystone.service[51265]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 28 12:36:16 l75lg1-v1 dstat.sh[49771]: 28-05 12:36:16| 18 2 79 0 0|1300M 8450M 233M 5720M| 18k 5361B| 16k 168k|1.00 3.00 |1870 1776 |1.05 0.70 0.58|3.0 1.0 65| 0 0 | 0 2048M| 19 6 0 6 0 May 28 12:36:17 l75lg1-v1 dstat.sh[49771]: 28-05 12:36:17| 19 1 80 0 0|1351M 8399M 233M 5721M| 16k 86B| 0 368k| 0 36.0 |1425 1266 |1.05 0.70 0.58|5.0 0 0| 0 0 | 0 2048M| 19 6 0 6 0 May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2600}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2601}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2600}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2601}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] command line args: [] {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2603}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] ================================================================================ {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2605}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] command line args: [] {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] admin_token = **** {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2603}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] config_dir = [] {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] ================================================================================ {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2605}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] config_source = [] {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] admin_token = **** {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] debug = True {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] config_dir = [] {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] config_source = [] {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] debug = True {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] insecure_debug = False {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] insecure_debug = False {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] list_limit = None {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] log_config_append = None {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] log_dir = None {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] list_limit = None {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] log_file = None {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] log_config_append = None {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] log_dir = None {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] log_file = None {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] notification_format = cadf {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending'] {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] notification_format = cadf {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending'] {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] public_endpoint = http://10.27.203.238/identity {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] publish_errors = False {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] public_endpoint = http://10.27.203.238/identity {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] publish_errors = False {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] strict_password_check = False {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] use_eventlog = False {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] strict_password_check = False {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] use_journal = False {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] use_json = False {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] use_eventlog = False {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] use_stderr = False {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] use_journal = False {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] use_syslog = False {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] use_json = False {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] use_stderr = False {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] watch_log_file = False {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] use_syslog = False {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] watch_log_file = False {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] profiler.hmac_keys = **** {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] profiler.hmac_keys = **** {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] profiler.trace_requests = False {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] profiler.trace_requests = False {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] profiler_jaeger.process_tags = {} {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] profiler_jaeger.process_tags = {} {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] profiler_jaeger.service_name_prefix = None {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] profiler_jaeger.service_name_prefix = None {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] profiler_otlp.service_name_prefix = None {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] profiler_otlp.service_name_prefix = None {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] cache.enabled = True {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] cache.enforce_fips_mode = False {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] cache.enabled = True {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] cache.memcache_password = **** {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] cache.enforce_fips_mode = False {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] cache.memcache_password = **** {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] cache.memcache_username = None {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] cache.redis_password = **** {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] cache.redis_sentinel_service_name = mymaster {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] cache.redis_sentinels = ['localhost:26379'] {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] cache.redis_server = localhost:6379 {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] cache.memcache_username = None {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] cache.redis_socket_timeout = 1.0 {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] cache.redis_username = None {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] cache.redis_password = **** {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] cache.redis_sentinel_service_name = mymaster {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] cache.redis_sentinels = ['localhost:26379'] {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] cache.redis_server = localhost:6379 {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] cache.redis_socket_timeout = 1.0 {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] cache.redis_username = None {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] auth.external = None {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] auth.mapped = None {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] auth.password = None {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] auth.token = None {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] auth.external = None {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] catalog.caching = True {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] auth.mapped = None {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] auth.password = None {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] auth.token = None {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] credential.caching = True {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] catalog.caching = True {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] credential.driver = sql {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] credential.caching = True {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] credential.driver = sql {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] federation.attribute_mapping_default_schema_version = 1.0 {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] federation.caching = True {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] federation.driver = sql {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] federation.attribute_mapping_default_schema_version = 1.0 {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] federation.caching = True {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] federation.driver = sql {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] identity.caching = True {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] identity.driver = sql {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] identity.caching = True {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] identity.driver = sql {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] ldap.password = **** {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] ldap.randomize_urls = False {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] ldap.user = None {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] ldap.password = **** {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] ldap.randomize_urls = False {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] ldap.user = None {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] oauth2.oauth2_authn_methods = ['tls_client_auth', 'client_secret_basic'] {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] oauth2.oauth2_cert_dn_mapping_id = oauth2_mapping {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] policy.driver = sql {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] receipt.caching = True {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] resource.caching = True {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] resource.driver = sql {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] revoke.caching = True {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] oauth2.oauth2_authn_methods = ['tls_client_auth', 'client_secret_basic'] {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] oauth2.oauth2_cert_dn_mapping_id = oauth2_mapping {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] policy.driver = sql {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] role.cache_time = None {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] role.caching = True {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] role.driver = sql {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] role.list_limit = None {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] receipt.caching = True {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] resource.caching = True {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] resource.driver = sql {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] revoke.caching = True {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] role.cache_time = None {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] role.caching = True {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] role.driver = sql {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] role.list_limit = None {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] token.cache_time = None {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] token.caching = True {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] token.provider = fernet {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] trust.driver = sql {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] database.connection = **** {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] token.cache_time = None {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] token.caching = True {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] token.provider = fernet {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] trust.driver = sql {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] database.mysql_wsrep_sync_wait = None {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=51266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2624}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] database.connection = **** {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] database.mysql_wsrep_sync_wait = None {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=51267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2624}} May 28 12:36:18 l75lg1-v1 dstat.sh[49771]: 28-05 12:36:18| 19 2 78 0 0|1375M 8374M 233M 5721M| 18k 86B| 0 1564k| 0 79.0 |1863 4150 |1.05 0.70 0.58|6.0 0 2.0| 0 0 | 0 2048M| 19 6 0 6 0 May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=51266) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=51266) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=51266) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=51267) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=51267) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=51267) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=51266) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=51267) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=51266) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=51266) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=51267) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=51267) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=51266) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=51267) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=51267) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=51267) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=51266) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=51266) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=51266) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=51266) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=51266) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=51267) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=51266) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=51267) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=51266) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=51266) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=51267) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=51267) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=51267) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=51267) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=51266) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=51266) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=51267) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=51266) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=51267) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=51266) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=51267) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=51266) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=51267) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=51266) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=51267) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=51266) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=51267) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=51267) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=51266) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=51267) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=51266) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=51266) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=51266) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=51266) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=51267) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=51266) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=51267) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=51266) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=51267) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=51266) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=51267) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=51267) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=51267) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=51267) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=51266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:416}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=51266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:432}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=51266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:416}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=51266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:432}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=51266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:416}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=51267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:416}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=51266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:416}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=51267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:432}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=51266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:416}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=51267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:416}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=51266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:416}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=51267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:432}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=51267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:416}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=51267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:416}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=51267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:416}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=51267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:416}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=51266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:416}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=51266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:416}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=51266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:416}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=51266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:416}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=51267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:416}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=51267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:416}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=51267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:416}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=51267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:416}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=51266) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:342}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=51267) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:342}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=51266) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:342}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=51266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:416}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=51266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:416}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=51266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:416}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=51267) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:342}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=51266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:416}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=51266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:416}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=51267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:416}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=51266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:416}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=51267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:416}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=51266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:416}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=51267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:416}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=51266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:416}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=51267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:416}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=51266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:416}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=51267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:416}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=51266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:416}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=51267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:416}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=51267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:416}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=51267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:416}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=51267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:416}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=51267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:416}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=51266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:416}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=51267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:416}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=51266) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:342}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=51266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:416}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=51267) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:342}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=51267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:416}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=51266) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:342}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=51266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:416}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=51266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:416}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=51267) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:342}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=51267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:416}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=51267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:416}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=51266) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:342}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=51266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:416}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=51267) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:342}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=51267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:416}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=51266) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:342}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=51266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:416}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=51266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:416}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=51267) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:342}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=51266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:416}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=51266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:416}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=51267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:416}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=51266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:416}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=51267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:416}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=51266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:416}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=51267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:416}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=51266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:416}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=51267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:416}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=51267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:416}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=51267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:416}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=51267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:416}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=51266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:416}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=51266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:416}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=51267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:416}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=51267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:416}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=51266) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:342}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=51267) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:342}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=51266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:416}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=51266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:416}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=51267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:416}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=51267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:416}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=51266) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:342}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=51267) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:342}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=51266) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:342}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=51267) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:342}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=51266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:416}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=51266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:416}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=51266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:416}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=51267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:416}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=51266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:416}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=51266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:416}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=51267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:416}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=51266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:416}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=51267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:416}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=51267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:416}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=51267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:416}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=51267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:416}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=51266) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:342}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=51266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:416}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=51266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:416}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=51267) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:342}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=51266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:416}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=51267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:416}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=51267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:416}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=51267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:416}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=51266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:416}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=51267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:416}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=51266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:416}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=51267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:416}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=51266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:416}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=51266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:416}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=51267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:416}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=51267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:416}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=51266) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:342}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=51266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:416}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=51266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:416}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=51266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:416}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=51267) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:342}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=51266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:416}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=51267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:416}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=51267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:416}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=51267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:416}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=51267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:416}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=51266) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:342}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=51266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:416}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=51266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:416}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=51267) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:342}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=51266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:416}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=51266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:416}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=51267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:416}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=51266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:416}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=51267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:416}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=51266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:416}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=51267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:416}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=51267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:416}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=51267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:416}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=51267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:416}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=51266) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:342}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=51267) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:342}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=51266) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:342}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=51267) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:342}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=51266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:416}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=51267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:416}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=51266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:416}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=51267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:416}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=51266) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:342}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=51266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:416}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=51266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:416}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=51267) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:342}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=51267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:416}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=51267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:416}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=51266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:416}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=51267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:416}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=51266) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:342}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=51267) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:342}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=51266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:416}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=51266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:416}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=51266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:416}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=51266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:416}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=51267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:416}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=51267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:416}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=51267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:416}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=51267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:416}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=51266) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:342}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=51266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:416}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=51266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:416}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=51267) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:342}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=51267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:416}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=51267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:416}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=51266) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:342}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=51266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:416}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=51266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:416}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=51266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:416}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=51266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:416}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=51267) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:342}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=51266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:416}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=51267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:416}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=51266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:416}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=51267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:416}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=51266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:416}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=51267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:416}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=51266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:416}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=51267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:416}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=51266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:416}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=51266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:416}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=51267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:416}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=51266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:416}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=51267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:416}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=51266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:416}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=51267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:416}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=51266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:416}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=51267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:416}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=51267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:416}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=51267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:416}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=51267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:416}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=51267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:416}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=51267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:416}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: WSGI app 0 (mountpoint='') ready in 3 seconds on interpreter 0x5602523399e0 pid: 51266 (default app) May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51267]: WSGI app 0 (mountpoint='') ready in 3 seconds on interpreter 0x5602523399e0 pid: 51267 (default app) May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825eb4ac-845d-4f59-a56b-fa1da1448ff3 None None] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825eb4ac-845d-4f59-a56b-fa1da1448ff3 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825eb4ac-845d-4f59-a56b-fa1da1448ff3 None None] PATH_INFO: `/v3` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:18 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1/1] 10.27.203.238 () {50 vars in 791 bytes} [Tue May 28 12:36:18 2024] GET /identity/v3/ => generated 257 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:36:19 l75lg1-v1 dstat.sh[49771]: 28-05 12:36:19| 9 1 89 0 0|1388M 8358M 233M 5723M| 12k 4926B| 0 1064k| 0 52.0 |1886 3057 |1.05 0.70 0.58|1.0 0 62| 0 0 | 0 2048M| 19 5 0 7 0 May 28 12:36:20 l75lg1-v1 dstat.sh[49771]: 28-05 12:36:20| 0 0 100 0 0|1389M 8358M 233M 5723M| 15k 86B| 0 3343k| 0 281 | 850 1141 |1.05 0.70 0.58| 0 0 0| 0 0 | 0 2048M| 19 5 0 7 0 May 28 12:36:21 l75lg1-v1 dstat.sh[49771]: 28-05 12:36:21| 9 2 89 0 0|1428M 8319M 233M 5723M| 15k 698B| 0 6694k| 0 274 |1942 1604 |1.04 0.71 0.58|1.0 0 18| 0 0 | 0 2048M| 19 5 0 7 0 May 28 12:36:22 l75lg1-v1 dstat.sh[49771]: 28-05 12:36:22| 12 2 87 0 0|1462M 8285M 233M 5723M| 11k 86B| 0 4094B| 0 1.00 |2094 3020 |1.04 0.71 0.58|1.0 0 46| 0 0 | 0 2048M| 19 5 0 8 0 May 28 12:36:23 l75lg1-v1 dstat.sh[49771]: 28-05 12:36:23| 9 0 89 1 0|1480M 8267M 233M 5723M| 16k 14k| 0 1437k| 0 71.0 |1859 2526 |1.04 0.71 0.58|1.0 0 1.0| 0 0 | 0 2048M| 19 11 0 7 0 May 28 12:36:24 l75lg1-v1 dstat.sh[49771]: 28-05 12:36:24| 8 1 89 2 0|1399M 8347M 233M 5723M| 20k 12k| 0 1208k| 0 227 |3439 5213 |1.04 0.71 0.58|1.0 0 24| 0 0 | 0 2048M| 19 5 0 9 0 May 28 12:36:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602f2b9c-cef4-4f2b-8c61-ed6506f74b6e None None] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602f2b9c-cef4-4f2b-8c61-ed6506f74b6e None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602f2b9c-cef4-4f2b-8c61-ed6506f74b6e None None] PATH_INFO: `/` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:25 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1/2] 10.27.203.238 () {54 vars in 926 bytes} [Tue May 28 12:36:25 2024] GET /identity => generated 272 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 236 bytes (2 switches on core 0) May 28 12:36:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d93a57-938a-4abf-8b62-01120d74af16 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d93a57-938a-4abf-8b62-01120d74af16 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d93a57-938a-4abf-8b62-01120d74af16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:25 l75lg1-v1 dstat.sh[49771]: 28-05 12:36:25| 9 1 89 0 0|1440M 8306M 233M 5723M| 14k 86B| 0 8183B| 0 2.00 |1172 1309 |1.04 0.71 0.58|1.0 0 0| 0 0 | 0 2048M| 19 6 0 9 0 May 28 12:36:25 l75lg1-v1 devstack@keystone.service[51266]: INFO dbcounter [None req-b3d93a57-938a-4abf-8b62-01120d74af16 None None] Registered counter for database keystone May 28 12:36:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG oslo_db.sqlalchemy.engines [None req-b3d93a57-938a-4abf-8b62-01120d74af16 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=51266) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:342}} May 28 12:36:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG dbcounter [-] [51266] Writer thread running {{(pid=51266) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} May 28 12:36:25 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-b3d93a57-938a-4abf-8b62-01120d74af16 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:36:25 l75lg1-v1 devstack@keystone.service[51266]: WARNING passlib.handlers.bcrypt [None req-b3d93a57-938a-4abf-8b62-01120d74af16 None None] (trapped) error reading bcrypt version: AttributeError: module 'bcrypt' has no attribute '__about__' May 28 12:36:25 l75lg1-v1 devstack@keystone.service[51266]: ERROR passlib.handlers.bcrypt Traceback (most recent call last): May 28 12:36:25 l75lg1-v1 devstack@keystone.service[51266]: ERROR passlib.handlers.bcrypt File "/opt/stack/data/venv/lib/python3.10/site-packages/passlib/handlers/bcrypt.py", line 620, in _load_backend_mixin May 28 12:36:25 l75lg1-v1 devstack@keystone.service[51266]: ERROR passlib.handlers.bcrypt version = _bcrypt.__about__.__version__ May 28 12:36:25 l75lg1-v1 devstack@keystone.service[51266]: ERROR passlib.handlers.bcrypt AttributeError: module 'bcrypt' has no attribute '__about__' May 28 12:36:25 l75lg1-v1 devstack@keystone.service[51266]: ERROR passlib.handlers.bcrypt May 28 12:36:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG passlib.handlers.bcrypt [None req-b3d93a57-938a-4abf-8b62-01120d74af16 None None] detected 'bcrypt' backend, version '' {{(pid=51266) _load_backend_mixin /opt/stack/data/venv/lib/python3.10/site-packages/passlib/handlers/bcrypt.py:625}} May 28 12:36:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG passlib.handlers.bcrypt [None req-b3d93a57-938a-4abf-8b62-01120d74af16 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=51266) _finalize_backend_mixin /opt/stack/data/venv/lib/python3.10/site-packages/passlib/handlers/bcrypt.py:406}} May 28 12:36:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-b3d93a57-938a-4abf-8b62-01120d74af16 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:36:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-b3d93a57-938a-4abf-8b62-01120d74af16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:36:25 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 2/3] 10.27.203.238 () {58 vars in 1023 bytes} [Tue May 28 12:36:25 2024] POST /identity/v3/auth/tokens => generated 979 bytes in 374 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 28 12:36:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602f2b9c-cef4-4f2b-8c61-ed6506f74b6e None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:25 l75lg1-v1 devstack@keystone.service[51267]: INFO dbcounter [None req-602f2b9c-cef4-4f2b-8c61-ed6506f74b6e None None] Registered counter for database keystone May 28 12:36:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG oslo_db.sqlalchemy.engines [None req-602f2b9c-cef4-4f2b-8c61-ed6506f74b6e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=51267) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:342}} May 28 12:36:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG dbcounter [-] [51267] Writer thread running {{(pid=51267) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} May 28 12:36:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602f2b9c-cef4-4f2b-8c61-ed6506f74b6e None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc3a917-a2e2-4043-9848-b92d0f4fa965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8d517cde1d40bb82c97e080ce071f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc3a917-a2e2-4043-9848-b92d0f4fa965 admin admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc3a917-a2e2-4043-9848-b92d0f4fa965 admin admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc3a917-a2e2-4043-9848-b92d0f4fa965 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc3a917-a2e2-4043-9848-b92d0f4fa965 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:36:26 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.rbac_enforcer.enforcer [None req-9dc3a917-a2e2-4043-9848-b92d0f4fa965 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 28 12:36:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc3a917-a2e2-4043-9848-b92d0f4fa965 admin admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:36:26 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 2/4] 10.27.203.238 () {58 vars in 1324 bytes} [Tue May 28 12:36:25 2024] GET /identity/v3/auth/tokens => generated 979 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 28 12:36:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d93a57-938a-4abf-8b62-01120d74af16 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d93a57-938a-4abf-8b62-01120d74af16 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c466d6-2526-4197-9504-2f6ae4540fb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8d517cde1d40bb82c97e080ce071f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c466d6-2526-4197-9504-2f6ae4540fb9 admin admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c466d6-2526-4197-9504-2f6ae4540fb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c466d6-2526-4197-9504-2f6ae4540fb9 admin admin] PATH_INFO: `/v3/projects/ea8d517cde1d40bb82c97e080ce071f7` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c466d6-2526-4197-9504-2f6ae4540fb9 admin admin] RBAC: Authorizing `identity:get_project(project_id=ea8d517cde1d40bb82c97e080ce071f7)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:36:26 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.rbac_enforcer.enforcer [None req-d2c466d6-2526-4197-9504-2f6ae4540fb9 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 28 12:36:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c466d6-2526-4197-9504-2f6ae4540fb9 admin admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:36:26 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 3/5] 10.27.203.238 () {56 vars in 1207 bytes} [Tue May 28 12:36:26 2024] GET /identity/v3/projects/ea8d517cde1d40bb82c97e080ce071f7 => generated 346 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:36:26 l75lg1-v1 dstat.sh[49771]: 28-05 12:36:26| 10 1 88 2 0|1452M 8293M 234M 5724M| 13k 86B| 228k 4040k|57.1 151 |2569 3521 |1.04 0.71 0.59|1.0 0 3.0| 0 0 | 0 2048M| 19 29 0 9 0 May 28 12:36:27 l75lg1-v1 dstat.sh[49771]: 28-05 12:36:27| 9 1 90 0 0|1447M 8299M 234M 5724M| 15k 1676B| 0 124k| 0 18.0 |1425 1681 |1.04 0.71 0.59|1.0 0 25| 0 0 | 0 2048M| 19 29 0 9 0 May 28 12:36:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a82c1b2-f15f-4bd0-9fe9-9c2cd9dc57af None None] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a82c1b2-f15f-4bd0-9fe9-9c2cd9dc57af None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a82c1b2-f15f-4bd0-9fe9-9c2cd9dc57af None None] PATH_INFO: `/` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:27 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 3/6] 10.27.203.238 () {54 vars in 926 bytes} [Tue May 28 12:36:27 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:36:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a42913-cb1c-46ea-89b3-33fa320ae6c7 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a42913-cb1c-46ea-89b3-33fa320ae6c7 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a42913-cb1c-46ea-89b3-33fa320ae6c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:27 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-42a42913-cb1c-46ea-89b3-33fa320ae6c7 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:36:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-42a42913-cb1c-46ea-89b3-33fa320ae6c7 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:36:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-42a42913-cb1c-46ea-89b3-33fa320ae6c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:36:27 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 4/7] 10.27.203.238 () {58 vars in 1023 bytes} [Tue May 28 12:36:27 2024] POST /identity/v3/auth/tokens => generated 979 bytes in 23 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 28 12:36:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a82c1b2-f15f-4bd0-9fe9-9c2cd9dc57af None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a82c1b2-f15f-4bd0-9fe9-9c2cd9dc57af None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86c0d91-d81c-45f7-8ed8-96b7cd61e015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8d517cde1d40bb82c97e080ce071f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86c0d91-d81c-45f7-8ed8-96b7cd61e015 admin admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86c0d91-d81c-45f7-8ed8-96b7cd61e015 admin admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86c0d91-d81c-45f7-8ed8-96b7cd61e015 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86c0d91-d81c-45f7-8ed8-96b7cd61e015 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:36:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86c0d91-d81c-45f7-8ed8-96b7cd61e015 admin admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:36:27 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 4/8] 10.27.203.238 () {58 vars in 1324 bytes} [Tue May 28 12:36:27 2024] GET /identity/v3/auth/tokens => generated 979 bytes in 20 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 28 12:36:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a42913-cb1c-46ea-89b3-33fa320ae6c7 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a42913-cb1c-46ea-89b3-33fa320ae6c7 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2ab7d3-d995-4636-bb5a-d0aa7299c1e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8d517cde1d40bb82c97e080ce071f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2ab7d3-d995-4636-bb5a-d0aa7299c1e6 admin admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2ab7d3-d995-4636-bb5a-d0aa7299c1e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2ab7d3-d995-4636-bb5a-d0aa7299c1e6 admin admin] PATH_INFO: `/v3/users/e48f0d07e6644786b1da9213d53cc1e1` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2ab7d3-d995-4636-bb5a-d0aa7299c1e6 admin admin] RBAC: Authorizing `identity:get_user(user_id=e48f0d07e6644786b1da9213d53cc1e1)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:36:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2ab7d3-d995-4636-bb5a-d0aa7299c1e6 admin admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:36:27 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 5/9] 10.27.203.238 () {56 vars in 1198 bytes} [Tue May 28 12:36:27 2024] GET /identity/v3/users/e48f0d07e6644786b1da9213d53cc1e1 => generated 249 bytes in 10 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:36:28 l75lg1-v1 dstat.sh[49771]: 28-05 12:36:28| 12 2 86 0 0|1435M 8311M 234M 5724M| 20k 4006B| 0 16k| 0 4.00 |2429 2641 |1.04 0.71 0.59|2.0 0 120| 0 0 | 0 2048M| 19 29 0 9 0 May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd1418e-e245-4b89-a71d-6a4a32f7583f None None] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd1418e-e245-4b89-a71d-6a4a32f7583f None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd1418e-e245-4b89-a71d-6a4a32f7583f None None] PATH_INFO: `/` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 5/10] 10.27.203.238 () {54 vars in 926 bytes} [Tue May 28 12:36:29 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e563a614-9497-485d-a6f4-ace2b62be24f None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e563a614-9497-485d-a6f4-ace2b62be24f None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e563a614-9497-485d-a6f4-ace2b62be24f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-e563a614-9497-485d-a6f4-ace2b62be24f None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-e563a614-9497-485d-a6f4-ace2b62be24f None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-e563a614-9497-485d-a6f4-ace2b62be24f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9157dc27-2580-4614-9fe2-9ea94671d606 None None] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9157dc27-2580-4614-9fe2-9ea94671d606 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9157dc27-2580-4614-9fe2-9ea94671d606 None None] PATH_INFO: `/` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 6/11] 10.27.203.238 () {54 vars in 926 bytes} [Tue May 28 12:36:29 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061687c4-14cd-49ef-a645-9f7f31a06124 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061687c4-14cd-49ef-a645-9f7f31a06124 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061687c4-14cd-49ef-a645-9f7f31a06124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 6/12] 10.27.203.238 () {58 vars in 1023 bytes} [Tue May 28 12:36:29 2024] POST /identity/v3/auth/tokens => generated 864 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-061687c4-14cd-49ef-a645-9f7f31a06124 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51267]: WARNING passlib.handlers.bcrypt [None req-061687c4-14cd-49ef-a645-9f7f31a06124 None None] (trapped) error reading bcrypt version: AttributeError: module 'bcrypt' has no attribute '__about__' May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR passlib.handlers.bcrypt Traceback (most recent call last): May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR passlib.handlers.bcrypt File "/opt/stack/data/venv/lib/python3.10/site-packages/passlib/handlers/bcrypt.py", line 620, in _load_backend_mixin May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR passlib.handlers.bcrypt version = _bcrypt.__about__.__version__ May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR passlib.handlers.bcrypt AttributeError: module 'bcrypt' has no attribute '__about__' May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR passlib.handlers.bcrypt May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG passlib.handlers.bcrypt [None req-061687c4-14cd-49ef-a645-9f7f31a06124 None None] detected 'bcrypt' backend, version '' {{(pid=51267) _load_backend_mixin /opt/stack/data/venv/lib/python3.10/site-packages/passlib/handlers/bcrypt.py:625}} May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG passlib.handlers.bcrypt [None req-061687c4-14cd-49ef-a645-9f7f31a06124 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=51267) _finalize_backend_mixin /opt/stack/data/venv/lib/python3.10/site-packages/passlib/handlers/bcrypt.py:406}} May 28 12:36:29 l75lg1-v1 dstat.sh[49771]: 28-05 12:36:29| 18 1 80 0 0|1512M 8233M 234M 5724M| 12k 86B| 0 124k| 0 6.00 |1648 1953 |1.04 0.71 0.59|2.0 0 0| 0 0 | 0 2048M| 19 30 0 9 0 May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-061687c4-14cd-49ef-a645-9f7f31a06124 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-061687c4-14cd-49ef-a645-9f7f31a06124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 7/13] 10.27.203.238 () {58 vars in 1023 bytes} [Tue May 28 12:36:29 2024] POST /identity/v3/auth/tokens => generated 864 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e563a614-9497-485d-a6f4-ace2b62be24f None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e563a614-9497-485d-a6f4-ace2b62be24f None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a084d46-a0a5-4672-8b67-0ee24ce1094f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a084d46-a0a5-4672-8b67-0ee24ce1094f None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a084d46-a0a5-4672-8b67-0ee24ce1094f None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a084d46-a0a5-4672-8b67-0ee24ce1094f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a084d46-a0a5-4672-8b67-0ee24ce1094f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-5a084d46-a0a5-4672-8b67-0ee24ce1094f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._get_role(role_id) May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1281, in get_role May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 7/14] 10.27.203.238 () {56 vars in 1096 bytes} [Tue May 28 12:36:29 2024] GET /identity/v3/roles/admin => generated 83 bytes in 93 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061687c4-14cd-49ef-a645-9f7f31a06124 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061687c4-14cd-49ef-a645-9f7f31a06124 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a084d46-a0a5-4672-8b67-0ee24ce1094f None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffb9180-6b35-4ade-b5a5-8cb573d4d542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffb9180-6b35-4ade-b5a5-8cb573d4d542 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffb9180-6b35-4ade-b5a5-8cb573d4d542 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffb9180-6b35-4ade-b5a5-8cb573d4d542 None admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffb9180-6b35-4ade-b5a5-8cb573d4d542 None admin] RBAC: Adding query filter params (name=admin) {{(pid=51267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffb9180-6b35-4ade-b5a5-8cb573d4d542 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffb9180-6b35-4ade-b5a5-8cb573d4d542 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 8/15] 10.27.203.238 () {56 vars in 1099 bytes} [Tue May 28 12:36:29 2024] GET /identity/v3/roles?name=admin => generated 343 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffb9180-6b35-4ade-b5a5-8cb573d4d542 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a084d46-a0a5-4672-8b67-0ee24ce1094f None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffb9180-6b35-4ade-b5a5-8cb573d4d542 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f98793-dfb9-4c61-b709-a8fb8bca4d36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f98793-dfb9-4c61-b709-a8fb8bca4d36 None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f98793-dfb9-4c61-b709-a8fb8bca4d36 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f98793-dfb9-4c61-b709-a8fb8bca4d36 None admin] PATH_INFO: `/v3/domains` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f98793-dfb9-4c61-b709-a8fb8bca4d36 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f98793-dfb9-4c61-b709-a8fb8bca4d36 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efa0b4f-7de2-4b13-bcc7-8a7d34003b09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efa0b4f-7de2-4b13-bcc7-8a7d34003b09 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efa0b4f-7de2-4b13-bcc7-8a7d34003b09 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efa0b4f-7de2-4b13-bcc7-8a7d34003b09 None admin] PATH_INFO: `/v3/users/e48f0d07e6644786b1da9213d53cc1e1` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.sql.core [None req-59f98793-dfb9-4c61-b709-a8fb8bca4d36 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: [parameters: {'id': 'c6b594c5347a41bebc7e8f649192b97b', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: (Background on this error at: https://sqlalche.me/e/20/gkpj) {{(pid=51266) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efa0b4f-7de2-4b13-bcc7-8a7d34003b09 None admin] RBAC: Authorizing `identity:get_user(user_id=e48f0d07e6644786b1da9213d53cc1e1)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efa0b4f-7de2-4b13-bcc7-8a7d34003b09 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 9/16] 10.27.203.238 () {56 vars in 1177 bytes} [Tue May 28 12:36:29 2024] GET /identity/v3/users/e48f0d07e6644786b1da9213d53cc1e1 => generated 249 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efa0b4f-7de2-4b13-bcc7-8a7d34003b09 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-59f98793-dfb9-4c61-b709-a8fb8bca4d36 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1967, in _exec_single_context May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application self.dialect.do_execute( May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 924, in do_execute May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/pymysql/cursors.py", line 153, in execute May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application result = self._query(query) May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/pymysql/cursors.py", line 322, in _query May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application conn.query(q) May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/pymysql/connections.py", line 558, in query May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/pymysql/connections.py", line 822, in _read_query_result May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application result.read() May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/pymysql/connections.py", line 1200, in read May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/pymysql/connections.py", line 772, in _read_packet May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application packet.raise_for_error() May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/pymysql/protocol.py", line 221, in raise_for_error May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/pymysql/err.py", line 143, in raise_mysql_exception May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 234, in create_project May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with sql.session_for_write() as session: May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application next(self.gen) May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/enginefacade.py", line 1042, in _transaction_scope May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with current._produce_block( May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application next(self.gen) May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/enginefacade.py", line 649, in _session May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with excutils.save_and_reraise_exception(): May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__ May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application self.force_reraise() May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise self.value May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/enginefacade.py", line 647, in _session May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/enginefacade.py", line 675, in _end_session_transaction May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application session.commit() May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2017, in commit May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application trans.commit(_to_root=True) May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "", line 2, in commit May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/sqlalchemy/orm/state_changes.py", line 139, in _go May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ret_value = fn(self, *arg, **kw) May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1302, in commit May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application self._prepare_impl() May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "", line 2, in _prepare_impl May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/sqlalchemy/orm/state_changes.py", line 139, in _go May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ret_value = fn(self, *arg, **kw) May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1277, in _prepare_impl May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application self.session.flush() May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 4341, in flush May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application self._flush(objects) May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 4476, in _flush May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with util.safe_reraise(): May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 146, in __exit__ May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exc_value.with_traceback(exc_tb) May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 4437, in _flush May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application flush_context.execute() May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 466, in execute May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rec.execute(self) May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 642, in execute May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 93, in save_obj May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application _emit_insert_statements( May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1048, in _emit_insert_statements May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application result = connection.execute( May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1418, in execute May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return meth( May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 515, in _execute_on_connection May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1640, in _execute_clauseelement May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ret = self._execute_context( May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1846, in _execute_context May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._exec_single_context( May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1986, in _exec_single_context May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 2350, in _handle_dbapi_exception May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise newraise.with_traceback(exc_info[2]) from e May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1967, in _exec_single_context May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application self.dialect.do_execute( May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 924, in do_execute May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/pymysql/cursors.py", line 153, in execute May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application result = self._query(query) May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/pymysql/cursors.py", line 322, in _query May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application conn.query(q) May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/pymysql/connections.py", line 558, in query May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/pymysql/connections.py", line 822, in _read_query_result May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application result.read() May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/pymysql/connections.py", line 1200, in read May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/pymysql/connections.py", line 772, in _read_packet May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application packet.raise_for_error() May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/pymysql/protocol.py", line 221, in raise_for_error May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/pymysql/err.py", line 143, in raise_mysql_exception May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [parameters: {'id': 'c6b594c5347a41bebc7e8f649192b97b', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/20/gkpj) May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name Default. May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 139, in post May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application is_domain_project = self.create_project( May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.Conflict( May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 8/17] 10.27.203.238 () {60 vars in 1137 bytes} [Tue May 28 12:36:29 2024] POST /identity/v3/domains => generated 190 bytes in 113 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f98793-dfb9-4c61-b709-a8fb8bca4d36 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efa0b4f-7de2-4b13-bcc7-8a7d34003b09 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f98793-dfb9-4c61-b709-a8fb8bca4d36 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03ccb12-f7af-47c2-9fba-147f1248b0b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03ccb12-f7af-47c2-9fba-147f1248b0b2 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03ccb12-f7af-47c2-9fba-147f1248b0b2 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03ccb12-f7af-47c2-9fba-147f1248b0b2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03ccb12-f7af-47c2-9fba-147f1248b0b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03ccb12-f7af-47c2-9fba-147f1248b0b2 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 10/18] 10.27.203.238 () {56 vars in 1108 bytes} [Tue May 28 12:36:29 2024] GET /identity/v3/domains/default => generated 201 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03ccb12-f7af-47c2-9fba-147f1248b0b2 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d794e95b-3ea3-4ef0-b7d9-faf5ff37ad4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d794e95b-3ea3-4ef0-b7d9-faf5ff37ad4e None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d794e95b-3ea3-4ef0-b7d9-faf5ff37ad4e None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d794e95b-3ea3-4ef0-b7d9-faf5ff37ad4e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d794e95b-3ea3-4ef0-b7d9-faf5ff37ad4e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d794e95b-3ea3-4ef0-b7d9-faf5ff37ad4e None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-d794e95b-3ea3-4ef0-b7d9-faf5ff37ad4e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 9/19] 10.27.203.238 () {56 vars in 1108 bytes} [Tue May 28 12:36:29 2024] GET /identity/v3/domains/Default => generated 87 bytes in 93 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d794e95b-3ea3-4ef0-b7d9-faf5ff37ad4e None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03ccb12-f7af-47c2-9fba-147f1248b0b2 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc48b7c4-2ff2-4d1c-a69e-887950b62545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc48b7c4-2ff2-4d1c-a69e-887950b62545 None admin] REQUEST_METHOD: `PUT` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc48b7c4-2ff2-4d1c-a69e-887950b62545 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc48b7c4-2ff2-4d1c-a69e-887950b62545 None admin] PATH_INFO: `/v3/domains/default/users/e48f0d07e6644786b1da9213d53cc1e1/roles/e7989893488f483baa107be56668c4f8` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc48b7c4-2ff2-4d1c-a69e-887950b62545 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=e48f0d07e6644786b1da9213d53cc1e1, role_id=e7989893488f483baa107be56668c4f8)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc48b7c4-2ff2-4d1c-a69e-887950b62545 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d794e95b-3ea3-4ef0-b7d9-faf5ff37ad4e None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a226e3b-8afd-478a-aa89-bb7f836c6d42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a226e3b-8afd-478a-aa89-bb7f836c6d42 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a226e3b-8afd-478a-aa89-bb7f836c6d42 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a226e3b-8afd-478a-aa89-bb7f836c6d42 None admin] PATH_INFO: `/v3/domains` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a226e3b-8afd-478a-aa89-bb7f836c6d42 None admin] RBAC: Adding query filter params (name=Default) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a226e3b-8afd-478a-aa89-bb7f836c6d42 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a226e3b-8afd-478a-aa89-bb7f836c6d42 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 10/20] 10.27.203.238 () {56 vars in 1109 bytes} [Tue May 28 12:36:29 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 28 12:36:29 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 11/21] 10.27.203.238 () {58 vars in 1361 bytes} [Tue May 28 12:36:29 2024] PUT /identity/v3/domains/default/users/e48f0d07e6644786b1da9213d53cc1e1/roles/e7989893488f483baa107be56668c4f8 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 28 12:36:30 l75lg1-v1 dstat.sh[49771]: 28-05 12:36:30| 19 4 76 0 0|1423M 8322M 234M 5724M| 15k 3284B| 0 1659k| 0 89.0 |6139 10k|1.04 0.71 0.59|4.0 0 204| 0 0 | 0 2048M| 19 29 0 9 0 May 28 12:36:31 l75lg1-v1 dstat.sh[49771]: 28-05 12:36:31| 49 9 42 0 0|1675M 8070M 234M 5724M| 17k 5141B| 0 132k| 0 11.0 |3359 2791 |1.44 0.80 0.62|6.0 0 224| 0 0 | 0 2048M| 19 29 0 9 0 May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5da446-94aa-422d-a11c-c16f28a1906d None None] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5da446-94aa-422d-a11c-c16f28a1906d None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5da446-94aa-422d-a11c-c16f28a1906d None None] PATH_INFO: `/` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 11/22] 10.27.203.238 () {54 vars in 926 bytes} [Tue May 28 12:36:31 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92e8292-ae21-481b-a6b2-be6e808e478a None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92e8292-ae21-481b-a6b2-be6e808e478a None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92e8292-ae21-481b-a6b2-be6e808e478a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-a92e8292-ae21-481b-a6b2-be6e808e478a None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-a92e8292-ae21-481b-a6b2-be6e808e478a None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-a92e8292-ae21-481b-a6b2-be6e808e478a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9b88f1-65fb-402c-a182-9db945595c11 None None] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9b88f1-65fb-402c-a182-9db945595c11 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9b88f1-65fb-402c-a182-9db945595c11 None None] PATH_INFO: `/` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 12/23] 10.27.203.238 () {54 vars in 926 bytes} [Tue May 28 12:36:31 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa8e731-03fb-4302-ac36-975c7e6b1b0d None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa8e731-03fb-4302-ac36-975c7e6b1b0d None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa8e731-03fb-4302-ac36-975c7e6b1b0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-7aa8e731-03fb-4302-ac36-975c7e6b1b0d None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-7aa8e731-03fb-4302-ac36-975c7e6b1b0d None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-7aa8e731-03fb-4302-ac36-975c7e6b1b0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 12/24] 10.27.203.238 () {58 vars in 1023 bytes} [Tue May 28 12:36:31 2024] POST /identity/v3/auth/tokens => generated 864 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 13/25] 10.27.203.238 () {58 vars in 1023 bytes} [Tue May 28 12:36:31 2024] POST /identity/v3/auth/tokens => generated 864 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4a159d-9ce7-4a47-b33e-773c7d4f7dd0 None None] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4a159d-9ce7-4a47-b33e-773c7d4f7dd0 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4a159d-9ce7-4a47-b33e-773c7d4f7dd0 None None] PATH_INFO: `/` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 13/26] 10.27.203.238 () {54 vars in 926 bytes} [Tue May 28 12:36:31 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a133fe-75d2-4888-bd48-9b7655722c71 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a133fe-75d2-4888-bd48-9b7655722c71 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a133fe-75d2-4888-bd48-9b7655722c71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-00a133fe-75d2-4888-bd48-9b7655722c71 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-00a133fe-75d2-4888-bd48-9b7655722c71 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-00a133fe-75d2-4888-bd48-9b7655722c71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4a159d-9ce7-4a47-b33e-773c7d4f7dd0 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 14/27] 10.27.203.238 () {58 vars in 1023 bytes} [Tue May 28 12:36:31 2024] POST /identity/v3/auth/tokens => generated 864 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a133fe-75d2-4888-bd48-9b7655722c71 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4a159d-9ce7-4a47-b33e-773c7d4f7dd0 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a133fe-75d2-4888-bd48-9b7655722c71 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ce6385-c162-48d7-99d5-fd16c00221f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ce6385-c162-48d7-99d5-fd16c00221f7 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ce6385-c162-48d7-99d5-fd16c00221f7 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ce6385-c162-48d7-99d5-fd16c00221f7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ce6385-c162-48d7-99d5-fd16c00221f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e5ed0d-41ef-4ea8-9ae5-8c34f777b2e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e5ed0d-41ef-4ea8-9ae5-8c34f777b2e9 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e5ed0d-41ef-4ea8-9ae5-8c34f777b2e9 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e5ed0d-41ef-4ea8-9ae5-8c34f777b2e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-78ce6385-c162-48d7-99d5-fd16c00221f7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._get_role(role_id) May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1281, in get_role May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 14/28] 10.27.203.238 () {56 vars in 1096 bytes} [Tue May 28 12:36:31 2024] GET /identity/v3/roles/admin => generated 83 bytes in 116 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e5ed0d-41ef-4ea8-9ae5-8c34f777b2e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ce6385-c162-48d7-99d5-fd16c00221f7 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e5ed0d-41ef-4ea8-9ae5-8c34f777b2e9 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-76e5ed0d-41ef-4ea8-9ae5-8c34f777b2e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 15/29] 10.27.203.238 () {56 vars in 1108 bytes} [Tue May 28 12:36:31 2024] GET /identity/v3/domains/Default => generated 87 bytes in 109 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e5ed0d-41ef-4ea8-9ae5-8c34f777b2e9 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ce6385-c162-48d7-99d5-fd16c00221f7 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e5ed0d-41ef-4ea8-9ae5-8c34f777b2e9 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5ea082-2f24-458d-be40-7c2af5d3584c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5ea082-2f24-458d-be40-7c2af5d3584c None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5ea082-2f24-458d-be40-7c2af5d3584c None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5ea082-2f24-458d-be40-7c2af5d3584c None admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5ea082-2f24-458d-be40-7c2af5d3584c None admin] RBAC: Adding query filter params (name=admin) {{(pid=51267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5ea082-2f24-458d-be40-7c2af5d3584c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5ea082-2f24-458d-be40-7c2af5d3584c None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 15/30] 10.27.203.238 () {56 vars in 1099 bytes} [Tue May 28 12:36:31 2024] GET /identity/v3/roles?name=admin => generated 343 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb207d6-e010-4125-97aa-3944f36972d8 None None] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb207d6-e010-4125-97aa-3944f36972d8 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb207d6-e010-4125-97aa-3944f36972d8 None None] PATH_INFO: `/` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 16/31] 10.27.203.238 () {54 vars in 926 bytes} [Tue May 28 12:36:31 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2a0a41-bac7-40cf-b9a6-b05a866fd43d None None] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2a0a41-bac7-40cf-b9a6-b05a866fd43d None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2a0a41-bac7-40cf-b9a6-b05a866fd43d None None] PATH_INFO: `/` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 17/32] 10.27.203.238 () {54 vars in 926 bytes} [Tue May 28 12:36:31 2024] GET /identity => generated 272 bytes in 1 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2a0a41-bac7-40cf-b9a6-b05a866fd43d None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a7769a-c3ac-4da8-a741-a1a3b1f1bb1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a7769a-c3ac-4da8-a741-a1a3b1f1bb1f None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a7769a-c3ac-4da8-a741-a1a3b1f1bb1f None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a7769a-c3ac-4da8-a741-a1a3b1f1bb1f None admin] PATH_INFO: `/v3/domains` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a7769a-c3ac-4da8-a741-a1a3b1f1bb1f None admin] RBAC: Adding query filter params (name=Default) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a7769a-c3ac-4da8-a741-a1a3b1f1bb1f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a7769a-c3ac-4da8-a741-a1a3b1f1bb1f None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 16/33] 10.27.203.238 () {56 vars in 1109 bytes} [Tue May 28 12:36:31 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9f5e6d-a9f3-4bd6-a80d-dd36527925b8 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9f5e6d-a9f3-4bd6-a80d-dd36527925b8 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9f5e6d-a9f3-4bd6-a80d-dd36527925b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-cf9f5e6d-a9f3-4bd6-a80d-dd36527925b8 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-cf9f5e6d-a9f3-4bd6-a80d-dd36527925b8 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-cf9f5e6d-a9f3-4bd6-a80d-dd36527925b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2a0a41-bac7-40cf-b9a6-b05a866fd43d None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa98066-5823-496d-b1f7-d06c224e9ddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa98066-5823-496d-b1f7-d06c224e9ddf None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa98066-5823-496d-b1f7-d06c224e9ddf None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa98066-5823-496d-b1f7-d06c224e9ddf None admin] PATH_INFO: `/v3/users/e48f0d07e6644786b1da9213d53cc1e1` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa98066-5823-496d-b1f7-d06c224e9ddf None admin] RBAC: Authorizing `identity:get_user(user_id=e48f0d07e6644786b1da9213d53cc1e1)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa98066-5823-496d-b1f7-d06c224e9ddf None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 18/34] 10.27.203.238 () {56 vars in 1177 bytes} [Tue May 28 12:36:31 2024] GET /identity/v3/users/e48f0d07e6644786b1da9213d53cc1e1 => generated 249 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5a8c88-6cae-419e-9feb-6b86b4f8f5b9 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5a8c88-6cae-419e-9feb-6b86b4f8f5b9 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5a8c88-6cae-419e-9feb-6b86b4f8f5b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 17/35] 10.27.203.238 () {58 vars in 1023 bytes} [Tue May 28 12:36:31 2024] POST /identity/v3/auth/tokens => generated 864 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9f5e6d-a9f3-4bd6-a80d-dd36527925b8 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-de5a8c88-6cae-419e-9feb-6b86b4f8f5b9 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-de5a8c88-6cae-419e-9feb-6b86b4f8f5b9 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-de5a8c88-6cae-419e-9feb-6b86b4f8f5b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9f5e6d-a9f3-4bd6-a80d-dd36527925b8 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 19/36] 10.27.203.238 () {58 vars in 1023 bytes} [Tue May 28 12:36:31 2024] POST /identity/v3/auth/tokens => generated 864 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5a8c88-6cae-419e-9feb-6b86b4f8f5b9 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ff7078-fd11-4781-a510-ed0a80b126b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ff7078-fd11-4781-a510-ed0a80b126b9 None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ff7078-fd11-4781-a510-ed0a80b126b9 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ff7078-fd11-4781-a510-ed0a80b126b9 None admin] PATH_INFO: `/v3/roles` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ff7078-fd11-4781-a510-ed0a80b126b9 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ff7078-fd11-4781-a510-ed0a80b126b9 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.sql.core [None req-b2ff7078-fd11-4781-a510-ed0a80b126b9 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'service-<>' for key 'role.ixu_role_name_domain_id'") May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: [parameters: {'id': '660188a3321e4e0693b2b623860fa532', 'name': 'service', 'description': None, 'extra': '{}'}] May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: (Background on this error at: https://sqlalche.me/e/20/gkpj) {{(pid=51266) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-b2ff7078-fd11-4781-a510-ed0a80b126b9 None admin] Conflict occurred attempting to store role - Duplicate entry found with name service.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name service. May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1967, in _exec_single_context May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application self.dialect.do_execute( May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 924, in do_execute May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/pymysql/cursors.py", line 153, in execute May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application result = self._query(query) May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/pymysql/cursors.py", line 322, in _query May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application conn.query(q) May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/pymysql/connections.py", line 558, in query May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/pymysql/connections.py", line 822, in _read_query_result May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application result.read() May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/pymysql/connections.py", line 1200, in read May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/pymysql/connections.py", line 772, in _read_packet May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application packet.raise_for_error() May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/pymysql/protocol.py", line 221, in raise_for_error May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/pymysql/err.py", line 143, in raise_mysql_exception May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'service-<>' for key 'role.ixu_role_name_domain_id'") May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 26, in create_role May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with sql.session_for_write() as session: May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application next(self.gen) May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/enginefacade.py", line 1042, in _transaction_scope May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with current._produce_block( May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application next(self.gen) May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/enginefacade.py", line 649, in _session May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with excutils.save_and_reraise_exception(): May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__ May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application self.force_reraise() May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise self.value May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/enginefacade.py", line 647, in _session May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/enginefacade.py", line 675, in _end_session_transaction May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application session.commit() May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2017, in commit May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application trans.commit(_to_root=True) May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "", line 2, in commit May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/sqlalchemy/orm/state_changes.py", line 139, in _go May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ret_value = fn(self, *arg, **kw) May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1302, in commit May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application self._prepare_impl() May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "", line 2, in _prepare_impl May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/sqlalchemy/orm/state_changes.py", line 139, in _go May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ret_value = fn(self, *arg, **kw) May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1277, in _prepare_impl May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application self.session.flush() May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 4341, in flush May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application self._flush(objects) May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 4476, in _flush May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with util.safe_reraise(): May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 146, in __exit__ May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exc_value.with_traceback(exc_tb) May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 4437, in _flush May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application flush_context.execute() May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 466, in execute May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rec.execute(self) May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 642, in execute May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 93, in save_obj May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application _emit_insert_statements( May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1048, in _emit_insert_statements May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application result = connection.execute( May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1418, in execute May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return meth( May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 515, in _execute_on_connection May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1640, in _execute_clauseelement May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ret = self._execute_context( May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1846, in _execute_context May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._exec_single_context( May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1986, in _exec_single_context May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 2350, in _handle_dbapi_exception May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise newraise.with_traceback(exc_info[2]) from e May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1967, in _exec_single_context May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application self.dialect.do_execute( May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 924, in do_execute May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/pymysql/cursors.py", line 153, in execute May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application result = self._query(query) May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/pymysql/cursors.py", line 322, in _query May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application conn.query(q) May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/pymysql/connections.py", line 558, in query May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/pymysql/connections.py", line 822, in _read_query_result May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application result.read() May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/pymysql/connections.py", line 1200, in read May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/pymysql/connections.py", line 772, in _read_packet May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application packet.raise_for_error() May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/pymysql/protocol.py", line 221, in raise_for_error May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/pymysql/err.py", line 143, in raise_mysql_exception May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'service-<>' for key 'role.ixu_role_name_domain_id'") May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [parameters: {'id': '660188a3321e4e0693b2b623860fa532', 'name': 'service', 'description': None, 'extra': '{}'}] May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/20/gkpj) May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1303, in create_role May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name service. May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 18/37] 10.27.203.238 () {60 vars in 1131 bytes} [Tue May 28 12:36:31 2024] POST /identity/v3/roles => generated 140 bytes in 102 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70611e8-c302-49e7-b41d-0cbe2b1778f1 None None] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70611e8-c302-49e7-b41d-0cbe2b1778f1 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70611e8-c302-49e7-b41d-0cbe2b1778f1 None None] PATH_INFO: `/` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 19/38] 10.27.203.238 () {54 vars in 926 bytes} [Tue May 28 12:36:31 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:36:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70611e8-c302-49e7-b41d-0cbe2b1778f1 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5a8c88-6cae-419e-9feb-6b86b4f8f5b9 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e52c7e9-559f-4e87-8ff9-fcee4a16b9ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70611e8-c302-49e7-b41d-0cbe2b1778f1 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e52c7e9-559f-4e87-8ff9-fcee4a16b9ac None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e52c7e9-559f-4e87-8ff9-fcee4a16b9ac None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e52c7e9-559f-4e87-8ff9-fcee4a16b9ac None admin] PATH_INFO: `/v3/projects` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e52c7e9-559f-4e87-8ff9-fcee4a16b9ac None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:36:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e52c7e9-559f-4e87-8ff9-fcee4a16b9ac None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:36:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee8840e-1368-4347-8245-5933a1c4d3f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee8840e-1368-4347-8245-5933a1c4d3f6 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee8840e-1368-4347-8245-5933a1c4d3f6 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee8840e-1368-4347-8245-5933a1c4d3f6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee8840e-1368-4347-8245-5933a1c4d3f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:36:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee8840e-1368-4347-8245-5933a1c4d3f6 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:36:32 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 20/39] 10.27.203.238 () {56 vars in 1108 bytes} [Tue May 28 12:36:31 2024] GET /identity/v3/domains/default => generated 201 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:36:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee8840e-1368-4347-8245-5933a1c4d3f6 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:32 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 20/40] 10.27.203.238 () {60 vars in 1141 bytes} [Tue May 28 12:36:31 2024] POST /identity/v3/projects => generated 303 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:36:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a1487f-f319-48c1-a337-9d39a2e41dbd None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a1487f-f319-48c1-a337-9d39a2e41dbd None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a1487f-f319-48c1-a337-9d39a2e41dbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:32 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-45a1487f-f319-48c1-a337-9d39a2e41dbd None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:36:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-45a1487f-f319-48c1-a337-9d39a2e41dbd None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:36:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-45a1487f-f319-48c1-a337-9d39a2e41dbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:36:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee8840e-1368-4347-8245-5933a1c4d3f6 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0979cc92-d1c1-406f-9e69-ecfe15b2654d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0979cc92-d1c1-406f-9e69-ecfe15b2654d None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0979cc92-d1c1-406f-9e69-ecfe15b2654d None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0979cc92-d1c1-406f-9e69-ecfe15b2654d None admin] PATH_INFO: `/v3/roles/service` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0979cc92-d1c1-406f-9e69-ecfe15b2654d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 28 12:36:32 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 21/41] 10.27.203.238 () {58 vars in 1023 bytes} [Tue May 28 12:36:32 2024] POST /identity/v3/auth/tokens => generated 864 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 28 12:36:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a1487f-f319-48c1-a337-9d39a2e41dbd None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:32 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-0979cc92-d1c1-406f-9e69-ecfe15b2654d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 28 12:36:32 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:36:32 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:36:32 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:36:32 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:36:32 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:36:32 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:36:32 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:36:32 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:36:32 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:36:32 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:36:32 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:36:32 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 28 12:36:32 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._get_role(role_id) May 28 12:36:32 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 28 12:36:32 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 28 12:36:32 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 28 12:36:32 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 28 12:36:32 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 28 12:36:32 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 28 12:36:32 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:36:32 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:36:32 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:36:32 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:36:32 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:36:32 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:36:32 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:36:32 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 12:36:32 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:36:32 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 12:36:32 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:36:32 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:36:32 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:36:32 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 12:36:32 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:36:32 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 12:36:32 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1281, in get_role May 28 12:36:32 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 28 12:36:32 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 28 12:36:32 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 28 12:36:32 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 28 12:36:32 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 28 12:36:32 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 28 12:36:32 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 12:36:32 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 21/42] 10.27.203.238 () {56 vars in 1102 bytes} [Tue May 28 12:36:32 2024] GET /identity/v3/roles/service => generated 85 bytes in 93 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 28 12:36:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0979cc92-d1c1-406f-9e69-ecfe15b2654d None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a1487f-f319-48c1-a337-9d39a2e41dbd None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0979cc92-d1c1-406f-9e69-ecfe15b2654d None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2db33f0-fc01-4783-b9c2-3b1669de4198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:32 l75lg1-v1 dstat.sh[49771]: 28-05 12:36:32| 43 5 51 0 0|1762M 7983M 234M 5724M| 15k 86B| 0 444k| 0 43.0 |7499 14k|1.44 0.80 0.62|4.0 0 0| 0 0 | 0 2048M| 19 33 0 11 0 May 28 12:36:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2db33f0-fc01-4783-b9c2-3b1669de4198 None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2db33f0-fc01-4783-b9c2-3b1669de4198 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2db33f0-fc01-4783-b9c2-3b1669de4198 None admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2db33f0-fc01-4783-b9c2-3b1669de4198 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:36:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2db33f0-fc01-4783-b9c2-3b1669de4198 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:36:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e39598-3be9-4fa3-a22e-d2392179db30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e39598-3be9-4fa3-a22e-d2392179db30 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e39598-3be9-4fa3-a22e-d2392179db30 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e39598-3be9-4fa3-a22e-d2392179db30 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e39598-3be9-4fa3-a22e-d2392179db30 None admin] RBAC: Adding query filter params (role.id=e7989893488f483baa107be56668c4f8, scope.domain.id=default, user.id=e48f0d07e6644786b1da9213d53cc1e1) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:36:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e39598-3be9-4fa3-a22e-d2392179db30 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:36:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e39598-3be9-4fa3-a22e-d2392179db30 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:36:32 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 22/43] 10.27.203.238 () {56 vars in 1322 bytes} [Tue May 28 12:36:32 2024] GET /identity/v3/role_assignments?user.id=e48f0d07e6644786b1da9213d53cc1e1&scope.domain.id=default&role.id=e7989893488f483baa107be56668c4f8 => generated 534 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:36:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e39598-3be9-4fa3-a22e-d2392179db30 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:32 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 22/44] 10.27.203.238 () {60 vars in 1131 bytes} [Tue May 28 12:36:32 2024] POST /identity/v3/roles => generated 227 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:36:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2db33f0-fc01-4783-b9c2-3b1669de4198 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e39598-3be9-4fa3-a22e-d2392179db30 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2db33f0-fc01-4783-b9c2-3b1669de4198 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91a2617-a845-4f21-96e6-ee9af4575a1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91a2617-a845-4f21-96e6-ee9af4575a1f None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91a2617-a845-4f21-96e6-ee9af4575a1f None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91a2617-a845-4f21-96e6-ee9af4575a1f None admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91a2617-a845-4f21-96e6-ee9af4575a1f None admin] RBAC: Adding query filter params (name=service) {{(pid=51267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:36:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91a2617-a845-4f21-96e6-ee9af4575a1f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:36:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91a2617-a845-4f21-96e6-ee9af4575a1f None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:36:32 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 23/45] 10.27.203.238 () {56 vars in 1103 bytes} [Tue May 28 12:36:32 2024] GET /identity/v3/roles?name=service => generated 347 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:36:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91a2617-a845-4f21-96e6-ee9af4575a1f None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91a2617-a845-4f21-96e6-ee9af4575a1f None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaa9cec-a8c8-428a-b9e3-6c7b77255f61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaa9cec-a8c8-428a-b9e3-6c7b77255f61 None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaa9cec-a8c8-428a-b9e3-6c7b77255f61 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaa9cec-a8c8-428a-b9e3-6c7b77255f61 None admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aaa9cec-a8c8-428a-b9e3-6c7b77255f61 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:36:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aaa9cec-a8c8-428a-b9e3-6c7b77255f61 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:36:32 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 24/46] 10.27.203.238 () {60 vars in 1131 bytes} [Tue May 28 12:36:32 2024] POST /identity/v3/roles => generated 225 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:36:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab50ab7c-7cb4-4b5c-b842-95c4ceffcb3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab50ab7c-7cb4-4b5c-b842-95c4ceffcb3c None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab50ab7c-7cb4-4b5c-b842-95c4ceffcb3c None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab50ab7c-7cb4-4b5c-b842-95c4ceffcb3c None admin] PATH_INFO: `/v3/domains/default` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab50ab7c-7cb4-4b5c-b842-95c4ceffcb3c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:36:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab50ab7c-7cb4-4b5c-b842-95c4ceffcb3c None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:36:32 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 23/47] 10.27.203.238 () {56 vars in 1108 bytes} [Tue May 28 12:36:32 2024] GET /identity/v3/domains/default => generated 201 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:36:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaa9cec-a8c8-428a-b9e3-6c7b77255f61 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaa9cec-a8c8-428a-b9e3-6c7b77255f61 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157c708d-8799-49cc-92b8-29fb82a00db8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157c708d-8799-49cc-92b8-29fb82a00db8 None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157c708d-8799-49cc-92b8-29fb82a00db8 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157c708d-8799-49cc-92b8-29fb82a00db8 None admin] PATH_INFO: `/v3/projects` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157c708d-8799-49cc-92b8-29fb82a00db8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:36:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157c708d-8799-49cc-92b8-29fb82a00db8 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:36:32 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 25/48] 10.27.203.238 () {60 vars in 1141 bytes} [Tue May 28 12:36:32 2024] POST /identity/v3/projects => generated 314 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:36:33 l75lg1-v1 dstat.sh[49771]: 28-05 12:36:33| 21 4 75 0 0|1433M 8311M 234M 5724M| 17k 4919B| 0 576k| 0 64.0 |5149 7463 |1.44 0.80 0.62|1.0 0 234| 0 0 | 0 2048M| 19 29 0 11 0 May 28 12:36:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc331b9b-f037-420c-bb8b-cdb8cead13ba None None] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc331b9b-f037-420c-bb8b-cdb8cead13ba None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc331b9b-f037-420c-bb8b-cdb8cead13ba None None] PATH_INFO: `/` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:34 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 24/49] 10.27.203.238 () {54 vars in 926 bytes} [Tue May 28 12:36:34 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:36:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bad11ed-6515-4d67-8ee0-37b7d0f0b2b3 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bad11ed-6515-4d67-8ee0-37b7d0f0b2b3 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bad11ed-6515-4d67-8ee0-37b7d0f0b2b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:34 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-0bad11ed-6515-4d67-8ee0-37b7d0f0b2b3 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:36:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-0bad11ed-6515-4d67-8ee0-37b7d0f0b2b3 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:36:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-0bad11ed-6515-4d67-8ee0-37b7d0f0b2b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:36:34 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 26/50] 10.27.203.238 () {58 vars in 1023 bytes} [Tue May 28 12:36:34 2024] POST /identity/v3/auth/tokens => generated 864 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 28 12:36:34 l75lg1-v1 dstat.sh[49771]: 28-05 12:36:34| 9 1 90 0 0|1471M 8274M 234M 5724M| 17k 86B| 0 344k| 0 12.0 |1497 1929 |1.44 0.80 0.62|1.0 0 0| 0 0 | 0 2048M| 19 29 0 11 0 May 28 12:36:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc331b9b-f037-420c-bb8b-cdb8cead13ba None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc331b9b-f037-420c-bb8b-cdb8cead13ba None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1864a7a-1ea4-4624-a92f-14aa2e383754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1864a7a-1ea4-4624-a92f-14aa2e383754 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1864a7a-1ea4-4624-a92f-14aa2e383754 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1864a7a-1ea4-4624-a92f-14aa2e383754 None admin] PATH_INFO: `/v3/domains/default` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1864a7a-1ea4-4624-a92f-14aa2e383754 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:36:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1864a7a-1ea4-4624-a92f-14aa2e383754 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:36:34 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 25/51] 10.27.203.238 () {56 vars in 1108 bytes} [Tue May 28 12:36:34 2024] GET /identity/v3/domains/default => generated 201 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:36:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bad11ed-6515-4d67-8ee0-37b7d0f0b2b3 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bad11ed-6515-4d67-8ee0-37b7d0f0b2b3 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e350196a-1cc9-4a77-84a0-caca2a506cf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e350196a-1cc9-4a77-84a0-caca2a506cf0 None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e350196a-1cc9-4a77-84a0-caca2a506cf0 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e350196a-1cc9-4a77-84a0-caca2a506cf0 None admin] PATH_INFO: `/v3/projects` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e350196a-1cc9-4a77-84a0-caca2a506cf0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:36:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e350196a-1cc9-4a77-84a0-caca2a506cf0 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:36:34 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 27/52] 10.27.203.238 () {60 vars in 1140 bytes} [Tue May 28 12:36:34 2024] POST /identity/v3/projects => generated 300 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:36:35 l75lg1-v1 dstat.sh[49771]: 28-05 12:36:35| 9 1 89 0 0|1443M 8301M 234M 5724M| 21k 2842B| 0 560k| 0 50.0 |2447 3555 |1.44 0.80 0.62|1.0 0 38| 0 0 | 0 2048M| 19 29 0 11 0 May 28 12:36:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bcaa07-d688-468d-9ebf-26e5853da8f7 None None] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bcaa07-d688-468d-9ebf-26e5853da8f7 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bcaa07-d688-468d-9ebf-26e5853da8f7 None None] PATH_INFO: `/` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:35 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 26/53] 10.27.203.238 () {54 vars in 926 bytes} [Tue May 28 12:36:35 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:36:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405cfa15-eaac-488c-a627-2c083d7e0e74 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405cfa15-eaac-488c-a627-2c083d7e0e74 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405cfa15-eaac-488c-a627-2c083d7e0e74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:35 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-405cfa15-eaac-488c-a627-2c083d7e0e74 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:36:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-405cfa15-eaac-488c-a627-2c083d7e0e74 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:36:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-405cfa15-eaac-488c-a627-2c083d7e0e74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:36:36 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 28/54] 10.27.203.238 () {58 vars in 1023 bytes} [Tue May 28 12:36:35 2024] POST /identity/v3/auth/tokens => generated 864 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 28 12:36:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bcaa07-d688-468d-9ebf-26e5853da8f7 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:36 l75lg1-v1 dstat.sh[49771]: 28-05 12:36:36| 9 1 89 0 0|1473M 8272M 234M 5725M| 17k 0 | 0 2695k| 0 259 |1672 2212 |1.40 0.81 0.62|1.0 0 0| 0 0 | 0 2048M| 19 30 0 11 0 May 28 12:36:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bcaa07-d688-468d-9ebf-26e5853da8f7 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7f3a17-64a7-486d-a039-7e148037c4da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7f3a17-64a7-486d-a039-7e148037c4da None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7f3a17-64a7-486d-a039-7e148037c4da None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7f3a17-64a7-486d-a039-7e148037c4da None admin] PATH_INFO: `/v3/domains/default` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7f3a17-64a7-486d-a039-7e148037c4da None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:36:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7f3a17-64a7-486d-a039-7e148037c4da None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:36:36 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 27/55] 10.27.203.238 () {56 vars in 1108 bytes} [Tue May 28 12:36:36 2024] GET /identity/v3/domains/default => generated 201 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:36:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405cfa15-eaac-488c-a627-2c083d7e0e74 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405cfa15-eaac-488c-a627-2c083d7e0e74 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2a5d14-2924-473f-953f-15214a6fea79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2a5d14-2924-473f-953f-15214a6fea79 None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2a5d14-2924-473f-953f-15214a6fea79 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2a5d14-2924-473f-953f-15214a6fea79 None admin] PATH_INFO: `/v3/users` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2a5d14-2924-473f-953f-15214a6fea79 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:36:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2a5d14-2924-473f-953f-15214a6fea79 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:36:36 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-3f2a5d14-2924-473f-953f-15214a6fea79 None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 12:36:36 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 29/56] 10.27.203.238 () {60 vars in 1132 bytes} [Tue May 28 12:36:36 2024] POST /identity/v3/users => generated 277 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:36:37 l75lg1-v1 dstat.sh[49771]: 28-05 12:36:37| 5 6 88 1 0|1423M 8322M 234M 5725M| 14k 11k| 0 320k| 0 34.0 |4586 5757 |1.40 0.81 0.62|1.0 0 418| 0 0 | 0 2048M| 19 29 0 11 0 May 28 12:36:38 l75lg1-v1 dstat.sh[49771]: 28-05 12:36:38| 31 9 60 0 0|1582M 8162M 234M 5725M| 24k 9056B| 0 268k| 0 23.0 |4188 4250 |1.40 0.81 0.62|5.0 0 442| 0 0 | 0 2048M| 19 29 0 11 0 May 28 12:36:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb461ec8-7eb3-4ea6-91b5-66f06a50c395 None None] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb461ec8-7eb3-4ea6-91b5-66f06a50c395 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb461ec8-7eb3-4ea6-91b5-66f06a50c395 None None] PATH_INFO: `/` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:38 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 28/57] 10.27.203.238 () {54 vars in 926 bytes} [Tue May 28 12:36:38 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:36:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06fbbb6-687e-47c6-ba99-56201ef66558 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06fbbb6-687e-47c6-ba99-56201ef66558 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06fbbb6-687e-47c6-ba99-56201ef66558 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:38 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-a06fbbb6-687e-47c6-ba99-56201ef66558 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:36:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-a06fbbb6-687e-47c6-ba99-56201ef66558 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:36:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-a06fbbb6-687e-47c6-ba99-56201ef66558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:36:38 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 30/58] 10.27.203.238 () {58 vars in 1023 bytes} [Tue May 28 12:36:38 2024] POST /identity/v3/auth/tokens => generated 864 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 28 12:36:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd628b63-3fda-4f1d-a4e4-b5bca72731ce None None] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd628b63-3fda-4f1d-a4e4-b5bca72731ce None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd628b63-3fda-4f1d-a4e4-b5bca72731ce None None] PATH_INFO: `/` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:38 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 29/59] 10.27.203.238 () {54 vars in 926 bytes} [Tue May 28 12:36:38 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:36:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f68634d-7a65-4854-9b37-7fca52430999 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f68634d-7a65-4854-9b37-7fca52430999 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f68634d-7a65-4854-9b37-7fca52430999 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:38 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-5f68634d-7a65-4854-9b37-7fca52430999 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:36:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-5f68634d-7a65-4854-9b37-7fca52430999 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:36:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-5f68634d-7a65-4854-9b37-7fca52430999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:36:38 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 31/60] 10.27.203.238 () {58 vars in 1023 bytes} [Tue May 28 12:36:38 2024] POST /identity/v3/auth/tokens => generated 864 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 28 12:36:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd628b63-3fda-4f1d-a4e4-b5bca72731ce None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ce1b5d-92a2-4bb5-a43f-14569b24841e None None] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ce1b5d-92a2-4bb5-a43f-14569b24841e None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ce1b5d-92a2-4bb5-a43f-14569b24841e None None] PATH_INFO: `/` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:38 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 32/61] 10.27.203.238 () {54 vars in 926 bytes} [Tue May 28 12:36:38 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:36:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b291280e-37d0-4e2d-b859-43bb2f8771f5 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b291280e-37d0-4e2d-b859-43bb2f8771f5 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b291280e-37d0-4e2d-b859-43bb2f8771f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:38 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-b291280e-37d0-4e2d-b859-43bb2f8771f5 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:36:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-b291280e-37d0-4e2d-b859-43bb2f8771f5 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:36:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-b291280e-37d0-4e2d-b859-43bb2f8771f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:36:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd628b63-3fda-4f1d-a4e4-b5bca72731ce None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:38 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 33/62] 10.27.203.238 () {58 vars in 1023 bytes} [Tue May 28 12:36:38 2024] POST /identity/v3/auth/tokens => generated 864 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 28 12:36:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ed4e31-d990-4503-8af6-5e81073fd1b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ed4e31-d990-4503-8af6-5e81073fd1b4 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ed4e31-d990-4503-8af6-5e81073fd1b4 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ed4e31-d990-4503-8af6-5e81073fd1b4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b291280e-37d0-4e2d-b859-43bb2f8771f5 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ed4e31-d990-4503-8af6-5e81073fd1b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 28 12:36:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-b9ed4e31-d990-4503-8af6-5e81073fd1b4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 28 12:36:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:36:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:36:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:36:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:36:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:36:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:36:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:36:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:36:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:36:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:36:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:36:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 28 12:36:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._get_role(role_id) May 28 12:36:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 28 12:36:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 28 12:36:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 28 12:36:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 28 12:36:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 28 12:36:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 28 12:36:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:36:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:36:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:36:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:36:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:36:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:36:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:36:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 12:36:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:36:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 12:36:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:36:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:36:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:36:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 12:36:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:36:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 12:36:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1281, in get_role May 28 12:36:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 28 12:36:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 28 12:36:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 28 12:36:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 28 12:36:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 28 12:36:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 28 12:36:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 12:36:38 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 30/63] 10.27.203.238 () {56 vars in 1099 bytes} [Tue May 28 12:36:38 2024] GET /identity/v3/roles/member => generated 84 bytes in 135 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 28 12:36:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ed4e31-d990-4503-8af6-5e81073fd1b4 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b291280e-37d0-4e2d-b859-43bb2f8771f5 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ed4e31-d990-4503-8af6-5e81073fd1b4 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767ed84b-b79d-4b4a-aa34-0db14d79c08a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767ed84b-b79d-4b4a-aa34-0db14d79c08a None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767ed84b-b79d-4b4a-aa34-0db14d79c08a None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767ed84b-b79d-4b4a-aa34-0db14d79c08a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767ed84b-b79d-4b4a-aa34-0db14d79c08a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-767ed84b-b79d-4b4a-aa34-0db14d79c08a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._get_role(role_id) May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1281, in get_role May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 34/64] 10.27.203.238 () {56 vars in 1096 bytes} [Tue May 28 12:36:38 2024] GET /identity/v3/roles/admin => generated 83 bytes in 101 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bfb4d2-cba7-4a91-ab72-2506f5bdd44a None None] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bfb4d2-cba7-4a91-ab72-2506f5bdd44a None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bfb4d2-cba7-4a91-ab72-2506f5bdd44a None None] PATH_INFO: `/` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 35/65] 10.27.203.238 () {54 vars in 926 bytes} [Tue May 28 12:36:39 2024] GET /identity => generated 272 bytes in 1 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026ab4e3-dc47-4c6a-a275-7ba1ac981c3f None None] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026ab4e3-dc47-4c6a-a275-7ba1ac981c3f None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026ab4e3-dc47-4c6a-a275-7ba1ac981c3f None None] PATH_INFO: `/` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 36/66] 10.27.203.238 () {54 vars in 926 bytes} [Tue May 28 12:36:39 2024] GET /identity => generated 272 bytes in 1 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026ab4e3-dc47-4c6a-a275-7ba1ac981c3f None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b487217-f71b-45d8-8c64-5f2652694729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b487217-f71b-45d8-8c64-5f2652694729 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b487217-f71b-45d8-8c64-5f2652694729 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b487217-f71b-45d8-8c64-5f2652694729 None admin] PATH_INFO: `/v3/roles` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b487217-f71b-45d8-8c64-5f2652694729 None admin] RBAC: Adding query filter params (name=member) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b487217-f71b-45d8-8c64-5f2652694729 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b487217-f71b-45d8-8c64-5f2652694729 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 31/67] 10.27.203.238 () {56 vars in 1101 bytes} [Tue May 28 12:36:38 2024] GET /identity/v3/roles?name=member => generated 345 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df19d7f-3aea-47ce-b092-89ad5ccba5ca None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df19d7f-3aea-47ce-b092-89ad5ccba5ca None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df19d7f-3aea-47ce-b092-89ad5ccba5ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-5df19d7f-3aea-47ce-b092-89ad5ccba5ca None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-5df19d7f-3aea-47ce-b092-89ad5ccba5ca None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-5df19d7f-3aea-47ce-b092-89ad5ccba5ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026ab4e3-dc47-4c6a-a275-7ba1ac981c3f None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb4392b-c295-49ba-a95b-65154046715a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb4392b-c295-49ba-a95b-65154046715a None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb4392b-c295-49ba-a95b-65154046715a None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb4392b-c295-49ba-a95b-65154046715a None admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb4392b-c295-49ba-a95b-65154046715a None admin] RBAC: Adding query filter params (name=admin) {{(pid=51267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb4392b-c295-49ba-a95b-65154046715a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb4392b-c295-49ba-a95b-65154046715a None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 37/68] 10.27.203.238 () {56 vars in 1099 bytes} [Tue May 28 12:36:39 2024] GET /identity/v3/roles?name=admin => generated 343 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69697e71-7ba1-4d7d-97df-95c55ef308d5 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69697e71-7ba1-4d7d-97df-95c55ef308d5 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69697e71-7ba1-4d7d-97df-95c55ef308d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 32/69] 10.27.203.238 () {58 vars in 1023 bytes} [Tue May 28 12:36:39 2024] POST /identity/v3/auth/tokens => generated 864 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df19d7f-3aea-47ce-b092-89ad5ccba5ca None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-69697e71-7ba1-4d7d-97df-95c55ef308d5 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-69697e71-7ba1-4d7d-97df-95c55ef308d5 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-69697e71-7ba1-4d7d-97df-95c55ef308d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df19d7f-3aea-47ce-b092-89ad5ccba5ca None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 38/70] 10.27.203.238 () {58 vars in 1023 bytes} [Tue May 28 12:36:39 2024] POST /identity/v3/auth/tokens => generated 864 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69697e71-7ba1-4d7d-97df-95c55ef308d5 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:39 l75lg1-v1 dstat.sh[49771]: 28-05 12:36:39| 42 4 53 0 0|1706M 8038M 234M 5725M| 16k 172B| 0 496k| 0 30.0 |5323 7908 |1.40 0.81 0.62|4.0 0 0| 0 0 | 0 2048M| 19 32 0 11 0 May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855e6242-040f-4ca8-9192-eb9f95edd1e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855e6242-040f-4ca8-9192-eb9f95edd1e3 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855e6242-040f-4ca8-9192-eb9f95edd1e3 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855e6242-040f-4ca8-9192-eb9f95edd1e3 None admin] PATH_INFO: `/v3/users/2a1747ad86b04cc4aa7bc0b3e4077eaf` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855e6242-040f-4ca8-9192-eb9f95edd1e3 None admin] RBAC: Authorizing `identity:get_user(user_id=2a1747ad86b04cc4aa7bc0b3e4077eaf)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855e6242-040f-4ca8-9192-eb9f95edd1e3 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 33/71] 10.27.203.238 () {56 vars in 1177 bytes} [Tue May 28 12:36:39 2024] GET /identity/v3/users/2a1747ad86b04cc4aa7bc0b3e4077eaf => generated 277 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855e6242-040f-4ca8-9192-eb9f95edd1e3 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69697e71-7ba1-4d7d-97df-95c55ef308d5 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6ac01b-43ae-4779-acd1-3fa122366d9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6ac01b-43ae-4779-acd1-3fa122366d9e None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6ac01b-43ae-4779-acd1-3fa122366d9e None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6ac01b-43ae-4779-acd1-3fa122366d9e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855e6242-040f-4ca8-9192-eb9f95edd1e3 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6ac01b-43ae-4779-acd1-3fa122366d9e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-8d6ac01b-43ae-4779-acd1-3fa122366d9e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._get_role(role_id) May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1281, in get_role May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 39/72] 10.27.203.238 () {56 vars in 1114 bytes} [Tue May 28 12:36:39 2024] GET /identity/v3/roles/anotherrole => generated 89 bytes in 93 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6ac01b-43ae-4779-acd1-3fa122366d9e None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe11f4b-0a95-43b1-b290-d14b1ad61546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe11f4b-0a95-43b1-b290-d14b1ad61546 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe11f4b-0a95-43b1-b290-d14b1ad61546 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe11f4b-0a95-43b1-b290-d14b1ad61546 None admin] PATH_INFO: `/v3/users/e48f0d07e6644786b1da9213d53cc1e1` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe11f4b-0a95-43b1-b290-d14b1ad61546 None admin] RBAC: Authorizing `identity:get_user(user_id=e48f0d07e6644786b1da9213d53cc1e1)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe11f4b-0a95-43b1-b290-d14b1ad61546 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 34/73] 10.27.203.238 () {56 vars in 1177 bytes} [Tue May 28 12:36:39 2024] GET /identity/v3/users/e48f0d07e6644786b1da9213d53cc1e1 => generated 249 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe11f4b-0a95-43b1-b290-d14b1ad61546 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6ac01b-43ae-4779-acd1-3fa122366d9e None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe11f4b-0a95-43b1-b290-d14b1ad61546 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675be45b-cbf3-4677-94d2-1e0cea5b1774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675be45b-cbf3-4677-94d2-1e0cea5b1774 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675be45b-cbf3-4677-94d2-1e0cea5b1774 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675be45b-cbf3-4677-94d2-1e0cea5b1774 None admin] PATH_INFO: `/v3/projects/95de88f6d26e4420bc466ba67668171f` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675be45b-cbf3-4677-94d2-1e0cea5b1774 None admin] RBAC: Authorizing `identity:get_project(project_id=95de88f6d26e4420bc466ba67668171f)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675be45b-cbf3-4677-94d2-1e0cea5b1774 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 40/74] 10.27.203.238 () {56 vars in 1186 bytes} [Tue May 28 12:36:39 2024] GET /identity/v3/projects/95de88f6d26e4420bc466ba67668171f => generated 300 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675be45b-cbf3-4677-94d2-1e0cea5b1774 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a1b684-ac8f-48bf-8afa-427365a17e5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a1b684-ac8f-48bf-8afa-427365a17e5a None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a1b684-ac8f-48bf-8afa-427365a17e5a None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a1b684-ac8f-48bf-8afa-427365a17e5a None admin] PATH_INFO: `/v3/roles` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a1b684-ac8f-48bf-8afa-427365a17e5a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a1b684-ac8f-48bf-8afa-427365a17e5a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a1b684-ac8f-48bf-8afa-427365a17e5a None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 35/75] 10.27.203.238 () {56 vars in 1111 bytes} [Tue May 28 12:36:39 2024] GET /identity/v3/roles?name=anotherrole => generated 338 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a1b684-ac8f-48bf-8afa-427365a17e5a None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675be45b-cbf3-4677-94d2-1e0cea5b1774 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72e8291-e05e-4e31-aa8f-bd1ca0a8e084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72e8291-e05e-4e31-aa8f-bd1ca0a8e084 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72e8291-e05e-4e31-aa8f-bd1ca0a8e084 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72e8291-e05e-4e31-aa8f-bd1ca0a8e084 None admin] PATH_INFO: `/v3/projects/95de88f6d26e4420bc466ba67668171f` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a1b684-ac8f-48bf-8afa-427365a17e5a None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72e8291-e05e-4e31-aa8f-bd1ca0a8e084 None admin] RBAC: Authorizing `identity:get_project(project_id=95de88f6d26e4420bc466ba67668171f)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72e8291-e05e-4e31-aa8f-bd1ca0a8e084 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 41/76] 10.27.203.238 () {56 vars in 1186 bytes} [Tue May 28 12:36:39 2024] GET /identity/v3/projects/95de88f6d26e4420bc466ba67668171f => generated 300 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72e8291-e05e-4e31-aa8f-bd1ca0a8e084 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a4a3aa-b1db-4d79-99b0-49b974897cf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a4a3aa-b1db-4d79-99b0-49b974897cf9 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a4a3aa-b1db-4d79-99b0-49b974897cf9 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a4a3aa-b1db-4d79-99b0-49b974897cf9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a4a3aa-b1db-4d79-99b0-49b974897cf9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-21a4a3aa-b1db-4d79-99b0-49b974897cf9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._get_role(role_id) May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1281, in get_role May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 36/77] 10.27.203.238 () {56 vars in 1099 bytes} [Tue May 28 12:36:39 2024] GET /identity/v3/roles/member => generated 84 bytes in 90 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a4a3aa-b1db-4d79-99b0-49b974897cf9 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72e8291-e05e-4e31-aa8f-bd1ca0a8e084 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa7eaf3-61dc-4f70-9fbf-a599d910a4bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa7eaf3-61dc-4f70-9fbf-a599d910a4bd None admin] REQUEST_METHOD: `PUT` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa7eaf3-61dc-4f70-9fbf-a599d910a4bd None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa7eaf3-61dc-4f70-9fbf-a599d910a4bd None admin] PATH_INFO: `/v3/projects/95de88f6d26e4420bc466ba67668171f/users/2a1747ad86b04cc4aa7bc0b3e4077eaf/roles/44620cad10ae407c90c91e2c296adb04` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa7eaf3-61dc-4f70-9fbf-a599d910a4bd None admin] RBAC: Authorizing `identity:create_grant(project_id=95de88f6d26e4420bc466ba67668171f, user_id=2a1747ad86b04cc4aa7bc0b3e4077eaf, role_id=44620cad10ae407c90c91e2c296adb04)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa7eaf3-61dc-4f70-9fbf-a599d910a4bd None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a4a3aa-b1db-4d79-99b0-49b974897cf9 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 42/78] 10.27.203.238 () {58 vars in 1439 bytes} [Tue May 28 12:36:39 2024] PUT /identity/v3/projects/95de88f6d26e4420bc466ba67668171f/users/2a1747ad86b04cc4aa7bc0b3e4077eaf/roles/44620cad10ae407c90c91e2c296adb04 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa7eaf3-61dc-4f70-9fbf-a599d910a4bd None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49f66d8-f33c-4eec-ae5e-563d00bb7382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49f66d8-f33c-4eec-ae5e-563d00bb7382 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49f66d8-f33c-4eec-ae5e-563d00bb7382 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49f66d8-f33c-4eec-ae5e-563d00bb7382 None admin] PATH_INFO: `/v3/domains/default` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49f66d8-f33c-4eec-ae5e-563d00bb7382 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49f66d8-f33c-4eec-ae5e-563d00bb7382 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 37/79] 10.27.203.238 () {56 vars in 1108 bytes} [Tue May 28 12:36:39 2024] GET /identity/v3/domains/default => generated 201 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49f66d8-f33c-4eec-ae5e-563d00bb7382 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa7eaf3-61dc-4f70-9fbf-a599d910a4bd None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49f66d8-f33c-4eec-ae5e-563d00bb7382 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c67880-19be-4218-9b6e-f057a0240d65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c67880-19be-4218-9b6e-f057a0240d65 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c67880-19be-4218-9b6e-f057a0240d65 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c67880-19be-4218-9b6e-f057a0240d65 None admin] PATH_INFO: `/v3/users/2a1747ad86b04cc4aa7bc0b3e4077eaf` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c67880-19be-4218-9b6e-f057a0240d65 None admin] RBAC: Authorizing `identity:get_user(user_id=2a1747ad86b04cc4aa7bc0b3e4077eaf)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c67880-19be-4218-9b6e-f057a0240d65 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 43/80] 10.27.203.238 () {56 vars in 1177 bytes} [Tue May 28 12:36:39 2024] GET /identity/v3/users/2a1747ad86b04cc4aa7bc0b3e4077eaf => generated 277 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c67880-19be-4218-9b6e-f057a0240d65 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d316e829-1113-4121-b72c-d9e7452603e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d316e829-1113-4121-b72c-d9e7452603e7 None admin] REQUEST_METHOD: `PUT` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d316e829-1113-4121-b72c-d9e7452603e7 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d316e829-1113-4121-b72c-d9e7452603e7 None admin] PATH_INFO: `/v3/projects/95de88f6d26e4420bc466ba67668171f/users/e48f0d07e6644786b1da9213d53cc1e1/roles/e7989893488f483baa107be56668c4f8` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d316e829-1113-4121-b72c-d9e7452603e7 None admin] RBAC: Authorizing `identity:create_grant(project_id=95de88f6d26e4420bc466ba67668171f, user_id=e48f0d07e6644786b1da9213d53cc1e1, role_id=e7989893488f483baa107be56668c4f8)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d316e829-1113-4121-b72c-d9e7452603e7 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c67880-19be-4218-9b6e-f057a0240d65 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c16269a-87b5-444f-a500-12721113ffe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c16269a-87b5-444f-a500-12721113ffe6 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c16269a-87b5-444f-a500-12721113ffe6 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c16269a-87b5-444f-a500-12721113ffe6 None admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c16269a-87b5-444f-a500-12721113ffe6 None admin] RBAC: Adding query filter params (name=member) {{(pid=51267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c16269a-87b5-444f-a500-12721113ffe6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c16269a-87b5-444f-a500-12721113ffe6 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 44/81] 10.27.203.238 () {56 vars in 1101 bytes} [Tue May 28 12:36:39 2024] GET /identity/v3/roles?name=member => generated 345 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c16269a-87b5-444f-a500-12721113ffe6 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c16269a-87b5-444f-a500-12721113ffe6 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 38/82] 10.27.203.238 () {58 vars in 1439 bytes} [Tue May 28 12:36:39 2024] PUT /identity/v3/projects/95de88f6d26e4420bc466ba67668171f/users/e48f0d07e6644786b1da9213d53cc1e1/roles/e7989893488f483baa107be56668c4f8 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d316e829-1113-4121-b72c-d9e7452603e7 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27586a94-bf66-49fb-9cde-01279373ff29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27586a94-bf66-49fb-9cde-01279373ff29 None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27586a94-bf66-49fb-9cde-01279373ff29 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27586a94-bf66-49fb-9cde-01279373ff29 None admin] PATH_INFO: `/v3/users` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27586a94-bf66-49fb-9cde-01279373ff29 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27586a94-bf66-49fb-9cde-01279373ff29 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-27586a94-bf66-49fb-9cde-01279373ff29 None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 45/83] 10.27.203.238 () {60 vars in 1132 bytes} [Tue May 28 12:36:39 2024] POST /identity/v3/users => generated 291 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27586a94-bf66-49fb-9cde-01279373ff29 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d316e829-1113-4121-b72c-d9e7452603e7 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d6e238-b5c1-487e-b78d-af91a51f46c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d6e238-b5c1-487e-b78d-af91a51f46c7 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d6e238-b5c1-487e-b78d-af91a51f46c7 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d6e238-b5c1-487e-b78d-af91a51f46c7 None admin] PATH_INFO: `/v3/projects/95de88f6d26e4420bc466ba67668171f` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d6e238-b5c1-487e-b78d-af91a51f46c7 None admin] RBAC: Authorizing `identity:get_project(project_id=95de88f6d26e4420bc466ba67668171f)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d6e238-b5c1-487e-b78d-af91a51f46c7 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 39/84] 10.27.203.238 () {56 vars in 1186 bytes} [Tue May 28 12:36:39 2024] GET /identity/v3/projects/95de88f6d26e4420bc466ba67668171f => generated 300 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27586a94-bf66-49fb-9cde-01279373ff29 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d6e238-b5c1-487e-b78d-af91a51f46c7 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f41b9a5-b52a-42e7-9c4f-8c9cf26f35f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f41b9a5-b52a-42e7-9c4f-8c9cf26f35f7 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f41b9a5-b52a-42e7-9c4f-8c9cf26f35f7 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f41b9a5-b52a-42e7-9c4f-8c9cf26f35f7 None admin] PATH_INFO: `/v3/users/2a1747ad86b04cc4aa7bc0b3e4077eaf` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f41b9a5-b52a-42e7-9c4f-8c9cf26f35f7 None admin] RBAC: Authorizing `identity:get_user(user_id=2a1747ad86b04cc4aa7bc0b3e4077eaf)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f41b9a5-b52a-42e7-9c4f-8c9cf26f35f7 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 46/85] 10.27.203.238 () {56 vars in 1177 bytes} [Tue May 28 12:36:39 2024] GET /identity/v3/users/2a1747ad86b04cc4aa7bc0b3e4077eaf => generated 277 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f41b9a5-b52a-42e7-9c4f-8c9cf26f35f7 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d6e238-b5c1-487e-b78d-af91a51f46c7 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f41b9a5-b52a-42e7-9c4f-8c9cf26f35f7 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d0716d-696d-45c9-904e-d8968a9d91ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d0716d-696d-45c9-904e-d8968a9d91ea None admin] REQUEST_METHOD: `PUT` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d0716d-696d-45c9-904e-d8968a9d91ea None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d0716d-696d-45c9-904e-d8968a9d91ea None admin] PATH_INFO: `/v3/projects/95de88f6d26e4420bc466ba67668171f/users/2a1747ad86b04cc4aa7bc0b3e4077eaf/roles/67bacc33b83c4fc898309c1e5960a722` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d0716d-696d-45c9-904e-d8968a9d91ea None admin] RBAC: Authorizing `identity:create_grant(project_id=95de88f6d26e4420bc466ba67668171f, user_id=2a1747ad86b04cc4aa7bc0b3e4077eaf, role_id=67bacc33b83c4fc898309c1e5960a722)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:36:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d0716d-696d-45c9-904e-d8968a9d91ea None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:36:40 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 40/86] 10.27.203.238 () {58 vars in 1439 bytes} [Tue May 28 12:36:39 2024] PUT /identity/v3/projects/95de88f6d26e4420bc466ba67668171f/users/2a1747ad86b04cc4aa7bc0b3e4077eaf/roles/67bacc33b83c4fc898309c1e5960a722 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:36:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dff0289-53a8-4066-8ed0-7876a127e1c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dff0289-53a8-4066-8ed0-7876a127e1c4 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dff0289-53a8-4066-8ed0-7876a127e1c4 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dff0289-53a8-4066-8ed0-7876a127e1c4 None admin] PATH_INFO: `/v3/projects/c43e12e502cd4cfcacdcc7e0514c3a93` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dff0289-53a8-4066-8ed0-7876a127e1c4 None admin] RBAC: Authorizing `identity:get_project(project_id=c43e12e502cd4cfcacdcc7e0514c3a93)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:36:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dff0289-53a8-4066-8ed0-7876a127e1c4 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:36:40 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 47/87] 10.27.203.238 () {56 vars in 1186 bytes} [Tue May 28 12:36:39 2024] GET /identity/v3/projects/c43e12e502cd4cfcacdcc7e0514c3a93 => generated 314 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 28 12:36:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d0716d-696d-45c9-904e-d8968a9d91ea None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d0716d-696d-45c9-904e-d8968a9d91ea None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0bb994-3f2e-4995-b96f-5e761b07a2a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0bb994-3f2e-4995-b96f-5e761b07a2a2 None admin] REQUEST_METHOD: `PUT` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0bb994-3f2e-4995-b96f-5e761b07a2a2 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0bb994-3f2e-4995-b96f-5e761b07a2a2 None admin] PATH_INFO: `/v3/projects/c43e12e502cd4cfcacdcc7e0514c3a93/users/2a1747ad86b04cc4aa7bc0b3e4077eaf/roles/44620cad10ae407c90c91e2c296adb04` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0bb994-3f2e-4995-b96f-5e761b07a2a2 None admin] RBAC: Authorizing `identity:create_grant(project_id=c43e12e502cd4cfcacdcc7e0514c3a93, user_id=2a1747ad86b04cc4aa7bc0b3e4077eaf, role_id=44620cad10ae407c90c91e2c296adb04)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:36:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0bb994-3f2e-4995-b96f-5e761b07a2a2 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:36:40 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 41/88] 10.27.203.238 () {58 vars in 1439 bytes} [Tue May 28 12:36:40 2024] PUT /identity/v3/projects/c43e12e502cd4cfcacdcc7e0514c3a93/users/2a1747ad86b04cc4aa7bc0b3e4077eaf/roles/44620cad10ae407c90c91e2c296adb04 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:36:40 l75lg1-v1 dstat.sh[49771]: 28-05 12:36:40| 34 5 60 0 0|1584M 8160M 234M 5725M| 18k 3691B| 0 904k| 0 104 |9575 16k|1.40 0.81 0.62|6.0 0 162| 0 0 | 0 2048M| 19 29 0 11 0 May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b0723d-1042-4b2a-9fde-fa94a3ebe926 None None] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b0723d-1042-4b2a-9fde-fa94a3ebe926 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b0723d-1042-4b2a-9fde-fa94a3ebe926 None None] PATH_INFO: `/` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 48/89] 10.27.203.238 () {54 vars in 926 bytes} [Tue May 28 12:36:41 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca40174-64b1-4fc7-8fb1-6ba9c0cabb8f None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca40174-64b1-4fc7-8fb1-6ba9c0cabb8f None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca40174-64b1-4fc7-8fb1-6ba9c0cabb8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-aca40174-64b1-4fc7-8fb1-6ba9c0cabb8f None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-aca40174-64b1-4fc7-8fb1-6ba9c0cabb8f None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-aca40174-64b1-4fc7-8fb1-6ba9c0cabb8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 42/90] 10.27.203.238 () {58 vars in 1023 bytes} [Tue May 28 12:36:41 2024] POST /identity/v3/auth/tokens => generated 864 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 28 12:36:41 l75lg1-v1 dstat.sh[49771]: 28-05 12:36:41| 55 6 39 0 0|1713M 8031M 234M 5725M| 20k 356B| 0 180k| 0 12.0 |2920 2113 |1.77 0.89 0.65|6.0 0 40| 0 0 | 0 2048M| 19 29 0 11 0 May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3ca369-1775-4ae5-8562-e03dd45a3fed None None] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3ca369-1775-4ae5-8562-e03dd45a3fed None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3ca369-1775-4ae5-8562-e03dd45a3fed None None] PATH_INFO: `/` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 49/91] 10.27.203.238 () {54 vars in 926 bytes} [Tue May 28 12:36:41 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34a06d0-8a1b-4571-ad00-8b2a8370e9bb None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34a06d0-8a1b-4571-ad00-8b2a8370e9bb None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34a06d0-8a1b-4571-ad00-8b2a8370e9bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-b34a06d0-8a1b-4571-ad00-8b2a8370e9bb None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-b34a06d0-8a1b-4571-ad00-8b2a8370e9bb None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-b34a06d0-8a1b-4571-ad00-8b2a8370e9bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3ca369-1775-4ae5-8562-e03dd45a3fed None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 43/92] 10.27.203.238 () {58 vars in 1023 bytes} [Tue May 28 12:36:41 2024] POST /identity/v3/auth/tokens => generated 864 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3ca369-1775-4ae5-8562-e03dd45a3fed None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c74a5f3-89fd-446a-822d-4134d671fe65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c74a5f3-89fd-446a-822d-4134d671fe65 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c74a5f3-89fd-446a-822d-4134d671fe65 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c74a5f3-89fd-446a-822d-4134d671fe65 None admin] PATH_INFO: `/v3/roles/member` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c74a5f3-89fd-446a-822d-4134d671fe65 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-0c74a5f3-89fd-446a-822d-4134d671fe65 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._get_role(role_id) May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1281, in get_role May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 50/93] 10.27.203.238 () {56 vars in 1099 bytes} [Tue May 28 12:36:41 2024] GET /identity/v3/roles/member => generated 84 bytes in 126 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34a06d0-8a1b-4571-ad00-8b2a8370e9bb None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7097ee57-4f54-4060-90ab-529cad2d832f None None] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7097ee57-4f54-4060-90ab-529cad2d832f None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7097ee57-4f54-4060-90ab-529cad2d832f None None] PATH_INFO: `/` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 51/94] 10.27.203.238 () {54 vars in 926 bytes} [Tue May 28 12:36:41 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618f27a1-cd5a-4ebd-a97a-ba5c1367b8ab None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618f27a1-cd5a-4ebd-a97a-ba5c1367b8ab None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618f27a1-cd5a-4ebd-a97a-ba5c1367b8ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-618f27a1-cd5a-4ebd-a97a-ba5c1367b8ab None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-618f27a1-cd5a-4ebd-a97a-ba5c1367b8ab None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-618f27a1-cd5a-4ebd-a97a-ba5c1367b8ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34a06d0-8a1b-4571-ad00-8b2a8370e9bb None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecbf264-ae69-4b2b-89ac-3ccec5722241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecbf264-ae69-4b2b-89ac-3ccec5722241 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecbf264-ae69-4b2b-89ac-3ccec5722241 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecbf264-ae69-4b2b-89ac-3ccec5722241 None admin] PATH_INFO: `/v3/roles` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecbf264-ae69-4b2b-89ac-3ccec5722241 None admin] RBAC: Adding query filter params (name=member) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecbf264-ae69-4b2b-89ac-3ccec5722241 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecbf264-ae69-4b2b-89ac-3ccec5722241 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 44/95] 10.27.203.238 () {56 vars in 1101 bytes} [Tue May 28 12:36:41 2024] GET /identity/v3/roles?name=member => generated 345 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3e6870-aaa6-4635-ba87-26f2b20b4b62 None None] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3e6870-aaa6-4635-ba87-26f2b20b4b62 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3e6870-aaa6-4635-ba87-26f2b20b4b62 None None] PATH_INFO: `/` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 45/96] 10.27.203.238 () {54 vars in 926 bytes} [Tue May 28 12:36:41 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9270b1cd-c09e-43c9-8e83-cd23122852e2 None None] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9270b1cd-c09e-43c9-8e83-cd23122852e2 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9270b1cd-c09e-43c9-8e83-cd23122852e2 None None] PATH_INFO: `/` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 46/97] 10.27.203.238 () {54 vars in 926 bytes} [Tue May 28 12:36:41 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9270b1cd-c09e-43c9-8e83-cd23122852e2 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 52/98] 10.27.203.238 () {58 vars in 1023 bytes} [Tue May 28 12:36:41 2024] POST /identity/v3/auth/tokens => generated 864 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03875d8-1e78-4cf0-936b-24c2c6dc0d8b None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03875d8-1e78-4cf0-936b-24c2c6dc0d8b None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03875d8-1e78-4cf0-936b-24c2c6dc0d8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-c03875d8-1e78-4cf0-936b-24c2c6dc0d8b None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-c03875d8-1e78-4cf0-936b-24c2c6dc0d8b None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-c03875d8-1e78-4cf0-936b-24c2c6dc0d8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9270b1cd-c09e-43c9-8e83-cd23122852e2 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 53/99] 10.27.203.238 () {58 vars in 1023 bytes} [Tue May 28 12:36:41 2024] POST /identity/v3/auth/tokens => generated 864 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0956e138-389c-4a02-8f34-772135510f02 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0956e138-389c-4a02-8f34-772135510f02 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0956e138-389c-4a02-8f34-772135510f02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f30663-cb9f-49a8-8db0-8a4d17311ade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f30663-cb9f-49a8-8db0-8a4d17311ade None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f30663-cb9f-49a8-8db0-8a4d17311ade None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f30663-cb9f-49a8-8db0-8a4d17311ade None admin] PATH_INFO: `/v3/users/2a1747ad86b04cc4aa7bc0b3e4077eaf` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f30663-cb9f-49a8-8db0-8a4d17311ade None admin] RBAC: Authorizing `identity:get_user(user_id=2a1747ad86b04cc4aa7bc0b3e4077eaf)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f30663-cb9f-49a8-8db0-8a4d17311ade None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 47/100] 10.27.203.238 () {56 vars in 1177 bytes} [Tue May 28 12:36:41 2024] GET /identity/v3/users/2a1747ad86b04cc4aa7bc0b3e4077eaf => generated 277 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f30663-cb9f-49a8-8db0-8a4d17311ade None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-0956e138-389c-4a02-8f34-772135510f02 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-0956e138-389c-4a02-8f34-772135510f02 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-0956e138-389c-4a02-8f34-772135510f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f30663-cb9f-49a8-8db0-8a4d17311ade None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 54/101] 10.27.203.238 () {58 vars in 1023 bytes} [Tue May 28 12:36:41 2024] POST /identity/v3/auth/tokens => generated 864 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a786d5f-1264-47c2-9e2d-c50164d4c606 None None] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a786d5f-1264-47c2-9e2d-c50164d4c606 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a786d5f-1264-47c2-9e2d-c50164d4c606 None None] PATH_INFO: `/` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 55/102] 10.27.203.238 () {54 vars in 926 bytes} [Tue May 28 12:36:41 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a786d5f-1264-47c2-9e2d-c50164d4c606 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a10a68f-d661-4f09-9236-835eed2248c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a10a68f-d661-4f09-9236-835eed2248c9 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a10a68f-d661-4f09-9236-835eed2248c9 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a10a68f-d661-4f09-9236-835eed2248c9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a10a68f-d661-4f09-9236-835eed2248c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-2a10a68f-d661-4f09-9236-835eed2248c9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._get_role(role_id) May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1281, in get_role May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 48/103] 10.27.203.238 () {56 vars in 1096 bytes} [Tue May 28 12:36:41 2024] GET /identity/v3/roles/admin => generated 83 bytes in 92 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8feb74-de9c-4809-a307-efd229264575 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8feb74-de9c-4809-a307-efd229264575 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8feb74-de9c-4809-a307-efd229264575 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-6e8feb74-de9c-4809-a307-efd229264575 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-6e8feb74-de9c-4809-a307-efd229264575 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-6e8feb74-de9c-4809-a307-efd229264575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a786d5f-1264-47c2-9e2d-c50164d4c606 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34cbb5d-27e9-4230-86b6-8e11f954ff04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34cbb5d-27e9-4230-86b6-8e11f954ff04 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34cbb5d-27e9-4230-86b6-8e11f954ff04 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34cbb5d-27e9-4230-86b6-8e11f954ff04 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 49/104] 10.27.203.238 () {58 vars in 1023 bytes} [Tue May 28 12:36:41 2024] POST /identity/v3/auth/tokens => generated 864 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8feb74-de9c-4809-a307-efd229264575 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34cbb5d-27e9-4230-86b6-8e11f954ff04 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34cbb5d-27e9-4230-86b6-8e11f954ff04 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8feb74-de9c-4809-a307-efd229264575 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 56/105] 10.27.203.238 () {58 vars in 1282 bytes} [Tue May 28 12:36:41 2024] GET /identity/v3/auth/tokens => generated 864 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34cbb5d-27e9-4230-86b6-8e11f954ff04 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab4f087-b658-4388-9c8b-98e396fd4349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab4f087-b658-4388-9c8b-98e396fd4349 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab4f087-b658-4388-9c8b-98e396fd4349 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab4f087-b658-4388-9c8b-98e396fd4349 None admin] PATH_INFO: `/v3/roles` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab4f087-b658-4388-9c8b-98e396fd4349 None admin] RBAC: Adding query filter params (name=admin) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab4f087-b658-4388-9c8b-98e396fd4349 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab4f087-b658-4388-9c8b-98e396fd4349 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 50/106] 10.27.203.238 () {56 vars in 1099 bytes} [Tue May 28 12:36:41 2024] GET /identity/v3/roles?name=admin => generated 343 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab4f087-b658-4388-9c8b-98e396fd4349 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34cbb5d-27e9-4230-86b6-8e11f954ff04 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab4f087-b658-4388-9c8b-98e396fd4349 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4442675d-14ce-4a1f-80b2-2cdf18090748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4442675d-14ce-4a1f-80b2-2cdf18090748 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4442675d-14ce-4a1f-80b2-2cdf18090748 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4442675d-14ce-4a1f-80b2-2cdf18090748 None admin] PATH_INFO: `/v3/domains/default` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4442675d-14ce-4a1f-80b2-2cdf18090748 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4442675d-14ce-4a1f-80b2-2cdf18090748 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 57/107] 10.27.203.238 () {56 vars in 1108 bytes} [Tue May 28 12:36:41 2024] GET /identity/v3/domains/default => generated 201 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4442675d-14ce-4a1f-80b2-2cdf18090748 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02ac460-08ec-464a-80d3-e01b289dfccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02ac460-08ec-464a-80d3-e01b289dfccd None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02ac460-08ec-464a-80d3-e01b289dfccd None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02ac460-08ec-464a-80d3-e01b289dfccd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02ac460-08ec-464a-80d3-e01b289dfccd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-b02ac460-08ec-464a-80d3-e01b289dfccd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._get_role(role_id) May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1281, in get_role May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 51/108] 10.27.203.238 () {56 vars in 1114 bytes} [Tue May 28 12:36:41 2024] GET /identity/v3/roles/anotherrole => generated 89 bytes in 92 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 28 12:36:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02ac460-08ec-464a-80d3-e01b289dfccd None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4442675d-14ce-4a1f-80b2-2cdf18090748 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02ac460-08ec-464a-80d3-e01b289dfccd None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fb7cdc-4c59-411b-8655-9eb9229754f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fb7cdc-4c59-411b-8655-9eb9229754f4 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fb7cdc-4c59-411b-8655-9eb9229754f4 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fb7cdc-4c59-411b-8655-9eb9229754f4 None admin] PATH_INFO: `/v3/projects/95de88f6d26e4420bc466ba67668171f` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fb7cdc-4c59-411b-8655-9eb9229754f4 None admin] RBAC: Authorizing `identity:get_project(project_id=95de88f6d26e4420bc466ba67668171f)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fb7cdc-4c59-411b-8655-9eb9229754f4 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 58/109] 10.27.203.238 () {56 vars in 1186 bytes} [Tue May 28 12:36:41 2024] GET /identity/v3/projects/95de88f6d26e4420bc466ba67668171f => generated 300 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fb7cdc-4c59-411b-8655-9eb9229754f4 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1173fb-f996-4eb8-948d-573672010182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1173fb-f996-4eb8-948d-573672010182 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1173fb-f996-4eb8-948d-573672010182 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1173fb-f996-4eb8-948d-573672010182 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1173fb-f996-4eb8-948d-573672010182 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-ef1173fb-f996-4eb8-948d-573672010182 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._get_role(role_id) May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1281, in get_role May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 52/110] 10.27.203.238 () {56 vars in 1099 bytes} [Tue May 28 12:36:41 2024] GET /identity/v3/roles/reader => generated 84 bytes in 89 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1173fb-f996-4eb8-948d-573672010182 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fb7cdc-4c59-411b-8655-9eb9229754f4 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1173fb-f996-4eb8-948d-573672010182 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53fcf9c-df91-4ab8-9eb3-e9be0fe93c6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53fcf9c-df91-4ab8-9eb3-e9be0fe93c6d None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53fcf9c-df91-4ab8-9eb3-e9be0fe93c6d None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53fcf9c-df91-4ab8-9eb3-e9be0fe93c6d None admin] PATH_INFO: `/v3/users/e48f0d07e6644786b1da9213d53cc1e1` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53fcf9c-df91-4ab8-9eb3-e9be0fe93c6d None admin] RBAC: Authorizing `identity:get_user(user_id=e48f0d07e6644786b1da9213d53cc1e1)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53fcf9c-df91-4ab8-9eb3-e9be0fe93c6d None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 59/111] 10.27.203.238 () {56 vars in 1177 bytes} [Tue May 28 12:36:42 2024] GET /identity/v3/users/e48f0d07e6644786b1da9213d53cc1e1 => generated 249 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53fcf9c-df91-4ab8-9eb3-e9be0fe93c6d None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0336755b-713d-4ed8-be4f-002838064cba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0336755b-713d-4ed8-be4f-002838064cba None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0336755b-713d-4ed8-be4f-002838064cba None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0336755b-713d-4ed8-be4f-002838064cba None admin] PATH_INFO: `/v3/projects` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0336755b-713d-4ed8-be4f-002838064cba None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0336755b-713d-4ed8-be4f-002838064cba None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 53/112] 10.27.203.238 () {60 vars in 1141 bytes} [Tue May 28 12:36:42 2024] POST /identity/v3/projects => generated 304 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0336755b-713d-4ed8-be4f-002838064cba None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53fcf9c-df91-4ab8-9eb3-e9be0fe93c6d None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d886954-e258-45d5-8179-cbbc60c59e50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d886954-e258-45d5-8179-cbbc60c59e50 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d886954-e258-45d5-8179-cbbc60c59e50 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d886954-e258-45d5-8179-cbbc60c59e50 None admin] PATH_INFO: `/v3/roles/member` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d886954-e258-45d5-8179-cbbc60c59e50 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-1d886954-e258-45d5-8179-cbbc60c59e50 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._get_role(role_id) May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1281, in get_role May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 60/113] 10.27.203.238 () {56 vars in 1099 bytes} [Tue May 28 12:36:42 2024] GET /identity/v3/roles/member => generated 84 bytes in 98 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d886954-e258-45d5-8179-cbbc60c59e50 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0336755b-713d-4ed8-be4f-002838064cba None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:42 l75lg1-v1 dstat.sh[49771]: 28-05 12:36:42| 39 3 57 0 0|1764M 7979M 234M 5726M| 15k 0 | 0 272k| 0 29.0 |6711 14k|1.77 0.89 0.65|4.0 0 0| 0 0 | 0 2048M| 19 34 0 11 0 May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024fb2a7-28a6-4406-9061-38e2a5e96a1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024fb2a7-28a6-4406-9061-38e2a5e96a1a None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024fb2a7-28a6-4406-9061-38e2a5e96a1a None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024fb2a7-28a6-4406-9061-38e2a5e96a1a None admin] PATH_INFO: `/v3/roles` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024fb2a7-28a6-4406-9061-38e2a5e96a1a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024fb2a7-28a6-4406-9061-38e2a5e96a1a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024fb2a7-28a6-4406-9061-38e2a5e96a1a None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 54/114] 10.27.203.238 () {56 vars in 1111 bytes} [Tue May 28 12:36:42 2024] GET /identity/v3/roles?name=anotherrole => generated 338 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024fb2a7-28a6-4406-9061-38e2a5e96a1a None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d886954-e258-45d5-8179-cbbc60c59e50 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024fb2a7-28a6-4406-9061-38e2a5e96a1a None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbc3383-b841-4cbd-9bcf-d4fd5789494a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbc3383-b841-4cbd-9bcf-d4fd5789494a None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbc3383-b841-4cbd-9bcf-d4fd5789494a None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbc3383-b841-4cbd-9bcf-d4fd5789494a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbc3383-b841-4cbd-9bcf-d4fd5789494a None admin] RBAC: Adding query filter params (role.id=44620cad10ae407c90c91e2c296adb04, scope.project.id=95de88f6d26e4420bc466ba67668171f, user.id=2a1747ad86b04cc4aa7bc0b3e4077eaf) {{(pid=51267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbc3383-b841-4cbd-9bcf-d4fd5789494a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbc3383-b841-4cbd-9bcf-d4fd5789494a None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 61/115] 10.27.203.238 () {56 vars in 1374 bytes} [Tue May 28 12:36:42 2024] GET /identity/v3/role_assignments?user.id=2a1747ad86b04cc4aa7bc0b3e4077eaf&scope.project.id=95de88f6d26e4420bc466ba67668171f&role.id=44620cad10ae407c90c91e2c296adb04 => generated 612 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbc3383-b841-4cbd-9bcf-d4fd5789494a None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f543582-f87d-4a6f-b261-ffbd50adc4d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f543582-f87d-4a6f-b261-ffbd50adc4d1 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f543582-f87d-4a6f-b261-ffbd50adc4d1 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f543582-f87d-4a6f-b261-ffbd50adc4d1 None admin] PATH_INFO: `/v3/roles` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f543582-f87d-4a6f-b261-ffbd50adc4d1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f543582-f87d-4a6f-b261-ffbd50adc4d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f543582-f87d-4a6f-b261-ffbd50adc4d1 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 55/116] 10.27.203.238 () {56 vars in 1101 bytes} [Tue May 28 12:36:42 2024] GET /identity/v3/roles?name=reader => generated 345 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f543582-f87d-4a6f-b261-ffbd50adc4d1 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbc3383-b841-4cbd-9bcf-d4fd5789494a None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f543582-f87d-4a6f-b261-ffbd50adc4d1 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea51898-56f3-4b3f-81ee-8d14939c121b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea51898-56f3-4b3f-81ee-8d14939c121b None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea51898-56f3-4b3f-81ee-8d14939c121b None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea51898-56f3-4b3f-81ee-8d14939c121b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787299fe-b537-4d54-ab03-51b5b4b4f14c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787299fe-b537-4d54-ab03-51b5b4b4f14c None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787299fe-b537-4d54-ab03-51b5b4b4f14c None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787299fe-b537-4d54-ab03-51b5b4b4f14c None admin] PATH_INFO: `/v3/roles` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787299fe-b537-4d54-ab03-51b5b4b4f14c None admin] RBAC: Adding query filter params (name=member) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787299fe-b537-4d54-ab03-51b5b4b4f14c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787299fe-b537-4d54-ab03-51b5b4b4f14c None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 56/117] 10.27.203.238 () {56 vars in 1101 bytes} [Tue May 28 12:36:42 2024] GET /identity/v3/roles?name=member => generated 345 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787299fe-b537-4d54-ab03-51b5b4b4f14c None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea51898-56f3-4b3f-81ee-8d14939c121b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea51898-56f3-4b3f-81ee-8d14939c121b None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787299fe-b537-4d54-ab03-51b5b4b4f14c None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 62/118] 10.27.203.238 () {58 vars in 1282 bytes} [Tue May 28 12:36:42 2024] GET /identity/v3/auth/tokens => generated 864 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea51898-56f3-4b3f-81ee-8d14939c121b None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983bc83e-5004-4cf3-b0c0-0ecb69c247c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983bc83e-5004-4cf3-b0c0-0ecb69c247c6 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983bc83e-5004-4cf3-b0c0-0ecb69c247c6 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983bc83e-5004-4cf3-b0c0-0ecb69c247c6 None admin] PATH_INFO: `/v3/users/2a1747ad86b04cc4aa7bc0b3e4077eaf` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983bc83e-5004-4cf3-b0c0-0ecb69c247c6 None admin] RBAC: Authorizing `identity:get_user(user_id=2a1747ad86b04cc4aa7bc0b3e4077eaf)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983bc83e-5004-4cf3-b0c0-0ecb69c247c6 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 57/119] 10.27.203.238 () {56 vars in 1177 bytes} [Tue May 28 12:36:42 2024] GET /identity/v3/users/2a1747ad86b04cc4aa7bc0b3e4077eaf => generated 277 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983bc83e-5004-4cf3-b0c0-0ecb69c247c6 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea51898-56f3-4b3f-81ee-8d14939c121b None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda133ec-e8df-49aa-b2e3-7793944413ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda133ec-e8df-49aa-b2e3-7793944413ac None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda133ec-e8df-49aa-b2e3-7793944413ac None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda133ec-e8df-49aa-b2e3-7793944413ac None admin] PATH_INFO: `/v3/users/4c69d81f93e146e2ba35a6c0e436cb0c` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983bc83e-5004-4cf3-b0c0-0ecb69c247c6 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda133ec-e8df-49aa-b2e3-7793944413ac None admin] RBAC: Authorizing `identity:get_user(user_id=4c69d81f93e146e2ba35a6c0e436cb0c)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda133ec-e8df-49aa-b2e3-7793944413ac None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 63/120] 10.27.203.238 () {56 vars in 1177 bytes} [Tue May 28 12:36:42 2024] GET /identity/v3/users/4c69d81f93e146e2ba35a6c0e436cb0c => generated 291 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda133ec-e8df-49aa-b2e3-7793944413ac None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680c5895-5c20-4732-8e68-2205863e6782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680c5895-5c20-4732-8e68-2205863e6782 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680c5895-5c20-4732-8e68-2205863e6782 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680c5895-5c20-4732-8e68-2205863e6782 None admin] PATH_INFO: `/v3/users/2a1747ad86b04cc4aa7bc0b3e4077eaf` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680c5895-5c20-4732-8e68-2205863e6782 None admin] RBAC: Authorizing `identity:get_user(user_id=2a1747ad86b04cc4aa7bc0b3e4077eaf)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680c5895-5c20-4732-8e68-2205863e6782 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 58/121] 10.27.203.238 () {56 vars in 1177 bytes} [Tue May 28 12:36:42 2024] GET /identity/v3/users/2a1747ad86b04cc4aa7bc0b3e4077eaf => generated 277 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680c5895-5c20-4732-8e68-2205863e6782 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda133ec-e8df-49aa-b2e3-7793944413ac None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680c5895-5c20-4732-8e68-2205863e6782 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ca8b5f-32a9-4e12-9b71-bda7500f46c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ca8b5f-32a9-4e12-9b71-bda7500f46c8 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ca8b5f-32a9-4e12-9b71-bda7500f46c8 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ca8b5f-32a9-4e12-9b71-bda7500f46c8 None admin] PATH_INFO: `/v3/projects/95de88f6d26e4420bc466ba67668171f` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ca8b5f-32a9-4e12-9b71-bda7500f46c8 None admin] RBAC: Authorizing `identity:get_project(project_id=95de88f6d26e4420bc466ba67668171f)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ca8b5f-32a9-4e12-9b71-bda7500f46c8 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 64/122] 10.27.203.238 () {56 vars in 1186 bytes} [Tue May 28 12:36:42 2024] GET /identity/v3/projects/95de88f6d26e4420bc466ba67668171f => generated 300 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ca8b5f-32a9-4e12-9b71-bda7500f46c8 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9947ba-63d3-4ceb-aeee-e20e20bd0608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9947ba-63d3-4ceb-aeee-e20e20bd0608 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9947ba-63d3-4ceb-aeee-e20e20bd0608 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9947ba-63d3-4ceb-aeee-e20e20bd0608 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9947ba-63d3-4ceb-aeee-e20e20bd0608 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9947ba-63d3-4ceb-aeee-e20e20bd0608 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ca8b5f-32a9-4e12-9b71-bda7500f46c8 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ecb191-42e2-4c62-aec9-1d2c88900b35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ecb191-42e2-4c62-aec9-1d2c88900b35 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ecb191-42e2-4c62-aec9-1d2c88900b35 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ecb191-42e2-4c62-aec9-1d2c88900b35 None admin] PATH_INFO: `/v3/projects/95de88f6d26e4420bc466ba67668171f` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ecb191-42e2-4c62-aec9-1d2c88900b35 None admin] RBAC: Authorizing `identity:get_project(project_id=95de88f6d26e4420bc466ba67668171f)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ecb191-42e2-4c62-aec9-1d2c88900b35 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 65/123] 10.27.203.238 () {56 vars in 1186 bytes} [Tue May 28 12:36:42 2024] GET /identity/v3/projects/95de88f6d26e4420bc466ba67668171f => generated 300 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ecb191-42e2-4c62-aec9-1d2c88900b35 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 59/124] 10.27.203.238 () {58 vars in 1282 bytes} [Tue May 28 12:36:42 2024] GET /identity/v3/auth/tokens => generated 864 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9947ba-63d3-4ceb-aeee-e20e20bd0608 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ecb191-42e2-4c62-aec9-1d2c88900b35 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9947ba-63d3-4ceb-aeee-e20e20bd0608 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c4d848-0244-408e-a072-8e9cb168d325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c4d848-0244-408e-a072-8e9cb168d325 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6288d271-d134-4cd2-b1f9-9e07f2b95141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c4d848-0244-408e-a072-8e9cb168d325 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c4d848-0244-408e-a072-8e9cb168d325 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6288d271-d134-4cd2-b1f9-9e07f2b95141 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6288d271-d134-4cd2-b1f9-9e07f2b95141 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6288d271-d134-4cd2-b1f9-9e07f2b95141 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6288d271-d134-4cd2-b1f9-9e07f2b95141 None admin] RBAC: Adding query filter params (role.id=e7989893488f483baa107be56668c4f8, scope.project.id=95de88f6d26e4420bc466ba67668171f, user.id=e48f0d07e6644786b1da9213d53cc1e1) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6288d271-d134-4cd2-b1f9-9e07f2b95141 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6288d271-d134-4cd2-b1f9-9e07f2b95141 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 60/125] 10.27.203.238 () {56 vars in 1374 bytes} [Tue May 28 12:36:42 2024] GET /identity/v3/role_assignments?user.id=e48f0d07e6644786b1da9213d53cc1e1&scope.project.id=95de88f6d26e4420bc466ba67668171f&role.id=e7989893488f483baa107be56668c4f8 => generated 612 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6288d271-d134-4cd2-b1f9-9e07f2b95141 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c4d848-0244-408e-a072-8e9cb168d325 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c4d848-0244-408e-a072-8e9cb168d325 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6288d271-d134-4cd2-b1f9-9e07f2b95141 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 66/126] 10.27.203.238 () {58 vars in 1282 bytes} [Tue May 28 12:36:42 2024] GET /identity/v3/auth/tokens => generated 864 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c4d848-0244-408e-a072-8e9cb168d325 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d2b944-882a-4268-8cab-46669d08e651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d2b944-882a-4268-8cab-46669d08e651 None admin] REQUEST_METHOD: `PUT` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d2b944-882a-4268-8cab-46669d08e651 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d2b944-882a-4268-8cab-46669d08e651 None admin] PATH_INFO: `/v3/projects/95de88f6d26e4420bc466ba67668171f/users/4c69d81f93e146e2ba35a6c0e436cb0c/roles/20fc3860247242838aac793d192b83dc` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d2b944-882a-4268-8cab-46669d08e651 None admin] RBAC: Authorizing `identity:create_grant(project_id=95de88f6d26e4420bc466ba67668171f, user_id=4c69d81f93e146e2ba35a6c0e436cb0c, role_id=20fc3860247242838aac793d192b83dc)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d2b944-882a-4268-8cab-46669d08e651 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 61/127] 10.27.203.238 () {58 vars in 1439 bytes} [Tue May 28 12:36:42 2024] PUT /identity/v3/projects/95de88f6d26e4420bc466ba67668171f/users/4c69d81f93e146e2ba35a6c0e436cb0c/roles/20fc3860247242838aac793d192b83dc => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d2b944-882a-4268-8cab-46669d08e651 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c4d848-0244-408e-a072-8e9cb168d325 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d2b944-882a-4268-8cab-46669d08e651 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82944d71-8263-443a-95f0-7cf4906ccdce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82944d71-8263-443a-95f0-7cf4906ccdce None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82944d71-8263-443a-95f0-7cf4906ccdce None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82944d71-8263-443a-95f0-7cf4906ccdce None admin] PATH_INFO: `/v3/projects/95de88f6d26e4420bc466ba67668171f` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82944d71-8263-443a-95f0-7cf4906ccdce None admin] RBAC: Authorizing `identity:get_project(project_id=95de88f6d26e4420bc466ba67668171f)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:36:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82944d71-8263-443a-95f0-7cf4906ccdce None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:36:43 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 67/128] 10.27.203.238 () {56 vars in 1186 bytes} [Tue May 28 12:36:42 2024] GET /identity/v3/projects/95de88f6d26e4420bc466ba67668171f => generated 300 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:36:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82944d71-8263-443a-95f0-7cf4906ccdce None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed88b9a2-bd6c-4554-9eba-46b866155ff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed88b9a2-bd6c-4554-9eba-46b866155ff7 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed88b9a2-bd6c-4554-9eba-46b866155ff7 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed88b9a2-bd6c-4554-9eba-46b866155ff7 None admin] PATH_INFO: `/v3/projects/c43e12e502cd4cfcacdcc7e0514c3a93` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed88b9a2-bd6c-4554-9eba-46b866155ff7 None admin] RBAC: Authorizing `identity:get_project(project_id=c43e12e502cd4cfcacdcc7e0514c3a93)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:36:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed88b9a2-bd6c-4554-9eba-46b866155ff7 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:36:43 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 62/129] 10.27.203.238 () {56 vars in 1186 bytes} [Tue May 28 12:36:42 2024] GET /identity/v3/projects/c43e12e502cd4cfcacdcc7e0514c3a93 => generated 314 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:36:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed88b9a2-bd6c-4554-9eba-46b866155ff7 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82944d71-8263-443a-95f0-7cf4906ccdce None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed88b9a2-bd6c-4554-9eba-46b866155ff7 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c80b98-b583-4b18-951f-f6af7886bd26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c80b98-b583-4b18-951f-f6af7886bd26 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c80b98-b583-4b18-951f-f6af7886bd26 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c80b98-b583-4b18-951f-f6af7886bd26 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c80b98-b583-4b18-951f-f6af7886bd26 None admin] RBAC: Adding query filter params (role.id=67bacc33b83c4fc898309c1e5960a722, scope.project.id=95de88f6d26e4420bc466ba67668171f, user.id=2a1747ad86b04cc4aa7bc0b3e4077eaf) {{(pid=51267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:36:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c80b98-b583-4b18-951f-f6af7886bd26 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:36:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c80b98-b583-4b18-951f-f6af7886bd26 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:36:43 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 68/130] 10.27.203.238 () {56 vars in 1374 bytes} [Tue May 28 12:36:43 2024] GET /identity/v3/role_assignments?user.id=2a1747ad86b04cc4aa7bc0b3e4077eaf&scope.project.id=95de88f6d26e4420bc466ba67668171f&role.id=67bacc33b83c4fc898309c1e5960a722 => generated 612 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:36:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eba8005-e3b8-48cb-adef-7a418fa55492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eba8005-e3b8-48cb-adef-7a418fa55492 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eba8005-e3b8-48cb-adef-7a418fa55492 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eba8005-e3b8-48cb-adef-7a418fa55492 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eba8005-e3b8-48cb-adef-7a418fa55492 None admin] RBAC: Adding query filter params (role.id=44620cad10ae407c90c91e2c296adb04, scope.project.id=c43e12e502cd4cfcacdcc7e0514c3a93, user.id=2a1747ad86b04cc4aa7bc0b3e4077eaf) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:36:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eba8005-e3b8-48cb-adef-7a418fa55492 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:36:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eba8005-e3b8-48cb-adef-7a418fa55492 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:36:43 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 63/131] 10.27.203.238 () {56 vars in 1374 bytes} [Tue May 28 12:36:43 2024] GET /identity/v3/role_assignments?user.id=2a1747ad86b04cc4aa7bc0b3e4077eaf&scope.project.id=c43e12e502cd4cfcacdcc7e0514c3a93&role.id=44620cad10ae407c90c91e2c296adb04 => generated 612 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:36:43 l75lg1-v1 dstat.sh[49771]: 28-05 12:36:43| 36 5 60 0 0|1579M 8164M 234M 5726M| 16k 3846B| 0 328k| 0 30.0 |7172 14k|1.77 0.89 0.65|4.0 0 136| 0 0 | 0 2048M| 19 29 0 12 0 May 28 12:36:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f59bc46-9165-46a9-937b-0a0d8594add5 None None] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f59bc46-9165-46a9-937b-0a0d8594add5 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f59bc46-9165-46a9-937b-0a0d8594add5 None None] PATH_INFO: `/` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:43 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 69/132] 10.27.203.238 () {54 vars in 926 bytes} [Tue May 28 12:36:43 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:36:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86c2fcd-7dd9-472e-83f1-e944492b3fcf None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86c2fcd-7dd9-472e-83f1-e944492b3fcf None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86c2fcd-7dd9-472e-83f1-e944492b3fcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:43 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-f86c2fcd-7dd9-472e-83f1-e944492b3fcf None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:36:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-f86c2fcd-7dd9-472e-83f1-e944492b3fcf None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:36:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-f86c2fcd-7dd9-472e-83f1-e944492b3fcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:36:43 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 64/133] 10.27.203.238 () {58 vars in 1023 bytes} [Tue May 28 12:36:43 2024] POST /identity/v3/auth/tokens => generated 864 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 28 12:36:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f59bc46-9165-46a9-937b-0a0d8594add5 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f59bc46-9165-46a9-937b-0a0d8594add5 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e65a5a-97a7-4e14-88b9-08cd275d9192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e65a5a-97a7-4e14-88b9-08cd275d9192 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e65a5a-97a7-4e14-88b9-08cd275d9192 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e65a5a-97a7-4e14-88b9-08cd275d9192 None admin] PATH_INFO: `/v3/domains/default` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e65a5a-97a7-4e14-88b9-08cd275d9192 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:36:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e65a5a-97a7-4e14-88b9-08cd275d9192 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:36:43 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 70/134] 10.27.203.238 () {56 vars in 1108 bytes} [Tue May 28 12:36:43 2024] GET /identity/v3/domains/default => generated 201 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:36:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86c2fcd-7dd9-472e-83f1-e944492b3fcf None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86c2fcd-7dd9-472e-83f1-e944492b3fcf None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850d7513-8547-4a3b-843e-cedb39295ca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850d7513-8547-4a3b-843e-cedb39295ca7 None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850d7513-8547-4a3b-843e-cedb39295ca7 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850d7513-8547-4a3b-843e-cedb39295ca7 None admin] PATH_INFO: `/v3/users` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850d7513-8547-4a3b-843e-cedb39295ca7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:36:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850d7513-8547-4a3b-843e-cedb39295ca7 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:36:44 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-850d7513-8547-4a3b-843e-cedb39295ca7 None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 12:36:44 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 65/135] 10.27.203.238 () {60 vars in 1132 bytes} [Tue May 28 12:36:43 2024] POST /identity/v3/users => generated 285 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:36:44 l75lg1-v1 dstat.sh[49771]: 28-05 12:36:44| 19 3 77 0 0|1471M 8272M 234M 5726M| 20k 2262B| 0 332k| 0 29.0 |3275 4275 |1.77 0.89 0.65|3.0 0 96| 0 0 | 0 2048M| 19 29 0 12 0 May 28 12:36:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3885e8-be60-43e0-b894-5b07cdf1ea59 None None] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3885e8-be60-43e0-b894-5b07cdf1ea59 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3885e8-be60-43e0-b894-5b07cdf1ea59 None None] PATH_INFO: `/` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:44 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 71/136] 10.27.203.238 () {54 vars in 926 bytes} [Tue May 28 12:36:44 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (2 switches on core 0) May 28 12:36:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186c629c-ae8c-4481-a44b-19bd15179b18 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186c629c-ae8c-4481-a44b-19bd15179b18 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186c629c-ae8c-4481-a44b-19bd15179b18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:44 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-186c629c-ae8c-4481-a44b-19bd15179b18 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:36:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-186c629c-ae8c-4481-a44b-19bd15179b18 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:36:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-186c629c-ae8c-4481-a44b-19bd15179b18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:36:44 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 66/137] 10.27.203.238 () {58 vars in 1023 bytes} [Tue May 28 12:36:44 2024] POST /identity/v3/auth/tokens => generated 864 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 28 12:36:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3885e8-be60-43e0-b894-5b07cdf1ea59 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3885e8-be60-43e0-b894-5b07cdf1ea59 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac343bc-1a6b-41f2-994d-54683709b2f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac343bc-1a6b-41f2-994d-54683709b2f8 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac343bc-1a6b-41f2-994d-54683709b2f8 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac343bc-1a6b-41f2-994d-54683709b2f8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac343bc-1a6b-41f2-994d-54683709b2f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 28 12:36:44 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-8ac343bc-1a6b-41f2-994d-54683709b2f8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 28 12:36:44 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:36:44 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:36:44 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:36:44 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:36:44 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:36:44 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:36:44 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:36:44 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:36:44 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:36:44 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:36:44 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:36:44 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 28 12:36:44 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._get_role(role_id) May 28 12:36:44 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 28 12:36:44 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 28 12:36:44 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 28 12:36:44 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 28 12:36:44 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 28 12:36:44 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 28 12:36:44 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:36:44 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:36:44 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:36:44 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:36:44 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:36:44 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:36:44 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:36:44 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 12:36:44 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:36:44 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 12:36:44 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:36:44 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:36:44 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:36:44 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 12:36:44 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:36:44 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 12:36:44 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1281, in get_role May 28 12:36:44 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 28 12:36:44 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 28 12:36:44 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 28 12:36:44 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 28 12:36:44 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 28 12:36:44 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 28 12:36:44 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 12:36:44 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 72/138] 10.27.203.238 () {56 vars in 1099 bytes} [Tue May 28 12:36:44 2024] GET /identity/v3/roles/reader => generated 84 bytes in 95 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 28 12:36:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186c629c-ae8c-4481-a44b-19bd15179b18 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186c629c-ae8c-4481-a44b-19bd15179b18 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d36ad57-7473-4b65-818b-4ba0f476ec0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d36ad57-7473-4b65-818b-4ba0f476ec0e None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d36ad57-7473-4b65-818b-4ba0f476ec0e None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d36ad57-7473-4b65-818b-4ba0f476ec0e None admin] PATH_INFO: `/v3/roles` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d36ad57-7473-4b65-818b-4ba0f476ec0e None admin] RBAC: Adding query filter params (name=reader) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:36:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d36ad57-7473-4b65-818b-4ba0f476ec0e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:36:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d36ad57-7473-4b65-818b-4ba0f476ec0e None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:36:44 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 67/139] 10.27.203.238 () {56 vars in 1101 bytes} [Tue May 28 12:36:44 2024] GET /identity/v3/roles?name=reader => generated 345 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:36:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac343bc-1a6b-41f2-994d-54683709b2f8 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac343bc-1a6b-41f2-994d-54683709b2f8 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f031d2d5-9376-4f2e-ab21-91feddb679ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f031d2d5-9376-4f2e-ab21-91feddb679ed None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f031d2d5-9376-4f2e-ab21-91feddb679ed None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f031d2d5-9376-4f2e-ab21-91feddb679ed None admin] PATH_INFO: `/v3/users/4c69d81f93e146e2ba35a6c0e436cb0c` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f031d2d5-9376-4f2e-ab21-91feddb679ed None admin] RBAC: Authorizing `identity:get_user(user_id=4c69d81f93e146e2ba35a6c0e436cb0c)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:36:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f031d2d5-9376-4f2e-ab21-91feddb679ed None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:36:44 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 73/140] 10.27.203.238 () {56 vars in 1177 bytes} [Tue May 28 12:36:44 2024] GET /identity/v3/users/4c69d81f93e146e2ba35a6c0e436cb0c => generated 291 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:36:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d36ad57-7473-4b65-818b-4ba0f476ec0e None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d36ad57-7473-4b65-818b-4ba0f476ec0e None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82dd67f-662f-4fa6-8371-f2d2897eb833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82dd67f-662f-4fa6-8371-f2d2897eb833 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82dd67f-662f-4fa6-8371-f2d2897eb833 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82dd67f-662f-4fa6-8371-f2d2897eb833 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82dd67f-662f-4fa6-8371-f2d2897eb833 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:36:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82dd67f-662f-4fa6-8371-f2d2897eb833 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:36:45 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 68/141] 10.27.203.238 () {58 vars in 1282 bytes} [Tue May 28 12:36:44 2024] GET /identity/v3/auth/tokens => generated 864 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 28 12:36:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f031d2d5-9376-4f2e-ab21-91feddb679ed None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f031d2d5-9376-4f2e-ab21-91feddb679ed None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccf8ec4-b9c7-4acd-966c-de26cb646b78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccf8ec4-b9c7-4acd-966c-de26cb646b78 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccf8ec4-b9c7-4acd-966c-de26cb646b78 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccf8ec4-b9c7-4acd-966c-de26cb646b78 None admin] PATH_INFO: `/v3/projects/95de88f6d26e4420bc466ba67668171f` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccf8ec4-b9c7-4acd-966c-de26cb646b78 None admin] RBAC: Authorizing `identity:get_project(project_id=95de88f6d26e4420bc466ba67668171f)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:36:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccf8ec4-b9c7-4acd-966c-de26cb646b78 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:36:45 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 74/142] 10.27.203.238 () {56 vars in 1186 bytes} [Tue May 28 12:36:45 2024] GET /identity/v3/projects/95de88f6d26e4420bc466ba67668171f => generated 300 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:36:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82dd67f-662f-4fa6-8371-f2d2897eb833 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82dd67f-662f-4fa6-8371-f2d2897eb833 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe0beea-40d8-4828-aa5d-723aa6414089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe0beea-40d8-4828-aa5d-723aa6414089 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe0beea-40d8-4828-aa5d-723aa6414089 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe0beea-40d8-4828-aa5d-723aa6414089 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe0beea-40d8-4828-aa5d-723aa6414089 None admin] RBAC: Adding query filter params (role.id=20fc3860247242838aac793d192b83dc, scope.project.id=95de88f6d26e4420bc466ba67668171f, user.id=4c69d81f93e146e2ba35a6c0e436cb0c) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:36:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe0beea-40d8-4828-aa5d-723aa6414089 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:36:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe0beea-40d8-4828-aa5d-723aa6414089 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:36:45 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 69/143] 10.27.203.238 () {56 vars in 1374 bytes} [Tue May 28 12:36:45 2024] GET /identity/v3/role_assignments?user.id=4c69d81f93e146e2ba35a6c0e436cb0c&scope.project.id=95de88f6d26e4420bc466ba67668171f&role.id=20fc3860247242838aac793d192b83dc => generated 612 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:36:45 l75lg1-v1 dstat.sh[49771]: 28-05 12:36:45| 32 6 61 0 0|1585M 8157M 234M 5726M| 18k 4942B| 0 564k| 0 19.0 |5647 7949 |1.77 0.89 0.65|7.0 0 214| 0 0 | 0 2048M| 19 29 0 12 0 May 28 12:36:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a76c5c-7549-4153-acc5-5d53df804cd6 None None] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a76c5c-7549-4153-acc5-5d53df804cd6 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a76c5c-7549-4153-acc5-5d53df804cd6 None None] PATH_INFO: `/` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:45 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 75/144] 10.27.203.238 () {54 vars in 926 bytes} [Tue May 28 12:36:45 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:36:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d276bf7-9deb-4e63-b6d8-522391293cfc None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d276bf7-9deb-4e63-b6d8-522391293cfc None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d276bf7-9deb-4e63-b6d8-522391293cfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:45 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-0d276bf7-9deb-4e63-b6d8-522391293cfc None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:36:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-0d276bf7-9deb-4e63-b6d8-522391293cfc None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:36:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-0d276bf7-9deb-4e63-b6d8-522391293cfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:36:45 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 70/145] 10.27.203.238 () {58 vars in 1023 bytes} [Tue May 28 12:36:45 2024] POST /identity/v3/auth/tokens => generated 864 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 28 12:36:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01620ff6-51fc-434a-95a4-71e68c795d07 None None] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01620ff6-51fc-434a-95a4-71e68c795d07 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01620ff6-51fc-434a-95a4-71e68c795d07 None None] PATH_INFO: `/` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:45 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 76/146] 10.27.203.238 () {54 vars in 926 bytes} [Tue May 28 12:36:45 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:36:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17443b46-51ce-435c-a657-062e6d735e07 None None] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17443b46-51ce-435c-a657-062e6d735e07 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17443b46-51ce-435c-a657-062e6d735e07 None None] PATH_INFO: `/` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ae4c98-5c8c-45ec-ab25-d60f847bf8ee None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ae4c98-5c8c-45ec-ab25-d60f847bf8ee None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:45 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 71/147] 10.27.203.238 () {54 vars in 926 bytes} [Tue May 28 12:36:45 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:36:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ae4c98-5c8c-45ec-ab25-d60f847bf8ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f999c9-3c11-4b23-a359-2f215904e233 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f999c9-3c11-4b23-a359-2f215904e233 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f999c9-3c11-4b23-a359-2f215904e233 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:45 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-75ae4c98-5c8c-45ec-ab25-d60f847bf8ee None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:36:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-75ae4c98-5c8c-45ec-ab25-d60f847bf8ee None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:36:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-75ae4c98-5c8c-45ec-ab25-d60f847bf8ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:36:45 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-f5f999c9-3c11-4b23-a359-2f215904e233 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:36:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-f5f999c9-3c11-4b23-a359-2f215904e233 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:36:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-f5f999c9-3c11-4b23-a359-2f215904e233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:36:45 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 77/148] 10.27.203.238 () {58 vars in 1023 bytes} [Tue May 28 12:36:45 2024] POST /identity/v3/auth/tokens => generated 864 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 28 12:36:45 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 72/149] 10.27.203.238 () {58 vars in 1023 bytes} [Tue May 28 12:36:45 2024] POST /identity/v3/auth/tokens => generated 864 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 28 12:36:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ae4c98-5c8c-45ec-ab25-d60f847bf8ee None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ae4c98-5c8c-45ec-ab25-d60f847bf8ee None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f999c9-3c11-4b23-a359-2f215904e233 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a38e8ac-2275-453c-a36a-96e739e20410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a38e8ac-2275-453c-a36a-96e739e20410 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a38e8ac-2275-453c-a36a-96e739e20410 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a38e8ac-2275-453c-a36a-96e739e20410 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a38e8ac-2275-453c-a36a-96e739e20410 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-1a38e8ac-2275-453c-a36a-96e739e20410 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._get_role(role_id) May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1281, in get_role May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 78/150] 10.27.203.238 () {56 vars in 1114 bytes} [Tue May 28 12:36:45 2024] GET /identity/v3/roles/anotherrole => generated 89 bytes in 100 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a38e8ac-2275-453c-a36a-96e739e20410 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f999c9-3c11-4b23-a359-2f215904e233 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a38e8ac-2275-453c-a36a-96e739e20410 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb0152f-dc7a-452e-8fdd-4bcd02e5c498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb0152f-dc7a-452e-8fdd-4bcd02e5c498 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb0152f-dc7a-452e-8fdd-4bcd02e5c498 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb0152f-dc7a-452e-8fdd-4bcd02e5c498 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb0152f-dc7a-452e-8fdd-4bcd02e5c498 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-bdb0152f-dc7a-452e-8fdd-4bcd02e5c498 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._get_role(role_id) May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1281, in get_role May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 73/151] 10.27.203.238 () {56 vars in 1096 bytes} [Tue May 28 12:36:45 2024] GET /identity/v3/roles/admin => generated 83 bytes in 96 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb0152f-dc7a-452e-8fdd-4bcd02e5c498 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9b46df-1ec1-4210-b89f-76c444ed7d4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9b46df-1ec1-4210-b89f-76c444ed7d4a None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9b46df-1ec1-4210-b89f-76c444ed7d4a None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9b46df-1ec1-4210-b89f-76c444ed7d4a None admin] PATH_INFO: `/v3/domains/default` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9b46df-1ec1-4210-b89f-76c444ed7d4a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9b46df-1ec1-4210-b89f-76c444ed7d4a None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 79/152] 10.27.203.238 () {56 vars in 1108 bytes} [Tue May 28 12:36:46 2024] GET /identity/v3/domains/default => generated 201 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9b46df-1ec1-4210-b89f-76c444ed7d4a None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb0152f-dc7a-452e-8fdd-4bcd02e5c498 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9b46df-1ec1-4210-b89f-76c444ed7d4a None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72880b8f-8bd1-4db0-9893-6d7193da14c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72880b8f-8bd1-4db0-9893-6d7193da14c1 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72880b8f-8bd1-4db0-9893-6d7193da14c1 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72880b8f-8bd1-4db0-9893-6d7193da14c1 None admin] PATH_INFO: `/v3/roles` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72880b8f-8bd1-4db0-9893-6d7193da14c1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72880b8f-8bd1-4db0-9893-6d7193da14c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72880b8f-8bd1-4db0-9893-6d7193da14c1 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 74/153] 10.27.203.238 () {56 vars in 1111 bytes} [Tue May 28 12:36:46 2024] GET /identity/v3/roles?name=anotherrole => generated 338 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72880b8f-8bd1-4db0-9893-6d7193da14c1 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652ba78f-7b77-4e2d-8315-7c4427e8a9c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652ba78f-7b77-4e2d-8315-7c4427e8a9c2 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652ba78f-7b77-4e2d-8315-7c4427e8a9c2 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652ba78f-7b77-4e2d-8315-7c4427e8a9c2 None admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652ba78f-7b77-4e2d-8315-7c4427e8a9c2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=51267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652ba78f-7b77-4e2d-8315-7c4427e8a9c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652ba78f-7b77-4e2d-8315-7c4427e8a9c2 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 80/154] 10.27.203.238 () {56 vars in 1099 bytes} [Tue May 28 12:36:46 2024] GET /identity/v3/roles?name=admin => generated 343 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652ba78f-7b77-4e2d-8315-7c4427e8a9c2 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72880b8f-8bd1-4db0-9893-6d7193da14c1 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652ba78f-7b77-4e2d-8315-7c4427e8a9c2 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:46 l75lg1-v1 dstat.sh[49771]: 28-05 12:36:46| 28 3 69 0 0|1593M 8149M 234M 5727M| 15k 740B| 0 212k| 0 14.0 |4607 7413 |1.79 0.91 0.65|3.0 0 40| 0 0 | 0 2048M| 19 32 0 12 0 May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e450c21-e76c-4190-8691-7975fcd9b237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e450c21-e76c-4190-8691-7975fcd9b237 None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e450c21-e76c-4190-8691-7975fcd9b237 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e450c21-e76c-4190-8691-7975fcd9b237 None admin] PATH_INFO: `/v3/users` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e450c21-e76c-4190-8691-7975fcd9b237 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e450c21-e76c-4190-8691-7975fcd9b237 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-8e450c21-e76c-4190-8691-7975fcd9b237 None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39b780f-cf8c-4a81-bba0-c09ff3974268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39b780f-cf8c-4a81-bba0-c09ff3974268 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39b780f-cf8c-4a81-bba0-c09ff3974268 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39b780f-cf8c-4a81-bba0-c09ff3974268 None admin] PATH_INFO: `/v3/users/5ea78bf33c1c4e3ca99b5d261e9bebf6` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39b780f-cf8c-4a81-bba0-c09ff3974268 None admin] RBAC: Authorizing `identity:get_user(user_id=5ea78bf33c1c4e3ca99b5d261e9bebf6)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39b780f-cf8c-4a81-bba0-c09ff3974268 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 81/155] 10.27.203.238 () {56 vars in 1177 bytes} [Tue May 28 12:36:46 2024] GET /identity/v3/users/5ea78bf33c1c4e3ca99b5d261e9bebf6 => generated 285 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39b780f-cf8c-4a81-bba0-c09ff3974268 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 75/156] 10.27.203.238 () {60 vars in 1132 bytes} [Tue May 28 12:36:46 2024] POST /identity/v3/users => generated 299 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e450c21-e76c-4190-8691-7975fcd9b237 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39b780f-cf8c-4a81-bba0-c09ff3974268 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e450c21-e76c-4190-8691-7975fcd9b237 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f6f12a-d6b5-464a-bc96-782a70dd2d8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f6f12a-d6b5-464a-bc96-782a70dd2d8e None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f6f12a-d6b5-464a-bc96-782a70dd2d8e None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f6f12a-d6b5-464a-bc96-782a70dd2d8e None admin] PATH_INFO: `/v3/users/5ea78bf33c1c4e3ca99b5d261e9bebf6` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f6f12a-d6b5-464a-bc96-782a70dd2d8e None admin] RBAC: Authorizing `identity:get_user(user_id=5ea78bf33c1c4e3ca99b5d261e9bebf6)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f6f12a-d6b5-464a-bc96-782a70dd2d8e None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 82/157] 10.27.203.238 () {56 vars in 1177 bytes} [Tue May 28 12:36:46 2024] GET /identity/v3/users/5ea78bf33c1c4e3ca99b5d261e9bebf6 => generated 285 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f6f12a-d6b5-464a-bc96-782a70dd2d8e None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ecb676-02a4-4b15-8e07-ca420d19b1a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ecb676-02a4-4b15-8e07-ca420d19b1a7 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ecb676-02a4-4b15-8e07-ca420d19b1a7 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ecb676-02a4-4b15-8e07-ca420d19b1a7 None admin] PATH_INFO: `/v3/projects/6694b9ccc35f48a680a684b41016b8db` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ecb676-02a4-4b15-8e07-ca420d19b1a7 None admin] RBAC: Authorizing `identity:get_project(project_id=6694b9ccc35f48a680a684b41016b8db)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ecb676-02a4-4b15-8e07-ca420d19b1a7 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 76/158] 10.27.203.238 () {56 vars in 1186 bytes} [Tue May 28 12:36:46 2024] GET /identity/v3/projects/6694b9ccc35f48a680a684b41016b8db => generated 304 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ecb676-02a4-4b15-8e07-ca420d19b1a7 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f6f12a-d6b5-464a-bc96-782a70dd2d8e None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ecb676-02a4-4b15-8e07-ca420d19b1a7 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf5f77b-2980-4419-8765-9f60b95caa1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf5f77b-2980-4419-8765-9f60b95caa1b None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf5f77b-2980-4419-8765-9f60b95caa1b None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf5f77b-2980-4419-8765-9f60b95caa1b None admin] PATH_INFO: `/v3/projects/6694b9ccc35f48a680a684b41016b8db` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf5f77b-2980-4419-8765-9f60b95caa1b None admin] RBAC: Authorizing `identity:get_project(project_id=6694b9ccc35f48a680a684b41016b8db)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf5f77b-2980-4419-8765-9f60b95caa1b None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 83/159] 10.27.203.238 () {56 vars in 1186 bytes} [Tue May 28 12:36:46 2024] GET /identity/v3/projects/6694b9ccc35f48a680a684b41016b8db => generated 304 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf5f77b-2980-4419-8765-9f60b95caa1b None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a54efd-42c0-4440-9e5a-8b8257616206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a54efd-42c0-4440-9e5a-8b8257616206 None admin] REQUEST_METHOD: `PUT` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a54efd-42c0-4440-9e5a-8b8257616206 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a54efd-42c0-4440-9e5a-8b8257616206 None admin] PATH_INFO: `/v3/projects/6694b9ccc35f48a680a684b41016b8db/users/5ea78bf33c1c4e3ca99b5d261e9bebf6/roles/67bacc33b83c4fc898309c1e5960a722` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a54efd-42c0-4440-9e5a-8b8257616206 None admin] RBAC: Authorizing `identity:create_grant(project_id=6694b9ccc35f48a680a684b41016b8db, user_id=5ea78bf33c1c4e3ca99b5d261e9bebf6, role_id=67bacc33b83c4fc898309c1e5960a722)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a54efd-42c0-4440-9e5a-8b8257616206 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 77/160] 10.27.203.238 () {58 vars in 1439 bytes} [Tue May 28 12:36:46 2024] PUT /identity/v3/projects/6694b9ccc35f48a680a684b41016b8db/users/5ea78bf33c1c4e3ca99b5d261e9bebf6/roles/67bacc33b83c4fc898309c1e5960a722 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf5f77b-2980-4419-8765-9f60b95caa1b None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f095b352-d90e-4cb2-b3fb-408a1a90d85e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f095b352-d90e-4cb2-b3fb-408a1a90d85e None admin] REQUEST_METHOD: `PUT` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f095b352-d90e-4cb2-b3fb-408a1a90d85e None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f095b352-d90e-4cb2-b3fb-408a1a90d85e None admin] PATH_INFO: `/v3/projects/6694b9ccc35f48a680a684b41016b8db/users/5ea78bf33c1c4e3ca99b5d261e9bebf6/roles/e7989893488f483baa107be56668c4f8` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f095b352-d90e-4cb2-b3fb-408a1a90d85e None admin] RBAC: Authorizing `identity:create_grant(project_id=6694b9ccc35f48a680a684b41016b8db, user_id=5ea78bf33c1c4e3ca99b5d261e9bebf6, role_id=e7989893488f483baa107be56668c4f8)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f095b352-d90e-4cb2-b3fb-408a1a90d85e None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:36:46 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 84/161] 10.27.203.238 () {58 vars in 1439 bytes} [Tue May 28 12:36:46 2024] PUT /identity/v3/projects/6694b9ccc35f48a680a684b41016b8db/users/5ea78bf33c1c4e3ca99b5d261e9bebf6/roles/e7989893488f483baa107be56668c4f8 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:36:47 l75lg1-v1 dstat.sh[49771]: 28-05 12:36:47| 32 5 62 0 0|1547M 8195M 234M 5727M| 19k 4632B| 0 604k| 0 64.0 |5234 7543 |1.79 0.91 0.65|4.0 0 170| 0 0 | 0 2048M| 19 29 0 12 0 May 28 12:36:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4724b9-a266-4bc2-99ec-2956c870fa5b None None] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4724b9-a266-4bc2-99ec-2956c870fa5b None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4724b9-a266-4bc2-99ec-2956c870fa5b None None] PATH_INFO: `/` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:47 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 78/162] 10.27.203.238 () {54 vars in 926 bytes} [Tue May 28 12:36:47 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:36:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8250b618-5d8a-4857-a549-5c959b5284d6 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8250b618-5d8a-4857-a549-5c959b5284d6 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8250b618-5d8a-4857-a549-5c959b5284d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:47 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-8250b618-5d8a-4857-a549-5c959b5284d6 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:36:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-8250b618-5d8a-4857-a549-5c959b5284d6 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:36:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-8250b618-5d8a-4857-a549-5c959b5284d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:36:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414bd031-22f5-4206-a11c-9c5d1d24a8f4 None None] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414bd031-22f5-4206-a11c-9c5d1d24a8f4 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414bd031-22f5-4206-a11c-9c5d1d24a8f4 None None] PATH_INFO: `/` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:47 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 79/163] 10.27.203.238 () {54 vars in 926 bytes} [Tue May 28 12:36:47 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:36:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e587d03-3c52-4dd0-b8c9-4f58bffddc6e None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e587d03-3c52-4dd0-b8c9-4f58bffddc6e None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e587d03-3c52-4dd0-b8c9-4f58bffddc6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:47 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-5e587d03-3c52-4dd0-b8c9-4f58bffddc6e None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:36:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-5e587d03-3c52-4dd0-b8c9-4f58bffddc6e None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:36:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-5e587d03-3c52-4dd0-b8c9-4f58bffddc6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:36:47 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 85/164] 10.27.203.238 () {58 vars in 1023 bytes} [Tue May 28 12:36:47 2024] POST /identity/v3/auth/tokens => generated 864 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 28 12:36:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41982355-ee14-414b-9b6f-b022d8e0318e None None] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41982355-ee14-414b-9b6f-b022d8e0318e None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41982355-ee14-414b-9b6f-b022d8e0318e None None] PATH_INFO: `/` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:47 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 86/165] 10.27.203.238 () {54 vars in 926 bytes} [Tue May 28 12:36:47 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:36:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dd98ec-68d9-437e-b10e-4f9b4e047a5f None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dd98ec-68d9-437e-b10e-4f9b4e047a5f None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dd98ec-68d9-437e-b10e-4f9b4e047a5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:47 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 80/166] 10.27.203.238 () {58 vars in 1023 bytes} [Tue May 28 12:36:47 2024] POST /identity/v3/auth/tokens => generated 864 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 28 12:36:47 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-40dd98ec-68d9-437e-b10e-4f9b4e047a5f None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:36:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-40dd98ec-68d9-437e-b10e-4f9b4e047a5f None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:36:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-40dd98ec-68d9-437e-b10e-4f9b4e047a5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:36:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b293fc59-f460-4072-bdfa-0cb8ff515922 None None] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b293fc59-f460-4072-bdfa-0cb8ff515922 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b293fc59-f460-4072-bdfa-0cb8ff515922 None None] PATH_INFO: `/` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:47 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 81/167] 10.27.203.238 () {54 vars in 926 bytes} [Tue May 28 12:36:47 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:36:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80af9dfc-665a-4359-a1f5-16898008af80 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80af9dfc-665a-4359-a1f5-16898008af80 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80af9dfc-665a-4359-a1f5-16898008af80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:47 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-80af9dfc-665a-4359-a1f5-16898008af80 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:36:47 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 87/168] 10.27.203.238 () {58 vars in 1023 bytes} [Tue May 28 12:36:47 2024] POST /identity/v3/auth/tokens => generated 864 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 28 12:36:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-80af9dfc-665a-4359-a1f5-16898008af80 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:36:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-80af9dfc-665a-4359-a1f5-16898008af80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 82/169] 10.27.203.238 () {58 vars in 1023 bytes} [Tue May 28 12:36:47 2024] POST /identity/v3/auth/tokens => generated 864 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dd98ec-68d9-437e-b10e-4f9b4e047a5f None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80af9dfc-665a-4359-a1f5-16898008af80 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dd98ec-68d9-437e-b10e-4f9b4e047a5f None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80af9dfc-665a-4359-a1f5-16898008af80 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cde228-024f-437d-811d-63484fbc4a92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cde228-024f-437d-811d-63484fbc4a92 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cde228-024f-437d-811d-63484fbc4a92 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cde228-024f-437d-811d-63484fbc4a92 None admin] PATH_INFO: `/v3/domains/default` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cde228-024f-437d-811d-63484fbc4a92 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cde228-024f-437d-811d-63484fbc4a92 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 88/170] 10.27.203.238 () {56 vars in 1108 bytes} [Tue May 28 12:36:48 2024] GET /identity/v3/domains/default => generated 201 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cde228-024f-437d-811d-63484fbc4a92 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebb4e42-9df5-4e8e-bf99-a49c552219a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebb4e42-9df5-4e8e-bf99-a49c552219a9 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebb4e42-9df5-4e8e-bf99-a49c552219a9 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebb4e42-9df5-4e8e-bf99-a49c552219a9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebb4e42-9df5-4e8e-bf99-a49c552219a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-7ebb4e42-9df5-4e8e-bf99-a49c552219a9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._get_role(role_id) May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1281, in get_role May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 83/171] 10.27.203.238 () {56 vars in 1099 bytes} [Tue May 28 12:36:48 2024] GET /identity/v3/roles/member => generated 84 bytes in 89 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebb4e42-9df5-4e8e-bf99-a49c552219a9 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cde228-024f-437d-811d-63484fbc4a92 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339ca1a6-ab5b-4cc0-8142-10a7b2eae3cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339ca1a6-ab5b-4cc0-8142-10a7b2eae3cf None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339ca1a6-ab5b-4cc0-8142-10a7b2eae3cf None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339ca1a6-ab5b-4cc0-8142-10a7b2eae3cf None admin] PATH_INFO: `/v3/users` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339ca1a6-ab5b-4cc0-8142-10a7b2eae3cf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339ca1a6-ab5b-4cc0-8142-10a7b2eae3cf None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebb4e42-9df5-4e8e-bf99-a49c552219a9 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-339ca1a6-ab5b-4cc0-8142-10a7b2eae3cf None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 12:36:48 l75lg1-v1 dstat.sh[49771]: 28-05 12:36:48| 36 3 60 0 0|1647M 8095M 234M 5727M| 19k 86B| 0 148k| 0 8.00 |4078 6157 |1.79 0.91 0.65|2.0 0 2.0| 0 0 | 0 2048M| 19 33 0 12 0 May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738ed7ac-f38d-4a91-828d-4fa63a54e03d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738ed7ac-f38d-4a91-828d-4fa63a54e03d None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738ed7ac-f38d-4a91-828d-4fa63a54e03d None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738ed7ac-f38d-4a91-828d-4fa63a54e03d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 89/172] 10.27.203.238 () {60 vars in 1132 bytes} [Tue May 28 12:36:48 2024] POST /identity/v3/users => generated 299 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339ca1a6-ab5b-4cc0-8142-10a7b2eae3cf None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738ed7ac-f38d-4a91-828d-4fa63a54e03d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-738ed7ac-f38d-4a91-828d-4fa63a54e03d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._get_role(role_id) May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1281, in get_role May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 84/173] 10.27.203.238 () {56 vars in 1114 bytes} [Tue May 28 12:36:48 2024] GET /identity/v3/roles/anotherrole => generated 89 bytes in 92 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738ed7ac-f38d-4a91-828d-4fa63a54e03d None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339ca1a6-ab5b-4cc0-8142-10a7b2eae3cf None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738ed7ac-f38d-4a91-828d-4fa63a54e03d None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e5555c-eb7b-4653-8e2f-66134780220b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e5555c-eb7b-4653-8e2f-66134780220b None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e5555c-eb7b-4653-8e2f-66134780220b None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e5555c-eb7b-4653-8e2f-66134780220b None admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e5555c-eb7b-4653-8e2f-66134780220b None admin] RBAC: Adding query filter params (name=member) {{(pid=51267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e5555c-eb7b-4653-8e2f-66134780220b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e5555c-eb7b-4653-8e2f-66134780220b None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 90/174] 10.27.203.238 () {56 vars in 1101 bytes} [Tue May 28 12:36:48 2024] GET /identity/v3/roles?name=member => generated 345 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e5555c-eb7b-4653-8e2f-66134780220b None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beeb3efc-69c8-48ed-8341-79cab6218dc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeb3efc-69c8-48ed-8341-79cab6218dc0 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeb3efc-69c8-48ed-8341-79cab6218dc0 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeb3efc-69c8-48ed-8341-79cab6218dc0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beeb3efc-69c8-48ed-8341-79cab6218dc0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-beeb3efc-69c8-48ed-8341-79cab6218dc0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._get_role(role_id) May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1281, in get_role May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 85/175] 10.27.203.238 () {56 vars in 1096 bytes} [Tue May 28 12:36:48 2024] GET /identity/v3/roles/admin => generated 83 bytes in 89 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beeb3efc-69c8-48ed-8341-79cab6218dc0 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e5555c-eb7b-4653-8e2f-66134780220b None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beeb3efc-69c8-48ed-8341-79cab6218dc0 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef32bf81-1a3d-4ba1-a679-b0c909ec8464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef32bf81-1a3d-4ba1-a679-b0c909ec8464 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef32bf81-1a3d-4ba1-a679-b0c909ec8464 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef32bf81-1a3d-4ba1-a679-b0c909ec8464 None admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef32bf81-1a3d-4ba1-a679-b0c909ec8464 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=51267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef32bf81-1a3d-4ba1-a679-b0c909ec8464 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef32bf81-1a3d-4ba1-a679-b0c909ec8464 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 91/176] 10.27.203.238 () {56 vars in 1111 bytes} [Tue May 28 12:36:48 2024] GET /identity/v3/roles?name=anotherrole => generated 338 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef32bf81-1a3d-4ba1-a679-b0c909ec8464 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a078d4e9-a8ba-4f52-836f-e71ab78cce50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a078d4e9-a8ba-4f52-836f-e71ab78cce50 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a078d4e9-a8ba-4f52-836f-e71ab78cce50 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a078d4e9-a8ba-4f52-836f-e71ab78cce50 None admin] PATH_INFO: `/v3/users/791678a80aaa475ea0bab12b006b0249` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a078d4e9-a8ba-4f52-836f-e71ab78cce50 None admin] RBAC: Authorizing `identity:get_user(user_id=791678a80aaa475ea0bab12b006b0249)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a078d4e9-a8ba-4f52-836f-e71ab78cce50 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 86/177] 10.27.203.238 () {56 vars in 1177 bytes} [Tue May 28 12:36:48 2024] GET /identity/v3/users/791678a80aaa475ea0bab12b006b0249 => generated 299 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a078d4e9-a8ba-4f52-836f-e71ab78cce50 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef32bf81-1a3d-4ba1-a679-b0c909ec8464 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a078d4e9-a8ba-4f52-836f-e71ab78cce50 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8cfa7a-ada5-4c81-9a4e-4aeb5e6eef2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8cfa7a-ada5-4c81-9a4e-4aeb5e6eef2a None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8cfa7a-ada5-4c81-9a4e-4aeb5e6eef2a None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8cfa7a-ada5-4c81-9a4e-4aeb5e6eef2a None admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8cfa7a-ada5-4c81-9a4e-4aeb5e6eef2a None admin] RBAC: Adding query filter params (name=admin) {{(pid=51267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8cfa7a-ada5-4c81-9a4e-4aeb5e6eef2a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8cfa7a-ada5-4c81-9a4e-4aeb5e6eef2a None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 92/178] 10.27.203.238 () {56 vars in 1099 bytes} [Tue May 28 12:36:48 2024] GET /identity/v3/roles?name=admin => generated 343 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8cfa7a-ada5-4c81-9a4e-4aeb5e6eef2a None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee57f31-e90c-4edf-ba3a-c6b9c0a316c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee57f31-e90c-4edf-ba3a-c6b9c0a316c6 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee57f31-e90c-4edf-ba3a-c6b9c0a316c6 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee57f31-e90c-4edf-ba3a-c6b9c0a316c6 None admin] PATH_INFO: `/v3/users/5ea78bf33c1c4e3ca99b5d261e9bebf6` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee57f31-e90c-4edf-ba3a-c6b9c0a316c6 None admin] RBAC: Authorizing `identity:get_user(user_id=5ea78bf33c1c4e3ca99b5d261e9bebf6)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee57f31-e90c-4edf-ba3a-c6b9c0a316c6 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 87/179] 10.27.203.238 () {56 vars in 1177 bytes} [Tue May 28 12:36:48 2024] GET /identity/v3/users/5ea78bf33c1c4e3ca99b5d261e9bebf6 => generated 285 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee57f31-e90c-4edf-ba3a-c6b9c0a316c6 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8cfa7a-ada5-4c81-9a4e-4aeb5e6eef2a None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee57f31-e90c-4edf-ba3a-c6b9c0a316c6 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c52c1c-7504-41ee-8b9e-e4deacb13366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c52c1c-7504-41ee-8b9e-e4deacb13366 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c52c1c-7504-41ee-8b9e-e4deacb13366 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c52c1c-7504-41ee-8b9e-e4deacb13366 None admin] PATH_INFO: `/v3/projects/6694b9ccc35f48a680a684b41016b8db` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c52c1c-7504-41ee-8b9e-e4deacb13366 None admin] RBAC: Authorizing `identity:get_project(project_id=6694b9ccc35f48a680a684b41016b8db)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c52c1c-7504-41ee-8b9e-e4deacb13366 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 93/180] 10.27.203.238 () {56 vars in 1186 bytes} [Tue May 28 12:36:48 2024] GET /identity/v3/projects/6694b9ccc35f48a680a684b41016b8db => generated 304 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c52c1c-7504-41ee-8b9e-e4deacb13366 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5888a8c-2be9-4256-bfcb-464d5fa61db5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5888a8c-2be9-4256-bfcb-464d5fa61db5 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5888a8c-2be9-4256-bfcb-464d5fa61db5 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5888a8c-2be9-4256-bfcb-464d5fa61db5 None admin] PATH_INFO: `/v3/users/5ea78bf33c1c4e3ca99b5d261e9bebf6` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5888a8c-2be9-4256-bfcb-464d5fa61db5 None admin] RBAC: Authorizing `identity:get_user(user_id=5ea78bf33c1c4e3ca99b5d261e9bebf6)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5888a8c-2be9-4256-bfcb-464d5fa61db5 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 88/181] 10.27.203.238 () {56 vars in 1177 bytes} [Tue May 28 12:36:48 2024] GET /identity/v3/users/5ea78bf33c1c4e3ca99b5d261e9bebf6 => generated 285 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5888a8c-2be9-4256-bfcb-464d5fa61db5 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c52c1c-7504-41ee-8b9e-e4deacb13366 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5888a8c-2be9-4256-bfcb-464d5fa61db5 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a025f4d6-fc18-4fa6-b4ff-bedb21878bd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a025f4d6-fc18-4fa6-b4ff-bedb21878bd1 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a025f4d6-fc18-4fa6-b4ff-bedb21878bd1 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a025f4d6-fc18-4fa6-b4ff-bedb21878bd1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d10783-dece-488c-9f12-7764082dc27b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d10783-dece-488c-9f12-7764082dc27b None admin] REQUEST_METHOD: `PUT` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d10783-dece-488c-9f12-7764082dc27b None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d10783-dece-488c-9f12-7764082dc27b None admin] PATH_INFO: `/v3/projects/6694b9ccc35f48a680a684b41016b8db/users/791678a80aaa475ea0bab12b006b0249/roles/44620cad10ae407c90c91e2c296adb04` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d10783-dece-488c-9f12-7764082dc27b None admin] RBAC: Authorizing `identity:create_grant(project_id=6694b9ccc35f48a680a684b41016b8db, user_id=791678a80aaa475ea0bab12b006b0249, role_id=44620cad10ae407c90c91e2c296adb04)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d10783-dece-488c-9f12-7764082dc27b None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a025f4d6-fc18-4fa6-b4ff-bedb21878bd1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a025f4d6-fc18-4fa6-b4ff-bedb21878bd1 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 89/182] 10.27.203.238 () {58 vars in 1439 bytes} [Tue May 28 12:36:48 2024] PUT /identity/v3/projects/6694b9ccc35f48a680a684b41016b8db/users/791678a80aaa475ea0bab12b006b0249/roles/44620cad10ae407c90c91e2c296adb04 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d10783-dece-488c-9f12-7764082dc27b None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 94/183] 10.27.203.238 () {58 vars in 1282 bytes} [Tue May 28 12:36:48 2024] GET /identity/v3/auth/tokens => generated 864 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a025f4d6-fc18-4fa6-b4ff-bedb21878bd1 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d10783-dece-488c-9f12-7764082dc27b None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef33308-57e9-4777-bc69-aba04c8c1578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef33308-57e9-4777-bc69-aba04c8c1578 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef33308-57e9-4777-bc69-aba04c8c1578 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef33308-57e9-4777-bc69-aba04c8c1578 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a025f4d6-fc18-4fa6-b4ff-bedb21878bd1 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef33308-57e9-4777-bc69-aba04c8c1578 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef33308-57e9-4777-bc69-aba04c8c1578 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad228f8-727d-490d-b015-a34cbdef7261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad228f8-727d-490d-b015-a34cbdef7261 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad228f8-727d-490d-b015-a34cbdef7261 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad228f8-727d-490d-b015-a34cbdef7261 None admin] PATH_INFO: `/v3/projects/6694b9ccc35f48a680a684b41016b8db` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad228f8-727d-490d-b015-a34cbdef7261 None admin] RBAC: Authorizing `identity:get_project(project_id=6694b9ccc35f48a680a684b41016b8db)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad228f8-727d-490d-b015-a34cbdef7261 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 95/184] 10.27.203.238 () {56 vars in 1186 bytes} [Tue May 28 12:36:48 2024] GET /identity/v3/projects/6694b9ccc35f48a680a684b41016b8db => generated 304 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad228f8-727d-490d-b015-a34cbdef7261 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 90/185] 10.27.203.238 () {58 vars in 1282 bytes} [Tue May 28 12:36:48 2024] GET /identity/v3/auth/tokens => generated 864 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef33308-57e9-4777-bc69-aba04c8c1578 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad228f8-727d-490d-b015-a34cbdef7261 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62ab7b8-f7f2-41ba-abfe-70cf54d27a70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62ab7b8-f7f2-41ba-abfe-70cf54d27a70 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62ab7b8-f7f2-41ba-abfe-70cf54d27a70 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62ab7b8-f7f2-41ba-abfe-70cf54d27a70 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62ab7b8-f7f2-41ba-abfe-70cf54d27a70 None admin] RBAC: Adding query filter params (role.id=67bacc33b83c4fc898309c1e5960a722, scope.project.id=6694b9ccc35f48a680a684b41016b8db, user.id=5ea78bf33c1c4e3ca99b5d261e9bebf6) {{(pid=51267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62ab7b8-f7f2-41ba-abfe-70cf54d27a70 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62ab7b8-f7f2-41ba-abfe-70cf54d27a70 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 96/186] 10.27.203.238 () {56 vars in 1374 bytes} [Tue May 28 12:36:48 2024] GET /identity/v3/role_assignments?user.id=5ea78bf33c1c4e3ca99b5d261e9bebf6&scope.project.id=6694b9ccc35f48a680a684b41016b8db&role.id=67bacc33b83c4fc898309c1e5960a722 => generated 612 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef33308-57e9-4777-bc69-aba04c8c1578 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ecdd20-4ed9-4a33-a26c-c97bb657140a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ecdd20-4ed9-4a33-a26c-c97bb657140a None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ecdd20-4ed9-4a33-a26c-c97bb657140a None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ecdd20-4ed9-4a33-a26c-c97bb657140a None admin] PATH_INFO: `/v3/projects/6694b9ccc35f48a680a684b41016b8db` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ecdd20-4ed9-4a33-a26c-c97bb657140a None admin] RBAC: Authorizing `identity:get_project(project_id=6694b9ccc35f48a680a684b41016b8db)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ecdd20-4ed9-4a33-a26c-c97bb657140a None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 91/187] 10.27.203.238 () {56 vars in 1186 bytes} [Tue May 28 12:36:48 2024] GET /identity/v3/projects/6694b9ccc35f48a680a684b41016b8db => generated 304 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:36:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62ab7b8-f7f2-41ba-abfe-70cf54d27a70 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62ab7b8-f7f2-41ba-abfe-70cf54d27a70 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008a05ce-3539-44a2-b97f-3c625d481501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008a05ce-3539-44a2-b97f-3c625d481501 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008a05ce-3539-44a2-b97f-3c625d481501 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008a05ce-3539-44a2-b97f-3c625d481501 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008a05ce-3539-44a2-b97f-3c625d481501 None admin] RBAC: Adding query filter params (role.id=e7989893488f483baa107be56668c4f8, scope.project.id=6694b9ccc35f48a680a684b41016b8db, user.id=5ea78bf33c1c4e3ca99b5d261e9bebf6) {{(pid=51267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:36:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008a05ce-3539-44a2-b97f-3c625d481501 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:36:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008a05ce-3539-44a2-b97f-3c625d481501 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:36:49 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 97/188] 10.27.203.238 () {56 vars in 1374 bytes} [Tue May 28 12:36:48 2024] GET /identity/v3/role_assignments?user.id=5ea78bf33c1c4e3ca99b5d261e9bebf6&scope.project.id=6694b9ccc35f48a680a684b41016b8db&role.id=e7989893488f483baa107be56668c4f8 => generated 612 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:36:49 l75lg1-v1 dstat.sh[49771]: 28-05 12:36:49| 37 6 57 0 0|1501M 8241M 234M 5727M| 21k 5243B| 0 464k| 0 54.0 |9417 16k|1.79 0.91 0.65|4.0 0 205| 0 0 | 0 2048M| 19 29 0 12 0 May 28 12:36:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2279f27-b922-400f-a1f9-4f2db6741e04 None None] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2279f27-b922-400f-a1f9-4f2db6741e04 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2279f27-b922-400f-a1f9-4f2db6741e04 None None] PATH_INFO: `/` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:49 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 92/189] 10.27.203.238 () {54 vars in 926 bytes} [Tue May 28 12:36:49 2024] GET /identity => generated 272 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:36:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4244539e-fcae-4ab7-9f8d-7bd1c8645727 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4244539e-fcae-4ab7-9f8d-7bd1c8645727 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4244539e-fcae-4ab7-9f8d-7bd1c8645727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:49 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-4244539e-fcae-4ab7-9f8d-7bd1c8645727 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:36:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-4244539e-fcae-4ab7-9f8d-7bd1c8645727 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:36:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-4244539e-fcae-4ab7-9f8d-7bd1c8645727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:36:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e884ff03-90cc-42c3-9da4-11b25feaf562 None None] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e884ff03-90cc-42c3-9da4-11b25feaf562 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e884ff03-90cc-42c3-9da4-11b25feaf562 None None] PATH_INFO: `/` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:49 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 93/190] 10.27.203.238 () {54 vars in 926 bytes} [Tue May 28 12:36:49 2024] GET /identity => generated 272 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:36:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abadfa8c-4830-4740-ae9a-c509cf830108 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abadfa8c-4830-4740-ae9a-c509cf830108 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abadfa8c-4830-4740-ae9a-c509cf830108 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:49 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 98/191] 10.27.203.238 () {58 vars in 1023 bytes} [Tue May 28 12:36:49 2024] POST /identity/v3/auth/tokens => generated 864 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 28 12:36:49 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-abadfa8c-4830-4740-ae9a-c509cf830108 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:36:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-abadfa8c-4830-4740-ae9a-c509cf830108 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:36:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-abadfa8c-4830-4740-ae9a-c509cf830108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:36:49 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 94/192] 10.27.203.238 () {58 vars in 1023 bytes} [Tue May 28 12:36:49 2024] POST /identity/v3/auth/tokens => generated 864 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 28 12:36:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4244539e-fcae-4ab7-9f8d-7bd1c8645727 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4244539e-fcae-4ab7-9f8d-7bd1c8645727 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abadfa8c-4830-4740-ae9a-c509cf830108 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9bea30-fdb2-412e-9d3a-c53a9a3e80ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9bea30-fdb2-412e-9d3a-c53a9a3e80ad None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9bea30-fdb2-412e-9d3a-c53a9a3e80ad None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9bea30-fdb2-412e-9d3a-c53a9a3e80ad None admin] PATH_INFO: `/v3/roles/reader` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9bea30-fdb2-412e-9d3a-c53a9a3e80ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-1f9bea30-fdb2-412e-9d3a-c53a9a3e80ad None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._get_role(role_id) May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1281, in get_role May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 99/193] 10.27.203.238 () {56 vars in 1099 bytes} [Tue May 28 12:36:49 2024] GET /identity/v3/roles/reader => generated 84 bytes in 90 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9bea30-fdb2-412e-9d3a-c53a9a3e80ad None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abadfa8c-4830-4740-ae9a-c509cf830108 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f037829-b994-489c-9d48-a4849689878f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f037829-b994-489c-9d48-a4849689878f None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f037829-b994-489c-9d48-a4849689878f None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f037829-b994-489c-9d48-a4849689878f None admin] PATH_INFO: `/v3/domains/default` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f037829-b994-489c-9d48-a4849689878f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f037829-b994-489c-9d48-a4849689878f None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 95/194] 10.27.203.238 () {56 vars in 1108 bytes} [Tue May 28 12:36:50 2024] GET /identity/v3/domains/default => generated 201 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9bea30-fdb2-412e-9d3a-c53a9a3e80ad None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f037829-b994-489c-9d48-a4849689878f None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab766f7-544c-4368-b595-4b645a8a2f77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab766f7-544c-4368-b595-4b645a8a2f77 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab766f7-544c-4368-b595-4b645a8a2f77 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab766f7-544c-4368-b595-4b645a8a2f77 None admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab766f7-544c-4368-b595-4b645a8a2f77 None admin] RBAC: Adding query filter params (name=reader) {{(pid=51267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab766f7-544c-4368-b595-4b645a8a2f77 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab766f7-544c-4368-b595-4b645a8a2f77 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 100/195] 10.27.203.238 () {56 vars in 1101 bytes} [Tue May 28 12:36:50 2024] GET /identity/v3/roles?name=reader => generated 345 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8c9b59-a530-4685-a019-8e0255c42a6c None None] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8c9b59-a530-4685-a019-8e0255c42a6c None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8c9b59-a530-4685-a019-8e0255c42a6c None None] PATH_INFO: `/` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 101/196] 10.27.203.238 () {54 vars in 926 bytes} [Tue May 28 12:36:50 2024] GET /identity => generated 272 bytes in 1 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8c9b59-a530-4685-a019-8e0255c42a6c None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f037829-b994-489c-9d48-a4849689878f None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5c0c04-a919-423c-8bea-d1dfa0c3f0e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5c0c04-a919-423c-8bea-d1dfa0c3f0e2 None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5c0c04-a919-423c-8bea-d1dfa0c3f0e2 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5c0c04-a919-423c-8bea-d1dfa0c3f0e2 None admin] PATH_INFO: `/v3/users` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5c0c04-a919-423c-8bea-d1dfa0c3f0e2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5c0c04-a919-423c-8bea-d1dfa0c3f0e2 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-8a5c0c04-a919-423c-8bea-d1dfa0c3f0e2 None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8c9b59-a530-4685-a019-8e0255c42a6c None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:50 l75lg1-v1 dstat.sh[49771]: 28-05 12:36:50| 27 3 69 0 0|1588M 8153M 234M 5727M| 15k 244B| 0 648k| 0 33.0 |4479 6615 |1.79 0.91 0.65|2.0 1.0 25| 0 0 | 0 2048M| 19 32 0 9 0 May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 96/197] 10.27.203.238 () {60 vars in 1132 bytes} [Tue May 28 12:36:50 2024] POST /identity/v3/users => generated 295 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88735aa-8e22-4c56-9815-afffa3f691b5 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88735aa-8e22-4c56-9815-afffa3f691b5 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88735aa-8e22-4c56-9815-afffa3f691b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a362b2-c640-494c-9374-33be6d78ae76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a362b2-c640-494c-9374-33be6d78ae76 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a362b2-c640-494c-9374-33be6d78ae76 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a362b2-c640-494c-9374-33be6d78ae76 None admin] PATH_INFO: `/v3/users/aed1000f912a4ef295cd062e1ba15dcf` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-e88735aa-8e22-4c56-9815-afffa3f691b5 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-e88735aa-8e22-4c56-9815-afffa3f691b5 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-e88735aa-8e22-4c56-9815-afffa3f691b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a362b2-c640-494c-9374-33be6d78ae76 None admin] RBAC: Authorizing `identity:get_user(user_id=aed1000f912a4ef295cd062e1ba15dcf)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a362b2-c640-494c-9374-33be6d78ae76 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 102/198] 10.27.203.238 () {56 vars in 1177 bytes} [Tue May 28 12:36:50 2024] GET /identity/v3/users/aed1000f912a4ef295cd062e1ba15dcf => generated 299 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a362b2-c640-494c-9374-33be6d78ae76 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a362b2-c640-494c-9374-33be6d78ae76 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 97/199] 10.27.203.238 () {58 vars in 1023 bytes} [Tue May 28 12:36:50 2024] POST /identity/v3/auth/tokens => generated 864 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe1e254-bbd1-42ba-99df-73b23ab835f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe1e254-bbd1-42ba-99df-73b23ab835f9 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe1e254-bbd1-42ba-99df-73b23ab835f9 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe1e254-bbd1-42ba-99df-73b23ab835f9 None admin] PATH_INFO: `/v3/projects/6694b9ccc35f48a680a684b41016b8db` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe1e254-bbd1-42ba-99df-73b23ab835f9 None admin] RBAC: Authorizing `identity:get_project(project_id=6694b9ccc35f48a680a684b41016b8db)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe1e254-bbd1-42ba-99df-73b23ab835f9 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 103/200] 10.27.203.238 () {56 vars in 1186 bytes} [Tue May 28 12:36:50 2024] GET /identity/v3/projects/6694b9ccc35f48a680a684b41016b8db => generated 304 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88735aa-8e22-4c56-9815-afffa3f691b5 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88735aa-8e22-4c56-9815-afffa3f691b5 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99250e4f-db21-484a-9c35-d9aa80b3fcf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99250e4f-db21-484a-9c35-d9aa80b3fcf4 None admin] REQUEST_METHOD: `PUT` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99250e4f-db21-484a-9c35-d9aa80b3fcf4 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99250e4f-db21-484a-9c35-d9aa80b3fcf4 None admin] PATH_INFO: `/v3/projects/6694b9ccc35f48a680a684b41016b8db/users/aed1000f912a4ef295cd062e1ba15dcf/roles/20fc3860247242838aac793d192b83dc` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99250e4f-db21-484a-9c35-d9aa80b3fcf4 None admin] RBAC: Authorizing `identity:create_grant(project_id=6694b9ccc35f48a680a684b41016b8db, user_id=aed1000f912a4ef295cd062e1ba15dcf, role_id=20fc3860247242838aac793d192b83dc)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99250e4f-db21-484a-9c35-d9aa80b3fcf4 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 98/201] 10.27.203.238 () {58 vars in 1439 bytes} [Tue May 28 12:36:50 2024] PUT /identity/v3/projects/6694b9ccc35f48a680a684b41016b8db/users/aed1000f912a4ef295cd062e1ba15dcf/roles/20fc3860247242838aac793d192b83dc => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe1e254-bbd1-42ba-99df-73b23ab835f9 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe1e254-bbd1-42ba-99df-73b23ab835f9 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f618002-98c4-4f5d-b635-2602fcdf1254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f618002-98c4-4f5d-b635-2602fcdf1254 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f618002-98c4-4f5d-b635-2602fcdf1254 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f618002-98c4-4f5d-b635-2602fcdf1254 None admin] PATH_INFO: `/v3/roles/member` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f618002-98c4-4f5d-b635-2602fcdf1254 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-8f618002-98c4-4f5d-b635-2602fcdf1254 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._get_role(role_id) May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1281, in get_role May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 104/202] 10.27.203.238 () {56 vars in 1099 bytes} [Tue May 28 12:36:50 2024] GET /identity/v3/roles/member => generated 84 bytes in 102 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99250e4f-db21-484a-9c35-d9aa80b3fcf4 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99250e4f-db21-484a-9c35-d9aa80b3fcf4 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746d4f31-220a-43e7-bae7-458881234a91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746d4f31-220a-43e7-bae7-458881234a91 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746d4f31-220a-43e7-bae7-458881234a91 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746d4f31-220a-43e7-bae7-458881234a91 None admin] PATH_INFO: `/v3/roles` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746d4f31-220a-43e7-bae7-458881234a91 None admin] RBAC: Adding query filter params (name=member) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746d4f31-220a-43e7-bae7-458881234a91 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746d4f31-220a-43e7-bae7-458881234a91 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 99/203] 10.27.203.238 () {56 vars in 1101 bytes} [Tue May 28 12:36:50 2024] GET /identity/v3/roles?name=member => generated 345 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f618002-98c4-4f5d-b635-2602fcdf1254 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f618002-98c4-4f5d-b635-2602fcdf1254 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b39ea7-f293-45c1-940e-9941e0dbf596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b39ea7-f293-45c1-940e-9941e0dbf596 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b39ea7-f293-45c1-940e-9941e0dbf596 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b39ea7-f293-45c1-940e-9941e0dbf596 None admin] PATH_INFO: `/v3/users/791678a80aaa475ea0bab12b006b0249` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b39ea7-f293-45c1-940e-9941e0dbf596 None admin] RBAC: Authorizing `identity:get_user(user_id=791678a80aaa475ea0bab12b006b0249)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b39ea7-f293-45c1-940e-9941e0dbf596 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 105/204] 10.27.203.238 () {56 vars in 1177 bytes} [Tue May 28 12:36:50 2024] GET /identity/v3/users/791678a80aaa475ea0bab12b006b0249 => generated 299 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746d4f31-220a-43e7-bae7-458881234a91 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746d4f31-220a-43e7-bae7-458881234a91 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d477624b-7190-493f-a287-e6302e03a769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d477624b-7190-493f-a287-e6302e03a769 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d477624b-7190-493f-a287-e6302e03a769 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d477624b-7190-493f-a287-e6302e03a769 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d477624b-7190-493f-a287-e6302e03a769 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d477624b-7190-493f-a287-e6302e03a769 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 100/205] 10.27.203.238 () {58 vars in 1282 bytes} [Tue May 28 12:36:50 2024] GET /identity/v3/auth/tokens => generated 864 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 28 12:36:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b39ea7-f293-45c1-940e-9941e0dbf596 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b39ea7-f293-45c1-940e-9941e0dbf596 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a240543-4abf-4b3c-9f6b-8e0fb101f3d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a240543-4abf-4b3c-9f6b-8e0fb101f3d0 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a240543-4abf-4b3c-9f6b-8e0fb101f3d0 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a240543-4abf-4b3c-9f6b-8e0fb101f3d0 None admin] PATH_INFO: `/v3/projects/6694b9ccc35f48a680a684b41016b8db` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a240543-4abf-4b3c-9f6b-8e0fb101f3d0 None admin] RBAC: Authorizing `identity:get_project(project_id=6694b9ccc35f48a680a684b41016b8db)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:36:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a240543-4abf-4b3c-9f6b-8e0fb101f3d0 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:36:51 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 106/206] 10.27.203.238 () {56 vars in 1186 bytes} [Tue May 28 12:36:50 2024] GET /identity/v3/projects/6694b9ccc35f48a680a684b41016b8db => generated 304 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:36:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d477624b-7190-493f-a287-e6302e03a769 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d477624b-7190-493f-a287-e6302e03a769 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3cd087-386a-4944-9e2d-15db89cbe003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3cd087-386a-4944-9e2d-15db89cbe003 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3cd087-386a-4944-9e2d-15db89cbe003 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3cd087-386a-4944-9e2d-15db89cbe003 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3cd087-386a-4944-9e2d-15db89cbe003 None admin] RBAC: Adding query filter params (role.id=44620cad10ae407c90c91e2c296adb04, scope.project.id=6694b9ccc35f48a680a684b41016b8db, user.id=791678a80aaa475ea0bab12b006b0249) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:36:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3cd087-386a-4944-9e2d-15db89cbe003 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:36:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3cd087-386a-4944-9e2d-15db89cbe003 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:36:51 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 101/207] 10.27.203.238 () {56 vars in 1374 bytes} [Tue May 28 12:36:51 2024] GET /identity/v3/role_assignments?user.id=791678a80aaa475ea0bab12b006b0249&scope.project.id=6694b9ccc35f48a680a684b41016b8db&role.id=44620cad10ae407c90c91e2c296adb04 => generated 612 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:36:51 l75lg1-v1 dstat.sh[49771]: 28-05 12:36:51| 33 5 61 0 0|1573M 8168M 234M 5728M| 25k 4345B| 0 784k| 0 63.0 |6839 10k|1.97 0.96 0.67|4.0 0 165| 0 0 | 0 2048M| 19 29 0 9 0 May 28 12:36:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a105049c-bddd-45e4-9246-b2c17fdd3eb4 None None] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a105049c-bddd-45e4-9246-b2c17fdd3eb4 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a105049c-bddd-45e4-9246-b2c17fdd3eb4 None None] PATH_INFO: `/` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:51 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 107/208] 10.27.203.238 () {54 vars in 926 bytes} [Tue May 28 12:36:51 2024] GET /identity => generated 272 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:36:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0137ecf8-e8cb-44f9-b447-90ed988a94f3 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0137ecf8-e8cb-44f9-b447-90ed988a94f3 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0137ecf8-e8cb-44f9-b447-90ed988a94f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078627ac-7c9b-41ff-96e0-f3ff16bde340 None None] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078627ac-7c9b-41ff-96e0-f3ff16bde340 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078627ac-7c9b-41ff-96e0-f3ff16bde340 None None] PATH_INFO: `/` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:51 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 108/209] 10.27.203.238 () {54 vars in 926 bytes} [Tue May 28 12:36:51 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:36:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca69a37-e8bf-4a54-82f5-8c6ad30c86d6 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca69a37-e8bf-4a54-82f5-8c6ad30c86d6 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca69a37-e8bf-4a54-82f5-8c6ad30c86d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:51 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-0137ecf8-e8cb-44f9-b447-90ed988a94f3 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:36:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-0137ecf8-e8cb-44f9-b447-90ed988a94f3 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:36:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-0137ecf8-e8cb-44f9-b447-90ed988a94f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:36:51 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-bca69a37-e8bf-4a54-82f5-8c6ad30c86d6 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:36:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-bca69a37-e8bf-4a54-82f5-8c6ad30c86d6 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:36:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-bca69a37-e8bf-4a54-82f5-8c6ad30c86d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:36:51 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 102/210] 10.27.203.238 () {58 vars in 1023 bytes} [Tue May 28 12:36:51 2024] POST /identity/v3/auth/tokens => generated 864 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 28 12:36:51 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 109/211] 10.27.203.238 () {58 vars in 1023 bytes} [Tue May 28 12:36:51 2024] POST /identity/v3/auth/tokens => generated 864 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 28 12:36:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b19363-6ac5-4ad3-9987-24a28dba4ed7 None None] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b19363-6ac5-4ad3-9987-24a28dba4ed7 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b19363-6ac5-4ad3-9987-24a28dba4ed7 None None] PATH_INFO: `/` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:51 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 103/212] 10.27.203.238 () {54 vars in 926 bytes} [Tue May 28 12:36:51 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:36:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f772db6-97b3-4e34-b8c9-ec84c1f9cda9 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f772db6-97b3-4e34-b8c9-ec84c1f9cda9 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f772db6-97b3-4e34-b8c9-ec84c1f9cda9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:51 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-2f772db6-97b3-4e34-b8c9-ec84c1f9cda9 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:36:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-2f772db6-97b3-4e34-b8c9-ec84c1f9cda9 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:36:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-2f772db6-97b3-4e34-b8c9-ec84c1f9cda9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:36:51 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 110/213] 10.27.203.238 () {58 vars in 1023 bytes} [Tue May 28 12:36:51 2024] POST /identity/v3/auth/tokens => generated 864 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b19363-6ac5-4ad3-9987-24a28dba4ed7 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f772db6-97b3-4e34-b8c9-ec84c1f9cda9 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b19363-6ac5-4ad3-9987-24a28dba4ed7 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f772db6-97b3-4e34-b8c9-ec84c1f9cda9 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d145257b-12b4-4354-a623-11782c7d46a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d145257b-12b4-4354-a623-11782c7d46a6 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d145257b-12b4-4354-a623-11782c7d46a6 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d145257b-12b4-4354-a623-11782c7d46a6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325c279f-5ecf-4aac-89f8-541fff2c25cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325c279f-5ecf-4aac-89f8-541fff2c25cc None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325c279f-5ecf-4aac-89f8-541fff2c25cc None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325c279f-5ecf-4aac-89f8-541fff2c25cc None admin] PATH_INFO: `/v3/domains/default` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325c279f-5ecf-4aac-89f8-541fff2c25cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325c279f-5ecf-4aac-89f8-541fff2c25cc None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 111/214] 10.27.203.238 () {56 vars in 1108 bytes} [Tue May 28 12:36:52 2024] GET /identity/v3/domains/default => generated 201 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d145257b-12b4-4354-a623-11782c7d46a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325c279f-5ecf-4aac-89f8-541fff2c25cc None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-d145257b-12b4-4354-a623-11782c7d46a6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._get_role(role_id) May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1281, in get_role May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 104/215] 10.27.203.238 () {56 vars in 1099 bytes} [Tue May 28 12:36:52 2024] GET /identity/v3/roles/reader => generated 84 bytes in 98 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d145257b-12b4-4354-a623-11782c7d46a6 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d145257b-12b4-4354-a623-11782c7d46a6 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:52 l75lg1-v1 dstat.sh[49771]: 28-05 12:36:52| 28 3 69 0 0|1591M 8150M 234M 5728M| 22k 748B| 0 5149k| 0 262 |3591 4971 |1.97 0.96 0.67|2.0 0 40| 0 0 | 0 2048M| 19 32 0 9 0 May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325c279f-5ecf-4aac-89f8-541fff2c25cc None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308736cb-7c8e-4b47-8cb8-77b8c5e9efd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308736cb-7c8e-4b47-8cb8-77b8c5e9efd7 None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308736cb-7c8e-4b47-8cb8-77b8c5e9efd7 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308736cb-7c8e-4b47-8cb8-77b8c5e9efd7 None admin] PATH_INFO: `/v3/users` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308736cb-7c8e-4b47-8cb8-77b8c5e9efd7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308736cb-7c8e-4b47-8cb8-77b8c5e9efd7 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-308736cb-7c8e-4b47-8cb8-77b8c5e9efd7 None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653de421-912b-4b07-8cec-6fb0c9aa5788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653de421-912b-4b07-8cec-6fb0c9aa5788 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653de421-912b-4b07-8cec-6fb0c9aa5788 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653de421-912b-4b07-8cec-6fb0c9aa5788 None admin] PATH_INFO: `/v3/roles/member` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653de421-912b-4b07-8cec-6fb0c9aa5788 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-653de421-912b-4b07-8cec-6fb0c9aa5788 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._get_role(role_id) May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1281, in get_role May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 112/216] 10.27.203.238 () {56 vars in 1099 bytes} [Tue May 28 12:36:52 2024] GET /identity/v3/roles/member => generated 84 bytes in 103 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653de421-912b-4b07-8cec-6fb0c9aa5788 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 105/217] 10.27.203.238 () {60 vars in 1132 bytes} [Tue May 28 12:36:52 2024] POST /identity/v3/users => generated 295 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308736cb-7c8e-4b47-8cb8-77b8c5e9efd7 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653de421-912b-4b07-8cec-6fb0c9aa5788 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308736cb-7c8e-4b47-8cb8-77b8c5e9efd7 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7293134-0dcb-4ae6-8091-f5ac4e805e2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7293134-0dcb-4ae6-8091-f5ac4e805e2d None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7293134-0dcb-4ae6-8091-f5ac4e805e2d None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7293134-0dcb-4ae6-8091-f5ac4e805e2d None admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7293134-0dcb-4ae6-8091-f5ac4e805e2d None admin] RBAC: Adding query filter params (name=reader) {{(pid=51267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7293134-0dcb-4ae6-8091-f5ac4e805e2d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7293134-0dcb-4ae6-8091-f5ac4e805e2d None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247fca3c-3f91-47e8-ad4e-8770a97c08f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247fca3c-3f91-47e8-ad4e-8770a97c08f0 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247fca3c-3f91-47e8-ad4e-8770a97c08f0 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247fca3c-3f91-47e8-ad4e-8770a97c08f0 None admin] PATH_INFO: `/v3/roles` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247fca3c-3f91-47e8-ad4e-8770a97c08f0 None admin] RBAC: Adding query filter params (name=member) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 113/218] 10.27.203.238 () {56 vars in 1101 bytes} [Tue May 28 12:36:52 2024] GET /identity/v3/roles?name=reader => generated 345 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247fca3c-3f91-47e8-ad4e-8770a97c08f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247fca3c-3f91-47e8-ad4e-8770a97c08f0 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7293134-0dcb-4ae6-8091-f5ac4e805e2d None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 106/219] 10.27.203.238 () {56 vars in 1101 bytes} [Tue May 28 12:36:52 2024] GET /identity/v3/roles?name=member => generated 345 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247fca3c-3f91-47e8-ad4e-8770a97c08f0 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247fca3c-3f91-47e8-ad4e-8770a97c08f0 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7293134-0dcb-4ae6-8091-f5ac4e805e2d None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb9bc34-0a51-4c72-ab00-7b87e9f29ab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb9bc34-0a51-4c72-ab00-7b87e9f29ab1 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb9bc34-0a51-4c72-ab00-7b87e9f29ab1 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb9bc34-0a51-4c72-ab00-7b87e9f29ab1 None admin] PATH_INFO: `/v3/users/efb3770c7a174bac8a9ba1451cee68cd` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba101bd-14fa-425a-8484-d99d067c7604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba101bd-14fa-425a-8484-d99d067c7604 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba101bd-14fa-425a-8484-d99d067c7604 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba101bd-14fa-425a-8484-d99d067c7604 None admin] PATH_INFO: `/v3/users/aed1000f912a4ef295cd062e1ba15dcf` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba101bd-14fa-425a-8484-d99d067c7604 None admin] RBAC: Authorizing `identity:get_user(user_id=aed1000f912a4ef295cd062e1ba15dcf)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba101bd-14fa-425a-8484-d99d067c7604 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 114/220] 10.27.203.238 () {56 vars in 1177 bytes} [Tue May 28 12:36:52 2024] GET /identity/v3/users/aed1000f912a4ef295cd062e1ba15dcf => generated 299 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba101bd-14fa-425a-8484-d99d067c7604 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb9bc34-0a51-4c72-ab00-7b87e9f29ab1 None admin] RBAC: Authorizing `identity:get_user(user_id=efb3770c7a174bac8a9ba1451cee68cd)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb9bc34-0a51-4c72-ab00-7b87e9f29ab1 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 107/221] 10.27.203.238 () {56 vars in 1177 bytes} [Tue May 28 12:36:52 2024] GET /identity/v3/users/efb3770c7a174bac8a9ba1451cee68cd => generated 295 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb9bc34-0a51-4c72-ab00-7b87e9f29ab1 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba101bd-14fa-425a-8484-d99d067c7604 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb9bc34-0a51-4c72-ab00-7b87e9f29ab1 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6fe12d-79f1-40ac-b744-f794c88290cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6fe12d-79f1-40ac-b744-f794c88290cd None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6fe12d-79f1-40ac-b744-f794c88290cd None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6fe12d-79f1-40ac-b744-f794c88290cd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f076a52e-8c3b-4490-bebe-e6a757225f0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f076a52e-8c3b-4490-bebe-e6a757225f0e None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f076a52e-8c3b-4490-bebe-e6a757225f0e None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f076a52e-8c3b-4490-bebe-e6a757225f0e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f076a52e-8c3b-4490-bebe-e6a757225f0e None admin] RBAC: Adding query filter params (role.id=44620cad10ae407c90c91e2c296adb04, user.id=efb3770c7a174bac8a9ba1451cee68cd, scope.system=all) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f076a52e-8c3b-4490-bebe-e6a757225f0e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f076a52e-8c3b-4490-bebe-e6a757225f0e None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 108/222] 10.27.203.238 () {56 vars in 1308 bytes} [Tue May 28 12:36:52 2024] GET /identity/v3/role_assignments?user.id=efb3770c7a174bac8a9ba1451cee68cd&scope.system=all&role.id=44620cad10ae407c90c91e2c296adb04 => generated 228 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6fe12d-79f1-40ac-b744-f794c88290cd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6fe12d-79f1-40ac-b744-f794c88290cd None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 115/223] 10.27.203.238 () {58 vars in 1282 bytes} [Tue May 28 12:36:52 2024] GET /identity/v3/auth/tokens => generated 864 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f076a52e-8c3b-4490-bebe-e6a757225f0e None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f076a52e-8c3b-4490-bebe-e6a757225f0e None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f824c8-209c-4c87-9b14-a0fd926cbf0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f824c8-209c-4c87-9b14-a0fd926cbf0e None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f824c8-209c-4c87-9b14-a0fd926cbf0e None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f824c8-209c-4c87-9b14-a0fd926cbf0e None admin] PATH_INFO: `/v3/projects/6694b9ccc35f48a680a684b41016b8db` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f824c8-209c-4c87-9b14-a0fd926cbf0e None admin] RBAC: Authorizing `identity:get_project(project_id=6694b9ccc35f48a680a684b41016b8db)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f824c8-209c-4c87-9b14-a0fd926cbf0e None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 109/224] 10.27.203.238 () {56 vars in 1186 bytes} [Tue May 28 12:36:52 2024] GET /identity/v3/projects/6694b9ccc35f48a680a684b41016b8db => generated 304 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6fe12d-79f1-40ac-b744-f794c88290cd None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6fe12d-79f1-40ac-b744-f794c88290cd None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271c1e79-c20b-4b34-bd45-ada35daa9849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271c1e79-c20b-4b34-bd45-ada35daa9849 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271c1e79-c20b-4b34-bd45-ada35daa9849 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271c1e79-c20b-4b34-bd45-ada35daa9849 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271c1e79-c20b-4b34-bd45-ada35daa9849 None admin] RBAC: Adding query filter params (role.id=20fc3860247242838aac793d192b83dc, scope.project.id=6694b9ccc35f48a680a684b41016b8db, user.id=aed1000f912a4ef295cd062e1ba15dcf) {{(pid=51267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271c1e79-c20b-4b34-bd45-ada35daa9849 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271c1e79-c20b-4b34-bd45-ada35daa9849 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:36:52 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 116/225] 10.27.203.238 () {56 vars in 1374 bytes} [Tue May 28 12:36:52 2024] GET /identity/v3/role_assignments?user.id=aed1000f912a4ef295cd062e1ba15dcf&scope.project.id=6694b9ccc35f48a680a684b41016b8db&role.id=20fc3860247242838aac793d192b83dc => generated 612 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:36:53 l75lg1-v1 dstat.sh[49771]: 28-05 12:36:53| 30 5 64 0 0|1511M 8230M 234M 5728M| 20k 4780B| 0 348k| 0 34.0 |6355 9511 |1.97 0.96 0.67|3.0 0 197| 0 0 | 0 2048M| 19 29 0 9 0 May 28 12:36:53 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee72b95-e8bf-4c32-b7f6-a1f19b06efd3 None None] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:53 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee72b95-e8bf-4c32-b7f6-a1f19b06efd3 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:53 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee72b95-e8bf-4c32-b7f6-a1f19b06efd3 None None] PATH_INFO: `/` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:53 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 110/226] 10.27.203.238 () {54 vars in 926 bytes} [Tue May 28 12:36:53 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:36:53 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56788796-c382-4bc1-bdfa-2deb597a3686 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:53 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56788796-c382-4bc1-bdfa-2deb597a3686 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:53 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56788796-c382-4bc1-bdfa-2deb597a3686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:53 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-56788796-c382-4bc1-bdfa-2deb597a3686 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:36:53 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-56788796-c382-4bc1-bdfa-2deb597a3686 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:36:53 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-56788796-c382-4bc1-bdfa-2deb597a3686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:36:53 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5474755a-e6f5-4940-a866-76fb8b2693e8 None None] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:53 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5474755a-e6f5-4940-a866-76fb8b2693e8 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:53 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5474755a-e6f5-4940-a866-76fb8b2693e8 None None] PATH_INFO: `/` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:53 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 111/227] 10.27.203.238 () {54 vars in 926 bytes} [Tue May 28 12:36:53 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:36:53 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7859b962-2872-4676-b4f4-b21dd3507a89 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:53 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7859b962-2872-4676-b4f4-b21dd3507a89 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:53 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7859b962-2872-4676-b4f4-b21dd3507a89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:53 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 117/228] 10.27.203.238 () {58 vars in 1023 bytes} [Tue May 28 12:36:53 2024] POST /identity/v3/auth/tokens => generated 864 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 28 12:36:53 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-7859b962-2872-4676-b4f4-b21dd3507a89 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:36:53 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-7859b962-2872-4676-b4f4-b21dd3507a89 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:36:53 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-7859b962-2872-4676-b4f4-b21dd3507a89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:36:53 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 112/229] 10.27.203.238 () {58 vars in 1023 bytes} [Tue May 28 12:36:53 2024] POST /identity/v3/auth/tokens => generated 864 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56788796-c382-4bc1-bdfa-2deb597a3686 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ff4c01-2dc4-4e23-87a2-516eb27d92ea None None] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ff4c01-2dc4-4e23-87a2-516eb27d92ea None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ff4c01-2dc4-4e23-87a2-516eb27d92ea None None] PATH_INFO: `/` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 113/230] 10.27.203.238 () {54 vars in 926 bytes} [Tue May 28 12:36:54 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5a1e67-f9da-46a2-ae94-a166d32a3c36 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5a1e67-f9da-46a2-ae94-a166d32a3c36 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5a1e67-f9da-46a2-ae94-a166d32a3c36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-df5a1e67-f9da-46a2-ae94-a166d32a3c36 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-df5a1e67-f9da-46a2-ae94-a166d32a3c36 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-df5a1e67-f9da-46a2-ae94-a166d32a3c36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56788796-c382-4bc1-bdfa-2deb597a3686 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9aac2f-9815-4202-82f7-b55fcf22044c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9aac2f-9815-4202-82f7-b55fcf22044c None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9aac2f-9815-4202-82f7-b55fcf22044c None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9aac2f-9815-4202-82f7-b55fcf22044c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9aac2f-9815-4202-82f7-b55fcf22044c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-4b9aac2f-9815-4202-82f7-b55fcf22044c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._get_role(role_id) May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1281, in get_role May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 118/231] 10.27.203.238 () {56 vars in 1099 bytes} [Tue May 28 12:36:54 2024] GET /identity/v3/roles/reader => generated 84 bytes in 88 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9aac2f-9815-4202-82f7-b55fcf22044c None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 114/232] 10.27.203.238 () {58 vars in 1023 bytes} [Tue May 28 12:36:54 2024] POST /identity/v3/auth/tokens => generated 864 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5a1e67-f9da-46a2-ae94-a166d32a3c36 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5a1e67-f9da-46a2-ae94-a166d32a3c36 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9aac2f-9815-4202-82f7-b55fcf22044c None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8ade4b-b55f-427a-b466-c699796c6c14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8ade4b-b55f-427a-b466-c699796c6c14 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8ade4b-b55f-427a-b466-c699796c6c14 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8ade4b-b55f-427a-b466-c699796c6c14 None admin] PATH_INFO: `/v3/roles` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8ade4b-b55f-427a-b466-c699796c6c14 None admin] RBAC: Adding query filter params (name=reader) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8ade4b-b55f-427a-b466-c699796c6c14 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3378cf08-b2ac-403f-8609-68bea9a22c13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8ade4b-b55f-427a-b466-c699796c6c14 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3378cf08-b2ac-403f-8609-68bea9a22c13 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3378cf08-b2ac-403f-8609-68bea9a22c13 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3378cf08-b2ac-403f-8609-68bea9a22c13 None admin] PATH_INFO: `/v3/domains/default` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3378cf08-b2ac-403f-8609-68bea9a22c13 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3378cf08-b2ac-403f-8609-68bea9a22c13 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 119/233] 10.27.203.238 () {56 vars in 1108 bytes} [Tue May 28 12:36:54 2024] GET /identity/v3/domains/default => generated 201 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 115/234] 10.27.203.238 () {56 vars in 1101 bytes} [Tue May 28 12:36:54 2024] GET /identity/v3/roles?name=reader => generated 345 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3378cf08-b2ac-403f-8609-68bea9a22c13 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8ade4b-b55f-427a-b466-c699796c6c14 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:54 l75lg1-v1 dstat.sh[49771]: 28-05 12:36:54| 28 2 70 0 0|1593M 8147M 234M 5728M| 17k 258B| 0 176k| 0 13.0 |3957 5685 |1.97 0.96 0.67|3.0 0 0| 0 0 | 0 2048M| 19 31 0 9 0 May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3378cf08-b2ac-403f-8609-68bea9a22c13 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8ade4b-b55f-427a-b466-c699796c6c14 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3459b112-deab-479e-9ae8-8d06b915b1f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3459b112-deab-479e-9ae8-8d06b915b1f4 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a67062d-e429-4d4d-a5e9-fbcab5f1e7f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a67062d-e429-4d4d-a5e9-fbcab5f1e7f5 None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3459b112-deab-479e-9ae8-8d06b915b1f4 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a67062d-e429-4d4d-a5e9-fbcab5f1e7f5 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a67062d-e429-4d4d-a5e9-fbcab5f1e7f5 None admin] PATH_INFO: `/v3/groups` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3459b112-deab-479e-9ae8-8d06b915b1f4 None admin] PATH_INFO: `/v3/users/8725b035bebf4f27a8f00998d1b83c4b` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a67062d-e429-4d4d-a5e9-fbcab5f1e7f5 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a67062d-e429-4d4d-a5e9-fbcab5f1e7f5 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3459b112-deab-479e-9ae8-8d06b915b1f4 None admin] RBAC: Authorizing `identity:get_user(user_id=8725b035bebf4f27a8f00998d1b83c4b)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3459b112-deab-479e-9ae8-8d06b915b1f4 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 116/235] 10.27.203.238 () {56 vars in 1177 bytes} [Tue May 28 12:36:54 2024] GET /identity/v3/users/8725b035bebf4f27a8f00998d1b83c4b => generated 295 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3459b112-deab-479e-9ae8-8d06b915b1f4 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 120/236] 10.27.203.238 () {60 vars in 1134 bytes} [Tue May 28 12:36:54 2024] POST /identity/v3/groups => generated 231 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a67062d-e429-4d4d-a5e9-fbcab5f1e7f5 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3459b112-deab-479e-9ae8-8d06b915b1f4 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a67062d-e429-4d4d-a5e9-fbcab5f1e7f5 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577b831c-8969-4c33-82ff-039674c27b59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577b831c-8969-4c33-82ff-039674c27b59 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577b831c-8969-4c33-82ff-039674c27b59 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577b831c-8969-4c33-82ff-039674c27b59 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577b831c-8969-4c33-82ff-039674c27b59 None admin] RBAC: Adding query filter params (role.id=20fc3860247242838aac793d192b83dc, user.id=8725b035bebf4f27a8f00998d1b83c4b, scope.system=all) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577b831c-8969-4c33-82ff-039674c27b59 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577b831c-8969-4c33-82ff-039674c27b59 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 117/237] 10.27.203.238 () {56 vars in 1308 bytes} [Tue May 28 12:36:54 2024] GET /identity/v3/role_assignments?user.id=8725b035bebf4f27a8f00998d1b83c4b&scope.system=all&role.id=20fc3860247242838aac793d192b83dc => generated 228 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dcb1dc-9eaa-4f01-a689-b784759c4e4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dcb1dc-9eaa-4f01-a689-b784759c4e4c None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dcb1dc-9eaa-4f01-a689-b784759c4e4c None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dcb1dc-9eaa-4f01-a689-b784759c4e4c None admin] PATH_INFO: `/v3/roles/member` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dcb1dc-9eaa-4f01-a689-b784759c4e4c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-f2dcb1dc-9eaa-4f01-a689-b784759c4e4c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._get_role(role_id) May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1281, in get_role May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 121/238] 10.27.203.238 () {56 vars in 1099 bytes} [Tue May 28 12:36:54 2024] GET /identity/v3/roles/member => generated 84 bytes in 91 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577b831c-8969-4c33-82ff-039674c27b59 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577b831c-8969-4c33-82ff-039674c27b59 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25595ae-06c5-4d60-a908-16bc56931fbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25595ae-06c5-4d60-a908-16bc56931fbd None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25595ae-06c5-4d60-a908-16bc56931fbd None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25595ae-06c5-4d60-a908-16bc56931fbd None admin] PATH_INFO: `/v3/roles` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25595ae-06c5-4d60-a908-16bc56931fbd None admin] RBAC: Adding query filter params (name=member) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25595ae-06c5-4d60-a908-16bc56931fbd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25595ae-06c5-4d60-a908-16bc56931fbd None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 118/239] 10.27.203.238 () {56 vars in 1101 bytes} [Tue May 28 12:36:54 2024] GET /identity/v3/roles?name=member => generated 345 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dcb1dc-9eaa-4f01-a689-b784759c4e4c None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dcb1dc-9eaa-4f01-a689-b784759c4e4c None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c48d9f-2ccf-4cb5-a453-11afedd4600f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c48d9f-2ccf-4cb5-a453-11afedd4600f None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c48d9f-2ccf-4cb5-a453-11afedd4600f None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c48d9f-2ccf-4cb5-a453-11afedd4600f None admin] PATH_INFO: `/v3/users/efb3770c7a174bac8a9ba1451cee68cd` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c48d9f-2ccf-4cb5-a453-11afedd4600f None admin] RBAC: Authorizing `identity:get_user(user_id=efb3770c7a174bac8a9ba1451cee68cd)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c48d9f-2ccf-4cb5-a453-11afedd4600f None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 122/240] 10.27.203.238 () {56 vars in 1177 bytes} [Tue May 28 12:36:54 2024] GET /identity/v3/users/efb3770c7a174bac8a9ba1451cee68cd => generated 295 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25595ae-06c5-4d60-a908-16bc56931fbd None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25595ae-06c5-4d60-a908-16bc56931fbd None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86744c2c-0c8b-4151-80e0-1c075461ca41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86744c2c-0c8b-4151-80e0-1c075461ca41 None admin] REQUEST_METHOD: `PUT` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86744c2c-0c8b-4151-80e0-1c075461ca41 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86744c2c-0c8b-4151-80e0-1c075461ca41 None admin] PATH_INFO: `/v3/system/users/efb3770c7a174bac8a9ba1451cee68cd/roles/44620cad10ae407c90c91e2c296adb04` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86744c2c-0c8b-4151-80e0-1c075461ca41 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=efb3770c7a174bac8a9ba1451cee68cd, role_id=44620cad10ae407c90c91e2c296adb04)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86744c2c-0c8b-4151-80e0-1c075461ca41 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:36:54 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 119/241] 10.27.203.238 () {58 vars in 1334 bytes} [Tue May 28 12:36:54 2024] PUT /identity/v3/system/users/efb3770c7a174bac8a9ba1451cee68cd/roles/44620cad10ae407c90c91e2c296adb04 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:36:55 l75lg1-v1 dstat.sh[49771]: 28-05 12:36:55| 27 3 69 0 0|1506M 8234M 234M 5728M| 26k 2730B| 0 3476k| 0 382 |5080 7119 |1.97 0.96 0.67|5.0 0 64| 0 0 | 0 2048M| 19 29 0 9 0 May 28 12:36:55 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5e230a-6d4f-4c15-b467-b792add99aa0 None None] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:55 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5e230a-6d4f-4c15-b467-b792add99aa0 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:55 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5e230a-6d4f-4c15-b467-b792add99aa0 None None] PATH_INFO: `/` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:55 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 123/242] 10.27.203.238 () {54 vars in 926 bytes} [Tue May 28 12:36:55 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:36:55 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f58d505-47b2-4351-a8c1-2227483f8032 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:55 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f58d505-47b2-4351-a8c1-2227483f8032 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:55 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f58d505-47b2-4351-a8c1-2227483f8032 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:55 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-8f58d505-47b2-4351-a8c1-2227483f8032 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:36:55 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-8f58d505-47b2-4351-a8c1-2227483f8032 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:36:55 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-8f58d505-47b2-4351-a8c1-2227483f8032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:36:55 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b74c889-5e15-4b4a-b127-e630217a923b None None] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:55 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b74c889-5e15-4b4a-b127-e630217a923b None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:55 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b74c889-5e15-4b4a-b127-e630217a923b None None] PATH_INFO: `/` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:55 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 124/243] 10.27.203.238 () {54 vars in 926 bytes} [Tue May 28 12:36:55 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:36:55 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e799dc-2e93-41ff-8b20-b6bd572e3e84 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:55 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e799dc-2e93-41ff-8b20-b6bd572e3e84 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:55 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e799dc-2e93-41ff-8b20-b6bd572e3e84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:55 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-d6e799dc-2e93-41ff-8b20-b6bd572e3e84 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:36:55 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-d6e799dc-2e93-41ff-8b20-b6bd572e3e84 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:36:55 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-d6e799dc-2e93-41ff-8b20-b6bd572e3e84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:36:55 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 120/244] 10.27.203.238 () {58 vars in 1023 bytes} [Tue May 28 12:36:55 2024] POST /identity/v3/auth/tokens => generated 864 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 28 12:36:55 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 125/245] 10.27.203.238 () {58 vars in 1023 bytes} [Tue May 28 12:36:55 2024] POST /identity/v3/auth/tokens => generated 864 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f58d505-47b2-4351-a8c1-2227483f8032 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601e7cfe-43f4-4f6d-9b4c-ec0cc6278a21 None None] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601e7cfe-43f4-4f6d-9b4c-ec0cc6278a21 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601e7cfe-43f4-4f6d-9b4c-ec0cc6278a21 None None] PATH_INFO: `/` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 126/246] 10.27.203.238 () {54 vars in 926 bytes} [Tue May 28 12:36:56 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e16dca-327c-4b6d-a4d5-937ae3098fa7 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e16dca-327c-4b6d-a4d5-937ae3098fa7 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e16dca-327c-4b6d-a4d5-937ae3098fa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-20e16dca-327c-4b6d-a4d5-937ae3098fa7 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-20e16dca-327c-4b6d-a4d5-937ae3098fa7 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-20e16dca-327c-4b6d-a4d5-937ae3098fa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f58d505-47b2-4351-a8c1-2227483f8032 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29d8442-d986-47d7-8e36-b3e91ccf0f0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29d8442-d986-47d7-8e36-b3e91ccf0f0a None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29d8442-d986-47d7-8e36-b3e91ccf0f0a None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29d8442-d986-47d7-8e36-b3e91ccf0f0a None admin] PATH_INFO: `/v3/domains/default` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29d8442-d986-47d7-8e36-b3e91ccf0f0a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29d8442-d986-47d7-8e36-b3e91ccf0f0a None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 127/247] 10.27.203.238 () {58 vars in 1023 bytes} [Tue May 28 12:36:56 2024] POST /identity/v3/auth/tokens => generated 864 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e16dca-327c-4b6d-a4d5-937ae3098fa7 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 121/248] 10.27.203.238 () {56 vars in 1108 bytes} [Tue May 28 12:36:56 2024] GET /identity/v3/domains/default => generated 201 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29d8442-d986-47d7-8e36-b3e91ccf0f0a None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e16dca-327c-4b6d-a4d5-937ae3098fa7 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29d8442-d986-47d7-8e36-b3e91ccf0f0a None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4705f3c4-9b24-470f-b984-fd1c399a9cf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4705f3c4-9b24-470f-b984-fd1c399a9cf6 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4705f3c4-9b24-470f-b984-fd1c399a9cf6 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4705f3c4-9b24-470f-b984-fd1c399a9cf6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4705f3c4-9b24-470f-b984-fd1c399a9cf6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-4705f3c4-9b24-470f-b984-fd1c399a9cf6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._get_role(role_id) May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1281, in get_role May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 128/249] 10.27.203.238 () {56 vars in 1099 bytes} [Tue May 28 12:36:56 2024] GET /identity/v3/roles/reader => generated 84 bytes in 88 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4705f3c4-9b24-470f-b984-fd1c399a9cf6 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9843fa0f-482a-4161-b0dc-df7f40a11225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9843fa0f-482a-4161-b0dc-df7f40a11225 None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9843fa0f-482a-4161-b0dc-df7f40a11225 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9843fa0f-482a-4161-b0dc-df7f40a11225 None admin] PATH_INFO: `/v3/groups` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9843fa0f-482a-4161-b0dc-df7f40a11225 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9843fa0f-482a-4161-b0dc-df7f40a11225 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 122/250] 10.27.203.238 () {60 vars in 1134 bytes} [Tue May 28 12:36:56 2024] POST /identity/v3/groups => generated 228 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:36:56 l75lg1-v1 dstat.sh[49771]: 28-05 12:36:56| 27 3 70 1 0|1590M 8151M 234M 5728M| 28k 86B| 0 300k| 0 27.0 |4051 5573 |2.05 1.00 0.68|3.0 1.0 0| 0 0 | 0 2048M| 19 31 0 9 0 May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4705f3c4-9b24-470f-b984-fd1c399a9cf6 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ae9705-3378-45c1-ad09-29aecaafd856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ae9705-3378-45c1-ad09-29aecaafd856 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ae9705-3378-45c1-ad09-29aecaafd856 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ae9705-3378-45c1-ad09-29aecaafd856 None admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ae9705-3378-45c1-ad09-29aecaafd856 None admin] RBAC: Adding query filter params (name=reader) {{(pid=51267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ae9705-3378-45c1-ad09-29aecaafd856 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ae9705-3378-45c1-ad09-29aecaafd856 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9843fa0f-482a-4161-b0dc-df7f40a11225 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 129/251] 10.27.203.238 () {56 vars in 1101 bytes} [Tue May 28 12:36:56 2024] GET /identity/v3/roles?name=reader => generated 345 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ae9705-3378-45c1-ad09-29aecaafd856 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9843fa0f-482a-4161-b0dc-df7f40a11225 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ae9705-3378-45c1-ad09-29aecaafd856 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5300ed9b-cf3b-4e7c-a92e-d5fe9a4e5caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5300ed9b-cf3b-4e7c-a92e-d5fe9a4e5caf None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5300ed9b-cf3b-4e7c-a92e-d5fe9a4e5caf None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5300ed9b-cf3b-4e7c-a92e-d5fe9a4e5caf None admin] PATH_INFO: `/v3/roles/member` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f033ee2-937c-4d0c-92d5-ccedaaec1877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f033ee2-937c-4d0c-92d5-ccedaaec1877 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f033ee2-937c-4d0c-92d5-ccedaaec1877 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f033ee2-937c-4d0c-92d5-ccedaaec1877 None admin] PATH_INFO: `/v3/users/8725b035bebf4f27a8f00998d1b83c4b` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5300ed9b-cf3b-4e7c-a92e-d5fe9a4e5caf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f033ee2-937c-4d0c-92d5-ccedaaec1877 None admin] RBAC: Authorizing `identity:get_user(user_id=8725b035bebf4f27a8f00998d1b83c4b)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f033ee2-937c-4d0c-92d5-ccedaaec1877 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-5300ed9b-cf3b-4e7c-a92e-d5fe9a4e5caf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._get_role(role_id) May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1281, in get_role May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 130/252] 10.27.203.238 () {56 vars in 1177 bytes} [Tue May 28 12:36:56 2024] GET /identity/v3/users/8725b035bebf4f27a8f00998d1b83c4b => generated 295 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 123/253] 10.27.203.238 () {56 vars in 1099 bytes} [Tue May 28 12:36:56 2024] GET /identity/v3/roles/member => generated 84 bytes in 91 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f033ee2-937c-4d0c-92d5-ccedaaec1877 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5300ed9b-cf3b-4e7c-a92e-d5fe9a4e5caf None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f033ee2-937c-4d0c-92d5-ccedaaec1877 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5300ed9b-cf3b-4e7c-a92e-d5fe9a4e5caf None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d158aca-1a74-4628-ac26-7fd35ecb9bf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d158aca-1a74-4628-ac26-7fd35ecb9bf0 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fda21f-9226-4050-880c-c20f48dd4cf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d158aca-1a74-4628-ac26-7fd35ecb9bf0 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d158aca-1a74-4628-ac26-7fd35ecb9bf0 None admin] PATH_INFO: `/v3/roles` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fda21f-9226-4050-880c-c20f48dd4cf4 None admin] REQUEST_METHOD: `PUT` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fda21f-9226-4050-880c-c20f48dd4cf4 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d158aca-1a74-4628-ac26-7fd35ecb9bf0 None admin] RBAC: Adding query filter params (name=member) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fda21f-9226-4050-880c-c20f48dd4cf4 None admin] PATH_INFO: `/v3/system/users/8725b035bebf4f27a8f00998d1b83c4b/roles/20fc3860247242838aac793d192b83dc` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d158aca-1a74-4628-ac26-7fd35ecb9bf0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fda21f-9226-4050-880c-c20f48dd4cf4 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=8725b035bebf4f27a8f00998d1b83c4b, role_id=20fc3860247242838aac793d192b83dc)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d158aca-1a74-4628-ac26-7fd35ecb9bf0 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fda21f-9226-4050-880c-c20f48dd4cf4 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 124/254] 10.27.203.238 () {56 vars in 1101 bytes} [Tue May 28 12:36:56 2024] GET /identity/v3/roles?name=member => generated 345 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d158aca-1a74-4628-ac26-7fd35ecb9bf0 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 131/255] 10.27.203.238 () {58 vars in 1334 bytes} [Tue May 28 12:36:56 2024] PUT /identity/v3/system/users/8725b035bebf4f27a8f00998d1b83c4b/roles/20fc3860247242838aac793d192b83dc => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d158aca-1a74-4628-ac26-7fd35ecb9bf0 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77ab7cd-5168-419a-951b-ffb738486a99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77ab7cd-5168-419a-951b-ffb738486a99 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77ab7cd-5168-419a-951b-ffb738486a99 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77ab7cd-5168-419a-951b-ffb738486a99 None admin] PATH_INFO: `/v3/users/efb3770c7a174bac8a9ba1451cee68cd` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77ab7cd-5168-419a-951b-ffb738486a99 None admin] RBAC: Authorizing `identity:get_user(user_id=efb3770c7a174bac8a9ba1451cee68cd)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77ab7cd-5168-419a-951b-ffb738486a99 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 125/256] 10.27.203.238 () {56 vars in 1177 bytes} [Tue May 28 12:36:56 2024] GET /identity/v3/users/efb3770c7a174bac8a9ba1451cee68cd => generated 295 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fda21f-9226-4050-880c-c20f48dd4cf4 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fda21f-9226-4050-880c-c20f48dd4cf4 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a8f8dd-1e88-4dfd-aaf0-75ad251f1031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a8f8dd-1e88-4dfd-aaf0-75ad251f1031 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a8f8dd-1e88-4dfd-aaf0-75ad251f1031 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a8f8dd-1e88-4dfd-aaf0-75ad251f1031 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a8f8dd-1e88-4dfd-aaf0-75ad251f1031 None admin] RBAC: Adding query filter params (role.id=44620cad10ae407c90c91e2c296adb04, user.id=efb3770c7a174bac8a9ba1451cee68cd, scope.system=all) {{(pid=51267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a8f8dd-1e88-4dfd-aaf0-75ad251f1031 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a8f8dd-1e88-4dfd-aaf0-75ad251f1031 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:36:56 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 132/257] 10.27.203.238 () {56 vars in 1308 bytes} [Tue May 28 12:36:56 2024] GET /identity/v3/role_assignments?user.id=efb3770c7a174bac8a9ba1451cee68cd&scope.system=all&role.id=44620cad10ae407c90c91e2c296adb04 => generated 228 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:36:57 l75lg1-v1 dstat.sh[49771]: 28-05 12:36:57| 40 13 47 0 0|1583M 8157M 234M 5728M| 31k 13k| 0 596k| 0 53.0 |7430 10k|2.05 1.00 0.68|7.0 0 556| 0 0 | 0 2048M| 19 29 0 9 0 May 28 12:36:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d95406-32e5-47e1-96d7-d7c3755a8c66 None None] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d95406-32e5-47e1-96d7-d7c3755a8c66 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d95406-32e5-47e1-96d7-d7c3755a8c66 None None] PATH_INFO: `/` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:57 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 126/258] 10.27.203.238 () {54 vars in 926 bytes} [Tue May 28 12:36:57 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:36:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65359f25-d239-4149-9b8d-d769c5202560 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65359f25-d239-4149-9b8d-d769c5202560 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65359f25-d239-4149-9b8d-d769c5202560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:57 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-65359f25-d239-4149-9b8d-d769c5202560 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:36:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-65359f25-d239-4149-9b8d-d769c5202560 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:36:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-65359f25-d239-4149-9b8d-d769c5202560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:36:57 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 133/259] 10.27.203.238 () {58 vars in 1023 bytes} [Tue May 28 12:36:57 2024] POST /identity/v3/auth/tokens => generated 979 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 28 12:36:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebc418b-f4b0-467b-9541-a9830500481b None None] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebc418b-f4b0-467b-9541-a9830500481b None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebc418b-f4b0-467b-9541-a9830500481b None None] PATH_INFO: `/` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:57 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 127/260] 10.27.203.238 () {54 vars in 926 bytes} [Tue May 28 12:36:57 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:36:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea6f87f-0e14-42bc-90b8-cdfedf475d9c None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea6f87f-0e14-42bc-90b8-cdfedf475d9c None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea6f87f-0e14-42bc-90b8-cdfedf475d9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:57 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-5ea6f87f-0e14-42bc-90b8-cdfedf475d9c None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:36:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-5ea6f87f-0e14-42bc-90b8-cdfedf475d9c None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:36:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-5ea6f87f-0e14-42bc-90b8-cdfedf475d9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:36:57 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 134/261] 10.27.203.238 () {58 vars in 1023 bytes} [Tue May 28 12:36:57 2024] POST /identity/v3/auth/tokens => generated 979 bytes in 22 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 28 12:36:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebc418b-f4b0-467b-9541-a9830500481b None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebc418b-f4b0-467b-9541-a9830500481b None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcb3d8e-f648-4628-b439-c9c01029e232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8d517cde1d40bb82c97e080ce071f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcb3d8e-f648-4628-b439-c9c01029e232 admin admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcb3d8e-f648-4628-b439-c9c01029e232 admin admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcb3d8e-f648-4628-b439-c9c01029e232 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4174795-75b0-44dd-9edd-1bdd392aecbb None None] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4174795-75b0-44dd-9edd-1bdd392aecbb None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4174795-75b0-44dd-9edd-1bdd392aecbb None None] PATH_INFO: `/` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 135/262] 10.27.203.238 () {54 vars in 926 bytes} [Tue May 28 12:36:58 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf7cc67-0ffd-4964-80dd-e51f1df2ff68 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf7cc67-0ffd-4964-80dd-e51f1df2ff68 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf7cc67-0ffd-4964-80dd-e51f1df2ff68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcb3d8e-f648-4628-b439-c9c01029e232 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-cfcb3d8e-f648-4628-b439-c9c01029e232 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._get_role(role_id) May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1281, in get_role May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 128/263] 10.27.203.238 () {56 vars in 1120 bytes} [Tue May 28 12:36:57 2024] GET /identity/v3/roles/member => generated 84 bytes in 28 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bc6161-957b-4f91-a966-a4d87049eeed None None] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bc6161-957b-4f91-a966-a4d87049eeed None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bc6161-957b-4f91-a966-a4d87049eeed None None] PATH_INFO: `/` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 129/264] 10.27.203.238 () {54 vars in 926 bytes} [Tue May 28 12:36:58 2024] GET /identity => generated 272 bytes in 1 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bc6161-957b-4f91-a966-a4d87049eeed None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-5bf7cc67-0ffd-4964-80dd-e51f1df2ff68 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-5bf7cc67-0ffd-4964-80dd-e51f1df2ff68 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-5bf7cc67-0ffd-4964-80dd-e51f1df2ff68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bc6161-957b-4f91-a966-a4d87049eeed None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d893f85-35a8-4692-8419-7fa9a31f47ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8d517cde1d40bb82c97e080ce071f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d893f85-35a8-4692-8419-7fa9a31f47ef admin admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d893f85-35a8-4692-8419-7fa9a31f47ef admin admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d893f85-35a8-4692-8419-7fa9a31f47ef admin admin] PATH_INFO: `/v3/roles` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 136/265] 10.27.203.238 () {58 vars in 1023 bytes} [Tue May 28 12:36:58 2024] POST /identity/v3/auth/tokens => generated 979 bytes in 22 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d893f85-35a8-4692-8419-7fa9a31f47ef admin admin] RBAC: Adding query filter params (name=member) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d893f85-35a8-4692-8419-7fa9a31f47ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2984fa8e-fd92-4603-b9a0-0d49033c028f None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2984fa8e-fd92-4603-b9a0-0d49033c028f None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2984fa8e-fd92-4603-b9a0-0d49033c028f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d893f85-35a8-4692-8419-7fa9a31f47ef admin admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 130/266] 10.27.203.238 () {56 vars in 1122 bytes} [Tue May 28 12:36:58 2024] GET /identity/v3/roles?name=member => generated 345 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d893f85-35a8-4692-8419-7fa9a31f47ef admin admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-2984fa8e-fd92-4603-b9a0-0d49033c028f None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-2984fa8e-fd92-4603-b9a0-0d49033c028f None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-2984fa8e-fd92-4603-b9a0-0d49033c028f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d893f85-35a8-4692-8419-7fa9a31f47ef admin admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b3b1c9-8fdc-405c-bc92-b6a2b991a9c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8d517cde1d40bb82c97e080ce071f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b3b1c9-8fdc-405c-bc92-b6a2b991a9c6 admin admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b3b1c9-8fdc-405c-bc92-b6a2b991a9c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b3b1c9-8fdc-405c-bc92-b6a2b991a9c6 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b3b1c9-8fdc-405c-bc92-b6a2b991a9c6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-a4b3b1c9-8fdc-405c-bc92-b6a2b991a9c6 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._get_role(role_id) May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1281, in get_role May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 131/267] 10.27.203.238 () {56 vars in 1135 bytes} [Tue May 28 12:36:58 2024] GET /identity/v3/roles/anotherrole => generated 89 bytes in 24 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b3b1c9-8fdc-405c-bc92-b6a2b991a9c6 admin admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b3b1c9-8fdc-405c-bc92-b6a2b991a9c6 admin admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25b5124-3351-4da1-b233-8107863ff5ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8d517cde1d40bb82c97e080ce071f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25b5124-3351-4da1-b233-8107863ff5ec admin admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25b5124-3351-4da1-b233-8107863ff5ec admin admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25b5124-3351-4da1-b233-8107863ff5ec admin admin] PATH_INFO: `/v3/groups/a56bfda02d2d48cf9979a3a2aaad10b9` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25b5124-3351-4da1-b233-8107863ff5ec admin admin] RBAC: Authorizing `identity:get_group(group_id=a56bfda02d2d48cf9979a3a2aaad10b9)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25b5124-3351-4da1-b233-8107863ff5ec admin admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 132/268] 10.27.203.238 () {56 vars in 1201 bytes} [Tue May 28 12:36:58 2024] GET /identity/v3/groups/a56bfda02d2d48cf9979a3a2aaad10b9 => generated 228 bytes in 16 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25b5124-3351-4da1-b233-8107863ff5ec admin admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25b5124-3351-4da1-b233-8107863ff5ec admin admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2141f80-790c-4ff0-aab6-c835af6b6972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8d517cde1d40bb82c97e080ce071f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2141f80-790c-4ff0-aab6-c835af6b6972 admin admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2141f80-790c-4ff0-aab6-c835af6b6972 admin admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2141f80-790c-4ff0-aab6-c835af6b6972 admin admin] PATH_INFO: `/v3/roles` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2141f80-790c-4ff0-aab6-c835af6b6972 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2141f80-790c-4ff0-aab6-c835af6b6972 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2141f80-790c-4ff0-aab6-c835af6b6972 admin admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 133/269] 10.27.203.238 () {56 vars in 1132 bytes} [Tue May 28 12:36:58 2024] GET /identity/v3/roles?name=anotherrole => generated 338 bytes in 15 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2141f80-790c-4ff0-aab6-c835af6b6972 admin admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2141f80-790c-4ff0-aab6-c835af6b6972 admin admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 137/270] 10.27.203.238 () {58 vars in 1023 bytes} [Tue May 28 12:36:58 2024] POST /identity/v3/auth/tokens => generated 864 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2984fa8e-fd92-4603-b9a0-0d49033c028f None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b53861a-cc54-4db0-b8fc-5d2353e8e420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8d517cde1d40bb82c97e080ce071f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b53861a-cc54-4db0-b8fc-5d2353e8e420 admin admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b53861a-cc54-4db0-b8fc-5d2353e8e420 admin admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b53861a-cc54-4db0-b8fc-5d2353e8e420 admin admin] PATH_INFO: `/v3/projects/95de88f6d26e4420bc466ba67668171f` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b53861a-cc54-4db0-b8fc-5d2353e8e420 admin admin] RBAC: Authorizing `identity:get_project(project_id=95de88f6d26e4420bc466ba67668171f)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2984fa8e-fd92-4603-b9a0-0d49033c028f None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b53861a-cc54-4db0-b8fc-5d2353e8e420 admin admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 134/271] 10.27.203.238 () {56 vars in 1207 bytes} [Tue May 28 12:36:58 2024] GET /identity/v3/projects/95de88f6d26e4420bc466ba67668171f => generated 300 bytes in 10 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3440e660-c437-431c-9b8c-8faf5a0df076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8d517cde1d40bb82c97e080ce071f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3440e660-c437-431c-9b8c-8faf5a0df076 admin admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3440e660-c437-431c-9b8c-8faf5a0df076 admin admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3440e660-c437-431c-9b8c-8faf5a0df076 admin admin] PATH_INFO: `/v3/groups/a56bfda02d2d48cf9979a3a2aaad10b9` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b53861a-cc54-4db0-b8fc-5d2353e8e420 admin admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3440e660-c437-431c-9b8c-8faf5a0df076 admin admin] RBAC: Authorizing `identity:get_group(group_id=a56bfda02d2d48cf9979a3a2aaad10b9)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3440e660-c437-431c-9b8c-8faf5a0df076 admin admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b53861a-cc54-4db0-b8fc-5d2353e8e420 admin admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 138/272] 10.27.203.238 () {56 vars in 1201 bytes} [Tue May 28 12:36:58 2024] GET /identity/v3/groups/a56bfda02d2d48cf9979a3a2aaad10b9 => generated 228 bytes in 12 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eb5937-8d75-45c3-a7b1-5ffa6f81451e None None] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eb5937-8d75-45c3-a7b1-5ffa6f81451e None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eb5937-8d75-45c3-a7b1-5ffa6f81451e None None] PATH_INFO: `/` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 139/273] 10.27.203.238 () {54 vars in 926 bytes} [Tue May 28 12:36:58 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12696718-5932-4a9a-bc32-7a05af5d00be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8d517cde1d40bb82c97e080ce071f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4eb5937-8d75-45c3-a7b1-5ffa6f81451e None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12696718-5932-4a9a-bc32-7a05af5d00be admin admin] REQUEST_METHOD: `PUT` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12696718-5932-4a9a-bc32-7a05af5d00be admin admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12696718-5932-4a9a-bc32-7a05af5d00be admin admin] PATH_INFO: `/v3/projects/95de88f6d26e4420bc466ba67668171f/groups/a56bfda02d2d48cf9979a3a2aaad10b9/roles/44620cad10ae407c90c91e2c296adb04` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12696718-5932-4a9a-bc32-7a05af5d00be admin admin] RBAC: Authorizing `identity:create_grant(project_id=95de88f6d26e4420bc466ba67668171f, group_id=a56bfda02d2d48cf9979a3a2aaad10b9, role_id=44620cad10ae407c90c91e2c296adb04)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12696718-5932-4a9a-bc32-7a05af5d00be admin admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4eb5937-8d75-45c3-a7b1-5ffa6f81451e None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9505481f-e947-41e4-ae1d-b9a0e06f362b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8d517cde1d40bb82c97e080ce071f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9505481f-e947-41e4-ae1d-b9a0e06f362b admin admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9505481f-e947-41e4-ae1d-b9a0e06f362b admin admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9505481f-e947-41e4-ae1d-b9a0e06f362b admin admin] PATH_INFO: `/v3/projects/95de88f6d26e4420bc466ba67668171f` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9505481f-e947-41e4-ae1d-b9a0e06f362b admin admin] RBAC: Authorizing `identity:get_project(project_id=95de88f6d26e4420bc466ba67668171f)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9505481f-e947-41e4-ae1d-b9a0e06f362b admin admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 140/274] 10.27.203.238 () {56 vars in 1207 bytes} [Tue May 28 12:36:58 2024] GET /identity/v3/projects/95de88f6d26e4420bc466ba67668171f => generated 300 bytes in 16 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5912330-da6f-4818-a96b-639debfb3d5c None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5912330-da6f-4818-a96b-639debfb3d5c None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5912330-da6f-4818-a96b-639debfb3d5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 135/275] 10.27.203.238 () {58 vars in 1463 bytes} [Tue May 28 12:36:58 2024] PUT /identity/v3/projects/95de88f6d26e4420bc466ba67668171f/groups/a56bfda02d2d48cf9979a3a2aaad10b9/roles/44620cad10ae407c90c91e2c296adb04 => generated 0 bytes in 29 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12696718-5932-4a9a-bc32-7a05af5d00be admin admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-c5912330-da6f-4818-a96b-639debfb3d5c None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-c5912330-da6f-4818-a96b-639debfb3d5c None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-c5912330-da6f-4818-a96b-639debfb3d5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12696718-5932-4a9a-bc32-7a05af5d00be admin admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e74b5d9-7a79-4c01-829d-54b2d18bb39a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8d517cde1d40bb82c97e080ce071f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e74b5d9-7a79-4c01-829d-54b2d18bb39a admin admin] REQUEST_METHOD: `PUT` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e74b5d9-7a79-4c01-829d-54b2d18bb39a admin admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e74b5d9-7a79-4c01-829d-54b2d18bb39a admin admin] PATH_INFO: `/v3/projects/95de88f6d26e4420bc466ba67668171f/groups/a56bfda02d2d48cf9979a3a2aaad10b9/roles/67bacc33b83c4fc898309c1e5960a722` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e74b5d9-7a79-4c01-829d-54b2d18bb39a admin admin] RBAC: Authorizing `identity:create_grant(project_id=95de88f6d26e4420bc466ba67668171f, group_id=a56bfda02d2d48cf9979a3a2aaad10b9, role_id=67bacc33b83c4fc898309c1e5960a722)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e74b5d9-7a79-4c01-829d-54b2d18bb39a admin admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 141/276] 10.27.203.238 () {58 vars in 1023 bytes} [Tue May 28 12:36:58 2024] POST /identity/v3/auth/tokens => generated 979 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 136/277] 10.27.203.238 () {58 vars in 1463 bytes} [Tue May 28 12:36:58 2024] PUT /identity/v3/projects/95de88f6d26e4420bc466ba67668171f/groups/a56bfda02d2d48cf9979a3a2aaad10b9/roles/67bacc33b83c4fc898309c1e5960a722 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:36:58 l75lg1-v1 dstat.sh[49771]: 28-05 12:36:58| 57 13 29 0 0|1768M 7972M 234M 5728M| 33k 18k| 0 496k| 0 41.0 |7119 9339 |2.05 1.00 0.68|7.0 0 541| 0 0 | 0 2048M| 19 29 0 7 0 May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5912330-da6f-4818-a96b-639debfb3d5c None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5912330-da6f-4818-a96b-639debfb3d5c None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1925ceae-2902-4a86-aada-c7faaa567011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8d517cde1d40bb82c97e080ce071f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1925ceae-2902-4a86-aada-c7faaa567011 admin admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1925ceae-2902-4a86-aada-c7faaa567011 admin admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1925ceae-2902-4a86-aada-c7faaa567011 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1925ceae-2902-4a86-aada-c7faaa567011 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-1925ceae-2902-4a86-aada-c7faaa567011 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._get_role(role_id) May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1281, in get_role May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 142/278] 10.27.203.238 () {56 vars in 1120 bytes} [Tue May 28 12:36:58 2024] GET /identity/v3/roles/member => generated 84 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e74b5d9-7a79-4c01-829d-54b2d18bb39a admin admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1925ceae-2902-4a86-aada-c7faaa567011 admin admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1925ceae-2902-4a86-aada-c7faaa567011 admin admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232bf8b1-3e69-4d4d-87cc-060141541f44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8d517cde1d40bb82c97e080ce071f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232bf8b1-3e69-4d4d-87cc-060141541f44 admin admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232bf8b1-3e69-4d4d-87cc-060141541f44 admin admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232bf8b1-3e69-4d4d-87cc-060141541f44 admin admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232bf8b1-3e69-4d4d-87cc-060141541f44 admin admin] RBAC: Adding query filter params (name=member) {{(pid=51267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232bf8b1-3e69-4d4d-87cc-060141541f44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232bf8b1-3e69-4d4d-87cc-060141541f44 admin admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 143/279] 10.27.203.238 () {56 vars in 1122 bytes} [Tue May 28 12:36:58 2024] GET /identity/v3/roles?name=member => generated 345 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232bf8b1-3e69-4d4d-87cc-060141541f44 admin admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232bf8b1-3e69-4d4d-87cc-060141541f44 admin admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7003c1b7-7fc3-4285-9b0d-0f621130e851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8d517cde1d40bb82c97e080ce071f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7003c1b7-7fc3-4285-9b0d-0f621130e851 admin admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7003c1b7-7fc3-4285-9b0d-0f621130e851 admin admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7003c1b7-7fc3-4285-9b0d-0f621130e851 admin admin] PATH_INFO: `/v3/groups/a56bfda02d2d48cf9979a3a2aaad10b9` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7003c1b7-7fc3-4285-9b0d-0f621130e851 admin admin] RBAC: Authorizing `identity:get_group(group_id=a56bfda02d2d48cf9979a3a2aaad10b9)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7003c1b7-7fc3-4285-9b0d-0f621130e851 admin admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 144/280] 10.27.203.238 () {56 vars in 1201 bytes} [Tue May 28 12:36:58 2024] GET /identity/v3/groups/a56bfda02d2d48cf9979a3a2aaad10b9 => generated 228 bytes in 16 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7003c1b7-7fc3-4285-9b0d-0f621130e851 admin admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e74b5d9-7a79-4c01-829d-54b2d18bb39a admin admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7003c1b7-7fc3-4285-9b0d-0f621130e851 admin admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fd315b-f10b-4960-815f-fa42cf03f65f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8d517cde1d40bb82c97e080ce071f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fd315b-f10b-4960-815f-fa42cf03f65f admin admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fd315b-f10b-4960-815f-fa42cf03f65f admin admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fd315b-f10b-4960-815f-fa42cf03f65f admin admin] PATH_INFO: `/v3/projects/6694b9ccc35f48a680a684b41016b8db` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fd315b-f10b-4960-815f-fa42cf03f65f admin admin] RBAC: Authorizing `identity:get_project(project_id=6694b9ccc35f48a680a684b41016b8db)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fd315b-f10b-4960-815f-fa42cf03f65f admin admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 145/281] 10.27.203.238 () {56 vars in 1207 bytes} [Tue May 28 12:36:58 2024] GET /identity/v3/projects/6694b9ccc35f48a680a684b41016b8db => generated 304 bytes in 15 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fd315b-f10b-4960-815f-fa42cf03f65f admin admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fd315b-f10b-4960-815f-fa42cf03f65f admin admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90c576b-60d9-4f70-b5c9-ade1e6771f5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8d517cde1d40bb82c97e080ce071f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90c576b-60d9-4f70-b5c9-ade1e6771f5d admin admin] REQUEST_METHOD: `PUT` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90c576b-60d9-4f70-b5c9-ade1e6771f5d admin admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90c576b-60d9-4f70-b5c9-ade1e6771f5d admin admin] PATH_INFO: `/v3/projects/6694b9ccc35f48a680a684b41016b8db/groups/a56bfda02d2d48cf9979a3a2aaad10b9/roles/44620cad10ae407c90c91e2c296adb04` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90c576b-60d9-4f70-b5c9-ade1e6771f5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6694b9ccc35f48a680a684b41016b8db, group_id=a56bfda02d2d48cf9979a3a2aaad10b9, role_id=44620cad10ae407c90c91e2c296adb04)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90c576b-60d9-4f70-b5c9-ade1e6771f5d admin admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa208445-c18f-4495-8ff0-b622a2772ad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa208445-c18f-4495-8ff0-b622a2772ad6 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa208445-c18f-4495-8ff0-b622a2772ad6 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa208445-c18f-4495-8ff0-b622a2772ad6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa208445-c18f-4495-8ff0-b622a2772ad6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-fa208445-c18f-4495-8ff0-b622a2772ad6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._get_role(role_id) May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1281, in get_role May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 137/282] 10.27.203.238 () {56 vars in 1099 bytes} [Tue May 28 12:36:58 2024] GET /identity/v3/roles/reader => generated 84 bytes in 100 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331237e5-66f9-4cf8-bf64-db936efded05 None None] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331237e5-66f9-4cf8-bf64-db936efded05 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331237e5-66f9-4cf8-bf64-db936efded05 None None] PATH_INFO: `/` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 146/283] 10.27.203.238 () {58 vars in 1463 bytes} [Tue May 28 12:36:58 2024] PUT /identity/v3/projects/6694b9ccc35f48a680a684b41016b8db/groups/a56bfda02d2d48cf9979a3a2aaad10b9/roles/44620cad10ae407c90c91e2c296adb04 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90c576b-60d9-4f70-b5c9-ade1e6771f5d admin admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 138/284] 10.27.203.238 () {54 vars in 926 bytes} [Tue May 28 12:36:58 2024] GET /identity => generated 272 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331237e5-66f9-4cf8-bf64-db936efded05 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90c576b-60d9-4f70-b5c9-ade1e6771f5d admin admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf657d4-7f1c-4d1f-8adf-302642b862d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8d517cde1d40bb82c97e080ce071f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf657d4-7f1c-4d1f-8adf-302642b862d9 admin admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf657d4-7f1c-4d1f-8adf-302642b862d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf657d4-7f1c-4d1f-8adf-302642b862d9 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331237e5-66f9-4cf8-bf64-db936efded05 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf657d4-7f1c-4d1f-8adf-302642b862d9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-3bf657d4-7f1c-4d1f-8adf-302642b862d9 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._get_role(role_id) May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1281, in get_role May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 147/285] 10.27.203.238 () {56 vars in 1135 bytes} [Tue May 28 12:36:58 2024] GET /identity/v3/roles/anotherrole => generated 89 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723fad3c-8fcd-4b0e-8f96-adbb554f24ad None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723fad3c-8fcd-4b0e-8f96-adbb554f24ad None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723fad3c-8fcd-4b0e-8f96-adbb554f24ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-723fad3c-8fcd-4b0e-8f96-adbb554f24ad None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-723fad3c-8fcd-4b0e-8f96-adbb554f24ad None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-723fad3c-8fcd-4b0e-8f96-adbb554f24ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 148/286] 10.27.203.238 () {58 vars in 1023 bytes} [Tue May 28 12:36:58 2024] POST /identity/v3/auth/tokens => generated 979 bytes in 21 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969b8af3-b8ac-465d-ad61-1989f78d941f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723fad3c-8fcd-4b0e-8f96-adbb554f24ad None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969b8af3-b8ac-465d-ad61-1989f78d941f None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969b8af3-b8ac-465d-ad61-1989f78d941f None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969b8af3-b8ac-465d-ad61-1989f78d941f None admin] PATH_INFO: `/v3/roles` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969b8af3-b8ac-465d-ad61-1989f78d941f None admin] RBAC: Adding query filter params (name=reader) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969b8af3-b8ac-465d-ad61-1989f78d941f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969b8af3-b8ac-465d-ad61-1989f78d941f None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723fad3c-8fcd-4b0e-8f96-adbb554f24ad None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ead3d65-1d76-4079-a97a-45a2a432ccdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8d517cde1d40bb82c97e080ce071f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ead3d65-1d76-4079-a97a-45a2a432ccdd admin admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ead3d65-1d76-4079-a97a-45a2a432ccdd admin admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ead3d65-1d76-4079-a97a-45a2a432ccdd admin admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ead3d65-1d76-4079-a97a-45a2a432ccdd admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=51267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ead3d65-1d76-4079-a97a-45a2a432ccdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 139/287] 10.27.203.238 () {56 vars in 1101 bytes} [Tue May 28 12:36:58 2024] GET /identity/v3/roles?name=reader => generated 345 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ead3d65-1d76-4079-a97a-45a2a432ccdd admin admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969b8af3-b8ac-465d-ad61-1989f78d941f None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 149/288] 10.27.203.238 () {56 vars in 1132 bytes} [Tue May 28 12:36:58 2024] GET /identity/v3/roles?name=anotherrole => generated 338 bytes in 14 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ead3d65-1d76-4079-a97a-45a2a432ccdd admin admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ead3d65-1d76-4079-a97a-45a2a432ccdd admin admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13589ddf-db98-41e9-a672-e46c1959bc8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8d517cde1d40bb82c97e080ce071f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13589ddf-db98-41e9-a672-e46c1959bc8a admin admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13589ddf-db98-41e9-a672-e46c1959bc8a admin admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13589ddf-db98-41e9-a672-e46c1959bc8a admin admin] PATH_INFO: `/v3/groups/a56bfda02d2d48cf9979a3a2aaad10b9` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13589ddf-db98-41e9-a672-e46c1959bc8a admin admin] RBAC: Authorizing `identity:get_group(group_id=a56bfda02d2d48cf9979a3a2aaad10b9)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13589ddf-db98-41e9-a672-e46c1959bc8a admin admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 150/289] 10.27.203.238 () {56 vars in 1201 bytes} [Tue May 28 12:36:58 2024] GET /identity/v3/groups/a56bfda02d2d48cf9979a3a2aaad10b9 => generated 228 bytes in 10 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13589ddf-db98-41e9-a672-e46c1959bc8a admin admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13589ddf-db98-41e9-a672-e46c1959bc8a admin admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4906a34b-3338-4fa3-9796-623e5577b24b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8d517cde1d40bb82c97e080ce071f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4906a34b-3338-4fa3-9796-623e5577b24b admin admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4906a34b-3338-4fa3-9796-623e5577b24b admin admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4906a34b-3338-4fa3-9796-623e5577b24b admin admin] PATH_INFO: `/v3/projects/6694b9ccc35f48a680a684b41016b8db` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4906a34b-3338-4fa3-9796-623e5577b24b admin admin] RBAC: Authorizing `identity:get_project(project_id=6694b9ccc35f48a680a684b41016b8db)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4906a34b-3338-4fa3-9796-623e5577b24b admin admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 151/290] 10.27.203.238 () {56 vars in 1207 bytes} [Tue May 28 12:36:58 2024] GET /identity/v3/projects/6694b9ccc35f48a680a684b41016b8db => generated 304 bytes in 10 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4906a34b-3338-4fa3-9796-623e5577b24b admin admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4906a34b-3338-4fa3-9796-623e5577b24b admin admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b17377-8320-46b7-9b86-02d8a9f6e329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8d517cde1d40bb82c97e080ce071f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b17377-8320-46b7-9b86-02d8a9f6e329 admin admin] REQUEST_METHOD: `PUT` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b17377-8320-46b7-9b86-02d8a9f6e329 admin admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b17377-8320-46b7-9b86-02d8a9f6e329 admin admin] PATH_INFO: `/v3/projects/6694b9ccc35f48a680a684b41016b8db/groups/a56bfda02d2d48cf9979a3a2aaad10b9/roles/67bacc33b83c4fc898309c1e5960a722` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b17377-8320-46b7-9b86-02d8a9f6e329 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6694b9ccc35f48a680a684b41016b8db, group_id=a56bfda02d2d48cf9979a3a2aaad10b9, role_id=67bacc33b83c4fc898309c1e5960a722)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b17377-8320-46b7-9b86-02d8a9f6e329 admin admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969b8af3-b8ac-465d-ad61-1989f78d941f None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 152/291] 10.27.203.238 () {58 vars in 1463 bytes} [Tue May 28 12:36:58 2024] PUT /identity/v3/projects/6694b9ccc35f48a680a684b41016b8db/groups/a56bfda02d2d48cf9979a3a2aaad10b9/roles/67bacc33b83c4fc898309c1e5960a722 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce8f6ee-c2dd-4003-92fa-3db3b80b6b80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce8f6ee-c2dd-4003-92fa-3db3b80b6b80 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce8f6ee-c2dd-4003-92fa-3db3b80b6b80 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce8f6ee-c2dd-4003-92fa-3db3b80b6b80 None admin] PATH_INFO: `/v3/users/8725b035bebf4f27a8f00998d1b83c4b` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce8f6ee-c2dd-4003-92fa-3db3b80b6b80 None admin] RBAC: Authorizing `identity:get_user(user_id=8725b035bebf4f27a8f00998d1b83c4b)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce8f6ee-c2dd-4003-92fa-3db3b80b6b80 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 140/292] 10.27.203.238 () {56 vars in 1177 bytes} [Tue May 28 12:36:58 2024] GET /identity/v3/users/8725b035bebf4f27a8f00998d1b83c4b => generated 295 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b17377-8320-46b7-9b86-02d8a9f6e329 admin admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b17377-8320-46b7-9b86-02d8a9f6e329 admin admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce8f6ee-c2dd-4003-92fa-3db3b80b6b80 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fe1739-90b3-4cc0-b66c-04aebf87f923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fe1739-90b3-4cc0-b66c-04aebf87f923 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fe1739-90b3-4cc0-b66c-04aebf87f923 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fe1739-90b3-4cc0-b66c-04aebf87f923 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fe1739-90b3-4cc0-b66c-04aebf87f923 None admin] RBAC: Adding query filter params (role.id=20fc3860247242838aac793d192b83dc, user.id=8725b035bebf4f27a8f00998d1b83c4b, scope.system=all) {{(pid=51267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fe1739-90b3-4cc0-b66c-04aebf87f923 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fe1739-90b3-4cc0-b66c-04aebf87f923 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 153/293] 10.27.203.238 () {56 vars in 1308 bytes} [Tue May 28 12:36:58 2024] GET /identity/v3/role_assignments?user.id=8725b035bebf4f27a8f00998d1b83c4b&scope.system=all&role.id=20fc3860247242838aac793d192b83dc => generated 514 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce8f6ee-c2dd-4003-92fa-3db3b80b6b80 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9fed69-ac2d-488c-8c93-8e6a2668a911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8d517cde1d40bb82c97e080ce071f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9fed69-ac2d-488c-8c93-8e6a2668a911 admin admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9fed69-ac2d-488c-8c93-8e6a2668a911 admin admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9fed69-ac2d-488c-8c93-8e6a2668a911 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9fed69-ac2d-488c-8c93-8e6a2668a911 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-fc9fed69-ac2d-488c-8c93-8e6a2668a911 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._get_role(role_id) May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1281, in get_role May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 141/294] 10.27.203.238 () {56 vars in 1117 bytes} [Tue May 28 12:36:58 2024] GET /identity/v3/roles/admin => generated 83 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fe1739-90b3-4cc0-b66c-04aebf87f923 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fe1739-90b3-4cc0-b66c-04aebf87f923 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb97d4b-9332-48c1-b7be-953f08a55136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8d517cde1d40bb82c97e080ce071f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb97d4b-9332-48c1-b7be-953f08a55136 admin admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb97d4b-9332-48c1-b7be-953f08a55136 admin admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb97d4b-9332-48c1-b7be-953f08a55136 admin admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb97d4b-9332-48c1-b7be-953f08a55136 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=51267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb97d4b-9332-48c1-b7be-953f08a55136 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb97d4b-9332-48c1-b7be-953f08a55136 admin admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 154/295] 10.27.203.238 () {56 vars in 1120 bytes} [Tue May 28 12:36:58 2024] GET /identity/v3/roles?name=admin => generated 343 bytes in 16 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9fed69-ac2d-488c-8c93-8e6a2668a911 admin admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9fed69-ac2d-488c-8c93-8e6a2668a911 admin admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd40748-b2d6-4ec3-9dc8-3d164b83e6c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8d517cde1d40bb82c97e080ce071f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd40748-b2d6-4ec3-9dc8-3d164b83e6c9 admin admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd40748-b2d6-4ec3-9dc8-3d164b83e6c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd40748-b2d6-4ec3-9dc8-3d164b83e6c9 admin admin] PATH_INFO: `/v3/groups/039a8013241542f3a1d4564adb89dbcb` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd40748-b2d6-4ec3-9dc8-3d164b83e6c9 admin admin] RBAC: Authorizing `identity:get_group(group_id=039a8013241542f3a1d4564adb89dbcb)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd40748-b2d6-4ec3-9dc8-3d164b83e6c9 admin admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 142/296] 10.27.203.238 () {56 vars in 1201 bytes} [Tue May 28 12:36:58 2024] GET /identity/v3/groups/039a8013241542f3a1d4564adb89dbcb => generated 231 bytes in 15 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb97d4b-9332-48c1-b7be-953f08a55136 admin admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb97d4b-9332-48c1-b7be-953f08a55136 admin admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a7b2be-fcf3-4979-a651-ab01bbf2059e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8d517cde1d40bb82c97e080ce071f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a7b2be-fcf3-4979-a651-ab01bbf2059e admin admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a7b2be-fcf3-4979-a651-ab01bbf2059e admin admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a7b2be-fcf3-4979-a651-ab01bbf2059e admin admin] PATH_INFO: `/v3/projects/ea8d517cde1d40bb82c97e080ce071f7` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a7b2be-fcf3-4979-a651-ab01bbf2059e admin admin] RBAC: Authorizing `identity:get_project(project_id=ea8d517cde1d40bb82c97e080ce071f7)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a7b2be-fcf3-4979-a651-ab01bbf2059e admin admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 155/297] 10.27.203.238 () {56 vars in 1207 bytes} [Tue May 28 12:36:58 2024] GET /identity/v3/projects/ea8d517cde1d40bb82c97e080ce071f7 => generated 346 bytes in 10 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd40748-b2d6-4ec3-9dc8-3d164b83e6c9 admin admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd40748-b2d6-4ec3-9dc8-3d164b83e6c9 admin admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca524ee-00a4-4d16-9a4c-40e51067ea9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8d517cde1d40bb82c97e080ce071f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca524ee-00a4-4d16-9a4c-40e51067ea9e admin admin] REQUEST_METHOD: `PUT` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca524ee-00a4-4d16-9a4c-40e51067ea9e admin admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca524ee-00a4-4d16-9a4c-40e51067ea9e admin admin] PATH_INFO: `/v3/projects/ea8d517cde1d40bb82c97e080ce071f7/groups/039a8013241542f3a1d4564adb89dbcb/roles/e7989893488f483baa107be56668c4f8` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca524ee-00a4-4d16-9a4c-40e51067ea9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea8d517cde1d40bb82c97e080ce071f7, group_id=039a8013241542f3a1d4564adb89dbcb, role_id=e7989893488f483baa107be56668c4f8)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca524ee-00a4-4d16-9a4c-40e51067ea9e admin admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:36:58 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 143/298] 10.27.203.238 () {58 vars in 1463 bytes} [Tue May 28 12:36:58 2024] PUT /identity/v3/projects/ea8d517cde1d40bb82c97e080ce071f7/groups/039a8013241542f3a1d4564adb89dbcb/roles/e7989893488f483baa107be56668c4f8 => generated 0 bytes in 23 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:36:59 l75lg1-v1 dstat.sh[49771]: 28-05 12:36:59| 53 11 34 1 0|1561M 8178M 234M 5729M| 25k 15k| 0 2320k| 0 187 |8521 13k|2.05 1.00 0.68|5.0 0 515| 0 0 | 0 2048M| 19 29 0 7 0 May 28 12:36:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ef2e54-9966-49d1-9652-943fe7f18490 None None] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ef2e54-9966-49d1-9652-943fe7f18490 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ef2e54-9966-49d1-9652-943fe7f18490 None None] PATH_INFO: `/` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:59 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 156/299] 10.27.203.238 () {54 vars in 926 bytes} [Tue May 28 12:36:59 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:36:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985b2885-cc21-4649-9ca7-3143c24ed43a None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985b2885-cc21-4649-9ca7-3143c24ed43a None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985b2885-cc21-4649-9ca7-3143c24ed43a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:59 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-985b2885-cc21-4649-9ca7-3143c24ed43a None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:36:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-985b2885-cc21-4649-9ca7-3143c24ed43a None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:36:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-985b2885-cc21-4649-9ca7-3143c24ed43a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:36:59 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 144/300] 10.27.203.238 () {58 vars in 1023 bytes} [Tue May 28 12:36:59 2024] POST /identity/v3/auth/tokens => generated 864 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 28 12:36:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615f4b06-f7bc-4523-acab-e73c15dd24cf None None] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615f4b06-f7bc-4523-acab-e73c15dd24cf None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615f4b06-f7bc-4523-acab-e73c15dd24cf None None] PATH_INFO: `/` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:59 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 157/301] 10.27.203.238 () {54 vars in 926 bytes} [Tue May 28 12:36:59 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:36:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30985f16-fe9a-4b59-bf5b-07b5fe68ddc9 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30985f16-fe9a-4b59-bf5b-07b5fe68ddc9 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30985f16-fe9a-4b59-bf5b-07b5fe68ddc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:59 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-30985f16-fe9a-4b59-bf5b-07b5fe68ddc9 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:36:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-30985f16-fe9a-4b59-bf5b-07b5fe68ddc9 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:36:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-30985f16-fe9a-4b59-bf5b-07b5fe68ddc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:36:59 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 145/302] 10.27.203.238 () {58 vars in 1023 bytes} [Tue May 28 12:36:59 2024] POST /identity/v3/auth/tokens => generated 864 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 28 12:36:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615f4b06-f7bc-4523-acab-e73c15dd24cf None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e16135-14fc-4d11-a37c-f6eba0db9d18 None None] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e16135-14fc-4d11-a37c-f6eba0db9d18 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e16135-14fc-4d11-a37c-f6eba0db9d18 None None] PATH_INFO: `/` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:59 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 146/303] 10.27.203.238 () {54 vars in 926 bytes} [Tue May 28 12:36:59 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:36:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c539fd8-d815-45ec-a5ef-7bd073eab97c None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c539fd8-d815-45ec-a5ef-7bd073eab97c None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c539fd8-d815-45ec-a5ef-7bd073eab97c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:59 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-6c539fd8-d815-45ec-a5ef-7bd073eab97c None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:36:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-6c539fd8-d815-45ec-a5ef-7bd073eab97c None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:36:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-6c539fd8-d815-45ec-a5ef-7bd073eab97c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:36:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615f4b06-f7bc-4523-acab-e73c15dd24cf None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:36:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc32ce9-2256-4576-97d0-030c4c84e85d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:36:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc32ce9-2256-4576-97d0-030c4c84e85d None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:36:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc32ce9-2256-4576-97d0-030c4c84e85d None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:36:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc32ce9-2256-4576-97d0-030c4c84e85d None admin] PATH_INFO: `/v3/roles/member` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:36:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc32ce9-2256-4576-97d0-030c4c84e85d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 28 12:36:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-ffc32ce9-2256-4576-97d0-030c4c84e85d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 28 12:36:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:36:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:36:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:36:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:36:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:36:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:36:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:36:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:36:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:36:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:36:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:36:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 28 12:36:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._get_role(role_id) May 28 12:36:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 28 12:36:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 28 12:36:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 28 12:36:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 28 12:36:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 28 12:36:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 28 12:36:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:36:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:36:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:36:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:36:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:36:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:36:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:36:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 12:36:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:36:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 12:36:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:36:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:36:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:36:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 12:36:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:36:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 12:36:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1281, in get_role May 28 12:36:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 28 12:36:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 28 12:36:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 28 12:36:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 28 12:36:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 28 12:36:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 28 12:36:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 12:36:59 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 158/304] 10.27.203.238 () {56 vars in 1099 bytes} [Tue May 28 12:36:59 2024] GET /identity/v3/roles/member => generated 84 bytes in 93 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 28 12:36:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc32ce9-2256-4576-97d0-030c4c84e85d None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:59 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 147/305] 10.27.203.238 () {58 vars in 1023 bytes} [Tue May 28 12:36:59 2024] POST /identity/v3/auth/tokens => generated 864 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 28 12:36:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c539fd8-d815-45ec-a5ef-7bd073eab97c None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:36:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc32ce9-2256-4576-97d0-030c4c84e85d None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c539fd8-d815-45ec-a5ef-7bd073eab97c None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8f8869-8555-441e-906e-c5df282d4c6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8f8869-8555-441e-906e-c5df282d4c6b None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8f8869-8555-441e-906e-c5df282d4c6b None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8f8869-8555-441e-906e-c5df282d4c6b None admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8f8869-8555-441e-906e-c5df282d4c6b None admin] RBAC: Adding query filter params (name=member) {{(pid=51267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8f8869-8555-441e-906e-c5df282d4c6b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8f8869-8555-441e-906e-c5df282d4c6b None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 159/306] 10.27.203.238 () {56 vars in 1101 bytes} [Tue May 28 12:36:59 2024] GET /identity/v3/roles?name=member => generated 345 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec227b13-710d-43da-a1f2-e8dd7f74b985 None None] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec227b13-710d-43da-a1f2-e8dd7f74b985 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec227b13-710d-43da-a1f2-e8dd7f74b985 None None] PATH_INFO: `/` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 160/307] 10.27.203.238 () {54 vars in 926 bytes} [Tue May 28 12:37:00 2024] GET /identity => generated 272 bytes in 1 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec227b13-710d-43da-a1f2-e8dd7f74b985 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41e4150-467f-4b4c-a15a-816cf3d0c63a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41e4150-467f-4b4c-a15a-816cf3d0c63a None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41e4150-467f-4b4c-a15a-816cf3d0c63a None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41e4150-467f-4b4c-a15a-816cf3d0c63a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41e4150-467f-4b4c-a15a-816cf3d0c63a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-f41e4150-467f-4b4c-a15a-816cf3d0c63a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._get_role(role_id) May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1281, in get_role May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 148/308] 10.27.203.238 () {56 vars in 1114 bytes} [Tue May 28 12:36:59 2024] GET /identity/v3/roles/anotherrole => generated 89 bytes in 88 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cfedcf-c474-4f9e-8bc3-961552c9df92 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cfedcf-c474-4f9e-8bc3-961552c9df92 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cfedcf-c474-4f9e-8bc3-961552c9df92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-f8cfedcf-c474-4f9e-8bc3-961552c9df92 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-f8cfedcf-c474-4f9e-8bc3-961552c9df92 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-f8cfedcf-c474-4f9e-8bc3-961552c9df92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec227b13-710d-43da-a1f2-e8dd7f74b985 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37266429-760a-4ae9-bbc8-db32dbf17c3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37266429-760a-4ae9-bbc8-db32dbf17c3d None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37266429-760a-4ae9-bbc8-db32dbf17c3d None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37266429-760a-4ae9-bbc8-db32dbf17c3d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 149/309] 10.27.203.238 () {58 vars in 1023 bytes} [Tue May 28 12:37:00 2024] POST /identity/v3/auth/tokens => generated 864 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cfedcf-c474-4f9e-8bc3-961552c9df92 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37266429-760a-4ae9-bbc8-db32dbf17c3d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37266429-760a-4ae9-bbc8-db32dbf17c3d None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cfedcf-c474-4f9e-8bc3-961552c9df92 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 161/310] 10.27.203.238 () {58 vars in 1282 bytes} [Tue May 28 12:37:00 2024] GET /identity/v3/auth/tokens => generated 864 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37266429-760a-4ae9-bbc8-db32dbf17c3d None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c53772c-a960-4c15-a470-78eeb2a8ea01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c53772c-a960-4c15-a470-78eeb2a8ea01 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c53772c-a960-4c15-a470-78eeb2a8ea01 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c53772c-a960-4c15-a470-78eeb2a8ea01 None admin] PATH_INFO: `/v3/roles` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c53772c-a960-4c15-a470-78eeb2a8ea01 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c53772c-a960-4c15-a470-78eeb2a8ea01 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c53772c-a960-4c15-a470-78eeb2a8ea01 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 150/311] 10.27.203.238 () {56 vars in 1111 bytes} [Tue May 28 12:37:00 2024] GET /identity/v3/roles?name=anotherrole => generated 338 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c53772c-a960-4c15-a470-78eeb2a8ea01 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37266429-760a-4ae9-bbc8-db32dbf17c3d None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:00 l75lg1-v1 dstat.sh[49771]: 28-05 12:37:00| 44 5 51 0 0|1698M 8041M 234M 5729M| 20k 86B| 0 112k| 0 10.0 |5912 9191 |2.05 1.00 0.68|4.0 0 0| 0 0 | 0 2048M| 19 32 0 7 0 May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c53772c-a960-4c15-a470-78eeb2a8ea01 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd16ccaa-663e-4835-bcda-f6f4d8b21a63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd16ccaa-663e-4835-bcda-f6f4d8b21a63 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd16ccaa-663e-4835-bcda-f6f4d8b21a63 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd16ccaa-663e-4835-bcda-f6f4d8b21a63 None admin] PATH_INFO: `/v3/roles/member` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd16ccaa-663e-4835-bcda-f6f4d8b21a63 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-fd16ccaa-663e-4835-bcda-f6f4d8b21a63 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._get_role(role_id) May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1281, in get_role May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 162/312] 10.27.203.238 () {56 vars in 1099 bytes} [Tue May 28 12:37:00 2024] GET /identity/v3/roles/member => generated 84 bytes in 93 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd16ccaa-663e-4835-bcda-f6f4d8b21a63 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31861aa6-1583-4e60-ab7b-225b45090d45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31861aa6-1583-4e60-ab7b-225b45090d45 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31861aa6-1583-4e60-ab7b-225b45090d45 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31861aa6-1583-4e60-ab7b-225b45090d45 None admin] PATH_INFO: `/v3/projects/95de88f6d26e4420bc466ba67668171f` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31861aa6-1583-4e60-ab7b-225b45090d45 None admin] RBAC: Authorizing `identity:get_project(project_id=95de88f6d26e4420bc466ba67668171f)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31861aa6-1583-4e60-ab7b-225b45090d45 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 151/313] 10.27.203.238 () {56 vars in 1186 bytes} [Tue May 28 12:37:00 2024] GET /identity/v3/projects/95de88f6d26e4420bc466ba67668171f => generated 300 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31861aa6-1583-4e60-ab7b-225b45090d45 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd16ccaa-663e-4835-bcda-f6f4d8b21a63 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31861aa6-1583-4e60-ab7b-225b45090d45 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ec839f-8caa-4805-9f3d-3d470af95628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ec839f-8caa-4805-9f3d-3d470af95628 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ec839f-8caa-4805-9f3d-3d470af95628 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ec839f-8caa-4805-9f3d-3d470af95628 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7639be60-59f6-4f57-8029-c040249c19cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7639be60-59f6-4f57-8029-c040249c19cd None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7639be60-59f6-4f57-8029-c040249c19cd None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7639be60-59f6-4f57-8029-c040249c19cd None admin] PATH_INFO: `/v3/roles` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7639be60-59f6-4f57-8029-c040249c19cd None admin] RBAC: Adding query filter params (name=member) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7639be60-59f6-4f57-8029-c040249c19cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7639be60-59f6-4f57-8029-c040249c19cd None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 152/314] 10.27.203.238 () {56 vars in 1101 bytes} [Tue May 28 12:37:00 2024] GET /identity/v3/roles?name=member => generated 345 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7639be60-59f6-4f57-8029-c040249c19cd None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ec839f-8caa-4805-9f3d-3d470af95628 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ec839f-8caa-4805-9f3d-3d470af95628 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7639be60-59f6-4f57-8029-c040249c19cd None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 163/315] 10.27.203.238 () {58 vars in 1282 bytes} [Tue May 28 12:37:00 2024] GET /identity/v3/auth/tokens => generated 864 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ec839f-8caa-4805-9f3d-3d470af95628 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5902d2d-ad98-482c-afb7-fcb1ee893a0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5902d2d-ad98-482c-afb7-fcb1ee893a0a None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5902d2d-ad98-482c-afb7-fcb1ee893a0a None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5902d2d-ad98-482c-afb7-fcb1ee893a0a None admin] PATH_INFO: `/v3/groups/a56bfda02d2d48cf9979a3a2aaad10b9` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5902d2d-ad98-482c-afb7-fcb1ee893a0a None admin] RBAC: Authorizing `identity:get_group(group_id=a56bfda02d2d48cf9979a3a2aaad10b9)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5902d2d-ad98-482c-afb7-fcb1ee893a0a None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 153/316] 10.27.203.238 () {56 vars in 1180 bytes} [Tue May 28 12:37:00 2024] GET /identity/v3/groups/a56bfda02d2d48cf9979a3a2aaad10b9 => generated 228 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd36c136-d9c6-46ab-9b7d-f9ab98466928 None None] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd36c136-d9c6-46ab-9b7d-f9ab98466928 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd36c136-d9c6-46ab-9b7d-f9ab98466928 None None] PATH_INFO: `/` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 154/317] 10.27.203.238 () {54 vars in 926 bytes} [Tue May 28 12:37:00 2024] GET /identity => generated 272 bytes in 1 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd36c136-d9c6-46ab-9b7d-f9ab98466928 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ec839f-8caa-4805-9f3d-3d470af95628 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd36c136-d9c6-46ab-9b7d-f9ab98466928 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef2ed7f-697d-42e8-94bd-50f2a3c740cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef2ed7f-697d-42e8-94bd-50f2a3c740cd None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef2ed7f-697d-42e8-94bd-50f2a3c740cd None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef2ed7f-697d-42e8-94bd-50f2a3c740cd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef2ed7f-697d-42e8-94bd-50f2a3c740cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-0ef2ed7f-697d-42e8-94bd-50f2a3c740cd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._get_role(role_id) May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1281, in get_role May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 164/318] 10.27.203.238 () {56 vars in 1114 bytes} [Tue May 28 12:37:00 2024] GET /identity/v3/roles/anotherrole => generated 89 bytes in 87 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef2ed7f-697d-42e8-94bd-50f2a3c740cd None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185babf2-a546-43a8-809a-dfa6d0d6ab8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185babf2-a546-43a8-809a-dfa6d0d6ab8f None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185babf2-a546-43a8-809a-dfa6d0d6ab8f None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185babf2-a546-43a8-809a-dfa6d0d6ab8f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185babf2-a546-43a8-809a-dfa6d0d6ab8f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185babf2-a546-43a8-809a-dfa6d0d6ab8f None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef2ed7f-697d-42e8-94bd-50f2a3c740cd None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60961808-7811-44ee-b476-18f9a75e0937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60961808-7811-44ee-b476-18f9a75e0937 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60961808-7811-44ee-b476-18f9a75e0937 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60961808-7811-44ee-b476-18f9a75e0937 None admin] PATH_INFO: `/v3/projects/95de88f6d26e4420bc466ba67668171f` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60961808-7811-44ee-b476-18f9a75e0937 None admin] RBAC: Authorizing `identity:get_project(project_id=95de88f6d26e4420bc466ba67668171f)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60961808-7811-44ee-b476-18f9a75e0937 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 165/319] 10.27.203.238 () {56 vars in 1186 bytes} [Tue May 28 12:37:00 2024] GET /identity/v3/projects/95de88f6d26e4420bc466ba67668171f => generated 300 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60961808-7811-44ee-b476-18f9a75e0937 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 155/320] 10.27.203.238 () {58 vars in 1282 bytes} [Tue May 28 12:37:00 2024] GET /identity/v3/auth/tokens => generated 864 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82df5e74-e52e-4129-b0cf-5bc92276ecd3 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82df5e74-e52e-4129-b0cf-5bc92276ecd3 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82df5e74-e52e-4129-b0cf-5bc92276ecd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-82df5e74-e52e-4129-b0cf-5bc92276ecd3 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-82df5e74-e52e-4129-b0cf-5bc92276ecd3 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-82df5e74-e52e-4129-b0cf-5bc92276ecd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60961808-7811-44ee-b476-18f9a75e0937 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 156/321] 10.27.203.238 () {58 vars in 1023 bytes} [Tue May 28 12:37:00 2024] POST /identity/v3/auth/tokens => generated 864 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82df5e74-e52e-4129-b0cf-5bc92276ecd3 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5492dd-f12a-46d6-a532-3b04b4e5e8d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5492dd-f12a-46d6-a532-3b04b4e5e8d0 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5492dd-f12a-46d6-a532-3b04b4e5e8d0 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5492dd-f12a-46d6-a532-3b04b4e5e8d0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5492dd-f12a-46d6-a532-3b04b4e5e8d0 None admin] RBAC: Adding query filter params (group.id=a56bfda02d2d48cf9979a3a2aaad10b9, role.id=44620cad10ae407c90c91e2c296adb04, scope.project.id=95de88f6d26e4420bc466ba67668171f) {{(pid=51267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5492dd-f12a-46d6-a532-3b04b4e5e8d0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5492dd-f12a-46d6-a532-3b04b4e5e8d0 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 166/322] 10.27.203.238 () {56 vars in 1376 bytes} [Tue May 28 12:37:00 2024] GET /identity/v3/role_assignments?group.id=a56bfda02d2d48cf9979a3a2aaad10b9&scope.project.id=95de88f6d26e4420bc466ba67668171f&role.id=44620cad10ae407c90c91e2c296adb04 => generated 615 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5492dd-f12a-46d6-a532-3b04b4e5e8d0 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82df5e74-e52e-4129-b0cf-5bc92276ecd3 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5492dd-f12a-46d6-a532-3b04b4e5e8d0 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b3ff4f-8ff7-4165-a366-7e478c8f15d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b3ff4f-8ff7-4165-a366-7e478c8f15d5 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b3ff4f-8ff7-4165-a366-7e478c8f15d5 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b3ff4f-8ff7-4165-a366-7e478c8f15d5 None admin] PATH_INFO: `/v3/roles` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b3ff4f-8ff7-4165-a366-7e478c8f15d5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b3ff4f-8ff7-4165-a366-7e478c8f15d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b3ff4f-8ff7-4165-a366-7e478c8f15d5 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 157/323] 10.27.203.238 () {56 vars in 1111 bytes} [Tue May 28 12:37:00 2024] GET /identity/v3/roles?name=anotherrole => generated 338 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b3ff4f-8ff7-4165-a366-7e478c8f15d5 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197b56e6-3358-4eb2-b4a4-a43f6975590f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197b56e6-3358-4eb2-b4a4-a43f6975590f None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197b56e6-3358-4eb2-b4a4-a43f6975590f None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197b56e6-3358-4eb2-b4a4-a43f6975590f None admin] PATH_INFO: `/v3/groups/a56bfda02d2d48cf9979a3a2aaad10b9` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197b56e6-3358-4eb2-b4a4-a43f6975590f None admin] RBAC: Authorizing `identity:get_group(group_id=a56bfda02d2d48cf9979a3a2aaad10b9)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197b56e6-3358-4eb2-b4a4-a43f6975590f None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 167/324] 10.27.203.238 () {56 vars in 1180 bytes} [Tue May 28 12:37:00 2024] GET /identity/v3/groups/a56bfda02d2d48cf9979a3a2aaad10b9 => generated 228 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197b56e6-3358-4eb2-b4a4-a43f6975590f None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b3ff4f-8ff7-4165-a366-7e478c8f15d5 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197b56e6-3358-4eb2-b4a4-a43f6975590f None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d6775e-ce65-4c36-8987-27e78acc43a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d6775e-ce65-4c36-8987-27e78acc43a8 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d6775e-ce65-4c36-8987-27e78acc43a8 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d6775e-ce65-4c36-8987-27e78acc43a8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1930dbbf-dbaf-41d7-9858-86c09a497d51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1930dbbf-dbaf-41d7-9858-86c09a497d51 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1930dbbf-dbaf-41d7-9858-86c09a497d51 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1930dbbf-dbaf-41d7-9858-86c09a497d51 None admin] PATH_INFO: `/v3/projects/6694b9ccc35f48a680a684b41016b8db` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1930dbbf-dbaf-41d7-9858-86c09a497d51 None admin] RBAC: Authorizing `identity:get_project(project_id=6694b9ccc35f48a680a684b41016b8db)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1930dbbf-dbaf-41d7-9858-86c09a497d51 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 158/325] 10.27.203.238 () {56 vars in 1186 bytes} [Tue May 28 12:37:00 2024] GET /identity/v3/projects/6694b9ccc35f48a680a684b41016b8db => generated 304 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1930dbbf-dbaf-41d7-9858-86c09a497d51 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d6775e-ce65-4c36-8987-27e78acc43a8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d6775e-ce65-4c36-8987-27e78acc43a8 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1930dbbf-dbaf-41d7-9858-86c09a497d51 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 168/326] 10.27.203.238 () {58 vars in 1282 bytes} [Tue May 28 12:37:00 2024] GET /identity/v3/auth/tokens => generated 864 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d6775e-ce65-4c36-8987-27e78acc43a8 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842f9e18-6085-4756-8925-82ab8d2815dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842f9e18-6085-4756-8925-82ab8d2815dd None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842f9e18-6085-4756-8925-82ab8d2815dd None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842f9e18-6085-4756-8925-82ab8d2815dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842f9e18-6085-4756-8925-82ab8d2815dd None admin] RBAC: Adding query filter params (group.id=a56bfda02d2d48cf9979a3a2aaad10b9, role.id=67bacc33b83c4fc898309c1e5960a722, scope.project.id=95de88f6d26e4420bc466ba67668171f) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842f9e18-6085-4756-8925-82ab8d2815dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842f9e18-6085-4756-8925-82ab8d2815dd None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 159/327] 10.27.203.238 () {56 vars in 1376 bytes} [Tue May 28 12:37:00 2024] GET /identity/v3/role_assignments?group.id=a56bfda02d2d48cf9979a3a2aaad10b9&scope.project.id=95de88f6d26e4420bc466ba67668171f&role.id=67bacc33b83c4fc898309c1e5960a722 => generated 615 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842f9e18-6085-4756-8925-82ab8d2815dd None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d6775e-ce65-4c36-8987-27e78acc43a8 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842f9e18-6085-4756-8925-82ab8d2815dd None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a7f7ea-f8fe-44f2-af21-7b7badb03dc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a7f7ea-f8fe-44f2-af21-7b7badb03dc2 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a7f7ea-f8fe-44f2-af21-7b7badb03dc2 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a7f7ea-f8fe-44f2-af21-7b7badb03dc2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a7f7ea-f8fe-44f2-af21-7b7badb03dc2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 28 12:37:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-00a7f7ea-f8fe-44f2-af21-7b7badb03dc2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 28 12:37:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:37:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:37:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:37:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:37:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:37:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:37:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:37:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:37:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:37:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:37:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:37:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 28 12:37:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._get_role(role_id) May 28 12:37:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 28 12:37:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 28 12:37:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 28 12:37:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 28 12:37:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 28 12:37:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 28 12:37:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:37:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:37:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:37:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:37:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:37:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:37:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:37:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 12:37:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:37:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 12:37:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:37:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:37:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:37:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 12:37:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:37:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 12:37:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1281, in get_role May 28 12:37:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 28 12:37:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 28 12:37:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 28 12:37:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 28 12:37:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 28 12:37:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 28 12:37:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 12:37:01 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 169/328] 10.27.203.238 () {56 vars in 1096 bytes} [Tue May 28 12:37:00 2024] GET /identity/v3/roles/admin => generated 83 bytes in 100 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 28 12:37:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a7f7ea-f8fe-44f2-af21-7b7badb03dc2 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd3b588-2671-488d-ae52-08d7b390ce42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd3b588-2671-488d-ae52-08d7b390ce42 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd3b588-2671-488d-ae52-08d7b390ce42 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd3b588-2671-488d-ae52-08d7b390ce42 None admin] PATH_INFO: `/v3/groups/a56bfda02d2d48cf9979a3a2aaad10b9` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd3b588-2671-488d-ae52-08d7b390ce42 None admin] RBAC: Authorizing `identity:get_group(group_id=a56bfda02d2d48cf9979a3a2aaad10b9)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd3b588-2671-488d-ae52-08d7b390ce42 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:01 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 160/329] 10.27.203.238 () {56 vars in 1180 bytes} [Tue May 28 12:37:00 2024] GET /identity/v3/groups/a56bfda02d2d48cf9979a3a2aaad10b9 => generated 228 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:37:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd3b588-2671-488d-ae52-08d7b390ce42 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a7f7ea-f8fe-44f2-af21-7b7badb03dc2 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd3b588-2671-488d-ae52-08d7b390ce42 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864d7bdf-f673-46d4-80b3-8261d0c41b9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864d7bdf-f673-46d4-80b3-8261d0c41b9c None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864d7bdf-f673-46d4-80b3-8261d0c41b9c None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864d7bdf-f673-46d4-80b3-8261d0c41b9c None admin] PATH_INFO: `/v3/projects/6694b9ccc35f48a680a684b41016b8db` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864d7bdf-f673-46d4-80b3-8261d0c41b9c None admin] RBAC: Authorizing `identity:get_project(project_id=6694b9ccc35f48a680a684b41016b8db)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864d7bdf-f673-46d4-80b3-8261d0c41b9c None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:01 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 170/330] 10.27.203.238 () {56 vars in 1186 bytes} [Tue May 28 12:37:01 2024] GET /identity/v3/projects/6694b9ccc35f48a680a684b41016b8db => generated 304 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:37:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864d7bdf-f673-46d4-80b3-8261d0c41b9c None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48467461-842a-4a83-b582-9567cdce2ab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48467461-842a-4a83-b582-9567cdce2ab1 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48467461-842a-4a83-b582-9567cdce2ab1 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48467461-842a-4a83-b582-9567cdce2ab1 None admin] PATH_INFO: `/v3/roles` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48467461-842a-4a83-b582-9567cdce2ab1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:37:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48467461-842a-4a83-b582-9567cdce2ab1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48467461-842a-4a83-b582-9567cdce2ab1 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:01 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 161/331] 10.27.203.238 () {56 vars in 1099 bytes} [Tue May 28 12:37:01 2024] GET /identity/v3/roles?name=admin => generated 343 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:37:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48467461-842a-4a83-b582-9567cdce2ab1 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864d7bdf-f673-46d4-80b3-8261d0c41b9c None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48467461-842a-4a83-b582-9567cdce2ab1 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1ed9f5-f8a5-4fee-a3d9-edec17986d81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1ed9f5-f8a5-4fee-a3d9-edec17986d81 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1ed9f5-f8a5-4fee-a3d9-edec17986d81 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1ed9f5-f8a5-4fee-a3d9-edec17986d81 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1ed9f5-f8a5-4fee-a3d9-edec17986d81 None admin] RBAC: Adding query filter params (group.id=a56bfda02d2d48cf9979a3a2aaad10b9, role.id=44620cad10ae407c90c91e2c296adb04, scope.project.id=6694b9ccc35f48a680a684b41016b8db) {{(pid=51267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:37:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1ed9f5-f8a5-4fee-a3d9-edec17986d81 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1ed9f5-f8a5-4fee-a3d9-edec17986d81 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:01 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 171/332] 10.27.203.238 () {56 vars in 1376 bytes} [Tue May 28 12:37:01 2024] GET /identity/v3/role_assignments?group.id=a56bfda02d2d48cf9979a3a2aaad10b9&scope.project.id=6694b9ccc35f48a680a684b41016b8db&role.id=44620cad10ae407c90c91e2c296adb04 => generated 615 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:37:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1ed9f5-f8a5-4fee-a3d9-edec17986d81 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafe34ca-c334-4283-b24c-9f878183c490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafe34ca-c334-4283-b24c-9f878183c490 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafe34ca-c334-4283-b24c-9f878183c490 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafe34ca-c334-4283-b24c-9f878183c490 None admin] PATH_INFO: `/v3/groups/a56bfda02d2d48cf9979a3a2aaad10b9` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafe34ca-c334-4283-b24c-9f878183c490 None admin] RBAC: Authorizing `identity:get_group(group_id=a56bfda02d2d48cf9979a3a2aaad10b9)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafe34ca-c334-4283-b24c-9f878183c490 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:01 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 162/333] 10.27.203.238 () {56 vars in 1180 bytes} [Tue May 28 12:37:01 2024] GET /identity/v3/groups/a56bfda02d2d48cf9979a3a2aaad10b9 => generated 228 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:37:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafe34ca-c334-4283-b24c-9f878183c490 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:01 l75lg1-v1 dstat.sh[49771]: 28-05 12:37:01| 28 5 66 0 0|1591M 8148M 234M 5729M| 36k 3402B| 0 564k| 0 16.0 |9749 18k|2.21 1.05 0.70|5.0 0 164| 0 0 | 0 2048M| 19 31 0 7 0 May 28 12:37:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1ed9f5-f8a5-4fee-a3d9-edec17986d81 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafe34ca-c334-4283-b24c-9f878183c490 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac09dda-7157-4098-b912-d475c0ce02eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac09dda-7157-4098-b912-d475c0ce02eb None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac09dda-7157-4098-b912-d475c0ce02eb None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac09dda-7157-4098-b912-d475c0ce02eb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0194a81a-66b4-4419-9dda-c63c3f5dd283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0194a81a-66b4-4419-9dda-c63c3f5dd283 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0194a81a-66b4-4419-9dda-c63c3f5dd283 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0194a81a-66b4-4419-9dda-c63c3f5dd283 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0194a81a-66b4-4419-9dda-c63c3f5dd283 None admin] RBAC: Adding query filter params (group.id=a56bfda02d2d48cf9979a3a2aaad10b9, role.id=67bacc33b83c4fc898309c1e5960a722, scope.project.id=6694b9ccc35f48a680a684b41016b8db) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:37:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0194a81a-66b4-4419-9dda-c63c3f5dd283 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0194a81a-66b4-4419-9dda-c63c3f5dd283 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:01 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 163/334] 10.27.203.238 () {56 vars in 1376 bytes} [Tue May 28 12:37:01 2024] GET /identity/v3/role_assignments?group.id=a56bfda02d2d48cf9979a3a2aaad10b9&scope.project.id=6694b9ccc35f48a680a684b41016b8db&role.id=67bacc33b83c4fc898309c1e5960a722 => generated 615 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:37:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac09dda-7157-4098-b912-d475c0ce02eb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac09dda-7157-4098-b912-d475c0ce02eb None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:01 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 172/335] 10.27.203.238 () {58 vars in 1282 bytes} [Tue May 28 12:37:01 2024] GET /identity/v3/auth/tokens => generated 864 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 28 12:37:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0194a81a-66b4-4419-9dda-c63c3f5dd283 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0194a81a-66b4-4419-9dda-c63c3f5dd283 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f8db11-2247-4b4a-a37c-fc572cd56c22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f8db11-2247-4b4a-a37c-fc572cd56c22 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f8db11-2247-4b4a-a37c-fc572cd56c22 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f8db11-2247-4b4a-a37c-fc572cd56c22 None admin] PATH_INFO: `/v3/projects/ea8d517cde1d40bb82c97e080ce071f7` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f8db11-2247-4b4a-a37c-fc572cd56c22 None admin] RBAC: Authorizing `identity:get_project(project_id=ea8d517cde1d40bb82c97e080ce071f7)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f8db11-2247-4b4a-a37c-fc572cd56c22 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:01 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 164/336] 10.27.203.238 () {56 vars in 1186 bytes} [Tue May 28 12:37:01 2024] GET /identity/v3/projects/ea8d517cde1d40bb82c97e080ce071f7 => generated 346 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:37:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac09dda-7157-4098-b912-d475c0ce02eb None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac09dda-7157-4098-b912-d475c0ce02eb None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb9cdfa-3fd6-44d2-9a97-1bea04a69c0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb9cdfa-3fd6-44d2-9a97-1bea04a69c0a None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb9cdfa-3fd6-44d2-9a97-1bea04a69c0a None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb9cdfa-3fd6-44d2-9a97-1bea04a69c0a None admin] PATH_INFO: `/v3/groups/039a8013241542f3a1d4564adb89dbcb` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb9cdfa-3fd6-44d2-9a97-1bea04a69c0a None admin] RBAC: Authorizing `identity:get_group(group_id=039a8013241542f3a1d4564adb89dbcb)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb9cdfa-3fd6-44d2-9a97-1bea04a69c0a None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:01 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 173/337] 10.27.203.238 () {56 vars in 1180 bytes} [Tue May 28 12:37:01 2024] GET /identity/v3/groups/039a8013241542f3a1d4564adb89dbcb => generated 231 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:37:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f8db11-2247-4b4a-a37c-fc572cd56c22 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f8db11-2247-4b4a-a37c-fc572cd56c22 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4908eaf1-7a5e-4a37-9216-43700fd13e39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4908eaf1-7a5e-4a37-9216-43700fd13e39 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4908eaf1-7a5e-4a37-9216-43700fd13e39 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4908eaf1-7a5e-4a37-9216-43700fd13e39 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4908eaf1-7a5e-4a37-9216-43700fd13e39 None admin] RBAC: Adding query filter params (group.id=039a8013241542f3a1d4564adb89dbcb, role.id=e7989893488f483baa107be56668c4f8, scope.project.id=ea8d517cde1d40bb82c97e080ce071f7) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:37:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4908eaf1-7a5e-4a37-9216-43700fd13e39 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4908eaf1-7a5e-4a37-9216-43700fd13e39 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:01 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 165/338] 10.27.203.238 () {56 vars in 1376 bytes} [Tue May 28 12:37:01 2024] GET /identity/v3/role_assignments?group.id=039a8013241542f3a1d4564adb89dbcb&scope.project.id=ea8d517cde1d40bb82c97e080ce071f7&role.id=e7989893488f483baa107be56668c4f8 => generated 615 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:37:02 l75lg1-v1 dstat.sh[49771]: 28-05 12:37:02| 14 10 75 0 0|1424M 8315M 234M 5729M| 46k 16k| 0 200k| 0 15.0 |6481 8376 |2.21 1.05 0.70|2.0 0 587| 0 0 | 0 2048M| 19 29 0 7 0 May 28 12:37:03 l75lg1-v1 dstat.sh[49771]: 28-05 12:37:03| 36 12 53 0 0|1596M 8143M 234M 5729M| 43k 12k| 0 232k| 0 22.0 |5084 5321 |2.21 1.05 0.70|5.0 0 608| 0 0 | 0 2048M| 19 29 0 7 0 May 28 12:37:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a55c4b7-1cd9-4f87-9ac6-3b6506650be6 None None] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a55c4b7-1cd9-4f87-9ac6-3b6506650be6 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a55c4b7-1cd9-4f87-9ac6-3b6506650be6 None None] PATH_INFO: `/` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:03 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 174/339] 10.27.203.238 () {54 vars in 926 bytes} [Tue May 28 12:37:03 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:37:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68e4df8-ff21-4c18-8760-e000b2cdd014 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68e4df8-ff21-4c18-8760-e000b2cdd014 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68e4df8-ff21-4c18-8760-e000b2cdd014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:03 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-c68e4df8-ff21-4c18-8760-e000b2cdd014 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:37:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-c68e4df8-ff21-4c18-8760-e000b2cdd014 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:37:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-c68e4df8-ff21-4c18-8760-e000b2cdd014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:37:03 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 166/340] 10.27.203.238 () {58 vars in 1023 bytes} [Tue May 28 12:37:03 2024] POST /identity/v3/auth/tokens => generated 864 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 28 12:37:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00541bd7-e3ea-4819-831c-a9baa95750e3 None None] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00541bd7-e3ea-4819-831c-a9baa95750e3 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00541bd7-e3ea-4819-831c-a9baa95750e3 None None] PATH_INFO: `/` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:03 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 175/341] 10.27.203.238 () {54 vars in 926 bytes} [Tue May 28 12:37:03 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:37:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ab838e-976a-4643-9f3b-99dde8be61b5 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ab838e-976a-4643-9f3b-99dde8be61b5 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ab838e-976a-4643-9f3b-99dde8be61b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:03 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-01ab838e-976a-4643-9f3b-99dde8be61b5 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:37:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-01ab838e-976a-4643-9f3b-99dde8be61b5 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:37:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-01ab838e-976a-4643-9f3b-99dde8be61b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:37:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00541bd7-e3ea-4819-831c-a9baa95750e3 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:03 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 167/342] 10.27.203.238 () {58 vars in 1023 bytes} [Tue May 28 12:37:03 2024] POST /identity/v3/auth/tokens => generated 864 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 28 12:37:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00541bd7-e3ea-4819-831c-a9baa95750e3 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1f90fc-34f6-4612-9010-6f1b6aec8b40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1f90fc-34f6-4612-9010-6f1b6aec8b40 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1f90fc-34f6-4612-9010-6f1b6aec8b40 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1f90fc-34f6-4612-9010-6f1b6aec8b40 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1f90fc-34f6-4612-9010-6f1b6aec8b40 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1f90fc-34f6-4612-9010-6f1b6aec8b40 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-4b1f90fc-34f6-4612-9010-6f1b6aec8b40 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 28 12:37:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:37:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:37:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:37:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:37:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:37:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:37:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:37:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:37:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:37:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:37:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:37:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 28 12:37:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 28 12:37:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 28 12:37:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 28 12:37:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:37:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:37:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:37:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:37:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:37:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:37:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:37:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 12:37:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:37:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 12:37:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:37:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:37:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:37:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 12:37:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:37:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 12:37:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 28 12:37:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 28 12:37:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 28 12:37:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 12:37:03 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 176/343] 10.27.203.238 () {56 vars in 1108 bytes} [Tue May 28 12:37:03 2024] GET /identity/v3/domains/Default => generated 87 bytes in 98 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 28 12:37:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ab838e-976a-4643-9f3b-99dde8be61b5 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fb67f4-250f-44c1-9e11-3c2204867acb None None] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fb67f4-250f-44c1-9e11-3c2204867acb None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fb67f4-250f-44c1-9e11-3c2204867acb None None] PATH_INFO: `/` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:03 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 177/344] 10.27.203.238 () {54 vars in 926 bytes} [Tue May 28 12:37:03 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:37:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e236cf6-9b5c-46e0-9349-82215419b79c None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e236cf6-9b5c-46e0-9349-82215419b79c None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e236cf6-9b5c-46e0-9349-82215419b79c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:03 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-4e236cf6-9b5c-46e0-9349-82215419b79c None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:37:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-4e236cf6-9b5c-46e0-9349-82215419b79c None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:37:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-4e236cf6-9b5c-46e0-9349-82215419b79c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:37:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ab838e-976a-4643-9f3b-99dde8be61b5 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bd75a1-fe84-4109-8531-963487779245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bd75a1-fe84-4109-8531-963487779245 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bd75a1-fe84-4109-8531-963487779245 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bd75a1-fe84-4109-8531-963487779245 None admin] PATH_INFO: `/v3/domains` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bd75a1-fe84-4109-8531-963487779245 None admin] RBAC: Adding query filter params (name=Default) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:37:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bd75a1-fe84-4109-8531-963487779245 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bd75a1-fe84-4109-8531-963487779245 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:03 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 178/345] 10.27.203.238 () {58 vars in 1023 bytes} [Tue May 28 12:37:03 2024] POST /identity/v3/auth/tokens => generated 864 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 28 12:37:03 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 168/346] 10.27.203.238 () {56 vars in 1109 bytes} [Tue May 28 12:37:03 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:37:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e236cf6-9b5c-46e0-9349-82215419b79c None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bd75a1-fe84-4109-8531-963487779245 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e236cf6-9b5c-46e0-9349-82215419b79c None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bd75a1-fe84-4109-8531-963487779245 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32486af-a6d7-4dd7-9298-b02204d9383b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32486af-a6d7-4dd7-9298-b02204d9383b None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32486af-a6d7-4dd7-9298-b02204d9383b None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32486af-a6d7-4dd7-9298-b02204d9383b None admin] PATH_INFO: `/v3/users` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32486af-a6d7-4dd7-9298-b02204d9383b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32486af-a6d7-4dd7-9298-b02204d9383b None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:03 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-c32486af-a6d7-4dd7-9298-b02204d9383b None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 12:37:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64e0e94-2f42-487d-a1f5-9ff70b5dfc79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64e0e94-2f42-487d-a1f5-9ff70b5dfc79 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64e0e94-2f42-487d-a1f5-9ff70b5dfc79 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64e0e94-2f42-487d-a1f5-9ff70b5dfc79 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:03 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 179/347] 10.27.203.238 () {60 vars in 1132 bytes} [Tue May 28 12:37:03 2024] POST /identity/v3/users => generated 248 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:37:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd29afc-57b4-4c8d-97d2-e0c2eb25df8c None None] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64e0e94-2f42-487d-a1f5-9ff70b5dfc79 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd29afc-57b4-4c8d-97d2-e0c2eb25df8c None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd29afc-57b4-4c8d-97d2-e0c2eb25df8c None None] PATH_INFO: `/` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64e0e94-2f42-487d-a1f5-9ff70b5dfc79 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:03 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 180/348] 10.27.203.238 () {54 vars in 926 bytes} [Tue May 28 12:37:03 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:37:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7b7964-9f84-48d9-b7b3-ef154481a11c None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7b7964-9f84-48d9-b7b3-ef154481a11c None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7b7964-9f84-48d9-b7b3-ef154481a11c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-d64e0e94-2f42-487d-a1f5-9ff70b5dfc79 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 28 12:37:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:37:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:37:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:37:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:37:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:37:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:37:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:37:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:37:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:37:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:37:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:37:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 28 12:37:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 28 12:37:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 28 12:37:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 28 12:37:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:37:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:37:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:37:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:37:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:37:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:37:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:37:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 12:37:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:37:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 12:37:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:37:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:37:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:37:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 12:37:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:37:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 12:37:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 28 12:37:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 28 12:37:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 28 12:37:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 12:37:03 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 169/349] 10.27.203.238 () {56 vars in 1108 bytes} [Tue May 28 12:37:03 2024] GET /identity/v3/domains/Default => generated 87 bytes in 102 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 28 12:37:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64e0e94-2f42-487d-a1f5-9ff70b5dfc79 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:03 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-7f7b7964-9f84-48d9-b7b3-ef154481a11c None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:37:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-7f7b7964-9f84-48d9-b7b3-ef154481a11c None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:37:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-7f7b7964-9f84-48d9-b7b3-ef154481a11c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:37:04 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64e0e94-2f42-487d-a1f5-9ff70b5dfc79 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:04 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 181/350] 10.27.203.238 () {58 vars in 1023 bytes} [Tue May 28 12:37:03 2024] POST /identity/v3/auth/tokens => generated 864 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 28 12:37:04 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7b7964-9f84-48d9-b7b3-ef154481a11c None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:04 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2527024-66c5-4b33-b738-457b91676e3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:04 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2527024-66c5-4b33-b738-457b91676e3d None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:04 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2527024-66c5-4b33-b738-457b91676e3d None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:04 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2527024-66c5-4b33-b738-457b91676e3d None admin] PATH_INFO: `/v3/domains` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:04 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2527024-66c5-4b33-b738-457b91676e3d None admin] RBAC: Adding query filter params (name=Default) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:37:04 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2527024-66c5-4b33-b738-457b91676e3d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:04 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2527024-66c5-4b33-b738-457b91676e3d None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:04 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 170/351] 10.27.203.238 () {56 vars in 1109 bytes} [Tue May 28 12:37:03 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:37:04 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2527024-66c5-4b33-b738-457b91676e3d None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:04 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7b7964-9f84-48d9-b7b3-ef154481a11c None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:04 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b78a84-32ce-4e88-986a-24f0b767f33e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:04 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b78a84-32ce-4e88-986a-24f0b767f33e None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:04 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b78a84-32ce-4e88-986a-24f0b767f33e None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:04 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b78a84-32ce-4e88-986a-24f0b767f33e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:04 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b78a84-32ce-4e88-986a-24f0b767f33e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:04 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2527024-66c5-4b33-b738-457b91676e3d None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:04 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b78a84-32ce-4e88-986a-24f0b767f33e None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:04 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-70b78a84-32ce-4e88-986a-24f0b767f33e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 28 12:37:04 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:37:04 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:37:04 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:37:04 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:37:04 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:37:04 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:37:04 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:37:04 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:37:04 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:37:04 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:37:04 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:37:04 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 28 12:37:04 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 28 12:37:04 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 28 12:37:04 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 28 12:37:04 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:37:04 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:37:04 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:37:04 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:37:04 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:37:04 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:37:04 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:37:04 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 12:37:04 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:37:04 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 12:37:04 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:37:04 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:37:04 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:37:04 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 12:37:04 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:37:04 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 12:37:04 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 28 12:37:04 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 28 12:37:04 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 28 12:37:04 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 12:37:04 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 182/352] 10.27.203.238 () {56 vars in 1108 bytes} [Tue May 28 12:37:04 2024] GET /identity/v3/domains/Default => generated 87 bytes in 94 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 28 12:37:04 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b78a84-32ce-4e88-986a-24f0b767f33e None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:04 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506d278e-5e2a-4819-b4f4-0530e5dd6c17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:04 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506d278e-5e2a-4819-b4f4-0530e5dd6c17 None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:04 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506d278e-5e2a-4819-b4f4-0530e5dd6c17 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:04 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506d278e-5e2a-4819-b4f4-0530e5dd6c17 None admin] PATH_INFO: `/v3/users` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:04 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506d278e-5e2a-4819-b4f4-0530e5dd6c17 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:04 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506d278e-5e2a-4819-b4f4-0530e5dd6c17 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:04 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-506d278e-5e2a-4819-b4f4-0530e5dd6c17 None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 12:37:04 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 171/353] 10.27.203.238 () {60 vars in 1132 bytes} [Tue May 28 12:37:04 2024] POST /identity/v3/users => generated 250 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 28 12:37:04 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b78a84-32ce-4e88-986a-24f0b767f33e None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:04 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2960f9a8-1794-49de-8d1a-198ffa27e1e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:04 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2960f9a8-1794-49de-8d1a-198ffa27e1e5 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:04 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2960f9a8-1794-49de-8d1a-198ffa27e1e5 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:04 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2960f9a8-1794-49de-8d1a-198ffa27e1e5 None admin] PATH_INFO: `/v3/domains` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:04 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2960f9a8-1794-49de-8d1a-198ffa27e1e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=51267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:37:04 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2960f9a8-1794-49de-8d1a-198ffa27e1e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:04 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2960f9a8-1794-49de-8d1a-198ffa27e1e5 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:04 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 183/354] 10.27.203.238 () {56 vars in 1109 bytes} [Tue May 28 12:37:04 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:37:04 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506d278e-5e2a-4819-b4f4-0530e5dd6c17 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:04 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2960f9a8-1794-49de-8d1a-198ffa27e1e5 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:04 l75lg1-v1 dstat.sh[49771]: 28-05 12:37:04| 46 5 49 0 0|1636M 8103M 234M 5730M| 38k 86B| 0 924k| 0 66.0 |6860 11k|2.21 1.05 0.70|5.0 0 87| 0 0 | 0 2048M| 19 31 0 7 0 May 28 12:37:04 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2960f9a8-1794-49de-8d1a-198ffa27e1e5 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:04 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506d278e-5e2a-4819-b4f4-0530e5dd6c17 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:04 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3fd835-8c6a-4dba-a3e7-a3445dac22aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:04 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3fd835-8c6a-4dba-a3e7-a3445dac22aa None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:04 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3fd835-8c6a-4dba-a3e7-a3445dac22aa None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:04 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3fd835-8c6a-4dba-a3e7-a3445dac22aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:04 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7a8878-a878-4298-9c33-86cb87bc99d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:04 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7a8878-a878-4298-9c33-86cb87bc99d0 None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:04 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7a8878-a878-4298-9c33-86cb87bc99d0 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:04 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7a8878-a878-4298-9c33-86cb87bc99d0 None admin] PATH_INFO: `/v3/users` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:04 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7a8878-a878-4298-9c33-86cb87bc99d0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:04 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7a8878-a878-4298-9c33-86cb87bc99d0 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:04 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3fd835-8c6a-4dba-a3e7-a3445dac22aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:04 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-3a7a8878-a878-4298-9c33-86cb87bc99d0 None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 12:37:04 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3fd835-8c6a-4dba-a3e7-a3445dac22aa None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:04 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-2e3fd835-8c6a-4dba-a3e7-a3445dac22aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 28 12:37:04 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:37:04 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:37:04 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:37:04 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:37:04 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:37:04 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:37:04 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:37:04 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:37:04 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:37:04 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:37:04 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:37:04 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 28 12:37:04 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 28 12:37:04 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 28 12:37:04 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 28 12:37:04 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:37:04 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:37:04 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:37:04 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:37:04 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:37:04 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:37:04 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:37:04 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 12:37:04 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:37:04 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 12:37:04 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:37:04 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:37:04 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:37:04 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 12:37:04 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:37:04 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 12:37:04 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 28 12:37:04 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 28 12:37:04 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 28 12:37:04 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 12:37:04 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 184/355] 10.27.203.238 () {56 vars in 1108 bytes} [Tue May 28 12:37:04 2024] GET /identity/v3/domains/Default => generated 87 bytes in 95 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 28 12:37:04 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3fd835-8c6a-4dba-a3e7-a3445dac22aa None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:04 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 172/356] 10.27.203.238 () {60 vars in 1132 bytes} [Tue May 28 12:37:04 2024] POST /identity/v3/users => generated 250 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:37:04 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3fd835-8c6a-4dba-a3e7-a3445dac22aa None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:04 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc5f69b-1b42-4020-ad4b-9cb13b4a2268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:04 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc5f69b-1b42-4020-ad4b-9cb13b4a2268 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:04 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc5f69b-1b42-4020-ad4b-9cb13b4a2268 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:04 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc5f69b-1b42-4020-ad4b-9cb13b4a2268 None admin] PATH_INFO: `/v3/domains` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:04 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc5f69b-1b42-4020-ad4b-9cb13b4a2268 None admin] RBAC: Adding query filter params (name=Default) {{(pid=51267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:37:04 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc5f69b-1b42-4020-ad4b-9cb13b4a2268 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:04 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc5f69b-1b42-4020-ad4b-9cb13b4a2268 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:04 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 185/357] 10.27.203.238 () {56 vars in 1109 bytes} [Tue May 28 12:37:04 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:37:04 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7a8878-a878-4298-9c33-86cb87bc99d0 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:04 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7a8878-a878-4298-9c33-86cb87bc99d0 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:04 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937d5dbb-cf7c-47dc-8c9f-356ca6011925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:04 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937d5dbb-cf7c-47dc-8c9f-356ca6011925 None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:04 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937d5dbb-cf7c-47dc-8c9f-356ca6011925 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:04 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937d5dbb-cf7c-47dc-8c9f-356ca6011925 None admin] PATH_INFO: `/v3/users` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:04 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937d5dbb-cf7c-47dc-8c9f-356ca6011925 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:04 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937d5dbb-cf7c-47dc-8c9f-356ca6011925 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:04 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-937d5dbb-cf7c-47dc-8c9f-356ca6011925 None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 12:37:04 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 173/358] 10.27.203.238 () {60 vars in 1132 bytes} [Tue May 28 12:37:04 2024] POST /identity/v3/users => generated 251 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:37:05 l75lg1-v1 dstat.sh[49771]: 28-05 12:37:05| 45 5 49 1 0|1620M 8119M 234M 5730M| 43k 86B| 0 484k| 0 47.0 |4884 5671 |2.21 1.05 0.70|5.0 0 106| 0 0 | 0 2048M| 19 29 0 7 0 May 28 12:37:05 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b06f37b-8889-45c0-aebc-58a5cad3f1bc None None] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:05 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b06f37b-8889-45c0-aebc-58a5cad3f1bc None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:05 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b06f37b-8889-45c0-aebc-58a5cad3f1bc None None] PATH_INFO: `/` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:05 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 186/359] 10.27.203.238 () {54 vars in 926 bytes} [Tue May 28 12:37:05 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:37:05 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79a4177-5758-418d-88b0-a64b821fcbdd None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:05 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79a4177-5758-418d-88b0-a64b821fcbdd None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:05 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79a4177-5758-418d-88b0-a64b821fcbdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:05 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-c79a4177-5758-418d-88b0-a64b821fcbdd None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:37:05 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-c79a4177-5758-418d-88b0-a64b821fcbdd None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:37:05 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-c79a4177-5758-418d-88b0-a64b821fcbdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:37:05 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 174/360] 10.27.203.238 () {58 vars in 1023 bytes} [Tue May 28 12:37:05 2024] POST /identity/v3/auth/tokens => generated 864 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 28 12:37:05 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b06f37b-8889-45c0-aebc-58a5cad3f1bc None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:05 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38083738-12df-42c7-a213-787bc61e1d5b None None] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:05 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38083738-12df-42c7-a213-787bc61e1d5b None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:05 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38083738-12df-42c7-a213-787bc61e1d5b None None] PATH_INFO: `/` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:05 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 175/361] 10.27.203.238 () {54 vars in 926 bytes} [Tue May 28 12:37:05 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:37:05 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885660a7-a6c3-420f-8cc3-d42731e9ca69 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:05 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885660a7-a6c3-420f-8cc3-d42731e9ca69 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:05 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885660a7-a6c3-420f-8cc3-d42731e9ca69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:05 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-885660a7-a6c3-420f-8cc3-d42731e9ca69 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:37:05 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-885660a7-a6c3-420f-8cc3-d42731e9ca69 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:37:05 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-885660a7-a6c3-420f-8cc3-d42731e9ca69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:37:05 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b06f37b-8889-45c0-aebc-58a5cad3f1bc None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:05 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 176/362] 10.27.203.238 () {58 vars in 1023 bytes} [Tue May 28 12:37:05 2024] POST /identity/v3/auth/tokens => generated 864 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 28 12:37:05 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fbdd90-3b02-4f1d-9541-6afd81d63309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:05 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fbdd90-3b02-4f1d-9541-6afd81d63309 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:05 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fbdd90-3b02-4f1d-9541-6afd81d63309 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:05 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fbdd90-3b02-4f1d-9541-6afd81d63309 None admin] PATH_INFO: `/v3/roles/service` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:05 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fbdd90-3b02-4f1d-9541-6afd81d63309 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 28 12:37:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-77fbdd90-3b02-4f1d-9541-6afd81d63309 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 28 12:37:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:37:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:37:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:37:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:37:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:37:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:37:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:37:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:37:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:37:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:37:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:37:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 28 12:37:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._get_role(role_id) May 28 12:37:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 28 12:37:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 28 12:37:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 28 12:37:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 28 12:37:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 28 12:37:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 28 12:37:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:37:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:37:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:37:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:37:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:37:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:37:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:37:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 12:37:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:37:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 12:37:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:37:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:37:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:37:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 12:37:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:37:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 12:37:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1281, in get_role May 28 12:37:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 28 12:37:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 28 12:37:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 28 12:37:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 28 12:37:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 28 12:37:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 28 12:37:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 12:37:05 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 187/363] 10.27.203.238 () {56 vars in 1102 bytes} [Tue May 28 12:37:05 2024] GET /identity/v3/roles/service => generated 85 bytes in 102 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 28 12:37:05 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885660a7-a6c3-420f-8cc3-d42731e9ca69 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:05 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885660a7-a6c3-420f-8cc3-d42731e9ca69 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:05 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412f02c8-a844-4abb-ad0d-4c8607d8fcf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:05 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412f02c8-a844-4abb-ad0d-4c8607d8fcf2 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:05 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412f02c8-a844-4abb-ad0d-4c8607d8fcf2 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:05 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412f02c8-a844-4abb-ad0d-4c8607d8fcf2 None admin] PATH_INFO: `/v3/roles` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:05 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412f02c8-a844-4abb-ad0d-4c8607d8fcf2 None admin] RBAC: Adding query filter params (name=service) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:37:05 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412f02c8-a844-4abb-ad0d-4c8607d8fcf2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:05 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412f02c8-a844-4abb-ad0d-4c8607d8fcf2 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:05 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 177/364] 10.27.203.238 () {56 vars in 1103 bytes} [Tue May 28 12:37:05 2024] GET /identity/v3/roles?name=service => generated 347 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:37:05 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fbdd90-3b02-4f1d-9541-6afd81d63309 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:05 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95953b9-b9c1-4666-add4-71e7897311fb None None] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:05 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95953b9-b9c1-4666-add4-71e7897311fb None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:05 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95953b9-b9c1-4666-add4-71e7897311fb None None] PATH_INFO: `/` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:05 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 178/365] 10.27.203.238 () {54 vars in 926 bytes} [Tue May 28 12:37:05 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:37:05 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba31f16-943b-44db-8ef2-9404a9d26cd9 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:05 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba31f16-943b-44db-8ef2-9404a9d26cd9 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:05 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba31f16-943b-44db-8ef2-9404a9d26cd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:05 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fbdd90-3b02-4f1d-9541-6afd81d63309 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:05 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-fba31f16-943b-44db-8ef2-9404a9d26cd9 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:37:05 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-fba31f16-943b-44db-8ef2-9404a9d26cd9 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:37:05 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-fba31f16-943b-44db-8ef2-9404a9d26cd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:37:05 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87b4d0a-d547-43c6-b0ca-6f8ddbf5ea9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:05 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87b4d0a-d547-43c6-b0ca-6f8ddbf5ea9e None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:05 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87b4d0a-d547-43c6-b0ca-6f8ddbf5ea9e None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:05 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87b4d0a-d547-43c6-b0ca-6f8ddbf5ea9e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:05 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87b4d0a-d547-43c6-b0ca-6f8ddbf5ea9e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:05 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87b4d0a-d547-43c6-b0ca-6f8ddbf5ea9e None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-b87b4d0a-d547-43c6-b0ca-6f8ddbf5ea9e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 28 12:37:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:37:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:37:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:37:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:37:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:37:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:37:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:37:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:37:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:37:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:37:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:37:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 28 12:37:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 28 12:37:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 28 12:37:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 28 12:37:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:37:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:37:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:37:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:37:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:37:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:37:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:37:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 12:37:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:37:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 12:37:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:37:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:37:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:37:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 12:37:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:37:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 12:37:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 28 12:37:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 28 12:37:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 28 12:37:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 12:37:05 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 188/366] 10.27.203.238 () {56 vars in 1108 bytes} [Tue May 28 12:37:05 2024] GET /identity/v3/domains/Default => generated 87 bytes in 104 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 28 12:37:05 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87b4d0a-d547-43c6-b0ca-6f8ddbf5ea9e None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:05 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 179/367] 10.27.203.238 () {58 vars in 1023 bytes} [Tue May 28 12:37:05 2024] POST /identity/v3/auth/tokens => generated 864 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 28 12:37:05 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32762d8-aad0-4e9b-b422-d808bd166810 None None] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:05 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32762d8-aad0-4e9b-b422-d808bd166810 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:05 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32762d8-aad0-4e9b-b422-d808bd166810 None None] PATH_INFO: `/` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:05 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 180/368] 10.27.203.238 () {54 vars in 926 bytes} [Tue May 28 12:37:05 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:37:05 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32762d8-aad0-4e9b-b422-d808bd166810 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87b4d0a-d547-43c6-b0ca-6f8ddbf5ea9e None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32762d8-aad0-4e9b-b422-d808bd166810 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a39991-1fa6-4f98-90ac-14df5ceb7bee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a39991-1fa6-4f98-90ac-14df5ceb7bee None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a39991-1fa6-4f98-90ac-14df5ceb7bee None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a39991-1fa6-4f98-90ac-14df5ceb7bee None admin] PATH_INFO: `/v3/roles/service` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a39991-1fa6-4f98-90ac-14df5ceb7bee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-51a39991-1fa6-4f98-90ac-14df5ceb7bee None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._get_role(role_id) May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1281, in get_role May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 189/369] 10.27.203.238 () {56 vars in 1102 bytes} [Tue May 28 12:37:05 2024] GET /identity/v3/roles/service => generated 85 bytes in 90 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75047de-c5ac-482f-ba65-cd447b97f55f None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75047de-c5ac-482f-ba65-cd447b97f55f None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75047de-c5ac-482f-ba65-cd447b97f55f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10d9371-7a76-47ad-a2b0-499bdcb2e84c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10d9371-7a76-47ad-a2b0-499bdcb2e84c None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10d9371-7a76-47ad-a2b0-499bdcb2e84c None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10d9371-7a76-47ad-a2b0-499bdcb2e84c None admin] PATH_INFO: `/v3/domains` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10d9371-7a76-47ad-a2b0-499bdcb2e84c None admin] RBAC: Adding query filter params (name=Default) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10d9371-7a76-47ad-a2b0-499bdcb2e84c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10d9371-7a76-47ad-a2b0-499bdcb2e84c None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-c75047de-c5ac-482f-ba65-cd447b97f55f None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 181/370] 10.27.203.238 () {56 vars in 1109 bytes} [Tue May 28 12:37:05 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10d9371-7a76-47ad-a2b0-499bdcb2e84c None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-c75047de-c5ac-482f-ba65-cd447b97f55f None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-c75047de-c5ac-482f-ba65-cd447b97f55f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10d9371-7a76-47ad-a2b0-499bdcb2e84c None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 190/371] 10.27.203.238 () {58 vars in 1023 bytes} [Tue May 28 12:37:06 2024] POST /identity/v3/auth/tokens => generated 864 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75047de-c5ac-482f-ba65-cd447b97f55f None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49635257-a9b8-4c92-871f-f2bb9ac15c26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49635257-a9b8-4c92-871f-f2bb9ac15c26 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49635257-a9b8-4c92-871f-f2bb9ac15c26 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49635257-a9b8-4c92-871f-f2bb9ac15c26 None admin] PATH_INFO: `/v3/roles` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49635257-a9b8-4c92-871f-f2bb9ac15c26 None admin] RBAC: Adding query filter params (name=service) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49635257-a9b8-4c92-871f-f2bb9ac15c26 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49635257-a9b8-4c92-871f-f2bb9ac15c26 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 182/372] 10.27.203.238 () {56 vars in 1103 bytes} [Tue May 28 12:37:06 2024] GET /identity/v3/roles?name=service => generated 347 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49635257-a9b8-4c92-871f-f2bb9ac15c26 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75047de-c5ac-482f-ba65-cd447b97f55f None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f20a3c-eec1-4cdc-8476-2ea47366ac7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f20a3c-eec1-4cdc-8476-2ea47366ac7e None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f20a3c-eec1-4cdc-8476-2ea47366ac7e None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f20a3c-eec1-4cdc-8476-2ea47366ac7e None admin] PATH_INFO: `/v3/users/nova` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f20a3c-eec1-4cdc-8476-2ea47366ac7e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f20a3c-eec1-4cdc-8476-2ea47366ac7e None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49635257-a9b8-4c92-871f-f2bb9ac15c26 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-d3f20a3c-eec1-4cdc-8476-2ea47366ac7e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._get_user(user_id) May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 191/373] 10.27.203.238 () {56 vars in 1093 bytes} [Tue May 28 12:37:06 2024] GET /identity/v3/users/nova => generated 82 bytes in 89 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f20a3c-eec1-4cdc-8476-2ea47366ac7e None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4d0da1-4618-4fac-a1d8-69a3a49d318f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4d0da1-4618-4fac-a1d8-69a3a49d318f None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4d0da1-4618-4fac-a1d8-69a3a49d318f None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4d0da1-4618-4fac-a1d8-69a3a49d318f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4d0da1-4618-4fac-a1d8-69a3a49d318f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4d0da1-4618-4fac-a1d8-69a3a49d318f None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-ab4d0da1-4618-4fac-a1d8-69a3a49d318f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 183/374] 10.27.203.238 () {56 vars in 1108 bytes} [Tue May 28 12:37:06 2024] GET /identity/v3/domains/Default => generated 87 bytes in 93 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4d0da1-4618-4fac-a1d8-69a3a49d318f None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:06 l75lg1-v1 dstat.sh[49771]: 28-05 12:37:06| 44 6 49 0 0|1713M 8025M 234M 5730M| 41k 86B| 0 1316k| 0 13.0 | 17k 31k|2.19 1.06 0.71|4.0 0 12| 0 0 | 0 2048M| 19 32 0 7 0 May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f20a3c-eec1-4cdc-8476-2ea47366ac7e None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9b3309-b13d-4b7b-8c00-89aa77228a0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9b3309-b13d-4b7b-8c00-89aa77228a0f None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9b3309-b13d-4b7b-8c00-89aa77228a0f None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9b3309-b13d-4b7b-8c00-89aa77228a0f None admin] PATH_INFO: `/v3/roles/service` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4d0da1-4618-4fac-a1d8-69a3a49d318f None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9b3309-b13d-4b7b-8c00-89aa77228a0f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-2d9b3309-b13d-4b7b-8c00-89aa77228a0f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._get_role(role_id) May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1281, in get_role May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 192/375] 10.27.203.238 () {56 vars in 1102 bytes} [Tue May 28 12:37:06 2024] GET /identity/v3/roles/service => generated 85 bytes in 95 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9b3309-b13d-4b7b-8c00-89aa77228a0f None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843b8637-d226-4639-9c83-0544ce5323a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843b8637-d226-4639-9c83-0544ce5323a8 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843b8637-d226-4639-9c83-0544ce5323a8 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843b8637-d226-4639-9c83-0544ce5323a8 None admin] PATH_INFO: `/v3/users` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843b8637-d226-4639-9c83-0544ce5323a8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843b8637-d226-4639-9c83-0544ce5323a8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843b8637-d226-4639-9c83-0544ce5323a8 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9b3309-b13d-4b7b-8c00-89aa77228a0f None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 184/376] 10.27.203.238 () {56 vars in 1133 bytes} [Tue May 28 12:37:06 2024] GET /identity/v3/users?domain_id=default&name=nova => generated 372 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843b8637-d226-4639-9c83-0544ce5323a8 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef78d1f-1725-4b1c-aed0-c669ebd6c1ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef78d1f-1725-4b1c-aed0-c669ebd6c1ba None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef78d1f-1725-4b1c-aed0-c669ebd6c1ba None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef78d1f-1725-4b1c-aed0-c669ebd6c1ba None admin] PATH_INFO: `/v3/domains` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef78d1f-1725-4b1c-aed0-c669ebd6c1ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=51267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef78d1f-1725-4b1c-aed0-c669ebd6c1ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef78d1f-1725-4b1c-aed0-c669ebd6c1ba None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 193/377] 10.27.203.238 () {56 vars in 1109 bytes} [Tue May 28 12:37:06 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef78d1f-1725-4b1c-aed0-c669ebd6c1ba None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843b8637-d226-4639-9c83-0544ce5323a8 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c0452f-5a7a-4cc1-a6a9-52365fae75fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c0452f-5a7a-4cc1-a6a9-52365fae75fc None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c0452f-5a7a-4cc1-a6a9-52365fae75fc None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c0452f-5a7a-4cc1-a6a9-52365fae75fc None admin] PATH_INFO: `/v3/roles` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c0452f-5a7a-4cc1-a6a9-52365fae75fc None admin] RBAC: Adding query filter params (name=service) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c0452f-5a7a-4cc1-a6a9-52365fae75fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c0452f-5a7a-4cc1-a6a9-52365fae75fc None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef78d1f-1725-4b1c-aed0-c669ebd6c1ba None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 185/378] 10.27.203.238 () {56 vars in 1103 bytes} [Tue May 28 12:37:06 2024] GET /identity/v3/roles?name=service => generated 347 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c0452f-5a7a-4cc1-a6a9-52365fae75fc None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7cbeca-6856-44c9-8d87-df8ccc463ffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7cbeca-6856-44c9-8d87-df8ccc463ffd None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7cbeca-6856-44c9-8d87-df8ccc463ffd None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7cbeca-6856-44c9-8d87-df8ccc463ffd None admin] PATH_INFO: `/v3/roles/service` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7cbeca-6856-44c9-8d87-df8ccc463ffd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-cc7cbeca-6856-44c9-8d87-df8ccc463ffd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._get_role(role_id) May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1281, in get_role May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 194/379] 10.27.203.238 () {56 vars in 1102 bytes} [Tue May 28 12:37:06 2024] GET /identity/v3/roles/service => generated 85 bytes in 88 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7cbeca-6856-44c9-8d87-df8ccc463ffd None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c0452f-5a7a-4cc1-a6a9-52365fae75fc None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b7a8da-440c-4325-886d-d67abae06344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b7a8da-440c-4325-886d-d67abae06344 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b7a8da-440c-4325-886d-d67abae06344 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b7a8da-440c-4325-886d-d67abae06344 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b7a8da-440c-4325-886d-d67abae06344 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7cbeca-6856-44c9-8d87-df8ccc463ffd None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b7a8da-440c-4325-886d-d67abae06344 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-51b7a8da-440c-4325-886d-d67abae06344 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 186/380] 10.27.203.238 () {56 vars in 1108 bytes} [Tue May 28 12:37:06 2024] GET /identity/v3/domains/Default => generated 87 bytes in 95 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b7a8da-440c-4325-886d-d67abae06344 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b0fb40-1510-41c9-a6ae-05aa8478cf91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b0fb40-1510-41c9-a6ae-05aa8478cf91 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b0fb40-1510-41c9-a6ae-05aa8478cf91 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b0fb40-1510-41c9-a6ae-05aa8478cf91 None admin] PATH_INFO: `/v3/users/glance` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b0fb40-1510-41c9-a6ae-05aa8478cf91 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b0fb40-1510-41c9-a6ae-05aa8478cf91 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-01b0fb40-1510-41c9-a6ae-05aa8478cf91 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._get_user(user_id) May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 195/381] 10.27.203.238 () {56 vars in 1099 bytes} [Tue May 28 12:37:06 2024] GET /identity/v3/users/glance => generated 84 bytes in 94 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b0fb40-1510-41c9-a6ae-05aa8478cf91 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b7a8da-440c-4325-886d-d67abae06344 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79aa970d-ef0f-4a64-9088-76351b8f3e6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aa970d-ef0f-4a64-9088-76351b8f3e6a None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aa970d-ef0f-4a64-9088-76351b8f3e6a None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aa970d-ef0f-4a64-9088-76351b8f3e6a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b0fb40-1510-41c9-a6ae-05aa8478cf91 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79aa970d-ef0f-4a64-9088-76351b8f3e6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79aa970d-ef0f-4a64-9088-76351b8f3e6a None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-79aa970d-ef0f-4a64-9088-76351b8f3e6a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 187/382] 10.27.203.238 () {56 vars in 1108 bytes} [Tue May 28 12:37:06 2024] GET /identity/v3/domains/Default => generated 87 bytes in 96 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79aa970d-ef0f-4a64-9088-76351b8f3e6a None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c714485-250a-4f0c-bc63-8eb2126d0918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c714485-250a-4f0c-bc63-8eb2126d0918 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c714485-250a-4f0c-bc63-8eb2126d0918 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c714485-250a-4f0c-bc63-8eb2126d0918 None admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c714485-250a-4f0c-bc63-8eb2126d0918 None admin] RBAC: Adding query filter params (name=service) {{(pid=51267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c714485-250a-4f0c-bc63-8eb2126d0918 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c714485-250a-4f0c-bc63-8eb2126d0918 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 196/383] 10.27.203.238 () {56 vars in 1103 bytes} [Tue May 28 12:37:06 2024] GET /identity/v3/roles?name=service => generated 347 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c714485-250a-4f0c-bc63-8eb2126d0918 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79aa970d-ef0f-4a64-9088-76351b8f3e6a None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c714485-250a-4f0c-bc63-8eb2126d0918 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53b2542-f101-48c2-b314-c8eb8d828a3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53b2542-f101-48c2-b314-c8eb8d828a3c None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53b2542-f101-48c2-b314-c8eb8d828a3c None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53b2542-f101-48c2-b314-c8eb8d828a3c None admin] PATH_INFO: `/v3/domains` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53b2542-f101-48c2-b314-c8eb8d828a3c None admin] RBAC: Adding query filter params (name=Default) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53b2542-f101-48c2-b314-c8eb8d828a3c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53b2542-f101-48c2-b314-c8eb8d828a3c None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5c173e-b4b1-4377-96a2-10e6f9d9ea72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5c173e-b4b1-4377-96a2-10e6f9d9ea72 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5c173e-b4b1-4377-96a2-10e6f9d9ea72 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5c173e-b4b1-4377-96a2-10e6f9d9ea72 None admin] PATH_INFO: `/v3/users` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 188/384] 10.27.203.238 () {56 vars in 1109 bytes} [Tue May 28 12:37:06 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5c173e-b4b1-4377-96a2-10e6f9d9ea72 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=51267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5c173e-b4b1-4377-96a2-10e6f9d9ea72 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53b2542-f101-48c2-b314-c8eb8d828a3c None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5c173e-b4b1-4377-96a2-10e6f9d9ea72 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 197/385] 10.27.203.238 () {56 vars in 1137 bytes} [Tue May 28 12:37:06 2024] GET /identity/v3/users?domain_id=default&name=glance => generated 376 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5c173e-b4b1-4377-96a2-10e6f9d9ea72 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53b2542-f101-48c2-b314-c8eb8d828a3c None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779fe2d7-4f9f-4932-ae14-d4e322d5e7c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779fe2d7-4f9f-4932-ae14-d4e322d5e7c6 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779fe2d7-4f9f-4932-ae14-d4e322d5e7c6 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779fe2d7-4f9f-4932-ae14-d4e322d5e7c6 None admin] PATH_INFO: `/v3/domains` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779fe2d7-4f9f-4932-ae14-d4e322d5e7c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779fe2d7-4f9f-4932-ae14-d4e322d5e7c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779fe2d7-4f9f-4932-ae14-d4e322d5e7c6 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5c173e-b4b1-4377-96a2-10e6f9d9ea72 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 189/386] 10.27.203.238 () {56 vars in 1109 bytes} [Tue May 28 12:37:06 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779fe2d7-4f9f-4932-ae14-d4e322d5e7c6 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fc986a-e14a-4594-9d06-28f50700baa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fc986a-e14a-4594-9d06-28f50700baa5 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fc986a-e14a-4594-9d06-28f50700baa5 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fc986a-e14a-4594-9d06-28f50700baa5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fc986a-e14a-4594-9d06-28f50700baa5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fc986a-e14a-4594-9d06-28f50700baa5 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-68fc986a-e14a-4594-9d06-28f50700baa5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 198/387] 10.27.203.238 () {56 vars in 1108 bytes} [Tue May 28 12:37:06 2024] GET /identity/v3/domains/Default => generated 87 bytes in 95 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fc986a-e14a-4594-9d06-28f50700baa5 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779fe2d7-4f9f-4932-ae14-d4e322d5e7c6 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58272bb6-fd4c-412d-aa77-29e3554a3e4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58272bb6-fd4c-412d-aa77-29e3554a3e4a None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58272bb6-fd4c-412d-aa77-29e3554a3e4a None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58272bb6-fd4c-412d-aa77-29e3554a3e4a None admin] PATH_INFO: `/v3/projects/service` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58272bb6-fd4c-412d-aa77-29e3554a3e4a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58272bb6-fd4c-412d-aa77-29e3554a3e4a None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fc986a-e14a-4594-9d06-28f50700baa5 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-58272bb6-fd4c-412d-aa77-29e3554a3e4a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._get_project(project_id) May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 190/388] 10.27.203.238 () {56 vars in 1111 bytes} [Tue May 28 12:37:06 2024] GET /identity/v3/projects/service => generated 88 bytes in 96 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58272bb6-fd4c-412d-aa77-29e3554a3e4a None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40c9e38-eabe-40ac-bdd8-91b49671d20f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40c9e38-eabe-40ac-bdd8-91b49671d20f None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40c9e38-eabe-40ac-bdd8-91b49671d20f None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40c9e38-eabe-40ac-bdd8-91b49671d20f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40c9e38-eabe-40ac-bdd8-91b49671d20f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40c9e38-eabe-40ac-bdd8-91b49671d20f None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-f40c9e38-eabe-40ac-bdd8-91b49671d20f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 199/389] 10.27.203.238 () {56 vars in 1108 bytes} [Tue May 28 12:37:06 2024] GET /identity/v3/domains/Default => generated 87 bytes in 94 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40c9e38-eabe-40ac-bdd8-91b49671d20f None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58272bb6-fd4c-412d-aa77-29e3554a3e4a None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75075e7-edd7-453b-9936-e59564ff568d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75075e7-edd7-453b-9936-e59564ff568d None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75075e7-edd7-453b-9936-e59564ff568d None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75075e7-edd7-453b-9936-e59564ff568d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75075e7-edd7-453b-9936-e59564ff568d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75075e7-edd7-453b-9936-e59564ff568d None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-e75075e7-edd7-453b-9936-e59564ff568d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._get_user(user_id) May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 191/390] 10.27.203.238 () {56 vars in 1099 bytes} [Tue May 28 12:37:06 2024] GET /identity/v3/users/cinder => generated 84 bytes in 90 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75075e7-edd7-453b-9936-e59564ff568d None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:06 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40c9e38-eabe-40ac-bdd8-91b49671d20f None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d79d3a-7f36-4eb0-a2da-94f51beeae4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d79d3a-7f36-4eb0-a2da-94f51beeae4a None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d79d3a-7f36-4eb0-a2da-94f51beeae4a None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d79d3a-7f36-4eb0-a2da-94f51beeae4a None admin] PATH_INFO: `/v3/domains` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d79d3a-7f36-4eb0-a2da-94f51beeae4a None admin] RBAC: Adding query filter params (name=Default) {{(pid=51267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d79d3a-7f36-4eb0-a2da-94f51beeae4a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d79d3a-7f36-4eb0-a2da-94f51beeae4a None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 200/391] 10.27.203.238 () {56 vars in 1109 bytes} [Tue May 28 12:37:06 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d79d3a-7f36-4eb0-a2da-94f51beeae4a None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75075e7-edd7-453b-9936-e59564ff568d None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e067b90-c7cc-4834-930d-aa0f917ee4e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e067b90-c7cc-4834-930d-aa0f917ee4e9 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e067b90-c7cc-4834-930d-aa0f917ee4e9 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e067b90-c7cc-4834-930d-aa0f917ee4e9 None admin] PATH_INFO: `/v3/projects` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e067b90-c7cc-4834-930d-aa0f917ee4e9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e067b90-c7cc-4834-930d-aa0f917ee4e9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e067b90-c7cc-4834-930d-aa0f917ee4e9 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 192/392] 10.27.203.238 () {56 vars in 1148 bytes} [Tue May 28 12:37:06 2024] GET /identity/v3/projects?domain_id=default&name=service => generated 433 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d79d3a-7f36-4eb0-a2da-94f51beeae4a None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e067b90-c7cc-4834-930d-aa0f917ee4e9 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16956daf-bf15-4082-98a5-8436ad69ef36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16956daf-bf15-4082-98a5-8436ad69ef36 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16956daf-bf15-4082-98a5-8436ad69ef36 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16956daf-bf15-4082-98a5-8436ad69ef36 None admin] PATH_INFO: `/v3/domains` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16956daf-bf15-4082-98a5-8436ad69ef36 None admin] RBAC: Adding query filter params (name=Default) {{(pid=51267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16956daf-bf15-4082-98a5-8436ad69ef36 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16956daf-bf15-4082-98a5-8436ad69ef36 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 201/393] 10.27.203.238 () {56 vars in 1109 bytes} [Tue May 28 12:37:07 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16956daf-bf15-4082-98a5-8436ad69ef36 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e067b90-c7cc-4834-930d-aa0f917ee4e9 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ec1c31-31b5-4b23-83c9-945628eb2b57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ec1c31-31b5-4b23-83c9-945628eb2b57 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ec1c31-31b5-4b23-83c9-945628eb2b57 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ec1c31-31b5-4b23-83c9-945628eb2b57 None admin] PATH_INFO: `/v3/users` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ec1c31-31b5-4b23-83c9-945628eb2b57 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ec1c31-31b5-4b23-83c9-945628eb2b57 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ec1c31-31b5-4b23-83c9-945628eb2b57 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16956daf-bf15-4082-98a5-8436ad69ef36 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 193/394] 10.27.203.238 () {56 vars in 1137 bytes} [Tue May 28 12:37:07 2024] GET /identity/v3/users?domain_id=default&name=cinder => generated 376 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ec1c31-31b5-4b23-83c9-945628eb2b57 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bdacd5-9276-4405-b37e-5fecab0de657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bdacd5-9276-4405-b37e-5fecab0de657 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bdacd5-9276-4405-b37e-5fecab0de657 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bdacd5-9276-4405-b37e-5fecab0de657 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bdacd5-9276-4405-b37e-5fecab0de657 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bdacd5-9276-4405-b37e-5fecab0de657 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-79bdacd5-9276-4405-b37e-5fecab0de657 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._get_user(user_id) May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 202/395] 10.27.203.238 () {56 vars in 1102 bytes} [Tue May 28 12:37:07 2024] GET /identity/v3/users/neutron => generated 85 bytes in 105 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bdacd5-9276-4405-b37e-5fecab0de657 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ec1c31-31b5-4b23-83c9-945628eb2b57 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:07 l75lg1-v1 dstat.sh[49771]: 28-05 12:37:07| 27 6 66 0 0|1686M 8051M 234M 5731M| 33k 86B| 0 348k| 0 12.0 | 11k 19k|2.19 1.06 0.71|4.0 0 0| 0 0 | 0 2048M| 19 33 0 8 0 May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5337bd9a-63d8-40c4-9715-ebd818b3c0f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5337bd9a-63d8-40c4-9715-ebd818b3c0f9 None admin] REQUEST_METHOD: `PUT` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5337bd9a-63d8-40c4-9715-ebd818b3c0f9 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5337bd9a-63d8-40c4-9715-ebd818b3c0f9 None admin] PATH_INFO: `/v3/projects/98a6a2dcbf0248d5b353760f7757f713/users/befdd4414dc2432ab2baa1ae3fbffef7/roles/14940fb5f1c44f629b6e1d8472832bd1` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5337bd9a-63d8-40c4-9715-ebd818b3c0f9 None admin] RBAC: Authorizing `identity:create_grant(project_id=98a6a2dcbf0248d5b353760f7757f713, user_id=befdd4414dc2432ab2baa1ae3fbffef7, role_id=14940fb5f1c44f629b6e1d8472832bd1)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5337bd9a-63d8-40c4-9715-ebd818b3c0f9 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 194/396] 10.27.203.238 () {58 vars in 1439 bytes} [Tue May 28 12:37:07 2024] PUT /identity/v3/projects/98a6a2dcbf0248d5b353760f7757f713/users/befdd4414dc2432ab2baa1ae3fbffef7/roles/14940fb5f1c44f629b6e1d8472832bd1 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5337bd9a-63d8-40c4-9715-ebd818b3c0f9 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bdacd5-9276-4405-b37e-5fecab0de657 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facbef2a-da95-421b-b333-70973749f9b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facbef2a-da95-421b-b333-70973749f9b7 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facbef2a-da95-421b-b333-70973749f9b7 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facbef2a-da95-421b-b333-70973749f9b7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facbef2a-da95-421b-b333-70973749f9b7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facbef2a-da95-421b-b333-70973749f9b7 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-facbef2a-da95-421b-b333-70973749f9b7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._get_project(project_id) May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 203/397] 10.27.203.238 () {56 vars in 1111 bytes} [Tue May 28 12:37:07 2024] GET /identity/v3/projects/service => generated 88 bytes in 107 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facbef2a-da95-421b-b333-70973749f9b7 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5337bd9a-63d8-40c4-9715-ebd818b3c0f9 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f3c46c-6d96-40bd-8af0-64f522c7b302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f3c46c-6d96-40bd-8af0-64f522c7b302 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f3c46c-6d96-40bd-8af0-64f522c7b302 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f3c46c-6d96-40bd-8af0-64f522c7b302 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f3c46c-6d96-40bd-8af0-64f522c7b302 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f3c46c-6d96-40bd-8af0-64f522c7b302 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facbef2a-da95-421b-b333-70973749f9b7 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-45f3c46c-6d96-40bd-8af0-64f522c7b302 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 195/398] 10.27.203.238 () {56 vars in 1108 bytes} [Tue May 28 12:37:07 2024] GET /identity/v3/domains/Default => generated 87 bytes in 97 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f3c46c-6d96-40bd-8af0-64f522c7b302 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56df5076-27b7-44b8-a7c2-8982b246a5ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56df5076-27b7-44b8-a7c2-8982b246a5ad None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56df5076-27b7-44b8-a7c2-8982b246a5ad None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56df5076-27b7-44b8-a7c2-8982b246a5ad None admin] PATH_INFO: `/v3/users` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56df5076-27b7-44b8-a7c2-8982b246a5ad None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=51267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56df5076-27b7-44b8-a7c2-8982b246a5ad None admin] RBAC: Authorizing `identity:list_users()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56df5076-27b7-44b8-a7c2-8982b246a5ad None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 204/399] 10.27.203.238 () {56 vars in 1139 bytes} [Tue May 28 12:37:07 2024] GET /identity/v3/users?domain_id=default&name=neutron => generated 378 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56df5076-27b7-44b8-a7c2-8982b246a5ad None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f3c46c-6d96-40bd-8af0-64f522c7b302 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4f0600-8370-471b-b81d-b26cfe015414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4f0600-8370-471b-b81d-b26cfe015414 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4f0600-8370-471b-b81d-b26cfe015414 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4f0600-8370-471b-b81d-b26cfe015414 None admin] PATH_INFO: `/v3/projects` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4f0600-8370-471b-b81d-b26cfe015414 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4f0600-8370-471b-b81d-b26cfe015414 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4f0600-8370-471b-b81d-b26cfe015414 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56df5076-27b7-44b8-a7c2-8982b246a5ad None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 196/400] 10.27.203.238 () {56 vars in 1148 bytes} [Tue May 28 12:37:07 2024] GET /identity/v3/projects?domain_id=default&name=service => generated 433 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4f0600-8370-471b-b81d-b26cfe015414 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334d0df0-fe5b-4703-8ebb-7199ca25e5a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334d0df0-fe5b-4703-8ebb-7199ca25e5a9 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334d0df0-fe5b-4703-8ebb-7199ca25e5a9 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334d0df0-fe5b-4703-8ebb-7199ca25e5a9 None admin] PATH_INFO: `/v3/domains` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334d0df0-fe5b-4703-8ebb-7199ca25e5a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=51267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334d0df0-fe5b-4703-8ebb-7199ca25e5a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334d0df0-fe5b-4703-8ebb-7199ca25e5a9 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 205/401] 10.27.203.238 () {56 vars in 1109 bytes} [Tue May 28 12:37:07 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334d0df0-fe5b-4703-8ebb-7199ca25e5a9 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4f0600-8370-471b-b81d-b26cfe015414 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334d0df0-fe5b-4703-8ebb-7199ca25e5a9 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d6b464-fa07-44b4-855d-91912ef8a43e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d6b464-fa07-44b4-855d-91912ef8a43e None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d6b464-fa07-44b4-855d-91912ef8a43e None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d6b464-fa07-44b4-855d-91912ef8a43e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d6b464-fa07-44b4-855d-91912ef8a43e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d6b464-fa07-44b4-855d-91912ef8a43e None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-42d6b464-fa07-44b4-855d-91912ef8a43e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 197/402] 10.27.203.238 () {56 vars in 1108 bytes} [Tue May 28 12:37:07 2024] GET /identity/v3/domains/Default => generated 87 bytes in 102 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638ecd82-34e4-42a9-8e8b-d817f249e92e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638ecd82-34e4-42a9-8e8b-d817f249e92e None admin] REQUEST_METHOD: `PUT` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d6b464-fa07-44b4-855d-91912ef8a43e None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638ecd82-34e4-42a9-8e8b-d817f249e92e None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638ecd82-34e4-42a9-8e8b-d817f249e92e None admin] PATH_INFO: `/v3/projects/98a6a2dcbf0248d5b353760f7757f713/users/d1436e60c2e34e0b8af9ae1c668bdf03/roles/14940fb5f1c44f629b6e1d8472832bd1` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638ecd82-34e4-42a9-8e8b-d817f249e92e None admin] RBAC: Authorizing `identity:create_grant(project_id=98a6a2dcbf0248d5b353760f7757f713, user_id=d1436e60c2e34e0b8af9ae1c668bdf03, role_id=14940fb5f1c44f629b6e1d8472832bd1)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638ecd82-34e4-42a9-8e8b-d817f249e92e None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 206/403] 10.27.203.238 () {58 vars in 1439 bytes} [Tue May 28 12:37:07 2024] PUT /identity/v3/projects/98a6a2dcbf0248d5b353760f7757f713/users/d1436e60c2e34e0b8af9ae1c668bdf03/roles/14940fb5f1c44f629b6e1d8472832bd1 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638ecd82-34e4-42a9-8e8b-d817f249e92e None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d6b464-fa07-44b4-855d-91912ef8a43e None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638ecd82-34e4-42a9-8e8b-d817f249e92e None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535a6b47-98bc-4857-b592-17a27bd94cd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535a6b47-98bc-4857-b592-17a27bd94cd9 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535a6b47-98bc-4857-b592-17a27bd94cd9 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535a6b47-98bc-4857-b592-17a27bd94cd9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535a6b47-98bc-4857-b592-17a27bd94cd9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535a6b47-98bc-4857-b592-17a27bd94cd9 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98675cf-4458-41d1-b366-8e6e46adf8e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98675cf-4458-41d1-b366-8e6e46adf8e7 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98675cf-4458-41d1-b366-8e6e46adf8e7 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98675cf-4458-41d1-b366-8e6e46adf8e7 None admin] PATH_INFO: `/v3/domains` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98675cf-4458-41d1-b366-8e6e46adf8e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=51267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98675cf-4458-41d1-b366-8e6e46adf8e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-535a6b47-98bc-4857-b592-17a27bd94cd9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._get_project(project_id) May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98675cf-4458-41d1-b366-8e6e46adf8e7 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 198/404] 10.27.203.238 () {56 vars in 1111 bytes} [Tue May 28 12:37:07 2024] GET /identity/v3/projects/service => generated 88 bytes in 114 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535a6b47-98bc-4857-b592-17a27bd94cd9 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 207/405] 10.27.203.238 () {56 vars in 1109 bytes} [Tue May 28 12:37:07 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98675cf-4458-41d1-b366-8e6e46adf8e7 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535a6b47-98bc-4857-b592-17a27bd94cd9 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98675cf-4458-41d1-b366-8e6e46adf8e7 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08400978-b83c-4592-a5bd-a2ba0cdd7148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08400978-b83c-4592-a5bd-a2ba0cdd7148 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08400978-b83c-4592-a5bd-a2ba0cdd7148 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08400978-b83c-4592-a5bd-a2ba0cdd7148 None admin] PATH_INFO: `/v3/projects` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08400978-b83c-4592-a5bd-a2ba0cdd7148 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08400978-b83c-4592-a5bd-a2ba0cdd7148 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08400978-b83c-4592-a5bd-a2ba0cdd7148 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0d7182-0356-486f-a997-6c62b488ecf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0d7182-0356-486f-a997-6c62b488ecf2 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0d7182-0356-486f-a997-6c62b488ecf2 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0d7182-0356-486f-a997-6c62b488ecf2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 199/406] 10.27.203.238 () {56 vars in 1148 bytes} [Tue May 28 12:37:07 2024] GET /identity/v3/projects?domain_id=default&name=service => generated 433 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0d7182-0356-486f-a997-6c62b488ecf2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0d7182-0356-486f-a997-6c62b488ecf2 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08400978-b83c-4592-a5bd-a2ba0cdd7148 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-5f0d7182-0356-486f-a997-6c62b488ecf2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._get_project(project_id) May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 208/407] 10.27.203.238 () {56 vars in 1111 bytes} [Tue May 28 12:37:07 2024] GET /identity/v3/projects/service => generated 88 bytes in 108 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0d7182-0356-486f-a997-6c62b488ecf2 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08400978-b83c-4592-a5bd-a2ba0cdd7148 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0d7182-0356-486f-a997-6c62b488ecf2 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a40f96-7180-4ced-93fe-fa4b15c7b083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a40f96-7180-4ced-93fe-fa4b15c7b083 None admin] REQUEST_METHOD: `PUT` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a40f96-7180-4ced-93fe-fa4b15c7b083 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a40f96-7180-4ced-93fe-fa4b15c7b083 None admin] PATH_INFO: `/v3/projects/98a6a2dcbf0248d5b353760f7757f713/users/d8b9b336af4049a99b45df9eba13a358/roles/14940fb5f1c44f629b6e1d8472832bd1` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a40f96-7180-4ced-93fe-fa4b15c7b083 None admin] RBAC: Authorizing `identity:create_grant(project_id=98a6a2dcbf0248d5b353760f7757f713, user_id=d8b9b336af4049a99b45df9eba13a358, role_id=14940fb5f1c44f629b6e1d8472832bd1)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae04645-cd48-477c-8908-9d4223d91f05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae04645-cd48-477c-8908-9d4223d91f05 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a40f96-7180-4ced-93fe-fa4b15c7b083 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae04645-cd48-477c-8908-9d4223d91f05 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae04645-cd48-477c-8908-9d4223d91f05 None admin] PATH_INFO: `/v3/projects` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae04645-cd48-477c-8908-9d4223d91f05 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=51267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae04645-cd48-477c-8908-9d4223d91f05 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae04645-cd48-477c-8908-9d4223d91f05 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 209/408] 10.27.203.238 () {56 vars in 1148 bytes} [Tue May 28 12:37:07 2024] GET /identity/v3/projects?domain_id=default&name=service => generated 433 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 200/409] 10.27.203.238 () {58 vars in 1439 bytes} [Tue May 28 12:37:07 2024] PUT /identity/v3/projects/98a6a2dcbf0248d5b353760f7757f713/users/d8b9b336af4049a99b45df9eba13a358/roles/14940fb5f1c44f629b6e1d8472832bd1 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae04645-cd48-477c-8908-9d4223d91f05 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae04645-cd48-477c-8908-9d4223d91f05 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80999531-f08d-4fd3-a9db-032698f067c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80999531-f08d-4fd3-a9db-032698f067c3 None admin] REQUEST_METHOD: `PUT` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80999531-f08d-4fd3-a9db-032698f067c3 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80999531-f08d-4fd3-a9db-032698f067c3 None admin] PATH_INFO: `/v3/projects/98a6a2dcbf0248d5b353760f7757f713/users/8ef17047035e4b518fd5360a01f2da1a/roles/14940fb5f1c44f629b6e1d8472832bd1` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80999531-f08d-4fd3-a9db-032698f067c3 None admin] RBAC: Authorizing `identity:create_grant(project_id=98a6a2dcbf0248d5b353760f7757f713, user_id=8ef17047035e4b518fd5360a01f2da1a, role_id=14940fb5f1c44f629b6e1d8472832bd1)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80999531-f08d-4fd3-a9db-032698f067c3 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:08 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 210/410] 10.27.203.238 () {58 vars in 1439 bytes} [Tue May 28 12:37:07 2024] PUT /identity/v3/projects/98a6a2dcbf0248d5b353760f7757f713/users/8ef17047035e4b518fd5360a01f2da1a/roles/14940fb5f1c44f629b6e1d8472832bd1 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:37:08 l75lg1-v1 dstat.sh[49771]: 28-05 12:37:08| 44 3 51 1 0|1577M 8160M 234M 5731M| 37k 86B| 0 556k| 0 78.0 |8989 14k|2.19 1.06 0.71|5.0 0 56| 0 0 | 0 2048M| 19 29 0 8 0 May 28 12:37:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ca27c5-77e8-4cc9-a2e8-5f92cfde61b1 None None] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ca27c5-77e8-4cc9-a2e8-5f92cfde61b1 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ca27c5-77e8-4cc9-a2e8-5f92cfde61b1 None None] PATH_INFO: `/` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:08 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 201/411] 10.27.203.238 () {54 vars in 926 bytes} [Tue May 28 12:37:08 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:37:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875971cd-0b19-43fd-aa97-88a43a17a135 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875971cd-0b19-43fd-aa97-88a43a17a135 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875971cd-0b19-43fd-aa97-88a43a17a135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:08 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-875971cd-0b19-43fd-aa97-88a43a17a135 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:37:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-875971cd-0b19-43fd-aa97-88a43a17a135 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:37:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-875971cd-0b19-43fd-aa97-88a43a17a135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:37:08 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 211/412] 10.27.203.238 () {58 vars in 1023 bytes} [Tue May 28 12:37:08 2024] POST /identity/v3/auth/tokens => generated 864 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ca27c5-77e8-4cc9-a2e8-5f92cfde61b1 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc9c84a-d750-44bc-bed3-9132d5696571 None None] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc9c84a-d750-44bc-bed3-9132d5696571 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc9c84a-d750-44bc-bed3-9132d5696571 None None] PATH_INFO: `/` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 212/413] 10.27.203.238 () {54 vars in 926 bytes} [Tue May 28 12:37:09 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916aeac1-5420-42a9-9067-4c47d6b6d420 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916aeac1-5420-42a9-9067-4c47d6b6d420 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916aeac1-5420-42a9-9067-4c47d6b6d420 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-916aeac1-5420-42a9-9067-4c47d6b6d420 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-916aeac1-5420-42a9-9067-4c47d6b6d420 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-916aeac1-5420-42a9-9067-4c47d6b6d420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ca27c5-77e8-4cc9-a2e8-5f92cfde61b1 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2cf241-0c54-4a26-b693-c0e0c6e7f614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 213/414] 10.27.203.238 () {58 vars in 1023 bytes} [Tue May 28 12:37:09 2024] POST /identity/v3/auth/tokens => generated 864 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2cf241-0c54-4a26-b693-c0e0c6e7f614 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2cf241-0c54-4a26-b693-c0e0c6e7f614 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2cf241-0c54-4a26-b693-c0e0c6e7f614 None admin] PATH_INFO: `/v3/roles/service` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2cf241-0c54-4a26-b693-c0e0c6e7f614 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-2a2cf241-0c54-4a26-b693-c0e0c6e7f614 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._get_role(role_id) May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1281, in get_role May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 202/415] 10.27.203.238 () {56 vars in 1102 bytes} [Tue May 28 12:37:09 2024] GET /identity/v3/roles/service => generated 85 bytes in 90 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916aeac1-5420-42a9-9067-4c47d6b6d420 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916aeac1-5420-42a9-9067-4c47d6b6d420 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e236b7d5-4ed4-4edd-a3f6-b0c463abb894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e236b7d5-4ed4-4edd-a3f6-b0c463abb894 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e236b7d5-4ed4-4edd-a3f6-b0c463abb894 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e236b7d5-4ed4-4edd-a3f6-b0c463abb894 None admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e236b7d5-4ed4-4edd-a3f6-b0c463abb894 None admin] RBAC: Adding query filter params (name=service) {{(pid=51267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e236b7d5-4ed4-4edd-a3f6-b0c463abb894 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e236b7d5-4ed4-4edd-a3f6-b0c463abb894 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 214/416] 10.27.203.238 () {56 vars in 1103 bytes} [Tue May 28 12:37:09 2024] GET /identity/v3/roles?name=service => generated 347 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2cf241-0c54-4a26-b693-c0e0c6e7f614 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:09 l75lg1-v1 dstat.sh[49771]: 28-05 12:37:09| 47 4 49 0 0|1671M 8066M 234M 5731M| 33k 86B| 0 176k| 0 10.0 |2998 3670 |2.19 1.06 0.71|5.0 0 18| 0 0 | 0 2048M| 19 30 0 8 0 May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2cf241-0c54-4a26-b693-c0e0c6e7f614 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1447797-1108-48b6-903c-d9e513ccb752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e236b7d5-4ed4-4edd-a3f6-b0c463abb894 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1447797-1108-48b6-903c-d9e513ccb752 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1447797-1108-48b6-903c-d9e513ccb752 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1447797-1108-48b6-903c-d9e513ccb752 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1447797-1108-48b6-903c-d9e513ccb752 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1447797-1108-48b6-903c-d9e513ccb752 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-e1447797-1108-48b6-903c-d9e513ccb752 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 203/417] 10.27.203.238 () {56 vars in 1108 bytes} [Tue May 28 12:37:09 2024] GET /identity/v3/domains/Default => generated 87 bytes in 99 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1447797-1108-48b6-903c-d9e513ccb752 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e236b7d5-4ed4-4edd-a3f6-b0c463abb894 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1447797-1108-48b6-903c-d9e513ccb752 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9e2050-f4aa-4565-adf3-e45bb23b6565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9e2050-f4aa-4565-adf3-e45bb23b6565 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9e2050-f4aa-4565-adf3-e45bb23b6565 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9e2050-f4aa-4565-adf3-e45bb23b6565 None admin] PATH_INFO: `/v3/roles/service` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9e2050-f4aa-4565-adf3-e45bb23b6565 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-ed9e2050-f4aa-4565-adf3-e45bb23b6565 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._get_role(role_id) May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1281, in get_role May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 215/418] 10.27.203.238 () {56 vars in 1102 bytes} [Tue May 28 12:37:09 2024] GET /identity/v3/roles/service => generated 85 bytes in 93 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044ac5a0-bc61-4134-b528-9f5f448a9345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044ac5a0-bc61-4134-b528-9f5f448a9345 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044ac5a0-bc61-4134-b528-9f5f448a9345 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044ac5a0-bc61-4134-b528-9f5f448a9345 None admin] PATH_INFO: `/v3/domains` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044ac5a0-bc61-4134-b528-9f5f448a9345 None admin] RBAC: Adding query filter params (name=Default) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9e2050-f4aa-4565-adf3-e45bb23b6565 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044ac5a0-bc61-4134-b528-9f5f448a9345 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044ac5a0-bc61-4134-b528-9f5f448a9345 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 204/419] 10.27.203.238 () {56 vars in 1109 bytes} [Tue May 28 12:37:09 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f5b37d-4660-4f84-a12c-cbeda34c60f0 None None] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f5b37d-4660-4f84-a12c-cbeda34c60f0 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f5b37d-4660-4f84-a12c-cbeda34c60f0 None None] PATH_INFO: `/` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 205/420] 10.27.203.238 () {54 vars in 926 bytes} [Tue May 28 12:37:09 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f5b37d-4660-4f84-a12c-cbeda34c60f0 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9e2050-f4aa-4565-adf3-e45bb23b6565 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f5b37d-4660-4f84-a12c-cbeda34c60f0 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817e9326-84f9-4bdf-b056-095f51d34f4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817e9326-84f9-4bdf-b056-095f51d34f4d None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817e9326-84f9-4bdf-b056-095f51d34f4d None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817e9326-84f9-4bdf-b056-095f51d34f4d None admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817e9326-84f9-4bdf-b056-095f51d34f4d None admin] RBAC: Adding query filter params (name=service) {{(pid=51267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817e9326-84f9-4bdf-b056-095f51d34f4d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817e9326-84f9-4bdf-b056-095f51d34f4d None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 216/421] 10.27.203.238 () {56 vars in 1103 bytes} [Tue May 28 12:37:09 2024] GET /identity/v3/roles?name=service => generated 347 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac30ac2-84b9-4f11-9c0c-5aa35932e873 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac30ac2-84b9-4f11-9c0c-5aa35932e873 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac30ac2-84b9-4f11-9c0c-5aa35932e873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2d8881-4801-49aa-99e5-26a9393dd4b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2d8881-4801-49aa-99e5-26a9393dd4b7 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2d8881-4801-49aa-99e5-26a9393dd4b7 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2d8881-4801-49aa-99e5-26a9393dd4b7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-5ac30ac2-84b9-4f11-9c0c-5aa35932e873 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2d8881-4801-49aa-99e5-26a9393dd4b7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-5ac30ac2-84b9-4f11-9c0c-5aa35932e873 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2d8881-4801-49aa-99e5-26a9393dd4b7 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-5ac30ac2-84b9-4f11-9c0c-5aa35932e873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-6e2d8881-4801-49aa-99e5-26a9393dd4b7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._get_user(user_id) May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 206/422] 10.27.203.238 () {56 vars in 1093 bytes} [Tue May 28 12:37:09 2024] GET /identity/v3/users/nova => generated 82 bytes in 92 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2d8881-4801-49aa-99e5-26a9393dd4b7 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 217/423] 10.27.203.238 () {58 vars in 1023 bytes} [Tue May 28 12:37:09 2024] POST /identity/v3/auth/tokens => generated 864 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc66295c-ab0d-49d6-9990-390f92931a22 None None] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc66295c-ab0d-49d6-9990-390f92931a22 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc66295c-ab0d-49d6-9990-390f92931a22 None None] PATH_INFO: `/` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 218/424] 10.27.203.238 () {54 vars in 926 bytes} [Tue May 28 12:37:09 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc66295c-ab0d-49d6-9990-390f92931a22 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2d8881-4801-49aa-99e5-26a9393dd4b7 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d02711-427a-418b-8e24-f88ecee82527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d02711-427a-418b-8e24-f88ecee82527 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d02711-427a-418b-8e24-f88ecee82527 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d02711-427a-418b-8e24-f88ecee82527 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d02711-427a-418b-8e24-f88ecee82527 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d02711-427a-418b-8e24-f88ecee82527 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-77d02711-427a-418b-8e24-f88ecee82527 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 207/425] 10.27.203.238 () {56 vars in 1108 bytes} [Tue May 28 12:37:09 2024] GET /identity/v3/domains/Default => generated 87 bytes in 90 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441046b7-2239-4d55-b692-e296db4eae39 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441046b7-2239-4d55-b692-e296db4eae39 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441046b7-2239-4d55-b692-e296db4eae39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc66295c-ab0d-49d6-9990-390f92931a22 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-441046b7-2239-4d55-b692-e296db4eae39 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-441046b7-2239-4d55-b692-e296db4eae39 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-441046b7-2239-4d55-b692-e296db4eae39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674fadb6-17d8-4337-a3ca-a0dabb636c7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674fadb6-17d8-4337-a3ca-a0dabb636c7c None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674fadb6-17d8-4337-a3ca-a0dabb636c7c None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674fadb6-17d8-4337-a3ca-a0dabb636c7c None admin] PATH_INFO: `/v3/users` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674fadb6-17d8-4337-a3ca-a0dabb636c7c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=51267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674fadb6-17d8-4337-a3ca-a0dabb636c7c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674fadb6-17d8-4337-a3ca-a0dabb636c7c None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 219/426] 10.27.203.238 () {56 vars in 1133 bytes} [Tue May 28 12:37:09 2024] GET /identity/v3/users?domain_id=default&name=nova => generated 372 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674fadb6-17d8-4337-a3ca-a0dabb636c7c None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 208/427] 10.27.203.238 () {58 vars in 1023 bytes} [Tue May 28 12:37:09 2024] POST /identity/v3/auth/tokens => generated 864 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441046b7-2239-4d55-b692-e296db4eae39 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674fadb6-17d8-4337-a3ca-a0dabb636c7c None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441046b7-2239-4d55-b692-e296db4eae39 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd84ba13-b6d4-42e1-93de-26e6174da1ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd84ba13-b6d4-42e1-93de-26e6174da1ab None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd84ba13-b6d4-42e1-93de-26e6174da1ab None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd84ba13-b6d4-42e1-93de-26e6174da1ab None admin] PATH_INFO: `/v3/domains` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd84ba13-b6d4-42e1-93de-26e6174da1ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=51267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd84ba13-b6d4-42e1-93de-26e6174da1ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd84ba13-b6d4-42e1-93de-26e6174da1ab None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 220/428] 10.27.203.238 () {56 vars in 1109 bytes} [Tue May 28 12:37:09 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd84ba13-b6d4-42e1-93de-26e6174da1ab None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7691074a-3b4d-4177-b690-b8fc85440331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7691074a-3b4d-4177-b690-b8fc85440331 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7691074a-3b4d-4177-b690-b8fc85440331 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7691074a-3b4d-4177-b690-b8fc85440331 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7691074a-3b4d-4177-b690-b8fc85440331 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7691074a-3b4d-4177-b690-b8fc85440331 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd84ba13-b6d4-42e1-93de-26e6174da1ab None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83da139c-5245-4f7b-9e9a-ac21a24f21a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83da139c-5245-4f7b-9e9a-ac21a24f21a8 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83da139c-5245-4f7b-9e9a-ac21a24f21a8 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83da139c-5245-4f7b-9e9a-ac21a24f21a8 None admin] PATH_INFO: `/v3/users/glance` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83da139c-5245-4f7b-9e9a-ac21a24f21a8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83da139c-5245-4f7b-9e9a-ac21a24f21a8 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 209/429] 10.27.203.238 () {58 vars in 1282 bytes} [Tue May 28 12:37:09 2024] GET /identity/v3/auth/tokens => generated 864 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7691074a-3b4d-4177-b690-b8fc85440331 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-83da139c-5245-4f7b-9e9a-ac21a24f21a8 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._get_user(user_id) May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 221/430] 10.27.203.238 () {56 vars in 1099 bytes} [Tue May 28 12:37:09 2024] GET /identity/v3/users/glance => generated 84 bytes in 85 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83da139c-5245-4f7b-9e9a-ac21a24f21a8 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83da139c-5245-4f7b-9e9a-ac21a24f21a8 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7691074a-3b4d-4177-b690-b8fc85440331 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9262366a-e369-4fe0-8968-47ab1f6ba6bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9262366a-e369-4fe0-8968-47ab1f6ba6bc None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9262366a-e369-4fe0-8968-47ab1f6ba6bc None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9262366a-e369-4fe0-8968-47ab1f6ba6bc None admin] PATH_INFO: `/v3/roles/service` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85641a9-c75e-4195-b240-07ba4a7a8ce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85641a9-c75e-4195-b240-07ba4a7a8ce3 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85641a9-c75e-4195-b240-07ba4a7a8ce3 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85641a9-c75e-4195-b240-07ba4a7a8ce3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9262366a-e369-4fe0-8968-47ab1f6ba6bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85641a9-c75e-4195-b240-07ba4a7a8ce3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-9262366a-e369-4fe0-8968-47ab1f6ba6bc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._get_role(role_id) May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1281, in get_role May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85641a9-c75e-4195-b240-07ba4a7a8ce3 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 210/431] 10.27.203.238 () {56 vars in 1102 bytes} [Tue May 28 12:37:09 2024] GET /identity/v3/roles/service => generated 85 bytes in 87 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9262366a-e369-4fe0-8968-47ab1f6ba6bc None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-a85641a9-c75e-4195-b240-07ba4a7a8ce3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 222/432] 10.27.203.238 () {56 vars in 1108 bytes} [Tue May 28 12:37:09 2024] GET /identity/v3/domains/Default => generated 87 bytes in 93 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85641a9-c75e-4195-b240-07ba4a7a8ce3 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9262366a-e369-4fe0-8968-47ab1f6ba6bc None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85641a9-c75e-4195-b240-07ba4a7a8ce3 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090a122b-5ae8-40a2-8a94-23332cff3e18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090a122b-5ae8-40a2-8a94-23332cff3e18 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090a122b-5ae8-40a2-8a94-23332cff3e18 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090a122b-5ae8-40a2-8a94-23332cff3e18 None admin] PATH_INFO: `/v3/users` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090a122b-5ae8-40a2-8a94-23332cff3e18 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090a122b-5ae8-40a2-8a94-23332cff3e18 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090a122b-5ae8-40a2-8a94-23332cff3e18 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985eb0bc-73e2-4b95-96a3-fed134de142f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 211/433] 10.27.203.238 () {56 vars in 1137 bytes} [Tue May 28 12:37:09 2024] GET /identity/v3/users?domain_id=default&name=glance => generated 376 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985eb0bc-73e2-4b95-96a3-fed134de142f None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985eb0bc-73e2-4b95-96a3-fed134de142f None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090a122b-5ae8-40a2-8a94-23332cff3e18 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985eb0bc-73e2-4b95-96a3-fed134de142f None admin] PATH_INFO: `/v3/roles/service` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985eb0bc-73e2-4b95-96a3-fed134de142f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-985eb0bc-73e2-4b95-96a3-fed134de142f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._get_role(role_id) May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1281, in get_role May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 223/434] 10.27.203.238 () {56 vars in 1102 bytes} [Tue May 28 12:37:09 2024] GET /identity/v3/roles/service => generated 85 bytes in 87 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 28 12:37:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985eb0bc-73e2-4b95-96a3-fed134de142f None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090a122b-5ae8-40a2-8a94-23332cff3e18 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985eb0bc-73e2-4b95-96a3-fed134de142f None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d837a9c-0a94-4600-851d-3ce50333f8b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d837a9c-0a94-4600-851d-3ce50333f8b7 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d837a9c-0a94-4600-851d-3ce50333f8b7 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d837a9c-0a94-4600-851d-3ce50333f8b7 None admin] PATH_INFO: `/v3/roles` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d837a9c-0a94-4600-851d-3ce50333f8b7 None admin] RBAC: Adding query filter params (name=service) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d837a9c-0a94-4600-851d-3ce50333f8b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d837a9c-0a94-4600-851d-3ce50333f8b7 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 212/435] 10.27.203.238 () {56 vars in 1103 bytes} [Tue May 28 12:37:09 2024] GET /identity/v3/roles?name=service => generated 347 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d837a9c-0a94-4600-851d-3ce50333f8b7 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68273d00-05e8-47b6-8d49-edb447ca4ee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68273d00-05e8-47b6-8d49-edb447ca4ee4 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68273d00-05e8-47b6-8d49-edb447ca4ee4 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68273d00-05e8-47b6-8d49-edb447ca4ee4 None admin] PATH_INFO: `/v3/domains` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68273d00-05e8-47b6-8d49-edb447ca4ee4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=51267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68273d00-05e8-47b6-8d49-edb447ca4ee4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68273d00-05e8-47b6-8d49-edb447ca4ee4 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 224/436] 10.27.203.238 () {56 vars in 1109 bytes} [Tue May 28 12:37:09 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68273d00-05e8-47b6-8d49-edb447ca4ee4 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d837a9c-0a94-4600-851d-3ce50333f8b7 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68273d00-05e8-47b6-8d49-edb447ca4ee4 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3ad683-9def-42e4-94e5-833068cefae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3ad683-9def-42e4-94e5-833068cefae1 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3ad683-9def-42e4-94e5-833068cefae1 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3ad683-9def-42e4-94e5-833068cefae1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40094619-91e0-4f0c-b55b-287400c98f8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40094619-91e0-4f0c-b55b-287400c98f8e None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40094619-91e0-4f0c-b55b-287400c98f8e None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40094619-91e0-4f0c-b55b-287400c98f8e None admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40094619-91e0-4f0c-b55b-287400c98f8e None admin] RBAC: Adding query filter params (name=service) {{(pid=51267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40094619-91e0-4f0c-b55b-287400c98f8e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40094619-91e0-4f0c-b55b-287400c98f8e None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 225/437] 10.27.203.238 () {56 vars in 1103 bytes} [Tue May 28 12:37:10 2024] GET /identity/v3/roles?name=service => generated 347 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3ad683-9def-42e4-94e5-833068cefae1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40094619-91e0-4f0c-b55b-287400c98f8e None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3ad683-9def-42e4-94e5-833068cefae1 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 213/438] 10.27.203.238 () {58 vars in 1282 bytes} [Tue May 28 12:37:10 2024] GET /identity/v3/auth/tokens => generated 864 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3ad683-9def-42e4-94e5-833068cefae1 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40094619-91e0-4f0c-b55b-287400c98f8e None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868c84ec-089b-47f2-87ec-26308b1dddca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868c84ec-089b-47f2-87ec-26308b1dddca None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868c84ec-089b-47f2-87ec-26308b1dddca None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868c84ec-089b-47f2-87ec-26308b1dddca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:10 l75lg1-v1 dstat.sh[49771]: 28-05 12:37:10| 37 3 60 0 0|1698M 8039M 234M 5732M| 31k 258B| 0 148k| 0 13.0 |5411 14k|2.19 1.06 0.71|3.0 0 0| 0 0 | 0 2048M| 19 33 0 8 0 May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868c84ec-089b-47f2-87ec-26308b1dddca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868c84ec-089b-47f2-87ec-26308b1dddca None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-868c84ec-089b-47f2-87ec-26308b1dddca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3ad683-9def-42e4-94e5-833068cefae1 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 226/439] 10.27.203.238 () {56 vars in 1108 bytes} [Tue May 28 12:37:10 2024] GET /identity/v3/domains/Default => generated 87 bytes in 98 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868c84ec-089b-47f2-87ec-26308b1dddca None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e24c8b-f508-4e3f-80cc-370936032677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e24c8b-f508-4e3f-80cc-370936032677 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e24c8b-f508-4e3f-80cc-370936032677 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e24c8b-f508-4e3f-80cc-370936032677 None admin] PATH_INFO: `/v3/projects/service` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e24c8b-f508-4e3f-80cc-370936032677 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e24c8b-f508-4e3f-80cc-370936032677 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-94e24c8b-f508-4e3f-80cc-370936032677 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._get_project(project_id) May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 214/440] 10.27.203.238 () {56 vars in 1111 bytes} [Tue May 28 12:37:10 2024] GET /identity/v3/projects/service => generated 88 bytes in 89 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e24c8b-f508-4e3f-80cc-370936032677 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868c84ec-089b-47f2-87ec-26308b1dddca None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5819ea6-0cf1-4b8d-a848-0630cf2c8fce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5819ea6-0cf1-4b8d-a848-0630cf2c8fce None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5819ea6-0cf1-4b8d-a848-0630cf2c8fce None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5819ea6-0cf1-4b8d-a848-0630cf2c8fce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5819ea6-0cf1-4b8d-a848-0630cf2c8fce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5819ea6-0cf1-4b8d-a848-0630cf2c8fce None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e24c8b-f508-4e3f-80cc-370936032677 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-f5819ea6-0cf1-4b8d-a848-0630cf2c8fce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 227/441] 10.27.203.238 () {56 vars in 1108 bytes} [Tue May 28 12:37:10 2024] GET /identity/v3/domains/Default => generated 87 bytes in 93 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5819ea6-0cf1-4b8d-a848-0630cf2c8fce None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18473055-b584-4afb-90bb-393386ebf1bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18473055-b584-4afb-90bb-393386ebf1bb None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18473055-b584-4afb-90bb-393386ebf1bb None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18473055-b584-4afb-90bb-393386ebf1bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18473055-b584-4afb-90bb-393386ebf1bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18473055-b584-4afb-90bb-393386ebf1bb None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-18473055-b584-4afb-90bb-393386ebf1bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 215/442] 10.27.203.238 () {56 vars in 1108 bytes} [Tue May 28 12:37:10 2024] GET /identity/v3/domains/Default => generated 87 bytes in 93 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18473055-b584-4afb-90bb-393386ebf1bb None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5819ea6-0cf1-4b8d-a848-0630cf2c8fce None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcb2bc9-8ba1-4dbc-a551-3040703bccb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcb2bc9-8ba1-4dbc-a551-3040703bccb6 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcb2bc9-8ba1-4dbc-a551-3040703bccb6 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcb2bc9-8ba1-4dbc-a551-3040703bccb6 None admin] PATH_INFO: `/v3/domains` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcb2bc9-8ba1-4dbc-a551-3040703bccb6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=51267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcb2bc9-8ba1-4dbc-a551-3040703bccb6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcb2bc9-8ba1-4dbc-a551-3040703bccb6 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 228/443] 10.27.203.238 () {56 vars in 1109 bytes} [Tue May 28 12:37:10 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcb2bc9-8ba1-4dbc-a551-3040703bccb6 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18473055-b584-4afb-90bb-393386ebf1bb None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dcfed9-8ef0-4920-bb42-f6c1f5c5c19e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dcfed9-8ef0-4920-bb42-f6c1f5c5c19e None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dcfed9-8ef0-4920-bb42-f6c1f5c5c19e None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dcfed9-8ef0-4920-bb42-f6c1f5c5c19e None admin] PATH_INFO: `/v3/projects` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dcfed9-8ef0-4920-bb42-f6c1f5c5c19e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dcfed9-8ef0-4920-bb42-f6c1f5c5c19e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dcfed9-8ef0-4920-bb42-f6c1f5c5c19e None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 216/444] 10.27.203.238 () {56 vars in 1148 bytes} [Tue May 28 12:37:10 2024] GET /identity/v3/projects?domain_id=default&name=service => generated 433 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dcfed9-8ef0-4920-bb42-f6c1f5c5c19e None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcb2bc9-8ba1-4dbc-a551-3040703bccb6 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df0fdde-d9aa-4a14-ab08-058ba1238249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df0fdde-d9aa-4a14-ab08-058ba1238249 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df0fdde-d9aa-4a14-ab08-058ba1238249 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df0fdde-d9aa-4a14-ab08-058ba1238249 None admin] PATH_INFO: `/v3/domains` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df0fdde-d9aa-4a14-ab08-058ba1238249 None admin] RBAC: Adding query filter params (name=Default) {{(pid=51267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df0fdde-d9aa-4a14-ab08-058ba1238249 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df0fdde-d9aa-4a14-ab08-058ba1238249 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 229/445] 10.27.203.238 () {56 vars in 1109 bytes} [Tue May 28 12:37:10 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df0fdde-d9aa-4a14-ab08-058ba1238249 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dcfed9-8ef0-4920-bb42-f6c1f5c5c19e None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a9fe4f-b07f-4953-8314-6b974b3c032e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a9fe4f-b07f-4953-8314-6b974b3c032e None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a9fe4f-b07f-4953-8314-6b974b3c032e None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a9fe4f-b07f-4953-8314-6b974b3c032e None admin] PATH_INFO: `/v3/domains` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a9fe4f-b07f-4953-8314-6b974b3c032e None admin] RBAC: Adding query filter params (name=Default) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a9fe4f-b07f-4953-8314-6b974b3c032e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a9fe4f-b07f-4953-8314-6b974b3c032e None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 217/446] 10.27.203.238 () {56 vars in 1109 bytes} [Tue May 28 12:37:10 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a9fe4f-b07f-4953-8314-6b974b3c032e None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df0fdde-d9aa-4a14-ab08-058ba1238249 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be2bf8e-8116-4e4e-850c-2a253a228588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be2bf8e-8116-4e4e-850c-2a253a228588 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be2bf8e-8116-4e4e-850c-2a253a228588 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be2bf8e-8116-4e4e-850c-2a253a228588 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be2bf8e-8116-4e4e-850c-2a253a228588 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be2bf8e-8116-4e4e-850c-2a253a228588 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-8be2bf8e-8116-4e4e-850c-2a253a228588 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._get_user(user_id) May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 230/447] 10.27.203.238 () {56 vars in 1099 bytes} [Tue May 28 12:37:10 2024] GET /identity/v3/users/cinder => generated 84 bytes in 87 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be2bf8e-8116-4e4e-850c-2a253a228588 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a9fe4f-b07f-4953-8314-6b974b3c032e None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cae4642-060f-4a9f-aa7a-728e96c412fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cae4642-060f-4a9f-aa7a-728e96c412fa None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cae4642-060f-4a9f-aa7a-728e96c412fa None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cae4642-060f-4a9f-aa7a-728e96c412fa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cae4642-060f-4a9f-aa7a-728e96c412fa None admin] RBAC: Adding query filter params (role.id=14940fb5f1c44f629b6e1d8472832bd1, scope.project.id=98a6a2dcbf0248d5b353760f7757f713, user.id=befdd4414dc2432ab2baa1ae3fbffef7) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cae4642-060f-4a9f-aa7a-728e96c412fa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cae4642-060f-4a9f-aa7a-728e96c412fa None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 218/448] 10.27.203.238 () {56 vars in 1374 bytes} [Tue May 28 12:37:10 2024] GET /identity/v3/role_assignments?user.id=befdd4414dc2432ab2baa1ae3fbffef7&scope.project.id=98a6a2dcbf0248d5b353760f7757f713&role.id=14940fb5f1c44f629b6e1d8472832bd1 => generated 612 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cae4642-060f-4a9f-aa7a-728e96c412fa None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be2bf8e-8116-4e4e-850c-2a253a228588 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412d831d-add3-467a-aa62-7b83104eaa31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412d831d-add3-467a-aa62-7b83104eaa31 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412d831d-add3-467a-aa62-7b83104eaa31 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412d831d-add3-467a-aa62-7b83104eaa31 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412d831d-add3-467a-aa62-7b83104eaa31 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412d831d-add3-467a-aa62-7b83104eaa31 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-412d831d-add3-467a-aa62-7b83104eaa31 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._get_user(user_id) May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 231/449] 10.27.203.238 () {56 vars in 1102 bytes} [Tue May 28 12:37:10 2024] GET /identity/v3/users/neutron => generated 85 bytes in 96 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412d831d-add3-467a-aa62-7b83104eaa31 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cae4642-060f-4a9f-aa7a-728e96c412fa None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c965b8d2-09bf-463e-b646-3e640893f1df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c965b8d2-09bf-463e-b646-3e640893f1df None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c965b8d2-09bf-463e-b646-3e640893f1df None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c965b8d2-09bf-463e-b646-3e640893f1df None admin] PATH_INFO: `/v3/projects/service` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c965b8d2-09bf-463e-b646-3e640893f1df None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c965b8d2-09bf-463e-b646-3e640893f1df None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-c965b8d2-09bf-463e-b646-3e640893f1df None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._get_project(project_id) May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 219/450] 10.27.203.238 () {56 vars in 1111 bytes} [Tue May 28 12:37:10 2024] GET /identity/v3/projects/service => generated 88 bytes in 104 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c965b8d2-09bf-463e-b646-3e640893f1df None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412d831d-add3-467a-aa62-7b83104eaa31 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01829a39-7f50-41fa-bd52-df3c1592729b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01829a39-7f50-41fa-bd52-df3c1592729b None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01829a39-7f50-41fa-bd52-df3c1592729b None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01829a39-7f50-41fa-bd52-df3c1592729b None admin] PATH_INFO: `/v3/users` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01829a39-7f50-41fa-bd52-df3c1592729b None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=51267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01829a39-7f50-41fa-bd52-df3c1592729b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01829a39-7f50-41fa-bd52-df3c1592729b None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 232/451] 10.27.203.238 () {56 vars in 1137 bytes} [Tue May 28 12:37:10 2024] GET /identity/v3/users?domain_id=default&name=cinder => generated 376 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01829a39-7f50-41fa-bd52-df3c1592729b None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c965b8d2-09bf-463e-b646-3e640893f1df None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603a8816-19a1-43e1-9718-abfb96582b6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603a8816-19a1-43e1-9718-abfb96582b6a None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603a8816-19a1-43e1-9718-abfb96582b6a None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603a8816-19a1-43e1-9718-abfb96582b6a None admin] PATH_INFO: `/v3/users` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603a8816-19a1-43e1-9718-abfb96582b6a None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603a8816-19a1-43e1-9718-abfb96582b6a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603a8816-19a1-43e1-9718-abfb96582b6a None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01829a39-7f50-41fa-bd52-df3c1592729b None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 220/452] 10.27.203.238 () {56 vars in 1139 bytes} [Tue May 28 12:37:10 2024] GET /identity/v3/users?domain_id=default&name=neutron => generated 378 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603a8816-19a1-43e1-9718-abfb96582b6a None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c818bb0-55d4-48c5-a3bc-f5fecd9bba20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c818bb0-55d4-48c5-a3bc-f5fecd9bba20 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c818bb0-55d4-48c5-a3bc-f5fecd9bba20 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c818bb0-55d4-48c5-a3bc-f5fecd9bba20 None admin] PATH_INFO: `/v3/projects` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c818bb0-55d4-48c5-a3bc-f5fecd9bba20 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=51267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c818bb0-55d4-48c5-a3bc-f5fecd9bba20 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c818bb0-55d4-48c5-a3bc-f5fecd9bba20 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 233/453] 10.27.203.238 () {56 vars in 1148 bytes} [Tue May 28 12:37:10 2024] GET /identity/v3/projects?domain_id=default&name=service => generated 433 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c818bb0-55d4-48c5-a3bc-f5fecd9bba20 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603a8816-19a1-43e1-9718-abfb96582b6a None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b3ba18-b05e-4f3a-a9e9-eb3c00ddddca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b3ba18-b05e-4f3a-a9e9-eb3c00ddddca None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b3ba18-b05e-4f3a-a9e9-eb3c00ddddca None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b3ba18-b05e-4f3a-a9e9-eb3c00ddddca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c818bb0-55d4-48c5-a3bc-f5fecd9bba20 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b3ba18-b05e-4f3a-a9e9-eb3c00ddddca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b3ba18-b05e-4f3a-a9e9-eb3c00ddddca None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3daa885-9453-4014-991f-a6046bb142b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3daa885-9453-4014-991f-a6046bb142b3 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3daa885-9453-4014-991f-a6046bb142b3 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:10 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3daa885-9453-4014-991f-a6046bb142b3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3daa885-9453-4014-991f-a6046bb142b3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3daa885-9453-4014-991f-a6046bb142b3 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 221/454] 10.27.203.238 () {58 vars in 1282 bytes} [Tue May 28 12:37:10 2024] GET /identity/v3/auth/tokens => generated 864 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b3ba18-b05e-4f3a-a9e9-eb3c00ddddca None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b3ba18-b05e-4f3a-a9e9-eb3c00ddddca None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 234/455] 10.27.203.238 () {58 vars in 1282 bytes} [Tue May 28 12:37:10 2024] GET /identity/v3/auth/tokens => generated 864 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3daa885-9453-4014-991f-a6046bb142b3 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9407ceef-f57b-41ba-a762-512ed9bb498b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9407ceef-f57b-41ba-a762-512ed9bb498b None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9407ceef-f57b-41ba-a762-512ed9bb498b None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9407ceef-f57b-41ba-a762-512ed9bb498b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9407ceef-f57b-41ba-a762-512ed9bb498b None admin] RBAC: Adding query filter params (role.id=14940fb5f1c44f629b6e1d8472832bd1, scope.project.id=98a6a2dcbf0248d5b353760f7757f713, user.id=d1436e60c2e34e0b8af9ae1c668bdf03) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9407ceef-f57b-41ba-a762-512ed9bb498b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9407ceef-f57b-41ba-a762-512ed9bb498b None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 222/456] 10.27.203.238 () {56 vars in 1374 bytes} [Tue May 28 12:37:11 2024] GET /identity/v3/role_assignments?user.id=d1436e60c2e34e0b8af9ae1c668bdf03&scope.project.id=98a6a2dcbf0248d5b353760f7757f713&role.id=14940fb5f1c44f629b6e1d8472832bd1 => generated 612 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9407ceef-f57b-41ba-a762-512ed9bb498b None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3daa885-9453-4014-991f-a6046bb142b3 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93329ab4-a9f7-433d-9cf3-b35bff5f6564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93329ab4-a9f7-433d-9cf3-b35bff5f6564 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93329ab4-a9f7-433d-9cf3-b35bff5f6564 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93329ab4-a9f7-433d-9cf3-b35bff5f6564 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9407ceef-f57b-41ba-a762-512ed9bb498b None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93329ab4-a9f7-433d-9cf3-b35bff5f6564 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93329ab4-a9f7-433d-9cf3-b35bff5f6564 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-93329ab4-a9f7-433d-9cf3-b35bff5f6564 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 235/457] 10.27.203.238 () {56 vars in 1108 bytes} [Tue May 28 12:37:11 2024] GET /identity/v3/domains/Default => generated 87 bytes in 105 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93329ab4-a9f7-433d-9cf3-b35bff5f6564 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efdad9e-b8ef-4d44-b2fd-8e3bf66dc298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efdad9e-b8ef-4d44-b2fd-8e3bf66dc298 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efdad9e-b8ef-4d44-b2fd-8e3bf66dc298 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efdad9e-b8ef-4d44-b2fd-8e3bf66dc298 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efdad9e-b8ef-4d44-b2fd-8e3bf66dc298 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efdad9e-b8ef-4d44-b2fd-8e3bf66dc298 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-8efdad9e-b8ef-4d44-b2fd-8e3bf66dc298 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 223/458] 10.27.203.238 () {56 vars in 1108 bytes} [Tue May 28 12:37:11 2024] GET /identity/v3/domains/Default => generated 87 bytes in 116 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efdad9e-b8ef-4d44-b2fd-8e3bf66dc298 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93329ab4-a9f7-433d-9cf3-b35bff5f6564 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:11 l75lg1-v1 dstat.sh[49771]: 28-05 12:37:11| 35 4 61 0 0|1681M 8054M 234M 5733M| 30k 86B| 0 1794k| 0 17.0 |7898 15k|2.33 1.11 0.73|5.0 0 38| 0 0 | 0 2048M| 19 31 0 8 0 May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7205cd3a-f777-4705-98f8-3a90cc93e8e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7205cd3a-f777-4705-98f8-3a90cc93e8e0 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7205cd3a-f777-4705-98f8-3a90cc93e8e0 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7205cd3a-f777-4705-98f8-3a90cc93e8e0 None admin] PATH_INFO: `/v3/domains` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7205cd3a-f777-4705-98f8-3a90cc93e8e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=51267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7205cd3a-f777-4705-98f8-3a90cc93e8e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7205cd3a-f777-4705-98f8-3a90cc93e8e0 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 236/459] 10.27.203.238 () {56 vars in 1109 bytes} [Tue May 28 12:37:11 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7205cd3a-f777-4705-98f8-3a90cc93e8e0 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efdad9e-b8ef-4d44-b2fd-8e3bf66dc298 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490d2cc0-95b5-4ced-ba10-c70171178947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490d2cc0-95b5-4ced-ba10-c70171178947 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490d2cc0-95b5-4ced-ba10-c70171178947 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490d2cc0-95b5-4ced-ba10-c70171178947 None admin] PATH_INFO: `/v3/domains` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490d2cc0-95b5-4ced-ba10-c70171178947 None admin] RBAC: Adding query filter params (name=Default) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490d2cc0-95b5-4ced-ba10-c70171178947 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490d2cc0-95b5-4ced-ba10-c70171178947 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 224/460] 10.27.203.238 () {56 vars in 1109 bytes} [Tue May 28 12:37:11 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490d2cc0-95b5-4ced-ba10-c70171178947 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7205cd3a-f777-4705-98f8-3a90cc93e8e0 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade3f0f5-44f3-4408-aaa0-2a3219f9de7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade3f0f5-44f3-4408-aaa0-2a3219f9de7a None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade3f0f5-44f3-4408-aaa0-2a3219f9de7a None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade3f0f5-44f3-4408-aaa0-2a3219f9de7a None admin] PATH_INFO: `/v3/projects/service` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade3f0f5-44f3-4408-aaa0-2a3219f9de7a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade3f0f5-44f3-4408-aaa0-2a3219f9de7a None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-ade3f0f5-44f3-4408-aaa0-2a3219f9de7a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._get_project(project_id) May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 237/461] 10.27.203.238 () {56 vars in 1111 bytes} [Tue May 28 12:37:11 2024] GET /identity/v3/projects/service => generated 88 bytes in 99 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade3f0f5-44f3-4408-aaa0-2a3219f9de7a None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490d2cc0-95b5-4ced-ba10-c70171178947 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201772ac-d56b-49b6-b5ad-cceef323b212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201772ac-d56b-49b6-b5ad-cceef323b212 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201772ac-d56b-49b6-b5ad-cceef323b212 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201772ac-d56b-49b6-b5ad-cceef323b212 None admin] PATH_INFO: `/v3/projects/service` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade3f0f5-44f3-4408-aaa0-2a3219f9de7a None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201772ac-d56b-49b6-b5ad-cceef323b212 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201772ac-d56b-49b6-b5ad-cceef323b212 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-201772ac-d56b-49b6-b5ad-cceef323b212 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._get_project(project_id) May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 225/462] 10.27.203.238 () {56 vars in 1111 bytes} [Tue May 28 12:37:11 2024] GET /identity/v3/projects/service => generated 88 bytes in 130 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201772ac-d56b-49b6-b5ad-cceef323b212 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654c3163-7ce4-49e4-a744-a90b96154f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654c3163-7ce4-49e4-a744-a90b96154f04 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654c3163-7ce4-49e4-a744-a90b96154f04 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654c3163-7ce4-49e4-a744-a90b96154f04 None admin] PATH_INFO: `/v3/projects` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654c3163-7ce4-49e4-a744-a90b96154f04 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=51267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654c3163-7ce4-49e4-a744-a90b96154f04 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654c3163-7ce4-49e4-a744-a90b96154f04 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 238/463] 10.27.203.238 () {56 vars in 1148 bytes} [Tue May 28 12:37:11 2024] GET /identity/v3/projects?domain_id=default&name=service => generated 433 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654c3163-7ce4-49e4-a744-a90b96154f04 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201772ac-d56b-49b6-b5ad-cceef323b212 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654c3163-7ce4-49e4-a744-a90b96154f04 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1a5f34-4502-41ba-9b13-2b9177eaabb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1a5f34-4502-41ba-9b13-2b9177eaabb7 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1a5f34-4502-41ba-9b13-2b9177eaabb7 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1a5f34-4502-41ba-9b13-2b9177eaabb7 None admin] PATH_INFO: `/v3/projects` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1a5f34-4502-41ba-9b13-2b9177eaabb7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1a5f34-4502-41ba-9b13-2b9177eaabb7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1a5f34-4502-41ba-9b13-2b9177eaabb7 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a6406f-84c2-4ad1-a2a1-623c5f12193d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a6406f-84c2-4ad1-a2a1-623c5f12193d None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a6406f-84c2-4ad1-a2a1-623c5f12193d None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a6406f-84c2-4ad1-a2a1-623c5f12193d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a6406f-84c2-4ad1-a2a1-623c5f12193d None admin] RBAC: Adding query filter params (role.id=14940fb5f1c44f629b6e1d8472832bd1, scope.project.id=98a6a2dcbf0248d5b353760f7757f713, user.id=d8b9b336af4049a99b45df9eba13a358) {{(pid=51267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a6406f-84c2-4ad1-a2a1-623c5f12193d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a6406f-84c2-4ad1-a2a1-623c5f12193d None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 239/464] 10.27.203.238 () {56 vars in 1374 bytes} [Tue May 28 12:37:11 2024] GET /identity/v3/role_assignments?user.id=d8b9b336af4049a99b45df9eba13a358&scope.project.id=98a6a2dcbf0248d5b353760f7757f713&role.id=14940fb5f1c44f629b6e1d8472832bd1 => generated 612 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 226/465] 10.27.203.238 () {56 vars in 1148 bytes} [Tue May 28 12:37:11 2024] GET /identity/v3/projects?domain_id=default&name=service => generated 433 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a6406f-84c2-4ad1-a2a1-623c5f12193d None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a6406f-84c2-4ad1-a2a1-623c5f12193d None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b14b15-2925-4c81-aa2d-551e2f84ec3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b14b15-2925-4c81-aa2d-551e2f84ec3b None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b14b15-2925-4c81-aa2d-551e2f84ec3b None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b14b15-2925-4c81-aa2d-551e2f84ec3b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b14b15-2925-4c81-aa2d-551e2f84ec3b None admin] RBAC: Adding query filter params (role.id=14940fb5f1c44f629b6e1d8472832bd1, scope.project.id=98a6a2dcbf0248d5b353760f7757f713, user.id=8ef17047035e4b518fd5360a01f2da1a) {{(pid=51267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b14b15-2925-4c81-aa2d-551e2f84ec3b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b14b15-2925-4c81-aa2d-551e2f84ec3b None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:11 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 240/466] 10.27.203.238 () {56 vars in 1374 bytes} [Tue May 28 12:37:11 2024] GET /identity/v3/role_assignments?user.id=8ef17047035e4b518fd5360a01f2da1a&scope.project.id=98a6a2dcbf0248d5b353760f7757f713&role.id=14940fb5f1c44f629b6e1d8472832bd1 => generated 612 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0bc3ac-f81d-49bc-aede-e019dc7e2798 None None] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0bc3ac-f81d-49bc-aede-e019dc7e2798 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0bc3ac-f81d-49bc-aede-e019dc7e2798 None None] PATH_INFO: `/` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 227/467] 10.27.203.238 () {54 vars in 926 bytes} [Tue May 28 12:37:12 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7fe4f3-71a5-489f-b0fa-c30a9dd95c1f None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7fe4f3-71a5-489f-b0fa-c30a9dd95c1f None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7fe4f3-71a5-489f-b0fa-c30a9dd95c1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:12 l75lg1-v1 dstat.sh[49771]: 28-05 12:37:12| 45 7 48 0 0|1641M 8094M 234M 5733M| 25k 86B| 0 208k| 0 10.0 | 15k 28k|2.33 1.11 0.73|5.0 0 122| 0 0 | 0 2048M| 19 30 0 8 0 May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-cf7fe4f3-71a5-489f-b0fa-c30a9dd95c1f None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-cf7fe4f3-71a5-489f-b0fa-c30a9dd95c1f None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-cf7fe4f3-71a5-489f-b0fa-c30a9dd95c1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 241/468] 10.27.203.238 () {58 vars in 1023 bytes} [Tue May 28 12:37:12 2024] POST /identity/v3/auth/tokens => generated 864 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0bc3ac-f81d-49bc-aede-e019dc7e2798 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0bc3ac-f81d-49bc-aede-e019dc7e2798 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc4564c-1d3d-4b1a-9d78-502e84226dda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc4564c-1d3d-4b1a-9d78-502e84226dda None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc4564c-1d3d-4b1a-9d78-502e84226dda None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc4564c-1d3d-4b1a-9d78-502e84226dda None admin] PATH_INFO: `/v3/roles/admin` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc4564c-1d3d-4b1a-9d78-502e84226dda None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a65f61-0f9e-4e14-8a06-8e98889620ab None None] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a65f61-0f9e-4e14-8a06-8e98889620ab None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a65f61-0f9e-4e14-8a06-8e98889620ab None None] PATH_INFO: `/` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 242/469] 10.27.203.238 () {54 vars in 926 bytes} [Tue May 28 12:37:12 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (2 switches on core 0) May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-4cc4564c-1d3d-4b1a-9d78-502e84226dda None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._get_role(role_id) May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1281, in get_role May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 228/470] 10.27.203.238 () {56 vars in 1096 bytes} [Tue May 28 12:37:12 2024] GET /identity/v3/roles/admin => generated 83 bytes in 95 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f719478f-2632-40c3-ab54-0fe6d12756ca None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f719478f-2632-40c3-ab54-0fe6d12756ca None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f719478f-2632-40c3-ab54-0fe6d12756ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc4564c-1d3d-4b1a-9d78-502e84226dda None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-f719478f-2632-40c3-ab54-0fe6d12756ca None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-f719478f-2632-40c3-ab54-0fe6d12756ca None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-f719478f-2632-40c3-ab54-0fe6d12756ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc4564c-1d3d-4b1a-9d78-502e84226dda None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 243/471] 10.27.203.238 () {58 vars in 1023 bytes} [Tue May 28 12:37:12 2024] POST /identity/v3/auth/tokens => generated 864 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d0a744-b460-46eb-883e-7e767bf96557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d0a744-b460-46eb-883e-7e767bf96557 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d0a744-b460-46eb-883e-7e767bf96557 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d0a744-b460-46eb-883e-7e767bf96557 None admin] PATH_INFO: `/v3/roles` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d0a744-b460-46eb-883e-7e767bf96557 None admin] RBAC: Adding query filter params (name=admin) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d0a744-b460-46eb-883e-7e767bf96557 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d0a744-b460-46eb-883e-7e767bf96557 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 229/472] 10.27.203.238 () {56 vars in 1099 bytes} [Tue May 28 12:37:12 2024] GET /identity/v3/roles?name=admin => generated 343 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f719478f-2632-40c3-ab54-0fe6d12756ca None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f719478f-2632-40c3-ab54-0fe6d12756ca None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ba8716-978b-46ef-9be2-c95e311d4e6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ba8716-978b-46ef-9be2-c95e311d4e6e None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ba8716-978b-46ef-9be2-c95e311d4e6e None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ba8716-978b-46ef-9be2-c95e311d4e6e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ba8716-978b-46ef-9be2-c95e311d4e6e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ba8716-978b-46ef-9be2-c95e311d4e6e None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-b8ba8716-978b-46ef-9be2-c95e311d4e6e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 244/473] 10.27.203.238 () {56 vars in 1108 bytes} [Tue May 28 12:37:12 2024] GET /identity/v3/domains/Default => generated 87 bytes in 100 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d0a744-b460-46eb-883e-7e767bf96557 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ba8716-978b-46ef-9be2-c95e311d4e6e None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d0a744-b460-46eb-883e-7e767bf96557 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd52154-2d21-4786-9597-419d8edac8ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd52154-2d21-4786-9597-419d8edac8ca None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd52154-2d21-4786-9597-419d8edac8ca None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd52154-2d21-4786-9597-419d8edac8ca None admin] PATH_INFO: `/v3/domains` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd52154-2d21-4786-9597-419d8edac8ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd52154-2d21-4786-9597-419d8edac8ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd52154-2d21-4786-9597-419d8edac8ca None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 230/474] 10.27.203.238 () {56 vars in 1109 bytes} [Tue May 28 12:37:12 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd52154-2d21-4786-9597-419d8edac8ca None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ba8716-978b-46ef-9be2-c95e311d4e6e None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd52154-2d21-4786-9597-419d8edac8ca None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c79af97-0670-4e4b-a385-5407a8a53c8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c79af97-0670-4e4b-a385-5407a8a53c8a None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c79af97-0670-4e4b-a385-5407a8a53c8a None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c79af97-0670-4e4b-a385-5407a8a53c8a None admin] PATH_INFO: `/v3/services/image` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c79af97-0670-4e4b-a385-5407a8a53c8a None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c79af97-0670-4e4b-a385-5407a8a53c8a None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-7c79af97-0670-4e4b-a385-5407a8a53c8a None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 194, in get_service May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 189, in _get_service May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._get_service(service_id) May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 245/475] 10.27.203.238 () {56 vars in 1105 bytes} [Tue May 28 12:37:12 2024] GET /identity/v3/services/image => generated 86 bytes in 111 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c79af97-0670-4e4b-a385-5407a8a53c8a None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f875a57d-fd6f-4b07-9b14-c2738e6e29cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f875a57d-fd6f-4b07-9b14-c2738e6e29cb None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f875a57d-fd6f-4b07-9b14-c2738e6e29cb None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f875a57d-fd6f-4b07-9b14-c2738e6e29cb None admin] PATH_INFO: `/v3/users/nova` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f875a57d-fd6f-4b07-9b14-c2738e6e29cb None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f875a57d-fd6f-4b07-9b14-c2738e6e29cb None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-f875a57d-fd6f-4b07-9b14-c2738e6e29cb None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._get_user(user_id) May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 231/476] 10.27.203.238 () {56 vars in 1093 bytes} [Tue May 28 12:37:12 2024] GET /identity/v3/users/nova => generated 82 bytes in 87 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 28 12:37:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f875a57d-fd6f-4b07-9b14-c2738e6e29cb None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c79af97-0670-4e4b-a385-5407a8a53c8a None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f875a57d-fd6f-4b07-9b14-c2738e6e29cb None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da9ed1e-1826-478a-aced-49116102b351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da9ed1e-1826-478a-aced-49116102b351 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da9ed1e-1826-478a-aced-49116102b351 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da9ed1e-1826-478a-aced-49116102b351 None admin] PATH_INFO: `/v3/services` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da9ed1e-1826-478a-aced-49116102b351 None admin] RBAC: Adding query filter params (name=image) {{(pid=51267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da9ed1e-1826-478a-aced-49116102b351 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da9ed1e-1826-478a-aced-49116102b351 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401bb4fd-e065-4254-bf71-53c7b4235952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 246/477] 10.27.203.238 () {56 vars in 1108 bytes} [Tue May 28 12:37:12 2024] GET /identity/v3/services?name=image => generated 124 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401bb4fd-e065-4254-bf71-53c7b4235952 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401bb4fd-e065-4254-bf71-53c7b4235952 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401bb4fd-e065-4254-bf71-53c7b4235952 None admin] PATH_INFO: `/v3/users` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa8c95d-9133-4b41-a662-bb2ef39ba75e None None] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa8c95d-9133-4b41-a662-bb2ef39ba75e None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa8c95d-9133-4b41-a662-bb2ef39ba75e None None] PATH_INFO: `/` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401bb4fd-e065-4254-bf71-53c7b4235952 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401bb4fd-e065-4254-bf71-53c7b4235952 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 247/478] 10.27.203.238 () {54 vars in 926 bytes} [Tue May 28 12:37:13 2024] GET /identity => generated 272 bytes in 1 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401bb4fd-e065-4254-bf71-53c7b4235952 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa8c95d-9133-4b41-a662-bb2ef39ba75e None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 232/479] 10.27.203.238 () {56 vars in 1133 bytes} [Tue May 28 12:37:12 2024] GET /identity/v3/users?domain_id=default&name=nova => generated 372 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533cf82c-e332-4983-a4db-f93c50ac50cf None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533cf82c-e332-4983-a4db-f93c50ac50cf None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533cf82c-e332-4983-a4db-f93c50ac50cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-533cf82c-e332-4983-a4db-f93c50ac50cf None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-533cf82c-e332-4983-a4db-f93c50ac50cf None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-533cf82c-e332-4983-a4db-f93c50ac50cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa8c95d-9133-4b41-a662-bb2ef39ba75e None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 233/480] 10.27.203.238 () {58 vars in 1023 bytes} [Tue May 28 12:37:13 2024] POST /identity/v3/auth/tokens => generated 864 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533cf82c-e332-4983-a4db-f93c50ac50cf None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a633db39-7143-4dc3-ac2e-8f54ac114543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a633db39-7143-4dc3-ac2e-8f54ac114543 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a633db39-7143-4dc3-ac2e-8f54ac114543 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a633db39-7143-4dc3-ac2e-8f54ac114543 None admin] PATH_INFO: `/v3/services` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a633db39-7143-4dc3-ac2e-8f54ac114543 None admin] RBAC: Adding query filter params (type=image) {{(pid=51267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a633db39-7143-4dc3-ac2e-8f54ac114543 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a633db39-7143-4dc3-ac2e-8f54ac114543 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 248/481] 10.27.203.238 () {56 vars in 1108 bytes} [Tue May 28 12:37:13 2024] GET /identity/v3/services?type=image => generated 124 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ce659c-2b28-4bf0-93f7-7a39aa8f0b6b None None] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ce659c-2b28-4bf0-93f7-7a39aa8f0b6b None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ce659c-2b28-4bf0-93f7-7a39aa8f0b6b None None] PATH_INFO: `/` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 249/482] 10.27.203.238 () {54 vars in 926 bytes} [Tue May 28 12:37:13 2024] GET /identity => generated 272 bytes in 1 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad96f1a-1674-44bc-8b5f-49e6e5cc4ba2 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad96f1a-1674-44bc-8b5f-49e6e5cc4ba2 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad96f1a-1674-44bc-8b5f-49e6e5cc4ba2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-1ad96f1a-1674-44bc-8b5f-49e6e5cc4ba2 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-1ad96f1a-1674-44bc-8b5f-49e6e5cc4ba2 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-1ad96f1a-1674-44bc-8b5f-49e6e5cc4ba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533cf82c-e332-4983-a4db-f93c50ac50cf None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3580f254-1e71-44ff-825f-125ca68c965b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3580f254-1e71-44ff-825f-125ca68c965b None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3580f254-1e71-44ff-825f-125ca68c965b None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3580f254-1e71-44ff-825f-125ca68c965b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3580f254-1e71-44ff-825f-125ca68c965b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3580f254-1e71-44ff-825f-125ca68c965b None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-3580f254-1e71-44ff-825f-125ca68c965b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 234/483] 10.27.203.238 () {56 vars in 1108 bytes} [Tue May 28 12:37:13 2024] GET /identity/v3/domains/Default => generated 87 bytes in 90 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3580f254-1e71-44ff-825f-125ca68c965b None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 250/484] 10.27.203.238 () {58 vars in 1023 bytes} [Tue May 28 12:37:13 2024] POST /identity/v3/auth/tokens => generated 864 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 28 12:37:13 l75lg1-v1 dstat.sh[49771]: 28-05 12:37:13| 42 7 50 0 0|1723M 8011M 234M 5734M| 19k 86B| 0 7459k| 0 179 |7260 12k|2.33 1.11 0.73|5.0 0 0| 0 0 | 0 2048M| 19 30 0 8 0 May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3580f254-1e71-44ff-825f-125ca68c965b None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9edb97-144e-406f-b399-be519b9a2444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9edb97-144e-406f-b399-be519b9a2444 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9edb97-144e-406f-b399-be519b9a2444 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9edb97-144e-406f-b399-be519b9a2444 None admin] PATH_INFO: `/v3/domains` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9edb97-144e-406f-b399-be519b9a2444 None admin] RBAC: Adding query filter params (name=Default) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9edb97-144e-406f-b399-be519b9a2444 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9edb97-144e-406f-b399-be519b9a2444 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad96f1a-1674-44bc-8b5f-49e6e5cc4ba2 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 235/485] 10.27.203.238 () {56 vars in 1109 bytes} [Tue May 28 12:37:13 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9edb97-144e-406f-b399-be519b9a2444 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9edb97-144e-406f-b399-be519b9a2444 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad96f1a-1674-44bc-8b5f-49e6e5cc4ba2 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b229a6-f997-40e8-a8c7-bc55e36f0e0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b229a6-f997-40e8-a8c7-bc55e36f0e0f None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b229a6-f997-40e8-a8c7-bc55e36f0e0f None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b229a6-f997-40e8-a8c7-bc55e36f0e0f None admin] PATH_INFO: `/v3/projects/service` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b229a6-f997-40e8-a8c7-bc55e36f0e0f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b229a6-f997-40e8-a8c7-bc55e36f0e0f None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-02b229a6-f997-40e8-a8c7-bc55e36f0e0f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._get_project(project_id) May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7b9b1e-dce6-450e-8764-101bb2378216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7b9b1e-dce6-450e-8764-101bb2378216 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7b9b1e-dce6-450e-8764-101bb2378216 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 236/486] 10.27.203.238 () {56 vars in 1111 bytes} [Tue May 28 12:37:13 2024] GET /identity/v3/projects/service => generated 88 bytes in 91 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7b9b1e-dce6-450e-8764-101bb2378216 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7b9b1e-dce6-450e-8764-101bb2378216 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7b9b1e-dce6-450e-8764-101bb2378216 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b229a6-f997-40e8-a8c7-bc55e36f0e0f None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-0e7b9b1e-dce6-450e-8764-101bb2378216 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 194, in get_service May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 189, in _get_service May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._get_service(service_id) May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 251/487] 10.27.203.238 () {56 vars in 1129 bytes} [Tue May 28 12:37:13 2024] GET /identity/v3/services/block-storage => generated 94 bytes in 107 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7b9b1e-dce6-450e-8764-101bb2378216 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b229a6-f997-40e8-a8c7-bc55e36f0e0f None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7b9b1e-dce6-450e-8764-101bb2378216 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461df90f-1c09-4b80-9621-849e458f4060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461df90f-1c09-4b80-9621-849e458f4060 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461df90f-1c09-4b80-9621-849e458f4060 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461df90f-1c09-4b80-9621-849e458f4060 None admin] PATH_INFO: `/v3/services/network` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461df90f-1c09-4b80-9621-849e458f4060 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461df90f-1c09-4b80-9621-849e458f4060 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-461df90f-1c09-4b80-9621-849e458f4060 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 194, in get_service May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 189, in _get_service May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._get_service(service_id) May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 237/488] 10.27.203.238 () {56 vars in 1111 bytes} [Tue May 28 12:37:13 2024] GET /identity/v3/services/network => generated 88 bytes in 85 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461df90f-1c09-4b80-9621-849e458f4060 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea93ce07-38c3-43bc-a1c8-a181c15cad0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea93ce07-38c3-43bc-a1c8-a181c15cad0b None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea93ce07-38c3-43bc-a1c8-a181c15cad0b None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea93ce07-38c3-43bc-a1c8-a181c15cad0b None admin] PATH_INFO: `/v3/projects` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea93ce07-38c3-43bc-a1c8-a181c15cad0b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=51267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea93ce07-38c3-43bc-a1c8-a181c15cad0b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea93ce07-38c3-43bc-a1c8-a181c15cad0b None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 252/489] 10.27.203.238 () {56 vars in 1148 bytes} [Tue May 28 12:37:13 2024] GET /identity/v3/projects?domain_id=default&name=service => generated 433 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea93ce07-38c3-43bc-a1c8-a181c15cad0b None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461df90f-1c09-4b80-9621-849e458f4060 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbadf26-8e02-4db0-89bd-2df0190560e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbadf26-8e02-4db0-89bd-2df0190560e3 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbadf26-8e02-4db0-89bd-2df0190560e3 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbadf26-8e02-4db0-89bd-2df0190560e3 None admin] PATH_INFO: `/v3/services` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbadf26-8e02-4db0-89bd-2df0190560e3 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbadf26-8e02-4db0-89bd-2df0190560e3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbadf26-8e02-4db0-89bd-2df0190560e3 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 238/490] 10.27.203.238 () {56 vars in 1124 bytes} [Tue May 28 12:37:13 2024] GET /identity/v3/services?name=block-storage => generated 132 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbadf26-8e02-4db0-89bd-2df0190560e3 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea93ce07-38c3-43bc-a1c8-a181c15cad0b None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ed9979-061d-47eb-92de-5c854fd44567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ed9979-061d-47eb-92de-5c854fd44567 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ed9979-061d-47eb-92de-5c854fd44567 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ed9979-061d-47eb-92de-5c854fd44567 None admin] PATH_INFO: `/v3/services` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ed9979-061d-47eb-92de-5c854fd44567 None admin] RBAC: Adding query filter params (name=network) {{(pid=51267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ed9979-061d-47eb-92de-5c854fd44567 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ed9979-061d-47eb-92de-5c854fd44567 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 253/491] 10.27.203.238 () {56 vars in 1112 bytes} [Tue May 28 12:37:13 2024] GET /identity/v3/services?name=network => generated 126 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ed9979-061d-47eb-92de-5c854fd44567 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbadf26-8e02-4db0-89bd-2df0190560e3 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a25a8e-6b1b-4b59-9067-83e4587e8ad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a25a8e-6b1b-4b59-9067-83e4587e8ad1 None admin] REQUEST_METHOD: `PUT` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a25a8e-6b1b-4b59-9067-83e4587e8ad1 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a25a8e-6b1b-4b59-9067-83e4587e8ad1 None admin] PATH_INFO: `/v3/projects/98a6a2dcbf0248d5b353760f7757f713/users/befdd4414dc2432ab2baa1ae3fbffef7/roles/e7989893488f483baa107be56668c4f8` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a25a8e-6b1b-4b59-9067-83e4587e8ad1 None admin] RBAC: Authorizing `identity:create_grant(project_id=98a6a2dcbf0248d5b353760f7757f713, user_id=befdd4414dc2432ab2baa1ae3fbffef7, role_id=e7989893488f483baa107be56668c4f8)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a25a8e-6b1b-4b59-9067-83e4587e8ad1 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ed9979-061d-47eb-92de-5c854fd44567 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38990987-73fb-4a40-a204-ecb8be1efbe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38990987-73fb-4a40-a204-ecb8be1efbe9 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38990987-73fb-4a40-a204-ecb8be1efbe9 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38990987-73fb-4a40-a204-ecb8be1efbe9 None admin] PATH_INFO: `/v3/services` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38990987-73fb-4a40-a204-ecb8be1efbe9 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=51267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38990987-73fb-4a40-a204-ecb8be1efbe9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38990987-73fb-4a40-a204-ecb8be1efbe9 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 254/492] 10.27.203.238 () {56 vars in 1124 bytes} [Tue May 28 12:37:13 2024] GET /identity/v3/services?type=block-storage => generated 132 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38990987-73fb-4a40-a204-ecb8be1efbe9 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 239/493] 10.27.203.238 () {58 vars in 1439 bytes} [Tue May 28 12:37:13 2024] PUT /identity/v3/projects/98a6a2dcbf0248d5b353760f7757f713/users/befdd4414dc2432ab2baa1ae3fbffef7/roles/e7989893488f483baa107be56668c4f8 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38990987-73fb-4a40-a204-ecb8be1efbe9 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed2aa8f-6a1f-4c0d-af23-e97d6a3acfe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed2aa8f-6a1f-4c0d-af23-e97d6a3acfe1 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed2aa8f-6a1f-4c0d-af23-e97d6a3acfe1 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed2aa8f-6a1f-4c0d-af23-e97d6a3acfe1 None admin] PATH_INFO: `/v3/services` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed2aa8f-6a1f-4c0d-af23-e97d6a3acfe1 None admin] RBAC: Adding query filter params (type=network) {{(pid=51267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed2aa8f-6a1f-4c0d-af23-e97d6a3acfe1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed2aa8f-6a1f-4c0d-af23-e97d6a3acfe1 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:13 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 255/494] 10.27.203.238 () {56 vars in 1112 bytes} [Tue May 28 12:37:13 2024] GET /identity/v3/services?type=network => generated 126 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:37:14 l75lg1-v1 dstat.sh[49771]: 28-05 12:37:14| 42 6 52 0 0|1518M 8254M 234M 5702M| 20k 86B| 0 2029k| 0 34.0 |6846 11k|2.33 1.11 0.73|5.0 0 135| 0 0 | 0 2048M| 19 29 0 8 0 May 28 12:37:14 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1067054c-3052-47cc-b641-afbe0017b38b None None] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:14 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1067054c-3052-47cc-b641-afbe0017b38b None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:14 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1067054c-3052-47cc-b641-afbe0017b38b None None] PATH_INFO: `/` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:14 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 240/495] 10.27.203.238 () {54 vars in 926 bytes} [Tue May 28 12:37:14 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:37:14 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39895a4-0dfd-4f3a-ae63-a2bef0ca5d43 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:14 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39895a4-0dfd-4f3a-ae63-a2bef0ca5d43 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:14 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39895a4-0dfd-4f3a-ae63-a2bef0ca5d43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:14 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-b39895a4-0dfd-4f3a-ae63-a2bef0ca5d43 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:37:14 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-b39895a4-0dfd-4f3a-ae63-a2bef0ca5d43 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:37:14 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-b39895a4-0dfd-4f3a-ae63-a2bef0ca5d43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:37:14 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 256/496] 10.27.203.238 () {58 vars in 1023 bytes} [Tue May 28 12:37:14 2024] POST /identity/v3/auth/tokens => generated 864 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 28 12:37:14 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1067054c-3052-47cc-b641-afbe0017b38b None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:14 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1067054c-3052-47cc-b641-afbe0017b38b None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:14 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1fd2e5-e47b-4b2e-92ba-7b2672e8b046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:14 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1fd2e5-e47b-4b2e-92ba-7b2672e8b046 None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:14 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1fd2e5-e47b-4b2e-92ba-7b2672e8b046 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:14 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1fd2e5-e47b-4b2e-92ba-7b2672e8b046 None admin] PATH_INFO: `/v3/services` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:14 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1fd2e5-e47b-4b2e-92ba-7b2672e8b046 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:14 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1fd2e5-e47b-4b2e-92ba-7b2672e8b046 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:14 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 241/497] 10.27.203.238 () {60 vars in 1141 bytes} [Tue May 28 12:37:14 2024] POST /identity/v3/services => generated 244 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200c3d61-9caf-4fcb-a1af-568a3dc91591 None None] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200c3d61-9caf-4fcb-a1af-568a3dc91591 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200c3d61-9caf-4fcb-a1af-568a3dc91591 None None] PATH_INFO: `/` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 257/498] 10.27.203.238 () {54 vars in 926 bytes} [Tue May 28 12:37:15 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c4826f-cbe8-4d87-b77c-d8e63ccbe8a5 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c4826f-cbe8-4d87-b77c-d8e63ccbe8a5 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c4826f-cbe8-4d87-b77c-d8e63ccbe8a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-36c4826f-cbe8-4d87-b77c-d8e63ccbe8a5 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-36c4826f-cbe8-4d87-b77c-d8e63ccbe8a5 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-36c4826f-cbe8-4d87-b77c-d8e63ccbe8a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f5c8de-fc79-4bb8-8790-ac2ecf5be2ee None None] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f5c8de-fc79-4bb8-8790-ac2ecf5be2ee None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f5c8de-fc79-4bb8-8790-ac2ecf5be2ee None None] PATH_INFO: `/` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 258/499] 10.27.203.238 () {54 vars in 926 bytes} [Tue May 28 12:37:15 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9e00bf-476e-4111-b92c-3eb25ea2becb None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9e00bf-476e-4111-b92c-3eb25ea2becb None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9e00bf-476e-4111-b92c-3eb25ea2becb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-6a9e00bf-476e-4111-b92c-3eb25ea2becb None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-6a9e00bf-476e-4111-b92c-3eb25ea2becb None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 242/500] 10.27.203.238 () {58 vars in 1023 bytes} [Tue May 28 12:37:15 2024] POST /identity/v3/auth/tokens => generated 960 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-6a9e00bf-476e-4111-b92c-3eb25ea2becb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:37:15 l75lg1-v1 dstat.sh[49771]: 28-05 12:37:15| 45 4 49 0 0|1651M 8121M 234M 5703M| 20k 86B| 0 960k| 0 45.0 |3732 4473 |2.33 1.11 0.73|5.0 0 34| 0 0 | 0 2048M| 19 30 0 8 0 May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a2be85-9c16-42e0-8798-b856e8ff95a4 None None] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a2be85-9c16-42e0-8798-b856e8ff95a4 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a2be85-9c16-42e0-8798-b856e8ff95a4 None None] PATH_INFO: `/` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 243/501] 10.27.203.238 () {54 vars in 926 bytes} [Tue May 28 12:37:15 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69c6139-2879-42ba-afc8-d4e06403c137 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69c6139-2879-42ba-afc8-d4e06403c137 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69c6139-2879-42ba-afc8-d4e06403c137 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-c69c6139-2879-42ba-afc8-d4e06403c137 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-c69c6139-2879-42ba-afc8-d4e06403c137 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-c69c6139-2879-42ba-afc8-d4e06403c137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 259/502] 10.27.203.238 () {58 vars in 1023 bytes} [Tue May 28 12:37:15 2024] POST /identity/v3/auth/tokens => generated 960 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 244/503] 10.27.203.238 () {58 vars in 1023 bytes} [Tue May 28 12:37:15 2024] POST /identity/v3/auth/tokens => generated 960 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9e00bf-476e-4111-b92c-3eb25ea2becb None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9e00bf-476e-4111-b92c-3eb25ea2becb None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5f18e2-07af-421b-a979-e10cfb5926cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69c6139-2879-42ba-afc8-d4e06403c137 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5f18e2-07af-421b-a979-e10cfb5926cc None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5f18e2-07af-421b-a979-e10cfb5926cc None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5f18e2-07af-421b-a979-e10cfb5926cc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5f18e2-07af-421b-a979-e10cfb5926cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-de5f18e2-07af-421b-a979-e10cfb5926cc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._get_role(role_id) May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1281, in get_role May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 260/504] 10.27.203.238 () {56 vars in 1096 bytes} [Tue May 28 12:37:15 2024] GET /identity/v3/roles/admin => generated 83 bytes in 92 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5f18e2-07af-421b-a979-e10cfb5926cc None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5f18e2-07af-421b-a979-e10cfb5926cc None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69c6139-2879-42ba-afc8-d4e06403c137 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599f9e11-9754-45fb-a38d-2aec275fbaca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599f9e11-9754-45fb-a38d-2aec275fbaca None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599f9e11-9754-45fb-a38d-2aec275fbaca None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599f9e11-9754-45fb-a38d-2aec275fbaca None admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599f9e11-9754-45fb-a38d-2aec275fbaca None admin] RBAC: Adding query filter params (name=admin) {{(pid=51267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599f9e11-9754-45fb-a38d-2aec275fbaca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599f9e11-9754-45fb-a38d-2aec275fbaca None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df6b2c7-d398-4f89-8805-e6501bfe0f3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df6b2c7-d398-4f89-8805-e6501bfe0f3f None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df6b2c7-d398-4f89-8805-e6501bfe0f3f None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df6b2c7-d398-4f89-8805-e6501bfe0f3f None admin] PATH_INFO: `/v3/services` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df6b2c7-d398-4f89-8805-e6501bfe0f3f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df6b2c7-d398-4f89-8805-e6501bfe0f3f None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 261/505] 10.27.203.238 () {56 vars in 1099 bytes} [Tue May 28 12:37:15 2024] GET /identity/v3/roles?name=admin => generated 343 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599f9e11-9754-45fb-a38d-2aec275fbaca None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 245/506] 10.27.203.238 () {60 vars in 1141 bytes} [Tue May 28 12:37:15 2024] POST /identity/v3/services => generated 253 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df6b2c7-d398-4f89-8805-e6501bfe0f3f None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599f9e11-9754-45fb-a38d-2aec275fbaca None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df6b2c7-d398-4f89-8805-e6501bfe0f3f None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c4ca68-ac23-41bf-a3b9-74d730f72c6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c4ca68-ac23-41bf-a3b9-74d730f72c6c None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c4ca68-ac23-41bf-a3b9-74d730f72c6c None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c4ca68-ac23-41bf-a3b9-74d730f72c6c None admin] PATH_INFO: `/v3/services` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c4ca68-ac23-41bf-a3b9-74d730f72c6c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c4ca68-ac23-41bf-a3b9-74d730f72c6c None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee4d76a-486c-4411-89ca-5ad1eee20efa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee4d76a-486c-4411-89ca-5ad1eee20efa None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee4d76a-486c-4411-89ca-5ad1eee20efa None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee4d76a-486c-4411-89ca-5ad1eee20efa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 262/507] 10.27.203.238 () {60 vars in 1141 bytes} [Tue May 28 12:37:15 2024] POST /identity/v3/services => generated 242 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee4d76a-486c-4411-89ca-5ad1eee20efa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee4d76a-486c-4411-89ca-5ad1eee20efa None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-1ee4d76a-486c-4411-89ca-5ad1eee20efa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 246/508] 10.27.203.238 () {56 vars in 1108 bytes} [Tue May 28 12:37:15 2024] GET /identity/v3/domains/Default => generated 87 bytes in 111 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c4ca68-ac23-41bf-a3b9-74d730f72c6c None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c4ca68-ac23-41bf-a3b9-74d730f72c6c None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdd912b-ba38-4693-941c-53dfc2a79fd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdd912b-ba38-4693-941c-53dfc2a79fd2 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdd912b-ba38-4693-941c-53dfc2a79fd2 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdd912b-ba38-4693-941c-53dfc2a79fd2 None admin] PATH_INFO: `/v3/domains` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdd912b-ba38-4693-941c-53dfc2a79fd2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=51267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdd912b-ba38-4693-941c-53dfc2a79fd2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdd912b-ba38-4693-941c-53dfc2a79fd2 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 263/509] 10.27.203.238 () {56 vars in 1109 bytes} [Tue May 28 12:37:15 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee4d76a-486c-4411-89ca-5ad1eee20efa None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee4d76a-486c-4411-89ca-5ad1eee20efa None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6c73fe-8bf2-48d5-ad51-416dc756e5ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6c73fe-8bf2-48d5-ad51-416dc756e5ea None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6c73fe-8bf2-48d5-ad51-416dc756e5ea None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6c73fe-8bf2-48d5-ad51-416dc756e5ea None admin] PATH_INFO: `/v3/users/nova` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6c73fe-8bf2-48d5-ad51-416dc756e5ea None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6c73fe-8bf2-48d5-ad51-416dc756e5ea None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-ff6c73fe-8bf2-48d5-ad51-416dc756e5ea None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._get_user(user_id) May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 247/510] 10.27.203.238 () {56 vars in 1093 bytes} [Tue May 28 12:37:15 2024] GET /identity/v3/users/nova => generated 82 bytes in 98 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdd912b-ba38-4693-941c-53dfc2a79fd2 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdd912b-ba38-4693-941c-53dfc2a79fd2 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8836987b-db62-4059-b3ee-6e819c7f4e5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8836987b-db62-4059-b3ee-6e819c7f4e5b None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8836987b-db62-4059-b3ee-6e819c7f4e5b None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8836987b-db62-4059-b3ee-6e819c7f4e5b None admin] PATH_INFO: `/v3/users` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8836987b-db62-4059-b3ee-6e819c7f4e5b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=51267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8836987b-db62-4059-b3ee-6e819c7f4e5b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8836987b-db62-4059-b3ee-6e819c7f4e5b None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 264/511] 10.27.203.238 () {56 vars in 1133 bytes} [Tue May 28 12:37:15 2024] GET /identity/v3/users?domain_id=default&name=nova => generated 372 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6c73fe-8bf2-48d5-ad51-416dc756e5ea None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6c73fe-8bf2-48d5-ad51-416dc756e5ea None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9089c563-9c0a-4cbf-a994-73f5756d17c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9089c563-9c0a-4cbf-a994-73f5756d17c3 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9089c563-9c0a-4cbf-a994-73f5756d17c3 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9089c563-9c0a-4cbf-a994-73f5756d17c3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9089c563-9c0a-4cbf-a994-73f5756d17c3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9089c563-9c0a-4cbf-a994-73f5756d17c3 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 248/512] 10.27.203.238 () {58 vars in 1282 bytes} [Tue May 28 12:37:16 2024] GET /identity/v3/auth/tokens => generated 1163 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8836987b-db62-4059-b3ee-6e819c7f4e5b None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:16 l75lg1-v1 dstat.sh[49771]: 28-05 12:37:16| 54 10 34 0 0|1581M 8177M 234M 5716M| 18k 86B| 720k 2958k|19.0 62.0 | 12k 22k|2.63 1.19 0.76|5.0 0 444| 0 0 | 0 2048M| 19 30 0 8 0 May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8836987b-db62-4059-b3ee-6e819c7f4e5b None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98b091a-c09f-4e3f-b8ee-0839caca9a9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98b091a-c09f-4e3f-b8ee-0839caca9a9e None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98b091a-c09f-4e3f-b8ee-0839caca9a9e None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98b091a-c09f-4e3f-b8ee-0839caca9a9e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98b091a-c09f-4e3f-b8ee-0839caca9a9e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98b091a-c09f-4e3f-b8ee-0839caca9a9e None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-b98b091a-c09f-4e3f-b8ee-0839caca9a9e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 265/513] 10.27.203.238 () {56 vars in 1108 bytes} [Tue May 28 12:37:16 2024] GET /identity/v3/domains/Default => generated 87 bytes in 125 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9089c563-9c0a-4cbf-a994-73f5756d17c3 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9089c563-9c0a-4cbf-a994-73f5756d17c3 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c72a592-5684-46bc-aa5c-55ff2acc9cf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c72a592-5684-46bc-aa5c-55ff2acc9cf7 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c72a592-5684-46bc-aa5c-55ff2acc9cf7 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c72a592-5684-46bc-aa5c-55ff2acc9cf7 None admin] PATH_INFO: `/v3/domains` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c72a592-5684-46bc-aa5c-55ff2acc9cf7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c72a592-5684-46bc-aa5c-55ff2acc9cf7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c72a592-5684-46bc-aa5c-55ff2acc9cf7 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 249/514] 10.27.203.238 () {56 vars in 1109 bytes} [Tue May 28 12:37:16 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98b091a-c09f-4e3f-b8ee-0839caca9a9e None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98b091a-c09f-4e3f-b8ee-0839caca9a9e None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da56c8ab-ac6d-4276-8fe9-8f99e30a6cdc None None] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da56c8ab-ac6d-4276-8fe9-8f99e30a6cdc None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da56c8ab-ac6d-4276-8fe9-8f99e30a6cdc None None] PATH_INFO: `/` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 250/515] 10.27.203.238 () {54 vars in 926 bytes} [Tue May 28 12:37:16 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f7e0cc-6e9b-49f1-9999-86cbf99f420f None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f7e0cc-6e9b-49f1-9999-86cbf99f420f None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f7e0cc-6e9b-49f1-9999-86cbf99f420f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835a447d-86c1-497c-939f-dbb7c07c26ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835a447d-86c1-497c-939f-dbb7c07c26ce None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835a447d-86c1-497c-939f-dbb7c07c26ce None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835a447d-86c1-497c-939f-dbb7c07c26ce None admin] PATH_INFO: `/v3/projects/service` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835a447d-86c1-497c-939f-dbb7c07c26ce None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835a447d-86c1-497c-939f-dbb7c07c26ce None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-c5f7e0cc-6e9b-49f1-9999-86cbf99f420f None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-c5f7e0cc-6e9b-49f1-9999-86cbf99f420f None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-c5f7e0cc-6e9b-49f1-9999-86cbf99f420f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-835a447d-86c1-497c-939f-dbb7c07c26ce None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._get_project(project_id) May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 266/516] 10.27.203.238 () {56 vars in 1111 bytes} [Tue May 28 12:37:16 2024] GET /identity/v3/projects/service => generated 88 bytes in 96 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835a447d-86c1-497c-939f-dbb7c07c26ce None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 251/517] 10.27.203.238 () {58 vars in 1023 bytes} [Tue May 28 12:37:16 2024] POST /identity/v3/auth/tokens => generated 1163 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835a447d-86c1-497c-939f-dbb7c07c26ce None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ba0a89-16d5-4ba6-8cc1-4d8481adf8bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ba0a89-16d5-4ba6-8cc1-4d8481adf8bd None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ba0a89-16d5-4ba6-8cc1-4d8481adf8bd None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ba0a89-16d5-4ba6-8cc1-4d8481adf8bd None admin] PATH_INFO: `/v3/projects` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ba0a89-16d5-4ba6-8cc1-4d8481adf8bd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=51267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ba0a89-16d5-4ba6-8cc1-4d8481adf8bd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ba0a89-16d5-4ba6-8cc1-4d8481adf8bd None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 267/518] 10.27.203.238 () {56 vars in 1148 bytes} [Tue May 28 12:37:16 2024] GET /identity/v3/projects?domain_id=default&name=service => generated 433 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f7e0cc-6e9b-49f1-9999-86cbf99f420f None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f7e0cc-6e9b-49f1-9999-86cbf99f420f None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe0527c-655d-4050-84c5-8d4c233a7137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe0527c-655d-4050-84c5-8d4c233a7137 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe0527c-655d-4050-84c5-8d4c233a7137 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe0527c-655d-4050-84c5-8d4c233a7137 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe0527c-655d-4050-84c5-8d4c233a7137 None admin] RBAC: Adding query filter params (role.id=e7989893488f483baa107be56668c4f8, scope.project.id=98a6a2dcbf0248d5b353760f7757f713, user.id=befdd4414dc2432ab2baa1ae3fbffef7) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe0527c-655d-4050-84c5-8d4c233a7137 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe0527c-655d-4050-84c5-8d4c233a7137 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 252/519] 10.27.203.238 () {56 vars in 1374 bytes} [Tue May 28 12:37:16 2024] GET /identity/v3/role_assignments?user.id=befdd4414dc2432ab2baa1ae3fbffef7&scope.project.id=98a6a2dcbf0248d5b353760f7757f713&role.id=e7989893488f483baa107be56668c4f8 => generated 612 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ba0a89-16d5-4ba6-8cc1-4d8481adf8bd None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ba0a89-16d5-4ba6-8cc1-4d8481adf8bd None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38d1cc6-e56f-4658-8ac2-c9fa674c6b61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38d1cc6-e56f-4658-8ac2-c9fa674c6b61 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38d1cc6-e56f-4658-8ac2-c9fa674c6b61 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38d1cc6-e56f-4658-8ac2-c9fa674c6b61 None admin] PATH_INFO: `/v3/services/image` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38d1cc6-e56f-4658-8ac2-c9fa674c6b61 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38d1cc6-e56f-4658-8ac2-c9fa674c6b61 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-a38d1cc6-e56f-4658-8ac2-c9fa674c6b61 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 194, in get_service May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 189, in _get_service May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._get_service(service_id) May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 268/520] 10.27.203.238 () {56 vars in 1105 bytes} [Tue May 28 12:37:16 2024] GET /identity/v3/services/image => generated 86 bytes in 87 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe0527c-655d-4050-84c5-8d4c233a7137 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe0527c-655d-4050-84c5-8d4c233a7137 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19f350f-7194-4370-a6b3-cf61d4e9c49b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19f350f-7194-4370-a6b3-cf61d4e9c49b None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19f350f-7194-4370-a6b3-cf61d4e9c49b None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19f350f-7194-4370-a6b3-cf61d4e9c49b None admin] PATH_INFO: `/v3/services` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19f350f-7194-4370-a6b3-cf61d4e9c49b None admin] RBAC: Adding query filter params (name=image) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19f350f-7194-4370-a6b3-cf61d4e9c49b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19f350f-7194-4370-a6b3-cf61d4e9c49b None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 253/521] 10.27.203.238 () {56 vars in 1108 bytes} [Tue May 28 12:37:16 2024] GET /identity/v3/services?name=image => generated 124 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:37:16 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38d1cc6-e56f-4658-8ac2-c9fa674c6b61 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38d1cc6-e56f-4658-8ac2-c9fa674c6b61 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d206c80e-bf9d-43d3-9665-a5f77d550211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d206c80e-bf9d-43d3-9665-a5f77d550211 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d206c80e-bf9d-43d3-9665-a5f77d550211 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d206c80e-bf9d-43d3-9665-a5f77d550211 None admin] PATH_INFO: `/v3/services` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d206c80e-bf9d-43d3-9665-a5f77d550211 None admin] RBAC: Adding query filter params (type=image) {{(pid=51267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d206c80e-bf9d-43d3-9665-a5f77d550211 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d206c80e-bf9d-43d3-9665-a5f77d550211 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 269/522] 10.27.203.238 () {56 vars in 1108 bytes} [Tue May 28 12:37:16 2024] GET /identity/v3/services?type=image => generated 354 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19f350f-7194-4370-a6b3-cf61d4e9c49b None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19f350f-7194-4370-a6b3-cf61d4e9c49b None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93fcaba-9a36-4de3-8b08-7e46c59ed95f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93fcaba-9a36-4de3-8b08-7e46c59ed95f None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93fcaba-9a36-4de3-8b08-7e46c59ed95f None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93fcaba-9a36-4de3-8b08-7e46c59ed95f None admin] PATH_INFO: `/v3/endpoints` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93fcaba-9a36-4de3-8b08-7e46c59ed95f None admin] RBAC: Adding query filter params (interface=public, service_id=b5d296eb68964f14a9e57eb9d15e174d, region_id=RegionOne) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93fcaba-9a36-4de3-8b08-7e46c59ed95f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93fcaba-9a36-4de3-8b08-7e46c59ed95f None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 254/523] 10.27.203.238 () {56 vars in 1251 bytes} [Tue May 28 12:37:17 2024] GET /identity/v3/endpoints?service_id=b5d296eb68964f14a9e57eb9d15e174d&interface=public®ion_id=RegionOne => generated 196 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d206c80e-bf9d-43d3-9665-a5f77d550211 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca212d6-0d5f-4ad7-b73e-7dbfe0820e17 None None] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca212d6-0d5f-4ad7-b73e-7dbfe0820e17 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca212d6-0d5f-4ad7-b73e-7dbfe0820e17 None None] PATH_INFO: `/` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 255/524] 10.27.203.238 () {54 vars in 926 bytes} [Tue May 28 12:37:17 2024] GET /identity => generated 272 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae362673-c565-4115-bcec-ee8e947900b0 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae362673-c565-4115-bcec-ee8e947900b0 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae362673-c565-4115-bcec-ee8e947900b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-ae362673-c565-4115-bcec-ee8e947900b0 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-ae362673-c565-4115-bcec-ee8e947900b0 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-ae362673-c565-4115-bcec-ee8e947900b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d206c80e-bf9d-43d3-9665-a5f77d550211 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6eb7a6-26a9-4a38-aebc-8998f858443a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6eb7a6-26a9-4a38-aebc-8998f858443a None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6eb7a6-26a9-4a38-aebc-8998f858443a None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6eb7a6-26a9-4a38-aebc-8998f858443a None admin] PATH_INFO: `/v3/services` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6eb7a6-26a9-4a38-aebc-8998f858443a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6eb7a6-26a9-4a38-aebc-8998f858443a None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 270/525] 10.27.203.238 () {56 vars in 1087 bytes} [Tue May 28 12:37:17 2024] GET /identity/v3/services => generated 1012 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7387db-d23e-473a-bc3f-6a1708a74dcc None None] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7387db-d23e-473a-bc3f-6a1708a74dcc None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7387db-d23e-473a-bc3f-6a1708a74dcc None None] PATH_INFO: `/` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 271/526] 10.27.203.238 () {54 vars in 926 bytes} [Tue May 28 12:37:17 2024] GET /identity => generated 272 bytes in 1 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df7e753-2ff4-4aa7-a528-476cd50d5ffe None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df7e753-2ff4-4aa7-a528-476cd50d5ffe None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df7e753-2ff4-4aa7-a528-476cd50d5ffe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 256/527] 10.27.203.238 () {58 vars in 1023 bytes} [Tue May 28 12:37:17 2024] POST /identity/v3/auth/tokens => generated 1163 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-6df7e753-2ff4-4aa7-a528-476cd50d5ffe None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-6df7e753-2ff4-4aa7-a528-476cd50d5ffe None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-6df7e753-2ff4-4aa7-a528-476cd50d5ffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:37:17 l75lg1-v1 dstat.sh[49771]: 28-05 12:37:17| 38 5 56 0 0|1620M 8137M 234M 5717M| 19k 490B| 0 316k| 0 13.0 |7127 11k|2.63 1.19 0.76|4.0 0 130| 0 0 | 0 2048M| 19 30 0 8 0 May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 272/528] 10.27.203.238 () {58 vars in 1023 bytes} [Tue May 28 12:37:17 2024] POST /identity/v3/auth/tokens => generated 1163 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae362673-c565-4115-bcec-ee8e947900b0 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df7e753-2ff4-4aa7-a528-476cd50d5ffe None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae362673-c565-4115-bcec-ee8e947900b0 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae66bb12-ce0e-4aae-b6c8-730666cc8151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae66bb12-ce0e-4aae-b6c8-730666cc8151 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae66bb12-ce0e-4aae-b6c8-730666cc8151 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae66bb12-ce0e-4aae-b6c8-730666cc8151 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae66bb12-ce0e-4aae-b6c8-730666cc8151 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae66bb12-ce0e-4aae-b6c8-730666cc8151 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-ae66bb12-ce0e-4aae-b6c8-730666cc8151 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 194, in get_service May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 189, in _get_service May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._get_service(service_id) May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 257/529] 10.27.203.238 () {56 vars in 1129 bytes} [Tue May 28 12:37:17 2024] GET /identity/v3/services/block-storage => generated 94 bytes in 88 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae66bb12-ce0e-4aae-b6c8-730666cc8151 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df7e753-2ff4-4aa7-a528-476cd50d5ffe None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfe9595-00a2-40a6-a3f2-cccb2747e9ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfe9595-00a2-40a6-a3f2-cccb2747e9ed None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfe9595-00a2-40a6-a3f2-cccb2747e9ed None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfe9595-00a2-40a6-a3f2-cccb2747e9ed None admin] PATH_INFO: `/v3/services/network` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfe9595-00a2-40a6-a3f2-cccb2747e9ed None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfe9595-00a2-40a6-a3f2-cccb2747e9ed None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-9bfe9595-00a2-40a6-a3f2-cccb2747e9ed None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 194, in get_service May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 189, in _get_service May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._get_service(service_id) May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 273/530] 10.27.203.238 () {56 vars in 1111 bytes} [Tue May 28 12:37:17 2024] GET /identity/v3/services/network => generated 88 bytes in 90 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfe9595-00a2-40a6-a3f2-cccb2747e9ed None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae66bb12-ce0e-4aae-b6c8-730666cc8151 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7c1d07-4403-428c-8bc3-16925a539f1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7c1d07-4403-428c-8bc3-16925a539f1f None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7c1d07-4403-428c-8bc3-16925a539f1f None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7c1d07-4403-428c-8bc3-16925a539f1f None admin] PATH_INFO: `/v3/services` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7c1d07-4403-428c-8bc3-16925a539f1f None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7c1d07-4403-428c-8bc3-16925a539f1f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7c1d07-4403-428c-8bc3-16925a539f1f None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 258/531] 10.27.203.238 () {56 vars in 1124 bytes} [Tue May 28 12:37:17 2024] GET /identity/v3/services?name=block-storage => generated 132 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7c1d07-4403-428c-8bc3-16925a539f1f None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfe9595-00a2-40a6-a3f2-cccb2747e9ed None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d095a7e9-e834-4450-a106-042345440e78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d095a7e9-e834-4450-a106-042345440e78 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d095a7e9-e834-4450-a106-042345440e78 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d095a7e9-e834-4450-a106-042345440e78 None admin] PATH_INFO: `/v3/services` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d095a7e9-e834-4450-a106-042345440e78 None admin] RBAC: Adding query filter params (name=network) {{(pid=51267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d095a7e9-e834-4450-a106-042345440e78 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d095a7e9-e834-4450-a106-042345440e78 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 274/532] 10.27.203.238 () {56 vars in 1112 bytes} [Tue May 28 12:37:17 2024] GET /identity/v3/services?name=network => generated 126 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d095a7e9-e834-4450-a106-042345440e78 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7c1d07-4403-428c-8bc3-16925a539f1f None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237f9fa7-9227-420a-a6ab-194c5ecdb37f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237f9fa7-9227-420a-a6ab-194c5ecdb37f None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237f9fa7-9227-420a-a6ab-194c5ecdb37f None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237f9fa7-9227-420a-a6ab-194c5ecdb37f None admin] PATH_INFO: `/v3/services` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237f9fa7-9227-420a-a6ab-194c5ecdb37f None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237f9fa7-9227-420a-a6ab-194c5ecdb37f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237f9fa7-9227-420a-a6ab-194c5ecdb37f None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 259/533] 10.27.203.238 () {56 vars in 1124 bytes} [Tue May 28 12:37:17 2024] GET /identity/v3/services?type=block-storage => generated 371 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237f9fa7-9227-420a-a6ab-194c5ecdb37f None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d095a7e9-e834-4450-a106-042345440e78 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323abd4e-fa2c-4f0d-af4f-39154607be6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323abd4e-fa2c-4f0d-af4f-39154607be6e None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323abd4e-fa2c-4f0d-af4f-39154607be6e None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323abd4e-fa2c-4f0d-af4f-39154607be6e None admin] PATH_INFO: `/v3/services` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323abd4e-fa2c-4f0d-af4f-39154607be6e None admin] RBAC: Adding query filter params (type=network) {{(pid=51267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323abd4e-fa2c-4f0d-af4f-39154607be6e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323abd4e-fa2c-4f0d-af4f-39154607be6e None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 275/534] 10.27.203.238 () {56 vars in 1112 bytes} [Tue May 28 12:37:17 2024] GET /identity/v3/services?type=network => generated 354 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323abd4e-fa2c-4f0d-af4f-39154607be6e None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237f9fa7-9227-420a-a6ab-194c5ecdb37f None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bea146-a0e1-405f-ace4-d8f174820822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bea146-a0e1-405f-ace4-d8f174820822 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bea146-a0e1-405f-ace4-d8f174820822 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bea146-a0e1-405f-ace4-d8f174820822 None admin] PATH_INFO: `/v3/endpoints` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bea146-a0e1-405f-ace4-d8f174820822 None admin] RBAC: Adding query filter params (interface=public, service_id=33e789382223405fb6cbdd9b7ac22b21, region_id=RegionOne) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bea146-a0e1-405f-ace4-d8f174820822 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bea146-a0e1-405f-ace4-d8f174820822 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 260/535] 10.27.203.238 () {56 vars in 1251 bytes} [Tue May 28 12:37:17 2024] GET /identity/v3/endpoints?service_id=33e789382223405fb6cbdd9b7ac22b21&interface=public®ion_id=RegionOne => generated 196 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bea146-a0e1-405f-ace4-d8f174820822 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323abd4e-fa2c-4f0d-af4f-39154607be6e None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949b15e0-548f-4ca3-9916-7b54ac5d6b75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949b15e0-548f-4ca3-9916-7b54ac5d6b75 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949b15e0-548f-4ca3-9916-7b54ac5d6b75 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949b15e0-548f-4ca3-9916-7b54ac5d6b75 None admin] PATH_INFO: `/v3/endpoints` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949b15e0-548f-4ca3-9916-7b54ac5d6b75 None admin] RBAC: Adding query filter params (interface=public, service_id=9ec398e4f8384ff5a97c1d2925ef6725, region_id=RegionOne) {{(pid=51267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949b15e0-548f-4ca3-9916-7b54ac5d6b75 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949b15e0-548f-4ca3-9916-7b54ac5d6b75 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 276/536] 10.27.203.238 () {56 vars in 1251 bytes} [Tue May 28 12:37:17 2024] GET /identity/v3/endpoints?service_id=9ec398e4f8384ff5a97c1d2925ef6725&interface=public®ion_id=RegionOne => generated 196 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bea146-a0e1-405f-ace4-d8f174820822 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949b15e0-548f-4ca3-9916-7b54ac5d6b75 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d93b37d-02f0-4bc3-b370-c737bcfaa2c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d93b37d-02f0-4bc3-b370-c737bcfaa2c9 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d93b37d-02f0-4bc3-b370-c737bcfaa2c9 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d93b37d-02f0-4bc3-b370-c737bcfaa2c9 None admin] PATH_INFO: `/v3/services` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d93b37d-02f0-4bc3-b370-c737bcfaa2c9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d93b37d-02f0-4bc3-b370-c737bcfaa2c9 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 261/537] 10.27.203.238 () {56 vars in 1087 bytes} [Tue May 28 12:37:17 2024] GET /identity/v3/services => generated 1012 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949b15e0-548f-4ca3-9916-7b54ac5d6b75 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da64e929-bff7-4f91-88ea-8f4a44037610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da64e929-bff7-4f91-88ea-8f4a44037610 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da64e929-bff7-4f91-88ea-8f4a44037610 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da64e929-bff7-4f91-88ea-8f4a44037610 None admin] PATH_INFO: `/v3/services` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da64e929-bff7-4f91-88ea-8f4a44037610 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da64e929-bff7-4f91-88ea-8f4a44037610 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:17 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 277/538] 10.27.203.238 () {56 vars in 1087 bytes} [Tue May 28 12:37:17 2024] GET /identity/v3/services => generated 1012 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 28 12:37:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b80c161-43fa-4bbf-9010-192e1e6f0ba4 None None] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b80c161-43fa-4bbf-9010-192e1e6f0ba4 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b80c161-43fa-4bbf-9010-192e1e6f0ba4 None None] PATH_INFO: `/` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:18 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 262/539] 10.27.203.238 () {54 vars in 926 bytes} [Tue May 28 12:37:18 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:37:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a67fff-bdc9-48c5-b923-db6158f368d7 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a67fff-bdc9-48c5-b923-db6158f368d7 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a67fff-bdc9-48c5-b923-db6158f368d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:18 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-e8a67fff-bdc9-48c5-b923-db6158f368d7 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:37:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-e8a67fff-bdc9-48c5-b923-db6158f368d7 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:37:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-e8a67fff-bdc9-48c5-b923-db6158f368d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:37:18 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 278/540] 10.27.203.238 () {58 vars in 1023 bytes} [Tue May 28 12:37:18 2024] POST /identity/v3/auth/tokens => generated 1163 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 12:37:18 l75lg1-v1 dstat.sh[49771]: 28-05 12:37:18| 37 4 59 0 0|1539M 8217M 234M 5717M| 24k 258B| 0 156k| 0 9.99 |6806 11k|2.63 1.19 0.76|4.0 0 77| 0 0 | 0 2048M| 19 29 0 8 0 May 28 12:37:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b80c161-43fa-4bbf-9010-192e1e6f0ba4 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b80c161-43fa-4bbf-9010-192e1e6f0ba4 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6991df-da65-470a-a568-bf3a9ce5ae9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6991df-da65-470a-a568-bf3a9ce5ae9c None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6991df-da65-470a-a568-bf3a9ce5ae9c None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6991df-da65-470a-a568-bf3a9ce5ae9c None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6991df-da65-470a-a568-bf3a9ce5ae9c None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6991df-da65-470a-a568-bf3a9ce5ae9c None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-af6991df-da65-470a-a568-bf3a9ce5ae9c None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 28 12:37:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:37:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 28 12:37:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 28 12:37:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 194, in get_service May 28 12:37:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 28 12:37:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 189, in _get_service May 28 12:37:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 28 12:37:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 28 12:37:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 12:37:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 28 12:37:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 12:37:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:37:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:37:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:37:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:37:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:37:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:37:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:37:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:37:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:37:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:37:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:37:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 28 12:37:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._get_service(service_id) May 28 12:37:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 28 12:37:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 28 12:37:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:37:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:37:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:37:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:37:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:37:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:37:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:37:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 12:37:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:37:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 12:37:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:37:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:37:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:37:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 12:37:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:37:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 12:37:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 28 12:37:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 28 12:37:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 28 12:37:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 12:37:18 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 263/541] 10.27.203.238 () {56 vars in 1132 bytes} [Tue May 28 12:37:18 2024] GET /identity/v3/services/compute_legacy => generated 95 bytes in 86 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 28 12:37:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a67fff-bdc9-48c5-b923-db6158f368d7 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a67fff-bdc9-48c5-b923-db6158f368d7 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d29430-c099-4255-a645-025b997ee364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d29430-c099-4255-a645-025b997ee364 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d29430-c099-4255-a645-025b997ee364 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d29430-c099-4255-a645-025b997ee364 None admin] PATH_INFO: `/v3/services` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d29430-c099-4255-a645-025b997ee364 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=51267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:37:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d29430-c099-4255-a645-025b997ee364 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d29430-c099-4255-a645-025b997ee364 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:18 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 279/542] 10.27.203.238 () {56 vars in 1126 bytes} [Tue May 28 12:37:18 2024] GET /identity/v3/services?name=compute_legacy => generated 133 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:37:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6991df-da65-470a-a568-bf3a9ce5ae9c None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6991df-da65-470a-a568-bf3a9ce5ae9c None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba3cda4-e164-4c6c-b4a2-2da956b85e90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba3cda4-e164-4c6c-b4a2-2da956b85e90 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba3cda4-e164-4c6c-b4a2-2da956b85e90 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba3cda4-e164-4c6c-b4a2-2da956b85e90 None admin] PATH_INFO: `/v3/services` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba3cda4-e164-4c6c-b4a2-2da956b85e90 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:37:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba3cda4-e164-4c6c-b4a2-2da956b85e90 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba3cda4-e164-4c6c-b4a2-2da956b85e90 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:18 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 264/543] 10.27.203.238 () {56 vars in 1126 bytes} [Tue May 28 12:37:18 2024] GET /identity/v3/services?type=compute_legacy => generated 133 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:37:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d8744b-4355-414a-a2bc-7f789a1506a4 None None] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d8744b-4355-414a-a2bc-7f789a1506a4 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d8744b-4355-414a-a2bc-7f789a1506a4 None None] PATH_INFO: `/` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:18 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 280/544] 10.27.203.238 () {54 vars in 926 bytes} [Tue May 28 12:37:18 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:37:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fa92a7-65c4-40b1-930f-65bf7f5b258f None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fa92a7-65c4-40b1-930f-65bf7f5b258f None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fa92a7-65c4-40b1-930f-65bf7f5b258f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:18 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-98fa92a7-65c4-40b1-930f-65bf7f5b258f None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:37:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-98fa92a7-65c4-40b1-930f-65bf7f5b258f None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:37:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-98fa92a7-65c4-40b1-930f-65bf7f5b258f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:37:18 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 265/545] 10.27.203.238 () {58 vars in 1023 bytes} [Tue May 28 12:37:18 2024] POST /identity/v3/auth/tokens => generated 1163 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 12:37:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d8744b-4355-414a-a2bc-7f789a1506a4 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d8744b-4355-414a-a2bc-7f789a1506a4 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d79798f-b8f9-44ba-a497-43774d72d81d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d79798f-b8f9-44ba-a497-43774d72d81d None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d79798f-b8f9-44ba-a497-43774d72d81d None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d79798f-b8f9-44ba-a497-43774d72d81d None admin] PATH_INFO: `/v3/services/image` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d79798f-b8f9-44ba-a497-43774d72d81d None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d79798f-b8f9-44ba-a497-43774d72d81d None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-8d79798f-b8f9-44ba-a497-43774d72d81d None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 194, in get_service May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 189, in _get_service May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._get_service(service_id) May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 281/546] 10.27.203.238 () {56 vars in 1105 bytes} [Tue May 28 12:37:18 2024] GET /identity/v3/services/image => generated 86 bytes in 86 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fa92a7-65c4-40b1-930f-65bf7f5b258f None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fa92a7-65c4-40b1-930f-65bf7f5b258f None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70543ad1-c4e7-4fec-9507-dd11b6957222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70543ad1-c4e7-4fec-9507-dd11b6957222 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70543ad1-c4e7-4fec-9507-dd11b6957222 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70543ad1-c4e7-4fec-9507-dd11b6957222 None admin] PATH_INFO: `/v3/services` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70543ad1-c4e7-4fec-9507-dd11b6957222 None admin] RBAC: Adding query filter params (name=image) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70543ad1-c4e7-4fec-9507-dd11b6957222 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70543ad1-c4e7-4fec-9507-dd11b6957222 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 266/547] 10.27.203.238 () {56 vars in 1108 bytes} [Tue May 28 12:37:19 2024] GET /identity/v3/services?name=image => generated 124 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d79798f-b8f9-44ba-a497-43774d72d81d None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d79798f-b8f9-44ba-a497-43774d72d81d None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7f29e6-6370-40ef-a6ea-6024c4aa83f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7f29e6-6370-40ef-a6ea-6024c4aa83f7 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7f29e6-6370-40ef-a6ea-6024c4aa83f7 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7f29e6-6370-40ef-a6ea-6024c4aa83f7 None admin] PATH_INFO: `/v3/services` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7f29e6-6370-40ef-a6ea-6024c4aa83f7 None admin] RBAC: Adding query filter params (type=image) {{(pid=51267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7f29e6-6370-40ef-a6ea-6024c4aa83f7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7f29e6-6370-40ef-a6ea-6024c4aa83f7 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 282/548] 10.27.203.238 () {56 vars in 1108 bytes} [Tue May 28 12:37:19 2024] GET /identity/v3/services?type=image => generated 354 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70543ad1-c4e7-4fec-9507-dd11b6957222 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70543ad1-c4e7-4fec-9507-dd11b6957222 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:19 l75lg1-v1 dstat.sh[49771]: 28-05 12:37:19| 36 4 59 0 0|1621M 8135M 234M 5717M| 18k 86B| 0 124k| 0 10.0 |4954 7364 |2.63 1.19 0.76|4.0 0 20| 0 0 | 0 2048M| 19 30 0 8 0 May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70398e10-efd2-4e68-879d-fa3ffa86f2b4 None None] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70398e10-efd2-4e68-879d-fa3ffa86f2b4 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70398e10-efd2-4e68-879d-fa3ffa86f2b4 None None] PATH_INFO: `/` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 283/549] 10.27.203.238 () {54 vars in 926 bytes} [Tue May 28 12:37:19 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a41184-c9c2-44d1-85ce-08776a12fc43 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a41184-c9c2-44d1-85ce-08776a12fc43 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a41184-c9c2-44d1-85ce-08776a12fc43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-e3a41184-c9c2-44d1-85ce-08776a12fc43 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bb6037-1e8f-47ac-b217-627ce340d537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bb6037-1e8f-47ac-b217-627ce340d537 None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-e3a41184-c9c2-44d1-85ce-08776a12fc43 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bb6037-1e8f-47ac-b217-627ce340d537 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bb6037-1e8f-47ac-b217-627ce340d537 None admin] PATH_INFO: `/v3/endpoints` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-e3a41184-c9c2-44d1-85ce-08776a12fc43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bb6037-1e8f-47ac-b217-627ce340d537 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bb6037-1e8f-47ac-b217-627ce340d537 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 267/550] 10.27.203.238 () {60 vars in 1144 bytes} [Tue May 28 12:37:19 2024] POST /identity/v3/endpoints => generated 331 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 284/551] 10.27.203.238 () {58 vars in 1023 bytes} [Tue May 28 12:37:19 2024] POST /identity/v3/auth/tokens => generated 1314 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1046a2b2-d480-49db-8812-b5967ddae797 None None] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1046a2b2-d480-49db-8812-b5967ddae797 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1046a2b2-d480-49db-8812-b5967ddae797 None None] PATH_INFO: `/` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 268/552] 10.27.203.238 () {54 vars in 926 bytes} [Tue May 28 12:37:19 2024] GET /identity => generated 272 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cff23d-1ebb-4f52-bbaa-3cb64a41fba3 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cff23d-1ebb-4f52-bbaa-3cb64a41fba3 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cff23d-1ebb-4f52-bbaa-3cb64a41fba3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-e2cff23d-1ebb-4f52-bbaa-3cb64a41fba3 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-e2cff23d-1ebb-4f52-bbaa-3cb64a41fba3 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-e2cff23d-1ebb-4f52-bbaa-3cb64a41fba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 285/553] 10.27.203.238 () {58 vars in 1023 bytes} [Tue May 28 12:37:19 2024] POST /identity/v3/auth/tokens => generated 1314 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1046a2b2-d480-49db-8812-b5967ddae797 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1046a2b2-d480-49db-8812-b5967ddae797 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7e2c98-fc72-4810-8537-2476c1c50a4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7e2c98-fc72-4810-8537-2476c1c50a4b None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7e2c98-fc72-4810-8537-2476c1c50a4b None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7e2c98-fc72-4810-8537-2476c1c50a4b None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7e2c98-fc72-4810-8537-2476c1c50a4b None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7e2c98-fc72-4810-8537-2476c1c50a4b None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-df7e2c98-fc72-4810-8537-2476c1c50a4b None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 194, in get_service May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 189, in _get_service May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._get_service(service_id) May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 269/554] 10.27.203.238 () {56 vars in 1129 bytes} [Tue May 28 12:37:19 2024] GET /identity/v3/services/block-storage => generated 94 bytes in 88 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cff23d-1ebb-4f52-bbaa-3cb64a41fba3 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7e2c98-fc72-4810-8537-2476c1c50a4b None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cff23d-1ebb-4f52-bbaa-3cb64a41fba3 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed818f87-1b0c-4a9d-b308-59d4b74311ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed818f87-1b0c-4a9d-b308-59d4b74311ff None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed818f87-1b0c-4a9d-b308-59d4b74311ff None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed818f87-1b0c-4a9d-b308-59d4b74311ff None admin] PATH_INFO: `/v3/services` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed818f87-1b0c-4a9d-b308-59d4b74311ff None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=51267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed818f87-1b0c-4a9d-b308-59d4b74311ff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed818f87-1b0c-4a9d-b308-59d4b74311ff None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 286/555] 10.27.203.238 () {56 vars in 1124 bytes} [Tue May 28 12:37:19 2024] GET /identity/v3/services?name=block-storage => generated 132 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed818f87-1b0c-4a9d-b308-59d4b74311ff None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7e2c98-fc72-4810-8537-2476c1c50a4b None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b40ac5-d3bd-4f64-bb22-b0e30bfbfa83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b40ac5-d3bd-4f64-bb22-b0e30bfbfa83 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b40ac5-d3bd-4f64-bb22-b0e30bfbfa83 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b40ac5-d3bd-4f64-bb22-b0e30bfbfa83 None admin] PATH_INFO: `/v3/services/network` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b40ac5-d3bd-4f64-bb22-b0e30bfbfa83 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed818f87-1b0c-4a9d-b308-59d4b74311ff None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b40ac5-d3bd-4f64-bb22-b0e30bfbfa83 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-02b40ac5-d3bd-4f64-bb22-b0e30bfbfa83 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 194, in get_service May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 189, in _get_service May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._get_service(service_id) May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 270/556] 10.27.203.238 () {56 vars in 1111 bytes} [Tue May 28 12:37:19 2024] GET /identity/v3/services/network => generated 88 bytes in 110 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b40ac5-d3bd-4f64-bb22-b0e30bfbfa83 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b99fa60-b50b-40c8-9e4d-814c0e86f129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b99fa60-b50b-40c8-9e4d-814c0e86f129 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b99fa60-b50b-40c8-9e4d-814c0e86f129 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b99fa60-b50b-40c8-9e4d-814c0e86f129 None admin] PATH_INFO: `/v3/services` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b99fa60-b50b-40c8-9e4d-814c0e86f129 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=51267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b99fa60-b50b-40c8-9e4d-814c0e86f129 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b99fa60-b50b-40c8-9e4d-814c0e86f129 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 287/557] 10.27.203.238 () {56 vars in 1124 bytes} [Tue May 28 12:37:19 2024] GET /identity/v3/services?type=block-storage => generated 371 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b99fa60-b50b-40c8-9e4d-814c0e86f129 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b40ac5-d3bd-4f64-bb22-b0e30bfbfa83 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b99fa60-b50b-40c8-9e4d-814c0e86f129 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23c2e3a-99c1-4a5a-ab89-9666a7e9139a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23c2e3a-99c1-4a5a-ab89-9666a7e9139a None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23c2e3a-99c1-4a5a-ab89-9666a7e9139a None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23c2e3a-99c1-4a5a-ab89-9666a7e9139a None admin] PATH_INFO: `/v3/endpoints` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23c2e3a-99c1-4a5a-ab89-9666a7e9139a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23c2e3a-99c1-4a5a-ab89-9666a7e9139a None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bfb794-7007-4d35-8561-995607e7a982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bfb794-7007-4d35-8561-995607e7a982 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bfb794-7007-4d35-8561-995607e7a982 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bfb794-7007-4d35-8561-995607e7a982 None admin] PATH_INFO: `/v3/services` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bfb794-7007-4d35-8561-995607e7a982 None admin] RBAC: Adding query filter params (name=network) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bfb794-7007-4d35-8561-995607e7a982 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bfb794-7007-4d35-8561-995607e7a982 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 271/558] 10.27.203.238 () {56 vars in 1112 bytes} [Tue May 28 12:37:19 2024] GET /identity/v3/services?name=network => generated 126 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bfb794-7007-4d35-8561-995607e7a982 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 288/559] 10.27.203.238 () {60 vars in 1144 bytes} [Tue May 28 12:37:19 2024] POST /identity/v3/endpoints => generated 350 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bfb794-7007-4d35-8561-995607e7a982 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdf44aa-4203-4a94-8f5e-b889a9f914af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdf44aa-4203-4a94-8f5e-b889a9f914af None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdf44aa-4203-4a94-8f5e-b889a9f914af None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdf44aa-4203-4a94-8f5e-b889a9f914af None admin] PATH_INFO: `/v3/services` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdf44aa-4203-4a94-8f5e-b889a9f914af None admin] RBAC: Adding query filter params (type=network) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdf44aa-4203-4a94-8f5e-b889a9f914af None admin] RBAC: Authorizing `identity:list_services()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdf44aa-4203-4a94-8f5e-b889a9f914af None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 272/560] 10.27.203.238 () {56 vars in 1112 bytes} [Tue May 28 12:37:19 2024] GET /identity/v3/services?type=network => generated 354 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23c2e3a-99c1-4a5a-ab89-9666a7e9139a None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23c2e3a-99c1-4a5a-ab89-9666a7e9139a None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9ae90d-b86e-435e-a103-e939feff9153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9ae90d-b86e-435e-a103-e939feff9153 None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9ae90d-b86e-435e-a103-e939feff9153 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9ae90d-b86e-435e-a103-e939feff9153 None admin] PATH_INFO: `/v3/endpoints` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9ae90d-b86e-435e-a103-e939feff9153 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9ae90d-b86e-435e-a103-e939feff9153 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:20 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 289/561] 10.27.203.238 () {60 vars in 1144 bytes} [Tue May 28 12:37:19 2024] POST /identity/v3/endpoints => generated 341 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 28 12:37:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8ab39a-c2f6-4b02-8af8-60177039d833 None None] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8ab39a-c2f6-4b02-8af8-60177039d833 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8ab39a-c2f6-4b02-8af8-60177039d833 None None] PATH_INFO: `/` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:20 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 273/562] 10.27.203.238 () {54 vars in 926 bytes} [Tue May 28 12:37:20 2024] GET /identity => generated 272 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:37:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95769afe-abb7-4b02-9feb-b93e77dddb2b None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95769afe-abb7-4b02-9feb-b93e77dddb2b None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95769afe-abb7-4b02-9feb-b93e77dddb2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:20 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-95769afe-abb7-4b02-9feb-b93e77dddb2b None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:37:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-95769afe-abb7-4b02-9feb-b93e77dddb2b None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:37:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-95769afe-abb7-4b02-9feb-b93e77dddb2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:37:20 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 290/563] 10.27.203.238 () {58 vars in 1023 bytes} [Tue May 28 12:37:20 2024] POST /identity/v3/auth/tokens => generated 1475 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 12:37:20 l75lg1-v1 dstat.sh[49771]: 28-05 12:37:20| 36 5 59 0 0|1525M 8231M 234M 5718M| 12k 410B| 0 544k| 0 65.0 |6800 11k|2.63 1.19 0.76|4.0 0 106| 0 0 | 0 2048M| 19 29 0 8 0 May 28 12:37:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8ab39a-c2f6-4b02-8af8-60177039d833 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8ab39a-c2f6-4b02-8af8-60177039d833 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38edc6e8-7391-442f-b522-661b5929e981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38edc6e8-7391-442f-b522-661b5929e981 None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38edc6e8-7391-442f-b522-661b5929e981 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38edc6e8-7391-442f-b522-661b5929e981 None admin] PATH_INFO: `/v3/services` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38edc6e8-7391-442f-b522-661b5929e981 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38edc6e8-7391-442f-b522-661b5929e981 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:20 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 274/564] 10.27.203.238 () {60 vars in 1141 bytes} [Tue May 28 12:37:20 2024] POST /identity/v3/services => generated 271 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:37:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864d56e8-e760-44de-9973-7e38a22f3b08 None None] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864d56e8-e760-44de-9973-7e38a22f3b08 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864d56e8-e760-44de-9973-7e38a22f3b08 None None] PATH_INFO: `/` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:20 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 291/565] 10.27.203.238 () {54 vars in 926 bytes} [Tue May 28 12:37:20 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:37:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579f569f-016c-405c-9ea7-63012dd43c1e None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579f569f-016c-405c-9ea7-63012dd43c1e None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579f569f-016c-405c-9ea7-63012dd43c1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:20 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-579f569f-016c-405c-9ea7-63012dd43c1e None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:37:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-579f569f-016c-405c-9ea7-63012dd43c1e None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:37:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-579f569f-016c-405c-9ea7-63012dd43c1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:37:20 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 275/566] 10.27.203.238 () {58 vars in 1023 bytes} [Tue May 28 12:37:20 2024] POST /identity/v3/auth/tokens => generated 1585 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 12:37:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864d56e8-e760-44de-9973-7e38a22f3b08 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864d56e8-e760-44de-9973-7e38a22f3b08 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f95a463-5932-46ad-8e6a-deb46128ce6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f95a463-5932-46ad-8e6a-deb46128ce6b None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f95a463-5932-46ad-8e6a-deb46128ce6b None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f95a463-5932-46ad-8e6a-deb46128ce6b None admin] PATH_INFO: `/v3/domains` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f95a463-5932-46ad-8e6a-deb46128ce6b None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f95a463-5932-46ad-8e6a-deb46128ce6b None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.sql.core [None req-2f95a463-5932-46ad-8e6a-deb46128ce6b None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: [parameters: {'id': '8ace18a335f94956bd6205734aeb80dd', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: (Background on this error at: https://sqlalche.me/e/20/gkpj) {{(pid=51267) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-2f95a463-5932-46ad-8e6a-deb46128ce6b None admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1967, in _exec_single_context May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application self.dialect.do_execute( May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 924, in do_execute May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/pymysql/cursors.py", line 153, in execute May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application result = self._query(query) May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/pymysql/cursors.py", line 322, in _query May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application conn.query(q) May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/pymysql/connections.py", line 558, in query May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/pymysql/connections.py", line 822, in _read_query_result May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application result.read() May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/pymysql/connections.py", line 1200, in read May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/pymysql/connections.py", line 772, in _read_packet May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application packet.raise_for_error() May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/pymysql/protocol.py", line 221, in raise_for_error May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/pymysql/err.py", line 143, in raise_mysql_exception May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 234, in create_project May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with sql.session_for_write() as session: May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application next(self.gen) May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/enginefacade.py", line 1042, in _transaction_scope May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with current._produce_block( May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application next(self.gen) May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/enginefacade.py", line 649, in _session May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with excutils.save_and_reraise_exception(): May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__ May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application self.force_reraise() May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise self.value May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/enginefacade.py", line 647, in _session May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/enginefacade.py", line 675, in _end_session_transaction May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application session.commit() May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2017, in commit May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application trans.commit(_to_root=True) May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "", line 2, in commit May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/sqlalchemy/orm/state_changes.py", line 139, in _go May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ret_value = fn(self, *arg, **kw) May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1302, in commit May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application self._prepare_impl() May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "", line 2, in _prepare_impl May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/sqlalchemy/orm/state_changes.py", line 139, in _go May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ret_value = fn(self, *arg, **kw) May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1277, in _prepare_impl May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application self.session.flush() May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 4341, in flush May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application self._flush(objects) May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 4476, in _flush May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with util.safe_reraise(): May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 146, in __exit__ May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exc_value.with_traceback(exc_tb) May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 4437, in _flush May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application flush_context.execute() May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 466, in execute May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rec.execute(self) May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 642, in execute May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 93, in save_obj May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application _emit_insert_statements( May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1048, in _emit_insert_statements May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application result = connection.execute( May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1418, in execute May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return meth( May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 515, in _execute_on_connection May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1640, in _execute_clauseelement May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ret = self._execute_context( May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1846, in _execute_context May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._exec_single_context( May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1986, in _exec_single_context May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 2350, in _handle_dbapi_exception May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise newraise.with_traceback(exc_info[2]) from e May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1967, in _exec_single_context May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application self.dialect.do_execute( May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 924, in do_execute May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/pymysql/cursors.py", line 153, in execute May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application result = self._query(query) May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/pymysql/cursors.py", line 322, in _query May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application conn.query(q) May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/pymysql/connections.py", line 558, in query May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/pymysql/connections.py", line 822, in _read_query_result May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application result.read() May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/pymysql/connections.py", line 1200, in read May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/pymysql/connections.py", line 772, in _read_packet May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application packet.raise_for_error() May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/pymysql/protocol.py", line 221, in raise_for_error May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/pymysql/err.py", line 143, in raise_mysql_exception May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [parameters: {'id': '8ace18a335f94956bd6205734aeb80dd', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/20/gkpj) May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name Default. May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 139, in post May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application is_domain_project = self.create_project( May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.Conflict( May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 292/567] 10.27.203.238 () {60 vars in 1137 bytes} [Tue May 28 12:37:20 2024] POST /identity/v3/domains => generated 190 bytes in 111 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579f569f-016c-405c-9ea7-63012dd43c1e None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579f569f-016c-405c-9ea7-63012dd43c1e None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213606e9-5108-4ac9-b82b-9b0fc877ab5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213606e9-5108-4ac9-b82b-9b0fc877ab5c None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213606e9-5108-4ac9-b82b-9b0fc877ab5c None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213606e9-5108-4ac9-b82b-9b0fc877ab5c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213606e9-5108-4ac9-b82b-9b0fc877ab5c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213606e9-5108-4ac9-b82b-9b0fc877ab5c None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-213606e9-5108-4ac9-b82b-9b0fc877ab5c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 276/568] 10.27.203.238 () {56 vars in 1108 bytes} [Tue May 28 12:37:21 2024] GET /identity/v3/domains/Default => generated 87 bytes in 132 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f95a463-5932-46ad-8e6a-deb46128ce6b None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:21 l75lg1-v1 dstat.sh[49771]: 28-05 12:37:21| 28 3 69 0 0|1572M 8184M 234M 5718M| 19k 260B| 0 851k| 0 49.0 |3891 5948 |2.66 1.22 0.77|3.0 0 51| 0 0 | 0 2048M| 19 30 0 7 0 May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1ad919-ae00-4b1e-8bab-e8dc83dfe012 None None] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1ad919-ae00-4b1e-8bab-e8dc83dfe012 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1ad919-ae00-4b1e-8bab-e8dc83dfe012 None None] PATH_INFO: `/` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 277/569] 10.27.203.238 () {54 vars in 926 bytes} [Tue May 28 12:37:21 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8a73c2-a6d2-426e-97e4-f3e2a588ffe0 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8a73c2-a6d2-426e-97e4-f3e2a588ffe0 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8a73c2-a6d2-426e-97e4-f3e2a588ffe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-ed8a73c2-a6d2-426e-97e4-f3e2a588ffe0 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f95a463-5932-46ad-8e6a-deb46128ce6b None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-ed8a73c2-a6d2-426e-97e4-f3e2a588ffe0 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-ed8a73c2-a6d2-426e-97e4-f3e2a588ffe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99558b53-e3c4-4300-bd11-da6ef763e8fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99558b53-e3c4-4300-bd11-da6ef763e8fe None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99558b53-e3c4-4300-bd11-da6ef763e8fe None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99558b53-e3c4-4300-bd11-da6ef763e8fe None admin] PATH_INFO: `/v3/domains` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99558b53-e3c4-4300-bd11-da6ef763e8fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=51267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99558b53-e3c4-4300-bd11-da6ef763e8fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99558b53-e3c4-4300-bd11-da6ef763e8fe None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 293/570] 10.27.203.238 () {56 vars in 1109 bytes} [Tue May 28 12:37:21 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 278/571] 10.27.203.238 () {58 vars in 1023 bytes} [Tue May 28 12:37:21 2024] POST /identity/v3/auth/tokens => generated 1585 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99558b53-e3c4-4300-bd11-da6ef763e8fe None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99558b53-e3c4-4300-bd11-da6ef763e8fe None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96743446-8f8f-485e-a2c6-061d9071d2f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96743446-8f8f-485e-a2c6-061d9071d2f6 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96743446-8f8f-485e-a2c6-061d9071d2f6 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96743446-8f8f-485e-a2c6-061d9071d2f6 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96743446-8f8f-485e-a2c6-061d9071d2f6 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96743446-8f8f-485e-a2c6-061d9071d2f6 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-96743446-8f8f-485e-a2c6-061d9071d2f6 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 194, in get_service May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 189, in _get_service May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._get_service(service_id) May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 294/572] 10.27.203.238 () {56 vars in 1114 bytes} [Tue May 28 12:37:21 2024] GET /identity/v3/services/volumev3 => generated 89 bytes in 91 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8a73c2-a6d2-426e-97e4-f3e2a588ffe0 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8a73c2-a6d2-426e-97e4-f3e2a588ffe0 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15dee8b-e374-4f44-a9c0-cfce1a416559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15dee8b-e374-4f44-a9c0-cfce1a416559 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15dee8b-e374-4f44-a9c0-cfce1a416559 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15dee8b-e374-4f44-a9c0-cfce1a416559 None admin] PATH_INFO: `/v3/services` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15dee8b-e374-4f44-a9c0-cfce1a416559 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15dee8b-e374-4f44-a9c0-cfce1a416559 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15dee8b-e374-4f44-a9c0-cfce1a416559 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 279/573] 10.27.203.238 () {56 vars in 1114 bytes} [Tue May 28 12:37:21 2024] GET /identity/v3/services?name=volumev3 => generated 127 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96743446-8f8f-485e-a2c6-061d9071d2f6 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96743446-8f8f-485e-a2c6-061d9071d2f6 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b455fca-c550-480d-80c8-6ab79cde1710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b455fca-c550-480d-80c8-6ab79cde1710 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b455fca-c550-480d-80c8-6ab79cde1710 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b455fca-c550-480d-80c8-6ab79cde1710 None admin] PATH_INFO: `/v3/services` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b455fca-c550-480d-80c8-6ab79cde1710 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=51267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b455fca-c550-480d-80c8-6ab79cde1710 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b455fca-c550-480d-80c8-6ab79cde1710 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 295/574] 10.27.203.238 () {56 vars in 1114 bytes} [Tue May 28 12:37:21 2024] GET /identity/v3/services?type=volumev3 => generated 127 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296be1ba-d6ee-41b7-97fb-2aaaa7b4a6c7 None None] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296be1ba-d6ee-41b7-97fb-2aaaa7b4a6c7 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296be1ba-d6ee-41b7-97fb-2aaaa7b4a6c7 None None] PATH_INFO: `/` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 280/575] 10.27.203.238 () {54 vars in 926 bytes} [Tue May 28 12:37:21 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1037946e-8cdf-47d4-bbd4-361f942dc876 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1037946e-8cdf-47d4-bbd4-361f942dc876 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1037946e-8cdf-47d4-bbd4-361f942dc876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-1037946e-8cdf-47d4-bbd4-361f942dc876 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-1037946e-8cdf-47d4-bbd4-361f942dc876 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-1037946e-8cdf-47d4-bbd4-361f942dc876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:37:21 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 296/576] 10.27.203.238 () {58 vars in 1023 bytes} [Tue May 28 12:37:21 2024] POST /identity/v3/auth/tokens => generated 1585 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 12:37:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296be1ba-d6ee-41b7-97fb-2aaaa7b4a6c7 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296be1ba-d6ee-41b7-97fb-2aaaa7b4a6c7 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debacee8-1c49-45dc-84be-a439b2a59a10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debacee8-1c49-45dc-84be-a439b2a59a10 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debacee8-1c49-45dc-84be-a439b2a59a10 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debacee8-1c49-45dc-84be-a439b2a59a10 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debacee8-1c49-45dc-84be-a439b2a59a10 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debacee8-1c49-45dc-84be-a439b2a59a10 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-debacee8-1c49-45dc-84be-a439b2a59a10 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 28 12:37:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:37:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 28 12:37:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 28 12:37:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 194, in get_service May 28 12:37:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 28 12:37:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 189, in _get_service May 28 12:37:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 28 12:37:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 28 12:37:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 12:37:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 28 12:37:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 12:37:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:37:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:37:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:37:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:37:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:37:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:37:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:37:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:37:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:37:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:37:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:37:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 28 12:37:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._get_service(service_id) May 28 12:37:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 28 12:37:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 28 12:37:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:37:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:37:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:37:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:37:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:37:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:37:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:37:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 12:37:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:37:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 12:37:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:37:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:37:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:37:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 12:37:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:37:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 12:37:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 28 12:37:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 28 12:37:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 28 12:37:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 12:37:22 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 281/577] 10.27.203.238 () {56 vars in 1132 bytes} [Tue May 28 12:37:22 2024] GET /identity/v3/services/compute_legacy => generated 95 bytes in 100 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 28 12:37:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1037946e-8cdf-47d4-bbd4-361f942dc876 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:22 l75lg1-v1 dstat.sh[49771]: 28-05 12:37:22| 30 4 66 0 0|1533M 8223M 234M 5718M| 22k 128B| 0 240k| 0 16.0 |5047 10k|2.66 1.22 0.77|4.0 0 132| 0 0 | 0 2048M| 19 30 0 8 0 May 28 12:37:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1037946e-8cdf-47d4-bbd4-361f942dc876 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6791323c-8b57-4a74-b68a-7d5082a896a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6791323c-8b57-4a74-b68a-7d5082a896a6 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6791323c-8b57-4a74-b68a-7d5082a896a6 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6791323c-8b57-4a74-b68a-7d5082a896a6 None admin] PATH_INFO: `/v3/services` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6791323c-8b57-4a74-b68a-7d5082a896a6 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=51267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:37:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6791323c-8b57-4a74-b68a-7d5082a896a6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6791323c-8b57-4a74-b68a-7d5082a896a6 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:22 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 297/578] 10.27.203.238 () {56 vars in 1126 bytes} [Tue May 28 12:37:22 2024] GET /identity/v3/services?name=compute_legacy => generated 133 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:37:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debacee8-1c49-45dc-84be-a439b2a59a10 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debacee8-1c49-45dc-84be-a439b2a59a10 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08da6d60-2938-434b-81eb-354d2ae8b886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08da6d60-2938-434b-81eb-354d2ae8b886 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08da6d60-2938-434b-81eb-354d2ae8b886 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08da6d60-2938-434b-81eb-354d2ae8b886 None admin] PATH_INFO: `/v3/services` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08da6d60-2938-434b-81eb-354d2ae8b886 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:37:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08da6d60-2938-434b-81eb-354d2ae8b886 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08da6d60-2938-434b-81eb-354d2ae8b886 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:22 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 282/579] 10.27.203.238 () {56 vars in 1126 bytes} [Tue May 28 12:37:22 2024] GET /identity/v3/services?type=compute_legacy => generated 390 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:37:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6791323c-8b57-4a74-b68a-7d5082a896a6 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6791323c-8b57-4a74-b68a-7d5082a896a6 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6397aaf5-9294-4805-a8f5-0fcc2ff7f64e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6397aaf5-9294-4805-a8f5-0fcc2ff7f64e None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6397aaf5-9294-4805-a8f5-0fcc2ff7f64e None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6397aaf5-9294-4805-a8f5-0fcc2ff7f64e None admin] PATH_INFO: `/v3/endpoints` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6397aaf5-9294-4805-a8f5-0fcc2ff7f64e None admin] RBAC: Adding query filter params (interface=public, service_id=4cef0e8c306d4cc1b782ba7e22b9aef9, region_id=RegionOne) {{(pid=51267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:37:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6397aaf5-9294-4805-a8f5-0fcc2ff7f64e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6397aaf5-9294-4805-a8f5-0fcc2ff7f64e None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:22 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 298/580] 10.27.203.238 () {56 vars in 1251 bytes} [Tue May 28 12:37:22 2024] GET /identity/v3/endpoints?service_id=4cef0e8c306d4cc1b782ba7e22b9aef9&interface=public®ion_id=RegionOne => generated 196 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:37:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08da6d60-2938-434b-81eb-354d2ae8b886 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08da6d60-2938-434b-81eb-354d2ae8b886 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3802416a-3694-4ec4-b2c5-c15b8bfb4822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3802416a-3694-4ec4-b2c5-c15b8bfb4822 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3802416a-3694-4ec4-b2c5-c15b8bfb4822 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3802416a-3694-4ec4-b2c5-c15b8bfb4822 None admin] PATH_INFO: `/v3/services` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3802416a-3694-4ec4-b2c5-c15b8bfb4822 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3802416a-3694-4ec4-b2c5-c15b8bfb4822 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:22 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 283/581] 10.27.203.238 () {56 vars in 1087 bytes} [Tue May 28 12:37:22 2024] GET /identity/v3/services => generated 1271 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:37:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1946a7a-343c-4e4a-971d-d84b56d414c6 None None] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1946a7a-343c-4e4a-971d-d84b56d414c6 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1946a7a-343c-4e4a-971d-d84b56d414c6 None None] PATH_INFO: `/` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:22 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 299/582] 10.27.203.238 () {54 vars in 926 bytes} [Tue May 28 12:37:22 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:37:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bad380-88be-4dfc-8aca-368018f49050 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bad380-88be-4dfc-8aca-368018f49050 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bad380-88be-4dfc-8aca-368018f49050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:22 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-03bad380-88be-4dfc-8aca-368018f49050 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:37:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-03bad380-88be-4dfc-8aca-368018f49050 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:37:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-03bad380-88be-4dfc-8aca-368018f49050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:37:23 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 284/583] 10.27.203.238 () {58 vars in 1023 bytes} [Tue May 28 12:37:22 2024] POST /identity/v3/auth/tokens => generated 1585 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 12:37:23 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c0068f-be8d-45ca-b798-5dd32ee4b66b None None] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:23 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c0068f-be8d-45ca-b798-5dd32ee4b66b None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:23 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c0068f-be8d-45ca-b798-5dd32ee4b66b None None] PATH_INFO: `/` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:23 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 300/584] 10.27.203.238 () {54 vars in 926 bytes} [Tue May 28 12:37:23 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:37:23 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2712fd3f-7636-450f-ba3b-d8e59a5b0e9f None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:23 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2712fd3f-7636-450f-ba3b-d8e59a5b0e9f None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:23 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2712fd3f-7636-450f-ba3b-d8e59a5b0e9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:23 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c0068f-be8d-45ca-b798-5dd32ee4b66b None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:23 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-2712fd3f-7636-450f-ba3b-d8e59a5b0e9f None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:37:23 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-2712fd3f-7636-450f-ba3b-d8e59a5b0e9f None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:37:23 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-2712fd3f-7636-450f-ba3b-d8e59a5b0e9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:37:23 l75lg1-v1 dstat.sh[49771]: 28-05 12:37:23| 28 3 69 0 0|1567M 8188M 234M 5718M| 18k 86B| 0 176k| 0 11.0 |3129 4468 |2.66 1.22 0.77|3.0 0 25| 0 0 | 0 2048M| 19 31 0 7 0 May 28 12:37:23 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c0068f-be8d-45ca-b798-5dd32ee4b66b None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:23 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 285/585] 10.27.203.238 () {58 vars in 1023 bytes} [Tue May 28 12:37:23 2024] POST /identity/v3/auth/tokens => generated 1585 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 12:37:23 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1c6260-f235-4d27-a85c-d71dc1f1f255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:23 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1c6260-f235-4d27-a85c-d71dc1f1f255 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:23 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1c6260-f235-4d27-a85c-d71dc1f1f255 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:23 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1c6260-f235-4d27-a85c-d71dc1f1f255 None admin] PATH_INFO: `/v3/services/glance` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:23 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1c6260-f235-4d27-a85c-d71dc1f1f255 None admin] RBAC: Authorizing `identity:get_service(service_id=glance)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:23 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1c6260-f235-4d27-a85c-d71dc1f1f255 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:23 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-3f1c6260-f235-4d27-a85c-d71dc1f1f255 None admin] Could not find service: glance.: keystone.exception.ServiceNotFound: Could not find service: glance. May 28 12:37:23 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:37:23 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 28 12:37:23 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 28 12:37:23 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 194, in get_service May 28 12:37:23 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 28 12:37:23 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 189, in _get_service May 28 12:37:23 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 28 12:37:23 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: glance. May 28 12:37:23 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 12:37:23 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 28 12:37:23 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 12:37:23 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:37:23 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:37:23 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:37:23 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:37:23 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:37:23 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:37:23 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:37:23 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:37:23 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:37:23 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:37:23 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:37:23 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 28 12:37:23 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._get_service(service_id) May 28 12:37:23 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 28 12:37:23 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 28 12:37:23 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:37:23 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:37:23 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:37:23 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:37:23 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:37:23 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:37:23 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:37:23 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 12:37:23 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:37:23 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 12:37:23 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:37:23 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:37:23 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:37:23 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 12:37:23 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:37:23 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 12:37:23 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 28 12:37:23 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 28 12:37:23 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: glance. May 28 12:37:23 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 12:37:23 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 301/586] 10.27.203.238 () {56 vars in 1108 bytes} [Tue May 28 12:37:23 2024] GET /identity/v3/services/glance => generated 87 bytes in 87 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 28 12:37:23 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2712fd3f-7636-450f-ba3b-d8e59a5b0e9f None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:23 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2712fd3f-7636-450f-ba3b-d8e59a5b0e9f None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:23 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f80c2d6-93ea-4200-a5cd-ca85771d047f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:23 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f80c2d6-93ea-4200-a5cd-ca85771d047f None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:23 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f80c2d6-93ea-4200-a5cd-ca85771d047f None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:23 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f80c2d6-93ea-4200-a5cd-ca85771d047f None admin] PATH_INFO: `/v3/services` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:23 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f80c2d6-93ea-4200-a5cd-ca85771d047f None admin] RBAC: Adding query filter params (name=glance) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:37:23 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f80c2d6-93ea-4200-a5cd-ca85771d047f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:23 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f80c2d6-93ea-4200-a5cd-ca85771d047f None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:23 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 286/587] 10.27.203.238 () {56 vars in 1110 bytes} [Tue May 28 12:37:23 2024] GET /identity/v3/services?name=glance => generated 355 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:37:23 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1c6260-f235-4d27-a85c-d71dc1f1f255 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:23 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1c6260-f235-4d27-a85c-d71dc1f1f255 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:23 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f80c2d6-93ea-4200-a5cd-ca85771d047f None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:23 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3403d2e5-1304-49cd-81ad-f370ca1060b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:23 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3403d2e5-1304-49cd-81ad-f370ca1060b1 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:23 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3403d2e5-1304-49cd-81ad-f370ca1060b1 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:23 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3403d2e5-1304-49cd-81ad-f370ca1060b1 None admin] PATH_INFO: `/v3/regions/RegionOne` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:23 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3403d2e5-1304-49cd-81ad-f370ca1060b1 None admin] RBAC: Authorizing `identity:get_region(region_id=RegionOne)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:23 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3403d2e5-1304-49cd-81ad-f370ca1060b1 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:23 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 302/588] 10.27.203.238 () {56 vars in 1114 bytes} [Tue May 28 12:37:23 2024] GET /identity/v3/regions/RegionOne => generated 150 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:37:23 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3403d2e5-1304-49cd-81ad-f370ca1060b1 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:23 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f80c2d6-93ea-4200-a5cd-ca85771d047f None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:23 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3403d2e5-1304-49cd-81ad-f370ca1060b1 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:23 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb91f31f-5ab3-4654-89cc-16a89ab0ad44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:23 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb91f31f-5ab3-4654-89cc-16a89ab0ad44 None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:23 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb91f31f-5ab3-4654-89cc-16a89ab0ad44 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:23 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb91f31f-5ab3-4654-89cc-16a89ab0ad44 None admin] PATH_INFO: `/v3/services` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:23 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb91f31f-5ab3-4654-89cc-16a89ab0ad44 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:23 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb91f31f-5ab3-4654-89cc-16a89ab0ad44 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:23 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bccbaf-2b47-4f7f-b1f6-63110ee73d50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:23 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bccbaf-2b47-4f7f-b1f6-63110ee73d50 None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:23 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bccbaf-2b47-4f7f-b1f6-63110ee73d50 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:23 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bccbaf-2b47-4f7f-b1f6-63110ee73d50 None admin] PATH_INFO: `/v3/registered_limits` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:23 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bccbaf-2b47-4f7f-b1f6-63110ee73d50 None admin] RBAC: Authorizing `identity:create_registered_limits()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:23 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bccbaf-2b47-4f7f-b1f6-63110ee73d50 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:23 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 287/589] 10.27.203.238 () {60 vars in 1141 bytes} [Tue May 28 12:37:23 2024] POST /identity/v3/services => generated 253 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:37:23 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 303/590] 10.27.203.238 () {60 vars in 1168 bytes} [Tue May 28 12:37:23 2024] POST /identity/v3/registered_limits => generated 331 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 28 12:37:24 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e406d5b-3ad8-44a3-a764-d503bbbdd17d None None] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:24 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e406d5b-3ad8-44a3-a764-d503bbbdd17d None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:24 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e406d5b-3ad8-44a3-a764-d503bbbdd17d None None] PATH_INFO: `/` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:24 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 288/591] 10.27.203.238 () {54 vars in 926 bytes} [Tue May 28 12:37:24 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:37:24 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7726ae82-9634-4dff-8fd5-6b8acabafb9e None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:24 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7726ae82-9634-4dff-8fd5-6b8acabafb9e None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:24 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7726ae82-9634-4dff-8fd5-6b8acabafb9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:24 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-7726ae82-9634-4dff-8fd5-6b8acabafb9e None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:37:24 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-7726ae82-9634-4dff-8fd5-6b8acabafb9e None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:37:24 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-7726ae82-9634-4dff-8fd5-6b8acabafb9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:37:24 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 304/592] 10.27.203.238 () {58 vars in 1023 bytes} [Tue May 28 12:37:24 2024] POST /identity/v3/auth/tokens => generated 1686 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 12:37:24 l75lg1-v1 dstat.sh[49771]: 28-05 12:37:24| 28 3 69 0 0|1540M 8215M 234M 5718M| 22k 86B| 0 356k| 0 41.0 |3193 5193 |2.66 1.22 0.77|3.0 0 37| 0 0 | 0 2048M| 19 29 0 7 0 May 28 12:37:24 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e406d5b-3ad8-44a3-a764-d503bbbdd17d None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:24 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e406d5b-3ad8-44a3-a764-d503bbbdd17d None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:24 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46549522-a10d-416b-b09d-572a25c3046b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:24 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46549522-a10d-416b-b09d-572a25c3046b None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:24 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46549522-a10d-416b-b09d-572a25c3046b None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:24 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46549522-a10d-416b-b09d-572a25c3046b None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:24 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46549522-a10d-416b-b09d-572a25c3046b None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:24 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46549522-a10d-416b-b09d-572a25c3046b None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-46549522-a10d-416b-b09d-572a25c3046b None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 28 12:37:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:37:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 28 12:37:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 28 12:37:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 194, in get_service May 28 12:37:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 28 12:37:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 189, in _get_service May 28 12:37:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 28 12:37:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 28 12:37:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 12:37:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 28 12:37:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 12:37:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:37:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:37:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:37:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:37:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:37:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:37:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:37:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:37:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:37:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:37:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:37:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 28 12:37:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._get_service(service_id) May 28 12:37:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 28 12:37:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 28 12:37:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:37:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:37:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:37:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:37:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:37:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:37:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:37:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 12:37:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:37:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 12:37:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:37:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:37:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:37:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 12:37:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:37:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 12:37:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 28 12:37:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 28 12:37:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 28 12:37:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 12:37:24 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 289/593] 10.27.203.238 () {56 vars in 1132 bytes} [Tue May 28 12:37:24 2024] GET /identity/v3/services/compute_legacy => generated 95 bytes in 87 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 28 12:37:24 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7726ae82-9634-4dff-8fd5-6b8acabafb9e None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:24 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7726ae82-9634-4dff-8fd5-6b8acabafb9e None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:24 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db17526c-28ff-4699-b33b-98bdbd1e455d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:24 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db17526c-28ff-4699-b33b-98bdbd1e455d None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:24 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db17526c-28ff-4699-b33b-98bdbd1e455d None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:24 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db17526c-28ff-4699-b33b-98bdbd1e455d None admin] PATH_INFO: `/v3/services` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:24 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db17526c-28ff-4699-b33b-98bdbd1e455d None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=51267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:37:24 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db17526c-28ff-4699-b33b-98bdbd1e455d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:24 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db17526c-28ff-4699-b33b-98bdbd1e455d None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:24 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 305/594] 10.27.203.238 () {56 vars in 1126 bytes} [Tue May 28 12:37:24 2024] GET /identity/v3/services?name=compute_legacy => generated 133 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:37:24 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46549522-a10d-416b-b09d-572a25c3046b None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:24 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46549522-a10d-416b-b09d-572a25c3046b None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:24 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cabeda7-50c8-427c-9376-9610403b34b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:24 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cabeda7-50c8-427c-9376-9610403b34b2 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:24 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cabeda7-50c8-427c-9376-9610403b34b2 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:24 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cabeda7-50c8-427c-9376-9610403b34b2 None admin] PATH_INFO: `/v3/services` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:24 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cabeda7-50c8-427c-9376-9610403b34b2 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:37:24 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cabeda7-50c8-427c-9376-9610403b34b2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:24 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cabeda7-50c8-427c-9376-9610403b34b2 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:24 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 290/595] 10.27.203.238 () {56 vars in 1126 bytes} [Tue May 28 12:37:24 2024] GET /identity/v3/services?type=compute_legacy => generated 390 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:37:24 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db17526c-28ff-4699-b33b-98bdbd1e455d None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:24 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db17526c-28ff-4699-b33b-98bdbd1e455d None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:24 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223255af-e86d-4abd-9a4f-d47f1e90a8ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:24 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223255af-e86d-4abd-9a4f-d47f1e90a8ff None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:24 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223255af-e86d-4abd-9a4f-d47f1e90a8ff None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:24 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223255af-e86d-4abd-9a4f-d47f1e90a8ff None admin] PATH_INFO: `/v3/endpoints` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:24 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223255af-e86d-4abd-9a4f-d47f1e90a8ff None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:24 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223255af-e86d-4abd-9a4f-d47f1e90a8ff None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:24 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 306/596] 10.27.203.238 () {60 vars in 1144 bytes} [Tue May 28 12:37:24 2024] POST /identity/v3/endpoints => generated 351 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:37:24 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfee663-e9c6-43ee-87c9-a5ac972264d6 None None] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:24 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfee663-e9c6-43ee-87c9-a5ac972264d6 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:24 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfee663-e9c6-43ee-87c9-a5ac972264d6 None None] PATH_INFO: `/` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:24 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 291/597] 10.27.203.238 () {54 vars in 926 bytes} [Tue May 28 12:37:24 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:37:24 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a6e377-ec98-41d9-8787-5c99436d8d91 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:24 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a6e377-ec98-41d9-8787-5c99436d8d91 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:24 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a6e377-ec98-41d9-8787-5c99436d8d91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:24 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-34a6e377-ec98-41d9-8787-5c99436d8d91 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:37:24 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-34a6e377-ec98-41d9-8787-5c99436d8d91 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:37:24 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-34a6e377-ec98-41d9-8787-5c99436d8d91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 307/598] 10.27.203.238 () {58 vars in 1023 bytes} [Tue May 28 12:37:24 2024] POST /identity/v3/auth/tokens => generated 1686 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d6f98d-377c-4a66-98d6-a358d144d721 None None] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d6f98d-377c-4a66-98d6-a358d144d721 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d6f98d-377c-4a66-98d6-a358d144d721 None None] PATH_INFO: `/` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 292/599] 10.27.203.238 () {54 vars in 926 bytes} [Tue May 28 12:37:25 2024] GET /identity => generated 272 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25a96c9-5611-466f-accd-5c267c090ca4 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25a96c9-5611-466f-accd-5c267c090ca4 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25a96c9-5611-466f-accd-5c267c090ca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-b25a96c9-5611-466f-accd-5c267c090ca4 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-b25a96c9-5611-466f-accd-5c267c090ca4 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-b25a96c9-5611-466f-accd-5c267c090ca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 308/600] 10.27.203.238 () {58 vars in 1023 bytes} [Tue May 28 12:37:25 2024] POST /identity/v3/auth/tokens => generated 1686 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d6f98d-377c-4a66-98d6-a358d144d721 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:25 l75lg1-v1 dstat.sh[49771]: 28-05 12:37:25| 27 3 69 0 0|1566M 8189M 234M 5718M| 26k 86B| 0 268k| 0 27.0 |3925 5831 |2.66 1.22 0.77|3.0 0 37| 0 0 | 0 2048M| 19 30 0 5 0 May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d6f98d-377c-4a66-98d6-a358d144d721 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23c0bbd-2f74-461c-9900-08098449d80e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23c0bbd-2f74-461c-9900-08098449d80e None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23c0bbd-2f74-461c-9900-08098449d80e None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23c0bbd-2f74-461c-9900-08098449d80e None admin] PATH_INFO: `/v3/services/glance` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23c0bbd-2f74-461c-9900-08098449d80e None admin] RBAC: Authorizing `identity:get_service(service_id=glance)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23c0bbd-2f74-461c-9900-08098449d80e None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-a23c0bbd-2f74-461c-9900-08098449d80e None admin] Could not find service: glance.: keystone.exception.ServiceNotFound: Could not find service: glance. May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 194, in get_service May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 189, in _get_service May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: glance. May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._get_service(service_id) May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: glance. May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25a96c9-5611-466f-accd-5c267c090ca4 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 293/601] 10.27.203.238 () {56 vars in 1108 bytes} [Tue May 28 12:37:25 2024] GET /identity/v3/services/glance => generated 87 bytes in 124 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23c0bbd-2f74-461c-9900-08098449d80e None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25a96c9-5611-466f-accd-5c267c090ca4 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23c0bbd-2f74-461c-9900-08098449d80e None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d25a043-a909-438f-bbde-c5fe9970ef8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d25a043-a909-438f-bbde-c5fe9970ef8d None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d25a043-a909-438f-bbde-c5fe9970ef8d None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d25a043-a909-438f-bbde-c5fe9970ef8d None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d25a043-a909-438f-bbde-c5fe9970ef8d None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d25a043-a909-438f-bbde-c5fe9970ef8d None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bbea01-52ca-4304-9849-44f6a1281dc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bbea01-52ca-4304-9849-44f6a1281dc2 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bbea01-52ca-4304-9849-44f6a1281dc2 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bbea01-52ca-4304-9849-44f6a1281dc2 None admin] PATH_INFO: `/v3/services` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bbea01-52ca-4304-9849-44f6a1281dc2 None admin] RBAC: Adding query filter params (name=glance) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bbea01-52ca-4304-9849-44f6a1281dc2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bbea01-52ca-4304-9849-44f6a1281dc2 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-1d25a043-a909-438f-bbde-c5fe9970ef8d None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 194, in get_service May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 189, in _get_service May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._get_service(service_id) May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 294/602] 10.27.203.238 () {56 vars in 1110 bytes} [Tue May 28 12:37:25 2024] GET /identity/v3/services?name=glance => generated 355 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 309/603] 10.27.203.238 () {56 vars in 1114 bytes} [Tue May 28 12:37:25 2024] GET /identity/v3/services/volumev3 => generated 89 bytes in 84 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bbea01-52ca-4304-9849-44f6a1281dc2 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d25a043-a909-438f-bbde-c5fe9970ef8d None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG dbcounter [-] [51266] Writing DB stats keystone:SELECT=8174,keystone:INSERT=44 {{(pid=51266) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d25a043-a909-438f-bbde-c5fe9970ef8d None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bbea01-52ca-4304-9849-44f6a1281dc2 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a0e03b-70cc-4779-b484-2b29186e2390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a0e03b-70cc-4779-b484-2b29186e2390 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a0e03b-70cc-4779-b484-2b29186e2390 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a0e03b-70cc-4779-b484-2b29186e2390 None admin] PATH_INFO: `/v3/services` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a0e03b-70cc-4779-b484-2b29186e2390 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=51267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a0e03b-70cc-4779-b484-2b29186e2390 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a0e03b-70cc-4779-b484-2b29186e2390 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7251d1f-7acc-4e20-a8bc-0f1748fd90af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7251d1f-7acc-4e20-a8bc-0f1748fd90af None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7251d1f-7acc-4e20-a8bc-0f1748fd90af None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7251d1f-7acc-4e20-a8bc-0f1748fd90af None admin] PATH_INFO: `/v3/regions/RegionOne` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7251d1f-7acc-4e20-a8bc-0f1748fd90af None admin] RBAC: Authorizing `identity:get_region(region_id=RegionOne)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 310/604] 10.27.203.238 () {56 vars in 1114 bytes} [Tue May 28 12:37:25 2024] GET /identity/v3/services?name=volumev3 => generated 127 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7251d1f-7acc-4e20-a8bc-0f1748fd90af None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a0e03b-70cc-4779-b484-2b29186e2390 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 295/605] 10.27.203.238 () {56 vars in 1114 bytes} [Tue May 28 12:37:25 2024] GET /identity/v3/regions/RegionOne => generated 150 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7251d1f-7acc-4e20-a8bc-0f1748fd90af None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a0e03b-70cc-4779-b484-2b29186e2390 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7251d1f-7acc-4e20-a8bc-0f1748fd90af None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a02e589-02cb-496e-b512-b5cf1d4f4e18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a02e589-02cb-496e-b512-b5cf1d4f4e18 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a02e589-02cb-496e-b512-b5cf1d4f4e18 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a02e589-02cb-496e-b512-b5cf1d4f4e18 None admin] PATH_INFO: `/v3/services` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a02e589-02cb-496e-b512-b5cf1d4f4e18 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=51267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a02e589-02cb-496e-b512-b5cf1d4f4e18 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a02e589-02cb-496e-b512-b5cf1d4f4e18 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce70be71-5a9c-4fdc-a7f0-7eaf5a88df0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce70be71-5a9c-4fdc-a7f0-7eaf5a88df0a None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce70be71-5a9c-4fdc-a7f0-7eaf5a88df0a None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce70be71-5a9c-4fdc-a7f0-7eaf5a88df0a None admin] PATH_INFO: `/v3/registered_limits` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce70be71-5a9c-4fdc-a7f0-7eaf5a88df0a None admin] RBAC: Authorizing `identity:create_registered_limits()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 311/606] 10.27.203.238 () {56 vars in 1114 bytes} [Tue May 28 12:37:25 2024] GET /identity/v3/services?type=volumev3 => generated 366 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce70be71-5a9c-4fdc-a7f0-7eaf5a88df0a None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a02e589-02cb-496e-b512-b5cf1d4f4e18 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 296/607] 10.27.203.238 () {60 vars in 1168 bytes} [Tue May 28 12:37:25 2024] POST /identity/v3/registered_limits => generated 332 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a02e589-02cb-496e-b512-b5cf1d4f4e18 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f33a2a-3ddf-4554-b5bb-abfc6b3f1817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f33a2a-3ddf-4554-b5bb-abfc6b3f1817 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f33a2a-3ddf-4554-b5bb-abfc6b3f1817 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f33a2a-3ddf-4554-b5bb-abfc6b3f1817 None admin] PATH_INFO: `/v3/endpoints` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f33a2a-3ddf-4554-b5bb-abfc6b3f1817 None admin] RBAC: Adding query filter params (interface=public, service_id=b64dd36eb99d496fbb2652c96970378a, region_id=RegionOne) {{(pid=51267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f33a2a-3ddf-4554-b5bb-abfc6b3f1817 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f33a2a-3ddf-4554-b5bb-abfc6b3f1817 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 312/608] 10.27.203.238 () {56 vars in 1251 bytes} [Tue May 28 12:37:25 2024] GET /identity/v3/endpoints?service_id=b64dd36eb99d496fbb2652c96970378a&interface=public®ion_id=RegionOne => generated 196 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce70be71-5a9c-4fdc-a7f0-7eaf5a88df0a None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce70be71-5a9c-4fdc-a7f0-7eaf5a88df0a None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b83aee1-e961-4958-a648-8e2ff42a8f9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b83aee1-e961-4958-a648-8e2ff42a8f9b None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b83aee1-e961-4958-a648-8e2ff42a8f9b None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b83aee1-e961-4958-a648-8e2ff42a8f9b None admin] PATH_INFO: `/v3/services` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b83aee1-e961-4958-a648-8e2ff42a8f9b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b83aee1-e961-4958-a648-8e2ff42a8f9b None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:25 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 297/609] 10.27.203.238 () {56 vars in 1087 bytes} [Tue May 28 12:37:25 2024] GET /identity/v3/services => generated 1512 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:37:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9aefe7-b187-4af8-9811-17cd11ef8a71 None None] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9aefe7-b187-4af8-9811-17cd11ef8a71 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9aefe7-b187-4af8-9811-17cd11ef8a71 None None] PATH_INFO: `/` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:26 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 313/610] 10.27.203.238 () {54 vars in 926 bytes} [Tue May 28 12:37:26 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:37:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882571bf-0215-44dc-af75-d96ccf0fc7fb None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882571bf-0215-44dc-af75-d96ccf0fc7fb None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882571bf-0215-44dc-af75-d96ccf0fc7fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:26 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-882571bf-0215-44dc-af75-d96ccf0fc7fb None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:37:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-882571bf-0215-44dc-af75-d96ccf0fc7fb None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:37:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-882571bf-0215-44dc-af75-d96ccf0fc7fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:37:26 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 298/611] 10.27.203.238 () {58 vars in 1023 bytes} [Tue May 28 12:37:26 2024] POST /identity/v3/auth/tokens => generated 1686 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 12:37:26 l75lg1-v1 dstat.sh[49771]: 28-05 12:37:26| 27 3 69 0 0|1530M 8225M 234M 5719M| 16k 258B| 0 700k| 0 57.0 |4758 8481 |2.69 1.25 0.78|3.0 0 29| 0 0 | 0 2048M| 19 31 0 5 0 May 28 12:37:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9aefe7-b187-4af8-9811-17cd11ef8a71 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG dbcounter [-] [51267] Writing DB stats keystone:SELECT=8445,keystone:INSERT=32 {{(pid=51267) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:37:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9aefe7-b187-4af8-9811-17cd11ef8a71 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0926a7-feef-40aa-acfe-ef7f547f13b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0926a7-feef-40aa-acfe-ef7f547f13b6 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0926a7-feef-40aa-acfe-ef7f547f13b6 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0926a7-feef-40aa-acfe-ef7f547f13b6 None admin] PATH_INFO: `/v3/services/compute` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0926a7-feef-40aa-acfe-ef7f547f13b6 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0926a7-feef-40aa-acfe-ef7f547f13b6 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:26 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-cb0926a7-feef-40aa-acfe-ef7f547f13b6 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 28 12:37:26 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:37:26 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 28 12:37:26 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 28 12:37:26 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 194, in get_service May 28 12:37:26 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 28 12:37:26 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 189, in _get_service May 28 12:37:26 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 28 12:37:26 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 28 12:37:26 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 12:37:26 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 28 12:37:26 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 12:37:26 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:37:26 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:37:26 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:37:26 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:37:26 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:37:26 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:37:26 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:37:26 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:37:26 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:37:26 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:37:26 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:37:26 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 28 12:37:26 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._get_service(service_id) May 28 12:37:26 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 28 12:37:26 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 28 12:37:26 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:37:26 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:37:26 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:37:26 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:37:26 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:37:26 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:37:26 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:37:26 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 12:37:26 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:37:26 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 12:37:26 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:37:26 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:37:26 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:37:26 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 12:37:26 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:37:26 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 12:37:26 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 28 12:37:26 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 28 12:37:26 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 28 12:37:26 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 12:37:26 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 314/612] 10.27.203.238 () {56 vars in 1111 bytes} [Tue May 28 12:37:26 2024] GET /identity/v3/services/compute => generated 88 bytes in 91 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 28 12:37:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882571bf-0215-44dc-af75-d96ccf0fc7fb None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882571bf-0215-44dc-af75-d96ccf0fc7fb None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b8a50c-1813-41f6-a30b-4cb97fb9026b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b8a50c-1813-41f6-a30b-4cb97fb9026b None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b8a50c-1813-41f6-a30b-4cb97fb9026b None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b8a50c-1813-41f6-a30b-4cb97fb9026b None admin] PATH_INFO: `/v3/services` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b8a50c-1813-41f6-a30b-4cb97fb9026b None admin] RBAC: Adding query filter params (name=compute) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:37:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b8a50c-1813-41f6-a30b-4cb97fb9026b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b8a50c-1813-41f6-a30b-4cb97fb9026b None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:26 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 299/613] 10.27.203.238 () {56 vars in 1112 bytes} [Tue May 28 12:37:26 2024] GET /identity/v3/services?name=compute => generated 126 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:37:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0926a7-feef-40aa-acfe-ef7f547f13b6 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0926a7-feef-40aa-acfe-ef7f547f13b6 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b4227d-445d-4c38-b8c2-7ea9cbaeebb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b4227d-445d-4c38-b8c2-7ea9cbaeebb1 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b4227d-445d-4c38-b8c2-7ea9cbaeebb1 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b4227d-445d-4c38-b8c2-7ea9cbaeebb1 None admin] PATH_INFO: `/v3/services` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b4227d-445d-4c38-b8c2-7ea9cbaeebb1 None admin] RBAC: Adding query filter params (type=compute) {{(pid=51267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:37:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b4227d-445d-4c38-b8c2-7ea9cbaeebb1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b4227d-445d-4c38-b8c2-7ea9cbaeebb1 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:26 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 315/614] 10.27.203.238 () {56 vars in 1112 bytes} [Tue May 28 12:37:26 2024] GET /identity/v3/services?type=compute => generated 126 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55cd1a6-a8ae-4949-8553-857ea25655f6 None None] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55cd1a6-a8ae-4949-8553-857ea25655f6 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55cd1a6-a8ae-4949-8553-857ea25655f6 None None] PATH_INFO: `/` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 300/615] 10.27.203.238 () {54 vars in 926 bytes} [Tue May 28 12:37:27 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d846f8-5dee-4845-914c-8c6bd5cc3542 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d846f8-5dee-4845-914c-8c6bd5cc3542 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d846f8-5dee-4845-914c-8c6bd5cc3542 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d81597-cd84-4612-a850-573aa8698369 None None] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d81597-cd84-4612-a850-573aa8698369 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d81597-cd84-4612-a850-573aa8698369 None None] PATH_INFO: `/` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 301/616] 10.27.203.238 () {54 vars in 926 bytes} [Tue May 28 12:37:27 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd85a2f1-f94e-4d48-bf81-fbec896d58c1 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd85a2f1-f94e-4d48-bf81-fbec896d58c1 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd85a2f1-f94e-4d48-bf81-fbec896d58c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-a1d846f8-5dee-4845-914c-8c6bd5cc3542 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-a1d846f8-5dee-4845-914c-8c6bd5cc3542 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-a1d846f8-5dee-4845-914c-8c6bd5cc3542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-bd85a2f1-f94e-4d48-bf81-fbec896d58c1 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-bd85a2f1-f94e-4d48-bf81-fbec896d58c1 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-bd85a2f1-f94e-4d48-bf81-fbec896d58c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 316/617] 10.27.203.238 () {58 vars in 1023 bytes} [Tue May 28 12:37:27 2024] POST /identity/v3/auth/tokens => generated 1686 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 302/618] 10.27.203.238 () {58 vars in 1023 bytes} [Tue May 28 12:37:27 2024] POST /identity/v3/auth/tokens => generated 1686 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 12:37:27 l75lg1-v1 dstat.sh[49771]: 28-05 12:37:27| 28 2 69 0 0|1566M 8189M 234M 5719M| 12k 86B| 0 256k| 0 23.0 |2947 4788 |2.69 1.25 0.78|3.0 0 21| 0 0 | 0 2048M| 19 33 0 6 0 May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d846f8-5dee-4845-914c-8c6bd5cc3542 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd85a2f1-f94e-4d48-bf81-fbec896d58c1 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d846f8-5dee-4845-914c-8c6bd5cc3542 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd85a2f1-f94e-4d48-bf81-fbec896d58c1 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c769291-2ba5-469e-9db6-b375a1ca00fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c769291-2ba5-469e-9db6-b375a1ca00fa None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c769291-2ba5-469e-9db6-b375a1ca00fa None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c769291-2ba5-469e-9db6-b375a1ca00fa None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c769291-2ba5-469e-9db6-b375a1ca00fa None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c769291-2ba5-469e-9db6-b375a1ca00fa None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-1c769291-2ba5-469e-9db6-b375a1ca00fa None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 194, in get_service May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 189, in _get_service May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._get_service(service_id) May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 317/619] 10.27.203.238 () {56 vars in 1114 bytes} [Tue May 28 12:37:27 2024] GET /identity/v3/services/volumev3 => generated 89 bytes in 82 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c769291-2ba5-469e-9db6-b375a1ca00fa None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00082f8-aa0f-425e-8afa-fa1bdd7a29ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00082f8-aa0f-425e-8afa-fa1bdd7a29ee None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00082f8-aa0f-425e-8afa-fa1bdd7a29ee None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00082f8-aa0f-425e-8afa-fa1bdd7a29ee None admin] PATH_INFO: `/v3/services/glance` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00082f8-aa0f-425e-8afa-fa1bdd7a29ee None admin] RBAC: Authorizing `identity:get_service(service_id=glance)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00082f8-aa0f-425e-8afa-fa1bdd7a29ee None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-f00082f8-aa0f-425e-8afa-fa1bdd7a29ee None admin] Could not find service: glance.: keystone.exception.ServiceNotFound: Could not find service: glance. May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 194, in get_service May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 189, in _get_service May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: glance. May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._get_service(service_id) May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: glance. May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 303/620] 10.27.203.238 () {56 vars in 1108 bytes} [Tue May 28 12:37:27 2024] GET /identity/v3/services/glance => generated 87 bytes in 89 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00082f8-aa0f-425e-8afa-fa1bdd7a29ee None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c769291-2ba5-469e-9db6-b375a1ca00fa None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6b0f78-71f5-4d9d-aa7b-d10a219fc5d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6b0f78-71f5-4d9d-aa7b-d10a219fc5d9 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6b0f78-71f5-4d9d-aa7b-d10a219fc5d9 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6b0f78-71f5-4d9d-aa7b-d10a219fc5d9 None admin] PATH_INFO: `/v3/services` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6b0f78-71f5-4d9d-aa7b-d10a219fc5d9 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=51267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6b0f78-71f5-4d9d-aa7b-d10a219fc5d9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00082f8-aa0f-425e-8afa-fa1bdd7a29ee None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6b0f78-71f5-4d9d-aa7b-d10a219fc5d9 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 318/621] 10.27.203.238 () {56 vars in 1114 bytes} [Tue May 28 12:37:27 2024] GET /identity/v3/services?name=volumev3 => generated 127 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6b0f78-71f5-4d9d-aa7b-d10a219fc5d9 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7012cd-7e70-4c19-a67d-afb14ea23f4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7012cd-7e70-4c19-a67d-afb14ea23f4e None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7012cd-7e70-4c19-a67d-afb14ea23f4e None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7012cd-7e70-4c19-a67d-afb14ea23f4e None admin] PATH_INFO: `/v3/services` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7012cd-7e70-4c19-a67d-afb14ea23f4e None admin] RBAC: Adding query filter params (name=glance) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7012cd-7e70-4c19-a67d-afb14ea23f4e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7012cd-7e70-4c19-a67d-afb14ea23f4e None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 304/622] 10.27.203.238 () {56 vars in 1110 bytes} [Tue May 28 12:37:27 2024] GET /identity/v3/services?name=glance => generated 355 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7012cd-7e70-4c19-a67d-afb14ea23f4e None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6b0f78-71f5-4d9d-aa7b-d10a219fc5d9 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25526752-7d35-479c-8f94-a32df85e471f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25526752-7d35-479c-8f94-a32df85e471f None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25526752-7d35-479c-8f94-a32df85e471f None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25526752-7d35-479c-8f94-a32df85e471f None admin] PATH_INFO: `/v3/services` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25526752-7d35-479c-8f94-a32df85e471f None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=51267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25526752-7d35-479c-8f94-a32df85e471f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25526752-7d35-479c-8f94-a32df85e471f None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 319/623] 10.27.203.238 () {56 vars in 1114 bytes} [Tue May 28 12:37:27 2024] GET /identity/v3/services?type=volumev3 => generated 366 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7012cd-7e70-4c19-a67d-afb14ea23f4e None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25526752-7d35-479c-8f94-a32df85e471f None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2e3ba4-0800-4d39-9261-ebdf283f0970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2e3ba4-0800-4d39-9261-ebdf283f0970 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2e3ba4-0800-4d39-9261-ebdf283f0970 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2e3ba4-0800-4d39-9261-ebdf283f0970 None admin] PATH_INFO: `/v3/regions/RegionOne` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2e3ba4-0800-4d39-9261-ebdf283f0970 None admin] RBAC: Authorizing `identity:get_region(region_id=RegionOne)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2e3ba4-0800-4d39-9261-ebdf283f0970 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 305/624] 10.27.203.238 () {56 vars in 1114 bytes} [Tue May 28 12:37:27 2024] GET /identity/v3/regions/RegionOne => generated 150 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2e3ba4-0800-4d39-9261-ebdf283f0970 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25526752-7d35-479c-8f94-a32df85e471f None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb61e039-cd1a-4d7c-ac60-16ee07cbc09a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb61e039-cd1a-4d7c-ac60-16ee07cbc09a None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb61e039-cd1a-4d7c-ac60-16ee07cbc09a None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb61e039-cd1a-4d7c-ac60-16ee07cbc09a None admin] PATH_INFO: `/v3/endpoints` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb61e039-cd1a-4d7c-ac60-16ee07cbc09a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb61e039-cd1a-4d7c-ac60-16ee07cbc09a None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2e3ba4-0800-4d39-9261-ebdf283f0970 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 320/625] 10.27.203.238 () {60 vars in 1144 bytes} [Tue May 28 12:37:27 2024] POST /identity/v3/endpoints => generated 350 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b562b9-e809-418b-8b05-e94e946e2fdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b562b9-e809-418b-8b05-e94e946e2fdb None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b562b9-e809-418b-8b05-e94e946e2fdb None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b562b9-e809-418b-8b05-e94e946e2fdb None admin] PATH_INFO: `/v3/registered_limits` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b562b9-e809-418b-8b05-e94e946e2fdb None admin] RBAC: Authorizing `identity:create_registered_limits()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b562b9-e809-418b-8b05-e94e946e2fdb None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 306/626] 10.27.203.238 () {60 vars in 1168 bytes} [Tue May 28 12:37:27 2024] POST /identity/v3/registered_limits => generated 331 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cb36f1-216f-4487-b1f0-40b2b893be14 None None] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cb36f1-216f-4487-b1f0-40b2b893be14 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cb36f1-216f-4487-b1f0-40b2b893be14 None None] PATH_INFO: `/` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 321/627] 10.27.203.238 () {54 vars in 926 bytes} [Tue May 28 12:37:27 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1afaf3-4900-40b2-9a66-57407140db5e None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1afaf3-4900-40b2-9a66-57407140db5e None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1afaf3-4900-40b2-9a66-57407140db5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-bc1afaf3-4900-40b2-9a66-57407140db5e None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-bc1afaf3-4900-40b2-9a66-57407140db5e None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:37:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-bc1afaf3-4900-40b2-9a66-57407140db5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:37:28 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 307/628] 10.27.203.238 () {58 vars in 1023 bytes} [Tue May 28 12:37:27 2024] POST /identity/v3/auth/tokens => generated 1686 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 12:37:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cb36f1-216f-4487-b1f0-40b2b893be14 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:28 l75lg1-v1 dstat.sh[49771]: 28-05 12:37:28| 28 3 68 0 0|1525M 8229M 234M 5719M| 14k 294B| 0 392k| 0 48.0 |5306 8918 |2.69 1.25 0.78|3.0 0 51| 0 0 | 0 2048M| 19 34 0 6 0 May 28 12:37:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cb36f1-216f-4487-b1f0-40b2b893be14 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4ad33b-ee55-40c4-88e1-f097a66526d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4ad33b-ee55-40c4-88e1-f097a66526d6 None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4ad33b-ee55-40c4-88e1-f097a66526d6 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4ad33b-ee55-40c4-88e1-f097a66526d6 None admin] PATH_INFO: `/v3/services` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4ad33b-ee55-40c4-88e1-f097a66526d6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4ad33b-ee55-40c4-88e1-f097a66526d6 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:28 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 322/629] 10.27.203.238 () {60 vars in 1141 bytes} [Tue May 28 12:37:28 2024] POST /identity/v3/services => generated 244 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8027986b-3ac5-422b-8aff-31a25c6e49da None None] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8027986b-3ac5-422b-8aff-31a25c6e49da None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8027986b-3ac5-422b-8aff-31a25c6e49da None None] PATH_INFO: `/` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 308/630] 10.27.203.238 () {54 vars in 926 bytes} [Tue May 28 12:37:29 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5517cd-236c-400f-a7c9-45772765d789 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5517cd-236c-400f-a7c9-45772765d789 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5517cd-236c-400f-a7c9-45772765d789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-5a5517cd-236c-400f-a7c9-45772765d789 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-5a5517cd-236c-400f-a7c9-45772765d789 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-5a5517cd-236c-400f-a7c9-45772765d789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a88b0c-0147-4e4e-b930-ba4e8d43d6c4 None None] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a88b0c-0147-4e4e-b930-ba4e8d43d6c4 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a88b0c-0147-4e4e-b930-ba4e8d43d6c4 None None] PATH_INFO: `/` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 309/631] 10.27.203.238 () {54 vars in 926 bytes} [Tue May 28 12:37:29 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58733799-f99e-41b4-9ddd-d1ad9a0a60ed None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58733799-f99e-41b4-9ddd-d1ad9a0a60ed None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58733799-f99e-41b4-9ddd-d1ad9a0a60ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-58733799-f99e-41b4-9ddd-d1ad9a0a60ed None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-58733799-f99e-41b4-9ddd-d1ad9a0a60ed None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-58733799-f99e-41b4-9ddd-d1ad9a0a60ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 323/632] 10.27.203.238 () {58 vars in 1023 bytes} [Tue May 28 12:37:29 2024] POST /identity/v3/auth/tokens => generated 1782 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 310/633] 10.27.203.238 () {58 vars in 1023 bytes} [Tue May 28 12:37:29 2024] POST /identity/v3/auth/tokens => generated 1782 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 28 12:37:29 l75lg1-v1 dstat.sh[49771]: 28-05 12:37:29| 27 3 69 0 0|1572M 8182M 234M 5719M| 22k 86B| 0 260k| 0 28.0 |2943 3639 |2.69 1.25 0.78|4.0 0 34| 0 0 | 0 2048M| 19 34 0 7 0 May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5517cd-236c-400f-a7c9-45772765d789 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58733799-f99e-41b4-9ddd-d1ad9a0a60ed None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5517cd-236c-400f-a7c9-45772765d789 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4f1ef5-4b6f-4411-b4cc-a20a1b625f64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4f1ef5-4b6f-4411-b4cc-a20a1b625f64 None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4f1ef5-4b6f-4411-b4cc-a20a1b625f64 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4f1ef5-4b6f-4411-b4cc-a20a1b625f64 None admin] PATH_INFO: `/v3/projects` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4f1ef5-4b6f-4411-b4cc-a20a1b625f64 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4f1ef5-4b6f-4411-b4cc-a20a1b625f64 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.server.flask.common [None req-2f4f1ef5-4b6f-4411-b4cc-a20a1b625f64 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.sql.core [None req-2f4f1ef5-4b6f-4411-b4cc-a20a1b625f64 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: [parameters: {'id': 'ca7ad9eb9d7b4b5c8d1afd0395d0c21b', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: (Background on this error at: https://sqlalche.me/e/20/gkpj) {{(pid=51267) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-2f4f1ef5-4b6f-4411-b4cc-a20a1b625f64 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id ca7ad9eb9d7b4b5c8d1afd0395d0c21b.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id ca7ad9eb9d7b4b5c8d1afd0395d0c21b. May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1967, in _exec_single_context May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application self.dialect.do_execute( May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 924, in do_execute May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/pymysql/cursors.py", line 153, in execute May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application result = self._query(query) May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/pymysql/cursors.py", line 322, in _query May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application conn.query(q) May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/pymysql/connections.py", line 558, in query May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/pymysql/connections.py", line 822, in _read_query_result May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application result.read() May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/pymysql/connections.py", line 1200, in read May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/pymysql/connections.py", line 772, in _read_packet May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application packet.raise_for_error() May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/pymysql/protocol.py", line 221, in raise_for_error May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/pymysql/err.py", line 143, in raise_mysql_exception May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 234, in create_project May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with sql.session_for_write() as session: May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application next(self.gen) May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/enginefacade.py", line 1042, in _transaction_scope May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with current._produce_block( May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application next(self.gen) May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/enginefacade.py", line 649, in _session May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with excutils.save_and_reraise_exception(): May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__ May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application self.force_reraise() May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise self.value May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/enginefacade.py", line 647, in _session May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/enginefacade.py", line 675, in _end_session_transaction May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application session.commit() May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2017, in commit May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application trans.commit(_to_root=True) May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "", line 2, in commit May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/sqlalchemy/orm/state_changes.py", line 139, in _go May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ret_value = fn(self, *arg, **kw) May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1302, in commit May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application self._prepare_impl() May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "", line 2, in _prepare_impl May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/sqlalchemy/orm/state_changes.py", line 139, in _go May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ret_value = fn(self, *arg, **kw) May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1277, in _prepare_impl May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application self.session.flush() May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 4341, in flush May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application self._flush(objects) May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 4476, in _flush May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with util.safe_reraise(): May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 146, in __exit__ May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exc_value.with_traceback(exc_tb) May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 4437, in _flush May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application flush_context.execute() May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 466, in execute May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rec.execute(self) May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 642, in execute May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 93, in save_obj May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application _emit_insert_statements( May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1048, in _emit_insert_statements May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application result = connection.execute( May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1418, in execute May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return meth( May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 515, in _execute_on_connection May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1640, in _execute_clauseelement May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ret = self._execute_context( May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1846, in _execute_context May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._exec_single_context( May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1986, in _exec_single_context May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 2350, in _handle_dbapi_exception May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise newraise.with_traceback(exc_info[2]) from e May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1967, in _exec_single_context May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application self.dialect.do_execute( May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 924, in do_execute May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/pymysql/cursors.py", line 153, in execute May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application result = self._query(query) May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/pymysql/cursors.py", line 322, in _query May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application conn.query(q) May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/pymysql/connections.py", line 558, in query May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/pymysql/connections.py", line 822, in _read_query_result May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application result.read() May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/pymysql/connections.py", line 1200, in read May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/pymysql/connections.py", line 772, in _read_packet May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application packet.raise_for_error() May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/pymysql/protocol.py", line 221, in raise_for_error May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/pymysql/err.py", line 143, in raise_mysql_exception May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [parameters: {'id': 'ca7ad9eb9d7b4b5c8d1afd0395d0c21b', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/20/gkpj) May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.Conflict( May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id ca7ad9eb9d7b4b5c8d1afd0395d0c21b. May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58733799-f99e-41b4-9ddd-d1ad9a0a60ed None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 324/634] 10.27.203.238 () {60 vars in 1140 bytes} [Tue May 28 12:37:29 2024] POST /identity/v3/projects => generated 262 bytes in 96 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4f1ef5-4b6f-4411-b4cc-a20a1b625f64 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2037adda-b845-4744-81bc-939557e3c198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2037adda-b845-4744-81bc-939557e3c198 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2037adda-b845-4744-81bc-939557e3c198 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2037adda-b845-4744-81bc-939557e3c198 None admin] PATH_INFO: `/v3/services/glance` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2037adda-b845-4744-81bc-939557e3c198 None admin] RBAC: Authorizing `identity:get_service(service_id=glance)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2037adda-b845-4744-81bc-939557e3c198 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-2037adda-b845-4744-81bc-939557e3c198 None admin] Could not find service: glance.: keystone.exception.ServiceNotFound: Could not find service: glance. May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 194, in get_service May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 189, in _get_service May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: glance. May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._get_service(service_id) May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: glance. May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 311/635] 10.27.203.238 () {56 vars in 1108 bytes} [Tue May 28 12:37:29 2024] GET /identity/v3/services/glance => generated 87 bytes in 85 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2037adda-b845-4744-81bc-939557e3c198 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4f1ef5-4b6f-4411-b4cc-a20a1b625f64 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2037adda-b845-4744-81bc-939557e3c198 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82423c30-c24e-4169-9fe5-712235430e99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82423c30-c24e-4169-9fe5-712235430e99 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82423c30-c24e-4169-9fe5-712235430e99 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82423c30-c24e-4169-9fe5-712235430e99 None admin] PATH_INFO: `/v3/projects/service` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82423c30-c24e-4169-9fe5-712235430e99 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82423c30-c24e-4169-9fe5-712235430e99 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-82423c30-c24e-4169-9fe5-712235430e99 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._get_project(project_id) May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 325/636] 10.27.203.238 () {56 vars in 1111 bytes} [Tue May 28 12:37:29 2024] GET /identity/v3/projects/service => generated 88 bytes in 94 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82423c30-c24e-4169-9fe5-712235430e99 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5135dc6-2d9a-4ae7-851d-85eaebb6acda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5135dc6-2d9a-4ae7-851d-85eaebb6acda None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5135dc6-2d9a-4ae7-851d-85eaebb6acda None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5135dc6-2d9a-4ae7-851d-85eaebb6acda None admin] PATH_INFO: `/v3/services` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5135dc6-2d9a-4ae7-851d-85eaebb6acda None admin] RBAC: Adding query filter params (name=glance) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5135dc6-2d9a-4ae7-851d-85eaebb6acda None admin] RBAC: Authorizing `identity:list_services()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5135dc6-2d9a-4ae7-851d-85eaebb6acda None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 312/637] 10.27.203.238 () {56 vars in 1110 bytes} [Tue May 28 12:37:29 2024] GET /identity/v3/services?name=glance => generated 355 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5135dc6-2d9a-4ae7-851d-85eaebb6acda None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82423c30-c24e-4169-9fe5-712235430e99 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5135dc6-2d9a-4ae7-851d-85eaebb6acda None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e51041-360f-44c4-baa7-2e8d463465dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e51041-360f-44c4-baa7-2e8d463465dc None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e51041-360f-44c4-baa7-2e8d463465dc None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e51041-360f-44c4-baa7-2e8d463465dc None admin] PATH_INFO: `/v3/projects` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e51041-360f-44c4-baa7-2e8d463465dc None admin] RBAC: Adding query filter params (name=service) {{(pid=51267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e51041-360f-44c4-baa7-2e8d463465dc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e51041-360f-44c4-baa7-2e8d463465dc None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5ea4ea-2ef8-4536-84ba-2efe3ed6705e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5ea4ea-2ef8-4536-84ba-2efe3ed6705e None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 326/638] 10.27.203.238 () {56 vars in 1112 bytes} [Tue May 28 12:37:29 2024] GET /identity/v3/projects?name=service => generated 415 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5ea4ea-2ef8-4536-84ba-2efe3ed6705e None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5ea4ea-2ef8-4536-84ba-2efe3ed6705e None admin] PATH_INFO: `/v3/regions/RegionOne` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5ea4ea-2ef8-4536-84ba-2efe3ed6705e None admin] RBAC: Authorizing `identity:get_region(region_id=RegionOne)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5ea4ea-2ef8-4536-84ba-2efe3ed6705e None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 313/639] 10.27.203.238 () {56 vars in 1114 bytes} [Tue May 28 12:37:29 2024] GET /identity/v3/regions/RegionOne => generated 150 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e51041-360f-44c4-baa7-2e8d463465dc None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e51041-360f-44c4-baa7-2e8d463465dc None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfecce9-fca2-469b-a4ef-5c1d984cce3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfecce9-fca2-469b-a4ef-5c1d984cce3e None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfecce9-fca2-469b-a4ef-5c1d984cce3e None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfecce9-fca2-469b-a4ef-5c1d984cce3e None admin] PATH_INFO: `/v3/registered_limits` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfecce9-fca2-469b-a4ef-5c1d984cce3e None admin] RBAC: Authorizing `identity:create_registered_limits()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfecce9-fca2-469b-a4ef-5c1d984cce3e None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ebee90-c841-4ee5-bf65-83113a31500d None None] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ebee90-c841-4ee5-bf65-83113a31500d None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ebee90-c841-4ee5-bf65-83113a31500d None None] PATH_INFO: `/` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 314/640] 10.27.203.238 () {54 vars in 926 bytes} [Tue May 28 12:37:29 2024] GET /identity => generated 272 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 327/641] 10.27.203.238 () {60 vars in 1168 bytes} [Tue May 28 12:37:29 2024] POST /identity/v3/registered_limits => generated 335 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd36fa5d-8177-4bf1-9324-41f00c3f465e None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd36fa5d-8177-4bf1-9324-41f00c3f465e None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd36fa5d-8177-4bf1-9324-41f00c3f465e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-bd36fa5d-8177-4bf1-9324-41f00c3f465e None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-bd36fa5d-8177-4bf1-9324-41f00c3f465e None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-bd36fa5d-8177-4bf1-9324-41f00c3f465e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:37:29 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 315/642] 10.27.203.238 () {58 vars in 1023 bytes} [Tue May 28 12:37:29 2024] POST /identity/v3/auth/tokens => generated 1782 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 12:37:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfecce9-fca2-469b-a4ef-5c1d984cce3e None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfecce9-fca2-469b-a4ef-5c1d984cce3e None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85d96dc-71f7-4540-b6e5-5e11a14ad556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85d96dc-71f7-4540-b6e5-5e11a14ad556 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85d96dc-71f7-4540-b6e5-5e11a14ad556 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85d96dc-71f7-4540-b6e5-5e11a14ad556 None admin] PATH_INFO: `/v3/services/compute` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85d96dc-71f7-4540-b6e5-5e11a14ad556 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85d96dc-71f7-4540-b6e5-5e11a14ad556 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:30 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-e85d96dc-71f7-4540-b6e5-5e11a14ad556 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 28 12:37:30 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:37:30 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 28 12:37:30 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 28 12:37:30 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 194, in get_service May 28 12:37:30 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 28 12:37:30 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 189, in _get_service May 28 12:37:30 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 28 12:37:30 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 28 12:37:30 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 12:37:30 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 28 12:37:30 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 12:37:30 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:37:30 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:37:30 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:37:30 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:37:30 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:37:30 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:37:30 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:37:30 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:37:30 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:37:30 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:37:30 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:37:30 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 28 12:37:30 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._get_service(service_id) May 28 12:37:30 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 28 12:37:30 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 28 12:37:30 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:37:30 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:37:30 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:37:30 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:37:30 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:37:30 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:37:30 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:37:30 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 12:37:30 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:37:30 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 12:37:30 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:37:30 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:37:30 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:37:30 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 12:37:30 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:37:30 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 12:37:30 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 28 12:37:30 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 28 12:37:30 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 28 12:37:30 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 12:37:30 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 328/643] 10.27.203.238 () {56 vars in 1111 bytes} [Tue May 28 12:37:30 2024] GET /identity/v3/services/compute => generated 88 bytes in 83 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 28 12:37:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd36fa5d-8177-4bf1-9324-41f00c3f465e None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd36fa5d-8177-4bf1-9324-41f00c3f465e None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b501f8a-a5d6-45c0-8341-ad43fe07f4a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b501f8a-a5d6-45c0-8341-ad43fe07f4a0 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b501f8a-a5d6-45c0-8341-ad43fe07f4a0 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b501f8a-a5d6-45c0-8341-ad43fe07f4a0 None admin] PATH_INFO: `/v3/services` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b501f8a-a5d6-45c0-8341-ad43fe07f4a0 None admin] RBAC: Adding query filter params (name=compute) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:37:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b501f8a-a5d6-45c0-8341-ad43fe07f4a0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b501f8a-a5d6-45c0-8341-ad43fe07f4a0 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:30 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 316/644] 10.27.203.238 () {56 vars in 1112 bytes} [Tue May 28 12:37:30 2024] GET /identity/v3/services?name=compute => generated 126 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:37:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85d96dc-71f7-4540-b6e5-5e11a14ad556 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85d96dc-71f7-4540-b6e5-5e11a14ad556 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:30 l75lg1-v1 dstat.sh[49771]: 28-05 12:37:30| 26 6 68 0 0|1515M 8239M 234M 5719M| 22k 86B| 0 520k| 0 45.0 |7156 12k|2.69 1.25 0.78|4.0 0 246| 0 0 | 0 2048M| 19 34 0 7 0 May 28 12:37:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f2761c-e1a1-423a-9d8e-ad9d9f559ceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f2761c-e1a1-423a-9d8e-ad9d9f559ceb None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f2761c-e1a1-423a-9d8e-ad9d9f559ceb None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f2761c-e1a1-423a-9d8e-ad9d9f559ceb None admin] PATH_INFO: `/v3/services` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f2761c-e1a1-423a-9d8e-ad9d9f559ceb None admin] RBAC: Adding query filter params (type=compute) {{(pid=51267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:37:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f2761c-e1a1-423a-9d8e-ad9d9f559ceb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f2761c-e1a1-423a-9d8e-ad9d9f559ceb None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:30 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 329/645] 10.27.203.238 () {56 vars in 1112 bytes} [Tue May 28 12:37:30 2024] GET /identity/v3/services?type=compute => generated 356 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:37:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b501f8a-a5d6-45c0-8341-ad43fe07f4a0 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b501f8a-a5d6-45c0-8341-ad43fe07f4a0 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0876325d-0626-4ca8-ab51-b0f424605f12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0876325d-0626-4ca8-ab51-b0f424605f12 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0876325d-0626-4ca8-ab51-b0f424605f12 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0876325d-0626-4ca8-ab51-b0f424605f12 None admin] PATH_INFO: `/v3/endpoints` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0876325d-0626-4ca8-ab51-b0f424605f12 None admin] RBAC: Adding query filter params (interface=public, service_id=69eda2dc23a84f7793e565c153f8422e, region_id=RegionOne) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:37:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0876325d-0626-4ca8-ab51-b0f424605f12 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0876325d-0626-4ca8-ab51-b0f424605f12 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:30 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 317/646] 10.27.203.238 () {56 vars in 1251 bytes} [Tue May 28 12:37:30 2024] GET /identity/v3/endpoints?service_id=69eda2dc23a84f7793e565c153f8422e&interface=public®ion_id=RegionOne => generated 196 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:37:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f2761c-e1a1-423a-9d8e-ad9d9f559ceb None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f2761c-e1a1-423a-9d8e-ad9d9f559ceb None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37eddd79-f683-4905-bb2e-ddb1880002e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eddd79-f683-4905-bb2e-ddb1880002e1 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eddd79-f683-4905-bb2e-ddb1880002e1 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eddd79-f683-4905-bb2e-ddb1880002e1 None admin] PATH_INFO: `/v3/services` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37eddd79-f683-4905-bb2e-ddb1880002e1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37eddd79-f683-4905-bb2e-ddb1880002e1 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:30 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 330/647] 10.27.203.238 () {56 vars in 1087 bytes} [Tue May 28 12:37:30 2024] GET /identity/v3/services => generated 1744 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d316b039-6c56-4fca-bbba-a2c7c7931bbd None None] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d316b039-6c56-4fca-bbba-a2c7c7931bbd None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d316b039-6c56-4fca-bbba-a2c7c7931bbd None None] PATH_INFO: `/` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 318/648] 10.27.203.238 () {54 vars in 926 bytes} [Tue May 28 12:37:31 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2953f02-67f2-4759-b66f-b7bcbcb683dd None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2953f02-67f2-4759-b66f-b7bcbcb683dd None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2953f02-67f2-4759-b66f-b7bcbcb683dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-d2953f02-67f2-4759-b66f-b7bcbcb683dd None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-d2953f02-67f2-4759-b66f-b7bcbcb683dd None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-d2953f02-67f2-4759-b66f-b7bcbcb683dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 331/649] 10.27.203.238 () {58 vars in 1023 bytes} [Tue May 28 12:37:31 2024] POST /identity/v3/auth/tokens => generated 1782 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 12:37:31 l75lg1-v1 dstat.sh[49771]: 28-05 12:37:31| 28 3 69 0 0|1572M 8182M 234M 5719M| 22k 86B| 0 4048k| 0 311 |3226 3856 |2.71 1.28 0.79|3.0 0 25| 0 0 | 0 2048M| 19 33 0 7 0 May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d316b039-6c56-4fca-bbba-a2c7c7931bbd None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57a7bdd-8b1f-428b-bb4d-db87b5884a0c None None] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57a7bdd-8b1f-428b-bb4d-db87b5884a0c None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57a7bdd-8b1f-428b-bb4d-db87b5884a0c None None] PATH_INFO: `/` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 332/650] 10.27.203.238 () {54 vars in 926 bytes} [Tue May 28 12:37:31 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5388ae9-9339-40f0-b87a-eeeec5bd0742 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5388ae9-9339-40f0-b87a-eeeec5bd0742 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5388ae9-9339-40f0-b87a-eeeec5bd0742 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d316b039-6c56-4fca-bbba-a2c7c7931bbd None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-c5388ae9-9339-40f0-b87a-eeeec5bd0742 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-c5388ae9-9339-40f0-b87a-eeeec5bd0742 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-c5388ae9-9339-40f0-b87a-eeeec5bd0742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3df2024-f280-4431-beda-346eead34876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3df2024-f280-4431-beda-346eead34876 None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3df2024-f280-4431-beda-346eead34876 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3df2024-f280-4431-beda-346eead34876 None admin] PATH_INFO: `/v3/users` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3df2024-f280-4431-beda-346eead34876 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3df2024-f280-4431-beda-346eead34876 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.server.flask.common [None req-e3df2024-f280-4431-beda-346eead34876 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-e3df2024-f280-4431-beda-346eead34876 None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 333/651] 10.27.203.238 () {58 vars in 1023 bytes} [Tue May 28 12:37:31 2024] POST /identity/v3/auth/tokens => generated 1782 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.sql.core [None req-e3df2024-f280-4431-beda-346eead34876 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: [parameters: {'user_id': '021498deb0d546d1848008c0d19e0d2e', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: (Background on this error at: https://sqlalche.me/e/20/gkpj) {{(pid=51266) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-e3df2024-f280-4431-beda-346eead34876 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1967, in _exec_single_context May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application self.dialect.do_execute( May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 924, in do_execute May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/pymysql/cursors.py", line 153, in execute May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application result = self._query(query) May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/pymysql/cursors.py", line 322, in _query May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application conn.query(q) May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/pymysql/connections.py", line 558, in query May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/pymysql/connections.py", line 822, in _read_query_result May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application result.read() May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/pymysql/connections.py", line 1200, in read May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/pymysql/connections.py", line 772, in _read_packet May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application packet.raise_for_error() May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/pymysql/protocol.py", line 221, in raise_for_error May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/pymysql/err.py", line 143, in raise_mysql_exception May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 132, in create_user May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with sql.session_for_write() as session: May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application next(self.gen) May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/enginefacade.py", line 1042, in _transaction_scope May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with current._produce_block( May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application next(self.gen) May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/enginefacade.py", line 649, in _session May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with excutils.save_and_reraise_exception(): May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__ May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application self.force_reraise() May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise self.value May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/enginefacade.py", line 647, in _session May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/enginefacade.py", line 675, in _end_session_transaction May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application session.commit() May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2017, in commit May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application trans.commit(_to_root=True) May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "", line 2, in commit May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/sqlalchemy/orm/state_changes.py", line 139, in _go May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ret_value = fn(self, *arg, **kw) May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1302, in commit May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application self._prepare_impl() May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "", line 2, in _prepare_impl May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/sqlalchemy/orm/state_changes.py", line 139, in _go May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ret_value = fn(self, *arg, **kw) May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1277, in _prepare_impl May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application self.session.flush() May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 4341, in flush May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application self._flush(objects) May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 4476, in _flush May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with util.safe_reraise(): May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 146, in __exit__ May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exc_value.with_traceback(exc_tb) May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 4437, in _flush May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application flush_context.execute() May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 466, in execute May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rec.execute(self) May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 642, in execute May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 93, in save_obj May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application _emit_insert_statements( May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1233, in _emit_insert_statements May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application result = connection.execute( May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1418, in execute May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return meth( May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 515, in _execute_on_connection May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1640, in _execute_clauseelement May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ret = self._execute_context( May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1846, in _execute_context May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._exec_single_context( May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1986, in _exec_single_context May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 2350, in _handle_dbapi_exception May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise newraise.with_traceback(exc_info[2]) from e May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1967, in _exec_single_context May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application self.dialect.do_execute( May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 924, in do_execute May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/pymysql/cursors.py", line 153, in execute May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application result = self._query(query) May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/pymysql/cursors.py", line 322, in _query May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application conn.query(q) May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/pymysql/connections.py", line 558, in query May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/pymysql/connections.py", line 822, in _read_query_result May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application result.read() May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/pymysql/connections.py", line 1200, in read May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/pymysql/connections.py", line 772, in _read_packet May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application packet.raise_for_error() May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/pymysql/protocol.py", line 221, in raise_for_error May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/pymysql/err.py", line 143, in raise_mysql_exception May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [parameters: {'user_id': '021498deb0d546d1848008c0d19e0d2e', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/20/gkpj) May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 319/652] 10.27.203.238 () {60 vars in 1131 bytes} [Tue May 28 12:37:31 2024] POST /identity/v3/users => generated 160 bytes in 152 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5388ae9-9339-40f0-b87a-eeeec5bd0742 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5388ae9-9339-40f0-b87a-eeeec5bd0742 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3770bb71-3528-4b61-9793-593e2f4d8e19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3770bb71-3528-4b61-9793-593e2f4d8e19 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3770bb71-3528-4b61-9793-593e2f4d8e19 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3770bb71-3528-4b61-9793-593e2f4d8e19 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3770bb71-3528-4b61-9793-593e2f4d8e19 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3770bb71-3528-4b61-9793-593e2f4d8e19 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-3770bb71-3528-4b61-9793-593e2f4d8e19 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._get_user(user_id) May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 334/653] 10.27.203.238 () {56 vars in 1099 bytes} [Tue May 28 12:37:31 2024] GET /identity/v3/users/cinder => generated 84 bytes in 97 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3df2024-f280-4431-beda-346eead34876 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3df2024-f280-4431-beda-346eead34876 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46420568-06aa-4f16-ba43-3639273b7a41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46420568-06aa-4f16-ba43-3639273b7a41 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46420568-06aa-4f16-ba43-3639273b7a41 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46420568-06aa-4f16-ba43-3639273b7a41 None admin] PATH_INFO: `/v3/users` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46420568-06aa-4f16-ba43-3639273b7a41 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46420568-06aa-4f16-ba43-3639273b7a41 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3770bb71-3528-4b61-9793-593e2f4d8e19 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46420568-06aa-4f16-ba43-3639273b7a41 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 320/654] 10.27.203.238 () {56 vars in 1101 bytes} [Tue May 28 12:37:31 2024] GET /identity/v3/users?name=cinder => generated 358 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3770bb71-3528-4b61-9793-593e2f4d8e19 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d6507b-071f-4c07-b45b-3c91bd397d3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d6507b-071f-4c07-b45b-3c91bd397d3b None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d6507b-071f-4c07-b45b-3c91bd397d3b None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d6507b-071f-4c07-b45b-3c91bd397d3b None admin] PATH_INFO: `/v3/services/glance` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d6507b-071f-4c07-b45b-3c91bd397d3b None admin] RBAC: Authorizing `identity:get_service(service_id=glance)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d6507b-071f-4c07-b45b-3c91bd397d3b None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-55d6507b-071f-4c07-b45b-3c91bd397d3b None admin] Could not find service: glance.: keystone.exception.ServiceNotFound: Could not find service: glance. May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 194, in get_service May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 189, in _get_service May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: glance. May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._get_service(service_id) May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: glance. May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 335/655] 10.27.203.238 () {56 vars in 1108 bytes} [Tue May 28 12:37:31 2024] GET /identity/v3/services/glance => generated 87 bytes in 89 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46420568-06aa-4f16-ba43-3639273b7a41 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46420568-06aa-4f16-ba43-3639273b7a41 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae4b462-e39b-46ec-80dd-fbcdea228ef1 None None] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae4b462-e39b-46ec-80dd-fbcdea228ef1 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae4b462-e39b-46ec-80dd-fbcdea228ef1 None None] PATH_INFO: `/` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 336/656] 10.27.203.238 () {54 vars in 926 bytes} [Tue May 28 12:37:31 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d4f436-9a2f-4622-b82c-29687925a7cb None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d4f436-9a2f-4622-b82c-29687925a7cb None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d4f436-9a2f-4622-b82c-29687925a7cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b127d80-a856-44c5-a9b2-d94ba6756b8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b127d80-a856-44c5-a9b2-d94ba6756b8c None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b127d80-a856-44c5-a9b2-d94ba6756b8c None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b127d80-a856-44c5-a9b2-d94ba6756b8c None admin] PATH_INFO: `/v3/services` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b127d80-a856-44c5-a9b2-d94ba6756b8c None admin] RBAC: Adding query filter params (name=glance) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b127d80-a856-44c5-a9b2-d94ba6756b8c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b127d80-a856-44c5-a9b2-d94ba6756b8c None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-60d4f436-9a2f-4622-b82c-29687925a7cb None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 321/657] 10.27.203.238 () {56 vars in 1110 bytes} [Tue May 28 12:37:31 2024] GET /identity/v3/services?name=glance => generated 355 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-60d4f436-9a2f-4622-b82c-29687925a7cb None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-60d4f436-9a2f-4622-b82c-29687925a7cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b127d80-a856-44c5-a9b2-d94ba6756b8c None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b127d80-a856-44c5-a9b2-d94ba6756b8c None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 337/658] 10.27.203.238 () {58 vars in 1023 bytes} [Tue May 28 12:37:31 2024] POST /identity/v3/auth/tokens => generated 1782 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febda168-8026-472f-8977-f594045639be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febda168-8026-472f-8977-f594045639be None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febda168-8026-472f-8977-f594045639be None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febda168-8026-472f-8977-f594045639be None admin] PATH_INFO: `/v3/endpoints` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febda168-8026-472f-8977-f594045639be None admin] RBAC: Adding query filter params (service_id=b5d296eb68964f14a9e57eb9d15e174d) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febda168-8026-472f-8977-f594045639be None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febda168-8026-472f-8977-f594045639be None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 322/659] 10.27.203.238 () {56 vars in 1177 bytes} [Tue May 28 12:37:31 2024] GET /identity/v3/endpoints?service_id=b5d296eb68964f14a9e57eb9d15e174d => generated 475 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:37:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d4f436-9a2f-4622-b82c-29687925a7cb None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d4f436-9a2f-4622-b82c-29687925a7cb None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14156117-e230-4d75-8569-5b7ad6654b4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14156117-e230-4d75-8569-5b7ad6654b4b None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14156117-e230-4d75-8569-5b7ad6654b4b None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14156117-e230-4d75-8569-5b7ad6654b4b None admin] PATH_INFO: `/v3/services` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14156117-e230-4d75-8569-5b7ad6654b4b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14156117-e230-4d75-8569-5b7ad6654b4b None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:32 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 338/660] 10.27.203.238 () {56 vars in 1087 bytes} [Tue May 28 12:37:31 2024] GET /identity/v3/services => generated 1744 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:37:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febda168-8026-472f-8977-f594045639be None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febda168-8026-472f-8977-f594045639be None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781b0147-8945-4502-a5d7-2ef2af9f37a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781b0147-8945-4502-a5d7-2ef2af9f37a8 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781b0147-8945-4502-a5d7-2ef2af9f37a8 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781b0147-8945-4502-a5d7-2ef2af9f37a8 None admin] PATH_INFO: `/v3/services/compute` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781b0147-8945-4502-a5d7-2ef2af9f37a8 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781b0147-8945-4502-a5d7-2ef2af9f37a8 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:32 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-781b0147-8945-4502-a5d7-2ef2af9f37a8 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 28 12:37:32 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:37:32 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 28 12:37:32 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 28 12:37:32 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 194, in get_service May 28 12:37:32 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 28 12:37:32 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 189, in _get_service May 28 12:37:32 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 28 12:37:32 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 28 12:37:32 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 12:37:32 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 28 12:37:32 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 12:37:32 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:37:32 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:37:32 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:37:32 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:37:32 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:37:32 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:37:32 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:37:32 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:37:32 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:37:32 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:37:32 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:37:32 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 28 12:37:32 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._get_service(service_id) May 28 12:37:32 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 28 12:37:32 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 28 12:37:32 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:37:32 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:37:32 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:37:32 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:37:32 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:37:32 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:37:32 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:37:32 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 12:37:32 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:37:32 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 12:37:32 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:37:32 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:37:32 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:37:32 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 12:37:32 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:37:32 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 12:37:32 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 28 12:37:32 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 28 12:37:32 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 28 12:37:32 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 12:37:32 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 323/661] 10.27.203.238 () {56 vars in 1111 bytes} [Tue May 28 12:37:32 2024] GET /identity/v3/services/compute => generated 88 bytes in 91 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 28 12:37:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14156117-e230-4d75-8569-5b7ad6654b4b None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:32 l75lg1-v1 dstat.sh[49771]: 28-05 12:37:32| 25 3 70 0 0|1489M 8265M 234M 5719M| 23k 576B| 0 548k| 0 22.0 |5765 11k|2.71 1.28 0.79|2.0 0 65| 0 0 | 0 2048M| 19 34 0 7 0 May 28 12:37:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14156117-e230-4d75-8569-5b7ad6654b4b None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550b6e74-64ed-4f40-923f-7dab8bc84ecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550b6e74-64ed-4f40-923f-7dab8bc84ecb None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550b6e74-64ed-4f40-923f-7dab8bc84ecb None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550b6e74-64ed-4f40-923f-7dab8bc84ecb None admin] PATH_INFO: `/v3/services` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550b6e74-64ed-4f40-923f-7dab8bc84ecb None admin] RBAC: Adding query filter params (name=compute) {{(pid=51267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:37:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550b6e74-64ed-4f40-923f-7dab8bc84ecb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550b6e74-64ed-4f40-923f-7dab8bc84ecb None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:32 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 339/662] 10.27.203.238 () {56 vars in 1112 bytes} [Tue May 28 12:37:32 2024] GET /identity/v3/services?name=compute => generated 126 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:37:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781b0147-8945-4502-a5d7-2ef2af9f37a8 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781b0147-8945-4502-a5d7-2ef2af9f37a8 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1a6c07-09ff-4d6e-99b5-cd913053f2ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1a6c07-09ff-4d6e-99b5-cd913053f2ae None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1a6c07-09ff-4d6e-99b5-cd913053f2ae None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1a6c07-09ff-4d6e-99b5-cd913053f2ae None admin] PATH_INFO: `/v3/services` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1a6c07-09ff-4d6e-99b5-cd913053f2ae None admin] RBAC: Adding query filter params (type=compute) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:37:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1a6c07-09ff-4d6e-99b5-cd913053f2ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1a6c07-09ff-4d6e-99b5-cd913053f2ae None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:32 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 324/663] 10.27.203.238 () {56 vars in 1112 bytes} [Tue May 28 12:37:32 2024] GET /identity/v3/services?type=compute => generated 356 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:37:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550b6e74-64ed-4f40-923f-7dab8bc84ecb None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550b6e74-64ed-4f40-923f-7dab8bc84ecb None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9c2a20-9881-4390-839c-31f243cc9d92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9c2a20-9881-4390-839c-31f243cc9d92 None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9c2a20-9881-4390-839c-31f243cc9d92 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9c2a20-9881-4390-839c-31f243cc9d92 None admin] PATH_INFO: `/v3/endpoints` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9c2a20-9881-4390-839c-31f243cc9d92 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9c2a20-9881-4390-839c-31f243cc9d92 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:32 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 340/664] 10.27.203.238 () {60 vars in 1144 bytes} [Tue May 28 12:37:32 2024] POST /identity/v3/endpoints => generated 338 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:37:33 l75lg1-v1 dstat.sh[49771]: 28-05 12:37:33| 15 5 80 1 0|1479M 8275M 235M 5719M| 13k 16k| 0 7055k| 0 266 |3987 5225 |2.71 1.28 0.79|1.0 0 230| 0 0 | 0 2048M| 19 33 0 5 0 May 28 12:37:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79d2a88-41bc-4585-af95-cf1003a459f9 None None] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79d2a88-41bc-4585-af95-cf1003a459f9 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79d2a88-41bc-4585-af95-cf1003a459f9 None None] PATH_INFO: `/` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:33 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 325/665] 10.27.203.238 () {54 vars in 926 bytes} [Tue May 28 12:37:33 2024] GET /identity => generated 272 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:37:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8b13f8-6c9f-4b73-8e18-2b08d08204a9 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8b13f8-6c9f-4b73-8e18-2b08d08204a9 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8b13f8-6c9f-4b73-8e18-2b08d08204a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:33 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-8c8b13f8-6c9f-4b73-8e18-2b08d08204a9 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:37:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-8c8b13f8-6c9f-4b73-8e18-2b08d08204a9 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:37:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-8c8b13f8-6c9f-4b73-8e18-2b08d08204a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:37:33 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 341/666] 10.27.203.238 () {58 vars in 1023 bytes} [Tue May 28 12:37:33 2024] POST /identity/v3/auth/tokens => generated 1940 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 12:37:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79d2a88-41bc-4585-af95-cf1003a459f9 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79d2a88-41bc-4585-af95-cf1003a459f9 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d83751-aca9-4bb9-be3b-c03d7f54e86b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d83751-aca9-4bb9-be3b-c03d7f54e86b None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d83751-aca9-4bb9-be3b-c03d7f54e86b None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d83751-aca9-4bb9-be3b-c03d7f54e86b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d83751-aca9-4bb9-be3b-c03d7f54e86b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 28 12:37:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-21d83751-aca9-4bb9-be3b-c03d7f54e86b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 28 12:37:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:37:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:37:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:37:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:37:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:37:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:37:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:37:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:37:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:37:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:37:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:37:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 28 12:37:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._get_role(role_id) May 28 12:37:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 28 12:37:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 28 12:37:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 28 12:37:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 28 12:37:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 28 12:37:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 28 12:37:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:37:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:37:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:37:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:37:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:37:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:37:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:37:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 12:37:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:37:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 12:37:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:37:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:37:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:37:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 12:37:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:37:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 12:37:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1281, in get_role May 28 12:37:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 28 12:37:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 28 12:37:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 28 12:37:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 28 12:37:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 28 12:37:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 28 12:37:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 12:37:33 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 326/667] 10.27.203.238 () {56 vars in 1099 bytes} [Tue May 28 12:37:33 2024] GET /identity/v3/roles/reader => generated 84 bytes in 91 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 28 12:37:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8b13f8-6c9f-4b73-8e18-2b08d08204a9 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8b13f8-6c9f-4b73-8e18-2b08d08204a9 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513f9203-5812-4530-98ea-2e6d11e59e06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513f9203-5812-4530-98ea-2e6d11e59e06 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513f9203-5812-4530-98ea-2e6d11e59e06 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513f9203-5812-4530-98ea-2e6d11e59e06 None admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513f9203-5812-4530-98ea-2e6d11e59e06 None admin] RBAC: Adding query filter params (name=reader) {{(pid=51267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:37:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513f9203-5812-4530-98ea-2e6d11e59e06 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513f9203-5812-4530-98ea-2e6d11e59e06 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:33 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 342/668] 10.27.203.238 () {56 vars in 1101 bytes} [Tue May 28 12:37:33 2024] GET /identity/v3/roles?name=reader => generated 345 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:37:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d83751-aca9-4bb9-be3b-c03d7f54e86b None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d83751-aca9-4bb9-be3b-c03d7f54e86b None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee3eb36-6fa3-45ee-8b0b-4eb17e0bdc93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee3eb36-6fa3-45ee-8b0b-4eb17e0bdc93 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee3eb36-6fa3-45ee-8b0b-4eb17e0bdc93 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee3eb36-6fa3-45ee-8b0b-4eb17e0bdc93 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee3eb36-6fa3-45ee-8b0b-4eb17e0bdc93 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee3eb36-6fa3-45ee-8b0b-4eb17e0bdc93 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-3ee3eb36-6fa3-45ee-8b0b-4eb17e0bdc93 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 28 12:37:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:37:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:37:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:37:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:37:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:37:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:37:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:37:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:37:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:37:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:37:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:37:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 28 12:37:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 28 12:37:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 28 12:37:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 28 12:37:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:37:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:37:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:37:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:37:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:37:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:37:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:37:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 12:37:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:37:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 12:37:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:37:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:37:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:37:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 12:37:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:37:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 12:37:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 28 12:37:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 28 12:37:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 28 12:37:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 12:37:34 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 327/669] 10.27.203.238 () {56 vars in 1108 bytes} [Tue May 28 12:37:33 2024] GET /identity/v3/domains/Default => generated 87 bytes in 93 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 28 12:37:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513f9203-5812-4530-98ea-2e6d11e59e06 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513f9203-5812-4530-98ea-2e6d11e59e06 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eea3371-45a9-4a68-8cb2-706a951821d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eea3371-45a9-4a68-8cb2-706a951821d5 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eea3371-45a9-4a68-8cb2-706a951821d5 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eea3371-45a9-4a68-8cb2-706a951821d5 None admin] PATH_INFO: `/v3/domains` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eea3371-45a9-4a68-8cb2-706a951821d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=51267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:37:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eea3371-45a9-4a68-8cb2-706a951821d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eea3371-45a9-4a68-8cb2-706a951821d5 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:34 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 343/670] 10.27.203.238 () {56 vars in 1109 bytes} [Tue May 28 12:37:34 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:37:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee3eb36-6fa3-45ee-8b0b-4eb17e0bdc93 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee3eb36-6fa3-45ee-8b0b-4eb17e0bdc93 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031fe2e8-92cd-4d17-873a-41f18a9c699a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031fe2e8-92cd-4d17-873a-41f18a9c699a None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031fe2e8-92cd-4d17-873a-41f18a9c699a None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031fe2e8-92cd-4d17-873a-41f18a9c699a None admin] PATH_INFO: `/v3/users/glance` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031fe2e8-92cd-4d17-873a-41f18a9c699a None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031fe2e8-92cd-4d17-873a-41f18a9c699a None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-031fe2e8-92cd-4d17-873a-41f18a9c699a None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 28 12:37:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:37:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:37:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:37:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:37:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:37:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:37:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:37:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:37:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:37:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:37:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:37:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 28 12:37:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._get_user(user_id) May 28 12:37:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 28 12:37:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 28 12:37:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:37:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:37:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 12:37:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:37:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 12:37:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:37:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:37:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:37:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:37:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:37:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:37:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 12:37:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:37:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 12:37:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:37:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:37:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:37:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 12:37:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:37:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 12:37:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 12:37:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 12:37:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 12:37:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 12:37:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 12:37:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 12:37:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 28 12:37:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 12:37:34 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 328/671] 10.27.203.238 () {56 vars in 1099 bytes} [Tue May 28 12:37:34 2024] GET /identity/v3/users/glance => generated 84 bytes in 94 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 28 12:37:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eea3371-45a9-4a68-8cb2-706a951821d5 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:34 l75lg1-v1 dstat.sh[49771]: 28-05 12:37:34| 10 1 89 0 0|1492M 8262M 235M 5720M| 13k 86B| 0 160k| 0 13.0 |3192 6102 |2.71 1.28 0.79|1.0 0 0| 0 0 | 0 2048M| 19 34 0 5 0 May 28 12:37:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eea3371-45a9-4a68-8cb2-706a951821d5 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a624e07-0a77-45cd-b094-506685fa9dde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a624e07-0a77-45cd-b094-506685fa9dde None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a624e07-0a77-45cd-b094-506685fa9dde None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a624e07-0a77-45cd-b094-506685fa9dde None admin] PATH_INFO: `/v3/users` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a624e07-0a77-45cd-b094-506685fa9dde None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=51267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:37:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a624e07-0a77-45cd-b094-506685fa9dde None admin] RBAC: Authorizing `identity:list_users()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a624e07-0a77-45cd-b094-506685fa9dde None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:34 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 344/672] 10.27.203.238 () {56 vars in 1137 bytes} [Tue May 28 12:37:34 2024] GET /identity/v3/users?domain_id=default&name=glance => generated 376 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:37:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031fe2e8-92cd-4d17-873a-41f18a9c699a None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:37:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031fe2e8-92cd-4d17-873a-41f18a9c699a None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:37:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8848cdfd-2aba-4bab-8310-830529975f6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:37:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8848cdfd-2aba-4bab-8310-830529975f6e None admin] REQUEST_METHOD: `PUT` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:37:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8848cdfd-2aba-4bab-8310-830529975f6e None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:37:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8848cdfd-2aba-4bab-8310-830529975f6e None admin] PATH_INFO: `/v3/system/users/d1436e60c2e34e0b8af9ae1c668bdf03/roles/20fc3860247242838aac793d192b83dc` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:37:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8848cdfd-2aba-4bab-8310-830529975f6e None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=d1436e60c2e34e0b8af9ae1c668bdf03, role_id=20fc3860247242838aac793d192b83dc)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:37:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8848cdfd-2aba-4bab-8310-830529975f6e None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:37:34 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 329/673] 10.27.203.238 () {58 vars in 1334 bytes} [Tue May 28 12:37:34 2024] PUT /identity/v3/system/users/d1436e60c2e34e0b8af9ae1c668bdf03/roles/20fc3860247242838aac793d192b83dc => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:37:35 l75lg1-v1 dstat.sh[49771]: 28-05 12:37:35| 5 7 88 0 0|1439M 8315M 235M 5720M| 22k 92k| 0 276k| 0 29.0 |4421 5202 |2.71 1.28 0.79|1.0 0 404| 0 0 | 0 2048M| 19 33 0 5 0 May 28 12:37:36 l75lg1-v1 dstat.sh[49771]: 28-05 12:37:36| 16 4 80 1 0|1539M 8215M 235M 5720M| 17k 3666B| 0 800k| 0 56.0 |2794 3279 |2.65 1.29 0.80|2.0 0 138| 0 0 | 0 2048M| 19 33 0 7 0 May 28 12:37:37 l75lg1-v1 dstat.sh[49771]: 28-05 12:37:37| 18 2 80 0 0|1607M 8144M 235M 5722M| 15k 86B|1480k 1456k|18.0 15.0 |1498 1514 |2.65 1.29 0.80|2.0 0 2.0| 0 0 | 0 2048M| 19 33 0 7 0 May 28 12:37:38 l75lg1-v1 dstat.sh[49771]: 28-05 12:37:38| 12 1 78 8 0|1534M 8214M 235M 5724M| 20k 258B| 0 7876k| 0 807 |6435 11k|2.65 1.29 0.80|1.0 2.0 33| 0 0 | 0 2048M| 19 37 0 7 0 May 28 12:37:39 l75lg1-v1 dstat.sh[49771]: 28-05 12:37:39| 11 1 76 11 0|1590M 8157M 236M 5725M| 12k 86B| 0 11M| 0 1062 |7221 12k|2.65 1.29 0.80|1.0 1.0 27| 0 0 | 0 2048M| 19 37 0 7 0 May 28 12:37:40 l75lg1-v1 dstat.sh[49771]: 28-05 12:37:40| 10 1 75 12 0|1629M 8116M 236M 5726M| 13k 86B| 0 12M| 0 1093 |6973 12k|2.65 1.29 0.80|1.0 2.0 14| 0 0 | 0 2048M| 19 37 0 7 0 May 28 12:37:41 l75lg1-v1 dstat.sh[49771]: 28-05 12:37:41| 11 2 78 9 0|1559M 8184M 237M 5727M| 12k 258B| 0 6156k| 0 796 |6699 11k|2.68 1.32 0.81|1.0 1.0 31| 0 0 | 0 2048M| 19 37 0 7 0 May 28 12:37:42 l75lg1-v1 dstat.sh[49771]: 28-05 12:37:42| 11 1 74 13 0|1612M 8131M 237M 5728M| 16k 86B| 0 9217k| 0 842 |5497 9529 |2.68 1.32 0.81|1.0 1.0 14| 0 0 | 0 2048M| 19 37 0 7 0 May 28 12:37:43 l75lg1-v1 dstat.sh[49771]: 28-05 12:37:43| 12 1 77 9 0|1526M 8216M 238M 5728M| 13k 86B| 0 6552k| 0 858 |6763 12k|2.68 1.32 0.81|1.0 1.0 22| 0 0 | 0 2048M| 19 37 0 6 0 May 28 12:37:44 l75lg1-v1 dstat.sh[49771]: 28-05 12:37:44| 12 1 74 12 0|1584M 8157M 238M 5729M| 12k 178B| 0 11M| 0 1043 |6050 11k|2.68 1.32 0.81|1.0 1.0 6.0| 0 0 | 0 2048M| 19 37 0 6 0 May 28 12:37:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG dbcounter [-] [51267] Writing DB stats keystone:SELECT=912,keystone:INSERT=5 {{(pid=51267) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:37:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG dbcounter [-] [51266] Writing DB stats keystone:SELECT=896,keystone:INSERT=5 {{(pid=51266) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:37:45 l75lg1-v1 dstat.sh[49771]: 28-05 12:37:45| 11 2 76 11 0|1625M 8114M 239M 5730M| 16k 723B| 0 12M| 0 1043 |6181 11k|2.68 1.32 0.81|1.0 1.0 5.0| 0 0 | 0 2048M| 19 37 0 6 0 May 28 12:37:46 l75lg1-v1 dstat.sh[49771]: 28-05 12:37:46| 14 2 75 8 0|1478M 8262M 239M 5729M| 12k 0 | 0 7992k| 0 819 |5384 9254 |2.79 1.37 0.83|2.0 1.0 7.0| 0 0 | 0 2048M| 19 33 0 6 0 May 28 12:37:47 l75lg1-v1 dstat.sh[49771]: 28-05 12:37:47| 19 2 78 2 0|1581M 8158M 239M 5729M| 10k 0 | 0 18M| 0 578 |2551 3329 |2.79 1.37 0.83|2.0 0 2.0| 0 0 | 0 2048M| 19 33 0 6 0 May 28 12:37:48 l75lg1-v1 dstat.sh[49771]: 28-05 12:37:48| 17 2 80 1 0|1627M 8112M 239M 5729M| 10k 0 | 0 5745k| 0 498 |3517 5302 |2.79 1.37 0.83|1.0 1.0 3.0| 0 0 | 0 2048M| 19 35 0 6 0 May 28 12:37:49 l75lg1-v1 dstat.sh[49771]: 28-05 12:37:49| 12 2 77 8 0|1576M 8163M 240M 5729M| 14k 172B| 0 5272k| 0 1096 |8882 15k|2.79 1.37 0.83|1.0 1.0 1.0| 0 0 | 0 2048M| 19 35 0 6 0 May 28 12:37:50 l75lg1-v1 dstat.sh[49771]: 28-05 12:37:50| 11 2 78 9 0|1617M 8121M 241M 5729M| 11k 0 | 0 4052k| 0 820 |7337 12k|2.79 1.37 0.83|3.0 1.0 2.0| 0 0 | 0 2048M| 19 35 0 6 0 May 28 12:37:51 l75lg1-v1 dstat.sh[49771]: 28-05 12:37:51| 12 1 77 9 0|1552M 8185M 241M 5729M| 13k 0 | 0 4312k| 0 831 |7345 12k|2.89 1.41 0.85|2.0 0 1.0| 0 0 | 0 2048M| 19 35 0 6 0 May 28 12:37:52 l75lg1-v1 dstat.sh[49771]: 28-05 12:37:52| 13 2 83 2 0|1533M 8204M 241M 5729M| 15k 482B| 0 1788k| 0 193 |2831 3725 |2.89 1.41 0.85|1.0 0 66| 0 0 | 0 2048M| 19 33 0 6 0 May 28 12:37:53 l75lg1-v1 dstat.sh[49771]: 28-05 12:37:53| 10 1 89 1 0|1558M 8178M 241M 5730M| 11k 0 | 0 924k| 0 59.0 |1276 1601 |2.89 1.41 0.85|1.0 0 0| 0 0 | 0 2048M| 19 33 0 6 0 May 28 12:37:54 l75lg1-v1 dstat.sh[49771]: 28-05 12:37:54| 9 1 85 4 0|1491M 8246M 241M 5730M| 11k 86B| 0 6017k| 0 448 |1864 2581 |2.89 1.41 0.85|2.0 1.0 1.0| 0 0 | 0 2048M| 19 33 0 6 0 May 28 12:37:55 l75lg1-v1 dstat.sh[49771]: 28-05 12:37:55| 9 1 87 2 0|1547M 8190M 241M 5730M| 16k 86B| 0 2820k| 0 176 |1606 2079 |2.89 1.41 0.85|2.0 0 2.0| 0 0 | 0 2048M| 19 33 0 6 0 May 28 12:37:56 l75lg1-v1 dstat.sh[49771]: 28-05 12:37:56| 9 1 90 0 0|1468M 8269M 241M 5730M| 11k 86B| 0 0 | 0 0 |1117 1270 |2.73 1.40 0.85|1.0 0 1.0| 0 0 | 0 2048M| 19 33 0 6 0 May 28 12:37:57 l75lg1-v1 dstat.sh[49771]: 28-05 12:37:57| 10 1 90 0 0|1513M 8223M 241M 5730M| 10k 258B| 0 0 | 0 0 |1042 1222 |2.73 1.40 0.85|1.0 0 0| 0 0 | 0 2048M| 19 33 0 6 0 May 28 12:37:58 l75lg1-v1 dstat.sh[49771]: 28-05 12:37:58| 9 1 90 0 0|1509M 8227M 241M 5730M| 10k 86B| 0 8193B| 0 1.00 |1119 1335 |2.73 1.40 0.85|1.0 0 3.0| 0 0 | 0 2048M| 19 33 0 6 0 May 28 12:37:59 l75lg1-v1 dstat.sh[49771]: 28-05 12:37:59| 9 1 89 0 0|1551M 8185M 241M 5730M| 15k 86B| 0 432k| 0 34.0 |1373 1797 |2.73 1.40 0.85|1.0 0 2.0| 0 0 | 0 2048M| 19 33 0 6 0 May 28 12:38:00 l75lg1-v1 dstat.sh[49771]: 28-05 12:38:00| 9 1 90 0 0|1485M 8251M 241M 5730M| 11k 86B| 0 88k| 0 5.00 |1125 1269 |2.73 1.40 0.85|1.0 0 1.0| 0 0 | 0 2048M| 19 33 0 6 0 May 28 12:38:01 l75lg1-v1 dstat.sh[49771]: 28-05 12:38:01| 9 1 89 0 0|1471M 8265M 241M 5730M| 13k 86B| 0 4093B| 0 1.00 |1114 1266 |2.59 1.40 0.85|2.0 0 1.0| 0 0 | 0 2048M| 19 33 0 6 0 May 28 12:38:02 l75lg1-v1 dstat.sh[49771]: 28-05 12:38:02| 9 1 90 0 0|1525M 8211M 241M 5730M| 19k 86B| 0 2192k| 0 236 |1143 1304 |2.59 1.40 0.85|3.0 0 0| 0 0 | 0 2048M| 19 33 0 6 0 May 28 12:38:03 l75lg1-v1 dstat.sh[49771]: 28-05 12:38:03| 9 1 90 0 0|1555M 8182M 241M 5730M| 16k 86B| 0 4099B| 0 1.00 |1132 1221 |2.59 1.40 0.85|1.0 0 2.0| 0 0 | 0 2048M| 19 33 0 6 0 May 28 12:38:04 l75lg1-v1 dstat.sh[49771]: 28-05 12:38:04| 6 6 89 0 0|1467M 8270M 241M 5730M| 22k 27k| 0 932k| 0 13.0 |3963 4452 |2.59 1.40 0.85|1.0 0 433| 0 0 | 0 2048M| 19 33 0 6 0 May 28 12:38:05 l75lg1-v1 dstat.sh[49771]: 28-05 12:38:05| 6 5 89 0 0|1488M 8249M 241M 5730M| 28k 24k| 0 888k| 0 82.0 |3581 3812 |2.59 1.40 0.85|1.0 1.0 350| 0 0 | 0 2048M| 19 33 0 6 0 May 28 12:38:06 l75lg1-v1 dstat.sh[49771]: 28-05 12:38:06| 9 1 89 0 0|1537M 8200M 241M 5730M| 15k 1139B| 0 4094B| 0 2.00 |1181 1327 |2.47 1.39 0.85|1.0 0 2.0| 0 0 | 0 2048M| 19 33 0 6 0 May 28 12:38:07 l75lg1-v1 dstat.sh[49771]: 28-05 12:38:07| 10 1 90 0 0|1563M 8174M 241M 5730M| 17k 86B| 0 632k| 0 18.0 |1054 1162 |2.47 1.39 0.85|1.0 0 0| 0 0 | 0 2048M| 19 33 0 6 0 May 28 12:38:08 l75lg1-v1 dstat.sh[49771]: 28-05 12:38:08| 9 1 90 0 0|1506M 8231M 241M 5730M| 11k 86B| 0 0 | 0 0 |1060 1242 |2.47 1.39 0.85|1.0 0 3.0| 0 0 | 0 2048M| 19 33 0 5 0 May 28 12:38:09 l75lg1-v1 dstat.sh[49771]: 28-05 12:38:09| 9 1 89 0 0|1547M 8190M 241M 5730M| 15k 128B| 0 512k| 0 42.0 |1448 1881 |2.47 1.39 0.85|1.0 0 2.0| 0 0 | 0 2048M| 19 33 0 5 0 May 28 12:38:10 l75lg1-v1 dstat.sh[49771]: 28-05 12:38:10| 9 1 90 0 0|1460M 8276M 241M 5730M| 11k 86B| 0 256k| 0 41.0 |1071 1238 |2.47 1.39 0.85|1.0 0 1.0| 0 0 | 0 2048M| 19 33 0 5 0 May 28 12:38:11 l75lg1-v1 dstat.sh[49771]: 28-05 12:38:11| 9 1 90 0 0|1518M 8218M 241M 5730M| 12k 86B| 0 0 | 0 0 |1111 1250 |2.35 1.38 0.85|2.0 0 0| 0 0 | 0 2048M| 19 33 0 5 0 May 28 12:38:12 l75lg1-v1 dstat.sh[49771]: 28-05 12:38:12| 10 1 90 0 0|1553M 8183M 241M 5730M| 16k 86B| 0 1064k| 0 27.0 |1107 1240 |2.35 1.38 0.85|1.0 0 2.0| 0 0 | 0 2048M| 19 33 0 5 0 May 28 12:38:13 l75lg1-v1 dstat.sh[49771]: 28-05 12:38:13| 9 1 90 0 0|1494M 8243M 241M 5730M| 11k 258B| 0 4096B| 0 1.00 |1064 1164 |2.35 1.38 0.85|1.0 0 1.0| 0 0 | 0 2048M| 19 33 0 5 0 May 28 12:38:14 l75lg1-v1 dstat.sh[49771]: 28-05 12:38:14| 9 1 90 0 0|1541M 8195M 241M 5730M| 11k 86B| 0 144k| 0 2.00 |1139 1302 |2.35 1.38 0.85|1.0 1.0 2.0| 0 0 | 0 2048M| 19 33 0 5 0 May 28 12:38:15 l75lg1-v1 dstat.sh[49771]: 28-05 12:38:15| 9 1 89 0 0|1474M 8262M 241M 5730M| 15k 86B| 0 20k| 0 4.00 |1123 1274 |2.35 1.38 0.85|1.0 0 1.0| 0 0 | 0 2048M| 19 33 0 5 0 May 28 12:38:16 l75lg1-v1 dstat.sh[49771]: 28-05 12:38:16| 9 1 90 0 0|1530M 8206M 241M 5730M| 11k 86B| 0 120k| 0 24.0 |1076 1242 |2.24 1.38 0.85|1.0 0 0| 0 0 | 0 2048M| 19 33 0 5 0 May 28 12:38:17 l75lg1-v1 dstat.sh[49771]: 28-05 12:38:17| 9 1 90 0 0|1563M 8173M 241M 5730M| 10k 86B| 0 20k| 0 1.00 |1122 1314 |2.24 1.38 0.85|1.0 0 2.0| 0 0 | 0 2048M| 19 33 0 5 0 May 28 12:38:18 l75lg1-v1 dstat.sh[49771]: 28-05 12:38:18| 9 1 90 0 0|1499M 8238M 241M 5730M| 13k 86B| 0 0 | 0 0 |1202 1338 |2.24 1.38 0.85|1.0 0 3.0| 0 0 | 0 2048M| 19 33 0 5 0 May 28 12:38:19 l75lg1-v1 dstat.sh[49771]: 28-05 12:38:19| 9 1 90 0 0|1543M 8193M 241M 5730M| 17k 86B| 0 424k| 0 43.0 |1473 1883 |2.24 1.38 0.85|1.0 0 2.0| 0 0 | 0 2048M| 19 33 0 5 0 May 28 12:38:20 l75lg1-v1 dstat.sh[49771]: 28-05 12:38:20| 9 1 90 0 0|1473M 8263M 241M 5730M| 13k 258B| 0 52k| 0 2.00 |1137 1243 |2.24 1.38 0.85|1.0 0 1.0| 0 0 | 0 2048M| 19 33 0 5 0 May 28 12:38:21 l75lg1-v1 dstat.sh[49771]: 28-05 12:38:21| 10 0 90 0 0|1528M 8209M 241M 5730M| 13k 86B| 0 128k| 0 25.0 |1146 1246 |2.14 1.37 0.85|1.0 0 0| 0 0 | 0 2048M| 19 33 0 5 0 May 28 12:38:22 l75lg1-v1 dstat.sh[49771]: 28-05 12:38:22| 12 2 86 0 0|1555M 8181M 241M 5730M| 16k 86B| 0 536k| 0 54.0 |1984 2944 |2.14 1.37 0.85|2.0 0 48| 0 0 | 0 2048M| 19 33 0 6 0 May 28 12:38:23 l75lg1-v1 dstat.sh[49771]: 28-05 12:38:23| 9 1 90 0 0|1486M 8250M 241M 5730M| 13k 86B| 0 0 | 0 0 |1179 1222 |2.14 1.37 0.85|1.0 0 1.0| 0 0 | 0 2048M| 19 33 0 6 0 May 28 12:38:24 l75lg1-v1 dstat.sh[49771]: 28-05 12:38:24| 9 1 90 0 0|1535M 8201M 241M 5730M| 15k 1681B| 0 152k| 0 5.00 |1230 1399 |2.14 1.37 0.85|1.0 0 2.0| 0 0 | 0 2048M| 19 33 0 5 0 May 28 12:38:25 l75lg1-v1 dstat.sh[49771]: 28-05 12:38:25| 10 1 89 0 0|1460M 8277M 241M 5730M| 17k 0 | 0 1928k| 0 107 |1350 1618 |2.14 1.37 0.85|1.0 0 1.0| 0 0 | 0 2048M| 19 33 0 5 0 May 28 12:38:26 l75lg1-v1 dstat.sh[49771]: 28-05 12:38:26| 9 1 90 0 0|1452M 8285M 241M 5730M| 14k 172B| 0 12k| 0 1.00 |1147 1245 |2.05 1.36 0.85|1.0 0 1.0| 0 0 | 0 2048M| 19 33 0 5 0 May 28 12:38:27 l75lg1-v1 dstat.sh[49771]: 28-05 12:38:27| 9 1 89 0 0|1508M 8229M 241M 5730M| 12k 0 | 0 128k| 0 27.0 |1102 1250 |2.05 1.36 0.85|1.0 0 0| 0 0 | 0 2048M| 19 33 0 5 0 May 28 12:38:28 l75lg1-v1 dstat.sh[49771]: 28-05 12:38:28| 9 1 90 0 0|1550M 8186M 241M 5730M| 11k 172B| 0 0 | 0 0 |1246 1394 |2.05 1.36 0.85|1.0 0 10| 0 0 | 0 2048M| 19 33 0 4 0 May 28 12:38:29 l75lg1-v1 dstat.sh[49771]: 28-05 12:38:29| 9 1 89 0 0|1484M 8252M 241M 5730M| 15k 42B| 0 444k| 0 38.0 |1381 1776 |2.05 1.36 0.85|1.0 0 1.0| 0 0 | 0 2048M| 19 33 0 4 0 May 28 12:38:30 l75lg1-v1 dstat.sh[49771]: 28-05 12:38:30| 10 1 90 0 0|1471M 8265M 241M 5730M| 12k 0 | 0 72k| 0 6.00 |1162 1324 |2.05 1.36 0.85|1.0 0 1.0| 0 0 | 0 2048M| 19 33 0 3 0 May 28 12:38:31 l75lg1-v1 dstat.sh[49771]: 28-05 12:38:31| 9 1 90 0 0|1527M 8209M 241M 5730M| 12k 0 | 0 4096B| 0 1.00 |1103 1278 |1.96 1.36 0.85|2.0 0 2.0| 0 0 | 0 2048M| 19 33 0 3 0 May 28 12:38:32 l75lg1-v1 dstat.sh[49771]: 28-05 12:38:32| 10 1 89 0 0|1554M 8182M 241M 5730M| 15k 0 | 0 128k| 0 24.0 |1086 1242 |1.96 1.36 0.85|1.0 0 0| 0 0 | 0 2048M| 19 33 0 3 0 May 28 12:38:33 l75lg1-v1 dstat.sh[49771]: 28-05 12:38:33| 7 5 89 0 0|1492M 8244M 241M 5730M| 15k 13k| 0 100k| 0 9.00 |2827 2967 |1.96 1.36 0.85|1.0 0 250| 0 0 | 0 2048M| 19 33 0 3 0 May 28 12:38:34 l75lg1-v1 dstat.sh[49771]: 28-05 12:38:34| 9 1 90 0 0|1543M 8193M 241M 5730M| 12k 86B| 0 0 | 0 0 |1069 1262 |1.96 1.36 0.85|1.0 0 0| 0 0 | 0 2048M| 19 33 0 3 0 May 28 12:38:35 l75lg1-v1 dstat.sh[49771]: 28-05 12:38:35| 9 1 89 0 0|1480M 8255M 241M 5730M| 22k 1908B| 0 180k| 0 1.00 |1322 1363 |1.96 1.36 0.85|1.0 1.0 5.0| 0 0 | 0 2048M| 19 33 0 3 0 May 28 12:38:36 l75lg1-v1 dstat.sh[49771]: 28-05 12:38:36| 9 1 90 0 0|1537M 8199M 241M 5730M| 19k 172B| 0 4096B| 0 2.00 |1177 1240 |1.89 1.35 0.86|1.0 0 0| 0 0 | 0 2048M| 19 33 0 3 0 May 28 12:38:37 l75lg1-v1 dstat.sh[49771]: 28-05 12:38:37| 8 3 89 0 0|1459M 8277M 241M 5730M| 18k 39k| 0 76k| 0 4.00 |2293 2599 |1.89 1.35 0.86|1.0 0 221| 0 0 | 0 2048M| 19 33 0 1 0 May 28 12:38:38 l75lg1-v1 dstat.sh[49771]: 28-05 12:38:38| 3 9 87 0 0|1472M 8264M 241M 5730M| 29k 37k| 0 1172k| 0 43.0 |5608 5978 |1.89 1.35 0.86|1.0 0 645| 0 0 | 0 2048M| 19 33 0 1 0 May 28 12:38:39 l75lg1-v1 dstat.sh[49771]: 28-05 12:38:39| 4 9 87 0 0|1474M 8261M 241M 5730M| 28k 27k| 0 2212k| 0 25.0 |5305 5582 |1.89 1.35 0.86|1.0 0 604| 0 0 | 0 2048M| 19 33 0 1 0 May 28 12:38:40 l75lg1-v1 dstat.sh[49771]: 28-05 12:38:40| 3 9 88 0 0|1475M 8261M 241M 5730M| 23k 37k| 0 820k| 0 18.0 |5491 5781 |1.89 1.35 0.86|1.0 0 627| 0 0 | 0 2048M| 19 33 0 1 0 May 28 12:38:41 l75lg1-v1 dstat.sh[49771]: 28-05 12:38:41| 19 10 70 1 0|1562M 8174M 241M 5730M| 15k 14k| 0 1304k| 0 91.0 |5016 5963 |1.98 1.38 0.87|5.0 0 498| 0 0 | 0 2048M| 19 33 0 7 0 May 28 12:38:42 l75lg1-v1 dstat.sh[49771]: 28-05 12:38:42| 28 2 70 0 0|1682M 8053M 241M 5731M| 15k 0 | 0 376k| 0 17.0 |1734 1666 |1.98 1.38 0.87|4.0 0 0| 0 0 | 0 2048M| 19 33 0 7 0 May 28 12:38:43 l75lg1-v1 dstat.sh[49771]: 28-05 12:38:43| 18 2 70 8 0|1734M 7997M 242M 5734M| 14k 0 | 388k 11M|5.00 823 |6509 11k|1.98 1.38 0.87|2.0 3.0 31| 0 0 | 0 2048M| 19 39 0 7 0 May 28 12:38:44 l75lg1-v1 dstat.sh[49771]: 28-05 12:38:44| 5 1 81 13 0|1739M 7988M 242M 5737M| 13k 447B| 0 14M| 0 1059 |7544 13k|1.98 1.38 0.87| 0 1.0 19| 0 0 | 0 2048M| 19 39 0 9 0 May 28 12:38:45 l75lg1-v1 dstat.sh[49771]: 28-05 12:38:45| 3 1 83 13 0|1740M 7985M 243M 5739M| 13k 0 | 0 13M| 0 1116 |7331 13k|1.98 1.38 0.87| 0 1.0 36| 0 0 | 0 2048M| 19 39 0 9 0 May 28 12:38:46 l75lg1-v1 dstat.sh[49771]: 28-05 12:38:46| 3 1 81 14 0|1740M 7983M 243M 5740M| 15k 0 | 0 15M| 0 1218 |7165 13k|2.22 1.44 0.89| 0 2.0 9.0| 0 0 | 0 2048M| 19 39 0 9 0 May 28 12:38:47 l75lg1-v1 dstat.sh[49771]: 28-05 12:38:47| 3 1 83 13 0|1739M 7982M 244M 5742M| 11k 0 | 0 15M| 0 1273 |7065 14k|2.22 1.44 0.89| 0 2.0 18| 0 0 | 0 2048M| 19 39 0 9 0 May 28 12:38:48 l75lg1-v1 dstat.sh[49771]: 28-05 12:38:48| 6 1 78 14 0|1686M 8033M 244M 5743M| 11k 0 | 0 14M| 0 1197 |7101 13k|2.22 1.44 0.89|1.0 1.0 41| 0 0 | 0 2048M| 19 37 0 9 0 May 28 12:38:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5a3f7b-fb91-4c60-abdc-29e217118803 None None] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:38:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5a3f7b-fb91-4c60-abdc-29e217118803 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:38:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5a3f7b-fb91-4c60-abdc-29e217118803 None None] PATH_INFO: `/` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:38:49 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 345/674] 10.27.203.238 () {54 vars in 926 bytes} [Tue May 28 12:38:49 2024] GET /identity => generated 272 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:38:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1ef993-61df-4b37-9da0-38651a36c65e None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:38:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1ef993-61df-4b37-9da0-38651a36c65e None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:38:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1ef993-61df-4b37-9da0-38651a36c65e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:38:49 l75lg1-v1 dstat.sh[49771]: 28-05 12:38:49| 11 2 73 14 0|1730M 7987M 245M 5745M| 17k 0 | 0 15M| 0 1241 |7606 13k|2.22 1.44 0.89| 0 2.0 13| 0 0 | 0 2048M| 19 38 0 9 0 May 28 12:38:49 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-1d1ef993-61df-4b37-9da0-38651a36c65e None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:38:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-1d1ef993-61df-4b37-9da0-38651a36c65e None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:38:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-1d1ef993-61df-4b37-9da0-38651a36c65e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:38:49 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 330/675] 10.27.203.238 () {58 vars in 1023 bytes} [Tue May 28 12:38:49 2024] POST /identity/v3/auth/tokens => generated 1940 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 12:38:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5a3f7b-fb91-4c60-abdc-29e217118803 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:38:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5a3f7b-fb91-4c60-abdc-29e217118803 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:38:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89411604-2ed1-408f-ab91-18c8bbc027f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:38:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89411604-2ed1-408f-ab91-18c8bbc027f9 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:38:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89411604-2ed1-408f-ab91-18c8bbc027f9 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:38:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89411604-2ed1-408f-ab91-18c8bbc027f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:38:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89411604-2ed1-408f-ab91-18c8bbc027f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:38:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89411604-2ed1-408f-ab91-18c8bbc027f9 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:38:49 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-89411604-2ed1-408f-ab91-18c8bbc027f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 28 12:38:49 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:38:49 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:38:49 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:38:49 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:38:49 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:38:49 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:38:49 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:38:49 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:38:49 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:38:49 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:38:49 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:38:49 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 28 12:38:49 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 28 12:38:49 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 28 12:38:49 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 28 12:38:49 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:38:49 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:38:49 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:38:49 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:38:49 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:38:49 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:38:49 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:38:49 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 12:38:49 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:38:49 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 12:38:49 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:38:49 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:38:49 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:38:49 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 12:38:49 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:38:49 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 12:38:49 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 28 12:38:49 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 28 12:38:49 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 28 12:38:49 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 12:38:49 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 346/676] 10.27.203.238 () {56 vars in 1108 bytes} [Tue May 28 12:38:49 2024] GET /identity/v3/domains/Default => generated 87 bytes in 102 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 28 12:38:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1ef993-61df-4b37-9da0-38651a36c65e None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:38:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1ef993-61df-4b37-9da0-38651a36c65e None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:38:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46b8c3b-e671-4983-9cca-e7275db75253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:38:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46b8c3b-e671-4983-9cca-e7275db75253 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:38:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46b8c3b-e671-4983-9cca-e7275db75253 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:38:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46b8c3b-e671-4983-9cca-e7275db75253 None admin] PATH_INFO: `/v3/domains` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:38:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46b8c3b-e671-4983-9cca-e7275db75253 None admin] RBAC: Adding query filter params (name=Default) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:38:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46b8c3b-e671-4983-9cca-e7275db75253 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:38:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46b8c3b-e671-4983-9cca-e7275db75253 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:38:49 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 331/677] 10.27.203.238 () {56 vars in 1109 bytes} [Tue May 28 12:38:49 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:38:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89411604-2ed1-408f-ab91-18c8bbc027f9 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:38:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89411604-2ed1-408f-ab91-18c8bbc027f9 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:38:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bd63df-2a15-4607-b15e-328dd14d587c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:38:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bd63df-2a15-4607-b15e-328dd14d587c None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:38:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bd63df-2a15-4607-b15e-328dd14d587c None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:38:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bd63df-2a15-4607-b15e-328dd14d587c None admin] PATH_INFO: `/v3/users` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:38:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bd63df-2a15-4607-b15e-328dd14d587c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:38:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bd63df-2a15-4607-b15e-328dd14d587c None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:38:49 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-c9bd63df-2a15-4607-b15e-328dd14d587c None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 12:38:49 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 347/678] 10.27.203.238 () {60 vars in 1132 bytes} [Tue May 28 12:38:49 2024] POST /identity/v3/users => generated 253 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:38:50 l75lg1-v1 dstat.sh[49771]: 28-05 12:38:50| 11 1 74 13 0|1687M 8028M 245M 5746M| 12k 335B| 0 14M| 0 1192 |9030 15k|2.22 1.44 0.89|2.0 1.0 53| 0 0 | 0 2048M| 19 37 0 9 0 May 28 12:38:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a96f3bf-7df0-48d7-92d1-24bdaf56c3ba None None] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:38:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a96f3bf-7df0-48d7-92d1-24bdaf56c3ba None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:38:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a96f3bf-7df0-48d7-92d1-24bdaf56c3ba None None] PATH_INFO: `/` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:38:51 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 332/679] 10.27.203.238 () {54 vars in 926 bytes} [Tue May 28 12:38:51 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:38:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26011ca4-bb27-4c1b-8fb8-943e6a1a5536 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:38:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26011ca4-bb27-4c1b-8fb8-943e6a1a5536 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:38:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26011ca4-bb27-4c1b-8fb8-943e6a1a5536 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:38:51 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-26011ca4-bb27-4c1b-8fb8-943e6a1a5536 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:38:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-26011ca4-bb27-4c1b-8fb8-943e6a1a5536 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:38:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-26011ca4-bb27-4c1b-8fb8-943e6a1a5536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:38:51 l75lg1-v1 dstat.sh[49771]: 28-05 12:38:51| 11 2 74 12 0|1728M 7985M 245M 5748M| 12k 0 | 0 14M| 0 1201 |7491 13k|2.36 1.48 0.91| 0 1.0 18| 0 0 | 0 2048M| 19 38 0 9 0 May 28 12:38:51 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 348/680] 10.27.203.238 () {58 vars in 1023 bytes} [Tue May 28 12:38:51 2024] POST /identity/v3/auth/tokens => generated 1940 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 12:38:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a96f3bf-7df0-48d7-92d1-24bdaf56c3ba None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:38:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a96f3bf-7df0-48d7-92d1-24bdaf56c3ba None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:38:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707705c8-0fcd-4b48-ab84-6e4e08c52adf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:38:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707705c8-0fcd-4b48-ab84-6e4e08c52adf None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:38:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707705c8-0fcd-4b48-ab84-6e4e08c52adf None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:38:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707705c8-0fcd-4b48-ab84-6e4e08c52adf None admin] PATH_INFO: `/v3/roles/service` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:38:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707705c8-0fcd-4b48-ab84-6e4e08c52adf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 28 12:38:51 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-707705c8-0fcd-4b48-ab84-6e4e08c52adf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 28 12:38:51 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:38:51 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:38:51 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:38:51 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:38:51 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:38:51 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:38:51 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:38:51 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:38:51 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:38:51 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:38:51 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:38:51 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 28 12:38:51 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._get_role(role_id) May 28 12:38:51 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 28 12:38:51 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 28 12:38:51 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 28 12:38:51 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 28 12:38:51 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 28 12:38:51 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 28 12:38:51 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:38:51 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:38:51 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:38:51 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:38:51 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:38:51 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:38:51 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:38:51 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 12:38:51 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:38:51 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 12:38:51 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:38:51 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:38:51 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:38:51 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 12:38:51 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:38:51 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 12:38:51 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1281, in get_role May 28 12:38:51 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 28 12:38:51 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 28 12:38:51 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 28 12:38:51 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 28 12:38:51 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 28 12:38:51 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 28 12:38:51 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 12:38:51 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 333/681] 10.27.203.238 () {56 vars in 1102 bytes} [Tue May 28 12:38:51 2024] GET /identity/v3/roles/service => generated 85 bytes in 119 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 28 12:38:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26011ca4-bb27-4c1b-8fb8-943e6a1a5536 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:38:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26011ca4-bb27-4c1b-8fb8-943e6a1a5536 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:38:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2710524-bf41-4bb8-a1ed-c93b39e7913b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:38:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2710524-bf41-4bb8-a1ed-c93b39e7913b None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:38:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2710524-bf41-4bb8-a1ed-c93b39e7913b None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:38:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2710524-bf41-4bb8-a1ed-c93b39e7913b None admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:38:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2710524-bf41-4bb8-a1ed-c93b39e7913b None admin] RBAC: Adding query filter params (name=service) {{(pid=51267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:38:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2710524-bf41-4bb8-a1ed-c93b39e7913b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:38:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2710524-bf41-4bb8-a1ed-c93b39e7913b None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:38:51 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 349/682] 10.27.203.238 () {56 vars in 1103 bytes} [Tue May 28 12:38:51 2024] GET /identity/v3/roles?name=service => generated 347 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:38:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707705c8-0fcd-4b48-ab84-6e4e08c52adf None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:38:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707705c8-0fcd-4b48-ab84-6e4e08c52adf None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:38:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865cbaae-aff3-40f8-b6de-6a3dc1727309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:38:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865cbaae-aff3-40f8-b6de-6a3dc1727309 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:38:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865cbaae-aff3-40f8-b6de-6a3dc1727309 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:38:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865cbaae-aff3-40f8-b6de-6a3dc1727309 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:38:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865cbaae-aff3-40f8-b6de-6a3dc1727309 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:38:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865cbaae-aff3-40f8-b6de-6a3dc1727309 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:38:51 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-865cbaae-aff3-40f8-b6de-6a3dc1727309 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 28 12:38:51 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:38:51 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:38:51 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:38:51 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:38:51 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:38:51 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:38:51 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:38:51 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:38:51 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:38:51 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:38:51 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:38:51 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 28 12:38:51 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 28 12:38:51 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 28 12:38:51 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 28 12:38:51 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:38:51 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:38:51 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:38:51 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:38:51 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:38:51 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:38:51 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:38:51 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 12:38:51 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:38:51 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 12:38:51 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:38:51 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:38:51 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:38:51 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 12:38:51 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:38:51 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 12:38:51 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 28 12:38:51 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 28 12:38:51 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 28 12:38:51 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 12:38:51 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 334/683] 10.27.203.238 () {56 vars in 1108 bytes} [Tue May 28 12:38:51 2024] GET /identity/v3/domains/Default => generated 87 bytes in 101 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 28 12:38:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2710524-bf41-4bb8-a1ed-c93b39e7913b None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:38:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2710524-bf41-4bb8-a1ed-c93b39e7913b None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:38:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58309ae-19ad-40d3-9349-e1d96d97bfbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:38:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58309ae-19ad-40d3-9349-e1d96d97bfbe None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:38:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58309ae-19ad-40d3-9349-e1d96d97bfbe None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:38:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58309ae-19ad-40d3-9349-e1d96d97bfbe None admin] PATH_INFO: `/v3/domains` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:38:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58309ae-19ad-40d3-9349-e1d96d97bfbe None admin] RBAC: Adding query filter params (name=Default) {{(pid=51267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:38:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58309ae-19ad-40d3-9349-e1d96d97bfbe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:38:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58309ae-19ad-40d3-9349-e1d96d97bfbe None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:38:51 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 350/684] 10.27.203.238 () {56 vars in 1109 bytes} [Tue May 28 12:38:51 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:38:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865cbaae-aff3-40f8-b6de-6a3dc1727309 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:38:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865cbaae-aff3-40f8-b6de-6a3dc1727309 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:38:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5068ef04-4595-4f00-a189-bc0a2c4f0074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:38:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5068ef04-4595-4f00-a189-bc0a2c4f0074 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:38:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5068ef04-4595-4f00-a189-bc0a2c4f0074 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:38:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5068ef04-4595-4f00-a189-bc0a2c4f0074 None admin] PATH_INFO: `/v3/users/placement` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:38:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5068ef04-4595-4f00-a189-bc0a2c4f0074 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:38:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5068ef04-4595-4f00-a189-bc0a2c4f0074 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:38:51 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-5068ef04-4595-4f00-a189-bc0a2c4f0074 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 28 12:38:51 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:38:51 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:38:51 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:38:51 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:38:51 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:38:51 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:38:51 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:38:51 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:38:51 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:38:51 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:38:51 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:38:51 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 28 12:38:51 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._get_user(user_id) May 28 12:38:51 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 28 12:38:51 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 28 12:38:51 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:38:51 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:38:51 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 12:38:51 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:38:51 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 12:38:51 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:38:51 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:38:51 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:38:51 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:38:51 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:38:51 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:38:51 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 12:38:51 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:38:51 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 12:38:51 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:38:51 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:38:51 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:38:51 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 12:38:51 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:38:51 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 12:38:51 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 12:38:51 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 12:38:51 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 12:38:51 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 12:38:51 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 12:38:51 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 12:38:51 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 28 12:38:51 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 12:38:51 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 335/685] 10.27.203.238 () {56 vars in 1108 bytes} [Tue May 28 12:38:51 2024] GET /identity/v3/users/placement => generated 87 bytes in 110 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 28 12:38:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58309ae-19ad-40d3-9349-e1d96d97bfbe None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:38:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58309ae-19ad-40d3-9349-e1d96d97bfbe None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:38:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5d62f4-0ed3-41b3-9a2d-1cbb73ac61a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:38:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5d62f4-0ed3-41b3-9a2d-1cbb73ac61a6 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:38:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5d62f4-0ed3-41b3-9a2d-1cbb73ac61a6 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:38:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5d62f4-0ed3-41b3-9a2d-1cbb73ac61a6 None admin] PATH_INFO: `/v3/users` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:38:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5d62f4-0ed3-41b3-9a2d-1cbb73ac61a6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=51267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:38:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5d62f4-0ed3-41b3-9a2d-1cbb73ac61a6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:38:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5d62f4-0ed3-41b3-9a2d-1cbb73ac61a6 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:38:52 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 351/686] 10.27.203.238 () {56 vars in 1143 bytes} [Tue May 28 12:38:51 2024] GET /identity/v3/users?domain_id=default&name=placement => generated 382 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:38:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5068ef04-4595-4f00-a189-bc0a2c4f0074 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:38:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5068ef04-4595-4f00-a189-bc0a2c4f0074 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:38:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102c27ac-7cbc-48ad-a6c6-0afe7fe85cb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:38:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102c27ac-7cbc-48ad-a6c6-0afe7fe85cb5 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:38:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102c27ac-7cbc-48ad-a6c6-0afe7fe85cb5 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:38:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102c27ac-7cbc-48ad-a6c6-0afe7fe85cb5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:38:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102c27ac-7cbc-48ad-a6c6-0afe7fe85cb5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:38:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102c27ac-7cbc-48ad-a6c6-0afe7fe85cb5 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:38:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-102c27ac-7cbc-48ad-a6c6-0afe7fe85cb5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 28 12:38:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:38:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:38:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:38:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:38:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:38:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:38:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:38:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:38:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:38:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:38:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:38:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 28 12:38:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 28 12:38:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 28 12:38:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 28 12:38:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:38:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:38:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:38:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:38:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:38:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:38:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:38:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 12:38:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:38:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 12:38:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:38:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:38:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:38:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 12:38:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:38:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 12:38:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 28 12:38:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 28 12:38:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 28 12:38:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 12:38:52 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 336/687] 10.27.203.238 () {56 vars in 1108 bytes} [Tue May 28 12:38:52 2024] GET /identity/v3/domains/Default => generated 87 bytes in 105 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 28 12:38:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5d62f4-0ed3-41b3-9a2d-1cbb73ac61a6 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:38:52 l75lg1-v1 dstat.sh[49771]: 28-05 12:38:52| 11 2 75 12 0|1728M 7982M 246M 5750M| 15k 172B| 0 16M| 0 1206 | 11k 19k|2.36 1.48 0.91|1.0 2.0 9.0| 0 0 | 0 2048M| 19 38 0 9 0 May 28 12:38:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5d62f4-0ed3-41b3-9a2d-1cbb73ac61a6 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:38:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e6fd5f-050b-4b38-906b-050e63ac8053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:38:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e6fd5f-050b-4b38-906b-050e63ac8053 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:38:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e6fd5f-050b-4b38-906b-050e63ac8053 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:38:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e6fd5f-050b-4b38-906b-050e63ac8053 None admin] PATH_INFO: `/v3/domains` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:38:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e6fd5f-050b-4b38-906b-050e63ac8053 None admin] RBAC: Adding query filter params (name=Default) {{(pid=51267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:38:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e6fd5f-050b-4b38-906b-050e63ac8053 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:38:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e6fd5f-050b-4b38-906b-050e63ac8053 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:38:52 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 352/688] 10.27.203.238 () {56 vars in 1109 bytes} [Tue May 28 12:38:52 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:38:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102c27ac-7cbc-48ad-a6c6-0afe7fe85cb5 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:38:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102c27ac-7cbc-48ad-a6c6-0afe7fe85cb5 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:38:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b895c8-73de-4a3c-a586-635b65b8512e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:38:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b895c8-73de-4a3c-a586-635b65b8512e None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:38:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b895c8-73de-4a3c-a586-635b65b8512e None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:38:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b895c8-73de-4a3c-a586-635b65b8512e None admin] PATH_INFO: `/v3/projects/service` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:38:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b895c8-73de-4a3c-a586-635b65b8512e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:38:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b895c8-73de-4a3c-a586-635b65b8512e None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:38:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-18b895c8-73de-4a3c-a586-635b65b8512e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 28 12:38:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:38:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:38:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:38:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:38:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:38:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:38:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:38:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:38:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:38:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:38:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:38:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 28 12:38:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._get_project(project_id) May 28 12:38:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 28 12:38:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 28 12:38:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:38:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:38:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:38:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:38:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:38:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:38:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:38:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 12:38:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:38:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 12:38:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:38:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:38:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:38:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 12:38:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:38:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 12:38:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 28 12:38:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 28 12:38:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 28 12:38:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 28 12:38:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 28 12:38:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 28 12:38:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 28 12:38:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 12:38:52 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 337/689] 10.27.203.238 () {56 vars in 1111 bytes} [Tue May 28 12:38:52 2024] GET /identity/v3/projects/service => generated 88 bytes in 97 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 28 12:38:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e6fd5f-050b-4b38-906b-050e63ac8053 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:38:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e6fd5f-050b-4b38-906b-050e63ac8053 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:38:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac913e75-780c-4656-b6a3-a42eab37b4b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:38:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac913e75-780c-4656-b6a3-a42eab37b4b2 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:38:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac913e75-780c-4656-b6a3-a42eab37b4b2 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:38:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac913e75-780c-4656-b6a3-a42eab37b4b2 None admin] PATH_INFO: `/v3/projects` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:38:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac913e75-780c-4656-b6a3-a42eab37b4b2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=51267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:38:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac913e75-780c-4656-b6a3-a42eab37b4b2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:38:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac913e75-780c-4656-b6a3-a42eab37b4b2 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:38:52 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 353/690] 10.27.203.238 () {56 vars in 1148 bytes} [Tue May 28 12:38:52 2024] GET /identity/v3/projects?domain_id=default&name=service => generated 433 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:38:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b895c8-73de-4a3c-a586-635b65b8512e None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:38:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b895c8-73de-4a3c-a586-635b65b8512e None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:38:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7fd861-d5aa-4ac4-a454-72b529257b58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:38:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7fd861-d5aa-4ac4-a454-72b529257b58 None admin] REQUEST_METHOD: `PUT` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:38:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7fd861-d5aa-4ac4-a454-72b529257b58 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:38:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7fd861-d5aa-4ac4-a454-72b529257b58 None admin] PATH_INFO: `/v3/projects/98a6a2dcbf0248d5b353760f7757f713/users/c3fe870f285d4169bd917382dd02d7b0/roles/14940fb5f1c44f629b6e1d8472832bd1` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:38:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7fd861-d5aa-4ac4-a454-72b529257b58 None admin] RBAC: Authorizing `identity:create_grant(project_id=98a6a2dcbf0248d5b353760f7757f713, user_id=c3fe870f285d4169bd917382dd02d7b0, role_id=14940fb5f1c44f629b6e1d8472832bd1)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:38:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7fd861-d5aa-4ac4-a454-72b529257b58 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:38:52 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 338/691] 10.27.203.238 () {58 vars in 1439 bytes} [Tue May 28 12:38:52 2024] PUT /identity/v3/projects/98a6a2dcbf0248d5b353760f7757f713/users/c3fe870f285d4169bd917382dd02d7b0/roles/14940fb5f1c44f629b6e1d8472832bd1 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:38:53 l75lg1-v1 dstat.sh[49771]: 28-05 12:38:53| 10 2 74 12 0|1698M 8011M 246M 5751M| 12k 0 | 0 14M| 0 1153 |8691 15k|2.36 1.48 0.91|2.0 0 39| 0 0 | 0 2048M| 19 37 0 9 0 May 28 12:38:53 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72561fbb-ec38-49ba-8cbe-4aaf991586f2 None None] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:38:53 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72561fbb-ec38-49ba-8cbe-4aaf991586f2 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:38:53 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72561fbb-ec38-49ba-8cbe-4aaf991586f2 None None] PATH_INFO: `/` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:38:53 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 354/692] 10.27.203.238 () {54 vars in 926 bytes} [Tue May 28 12:38:53 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:38:53 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa85a84-abae-4298-91bb-fa00dd6749ab None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:38:53 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa85a84-abae-4298-91bb-fa00dd6749ab None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:38:53 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa85a84-abae-4298-91bb-fa00dd6749ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-dfa85a84-abae-4298-91bb-fa00dd6749ab None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-dfa85a84-abae-4298-91bb-fa00dd6749ab None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-dfa85a84-abae-4298-91bb-fa00dd6749ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 339/693] 10.27.203.238 () {58 vars in 1023 bytes} [Tue May 28 12:38:53 2024] POST /identity/v3/auth/tokens => generated 1940 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 12:38:54 l75lg1-v1 dstat.sh[49771]: 28-05 12:38:54| 11 2 73 14 0|1729M 7978M 246M 5752M| 10k 0 | 0 16M| 0 1374 |7316 13k|2.36 1.48 0.91|1.0 1.0 6.0| 0 0 | 0 2048M| 19 39 0 9 0 May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72561fbb-ec38-49ba-8cbe-4aaf991586f2 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72561fbb-ec38-49ba-8cbe-4aaf991586f2 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e90cc33-fa57-4ffb-b6ce-4887c21f21e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e90cc33-fa57-4ffb-b6ce-4887c21f21e8 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e90cc33-fa57-4ffb-b6ce-4887c21f21e8 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e90cc33-fa57-4ffb-b6ce-4887c21f21e8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e90cc33-fa57-4ffb-b6ce-4887c21f21e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-2e90cc33-fa57-4ffb-b6ce-4887c21f21e8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._get_role(role_id) May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1281, in get_role May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 355/694] 10.27.203.238 () {56 vars in 1102 bytes} [Tue May 28 12:38:54 2024] GET /identity/v3/roles/service => generated 85 bytes in 91 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa85a84-abae-4298-91bb-fa00dd6749ab None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa85a84-abae-4298-91bb-fa00dd6749ab None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bcfed3-6ef1-4107-940c-67859eee9bd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bcfed3-6ef1-4107-940c-67859eee9bd6 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bcfed3-6ef1-4107-940c-67859eee9bd6 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bcfed3-6ef1-4107-940c-67859eee9bd6 None admin] PATH_INFO: `/v3/roles` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bcfed3-6ef1-4107-940c-67859eee9bd6 None admin] RBAC: Adding query filter params (name=service) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bcfed3-6ef1-4107-940c-67859eee9bd6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bcfed3-6ef1-4107-940c-67859eee9bd6 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 340/695] 10.27.203.238 () {56 vars in 1103 bytes} [Tue May 28 12:38:54 2024] GET /identity/v3/roles?name=service => generated 347 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e90cc33-fa57-4ffb-b6ce-4887c21f21e8 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e90cc33-fa57-4ffb-b6ce-4887c21f21e8 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18897614-d103-4332-b0cf-058a860fd10b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18897614-d103-4332-b0cf-058a860fd10b None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18897614-d103-4332-b0cf-058a860fd10b None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18897614-d103-4332-b0cf-058a860fd10b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18897614-d103-4332-b0cf-058a860fd10b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18897614-d103-4332-b0cf-058a860fd10b None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-18897614-d103-4332-b0cf-058a860fd10b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 356/696] 10.27.203.238 () {56 vars in 1108 bytes} [Tue May 28 12:38:54 2024] GET /identity/v3/domains/Default => generated 87 bytes in 108 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bcfed3-6ef1-4107-940c-67859eee9bd6 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bcfed3-6ef1-4107-940c-67859eee9bd6 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4209723c-198b-4093-901f-0752e93bdc72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4209723c-198b-4093-901f-0752e93bdc72 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4209723c-198b-4093-901f-0752e93bdc72 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4209723c-198b-4093-901f-0752e93bdc72 None admin] PATH_INFO: `/v3/domains` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4209723c-198b-4093-901f-0752e93bdc72 None admin] RBAC: Adding query filter params (name=Default) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4209723c-198b-4093-901f-0752e93bdc72 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4209723c-198b-4093-901f-0752e93bdc72 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 341/697] 10.27.203.238 () {56 vars in 1109 bytes} [Tue May 28 12:38:54 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18897614-d103-4332-b0cf-058a860fd10b None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18897614-d103-4332-b0cf-058a860fd10b None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e628968f-51aa-4996-932e-eda9ad8d3f35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e628968f-51aa-4996-932e-eda9ad8d3f35 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e628968f-51aa-4996-932e-eda9ad8d3f35 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e628968f-51aa-4996-932e-eda9ad8d3f35 None admin] PATH_INFO: `/v3/users/placement` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e628968f-51aa-4996-932e-eda9ad8d3f35 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e628968f-51aa-4996-932e-eda9ad8d3f35 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-e628968f-51aa-4996-932e-eda9ad8d3f35 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._get_user(user_id) May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 357/698] 10.27.203.238 () {56 vars in 1108 bytes} [Tue May 28 12:38:54 2024] GET /identity/v3/users/placement => generated 87 bytes in 89 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4209723c-198b-4093-901f-0752e93bdc72 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4209723c-198b-4093-901f-0752e93bdc72 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e5c02f-d38b-43d6-b076-5da868403fcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e5c02f-d38b-43d6-b076-5da868403fcc None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e5c02f-d38b-43d6-b076-5da868403fcc None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e5c02f-d38b-43d6-b076-5da868403fcc None admin] PATH_INFO: `/v3/users` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e5c02f-d38b-43d6-b076-5da868403fcc None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e5c02f-d38b-43d6-b076-5da868403fcc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e5c02f-d38b-43d6-b076-5da868403fcc None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 342/699] 10.27.203.238 () {56 vars in 1143 bytes} [Tue May 28 12:38:54 2024] GET /identity/v3/users?domain_id=default&name=placement => generated 382 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e628968f-51aa-4996-932e-eda9ad8d3f35 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e628968f-51aa-4996-932e-eda9ad8d3f35 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7778f04b-f590-44c1-881b-69e453326dda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7778f04b-f590-44c1-881b-69e453326dda None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7778f04b-f590-44c1-881b-69e453326dda None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7778f04b-f590-44c1-881b-69e453326dda None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7778f04b-f590-44c1-881b-69e453326dda None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:38:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7778f04b-f590-44c1-881b-69e453326dda None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:38:55 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 358/700] 10.27.203.238 () {58 vars in 1282 bytes} [Tue May 28 12:38:54 2024] GET /identity/v3/auth/tokens => generated 1940 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 28 12:38:55 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e5c02f-d38b-43d6-b076-5da868403fcc None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:38:55 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e5c02f-d38b-43d6-b076-5da868403fcc None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:38:55 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36840810-05fb-4204-8bdb-c8b6db6f5620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:38:55 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36840810-05fb-4204-8bdb-c8b6db6f5620 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:38:55 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36840810-05fb-4204-8bdb-c8b6db6f5620 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:38:55 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36840810-05fb-4204-8bdb-c8b6db6f5620 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:38:55 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36840810-05fb-4204-8bdb-c8b6db6f5620 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:38:55 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36840810-05fb-4204-8bdb-c8b6db6f5620 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:38:55 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-36840810-05fb-4204-8bdb-c8b6db6f5620 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 28 12:38:55 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:38:55 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:38:55 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:38:55 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:38:55 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:38:55 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:38:55 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:38:55 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:38:55 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:38:55 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:38:55 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:38:55 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 28 12:38:55 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 28 12:38:55 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 28 12:38:55 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 28 12:38:55 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:38:55 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:38:55 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:38:55 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:38:55 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:38:55 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:38:55 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:38:55 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 12:38:55 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:38:55 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 12:38:55 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:38:55 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:38:55 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:38:55 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 12:38:55 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:38:55 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 12:38:55 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 28 12:38:55 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 28 12:38:55 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 28 12:38:55 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 12:38:55 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 343/701] 10.27.203.238 () {56 vars in 1108 bytes} [Tue May 28 12:38:55 2024] GET /identity/v3/domains/Default => generated 87 bytes in 103 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 28 12:38:55 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7778f04b-f590-44c1-881b-69e453326dda None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:38:55 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7778f04b-f590-44c1-881b-69e453326dda None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:38:55 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce348bc-e8ee-4fd0-be3a-1e1764ef4602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:38:55 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce348bc-e8ee-4fd0-be3a-1e1764ef4602 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:38:55 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce348bc-e8ee-4fd0-be3a-1e1764ef4602 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:38:55 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce348bc-e8ee-4fd0-be3a-1e1764ef4602 None admin] PATH_INFO: `/v3/domains` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:38:55 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce348bc-e8ee-4fd0-be3a-1e1764ef4602 None admin] RBAC: Adding query filter params (name=Default) {{(pid=51267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:38:55 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce348bc-e8ee-4fd0-be3a-1e1764ef4602 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:38:55 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce348bc-e8ee-4fd0-be3a-1e1764ef4602 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:38:55 l75lg1-v1 dstat.sh[49771]: 28-05 12:38:55| 11 2 75 12 0|1729M 7977M 246M 5754M| 11k 208B| 0 14M| 0 1179 | 11k 20k|2.36 1.48 0.91|1.0 2.0 18| 0 0 | 0 2048M| 19 40 0 9 0 May 28 12:38:55 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 359/702] 10.27.203.238 () {56 vars in 1109 bytes} [Tue May 28 12:38:55 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:38:55 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36840810-05fb-4204-8bdb-c8b6db6f5620 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:38:55 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36840810-05fb-4204-8bdb-c8b6db6f5620 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:38:55 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb1e4e9-bbaf-4b5d-9df3-dec6ad17ac9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:38:55 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb1e4e9-bbaf-4b5d-9df3-dec6ad17ac9c None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:38:55 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb1e4e9-bbaf-4b5d-9df3-dec6ad17ac9c None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:38:55 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb1e4e9-bbaf-4b5d-9df3-dec6ad17ac9c None admin] PATH_INFO: `/v3/projects/service` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:38:55 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb1e4e9-bbaf-4b5d-9df3-dec6ad17ac9c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:38:55 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb1e4e9-bbaf-4b5d-9df3-dec6ad17ac9c None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:38:55 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-fcb1e4e9-bbaf-4b5d-9df3-dec6ad17ac9c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 28 12:38:55 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:38:55 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:38:55 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:38:55 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:38:55 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:38:55 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:38:55 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:38:55 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:38:55 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:38:55 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:38:55 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:38:55 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 28 12:38:55 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._get_project(project_id) May 28 12:38:55 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 28 12:38:55 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 28 12:38:55 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:38:55 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:38:55 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:38:55 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:38:55 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:38:55 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:38:55 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:38:55 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 12:38:55 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:38:55 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 12:38:55 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:38:55 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:38:55 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:38:55 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 12:38:55 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:38:55 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 12:38:55 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 28 12:38:55 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 28 12:38:55 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 28 12:38:55 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 28 12:38:55 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 28 12:38:55 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 28 12:38:55 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 28 12:38:55 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 12:38:55 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 344/703] 10.27.203.238 () {56 vars in 1111 bytes} [Tue May 28 12:38:55 2024] GET /identity/v3/projects/service => generated 88 bytes in 95 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 28 12:38:55 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce348bc-e8ee-4fd0-be3a-1e1764ef4602 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:38:55 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce348bc-e8ee-4fd0-be3a-1e1764ef4602 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:38:55 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133c11d5-7128-4ea4-b9b8-ba40fc0a87ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:38:55 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133c11d5-7128-4ea4-b9b8-ba40fc0a87ad None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:38:55 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133c11d5-7128-4ea4-b9b8-ba40fc0a87ad None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:38:55 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133c11d5-7128-4ea4-b9b8-ba40fc0a87ad None admin] PATH_INFO: `/v3/projects` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:38:55 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133c11d5-7128-4ea4-b9b8-ba40fc0a87ad None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=51267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:38:55 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133c11d5-7128-4ea4-b9b8-ba40fc0a87ad None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:38:55 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133c11d5-7128-4ea4-b9b8-ba40fc0a87ad None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:38:55 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 360/704] 10.27.203.238 () {56 vars in 1148 bytes} [Tue May 28 12:38:55 2024] GET /identity/v3/projects?domain_id=default&name=service => generated 433 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:38:55 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb1e4e9-bbaf-4b5d-9df3-dec6ad17ac9c None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:38:55 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb1e4e9-bbaf-4b5d-9df3-dec6ad17ac9c None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:38:55 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35659001-df9a-4419-9b16-29c2b59ab249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:38:55 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35659001-df9a-4419-9b16-29c2b59ab249 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:38:55 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35659001-df9a-4419-9b16-29c2b59ab249 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:38:55 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35659001-df9a-4419-9b16-29c2b59ab249 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:38:55 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35659001-df9a-4419-9b16-29c2b59ab249 None admin] RBAC: Adding query filter params (role.id=14940fb5f1c44f629b6e1d8472832bd1, scope.project.id=98a6a2dcbf0248d5b353760f7757f713, user.id=c3fe870f285d4169bd917382dd02d7b0) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:38:55 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35659001-df9a-4419-9b16-29c2b59ab249 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:38:55 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35659001-df9a-4419-9b16-29c2b59ab249 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:38:55 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 345/705] 10.27.203.238 () {56 vars in 1374 bytes} [Tue May 28 12:38:55 2024] GET /identity/v3/role_assignments?user.id=c3fe870f285d4169bd917382dd02d7b0&scope.project.id=98a6a2dcbf0248d5b353760f7757f713&role.id=14940fb5f1c44f629b6e1d8472832bd1 => generated 612 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:38:56 l75lg1-v1 dstat.sh[49771]: 28-05 12:38:56| 13 2 72 12 0|1696M 8008M 246M 5756M| 16k 0 | 0 15M| 0 1229 |9278 16k|2.57 1.54 0.93|2.0 3.0 37| 0 0 | 0 2048M| 19 39 0 9 0 May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a303250b-e557-4bbb-b8a2-be7889d37722 None None] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a303250b-e557-4bbb-b8a2-be7889d37722 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a303250b-e557-4bbb-b8a2-be7889d37722 None None] PATH_INFO: `/` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 361/706] 10.27.203.238 () {54 vars in 926 bytes} [Tue May 28 12:38:57 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7f7d4e-50e9-4574-8f90-c42d1338fa09 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7f7d4e-50e9-4574-8f90-c42d1338fa09 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7f7d4e-50e9-4574-8f90-c42d1338fa09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-4a7f7d4e-50e9-4574-8f90-c42d1338fa09 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-4a7f7d4e-50e9-4574-8f90-c42d1338fa09 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-4a7f7d4e-50e9-4574-8f90-c42d1338fa09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 346/707] 10.27.203.238 () {58 vars in 1023 bytes} [Tue May 28 12:38:57 2024] POST /identity/v3/auth/tokens => generated 1940 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 12:38:57 l75lg1-v1 dstat.sh[49771]: 28-05 12:38:57| 11 2 75 12 0|1726M 7977M 246M 5757M| 11k 0 | 0 14M| 0 1182 |7315 13k|2.57 1.54 0.93|1.0 1.0 3.0| 0 0 | 0 2048M| 19 39 0 9 0 May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a303250b-e557-4bbb-b8a2-be7889d37722 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a303250b-e557-4bbb-b8a2-be7889d37722 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e65a0ba-17a1-4f62-b026-23a53a547c89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e65a0ba-17a1-4f62-b026-23a53a547c89 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e65a0ba-17a1-4f62-b026-23a53a547c89 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e65a0ba-17a1-4f62-b026-23a53a547c89 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e65a0ba-17a1-4f62-b026-23a53a547c89 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-1e65a0ba-17a1-4f62-b026-23a53a547c89 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._get_role(role_id) May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1281, in get_role May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 362/708] 10.27.203.238 () {56 vars in 1096 bytes} [Tue May 28 12:38:57 2024] GET /identity/v3/roles/admin => generated 83 bytes in 101 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7f7d4e-50e9-4574-8f90-c42d1338fa09 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7f7d4e-50e9-4574-8f90-c42d1338fa09 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bd27bd-89e1-42d1-baca-57639a1721a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bd27bd-89e1-42d1-baca-57639a1721a1 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bd27bd-89e1-42d1-baca-57639a1721a1 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bd27bd-89e1-42d1-baca-57639a1721a1 None admin] PATH_INFO: `/v3/roles` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bd27bd-89e1-42d1-baca-57639a1721a1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bd27bd-89e1-42d1-baca-57639a1721a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bd27bd-89e1-42d1-baca-57639a1721a1 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 347/709] 10.27.203.238 () {56 vars in 1099 bytes} [Tue May 28 12:38:57 2024] GET /identity/v3/roles?name=admin => generated 343 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e65a0ba-17a1-4f62-b026-23a53a547c89 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e65a0ba-17a1-4f62-b026-23a53a547c89 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06b27dc-9fec-4fda-98ce-6d5ee1c9becd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06b27dc-9fec-4fda-98ce-6d5ee1c9becd None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06b27dc-9fec-4fda-98ce-6d5ee1c9becd None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06b27dc-9fec-4fda-98ce-6d5ee1c9becd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06b27dc-9fec-4fda-98ce-6d5ee1c9becd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06b27dc-9fec-4fda-98ce-6d5ee1c9becd None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-a06b27dc-9fec-4fda-98ce-6d5ee1c9becd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 363/710] 10.27.203.238 () {56 vars in 1108 bytes} [Tue May 28 12:38:57 2024] GET /identity/v3/domains/Default => generated 87 bytes in 108 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bd27bd-89e1-42d1-baca-57639a1721a1 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bd27bd-89e1-42d1-baca-57639a1721a1 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c62f7d-5726-4098-97fe-699673165bf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c62f7d-5726-4098-97fe-699673165bf3 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c62f7d-5726-4098-97fe-699673165bf3 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c62f7d-5726-4098-97fe-699673165bf3 None admin] PATH_INFO: `/v3/domains` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c62f7d-5726-4098-97fe-699673165bf3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c62f7d-5726-4098-97fe-699673165bf3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c62f7d-5726-4098-97fe-699673165bf3 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 348/711] 10.27.203.238 () {56 vars in 1109 bytes} [Tue May 28 12:38:57 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06b27dc-9fec-4fda-98ce-6d5ee1c9becd None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06b27dc-9fec-4fda-98ce-6d5ee1c9becd None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837a7a83-7b0d-47ea-8a9a-98afbba9d06a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837a7a83-7b0d-47ea-8a9a-98afbba9d06a None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837a7a83-7b0d-47ea-8a9a-98afbba9d06a None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837a7a83-7b0d-47ea-8a9a-98afbba9d06a None admin] PATH_INFO: `/v3/users/placement` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837a7a83-7b0d-47ea-8a9a-98afbba9d06a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837a7a83-7b0d-47ea-8a9a-98afbba9d06a None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-837a7a83-7b0d-47ea-8a9a-98afbba9d06a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._get_user(user_id) May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 364/712] 10.27.203.238 () {56 vars in 1108 bytes} [Tue May 28 12:38:57 2024] GET /identity/v3/users/placement => generated 87 bytes in 137 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c62f7d-5726-4098-97fe-699673165bf3 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c62f7d-5726-4098-97fe-699673165bf3 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22245500-784a-4ff4-9b85-181b0cc30f8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22245500-784a-4ff4-9b85-181b0cc30f8b None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22245500-784a-4ff4-9b85-181b0cc30f8b None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22245500-784a-4ff4-9b85-181b0cc30f8b None admin] PATH_INFO: `/v3/users` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22245500-784a-4ff4-9b85-181b0cc30f8b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22245500-784a-4ff4-9b85-181b0cc30f8b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22245500-784a-4ff4-9b85-181b0cc30f8b None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 349/713] 10.27.203.238 () {56 vars in 1143 bytes} [Tue May 28 12:38:57 2024] GET /identity/v3/users?domain_id=default&name=placement => generated 382 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837a7a83-7b0d-47ea-8a9a-98afbba9d06a None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:38:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837a7a83-7b0d-47ea-8a9a-98afbba9d06a None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:38:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08af11cc-2c8d-4547-b032-428ba1f8654c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:38:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08af11cc-2c8d-4547-b032-428ba1f8654c None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:38:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08af11cc-2c8d-4547-b032-428ba1f8654c None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:38:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08af11cc-2c8d-4547-b032-428ba1f8654c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:38:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08af11cc-2c8d-4547-b032-428ba1f8654c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:38:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08af11cc-2c8d-4547-b032-428ba1f8654c None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:38:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-08af11cc-2c8d-4547-b032-428ba1f8654c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 28 12:38:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:38:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:38:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:38:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:38:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:38:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:38:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:38:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:38:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:38:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:38:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:38:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 28 12:38:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 28 12:38:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 28 12:38:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 28 12:38:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:38:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:38:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:38:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:38:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:38:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:38:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:38:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 12:38:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:38:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 12:38:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:38:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:38:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:38:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 12:38:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:38:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 12:38:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 28 12:38:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 28 12:38:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 28 12:38:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 12:38:58 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 365/714] 10.27.203.238 () {56 vars in 1108 bytes} [Tue May 28 12:38:57 2024] GET /identity/v3/domains/Default => generated 87 bytes in 90 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 28 12:38:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22245500-784a-4ff4-9b85-181b0cc30f8b None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:38:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22245500-784a-4ff4-9b85-181b0cc30f8b None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:38:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d193a5-2389-4ddc-86b0-937b608476af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:38:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d193a5-2389-4ddc-86b0-937b608476af None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:38:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d193a5-2389-4ddc-86b0-937b608476af None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:38:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d193a5-2389-4ddc-86b0-937b608476af None admin] PATH_INFO: `/v3/domains` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:38:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d193a5-2389-4ddc-86b0-937b608476af None admin] RBAC: Adding query filter params (name=Default) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:38:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d193a5-2389-4ddc-86b0-937b608476af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:38:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d193a5-2389-4ddc-86b0-937b608476af None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:38:58 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 350/715] 10.27.203.238 () {56 vars in 1109 bytes} [Tue May 28 12:38:58 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:38:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08af11cc-2c8d-4547-b032-428ba1f8654c None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:38:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08af11cc-2c8d-4547-b032-428ba1f8654c None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:38:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7197d1fe-96ac-4810-a4f3-643784b20bb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:38:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7197d1fe-96ac-4810-a4f3-643784b20bb0 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:38:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7197d1fe-96ac-4810-a4f3-643784b20bb0 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:38:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7197d1fe-96ac-4810-a4f3-643784b20bb0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:38:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7197d1fe-96ac-4810-a4f3-643784b20bb0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:38:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7197d1fe-96ac-4810-a4f3-643784b20bb0 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:38:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-7197d1fe-96ac-4810-a4f3-643784b20bb0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 28 12:38:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:38:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:38:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:38:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:38:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:38:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:38:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:38:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:38:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:38:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:38:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:38:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 28 12:38:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._get_project(project_id) May 28 12:38:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 28 12:38:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 28 12:38:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:38:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:38:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:38:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:38:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:38:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:38:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:38:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 12:38:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:38:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 12:38:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:38:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:38:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:38:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 12:38:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:38:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 12:38:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 28 12:38:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 28 12:38:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 28 12:38:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 28 12:38:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 28 12:38:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 28 12:38:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 28 12:38:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 12:38:58 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 366/716] 10.27.203.238 () {56 vars in 1111 bytes} [Tue May 28 12:38:58 2024] GET /identity/v3/projects/service => generated 88 bytes in 113 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 28 12:38:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d193a5-2389-4ddc-86b0-937b608476af None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:38:58 l75lg1-v1 dstat.sh[49771]: 28-05 12:38:58| 12 3 74 11 0|1727M 7974M 247M 5758M| 12k 0 | 0 14M| 0 1157 | 11k 20k|2.57 1.54 0.93|1.0 1.0 14| 0 0 | 0 2048M| 19 40 0 10 0 May 28 12:38:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d193a5-2389-4ddc-86b0-937b608476af None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:38:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f40babe-d38b-4ea5-a673-90ad2a530be4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:38:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f40babe-d38b-4ea5-a673-90ad2a530be4 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:38:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f40babe-d38b-4ea5-a673-90ad2a530be4 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:38:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f40babe-d38b-4ea5-a673-90ad2a530be4 None admin] PATH_INFO: `/v3/projects` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:38:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f40babe-d38b-4ea5-a673-90ad2a530be4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:38:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f40babe-d38b-4ea5-a673-90ad2a530be4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:38:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f40babe-d38b-4ea5-a673-90ad2a530be4 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:38:58 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 351/717] 10.27.203.238 () {56 vars in 1148 bytes} [Tue May 28 12:38:58 2024] GET /identity/v3/projects?domain_id=default&name=service => generated 433 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:38:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7197d1fe-96ac-4810-a4f3-643784b20bb0 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:38:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7197d1fe-96ac-4810-a4f3-643784b20bb0 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:38:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47542ef-66a8-4b32-a0b9-a9934249ca57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:38:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47542ef-66a8-4b32-a0b9-a9934249ca57 None admin] REQUEST_METHOD: `PUT` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:38:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47542ef-66a8-4b32-a0b9-a9934249ca57 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:38:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47542ef-66a8-4b32-a0b9-a9934249ca57 None admin] PATH_INFO: `/v3/projects/98a6a2dcbf0248d5b353760f7757f713/users/c3fe870f285d4169bd917382dd02d7b0/roles/e7989893488f483baa107be56668c4f8` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:38:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47542ef-66a8-4b32-a0b9-a9934249ca57 None admin] RBAC: Authorizing `identity:create_grant(project_id=98a6a2dcbf0248d5b353760f7757f713, user_id=c3fe870f285d4169bd917382dd02d7b0, role_id=e7989893488f483baa107be56668c4f8)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:38:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47542ef-66a8-4b32-a0b9-a9934249ca57 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:38:58 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 367/718] 10.27.203.238 () {58 vars in 1439 bytes} [Tue May 28 12:38:58 2024] PUT /identity/v3/projects/98a6a2dcbf0248d5b353760f7757f713/users/c3fe870f285d4169bd917382dd02d7b0/roles/e7989893488f483baa107be56668c4f8 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:38:59 l75lg1-v1 dstat.sh[49771]: 28-05 12:38:59| 11 1 74 12 0|1702M 7997M 247M 5760M| 15k 0 | 0 17M| 0 1559 |8058 14k|2.57 1.54 0.93|2.0 1.0 27| 0 0 | 0 2048M| 19 39 0 10 0 May 28 12:38:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ea6a50-eb2e-4e42-b2b7-6f08986ee318 None None] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:38:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ea6a50-eb2e-4e42-b2b7-6f08986ee318 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:38:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ea6a50-eb2e-4e42-b2b7-6f08986ee318 None None] PATH_INFO: `/` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:38:59 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 352/719] 10.27.203.238 () {54 vars in 926 bytes} [Tue May 28 12:38:59 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:38:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2f8a70-f68b-4f62-b194-283092f8db7f None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:38:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2f8a70-f68b-4f62-b194-283092f8db7f None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:38:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2f8a70-f68b-4f62-b194-283092f8db7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:38:59 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-6f2f8a70-f68b-4f62-b194-283092f8db7f None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:38:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-6f2f8a70-f68b-4f62-b194-283092f8db7f None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:38:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-6f2f8a70-f68b-4f62-b194-283092f8db7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:38:59 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 368/720] 10.27.203.238 () {58 vars in 1023 bytes} [Tue May 28 12:38:59 2024] POST /identity/v3/auth/tokens => generated 1940 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ea6a50-eb2e-4e42-b2b7-6f08986ee318 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ea6a50-eb2e-4e42-b2b7-6f08986ee318 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d451bc-57bf-4573-aba5-f6595c8e3f1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d451bc-57bf-4573-aba5-f6595c8e3f1f None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d451bc-57bf-4573-aba5-f6595c8e3f1f None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d451bc-57bf-4573-aba5-f6595c8e3f1f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d451bc-57bf-4573-aba5-f6595c8e3f1f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-d9d451bc-57bf-4573-aba5-f6595c8e3f1f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._get_role(role_id) May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1281, in get_role May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 353/721] 10.27.203.238 () {56 vars in 1096 bytes} [Tue May 28 12:39:00 2024] GET /identity/v3/roles/admin => generated 83 bytes in 92 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2f8a70-f68b-4f62-b194-283092f8db7f None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:39:00 l75lg1-v1 dstat.sh[49771]: 28-05 12:39:00| 16 2 69 12 0|1639M 8059M 247M 5761M| 11k 172B| 0 15M| 0 1255 |8359 14k|2.57 1.54 0.93|4.0 1.0 24| 0 0 | 0 2048M| 19 38 0 10 0 May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2f8a70-f68b-4f62-b194-283092f8db7f None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10b6d5f-b942-4616-895e-066b7d29fb88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10b6d5f-b942-4616-895e-066b7d29fb88 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10b6d5f-b942-4616-895e-066b7d29fb88 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10b6d5f-b942-4616-895e-066b7d29fb88 None admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10b6d5f-b942-4616-895e-066b7d29fb88 None admin] RBAC: Adding query filter params (name=admin) {{(pid=51267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10b6d5f-b942-4616-895e-066b7d29fb88 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10b6d5f-b942-4616-895e-066b7d29fb88 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 369/722] 10.27.203.238 () {56 vars in 1099 bytes} [Tue May 28 12:39:00 2024] GET /identity/v3/roles?name=admin => generated 343 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d451bc-57bf-4573-aba5-f6595c8e3f1f None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d451bc-57bf-4573-aba5-f6595c8e3f1f None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9160be8-1bfe-4b96-a349-e4002b46e8bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9160be8-1bfe-4b96-a349-e4002b46e8bf None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9160be8-1bfe-4b96-a349-e4002b46e8bf None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9160be8-1bfe-4b96-a349-e4002b46e8bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9160be8-1bfe-4b96-a349-e4002b46e8bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9160be8-1bfe-4b96-a349-e4002b46e8bf None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-d9160be8-1bfe-4b96-a349-e4002b46e8bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 354/723] 10.27.203.238 () {56 vars in 1108 bytes} [Tue May 28 12:39:00 2024] GET /identity/v3/domains/Default => generated 87 bytes in 117 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10b6d5f-b942-4616-895e-066b7d29fb88 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10b6d5f-b942-4616-895e-066b7d29fb88 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bfaa45-e987-4b27-bcbf-144acb20a6ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bfaa45-e987-4b27-bcbf-144acb20a6ba None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bfaa45-e987-4b27-bcbf-144acb20a6ba None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bfaa45-e987-4b27-bcbf-144acb20a6ba None admin] PATH_INFO: `/v3/domains` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bfaa45-e987-4b27-bcbf-144acb20a6ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=51267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bfaa45-e987-4b27-bcbf-144acb20a6ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bfaa45-e987-4b27-bcbf-144acb20a6ba None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 370/724] 10.27.203.238 () {56 vars in 1109 bytes} [Tue May 28 12:39:00 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9160be8-1bfe-4b96-a349-e4002b46e8bf None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9160be8-1bfe-4b96-a349-e4002b46e8bf None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e6300a-6067-44da-b7b8-d94568afe59f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e6300a-6067-44da-b7b8-d94568afe59f None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e6300a-6067-44da-b7b8-d94568afe59f None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e6300a-6067-44da-b7b8-d94568afe59f None admin] PATH_INFO: `/v3/users/placement` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e6300a-6067-44da-b7b8-d94568afe59f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e6300a-6067-44da-b7b8-d94568afe59f None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-83e6300a-6067-44da-b7b8-d94568afe59f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._get_user(user_id) May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 355/725] 10.27.203.238 () {56 vars in 1108 bytes} [Tue May 28 12:39:00 2024] GET /identity/v3/users/placement => generated 87 bytes in 98 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bfaa45-e987-4b27-bcbf-144acb20a6ba None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bfaa45-e987-4b27-bcbf-144acb20a6ba None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ff025f-a709-4de3-91e1-838d766dc742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ff025f-a709-4de3-91e1-838d766dc742 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ff025f-a709-4de3-91e1-838d766dc742 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ff025f-a709-4de3-91e1-838d766dc742 None admin] PATH_INFO: `/v3/users` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ff025f-a709-4de3-91e1-838d766dc742 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=51267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ff025f-a709-4de3-91e1-838d766dc742 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ff025f-a709-4de3-91e1-838d766dc742 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 371/726] 10.27.203.238 () {56 vars in 1143 bytes} [Tue May 28 12:39:00 2024] GET /identity/v3/users?domain_id=default&name=placement => generated 382 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e6300a-6067-44da-b7b8-d94568afe59f None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e6300a-6067-44da-b7b8-d94568afe59f None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16452d4-cc02-4e9b-8045-e772739196bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16452d4-cc02-4e9b-8045-e772739196bb None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16452d4-cc02-4e9b-8045-e772739196bb None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16452d4-cc02-4e9b-8045-e772739196bb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16452d4-cc02-4e9b-8045-e772739196bb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16452d4-cc02-4e9b-8045-e772739196bb None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 356/727] 10.27.203.238 () {58 vars in 1282 bytes} [Tue May 28 12:39:00 2024] GET /identity/v3/auth/tokens => generated 1940 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ff025f-a709-4de3-91e1-838d766dc742 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ff025f-a709-4de3-91e1-838d766dc742 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadbc8f2-46a6-41e0-ab85-ef839d65779a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadbc8f2-46a6-41e0-ab85-ef839d65779a None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadbc8f2-46a6-41e0-ab85-ef839d65779a None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadbc8f2-46a6-41e0-ab85-ef839d65779a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadbc8f2-46a6-41e0-ab85-ef839d65779a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadbc8f2-46a6-41e0-ab85-ef839d65779a None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-dadbc8f2-46a6-41e0-ab85-ef839d65779a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 12:39:00 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 372/728] 10.27.203.238 () {56 vars in 1108 bytes} [Tue May 28 12:39:00 2024] GET /identity/v3/domains/Default => generated 87 bytes in 102 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 28 12:39:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16452d4-cc02-4e9b-8045-e772739196bb None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:39:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16452d4-cc02-4e9b-8045-e772739196bb None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:39:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608c1fef-352f-45e0-b18c-e7cbc4e45f08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:39:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608c1fef-352f-45e0-b18c-e7cbc4e45f08 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:39:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608c1fef-352f-45e0-b18c-e7cbc4e45f08 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:39:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608c1fef-352f-45e0-b18c-e7cbc4e45f08 None admin] PATH_INFO: `/v3/domains` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:39:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608c1fef-352f-45e0-b18c-e7cbc4e45f08 None admin] RBAC: Adding query filter params (name=Default) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:39:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608c1fef-352f-45e0-b18c-e7cbc4e45f08 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:39:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608c1fef-352f-45e0-b18c-e7cbc4e45f08 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:39:01 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 357/729] 10.27.203.238 () {56 vars in 1109 bytes} [Tue May 28 12:39:01 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:39:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadbc8f2-46a6-41e0-ab85-ef839d65779a None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:39:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadbc8f2-46a6-41e0-ab85-ef839d65779a None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:39:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbadeac1-8f8b-4752-9963-4f7933add4c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:39:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbadeac1-8f8b-4752-9963-4f7933add4c9 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:39:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbadeac1-8f8b-4752-9963-4f7933add4c9 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:39:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbadeac1-8f8b-4752-9963-4f7933add4c9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:39:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbadeac1-8f8b-4752-9963-4f7933add4c9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:39:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbadeac1-8f8b-4752-9963-4f7933add4c9 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:39:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-cbadeac1-8f8b-4752-9963-4f7933add4c9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 28 12:39:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:39:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:39:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:39:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:39:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:39:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:39:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:39:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:39:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:39:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:39:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:39:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 28 12:39:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._get_project(project_id) May 28 12:39:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 28 12:39:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 28 12:39:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:39:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:39:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:39:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:39:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:39:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:39:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:39:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 12:39:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:39:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 12:39:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:39:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:39:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:39:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 12:39:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:39:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 12:39:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 28 12:39:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 28 12:39:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 28 12:39:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 28 12:39:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 28 12:39:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 28 12:39:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 28 12:39:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 12:39:01 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 373/730] 10.27.203.238 () {56 vars in 1111 bytes} [Tue May 28 12:39:01 2024] GET /identity/v3/projects/service => generated 88 bytes in 96 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 28 12:39:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608c1fef-352f-45e0-b18c-e7cbc4e45f08 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:39:01 l75lg1-v1 dstat.sh[49771]: 28-05 12:39:01| 16 8 66 8 0|1662M 8034M 248M 5763M| 11k 723B| 596k 11M|34.0 973 | 15k 26k|2.93 1.63 0.96|2.0 2.0 196| 0 0 | 0 2048M| 19 38 0 10 0 May 28 12:39:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608c1fef-352f-45e0-b18c-e7cbc4e45f08 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:39:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0941d7a-5434-45a6-aea5-11e43d1dec1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:39:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0941d7a-5434-45a6-aea5-11e43d1dec1c None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:39:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0941d7a-5434-45a6-aea5-11e43d1dec1c None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:39:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0941d7a-5434-45a6-aea5-11e43d1dec1c None admin] PATH_INFO: `/v3/projects` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:39:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0941d7a-5434-45a6-aea5-11e43d1dec1c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:39:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0941d7a-5434-45a6-aea5-11e43d1dec1c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:39:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0941d7a-5434-45a6-aea5-11e43d1dec1c None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:39:01 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 358/731] 10.27.203.238 () {56 vars in 1148 bytes} [Tue May 28 12:39:01 2024] GET /identity/v3/projects?domain_id=default&name=service => generated 433 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:39:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbadeac1-8f8b-4752-9963-4f7933add4c9 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:39:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbadeac1-8f8b-4752-9963-4f7933add4c9 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:39:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92af516b-2a2b-4bf2-ab5d-b22838578292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:39:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92af516b-2a2b-4bf2-ab5d-b22838578292 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:39:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92af516b-2a2b-4bf2-ab5d-b22838578292 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:39:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92af516b-2a2b-4bf2-ab5d-b22838578292 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:39:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92af516b-2a2b-4bf2-ab5d-b22838578292 None admin] RBAC: Adding query filter params (role.id=e7989893488f483baa107be56668c4f8, scope.project.id=98a6a2dcbf0248d5b353760f7757f713, user.id=c3fe870f285d4169bd917382dd02d7b0) {{(pid=51267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:39:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92af516b-2a2b-4bf2-ab5d-b22838578292 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:39:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92af516b-2a2b-4bf2-ab5d-b22838578292 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:39:01 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 374/732] 10.27.203.238 () {56 vars in 1374 bytes} [Tue May 28 12:39:01 2024] GET /identity/v3/role_assignments?user.id=c3fe870f285d4169bd917382dd02d7b0&scope.project.id=98a6a2dcbf0248d5b353760f7757f713&role.id=e7989893488f483baa107be56668c4f8 => generated 612 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:39:02 l75lg1-v1 dstat.sh[49771]: 28-05 12:39:02| 14 5 70 11 0|1631M 8061M 248M 5765M| 15k 0 |1184k 13M|16.0 1034 |9718 15k|2.93 1.63 0.96|2.0 2.0 100| 0 0 | 0 2048M| 19 37 0 10 0 May 28 12:39:02 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2869d5fe-6f55-40a8-a98b-a1bee0c21dcc None None] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:39:02 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2869d5fe-6f55-40a8-a98b-a1bee0c21dcc None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:39:02 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2869d5fe-6f55-40a8-a98b-a1bee0c21dcc None None] PATH_INFO: `/` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:39:02 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 359/733] 10.27.203.238 () {54 vars in 926 bytes} [Tue May 28 12:39:02 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:39:02 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66344f9-254c-464f-b4e9-c71bba13bfe9 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:39:02 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66344f9-254c-464f-b4e9-c71bba13bfe9 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:39:02 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66344f9-254c-464f-b4e9-c71bba13bfe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:39:02 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-d66344f9-254c-464f-b4e9-c71bba13bfe9 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:39:02 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-d66344f9-254c-464f-b4e9-c71bba13bfe9 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:39:02 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-d66344f9-254c-464f-b4e9-c71bba13bfe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:39:03 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 375/734] 10.27.203.238 () {58 vars in 1023 bytes} [Tue May 28 12:39:02 2024] POST /identity/v3/auth/tokens => generated 1940 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 12:39:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2869d5fe-6f55-40a8-a98b-a1bee0c21dcc None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:39:03 l75lg1-v1 dstat.sh[49771]: 28-05 12:39:03| 10 2 77 10 0|1663M 8029M 248M 5765M| 15k 482B| 656k 13M|9.00 1141 |6999 12k|2.93 1.63 0.96|1.0 1.0 54| 0 0 | 0 2048M| 19 38 0 10 0 May 28 12:39:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2869d5fe-6f55-40a8-a98b-a1bee0c21dcc None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:39:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e098451d-1e77-44bc-ac88-192720a5da5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:39:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e098451d-1e77-44bc-ac88-192720a5da5a None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:39:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e098451d-1e77-44bc-ac88-192720a5da5a None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:39:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e098451d-1e77-44bc-ac88-192720a5da5a None admin] PATH_INFO: `/v3/services/placement` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:39:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e098451d-1e77-44bc-ac88-192720a5da5a None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:39:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e098451d-1e77-44bc-ac88-192720a5da5a None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:39:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-e098451d-1e77-44bc-ac88-192720a5da5a None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 28 12:39:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:39:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 28 12:39:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 28 12:39:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 194, in get_service May 28 12:39:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 28 12:39:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 189, in _get_service May 28 12:39:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 28 12:39:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 28 12:39:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 12:39:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 28 12:39:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 12:39:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:39:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:39:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:39:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:39:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:39:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:39:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:39:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:39:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:39:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:39:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:39:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 28 12:39:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._get_service(service_id) May 28 12:39:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 28 12:39:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 28 12:39:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:39:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:39:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:39:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:39:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:39:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:39:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:39:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 12:39:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:39:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 12:39:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:39:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:39:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:39:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 12:39:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:39:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 12:39:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 28 12:39:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 28 12:39:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 28 12:39:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 12:39:03 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 360/735] 10.27.203.238 () {56 vars in 1117 bytes} [Tue May 28 12:39:03 2024] GET /identity/v3/services/placement => generated 90 bytes in 122 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 28 12:39:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66344f9-254c-464f-b4e9-c71bba13bfe9 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:39:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66344f9-254c-464f-b4e9-c71bba13bfe9 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:39:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1aaa1c4-3e59-460e-bd59-4287ae9e2e80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:39:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aaa1c4-3e59-460e-bd59-4287ae9e2e80 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:39:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aaa1c4-3e59-460e-bd59-4287ae9e2e80 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:39:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aaa1c4-3e59-460e-bd59-4287ae9e2e80 None admin] PATH_INFO: `/v3/services` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:39:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1aaa1c4-3e59-460e-bd59-4287ae9e2e80 None admin] RBAC: Adding query filter params (name=placement) {{(pid=51267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:39:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1aaa1c4-3e59-460e-bd59-4287ae9e2e80 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:39:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1aaa1c4-3e59-460e-bd59-4287ae9e2e80 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:39:03 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 376/736] 10.27.203.238 () {56 vars in 1116 bytes} [Tue May 28 12:39:03 2024] GET /identity/v3/services?name=placement => generated 128 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:39:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e098451d-1e77-44bc-ac88-192720a5da5a None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:39:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e098451d-1e77-44bc-ac88-192720a5da5a None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:39:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8252568c-07a3-4946-b7fe-8936d9f9b3c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:39:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8252568c-07a3-4946-b7fe-8936d9f9b3c9 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:39:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8252568c-07a3-4946-b7fe-8936d9f9b3c9 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:39:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8252568c-07a3-4946-b7fe-8936d9f9b3c9 None admin] PATH_INFO: `/v3/services` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:39:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8252568c-07a3-4946-b7fe-8936d9f9b3c9 None admin] RBAC: Adding query filter params (type=placement) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:39:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8252568c-07a3-4946-b7fe-8936d9f9b3c9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:39:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8252568c-07a3-4946-b7fe-8936d9f9b3c9 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:39:03 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 361/737] 10.27.203.238 () {56 vars in 1116 bytes} [Tue May 28 12:39:03 2024] GET /identity/v3/services?type=placement => generated 128 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:39:04 l75lg1-v1 dstat.sh[49771]: 28-05 12:39:04| 10 1 77 11 0|1631M 8059M 249M 5767M| 11k 0 | 0 12M| 0 1050 |7666 13k|2.93 1.63 0.96|1.0 1.0 20| 0 0 | 0 2048M| 19 37 0 10 0 May 28 12:39:04 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eae112e-fd2f-4128-9cd1-7d1bab06591c None None] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:39:04 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eae112e-fd2f-4128-9cd1-7d1bab06591c None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:39:04 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eae112e-fd2f-4128-9cd1-7d1bab06591c None None] PATH_INFO: `/` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:39:04 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 377/738] 10.27.203.238 () {54 vars in 926 bytes} [Tue May 28 12:39:04 2024] GET /identity => generated 272 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:39:04 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccec3185-1827-4bf9-abe8-e98356d83dd4 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:39:04 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccec3185-1827-4bf9-abe8-e98356d83dd4 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:39:04 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccec3185-1827-4bf9-abe8-e98356d83dd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:39:04 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-ccec3185-1827-4bf9-abe8-e98356d83dd4 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:39:04 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-ccec3185-1827-4bf9-abe8-e98356d83dd4 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:39:04 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-ccec3185-1827-4bf9-abe8-e98356d83dd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:39:04 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 362/739] 10.27.203.238 () {58 vars in 1023 bytes} [Tue May 28 12:39:04 2024] POST /identity/v3/auth/tokens => generated 1940 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 12:39:05 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eae112e-fd2f-4128-9cd1-7d1bab06591c None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:39:05 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eae112e-fd2f-4128-9cd1-7d1bab06591c None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:39:05 l75lg1-v1 dstat.sh[49771]: 28-05 12:39:05| 10 1 76 11 0|1657M 8031M 249M 5769M|9982B 0 | 0 12M| 0 1069 |6857 13k|2.93 1.63 0.96|1.0 1.0 3.0| 0 0 | 0 2048M| 19 38 0 10 0 May 28 12:39:05 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0f18cd-6961-4eb1-a96f-2e6bc6cf17b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:39:05 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0f18cd-6961-4eb1-a96f-2e6bc6cf17b9 None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:39:05 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0f18cd-6961-4eb1-a96f-2e6bc6cf17b9 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:39:05 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0f18cd-6961-4eb1-a96f-2e6bc6cf17b9 None admin] PATH_INFO: `/v3/services` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:39:05 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0f18cd-6961-4eb1-a96f-2e6bc6cf17b9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:39:05 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0f18cd-6961-4eb1-a96f-2e6bc6cf17b9 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:39:05 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 378/740] 10.27.203.238 () {60 vars in 1141 bytes} [Tue May 28 12:39:05 2024] POST /identity/v3/services => generated 248 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:39:06 l75lg1-v1 dstat.sh[49771]: 28-05 12:39:06| 10 2 76 11 0|1632M 8054M 250M 5770M| 14k 0 | 0 14M| 0 1204 |6508 13k|2.85 1.64 0.97|2.0 1.0 40| 0 0 | 0 2048M| 19 37 0 10 0 May 28 12:39:06 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0370505-2ac0-4e36-a7bb-860f3d48290b None None] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:39:06 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0370505-2ac0-4e36-a7bb-860f3d48290b None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:39:06 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0370505-2ac0-4e36-a7bb-860f3d48290b None None] PATH_INFO: `/` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:39:06 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 363/741] 10.27.203.238 () {54 vars in 926 bytes} [Tue May 28 12:39:06 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:39:06 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ad1b14-79b0-4841-af78-42e4e461081a None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:39:06 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ad1b14-79b0-4841-af78-42e4e461081a None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:39:06 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ad1b14-79b0-4841-af78-42e4e461081a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:39:06 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-44ad1b14-79b0-4841-af78-42e4e461081a None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:39:06 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-44ad1b14-79b0-4841-af78-42e4e461081a None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:39:06 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-44ad1b14-79b0-4841-af78-42e4e461081a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:39:06 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 379/742] 10.27.203.238 () {58 vars in 1023 bytes} [Tue May 28 12:39:06 2024] POST /identity/v3/auth/tokens => generated 2043 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 12:39:06 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0370505-2ac0-4e36-a7bb-860f3d48290b None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:39:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0370505-2ac0-4e36-a7bb-860f3d48290b None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:39:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5ad51a-e13f-45e2-853a-de65e9909ab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:39:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5ad51a-e13f-45e2-853a-de65e9909ab3 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:39:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5ad51a-e13f-45e2-853a-de65e9909ab3 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:39:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5ad51a-e13f-45e2-853a-de65e9909ab3 None admin] PATH_INFO: `/v3/services/placement` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:39:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5ad51a-e13f-45e2-853a-de65e9909ab3 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:39:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5ad51a-e13f-45e2-853a-de65e9909ab3 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:39:07 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-7a5ad51a-e13f-45e2-853a-de65e9909ab3 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 28 12:39:07 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:39:07 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 28 12:39:07 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 28 12:39:07 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 194, in get_service May 28 12:39:07 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 28 12:39:07 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 189, in _get_service May 28 12:39:07 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 28 12:39:07 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 28 12:39:07 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 12:39:07 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 28 12:39:07 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 12:39:07 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:39:07 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:39:07 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:39:07 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:39:07 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:39:07 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:39:07 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:39:07 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:39:07 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:39:07 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:39:07 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:39:07 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 28 12:39:07 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._get_service(service_id) May 28 12:39:07 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 28 12:39:07 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 28 12:39:07 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:39:07 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:39:07 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:39:07 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:39:07 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:39:07 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:39:07 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:39:07 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 12:39:07 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:39:07 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 12:39:07 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:39:07 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:39:07 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:39:07 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 12:39:07 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:39:07 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 12:39:07 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 28 12:39:07 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 28 12:39:07 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 28 12:39:07 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 12:39:07 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 364/743] 10.27.203.238 () {56 vars in 1117 bytes} [Tue May 28 12:39:06 2024] GET /identity/v3/services/placement => generated 90 bytes in 114 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 28 12:39:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ad1b14-79b0-4841-af78-42e4e461081a None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:39:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ad1b14-79b0-4841-af78-42e4e461081a None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:39:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3632c19-c3b4-4117-848a-c5b57bda6d68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:39:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3632c19-c3b4-4117-848a-c5b57bda6d68 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:39:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3632c19-c3b4-4117-848a-c5b57bda6d68 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:39:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3632c19-c3b4-4117-848a-c5b57bda6d68 None admin] PATH_INFO: `/v3/services` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:39:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3632c19-c3b4-4117-848a-c5b57bda6d68 None admin] RBAC: Adding query filter params (name=placement) {{(pid=51267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:39:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3632c19-c3b4-4117-848a-c5b57bda6d68 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:39:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3632c19-c3b4-4117-848a-c5b57bda6d68 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:39:07 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 380/744] 10.27.203.238 () {56 vars in 1116 bytes} [Tue May 28 12:39:07 2024] GET /identity/v3/services?name=placement => generated 362 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:39:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5ad51a-e13f-45e2-853a-de65e9909ab3 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:39:07 l75lg1-v1 dstat.sh[49771]: 28-05 12:39:07| 9 1 77 10 0|1655M 8028M 250M 5772M| 10k 42B| 0 11M| 0 1028 |6932 14k|2.85 1.64 0.97|1.0 2.0 3.0| 0 0 | 0 2048M| 19 38 0 10 0 May 28 12:39:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5ad51a-e13f-45e2-853a-de65e9909ab3 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:39:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05273fc-30b0-4018-8410-eb6f66f4a9e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:39:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05273fc-30b0-4018-8410-eb6f66f4a9e7 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:39:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05273fc-30b0-4018-8410-eb6f66f4a9e7 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:39:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05273fc-30b0-4018-8410-eb6f66f4a9e7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:39:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05273fc-30b0-4018-8410-eb6f66f4a9e7 None admin] RBAC: Adding query filter params (interface=public, service_id=4326ea2925ab47df8ff3f65833ab8074, region_id=RegionOne) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:39:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05273fc-30b0-4018-8410-eb6f66f4a9e7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:39:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05273fc-30b0-4018-8410-eb6f66f4a9e7 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:39:07 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 365/745] 10.27.203.238 () {56 vars in 1251 bytes} [Tue May 28 12:39:07 2024] GET /identity/v3/endpoints?service_id=4326ea2925ab47df8ff3f65833ab8074&interface=public®ion_id=RegionOne => generated 196 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:39:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3632c19-c3b4-4117-848a-c5b57bda6d68 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:39:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3632c19-c3b4-4117-848a-c5b57bda6d68 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:39:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580ee963-0ff9-461b-853d-d5893277dd52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:39:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580ee963-0ff9-461b-853d-d5893277dd52 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:39:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580ee963-0ff9-461b-853d-d5893277dd52 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:39:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580ee963-0ff9-461b-853d-d5893277dd52 None admin] PATH_INFO: `/v3/services` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:39:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580ee963-0ff9-461b-853d-d5893277dd52 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:39:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580ee963-0ff9-461b-853d-d5893277dd52 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:39:07 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 381/746] 10.27.203.238 () {56 vars in 1087 bytes} [Tue May 28 12:39:07 2024] GET /identity/v3/services => generated 1980 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:39:08 l75lg1-v1 dstat.sh[49771]: 28-05 12:39:08| 11 2 75 12 0|1624M 8058M 251M 5773M| 12k 214B| 0 15M| 0 1175 |7087 13k|2.85 1.64 0.97|3.0 2.0 27| 0 0 | 0 2048M| 19 37 0 10 0 May 28 12:39:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2908a2-6e69-40c0-bed5-c85f12c1b451 None None] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:39:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2908a2-6e69-40c0-bed5-c85f12c1b451 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:39:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2908a2-6e69-40c0-bed5-c85f12c1b451 None None] PATH_INFO: `/` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:39:08 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 366/747] 10.27.203.238 () {54 vars in 926 bytes} [Tue May 28 12:39:08 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:39:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9028cb0-655b-4003-938f-937e4a59651c None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:39:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9028cb0-655b-4003-938f-937e4a59651c None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:39:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9028cb0-655b-4003-938f-937e4a59651c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:39:08 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-f9028cb0-655b-4003-938f-937e4a59651c None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:39:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-f9028cb0-655b-4003-938f-937e4a59651c None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:39:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-f9028cb0-655b-4003-938f-937e4a59651c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:39:08 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 382/748] 10.27.203.238 () {58 vars in 1023 bytes} [Tue May 28 12:39:08 2024] POST /identity/v3/auth/tokens => generated 2043 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 12:39:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2908a2-6e69-40c0-bed5-c85f12c1b451 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:39:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2908a2-6e69-40c0-bed5-c85f12c1b451 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:39:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb85bb03-590b-4331-a7d5-89d070b2de73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:39:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb85bb03-590b-4331-a7d5-89d070b2de73 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:39:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb85bb03-590b-4331-a7d5-89d070b2de73 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:39:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb85bb03-590b-4331-a7d5-89d070b2de73 None admin] PATH_INFO: `/v3/services/placement` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:39:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb85bb03-590b-4331-a7d5-89d070b2de73 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:39:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb85bb03-590b-4331-a7d5-89d070b2de73 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:39:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-eb85bb03-590b-4331-a7d5-89d070b2de73 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 28 12:39:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:39:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 28 12:39:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 28 12:39:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 194, in get_service May 28 12:39:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 28 12:39:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 189, in _get_service May 28 12:39:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 28 12:39:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 28 12:39:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 12:39:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 28 12:39:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 12:39:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:39:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:39:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:39:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:39:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:39:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:39:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:39:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:39:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:39:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:39:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:39:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 28 12:39:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._get_service(service_id) May 28 12:39:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 28 12:39:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 28 12:39:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:39:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:39:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:39:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:39:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:39:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:39:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:39:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 12:39:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:39:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 12:39:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:39:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:39:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:39:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 12:39:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:39:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 12:39:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 28 12:39:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 28 12:39:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 28 12:39:09 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 12:39:09 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 367/749] 10.27.203.238 () {56 vars in 1117 bytes} [Tue May 28 12:39:09 2024] GET /identity/v3/services/placement => generated 90 bytes in 87 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 28 12:39:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9028cb0-655b-4003-938f-937e4a59651c None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:39:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9028cb0-655b-4003-938f-937e4a59651c None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:39:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d3e63e-22e1-4ab8-bfb9-673f25c7ecff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:39:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d3e63e-22e1-4ab8-bfb9-673f25c7ecff None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:39:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d3e63e-22e1-4ab8-bfb9-673f25c7ecff None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:39:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d3e63e-22e1-4ab8-bfb9-673f25c7ecff None admin] PATH_INFO: `/v3/services` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:39:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d3e63e-22e1-4ab8-bfb9-673f25c7ecff None admin] RBAC: Adding query filter params (name=placement) {{(pid=51267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:39:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d3e63e-22e1-4ab8-bfb9-673f25c7ecff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:39:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d3e63e-22e1-4ab8-bfb9-673f25c7ecff None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:39:09 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 383/750] 10.27.203.238 () {56 vars in 1116 bytes} [Tue May 28 12:39:09 2024] GET /identity/v3/services?name=placement => generated 362 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:39:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb85bb03-590b-4331-a7d5-89d070b2de73 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:39:09 l75lg1-v1 dstat.sh[49771]: 28-05 12:39:09| 10 1 78 10 0|1648M 8032M 251M 5774M| 15k 0 | 0 7518k| 0 742 |6362 12k|2.85 1.64 0.97|1.0 2.0 3.0| 0 0 | 0 2048M| 19 38 0 10 0 May 28 12:39:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb85bb03-590b-4331-a7d5-89d070b2de73 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:39:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dc6c02-c038-474a-b057-d46170a2b977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:39:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dc6c02-c038-474a-b057-d46170a2b977 None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:39:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dc6c02-c038-474a-b057-d46170a2b977 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:39:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dc6c02-c038-474a-b057-d46170a2b977 None admin] PATH_INFO: `/v3/endpoints` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:39:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dc6c02-c038-474a-b057-d46170a2b977 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:39:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dc6c02-c038-474a-b057-d46170a2b977 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:39:09 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 368/751] 10.27.203.238 () {60 vars in 1144 bytes} [Tue May 28 12:39:09 2024] POST /identity/v3/endpoints => generated 335 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:39:10 l75lg1-v1 dstat.sh[49771]: 28-05 12:39:10| 4 2 81 13 0|1589M 8090M 251M 5775M| 11k 482B| 0 16M| 0 1521 |6190 12k|2.85 1.64 0.97| 0 1.0 54| 0 0 | 0 2048M| 19 37 0 10 0 May 28 12:39:11 l75lg1-v1 dstat.sh[49771]: 28-05 12:39:11| 2 1 84 13 0|1589M 8089M 252M 5776M| 11k 0 | 0 14M| 0 1266 |5946 12k|2.87 1.66 0.98| 0 2.0 9.0| 0 0 | 0 2048M| 19 37 0 10 0 May 28 12:39:12 l75lg1-v1 dstat.sh[49771]: 28-05 12:39:12| 3 0 85 10 0|1588M 8088M 252M 5777M| 12k 208B| 0 8983k| 0 855 |5674 11k|2.87 1.66 0.98| 0 1.0 0| 0 0 | 0 2048M| 19 37 0 10 0 May 28 12:39:13 l75lg1-v1 dstat.sh[49771]: 28-05 12:39:13| 3 1 85 10 0|1588M 8087M 252M 5778M| 15k 172B| 0 10M| 0 1038 |5777 12k|2.87 1.66 0.98| 0 2.0 0| 0 0 | 0 2048M| 19 37 0 10 0 May 28 12:39:14 l75lg1-v1 dstat.sh[49771]: 28-05 12:39:14| 1 1 85 13 0|1589M 8085M 252M 5779M| 10k 0 | 0 17M| 0 1283 |5573 11k|2.87 1.66 0.98|2.0 1.0 3.0| 0 0 | 0 2048M| 19 37 0 10 0 May 28 12:39:15 l75lg1-v1 dstat.sh[49771]: 28-05 12:39:15| 2 1 86 11 0|1588M 8084M 252M 5780M| 13k 208B| 0 9500k| 0 950 |5662 11k|2.87 1.66 0.98| 0 1.0 9.0| 0 0 | 0 2048M| 19 37 0 10 0 May 28 12:39:16 l75lg1-v1 dstat.sh[49771]: 28-05 12:39:16| 2 1 85 12 0|1589M 8083M 253M 5781M| 20k 172B| 0 10M| 0 1001 |5980 11k|2.88 1.68 0.99| 0 1.0 6.0| 0 0 | 0 2048M| 19 37 0 10 0 May 28 12:39:17 l75lg1-v1 dstat.sh[49771]: 28-05 12:39:17| 2 1 84 13 0|1588M 8082M 253M 5781M| 13k 42B| 0 13M| 0 1146 |5584 12k|2.88 1.68 0.99| 0 1.0 0| 0 0 | 0 2048M| 19 37 0 10 0 May 28 12:39:18 l75lg1-v1 dstat.sh[49771]: 28-05 12:39:18| 1 1 86 11 0|1589M 8082M 253M 5781M| 12k 0 | 0 11M| 0 1092 |5777 12k|2.88 1.68 0.99| 0 1.0 2.0| 0 0 | 0 2048M| 19 37 0 10 0 May 28 12:39:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG dbcounter [-] [51267] Writing DB stats keystone:SELECT=1226,keystone:INSERT=5 {{(pid=51267) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:39:19 l75lg1-v1 dstat.sh[49771]: 28-05 12:39:19| 1 1 86 11 0|1590M 8082M 253M 5780M| 20k 0 | 0 10M| 0 1093 |6083 13k|2.88 1.68 0.99| 0 2.0 3.0| 0 0 | 0 2048M| 19 37 0 10 0 May 28 12:39:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG dbcounter [-] [51266] Writing DB stats keystone:SELECT=1203,keystone:INSERT=2 {{(pid=51266) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:39:20 l75lg1-v1 dstat.sh[49771]: 28-05 12:39:20| 2 0 84 12 0|1591M 8081M 254M 5780M| 16k 42B| 0 14M| 0 1186 |5783 12k|2.88 1.68 0.99|1.0 1.0 3.0| 0 0 | 0 2048M| 19 37 0 10 0 May 28 12:39:21 l75lg1-v1 dstat.sh[49771]: 28-05 12:39:21| 3 1 86 10 0|1590M 8080M 254M 5780M| 13k 0 | 0 10M| 0 951 |5426 11k|2.89 1.71 1.00| 0 1.0 9.0| 0 0 | 0 2048M| 19 37 0 10 0 May 28 12:39:22 l75lg1-v1 dstat.sh[49771]: 28-05 12:39:22| 1 1 86 11 0|1590M 8080M 254M 5781M| 11k 0 | 0 10M| 0 1002 |5967 12k|2.89 1.71 1.00|1.0 1.0 17| 0 0 | 0 2048M| 19 37 0 10 0 May 28 12:39:23 l75lg1-v1 dstat.sh[49771]: 28-05 12:39:23| 5 1 82 11 0|1590M 8079M 255M 5781M| 15k 0 | 0 10M| 0 986 |7069 12k|2.89 1.71 1.00| 0 1.0 47| 0 0 | 0 2048M| 19 37 0 11 0 May 28 12:39:24 l75lg1-v1 dstat.sh[49771]: 28-05 12:39:24| 2 1 86 11 0|1589M 8078M 255M 5782M| 10k 172B| 0 11M| 0 1034 |6503 11k|2.89 1.71 1.00| 0 1.0 9.0| 0 0 | 0 2048M| 19 37 0 10 0 May 28 12:39:25 l75lg1-v1 dstat.sh[49771]: 28-05 12:39:25| 2 1 85 12 0|1589M 8078M 255M 5783M| 10k 0 | 0 14M| 0 1219 |6587 12k|2.89 1.71 1.00| 0 1.0 6.0| 0 0 | 0 2048M| 19 37 0 10 0 May 28 12:39:26 l75lg1-v1 dstat.sh[49771]: 28-05 12:39:26| 2 1 87 9 0|1590M 8077M 256M 5782M| 15k 0 | 0 7142k| 0 899 |6324 11k|2.74 1.69 1.00| 0 1.0 3.0| 0 0 | 0 2048M| 19 37 0 10 0 May 28 12:39:27 l75lg1-v1 dstat.sh[49771]: 28-05 12:39:27| 1 1 85 12 0|1590M 8077M 256M 5782M| 12k 0 | 0 12M| 0 1069 |5986 11k|2.74 1.69 1.00|1.0 1.0 0| 0 0 | 0 2048M| 19 37 0 10 0 May 28 12:39:28 l75lg1-v1 dstat.sh[49771]: 28-05 12:39:28| 2 1 84 12 0|1591M 8075M 256M 5783M| 14k 0 | 0 13M| 0 1136 |6469 11k|2.74 1.69 1.00| 0 1.0 11| 0 0 | 0 2048M| 19 37 0 10 0 May 28 12:39:29 l75lg1-v1 dstat.sh[49771]: 28-05 12:39:29| 2 1 85 11 0|1591M 8074M 256M 5783M| 18k 0 | 0 12M| 0 1101 |6610 12k|2.74 1.69 1.00| 0 1.0 9.0| 0 0 | 0 2048M| 19 37 0 10 0 May 28 12:39:30 l75lg1-v1 dstat.sh[49771]: 28-05 12:39:30| 3 1 85 10 0|1590M 8074M 257M 5784M| 13k 0 | 0 9666k| 0 1013 |6250 11k|2.74 1.69 1.00|1.0 1.0 9.0| 0 0 | 0 2048M| 19 37 0 10 0 May 28 12:39:31 l75lg1-v1 dstat.sh[49771]: 28-05 12:39:31| 3 1 84 12 0|1590M 8074M 257M 5785M| 14k 0 | 0 11M| 0 1106 |6540 11k|2.76 1.72 1.01| 0 1.0 9.0| 0 0 | 0 2048M| 19 37 0 10 0 May 28 12:39:32 l75lg1-v1 dstat.sh[49771]: 28-05 12:39:32| 4 1 87 8 0|1589M 8074M 257M 5785M| 15k 172B| 0 6612k| 0 839 |6233 11k|2.76 1.72 1.01| 0 1.0 15| 0 0 | 0 2048M| 19 37 0 10 0 May 28 12:39:33 l75lg1-v1 dstat.sh[49771]: 28-05 12:39:33| 2 1 84 12 0|1589M 8073M 257M 5786M| 19k 0 | 0 13M| 0 1111 |6997 12k|2.76 1.72 1.01| 0 1.0 9.0| 0 0 | 0 2048M| 19 37 0 10 0 May 28 12:39:34 l75lg1-v1 dstat.sh[49771]: 28-05 12:39:34| 2 1 84 12 0|1589M 8072M 257M 5786M| 15k 0 | 0 13M| 0 1145 |6411 11k|2.76 1.72 1.01|1.0 1.0 6.0| 0 0 | 0 2048M| 19 37 0 10 0 May 28 12:39:35 l75lg1-v1 dstat.sh[49771]: 28-05 12:39:35| 2 1 87 10 0|1589M 8071M 257M 5787M| 13k 0 | 0 6721k| 0 869 |6840 13k|2.76 1.72 1.01| 0 1.0 12| 0 0 | 0 2048M| 19 37 0 10 0 May 28 12:39:36 l75lg1-v1 dstat.sh[49771]: 28-05 12:39:36| 1 0 85 12 0|1589M 8071M 257M 5787M| 16k 0 | 0 12M| 0 1100 |5974 10k|2.78 1.74 1.02|3.0 2.0 6.0| 0 0 | 0 2048M| 19 37 0 10 0 May 28 12:39:37 l75lg1-v1 dstat.sh[49771]: 28-05 12:39:37| 1 1 85 12 0|1589M 8071M 257M 5788M| 11k 0 | 0 12M| 0 1051 |5789 10k|2.78 1.74 1.02| 0 1.0 0| 0 0 | 0 2048M| 19 37 0 10 0 May 28 12:39:38 l75lg1-v1 dstat.sh[49771]: 28-05 12:39:38| 2 1 87 10 0|1590M 8069M 257M 5789M| 11k 0 | 0 7390k| 0 839 |6236 11k|2.78 1.74 1.02| 0 1.0 11| 0 0 | 0 2048M| 19 37 0 10 0 May 28 12:39:39 l75lg1-v1 dstat.sh[49771]: 28-05 12:39:39| 2 1 84 12 0|1589M 8069M 257M 5789M| 15k 172B| 0 11M| 0 1025 |5988 10k|2.78 1.74 1.02| 0 1.0 12| 0 0 | 0 2048M| 19 37 0 10 0 May 28 12:39:40 l75lg1-v1 dstat.sh[49771]: 28-05 12:39:40| 1 0 85 13 0|1589M 8068M 257M 5790M| 11k 0 | 0 13M| 0 1048 |6073 10k|2.78 1.74 1.02|1.0 0 6.0| 0 0 | 0 2048M| 19 37 0 10 0 May 28 12:39:41 l75lg1-v1 dstat.sh[49771]: 28-05 12:39:41| 2 1 86 11 0|1589M 8067M 258M 5790M| 11k 0 | 0 9040k| 0 881 |6184 11k|2.71 1.74 1.03|1.0 0 6.0| 0 0 | 0 2048M| 19 37 0 10 0 May 28 12:39:42 l75lg1-v1 dstat.sh[49771]: 28-05 12:39:42| 2 1 85 11 0|1589M 8067M 258M 5791M| 10k 0 | 0 9780k| 0 963 |6167 11k|2.71 1.74 1.03|2.0 1.0 6.0| 0 0 | 0 2048M| 19 37 0 4 0 May 28 12:39:43 l75lg1-v1 dstat.sh[49771]: 28-05 12:39:43| 1 1 84 13 0|1589M 8066M 258M 5791M| 15k 0 | 0 11M| 0 918 |6308 11k|2.71 1.74 1.03| 0 1.0 3.0| 0 0 | 0 2048M| 19 37 0 4 0 May 28 12:39:44 l75lg1-v1 dstat.sh[49771]: 28-05 12:39:44| 2 1 85 12 0|1589M 8065M 258M 5792M| 12k 0 | 0 15M| 0 1241 |6345 11k|2.71 1.74 1.03| 0 3.0 3.0| 0 0 | 0 2048M| 19 39 0 2 0 May 28 12:39:45 l75lg1-v1 dstat.sh[49771]: 28-05 12:39:45| 2 1 87 9 0|1589M 8064M 258M 5793M| 11k 0 | 0 7062k| 0 917 |6679 12k|2.71 1.74 1.03| 0 1.0 21| 0 0 | 0 2048M| 19 39 0 2 0 May 28 12:39:46 l75lg1-v1 dstat.sh[49771]: 28-05 12:39:46| 2 1 84 12 0|1589M 8062M 258M 5794M| 15k 0 | 0 16M| 0 1322 |7338 13k|2.74 1.76 1.04| 0 1.0 27| 0 0 | 0 2048M| 19 39 0 2 0 May 28 12:39:47 l75lg1-v1 dstat.sh[49771]: 28-05 12:39:47| 2 1 86 11 0|1589M 8062M 259M 5795M| 10k 172B| 0 8968k| 0 923 |5301 10k|2.74 1.76 1.04| 0 1.0 15| 0 0 | 0 2048M| 19 39 0 2 0 May 28 12:39:48 l75lg1-v1 dstat.sh[49771]: 28-05 12:39:48| 2 1 86 11 0|1590M 8060M 259M 5795M| 11k 0 | 0 9301k| 0 891 |6160 11k|2.74 1.76 1.04| 0 1.0 17| 0 0 | 0 2048M| 19 39 0 2 0 May 28 12:39:49 l75lg1-v1 dstat.sh[49771]: 28-05 12:39:49| 2 0 86 11 0|1590M 8060M 259M 5796M| 14k 0 | 0 12M| 0 1041 |6119 11k|2.74 1.76 1.04| 0 2.0 15| 0 0 | 0 2048M| 19 39 0 2 0 May 28 12:39:50 l75lg1-v1 dstat.sh[49771]: 28-05 12:39:50| 1 1 84 13 0|1590M 8059M 259M 5796M| 14k 0 | 0 12M| 0 1019 |5999 11k|2.74 1.76 1.04| 0 1.0 3.0| 0 0 | 0 2048M| 19 39 0 2 0 May 28 12:39:51 l75lg1-v1 dstat.sh[49771]: 28-05 12:39:51| 2 1 86 11 0|1590M 8059M 259M 5797M| 10k 0 | 0 9243k| 0 844 |5597 10k|2.76 1.78 1.05|1.0 1.0 6.0| 0 0 | 0 2048M| 19 39 0 2 0 May 28 12:39:52 l75lg1-v1 dstat.sh[49771]: 28-05 12:39:52| 1 1 85 13 0|1590M 8058M 260M 5797M| 11k 208B| 0 11M| 0 938 |5519 9610 |2.76 1.78 1.05| 0 1.0 0| 0 0 | 0 2048M| 19 39 0 2 0 May 28 12:39:53 l75lg1-v1 dstat.sh[49771]: 28-05 12:39:53| 3 1 87 9 0|1592M 8055M 260M 5797M| 18k 0 | 0 5671k| 0 737 |5962 10k|2.76 1.78 1.05| 0 1.0 9.0| 0 0 | 0 2048M| 19 39 0 2 0 May 28 12:39:54 l75lg1-v1 dstat.sh[49771]: 28-05 12:39:54| 2 1 85 12 0|1592M 8055M 260M 5798M| 13k 0 | 0 11M| 0 987 |5698 10k|2.76 1.78 1.05| 0 1.0 6.0| 0 0 | 0 2048M| 19 39 0 2 0 May 28 12:39:55 l75lg1-v1 dstat.sh[49771]: 28-05 12:39:55| 3 1 84 13 0|1592M 8054M 260M 5798M| 13k 172B| 0 11M| 0 946 |6299 11k|2.76 1.78 1.05| 0 1.0 0| 0 0 | 0 2048M| 19 39 0 2 0 May 28 12:39:56 l75lg1-v1 dstat.sh[49771]: 28-05 12:39:56| 1 0 86 12 0|1594M 8054M 260M 5797M| 19k 0 | 0 12M| 0 1058 |6528 12k|2.86 1.82 1.07| 0 1.0 0| 0 0 | 0 2048M| 19 39 0 2 0 May 28 12:39:57 l75lg1-v1 dstat.sh[49771]: 28-05 12:39:57| 2 1 87 10 0|1595M 8054M 260M 5795M| 16k 42B| 0 6431k| 0 834 |6029 11k|2.86 1.82 1.07| 0 1.0 0| 0 0 | 0 2048M| 19 39 0 2 0 May 28 12:39:58 l75lg1-v1 dstat.sh[49771]: 28-05 12:39:58| 1 1 86 12 0|1595M 8054M 260M 5794M| 17k 1265B| 0 12M| 0 1064 |6592 12k|2.86 1.82 1.07| 0 2.0 2.0| 0 0 | 0 2048M| 19 39 0 1 0 May 28 12:39:59 l75lg1-v1 dstat.sh[49771]: 28-05 12:39:59| 1 1 85 12 0|1597M 8054M 260M 5793M| 17k 0 | 0 10M| 0 948 |6292 11k|2.86 1.82 1.07| 0 1.0 0| 0 0 | 0 2048M| 19 39 0 1 0 May 28 12:40:00 l75lg1-v1 dstat.sh[49771]: 28-05 12:40:00| 2 1 86 11 0|1597M 8054M 260M 5793M| 16k 172B| 0 9388k| 0 930 |6135 11k|2.86 1.82 1.07| 0 1.0 9.0| 0 0 | 0 2048M| 19 39 0 1 0 May 28 12:40:01 l75lg1-v1 dstat.sh[49771]: 28-05 12:40:01| 2 0 85 12 0|1596M 8054M 261M 5793M| 13k 0 | 0 12M| 0 1037 |5764 10k|2.87 1.84 1.08|1.0 1.0 5.0| 0 0 | 0 2048M| 19 39 0 1 0 May 28 12:40:02 l75lg1-v1 dstat.sh[49771]: 28-05 12:40:02| 3 0 84 11 0|1597M 8054M 261M 5793M| 13k 0 | 0 13M| 0 1051 |5479 9869 |2.87 1.84 1.08|1.0 0 6.0| 0 0 | 0 2048M| 19 37 0 2 0 May 28 12:40:03 l75lg1-v1 dstat.sh[49771]: 28-05 12:40:03| 6 6 88 1 0|1488M 8163M 261M 5793M| 17k 55k| 0 1380k| 0 92.0 |3881 4074 |2.87 1.84 1.08|3.0 0 389| 0 0 | 0 2048M| 19 33 0 2 0 May 28 12:40:04 l75lg1-v1 dstat.sh[49771]: 28-05 12:40:04| 17 7 74 2 0|1561M 8089M 261M 5793M| 14k 24k| 0 2935k| 0 223 |4559 5443 |2.87 1.84 1.08|3.0 1.0 322| 0 0 | 0 2048M| 19 33 0 8 0 May 28 12:40:05 l75lg1-v1 dstat.sh[49771]: 28-05 12:40:05| 27 3 69 1 0|1690M 7960M 261M 5794M| 13k 0 | 0 1857k| 0 128 |2152 2255 |2.87 1.84 1.08|3.0 0 3.0| 0 0 | 0 2048M| 19 33 0 8 0 May 28 12:40:06 l75lg1-v1 dstat.sh[49771]: 28-05 12:40:06| 28 2 70 0 0|1797M 7851M 261M 5795M| 17k 0 | 0 2088k| 0 95.0 |1948 1695 |2.88 1.86 1.09|3.0 0 0| 0 0 | 0 2048M| 19 33 0 8 0 May 28 12:40:07 l75lg1-v1 dstat.sh[49771]: 28-05 12:40:07| 19 2 74 4 0|1863M 7782M 261M 5798M| 10k 1198B| 0 7829k| 0 457 |4080 5926 |2.88 1.86 1.09| 0 2.0 3.0| 0 0 | 0 2048M| 19 39 0 8 0 May 28 12:40:08 l75lg1-v1 dstat.sh[49771]: 28-05 12:40:08| 4 1 82 13 0|1862M 7781M 261M 5800M| 11k 0 | 0 9647k| 0 897 |7296 12k|2.88 1.86 1.09|2.0 1.0 50| 0 0 | 0 2048M| 19 39 0 8 0 May 28 12:40:09 l75lg1-v1 dstat.sh[49771]: 28-05 12:40:09| 3 1 82 13 0|1861M 7780M 261M 5802M| 11k 0 | 0 12M| 0 965 |7109 12k|2.88 1.86 1.09|4.0 1.0 33| 0 0 | 0 2048M| 19 39 0 8 0 May 28 12:40:10 l75lg1-v1 dstat.sh[49771]: 28-05 12:40:10| 2 1 83 14 0|1859M 7780M 261M 5803M| 21k 0 | 0 14M| 0 1061 |7375 12k|2.88 1.86 1.09| 0 2.0 21| 0 0 | 0 2048M| 19 39 0 8 0 May 28 12:40:11 l75lg1-v1 dstat.sh[49771]: 28-05 12:40:11| 2 1 84 13 0|1858M 7779M 261M 5805M| 16k 172B| 0 12M| 0 982 |6952 12k|2.89 1.88 1.10| 0 1.0 24| 0 0 | 0 2048M| 19 39 0 8 0 May 28 12:40:12 l75lg1-v1 dstat.sh[49771]: 28-05 12:40:12| 4 1 82 13 0|1858M 7779M 261M 5806M| 12k 0 | 0 12M| 0 993 |6873 11k|2.89 1.88 1.10| 0 1.0 27| 0 0 | 0 2048M| 19 39 0 8 0 May 28 12:40:13 l75lg1-v1 dstat.sh[49771]: 28-05 12:40:13| 2 1 83 13 0|1857M 7778M 262M 5807M| 14k 0 | 0 13M| 0 1031 |6874 12k|2.89 1.88 1.10| 0 1.0 30| 0 0 | 0 2048M| 19 39 0 8 0 May 28 12:40:14 l75lg1-v1 dstat.sh[49771]: 28-05 12:40:14| 2 1 83 13 0|1856M 7777M 262M 5808M| 11k 0 | 0 13M| 0 1040 |7152 12k|2.89 1.88 1.10| 0 3.0 24| 0 0 | 0 2048M| 19 39 0 8 0 May 28 12:40:15 l75lg1-v1 dstat.sh[49771]: 28-05 12:40:15| 2 0 83 13 0|1856M 7775M 262M 5810M| 10k 0 | 0 13M| 0 1139 |7149 12k|2.89 1.88 1.10| 0 2.0 30| 0 0 | 0 2048M| 19 39 0 8 0 May 28 12:40:16 l75lg1-v1 dstat.sh[49771]: 28-05 12:40:16| 2 1 83 13 0|1857M 7773M 262M 5811M| 15k 0 | 0 13M| 0 1023 |7132 12k|2.90 1.90 1.11|1.0 2.0 24| 0 0 | 0 2048M| 19 39 0 8 0 May 28 12:40:17 l75lg1-v1 dstat.sh[49771]: 28-05 12:40:17| 3 1 82 14 0|1858M 7771M 262M 5813M| 11k 0 | 0 13M| 0 1007 |6607 11k|2.90 1.90 1.11| 0 1.0 18| 0 0 | 0 2048M| 19 39 0 8 0 May 28 12:40:18 l75lg1-v1 dstat.sh[49771]: 28-05 12:40:18| 2 1 83 14 0|1858M 7769M 262M 5814M| 12k 0 | 0 12M| 0 1072 |7278 12k|2.90 1.90 1.11| 0 1.0 38| 0 0 | 0 2048M| 19 39 0 8 0 May 28 12:40:19 l75lg1-v1 dstat.sh[49771]: 28-05 12:40:19| 4 1 82 13 0|1857M 7769M 262M 5815M| 13k 172B| 0 11M| 0 965 |6724 11k|2.90 1.90 1.11| 0 2.0 33| 0 0 | 0 2048M| 19 39 0 8 0 May 28 12:40:20 l75lg1-v1 dstat.sh[49771]: 28-05 12:40:20| 2 1 83 14 0|1856M 7768M 262M 5817M| 19k 0 | 0 12M| 0 1011 |7264 13k|2.90 1.90 1.11| 0 1.0 33| 0 0 | 0 2048M| 19 39 0 8 0 May 28 12:40:21 l75lg1-v1 dstat.sh[49771]: 28-05 12:40:21| 2 1 84 13 0|1856M 7767M 262M 5817M| 12k 620B| 0 12M| 0 1052 |6880 12k|2.91 1.92 1.12| 0 3.0 27| 0 0 | 0 2048M| 19 39 0 8 0 May 28 12:40:22 l75lg1-v1 dstat.sh[49771]: 28-05 12:40:22| 2 1 83 13 0|1856M 7766M 262M 5819M| 12k 0 | 0 13M| 0 1003 |6896 12k|2.91 1.92 1.12| 0 2.0 6.0| 0 0 | 0 2048M| 19 39 0 8 0 May 28 12:40:23 l75lg1-v1 dstat.sh[49771]: 28-05 12:40:23| 4 2 80 13 0|1859M 7761M 262M 5820M| 15k 0 | 0 12M| 0 986 |8205 14k|2.91 1.92 1.12| 0 1.0 58| 0 0 | 0 2048M| 19 39 0 8 0 May 28 12:40:24 l75lg1-v1 dstat.sh[49771]: 28-05 12:40:24| 7 1 78 13 0|1737M 7882M 262M 5821M| 14k 3299B| 0 13M| 0 1046 |6764 12k|2.91 1.92 1.12|3.0 2.0 42| 0 0 | 0 2048M| 19 37 0 8 0 May 28 12:40:25 l75lg1-v1 dstat.sh[49771]: 28-05 12:40:25| 10 2 74 13 0|1780M 7838M 262M 5822M| 13k 761B| 0 13M| 0 1050 |7248 12k|2.91 1.92 1.12|1.0 1.0 26| 0 0 | 0 2048M| 19 37 0 8 0 May 28 12:40:26 l75lg1-v1 dstat.sh[49771]: 28-05 12:40:26| 10 2 74 13 0|1820M 7797M 263M 5823M| 15k 0 | 0 12M| 0 1049 |7030 11k|3.08 1.97 1.14|1.0 1.0 18| 0 0 | 0 2048M| 19 37 0 8 0 May 28 12:40:27 l75lg1-v1 dstat.sh[49771]: 28-05 12:40:27| 11 1 74 14 0|1852M 7764M 263M 5825M|9724B 760B| 0 13M| 0 1017 |7230 12k|3.08 1.97 1.14|1.0 1.0 21| 0 0 | 0 2048M| 19 39 0 8 0 May 28 12:40:28 l75lg1-v1 dstat.sh[49771]: 28-05 12:40:28| 6 3 78 13 0|1744M 7871M 263M 5826M| 12k 1772B| 0 12M| 0 1032 |7912 13k|3.08 1.97 1.14| 0 1.0 100| 0 0 | 0 2048M| 19 37 0 8 0 May 28 12:40:29 l75lg1-v1 dstat.sh[49771]: 28-05 12:40:29| 2 1 83 13 0|1742M 7871M 263M 5827M| 13k 0 | 0 12M| 0 960 |6412 11k|3.08 1.97 1.14| 0 1.0 27| 0 0 | 0 2048M| 19 37 0 8 0 May 28 12:40:30 l75lg1-v1 dstat.sh[49771]: 28-05 12:40:30| 1 1 84 13 0|1742M 7870M 263M 5828M| 16k 0 | 0 12M| 0 994 |6380 11k|3.08 1.97 1.14| 0 2.0 21| 0 0 | 0 2048M| 19 37 0 8 0 May 28 12:40:31 l75lg1-v1 dstat.sh[49771]: 28-05 12:40:31| 2 1 84 13 0|1740M 7870M 263M 5829M| 11k 0 | 0 13M| 0 1090 |6397 11k|3.15 2.00 1.16|1.0 3.0 24| 0 0 | 0 2048M| 19 37 0 8 0 May 28 12:40:32 l75lg1-v1 dstat.sh[49771]: 28-05 12:40:32| 2 1 84 12 0|1740M 7869M 263M 5831M| 14k 0 | 0 13M| 0 1041 |6717 11k|3.15 2.00 1.16|1.0 1.0 18| 0 0 | 0 2048M| 19 37 0 8 0 May 28 12:40:33 l75lg1-v1 dstat.sh[49771]: 28-05 12:40:33| 2 1 84 13 0|1739M 7868M 263M 5832M| 17k 0 | 0 12M| 0 935 |6505 11k|3.15 2.00 1.16| 0 1.0 15| 0 0 | 0 2048M| 19 37 0 8 0 May 28 12:40:34 l75lg1-v1 dstat.sh[49771]: 28-05 12:40:34| 2 1 83 13 0|1738M 7867M 263M 5834M| 15k 172B| 0 13M| 0 971 |6609 11k|3.15 2.00 1.16| 0 1.0 6.0| 0 0 | 0 2048M| 19 37 0 8 0 May 28 12:40:35 l75lg1-v1 dstat.sh[49771]: 28-05 12:40:35| 1 1 83 14 0|1741M 7864M 263M 5834M| 13k 0 | 0 12M| 0 1050 |7042 12k|3.15 2.00 1.16| 0 2.0 18| 0 0 | 0 2048M| 19 37 0 8 0 May 28 12:40:36 l75lg1-v1 dstat.sh[49771]: 28-05 12:40:36| 2 1 85 11 0|1740M 7862M 263M 5837M| 16k 0 | 0 10M| 0 938 |7279 12k|3.30 2.05 1.18| 0 1.0 39| 0 0 | 0 2048M| 19 37 0 8 0 May 28 12:40:37 l75lg1-v1 dstat.sh[49771]: 28-05 12:40:37| 4 1 81 13 0|1742M 7860M 263M 5837M| 12k 723B| 0 11M| 0 1043 |6360 11k|3.30 2.05 1.18| 0 1.0 6.0| 0 0 | 0 2048M| 19 37 0 8 0 May 28 12:40:38 l75lg1-v1 dstat.sh[49771]: 28-05 12:40:38| 4 1 81 14 0|1742M 7859M 263M 5838M| 11k 0 | 0 13M| 0 1013 |6143 11k|3.30 2.05 1.18| 0 2.0 2.0| 0 0 | 0 2048M| 19 37 0 8 0 May 28 12:40:39 l75lg1-v1 dstat.sh[49771]: 28-05 12:40:39| 2 1 83 14 0|1740M 7858M 264M 5840M| 11k 0 | 0 13M| 0 1024 |6753 12k|3.30 2.05 1.18| 0 1.0 0| 0 0 | 0 2048M| 19 37 0 8 0 May 28 12:40:40 l75lg1-v1 dstat.sh[49771]: 28-05 12:40:40| 1 1 84 13 0|1741M 7856M 264M 5842M| 14k 0 | 0 13M| 0 1010 |6764 12k|3.30 2.05 1.18|1.0 1.0 0| 0 0 | 0 2048M| 19 37 0 8 0 May 28 12:40:41 l75lg1-v1 dstat.sh[49771]: 28-05 12:40:41| 1 1 84 14 0|1740M 7855M 264M 5843M| 10k 0 | 0 14M| 0 995 |6441 12k|3.27 2.07 1.19|3.0 1.0 0| 0 0 | 0 2048M| 19 37 0 8 0 May 28 12:40:42 l75lg1-v1 dstat.sh[49771]: 28-05 12:40:42| 1 1 84 13 0|1740M 7854M 264M 5845M| 11k 214B| 0 13M| 0 1008 |5865 11k|3.27 2.07 1.19| 0 2.0 0| 0 0 | 0 2048M| 19 37 0 8 0 May 28 12:40:43 l75lg1-v1 dstat.sh[49771]: 28-05 12:40:43| 2 1 84 13 0|1740M 7852M 264M 5846M| 14k 0 | 0 13M| 0 975 |6207 11k|3.27 2.07 1.19| 0 2.0 0| 0 0 | 0 2048M| 19 37 0 8 0 May 28 12:40:44 l75lg1-v1 dstat.sh[49771]: 28-05 12:40:44| 2 1 83 14 0|1739M 7851M 264M 5848M| 12k 0 | 0 14M| 0 1023 |7130 12k|3.27 2.07 1.19| 0 2.0 0| 0 0 | 0 2048M| 19 37 0 8 0 May 28 12:40:45 l75lg1-v1 dstat.sh[49771]: 28-05 12:40:45| 1 0 84 13 0|1739M 7850M 264M 5850M| 12k 0 | 0 14M| 0 1052 |6786 12k|3.27 2.07 1.19|2.0 1.0 0| 0 0 | 0 2048M| 19 37 0 8 0 May 28 12:40:46 l75lg1-v1 dstat.sh[49771]: 28-05 12:40:46| 2 1 83 14 0|1739M 7848M 264M 5851M| 11k 0 | 0 13M| 0 1053 |6361 11k|3.25 2.08 1.20| 0 1.0 3.0| 0 0 | 0 2048M| 19 37 0 8 0 May 28 12:40:47 l75lg1-v1 dstat.sh[49771]: 28-05 12:40:47| 2 1 83 14 0|1738M 7848M 264M 5852M| 14k 172B| 0 13M| 0 1036 |6656 11k|3.25 2.08 1.20| 0 1.0 9.0| 0 0 | 0 2048M| 19 37 0 8 0 May 28 12:40:48 l75lg1-v1 dstat.sh[49771]: 28-05 12:40:48| 2 1 84 13 0|1738M 7847M 264M 5853M| 12k 0 | 0 13M| 0 1117 |6716 12k|3.25 2.08 1.20| 0 2.0 8.0| 0 0 | 0 2048M| 19 37 0 8 0 May 28 12:40:49 l75lg1-v1 dstat.sh[49771]: 28-05 12:40:49| 3 1 83 13 0|1738M 7846M 264M 5854M| 11k 0 | 0 13M| 0 1120 |6273 12k|3.25 2.08 1.20|1.0 1.0 0| 0 0 | 0 2048M| 19 37 0 8 0 May 28 12:40:50 l75lg1-v1 dstat.sh[49771]: 28-05 12:40:50| 4 1 82 12 0|1738M 7845M 264M 5855M| 14k 172B| 0 12M| 0 1047 |5841 11k|3.25 2.08 1.20| 0 1.0 9.0| 0 0 | 0 2048M| 19 37 0 8 0 May 28 12:40:51 l75lg1-v1 dstat.sh[49771]: 28-05 12:40:51| 7 1 79 12 0|1610M 7971M 264M 5856M| 13k 482B| 0 13M| 0 1091 |6016 11k|3.23 2.10 1.21|1.0 1.0 48| 0 0 | 0 2048M| 19 35 0 8 0 May 28 12:40:52 l75lg1-v1 dstat.sh[49771]: 28-05 12:40:52| 8 4 83 5 0|1499M 8082M 264M 5856M| 16k 13k| 0 9120k| 0 650 |3586 5310 |3.23 2.10 1.21|1.0 0 186| 0 0 | 0 2048M| 19 33 0 8 0 May 28 12:40:53 l75lg1-v1 dstat.sh[49771]: 28-05 12:40:53| 9 1 88 1 0|1545M 8037M 264M 5856M| 16k 0 | 0 1492k| 0 126 |1392 1821 |3.23 2.10 1.21|1.0 0 1.0| 0 0 | 0 2048M| 19 33 0 8 0 May 28 12:40:54 l75lg1-v1 dstat.sh[49771]: 28-05 12:40:54| 9 1 87 2 0|1580M 8001M 264M 5856M| 11k 0 | 0 3680k| 0 229 |1537 2183 |3.23 2.10 1.21|1.0 0 0| 0 0 | 0 2048M| 19 33 0 8 0 May 28 12:40:55 l75lg1-v1 dstat.sh[49771]: 28-05 12:40:55| 10 1 90 0 0|1608M 7973M 264M 5856M| 14k 2913B| 0 96k| 0 13.0 |1461 1931 |3.23 2.10 1.21|1.0 0 0| 0 0 | 0 2048M| 19 39 0 8 0 May 28 12:40:56 l75lg1-v1 dstat.sh[49771]: 28-05 12:40:56| 9 1 90 0 0|1520M 8061M 264M 5856M| 12k 1231B| 0 68k| 0 8.00 |1252 1381 |3.13 2.10 1.21|1.0 0 15| 0 0 | 0 2048M| 19 33 0 8 0 May 28 12:40:57 l75lg1-v1 dstat.sh[49771]: 28-05 12:40:57| 9 1 89 0 0|1566M 8015M 264M 5856M| 14k 0 | 0 36k| 0 6.00 |1088 1270 |3.13 2.10 1.21|1.0 0 1.0| 0 0 | 0 2048M| 19 33 0 8 0 May 28 12:40:58 l75lg1-v1 dstat.sh[49771]: 28-05 12:40:58| 10 1 90 0 0|1605M 7976M 264M 5856M| 11k 1000B| 0 104k| 0 17.0 |1291 1682 |3.13 2.10 1.21|1.0 0 2.0| 0 0 | 0 2048M| 19 35 0 8 0 May 28 12:40:59 l75lg1-v1 dstat.sh[49771]: 28-05 12:40:59| 7 10 82 0 0|1497M 8084M 264M 5856M| 20k 21k| 0 404k| 0 55.0 |4665 5894 |3.13 2.10 1.21|2.0 0 631| 0 0 | 0 2048M| 19 33 0 8 0 May 28 12:41:00 l75lg1-v1 dstat.sh[49771]: 28-05 12:41:00| 4 13 81 0 0|1508M 8073M 264M 5856M| 27k 35k| 0 440k| 0 49.0 |6816 8654 |3.13 2.10 1.21|1.0 0 1.1| 0 0 | 0 2048M| 19 33 0 8 0 May 28 12:41:01 l75lg1-v1 dstat.sh[49771]: 28-05 12:41:01| 4 9 87 0 0|1513M 8068M 264M 5856M| 16k 35k| 0 328k| 0 40.0 |5665 6468 |2.88 2.06 1.20|1.0 0 737| 0 0 | 0 2048M| 19 33 0 8 0 May 28 12:41:02 l75lg1-v1 dstat.sh[49771]: 28-05 12:41:02| 3 9 88 0 0|1515M 8066M 264M 5856M| 15k 33k| 0 684k| 0 101 |5509 6101 |2.88 2.06 1.20|1.0 0 695| 0 0 | 0 2048M| 19 33 0 8 0 May 28 12:41:03 l75lg1-v1 dstat.sh[49771]: 28-05 12:41:03| 3 9 87 0 0|1515M 8066M 264M 5856M| 25k 41k| 0 56k| 0 14.0 |5875 6567 |2.88 2.06 1.20|1.0 0 622| 0 0 | 0 2048M| 19 33 0 8 0 May 28 12:41:04 l75lg1-v1 dstat.sh[49771]: 28-05 12:41:04| 8 8 83 0 0|1501M 8080M 264M 5856M| 16k 28k| 0 1140k| 0 173 |5537 6237 |2.88 2.06 1.20|1.0 0 612| 0 0 | 0 2048M| 19 33 0 4 0 May 28 12:41:05 l75lg1-v1 dstat.sh[49771]: 28-05 12:41:05| 9 1 89 0 0|1546M 8035M 264M 5856M| 12k 0 | 0 256k| 0 15.0 |1092 1494 |2.88 2.06 1.20|1.0 0 0| 0 0 | 0 2048M| 19 33 0 4 0 May 28 12:41:06 l75lg1-v1 dstat.sh[49771]: 28-05 12:41:06| 8 1 89 2 0|1580M 8000M 264M 5858M| 15k 3360B| 0 1520k| 0 135 |2094 3360 |2.73 2.04 1.20| 0 1.0 1.0| 0 0 | 0 2048M| 19 37 0 3 0 May 28 12:41:07 l75lg1-v1 dstat.sh[49771]: 28-05 12:41:07| 1 1 86 12 0|1580M 7998M 264M 5859M| 18k 0 | 0 10M| 0 988 |6630 12k|2.73 2.04 1.20| 0 1.0 9.0| 0 0 | 0 2048M| 19 37 0 3 0 May 28 12:41:08 l75lg1-v1 dstat.sh[49771]: 28-05 12:41:08| 1 0 87 11 0|1579M 7998M 265M 5860M| 13k 0 | 0 9844k| 0 918 |6113 11k|2.73 2.04 1.20| 0 1.0 2.0| 0 0 | 0 2048M| 19 37 0 3 0 May 28 12:41:09 l75lg1-v1 dstat.sh[49771]: 28-05 12:41:09| 2 1 86 11 0|1580M 7996M 265M 5861M| 15k 3504B| 0 10M| 0 1070 |6049 11k|2.73 2.04 1.20| 0 2.0 3.0| 0 0 | 0 2048M| 19 37 0 3 0 May 28 12:41:10 l75lg1-v1 dstat.sh[49771]: 28-05 12:41:10| 2 1 85 11 0|1580M 7996M 265M 5861M| 17k 4561B| 0 11M| 0 1026 |6834 12k|2.73 2.04 1.20|1.0 1.0 0| 0 0 | 0 2048M| 19 37 0 3 0 May 28 12:41:11 l75lg1-v1 dstat.sh[49771]: 28-05 12:41:11| 3 1 86 10 0|1579M 7995M 265M 5862M| 12k 604B| 0 8585k| 0 859 |5780 10k|2.75 2.06 1.21| 0 1.0 3.0| 0 0 | 0 2048M| 19 37 0 3 0 May 28 12:41:12 l75lg1-v1 dstat.sh[49771]: 28-05 12:41:12| 2 0 84 12 0|1579M 7994M 265M 5863M| 11k 0 | 0 13M| 0 1114 |6198 11k|2.75 2.06 1.21|1.0 1.0 3.0| 0 0 | 0 2048M| 19 37 0 3 0 May 28 12:41:13 l75lg1-v1 dstat.sh[49771]: 28-05 12:41:13| 3 1 86 9 0|1579M 7994M 265M 5863M| 14k 1223B| 0 9808k| 0 907 |5879 10k|2.75 2.06 1.21| 0 1.0 3.0| 0 0 | 0 2048M| 19 37 0 3 0 May 28 12:41:14 l75lg1-v1 dstat.sh[49771]: 28-05 12:41:14| 2 0 87 10 0|1579M 7993M 265M 5864M| 10k 172B| 0 9830k| 0 967 |6278 11k|2.75 2.06 1.21| 0 1.0 0| 0 0 | 0 2048M| 19 37 0 3 0 May 28 12:41:15 l75lg1-v1 dstat.sh[49771]: 28-05 12:41:15| 2 0 85 11 0|1578M 7993M 265M 5864M| 11k 1264B| 0 12M| 0 1055 |6098 11k|2.75 2.06 1.21| 0 3.0 0| 0 0 | 0 2048M| 19 37 0 3 0 May 28 12:41:16 l75lg1-v1 dstat.sh[49771]: 28-05 12:41:16| 2 1 85 12 0|1578M 7993M 265M 5865M| 10k 1248B| 0 13M| 0 1151 |6744 12k|2.85 2.09 1.23| 0 1.0 6.0| 0 0 | 0 2048M| 19 37 0 3 0 May 28 12:41:17 l75lg1-v1 dstat.sh[49771]: 28-05 12:41:17| 4 0 87 7 0|1578M 7992M 265M 5866M| 16k 3029B| 0 5616k| 0 702 |5555 9759 |2.85 2.09 1.23| 0 2.0 0| 0 0 | 0 2048M| 19 37 0 3 0 May 28 12:41:18 l75lg1-v1 dstat.sh[49771]: 28-05 12:41:18| 1 1 85 13 0|1578M 7992M 265M 5866M| 12k 1653B| 0 13M| 0 1158 |6278 11k|2.85 2.09 1.23|2.0 1.0 2.0| 0 0 | 0 2048M| 19 37 0 3 0 May 28 12:41:19 l75lg1-v1 dstat.sh[49771]: 28-05 12:41:19| 2 1 86 11 0|1577M 7991M 265M 5867M| 16k 3076B| 0 10M| 0 973 |6598 11k|2.85 2.09 1.23| 0 1.0 3.0| 0 0 | 0 2048M| 19 37 0 3 0 May 28 12:41:20 l75lg1-v1 dstat.sh[49771]: 28-05 12:41:20| 3 1 84 12 0|1577M 7991M 265M 5868M| 16k 1279B| 0 13M| 0 1155 |5866 10k|2.85 2.09 1.23| 0 1.0 0| 0 0 | 0 2048M| 19 37 0 3 0 May 28 12:41:21 l75lg1-v1 dstat.sh[49771]: 28-05 12:41:21| 5 1 87 7 0|1579M 7989M 265M 5868M| 12k 2660B| 0 5052k| 0 565 |4831 8565 |2.70 2.07 1.23| 0 2.0 3.0| 0 0 | 0 2048M| 19 37 0 3 0 May 28 12:41:22 l75lg1-v1 dstat.sh[49771]: 28-05 12:41:22| 2 1 84 12 0|1578M 7989M 265M 5869M| 14k 558B| 0 13M| 0 1091 |6572 11k|2.70 2.07 1.23| 0 1.0 0| 0 0 | 0 2048M| 19 37 0 3 0 May 28 12:41:23 l75lg1-v1 dstat.sh[49771]: 28-05 12:41:23| 5 2 85 8 0|1582M 7984M 265M 5870M| 15k 0 | 0 6988k| 0 919 |7798 14k|2.70 2.07 1.23| 0 1.0 52| 0 0 | 0 2048M| 19 37 0 4 0 May 28 12:41:24 l75lg1-v1 dstat.sh[49771]: 28-05 12:41:24| 2 1 84 13 0|1581M 7984M 265M 5870M| 12k 0 | 0 17M| 0 1460 |7336 13k|2.70 2.07 1.23|1.0 1.0 3.0| 0 0 | 0 2048M| 19 37 0 4 0 May 28 12:41:25 l75lg1-v1 dstat.sh[49771]: 28-05 12:41:25| 1 1 88 10 0|1581M 7984M 265M 5870M| 12k 612B| 0 8372k| 0 973 |6812 12k|2.70 2.07 1.23|1.0 1.0 3.0| 0 0 | 0 2048M| 19 37 0 3 0 May 28 12:41:26 l75lg1-v1 dstat.sh[49771]: 28-05 12:41:26| 1 1 85 12 0|1581M 7983M 265M 5871M| 10k 0 | 0 12M| 0 1005 |5609 9885 |2.73 2.09 1.24| 0 2.0 0| 0 0 | 0 2048M| 19 37 0 3 0 May 28 12:41:27 l75lg1-v1 dstat.sh[49771]: 28-05 12:41:27| 2 1 85 12 0|1581M 7982M 266M 5872M| 15k 1264B| 0 13M| 0 988 |5647 9786 |2.73 2.09 1.24| 0 1.0 0| 0 0 | 0 2048M| 19 37 0 3 0 May 28 12:41:28 l75lg1-v1 dstat.sh[49771]: 28-05 12:41:28| 2 1 85 12 0|1581M 7981M 266M 5873M| 12k 2569B| 0 9471k| 0 892 |6148 11k|2.73 2.09 1.24| 0 2.0 11| 0 0 | 0 2048M| 19 37 0 3 0 May 28 12:41:29 l75lg1-v1 dstat.sh[49771]: 28-05 12:41:29| 3 1 87 8 0|1582M 7979M 266M 5874M| 11k 2032B| 0 5467k| 0 544 |4835 8619 |2.73 2.09 1.24| 0 2.0 0| 0 0 | 0 2048M| 19 37 0 3 0 May 28 12:41:30 l75lg1-v1 dstat.sh[49771]: 28-05 12:41:30| 1 1 85 12 0|1582M 7978M 266M 5875M| 13k 2448B| 0 10M| 0 902 |5432 9481 |2.73 2.09 1.24| 0 2.0 6.0| 0 0 | 0 2048M| 19 37 0 3 0 May 28 12:41:31 l75lg1-v1 dstat.sh[49771]: 28-05 12:41:31| 2 1 85 12 0|1582M 7978M 266M 5875M| 11k 1925B| 0 10M| 0 919 |5749 10k|2.59 2.07 1.23| 0 1.0 0| 0 0 | 0 2048M| 19 37 0 3 0 May 28 12:41:32 l75lg1-v1 dstat.sh[49771]: 28-05 12:41:32| 3 1 86 9 0|1582M 7977M 266M 5876M| 11k 0 | 0 7382k| 0 804 |5893 10k|2.59 2.07 1.23|1.0 2.0 3.0| 0 0 | 0 2048M| 19 37 0 3 0 May 28 12:41:33 l75lg1-v1 dstat.sh[49771]: 28-05 12:41:33| 3 1 84 11 0|1583M 7976M 266M 5876M| 12k 1248B| 0 14M| 0 1148 |5954 10k|2.59 2.07 1.23| 0 1.0 0| 0 0 | 0 2048M| 19 37 0 3 0 May 28 12:41:34 l75lg1-v1 dstat.sh[49771]: 28-05 12:41:34| 2 1 87 10 0|1583M 7975M 266M 5877M| 14k 2072B| 0 7761k| 0 845 |6683 12k|2.59 2.07 1.23|2.0 1.0 0| 0 0 | 0 2048M| 19 37 0 3 0 May 28 12:41:35 l75lg1-v1 dstat.sh[49771]: 28-05 12:41:35| 1 1 87 11 0|1582M 7975M 266M 5877M| 10k 42B| 0 8553k| 0 878 |5889 11k|2.59 2.07 1.23| 0 2.0 0| 0 0 | 0 2048M| 19 37 0 3 0 May 28 12:41:36 l75lg1-v1 dstat.sh[49771]: 28-05 12:41:36| 1 1 85 13 0|1582M 7975M 266M 5877M| 10k 0 | 0 12M| 0 1039 |6026 11k|2.70 2.10 1.25|5.0 0 0| 0 0 | 0 2048M| 19 37 0 3 0 May 28 12:41:37 l75lg1-v1 dstat.sh[49771]: 28-05 12:41:37| 1 1 85 13 0|1583M 7975M 266M 5878M| 14k 172B| 0 13M| 0 1104 |5825 10k|2.70 2.10 1.25| 0 1.0 0| 0 0 | 0 2048M| 19 37 0 3 0 May 28 12:41:38 l75lg1-v1 dstat.sh[49771]: 28-05 12:41:38| 1 1 88 9 0|1583M 7974M 266M 5878M|9792B 0 | 0 8276k| 0 930 |5665 10k|2.70 2.10 1.25| 0 1.0 2.0| 0 0 | 0 2048M| 19 37 0 3 0 May 28 12:41:39 l75lg1-v1 dstat.sh[49771]: 28-05 12:41:39| 1 1 85 13 0|1583M 7974M 266M 5878M| 11k 0 | 0 11M| 0 1024 |5927 11k|2.70 2.10 1.25|1.0 1.0 0| 0 0 | 0 2048M| 19 37 0 3 0 May 28 12:41:40 l75lg1-v1 dstat.sh[49771]: 28-05 12:41:40| 1 1 84 13 0|1583M 7969M 266M 5883M| 14k 0 | 0 15M| 0 1022 |5806 10k|2.70 2.10 1.25|1.0 0 0| 0 0 | 0 2048M| 19 37 0 3 0 May 28 12:41:41 l75lg1-v1 dstat.sh[49771]: 28-05 12:41:41| 2 1 87 10 0|1583M 7968M 266M 5883M| 10k 0 | 0 7752k| 0 852 |5866 11k|2.73 2.12 1.26|1.0 1.0 0| 0 0 | 0 2048M| 19 37 0 3 0 May 28 12:41:42 l75lg1-v1 dstat.sh[49771]: 28-05 12:41:42| 1 1 85 12 0|1583M 7968M 266M 5884M| 13k 0 | 0 12M| 0 1091 |5753 10k|2.73 2.12 1.26|1.0 1.0 0| 0 0 | 0 2048M| 19 37 0 3 0 May 28 12:41:43 l75lg1-v1 dstat.sh[49771]: 28-05 12:41:43| 2 1 84 13 0|1583M 7968M 266M 5884M| 13k 0 | 0 14M| 0 1091 |6089 11k|2.73 2.12 1.26| 0 1.0 0| 0 0 | 0 2048M| 19 37 0 3 0 May 28 12:41:44 l75lg1-v1 dstat.sh[49771]: 28-05 12:41:44| 2 1 88 9 0|1582M 7968M 266M 5885M| 15k 0 | 0 7614k| 0 871 |6340 11k|2.73 2.12 1.26|1.0 1.0 0| 0 0 | 0 2048M| 19 37 0 3 0 May 28 12:41:45 l75lg1-v1 dstat.sh[49771]: 28-05 12:41:45| 1 1 84 13 0|1582M 7968M 266M 5885M| 13k 172B| 0 13M| 0 1154 |6202 11k|2.73 2.12 1.26| 0 1.0 0| 0 0 | 0 2048M| 19 37 0 3 0 May 28 12:41:46 l75lg1-v1 dstat.sh[49771]: 28-05 12:41:46| 1 1 88 10 0|1582M 7967M 266M 5885M| 13k 0 | 0 7778k| 0 935 |6816 12k|2.59 2.10 1.26|1.0 1.0 0| 0 0 | 0 2048M| 19 37 0 3 0 May 28 12:41:47 l75lg1-v1 dstat.sh[49771]: 28-05 12:41:47| 1 1 85 12 0|1582M 7967M 266M 5886M| 17k 0 | 0 13M| 0 1153 |5964 11k|2.59 2.10 1.26| 0 1.0 0| 0 0 | 0 2048M| 19 37 0 3 0 May 28 12:41:48 l75lg1-v1 dstat.sh[49771]: 28-05 12:41:48| 1 1 85 13 0|1582M 7966M 266M 5886M| 22k 0 | 0 14M| 0 1194 |6943 12k|2.59 2.10 1.26|1.0 2.0 2.0| 0 0 | 0 2048M| 19 37 0 3 0 May 28 12:41:49 l75lg1-v1 dstat.sh[49771]: 28-05 12:41:49| 1 1 85 13 0|1582M 7966M 266M 5887M| 10k 0 | 0 13M| 0 1137 |6469 11k|2.59 2.10 1.26|1.0 0 0| 0 0 | 0 2048M| 19 37 0 3 0 May 28 12:41:50 l75lg1-v1 dstat.sh[49771]: 28-05 12:41:50| 1 0 87 10 0|1581M 7966M 266M 5887M| 13k 0 | 0 8643k| 0 955 |6309 11k|2.59 2.10 1.26| 0 2.0 0| 0 0 | 0 2048M| 19 37 0 3 0 May 28 12:41:51 l75lg1-v1 dstat.sh[49771]: 28-05 12:41:51| 1 1 85 13 0|1582M 7965M 266M 5887M|9609B 0 | 0 12M| 0 1148 |6439 11k|2.62 2.12 1.27| 0 1.0 0| 0 0 | 0 2048M| 19 37 0 3 0 May 28 12:41:52 l75lg1-v1 dstat.sh[49771]: 28-05 12:41:52| 2 0 88 9 0|1582M 7964M 266M 5888M| 11k 0 | 0 7532k| 0 886 |6335 11k|2.62 2.12 1.27| 0 2.0 0| 0 0 | 0 2048M| 19 37 0 3 0 May 28 12:41:53 l75lg1-v1 dstat.sh[49771]: 28-05 12:41:53| 1 1 85 13 0|1582M 7964M 266M 5888M| 10k 172B| 0 14M| 0 1182 |6185 11k|2.62 2.12 1.27| 0 1.0 0| 0 0 | 0 2048M| 19 37 0 3 0 May 28 12:41:54 l75lg1-v1 dstat.sh[49771]: 28-05 12:41:54| 1 1 85 12 0|1581M 7964M 267M 5889M| 15k 0 | 0 15M| 0 1195 |6298 11k|2.62 2.12 1.27| 0 1.0 0| 0 0 | 0 2048M| 19 37 0 3 0 May 28 12:41:55 l75lg1-v1 dstat.sh[49771]: 28-05 12:41:55| 1 0 87 10 0|1581M 7963M 267M 5889M| 10k 0 | 0 7343k| 0 887 |6440 11k|2.62 2.12 1.27| 0 1.0 0| 0 0 | 0 2048M| 19 37 0 3 0 May 28 12:41:56 l75lg1-v1 dstat.sh[49771]: 28-05 12:41:56| 1 0 85 13 0|1581M 7963M 267M 5889M| 12k 0 | 0 12M| 0 1099 |5784 10k|2.49 2.10 1.27| 0 2.0 0| 0 0 | 0 2048M| 19 37 0 3 0 May 28 12:41:57 l75lg1-v1 dstat.sh[49771]: 28-05 12:41:57| 1 1 85 13 0|1581M 7963M 267M 5890M| 19k 0 | 0 13M| 0 1130 |6209 11k|2.49 2.10 1.27|1.0 1.0 0| 0 0 | 0 2048M| 19 37 0 3 0 May 28 12:41:58 l75lg1-v1 dstat.sh[49771]: 28-05 12:41:58| 2 0 85 12 0|1582M 7961M 267M 5890M| 12k 132B| 0 14M| 0 1159 |6584 11k|2.49 2.10 1.27| 0 2.0 2.0| 0 0 | 0 2048M| 19 37 0 3 0 May 28 12:41:59 l75lg1-v1 dstat.sh[49771]: 28-05 12:41:59| 1 1 88 10 0|1582M 7961M 267M 5891M| 13k 0 | 0 7984k| 0 910 |6372 11k|2.49 2.10 1.27| 0 1.0 0| 0 0 | 0 2048M| 19 37 0 3 0 May 28 12:42:00 l75lg1-v1 dstat.sh[49771]: 28-05 12:42:00| 1 0 85 13 0|1582M 7961M 267M 5891M| 16k 0 | 0 12M| 0 1113 |6193 11k|2.49 2.10 1.27| 0 2.0 0| 0 0 | 0 2048M| 19 37 0 3 0 May 28 12:42:01 l75lg1-v1 dstat.sh[49771]: 28-05 12:42:01| 1 1 87 10 0|1582M 7960M 267M 5892M| 15k 172B| 0 7612k| 0 869 |6346 11k|2.45 2.09 1.27| 0 1.0 0| 0 0 | 0 2048M| 19 37 0 3 0 May 28 12:42:02 l75lg1-v1 dstat.sh[49771]: 28-05 12:42:02| 1 1 85 13 0|1582M 7960M 267M 5892M| 11k 0 | 0 12M| 0 1057 |5825 10k|2.45 2.09 1.27| 0 1.0 0| 0 0 | 0 2048M| 19 37 0 3 0 May 28 12:42:03 l75lg1-v1 dstat.sh[49771]: 28-05 12:42:03| 1 0 86 12 0|1582M 7960M 267M 5892M| 11k 42B| 0 13M| 0 1106 |5936 10k|2.45 2.09 1.27| 0 1.0 0| 0 0 | 0 2048M| 19 37 0 3 0 May 28 12:42:04 l75lg1-v1 dstat.sh[49771]: 28-05 12:42:04| 1 0 88 9 0|1581M 7959M 267M 5892M| 16k 0 | 0 5532k| 0 799 |6091 11k|2.45 2.09 1.27| 0 1.0 0| 0 0 | 0 2048M| 19 37 0 3 0 May 28 12:42:05 l75lg1-v1 dstat.sh[49771]: 28-05 12:42:05| 1 1 85 13 0|1581M 7959M 267M 5893M| 14k 723B| 0 12M| 0 1046 |5854 10k|2.45 2.09 1.27| 0 2.0 0| 0 0 | 0 2048M| 19 37 0 1 0 May 28 12:42:06 l75lg1-v1 dstat.sh[49771]: 28-05 12:42:06| 1 1 84 13 0|1581M 7959M 267M 5893M| 13k 1508B| 0 12M| 0 1031 |6149 11k|2.34 2.08 1.27|1.0 1.0 0| 0 0 | 0 2048M| 19 39 0 1 0 May 28 12:42:07 l75lg1-v1 dstat.sh[49771]: 28-05 12:42:07| 2 0 87 10 0|1581M 7958M 267M 5894M| 15k 1264B| 0 8332k| 0 832 |5575 10k|2.34 2.08 1.27| 0 1.0 0| 0 0 | 0 2048M| 19 39 0 1 0 May 28 12:42:08 l75lg1-v1 dstat.sh[49771]: 28-05 12:42:08| 3 1 84 11 0|1581M 7958M 267M 5894M| 13k 0 | 0 13M| 0 1070 |5095 9649 |2.34 2.08 1.27|1.0 1.0 5.0| 0 0 | 0 2048M| 19 39 0 1 0 May 28 12:42:09 l75lg1-v1 dstat.sh[49771]: 28-05 12:42:09| 2 1 87 10 0|1582M 7957M 267M 5895M| 15k 5085B| 0 8097k| 0 848 |5398 11k|2.34 2.08 1.27| 0 1.0 0| 0 0 | 0 2048M| 19 39 0 1 0 May 28 12:42:10 l75lg1-v1 dstat.sh[49771]: 28-05 12:42:10| 2 1 85 11 0|1582M 7956M 267M 5896M| 16k 2237B| 0 9346k| 0 894 |5332 10k|2.34 2.08 1.27|1.0 1.0 0| 0 0 | 0 2048M| 19 39 0 1 0 May 28 12:42:11 l75lg1-v1 dstat.sh[49771]: 28-05 12:42:11| 9 1 84 5 0|1529M 8008M 267M 5896M| 12k 1480B| 0 7824k| 0 554 |2559 3855 |2.23 2.06 1.27|1.0 0 21| 0 0 | 0 2048M| 19 33 0 1 0 May 28 12:42:12 l75lg1-v1 dstat.sh[49771]: 28-05 12:42:12| 9 1 89 1 0|1578M 7959M 267M 5896M| 15k 2246B| 0 828k| 0 56.0 |1431 1747 |2.23 2.06 1.27|1.0 0 0| 0 0 | 0 2048M| 19 35 0 1 0 May 28 12:42:13 l75lg1-v1 dstat.sh[49771]: 28-05 12:42:13| 9 2 88 1 0|1514M 8024M 267M 5896M| 15k 9344B| 0 1336k| 0 85.0 |2081 2258 |2.23 2.06 1.27|3.0 0 96| 0 0 | 0 2048M| 19 33 0 1 0 May 28 12:42:14 l75lg1-v1 dstat.sh[49771]: 28-05 12:42:14| 8 2 90 0 0|1537M 8001M 267M 5896M| 16k 6655B| 0 72k| 0 5.00 |1727 1805 |2.23 2.06 1.27|2.0 0 81| 0 0 | 0 2048M| 19 33 0 1 0 May 28 12:42:14 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71013c1-f7ab-4046-ac32-434ee242458b None None] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:42:14 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71013c1-f7ab-4046-ac32-434ee242458b None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:42:14 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71013c1-f7ab-4046-ac32-434ee242458b None None] PATH_INFO: `/` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:42:14 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 384/752] 10.27.203.238 () {58 vars in 1014 bytes} [Tue May 28 12:42:14 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:42:14 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7d4fbd-67ec-48b6-8f9c-5ee83a9894a7 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:42:14 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7d4fbd-67ec-48b6-8f9c-5ee83a9894a7 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:42:14 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7d4fbd-67ec-48b6-8f9c-5ee83a9894a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:42:14 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-ac7d4fbd-67ec-48b6-8f9c-5ee83a9894a7 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:42:14 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-ac7d4fbd-67ec-48b6-8f9c-5ee83a9894a7 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:42:14 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-ac7d4fbd-67ec-48b6-8f9c-5ee83a9894a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:42:14 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 369/753] 10.27.203.238 () {62 vars in 1111 bytes} [Tue May 28 12:42:14 2024] POST /identity/v3/auth/tokens => generated 2198 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 12:42:14 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71013c1-f7ab-4046-ac32-434ee242458b None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:42:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71013c1-f7ab-4046-ac32-434ee242458b None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:42:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa68b08a-1841-4d07-8b4a-02a82f119c6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:42:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa68b08a-1841-4d07-8b4a-02a82f119c6e None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:42:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa68b08a-1841-4d07-8b4a-02a82f119c6e None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:42:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa68b08a-1841-4d07-8b4a-02a82f119c6e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:42:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa68b08a-1841-4d07-8b4a-02a82f119c6e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:42:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa68b08a-1841-4d07-8b4a-02a82f119c6e None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:42:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-fa68b08a-1841-4d07-8b4a-02a82f119c6e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 28 12:42:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:42:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:42:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:42:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:42:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:42:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:42:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:42:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:42:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:42:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:42:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:42:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 28 12:42:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 28 12:42:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 28 12:42:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 28 12:42:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:42:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:42:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:42:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:42:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:42:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:42:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:42:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 12:42:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:42:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 12:42:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:42:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:42:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:42:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 12:42:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:42:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 12:42:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 28 12:42:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 28 12:42:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 28 12:42:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 12:42:15 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 385/754] 10.27.203.238 () {60 vars in 1196 bytes} [Tue May 28 12:42:14 2024] GET /identity/v3/domains/Default => generated 87 bytes in 94 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 28 12:42:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7d4fbd-67ec-48b6-8f9c-5ee83a9894a7 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:42:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7d4fbd-67ec-48b6-8f9c-5ee83a9894a7 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:42:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8cec29-0f01-47ab-a5d6-6af31ad0ee40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:42:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8cec29-0f01-47ab-a5d6-6af31ad0ee40 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:42:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8cec29-0f01-47ab-a5d6-6af31ad0ee40 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:42:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8cec29-0f01-47ab-a5d6-6af31ad0ee40 None admin] PATH_INFO: `/v3/domains` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:42:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8cec29-0f01-47ab-a5d6-6af31ad0ee40 None admin] RBAC: Adding query filter params (name=Default) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:42:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8cec29-0f01-47ab-a5d6-6af31ad0ee40 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:42:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8cec29-0f01-47ab-a5d6-6af31ad0ee40 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:42:15 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 370/755] 10.27.203.238 () {60 vars in 1197 bytes} [Tue May 28 12:42:15 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:42:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa68b08a-1841-4d07-8b4a-02a82f119c6e None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:42:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa68b08a-1841-4d07-8b4a-02a82f119c6e None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:42:15 l75lg1-v1 dstat.sh[49771]: 28-05 12:42:15| 9 1 89 0 0|1562M 7976M 267M 5896M| 10k 0 | 0 268k| 0 57.0 |2264 3755 |2.23 2.06 1.27|2.0 0 0| 0 0 | 0 2048M| 19 34 0 1 0 May 28 12:42:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e750ce-c7fe-4402-afa0-2da3bedc1d43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:42:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e750ce-c7fe-4402-afa0-2da3bedc1d43 None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:42:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e750ce-c7fe-4402-afa0-2da3bedc1d43 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:42:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e750ce-c7fe-4402-afa0-2da3bedc1d43 None admin] PATH_INFO: `/v3/users` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:42:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e750ce-c7fe-4402-afa0-2da3bedc1d43 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:42:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e750ce-c7fe-4402-afa0-2da3bedc1d43 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:42:15 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-e5e750ce-c7fe-4402-afa0-2da3bedc1d43 None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 12:42:15 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 386/756] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 12:42:15 2024] POST /identity/v3/users => generated 250 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:42:16 l75lg1-v1 dstat.sh[49771]: 28-05 12:42:16| 9 1 89 0 0|1539M 7998M 267M 5896M| 13k 3306B| 0 560k| 0 38.0 |1710 2122 |2.13 2.04 1.27|1.0 0 35| 0 0 | 0 2048M| 19 33 0 1 0 May 28 12:42:16 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd86df5f-c225-45dd-9b16-8cd12c83a9de None None] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:42:16 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd86df5f-c225-45dd-9b16-8cd12c83a9de None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:42:16 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd86df5f-c225-45dd-9b16-8cd12c83a9de None None] PATH_INFO: `/` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:42:16 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 371/757] 10.27.203.238 () {58 vars in 1014 bytes} [Tue May 28 12:42:16 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:42:16 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c45cbe2-b3cc-42ec-bfc8-9d827941092d None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:42:16 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c45cbe2-b3cc-42ec-bfc8-9d827941092d None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:42:16 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c45cbe2-b3cc-42ec-bfc8-9d827941092d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:42:16 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-2c45cbe2-b3cc-42ec-bfc8-9d827941092d None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:42:16 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-2c45cbe2-b3cc-42ec-bfc8-9d827941092d None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:42:16 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-2c45cbe2-b3cc-42ec-bfc8-9d827941092d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:42:16 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 387/758] 10.27.203.238 () {62 vars in 1111 bytes} [Tue May 28 12:42:16 2024] POST /identity/v3/auth/tokens => generated 2198 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 12:42:16 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd86df5f-c225-45dd-9b16-8cd12c83a9de None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd86df5f-c225-45dd-9b16-8cd12c83a9de None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3289e12-2442-41d3-bf37-88c1039f7ccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3289e12-2442-41d3-bf37-88c1039f7ccc None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3289e12-2442-41d3-bf37-88c1039f7ccc None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3289e12-2442-41d3-bf37-88c1039f7ccc None admin] PATH_INFO: `/v3/roles/service` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3289e12-2442-41d3-bf37-88c1039f7ccc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-d3289e12-2442-41d3-bf37-88c1039f7ccc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._get_role(role_id) May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1281, in get_role May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 372/759] 10.27.203.238 () {60 vars in 1190 bytes} [Tue May 28 12:42:16 2024] GET /identity/v3/roles/service => generated 85 bytes in 88 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c45cbe2-b3cc-42ec-bfc8-9d827941092d None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c45cbe2-b3cc-42ec-bfc8-9d827941092d None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a89409-4886-473e-8143-c5893a8fac34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a89409-4886-473e-8143-c5893a8fac34 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a89409-4886-473e-8143-c5893a8fac34 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a89409-4886-473e-8143-c5893a8fac34 None admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a89409-4886-473e-8143-c5893a8fac34 None admin] RBAC: Adding query filter params (name=service) {{(pid=51267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a89409-4886-473e-8143-c5893a8fac34 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a89409-4886-473e-8143-c5893a8fac34 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 388/760] 10.27.203.238 () {60 vars in 1191 bytes} [Tue May 28 12:42:17 2024] GET /identity/v3/roles?name=service => generated 347 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3289e12-2442-41d3-bf37-88c1039f7ccc None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3289e12-2442-41d3-bf37-88c1039f7ccc None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cc4590-9a77-44dc-8618-5e589ae1f198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cc4590-9a77-44dc-8618-5e589ae1f198 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cc4590-9a77-44dc-8618-5e589ae1f198 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cc4590-9a77-44dc-8618-5e589ae1f198 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cc4590-9a77-44dc-8618-5e589ae1f198 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cc4590-9a77-44dc-8618-5e589ae1f198 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-19cc4590-9a77-44dc-8618-5e589ae1f198 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 373/761] 10.27.203.238 () {60 vars in 1196 bytes} [Tue May 28 12:42:17 2024] GET /identity/v3/domains/Default => generated 87 bytes in 92 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a89409-4886-473e-8143-c5893a8fac34 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:42:17 l75lg1-v1 dstat.sh[49771]: 28-05 12:42:17| 9 1 89 0 0|1561M 7976M 267M 5896M| 14k 86B| 0 0 | 0 0 |2214 3687 |2.13 2.04 1.27|1.0 0 0| 0 0 | 0 2048M| 19 34 0 1 0 May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a89409-4886-473e-8143-c5893a8fac34 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0bccd4-cb3a-4ee1-a4d0-f0fbb87ca7f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0bccd4-cb3a-4ee1-a4d0-f0fbb87ca7f5 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0bccd4-cb3a-4ee1-a4d0-f0fbb87ca7f5 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0bccd4-cb3a-4ee1-a4d0-f0fbb87ca7f5 None admin] PATH_INFO: `/v3/domains` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0bccd4-cb3a-4ee1-a4d0-f0fbb87ca7f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=51267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0bccd4-cb3a-4ee1-a4d0-f0fbb87ca7f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0bccd4-cb3a-4ee1-a4d0-f0fbb87ca7f5 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 389/762] 10.27.203.238 () {60 vars in 1197 bytes} [Tue May 28 12:42:17 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cc4590-9a77-44dc-8618-5e589ae1f198 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cc4590-9a77-44dc-8618-5e589ae1f198 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cd3e56-8e6c-46e6-ab12-1a841b4ee4e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cd3e56-8e6c-46e6-ab12-1a841b4ee4e3 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cd3e56-8e6c-46e6-ab12-1a841b4ee4e3 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cd3e56-8e6c-46e6-ab12-1a841b4ee4e3 None admin] PATH_INFO: `/v3/users/manila` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cd3e56-8e6c-46e6-ab12-1a841b4ee4e3 None admin] RBAC: Authorizing `identity:get_user(user_id=manila)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cd3e56-8e6c-46e6-ab12-1a841b4ee4e3 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-c6cd3e56-8e6c-46e6-ab12-1a841b4ee4e3 None admin] Could not find user: manila.: keystone.exception.UserNotFound: Could not find user: manila. May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._get_user(user_id) May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: manila. May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 374/763] 10.27.203.238 () {60 vars in 1187 bytes} [Tue May 28 12:42:17 2024] GET /identity/v3/users/manila => generated 84 bytes in 88 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0bccd4-cb3a-4ee1-a4d0-f0fbb87ca7f5 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0bccd4-cb3a-4ee1-a4d0-f0fbb87ca7f5 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fd24f3-5715-4430-b535-a3e43517fbcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fd24f3-5715-4430-b535-a3e43517fbcf None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fd24f3-5715-4430-b535-a3e43517fbcf None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fd24f3-5715-4430-b535-a3e43517fbcf None admin] PATH_INFO: `/v3/users` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fd24f3-5715-4430-b535-a3e43517fbcf None admin] RBAC: Adding query filter params (domain_id=default, name=manila) {{(pid=51267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fd24f3-5715-4430-b535-a3e43517fbcf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fd24f3-5715-4430-b535-a3e43517fbcf None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 390/764] 10.27.203.238 () {60 vars in 1225 bytes} [Tue May 28 12:42:17 2024] GET /identity/v3/users?domain_id=default&name=manila => generated 376 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cd3e56-8e6c-46e6-ab12-1a841b4ee4e3 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cd3e56-8e6c-46e6-ab12-1a841b4ee4e3 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a25319-ec74-4a70-b12c-a6bc9ee4a664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a25319-ec74-4a70-b12c-a6bc9ee4a664 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a25319-ec74-4a70-b12c-a6bc9ee4a664 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a25319-ec74-4a70-b12c-a6bc9ee4a664 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a25319-ec74-4a70-b12c-a6bc9ee4a664 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a25319-ec74-4a70-b12c-a6bc9ee4a664 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-71a25319-ec74-4a70-b12c-a6bc9ee4a664 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 375/765] 10.27.203.238 () {60 vars in 1196 bytes} [Tue May 28 12:42:17 2024] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fd24f3-5715-4430-b535-a3e43517fbcf None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fd24f3-5715-4430-b535-a3e43517fbcf None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092aa73a-6a8d-45a2-a267-fc23add85e46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092aa73a-6a8d-45a2-a267-fc23add85e46 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092aa73a-6a8d-45a2-a267-fc23add85e46 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092aa73a-6a8d-45a2-a267-fc23add85e46 None admin] PATH_INFO: `/v3/domains` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092aa73a-6a8d-45a2-a267-fc23add85e46 None admin] RBAC: Adding query filter params (name=Default) {{(pid=51267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092aa73a-6a8d-45a2-a267-fc23add85e46 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092aa73a-6a8d-45a2-a267-fc23add85e46 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 391/766] 10.27.203.238 () {60 vars in 1197 bytes} [Tue May 28 12:42:17 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a25319-ec74-4a70-b12c-a6bc9ee4a664 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a25319-ec74-4a70-b12c-a6bc9ee4a664 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84aa7f81-9a22-40b1-90bf-f9b95dc31827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aa7f81-9a22-40b1-90bf-f9b95dc31827 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aa7f81-9a22-40b1-90bf-f9b95dc31827 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aa7f81-9a22-40b1-90bf-f9b95dc31827 None admin] PATH_INFO: `/v3/projects/service` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84aa7f81-9a22-40b1-90bf-f9b95dc31827 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84aa7f81-9a22-40b1-90bf-f9b95dc31827 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-84aa7f81-9a22-40b1-90bf-f9b95dc31827 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._get_project(project_id) May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 376/767] 10.27.203.238 () {60 vars in 1199 bytes} [Tue May 28 12:42:17 2024] GET /identity/v3/projects/service => generated 88 bytes in 87 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092aa73a-6a8d-45a2-a267-fc23add85e46 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092aa73a-6a8d-45a2-a267-fc23add85e46 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7918f3b4-077b-4089-9397-96e41e89d797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7918f3b4-077b-4089-9397-96e41e89d797 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7918f3b4-077b-4089-9397-96e41e89d797 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7918f3b4-077b-4089-9397-96e41e89d797 None admin] PATH_INFO: `/v3/projects` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7918f3b4-077b-4089-9397-96e41e89d797 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=51267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7918f3b4-077b-4089-9397-96e41e89d797 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7918f3b4-077b-4089-9397-96e41e89d797 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 392/768] 10.27.203.238 () {60 vars in 1236 bytes} [Tue May 28 12:42:17 2024] GET /identity/v3/projects?domain_id=default&name=service => generated 433 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:42:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84aa7f81-9a22-40b1-90bf-f9b95dc31827 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:42:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84aa7f81-9a22-40b1-90bf-f9b95dc31827 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:42:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbd6ca1-c0be-4e71-b809-6dc4640d5f18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:42:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbd6ca1-c0be-4e71-b809-6dc4640d5f18 None admin] REQUEST_METHOD: `PUT` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:42:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbd6ca1-c0be-4e71-b809-6dc4640d5f18 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:42:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbd6ca1-c0be-4e71-b809-6dc4640d5f18 None admin] PATH_INFO: `/v3/projects/98a6a2dcbf0248d5b353760f7757f713/users/f110cf6300f049c897d0aab63218d1e5/roles/14940fb5f1c44f629b6e1d8472832bd1` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:42:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbd6ca1-c0be-4e71-b809-6dc4640d5f18 None admin] RBAC: Authorizing `identity:create_grant(project_id=98a6a2dcbf0248d5b353760f7757f713, user_id=f110cf6300f049c897d0aab63218d1e5, role_id=14940fb5f1c44f629b6e1d8472832bd1)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:42:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbd6ca1-c0be-4e71-b809-6dc4640d5f18 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:42:18 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 377/769] 10.27.203.238 () {62 vars in 1527 bytes} [Tue May 28 12:42:17 2024] PUT /identity/v3/projects/98a6a2dcbf0248d5b353760f7757f713/users/f110cf6300f049c897d0aab63218d1e5/roles/14940fb5f1c44f629b6e1d8472832bd1 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:42:18 l75lg1-v1 dstat.sh[49771]: 28-05 12:42:18| 10 1 89 0 0|1503M 8035M 267M 5896M| 15k 1196B| 0 100k| 0 16.0 |3554 6492 |2.13 2.04 1.27|1.0 0 20| 0 0 | 0 2048M| 19 33 0 3 0 May 28 12:42:19 l75lg1-v1 dstat.sh[49771]: 28-05 12:42:19| 9 1 89 0 0|1550M 7988M 267M 5896M| 14k 0 | 0 480k| 0 48.0 |1472 1843 |2.13 2.04 1.27|1.0 0 0| 0 0 | 0 2048M| 19 33 0 3 0 May 28 12:42:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532baad4-0e1a-4515-ba1a-12da2d8a8fe3 None None] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:42:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532baad4-0e1a-4515-ba1a-12da2d8a8fe3 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:42:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532baad4-0e1a-4515-ba1a-12da2d8a8fe3 None None] PATH_INFO: `/` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:42:19 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 393/770] 10.27.203.238 () {58 vars in 1014 bytes} [Tue May 28 12:42:19 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:42:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9728291c-a6ec-4d1a-9b5d-543aafb66d00 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:42:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9728291c-a6ec-4d1a-9b5d-543aafb66d00 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:42:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9728291c-a6ec-4d1a-9b5d-543aafb66d00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:42:19 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-9728291c-a6ec-4d1a-9b5d-543aafb66d00 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:42:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-9728291c-a6ec-4d1a-9b5d-543aafb66d00 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:42:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-9728291c-a6ec-4d1a-9b5d-543aafb66d00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:42:19 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 378/771] 10.27.203.238 () {62 vars in 1111 bytes} [Tue May 28 12:42:19 2024] POST /identity/v3/auth/tokens => generated 2198 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 12:42:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532baad4-0e1a-4515-ba1a-12da2d8a8fe3 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:42:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532baad4-0e1a-4515-ba1a-12da2d8a8fe3 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:42:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9201e53b-228d-4c64-9a77-6a7513be610d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:42:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9201e53b-228d-4c64-9a77-6a7513be610d None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:42:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9201e53b-228d-4c64-9a77-6a7513be610d None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:42:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9201e53b-228d-4c64-9a77-6a7513be610d None admin] PATH_INFO: `/v3/roles/service` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:42:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9201e53b-228d-4c64-9a77-6a7513be610d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 28 12:42:19 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-9201e53b-228d-4c64-9a77-6a7513be610d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 28 12:42:19 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:42:19 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:42:19 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:42:19 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:42:19 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:42:19 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:42:19 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:42:19 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:42:19 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:42:19 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:42:19 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:42:19 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 28 12:42:19 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._get_role(role_id) May 28 12:42:19 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 28 12:42:19 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 28 12:42:19 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 28 12:42:19 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 28 12:42:19 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 28 12:42:19 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 28 12:42:19 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:42:19 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:42:19 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:42:19 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:42:19 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:42:19 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:42:19 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:42:19 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 12:42:19 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:42:19 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 12:42:19 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:42:19 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:42:19 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:42:19 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 12:42:19 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:42:19 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 12:42:19 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1281, in get_role May 28 12:42:19 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 28 12:42:19 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 28 12:42:19 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 28 12:42:19 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 28 12:42:19 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 28 12:42:19 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 28 12:42:19 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 12:42:19 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 394/772] 10.27.203.238 () {60 vars in 1190 bytes} [Tue May 28 12:42:19 2024] GET /identity/v3/roles/service => generated 85 bytes in 87 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 28 12:42:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9728291c-a6ec-4d1a-9b5d-543aafb66d00 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:42:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9728291c-a6ec-4d1a-9b5d-543aafb66d00 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:42:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3e2bcc-b98c-4e0d-9fd4-1fb1f44c861c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:42:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3e2bcc-b98c-4e0d-9fd4-1fb1f44c861c None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:42:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3e2bcc-b98c-4e0d-9fd4-1fb1f44c861c None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:42:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3e2bcc-b98c-4e0d-9fd4-1fb1f44c861c None admin] PATH_INFO: `/v3/roles` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:42:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3e2bcc-b98c-4e0d-9fd4-1fb1f44c861c None admin] RBAC: Adding query filter params (name=service) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:42:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3e2bcc-b98c-4e0d-9fd4-1fb1f44c861c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:42:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3e2bcc-b98c-4e0d-9fd4-1fb1f44c861c None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:42:19 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 379/773] 10.27.203.238 () {60 vars in 1191 bytes} [Tue May 28 12:42:19 2024] GET /identity/v3/roles?name=service => generated 347 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:42:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9201e53b-228d-4c64-9a77-6a7513be610d None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:42:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9201e53b-228d-4c64-9a77-6a7513be610d None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:42:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb1609f-2921-4da7-a92c-42bd2c90fd54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:42:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb1609f-2921-4da7-a92c-42bd2c90fd54 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:42:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb1609f-2921-4da7-a92c-42bd2c90fd54 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:42:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb1609f-2921-4da7-a92c-42bd2c90fd54 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:42:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb1609f-2921-4da7-a92c-42bd2c90fd54 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:42:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb1609f-2921-4da7-a92c-42bd2c90fd54 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:42:19 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-0fb1609f-2921-4da7-a92c-42bd2c90fd54 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 28 12:42:19 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:42:19 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:42:19 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:42:19 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:42:19 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:42:19 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:42:19 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:42:19 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:42:19 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:42:19 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:42:19 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:42:19 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 28 12:42:19 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 28 12:42:19 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 28 12:42:19 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 28 12:42:19 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:42:19 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:42:19 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:42:19 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:42:19 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:42:19 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:42:19 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:42:19 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 12:42:19 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:42:19 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 12:42:19 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:42:19 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:42:19 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:42:19 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 12:42:19 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:42:19 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 12:42:19 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 28 12:42:19 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 28 12:42:19 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 28 12:42:19 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 12:42:19 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 395/774] 10.27.203.238 () {60 vars in 1196 bytes} [Tue May 28 12:42:19 2024] GET /identity/v3/domains/Default => generated 87 bytes in 91 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 28 12:42:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3e2bcc-b98c-4e0d-9fd4-1fb1f44c861c None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:42:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3e2bcc-b98c-4e0d-9fd4-1fb1f44c861c None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198dbaac-f290-43b3-bc97-04c41f830db1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198dbaac-f290-43b3-bc97-04c41f830db1 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198dbaac-f290-43b3-bc97-04c41f830db1 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198dbaac-f290-43b3-bc97-04c41f830db1 None admin] PATH_INFO: `/v3/domains` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198dbaac-f290-43b3-bc97-04c41f830db1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198dbaac-f290-43b3-bc97-04c41f830db1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198dbaac-f290-43b3-bc97-04c41f830db1 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 380/775] 10.27.203.238 () {60 vars in 1197 bytes} [Tue May 28 12:42:19 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb1609f-2921-4da7-a92c-42bd2c90fd54 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb1609f-2921-4da7-a92c-42bd2c90fd54 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cc7094-e166-4da3-8ef8-b5b628eee53f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cc7094-e166-4da3-8ef8-b5b628eee53f None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cc7094-e166-4da3-8ef8-b5b628eee53f None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cc7094-e166-4da3-8ef8-b5b628eee53f None admin] PATH_INFO: `/v3/users/manila` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cc7094-e166-4da3-8ef8-b5b628eee53f None admin] RBAC: Authorizing `identity:get_user(user_id=manila)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cc7094-e166-4da3-8ef8-b5b628eee53f None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-26cc7094-e166-4da3-8ef8-b5b628eee53f None admin] Could not find user: manila.: keystone.exception.UserNotFound: Could not find user: manila. May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._get_user(user_id) May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: manila. May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 396/776] 10.27.203.238 () {60 vars in 1187 bytes} [Tue May 28 12:42:20 2024] GET /identity/v3/users/manila => generated 84 bytes in 86 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198dbaac-f290-43b3-bc97-04c41f830db1 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198dbaac-f290-43b3-bc97-04c41f830db1 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f89755-b641-4cce-af61-8ee0c4a9dc83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f89755-b641-4cce-af61-8ee0c4a9dc83 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f89755-b641-4cce-af61-8ee0c4a9dc83 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f89755-b641-4cce-af61-8ee0c4a9dc83 None admin] PATH_INFO: `/v3/users` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f89755-b641-4cce-af61-8ee0c4a9dc83 None admin] RBAC: Adding query filter params (domain_id=default, name=manila) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f89755-b641-4cce-af61-8ee0c4a9dc83 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f89755-b641-4cce-af61-8ee0c4a9dc83 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 381/777] 10.27.203.238 () {60 vars in 1225 bytes} [Tue May 28 12:42:20 2024] GET /identity/v3/users?domain_id=default&name=manila => generated 376 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cc7094-e166-4da3-8ef8-b5b628eee53f None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:42:20 l75lg1-v1 dstat.sh[49771]: 28-05 12:42:20| 10 1 89 0 0|1558M 7979M 267M 5896M| 14k 0 | 0 1536k| 0 203 |3425 6026 |2.13 2.04 1.27|1.0 0 0| 0 0 | 0 2048M| 19 34 0 3 0 May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cc7094-e166-4da3-8ef8-b5b628eee53f None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1031f853-faae-4d2d-985d-7ec1169a96b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1031f853-faae-4d2d-985d-7ec1169a96b1 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1031f853-faae-4d2d-985d-7ec1169a96b1 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1031f853-faae-4d2d-985d-7ec1169a96b1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1031f853-faae-4d2d-985d-7ec1169a96b1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1031f853-faae-4d2d-985d-7ec1169a96b1 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 397/778] 10.27.203.238 () {62 vars in 1370 bytes} [Tue May 28 12:42:20 2024] GET /identity/v3/auth/tokens => generated 2198 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f89755-b641-4cce-af61-8ee0c4a9dc83 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f89755-b641-4cce-af61-8ee0c4a9dc83 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31a097f-d9ab-4029-9123-ea218823419b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31a097f-d9ab-4029-9123-ea218823419b None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31a097f-d9ab-4029-9123-ea218823419b None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31a097f-d9ab-4029-9123-ea218823419b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31a097f-d9ab-4029-9123-ea218823419b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31a097f-d9ab-4029-9123-ea218823419b None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-c31a097f-d9ab-4029-9123-ea218823419b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 382/779] 10.27.203.238 () {60 vars in 1196 bytes} [Tue May 28 12:42:20 2024] GET /identity/v3/domains/Default => generated 87 bytes in 102 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1031f853-faae-4d2d-985d-7ec1169a96b1 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1031f853-faae-4d2d-985d-7ec1169a96b1 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d324c84a-f33b-4e3d-ad33-da52faa36ed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d324c84a-f33b-4e3d-ad33-da52faa36ed3 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d324c84a-f33b-4e3d-ad33-da52faa36ed3 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d324c84a-f33b-4e3d-ad33-da52faa36ed3 None admin] PATH_INFO: `/v3/domains` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d324c84a-f33b-4e3d-ad33-da52faa36ed3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=51267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d324c84a-f33b-4e3d-ad33-da52faa36ed3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d324c84a-f33b-4e3d-ad33-da52faa36ed3 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 398/780] 10.27.203.238 () {60 vars in 1197 bytes} [Tue May 28 12:42:20 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31a097f-d9ab-4029-9123-ea218823419b None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31a097f-d9ab-4029-9123-ea218823419b None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23df3b2c-0edc-4a45-978d-b49b5f927989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23df3b2c-0edc-4a45-978d-b49b5f927989 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23df3b2c-0edc-4a45-978d-b49b5f927989 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23df3b2c-0edc-4a45-978d-b49b5f927989 None admin] PATH_INFO: `/v3/projects/service` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23df3b2c-0edc-4a45-978d-b49b5f927989 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23df3b2c-0edc-4a45-978d-b49b5f927989 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-23df3b2c-0edc-4a45-978d-b49b5f927989 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._get_project(project_id) May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 383/781] 10.27.203.238 () {60 vars in 1199 bytes} [Tue May 28 12:42:20 2024] GET /identity/v3/projects/service => generated 88 bytes in 88 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d324c84a-f33b-4e3d-ad33-da52faa36ed3 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d324c84a-f33b-4e3d-ad33-da52faa36ed3 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b02e63a-3ccd-4a35-a3f8-5af8808a77d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b02e63a-3ccd-4a35-a3f8-5af8808a77d9 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b02e63a-3ccd-4a35-a3f8-5af8808a77d9 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b02e63a-3ccd-4a35-a3f8-5af8808a77d9 None admin] PATH_INFO: `/v3/projects` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b02e63a-3ccd-4a35-a3f8-5af8808a77d9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=51267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b02e63a-3ccd-4a35-a3f8-5af8808a77d9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b02e63a-3ccd-4a35-a3f8-5af8808a77d9 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 399/782] 10.27.203.238 () {60 vars in 1236 bytes} [Tue May 28 12:42:20 2024] GET /identity/v3/projects?domain_id=default&name=service => generated 433 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23df3b2c-0edc-4a45-978d-b49b5f927989 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23df3b2c-0edc-4a45-978d-b49b5f927989 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733530d0-fd02-4bc0-ad92-e6cca1cf006f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733530d0-fd02-4bc0-ad92-e6cca1cf006f None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733530d0-fd02-4bc0-ad92-e6cca1cf006f None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733530d0-fd02-4bc0-ad92-e6cca1cf006f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733530d0-fd02-4bc0-ad92-e6cca1cf006f None admin] RBAC: Adding query filter params (role.id=14940fb5f1c44f629b6e1d8472832bd1, scope.project.id=98a6a2dcbf0248d5b353760f7757f713, user.id=f110cf6300f049c897d0aab63218d1e5) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733530d0-fd02-4bc0-ad92-e6cca1cf006f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733530d0-fd02-4bc0-ad92-e6cca1cf006f None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:42:20 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 384/783] 10.27.203.238 () {60 vars in 1462 bytes} [Tue May 28 12:42:20 2024] GET /identity/v3/role_assignments?user.id=f110cf6300f049c897d0aab63218d1e5&scope.project.id=98a6a2dcbf0248d5b353760f7757f713&role.id=14940fb5f1c44f629b6e1d8472832bd1 => generated 612 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:42:21 l75lg1-v1 dstat.sh[49771]: 28-05 12:42:21| 9 1 89 0 0|1512M 8025M 267M 5896M| 17k 1478B| 0 140k| 0 12.0 |3444 5927 |2.04 2.02 1.26|1.0 0 31| 0 0 | 0 2048M| 19 33 0 3 0 May 28 12:42:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2bc8df-f1f1-4b6b-b55a-8e68b3a0b2bb None None] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:42:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2bc8df-f1f1-4b6b-b55a-8e68b3a0b2bb None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:42:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2bc8df-f1f1-4b6b-b55a-8e68b3a0b2bb None None] PATH_INFO: `/` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:42:22 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 400/784] 10.27.203.238 () {58 vars in 1014 bytes} [Tue May 28 12:42:22 2024] GET /identity => generated 272 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:42:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fa586c-432c-4447-a5af-d986770e6c08 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:42:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fa586c-432c-4447-a5af-d986770e6c08 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:42:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fa586c-432c-4447-a5af-d986770e6c08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:42:22 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-77fa586c-432c-4447-a5af-d986770e6c08 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:42:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-77fa586c-432c-4447-a5af-d986770e6c08 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:42:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-77fa586c-432c-4447-a5af-d986770e6c08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:42:22 l75lg1-v1 dstat.sh[49771]: 28-05 12:42:22| 9 1 90 0 0|1554M 7983M 267M 5896M| 19k 172B| 0 80k| 0 8.00 |1335 1441 |2.04 2.02 1.26|1.0 0 0| 0 0 | 0 2048M| 19 34 0 3 0 May 28 12:42:22 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 385/785] 10.27.203.238 () {62 vars in 1111 bytes} [Tue May 28 12:42:22 2024] POST /identity/v3/auth/tokens => generated 2198 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 12:42:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2bc8df-f1f1-4b6b-b55a-8e68b3a0b2bb None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:42:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2bc8df-f1f1-4b6b-b55a-8e68b3a0b2bb None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:42:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba495c26-7969-46f1-ba89-3ad259c18708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:42:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba495c26-7969-46f1-ba89-3ad259c18708 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:42:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba495c26-7969-46f1-ba89-3ad259c18708 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:42:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba495c26-7969-46f1-ba89-3ad259c18708 None admin] PATH_INFO: `/v3/services/share` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:42:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba495c26-7969-46f1-ba89-3ad259c18708 None admin] RBAC: Authorizing `identity:get_service(service_id=share)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:42:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba495c26-7969-46f1-ba89-3ad259c18708 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:42:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-ba495c26-7969-46f1-ba89-3ad259c18708 None admin] Could not find service: share.: keystone.exception.ServiceNotFound: Could not find service: share. May 28 12:42:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:42:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 28 12:42:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 28 12:42:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 194, in get_service May 28 12:42:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 28 12:42:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 189, in _get_service May 28 12:42:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 28 12:42:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: share. May 28 12:42:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 12:42:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 28 12:42:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 12:42:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:42:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:42:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:42:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:42:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:42:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:42:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:42:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:42:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:42:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:42:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:42:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 28 12:42:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._get_service(service_id) May 28 12:42:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 28 12:42:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 28 12:42:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:42:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:42:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:42:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:42:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:42:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:42:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:42:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 12:42:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:42:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 12:42:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:42:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:42:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:42:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 12:42:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:42:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 12:42:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 28 12:42:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 28 12:42:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: share. May 28 12:42:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 12:42:22 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 401/786] 10.27.203.238 () {60 vars in 1193 bytes} [Tue May 28 12:42:22 2024] GET /identity/v3/services/share => generated 86 bytes in 88 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 28 12:42:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fa586c-432c-4447-a5af-d986770e6c08 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:42:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fa586c-432c-4447-a5af-d986770e6c08 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:42:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d23d90-e9c5-450a-89aa-99b4b2894484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:42:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d23d90-e9c5-450a-89aa-99b4b2894484 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:42:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d23d90-e9c5-450a-89aa-99b4b2894484 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:42:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d23d90-e9c5-450a-89aa-99b4b2894484 None admin] PATH_INFO: `/v3/services` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:42:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d23d90-e9c5-450a-89aa-99b4b2894484 None admin] RBAC: Adding query filter params (name=share) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:42:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d23d90-e9c5-450a-89aa-99b4b2894484 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:42:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d23d90-e9c5-450a-89aa-99b4b2894484 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:42:22 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 386/787] 10.27.203.238 () {60 vars in 1196 bytes} [Tue May 28 12:42:22 2024] GET /identity/v3/services?name=share => generated 124 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:42:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba495c26-7969-46f1-ba89-3ad259c18708 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:42:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba495c26-7969-46f1-ba89-3ad259c18708 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:42:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306deccd-e134-41bd-8ca8-49249347b97b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:42:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306deccd-e134-41bd-8ca8-49249347b97b None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:42:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306deccd-e134-41bd-8ca8-49249347b97b None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:42:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306deccd-e134-41bd-8ca8-49249347b97b None admin] PATH_INFO: `/v3/services` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:42:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306deccd-e134-41bd-8ca8-49249347b97b None admin] RBAC: Adding query filter params (type=share) {{(pid=51267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:42:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306deccd-e134-41bd-8ca8-49249347b97b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:42:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306deccd-e134-41bd-8ca8-49249347b97b None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:42:22 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 402/788] 10.27.203.238 () {60 vars in 1196 bytes} [Tue May 28 12:42:22 2024] GET /identity/v3/services?type=share => generated 124 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:42:23 l75lg1-v1 dstat.sh[49771]: 28-05 12:42:23| 12 2 86 0 0|1519M 8018M 267M 5896M| 18k 1156B| 0 0 | 0 0 |3600 6424 |2.04 2.02 1.26|1.0 0 66| 0 0 | 0 2048M| 19 33 0 4 0 May 28 12:42:24 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec4b4ea-4761-4b6f-bf68-5d611edb1245 None None] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:42:24 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec4b4ea-4761-4b6f-bf68-5d611edb1245 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:42:24 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec4b4ea-4761-4b6f-bf68-5d611edb1245 None None] PATH_INFO: `/` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:42:24 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 387/789] 10.27.203.238 () {58 vars in 1014 bytes} [Tue May 28 12:42:24 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:42:24 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771166ad-d576-45fc-ada0-1aed508a6513 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:42:24 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771166ad-d576-45fc-ada0-1aed508a6513 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:42:24 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771166ad-d576-45fc-ada0-1aed508a6513 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:42:24 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-771166ad-d576-45fc-ada0-1aed508a6513 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:42:24 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-771166ad-d576-45fc-ada0-1aed508a6513 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:42:24 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-771166ad-d576-45fc-ada0-1aed508a6513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:42:24 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 403/790] 10.27.203.238 () {62 vars in 1111 bytes} [Tue May 28 12:42:24 2024] POST /identity/v3/auth/tokens => generated 2198 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 12:42:24 l75lg1-v1 dstat.sh[49771]: 28-05 12:42:24| 9 1 89 0 0|1556M 7981M 267M 5896M| 19k 172B| 0 40k| 0 5.00 |1520 1778 |2.04 2.02 1.26|1.0 0 0| 0 0 | 0 2048M| 19 33 0 3 0 May 28 12:42:24 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec4b4ea-4761-4b6f-bf68-5d611edb1245 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:42:24 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec4b4ea-4761-4b6f-bf68-5d611edb1245 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:42:24 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d095897e-7ee5-44a7-8a91-1143892fa115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:42:24 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d095897e-7ee5-44a7-8a91-1143892fa115 None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:42:24 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d095897e-7ee5-44a7-8a91-1143892fa115 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:42:24 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d095897e-7ee5-44a7-8a91-1143892fa115 None admin] PATH_INFO: `/v3/services` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:42:24 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d095897e-7ee5-44a7-8a91-1143892fa115 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:42:24 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d095897e-7ee5-44a7-8a91-1143892fa115 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:42:24 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 388/791] 10.27.203.238 () {64 vars in 1229 bytes} [Tue May 28 12:42:24 2024] POST /identity/v3/services => generated 256 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:42:25 l75lg1-v1 dstat.sh[49771]: 28-05 12:42:25| 9 1 89 0 0|1531M 8006M 267M 5896M| 15k 2714B| 0 2020k| 0 266 |1986 2650 |2.04 2.02 1.26|2.0 0 34| 0 0 | 0 2048M| 19 33 0 3 0 May 28 12:42:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aec0de-324b-47ed-8575-9f65624e039b None None] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:42:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aec0de-324b-47ed-8575-9f65624e039b None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:42:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aec0de-324b-47ed-8575-9f65624e039b None None] PATH_INFO: `/` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:42:25 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 404/792] 10.27.203.238 () {58 vars in 1014 bytes} [Tue May 28 12:42:25 2024] GET /identity => generated 272 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:42:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb434e4-e9f7-4e45-9c5f-d0ce60a77b9d None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:42:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb434e4-e9f7-4e45-9c5f-d0ce60a77b9d None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:42:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb434e4-e9f7-4e45-9c5f-d0ce60a77b9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:42:25 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-2eb434e4-e9f7-4e45-9c5f-d0ce60a77b9d None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:42:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-2eb434e4-e9f7-4e45-9c5f-d0ce60a77b9d None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:42:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-2eb434e4-e9f7-4e45-9c5f-d0ce60a77b9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:42:25 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 389/793] 10.27.203.238 () {62 vars in 1111 bytes} [Tue May 28 12:42:25 2024] POST /identity/v3/auth/tokens => generated 2294 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 12:42:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4aec0de-324b-47ed-8575-9f65624e039b None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:42:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4aec0de-324b-47ed-8575-9f65624e039b None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:42:26 l75lg1-v1 dstat.sh[49771]: 28-05 12:42:26| 9 1 89 0 0|1559M 7978M 267M 5896M| 11k 0 | 0 60k| 0 5.00 |1622 2228 |2.04 2.02 1.27|3.0 0 0| 0 0 | 0 2048M| 19 34 0 3 0 May 28 12:42:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1135ac6-b22f-416f-87fc-f3a4b4880eee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:42:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1135ac6-b22f-416f-87fc-f3a4b4880eee None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:42:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1135ac6-b22f-416f-87fc-f3a4b4880eee None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:42:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1135ac6-b22f-416f-87fc-f3a4b4880eee None admin] PATH_INFO: `/v3/services/share` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:42:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1135ac6-b22f-416f-87fc-f3a4b4880eee None admin] RBAC: Authorizing `identity:get_service(service_id=share)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:42:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1135ac6-b22f-416f-87fc-f3a4b4880eee None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:42:26 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-e1135ac6-b22f-416f-87fc-f3a4b4880eee None admin] Could not find service: share.: keystone.exception.ServiceNotFound: Could not find service: share. May 28 12:42:26 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:42:26 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 28 12:42:26 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 28 12:42:26 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 194, in get_service May 28 12:42:26 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 28 12:42:26 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 189, in _get_service May 28 12:42:26 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 28 12:42:26 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: share. May 28 12:42:26 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 12:42:26 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 28 12:42:26 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 12:42:26 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:42:26 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:42:26 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:42:26 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:42:26 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:42:26 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:42:26 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:42:26 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:42:26 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:42:26 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:42:26 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:42:26 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 28 12:42:26 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._get_service(service_id) May 28 12:42:26 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 28 12:42:26 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 28 12:42:26 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:42:26 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:42:26 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:42:26 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:42:26 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:42:26 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:42:26 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:42:26 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 12:42:26 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:42:26 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 12:42:26 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:42:26 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:42:26 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:42:26 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 12:42:26 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:42:26 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 12:42:26 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 28 12:42:26 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 28 12:42:26 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: share. May 28 12:42:26 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 12:42:26 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 405/794] 10.27.203.238 () {60 vars in 1193 bytes} [Tue May 28 12:42:26 2024] GET /identity/v3/services/share => generated 86 bytes in 113 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 28 12:42:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb434e4-e9f7-4e45-9c5f-d0ce60a77b9d None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:42:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb434e4-e9f7-4e45-9c5f-d0ce60a77b9d None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:42:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6500ea-9e6d-4c9c-b1eb-40f4f234a437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:42:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6500ea-9e6d-4c9c-b1eb-40f4f234a437 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:42:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6500ea-9e6d-4c9c-b1eb-40f4f234a437 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:42:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6500ea-9e6d-4c9c-b1eb-40f4f234a437 None admin] PATH_INFO: `/v3/services` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:42:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6500ea-9e6d-4c9c-b1eb-40f4f234a437 None admin] RBAC: Adding query filter params (name=share) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:42:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6500ea-9e6d-4c9c-b1eb-40f4f234a437 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:42:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6500ea-9e6d-4c9c-b1eb-40f4f234a437 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:42:26 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 390/795] 10.27.203.238 () {60 vars in 1196 bytes} [Tue May 28 12:42:26 2024] GET /identity/v3/services?name=share => generated 124 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:42:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1135ac6-b22f-416f-87fc-f3a4b4880eee None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:42:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1135ac6-b22f-416f-87fc-f3a4b4880eee None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:42:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e583509b-b65b-4356-989f-e541e691d5c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:42:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e583509b-b65b-4356-989f-e541e691d5c7 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:42:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e583509b-b65b-4356-989f-e541e691d5c7 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:42:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e583509b-b65b-4356-989f-e541e691d5c7 None admin] PATH_INFO: `/v3/services` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:42:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e583509b-b65b-4356-989f-e541e691d5c7 None admin] RBAC: Adding query filter params (type=share) {{(pid=51267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:42:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e583509b-b65b-4356-989f-e541e691d5c7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:42:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e583509b-b65b-4356-989f-e541e691d5c7 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:42:26 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 406/796] 10.27.203.238 () {60 vars in 1196 bytes} [Tue May 28 12:42:26 2024] GET /identity/v3/services?type=share => generated 366 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:42:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6500ea-9e6d-4c9c-b1eb-40f4f234a437 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:42:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6500ea-9e6d-4c9c-b1eb-40f4f234a437 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:42:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0523cee-7485-4321-955e-6708a093e91a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:42:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0523cee-7485-4321-955e-6708a093e91a None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:42:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0523cee-7485-4321-955e-6708a093e91a None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:42:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0523cee-7485-4321-955e-6708a093e91a None admin] PATH_INFO: `/v3/endpoints` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:42:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0523cee-7485-4321-955e-6708a093e91a None admin] RBAC: Adding query filter params (interface=public, service_id=d08cdd5b32ac441aa6e603ff94659d17, region_id=RegionOne) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:42:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0523cee-7485-4321-955e-6708a093e91a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:42:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0523cee-7485-4321-955e-6708a093e91a None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:42:26 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 391/797] 10.27.203.238 () {60 vars in 1339 bytes} [Tue May 28 12:42:26 2024] GET /identity/v3/endpoints?service_id=d08cdd5b32ac441aa6e603ff94659d17&interface=public®ion_id=RegionOne => generated 196 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:42:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e583509b-b65b-4356-989f-e541e691d5c7 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:42:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e583509b-b65b-4356-989f-e541e691d5c7 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:42:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71c7b4f-5f27-4cf2-9996-a60a89728972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:42:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71c7b4f-5f27-4cf2-9996-a60a89728972 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:42:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71c7b4f-5f27-4cf2-9996-a60a89728972 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:42:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71c7b4f-5f27-4cf2-9996-a60a89728972 None admin] PATH_INFO: `/v3/services` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:42:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71c7b4f-5f27-4cf2-9996-a60a89728972 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:42:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71c7b4f-5f27-4cf2-9996-a60a89728972 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:42:26 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 407/798] 10.27.203.238 () {60 vars in 1175 bytes} [Tue May 28 12:42:26 2024] GET /identity/v3/services => generated 2224 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:42:27 l75lg1-v1 dstat.sh[49771]: 28-05 12:42:27| 9 1 89 0 0|1527M 8010M 267M 5897M| 18k 1742B| 0 4096B| 0 1.00 |2716 4209 |2.04 2.02 1.27|1.0 0 25| 0 0 | 0 2048M| 19 33 0 3 0 May 28 12:42:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277eda44-fe10-45c5-af6a-b341f0f6327e None None] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:42:28 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277eda44-fe10-45c5-af6a-b341f0f6327e None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:42:28 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277eda44-fe10-45c5-af6a-b341f0f6327e None None] PATH_INFO: `/` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:42:28 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 392/799] 10.27.203.238 () {58 vars in 1014 bytes} [Tue May 28 12:42:27 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:42:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae883de-f33e-4e77-9249-d1c1b463ed93 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:42:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae883de-f33e-4e77-9249-d1c1b463ed93 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:42:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae883de-f33e-4e77-9249-d1c1b463ed93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:42:28 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-2ae883de-f33e-4e77-9249-d1c1b463ed93 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:42:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-2ae883de-f33e-4e77-9249-d1c1b463ed93 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:42:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-2ae883de-f33e-4e77-9249-d1c1b463ed93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:42:28 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 408/800] 10.27.203.238 () {62 vars in 1111 bytes} [Tue May 28 12:42:28 2024] POST /identity/v3/auth/tokens => generated 2294 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 12:42:28 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277eda44-fe10-45c5-af6a-b341f0f6327e None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:42:28 l75lg1-v1 dstat.sh[49771]: 28-05 12:42:28| 9 1 89 0 0|1555M 7982M 267M 5897M| 10k 0 | 0 0 | 0 0 |1450 1853 |2.04 2.02 1.27|3.0 0 8.0| 0 0 | 0 2048M| 19 34 0 3 0 May 28 12:42:28 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277eda44-fe10-45c5-af6a-b341f0f6327e None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:42:28 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0890c10-9633-44b7-82e4-e171fcaccc67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:42:28 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0890c10-9633-44b7-82e4-e171fcaccc67 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:42:28 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0890c10-9633-44b7-82e4-e171fcaccc67 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:42:28 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0890c10-9633-44b7-82e4-e171fcaccc67 None admin] PATH_INFO: `/v3/services/share` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:42:28 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0890c10-9633-44b7-82e4-e171fcaccc67 None admin] RBAC: Authorizing `identity:get_service(service_id=share)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:42:28 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0890c10-9633-44b7-82e4-e171fcaccc67 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:42:28 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-a0890c10-9633-44b7-82e4-e171fcaccc67 None admin] Could not find service: share.: keystone.exception.ServiceNotFound: Could not find service: share. May 28 12:42:28 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:42:28 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 28 12:42:28 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 28 12:42:28 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 194, in get_service May 28 12:42:28 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 28 12:42:28 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 189, in _get_service May 28 12:42:28 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 28 12:42:28 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: share. May 28 12:42:28 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 12:42:28 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 28 12:42:28 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 12:42:28 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:42:28 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:42:28 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:42:28 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:42:28 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:42:28 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:42:28 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:42:28 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:42:28 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:42:28 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:42:28 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:42:28 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 28 12:42:28 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._get_service(service_id) May 28 12:42:28 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 28 12:42:28 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 28 12:42:28 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:42:28 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:42:28 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:42:28 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:42:28 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:42:28 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:42:28 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:42:28 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 12:42:28 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:42:28 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 12:42:28 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:42:28 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:42:28 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:42:28 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 12:42:28 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:42:28 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 12:42:28 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 28 12:42:28 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 28 12:42:28 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: share. May 28 12:42:28 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 12:42:28 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 393/801] 10.27.203.238 () {60 vars in 1193 bytes} [Tue May 28 12:42:28 2024] GET /identity/v3/services/share => generated 86 bytes in 87 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 28 12:42:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae883de-f33e-4e77-9249-d1c1b463ed93 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:42:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae883de-f33e-4e77-9249-d1c1b463ed93 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:42:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7777ec6-58ac-45e0-b7b8-31c01e69787b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:42:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7777ec6-58ac-45e0-b7b8-31c01e69787b None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:42:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7777ec6-58ac-45e0-b7b8-31c01e69787b None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:42:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7777ec6-58ac-45e0-b7b8-31c01e69787b None admin] PATH_INFO: `/v3/services` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:42:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7777ec6-58ac-45e0-b7b8-31c01e69787b None admin] RBAC: Adding query filter params (name=share) {{(pid=51267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:42:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7777ec6-58ac-45e0-b7b8-31c01e69787b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:42:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7777ec6-58ac-45e0-b7b8-31c01e69787b None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:42:28 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 409/802] 10.27.203.238 () {60 vars in 1196 bytes} [Tue May 28 12:42:28 2024] GET /identity/v3/services?name=share => generated 124 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:42:28 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0890c10-9633-44b7-82e4-e171fcaccc67 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:42:28 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0890c10-9633-44b7-82e4-e171fcaccc67 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:42:28 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dec2663-73a5-433b-9122-e1dd40655c75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:42:28 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dec2663-73a5-433b-9122-e1dd40655c75 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:42:28 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dec2663-73a5-433b-9122-e1dd40655c75 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:42:28 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dec2663-73a5-433b-9122-e1dd40655c75 None admin] PATH_INFO: `/v3/services` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:42:28 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dec2663-73a5-433b-9122-e1dd40655c75 None admin] RBAC: Adding query filter params (type=share) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:42:28 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dec2663-73a5-433b-9122-e1dd40655c75 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:42:28 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dec2663-73a5-433b-9122-e1dd40655c75 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:42:28 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 394/803] 10.27.203.238 () {60 vars in 1196 bytes} [Tue May 28 12:42:28 2024] GET /identity/v3/services?type=share => generated 366 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:42:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7777ec6-58ac-45e0-b7b8-31c01e69787b None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:42:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7777ec6-58ac-45e0-b7b8-31c01e69787b None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:42:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3198f0a-0360-410b-a4cc-e54e3c5a8f42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:42:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3198f0a-0360-410b-a4cc-e54e3c5a8f42 None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:42:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3198f0a-0360-410b-a4cc-e54e3c5a8f42 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:42:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3198f0a-0360-410b-a4cc-e54e3c5a8f42 None admin] PATH_INFO: `/v3/endpoints` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:42:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3198f0a-0360-410b-a4cc-e54e3c5a8f42 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:42:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3198f0a-0360-410b-a4cc-e54e3c5a8f42 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:42:28 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 410/804] 10.27.203.238 () {64 vars in 1232 bytes} [Tue May 28 12:42:28 2024] POST /identity/v3/endpoints => generated 349 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:42:29 l75lg1-v1 dstat.sh[49771]: 28-05 12:42:29| 9 2 89 1 0|1525M 8012M 267M 5897M| 13k 2089B| 0 560k| 0 54.0 |2910 4626 |2.04 2.02 1.27|3.0 0 37| 0 0 | 0 2048M| 19 33 0 3 0 May 28 12:42:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ca0e6a-dc78-4239-9f4e-d27dcaecee36 None None] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:42:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ca0e6a-dc78-4239-9f4e-d27dcaecee36 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:42:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ca0e6a-dc78-4239-9f4e-d27dcaecee36 None None] PATH_INFO: `/` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:42:29 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 395/805] 10.27.203.238 () {58 vars in 1014 bytes} [Tue May 28 12:42:29 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:42:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef25572-5a7a-4bd0-8436-c56c283008c6 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:42:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef25572-5a7a-4bd0-8436-c56c283008c6 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:42:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef25572-5a7a-4bd0-8436-c56c283008c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:42:30 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-fef25572-5a7a-4bd0-8436-c56c283008c6 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:42:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-fef25572-5a7a-4bd0-8436-c56c283008c6 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:42:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-fef25572-5a7a-4bd0-8436-c56c283008c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:42:30 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 411/806] 10.27.203.238 () {62 vars in 1111 bytes} [Tue May 28 12:42:29 2024] POST /identity/v3/auth/tokens => generated 2294 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 12:42:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ca0e6a-dc78-4239-9f4e-d27dcaecee36 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:42:30 l75lg1-v1 dstat.sh[49771]: 28-05 12:42:30| 9 1 90 0 0|1556M 7981M 267M 5897M| 12k 0 | 0 32k| 0 5.00 |1428 1813 |2.04 2.02 1.27|3.0 0 0| 0 0 | 0 2048M| 19 34 0 3 0 May 28 12:42:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ca0e6a-dc78-4239-9f4e-d27dcaecee36 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:42:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b7ddc7-0f5d-4a61-8751-eda9929bfbca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:42:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b7ddc7-0f5d-4a61-8751-eda9929bfbca None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:42:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b7ddc7-0f5d-4a61-8751-eda9929bfbca None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:42:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b7ddc7-0f5d-4a61-8751-eda9929bfbca None admin] PATH_INFO: `/v3/services/sharev2` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:42:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b7ddc7-0f5d-4a61-8751-eda9929bfbca None admin] RBAC: Authorizing `identity:get_service(service_id=sharev2)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:42:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b7ddc7-0f5d-4a61-8751-eda9929bfbca None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:42:30 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-62b7ddc7-0f5d-4a61-8751-eda9929bfbca None admin] Could not find service: sharev2.: keystone.exception.ServiceNotFound: Could not find service: sharev2. May 28 12:42:30 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:42:30 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 28 12:42:30 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 28 12:42:30 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 194, in get_service May 28 12:42:30 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 28 12:42:30 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 189, in _get_service May 28 12:42:30 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 28 12:42:30 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: sharev2. May 28 12:42:30 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 12:42:30 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 28 12:42:30 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 12:42:30 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:42:30 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:42:30 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:42:30 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:42:30 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:42:30 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:42:30 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:42:30 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:42:30 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:42:30 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:42:30 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:42:30 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 28 12:42:30 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._get_service(service_id) May 28 12:42:30 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 28 12:42:30 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 28 12:42:30 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:42:30 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:42:30 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:42:30 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:42:30 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:42:30 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:42:30 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:42:30 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 12:42:30 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:42:30 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 12:42:30 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:42:30 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:42:30 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:42:30 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 12:42:30 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:42:30 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 12:42:30 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 28 12:42:30 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 28 12:42:30 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: sharev2. May 28 12:42:30 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 12:42:30 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 396/807] 10.27.203.238 () {60 vars in 1199 bytes} [Tue May 28 12:42:30 2024] GET /identity/v3/services/sharev2 => generated 88 bytes in 101 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 28 12:42:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef25572-5a7a-4bd0-8436-c56c283008c6 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:42:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef25572-5a7a-4bd0-8436-c56c283008c6 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:42:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72db6822-942e-4bc3-858d-2b177f0c63a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:42:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72db6822-942e-4bc3-858d-2b177f0c63a1 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:42:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72db6822-942e-4bc3-858d-2b177f0c63a1 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:42:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72db6822-942e-4bc3-858d-2b177f0c63a1 None admin] PATH_INFO: `/v3/services` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:42:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72db6822-942e-4bc3-858d-2b177f0c63a1 None admin] RBAC: Adding query filter params (name=sharev2) {{(pid=51267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:42:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72db6822-942e-4bc3-858d-2b177f0c63a1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:42:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72db6822-942e-4bc3-858d-2b177f0c63a1 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:42:30 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 412/808] 10.27.203.238 () {60 vars in 1200 bytes} [Tue May 28 12:42:30 2024] GET /identity/v3/services?name=sharev2 => generated 126 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:42:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b7ddc7-0f5d-4a61-8751-eda9929bfbca None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:42:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b7ddc7-0f5d-4a61-8751-eda9929bfbca None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:42:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acae270-f91e-4d04-8810-237c5b942b50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:42:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acae270-f91e-4d04-8810-237c5b942b50 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:42:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acae270-f91e-4d04-8810-237c5b942b50 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:42:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acae270-f91e-4d04-8810-237c5b942b50 None admin] PATH_INFO: `/v3/services` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:42:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acae270-f91e-4d04-8810-237c5b942b50 None admin] RBAC: Adding query filter params (type=sharev2) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:42:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acae270-f91e-4d04-8810-237c5b942b50 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:42:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acae270-f91e-4d04-8810-237c5b942b50 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:42:30 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 397/809] 10.27.203.238 () {60 vars in 1200 bytes} [Tue May 28 12:42:30 2024] GET /identity/v3/services?type=sharev2 => generated 126 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:42:31 l75lg1-v1 dstat.sh[49771]: 28-05 12:42:31| 9 1 90 0 0|1529M 8007M 267M 5897M| 14k 1164B| 0 84k| 0 3.00 |1994 3001 |1.95 2.01 1.27|1.0 0 20| 0 0 | 0 2048M| 19 33 0 3 0 May 28 12:42:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33605c63-6a84-438e-bf96-91724fdaebce None None] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:42:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33605c63-6a84-438e-bf96-91724fdaebce None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:42:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33605c63-6a84-438e-bf96-91724fdaebce None None] PATH_INFO: `/` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:42:31 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 413/810] 10.27.203.238 () {58 vars in 1014 bytes} [Tue May 28 12:42:31 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:42:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211763ff-b4b1-4b91-b66d-2b00a27c03c3 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:42:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211763ff-b4b1-4b91-b66d-2b00a27c03c3 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:42:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211763ff-b4b1-4b91-b66d-2b00a27c03c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:42:31 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-211763ff-b4b1-4b91-b66d-2b00a27c03c3 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:42:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-211763ff-b4b1-4b91-b66d-2b00a27c03c3 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:42:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-211763ff-b4b1-4b91-b66d-2b00a27c03c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:42:31 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 398/811] 10.27.203.238 () {62 vars in 1111 bytes} [Tue May 28 12:42:31 2024] POST /identity/v3/auth/tokens => generated 2294 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 12:42:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33605c63-6a84-438e-bf96-91724fdaebce None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:42:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33605c63-6a84-438e-bf96-91724fdaebce None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:42:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19ca9bb-dddd-45d2-9ce0-6ca1f0fdba24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:42:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19ca9bb-dddd-45d2-9ce0-6ca1f0fdba24 None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:42:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19ca9bb-dddd-45d2-9ce0-6ca1f0fdba24 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:42:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19ca9bb-dddd-45d2-9ce0-6ca1f0fdba24 None admin] PATH_INFO: `/v3/services` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:42:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19ca9bb-dddd-45d2-9ce0-6ca1f0fdba24 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:42:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19ca9bb-dddd-45d2-9ce0-6ca1f0fdba24 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:42:32 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 414/812] 10.27.203.238 () {64 vars in 1229 bytes} [Tue May 28 12:42:32 2024] POST /identity/v3/services => generated 263 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:42:32 l75lg1-v1 dstat.sh[49771]: 28-05 12:42:32| 9 1 89 0 0|1556M 7980M 267M 5897M| 11k 172B| 0 100k| 0 12.0 |1781 2605 |1.95 2.01 1.27|1.0 0 0| 0 0 | 0 2048M| 19 33 0 3 0 May 28 12:42:33 l75lg1-v1 dstat.sh[49771]: 28-05 12:42:33| 9 1 89 0 0|1534M 8002M 267M 5897M| 13k 2571B| 0 196k| 0 17.0 |1558 1798 |1.95 2.01 1.27|1.0 0 34| 0 0 | 0 2048M| 19 33 0 3 0 May 28 12:42:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f29dfa-05fb-4a20-a3a2-cddc5c6477b6 None None] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:42:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f29dfa-05fb-4a20-a3a2-cddc5c6477b6 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:42:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f29dfa-05fb-4a20-a3a2-cddc5c6477b6 None None] PATH_INFO: `/` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:42:33 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 399/813] 10.27.203.238 () {58 vars in 1014 bytes} [Tue May 28 12:42:33 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:42:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2ed0f7-296b-49a7-8f87-934c56e2d682 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:42:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2ed0f7-296b-49a7-8f87-934c56e2d682 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:42:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2ed0f7-296b-49a7-8f87-934c56e2d682 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:42:33 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-0c2ed0f7-296b-49a7-8f87-934c56e2d682 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:42:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-0c2ed0f7-296b-49a7-8f87-934c56e2d682 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:42:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-0c2ed0f7-296b-49a7-8f87-934c56e2d682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:42:33 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 415/814] 10.27.203.238 () {62 vars in 1111 bytes} [Tue May 28 12:42:33 2024] POST /identity/v3/auth/tokens => generated 2394 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 12:42:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f29dfa-05fb-4a20-a3a2-cddc5c6477b6 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:42:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f29dfa-05fb-4a20-a3a2-cddc5c6477b6 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:42:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88461efb-7412-4576-b1cd-5a9ee68a792c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:42:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88461efb-7412-4576-b1cd-5a9ee68a792c None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:42:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88461efb-7412-4576-b1cd-5a9ee68a792c None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:42:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88461efb-7412-4576-b1cd-5a9ee68a792c None admin] PATH_INFO: `/v3/services/sharev2` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:42:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88461efb-7412-4576-b1cd-5a9ee68a792c None admin] RBAC: Authorizing `identity:get_service(service_id=sharev2)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:42:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88461efb-7412-4576-b1cd-5a9ee68a792c None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:42:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-88461efb-7412-4576-b1cd-5a9ee68a792c None admin] Could not find service: sharev2.: keystone.exception.ServiceNotFound: Could not find service: sharev2. May 28 12:42:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:42:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 28 12:42:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 28 12:42:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 194, in get_service May 28 12:42:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 28 12:42:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 189, in _get_service May 28 12:42:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 28 12:42:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: sharev2. May 28 12:42:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 12:42:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 28 12:42:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 12:42:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:42:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:42:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:42:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:42:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:42:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:42:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:42:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:42:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:42:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:42:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:42:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 28 12:42:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._get_service(service_id) May 28 12:42:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 28 12:42:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 28 12:42:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:42:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:42:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:42:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:42:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:42:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:42:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:42:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 12:42:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:42:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 12:42:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:42:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:42:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:42:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 12:42:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:42:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 12:42:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 28 12:42:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 28 12:42:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: sharev2. May 28 12:42:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 12:42:34 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 400/815] 10.27.203.238 () {60 vars in 1199 bytes} [Tue May 28 12:42:33 2024] GET /identity/v3/services/sharev2 => generated 88 bytes in 89 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 28 12:42:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2ed0f7-296b-49a7-8f87-934c56e2d682 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:42:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2ed0f7-296b-49a7-8f87-934c56e2d682 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:42:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c9205e-48b2-4678-8c1e-78088b60ca37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:42:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c9205e-48b2-4678-8c1e-78088b60ca37 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:42:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c9205e-48b2-4678-8c1e-78088b60ca37 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:42:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c9205e-48b2-4678-8c1e-78088b60ca37 None admin] PATH_INFO: `/v3/services` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:42:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c9205e-48b2-4678-8c1e-78088b60ca37 None admin] RBAC: Adding query filter params (name=sharev2) {{(pid=51267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:42:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c9205e-48b2-4678-8c1e-78088b60ca37 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:42:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c9205e-48b2-4678-8c1e-78088b60ca37 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:42:34 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 416/816] 10.27.203.238 () {60 vars in 1200 bytes} [Tue May 28 12:42:34 2024] GET /identity/v3/services?name=sharev2 => generated 126 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:42:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88461efb-7412-4576-b1cd-5a9ee68a792c None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:42:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88461efb-7412-4576-b1cd-5a9ee68a792c None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:42:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04b7392-d923-442b-9efd-19458d79801c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:42:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04b7392-d923-442b-9efd-19458d79801c None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:42:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04b7392-d923-442b-9efd-19458d79801c None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:42:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04b7392-d923-442b-9efd-19458d79801c None admin] PATH_INFO: `/v3/services` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:42:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04b7392-d923-442b-9efd-19458d79801c None admin] RBAC: Adding query filter params (type=sharev2) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:42:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04b7392-d923-442b-9efd-19458d79801c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:42:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04b7392-d923-442b-9efd-19458d79801c None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:42:34 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 401/817] 10.27.203.238 () {60 vars in 1200 bytes} [Tue May 28 12:42:34 2024] GET /identity/v3/services?type=sharev2 => generated 375 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:42:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c9205e-48b2-4678-8c1e-78088b60ca37 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:42:34 l75lg1-v1 dstat.sh[49771]: 28-05 12:42:34| 9 1 89 0 0|1555M 7982M 267M 5897M| 17k 0 | 0 228k| 0 40.0 |2288 3732 |1.95 2.01 1.27|2.0 0 0| 0 0 | 0 2048M| 19 34 0 3 0 May 28 12:42:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c9205e-48b2-4678-8c1e-78088b60ca37 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:42:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370e1a4a-9e1f-418d-9980-69afef216d8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:42:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370e1a4a-9e1f-418d-9980-69afef216d8c None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:42:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370e1a4a-9e1f-418d-9980-69afef216d8c None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:42:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370e1a4a-9e1f-418d-9980-69afef216d8c None admin] PATH_INFO: `/v3/endpoints` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:42:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370e1a4a-9e1f-418d-9980-69afef216d8c None admin] RBAC: Adding query filter params (interface=public, service_id=e868863e658b4d928098b313490288c3, region_id=RegionOne) {{(pid=51267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:42:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370e1a4a-9e1f-418d-9980-69afef216d8c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:42:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370e1a4a-9e1f-418d-9980-69afef216d8c None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:42:34 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 417/818] 10.27.203.238 () {60 vars in 1339 bytes} [Tue May 28 12:42:34 2024] GET /identity/v3/endpoints?service_id=e868863e658b4d928098b313490288c3&interface=public®ion_id=RegionOne => generated 196 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:42:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04b7392-d923-442b-9efd-19458d79801c None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:42:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04b7392-d923-442b-9efd-19458d79801c None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:42:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd4d563-7200-4e9d-8fb8-73862f2aa453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:42:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd4d563-7200-4e9d-8fb8-73862f2aa453 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:42:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd4d563-7200-4e9d-8fb8-73862f2aa453 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:42:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd4d563-7200-4e9d-8fb8-73862f2aa453 None admin] PATH_INFO: `/v3/services` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:42:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd4d563-7200-4e9d-8fb8-73862f2aa453 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:42:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd4d563-7200-4e9d-8fb8-73862f2aa453 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:42:34 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 402/819] 10.27.203.238 () {60 vars in 1175 bytes} [Tue May 28 12:42:34 2024] GET /identity/v3/services => generated 2475 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:42:35 l75lg1-v1 dstat.sh[49771]: 28-05 12:42:35| 9 1 90 0 0|1528M 8008M 267M 5897M| 12k 1726B| 0 0 | 0 0 |1842 2464 |1.95 2.01 1.27|1.0 0 25| 0 0 | 0 2048M| 19 33 0 3 0 May 28 12:42:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ff3092-a18b-410c-bc79-f537e56405bc None None] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:42:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ff3092-a18b-410c-bc79-f537e56405bc None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:42:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ff3092-a18b-410c-bc79-f537e56405bc None None] PATH_INFO: `/` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:42:36 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 418/820] 10.27.203.238 () {58 vars in 1014 bytes} [Tue May 28 12:42:36 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:42:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96fc8da-b963-4102-acdb-12d8075ac3fb None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:42:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96fc8da-b963-4102-acdb-12d8075ac3fb None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:42:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96fc8da-b963-4102-acdb-12d8075ac3fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:42:36 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-b96fc8da-b963-4102-acdb-12d8075ac3fb None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:42:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-b96fc8da-b963-4102-acdb-12d8075ac3fb None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:42:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-b96fc8da-b963-4102-acdb-12d8075ac3fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:42:36 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 403/821] 10.27.203.238 () {62 vars in 1111 bytes} [Tue May 28 12:42:36 2024] POST /identity/v3/auth/tokens => generated 2394 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 12:42:36 l75lg1-v1 dstat.sh[49771]: 28-05 12:42:36| 10 1 90 0 0|1555M 7981M 267M 5897M| 10k 0 | 0 1696k| 0 224 |1456 1911 |1.88 1.99 1.27|1.0 0 0| 0 0 | 0 2048M| 19 33 0 3 0 May 28 12:42:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ff3092-a18b-410c-bc79-f537e56405bc None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:42:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ff3092-a18b-410c-bc79-f537e56405bc None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:42:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f32928-c0c9-4eeb-bd98-b275ed67846f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:42:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f32928-c0c9-4eeb-bd98-b275ed67846f None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:42:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f32928-c0c9-4eeb-bd98-b275ed67846f None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:42:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f32928-c0c9-4eeb-bd98-b275ed67846f None admin] PATH_INFO: `/v3/services/sharev2` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:42:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f32928-c0c9-4eeb-bd98-b275ed67846f None admin] RBAC: Authorizing `identity:get_service(service_id=sharev2)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:42:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f32928-c0c9-4eeb-bd98-b275ed67846f None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:42:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-12f32928-c0c9-4eeb-bd98-b275ed67846f None admin] Could not find service: sharev2.: keystone.exception.ServiceNotFound: Could not find service: sharev2. May 28 12:42:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:42:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 28 12:42:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 28 12:42:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 194, in get_service May 28 12:42:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 28 12:42:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 189, in _get_service May 28 12:42:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 28 12:42:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: sharev2. May 28 12:42:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 12:42:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 28 12:42:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 12:42:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:42:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:42:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:42:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:42:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:42:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:42:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:42:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:42:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:42:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:42:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:42:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 28 12:42:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._get_service(service_id) May 28 12:42:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 28 12:42:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 28 12:42:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:42:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:42:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:42:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:42:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:42:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:42:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:42:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 12:42:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:42:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 12:42:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:42:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:42:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:42:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 12:42:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:42:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 12:42:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 28 12:42:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 28 12:42:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: sharev2. May 28 12:42:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 12:42:36 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 419/822] 10.27.203.238 () {60 vars in 1199 bytes} [Tue May 28 12:42:36 2024] GET /identity/v3/services/sharev2 => generated 88 bytes in 94 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 28 12:42:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96fc8da-b963-4102-acdb-12d8075ac3fb None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:42:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96fc8da-b963-4102-acdb-12d8075ac3fb None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:42:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2907d32-491b-4077-a690-68d9d37e58ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:42:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2907d32-491b-4077-a690-68d9d37e58ac None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:42:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2907d32-491b-4077-a690-68d9d37e58ac None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:42:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2907d32-491b-4077-a690-68d9d37e58ac None admin] PATH_INFO: `/v3/services` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:42:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2907d32-491b-4077-a690-68d9d37e58ac None admin] RBAC: Adding query filter params (name=sharev2) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:42:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2907d32-491b-4077-a690-68d9d37e58ac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:42:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2907d32-491b-4077-a690-68d9d37e58ac None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:42:36 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 404/823] 10.27.203.238 () {60 vars in 1200 bytes} [Tue May 28 12:42:36 2024] GET /identity/v3/services?name=sharev2 => generated 126 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:42:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f32928-c0c9-4eeb-bd98-b275ed67846f None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:42:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f32928-c0c9-4eeb-bd98-b275ed67846f None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:42:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b374c44-4c04-4f8a-9972-d125386a6c45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:42:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b374c44-4c04-4f8a-9972-d125386a6c45 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:42:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b374c44-4c04-4f8a-9972-d125386a6c45 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:42:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b374c44-4c04-4f8a-9972-d125386a6c45 None admin] PATH_INFO: `/v3/services` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:42:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b374c44-4c04-4f8a-9972-d125386a6c45 None admin] RBAC: Adding query filter params (type=sharev2) {{(pid=51267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:42:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b374c44-4c04-4f8a-9972-d125386a6c45 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:42:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b374c44-4c04-4f8a-9972-d125386a6c45 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:42:36 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 420/824] 10.27.203.238 () {60 vars in 1200 bytes} [Tue May 28 12:42:36 2024] GET /identity/v3/services?type=sharev2 => generated 375 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:42:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2907d32-491b-4077-a690-68d9d37e58ac None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:42:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2907d32-491b-4077-a690-68d9d37e58ac None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:42:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49060ad-9db9-4eb9-80f6-003df9093ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:42:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49060ad-9db9-4eb9-80f6-003df9093ea5 None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:42:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49060ad-9db9-4eb9-80f6-003df9093ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:42:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49060ad-9db9-4eb9-80f6-003df9093ea5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:42:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49060ad-9db9-4eb9-80f6-003df9093ea5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:42:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49060ad-9db9-4eb9-80f6-003df9093ea5 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:42:36 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 405/825] 10.27.203.238 () {64 vars in 1232 bytes} [Tue May 28 12:42:36 2024] POST /identity/v3/endpoints => generated 334 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:42:37 l75lg1-v1 dstat.sh[49771]: 28-05 12:42:37| 9 1 89 0 0|1525M 8011M 267M 5897M| 15k 2128B| 0 308k| 0 34.0 |3115 4912 |1.88 1.99 1.27|1.0 0 37| 0 0 | 0 2048M| 19 33 0 3 0 May 28 12:42:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be2c751-64e9-4553-a718-9e19aea765e5 None None] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:42:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be2c751-64e9-4553-a718-9e19aea765e5 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:42:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be2c751-64e9-4553-a718-9e19aea765e5 None None] PATH_INFO: `/` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:42:38 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 421/826] 10.27.203.238 () {58 vars in 1014 bytes} [Tue May 28 12:42:38 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:42:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c42b48-7762-4a94-8c7f-1d0b00bc2dcc None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:42:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c42b48-7762-4a94-8c7f-1d0b00bc2dcc None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:42:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c42b48-7762-4a94-8c7f-1d0b00bc2dcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:42:38 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-19c42b48-7762-4a94-8c7f-1d0b00bc2dcc None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:42:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-19c42b48-7762-4a94-8c7f-1d0b00bc2dcc None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:42:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-19c42b48-7762-4a94-8c7f-1d0b00bc2dcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:42:38 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 406/827] 10.27.203.238 () {62 vars in 1111 bytes} [Tue May 28 12:42:38 2024] POST /identity/v3/auth/tokens => generated 2548 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 12:42:38 l75lg1-v1 dstat.sh[49771]: 28-05 12:42:38| 9 1 90 0 0|1557M 7980M 267M 5897M| 10k 0 | 0 32k| 0 5.00 |1488 1947 |1.88 1.99 1.27|1.0 0 2.0| 0 0 | 0 2048M| 19 33 0 3 0 May 28 12:42:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be2c751-64e9-4553-a718-9e19aea765e5 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:42:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be2c751-64e9-4553-a718-9e19aea765e5 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:42:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b765bf8-9bbd-4008-839c-5981c774cfe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:42:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b765bf8-9bbd-4008-839c-5981c774cfe5 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:42:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b765bf8-9bbd-4008-839c-5981c774cfe5 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:42:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b765bf8-9bbd-4008-839c-5981c774cfe5 None admin] PATH_INFO: `/v3/services/sharev2_legacy` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:42:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b765bf8-9bbd-4008-839c-5981c774cfe5 None admin] RBAC: Authorizing `identity:get_service(service_id=sharev2_legacy)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:42:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b765bf8-9bbd-4008-839c-5981c774cfe5 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:42:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-4b765bf8-9bbd-4008-839c-5981c774cfe5 None admin] Could not find service: sharev2_legacy.: keystone.exception.ServiceNotFound: Could not find service: sharev2_legacy. May 28 12:42:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:42:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 28 12:42:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 28 12:42:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 194, in get_service May 28 12:42:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 28 12:42:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 189, in _get_service May 28 12:42:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 28 12:42:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: sharev2_legacy. May 28 12:42:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 12:42:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 28 12:42:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 12:42:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:42:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:42:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:42:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:42:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:42:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:42:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:42:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:42:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:42:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:42:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:42:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 28 12:42:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._get_service(service_id) May 28 12:42:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 28 12:42:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 28 12:42:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:42:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:42:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:42:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:42:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:42:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:42:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:42:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 12:42:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:42:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 12:42:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:42:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:42:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:42:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 12:42:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:42:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 12:42:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 28 12:42:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 28 12:42:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: sharev2_legacy. May 28 12:42:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 12:42:38 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 422/828] 10.27.203.238 () {60 vars in 1220 bytes} [Tue May 28 12:42:38 2024] GET /identity/v3/services/sharev2_legacy => generated 95 bytes in 90 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 28 12:42:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c42b48-7762-4a94-8c7f-1d0b00bc2dcc None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:42:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c42b48-7762-4a94-8c7f-1d0b00bc2dcc None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:42:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6904d9de-01b2-49a1-90fc-484a86f646f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:42:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6904d9de-01b2-49a1-90fc-484a86f646f6 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:42:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6904d9de-01b2-49a1-90fc-484a86f646f6 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:42:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6904d9de-01b2-49a1-90fc-484a86f646f6 None admin] PATH_INFO: `/v3/services` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:42:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6904d9de-01b2-49a1-90fc-484a86f646f6 None admin] RBAC: Adding query filter params (name=sharev2_legacy) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:42:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6904d9de-01b2-49a1-90fc-484a86f646f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:42:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6904d9de-01b2-49a1-90fc-484a86f646f6 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:42:38 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 407/829] 10.27.203.238 () {60 vars in 1214 bytes} [Tue May 28 12:42:38 2024] GET /identity/v3/services?name=sharev2_legacy => generated 133 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:42:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b765bf8-9bbd-4008-839c-5981c774cfe5 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:42:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b765bf8-9bbd-4008-839c-5981c774cfe5 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:42:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf1ffb2-f58b-4ac4-a887-58c3815566fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:42:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf1ffb2-f58b-4ac4-a887-58c3815566fc None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:42:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf1ffb2-f58b-4ac4-a887-58c3815566fc None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:42:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf1ffb2-f58b-4ac4-a887-58c3815566fc None admin] PATH_INFO: `/v3/services` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:42:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf1ffb2-f58b-4ac4-a887-58c3815566fc None admin] RBAC: Adding query filter params (type=sharev2_legacy) {{(pid=51267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:42:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf1ffb2-f58b-4ac4-a887-58c3815566fc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:42:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf1ffb2-f58b-4ac4-a887-58c3815566fc None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:42:38 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 423/830] 10.27.203.238 () {60 vars in 1214 bytes} [Tue May 28 12:42:38 2024] GET /identity/v3/services?type=sharev2_legacy => generated 133 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:42:39 l75lg1-v1 dstat.sh[49771]: 28-05 12:42:39| 9 1 89 0 0|1529M 8008M 267M 5897M| 10k 1188B| 0 4096B| 0 1.00 |2347 3492 |1.88 1.99 1.27|1.0 0 20| 0 0 | 0 2048M| 19 33 0 3 0 May 28 12:42:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e75f0e-bfcc-4fc5-8206-64870a831b83 None None] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:42:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e75f0e-bfcc-4fc5-8206-64870a831b83 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:42:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e75f0e-bfcc-4fc5-8206-64870a831b83 None None] PATH_INFO: `/` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:42:39 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 408/831] 10.27.203.238 () {58 vars in 1014 bytes} [Tue May 28 12:42:39 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:42:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caa1d5e-341b-4212-a139-2274ff37a280 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:42:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caa1d5e-341b-4212-a139-2274ff37a280 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:42:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caa1d5e-341b-4212-a139-2274ff37a280 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:42:39 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-2caa1d5e-341b-4212-a139-2274ff37a280 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:42:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-2caa1d5e-341b-4212-a139-2274ff37a280 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:42:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-2caa1d5e-341b-4212-a139-2274ff37a280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:42:39 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 424/832] 10.27.203.238 () {62 vars in 1111 bytes} [Tue May 28 12:42:39 2024] POST /identity/v3/auth/tokens => generated 2548 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 12:42:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e75f0e-bfcc-4fc5-8206-64870a831b83 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:42:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e75f0e-bfcc-4fc5-8206-64870a831b83 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:42:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fe53bc-f6a6-45f0-81ed-59ca6a0c9f7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:42:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fe53bc-f6a6-45f0-81ed-59ca6a0c9f7c None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:42:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fe53bc-f6a6-45f0-81ed-59ca6a0c9f7c None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:42:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fe53bc-f6a6-45f0-81ed-59ca6a0c9f7c None admin] PATH_INFO: `/v3/services` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:42:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fe53bc-f6a6-45f0-81ed-59ca6a0c9f7c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:42:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fe53bc-f6a6-45f0-81ed-59ca6a0c9f7c None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:42:40 l75lg1-v1 dstat.sh[49771]: 28-05 12:42:40| 9 1 90 0 0|1556M 7980M 267M 5897M| 11k 172B| 0 36k| 0 9.00 |1537 2289 |1.88 1.99 1.27|1.0 0 0| 0 0 | 0 2048M| 19 34 0 3 0 May 28 12:42:40 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 409/833] 10.27.203.238 () {64 vars in 1229 bytes} [Tue May 28 12:42:40 2024] POST /identity/v3/services => generated 295 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:42:41 l75lg1-v1 dstat.sh[49771]: 28-05 12:42:41| 9 0 89 0 0|1536M 8000M 267M 5897M| 16k 2732B| 0 319k| 0 28.9 |1642 1918 |1.88 1.99 1.27|1.0 0 34| 0 0 | 0 2048M| 19 33 0 3 0 May 28 12:42:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b524eaa-33e5-4285-9cde-98548fce8df2 None None] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:42:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b524eaa-33e5-4285-9cde-98548fce8df2 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:42:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b524eaa-33e5-4285-9cde-98548fce8df2 None None] PATH_INFO: `/` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:42:41 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 425/834] 10.27.203.238 () {58 vars in 1014 bytes} [Tue May 28 12:42:41 2024] GET /identity => generated 272 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:42:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15d3038-5077-48ba-ac87-d790fd4280a8 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:42:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15d3038-5077-48ba-ac87-d790fd4280a8 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:42:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15d3038-5077-48ba-ac87-d790fd4280a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:42:41 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-b15d3038-5077-48ba-ac87-d790fd4280a8 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:42:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-b15d3038-5077-48ba-ac87-d790fd4280a8 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:42:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-b15d3038-5077-48ba-ac87-d790fd4280a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:42:41 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 410/835] 10.27.203.238 () {62 vars in 1111 bytes} [Tue May 28 12:42:41 2024] POST /identity/v3/auth/tokens => generated 2662 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 12:42:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b524eaa-33e5-4285-9cde-98548fce8df2 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:42:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b524eaa-33e5-4285-9cde-98548fce8df2 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:42:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a63e33-c6cf-4162-bd22-454d1554d351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:42:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a63e33-c6cf-4162-bd22-454d1554d351 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:42:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a63e33-c6cf-4162-bd22-454d1554d351 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:42:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a63e33-c6cf-4162-bd22-454d1554d351 None admin] PATH_INFO: `/v3/services/sharev2_legacy` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:42:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a63e33-c6cf-4162-bd22-454d1554d351 None admin] RBAC: Authorizing `identity:get_service(service_id=sharev2_legacy)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:42:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a63e33-c6cf-4162-bd22-454d1554d351 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:42:42 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-52a63e33-c6cf-4162-bd22-454d1554d351 None admin] Could not find service: sharev2_legacy.: keystone.exception.ServiceNotFound: Could not find service: sharev2_legacy. May 28 12:42:42 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:42:42 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 28 12:42:42 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 28 12:42:42 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 194, in get_service May 28 12:42:42 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 28 12:42:42 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 189, in _get_service May 28 12:42:42 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 28 12:42:42 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: sharev2_legacy. May 28 12:42:42 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 12:42:42 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 28 12:42:42 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 12:42:42 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:42:42 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:42:42 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:42:42 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:42:42 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:42:42 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:42:42 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:42:42 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:42:42 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:42:42 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:42:42 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:42:42 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 28 12:42:42 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._get_service(service_id) May 28 12:42:42 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 28 12:42:42 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 28 12:42:42 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:42:42 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:42:42 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:42:42 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:42:42 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:42:42 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:42:42 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:42:42 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 12:42:42 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:42:42 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 12:42:42 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:42:42 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:42:42 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:42:42 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 12:42:42 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:42:42 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 12:42:42 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 28 12:42:42 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 28 12:42:42 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: sharev2_legacy. May 28 12:42:42 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 12:42:42 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 426/836] 10.27.203.238 () {60 vars in 1220 bytes} [Tue May 28 12:42:41 2024] GET /identity/v3/services/sharev2_legacy => generated 95 bytes in 89 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 28 12:42:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15d3038-5077-48ba-ac87-d790fd4280a8 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:42:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15d3038-5077-48ba-ac87-d790fd4280a8 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:42:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b699b318-a095-4a2f-a345-86716e13eab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:42:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b699b318-a095-4a2f-a345-86716e13eab3 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:42:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b699b318-a095-4a2f-a345-86716e13eab3 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:42:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b699b318-a095-4a2f-a345-86716e13eab3 None admin] PATH_INFO: `/v3/services` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:42:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b699b318-a095-4a2f-a345-86716e13eab3 None admin] RBAC: Adding query filter params (name=sharev2_legacy) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:42:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b699b318-a095-4a2f-a345-86716e13eab3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:42:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b699b318-a095-4a2f-a345-86716e13eab3 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:42:42 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 411/837] 10.27.203.238 () {60 vars in 1214 bytes} [Tue May 28 12:42:42 2024] GET /identity/v3/services?name=sharev2_legacy => generated 133 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:42:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a63e33-c6cf-4162-bd22-454d1554d351 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:42:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a63e33-c6cf-4162-bd22-454d1554d351 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:42:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff57e081-bc23-45fa-814e-b390a0a7e431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:42:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff57e081-bc23-45fa-814e-b390a0a7e431 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:42:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff57e081-bc23-45fa-814e-b390a0a7e431 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:42:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff57e081-bc23-45fa-814e-b390a0a7e431 None admin] PATH_INFO: `/v3/services` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:42:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff57e081-bc23-45fa-814e-b390a0a7e431 None admin] RBAC: Adding query filter params (type=sharev2_legacy) {{(pid=51267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:42:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff57e081-bc23-45fa-814e-b390a0a7e431 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:42:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff57e081-bc23-45fa-814e-b390a0a7e431 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:42:42 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 427/838] 10.27.203.238 () {60 vars in 1214 bytes} [Tue May 28 12:42:42 2024] GET /identity/v3/services?type=sharev2_legacy => generated 414 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:42:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b699b318-a095-4a2f-a345-86716e13eab3 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:42:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b699b318-a095-4a2f-a345-86716e13eab3 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:42:42 l75lg1-v1 dstat.sh[49771]: 28-05 12:42:42| 9 1 89 0 0|1557M 7979M 267M 5897M| 12k 0 | 0 0 | 0 0 |2289 3893 |1.81 1.97 1.26|1.0 0 0| 0 0 | 0 2048M| 19 34 0 3 0 May 28 12:42:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f470a01-1d8d-4d82-9231-0457878220d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:42:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f470a01-1d8d-4d82-9231-0457878220d3 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:42:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f470a01-1d8d-4d82-9231-0457878220d3 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:42:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f470a01-1d8d-4d82-9231-0457878220d3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:42:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f470a01-1d8d-4d82-9231-0457878220d3 None admin] RBAC: Adding query filter params (interface=public, service_id=948af76678534397bd87b20ba9da7590, region_id=RegionOne) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:42:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f470a01-1d8d-4d82-9231-0457878220d3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:42:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f470a01-1d8d-4d82-9231-0457878220d3 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:42:42 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 412/839] 10.27.203.238 () {60 vars in 1339 bytes} [Tue May 28 12:42:42 2024] GET /identity/v3/endpoints?service_id=948af76678534397bd87b20ba9da7590&interface=public®ion_id=RegionOne => generated 196 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:42:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff57e081-bc23-45fa-814e-b390a0a7e431 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:42:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff57e081-bc23-45fa-814e-b390a0a7e431 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:42:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262cd11f-db96-4c54-ac5b-d4fdf5730930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:42:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262cd11f-db96-4c54-ac5b-d4fdf5730930 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:42:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262cd11f-db96-4c54-ac5b-d4fdf5730930 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:42:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262cd11f-db96-4c54-ac5b-d4fdf5730930 None admin] PATH_INFO: `/v3/services` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:42:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262cd11f-db96-4c54-ac5b-d4fdf5730930 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:42:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262cd11f-db96-4c54-ac5b-d4fdf5730930 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:42:42 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 428/840] 10.27.203.238 () {60 vars in 1175 bytes} [Tue May 28 12:42:42 2024] GET /identity/v3/services => generated 2758 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:42:43 l75lg1-v1 dstat.sh[49771]: 28-05 12:42:43| 9 1 89 0 0|1532M 8004M 267M 5897M| 12k 1750B| 0 8192B| 0 1.00 |1821 2365 |1.81 1.97 1.26|1.0 0 25| 0 0 | 0 2048M| 19 33 0 3 0 May 28 12:42:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2710ff8-752c-4325-bf55-0b09b245bb24 None None] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:42:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2710ff8-752c-4325-bf55-0b09b245bb24 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:42:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2710ff8-752c-4325-bf55-0b09b245bb24 None None] PATH_INFO: `/` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:42:43 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 413/841] 10.27.203.238 () {58 vars in 1014 bytes} [Tue May 28 12:42:43 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:42:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe1740d-2574-4f0b-8945-0f0291d39be7 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:42:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe1740d-2574-4f0b-8945-0f0291d39be7 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:42:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe1740d-2574-4f0b-8945-0f0291d39be7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:42:43 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-9fe1740d-2574-4f0b-8945-0f0291d39be7 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:42:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-9fe1740d-2574-4f0b-8945-0f0291d39be7 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:42:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-9fe1740d-2574-4f0b-8945-0f0291d39be7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:42:43 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 429/842] 10.27.203.238 () {62 vars in 1111 bytes} [Tue May 28 12:42:43 2024] POST /identity/v3/auth/tokens => generated 2662 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 12:42:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2710ff8-752c-4325-bf55-0b09b245bb24 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:42:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2710ff8-752c-4325-bf55-0b09b245bb24 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:42:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1b17e7-a063-48ee-9c86-cef4055dc581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:42:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1b17e7-a063-48ee-9c86-cef4055dc581 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:42:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1b17e7-a063-48ee-9c86-cef4055dc581 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:42:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1b17e7-a063-48ee-9c86-cef4055dc581 None admin] PATH_INFO: `/v3/services/sharev2_legacy` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:42:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1b17e7-a063-48ee-9c86-cef4055dc581 None admin] RBAC: Authorizing `identity:get_service(service_id=sharev2_legacy)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:42:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1b17e7-a063-48ee-9c86-cef4055dc581 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:42:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-8e1b17e7-a063-48ee-9c86-cef4055dc581 None admin] Could not find service: sharev2_legacy.: keystone.exception.ServiceNotFound: Could not find service: sharev2_legacy. May 28 12:42:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:42:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 28 12:42:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 28 12:42:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 194, in get_service May 28 12:42:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 28 12:42:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 189, in _get_service May 28 12:42:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 28 12:42:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: sharev2_legacy. May 28 12:42:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 12:42:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 28 12:42:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 12:42:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:42:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:42:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:42:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:42:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:42:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:42:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:42:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:42:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:42:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:42:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:42:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 28 12:42:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._get_service(service_id) May 28 12:42:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 28 12:42:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 28 12:42:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:42:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:42:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:42:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:42:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:42:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:42:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:42:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 12:42:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:42:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 12:42:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:42:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:42:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:42:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 12:42:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:42:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 12:42:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 28 12:42:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 28 12:42:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: sharev2_legacy. May 28 12:42:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 12:42:44 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 414/843] 10.27.203.238 () {60 vars in 1220 bytes} [Tue May 28 12:42:44 2024] GET /identity/v3/services/sharev2_legacy => generated 95 bytes in 92 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 28 12:42:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe1740d-2574-4f0b-8945-0f0291d39be7 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:42:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe1740d-2574-4f0b-8945-0f0291d39be7 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:42:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dc4c3c-d468-45d2-bda8-01d1fb7f0a0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:42:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dc4c3c-d468-45d2-bda8-01d1fb7f0a0d None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:42:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dc4c3c-d468-45d2-bda8-01d1fb7f0a0d None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:42:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dc4c3c-d468-45d2-bda8-01d1fb7f0a0d None admin] PATH_INFO: `/v3/services` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:42:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dc4c3c-d468-45d2-bda8-01d1fb7f0a0d None admin] RBAC: Adding query filter params (name=sharev2_legacy) {{(pid=51267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:42:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dc4c3c-d468-45d2-bda8-01d1fb7f0a0d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:42:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dc4c3c-d468-45d2-bda8-01d1fb7f0a0d None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:42:44 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 430/844] 10.27.203.238 () {60 vars in 1214 bytes} [Tue May 28 12:42:44 2024] GET /identity/v3/services?name=sharev2_legacy => generated 133 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:42:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1b17e7-a063-48ee-9c86-cef4055dc581 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:42:44 l75lg1-v1 dstat.sh[49771]: 28-05 12:42:44| 9 1 89 0 0|1557M 7979M 267M 5897M| 14k 367B| 0 0 | 0 0 |2258 3491 |1.81 1.97 1.26|2.0 0 0| 0 0 | 0 2048M| 19 34 0 3 0 May 28 12:42:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1b17e7-a063-48ee-9c86-cef4055dc581 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:42:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d596672-bc8c-469c-8ecd-5df966c0a1c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:42:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d596672-bc8c-469c-8ecd-5df966c0a1c1 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:42:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d596672-bc8c-469c-8ecd-5df966c0a1c1 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:42:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d596672-bc8c-469c-8ecd-5df966c0a1c1 None admin] PATH_INFO: `/v3/services` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:42:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d596672-bc8c-469c-8ecd-5df966c0a1c1 None admin] RBAC: Adding query filter params (type=sharev2_legacy) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:42:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d596672-bc8c-469c-8ecd-5df966c0a1c1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:42:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d596672-bc8c-469c-8ecd-5df966c0a1c1 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:42:44 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 415/845] 10.27.203.238 () {60 vars in 1214 bytes} [Tue May 28 12:42:44 2024] GET /identity/v3/services?type=sharev2_legacy => generated 414 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:42:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dc4c3c-d468-45d2-bda8-01d1fb7f0a0d None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:42:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dc4c3c-d468-45d2-bda8-01d1fb7f0a0d None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:42:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5400a2b-bcc3-44d6-9741-3e879612cee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:42:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5400a2b-bcc3-44d6-9741-3e879612cee4 None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:42:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5400a2b-bcc3-44d6-9741-3e879612cee4 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:42:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5400a2b-bcc3-44d6-9741-3e879612cee4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:42:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5400a2b-bcc3-44d6-9741-3e879612cee4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:42:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5400a2b-bcc3-44d6-9741-3e879612cee4 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:42:44 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 431/846] 10.27.203.238 () {64 vars in 1232 bytes} [Tue May 28 12:42:44 2024] POST /identity/v3/endpoints => generated 349 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:42:45 l75lg1-v1 dstat.sh[49771]: 28-05 12:42:45| 9 1 89 0 0|1530M 8006M 267M 5897M| 12k 2160B| 0 360k| 0 39.0 |2026 2926 |1.81 1.97 1.26|1.0 0 37| 0 0 | 0 2048M| 19 33 0 3 0 May 28 12:42:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202e3326-8907-41fa-9767-55334d887b94 None None] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:42:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202e3326-8907-41fa-9767-55334d887b94 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:42:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202e3326-8907-41fa-9767-55334d887b94 None None] PATH_INFO: `/` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:42:45 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 416/847] 10.27.203.238 () {58 vars in 1014 bytes} [Tue May 28 12:42:45 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:42:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe2c2e7-83c4-4e9a-a78e-5aaeabed8bdf None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:42:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe2c2e7-83c4-4e9a-a78e-5aaeabed8bdf None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:42:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe2c2e7-83c4-4e9a-a78e-5aaeabed8bdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:42:45 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-ebe2c2e7-83c4-4e9a-a78e-5aaeabed8bdf None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:42:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-ebe2c2e7-83c4-4e9a-a78e-5aaeabed8bdf None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:42:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-ebe2c2e7-83c4-4e9a-a78e-5aaeabed8bdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:42:45 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 432/848] 10.27.203.238 () {62 vars in 1111 bytes} [Tue May 28 12:42:45 2024] POST /identity/v3/auth/tokens => generated 2662 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 12:42:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202e3326-8907-41fa-9767-55334d887b94 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:42:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202e3326-8907-41fa-9767-55334d887b94 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:42:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99064cea-3758-44e8-98d3-e1967a6a59d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:42:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99064cea-3758-44e8-98d3-e1967a6a59d0 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:42:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99064cea-3758-44e8-98d3-e1967a6a59d0 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:42:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99064cea-3758-44e8-98d3-e1967a6a59d0 None admin] PATH_INFO: `/v3/services/shared-file-system` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:42:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99064cea-3758-44e8-98d3-e1967a6a59d0 None admin] RBAC: Authorizing `identity:get_service(service_id=shared-file-system)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:42:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99064cea-3758-44e8-98d3-e1967a6a59d0 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:42:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-99064cea-3758-44e8-98d3-e1967a6a59d0 None admin] Could not find service: shared-file-system.: keystone.exception.ServiceNotFound: Could not find service: shared-file-system. May 28 12:42:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:42:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 28 12:42:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 28 12:42:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 194, in get_service May 28 12:42:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 28 12:42:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 189, in _get_service May 28 12:42:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 28 12:42:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: shared-file-system. May 28 12:42:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 12:42:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 28 12:42:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 12:42:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:42:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:42:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:42:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:42:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:42:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:42:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:42:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:42:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:42:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:42:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:42:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 28 12:42:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._get_service(service_id) May 28 12:42:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 28 12:42:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 28 12:42:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:42:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:42:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:42:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:42:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:42:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:42:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:42:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 12:42:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:42:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 12:42:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:42:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:42:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:42:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 12:42:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:42:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 12:42:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 28 12:42:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 28 12:42:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: shared-file-system. May 28 12:42:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 12:42:46 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 417/849] 10.27.203.238 () {60 vars in 1232 bytes} [Tue May 28 12:42:46 2024] GET /identity/v3/services/shared-file-system => generated 99 bytes in 88 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 28 12:42:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe2c2e7-83c4-4e9a-a78e-5aaeabed8bdf None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:42:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe2c2e7-83c4-4e9a-a78e-5aaeabed8bdf None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:42:46 l75lg1-v1 dstat.sh[49771]: 28-05 12:42:46| 9 1 90 0 0|1556M 7980M 267M 5897M| 11k 0 | 0 1636k| 0 237 |1951 2943 |1.81 1.97 1.26|2.0 0 0| 0 0 | 0 2048M| 19 34 0 3 0 May 28 12:42:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea2e2fe-e0ed-4a66-935b-4f7bc789fa1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:42:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea2e2fe-e0ed-4a66-935b-4f7bc789fa1b None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:42:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea2e2fe-e0ed-4a66-935b-4f7bc789fa1b None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:42:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea2e2fe-e0ed-4a66-935b-4f7bc789fa1b None admin] PATH_INFO: `/v3/services` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:42:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea2e2fe-e0ed-4a66-935b-4f7bc789fa1b None admin] RBAC: Adding query filter params (name=shared-file-system) {{(pid=51267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:42:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea2e2fe-e0ed-4a66-935b-4f7bc789fa1b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:42:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea2e2fe-e0ed-4a66-935b-4f7bc789fa1b None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:42:46 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 433/850] 10.27.203.238 () {60 vars in 1222 bytes} [Tue May 28 12:42:46 2024] GET /identity/v3/services?name=shared-file-system => generated 137 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:42:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99064cea-3758-44e8-98d3-e1967a6a59d0 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:42:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99064cea-3758-44e8-98d3-e1967a6a59d0 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:42:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9317db0-e0f0-42d7-b3c5-e57edd113a77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:42:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9317db0-e0f0-42d7-b3c5-e57edd113a77 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:42:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9317db0-e0f0-42d7-b3c5-e57edd113a77 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:42:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9317db0-e0f0-42d7-b3c5-e57edd113a77 None admin] PATH_INFO: `/v3/services` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:42:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9317db0-e0f0-42d7-b3c5-e57edd113a77 None admin] RBAC: Adding query filter params (type=shared-file-system) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:42:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9317db0-e0f0-42d7-b3c5-e57edd113a77 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:42:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9317db0-e0f0-42d7-b3c5-e57edd113a77 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:42:46 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 418/851] 10.27.203.238 () {60 vars in 1222 bytes} [Tue May 28 12:42:46 2024] GET /identity/v3/services?type=shared-file-system => generated 137 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:42:47 l75lg1-v1 dstat.sh[49771]: 28-05 12:42:47| 9 1 90 0 0|1533M 8003M 267M 5897M| 14k 1220B| 0 96k| 0 1.00 |1392 1924 |1.74 1.95 1.26|1.0 0 20| 0 0 | 0 2048M| 19 33 0 3 0 May 28 12:42:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a56a12-3558-4180-a15d-a22f5274221b None None] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:42:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a56a12-3558-4180-a15d-a22f5274221b None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:42:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a56a12-3558-4180-a15d-a22f5274221b None None] PATH_INFO: `/` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:42:47 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 434/852] 10.27.203.238 () {58 vars in 1014 bytes} [Tue May 28 12:42:47 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:42:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627c7997-df9e-446c-9d95-2828190dd9af None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:42:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627c7997-df9e-446c-9d95-2828190dd9af None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:42:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627c7997-df9e-446c-9d95-2828190dd9af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:42:47 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-627c7997-df9e-446c-9d95-2828190dd9af None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:42:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-627c7997-df9e-446c-9d95-2828190dd9af None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:42:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-627c7997-df9e-446c-9d95-2828190dd9af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:42:47 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 419/853] 10.27.203.238 () {62 vars in 1111 bytes} [Tue May 28 12:42:47 2024] POST /identity/v3/auth/tokens => generated 2662 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 12:42:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a56a12-3558-4180-a15d-a22f5274221b None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:42:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a56a12-3558-4180-a15d-a22f5274221b None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:42:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaab9d8-036c-43cc-90eb-6de0696e6261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:42:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaab9d8-036c-43cc-90eb-6de0696e6261 None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:42:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaab9d8-036c-43cc-90eb-6de0696e6261 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:42:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaab9d8-036c-43cc-90eb-6de0696e6261 None admin] PATH_INFO: `/v3/services` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:42:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaab9d8-036c-43cc-90eb-6de0696e6261 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:42:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaab9d8-036c-43cc-90eb-6de0696e6261 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:42:48 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 435/854] 10.27.203.238 () {64 vars in 1229 bytes} [Tue May 28 12:42:47 2024] POST /identity/v3/services => generated 324 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:42:48 l75lg1-v1 dstat.sh[49771]: 28-05 12:42:48| 9 1 89 0 0|1498M 8038M 267M 5897M| 12k 2538B| 0 176k| 0 22.0 |2133 3262 |1.74 1.95 1.26|1.0 0 30| 0 0 | 0 2048M| 19 33 0 3 0 May 28 12:42:49 l75lg1-v1 dstat.sh[49771]: 28-05 12:42:49| 9 1 89 0 0|1548M 7988M 267M 5897M| 11k 356B| 0 384k| 0 32.0 |1179 1388 |1.74 1.95 1.26|1.0 0 6.0| 0 0 | 0 2048M| 19 33 0 3 0 May 28 12:42:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00f0453-f7a5-489a-8cb9-15f61b56aa67 None None] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:42:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00f0453-f7a5-489a-8cb9-15f61b56aa67 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:42:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00f0453-f7a5-489a-8cb9-15f61b56aa67 None None] PATH_INFO: `/` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:42:49 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 420/855] 10.27.203.238 () {58 vars in 1014 bytes} [Tue May 28 12:42:49 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:42:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cc9cd0-4f40-4b72-b953-e1ba50269869 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:42:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cc9cd0-4f40-4b72-b953-e1ba50269869 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:42:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cc9cd0-4f40-4b72-b953-e1ba50269869 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:42:49 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-b8cc9cd0-4f40-4b72-b953-e1ba50269869 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:42:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-b8cc9cd0-4f40-4b72-b953-e1ba50269869 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:42:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-b8cc9cd0-4f40-4b72-b953-e1ba50269869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:42:49 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 436/856] 10.27.203.238 () {62 vars in 1111 bytes} [Tue May 28 12:42:49 2024] POST /identity/v3/auth/tokens => generated 2783 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 28 12:42:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00f0453-f7a5-489a-8cb9-15f61b56aa67 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:42:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00f0453-f7a5-489a-8cb9-15f61b56aa67 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:42:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d0deba-160b-4eea-a0b2-b1bf7b785a8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:42:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d0deba-160b-4eea-a0b2-b1bf7b785a8e None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:42:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d0deba-160b-4eea-a0b2-b1bf7b785a8e None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:42:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d0deba-160b-4eea-a0b2-b1bf7b785a8e None admin] PATH_INFO: `/v3/services/shared-file-system` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:42:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d0deba-160b-4eea-a0b2-b1bf7b785a8e None admin] RBAC: Authorizing `identity:get_service(service_id=shared-file-system)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:42:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d0deba-160b-4eea-a0b2-b1bf7b785a8e None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:42:49 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-f1d0deba-160b-4eea-a0b2-b1bf7b785a8e None admin] Could not find service: shared-file-system.: keystone.exception.ServiceNotFound: Could not find service: shared-file-system. May 28 12:42:49 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:42:49 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 28 12:42:49 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 28 12:42:49 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 194, in get_service May 28 12:42:49 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 28 12:42:49 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 189, in _get_service May 28 12:42:49 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 28 12:42:49 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: shared-file-system. May 28 12:42:49 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 12:42:49 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 28 12:42:49 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 12:42:49 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:42:49 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:42:49 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:42:49 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:42:49 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:42:49 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:42:49 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:42:49 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:42:49 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:42:49 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:42:49 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:42:49 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 28 12:42:49 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._get_service(service_id) May 28 12:42:49 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 28 12:42:49 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 28 12:42:49 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:42:49 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:42:49 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:42:49 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:42:49 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:42:49 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:42:49 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:42:49 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 12:42:49 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:42:49 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 12:42:49 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:42:49 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:42:49 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:42:49 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 12:42:49 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:42:49 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 12:42:49 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 28 12:42:49 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 28 12:42:49 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: shared-file-system. May 28 12:42:49 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 12:42:49 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 421/857] 10.27.203.238 () {60 vars in 1232 bytes} [Tue May 28 12:42:49 2024] GET /identity/v3/services/shared-file-system => generated 99 bytes in 87 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 28 12:42:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cc9cd0-4f40-4b72-b953-e1ba50269869 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:42:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cc9cd0-4f40-4b72-b953-e1ba50269869 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:42:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bae2074-7535-41d0-8246-9ddca68bbf18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:42:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bae2074-7535-41d0-8246-9ddca68bbf18 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:42:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bae2074-7535-41d0-8246-9ddca68bbf18 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:42:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bae2074-7535-41d0-8246-9ddca68bbf18 None admin] PATH_INFO: `/v3/services` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:42:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bae2074-7535-41d0-8246-9ddca68bbf18 None admin] RBAC: Adding query filter params (name=shared-file-system) {{(pid=51267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:42:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bae2074-7535-41d0-8246-9ddca68bbf18 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:42:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bae2074-7535-41d0-8246-9ddca68bbf18 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:42:49 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 437/858] 10.27.203.238 () {60 vars in 1222 bytes} [Tue May 28 12:42:49 2024] GET /identity/v3/services?name=shared-file-system => generated 447 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:42:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d0deba-160b-4eea-a0b2-b1bf7b785a8e None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:42:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d0deba-160b-4eea-a0b2-b1bf7b785a8e None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:42:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c750ab49-89f5-4427-9eed-319570cd37d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:42:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c750ab49-89f5-4427-9eed-319570cd37d8 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:42:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c750ab49-89f5-4427-9eed-319570cd37d8 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:42:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c750ab49-89f5-4427-9eed-319570cd37d8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:42:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c750ab49-89f5-4427-9eed-319570cd37d8 None admin] RBAC: Adding query filter params (interface=public, service_id=65e91aefaee4452a962288264ed74e82, region_id=RegionOne) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:42:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c750ab49-89f5-4427-9eed-319570cd37d8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:42:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c750ab49-89f5-4427-9eed-319570cd37d8 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:42:49 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 422/859] 10.27.203.238 () {60 vars in 1339 bytes} [Tue May 28 12:42:49 2024] GET /identity/v3/endpoints?service_id=65e91aefaee4452a962288264ed74e82&interface=public®ion_id=RegionOne => generated 196 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:42:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bae2074-7535-41d0-8246-9ddca68bbf18 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:42:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bae2074-7535-41d0-8246-9ddca68bbf18 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:42:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8b423f-d677-4fdf-a5b3-d13303ac62ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:42:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8b423f-d677-4fdf-a5b3-d13303ac62ee None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:42:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8b423f-d677-4fdf-a5b3-d13303ac62ee None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:42:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8b423f-d677-4fdf-a5b3-d13303ac62ee None admin] PATH_INFO: `/v3/services` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:42:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8b423f-d677-4fdf-a5b3-d13303ac62ee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:42:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8b423f-d677-4fdf-a5b3-d13303ac62ee None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:42:50 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 438/860] 10.27.203.238 () {60 vars in 1175 bytes} [Tue May 28 12:42:49 2024] GET /identity/v3/services => generated 3070 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:42:50 l75lg1-v1 dstat.sh[49771]: 28-05 12:42:50| 9 2 89 0 0|1499M 8037M 267M 5897M| 12k 1784B| 0 4096B| 0 1.00 |2633 4304 |1.74 1.95 1.26|1.0 0 25| 0 0 | 0 2048M| 19 33 0 3 0 May 28 12:42:51 l75lg1-v1 dstat.sh[49771]: 28-05 12:42:51| 9 1 90 0 0|1541M 7995M 267M 5897M| 16k 723B| 0 4096B| 0 1.00 |1115 1229 |1.74 1.95 1.26|1.0 0 0| 0 0 | 0 2048M| 19 33 0 3 0 May 28 12:42:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82c6eca-019b-413e-905a-64cd5de94ea1 None None] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:42:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82c6eca-019b-413e-905a-64cd5de94ea1 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:42:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82c6eca-019b-413e-905a-64cd5de94ea1 None None] PATH_INFO: `/` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:42:51 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 423/861] 10.27.203.238 () {58 vars in 1014 bytes} [Tue May 28 12:42:51 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:42:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4360d39-66cb-4c00-956e-0f1f46c7639f None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:42:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4360d39-66cb-4c00-956e-0f1f46c7639f None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:42:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4360d39-66cb-4c00-956e-0f1f46c7639f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:42:51 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-f4360d39-66cb-4c00-956e-0f1f46c7639f None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:42:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-f4360d39-66cb-4c00-956e-0f1f46c7639f None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:42:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-f4360d39-66cb-4c00-956e-0f1f46c7639f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:42:51 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 439/862] 10.27.203.238 () {62 vars in 1111 bytes} [Tue May 28 12:42:51 2024] POST /identity/v3/auth/tokens => generated 2783 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 12:42:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82c6eca-019b-413e-905a-64cd5de94ea1 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:42:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82c6eca-019b-413e-905a-64cd5de94ea1 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:42:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dbbac2-347c-4e7f-8c8b-ea4063486429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:42:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dbbac2-347c-4e7f-8c8b-ea4063486429 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:42:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dbbac2-347c-4e7f-8c8b-ea4063486429 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:42:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dbbac2-347c-4e7f-8c8b-ea4063486429 None admin] PATH_INFO: `/v3/services/shared-file-system` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:42:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dbbac2-347c-4e7f-8c8b-ea4063486429 None admin] RBAC: Authorizing `identity:get_service(service_id=shared-file-system)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:42:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dbbac2-347c-4e7f-8c8b-ea4063486429 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:42:51 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-60dbbac2-347c-4e7f-8c8b-ea4063486429 None admin] Could not find service: shared-file-system.: keystone.exception.ServiceNotFound: Could not find service: shared-file-system. May 28 12:42:51 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:42:51 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 28 12:42:51 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 28 12:42:51 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 194, in get_service May 28 12:42:51 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 28 12:42:51 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 189, in _get_service May 28 12:42:51 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 28 12:42:51 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: shared-file-system. May 28 12:42:51 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 12:42:51 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 28 12:42:51 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 12:42:51 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:42:51 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:42:51 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:42:51 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:42:51 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:42:51 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:42:51 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:42:51 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:42:51 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:42:51 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:42:51 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:42:51 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 28 12:42:51 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._get_service(service_id) May 28 12:42:51 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 28 12:42:51 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 28 12:42:51 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:42:51 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:42:51 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:42:51 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:42:51 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:42:51 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:42:51 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:42:51 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 12:42:51 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:42:51 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 12:42:51 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:42:51 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:42:51 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:42:51 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 12:42:51 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:42:51 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 12:42:51 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 28 12:42:51 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 28 12:42:51 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: shared-file-system. May 28 12:42:51 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 12:42:51 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 424/863] 10.27.203.238 () {60 vars in 1232 bytes} [Tue May 28 12:42:51 2024] GET /identity/v3/services/shared-file-system => generated 99 bytes in 89 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 28 12:42:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4360d39-66cb-4c00-956e-0f1f46c7639f None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:42:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4360d39-66cb-4c00-956e-0f1f46c7639f None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:42:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2876e6-2ae1-4534-bc22-cbbe22dea008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:42:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2876e6-2ae1-4534-bc22-cbbe22dea008 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:42:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2876e6-2ae1-4534-bc22-cbbe22dea008 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:42:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2876e6-2ae1-4534-bc22-cbbe22dea008 None admin] PATH_INFO: `/v3/services` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:42:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2876e6-2ae1-4534-bc22-cbbe22dea008 None admin] RBAC: Adding query filter params (name=shared-file-system) {{(pid=51267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:42:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2876e6-2ae1-4534-bc22-cbbe22dea008 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:42:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2876e6-2ae1-4534-bc22-cbbe22dea008 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:42:51 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 440/864] 10.27.203.238 () {60 vars in 1222 bytes} [Tue May 28 12:42:51 2024] GET /identity/v3/services?name=shared-file-system => generated 447 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:42:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dbbac2-347c-4e7f-8c8b-ea4063486429 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:42:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dbbac2-347c-4e7f-8c8b-ea4063486429 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:42:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80364d1-3e4f-4b6e-8249-3e8ac19940e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'manager', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:42:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80364d1-3e4f-4b6e-8249-3e8ac19940e7 None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:42:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80364d1-3e4f-4b6e-8249-3e8ac19940e7 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:42:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80364d1-3e4f-4b6e-8249-3e8ac19940e7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:42:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80364d1-3e4f-4b6e-8249-3e8ac19940e7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:42:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80364d1-3e4f-4b6e-8249-3e8ac19940e7 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:42:52 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 425/865] 10.27.203.238 () {64 vars in 1232 bytes} [Tue May 28 12:42:51 2024] POST /identity/v3/endpoints => generated 334 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:42:52 l75lg1-v1 dstat.sh[49771]: 28-05 12:42:52| 9 1 89 0 0|1555M 7980M 267M 5897M| 13k 0 | 0 1041k| 0 168 |2659 4368 |1.68 1.94 1.26|1.0 0 0| 0 0 | 0 2048M| 19 33 0 3 0 May 28 12:42:53 l75lg1-v1 dstat.sh[49771]: 28-05 12:42:53| 3 9 87 0 0|1521M 8014M 267M 5898M| 27k 53k| 0 576k| 0 34.0 |5437 5668 |1.68 1.94 1.26|1.0 0 587| 0 0 | 0 2048M| 19 33 0 3 0 May 28 12:42:54 l75lg1-v1 dstat.sh[49771]: 28-05 12:42:54| 5 8 87 0 0|1532M 8003M 267M 5898M| 19k 12k| 68k 296k|17.0 27.0 |5933 7561 |1.68 1.94 1.26|1.0 0 347| 0 0 | 0 2048M| 19 33 0 3 0 May 28 12:42:54 l75lg1-v1 devstack@n-api.service[73998]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 28 12:42:54 l75lg1-v1 devstack@n-api.service[73998]: *** Starting uWSGI 2.0.20-debian (64bit) on [Tue May 28 12:42:54 2024] *** May 28 12:42:54 l75lg1-v1 devstack@n-api.service[73998]: compiled with version: 11.2.0 on 21 March 2022 11:00:44 May 28 12:42:54 l75lg1-v1 devstack@n-api.service[73998]: os: Linux-5.15.0-56-generic #62-Ubuntu SMP Tue Nov 22 19:54:14 UTC 2022 May 28 12:42:54 l75lg1-v1 devstack@n-api.service[73998]: nodename: l75lg1-v1 May 28 12:42:54 l75lg1-v1 devstack@n-api.service[73998]: machine: x86_64 May 28 12:42:54 l75lg1-v1 devstack@n-api.service[73998]: clock source: unix May 28 12:42:54 l75lg1-v1 devstack@n-api.service[73998]: pcre jit disabled May 28 12:42:54 l75lg1-v1 devstack@n-api.service[73998]: detected number of CPU cores: 10 May 28 12:42:54 l75lg1-v1 devstack@n-api.service[73998]: current working directory: / May 28 12:42:54 l75lg1-v1 devstack@n-api.service[73998]: detected binary path: /usr/bin/uwsgi-core May 28 12:42:54 l75lg1-v1 devstack@n-api.service[73998]: your processes number limit is 63557 May 28 12:42:54 l75lg1-v1 devstack@n-api.service[73998]: your memory page size is 4096 bytes May 28 12:42:54 l75lg1-v1 devstack@n-api.service[73998]: detected max file descriptor number: 2048 May 28 12:42:54 l75lg1-v1 devstack@n-api.service[73998]: lock engine: pthread robust mutexes May 28 12:42:54 l75lg1-v1 devstack@n-api.service[73998]: thunder lock: enabled May 28 12:42:54 l75lg1-v1 devstack@n-api.service[73998]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api.socket fd 4 May 28 12:42:54 l75lg1-v1 devstack@n-api.service[73998]: Python version: 3.10.12 (main, Nov 20 2023, 15:14:05) [GCC 11.4.0] May 28 12:42:54 l75lg1-v1 devstack@n-api.service[73998]: PEP 405 virtualenv detected: /opt/stack/data/venv May 28 12:42:54 l75lg1-v1 devstack@n-api.service[73998]: Set PythonHome to /opt/stack/data/venv May 28 12:42:54 l75lg1-v1 devstack@n-api.service[73998]: Python main interpreter initialized at 0x563b07316b90 May 28 12:42:54 l75lg1-v1 devstack@n-api.service[73998]: python threads support enabled May 28 12:42:54 l75lg1-v1 devstack@n-api.service[73998]: your server socket listen backlog is limited to 100 connections May 28 12:42:54 l75lg1-v1 devstack@n-api.service[73998]: your mercy for graceful operations on workers is 80 seconds May 28 12:42:54 l75lg1-v1 devstack@n-api.service[73998]: mapped 403077 bytes (393 KB) for 2 cores May 28 12:42:54 l75lg1-v1 devstack@n-api.service[73998]: *** Operational MODE: preforking *** May 28 12:42:54 l75lg1-v1 devstack@n-api.service[73998]: *** uWSGI is running in multiple interpreter mode *** May 28 12:42:54 l75lg1-v1 devstack@n-api.service[73998]: spawned uWSGI master process (pid: 73998) May 28 12:42:54 l75lg1-v1 devstack@n-api.service[73998]: spawned uWSGI worker 1 (pid: 73999, cores: 1) May 28 12:42:54 l75lg1-v1 devstack@n-api.service[73998]: spawned uWSGI worker 2 (pid: 74000, cores: 1) May 28 12:42:54 l75lg1-v1 devstack@n-api.service[73998]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 28 12:42:55 l75lg1-v1 dstat.sh[49771]: 28-05 12:42:55| 11 4 84 0 0|1559M 7976M 267M 5898M| 14k 5974B| 68k 20k|17.0 4.00 |5836 7588 |1.68 1.94 1.26|2.0 0 107| 0 0 | 0 2048M| 19 34 0 3 0 May 28 12:42:56 l75lg1-v1 dstat.sh[49771]: 28-05 12:42:56| 19 2 80 0 0|1613M 7922M 267M 5898M| 14k 214B| 0 236k| 0 2.00 |1419 1303 |1.68 1.94 1.26|3.0 0 0| 0 0 | 0 2048M| 19 34 0 3 0 May 28 12:42:57 l75lg1-v1 dstat.sh[49771]: 28-05 12:42:57| 19 1 80 0 0|1697M 7838M 267M 5899M|9831B 0 | 0 368k| 0 35.0 |1336 1316 |1.71 1.94 1.27|2.0 0 0| 0 0 | 0 2048M| 19 34 0 3 0 May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2600}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2601}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2603}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2605}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2600}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2601}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] console_host = l75lg1-v1 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2603}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2605}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] default_green_pool_size = 1000 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] console_host = l75lg1-v1 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] host = l75lg1-v1 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] default_green_pool_size = 1000 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] host = l75lg1-v1 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.27.203.238 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.27.203.238 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.27.203.238 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.27.203.238 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 120 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 720 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 120 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 720 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] cache.enforce_fips_mode = False {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = **** {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] cache.enforce_fips_mode = False {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] cache.redis_password = **** {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] cache.redis_sentinel_service_name = mymaster {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] cache.redis_sentinels = ['localhost:26379'] {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] cache.redis_server = localhost:6379 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] cache.redis_socket_timeout = 1.0 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = **** {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] cache.redis_username = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] cache.redis_password = **** {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] cache.redis_sentinel_service_name = mymaster {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] cache.redis_sentinels = ['localhost:26379'] {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] cache.redis_server = localhost:6379 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] cache.redis_socket_timeout = 1.0 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] cache.redis_username = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.enforce_session_timeout = False {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.retriable_status_codes = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.enforce_session_timeout = False {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.retriable_status_codes = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.default_format = luks {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.default_format = luks {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] glance.retriable_status_codes = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] glance.retriable_status_codes = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] ironic.conductor_group = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] ironic.retriable_status_codes = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] ironic.shard = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.conductor_group = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.retriable_status_codes = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.shard = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_path = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] keystone.auth_section = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] keystone.auth_type = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_path = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] keystone.retriable_status_codes = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] keystone.auth_section = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] keystone.auth_type = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] keystone.retriable_status_codes = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: live_migration_uri is deprecated for removal in favor of two other options that May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: allow to change live migration scheme and target URI: ``live_migration_scheme`` May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: and ``live_migration_inbound_addr`` respectively. May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: ). Its value may be silently ignored in the future. May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://vastdata@%s/system {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.migration_inbound_addr = 10.27.203.238 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: live_migration_uri is deprecated for removal in favor of two other options that May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: allow to change live migration scheme and target URI: ``live_migration_scheme`` May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: and ``live_migration_inbound_addr`` respectively. May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: ). Its value may be silently ignored in the future. May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://vastdata@%s/system {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.migration_inbound_addr = 10.27.203.238 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tb_cache_size = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = qemu {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tb_cache_size = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = qemu {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] neutron.retriable_status_codes = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.retriable_status_codes = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] placement.retriable_status_codes = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] placement.retriable_status_codes = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = True {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = True {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = **** {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = True {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = True {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_requests = False {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] profiler_jaeger.process_tags = {} {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] profiler_jaeger.service_name_prefix = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] profiler_otlp.service_name_prefix = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = **** {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.retriable_status_codes = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_requests = False {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] profiler_jaeger.process_tags = {} {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] profiler_jaeger.service_name_prefix = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] profiler_otlp.service_name_prefix = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.hostname = l75lg1-v1 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.retriable_status_codes = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.processname = uwsgi {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.hostname = l75lg1-v1 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.processname = uwsgi {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.use_queue_manager = False {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=74000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2624}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.use_queue_manager = False {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=73999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2624}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: INFO dbcounter [None req-05d0d265-71fe-4459-b94b-819ae5ab8130 None None] Registered counter for database nova_api May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: INFO dbcounter [None req-dd394c5a-683a-42d1-8b47-9abb064b3581 None None] Registered counter for database nova_api May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG oslo_db.sqlalchemy.engines [None req-05d0d265-71fe-4459-b94b-819ae5ab8130 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=74000) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:342}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG oslo_db.sqlalchemy.engines [None req-dd394c5a-683a-42d1-8b47-9abb064b3581 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73999) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:342}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG dbcounter [-] [74000] Writer thread running {{(pid=74000) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.context [None req-05d0d265-71fe-4459-b94b-819ae5ab8130 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),07f8d545-d202-434b-a916-12ac42ffae61(cell1) {{(pid=74000) load_cells /opt/stack/nova/nova/context.py:464}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG dbcounter [-] [73999] Writer thread running {{(pid=73999) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG oslo_concurrency.lockutils [None req-05d0d265-71fe-4459-b94b-819ae5ab8130 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=74000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG oslo_concurrency.lockutils [None req-05d0d265-71fe-4459-b94b-819ae5ab8130 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=74000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG oslo_concurrency.lockutils [None req-05d0d265-71fe-4459-b94b-819ae5ab8130 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=74000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG oslo_concurrency.lockutils [None req-05d0d265-71fe-4459-b94b-819ae5ab8130 None None] Acquiring lock "07f8d545-d202-434b-a916-12ac42ffae61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=74000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG oslo_concurrency.lockutils [None req-05d0d265-71fe-4459-b94b-819ae5ab8130 None None] Lock "07f8d545-d202-434b-a916-12ac42ffae61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=74000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.context [None req-dd394c5a-683a-42d1-8b47-9abb064b3581 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),07f8d545-d202-434b-a916-12ac42ffae61(cell1) {{(pid=73999) load_cells /opt/stack/nova/nova/context.py:464}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG oslo_concurrency.lockutils [None req-05d0d265-71fe-4459-b94b-819ae5ab8130 None None] Lock "07f8d545-d202-434b-a916-12ac42ffae61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=74000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: INFO dbcounter [None req-05d0d265-71fe-4459-b94b-819ae5ab8130 None None] Registered counter for database nova_cell0 May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG oslo_concurrency.lockutils [None req-dd394c5a-683a-42d1-8b47-9abb064b3581 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=73999) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG oslo_concurrency.lockutils [None req-dd394c5a-683a-42d1-8b47-9abb064b3581 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=73999) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG oslo_concurrency.lockutils [None req-dd394c5a-683a-42d1-8b47-9abb064b3581 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=73999) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG oslo_concurrency.lockutils [None req-dd394c5a-683a-42d1-8b47-9abb064b3581 None None] Acquiring lock "07f8d545-d202-434b-a916-12ac42ffae61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=73999) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG oslo_concurrency.lockutils [None req-dd394c5a-683a-42d1-8b47-9abb064b3581 None None] Lock "07f8d545-d202-434b-a916-12ac42ffae61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=73999) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: INFO dbcounter [None req-05d0d265-71fe-4459-b94b-819ae5ab8130 None None] Registered counter for database nova_cell1 May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG oslo_concurrency.lockutils [None req-dd394c5a-683a-42d1-8b47-9abb064b3581 None None] Lock "07f8d545-d202-434b-a916-12ac42ffae61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=73999) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: INFO dbcounter [None req-dd394c5a-683a-42d1-8b47-9abb064b3581 None None] Registered counter for database nova_cell0 May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: INFO dbcounter [None req-dd394c5a-683a-42d1-8b47-9abb064b3581 None None] Registered counter for database nova_cell1 May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG oslo_db.sqlalchemy.engines [None req-05d0d265-71fe-4459-b94b-819ae5ab8130 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=74000) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:342}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG oslo_db.sqlalchemy.engines [None req-05d0d265-71fe-4459-b94b-819ae5ab8130 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=74000) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:342}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG oslo_db.sqlalchemy.engines [None req-dd394c5a-683a-42d1-8b47-9abb064b3581 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73999) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:342}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG oslo_db.sqlalchemy.engines [None req-dd394c5a-683a-42d1-8b47-9abb064b3581 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73999) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:342}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG dbcounter [-] [74000] Writer thread running {{(pid=74000) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG dbcounter [-] [74000] Writer thread running {{(pid=74000) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG dbcounter [-] [73999] Writer thread running {{(pid=73999) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: INFO dbcounter [None req-05d0d265-71fe-4459-b94b-819ae5ab8130 None None] Registered counter for database nova_cell0 May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG dbcounter [-] [73999] Writer thread running {{(pid=73999) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG oslo_db.sqlalchemy.engines [None req-05d0d265-71fe-4459-b94b-819ae5ab8130 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=74000) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:342}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: INFO dbcounter [None req-dd394c5a-683a-42d1-8b47-9abb064b3581 None None] Registered counter for database nova_cell0 May 28 12:42:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG dbcounter [-] [74000] Writer thread running {{(pid=74000) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG oslo_db.sqlalchemy.engines [None req-dd394c5a-683a-42d1-8b47-9abb064b3581 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73999) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:342}} May 28 12:42:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG dbcounter [-] [73999] Writer thread running {{(pid=73999) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} May 28 12:42:58 l75lg1-v1 dstat.sh[49771]: 28-05 12:42:58| 20 2 77 0 0|1732M 7801M 267M 5900M| 15k 0 | 0 488k| 0 22.0 |2114 9140 |1.71 1.94 1.27|2.0 0 7.0| 0 0 | 0 2048M| 19 50 0 3 0 May 28 12:42:58 l75lg1-v1 devstack@n-api.service[74000]: DEBUG oslo_concurrency.processutils [None req-05d0d265-71fe-4459-b94b-819ae5ab8130 None None] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=74000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:390}} May 28 12:42:58 l75lg1-v1 devstack@n-api.service[73999]: DEBUG oslo_concurrency.processutils [None req-dd394c5a-683a-42d1-8b47-9abb064b3581 None None] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=73999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:390}} May 28 12:42:58 l75lg1-v1 devstack@n-api.service[74000]: DEBUG oslo_concurrency.processutils [None req-05d0d265-71fe-4459-b94b-819ae5ab8130 None None] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.011s {{(pid=74000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:428}} May 28 12:42:58 l75lg1-v1 devstack@n-api.service[73999]: DEBUG oslo_concurrency.processutils [None req-dd394c5a-683a-42d1-8b47-9abb064b3581 None None] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.011s {{(pid=73999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:428}} May 28 12:42:58 l75lg1-v1 devstack@n-api.service[74000]: WARNING keystonemiddleware.auth_token [None req-05d0d265-71fe-4459-b94b-819ae5ab8130 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 28 12:42:59 l75lg1-v1 devstack@n-api.service[74000]: WARNING keystonemiddleware.auth_token [None req-05d0d265-71fe-4459-b94b-819ae5ab8130 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 28 12:42:59 l75lg1-v1 devstack@n-api.service[73999]: WARNING keystonemiddleware.auth_token [None req-dd394c5a-683a-42d1-8b47-9abb064b3581 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 28 12:42:59 l75lg1-v1 devstack@n-api.service[73999]: WARNING keystonemiddleware.auth_token [None req-dd394c5a-683a-42d1-8b47-9abb064b3581 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 28 12:42:59 l75lg1-v1 devstack@n-api.service[74000]: WARNING keystonemiddleware.auth_token [None req-05d0d265-71fe-4459-b94b-819ae5ab8130 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 28 12:42:59 l75lg1-v1 devstack@n-api.service[74000]: WARNING keystonemiddleware.auth_token [None req-05d0d265-71fe-4459-b94b-819ae5ab8130 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 28 12:42:59 l75lg1-v1 devstack@n-api.service[74000]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x563b07316b90 pid: 74000 (default app) May 28 12:42:59 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi [None req-05d0d265-71fe-4459-b94b-819ae5ab8130 None None] Calling method '>' {{(pid=74000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} May 28 12:42:59 l75lg1-v1 devstack@n-api.service[74000]: INFO nova.api.openstack.requestlog [None req-05d0d265-71fe-4459-b94b-819ae5ab8130 None None] 10.27.203.238 "GET /compute/v2.1/" status: 200 len: 390 microversion: 2.1 time: 0.001275 May 28 12:42:59 l75lg1-v1 devstack@n-api.service[74000]: [pid: 74000|app: 0|req: 1/1] 10.27.203.238 () {54 vars in 871 bytes} [Tue May 28 12:42:59 2024] GET /compute/v2.1/ => generated 390 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 12:42:59 l75lg1-v1 devstack@n-api.service[73999]: WARNING keystonemiddleware.auth_token [None req-dd394c5a-683a-42d1-8b47-9abb064b3581 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 28 12:42:59 l75lg1-v1 devstack@n-api.service[73999]: WARNING keystonemiddleware.auth_token [None req-dd394c5a-683a-42d1-8b47-9abb064b3581 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 28 12:42:59 l75lg1-v1 devstack@n-api.service[73999]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x563b07316b90 pid: 73999 (default app) May 28 12:42:59 l75lg1-v1 dstat.sh[49771]: 28-05 12:42:59| 18 2 80 0 0|1775M 7757M 267M 5901M| 15k 4817B| 0 1875k| 0 124 |2174 2181 |1.71 1.94 1.27|1.0 0 60| 0 0 | 0 2048M| 19 49 0 3 0 May 28 12:43:00 l75lg1-v1 dstat.sh[49771]: 28-05 12:43:00| 7 7 86 0 0|1787M 7745M 267M 5902M| 17k 9428B| 136k 136k|34.0 9.01 |7010 10k|1.71 1.94 1.27|1.0 0 227| 0 0 | 0 2048M| 19 49 0 3 0 May 28 12:43:01 l75lg1-v1 dstat.sh[49771]: 28-05 12:43:01| 1 1 98 0 0|1787M 7745M 267M 5901M| 16k 1027B| 0 96k| 0 13.0 |2151 2460 |1.71 1.94 1.27|1.0 0 25| 0 0 | 0 2048M| 19 49 0 3 0 May 28 12:43:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG dbcounter [-] [51267] Writing DB stats keystone:SELECT=1604,keystone:INSERT=7 {{(pid=51267) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:43:02 l75lg1-v1 devstack@keystone.service[51266]: DEBUG dbcounter [-] [51266] Writing DB stats keystone:SELECT=1553,keystone:INSERT=5 {{(pid=51266) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:43:02 l75lg1-v1 dstat.sh[49771]: 28-05 12:43:02| 0 0 99 1 0|1787M 7745M 267M 5901M| 12k 0 | 0 6388k| 0 322 | 942 1318 |1.57 1.91 1.26|1.0 0 3.0| 0 0 | 0 2048M| 19 49 0 3 0 May 28 12:43:03 l75lg1-v1 dstat.sh[49771]: 28-05 12:43:03| 0 0 100 0 0|1787M 7745M 267M 5901M| 10k 0 | 0 604k| 0 73.0 | 851 1144 |1.57 1.91 1.26| 0 0 3.0| 0 0 | 0 2048M| 19 49 0 3 0 May 28 12:43:04 l75lg1-v1 dstat.sh[49771]: 28-05 12:43:04| 0 0 99 1 0|1787M 7745M 267M 5901M| 15k 172B| 0 2192k| 0 126 |1144 1687 |1.57 1.91 1.26|1.0 0 1.0| 0 0 | 0 2048M| 19 49 0 3 0 May 28 12:43:05 l75lg1-v1 dstat.sh[49771]: 28-05 12:43:05| 4 3 92 0 0|1667M 7864M 267M 5902M| 12k 388B| 68k 4097B|17.0 1.00 |3753 5335 |1.57 1.91 1.26|1.0 0 139| 0 0 | 0 2048M| 19 49 0 3 0 May 28 12:43:06 l75lg1-v1 dstat.sh[49771]: 28-05 12:43:06| 7 7 86 0 0|1779M 7753M 267M 5902M| 11k 5160B| 68k 0 |17.0 0 |6229 7491 |1.57 1.91 1.26|1.0 0 228| 0 0 | 0 2048M| 20 49 0 3 0 May 28 12:43:07 l75lg1-v1 dstat.sh[49771]: 28-05 12:43:07| 8 6 86 0 0|1785M 7746M 267M 5902M| 12k 6241B| 136k 4098B|34.0 1.00 |5264 9915 |1.52 1.89 1.26|1.0 0 157| 0 0 | 0 2048M| 20 49 0 3 0 May 28 12:43:08 l75lg1-v1 dstat.sh[49771]: 28-05 12:43:08| 2 2 95 0 0|1777M 7754M 267M 5902M| 16k 973B| 0 236k| 0 15.0 |2914 3306 |1.52 1.89 1.26| 0 0 143| 0 0 | 0 2048M| 20 49 0 3 0 May 28 12:43:09 l75lg1-v1 dstat.sh[49771]: 28-05 12:43:09| 7 5 87 0 0|1787M 7745M 267M 5902M| 13k 6704B| 136k 4096B|34.0 1.00 |6395 9103 |1.52 1.89 1.26|1.0 0 152| 0 0 | 0 2048M| 22 51 0 3 0 May 28 12:43:10 l75lg1-v1 dstat.sh[49771]: 28-05 12:43:10| 4 7 89 0 0|1791M 7741M 267M 5902M| 16k 20k| 0 92k| 0 18.0 |5408 6034 |1.52 1.89 1.26|1.0 0 389| 0 0 | 0 2048M| 22 51 0 4 0 May 28 12:43:11 l75lg1-v1 dstat.sh[49771]: 28-05 12:43:11| 8 5 86 0 0|1790M 7742M 267M 5902M| 18k 4738B| 136k 4096B|34.0 1.00 |7485 11k|1.52 1.89 1.26|2.0 0 141| 0 0 | 0 2048M| 22 51 0 4 0 May 28 12:43:12 l75lg1-v1 dstat.sh[49771]: 28-05 12:43:12| 16 8 76 0 0|1847M 7684M 267M 5902M| 12k 9081B| 136k 64k|34.0 8.00 |7237 10k|1.56 1.89 1.26|2.0 0 221| 0 0 | 0 2048M| 22 51 0 4 0 May 28 12:43:13 l75lg1-v1 dstat.sh[49771]: 28-05 12:43:13| 10 2 88 0 0|1886M 7645M 267M 5902M|8824B 1028B| 0 292k| 0 8.00 |2286 2540 |1.56 1.89 1.26|1.0 0 24| 0 0 | 0 2048M| 22 51 0 4 0 May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: INFO neutron.common.config [-] Logging enabled! May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-ovn-metadata-agent version 24.1.0.dev130 May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-ovn-metadata-agent --config-file /etc/neutron/neutron_ovn_metadata_agent.ini {{(pid=75705) setup_logging /opt/stack/neutron/neutron/common/config.py:123}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] ******************************************************************************** {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2600}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] Configuration options gathered from: {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2601}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] command line args: ['--config-file', '/etc/neutron/neutron_ovn_metadata_agent.ini'] {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] config files: ['/etc/neutron/neutron_ovn_metadata_agent.ini'] {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2603}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] ================================================================================ {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2605}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] agent_down_time = 75 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] allow_bulk = True {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] api_extensions_path = {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] api_paste_config = api-paste.ini {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] api_workers = None {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] auth_ca_cert = None {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] auth_strategy = keystone {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] backlog = 4096 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] base_mac = fa:16:3e:00:00:00 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] bind_host = 0.0.0.0 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] bind_port = 9696 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] client_socket_timeout = 900 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] config_dir = [] {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] config_file = ['/etc/neutron/neutron_ovn_metadata_agent.ini'] {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] config_source = [] {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] control_exchange = neutron {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] core_plugin = None {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] debug = True {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] default_availability_zones = [] {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] dhcp_agent_notification = True {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] dhcp_lease_duration = 86400 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] dhcp_load_type = networks {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] dns_domain = openstacklocal {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] enable_new_agents = True {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] enable_signals = True {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] enable_traditional_dhcp = True {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] external_dns_driver = None {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] external_pids = /opt/stack/data/neutron/external/pids {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] filter_validation = True {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] global_physnet_mtu = 1500 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] host = l75lg1-v1 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] http_retries = 3 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] instance_format = [instance: %(uuid)s] {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] ipam_driver = internal {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] ipv6_pd_enabled = False {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] log_config_append = None {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] log_dir = None {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] log_file = None {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] log_rotate_interval = 1 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] log_rotate_interval_type = days {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] log_rotation_type = none {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] max_dns_nameservers = 5 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] max_header_line = 16384 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] max_logfile_count = 30 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] max_logfile_size_mb = 200 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] max_subnet_host_routes = 20 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] metadata_backlog = 4096 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] metadata_proxy_group = {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] metadata_proxy_shared_secret = **** {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] metadata_proxy_socket = /opt/stack/data/neutron/metadata_proxy {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] metadata_proxy_socket_mode = deduce {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] metadata_proxy_user = {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] metadata_workers = 2 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] my_ip = 10.27.203.238 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] my_ipv6 = 2001:67c:9b4:1::1014 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] network_link_prefix = None {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] notify_nova_on_port_data_changes = True {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] notify_nova_on_port_status_changes = True {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] nova_client_cert = {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] nova_client_priv_key = {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] nova_metadata_host = 10.27.203.238 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] nova_metadata_insecure = False {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] nova_metadata_port = 8775 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] nova_metadata_protocol = http {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] pagination_max_limit = -1 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] periodic_fuzzy_delay = 5 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] periodic_interval = 40 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] publish_errors = False {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] rate_limit_burst = 0 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] rate_limit_except_level = CRITICAL {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] rate_limit_interval = 0 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] retry_until_window = 30 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] rpc_resources_processing_step = 20 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] rpc_response_max_timeout = 600 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] rpc_state_report_workers = 1 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] rpc_workers = None {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] send_events_interval = 2 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] service_plugins = [] {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] setproctitle = on {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] state_path = /opt/stack/data/neutron {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] syslog_log_facility = LOG_USER {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] tcp_keepidle = 600 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] transport_url = **** {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] use_eventlog = False {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] use_journal = False {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] use_json = False {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] use_ssl = False {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] use_stderr = False {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] use_syslog = False {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] vlan_transparent = False {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] watch_log_file = False {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] wsgi_default_pool_size = 100 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] wsgi_keep_alive = True {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] wsgi_server_debug = False {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] oslo_concurrency.disable_process_locking = False {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] oslo_concurrency.lock_path = None {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] profiler.connection_string = messaging:// {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] profiler.enabled = False {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] profiler.es_doc_type = notification {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] profiler.es_scroll_size = 10000 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] profiler.es_scroll_time = 2m {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] profiler.filter_error_trace = False {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] profiler.hmac_keys = **** {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] profiler.sentinel_service_name = mymaster {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] profiler.socket_timeout = 0.1 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] profiler.trace_requests = False {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] profiler.trace_sqlalchemy = False {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] profiler_jaeger.process_tags = {} {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] profiler_jaeger.service_name_prefix = None {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] profiler_otlp.service_name_prefix = None {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] oslo_policy.enforce_new_defaults = True {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] oslo_policy.enforce_scope = True {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] oslo_policy.policy_default_rule = default {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] oslo_policy.policy_file = policy.yaml {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] oslo_messaging_metrics.metrics_process_name = {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] service_providers.service_provider = [] {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] privsep.group = None {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] privsep.helper_command = None {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] privsep.logger_name = oslo_privsep.daemon {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] privsep.thread_pool_size = 10 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] privsep.user = None {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] privsep_dhcp_release.capabilities = [21, 12] {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] privsep_dhcp_release.group = None {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] privsep_dhcp_release.helper_command = None {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] privsep_dhcp_release.thread_pool_size = 10 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] privsep_dhcp_release.user = None {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] privsep_ovs_vsctl.group = None {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] privsep_ovs_vsctl.helper_command = None {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] privsep_ovs_vsctl.thread_pool_size = 10 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] privsep_ovs_vsctl.user = None {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] privsep_namespace.capabilities = [21] {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] privsep_namespace.group = None {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] privsep_namespace.helper_command = None {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] privsep_namespace.thread_pool_size = 10 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] privsep_namespace.user = None {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] privsep_conntrack.capabilities = [12] {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] privsep_conntrack.group = None {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] privsep_conntrack.helper_command = None {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] privsep_conntrack.thread_pool_size = 10 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] privsep_conntrack.user = None {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] privsep_link.capabilities = [12, 21] {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] privsep_link.group = None {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] privsep_link.helper_command = None {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] privsep_link.logger_name = oslo_privsep.daemon {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] privsep_link.thread_pool_size = 10 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] privsep_link.user = None {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] AGENT.check_child_processes_action = respawn {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] AGENT.check_child_processes_interval = 60 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] AGENT.comment_iptables_rules = True {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] AGENT.debug_iptables_rules = False {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] AGENT.kill_scripts_path = /etc/neutron/kill_scripts/ {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] AGENT.root_helper = sudo /opt/stack/data/venv/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] AGENT.root_helper_daemon = sudo /opt/stack/data/venv/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] AGENT.use_helper_for_ns_read = True {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] AGENT.use_random_fully = True {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] OVS.bridge_mac_table_size = 50000 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] OVS.bridge_mappings = [] {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] OVS.datapath_type = system {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] OVS.igmp_flood = False {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] OVS.igmp_flood_reports = True {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] OVS.igmp_flood_unregistered = False {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] OVS.igmp_snooping_enable = False {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] OVS.int_peer_patch_port = patch-tun {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] OVS.integration_bridge = br-int {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] OVS.local_ip = None {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] OVS.of_connect_timeout = 300 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] OVS.of_inactivity_probe = 10 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] OVS.of_listen_address = 127.0.0.1 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] OVS.of_listen_port = 6633 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] OVS.of_request_timeout = 300 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] OVS.openflow_processed_per_port = False {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] OVS.ovsdb_connection = tcp:127.0.0.1:6640 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] OVS.ovsdb_debug = False {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] OVS.ovsdb_timeout = 10 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] OVS.resource_provider_bandwidths = [] {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] OVS.resource_provider_default_hypervisor = None {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] OVS.resource_provider_hypervisors = {} {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] OVS.resource_provider_inventory_defaults = {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0} {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] OVS.resource_provider_packet_processing_inventory_defaults = {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0} {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] OVS.resource_provider_packet_processing_with_direction = [] {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] OVS.resource_provider_packet_processing_without_direction = [] {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] OVS.ssl_ca_cert_file = None {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] OVS.ssl_cert_file = None {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] OVS.ssl_key_file = None {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] OVS.tun_peer_patch_port = patch-int {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] OVS.tunnel_bridge = br-tun {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] OVS.vhostuser_socket_dir = /var/run/openvswitch {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] QUOTAS.default_quota = -1 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] QUOTAS.quota_network = 100 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] QUOTAS.quota_port = 500 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] QUOTAS.quota_security_group = 10 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] QUOTAS.quota_security_group_rule = 100 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] QUOTAS.quota_subnet = 100 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] QUOTAS.track_quota_usage = True {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] agent.extensions = [] {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] nova.auth_section = None {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] nova.auth_type = None {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] nova.cafile = None {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] nova.certfile = None {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] nova.collect_timing = False {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] nova.endpoint_type = public {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] nova.insecure = False {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] nova.keyfile = None {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] nova.region_name = None {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] nova.split_loggers = False {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] nova.timeout = None {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] placement.auth_section = None {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] placement.auth_type = None {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] placement.cafile = None {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] placement.certfile = None {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] placement.collect_timing = False {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] placement.endpoint_type = public {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] placement.insecure = False {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] placement.keyfile = None {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] placement.region_name = None {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] placement.split_loggers = False {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] placement.timeout = None {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] ironic.auth_section = None {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] ironic.auth_type = None {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] ironic.cafile = None {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] ironic.certfile = None {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] ironic.collect_timing = False {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] ironic.connect_retries = None {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] ironic.connect_retry_delay = None {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] ironic.enable_notifications = False {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] ironic.endpoint_override = None {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] ironic.insecure = False {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] ironic.interface = None {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] ironic.keyfile = None {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] ironic.max_version = None {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] ironic.min_version = None {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] ironic.region_name = None {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] ironic.retriable_status_codes = None {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] ironic.service_name = None {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] ironic.service_type = None {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] ironic.split_loggers = False {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] ironic.status_code_retries = None {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] ironic.status_code_retry_delay = None {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] ironic.timeout = None {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] ironic.valid_interfaces = None {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] ironic.version = None {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] cli_script.dry_run = False {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] ovn.allow_stateless_action_supported = True {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] ovn.dhcp_default_lease_time = 43200 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] ovn.disable_ovn_dhcp_for_baremetal_ports = False {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] ovn.dns_servers = [] {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] ovn.enable_distributed_floating_ip = False {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] ovn.fdb_age_threshold = 0 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] ovn.localnet_learn_fdb = False {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] ovn.mac_binding_age_threshold = 0 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] ovn.neutron_sync_mode = log {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] ovn.ovn_dhcp4_global_options = {} {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] ovn.ovn_dhcp6_global_options = {} {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] ovn.ovn_emit_need_to_frag = False {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] ovn.ovn_l3_scheduler = leastloaded {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] ovn.ovn_metadata_enabled = False {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] ovn.ovn_nb_ca_cert = {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] ovn.ovn_nb_certificate = {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] ovn.ovn_nb_connection = tcp:127.0.0.1:6641 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] ovn.ovn_nb_private_key = {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] ovn.ovn_sb_ca_cert = {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] ovn.ovn_sb_certificate = {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] ovn.ovn_sb_connection = tcp:10.27.203.238:6642 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] ovn.ovn_sb_private_key = {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] ovn.ovsdb_connection_timeout = 180 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] ovn.ovsdb_log_level = INFO {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] ovn.ovsdb_probe_interval = 60000 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] ovn.ovsdb_retry_max_interval = 180 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] ovn.vhost_sock_dir = /var/run/openvswitch {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] ovn_nb_global.fdb_removal_limit = 0 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] ovn_nb_global.ignore_lsp_down = False {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] ovn_nb_global.mac_binding_removal_limit = 0 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] metadata_rate_limiting.base_query_rate_limit = 10 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] metadata_rate_limiting.base_window_duration = 10 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] metadata_rate_limiting.burst_query_rate_limit = 10 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] metadata_rate_limiting.burst_window_duration = 10 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] metadata_rate_limiting.ip_versions = [4] {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] metadata_rate_limiting.rate_limit_enabled = False {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] ovs.ovsdb_connection = tcp:127.0.0.1:6640 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] ovs.ovsdb_connection_timeout = 180 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] oslo_messaging_rabbit.hostname = l75lg1-v1 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] oslo_messaging_rabbit.processname = neutron-ovn-metadata-agent {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] oslo_messaging_rabbit.ssl = False {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] oslo_messaging_rabbit.ssl_version = {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] oslo_messaging_notifications.driver = [] {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] oslo_messaging_notifications.retry = -1 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] oslo_messaging_notifications.transport_url = **** {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata_agent [-] ******************************************************************************** {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2624}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG ovsdbapp.backend.ovs_idl [-] Created schema index Bridge.name {{(pid=75705) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG ovsdbapp.backend.ovs_idl [-] Created schema index Port.name {{(pid=75705) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG ovsdbapp.backend.ovs_idl [-] Created schema index Interface.name {{(pid=75705) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: INFO ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: connecting... May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: INFO ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: connected May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron.agent.ovn.metadata.agent [-] Loaded chassis name 0da8323f-64af-4526-b223-049f5737145a (UUID: 0da8323f-64af-4526-b223-049f5737145a) and ovn bridge br-int. {{(pid=75705) _load_config /opt/stack/neutron/neutron/agent/ovn/metadata/agent.py:419}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: INFO neutron.agent.ovn.metadata.ovsdb [-] Getting OvsdbSbOvnIdl for MetadataAgent with retry May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG ovsdbapp.backend.ovs_idl [-] Created lookup_table index Chassis.name {{(pid=75705) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:87}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG ovsdbapp.backend.ovs_idl [-] Created lookup_table index Port_Binding.logical_port {{(pid=75705) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:87}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG ovsdbapp.backend.ovs_idl [-] Created schema index Datapath_Binding.tunnel_key {{(pid=75705) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG ovsdbapp.backend.ovs_idl [-] Created schema index Chassis_Private.name {{(pid=75705) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: INFO ovsdbapp.backend.ovs_idl.vlog [-] tcp:10.27.203.238:6642: connecting... May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: INFO ovsdbapp.backend.ovs_idl.vlog [-] tcp:10.27.203.238:6642: connected May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: ChassisPrivateCreateEvent(events=('create',), table='Chassis_Private', conditions=(('name', '=', '0da8323f-64af-4526-b223-049f5737145a'),), old_conditions=None), priority=20 to row=Chassis_Private(name=0da8323f-64af-4526-b223-049f5737145a, chassis=[], nb_cfg=0, nb_cfg_timestamp=0, external_ids={}) old= {{(pid=75705) matches /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > process after_init 55550000, False {{(pid=75705) subscribe /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:52}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75705) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75705) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75705) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: INFO oslo_service.service [-] Starting 2 workers May 28 12:43:13 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] Started child 75989 {{(pid=75705) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:579}} May 28 12:43:14 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] Started child 75990 {{(pid=75705) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:579}} May 28 12:43:14 l75lg1-v1 neutron-ovn-metadata-agent[75989]: DEBUG neutron_lib.callbacks.manager [-] Publish callbacks ['neutron.agent.ovn.metadata.server.MetadataProxyHandler.post_fork_initialize-239513'] for process (None), after_init {{(pid=75989) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:43:14 l75lg1-v1 neutron-ovn-metadata-agent[75705]: INFO oslo.privsep.daemon [-] Running privsep helper: ['sudo', '/opt/stack/data/venv/bin/neutron-rootwrap', '/etc/neutron/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/neutron/neutron_ovn_metadata_agent.ini', '--privsep_context', 'neutron.privileged.namespace_cmd', '--privsep_sock_path', '/tmp/tmpg_3id6ad/privsep.sock'] May 28 12:43:14 l75lg1-v1 neutron-ovn-metadata-agent[75990]: DEBUG neutron_lib.callbacks.manager [-] Publish callbacks ['neutron.agent.ovn.metadata.server.MetadataProxyHandler.post_fork_initialize-239513'] for process (None), after_init {{(pid=75990) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:43:14 l75lg1-v1 sudo[75991]: vastdata : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/neutron-rootwrap /etc/neutron/rootwrap.conf privsep-helper --config-file /etc/neutron/neutron_ovn_metadata_agent.ini --privsep_context neutron.privileged.namespace_cmd --privsep_sock_path /tmp/tmpg_3id6ad/privsep.sock May 28 12:43:14 l75lg1-v1 sudo[75991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) May 28 12:43:14 l75lg1-v1 neutron-ovn-metadata-agent[75989]: INFO neutron.agent.ovn.metadata.ovsdb [-] Getting OvsdbSbOvnIdl for MetadataAgent with retry May 28 12:43:14 l75lg1-v1 neutron-ovn-metadata-agent[75989]: DEBUG ovsdbapp.backend.ovs_idl [-] Created lookup_table index Chassis.name {{(pid=75989) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:87}} May 28 12:43:14 l75lg1-v1 neutron-ovn-metadata-agent[75989]: DEBUG ovsdbapp.backend.ovs_idl [-] Created lookup_table index Port_Binding.logical_port {{(pid=75989) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:87}} May 28 12:43:14 l75lg1-v1 neutron-ovn-metadata-agent[75989]: DEBUG ovsdbapp.backend.ovs_idl [-] Created schema index Datapath_Binding.tunnel_key {{(pid=75989) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}} May 28 12:43:14 l75lg1-v1 neutron-ovn-metadata-agent[75989]: INFO ovsdbapp.backend.ovs_idl.vlog [-] tcp:10.27.203.238:6642: connecting... May 28 12:43:14 l75lg1-v1 neutron-ovn-metadata-agent[75989]: INFO ovsdbapp.backend.ovs_idl.vlog [-] tcp:10.27.203.238:6642: connected May 28 12:43:14 l75lg1-v1 neutron-ovn-metadata-agent[75990]: INFO neutron.agent.ovn.metadata.ovsdb [-] Getting OvsdbSbOvnIdl for MetadataAgent with retry May 28 12:43:14 l75lg1-v1 neutron-ovn-metadata-agent[75990]: DEBUG ovsdbapp.backend.ovs_idl [-] Created lookup_table index Chassis.name {{(pid=75990) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:87}} May 28 12:43:14 l75lg1-v1 neutron-ovn-metadata-agent[75990]: DEBUG ovsdbapp.backend.ovs_idl [-] Created lookup_table index Port_Binding.logical_port {{(pid=75990) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:87}} May 28 12:43:14 l75lg1-v1 neutron-ovn-metadata-agent[75990]: DEBUG ovsdbapp.backend.ovs_idl [-] Created schema index Datapath_Binding.tunnel_key {{(pid=75990) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}} May 28 12:43:14 l75lg1-v1 neutron-ovn-metadata-agent[75990]: INFO ovsdbapp.backend.ovs_idl.vlog [-] tcp:10.27.203.238:6642: connecting... May 28 12:43:14 l75lg1-v1 neutron-ovn-metadata-agent[75990]: INFO ovsdbapp.backend.ovs_idl.vlog [-] tcp:10.27.203.238:6642: connected May 28 12:43:14 l75lg1-v1 neutron-ovn-metadata-agent[75989]: INFO eventlet.wsgi.server [-] (75989) wsgi starting up on http:/opt/stack/data/neutron/metadata_proxy May 28 12:43:14 l75lg1-v1 neutron-ovn-metadata-agent[75990]: INFO eventlet.wsgi.server [-] (75990) wsgi starting up on http:/opt/stack/data/neutron/metadata_proxy May 28 12:43:14 l75lg1-v1 dstat.sh[49771]: 28-05 12:43:14| 10 1 87 0 0|1923M 7607M 267M 5903M| 13k 0 | 0 216k| 0 47.0 |2208 4790 |1.56 1.89 1.26|1.0 0 9.0| 0 0 | 0 2048M| 22 59 0 8 0 May 28 12:43:15 l75lg1-v1 sudo[75991]: pam_unix(sudo:session): session closed for user root May 28 12:43:15 l75lg1-v1 neutron-ovn-metadata-agent[75705]: INFO oslo.privsep.daemon [-] Spawned new privsep daemon via rootwrap May 28 12:43:15 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo.privsep.daemon [-] Accepted privsep connection to /tmp/tmpg_3id6ad/privsep.sock {{(pid=75705) __init__ /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:362}} May 28 12:43:15 l75lg1-v1 neutron-ovn-metadata-agent[75705]: INFO oslo.privsep.daemon [-] privsep daemon starting May 28 12:43:15 l75lg1-v1 neutron-ovn-metadata-agent[75705]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 May 28 12:43:15 l75lg1-v1 neutron-ovn-metadata-agent[75705]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none May 28 12:43:15 l75lg1-v1 neutron-ovn-metadata-agent[75705]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 75997 May 28 12:43:15 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo.privsep.daemon [-] privsep: reply[608e34af-ea4a-48b0-9655-8a65d742bf02]: (2,) {{(pid=75997) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} May 28 12:43:15 l75lg1-v1 dstat.sh[49771]: 28-05 12:43:15| 9 2 90 0 0|1948M 7582M 267M 5903M|8674B 86B| 0 164k| 0 4.00 |1340 1573 |1.56 1.89 1.26|1.0 0 8.0| 0 0 | 0 2048M| 22 59 0 8 0 May 28 12:43:15 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "context-manager" by "neutron_lib.db.api._create_context_manager" {{(pid=75997) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:43:15 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_concurrency.lockutils [-] Lock "context-manager" acquired by "neutron_lib.db.api._create_context_manager" :: waited 0.000s {{(pid=75997) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:43:15 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_concurrency.lockutils [-] Lock "context-manager" "released" by "neutron_lib.db.api._create_context_manager" :: held 0.000s {{(pid=75997) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:43:16 l75lg1-v1 dstat.sh[49771]: 28-05 12:43:16| 9 1 89 0 0|1988M 7542M 267M 5903M| 10k 0 | 0 0 | 0 0 |1120 1325 |1.56 1.89 1.26|1.0 0 2.0| 0 0 | 0 2048M| 22 59 0 8 0 May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo.privsep.daemon [-] privsep: reply[f51f4435-7115-4aab-9bb1-6d07fd843ea4]: (4, []) {{(pid=75997) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbAddCommand(_result=None, table=Chassis_Private, record=0da8323f-64af-4526-b223-049f5737145a, column=external_ids, values=({'neutron:ovn-metadata-id': 'b7c1cbf2-dffa-5cd9-9c1d-e0b97d632cf7'},)) {{(pid=75705) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=Chassis_Private, record=0da8323f-64af-4526-b223-049f5737145a, col_values=(('external_ids', {'neutron:ovn-bridge': 'br-int'}),), if_exists=True) {{(pid=75705) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] Full set of CONF: {{(pid=75705) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:653}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2600}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] Configuration options gathered from: {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2601}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] command line args: ['--config-file', '/etc/neutron/neutron_ovn_metadata_agent.ini'] {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] config files: ['/etc/neutron/neutron_ovn_metadata_agent.ini'] {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2603}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] ================================================================================ {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2605}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] agent_down_time = 75 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] allow_bulk = True {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] api_extensions_path = {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] api_paste_config = api-paste.ini {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] api_workers = None {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] auth_ca_cert = None {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] auth_strategy = keystone {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] backlog = 4096 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] base_mac = fa:16:3e:00:00:00 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] bind_host = 0.0.0.0 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] bind_port = 9696 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] client_socket_timeout = 900 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] config_dir = [] {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] config_file = ['/etc/neutron/neutron_ovn_metadata_agent.ini'] {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] config_source = [] {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] control_exchange = neutron {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] core_plugin = None {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] debug = True {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] default_availability_zones = [] {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] dhcp_agent_notification = True {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] dhcp_lease_duration = 86400 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] dhcp_load_type = networks {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] dns_domain = openstacklocal {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] enable_new_agents = True {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] enable_signals = True {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] enable_traditional_dhcp = True {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] external_dns_driver = None {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] external_pids = /opt/stack/data/neutron/external/pids {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] filter_validation = True {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] global_physnet_mtu = 1500 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] graceful_shutdown_timeout = 60 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] host = l75lg1-v1 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] http_retries = 3 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] instance_format = [instance: %(uuid)s] {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] ipam_driver = internal {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] ipv6_pd_enabled = False {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] log_config_append = None {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] log_dir = None {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] log_file = None {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] log_options = True {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] log_rotate_interval = 1 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] log_rotate_interval_type = days {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] log_rotation_type = none {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] max_dns_nameservers = 5 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] max_header_line = 16384 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] max_logfile_count = 30 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] max_logfile_size_mb = 200 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] max_subnet_host_routes = 20 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] metadata_backlog = 4096 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] metadata_proxy_group = {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] metadata_proxy_shared_secret = **** {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] metadata_proxy_socket = /opt/stack/data/neutron/metadata_proxy {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] metadata_proxy_socket_mode = deduce {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] metadata_proxy_user = {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] metadata_workers = 2 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] my_ip = 10.27.203.238 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] my_ipv6 = 2001:67c:9b4:1::1014 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] network_link_prefix = None {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] notify_nova_on_port_data_changes = True {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] notify_nova_on_port_status_changes = True {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] nova_client_cert = {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] nova_client_priv_key = {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] nova_metadata_host = 10.27.203.238 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] nova_metadata_insecure = False {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] nova_metadata_port = 8775 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] nova_metadata_protocol = http {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] pagination_max_limit = -1 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] periodic_fuzzy_delay = 5 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] periodic_interval = 40 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] publish_errors = False {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] rate_limit_burst = 0 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] rate_limit_except_level = CRITICAL {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] rate_limit_interval = 0 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] retry_until_window = 30 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] rpc_resources_processing_step = 20 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] rpc_response_max_timeout = 600 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] rpc_state_report_workers = 1 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] rpc_workers = None {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] send_events_interval = 2 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] service_plugins = [] {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] setproctitle = on {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] state_path = /opt/stack/data/neutron {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] syslog_log_facility = LOG_USER {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] tcp_keepidle = 600 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] transport_url = **** {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] use_eventlog = False {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] use_journal = False {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] use_json = False {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] use_ssl = False {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] use_stderr = False {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] use_syslog = False {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] vlan_transparent = False {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] watch_log_file = False {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] wsgi_default_pool_size = 100 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] wsgi_keep_alive = True {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] wsgi_server_debug = False {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] oslo_concurrency.disable_process_locking = False {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] oslo_concurrency.lock_path = None {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] profiler.connection_string = messaging:// {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] profiler.enabled = False {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] profiler.es_doc_type = notification {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] profiler.es_scroll_size = 10000 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] profiler.es_scroll_time = 2m {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] profiler.filter_error_trace = False {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] profiler.hmac_keys = **** {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] profiler.sentinel_service_name = mymaster {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] profiler.socket_timeout = 0.1 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] profiler.trace_requests = False {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] profiler.trace_sqlalchemy = False {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] profiler_jaeger.process_tags = {} {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] profiler_jaeger.service_name_prefix = None {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] profiler_otlp.service_name_prefix = None {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] oslo_policy.enforce_new_defaults = True {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] oslo_policy.enforce_scope = True {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] oslo_policy.policy_default_rule = default {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] oslo_policy.policy_file = policy.yaml {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_process_name = {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] service_providers.service_provider = [] {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] privsep.group = None {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] privsep.helper_command = None {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] privsep.logger_name = oslo_privsep.daemon {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] privsep.thread_pool_size = 10 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] privsep.user = None {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] privsep_dhcp_release.capabilities = [21, 12] {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] privsep_dhcp_release.group = None {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] privsep_dhcp_release.helper_command = None {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] privsep_dhcp_release.thread_pool_size = 10 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] privsep_dhcp_release.user = None {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.group = None {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.helper_command = None {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.thread_pool_size = 10 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.user = None {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] privsep_namespace.capabilities = [21] {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] privsep_namespace.group = None {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] privsep_namespace.helper_command = None {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] privsep_namespace.thread_pool_size = 10 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] privsep_namespace.user = None {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] privsep_conntrack.capabilities = [12] {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] privsep_conntrack.group = None {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] privsep_conntrack.helper_command = None {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] privsep_conntrack.thread_pool_size = 10 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] privsep_conntrack.user = None {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] privsep_link.capabilities = [12, 21] {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] privsep_link.group = None {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] privsep_link.helper_command = None {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] privsep_link.logger_name = oslo_privsep.daemon {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] privsep_link.thread_pool_size = 10 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] privsep_link.user = None {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] AGENT.check_child_processes_action = respawn {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] AGENT.check_child_processes_interval = 60 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] AGENT.comment_iptables_rules = True {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] AGENT.debug_iptables_rules = False {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] AGENT.kill_scripts_path = /etc/neutron/kill_scripts/ {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] AGENT.root_helper = sudo /opt/stack/data/venv/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] AGENT.root_helper_daemon = sudo /opt/stack/data/venv/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] AGENT.use_helper_for_ns_read = True {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] AGENT.use_random_fully = True {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] OVS.bridge_mac_table_size = 50000 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] OVS.bridge_mappings = [] {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] OVS.datapath_type = system {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] OVS.igmp_flood = False {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] OVS.igmp_flood_reports = True {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] OVS.igmp_flood_unregistered = False {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] OVS.igmp_snooping_enable = False {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] OVS.int_peer_patch_port = patch-tun {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] OVS.integration_bridge = br-int {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] OVS.local_ip = None {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] OVS.of_connect_timeout = 300 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] OVS.of_inactivity_probe = 10 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] OVS.of_listen_address = 127.0.0.1 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] OVS.of_listen_port = 6633 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] OVS.of_request_timeout = 300 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] OVS.openflow_processed_per_port = False {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] OVS.ovsdb_connection = tcp:127.0.0.1:6640 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] OVS.ovsdb_debug = False {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] OVS.ovsdb_timeout = 10 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] OVS.resource_provider_bandwidths = [] {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] OVS.resource_provider_default_hypervisor = None {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] OVS.resource_provider_hypervisors = {} {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] OVS.resource_provider_inventory_defaults = {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0} {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] OVS.resource_provider_packet_processing_inventory_defaults = {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0} {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] OVS.resource_provider_packet_processing_with_direction = [] {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] OVS.resource_provider_packet_processing_without_direction = [] {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] OVS.ssl_ca_cert_file = None {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] OVS.ssl_cert_file = None {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] OVS.ssl_key_file = None {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] OVS.tun_peer_patch_port = patch-int {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] OVS.tunnel_bridge = br-tun {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] OVS.vhostuser_socket_dir = /var/run/openvswitch {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] QUOTAS.default_quota = -1 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] QUOTAS.quota_network = 100 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] QUOTAS.quota_port = 500 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group = 10 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group_rule = 100 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] QUOTAS.quota_subnet = 100 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] QUOTAS.track_quota_usage = True {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] agent.extensions = [] {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] nova.auth_section = None {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] nova.auth_type = None {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] nova.cafile = None {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] nova.certfile = None {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] nova.collect_timing = False {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] nova.endpoint_type = public {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] nova.insecure = False {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] nova.keyfile = None {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] nova.region_name = None {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] nova.split_loggers = False {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] nova.timeout = None {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] placement.auth_section = None {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] placement.auth_type = None {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] placement.cafile = None {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] placement.certfile = None {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] placement.collect_timing = False {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] placement.endpoint_type = public {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] placement.insecure = False {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] placement.keyfile = None {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] placement.region_name = None {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] placement.split_loggers = False {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] placement.timeout = None {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] ironic.auth_section = None {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] ironic.auth_type = None {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] ironic.cafile = None {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] ironic.certfile = None {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] ironic.collect_timing = False {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] ironic.connect_retries = None {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] ironic.connect_retry_delay = None {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] ironic.enable_notifications = False {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] ironic.endpoint_override = None {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] ironic.insecure = False {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] ironic.interface = None {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] ironic.keyfile = None {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] ironic.max_version = None {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] ironic.min_version = None {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] ironic.region_name = None {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] ironic.retriable_status_codes = None {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] ironic.service_name = None {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] ironic.service_type = None {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] ironic.split_loggers = False {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] ironic.status_code_retries = None {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] ironic.status_code_retry_delay = None {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] ironic.timeout = None {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] ironic.valid_interfaces = None {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] ironic.version = None {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] cli_script.dry_run = False {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] ovn.allow_stateless_action_supported = True {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] ovn.dhcp_default_lease_time = 43200 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] ovn.disable_ovn_dhcp_for_baremetal_ports = False {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] ovn.dns_servers = [] {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] ovn.enable_distributed_floating_ip = False {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] ovn.fdb_age_threshold = 0 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] ovn.localnet_learn_fdb = False {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] ovn.mac_binding_age_threshold = 0 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] ovn.neutron_sync_mode = log {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] ovn.ovn_dhcp4_global_options = {} {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] ovn.ovn_dhcp6_global_options = {} {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] ovn.ovn_emit_need_to_frag = False {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] ovn.ovn_l3_scheduler = leastloaded {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] ovn.ovn_metadata_enabled = False {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] ovn.ovn_nb_ca_cert = {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] ovn.ovn_nb_certificate = {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] ovn.ovn_nb_connection = tcp:127.0.0.1:6641 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] ovn.ovn_nb_private_key = {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] ovn.ovn_sb_ca_cert = {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] ovn.ovn_sb_certificate = {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] ovn.ovn_sb_connection = tcp:10.27.203.238:6642 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] ovn.ovn_sb_private_key = {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] ovn.ovsdb_connection_timeout = 180 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] ovn.ovsdb_log_level = INFO {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] ovn.ovsdb_probe_interval = 60000 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] ovn.ovsdb_retry_max_interval = 180 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] ovn.vhost_sock_dir = /var/run/openvswitch {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] ovn_nb_global.fdb_removal_limit = 0 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] ovn_nb_global.ignore_lsp_down = False {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] ovn_nb_global.mac_binding_removal_limit = 0 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] metadata_rate_limiting.base_query_rate_limit = 10 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] metadata_rate_limiting.base_window_duration = 10 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] metadata_rate_limiting.burst_query_rate_limit = 10 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] metadata_rate_limiting.burst_window_duration = 10 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] metadata_rate_limiting.ip_versions = [4] {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] metadata_rate_limiting.rate_limit_enabled = False {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] ovs.ovsdb_connection = tcp:127.0.0.1:6640 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] ovs.ovsdb_connection_timeout = 180 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.hostname = l75lg1-v1 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.processname = neutron-ovn-metadata-agent {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl = False {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_version = {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] oslo_messaging_notifications.driver = [] {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] oslo_messaging_notifications.retry = -1 {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] oslo_messaging_notifications.transport_url = **** {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=75705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2624}} May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: WARNING ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: send error: Broken pipe May 28 12:43:16 l75lg1-v1 neutron-ovn-metadata-agent[75705]: WARNING ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: connection dropped (Broken pipe) May 28 12:43:17 l75lg1-v1 dstat.sh[49771]: 28-05 12:43:17| 7 4 89 0 0|1895M 7635M 267M 5904M|9951B 396B| 68k 6248k|17.0 559 |4706 8670 |1.52 1.88 1.26|1.0 0 137| 0 0 | 0 2048M| 22 57 0 8 0 May 28 12:43:17 l75lg1-v1 neutron-ovn-metadata-agent[75705]: INFO ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: connecting... May 28 12:43:17 l75lg1-v1 neutron-ovn-metadata-agent[75705]: INFO ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: connected May 28 12:43:18 l75lg1-v1 dstat.sh[49771]: 28-05 12:43:18| 8 7 84 0 0|2016M 7513M 267M 5904M| 16k 2832B| 136k 632k|34.0 5.00 |8596 12k|1.52 1.88 1.26|1.0 0 209| 0 0 | 0 2048M| 22 59 0 8 0 May 28 12:43:19 l75lg1-v1 dstat.sh[49771]: 28-05 12:43:19| 8 5 85 0 0|2021M 7508M 267M 5904M| 21k 2182B| 136k 560k|34.0 94.0 |8622 13k|1.52 1.88 1.26|2.0 0 146| 0 0 | 0 2048M| 21 59 0 6 0 May 28 12:43:19 l75lg1-v1 neutron-ovn-metadata-agent[75705]: WARNING ovsdbapp.backend.ovs_idl.vlog [-] tcp:10.27.203.238:6642: send error: Broken pipe May 28 12:43:19 l75lg1-v1 neutron-ovn-metadata-agent[75990]: WARNING ovsdbapp.backend.ovs_idl.vlog [-] tcp:10.27.203.238:6642: send error: Broken pipe May 28 12:43:19 l75lg1-v1 neutron-ovn-metadata-agent[75989]: WARNING ovsdbapp.backend.ovs_idl.vlog [-] tcp:10.27.203.238:6642: send error: Broken pipe May 28 12:43:19 l75lg1-v1 neutron-ovn-metadata-agent[75705]: WARNING ovsdbapp.backend.ovs_idl.vlog [-] tcp:10.27.203.238:6642: connection dropped (Broken pipe) May 28 12:43:19 l75lg1-v1 neutron-ovn-metadata-agent[75989]: WARNING ovsdbapp.backend.ovs_idl.vlog [-] tcp:10.27.203.238:6642: connection dropped (Broken pipe) May 28 12:43:19 l75lg1-v1 neutron-ovn-metadata-agent[75990]: WARNING ovsdbapp.backend.ovs_idl.vlog [-] tcp:10.27.203.238:6642: connection dropped (Broken pipe) May 28 12:43:20 l75lg1-v1 dstat.sh[49771]: 28-05 12:43:20| 7 6 87 0 0|2022M 7507M 267M 5904M| 17k 5300B| 136k 228k|34.0 14.0 |7957 12k|1.52 1.88 1.26|1.0 0 218| 0 0 | 0 2048M| 20 51 0 6 0 May 28 12:43:20 l75lg1-v1 neutron-ovn-metadata-agent[75705]: INFO ovsdbapp.backend.ovs_idl.vlog [-] tcp:10.27.203.238:6642: connecting... May 28 12:43:20 l75lg1-v1 neutron-ovn-metadata-agent[75705]: WARNING ovsdbapp.backend.ovs_idl.vlog [-] tcp:10.27.203.238:6642: connection attempt failed (Connection refused) May 28 12:43:20 l75lg1-v1 neutron-ovn-metadata-agent[75705]: INFO ovsdbapp.backend.ovs_idl.vlog [-] tcp:10.27.203.238:6642: waiting 2 seconds before reconnect May 28 12:43:20 l75lg1-v1 neutron-ovn-metadata-agent[75990]: INFO ovsdbapp.backend.ovs_idl.vlog [-] tcp:10.27.203.238:6642: connecting... May 28 12:43:20 l75lg1-v1 neutron-ovn-metadata-agent[75989]: INFO ovsdbapp.backend.ovs_idl.vlog [-] tcp:10.27.203.238:6642: connecting... May 28 12:43:20 l75lg1-v1 neutron-ovn-metadata-agent[75990]: WARNING ovsdbapp.backend.ovs_idl.vlog [-] tcp:10.27.203.238:6642: connection attempt failed (Connection refused) May 28 12:43:20 l75lg1-v1 neutron-ovn-metadata-agent[75989]: WARNING ovsdbapp.backend.ovs_idl.vlog [-] tcp:10.27.203.238:6642: connection attempt failed (Connection refused) May 28 12:43:20 l75lg1-v1 neutron-ovn-metadata-agent[75989]: INFO ovsdbapp.backend.ovs_idl.vlog [-] tcp:10.27.203.238:6642: waiting 2 seconds before reconnect May 28 12:43:20 l75lg1-v1 neutron-ovn-metadata-agent[75990]: INFO ovsdbapp.backend.ovs_idl.vlog [-] tcp:10.27.203.238:6642: waiting 2 seconds before reconnect May 28 12:43:21 l75lg1-v1 dstat.sh[49771]: 28-05 12:43:21| 6 4 90 0 0|2022M 7507M 267M 5903M| 15k 444B| 68k 8191B|17.0 2.00 |8427 13k|1.52 1.88 1.26| 0 0 105| 0 0 | 0 2048M| 22 53 0 6 0 May 28 12:43:21 l75lg1-v1 neutron-ovn-metadata-agent[75705]: INFO oslo_service.service [-] Caught SIGTERM, stopping children May 28 12:43:21 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75705) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} May 28 12:43:21 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75705) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} May 28 12:43:21 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75705) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} May 28 12:43:21 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] Stop services. {{(pid=75705) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:699}} May 28 12:43:21 l75lg1-v1 neutron-ovn-metadata-agent[75705]: DEBUG oslo_service.service [-] Killing children. {{(pid=75705) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:704}} May 28 12:43:21 l75lg1-v1 neutron-ovn-metadata-agent[75705]: INFO oslo_service.service [-] Waiting on 2 children to exit May 28 12:43:21 l75lg1-v1 neutron-ovn-metadata-agent[75989]: INFO eventlet.wsgi.server [-] (75989) wsgi exited, is_accepting=True May 28 12:43:21 l75lg1-v1 neutron-ovn-metadata-agent[75990]: INFO eventlet.wsgi.server [-] (75990) wsgi exited, is_accepting=True May 28 12:43:21 l75lg1-v1 neutron-ovn-metadata-agent[75989]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75989) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} May 28 12:43:21 l75lg1-v1 neutron-ovn-metadata-agent[75990]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} May 28 12:43:21 l75lg1-v1 neutron-ovn-metadata-agent[75990]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} May 28 12:43:21 l75lg1-v1 neutron-ovn-metadata-agent[75989]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75989) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} May 28 12:43:21 l75lg1-v1 neutron-ovn-metadata-agent[75989]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75989) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} May 28 12:43:21 l75lg1-v1 neutron-ovn-metadata-agent[75990]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} May 28 12:43:21 l75lg1-v1 neutron-ovn-metadata-agent[75705]: INFO oslo_service.service [-] Child 75989 exited with status 0 May 28 12:43:21 l75lg1-v1 neutron-ovn-metadata-agent[75705]: INFO oslo_service.service [-] Child 75990 exited with status 0 May 28 12:43:22 l75lg1-v1 dstat.sh[49771]: 28-05 12:43:22| 11 7 83 0 0|1811M 7718M 267M 5903M| 17k 24k| 0 284k| 0 5.00 |3513 3822 |1.40 1.85 1.25|3.0 0 314| 0 0 | 0 2048M| 22 51 0 7 0 May 28 12:43:23 l75lg1-v1 dstat.sh[49771]: 28-05 12:43:23| 17 8 74 0 0|1850M 7679M 267M 5904M| 14k 9482B| 68k 268k|17.0 11.0 |6586 9098 |1.40 1.85 1.25|2.0 0 312| 0 0 | 0 2048M| 22 51 0 7 0 May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: INFO neutron.common.config [-] Logging enabled! May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-ovn-metadata-agent version 24.1.0.dev130 May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-ovn-metadata-agent --config-file /etc/neutron/neutron_ovn_metadata_agent.ini {{(pid=76818) setup_logging /opt/stack/neutron/neutron/common/config.py:123}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] ******************************************************************************** {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2600}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] Configuration options gathered from: {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2601}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] command line args: ['--config-file', '/etc/neutron/neutron_ovn_metadata_agent.ini'] {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] config files: ['/etc/neutron/neutron_ovn_metadata_agent.ini'] {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2603}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] ================================================================================ {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2605}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] agent_down_time = 75 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] allow_bulk = True {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] api_extensions_path = {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] api_paste_config = api-paste.ini {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] api_workers = None {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] auth_ca_cert = None {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] auth_strategy = keystone {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] backlog = 4096 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] base_mac = fa:16:3e:00:00:00 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] bind_host = 0.0.0.0 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] bind_port = 9696 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] client_socket_timeout = 900 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] config_dir = [] {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] config_file = ['/etc/neutron/neutron_ovn_metadata_agent.ini'] {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] config_source = [] {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] control_exchange = neutron {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] core_plugin = None {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] debug = True {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] default_availability_zones = [] {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] dhcp_agent_notification = True {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] dhcp_lease_duration = 86400 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] dhcp_load_type = networks {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] dns_domain = openstacklocal {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] enable_new_agents = True {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] enable_signals = True {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] enable_traditional_dhcp = True {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] external_dns_driver = None {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] external_pids = /opt/stack/data/neutron/external/pids {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] filter_validation = True {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] global_physnet_mtu = 1500 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] host = l75lg1-v1 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] http_retries = 3 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] instance_format = [instance: %(uuid)s] {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] ipam_driver = internal {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] ipv6_pd_enabled = False {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] log_config_append = None {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] log_dir = None {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] log_file = None {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] log_rotate_interval = 1 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] log_rotate_interval_type = days {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] log_rotation_type = none {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] max_dns_nameservers = 5 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] max_header_line = 16384 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] max_logfile_count = 30 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] max_logfile_size_mb = 200 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] max_subnet_host_routes = 20 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] metadata_backlog = 4096 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] metadata_proxy_group = {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] metadata_proxy_shared_secret = **** {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] metadata_proxy_socket = /opt/stack/data/neutron/metadata_proxy {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] metadata_proxy_socket_mode = deduce {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] metadata_proxy_user = {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] metadata_workers = 2 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] my_ip = 10.27.203.238 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] my_ipv6 = 2001:67c:9b4:1::1014 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] network_link_prefix = None {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] notify_nova_on_port_data_changes = True {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] notify_nova_on_port_status_changes = True {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] nova_client_cert = {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] nova_client_priv_key = {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] nova_metadata_host = 10.27.203.238 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] nova_metadata_insecure = False {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] nova_metadata_port = 8775 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] nova_metadata_protocol = http {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] pagination_max_limit = -1 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] periodic_fuzzy_delay = 5 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] periodic_interval = 40 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] publish_errors = False {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] rate_limit_burst = 0 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] rate_limit_except_level = CRITICAL {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] rate_limit_interval = 0 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] retry_until_window = 30 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] rpc_resources_processing_step = 20 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] rpc_response_max_timeout = 600 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] rpc_state_report_workers = 1 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] rpc_workers = None {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] send_events_interval = 2 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] service_plugins = [] {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] setproctitle = on {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] state_path = /opt/stack/data/neutron {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] syslog_log_facility = LOG_USER {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] tcp_keepidle = 600 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] transport_url = **** {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] use_eventlog = False {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] use_journal = False {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] use_json = False {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] use_ssl = False {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] use_stderr = False {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] use_syslog = False {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] vlan_transparent = False {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] watch_log_file = False {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] wsgi_default_pool_size = 100 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] wsgi_keep_alive = True {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] wsgi_server_debug = False {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] oslo_concurrency.disable_process_locking = False {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] oslo_concurrency.lock_path = None {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] profiler.connection_string = messaging:// {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] profiler.enabled = False {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] profiler.es_doc_type = notification {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] profiler.es_scroll_size = 10000 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] profiler.es_scroll_time = 2m {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] profiler.filter_error_trace = False {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] profiler.hmac_keys = **** {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] profiler.sentinel_service_name = mymaster {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] profiler.socket_timeout = 0.1 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] profiler.trace_requests = False {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] profiler.trace_sqlalchemy = False {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] profiler_jaeger.process_tags = {} {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] profiler_jaeger.service_name_prefix = None {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] profiler_otlp.service_name_prefix = None {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] oslo_policy.enforce_new_defaults = True {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] oslo_policy.enforce_scope = True {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] oslo_policy.policy_default_rule = default {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] oslo_policy.policy_file = policy.yaml {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] oslo_messaging_metrics.metrics_process_name = {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] service_providers.service_provider = [] {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] privsep.group = None {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] privsep.helper_command = None {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] privsep.logger_name = oslo_privsep.daemon {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] privsep.thread_pool_size = 10 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] privsep.user = None {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] privsep_dhcp_release.capabilities = [21, 12] {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] privsep_dhcp_release.group = None {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] privsep_dhcp_release.helper_command = None {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] privsep_dhcp_release.thread_pool_size = 10 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] privsep_dhcp_release.user = None {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] privsep_ovs_vsctl.group = None {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] privsep_ovs_vsctl.helper_command = None {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] privsep_ovs_vsctl.thread_pool_size = 10 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] privsep_ovs_vsctl.user = None {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] privsep_namespace.capabilities = [21] {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] privsep_namespace.group = None {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] privsep_namespace.helper_command = None {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] privsep_namespace.thread_pool_size = 10 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] privsep_namespace.user = None {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] privsep_conntrack.capabilities = [12] {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] privsep_conntrack.group = None {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] privsep_conntrack.helper_command = None {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] privsep_conntrack.thread_pool_size = 10 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] privsep_conntrack.user = None {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] privsep_link.capabilities = [12, 21] {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] privsep_link.group = None {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] privsep_link.helper_command = None {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] privsep_link.logger_name = oslo_privsep.daemon {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] privsep_link.thread_pool_size = 10 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] privsep_link.user = None {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] AGENT.check_child_processes_action = respawn {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] AGENT.check_child_processes_interval = 60 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] AGENT.comment_iptables_rules = True {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] AGENT.debug_iptables_rules = False {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] AGENT.kill_scripts_path = /etc/neutron/kill_scripts/ {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] AGENT.root_helper = sudo /opt/stack/data/venv/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] AGENT.root_helper_daemon = sudo /opt/stack/data/venv/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] AGENT.use_helper_for_ns_read = True {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] AGENT.use_random_fully = True {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] OVS.bridge_mac_table_size = 50000 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] OVS.bridge_mappings = [] {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] OVS.datapath_type = system {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] OVS.igmp_flood = False {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] OVS.igmp_flood_reports = True {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] OVS.igmp_flood_unregistered = False {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] OVS.igmp_snooping_enable = False {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] OVS.int_peer_patch_port = patch-tun {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] OVS.integration_bridge = br-int {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] OVS.local_ip = None {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] OVS.of_connect_timeout = 300 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] OVS.of_inactivity_probe = 10 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] OVS.of_listen_address = 127.0.0.1 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] OVS.of_listen_port = 6633 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] OVS.of_request_timeout = 300 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] OVS.openflow_processed_per_port = False {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] OVS.ovsdb_connection = tcp:127.0.0.1:6640 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] OVS.ovsdb_debug = False {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] OVS.ovsdb_timeout = 10 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] OVS.resource_provider_bandwidths = [] {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] OVS.resource_provider_default_hypervisor = None {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] OVS.resource_provider_hypervisors = {} {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] OVS.resource_provider_inventory_defaults = {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0} {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] OVS.resource_provider_packet_processing_inventory_defaults = {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0} {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] OVS.resource_provider_packet_processing_with_direction = [] {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] OVS.resource_provider_packet_processing_without_direction = [] {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] OVS.ssl_ca_cert_file = None {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] OVS.ssl_cert_file = None {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] OVS.ssl_key_file = None {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] OVS.tun_peer_patch_port = patch-int {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] OVS.tunnel_bridge = br-tun {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] OVS.vhostuser_socket_dir = /var/run/openvswitch {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] QUOTAS.default_quota = -1 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] QUOTAS.quota_network = 100 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] QUOTAS.quota_port = 500 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] QUOTAS.quota_security_group = 10 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] QUOTAS.quota_security_group_rule = 100 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] QUOTAS.quota_subnet = 100 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] QUOTAS.track_quota_usage = True {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] agent.extensions = [] {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] nova.auth_section = None {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] nova.auth_type = None {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] nova.cafile = None {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] nova.certfile = None {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] nova.collect_timing = False {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] nova.endpoint_type = public {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] nova.insecure = False {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] nova.keyfile = None {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] nova.region_name = None {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] nova.split_loggers = False {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] nova.timeout = None {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] placement.auth_section = None {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] placement.auth_type = None {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] placement.cafile = None {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] placement.certfile = None {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] placement.collect_timing = False {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] placement.endpoint_type = public {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] placement.insecure = False {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] placement.keyfile = None {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] placement.region_name = None {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] placement.split_loggers = False {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] placement.timeout = None {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] ironic.auth_section = None {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] ironic.auth_type = None {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] ironic.cafile = None {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] ironic.certfile = None {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] ironic.collect_timing = False {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] ironic.connect_retries = None {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] ironic.connect_retry_delay = None {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] ironic.enable_notifications = False {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] ironic.endpoint_override = None {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] ironic.insecure = False {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] ironic.interface = None {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] ironic.keyfile = None {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] ironic.max_version = None {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] ironic.min_version = None {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] ironic.region_name = None {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] ironic.retriable_status_codes = None {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] ironic.service_name = None {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] ironic.service_type = None {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] ironic.split_loggers = False {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] ironic.status_code_retries = None {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] ironic.status_code_retry_delay = None {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] ironic.timeout = None {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] ironic.valid_interfaces = None {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] ironic.version = None {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] cli_script.dry_run = False {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] ovn.allow_stateless_action_supported = True {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] ovn.dhcp_default_lease_time = 43200 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] ovn.disable_ovn_dhcp_for_baremetal_ports = False {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] ovn.dns_servers = [] {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] ovn.enable_distributed_floating_ip = False {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] ovn.fdb_age_threshold = 0 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] ovn.localnet_learn_fdb = False {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] ovn.mac_binding_age_threshold = 0 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] ovn.neutron_sync_mode = log {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] ovn.ovn_dhcp4_global_options = {} {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] ovn.ovn_dhcp6_global_options = {} {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] ovn.ovn_emit_need_to_frag = False {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] ovn.ovn_l3_scheduler = leastloaded {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] ovn.ovn_metadata_enabled = False {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] ovn.ovn_nb_ca_cert = {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] ovn.ovn_nb_certificate = {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] ovn.ovn_nb_connection = tcp:127.0.0.1:6641 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] ovn.ovn_nb_private_key = {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] ovn.ovn_sb_ca_cert = {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] ovn.ovn_sb_certificate = {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] ovn.ovn_sb_connection = tcp:10.27.203.238:6642 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] ovn.ovn_sb_private_key = {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] ovn.ovsdb_connection_timeout = 180 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] ovn.ovsdb_log_level = INFO {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] ovn.ovsdb_probe_interval = 60000 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] ovn.ovsdb_retry_max_interval = 180 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] ovn.vhost_sock_dir = /var/run/openvswitch {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] ovn_nb_global.fdb_removal_limit = 0 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] ovn_nb_global.ignore_lsp_down = False {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] ovn_nb_global.mac_binding_removal_limit = 0 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] metadata_rate_limiting.base_query_rate_limit = 10 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] metadata_rate_limiting.base_window_duration = 10 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] metadata_rate_limiting.burst_query_rate_limit = 10 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] metadata_rate_limiting.burst_window_duration = 10 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] metadata_rate_limiting.ip_versions = [4] {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] metadata_rate_limiting.rate_limit_enabled = False {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] ovs.ovsdb_connection = tcp:127.0.0.1:6640 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] ovs.ovsdb_connection_timeout = 180 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] oslo_messaging_rabbit.hostname = l75lg1-v1 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] oslo_messaging_rabbit.processname = neutron-ovn-metadata-agent {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] oslo_messaging_rabbit.ssl = False {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] oslo_messaging_rabbit.ssl_version = {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] oslo_messaging_rabbit.use_queue_manager = False {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] oslo_messaging_notifications.driver = [] {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] oslo_messaging_notifications.retry = -1 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] oslo_messaging_notifications.transport_url = **** {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata_agent [-] ******************************************************************************** {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2624}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG ovsdbapp.backend.ovs_idl [-] Created schema index Bridge.name {{(pid=76818) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG ovsdbapp.backend.ovs_idl [-] Created schema index Port.name {{(pid=76818) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG ovsdbapp.backend.ovs_idl [-] Created schema index Interface.name {{(pid=76818) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: INFO ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: connecting... May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: INFO ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: connected May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata.agent [-] Loaded chassis name 0da8323f-64af-4526-b223-049f5737145a (UUID: 0da8323f-64af-4526-b223-049f5737145a) and ovn bridge br-int. {{(pid=76818) _load_config /opt/stack/neutron/neutron/agent/ovn/metadata/agent.py:419}} May 28 12:43:24 l75lg1-v1 dstat.sh[49771]: 28-05 12:43:24| 18 5 76 0 0|1916M 7613M 267M 5904M| 16k 7869B| 68k 4095B|17.0 1.00 |6250 8455 |1.40 1.85 1.25|2.0 0 131| 0 0 | 0 2048M| 22 55 0 8 0 May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: INFO neutron.agent.ovn.metadata.ovsdb [-] Getting OvsdbSbOvnIdl for MetadataAgent with retry May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG ovsdbapp.backend.ovs_idl [-] Created lookup_table index Chassis.name {{(pid=76818) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:87}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG ovsdbapp.backend.ovs_idl [-] Created lookup_table index Port_Binding.logical_port {{(pid=76818) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:87}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG ovsdbapp.backend.ovs_idl [-] Created schema index Datapath_Binding.tunnel_key {{(pid=76818) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG ovsdbapp.backend.ovs_idl [-] Created schema index Chassis_Private.name {{(pid=76818) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: INFO ovsdbapp.backend.ovs_idl.vlog [-] tcp:10.27.203.238:6642: connecting... May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: INFO ovsdbapp.backend.ovs_idl.vlog [-] tcp:10.27.203.238:6642: connected May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: ChassisPrivateCreateEvent(events=('create',), table='Chassis_Private', conditions=(('name', '=', '0da8323f-64af-4526-b223-049f5737145a'),), old_conditions=None), priority=20 to row=Chassis_Private(name=0da8323f-64af-4526-b223-049f5737145a, chassis=[], nb_cfg=0, nb_cfg_timestamp=0, external_ids={'neutron:ovn-bridge': 'br-int', 'neutron:ovn-metadata-id': 'b7c1cbf2-dffa-5cd9-9c1d-e0b97d632cf7'}) old= {{(pid=76818) matches /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > process after_init 55550000, False {{(pid=76818) subscribe /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:52}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=76818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=76818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=76818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: INFO oslo_service.service [-] Starting 2 workers May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] Started child 77575 {{(pid=76818) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:579}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] Started child 77576 {{(pid=76818) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:579}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[77575]: DEBUG neutron_lib.callbacks.manager [-] Publish callbacks ['neutron.agent.ovn.metadata.server.MetadataProxyHandler.post_fork_initialize-349394'] for process (None), after_init {{(pid=77575) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: INFO oslo.privsep.daemon [-] Running privsep helper: ['sudo', '/opt/stack/data/venv/bin/neutron-rootwrap', '/etc/neutron/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/neutron/neutron_ovn_metadata_agent.ini', '--privsep_context', 'neutron.privileged.namespace_cmd', '--privsep_sock_path', '/tmp/tmpeu2vnn5e/privsep.sock'] May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[77576]: DEBUG neutron_lib.callbacks.manager [-] Publish callbacks ['neutron.agent.ovn.metadata.server.MetadataProxyHandler.post_fork_initialize-349394'] for process (None), after_init {{(pid=77576) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:43:24 l75lg1-v1 sudo[77577]: vastdata : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/neutron-rootwrap /etc/neutron/rootwrap.conf privsep-helper --config-file /etc/neutron/neutron_ovn_metadata_agent.ini --privsep_context neutron.privileged.namespace_cmd --privsep_sock_path /tmp/tmpeu2vnn5e/privsep.sock May 28 12:43:24 l75lg1-v1 sudo[77577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[77575]: INFO neutron.agent.ovn.metadata.ovsdb [-] Getting OvsdbSbOvnIdl for MetadataAgent with retry May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[77575]: DEBUG ovsdbapp.backend.ovs_idl [-] Created lookup_table index Chassis.name {{(pid=77575) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:87}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[77575]: DEBUG ovsdbapp.backend.ovs_idl [-] Created lookup_table index Port_Binding.logical_port {{(pid=77575) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:87}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[77575]: DEBUG ovsdbapp.backend.ovs_idl [-] Created schema index Datapath_Binding.tunnel_key {{(pid=77575) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[77575]: INFO ovsdbapp.backend.ovs_idl.vlog [-] tcp:10.27.203.238:6642: connecting... May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[77576]: INFO neutron.agent.ovn.metadata.ovsdb [-] Getting OvsdbSbOvnIdl for MetadataAgent with retry May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[77575]: INFO ovsdbapp.backend.ovs_idl.vlog [-] tcp:10.27.203.238:6642: connected May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[77576]: DEBUG ovsdbapp.backend.ovs_idl [-] Created lookup_table index Chassis.name {{(pid=77576) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:87}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[77576]: DEBUG ovsdbapp.backend.ovs_idl [-] Created lookup_table index Port_Binding.logical_port {{(pid=77576) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:87}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[77576]: DEBUG ovsdbapp.backend.ovs_idl [-] Created schema index Datapath_Binding.tunnel_key {{(pid=77576) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}} May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[77576]: INFO ovsdbapp.backend.ovs_idl.vlog [-] tcp:10.27.203.238:6642: connecting... May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[77576]: INFO ovsdbapp.backend.ovs_idl.vlog [-] tcp:10.27.203.238:6642: connected May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[77575]: INFO eventlet.wsgi.server [-] (77575) wsgi starting up on http:/opt/stack/data/neutron/metadata_proxy May 28 12:43:24 l75lg1-v1 neutron-ovn-metadata-agent[77576]: INFO eventlet.wsgi.server [-] (77576) wsgi starting up on http:/opt/stack/data/neutron/metadata_proxy May 28 12:43:25 l75lg1-v1 dstat.sh[49771]: 28-05 12:43:25| 20 2 78 0 0|2052M 7476M 267M 5904M| 12k 0 | 0 300k| 0 34.0 |1761 1703 |1.40 1.85 1.25|2.0 0 10| 0 0 | 0 2048M| 22 59 0 11 0 May 28 12:43:25 l75lg1-v1 sudo[77577]: pam_unix(sudo:session): session closed for user root May 28 12:43:25 l75lg1-v1 neutron-ovn-metadata-agent[76818]: INFO oslo.privsep.daemon [-] Spawned new privsep daemon via rootwrap May 28 12:43:25 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo.privsep.daemon [-] Accepted privsep connection to /tmp/tmpeu2vnn5e/privsep.sock {{(pid=76818) __init__ /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:362}} May 28 12:43:25 l75lg1-v1 neutron-ovn-metadata-agent[76818]: INFO oslo.privsep.daemon [-] privsep daemon starting May 28 12:43:25 l75lg1-v1 neutron-ovn-metadata-agent[76818]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 May 28 12:43:25 l75lg1-v1 neutron-ovn-metadata-agent[76818]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none May 28 12:43:25 l75lg1-v1 neutron-ovn-metadata-agent[76818]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 77584 May 28 12:43:25 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo.privsep.daemon [-] privsep: reply[131d30fa-4e5d-4db3-be1a-deec597d7f08]: (2,) {{(pid=77584) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: INFO neutron.common.config [-] Logging enabled! May 28 12:43:25 l75lg1-v1 neutron-server[77485]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-server version 24.1.0.dev130 May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-server --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini {{(pid=77485) setup_logging /opt/stack/neutron/neutron/common/config.py:123}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] ******************************************************************************** {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2600}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] Configuration options gathered from: {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2601}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2603}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] ================================================================================ {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2605}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] allow_bulk = True {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] api_extensions_path = {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] api_paste_config = api-paste.ini {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] api_workers = 2 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] auth_strategy = keystone {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] backlog = 4096 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] base_mac = fa:16:3e:00:00:00 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] bind_host = 0.0.0.0 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] bind_port = 9696 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] client_socket_timeout = 900 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] config_dir = [] {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] config_source = [] {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] control_exchange = neutron {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] core_plugin = ml2 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] debug = True {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] default_availability_zones = [] {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] dhcp_agent_notification = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] dhcp_lease_duration = 86400 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] dns_domain = openstacklocal {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] enable_signals = True {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] enable_traditional_dhcp = True {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] external_dns_driver = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] filter_validation = True {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] global_physnet_mtu = 1500 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] host = l75lg1-v1 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] http_retries = 3 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] instance_format = [instance: %(uuid)s] {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] ipam_driver = internal {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] ipv6_pd_enabled = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] log_config_append = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] log_dir = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] log_file = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] log_rotate_interval = 1 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] log_rotate_interval_type = days {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] log_rotation_type = none {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] max_dns_nameservers = 5 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] max_header_line = 16384 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] max_logfile_count = 30 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] max_logfile_size_mb = 200 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] max_subnet_host_routes = 20 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] my_ip = 10.27.203.238 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] my_ipv6 = 2001:67c:9b4:1::1014 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] network_link_prefix = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] notify_nova_on_port_data_changes = True {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] notify_nova_on_port_status_changes = True {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] pagination_max_limit = -1 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] periodic_fuzzy_delay = 5 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] periodic_interval = 40 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] publish_errors = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] rate_limit_burst = 0 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] rate_limit_except_level = CRITICAL {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] rate_limit_interval = 0 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] retry_until_window = 30 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] rpc_response_max_timeout = 600 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] rpc_state_report_workers = 0 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] rpc_workers = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] send_events_interval = 2 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] service_plugins = ['ovn-router'] {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] setproctitle = on {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] state_path = /opt/stack/data/neutron {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] syslog_log_facility = LOG_USER {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] tcp_keepidle = 600 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] transport_url = **** {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] use_eventlog = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] use_journal = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] use_json = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] use_ssl = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] use_stderr = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] use_syslog = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] vlan_transparent = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] watch_log_file = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] wsgi_default_pool_size = 100 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] wsgi_keep_alive = True {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] wsgi_server_debug = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] oslo_concurrency.disable_process_locking = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] profiler.connection_string = messaging:// {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] profiler.enabled = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] profiler.es_doc_type = notification {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] profiler.es_scroll_size = 10000 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] profiler.es_scroll_time = 2m {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] profiler.filter_error_trace = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] profiler.hmac_keys = **** {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] profiler.sentinel_service_name = mymaster {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] profiler.socket_timeout = 0.1 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] profiler.trace_requests = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] profiler.trace_sqlalchemy = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] profiler_jaeger.process_tags = {} {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] profiler_jaeger.service_name_prefix = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] profiler_otlp.service_name_prefix = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] oslo_policy.enforce_new_defaults = True {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] oslo_policy.enforce_scope = True {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] oslo_policy.policy_default_rule = default {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] oslo_messaging_metrics.metrics_process_name = {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] service_providers.service_provider = [] {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] nova.auth_section = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] nova.auth_type = password {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] nova.certfile = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] nova.collect_timing = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] nova.endpoint_type = public {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] nova.insecure = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] nova.keyfile = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] nova.region_name = RegionOne {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] nova.split_loggers = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] nova.timeout = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] placement.auth_section = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] placement.auth_type = password {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] placement.cafile = /opt/stack/data/ca-bundle.pem {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] placement.certfile = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] placement.collect_timing = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] placement.endpoint_type = public {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] placement.insecure = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] placement.keyfile = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] placement.region_name = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] placement.split_loggers = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] placement.timeout = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] ironic.auth_section = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] ironic.auth_type = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] ironic.cafile = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] ironic.certfile = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] ironic.collect_timing = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] ironic.connect_retries = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] ironic.connect_retry_delay = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] ironic.enable_notifications = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] ironic.endpoint_override = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] ironic.insecure = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] ironic.interface = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] ironic.keyfile = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] ironic.max_version = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] ironic.min_version = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] ironic.region_name = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] ironic.retriable_status_codes = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] ironic.service_name = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] ironic.service_type = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] ironic.split_loggers = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] ironic.status_code_retries = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] ironic.status_code_retry_delay = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] ironic.timeout = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] ironic.valid_interfaces = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] ironic.version = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] cli_script.dry_run = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.hostname = l75lg1-v1 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.processname = neutron-server {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_version = {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.use_queue_manager = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] oslo_messaging_notifications.driver = [] {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] oslo_messaging_notifications.retry = -1 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] oslo_messaging_notifications.transport_url = **** {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] oslo_reports.file_event_handler = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] oslo_reports.file_event_handler_interval = 1 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] oslo_reports.log_dir = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG neutron.common.config [-] ******************************************************************************** {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2624}} May 28 12:43:25 l75lg1-v1 neutron-server[77485]: DEBUG oslo.service.wsgi [-] Loading app neutron from /etc/neutron/api-paste.ini {{(pid=77485) load_app /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/wsgi.py:349}} May 28 12:43:25 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "context-manager" by "neutron_lib.db.api._create_context_manager" {{(pid=77584) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:43:25 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_concurrency.lockutils [-] Lock "context-manager" acquired by "neutron_lib.db.api._create_context_manager" :: waited 0.000s {{(pid=77584) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:43:25 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_concurrency.lockutils [-] Lock "context-manager" "released" by "neutron_lib.db.api._create_context_manager" :: held 0.000s {{(pid=77584) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:43:26 l75lg1-v1 neutron-server[77485]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "plugin-directory" by "neutron_lib.plugins.directory._create_plugin_directory" {{(pid=77485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:43:26 l75lg1-v1 neutron-server[77485]: DEBUG oslo_concurrency.lockutils [-] Lock "plugin-directory" acquired by "neutron_lib.plugins.directory._create_plugin_directory" :: waited 0.000s {{(pid=77485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:43:26 l75lg1-v1 neutron-server[77485]: DEBUG oslo_concurrency.lockutils [-] Lock "plugin-directory" "released" by "neutron_lib.plugins.directory._create_plugin_directory" :: held 0.000s {{(pid=77485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:43:26 l75lg1-v1 neutron-server[77485]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "manager" by "neutron.manager.NeutronManager._create_instance" {{(pid=77485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:43:26 l75lg1-v1 neutron-server[77485]: DEBUG oslo_concurrency.lockutils [-] Lock "manager" acquired by "neutron.manager.NeutronManager._create_instance" :: waited 0.000s {{(pid=77485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:43:26 l75lg1-v1 neutron-server[77485]: INFO neutron.manager [-] Loading core plugin: ml2 May 28 12:43:26 l75lg1-v1 dstat.sh[49771]: 28-05 12:43:26| 18 2 79 0 0|2094M 7434M 267M 5905M| 12k 0 | 0 12k| 0 3.00 |1810 2609 |1.40 1.85 1.25|2.0 0 7.0| 0 0 | 0 2048M| 22 59 0 11 0 May 28 12:43:26 l75lg1-v1 neutron-server[77485]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000, False {{(pid=77485) subscribe /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:52}} May 28 12:43:26 l75lg1-v1 neutron-server[77485]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000, False {{(pid=77485) subscribe /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:52}} May 28 12:43:26 l75lg1-v1 neutron-server[77485]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000, False {{(pid=77485) subscribe /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:52}} May 28 12:43:26 l75lg1-v1 neutron-server[77485]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000, False {{(pid=77485) subscribe /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:52}} May 28 12:43:26 l75lg1-v1 neutron-server[77485]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000, False {{(pid=77485) subscribe /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:52}} May 28 12:43:26 l75lg1-v1 neutron-server[77485]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000, False {{(pid=77485) subscribe /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:52}} May 28 12:43:26 l75lg1-v1 neutron-server[77485]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000, False {{(pid=77485) subscribe /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:52}} May 28 12:43:26 l75lg1-v1 neutron-server[77485]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000, False {{(pid=77485) subscribe /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:52}} May 28 12:43:26 l75lg1-v1 neutron-server[77485]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000, False {{(pid=77485) subscribe /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:52}} May 28 12:43:26 l75lg1-v1 neutron-server[77485]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000, False {{(pid=77485) subscribe /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:52}} May 28 12:43:26 l75lg1-v1 neutron-server[77485]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000, False {{(pid=77485) subscribe /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:52}} May 28 12:43:26 l75lg1-v1 neutron-server[77485]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000, False {{(pid=77485) subscribe /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:52}} May 28 12:43:26 l75lg1-v1 neutron-server[77485]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000, False {{(pid=77485) subscribe /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:52}} May 28 12:43:26 l75lg1-v1 neutron-server[77485]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000, False {{(pid=77485) subscribe /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:52}} May 28 12:43:26 l75lg1-v1 neutron-server[77485]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000, False {{(pid=77485) subscribe /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:52}} May 28 12:43:26 l75lg1-v1 neutron-server[77485]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000, False {{(pid=77485) subscribe /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:52}} May 28 12:43:26 l75lg1-v1 neutron-server[77485]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000, False {{(pid=77485) subscribe /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:52}} May 28 12:43:26 l75lg1-v1 neutron-server[77485]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000, False {{(pid=77485) subscribe /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:52}} May 28 12:43:26 l75lg1-v1 neutron-server[77485]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: agent after_create 55550000, False {{(pid=77485) subscribe /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:52}} May 28 12:43:26 l75lg1-v1 neutron-server[77485]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: agent after_update 55550000, False {{(pid=77485) subscribe /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:52}} May 28 12:43:26 l75lg1-v1 neutron-server[77485]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: segment precommit_create 55550000, False {{(pid=77485) subscribe /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:52}} May 28 12:43:26 l75lg1-v1 neutron-server[77485]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: network precommit_delete 55550000, False {{(pid=77485) subscribe /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:52}} May 28 12:43:26 l75lg1-v1 neutron-server[77485]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: segment before_delete 55550000, False {{(pid=77485) subscribe /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:52}} May 28 12:43:26 l75lg1-v1 neutron-server[77485]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network before_delete 55550000, False {{(pid=77485) subscribe /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:52}} May 28 12:43:26 l75lg1-v1 neutron-server[77485]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: agent before_delete 55550000, False {{(pid=77485) subscribe /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:52}} May 28 12:43:26 l75lg1-v1 neutron-server[77485]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network before_create 55550000, False {{(pid=77485) subscribe /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:52}} May 28 12:43:26 l75lg1-v1 neutron-server[77485]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port before_create 55550000, False {{(pid=77485) subscribe /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:52}} May 28 12:43:26 l75lg1-v1 neutron-server[77485]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port before_update 55550000, False {{(pid=77485) subscribe /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:52}} May 28 12:43:26 l75lg1-v1 neutron-server[77485]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment precommit_create 55550000, False {{(pid=77485) subscribe /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:52}} May 28 12:43:26 l75lg1-v1 neutron-server[77485]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment precommit_delete 55550000, False {{(pid=77485) subscribe /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:52}} May 28 12:43:26 l75lg1-v1 neutron-server[77485]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment after_create 55550000, False {{(pid=77485) subscribe /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:52}} May 28 12:43:26 l75lg1-v1 neutron-server[77485]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment after_delete 55550000, False {{(pid=77485) subscribe /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:52}} May 28 12:43:26 l75lg1-v1 neutron-server[77485]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network after_delete 55550000, False {{(pid=77485) subscribe /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:52}} May 28 12:43:26 l75lg1-v1 neutron-server[77485]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network precommit_delete 0, False {{(pid=77485) subscribe /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:52}} May 28 12:43:26 l75lg1-v1 neutron-server[77485]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port provisioning_complete 55550000, False {{(pid=77485) subscribe /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:52}} May 28 12:43:26 l75lg1-v1 neutron-server[77485]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000, False {{(pid=77485) subscribe /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:52}} May 28 12:43:26 l75lg1-v1 neutron-server[77485]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy after_delete 55550000, False {{(pid=77485) subscribe /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:52}} May 28 12:43:26 l75lg1-v1 neutron-server[77485]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > agent after_update 55550000, False {{(pid=77485) subscribe /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:52}} May 28 12:43:26 l75lg1-v1 neutron-server[77485]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > subnet after_delete 55550000, False {{(pid=77485) subscribe /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:52}} May 28 12:43:26 l75lg1-v1 neutron-server[77485]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > subnet precommit_delete 0, False {{(pid=77485) subscribe /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:52}} May 28 12:43:26 l75lg1-v1 neutron-server[77485]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000, False {{(pid=77485) subscribe /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:52}} May 28 12:43:26 l75lg1-v1 neutron-server[77485]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000, False {{(pid=77485) subscribe /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:52}} May 28 12:43:26 l75lg1-v1 neutron-server[77485]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment_host_mapping after_create 55550000, False {{(pid=77485) subscribe /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:52}} May 28 12:43:26 l75lg1-v1 neutron-server[77485]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000, False {{(pid=77485) subscribe /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:52}} May 28 12:43:26 l75lg1-v1 neutron-server[77485]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000, False {{(pid=77485) subscribe /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:52}} May 28 12:43:26 l75lg1-v1 neutron-server[77485]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000, False {{(pid=77485) subscribe /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:52}} May 28 12:43:26 l75lg1-v1 neutron-server[77485]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: network configured {{(pid=77485) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} May 28 12:43:26 l75lg1-v1 neutron-server[77485]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: port configured {{(pid=77485) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} May 28 12:43:26 l75lg1-v1 neutron-server[77485]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: subnet configured {{(pid=77485) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} May 28 12:43:26 l75lg1-v1 neutron-server[77485]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: subnetpool configured {{(pid=77485) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} May 28 12:43:26 l75lg1-v1 neutron-server[77485]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: security_group configured {{(pid=77485) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} May 28 12:43:26 l75lg1-v1 neutron-server[77485]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: security_group_rule configured {{(pid=77485) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} May 28 12:43:26 l75lg1-v1 neutron-server[77485]: INFO neutron.plugins.ml2.managers [-] Configured type driver names: ['local', 'flat', 'vlan', 'geneve'] May 28 12:43:26 l75lg1-v1 neutron-server[77485]: INFO neutron.plugins.ml2.drivers.type_flat [-] Allowable flat physical_network names: ['public'] May 28 12:43:26 l75lg1-v1 neutron-server[77485]: INFO neutron.plugins.ml2.drivers.type_local [-] ML2 LocalTypeDriver initialization complete May 28 12:43:26 l75lg1-v1 neutron-server[77485]: INFO neutron.plugins.ml2.drivers.type_vlan [-] Network VLAN ranges: OrderedDict([('public', [(1, 4094)])]) May 28 12:43:26 l75lg1-v1 neutron-server[77485]: INFO neutron.plugins.ml2.managers [-] Loaded type driver names: ['flat', 'geneve', 'local', 'vlan'] May 28 12:43:26 l75lg1-v1 neutron-server[77485]: INFO neutron.plugins.ml2.managers [-] Registered types: dict_keys(['flat', 'geneve', 'local', 'vlan']) May 28 12:43:26 l75lg1-v1 neutron-server[77485]: INFO neutron.plugins.ml2.managers [-] Tenant network_types: ['geneve'] May 28 12:43:26 l75lg1-v1 neutron-server[77485]: INFO neutron.plugins.ml2.managers [-] Configured extension driver names: ['port_security', 'qos'] May 28 12:43:26 l75lg1-v1 neutron-server[77485]: INFO neutron.plugins.ml2.managers [-] Loaded extension driver names: ['port_security', 'qos'] May 28 12:43:26 l75lg1-v1 neutron-server[77485]: INFO neutron.plugins.ml2.managers [-] Registered extension drivers: ['port_security', 'qos'] May 28 12:43:26 l75lg1-v1 neutron-server[77485]: INFO neutron.plugins.ml2.managers [-] Configured mechanism driver names: ['ovn', 'logger'] May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo.privsep.daemon [-] privsep: reply[92e2d402-a484-449d-9cc8-2ba3d81489be]: (4, []) {{(pid=77584) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbAddCommand(_result=None, table=Chassis_Private, record=0da8323f-64af-4526-b223-049f5737145a, column=external_ids, values=({'neutron:ovn-metadata-id': 'b7c1cbf2-dffa-5cd9-9c1d-e0b97d632cf7'},)) {{(pid=76818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=Chassis_Private, record=0da8323f-64af-4526-b223-049f5737145a, col_values=(('external_ids', {'neutron:ovn-bridge': 'br-int'}),), if_exists=True) {{(pid=76818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] Full set of CONF: {{(pid=76818) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:653}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2600}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] Configuration options gathered from: {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2601}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] command line args: ['--config-file', '/etc/neutron/neutron_ovn_metadata_agent.ini'] {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] config files: ['/etc/neutron/neutron_ovn_metadata_agent.ini'] {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2603}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] ================================================================================ {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2605}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] agent_down_time = 75 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] allow_bulk = True {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] api_extensions_path = {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] api_paste_config = api-paste.ini {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] api_workers = None {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] auth_ca_cert = None {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] auth_strategy = keystone {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] backlog = 4096 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] base_mac = fa:16:3e:00:00:00 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] bind_host = 0.0.0.0 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] bind_port = 9696 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] client_socket_timeout = 900 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] config_dir = [] {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] config_file = ['/etc/neutron/neutron_ovn_metadata_agent.ini'] {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] config_source = [] {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] control_exchange = neutron {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] core_plugin = None {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] debug = True {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] default_availability_zones = [] {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] dhcp_agent_notification = True {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] dhcp_lease_duration = 86400 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] dhcp_load_type = networks {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] dns_domain = openstacklocal {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] enable_new_agents = True {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] enable_signals = True {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] enable_traditional_dhcp = True {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] external_dns_driver = None {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] external_pids = /opt/stack/data/neutron/external/pids {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] filter_validation = True {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] global_physnet_mtu = 1500 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] graceful_shutdown_timeout = 60 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] host = l75lg1-v1 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] http_retries = 3 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] instance_format = [instance: %(uuid)s] {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] ipam_driver = internal {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] ipv6_pd_enabled = False {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] log_config_append = None {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] log_dir = None {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] log_file = None {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] log_options = True {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] log_rotate_interval = 1 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] log_rotate_interval_type = days {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] log_rotation_type = none {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] max_dns_nameservers = 5 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] max_header_line = 16384 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] max_logfile_count = 30 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] max_logfile_size_mb = 200 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] max_subnet_host_routes = 20 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] metadata_backlog = 4096 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] metadata_proxy_group = {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] metadata_proxy_shared_secret = **** {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] metadata_proxy_socket = /opt/stack/data/neutron/metadata_proxy {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] metadata_proxy_socket_mode = deduce {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] metadata_proxy_user = {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] metadata_workers = 2 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] my_ip = 10.27.203.238 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] my_ipv6 = 2001:67c:9b4:1::1014 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] network_link_prefix = None {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] notify_nova_on_port_data_changes = True {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] notify_nova_on_port_status_changes = True {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] nova_client_cert = {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] nova_client_priv_key = {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] nova_metadata_host = 10.27.203.238 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] nova_metadata_insecure = False {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] nova_metadata_port = 8775 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] nova_metadata_protocol = http {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] pagination_max_limit = -1 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] periodic_fuzzy_delay = 5 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] periodic_interval = 40 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] publish_errors = False {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] rate_limit_burst = 0 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] rate_limit_except_level = CRITICAL {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] rate_limit_interval = 0 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] retry_until_window = 30 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] rpc_resources_processing_step = 20 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] rpc_response_max_timeout = 600 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] rpc_state_report_workers = 1 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] rpc_workers = None {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] send_events_interval = 2 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] service_plugins = [] {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] setproctitle = on {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] state_path = /opt/stack/data/neutron {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] syslog_log_facility = LOG_USER {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] tcp_keepidle = 600 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] transport_url = **** {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] use_eventlog = False {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] use_journal = False {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] use_json = False {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] use_ssl = False {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] use_stderr = False {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] use_syslog = False {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] vlan_transparent = False {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] watch_log_file = False {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] wsgi_default_pool_size = 100 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] wsgi_keep_alive = True {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] wsgi_server_debug = False {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] oslo_concurrency.disable_process_locking = False {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] oslo_concurrency.lock_path = None {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] profiler.connection_string = messaging:// {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] profiler.enabled = False {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] profiler.es_doc_type = notification {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] profiler.es_scroll_size = 10000 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] profiler.es_scroll_time = 2m {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] profiler.filter_error_trace = False {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] profiler.hmac_keys = **** {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] profiler.sentinel_service_name = mymaster {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] profiler.socket_timeout = 0.1 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] profiler.trace_requests = False {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] profiler.trace_sqlalchemy = False {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] profiler_jaeger.process_tags = {} {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] profiler_jaeger.service_name_prefix = None {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] profiler_otlp.service_name_prefix = None {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] oslo_policy.enforce_new_defaults = True {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] oslo_policy.enforce_scope = True {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] oslo_policy.policy_default_rule = default {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] oslo_policy.policy_file = policy.yaml {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_process_name = {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] service_providers.service_provider = [] {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] privsep.group = None {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] privsep.helper_command = None {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] privsep.logger_name = oslo_privsep.daemon {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] privsep.thread_pool_size = 10 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] privsep.user = None {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] privsep_dhcp_release.capabilities = [21, 12] {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] privsep_dhcp_release.group = None {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] privsep_dhcp_release.helper_command = None {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] privsep_dhcp_release.thread_pool_size = 10 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] privsep_dhcp_release.user = None {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.group = None {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.helper_command = None {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.thread_pool_size = 10 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.user = None {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] privsep_namespace.capabilities = [21] {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] privsep_namespace.group = None {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] privsep_namespace.helper_command = None {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] privsep_namespace.thread_pool_size = 10 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] privsep_namespace.user = None {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] privsep_conntrack.capabilities = [12] {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] privsep_conntrack.group = None {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] privsep_conntrack.helper_command = None {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] privsep_conntrack.thread_pool_size = 10 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] privsep_conntrack.user = None {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] privsep_link.capabilities = [12, 21] {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] privsep_link.group = None {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] privsep_link.helper_command = None {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] privsep_link.logger_name = oslo_privsep.daemon {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] privsep_link.thread_pool_size = 10 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] privsep_link.user = None {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] AGENT.check_child_processes_action = respawn {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] AGENT.check_child_processes_interval = 60 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] AGENT.comment_iptables_rules = True {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] AGENT.debug_iptables_rules = False {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] AGENT.kill_scripts_path = /etc/neutron/kill_scripts/ {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] AGENT.root_helper = sudo /opt/stack/data/venv/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] AGENT.root_helper_daemon = sudo /opt/stack/data/venv/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] AGENT.use_helper_for_ns_read = True {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] AGENT.use_random_fully = True {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] OVS.bridge_mac_table_size = 50000 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] OVS.bridge_mappings = [] {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] OVS.datapath_type = system {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] OVS.igmp_flood = False {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] OVS.igmp_flood_reports = True {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] OVS.igmp_flood_unregistered = False {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] OVS.igmp_snooping_enable = False {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] OVS.int_peer_patch_port = patch-tun {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] OVS.integration_bridge = br-int {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] OVS.local_ip = None {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] OVS.of_connect_timeout = 300 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] OVS.of_inactivity_probe = 10 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] OVS.of_listen_address = 127.0.0.1 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] OVS.of_listen_port = 6633 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] OVS.of_request_timeout = 300 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] OVS.openflow_processed_per_port = False {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] OVS.ovsdb_connection = tcp:127.0.0.1:6640 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] OVS.ovsdb_debug = False {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] OVS.ovsdb_timeout = 10 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] OVS.resource_provider_bandwidths = [] {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] OVS.resource_provider_default_hypervisor = None {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] OVS.resource_provider_hypervisors = {} {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] OVS.resource_provider_inventory_defaults = {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0} {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] OVS.resource_provider_packet_processing_inventory_defaults = {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0} {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] OVS.resource_provider_packet_processing_with_direction = [] {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] OVS.resource_provider_packet_processing_without_direction = [] {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] OVS.ssl_ca_cert_file = None {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] OVS.ssl_cert_file = None {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] OVS.ssl_key_file = None {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] OVS.tun_peer_patch_port = patch-int {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] OVS.tunnel_bridge = br-tun {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] OVS.vhostuser_socket_dir = /var/run/openvswitch {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] QUOTAS.default_quota = -1 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] QUOTAS.quota_network = 100 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] QUOTAS.quota_port = 500 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group = 10 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group_rule = 100 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] QUOTAS.quota_subnet = 100 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] QUOTAS.track_quota_usage = True {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] agent.extensions = [] {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] nova.auth_section = None {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] nova.auth_type = None {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] nova.cafile = None {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] nova.certfile = None {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] nova.collect_timing = False {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] nova.endpoint_type = public {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] nova.insecure = False {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] nova.keyfile = None {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] nova.region_name = None {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] nova.split_loggers = False {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] nova.timeout = None {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] placement.auth_section = None {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] placement.auth_type = None {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] placement.cafile = None {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] placement.certfile = None {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] placement.collect_timing = False {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] placement.endpoint_type = public {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] placement.insecure = False {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] placement.keyfile = None {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] placement.region_name = None {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] placement.split_loggers = False {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] placement.timeout = None {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] ironic.auth_section = None {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] ironic.auth_type = None {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] ironic.cafile = None {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] ironic.certfile = None {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] ironic.collect_timing = False {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] ironic.connect_retries = None {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] ironic.connect_retry_delay = None {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] ironic.enable_notifications = False {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] ironic.endpoint_override = None {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] ironic.insecure = False {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] ironic.interface = None {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] ironic.keyfile = None {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] ironic.max_version = None {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] ironic.min_version = None {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] ironic.region_name = None {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] ironic.retriable_status_codes = None {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] ironic.service_name = None {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] ironic.service_type = None {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] ironic.split_loggers = False {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] ironic.status_code_retries = None {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] ironic.status_code_retry_delay = None {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] ironic.timeout = None {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] ironic.valid_interfaces = None {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] ironic.version = None {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] cli_script.dry_run = False {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] ovn.allow_stateless_action_supported = True {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] ovn.dhcp_default_lease_time = 43200 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] ovn.disable_ovn_dhcp_for_baremetal_ports = False {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] ovn.dns_servers = [] {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] ovn.enable_distributed_floating_ip = False {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] ovn.fdb_age_threshold = 0 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] ovn.localnet_learn_fdb = False {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] ovn.mac_binding_age_threshold = 0 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] ovn.neutron_sync_mode = log {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] ovn.ovn_dhcp4_global_options = {} {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] ovn.ovn_dhcp6_global_options = {} {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] ovn.ovn_emit_need_to_frag = False {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] ovn.ovn_l3_scheduler = leastloaded {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] ovn.ovn_metadata_enabled = False {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] ovn.ovn_nb_ca_cert = {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] ovn.ovn_nb_certificate = {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] ovn.ovn_nb_connection = tcp:127.0.0.1:6641 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] ovn.ovn_nb_private_key = {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] ovn.ovn_sb_ca_cert = {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] ovn.ovn_sb_certificate = {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] ovn.ovn_sb_connection = tcp:10.27.203.238:6642 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] ovn.ovn_sb_private_key = {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] ovn.ovsdb_connection_timeout = 180 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] ovn.ovsdb_log_level = INFO {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] ovn.ovsdb_probe_interval = 60000 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] ovn.ovsdb_retry_max_interval = 180 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] ovn.vhost_sock_dir = /var/run/openvswitch {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] ovn_nb_global.fdb_removal_limit = 0 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] ovn_nb_global.ignore_lsp_down = False {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] ovn_nb_global.mac_binding_removal_limit = 0 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] metadata_rate_limiting.base_query_rate_limit = 10 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] metadata_rate_limiting.base_window_duration = 10 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] metadata_rate_limiting.burst_query_rate_limit = 10 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] metadata_rate_limiting.burst_window_duration = 10 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] metadata_rate_limiting.ip_versions = [4] {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] metadata_rate_limiting.rate_limit_enabled = False {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] ovs.ovsdb_connection = tcp:127.0.0.1:6640 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] ovs.ovsdb_connection_timeout = 180 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.hostname = l75lg1-v1 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.processname = neutron-ovn-metadata-agent {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl = False {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_version = {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.use_queue_manager = False {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] oslo_messaging_notifications.driver = [] {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] oslo_messaging_notifications.retry = -1 {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] oslo_messaging_notifications.transport_url = **** {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:26 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=76818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2624}} May 28 12:43:26 l75lg1-v1 neutron-server[77485]: INFO neutron.plugins.ml2.managers [-] Loaded mechanism driver names: ['ovn', 'logger'] May 28 12:43:26 l75lg1-v1 neutron-server[77485]: INFO neutron.plugins.ml2.managers [-] Registered mechanism drivers: ['ovn', 'logger'] May 28 12:43:26 l75lg1-v1 neutron-server[77485]: INFO neutron.plugins.ml2.managers [-] No mechanism drivers provide segment reachability information for agent scheduling. May 28 12:43:26 l75lg1-v1 neutron-server[77485]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > floatingip before_response 55550000, False {{(pid=77485) subscribe /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:52}} May 28 12:43:26 l75lg1-v1 neutron-server[77485]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port before_response 55550000, False {{(pid=77485) subscribe /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:52}} May 28 12:43:26 l75lg1-v1 neutron-server[77485]: INFO neutron.plugins.ml2.managers [-] Initializing driver for type 'flat' May 28 12:43:26 l75lg1-v1 neutron-server[77485]: INFO neutron.plugins.ml2.drivers.type_flat [-] ML2 FlatTypeDriver initialization complete May 28 12:43:26 l75lg1-v1 neutron-server[77485]: INFO neutron.plugins.ml2.managers [-] Initializing driver for type 'geneve' May 28 12:43:26 l75lg1-v1 neutron-server[77485]: INFO neutron.plugins.ml2.drivers.type_tunnel [-] geneve ID ranges: [(1, 65536)] May 28 12:43:27 l75lg1-v1 neutron-server[77485]: WARNING oslo_policy.policy [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. May 28 12:43:27 l75lg1-v1 neutron-server[77485]: WARNING oslo_policy.policy [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. May 28 12:43:27 l75lg1-v1 neutron-server[77485]: INFO dbcounter [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Registered counter for database neutron May 28 12:43:27 l75lg1-v1 neutron-server[77485]: DEBUG oslo_db.sqlalchemy.engines [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77485) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:342}} May 28 12:43:27 l75lg1-v1 dstat.sh[49771]: 28-05 12:43:27| 15 2 82 0 0|2143M 7383M 267M 5906M|9853B 172B| 164k 4096B|41.0 1.00 |1851 3638 |1.52 1.87 1.26|1.0 0 5.0| 0 0 | 0 2048M| 22 61 0 11 0 May 28 12:43:27 l75lg1-v1 neutron-server[77485]: DEBUG dbcounter [-] [77485] Writer thread running {{(pid=77485) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} May 28 12:43:28 l75lg1-v1 dstat.sh[49771]: 28-05 12:43:28| 8 1 84 7 0|2149M 7374M 267M 5909M| 14k 0 | 0 8124k| 0 713 |5908 9440 |1.52 1.87 1.26|2.0 1.0 13| 0 0 | 0 2048M| 22 61 0 11 0 May 28 12:43:29 l75lg1-v1 dstat.sh[49771]: 28-05 12:43:29| 8 1 82 8 0|2147M 7362M 267M 5922M| 10k 0 | 0 17M| 0 791 |7179 12k|1.52 1.87 1.26|2.0 1.0 4.0| 0 0 | 0 2048M| 22 61 0 11 0 May 28 12:43:29 l75lg1-v1 neutron-server[77485]: INFO neutron.plugins.ml2.managers [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Initializing driver for type 'local' May 28 12:43:29 l75lg1-v1 neutron-server[77485]: INFO neutron.plugins.ml2.managers [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Initializing driver for type 'vlan' May 28 12:43:29 l75lg1-v1 neutron-server[77485]: INFO neutron.plugins.ml2.drivers.type_vlan [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] VlanTypeDriver initialization complete May 28 12:43:29 l75lg1-v1 neutron-server[77485]: INFO neutron.plugins.ml2.managers [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Initializing extension driver 'port_security' May 28 12:43:29 l75lg1-v1 neutron-server[77485]: INFO neutron.plugins.ml2.extensions.port_security [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] PortSecurityExtensionDriver initialization complete May 28 12:43:29 l75lg1-v1 neutron-server[77485]: INFO neutron.plugins.ml2.managers [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Initializing extension driver 'qos' May 28 12:43:29 l75lg1-v1 neutron-server[77485]: DEBUG neutron.plugins.ml2.extensions.qos [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] QosExtensionDriver initialization complete {{(pid=77485) initialize /opt/stack/neutron/neutron/plugins/ml2/extensions/qos.py:31}} May 28 12:43:29 l75lg1-v1 neutron-server[77485]: INFO neutron.plugins.ml2.managers [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Initializing mechanism driver 'ovn' May 28 12:43:29 l75lg1-v1 neutron-server[77485]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Starting OVNMechanismDriver May 28 12:43:29 l75lg1-v1 neutron-server[77485]: DEBUG neutron_lib.callbacks.manager [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Subscribe: > process before_spawn 55550000, False {{(pid=77485) subscribe /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:52}} May 28 12:43:29 l75lg1-v1 neutron-server[77485]: DEBUG neutron_lib.callbacks.manager [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Subscribe: > process after_init 55550000, True {{(pid=77485) subscribe /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:52}} May 28 12:43:29 l75lg1-v1 neutron-server[77485]: DEBUG neutron_lib.callbacks.manager [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Subscribe: > segment after_create 55550000, False {{(pid=77485) subscribe /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:52}} May 28 12:43:29 l75lg1-v1 neutron-server[77485]: DEBUG neutron_lib.callbacks.manager [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Subscribe: > segment after_create 55550000, False {{(pid=77485) subscribe /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:52}} May 28 12:43:29 l75lg1-v1 neutron-server[77485]: DEBUG neutron_lib.callbacks.manager [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Subscribe: > segment after_delete 55550000, False {{(pid=77485) subscribe /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:52}} May 28 12:43:29 l75lg1-v1 neutron-server[77485]: DEBUG neutron_lib.callbacks.manager [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Subscribe: > security_group precommit_create 55550000, False {{(pid=77485) subscribe /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:52}} May 28 12:43:29 l75lg1-v1 neutron-server[77485]: DEBUG neutron_lib.callbacks.manager [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Subscribe: > security_group after_update 55550000, False {{(pid=77485) subscribe /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:52}} May 28 12:43:29 l75lg1-v1 neutron-server[77485]: DEBUG neutron_lib.callbacks.manager [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Subscribe: > security_group after_create 55550000, False {{(pid=77485) subscribe /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:52}} May 28 12:43:29 l75lg1-v1 neutron-server[77485]: DEBUG neutron_lib.callbacks.manager [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Subscribe: > security_group precommit_delete 55550000, False {{(pid=77485) subscribe /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:52}} May 28 12:43:29 l75lg1-v1 neutron-server[77485]: DEBUG neutron_lib.callbacks.manager [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Subscribe: > security_group after_delete 55550000, False {{(pid=77485) subscribe /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:52}} May 28 12:43:29 l75lg1-v1 neutron-server[77485]: DEBUG neutron_lib.callbacks.manager [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Subscribe: > security_group_rule precommit_create 55550000, False {{(pid=77485) subscribe /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:52}} May 28 12:43:29 l75lg1-v1 neutron-server[77485]: DEBUG neutron_lib.callbacks.manager [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Subscribe: > security_group_rule after_create 55550000, False {{(pid=77485) subscribe /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:52}} May 28 12:43:29 l75lg1-v1 neutron-server[77485]: DEBUG neutron_lib.callbacks.manager [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Subscribe: > security_group_rule before_delete 55550000, False {{(pid=77485) subscribe /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:52}} May 28 12:43:29 l75lg1-v1 neutron-server[77485]: DEBUG neutron_lib.callbacks.manager [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Subscribe: > qos_plugin after_init 55550000, False {{(pid=77485) subscribe /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:52}} May 28 12:43:29 l75lg1-v1 neutron-server[77485]: DEBUG neutron_lib.callbacks.manager [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Subscribe: > trunk_plugin after_init 55550000, False {{(pid=77485) subscribe /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:52}} May 28 12:43:29 l75lg1-v1 neutron-server[77485]: DEBUG neutron_lib.callbacks.manager [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Subscribe: > logging-plugin after_init 55550000, False {{(pid=77485) subscribe /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:52}} May 28 12:43:29 l75lg1-v1 neutron-server[77485]: INFO neutron.services.logapi.drivers.ovn.driver [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] OVN logging driver registered May 28 12:43:29 l75lg1-v1 neutron-server[77485]: INFO neutron.plugins.ml2.managers [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Initializing mechanism driver 'logger' May 28 12:43:29 l75lg1-v1 neutron-server[77485]: DEBUG neutron.plugins.ml2.plugin [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] neutron.plugins.ml2.plugin.Ml2Plugin method _start_rpc_notifiers called with arguments () {} {{(pid=77485) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} May 28 12:43:29 l75lg1-v1 neutron-server[77485]: DEBUG neutron_lib.callbacks.manager [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Subscribe: > port after_create 55550000, False {{(pid=77485) subscribe /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:52}} May 28 12:43:29 l75lg1-v1 neutron-server[77485]: DEBUG neutron_lib.callbacks.manager [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Subscribe: > port after_update 55550000, False {{(pid=77485) subscribe /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:52}} May 28 12:43:29 l75lg1-v1 neutron-server[77485]: DEBUG neutron_lib.callbacks.manager [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Subscribe: > port after_delete 55550000, False {{(pid=77485) subscribe /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:52}} May 28 12:43:29 l75lg1-v1 neutron-server[77485]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[port] started {{(pid=77485) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:112}} May 28 12:43:29 l75lg1-v1 neutron-server[77485]: DEBUG neutron_lib.callbacks.manager [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Subscribe: > subnet after_create 55550000, False {{(pid=77485) subscribe /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:52}} May 28 12:43:29 l75lg1-v1 neutron-server[77485]: DEBUG neutron_lib.callbacks.manager [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Subscribe: > subnet after_update 55550000, False {{(pid=77485) subscribe /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:52}} May 28 12:43:29 l75lg1-v1 neutron-server[77485]: DEBUG neutron_lib.callbacks.manager [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Subscribe: > subnet after_delete 55550000, False {{(pid=77485) subscribe /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:52}} May 28 12:43:29 l75lg1-v1 neutron-server[77485]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[subnet] started {{(pid=77485) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:112}} May 28 12:43:29 l75lg1-v1 neutron-server[77485]: DEBUG neutron_lib.callbacks.manager [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Subscribe: > network after_create 55550000, False {{(pid=77485) subscribe /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:52}} May 28 12:43:29 l75lg1-v1 neutron-server[77485]: DEBUG neutron_lib.callbacks.manager [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Subscribe: > network after_update 55550000, False {{(pid=77485) subscribe /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:52}} May 28 12:43:29 l75lg1-v1 neutron-server[77485]: DEBUG neutron_lib.callbacks.manager [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Subscribe: > network after_delete 55550000, False {{(pid=77485) subscribe /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:52}} May 28 12:43:29 l75lg1-v1 neutron-server[77485]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[network] started {{(pid=77485) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:112}} May 28 12:43:29 l75lg1-v1 neutron-server[77485]: DEBUG neutron_lib.callbacks.manager [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Subscribe: > security_group after_create 55550000, False {{(pid=77485) subscribe /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:52}} May 28 12:43:29 l75lg1-v1 neutron-server[77485]: DEBUG neutron_lib.callbacks.manager [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Subscribe: > security_group after_update 55550000, False {{(pid=77485) subscribe /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:52}} May 28 12:43:29 l75lg1-v1 neutron-server[77485]: DEBUG neutron_lib.callbacks.manager [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Subscribe: > security_group after_delete 55550000, False {{(pid=77485) subscribe /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:52}} May 28 12:43:29 l75lg1-v1 neutron-server[77485]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[security_group] started {{(pid=77485) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:112}} May 28 12:43:29 l75lg1-v1 neutron-server[77485]: DEBUG neutron_lib.callbacks.manager [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Subscribe: > security_group_rule after_create 55550000, False {{(pid=77485) subscribe /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:52}} May 28 12:43:29 l75lg1-v1 neutron-server[77485]: DEBUG neutron_lib.callbacks.manager [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Subscribe: > security_group_rule after_update 55550000, False {{(pid=77485) subscribe /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:52}} May 28 12:43:29 l75lg1-v1 neutron-server[77485]: DEBUG neutron_lib.callbacks.manager [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Subscribe: > security_group_rule after_delete 55550000, False {{(pid=77485) subscribe /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:52}} May 28 12:43:29 l75lg1-v1 neutron-server[77485]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[security_group_rule] started {{(pid=77485) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:112}} May 28 12:43:29 l75lg1-v1 neutron-server[77485]: DEBUG neutron_lib.callbacks.manager [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Subscribe: > address_group after_create 55550000, False {{(pid=77485) subscribe /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:52}} May 28 12:43:29 l75lg1-v1 neutron-server[77485]: DEBUG neutron_lib.callbacks.manager [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Subscribe: > address_group after_update 55550000, False {{(pid=77485) subscribe /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:52}} May 28 12:43:29 l75lg1-v1 neutron-server[77485]: DEBUG neutron_lib.callbacks.manager [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Subscribe: > address_group after_delete 55550000, False {{(pid=77485) subscribe /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:52}} May 28 12:43:29 l75lg1-v1 neutron-server[77485]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[address_group] started {{(pid=77485) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:112}} May 28 12:43:29 l75lg1-v1 neutron-server[77485]: DEBUG oslo_concurrency.lockutils [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Acquiring lock "singleton_lock" {{(pid=77485) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} May 28 12:43:29 l75lg1-v1 neutron-server[77485]: DEBUG oslo_concurrency.lockutils [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Acquired lock "singleton_lock" {{(pid=77485) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} May 28 12:43:29 l75lg1-v1 neutron-server[77485]: DEBUG oslo_concurrency.lockutils [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Releasing lock "singleton_lock" {{(pid=77485) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} May 28 12:43:29 l75lg1-v1 neutron-server[77485]: DEBUG neutron.plugins.ml2.ovo_rpc [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] ML2 OVO RPC backend initialized. {{(pid=77485) __init__ /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:165}} May 28 12:43:29 l75lg1-v1 neutron-server[77485]: INFO neutron.quota [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loaded quota_driver: . May 28 12:43:29 l75lg1-v1 neutron-server[77485]: INFO neutron.plugins.ml2.plugin [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Modular L2 Plugin initialization complete May 28 12:43:29 l75lg1-v1 neutron-server[77485]: DEBUG neutron.manager [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loading services supported by the core plugin {{(pid=77485) _load_services_from_core_plugin /opt/stack/neutron/neutron/manager.py:168}} May 28 12:43:29 l75lg1-v1 neutron-server[77485]: INFO neutron.plugins.ml2.managers [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Got port-security extension from driver 'port_security' May 28 12:43:29 l75lg1-v1 neutron-server[77485]: INFO neutron.extensions.vlantransparent [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Disabled vlantransparent extension. May 28 12:43:29 l75lg1-v1 neutron-server[77485]: DEBUG neutron.manager [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loading service plugins: ['ovn-router', 'auto_allocate', 'tag', 'timestamp', 'network_ip_availability', 'flavors', 'revisions'] {{(pid=77485) _load_service_plugins /opt/stack/neutron/neutron/manager.py:194}} May 28 12:43:29 l75lg1-v1 neutron-server[77485]: INFO neutron.manager [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loading Plugin: ovn-router May 28 12:43:29 l75lg1-v1 neutron-server[77485]: DEBUG neutron_lib.callbacks.manager [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Subscribe: > router before_delete 55550000, False {{(pid=77485) subscribe /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:52}} May 28 12:43:29 l75lg1-v1 neutron-server[77485]: DEBUG neutron_lib.callbacks.manager [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Subscribe: port after_update 55550000, False {{(pid=77485) subscribe /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:52}} May 28 12:43:29 l75lg1-v1 neutron-server[77485]: DEBUG neutron_lib.callbacks.manager [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Subscribe: port after_delete 55550000, False {{(pid=77485) subscribe /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:52}} May 28 12:43:29 l75lg1-v1 neutron-server[77485]: DEBUG neutron_lib.callbacks.manager [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Subscribe: subnet after_update 55550000, False {{(pid=77485) subscribe /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:52}} May 28 12:43:29 l75lg1-v1 neutron-server[77485]: DEBUG neutron_lib.callbacks.manager [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Subscribe: subnetpool_address_scope after_update 55550000, False {{(pid=77485) subscribe /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:52}} May 28 12:43:29 l75lg1-v1 neutron-server[77485]: DEBUG neutron_lib.callbacks.manager [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Subscribe: port before_update 55550000, False {{(pid=77485) subscribe /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:52}} May 28 12:43:29 l75lg1-v1 neutron-server[77485]: DEBUG neutron_lib.callbacks.manager [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Subscribe: port after_update 55550000, False {{(pid=77485) subscribe /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:52}} May 28 12:43:29 l75lg1-v1 neutron-server[77485]: DEBUG neutron_lib.callbacks.manager [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Subscribe: > port precommit_delete 55550000, False {{(pid=77485) subscribe /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:52}} May 28 12:43:29 l75lg1-v1 neutron-server[77485]: DEBUG neutron_lib.callbacks.manager [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Subscribe: port before_update 55550000, False {{(pid=77485) subscribe /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:52}} May 28 12:43:29 l75lg1-v1 neutron-server[77485]: DEBUG neutron_lib.callbacks.manager [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Subscribe: port before_delete 55550000, False {{(pid=77485) subscribe /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:52}} May 28 12:43:29 l75lg1-v1 neutron-server[77485]: DEBUG neutron_lib.callbacks.manager [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Subscribe: > router precommit_create 55550000, False {{(pid=77485) subscribe /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:52}} May 28 12:43:29 l75lg1-v1 neutron-server[77485]: DEBUG neutron_lib.callbacks.manager [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Subscribe: > router precommit_create 55550000, False {{(pid=77485) subscribe /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:52}} May 28 12:43:29 l75lg1-v1 neutron-server[77485]: DEBUG neutron_lib.callbacks.manager [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Subscribe: > router precommit_update 55550000, False {{(pid=77485) subscribe /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:52}} May 28 12:43:29 l75lg1-v1 neutron-server[77485]: DEBUG neutron_lib.callbacks.manager [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Subscribe: subnet after_update 55550000, False {{(pid=77485) subscribe /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:52}} May 28 12:43:29 l75lg1-v1 neutron-server[77485]: DEBUG neutron.quota.resource_registry [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Tracking information for resource: router configured {{(pid=77485) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} May 28 12:43:29 l75lg1-v1 neutron-server[77485]: DEBUG neutron.quota.resource_registry [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Tracking information for resource: floatingip configured {{(pid=77485) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} May 28 12:43:29 l75lg1-v1 neutron-server[77485]: INFO neutron.services.ovn_l3.plugin [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Starting OVNL3RouterPlugin May 28 12:43:29 l75lg1-v1 neutron-server[77485]: DEBUG neutron_lib.callbacks.manager [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Subscribe: > port_forwarding_plugin after_init 55550000, False {{(pid=77485) subscribe /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:52}} May 28 12:43:29 l75lg1-v1 neutron-server[77485]: DEBUG neutron_lib.callbacks.manager [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Subscribe: > router before_create 55550100, False {{(pid=77485) subscribe /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:52}} May 28 12:43:29 l75lg1-v1 neutron-server[77485]: DEBUG neutron_lib.callbacks.manager [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Subscribe: > router precommit_delete 55550100, False {{(pid=77485) subscribe /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:52}} May 28 12:43:29 l75lg1-v1 neutron-server[77485]: DEBUG neutron_lib.callbacks.manager [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Subscribe: > router precommit_create 55550100, False {{(pid=77485) subscribe /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:52}} May 28 12:43:29 l75lg1-v1 neutron-server[77485]: DEBUG neutron_lib.callbacks.manager [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Subscribe: > router precommit_update 55550100, False {{(pid=77485) subscribe /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:52}} May 28 12:43:29 l75lg1-v1 neutron-server[77485]: DEBUG neutron.services.provider_configuration [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Service providers = [] {{(pid=77485) parse_service_provider_opt /opt/stack/neutron/neutron/services/provider_configuration.py:171}} May 28 12:43:29 l75lg1-v1 neutron-server[77485]: DEBUG neutron.db.servicetype_db [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Adding provider configuration for service L3_ROUTER_NAT {{(pid=77485) add_provider_configuration /opt/stack/neutron/neutron/db/servicetype_db.py:42}} May 28 12:43:29 l75lg1-v1 neutron-server[77485]: DEBUG neutron_lib.callbacks.manager [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Subscribe: > router precommit_create 55549900, False {{(pid=77485) subscribe /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:52}} May 28 12:43:29 l75lg1-v1 neutron-server[77485]: DEBUG neutron_lib.callbacks.manager [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Subscribe: > router_interface after_create 55550000, False {{(pid=77485) subscribe /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:52}} May 28 12:43:29 l75lg1-v1 neutron-server[77485]: DEBUG neutron_lib.callbacks.manager [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Subscribe: > floatingip after_create 55550000, False {{(pid=77485) subscribe /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:52}} May 28 12:43:29 l75lg1-v1 neutron-server[77485]: DEBUG neutron_lib.callbacks.manager [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Subscribe: > floatingip precommit_create 55550000, False {{(pid=77485) subscribe /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:52}} May 28 12:43:29 l75lg1-v1 neutron-server[77485]: DEBUG neutron_lib.callbacks.manager [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Subscribe: > floatingip precommit_update 55550000, False {{(pid=77485) subscribe /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:52}} May 28 12:43:29 l75lg1-v1 neutron-server[77485]: DEBUG neutron_lib.callbacks.manager [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Subscribe: > floatingip after_delete 55550000, False {{(pid=77485) subscribe /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:52}} May 28 12:43:29 l75lg1-v1 neutron-server[77485]: DEBUG neutron_lib.callbacks.manager [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Subscribe: > floatingip after_status_update 55550000, False {{(pid=77485) subscribe /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:52}} May 28 12:43:29 l75lg1-v1 neutron-server[77485]: DEBUG neutron_lib.callbacks.manager [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Subscribe: > floatingip after_update 55550000, False {{(pid=77485) subscribe /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:52}} May 28 12:43:29 l75lg1-v1 neutron-server[77485]: DEBUG neutron_lib.callbacks.manager [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Subscribe: > port_forwarding after_create 55550000, False {{(pid=77485) subscribe /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:52}} May 28 12:43:29 l75lg1-v1 neutron-server[77485]: DEBUG neutron_lib.callbacks.manager [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Subscribe: > router_interface after_delete 55550000, False {{(pid=77485) subscribe /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:52}} May 28 12:43:29 l75lg1-v1 neutron-server[77485]: DEBUG neutron_lib.callbacks.manager [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Subscribe: > router after_create 55550000, False {{(pid=77485) subscribe /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:52}} May 28 12:43:29 l75lg1-v1 neutron-server[77485]: DEBUG neutron_lib.callbacks.manager [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Subscribe: > router precommit_create 55550000, False {{(pid=77485) subscribe /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:52}} May 28 12:43:29 l75lg1-v1 neutron-server[77485]: DEBUG neutron_lib.callbacks.manager [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Subscribe: > router after_delete 55550000, False {{(pid=77485) subscribe /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:52}} May 28 12:43:29 l75lg1-v1 neutron-server[77485]: DEBUG neutron_lib.callbacks.manager [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Subscribe: > router after_update 55550000, False {{(pid=77485) subscribe /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:52}} May 28 12:43:29 l75lg1-v1 neutron-server[77485]: DEBUG neutron.services.service_base [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loaded 'neutron.services.ovn_l3.service_providers.ovn.OvnDriver' provider for service L3_ROUTER_NAT {{(pid=77485) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}} May 28 12:43:29 l75lg1-v1 neutron-server[77485]: DEBUG neutron.manager [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Successfully loaded L3_ROUTER_NAT plugin. Description: L3 Router Service Plugin for basic L3 forwarding using OVN {{(pid=77485) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} May 28 12:43:29 l75lg1-v1 neutron-server[77485]: INFO neutron.manager [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loading Plugin: auto_allocate May 28 12:43:29 l75lg1-v1 neutron-server[77485]: DEBUG neutron_lib.callbacks.manager [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Subscribe: network precommit_update 55550000, False {{(pid=77485) subscribe /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:52}} May 28 12:43:29 l75lg1-v1 neutron-server[77485]: DEBUG neutron_lib.callbacks.manager [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Subscribe: network precommit_create 55550000, False {{(pid=77485) subscribe /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:52}} May 28 12:43:29 l75lg1-v1 neutron-server[77485]: DEBUG neutron.manager [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Successfully loaded auto-allocated-topology plugin. Description: Auto Allocated Topology - aka get me a network. {{(pid=77485) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} May 28 12:43:29 l75lg1-v1 neutron-server[77485]: INFO neutron.manager [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loading Plugin: tag May 28 12:43:29 l75lg1-v1 neutron-server[77485]: DEBUG neutron.manager [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Successfully loaded TAG plugin. Description: Tag support {{(pid=77485) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} May 28 12:43:29 l75lg1-v1 neutron-server[77485]: INFO neutron.manager [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loading Plugin: timestamp May 28 12:43:29 l75lg1-v1 neutron-server[77485]: DEBUG neutron.manager [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Successfully loaded timestamp plugin. Description: Adds timestamps to Neutron resources with standard attributes {{(pid=77485) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} May 28 12:43:29 l75lg1-v1 neutron-server[77485]: INFO neutron.manager [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loading Plugin: network_ip_availability May 28 12:43:29 l75lg1-v1 neutron-server[77485]: DEBUG neutron_lib.callbacks.manager [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Subscribe: > rbac-policy before_create 55550000, False {{(pid=77485) subscribe /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:52}} May 28 12:43:29 l75lg1-v1 neutron-server[77485]: DEBUG neutron_lib.callbacks.manager [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Subscribe: > rbac-policy before_update 55550000, False {{(pid=77485) subscribe /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:52}} May 28 12:43:29 l75lg1-v1 neutron-server[77485]: DEBUG neutron_lib.callbacks.manager [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Subscribe: > rbac-policy before_delete 55550000, False {{(pid=77485) subscribe /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:52}} May 28 12:43:29 l75lg1-v1 neutron-server[77485]: DEBUG neutron.manager [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Successfully loaded network-ip-availability plugin. Description: Provides IP availability data for each network and subnet. {{(pid=77485) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} May 28 12:43:29 l75lg1-v1 neutron-server[77485]: INFO neutron.manager [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loading Plugin: flavors May 28 12:43:29 l75lg1-v1 neutron-server[77485]: DEBUG neutron.manager [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Successfully loaded FLAVORS plugin. Description: Neutron Flavors and Service Profiles manager plugin {{(pid=77485) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} May 28 12:43:29 l75lg1-v1 neutron-server[77485]: INFO neutron.manager [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loading Plugin: revisions May 28 12:43:29 l75lg1-v1 neutron-server[77485]: DEBUG neutron.manager [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Successfully loaded revision_plugin plugin. Description: Adds revision numbers to resources. {{(pid=77485) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} May 28 12:43:29 l75lg1-v1 neutron-server[77485]: DEBUG oslo_concurrency.lockutils [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Lock "manager" "released" by "neutron.manager.NeutronManager._create_instance" :: held 3.955s {{(pid=77485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:43:29 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] get_extension_paths = OrderedDict([('/opt/stack/neutron/neutron/extensions', 1)]) {{(pid=77485) get_extensions_path /opt/stack/neutron/neutron/api/extensions.py:642}} May 28 12:43:29 l75lg1-v1 neutron-server[77485]: INFO neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Initializing extension manager. May 28 12:43:29 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loading extension file: __init__.py {{(pid=77485) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 28 12:43:29 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loading extension file: __pycache__ {{(pid=77485) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 28 12:43:29 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loading extension file: address_group.py {{(pid=77485) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 28 12:43:29 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Ext name="Address group" alias="address-group" description="Support address group" updated="2020-07-15T10:00:00-00:00" {{(pid=77485) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 28 12:43:29 l75lg1-v1 neutron-server[77485]: INFO neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loaded extension: address-group May 28 12:43:29 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loading extension file: address_scope.py {{(pid=77485) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 28 12:43:29 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Ext name="Address scope" alias="address-scope" description="Address scopes extension." updated="2015-07-26T10:00:00-00:00" {{(pid=77485) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 28 12:43:29 l75lg1-v1 neutron-server[77485]: INFO neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loaded extension: address-scope May 28 12:43:29 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loading extension file: admin_state_down_before_update.py {{(pid=77485) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 28 12:43:29 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Ext name="Enforce Router's Admin State Down Before Update Extension" alias="router-admin-state-down-before-update" description="Ensure that the admin state of a router is DOWN (admin_state_up=False) before updating the distributed attribute" updated="2019-07-02T15:56:00" {{(pid=77485) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 28 12:43:29 l75lg1-v1 neutron-server[77485]: INFO neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Extension router-admin-state-down-before-update not supported by any of loaded plugins May 28 12:43:29 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loading extension file: agent.py {{(pid=77485) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 28 12:43:29 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Ext name="agent" alias="agent" description="The agent management extension." updated="2013-02-03T10:00:00-00:00" {{(pid=77485) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 28 12:43:29 l75lg1-v1 neutron-server[77485]: INFO neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loaded extension: agent May 28 12:43:29 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loading extension file: agent_resources_synced.py {{(pid=77485) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 28 12:43:29 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Ext name="Agent's Resource View Synced to Placement" alias="agent-resources-synced" description="Stores success/failure of last sync to Placement" updated="2018-12-19T00:00:00-00:00" {{(pid=77485) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 28 12:43:29 l75lg1-v1 neutron-server[77485]: INFO neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Extension agent-resources-synced not supported by any of loaded plugins May 28 12:43:29 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loading extension file: allowedaddresspairs.py {{(pid=77485) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 28 12:43:29 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Ext name="Allowed Address Pairs" alias="allowed-address-pairs" description="Provides allowed address pairs" updated="2013-07-23T10:00:00-00:00" {{(pid=77485) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 28 12:43:29 l75lg1-v1 neutron-server[77485]: INFO neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loaded extension: allowed-address-pairs May 28 12:43:29 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loading extension file: auto_allocated_topology.py {{(pid=77485) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 28 12:43:29 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Ext name="Auto Allocated Topology Services" alias="auto-allocated-topology" description="Auto Allocated Topology Services." updated="2016-01-01T00:00:00-00:00" {{(pid=77485) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 28 12:43:29 l75lg1-v1 neutron-server[77485]: INFO neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loaded extension: auto-allocated-topology May 28 12:43:29 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loading extension file: availability_zone.py {{(pid=77485) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 28 12:43:29 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Ext name="Availability Zone" alias="availability_zone" description="The availability zone extension." updated="2015-01-01T10:00:00-00:00" {{(pid=77485) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 28 12:43:29 l75lg1-v1 neutron-server[77485]: INFO neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loaded extension: availability_zone May 28 12:43:29 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loading extension file: availability_zone_filter.py {{(pid=77485) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 28 12:43:29 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Ext name="Availability Zone Filter Extension" alias="availability_zone_filter" description="Add filter parameters to AvailabilityZone resource" updated="2018-06-22T10:00:00-00:00" {{(pid=77485) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 28 12:43:29 l75lg1-v1 neutron-server[77485]: INFO neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Extension availability_zone_filter not supported by any of loaded plugins May 28 12:43:29 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loading extension file: data_plane_status.py {{(pid=77485) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Ext name="Port data plane status extension" alias="data-plane-status" description="Expose status of underlying data plane" updated="2017-01-24T10:00:00-00:00" {{(pid=77485) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: INFO neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Extension data-plane-status not supported by any of loaded plugins May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loading extension file: default_subnetpools.py {{(pid=77485) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Ext name="Default Subnetpools" alias="default-subnetpools" description="Provides ability to mark and use a subnetpool as the default." updated="2016-02-18T18:00:00-00:00" {{(pid=77485) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: INFO neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loaded extension: default-subnetpools May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loading extension file: dhcpagentscheduler.py {{(pid=77485) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Ext name="DHCP Agent Scheduler" alias="dhcp_agent_scheduler" description="Schedule networks among dhcp agents" updated="2013-02-07T10:00:00-00:00" {{(pid=77485) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: INFO neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loaded extension: dhcp_agent_scheduler May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loading extension file: dns.py {{(pid=77485) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Ext name="DNS Integration" alias="dns-integration" description="Provides integration with DNS." updated="2015-08-15T18:00:00-00:00" {{(pid=77485) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: INFO neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loaded extension: dns-integration May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loading extension file: dns_domain_ports.py {{(pid=77485) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Ext name="dns_domain for ports" alias="dns-domain-ports" description="Allows the DNS domain to be specified for a network port." updated="2017-04-24T10:00:00-00:00" {{(pid=77485) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: INFO neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loaded extension: dns-domain-ports May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loading extension file: dns_integration_domain_keywords.py {{(pid=77485) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Ext name="DNS domain names with keywords allowed" alias="dns-integration-domain-keywords" description="Allows to use keywords like , , and as DNS domain name" updated="2020-06-15T18:00:00-00:00" {{(pid=77485) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: INFO neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loaded extension: dns-integration-domain-keywords May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loading extension file: dvr.py {{(pid=77485) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Ext name="Distributed Virtual Router" alias="dvr" description="Enables configuration of Distributed Virtual Routers." updated="2014-06-1T10:00:00-00:00" {{(pid=77485) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: INFO neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Extension dvr not supported by any of loaded plugins May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loading extension file: ecmp_routes.py {{(pid=77485) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Ext name="Equal Cost Multipath Routing" alias="ecmp_routes" description="Allows traffic to reach thesame destination via multiple different links " updated="2020-11-26T18:00:00-00:00" {{(pid=77485) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: INFO neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Extension ecmp_routes not supported by any of loaded plugins May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loading extension file: empty_string_filtering.py {{(pid=77485) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Ext name="Empty String Filtering Extension" alias="empty-string-filtering" description="Allow filtering by attributes with empty string value" updated="2018-05-01T10:00:00-00:00" {{(pid=77485) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: INFO neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Extension empty-string-filtering not supported by any of loaded plugins May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loading extension file: expose_l3_conntrack_helper.py {{(pid=77485) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Ext name="Expose CT target rules for conntrack helper" alias="expose-l3-conntrack-helper" description="Expose allow adding CT target rules for conntrack helper" updated="2019-04-04T10:00:00-00:00" {{(pid=77485) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: INFO neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Extension expose-l3-conntrack-helper not supported by any of loaded plugins May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loading extension file: expose_port_forwarding_in_fip.py {{(pid=77485) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Ext name="Expose Floating IP port forwardings" alias="expose-port-forwarding-in-fip" description="Expose port forwarding fields in floating IP response" updated="2018-06-28T16:00:00-00:00" {{(pid=77485) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: INFO neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Extension expose-port-forwarding-in-fip not supported by any of loaded plugins May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loading extension file: external_net.py {{(pid=77485) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Ext name="Neutron external network" alias="external-net" description="Adds external network attribute to network resource." updated="2013-01-14T10:00:00-00:00" {{(pid=77485) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: INFO neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loaded extension: external-net May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loading extension file: extra_dhcp_opt.py {{(pid=77485) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Ext name="Neutron Extra DHCP options" alias="extra_dhcp_opt" description="Extra options configuration for DHCP. For example PXE boot options to DHCP clients can be specified (e.g. tftp-server, server-ip-address, bootfile-name)" updated="2013-03-17T12:00:00-00:00" {{(pid=77485) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: INFO neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loaded extension: extra_dhcp_opt May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loading extension file: extraroute.py {{(pid=77485) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Ext name="Neutron Extra Route" alias="extraroute" description="Extra routes configuration for L3 router" updated="2013-02-01T10:00:00-00:00" {{(pid=77485) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: INFO neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loaded extension: extraroute May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loading extension file: extraroute_atomic.py {{(pid=77485) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Ext name="Atomically add/remove extra routes" alias="extraroute-atomic" description="Edit extra routes of a router on server side by atomically adding/removing extra routes" updated="2019-07-10T00:00:00+00:00" {{(pid=77485) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: INFO neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Extension extraroute-atomic not supported by any of loaded plugins May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loading extension file: filter_validation.py {{(pid=77485) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Ext name="Filter parameters validation" alias="filter-validation" description="Provides validation on filter parameters." updated="2018-07-04T10:00:00-00:00" {{(pid=77485) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: INFO neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loaded extension: filter-validation May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loading extension file: fip_pf_description.py {{(pid=77485) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Ext name="Floating IP Port Forwarding new attribute description" alias="floating-ip-port-forwarding-description" description="Add a description field to Port Forwarding rules" updated="2019-11-01T10:00:00-00:00" {{(pid=77485) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: INFO neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Extension floating-ip-port-forwarding-description not supported by any of loaded plugins May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loading extension file: fip_pf_detail.py {{(pid=77485) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Ext name="Floating IP port forwarding detail" alias="floating-ip-port-forwarding-detail" description="Allow list floating ip return more port forwarding data, include'id' and 'internal_port_id'" updated="2022-05-06T10:00:00-00:00" {{(pid=77485) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: INFO neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loaded extension: floating-ip-port-forwarding-detail May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loading extension file: fip_pf_port_range.py {{(pid=77485) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Ext name="Floating IP Port Forwarding support port ranges" alias="floating-ip-port-forwarding-port-ranges" description="Add suport to port ranges" updated="2020-07-01T10:00:00-00:00" {{(pid=77485) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: INFO neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Extension floating-ip-port-forwarding-port-ranges not supported by any of loaded plugins May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loading extension file: fip_port_details.py {{(pid=77485) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Ext name="Floating IP Port Details Extension" alias="fip-port-details" description="Add port_details attribute to Floating IP resource" updated="2018-04-09T10:00:00-00:00" {{(pid=77485) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: INFO neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loaded extension: fip-port-details May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loading extension file: flavors.py {{(pid=77485) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Ext name="Neutron Service Flavors" alias="flavors" description="Flavor specification for Neutron advanced services." updated="2015-09-17T10:00:00-00:00" {{(pid=77485) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: INFO neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loaded extension: flavors May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loading extension file: floating_ip_port_forwarding.py {{(pid=77485) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Ext name="Floating IP Port Forwarding" alias="floating-ip-port-forwarding" description="Allow port forwarding from floating IP port to an internal port" updated="2018-01-19T10:00:00-00:00" {{(pid=77485) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: INFO neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Extension floating-ip-port-forwarding not supported by any of loaded plugins May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loading extension file: floatingip_pools.py {{(pid=77485) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Ext name="Floating IP Pools Extension" alias="floatingip-pools" description="Provides a floating IP pools API." updated="2018-03-21T10:00:00-00:00" {{(pid=77485) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: INFO neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loaded extension: floatingip-pools May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loading extension file: ip_allocation.py {{(pid=77485) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Ext name="IP Allocation" alias="ip_allocation" description="IP allocation extension." updated="2016-06-10T23:00:00-00:00" {{(pid=77485) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: INFO neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Extension ip_allocation not supported by any of loaded plugins May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loading extension file: ip_substring_port_filtering.py {{(pid=77485) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Ext name="IP address substring filtering" alias="ip-substring-filtering" description="Provides IP address substring filtering when listing ports" updated="2017-11-28T09:00:00-00:00" {{(pid=77485) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: INFO neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Extension ip-substring-filtering not supported by any of loaded plugins May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loading extension file: l2_adjacency.py {{(pid=77485) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Ext name="L2 Adjacency" alias="l2_adjacency" description="Display L2 Adjacency for Neutron Networks." updated="2016-04-12T16:00:00-00:00" {{(pid=77485) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: INFO neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Extension l2_adjacency not supported by any of loaded plugins May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loading extension file: l3.py {{(pid=77485) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Ext name="Neutron L3 Router" alias="router" description="Router abstraction for basic L3 forwarding between L2 Neutron networks and access to external networks via a NAT gateway." updated="2012-07-20T10:00:00-00:00" {{(pid=77485) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: INFO neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loaded extension: router May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loading extension file: l3_conntrack_helper.py {{(pid=77485) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Ext name="L3 Conntrack helper" alias="l3-conntrack-helper" description="Allow adding CT target rules for conntrack helper" updated="2019-04-04T10:00:00-00:00" {{(pid=77485) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: INFO neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Extension l3-conntrack-helper not supported by any of loaded plugins May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loading extension file: l3_enable_default_route_bfd.py {{(pid=77485) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Ext name="Enable Default Route BFD" alias="enable-default-route-bfd" description="Enables configurable BFD behavior for default routes" updated="2023-02-27T00:00:00-00:00" {{(pid=77485) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: INFO neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loaded extension: enable-default-route-bfd May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loading extension file: l3_enable_default_route_ecmp.py {{(pid=77485) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Ext name="Enable Default Route ECMP" alias="enable-default-route-ecmp" description="Enables configurable ECMP behavior for default routes" updated="2023-02-27T00:00:00-00:00" {{(pid=77485) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: INFO neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loaded extension: enable-default-route-ecmp May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loading extension file: l3_ext_gw_mode.py {{(pid=77485) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Ext name="Neutron L3 Configurable external gateway mode" alias="ext-gw-mode" description="Extension of the router abstraction for specifying whether SNAT should occur on the external gateway" updated="2013-03-28T10:00:00-00:00" {{(pid=77485) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: INFO neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loaded extension: ext-gw-mode May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loading extension file: l3_ext_ha_mode.py {{(pid=77485) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Ext name="HA Router extension" alias="l3-ha" description="Adds HA capability to routers." updated="2014-04-26T00:00:00-00:00" {{(pid=77485) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: INFO neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loaded extension: l3-ha May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loading extension file: l3_ext_ndp_proxy.py {{(pid=77485) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Ext name="Router support to enable NDP proxy" alias="l3-ext-ndp-proxy" description="Router extension to enable ndp proxy" updated="2020-08-25T00:00:00-00:00" {{(pid=77485) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: INFO neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Extension l3-ext-ndp-proxy not supported by any of loaded plugins May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loading extension file: l3_extra_gws.py {{(pid=77485) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Ext name="Neutron L3 External Gateway Multihoming" alias="external-gateway-multihoming" description="Allow multiple external gateway ports per router" updated="2023-01-18T00:00:00-00:00" {{(pid=77485) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: INFO neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loaded extension: external-gateway-multihoming May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loading extension file: l3_flavors.py {{(pid=77485) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Ext name="Router Flavor Extension" alias="l3-flavors" description="Flavor support for routers." updated="2016-05-17T00:00:00-00:00" {{(pid=77485) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: INFO neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loaded extension: l3-flavors May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loading extension file: l3_ndp_proxy.py {{(pid=77485) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Ext name="name" alias="l3-ndp-proxy" description="description" updated="2021-06-29T10:00:00-00:00" {{(pid=77485) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: INFO neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Extension l3-ndp-proxy not supported by any of loaded plugins May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loading extension file: l3_port_ip_change_not_allowed.py {{(pid=77485) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Ext name="Prevent L3 router ports IP address change extension" alias="l3-port-ip-change-not-allowed" description="Prevent change of IP address for some L3 router ports" updated="2018-10-09T10:00:00-00:00" {{(pid=77485) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: INFO neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Extension l3-port-ip-change-not-allowed not supported by any of loaded plugins May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loading extension file: l3agentscheduler.py {{(pid=77485) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Ext name="L3 Agent Scheduler" alias="l3_agent_scheduler" description="Schedule routers among l3 agents" updated="2013-02-07T10:00:00-00:00" {{(pid=77485) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: INFO neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Extension l3_agent_scheduler not supported by any of loaded plugins May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loading extension file: local_ip.py {{(pid=77485) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Ext name="Local IP" alias="local_ip" description="Support Node Local Virtual IP" updated="2021-07-26T10:00:00-00:00" {{(pid=77485) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: INFO neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Extension local_ip not supported by any of loaded plugins May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loading extension file: logging.py {{(pid=77485) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Ext name="Logging API Extension" alias="logging" description="Provides a logging API for resources such as security group and firewall." updated="2017-01-01T10:00:00-00:00" {{(pid=77485) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: INFO neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Extension logging not supported by any of loaded plugins May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loading extension file: metering.py {{(pid=77485) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Ext name="Neutron Metering" alias="metering" description="Neutron Metering extension." updated="2013-06-12T10:00:00-00:00" {{(pid=77485) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: INFO neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Extension metering not supported by any of loaded plugins May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loading extension file: metering_source_and_destination_fields.py {{(pid=77485) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Ext name="Neutron Metering with source and destination filtering" alias="metering_source_and_destination_fields" description="Neutron Metering extension that enables the use of source and destination IP prefixes to create metering label rules." updated="2020-08-21T08:12:00-00:00" {{(pid=77485) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: INFO neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Extension metering_source_and_destination_fields not supported by any of loaded plugins May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loading extension file: multiprovidernet.py {{(pid=77485) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Ext name="Multi Provider Network" alias="multi-provider" description="Expose mapping of virtual networks to multiple physical networks" updated="2013-06-27T10:00:00-00:00" {{(pid=77485) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: INFO neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loaded extension: multi-provider May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loading extension file: netmtu.py {{(pid=77485) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Ext name="Network MTU" alias="net-mtu" description="Provides MTU attribute for a network resource." updated="2015-03-25T10:00:00-00:00" {{(pid=77485) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: INFO neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loaded extension: net-mtu May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loading extension file: netmtu_writable.py {{(pid=77485) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Ext name="Network MTU (writable)" alias="net-mtu-writable" description="Provides a writable MTU attribute for a network resource." updated="2017-07-12T00:00:00-00:00" {{(pid=77485) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: INFO neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loaded extension: net-mtu-writable May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loading extension file: network_availability_zone.py {{(pid=77485) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Ext name="Network Availability Zone" alias="network_availability_zone" description="Availability zone support for network." updated="2015-01-01T10:00:00-00:00" {{(pid=77485) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: INFO neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loaded extension: network_availability_zone May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loading extension file: network_ha.py {{(pid=77485) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Ext name="Network HA creation flag" alias="network_ha" description="Network high availability creation flag." updated="2023-04-27T10:00:00-00:00" {{(pid=77485) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: INFO neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Extension network_ha not supported by any of loaded plugins May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loading extension file: network_ip_availability.py {{(pid=77485) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Ext name="Network IP Availability" alias="network-ip-availability" description="Provides IP availability data for each network and subnet." updated="2015-09-24T00:00:00-00:00" {{(pid=77485) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: INFO neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loaded extension: network-ip-availability May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loading extension file: network_segment_range.py {{(pid=77485) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Ext name="Neutron Network Segment Range" alias="network-segment-range" description="Provides support for the network segment range management" updated="2018-11-29T00:00:00-00:00" {{(pid=77485) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: INFO neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Extension network-segment-range not supported by any of loaded plugins May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loading extension file: pagination.py {{(pid=77485) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Ext name="Pagination support" alias="pagination" description="Extension that indicates that pagination is enabled." updated="2016-06-12T00:00:00-00:00" {{(pid=77485) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: INFO neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loaded extension: pagination May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loading extension file: port_device_profile.py {{(pid=77485) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Ext name="Port device profile" alias="port-device-profile" description="Expose the port device profile (Cyborg)" updated="2020-12-17T10:00:00-00:00" {{(pid=77485) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: INFO neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loaded extension: port-device-profile May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loading extension file: port_hardware_offload_type.py {{(pid=77485) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Ext name="Port hardware offload" alias="port-hardware-offload-type" description="Expose port hardware offload extension" updated="2023-05-09T10:00:00-00:00" {{(pid=77485) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: INFO neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loaded extension: port-hardware-offload-type May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loading extension file: port_hint_ovs_tx_steering.py {{(pid=77485) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Ext name="Port hint: Open vSwitch Tx steering" alias="port-hint-ovs-tx-steering" description="Enable Port hint: Open vSwitch Tx steering" updated="2023-01-01T00:00:00-00:00" {{(pid=77485) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: INFO neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Extension port-hint-ovs-tx-steering not supported by any of loaded plugins May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loading extension file: port_hints.py {{(pid=77485) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Ext name="Port hints" alias="port-hints" description="Backend specific port hints to allow backend specific tuning" updated="2023-01-01T00:00:00-00:00" {{(pid=77485) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: INFO neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Extension port-hints not supported by any of loaded plugins May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loading extension file: port_mac_address_override.py {{(pid=77485) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Ext name="Neutron Port MAC address override" alias="port-mac-override" description="Allow overriding the MAC address of a direct-physical Port via the active binding profile" updated="2022-03-18T10:00:00-00:00" {{(pid=77485) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: INFO neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Extension port-mac-override not supported by any of loaded plugins May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loading extension file: port_mac_address_regenerate.py {{(pid=77485) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Ext name="Neutron Port MAC address regenerate" alias="port-mac-address-regenerate" description="Network port MAC address regenerate" updated="2018-05-03T10:00:00-00:00" {{(pid=77485) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: INFO neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loaded extension: port-mac-address-regenerate May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loading extension file: port_numa_affinity_policy.py {{(pid=77485) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Ext name="Port NUMA affinity policy" alias="port-numa-affinity-policy" description="Expose the port NUMA affinity policy" updated="2020-07-08T10:00:00-00:00" {{(pid=77485) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: INFO neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loaded extension: port-numa-affinity-policy May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loading extension file: port_numa_affinity_policy_socket.py {{(pid=77485) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Ext name="Port NUMA affinity policy "socket"" alias="port-numa-affinity-policy-socket" description="Adds "socket" to the supported port NUMA affinity policies" updated="2024-02-09T10:00:00-00:00" {{(pid=77485) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: INFO neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loaded extension: port-numa-affinity-policy-socket May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loading extension file: port_resource_request.py {{(pid=77485) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Ext name="Port Resource Request" alias="port-resource-request" description="Expose resource request to Port" updated="2018-05-08T10:00:00-00:00" {{(pid=77485) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: INFO neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Extension port-resource-request not supported by any of loaded plugins May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loading extension file: port_resource_request_groups.py {{(pid=77485) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Ext name="Port Resource Request Groups" alias="port-resource-request-groups" description="Support requesting multiple groups of resources and traits from the same RP subtree in resource_request" updated="2021-08-02T10:00:00-00:00" {{(pid=77485) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: INFO neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Extension port-resource-request-groups not supported by any of loaded plugins May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loading extension file: portbindings.py {{(pid=77485) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Ext name="Port Binding" alias="binding" description="Expose port bindings of a virtual port to external application" updated="2014-02-03T10:00:00-00:00" {{(pid=77485) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: INFO neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loaded extension: binding May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loading extension file: portbindings_extended.py {{(pid=77485) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Ext name="Port Bindings Extended" alias="binding-extended" description="Expose port bindings of a virtual port to external application" updated="2017-07-17T10:00:00-00:00" {{(pid=77485) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: INFO neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loaded extension: binding-extended May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loading extension file: portsecurity.py {{(pid=77485) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Ext name="Port Security" alias="port-security" description="Provides port security" updated="2012-07-23T10:00:00-00:00" {{(pid=77485) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: INFO neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loaded extension: port-security May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loading extension file: project_id.py {{(pid=77485) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Ext name="project_id field enabled" alias="project-id" description="Extension that indicates that project_id field is enabled." updated="2016-09-09T09:09:09-09:09" {{(pid=77485) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: INFO neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loaded extension: project-id May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loading extension file: providernet.py {{(pid=77485) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Ext name="Provider Network" alias="provider" description="Expose mapping of virtual networks to physical networks" updated="2012-09-07T10:00:00-00:00" {{(pid=77485) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: INFO neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loaded extension: provider May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loading extension file: qos.py {{(pid=77485) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Ext name="Quality of Service" alias="qos" description="The Quality of Service extension." updated="2015-06-08T10:00:00-00:00" {{(pid=77485) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: INFO neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Extension qos not supported by any of loaded plugins May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loading extension file: qos_bw_limit_direction.py {{(pid=77485) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Ext name="Direction for QoS bandwidth limit rule" alias="qos-bw-limit-direction" description="Allow to configure QoS bandwidth limit rule with specific direction: ingress or egress" updated="2017-04-10T10:00:00-00:00" {{(pid=77485) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: INFO neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Extension qos-bw-limit-direction not supported by any of loaded plugins May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loading extension file: qos_bw_minimum_ingress.py {{(pid=77485) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Ext name="Ingress direction for QoS minimum bandwidth rule" alias="qos-bw-minimum-ingress" description="Allow to configure QoS minumum bandwidth rule with ingress direction." updated="2018-07-09T10:00:00-00:00" {{(pid=77485) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: INFO neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Extension qos-bw-minimum-ingress not supported by any of loaded plugins May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loading extension file: qos_default.py {{(pid=77485) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Ext name="QoS default policy" alias="qos-default" description="Expose the QoS default policy per project" updated="2017-041-06T10:00:00-00:00" {{(pid=77485) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: INFO neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Extension qos-default not supported by any of loaded plugins May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loading extension file: qos_fip.py {{(pid=77485) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Ext name="Floating IP QoS" alias="qos-fip" description="The floating IP Quality of Service extension" updated="2017-07-20T00:00:00-00:00" {{(pid=77485) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: INFO neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Extension qos-fip not supported by any of loaded plugins May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loading extension file: qos_fip_network_policy.py {{(pid=77485) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Ext name="QoS floating IP network policy ID" alias="qos-fip-network-policy" description="Adds a the QoS network ID to the floating IP definition" updated="2021-11-15T10:00:00-00:00" {{(pid=77485) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: INFO neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Extension qos-fip-network-policy not supported by any of loaded plugins May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loading extension file: qos_gateway_ip.py {{(pid=77485) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Ext name="Router gateway IP QoS" alias="qos-gateway-ip" description="The Router gateway IP Quality of Service extension" updated="2018-02-24T00:00:00-00:00" {{(pid=77485) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: INFO neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Extension qos-gateway-ip not supported by any of loaded plugins May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loading extension file: qos_port_network_policy.py {{(pid=77485) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Ext name="QoS port network policy ID" alias="qos-port-network-policy" description="Adds a the QoS network ID to the port definition" updated="2019-11-01T10:00:00-00:00" {{(pid=77485) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: INFO neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Extension qos-port-network-policy not supported by any of loaded plugins May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loading extension file: qos_pps_minimum_rule.py {{(pid=77485) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Ext name="QoS minimum packet rate rule" alias="qos-pps-minimum" description="Allow to configure QoS minimum packet rate rule." updated="2021-07-14T10:00:00-00:00" {{(pid=77485) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: INFO neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Extension qos-pps-minimum not supported by any of loaded plugins May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loading extension file: qos_pps_minimum_rule_alias.py {{(pid=77485) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Ext name="QoS minimum packet rate rule alias" alias="qos-pps-minimum-rule-alias" description="API to enable GET, PUT and DELETE operations on QoS minimum packet rate rule without specifying policy ID" updated="2021-10-22T10:00:00-00:00" {{(pid=77485) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: INFO neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Extension qos-pps-minimum-rule-alias not supported by any of loaded plugins May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loading extension file: qos_pps_rule.py {{(pid=77485) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Ext name="QoS Rule Type Packet per Second Extension" alias="qos-pps" description="Add QoS Rule Type Packet per Second" updated="2021-05-12T10:00:00-00:00" {{(pid=77485) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: INFO neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Extension qos-pps not supported by any of loaded plugins May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loading extension file: qos_rule_type_details.py {{(pid=77485) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Ext name="Details of QoS rule types" alias="qos-rule-type-details" description="Expose details about QoS rule types supported by loaded backend drivers" updated="2017-06-22T10:00:00-00:00" {{(pid=77485) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: INFO neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Extension qos-rule-type-details not supported by any of loaded plugins May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loading extension file: qos_rule_type_filter.py {{(pid=77485) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Ext name="Allow to filter the list of QoS rule types" alias="qos-rule-type-filter" description="Allows to filter the QoS rule type list adding two new flags. "all_rules" prints all implemented QoS rule types."all_supported" prints all supported QoS rule types by the loaded mechanism drivers" updated="2022-02-02T10:00:00-00:00" {{(pid=77485) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: INFO neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Extension qos-rule-type-filter not supported by any of loaded plugins May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loading extension file: qos_rules_alias.py {{(pid=77485) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Ext name="Quality of Service rules alias API" alias="qos-rules-alias" description="API to enable GET, PUT and DELETE operations on QoS policy rules without specifying policy ID" updated="2018-10-07T10:00:00-00:00" {{(pid=77485) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: INFO neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Extension qos-rules-alias not supported by any of loaded plugins May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loading extension file: quota_check_limit.py {{(pid=77485) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Ext name="Quota engine limit check" alias="quota-check-limit" description="Support for checking the resource usage before applying a new quota limit" updated="2021-09-08T16:00:00-00:00" {{(pid=77485) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: INFO neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loaded extension: quota-check-limit May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loading extension file: quotasv2.py {{(pid=77485) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Ext name="Quota management support" alias="quotas" description="Expose functions for quotas management per project" updated="2012-07-29T10:00:00-00:00" {{(pid=77485) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: INFO neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loaded extension: quotas May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loading extension file: quotasv2_detail.py {{(pid=77485) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Ext name="Quota details management support" alias="quota_details" description="Expose functions for quotas usage statistics per project" updated="2017-02-10T10:00:00-00:00" {{(pid=77485) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: INFO neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loaded extension: quota_details May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loading extension file: rbac.py {{(pid=77485) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Ext name="RBAC Policies" alias="rbac-policies" description="Allows creation and modification of policies that control tenant access to resources." updated="2015-06-17T12:15:12-00:00" {{(pid=77485) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: INFO neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loaded extension: rbac-policies May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loading extension file: rbac_address_group.py {{(pid=77485) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Ext name="Add address_group type to RBAC" alias="rbac-address-group" description="Add address_group type to network RBAC" updated="2021-01-20T00:00:00-00:00" {{(pid=77485) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: INFO neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Extension rbac-address-group not supported by any of loaded plugins May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loading extension file: rbac_address_scope.py {{(pid=77485) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Ext name="Add address_scope type to RBAC" alias="rbac-address-scope" description="Add address_scope type to RBAC" updated="2020-02-12T00:00:00-00:00" {{(pid=77485) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: INFO neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loaded extension: rbac-address-scope May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loading extension file: rbac_security_groups.py {{(pid=77485) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Ext name="Add security_group type to network RBAC" alias="rbac-security-groups" description="Add security_group type to network RBAC" updated="2019-02-14T00:00:00-00:00" {{(pid=77485) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: INFO neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loaded extension: rbac-security-groups May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loading extension file: rbac_subnetpool.py {{(pid=77485) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Ext name="Add subnetpool type to RBAC" alias="rbac-subnetpool" description="Add subnetpool type to RBAC" updated="2020-02-05T00:00:00-00:00" {{(pid=77485) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: INFO neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Extension rbac-subnetpool not supported by any of loaded plugins May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loading extension file: revisionifmatch.py {{(pid=77485) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Ext name="If-Match constraints based on revision_number" alias="revision-if-match" description="Extension indicating that If-Match based on revision_number is supported." updated="2016-12-11T00:00:00-00:00" {{(pid=77485) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: INFO neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loaded extension: revision-if-match May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loading extension file: revisions.py {{(pid=77485) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Ext name="Resource revision numbers" alias="standard-attr-revisions" description="This extension will display the revision number of neutron resources." updated="2016-04-11T10:00:00-00:00" {{(pid=77485) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: INFO neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loaded extension: standard-attr-revisions May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loading extension file: router_availability_zone.py {{(pid=77485) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Ext name="Router Availability Zone" alias="router_availability_zone" description="Availability zone support for router." updated="2015-01-01T10:00:00-00:00" {{(pid=77485) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: INFO neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loaded extension: router_availability_zone May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loading extension file: routerservicetype.py {{(pid=77485) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Ext name="Router Service Type" alias="router-service-type" description="Provides router service type" updated="2013-01-29T00:00:00-00:00" {{(pid=77485) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: INFO neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Extension router-service-type not supported by any of loaded plugins May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loading extension file: security_groups_default_rules.py {{(pid=77485) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Ext name="Default rules for security groups" alias="security-groups-default-rules" description="Configure set of security group rules used as default rules for every new security group" updated="2022-12-19T10:00:00-00:00" {{(pid=77485) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: INFO neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loaded extension: security-groups-default-rules May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loading extension file: security_groups_normalized_cidr.py {{(pid=77485) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Ext name="Normalized CIDR field for security group rules" alias="security-groups-normalized-cidr" description="Add new field with normalized remote_ip_prefix cidr in SG rule" updated="2020-07-28T10:00:00-00:00" {{(pid=77485) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: INFO neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loaded extension: security-groups-normalized-cidr May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loading extension file: security_groups_port_filtering.py {{(pid=77485) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Ext name="Port filtering on security groups" alias="port-security-groups-filtering" description="Provides security groups filtering when listing ports" updated="2018-01-09T09:00:00-00:00" {{(pid=77485) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: INFO neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Extension port-security-groups-filtering not supported by any of loaded plugins May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loading extension file: security_groups_remote_address_group.py {{(pid=77485) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Ext name="Remote address group id field for security group rules" alias="security-groups-remote-address-group" description="Add new field of remote address group id in SG rules" updated="2020-08-25T10:00:00-00:00" {{(pid=77485) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: INFO neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loaded extension: security-groups-remote-address-group May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loading extension file: security_groups_rules_belongs_to_default_sg.py {{(pid=77485) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Ext name="Security group rule belongs to the project's default security group" alias="security-groups-rules-belongs-to-default-sg" description="Flag to determine if the security group rule belongs to the project's default security group" updated="2023-05-23T10:00:00-00:00" {{(pid=77485) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: INFO neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loaded extension: security-groups-rules-belongs-to-default-sg May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loading extension file: security_groups_shared_filtering.py {{(pid=77485) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Ext name="Security group filtering on the shared field" alias="security-groups-shared-filtering" description="Support filtering security groups on the shared field" updated="2021-10-05T09:00:00-00:00" {{(pid=77485) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: INFO neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loaded extension: security-groups-shared-filtering May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loading extension file: securitygroup.py {{(pid=77485) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Ext name="security-group" alias="security-group" description="The security groups extension." updated="2012-10-05T10:00:00-00:00" {{(pid=77485) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: INFO neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loaded extension: security-group May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loading extension file: segment.py {{(pid=77485) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Ext name="Segment" alias="segment" description="Segments extension." updated="2016-02-24T17:00:00-00:00" {{(pid=77485) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: INFO neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Extension segment not supported by any of loaded plugins May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loading extension file: segments_peer_subnet_host_routes.py {{(pid=77485) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Ext name="Segments peer-subnet host routes" alias="segments-peer-subnet-host-routes" description="Add host routes to subnets on a routed network (segments)" updated="2018-06-12T10:00:00-00:00" {{(pid=77485) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: INFO neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Extension segments-peer-subnet-host-routes not supported by any of loaded plugins May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loading extension file: servicetype.py {{(pid=77485) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Ext name="Neutron Service Type Management" alias="service-type" description="API for retrieving service providers for Neutron advanced services" updated="2013-01-20T00:00:00-00:00" {{(pid=77485) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: INFO neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loaded extension: service-type May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loading extension file: sorting.py {{(pid=77485) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Ext name="Sorting support" alias="sorting" description="Extension that indicates that sorting is enabled." updated="2016-06-12T00:00:00-00:00" {{(pid=77485) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: INFO neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loaded extension: sorting May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loading extension file: standard_attr_segment.py {{(pid=77485) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Ext name="Standard Attribute Segment Extension" alias="standard-attr-segment" description="Add standard attributes to Segment resource" updated="2018-04-09T10:00:00-00:00" {{(pid=77485) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: INFO neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Extension standard-attr-segment not supported by any of loaded plugins May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loading extension file: standardattrdescription.py {{(pid=77485) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Ext name="standard-attr-description" alias="standard-attr-description" description="Extension to add descriptions to standard attributes" updated="2016-02-10T10:00:00-00:00" {{(pid=77485) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: INFO neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loaded extension: standard-attr-description May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loading extension file: stateful_security_group.py {{(pid=77485) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Ext name="Stateful security group" alias="stateful-security-group" description="Indicates if the security group is stateful or not" updated="2019-11-26T09:00:00-00:00" {{(pid=77485) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: INFO neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loaded extension: stateful-security-group May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loading extension file: stdattrs_common.py {{(pid=77485) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: WARNING neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Did not find expected name "Stdattrs_common" in /opt/stack/neutron/neutron/extensions/stdattrs_common.py May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loading extension file: subnet_dns_publish_fixed_ip.py {{(pid=77485) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Ext name="Subnet DNS publish fixed IP" alias="subnet-dns-publish-fixed-ip" description="Support choosing to publish DNS records for IPs from a subnet" updated="2019-05-24T10:00:00-00:00" {{(pid=77485) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: INFO neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loaded extension: subnet-dns-publish-fixed-ip May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loading extension file: subnet_onboard.py {{(pid=77485) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Ext name="Subnet Onboard" alias="subnet_onboard" description="Provides support for onboarding subnets into subnet pools" updated="2018-12-18T09:00:00-00:00" {{(pid=77485) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: INFO neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Extension subnet_onboard not supported by any of loaded plugins May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loading extension file: subnet_segmentid_writable.py {{(pid=77485) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Ext name="Subnet SegmentID (writable)" alias="subnet-segmentid-writable" description="Provides a writable segment_id attribute for a subnet resource." updated="2018-03-12T00:00:00-00:00" {{(pid=77485) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: INFO neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Extension subnet-segmentid-writable not supported by any of loaded plugins May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loading extension file: subnet_service_types.py {{(pid=77485) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Ext name="Subnet service types" alias="subnet-service-types" description="Provides ability to set the subnet service_types field" updated="2016-03-15T18:00:00-00:00" {{(pid=77485) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: INFO neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loaded extension: subnet-service-types May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loading extension file: subnetallocation.py {{(pid=77485) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Ext name="Subnet Allocation" alias="subnet_allocation" description="Enables allocation of subnets from a subnet pool" updated="2015-03-30T10:00:00-00:00" {{(pid=77485) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: INFO neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loaded extension: subnet_allocation May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loading extension file: subnetpool_prefix_ops.py {{(pid=77485) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Ext name="Subnet Pool Prefix Operations" alias="subnetpool-prefix-ops" description="Provides support for adjusting the prefix list of subnet pools" updated="2019-02-08T10:00:00-00:00" {{(pid=77485) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: INFO neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loaded extension: subnetpool-prefix-ops May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loading extension file: tag_ports_during_bulk_creation.py {{(pid=77485) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Ext name="Tag Ports During Bulk Creation" alias="tag-ports-during-bulk-creation" description="Allow to tag ports during bulk creation" updated="2019-12-29T19:00:00-00:00" {{(pid=77485) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: INFO neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Extension tag-ports-during-bulk-creation not supported by any of loaded plugins May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loading extension file: tagging.py {{(pid=77485) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Ext name="Tag support for resources with standard attribute: port, subnet, subnetpool, network, security_group, router, floatingip, policy, trunk, network_segment_range" alias="standard-attr-tag" description="Enables to set tag on resources with standard attribute." updated="2017-01-01T00:00:00-00:00" {{(pid=77485) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: INFO neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loaded extension: standard-attr-tag May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loading extension file: timestamp.py {{(pid=77485) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Ext name="Resource timestamps" alias="standard-attr-timestamp" description="Adds created_at and updated_at fields to all Neutron resources that have Neutron standard attributes." updated="2016-09-12T10:00:00-00:00" {{(pid=77485) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: INFO neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loaded extension: standard-attr-timestamp May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loading extension file: trunk.py {{(pid=77485) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Ext name="Trunk Extension" alias="trunk" description="Provides support for trunk ports" updated="2016-01-01T10:00:00-00:00" {{(pid=77485) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: INFO neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Extension trunk not supported by any of loaded plugins May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loading extension file: trunk_details.py {{(pid=77485) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Ext name="Trunk port details" alias="trunk-details" description="Expose trunk port details" updated="2016-01-01T10:00:00-00:00" {{(pid=77485) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: INFO neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Extension trunk-details not supported by any of loaded plugins May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loading extension file: uplink_status_propagation.py {{(pid=77485) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Ext name="Uplink status propagation extension" alias="uplink-status-propagation" description="Provides ability to propagate port uplink status." updated="2018-05-31T18:00:00-00:00" {{(pid=77485) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: INFO neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Extension uplink-status-propagation not supported by any of loaded plugins May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Loading extension file: vlantransparent.py {{(pid=77485) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Ext name="Vlantransparent" alias="vlan-transparent" description="Provides Vlan Transparent Networks" updated="2015-03-23T09:00:00-00:00" {{(pid=77485) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: INFO neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Extension vlan-transparent not supported by any of loaded plugins May 28 12:43:30 l75lg1-v1 neutron-server[77485]: INFO neutron.quota.resource_registry [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Creating instance of TrackedResource for resource:network May 28 12:43:30 l75lg1-v1 neutron-server[77485]: INFO neutron.quota.resource_registry [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Creating instance of TrackedResource for resource:subnet May 28 12:43:30 l75lg1-v1 neutron-server[77485]: INFO neutron.quota.resource_registry [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Creating instance of TrackedResource for resource:subnetpool May 28 12:43:30 l75lg1-v1 neutron-server[77485]: INFO neutron.quota.resource_registry [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Creating instance of TrackedResource for resource:port May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.v2.resource_helper [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Service FLAVORS assigned prefix: {{(pid=77485) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.v2.resource_helper [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=77485) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.v2.resource_helper [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=77485) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: INFO neutron.quota.resource_registry [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Creating instance of TrackedResource for resource:router May 28 12:43:30 l75lg1-v1 neutron-server[77485]: INFO neutron.quota.resource_registry [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Creating instance of TrackedResource for resource:floatingip May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron_lib.callbacks.manager [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Subscribe: > rbac-policy before_create 55550000, False {{(pid=77485) subscribe /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:52}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron_lib.callbacks.manager [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Subscribe: > rbac-policy before_update 55550000, False {{(pid=77485) subscribe /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:52}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron_lib.callbacks.manager [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Subscribe: > rbac-policy before_delete 55550000, False {{(pid=77485) subscribe /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:52}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: INFO neutron.quota.resource_registry [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Creating instance of CountableResource for resource:rbac_policy May 28 12:43:30 l75lg1-v1 neutron-server[77485]: INFO neutron.quota.resource_registry [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Creating instance of TrackedResource for resource:security_group May 28 12:43:30 l75lg1-v1 neutron-server[77485]: INFO neutron.quota.resource_registry [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Creating instance of TrackedResource for resource:security_group_rule May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.v2.resource_helper [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Service CORE assigned prefix: {{(pid=77485) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: INFO neutron.quota.resource_registry [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Creating instance of TrackedResource for resource:subnetpool May 28 12:43:30 l75lg1-v1 neutron-server[77485]: WARNING neutron.quota.resource_registry [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] subnetpool is already registered May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.v2.resource_helper [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Service FLAVORS assigned prefix: {{(pid=77485) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.v2.resource_helper [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=77485) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.v2.resource_helper [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=77485) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: INFO neutron.quota.resource_registry [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Creating instance of TrackedResource for resource:router May 28 12:43:30 l75lg1-v1 neutron-server[77485]: WARNING neutron.quota.resource_registry [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] router is already registered May 28 12:43:30 l75lg1-v1 neutron-server[77485]: INFO neutron.quota.resource_registry [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Creating instance of TrackedResource for resource:floatingip May 28 12:43:30 l75lg1-v1 neutron-server[77485]: WARNING neutron.quota.resource_registry [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] floatingip is already registered May 28 12:43:30 l75lg1-v1 neutron-server[77485]: INFO neutron.quota.resource_registry [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Creating instance of CountableResource for resource:rbac_policy May 28 12:43:30 l75lg1-v1 neutron-server[77485]: WARNING neutron.quota.resource_registry [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] rbac_policy is already registered May 28 12:43:30 l75lg1-v1 neutron-server[77485]: INFO neutron.quota.resource_registry [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Creating instance of TrackedResource for resource:security_group May 28 12:43:30 l75lg1-v1 neutron-server[77485]: WARNING neutron.quota.resource_registry [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] security_group is already registered May 28 12:43:30 l75lg1-v1 neutron-server[77485]: INFO neutron.quota.resource_registry [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Creating instance of TrackedResource for resource:security_group_rule May 28 12:43:30 l75lg1-v1 neutron-server[77485]: WARNING neutron.quota.resource_registry [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] security_group_rule is already registered May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.v2.resource_helper [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Service CORE assigned prefix: {{(pid=77485) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: INFO neutron.quota.resource_registry [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Creating instance of TrackedResource for resource:subnetpool May 28 12:43:30 l75lg1-v1 neutron-server[77485]: WARNING neutron.quota.resource_registry [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] subnetpool is already registered May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Extended resource: extensions {{(pid=77485) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Extended resource: address-groups {{(pid=77485) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Extended resource: address-scopes {{(pid=77485) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Extended resource: agents {{(pid=77485) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Extended resource: auto-allocated-topology {{(pid=77485) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Extended resource: availability_zones {{(pid=77485) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Extended resource: dhcp-networks {{(pid=77485) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Extended resource: dhcp-agents {{(pid=77485) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Extended resource: flavors {{(pid=77485) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Extended resource: service_profiles {{(pid=77485) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Extended resource: next_providers {{(pid=77485) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Extended resource: service_profiles {{(pid=77485) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Extended resource: floatingip-pools {{(pid=77485) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Extended resource: routers {{(pid=77485) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Extended resource: floatingips {{(pid=77485) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Extended resource: network-ip-availabilities {{(pid=77485) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Extended resource: bindings {{(pid=77485) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Extended resource: quotas {{(pid=77485) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Extended resource: quotas {{(pid=77485) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Extended resource: rbac-policies {{(pid=77485) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Extended resource: default-security-group-rules {{(pid=77485) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Extended resource: security-groups {{(pid=77485) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Extended resource: security-group-rules {{(pid=77485) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Extended resource: service-providers {{(pid=77485) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Extended resource: subnetpools {{(pid=77485) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Extended resource: tags {{(pid=77485) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Extended resource: tags {{(pid=77485) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Extended resource: tags {{(pid=77485) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Extended resource: tags {{(pid=77485) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Extended resource: tags {{(pid=77485) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Extended resource: tags {{(pid=77485) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Extended resource: tags {{(pid=77485) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Extended resource: tags {{(pid=77485) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Extended resource: tags {{(pid=77485) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron.api.extensions [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Extended resource: tags {{(pid=77485) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: WARNING keystonemiddleware.auth_token [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 28 12:43:30 l75lg1-v1 neutron-server[77485]: WARNING keystonemiddleware.auth_token [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_concurrency.lockutils [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Acquiring lock "singleton_lock" {{(pid=77485) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_concurrency.lockutils [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Acquired lock "singleton_lock" {{(pid=77485) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_concurrency.lockutils [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Releasing lock "singleton_lock" {{(pid=77485) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: INFO oslo_service.service [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Starting 2 workers May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Started child 77618 {{(pid=77485) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:579}} May 28 12:43:30 l75lg1-v1 dstat.sh[49771]: 28-05 12:43:30| 8 1 84 6 0|2150M 7355M 267M 5926M| 11k 0 | 0 8590k| 0 532 |5948 11k|1.52 1.87 1.26|2.0 0 5.0| 0 0 | 0 2048M| 23 59 0 12 0 May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Started child 77619 {{(pid=77485) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:579}} May 28 12:43:30 l75lg1-v1 neutron-server[77618]: DEBUG neutron_lib.callbacks.manager [-] Publish callbacks ['neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver.OVNMechanismDriver.post_fork_initialize-4094289'] for process (None), after_init {{(pid=77618) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:43:30 l75lg1-v1 neutron-server[77618]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "hash_ring_probe_lock" by "neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver.OVNMechanismDriver._setup_hash_ring" {{(pid=77618) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: INFO neutron.service [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Neutron service started, listening on 0.0.0.0:9696 May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron_lib.callbacks.manager [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Publish callbacks ['neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver.OVNMechanismDriver.pre_fork_initialize-4094335'] for process (None), before_spawn {{(pid=77485) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:43:30 l75lg1-v1 neutron-server[77618]: DEBUG oslo_concurrency.lockutils [-] Lock "hash_ring_probe_lock" acquired by "neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver.OVNMechanismDriver._setup_hash_ring" :: waited 0.001s {{(pid=77618) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:43:30 l75lg1-v1 neutron-server[77618]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=77618) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} May 28 12:43:30 l75lg1-v1 neutron-server[77618]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=77618) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} May 28 12:43:30 l75lg1-v1 neutron-server[77618]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=77618) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_concurrency.processutils [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Running cmd (subprocess): ovsdb-client transact tcp:10.27.203.238:6641 --timeout 180 ["OVN_Northbound", {"op": "wait", "timeout": 0, "table": "Port_Group", "where": [["name", "==", "neutron_pg_drop"]], "until": "==", "rows": []}, {"op": "insert", "table": "ACL", "row": {"action": "drop", "direction": "to-lport", "match": "outport == @neutron_pg_drop && ip", "priority": 1001}, "uuid-name": "droptoport"}, {"op": "insert", "table": "ACL", "row": {"action": "drop", "direction": "from-lport", "match": "inport == @neutron_pg_drop && ip", "priority": 1001}, "uuid-name": "dropfromport"}, {"op": "insert", "table": "Port_Group", "row": {"name": "neutron_pg_drop", "acls": ["set", [["named-uuid", "droptoport"], ["named-uuid", "dropfromport"]]]}}] {{(pid=77485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:390}} May 28 12:43:30 l75lg1-v1 neutron-server[77619]: DEBUG neutron_lib.callbacks.manager [-] Publish callbacks ['neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver.OVNMechanismDriver.post_fork_initialize-4094289'] for process (None), after_init {{(pid=77619) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:43:30 l75lg1-v1 neutron-server[77619]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "hash_ring_probe_lock" by "neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver.OVNMechanismDriver._setup_hash_ring" {{(pid=77619) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_concurrency.processutils [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] CMD "ovsdb-client transact tcp:10.27.203.238:6641 --timeout 180 ["OVN_Northbound", {"op": "wait", "timeout": 0, "table": "Port_Group", "where": [["name", "==", "neutron_pg_drop"]], "until": "==", "rows": []}, {"op": "insert", "table": "ACL", "row": {"action": "drop", "direction": "to-lport", "match": "outport == @neutron_pg_drop && ip", "priority": 1001}, "uuid-name": "droptoport"}, {"op": "insert", "table": "ACL", "row": {"action": "drop", "direction": "from-lport", "match": "inport == @neutron_pg_drop && ip", "priority": 1001}, "uuid-name": "dropfromport"}, {"op": "insert", "table": "Port_Group", "row": {"name": "neutron_pg_drop", "acls": ["set", [["named-uuid", "droptoport"], ["named-uuid", "dropfromport"]]]}}]" returned: 0 in 0.014s {{(pid=77485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:428}} May 28 12:43:30 l75lg1-v1 neutron-server[77618]: DEBUG dbcounter [-] [77618] Writer thread running {{(pid=77618) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: INFO oslo_service.service [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Starting 1 workers May 28 12:43:30 l75lg1-v1 neutron-server[77618]: INFO neutron.db.ovn_hash_ring_db [None req-cf97f244-38b0-4e98-91a4-e7837fc099f0 None None] Nodes from host "l75lg1-v1" and group "mechanism_driver" removed from the Hash Ring May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Started child 77621 {{(pid=77485) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:579}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: INFO oslo_service.service [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Starting 1 workers May 28 12:43:30 l75lg1-v1 neutron-server[77621]: DEBUG neutron.service [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] calling RpcWorker wait() {{(pid=77621) _wait /opt/stack/neutron/neutron/service.py:127}} May 28 12:43:30 l75lg1-v1 neutron-server[77621]: DEBUG neutron.service [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] returning from RpcWorker wait() {{(pid=77621) _wait /opt/stack/neutron/neutron/service.py:134}} May 28 12:43:30 l75lg1-v1 neutron-server[77621]: DEBUG neutron_lib.callbacks.manager [-] Publish callbacks ['neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver.OVNMechanismDriver.post_fork_initialize-4094289'] for process (None), after_init {{(pid=77621) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Started child 77622 {{(pid=77485) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:579}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: INFO oslo_service.service [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Starting 1 workers May 28 12:43:30 l75lg1-v1 neutron-server[77621]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Getting OvsdbNbOvnIdl for RpcWorker with retry May 28 12:43:30 l75lg1-v1 neutron-server[77622]: DEBUG neutron_lib.callbacks.manager [-] Publish callbacks ['neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver.OVNMechanismDriver.post_fork_initialize-4094289'] for process (None), after_init {{(pid=77622) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Started child 77623 {{(pid=77485) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:579}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG neutron_lib.callbacks.manager [None req-5ea20dae-132d-4f00-baf0-d10bfb6bfefe None None] Publish callbacks [] for process (None), after_spawn {{(pid=77485) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:43:30 l75lg1-v1 neutron-server[77622]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Getting OvsdbNbOvnIdl for MaintenanceWorker with retry May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] Full set of CONF: {{(pid=77485) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:653}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2600}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] Configuration options gathered from: {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2601}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} May 28 12:43:30 l75lg1-v1 neutron-server[77618]: INFO neutron.db.ovn_hash_ring_db [None req-cf97f244-38b0-4e98-91a4-e7837fc099f0 None None] Node 4c6fc793-7f5a-456f-b4d6-6e5bd97592f2 from host "l75lg1-v1" and group "mechanism_driver" added to the Hash Ring May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2603}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] ================================================================================ {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2605}} May 28 12:43:30 l75lg1-v1 neutron-server[77623]: DEBUG neutron_lib.callbacks.manager [-] Publish callbacks ['neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver.OVNMechanismDriver.post_fork_initialize-4094289'] for process (None), after_init {{(pid=77623) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:43:30 l75lg1-v1 neutron-server[77618]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-cf97f244-38b0-4e98-91a4-e7837fc099f0 None None] Periodic task found: HashRingHealthCheckPeriodics.touch_hash_ring_nodes {{(pid=77618) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:82}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] agent_down_time = 75 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] allow_automatic_dhcp_failover = True {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] allow_bulk = True {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] allowed_conntrack_helpers = [{'amanda': 'tcp'}, {'ftp': 'tcp'}, {'h323': 'udp'}, {'h323': 'tcp'}, {'irc': 'tcp'}, {'netbios-ns': 'udp'}, {'pptp': 'tcp'}, {'sane': 'tcp'}, {'sip': 'udp'}, {'sip': 'tcp'}, {'snmp': 'udp'}, {'tftp': 'udp'}] {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77618]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver [None req-cf97f244-38b0-4e98-91a4-e7837fc099f0 None None] Hash Ring probing thread has started May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] api_extensions_path = {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] api_paste_config = api-paste.ini {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] api_workers = 2 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77618]: DEBUG oslo_concurrency.lockutils [None req-cf97f244-38b0-4e98-91a4-e7837fc099f0 None None] Lock "hash_ring_probe_lock" "released" by "neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver.OVNMechanismDriver._setup_hash_ring" :: held 0.042s {{(pid=77618) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] auth_strategy = keystone {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] backdoor_port = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] backdoor_socket = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] backlog = 4096 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] base_mac = fa:16:3e:00:00:00 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] bind_host = 0.0.0.0 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] bind_port = 9696 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] client_socket_timeout = 900 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] config_dir = [] {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77618]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-cf97f244-38b0-4e98-91a4-e7837fc099f0 None None] Getting OvsdbNbOvnIdl for WorkerService with retry May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] config_source = [] {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] control_exchange = neutron {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] core_plugin = ml2 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] debug = True {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] default_availability_zones = [] {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] dhcp_agent_notification = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] dhcp_agents_per_network = 1 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] dhcp_lease_duration = 86400 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] dhcp_load_type = networks {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] dns_domain = openstacklocal {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] enable_default_route_bfd = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] enable_default_route_ecmp = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] enable_dvr = True {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] enable_new_agents = True {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] enable_services_on_agents_with_admin_state_down = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] enable_signals = True {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] enable_snat_by_default = True {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] enable_traditional_dhcp = True {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] external_dns_driver = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] filter_validation = True {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] global_physnet_mtu = 1500 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] graceful_shutdown_timeout = 60 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] host = l75lg1-v1 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] host_dvr_for_dhcp = True {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] http_retries = 3 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] instance_format = [instance: %(uuid)s] {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] ipam_driver = internal {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] ipv6_pd_enabled = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] l3_ha = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] l3_ha_network_physical_name = {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] l3_ha_network_type = {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] log_config_append = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] log_dir = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] log_file = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] log_options = True {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] log_rotate_interval = 1 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] log_rotate_interval_type = days {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] log_rotation_type = none {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] max_allowed_address_pair = 10 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] max_dns_nameservers = 5 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] max_header_line = 16384 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] max_l3_agents_per_router = 3 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] max_logfile_count = 30 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] max_logfile_size_mb = 200 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] max_routes = 30 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] max_subnet_host_routes = 20 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] my_ip = 10.27.203.238 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] my_ipv6 = 2001:67c:9b4:1::1014 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] network_auto_schedule = True {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] network_link_prefix = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] notify_nova_on_port_data_changes = True {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] notify_nova_on_port_status_changes = True {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] pagination_max_limit = -1 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] periodic_fuzzy_delay = 5 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] periodic_interval = 40 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] publish_errors = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] rate_limit_burst = 0 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] rate_limit_except_level = CRITICAL {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] rate_limit_interval = 0 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] retry_until_window = 30 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] router_distributed = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] rpc_resources_processing_step = 20 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] rpc_response_max_timeout = 600 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] rpc_response_timeout = 60 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] rpc_state_report_workers = 0 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] rpc_workers = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] send_events_interval = 2 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] service_plugins = ['ovn-router'] {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] setproctitle = on {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] state_path = /opt/stack/data/neutron {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] syslog_log_facility = LOG_USER {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] tcp_keepidle = 600 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] transport_url = **** {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] use_eventlog = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] use_journal = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] use_json = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] use_ssl = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] use_stderr = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] use_syslog = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] vlan_transparent = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] watch_log_file = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] wsgi_default_pool_size = 100 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] wsgi_keep_alive = True {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] wsgi_server_debug = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] oslo_concurrency.disable_process_locking = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] profiler.connection_string = messaging:// {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] profiler.enabled = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] profiler.es_doc_type = notification {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] profiler.es_scroll_size = 10000 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] profiler.es_scroll_time = 2m {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] profiler.filter_error_trace = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] profiler.hmac_keys = **** {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] profiler.sentinel_service_name = mymaster {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] profiler.socket_timeout = 0.1 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] profiler.trace_requests = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] profiler.trace_sqlalchemy = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] profiler_jaeger.process_tags = {} {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] profiler_jaeger.service_name_prefix = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] profiler_otlp.service_name_prefix = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] oslo_policy.enforce_new_defaults = True {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] oslo_policy.enforce_scope = True {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] oslo_policy.policy_default_rule = default {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_process_name = {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] oslo_middleware.enable_proxy_headers_parsing = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] service_providers.service_provider = [] {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] nova.auth_section = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] nova.auth_type = password {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] nova.auth_url = http://10.27.203.238/identity {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] nova.certfile = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] nova.collect_timing = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] nova.default_domain_id = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] nova.default_domain_name = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] nova.domain_id = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] nova.domain_name = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] nova.endpoint_type = public {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] nova.insecure = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] nova.keyfile = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] nova.password = **** {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] nova.project_domain_id = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] nova.project_domain_name = Default {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] nova.project_id = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] nova.project_name = service {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77619]: DEBUG oslo_concurrency.lockutils [-] Lock "hash_ring_probe_lock" acquired by "neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver.OVNMechanismDriver._setup_hash_ring" :: waited 0.063s {{(pid=77619) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] nova.region_name = RegionOne {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] nova.split_loggers = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77619]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=77619) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] nova.system_scope = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77619]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=77619) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} May 28 12:43:30 l75lg1-v1 neutron-server[77619]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=77619) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] nova.timeout = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] nova.trust_id = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] nova.user_domain_id = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] nova.user_domain_name = Default {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] nova.user_id = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] nova.username = nova {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] placement.auth_section = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] placement.auth_type = password {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] placement.cafile = /opt/stack/data/ca-bundle.pem {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] placement.certfile = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] placement.collect_timing = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] placement.endpoint_type = public {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] placement.insecure = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] placement.keyfile = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] placement.region_name = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] placement.split_loggers = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] placement.timeout = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] ironic.auth_section = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] ironic.auth_type = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] ironic.cafile = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] ironic.certfile = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] ironic.collect_timing = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] ironic.connect_retries = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] ironic.connect_retry_delay = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] ironic.enable_notifications = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] ironic.endpoint_override = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] ironic.insecure = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] ironic.interface = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] ironic.keyfile = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] ironic.max_version = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] ironic.min_version = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] ironic.region_name = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] ironic.retriable_status_codes = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] ironic.service_name = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] ironic.service_type = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] ironic.split_loggers = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] ironic.status_code_retries = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] ironic.status_code_retry_delay = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] ironic.timeout = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] ironic.valid_interfaces = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] ironic.version = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] cli_script.dry_run = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.hostname = l75lg1-v1 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77621]: DEBUG ovsdbapp.backend.ovs_idl [None req-c0f77364-2642-431d-b5b5-d4f08d369f82 None None] Created lookup_table index Logical_Switch.name {{(pid=77621) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:87}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77621]: DEBUG ovsdbapp.backend.ovs_idl [None req-c0f77364-2642-431d-b5b5-d4f08d369f82 None None] Created lookup_table index Logical_Router.name {{(pid=77621) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:87}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77621]: DEBUG ovsdbapp.backend.ovs_idl [None req-c0f77364-2642-431d-b5b5-d4f08d369f82 None None] Created lookup_table index Load_Balancer.name {{(pid=77621) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:87}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77621]: DEBUG ovsdbapp.backend.ovs_idl [None req-c0f77364-2642-431d-b5b5-d4f08d369f82 None None] Created schema index Copp.name {{(pid=77621) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.processname = neutron-server {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77621]: DEBUG ovsdbapp.backend.ovs_idl [None req-c0f77364-2642-431d-b5b5-d4f08d369f82 None None] Created schema index Meter.name {{(pid=77621) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77621]: DEBUG ovsdbapp.backend.ovs_idl [None req-c0f77364-2642-431d-b5b5-d4f08d369f82 None None] Created schema index Load_Balancer_Group.name {{(pid=77621) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77621]: DEBUG ovsdbapp.backend.ovs_idl [None req-c0f77364-2642-431d-b5b5-d4f08d369f82 None None] Created schema index HA_Chassis_Group.name {{(pid=77621) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77621]: DEBUG ovsdbapp.backend.ovs_idl [None req-c0f77364-2642-431d-b5b5-d4f08d369f82 None None] Created schema index Address_Set.name {{(pid=77621) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77621]: DEBUG ovsdbapp.backend.ovs_idl [None req-c0f77364-2642-431d-b5b5-d4f08d369f82 None None] Created schema index Connection.target {{(pid=77621) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77621]: DEBUG ovsdbapp.backend.ovs_idl [None req-c0f77364-2642-431d-b5b5-d4f08d369f82 None None] Created schema index Gateway_Chassis.name {{(pid=77621) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77621]: DEBUG ovsdbapp.backend.ovs_idl [None req-c0f77364-2642-431d-b5b5-d4f08d369f82 None None] Created schema index Logical_Router_Port.name {{(pid=77621) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77621]: DEBUG ovsdbapp.backend.ovs_idl [None req-c0f77364-2642-431d-b5b5-d4f08d369f82 None None] Created schema index Port_Group.name {{(pid=77621) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77621]: DEBUG ovsdbapp.backend.ovs_idl [None req-c0f77364-2642-431d-b5b5-d4f08d369f82 None None] Created schema index Logical_Switch_Port.name {{(pid=77621) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77622]: DEBUG ovsdbapp.backend.ovs_idl [-] Created lookup_table index Logical_Switch.name {{(pid=77622) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:87}} May 28 12:43:30 l75lg1-v1 neutron-server[77621]: INFO ovsdbapp.backend.ovs_idl.vlog [None req-c0f77364-2642-431d-b5b5-d4f08d369f82 None None] tcp:10.27.203.238:6641: connecting... May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77622]: DEBUG ovsdbapp.backend.ovs_idl [-] Created lookup_table index Logical_Router.name {{(pid=77622) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:87}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77622]: DEBUG ovsdbapp.backend.ovs_idl [-] Created lookup_table index Load_Balancer.name {{(pid=77622) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:87}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77622]: DEBUG ovsdbapp.backend.ovs_idl [-] Created schema index Copp.name {{(pid=77622) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}} May 28 12:43:30 l75lg1-v1 neutron-server[77621]: INFO ovsdbapp.backend.ovs_idl.vlog [None req-c0f77364-2642-431d-b5b5-d4f08d369f82 None None] tcp:10.27.203.238:6641: connected May 28 12:43:30 l75lg1-v1 neutron-server[77622]: DEBUG ovsdbapp.backend.ovs_idl [-] Created schema index Meter.name {{(pid=77622) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77622]: DEBUG ovsdbapp.backend.ovs_idl [-] Created schema index Load_Balancer_Group.name {{(pid=77622) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77622]: DEBUG ovsdbapp.backend.ovs_idl [-] Created schema index HA_Chassis_Group.name {{(pid=77622) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}} May 28 12:43:30 l75lg1-v1 neutron-server[77622]: DEBUG ovsdbapp.backend.ovs_idl [-] Created schema index Address_Set.name {{(pid=77622) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}} May 28 12:43:30 l75lg1-v1 neutron-server[77622]: DEBUG ovsdbapp.backend.ovs_idl [-] Created schema index Connection.target {{(pid=77622) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_version = {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77622]: DEBUG ovsdbapp.backend.ovs_idl [-] Created schema index Gateway_Chassis.name {{(pid=77622) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}} May 28 12:43:30 l75lg1-v1 neutron-server[77622]: DEBUG ovsdbapp.backend.ovs_idl [-] Created schema index Logical_Router_Port.name {{(pid=77622) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.use_queue_manager = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77622]: DEBUG ovsdbapp.backend.ovs_idl [-] Created schema index Port_Group.name {{(pid=77622) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}} May 28 12:43:30 l75lg1-v1 neutron-server[77622]: DEBUG ovsdbapp.backend.ovs_idl [-] Created schema index Logical_Switch_Port.name {{(pid=77622) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] oslo_messaging_notifications.driver = [] {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] oslo_messaging_notifications.retry = -1 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77622]: INFO ovsdbapp.backend.ovs_idl.vlog [-] tcp:10.27.203.238:6641: connecting... May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] oslo_messaging_notifications.transport_url = **** {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] oslo_reports.file_event_handler = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77622]: INFO ovsdbapp.backend.ovs_idl.vlog [-] tcp:10.27.203.238:6641: connected May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] oslo_reports.file_event_handler_interval = 1 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] oslo_reports.log_dir = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] QUOTAS.default_quota = -1 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] QUOTAS.quota_floatingip = 50 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] QUOTAS.quota_network = 100 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] QUOTAS.quota_port = 500 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] QUOTAS.quota_rbac_policy = 10 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] QUOTAS.quota_router = 10 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group = 10 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group_rule = 100 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] QUOTAS.quota_subnet = 100 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] QUOTAS.track_quota_usage = True {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] healthcheck.allowed_source_ranges = [] {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] healthcheck.backends = ['disable_by_file'] {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] healthcheck.detailed = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] healthcheck.disable_by_file_path = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] healthcheck.ignore_proxied_requests = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] healthcheck.path = /healthcheck {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] keystone_authtoken.admin_password = **** {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] keystone_authtoken.admin_tenant_name = admin {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] keystone_authtoken.admin_token = **** {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] keystone_authtoken.admin_user = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] keystone_authtoken.auth_admin_prefix = {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] keystone_authtoken.auth_port = 35357 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] keystone_authtoken.auth_protocol = https {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] keystone_authtoken.auth_section = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77618]: DEBUG ovsdbapp.backend.ovs_idl [None req-cf97f244-38b0-4e98-91a4-e7837fc099f0 None None] Created lookup_table index Logical_Switch.name {{(pid=77618) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:87}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] keystone_authtoken.auth_type = password {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77618]: DEBUG ovsdbapp.backend.ovs_idl [None req-cf97f244-38b0-4e98-91a4-e7837fc099f0 None None] Created lookup_table index Logical_Router.name {{(pid=77618) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:87}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] keystone_authtoken.auth_uri = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] keystone_authtoken.auth_url = http://10.27.203.238/identity {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77618]: DEBUG ovsdbapp.backend.ovs_idl [None req-cf97f244-38b0-4e98-91a4-e7837fc099f0 None None] Created lookup_table index Load_Balancer.name {{(pid=77618) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:87}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] keystone_authtoken.auth_version = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] keystone_authtoken.cache = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77618]: DEBUG ovsdbapp.backend.ovs_idl [None req-cf97f244-38b0-4e98-91a4-e7837fc099f0 None None] Created schema index Copp.name {{(pid=77618) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] keystone_authtoken.certfile = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77618]: DEBUG ovsdbapp.backend.ovs_idl [None req-cf97f244-38b0-4e98-91a4-e7837fc099f0 None None] Created schema index Meter.name {{(pid=77618) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_id = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77618]: DEBUG ovsdbapp.backend.ovs_idl [None req-cf97f244-38b0-4e98-91a4-e7837fc099f0 None None] Created schema index Load_Balancer_Group.name {{(pid=77618) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_name = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77618]: DEBUG ovsdbapp.backend.ovs_idl [None req-cf97f244-38b0-4e98-91a4-e7837fc099f0 None None] Created schema index HA_Chassis_Group.name {{(pid=77618) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] keystone_authtoken.delay_auth_decision = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77618]: DEBUG ovsdbapp.backend.ovs_idl [None req-cf97f244-38b0-4e98-91a4-e7837fc099f0 None None] Created schema index Address_Set.name {{(pid=77618) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] keystone_authtoken.domain_id = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] keystone_authtoken.domain_name = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77618]: DEBUG ovsdbapp.backend.ovs_idl [None req-cf97f244-38b0-4e98-91a4-e7837fc099f0 None None] Created schema index Connection.target {{(pid=77618) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77618]: DEBUG ovsdbapp.backend.ovs_idl [None req-cf97f244-38b0-4e98-91a4-e7837fc099f0 None None] Created schema index Gateway_Chassis.name {{(pid=77618) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] keystone_authtoken.http_connect_timeout = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77618]: DEBUG ovsdbapp.backend.ovs_idl [None req-cf97f244-38b0-4e98-91a4-e7837fc099f0 None None] Created schema index Logical_Router_Port.name {{(pid=77618) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] keystone_authtoken.identity_uri = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77618]: DEBUG ovsdbapp.backend.ovs_idl [None req-cf97f244-38b0-4e98-91a4-e7837fc099f0 None None] Created schema index Port_Group.name {{(pid=77618) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] keystone_authtoken.include_service_catalog = True {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77618]: DEBUG ovsdbapp.backend.ovs_idl [None req-cf97f244-38b0-4e98-91a4-e7837fc099f0 None None] Created schema index Logical_Switch_Port.name {{(pid=77618) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] keystone_authtoken.insecure = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] keystone_authtoken.interface = public {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77619]: DEBUG dbcounter [-] [77619] Writer thread running {{(pid=77619) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] keystone_authtoken.keyfile = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77618]: INFO ovsdbapp.backend.ovs_idl.vlog [None req-cf97f244-38b0-4e98-91a4-e7837fc099f0 None None] tcp:10.27.203.238:6641: connecting... May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77618]: INFO ovsdbapp.backend.ovs_idl.vlog [None req-cf97f244-38b0-4e98-91a4-e7837fc099f0 None None] tcp:10.27.203.238:6641: connected May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_secret_key = **** {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_security_strategy = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] keystone_authtoken.password = **** {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_id = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_name = Default {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] keystone_authtoken.project_id = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] keystone_authtoken.project_name = service {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] keystone_authtoken.region_name = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles_required = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] keystone_authtoken.service_type = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] keystone_authtoken.system_scope = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] keystone_authtoken.token_cache_time = 300 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] keystone_authtoken.trust_id = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_id = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_name = Default {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] keystone_authtoken.user_id = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] keystone_authtoken.username = neutron {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] keystone_authtoken.www_authenticate_uri = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] cache.backend = dogpile.cache.null {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] cache.backend_argument = **** {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] cache.config_prefix = cache.oslo {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] cache.dead_timeout = 60.0 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] cache.debug_cache_backend = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] cache.enable_retry_client = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] cache.enable_socket_keepalive = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] cache.enabled = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] cache.enforce_fips_mode = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] cache.expiration_time = 600 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] cache.hashclient_retry_attempts = 2 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] cache.hashclient_retry_delay = 1.0 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] cache.memcache_dead_retry = 300 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] cache.memcache_password = **** {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] cache.memcache_pool_maxsize = 10 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] cache.memcache_pool_unused_timeout = 60 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] cache.memcache_sasl_enabled = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] cache.memcache_servers = ['localhost:11211'] {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] cache.memcache_socket_timeout = 1.0 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] cache.memcache_username = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] cache.proxies = [] {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] cache.redis_password = **** {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] cache.redis_sentinel_service_name = mymaster {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] cache.redis_sentinels = ['localhost:26379'] {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] cache.redis_server = localhost:6379 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] cache.redis_socket_timeout = 1.0 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] cache.redis_username = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] cache.retry_attempts = 2 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] cache.retry_delay = 0.0 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] cache.socket_keepalive_count = 1 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] cache.socket_keepalive_idle = 1 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] cache.socket_keepalive_interval = 1 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] cache.tls_allowed_ciphers = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] cache.tls_cafile = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] cache.tls_certfile = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] cache.tls_enabled = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] cache.tls_keyfile = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] privsep.group = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] privsep.helper_command = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] privsep.logger_name = oslo_privsep.daemon {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] privsep.thread_pool_size = 10 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] privsep.user = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] privsep_dhcp_release.capabilities = [21, 12] {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] privsep_dhcp_release.group = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] privsep_dhcp_release.helper_command = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] privsep_dhcp_release.thread_pool_size = 10 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] privsep_dhcp_release.user = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.group = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.helper_command = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.thread_pool_size = 10 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.user = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] privsep_namespace.capabilities = [21] {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] privsep_namespace.group = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] privsep_namespace.helper_command = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] privsep_namespace.thread_pool_size = 10 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] privsep_namespace.user = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] privsep_conntrack.capabilities = [12] {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] privsep_conntrack.group = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] privsep_conntrack.helper_command = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] privsep_conntrack.thread_pool_size = 10 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] privsep_conntrack.user = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] privsep_link.capabilities = [12, 21] {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] privsep_link.group = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] privsep_link.helper_command = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] privsep_link.logger_name = oslo_privsep.daemon {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] privsep_link.thread_pool_size = 10 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77619]: INFO neutron.db.ovn_hash_ring_db [None req-958bbc1e-5f49-4fac-ada0-37ba83913152 None None] Node c89b3497-133e-4a5a-b67a-3310d2cb2485 from host "l75lg1-v1" and group "mechanism_driver" added to the Hash Ring May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] privsep_link.user = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] AGENT.root_helper = sudo /opt/stack/data/venv/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] AGENT.root_helper_daemon = sudo /opt/stack/data/venv/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77619]: DEBUG oslo_concurrency.lockutils [None req-958bbc1e-5f49-4fac-ada0-37ba83913152 None None] Lock "hash_ring_probe_lock" "released" by "neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver.OVNMechanismDriver._setup_hash_ring" :: held 0.031s {{(pid=77619) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] AGENT.use_helper_for_ns_read = True {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_ipset = True {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_security_group = True {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] SECURITYGROUP.firewall_driver = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] SECURITYGROUP.permitted_ethertypes = [] {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] experimental.ipv6_pd_enabled = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] experimental.linuxbridge = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] ml2.extension_drivers = ['port_security', 'qos'] {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] ml2.external_network_type = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77619]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-958bbc1e-5f49-4fac-ada0-37ba83913152 None None] Getting OvsdbNbOvnIdl for WorkerService with retry May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] ml2.mechanism_drivers = ['ovn', 'logger'] {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] ml2.overlay_ip_version = 4 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] ml2.path_mtu = 0 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] ml2.physical_network_mtus = [] {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] ml2.tenant_network_types = ['geneve'] {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] ml2.tunnelled_network_rp_name = rp_tunnelled {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] ml2.type_drivers = ['local', 'flat', 'vlan', 'geneve'] {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] ml2_type_flat.flat_networks = ['public'] {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] ml2_type_geneve.max_header_size = 38 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] ml2_type_geneve.vni_ranges = ['1:65536'] {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] ml2_type_vlan.network_vlan_ranges = ['public'] {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] network_log.burst_limit = 25 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] network_log.local_output_log_base = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] network_log.rate_limit = 100 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] database.backend = sqlalchemy {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] database.connection = **** {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] database.connection_debug = 0 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] database.connection_parameters = {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] database.connection_recycle_time = 3600 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] database.connection_trace = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] database.db_inc_retry_interval = True {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] database.db_max_retries = 20 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] database.db_max_retry_interval = 10 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] database.db_retry_interval = 1 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] database.max_overflow = 50 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] database.max_pool_size = 5 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] database.max_retries = 10 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] database.mysql_sql_mode = TRADITIONAL {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] database.mysql_wsrep_sync_wait = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] database.pool_timeout = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] database.retry_interval = 10 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] database.slave_connection = **** {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] database.sqlite_synchronous = True {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] database.use_db_reconnect = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] ovn.allow_stateless_action_supported = True {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] ovn.dhcp_default_lease_time = 43200 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] ovn.disable_ovn_dhcp_for_baremetal_ports = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] ovn.dns_servers = [] {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] ovn.enable_distributed_floating_ip = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] ovn.fdb_age_threshold = 0 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] ovn.localnet_learn_fdb = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] ovn.mac_binding_age_threshold = 0 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] ovn.neutron_sync_mode = log {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] ovn.ovn_dhcp4_global_options = {} {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] ovn.ovn_dhcp6_global_options = {} {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] ovn.ovn_emit_need_to_frag = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] ovn.ovn_l3_scheduler = leastloaded {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] ovn.ovn_metadata_enabled = True {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] ovn.ovn_nb_ca_cert = {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] ovn.ovn_nb_certificate = {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] ovn.ovn_nb_connection = tcp:10.27.203.238:6641 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] ovn.ovn_nb_private_key = {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] ovn.ovn_sb_ca_cert = {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] ovn.ovn_sb_certificate = {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] ovn.ovn_sb_connection = tcp:10.27.203.238:6642 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] ovn.ovn_sb_private_key = {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] ovn.ovsdb_connection_timeout = 180 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] ovn.ovsdb_log_level = INFO {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] ovn.ovsdb_probe_interval = 60000 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] ovn.ovsdb_retry_max_interval = 180 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] ovn.vhost_sock_dir = /var/run/openvswitch {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] OVS.bridge_mac_table_size = 50000 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] OVS.igmp_flood = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] OVS.igmp_flood_reports = True {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] OVS.igmp_flood_unregistered = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] OVS.igmp_snooping_enable = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] OVS.ovsdb_timeout = 10 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] ovn_nb_global.fdb_removal_limit = 0 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] ovn_nb_global.ignore_lsp_down = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] ovn_nb_global.mac_binding_removal_limit = 0 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2624}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] Full set of CONF: {{(pid=77485) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:653}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2600}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] Configuration options gathered from: {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2601}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2603}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] ================================================================================ {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2605}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] agent_down_time = 75 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] allow_automatic_dhcp_failover = True {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] allow_bulk = True {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] allowed_conntrack_helpers = [{'amanda': 'tcp'}, {'ftp': 'tcp'}, {'h323': 'udp'}, {'h323': 'tcp'}, {'irc': 'tcp'}, {'netbios-ns': 'udp'}, {'pptp': 'tcp'}, {'sane': 'tcp'}, {'sip': 'udp'}, {'sip': 'tcp'}, {'snmp': 'udp'}, {'tftp': 'udp'}] {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] api_extensions_path = {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] api_paste_config = api-paste.ini {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] api_workers = 2 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] auth_strategy = keystone {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] backdoor_port = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] backdoor_socket = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] backlog = 4096 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] base_mac = fa:16:3e:00:00:00 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] bind_host = 0.0.0.0 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] bind_port = 9696 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] client_socket_timeout = 900 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] config_dir = [] {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] config_source = [] {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] control_exchange = neutron {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] core_plugin = ml2 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] debug = True {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] default_availability_zones = [] {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] dhcp_agent_notification = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] dhcp_agents_per_network = 1 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] dhcp_lease_duration = 86400 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] dhcp_load_type = networks {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] dns_domain = openstacklocal {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] enable_default_route_bfd = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] enable_default_route_ecmp = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] enable_dvr = True {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] enable_new_agents = True {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] enable_services_on_agents_with_admin_state_down = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] enable_signals = True {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] enable_snat_by_default = True {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] enable_traditional_dhcp = True {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] external_dns_driver = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] filter_validation = True {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] global_physnet_mtu = 1500 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] graceful_shutdown_timeout = 60 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] host = l75lg1-v1 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] host_dvr_for_dhcp = True {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] http_retries = 3 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] instance_format = [instance: %(uuid)s] {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] ipam_driver = internal {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] ipv6_pd_enabled = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] l3_ha = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] l3_ha_network_physical_name = {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] l3_ha_network_type = {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] log_config_append = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] log_dir = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] log_file = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] log_options = True {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] log_rotate_interval = 1 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] log_rotate_interval_type = days {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] log_rotation_type = none {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] max_allowed_address_pair = 10 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] max_dns_nameservers = 5 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] max_header_line = 16384 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] max_l3_agents_per_router = 3 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] max_logfile_count = 30 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77622]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Getting OvsdbSbOvnIdl for MaintenanceWorker with retry May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] max_logfile_size_mb = 200 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] max_routes = 30 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] max_subnet_host_routes = 20 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] my_ip = 10.27.203.238 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] my_ipv6 = 2001:67c:9b4:1::1014 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] network_auto_schedule = True {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] network_link_prefix = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] notify_nova_on_port_data_changes = True {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] notify_nova_on_port_status_changes = True {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] pagination_max_limit = -1 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] periodic_fuzzy_delay = 5 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] periodic_interval = 40 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] publish_errors = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] rate_limit_burst = 0 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] rate_limit_except_level = CRITICAL {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] rate_limit_interval = 0 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] retry_until_window = 30 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] router_distributed = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] rpc_resources_processing_step = 20 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] rpc_response_max_timeout = 600 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] rpc_response_timeout = 60 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] rpc_state_report_workers = 0 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] rpc_workers = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] send_events_interval = 2 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] service_plugins = ['ovn-router'] {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] setproctitle = on {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] state_path = /opt/stack/data/neutron {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] syslog_log_facility = LOG_USER {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] tcp_keepidle = 600 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] transport_url = **** {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] use_eventlog = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] use_journal = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] use_json = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] use_ssl = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] use_stderr = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] use_syslog = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] vlan_transparent = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] watch_log_file = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] wsgi_default_pool_size = 100 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] wsgi_keep_alive = True {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] wsgi_server_debug = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] oslo_concurrency.disable_process_locking = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] profiler.connection_string = messaging:// {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] profiler.enabled = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] profiler.es_doc_type = notification {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] profiler.es_scroll_size = 10000 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] profiler.es_scroll_time = 2m {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] profiler.filter_error_trace = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] profiler.hmac_keys = **** {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] profiler.sentinel_service_name = mymaster {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] profiler.socket_timeout = 0.1 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] profiler.trace_requests = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] profiler.trace_sqlalchemy = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] profiler_jaeger.process_tags = {} {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] profiler_jaeger.service_name_prefix = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] profiler_otlp.service_name_prefix = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] oslo_policy.enforce_new_defaults = True {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] oslo_policy.enforce_scope = True {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] oslo_policy.policy_default_rule = default {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_process_name = {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] oslo_middleware.enable_proxy_headers_parsing = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] service_providers.service_provider = [] {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] nova.auth_section = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] nova.auth_type = password {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] nova.auth_url = http://10.27.203.238/identity {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] nova.certfile = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] nova.collect_timing = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] nova.default_domain_id = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] nova.default_domain_name = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] nova.domain_id = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] nova.domain_name = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] nova.endpoint_type = public {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] nova.insecure = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] nova.keyfile = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] nova.password = **** {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] nova.project_domain_id = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] nova.project_domain_name = Default {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] nova.project_id = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] nova.project_name = service {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] nova.region_name = RegionOne {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] nova.split_loggers = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] nova.system_scope = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] nova.timeout = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] nova.trust_id = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] nova.user_domain_id = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] nova.user_domain_name = Default {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] nova.user_id = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] nova.username = nova {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] placement.auth_section = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] placement.auth_type = password {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] placement.cafile = /opt/stack/data/ca-bundle.pem {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] placement.certfile = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] placement.collect_timing = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] placement.endpoint_type = public {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] placement.insecure = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] placement.keyfile = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] placement.region_name = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] placement.split_loggers = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] placement.timeout = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] ironic.auth_section = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] ironic.auth_type = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] ironic.cafile = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] ironic.certfile = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] ironic.collect_timing = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] ironic.connect_retries = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] ironic.connect_retry_delay = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] ironic.enable_notifications = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] ironic.endpoint_override = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77621]: DEBUG dbcounter [-] [77621] Writer thread running {{(pid=77621) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] ironic.insecure = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] ironic.interface = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] ironic.keyfile = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] ironic.max_version = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] ironic.min_version = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] ironic.region_name = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] ironic.retriable_status_codes = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] ironic.service_name = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] ironic.service_type = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] ironic.split_loggers = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] ironic.status_code_retries = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] ironic.status_code_retry_delay = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] ironic.timeout = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] ironic.valid_interfaces = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] ironic.version = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] cli_script.dry_run = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.hostname = l75lg1-v1 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.processname = neutron-server {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_version = {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.use_queue_manager = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] oslo_messaging_notifications.driver = [] {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] oslo_messaging_notifications.retry = -1 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] oslo_messaging_notifications.transport_url = **** {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] oslo_reports.file_event_handler = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] oslo_reports.file_event_handler_interval = 1 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] oslo_reports.log_dir = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] QUOTAS.default_quota = -1 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] QUOTAS.quota_floatingip = 50 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] QUOTAS.quota_network = 100 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] QUOTAS.quota_port = 500 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] QUOTAS.quota_rbac_policy = 10 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] QUOTAS.quota_router = 10 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group = 10 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group_rule = 100 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] QUOTAS.quota_subnet = 100 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] QUOTAS.track_quota_usage = True {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] healthcheck.allowed_source_ranges = [] {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] healthcheck.backends = ['disable_by_file'] {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] healthcheck.detailed = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] healthcheck.disable_by_file_path = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] healthcheck.ignore_proxied_requests = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] healthcheck.path = /healthcheck {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] keystone_authtoken.admin_password = **** {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] keystone_authtoken.admin_tenant_name = admin {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] keystone_authtoken.admin_token = **** {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] keystone_authtoken.admin_user = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] keystone_authtoken.auth_admin_prefix = {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] keystone_authtoken.auth_port = 35357 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] keystone_authtoken.auth_protocol = https {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] keystone_authtoken.auth_section = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] keystone_authtoken.auth_type = password {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] keystone_authtoken.auth_uri = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] keystone_authtoken.auth_url = http://10.27.203.238/identity {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] keystone_authtoken.auth_version = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] keystone_authtoken.cache = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] keystone_authtoken.certfile = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_id = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_name = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] keystone_authtoken.delay_auth_decision = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] keystone_authtoken.domain_id = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] keystone_authtoken.domain_name = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] keystone_authtoken.http_connect_timeout = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] keystone_authtoken.identity_uri = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] keystone_authtoken.include_service_catalog = True {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] keystone_authtoken.insecure = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] keystone_authtoken.interface = public {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] keystone_authtoken.keyfile = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_secret_key = **** {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_security_strategy = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] keystone_authtoken.password = **** {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_id = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_name = Default {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] keystone_authtoken.project_id = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] keystone_authtoken.project_name = service {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] keystone_authtoken.region_name = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles_required = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] keystone_authtoken.service_type = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] keystone_authtoken.system_scope = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] keystone_authtoken.token_cache_time = 300 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] keystone_authtoken.trust_id = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_id = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_name = Default {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] keystone_authtoken.user_id = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] keystone_authtoken.username = neutron {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] keystone_authtoken.www_authenticate_uri = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] cache.backend = dogpile.cache.null {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] cache.backend_argument = **** {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] cache.config_prefix = cache.oslo {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] cache.dead_timeout = 60.0 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] cache.debug_cache_backend = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] cache.enable_retry_client = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] cache.enable_socket_keepalive = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] cache.enabled = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] cache.enforce_fips_mode = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] cache.expiration_time = 600 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] cache.hashclient_retry_attempts = 2 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] cache.hashclient_retry_delay = 1.0 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] cache.memcache_dead_retry = 300 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] cache.memcache_password = **** {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] cache.memcache_pool_maxsize = 10 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] cache.memcache_pool_unused_timeout = 60 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] cache.memcache_sasl_enabled = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] cache.memcache_servers = ['localhost:11211'] {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] cache.memcache_socket_timeout = 1.0 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] cache.memcache_username = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] cache.proxies = [] {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] cache.redis_password = **** {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] cache.redis_sentinel_service_name = mymaster {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] cache.redis_sentinels = ['localhost:26379'] {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] cache.redis_server = localhost:6379 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] cache.redis_socket_timeout = 1.0 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] cache.redis_username = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] cache.retry_attempts = 2 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] cache.retry_delay = 0.0 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] cache.socket_keepalive_count = 1 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] cache.socket_keepalive_idle = 1 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] cache.socket_keepalive_interval = 1 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] cache.tls_allowed_ciphers = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] cache.tls_cafile = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] cache.tls_certfile = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] cache.tls_enabled = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] cache.tls_keyfile = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] privsep.group = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] privsep.helper_command = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] privsep.logger_name = oslo_privsep.daemon {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] privsep.thread_pool_size = 10 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] privsep.user = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] privsep_dhcp_release.capabilities = [21, 12] {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] privsep_dhcp_release.group = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] privsep_dhcp_release.helper_command = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] privsep_dhcp_release.thread_pool_size = 10 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] privsep_dhcp_release.user = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.group = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.helper_command = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.thread_pool_size = 10 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.user = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] privsep_namespace.capabilities = [21] {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77619]: DEBUG ovsdbapp.backend.ovs_idl [None req-958bbc1e-5f49-4fac-ada0-37ba83913152 None None] Created lookup_table index Logical_Switch.name {{(pid=77619) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:87}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] privsep_namespace.group = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] privsep_namespace.helper_command = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] privsep_namespace.thread_pool_size = 10 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] privsep_namespace.user = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] privsep_conntrack.capabilities = [12] {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] privsep_conntrack.group = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] privsep_conntrack.helper_command = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77619]: DEBUG ovsdbapp.backend.ovs_idl [None req-958bbc1e-5f49-4fac-ada0-37ba83913152 None None] Created lookup_table index Logical_Router.name {{(pid=77619) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:87}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] privsep_conntrack.thread_pool_size = 10 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] privsep_conntrack.user = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] privsep_link.capabilities = [12, 21] {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] privsep_link.group = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77619]: DEBUG ovsdbapp.backend.ovs_idl [None req-958bbc1e-5f49-4fac-ada0-37ba83913152 None None] Created lookup_table index Load_Balancer.name {{(pid=77619) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:87}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] privsep_link.helper_command = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] privsep_link.logger_name = oslo_privsep.daemon {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] privsep_link.thread_pool_size = 10 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77619]: DEBUG ovsdbapp.backend.ovs_idl [None req-958bbc1e-5f49-4fac-ada0-37ba83913152 None None] Created schema index Copp.name {{(pid=77619) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] privsep_link.user = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] AGENT.root_helper = sudo /opt/stack/data/venv/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77619]: DEBUG ovsdbapp.backend.ovs_idl [None req-958bbc1e-5f49-4fac-ada0-37ba83913152 None None] Created schema index Meter.name {{(pid=77619) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] AGENT.root_helper_daemon = sudo /opt/stack/data/venv/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] AGENT.use_helper_for_ns_read = True {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77619]: DEBUG ovsdbapp.backend.ovs_idl [None req-958bbc1e-5f49-4fac-ada0-37ba83913152 None None] Created schema index Load_Balancer_Group.name {{(pid=77619) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_ipset = True {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_security_group = True {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] SECURITYGROUP.firewall_driver = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77622]: DEBUG ovsdbapp.backend.ovs_idl [-] Created lookup_table index Chassis.name {{(pid=77622) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:87}} May 28 12:43:30 l75lg1-v1 neutron-server[77619]: DEBUG ovsdbapp.backend.ovs_idl [None req-958bbc1e-5f49-4fac-ada0-37ba83913152 None None] Created schema index HA_Chassis_Group.name {{(pid=77619) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] SECURITYGROUP.permitted_ethertypes = [] {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77622]: DEBUG ovsdbapp.backend.ovs_idl [-] Created lookup_table index Port_Binding.logical_port {{(pid=77622) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:87}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] experimental.ipv6_pd_enabled = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77619]: DEBUG ovsdbapp.backend.ovs_idl [None req-958bbc1e-5f49-4fac-ada0-37ba83913152 None None] Created schema index Address_Set.name {{(pid=77619) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] experimental.linuxbridge = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77622]: DEBUG ovsdbapp.backend.ovs_idl [-] Created schema index Chassis_Private.name {{(pid=77622) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] ml2.extension_drivers = ['port_security', 'qos'] {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77619]: DEBUG ovsdbapp.backend.ovs_idl [None req-958bbc1e-5f49-4fac-ada0-37ba83913152 None None] Created schema index Connection.target {{(pid=77619) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}} May 28 12:43:30 l75lg1-v1 neutron-server[77622]: DEBUG ovsdbapp.backend.ovs_idl [-] Created schema index Datapath_Binding.tunnel_key {{(pid=77622) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] ml2.external_network_type = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] ml2.mechanism_drivers = ['ovn', 'logger'] {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] ml2.overlay_ip_version = 4 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] ml2.path_mtu = 0 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] ml2.physical_network_mtus = [] {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77622]: INFO ovsdbapp.backend.ovs_idl.vlog [-] tcp:10.27.203.238:6642: connecting... May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] ml2.tenant_network_types = ['geneve'] {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77619]: DEBUG ovsdbapp.backend.ovs_idl [None req-958bbc1e-5f49-4fac-ada0-37ba83913152 None None] Created schema index Gateway_Chassis.name {{(pid=77619) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] ml2.tunnelled_network_rp_name = rp_tunnelled {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] ml2.type_drivers = ['local', 'flat', 'vlan', 'geneve'] {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77619]: DEBUG ovsdbapp.backend.ovs_idl [None req-958bbc1e-5f49-4fac-ada0-37ba83913152 None None] Created schema index Logical_Router_Port.name {{(pid=77619) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}} May 28 12:43:30 l75lg1-v1 neutron-server[77622]: INFO ovsdbapp.backend.ovs_idl.vlog [-] tcp:10.27.203.238:6642: connected May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] ml2_type_flat.flat_networks = ['public'] {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] ml2_type_geneve.max_header_size = 38 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77618]: DEBUG neutron.common.ovn.hash_ring_manager [None req-cf97f244-38b0-4e98-91a4-e7837fc099f0 None None] Allow caching, nodes 2>=2 {{(pid=77618) _wait_startup_before_caching /opt/stack/neutron/neutron/common/ovn/hash_ring_manager.py:64}} May 28 12:43:30 l75lg1-v1 neutron-server[77619]: DEBUG ovsdbapp.backend.ovs_idl [None req-958bbc1e-5f49-4fac-ada0-37ba83913152 None None] Created schema index Port_Group.name {{(pid=77619) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] ml2_type_geneve.vni_ranges = ['1:65536'] {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] ml2_type_vlan.network_vlan_ranges = ['public'] {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77619]: DEBUG ovsdbapp.backend.ovs_idl [None req-958bbc1e-5f49-4fac-ada0-37ba83913152 None None] Created schema index Logical_Switch_Port.name {{(pid=77619) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] network_log.burst_limit = 25 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] network_log.local_output_log_base = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] network_log.rate_limit = 100 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] database.backend = sqlalchemy {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] database.connection = **** {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] database.connection_debug = 0 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] database.connection_parameters = {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] database.connection_recycle_time = 3600 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77619]: INFO ovsdbapp.backend.ovs_idl.vlog [None req-958bbc1e-5f49-4fac-ada0-37ba83913152 None None] tcp:10.27.203.238:6641: connecting... May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] database.connection_trace = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] database.db_inc_retry_interval = True {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] database.db_max_retries = 20 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] database.db_max_retry_interval = 10 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] database.db_retry_interval = 1 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] database.max_overflow = 50 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77619]: INFO ovsdbapp.backend.ovs_idl.vlog [None req-958bbc1e-5f49-4fac-ada0-37ba83913152 None None] tcp:10.27.203.238:6641: connected May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] database.max_pool_size = 5 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] database.max_retries = 10 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] database.mysql_sql_mode = TRADITIONAL {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] database.mysql_wsrep_sync_wait = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] database.pool_timeout = None {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] database.retry_interval = 10 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] database.slave_connection = **** {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] database.sqlite_synchronous = True {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] database.use_db_reconnect = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] ovn.allow_stateless_action_supported = True {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] ovn.dhcp_default_lease_time = 43200 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] ovn.disable_ovn_dhcp_for_baremetal_ports = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] ovn.dns_servers = [] {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] ovn.enable_distributed_floating_ip = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] ovn.fdb_age_threshold = 0 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] ovn.localnet_learn_fdb = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] ovn.mac_binding_age_threshold = 0 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] ovn.neutron_sync_mode = log {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] ovn.ovn_dhcp4_global_options = {} {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] ovn.ovn_dhcp6_global_options = {} {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] ovn.ovn_emit_need_to_frag = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] ovn.ovn_l3_scheduler = leastloaded {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] ovn.ovn_metadata_enabled = True {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] ovn.ovn_nb_ca_cert = {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] ovn.ovn_nb_certificate = {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] ovn.ovn_nb_connection = tcp:10.27.203.238:6641 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] ovn.ovn_nb_private_key = {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] ovn.ovn_sb_ca_cert = {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] ovn.ovn_sb_certificate = {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] ovn.ovn_sb_connection = tcp:10.27.203.238:6642 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] ovn.ovn_sb_private_key = {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] ovn.ovsdb_connection_timeout = 180 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] ovn.ovsdb_log_level = INFO {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] ovn.ovsdb_probe_interval = 60000 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] ovn.ovsdb_retry_max_interval = 180 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] ovn.vhost_sock_dir = /var/run/openvswitch {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] OVS.bridge_mac_table_size = 50000 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] OVS.igmp_flood = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] OVS.igmp_flood_reports = True {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] OVS.igmp_flood_unregistered = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] OVS.igmp_snooping_enable = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] OVS.ovsdb_timeout = 10 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] ovn_nb_global.fdb_removal_limit = 0 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] ovn_nb_global.ignore_lsp_down = False {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] ovn_nb_global.mac_binding_removal_limit = 0 {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:30 l75lg1-v1 neutron-server[77485]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=77485) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2624}} May 28 12:43:30 l75lg1-v1 neutron-server[77618]: DEBUG neutron.common.ovn.hash_ring_manager [None req-cf97f244-38b0-4e98-91a4-e7837fc099f0 None None] Hash Ring loaded. 2 active nodes. 0 offline nodes {{(pid=77618) _load_hash_ring /opt/stack/neutron/neutron/common/ovn/hash_ring_manager.py:99}} May 28 12:43:30 l75lg1-v1 neutron-server[77621]: DEBUG neutron.common.ovn.hash_ring_manager [None req-c0f77364-2642-431d-b5b5-d4f08d369f82 None None] Allow caching, nodes 2>=2 {{(pid=77621) _wait_startup_before_caching /opt/stack/neutron/neutron/common/ovn/hash_ring_manager.py:64}} May 28 12:43:30 l75lg1-v1 neutron-server[77618]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-cf97f244-38b0-4e98-91a4-e7837fc099f0 None None] Hash Ring: Node 4c6fc793-7f5a-456f-b4d6-6e5bd97592f2 (host: l75lg1-v1) handling event "create" for row 92fe24fc-3a72-43ed-afa8-e564fec3e2ce (table: ACL) {{(pid=77618) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:43:30 l75lg1-v1 neutron-server[77618]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-cf97f244-38b0-4e98-91a4-e7837fc099f0 None None] Hash Ring: Node 4c6fc793-7f5a-456f-b4d6-6e5bd97592f2 (host: l75lg1-v1) handling event "create" for row c8d85480-f4e4-416c-a4de-e75a788cdc99 (table: Port_Group) {{(pid=77618) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:43:30 l75lg1-v1 neutron-server[77618]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-cf97f244-38b0-4e98-91a4-e7837fc099f0 None None] Getting OvsdbSbOvnIdl for WorkerService with retry May 28 12:43:30 l75lg1-v1 neutron-server[77621]: DEBUG neutron.common.ovn.hash_ring_manager [None req-c0f77364-2642-431d-b5b5-d4f08d369f82 None None] Hash Ring loaded. 2 active nodes. 0 offline nodes {{(pid=77621) _load_hash_ring /opt/stack/neutron/neutron/common/ovn/hash_ring_manager.py:99}} May 28 12:43:30 l75lg1-v1 neutron-server[77621]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-c0f77364-2642-431d-b5b5-d4f08d369f82 None None] Getting OvsdbSbOvnIdl for RpcWorker with retry May 28 12:43:30 l75lg1-v1 neutron-server[77619]: DEBUG neutron.common.ovn.hash_ring_manager [None req-958bbc1e-5f49-4fac-ada0-37ba83913152 None None] Allow caching, nodes 2>=2 {{(pid=77619) _wait_startup_before_caching /opt/stack/neutron/neutron/common/ovn/hash_ring_manager.py:64}} May 28 12:43:30 l75lg1-v1 neutron-server[77622]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > floatingip precommit_update 55550000, False {{(pid=77622) subscribe /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:52}} May 28 12:43:30 l75lg1-v1 neutron-server[77622]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > floatingip precommit_delete 55550000, False {{(pid=77622) subscribe /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:52}} May 28 12:43:30 l75lg1-v1 neutron-server[77622]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > floatingip before_create 55550000, False {{(pid=77622) subscribe /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:52}} May 28 12:43:30 l75lg1-v1 neutron-server[77622]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > floatingip before_update 55550000, False {{(pid=77622) subscribe /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:52}} May 28 12:43:30 l75lg1-v1 neutron-server[77622]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port after_update 55550000, False {{(pid=77622) subscribe /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:52}} May 28 12:43:30 l75lg1-v1 neutron-server[77622]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port precommit_delete 55550000, False {{(pid=77622) subscribe /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:52}} May 28 12:43:30 l75lg1-v1 neutron-server[77618]: DEBUG ovsdbapp.backend.ovs_idl [None req-cf97f244-38b0-4e98-91a4-e7837fc099f0 None None] Created lookup_table index Chassis.name {{(pid=77618) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:87}} May 28 12:43:30 l75lg1-v1 neutron-server[77618]: DEBUG ovsdbapp.backend.ovs_idl [None req-cf97f244-38b0-4e98-91a4-e7837fc099f0 None None] Created lookup_table index Port_Binding.logical_port {{(pid=77618) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:87}} May 28 12:43:30 l75lg1-v1 neutron-server[77622]: DEBUG neutron_lib.callbacks.manager [-] Publish callbacks ['neutron.services.portforwarding.drivers.ovn.driver.OVNPortForwarding.register-848454'] for port_forwarding_plugin (None), after_init {{(pid=77622) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:43:30 l75lg1-v1 neutron-server[77618]: DEBUG ovsdbapp.backend.ovs_idl [None req-cf97f244-38b0-4e98-91a4-e7837fc099f0 None None] Created schema index Chassis_Private.name {{(pid=77618) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}} May 28 12:43:30 l75lg1-v1 neutron-server[77618]: DEBUG ovsdbapp.backend.ovs_idl [None req-cf97f244-38b0-4e98-91a4-e7837fc099f0 None None] Created schema index Datapath_Binding.tunnel_key {{(pid=77618) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}} May 28 12:43:30 l75lg1-v1 neutron-server[77622]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port_forwarding after_create 55550000, False {{(pid=77622) subscribe /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:52}} May 28 12:43:30 l75lg1-v1 neutron-server[77622]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > router_interface after_create 55550000, False {{(pid=77622) subscribe /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:52}} May 28 12:43:30 l75lg1-v1 neutron-server[77622]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port_forwarding after_update 55550000, False {{(pid=77622) subscribe /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:52}} May 28 12:43:30 l75lg1-v1 neutron-server[77618]: INFO ovsdbapp.backend.ovs_idl.vlog [None req-cf97f244-38b0-4e98-91a4-e7837fc099f0 None None] tcp:10.27.203.238:6642: connecting... May 28 12:43:30 l75lg1-v1 neutron-server[77622]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port_forwarding after_delete 55550000, False {{(pid=77622) subscribe /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:52}} May 28 12:43:30 l75lg1-v1 neutron-server[77622]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > router_interface after_delete 55550000, False {{(pid=77622) subscribe /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:52}} May 28 12:43:30 l75lg1-v1 neutron-server[77618]: INFO ovsdbapp.backend.ovs_idl.vlog [None req-cf97f244-38b0-4e98-91a4-e7837fc099f0 None None] tcp:10.27.203.238:6642: connected May 28 12:43:30 l75lg1-v1 neutron-server[77622]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.extensions.qos [-] Starting OVNClientQosExtension May 28 12:43:30 l75lg1-v1 neutron-server[77622]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.extensions.placement [-] Starting OVNClientPlacementExtension May 28 12:43:30 l75lg1-v1 neutron-server[77622]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment before_delete 55550000, False {{(pid=77622) subscribe /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:52}} May 28 12:43:30 l75lg1-v1 neutron-server[77622]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > subnet precommit_delete_associations 55550000, False {{(pid=77622) subscribe /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:52}} May 28 12:43:30 l75lg1-v1 neutron-server[77622]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment_host_mapping after_create 55550000, False {{(pid=77622) subscribe /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:52}} May 28 12:43:30 l75lg1-v1 neutron-server[77622]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port after_create 55550000, False {{(pid=77622) subscribe /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:52}} May 28 12:43:30 l75lg1-v1 neutron-server[77622]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port after_delete 55550000, False {{(pid=77622) subscribe /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:52}} May 28 12:43:30 l75lg1-v1 neutron-server[77622]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port after_update 55550000, False {{(pid=77622) subscribe /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:52}} May 28 12:43:30 l75lg1-v1 neutron-server[77622]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment after_delete 55550000, False {{(pid=77622) subscribe /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:52}} May 28 12:43:30 l75lg1-v1 neutron-server[77622]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > subnet after_create 55550000, False {{(pid=77622) subscribe /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:52}} May 28 12:43:30 l75lg1-v1 neutron-server[77622]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > subnet after_delete 55550000, False {{(pid=77622) subscribe /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:52}} May 28 12:43:30 l75lg1-v1 neutron-server[77622]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > subnet after_update 55550000, False {{(pid=77622) subscribe /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:52}} May 28 12:43:30 l75lg1-v1 neutron-server[77619]: DEBUG neutron.common.ovn.hash_ring_manager [None req-958bbc1e-5f49-4fac-ada0-37ba83913152 None None] Hash Ring loaded. 2 active nodes. 0 offline nodes {{(pid=77619) _load_hash_ring /opt/stack/neutron/neutron/common/ovn/hash_ring_manager.py:99}} May 28 12:43:30 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-958bbc1e-5f49-4fac-ada0-37ba83913152 None None] Hash Ring: Node c89b3497-133e-4a5a-b67a-3310d2cb2485 (host: l75lg1-v1) handling event "create" for row baf4c4e1-8aea-4f2e-bd16-76776194c0a5 (table: Database) {{(pid=77619) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:43:30 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-958bbc1e-5f49-4fac-ada0-37ba83913152 None None] Hash Ring: Node c89b3497-133e-4a5a-b67a-3310d2cb2485 (host: l75lg1-v1) handling event "create" for row 3a4d411f-36f2-4322-82d4-aff709bae844 (table: Database) {{(pid=77619) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:43:30 l75lg1-v1 neutron-server[77621]: DEBUG ovsdbapp.backend.ovs_idl [None req-c0f77364-2642-431d-b5b5-d4f08d369f82 None None] Created lookup_table index Chassis.name {{(pid=77621) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:87}} May 28 12:43:30 l75lg1-v1 neutron-server[77621]: DEBUG ovsdbapp.backend.ovs_idl [None req-c0f77364-2642-431d-b5b5-d4f08d369f82 None None] Created lookup_table index Port_Binding.logical_port {{(pid=77621) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:87}} May 28 12:43:30 l75lg1-v1 neutron-server[77621]: DEBUG ovsdbapp.backend.ovs_idl [None req-c0f77364-2642-431d-b5b5-d4f08d369f82 None None] Created schema index Chassis_Private.name {{(pid=77621) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}} May 28 12:43:30 l75lg1-v1 neutron-server[77621]: DEBUG ovsdbapp.backend.ovs_idl [None req-c0f77364-2642-431d-b5b5-d4f08d369f82 None None] Created schema index Datapath_Binding.tunnel_key {{(pid=77621) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}} May 28 12:43:30 l75lg1-v1 neutron-server[77621]: INFO ovsdbapp.backend.ovs_idl.vlog [None req-c0f77364-2642-431d-b5b5-d4f08d369f82 None None] tcp:10.27.203.238:6642: connecting... May 28 12:43:30 l75lg1-v1 neutron-server[77621]: INFO ovsdbapp.backend.ovs_idl.vlog [None req-c0f77364-2642-431d-b5b5-d4f08d369f82 None None] tcp:10.27.203.238:6642: connected May 28 12:43:30 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-958bbc1e-5f49-4fac-ada0-37ba83913152 None None] Hash Ring: Node c89b3497-133e-4a5a-b67a-3310d2cb2485 (host: l75lg1-v1) handling event "create" for row a5abe8d3-b242-48b2-9044-8b030a0a4d27 (table: ACL) {{(pid=77619) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:43:30 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-958bbc1e-5f49-4fac-ada0-37ba83913152 None None] Hash Ring: Node c89b3497-133e-4a5a-b67a-3310d2cb2485 (host: l75lg1-v1) handling event "create" for row e3b44181-d0d1-48a4-919e-aebe82c3ec56 (table: Connection) {{(pid=77619) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:43:30 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-958bbc1e-5f49-4fac-ada0-37ba83913152 None None] Hash Ring: Node c89b3497-133e-4a5a-b67a-3310d2cb2485 (host: l75lg1-v1) handling event "create" for row 459958f3-26c0-486c-a7b4-0e57d78742d2 (table: NB_Global) {{(pid=77619) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:43:30 l75lg1-v1 neutron-server[77619]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-958bbc1e-5f49-4fac-ada0-37ba83913152 None None] Getting OvsdbSbOvnIdl for WorkerService with retry May 28 12:43:30 l75lg1-v1 neutron-server[77618]: DEBUG neutron.common.ovn.hash_ring_manager [None req-cf97f244-38b0-4e98-91a4-e7837fc099f0 None None] Allow caching, nodes 2>=2 {{(pid=77618) _wait_startup_before_caching /opt/stack/neutron/neutron/common/ovn/hash_ring_manager.py:64}} May 28 12:43:30 l75lg1-v1 neutron-server[77618]: DEBUG neutron.common.ovn.hash_ring_manager [None req-cf97f244-38b0-4e98-91a4-e7837fc099f0 None None] Hash Ring loaded. 2 active nodes. 0 offline nodes {{(pid=77618) _load_hash_ring /opt/stack/neutron/neutron/common/ovn/hash_ring_manager.py:99}} May 28 12:43:30 l75lg1-v1 neutron-server[77618]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-cf97f244-38b0-4e98-91a4-e7837fc099f0 None None] Hash Ring: Node 4c6fc793-7f5a-456f-b4d6-6e5bd97592f2 (host: l75lg1-v1) handling event "create" for row ac59800c-4025-4400-a374-52ea07cf1813 (table: Database) {{(pid=77618) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:43:30 l75lg1-v1 neutron-server[77618]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-cf97f244-38b0-4e98-91a4-e7837fc099f0 None None] Hash Ring: Node 4c6fc793-7f5a-456f-b4d6-6e5bd97592f2 (host: l75lg1-v1) handling event "create" for row c5959b15-b062-4b32-a0f4-164f729d1ce6 (table: Chassis) {{(pid=77618) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:43:30 l75lg1-v1 neutron-server[77618]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-cf97f244-38b0-4e98-91a4-e7837fc099f0 None None] ChassisAgentWriteEvent : Matched Chassis_Private, create, None None {{(pid=77618) matches /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:65}} May 28 12:43:30 l75lg1-v1 neutron-server[77618]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-cf97f244-38b0-4e98-91a4-e7837fc099f0 None None] ChassisMetadataAgentWriteEvent : Matched Chassis_Private, create, None None {{(pid=77618) matches /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:65}} May 28 12:43:30 l75lg1-v1 neutron-server[77621]: DEBUG neutron.common.ovn.hash_ring_manager [None req-c0f77364-2642-431d-b5b5-d4f08d369f82 None None] Allow caching, nodes 2>=2 {{(pid=77621) _wait_startup_before_caching /opt/stack/neutron/neutron/common/ovn/hash_ring_manager.py:64}} May 28 12:43:30 l75lg1-v1 neutron-server[77618]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-cf97f244-38b0-4e98-91a4-e7837fc099f0 None None] Hash Ring: Node 4c6fc793-7f5a-456f-b4d6-6e5bd97592f2 (host: l75lg1-v1) handling event "create" for row 178e2c95-f9c9-47af-be15-517ed3bc92c8 (table: Encap) {{(pid=77618) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:43:30 l75lg1-v1 neutron-server[77618]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver [None req-cf97f244-38b0-4e98-91a4-e7837fc099f0 None None] WorkerService process has finished the post initialization May 28 12:43:30 l75lg1-v1 neutron-server[77618]: INFO neutron.wsgi [-] (77618) wsgi starting up on http://0.0.0.0:9696 May 28 12:43:30 l75lg1-v1 neutron-server[77618]: DEBUG neutron.wsgi [-] (77618) accepted ('10.27.203.238', 40614) {{(pid=77618) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 12:43:30 l75lg1-v1 neutron-server[77619]: DEBUG ovsdbapp.backend.ovs_idl [None req-958bbc1e-5f49-4fac-ada0-37ba83913152 None None] Created lookup_table index Chassis.name {{(pid=77619) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:87}} May 28 12:43:30 l75lg1-v1 neutron-server[77619]: DEBUG ovsdbapp.backend.ovs_idl [None req-958bbc1e-5f49-4fac-ada0-37ba83913152 None None] Created lookup_table index Port_Binding.logical_port {{(pid=77619) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:87}} May 28 12:43:30 l75lg1-v1 neutron-server[77619]: DEBUG ovsdbapp.backend.ovs_idl [None req-958bbc1e-5f49-4fac-ada0-37ba83913152 None None] Created schema index Chassis_Private.name {{(pid=77619) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}} May 28 12:43:30 l75lg1-v1 neutron-server[77619]: DEBUG ovsdbapp.backend.ovs_idl [None req-958bbc1e-5f49-4fac-ada0-37ba83913152 None None] Created schema index Datapath_Binding.tunnel_key {{(pid=77619) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}} May 28 12:43:30 l75lg1-v1 neutron-server[77619]: INFO ovsdbapp.backend.ovs_idl.vlog [None req-958bbc1e-5f49-4fac-ada0-37ba83913152 None None] tcp:10.27.203.238:6642: connecting... May 28 12:43:30 l75lg1-v1 neutron-server[77619]: INFO ovsdbapp.backend.ovs_idl.vlog [None req-958bbc1e-5f49-4fac-ada0-37ba83913152 None None] tcp:10.27.203.238:6642: connected May 28 12:43:30 l75lg1-v1 neutron-server[77621]: DEBUG neutron.common.ovn.hash_ring_manager [None req-c0f77364-2642-431d-b5b5-d4f08d369f82 None None] Hash Ring loaded. 2 active nodes. 0 offline nodes {{(pid=77621) _load_hash_ring /opt/stack/neutron/neutron/common/ovn/hash_ring_manager.py:99}} May 28 12:43:30 l75lg1-v1 neutron-server[77618]: INFO neutron.wsgi [-] 10.27.203.238 "GET /networking HTTP/1.1" status: 302 len: 450 time: 0.0026262 May 28 12:43:30 l75lg1-v1 neutron-server[77618]: INFO neutron.wsgi [-] 10.27.203.238 "GET /networking/ HTTP/1.1" status: 200 len: 266 time: 0.0019138 May 28 12:43:30 l75lg1-v1 neutron-server[77621]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-c0f77364-2642-431d-b5b5-d4f08d369f82 None None] ChassisAgentWriteEvent : Matched Chassis_Private, create, None None {{(pid=77621) matches /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:65}} May 28 12:43:30 l75lg1-v1 neutron-server[77621]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-c0f77364-2642-431d-b5b5-d4f08d369f82 None None] ChassisMetadataAgentWriteEvent : Matched Chassis_Private, create, None None {{(pid=77621) matches /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:65}} May 28 12:43:30 l75lg1-v1 neutron-server[77621]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver [None req-c0f77364-2642-431d-b5b5-d4f08d369f82 None None] RpcWorker process has finished the post initialization May 28 12:43:30 l75lg1-v1 neutron-server[77621]: DEBUG neutron.plugins.ml2.plugin [None req-c0f77364-2642-431d-b5b5-d4f08d369f82 None None] neutron.plugins.ml2.plugin.Ml2Plugin method start_rpc_listeners called with arguments () {} {{(pid=77621) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} May 28 12:43:30 l75lg1-v1 neutron-server[77621]: INFO oslo.messaging._drivers.impl_rabbit [None req-c0f77364-2642-431d-b5b5-d4f08d369f82 None None] Creating fanout queue: q-plugin_fanout_6d21ebd5715745778681f618d0dea002 May 28 12:43:30 l75lg1-v1 neutron-server[77619]: DEBUG neutron.common.ovn.hash_ring_manager [None req-958bbc1e-5f49-4fac-ada0-37ba83913152 None None] Allow caching, nodes 2>=2 {{(pid=77619) _wait_startup_before_caching /opt/stack/neutron/neutron/common/ovn/hash_ring_manager.py:64}} May 28 12:43:30 l75lg1-v1 neutron-server[77619]: DEBUG neutron.common.ovn.hash_ring_manager [None req-958bbc1e-5f49-4fac-ada0-37ba83913152 None None] Hash Ring loaded. 2 active nodes. 0 offline nodes {{(pid=77619) _load_hash_ring /opt/stack/neutron/neutron/common/ovn/hash_ring_manager.py:99}} May 28 12:43:30 l75lg1-v1 neutron-server[77622]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > subnet after_create 55550000, False {{(pid=77622) subscribe /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:52}} May 28 12:43:30 l75lg1-v1 neutron-server[77622]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > subnet after_delete 55550000, False {{(pid=77622) subscribe /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:52}} May 28 12:43:30 l75lg1-v1 neutron-server[77622]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > subnet before_create 55550000, False {{(pid=77622) subscribe /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:52}} May 28 12:43:30 l75lg1-v1 neutron-server[77622]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > subnet before_update 55550000, False {{(pid=77622) subscribe /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:52}} May 28 12:43:30 l75lg1-v1 neutron-server[77622]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.extensions.qos [-] Starting OVNClientQosExtension May 28 12:43:30 l75lg1-v1 neutron-server[77622]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.add_gw_port_info_to_logical_router_port {{(pid=77622) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:82}} May 28 12:43:30 l75lg1-v1 neutron-server[77622]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.add_provider_resource_association_to_routers {{(pid=77622) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:82}} May 28 12:43:30 l75lg1-v1 neutron-server[77622]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.add_vnic_type_and_pb_capabilities_to_lsp {{(pid=77622) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:82}} May 28 12:43:30 l75lg1-v1 neutron-server[77622]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.check_baremetal_ports_dhcp_options {{(pid=77622) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:82}} May 28 12:43:30 l75lg1-v1 neutron-server[77622]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.check_fair_meter_consistency {{(pid=77622) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:82}} May 28 12:43:30 l75lg1-v1 neutron-server[77622]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.check_fdb_aging_settings {{(pid=77622) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:82}} May 28 12:43:30 l75lg1-v1 neutron-server[77622]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.check_for_ha_chassis_group {{(pid=77622) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:82}} May 28 12:43:30 l75lg1-v1 neutron-server[77622]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.check_for_igmp_snoop_support {{(pid=77622) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:82}} May 28 12:43:30 l75lg1-v1 neutron-server[77622]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.check_for_inconsistencies {{(pid=77622) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:82}} May 28 12:43:30 l75lg1-v1 neutron-server[77622]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.check_for_mcast_flood_reports {{(pid=77622) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:82}} May 28 12:43:30 l75lg1-v1 neutron-server[77622]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.check_global_dhcp_opts {{(pid=77622) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:82}} May 28 12:43:30 l75lg1-v1 neutron-server[77622]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.check_localnet_port_has_learn_fdb {{(pid=77622) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:82}} May 28 12:43:30 l75lg1-v1 neutron-server[77622]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.check_port_has_address_scope {{(pid=77622) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:82}} May 28 12:43:30 l75lg1-v1 neutron-server[77622]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.check_redirect_type_router_gateway_ports {{(pid=77622) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:82}} May 28 12:43:30 l75lg1-v1 neutron-server[77622]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip {{(pid=77622) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:82}} May 28 12:43:30 l75lg1-v1 neutron-server[77622]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.check_vlan_distributed_ports {{(pid=77622) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:82}} May 28 12:43:30 l75lg1-v1 neutron-server[77622]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.cleanup_old_hash_ring_nodes {{(pid=77622) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:82}} May 28 12:43:30 l75lg1-v1 neutron-server[77622]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.configure_nb_global {{(pid=77622) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:82}} May 28 12:43:30 l75lg1-v1 neutron-server[77622]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.create_router_extra_attributes_registers {{(pid=77622) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:82}} May 28 12:43:30 l75lg1-v1 neutron-server[77622]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.remove_duplicated_chassis_registers {{(pid=77622) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:82}} May 28 12:43:30 l75lg1-v1 neutron-server[77622]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.remove_gw_ext_ids_from_logical_router {{(pid=77622) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:82}} May 28 12:43:30 l75lg1-v1 neutron-server[77622]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.remove_invalid_gateway_chassis_from_unbound_lrp {{(pid=77622) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:82}} May 28 12:43:30 l75lg1-v1 neutron-server[77622]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.set_network_type {{(pid=77622) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:82}} May 28 12:43:30 l75lg1-v1 neutron-server[77622]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.update_mac_aging_settings {{(pid=77622) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:82}} May 28 12:43:30 l75lg1-v1 neutron-server[77622]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.update_nat_floating_ip_with_gateway_port_reference {{(pid=77622) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:82}} May 28 12:43:30 l75lg1-v1 neutron-server[77622]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.update_port_virtual_type {{(pid=77622) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:82}} May 28 12:43:30 l75lg1-v1 neutron-server[77622]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.update_router_distributed_flag {{(pid=77622) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:82}} May 28 12:43:30 l75lg1-v1 neutron-server[77621]: INFO oslo.messaging._drivers.impl_rabbit [None req-c0f77364-2642-431d-b5b5-d4f08d369f82 None None] Creating fanout queue: q-server-resource-versions_fanout_9935675e298c4b5eb4b8594c17ad8073 May 28 12:43:30 l75lg1-v1 neutron-server[77622]: DEBUG futurist.periodics [-] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.add_gw_port_info_to_logical_router_port' {{(pid=77622) _process_immediates /opt/stack/data/venv/lib/python3.10/site-packages/futurist/periodics.py:673}} May 28 12:43:30 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-958bbc1e-5f49-4fac-ada0-37ba83913152 None None] Hash Ring: Node c89b3497-133e-4a5a-b67a-3310d2cb2485 (host: l75lg1-v1) handling event "create" for row 0fa51a70-3fc8-4b32-bfba-4ddc2148baf0 (table: Database) {{(pid=77619) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:43:30 l75lg1-v1 neutron-server[77622]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver [-] Maintenance task thread has started May 28 12:43:30 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-958bbc1e-5f49-4fac-ada0-37ba83913152 None None] ChassisAgentWriteEvent : Matched Chassis_Private, create, None None {{(pid=77619) matches /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:65}} May 28 12:43:30 l75lg1-v1 neutron-server[77622]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver [-] MaintenanceWorker process has finished the post initialization May 28 12:43:30 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-958bbc1e-5f49-4fac-ada0-37ba83913152 None None] ChassisMetadataAgentWriteEvent : Matched Chassis_Private, create, None None {{(pid=77619) matches /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:65}} May 28 12:43:30 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-958bbc1e-5f49-4fac-ada0-37ba83913152 None None] Hash Ring: Node c89b3497-133e-4a5a-b67a-3310d2cb2485 (host: l75lg1-v1) handling event "create" for row 6ef07056-3e6a-44fb-b483-fdb6022e4e42 (table: Chassis_Private) {{(pid=77619) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:43:30 l75lg1-v1 neutron-server[77619]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver [None req-958bbc1e-5f49-4fac-ada0-37ba83913152 None None] WorkerService process has finished the post initialization May 28 12:43:30 l75lg1-v1 neutron-server[77619]: INFO neutron.wsgi [-] (77619) wsgi starting up on http://0.0.0.0:9696 May 28 12:43:30 l75lg1-v1 neutron-server[77621]: INFO oslo.messaging._drivers.impl_rabbit [None req-c0f77364-2642-431d-b5b5-d4f08d369f82 None None] Creating fanout queue: q-reports-plugin_fanout_463600ec92f04b2cbac1d810ae19b11d May 28 12:43:30 l75lg1-v1 neutron-server[77622]: DEBUG dbcounter [-] [77622] Writer thread running {{(pid=77622) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} May 28 12:43:30 l75lg1-v1 neutron-server[77622]: DEBUG futurist.periodics [None req-fbd03350-93f0-48b6-99af-923b4570b093 None None] Periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.add_gw_port_info_to_logical_router_port' raised 'NeverAgain' exception, stopping any further execution of it. {{(pid=77622) _on_done /opt/stack/data/venv/lib/python3.10/site-packages/futurist/periodics.py:710}} May 28 12:43:30 l75lg1-v1 neutron-server[77622]: DEBUG futurist.periodics [None req-fbd03350-93f0-48b6-99af-923b4570b093 None None] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.add_provider_resource_association_to_routers' {{(pid=77622) _process_immediates /opt/stack/data/venv/lib/python3.10/site-packages/futurist/periodics.py:673}} May 28 12:43:30 l75lg1-v1 neutron-server[77622]: DEBUG futurist.periodics [None req-fbd03350-93f0-48b6-99af-923b4570b093 None None] Periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.add_provider_resource_association_to_routers' raised 'NeverAgain' exception, stopping any further execution of it. {{(pid=77622) _on_done /opt/stack/data/venv/lib/python3.10/site-packages/futurist/periodics.py:710}} May 28 12:43:30 l75lg1-v1 neutron-server[77622]: DEBUG futurist.periodics [None req-fbd03350-93f0-48b6-99af-923b4570b093 None None] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.add_vnic_type_and_pb_capabilities_to_lsp' {{(pid=77622) _process_immediates /opt/stack/data/venv/lib/python3.10/site-packages/futurist/periodics.py:673}} May 28 12:43:30 l75lg1-v1 neutron-server[77622]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] There are no commands to commit {{(pid=77622) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:78}} May 28 12:43:30 l75lg1-v1 neutron-server[77622]: DEBUG futurist.periodics [None req-fbd03350-93f0-48b6-99af-923b4570b093 None None] Periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.add_vnic_type_and_pb_capabilities_to_lsp' raised 'NeverAgain' exception, stopping any further execution of it. {{(pid=77622) _on_done /opt/stack/data/venv/lib/python3.10/site-packages/futurist/periodics.py:710}} May 28 12:43:30 l75lg1-v1 neutron-server[77622]: DEBUG futurist.periodics [None req-fbd03350-93f0-48b6-99af-923b4570b093 None None] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_baremetal_ports_dhcp_options' {{(pid=77622) _process_immediates /opt/stack/data/venv/lib/python3.10/site-packages/futurist/periodics.py:673}} May 28 12:43:30 l75lg1-v1 neutron-server[77622]: DEBUG futurist.periodics [None req-fbd03350-93f0-48b6-99af-923b4570b093 None None] Periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_baremetal_ports_dhcp_options' raised 'NeverAgain' exception, stopping any further execution of it. {{(pid=77622) _on_done /opt/stack/data/venv/lib/python3.10/site-packages/futurist/periodics.py:710}} May 28 12:43:30 l75lg1-v1 neutron-server[77622]: DEBUG futurist.periodics [None req-fbd03350-93f0-48b6-99af-923b4570b093 None None] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fair_meter_consistency' {{(pid=77622) _process_immediates /opt/stack/data/venv/lib/python3.10/site-packages/futurist/periodics.py:673}} May 28 12:43:30 l75lg1-v1 neutron-server[77622]: DEBUG futurist.periodics [None req-fbd03350-93f0-48b6-99af-923b4570b093 None None] Periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fair_meter_consistency' raised 'NeverAgain' exception, stopping any further execution of it. {{(pid=77622) _on_done /opt/stack/data/venv/lib/python3.10/site-packages/futurist/periodics.py:710}} May 28 12:43:30 l75lg1-v1 neutron-server[77622]: DEBUG futurist.periodics [None req-fbd03350-93f0-48b6-99af-923b4570b093 None None] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=77622) _process_immediates /opt/stack/data/venv/lib/python3.10/site-packages/futurist/periodics.py:673}} May 28 12:43:30 l75lg1-v1 neutron-server[77622]: DEBUG futurist.periodics [None req-fbd03350-93f0-48b6-99af-923b4570b093 None None] Periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' raised 'NeverAgain' exception, stopping any further execution of it. {{(pid=77622) _on_done /opt/stack/data/venv/lib/python3.10/site-packages/futurist/periodics.py:710}} May 28 12:43:30 l75lg1-v1 neutron-server[77622]: DEBUG futurist.periodics [None req-fbd03350-93f0-48b6-99af-923b4570b093 None None] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_for_ha_chassis_group' {{(pid=77622) _process_immediates /opt/stack/data/venv/lib/python3.10/site-packages/futurist/periodics.py:673}} May 28 12:43:30 l75lg1-v1 neutron-server[77622]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] There are no commands to commit {{(pid=77622) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:78}} May 28 12:43:30 l75lg1-v1 neutron-server[77622]: DEBUG futurist.periodics [None req-fbd03350-93f0-48b6-99af-923b4570b093 None None] Periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_for_ha_chassis_group' raised 'NeverAgain' exception, stopping any further execution of it. {{(pid=77622) _on_done /opt/stack/data/venv/lib/python3.10/site-packages/futurist/periodics.py:710}} May 28 12:43:30 l75lg1-v1 neutron-server[77622]: DEBUG futurist.periodics [None req-fbd03350-93f0-48b6-99af-923b4570b093 None None] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_for_igmp_snoop_support' {{(pid=77622) _process_immediates /opt/stack/data/venv/lib/python3.10/site-packages/futurist/periodics.py:673}} May 28 12:43:30 l75lg1-v1 neutron-server[77622]: DEBUG futurist.periodics [None req-fbd03350-93f0-48b6-99af-923b4570b093 None None] Periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_for_igmp_snoop_support' raised 'NeverAgain' exception, stopping any further execution of it. {{(pid=77622) _on_done /opt/stack/data/venv/lib/python3.10/site-packages/futurist/periodics.py:710}} May 28 12:43:30 l75lg1-v1 neutron-server[77622]: DEBUG futurist.periodics [None req-fbd03350-93f0-48b6-99af-923b4570b093 None None] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_for_inconsistencies' {{(pid=77622) _process_immediates /opt/stack/data/venv/lib/python3.10/site-packages/futurist/periodics.py:673}} May 28 12:43:30 l75lg1-v1 neutron-server[77622]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-fbd03350-93f0-48b6-99af-923b4570b093 None None] Maintenance task: No inconsistencies found. Skipping {{(pid=77622) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:337}} May 28 12:43:30 l75lg1-v1 neutron-server[77622]: DEBUG futurist.periodics [None req-fbd03350-93f0-48b6-99af-923b4570b093 None None] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_for_mcast_flood_reports' {{(pid=77622) _process_immediates /opt/stack/data/venv/lib/python3.10/site-packages/futurist/periodics.py:673}} May 28 12:43:30 l75lg1-v1 neutron-server[77622]: DEBUG futurist.periodics [None req-fbd03350-93f0-48b6-99af-923b4570b093 None None] Periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_for_mcast_flood_reports' raised 'NeverAgain' exception, stopping any further execution of it. {{(pid=77622) _on_done /opt/stack/data/venv/lib/python3.10/site-packages/futurist/periodics.py:710}} May 28 12:43:30 l75lg1-v1 neutron-server[77622]: DEBUG futurist.periodics [None req-fbd03350-93f0-48b6-99af-923b4570b093 None None] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_global_dhcp_opts' {{(pid=77622) _process_immediates /opt/stack/data/venv/lib/python3.10/site-packages/futurist/periodics.py:673}} May 28 12:43:30 l75lg1-v1 neutron-server[77622]: DEBUG futurist.periodics [None req-fbd03350-93f0-48b6-99af-923b4570b093 None None] Periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_global_dhcp_opts' raised 'NeverAgain' exception, stopping any further execution of it. {{(pid=77622) _on_done /opt/stack/data/venv/lib/python3.10/site-packages/futurist/periodics.py:710}} May 28 12:43:30 l75lg1-v1 neutron-server[77622]: DEBUG futurist.periodics [None req-fbd03350-93f0-48b6-99af-923b4570b093 None None] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_localnet_port_has_learn_fdb' {{(pid=77622) _process_immediates /opt/stack/data/venv/lib/python3.10/site-packages/futurist/periodics.py:673}} May 28 12:43:30 l75lg1-v1 neutron-server[77622]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] There are no commands to commit {{(pid=77622) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:78}} May 28 12:43:30 l75lg1-v1 neutron-server[77622]: DEBUG futurist.periodics [None req-fbd03350-93f0-48b6-99af-923b4570b093 None None] Periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_localnet_port_has_learn_fdb' raised 'NeverAgain' exception, stopping any further execution of it. {{(pid=77622) _on_done /opt/stack/data/venv/lib/python3.10/site-packages/futurist/periodics.py:710}} May 28 12:43:30 l75lg1-v1 neutron-server[77622]: DEBUG futurist.periodics [None req-fbd03350-93f0-48b6-99af-923b4570b093 None None] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_port_has_address_scope' {{(pid=77622) _process_immediates /opt/stack/data/venv/lib/python3.10/site-packages/futurist/periodics.py:673}} May 28 12:43:30 l75lg1-v1 neutron-server[77622]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] There are no commands to commit {{(pid=77622) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:78}} May 28 12:43:30 l75lg1-v1 neutron-server[77622]: DEBUG futurist.periodics [None req-fbd03350-93f0-48b6-99af-923b4570b093 None None] Periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_port_has_address_scope' raised 'NeverAgain' exception, stopping any further execution of it. {{(pid=77622) _on_done /opt/stack/data/venv/lib/python3.10/site-packages/futurist/periodics.py:710}} May 28 12:43:30 l75lg1-v1 neutron-server[77622]: DEBUG futurist.periodics [None req-fbd03350-93f0-48b6-99af-923b4570b093 None None] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_redirect_type_router_gateway_ports' {{(pid=77622) _process_immediates /opt/stack/data/venv/lib/python3.10/site-packages/futurist/periodics.py:673}} May 28 12:43:30 l75lg1-v1 neutron-server[77622]: DEBUG futurist.periodics [None req-fbd03350-93f0-48b6-99af-923b4570b093 None None] Periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_redirect_type_router_gateway_ports' raised 'NeverAgain' exception, stopping any further execution of it. {{(pid=77622) _on_done /opt/stack/data/venv/lib/python3.10/site-packages/futurist/periodics.py:710}} May 28 12:43:30 l75lg1-v1 neutron-server[77622]: DEBUG futurist.periodics [None req-fbd03350-93f0-48b6-99af-923b4570b093 None None] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=77622) _process_immediates /opt/stack/data/venv/lib/python3.10/site-packages/futurist/periodics.py:673}} May 28 12:43:30 l75lg1-v1 neutron-server[77622]: DEBUG futurist.periodics [None req-fbd03350-93f0-48b6-99af-923b4570b093 None None] Periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' raised 'NeverAgain' exception, stopping any further execution of it. {{(pid=77622) _on_done /opt/stack/data/venv/lib/python3.10/site-packages/futurist/periodics.py:710}} May 28 12:43:30 l75lg1-v1 neutron-server[77622]: DEBUG futurist.periodics [None req-fbd03350-93f0-48b6-99af-923b4570b093 None None] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_vlan_distributed_ports' {{(pid=77622) _process_immediates /opt/stack/data/venv/lib/python3.10/site-packages/futurist/periodics.py:673}} May 28 12:43:30 l75lg1-v1 neutron-server[77622]: DEBUG futurist.periodics [None req-fbd03350-93f0-48b6-99af-923b4570b093 None None] Periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_vlan_distributed_ports' raised 'NeverAgain' exception, stopping any further execution of it. {{(pid=77622) _on_done /opt/stack/data/venv/lib/python3.10/site-packages/futurist/periodics.py:710}} May 28 12:43:30 l75lg1-v1 neutron-server[77622]: DEBUG futurist.periodics [None req-fbd03350-93f0-48b6-99af-923b4570b093 None None] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.cleanup_old_hash_ring_nodes' {{(pid=77622) _process_immediates /opt/stack/data/venv/lib/python3.10/site-packages/futurist/periodics.py:673}} May 28 12:43:30 l75lg1-v1 neutron-server[77622]: INFO neutron.db.ovn_hash_ring_db [None req-fbd03350-93f0-48b6-99af-923b4570b093 None None] Cleaned up Hash Ring nodes older than 5 days May 28 12:43:30 l75lg1-v1 neutron-server[77622]: DEBUG futurist.periodics [None req-fbd03350-93f0-48b6-99af-923b4570b093 None None] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.configure_nb_global' {{(pid=77622) _process_immediates /opt/stack/data/venv/lib/python3.10/site-packages/futurist/periodics.py:673}} May 28 12:43:30 l75lg1-v1 neutron-server[77622]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-fbd03350-93f0-48b6-99af-923b4570b093 None None] Setting NB_Global options: {'ignore_lsp_down': 'false', 'fdb_removal_limit': '0', 'mac_binding_removal_limit': '0'} {{(pid=77622) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:877}} May 28 12:43:30 l75lg1-v1 neutron-server[77622]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'ignore_lsp_down': 'false', 'fdb_removal_limit': '0', 'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=77622) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:43:30 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [-] Hash Ring: Node c89b3497-133e-4a5a-b67a-3310d2cb2485 (host: l75lg1-v1) handling event "update" for row 459958f3-26c0-486c-a7b4-0e57d78742d2 (table: NB_Global) {{(pid=77619) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:43:30 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched UPDATE: SbGlobalUpdateEvent(events=('update',), table='SB_Global', conditions=None, old_conditions=None), priority=20 to row=SB_Global(ipsec=False, ssl=[], nb_cfg=0, external_ids={}, options={'lb_hairpin_use_ct_mark': 'true', 'mac_prefix': '6e:b3:c1', 'max_tunid': '16711680', 'northd_internal_version': '22.03.3-20.21.0-62.4', 'svc_monitor_mac': '6e:c0:93:26:20:eb', 'fdb_removal_limit': '0', 'ignore_lsp_down': 'false', 'mac_binding_removal_limit': '0'}) old=SB_Global(options={'lb_hairpin_use_ct_mark': 'true', 'mac_prefix': '6e:b3:c1', 'max_tunid': '16711680', 'northd_internal_version': '22.03.3-20.21.0-62.4', 'svc_monitor_mac': '6e:c0:93:26:20:eb'}) {{(pid=76818) matches /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} May 28 12:43:30 l75lg1-v1 neutron-server[77622]: DEBUG futurist.periodics [None req-fbd03350-93f0-48b6-99af-923b4570b093 None None] Periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.configure_nb_global' raised 'NeverAgain' exception, stopping any further execution of it. {{(pid=77622) _on_done /opt/stack/data/venv/lib/python3.10/site-packages/futurist/periodics.py:710}} May 28 12:43:30 l75lg1-v1 neutron-server[77622]: DEBUG futurist.periodics [None req-fbd03350-93f0-48b6-99af-923b4570b093 None None] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.create_router_extra_attributes_registers' {{(pid=77622) _process_immediates /opt/stack/data/venv/lib/python3.10/site-packages/futurist/periodics.py:673}} May 28 12:43:30 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata.agent [-] Delaying updating chassis table for 0 seconds {{(pid=76818) run /opt/stack/neutron/neutron/agent/ovn/metadata/agent.py:364}} May 28 12:43:30 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=Chassis_Private, record=0da8323f-64af-4526-b223-049f5737145a, col_values=(('external_ids', {'neutron:ovn-metadata-sb-cfg': '0'}),), if_exists=True) {{(pid=76818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:43:30 l75lg1-v1 neutron-server[77621]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [-] ChassisMetadataAgentWriteEvent : Matched Chassis_Private, update, None None {{(pid=77621) matches /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:65}} May 28 12:43:30 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [-] ChassisMetadataAgentWriteEvent : Matched Chassis_Private, update, None None {{(pid=77619) matches /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:65}} May 28 12:43:30 l75lg1-v1 neutron-server[77618]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [-] ChassisMetadataAgentWriteEvent : Matched Chassis_Private, update, None None {{(pid=77618) matches /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:65}} May 28 12:43:30 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [-] Hash Ring: Node c89b3497-133e-4a5a-b67a-3310d2cb2485 (host: l75lg1-v1) handling event "update" for row 6ef07056-3e6a-44fb-b483-fdb6022e4e42 (table: Chassis_Private) {{(pid=77619) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:43:30 l75lg1-v1 neutron-server[77622]: DEBUG futurist.periodics [None req-fbd03350-93f0-48b6-99af-923b4570b093 None None] Periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.create_router_extra_attributes_registers' raised 'NeverAgain' exception, stopping any further execution of it. {{(pid=77622) _on_done /opt/stack/data/venv/lib/python3.10/site-packages/futurist/periodics.py:710}} May 28 12:43:30 l75lg1-v1 neutron-server[77622]: DEBUG futurist.periodics [None req-fbd03350-93f0-48b6-99af-923b4570b093 None None] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.remove_duplicated_chassis_registers' {{(pid=77622) _process_immediates /opt/stack/data/venv/lib/python3.10/site-packages/futurist/periodics.py:673}} May 28 12:43:30 l75lg1-v1 neutron-server[77622]: DEBUG futurist.periodics [None req-fbd03350-93f0-48b6-99af-923b4570b093 None None] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.remove_gw_ext_ids_from_logical_router' {{(pid=77622) _process_immediates /opt/stack/data/venv/lib/python3.10/site-packages/futurist/periodics.py:673}} May 28 12:43:30 l75lg1-v1 neutron-server[77622]: DEBUG futurist.periodics [None req-fbd03350-93f0-48b6-99af-923b4570b093 None None] Periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.remove_gw_ext_ids_from_logical_router' raised 'NeverAgain' exception, stopping any further execution of it. {{(pid=77622) _on_done /opt/stack/data/venv/lib/python3.10/site-packages/futurist/periodics.py:710}} May 28 12:43:30 l75lg1-v1 neutron-server[77622]: DEBUG futurist.periodics [None req-fbd03350-93f0-48b6-99af-923b4570b093 None None] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.remove_invalid_gateway_chassis_from_unbound_lrp' {{(pid=77622) _process_immediates /opt/stack/data/venv/lib/python3.10/site-packages/futurist/periodics.py:673}} May 28 12:43:30 l75lg1-v1 neutron-server[77622]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] There are no commands to commit {{(pid=77622) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:78}} May 28 12:43:30 l75lg1-v1 neutron-server[77622]: DEBUG futurist.periodics [None req-fbd03350-93f0-48b6-99af-923b4570b093 None None] Periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.remove_invalid_gateway_chassis_from_unbound_lrp' raised 'NeverAgain' exception, stopping any further execution of it. {{(pid=77622) _on_done /opt/stack/data/venv/lib/python3.10/site-packages/futurist/periodics.py:710}} May 28 12:43:30 l75lg1-v1 neutron-server[77622]: DEBUG futurist.periodics [None req-fbd03350-93f0-48b6-99af-923b4570b093 None None] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_network_type' {{(pid=77622) _process_immediates /opt/stack/data/venv/lib/python3.10/site-packages/futurist/periodics.py:673}} May 28 12:43:30 l75lg1-v1 neutron-server[77622]: DEBUG futurist.periodics [None req-fbd03350-93f0-48b6-99af-923b4570b093 None None] Periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_network_type' raised 'NeverAgain' exception, stopping any further execution of it. {{(pid=77622) _on_done /opt/stack/data/venv/lib/python3.10/site-packages/futurist/periodics.py:710}} May 28 12:43:30 l75lg1-v1 neutron-server[77622]: DEBUG futurist.periodics [None req-fbd03350-93f0-48b6-99af-923b4570b093 None None] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=77622) _process_immediates /opt/stack/data/venv/lib/python3.10/site-packages/futurist/periodics.py:673}} May 28 12:43:30 l75lg1-v1 neutron-server[77622]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=0) {{(pid=77622) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:43:30 l75lg1-v1 neutron-server[77622]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=77622) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} May 28 12:43:30 l75lg1-v1 neutron-server[77622]: DEBUG futurist.periodics [None req-fbd03350-93f0-48b6-99af-923b4570b093 None None] Periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' raised 'NeverAgain' exception, stopping any further execution of it. {{(pid=77622) _on_done /opt/stack/data/venv/lib/python3.10/site-packages/futurist/periodics.py:710}} May 28 12:43:30 l75lg1-v1 neutron-server[77622]: DEBUG futurist.periodics [None req-fbd03350-93f0-48b6-99af-923b4570b093 None None] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_nat_floating_ip_with_gateway_port_reference' {{(pid=77622) _process_immediates /opt/stack/data/venv/lib/python3.10/site-packages/futurist/periodics.py:673}} May 28 12:43:30 l75lg1-v1 neutron-server[77622]: DEBUG futurist.periodics [None req-fbd03350-93f0-48b6-99af-923b4570b093 None None] Periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_nat_floating_ip_with_gateway_port_reference' raised 'NeverAgain' exception, stopping any further execution of it. {{(pid=77622) _on_done /opt/stack/data/venv/lib/python3.10/site-packages/futurist/periodics.py:710}} May 28 12:43:30 l75lg1-v1 neutron-server[77622]: DEBUG futurist.periodics [None req-fbd03350-93f0-48b6-99af-923b4570b093 None None] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_port_virtual_type' {{(pid=77622) _process_immediates /opt/stack/data/venv/lib/python3.10/site-packages/futurist/periodics.py:673}} May 28 12:43:30 l75lg1-v1 neutron-server[77622]: DEBUG futurist.periodics [None req-fbd03350-93f0-48b6-99af-923b4570b093 None None] Periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_port_virtual_type' raised 'NeverAgain' exception, stopping any further execution of it. {{(pid=77622) _on_done /opt/stack/data/venv/lib/python3.10/site-packages/futurist/periodics.py:710}} May 28 12:43:30 l75lg1-v1 neutron-server[77622]: DEBUG futurist.periodics [None req-fbd03350-93f0-48b6-99af-923b4570b093 None None] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_router_distributed_flag' {{(pid=77622) _process_immediates /opt/stack/data/venv/lib/python3.10/site-packages/futurist/periodics.py:673}} May 28 12:43:30 l75lg1-v1 neutron-server[77622]: DEBUG futurist.periodics [None req-fbd03350-93f0-48b6-99af-923b4570b093 None None] Periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_router_distributed_flag' raised 'NeverAgain' exception, stopping any further execution of it. {{(pid=77622) _on_done /opt/stack/data/venv/lib/python3.10/site-packages/futurist/periodics.py:710}} May 28 12:43:31 l75lg1-v1 dstat.sh[49771]: 28-05 12:43:31| 18 9 70 2 0|2324M 7178M 267M 5928M| 23k 22k| 0 4191k| 0 292 |7897 15k|1.52 1.87 1.26|1.0 0 358| 0 0 | 0 2048M| 23 86 0 22 0 May 28 12:43:32 l75lg1-v1 dstat.sh[49771]: 28-05 12:43:32| 7 6 86 0 0|2337M 7166M 267M 5929M| 17k 6466B| 136k 732k|34.0 46.0 |7526 11k|1.48 1.85 1.26|1.0 0 219| 0 0 | 0 2048M| 23 86 0 22 0 May 28 12:43:32 l75lg1-v1 devstack@placement-api.service[78200]: [uWSGI] getting INI configuration from /etc/placement/placement-uwsgi.ini May 28 12:43:32 l75lg1-v1 devstack@placement-api.service[78200]: *** Starting uWSGI 2.0.20-debian (64bit) on [Tue May 28 12:43:32 2024] *** May 28 12:43:32 l75lg1-v1 devstack@placement-api.service[78200]: compiled with version: 11.2.0 on 21 March 2022 11:00:44 May 28 12:43:32 l75lg1-v1 devstack@placement-api.service[78200]: os: Linux-5.15.0-56-generic #62-Ubuntu SMP Tue Nov 22 19:54:14 UTC 2022 May 28 12:43:32 l75lg1-v1 devstack@placement-api.service[78200]: nodename: l75lg1-v1 May 28 12:43:32 l75lg1-v1 devstack@placement-api.service[78200]: machine: x86_64 May 28 12:43:32 l75lg1-v1 devstack@placement-api.service[78200]: clock source: unix May 28 12:43:32 l75lg1-v1 devstack@placement-api.service[78200]: pcre jit disabled May 28 12:43:32 l75lg1-v1 devstack@placement-api.service[78200]: detected number of CPU cores: 10 May 28 12:43:32 l75lg1-v1 devstack@placement-api.service[78200]: current working directory: / May 28 12:43:32 l75lg1-v1 devstack@placement-api.service[78200]: detected binary path: /usr/bin/uwsgi-core May 28 12:43:32 l75lg1-v1 devstack@placement-api.service[78200]: your processes number limit is 63557 May 28 12:43:32 l75lg1-v1 devstack@placement-api.service[78200]: your memory page size is 4096 bytes May 28 12:43:32 l75lg1-v1 devstack@placement-api.service[78200]: detected max file descriptor number: 2048 May 28 12:43:32 l75lg1-v1 devstack@placement-api.service[78200]: lock engine: pthread robust mutexes May 28 12:43:32 l75lg1-v1 devstack@placement-api.service[78200]: thunder lock: enabled May 28 12:43:32 l75lg1-v1 devstack@placement-api.service[78200]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/placement-api.socket fd 4 May 28 12:43:32 l75lg1-v1 devstack@placement-api.service[78200]: Python version: 3.10.12 (main, Nov 20 2023, 15:14:05) [GCC 11.4.0] May 28 12:43:32 l75lg1-v1 devstack@placement-api.service[78200]: PEP 405 virtualenv detected: /opt/stack/data/venv May 28 12:43:32 l75lg1-v1 devstack@placement-api.service[78200]: Set PythonHome to /opt/stack/data/venv May 28 12:43:32 l75lg1-v1 devstack@placement-api.service[78200]: Python main interpreter initialized at 0x55f1653d2b70 May 28 12:43:32 l75lg1-v1 devstack@placement-api.service[78200]: python threads support enabled May 28 12:43:32 l75lg1-v1 devstack@placement-api.service[78200]: your server socket listen backlog is limited to 100 connections May 28 12:43:32 l75lg1-v1 devstack@placement-api.service[78200]: your mercy for graceful operations on workers is 80 seconds May 28 12:43:32 l75lg1-v1 devstack@placement-api.service[78200]: mapped 403077 bytes (393 KB) for 2 cores May 28 12:43:32 l75lg1-v1 devstack@placement-api.service[78200]: *** Operational MODE: preforking *** May 28 12:43:32 l75lg1-v1 devstack@placement-api.service[78200]: *** uWSGI is running in multiple interpreter mode *** May 28 12:43:32 l75lg1-v1 devstack@placement-api.service[78200]: spawned uWSGI master process (pid: 78200) May 28 12:43:32 l75lg1-v1 devstack@placement-api.service[78200]: spawned uWSGI worker 1 (pid: 78201, cores: 1) May 28 12:43:32 l75lg1-v1 devstack@placement-api.service[78200]: spawned uWSGI worker 2 (pid: 78202, cores: 1) May 28 12:43:32 l75lg1-v1 devstack@placement-api.service[78200]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 28 12:43:33 l75lg1-v1 dstat.sh[49771]: 28-05 12:43:33| 15 3 81 0 0|2398M 7105M 267M 5929M| 15k 5290B| 0 9104k| 0 459 |3144 3212 |1.48 1.85 1.26|3.0 0 68| 0 0 | 0 2048M| 23 87 0 22 0 May 28 12:43:34 l75lg1-v1 dstat.sh[49771]: 28-05 12:43:34| 19 2 79 1 0|2473M 7030M 267M 5929M| 15k 0 | 0 4500k| 0 282 |2075 2495 |1.48 1.85 1.26|4.0 0 0| 0 0 | 0 2048M| 23 87 0 22 0 May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78202]: DEBUG placement.wsgi [-] ******************************************************************************** {{(pid=78202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2600}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78202]: DEBUG placement.wsgi [-] Configuration options gathered from: {{(pid=78202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2601}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78202]: DEBUG placement.wsgi [-] command line args: [] {{(pid=78202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78202]: DEBUG placement.wsgi [-] config files: ['/etc/placement/placement.conf'] {{(pid=78202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2603}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78202]: DEBUG placement.wsgi [-] ================================================================================ {{(pid=78202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2605}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78202]: DEBUG placement.wsgi [-] config_dir = [] {{(pid=78202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78202]: DEBUG placement.wsgi [-] config_file = ['/etc/placement/placement.conf'] {{(pid=78202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78202]: DEBUG placement.wsgi [-] config_source = [] {{(pid=78202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78202]: DEBUG placement.wsgi [-] debug = True {{(pid=78202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78202]: DEBUG placement.wsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'routes=INFO'] {{(pid=78202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78202]: DEBUG placement.wsgi [-] instance_format = [instance: %(uuid)s] {{(pid=78202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78202]: DEBUG placement.wsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=78202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78202]: DEBUG placement.wsgi [-] log_config_append = None {{(pid=78202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78202]: DEBUG placement.wsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=78202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78202]: DEBUG placement.wsgi [-] log_dir = None {{(pid=78202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78202]: DEBUG placement.wsgi [-] log_file = None {{(pid=78202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78202]: DEBUG placement.wsgi [-] log_options = True {{(pid=78202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78202]: DEBUG placement.wsgi [-] log_rotate_interval = 1 {{(pid=78202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78202]: DEBUG placement.wsgi [-] log_rotate_interval_type = days {{(pid=78202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78202]: DEBUG placement.wsgi [-] log_rotation_type = none {{(pid=78202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78202]: DEBUG placement.wsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=78202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78202]: DEBUG placement.wsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=78202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78202]: DEBUG placement.wsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=78202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78202]: DEBUG placement.wsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=78202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78202]: DEBUG placement.wsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=78202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78202]: DEBUG placement.wsgi [-] max_logfile_count = 30 {{(pid=78202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78202]: DEBUG placement.wsgi [-] max_logfile_size_mb = 200 {{(pid=78202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78202]: DEBUG placement.wsgi [-] publish_errors = False {{(pid=78202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78202]: DEBUG placement.wsgi [-] pybasedir = /opt/stack/placement {{(pid=78202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78202]: DEBUG placement.wsgi [-] rate_limit_burst = 0 {{(pid=78202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78202]: DEBUG placement.wsgi [-] rate_limit_except_level = CRITICAL {{(pid=78202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78202]: DEBUG placement.wsgi [-] rate_limit_interval = 0 {{(pid=78202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78202]: DEBUG placement.wsgi [-] state_path = /opt/stack/placement {{(pid=78202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78202]: DEBUG placement.wsgi [-] syslog_log_facility = LOG_USER {{(pid=78202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78202]: DEBUG placement.wsgi [-] tempdir = None {{(pid=78202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78202]: DEBUG placement.wsgi [-] use_eventlog = False {{(pid=78202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78202]: DEBUG placement.wsgi [-] use_journal = False {{(pid=78202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78202]: DEBUG placement.wsgi [-] use_json = False {{(pid=78202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78202]: DEBUG placement.wsgi [-] use_stderr = False {{(pid=78202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78202]: DEBUG placement.wsgi [-] use_syslog = False {{(pid=78202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78202]: DEBUG placement.wsgi [-] watch_log_file = False {{(pid=78202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78202]: DEBUG placement.wsgi [-] api.auth_strategy = keystone {{(pid=78202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78202]: DEBUG placement.wsgi [-] placement_database.connection = **** {{(pid=78202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78202]: DEBUG placement.wsgi [-] placement_database.connection_debug = 0 {{(pid=78202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78202]: DEBUG placement.wsgi [-] placement_database.connection_parameters = {{(pid=78202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78202]: DEBUG placement.wsgi [-] placement_database.connection_recycle_time = 3600 {{(pid=78202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78202]: DEBUG placement.wsgi [-] placement_database.connection_trace = False {{(pid=78202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78202]: DEBUG placement.wsgi [-] placement_database.max_overflow = None {{(pid=78202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78202]: DEBUG placement.wsgi [-] placement_database.max_pool_size = None {{(pid=78202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78202]: DEBUG placement.wsgi [-] placement_database.max_retries = 10 {{(pid=78202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78202]: DEBUG placement.wsgi [-] placement_database.mysql_sql_mode = TRADITIONAL {{(pid=78202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78202]: DEBUG placement.wsgi [-] placement_database.pool_timeout = None {{(pid=78202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78202]: DEBUG placement.wsgi [-] placement_database.retry_interval = 10 {{(pid=78202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78202]: DEBUG placement.wsgi [-] placement_database.slave_connection = **** {{(pid=78202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78202]: DEBUG placement.wsgi [-] placement_database.sqlite_synchronous = True {{(pid=78202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78202]: DEBUG placement.wsgi [-] placement_database.sync_on_startup = False {{(pid=78202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78202]: DEBUG placement.wsgi [-] placement.allocation_conflict_retry_count = 10 {{(pid=78202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78202]: DEBUG placement.wsgi [-] placement.incomplete_consumer_project_id = 00000000-0000-0000-0000-000000000000 {{(pid=78202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78202]: DEBUG placement.wsgi [-] placement.incomplete_consumer_user_id = 00000000-0000-0000-0000-000000000000 {{(pid=78202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78202]: DEBUG placement.wsgi [-] placement.randomize_allocation_candidates = False {{(pid=78202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78202]: DEBUG placement.wsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=78202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78202]: DEBUG placement.wsgi [-] oslo_policy.enforce_scope = False {{(pid=78202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78202]: DEBUG placement.wsgi [-] oslo_policy.policy_default_rule = default {{(pid=78202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78202]: DEBUG placement.wsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=78202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78202]: DEBUG placement.wsgi [-] oslo_policy.policy_file = policy.json {{(pid=78202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78202]: DEBUG placement.wsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=78202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78202]: DEBUG placement.wsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=78202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78202]: DEBUG placement.wsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=78202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78202]: DEBUG placement.wsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=78202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78202]: DEBUG placement.wsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=78202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78202]: DEBUG placement.wsgi [-] cors.allow_credentials = True {{(pid=78202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78202]: DEBUG placement.wsgi [-] cors.allow_headers = ['X-Auth-Token', 'X-Openstack-Request-Id', 'X-Identity-Status', 'X-Roles', 'X-Service-Catalog', 'X-User-Id', 'X-Tenant-Id', 'OpenStack-API-Version'] {{(pid=78202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78202]: DEBUG placement.wsgi [-] cors.allow_methods = ['GET', 'PUT', 'POST', 'DELETE', 'PATCH'] {{(pid=78202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78202]: DEBUG placement.wsgi [-] cors.allowed_origin = None {{(pid=78202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78202]: DEBUG placement.wsgi [-] cors.expose_headers = ['X-Auth-Token', 'X-Openstack-Request-Id', 'X-Subject-Token', 'X-Service-Token', 'OpenStack-API-Version'] {{(pid=78202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78202]: DEBUG placement.wsgi [-] cors.max_age = 3600 {{(pid=78202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78202]: DEBUG placement.wsgi [-] oslo_middleware.enable_proxy_headers_parsing = False {{(pid=78202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78202]: DEBUG placement.wsgi [-] profiler.connection_string = messaging:// {{(pid=78202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78202]: DEBUG placement.wsgi [-] profiler.enabled = False {{(pid=78202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78202]: DEBUG placement.wsgi [-] profiler.es_doc_type = notification {{(pid=78202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78202]: DEBUG placement.wsgi [-] profiler.es_scroll_size = 10000 {{(pid=78202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78202]: DEBUG placement.wsgi [-] profiler.es_scroll_time = 2m {{(pid=78202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78202]: DEBUG placement.wsgi [-] profiler.filter_error_trace = False {{(pid=78202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78202]: DEBUG placement.wsgi [-] profiler.hmac_keys = **** {{(pid=78202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78202]: DEBUG placement.wsgi [-] profiler.sentinel_service_name = mymaster {{(pid=78202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78202]: DEBUG placement.wsgi [-] profiler.socket_timeout = 0.1 {{(pid=78202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78202]: DEBUG placement.wsgi [-] profiler.trace_requests = False {{(pid=78202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78202]: DEBUG placement.wsgi [-] profiler.trace_sqlalchemy = False {{(pid=78202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78202]: DEBUG placement.wsgi [-] ******************************************************************************** {{(pid=78202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2624}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78201]: DEBUG placement.wsgi [-] ******************************************************************************** {{(pid=78201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2600}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78201]: DEBUG placement.wsgi [-] Configuration options gathered from: {{(pid=78201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2601}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78201]: DEBUG placement.wsgi [-] command line args: [] {{(pid=78201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78201]: DEBUG placement.wsgi [-] config files: ['/etc/placement/placement.conf'] {{(pid=78201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2603}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78201]: DEBUG placement.wsgi [-] ================================================================================ {{(pid=78201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2605}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78201]: DEBUG placement.wsgi [-] config_dir = [] {{(pid=78201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78201]: DEBUG placement.wsgi [-] config_file = ['/etc/placement/placement.conf'] {{(pid=78201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78201]: DEBUG placement.wsgi [-] config_source = [] {{(pid=78201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78201]: DEBUG placement.wsgi [-] debug = True {{(pid=78201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78201]: DEBUG placement.wsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'routes=INFO'] {{(pid=78201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78201]: DEBUG placement.wsgi [-] instance_format = [instance: %(uuid)s] {{(pid=78201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78201]: DEBUG placement.wsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=78201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78201]: DEBUG placement.wsgi [-] log_config_append = None {{(pid=78201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78201]: DEBUG placement.wsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=78201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78201]: DEBUG placement.wsgi [-] log_dir = None {{(pid=78201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78202]: WARNING keystonemiddleware.auth_token [-] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78201]: DEBUG placement.wsgi [-] log_file = None {{(pid=78201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78201]: DEBUG placement.wsgi [-] log_options = True {{(pid=78201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78201]: DEBUG placement.wsgi [-] log_rotate_interval = 1 {{(pid=78201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78201]: DEBUG placement.wsgi [-] log_rotate_interval_type = days {{(pid=78201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78201]: DEBUG placement.wsgi [-] log_rotation_type = none {{(pid=78201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78201]: DEBUG placement.wsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=78201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78201]: DEBUG placement.wsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=78201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78201]: DEBUG placement.wsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=78201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78201]: DEBUG placement.wsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=78201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78201]: DEBUG placement.wsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=78201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78201]: DEBUG placement.wsgi [-] max_logfile_count = 30 {{(pid=78201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78201]: DEBUG placement.wsgi [-] max_logfile_size_mb = 200 {{(pid=78201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78201]: DEBUG placement.wsgi [-] publish_errors = False {{(pid=78201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78201]: DEBUG placement.wsgi [-] pybasedir = /opt/stack/placement {{(pid=78201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78201]: DEBUG placement.wsgi [-] rate_limit_burst = 0 {{(pid=78201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78201]: DEBUG placement.wsgi [-] rate_limit_except_level = CRITICAL {{(pid=78201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78201]: DEBUG placement.wsgi [-] rate_limit_interval = 0 {{(pid=78201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78201]: DEBUG placement.wsgi [-] state_path = /opt/stack/placement {{(pid=78201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78201]: DEBUG placement.wsgi [-] syslog_log_facility = LOG_USER {{(pid=78201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78201]: DEBUG placement.wsgi [-] tempdir = None {{(pid=78201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78201]: DEBUG placement.wsgi [-] use_eventlog = False {{(pid=78201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78201]: DEBUG placement.wsgi [-] use_journal = False {{(pid=78201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78201]: DEBUG placement.wsgi [-] use_json = False {{(pid=78201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78201]: DEBUG placement.wsgi [-] use_stderr = False {{(pid=78201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78201]: DEBUG placement.wsgi [-] use_syslog = False {{(pid=78201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78201]: DEBUG placement.wsgi [-] watch_log_file = False {{(pid=78201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78201]: DEBUG placement.wsgi [-] api.auth_strategy = keystone {{(pid=78201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78201]: DEBUG placement.wsgi [-] placement_database.connection = **** {{(pid=78201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78201]: DEBUG placement.wsgi [-] placement_database.connection_debug = 0 {{(pid=78201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78201]: DEBUG placement.wsgi [-] placement_database.connection_parameters = {{(pid=78201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78201]: DEBUG placement.wsgi [-] placement_database.connection_recycle_time = 3600 {{(pid=78201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78201]: DEBUG placement.wsgi [-] placement_database.connection_trace = False {{(pid=78201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78201]: DEBUG placement.wsgi [-] placement_database.max_overflow = None {{(pid=78201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78201]: DEBUG placement.wsgi [-] placement_database.max_pool_size = None {{(pid=78201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78201]: DEBUG placement.wsgi [-] placement_database.max_retries = 10 {{(pid=78201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78201]: DEBUG placement.wsgi [-] placement_database.mysql_sql_mode = TRADITIONAL {{(pid=78201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78201]: DEBUG placement.wsgi [-] placement_database.pool_timeout = None {{(pid=78201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78201]: DEBUG placement.wsgi [-] placement_database.retry_interval = 10 {{(pid=78201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78201]: DEBUG placement.wsgi [-] placement_database.slave_connection = **** {{(pid=78201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78201]: DEBUG placement.wsgi [-] placement_database.sqlite_synchronous = True {{(pid=78201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78201]: DEBUG placement.wsgi [-] placement_database.sync_on_startup = False {{(pid=78201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78201]: DEBUG placement.wsgi [-] placement.allocation_conflict_retry_count = 10 {{(pid=78201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78201]: DEBUG placement.wsgi [-] placement.incomplete_consumer_project_id = 00000000-0000-0000-0000-000000000000 {{(pid=78201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78201]: DEBUG placement.wsgi [-] placement.incomplete_consumer_user_id = 00000000-0000-0000-0000-000000000000 {{(pid=78201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78201]: DEBUG placement.wsgi [-] placement.randomize_allocation_candidates = False {{(pid=78201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78201]: DEBUG placement.wsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=78201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78201]: DEBUG placement.wsgi [-] oslo_policy.enforce_scope = False {{(pid=78201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78201]: DEBUG placement.wsgi [-] oslo_policy.policy_default_rule = default {{(pid=78201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78201]: DEBUG placement.wsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=78201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78201]: DEBUG placement.wsgi [-] oslo_policy.policy_file = policy.json {{(pid=78201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78201]: DEBUG placement.wsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=78201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78201]: DEBUG placement.wsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=78201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78201]: DEBUG placement.wsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=78201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78201]: DEBUG placement.wsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=78201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78201]: DEBUG placement.wsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=78201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78201]: DEBUG placement.wsgi [-] cors.allow_credentials = True {{(pid=78201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78201]: DEBUG placement.wsgi [-] cors.allow_headers = ['X-Auth-Token', 'X-Openstack-Request-Id', 'X-Identity-Status', 'X-Roles', 'X-Service-Catalog', 'X-User-Id', 'X-Tenant-Id', 'OpenStack-API-Version'] {{(pid=78201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78201]: DEBUG placement.wsgi [-] cors.allow_methods = ['GET', 'PUT', 'POST', 'DELETE', 'PATCH'] {{(pid=78201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78201]: DEBUG placement.wsgi [-] cors.allowed_origin = None {{(pid=78201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78201]: DEBUG placement.wsgi [-] cors.expose_headers = ['X-Auth-Token', 'X-Openstack-Request-Id', 'X-Subject-Token', 'X-Service-Token', 'OpenStack-API-Version'] {{(pid=78201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78201]: DEBUG placement.wsgi [-] cors.max_age = 3600 {{(pid=78201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78201]: DEBUG placement.wsgi [-] oslo_middleware.enable_proxy_headers_parsing = False {{(pid=78201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78201]: DEBUG placement.wsgi [-] profiler.connection_string = messaging:// {{(pid=78201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78201]: DEBUG placement.wsgi [-] profiler.enabled = False {{(pid=78201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78201]: DEBUG placement.wsgi [-] profiler.es_doc_type = notification {{(pid=78201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78201]: DEBUG placement.wsgi [-] profiler.es_scroll_size = 10000 {{(pid=78201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78201]: DEBUG placement.wsgi [-] profiler.es_scroll_time = 2m {{(pid=78201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78201]: DEBUG placement.wsgi [-] profiler.filter_error_trace = False {{(pid=78201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78201]: DEBUG placement.wsgi [-] profiler.hmac_keys = **** {{(pid=78201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78201]: DEBUG placement.wsgi [-] profiler.sentinel_service_name = mymaster {{(pid=78201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78201]: DEBUG placement.wsgi [-] profiler.socket_timeout = 0.1 {{(pid=78201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78201]: DEBUG placement.wsgi [-] profiler.trace_requests = False {{(pid=78201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78201]: DEBUG placement.wsgi [-] profiler.trace_sqlalchemy = False {{(pid=78201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78201]: DEBUG placement.wsgi [-] ******************************************************************************** {{(pid=78201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2624}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78201]: WARNING keystonemiddleware.auth_token [-] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78202]: WARNING py.warnings [-] /opt/stack/data/venv/lib/python3.10/site-packages/pkg_resources/__init__.py:116: PkgResourcesDeprecationWarning: 0.1.43ubuntu1 is an invalid version and will not be supported in a future release May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78202]: warnings.warn( May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78202]: : pkg_resources.extern.packaging.version.InvalidVersion: Invalid version: '0.1.43ubuntu1' May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78202]: WARNING py.warnings [-] /opt/stack/data/venv/lib/python3.10/site-packages/pkg_resources/__init__.py:116: PkgResourcesDeprecationWarning: 1.1build1 is an invalid version and will not be supported in a future release May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78202]: warnings.warn( May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78202]: : pkg_resources.extern.packaging.version.InvalidVersion: Invalid version: '1.1build1' May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78202]: WARNING keystonemiddleware.auth_token [-] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78202]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "trait_sync" {{(pid=78202) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78202]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "trait_sync" {{(pid=78202) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78201]: WARNING py.warnings [-] /opt/stack/data/venv/lib/python3.10/site-packages/pkg_resources/__init__.py:116: PkgResourcesDeprecationWarning: 0.1.43ubuntu1 is an invalid version and will not be supported in a future release May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78201]: warnings.warn( May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78201]: : pkg_resources.extern.packaging.version.InvalidVersion: Invalid version: '0.1.43ubuntu1' May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78201]: WARNING py.warnings [-] /opt/stack/data/venv/lib/python3.10/site-packages/pkg_resources/__init__.py:116: PkgResourcesDeprecationWarning: 1.1build1 is an invalid version and will not be supported in a future release May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78201]: warnings.warn( May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78201]: : pkg_resources.extern.packaging.version.InvalidVersion: Invalid version: '1.1build1' May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78201]: WARNING keystonemiddleware.auth_token [-] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78201]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "trait_sync" {{(pid=78201) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78201]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "trait_sync" {{(pid=78201) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78202]: INFO dbcounter [-] Registered counter for database placement May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78201]: INFO dbcounter [-] Registered counter for database placement May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78202]: DEBUG oslo_db.sqlalchemy.engines [-] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=78202) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:342}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78202]: DEBUG dbcounter [-] [78202] Writer thread running {{(pid=78202) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78201]: DEBUG oslo_db.sqlalchemy.engines [-] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=78201) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:342}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78201]: DEBUG dbcounter [-] [78201] Writer thread running {{(pid=78201) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78202]: DEBUG placement.objects.trait [-] Synced traits from os_traits into API DB: {'HW_GPU_API_OPENGL_V3_0', 'HW_NIC_OFFLOAD_GRO', 'HW_CPU_AARCH64_ASIMD', 'COMPUTE_EPHEMERAL_ENCRYPTION_LUKS', 'HW_GPU_API_OPENGL_V1_3', 'HW_ARCH_SPARC64', 'COMPUTE_NET_VIF_MODEL_VMXNET3', 'HW_CPU_X86_AVX512CD', 'HW_CPU_X86_FMA4', 'HW_ARCH_ALPHA', 'HW_NIC_ACCEL_DEFLATE', 'HW_NIC_OFFLOAD_LSO', 'HW_GPU_API_OPENCL_V1_1', 'HW_CPU_PPC64LE_POWER8', 'HW_CPU_X86_SSE', 'HW_GPU_API_DIRECT3D_V9_0L', 'HW_NIC_SRIOV_QOS_RX', 'HW_CPU_X86_SHA', 'HW_ARCH_MICROBLAZE', 'HW_CPU_AARCH64_ASIMDHP', 'COMPUTE_VIOMMU_MODEL_INTEL', 'HW_GPU_API_OPENGL_V1_2', 'COMPUTE_GRAPHICS_MODEL_VGA', 'HW_NIC_OFFLOAD_TCS', 'HW_NIC_ACCEL_IPSEC', 'COMPUTE_IMAGE_TYPE_VHD', 'COMPUTE_ARCH_S390X', 'HW_NIC_OFFLOAD_VXLAN', 'COMPUTE_ADDRESS_SPACE_PASSTHROUGH', 'COMPUTE_IMAGE_TYPE_RAW', 'HW_GPU_API_DIRECT3D_V9_0C', 'COMPUTE_STORAGE_BUS_VIRTIO', 'COMPUTE_GRAPHICS_MODEL_VMVGA', 'HW_CPU_X86_MMX', 'COMPUTE_STORAGE_BUS_UML', 'HW_CPU_X86_AMD_SSBD', 'HW_GPU_RESOLUTION_W1024H768', 'HW_GPU_MAX_DISPLAY_HEADS_6', 'HW_CPU_X86_AVX512VL', 'HW_CPU_X86_FMA3', 'HW_GPU_RESOLUTION_W2560H1600', 'COMPUTE_NET_ATTACH_INTERFACE', 'COMPUTE_MIGRATE_AUTO_CONVERGE', 'HW_NIC_DCB_ETS', 'COMPUTE_NET_VIF_MODEL_VIRTIO', 'HW_CPU_X86_VMX', 'HW_CPU_X86_F16C', 'HW_NIC_VMDQ', 'COMPUTE_NET_VIF_MODEL_PCNET', 'HW_GPU_API_OPENGL_V2_0', 'HW_ARCH_LM32', 'HW_GPU_API_DIRECTX_V11', 'COMPUTE_STORAGE_BUS_LXC', 'COMPUTE_ARCH_AARCH64', 'HW_CPU_X86_INTEL_VMX', 'COMPUTE_IMAGE_TYPE_VDI', 'HW_CPU_AARCH64_ASIMDDP', 'HW_ARCH_OPENRISC', 'COMPUTE_VOLUME_ATTACH', 'COMPUTE_IMAGE_TYPE_ARI', 'COMPUTE_EPHEMERAL_ENCRYPTION', 'HW_ARCH_PPCLE', 'HW_CPU_X86_AVX512DQ', 'COMPUTE_ACCELERATORS', 'HW_ARCH_SPARC', 'HW_GPU_MAX_DISPLAY_HEADS_2', 'HW_CPU_X86_AVX', 'HW_ARCH_I686', 'HW_ARCH_CRIS', 'HW_ARCH_PPC', 'HW_GPU_API_OPENCL_V2_1', 'HW_NIC_OFFLOAD_GSO', 'HW_CPU_AARCH64_FPHP', 'HW_CPU_X86_AVX2', 'HW_GPU_API_OPENCL_V2_0', 'HW_GPU_CUDA_COMPUTE_CAPABILITY_V1_0', 'COMPUTE_VOLUME_EXTEND', 'COMPUTE_GRAPHICS_MODEL_GOP', 'HW_CPU_X86_TSX', 'HW_GPU_RESOLUTION_W640H480', 'COMPUTE_STORAGE_BUS_IDE', 'HW_NIC_ACCEL_ECC', 'HW_CPU_X86_PDPE1GB', 'HW_CPU_X86_AVX512F', 'OWNER_NOVA', 'HW_GPU_CUDA_COMPUTE_CAPABILITY_V2_1', 'COMPUTE_ARCH_X86_64', 'HW_GPU_CUDA_SDK_V8_0', 'HW_GPU_CUDA_COMPUTE_CAPABILITY_V5_3', 'HW_NIC_OFFLOAD_UFO', 'COMPUTE_SECURITY_TPM_2_0', 'COMPUTE_NET_VIRTIO_PACKED', 'HW_NIC_OFFLOAD_TSO', 'COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG', 'HW_GPU_API_DIRECT2D', 'HW_GPU_CUDA_SDK_V9_0', 'HW_ARCH_AARCH64', 'HW_CPU_AARCH64_FP', 'HW_NIC_PROGRAMMABLE_PIPELINE', 'COMPUTE_ARCH_PPC64LE', 'COMPUTE_SOCKET_PCI_NUMA_AFFINITY', 'HW_GPU_CUDA_COMPUTE_CAPABILITY_V6_0', 'HW_ARCH_M68K', 'HW_CPU_AARCH64_EVTSTRM', 'HW_GPU_RESOLUTION_W1360H768', 'HW_GPU_API_DIRECT3D_V12_0', 'HW_CPU_AARCH64_SHA1', 'HW_GPU_API_DIRECT3D_V11_2', 'HW_NIC_OFFLOAD_SG', 'COMPUTE_STORAGE_BUS_XEN', 'COMPUTE_VIOMMU_MODEL_VIRTIO', 'HW_CPU_X86_CLMUL', 'HW_CPU_X86_AMD_IBPB', 'COMPUTE_IMAGE_TYPE_VMDK', 'HW_GPU_RESOLUTION_W1280H800', 'HW_ARCH_SH4', 'COMPUTE_IMAGE_TYPE_AMI', 'HW_NIC_OFFLOAD_TXUDP', 'HW_CPU_AARCH64_DCPOP', 'COMPUTE_FIRMWARE_BIOS', 'HW_ARCH_SH4EB', 'HW_CPU_HYPERTHREADING', 'COMPUTE_GRAPHICS_MODEL_BOCHS', 'HW_CPU_AARCH64_SHA512', 'HW_NIC_ACCEL_RSA', 'COMPUTE_ARCH_MIPSEL', 'HW_GPU_API_DIRECT3D_V9_0B', 'COMPUTE_GRAPHICS_MODEL_CIRRUS', 'HW_CPU_X86_MPX', 'HW_CPU_X86_ASF', 'COMPUTE_NET_VIF_MODEL_E1000E', 'HW_CPU_AARCH64_SHA2', 'HW_NIC_ACCEL_SSL', 'HW_CPU_X86_AVX512ER', 'HW_NUMA_ROOT', 'HW_GPU_CUDA_SDK_V9_2', 'COMPUTE_NODE', 'COMPUTE_IMAGE_TYPE_QCOW2', 'HW_CPU_AARCH64_FCMA', 'HW_GPU_API_OPENGL_V3_1', 'COMPUTE_SECURITY_TPM_1_2', 'COMPUTE_CONFIG_DRIVE_REGENERATION', 'HW_GPU_MAX_DISPLAY_HEADS_1', 'HW_ARCH_XTENSA', 'HW_CPU_X86_AMD_VIRT_SSBD', 'OWNER_CYBORG', 'HW_GPU_API_DIRECT3D_V7_0', 'HW_CPU_AARCH64_SVE', 'HW_CPU_X86_INTEL_MD_CLEAR', 'HW_CPU_X86_SSSE3', 'HW_GPU_API_VULKAN', 'STORAGE_DISK_SSD', 'HW_ARCH_PARISC64', 'HW_ARCH_ARMV7B', 'HW_NIC_OFFLOAD_GRE', 'COMPUTE_GRAPHICS_MODEL_NONE', 'HW_CPU_X86_INTEL_SSBD', 'HW_NIC_OFFLOAD_SCS', 'HW_CPU_AARCH64_SM3', 'HW_NIC_OFFLOAD_RX', 'HW_GPU_API_OPENGL_V1_5', 'COMPUTE_TRUSTED_CERTS', 'HW_ARCH_PPCEMB', 'HW_GPU_RESOLUTION_W1920H1200', 'HW_CPU_AARCH64_PMULL', 'HW_GPU_RESOLUTION_W1680H1050', 'HW_CPU_X86_AESNI', 'HW_GPU_API_DIRECT3D_V8_1', 'HW_ARCH_MIPS64', 'HW_NIC_SRIOV', 'HW_CPU_X86_AVX512VAES', 'COMPUTE_NET_VIF_MODEL_LAN9118', 'HW_NIC_ACCEL_LZS', 'COMPUTE_ARCH_RISCV64', 'COMPUTE_VOLUME_ATTACH_WITH_TAG', 'HW_CPU_X86_AVX512PF', 'COMPUTE_GRAPHICS_MODEL_XEN', 'HW_NIC_OFFLOAD_RXVLAN', 'HW_NIC_OFFLOAD_RDMA', 'HW_GPU_API_DIRECT3D_V9_0', 'COMPUTE_RESCUE_BFV', 'HW_GPU_RESOLUTION_W1280H768', 'COMPUTE_GRAPHICS_MODEL_VIRTIO', 'HW_GPU_API_OPENCL_V1_2', 'HW_CPU_AARCH64_CRC32', 'HW_ARCH_S390', 'COMPUTE_NET_VIF_MODEL_E1000', 'HW_CPU_X86_AVX512VPOPCNTDQ', 'HW_CPU_X86_AMD_SVM', 'COMPUTE_NET_VIF_MODEL_SRIOV', 'HW_GPU_API_DIRECT3D_V10_1', 'HW_GPU_API_DIRECT3D_V11_1', 'HW_ARCH_MIPS', 'COMPUTE_NET_VIF_MODEL_NETFRONT', 'COMPUTE_REMOTE_MANAGED_PORTS', 'HW_ARCH_PPC64LE', 'COMPUTE_VOLUME_MULTI_ATTACH', 'HW_CPU_AARCH64_SM4', 'HW_GPU_API_DIRECT3D_V8_0', 'HW_GPU_API_DXVA', 'HW_CPU_X86_BMI', 'HW_CPU_X86_INTEL_SPEC_CTRL', 'HW_GPU_CUDA_COMPUTE_CAPABILITY_V2_0', 'HW_CPU_X86_AVX512IFMA', 'HW_GPU_RESOLUTION_W2560H1440', 'HW_ARCH_IA64', 'HW_GPU_API_OPENGL_V4_2', 'HW_GPU_CUDA_COMPUTE_CAPABILITY_V1_2', 'HW_GPU_CUDA_COMPUTE_CAPABILITY_V1_3', 'HW_GPU_CUDA_COMPUTE_CAPABILITY_V1_1', 'HW_GPU_RESOLUTION_W1366H768', 'HW_GPU_API_OPENGL_V2_1', 'HW_GPU_RESOLUTION_W1600H1200', 'HW_CPU_AARCH64_CPUID', 'HW_CPU_AARCH64_ATOMICS', 'HW_NIC_OFFLOAD_FDF', 'HW_GPU_CUDA_SDK_V9_1', 'HW_ARCH_MICROBLAZEEL', 'HW_GPU_API_OPENGL_V4_5', 'HW_GPU_CUDA_COMPUTE_CAPABILITY_V5_2', 'HW_CPU_AARCH64_SHA3', 'HW_GPU_CUDA_COMPUTE_CAPABILITY_V3_7', 'HW_CPU_X86_BMI2', 'HW_GPU_CUDA_SDK_V10_0', 'HW_GPU_CUDA_SDK_V7_5', 'HW_CPU_X86_SVM', 'HW_CPU_PPC64LE_POWER9', 'HW_NIC_OFFLOAD_GENEVE', 'HW_GPU_RESOLUTION_W1280H720', 'HW_GPU_CUDA_SDK_V6_5', 'COMPUTE_NET_VIF_MODEL_SPAPR_VLAN', 'HW_GPU_RESOLUTION_W3840H2160', 'HW_CPU_X86_AVX512BITALG', 'COMPUTE_STORAGE_BUS_USB', 'HW_CPU_AARCH64_AES', 'COMPUTE_STORAGE_BUS_SCSI', 'HW_ARCH_XTENSAEB', 'HW_GPU_CUDA_COMPUTE_CAPABILITY_V3_0', 'HW_GPU_API_OPENGL_V4_3', 'HW_CPU_X86_SSE3', 'HW_NIC_SRIOV_TRUSTED', 'COMPUTE_MIGRATE_POST_COPY', 'HW_NIC_SRIOV_QOS_TX', 'HW_CPU_X86_AVX512VPCLMULQDQ', 'HW_CPU_X86_SSE41', 'HW_GPU_API_DIRECTX_V10', 'HW_ARCH_MIPS64EL', 'HW_NIC_DCB_QCN', 'HW_CPU_X86_AVX512BW', 'HW_GPU_API_DIRECT3D_V6_0', 'HW_ARCH_MIPSEL', 'COMPUTE_VIOMMU_MODEL_SMMUV3', 'HW_GPU_CUDA_COMPUTE_CAPABILITY_V6_2', 'COMPUTE_NET_VIF_MODEL_RTL8139', 'HW_GPU_API_OPENGL_V3_2', 'COMPUTE_MANAGED_PCI_DEVICE', 'COMPUTE_EPHEMERAL_ENCRYPTION_PLAIN', 'HW_GPU_MAX_DISPLAY_HEADS_8', 'HW_CPU_AARCH64_JSCVT', 'HW_CPU_X86_STIBP', 'HW_GPU_API_OPENGL_V4_0', 'STORAGE_DISK_HDD', 'HW_NIC_ACCEL_DIFFIEH', 'HW_CPU_X86_AVX512VNNI', 'HW_ARCH_PPC64', 'HW_NIC_MULTIQUEUE', 'HW_GPU_MAX_DISPLAY_HEADS_4', 'HW_GPU_CUDA_COMPUTE_CAPABILITY_V7_2', 'HW_GPU_CUDA_COMPUTE_CAPABILITY_V3_2', 'HW_CPU_X86_SSE2', 'HW_CPU_X86_ABM', 'HW_GPU_CUDA_COMPUTE_CAPABILITY_V7_1', 'MISC_SHARES_VIA_AGGREGATE', 'HW_GPU_RESOLUTION_W7680H4320', 'HW_CPU_X86_AVX512GFNI', 'COMPUTE_IMAGE_TYPE_AKI', 'COMPUTE_DEVICE_TAGGING', 'HW_CPU_X86_AVX512VBMI', 'COMPUTE_IMAGE_TYPE_PLOOP', 'HW_CPU_X86_SSE4A', 'HW_ARCH_S390X', 'HW_CPU_X86_AVX512VBMI2', 'HW_NIC_OFFLOAD_LRO', 'HW_NIC_OFFLOAD_L2CRC', 'HW_GPU_API_DIRECT3D_V11_0', 'HW_CPU_X86_SGX', 'HW_ARCH_ARMV7', 'HW_CPU_X86_XOP', 'COMPUTE_VIOMMU_MODEL_AUTO', 'COMPUTE_STORAGE_VIRTIO_FS', 'COMPUTE_NET_VIF_MODEL_VMXNET', 'HW_GPU_API_DIRECTX_V12', 'HW_GPU_RESOLUTION_W1280H1024', 'HW_GPU_RESOLUTION_W320H240', 'HW_GPU_API_DIRECT3D_V11_3', 'HW_NIC_OFFLOAD_TX', 'HW_GPU_CUDA_COMPUTE_CAPABILITY_V6_1', 'HW_GPU_RESOLUTION_W1440H900', 'HW_GPU_API_OPENGL_V1_4', 'HW_CPU_AMD_SEV', 'HW_NIC_OFFLOAD_UCS', 'HW_CPU_AARCH64_LRCPC', 'COMPUTE_FIRMWARE_UEFI', 'HW_CPU_X86_AMD_SEV', 'HW_GPU_API_OPENGL_V4_1', 'COMPUTE_IMAGE_TYPE_VHDX', 'HW_GPU_RESOLUTION_W1024H600', 'HW_NIC_OFFLOAD_QINQ', 'HW_ARCH_ARMV6', 'HW_GPU_API_OPENGL_V3_3', 'HW_GPU_API_DIRECT3D_V10_0', 'HW_GPU_CUDA_COMPUTE_CAPABILITY_V5_0', 'HW_CPU_X86_AMD_NO_SSB', 'COMPUTE_GRAPHICS_MODEL_QXL', 'HW_NIC_OFFLOAD_SWITCHDEV', 'HW_GPU_API_OPENCL_V1_0', 'HW_GPU_RESOLUTION_W1152H864', 'HW_GPU_RESOLUTION_W800H600', 'COMPUTE_SECURITY_UEFI_SECURE_BOOT', 'COMPUTE_NET_VIF_MODEL_NE2K_PCI', 'HW_GPU_RESOLUTION_W1600H900', 'HW_NIC_OFFLOAD_RXHASH', 'HW_GPU_API_OPENGL_V1_1', 'COMPUTE_IMAGE_TYPE_ISO', 'HW_CPU_X86_INTEL_PCID', 'COMPUTE_ADDRESS_SPACE_EMULATED', 'HW_CPU_X86_SSE42', 'HW_GPU_API_OPENGL_V4_4', 'HW_CPU_AARCH64_ASIMDRDM', 'HW_CPU_X86_3DNOW', 'HW_GPU_API_OPENCL_V2_2', 'HW_GPU_RESOLUTION_W1920H1080', 'HW_NIC_ACCEL_TLS', 'COMPUTE_SHARE_LOCAL_FS', 'HW_GPU_CUDA_COMPUTE_CAPABILITY_V3_5', 'COMPUTE_MEM_BACKING_FILE', 'HW_ARCH_UNICORE32', 'HW_NIC_DCB_PFC', 'HW_ARCH_X86_64', 'HW_NIC_OFFLOAD_TXVLAN', 'COMPUTE_EPHEMERAL_ENCRYPTION_LUKSV2', 'COMPUTE_STORAGE_BUS_SATA', 'HW_GPU_CUDA_COMPUTE_CAPABILITY_V7_0', 'COMPUTE_SAME_HOST_COLD_MIGRATE', 'HW_NIC_SRIOV_MULTIQUEUE', 'HW_ARCH_PARISC', 'HW_CPU_X86_TBM', 'COMPUTE_STATUS_DISABLED', 'COMPUTE_STORAGE_BUS_FDC'} {{(pid=78202) _trait_sync /opt/stack/placement/placement/objects/trait.py:296}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78202]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "trait_sync" {{(pid=78202) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78202]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "resource_classes_sync" {{(pid=78202) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78202]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "resource_classes_sync" {{(pid=78202) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78202]: DEBUG placement.objects.resource_class [-] Found existing resource classes in db: [] {{(pid=78202) _resource_classes_sync /opt/stack/placement/placement/objects/resource_class.py:233}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78201]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "trait_sync" {{(pid=78201) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78201]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "resource_classes_sync" {{(pid=78201) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78201]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "resource_classes_sync" {{(pid=78201) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78202]: DEBUG placement.objects.resource_class [-] Synced resource_classes from os_resource_classes: [{'name': 'VCPU', 'id': 0}, {'name': 'MEMORY_MB', 'id': 1}, {'name': 'DISK_GB', 'id': 2}, {'name': 'PCI_DEVICE', 'id': 3}, {'name': 'SRIOV_NET_VF', 'id': 4}, {'name': 'NUMA_SOCKET', 'id': 5}, {'name': 'NUMA_CORE', 'id': 6}, {'name': 'NUMA_THREAD', 'id': 7}, {'name': 'NUMA_MEMORY_MB', 'id': 8}, {'name': 'IPV4_ADDRESS', 'id': 9}, {'name': 'VGPU', 'id': 10}, {'name': 'VGPU_DISPLAY_HEAD', 'id': 11}, {'name': 'NET_BW_EGR_KILOBIT_PER_SEC', 'id': 12}, {'name': 'NET_BW_IGR_KILOBIT_PER_SEC', 'id': 13}, {'name': 'PCPU', 'id': 14}, {'name': 'MEM_ENCRYPTION_CONTEXT', 'id': 15}, {'name': 'FPGA', 'id': 16}, {'name': 'PGPU', 'id': 17}, {'name': 'NET_PACKET_RATE_KILOPACKET_PER_SEC', 'id': 18}, {'name': 'NET_PACKET_RATE_EGR_KILOPACKET_PER_SEC', 'id': 19}, {'name': 'NET_PACKET_RATE_IGR_KILOPACKET_PER_SEC', 'id': 20}] {{(pid=78202) _resource_classes_sync /opt/stack/placement/placement/objects/resource_class.py:252}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78201]: DEBUG placement.objects.resource_class [-] Found existing resource classes in db: [] {{(pid=78201) _resource_classes_sync /opt/stack/placement/placement/objects/resource_class.py:233}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78202]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "resource_classes_sync" {{(pid=78202) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78202]: WSGI app 0 (mountpoint='') ready in 2 seconds on interpreter 0x55f1653d2b70 pid: 78202 (default app) May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78201]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "resource_classes_sync" {{(pid=78201) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78201]: WSGI app 0 (mountpoint='') ready in 2 seconds on interpreter 0x55f1653d2b70 pid: 78201 (default app) May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78202]: DEBUG placement.requestlog [None req-0d919693-688e-4eb0-9384-284cbab139b2 None None] Starting request: 10.27.203.238 "GET /placement/" {{(pid=78202) __call__ /opt/stack/placement/placement/requestlog.py:55}} May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78202]: INFO placement.requestlog [None req-0d919693-688e-4eb0-9384-284cbab139b2 None None] 10.27.203.238 "GET /placement/" status: 200 len: 136 microversion: 1.0 May 28 12:43:34 l75lg1-v1 devstack@placement-api.service[78202]: [pid: 78202|app: 0|req: 1/1] 10.27.203.238 () {54 vars in 864 bytes} [Tue May 28 12:43:34 2024] GET /placement => generated 136 bytes in 10 msecs (HTTP/1.1 200) 6 headers in 224 bytes (1 switches on core 0) May 28 12:43:35 l75lg1-v1 dstat.sh[49771]: 28-05 12:43:35| 9 6 84 1 0|2503M 6998M 267M 5929M| 23k 28k| 0 1176k| 0 89.0 |4634 5972 |1.48 1.85 1.26|1.0 0 340| 0 0 | 0 2048M| 23 90 0 22 0 May 28 12:43:36 l75lg1-v1 dstat.sh[49771]: 28-05 12:43:36| 8 3 89 0 0|2541M 6961M 267M 5929M| 24k 15k| 0 68k| 0 13.0 |2832 2947 |1.48 1.85 1.26|1.0 0 178| 0 0 | 0 2048M| 23 90 0 22 0 May 28 12:43:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8943b69f-319c-482d-bd13-540b5dfbb556 None None] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:43:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8943b69f-319c-482d-bd13-540b5dfbb556 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:43:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8943b69f-319c-482d-bd13-540b5dfbb556 None None] PATH_INFO: `/` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:43:36 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 441/866] 10.27.203.238 () {58 vars in 1014 bytes} [Tue May 28 12:43:36 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:43:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cd5fa5-70ff-44c8-ae3d-88749d4ac3af None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:43:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cd5fa5-70ff-44c8-ae3d-88749d4ac3af None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:43:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cd5fa5-70ff-44c8-ae3d-88749d4ac3af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:43:36 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-b2cd5fa5-70ff-44c8-ae3d-88749d4ac3af None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:43:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-b2cd5fa5-70ff-44c8-ae3d-88749d4ac3af None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:43:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-b2cd5fa5-70ff-44c8-ae3d-88749d4ac3af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:43:36 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 426/867] 10.27.203.238 () {62 vars in 1111 bytes} [Tue May 28 12:43:36 2024] POST /identity/v3/auth/tokens => generated 3991 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:43:36 l75lg1-v1 neutron-server[77619]: DEBUG neutron.wsgi [-] (77619) accepted ('10.27.203.238', 40630) {{(pid=77619) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 12:43:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3779183-990f-4166-a7bd-89c4ded975c7 None None] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:43:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3779183-990f-4166-a7bd-89c4ded975c7 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:43:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3779183-990f-4166-a7bd-89c4ded975c7 None None] PATH_INFO: `/` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:43:37 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 442/868] 10.27.203.238 () {58 vars in 1054 bytes} [Tue May 28 12:43:37 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:43:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc177f7e-0fce-4702-b415-e1b3e00988ee None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:43:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc177f7e-0fce-4702-b415-e1b3e00988ee None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:43:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc177f7e-0fce-4702-b415-e1b3e00988ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:43:37 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-fc177f7e-0fce-4702-b415-e1b3e00988ee None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:43:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-fc177f7e-0fce-4702-b415-e1b3e00988ee None None] MFA Rules not processed for user `8ef17047035e4b518fd5360a01f2da1a`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:43:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-fc177f7e-0fce-4702-b415-e1b3e00988ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:43:37 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 427/869] 10.27.203.238 () {62 vars in 1151 bytes} [Tue May 28 12:43:37 2024] POST /identity/v3/auth/tokens => generated 3810 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:43:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3779183-990f-4166-a7bd-89c4ded975c7 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:43:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3779183-990f-4166-a7bd-89c4ded975c7 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:43:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96786be-f077-4c85-a763-e7f528c5b8af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef17047035e4b518fd5360a01f2da1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:43:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96786be-f077-4c85-a763-e7f528c5b8af service neutron] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:43:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96786be-f077-4c85-a763-e7f528c5b8af service neutron] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:43:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96786be-f077-4c85-a763-e7f528c5b8af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:43:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96786be-f077-4c85-a763-e7f528c5b8af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:43:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96786be-f077-4c85-a763-e7f528c5b8af service neutron] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:43:37 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 443/870] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 12:43:37 2024] GET /identity/v3/auth/tokens => generated 3991 bytes in 23 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 28 12:43:37 l75lg1-v1 dstat.sh[49771]: 28-05 12:43:37| 9 1 89 0 0|2573M 6928M 267M 5930M| 16k 0 | 0 84k| 0 8.00 |1699 2353 |1.44 1.84 1.26|1.0 0 0| 0 0 | 0 2048M| 23 94 0 22 0 May 28 12:43:37 l75lg1-v1 neutron-server[77619]: DEBUG neutron.wsgi [None req-4e825233-28b5-4141-9694-e06b05972d44 admin admin] http://10.27.203.238:9696/networking/v2.0/extensions returned with HTTP 200 {{(pid=77619) __call__ /opt/stack/neutron/neutron/wsgi.py:730}} May 28 12:43:37 l75lg1-v1 neutron-server[77619]: INFO neutron.wsgi [None req-4e825233-28b5-4141-9694-e06b05972d44 admin admin] 10.27.203.238 "GET /networking/v2.0/extensions HTTP/1.1" status: 200 len: 13594 time: 0.2558153 May 28 12:43:38 l75lg1-v1 dstat.sh[49771]: 28-05 12:43:38| 9 1 89 0 0|2549M 6952M 267M 5930M| 15k 4992B| 0 264k| 0 32.0 |1625 1902 |1.44 1.84 1.26|1.0 0 33| 0 0 | 0 2048M| 23 92 0 23 0 May 28 12:43:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58561493-280d-446a-bab5-d018364215d0 None None] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:43:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58561493-280d-446a-bab5-d018364215d0 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:43:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58561493-280d-446a-bab5-d018364215d0 None None] PATH_INFO: `/` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:43:38 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 428/871] 10.27.203.238 () {58 vars in 1014 bytes} [Tue May 28 12:43:38 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:43:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee2323e-2a54-4d32-826d-3a5d4723914e None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:43:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee2323e-2a54-4d32-826d-3a5d4723914e None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:43:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee2323e-2a54-4d32-826d-3a5d4723914e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:43:38 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-eee2323e-2a54-4d32-826d-3a5d4723914e None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:43:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-eee2323e-2a54-4d32-826d-3a5d4723914e None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:43:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-eee2323e-2a54-4d32-826d-3a5d4723914e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:43:38 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 444/872] 10.27.203.238 () {62 vars in 1111 bytes} [Tue May 28 12:43:38 2024] POST /identity/v3/auth/tokens => generated 3991 bytes in 23 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:43:38 l75lg1-v1 neutron-server[77619]: DEBUG neutron.wsgi [-] (77619) accepted ('10.27.203.238', 40636) {{(pid=77619) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 12:43:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58561493-280d-446a-bab5-d018364215d0 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:43:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58561493-280d-446a-bab5-d018364215d0 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:43:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0ee89b-6012-49fa-8ce8-443ce65a156b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef17047035e4b518fd5360a01f2da1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:43:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0ee89b-6012-49fa-8ce8-443ce65a156b service neutron] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:43:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0ee89b-6012-49fa-8ce8-443ce65a156b service neutron] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:43:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0ee89b-6012-49fa-8ce8-443ce65a156b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:43:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0ee89b-6012-49fa-8ce8-443ce65a156b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:43:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0ee89b-6012-49fa-8ce8-443ce65a156b service neutron] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:43:38 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 429/873] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 12:43:38 2024] GET /identity/v3/auth/tokens => generated 3991 bytes in 23 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 12:43:38 l75lg1-v1 neutron-server[77619]: DEBUG neutron.api.v2.base [None req-4b13b0bf-adfa-4e54-852d-c99f070f2e69 admin admin] Request body: {'subnetpool': {'shared': True, 'prefixes': ['10.0.0.0/22'], 'is_default': True, 'default_prefixlen': 26, 'name': 'shared-default-subnetpool-v4'}} {{(pid=77619) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:734}} May 28 12:43:39 l75lg1-v1 neutron-server[77619]: DEBUG neutron.policy [None req-4b13b0bf-adfa-4e54-852d-c99f070f2e69 admin admin] Loaded default policies from ['neutron'] under neutron.policies entry points {{(pid=77619) register_rules /opt/stack/neutron/neutron/policy.py:76}} May 28 12:43:39 l75lg1-v1 neutron-server[77619]: WARNING oslo_policy.policy [None req-4b13b0bf-adfa-4e54-852d-c99f070f2e69 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. May 28 12:43:39 l75lg1-v1 neutron-server[77619]: WARNING oslo_policy.policy [None req-4b13b0bf-adfa-4e54-852d-c99f070f2e69 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. May 28 12:43:39 l75lg1-v1 neutron-server[77619]: DEBUG neutron_lib.callbacks.manager [None req-4b13b0bf-adfa-4e54-852d-c99f070f2e69 admin admin] Publish callbacks ['neutron.objects.securitygroup.RbacNeutronDbObjectMixin.validate_rbac_policy_change-2938862770854', 'neutron.objects.address_group.RbacNeutronDbObjectMixin.validate_rbac_policy_change-2938862773430', 'neutron.objects.network.RbacNeutronDbObjectMixin.validate_rbac_policy_change-2938862377441', 'neutron.objects.qos.policy.RbacNeutronDbObjectMixin.validate_rbac_policy_change-2938862406751', 'neutron.objects.subnetpool.RbacNeutronDbObjectMixin.validate_rbac_policy_change-2938862410936', 'neutron.objects.address_scope.RbacNeutronDbObjectMixin.validate_rbac_policy_change-2938862409382', 'neutron.plugins.ml2.plugin.External_net_db_mixin._process_ext_policy_create-1036147', 'neutron.plugins.ml2.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-1010197', 'neutron.services.network_ip_availability.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-4096615', 'neutron.services.network_ip_availability.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-3316917'] for rbac-policy (None), before_create {{(pid=77619) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:43:39 l75lg1-v1 neutron-server[77619]: DEBUG neutron_lib.callbacks.manager [None req-4b13b0bf-adfa-4e54-852d-c99f070f2e69 admin admin] Publish callbacks [] for subnetpool (None), before_response {{(pid=77619) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:43:39 l75lg1-v1 neutron-server[77619]: INFO neutron.wsgi [None req-4b13b0bf-adfa-4e54-852d-c99f070f2e69 admin admin] 10.27.203.238 "POST /networking/v2.0/subnetpools HTTP/1.1" status: 201 len: 737 time: 0.2672293 May 28 12:43:39 l75lg1-v1 dstat.sh[49771]: 28-05 12:43:39| 9 1 89 0 0|2584M 6917M 267M 5930M| 12k 0 | 0 528k| 0 63.0 |2295 3309 |1.44 1.84 1.26|3.0 0 0| 0 0 | 0 2048M| 23 92 0 24 0 May 28 12:43:39 l75lg1-v1 neutron-server[77485]: DEBUG dbcounter [-] [77485] Writing DB stats neutron:SELECT=3,neutron:INSERT=657 {{(pid=77485) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:43:40 l75lg1-v1 dstat.sh[49771]: 28-05 12:43:40| 9 1 89 0 0|2566M 6935M 267M 5930M| 12k 1720B| 0 372k| 0 34.0 |1737 2111 |1.44 1.84 1.26|1.0 0 26| 0 0 | 0 2048M| 23 94 0 24 0 May 28 12:43:40 l75lg1-v1 neutron-server[77618]: DEBUG dbcounter [-] [77618] Writing DB stats neutron:SELECT=4,neutron:INSERT=657,neutron:UPDATE=1 {{(pid=77618) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:43:40 l75lg1-v1 neutron-server[77618]: DEBUG dbcounter [-] [77618] Writing DB stats neutron:DELETE=1,neutron:INSERT=1,neutron:SELECT=5,neutron:UPDATE=1 {{(pid=77618) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:43:40 l75lg1-v1 neutron-server[77621]: DEBUG dbcounter [-] [77621] Writing DB stats neutron:SELECT=3 {{(pid=77621) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:43:40 l75lg1-v1 neutron-server[77621]: DEBUG dbcounter [-] [77621] Writing DB stats neutron:SELECT=6,neutron:INSERT=657 {{(pid=77621) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:43:40 l75lg1-v1 neutron-server[77622]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [-] OVN-Northbound DB sync process started @ 2024-05-28 12:43:40.550096 {{(pid=77622) do_sync /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:102}} May 28 12:43:40 l75lg1-v1 neutron-server[77622]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-6a8834e1-be17-4923-b513-86064402000d None None] OVN-NB Sync port groups started @ 2024-05-28 12:43:40.551053 {{(pid=77622) sync_port_groups /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:176}} May 28 12:43:40 l75lg1-v1 neutron-server[77622]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [-] OVN-Southbound DB sync process started @ 2024-05-28 12:43:40.569518 {{(pid=77622) do_sync /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:1302}} May 28 12:43:40 l75lg1-v1 neutron-server[77622]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-89f001c7-2cbb-48c1-8b0b-ea827fbc7776 None None] OVN-SB Sync hostname and physical networks started @ 2024-05-28 12:43:40.570318 {{(pid=77622) sync_hostname_and_physical_networks /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:1317}} May 28 12:43:40 l75lg1-v1 neutron-server[77622]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-6a8834e1-be17-4923-b513-86064402000d None None] OVN-NB Sync port groups completed @ 2024-05-28 12:43:40.572505 {{(pid=77622) sync_port_groups /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:234}} May 28 12:43:40 l75lg1-v1 neutron-server[77622]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-6a8834e1-be17-4923-b513-86064402000d None None] OVN-NB Sync networks, ports and DHCP options started @ 2024-05-28 12:43:40.572766 {{(pid=77622) sync_networks_ports_and_dhcp_opts /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:1042}} May 28 12:43:40 l75lg1-v1 neutron-server[77622]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-6a8834e1-be17-4923-b513-86064402000d None None] OVN-NB Sync metadata ports started {{(pid=77622) _sync_metadata_ports /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:987}} May 28 12:43:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c268642-20e5-4117-b356-7f27c05bc819 None None] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:43:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c268642-20e5-4117-b356-7f27c05bc819 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:43:40 l75lg1-v1 neutron-server[77622]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-6a8834e1-be17-4923-b513-86064402000d None None] OVN-NB Sync metadata ports completed {{(pid=77622) _sync_metadata_ports /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:1039}} May 28 12:43:40 l75lg1-v1 neutron-server[77622]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-6a8834e1-be17-4923-b513-86064402000d None None] OVN-NB Sync DHCP options for Neutron subnets started {{(pid=77622) _sync_subnet_dhcp_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:839}} May 28 12:43:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c268642-20e5-4117-b356-7f27c05bc819 None None] PATH_INFO: `/` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:43:40 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 445/874] 10.27.203.238 () {58 vars in 1014 bytes} [Tue May 28 12:43:40 2024] GET /identity => generated 272 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:43:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ae13c3-d0f2-4954-be5d-3ce0d1ee7d4e None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:43:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ae13c3-d0f2-4954-be5d-3ce0d1ee7d4e None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:43:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ae13c3-d0f2-4954-be5d-3ce0d1ee7d4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:43:40 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-c9ae13c3-d0f2-4954-be5d-3ce0d1ee7d4e None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:43:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-c9ae13c3-d0f2-4954-be5d-3ce0d1ee7d4e None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:43:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-c9ae13c3-d0f2-4954-be5d-3ce0d1ee7d4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:43:40 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 430/875] 10.27.203.238 () {62 vars in 1111 bytes} [Tue May 28 12:43:40 2024] POST /identity/v3/auth/tokens => generated 3991 bytes in 23 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:43:40 l75lg1-v1 neutron-server[77622]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-6a8834e1-be17-4923-b513-86064402000d None None] OVN-NB Sync DHCP options for Neutron subnets completed @ 2024-05-28 12:43:40.655215 {{(pid=77622) _sync_subnet_dhcp_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:912}} May 28 12:43:40 l75lg1-v1 neutron-server[77622]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] There are no commands to commit {{(pid=77622) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:78}} May 28 12:43:40 l75lg1-v1 neutron-server[77622]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-6a8834e1-be17-4923-b513-86064402000d None None] OVN-NB Sync DHCP options for Neutron ports with extra dhcp options assigned started {{(pid=77622) _sync_port_dhcp_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:917}} May 28 12:43:40 l75lg1-v1 neutron-server[77622]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-6a8834e1-be17-4923-b513-86064402000d None None] OVN-NB Sync DHCP options for Neutron ports with extra dhcp options assigned completed {{(pid=77622) _sync_port_dhcp_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:976}} May 28 12:43:40 l75lg1-v1 neutron-server[77622]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-6a8834e1-be17-4923-b513-86064402000d None None] OVN-NB Sync networks, ports and DHCP options completed @ 2024-05-28 12:43:40.656693 {{(pid=77622) sync_networks_ports_and_dhcp_opts /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:1211}} May 28 12:43:40 l75lg1-v1 neutron-server[77622]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-6a8834e1-be17-4923-b513-86064402000d None None] OVN-NB Sync ACLs started @ 2024-05-28 12:43:40.656862 {{(pid=77622) sync_acls /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:257}} May 28 12:43:40 l75lg1-v1 neutron-server[77622]: WARNING neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-89f001c7-2cbb-48c1-8b0b-ea827fbc7776 None None] New host l75lg1-v1 found in OVN SB DB, but not in Neutron. Add its SegmentHostMapping in Neutron May 28 12:43:40 l75lg1-v1 neutron-server[77622]: DEBUG oslo_concurrency.lockutils [None req-89f001c7-2cbb-48c1-8b0b-ea827fbc7776 None None] Acquiring lock "update_segment_host_mapping" by "neutron.services.segments.db.update_segment_host_mapping" {{(pid=77622) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:43:40 l75lg1-v1 neutron-server[77622]: DEBUG oslo_concurrency.lockutils [None req-89f001c7-2cbb-48c1-8b0b-ea827fbc7776 None None] Lock "update_segment_host_mapping" acquired by "neutron.services.segments.db.update_segment_host_mapping" :: waited 0.001s {{(pid=77622) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:43:40 l75lg1-v1 neutron-server[77622]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-6a8834e1-be17-4923-b513-86064402000d None None] OVN-NB Sync ACLs completed @ 2024-05-28 12:43:40.671494 {{(pid=77622) sync_acls /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:353}} May 28 12:43:40 l75lg1-v1 neutron-server[77622]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-6a8834e1-be17-4923-b513-86064402000d None None] OVN-NB Sync routers and router ports started @ 2024-05-28 12:43:40.671756 {{(pid=77622) sync_routers_and_rports /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:516}} May 28 12:43:40 l75lg1-v1 neutron-server[77622]: DEBUG neutron.services.segments.db [None req-89f001c7-2cbb-48c1-8b0b-ea827fbc7776 None None] Segments set() mapped to the host l75lg1-v1 {{(pid=77622) update_segment_host_mapping /opt/stack/neutron/neutron/services/segments/db.py:238}} May 28 12:43:40 l75lg1-v1 neutron-server[77622]: DEBUG oslo_concurrency.lockutils [None req-89f001c7-2cbb-48c1-8b0b-ea827fbc7776 None None] Lock "update_segment_host_mapping" "released" by "neutron.services.segments.db.update_segment_host_mapping" :: held 0.005s {{(pid=77622) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:43:40 l75lg1-v1 neutron-server[77622]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-89f001c7-2cbb-48c1-8b0b-ea827fbc7776 None None] OVN-SB Sync hostname and physical networks completed @ 2024-05-28 12:43:40.674403 {{(pid=77622) sync_hostname_and_physical_networks /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:1345}} May 28 12:43:40 l75lg1-v1 neutron-server[77622]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] There are no commands to commit {{(pid=77622) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:78}} May 28 12:43:40 l75lg1-v1 neutron-server[77622]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-6a8834e1-be17-4923-b513-86064402000d None None] OVN-NB Sync routers and router ports completed @ 2024-05-28 12:43:40.773348 {{(pid=77622) sync_routers_and_rports /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:834}} May 28 12:43:40 l75lg1-v1 neutron-server[77622]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-6a8834e1-be17-4923-b513-86064402000d None None] OVN-NB Sync port QoS policies started @ 2024-05-28 12:43:40.773610 {{(pid=77622) sync_port_qos_policies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:1258}} May 28 12:43:40 l75lg1-v1 neutron-server[77622]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.extensions.qos [None req-6a8834e1-be17-4923-b513-86064402000d None None] Starting OVNClientQosExtension May 28 12:43:40 l75lg1-v1 neutron-server[77622]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-89f001c7-2cbb-48c1-8b0b-ea827fbc7776 None None] OVN-Southbound DB sync process completed @ 2024-05-28 12:43:40.774806 {{(pid=77622) do_sync /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:1313}} May 28 12:43:40 l75lg1-v1 neutron-server[77622]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] There are no commands to commit {{(pid=77622) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:78}} May 28 12:43:40 l75lg1-v1 neutron-server[77622]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-6a8834e1-be17-4923-b513-86064402000d None None] OVN-NB Sync port QoS policies completed @ 2024-05-28 12:43:40.788247 {{(pid=77622) sync_port_qos_policies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:1268}} May 28 12:43:40 l75lg1-v1 neutron-server[77622]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-6a8834e1-be17-4923-b513-86064402000d None None] OVN-NB Sync Floating IP QoS policies started @ 2024-05-28 12:43:40.788536 {{(pid=77622) sync_fip_qos_policies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:1273}} May 28 12:43:40 l75lg1-v1 neutron-server[77622]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.extensions.qos [None req-6a8834e1-be17-4923-b513-86064402000d None None] Starting OVNClientQosExtension May 28 12:43:40 l75lg1-v1 neutron-server[77622]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] There are no commands to commit {{(pid=77622) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:78}} May 28 12:43:40 l75lg1-v1 neutron-server[77622]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-6a8834e1-be17-4923-b513-86064402000d None None] OVN-NB Sync Floating IP QoS policies completed @ 2024-05-28 12:43:40.860703 {{(pid=77622) sync_fip_qos_policies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:1283}} May 28 12:43:40 l75lg1-v1 neutron-server[77622]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-6a8834e1-be17-4923-b513-86064402000d None None] OVN-Northbound DB sync process completed @ 2024-05-28 12:43:40.861236 {{(pid=77622) do_sync /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:114}} May 28 12:43:40 l75lg1-v1 neutron-server[77619]: DEBUG neutron.wsgi [-] (77619) accepted ('10.27.203.238', 42976) {{(pid=77619) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 12:43:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c268642-20e5-4117-b356-7f27c05bc819 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:43:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c268642-20e5-4117-b356-7f27c05bc819 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:43:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f80ca8-1050-4ff9-ab36-19dfc25ff018 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef17047035e4b518fd5360a01f2da1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:43:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f80ca8-1050-4ff9-ab36-19dfc25ff018 service neutron] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:43:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f80ca8-1050-4ff9-ab36-19dfc25ff018 service neutron] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:43:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f80ca8-1050-4ff9-ab36-19dfc25ff018 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:43:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f80ca8-1050-4ff9-ab36-19dfc25ff018 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:43:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f80ca8-1050-4ff9-ab36-19dfc25ff018 service neutron] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:43:40 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 446/876] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 12:43:40 2024] GET /identity/v3/auth/tokens => generated 3991 bytes in 21 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 12:43:40 l75lg1-v1 neutron-server[77619]: DEBUG neutron.api.v2.base [None req-ef731604-9a6d-424f-a18d-5aa4e307de32 admin admin] Request body: {'subnetpool': {'prefixes': ['fd12:3562:78f7::/56'], 'default_prefixlen': 64, 'shared': True, 'name': 'shared-default-subnetpool-v6', 'is_default': True}} {{(pid=77619) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:734}} May 28 12:43:40 l75lg1-v1 neutron-server[77619]: DEBUG neutron_lib.callbacks.manager [None req-ef731604-9a6d-424f-a18d-5aa4e307de32 admin admin] Publish callbacks ['neutron.objects.securitygroup.RbacNeutronDbObjectMixin.validate_rbac_policy_change-2938862770854', 'neutron.objects.address_group.RbacNeutronDbObjectMixin.validate_rbac_policy_change-2938862773430', 'neutron.objects.network.RbacNeutronDbObjectMixin.validate_rbac_policy_change-2938862377441', 'neutron.objects.qos.policy.RbacNeutronDbObjectMixin.validate_rbac_policy_change-2938862406751', 'neutron.objects.subnetpool.RbacNeutronDbObjectMixin.validate_rbac_policy_change-2938862410936', 'neutron.objects.address_scope.RbacNeutronDbObjectMixin.validate_rbac_policy_change-2938862409382', 'neutron.plugins.ml2.plugin.External_net_db_mixin._process_ext_policy_create-1036147', 'neutron.plugins.ml2.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-1010197', 'neutron.services.network_ip_availability.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-4096615', 'neutron.services.network_ip_availability.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-3316917'] for rbac-policy (None), before_create {{(pid=77619) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:43:40 l75lg1-v1 neutron-server[77619]: DEBUG neutron_lib.callbacks.manager [None req-ef731604-9a6d-424f-a18d-5aa4e307de32 admin admin] Publish callbacks [] for subnetpool (None), before_response {{(pid=77619) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:43:40 l75lg1-v1 neutron-server[77619]: INFO neutron.wsgi [None req-ef731604-9a6d-424f-a18d-5aa4e307de32 admin admin] 10.27.203.238 "POST /networking/v2.0/subnetpools HTTP/1.1" status: 201 len: 747 time: 0.0967603 May 28 12:43:41 l75lg1-v1 dstat.sh[49771]: 28-05 12:43:41| 13 1 85 1 0|2539M 6962M 267M 5930M| 16k 2100B| 0 1844k| 0 127 |2947 4091 |1.44 1.84 1.26|1.0 0 33| 0 0 | 0 2048M| 23 102 0 25 0 May 28 12:43:42 l75lg1-v1 dstat.sh[49771]: 28-05 12:43:42| 9 1 89 0 0|2588M 6914M 267M 5930M| 13k 0 | 0 412k| 0 31.0 |1259 1453 |1.41 1.82 1.26|1.0 0 0| 0 0 | 0 2048M| 23 102 0 25 0 May 28 12:43:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36117243-33c1-430e-8d93-7725122b1885 None None] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:43:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36117243-33c1-430e-8d93-7725122b1885 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:43:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36117243-33c1-430e-8d93-7725122b1885 None None] PATH_INFO: `/` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:43:42 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 431/877] 10.27.203.238 () {58 vars in 1014 bytes} [Tue May 28 12:43:42 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:43:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394d56b2-fdac-4016-8b8d-b5a33f17af7d None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:43:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394d56b2-fdac-4016-8b8d-b5a33f17af7d None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:43:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394d56b2-fdac-4016-8b8d-b5a33f17af7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:43:42 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-394d56b2-fdac-4016-8b8d-b5a33f17af7d None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:43:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-394d56b2-fdac-4016-8b8d-b5a33f17af7d None None] MFA Rules not processed for user `2a1747ad86b04cc4aa7bc0b3e4077eaf`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:43:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-394d56b2-fdac-4016-8b8d-b5a33f17af7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:43:42 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 447/878] 10.27.203.238 () {62 vars in 1111 bytes} [Tue May 28 12:43:42 2024] POST /identity/v3/auth/tokens => generated 3932 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:43:42 l75lg1-v1 neutron-server[77618]: DEBUG neutron.wsgi [-] (77618) accepted ('10.27.203.238', 42992) {{(pid=77618) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 12:43:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc28b06-3234-4bf5-b2c5-74fe6b13bee9 None None] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:43:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc28b06-3234-4bf5-b2c5-74fe6b13bee9 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:43:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc28b06-3234-4bf5-b2c5-74fe6b13bee9 None None] PATH_INFO: `/` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:43:42 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 432/879] 10.27.203.238 () {58 vars in 1054 bytes} [Tue May 28 12:43:42 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:43:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b80e1f-7be8-46f7-8104-31d6a89d5cc1 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:43:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b80e1f-7be8-46f7-8104-31d6a89d5cc1 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:43:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b80e1f-7be8-46f7-8104-31d6a89d5cc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:43:42 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-62b80e1f-7be8-46f7-8104-31d6a89d5cc1 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:43:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-62b80e1f-7be8-46f7-8104-31d6a89d5cc1 None None] MFA Rules not processed for user `8ef17047035e4b518fd5360a01f2da1a`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:43:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-62b80e1f-7be8-46f7-8104-31d6a89d5cc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:43:42 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 448/880] 10.27.203.238 () {62 vars in 1151 bytes} [Tue May 28 12:43:42 2024] POST /identity/v3/auth/tokens => generated 3810 bytes in 23 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:43:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc28b06-3234-4bf5-b2c5-74fe6b13bee9 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:43:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc28b06-3234-4bf5-b2c5-74fe6b13bee9 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:43:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf63a20-f22b-46de-98cf-1d651ff7df8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef17047035e4b518fd5360a01f2da1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:43:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf63a20-f22b-46de-98cf-1d651ff7df8f service neutron] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:43:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf63a20-f22b-46de-98cf-1d651ff7df8f service neutron] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:43:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf63a20-f22b-46de-98cf-1d651ff7df8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:43:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf63a20-f22b-46de-98cf-1d651ff7df8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:43:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf63a20-f22b-46de-98cf-1d651ff7df8f service neutron] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:43:42 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 433/881] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 12:43:42 2024] GET /identity/v3/auth/tokens => generated 3932 bytes in 22 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 12:43:42 l75lg1-v1 neutron-server[77618]: DEBUG neutron.api.v2.base [None req-ae1f1c07-06d1-41a4-a529-e4ad2ebf593d demo demo] Request body: {'network': {'name': 'private', 'admin_state_up': True}} {{(pid=77618) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:734}} May 28 12:43:42 l75lg1-v1 neutron-server[77618]: WARNING neutron_lib.context [None req-ae1f1c07-06d1-41a4-a529-e4ad2ebf593d demo demo] Method 'is_advsvc' is deprecated since 2023.2 release (neutron-lib 3.8.0) and will be removed once support for the old RBAC API policies will be removed from Neutron. Please use method 'is_service_role' instead. May 28 12:43:42 l75lg1-v1 neutron-server[77618]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ae1f1c07-06d1-41a4-a529-e4ad2ebf593d demo demo] Made reservation on behalf of 95de88f6d26e4420bc466ba67668171f for: {'network': 1} {{(pid=77618) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 28 12:43:42 l75lg1-v1 neutron-server[77618]: DEBUG neutron.policy [None req-ae1f1c07-06d1-41a4-a529-e4ad2ebf593d demo demo] Loaded default policies from ['neutron'] under neutron.policies entry points {{(pid=77618) register_rules /opt/stack/neutron/neutron/policy.py:76}} May 28 12:43:43 l75lg1-v1 neutron-server[77618]: WARNING oslo_policy.policy [None req-ae1f1c07-06d1-41a4-a529-e4ad2ebf593d demo demo] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. May 28 12:43:43 l75lg1-v1 neutron-server[77618]: WARNING oslo_policy.policy [None req-ae1f1c07-06d1-41a4-a529-e4ad2ebf593d demo demo] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. May 28 12:43:43 l75lg1-v1 neutron-server[77618]: DEBUG neutron_lib.callbacks.manager [None req-ae1f1c07-06d1-41a4-a529-e4ad2ebf593d demo demo] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1015114'] for network (None), before_create {{(pid=77618) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:43:43 l75lg1-v1 neutron-server[77618]: DEBUG neutron_lib.callbacks.manager [None req-ae1f1c07-06d1-41a4-a529-e4ad2ebf593d demo demo] Publish callbacks [] for security_group (None), before_create {{(pid=77618) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:43:43 l75lg1-v1 neutron-server[77618]: DEBUG neutron_lib.callbacks.manager [None req-ae1f1c07-06d1-41a4-a529-e4ad2ebf593d demo demo] Publish callbacks ['neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver.OVNMechanismDriver._create_security_group_precommit-4094378'] for security_group (c94c54fa-fd91-4cb4-929a-21cf397964d0), precommit_create {{(pid=77618) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:43:43 l75lg1-v1 neutron-server[77618]: DEBUG neutron.db.ovn_revision_numbers_db [None req-ae1f1c07-06d1-41a4-a529-e4ad2ebf593d demo demo] create_initial_revision uuid=c94c54fa-fd91-4cb4-929a-21cf397964d0, type=security_groups, rev=-1 {{(pid=77618) create_initial_revision /opt/stack/neutron/neutron/db/ovn_revision_numbers_db.py:108}} May 28 12:43:43 l75lg1-v1 neutron-server[77618]: DEBUG neutron_lib.callbacks.manager [None req-ae1f1c07-06d1-41a4-a529-e4ad2ebf593d demo demo] Publish callbacks ['neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver.OVNMechanismDriver._create_security_group-4094389', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4165855'] for security_group (c94c54fa-fd91-4cb4-929a-21cf397964d0), after_create {{(pid=77618) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:43:43 l75lg1-v1 neutron-server[77618]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.extensions.qos [None req-ae1f1c07-06d1-41a4-a529-e4ad2ebf593d demo demo] Starting OVNClientQosExtension May 28 12:43:43 l75lg1-v1 neutron-server[77618]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.extensions.placement [None req-ae1f1c07-06d1-41a4-a529-e4ad2ebf593d demo demo] Starting OVNClientPlacementExtension May 28 12:43:43 l75lg1-v1 neutron-server[77618]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): PgAddCommand(_result=None, name=pg_c94c54fa_fd91_4cb4_929a_21cf397964d0, may_exist=False, columns={'acls': [], 'external_ids': {'neutron:security_group_id': 'c94c54fa-fd91-4cb4-929a-21cf397964d0'}}) {{(pid=77618) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:43:43 l75lg1-v1 neutron-server[77618]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): PgAclAddCommand(_result=None, entity=pg_c94c54fa_fd91_4cb4_929a_21cf397964d0, direction=to-lport, priority=1002, match=outport == @pg_c94c54fa_fd91_4cb4_929a_21cf397964d0 && ip4 && ip4.src == $pg_c94c54fa_fd91_4cb4_929a_21cf397964d0_ip4, action=allow-related, log=False, may_exist=True, severity=[], name=[], meter=None, external_ids={'neutron:security_group_rule_id': '1aebf55d-9aec-4bd6-ad94-f107c4f30dab'}) {{(pid=77618) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:43:43 l75lg1-v1 neutron-server[77618]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): PgAclAddCommand(_result=None, entity=pg_c94c54fa_fd91_4cb4_929a_21cf397964d0, direction=from-lport, priority=1002, match=inport == @pg_c94c54fa_fd91_4cb4_929a_21cf397964d0 && ip4, action=allow-related, log=False, may_exist=True, severity=[], name=[], meter=None, external_ids={'neutron:security_group_rule_id': '3c7d2b59-3f86-4bfe-ad7a-c4634c561bc2'}) {{(pid=77618) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:43:43 l75lg1-v1 neutron-server[77618]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=3): PgAclAddCommand(_result=None, entity=pg_c94c54fa_fd91_4cb4_929a_21cf397964d0, direction=to-lport, priority=1002, match=outport == @pg_c94c54fa_fd91_4cb4_929a_21cf397964d0 && ip6 && ip6.src == $pg_c94c54fa_fd91_4cb4_929a_21cf397964d0_ip6, action=allow-related, log=False, may_exist=True, severity=[], name=[], meter=None, external_ids={'neutron:security_group_rule_id': '4575416b-37d8-47d5-a35d-0c37db305435'}) {{(pid=77618) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:43:43 l75lg1-v1 neutron-server[77618]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=4): PgAclAddCommand(_result=None, entity=pg_c94c54fa_fd91_4cb4_929a_21cf397964d0, direction=from-lport, priority=1002, match=inport == @pg_c94c54fa_fd91_4cb4_929a_21cf397964d0 && ip6, action=allow-related, log=False, may_exist=True, severity=[], name=[], meter=None, external_ids={'neutron:security_group_rule_id': '5e2cc248-d2fc-428c-bef5-913a9a0f52bf'}) {{(pid=77618) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:43:43 l75lg1-v1 neutron-server[77618]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [-] Hash Ring: Node 4c6fc793-7f5a-456f-b4d6-6e5bd97592f2 (host: l75lg1-v1) handling event "create" for row 1c2eaf99-5cd9-45f0-be59-430edbbbd84e (table: ACL) {{(pid=77618) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:43:43 l75lg1-v1 neutron-server[77618]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [-] Hash Ring: Node 4c6fc793-7f5a-456f-b4d6-6e5bd97592f2 (host: l75lg1-v1) handling event "create" for row 6d7d67b0-2661-4095-9e1e-979216dc637b (table: ACL) {{(pid=77618) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:43:43 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [-] Hash Ring: Node c89b3497-133e-4a5a-b67a-3310d2cb2485 (host: l75lg1-v1) handling event "create" for row 4131b005-514e-41ce-bc08-0bfdbf7bc9c9 (table: ACL) {{(pid=77619) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:43:43 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [-] Hash Ring: Node c89b3497-133e-4a5a-b67a-3310d2cb2485 (host: l75lg1-v1) handling event "create" for row c0415aa8-070f-4682-93bf-74b05ca5a2a7 (table: ACL) {{(pid=77619) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:43:43 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [-] Hash Ring: Node c89b3497-133e-4a5a-b67a-3310d2cb2485 (host: l75lg1-v1) handling event "create" for row 8906ba49-0c33-47cd-9d46-a22edaf935b6 (table: Port_Group) {{(pid=77619) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:43:43 l75lg1-v1 dstat.sh[49771]: 28-05 12:43:43| 10 1 88 1 0|2615M 6886M 267M 5930M| 11k 172B| 0 700k| 0 89.0 |2460 3532 |1.41 1.82 1.26|1.0 0 0| 0 0 | 0 2048M| 23 106 0 25 0 May 28 12:43:43 l75lg1-v1 neutron-server[77618]: INFO neutron.db.ovn_revision_numbers_db [None req-ae1f1c07-06d1-41a4-a529-e4ad2ebf593d demo demo] Successfully bumped revision number for resource c94c54fa-fd91-4cb4-929a-21cf397964d0 (type: security_groups) to 1 May 28 12:43:43 l75lg1-v1 neutron-server[77618]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-ae1f1c07-06d1-41a4-a529-e4ad2ebf593d demo demo] geneve segment allocate from pool success with {'geneve_vni': 30276} {{(pid=77618) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 28 12:43:43 l75lg1-v1 neutron-server[77618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae1f1c07-06d1-41a4-a529-e4ad2ebf593d demo demo] Pushing event updated for resources: {'SecurityGroup': ['ID=c94c54fa-fd91-4cb4-929a-21cf397964d0,revision_number=1']} {{(pid=77618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 28 12:43:43 l75lg1-v1 neutron-server[77618]: DEBUG neutron_lib.callbacks.manager [None req-ae1f1c07-06d1-41a4-a529-e4ad2ebf593d demo demo] Publish callbacks ['neutron.services.segments.db._add_segment_host_mapping_for_segment-8754903005233', 'neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-910805'] for segment (bb1bf6f8-e34d-458b-82c6-3d470163b0d7), precommit_create {{(pid=77618) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:43:43 l75lg1-v1 neutron-server[77618]: INFO neutron.db.segments_db [None req-ae1f1c07-06d1-41a4-a529-e4ad2ebf593d demo demo] Added segment bb1bf6f8-e34d-458b-82c6-3d470163b0d7 of type geneve for network fb218033-3d98-4065-b336-c595d5e6ca77 May 28 12:43:43 l75lg1-v1 neutron-server[77618]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckLivenessCommand(_result=None) {{(pid=77618) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:43:43 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [-] Hash Ring: Node c89b3497-133e-4a5a-b67a-3310d2cb2485 (host: l75lg1-v1) handling event "update" for row 459958f3-26c0-486c-a7b4-0e57d78742d2 (table: NB_Global) {{(pid=77619) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:43:43 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched UPDATE: SbGlobalUpdateEvent(events=('update',), table='SB_Global', conditions=None, old_conditions=None), priority=20 to row=SB_Global(ipsec=False, ssl=[], nb_cfg=1, external_ids={}, options={'lb_hairpin_use_ct_mark': 'true', 'mac_prefix': '6e:b3:c1', 'max_tunid': '16711680', 'northd_internal_version': '22.03.3-20.21.0-62.4', 'svc_monitor_mac': '6e:c0:93:26:20:eb', 'fdb_removal_limit': '0', 'ignore_lsp_down': 'false', 'mac_binding_removal_limit': '0'}) old=SB_Global(nb_cfg=0) {{(pid=76818) matches /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} May 28 12:43:43 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [-] Hash Ring: Node c89b3497-133e-4a5a-b67a-3310d2cb2485 (host: l75lg1-v1) handling event "update" for row 459958f3-26c0-486c-a7b4-0e57d78742d2 (table: NB_Global) {{(pid=77619) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:43:43 l75lg1-v1 neutron-server[77621]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [-] ChassisAgentWriteEvent : Matched Chassis_Private, update, None None {{(pid=77621) matches /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:65}} May 28 12:43:43 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [-] ChassisAgentWriteEvent : Matched Chassis_Private, update, None None {{(pid=77619) matches /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:65}} May 28 12:43:43 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [-] Hash Ring: Node c89b3497-133e-4a5a-b67a-3310d2cb2485 (host: l75lg1-v1) handling event "update" for row 6ef07056-3e6a-44fb-b483-fdb6022e4e42 (table: Chassis_Private) {{(pid=77619) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:43:43 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata.agent [-] Delaying updating chassis table for 2 seconds {{(pid=76818) run /opt/stack/neutron/neutron/agent/ovn/metadata/agent.py:364}} May 28 12:43:43 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [-] Hash Ring: Node c89b3497-133e-4a5a-b67a-3310d2cb2485 (host: l75lg1-v1) handling event "update" for row 459958f3-26c0-486c-a7b4-0e57d78742d2 (table: NB_Global) {{(pid=77619) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:43:43 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [-] Hash Ring: Node c89b3497-133e-4a5a-b67a-3310d2cb2485 (host: l75lg1-v1) handling event "update" for row 459958f3-26c0-486c-a7b4-0e57d78742d2 (table: NB_Global) {{(pid=77619) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:43:43 l75lg1-v1 neutron-server[77618]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [-] ChassisAgentWriteEvent : Matched Chassis_Private, update, None None {{(pid=77618) matches /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:65}} May 28 12:43:43 l75lg1-v1 neutron-server[77618]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ae1f1c07-06d1-41a4-a529-e4ad2ebf593d demo demo] Tracked resource versions report: May 28 12:43:43 l75lg1-v1 neutron-server[77618]: pushed versions: May 28 12:43:43 l75lg1-v1 neutron-server[77618]: { 'AddressGroup': {'1.2'}, May 28 12:43:43 l75lg1-v1 neutron-server[77618]: 'Agent': {'1.1'}, May 28 12:43:43 l75lg1-v1 neutron-server[77618]: 'ConntrackHelper': {'1.0'}, May 28 12:43:43 l75lg1-v1 neutron-server[77618]: 'LocalIPAssociation': {'1.0'}, May 28 12:43:43 l75lg1-v1 neutron-server[77618]: 'Log': {'1.0'}, May 28 12:43:43 l75lg1-v1 neutron-server[77618]: 'NDPProxy': {'1.0'}, May 28 12:43:43 l75lg1-v1 neutron-server[77618]: 'Network': {'1.1'}, May 28 12:43:43 l75lg1-v1 neutron-server[77618]: 'Port': {'1.9'}, May 28 12:43:43 l75lg1-v1 neutron-server[77618]: 'PortForwarding': {'1.3'}, May 28 12:43:43 l75lg1-v1 neutron-server[77618]: 'QosPolicy': {'1.10'}, May 28 12:43:43 l75lg1-v1 neutron-server[77618]: 'SecurityGroup': {'1.6'}, May 28 12:43:43 l75lg1-v1 neutron-server[77618]: 'SecurityGroupRule': {'1.3'}, May 28 12:43:43 l75lg1-v1 neutron-server[77618]: 'SubPort': {'1.0'}, May 28 12:43:43 l75lg1-v1 neutron-server[77618]: 'Subnet': {'1.1'}, May 28 12:43:43 l75lg1-v1 neutron-server[77618]: 'Trunk': {'1.1'}} May 28 12:43:43 l75lg1-v1 neutron-server[77618]: consumer versions: May 28 12:43:43 l75lg1-v1 neutron-server[77618]: {OVN Controller Gateway agent@l75lg1-v1: {}} May 28 12:43:43 l75lg1-v1 neutron-server[77618]: {{(pid=77618) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:178}} May 28 12:43:43 l75lg1-v1 neutron-server[77618]: DEBUG neutron_lib.callbacks.manager [None req-ae1f1c07-06d1-41a4-a529-e4ad2ebf593d demo demo] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8754901908252'] for network (fb218033-3d98-4065-b336-c595d5e6ca77), precommit_create {{(pid=77618) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:43:43 l75lg1-v1 neutron-server[77618]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver [None req-ae1f1c07-06d1-41a4-a529-e4ad2ebf593d demo demo] Validating network segment with type geneve, segmentation ID 30276, physical network None {{(pid=77618) _validate_network_segments /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/mech_driver.py:520}} May 28 12:43:43 l75lg1-v1 neutron-server[77618]: DEBUG neutron.db.ovn_revision_numbers_db [None req-ae1f1c07-06d1-41a4-a529-e4ad2ebf593d demo demo] create_initial_revision uuid=fb218033-3d98-4065-b336-c595d5e6ca77, type=networks, rev=-1 {{(pid=77618) create_initial_revision /opt/stack/neutron/neutron/db/ovn_revision_numbers_db.py:108}} May 28 12:43:43 l75lg1-v1 neutron-server[77618]: INFO neutron.tests.unit.plugins.ml2.drivers.mechanism_logger [None req-ae1f1c07-06d1-41a4-a529-e4ad2ebf593d demo demo] create_network_precommit called with network settings {'id': 'fb218033-3d98-4065-b336-c595d5e6ca77', 'name': 'private', 'tenant_id': '95de88f6d26e4420bc466ba67668171f', 'admin_state_up': True, 'mtu': 1442, 'status': 'ACTIVE', 'subnets': [], 'standard_attr_id': 12, 'shared': False, 'project_id': '95de88f6d26e4420bc466ba67668171f', 'port_security_enabled': True, 'router:external': False, 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 30276, 'is_default': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'vlan_transparent': None, 'description': '', 'tags': [], 'created_at': '2024-05-28T12:43:43Z', 'updated_at': '2024-05-28T12:43:43Z', 'revision_number': 1} (original settings None) and network segments [{'id': 'bb1bf6f8-e34d-458b-82c6-3d470163b0d7', 'network_type': 'geneve', 'physical_network': None, 'segmentation_id': 30276, 'network_id': 'fb218033-3d98-4065-b336-c595d5e6ca77'}] May 28 12:43:43 l75lg1-v1 neutron-server[77618]: DEBUG neutron.tests.unit.plugins.ml2.drivers.mechanism_logger [None req-ae1f1c07-06d1-41a4-a529-e4ad2ebf593d demo demo] create_network_precommit: May 28 12:43:43 l75lg1-v1 neutron-server[77618]: key[tenant_id], None -> 95de88f6d26e4420bc466ba67668171f May 28 12:43:43 l75lg1-v1 neutron-server[77618]: key[provider:network_type], None -> geneve May 28 12:43:43 l75lg1-v1 neutron-server[77618]: key[project_id], None -> 95de88f6d26e4420bc466ba67668171f May 28 12:43:43 l75lg1-v1 neutron-server[77618]: key[ipv6_address_scope], None -> None May 28 12:43:43 l75lg1-v1 neutron-server[77618]: key[subnets], None -> [] May 28 12:43:43 l75lg1-v1 neutron-server[77618]: key[admin_state_up], None -> True May 28 12:43:43 l75lg1-v1 neutron-server[77618]: key[id], None -> fb218033-3d98-4065-b336-c595d5e6ca77 May 28 12:43:43 l75lg1-v1 neutron-server[77618]: key[ipv4_address_scope], None -> None May 28 12:43:43 l75lg1-v1 neutron-server[77618]: key[tags], None -> [] May 28 12:43:43 l75lg1-v1 neutron-server[77618]: key[created_at], None -> 2024-05-28T12:43:43Z May 28 12:43:43 l75lg1-v1 neutron-server[77618]: key[status], None -> ACTIVE May 28 12:43:43 l75lg1-v1 neutron-server[77618]: key[is_default], None -> False May 28 12:43:43 l75lg1-v1 neutron-server[77618]: key[port_security_enabled], None -> True May 28 12:43:43 l75lg1-v1 neutron-server[77618]: key[vlan_transparent], None -> None May 28 12:43:43 l75lg1-v1 neutron-server[77618]: key[updated_at], None -> 2024-05-28T12:43:43Z May 28 12:43:43 l75lg1-v1 neutron-server[77618]: key[standard_attr_id], None -> 12 May 28 12:43:43 l75lg1-v1 neutron-server[77618]: key[availability_zone_hints], None -> [] May 28 12:43:43 l75lg1-v1 neutron-server[77618]: key[provider:physical_network], None -> None May 28 12:43:43 l75lg1-v1 neutron-server[77618]: key[shared], None -> False May 28 12:43:43 l75lg1-v1 neutron-server[77618]: key[mtu], None -> 1442 May 28 12:43:43 l75lg1-v1 neutron-server[77618]: key[provider:segmentation_id], None -> 30276 May 28 12:43:43 l75lg1-v1 neutron-server[77618]: key[description], None -> May 28 12:43:43 l75lg1-v1 neutron-server[77618]: key[availability_zones], None -> [] May 28 12:43:43 l75lg1-v1 neutron-server[77618]: key[revision_number], None -> 1 May 28 12:43:43 l75lg1-v1 neutron-server[77618]: key[router:external], None -> False May 28 12:43:43 l75lg1-v1 neutron-server[77618]: key[name], None -> private May 28 12:43:43 l75lg1-v1 neutron-server[77618]: {{(pid=77618) _log_diff_call /opt/stack/neutron/neutron/tests/unit/plugins/ml2/drivers/mechanism_logger.py:59}} May 28 12:43:43 l75lg1-v1 neutron-server[77618]: DEBUG neutron_lib.callbacks.manager [None req-ae1f1c07-06d1-41a4-a529-e4ad2ebf593d demo demo] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4165676'] for network (fb218033-3d98-4065-b336-c595d5e6ca77), after_create {{(pid=77618) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:43:43 l75lg1-v1 neutron-server[77618]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): LsAddCommand(_result=None, switch=neutron-fb218033-3d98-4065-b336-c595d5e6ca77, columns={'external_ids': {'neutron:network_name': 'private', 'neutron:mtu': '1442', 'neutron:revision_number': '1', 'neutron:availability_zone_hints': '', 'neutron:provnet-network-type': 'geneve'}, 'other_config': {'mcast_snoop': 'false', 'mcast_flood_unregistered': 'false', 'vlan-passthru': 'false'}}, may_exist=True) {{(pid=77618) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:43:43 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [-] Hash Ring: Node c89b3497-133e-4a5a-b67a-3310d2cb2485 (host: l75lg1-v1) handling event "create" for row 82fbda28-3c6c-4fa0-8506-e1ae5636f88a (table: Datapath_Binding) {{(pid=77619) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:43:43 l75lg1-v1 neutron-server[77618]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [-] Hash Ring: Node 4c6fc793-7f5a-456f-b4d6-6e5bd97592f2 (host: l75lg1-v1) handling event "create" for row e0112af8-ce41-4b01-ad87-93806fb91451 (table: Logical_Switch) {{(pid=77618) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:43:43 l75lg1-v1 neutron-server[77618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae1f1c07-06d1-41a4-a529-e4ad2ebf593d demo demo] Pushing event updated for resources: {'Network': ['ID=fb218033-3d98-4065-b336-c595d5e6ca77,revision_number=1']} {{(pid=77618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 28 12:43:43 l75lg1-v1 neutron-server[77618]: INFO neutron.db.ovn_revision_numbers_db [None req-ae1f1c07-06d1-41a4-a529-e4ad2ebf593d demo demo] Successfully bumped revision number for resource fb218033-3d98-4065-b336-c595d5e6ca77 (type: networks) to 1 May 28 12:43:43 l75lg1-v1 neutron-server[77618]: DEBUG neutron_lib.callbacks.manager [None req-ae1f1c07-06d1-41a4-a529-e4ad2ebf593d demo demo] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1015114'] for port (None), before_create {{(pid=77618) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:43:43 l75lg1-v1 neutron-server[77618]: DEBUG neutron_lib.callbacks.manager [None req-ae1f1c07-06d1-41a4-a529-e4ad2ebf593d demo demo] Publish callbacks [] for port (f963b4ff-a496-409f-a783-967e97462265), precommit_create {{(pid=77618) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:43:43 l75lg1-v1 neutron-server[77618]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver [None req-ae1f1c07-06d1-41a4-a529-e4ad2ebf593d demo demo] No provisioning block for port f963b4ff-a496-409f-a783-967e97462265 since it does not have a host {{(pid=77618) _is_port_provisioning_required /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/mech_driver.py:720}} May 28 12:43:43 l75lg1-v1 neutron-server[77618]: DEBUG neutron.db.ovn_revision_numbers_db [None req-ae1f1c07-06d1-41a4-a529-e4ad2ebf593d demo demo] create_initial_revision uuid=f963b4ff-a496-409f-a783-967e97462265, type=ports, rev=-1 {{(pid=77618) create_initial_revision /opt/stack/neutron/neutron/db/ovn_revision_numbers_db.py:108}} May 28 12:43:43 l75lg1-v1 neutron-server[77618]: INFO neutron.tests.unit.plugins.ml2.drivers.mechanism_logger [None req-ae1f1c07-06d1-41a4-a529-e4ad2ebf593d demo demo] create_port_precommit called with port settings {'id': 'f963b4ff-a496-409f-a783-967e97462265', 'name': '', 'network_id': 'fb218033-3d98-4065-b336-c595d5e6ca77', 'tenant_id': '95de88f6d26e4420bc466ba67668171f', 'mac_address': 'fa:16:3e:de:39:0c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ovnmeta-fb218033-3d98-4065-b336-c595d5e6ca77', 'device_owner': 'network:distributed', 'standard_attr_id': 14, 'fixed_ips': [], 'project_id': '95de88f6d26e4420bc466ba67668171f', 'port_security_enabled': False, 'security_groups': [], 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'allowed_address_pairs': []} (original settings None) host (original host None) vif type unbound (original vif type None) vif details {} (original vif details None) binding levels None (original binding levels None) on network {'id': 'fb218033-3d98-4065-b336-c595d5e6ca77', 'name': 'private', 'tenant_id': '95de88f6d26e4420bc466ba67668171f', 'admin_state_up': True, 'mtu': 1442, 'status': 'ACTIVE', 'subnets': [], 'standard_attr_id': 12, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'vlan_transparent': None, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2024-05-28T12:43:43Z', 'updated_at': '2024-05-28T12:43:43Z', 'revision_number': 1, 'project_id': '95de88f6d26e4420bc466ba67668171f', 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 30276} with segments to bind None May 28 12:43:43 l75lg1-v1 neutron-server[77618]: DEBUG neutron.tests.unit.plugins.ml2.drivers.mechanism_logger [None req-ae1f1c07-06d1-41a4-a529-e4ad2ebf593d demo demo] create_port_precommit: May 28 12:43:43 l75lg1-v1 neutron-server[77618]: key[tenant_id], None -> 95de88f6d26e4420bc466ba67668171f May 28 12:43:43 l75lg1-v1 neutron-server[77618]: key[network_id], None -> fb218033-3d98-4065-b336-c595d5e6ca77 May 28 12:43:43 l75lg1-v1 neutron-server[77618]: key[allowed_address_pairs], None -> [] May 28 12:43:43 l75lg1-v1 neutron-server[77618]: key[binding:vif_type], None -> unbound May 28 12:43:43 l75lg1-v1 neutron-server[77618]: key[project_id], None -> 95de88f6d26e4420bc466ba67668171f May 28 12:43:43 l75lg1-v1 neutron-server[77618]: key[admin_state_up], None -> True May 28 12:43:43 l75lg1-v1 neutron-server[77618]: key[id], None -> f963b4ff-a496-409f-a783-967e97462265 May 28 12:43:43 l75lg1-v1 neutron-server[77618]: key[security_groups], None -> [] May 28 12:43:43 l75lg1-v1 neutron-server[77618]: key[binding:vnic_type], None -> normal May 28 12:43:43 l75lg1-v1 neutron-server[77618]: key[name], None -> May 28 12:43:43 l75lg1-v1 neutron-server[77618]: key[status], None -> DOWN May 28 12:43:43 l75lg1-v1 neutron-server[77618]: key[binding:profile], None -> {} May 28 12:43:43 l75lg1-v1 neutron-server[77618]: key[port_security_enabled], None -> False May 28 12:43:43 l75lg1-v1 neutron-server[77618]: key[standard_attr_id], None -> 14 May 28 12:43:43 l75lg1-v1 neutron-server[77618]: key[device_owner], None -> network:distributed May 28 12:43:43 l75lg1-v1 neutron-server[77618]: key[device_id], None -> ovnmeta-fb218033-3d98-4065-b336-c595d5e6ca77 May 28 12:43:43 l75lg1-v1 neutron-server[77618]: key[mac_address], None -> fa:16:3e:de:39:0c May 28 12:43:43 l75lg1-v1 neutron-server[77618]: key[binding:host_id], None -> May 28 12:43:43 l75lg1-v1 neutron-server[77618]: key[binding:vif_details], None -> {} May 28 12:43:43 l75lg1-v1 neutron-server[77618]: key[fixed_ips], None -> [] May 28 12:43:43 l75lg1-v1 neutron-server[77618]: {{(pid=77618) _log_diff_call /opt/stack/neutron/neutron/tests/unit/plugins/ml2/drivers/mechanism_logger.py:59}} May 28 12:43:43 l75lg1-v1 neutron-server[77618]: DEBUG neutron_lib.callbacks.manager [None req-ae1f1c07-06d1-41a4-a529-e4ad2ebf593d demo demo] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4166243'] for port (f963b4ff-a496-409f-a783-967e97462265), after_create {{(pid=77618) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:43:44 l75lg1-v1 neutron-server[77618]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddLSwitchPortCommand(_result=None, lport=f963b4ff-a496-409f-a783-967e97462265, lswitch=neutron-fb218033-3d98-4065-b336-c595d5e6ca77, may_exist=True, columns={'addresses': ['fa:16:3e:de:39:0c'], 'external_ids': {'neutron:port_name': '', 'neutron:device_id': 'ovnmeta-fb218033-3d98-4065-b336-c595d5e6ca77', 'neutron:project_id': '95de88f6d26e4420bc466ba67668171f', 'neutron:cidrs': '', 'neutron:device_owner': 'network:distributed', 'neutron:subnet_pool_addr_scope4': '', 'neutron:subnet_pool_addr_scope6': '', 'neutron:network_name': 'neutron-fb218033-3d98-4065-b336-c595d5e6ca77', 'neutron:security_group_ids': '', 'neutron:revision_number': '1', 'neutron:vnic_type': 'normal', 'neutron:port_capabilities': '', 'neutron:mtu': ''}, 'parent_name': [], 'tag': [], 'enabled': True, 'options': {}, 'type': 'localport', 'port_security': [], 'dhcpv4_options': [], 'dhcpv6_options': []}) {{(pid=77618) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:43:44 l75lg1-v1 neutron-server[77618]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): QoSDelCommand(_result=None, switch=neutron-fb218033-3d98-4065-b336-c595d5e6ca77, conditions=[('direction', '=', 'to-lport'), ('priority', '=', 2002), ('match', '=', 'outport == "f963b4ff-a496-409f-a783-967e97462265"')], if_exists=True) {{(pid=77618) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:43:44 l75lg1-v1 neutron-server[77618]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): UpdateLSwitchPortQosOptionsCommand(_result=None, lport=AddLSwitchPortCommand(_result=96f2544f-5925-4438-98c4-122c1ac8f5e7, lport=f963b4ff-a496-409f-a783-967e97462265, lswitch=neutron-fb218033-3d98-4065-b336-c595d5e6ca77, may_exist=True, columns={'addresses': ['fa:16:3e:de:39:0c'], 'external_ids': {'neutron:port_name': '', 'neutron:device_id': 'ovnmeta-fb218033-3d98-4065-b336-c595d5e6ca77', 'neutron:project_id': '95de88f6d26e4420bc466ba67668171f', 'neutron:cidrs': '', 'neutron:device_owner': 'network:distributed', 'neutron:subnet_pool_addr_scope4': '', 'neutron:subnet_pool_addr_scope6': '', 'neutron:network_name': 'neutron-fb218033-3d98-4065-b336-c595d5e6ca77', 'neutron:security_group_ids': '', 'neutron:revision_number': '1', 'neutron:vnic_type': 'normal', 'neutron:port_capabilities': '', 'neutron:mtu': ''}, 'parent_name': [], 'enabled': True, 'options': {}, 'type': 'localport', 'port_security': []}), if_exists=True, qos={'qos_min_rate': None}) {{(pid=77618) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:43:44 l75lg1-v1 neutron-server[77618]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=3): QoSDelCommand(_result=None, switch=neutron-fb218033-3d98-4065-b336-c595d5e6ca77, conditions=[('direction', '=', 'from-lport'), ('priority', '=', 2002), ('match', '=', 'inport == "f963b4ff-a496-409f-a783-967e97462265"')], if_exists=True) {{(pid=77618) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:43:44 l75lg1-v1 neutron-server[77618]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=4): UpdateLSwitchPortQosOptionsCommand(_result=None, lport=AddLSwitchPortCommand(_result=96f2544f-5925-4438-98c4-122c1ac8f5e7, lport=f963b4ff-a496-409f-a783-967e97462265, lswitch=neutron-fb218033-3d98-4065-b336-c595d5e6ca77, may_exist=True, columns={'addresses': ['fa:16:3e:de:39:0c'], 'external_ids': {'neutron:port_name': '', 'neutron:device_id': 'ovnmeta-fb218033-3d98-4065-b336-c595d5e6ca77', 'neutron:project_id': '95de88f6d26e4420bc466ba67668171f', 'neutron:cidrs': '', 'neutron:device_owner': 'network:distributed', 'neutron:subnet_pool_addr_scope4': '', 'neutron:subnet_pool_addr_scope6': '', 'neutron:network_name': 'neutron-fb218033-3d98-4065-b336-c595d5e6ca77', 'neutron:security_group_ids': '', 'neutron:revision_number': '1', 'neutron:vnic_type': 'normal', 'neutron:port_capabilities': '', 'neutron:mtu': ''}, 'parent_name': [], 'enabled': True, 'options': {}, 'type': 'localport', 'port_security': []}), if_exists=True, qos={'qos_min_rate': None}) {{(pid=77618) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:43:44 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [-] Hash Ring: Node c89b3497-133e-4a5a-b67a-3310d2cb2485 (host: l75lg1-v1) handling event "create" for row d750d9b5-f0d8-4325-98ce-ea5e5a97b343 (table: Port_Binding) {{(pid=77619) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:43:44 l75lg1-v1 neutron-server[77618]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [-] Hash Ring: Node 4c6fc793-7f5a-456f-b4d6-6e5bd97592f2 (host: l75lg1-v1) handling event "update" for row e0112af8-ce41-4b01-ad87-93806fb91451 (table: Logical_Switch) {{(pid=77618) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:43:44 l75lg1-v1 neutron-server[77618]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [-] Hash Ring: Node 4c6fc793-7f5a-456f-b4d6-6e5bd97592f2 (host: l75lg1-v1) handling event "create" for row 7c9589a5-001a-4a6c-96a7-a764b2e01be9 (table: Logical_Switch_Port) {{(pid=77618) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:43:44 l75lg1-v1 neutron-server[77618]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [-] Hash Ring: Node 4c6fc793-7f5a-456f-b4d6-6e5bd97592f2 (host: l75lg1-v1) handling event "update" for row 7c9589a5-001a-4a6c-96a7-a764b2e01be9 (table: Logical_Switch_Port) {{(pid=77618) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:43:44 l75lg1-v1 neutron-server[77618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae1f1c07-06d1-41a4-a529-e4ad2ebf593d demo demo] Pushing event updated for resources: {'Port': ['ID=f963b4ff-a496-409f-a783-967e97462265,revision_number=1']} {{(pid=77618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 28 12:43:44 l75lg1-v1 neutron-server[77618]: INFO neutron.db.ovn_revision_numbers_db [None req-ae1f1c07-06d1-41a4-a529-e4ad2ebf593d demo demo] Successfully bumped revision number for resource f963b4ff-a496-409f-a783-967e97462265 (type: ports) to 1 May 28 12:43:44 l75lg1-v1 neutron-server[77618]: INFO neutron.tests.unit.plugins.ml2.drivers.mechanism_logger [None req-ae1f1c07-06d1-41a4-a529-e4ad2ebf593d demo demo] create_port_postcommit called with port settings {'id': 'f963b4ff-a496-409f-a783-967e97462265', 'name': '', 'network_id': 'fb218033-3d98-4065-b336-c595d5e6ca77', 'tenant_id': '95de88f6d26e4420bc466ba67668171f', 'mac_address': 'fa:16:3e:de:39:0c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ovnmeta-fb218033-3d98-4065-b336-c595d5e6ca77', 'device_owner': 'network:distributed', 'standard_attr_id': 14, 'fixed_ips': [], 'project_id': '95de88f6d26e4420bc466ba67668171f', 'port_security_enabled': False, 'security_groups': [], 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'description': '', 'tags': [], 'created_at': '2024-05-28T12:43:43Z', 'updated_at': '2024-05-28T12:43:43Z', 'revision_number': 1, 'network': {'id': 'fb218033-3d98-4065-b336-c595d5e6ca77', 'name': 'private', 'tenant_id': '95de88f6d26e4420bc466ba67668171f', 'admin_state_up': True, 'mtu': 1442, 'status': 'ACTIVE', 'subnets': [], 'standard_attr_id': 12, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'vlan_transparent': None, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2024-05-28T12:43:43Z', 'updated_at': '2024-05-28T12:43:43Z', 'revision_number': 1, 'project_id': '95de88f6d26e4420bc466ba67668171f', 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 30276}} (original settings None) host (original host None) vif type unbound (original vif type None) vif details {} (original vif details None) binding levels None (original binding levels None) on network {'id': 'fb218033-3d98-4065-b336-c595d5e6ca77', 'name': 'private', 'tenant_id': '95de88f6d26e4420bc466ba67668171f', 'admin_state_up': True, 'mtu': 1442, 'status': 'ACTIVE', 'subnets': [], 'standard_attr_id': 12, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'vlan_transparent': None, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2024-05-28T12:43:43Z', 'updated_at': '2024-05-28T12:43:43Z', 'revision_number': 1, 'project_id': '95de88f6d26e4420bc466ba67668171f', 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 30276} with segments to bind None May 28 12:43:44 l75lg1-v1 neutron-server[77618]: DEBUG neutron.tests.unit.plugins.ml2.drivers.mechanism_logger [None req-ae1f1c07-06d1-41a4-a529-e4ad2ebf593d demo demo] create_port_postcommit: May 28 12:43:44 l75lg1-v1 neutron-server[77618]: key[tenant_id], None -> 95de88f6d26e4420bc466ba67668171f May 28 12:43:44 l75lg1-v1 neutron-server[77618]: key[network_id], None -> fb218033-3d98-4065-b336-c595d5e6ca77 May 28 12:43:44 l75lg1-v1 neutron-server[77618]: key[allowed_address_pairs], None -> [] May 28 12:43:44 l75lg1-v1 neutron-server[77618]: key[binding:vif_type], None -> unbound May 28 12:43:44 l75lg1-v1 neutron-server[77618]: key[project_id], None -> 95de88f6d26e4420bc466ba67668171f May 28 12:43:44 l75lg1-v1 neutron-server[77618]: key[admin_state_up], None -> True May 28 12:43:44 l75lg1-v1 neutron-server[77618]: key[id], None -> f963b4ff-a496-409f-a783-967e97462265 May 28 12:43:44 l75lg1-v1 neutron-server[77618]: key[security_groups], None -> [] May 28 12:43:44 l75lg1-v1 neutron-server[77618]: key[extra_dhcp_opts], None -> [] May 28 12:43:44 l75lg1-v1 neutron-server[77618]: key[binding:vnic_type], None -> normal May 28 12:43:44 l75lg1-v1 neutron-server[77618]: key[tags], None -> [] May 28 12:43:44 l75lg1-v1 neutron-server[77618]: key[name], None -> May 28 12:43:44 l75lg1-v1 neutron-server[77618]: key[created_at], None -> 2024-05-28T12:43:43Z May 28 12:43:44 l75lg1-v1 neutron-server[77618]: key[status], None -> DOWN May 28 12:43:44 l75lg1-v1 neutron-server[77618]: key[binding:profile], None -> {} May 28 12:43:44 l75lg1-v1 neutron-server[77618]: key[port_security_enabled], None -> False May 28 12:43:44 l75lg1-v1 neutron-server[77618]: key[updated_at], None -> 2024-05-28T12:43:43Z May 28 12:43:44 l75lg1-v1 neutron-server[77618]: key[network], None -> {'id': 'fb218033-3d98-4065-b336-c595d5e6ca77', 'name': 'private', 'tenant_id': '95de88f6d26e4420bc466ba67668171f', 'admin_state_up': True, 'mtu': 1442, 'status': 'ACTIVE', 'subnets': [], 'standard_attr_id': 12, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'vlan_transparent': None, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2024-05-28T12:43:43Z', 'updated_at': '2024-05-28T12:43:43Z', 'revision_number': 1, 'project_id': '95de88f6d26e4420bc466ba67668171f', 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 30276} May 28 12:43:44 l75lg1-v1 neutron-server[77618]: key[standard_attr_id], None -> 14 May 28 12:43:44 l75lg1-v1 neutron-server[77618]: key[device_owner], None -> network:distributed May 28 12:43:44 l75lg1-v1 neutron-server[77618]: key[device_id], None -> ovnmeta-fb218033-3d98-4065-b336-c595d5e6ca77 May 28 12:43:44 l75lg1-v1 neutron-server[77618]: key[mac_address], None -> fa:16:3e:de:39:0c May 28 12:43:44 l75lg1-v1 neutron-server[77618]: key[description], None -> May 28 12:43:44 l75lg1-v1 neutron-server[77618]: key[binding:host_id], None -> May 28 12:43:44 l75lg1-v1 neutron-server[77618]: key[binding:vif_details], None -> {} May 28 12:43:44 l75lg1-v1 neutron-server[77618]: key[revision_number], None -> 1 May 28 12:43:44 l75lg1-v1 neutron-server[77618]: key[fixed_ips], None -> [] May 28 12:43:44 l75lg1-v1 neutron-server[77618]: {{(pid=77618) _log_diff_call /opt/stack/neutron/neutron/tests/unit/plugins/ml2/drivers/mechanism_logger.py:59}} May 28 12:43:44 l75lg1-v1 neutron-server[77618]: INFO neutron.tests.unit.plugins.ml2.drivers.mechanism_logger [None req-ae1f1c07-06d1-41a4-a529-e4ad2ebf593d demo demo] create_network_postcommit called with network settings {'id': 'fb218033-3d98-4065-b336-c595d5e6ca77', 'name': 'private', 'tenant_id': '95de88f6d26e4420bc466ba67668171f', 'admin_state_up': True, 'mtu': 1442, 'status': 'ACTIVE', 'subnets': [], 'standard_attr_id': 12, 'shared': False, 'project_id': '95de88f6d26e4420bc466ba67668171f', 'port_security_enabled': True, 'router:external': False, 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 30276, 'is_default': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'vlan_transparent': None, 'description': '', 'tags': [], 'created_at': '2024-05-28T12:43:43Z', 'updated_at': '2024-05-28T12:43:43Z', 'revision_number': 1} (original settings None) and network segments [{'id': 'bb1bf6f8-e34d-458b-82c6-3d470163b0d7', 'network_type': 'geneve', 'physical_network': None, 'segmentation_id': 30276, 'network_id': 'fb218033-3d98-4065-b336-c595d5e6ca77'}] May 28 12:43:44 l75lg1-v1 neutron-server[77618]: DEBUG neutron.tests.unit.plugins.ml2.drivers.mechanism_logger [None req-ae1f1c07-06d1-41a4-a529-e4ad2ebf593d demo demo] create_network_postcommit: May 28 12:43:44 l75lg1-v1 neutron-server[77618]: key[tenant_id], None -> 95de88f6d26e4420bc466ba67668171f May 28 12:43:44 l75lg1-v1 neutron-server[77618]: key[provider:network_type], None -> geneve May 28 12:43:44 l75lg1-v1 neutron-server[77618]: key[project_id], None -> 95de88f6d26e4420bc466ba67668171f May 28 12:43:44 l75lg1-v1 neutron-server[77618]: key[ipv6_address_scope], None -> None May 28 12:43:44 l75lg1-v1 neutron-server[77618]: key[subnets], None -> [] May 28 12:43:44 l75lg1-v1 neutron-server[77618]: key[admin_state_up], None -> True May 28 12:43:44 l75lg1-v1 neutron-server[77618]: key[id], None -> fb218033-3d98-4065-b336-c595d5e6ca77 May 28 12:43:44 l75lg1-v1 neutron-server[77618]: key[ipv4_address_scope], None -> None May 28 12:43:44 l75lg1-v1 neutron-server[77618]: key[tags], None -> [] May 28 12:43:44 l75lg1-v1 neutron-server[77618]: key[created_at], None -> 2024-05-28T12:43:43Z May 28 12:43:44 l75lg1-v1 neutron-server[77618]: key[status], None -> ACTIVE May 28 12:43:44 l75lg1-v1 neutron-server[77618]: key[is_default], None -> False May 28 12:43:44 l75lg1-v1 neutron-server[77618]: key[port_security_enabled], None -> True May 28 12:43:44 l75lg1-v1 neutron-server[77618]: key[vlan_transparent], None -> None May 28 12:43:44 l75lg1-v1 neutron-server[77618]: key[updated_at], None -> 2024-05-28T12:43:43Z May 28 12:43:44 l75lg1-v1 neutron-server[77618]: key[standard_attr_id], None -> 12 May 28 12:43:44 l75lg1-v1 neutron-server[77618]: key[availability_zone_hints], None -> [] May 28 12:43:44 l75lg1-v1 neutron-server[77618]: key[provider:physical_network], None -> None May 28 12:43:44 l75lg1-v1 neutron-server[77618]: key[shared], None -> False May 28 12:43:44 l75lg1-v1 neutron-server[77618]: key[mtu], None -> 1442 May 28 12:43:44 l75lg1-v1 neutron-server[77618]: key[provider:segmentation_id], None -> 30276 May 28 12:43:44 l75lg1-v1 neutron-server[77618]: key[description], None -> May 28 12:43:44 l75lg1-v1 neutron-server[77618]: key[availability_zones], None -> [] May 28 12:43:44 l75lg1-v1 neutron-server[77618]: key[revision_number], None -> 1 May 28 12:43:44 l75lg1-v1 neutron-server[77618]: key[router:external], None -> False May 28 12:43:44 l75lg1-v1 neutron-server[77618]: key[name], None -> private May 28 12:43:44 l75lg1-v1 neutron-server[77618]: {{(pid=77618) _log_diff_call /opt/stack/neutron/neutron/tests/unit/plugins/ml2/drivers/mechanism_logger.py:59}} May 28 12:43:44 l75lg1-v1 neutron-server[77618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ae1f1c07-06d1-41a4-a529-e4ad2ebf593d demo demo] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=77618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:258}} May 28 12:43:44 l75lg1-v1 neutron-server[77618]: DEBUG neutron_lib.callbacks.manager [None req-ae1f1c07-06d1-41a4-a529-e4ad2ebf593d demo demo] Publish callbacks [] for network (None), before_response {{(pid=77618) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:43:44 l75lg1-v1 dstat.sh[49771]: 28-05 12:43:44| 11 1 86 1 0|2639M 6862M 267M 5930M| 14k 0 | 0 1798k| 0 217 |3893 6217 |1.41 1.82 1.26|1.0 0 2.0| 0 0 | 0 2048M| 23 109 0 26 0 May 28 12:43:44 l75lg1-v1 neutron-server[77618]: INFO neutron.wsgi [None req-ae1f1c07-06d1-41a4-a529-e4ad2ebf593d demo demo] 10.27.203.238 "POST /networking/v2.0/networks HTTP/1.1" status: 201 len: 748 time: 1.5552242 May 28 12:43:44 l75lg1-v1 devstack@placement-api.service[78202]: DEBUG dbcounter [-] [78202] Writing DB stats placement:SELECT=2,placement:INSERT=2,placement:SET=1 {{(pid=78202) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:43:44 l75lg1-v1 devstack@placement-api.service[78201]: DEBUG dbcounter [-] [78201] Writing DB stats placement:SELECT=2,placement:INSERT=2,placement:SET=1 {{(pid=78201) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:43:45 l75lg1-v1 dstat.sh[49771]: 28-05 12:43:45| 9 2 89 1 0|2615M 6886M 267M 5930M| 11k 4892B| 0 837k| 0 89.1 |2159 2727 |1.41 1.82 1.26|1.0 0 61| 0 0 | 0 2048M| 23 111 0 27 0 May 28 12:43:45 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=Chassis_Private, record=0da8323f-64af-4526-b223-049f5737145a, col_values=(('external_ids', {'neutron:ovn-metadata-sb-cfg': '1'}),), if_exists=True) {{(pid=76818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:43:45 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [-] ChassisMetadataAgentWriteEvent : Matched Chassis_Private, update, None None {{(pid=77619) matches /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:65}} May 28 12:43:45 l75lg1-v1 neutron-server[77621]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [-] ChassisMetadataAgentWriteEvent : Matched Chassis_Private, update, None None {{(pid=77621) matches /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:65}} May 28 12:43:45 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [-] Hash Ring: Node c89b3497-133e-4a5a-b67a-3310d2cb2485 (host: l75lg1-v1) handling event "update" for row 6ef07056-3e6a-44fb-b483-fdb6022e4e42 (table: Chassis_Private) {{(pid=77619) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:43:45 l75lg1-v1 neutron-server[77618]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [-] ChassisMetadataAgentWriteEvent : Matched Chassis_Private, update, None None {{(pid=77618) matches /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:65}} May 28 12:43:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd66a29e-8ce4-4d50-a9ea-dcffa6feeea0 None None] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:43:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd66a29e-8ce4-4d50-a9ea-dcffa6feeea0 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:43:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd66a29e-8ce4-4d50-a9ea-dcffa6feeea0 None None] PATH_INFO: `/` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:43:45 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 449/882] 10.27.203.238 () {58 vars in 1014 bytes} [Tue May 28 12:43:45 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:43:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3829cd-2320-4801-8303-4dff1adf5dd3 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:43:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3829cd-2320-4801-8303-4dff1adf5dd3 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:43:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3829cd-2320-4801-8303-4dff1adf5dd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:43:45 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-ad3829cd-2320-4801-8303-4dff1adf5dd3 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:43:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-ad3829cd-2320-4801-8303-4dff1adf5dd3 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:43:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-ad3829cd-2320-4801-8303-4dff1adf5dd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:43:45 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 434/883] 10.27.203.238 () {62 vars in 1111 bytes} [Tue May 28 12:43:45 2024] POST /identity/v3/auth/tokens => generated 3990 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 28 12:43:45 l75lg1-v1 neutron-server[77619]: DEBUG neutron.wsgi [-] (77619) accepted ('10.27.203.238', 42998) {{(pid=77619) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 12:43:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd66a29e-8ce4-4d50-a9ea-dcffa6feeea0 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:43:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd66a29e-8ce4-4d50-a9ea-dcffa6feeea0 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:43:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15048afc-d374-4040-93dd-7973df9808c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef17047035e4b518fd5360a01f2da1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:43:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15048afc-d374-4040-93dd-7973df9808c6 service neutron] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:43:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15048afc-d374-4040-93dd-7973df9808c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:43:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15048afc-d374-4040-93dd-7973df9808c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:43:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15048afc-d374-4040-93dd-7973df9808c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:43:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15048afc-d374-4040-93dd-7973df9808c6 service neutron] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:43:46 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 450/884] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 12:43:45 2024] GET /identity/v3/auth/tokens => generated 3990 bytes in 19 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 12:43:46 l75lg1-v1 neutron-server[77619]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b1fc45f4-eaca-4538-9d59-1afc8c2853a6 demo admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=77619) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:258}} May 28 12:43:46 l75lg1-v1 neutron-server[77619]: INFO neutron.wsgi [None req-b1fc45f4-eaca-4538-9d59-1afc8c2853a6 demo admin] 10.27.203.238 "GET /networking/v2.0/networks/fb218033-3d98-4065-b336-c595d5e6ca77 HTTP/1.1" status: 200 len: 823 time: 0.1169677 May 28 12:43:46 l75lg1-v1 neutron-server[77619]: INFO neutron.wsgi [None req-d7b91b48-2566-42ed-83ff-ee9ef318ba65 demo admin] 10.27.203.238 "GET /networking/v2.0/subnetpools/7ce124d7-9655-437a-bb20-8dfd71efaaff HTTP/1.1" status: 200 len: 732 time: 0.0108790 May 28 12:43:46 l75lg1-v1 neutron-server[77619]: DEBUG neutron.api.v2.base [None req-c34dadfe-f94d-4601-aa9f-07bf22353598 demo admin] Request body: {'subnet': {'ip_version': 4, 'name': 'private-subnet', 'subnetpool_id': '7ce124d7-9655-437a-bb20-8dfd71efaaff', 'network_id': 'fb218033-3d98-4065-b336-c595d5e6ca77'}} {{(pid=77619) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:734}} May 28 12:43:46 l75lg1-v1 neutron-server[77619]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c34dadfe-f94d-4601-aa9f-07bf22353598 demo admin] Made reservation on behalf of 95de88f6d26e4420bc466ba67668171f for: {'subnet': 1} {{(pid=77619) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 28 12:43:46 l75lg1-v1 neutron-server[77619]: DEBUG neutron_lib.callbacks.manager [None req-c34dadfe-f94d-4601-aa9f-07bf22353598 demo admin] Publish callbacks [] for subnet (None), before_create {{(pid=77619) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:43:46 l75lg1-v1 dstat.sh[49771]: 28-05 12:43:46| 9 1 89 0 0|2646M 6855M 267M 5930M|9626B 0 | 0 640k| 0 68.0 |2066 2958 |1.41 1.82 1.26|1.0 0 0| 0 0 | 0 2048M| 23 113 0 27 0 May 28 12:43:46 l75lg1-v1 neutron-server[77619]: DEBUG neutron.db.ovn_revision_numbers_db [None req-c34dadfe-f94d-4601-aa9f-07bf22353598 demo admin] create_initial_revision uuid=5508b790-cc91-4b59-8d30-81ef4480e470, type=subnets, rev=-1 {{(pid=77619) create_initial_revision /opt/stack/neutron/neutron/db/ovn_revision_numbers_db.py:108}} May 28 12:43:46 l75lg1-v1 neutron-server[77619]: INFO neutron.tests.unit.plugins.ml2.drivers.mechanism_logger [None req-c34dadfe-f94d-4601-aa9f-07bf22353598 demo admin] create_subnet_precommit called with subnet settings {'id': '5508b790-cc91-4b59-8d30-81ef4480e470', 'name': 'private-subnet', 'tenant_id': '95de88f6d26e4420bc466ba67668171f', 'network_id': 'fb218033-3d98-4065-b336-c595d5e6ca77', 'ip_version': 4, 'subnetpool_id': '7ce124d7-9655-437a-bb20-8dfd71efaaff', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'standard_attr_id': 15, 'gateway_ip': '10.0.0.1', 'cidr': '10.0.0.0/26', 'allocation_pools': [{'start': '10.0.0.2', 'end': '10.0.0.62'}], 'host_routes': [], 'dns_nameservers': [], 'shared': False, 'description': '', 'service_types': [], 'tags': [], 'created_at': '2024-05-28T12:43:46Z', 'updated_at': '2024-05-28T12:43:46Z', 'revision_number': 0, 'project_id': '95de88f6d26e4420bc466ba67668171f'} (original settings None) May 28 12:43:46 l75lg1-v1 neutron-server[77619]: DEBUG neutron.tests.unit.plugins.ml2.drivers.mechanism_logger [None req-c34dadfe-f94d-4601-aa9f-07bf22353598 demo admin] create_subnet_precommit: May 28 12:43:46 l75lg1-v1 neutron-server[77619]: key[tenant_id], None -> 95de88f6d26e4420bc466ba67668171f May 28 12:43:46 l75lg1-v1 neutron-server[77619]: key[network_id], None -> fb218033-3d98-4065-b336-c595d5e6ca77 May 28 12:43:46 l75lg1-v1 neutron-server[77619]: key[revision_number], None -> 0 May 28 12:43:46 l75lg1-v1 neutron-server[77619]: key[project_id], None -> 95de88f6d26e4420bc466ba67668171f May 28 12:43:46 l75lg1-v1 neutron-server[77619]: key[id], None -> 5508b790-cc91-4b59-8d30-81ef4480e470 May 28 12:43:46 l75lg1-v1 neutron-server[77619]: key[tags], None -> [] May 28 12:43:46 l75lg1-v1 neutron-server[77619]: key[created_at], None -> 2024-05-28T12:43:46Z May 28 12:43:46 l75lg1-v1 neutron-server[77619]: key[allocation_pools], None -> [{'start': '10.0.0.2', 'end': '10.0.0.62'}] May 28 12:43:46 l75lg1-v1 neutron-server[77619]: key[subnetpool_id], None -> 7ce124d7-9655-437a-bb20-8dfd71efaaff May 28 12:43:46 l75lg1-v1 neutron-server[77619]: key[host_routes], None -> [] May 28 12:43:46 l75lg1-v1 neutron-server[77619]: key[gateway_ip], None -> 10.0.0.1 May 28 12:43:46 l75lg1-v1 neutron-server[77619]: key[service_types], None -> [] May 28 12:43:46 l75lg1-v1 neutron-server[77619]: key[updated_at], None -> 2024-05-28T12:43:46Z May 28 12:43:46 l75lg1-v1 neutron-server[77619]: key[standard_attr_id], None -> 15 May 28 12:43:46 l75lg1-v1 neutron-server[77619]: key[ip_version], None -> 4 May 28 12:43:46 l75lg1-v1 neutron-server[77619]: key[cidr], None -> 10.0.0.0/26 May 28 12:43:46 l75lg1-v1 neutron-server[77619]: key[dns_nameservers], None -> [] May 28 12:43:46 l75lg1-v1 neutron-server[77619]: key[ipv6_address_mode], None -> None May 28 12:43:46 l75lg1-v1 neutron-server[77619]: key[description], None -> May 28 12:43:46 l75lg1-v1 neutron-server[77619]: key[ipv6_ra_mode], None -> None May 28 12:43:46 l75lg1-v1 neutron-server[77619]: key[enable_dhcp], None -> True May 28 12:43:46 l75lg1-v1 neutron-server[77619]: key[shared], None -> False May 28 12:43:46 l75lg1-v1 neutron-server[77619]: key[name], None -> private-subnet May 28 12:43:46 l75lg1-v1 neutron-server[77619]: {{(pid=77619) _log_diff_call /opt/stack/neutron/neutron/tests/unit/plugins/ml2/drivers/mechanism_logger.py:59}} May 28 12:43:46 l75lg1-v1 neutron-server[77619]: DEBUG neutron_lib.callbacks.manager [None req-c34dadfe-f94d-4601-aa9f-07bf22353598 demo admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4166501'] for subnet (5508b790-cc91-4b59-8d30-81ef4480e470), after_create {{(pid=77619) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:43:46 l75lg1-v1 neutron-server[77619]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.extensions.qos [None req-c34dadfe-f94d-4601-aa9f-07bf22353598 demo admin] Starting OVNClientQosExtension May 28 12:43:46 l75lg1-v1 neutron-server[77619]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.extensions.placement [None req-c34dadfe-f94d-4601-aa9f-07bf22353598 demo admin] Starting OVNClientPlacementExtension May 28 12:43:46 l75lg1-v1 neutron-server[77619]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c34dadfe-f94d-4601-aa9f-07bf22353598 demo admin] Pushing event updated for resources: {'Subnet': ['ID=5508b790-cc91-4b59-8d30-81ef4480e470,revision_number=0']} {{(pid=77619) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 28 12:43:46 l75lg1-v1 neutron-server[77619]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c34dadfe-f94d-4601-aa9f-07bf22353598 demo admin] Tracked resource versions report: May 28 12:43:46 l75lg1-v1 neutron-server[77619]: pushed versions: May 28 12:43:46 l75lg1-v1 neutron-server[77619]: { 'AddressGroup': {'1.2'}, May 28 12:43:46 l75lg1-v1 neutron-server[77619]: 'Agent': {'1.1'}, May 28 12:43:46 l75lg1-v1 neutron-server[77619]: 'ConntrackHelper': {'1.0'}, May 28 12:43:46 l75lg1-v1 neutron-server[77619]: 'LocalIPAssociation': {'1.0'}, May 28 12:43:46 l75lg1-v1 neutron-server[77619]: 'Log': {'1.0'}, May 28 12:43:46 l75lg1-v1 neutron-server[77619]: 'NDPProxy': {'1.0'}, May 28 12:43:46 l75lg1-v1 neutron-server[77619]: 'Network': {'1.1'}, May 28 12:43:46 l75lg1-v1 neutron-server[77619]: 'Port': {'1.9'}, May 28 12:43:46 l75lg1-v1 neutron-server[77619]: 'PortForwarding': {'1.3'}, May 28 12:43:46 l75lg1-v1 neutron-server[77619]: 'QosPolicy': {'1.10'}, May 28 12:43:46 l75lg1-v1 neutron-server[77619]: 'SecurityGroup': {'1.6'}, May 28 12:43:46 l75lg1-v1 neutron-server[77619]: 'SecurityGroupRule': {'1.3'}, May 28 12:43:46 l75lg1-v1 neutron-server[77619]: 'SubPort': {'1.0'}, May 28 12:43:46 l75lg1-v1 neutron-server[77619]: 'Subnet': {'1.1'}, May 28 12:43:46 l75lg1-v1 neutron-server[77619]: 'Trunk': {'1.1'}} May 28 12:43:46 l75lg1-v1 neutron-server[77619]: consumer versions: May 28 12:43:46 l75lg1-v1 neutron-server[77619]: {OVN Controller Gateway agent@l75lg1-v1: {}, OVN Metadata agent@l75lg1-v1: {}} May 28 12:43:46 l75lg1-v1 neutron-server[77619]: {{(pid=77619) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:178}} May 28 12:43:46 l75lg1-v1 neutron-server[77619]: DEBUG neutron_lib.callbacks.manager [None req-c34dadfe-f94d-4601-aa9f-07bf22353598 demo admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1015114', 'neutron.services.ovn_l3.plugin.OVNL3RouterPlugin._port_update-8754901907784', 'neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_internal_ip_change_for_fip-8754903031884'] for port (f963b4ff-a496-409f-a783-967e97462265), before_update {{(pid=77619) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:43:46 l75lg1-v1 neutron-server[77619]: DEBUG neutron.db.db_base_plugin_common [None req-c34dadfe-f94d-4601-aa9f-07bf22353598 demo admin] Allocated IP 10.0.0.2 (fb218033-3d98-4065-b336-c595d5e6ca77/5508b790-cc91-4b59-8d30-81ef4480e470/f963b4ff-a496-409f-a783-967e97462265) {{(pid=77619) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:134}} May 28 12:43:46 l75lg1-v1 neutron-server[77619]: DEBUG neutron_lib.callbacks.manager [None req-c34dadfe-f94d-4601-aa9f-07bf22353598 demo admin] Publish callbacks [] for port (f963b4ff-a496-409f-a783-967e97462265), precommit_update {{(pid=77619) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:43:46 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver [None req-c34dadfe-f94d-4601-aa9f-07bf22353598 demo admin] No provisioning block for port f963b4ff-a496-409f-a783-967e97462265 since it does not have a host {{(pid=77619) _is_port_provisioning_required /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/mech_driver.py:720}} May 28 12:43:46 l75lg1-v1 neutron-server[77619]: INFO neutron.tests.unit.plugins.ml2.drivers.mechanism_logger [None req-c34dadfe-f94d-4601-aa9f-07bf22353598 demo admin] update_port_precommit called with port settings {'id': 'f963b4ff-a496-409f-a783-967e97462265', 'name': '', 'network_id': 'fb218033-3d98-4065-b336-c595d5e6ca77', 'tenant_id': '95de88f6d26e4420bc466ba67668171f', 'mac_address': 'fa:16:3e:de:39:0c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ovnmeta-fb218033-3d98-4065-b336-c595d5e6ca77', 'device_owner': 'network:distributed', 'standard_attr_id': 14, 'fixed_ips': [{'subnet_id': '5508b790-cc91-4b59-8d30-81ef4480e470', 'ip_address': '10.0.0.2'}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2024-05-28T12:43:43Z', 'updated_at': '2024-05-28T12:43:46Z', 'revision_number': 2, 'project_id': '95de88f6d26e4420bc466ba67668171f'} (original settings {'id': 'f963b4ff-a496-409f-a783-967e97462265', 'name': '', 'network_id': 'fb218033-3d98-4065-b336-c595d5e6ca77', 'tenant_id': '95de88f6d26e4420bc466ba67668171f', 'mac_address': 'fa:16:3e:de:39:0c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ovnmeta-fb218033-3d98-4065-b336-c595d5e6ca77', 'device_owner': 'network:distributed', 'standard_attr_id': 14, 'fixed_ips': [], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2024-05-28T12:43:43Z', 'updated_at': '2024-05-28T12:43:43Z', 'revision_number': 1, 'project_id': '95de88f6d26e4420bc466ba67668171f'}) host (original host ) vif type unbound (original vif type unbound) vif details {} (original vif details {}) binding levels None (original binding levels None) on network {'id': 'fb218033-3d98-4065-b336-c595d5e6ca77', 'name': 'private', 'tenant_id': '95de88f6d26e4420bc466ba67668171f', 'admin_state_up': True, 'mtu': 1442, 'status': 'ACTIVE', 'subnets': ['5508b790-cc91-4b59-8d30-81ef4480e470'], 'standard_attr_id': 12, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'vlan_transparent': None, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2024-05-28T12:43:43Z', 'updated_at': '2024-05-28T12:43:46Z', 'revision_number': 2, 'project_id': '95de88f6d26e4420bc466ba67668171f', 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 30276} with segments to bind None May 28 12:43:46 l75lg1-v1 neutron-server[77619]: DEBUG neutron.tests.unit.plugins.ml2.drivers.mechanism_logger [None req-c34dadfe-f94d-4601-aa9f-07bf22353598 demo admin] update_port_precommit: May 28 12:43:46 l75lg1-v1 neutron-server[77619]: key[fixed_ips], [] -> [{'subnet_id': '5508b790-cc91-4b59-8d30-81ef4480e470', 'ip_address': '10.0.0.2'}] May 28 12:43:46 l75lg1-v1 neutron-server[77619]: key[updated_at], 2024-05-28T12:43:43Z -> 2024-05-28T12:43:46Z May 28 12:43:46 l75lg1-v1 neutron-server[77619]: key[revision_number], 1 -> 2 May 28 12:43:46 l75lg1-v1 neutron-server[77619]: {{(pid=77619) _log_diff_call /opt/stack/neutron/neutron/tests/unit/plugins/ml2/drivers/mechanism_logger.py:59}} May 28 12:43:46 l75lg1-v1 neutron-server[77619]: DEBUG neutron_lib.callbacks.manager [None req-c34dadfe-f94d-4601-aa9f-07bf22353598 demo admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4166243', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8754903016533', 'neutron.services.ovn_l3.plugin.OVNL3RouterPlugin._port_update-8754901907784'] for port (f963b4ff-a496-409f-a783-967e97462265), after_update {{(pid=77619) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:43:46 l75lg1-v1 neutron-server[77619]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-138bc913-abce-41c5-b6bf-e8cd71b4f577 None None] Pushing event updated for resources: {'Port': ['ID=f963b4ff-a496-409f-a783-967e97462265,revision_number=2']} {{(pid=77619) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 28 12:43:47 l75lg1-v1 neutron-server[77619]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=f963b4ff-a496-409f-a783-967e97462265, resource={'id': 'f963b4ff-a496-409f-a783-967e97462265', 'name': '', 'network_id': 'fb218033-3d98-4065-b336-c595d5e6ca77', 'tenant_id': '95de88f6d26e4420bc466ba67668171f', 'mac_address': 'fa:16:3e:de:39:0c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ovnmeta-fb218033-3d98-4065-b336-c595d5e6ca77', 'device_owner': 'network:distributed', 'standard_attr_id': 14, 'fixed_ips': [{'subnet_id': '5508b790-cc91-4b59-8d30-81ef4480e470', 'ip_address': '10.0.0.2'}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2024-05-28T12:43:43Z', 'updated_at': '2024-05-28T12:43:46Z', 'revision_number': 2, 'project_id': '95de88f6d26e4420bc466ba67668171f', 'network': {'id': 'fb218033-3d98-4065-b336-c595d5e6ca77', 'name': 'private', 'tenant_id': '95de88f6d26e4420bc466ba67668171f', 'admin_state_up': True, 'mtu': 1442, 'status': 'ACTIVE', 'subnets': ['5508b790-cc91-4b59-8d30-81ef4480e470'], 'standard_attr_id': 12, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'vlan_transparent': None, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2024-05-28T12:43:43Z', 'updated_at': '2024-05-28T12:43:46Z', 'revision_number': 2, 'project_id': '95de88f6d26e4420bc466ba67668171f', 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 30276}}, resource_type=ports, if_exists=True) {{(pid=77619) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:43:47 l75lg1-v1 neutron-server[77619]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): AddDHCPOptionsCommand(_result=None, columns={'cidr': '10.0.0.0/26', 'options': {'server_id': '10.0.0.1', 'lease_time': '43200', 'mtu': '1442', 'router': '10.0.0.1', 'server_mac': 'fa:16:3e:90:f6:a2', 'dns_server': '{127.0.0.53}', 'classless_static_route': '{169.254.169.254/32,10.0.0.2, 0.0.0.0/0,10.0.0.1}'}, 'external_ids': {'subnet_id': '5508b790-cc91-4b59-8d30-81ef4480e470', 'neutron:revision_number': '0'}}, may_exist=True, subnet_id=5508b790-cc91-4b59-8d30-81ef4480e470, port_id=None, new_insert=False) {{(pid=77619) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:43:47 l75lg1-v1 neutron-server[77619]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLSwitchPortCommand(_result=None, lport=f963b4ff-a496-409f-a783-967e97462265, external_ids_update=None, columns={'external_ids': {'neutron:port_name': '', 'neutron:device_id': 'ovnmeta-fb218033-3d98-4065-b336-c595d5e6ca77', 'neutron:project_id': '95de88f6d26e4420bc466ba67668171f', 'neutron:cidrs': '10.0.0.2/26', 'neutron:device_owner': 'network:distributed', 'neutron:subnet_pool_addr_scope4': '', 'neutron:subnet_pool_addr_scope6': '', 'neutron:network_name': 'neutron-fb218033-3d98-4065-b336-c595d5e6ca77', 'neutron:security_group_ids': '', 'neutron:revision_number': '2', 'neutron:vnic_type': 'normal', 'neutron:port_capabilities': '', 'neutron:mtu': ''}, 'parent_name': [], 'tag': [], 'options': {}, 'enabled': True, 'port_security': [], 'dhcpv4_options': [], 'dhcpv6_options': [], 'type': 'localport', 'addresses': ['fa:16:3e:de:39:0c 10.0.0.2'], 'ha_chassis_group': []}, if_exists=False) {{(pid=77619) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:43:47 l75lg1-v1 neutron-server[77619]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=3): PgDelPortCommand(_result=None, port_group=neutron_pg_drop, lsp=['f963b4ff-a496-409f-a783-967e97462265'], if_exists=False) {{(pid=77619) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:43:47 l75lg1-v1 neutron-server[77618]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [-] Hash Ring: Node 4c6fc793-7f5a-456f-b4d6-6e5bd97592f2 (host: l75lg1-v1) handling event "create" for row 775eacd5-f4e5-452d-a278-17a02d760015 (table: DHCP_Options) {{(pid=77618) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:43:47 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [-] Hash Ring: Node c89b3497-133e-4a5a-b67a-3310d2cb2485 (host: l75lg1-v1) handling event "update" for row d750d9b5-f0d8-4325-98ce-ea5e5a97b343 (table: Port_Binding) {{(pid=77619) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:43:47 l75lg1-v1 neutron-server[77618]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [-] Hash Ring: Node 4c6fc793-7f5a-456f-b4d6-6e5bd97592f2 (host: l75lg1-v1) handling event "update" for row 7c9589a5-001a-4a6c-96a7-a764b2e01be9 (table: Logical_Switch_Port) {{(pid=77618) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:43:47 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched UPDATE: PortBindingUpdatedEvent(events=('update',), table='Port_Binding', conditions=None, old_conditions=None), priority=20 to row=Port_Binding(parent_port=[], mac=['fa:16:3e:de:39:0c 10.0.0.2'], chassis=[], ha_chassis_group=[], options={}, type=localport, tag=[], requested_chassis=[], tunnel_key=1, up=[False], logical_port=f963b4ff-a496-409f-a783-967e97462265, gateway_chassis=[], encap=[], external_ids={'neutron:cidrs': '10.0.0.2/26', 'neutron:device_id': 'ovnmeta-fb218033-3d98-4065-b336-c595d5e6ca77', 'neutron:device_owner': 'network:distributed', 'neutron:mtu': '', 'neutron:network_name': 'neutron-fb218033-3d98-4065-b336-c595d5e6ca77', 'neutron:port_capabilities': '', 'neutron:port_name': '', 'neutron:project_id': '95de88f6d26e4420bc466ba67668171f', 'neutron:revision_number': '2', 'neutron:security_group_ids': '', 'neutron:subnet_pool_addr_scope4': '', 'neutron:subnet_pool_addr_scope6': '', 'neutron:vnic_type': 'normal'}, virtual_parent=[], nat_addresses=[], datapath=82fbda28-3c6c-4fa0-8506-e1ae5636f88a) old=Port_Binding(mac=['fa:16:3e:de:39:0c'], external_ids={'neutron:cidrs': '', 'neutron:device_id': 'ovnmeta-fb218033-3d98-4065-b336-c595d5e6ca77', 'neutron:device_owner': 'network:distributed', 'neutron:mtu': '', 'neutron:network_name': 'neutron-fb218033-3d98-4065-b336-c595d5e6ca77', 'neutron:port_capabilities': '', 'neutron:port_name': '', 'neutron:project_id': '95de88f6d26e4420bc466ba67668171f', 'neutron:revision_number': '1', 'neutron:security_group_ids': '', 'neutron:subnet_pool_addr_scope4': '', 'neutron:subnet_pool_addr_scope6': '', 'neutron:vnic_type': 'normal'}) {{(pid=76818) matches /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} May 28 12:43:47 l75lg1-v1 neutron-ovn-metadata-agent[76818]: INFO neutron.agent.ovn.metadata.agent [-] Metadata Port f963b4ff-a496-409f-a783-967e97462265 in datapath fb218033-3d98-4065-b336-c595d5e6ca77 updated May 28 12:43:47 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata.agent [-] No valid VIF ports were found for network fb218033-3d98-4065-b336-c595d5e6ca77, tearing the namespace down if needed {{(pid=76818) _get_provision_params /opt/stack/neutron/neutron/agent/ovn/metadata/agent.py:720}} May 28 12:43:47 l75lg1-v1 neutron-ovn-metadata-agent[76818]: INFO oslo.privsep.daemon [-] Running privsep helper: ['sudo', '/opt/stack/data/venv/bin/neutron-rootwrap', '/etc/neutron/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/neutron/neutron_ovn_metadata_agent.ini', '--privsep_context', 'neutron.privileged.default', '--privsep_sock_path', '/tmp/tmpjvk_3ovq/privsep.sock'] May 28 12:43:47 l75lg1-v1 sudo[78939]: vastdata : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/neutron-rootwrap /etc/neutron/rootwrap.conf privsep-helper --config-file /etc/neutron/neutron_ovn_metadata_agent.ini --privsep_context neutron.privileged.default --privsep_sock_path /tmp/tmpjvk_3ovq/privsep.sock May 28 12:43:47 l75lg1-v1 sudo[78939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) May 28 12:43:47 l75lg1-v1 neutron-server[77619]: INFO neutron.db.ovn_revision_numbers_db [None req-c34dadfe-f94d-4601-aa9f-07bf22353598 demo admin] Successfully bumped revision number for resource f963b4ff-a496-409f-a783-967e97462265 (type: ports) to 2 May 28 12:43:47 l75lg1-v1 neutron-server[77619]: INFO neutron.tests.unit.plugins.ml2.drivers.mechanism_logger [None req-c34dadfe-f94d-4601-aa9f-07bf22353598 demo admin] update_port_postcommit called with port settings {'id': 'f963b4ff-a496-409f-a783-967e97462265', 'name': '', 'network_id': 'fb218033-3d98-4065-b336-c595d5e6ca77', 'tenant_id': '95de88f6d26e4420bc466ba67668171f', 'mac_address': 'fa:16:3e:de:39:0c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ovnmeta-fb218033-3d98-4065-b336-c595d5e6ca77', 'device_owner': 'network:distributed', 'standard_attr_id': 14, 'fixed_ips': [{'subnet_id': '5508b790-cc91-4b59-8d30-81ef4480e470', 'ip_address': '10.0.0.2'}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2024-05-28T12:43:43Z', 'updated_at': '2024-05-28T12:43:46Z', 'revision_number': 2, 'project_id': '95de88f6d26e4420bc466ba67668171f'} (original settings {'id': 'f963b4ff-a496-409f-a783-967e97462265', 'name': '', 'network_id': 'fb218033-3d98-4065-b336-c595d5e6ca77', 'tenant_id': '95de88f6d26e4420bc466ba67668171f', 'mac_address': 'fa:16:3e:de:39:0c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ovnmeta-fb218033-3d98-4065-b336-c595d5e6ca77', 'device_owner': 'network:distributed', 'standard_attr_id': 14, 'fixed_ips': [], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2024-05-28T12:43:43Z', 'updated_at': '2024-05-28T12:43:43Z', 'revision_number': 1, 'project_id': '95de88f6d26e4420bc466ba67668171f'}) host (original host ) vif type unbound (original vif type unbound) vif details {} (original vif details {}) binding levels None (original binding levels None) on network {'id': 'fb218033-3d98-4065-b336-c595d5e6ca77', 'name': 'private', 'tenant_id': '95de88f6d26e4420bc466ba67668171f', 'admin_state_up': True, 'mtu': 1442, 'status': 'ACTIVE', 'subnets': ['5508b790-cc91-4b59-8d30-81ef4480e470'], 'standard_attr_id': 12, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'vlan_transparent': None, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2024-05-28T12:43:43Z', 'updated_at': '2024-05-28T12:43:46Z', 'revision_number': 2, 'project_id': '95de88f6d26e4420bc466ba67668171f', 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 30276} with segments to bind None May 28 12:43:47 l75lg1-v1 neutron-server[77619]: DEBUG neutron.tests.unit.plugins.ml2.drivers.mechanism_logger [None req-c34dadfe-f94d-4601-aa9f-07bf22353598 demo admin] update_port_postcommit: May 28 12:43:47 l75lg1-v1 neutron-server[77619]: key[fixed_ips], [] -> [{'subnet_id': '5508b790-cc91-4b59-8d30-81ef4480e470', 'ip_address': '10.0.0.2'}] May 28 12:43:47 l75lg1-v1 neutron-server[77619]: key[updated_at], 2024-05-28T12:43:43Z -> 2024-05-28T12:43:46Z May 28 12:43:47 l75lg1-v1 neutron-server[77619]: key[revision_number], 1 -> 2 May 28 12:43:47 l75lg1-v1 neutron-server[77619]: {{(pid=77619) _log_diff_call /opt/stack/neutron/neutron/tests/unit/plugins/ml2/drivers/mechanism_logger.py:59}} May 28 12:43:47 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.plugin [None req-c34dadfe-f94d-4601-aa9f-07bf22353598 demo admin] In _notify_port_updated(), no bound segment for port f963b4ff-a496-409f-a783-967e97462265 on network fb218033-3d98-4065-b336-c595d5e6ca77 {{(pid=77619) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:981}} May 28 12:43:47 l75lg1-v1 neutron-server[77619]: INFO neutron.db.ovn_revision_numbers_db [None req-c34dadfe-f94d-4601-aa9f-07bf22353598 demo admin] Successfully bumped revision number for resource 5508b790-cc91-4b59-8d30-81ef4480e470 (type: subnets) to 0 May 28 12:43:47 l75lg1-v1 neutron-server[77619]: INFO neutron.tests.unit.plugins.ml2.drivers.mechanism_logger [None req-c34dadfe-f94d-4601-aa9f-07bf22353598 demo admin] create_subnet_postcommit called with subnet settings {'id': '5508b790-cc91-4b59-8d30-81ef4480e470', 'name': 'private-subnet', 'tenant_id': '95de88f6d26e4420bc466ba67668171f', 'network_id': 'fb218033-3d98-4065-b336-c595d5e6ca77', 'ip_version': 4, 'subnetpool_id': '7ce124d7-9655-437a-bb20-8dfd71efaaff', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'standard_attr_id': 15, 'gateway_ip': '10.0.0.1', 'cidr': '10.0.0.0/26', 'allocation_pools': [{'start': '10.0.0.2', 'end': '10.0.0.62'}], 'host_routes': [], 'dns_nameservers': [], 'shared': False, 'description': '', 'service_types': [], 'tags': [], 'created_at': '2024-05-28T12:43:46Z', 'updated_at': '2024-05-28T12:43:46Z', 'revision_number': 0, 'project_id': '95de88f6d26e4420bc466ba67668171f', 'network': {'id': 'fb218033-3d98-4065-b336-c595d5e6ca77', 'name': 'private', 'tenant_id': '95de88f6d26e4420bc466ba67668171f', 'admin_state_up': True, 'mtu': 1442, 'status': 'ACTIVE', 'subnets': ['5508b790-cc91-4b59-8d30-81ef4480e470'], 'standard_attr_id': 12, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'vlan_transparent': None, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2024-05-28T12:43:43Z', 'updated_at': '2024-05-28T12:43:46Z', 'revision_number': 2, 'project_id': '95de88f6d26e4420bc466ba67668171f', 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 30276}} (original settings None) May 28 12:43:47 l75lg1-v1 neutron-server[77619]: DEBUG neutron.tests.unit.plugins.ml2.drivers.mechanism_logger [None req-c34dadfe-f94d-4601-aa9f-07bf22353598 demo admin] create_subnet_postcommit: May 28 12:43:47 l75lg1-v1 neutron-server[77619]: key[tenant_id], None -> 95de88f6d26e4420bc466ba67668171f May 28 12:43:47 l75lg1-v1 neutron-server[77619]: key[network_id], None -> fb218033-3d98-4065-b336-c595d5e6ca77 May 28 12:43:47 l75lg1-v1 neutron-server[77619]: key[revision_number], None -> 0 May 28 12:43:47 l75lg1-v1 neutron-server[77619]: key[project_id], None -> 95de88f6d26e4420bc466ba67668171f May 28 12:43:47 l75lg1-v1 neutron-server[77619]: key[id], None -> 5508b790-cc91-4b59-8d30-81ef4480e470 May 28 12:43:47 l75lg1-v1 neutron-server[77619]: key[tags], None -> [] May 28 12:43:47 l75lg1-v1 neutron-server[77619]: key[created_at], None -> 2024-05-28T12:43:46Z May 28 12:43:47 l75lg1-v1 neutron-server[77619]: key[allocation_pools], None -> [{'start': '10.0.0.2', 'end': '10.0.0.62'}] May 28 12:43:47 l75lg1-v1 neutron-server[77619]: key[subnetpool_id], None -> 7ce124d7-9655-437a-bb20-8dfd71efaaff May 28 12:43:47 l75lg1-v1 neutron-server[77619]: key[host_routes], None -> [] May 28 12:43:47 l75lg1-v1 neutron-server[77619]: key[gateway_ip], None -> 10.0.0.1 May 28 12:43:47 l75lg1-v1 neutron-server[77619]: key[service_types], None -> [] May 28 12:43:47 l75lg1-v1 neutron-server[77619]: key[updated_at], None -> 2024-05-28T12:43:46Z May 28 12:43:47 l75lg1-v1 neutron-server[77619]: key[network], None -> {'id': 'fb218033-3d98-4065-b336-c595d5e6ca77', 'name': 'private', 'tenant_id': '95de88f6d26e4420bc466ba67668171f', 'admin_state_up': True, 'mtu': 1442, 'status': 'ACTIVE', 'subnets': ['5508b790-cc91-4b59-8d30-81ef4480e470'], 'standard_attr_id': 12, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'vlan_transparent': None, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2024-05-28T12:43:43Z', 'updated_at': '2024-05-28T12:43:46Z', 'revision_number': 2, 'project_id': '95de88f6d26e4420bc466ba67668171f', 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 30276} May 28 12:43:47 l75lg1-v1 neutron-server[77619]: key[standard_attr_id], None -> 15 May 28 12:43:47 l75lg1-v1 neutron-server[77619]: key[ip_version], None -> 4 May 28 12:43:47 l75lg1-v1 neutron-server[77619]: key[cidr], None -> 10.0.0.0/26 May 28 12:43:47 l75lg1-v1 neutron-server[77619]: key[dns_nameservers], None -> [] May 28 12:43:47 l75lg1-v1 neutron-server[77619]: key[ipv6_address_mode], None -> None May 28 12:43:47 l75lg1-v1 neutron-server[77619]: key[description], None -> May 28 12:43:47 l75lg1-v1 neutron-server[77619]: key[ipv6_ra_mode], None -> None May 28 12:43:47 l75lg1-v1 neutron-server[77619]: key[enable_dhcp], None -> True May 28 12:43:47 l75lg1-v1 neutron-server[77619]: key[shared], None -> False May 28 12:43:47 l75lg1-v1 neutron-server[77619]: key[name], None -> private-subnet May 28 12:43:47 l75lg1-v1 neutron-server[77619]: {{(pid=77619) _log_diff_call /opt/stack/neutron/neutron/tests/unit/plugins/ml2/drivers/mechanism_logger.py:59}} May 28 12:43:47 l75lg1-v1 neutron-server[77619]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c34dadfe-f94d-4601-aa9f-07bf22353598 demo admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=77619) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:258}} May 28 12:43:47 l75lg1-v1 neutron-server[77619]: DEBUG neutron_lib.callbacks.manager [None req-c34dadfe-f94d-4601-aa9f-07bf22353598 demo admin] Publish callbacks [] for subnet (None), before_response {{(pid=77619) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:43:47 l75lg1-v1 neutron-server[77619]: INFO neutron.wsgi [None req-c34dadfe-f94d-4601-aa9f-07bf22353598 demo admin] 10.27.203.238 "POST /networking/v2.0/subnets HTTP/1.1" status: 201 len: 846 time: 1.1096461 May 28 12:43:47 l75lg1-v1 dstat.sh[49771]: 28-05 12:43:47| 11 1 86 1 0|2672M 6828M 267M 5930M|9763B 0 | 0 1452k| 0 166 |2925 4855 |1.37 1.81 1.26|4.0 0 4.0| 0 0 | 0 2048M| 23 114 0 29 0 May 28 12:43:48 l75lg1-v1 sudo[78939]: pam_unix(sudo:session): session closed for user root May 28 12:43:48 l75lg1-v1 neutron-ovn-metadata-agent[76818]: INFO oslo.privsep.daemon [-] Spawned new privsep daemon via rootwrap May 28 12:43:48 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo.privsep.daemon [-] Accepted privsep connection to /tmp/tmpjvk_3ovq/privsep.sock {{(pid=76818) __init__ /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:362}} May 28 12:43:48 l75lg1-v1 neutron-ovn-metadata-agent[76818]: INFO oslo.privsep.daemon [-] privsep daemon starting May 28 12:43:48 l75lg1-v1 neutron-ovn-metadata-agent[76818]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 May 28 12:43:48 l75lg1-v1 neutron-ovn-metadata-agent[76818]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_NET_ADMIN|CAP_SYS_ADMIN|CAP_SYS_PTRACE/CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_NET_ADMIN|CAP_SYS_ADMIN|CAP_SYS_PTRACE/none May 28 12:43:48 l75lg1-v1 neutron-ovn-metadata-agent[76818]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 79043 May 28 12:43:48 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo.privsep.daemon [-] privsep: reply[d491af57-b78f-423a-8c13-def3b6d1f90e]: (2,) {{(pid=79043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} May 28 12:43:48 l75lg1-v1 dstat.sh[49771]: 28-05 12:43:48| 18 3 79 0 0|2668M 6833M 267M 5930M| 16k 8261B| 0 448k| 0 30.0 |2477 2731 |1.37 1.81 1.26|3.0 0 106| 0 0 | 0 2048M| 23 114 0 29 0 May 28 12:43:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4283019c-094b-4b3a-bf14-856d6ce5424a None None] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:43:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4283019c-094b-4b3a-bf14-856d6ce5424a None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:43:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4283019c-094b-4b3a-bf14-856d6ce5424a None None] PATH_INFO: `/` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:43:48 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 435/885] 10.27.203.238 () {58 vars in 1014 bytes} [Tue May 28 12:43:48 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:43:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b24aa7-8218-438a-b716-850157279860 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:43:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b24aa7-8218-438a-b716-850157279860 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:43:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b24aa7-8218-438a-b716-850157279860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:43:48 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-b1b24aa7-8218-438a-b716-850157279860 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:43:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-b1b24aa7-8218-438a-b716-850157279860 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:43:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-b1b24aa7-8218-438a-b716-850157279860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:43:48 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 451/886] 10.27.203.238 () {62 vars in 1111 bytes} [Tue May 28 12:43:48 2024] POST /identity/v3/auth/tokens => generated 3990 bytes in 22 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:43:48 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "context-manager" by "neutron_lib.db.api._create_context_manager" {{(pid=79043) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:43:48 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_concurrency.lockutils [-] Lock "context-manager" acquired by "neutron_lib.db.api._create_context_manager" :: waited 0.000s {{(pid=79043) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:43:48 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_concurrency.lockutils [-] Lock "context-manager" "released" by "neutron_lib.db.api._create_context_manager" :: held 0.000s {{(pid=79043) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:43:48 l75lg1-v1 neutron-server[77619]: DEBUG neutron.wsgi [-] (77619) accepted ('10.27.203.238', 43008) {{(pid=77619) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 12:43:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4283019c-094b-4b3a-bf14-856d6ce5424a None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:43:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4283019c-094b-4b3a-bf14-856d6ce5424a None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:43:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ad7473-ce86-4fc7-bc75-5ccfc7e95370 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef17047035e4b518fd5360a01f2da1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:43:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ad7473-ce86-4fc7-bc75-5ccfc7e95370 service neutron] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:43:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ad7473-ce86-4fc7-bc75-5ccfc7e95370 service neutron] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:43:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ad7473-ce86-4fc7-bc75-5ccfc7e95370 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:43:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ad7473-ce86-4fc7-bc75-5ccfc7e95370 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:43:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ad7473-ce86-4fc7-bc75-5ccfc7e95370 service neutron] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:43:48 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 436/887] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 12:43:48 2024] GET /identity/v3/auth/tokens => generated 3990 bytes in 20 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 12:43:49 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo.privsep.daemon [-] privsep: reply[e084590f-e519-4b9c-a691-1fc77ad7917f]: (4, False) {{(pid=79043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} May 28 12:43:49 l75lg1-v1 neutron-server[77619]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-130d3bc7-602e-479a-a104-704d74a315ac demo admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=77619) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:258}} May 28 12:43:49 l75lg1-v1 neutron-server[77619]: INFO neutron.wsgi [None req-130d3bc7-602e-479a-a104-704d74a315ac demo admin] 10.27.203.238 "GET /networking/v2.0/networks/fb218033-3d98-4065-b336-c595d5e6ca77 HTTP/1.1" status: 200 len: 861 time: 0.0780041 May 28 12:43:49 l75lg1-v1 neutron-server[77619]: INFO neutron.wsgi [None req-0088985d-3385-4787-8454-e54a35cac1a5 demo admin] 10.27.203.238 "GET /networking/v2.0/subnetpools/d213a9b3-11ed-4176-a121-2dc281d546ef HTTP/1.1" status: 200 len: 742 time: 0.0111392 May 28 12:43:49 l75lg1-v1 neutron-server[77619]: DEBUG neutron.api.v2.base [None req-0563fb14-f85c-49cd-b593-66a4e77199c6 demo admin] Request body: {'subnet': {'ipv6_ra_mode': 'slaac', 'ip_version': 6, 'subnetpool_id': 'd213a9b3-11ed-4176-a121-2dc281d546ef', 'ipv6_address_mode': 'slaac', 'network_id': 'fb218033-3d98-4065-b336-c595d5e6ca77', 'name': 'ipv6-private-subnet'}} {{(pid=77619) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:734}} May 28 12:43:49 l75lg1-v1 neutron-server[77619]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0563fb14-f85c-49cd-b593-66a4e77199c6 demo admin] Made reservation on behalf of 95de88f6d26e4420bc466ba67668171f for: {'subnet': 1} {{(pid=77619) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 28 12:43:49 l75lg1-v1 neutron-server[77619]: DEBUG neutron_lib.callbacks.manager [None req-0563fb14-f85c-49cd-b593-66a4e77199c6 demo admin] Publish callbacks [] for subnet (None), before_create {{(pid=77619) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:43:49 l75lg1-v1 neutron-server[77619]: DEBUG neutron.db.ovn_revision_numbers_db [None req-0563fb14-f85c-49cd-b593-66a4e77199c6 demo admin] create_initial_revision uuid=799ded51-0b75-4f67-94e9-0a7ea3c3f3d6, type=subnets, rev=-1 {{(pid=77619) create_initial_revision /opt/stack/neutron/neutron/db/ovn_revision_numbers_db.py:108}} May 28 12:43:49 l75lg1-v1 neutron-server[77619]: INFO neutron.tests.unit.plugins.ml2.drivers.mechanism_logger [None req-0563fb14-f85c-49cd-b593-66a4e77199c6 demo admin] create_subnet_precommit called with subnet settings {'id': '799ded51-0b75-4f67-94e9-0a7ea3c3f3d6', 'name': 'ipv6-private-subnet', 'tenant_id': '95de88f6d26e4420bc466ba67668171f', 'network_id': 'fb218033-3d98-4065-b336-c595d5e6ca77', 'ip_version': 6, 'subnetpool_id': 'd213a9b3-11ed-4176-a121-2dc281d546ef', 'enable_dhcp': True, 'ipv6_ra_mode': 'slaac', 'ipv6_address_mode': 'slaac', 'standard_attr_id': 16, 'gateway_ip': 'fd12:3562:78f7::1', 'cidr': 'fd12:3562:78f7::/64', 'allocation_pools': [{'start': 'fd12:3562:78f7::2', 'end': 'fd12:3562:78f7:0:ffff:ffff:ffff:ffff'}], 'host_routes': [], 'dns_nameservers': [], 'shared': False, 'description': '', 'service_types': [], 'tags': [], 'created_at': '2024-05-28T12:43:49Z', 'updated_at': '2024-05-28T12:43:49Z', 'revision_number': 0, 'project_id': '95de88f6d26e4420bc466ba67668171f'} (original settings None) May 28 12:43:49 l75lg1-v1 neutron-server[77619]: DEBUG neutron.tests.unit.plugins.ml2.drivers.mechanism_logger [None req-0563fb14-f85c-49cd-b593-66a4e77199c6 demo admin] create_subnet_precommit: May 28 12:43:49 l75lg1-v1 neutron-server[77619]: key[tenant_id], None -> 95de88f6d26e4420bc466ba67668171f May 28 12:43:49 l75lg1-v1 neutron-server[77619]: key[network_id], None -> fb218033-3d98-4065-b336-c595d5e6ca77 May 28 12:43:49 l75lg1-v1 neutron-server[77619]: key[revision_number], None -> 0 May 28 12:43:49 l75lg1-v1 neutron-server[77619]: key[project_id], None -> 95de88f6d26e4420bc466ba67668171f May 28 12:43:49 l75lg1-v1 neutron-server[77619]: key[id], None -> 799ded51-0b75-4f67-94e9-0a7ea3c3f3d6 May 28 12:43:49 l75lg1-v1 neutron-server[77619]: key[tags], None -> [] May 28 12:43:49 l75lg1-v1 neutron-server[77619]: key[created_at], None -> 2024-05-28T12:43:49Z May 28 12:43:49 l75lg1-v1 neutron-server[77619]: key[allocation_pools], None -> [{'start': 'fd12:3562:78f7::2', 'end': 'fd12:3562:78f7:0:ffff:ffff:ffff:ffff'}] May 28 12:43:49 l75lg1-v1 neutron-server[77619]: key[subnetpool_id], None -> d213a9b3-11ed-4176-a121-2dc281d546ef May 28 12:43:49 l75lg1-v1 neutron-server[77619]: key[host_routes], None -> [] May 28 12:43:49 l75lg1-v1 neutron-server[77619]: key[gateway_ip], None -> fd12:3562:78f7::1 May 28 12:43:49 l75lg1-v1 neutron-server[77619]: key[service_types], None -> [] May 28 12:43:49 l75lg1-v1 neutron-server[77619]: key[updated_at], None -> 2024-05-28T12:43:49Z May 28 12:43:49 l75lg1-v1 neutron-server[77619]: key[standard_attr_id], None -> 16 May 28 12:43:49 l75lg1-v1 neutron-server[77619]: key[ip_version], None -> 6 May 28 12:43:49 l75lg1-v1 neutron-server[77619]: key[cidr], None -> fd12:3562:78f7::/64 May 28 12:43:49 l75lg1-v1 neutron-server[77619]: key[dns_nameservers], None -> [] May 28 12:43:49 l75lg1-v1 neutron-server[77619]: key[ipv6_address_mode], None -> slaac May 28 12:43:49 l75lg1-v1 neutron-server[77619]: key[description], None -> May 28 12:43:49 l75lg1-v1 neutron-server[77619]: key[ipv6_ra_mode], None -> slaac May 28 12:43:49 l75lg1-v1 neutron-server[77619]: key[enable_dhcp], None -> True May 28 12:43:49 l75lg1-v1 neutron-server[77619]: key[shared], None -> False May 28 12:43:49 l75lg1-v1 neutron-server[77619]: key[name], None -> ipv6-private-subnet May 28 12:43:49 l75lg1-v1 neutron-server[77619]: {{(pid=77619) _log_diff_call /opt/stack/neutron/neutron/tests/unit/plugins/ml2/drivers/mechanism_logger.py:59}} May 28 12:43:49 l75lg1-v1 dstat.sh[49771]: 28-05 12:43:49| 17 1 81 1 0|2733M 6768M 267M 5930M| 11k 0 | 0 808k| 0 95.0 |2400 3175 |1.37 1.81 1.26|2.0 1.0 0| 0 0 | 0 2048M| 23 116 0 29 0 May 28 12:43:49 l75lg1-v1 neutron-server[77619]: DEBUG neutron.objects.ports [None req-0563fb14-f85c-49cd-b593-66a4e77199c6 demo admin] Time-cost: Fetching 1 ports in 0 security groups {{(pid=77619) get_objects /opt/stack/neutron/neutron/objects/ports.py:497}} May 28 12:43:49 l75lg1-v1 neutron-server[77619]: DEBUG neutron_lib.callbacks.manager [None req-0563fb14-f85c-49cd-b593-66a4e77199c6 demo admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1015114', 'neutron.services.ovn_l3.plugin.OVNL3RouterPlugin._port_update-8754901907784', 'neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_internal_ip_change_for_fip-8754903031884'] for port (f963b4ff-a496-409f-a783-967e97462265), before_update {{(pid=77619) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:43:49 l75lg1-v1 neutron-server[77619]: DEBUG neutron_lib.callbacks.manager [None req-0563fb14-f85c-49cd-b593-66a4e77199c6 demo admin] Publish callbacks [] for port (f963b4ff-a496-409f-a783-967e97462265), precommit_update {{(pid=77619) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:43:49 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver [None req-0563fb14-f85c-49cd-b593-66a4e77199c6 demo admin] No provisioning block for port f963b4ff-a496-409f-a783-967e97462265 since it does not have a host {{(pid=77619) _is_port_provisioning_required /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/mech_driver.py:720}} May 28 12:43:49 l75lg1-v1 neutron-server[77619]: INFO neutron.tests.unit.plugins.ml2.drivers.mechanism_logger [None req-0563fb14-f85c-49cd-b593-66a4e77199c6 demo admin] update_port_precommit called with port settings {'id': 'f963b4ff-a496-409f-a783-967e97462265', 'name': '', 'network_id': 'fb218033-3d98-4065-b336-c595d5e6ca77', 'tenant_id': '95de88f6d26e4420bc466ba67668171f', 'mac_address': 'fa:16:3e:de:39:0c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ovnmeta-fb218033-3d98-4065-b336-c595d5e6ca77', 'device_owner': 'network:distributed', 'standard_attr_id': 14, 'fixed_ips': [{'subnet_id': '5508b790-cc91-4b59-8d30-81ef4480e470', 'ip_address': '10.0.0.2'}, {'subnet_id': '799ded51-0b75-4f67-94e9-0a7ea3c3f3d6', 'ip_address': 'fd12:3562:78f7:0:f816:3eff:fede:390c'}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2024-05-28T12:43:43Z', 'updated_at': '2024-05-28T12:43:49Z', 'revision_number': 3, 'project_id': '95de88f6d26e4420bc466ba67668171f'} (original settings {'id': 'f963b4ff-a496-409f-a783-967e97462265', 'name': '', 'network_id': 'fb218033-3d98-4065-b336-c595d5e6ca77', 'tenant_id': '95de88f6d26e4420bc466ba67668171f', 'mac_address': 'fa:16:3e:de:39:0c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ovnmeta-fb218033-3d98-4065-b336-c595d5e6ca77', 'device_owner': 'network:distributed', 'standard_attr_id': 14, 'fixed_ips': [{'subnet_id': '5508b790-cc91-4b59-8d30-81ef4480e470', 'ip_address': '10.0.0.2'}, {'subnet_id': '799ded51-0b75-4f67-94e9-0a7ea3c3f3d6', 'ip_address': 'fd12:3562:78f7:0:f816:3eff:fede:390c'}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2024-05-28T12:43:43Z', 'updated_at': '2024-05-28T12:43:49Z', 'revision_number': 3, 'project_id': '95de88f6d26e4420bc466ba67668171f'}) host (original host ) vif type unbound (original vif type unbound) vif details {} (original vif details {}) binding levels None (original binding levels None) on network {'id': 'fb218033-3d98-4065-b336-c595d5e6ca77', 'name': 'private', 'tenant_id': '95de88f6d26e4420bc466ba67668171f', 'admin_state_up': True, 'mtu': 1442, 'status': 'ACTIVE', 'subnets': ['5508b790-cc91-4b59-8d30-81ef4480e470', '799ded51-0b75-4f67-94e9-0a7ea3c3f3d6'], 'standard_attr_id': 12, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'vlan_transparent': None, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2024-05-28T12:43:43Z', 'updated_at': '2024-05-28T12:43:49Z', 'revision_number': 3, 'project_id': '95de88f6d26e4420bc466ba67668171f', 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 30276} with segments to bind None May 28 12:43:49 l75lg1-v1 neutron-server[77619]: DEBUG neutron.tests.unit.plugins.ml2.drivers.mechanism_logger [None req-0563fb14-f85c-49cd-b593-66a4e77199c6 demo admin] update_port_precommit: May 28 12:43:49 l75lg1-v1 neutron-server[77619]: {{(pid=77619) _log_diff_call /opt/stack/neutron/neutron/tests/unit/plugins/ml2/drivers/mechanism_logger.py:59}} May 28 12:43:49 l75lg1-v1 neutron-server[77619]: DEBUG neutron_lib.callbacks.manager [None req-0563fb14-f85c-49cd-b593-66a4e77199c6 demo admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4166243', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8754903016533', 'neutron.services.ovn_l3.plugin.OVNL3RouterPlugin._port_update-8754901907784'] for port (f963b4ff-a496-409f-a783-967e97462265), after_update {{(pid=77619) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:43:49 l75lg1-v1 neutron-server[77619]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0563fb14-f85c-49cd-b593-66a4e77199c6 demo admin] Pushing event updated for resources: {'Port': ['ID=f963b4ff-a496-409f-a783-967e97462265,revision_number=3']} {{(pid=77619) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 28 12:43:49 l75lg1-v1 neutron-server[77619]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=f963b4ff-a496-409f-a783-967e97462265, resource={'id': 'f963b4ff-a496-409f-a783-967e97462265', 'name': '', 'network_id': 'fb218033-3d98-4065-b336-c595d5e6ca77', 'tenant_id': '95de88f6d26e4420bc466ba67668171f', 'mac_address': 'fa:16:3e:de:39:0c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ovnmeta-fb218033-3d98-4065-b336-c595d5e6ca77', 'device_owner': 'network:distributed', 'standard_attr_id': 14, 'fixed_ips': [{'subnet_id': '5508b790-cc91-4b59-8d30-81ef4480e470', 'ip_address': '10.0.0.2'}, {'subnet_id': '799ded51-0b75-4f67-94e9-0a7ea3c3f3d6', 'ip_address': 'fd12:3562:78f7:0:f816:3eff:fede:390c'}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2024-05-28T12:43:43Z', 'updated_at': '2024-05-28T12:43:49Z', 'revision_number': 3, 'project_id': '95de88f6d26e4420bc466ba67668171f', 'network': {'id': 'fb218033-3d98-4065-b336-c595d5e6ca77', 'name': 'private', 'tenant_id': '95de88f6d26e4420bc466ba67668171f', 'admin_state_up': True, 'mtu': 1442, 'status': 'ACTIVE', 'subnets': ['5508b790-cc91-4b59-8d30-81ef4480e470', '799ded51-0b75-4f67-94e9-0a7ea3c3f3d6'], 'standard_attr_id': 12, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'vlan_transparent': None, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2024-05-28T12:43:43Z', 'updated_at': '2024-05-28T12:43:49Z', 'revision_number': 3, 'project_id': '95de88f6d26e4420bc466ba67668171f', 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 30276}}, resource_type=ports, if_exists=True) {{(pid=77619) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:43:49 l75lg1-v1 neutron-server[77619]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLSwitchPortCommand(_result=None, lport=f963b4ff-a496-409f-a783-967e97462265, external_ids_update=None, columns={'external_ids': {'neutron:port_name': '', 'neutron:device_id': 'ovnmeta-fb218033-3d98-4065-b336-c595d5e6ca77', 'neutron:project_id': '95de88f6d26e4420bc466ba67668171f', 'neutron:cidrs': '10.0.0.2/26 fd12:3562:78f7:0:f816:3eff:fede:390c/64', 'neutron:device_owner': 'network:distributed', 'neutron:subnet_pool_addr_scope4': '', 'neutron:subnet_pool_addr_scope6': '', 'neutron:network_name': 'neutron-fb218033-3d98-4065-b336-c595d5e6ca77', 'neutron:security_group_ids': '', 'neutron:revision_number': '3', 'neutron:vnic_type': 'normal', 'neutron:port_capabilities': '', 'neutron:mtu': ''}, 'parent_name': [], 'tag': [], 'options': {}, 'enabled': True, 'port_security': [], 'dhcpv4_options': [], 'dhcpv6_options': [], 'type': 'localport', 'addresses': ['fa:16:3e:de:39:0c 10.0.0.2 fd12:3562:78f7:0:f816:3eff:fede:390c'], 'ha_chassis_group': []}, if_exists=False) {{(pid=77619) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:43:49 l75lg1-v1 neutron-server[77619]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): PgDelPortCommand(_result=None, port_group=neutron_pg_drop, lsp=['f963b4ff-a496-409f-a783-967e97462265'], if_exists=False) {{(pid=77619) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:43:49 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [-] Hash Ring: Node c89b3497-133e-4a5a-b67a-3310d2cb2485 (host: l75lg1-v1) handling event "update" for row d750d9b5-f0d8-4325-98ce-ea5e5a97b343 (table: Port_Binding) {{(pid=77619) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:43:49 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched UPDATE: PortBindingUpdatedEvent(events=('update',), table='Port_Binding', conditions=None, old_conditions=None), priority=20 to row=Port_Binding(parent_port=[], mac=['fa:16:3e:de:39:0c 10.0.0.2 fd12:3562:78f7:0:f816:3eff:fede:390c'], chassis=[], ha_chassis_group=[], options={}, type=localport, tag=[], requested_chassis=[], tunnel_key=1, up=[False], logical_port=f963b4ff-a496-409f-a783-967e97462265, gateway_chassis=[], encap=[], external_ids={'neutron:cidrs': '10.0.0.2/26 fd12:3562:78f7:0:f816:3eff:fede:390c/64', 'neutron:device_id': 'ovnmeta-fb218033-3d98-4065-b336-c595d5e6ca77', 'neutron:device_owner': 'network:distributed', 'neutron:mtu': '', 'neutron:network_name': 'neutron-fb218033-3d98-4065-b336-c595d5e6ca77', 'neutron:port_capabilities': '', 'neutron:port_name': '', 'neutron:project_id': '95de88f6d26e4420bc466ba67668171f', 'neutron:revision_number': '3', 'neutron:security_group_ids': '', 'neutron:subnet_pool_addr_scope4': '', 'neutron:subnet_pool_addr_scope6': '', 'neutron:vnic_type': 'normal'}, virtual_parent=[], nat_addresses=[], datapath=82fbda28-3c6c-4fa0-8506-e1ae5636f88a) old=Port_Binding(mac=['fa:16:3e:de:39:0c 10.0.0.2'], external_ids={'neutron:cidrs': '10.0.0.2/26', 'neutron:device_id': 'ovnmeta-fb218033-3d98-4065-b336-c595d5e6ca77', 'neutron:device_owner': 'network:distributed', 'neutron:mtu': '', 'neutron:network_name': 'neutron-fb218033-3d98-4065-b336-c595d5e6ca77', 'neutron:port_capabilities': '', 'neutron:port_name': '', 'neutron:project_id': '95de88f6d26e4420bc466ba67668171f', 'neutron:revision_number': '2', 'neutron:security_group_ids': '', 'neutron:subnet_pool_addr_scope4': '', 'neutron:subnet_pool_addr_scope6': '', 'neutron:vnic_type': 'normal'}) {{(pid=76818) matches /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} May 28 12:43:49 l75lg1-v1 neutron-server[77618]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [-] Hash Ring: Node 4c6fc793-7f5a-456f-b4d6-6e5bd97592f2 (host: l75lg1-v1) handling event "update" for row 7c9589a5-001a-4a6c-96a7-a764b2e01be9 (table: Logical_Switch_Port) {{(pid=77618) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:43:49 l75lg1-v1 neutron-ovn-metadata-agent[76818]: INFO neutron.agent.ovn.metadata.agent [-] Metadata Port f963b4ff-a496-409f-a783-967e97462265 in datapath fb218033-3d98-4065-b336-c595d5e6ca77 updated May 28 12:43:49 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata.agent [-] No valid VIF ports were found for network fb218033-3d98-4065-b336-c595d5e6ca77, tearing the namespace down if needed {{(pid=76818) _get_provision_params /opt/stack/neutron/neutron/agent/ovn/metadata/agent.py:720}} May 28 12:43:49 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae8776a8-c340-4a65-a407-35b60a8f6f2e]: (4, False) {{(pid=79043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} May 28 12:43:49 l75lg1-v1 neutron-server[77619]: INFO neutron.db.ovn_revision_numbers_db [None req-0563fb14-f85c-49cd-b593-66a4e77199c6 demo admin] Successfully bumped revision number for resource f963b4ff-a496-409f-a783-967e97462265 (type: ports) to 3 May 28 12:43:49 l75lg1-v1 neutron-server[77619]: INFO neutron.tests.unit.plugins.ml2.drivers.mechanism_logger [None req-0563fb14-f85c-49cd-b593-66a4e77199c6 demo admin] update_port_postcommit called with port settings {'id': 'f963b4ff-a496-409f-a783-967e97462265', 'name': '', 'network_id': 'fb218033-3d98-4065-b336-c595d5e6ca77', 'tenant_id': '95de88f6d26e4420bc466ba67668171f', 'mac_address': 'fa:16:3e:de:39:0c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ovnmeta-fb218033-3d98-4065-b336-c595d5e6ca77', 'device_owner': 'network:distributed', 'standard_attr_id': 14, 'fixed_ips': [{'subnet_id': '5508b790-cc91-4b59-8d30-81ef4480e470', 'ip_address': '10.0.0.2'}, {'subnet_id': '799ded51-0b75-4f67-94e9-0a7ea3c3f3d6', 'ip_address': 'fd12:3562:78f7:0:f816:3eff:fede:390c'}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2024-05-28T12:43:43Z', 'updated_at': '2024-05-28T12:43:49Z', 'revision_number': 3, 'project_id': '95de88f6d26e4420bc466ba67668171f'} (original settings {'id': 'f963b4ff-a496-409f-a783-967e97462265', 'name': '', 'network_id': 'fb218033-3d98-4065-b336-c595d5e6ca77', 'tenant_id': '95de88f6d26e4420bc466ba67668171f', 'mac_address': 'fa:16:3e:de:39:0c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ovnmeta-fb218033-3d98-4065-b336-c595d5e6ca77', 'device_owner': 'network:distributed', 'standard_attr_id': 14, 'fixed_ips': [{'subnet_id': '5508b790-cc91-4b59-8d30-81ef4480e470', 'ip_address': '10.0.0.2'}, {'subnet_id': '799ded51-0b75-4f67-94e9-0a7ea3c3f3d6', 'ip_address': 'fd12:3562:78f7:0:f816:3eff:fede:390c'}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2024-05-28T12:43:43Z', 'updated_at': '2024-05-28T12:43:49Z', 'revision_number': 3, 'project_id': '95de88f6d26e4420bc466ba67668171f'}) host (original host ) vif type unbound (original vif type unbound) vif details {} (original vif details {}) binding levels None (original binding levels None) on network {'id': 'fb218033-3d98-4065-b336-c595d5e6ca77', 'name': 'private', 'tenant_id': '95de88f6d26e4420bc466ba67668171f', 'admin_state_up': True, 'mtu': 1442, 'status': 'ACTIVE', 'subnets': ['5508b790-cc91-4b59-8d30-81ef4480e470', '799ded51-0b75-4f67-94e9-0a7ea3c3f3d6'], 'standard_attr_id': 12, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'vlan_transparent': None, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2024-05-28T12:43:43Z', 'updated_at': '2024-05-28T12:43:49Z', 'revision_number': 3, 'project_id': '95de88f6d26e4420bc466ba67668171f', 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 30276} with segments to bind None May 28 12:43:49 l75lg1-v1 neutron-server[77619]: DEBUG neutron.tests.unit.plugins.ml2.drivers.mechanism_logger [None req-0563fb14-f85c-49cd-b593-66a4e77199c6 demo admin] update_port_postcommit: May 28 12:43:49 l75lg1-v1 neutron-server[77619]: {{(pid=77619) _log_diff_call /opt/stack/neutron/neutron/tests/unit/plugins/ml2/drivers/mechanism_logger.py:59}} May 28 12:43:49 l75lg1-v1 neutron-server[77619]: DEBUG neutron_lib.callbacks.manager [None req-0563fb14-f85c-49cd-b593-66a4e77199c6 demo admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4166501'] for subnet (799ded51-0b75-4f67-94e9-0a7ea3c3f3d6), after_create {{(pid=77619) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:43:49 l75lg1-v1 neutron-server[77619]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0563fb14-f85c-49cd-b593-66a4e77199c6 demo admin] Pushing event updated for resources: {'Subnet': ['ID=799ded51-0b75-4f67-94e9-0a7ea3c3f3d6,revision_number=0']} {{(pid=77619) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 28 12:43:49 l75lg1-v1 neutron-server[77619]: INFO neutron.db.ovn_revision_numbers_db [None req-0563fb14-f85c-49cd-b593-66a4e77199c6 demo admin] Successfully bumped revision number for resource 799ded51-0b75-4f67-94e9-0a7ea3c3f3d6 (type: subnets) to 0 May 28 12:43:49 l75lg1-v1 neutron-server[77619]: INFO neutron.tests.unit.plugins.ml2.drivers.mechanism_logger [None req-0563fb14-f85c-49cd-b593-66a4e77199c6 demo admin] create_subnet_postcommit called with subnet settings {'id': '799ded51-0b75-4f67-94e9-0a7ea3c3f3d6', 'name': 'ipv6-private-subnet', 'tenant_id': '95de88f6d26e4420bc466ba67668171f', 'network_id': 'fb218033-3d98-4065-b336-c595d5e6ca77', 'ip_version': 6, 'subnetpool_id': 'd213a9b3-11ed-4176-a121-2dc281d546ef', 'enable_dhcp': True, 'ipv6_ra_mode': 'slaac', 'ipv6_address_mode': 'slaac', 'standard_attr_id': 16, 'gateway_ip': 'fd12:3562:78f7::1', 'cidr': 'fd12:3562:78f7::/64', 'allocation_pools': [{'start': 'fd12:3562:78f7::2', 'end': 'fd12:3562:78f7:0:ffff:ffff:ffff:ffff'}], 'host_routes': [], 'dns_nameservers': [], 'shared': False, 'description': '', 'service_types': [], 'tags': [], 'created_at': '2024-05-28T12:43:49Z', 'updated_at': '2024-05-28T12:43:49Z', 'revision_number': 0, 'project_id': '95de88f6d26e4420bc466ba67668171f', 'network': {'id': 'fb218033-3d98-4065-b336-c595d5e6ca77', 'name': 'private', 'tenant_id': '95de88f6d26e4420bc466ba67668171f', 'admin_state_up': True, 'mtu': 1442, 'status': 'ACTIVE', 'subnets': ['5508b790-cc91-4b59-8d30-81ef4480e470', '799ded51-0b75-4f67-94e9-0a7ea3c3f3d6'], 'standard_attr_id': 12, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'vlan_transparent': None, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2024-05-28T12:43:43Z', 'updated_at': '2024-05-28T12:43:49Z', 'revision_number': 3, 'project_id': '95de88f6d26e4420bc466ba67668171f', 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 30276}} (original settings None) May 28 12:43:49 l75lg1-v1 neutron-server[77619]: DEBUG neutron.tests.unit.plugins.ml2.drivers.mechanism_logger [None req-0563fb14-f85c-49cd-b593-66a4e77199c6 demo admin] create_subnet_postcommit: May 28 12:43:49 l75lg1-v1 neutron-server[77619]: key[tenant_id], None -> 95de88f6d26e4420bc466ba67668171f May 28 12:43:49 l75lg1-v1 neutron-server[77619]: key[network_id], None -> fb218033-3d98-4065-b336-c595d5e6ca77 May 28 12:43:49 l75lg1-v1 neutron-server[77619]: key[revision_number], None -> 0 May 28 12:43:49 l75lg1-v1 neutron-server[77619]: key[project_id], None -> 95de88f6d26e4420bc466ba67668171f May 28 12:43:49 l75lg1-v1 neutron-server[77619]: key[id], None -> 799ded51-0b75-4f67-94e9-0a7ea3c3f3d6 May 28 12:43:49 l75lg1-v1 neutron-server[77619]: key[tags], None -> [] May 28 12:43:49 l75lg1-v1 neutron-server[77619]: key[created_at], None -> 2024-05-28T12:43:49Z May 28 12:43:49 l75lg1-v1 neutron-server[77619]: key[allocation_pools], None -> [{'start': 'fd12:3562:78f7::2', 'end': 'fd12:3562:78f7:0:ffff:ffff:ffff:ffff'}] May 28 12:43:49 l75lg1-v1 neutron-server[77619]: key[subnetpool_id], None -> d213a9b3-11ed-4176-a121-2dc281d546ef May 28 12:43:49 l75lg1-v1 neutron-server[77619]: key[host_routes], None -> [] May 28 12:43:49 l75lg1-v1 neutron-server[77619]: key[gateway_ip], None -> fd12:3562:78f7::1 May 28 12:43:49 l75lg1-v1 neutron-server[77619]: key[service_types], None -> [] May 28 12:43:49 l75lg1-v1 neutron-server[77619]: key[updated_at], None -> 2024-05-28T12:43:49Z May 28 12:43:49 l75lg1-v1 neutron-server[77619]: key[network], None -> {'id': 'fb218033-3d98-4065-b336-c595d5e6ca77', 'name': 'private', 'tenant_id': '95de88f6d26e4420bc466ba67668171f', 'admin_state_up': True, 'mtu': 1442, 'status': 'ACTIVE', 'subnets': ['5508b790-cc91-4b59-8d30-81ef4480e470', '799ded51-0b75-4f67-94e9-0a7ea3c3f3d6'], 'standard_attr_id': 12, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'vlan_transparent': None, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2024-05-28T12:43:43Z', 'updated_at': '2024-05-28T12:43:49Z', 'revision_number': 3, 'project_id': '95de88f6d26e4420bc466ba67668171f', 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 30276} May 28 12:43:49 l75lg1-v1 neutron-server[77619]: key[standard_attr_id], None -> 16 May 28 12:43:49 l75lg1-v1 neutron-server[77619]: key[ip_version], None -> 6 May 28 12:43:49 l75lg1-v1 neutron-server[77619]: key[cidr], None -> fd12:3562:78f7::/64 May 28 12:43:49 l75lg1-v1 neutron-server[77619]: key[dns_nameservers], None -> [] May 28 12:43:49 l75lg1-v1 neutron-server[77619]: key[ipv6_address_mode], None -> slaac May 28 12:43:49 l75lg1-v1 neutron-server[77619]: key[description], None -> May 28 12:43:49 l75lg1-v1 neutron-server[77619]: key[ipv6_ra_mode], None -> slaac May 28 12:43:49 l75lg1-v1 neutron-server[77619]: key[enable_dhcp], None -> True May 28 12:43:49 l75lg1-v1 neutron-server[77619]: key[shared], None -> False May 28 12:43:49 l75lg1-v1 neutron-server[77619]: key[name], None -> ipv6-private-subnet May 28 12:43:49 l75lg1-v1 neutron-server[77619]: {{(pid=77619) _log_diff_call /opt/stack/neutron/neutron/tests/unit/plugins/ml2/drivers/mechanism_logger.py:59}} May 28 12:43:49 l75lg1-v1 neutron-server[77619]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0563fb14-f85c-49cd-b593-66a4e77199c6 demo admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=77619) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:258}} May 28 12:43:49 l75lg1-v1 neutron-server[77619]: DEBUG neutron_lib.callbacks.manager [None req-0563fb14-f85c-49cd-b593-66a4e77199c6 demo admin] Publish callbacks [] for subnet (None), before_response {{(pid=77619) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:43:49 l75lg1-v1 neutron-server[77619]: INFO neutron.wsgi [None req-0563fb14-f85c-49cd-b593-66a4e77199c6 demo admin] 10.27.203.238 "POST /networking/v2.0/subnets HTTP/1.1" status: 201 len: 910 time: 0.8876207 May 28 12:43:50 l75lg1-v1 dstat.sh[49771]: 28-05 12:43:50| 9 2 87 3 0|2681M 6819M 267M 5931M| 11k 3698B| 0 3824k| 0 344 |3923 5871 |1.37 1.81 1.26|1.0 0 48| 0 0 | 0 2048M| 23 114 0 30 0 May 28 12:43:50 l75lg1-v1 neutron-server[77622]: DEBUG dbcounter [-] [77622] Writing DB stats neutron:SELECT=13,neutron:UPDATE=1 {{(pid=77622) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:43:50 l75lg1-v1 neutron-server[77622]: DEBUG dbcounter [-] [77622] Writing DB stats neutron:SELECT=18,neutron:INSERT=657,neutron:DELETE=1 {{(pid=77622) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:43:51 l75lg1-v1 dstat.sh[49771]: 28-05 12:43:51| 9 1 89 1 0|2725M 6776M 267M 5931M| 16k 172B| 0 684k| 0 48.0 |1483 1719 |1.37 1.81 1.26|1.0 0 1.0| 0 0 | 0 2048M| 23 116 0 30 0 May 28 12:43:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae95a79-20c2-4145-95c4-556fec6ef41b None None] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:43:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae95a79-20c2-4145-95c4-556fec6ef41b None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:43:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae95a79-20c2-4145-95c4-556fec6ef41b None None] PATH_INFO: `/` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:43:51 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 452/888] 10.27.203.238 () {58 vars in 1014 bytes} [Tue May 28 12:43:51 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:43:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6724235-bbff-4a7f-bb56-8b09b01bd035 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:43:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6724235-bbff-4a7f-bb56-8b09b01bd035 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:43:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6724235-bbff-4a7f-bb56-8b09b01bd035 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:43:51 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-b6724235-bbff-4a7f-bb56-8b09b01bd035 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:43:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-b6724235-bbff-4a7f-bb56-8b09b01bd035 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:43:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-b6724235-bbff-4a7f-bb56-8b09b01bd035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:43:51 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 437/889] 10.27.203.238 () {62 vars in 1111 bytes} [Tue May 28 12:43:51 2024] POST /identity/v3/auth/tokens => generated 3991 bytes in 24 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:43:51 l75lg1-v1 neutron-server[77618]: DEBUG neutron.wsgi [-] (77618) accepted ('10.27.203.238', 44582) {{(pid=77618) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 12:43:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae95a79-20c2-4145-95c4-556fec6ef41b None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:43:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae95a79-20c2-4145-95c4-556fec6ef41b None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:43:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d1f101-585a-4c88-84ab-9911106d5400 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef17047035e4b518fd5360a01f2da1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:43:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d1f101-585a-4c88-84ab-9911106d5400 service neutron] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:43:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d1f101-585a-4c88-84ab-9911106d5400 service neutron] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:43:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d1f101-585a-4c88-84ab-9911106d5400 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:43:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d1f101-585a-4c88-84ab-9911106d5400 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:43:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d1f101-585a-4c88-84ab-9911106d5400 service neutron] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:43:51 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 453/890] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 12:43:51 2024] GET /identity/v3/auth/tokens => generated 3991 bytes in 19 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 12:43:51 l75lg1-v1 neutron-server[77618]: DEBUG neutron.wsgi [None req-5558bc9b-ad24-46a5-8995-99c58f2dd547 admin admin] http://10.27.203.238:9696/networking/v2.0/extensions returned with HTTP 200 {{(pid=77618) __call__ /opt/stack/neutron/neutron/wsgi.py:730}} May 28 12:43:51 l75lg1-v1 neutron-server[77618]: INFO neutron.wsgi [None req-5558bc9b-ad24-46a5-8995-99c58f2dd547 admin admin] 10.27.203.238 "GET /networking/v2.0/extensions HTTP/1.1" status: 200 len: 13594 time: 0.0284591 May 28 12:43:52 l75lg1-v1 dstat.sh[49771]: 28-05 12:43:52| 9 1 89 0 0|2690M 6810M 267M 5931M| 14k 4928B| 0 380k| 0 22.0 |1670 1962 |1.34 1.80 1.26|1.0 0 31| 0 0 | 0 2048M| 23 116 0 31 0 May 28 12:43:53 l75lg1-v1 dstat.sh[49771]: 28-05 12:43:53| 9 1 89 0 0|2735M 6766M 267M 5931M| 12k 0 | 0 3912k| 0 409 |1236 1442 |1.34 1.80 1.26|1.0 0 0| 0 0 | 0 2048M| 23 116 0 31 0 May 28 12:43:53 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0bd6b4-cd1a-4c3c-99d9-025a8a99ae55 None None] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:43:53 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0bd6b4-cd1a-4c3c-99d9-025a8a99ae55 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:43:53 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0bd6b4-cd1a-4c3c-99d9-025a8a99ae55 None None] PATH_INFO: `/` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:43:53 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 438/891] 10.27.203.238 () {58 vars in 1014 bytes} [Tue May 28 12:43:53 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:43:53 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3fc32a-b003-4e08-ad00-ac29475ed816 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:43:53 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3fc32a-b003-4e08-ad00-ac29475ed816 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:43:53 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3fc32a-b003-4e08-ad00-ac29475ed816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:43:53 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-ab3fc32a-b003-4e08-ad00-ac29475ed816 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:43:53 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-ab3fc32a-b003-4e08-ad00-ac29475ed816 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:43:53 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-ab3fc32a-b003-4e08-ad00-ac29475ed816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:43:53 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 454/892] 10.27.203.238 () {62 vars in 1111 bytes} [Tue May 28 12:43:53 2024] POST /identity/v3/auth/tokens => generated 3991 bytes in 22 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:43:53 l75lg1-v1 neutron-server[77618]: DEBUG neutron.wsgi [-] (77618) accepted ('10.27.203.238', 44584) {{(pid=77618) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 12:43:53 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0bd6b4-cd1a-4c3c-99d9-025a8a99ae55 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:43:53 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0bd6b4-cd1a-4c3c-99d9-025a8a99ae55 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:43:53 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf926eb7-da9f-4356-89ac-cc3ad0082cbc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef17047035e4b518fd5360a01f2da1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:43:53 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf926eb7-da9f-4356-89ac-cc3ad0082cbc service neutron] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:43:53 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf926eb7-da9f-4356-89ac-cc3ad0082cbc service neutron] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:43:53 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf926eb7-da9f-4356-89ac-cc3ad0082cbc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:43:53 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf926eb7-da9f-4356-89ac-cc3ad0082cbc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:43:53 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf926eb7-da9f-4356-89ac-cc3ad0082cbc service neutron] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:43:53 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 439/893] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 12:43:53 2024] GET /identity/v3/auth/tokens => generated 3991 bytes in 20 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 12:43:53 l75lg1-v1 neutron-server[77618]: DEBUG neutron.wsgi [None req-37387f94-f529-44e7-8f11-8be4eb61aa7c admin admin] http://10.27.203.238:9696/networking/v2.0/extensions returned with HTTP 200 {{(pid=77618) __call__ /opt/stack/neutron/neutron/wsgi.py:730}} May 28 12:43:53 l75lg1-v1 neutron-server[77618]: INFO neutron.wsgi [None req-37387f94-f529-44e7-8f11-8be4eb61aa7c admin admin] 10.27.203.238 "GET /networking/v2.0/extensions HTTP/1.1" status: 200 len: 13594 time: 0.0287893 May 28 12:43:54 l75lg1-v1 dstat.sh[49771]: 28-05 12:43:54| 9 1 89 1 0|2707M 6794M 267M 5931M| 11k 4682B| 0 1012k| 0 66.0 |2038 2551 |1.34 1.80 1.26|1.0 0 29| 0 0 | 0 2048M| 23 116 0 32 0 May 28 12:43:54 l75lg1-v1 neutron-server[77618]: DEBUG dbcounter [-] [77618] Writing DB stats neutron:SELECT=64,neutron:INSERT=10,neutron:UPDATE=4,neutron:DELETE=1 {{(pid=77618) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:43:54 l75lg1-v1 neutron-server[77618]: DEBUG dbcounter [-] [77618] Writing DB stats neutron:SELECT=68,neutron:INSERT=15,neutron:UPDATE=5,neutron:DELETE=1 {{(pid=77618) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:43:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c683a87f-ea53-41ab-b617-1bc431a675c6 None None] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:43:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c683a87f-ea53-41ab-b617-1bc431a675c6 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:43:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c683a87f-ea53-41ab-b617-1bc431a675c6 None None] PATH_INFO: `/` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:43:54 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 455/894] 10.27.203.238 () {58 vars in 1014 bytes} [Tue May 28 12:43:54 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:43:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109af9de-3543-4c34-925c-e2408e17af9d None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:43:55 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109af9de-3543-4c34-925c-e2408e17af9d None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:43:55 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109af9de-3543-4c34-925c-e2408e17af9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:43:55 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-109af9de-3543-4c34-925c-e2408e17af9d None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:43:55 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-109af9de-3543-4c34-925c-e2408e17af9d None None] MFA Rules not processed for user `2a1747ad86b04cc4aa7bc0b3e4077eaf`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:43:55 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-109af9de-3543-4c34-925c-e2408e17af9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:43:55 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 440/895] 10.27.203.238 () {62 vars in 1111 bytes} [Tue May 28 12:43:54 2024] POST /identity/v3/auth/tokens => generated 3932 bytes in 22 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:43:55 l75lg1-v1 neutron-server[77618]: DEBUG neutron.wsgi [-] (77618) accepted ('10.27.203.238', 44598) {{(pid=77618) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 12:43:55 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c683a87f-ea53-41ab-b617-1bc431a675c6 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:43:55 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c683a87f-ea53-41ab-b617-1bc431a675c6 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:43:55 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d795ed6-eb5d-4c56-85e0-7f27e3086590 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef17047035e4b518fd5360a01f2da1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:43:55 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d795ed6-eb5d-4c56-85e0-7f27e3086590 service neutron] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:43:55 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d795ed6-eb5d-4c56-85e0-7f27e3086590 service neutron] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:43:55 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d795ed6-eb5d-4c56-85e0-7f27e3086590 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:43:55 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d795ed6-eb5d-4c56-85e0-7f27e3086590 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:43:55 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d795ed6-eb5d-4c56-85e0-7f27e3086590 service neutron] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:43:55 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 456/896] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 12:43:55 2024] GET /identity/v3/auth/tokens => generated 3932 bytes in 19 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 12:43:55 l75lg1-v1 neutron-server[77618]: DEBUG neutron.api.v2.base [None req-07fa2017-fb8f-4fa6-a5e0-30f4993a492f demo demo] Request body: {'router': {'name': 'router1', 'admin_state_up': True}} {{(pid=77618) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:734}} May 28 12:43:55 l75lg1-v1 neutron-server[77618]: WARNING neutron_lib.context [None req-07fa2017-fb8f-4fa6-a5e0-30f4993a492f demo demo] Method 'is_advsvc' is deprecated since 2023.2 release (neutron-lib 3.8.0) and will be removed once support for the old RBAC API policies will be removed from Neutron. Please use method 'is_service_role' instead. May 28 12:43:55 l75lg1-v1 dstat.sh[49771]: 28-05 12:43:55| 10 1 89 0 0|2738M 6762M 267M 5931M| 15k 0 | 0 256k| 0 48.0 |1635 2049 |1.34 1.80 1.26|1.0 0 1.0| 0 0 | 0 2048M| 23 120 0 32 0 May 28 12:43:55 l75lg1-v1 neutron-server[77618]: DEBUG neutron_lib.callbacks.manager [None req-07fa2017-fb8f-4fa6-a5e0-30f4993a492f demo demo] Publish callbacks ['neutron.services.ovn_l3.service_providers.driver_controller.DriverController._check_router_request-2927'] for router (80c11046-4421-4321-813a-d46f0332997a), before_create {{(pid=77618) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:43:55 l75lg1-v1 neutron-server[77618]: DEBUG neutron_lib.callbacks.manager [None req-07fa2017-fb8f-4fa6-a5e0-30f4993a492f demo demo] Publish callbacks ['neutron.services.ovn_l3.service_providers.ovn.OVN_L3_HA_db_mixin._precommit_router_create-58039', 'neutron.services.ovn_l3.plugin.RouterAvailabilityZoneMixin._process_az_request-4166628', 'neutron.services.ovn_l3.plugin.ExtraGatewaysDbOnlyMixin._process_bfd_ecmp_create-12766', 'neutron.services.ovn_l3.service_providers.ovn.OvnDriver._process_router_create_precommit-58065', 'neutron.services.ovn_l3.service_providers.driver_controller.DriverController._set_router_provider-2918'] for router (80c11046-4421-4321-813a-d46f0332997a), precommit_create {{(pid=77618) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:43:55 l75lg1-v1 neutron-server[77618]: DEBUG neutron.db.ovn_revision_numbers_db [None req-07fa2017-fb8f-4fa6-a5e0-30f4993a492f demo demo] create_initial_revision uuid=80c11046-4421-4321-813a-d46f0332997a, type=routers, rev=-1 {{(pid=77618) create_initial_revision /opt/stack/neutron/neutron/db/ovn_revision_numbers_db.py:108}} May 28 12:43:55 l75lg1-v1 neutron-server[77618]: DEBUG neutron_lib.callbacks.manager [None req-07fa2017-fb8f-4fa6-a5e0-30f4993a492f demo demo] Publish callbacks [] for router_controller (80c11046-4421-4321-813a-d46f0332997a), precommit_add_association {{(pid=77618) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:43:55 l75lg1-v1 neutron-server[77618]: DEBUG neutron_lib.callbacks.manager [None req-07fa2017-fb8f-4fa6-a5e0-30f4993a492f demo demo] Publish callbacks ['neutron.services.ovn_l3.service_providers.ovn.OvnDriver._process_router_create-58074'] for router (80c11046-4421-4321-813a-d46f0332997a), after_create {{(pid=77618) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:43:55 l75lg1-v1 neutron-server[77618]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.extensions.qos [None req-07fa2017-fb8f-4fa6-a5e0-30f4993a492f demo demo] Starting OVNClientQosExtension May 28 12:43:55 l75lg1-v1 neutron-server[77618]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.extensions.qos [None req-07fa2017-fb8f-4fa6-a5e0-30f4993a492f demo demo] Router 80c11046-4421-4321-813a-d46f0332997a does not have ID or gateway assigned {{(pid=77618) update_router /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/extensions/qos.py:441}} May 28 12:43:55 l75lg1-v1 neutron-server[77618]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): LrAddCommand(_result=None, router=neutron-80c11046-4421-4321-813a-d46f0332997a, may_exist=True, columns={'external_ids': {'neutron:router_name': 'router1', 'neutron:revision_number': '1', 'neutron:availability_zone_hints': ''}, 'enabled': True, 'options': {'always_learn_from_arp_request': 'false', 'dynamic_neigh_routers': 'true', 'mac_binding_age_threshold': '0'}}) {{(pid=77618) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:43:55 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [-] Hash Ring: Node c89b3497-133e-4a5a-b67a-3310d2cb2485 (host: l75lg1-v1) handling event "create" for row 74f0f327-cc93-479c-856e-03f5c93a4345 (table: Logical_Router) {{(pid=77619) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:43:55 l75lg1-v1 neutron-server[77618]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [-] Hash Ring: Node 4c6fc793-7f5a-456f-b4d6-6e5bd97592f2 (host: l75lg1-v1) handling event "create" for row 60c632e1-b161-4c7e-9282-f3cf8f40846d (table: Datapath_Binding) {{(pid=77618) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:43:55 l75lg1-v1 neutron-server[77618]: INFO neutron.db.ovn_revision_numbers_db [None req-07fa2017-fb8f-4fa6-a5e0-30f4993a492f demo demo] Successfully bumped revision number for resource 80c11046-4421-4321-813a-d46f0332997a (type: routers) to 1 May 28 12:43:55 l75lg1-v1 neutron-server[77618]: DEBUG neutron_lib.callbacks.manager [None req-07fa2017-fb8f-4fa6-a5e0-30f4993a492f demo demo] Publish callbacks [] for router (None), before_response {{(pid=77618) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:43:55 l75lg1-v1 neutron-server[77618]: INFO neutron.wsgi [None req-07fa2017-fb8f-4fa6-a5e0-30f4993a492f demo demo] 10.27.203.238 "POST /networking/v2.0/routers HTTP/1.1" status: 201 len: 770 time: 0.4737856 May 28 12:43:56 l75lg1-v1 dstat.sh[49771]: 28-05 12:43:56| 9 2 88 2 0|2713M 6788M 267M 5931M| 12k 3632B| 0 1752k| 0 174 |2755 3855 |1.34 1.80 1.26|1.0 0 46| 0 0 | 0 2048M| 23 118 0 33 0 May 28 12:43:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e282937-6342-4edc-86fb-de5b5545a0a0 None None] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:43:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e282937-6342-4edc-86fb-de5b5545a0a0 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:43:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e282937-6342-4edc-86fb-de5b5545a0a0 None None] PATH_INFO: `/` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:43:57 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 441/897] 10.27.203.238 () {58 vars in 1014 bytes} [Tue May 28 12:43:57 2024] GET /identity => generated 272 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:43:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e75daf7-56df-4d14-bcec-4eaab24d47b4 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:43:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e75daf7-56df-4d14-bcec-4eaab24d47b4 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:43:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e75daf7-56df-4d14-bcec-4eaab24d47b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:43:57 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-7e75daf7-56df-4d14-bcec-4eaab24d47b4 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:43:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-7e75daf7-56df-4d14-bcec-4eaab24d47b4 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:43:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-7e75daf7-56df-4d14-bcec-4eaab24d47b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:43:57 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 457/898] 10.27.203.238 () {62 vars in 1111 bytes} [Tue May 28 12:43:57 2024] POST /identity/v3/auth/tokens => generated 3991 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:43:57 l75lg1-v1 dstat.sh[49771]: 28-05 12:43:57| 10 1 89 0 0|2750M 6750M 267M 5931M|9689B 42B| 0 108k| 0 12.0 |1537 2068 |1.32 1.78 1.25|2.0 0 0| 0 0 | 0 2048M| 23 118 0 33 0 May 28 12:43:57 l75lg1-v1 neutron-server[77618]: DEBUG neutron.wsgi [-] (77618) accepted ('10.27.203.238', 44614) {{(pid=77618) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 12:43:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e282937-6342-4edc-86fb-de5b5545a0a0 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:43:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e282937-6342-4edc-86fb-de5b5545a0a0 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:43:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bf94ca-d5f7-4fdf-8ad4-60565f6c2fb9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef17047035e4b518fd5360a01f2da1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:43:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bf94ca-d5f7-4fdf-8ad4-60565f6c2fb9 service neutron] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:43:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bf94ca-d5f7-4fdf-8ad4-60565f6c2fb9 service neutron] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:43:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bf94ca-d5f7-4fdf-8ad4-60565f6c2fb9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:43:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bf94ca-d5f7-4fdf-8ad4-60565f6c2fb9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:43:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bf94ca-d5f7-4fdf-8ad4-60565f6c2fb9 service neutron] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:43:57 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 442/899] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 12:43:57 2024] GET /identity/v3/auth/tokens => generated 3991 bytes in 21 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 12:43:57 l75lg1-v1 neutron-server[77618]: DEBUG neutron.wsgi [None req-772a97d2-af7e-459c-90e8-106787aa7f21 admin admin] http://10.27.203.238:9696/networking/v2.0/extensions returned with HTTP 200 {{(pid=77618) __call__ /opt/stack/neutron/neutron/wsgi.py:730}} May 28 12:43:57 l75lg1-v1 neutron-server[77618]: INFO neutron.wsgi [None req-772a97d2-af7e-459c-90e8-106787aa7f21 admin admin] 10.27.203.238 "GET /networking/v2.0/extensions HTTP/1.1" status: 200 len: 13594 time: 0.0295477 May 28 12:43:58 l75lg1-v1 dstat.sh[49771]: 28-05 12:43:58| 9 1 89 0 0|2725M 6776M 267M 5931M| 14k 5172B| 0 80k| 0 8.00 |1587 1839 |1.32 1.78 1.25|2.0 0 33| 0 0 | 0 2048M| 23 118 0 34 0 May 28 12:43:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07d17f4-eb8f-484a-bea1-7987861bab2d None None] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:43:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07d17f4-eb8f-484a-bea1-7987861bab2d None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:43:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07d17f4-eb8f-484a-bea1-7987861bab2d None None] PATH_INFO: `/` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:43:58 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 458/900] 10.27.203.238 () {58 vars in 1014 bytes} [Tue May 28 12:43:58 2024] GET /identity => generated 272 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:43:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dcba85-1a21-425e-a2e2-41fd944c7ef1 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:43:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dcba85-1a21-425e-a2e2-41fd944c7ef1 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:43:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dcba85-1a21-425e-a2e2-41fd944c7ef1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:43:58 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-b5dcba85-1a21-425e-a2e2-41fd944c7ef1 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:43:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-b5dcba85-1a21-425e-a2e2-41fd944c7ef1 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:43:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-b5dcba85-1a21-425e-a2e2-41fd944c7ef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:43:58 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 443/901] 10.27.203.238 () {62 vars in 1111 bytes} [Tue May 28 12:43:58 2024] POST /identity/v3/auth/tokens => generated 3991 bytes in 23 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:43:59 l75lg1-v1 neutron-server[77619]: DEBUG neutron.wsgi [-] (77619) accepted ('10.27.203.238', 44618) {{(pid=77619) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 12:43:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07d17f4-eb8f-484a-bea1-7987861bab2d None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:43:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07d17f4-eb8f-484a-bea1-7987861bab2d None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:43:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d86fe0-90cf-4e53-8441-54ef9aefa89b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef17047035e4b518fd5360a01f2da1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:43:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d86fe0-90cf-4e53-8441-54ef9aefa89b service neutron] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:43:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d86fe0-90cf-4e53-8441-54ef9aefa89b service neutron] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:43:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d86fe0-90cf-4e53-8441-54ef9aefa89b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:43:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d86fe0-90cf-4e53-8441-54ef9aefa89b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:43:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d86fe0-90cf-4e53-8441-54ef9aefa89b service neutron] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:43:59 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 459/902] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 12:43:59 2024] GET /identity/v3/auth/tokens => generated 3991 bytes in 29 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 12:43:59 l75lg1-v1 neutron-server[77619]: DEBUG neutron.api.v2.base [None req-46e0b09e-c795-440f-9f9a-038aa56ff201 admin admin] Request body: {'network': {'provider:physical_network': 'public', 'is_default': True, 'name': 'public', 'provider:network_type': 'flat', 'router:external': True, 'admin_state_up': True}} {{(pid=77619) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:734}} May 28 12:43:59 l75lg1-v1 neutron-server[77619]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-46e0b09e-c795-440f-9f9a-038aa56ff201 admin admin] Made reservation on behalf of ea8d517cde1d40bb82c97e080ce071f7 for: {'network': 1} {{(pid=77619) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 28 12:43:59 l75lg1-v1 neutron-server[77619]: DEBUG neutron_lib.callbacks.manager [None req-46e0b09e-c795-440f-9f9a-038aa56ff201 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1015114'] for network (None), before_create {{(pid=77619) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:43:59 l75lg1-v1 neutron-server[77619]: DEBUG neutron_lib.callbacks.manager [None req-46e0b09e-c795-440f-9f9a-038aa56ff201 admin admin] Publish callbacks [] for security_group (None), before_create {{(pid=77619) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:43:59 l75lg1-v1 dstat.sh[49771]: 28-05 12:43:59| 9 1 89 0 0|2750M 6750M 267M 5931M|9845B 0 | 0 336k| 0 66.0 |1919 2778 |1.32 1.78 1.25|1.0 0 0| 0 0 | 0 2048M| 23 120 0 34 0 May 28 12:43:59 l75lg1-v1 neutron-server[77619]: DEBUG neutron_lib.callbacks.manager [None req-46e0b09e-c795-440f-9f9a-038aa56ff201 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver.OVNMechanismDriver._create_security_group_precommit-4094378'] for security_group (1aa6cd8a-8feb-428c-97b8-68e7710c31e2), precommit_create {{(pid=77619) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:43:59 l75lg1-v1 neutron-server[77619]: DEBUG neutron.db.ovn_revision_numbers_db [None req-46e0b09e-c795-440f-9f9a-038aa56ff201 admin admin] create_initial_revision uuid=1aa6cd8a-8feb-428c-97b8-68e7710c31e2, type=security_groups, rev=-1 {{(pid=77619) create_initial_revision /opt/stack/neutron/neutron/db/ovn_revision_numbers_db.py:108}} May 28 12:43:59 l75lg1-v1 neutron-server[77619]: DEBUG neutron_lib.callbacks.manager [None req-46e0b09e-c795-440f-9f9a-038aa56ff201 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver.OVNMechanismDriver._create_security_group-4094389', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4165855'] for security_group (1aa6cd8a-8feb-428c-97b8-68e7710c31e2), after_create {{(pid=77619) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:43:59 l75lg1-v1 neutron-server[77619]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): PgAddCommand(_result=None, name=pg_1aa6cd8a_8feb_428c_97b8_68e7710c31e2, may_exist=False, columns={'acls': [], 'external_ids': {'neutron:security_group_id': '1aa6cd8a-8feb-428c-97b8-68e7710c31e2'}}) {{(pid=77619) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:43:59 l75lg1-v1 neutron-server[77619]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): PgAclAddCommand(_result=None, entity=pg_1aa6cd8a_8feb_428c_97b8_68e7710c31e2, direction=to-lport, priority=1002, match=outport == @pg_1aa6cd8a_8feb_428c_97b8_68e7710c31e2 && ip6 && ip6.src == $pg_1aa6cd8a_8feb_428c_97b8_68e7710c31e2_ip6, action=allow-related, log=False, may_exist=True, severity=[], name=[], meter=None, external_ids={'neutron:security_group_rule_id': '0c78524c-04fd-4e60-9843-962f251ab589'}) {{(pid=77619) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:43:59 l75lg1-v1 neutron-server[77619]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): PgAclAddCommand(_result=None, entity=pg_1aa6cd8a_8feb_428c_97b8_68e7710c31e2, direction=from-lport, priority=1002, match=inport == @pg_1aa6cd8a_8feb_428c_97b8_68e7710c31e2 && ip4, action=allow-related, log=False, may_exist=True, severity=[], name=[], meter=None, external_ids={'neutron:security_group_rule_id': '4758bd20-91ec-4cf1-aad2-4a7ae6d475e2'}) {{(pid=77619) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:43:59 l75lg1-v1 neutron-server[77619]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=3): PgAclAddCommand(_result=None, entity=pg_1aa6cd8a_8feb_428c_97b8_68e7710c31e2, direction=from-lport, priority=1002, match=inport == @pg_1aa6cd8a_8feb_428c_97b8_68e7710c31e2 && ip6, action=allow-related, log=False, may_exist=True, severity=[], name=[], meter=None, external_ids={'neutron:security_group_rule_id': '70262ec5-488a-4995-8e49-399dc8b88520'}) {{(pid=77619) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:43:59 l75lg1-v1 neutron-server[77619]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=4): PgAclAddCommand(_result=None, entity=pg_1aa6cd8a_8feb_428c_97b8_68e7710c31e2, direction=to-lport, priority=1002, match=outport == @pg_1aa6cd8a_8feb_428c_97b8_68e7710c31e2 && ip4 && ip4.src == $pg_1aa6cd8a_8feb_428c_97b8_68e7710c31e2_ip4, action=allow-related, log=False, may_exist=True, severity=[], name=[], meter=None, external_ids={'neutron:security_group_rule_id': 'bc7f00e5-23d2-4e7f-9213-99e98f6085c3'}) {{(pid=77619) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:43:59 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [-] Hash Ring: Node c89b3497-133e-4a5a-b67a-3310d2cb2485 (host: l75lg1-v1) handling event "create" for row e6380e2f-4fbf-40fc-aa02-2d86b7c36fde (table: ACL) {{(pid=77619) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:43:59 l75lg1-v1 neutron-server[77618]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [-] Hash Ring: Node 4c6fc793-7f5a-456f-b4d6-6e5bd97592f2 (host: l75lg1-v1) handling event "create" for row 2aec6e0f-a79c-44a8-99f5-ac1a45a3d250 (table: ACL) {{(pid=77618) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:43:59 l75lg1-v1 neutron-server[77618]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [-] Hash Ring: Node 4c6fc793-7f5a-456f-b4d6-6e5bd97592f2 (host: l75lg1-v1) handling event "create" for row 885ed49d-0800-4eb4-9e32-09471c267ad6 (table: ACL) {{(pid=77618) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:43:59 l75lg1-v1 neutron-server[77618]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [-] Hash Ring: Node 4c6fc793-7f5a-456f-b4d6-6e5bd97592f2 (host: l75lg1-v1) handling event "create" for row a3dda76e-afaa-4574-a235-dc95170fe76b (table: ACL) {{(pid=77618) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:43:59 l75lg1-v1 neutron-server[77618]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [-] Hash Ring: Node 4c6fc793-7f5a-456f-b4d6-6e5bd97592f2 (host: l75lg1-v1) handling event "create" for row de3d148a-0802-42c1-883e-8ef1808bb4f1 (table: Port_Group) {{(pid=77618) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:43:59 l75lg1-v1 neutron-server[77619]: INFO neutron.db.ovn_revision_numbers_db [None req-46e0b09e-c795-440f-9f9a-038aa56ff201 admin admin] Successfully bumped revision number for resource 1aa6cd8a-8feb-428c-97b8-68e7710c31e2 (type: security_groups) to 1 May 28 12:43:59 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.drivers.type_flat [None req-46e0b09e-c795-440f-9f9a-038aa56ff201 admin admin] Reserving flat network on physical network public {{(pid=77619) reserve_provider_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_flat.py:100}} May 28 12:43:59 l75lg1-v1 neutron-server[77619]: DEBUG neutron_lib.callbacks.manager [None req-46e0b09e-c795-440f-9f9a-038aa56ff201 admin admin] Publish callbacks ['neutron.services.segments.db._add_segment_host_mapping_for_segment-8754903005233', 'neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-910805'] for segment (3385f5f9-bbb0-40f0-9631-6fb158c3207c), precommit_create {{(pid=77619) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:43:59 l75lg1-v1 neutron-server[77619]: DEBUG neutron_lib.callbacks.manager [None req-46e0b09e-c795-440f-9f9a-038aa56ff201 admin admin] Unsubscribe: segment precommit_create {{(pid=77619) unsubscribe /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:90}} May 28 12:43:59 l75lg1-v1 neutron-server[77619]: INFO neutron.db.segments_db [None req-46e0b09e-c795-440f-9f9a-038aa56ff201 admin admin] Added segment 3385f5f9-bbb0-40f0-9631-6fb158c3207c of type flat for network 5066e001-05ee-4812-ba7f-98a035d8bd0a May 28 12:43:59 l75lg1-v1 neutron-server[77619]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-46e0b09e-c795-440f-9f9a-038aa56ff201 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1aa6cd8a-8feb-428c-97b8-68e7710c31e2,revision_number=1']} {{(pid=77619) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 28 12:43:59 l75lg1-v1 neutron-server[77619]: DEBUG neutron_lib.callbacks.manager [None req-46e0b09e-c795-440f-9f9a-038aa56ff201 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8754901908252'] for network (5066e001-05ee-4812-ba7f-98a035d8bd0a), precommit_create {{(pid=77619) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:43:59 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver [None req-46e0b09e-c795-440f-9f9a-038aa56ff201 admin admin] Validating network segment with type flat, segmentation ID None, physical network public {{(pid=77619) _validate_network_segments /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/mech_driver.py:520}} May 28 12:43:59 l75lg1-v1 neutron-server[77619]: DEBUG neutron.db.ovn_revision_numbers_db [None req-46e0b09e-c795-440f-9f9a-038aa56ff201 admin admin] create_initial_revision uuid=5066e001-05ee-4812-ba7f-98a035d8bd0a, type=networks, rev=-1 {{(pid=77619) create_initial_revision /opt/stack/neutron/neutron/db/ovn_revision_numbers_db.py:108}} May 28 12:43:59 l75lg1-v1 neutron-server[77619]: INFO neutron.tests.unit.plugins.ml2.drivers.mechanism_logger [None req-46e0b09e-c795-440f-9f9a-038aa56ff201 admin admin] create_network_precommit called with network settings {'id': '5066e001-05ee-4812-ba7f-98a035d8bd0a', 'name': 'public', 'tenant_id': 'ea8d517cde1d40bb82c97e080ce071f7', 'admin_state_up': True, 'mtu': 1500, 'status': 'ACTIVE', 'subnets': [], 'standard_attr_id': 23, 'shared': False, 'project_id': 'ea8d517cde1d40bb82c97e080ce071f7', 'port_security_enabled': True, 'router:external': True, 'provider:network_type': 'flat', 'provider:physical_network': 'public', 'provider:segmentation_id': None, 'is_default': True, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'vlan_transparent': None, 'description': '', 'tags': [], 'created_at': '2024-05-28T12:43:59Z', 'updated_at': '2024-05-28T12:43:59Z', 'revision_number': 1} (original settings None) and network segments [{'id': '3385f5f9-bbb0-40f0-9631-6fb158c3207c', 'network_type': 'flat', 'physical_network': 'public', 'segmentation_id': None, 'network_id': '5066e001-05ee-4812-ba7f-98a035d8bd0a'}] May 28 12:43:59 l75lg1-v1 neutron-server[77619]: DEBUG neutron.tests.unit.plugins.ml2.drivers.mechanism_logger [None req-46e0b09e-c795-440f-9f9a-038aa56ff201 admin admin] create_network_precommit: May 28 12:43:59 l75lg1-v1 neutron-server[77619]: key[tenant_id], None -> ea8d517cde1d40bb82c97e080ce071f7 May 28 12:43:59 l75lg1-v1 neutron-server[77619]: key[provider:network_type], None -> flat May 28 12:43:59 l75lg1-v1 neutron-server[77619]: key[project_id], None -> ea8d517cde1d40bb82c97e080ce071f7 May 28 12:43:59 l75lg1-v1 neutron-server[77619]: key[ipv6_address_scope], None -> None May 28 12:43:59 l75lg1-v1 neutron-server[77619]: key[subnets], None -> [] May 28 12:43:59 l75lg1-v1 neutron-server[77619]: key[admin_state_up], None -> True May 28 12:43:59 l75lg1-v1 neutron-server[77619]: key[id], None -> 5066e001-05ee-4812-ba7f-98a035d8bd0a May 28 12:43:59 l75lg1-v1 neutron-server[77619]: key[ipv4_address_scope], None -> None May 28 12:43:59 l75lg1-v1 neutron-server[77619]: key[tags], None -> [] May 28 12:43:59 l75lg1-v1 neutron-server[77619]: key[created_at], None -> 2024-05-28T12:43:59Z May 28 12:43:59 l75lg1-v1 neutron-server[77619]: key[status], None -> ACTIVE May 28 12:43:59 l75lg1-v1 neutron-server[77619]: key[is_default], None -> True May 28 12:43:59 l75lg1-v1 neutron-server[77619]: key[port_security_enabled], None -> True May 28 12:43:59 l75lg1-v1 neutron-server[77619]: key[vlan_transparent], None -> None May 28 12:43:59 l75lg1-v1 neutron-server[77619]: key[updated_at], None -> 2024-05-28T12:43:59Z May 28 12:43:59 l75lg1-v1 neutron-server[77619]: key[standard_attr_id], None -> 23 May 28 12:43:59 l75lg1-v1 neutron-server[77619]: key[availability_zone_hints], None -> [] May 28 12:43:59 l75lg1-v1 neutron-server[77619]: key[provider:physical_network], None -> public May 28 12:43:59 l75lg1-v1 neutron-server[77619]: key[shared], None -> False May 28 12:43:59 l75lg1-v1 neutron-server[77619]: key[mtu], None -> 1500 May 28 12:43:59 l75lg1-v1 neutron-server[77619]: key[provider:segmentation_id], None -> None May 28 12:43:59 l75lg1-v1 neutron-server[77619]: key[description], None -> May 28 12:43:59 l75lg1-v1 neutron-server[77619]: key[availability_zones], None -> [] May 28 12:43:59 l75lg1-v1 neutron-server[77619]: key[revision_number], None -> 1 May 28 12:43:59 l75lg1-v1 neutron-server[77619]: key[router:external], None -> True May 28 12:43:59 l75lg1-v1 neutron-server[77619]: key[name], None -> public May 28 12:43:59 l75lg1-v1 neutron-server[77619]: {{(pid=77619) _log_diff_call /opt/stack/neutron/neutron/tests/unit/plugins/ml2/drivers/mechanism_logger.py:59}} May 28 12:43:59 l75lg1-v1 neutron-server[77619]: DEBUG neutron_lib.callbacks.manager [None req-46e0b09e-c795-440f-9f9a-038aa56ff201 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4165676'] for network (5066e001-05ee-4812-ba7f-98a035d8bd0a), after_create {{(pid=77619) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:43:59 l75lg1-v1 neutron-server[77619]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): LsAddCommand(_result=None, switch=neutron-5066e001-05ee-4812-ba7f-98a035d8bd0a, columns={'external_ids': {'neutron:network_name': 'public', 'neutron:mtu': '1500', 'neutron:revision_number': '1', 'neutron:availability_zone_hints': '', 'neutron:provnet-network-type': 'flat'}, 'other_config': {'mcast_snoop': 'false', 'mcast_flood_unregistered': 'false', 'vlan-passthru': 'false', 'fdb_age_threshold': '0'}}, may_exist=True) {{(pid=77619) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:43:59 l75lg1-v1 neutron-server[77619]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): AddLSwitchPortCommand(_result=None, lport=provnet-3385f5f9-bbb0-40f0-9631-6fb158c3207c, lswitch=neutron-5066e001-05ee-4812-ba7f-98a035d8bd0a, may_exist=True, columns={'addresses': ['unknown'], 'external_ids': {}, 'type': 'localnet', 'tag': None, 'options': {'network_name': 'public', 'mcast_flood_reports': 'true', 'mcast_flood': 'false', 'localnet_learn_fdb': 'false'}}) {{(pid=77619) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:43:59 l75lg1-v1 neutron-server[77618]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [-] Hash Ring: Node 4c6fc793-7f5a-456f-b4d6-6e5bd97592f2 (host: l75lg1-v1) handling event "create" for row b946fae3-ebd4-42d6-9336-c908375c2ee1 (table: Logical_Switch) {{(pid=77618) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:43:59 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [-] Hash Ring: Node c89b3497-133e-4a5a-b67a-3310d2cb2485 (host: l75lg1-v1) handling event "create" for row f1326100-74df-4ed7-b42e-30bf518dff76 (table: Logical_Switch_Port) {{(pid=77619) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:43:59 l75lg1-v1 neutron-server[77618]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [-] Hash Ring: Node 4c6fc793-7f5a-456f-b4d6-6e5bd97592f2 (host: l75lg1-v1) handling event "create" for row 58b793cb-e5bb-4956-9d83-ffd124c51d8a (table: Port_Binding) {{(pid=77618) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:43:59 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [-] Hash Ring: Node c89b3497-133e-4a5a-b67a-3310d2cb2485 (host: l75lg1-v1) handling event "update" for row f1326100-74df-4ed7-b42e-30bf518dff76 (table: Logical_Switch_Port) {{(pid=77619) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:43:59 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [-] Hash Ring: Node c89b3497-133e-4a5a-b67a-3310d2cb2485 (host: l75lg1-v1) handling event "create" for row df7441eb-1367-4631-850f-90a9cd17f4ec (table: Datapath_Binding) {{(pid=77619) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:43:59 l75lg1-v1 neutron-server[77619]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-46e0b09e-c795-440f-9f9a-038aa56ff201 admin admin] Pushing event updated for resources: {'Network': ['ID=5066e001-05ee-4812-ba7f-98a035d8bd0a,revision_number=1']} {{(pid=77619) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 28 12:43:59 l75lg1-v1 neutron-server[77619]: INFO neutron.db.ovn_revision_numbers_db [None req-46e0b09e-c795-440f-9f9a-038aa56ff201 admin admin] Successfully bumped revision number for resource 5066e001-05ee-4812-ba7f-98a035d8bd0a (type: networks) to 1 May 28 12:43:59 l75lg1-v1 neutron-server[77619]: DEBUG neutron_lib.callbacks.manager [None req-46e0b09e-c795-440f-9f9a-038aa56ff201 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1015114'] for port (None), before_create {{(pid=77619) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:43:59 l75lg1-v1 neutron-server[77619]: DEBUG neutron_lib.callbacks.manager [None req-46e0b09e-c795-440f-9f9a-038aa56ff201 admin admin] Publish callbacks [] for port (4b319e96-703d-49df-9a05-48399db72a46), precommit_create {{(pid=77619) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:43:59 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver [None req-46e0b09e-c795-440f-9f9a-038aa56ff201 admin admin] No provisioning block for port 4b319e96-703d-49df-9a05-48399db72a46 since it does not have a host {{(pid=77619) _is_port_provisioning_required /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/mech_driver.py:720}} May 28 12:43:59 l75lg1-v1 neutron-server[77619]: DEBUG neutron.db.ovn_revision_numbers_db [None req-46e0b09e-c795-440f-9f9a-038aa56ff201 admin admin] create_initial_revision uuid=4b319e96-703d-49df-9a05-48399db72a46, type=ports, rev=-1 {{(pid=77619) create_initial_revision /opt/stack/neutron/neutron/db/ovn_revision_numbers_db.py:108}} May 28 12:43:59 l75lg1-v1 neutron-server[77619]: INFO neutron.tests.unit.plugins.ml2.drivers.mechanism_logger [None req-46e0b09e-c795-440f-9f9a-038aa56ff201 admin admin] create_port_precommit called with port settings {'id': '4b319e96-703d-49df-9a05-48399db72a46', 'name': '', 'network_id': '5066e001-05ee-4812-ba7f-98a035d8bd0a', 'tenant_id': 'ea8d517cde1d40bb82c97e080ce071f7', 'mac_address': 'fa:16:3e:92:4c:f9', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ovnmeta-5066e001-05ee-4812-ba7f-98a035d8bd0a', 'device_owner': 'network:distributed', 'standard_attr_id': 25, 'fixed_ips': [], 'project_id': 'ea8d517cde1d40bb82c97e080ce071f7', 'port_security_enabled': False, 'security_groups': [], 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'allowed_address_pairs': []} (original settings None) host (original host None) vif type unbound (original vif type None) vif details {} (original vif details None) binding levels None (original binding levels None) on network {'id': '5066e001-05ee-4812-ba7f-98a035d8bd0a', 'name': 'public', 'tenant_id': 'ea8d517cde1d40bb82c97e080ce071f7', 'admin_state_up': True, 'mtu': 1500, 'status': 'ACTIVE', 'subnets': [], 'standard_attr_id': 23, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': True, 'vlan_transparent': None, 'description': '', 'port_security_enabled': True, 'is_default': True, 'tags': [], 'created_at': '2024-05-28T12:43:59Z', 'updated_at': '2024-05-28T12:43:59Z', 'revision_number': 1, 'project_id': 'ea8d517cde1d40bb82c97e080ce071f7', 'provider:network_type': 'flat', 'provider:physical_network': 'public', 'provider:segmentation_id': None} with segments to bind None May 28 12:43:59 l75lg1-v1 neutron-server[77619]: DEBUG neutron.tests.unit.plugins.ml2.drivers.mechanism_logger [None req-46e0b09e-c795-440f-9f9a-038aa56ff201 admin admin] create_port_precommit: May 28 12:43:59 l75lg1-v1 neutron-server[77619]: key[tenant_id], None -> ea8d517cde1d40bb82c97e080ce071f7 May 28 12:43:59 l75lg1-v1 neutron-server[77619]: key[network_id], None -> 5066e001-05ee-4812-ba7f-98a035d8bd0a May 28 12:43:59 l75lg1-v1 neutron-server[77619]: key[allowed_address_pairs], None -> [] May 28 12:43:59 l75lg1-v1 neutron-server[77619]: key[binding:vif_type], None -> unbound May 28 12:43:59 l75lg1-v1 neutron-server[77619]: key[project_id], None -> ea8d517cde1d40bb82c97e080ce071f7 May 28 12:43:59 l75lg1-v1 neutron-server[77619]: key[admin_state_up], None -> True May 28 12:43:59 l75lg1-v1 neutron-server[77619]: key[id], None -> 4b319e96-703d-49df-9a05-48399db72a46 May 28 12:43:59 l75lg1-v1 neutron-server[77619]: key[security_groups], None -> [] May 28 12:43:59 l75lg1-v1 neutron-server[77619]: key[binding:vnic_type], None -> normal May 28 12:43:59 l75lg1-v1 neutron-server[77619]: key[name], None -> May 28 12:43:59 l75lg1-v1 neutron-server[77619]: key[status], None -> DOWN May 28 12:43:59 l75lg1-v1 neutron-server[77619]: key[binding:profile], None -> {} May 28 12:43:59 l75lg1-v1 neutron-server[77619]: key[port_security_enabled], None -> False May 28 12:43:59 l75lg1-v1 neutron-server[77619]: key[standard_attr_id], None -> 25 May 28 12:43:59 l75lg1-v1 neutron-server[77619]: key[device_owner], None -> network:distributed May 28 12:43:59 l75lg1-v1 neutron-server[77619]: key[device_id], None -> ovnmeta-5066e001-05ee-4812-ba7f-98a035d8bd0a May 28 12:43:59 l75lg1-v1 neutron-server[77619]: key[mac_address], None -> fa:16:3e:92:4c:f9 May 28 12:43:59 l75lg1-v1 neutron-server[77619]: key[binding:host_id], None -> May 28 12:43:59 l75lg1-v1 neutron-server[77619]: key[binding:vif_details], None -> {} May 28 12:43:59 l75lg1-v1 neutron-server[77619]: key[fixed_ips], None -> [] May 28 12:43:59 l75lg1-v1 neutron-server[77619]: {{(pid=77619) _log_diff_call /opt/stack/neutron/neutron/tests/unit/plugins/ml2/drivers/mechanism_logger.py:59}} May 28 12:43:59 l75lg1-v1 neutron-server[77619]: DEBUG neutron_lib.callbacks.manager [None req-46e0b09e-c795-440f-9f9a-038aa56ff201 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4166243'] for port (4b319e96-703d-49df-9a05-48399db72a46), after_create {{(pid=77619) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:43:59 l75lg1-v1 neutron-server[77619]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddLSwitchPortCommand(_result=None, lport=4b319e96-703d-49df-9a05-48399db72a46, lswitch=neutron-5066e001-05ee-4812-ba7f-98a035d8bd0a, may_exist=True, columns={'addresses': ['fa:16:3e:92:4c:f9'], 'external_ids': {'neutron:port_name': '', 'neutron:device_id': 'ovnmeta-5066e001-05ee-4812-ba7f-98a035d8bd0a', 'neutron:project_id': 'ea8d517cde1d40bb82c97e080ce071f7', 'neutron:cidrs': '', 'neutron:device_owner': 'network:distributed', 'neutron:subnet_pool_addr_scope4': '', 'neutron:subnet_pool_addr_scope6': '', 'neutron:network_name': 'neutron-5066e001-05ee-4812-ba7f-98a035d8bd0a', 'neutron:security_group_ids': '', 'neutron:revision_number': '1', 'neutron:vnic_type': 'normal', 'neutron:port_capabilities': '', 'neutron:mtu': ''}, 'parent_name': [], 'tag': [], 'enabled': True, 'options': {}, 'type': 'localport', 'port_security': [], 'dhcpv4_options': [], 'dhcpv6_options': []}) {{(pid=77619) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:43:59 l75lg1-v1 neutron-server[77619]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): QoSDelCommand(_result=None, switch=neutron-5066e001-05ee-4812-ba7f-98a035d8bd0a, conditions=[('direction', '=', 'to-lport'), ('priority', '=', 2002), ('match', '=', 'outport == "4b319e96-703d-49df-9a05-48399db72a46"')], if_exists=True) {{(pid=77619) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:43:59 l75lg1-v1 neutron-server[77619]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): UpdateLSwitchPortQosOptionsCommand(_result=None, lport=AddLSwitchPortCommand(_result=c5e13742-0901-4930-a118-d410fd59b7f2, lport=4b319e96-703d-49df-9a05-48399db72a46, lswitch=neutron-5066e001-05ee-4812-ba7f-98a035d8bd0a, may_exist=True, columns={'addresses': ['fa:16:3e:92:4c:f9'], 'external_ids': {'neutron:port_name': '', 'neutron:device_id': 'ovnmeta-5066e001-05ee-4812-ba7f-98a035d8bd0a', 'neutron:project_id': 'ea8d517cde1d40bb82c97e080ce071f7', 'neutron:cidrs': '', 'neutron:device_owner': 'network:distributed', 'neutron:subnet_pool_addr_scope4': '', 'neutron:subnet_pool_addr_scope6': '', 'neutron:network_name': 'neutron-5066e001-05ee-4812-ba7f-98a035d8bd0a', 'neutron:security_group_ids': '', 'neutron:revision_number': '1', 'neutron:vnic_type': 'normal', 'neutron:port_capabilities': '', 'neutron:mtu': ''}, 'parent_name': [], 'enabled': True, 'options': {}, 'type': 'localport', 'port_security': []}), if_exists=True, qos={'qos_min_rate': None}) {{(pid=77619) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:43:59 l75lg1-v1 neutron-server[77619]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=3): QoSDelCommand(_result=None, switch=neutron-5066e001-05ee-4812-ba7f-98a035d8bd0a, conditions=[('direction', '=', 'from-lport'), ('priority', '=', 2002), ('match', '=', 'inport == "4b319e96-703d-49df-9a05-48399db72a46"')], if_exists=True) {{(pid=77619) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:43:59 l75lg1-v1 neutron-server[77619]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=4): UpdateLSwitchPortQosOptionsCommand(_result=None, lport=AddLSwitchPortCommand(_result=c5e13742-0901-4930-a118-d410fd59b7f2, lport=4b319e96-703d-49df-9a05-48399db72a46, lswitch=neutron-5066e001-05ee-4812-ba7f-98a035d8bd0a, may_exist=True, columns={'addresses': ['fa:16:3e:92:4c:f9'], 'external_ids': {'neutron:port_name': '', 'neutron:device_id': 'ovnmeta-5066e001-05ee-4812-ba7f-98a035d8bd0a', 'neutron:project_id': 'ea8d517cde1d40bb82c97e080ce071f7', 'neutron:cidrs': '', 'neutron:device_owner': 'network:distributed', 'neutron:subnet_pool_addr_scope4': '', 'neutron:subnet_pool_addr_scope6': '', 'neutron:network_name': 'neutron-5066e001-05ee-4812-ba7f-98a035d8bd0a', 'neutron:security_group_ids': '', 'neutron:revision_number': '1', 'neutron:vnic_type': 'normal', 'neutron:port_capabilities': '', 'neutron:mtu': ''}, 'parent_name': [], 'enabled': True, 'options': {}, 'type': 'localport', 'port_security': []}), if_exists=True, qos={'qos_min_rate': None}) {{(pid=77619) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:43:59 l75lg1-v1 neutron-server[77618]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [-] Hash Ring: Node 4c6fc793-7f5a-456f-b4d6-6e5bd97592f2 (host: l75lg1-v1) handling event "update" for row b946fae3-ebd4-42d6-9336-c908375c2ee1 (table: Logical_Switch) {{(pid=77618) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:43:59 l75lg1-v1 neutron-server[77618]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [-] Hash Ring: Node 4c6fc793-7f5a-456f-b4d6-6e5bd97592f2 (host: l75lg1-v1) handling event "create" for row 9d26b6ad-27a7-4433-bb16-e6ddfdeda204 (table: Logical_Switch_Port) {{(pid=77618) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:43:59 l75lg1-v1 neutron-server[77618]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [-] Hash Ring: Node 4c6fc793-7f5a-456f-b4d6-6e5bd97592f2 (host: l75lg1-v1) handling event "update" for row 9d26b6ad-27a7-4433-bb16-e6ddfdeda204 (table: Logical_Switch_Port) {{(pid=77618) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:43:59 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [-] Hash Ring: Node c89b3497-133e-4a5a-b67a-3310d2cb2485 (host: l75lg1-v1) handling event "create" for row 6c7f8c7a-03c0-44b9-884d-55f1a96d4cdb (table: Port_Binding) {{(pid=77619) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:43:59 l75lg1-v1 neutron-server[77619]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-46e0b09e-c795-440f-9f9a-038aa56ff201 admin admin] Pushing event updated for resources: {'Port': ['ID=4b319e96-703d-49df-9a05-48399db72a46,revision_number=1']} {{(pid=77619) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 28 12:43:59 l75lg1-v1 neutron-server[77619]: INFO neutron.db.ovn_revision_numbers_db [None req-46e0b09e-c795-440f-9f9a-038aa56ff201 admin admin] Successfully bumped revision number for resource 4b319e96-703d-49df-9a05-48399db72a46 (type: ports) to 1 May 28 12:43:59 l75lg1-v1 neutron-server[77619]: INFO neutron.tests.unit.plugins.ml2.drivers.mechanism_logger [None req-46e0b09e-c795-440f-9f9a-038aa56ff201 admin admin] create_port_postcommit called with port settings {'id': '4b319e96-703d-49df-9a05-48399db72a46', 'name': '', 'network_id': '5066e001-05ee-4812-ba7f-98a035d8bd0a', 'tenant_id': 'ea8d517cde1d40bb82c97e080ce071f7', 'mac_address': 'fa:16:3e:92:4c:f9', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ovnmeta-5066e001-05ee-4812-ba7f-98a035d8bd0a', 'device_owner': 'network:distributed', 'standard_attr_id': 25, 'fixed_ips': [], 'project_id': 'ea8d517cde1d40bb82c97e080ce071f7', 'port_security_enabled': False, 'security_groups': [], 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'description': '', 'tags': [], 'created_at': '2024-05-28T12:43:59Z', 'updated_at': '2024-05-28T12:43:59Z', 'revision_number': 1, 'network': {'id': '5066e001-05ee-4812-ba7f-98a035d8bd0a', 'name': 'public', 'tenant_id': 'ea8d517cde1d40bb82c97e080ce071f7', 'admin_state_up': True, 'mtu': 1500, 'status': 'ACTIVE', 'subnets': [], 'standard_attr_id': 23, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': True, 'vlan_transparent': None, 'description': '', 'port_security_enabled': True, 'is_default': True, 'tags': [], 'created_at': '2024-05-28T12:43:59Z', 'updated_at': '2024-05-28T12:43:59Z', 'revision_number': 1, 'project_id': 'ea8d517cde1d40bb82c97e080ce071f7', 'provider:network_type': 'flat', 'provider:physical_network': 'public', 'provider:segmentation_id': None}} (original settings None) host (original host None) vif type unbound (original vif type None) vif details {} (original vif details None) binding levels None (original binding levels None) on network {'id': '5066e001-05ee-4812-ba7f-98a035d8bd0a', 'name': 'public', 'tenant_id': 'ea8d517cde1d40bb82c97e080ce071f7', 'admin_state_up': True, 'mtu': 1500, 'status': 'ACTIVE', 'subnets': [], 'standard_attr_id': 23, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': True, 'vlan_transparent': None, 'description': '', 'port_security_enabled': True, 'is_default': True, 'tags': [], 'created_at': '2024-05-28T12:43:59Z', 'updated_at': '2024-05-28T12:43:59Z', 'revision_number': 1, 'project_id': 'ea8d517cde1d40bb82c97e080ce071f7', 'provider:network_type': 'flat', 'provider:physical_network': 'public', 'provider:segmentation_id': None} with segments to bind None May 28 12:43:59 l75lg1-v1 neutron-server[77619]: DEBUG neutron.tests.unit.plugins.ml2.drivers.mechanism_logger [None req-46e0b09e-c795-440f-9f9a-038aa56ff201 admin admin] create_port_postcommit: May 28 12:43:59 l75lg1-v1 neutron-server[77619]: key[tenant_id], None -> ea8d517cde1d40bb82c97e080ce071f7 May 28 12:43:59 l75lg1-v1 neutron-server[77619]: key[network_id], None -> 5066e001-05ee-4812-ba7f-98a035d8bd0a May 28 12:43:59 l75lg1-v1 neutron-server[77619]: key[allowed_address_pairs], None -> [] May 28 12:43:59 l75lg1-v1 neutron-server[77619]: key[binding:vif_type], None -> unbound May 28 12:43:59 l75lg1-v1 neutron-server[77619]: key[project_id], None -> ea8d517cde1d40bb82c97e080ce071f7 May 28 12:43:59 l75lg1-v1 neutron-server[77619]: key[admin_state_up], None -> True May 28 12:43:59 l75lg1-v1 neutron-server[77619]: key[id], None -> 4b319e96-703d-49df-9a05-48399db72a46 May 28 12:43:59 l75lg1-v1 neutron-server[77619]: key[security_groups], None -> [] May 28 12:43:59 l75lg1-v1 neutron-server[77619]: key[extra_dhcp_opts], None -> [] May 28 12:43:59 l75lg1-v1 neutron-server[77619]: key[binding:vnic_type], None -> normal May 28 12:43:59 l75lg1-v1 neutron-server[77619]: key[tags], None -> [] May 28 12:43:59 l75lg1-v1 neutron-server[77619]: key[name], None -> May 28 12:43:59 l75lg1-v1 neutron-server[77619]: key[created_at], None -> 2024-05-28T12:43:59Z May 28 12:43:59 l75lg1-v1 neutron-server[77619]: key[status], None -> DOWN May 28 12:43:59 l75lg1-v1 neutron-server[77619]: key[binding:profile], None -> {} May 28 12:43:59 l75lg1-v1 neutron-server[77619]: key[port_security_enabled], None -> False May 28 12:43:59 l75lg1-v1 neutron-server[77619]: key[updated_at], None -> 2024-05-28T12:43:59Z May 28 12:43:59 l75lg1-v1 neutron-server[77619]: key[network], None -> {'id': '5066e001-05ee-4812-ba7f-98a035d8bd0a', 'name': 'public', 'tenant_id': 'ea8d517cde1d40bb82c97e080ce071f7', 'admin_state_up': True, 'mtu': 1500, 'status': 'ACTIVE', 'subnets': [], 'standard_attr_id': 23, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': True, 'vlan_transparent': None, 'description': '', 'port_security_enabled': True, 'is_default': True, 'tags': [], 'created_at': '2024-05-28T12:43:59Z', 'updated_at': '2024-05-28T12:43:59Z', 'revision_number': 1, 'project_id': 'ea8d517cde1d40bb82c97e080ce071f7', 'provider:network_type': 'flat', 'provider:physical_network': 'public', 'provider:segmentation_id': None} May 28 12:43:59 l75lg1-v1 neutron-server[77619]: key[standard_attr_id], None -> 25 May 28 12:43:59 l75lg1-v1 neutron-server[77619]: key[device_owner], None -> network:distributed May 28 12:43:59 l75lg1-v1 neutron-server[77619]: key[device_id], None -> ovnmeta-5066e001-05ee-4812-ba7f-98a035d8bd0a May 28 12:43:59 l75lg1-v1 neutron-server[77619]: key[mac_address], None -> fa:16:3e:92:4c:f9 May 28 12:43:59 l75lg1-v1 neutron-server[77619]: key[description], None -> May 28 12:43:59 l75lg1-v1 neutron-server[77619]: key[binding:host_id], None -> May 28 12:43:59 l75lg1-v1 neutron-server[77619]: key[binding:vif_details], None -> {} May 28 12:43:59 l75lg1-v1 neutron-server[77619]: key[revision_number], None -> 1 May 28 12:43:59 l75lg1-v1 neutron-server[77619]: key[fixed_ips], None -> [] May 28 12:43:59 l75lg1-v1 neutron-server[77619]: {{(pid=77619) _log_diff_call /opt/stack/neutron/neutron/tests/unit/plugins/ml2/drivers/mechanism_logger.py:59}} May 28 12:43:59 l75lg1-v1 neutron-server[77619]: INFO neutron.tests.unit.plugins.ml2.drivers.mechanism_logger [None req-46e0b09e-c795-440f-9f9a-038aa56ff201 admin admin] create_network_postcommit called with network settings {'id': '5066e001-05ee-4812-ba7f-98a035d8bd0a', 'name': 'public', 'tenant_id': 'ea8d517cde1d40bb82c97e080ce071f7', 'admin_state_up': True, 'mtu': 1500, 'status': 'ACTIVE', 'subnets': [], 'standard_attr_id': 23, 'shared': False, 'project_id': 'ea8d517cde1d40bb82c97e080ce071f7', 'port_security_enabled': True, 'router:external': True, 'provider:network_type': 'flat', 'provider:physical_network': 'public', 'provider:segmentation_id': None, 'is_default': True, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'vlan_transparent': None, 'description': '', 'tags': [], 'created_at': '2024-05-28T12:43:59Z', 'updated_at': '2024-05-28T12:43:59Z', 'revision_number': 1} (original settings None) and network segments [{'id': '3385f5f9-bbb0-40f0-9631-6fb158c3207c', 'network_type': 'flat', 'physical_network': 'public', 'segmentation_id': None, 'network_id': '5066e001-05ee-4812-ba7f-98a035d8bd0a'}] May 28 12:43:59 l75lg1-v1 neutron-server[77619]: DEBUG neutron.tests.unit.plugins.ml2.drivers.mechanism_logger [None req-46e0b09e-c795-440f-9f9a-038aa56ff201 admin admin] create_network_postcommit: May 28 12:43:59 l75lg1-v1 neutron-server[77619]: key[tenant_id], None -> ea8d517cde1d40bb82c97e080ce071f7 May 28 12:43:59 l75lg1-v1 neutron-server[77619]: key[provider:network_type], None -> flat May 28 12:43:59 l75lg1-v1 neutron-server[77619]: key[project_id], None -> ea8d517cde1d40bb82c97e080ce071f7 May 28 12:43:59 l75lg1-v1 neutron-server[77619]: key[ipv6_address_scope], None -> None May 28 12:43:59 l75lg1-v1 neutron-server[77619]: key[subnets], None -> [] May 28 12:43:59 l75lg1-v1 neutron-server[77619]: key[admin_state_up], None -> True May 28 12:43:59 l75lg1-v1 neutron-server[77619]: key[id], None -> 5066e001-05ee-4812-ba7f-98a035d8bd0a May 28 12:43:59 l75lg1-v1 neutron-server[77619]: key[ipv4_address_scope], None -> None May 28 12:43:59 l75lg1-v1 neutron-server[77619]: key[tags], None -> [] May 28 12:43:59 l75lg1-v1 neutron-server[77619]: key[created_at], None -> 2024-05-28T12:43:59Z May 28 12:43:59 l75lg1-v1 neutron-server[77619]: key[status], None -> ACTIVE May 28 12:43:59 l75lg1-v1 neutron-server[77619]: key[is_default], None -> True May 28 12:43:59 l75lg1-v1 neutron-server[77619]: key[port_security_enabled], None -> True May 28 12:43:59 l75lg1-v1 neutron-server[77619]: key[vlan_transparent], None -> None May 28 12:43:59 l75lg1-v1 neutron-server[77619]: key[updated_at], None -> 2024-05-28T12:43:59Z May 28 12:43:59 l75lg1-v1 neutron-server[77619]: key[standard_attr_id], None -> 23 May 28 12:43:59 l75lg1-v1 neutron-server[77619]: key[availability_zone_hints], None -> [] May 28 12:43:59 l75lg1-v1 neutron-server[77619]: key[provider:physical_network], None -> public May 28 12:43:59 l75lg1-v1 neutron-server[77619]: key[shared], None -> False May 28 12:43:59 l75lg1-v1 neutron-server[77619]: key[mtu], None -> 1500 May 28 12:43:59 l75lg1-v1 neutron-server[77619]: key[provider:segmentation_id], None -> None May 28 12:43:59 l75lg1-v1 neutron-server[77619]: key[description], None -> May 28 12:43:59 l75lg1-v1 neutron-server[77619]: key[availability_zones], None -> [] May 28 12:43:59 l75lg1-v1 neutron-server[77619]: key[revision_number], None -> 1 May 28 12:43:59 l75lg1-v1 neutron-server[77619]: key[router:external], None -> True May 28 12:43:59 l75lg1-v1 neutron-server[77619]: key[name], None -> public May 28 12:43:59 l75lg1-v1 neutron-server[77619]: {{(pid=77619) _log_diff_call /opt/stack/neutron/neutron/tests/unit/plugins/ml2/drivers/mechanism_logger.py:59}} May 28 12:43:59 l75lg1-v1 neutron-server[77619]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-46e0b09e-c795-440f-9f9a-038aa56ff201 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=77619) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:258}} May 28 12:43:59 l75lg1-v1 neutron-server[77619]: DEBUG neutron_lib.callbacks.manager [None req-46e0b09e-c795-440f-9f9a-038aa56ff201 admin admin] Publish callbacks [] for network (None), before_response {{(pid=77619) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:43:59 l75lg1-v1 neutron-server[77619]: INFO neutron.wsgi [None req-46e0b09e-c795-440f-9f9a-038aa56ff201 admin admin] 10.27.203.238 "POST /networking/v2.0/networks HTTP/1.1" status: 201 len: 845 time: 0.8219466 May 28 12:44:00 l75lg1-v1 dstat.sh[49771]: 28-05 12:44:00| 10 1 84 4 0|2705M 6795M 267M 5931M| 10k 2400B| 0 5172k| 0 502 |4989 7763 |1.32 1.78 1.25|1.0 0 29| 0 0 | 0 2048M| 23 118 0 35 0 May 28 12:44:00 l75lg1-v1 neutron-server[77618]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.HashRingHealthCheckPeriodics.touch_hash_ring_nodes' {{(pid=77618) _process_scheduled /opt/stack/data/venv/lib/python3.10/site-packages/futurist/periodics.py:638}} May 28 12:44:01 l75lg1-v1 dstat.sh[49771]: 28-05 12:44:01| 10 1 89 0 0|2752M 6748M 267M 5931M| 14k 0 | 0 3424k| 0 332 |1516 1899 |1.32 1.78 1.25|1.0 0 1.0| 0 0 | 0 2048M| 23 118 0 35 0 May 28 12:44:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed9b33f-946f-42fe-8e0c-c6f0a59a0557 None None] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:44:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed9b33f-946f-42fe-8e0c-c6f0a59a0557 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:44:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed9b33f-946f-42fe-8e0c-c6f0a59a0557 None None] PATH_INFO: `/` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:44:01 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 444/903] 10.27.203.238 () {58 vars in 1014 bytes} [Tue May 28 12:44:01 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:44:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bef75f-93a8-45e2-9fb6-b31cde488b4b None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:44:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bef75f-93a8-45e2-9fb6-b31cde488b4b None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:44:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bef75f-93a8-45e2-9fb6-b31cde488b4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:44:01 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-a2bef75f-93a8-45e2-9fb6-b31cde488b4b None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:44:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-a2bef75f-93a8-45e2-9fb6-b31cde488b4b None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:44:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-a2bef75f-93a8-45e2-9fb6-b31cde488b4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:44:01 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 460/904] 10.27.203.238 () {62 vars in 1111 bytes} [Tue May 28 12:44:01 2024] POST /identity/v3/auth/tokens => generated 3990 bytes in 25 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:44:01 l75lg1-v1 neutron-server[77619]: DEBUG neutron.wsgi [-] (77619) accepted ('10.27.203.238', 49936) {{(pid=77619) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 12:44:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed9b33f-946f-42fe-8e0c-c6f0a59a0557 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:44:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed9b33f-946f-42fe-8e0c-c6f0a59a0557 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:44:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a32218-4932-48ba-8cfc-d19aa43773ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef17047035e4b518fd5360a01f2da1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:44:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a32218-4932-48ba-8cfc-d19aa43773ef service neutron] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:44:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a32218-4932-48ba-8cfc-d19aa43773ef service neutron] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:44:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a32218-4932-48ba-8cfc-d19aa43773ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:44:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a32218-4932-48ba-8cfc-d19aa43773ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:44:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a32218-4932-48ba-8cfc-d19aa43773ef service neutron] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:44:01 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 445/905] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 12:44:01 2024] GET /identity/v3/auth/tokens => generated 3990 bytes in 20 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 12:44:01 l75lg1-v1 neutron-server[77619]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-873de27e-6207-45f0-b449-8c643175549d demo admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=77619) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:258}} May 28 12:44:01 l75lg1-v1 neutron-server[77619]: INFO neutron.wsgi [None req-873de27e-6207-45f0-b449-8c643175549d demo admin] 10.27.203.238 "GET /networking/v2.0/subnets/5508b790-cc91-4b59-8d30-81ef4480e470 HTTP/1.1" status: 200 len: 841 time: 0.0539279 May 28 12:44:01 l75lg1-v1 neutron-server[77619]: INFO neutron.wsgi [None req-ec00b541-99d1-497e-8390-6636bc5216ed demo admin] 10.27.203.238 "GET /networking/v2.0/routers/80c11046-4421-4321-813a-d46f0332997a HTTP/1.1" status: 200 len: 777 time: 0.2158689 May 28 12:44:01 l75lg1-v1 neutron-server[77619]: DEBUG neutron_lib.callbacks.manager [None req-e9765d89-3bb5-4faf-aa7b-547f39f7a6e5 demo admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1015114'] for port (None), before_create {{(pid=77619) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:44:02 l75lg1-v1 neutron-server[77619]: DEBUG neutron.db.db_base_plugin_common [None req-e9765d89-3bb5-4faf-aa7b-547f39f7a6e5 demo admin] Allocated IP 10.0.0.1 (fb218033-3d98-4065-b336-c595d5e6ca77/5508b790-cc91-4b59-8d30-81ef4480e470/b291bf17-24f7-4815-bff8-3595d515760c) {{(pid=77619) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:134}} May 28 12:44:02 l75lg1-v1 neutron-server[77619]: DEBUG neutron_lib.callbacks.manager [None req-e9765d89-3bb5-4faf-aa7b-547f39f7a6e5 demo admin] Publish callbacks [] for port (b291bf17-24f7-4815-bff8-3595d515760c), precommit_create {{(pid=77619) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:44:02 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver [None req-e9765d89-3bb5-4faf-aa7b-547f39f7a6e5 demo admin] No provisioning block for port b291bf17-24f7-4815-bff8-3595d515760c since it does not have a host {{(pid=77619) _is_port_provisioning_required /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/mech_driver.py:720}} May 28 12:44:02 l75lg1-v1 neutron-server[77619]: DEBUG neutron.db.ovn_revision_numbers_db [None req-e9765d89-3bb5-4faf-aa7b-547f39f7a6e5 demo admin] create_initial_revision uuid=b291bf17-24f7-4815-bff8-3595d515760c, type=ports, rev=-1 {{(pid=77619) create_initial_revision /opt/stack/neutron/neutron/db/ovn_revision_numbers_db.py:108}} May 28 12:44:02 l75lg1-v1 neutron-server[77619]: DEBUG neutron.db.ovn_revision_numbers_db [None req-e9765d89-3bb5-4faf-aa7b-547f39f7a6e5 demo admin] create_initial_revision uuid=b291bf17-24f7-4815-bff8-3595d515760c, type=router_ports, rev=-1 {{(pid=77619) create_initial_revision /opt/stack/neutron/neutron/db/ovn_revision_numbers_db.py:108}} May 28 12:44:02 l75lg1-v1 neutron-server[77619]: INFO neutron.tests.unit.plugins.ml2.drivers.mechanism_logger [None req-e9765d89-3bb5-4faf-aa7b-547f39f7a6e5 demo admin] create_port_precommit called with port settings {'id': 'b291bf17-24f7-4815-bff8-3595d515760c', 'name': '', 'network_id': 'fb218033-3d98-4065-b336-c595d5e6ca77', 'tenant_id': '95de88f6d26e4420bc466ba67668171f', 'mac_address': 'fa:16:3e:35:c0:d8', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '80c11046-4421-4321-813a-d46f0332997a', 'device_owner': 'network:router_interface', 'standard_attr_id': 26, 'fixed_ips': [{'subnet_id': '5508b790-cc91-4b59-8d30-81ef4480e470', 'ip_address': '10.0.0.1'}], 'project_id': '95de88f6d26e4420bc466ba67668171f', 'port_security_enabled': False, 'security_groups': [], 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'allowed_address_pairs': []} (original settings None) host (original host None) vif type unbound (original vif type None) vif details {} (original vif details None) binding levels None (original binding levels None) on network {'id': 'fb218033-3d98-4065-b336-c595d5e6ca77', 'name': 'private', 'tenant_id': '95de88f6d26e4420bc466ba67668171f', 'admin_state_up': True, 'mtu': 1442, 'status': 'ACTIVE', 'subnets': ['5508b790-cc91-4b59-8d30-81ef4480e470', '799ded51-0b75-4f67-94e9-0a7ea3c3f3d6'], 'standard_attr_id': 12, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'vlan_transparent': None, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2024-05-28T12:43:43Z', 'updated_at': '2024-05-28T12:43:49Z', 'revision_number': 3, 'project_id': '95de88f6d26e4420bc466ba67668171f', 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 30276} with segments to bind None May 28 12:44:02 l75lg1-v1 neutron-server[77619]: DEBUG neutron.tests.unit.plugins.ml2.drivers.mechanism_logger [None req-e9765d89-3bb5-4faf-aa7b-547f39f7a6e5 demo admin] create_port_precommit: May 28 12:44:02 l75lg1-v1 neutron-server[77619]: key[tenant_id], None -> 95de88f6d26e4420bc466ba67668171f May 28 12:44:02 l75lg1-v1 neutron-server[77619]: key[network_id], None -> fb218033-3d98-4065-b336-c595d5e6ca77 May 28 12:44:02 l75lg1-v1 neutron-server[77619]: key[allowed_address_pairs], None -> [] May 28 12:44:02 l75lg1-v1 neutron-server[77619]: key[binding:vif_type], None -> unbound May 28 12:44:02 l75lg1-v1 neutron-server[77619]: key[project_id], None -> 95de88f6d26e4420bc466ba67668171f May 28 12:44:02 l75lg1-v1 neutron-server[77619]: key[admin_state_up], None -> True May 28 12:44:02 l75lg1-v1 neutron-server[77619]: key[id], None -> b291bf17-24f7-4815-bff8-3595d515760c May 28 12:44:02 l75lg1-v1 neutron-server[77619]: key[security_groups], None -> [] May 28 12:44:02 l75lg1-v1 neutron-server[77619]: key[binding:vnic_type], None -> normal May 28 12:44:02 l75lg1-v1 neutron-server[77619]: key[name], None -> May 28 12:44:02 l75lg1-v1 neutron-server[77619]: key[status], None -> DOWN May 28 12:44:02 l75lg1-v1 neutron-server[77619]: key[binding:profile], None -> {} May 28 12:44:02 l75lg1-v1 neutron-server[77619]: key[port_security_enabled], None -> False May 28 12:44:02 l75lg1-v1 neutron-server[77619]: key[standard_attr_id], None -> 26 May 28 12:44:02 l75lg1-v1 neutron-server[77619]: key[device_owner], None -> network:router_interface May 28 12:44:02 l75lg1-v1 neutron-server[77619]: key[device_id], None -> 80c11046-4421-4321-813a-d46f0332997a May 28 12:44:02 l75lg1-v1 neutron-server[77619]: key[mac_address], None -> fa:16:3e:35:c0:d8 May 28 12:44:02 l75lg1-v1 neutron-server[77619]: key[binding:host_id], None -> May 28 12:44:02 l75lg1-v1 neutron-server[77619]: key[binding:vif_details], None -> {} May 28 12:44:02 l75lg1-v1 neutron-server[77619]: key[fixed_ips], None -> [{'subnet_id': '5508b790-cc91-4b59-8d30-81ef4480e470', 'ip_address': '10.0.0.1'}] May 28 12:44:02 l75lg1-v1 neutron-server[77619]: {{(pid=77619) _log_diff_call /opt/stack/neutron/neutron/tests/unit/plugins/ml2/drivers/mechanism_logger.py:59}} May 28 12:44:02 l75lg1-v1 dstat.sh[49771]: 28-05 12:44:02| 10 1 89 1 0|2761M 6739M 267M 5931M| 11k 0 | 0 300k| 0 33.0 |2101 2987 |1.29 1.77 1.25|1.0 1.0 0| 0 0 | 0 2048M| 23 120 0 35 0 May 28 12:44:02 l75lg1-v1 neutron-server[77619]: DEBUG neutron_lib.callbacks.manager [None req-e9765d89-3bb5-4faf-aa7b-547f39f7a6e5 demo admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4166243'] for port (b291bf17-24f7-4815-bff8-3595d515760c), after_create {{(pid=77619) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:44:02 l75lg1-v1 neutron-server[77619]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e9765d89-3bb5-4faf-aa7b-547f39f7a6e5 demo admin] Pushing event updated for resources: {'Port': ['ID=b291bf17-24f7-4815-bff8-3595d515760c,revision_number=1']} {{(pid=77619) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 28 12:44:02 l75lg1-v1 neutron-server[77619]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddLSwitchPortCommand(_result=None, lport=b291bf17-24f7-4815-bff8-3595d515760c, lswitch=neutron-fb218033-3d98-4065-b336-c595d5e6ca77, may_exist=True, columns={'addresses': ['unknown'], 'external_ids': {'neutron:port_name': '', 'neutron:device_id': '80c11046-4421-4321-813a-d46f0332997a', 'neutron:project_id': '95de88f6d26e4420bc466ba67668171f', 'neutron:cidrs': '10.0.0.1/26', 'neutron:device_owner': 'network:router_interface', 'neutron:subnet_pool_addr_scope4': '', 'neutron:subnet_pool_addr_scope6': '', 'neutron:network_name': 'neutron-fb218033-3d98-4065-b336-c595d5e6ca77', 'neutron:security_group_ids': '', 'neutron:revision_number': '1', 'neutron:vnic_type': 'normal', 'neutron:port_capabilities': '', 'neutron:mtu': ''}, 'parent_name': [], 'tag': [], 'enabled': True, 'options': {'mcast_flood_reports': 'true'}, 'type': '', 'port_security': [], 'dhcpv4_options': [], 'dhcpv6_options': []}) {{(pid=77619) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:44:02 l75lg1-v1 neutron-server[77619]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): QoSDelCommand(_result=None, switch=neutron-fb218033-3d98-4065-b336-c595d5e6ca77, conditions=[('direction', '=', 'to-lport'), ('priority', '=', 2002), ('match', '=', 'outport == "b291bf17-24f7-4815-bff8-3595d515760c"')], if_exists=True) {{(pid=77619) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:44:02 l75lg1-v1 neutron-server[77619]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): UpdateLSwitchPortQosOptionsCommand(_result=None, lport=AddLSwitchPortCommand(_result=d906a312-d934-4633-9dd6-a2b0ba26c651, lport=b291bf17-24f7-4815-bff8-3595d515760c, lswitch=neutron-fb218033-3d98-4065-b336-c595d5e6ca77, may_exist=True, columns={'addresses': ['unknown'], 'external_ids': {'neutron:port_name': '', 'neutron:device_id': '80c11046-4421-4321-813a-d46f0332997a', 'neutron:project_id': '95de88f6d26e4420bc466ba67668171f', 'neutron:cidrs': '10.0.0.1/26', 'neutron:device_owner': 'network:router_interface', 'neutron:subnet_pool_addr_scope4': '', 'neutron:subnet_pool_addr_scope6': '', 'neutron:network_name': 'neutron-fb218033-3d98-4065-b336-c595d5e6ca77', 'neutron:security_group_ids': '', 'neutron:revision_number': '1', 'neutron:vnic_type': 'normal', 'neutron:port_capabilities': '', 'neutron:mtu': ''}, 'parent_name': [], 'enabled': True, 'options': {'mcast_flood_reports': 'true'}, 'type': '', 'port_security': []}), if_exists=True, qos={'qos_min_rate': None}) {{(pid=77619) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:44:02 l75lg1-v1 neutron-server[77619]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=3): QoSDelCommand(_result=None, switch=neutron-fb218033-3d98-4065-b336-c595d5e6ca77, conditions=[('direction', '=', 'from-lport'), ('priority', '=', 2002), ('match', '=', 'inport == "b291bf17-24f7-4815-bff8-3595d515760c"')], if_exists=True) {{(pid=77619) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:44:02 l75lg1-v1 neutron-server[77619]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=4): UpdateLSwitchPortQosOptionsCommand(_result=None, lport=AddLSwitchPortCommand(_result=d906a312-d934-4633-9dd6-a2b0ba26c651, lport=b291bf17-24f7-4815-bff8-3595d515760c, lswitch=neutron-fb218033-3d98-4065-b336-c595d5e6ca77, may_exist=True, columns={'addresses': ['unknown'], 'external_ids': {'neutron:port_name': '', 'neutron:device_id': '80c11046-4421-4321-813a-d46f0332997a', 'neutron:project_id': '95de88f6d26e4420bc466ba67668171f', 'neutron:cidrs': '10.0.0.1/26', 'neutron:device_owner': 'network:router_interface', 'neutron:subnet_pool_addr_scope4': '', 'neutron:subnet_pool_addr_scope6': '', 'neutron:network_name': 'neutron-fb218033-3d98-4065-b336-c595d5e6ca77', 'neutron:security_group_ids': '', 'neutron:revision_number': '1', 'neutron:vnic_type': 'normal', 'neutron:port_capabilities': '', 'neutron:mtu': ''}, 'parent_name': [], 'enabled': True, 'options': {'mcast_flood_reports': 'true'}, 'type': '', 'port_security': []}), if_exists=True, qos={'qos_min_rate': None}) {{(pid=77619) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:44:02 l75lg1-v1 neutron-server[77621]: DEBUG neutron.common.ovn.hash_ring_manager [-] Hash Ring loaded. 2 active nodes. 0 offline nodes {{(pid=77621) _load_hash_ring /opt/stack/neutron/neutron/common/ovn/hash_ring_manager.py:99}} May 28 12:44:02 l75lg1-v1 neutron-server[77618]: DEBUG neutron.common.ovn.hash_ring_manager [-] Hash Ring loaded. 2 active nodes. 0 offline nodes {{(pid=77618) _load_hash_ring /opt/stack/neutron/neutron/common/ovn/hash_ring_manager.py:99}} May 28 12:44:02 l75lg1-v1 neutron-server[77619]: DEBUG neutron.common.ovn.hash_ring_manager [-] Hash Ring loaded. 2 active nodes. 0 offline nodes {{(pid=77619) _load_hash_ring /opt/stack/neutron/neutron/common/ovn/hash_ring_manager.py:99}} May 28 12:44:02 l75lg1-v1 neutron-server[77618]: DEBUG neutron.common.ovn.hash_ring_manager [-] Hash Ring loaded. 2 active nodes. 0 offline nodes {{(pid=77618) _load_hash_ring /opt/stack/neutron/neutron/common/ovn/hash_ring_manager.py:99}} May 28 12:44:02 l75lg1-v1 neutron-server[77619]: DEBUG neutron.common.ovn.hash_ring_manager [-] Hash Ring loaded. 2 active nodes. 0 offline nodes {{(pid=77619) _load_hash_ring /opt/stack/neutron/neutron/common/ovn/hash_ring_manager.py:99}} May 28 12:44:02 l75lg1-v1 neutron-server[77621]: DEBUG neutron.common.ovn.hash_ring_manager [-] Hash Ring loaded. 2 active nodes. 0 offline nodes {{(pid=77621) _load_hash_ring /opt/stack/neutron/neutron/common/ovn/hash_ring_manager.py:99}} May 28 12:44:02 l75lg1-v1 neutron-server[77618]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-c63b1acc-b5c6-4be8-9db9-04824fec27f2 None None] Hash Ring: Node 4c6fc793-7f5a-456f-b4d6-6e5bd97592f2 (host: l75lg1-v1) handling event "update" for row e0112af8-ce41-4b01-ad87-93806fb91451 (table: Logical_Switch) {{(pid=77618) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:44:02 l75lg1-v1 neutron-server[77618]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-c63b1acc-b5c6-4be8-9db9-04824fec27f2 None None] Hash Ring: Node 4c6fc793-7f5a-456f-b4d6-6e5bd97592f2 (host: l75lg1-v1) handling event "create" for row 804bc8b6-beaf-4289-82af-da67ea9be64f (table: Logical_Switch_Port) {{(pid=77618) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:44:02 l75lg1-v1 neutron-server[77618]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-c63b1acc-b5c6-4be8-9db9-04824fec27f2 None None] Hash Ring: Node 4c6fc793-7f5a-456f-b4d6-6e5bd97592f2 (host: l75lg1-v1) handling event "update" for row 804bc8b6-beaf-4289-82af-da67ea9be64f (table: Logical_Switch_Port) {{(pid=77618) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:44:02 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-03b5f984-1478-4ad6-9838-8e34c1689c5b None None] Hash Ring: Node c89b3497-133e-4a5a-b67a-3310d2cb2485 (host: l75lg1-v1) handling event "create" for row 6674b5f0-1e65-498e-a5df-b24bb99a66b3 (table: Port_Binding) {{(pid=77619) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:44:02 l75lg1-v1 neutron-server[77619]: INFO neutron.db.ovn_revision_numbers_db [None req-e9765d89-3bb5-4faf-aa7b-547f39f7a6e5 demo admin] Successfully bumped revision number for resource b291bf17-24f7-4815-bff8-3595d515760c (type: ports) to 1 May 28 12:44:02 l75lg1-v1 neutron-server[77619]: INFO neutron.tests.unit.plugins.ml2.drivers.mechanism_logger [None req-e9765d89-3bb5-4faf-aa7b-547f39f7a6e5 demo admin] create_port_postcommit called with port settings {'id': 'b291bf17-24f7-4815-bff8-3595d515760c', 'name': '', 'network_id': 'fb218033-3d98-4065-b336-c595d5e6ca77', 'tenant_id': '95de88f6d26e4420bc466ba67668171f', 'mac_address': 'fa:16:3e:35:c0:d8', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '80c11046-4421-4321-813a-d46f0332997a', 'device_owner': 'network:router_interface', 'standard_attr_id': 26, 'fixed_ips': [{'subnet_id': '5508b790-cc91-4b59-8d30-81ef4480e470', 'ip_address': '10.0.0.1'}], 'project_id': '95de88f6d26e4420bc466ba67668171f', 'port_security_enabled': False, 'security_groups': [], 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'description': '', 'tags': [], 'created_at': '2024-05-28T12:44:01Z', 'updated_at': '2024-05-28T12:44:02Z', 'revision_number': 1, 'network': {'id': 'fb218033-3d98-4065-b336-c595d5e6ca77', 'name': 'private', 'tenant_id': '95de88f6d26e4420bc466ba67668171f', 'admin_state_up': True, 'mtu': 1442, 'status': 'ACTIVE', 'subnets': ['5508b790-cc91-4b59-8d30-81ef4480e470', '799ded51-0b75-4f67-94e9-0a7ea3c3f3d6'], 'standard_attr_id': 12, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'vlan_transparent': None, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2024-05-28T12:43:43Z', 'updated_at': '2024-05-28T12:43:49Z', 'revision_number': 3, 'project_id': '95de88f6d26e4420bc466ba67668171f', 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 30276}} (original settings None) host (original host None) vif type unbound (original vif type None) vif details {} (original vif details None) binding levels None (original binding levels None) on network {'id': 'fb218033-3d98-4065-b336-c595d5e6ca77', 'name': 'private', 'tenant_id': '95de88f6d26e4420bc466ba67668171f', 'admin_state_up': True, 'mtu': 1442, 'status': 'ACTIVE', 'subnets': ['5508b790-cc91-4b59-8d30-81ef4480e470', '799ded51-0b75-4f67-94e9-0a7ea3c3f3d6'], 'standard_attr_id': 12, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'vlan_transparent': None, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2024-05-28T12:43:43Z', 'updated_at': '2024-05-28T12:43:49Z', 'revision_number': 3, 'project_id': '95de88f6d26e4420bc466ba67668171f', 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 30276} with segments to bind None May 28 12:44:02 l75lg1-v1 neutron-server[77619]: DEBUG neutron.tests.unit.plugins.ml2.drivers.mechanism_logger [None req-e9765d89-3bb5-4faf-aa7b-547f39f7a6e5 demo admin] create_port_postcommit: May 28 12:44:02 l75lg1-v1 neutron-server[77619]: key[tenant_id], None -> 95de88f6d26e4420bc466ba67668171f May 28 12:44:02 l75lg1-v1 neutron-server[77619]: key[network_id], None -> fb218033-3d98-4065-b336-c595d5e6ca77 May 28 12:44:02 l75lg1-v1 neutron-server[77619]: key[allowed_address_pairs], None -> [] May 28 12:44:02 l75lg1-v1 neutron-server[77619]: key[binding:vif_type], None -> unbound May 28 12:44:02 l75lg1-v1 neutron-server[77619]: key[project_id], None -> 95de88f6d26e4420bc466ba67668171f May 28 12:44:02 l75lg1-v1 neutron-server[77619]: key[admin_state_up], None -> True May 28 12:44:02 l75lg1-v1 neutron-server[77619]: key[id], None -> b291bf17-24f7-4815-bff8-3595d515760c May 28 12:44:02 l75lg1-v1 neutron-server[77619]: key[security_groups], None -> [] May 28 12:44:02 l75lg1-v1 neutron-server[77619]: key[extra_dhcp_opts], None -> [] May 28 12:44:02 l75lg1-v1 neutron-server[77619]: key[binding:vnic_type], None -> normal May 28 12:44:02 l75lg1-v1 neutron-server[77619]: key[tags], None -> [] May 28 12:44:02 l75lg1-v1 neutron-server[77619]: key[name], None -> May 28 12:44:02 l75lg1-v1 neutron-server[77619]: key[created_at], None -> 2024-05-28T12:44:01Z May 28 12:44:02 l75lg1-v1 neutron-server[77619]: key[status], None -> DOWN May 28 12:44:02 l75lg1-v1 neutron-server[77619]: key[binding:profile], None -> {} May 28 12:44:02 l75lg1-v1 neutron-server[77619]: key[port_security_enabled], None -> False May 28 12:44:02 l75lg1-v1 neutron-server[77619]: key[updated_at], None -> 2024-05-28T12:44:02Z May 28 12:44:02 l75lg1-v1 neutron-server[77619]: key[network], None -> {'id': 'fb218033-3d98-4065-b336-c595d5e6ca77', 'name': 'private', 'tenant_id': '95de88f6d26e4420bc466ba67668171f', 'admin_state_up': True, 'mtu': 1442, 'status': 'ACTIVE', 'subnets': ['5508b790-cc91-4b59-8d30-81ef4480e470', '799ded51-0b75-4f67-94e9-0a7ea3c3f3d6'], 'standard_attr_id': 12, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'vlan_transparent': None, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2024-05-28T12:43:43Z', 'updated_at': '2024-05-28T12:43:49Z', 'revision_number': 3, 'project_id': '95de88f6d26e4420bc466ba67668171f', 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 30276} May 28 12:44:02 l75lg1-v1 neutron-server[77619]: key[standard_attr_id], None -> 26 May 28 12:44:02 l75lg1-v1 neutron-server[77619]: key[device_owner], None -> network:router_interface May 28 12:44:02 l75lg1-v1 neutron-server[77619]: key[device_id], None -> 80c11046-4421-4321-813a-d46f0332997a May 28 12:44:02 l75lg1-v1 neutron-server[77619]: key[mac_address], None -> fa:16:3e:35:c0:d8 May 28 12:44:02 l75lg1-v1 neutron-server[77619]: key[description], None -> May 28 12:44:02 l75lg1-v1 neutron-server[77619]: key[binding:host_id], None -> May 28 12:44:02 l75lg1-v1 neutron-server[77619]: key[binding:vif_details], None -> {} May 28 12:44:02 l75lg1-v1 neutron-server[77619]: key[revision_number], None -> 1 May 28 12:44:02 l75lg1-v1 neutron-server[77619]: key[fixed_ips], None -> [{'subnet_id': '5508b790-cc91-4b59-8d30-81ef4480e470', 'ip_address': '10.0.0.1'}] May 28 12:44:02 l75lg1-v1 neutron-server[77619]: {{(pid=77619) _log_diff_call /opt/stack/neutron/neutron/tests/unit/plugins/ml2/drivers/mechanism_logger.py:59}} May 28 12:44:02 l75lg1-v1 neutron-server[77619]: DEBUG neutron_lib.callbacks.manager [None req-e9765d89-3bb5-4faf-aa7b-547f39f7a6e5 demo admin] Publish callbacks [] for router_interface (80c11046-4421-4321-813a-d46f0332997a), before_create {{(pid=77619) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:44:02 l75lg1-v1 neutron-server[77619]: DEBUG neutron_lib.callbacks.manager [None req-e9765d89-3bb5-4faf-aa7b-547f39f7a6e5 demo admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1015114', 'neutron.services.ovn_l3.plugin.OVNL3RouterPlugin._port_update-8754901907784', 'neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_internal_ip_change_for_fip-8754903031884'] for port (b291bf17-24f7-4815-bff8-3595d515760c), before_update {{(pid=77619) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:44:02 l75lg1-v1 neutron-server[77619]: DEBUG neutron_lib.callbacks.manager [None req-e9765d89-3bb5-4faf-aa7b-547f39f7a6e5 demo admin] Publish callbacks [] for port (b291bf17-24f7-4815-bff8-3595d515760c), precommit_update {{(pid=77619) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:44:02 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver [None req-e9765d89-3bb5-4faf-aa7b-547f39f7a6e5 demo admin] No provisioning block for port b291bf17-24f7-4815-bff8-3595d515760c since it does not have a host {{(pid=77619) _is_port_provisioning_required /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/mech_driver.py:720}} May 28 12:44:02 l75lg1-v1 neutron-server[77619]: INFO neutron.tests.unit.plugins.ml2.drivers.mechanism_logger [None req-e9765d89-3bb5-4faf-aa7b-547f39f7a6e5 demo admin] update_port_precommit called with port settings {'id': 'b291bf17-24f7-4815-bff8-3595d515760c', 'name': '', 'network_id': 'fb218033-3d98-4065-b336-c595d5e6ca77', 'tenant_id': '95de88f6d26e4420bc466ba67668171f', 'mac_address': 'fa:16:3e:35:c0:d8', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '80c11046-4421-4321-813a-d46f0332997a', 'device_owner': 'network:router_interface', 'standard_attr_id': 26, 'fixed_ips': [{'subnet_id': '5508b790-cc91-4b59-8d30-81ef4480e470', 'ip_address': '10.0.0.1'}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2024-05-28T12:44:01Z', 'updated_at': '2024-05-28T12:44:02Z', 'revision_number': 1, 'project_id': '95de88f6d26e4420bc466ba67668171f'} (original settings {'id': 'b291bf17-24f7-4815-bff8-3595d515760c', 'name': '', 'network_id': 'fb218033-3d98-4065-b336-c595d5e6ca77', 'tenant_id': '95de88f6d26e4420bc466ba67668171f', 'mac_address': 'fa:16:3e:35:c0:d8', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '80c11046-4421-4321-813a-d46f0332997a', 'device_owner': 'network:router_interface', 'standard_attr_id': 26, 'fixed_ips': [{'subnet_id': '5508b790-cc91-4b59-8d30-81ef4480e470', 'ip_address': '10.0.0.1'}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2024-05-28T12:44:01Z', 'updated_at': '2024-05-28T12:44:02Z', 'revision_number': 1, 'project_id': '95de88f6d26e4420bc466ba67668171f'}) host (original host ) vif type unbound (original vif type unbound) vif details {} (original vif details {}) binding levels None (original binding levels None) on network {'id': 'fb218033-3d98-4065-b336-c595d5e6ca77', 'name': 'private', 'tenant_id': '95de88f6d26e4420bc466ba67668171f', 'admin_state_up': True, 'mtu': 1442, 'status': 'ACTIVE', 'subnets': ['5508b790-cc91-4b59-8d30-81ef4480e470', '799ded51-0b75-4f67-94e9-0a7ea3c3f3d6'], 'standard_attr_id': 12, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'vlan_transparent': None, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2024-05-28T12:43:43Z', 'updated_at': '2024-05-28T12:43:49Z', 'revision_number': 3, 'project_id': '95de88f6d26e4420bc466ba67668171f', 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 30276} with segments to bind None May 28 12:44:02 l75lg1-v1 neutron-server[77619]: DEBUG neutron.tests.unit.plugins.ml2.drivers.mechanism_logger [None req-e9765d89-3bb5-4faf-aa7b-547f39f7a6e5 demo admin] update_port_precommit: May 28 12:44:02 l75lg1-v1 neutron-server[77619]: {{(pid=77619) _log_diff_call /opt/stack/neutron/neutron/tests/unit/plugins/ml2/drivers/mechanism_logger.py:59}} May 28 12:44:02 l75lg1-v1 neutron-server[77619]: DEBUG neutron_lib.callbacks.manager [None req-e9765d89-3bb5-4faf-aa7b-547f39f7a6e5 demo admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4166243', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8754903016533', 'neutron.services.ovn_l3.plugin.OVNL3RouterPlugin._port_update-8754901907784'] for port (b291bf17-24f7-4815-bff8-3595d515760c), after_update {{(pid=77619) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:44:02 l75lg1-v1 neutron-server[77619]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e9765d89-3bb5-4faf-aa7b-547f39f7a6e5 demo admin] Pushing event updated for resources: {'Port': ['ID=b291bf17-24f7-4815-bff8-3595d515760c,revision_number=1']} {{(pid=77619) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 28 12:44:02 l75lg1-v1 neutron-server[77619]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=b291bf17-24f7-4815-bff8-3595d515760c, resource={'id': 'b291bf17-24f7-4815-bff8-3595d515760c', 'name': '', 'network_id': 'fb218033-3d98-4065-b336-c595d5e6ca77', 'tenant_id': '95de88f6d26e4420bc466ba67668171f', 'mac_address': 'fa:16:3e:35:c0:d8', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '80c11046-4421-4321-813a-d46f0332997a', 'device_owner': 'network:router_interface', 'standard_attr_id': 26, 'fixed_ips': [{'subnet_id': '5508b790-cc91-4b59-8d30-81ef4480e470', 'ip_address': '10.0.0.1'}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2024-05-28T12:44:01Z', 'updated_at': '2024-05-28T12:44:02Z', 'revision_number': 1, 'project_id': '95de88f6d26e4420bc466ba67668171f', 'network': {'id': 'fb218033-3d98-4065-b336-c595d5e6ca77', 'name': 'private', 'tenant_id': '95de88f6d26e4420bc466ba67668171f', 'admin_state_up': True, 'mtu': 1442, 'status': 'ACTIVE', 'subnets': ['5508b790-cc91-4b59-8d30-81ef4480e470', '799ded51-0b75-4f67-94e9-0a7ea3c3f3d6'], 'standard_attr_id': 12, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'vlan_transparent': None, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2024-05-28T12:43:43Z', 'updated_at': '2024-05-28T12:43:49Z', 'revision_number': 3, 'project_id': '95de88f6d26e4420bc466ba67668171f', 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 30276}}, resource_type=ports, if_exists=True) {{(pid=77619) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:44:02 l75lg1-v1 neutron-server[77619]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLSwitchPortCommand(_result=None, lport=b291bf17-24f7-4815-bff8-3595d515760c, external_ids_update=None, columns={'external_ids': {'neutron:port_name': '', 'neutron:device_id': '80c11046-4421-4321-813a-d46f0332997a', 'neutron:project_id': '95de88f6d26e4420bc466ba67668171f', 'neutron:cidrs': '10.0.0.1/26', 'neutron:device_owner': 'network:router_interface', 'neutron:subnet_pool_addr_scope4': '', 'neutron:subnet_pool_addr_scope6': '', 'neutron:network_name': 'neutron-fb218033-3d98-4065-b336-c595d5e6ca77', 'neutron:security_group_ids': '', 'neutron:revision_number': '1', 'neutron:vnic_type': 'normal', 'neutron:port_capabilities': '', 'neutron:mtu': ''}, 'parent_name': [], 'tag': [], 'options': {'mcast_flood_reports': 'true'}, 'enabled': True, 'port_security': [], 'dhcpv4_options': [], 'dhcpv6_options': [], 'type': 'router', 'ha_chassis_group': []}, if_exists=False) {{(pid=77619) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:44:02 l75lg1-v1 neutron-server[77619]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): PgDelPortCommand(_result=None, port_group=neutron_pg_drop, lsp=['b291bf17-24f7-4815-bff8-3595d515760c'], if_exists=False) {{(pid=77619) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:44:02 l75lg1-v1 neutron-server[77618]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-c63b1acc-b5c6-4be8-9db9-04824fec27f2 None None] Hash Ring: Node 4c6fc793-7f5a-456f-b4d6-6e5bd97592f2 (host: l75lg1-v1) handling event "update" for row 804bc8b6-beaf-4289-82af-da67ea9be64f (table: Logical_Switch_Port) {{(pid=77618) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:44:02 l75lg1-v1 neutron-server[77618]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-c63b1acc-b5c6-4be8-9db9-04824fec27f2 None None] Hash Ring: Node 4c6fc793-7f5a-456f-b4d6-6e5bd97592f2 (host: l75lg1-v1) handling event "update" for row 804bc8b6-beaf-4289-82af-da67ea9be64f (table: Logical_Switch_Port) {{(pid=77618) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:44:02 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-03b5f984-1478-4ad6-9838-8e34c1689c5b None None] Hash Ring: Node c89b3497-133e-4a5a-b67a-3310d2cb2485 (host: l75lg1-v1) handling event "update" for row 6674b5f0-1e65-498e-a5df-b24bb99a66b3 (table: Port_Binding) {{(pid=77619) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:44:02 l75lg1-v1 neutron-server[77618]: DEBUG ovsdbapp.backend.ovs_idl.event [None req-c63b1acc-b5c6-4be8-9db9-04824fec27f2 None None] Matched UPDATE: LogicalSwitchPortUpdateUpEvent(events=('update',), table='Logical_Switch_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Switch_Port(up=[True], name=b291bf17-24f7-4815-bff8-3595d515760c, external_ids={'neutron:cidrs': '10.0.0.1/26', 'neutron:device_id': '80c11046-4421-4321-813a-d46f0332997a', 'neutron:device_owner': 'network:router_interface', 'neutron:mtu': '', 'neutron:network_name': 'neutron-fb218033-3d98-4065-b336-c595d5e6ca77', 'neutron:port_capabilities': '', 'neutron:port_name': '', 'neutron:project_id': '95de88f6d26e4420bc466ba67668171f', 'neutron:revision_number': '1', 'neutron:security_group_ids': '', 'neutron:subnet_pool_addr_scope4': '', 'neutron:subnet_pool_addr_scope6': '', 'neutron:vnic_type': 'normal'}, ha_chassis_group=[], options={'mcast_flood_reports': 'true'}, parent_name=[], enabled=[True], type=router, dhcpv6_options=[], tag_request=[], port_security=[], addresses=['unknown'], dynamic_addresses=[], dhcpv4_options=[], tag=[]) old=Logical_Switch_Port(up=[False]) {{(pid=77618) matches /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} May 28 12:44:02 l75lg1-v1 neutron-server[77618]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver [-] OVN reports status up for port: b291bf17-24f7-4815-bff8-3595d515760c May 28 12:44:03 l75lg1-v1 neutron-server[77618]: DEBUG neutron.db.provisioning_blocks [None req-5ba0b4eb-00ab-4523-a874-41c9965d7fce None None] Provisioning complete for port b291bf17-24f7-4815-bff8-3595d515760c triggered by entity L2. {{(pid=77618) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:144}} May 28 12:44:03 l75lg1-v1 neutron-server[77618]: DEBUG neutron_lib.callbacks.manager [None req-5ba0b4eb-00ab-4523-a874-41c9965d7fce None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-857483'] for port (b291bf17-24f7-4815-bff8-3595d515760c), provisioning_complete {{(pid=77618) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:44:03 l75lg1-v1 neutron-server[77618]: INFO neutron.plugins.ml2.plugin [None req-5ba0b4eb-00ab-4523-a874-41c9965d7fce None None] Attempt 1 to provision port b291bf17-24f7-4815-bff8-3595d515760c May 28 12:44:03 l75lg1-v1 neutron-server[77619]: INFO neutron.db.ovn_revision_numbers_db [None req-e9765d89-3bb5-4faf-aa7b-547f39f7a6e5 demo admin] Successfully bumped revision number for resource b291bf17-24f7-4815-bff8-3595d515760c (type: ports) to 1 May 28 12:44:03 l75lg1-v1 neutron-server[77619]: INFO neutron.tests.unit.plugins.ml2.drivers.mechanism_logger [None req-e9765d89-3bb5-4faf-aa7b-547f39f7a6e5 demo admin] update_port_postcommit called with port settings {'id': 'b291bf17-24f7-4815-bff8-3595d515760c', 'name': '', 'network_id': 'fb218033-3d98-4065-b336-c595d5e6ca77', 'tenant_id': '95de88f6d26e4420bc466ba67668171f', 'mac_address': 'fa:16:3e:35:c0:d8', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '80c11046-4421-4321-813a-d46f0332997a', 'device_owner': 'network:router_interface', 'standard_attr_id': 26, 'fixed_ips': [{'subnet_id': '5508b790-cc91-4b59-8d30-81ef4480e470', 'ip_address': '10.0.0.1'}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2024-05-28T12:44:01Z', 'updated_at': '2024-05-28T12:44:02Z', 'revision_number': 1, 'project_id': '95de88f6d26e4420bc466ba67668171f'} (original settings {'id': 'b291bf17-24f7-4815-bff8-3595d515760c', 'name': '', 'network_id': 'fb218033-3d98-4065-b336-c595d5e6ca77', 'tenant_id': '95de88f6d26e4420bc466ba67668171f', 'mac_address': 'fa:16:3e:35:c0:d8', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '80c11046-4421-4321-813a-d46f0332997a', 'device_owner': 'network:router_interface', 'standard_attr_id': 26, 'fixed_ips': [{'subnet_id': '5508b790-cc91-4b59-8d30-81ef4480e470', 'ip_address': '10.0.0.1'}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2024-05-28T12:44:01Z', 'updated_at': '2024-05-28T12:44:02Z', 'revision_number': 1, 'project_id': '95de88f6d26e4420bc466ba67668171f'}) host (original host ) vif type unbound (original vif type unbound) vif details {} (original vif details {}) binding levels None (original binding levels None) on network {'id': 'fb218033-3d98-4065-b336-c595d5e6ca77', 'name': 'private', 'tenant_id': '95de88f6d26e4420bc466ba67668171f', 'admin_state_up': True, 'mtu': 1442, 'status': 'ACTIVE', 'subnets': ['5508b790-cc91-4b59-8d30-81ef4480e470', '799ded51-0b75-4f67-94e9-0a7ea3c3f3d6'], 'standard_attr_id': 12, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'vlan_transparent': None, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2024-05-28T12:43:43Z', 'updated_at': '2024-05-28T12:43:49Z', 'revision_number': 3, 'project_id': '95de88f6d26e4420bc466ba67668171f', 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 30276} with segments to bind None May 28 12:44:03 l75lg1-v1 neutron-server[77619]: DEBUG neutron.tests.unit.plugins.ml2.drivers.mechanism_logger [None req-e9765d89-3bb5-4faf-aa7b-547f39f7a6e5 demo admin] update_port_postcommit: May 28 12:44:03 l75lg1-v1 neutron-server[77619]: {{(pid=77619) _log_diff_call /opt/stack/neutron/neutron/tests/unit/plugins/ml2/drivers/mechanism_logger.py:59}} May 28 12:44:03 l75lg1-v1 neutron-server[77619]: DEBUG neutron_lib.callbacks.manager [None req-e9765d89-3bb5-4faf-aa7b-547f39f7a6e5 demo admin] Publish callbacks ['neutron.services.ovn_l3.service_providers.ovn.OvnDriver._process_add_router_interface-57909'] for router_interface (80c11046-4421-4321-813a-d46f0332997a), after_create {{(pid=77619) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:44:03 l75lg1-v1 neutron-server[77619]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.extensions.qos [None req-e9765d89-3bb5-4faf-aa7b-547f39f7a6e5 demo admin] Starting OVNClientQosExtension May 28 12:44:03 l75lg1-v1 neutron-server[77618]: DEBUG neutron.plugins.ml2.plugin [None req-5ba0b4eb-00ab-4523-a874-41c9965d7fce None None] Port b291bf17-24f7-4815-bff8-3595d515760c cannot update to ACTIVE because it is not bound. {{(pid=77618) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:372}} May 28 12:44:03 l75lg1-v1 neutron-server[77618]: DEBUG neutron.plugins.ml2.plugin [None req-5ba0b4eb-00ab-4523-a874-41c9965d7fce None None] Current status of the port b291bf17-24f7-4815-bff8-3595d515760c is: DOWN; New status is: ACTIVE {{(pid=77618) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2395}} May 28 12:44:03 l75lg1-v1 neutron-server[77618]: DEBUG neutron_lib.callbacks.manager [None req-5ba0b4eb-00ab-4523-a874-41c9965d7fce None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1015114', 'neutron.services.ovn_l3.plugin.OVNL3RouterPlugin._port_update-8754901907784', 'neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_internal_ip_change_for_fip-8754903031884'] for port (b291bf17-24f7-4815-bff8-3595d515760c), before_update {{(pid=77618) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:44:03 l75lg1-v1 neutron-server[77618]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver [None req-5ba0b4eb-00ab-4523-a874-41c9965d7fce None None] No provisioning block for port b291bf17-24f7-4815-bff8-3595d515760c since it is active {{(pid=77618) _is_port_provisioning_required /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/mech_driver.py:715}} May 28 12:44:03 l75lg1-v1 neutron-server[77619]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddLRouterPortCommand(_result=None, name=lrp-b291bf17-24f7-4815-bff8-3595d515760c, lrouter=neutron-80c11046-4421-4321-813a-d46f0332997a, may_exist=True, columns={'mac': 'fa:16:3e:35:c0:d8', 'networks': ['10.0.0.1/26'], 'external_ids': {'neutron:revision_number': '1', 'neutron:subnet_ids': '5508b790-cc91-4b59-8d30-81ef4480e470', 'neutron:network_name': 'neutron-fb218033-3d98-4065-b336-c595d5e6ca77', 'neutron:is_ext_gw': 'False', 'neutron:router_name': '80c11046-4421-4321-813a-d46f0332997a'}, 'options': {}}) {{(pid=77619) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:44:03 l75lg1-v1 neutron-server[77619]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterPortInLSwitchPortCommand(_result=None, lswitch_port=b291bf17-24f7-4815-bff8-3595d515760c, lrouter_port=lrp-b291bf17-24f7-4815-bff8-3595d515760c, is_gw_port=False, if_exists=True, lsp_address=router) {{(pid=77619) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:44:03 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-03b5f984-1478-4ad6-9838-8e34c1689c5b None None] Hash Ring: Node c89b3497-133e-4a5a-b67a-3310d2cb2485 (host: l75lg1-v1) handling event "create" for row 1fcc960e-70a0-4156-a0d7-b755514621fb (table: Port_Binding) {{(pid=77619) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:44:03 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-03b5f984-1478-4ad6-9838-8e34c1689c5b None None] Hash Ring: Node c89b3497-133e-4a5a-b67a-3310d2cb2485 (host: l75lg1-v1) handling event "update" for row 6674b5f0-1e65-498e-a5df-b24bb99a66b3 (table: Port_Binding) {{(pid=77619) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:44:03 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-53cecb61-7023-41e4-a5ea-23b1eb02606a None None] Hash Ring: Node c89b3497-133e-4a5a-b67a-3310d2cb2485 (host: l75lg1-v1) handling event "update" for row 74f0f327-cc93-479c-856e-03f5c93a4345 (table: Logical_Router) {{(pid=77619) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:44:03 l75lg1-v1 dstat.sh[49771]: 28-05 12:44:03| 13 1 84 1 0|2768M 6732M 267M 5931M| 12k 0 | 0 844k| 0 120 |3139 4822 |1.29 1.77 1.25|2.0 1.0 1.0| 0 0 | 0 2048M| 23 122 0 35 0 May 28 12:44:03 l75lg1-v1 neutron-server[77619]: INFO neutron.db.ovn_revision_numbers_db [None req-e9765d89-3bb5-4faf-aa7b-547f39f7a6e5 demo admin] Successfully bumped revision number for resource b291bf17-24f7-4815-bff8-3595d515760c (type: router_ports) to 1 May 28 12:44:03 l75lg1-v1 neutron-server[77619]: INFO neutron.wsgi [None req-e9765d89-3bb5-4faf-aa7b-547f39f7a6e5 demo admin] 10.27.203.238 "PUT /networking/v2.0/routers/80c11046-4421-4321-813a-d46f0332997a/add_router_interface HTTP/1.1" status: 200 len: 508 time: 1.4817073 May 28 12:44:03 l75lg1-v1 neutron-server[77618]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-c63b1acc-b5c6-4be8-9db9-04824fec27f2 None None] Hash Ring: Node 4c6fc793-7f5a-456f-b4d6-6e5bd97592f2 (host: l75lg1-v1) handling event "create" for row 98ceff9d-cdc0-4885-a56e-dedb12235e52 (table: Logical_Router_Port) {{(pid=77618) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:44:03 l75lg1-v1 neutron-server[77618]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-c63b1acc-b5c6-4be8-9db9-04824fec27f2 None None] Hash Ring: Node 4c6fc793-7f5a-456f-b4d6-6e5bd97592f2 (host: l75lg1-v1) handling event "update" for row 804bc8b6-beaf-4289-82af-da67ea9be64f (table: Logical_Switch_Port) {{(pid=77618) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:44:03 l75lg1-v1 neutron-server[77618]: DEBUG ovsdbapp.backend.ovs_idl.event [None req-c63b1acc-b5c6-4be8-9db9-04824fec27f2 None None] Matched UPDATE: LogicalSwitchPortUpdateLogicalRouterPortEvent(events=('update',), table='Logical_Switch_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Switch_Port(up=[True], name=b291bf17-24f7-4815-bff8-3595d515760c, external_ids={'neutron:cidrs': '10.0.0.1/26', 'neutron:device_id': '80c11046-4421-4321-813a-d46f0332997a', 'neutron:device_owner': 'network:router_interface', 'neutron:mtu': '', 'neutron:network_name': 'neutron-fb218033-3d98-4065-b336-c595d5e6ca77', 'neutron:port_capabilities': '', 'neutron:port_name': '', 'neutron:project_id': '95de88f6d26e4420bc466ba67668171f', 'neutron:revision_number': '1', 'neutron:security_group_ids': '', 'neutron:subnet_pool_addr_scope4': '', 'neutron:subnet_pool_addr_scope6': '', 'neutron:vnic_type': 'normal'}, ha_chassis_group=[], options={'router-port': 'lrp-b291bf17-24f7-4815-bff8-3595d515760c'}, parent_name=[], enabled=[True], type=router, dhcpv6_options=[], tag_request=[], port_security=[], addresses=['router'], dynamic_addresses=[], dhcpv4_options=[], tag=[]) old=Logical_Switch_Port(options={'mcast_flood_reports': 'true'}, addresses=['unknown']) {{(pid=77618) matches /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} May 28 12:44:03 l75lg1-v1 neutron-server[77618]: INFO neutron.tests.unit.plugins.ml2.drivers.mechanism_logger [None req-5ba0b4eb-00ab-4523-a874-41c9965d7fce None None] update_port_precommit called with port settings {'id': 'b291bf17-24f7-4815-bff8-3595d515760c', 'name': '', 'network_id': 'fb218033-3d98-4065-b336-c595d5e6ca77', 'tenant_id': '95de88f6d26e4420bc466ba67668171f', 'mac_address': 'fa:16:3e:35:c0:d8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '80c11046-4421-4321-813a-d46f0332997a', 'device_owner': 'network:router_interface', 'standard_attr_id': 26, 'fixed_ips': [{'subnet_id': '5508b790-cc91-4b59-8d30-81ef4480e470', 'ip_address': '10.0.0.1'}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2024-05-28T12:44:01Z', 'updated_at': '2024-05-28T12:44:03Z', 'revision_number': 2, 'project_id': '95de88f6d26e4420bc466ba67668171f'} (original settings {'id': 'b291bf17-24f7-4815-bff8-3595d515760c', 'name': '', 'network_id': 'fb218033-3d98-4065-b336-c595d5e6ca77', 'tenant_id': '95de88f6d26e4420bc466ba67668171f', 'mac_address': 'fa:16:3e:35:c0:d8', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '80c11046-4421-4321-813a-d46f0332997a', 'device_owner': 'network:router_interface', 'standard_attr_id': 26, 'fixed_ips': [{'subnet_id': '5508b790-cc91-4b59-8d30-81ef4480e470', 'ip_address': '10.0.0.1'}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2024-05-28T12:44:01Z', 'updated_at': '2024-05-28T12:44:02Z', 'revision_number': 1, 'project_id': '95de88f6d26e4420bc466ba67668171f'}) host (original host ) vif type unbound (original vif type unbound) vif details {} (original vif details {}) binding levels None (original binding levels None) on network {'id': 'fb218033-3d98-4065-b336-c595d5e6ca77', 'name': 'private', 'tenant_id': '95de88f6d26e4420bc466ba67668171f', 'admin_state_up': True, 'mtu': 1442, 'status': 'ACTIVE', 'subnets': ['5508b790-cc91-4b59-8d30-81ef4480e470', '799ded51-0b75-4f67-94e9-0a7ea3c3f3d6'], 'standard_attr_id': 12, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'vlan_transparent': None, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2024-05-28T12:43:43Z', 'updated_at': '2024-05-28T12:43:49Z', 'revision_number': 3, 'project_id': '95de88f6d26e4420bc466ba67668171f', 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 30276} with segments to bind None May 28 12:44:03 l75lg1-v1 neutron-server[77618]: DEBUG neutron.tests.unit.plugins.ml2.drivers.mechanism_logger [None req-5ba0b4eb-00ab-4523-a874-41c9965d7fce None None] update_port_precommit: May 28 12:44:03 l75lg1-v1 neutron-server[77618]: key[status], DOWN -> ACTIVE May 28 12:44:03 l75lg1-v1 neutron-server[77618]: key[updated_at], 2024-05-28T12:44:02Z -> 2024-05-28T12:44:03Z May 28 12:44:03 l75lg1-v1 neutron-server[77618]: key[revision_number], 1 -> 2 May 28 12:44:03 l75lg1-v1 neutron-server[77618]: {{(pid=77618) _log_diff_call /opt/stack/neutron/neutron/tests/unit/plugins/ml2/drivers/mechanism_logger.py:59}} May 28 12:44:03 l75lg1-v1 neutron-server[77618]: DEBUG ovsdbapp.backend.ovs_idl.transaction [None req-c63b1acc-b5c6-4be8-9db9-04824fec27f2 None None] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=b291bf17-24f7-4815-bff8-3595d515760c, resource={'id': 'b291bf17-24f7-4815-bff8-3595d515760c', 'name': '', 'network_id': 'fb218033-3d98-4065-b336-c595d5e6ca77', 'tenant_id': '95de88f6d26e4420bc466ba67668171f', 'mac_address': 'fa:16:3e:35:c0:d8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '80c11046-4421-4321-813a-d46f0332997a', 'device_owner': 'network:router_interface', 'standard_attr_id': 26, 'fixed_ips': [{'subnet_id': '5508b790-cc91-4b59-8d30-81ef4480e470', 'ip_address': '10.0.0.1'}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2024-05-28T12:44:01Z', 'updated_at': '2024-05-28T12:44:03Z', 'revision_number': 2, 'project_id': '95de88f6d26e4420bc466ba67668171f', 'network': {'id': 'fb218033-3d98-4065-b336-c595d5e6ca77', 'name': 'private', 'tenant_id': '95de88f6d26e4420bc466ba67668171f', 'admin_state_up': True, 'mtu': 1442, 'status': 'ACTIVE', 'subnets': ['5508b790-cc91-4b59-8d30-81ef4480e470', '799ded51-0b75-4f67-94e9-0a7ea3c3f3d6'], 'standard_attr_id': 12, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'vlan_transparent': None, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2024-05-28T12:43:43Z', 'updated_at': '2024-05-28T12:43:49Z', 'revision_number': 3, 'project_id': '95de88f6d26e4420bc466ba67668171f', 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 30276}}, resource_type=ports, if_exists=True) {{(pid=77618) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:44:03 l75lg1-v1 neutron-server[77618]: DEBUG ovsdbapp.backend.ovs_idl.transaction [None req-c63b1acc-b5c6-4be8-9db9-04824fec27f2 None None] Running txn n=1 command(idx=1): SetLSwitchPortCommand(_result=None, lport=b291bf17-24f7-4815-bff8-3595d515760c, external_ids_update=None, columns={'external_ids': {'neutron:port_name': '', 'neutron:device_id': '80c11046-4421-4321-813a-d46f0332997a', 'neutron:project_id': '95de88f6d26e4420bc466ba67668171f', 'neutron:cidrs': '10.0.0.1/26', 'neutron:device_owner': 'network:router_interface', 'neutron:subnet_pool_addr_scope4': '', 'neutron:subnet_pool_addr_scope6': '', 'neutron:network_name': 'neutron-fb218033-3d98-4065-b336-c595d5e6ca77', 'neutron:security_group_ids': '', 'neutron:revision_number': '2', 'neutron:vnic_type': 'normal', 'neutron:port_capabilities': '', 'neutron:mtu': ''}, 'parent_name': [], 'tag': [], 'options': {'mcast_flood_reports': 'true', 'router-port': 'lrp-b291bf17-24f7-4815-bff8-3595d515760c'}, 'enabled': True, 'port_security': [], 'dhcpv4_options': [], 'dhcpv6_options': [], 'type': 'router', 'ha_chassis_group': []}, if_exists=False) {{(pid=77618) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:44:03 l75lg1-v1 neutron-server[77618]: DEBUG ovsdbapp.backend.ovs_idl.transaction [None req-c63b1acc-b5c6-4be8-9db9-04824fec27f2 None None] Running txn n=1 command(idx=2): PgDelPortCommand(_result=None, port_group=neutron_pg_drop, lsp=['b291bf17-24f7-4815-bff8-3595d515760c'], if_exists=False) {{(pid=77618) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:44:03 l75lg1-v1 neutron-server[77618]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-c63b1acc-b5c6-4be8-9db9-04824fec27f2 None None] Hash Ring: Node 4c6fc793-7f5a-456f-b4d6-6e5bd97592f2 (host: l75lg1-v1) handling event "update" for row 804bc8b6-beaf-4289-82af-da67ea9be64f (table: Logical_Switch_Port) {{(pid=77618) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:44:03 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-03b5f984-1478-4ad6-9838-8e34c1689c5b None None] Hash Ring: Node c89b3497-133e-4a5a-b67a-3310d2cb2485 (host: l75lg1-v1) handling event "update" for row 6674b5f0-1e65-498e-a5df-b24bb99a66b3 (table: Port_Binding) {{(pid=77619) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:44:03 l75lg1-v1 neutron-server[77618]: DEBUG ovsdbapp.backend.ovs_idl.event [None req-c63b1acc-b5c6-4be8-9db9-04824fec27f2 None None] Matched UPDATE: LogicalSwitchPortUpdateLogicalRouterPortEvent(events=('update',), table='Logical_Switch_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Switch_Port(up=[True], name=b291bf17-24f7-4815-bff8-3595d515760c, external_ids={'neutron:cidrs': '10.0.0.1/26', 'neutron:device_id': '80c11046-4421-4321-813a-d46f0332997a', 'neutron:device_owner': 'network:router_interface', 'neutron:mtu': '', 'neutron:network_name': 'neutron-fb218033-3d98-4065-b336-c595d5e6ca77', 'neutron:port_capabilities': '', 'neutron:port_name': '', 'neutron:project_id': '95de88f6d26e4420bc466ba67668171f', 'neutron:revision_number': '2', 'neutron:security_group_ids': '', 'neutron:subnet_pool_addr_scope4': '', 'neutron:subnet_pool_addr_scope6': '', 'neutron:vnic_type': 'normal'}, ha_chassis_group=[], options={'router-port': 'lrp-b291bf17-24f7-4815-bff8-3595d515760c', 'mcast_flood_reports': 'true'}, parent_name=[], enabled=[True], type=router, dhcpv6_options=[], tag_request=[], port_security=[], addresses=['router'], dynamic_addresses=[], dhcpv4_options=[], tag=[]) old=Logical_Switch_Port(external_ids={'neutron:cidrs': '10.0.0.1/26', 'neutron:device_id': '80c11046-4421-4321-813a-d46f0332997a', 'neutron:device_owner': 'network:router_interface', 'neutron:mtu': '', 'neutron:network_name': 'neutron-fb218033-3d98-4065-b336-c595d5e6ca77', 'neutron:port_capabilities': '', 'neutron:port_name': '', 'neutron:project_id': '95de88f6d26e4420bc466ba67668171f', 'neutron:revision_number': '1', 'neutron:security_group_ids': '', 'neutron:subnet_pool_addr_scope4': '', 'neutron:subnet_pool_addr_scope6': '', 'neutron:vnic_type': 'normal'}, options={'router-port': 'lrp-b291bf17-24f7-4815-bff8-3595d515760c'}) {{(pid=77618) matches /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} May 28 12:44:03 l75lg1-v1 neutron-server[77618]: INFO neutron.db.ovn_revision_numbers_db [None req-5ba0b4eb-00ab-4523-a874-41c9965d7fce None None] Successfully bumped revision number for resource b291bf17-24f7-4815-bff8-3595d515760c (type: ports) to 2 May 28 12:44:03 l75lg1-v1 neutron-server[77618]: INFO neutron.tests.unit.plugins.ml2.drivers.mechanism_logger [None req-5ba0b4eb-00ab-4523-a874-41c9965d7fce None None] update_port_postcommit called with port settings {'id': 'b291bf17-24f7-4815-bff8-3595d515760c', 'name': '', 'network_id': 'fb218033-3d98-4065-b336-c595d5e6ca77', 'tenant_id': '95de88f6d26e4420bc466ba67668171f', 'mac_address': 'fa:16:3e:35:c0:d8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '80c11046-4421-4321-813a-d46f0332997a', 'device_owner': 'network:router_interface', 'standard_attr_id': 26, 'fixed_ips': [{'subnet_id': '5508b790-cc91-4b59-8d30-81ef4480e470', 'ip_address': '10.0.0.1'}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2024-05-28T12:44:01Z', 'updated_at': '2024-05-28T12:44:03Z', 'revision_number': 2, 'project_id': '95de88f6d26e4420bc466ba67668171f'} (original settings {'id': 'b291bf17-24f7-4815-bff8-3595d515760c', 'name': '', 'network_id': 'fb218033-3d98-4065-b336-c595d5e6ca77', 'tenant_id': '95de88f6d26e4420bc466ba67668171f', 'mac_address': 'fa:16:3e:35:c0:d8', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '80c11046-4421-4321-813a-d46f0332997a', 'device_owner': 'network:router_interface', 'standard_attr_id': 26, 'fixed_ips': [{'subnet_id': '5508b790-cc91-4b59-8d30-81ef4480e470', 'ip_address': '10.0.0.1'}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2024-05-28T12:44:01Z', 'updated_at': '2024-05-28T12:44:02Z', 'revision_number': 1, 'project_id': '95de88f6d26e4420bc466ba67668171f'}) host (original host ) vif type unbound (original vif type unbound) vif details {} (original vif details {}) binding levels None (original binding levels None) on network {'id': 'fb218033-3d98-4065-b336-c595d5e6ca77', 'name': 'private', 'tenant_id': '95de88f6d26e4420bc466ba67668171f', 'admin_state_up': True, 'mtu': 1442, 'status': 'ACTIVE', 'subnets': ['5508b790-cc91-4b59-8d30-81ef4480e470', '799ded51-0b75-4f67-94e9-0a7ea3c3f3d6'], 'standard_attr_id': 12, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'vlan_transparent': None, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2024-05-28T12:43:43Z', 'updated_at': '2024-05-28T12:43:49Z', 'revision_number': 3, 'project_id': '95de88f6d26e4420bc466ba67668171f', 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 30276} with segments to bind None May 28 12:44:03 l75lg1-v1 neutron-server[77618]: DEBUG neutron.tests.unit.plugins.ml2.drivers.mechanism_logger [None req-5ba0b4eb-00ab-4523-a874-41c9965d7fce None None] update_port_postcommit: May 28 12:44:03 l75lg1-v1 neutron-server[77618]: key[status], DOWN -> ACTIVE May 28 12:44:03 l75lg1-v1 neutron-server[77618]: key[updated_at], 2024-05-28T12:44:02Z -> 2024-05-28T12:44:03Z May 28 12:44:03 l75lg1-v1 neutron-server[77618]: key[revision_number], 1 -> 2 May 28 12:44:03 l75lg1-v1 neutron-server[77618]: {{(pid=77618) _log_diff_call /opt/stack/neutron/neutron/tests/unit/plugins/ml2/drivers/mechanism_logger.py:59}} May 28 12:44:03 l75lg1-v1 neutron-server[77618]: DEBUG neutron_lib.callbacks.manager [None req-5ba0b4eb-00ab-4523-a874-41c9965d7fce None None] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4166243', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8754903016533', 'neutron.services.ovn_l3.plugin.OVNL3RouterPlugin._port_update-8754901907784'] for port (b291bf17-24f7-4815-bff8-3595d515760c), after_update {{(pid=77618) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:44:03 l75lg1-v1 neutron-server[77618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5ba0b4eb-00ab-4523-a874-41c9965d7fce None None] Pushing event updated for resources: {'Port': ['ID=b291bf17-24f7-4815-bff8-3595d515760c,revision_number=2']} {{(pid=77618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 28 12:44:04 l75lg1-v1 dstat.sh[49771]: 28-05 12:44:04| 15 2 82 1 0|2750M 6750M 267M 5931M| 11k 3210B| 0 2304k| 0 332 |2634 3527 |1.29 1.77 1.25|1.0 0 39| 0 0 | 0 2048M| 23 120 0 36 0 May 28 12:44:05 l75lg1-v1 dstat.sh[49771]: 28-05 12:44:05| 9 1 89 0 0|2772M 6728M 267M 5931M| 17k 0 | 0 324k| 0 20.0 |1218 1403 |1.29 1.77 1.25|1.0 0 0| 0 0 | 0 2048M| 23 120 0 36 0 May 28 12:44:05 l75lg1-v1 neutron-server[77623]: DEBUG dbcounter [-] [77623] Writer thread running {{(pid=77623) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} May 28 12:44:05 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579a9604-6a8a-4d4f-adfb-da1bd40dac10 None None] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:44:05 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579a9604-6a8a-4d4f-adfb-da1bd40dac10 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:44:05 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579a9604-6a8a-4d4f-adfb-da1bd40dac10 None None] PATH_INFO: `/` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:44:05 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 461/906] 10.27.203.238 () {58 vars in 1014 bytes} [Tue May 28 12:44:05 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:44:05 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0086d741-68a1-48f7-9d04-3560fce95008 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:44:05 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0086d741-68a1-48f7-9d04-3560fce95008 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:44:05 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0086d741-68a1-48f7-9d04-3560fce95008 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:44:05 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-0086d741-68a1-48f7-9d04-3560fce95008 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:44:05 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-0086d741-68a1-48f7-9d04-3560fce95008 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:44:05 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-0086d741-68a1-48f7-9d04-3560fce95008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:44:05 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 446/907] 10.27.203.238 () {62 vars in 1111 bytes} [Tue May 28 12:44:05 2024] POST /identity/v3/auth/tokens => generated 3991 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:44:05 l75lg1-v1 neutron-server[77619]: DEBUG neutron.wsgi [-] (77619) accepted ('10.27.203.238', 49952) {{(pid=77619) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 12:44:05 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579a9604-6a8a-4d4f-adfb-da1bd40dac10 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:44:05 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579a9604-6a8a-4d4f-adfb-da1bd40dac10 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:44:05 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63665db9-4477-422e-a4f3-37a16e5a7972 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef17047035e4b518fd5360a01f2da1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:44:05 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63665db9-4477-422e-a4f3-37a16e5a7972 service neutron] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:44:05 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63665db9-4477-422e-a4f3-37a16e5a7972 service neutron] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:44:05 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63665db9-4477-422e-a4f3-37a16e5a7972 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:44:05 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63665db9-4477-422e-a4f3-37a16e5a7972 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:44:05 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63665db9-4477-422e-a4f3-37a16e5a7972 service neutron] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:44:05 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 462/908] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 12:44:05 2024] GET /identity/v3/auth/tokens => generated 3991 bytes in 19 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 12:44:05 l75lg1-v1 neutron-server[77619]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2b30f92f-4d2e-4474-8196-b7bd52ec0dc9 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=77619) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:258}} May 28 12:44:05 l75lg1-v1 neutron-server[77619]: INFO neutron.wsgi [None req-2b30f92f-4d2e-4474-8196-b7bd52ec0dc9 admin admin] 10.27.203.238 "GET /networking/v2.0/networks/5066e001-05ee-4812-ba7f-98a035d8bd0a HTTP/1.1" status: 200 len: 840 time: 0.0640786 May 28 12:44:05 l75lg1-v1 neutron-server[77619]: DEBUG neutron.api.v2.base [None req-08465162-549a-49d9-9830-b0ed89293511 admin admin] Request body: {'subnet': {'ip_version': 4, 'cidr': '172.24.4.0/24', 'name': 'public-subnet', 'network_id': '5066e001-05ee-4812-ba7f-98a035d8bd0a', 'enable_dhcp': False}} {{(pid=77619) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:734}} May 28 12:44:06 l75lg1-v1 neutron-server[77619]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-08465162-549a-49d9-9830-b0ed89293511 admin admin] Made reservation on behalf of ea8d517cde1d40bb82c97e080ce071f7 for: {'subnet': 1} {{(pid=77619) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 28 12:44:06 l75lg1-v1 neutron-server[77619]: DEBUG neutron_lib.callbacks.manager [None req-08465162-549a-49d9-9830-b0ed89293511 admin admin] Publish callbacks [] for subnet (None), before_create {{(pid=77619) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:44:06 l75lg1-v1 neutron-server[77619]: DEBUG neutron.db.ovn_revision_numbers_db [None req-08465162-549a-49d9-9830-b0ed89293511 admin admin] create_initial_revision uuid=cddf717c-a51e-4470-8ce9-c2ab09a80e38, type=subnets, rev=-1 {{(pid=77619) create_initial_revision /opt/stack/neutron/neutron/db/ovn_revision_numbers_db.py:108}} May 28 12:44:06 l75lg1-v1 neutron-server[77619]: INFO neutron.tests.unit.plugins.ml2.drivers.mechanism_logger [None req-08465162-549a-49d9-9830-b0ed89293511 admin admin] create_subnet_precommit called with subnet settings {'id': 'cddf717c-a51e-4470-8ce9-c2ab09a80e38', 'name': 'public-subnet', 'tenant_id': 'ea8d517cde1d40bb82c97e080ce071f7', 'network_id': '5066e001-05ee-4812-ba7f-98a035d8bd0a', 'ip_version': 4, 'subnetpool_id': None, 'enable_dhcp': False, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'standard_attr_id': 27, 'gateway_ip': '172.24.4.1', 'cidr': '172.24.4.0/24', 'allocation_pools': [{'start': '172.24.4.2', 'end': '172.24.4.254'}], 'host_routes': [], 'dns_nameservers': [], 'shared': False, 'description': '', 'service_types': [], 'tags': [], 'created_at': '2024-05-28T12:44:06Z', 'updated_at': '2024-05-28T12:44:06Z', 'revision_number': 0, 'project_id': 'ea8d517cde1d40bb82c97e080ce071f7'} (original settings None) May 28 12:44:06 l75lg1-v1 neutron-server[77619]: DEBUG neutron.tests.unit.plugins.ml2.drivers.mechanism_logger [None req-08465162-549a-49d9-9830-b0ed89293511 admin admin] create_subnet_precommit: May 28 12:44:06 l75lg1-v1 neutron-server[77619]: key[tenant_id], None -> ea8d517cde1d40bb82c97e080ce071f7 May 28 12:44:06 l75lg1-v1 neutron-server[77619]: key[network_id], None -> 5066e001-05ee-4812-ba7f-98a035d8bd0a May 28 12:44:06 l75lg1-v1 neutron-server[77619]: key[revision_number], None -> 0 May 28 12:44:06 l75lg1-v1 neutron-server[77619]: key[project_id], None -> ea8d517cde1d40bb82c97e080ce071f7 May 28 12:44:06 l75lg1-v1 neutron-server[77619]: key[id], None -> cddf717c-a51e-4470-8ce9-c2ab09a80e38 May 28 12:44:06 l75lg1-v1 neutron-server[77619]: key[tags], None -> [] May 28 12:44:06 l75lg1-v1 neutron-server[77619]: key[created_at], None -> 2024-05-28T12:44:06Z May 28 12:44:06 l75lg1-v1 neutron-server[77619]: key[allocation_pools], None -> [{'start': '172.24.4.2', 'end': '172.24.4.254'}] May 28 12:44:06 l75lg1-v1 neutron-server[77619]: key[subnetpool_id], None -> None May 28 12:44:06 l75lg1-v1 neutron-server[77619]: key[host_routes], None -> [] May 28 12:44:06 l75lg1-v1 neutron-server[77619]: key[gateway_ip], None -> 172.24.4.1 May 28 12:44:06 l75lg1-v1 neutron-server[77619]: key[service_types], None -> [] May 28 12:44:06 l75lg1-v1 neutron-server[77619]: key[updated_at], None -> 2024-05-28T12:44:06Z May 28 12:44:06 l75lg1-v1 neutron-server[77619]: key[standard_attr_id], None -> 27 May 28 12:44:06 l75lg1-v1 neutron-server[77619]: key[ip_version], None -> 4 May 28 12:44:06 l75lg1-v1 neutron-server[77619]: key[cidr], None -> 172.24.4.0/24 May 28 12:44:06 l75lg1-v1 neutron-server[77619]: key[dns_nameservers], None -> [] May 28 12:44:06 l75lg1-v1 neutron-server[77619]: key[ipv6_address_mode], None -> None May 28 12:44:06 l75lg1-v1 neutron-server[77619]: key[description], None -> May 28 12:44:06 l75lg1-v1 neutron-server[77619]: key[ipv6_ra_mode], None -> None May 28 12:44:06 l75lg1-v1 neutron-server[77619]: key[enable_dhcp], None -> False May 28 12:44:06 l75lg1-v1 neutron-server[77619]: key[shared], None -> False May 28 12:44:06 l75lg1-v1 neutron-server[77619]: key[name], None -> public-subnet May 28 12:44:06 l75lg1-v1 neutron-server[77619]: {{(pid=77619) _log_diff_call /opt/stack/neutron/neutron/tests/unit/plugins/ml2/drivers/mechanism_logger.py:59}} May 28 12:44:06 l75lg1-v1 neutron-server[77619]: DEBUG neutron.objects.ports [None req-08465162-549a-49d9-9830-b0ed89293511 admin admin] Time-cost: Fetching 0 ports in 0 security groups {{(pid=77619) get_objects /opt/stack/neutron/neutron/objects/ports.py:497}} May 28 12:44:06 l75lg1-v1 neutron-server[77619]: DEBUG neutron_lib.callbacks.manager [None req-08465162-549a-49d9-9830-b0ed89293511 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4166501'] for subnet (cddf717c-a51e-4470-8ce9-c2ab09a80e38), after_create {{(pid=77619) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:44:06 l75lg1-v1 neutron-server[77619]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-08465162-549a-49d9-9830-b0ed89293511 admin admin] Pushing event updated for resources: {'Subnet': ['ID=cddf717c-a51e-4470-8ce9-c2ab09a80e38,revision_number=0']} {{(pid=77619) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 28 12:44:06 l75lg1-v1 neutron-server[77619]: INFO neutron.db.ovn_revision_numbers_db [None req-08465162-549a-49d9-9830-b0ed89293511 admin admin] Successfully bumped revision number for resource cddf717c-a51e-4470-8ce9-c2ab09a80e38 (type: subnets) to 0 May 28 12:44:06 l75lg1-v1 neutron-server[77619]: INFO neutron.tests.unit.plugins.ml2.drivers.mechanism_logger [None req-08465162-549a-49d9-9830-b0ed89293511 admin admin] create_subnet_postcommit called with subnet settings {'id': 'cddf717c-a51e-4470-8ce9-c2ab09a80e38', 'name': 'public-subnet', 'tenant_id': 'ea8d517cde1d40bb82c97e080ce071f7', 'network_id': '5066e001-05ee-4812-ba7f-98a035d8bd0a', 'ip_version': 4, 'subnetpool_id': None, 'enable_dhcp': False, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'standard_attr_id': 27, 'gateway_ip': '172.24.4.1', 'cidr': '172.24.4.0/24', 'allocation_pools': [{'start': '172.24.4.2', 'end': '172.24.4.254'}], 'host_routes': [], 'dns_nameservers': [], 'shared': False, 'description': '', 'service_types': [], 'tags': [], 'created_at': '2024-05-28T12:44:06Z', 'updated_at': '2024-05-28T12:44:06Z', 'revision_number': 0, 'project_id': 'ea8d517cde1d40bb82c97e080ce071f7', 'network': {'id': '5066e001-05ee-4812-ba7f-98a035d8bd0a', 'name': 'public', 'tenant_id': 'ea8d517cde1d40bb82c97e080ce071f7', 'admin_state_up': True, 'mtu': 1500, 'status': 'ACTIVE', 'subnets': ['cddf717c-a51e-4470-8ce9-c2ab09a80e38'], 'standard_attr_id': 23, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': True, 'vlan_transparent': None, 'description': '', 'port_security_enabled': True, 'is_default': True, 'tags': [], 'created_at': '2024-05-28T12:43:59Z', 'updated_at': '2024-05-28T12:44:06Z', 'revision_number': 2, 'project_id': 'ea8d517cde1d40bb82c97e080ce071f7', 'provider:network_type': 'flat', 'provider:physical_network': 'public', 'provider:segmentation_id': None}} (original settings None) May 28 12:44:06 l75lg1-v1 neutron-server[77619]: DEBUG neutron.tests.unit.plugins.ml2.drivers.mechanism_logger [None req-08465162-549a-49d9-9830-b0ed89293511 admin admin] create_subnet_postcommit: May 28 12:44:06 l75lg1-v1 neutron-server[77619]: key[tenant_id], None -> ea8d517cde1d40bb82c97e080ce071f7 May 28 12:44:06 l75lg1-v1 neutron-server[77619]: key[network_id], None -> 5066e001-05ee-4812-ba7f-98a035d8bd0a May 28 12:44:06 l75lg1-v1 neutron-server[77619]: key[revision_number], None -> 0 May 28 12:44:06 l75lg1-v1 neutron-server[77619]: key[project_id], None -> ea8d517cde1d40bb82c97e080ce071f7 May 28 12:44:06 l75lg1-v1 neutron-server[77619]: key[id], None -> cddf717c-a51e-4470-8ce9-c2ab09a80e38 May 28 12:44:06 l75lg1-v1 neutron-server[77619]: key[tags], None -> [] May 28 12:44:06 l75lg1-v1 neutron-server[77619]: key[created_at], None -> 2024-05-28T12:44:06Z May 28 12:44:06 l75lg1-v1 neutron-server[77619]: key[allocation_pools], None -> [{'start': '172.24.4.2', 'end': '172.24.4.254'}] May 28 12:44:06 l75lg1-v1 neutron-server[77619]: key[subnetpool_id], None -> None May 28 12:44:06 l75lg1-v1 neutron-server[77619]: key[host_routes], None -> [] May 28 12:44:06 l75lg1-v1 neutron-server[77619]: key[gateway_ip], None -> 172.24.4.1 May 28 12:44:06 l75lg1-v1 neutron-server[77619]: key[service_types], None -> [] May 28 12:44:06 l75lg1-v1 neutron-server[77619]: key[updated_at], None -> 2024-05-28T12:44:06Z May 28 12:44:06 l75lg1-v1 neutron-server[77619]: key[network], None -> {'id': '5066e001-05ee-4812-ba7f-98a035d8bd0a', 'name': 'public', 'tenant_id': 'ea8d517cde1d40bb82c97e080ce071f7', 'admin_state_up': True, 'mtu': 1500, 'status': 'ACTIVE', 'subnets': ['cddf717c-a51e-4470-8ce9-c2ab09a80e38'], 'standard_attr_id': 23, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': True, 'vlan_transparent': None, 'description': '', 'port_security_enabled': True, 'is_default': True, 'tags': [], 'created_at': '2024-05-28T12:43:59Z', 'updated_at': '2024-05-28T12:44:06Z', 'revision_number': 2, 'project_id': 'ea8d517cde1d40bb82c97e080ce071f7', 'provider:network_type': 'flat', 'provider:physical_network': 'public', 'provider:segmentation_id': None} May 28 12:44:06 l75lg1-v1 neutron-server[77619]: key[standard_attr_id], None -> 27 May 28 12:44:06 l75lg1-v1 neutron-server[77619]: key[ip_version], None -> 4 May 28 12:44:06 l75lg1-v1 neutron-server[77619]: key[cidr], None -> 172.24.4.0/24 May 28 12:44:06 l75lg1-v1 neutron-server[77619]: key[dns_nameservers], None -> [] May 28 12:44:06 l75lg1-v1 neutron-server[77619]: key[ipv6_address_mode], None -> None May 28 12:44:06 l75lg1-v1 neutron-server[77619]: key[description], None -> May 28 12:44:06 l75lg1-v1 neutron-server[77619]: key[ipv6_ra_mode], None -> None May 28 12:44:06 l75lg1-v1 neutron-server[77619]: key[enable_dhcp], None -> False May 28 12:44:06 l75lg1-v1 neutron-server[77619]: key[shared], None -> False May 28 12:44:06 l75lg1-v1 neutron-server[77619]: key[name], None -> public-subnet May 28 12:44:06 l75lg1-v1 neutron-server[77619]: {{(pid=77619) _log_diff_call /opt/stack/neutron/neutron/tests/unit/plugins/ml2/drivers/mechanism_logger.py:59}} May 28 12:44:06 l75lg1-v1 neutron-server[77619]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-08465162-549a-49d9-9830-b0ed89293511 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=77619) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:258}} May 28 12:44:06 l75lg1-v1 neutron-server[77619]: DEBUG neutron_lib.callbacks.manager [None req-08465162-549a-49d9-9830-b0ed89293511 admin admin] Publish callbacks [] for subnet (None), before_response {{(pid=77619) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:44:06 l75lg1-v1 dstat.sh[49771]: 28-05 12:44:06| 10 1 88 1 0|2795M 6705M 267M 5931M| 15k 172B| 0 776k| 0 107 |2587 3745 |1.29 1.77 1.25| 0 1.0 1.0| 0 0 | 0 2048M| 23 124 0 36 0 May 28 12:44:06 l75lg1-v1 neutron-server[77619]: INFO neutron.wsgi [None req-08465162-549a-49d9-9830-b0ed89293511 admin admin] 10.27.203.238 "POST /networking/v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 0.2605932 May 28 12:44:07 l75lg1-v1 dstat.sh[49771]: 28-05 12:44:07| 9 1 89 0 0|2775M 6725M 267M 5931M| 15k 6758B| 0 476k| 0 46.0 |2005 2364 |1.27 1.76 1.25|1.0 0 81| 0 0 | 0 2048M| 23 122 0 37 0 May 28 12:44:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c6befb-fc81-4ccf-8404-821b0779a9a4 None None] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:44:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c6befb-fc81-4ccf-8404-821b0779a9a4 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:44:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c6befb-fc81-4ccf-8404-821b0779a9a4 None None] PATH_INFO: `/` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:44:07 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 447/909] 10.27.203.238 () {58 vars in 1014 bytes} [Tue May 28 12:44:07 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:44:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190ab8d7-ecb1-4f64-9afd-ef764997a01a None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:44:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190ab8d7-ecb1-4f64-9afd-ef764997a01a None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:44:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190ab8d7-ecb1-4f64-9afd-ef764997a01a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:44:07 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-190ab8d7-ecb1-4f64-9afd-ef764997a01a None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:44:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-190ab8d7-ecb1-4f64-9afd-ef764997a01a None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:44:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-190ab8d7-ecb1-4f64-9afd-ef764997a01a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:44:07 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 463/910] 10.27.203.238 () {62 vars in 1111 bytes} [Tue May 28 12:44:07 2024] POST /identity/v3/auth/tokens => generated 3990 bytes in 23 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:44:07 l75lg1-v1 neutron-server[77619]: DEBUG neutron.wsgi [-] (77619) accepted ('10.27.203.238', 49962) {{(pid=77619) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 12:44:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c6befb-fc81-4ccf-8404-821b0779a9a4 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:44:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c6befb-fc81-4ccf-8404-821b0779a9a4 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:44:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcd66fb-7bfe-4cef-9b65-16958030d356 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef17047035e4b518fd5360a01f2da1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:44:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcd66fb-7bfe-4cef-9b65-16958030d356 service neutron] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:44:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcd66fb-7bfe-4cef-9b65-16958030d356 service neutron] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:44:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcd66fb-7bfe-4cef-9b65-16958030d356 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:44:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcd66fb-7bfe-4cef-9b65-16958030d356 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:44:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcd66fb-7bfe-4cef-9b65-16958030d356 service neutron] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:44:07 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 448/911] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 12:44:07 2024] GET /identity/v3/auth/tokens => generated 3990 bytes in 29 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 12:44:08 l75lg1-v1 neutron-server[77619]: INFO neutron.wsgi [None req-174932b9-8b8f-40ae-b22b-241fd40cb5ef demo admin] 10.27.203.238 "GET /networking/v2.0/routers/80c11046-4421-4321-813a-d46f0332997a HTTP/1.1" status: 200 len: 777 time: 0.1052475 May 28 12:44:08 l75lg1-v1 neutron-server[77619]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-452d0ada-2801-4938-b0e5-ded7f1107d22 demo admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=77619) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:258}} May 28 12:44:08 l75lg1-v1 neutron-server[77619]: INFO neutron.wsgi [None req-452d0ada-2801-4938-b0e5-ded7f1107d22 demo admin] 10.27.203.238 "GET /networking/v2.0/networks/5066e001-05ee-4812-ba7f-98a035d8bd0a HTTP/1.1" status: 200 len: 878 time: 0.0515819 May 28 12:44:08 l75lg1-v1 neutron-server[77619]: DEBUG neutron.api.v2.base [None req-aca31e9c-8399-48d8-95b9-d8310637d33b demo admin] Request body: {'router': {'external_gateway_info': {'network_id': '5066e001-05ee-4812-ba7f-98a035d8bd0a'}}} {{(pid=77619) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:734}} May 28 12:44:08 l75lg1-v1 dstat.sh[49771]: 28-05 12:44:08| 10 1 87 2 0|2799M 6700M 267M 5931M| 15k 0 | 0 4087k| 0 265 |2344 3234 |1.27 1.76 1.25|1.0 0 2.0| 0 0 | 0 2048M| 23 124 0 37 0 May 28 12:44:08 l75lg1-v1 neutron-server[77619]: DEBUG neutron_lib.callbacks.manager [None req-aca31e9c-8399-48d8-95b9-d8310637d33b demo admin] Publish callbacks [] for router_gateway (80c11046-4421-4321-813a-d46f0332997a), precommit_update {{(pid=77619) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:44:08 l75lg1-v1 neutron-server[77619]: DEBUG neutron_lib.callbacks.manager [None req-aca31e9c-8399-48d8-95b9-d8310637d33b demo admin] Publish callbacks [] for router_gateway (80c11046-4421-4321-813a-d46f0332997a), before_create {{(pid=77619) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:44:08 l75lg1-v1 neutron-server[77618]: WARNING neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_client [None req-5ba0b4eb-00ab-4523-a874-41c9965d7fce None None] No hosting information found for port b291bf17-24f7-4815-bff8-3595d515760c: RuntimeError: No hosting information found for port b291bf17-24f7-4815-bff8-3595d515760c May 28 12:44:08 l75lg1-v1 neutron-server[77619]: DEBUG neutron_lib.callbacks.manager [None req-aca31e9c-8399-48d8-95b9-d8310637d33b demo admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1015114'] for port (None), before_create {{(pid=77619) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:44:08 l75lg1-v1 neutron-server[77619]: DEBUG neutron.db.db_base_plugin_common [None req-aca31e9c-8399-48d8-95b9-d8310637d33b demo admin] Allocated IP 172.24.4.236 (5066e001-05ee-4812-ba7f-98a035d8bd0a/cddf717c-a51e-4470-8ce9-c2ab09a80e38/be7063e1-bd60-43c5-bc4e-91151583d1f2) {{(pid=77619) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:134}} May 28 12:44:08 l75lg1-v1 neutron-server[77618]: DEBUG ovsdbapp.backend.ovs_idl.transaction [None req-c63b1acc-b5c6-4be8-9db9-04824fec27f2 None None] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=lrp-b291bf17-24f7-4815-bff8-3595d515760c, resource={'id': 'b291bf17-24f7-4815-bff8-3595d515760c', 'name': '', 'network_id': 'fb218033-3d98-4065-b336-c595d5e6ca77', 'tenant_id': '95de88f6d26e4420bc466ba67668171f', 'mac_address': 'fa:16:3e:35:c0:d8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '80c11046-4421-4321-813a-d46f0332997a', 'device_owner': 'network:router_interface', 'standard_attr_id': 26, 'fixed_ips': [{'subnet_id': '5508b790-cc91-4b59-8d30-81ef4480e470', 'ip_address': '10.0.0.1'}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2024-05-28T12:44:01Z', 'updated_at': '2024-05-28T12:44:03Z', 'revision_number': 2, 'project_id': '95de88f6d26e4420bc466ba67668171f'}, resource_type=router_ports, if_exists=True) {{(pid=77618) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:44:08 l75lg1-v1 neutron-server[77618]: DEBUG ovsdbapp.backend.ovs_idl.transaction [None req-c63b1acc-b5c6-4be8-9db9-04824fec27f2 None None] Running txn n=1 command(idx=1): UpdateLRouterPortCommand(_result=None, name=lrp-b291bf17-24f7-4815-bff8-3595d515760c, columns={'external_ids': {'neutron:revision_number': '2', 'neutron:subnet_ids': '5508b790-cc91-4b59-8d30-81ef4480e470', 'neutron:network_name': 'neutron-fb218033-3d98-4065-b336-c595d5e6ca77', 'neutron:is_ext_gw': 'False', 'neutron:router_name': '80c11046-4421-4321-813a-d46f0332997a'}, 'options': {}, 'networks': ['10.0.0.1/26'], 'ipv6_ra_configs': {}}, if_exists=False) {{(pid=77618) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:44:08 l75lg1-v1 neutron-server[77618]: DEBUG ovsdbapp.backend.ovs_idl.transaction [None req-c63b1acc-b5c6-4be8-9db9-04824fec27f2 None None] Running txn n=1 command(idx=2): SetLRouterPortInLSwitchPortCommand(_result=None, lswitch_port=b291bf17-24f7-4815-bff8-3595d515760c, lrouter_port=lrp-b291bf17-24f7-4815-bff8-3595d515760c, is_gw_port=False, if_exists=True, lsp_address=router) {{(pid=77618) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:44:08 l75lg1-v1 neutron-server[77618]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-c63b1acc-b5c6-4be8-9db9-04824fec27f2 None None] Hash Ring: Node 4c6fc793-7f5a-456f-b4d6-6e5bd97592f2 (host: l75lg1-v1) handling event "update" for row 98ceff9d-cdc0-4885-a56e-dedb12235e52 (table: Logical_Router_Port) {{(pid=77618) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:44:08 l75lg1-v1 neutron-server[77618]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-c63b1acc-b5c6-4be8-9db9-04824fec27f2 None None] Hash Ring: Node 4c6fc793-7f5a-456f-b4d6-6e5bd97592f2 (host: l75lg1-v1) handling event "update" for row 804bc8b6-beaf-4289-82af-da67ea9be64f (table: Logical_Switch_Port) {{(pid=77618) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:44:08 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-03b5f984-1478-4ad6-9838-8e34c1689c5b None None] Hash Ring: Node c89b3497-133e-4a5a-b67a-3310d2cb2485 (host: l75lg1-v1) handling event "update" for row 1fcc960e-70a0-4156-a0d7-b755514621fb (table: Port_Binding) {{(pid=77619) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:44:08 l75lg1-v1 neutron-server[77619]: DEBUG neutron_lib.callbacks.manager [None req-aca31e9c-8399-48d8-95b9-d8310637d33b demo admin] Publish callbacks [] for port (be7063e1-bd60-43c5-bc4e-91151583d1f2), precommit_create {{(pid=77619) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:44:08 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver [None req-aca31e9c-8399-48d8-95b9-d8310637d33b demo admin] No provisioning block for port be7063e1-bd60-43c5-bc4e-91151583d1f2 since it does not have a host {{(pid=77619) _is_port_provisioning_required /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/mech_driver.py:720}} May 28 12:44:08 l75lg1-v1 neutron-server[77619]: DEBUG neutron.db.ovn_revision_numbers_db [None req-aca31e9c-8399-48d8-95b9-d8310637d33b demo admin] create_initial_revision uuid=be7063e1-bd60-43c5-bc4e-91151583d1f2, type=ports, rev=-1 {{(pid=77619) create_initial_revision /opt/stack/neutron/neutron/db/ovn_revision_numbers_db.py:108}} May 28 12:44:08 l75lg1-v1 neutron-server[77618]: DEBUG ovsdbapp.backend.ovs_idl.event [None req-c63b1acc-b5c6-4be8-9db9-04824fec27f2 None None] Matched UPDATE: LogicalSwitchPortUpdateLogicalRouterPortEvent(events=('update',), table='Logical_Switch_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Switch_Port(up=[True], name=b291bf17-24f7-4815-bff8-3595d515760c, external_ids={'neutron:cidrs': '10.0.0.1/26', 'neutron:device_id': '80c11046-4421-4321-813a-d46f0332997a', 'neutron:device_owner': 'network:router_interface', 'neutron:mtu': '', 'neutron:network_name': 'neutron-fb218033-3d98-4065-b336-c595d5e6ca77', 'neutron:port_capabilities': '', 'neutron:port_name': '', 'neutron:project_id': '95de88f6d26e4420bc466ba67668171f', 'neutron:revision_number': '2', 'neutron:security_group_ids': '', 'neutron:subnet_pool_addr_scope4': '', 'neutron:subnet_pool_addr_scope6': '', 'neutron:vnic_type': 'normal'}, ha_chassis_group=[], options={'router-port': 'lrp-b291bf17-24f7-4815-bff8-3595d515760c'}, parent_name=[], enabled=[True], type=router, dhcpv6_options=[], tag_request=[], port_security=[], addresses=['router'], dynamic_addresses=[], dhcpv4_options=[], tag=[]) old=Logical_Switch_Port(options={'router-port': 'lrp-b291bf17-24f7-4815-bff8-3595d515760c', 'mcast_flood_reports': 'true'}) {{(pid=77618) matches /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} May 28 12:44:08 l75lg1-v1 neutron-server[77619]: DEBUG neutron.db.ovn_revision_numbers_db [None req-aca31e9c-8399-48d8-95b9-d8310637d33b demo admin] create_initial_revision uuid=be7063e1-bd60-43c5-bc4e-91151583d1f2, type=router_ports, rev=-1 {{(pid=77619) create_initial_revision /opt/stack/neutron/neutron/db/ovn_revision_numbers_db.py:108}} May 28 12:44:08 l75lg1-v1 neutron-server[77619]: INFO neutron.tests.unit.plugins.ml2.drivers.mechanism_logger [None req-aca31e9c-8399-48d8-95b9-d8310637d33b demo admin] create_port_precommit called with port settings {'id': 'be7063e1-bd60-43c5-bc4e-91151583d1f2', 'name': '', 'network_id': '5066e001-05ee-4812-ba7f-98a035d8bd0a', 'tenant_id': '', 'mac_address': 'fa:16:3e:62:f4:51', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '80c11046-4421-4321-813a-d46f0332997a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 28, 'fixed_ips': [{'subnet_id': 'cddf717c-a51e-4470-8ce9-c2ab09a80e38', 'ip_address': '172.24.4.236'}], 'project_id': '', 'port_security_enabled': False, 'security_groups': [], 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'allowed_address_pairs': []} (original settings None) host (original host None) vif type unbound (original vif type None) vif details {} (original vif details None) binding levels None (original binding levels None) on network {'id': '5066e001-05ee-4812-ba7f-98a035d8bd0a', 'name': 'public', 'tenant_id': 'ea8d517cde1d40bb82c97e080ce071f7', 'admin_state_up': True, 'mtu': 1500, 'status': 'ACTIVE', 'subnets': ['cddf717c-a51e-4470-8ce9-c2ab09a80e38'], 'standard_attr_id': 23, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': True, 'vlan_transparent': None, 'description': '', 'port_security_enabled': True, 'is_default': True, 'tags': [], 'created_at': '2024-05-28T12:43:59Z', 'updated_at': '2024-05-28T12:44:06Z', 'revision_number': 2, 'project_id': 'ea8d517cde1d40bb82c97e080ce071f7', 'provider:network_type': 'flat', 'provider:physical_network': 'public', 'provider:segmentation_id': None} with segments to bind None May 28 12:44:08 l75lg1-v1 neutron-server[77619]: DEBUG neutron.tests.unit.plugins.ml2.drivers.mechanism_logger [None req-aca31e9c-8399-48d8-95b9-d8310637d33b demo admin] create_port_precommit: May 28 12:44:08 l75lg1-v1 neutron-server[77619]: key[tenant_id], None -> May 28 12:44:08 l75lg1-v1 neutron-server[77619]: key[network_id], None -> 5066e001-05ee-4812-ba7f-98a035d8bd0a May 28 12:44:08 l75lg1-v1 neutron-server[77619]: key[allowed_address_pairs], None -> [] May 28 12:44:08 l75lg1-v1 neutron-server[77619]: key[binding:vif_type], None -> unbound May 28 12:44:08 l75lg1-v1 neutron-server[77619]: key[project_id], None -> May 28 12:44:08 l75lg1-v1 neutron-server[77619]: key[admin_state_up], None -> True May 28 12:44:08 l75lg1-v1 neutron-server[77619]: key[id], None -> be7063e1-bd60-43c5-bc4e-91151583d1f2 May 28 12:44:08 l75lg1-v1 neutron-server[77619]: key[security_groups], None -> [] May 28 12:44:08 l75lg1-v1 neutron-server[77619]: key[binding:vnic_type], None -> normal May 28 12:44:08 l75lg1-v1 neutron-server[77619]: key[name], None -> May 28 12:44:08 l75lg1-v1 neutron-server[77619]: key[status], None -> DOWN May 28 12:44:08 l75lg1-v1 neutron-server[77619]: key[binding:profile], None -> {} May 28 12:44:08 l75lg1-v1 neutron-server[77619]: key[port_security_enabled], None -> False May 28 12:44:08 l75lg1-v1 neutron-server[77619]: key[standard_attr_id], None -> 28 May 28 12:44:08 l75lg1-v1 neutron-server[77619]: key[device_owner], None -> network:router_gateway May 28 12:44:08 l75lg1-v1 neutron-server[77619]: key[device_id], None -> 80c11046-4421-4321-813a-d46f0332997a May 28 12:44:08 l75lg1-v1 neutron-server[77619]: key[mac_address], None -> fa:16:3e:62:f4:51 May 28 12:44:08 l75lg1-v1 neutron-server[77619]: key[binding:host_id], None -> May 28 12:44:08 l75lg1-v1 neutron-server[77619]: key[binding:vif_details], None -> {} May 28 12:44:08 l75lg1-v1 neutron-server[77619]: key[fixed_ips], None -> [{'subnet_id': 'cddf717c-a51e-4470-8ce9-c2ab09a80e38', 'ip_address': '172.24.4.236'}] May 28 12:44:08 l75lg1-v1 neutron-server[77619]: {{(pid=77619) _log_diff_call /opt/stack/neutron/neutron/tests/unit/plugins/ml2/drivers/mechanism_logger.py:59}} May 28 12:44:08 l75lg1-v1 neutron-server[77618]: INFO neutron.db.ovn_revision_numbers_db [None req-5ba0b4eb-00ab-4523-a874-41c9965d7fce None None] Successfully bumped revision number for resource b291bf17-24f7-4815-bff8-3595d515760c (type: router_ports) to 2 May 28 12:44:08 l75lg1-v1 neutron-server[77619]: DEBUG neutron_lib.callbacks.manager [None req-aca31e9c-8399-48d8-95b9-d8310637d33b demo admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4166243'] for port (be7063e1-bd60-43c5-bc4e-91151583d1f2), after_create {{(pid=77619) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:44:08 l75lg1-v1 neutron-server[77618]: DEBUG ovsdbapp.backend.ovs_idl.transaction [None req-c63b1acc-b5c6-4be8-9db9-04824fec27f2 None None] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=lrp-b291bf17-24f7-4815-bff8-3595d515760c, resource={'id': 'b291bf17-24f7-4815-bff8-3595d515760c', 'name': '', 'network_id': 'fb218033-3d98-4065-b336-c595d5e6ca77', 'tenant_id': '95de88f6d26e4420bc466ba67668171f', 'mac_address': 'fa:16:3e:35:c0:d8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '80c11046-4421-4321-813a-d46f0332997a', 'device_owner': 'network:router_interface', 'standard_attr_id': 26, 'fixed_ips': [{'subnet_id': '5508b790-cc91-4b59-8d30-81ef4480e470', 'ip_address': '10.0.0.1'}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2024-05-28T12:44:01Z', 'updated_at': '2024-05-28T12:44:03Z', 'revision_number': 2, 'project_id': '95de88f6d26e4420bc466ba67668171f'}, resource_type=router_ports, if_exists=True) {{(pid=77618) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:44:08 l75lg1-v1 neutron-server[77618]: DEBUG ovsdbapp.backend.ovs_idl.transaction [None req-c63b1acc-b5c6-4be8-9db9-04824fec27f2 None None] Running txn n=1 command(idx=1): UpdateLRouterPortCommand(_result=None, name=lrp-b291bf17-24f7-4815-bff8-3595d515760c, columns={'external_ids': {'neutron:revision_number': '2', 'neutron:subnet_ids': '5508b790-cc91-4b59-8d30-81ef4480e470', 'neutron:network_name': 'neutron-fb218033-3d98-4065-b336-c595d5e6ca77', 'neutron:is_ext_gw': 'False', 'neutron:router_name': '80c11046-4421-4321-813a-d46f0332997a'}, 'options': {}, 'networks': ['10.0.0.1/26'], 'ipv6_ra_configs': {}}, if_exists=False) {{(pid=77618) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:44:08 l75lg1-v1 neutron-server[77618]: DEBUG ovsdbapp.backend.ovs_idl.transaction [None req-c63b1acc-b5c6-4be8-9db9-04824fec27f2 None None] Running txn n=1 command(idx=2): SetLRouterPortInLSwitchPortCommand(_result=None, lswitch_port=b291bf17-24f7-4815-bff8-3595d515760c, lrouter_port=lrp-b291bf17-24f7-4815-bff8-3595d515760c, is_gw_port=False, if_exists=True, lsp_address=router) {{(pid=77618) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:44:08 l75lg1-v1 neutron-server[77618]: DEBUG ovsdbapp.backend.ovs_idl.transaction [None req-c63b1acc-b5c6-4be8-9db9-04824fec27f2 None None] Transaction caused no change {{(pid=77618) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} May 28 12:44:08 l75lg1-v1 neutron-server[77619]: DEBUG ovsdbapp.backend.ovs_idl.transaction [None req-53cecb61-7023-41e4-a5ea-23b1eb02606a None None] Running txn n=1 command(idx=0): AddLSwitchPortCommand(_result=None, lport=be7063e1-bd60-43c5-bc4e-91151583d1f2, lswitch=neutron-5066e001-05ee-4812-ba7f-98a035d8bd0a, may_exist=True, columns={'addresses': ['unknown'], 'external_ids': {'neutron:port_name': '', 'neutron:device_id': '80c11046-4421-4321-813a-d46f0332997a', 'neutron:project_id': '', 'neutron:cidrs': '172.24.4.236/24', 'neutron:device_owner': 'network:router_gateway', 'neutron:subnet_pool_addr_scope4': '', 'neutron:subnet_pool_addr_scope6': '', 'neutron:network_name': 'neutron-5066e001-05ee-4812-ba7f-98a035d8bd0a', 'neutron:security_group_ids': '', 'neutron:revision_number': '1', 'neutron:vnic_type': 'normal', 'neutron:port_capabilities': '', 'neutron:mtu': ''}, 'parent_name': [], 'tag': [], 'enabled': True, 'options': {'mcast_flood_reports': 'true'}, 'type': '', 'port_security': [], 'dhcpv4_options': [], 'dhcpv6_options': []}) {{(pid=77619) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:44:08 l75lg1-v1 neutron-server[77619]: DEBUG ovsdbapp.backend.ovs_idl.transaction [None req-53cecb61-7023-41e4-a5ea-23b1eb02606a None None] Running txn n=1 command(idx=1): QoSDelCommand(_result=None, switch=neutron-5066e001-05ee-4812-ba7f-98a035d8bd0a, conditions=[('direction', '=', 'to-lport'), ('priority', '=', 2002), ('match', '=', 'outport == "be7063e1-bd60-43c5-bc4e-91151583d1f2"')], if_exists=True) {{(pid=77619) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:44:08 l75lg1-v1 neutron-server[77619]: DEBUG ovsdbapp.backend.ovs_idl.transaction [None req-53cecb61-7023-41e4-a5ea-23b1eb02606a None None] Running txn n=1 command(idx=2): UpdateLSwitchPortQosOptionsCommand(_result=None, lport=AddLSwitchPortCommand(_result=c67615c2-829b-4b06-a65e-a0b14c0517a8, lport=be7063e1-bd60-43c5-bc4e-91151583d1f2, lswitch=neutron-5066e001-05ee-4812-ba7f-98a035d8bd0a, may_exist=True, columns={'addresses': ['unknown'], 'external_ids': {'neutron:port_name': '', 'neutron:device_id': '80c11046-4421-4321-813a-d46f0332997a', 'neutron:project_id': '', 'neutron:cidrs': '172.24.4.236/24', 'neutron:device_owner': 'network:router_gateway', 'neutron:subnet_pool_addr_scope4': '', 'neutron:subnet_pool_addr_scope6': '', 'neutron:network_name': 'neutron-5066e001-05ee-4812-ba7f-98a035d8bd0a', 'neutron:security_group_ids': '', 'neutron:revision_number': '1', 'neutron:vnic_type': 'normal', 'neutron:port_capabilities': '', 'neutron:mtu': ''}, 'parent_name': [], 'enabled': True, 'options': {'mcast_flood_reports': 'true'}, 'type': '', 'port_security': []}), if_exists=True, qos={'qos_min_rate': None}) {{(pid=77619) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:44:08 l75lg1-v1 neutron-server[77619]: DEBUG ovsdbapp.backend.ovs_idl.transaction [None req-53cecb61-7023-41e4-a5ea-23b1eb02606a None None] Running txn n=1 command(idx=3): QoSDelCommand(_result=None, switch=neutron-5066e001-05ee-4812-ba7f-98a035d8bd0a, conditions=[('direction', '=', 'from-lport'), ('priority', '=', 2002), ('match', '=', 'inport == "be7063e1-bd60-43c5-bc4e-91151583d1f2"')], if_exists=True) {{(pid=77619) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:44:08 l75lg1-v1 neutron-server[77619]: DEBUG ovsdbapp.backend.ovs_idl.transaction [None req-53cecb61-7023-41e4-a5ea-23b1eb02606a None None] Running txn n=1 command(idx=4): UpdateLSwitchPortQosOptionsCommand(_result=None, lport=AddLSwitchPortCommand(_result=c67615c2-829b-4b06-a65e-a0b14c0517a8, lport=be7063e1-bd60-43c5-bc4e-91151583d1f2, lswitch=neutron-5066e001-05ee-4812-ba7f-98a035d8bd0a, may_exist=True, columns={'addresses': ['unknown'], 'external_ids': {'neutron:port_name': '', 'neutron:device_id': '80c11046-4421-4321-813a-d46f0332997a', 'neutron:project_id': '', 'neutron:cidrs': '172.24.4.236/24', 'neutron:device_owner': 'network:router_gateway', 'neutron:subnet_pool_addr_scope4': '', 'neutron:subnet_pool_addr_scope6': '', 'neutron:network_name': 'neutron-5066e001-05ee-4812-ba7f-98a035d8bd0a', 'neutron:security_group_ids': '', 'neutron:revision_number': '1', 'neutron:vnic_type': 'normal', 'neutron:port_capabilities': '', 'neutron:mtu': ''}, 'parent_name': [], 'enabled': True, 'options': {'mcast_flood_reports': 'true'}, 'type': '', 'port_security': []}), if_exists=True, qos={'qos_min_rate': None}) {{(pid=77619) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:44:08 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-53cecb61-7023-41e4-a5ea-23b1eb02606a None None] Hash Ring: Node c89b3497-133e-4a5a-b67a-3310d2cb2485 (host: l75lg1-v1) handling event "create" for row c100b146-635b-4ec8-a4a1-ddbd59917880 (table: Logical_Switch_Port) {{(pid=77619) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:44:08 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-53cecb61-7023-41e4-a5ea-23b1eb02606a None None] Hash Ring: Node c89b3497-133e-4a5a-b67a-3310d2cb2485 (host: l75lg1-v1) handling event "update" for row c100b146-635b-4ec8-a4a1-ddbd59917880 (table: Logical_Switch_Port) {{(pid=77619) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:44:08 l75lg1-v1 neutron-server[77619]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aca31e9c-8399-48d8-95b9-d8310637d33b demo admin] Pushing event updated for resources: {'Port': ['ID=be7063e1-bd60-43c5-bc4e-91151583d1f2,revision_number=1']} {{(pid=77619) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 28 12:44:08 l75lg1-v1 neutron-server[77618]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-c63b1acc-b5c6-4be8-9db9-04824fec27f2 None None] Hash Ring: Node 4c6fc793-7f5a-456f-b4d6-6e5bd97592f2 (host: l75lg1-v1) handling event "update" for row b946fae3-ebd4-42d6-9336-c908375c2ee1 (table: Logical_Switch) {{(pid=77618) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:44:08 l75lg1-v1 neutron-server[77618]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-d9d4969c-e9ae-4d76-91b0-9b7c8eb907b3 None None] Hash Ring: Node 4c6fc793-7f5a-456f-b4d6-6e5bd97592f2 (host: l75lg1-v1) handling event "create" for row 58ca17de-33f0-42ed-8eac-a67cd94edbf1 (table: Port_Binding) {{(pid=77618) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:44:08 l75lg1-v1 neutron-server[77618]: DEBUG ovsdbapp.backend.ovs_idl.transaction [None req-c63b1acc-b5c6-4be8-9db9-04824fec27f2 None None] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=lrp-b291bf17-24f7-4815-bff8-3595d515760c, resource={'id': 'b291bf17-24f7-4815-bff8-3595d515760c', 'name': '', 'network_id': 'fb218033-3d98-4065-b336-c595d5e6ca77', 'tenant_id': '95de88f6d26e4420bc466ba67668171f', 'mac_address': 'fa:16:3e:35:c0:d8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '80c11046-4421-4321-813a-d46f0332997a', 'device_owner': 'network:router_interface', 'standard_attr_id': 26, 'fixed_ips': [{'subnet_id': '5508b790-cc91-4b59-8d30-81ef4480e470', 'ip_address': '10.0.0.1'}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2024-05-28T12:44:01Z', 'updated_at': '2024-05-28T12:44:03Z', 'revision_number': 2, 'project_id': '95de88f6d26e4420bc466ba67668171f'}, resource_type=router_ports, if_exists=True) {{(pid=77618) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:44:08 l75lg1-v1 neutron-server[77618]: DEBUG ovsdbapp.backend.ovs_idl.transaction [None req-c63b1acc-b5c6-4be8-9db9-04824fec27f2 None None] Running txn n=1 command(idx=1): UpdateLRouterPortCommand(_result=None, name=lrp-b291bf17-24f7-4815-bff8-3595d515760c, columns={'external_ids': {'neutron:revision_number': '2', 'neutron:subnet_ids': '5508b790-cc91-4b59-8d30-81ef4480e470', 'neutron:network_name': 'neutron-fb218033-3d98-4065-b336-c595d5e6ca77', 'neutron:is_ext_gw': 'False', 'neutron:router_name': '80c11046-4421-4321-813a-d46f0332997a'}, 'options': {}, 'networks': ['10.0.0.1/26'], 'ipv6_ra_configs': {}}, if_exists=False) {{(pid=77618) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:44:08 l75lg1-v1 neutron-server[77618]: DEBUG ovsdbapp.backend.ovs_idl.transaction [None req-c63b1acc-b5c6-4be8-9db9-04824fec27f2 None None] Running txn n=1 command(idx=2): SetLRouterPortInLSwitchPortCommand(_result=None, lswitch_port=b291bf17-24f7-4815-bff8-3595d515760c, lrouter_port=lrp-b291bf17-24f7-4815-bff8-3595d515760c, is_gw_port=False, if_exists=True, lsp_address=router) {{(pid=77618) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:44:08 l75lg1-v1 neutron-server[77618]: DEBUG ovsdbapp.backend.ovs_idl.transaction [None req-c63b1acc-b5c6-4be8-9db9-04824fec27f2 None None] Transaction caused no change {{(pid=77618) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} May 28 12:44:08 l75lg1-v1 neutron-server[77619]: INFO neutron.db.ovn_revision_numbers_db [None req-aca31e9c-8399-48d8-95b9-d8310637d33b demo admin] Successfully bumped revision number for resource be7063e1-bd60-43c5-bc4e-91151583d1f2 (type: ports) to 1 May 28 12:44:08 l75lg1-v1 neutron-server[77619]: INFO neutron.tests.unit.plugins.ml2.drivers.mechanism_logger [None req-aca31e9c-8399-48d8-95b9-d8310637d33b demo admin] create_port_postcommit called with port settings {'id': 'be7063e1-bd60-43c5-bc4e-91151583d1f2', 'name': '', 'network_id': '5066e001-05ee-4812-ba7f-98a035d8bd0a', 'tenant_id': '', 'mac_address': 'fa:16:3e:62:f4:51', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '80c11046-4421-4321-813a-d46f0332997a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 28, 'fixed_ips': [{'subnet_id': 'cddf717c-a51e-4470-8ce9-c2ab09a80e38', 'ip_address': '172.24.4.236'}], 'project_id': '', 'port_security_enabled': False, 'security_groups': [], 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'description': '', 'tags': [], 'created_at': '2024-05-28T12:44:08Z', 'updated_at': '2024-05-28T12:44:08Z', 'revision_number': 1, 'network': {'id': '5066e001-05ee-4812-ba7f-98a035d8bd0a', 'name': 'public', 'tenant_id': 'ea8d517cde1d40bb82c97e080ce071f7', 'admin_state_up': True, 'mtu': 1500, 'status': 'ACTIVE', 'subnets': ['cddf717c-a51e-4470-8ce9-c2ab09a80e38'], 'standard_attr_id': 23, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': True, 'vlan_transparent': None, 'description': '', 'port_security_enabled': True, 'is_default': True, 'tags': [], 'created_at': '2024-05-28T12:43:59Z', 'updated_at': '2024-05-28T12:44:06Z', 'revision_number': 2, 'project_id': 'ea8d517cde1d40bb82c97e080ce071f7', 'provider:network_type': 'flat', 'provider:physical_network': 'public', 'provider:segmentation_id': None}} (original settings None) host (original host None) vif type unbound (original vif type None) vif details {} (original vif details None) binding levels None (original binding levels None) on network {'id': '5066e001-05ee-4812-ba7f-98a035d8bd0a', 'name': 'public', 'tenant_id': 'ea8d517cde1d40bb82c97e080ce071f7', 'admin_state_up': True, 'mtu': 1500, 'status': 'ACTIVE', 'subnets': ['cddf717c-a51e-4470-8ce9-c2ab09a80e38'], 'standard_attr_id': 23, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': True, 'vlan_transparent': None, 'description': '', 'port_security_enabled': True, 'is_default': True, 'tags': [], 'created_at': '2024-05-28T12:43:59Z', 'updated_at': '2024-05-28T12:44:06Z', 'revision_number': 2, 'project_id': 'ea8d517cde1d40bb82c97e080ce071f7', 'provider:network_type': 'flat', 'provider:physical_network': 'public', 'provider:segmentation_id': None} with segments to bind None May 28 12:44:08 l75lg1-v1 neutron-server[77619]: DEBUG neutron.tests.unit.plugins.ml2.drivers.mechanism_logger [None req-aca31e9c-8399-48d8-95b9-d8310637d33b demo admin] create_port_postcommit: May 28 12:44:08 l75lg1-v1 neutron-server[77619]: key[tenant_id], None -> May 28 12:44:08 l75lg1-v1 neutron-server[77619]: key[network_id], None -> 5066e001-05ee-4812-ba7f-98a035d8bd0a May 28 12:44:08 l75lg1-v1 neutron-server[77619]: key[allowed_address_pairs], None -> [] May 28 12:44:08 l75lg1-v1 neutron-server[77619]: key[binding:vif_type], None -> unbound May 28 12:44:08 l75lg1-v1 neutron-server[77619]: key[project_id], None -> May 28 12:44:08 l75lg1-v1 neutron-server[77619]: key[admin_state_up], None -> True May 28 12:44:08 l75lg1-v1 neutron-server[77619]: key[id], None -> be7063e1-bd60-43c5-bc4e-91151583d1f2 May 28 12:44:08 l75lg1-v1 neutron-server[77619]: key[security_groups], None -> [] May 28 12:44:08 l75lg1-v1 neutron-server[77619]: key[extra_dhcp_opts], None -> [] May 28 12:44:08 l75lg1-v1 neutron-server[77619]: key[binding:vnic_type], None -> normal May 28 12:44:08 l75lg1-v1 neutron-server[77619]: key[tags], None -> [] May 28 12:44:08 l75lg1-v1 neutron-server[77619]: key[name], None -> May 28 12:44:08 l75lg1-v1 neutron-server[77619]: key[created_at], None -> 2024-05-28T12:44:08Z May 28 12:44:08 l75lg1-v1 neutron-server[77619]: key[status], None -> DOWN May 28 12:44:08 l75lg1-v1 neutron-server[77619]: key[binding:profile], None -> {} May 28 12:44:08 l75lg1-v1 neutron-server[77619]: key[port_security_enabled], None -> False May 28 12:44:08 l75lg1-v1 neutron-server[77619]: key[updated_at], None -> 2024-05-28T12:44:08Z May 28 12:44:08 l75lg1-v1 neutron-server[77619]: key[network], None -> {'id': '5066e001-05ee-4812-ba7f-98a035d8bd0a', 'name': 'public', 'tenant_id': 'ea8d517cde1d40bb82c97e080ce071f7', 'admin_state_up': True, 'mtu': 1500, 'status': 'ACTIVE', 'subnets': ['cddf717c-a51e-4470-8ce9-c2ab09a80e38'], 'standard_attr_id': 23, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': True, 'vlan_transparent': None, 'description': '', 'port_security_enabled': True, 'is_default': True, 'tags': [], 'created_at': '2024-05-28T12:43:59Z', 'updated_at': '2024-05-28T12:44:06Z', 'revision_number': 2, 'project_id': 'ea8d517cde1d40bb82c97e080ce071f7', 'provider:network_type': 'flat', 'provider:physical_network': 'public', 'provider:segmentation_id': None} May 28 12:44:08 l75lg1-v1 neutron-server[77619]: key[standard_attr_id], None -> 28 May 28 12:44:08 l75lg1-v1 neutron-server[77619]: key[device_owner], None -> network:router_gateway May 28 12:44:08 l75lg1-v1 neutron-server[77619]: key[device_id], None -> 80c11046-4421-4321-813a-d46f0332997a May 28 12:44:08 l75lg1-v1 neutron-server[77619]: key[mac_address], None -> fa:16:3e:62:f4:51 May 28 12:44:08 l75lg1-v1 neutron-server[77619]: key[description], None -> May 28 12:44:08 l75lg1-v1 neutron-server[77619]: key[binding:host_id], None -> May 28 12:44:08 l75lg1-v1 neutron-server[77619]: key[binding:vif_details], None -> {} May 28 12:44:08 l75lg1-v1 neutron-server[77619]: key[revision_number], None -> 1 May 28 12:44:08 l75lg1-v1 neutron-server[77619]: key[fixed_ips], None -> [{'subnet_id': 'cddf717c-a51e-4470-8ce9-c2ab09a80e38', 'ip_address': '172.24.4.236'}] May 28 12:44:08 l75lg1-v1 neutron-server[77619]: {{(pid=77619) _log_diff_call /opt/stack/neutron/neutron/tests/unit/plugins/ml2/drivers/mechanism_logger.py:59}} May 28 12:44:09 l75lg1-v1 neutron-server[77619]: DEBUG neutron_lib.callbacks.manager [None req-aca31e9c-8399-48d8-95b9-d8310637d33b demo admin] Publish callbacks [] for router_gateway (80c11046-4421-4321-813a-d46f0332997a), after_create {{(pid=77619) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:44:09 l75lg1-v1 dstat.sh[49771]: 28-05 12:44:09| 14 1 84 2 0|2802M 6698M 267M 5931M| 13k 0 | 0 1664k| 0 187 |3570 5726 |1.27 1.76 1.25|2.0 0 0| 0 0 | 0 2048M| 23 124 0 37 0 May 28 12:44:09 l75lg1-v1 neutron-server[77619]: DEBUG neutron_lib.callbacks.manager [None req-aca31e9c-8399-48d8-95b9-d8310637d33b demo admin] Publish callbacks ['neutron.services.ovn_l3.plugin.ExtraGatewaysDbOnlyMixin._process_bfd_ecmp_update-12753', 'neutron.services.ovn_l3.service_providers.driver_controller.DriverController._update_router_provider-2832'] for router (80c11046-4421-4321-813a-d46f0332997a), precommit_update {{(pid=77619) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:44:09 l75lg1-v1 neutron-server[77619]: DEBUG neutron_lib.callbacks.manager [None req-aca31e9c-8399-48d8-95b9-d8310637d33b demo admin] Publish callbacks ['neutron.services.ovn_l3.service_providers.ovn.OvnDriver._process_router_update-57891'] for router (80c11046-4421-4321-813a-d46f0332997a), after_update {{(pid=77619) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:44:09 l75lg1-v1 neutron-server[77619]: DEBUG ovsdbapp.backend.ovs_idl.transaction [None req-53cecb61-7023-41e4-a5ea-23b1eb02606a None None] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-80c11046-4421-4321-813a-d46f0332997a, resource={'id': '80c11046-4421-4321-813a-d46f0332997a', 'name': 'router1', 'tenant_id': '95de88f6d26e4420bc466ba67668171f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5066e001-05ee-4812-ba7f-98a035d8bd0a', 'external_fixed_ips': [{'subnet_id': 'cddf717c-a51e-4470-8ce9-c2ab09a80e38', 'ip_address': '172.24.4.236'}], 'enable_snat': True}, 'gw_port_id': 'be7063e1-bd60-43c5-bc4e-91151583d1f2', 'description': '', 'availability_zones': [], 'distributed': False, 'ha': True, 'ha_vr_id': 0, 'availability_zone_hints': [], 'enable_default_route_ecmp': False, 'enable_default_route_bfd': False, 'external_gateways': [{'network_id': '5066e001-05ee-4812-ba7f-98a035d8bd0a', 'external_fixed_ips': [{'ip_address': '172.24.4.236', 'subnet_id': 'cddf717c-a51e-4470-8ce9-c2ab09a80e38'}]}], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2024-05-28T12:43:55Z', 'updated_at': '2024-05-28T12:44:09Z', 'revision_number': 3, 'project_id': '95de88f6d26e4420bc466ba67668171f'}, resource_type=routers, if_exists=True) {{(pid=77619) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:44:09 l75lg1-v1 neutron-server[77619]: DEBUG ovsdbapp.backend.ovs_idl.transaction [None req-53cecb61-7023-41e4-a5ea-23b1eb02606a None None] Running txn n=1 command(idx=1): AddLRouterPortCommand(_result=None, name=lrp-be7063e1-bd60-43c5-bc4e-91151583d1f2, lrouter=neutron-80c11046-4421-4321-813a-d46f0332997a, may_exist=True, columns={'mac': 'fa:16:3e:62:f4:51', 'networks': ['172.24.4.236/24'], 'external_ids': {'neutron:revision_number': '1', 'neutron:subnet_ids': 'cddf717c-a51e-4470-8ce9-c2ab09a80e38', 'neutron:network_name': 'neutron-5066e001-05ee-4812-ba7f-98a035d8bd0a', 'neutron:is_ext_gw': 'True', 'neutron:router_name': '80c11046-4421-4321-813a-d46f0332997a'}, 'options': {}}) {{(pid=77619) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:44:09 l75lg1-v1 neutron-server[77619]: DEBUG ovsdbapp.backend.ovs_idl.transaction [None req-53cecb61-7023-41e4-a5ea-23b1eb02606a None None] Running txn n=1 command(idx=2): ScheduleNewGatewayCommand(_result=None, g_name=lrp-be7063e1-bd60-43c5-bc4e-91151583d1f2, sb_api=, lrouter_name=neutron-80c11046-4421-4321-813a-d46f0332997a, ovn_client=, scheduler=, physnet=public, az_hints=[]) {{(pid=77619) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:44:09 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_client [None req-53cecb61-7023-41e4-a5ea-23b1eb02606a None None] Chassis candidates for scheduling gateway router ports for "public" physical network: ['0da8323f-64af-4526-b223-049f5737145a'] {{(pid=77619) get_candidates_for_scheduling /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py:1609}} May 28 12:44:09 l75lg1-v1 neutron-server[77619]: DEBUG neutron.scheduler.l3_ovn_scheduler [None req-53cecb61-7023-41e4-a5ea-23b1eb02606a None None] Gateway lrp-be7063e1-bd60-43c5-bc4e-91151583d1f2 scheduled on chassis ['0da8323f-64af-4526-b223-049f5737145a'] {{(pid=77619) _schedule_gateway /opt/stack/neutron/neutron/scheduler/l3_ovn_scheduler.py:90}} May 28 12:44:09 l75lg1-v1 neutron-server[77619]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.commands [None req-53cecb61-7023-41e4-a5ea-23b1eb02606a None None] Schedule LRP lrp-be7063e1-bd60-43c5-bc4e-91151583d1f2 on gateway 0da8323f-64af-4526-b223-049f5737145a with priority 1 May 28 12:44:09 l75lg1-v1 neutron-server[77619]: DEBUG ovsdbapp.backend.ovs_idl.transaction [None req-53cecb61-7023-41e4-a5ea-23b1eb02606a None None] Running txn n=1 command(idx=3): SetLRouterPortInLSwitchPortCommand(_result=None, lswitch_port=be7063e1-bd60-43c5-bc4e-91151583d1f2, lrouter_port=lrp-be7063e1-bd60-43c5-bc4e-91151583d1f2, is_gw_port=True, if_exists=True, lsp_address=router) {{(pid=77619) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:44:09 l75lg1-v1 neutron-server[77619]: DEBUG ovsdbapp.backend.ovs_idl.transaction [None req-53cecb61-7023-41e4-a5ea-23b1eb02606a None None] Running txn n=1 command(idx=4): AddStaticRouteCommand(_result=None, lrouter=neutron-80c11046-4421-4321-813a-d46f0332997a, maintain_bfd=False, columns={'ip_prefix': '0.0.0.0/0', 'nexthop': '172.24.4.1', 'external_ids': {'neutron:is_ext_gw': 'true', 'neutron:subnet_id': 'cddf717c-a51e-4470-8ce9-c2ab09a80e38'}}) {{(pid=77619) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:44:09 l75lg1-v1 neutron-server[77619]: DEBUG ovsdbapp.backend.ovs_idl.transaction [None req-53cecb61-7023-41e4-a5ea-23b1eb02606a None None] Running txn n=1 command(idx=5): AddNATRuleInLRouterCommand(_result=None, lrouter=neutron-80c11046-4421-4321-813a-d46f0332997a, columns={'type': 'snat', 'logical_ip': '10.0.0.0/26', 'external_ip': '172.24.4.236'}) {{(pid=77619) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:44:09 l75lg1-v1 neutron-server[77619]: DEBUG ovsdbapp.backend.ovs_idl.transaction [None req-53cecb61-7023-41e4-a5ea-23b1eb02606a None None] Running txn n=1 command(idx=6): UpdateLRouterCommand(_result=None, name=neutron-80c11046-4421-4321-813a-d46f0332997a, columns={'external_ids': {'neutron:router_name': 'router1', 'neutron:revision_number': '3', 'neutron:availability_zone_hints': ''}, 'enabled': True}, if_exists=True) {{(pid=77619) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:44:09 l75lg1-v1 neutron-server[77619]: DEBUG ovsdbapp.backend.ovs_idl.transaction [None req-53cecb61-7023-41e4-a5ea-23b1eb02606a None None] Running txn n=1 command(idx=7): QoSDelCommand(_result=None, switch=neutron-5066e001-05ee-4812-ba7f-98a035d8bd0a, conditions=[('direction', '=', 'from-lport'), ('priority', '=', 2002), ('match', '=', 'inport == "be7063e1-bd60-43c5-bc4e-91151583d1f2"')], if_exists=True) {{(pid=77619) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:44:09 l75lg1-v1 neutron-server[77619]: DEBUG ovsdbapp.backend.ovs_idl.transaction [None req-53cecb61-7023-41e4-a5ea-23b1eb02606a None None] Running txn n=1 command(idx=8): QoSDelCommand(_result=None, switch=neutron-5066e001-05ee-4812-ba7f-98a035d8bd0a, conditions=[('direction', '=', 'to-lport'), ('priority', '=', 2002), ('match', '=', 'outport == "be7063e1-bd60-43c5-bc4e-91151583d1f2"')], if_exists=True) {{(pid=77619) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:44:09 l75lg1-v1 neutron-server[77618]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-c63b1acc-b5c6-4be8-9db9-04824fec27f2 None None] Hash Ring: Node 4c6fc793-7f5a-456f-b4d6-6e5bd97592f2 (host: l75lg1-v1) handling event "create" for row 971cbf7f-33c1-4138-b579-bb6823f77f1a (table: Gateway_Chassis) {{(pid=77618) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:44:09 l75lg1-v1 neutron-server[77618]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-c63b1acc-b5c6-4be8-9db9-04824fec27f2 None None] Hash Ring: Node 4c6fc793-7f5a-456f-b4d6-6e5bd97592f2 (host: l75lg1-v1) handling event "create" for row 649d2f2b-ffef-4277-be4f-6d5097f8bc85 (table: Logical_Router_Port) {{(pid=77618) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:44:09 l75lg1-v1 neutron-server[77618]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-c63b1acc-b5c6-4be8-9db9-04824fec27f2 None None] Hash Ring: Node 4c6fc793-7f5a-456f-b4d6-6e5bd97592f2 (host: l75lg1-v1) handling event "create" for row 3eae541e-4f81-456d-9453-a5dd990bd96e (table: NAT) {{(pid=77618) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:44:09 l75lg1-v1 neutron-server[77618]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-d9d4969c-e9ae-4d76-91b0-9b7c8eb907b3 None None] Hash Ring: Node 4c6fc793-7f5a-456f-b4d6-6e5bd97592f2 (host: l75lg1-v1) handling event "update" for row 58ca17de-33f0-42ed-8eac-a67cd94edbf1 (table: Port_Binding) {{(pid=77618) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:44:09 l75lg1-v1 neutron-server[77618]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-d9d4969c-e9ae-4d76-91b0-9b7c8eb907b3 None None] Hash Ring: Node 4c6fc793-7f5a-456f-b4d6-6e5bd97592f2 (host: l75lg1-v1) handling event "create" for row 679aa185-9f77-4421-9a89-94a849c44601 (table: Port_Binding) {{(pid=77618) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:44:09 l75lg1-v1 neutron-server[77618]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-d9d4969c-e9ae-4d76-91b0-9b7c8eb907b3 None None] Hash Ring: Node 4c6fc793-7f5a-456f-b4d6-6e5bd97592f2 (host: l75lg1-v1) handling event "create" for row 6a4b9989-5e7d-4652-8a02-ebd03d6100c1 (table: Port_Binding) {{(pid=77618) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:44:09 l75lg1-v1 neutron-server[77618]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-d9d4969c-e9ae-4d76-91b0-9b7c8eb907b3 None None] Hash Ring: Node 4c6fc793-7f5a-456f-b4d6-6e5bd97592f2 (host: l75lg1-v1) handling event "update" for row 679aa185-9f77-4421-9a89-94a849c44601 (table: Port_Binding) {{(pid=77618) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:44:09 l75lg1-v1 neutron-server[77618]: DEBUG ovsdbapp.backend.ovs_idl.event [None req-d9d4969c-e9ae-4d76-91b0-9b7c8eb907b3 None None] Matched UPDATE: PortBindingChassisEvent(events=('update',), table='Port_Binding', conditions=None, old_conditions=None), priority=20 to row=Port_Binding(parent_port=[], mac=['fa:16:3e:62:f4:51 172.24.4.236/24'], chassis=[], options={'always-redirect': 'true', 'distributed-port': 'lrp-be7063e1-bd60-43c5-bc4e-91151583d1f2'}, type=chassisredirect, tag=[], requested_chassis=[], tunnel_key=3, up=[True], logical_port=cr-lrp-be7063e1-bd60-43c5-bc4e-91151583d1f2, gateway_chassis=[], encap=[], external_ids={'neutron:is_ext_gw': 'True', 'neutron:network_name': 'neutron-5066e001-05ee-4812-ba7f-98a035d8bd0a', 'neutron:revision_number': '1', 'neutron:router_name': '80c11046-4421-4321-813a-d46f0332997a', 'neutron:subnet_ids': 'cddf717c-a51e-4470-8ce9-c2ab09a80e38'}, virtual_parent=[], nat_addresses=[], datapath=60c632e1-b161-4c7e-9282-f3cf8f40846d) old=Port_Binding(chassis=[], up=[False]) {{(pid=77618) matches /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} May 28 12:44:09 l75lg1-v1 neutron-server[77618]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [-] Router 80c11046-4421-4321-813a-d46f0332997a is bound to host l75lg1-v1 May 28 12:44:09 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-53cecb61-7023-41e4-a5ea-23b1eb02606a None None] Hash Ring: Node c89b3497-133e-4a5a-b67a-3310d2cb2485 (host: l75lg1-v1) handling event "update" for row 74f0f327-cc93-479c-856e-03f5c93a4345 (table: Logical_Router) {{(pid=77619) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:44:09 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-53cecb61-7023-41e4-a5ea-23b1eb02606a None None] Hash Ring: Node c89b3497-133e-4a5a-b67a-3310d2cb2485 (host: l75lg1-v1) handling event "create" for row b727135f-432b-4fa8-8e31-67b584e89d25 (table: Logical_Router_Static_Route) {{(pid=77619) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:44:09 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-53cecb61-7023-41e4-a5ea-23b1eb02606a None None] Hash Ring: Node c89b3497-133e-4a5a-b67a-3310d2cb2485 (host: l75lg1-v1) handling event "update" for row c100b146-635b-4ec8-a4a1-ddbd59917880 (table: Logical_Switch_Port) {{(pid=77619) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:44:09 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-53cecb61-7023-41e4-a5ea-23b1eb02606a None None] Hash Ring: Node c89b3497-133e-4a5a-b67a-3310d2cb2485 (host: l75lg1-v1) handling event "update" for row c100b146-635b-4ec8-a4a1-ddbd59917880 (table: Logical_Switch_Port) {{(pid=77619) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:44:09 l75lg1-v1 neutron-server[77619]: DEBUG ovsdbapp.backend.ovs_idl.event [None req-53cecb61-7023-41e4-a5ea-23b1eb02606a None None] Matched UPDATE: LogicalSwitchPortUpdateUpEvent(events=('update',), table='Logical_Switch_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Switch_Port(up=[True], name=be7063e1-bd60-43c5-bc4e-91151583d1f2, external_ids={'neutron:cidrs': '172.24.4.236/24', 'neutron:device_id': '80c11046-4421-4321-813a-d46f0332997a', 'neutron:device_owner': 'network:router_gateway', 'neutron:mtu': '', 'neutron:network_name': 'neutron-5066e001-05ee-4812-ba7f-98a035d8bd0a', 'neutron:port_capabilities': '', 'neutron:port_name': '', 'neutron:project_id': '', 'neutron:revision_number': '1', 'neutron:security_group_ids': '', 'neutron:subnet_pool_addr_scope4': '', 'neutron:subnet_pool_addr_scope6': '', 'neutron:vnic_type': 'normal'}, ha_chassis_group=[], options={'exclude-lb-vips-from-garp': 'true', 'nat-addresses': 'router', 'router-port': 'lrp-be7063e1-bd60-43c5-bc4e-91151583d1f2'}, parent_name=[], enabled=[True], type=router, dhcpv6_options=[], tag_request=[], port_security=[], addresses=['router'], dynamic_addresses=[], dhcpv4_options=[], tag=[]) old=Logical_Switch_Port(up=[False]) {{(pid=77619) matches /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} May 28 12:44:09 l75lg1-v1 neutron-server[77619]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver [-] OVN reports status up for port: be7063e1-bd60-43c5-bc4e-91151583d1f2 May 28 12:44:09 l75lg1-v1 neutron-server[77619]: DEBUG neutron.db.provisioning_blocks [None req-0dcde142-d2d2-4b7c-90f1-6c1ed20bcda3 None None] Provisioning complete for port be7063e1-bd60-43c5-bc4e-91151583d1f2 triggered by entity L2. {{(pid=77619) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:144}} May 28 12:44:09 l75lg1-v1 neutron-server[77619]: DEBUG neutron_lib.callbacks.manager [None req-0dcde142-d2d2-4b7c-90f1-6c1ed20bcda3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-857483'] for port (be7063e1-bd60-43c5-bc4e-91151583d1f2), provisioning_complete {{(pid=77619) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:44:09 l75lg1-v1 neutron-server[77619]: INFO neutron.plugins.ml2.plugin [None req-0dcde142-d2d2-4b7c-90f1-6c1ed20bcda3 None None] Attempt 1 to provision port be7063e1-bd60-43c5-bc4e-91151583d1f2 May 28 12:44:09 l75lg1-v1 neutron-server[77618]: DEBUG neutron_lib.callbacks.manager [None req-52bb25b6-e201-48e8-b427-2e1e387fb2e6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1015114', 'neutron.services.ovn_l3.plugin.OVNL3RouterPlugin._port_update-8754901907784', 'neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_internal_ip_change_for_fip-8754903031884'] for port (be7063e1-bd60-43c5-bc4e-91151583d1f2), before_update {{(pid=77618) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:44:09 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.plugin [None req-0dcde142-d2d2-4b7c-90f1-6c1ed20bcda3 None None] Port be7063e1-bd60-43c5-bc4e-91151583d1f2 cannot update to ACTIVE because it is not bound. {{(pid=77619) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:372}} May 28 12:44:09 l75lg1-v1 neutron-server[77619]: INFO neutron.db.ovn_revision_numbers_db [None req-aca31e9c-8399-48d8-95b9-d8310637d33b demo admin] Successfully bumped revision number for resource 80c11046-4421-4321-813a-d46f0332997a (type: routers) to 3 May 28 12:44:10 l75lg1-v1 neutron-server[77619]: INFO neutron.db.ovn_revision_numbers_db [None req-aca31e9c-8399-48d8-95b9-d8310637d33b demo admin] Successfully bumped revision number for resource be7063e1-bd60-43c5-bc4e-91151583d1f2 (type: router_ports) to 1 May 28 12:44:10 l75lg1-v1 neutron-server[77619]: DEBUG neutron_lib.callbacks.manager [None req-aca31e9c-8399-48d8-95b9-d8310637d33b demo admin] Publish callbacks [] for router (None), before_response {{(pid=77619) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:44:10 l75lg1-v1 neutron-server[77619]: INFO neutron.wsgi [None req-aca31e9c-8399-48d8-95b9-d8310637d33b demo admin] 10.27.203.238 "PUT /networking/v2.0/routers/80c11046-4421-4321-813a-d46f0332997a HTTP/1.1" status: 200 len: 1120 time: 1.9363465 May 28 12:44:10 l75lg1-v1 neutron-server[77618]: DEBUG neutron_lib.callbacks.manager [None req-52bb25b6-e201-48e8-b427-2e1e387fb2e6 None None] Publish callbacks [] for port (be7063e1-bd60-43c5-bc4e-91151583d1f2), precommit_update {{(pid=77618) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:44:10 l75lg1-v1 neutron-server[77618]: DEBUG neutron.db.provisioning_blocks [None req-52bb25b6-e201-48e8-b427-2e1e387fb2e6 None None] Transition to ACTIVE for port object be7063e1-bd60-43c5-bc4e-91151583d1f2 will not be triggered until provisioned by entity L2. {{(pid=77618) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:74}} May 28 12:44:10 l75lg1-v1 neutron-server[77618]: INFO neutron.tests.unit.plugins.ml2.drivers.mechanism_logger [None req-52bb25b6-e201-48e8-b427-2e1e387fb2e6 None None] update_port_precommit called with port settings {'id': 'be7063e1-bd60-43c5-bc4e-91151583d1f2', 'name': '', 'network_id': '5066e001-05ee-4812-ba7f-98a035d8bd0a', 'tenant_id': '', 'mac_address': 'fa:16:3e:62:f4:51', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '80c11046-4421-4321-813a-d46f0332997a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 28, 'fixed_ips': [{'subnet_id': 'cddf717c-a51e-4470-8ce9-c2ab09a80e38', 'ip_address': '172.24.4.236'}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'l75lg1-v1', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2024-05-28T12:44:08Z', 'updated_at': '2024-05-28T12:44:08Z', 'revision_number': 1, 'project_id': ''} (original settings {'id': 'be7063e1-bd60-43c5-bc4e-91151583d1f2', 'name': '', 'network_id': '5066e001-05ee-4812-ba7f-98a035d8bd0a', 'tenant_id': '', 'mac_address': 'fa:16:3e:62:f4:51', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '80c11046-4421-4321-813a-d46f0332997a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 28, 'fixed_ips': [{'subnet_id': 'cddf717c-a51e-4470-8ce9-c2ab09a80e38', 'ip_address': '172.24.4.236'}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2024-05-28T12:44:08Z', 'updated_at': '2024-05-28T12:44:08Z', 'revision_number': 1, 'project_id': ''}) host l75lg1-v1 (original host ) vif type unbound (original vif type unbound) vif details {} (original vif details {}) binding levels None (original binding levels None) on network {'id': '5066e001-05ee-4812-ba7f-98a035d8bd0a', 'name': 'public', 'tenant_id': 'ea8d517cde1d40bb82c97e080ce071f7', 'admin_state_up': True, 'mtu': 1500, 'status': 'ACTIVE', 'subnets': ['cddf717c-a51e-4470-8ce9-c2ab09a80e38'], 'standard_attr_id': 23, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': True, 'vlan_transparent': None, 'description': '', 'port_security_enabled': True, 'is_default': True, 'tags': [], 'created_at': '2024-05-28T12:43:59Z', 'updated_at': '2024-05-28T12:44:06Z', 'revision_number': 2, 'project_id': 'ea8d517cde1d40bb82c97e080ce071f7', 'provider:network_type': 'flat', 'provider:physical_network': 'public', 'provider:segmentation_id': None} with segments to bind None May 28 12:44:10 l75lg1-v1 neutron-server[77618]: DEBUG neutron.tests.unit.plugins.ml2.drivers.mechanism_logger [None req-52bb25b6-e201-48e8-b427-2e1e387fb2e6 None None] update_port_precommit: May 28 12:44:10 l75lg1-v1 neutron-server[77618]: key[binding:host_id], -> l75lg1-v1 May 28 12:44:10 l75lg1-v1 neutron-server[77618]: {{(pid=77618) _log_diff_call /opt/stack/neutron/neutron/tests/unit/plugins/ml2/drivers/mechanism_logger.py:59}} May 28 12:44:10 l75lg1-v1 neutron-server[77618]: DEBUG neutron_lib.callbacks.manager [None req-52bb25b6-e201-48e8-b427-2e1e387fb2e6 None None] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4166243', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8754903016533', 'neutron.services.ovn_l3.plugin.OVNL3RouterPlugin._port_update-8754901907784'] for port (be7063e1-bd60-43c5-bc4e-91151583d1f2), after_update {{(pid=77618) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:44:10 l75lg1-v1 dstat.sh[49771]: 28-05 12:44:10| 15 2 82 1 0|2752M 6748M 267M 5932M| 15k 2026B| 0 916k| 0 90.0 |2933 4249 |1.27 1.76 1.25|2.0 0 29| 0 0 | 0 2048M| 23 122 0 37 0 May 28 12:44:10 l75lg1-v1 neutron-server[77618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-52bb25b6-e201-48e8-b427-2e1e387fb2e6 None None] Pushing event updated for resources: {'Port': ['ID=be7063e1-bd60-43c5-bc4e-91151583d1f2,revision_number=2']} {{(pid=77618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 28 12:44:10 l75lg1-v1 neutron-server[77618]: DEBUG ovsdbapp.backend.ovs_idl.transaction [None req-c63b1acc-b5c6-4be8-9db9-04824fec27f2 None None] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=be7063e1-bd60-43c5-bc4e-91151583d1f2, resource={'id': 'be7063e1-bd60-43c5-bc4e-91151583d1f2', 'name': '', 'network_id': '5066e001-05ee-4812-ba7f-98a035d8bd0a', 'tenant_id': '', 'mac_address': 'fa:16:3e:62:f4:51', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '80c11046-4421-4321-813a-d46f0332997a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 28, 'fixed_ips': [{'subnet_id': 'cddf717c-a51e-4470-8ce9-c2ab09a80e38', 'ip_address': '172.24.4.236'}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'l75lg1-v1', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2024-05-28T12:44:08Z', 'updated_at': '2024-05-28T12:44:08Z', 'revision_number': 1, 'project_id': '', 'network': {'id': '5066e001-05ee-4812-ba7f-98a035d8bd0a', 'name': 'public', 'tenant_id': 'ea8d517cde1d40bb82c97e080ce071f7', 'admin_state_up': True, 'mtu': 1500, 'status': 'ACTIVE', 'subnets': ['cddf717c-a51e-4470-8ce9-c2ab09a80e38'], 'standard_attr_id': 23, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': True, 'vlan_transparent': None, 'description': '', 'port_security_enabled': True, 'is_default': True, 'tags': [], 'created_at': '2024-05-28T12:43:59Z', 'updated_at': '2024-05-28T12:44:06Z', 'revision_number': 2, 'project_id': 'ea8d517cde1d40bb82c97e080ce071f7', 'provider:network_type': 'flat', 'provider:physical_network': 'public', 'provider:segmentation_id': None}}, resource_type=ports, if_exists=True) {{(pid=77618) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:44:10 l75lg1-v1 neutron-server[77618]: DEBUG ovsdbapp.backend.ovs_idl.transaction [None req-c63b1acc-b5c6-4be8-9db9-04824fec27f2 None None] Running txn n=1 command(idx=1): SetLSwitchPortCommand(_result=None, lport=be7063e1-bd60-43c5-bc4e-91151583d1f2, external_ids_update=None, columns={'external_ids': {'neutron:port_name': '', 'neutron:device_id': '80c11046-4421-4321-813a-d46f0332997a', 'neutron:project_id': '', 'neutron:cidrs': '172.24.4.236/24', 'neutron:device_owner': 'network:router_gateway', 'neutron:subnet_pool_addr_scope4': '', 'neutron:subnet_pool_addr_scope6': '', 'neutron:network_name': 'neutron-5066e001-05ee-4812-ba7f-98a035d8bd0a', 'neutron:security_group_ids': '', 'neutron:revision_number': '1', 'neutron:vnic_type': 'normal', 'neutron:port_capabilities': '', 'neutron:mtu': ''}, 'parent_name': [], 'tag': [], 'options': {'requested-chassis': 'l75lg1-v1', 'mcast_flood_reports': 'true', 'exclude-lb-vips-from-garp': 'true', 'nat-addresses': 'router', 'router-port': 'lrp-be7063e1-bd60-43c5-bc4e-91151583d1f2'}, 'enabled': True, 'port_security': [], 'dhcpv4_options': [], 'dhcpv6_options': [], 'type': 'router', 'ha_chassis_group': []}, if_exists=False) {{(pid=77618) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:44:10 l75lg1-v1 neutron-server[77618]: DEBUG ovsdbapp.backend.ovs_idl.transaction [None req-c63b1acc-b5c6-4be8-9db9-04824fec27f2 None None] Running txn n=1 command(idx=2): PgDelPortCommand(_result=None, port_group=neutron_pg_drop, lsp=['be7063e1-bd60-43c5-bc4e-91151583d1f2'], if_exists=False) {{(pid=77618) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:44:10 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-53cecb61-7023-41e4-a5ea-23b1eb02606a None None] Hash Ring: Node c89b3497-133e-4a5a-b67a-3310d2cb2485 (host: l75lg1-v1) handling event "update" for row c100b146-635b-4ec8-a4a1-ddbd59917880 (table: Logical_Switch_Port) {{(pid=77619) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:44:10 l75lg1-v1 neutron-server[77618]: INFO neutron.db.ovn_revision_numbers_db [None req-52bb25b6-e201-48e8-b427-2e1e387fb2e6 None None] Successfully bumped revision number for resource be7063e1-bd60-43c5-bc4e-91151583d1f2 (type: ports) to 1 May 28 12:44:10 l75lg1-v1 neutron-server[77618]: INFO neutron.tests.unit.plugins.ml2.drivers.mechanism_logger [None req-52bb25b6-e201-48e8-b427-2e1e387fb2e6 None None] update_port_postcommit called with port settings {'id': 'be7063e1-bd60-43c5-bc4e-91151583d1f2', 'name': '', 'network_id': '5066e001-05ee-4812-ba7f-98a035d8bd0a', 'tenant_id': '', 'mac_address': 'fa:16:3e:62:f4:51', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '80c11046-4421-4321-813a-d46f0332997a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 28, 'fixed_ips': [{'subnet_id': 'cddf717c-a51e-4470-8ce9-c2ab09a80e38', 'ip_address': '172.24.4.236'}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'l75lg1-v1', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2024-05-28T12:44:08Z', 'updated_at': '2024-05-28T12:44:08Z', 'revision_number': 1, 'project_id': ''} (original settings {'id': 'be7063e1-bd60-43c5-bc4e-91151583d1f2', 'name': '', 'network_id': '5066e001-05ee-4812-ba7f-98a035d8bd0a', 'tenant_id': '', 'mac_address': 'fa:16:3e:62:f4:51', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '80c11046-4421-4321-813a-d46f0332997a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 28, 'fixed_ips': [{'subnet_id': 'cddf717c-a51e-4470-8ce9-c2ab09a80e38', 'ip_address': '172.24.4.236'}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2024-05-28T12:44:08Z', 'updated_at': '2024-05-28T12:44:08Z', 'revision_number': 1, 'project_id': ''}) host l75lg1-v1 (original host ) vif type unbound (original vif type unbound) vif details {} (original vif details {}) binding levels None (original binding levels None) on network {'id': '5066e001-05ee-4812-ba7f-98a035d8bd0a', 'name': 'public', 'tenant_id': 'ea8d517cde1d40bb82c97e080ce071f7', 'admin_state_up': True, 'mtu': 1500, 'status': 'ACTIVE', 'subnets': ['cddf717c-a51e-4470-8ce9-c2ab09a80e38'], 'standard_attr_id': 23, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': True, 'vlan_transparent': None, 'description': '', 'port_security_enabled': True, 'is_default': True, 'tags': [], 'created_at': '2024-05-28T12:43:59Z', 'updated_at': '2024-05-28T12:44:06Z', 'revision_number': 2, 'project_id': 'ea8d517cde1d40bb82c97e080ce071f7', 'provider:network_type': 'flat', 'provider:physical_network': 'public', 'provider:segmentation_id': None} with segments to bind None May 28 12:44:10 l75lg1-v1 neutron-server[77618]: DEBUG neutron.tests.unit.plugins.ml2.drivers.mechanism_logger [None req-52bb25b6-e201-48e8-b427-2e1e387fb2e6 None None] update_port_postcommit: May 28 12:44:10 l75lg1-v1 neutron-server[77618]: key[binding:host_id], -> l75lg1-v1 May 28 12:44:10 l75lg1-v1 neutron-server[77618]: {{(pid=77618) _log_diff_call /opt/stack/neutron/neutron/tests/unit/plugins/ml2/drivers/mechanism_logger.py:59}} May 28 12:44:10 l75lg1-v1 neutron-server[77618]: DEBUG neutron.plugins.ml2.managers [None req-52bb25b6-e201-48e8-b427-2e1e387fb2e6 None None] Attempting to bind port be7063e1-bd60-43c5-bc4e-91151583d1f2 on host l75lg1-v1 for vnic_type normal with profile {{(pid=77618) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:810}} May 28 12:44:10 l75lg1-v1 neutron-server[77618]: DEBUG neutron.plugins.ml2.managers [None req-52bb25b6-e201-48e8-b427-2e1e387fb2e6 None None] Attempting to bind port be7063e1-bd60-43c5-bc4e-91151583d1f2 by drivers ovn,logger on host l75lg1-v1 at level 0 using segments [{'id': '3385f5f9-bbb0-40f0-9631-6fb158c3207c', 'network_type': 'flat', 'physical_network': 'public', 'segmentation_id': None, 'network_id': '5066e001-05ee-4812-ba7f-98a035d8bd0a'}] {{(pid=77618) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:835}} May 28 12:44:10 l75lg1-v1 neutron-server[77618]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver [None req-52bb25b6-e201-48e8-b427-2e1e387fb2e6 None None] Attempting to bind port be7063e1-bd60-43c5-bc4e-91151583d1f2 on host l75lg1-v1 for network segment with type flat, segmentation ID None, physical network public {{(pid=77618) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/mech_driver.py:1009}} May 28 12:44:10 l75lg1-v1 neutron-server[77618]: DEBUG neutron.plugins.ml2.managers [None req-52bb25b6-e201-48e8-b427-2e1e387fb2e6 None None] Bound port: be7063e1-bd60-43c5-bc4e-91151583d1f2, host: l75lg1-v1, vif_type: ovs, vif_details: {"port_filter": true, "connectivity": "l2", "bridge_name": "br-int", "datapath_type": "system"}, binding_levels: [{'bound_driver': 'ovn', 'bound_segment': {'id': '3385f5f9-bbb0-40f0-9631-6fb158c3207c', 'network_type': 'flat', 'physical_network': 'public', 'segmentation_id': None, 'network_id': '5066e001-05ee-4812-ba7f-98a035d8bd0a'}}] {{(pid=77618) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:947}} May 28 12:44:10 l75lg1-v1 neutron-server[77618]: DEBUG neutron_lib.callbacks.manager [None req-52bb25b6-e201-48e8-b427-2e1e387fb2e6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1015114', 'neutron.services.ovn_l3.plugin.OVNL3RouterPlugin._port_update-8754901907784', 'neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_internal_ip_change_for_fip-8754903031884'] for port (be7063e1-bd60-43c5-bc4e-91151583d1f2), before_update {{(pid=77618) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:44:10 l75lg1-v1 neutron-server[77618]: DEBUG neutron.plugins.ml2.db [None req-52bb25b6-e201-48e8-b427-2e1e387fb2e6 None None] For port be7063e1-bd60-43c5-bc4e-91151583d1f2, host l75lg1-v1, cleared binding levels {{(pid=77618) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} May 28 12:44:10 l75lg1-v1 neutron-server[77618]: DEBUG neutron.plugins.ml2.db [None req-52bb25b6-e201-48e8-b427-2e1e387fb2e6 None None] For port be7063e1-bd60-43c5-bc4e-91151583d1f2, host l75lg1-v1, set binding levels [PortBindingLevel(driver='ovn',host='l75lg1-v1',level=0,port_id=be7063e1-bd60-43c5-bc4e-91151583d1f2,segment=NetworkSegment(3385f5f9-bbb0-40f0-9631-6fb158c3207c),segment_id=3385f5f9-bbb0-40f0-9631-6fb158c3207c)] {{(pid=77618) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} May 28 12:44:10 l75lg1-v1 neutron-server[77618]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver [None req-52bb25b6-e201-48e8-b427-2e1e387fb2e6 None None] No provisioning block for port be7063e1-bd60-43c5-bc4e-91151583d1f2 since host unchanged {{(pid=77618) _is_port_provisioning_required /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/mech_driver.py:725}} May 28 12:44:10 l75lg1-v1 neutron-server[77618]: INFO neutron.tests.unit.plugins.ml2.drivers.mechanism_logger [None req-52bb25b6-e201-48e8-b427-2e1e387fb2e6 None None] update_port_precommit called with port settings {'id': 'be7063e1-bd60-43c5-bc4e-91151583d1f2', 'name': '', 'network_id': '5066e001-05ee-4812-ba7f-98a035d8bd0a', 'tenant_id': '', 'mac_address': 'fa:16:3e:62:f4:51', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '80c11046-4421-4321-813a-d46f0332997a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 28, 'fixed_ips': [{'subnet_id': 'cddf717c-a51e-4470-8ce9-c2ab09a80e38', 'ip_address': '172.24.4.236'}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'l75lg1-v1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'port_filter': True, 'connectivity': 'l2', 'bridge_name': 'br-int', 'datapath_type': 'system'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2024-05-28T12:44:08Z', 'updated_at': '2024-05-28T12:44:10Z', 'revision_number': 2, 'project_id': ''} (original settings {'id': 'be7063e1-bd60-43c5-bc4e-91151583d1f2', 'name': '', 'network_id': '5066e001-05ee-4812-ba7f-98a035d8bd0a', 'tenant_id': '', 'mac_address': 'fa:16:3e:62:f4:51', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '80c11046-4421-4321-813a-d46f0332997a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 28, 'fixed_ips': [{'subnet_id': 'cddf717c-a51e-4470-8ce9-c2ab09a80e38', 'ip_address': '172.24.4.236'}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'l75lg1-v1', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2024-05-28T12:44:08Z', 'updated_at': '2024-05-28T12:44:10Z', 'revision_number': 2, 'project_id': ''}) host l75lg1-v1 (original host l75lg1-v1) vif type ovs (original vif type unbound) vif details {'port_filter': True, 'connectivity': 'l2', 'bridge_name': 'br-int', 'datapath_type': 'system'} (original vif details {}) binding levels [{'bound_driver': 'ovn', 'bound_segment': {'id': '3385f5f9-bbb0-40f0-9631-6fb158c3207c', 'network_type': 'flat', 'physical_network': 'public', 'segmentation_id': None, 'network_id': '5066e001-05ee-4812-ba7f-98a035d8bd0a'}}] (original binding levels None) on network {'id': '5066e001-05ee-4812-ba7f-98a035d8bd0a', 'name': 'public', 'tenant_id': 'ea8d517cde1d40bb82c97e080ce071f7', 'admin_state_up': True, 'mtu': 1500, 'status': 'ACTIVE', 'subnets': ['cddf717c-a51e-4470-8ce9-c2ab09a80e38'], 'standard_attr_id': 23, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': True, 'vlan_transparent': None, 'description': '', 'port_security_enabled': True, 'is_default': True, 'tags': [], 'created_at': '2024-05-28T12:43:59Z', 'updated_at': '2024-05-28T12:44:06Z', 'revision_number': 2, 'project_id': 'ea8d517cde1d40bb82c97e080ce071f7', 'provider:network_type': 'flat', 'provider:physical_network': 'public', 'provider:segmentation_id': None} with segments to bind None May 28 12:44:10 l75lg1-v1 neutron-server[77618]: DEBUG neutron.tests.unit.plugins.ml2.drivers.mechanism_logger [None req-52bb25b6-e201-48e8-b427-2e1e387fb2e6 None None] update_port_precommit: May 28 12:44:10 l75lg1-v1 neutron-server[77618]: key[binding:vif_type], unbound -> ovs May 28 12:44:10 l75lg1-v1 neutron-server[77618]: key[binding:vif_details], {} -> {'port_filter': True, 'connectivity': 'l2', 'bridge_name': 'br-int', 'datapath_type': 'system'} May 28 12:44:10 l75lg1-v1 neutron-server[77618]: {{(pid=77618) _log_diff_call /opt/stack/neutron/neutron/tests/unit/plugins/ml2/drivers/mechanism_logger.py:59}} May 28 12:44:10 l75lg1-v1 neutron-server[77618]: DEBUG neutron_lib.callbacks.manager [None req-52bb25b6-e201-48e8-b427-2e1e387fb2e6 None None] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4166243', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8754903016533', 'neutron.services.ovn_l3.plugin.OVNL3RouterPlugin._port_update-8754901907784'] for port (be7063e1-bd60-43c5-bc4e-91151583d1f2), after_update {{(pid=77618) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:44:10 l75lg1-v1 neutron-server[77618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-52bb25b6-e201-48e8-b427-2e1e387fb2e6 None None] Pushing event updated for resources: {'Port': ['ID=be7063e1-bd60-43c5-bc4e-91151583d1f2,revision_number=4']} {{(pid=77618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 28 12:44:10 l75lg1-v1 neutron-server[77618]: DEBUG ovsdbapp.backend.ovs_idl.transaction [None req-c63b1acc-b5c6-4be8-9db9-04824fec27f2 None None] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=be7063e1-bd60-43c5-bc4e-91151583d1f2, resource={'id': 'be7063e1-bd60-43c5-bc4e-91151583d1f2', 'name': '', 'network_id': '5066e001-05ee-4812-ba7f-98a035d8bd0a', 'tenant_id': '', 'mac_address': 'fa:16:3e:62:f4:51', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '80c11046-4421-4321-813a-d46f0332997a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 28, 'fixed_ips': [{'subnet_id': 'cddf717c-a51e-4470-8ce9-c2ab09a80e38', 'ip_address': '172.24.4.236'}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'l75lg1-v1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'port_filter': True, 'connectivity': 'l2', 'bridge_name': 'br-int', 'datapath_type': 'system'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2024-05-28T12:44:08Z', 'updated_at': '2024-05-28T12:44:10Z', 'revision_number': 2, 'project_id': '', 'network': {'id': '5066e001-05ee-4812-ba7f-98a035d8bd0a', 'name': 'public', 'tenant_id': 'ea8d517cde1d40bb82c97e080ce071f7', 'admin_state_up': True, 'mtu': 1500, 'status': 'ACTIVE', 'subnets': ['cddf717c-a51e-4470-8ce9-c2ab09a80e38'], 'standard_attr_id': 23, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': True, 'vlan_transparent': None, 'description': '', 'port_security_enabled': True, 'is_default': True, 'tags': [], 'created_at': '2024-05-28T12:43:59Z', 'updated_at': '2024-05-28T12:44:06Z', 'revision_number': 2, 'project_id': 'ea8d517cde1d40bb82c97e080ce071f7', 'provider:network_type': 'flat', 'provider:physical_network': 'public', 'provider:segmentation_id': None}}, resource_type=ports, if_exists=True) {{(pid=77618) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:44:10 l75lg1-v1 neutron-server[77618]: DEBUG ovsdbapp.backend.ovs_idl.transaction [None req-c63b1acc-b5c6-4be8-9db9-04824fec27f2 None None] Running txn n=1 command(idx=1): SetLSwitchPortCommand(_result=None, lport=be7063e1-bd60-43c5-bc4e-91151583d1f2, external_ids_update=None, columns={'external_ids': {'neutron:port_name': '', 'neutron:device_id': '80c11046-4421-4321-813a-d46f0332997a', 'neutron:project_id': '', 'neutron:cidrs': '172.24.4.236/24', 'neutron:device_owner': 'network:router_gateway', 'neutron:subnet_pool_addr_scope4': '', 'neutron:subnet_pool_addr_scope6': '', 'neutron:network_name': 'neutron-5066e001-05ee-4812-ba7f-98a035d8bd0a', 'neutron:security_group_ids': '', 'neutron:revision_number': '2', 'neutron:vnic_type': 'normal', 'neutron:port_capabilities': '', 'neutron:mtu': ''}, 'parent_name': [], 'tag': [], 'options': {'requested-chassis': 'l75lg1-v1', 'mcast_flood_reports': 'true', 'exclude-lb-vips-from-garp': 'true', 'nat-addresses': 'router', 'router-port': 'lrp-be7063e1-bd60-43c5-bc4e-91151583d1f2'}, 'enabled': True, 'port_security': [], 'dhcpv4_options': [], 'dhcpv6_options': [], 'type': 'router', 'ha_chassis_group': []}, if_exists=False) {{(pid=77618) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:44:10 l75lg1-v1 neutron-server[77618]: DEBUG ovsdbapp.backend.ovs_idl.transaction [None req-c63b1acc-b5c6-4be8-9db9-04824fec27f2 None None] Running txn n=1 command(idx=2): PgDelPortCommand(_result=None, port_group=neutron_pg_drop, lsp=['be7063e1-bd60-43c5-bc4e-91151583d1f2'], if_exists=False) {{(pid=77618) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:44:10 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-53cecb61-7023-41e4-a5ea-23b1eb02606a None None] Hash Ring: Node c89b3497-133e-4a5a-b67a-3310d2cb2485 (host: l75lg1-v1) handling event "update" for row c100b146-635b-4ec8-a4a1-ddbd59917880 (table: Logical_Switch_Port) {{(pid=77619) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:44:10 l75lg1-v1 neutron-server[77618]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-d9d4969c-e9ae-4d76-91b0-9b7c8eb907b3 None None] Hash Ring: Node 4c6fc793-7f5a-456f-b4d6-6e5bd97592f2 (host: l75lg1-v1) handling event "update" for row 58ca17de-33f0-42ed-8eac-a67cd94edbf1 (table: Port_Binding) {{(pid=77618) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:44:10 l75lg1-v1 neutron-server[77618]: INFO neutron.db.ovn_revision_numbers_db [None req-52bb25b6-e201-48e8-b427-2e1e387fb2e6 None None] Successfully bumped revision number for resource be7063e1-bd60-43c5-bc4e-91151583d1f2 (type: ports) to 2 May 28 12:44:10 l75lg1-v1 neutron-server[77618]: INFO neutron.tests.unit.plugins.ml2.drivers.mechanism_logger [None req-52bb25b6-e201-48e8-b427-2e1e387fb2e6 None None] update_port_postcommit called with port settings {'id': 'be7063e1-bd60-43c5-bc4e-91151583d1f2', 'name': '', 'network_id': '5066e001-05ee-4812-ba7f-98a035d8bd0a', 'tenant_id': '', 'mac_address': 'fa:16:3e:62:f4:51', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '80c11046-4421-4321-813a-d46f0332997a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 28, 'fixed_ips': [{'subnet_id': 'cddf717c-a51e-4470-8ce9-c2ab09a80e38', 'ip_address': '172.24.4.236'}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'l75lg1-v1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'port_filter': True, 'connectivity': 'l2', 'bridge_name': 'br-int', 'datapath_type': 'system'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2024-05-28T12:44:08Z', 'updated_at': '2024-05-28T12:44:10Z', 'revision_number': 2, 'project_id': ''} (original settings {'id': 'be7063e1-bd60-43c5-bc4e-91151583d1f2', 'name': '', 'network_id': '5066e001-05ee-4812-ba7f-98a035d8bd0a', 'tenant_id': '', 'mac_address': 'fa:16:3e:62:f4:51', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '80c11046-4421-4321-813a-d46f0332997a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 28, 'fixed_ips': [{'subnet_id': 'cddf717c-a51e-4470-8ce9-c2ab09a80e38', 'ip_address': '172.24.4.236'}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'l75lg1-v1', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2024-05-28T12:44:08Z', 'updated_at': '2024-05-28T12:44:10Z', 'revision_number': 2, 'project_id': ''}) host l75lg1-v1 (original host l75lg1-v1) vif type ovs (original vif type unbound) vif details {'port_filter': True, 'connectivity': 'l2', 'bridge_name': 'br-int', 'datapath_type': 'system'} (original vif details {}) binding levels [{'bound_driver': 'ovn', 'bound_segment': {'id': '3385f5f9-bbb0-40f0-9631-6fb158c3207c', 'network_type': 'flat', 'physical_network': 'public', 'segmentation_id': None, 'network_id': '5066e001-05ee-4812-ba7f-98a035d8bd0a'}}] (original binding levels None) on network {'id': '5066e001-05ee-4812-ba7f-98a035d8bd0a', 'name': 'public', 'tenant_id': 'ea8d517cde1d40bb82c97e080ce071f7', 'admin_state_up': True, 'mtu': 1500, 'status': 'ACTIVE', 'subnets': ['cddf717c-a51e-4470-8ce9-c2ab09a80e38'], 'standard_attr_id': 23, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': True, 'vlan_transparent': None, 'description': '', 'port_security_enabled': True, 'is_default': True, 'tags': [], 'created_at': '2024-05-28T12:43:59Z', 'updated_at': '2024-05-28T12:44:06Z', 'revision_number': 2, 'project_id': 'ea8d517cde1d40bb82c97e080ce071f7', 'provider:network_type': 'flat', 'provider:physical_network': 'public', 'provider:segmentation_id': None} with segments to bind None May 28 12:44:10 l75lg1-v1 neutron-server[77618]: DEBUG neutron.tests.unit.plugins.ml2.drivers.mechanism_logger [None req-52bb25b6-e201-48e8-b427-2e1e387fb2e6 None None] update_port_postcommit: May 28 12:44:10 l75lg1-v1 neutron-server[77618]: key[binding:vif_type], unbound -> ovs May 28 12:44:10 l75lg1-v1 neutron-server[77618]: key[binding:vif_details], {} -> {'port_filter': True, 'connectivity': 'l2', 'bridge_name': 'br-int', 'datapath_type': 'system'} May 28 12:44:10 l75lg1-v1 neutron-server[77618]: {{(pid=77618) _log_diff_call /opt/stack/neutron/neutron/tests/unit/plugins/ml2/drivers/mechanism_logger.py:59}} May 28 12:44:10 l75lg1-v1 neutron-server[77618]: DEBUG neutron.plugins.ml2.plugin [None req-52bb25b6-e201-48e8-b427-2e1e387fb2e6 None None] Current status of the port be7063e1-bd60-43c5-bc4e-91151583d1f2 is: DOWN; New status is: ACTIVE {{(pid=77618) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2395}} May 28 12:44:10 l75lg1-v1 neutron-server[77618]: DEBUG neutron_lib.callbacks.manager [None req-52bb25b6-e201-48e8-b427-2e1e387fb2e6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1015114', 'neutron.services.ovn_l3.plugin.OVNL3RouterPlugin._port_update-8754901907784', 'neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_internal_ip_change_for_fip-8754903031884'] for port (be7063e1-bd60-43c5-bc4e-91151583d1f2), before_update {{(pid=77618) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:44:10 l75lg1-v1 neutron-server[77618]: DEBUG neutron.plugins.ml2.db [None req-52bb25b6-e201-48e8-b427-2e1e387fb2e6 None None] For port be7063e1-bd60-43c5-bc4e-91151583d1f2, host l75lg1-v1, got binding levels [PortBindingLevel(driver='ovn',host='l75lg1-v1',level=0,port_id=be7063e1-bd60-43c5-bc4e-91151583d1f2,segment=NetworkSegment(3385f5f9-bbb0-40f0-9631-6fb158c3207c),segment_id=3385f5f9-bbb0-40f0-9631-6fb158c3207c)] {{(pid=77618) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} May 28 12:44:10 l75lg1-v1 neutron-server[77618]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver [None req-52bb25b6-e201-48e8-b427-2e1e387fb2e6 None None] No provisioning block for port be7063e1-bd60-43c5-bc4e-91151583d1f2 since it is active {{(pid=77618) _is_port_provisioning_required /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/mech_driver.py:715}} May 28 12:44:10 l75lg1-v1 neutron-server[77618]: INFO neutron.tests.unit.plugins.ml2.drivers.mechanism_logger [None req-52bb25b6-e201-48e8-b427-2e1e387fb2e6 None None] update_port_precommit called with port settings {'id': 'be7063e1-bd60-43c5-bc4e-91151583d1f2', 'name': '', 'network_id': '5066e001-05ee-4812-ba7f-98a035d8bd0a', 'tenant_id': '', 'mac_address': 'fa:16:3e:62:f4:51', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '80c11046-4421-4321-813a-d46f0332997a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 28, 'fixed_ips': [{'subnet_id': 'cddf717c-a51e-4470-8ce9-c2ab09a80e38', 'ip_address': '172.24.4.236'}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'l75lg1-v1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'port_filter': True, 'connectivity': 'l2', 'bridge_name': 'br-int', 'datapath_type': 'system', 'bound_drivers': {'0': 'ovn'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2024-05-28T12:44:08Z', 'updated_at': '2024-05-28T12:44:10Z', 'revision_number': 5, 'project_id': ''} (original settings {'id': 'be7063e1-bd60-43c5-bc4e-91151583d1f2', 'name': '', 'network_id': '5066e001-05ee-4812-ba7f-98a035d8bd0a', 'tenant_id': '', 'mac_address': 'fa:16:3e:62:f4:51', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '80c11046-4421-4321-813a-d46f0332997a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 28, 'fixed_ips': [{'subnet_id': 'cddf717c-a51e-4470-8ce9-c2ab09a80e38', 'ip_address': '172.24.4.236'}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'l75lg1-v1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'port_filter': True, 'connectivity': 'l2', 'bridge_name': 'br-int', 'datapath_type': 'system', 'bound_drivers': {'0': 'ovn'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2024-05-28T12:44:08Z', 'updated_at': '2024-05-28T12:44:10Z', 'revision_number': 4, 'project_id': ''}) host l75lg1-v1 (original host l75lg1-v1) vif type ovs (original vif type ovs) vif details {'port_filter': True, 'connectivity': 'l2', 'bridge_name': 'br-int', 'datapath_type': 'system'} (original vif details {'port_filter': True, 'connectivity': 'l2', 'bridge_name': 'br-int', 'datapath_type': 'system'}) binding levels [{'bound_driver': 'ovn', 'bound_segment': {'id': '3385f5f9-bbb0-40f0-9631-6fb158c3207c', 'network_type': 'flat', 'physical_network': 'public', 'segmentation_id': None, 'network_id': '5066e001-05ee-4812-ba7f-98a035d8bd0a'}}] (original binding levels [{'bound_driver': 'ovn', 'bound_segment': {'id': '3385f5f9-bbb0-40f0-9631-6fb158c3207c', 'network_type': 'flat', 'physical_network': 'public', 'segmentation_id': None, 'network_id': '5066e001-05ee-4812-ba7f-98a035d8bd0a'}}]) on network {'id': '5066e001-05ee-4812-ba7f-98a035d8bd0a', 'name': 'public', 'tenant_id': 'ea8d517cde1d40bb82c97e080ce071f7', 'admin_state_up': True, 'mtu': 1500, 'status': 'ACTIVE', 'subnets': ['cddf717c-a51e-4470-8ce9-c2ab09a80e38'], 'standard_attr_id': 23, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': True, 'vlan_transparent': None, 'description': '', 'port_security_enabled': True, 'is_default': True, 'tags': [], 'created_at': '2024-05-28T12:43:59Z', 'updated_at': '2024-05-28T12:44:06Z', 'revision_number': 2, 'project_id': 'ea8d517cde1d40bb82c97e080ce071f7', 'provider:network_type': 'flat', 'provider:physical_network': 'public', 'provider:segmentation_id': None} with segments to bind None May 28 12:44:10 l75lg1-v1 neutron-server[77618]: DEBUG neutron.tests.unit.plugins.ml2.drivers.mechanism_logger [None req-52bb25b6-e201-48e8-b427-2e1e387fb2e6 None None] update_port_precommit: May 28 12:44:10 l75lg1-v1 neutron-server[77618]: key[status], DOWN -> ACTIVE May 28 12:44:10 l75lg1-v1 neutron-server[77618]: key[revision_number], 4 -> 5 May 28 12:44:10 l75lg1-v1 neutron-server[77618]: {{(pid=77618) _log_diff_call /opt/stack/neutron/neutron/tests/unit/plugins/ml2/drivers/mechanism_logger.py:59}} May 28 12:44:11 l75lg1-v1 neutron-server[77618]: DEBUG ovsdbapp.backend.ovs_idl.transaction [None req-c63b1acc-b5c6-4be8-9db9-04824fec27f2 None None] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=be7063e1-bd60-43c5-bc4e-91151583d1f2, resource={'id': 'be7063e1-bd60-43c5-bc4e-91151583d1f2', 'name': '', 'network_id': '5066e001-05ee-4812-ba7f-98a035d8bd0a', 'tenant_id': '', 'mac_address': 'fa:16:3e:62:f4:51', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '80c11046-4421-4321-813a-d46f0332997a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 28, 'fixed_ips': [{'subnet_id': 'cddf717c-a51e-4470-8ce9-c2ab09a80e38', 'ip_address': '172.24.4.236'}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'l75lg1-v1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'port_filter': True, 'connectivity': 'l2', 'bridge_name': 'br-int', 'datapath_type': 'system', 'bound_drivers': {'0': 'ovn'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2024-05-28T12:44:08Z', 'updated_at': '2024-05-28T12:44:10Z', 'revision_number': 5, 'project_id': '', 'network': {'id': '5066e001-05ee-4812-ba7f-98a035d8bd0a', 'name': 'public', 'tenant_id': 'ea8d517cde1d40bb82c97e080ce071f7', 'admin_state_up': True, 'mtu': 1500, 'status': 'ACTIVE', 'subnets': ['cddf717c-a51e-4470-8ce9-c2ab09a80e38'], 'standard_attr_id': 23, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': True, 'vlan_transparent': None, 'description': '', 'port_security_enabled': True, 'is_default': True, 'tags': [], 'created_at': '2024-05-28T12:43:59Z', 'updated_at': '2024-05-28T12:44:06Z', 'revision_number': 2, 'project_id': 'ea8d517cde1d40bb82c97e080ce071f7', 'provider:network_type': 'flat', 'provider:physical_network': 'public', 'provider:segmentation_id': None}}, resource_type=ports, if_exists=True) {{(pid=77618) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:44:11 l75lg1-v1 neutron-server[77618]: DEBUG ovsdbapp.backend.ovs_idl.transaction [None req-c63b1acc-b5c6-4be8-9db9-04824fec27f2 None None] Running txn n=1 command(idx=1): SetLSwitchPortCommand(_result=None, lport=be7063e1-bd60-43c5-bc4e-91151583d1f2, external_ids_update=None, columns={'external_ids': {'neutron:port_name': '', 'neutron:device_id': '80c11046-4421-4321-813a-d46f0332997a', 'neutron:project_id': '', 'neutron:cidrs': '172.24.4.236/24', 'neutron:device_owner': 'network:router_gateway', 'neutron:subnet_pool_addr_scope4': '', 'neutron:subnet_pool_addr_scope6': '', 'neutron:network_name': 'neutron-5066e001-05ee-4812-ba7f-98a035d8bd0a', 'neutron:security_group_ids': '', 'neutron:revision_number': '5', 'neutron:vnic_type': 'normal', 'neutron:port_capabilities': '', 'neutron:mtu': ''}, 'parent_name': [], 'tag': [], 'options': {'requested-chassis': 'l75lg1-v1', 'mcast_flood_reports': 'true', 'exclude-lb-vips-from-garp': 'true', 'nat-addresses': 'router', 'router-port': 'lrp-be7063e1-bd60-43c5-bc4e-91151583d1f2'}, 'enabled': True, 'port_security': [], 'dhcpv4_options': [], 'dhcpv6_options': [], 'type': 'router', 'ha_chassis_group': []}, if_exists=False) {{(pid=77618) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:44:11 l75lg1-v1 neutron-server[77618]: DEBUG ovsdbapp.backend.ovs_idl.transaction [None req-c63b1acc-b5c6-4be8-9db9-04824fec27f2 None None] Running txn n=1 command(idx=2): PgDelPortCommand(_result=None, port_group=neutron_pg_drop, lsp=['be7063e1-bd60-43c5-bc4e-91151583d1f2'], if_exists=False) {{(pid=77618) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:44:11 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-53cecb61-7023-41e4-a5ea-23b1eb02606a None None] Hash Ring: Node c89b3497-133e-4a5a-b67a-3310d2cb2485 (host: l75lg1-v1) handling event "update" for row c100b146-635b-4ec8-a4a1-ddbd59917880 (table: Logical_Switch_Port) {{(pid=77619) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:44:11 l75lg1-v1 neutron-server[77618]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-d9d4969c-e9ae-4d76-91b0-9b7c8eb907b3 None None] Hash Ring: Node 4c6fc793-7f5a-456f-b4d6-6e5bd97592f2 (host: l75lg1-v1) handling event "update" for row 58ca17de-33f0-42ed-8eac-a67cd94edbf1 (table: Port_Binding) {{(pid=77618) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:44:11 l75lg1-v1 neutron-server[77618]: INFO neutron.db.ovn_revision_numbers_db [None req-52bb25b6-e201-48e8-b427-2e1e387fb2e6 None None] Successfully bumped revision number for resource be7063e1-bd60-43c5-bc4e-91151583d1f2 (type: ports) to 5 May 28 12:44:11 l75lg1-v1 neutron-server[77618]: INFO neutron.tests.unit.plugins.ml2.drivers.mechanism_logger [None req-52bb25b6-e201-48e8-b427-2e1e387fb2e6 None None] update_port_postcommit called with port settings {'id': 'be7063e1-bd60-43c5-bc4e-91151583d1f2', 'name': '', 'network_id': '5066e001-05ee-4812-ba7f-98a035d8bd0a', 'tenant_id': '', 'mac_address': 'fa:16:3e:62:f4:51', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '80c11046-4421-4321-813a-d46f0332997a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 28, 'fixed_ips': [{'subnet_id': 'cddf717c-a51e-4470-8ce9-c2ab09a80e38', 'ip_address': '172.24.4.236'}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'l75lg1-v1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'port_filter': True, 'connectivity': 'l2', 'bridge_name': 'br-int', 'datapath_type': 'system', 'bound_drivers': {'0': 'ovn'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2024-05-28T12:44:08Z', 'updated_at': '2024-05-28T12:44:10Z', 'revision_number': 5, 'project_id': ''} (original settings {'id': 'be7063e1-bd60-43c5-bc4e-91151583d1f2', 'name': '', 'network_id': '5066e001-05ee-4812-ba7f-98a035d8bd0a', 'tenant_id': '', 'mac_address': 'fa:16:3e:62:f4:51', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '80c11046-4421-4321-813a-d46f0332997a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 28, 'fixed_ips': [{'subnet_id': 'cddf717c-a51e-4470-8ce9-c2ab09a80e38', 'ip_address': '172.24.4.236'}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'l75lg1-v1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'port_filter': True, 'connectivity': 'l2', 'bridge_name': 'br-int', 'datapath_type': 'system', 'bound_drivers': {'0': 'ovn'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2024-05-28T12:44:08Z', 'updated_at': '2024-05-28T12:44:10Z', 'revision_number': 4, 'project_id': ''}) host l75lg1-v1 (original host l75lg1-v1) vif type ovs (original vif type ovs) vif details {'port_filter': True, 'connectivity': 'l2', 'bridge_name': 'br-int', 'datapath_type': 'system'} (original vif details {'port_filter': True, 'connectivity': 'l2', 'bridge_name': 'br-int', 'datapath_type': 'system'}) binding levels [{'bound_driver': 'ovn', 'bound_segment': {'id': '3385f5f9-bbb0-40f0-9631-6fb158c3207c', 'network_type': 'flat', 'physical_network': 'public', 'segmentation_id': None, 'network_id': '5066e001-05ee-4812-ba7f-98a035d8bd0a'}}] (original binding levels [{'bound_driver': 'ovn', 'bound_segment': {'id': '3385f5f9-bbb0-40f0-9631-6fb158c3207c', 'network_type': 'flat', 'physical_network': 'public', 'segmentation_id': None, 'network_id': '5066e001-05ee-4812-ba7f-98a035d8bd0a'}}]) on network {'id': '5066e001-05ee-4812-ba7f-98a035d8bd0a', 'name': 'public', 'tenant_id': 'ea8d517cde1d40bb82c97e080ce071f7', 'admin_state_up': True, 'mtu': 1500, 'status': 'ACTIVE', 'subnets': ['cddf717c-a51e-4470-8ce9-c2ab09a80e38'], 'standard_attr_id': 23, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': True, 'vlan_transparent': None, 'description': '', 'port_security_enabled': True, 'is_default': True, 'tags': [], 'created_at': '2024-05-28T12:43:59Z', 'updated_at': '2024-05-28T12:44:06Z', 'revision_number': 2, 'project_id': 'ea8d517cde1d40bb82c97e080ce071f7', 'provider:network_type': 'flat', 'provider:physical_network': 'public', 'provider:segmentation_id': None} with segments to bind None May 28 12:44:11 l75lg1-v1 neutron-server[77618]: DEBUG neutron.tests.unit.plugins.ml2.drivers.mechanism_logger [None req-52bb25b6-e201-48e8-b427-2e1e387fb2e6 None None] update_port_postcommit: May 28 12:44:11 l75lg1-v1 neutron-server[77618]: key[status], DOWN -> ACTIVE May 28 12:44:11 l75lg1-v1 neutron-server[77618]: key[revision_number], 4 -> 5 May 28 12:44:11 l75lg1-v1 neutron-server[77618]: {{(pid=77618) _log_diff_call /opt/stack/neutron/neutron/tests/unit/plugins/ml2/drivers/mechanism_logger.py:59}} May 28 12:44:11 l75lg1-v1 neutron-server[77618]: DEBUG neutron_lib.callbacks.manager [None req-52bb25b6-e201-48e8-b427-2e1e387fb2e6 None None] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4166243', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8754903016533', 'neutron.services.ovn_l3.plugin.OVNL3RouterPlugin._port_update-8754901907784'] for port (be7063e1-bd60-43c5-bc4e-91151583d1f2), after_update {{(pid=77618) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:44:11 l75lg1-v1 neutron-server[77618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-52bb25b6-e201-48e8-b427-2e1e387fb2e6 None None] Pushing event updated for resources: {'Port': ['ID=be7063e1-bd60-43c5-bc4e-91151583d1f2,revision_number=5']} {{(pid=77618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 28 12:44:11 l75lg1-v1 dstat.sh[49771]: 28-05 12:44:11| 18 3 78 1 0|2792M 6707M 267M 5932M| 23k 10k| 0 1268k| 0 112 |4394 6771 |1.27 1.76 1.25|1.0 0 130| 0 0 | 0 2048M| 23 122 0 37 0 May 28 12:44:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd404c83-2a9d-4178-963b-c7a6305a84c3 None None] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:44:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd404c83-2a9d-4178-963b-c7a6305a84c3 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:44:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd404c83-2a9d-4178-963b-c7a6305a84c3 None None] PATH_INFO: `/` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:44:11 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 464/912] 10.27.203.238 () {58 vars in 1014 bytes} [Tue May 28 12:44:11 2024] GET /identity => generated 272 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:44:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5476a8aa-8013-49ee-86aa-2a116e4aac3f None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:44:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5476a8aa-8013-49ee-86aa-2a116e4aac3f None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:44:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5476a8aa-8013-49ee-86aa-2a116e4aac3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:44:11 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-5476a8aa-8013-49ee-86aa-2a116e4aac3f None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:44:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-5476a8aa-8013-49ee-86aa-2a116e4aac3f None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:44:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-5476a8aa-8013-49ee-86aa-2a116e4aac3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:44:11 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 449/913] 10.27.203.238 () {62 vars in 1111 bytes} [Tue May 28 12:44:11 2024] POST /identity/v3/auth/tokens => generated 3991 bytes in 25 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:44:11 l75lg1-v1 neutron-server[77619]: DEBUG neutron.wsgi [-] (77619) accepted ('10.27.203.238', 38016) {{(pid=77619) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 12:44:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd404c83-2a9d-4178-963b-c7a6305a84c3 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:44:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd404c83-2a9d-4178-963b-c7a6305a84c3 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:44:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993a82f6-5e4f-411f-a011-555bbae599da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef17047035e4b518fd5360a01f2da1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:44:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993a82f6-5e4f-411f-a011-555bbae599da service neutron] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:44:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993a82f6-5e4f-411f-a011-555bbae599da service neutron] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:44:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993a82f6-5e4f-411f-a011-555bbae599da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:44:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993a82f6-5e4f-411f-a011-555bbae599da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:44:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993a82f6-5e4f-411f-a011-555bbae599da service neutron] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:44:11 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 465/914] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 12:44:11 2024] GET /identity/v3/auth/tokens => generated 3991 bytes in 21 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 12:44:12 l75lg1-v1 neutron-server[77619]: INFO neutron.wsgi [None req-1ccca61d-01ec-4294-b9e3-bfcf99d5e77f admin admin] 10.27.203.238 "GET /networking/v2.0/ports?device_owner=network%3Arouter_gateway&fields=id&fields=name&fields=mac_address&fields=fixed_ips&fields=status HTTP/1.1" status: 200 len: 413 time: 0.0910790 May 28 12:44:12 l75lg1-v1 dstat.sh[49771]: 28-05 12:44:12| 9 1 89 0 0|2757M 6742M 267M 5932M| 22k 3022B| 0 436k| 0 29.0 |1948 2333 |1.25 1.74 1.25|1.0 0 33| 0 0 | 0 2048M| 23 122 0 38 0 May 28 12:44:12 l75lg1-v1 neutron-server[77619]: DEBUG ovsdbapp.backend.ovs_idl.transaction [None req-53cecb61-7023-41e4-a5ea-23b1eb02606a None None] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=Logical_Switch_Port, record=be7063e1-bd60-43c5-bc4e-91151583d1f2, col_values=(('external_ids', {'neutron:host_id': 'l75lg1-v1'}),), if_exists=True) {{(pid=77619) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:44:12 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-53cecb61-7023-41e4-a5ea-23b1eb02606a None None] Hash Ring: Node c89b3497-133e-4a5a-b67a-3310d2cb2485 (host: l75lg1-v1) handling event "update" for row c100b146-635b-4ec8-a4a1-ddbd59917880 (table: Logical_Switch_Port) {{(pid=77619) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:44:12 l75lg1-v1 neutron-server[77618]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-d9d4969c-e9ae-4d76-91b0-9b7c8eb907b3 None None] Hash Ring: Node 4c6fc793-7f5a-456f-b4d6-6e5bd97592f2 (host: l75lg1-v1) handling event "update" for row 58ca17de-33f0-42ed-8eac-a67cd94edbf1 (table: Port_Binding) {{(pid=77618) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:44:12 l75lg1-v1 neutron-server[77621]: DEBUG dbcounter [-] [77621] Writing DB stats neutron:SELECT=2 {{(pid=77621) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:44:12 l75lg1-v1 neutron-server[77621]: DEBUG dbcounter [-] [77621] Writing DB stats neutron:SELECT=2 {{(pid=77621) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:44:13 l75lg1-v1 dstat.sh[49771]: 28-05 12:44:13| 10 1 88 0 0|2803M 6696M 267M 5932M| 19k 90B| 0 684k| 0 40.0 |1773 2070 |1.25 1.74 1.25|1.0 0 0| 0 0 | 0 2048M| 23 122 0 38 0 May 28 12:44:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88001ac4-81a9-4859-a38f-f19c22fe3bfd None None] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:44:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88001ac4-81a9-4859-a38f-f19c22fe3bfd None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:44:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88001ac4-81a9-4859-a38f-f19c22fe3bfd None None] PATH_INFO: `/` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:44:13 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 450/915] 10.27.203.238 () {58 vars in 1014 bytes} [Tue May 28 12:44:13 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:44:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c07d96-ff4a-4e18-9c33-d3cb42801b8b None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:44:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c07d96-ff4a-4e18-9c33-d3cb42801b8b None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:44:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c07d96-ff4a-4e18-9c33-d3cb42801b8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:44:13 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-f7c07d96-ff4a-4e18-9c33-d3cb42801b8b None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:44:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-f7c07d96-ff4a-4e18-9c33-d3cb42801b8b None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:44:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-f7c07d96-ff4a-4e18-9c33-d3cb42801b8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:44:13 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 466/916] 10.27.203.238 () {62 vars in 1111 bytes} [Tue May 28 12:44:13 2024] POST /identity/v3/auth/tokens => generated 3990 bytes in 25 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:44:13 l75lg1-v1 neutron-server[77618]: DEBUG neutron.wsgi [-] (77618) accepted ('10.27.203.238', 38018) {{(pid=77618) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 12:44:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88001ac4-81a9-4859-a38f-f19c22fe3bfd None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:44:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88001ac4-81a9-4859-a38f-f19c22fe3bfd None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:44:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3820bb4-8729-41e7-8e60-3bdb43c9fc4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef17047035e4b518fd5360a01f2da1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:44:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3820bb4-8729-41e7-8e60-3bdb43c9fc4a service neutron] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:44:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3820bb4-8729-41e7-8e60-3bdb43c9fc4a service neutron] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:44:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3820bb4-8729-41e7-8e60-3bdb43c9fc4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:44:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3820bb4-8729-41e7-8e60-3bdb43c9fc4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:44:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3820bb4-8729-41e7-8e60-3bdb43c9fc4a service neutron] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:44:13 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 451/917] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 12:44:13 2024] GET /identity/v3/auth/tokens => generated 3990 bytes in 21 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 12:44:13 l75lg1-v1 neutron-server[77618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9b66acc8-228c-4e95-81da-e8fc794ec791 demo admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=77618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:258}} May 28 12:44:13 l75lg1-v1 neutron-server[77618]: INFO neutron.wsgi [None req-9b66acc8-228c-4e95-81da-e8fc794ec791 demo admin] 10.27.203.238 "GET /networking/v2.0/subnets/799ded51-0b75-4f67-94e9-0a7ea3c3f3d6 HTTP/1.1" status: 200 len: 905 time: 0.0530784 May 28 12:44:13 l75lg1-v1 neutron-server[77618]: INFO neutron.wsgi [None req-a5c1df91-cdb6-48e7-8d72-0d6e1d181cae demo admin] 10.27.203.238 "GET /networking/v2.0/routers/80c11046-4421-4321-813a-d46f0332997a HTTP/1.1" status: 200 len: 1120 time: 0.1143758 May 28 12:44:14 l75lg1-v1 neutron-server[77618]: DEBUG neutron_lib.callbacks.manager [None req-eb5706e0-244e-4338-8d28-c30965e2a431 demo admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1015114'] for port (None), before_create {{(pid=77618) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:44:14 l75lg1-v1 dstat.sh[49771]: 28-05 12:44:14| 10 1 89 1 0|2815M 6684M 267M 5932M| 16k 172B| 0 2548k| 0 361 |1969 2630 |1.25 1.74 1.25|1.0 0 0| 0 0 | 0 2048M| 23 124 0 34 0 May 28 12:44:14 l75lg1-v1 neutron-server[77618]: DEBUG neutron.db.db_base_plugin_common [None req-eb5706e0-244e-4338-8d28-c30965e2a431 demo admin] Allocated IP fd12:3562:78f7::1 (fb218033-3d98-4065-b336-c595d5e6ca77/799ded51-0b75-4f67-94e9-0a7ea3c3f3d6/268e1eb8-0568-4553-9120-b5ec7ec1d878) {{(pid=77618) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:134}} May 28 12:44:14 l75lg1-v1 neutron-server[77618]: DEBUG neutron_lib.callbacks.manager [None req-eb5706e0-244e-4338-8d28-c30965e2a431 demo admin] Publish callbacks [] for port (268e1eb8-0568-4553-9120-b5ec7ec1d878), precommit_create {{(pid=77618) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:44:14 l75lg1-v1 neutron-server[77618]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver [None req-eb5706e0-244e-4338-8d28-c30965e2a431 demo admin] No provisioning block for port 268e1eb8-0568-4553-9120-b5ec7ec1d878 since it does not have a host {{(pid=77618) _is_port_provisioning_required /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/mech_driver.py:720}} May 28 12:44:14 l75lg1-v1 neutron-server[77618]: DEBUG neutron.db.ovn_revision_numbers_db [None req-eb5706e0-244e-4338-8d28-c30965e2a431 demo admin] create_initial_revision uuid=268e1eb8-0568-4553-9120-b5ec7ec1d878, type=ports, rev=-1 {{(pid=77618) create_initial_revision /opt/stack/neutron/neutron/db/ovn_revision_numbers_db.py:108}} May 28 12:44:14 l75lg1-v1 neutron-server[77618]: DEBUG neutron.db.ovn_revision_numbers_db [None req-eb5706e0-244e-4338-8d28-c30965e2a431 demo admin] create_initial_revision uuid=268e1eb8-0568-4553-9120-b5ec7ec1d878, type=router_ports, rev=-1 {{(pid=77618) create_initial_revision /opt/stack/neutron/neutron/db/ovn_revision_numbers_db.py:108}} May 28 12:44:14 l75lg1-v1 neutron-server[77618]: INFO neutron.tests.unit.plugins.ml2.drivers.mechanism_logger [None req-eb5706e0-244e-4338-8d28-c30965e2a431 demo admin] create_port_precommit called with port settings {'id': '268e1eb8-0568-4553-9120-b5ec7ec1d878', 'name': '', 'network_id': 'fb218033-3d98-4065-b336-c595d5e6ca77', 'tenant_id': '95de88f6d26e4420bc466ba67668171f', 'mac_address': 'fa:16:3e:7c:1e:ba', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '80c11046-4421-4321-813a-d46f0332997a', 'device_owner': 'network:router_interface', 'standard_attr_id': 29, 'fixed_ips': [{'subnet_id': '799ded51-0b75-4f67-94e9-0a7ea3c3f3d6', 'ip_address': 'fd12:3562:78f7::1'}], 'project_id': '95de88f6d26e4420bc466ba67668171f', 'port_security_enabled': False, 'security_groups': [], 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'allowed_address_pairs': []} (original settings None) host (original host None) vif type unbound (original vif type None) vif details {} (original vif details None) binding levels None (original binding levels None) on network {'id': 'fb218033-3d98-4065-b336-c595d5e6ca77', 'name': 'private', 'tenant_id': '95de88f6d26e4420bc466ba67668171f', 'admin_state_up': True, 'mtu': 1442, 'status': 'ACTIVE', 'subnets': ['5508b790-cc91-4b59-8d30-81ef4480e470', '799ded51-0b75-4f67-94e9-0a7ea3c3f3d6'], 'standard_attr_id': 12, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'vlan_transparent': None, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2024-05-28T12:43:43Z', 'updated_at': '2024-05-28T12:43:49Z', 'revision_number': 3, 'project_id': '95de88f6d26e4420bc466ba67668171f', 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 30276} with segments to bind None May 28 12:44:14 l75lg1-v1 neutron-server[77618]: DEBUG neutron.tests.unit.plugins.ml2.drivers.mechanism_logger [None req-eb5706e0-244e-4338-8d28-c30965e2a431 demo admin] create_port_precommit: May 28 12:44:14 l75lg1-v1 neutron-server[77618]: key[tenant_id], None -> 95de88f6d26e4420bc466ba67668171f May 28 12:44:14 l75lg1-v1 neutron-server[77618]: key[network_id], None -> fb218033-3d98-4065-b336-c595d5e6ca77 May 28 12:44:14 l75lg1-v1 neutron-server[77618]: key[allowed_address_pairs], None -> [] May 28 12:44:14 l75lg1-v1 neutron-server[77618]: key[binding:vif_type], None -> unbound May 28 12:44:14 l75lg1-v1 neutron-server[77618]: key[project_id], None -> 95de88f6d26e4420bc466ba67668171f May 28 12:44:14 l75lg1-v1 neutron-server[77618]: key[admin_state_up], None -> True May 28 12:44:14 l75lg1-v1 neutron-server[77618]: key[id], None -> 268e1eb8-0568-4553-9120-b5ec7ec1d878 May 28 12:44:14 l75lg1-v1 neutron-server[77618]: key[security_groups], None -> [] May 28 12:44:14 l75lg1-v1 neutron-server[77618]: key[binding:vnic_type], None -> normal May 28 12:44:14 l75lg1-v1 neutron-server[77618]: key[name], None -> May 28 12:44:14 l75lg1-v1 neutron-server[77618]: key[status], None -> DOWN May 28 12:44:14 l75lg1-v1 neutron-server[77618]: key[binding:profile], None -> {} May 28 12:44:14 l75lg1-v1 neutron-server[77618]: key[port_security_enabled], None -> False May 28 12:44:14 l75lg1-v1 neutron-server[77618]: key[standard_attr_id], None -> 29 May 28 12:44:14 l75lg1-v1 neutron-server[77618]: key[device_owner], None -> network:router_interface May 28 12:44:14 l75lg1-v1 neutron-server[77618]: key[device_id], None -> 80c11046-4421-4321-813a-d46f0332997a May 28 12:44:14 l75lg1-v1 neutron-server[77618]: key[mac_address], None -> fa:16:3e:7c:1e:ba May 28 12:44:14 l75lg1-v1 neutron-server[77618]: key[binding:host_id], None -> May 28 12:44:14 l75lg1-v1 neutron-server[77618]: key[binding:vif_details], None -> {} May 28 12:44:14 l75lg1-v1 neutron-server[77618]: key[fixed_ips], None -> [{'subnet_id': '799ded51-0b75-4f67-94e9-0a7ea3c3f3d6', 'ip_address': 'fd12:3562:78f7::1'}] May 28 12:44:14 l75lg1-v1 neutron-server[77618]: {{(pid=77618) _log_diff_call /opt/stack/neutron/neutron/tests/unit/plugins/ml2/drivers/mechanism_logger.py:59}} May 28 12:44:14 l75lg1-v1 neutron-server[77618]: DEBUG neutron_lib.callbacks.manager [None req-eb5706e0-244e-4338-8d28-c30965e2a431 demo admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4166243'] for port (268e1eb8-0568-4553-9120-b5ec7ec1d878), after_create {{(pid=77618) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:44:14 l75lg1-v1 neutron-server[77618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb5706e0-244e-4338-8d28-c30965e2a431 demo admin] Pushing event updated for resources: {'Port': ['ID=268e1eb8-0568-4553-9120-b5ec7ec1d878,revision_number=1']} {{(pid=77618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 28 12:44:14 l75lg1-v1 neutron-server[77618]: DEBUG ovsdbapp.backend.ovs_idl.transaction [None req-c63b1acc-b5c6-4be8-9db9-04824fec27f2 None None] Running txn n=1 command(idx=0): AddLSwitchPortCommand(_result=None, lport=268e1eb8-0568-4553-9120-b5ec7ec1d878, lswitch=neutron-fb218033-3d98-4065-b336-c595d5e6ca77, may_exist=True, columns={'addresses': ['unknown'], 'external_ids': {'neutron:port_name': '', 'neutron:device_id': '80c11046-4421-4321-813a-d46f0332997a', 'neutron:project_id': '95de88f6d26e4420bc466ba67668171f', 'neutron:cidrs': 'fd12:3562:78f7::1/64', 'neutron:device_owner': 'network:router_interface', 'neutron:subnet_pool_addr_scope4': '', 'neutron:subnet_pool_addr_scope6': '', 'neutron:network_name': 'neutron-fb218033-3d98-4065-b336-c595d5e6ca77', 'neutron:security_group_ids': '', 'neutron:revision_number': '1', 'neutron:vnic_type': 'normal', 'neutron:port_capabilities': '', 'neutron:mtu': ''}, 'parent_name': [], 'tag': [], 'enabled': True, 'options': {'mcast_flood_reports': 'true'}, 'type': '', 'port_security': [], 'dhcpv4_options': [], 'dhcpv6_options': []}) {{(pid=77618) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:44:14 l75lg1-v1 neutron-server[77618]: DEBUG ovsdbapp.backend.ovs_idl.transaction [None req-c63b1acc-b5c6-4be8-9db9-04824fec27f2 None None] Running txn n=1 command(idx=1): QoSDelCommand(_result=None, switch=neutron-fb218033-3d98-4065-b336-c595d5e6ca77, conditions=[('direction', '=', 'to-lport'), ('priority', '=', 2002), ('match', '=', 'outport == "268e1eb8-0568-4553-9120-b5ec7ec1d878"')], if_exists=True) {{(pid=77618) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:44:14 l75lg1-v1 neutron-server[77618]: DEBUG ovsdbapp.backend.ovs_idl.transaction [None req-c63b1acc-b5c6-4be8-9db9-04824fec27f2 None None] Running txn n=1 command(idx=2): UpdateLSwitchPortQosOptionsCommand(_result=None, lport=AddLSwitchPortCommand(_result=ef0e1ed1-490d-4aa0-991e-391b9a7efac9, lport=268e1eb8-0568-4553-9120-b5ec7ec1d878, lswitch=neutron-fb218033-3d98-4065-b336-c595d5e6ca77, may_exist=True, columns={'addresses': ['unknown'], 'external_ids': {'neutron:port_name': '', 'neutron:device_id': '80c11046-4421-4321-813a-d46f0332997a', 'neutron:project_id': '95de88f6d26e4420bc466ba67668171f', 'neutron:cidrs': 'fd12:3562:78f7::1/64', 'neutron:device_owner': 'network:router_interface', 'neutron:subnet_pool_addr_scope4': '', 'neutron:subnet_pool_addr_scope6': '', 'neutron:network_name': 'neutron-fb218033-3d98-4065-b336-c595d5e6ca77', 'neutron:security_group_ids': '', 'neutron:revision_number': '1', 'neutron:vnic_type': 'normal', 'neutron:port_capabilities': '', 'neutron:mtu': ''}, 'parent_name': [], 'enabled': True, 'options': {'mcast_flood_reports': 'true'}, 'type': '', 'port_security': []}), if_exists=True, qos={'qos_min_rate': None}) {{(pid=77618) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:44:14 l75lg1-v1 neutron-server[77618]: DEBUG ovsdbapp.backend.ovs_idl.transaction [None req-c63b1acc-b5c6-4be8-9db9-04824fec27f2 None None] Running txn n=1 command(idx=3): QoSDelCommand(_result=None, switch=neutron-fb218033-3d98-4065-b336-c595d5e6ca77, conditions=[('direction', '=', 'from-lport'), ('priority', '=', 2002), ('match', '=', 'inport == "268e1eb8-0568-4553-9120-b5ec7ec1d878"')], if_exists=True) {{(pid=77618) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:44:14 l75lg1-v1 neutron-server[77618]: DEBUG ovsdbapp.backend.ovs_idl.transaction [None req-c63b1acc-b5c6-4be8-9db9-04824fec27f2 None None] Running txn n=1 command(idx=4): UpdateLSwitchPortQosOptionsCommand(_result=None, lport=AddLSwitchPortCommand(_result=ef0e1ed1-490d-4aa0-991e-391b9a7efac9, lport=268e1eb8-0568-4553-9120-b5ec7ec1d878, lswitch=neutron-fb218033-3d98-4065-b336-c595d5e6ca77, may_exist=True, columns={'addresses': ['unknown'], 'external_ids': {'neutron:port_name': '', 'neutron:device_id': '80c11046-4421-4321-813a-d46f0332997a', 'neutron:project_id': '95de88f6d26e4420bc466ba67668171f', 'neutron:cidrs': 'fd12:3562:78f7::1/64', 'neutron:device_owner': 'network:router_interface', 'neutron:subnet_pool_addr_scope4': '', 'neutron:subnet_pool_addr_scope6': '', 'neutron:network_name': 'neutron-fb218033-3d98-4065-b336-c595d5e6ca77', 'neutron:security_group_ids': '', 'neutron:revision_number': '1', 'neutron:vnic_type': 'normal', 'neutron:port_capabilities': '', 'neutron:mtu': ''}, 'parent_name': [], 'enabled': True, 'options': {'mcast_flood_reports': 'true'}, 'type': '', 'port_security': []}), if_exists=True, qos={'qos_min_rate': None}) {{(pid=77618) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:44:14 l75lg1-v1 neutron-server[77618]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-c63b1acc-b5c6-4be8-9db9-04824fec27f2 None None] Hash Ring: Node 4c6fc793-7f5a-456f-b4d6-6e5bd97592f2 (host: l75lg1-v1) handling event "update" for row e0112af8-ce41-4b01-ad87-93806fb91451 (table: Logical_Switch) {{(pid=77618) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:44:14 l75lg1-v1 neutron-server[77618]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-c63b1acc-b5c6-4be8-9db9-04824fec27f2 None None] Hash Ring: Node 4c6fc793-7f5a-456f-b4d6-6e5bd97592f2 (host: l75lg1-v1) handling event "create" for row 7539fd27-b5ba-421e-bfc6-56dd4f7cb100 (table: Logical_Switch_Port) {{(pid=77618) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:44:14 l75lg1-v1 neutron-server[77618]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-c63b1acc-b5c6-4be8-9db9-04824fec27f2 None None] Hash Ring: Node 4c6fc793-7f5a-456f-b4d6-6e5bd97592f2 (host: l75lg1-v1) handling event "update" for row 7539fd27-b5ba-421e-bfc6-56dd4f7cb100 (table: Logical_Switch_Port) {{(pid=77618) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:44:14 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-03b5f984-1478-4ad6-9838-8e34c1689c5b None None] Hash Ring: Node c89b3497-133e-4a5a-b67a-3310d2cb2485 (host: l75lg1-v1) handling event "create" for row 0e0eb57e-da08-4143-9e8f-3372cb0f2acf (table: Port_Binding) {{(pid=77619) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:44:14 l75lg1-v1 neutron-server[77618]: INFO neutron.db.ovn_revision_numbers_db [None req-eb5706e0-244e-4338-8d28-c30965e2a431 demo admin] Successfully bumped revision number for resource 268e1eb8-0568-4553-9120-b5ec7ec1d878 (type: ports) to 1 May 28 12:44:14 l75lg1-v1 neutron-server[77618]: INFO neutron.tests.unit.plugins.ml2.drivers.mechanism_logger [None req-eb5706e0-244e-4338-8d28-c30965e2a431 demo admin] create_port_postcommit called with port settings {'id': '268e1eb8-0568-4553-9120-b5ec7ec1d878', 'name': '', 'network_id': 'fb218033-3d98-4065-b336-c595d5e6ca77', 'tenant_id': '95de88f6d26e4420bc466ba67668171f', 'mac_address': 'fa:16:3e:7c:1e:ba', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '80c11046-4421-4321-813a-d46f0332997a', 'device_owner': 'network:router_interface', 'standard_attr_id': 29, 'fixed_ips': [{'subnet_id': '799ded51-0b75-4f67-94e9-0a7ea3c3f3d6', 'ip_address': 'fd12:3562:78f7::1'}], 'project_id': '95de88f6d26e4420bc466ba67668171f', 'port_security_enabled': False, 'security_groups': [], 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'description': '', 'tags': [], 'created_at': '2024-05-28T12:44:14Z', 'updated_at': '2024-05-28T12:44:14Z', 'revision_number': 1, 'network': {'id': 'fb218033-3d98-4065-b336-c595d5e6ca77', 'name': 'private', 'tenant_id': '95de88f6d26e4420bc466ba67668171f', 'admin_state_up': True, 'mtu': 1442, 'status': 'ACTIVE', 'subnets': ['5508b790-cc91-4b59-8d30-81ef4480e470', '799ded51-0b75-4f67-94e9-0a7ea3c3f3d6'], 'standard_attr_id': 12, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'vlan_transparent': None, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2024-05-28T12:43:43Z', 'updated_at': '2024-05-28T12:43:49Z', 'revision_number': 3, 'project_id': '95de88f6d26e4420bc466ba67668171f', 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 30276}} (original settings None) host (original host None) vif type unbound (original vif type None) vif details {} (original vif details None) binding levels None (original binding levels None) on network {'id': 'fb218033-3d98-4065-b336-c595d5e6ca77', 'name': 'private', 'tenant_id': '95de88f6d26e4420bc466ba67668171f', 'admin_state_up': True, 'mtu': 1442, 'status': 'ACTIVE', 'subnets': ['5508b790-cc91-4b59-8d30-81ef4480e470', '799ded51-0b75-4f67-94e9-0a7ea3c3f3d6'], 'standard_attr_id': 12, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'vlan_transparent': None, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2024-05-28T12:43:43Z', 'updated_at': '2024-05-28T12:43:49Z', 'revision_number': 3, 'project_id': '95de88f6d26e4420bc466ba67668171f', 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 30276} with segments to bind None May 28 12:44:14 l75lg1-v1 neutron-server[77618]: DEBUG neutron.tests.unit.plugins.ml2.drivers.mechanism_logger [None req-eb5706e0-244e-4338-8d28-c30965e2a431 demo admin] create_port_postcommit: May 28 12:44:14 l75lg1-v1 neutron-server[77618]: key[tenant_id], None -> 95de88f6d26e4420bc466ba67668171f May 28 12:44:14 l75lg1-v1 neutron-server[77618]: key[network_id], None -> fb218033-3d98-4065-b336-c595d5e6ca77 May 28 12:44:14 l75lg1-v1 neutron-server[77618]: key[allowed_address_pairs], None -> [] May 28 12:44:14 l75lg1-v1 neutron-server[77618]: key[binding:vif_type], None -> unbound May 28 12:44:14 l75lg1-v1 neutron-server[77618]: key[project_id], None -> 95de88f6d26e4420bc466ba67668171f May 28 12:44:14 l75lg1-v1 neutron-server[77618]: key[admin_state_up], None -> True May 28 12:44:14 l75lg1-v1 neutron-server[77618]: key[id], None -> 268e1eb8-0568-4553-9120-b5ec7ec1d878 May 28 12:44:14 l75lg1-v1 neutron-server[77618]: key[security_groups], None -> [] May 28 12:44:14 l75lg1-v1 neutron-server[77618]: key[extra_dhcp_opts], None -> [] May 28 12:44:14 l75lg1-v1 neutron-server[77618]: key[binding:vnic_type], None -> normal May 28 12:44:14 l75lg1-v1 neutron-server[77618]: key[tags], None -> [] May 28 12:44:14 l75lg1-v1 neutron-server[77618]: key[name], None -> May 28 12:44:14 l75lg1-v1 neutron-server[77618]: key[created_at], None -> 2024-05-28T12:44:14Z May 28 12:44:14 l75lg1-v1 neutron-server[77618]: key[status], None -> DOWN May 28 12:44:14 l75lg1-v1 neutron-server[77618]: key[binding:profile], None -> {} May 28 12:44:14 l75lg1-v1 neutron-server[77618]: key[port_security_enabled], None -> False May 28 12:44:14 l75lg1-v1 neutron-server[77618]: key[updated_at], None -> 2024-05-28T12:44:14Z May 28 12:44:14 l75lg1-v1 neutron-server[77618]: key[network], None -> {'id': 'fb218033-3d98-4065-b336-c595d5e6ca77', 'name': 'private', 'tenant_id': '95de88f6d26e4420bc466ba67668171f', 'admin_state_up': True, 'mtu': 1442, 'status': 'ACTIVE', 'subnets': ['5508b790-cc91-4b59-8d30-81ef4480e470', '799ded51-0b75-4f67-94e9-0a7ea3c3f3d6'], 'standard_attr_id': 12, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'vlan_transparent': None, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2024-05-28T12:43:43Z', 'updated_at': '2024-05-28T12:43:49Z', 'revision_number': 3, 'project_id': '95de88f6d26e4420bc466ba67668171f', 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 30276} May 28 12:44:14 l75lg1-v1 neutron-server[77618]: key[standard_attr_id], None -> 29 May 28 12:44:14 l75lg1-v1 neutron-server[77618]: key[device_owner], None -> network:router_interface May 28 12:44:14 l75lg1-v1 neutron-server[77618]: key[device_id], None -> 80c11046-4421-4321-813a-d46f0332997a May 28 12:44:14 l75lg1-v1 neutron-server[77618]: key[mac_address], None -> fa:16:3e:7c:1e:ba May 28 12:44:14 l75lg1-v1 neutron-server[77618]: key[description], None -> May 28 12:44:14 l75lg1-v1 neutron-server[77618]: key[binding:host_id], None -> May 28 12:44:14 l75lg1-v1 neutron-server[77618]: key[binding:vif_details], None -> {} May 28 12:44:14 l75lg1-v1 neutron-server[77618]: key[revision_number], None -> 1 May 28 12:44:14 l75lg1-v1 neutron-server[77618]: key[fixed_ips], None -> [{'subnet_id': '799ded51-0b75-4f67-94e9-0a7ea3c3f3d6', 'ip_address': 'fd12:3562:78f7::1'}] May 28 12:44:14 l75lg1-v1 neutron-server[77618]: {{(pid=77618) _log_diff_call /opt/stack/neutron/neutron/tests/unit/plugins/ml2/drivers/mechanism_logger.py:59}} May 28 12:44:14 l75lg1-v1 neutron-server[77618]: DEBUG neutron_lib.callbacks.manager [None req-eb5706e0-244e-4338-8d28-c30965e2a431 demo admin] Publish callbacks [] for router_interface (80c11046-4421-4321-813a-d46f0332997a), before_create {{(pid=77618) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:44:14 l75lg1-v1 neutron-server[77618]: DEBUG neutron_lib.callbacks.manager [None req-eb5706e0-244e-4338-8d28-c30965e2a431 demo admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1015114', 'neutron.services.ovn_l3.plugin.OVNL3RouterPlugin._port_update-8754901907784', 'neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_internal_ip_change_for_fip-8754903031884'] for port (268e1eb8-0568-4553-9120-b5ec7ec1d878), before_update {{(pid=77618) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:44:15 l75lg1-v1 neutron-server[77618]: DEBUG neutron_lib.callbacks.manager [None req-eb5706e0-244e-4338-8d28-c30965e2a431 demo admin] Publish callbacks [] for port (268e1eb8-0568-4553-9120-b5ec7ec1d878), precommit_update {{(pid=77618) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:44:15 l75lg1-v1 neutron-server[77618]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver [None req-eb5706e0-244e-4338-8d28-c30965e2a431 demo admin] No provisioning block for port 268e1eb8-0568-4553-9120-b5ec7ec1d878 since it does not have a host {{(pid=77618) _is_port_provisioning_required /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/mech_driver.py:720}} May 28 12:44:15 l75lg1-v1 neutron-server[77618]: INFO neutron.tests.unit.plugins.ml2.drivers.mechanism_logger [None req-eb5706e0-244e-4338-8d28-c30965e2a431 demo admin] update_port_precommit called with port settings {'id': '268e1eb8-0568-4553-9120-b5ec7ec1d878', 'name': '', 'network_id': 'fb218033-3d98-4065-b336-c595d5e6ca77', 'tenant_id': '95de88f6d26e4420bc466ba67668171f', 'mac_address': 'fa:16:3e:7c:1e:ba', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '80c11046-4421-4321-813a-d46f0332997a', 'device_owner': 'network:router_interface', 'standard_attr_id': 29, 'fixed_ips': [{'subnet_id': '799ded51-0b75-4f67-94e9-0a7ea3c3f3d6', 'ip_address': 'fd12:3562:78f7::1'}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2024-05-28T12:44:14Z', 'updated_at': '2024-05-28T12:44:14Z', 'revision_number': 1, 'project_id': '95de88f6d26e4420bc466ba67668171f'} (original settings {'id': '268e1eb8-0568-4553-9120-b5ec7ec1d878', 'name': '', 'network_id': 'fb218033-3d98-4065-b336-c595d5e6ca77', 'tenant_id': '95de88f6d26e4420bc466ba67668171f', 'mac_address': 'fa:16:3e:7c:1e:ba', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '80c11046-4421-4321-813a-d46f0332997a', 'device_owner': 'network:router_interface', 'standard_attr_id': 29, 'fixed_ips': [{'subnet_id': '799ded51-0b75-4f67-94e9-0a7ea3c3f3d6', 'ip_address': 'fd12:3562:78f7::1'}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2024-05-28T12:44:14Z', 'updated_at': '2024-05-28T12:44:14Z', 'revision_number': 1, 'project_id': '95de88f6d26e4420bc466ba67668171f'}) host (original host ) vif type unbound (original vif type unbound) vif details {} (original vif details {}) binding levels None (original binding levels None) on network {'id': 'fb218033-3d98-4065-b336-c595d5e6ca77', 'name': 'private', 'tenant_id': '95de88f6d26e4420bc466ba67668171f', 'admin_state_up': True, 'mtu': 1442, 'status': 'ACTIVE', 'subnets': ['5508b790-cc91-4b59-8d30-81ef4480e470', '799ded51-0b75-4f67-94e9-0a7ea3c3f3d6'], 'standard_attr_id': 12, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'vlan_transparent': None, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2024-05-28T12:43:43Z', 'updated_at': '2024-05-28T12:43:49Z', 'revision_number': 3, 'project_id': '95de88f6d26e4420bc466ba67668171f', 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 30276} with segments to bind None May 28 12:44:15 l75lg1-v1 neutron-server[77618]: DEBUG neutron.tests.unit.plugins.ml2.drivers.mechanism_logger [None req-eb5706e0-244e-4338-8d28-c30965e2a431 demo admin] update_port_precommit: May 28 12:44:15 l75lg1-v1 neutron-server[77618]: {{(pid=77618) _log_diff_call /opt/stack/neutron/neutron/tests/unit/plugins/ml2/drivers/mechanism_logger.py:59}} May 28 12:44:15 l75lg1-v1 neutron-server[77618]: DEBUG neutron_lib.callbacks.manager [None req-eb5706e0-244e-4338-8d28-c30965e2a431 demo admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4166243', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8754903016533', 'neutron.services.ovn_l3.plugin.OVNL3RouterPlugin._port_update-8754901907784'] for port (268e1eb8-0568-4553-9120-b5ec7ec1d878), after_update {{(pid=77618) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:44:15 l75lg1-v1 neutron-server[77618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb5706e0-244e-4338-8d28-c30965e2a431 demo admin] Pushing event updated for resources: {'Port': ['ID=268e1eb8-0568-4553-9120-b5ec7ec1d878,revision_number=1']} {{(pid=77618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 28 12:44:15 l75lg1-v1 dstat.sh[49771]: 28-05 12:44:15| 11 1 88 1 0|2821M 6677M 267M 5932M| 17k 0 | 0 892k| 0 113 |2941 5539 |1.25 1.74 1.25|1.0 0 0| 0 0 | 0 2048M| 23 124 0 34 0 May 28 12:44:15 l75lg1-v1 neutron-server[77623]: DEBUG dbcounter [-] [77623] Writing DB stats neutron:SELECT=1 {{(pid=77623) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:44:15 l75lg1-v1 neutron-server[77618]: DEBUG ovsdbapp.backend.ovs_idl.transaction [None req-c63b1acc-b5c6-4be8-9db9-04824fec27f2 None None] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=268e1eb8-0568-4553-9120-b5ec7ec1d878, resource={'id': '268e1eb8-0568-4553-9120-b5ec7ec1d878', 'name': '', 'network_id': 'fb218033-3d98-4065-b336-c595d5e6ca77', 'tenant_id': '95de88f6d26e4420bc466ba67668171f', 'mac_address': 'fa:16:3e:7c:1e:ba', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '80c11046-4421-4321-813a-d46f0332997a', 'device_owner': 'network:router_interface', 'standard_attr_id': 29, 'fixed_ips': [{'subnet_id': '799ded51-0b75-4f67-94e9-0a7ea3c3f3d6', 'ip_address': 'fd12:3562:78f7::1'}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2024-05-28T12:44:14Z', 'updated_at': '2024-05-28T12:44:14Z', 'revision_number': 1, 'project_id': '95de88f6d26e4420bc466ba67668171f', 'network': {'id': 'fb218033-3d98-4065-b336-c595d5e6ca77', 'name': 'private', 'tenant_id': '95de88f6d26e4420bc466ba67668171f', 'admin_state_up': True, 'mtu': 1442, 'status': 'ACTIVE', 'subnets': ['5508b790-cc91-4b59-8d30-81ef4480e470', '799ded51-0b75-4f67-94e9-0a7ea3c3f3d6'], 'standard_attr_id': 12, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'vlan_transparent': None, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2024-05-28T12:43:43Z', 'updated_at': '2024-05-28T12:43:49Z', 'revision_number': 3, 'project_id': '95de88f6d26e4420bc466ba67668171f', 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 30276}}, resource_type=ports, if_exists=True) {{(pid=77618) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:44:15 l75lg1-v1 neutron-server[77618]: DEBUG ovsdbapp.backend.ovs_idl.transaction [None req-c63b1acc-b5c6-4be8-9db9-04824fec27f2 None None] Running txn n=1 command(idx=1): SetLSwitchPortCommand(_result=None, lport=268e1eb8-0568-4553-9120-b5ec7ec1d878, external_ids_update=None, columns={'external_ids': {'neutron:port_name': '', 'neutron:device_id': '80c11046-4421-4321-813a-d46f0332997a', 'neutron:project_id': '95de88f6d26e4420bc466ba67668171f', 'neutron:cidrs': 'fd12:3562:78f7::1/64', 'neutron:device_owner': 'network:router_interface', 'neutron:subnet_pool_addr_scope4': '', 'neutron:subnet_pool_addr_scope6': '', 'neutron:network_name': 'neutron-fb218033-3d98-4065-b336-c595d5e6ca77', 'neutron:security_group_ids': '', 'neutron:revision_number': '1', 'neutron:vnic_type': 'normal', 'neutron:port_capabilities': '', 'neutron:mtu': ''}, 'parent_name': [], 'tag': [], 'options': {'mcast_flood_reports': 'true'}, 'enabled': True, 'port_security': [], 'dhcpv4_options': [], 'dhcpv6_options': [], 'type': 'router', 'ha_chassis_group': []}, if_exists=False) {{(pid=77618) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:44:15 l75lg1-v1 neutron-server[77618]: DEBUG ovsdbapp.backend.ovs_idl.transaction [None req-c63b1acc-b5c6-4be8-9db9-04824fec27f2 None None] Running txn n=1 command(idx=2): PgDelPortCommand(_result=None, port_group=neutron_pg_drop, lsp=['268e1eb8-0568-4553-9120-b5ec7ec1d878'], if_exists=False) {{(pid=77618) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:44:15 l75lg1-v1 neutron-server[77618]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-c63b1acc-b5c6-4be8-9db9-04824fec27f2 None None] Hash Ring: Node 4c6fc793-7f5a-456f-b4d6-6e5bd97592f2 (host: l75lg1-v1) handling event "update" for row 7539fd27-b5ba-421e-bfc6-56dd4f7cb100 (table: Logical_Switch_Port) {{(pid=77618) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:44:15 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-03b5f984-1478-4ad6-9838-8e34c1689c5b None None] Hash Ring: Node c89b3497-133e-4a5a-b67a-3310d2cb2485 (host: l75lg1-v1) handling event "update" for row 0e0eb57e-da08-4143-9e8f-3372cb0f2acf (table: Port_Binding) {{(pid=77619) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:44:15 l75lg1-v1 neutron-server[77618]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-c63b1acc-b5c6-4be8-9db9-04824fec27f2 None None] Hash Ring: Node 4c6fc793-7f5a-456f-b4d6-6e5bd97592f2 (host: l75lg1-v1) handling event "update" for row 7539fd27-b5ba-421e-bfc6-56dd4f7cb100 (table: Logical_Switch_Port) {{(pid=77618) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:44:15 l75lg1-v1 neutron-server[77618]: DEBUG ovsdbapp.backend.ovs_idl.event [None req-c63b1acc-b5c6-4be8-9db9-04824fec27f2 None None] Matched UPDATE: LogicalSwitchPortUpdateUpEvent(events=('update',), table='Logical_Switch_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Switch_Port(up=[True], name=268e1eb8-0568-4553-9120-b5ec7ec1d878, external_ids={'neutron:cidrs': 'fd12:3562:78f7::1/64', 'neutron:device_id': '80c11046-4421-4321-813a-d46f0332997a', 'neutron:device_owner': 'network:router_interface', 'neutron:mtu': '', 'neutron:network_name': 'neutron-fb218033-3d98-4065-b336-c595d5e6ca77', 'neutron:port_capabilities': '', 'neutron:port_name': '', 'neutron:project_id': '95de88f6d26e4420bc466ba67668171f', 'neutron:revision_number': '1', 'neutron:security_group_ids': '', 'neutron:subnet_pool_addr_scope4': '', 'neutron:subnet_pool_addr_scope6': '', 'neutron:vnic_type': 'normal'}, ha_chassis_group=[], options={'mcast_flood_reports': 'true'}, parent_name=[], enabled=[True], type=router, dhcpv6_options=[], tag_request=[], port_security=[], addresses=['unknown'], dynamic_addresses=[], dhcpv4_options=[], tag=[]) old=Logical_Switch_Port(up=[False]) {{(pid=77618) matches /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} May 28 12:44:15 l75lg1-v1 neutron-server[77618]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver [None req-5ba0b4eb-00ab-4523-a874-41c9965d7fce None None] OVN reports status up for port: 268e1eb8-0568-4553-9120-b5ec7ec1d878 May 28 12:44:15 l75lg1-v1 neutron-server[77618]: DEBUG neutron.db.provisioning_blocks [None req-5ba0b4eb-00ab-4523-a874-41c9965d7fce None None] Provisioning complete for port 268e1eb8-0568-4553-9120-b5ec7ec1d878 triggered by entity L2. {{(pid=77618) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:144}} May 28 12:44:15 l75lg1-v1 neutron-server[77618]: DEBUG neutron_lib.callbacks.manager [None req-5ba0b4eb-00ab-4523-a874-41c9965d7fce None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-857483'] for port (268e1eb8-0568-4553-9120-b5ec7ec1d878), provisioning_complete {{(pid=77618) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:44:15 l75lg1-v1 neutron-server[77618]: INFO neutron.plugins.ml2.plugin [None req-5ba0b4eb-00ab-4523-a874-41c9965d7fce None None] Attempt 1 to provision port 268e1eb8-0568-4553-9120-b5ec7ec1d878 May 28 12:44:15 l75lg1-v1 neutron-server[77618]: INFO neutron.db.ovn_revision_numbers_db [None req-eb5706e0-244e-4338-8d28-c30965e2a431 demo admin] Successfully bumped revision number for resource 268e1eb8-0568-4553-9120-b5ec7ec1d878 (type: ports) to 1 May 28 12:44:15 l75lg1-v1 neutron-server[77618]: DEBUG neutron.plugins.ml2.plugin [None req-5ba0b4eb-00ab-4523-a874-41c9965d7fce None None] Port 268e1eb8-0568-4553-9120-b5ec7ec1d878 cannot update to ACTIVE because it is not bound. {{(pid=77618) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:372}} May 28 12:44:15 l75lg1-v1 neutron-server[77618]: INFO neutron.tests.unit.plugins.ml2.drivers.mechanism_logger [None req-eb5706e0-244e-4338-8d28-c30965e2a431 demo admin] update_port_postcommit called with port settings {'id': '268e1eb8-0568-4553-9120-b5ec7ec1d878', 'name': '', 'network_id': 'fb218033-3d98-4065-b336-c595d5e6ca77', 'tenant_id': '95de88f6d26e4420bc466ba67668171f', 'mac_address': 'fa:16:3e:7c:1e:ba', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '80c11046-4421-4321-813a-d46f0332997a', 'device_owner': 'network:router_interface', 'standard_attr_id': 29, 'fixed_ips': [{'subnet_id': '799ded51-0b75-4f67-94e9-0a7ea3c3f3d6', 'ip_address': 'fd12:3562:78f7::1'}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2024-05-28T12:44:14Z', 'updated_at': '2024-05-28T12:44:14Z', 'revision_number': 1, 'project_id': '95de88f6d26e4420bc466ba67668171f'} (original settings {'id': '268e1eb8-0568-4553-9120-b5ec7ec1d878', 'name': '', 'network_id': 'fb218033-3d98-4065-b336-c595d5e6ca77', 'tenant_id': '95de88f6d26e4420bc466ba67668171f', 'mac_address': 'fa:16:3e:7c:1e:ba', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '80c11046-4421-4321-813a-d46f0332997a', 'device_owner': 'network:router_interface', 'standard_attr_id': 29, 'fixed_ips': [{'subnet_id': '799ded51-0b75-4f67-94e9-0a7ea3c3f3d6', 'ip_address': 'fd12:3562:78f7::1'}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2024-05-28T12:44:14Z', 'updated_at': '2024-05-28T12:44:14Z', 'revision_number': 1, 'project_id': '95de88f6d26e4420bc466ba67668171f'}) host (original host ) vif type unbound (original vif type unbound) vif details {} (original vif details {}) binding levels None (original binding levels None) on network {'id': 'fb218033-3d98-4065-b336-c595d5e6ca77', 'name': 'private', 'tenant_id': '95de88f6d26e4420bc466ba67668171f', 'admin_state_up': True, 'mtu': 1442, 'status': 'ACTIVE', 'subnets': ['5508b790-cc91-4b59-8d30-81ef4480e470', '799ded51-0b75-4f67-94e9-0a7ea3c3f3d6'], 'standard_attr_id': 12, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'vlan_transparent': None, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2024-05-28T12:43:43Z', 'updated_at': '2024-05-28T12:43:49Z', 'revision_number': 3, 'project_id': '95de88f6d26e4420bc466ba67668171f', 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 30276} with segments to bind None May 28 12:44:15 l75lg1-v1 neutron-server[77618]: DEBUG neutron.tests.unit.plugins.ml2.drivers.mechanism_logger [None req-eb5706e0-244e-4338-8d28-c30965e2a431 demo admin] update_port_postcommit: May 28 12:44:15 l75lg1-v1 neutron-server[77618]: {{(pid=77618) _log_diff_call /opt/stack/neutron/neutron/tests/unit/plugins/ml2/drivers/mechanism_logger.py:59}} May 28 12:44:15 l75lg1-v1 neutron-server[77618]: DEBUG neutron_lib.callbacks.manager [None req-eb5706e0-244e-4338-8d28-c30965e2a431 demo admin] Publish callbacks ['neutron.services.ovn_l3.service_providers.ovn.OvnDriver._process_add_router_interface-57909'] for router_interface (80c11046-4421-4321-813a-d46f0332997a), after_create {{(pid=77618) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:44:15 l75lg1-v1 neutron-server[77618]: DEBUG neutron.plugins.ml2.plugin [None req-5ba0b4eb-00ab-4523-a874-41c9965d7fce None None] Current status of the port 268e1eb8-0568-4553-9120-b5ec7ec1d878 is: DOWN; New status is: ACTIVE {{(pid=77618) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2395}} May 28 12:44:15 l75lg1-v1 neutron-server[77618]: DEBUG neutron_lib.callbacks.manager [None req-5ba0b4eb-00ab-4523-a874-41c9965d7fce None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1015114', 'neutron.services.ovn_l3.plugin.OVNL3RouterPlugin._port_update-8754901907784', 'neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_internal_ip_change_for_fip-8754903031884'] for port (268e1eb8-0568-4553-9120-b5ec7ec1d878), before_update {{(pid=77618) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:44:15 l75lg1-v1 neutron-server[77618]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver [None req-5ba0b4eb-00ab-4523-a874-41c9965d7fce None None] No provisioning block for port 268e1eb8-0568-4553-9120-b5ec7ec1d878 since it is active {{(pid=77618) _is_port_provisioning_required /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/mech_driver.py:715}} May 28 12:44:15 l75lg1-v1 neutron-server[77618]: INFO neutron.tests.unit.plugins.ml2.drivers.mechanism_logger [None req-5ba0b4eb-00ab-4523-a874-41c9965d7fce None None] update_port_precommit called with port settings {'id': '268e1eb8-0568-4553-9120-b5ec7ec1d878', 'name': '', 'network_id': 'fb218033-3d98-4065-b336-c595d5e6ca77', 'tenant_id': '95de88f6d26e4420bc466ba67668171f', 'mac_address': 'fa:16:3e:7c:1e:ba', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '80c11046-4421-4321-813a-d46f0332997a', 'device_owner': 'network:router_interface', 'standard_attr_id': 29, 'fixed_ips': [{'subnet_id': '799ded51-0b75-4f67-94e9-0a7ea3c3f3d6', 'ip_address': 'fd12:3562:78f7::1'}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2024-05-28T12:44:14Z', 'updated_at': '2024-05-28T12:44:15Z', 'revision_number': 2, 'project_id': '95de88f6d26e4420bc466ba67668171f'} (original settings {'id': '268e1eb8-0568-4553-9120-b5ec7ec1d878', 'name': '', 'network_id': 'fb218033-3d98-4065-b336-c595d5e6ca77', 'tenant_id': '95de88f6d26e4420bc466ba67668171f', 'mac_address': 'fa:16:3e:7c:1e:ba', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '80c11046-4421-4321-813a-d46f0332997a', 'device_owner': 'network:router_interface', 'standard_attr_id': 29, 'fixed_ips': [{'subnet_id': '799ded51-0b75-4f67-94e9-0a7ea3c3f3d6', 'ip_address': 'fd12:3562:78f7::1'}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2024-05-28T12:44:14Z', 'updated_at': '2024-05-28T12:44:14Z', 'revision_number': 1, 'project_id': '95de88f6d26e4420bc466ba67668171f'}) host (original host ) vif type unbound (original vif type unbound) vif details {} (original vif details {}) binding levels None (original binding levels None) on network {'id': 'fb218033-3d98-4065-b336-c595d5e6ca77', 'name': 'private', 'tenant_id': '95de88f6d26e4420bc466ba67668171f', 'admin_state_up': True, 'mtu': 1442, 'status': 'ACTIVE', 'subnets': ['5508b790-cc91-4b59-8d30-81ef4480e470', '799ded51-0b75-4f67-94e9-0a7ea3c3f3d6'], 'standard_attr_id': 12, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'vlan_transparent': None, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2024-05-28T12:43:43Z', 'updated_at': '2024-05-28T12:43:49Z', 'revision_number': 3, 'project_id': '95de88f6d26e4420bc466ba67668171f', 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 30276} with segments to bind None May 28 12:44:15 l75lg1-v1 neutron-server[77618]: DEBUG neutron.tests.unit.plugins.ml2.drivers.mechanism_logger [None req-5ba0b4eb-00ab-4523-a874-41c9965d7fce None None] update_port_precommit: May 28 12:44:15 l75lg1-v1 neutron-server[77618]: key[status], DOWN -> ACTIVE May 28 12:44:15 l75lg1-v1 neutron-server[77618]: key[updated_at], 2024-05-28T12:44:14Z -> 2024-05-28T12:44:15Z May 28 12:44:15 l75lg1-v1 neutron-server[77618]: key[revision_number], 1 -> 2 May 28 12:44:15 l75lg1-v1 neutron-server[77618]: {{(pid=77618) _log_diff_call /opt/stack/neutron/neutron/tests/unit/plugins/ml2/drivers/mechanism_logger.py:59}} May 28 12:44:15 l75lg1-v1 neutron-server[77618]: DEBUG ovsdbapp.backend.ovs_idl.transaction [None req-c63b1acc-b5c6-4be8-9db9-04824fec27f2 None None] Running txn n=1 command(idx=0): AddLRouterPortCommand(_result=None, name=lrp-268e1eb8-0568-4553-9120-b5ec7ec1d878, lrouter=neutron-80c11046-4421-4321-813a-d46f0332997a, may_exist=True, columns={'mac': 'fa:16:3e:7c:1e:ba', 'networks': ['fd12:3562:78f7::1/64'], 'external_ids': {'neutron:revision_number': '1', 'neutron:subnet_ids': '799ded51-0b75-4f67-94e9-0a7ea3c3f3d6', 'neutron:network_name': 'neutron-fb218033-3d98-4065-b336-c595d5e6ca77', 'neutron:is_ext_gw': 'False', 'neutron:router_name': '80c11046-4421-4321-813a-d46f0332997a'}, 'options': {}, 'ipv6_ra_configs': {'address_mode': 'slaac', 'send_periodic': 'true', 'mtu': '1442'}}) {{(pid=77618) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:44:15 l75lg1-v1 neutron-server[77618]: DEBUG ovsdbapp.backend.ovs_idl.transaction [None req-c63b1acc-b5c6-4be8-9db9-04824fec27f2 None None] Running txn n=1 command(idx=1): SetLRouterPortInLSwitchPortCommand(_result=None, lswitch_port=268e1eb8-0568-4553-9120-b5ec7ec1d878, lrouter_port=lrp-268e1eb8-0568-4553-9120-b5ec7ec1d878, is_gw_port=False, if_exists=True, lsp_address=router) {{(pid=77618) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:44:15 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-53cecb61-7023-41e4-a5ea-23b1eb02606a None None] Hash Ring: Node c89b3497-133e-4a5a-b67a-3310d2cb2485 (host: l75lg1-v1) handling event "update" for row 74f0f327-cc93-479c-856e-03f5c93a4345 (table: Logical_Router) {{(pid=77619) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:44:15 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-03b5f984-1478-4ad6-9838-8e34c1689c5b None None] Hash Ring: Node c89b3497-133e-4a5a-b67a-3310d2cb2485 (host: l75lg1-v1) handling event "update" for row 0e0eb57e-da08-4143-9e8f-3372cb0f2acf (table: Port_Binding) {{(pid=77619) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:44:15 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-03b5f984-1478-4ad6-9838-8e34c1689c5b None None] Hash Ring: Node c89b3497-133e-4a5a-b67a-3310d2cb2485 (host: l75lg1-v1) handling event "create" for row 2439b35e-7a69-4257-b5ed-684f318177a4 (table: Port_Binding) {{(pid=77619) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:44:15 l75lg1-v1 neutron-server[77618]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-c63b1acc-b5c6-4be8-9db9-04824fec27f2 None None] Hash Ring: Node 4c6fc793-7f5a-456f-b4d6-6e5bd97592f2 (host: l75lg1-v1) handling event "create" for row 405f016e-4603-441b-92fc-b9d9f18fb4ba (table: Logical_Router_Port) {{(pid=77618) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:44:15 l75lg1-v1 neutron-server[77618]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-c63b1acc-b5c6-4be8-9db9-04824fec27f2 None None] Hash Ring: Node 4c6fc793-7f5a-456f-b4d6-6e5bd97592f2 (host: l75lg1-v1) handling event "update" for row 7539fd27-b5ba-421e-bfc6-56dd4f7cb100 (table: Logical_Switch_Port) {{(pid=77618) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:44:15 l75lg1-v1 neutron-server[77618]: DEBUG ovsdbapp.backend.ovs_idl.event [None req-c63b1acc-b5c6-4be8-9db9-04824fec27f2 None None] Matched UPDATE: LogicalSwitchPortUpdateLogicalRouterPortEvent(events=('update',), table='Logical_Switch_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Switch_Port(up=[True], name=268e1eb8-0568-4553-9120-b5ec7ec1d878, external_ids={'neutron:cidrs': 'fd12:3562:78f7::1/64', 'neutron:device_id': '80c11046-4421-4321-813a-d46f0332997a', 'neutron:device_owner': 'network:router_interface', 'neutron:mtu': '', 'neutron:network_name': 'neutron-fb218033-3d98-4065-b336-c595d5e6ca77', 'neutron:port_capabilities': '', 'neutron:port_name': '', 'neutron:project_id': '95de88f6d26e4420bc466ba67668171f', 'neutron:revision_number': '1', 'neutron:security_group_ids': '', 'neutron:subnet_pool_addr_scope4': '', 'neutron:subnet_pool_addr_scope6': '', 'neutron:vnic_type': 'normal'}, ha_chassis_group=[], options={'router-port': 'lrp-268e1eb8-0568-4553-9120-b5ec7ec1d878'}, parent_name=[], enabled=[True], type=router, dhcpv6_options=[], tag_request=[], port_security=[], addresses=['router'], dynamic_addresses=[], dhcpv4_options=[], tag=[]) old=Logical_Switch_Port(options={'mcast_flood_reports': 'true'}, addresses=['unknown']) {{(pid=77618) matches /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} May 28 12:44:16 l75lg1-v1 neutron-server[77618]: INFO neutron.db.ovn_revision_numbers_db [None req-eb5706e0-244e-4338-8d28-c30965e2a431 demo admin] Successfully bumped revision number for resource 268e1eb8-0568-4553-9120-b5ec7ec1d878 (type: router_ports) to 1 May 28 12:44:16 l75lg1-v1 neutron-server[77618]: INFO neutron.wsgi [None req-eb5706e0-244e-4338-8d28-c30965e2a431 demo admin] 10.27.203.238 "PUT /networking/v2.0/routers/80c11046-4421-4321-813a-d46f0332997a/add_router_interface HTTP/1.1" status: 200 len: 508 time: 2.1901228 May 28 12:44:16 l75lg1-v1 neutron-server[77618]: DEBUG ovsdbapp.backend.ovs_idl.transaction [None req-c63b1acc-b5c6-4be8-9db9-04824fec27f2 None None] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=268e1eb8-0568-4553-9120-b5ec7ec1d878, resource={'id': '268e1eb8-0568-4553-9120-b5ec7ec1d878', 'name': '', 'network_id': 'fb218033-3d98-4065-b336-c595d5e6ca77', 'tenant_id': '95de88f6d26e4420bc466ba67668171f', 'mac_address': 'fa:16:3e:7c:1e:ba', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '80c11046-4421-4321-813a-d46f0332997a', 'device_owner': 'network:router_interface', 'standard_attr_id': 29, 'fixed_ips': [{'subnet_id': '799ded51-0b75-4f67-94e9-0a7ea3c3f3d6', 'ip_address': 'fd12:3562:78f7::1'}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2024-05-28T12:44:14Z', 'updated_at': '2024-05-28T12:44:15Z', 'revision_number': 2, 'project_id': '95de88f6d26e4420bc466ba67668171f', 'network': {'id': 'fb218033-3d98-4065-b336-c595d5e6ca77', 'name': 'private', 'tenant_id': '95de88f6d26e4420bc466ba67668171f', 'admin_state_up': True, 'mtu': 1442, 'status': 'ACTIVE', 'subnets': ['5508b790-cc91-4b59-8d30-81ef4480e470', '799ded51-0b75-4f67-94e9-0a7ea3c3f3d6'], 'standard_attr_id': 12, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'vlan_transparent': None, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2024-05-28T12:43:43Z', 'updated_at': '2024-05-28T12:43:49Z', 'revision_number': 3, 'project_id': '95de88f6d26e4420bc466ba67668171f', 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 30276}}, resource_type=ports, if_exists=True) {{(pid=77618) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:44:16 l75lg1-v1 neutron-server[77618]: DEBUG ovsdbapp.backend.ovs_idl.transaction [None req-c63b1acc-b5c6-4be8-9db9-04824fec27f2 None None] Running txn n=1 command(idx=1): SetLSwitchPortCommand(_result=None, lport=268e1eb8-0568-4553-9120-b5ec7ec1d878, external_ids_update=None, columns={'external_ids': {'neutron:port_name': '', 'neutron:device_id': '80c11046-4421-4321-813a-d46f0332997a', 'neutron:project_id': '95de88f6d26e4420bc466ba67668171f', 'neutron:cidrs': 'fd12:3562:78f7::1/64', 'neutron:device_owner': 'network:router_interface', 'neutron:subnet_pool_addr_scope4': '', 'neutron:subnet_pool_addr_scope6': '', 'neutron:network_name': 'neutron-fb218033-3d98-4065-b336-c595d5e6ca77', 'neutron:security_group_ids': '', 'neutron:revision_number': '2', 'neutron:vnic_type': 'normal', 'neutron:port_capabilities': '', 'neutron:mtu': ''}, 'parent_name': [], 'tag': [], 'options': {'mcast_flood_reports': 'true', 'router-port': 'lrp-268e1eb8-0568-4553-9120-b5ec7ec1d878'}, 'enabled': True, 'port_security': [], 'dhcpv4_options': [], 'dhcpv6_options': [], 'type': 'router', 'ha_chassis_group': []}, if_exists=False) {{(pid=77618) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:44:16 l75lg1-v1 neutron-server[77618]: DEBUG ovsdbapp.backend.ovs_idl.transaction [None req-c63b1acc-b5c6-4be8-9db9-04824fec27f2 None None] Running txn n=1 command(idx=2): PgDelPortCommand(_result=None, port_group=neutron_pg_drop, lsp=['268e1eb8-0568-4553-9120-b5ec7ec1d878'], if_exists=False) {{(pid=77618) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:44:16 l75lg1-v1 neutron-server[77618]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-c63b1acc-b5c6-4be8-9db9-04824fec27f2 None None] Hash Ring: Node 4c6fc793-7f5a-456f-b4d6-6e5bd97592f2 (host: l75lg1-v1) handling event "update" for row 7539fd27-b5ba-421e-bfc6-56dd4f7cb100 (table: Logical_Switch_Port) {{(pid=77618) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:44:16 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-03b5f984-1478-4ad6-9838-8e34c1689c5b None None] Hash Ring: Node c89b3497-133e-4a5a-b67a-3310d2cb2485 (host: l75lg1-v1) handling event "update" for row 0e0eb57e-da08-4143-9e8f-3372cb0f2acf (table: Port_Binding) {{(pid=77619) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:44:16 l75lg1-v1 neutron-server[77618]: DEBUG ovsdbapp.backend.ovs_idl.event [None req-c63b1acc-b5c6-4be8-9db9-04824fec27f2 None None] Matched UPDATE: LogicalSwitchPortUpdateLogicalRouterPortEvent(events=('update',), table='Logical_Switch_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Switch_Port(up=[True], name=268e1eb8-0568-4553-9120-b5ec7ec1d878, external_ids={'neutron:cidrs': 'fd12:3562:78f7::1/64', 'neutron:device_id': '80c11046-4421-4321-813a-d46f0332997a', 'neutron:device_owner': 'network:router_interface', 'neutron:mtu': '', 'neutron:network_name': 'neutron-fb218033-3d98-4065-b336-c595d5e6ca77', 'neutron:port_capabilities': '', 'neutron:port_name': '', 'neutron:project_id': '95de88f6d26e4420bc466ba67668171f', 'neutron:revision_number': '2', 'neutron:security_group_ids': '', 'neutron:subnet_pool_addr_scope4': '', 'neutron:subnet_pool_addr_scope6': '', 'neutron:vnic_type': 'normal'}, ha_chassis_group=[], options={'router-port': 'lrp-268e1eb8-0568-4553-9120-b5ec7ec1d878', 'mcast_flood_reports': 'true'}, parent_name=[], enabled=[True], type=router, dhcpv6_options=[], tag_request=[], port_security=[], addresses=['router'], dynamic_addresses=[], dhcpv4_options=[], tag=[]) old=Logical_Switch_Port(external_ids={'neutron:cidrs': 'fd12:3562:78f7::1/64', 'neutron:device_id': '80c11046-4421-4321-813a-d46f0332997a', 'neutron:device_owner': 'network:router_interface', 'neutron:mtu': '', 'neutron:network_name': 'neutron-fb218033-3d98-4065-b336-c595d5e6ca77', 'neutron:port_capabilities': '', 'neutron:port_name': '', 'neutron:project_id': '95de88f6d26e4420bc466ba67668171f', 'neutron:revision_number': '1', 'neutron:security_group_ids': '', 'neutron:subnet_pool_addr_scope4': '', 'neutron:subnet_pool_addr_scope6': '', 'neutron:vnic_type': 'normal'}, options={'router-port': 'lrp-268e1eb8-0568-4553-9120-b5ec7ec1d878'}) {{(pid=77618) matches /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} May 28 12:44:16 l75lg1-v1 neutron-server[77618]: INFO neutron.db.ovn_revision_numbers_db [None req-5ba0b4eb-00ab-4523-a874-41c9965d7fce None None] Successfully bumped revision number for resource 268e1eb8-0568-4553-9120-b5ec7ec1d878 (type: ports) to 2 May 28 12:44:16 l75lg1-v1 neutron-server[77618]: INFO neutron.tests.unit.plugins.ml2.drivers.mechanism_logger [None req-5ba0b4eb-00ab-4523-a874-41c9965d7fce None None] update_port_postcommit called with port settings {'id': '268e1eb8-0568-4553-9120-b5ec7ec1d878', 'name': '', 'network_id': 'fb218033-3d98-4065-b336-c595d5e6ca77', 'tenant_id': '95de88f6d26e4420bc466ba67668171f', 'mac_address': 'fa:16:3e:7c:1e:ba', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '80c11046-4421-4321-813a-d46f0332997a', 'device_owner': 'network:router_interface', 'standard_attr_id': 29, 'fixed_ips': [{'subnet_id': '799ded51-0b75-4f67-94e9-0a7ea3c3f3d6', 'ip_address': 'fd12:3562:78f7::1'}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2024-05-28T12:44:14Z', 'updated_at': '2024-05-28T12:44:15Z', 'revision_number': 2, 'project_id': '95de88f6d26e4420bc466ba67668171f'} (original settings {'id': '268e1eb8-0568-4553-9120-b5ec7ec1d878', 'name': '', 'network_id': 'fb218033-3d98-4065-b336-c595d5e6ca77', 'tenant_id': '95de88f6d26e4420bc466ba67668171f', 'mac_address': 'fa:16:3e:7c:1e:ba', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '80c11046-4421-4321-813a-d46f0332997a', 'device_owner': 'network:router_interface', 'standard_attr_id': 29, 'fixed_ips': [{'subnet_id': '799ded51-0b75-4f67-94e9-0a7ea3c3f3d6', 'ip_address': 'fd12:3562:78f7::1'}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2024-05-28T12:44:14Z', 'updated_at': '2024-05-28T12:44:14Z', 'revision_number': 1, 'project_id': '95de88f6d26e4420bc466ba67668171f'}) host (original host ) vif type unbound (original vif type unbound) vif details {} (original vif details {}) binding levels None (original binding levels None) on network {'id': 'fb218033-3d98-4065-b336-c595d5e6ca77', 'name': 'private', 'tenant_id': '95de88f6d26e4420bc466ba67668171f', 'admin_state_up': True, 'mtu': 1442, 'status': 'ACTIVE', 'subnets': ['5508b790-cc91-4b59-8d30-81ef4480e470', '799ded51-0b75-4f67-94e9-0a7ea3c3f3d6'], 'standard_attr_id': 12, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'vlan_transparent': None, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2024-05-28T12:43:43Z', 'updated_at': '2024-05-28T12:43:49Z', 'revision_number': 3, 'project_id': '95de88f6d26e4420bc466ba67668171f', 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 30276} with segments to bind None May 28 12:44:16 l75lg1-v1 neutron-server[77618]: DEBUG neutron.tests.unit.plugins.ml2.drivers.mechanism_logger [None req-5ba0b4eb-00ab-4523-a874-41c9965d7fce None None] update_port_postcommit: May 28 12:44:16 l75lg1-v1 neutron-server[77618]: key[status], DOWN -> ACTIVE May 28 12:44:16 l75lg1-v1 neutron-server[77618]: key[updated_at], 2024-05-28T12:44:14Z -> 2024-05-28T12:44:15Z May 28 12:44:16 l75lg1-v1 neutron-server[77618]: key[revision_number], 1 -> 2 May 28 12:44:16 l75lg1-v1 neutron-server[77618]: {{(pid=77618) _log_diff_call /opt/stack/neutron/neutron/tests/unit/plugins/ml2/drivers/mechanism_logger.py:59}} May 28 12:44:16 l75lg1-v1 neutron-server[77618]: DEBUG neutron_lib.callbacks.manager [None req-5ba0b4eb-00ab-4523-a874-41c9965d7fce None None] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4166243', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8754903016533', 'neutron.services.ovn_l3.plugin.OVNL3RouterPlugin._port_update-8754901907784'] for port (268e1eb8-0568-4553-9120-b5ec7ec1d878), after_update {{(pid=77618) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:44:16 l75lg1-v1 neutron-server[77618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a299988-b021-4f5c-be6c-ee6eecea0224 None None] Pushing event updated for resources: {'Port': ['ID=268e1eb8-0568-4553-9120-b5ec7ec1d878,revision_number=2']} {{(pid=77618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 28 12:44:16 l75lg1-v1 dstat.sh[49771]: 28-05 12:44:16| 12 1 85 1 0|2766M 6733M 267M 5932M| 11k 1610B| 0 832k| 0 93.0 |3043 4600 |1.25 1.74 1.25|1.0 0 17| 0 0 | 0 2048M| 23 124 0 35 0 May 28 12:44:17 l75lg1-v1 dstat.sh[49771]: 28-05 12:44:17| 9 1 89 0 0|2815M 6684M 267M 5932M| 11k 1536B| 0 448k| 0 34.0 |1450 1652 |1.23 1.73 1.25|1.0 0 21| 0 0 | 0 2048M| 23 124 0 35 0 May 28 12:44:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5188367-e4c5-4c02-9520-e3f5091b07f9 None None] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:44:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5188367-e4c5-4c02-9520-e3f5091b07f9 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:44:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5188367-e4c5-4c02-9520-e3f5091b07f9 None None] PATH_INFO: `/` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:44:17 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 467/918] 10.27.203.238 () {58 vars in 1014 bytes} [Tue May 28 12:44:17 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:44:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914dec8f-ee3e-4236-be25-64dcd92a95b6 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:44:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914dec8f-ee3e-4236-be25-64dcd92a95b6 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:44:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914dec8f-ee3e-4236-be25-64dcd92a95b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:44:17 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-914dec8f-ee3e-4236-be25-64dcd92a95b6 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:44:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-914dec8f-ee3e-4236-be25-64dcd92a95b6 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:44:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-914dec8f-ee3e-4236-be25-64dcd92a95b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:44:17 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 452/919] 10.27.203.238 () {62 vars in 1111 bytes} [Tue May 28 12:44:17 2024] POST /identity/v3/auth/tokens => generated 3991 bytes in 22 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:44:17 l75lg1-v1 neutron-server[77618]: DEBUG neutron.wsgi [-] (77618) accepted ('10.27.203.238', 38030) {{(pid=77618) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 12:44:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5188367-e4c5-4c02-9520-e3f5091b07f9 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:44:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5188367-e4c5-4c02-9520-e3f5091b07f9 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:44:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4e45b3-199d-4355-92b6-80056f473f80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef17047035e4b518fd5360a01f2da1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:44:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4e45b3-199d-4355-92b6-80056f473f80 service neutron] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:44:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4e45b3-199d-4355-92b6-80056f473f80 service neutron] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:44:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4e45b3-199d-4355-92b6-80056f473f80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:44:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4e45b3-199d-4355-92b6-80056f473f80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:44:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4e45b3-199d-4355-92b6-80056f473f80 service neutron] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:44:17 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 468/920] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 12:44:17 2024] GET /identity/v3/auth/tokens => generated 3991 bytes in 20 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 12:44:17 l75lg1-v1 neutron-server[77618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3b62242f-f013-4313-bb71-d7a83edc79b8 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=77618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:258}} May 28 12:44:17 l75lg1-v1 neutron-server[77618]: INFO neutron.wsgi [None req-3b62242f-f013-4313-bb71-d7a83edc79b8 admin admin] 10.27.203.238 "GET /networking/v2.0/networks/5066e001-05ee-4812-ba7f-98a035d8bd0a HTTP/1.1" status: 200 len: 878 time: 0.0732803 May 28 12:44:17 l75lg1-v1 neutron-server[77618]: DEBUG neutron.api.v2.base [None req-4feaa811-f823-4f23-a948-967c1422d687 admin admin] Request body: {'subnet': {'gateway_ip': '2001:db8::2', 'network_id': '5066e001-05ee-4812-ba7f-98a035d8bd0a', 'cidr': '2001:db8::/64', 'enable_dhcp': False, 'ip_version': 6, 'name': 'ipv6-public-subnet'}} {{(pid=77618) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:734}} May 28 12:44:17 l75lg1-v1 neutron-server[77618]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4feaa811-f823-4f23-a948-967c1422d687 admin admin] Made reservation on behalf of ea8d517cde1d40bb82c97e080ce071f7 for: {'subnet': 1} {{(pid=77618) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 28 12:44:17 l75lg1-v1 neutron-server[77618]: DEBUG neutron_lib.callbacks.manager [None req-4feaa811-f823-4f23-a948-967c1422d687 admin admin] Publish callbacks [] for subnet (None), before_create {{(pid=77618) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:44:17 l75lg1-v1 neutron-server[77618]: DEBUG neutron.db.ovn_revision_numbers_db [None req-4feaa811-f823-4f23-a948-967c1422d687 admin admin] create_initial_revision uuid=6178146d-51fe-4ab8-9844-d8c72981438d, type=subnets, rev=-1 {{(pid=77618) create_initial_revision /opt/stack/neutron/neutron/db/ovn_revision_numbers_db.py:108}} May 28 12:44:17 l75lg1-v1 neutron-server[77618]: INFO neutron.tests.unit.plugins.ml2.drivers.mechanism_logger [None req-4feaa811-f823-4f23-a948-967c1422d687 admin admin] create_subnet_precommit called with subnet settings {'id': '6178146d-51fe-4ab8-9844-d8c72981438d', 'name': 'ipv6-public-subnet', 'tenant_id': 'ea8d517cde1d40bb82c97e080ce071f7', 'network_id': '5066e001-05ee-4812-ba7f-98a035d8bd0a', 'ip_version': 6, 'subnetpool_id': None, 'enable_dhcp': False, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'standard_attr_id': 30, 'gateway_ip': '2001:db8::2', 'cidr': '2001:db8::/64', 'allocation_pools': [{'start': '2001:db8::1', 'end': '2001:db8::1'}, {'start': '2001:db8::3', 'end': '2001:db8::ffff:ffff:ffff:ffff'}], 'host_routes': [], 'dns_nameservers': [], 'shared': False, 'description': '', 'service_types': [], 'tags': [], 'created_at': '2024-05-28T12:44:17Z', 'updated_at': '2024-05-28T12:44:17Z', 'revision_number': 0, 'project_id': 'ea8d517cde1d40bb82c97e080ce071f7'} (original settings None) May 28 12:44:17 l75lg1-v1 neutron-server[77618]: DEBUG neutron.tests.unit.plugins.ml2.drivers.mechanism_logger [None req-4feaa811-f823-4f23-a948-967c1422d687 admin admin] create_subnet_precommit: May 28 12:44:17 l75lg1-v1 neutron-server[77618]: key[tenant_id], None -> ea8d517cde1d40bb82c97e080ce071f7 May 28 12:44:17 l75lg1-v1 neutron-server[77618]: key[network_id], None -> 5066e001-05ee-4812-ba7f-98a035d8bd0a May 28 12:44:17 l75lg1-v1 neutron-server[77618]: key[revision_number], None -> 0 May 28 12:44:17 l75lg1-v1 neutron-server[77618]: key[project_id], None -> ea8d517cde1d40bb82c97e080ce071f7 May 28 12:44:17 l75lg1-v1 neutron-server[77618]: key[id], None -> 6178146d-51fe-4ab8-9844-d8c72981438d May 28 12:44:17 l75lg1-v1 neutron-server[77618]: key[tags], None -> [] May 28 12:44:17 l75lg1-v1 neutron-server[77618]: key[created_at], None -> 2024-05-28T12:44:17Z May 28 12:44:17 l75lg1-v1 neutron-server[77618]: key[allocation_pools], None -> [{'start': '2001:db8::1', 'end': '2001:db8::1'}, {'start': '2001:db8::3', 'end': '2001:db8::ffff:ffff:ffff:ffff'}] May 28 12:44:17 l75lg1-v1 neutron-server[77618]: key[subnetpool_id], None -> None May 28 12:44:17 l75lg1-v1 neutron-server[77618]: key[host_routes], None -> [] May 28 12:44:17 l75lg1-v1 neutron-server[77618]: key[gateway_ip], None -> 2001:db8::2 May 28 12:44:17 l75lg1-v1 neutron-server[77618]: key[service_types], None -> [] May 28 12:44:17 l75lg1-v1 neutron-server[77618]: key[updated_at], None -> 2024-05-28T12:44:17Z May 28 12:44:17 l75lg1-v1 neutron-server[77618]: key[standard_attr_id], None -> 30 May 28 12:44:17 l75lg1-v1 neutron-server[77618]: key[ip_version], None -> 6 May 28 12:44:17 l75lg1-v1 neutron-server[77618]: key[cidr], None -> 2001:db8::/64 May 28 12:44:17 l75lg1-v1 neutron-server[77618]: key[dns_nameservers], None -> [] May 28 12:44:17 l75lg1-v1 neutron-server[77618]: key[ipv6_address_mode], None -> None May 28 12:44:17 l75lg1-v1 neutron-server[77618]: key[description], None -> May 28 12:44:17 l75lg1-v1 neutron-server[77618]: key[ipv6_ra_mode], None -> None May 28 12:44:17 l75lg1-v1 neutron-server[77618]: key[enable_dhcp], None -> False May 28 12:44:17 l75lg1-v1 neutron-server[77618]: key[shared], None -> False May 28 12:44:17 l75lg1-v1 neutron-server[77618]: key[name], None -> ipv6-public-subnet May 28 12:44:17 l75lg1-v1 neutron-server[77618]: {{(pid=77618) _log_diff_call /opt/stack/neutron/neutron/tests/unit/plugins/ml2/drivers/mechanism_logger.py:59}} May 28 12:44:18 l75lg1-v1 neutron-server[77618]: DEBUG neutron.objects.ports [None req-4feaa811-f823-4f23-a948-967c1422d687 admin admin] Time-cost: Fetching 1 ports in 0 security groups {{(pid=77618) get_objects /opt/stack/neutron/neutron/objects/ports.py:497}} May 28 12:44:18 l75lg1-v1 dstat.sh[49771]: 28-05 12:44:18| 10 1 88 1 0|2828M 6670M 267M 5932M| 16k 0 | 0 852k| 0 105 |2628 4038 |1.23 1.73 1.25|1.0 0 2.0| 0 0 | 0 2048M| 23 126 0 35 0 May 28 12:44:18 l75lg1-v1 neutron-server[77618]: DEBUG neutron_lib.callbacks.manager [None req-4feaa811-f823-4f23-a948-967c1422d687 admin admin] Publish callbacks [] for router_gateway (80c11046-4421-4321-813a-d46f0332997a), precommit_update {{(pid=77618) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:44:18 l75lg1-v1 neutron-server[77618]: DEBUG neutron_lib.callbacks.manager [None req-4feaa811-f823-4f23-a948-967c1422d687 admin admin] Publish callbacks [] for router_gateway (None), before_update {{(pid=77618) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:44:18 l75lg1-v1 neutron-server[77618]: DEBUG neutron_lib.callbacks.manager [None req-4feaa811-f823-4f23-a948-967c1422d687 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1015114', 'neutron.services.ovn_l3.plugin.OVNL3RouterPlugin._port_update-8754901907784', 'neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_internal_ip_change_for_fip-8754903031884'] for port (be7063e1-bd60-43c5-bc4e-91151583d1f2), before_update {{(pid=77618) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:44:18 l75lg1-v1 neutron-server[77618]: DEBUG neutron.db.db_base_plugin_common [None req-4feaa811-f823-4f23-a948-967c1422d687 admin admin] Allocated IP 2001:db8::d4 (5066e001-05ee-4812-ba7f-98a035d8bd0a/6178146d-51fe-4ab8-9844-d8c72981438d/be7063e1-bd60-43c5-bc4e-91151583d1f2) {{(pid=77618) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:134}} May 28 12:44:18 l75lg1-v1 neutron-server[77618]: DEBUG neutron.plugins.ml2.db [None req-4feaa811-f823-4f23-a948-967c1422d687 admin admin] For port be7063e1-bd60-43c5-bc4e-91151583d1f2, host l75lg1-v1, got binding levels [PortBindingLevel(driver='ovn',host='l75lg1-v1',level=0,port_id=be7063e1-bd60-43c5-bc4e-91151583d1f2,segment=NetworkSegment(3385f5f9-bbb0-40f0-9631-6fb158c3207c),segment_id=3385f5f9-bbb0-40f0-9631-6fb158c3207c)] {{(pid=77618) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} May 28 12:44:18 l75lg1-v1 neutron-server[77618]: DEBUG neutron_lib.callbacks.manager [None req-4feaa811-f823-4f23-a948-967c1422d687 admin admin] Publish callbacks [] for port (be7063e1-bd60-43c5-bc4e-91151583d1f2), precommit_update {{(pid=77618) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:44:18 l75lg1-v1 neutron-server[77618]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver [None req-4feaa811-f823-4f23-a948-967c1422d687 admin admin] No provisioning block for port be7063e1-bd60-43c5-bc4e-91151583d1f2 since it is active {{(pid=77618) _is_port_provisioning_required /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/mech_driver.py:715}} May 28 12:44:18 l75lg1-v1 neutron-server[77618]: INFO neutron.tests.unit.plugins.ml2.drivers.mechanism_logger [None req-4feaa811-f823-4f23-a948-967c1422d687 admin admin] update_port_precommit called with port settings {'id': 'be7063e1-bd60-43c5-bc4e-91151583d1f2', 'name': '', 'network_id': '5066e001-05ee-4812-ba7f-98a035d8bd0a', 'tenant_id': '', 'mac_address': 'fa:16:3e:62:f4:51', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '80c11046-4421-4321-813a-d46f0332997a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 28, 'fixed_ips': [{'subnet_id': 'cddf717c-a51e-4470-8ce9-c2ab09a80e38', 'ip_address': '172.24.4.236'}, {'subnet_id': '6178146d-51fe-4ab8-9844-d8c72981438d', 'ip_address': '2001:db8::d4'}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'l75lg1-v1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'port_filter': True, 'connectivity': 'l2', 'bridge_name': 'br-int', 'datapath_type': 'system'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2024-05-28T12:44:08Z', 'updated_at': '2024-05-28T12:44:18Z', 'revision_number': 6, 'project_id': ''} (original settings {'id': 'be7063e1-bd60-43c5-bc4e-91151583d1f2', 'name': '', 'network_id': '5066e001-05ee-4812-ba7f-98a035d8bd0a', 'tenant_id': '', 'mac_address': 'fa:16:3e:62:f4:51', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '80c11046-4421-4321-813a-d46f0332997a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 28, 'fixed_ips': [{'subnet_id': 'cddf717c-a51e-4470-8ce9-c2ab09a80e38', 'ip_address': '172.24.4.236'}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'l75lg1-v1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'port_filter': True, 'connectivity': 'l2', 'bridge_name': 'br-int', 'datapath_type': 'system', 'bound_drivers': {'0': 'ovn'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2024-05-28T12:44:08Z', 'updated_at': '2024-05-28T12:44:10Z', 'revision_number': 5, 'project_id': ''}) host l75lg1-v1 (original host l75lg1-v1) vif type ovs (original vif type ovs) vif details {'port_filter': True, 'connectivity': 'l2', 'bridge_name': 'br-int', 'datapath_type': 'system'} (original vif details {'port_filter': True, 'connectivity': 'l2', 'bridge_name': 'br-int', 'datapath_type': 'system'}) binding levels [{'bound_driver': 'ovn', 'bound_segment': {'id': '3385f5f9-bbb0-40f0-9631-6fb158c3207c', 'network_type': 'flat', 'physical_network': 'public', 'segmentation_id': None, 'network_id': '5066e001-05ee-4812-ba7f-98a035d8bd0a'}}] (original binding levels [{'bound_driver': 'ovn', 'bound_segment': {'id': '3385f5f9-bbb0-40f0-9631-6fb158c3207c', 'network_type': 'flat', 'physical_network': 'public', 'segmentation_id': None, 'network_id': '5066e001-05ee-4812-ba7f-98a035d8bd0a'}}]) on network {'id': '5066e001-05ee-4812-ba7f-98a035d8bd0a', 'name': 'public', 'tenant_id': 'ea8d517cde1d40bb82c97e080ce071f7', 'admin_state_up': True, 'mtu': 1500, 'status': 'ACTIVE', 'subnets': ['6178146d-51fe-4ab8-9844-d8c72981438d', 'cddf717c-a51e-4470-8ce9-c2ab09a80e38'], 'standard_attr_id': 23, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': True, 'vlan_transparent': None, 'description': '', 'port_security_enabled': True, 'is_default': True, 'tags': [], 'created_at': '2024-05-28T12:43:59Z', 'updated_at': '2024-05-28T12:44:17Z', 'revision_number': 3, 'project_id': 'ea8d517cde1d40bb82c97e080ce071f7', 'provider:network_type': 'flat', 'provider:physical_network': 'public', 'provider:segmentation_id': None} with segments to bind None May 28 12:44:18 l75lg1-v1 neutron-server[77618]: DEBUG neutron.tests.unit.plugins.ml2.drivers.mechanism_logger [None req-4feaa811-f823-4f23-a948-967c1422d687 admin admin] update_port_precommit: May 28 12:44:18 l75lg1-v1 neutron-server[77618]: key[fixed_ips], [{'subnet_id': 'cddf717c-a51e-4470-8ce9-c2ab09a80e38', 'ip_address': '172.24.4.236'}] -> [{'subnet_id': 'cddf717c-a51e-4470-8ce9-c2ab09a80e38', 'ip_address': '172.24.4.236'}, {'subnet_id': '6178146d-51fe-4ab8-9844-d8c72981438d', 'ip_address': '2001:db8::d4'}] May 28 12:44:18 l75lg1-v1 neutron-server[77618]: key[binding:vif_details], {'port_filter': True, 'connectivity': 'l2', 'bridge_name': 'br-int', 'datapath_type': 'system', 'bound_drivers': {'0': 'ovn'}} -> {'port_filter': True, 'connectivity': 'l2', 'bridge_name': 'br-int', 'datapath_type': 'system'} May 28 12:44:18 l75lg1-v1 neutron-server[77618]: key[updated_at], 2024-05-28T12:44:10Z -> 2024-05-28T12:44:18Z May 28 12:44:18 l75lg1-v1 neutron-server[77618]: key[revision_number], 5 -> 6 May 28 12:44:18 l75lg1-v1 neutron-server[77618]: {{(pid=77618) _log_diff_call /opt/stack/neutron/neutron/tests/unit/plugins/ml2/drivers/mechanism_logger.py:59}} May 28 12:44:18 l75lg1-v1 neutron-server[77618]: DEBUG neutron_lib.callbacks.manager [None req-4feaa811-f823-4f23-a948-967c1422d687 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4166243', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8754903016533', 'neutron.services.ovn_l3.plugin.OVNL3RouterPlugin._port_update-8754901907784'] for port (be7063e1-bd60-43c5-bc4e-91151583d1f2), after_update {{(pid=77618) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:44:18 l75lg1-v1 neutron-server[77618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4feaa811-f823-4f23-a948-967c1422d687 admin admin] Pushing event updated for resources: {'Port': ['ID=be7063e1-bd60-43c5-bc4e-91151583d1f2,revision_number=6']} {{(pid=77618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 28 12:44:18 l75lg1-v1 neutron-server[77618]: DEBUG ovsdbapp.backend.ovs_idl.transaction [None req-c63b1acc-b5c6-4be8-9db9-04824fec27f2 None None] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=be7063e1-bd60-43c5-bc4e-91151583d1f2, resource={'id': 'be7063e1-bd60-43c5-bc4e-91151583d1f2', 'name': '', 'network_id': '5066e001-05ee-4812-ba7f-98a035d8bd0a', 'tenant_id': '', 'mac_address': 'fa:16:3e:62:f4:51', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '80c11046-4421-4321-813a-d46f0332997a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 28, 'fixed_ips': [{'subnet_id': 'cddf717c-a51e-4470-8ce9-c2ab09a80e38', 'ip_address': '172.24.4.236'}, {'subnet_id': '6178146d-51fe-4ab8-9844-d8c72981438d', 'ip_address': '2001:db8::d4'}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'l75lg1-v1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'port_filter': True, 'connectivity': 'l2', 'bridge_name': 'br-int', 'datapath_type': 'system'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2024-05-28T12:44:08Z', 'updated_at': '2024-05-28T12:44:18Z', 'revision_number': 6, 'project_id': '', 'network': {'id': '5066e001-05ee-4812-ba7f-98a035d8bd0a', 'name': 'public', 'tenant_id': 'ea8d517cde1d40bb82c97e080ce071f7', 'admin_state_up': True, 'mtu': 1500, 'status': 'ACTIVE', 'subnets': ['6178146d-51fe-4ab8-9844-d8c72981438d', 'cddf717c-a51e-4470-8ce9-c2ab09a80e38'], 'standard_attr_id': 23, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': True, 'vlan_transparent': None, 'description': '', 'port_security_enabled': True, 'is_default': True, 'tags': [], 'created_at': '2024-05-28T12:43:59Z', 'updated_at': '2024-05-28T12:44:17Z', 'revision_number': 3, 'project_id': 'ea8d517cde1d40bb82c97e080ce071f7', 'provider:network_type': 'flat', 'provider:physical_network': 'public', 'provider:segmentation_id': None}}, resource_type=ports, if_exists=True) {{(pid=77618) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:44:18 l75lg1-v1 neutron-server[77618]: DEBUG ovsdbapp.backend.ovs_idl.transaction [None req-c63b1acc-b5c6-4be8-9db9-04824fec27f2 None None] Running txn n=1 command(idx=1): SetLSwitchPortCommand(_result=None, lport=be7063e1-bd60-43c5-bc4e-91151583d1f2, external_ids_update=None, columns={'external_ids': {'neutron:port_name': '', 'neutron:device_id': '80c11046-4421-4321-813a-d46f0332997a', 'neutron:project_id': '', 'neutron:cidrs': '172.24.4.236/24 2001:db8::d4/64', 'neutron:device_owner': 'network:router_gateway', 'neutron:subnet_pool_addr_scope4': '', 'neutron:subnet_pool_addr_scope6': '', 'neutron:network_name': 'neutron-5066e001-05ee-4812-ba7f-98a035d8bd0a', 'neutron:security_group_ids': '', 'neutron:revision_number': '6', 'neutron:vnic_type': 'normal', 'neutron:port_capabilities': '', 'neutron:mtu': '', 'neutron:host_id': 'l75lg1-v1'}, 'parent_name': [], 'tag': [], 'options': {'requested-chassis': 'l75lg1-v1', 'mcast_flood_reports': 'true', 'exclude-lb-vips-from-garp': 'true', 'nat-addresses': 'router', 'router-port': 'lrp-be7063e1-bd60-43c5-bc4e-91151583d1f2'}, 'enabled': True, 'port_security': [], 'dhcpv4_options': [], 'dhcpv6_options': [], 'type': 'router', 'ha_chassis_group': []}, if_exists=False) {{(pid=77618) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:44:18 l75lg1-v1 neutron-server[77618]: DEBUG ovsdbapp.backend.ovs_idl.transaction [None req-c63b1acc-b5c6-4be8-9db9-04824fec27f2 None None] Running txn n=1 command(idx=2): PgDelPortCommand(_result=None, port_group=neutron_pg_drop, lsp=['be7063e1-bd60-43c5-bc4e-91151583d1f2'], if_exists=False) {{(pid=77618) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:44:18 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-53cecb61-7023-41e4-a5ea-23b1eb02606a None None] Hash Ring: Node c89b3497-133e-4a5a-b67a-3310d2cb2485 (host: l75lg1-v1) handling event "update" for row c100b146-635b-4ec8-a4a1-ddbd59917880 (table: Logical_Switch_Port) {{(pid=77619) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:44:18 l75lg1-v1 neutron-server[77618]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-d9d4969c-e9ae-4d76-91b0-9b7c8eb907b3 None None] Hash Ring: Node 4c6fc793-7f5a-456f-b4d6-6e5bd97592f2 (host: l75lg1-v1) handling event "update" for row 58ca17de-33f0-42ed-8eac-a67cd94edbf1 (table: Port_Binding) {{(pid=77618) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:44:18 l75lg1-v1 neutron-server[77618]: INFO neutron.db.ovn_revision_numbers_db [None req-4feaa811-f823-4f23-a948-967c1422d687 admin admin] Successfully bumped revision number for resource be7063e1-bd60-43c5-bc4e-91151583d1f2 (type: ports) to 6 May 28 12:44:18 l75lg1-v1 neutron-server[77618]: INFO neutron.tests.unit.plugins.ml2.drivers.mechanism_logger [None req-4feaa811-f823-4f23-a948-967c1422d687 admin admin] update_port_postcommit called with port settings {'id': 'be7063e1-bd60-43c5-bc4e-91151583d1f2', 'name': '', 'network_id': '5066e001-05ee-4812-ba7f-98a035d8bd0a', 'tenant_id': '', 'mac_address': 'fa:16:3e:62:f4:51', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '80c11046-4421-4321-813a-d46f0332997a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 28, 'fixed_ips': [{'subnet_id': 'cddf717c-a51e-4470-8ce9-c2ab09a80e38', 'ip_address': '172.24.4.236'}, {'subnet_id': '6178146d-51fe-4ab8-9844-d8c72981438d', 'ip_address': '2001:db8::d4'}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'l75lg1-v1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'port_filter': True, 'connectivity': 'l2', 'bridge_name': 'br-int', 'datapath_type': 'system'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2024-05-28T12:44:08Z', 'updated_at': '2024-05-28T12:44:18Z', 'revision_number': 6, 'project_id': ''} (original settings {'id': 'be7063e1-bd60-43c5-bc4e-91151583d1f2', 'name': '', 'network_id': '5066e001-05ee-4812-ba7f-98a035d8bd0a', 'tenant_id': '', 'mac_address': 'fa:16:3e:62:f4:51', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '80c11046-4421-4321-813a-d46f0332997a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 28, 'fixed_ips': [{'subnet_id': 'cddf717c-a51e-4470-8ce9-c2ab09a80e38', 'ip_address': '172.24.4.236'}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'l75lg1-v1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'port_filter': True, 'connectivity': 'l2', 'bridge_name': 'br-int', 'datapath_type': 'system', 'bound_drivers': {'0': 'ovn'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2024-05-28T12:44:08Z', 'updated_at': '2024-05-28T12:44:10Z', 'revision_number': 5, 'project_id': ''}) host l75lg1-v1 (original host l75lg1-v1) vif type ovs (original vif type ovs) vif details {'port_filter': True, 'connectivity': 'l2', 'bridge_name': 'br-int', 'datapath_type': 'system'} (original vif details {'port_filter': True, 'connectivity': 'l2', 'bridge_name': 'br-int', 'datapath_type': 'system'}) binding levels [{'bound_driver': 'ovn', 'bound_segment': {'id': '3385f5f9-bbb0-40f0-9631-6fb158c3207c', 'network_type': 'flat', 'physical_network': 'public', 'segmentation_id': None, 'network_id': '5066e001-05ee-4812-ba7f-98a035d8bd0a'}}] (original binding levels [{'bound_driver': 'ovn', 'bound_segment': {'id': '3385f5f9-bbb0-40f0-9631-6fb158c3207c', 'network_type': 'flat', 'physical_network': 'public', 'segmentation_id': None, 'network_id': '5066e001-05ee-4812-ba7f-98a035d8bd0a'}}]) on network {'id': '5066e001-05ee-4812-ba7f-98a035d8bd0a', 'name': 'public', 'tenant_id': 'ea8d517cde1d40bb82c97e080ce071f7', 'admin_state_up': True, 'mtu': 1500, 'status': 'ACTIVE', 'subnets': ['6178146d-51fe-4ab8-9844-d8c72981438d', 'cddf717c-a51e-4470-8ce9-c2ab09a80e38'], 'standard_attr_id': 23, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': True, 'vlan_transparent': None, 'description': '', 'port_security_enabled': True, 'is_default': True, 'tags': [], 'created_at': '2024-05-28T12:43:59Z', 'updated_at': '2024-05-28T12:44:17Z', 'revision_number': 3, 'project_id': 'ea8d517cde1d40bb82c97e080ce071f7', 'provider:network_type': 'flat', 'provider:physical_network': 'public', 'provider:segmentation_id': None} with segments to bind None May 28 12:44:18 l75lg1-v1 neutron-server[77618]: DEBUG neutron.tests.unit.plugins.ml2.drivers.mechanism_logger [None req-4feaa811-f823-4f23-a948-967c1422d687 admin admin] update_port_postcommit: May 28 12:44:18 l75lg1-v1 neutron-server[77618]: key[fixed_ips], [{'subnet_id': 'cddf717c-a51e-4470-8ce9-c2ab09a80e38', 'ip_address': '172.24.4.236'}] -> [{'subnet_id': 'cddf717c-a51e-4470-8ce9-c2ab09a80e38', 'ip_address': '172.24.4.236'}, {'subnet_id': '6178146d-51fe-4ab8-9844-d8c72981438d', 'ip_address': '2001:db8::d4'}] May 28 12:44:18 l75lg1-v1 neutron-server[77618]: key[binding:vif_details], {'port_filter': True, 'connectivity': 'l2', 'bridge_name': 'br-int', 'datapath_type': 'system', 'bound_drivers': {'0': 'ovn'}} -> {'port_filter': True, 'connectivity': 'l2', 'bridge_name': 'br-int', 'datapath_type': 'system'} May 28 12:44:18 l75lg1-v1 neutron-server[77618]: key[updated_at], 2024-05-28T12:44:10Z -> 2024-05-28T12:44:18Z May 28 12:44:18 l75lg1-v1 neutron-server[77618]: key[revision_number], 5 -> 6 May 28 12:44:18 l75lg1-v1 neutron-server[77618]: {{(pid=77618) _log_diff_call /opt/stack/neutron/neutron/tests/unit/plugins/ml2/drivers/mechanism_logger.py:59}} May 28 12:44:19 l75lg1-v1 neutron-server[77618]: DEBUG neutron_lib.callbacks.manager [None req-4feaa811-f823-4f23-a948-967c1422d687 admin admin] Publish callbacks ['neutron.services.ovn_l3.plugin.ExtraGatewaysDbOnlyMixin._process_bfd_ecmp_update-12753', 'neutron.services.ovn_l3.service_providers.driver_controller.DriverController._update_router_provider-2832'] for router (80c11046-4421-4321-813a-d46f0332997a), precommit_update {{(pid=77618) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:44:19 l75lg1-v1 neutron-server[77618]: DEBUG neutron_lib.callbacks.manager [None req-4feaa811-f823-4f23-a948-967c1422d687 admin admin] Publish callbacks ['neutron.services.ovn_l3.service_providers.ovn.OvnDriver._process_router_update-57891'] for router (80c11046-4421-4321-813a-d46f0332997a), after_update {{(pid=77618) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:44:19 l75lg1-v1 dstat.sh[49771]: 28-05 12:44:19| 10 0 88 1 0|2831M 6667M 267M 5932M| 14k 723B| 0 936k| 0 94.0 |3034 4696 |1.23 1.73 1.25|1.0 0 0| 0 0 | 0 2048M| 23 126 0 35 0 May 28 12:44:19 l75lg1-v1 neutron-server[77618]: DEBUG ovsdbapp.backend.ovs_idl.transaction [None req-c63b1acc-b5c6-4be8-9db9-04824fec27f2 None None] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-80c11046-4421-4321-813a-d46f0332997a, resource={'id': '80c11046-4421-4321-813a-d46f0332997a', 'name': 'router1', 'tenant_id': '95de88f6d26e4420bc466ba67668171f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5066e001-05ee-4812-ba7f-98a035d8bd0a', 'external_fixed_ips': [{'subnet_id': 'cddf717c-a51e-4470-8ce9-c2ab09a80e38', 'ip_address': '172.24.4.236'}, {'subnet_id': '6178146d-51fe-4ab8-9844-d8c72981438d', 'ip_address': '2001:db8::d4'}], 'enable_snat': True}, 'gw_port_id': 'be7063e1-bd60-43c5-bc4e-91151583d1f2', 'description': '', 'availability_zones': [], 'distributed': False, 'ha': True, 'ha_vr_id': 0, 'availability_zone_hints': [], 'enable_default_route_ecmp': False, 'enable_default_route_bfd': False, 'external_gateways': [{'network_id': '5066e001-05ee-4812-ba7f-98a035d8bd0a', 'external_fixed_ips': [{'ip_address': '172.24.4.236', 'subnet_id': 'cddf717c-a51e-4470-8ce9-c2ab09a80e38'}, {'ip_address': '2001:db8::d4', 'subnet_id': '6178146d-51fe-4ab8-9844-d8c72981438d'}]}], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2024-05-28T12:43:55Z', 'updated_at': '2024-05-28T12:44:18Z', 'revision_number': 4, 'project_id': '95de88f6d26e4420bc466ba67668171f'}, resource_type=routers, if_exists=True) {{(pid=77618) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:44:19 l75lg1-v1 neutron-server[77618]: DEBUG ovsdbapp.backend.ovs_idl.transaction [None req-c63b1acc-b5c6-4be8-9db9-04824fec27f2 None None] Running txn n=1 command(idx=1): DeleteLRouterExtGwCommand(_result=None, lrouter=neutron-80c11046-4421-4321-813a-d46f0332997a, if_exists=True, maintain_bfd=True) {{(pid=77618) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:44:19 l75lg1-v1 neutron-server[77618]: DEBUG ovsdbapp.backend.ovs_idl.transaction [None req-c63b1acc-b5c6-4be8-9db9-04824fec27f2 None None] Running txn n=1 command(idx=2): DeleteNATRuleInLRouterCommand(_result=None, lrouter=neutron-80c11046-4421-4321-813a-d46f0332997a, type=snat, logical_ip=10.0.0.0/26, external_ip=172.24.4.236, if_exists=True) {{(pid=77618) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:44:19 l75lg1-v1 neutron-server[77618]: DEBUG ovsdbapp.backend.ovs_idl.transaction [None req-c63b1acc-b5c6-4be8-9db9-04824fec27f2 None None] Running txn n=1 command(idx=3): DelStaticRoutesCommand(_result=None, lrouter=neutron-80c11046-4421-4321-813a-d46f0332997a, routes=[('0.0.0.0/0', '172.24.4.1'), ('::/0', '2001:db8::2')], if_exists=True) {{(pid=77618) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:44:19 l75lg1-v1 neutron-server[77618]: DEBUG ovsdbapp.backend.ovs_idl.transaction [None req-c63b1acc-b5c6-4be8-9db9-04824fec27f2 None None] Running txn n=1 command(idx=4): DelLRouterPortCommand(_result=None, name=lrp-be7063e1-bd60-43c5-bc4e-91151583d1f2, lrouter=neutron-80c11046-4421-4321-813a-d46f0332997a, if_exists=True) {{(pid=77618) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:44:19 l75lg1-v1 neutron-server[77618]: DEBUG ovsdbapp.backend.ovs_idl.transaction [None req-c63b1acc-b5c6-4be8-9db9-04824fec27f2 None None] Running txn n=1 command(idx=5): AddLRouterPortCommand(_result=None, name=lrp-be7063e1-bd60-43c5-bc4e-91151583d1f2, lrouter=neutron-80c11046-4421-4321-813a-d46f0332997a, may_exist=True, columns={'mac': 'fa:16:3e:62:f4:51', 'networks': ['172.24.4.236/24', '2001:db8::d4/64'], 'external_ids': {'neutron:revision_number': '6', 'neutron:subnet_ids': 'cddf717c-a51e-4470-8ce9-c2ab09a80e38 6178146d-51fe-4ab8-9844-d8c72981438d', 'neutron:network_name': 'neutron-5066e001-05ee-4812-ba7f-98a035d8bd0a', 'neutron:is_ext_gw': 'True', 'neutron:router_name': '80c11046-4421-4321-813a-d46f0332997a'}, 'options': {}}) {{(pid=77618) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:44:19 l75lg1-v1 neutron-server[77618]: DEBUG ovsdbapp.backend.ovs_idl.transaction [None req-c63b1acc-b5c6-4be8-9db9-04824fec27f2 None None] Running txn n=1 command(idx=6): ScheduleNewGatewayCommand(_result=None, g_name=lrp-be7063e1-bd60-43c5-bc4e-91151583d1f2, sb_api=, lrouter_name=neutron-80c11046-4421-4321-813a-d46f0332997a, ovn_client=, scheduler=, physnet=public, az_hints=[]) {{(pid=77618) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:44:19 l75lg1-v1 neutron-server[77618]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_client [None req-c63b1acc-b5c6-4be8-9db9-04824fec27f2 None None] Chassis candidates for scheduling gateway router ports for "public" physical network: ['0da8323f-64af-4526-b223-049f5737145a'] {{(pid=77618) get_candidates_for_scheduling /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py:1609}} May 28 12:44:19 l75lg1-v1 neutron-server[77618]: DEBUG neutron.scheduler.l3_ovn_scheduler [None req-c63b1acc-b5c6-4be8-9db9-04824fec27f2 None None] Gateway lrp-be7063e1-bd60-43c5-bc4e-91151583d1f2 scheduled on chassis ['0da8323f-64af-4526-b223-049f5737145a'] {{(pid=77618) _schedule_gateway /opt/stack/neutron/neutron/scheduler/l3_ovn_scheduler.py:90}} May 28 12:44:19 l75lg1-v1 neutron-server[77618]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.commands [None req-c63b1acc-b5c6-4be8-9db9-04824fec27f2 None None] Schedule LRP lrp-be7063e1-bd60-43c5-bc4e-91151583d1f2 on gateway 0da8323f-64af-4526-b223-049f5737145a with priority 1 May 28 12:44:19 l75lg1-v1 neutron-server[77618]: DEBUG ovsdbapp.backend.ovs_idl.transaction [None req-c63b1acc-b5c6-4be8-9db9-04824fec27f2 None None] Running txn n=1 command(idx=7): SetLRouterPortInLSwitchPortCommand(_result=None, lswitch_port=be7063e1-bd60-43c5-bc4e-91151583d1f2, lrouter_port=lrp-be7063e1-bd60-43c5-bc4e-91151583d1f2, is_gw_port=True, if_exists=True, lsp_address=router) {{(pid=77618) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:44:19 l75lg1-v1 neutron-server[77618]: DEBUG ovsdbapp.backend.ovs_idl.transaction [None req-c63b1acc-b5c6-4be8-9db9-04824fec27f2 None None] Running txn n=1 command(idx=8): AddStaticRouteCommand(_result=None, lrouter=neutron-80c11046-4421-4321-813a-d46f0332997a, maintain_bfd=False, columns={'ip_prefix': '0.0.0.0/0', 'nexthop': '172.24.4.1', 'external_ids': {'neutron:is_ext_gw': 'true', 'neutron:subnet_id': 'cddf717c-a51e-4470-8ce9-c2ab09a80e38'}}) {{(pid=77618) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:44:19 l75lg1-v1 neutron-server[77618]: DEBUG ovsdbapp.backend.ovs_idl.transaction [None req-c63b1acc-b5c6-4be8-9db9-04824fec27f2 None None] Running txn n=1 command(idx=9): AddStaticRouteCommand(_result=None, lrouter=neutron-80c11046-4421-4321-813a-d46f0332997a, maintain_bfd=False, columns={'ip_prefix': '::/0', 'nexthop': '2001:db8::2', 'external_ids': {'neutron:is_ext_gw': 'true', 'neutron:subnet_id': '6178146d-51fe-4ab8-9844-d8c72981438d'}}) {{(pid=77618) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:44:19 l75lg1-v1 neutron-server[77618]: DEBUG ovsdbapp.backend.ovs_idl.transaction [None req-c63b1acc-b5c6-4be8-9db9-04824fec27f2 None None] Running txn n=1 command(idx=10): AddNATRuleInLRouterCommand(_result=None, lrouter=neutron-80c11046-4421-4321-813a-d46f0332997a, columns={'type': 'snat', 'logical_ip': '10.0.0.0/26', 'external_ip': '172.24.4.236'}) {{(pid=77618) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:44:19 l75lg1-v1 neutron-server[77618]: DEBUG ovsdbapp.backend.ovs_idl.transaction [None req-c63b1acc-b5c6-4be8-9db9-04824fec27f2 None None] Running txn n=1 command(idx=11): UpdateLRouterCommand(_result=None, name=neutron-80c11046-4421-4321-813a-d46f0332997a, columns={'external_ids': {'neutron:router_name': 'router1', 'neutron:revision_number': '4', 'neutron:availability_zone_hints': ''}, 'enabled': True}, if_exists=True) {{(pid=77618) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:44:19 l75lg1-v1 neutron-server[77618]: DEBUG ovsdbapp.backend.ovs_idl.transaction [None req-c63b1acc-b5c6-4be8-9db9-04824fec27f2 None None] Running txn n=1 command(idx=12): QoSDelCommand(_result=None, switch=neutron-5066e001-05ee-4812-ba7f-98a035d8bd0a, conditions=[('direction', '=', 'from-lport'), ('priority', '=', 2002), ('match', '=', 'inport == "be7063e1-bd60-43c5-bc4e-91151583d1f2"')], if_exists=True) {{(pid=77618) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:44:19 l75lg1-v1 neutron-server[77618]: DEBUG ovsdbapp.backend.ovs_idl.transaction [None req-c63b1acc-b5c6-4be8-9db9-04824fec27f2 None None] Running txn n=1 command(idx=13): QoSDelCommand(_result=None, switch=neutron-5066e001-05ee-4812-ba7f-98a035d8bd0a, conditions=[('direction', '=', 'to-lport'), ('priority', '=', 2002), ('match', '=', 'outport == "be7063e1-bd60-43c5-bc4e-91151583d1f2"')], if_exists=True) {{(pid=77618) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:44:19 l75lg1-v1 neutron-server[77618]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-d9d4969c-e9ae-4d76-91b0-9b7c8eb907b3 None None] Hash Ring: Node 4c6fc793-7f5a-456f-b4d6-6e5bd97592f2 (host: l75lg1-v1) handling event "update" for row 679aa185-9f77-4421-9a89-94a849c44601 (table: Port_Binding) {{(pid=77618) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:44:19 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-53cecb61-7023-41e4-a5ea-23b1eb02606a None None] Hash Ring: Node c89b3497-133e-4a5a-b67a-3310d2cb2485 (host: l75lg1-v1) handling event "update" for row 74f0f327-cc93-479c-856e-03f5c93a4345 (table: Logical_Router) {{(pid=77619) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:44:19 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-53cecb61-7023-41e4-a5ea-23b1eb02606a None None] Hash Ring: Node c89b3497-133e-4a5a-b67a-3310d2cb2485 (host: l75lg1-v1) handling event "create" for row 7865bf8d-0324-4ae5-a908-dc4b116a6b1c (table: Logical_Router_Port) {{(pid=77619) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:44:19 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-53cecb61-7023-41e4-a5ea-23b1eb02606a None None] Hash Ring: Node c89b3497-133e-4a5a-b67a-3310d2cb2485 (host: l75lg1-v1) handling event "create" for row 2fdb013d-2cbb-45a4-be4d-e9734f26d3e3 (table: Logical_Router_Static_Route) {{(pid=77619) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:44:19 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-53cecb61-7023-41e4-a5ea-23b1eb02606a None None] Hash Ring: Node c89b3497-133e-4a5a-b67a-3310d2cb2485 (host: l75lg1-v1) handling event "create" for row 9034017f-8e86-4b0f-bef9-e5009e28ef58 (table: Logical_Router_Static_Route) {{(pid=77619) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:44:19 l75lg1-v1 neutron-server[77618]: DEBUG ovsdbapp.backend.ovs_idl.event [None req-d9d4969c-e9ae-4d76-91b0-9b7c8eb907b3 None None] Matched UPDATE: PortBindingChassisEvent(events=('update',), table='Port_Binding', conditions=None, old_conditions=None), priority=20 to row=Port_Binding(parent_port=[], mac=['fa:16:3e:62:f4:51 172.24.4.236/24 2001:db8::d4/64'], chassis=[], options={'always-redirect': 'true', 'distributed-port': 'lrp-be7063e1-bd60-43c5-bc4e-91151583d1f2'}, type=chassisredirect, tag=[], requested_chassis=[], tunnel_key=3, up=[True], logical_port=cr-lrp-be7063e1-bd60-43c5-bc4e-91151583d1f2, gateway_chassis=[], encap=[], external_ids={'neutron:is_ext_gw': 'True', 'neutron:network_name': 'neutron-5066e001-05ee-4812-ba7f-98a035d8bd0a', 'neutron:revision_number': '6', 'neutron:router_name': '80c11046-4421-4321-813a-d46f0332997a', 'neutron:subnet_ids': 'cddf717c-a51e-4470-8ce9-c2ab09a80e38 6178146d-51fe-4ab8-9844-d8c72981438d'}, virtual_parent=[], nat_addresses=[], datapath=60c632e1-b161-4c7e-9282-f3cf8f40846d) old=Port_Binding(mac=['fa:16:3e:62:f4:51 172.24.4.236/24'], external_ids={'neutron:is_ext_gw': 'True', 'neutron:network_name': 'neutron-5066e001-05ee-4812-ba7f-98a035d8bd0a', 'neutron:revision_number': '1', 'neutron:router_name': '80c11046-4421-4321-813a-d46f0332997a', 'neutron:subnet_ids': 'cddf717c-a51e-4470-8ce9-c2ab09a80e38'}) {{(pid=77618) matches /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} May 28 12:44:19 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-53cecb61-7023-41e4-a5ea-23b1eb02606a None None] Hash Ring: Node c89b3497-133e-4a5a-b67a-3310d2cb2485 (host: l75lg1-v1) handling event "delete" for row b727135f-432b-4fa8-8e31-67b584e89d25 (table: Logical_Router_Static_Route) {{(pid=77619) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:44:19 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-53cecb61-7023-41e4-a5ea-23b1eb02606a None None] Hash Ring: Node c89b3497-133e-4a5a-b67a-3310d2cb2485 (host: l75lg1-v1) handling event "update" for row c100b146-635b-4ec8-a4a1-ddbd59917880 (table: Logical_Switch_Port) {{(pid=77619) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:44:19 l75lg1-v1 neutron-server[77618]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-d9d4969c-e9ae-4d76-91b0-9b7c8eb907b3 None None] Hash Ring: Node 4c6fc793-7f5a-456f-b4d6-6e5bd97592f2 (host: l75lg1-v1) handling event "update" for row 6a4b9989-5e7d-4652-8a02-ebd03d6100c1 (table: Port_Binding) {{(pid=77618) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:44:19 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-53cecb61-7023-41e4-a5ea-23b1eb02606a None None] Hash Ring: Node c89b3497-133e-4a5a-b67a-3310d2cb2485 (host: l75lg1-v1) handling event "create" for row cfba3d50-d07e-4e64-8e22-3f16c2d77739 (table: NAT) {{(pid=77619) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:44:19 l75lg1-v1 neutron-server[77618]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-52bb25b6-e201-48e8-b427-2e1e387fb2e6 None None] Router 80c11046-4421-4321-813a-d46f0332997a is bound to host l75lg1-v1 May 28 12:44:19 l75lg1-v1 neutron-server[77618]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-c63b1acc-b5c6-4be8-9db9-04824fec27f2 None None] Hash Ring: Node 4c6fc793-7f5a-456f-b4d6-6e5bd97592f2 (host: l75lg1-v1) handling event "delete" for row 649d2f2b-ffef-4277-be4f-6d5097f8bc85 (table: Logical_Router_Port) {{(pid=77618) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:44:19 l75lg1-v1 neutron-server[77618]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-c63b1acc-b5c6-4be8-9db9-04824fec27f2 None None] Hash Ring: Node 4c6fc793-7f5a-456f-b4d6-6e5bd97592f2 (host: l75lg1-v1) handling event "delete" for row 3eae541e-4f81-456d-9453-a5dd990bd96e (table: NAT) {{(pid=77618) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:44:19 l75lg1-v1 neutron-server[77618]: DEBUG neutron_lib.callbacks.manager [None req-52bb25b6-e201-48e8-b427-2e1e387fb2e6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1015114', 'neutron.services.ovn_l3.plugin.OVNL3RouterPlugin._port_update-8754901907784', 'neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_internal_ip_change_for_fip-8754903031884'] for port (be7063e1-bd60-43c5-bc4e-91151583d1f2), before_update {{(pid=77618) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:44:19 l75lg1-v1 neutron-server[77618]: INFO neutron.db.ovn_revision_numbers_db [None req-4feaa811-f823-4f23-a948-967c1422d687 admin admin] Successfully bumped revision number for resource 80c11046-4421-4321-813a-d46f0332997a (type: routers) to 4 May 28 12:44:19 l75lg1-v1 neutron-server[77618]: DEBUG neutron.plugins.ml2.db [None req-52bb25b6-e201-48e8-b427-2e1e387fb2e6 None None] For port be7063e1-bd60-43c5-bc4e-91151583d1f2, host l75lg1-v1, got binding levels [PortBindingLevel(driver='ovn',host='l75lg1-v1',level=0,port_id=be7063e1-bd60-43c5-bc4e-91151583d1f2,segment=NetworkSegment(3385f5f9-bbb0-40f0-9631-6fb158c3207c),segment_id=3385f5f9-bbb0-40f0-9631-6fb158c3207c)] {{(pid=77618) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} May 28 12:44:19 l75lg1-v1 neutron-server[77618]: INFO neutron.db.ovn_revision_numbers_db [None req-4feaa811-f823-4f23-a948-967c1422d687 admin admin] Successfully bumped revision number for resource be7063e1-bd60-43c5-bc4e-91151583d1f2 (type: router_ports) to 6 May 28 12:44:19 l75lg1-v1 neutron-server[77618]: DEBUG neutron.db.ovn_revision_numbers_db [None req-4feaa811-f823-4f23-a948-967c1422d687 admin admin] delete_revision(be7063e1-bd60-43c5-bc4e-91151583d1f2) {{(pid=77618) delete_revision /opt/stack/neutron/neutron/db/ovn_revision_numbers_db.py:122}} May 28 12:44:19 l75lg1-v1 neutron-server[77618]: DEBUG neutron_lib.callbacks.manager [None req-52bb25b6-e201-48e8-b427-2e1e387fb2e6 None None] Publish callbacks [] for port (be7063e1-bd60-43c5-bc4e-91151583d1f2), precommit_update {{(pid=77618) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:44:19 l75lg1-v1 neutron-server[77618]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver [None req-52bb25b6-e201-48e8-b427-2e1e387fb2e6 None None] No provisioning block for port be7063e1-bd60-43c5-bc4e-91151583d1f2 since it is active {{(pid=77618) _is_port_provisioning_required /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/mech_driver.py:715}} May 28 12:44:19 l75lg1-v1 neutron-server[77618]: DEBUG neutron_lib.callbacks.manager [None req-4feaa811-f823-4f23-a948-967c1422d687 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4166501'] for subnet (6178146d-51fe-4ab8-9844-d8c72981438d), after_create {{(pid=77618) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:44:19 l75lg1-v1 neutron-server[77618]: INFO neutron.db.ovn_revision_numbers_db [None req-4feaa811-f823-4f23-a948-967c1422d687 admin admin] Successfully bumped revision number for resource 6178146d-51fe-4ab8-9844-d8c72981438d (type: subnets) to 0 May 28 12:44:19 l75lg1-v1 neutron-server[77618]: INFO neutron.tests.unit.plugins.ml2.drivers.mechanism_logger [None req-4feaa811-f823-4f23-a948-967c1422d687 admin admin] create_subnet_postcommit called with subnet settings {'id': '6178146d-51fe-4ab8-9844-d8c72981438d', 'name': 'ipv6-public-subnet', 'tenant_id': 'ea8d517cde1d40bb82c97e080ce071f7', 'network_id': '5066e001-05ee-4812-ba7f-98a035d8bd0a', 'ip_version': 6, 'subnetpool_id': None, 'enable_dhcp': False, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'standard_attr_id': 30, 'gateway_ip': '2001:db8::2', 'cidr': '2001:db8::/64', 'allocation_pools': [{'start': '2001:db8::1', 'end': '2001:db8::1'}, {'start': '2001:db8::3', 'end': '2001:db8::ffff:ffff:ffff:ffff'}], 'host_routes': [], 'dns_nameservers': [], 'shared': False, 'description': '', 'service_types': [], 'tags': [], 'created_at': '2024-05-28T12:44:17Z', 'updated_at': '2024-05-28T12:44:17Z', 'revision_number': 0, 'project_id': 'ea8d517cde1d40bb82c97e080ce071f7', 'network': {'id': '5066e001-05ee-4812-ba7f-98a035d8bd0a', 'name': 'public', 'tenant_id': 'ea8d517cde1d40bb82c97e080ce071f7', 'admin_state_up': True, 'mtu': 1500, 'status': 'ACTIVE', 'subnets': ['6178146d-51fe-4ab8-9844-d8c72981438d', 'cddf717c-a51e-4470-8ce9-c2ab09a80e38'], 'standard_attr_id': 23, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': True, 'vlan_transparent': None, 'description': '', 'port_security_enabled': True, 'is_default': True, 'tags': [], 'created_at': '2024-05-28T12:43:59Z', 'updated_at': '2024-05-28T12:44:17Z', 'revision_number': 3, 'project_id': 'ea8d517cde1d40bb82c97e080ce071f7', 'provider:network_type': 'flat', 'provider:physical_network': 'public', 'provider:segmentation_id': None}} (original settings None) May 28 12:44:19 l75lg1-v1 neutron-server[77618]: DEBUG neutron.tests.unit.plugins.ml2.drivers.mechanism_logger [None req-4feaa811-f823-4f23-a948-967c1422d687 admin admin] create_subnet_postcommit: May 28 12:44:19 l75lg1-v1 neutron-server[77618]: key[tenant_id], None -> ea8d517cde1d40bb82c97e080ce071f7 May 28 12:44:19 l75lg1-v1 neutron-server[77618]: key[network_id], None -> 5066e001-05ee-4812-ba7f-98a035d8bd0a May 28 12:44:19 l75lg1-v1 neutron-server[77618]: key[revision_number], None -> 0 May 28 12:44:19 l75lg1-v1 neutron-server[77618]: key[project_id], None -> ea8d517cde1d40bb82c97e080ce071f7 May 28 12:44:19 l75lg1-v1 neutron-server[77618]: key[id], None -> 6178146d-51fe-4ab8-9844-d8c72981438d May 28 12:44:19 l75lg1-v1 neutron-server[77618]: key[tags], None -> [] May 28 12:44:19 l75lg1-v1 neutron-server[77618]: key[created_at], None -> 2024-05-28T12:44:17Z May 28 12:44:19 l75lg1-v1 neutron-server[77618]: key[allocation_pools], None -> [{'start': '2001:db8::1', 'end': '2001:db8::1'}, {'start': '2001:db8::3', 'end': '2001:db8::ffff:ffff:ffff:ffff'}] May 28 12:44:19 l75lg1-v1 neutron-server[77618]: key[subnetpool_id], None -> None May 28 12:44:19 l75lg1-v1 neutron-server[77618]: key[host_routes], None -> [] May 28 12:44:19 l75lg1-v1 neutron-server[77618]: key[gateway_ip], None -> 2001:db8::2 May 28 12:44:19 l75lg1-v1 neutron-server[77618]: key[service_types], None -> [] May 28 12:44:19 l75lg1-v1 neutron-server[77618]: key[updated_at], None -> 2024-05-28T12:44:17Z May 28 12:44:19 l75lg1-v1 neutron-server[77618]: key[network], None -> {'id': '5066e001-05ee-4812-ba7f-98a035d8bd0a', 'name': 'public', 'tenant_id': 'ea8d517cde1d40bb82c97e080ce071f7', 'admin_state_up': True, 'mtu': 1500, 'status': 'ACTIVE', 'subnets': ['6178146d-51fe-4ab8-9844-d8c72981438d', 'cddf717c-a51e-4470-8ce9-c2ab09a80e38'], 'standard_attr_id': 23, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': True, 'vlan_transparent': None, 'description': '', 'port_security_enabled': True, 'is_default': True, 'tags': [], 'created_at': '2024-05-28T12:43:59Z', 'updated_at': '2024-05-28T12:44:17Z', 'revision_number': 3, 'project_id': 'ea8d517cde1d40bb82c97e080ce071f7', 'provider:network_type': 'flat', 'provider:physical_network': 'public', 'provider:segmentation_id': None} May 28 12:44:19 l75lg1-v1 neutron-server[77618]: key[standard_attr_id], None -> 30 May 28 12:44:19 l75lg1-v1 neutron-server[77618]: key[ip_version], None -> 6 May 28 12:44:19 l75lg1-v1 neutron-server[77618]: key[cidr], None -> 2001:db8::/64 May 28 12:44:19 l75lg1-v1 neutron-server[77618]: key[dns_nameservers], None -> [] May 28 12:44:19 l75lg1-v1 neutron-server[77618]: key[ipv6_address_mode], None -> None May 28 12:44:19 l75lg1-v1 neutron-server[77618]: key[description], None -> May 28 12:44:19 l75lg1-v1 neutron-server[77618]: key[ipv6_ra_mode], None -> None May 28 12:44:19 l75lg1-v1 neutron-server[77618]: key[enable_dhcp], None -> False May 28 12:44:19 l75lg1-v1 neutron-server[77618]: key[shared], None -> False May 28 12:44:19 l75lg1-v1 neutron-server[77618]: key[name], None -> ipv6-public-subnet May 28 12:44:19 l75lg1-v1 neutron-server[77618]: {{(pid=77618) _log_diff_call /opt/stack/neutron/neutron/tests/unit/plugins/ml2/drivers/mechanism_logger.py:59}} May 28 12:44:19 l75lg1-v1 neutron-server[77618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4feaa811-f823-4f23-a948-967c1422d687 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=77618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:258}} May 28 12:44:19 l75lg1-v1 neutron-server[77618]: DEBUG neutron_lib.callbacks.manager [None req-4feaa811-f823-4f23-a948-967c1422d687 admin admin] Publish callbacks [] for subnet (None), before_response {{(pid=77618) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:44:19 l75lg1-v1 neutron-server[77618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4feaa811-f823-4f23-a948-967c1422d687 admin admin] Pushing event updated for resources: {'Subnet': ['ID=6178146d-51fe-4ab8-9844-d8c72981438d,revision_number=0']} {{(pid=77618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 28 12:44:20 l75lg1-v1 neutron-server[77618]: INFO neutron.tests.unit.plugins.ml2.drivers.mechanism_logger [None req-52bb25b6-e201-48e8-b427-2e1e387fb2e6 None None] update_port_precommit called with port settings {'id': 'be7063e1-bd60-43c5-bc4e-91151583d1f2', 'name': '', 'network_id': '5066e001-05ee-4812-ba7f-98a035d8bd0a', 'tenant_id': '', 'mac_address': 'fa:16:3e:62:f4:51', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '80c11046-4421-4321-813a-d46f0332997a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 28, 'fixed_ips': [{'subnet_id': 'cddf717c-a51e-4470-8ce9-c2ab09a80e38', 'ip_address': '172.24.4.236'}, {'subnet_id': '6178146d-51fe-4ab8-9844-d8c72981438d', 'ip_address': '2001:db8::d4'}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'l75lg1-v1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'port_filter': True, 'connectivity': 'l2', 'bridge_name': 'br-int', 'datapath_type': 'system'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2024-05-28T12:44:08Z', 'updated_at': '2024-05-28T12:44:18Z', 'revision_number': 6, 'project_id': ''} (original settings {'id': 'be7063e1-bd60-43c5-bc4e-91151583d1f2', 'name': '', 'network_id': '5066e001-05ee-4812-ba7f-98a035d8bd0a', 'tenant_id': '', 'mac_address': 'fa:16:3e:62:f4:51', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '80c11046-4421-4321-813a-d46f0332997a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 28, 'fixed_ips': [{'subnet_id': 'cddf717c-a51e-4470-8ce9-c2ab09a80e38', 'ip_address': '172.24.4.236'}, {'subnet_id': '6178146d-51fe-4ab8-9844-d8c72981438d', 'ip_address': '2001:db8::d4'}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'l75lg1-v1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'port_filter': True, 'connectivity': 'l2', 'bridge_name': 'br-int', 'datapath_type': 'system', 'bound_drivers': {'0': 'ovn'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2024-05-28T12:44:08Z', 'updated_at': '2024-05-28T12:44:18Z', 'revision_number': 6, 'project_id': ''}) host l75lg1-v1 (original host l75lg1-v1) vif type ovs (original vif type ovs) vif details {'port_filter': True, 'connectivity': 'l2', 'bridge_name': 'br-int', 'datapath_type': 'system'} (original vif details {'port_filter': True, 'connectivity': 'l2', 'bridge_name': 'br-int', 'datapath_type': 'system'}) binding levels [{'bound_driver': 'ovn', 'bound_segment': {'id': '3385f5f9-bbb0-40f0-9631-6fb158c3207c', 'network_type': 'flat', 'physical_network': 'public', 'segmentation_id': None, 'network_id': '5066e001-05ee-4812-ba7f-98a035d8bd0a'}}] (original binding levels [{'bound_driver': 'ovn', 'bound_segment': {'id': '3385f5f9-bbb0-40f0-9631-6fb158c3207c', 'network_type': 'flat', 'physical_network': 'public', 'segmentation_id': None, 'network_id': '5066e001-05ee-4812-ba7f-98a035d8bd0a'}}]) on network {'id': '5066e001-05ee-4812-ba7f-98a035d8bd0a', 'name': 'public', 'tenant_id': 'ea8d517cde1d40bb82c97e080ce071f7', 'admin_state_up': True, 'mtu': 1500, 'status': 'ACTIVE', 'subnets': ['6178146d-51fe-4ab8-9844-d8c72981438d', 'cddf717c-a51e-4470-8ce9-c2ab09a80e38'], 'standard_attr_id': 23, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': True, 'vlan_transparent': None, 'description': '', 'port_security_enabled': True, 'is_default': True, 'tags': [], 'created_at': '2024-05-28T12:43:59Z', 'updated_at': '2024-05-28T12:44:17Z', 'revision_number': 3, 'project_id': 'ea8d517cde1d40bb82c97e080ce071f7', 'provider:network_type': 'flat', 'provider:physical_network': 'public', 'provider:segmentation_id': None} with segments to bind None May 28 12:44:20 l75lg1-v1 neutron-server[77618]: DEBUG neutron.tests.unit.plugins.ml2.drivers.mechanism_logger [None req-52bb25b6-e201-48e8-b427-2e1e387fb2e6 None None] update_port_precommit: May 28 12:44:20 l75lg1-v1 neutron-server[77618]: key[binding:vif_details], {'port_filter': True, 'connectivity': 'l2', 'bridge_name': 'br-int', 'datapath_type': 'system', 'bound_drivers': {'0': 'ovn'}} -> {'port_filter': True, 'connectivity': 'l2', 'bridge_name': 'br-int', 'datapath_type': 'system'} May 28 12:44:20 l75lg1-v1 neutron-server[77618]: {{(pid=77618) _log_diff_call /opt/stack/neutron/neutron/tests/unit/plugins/ml2/drivers/mechanism_logger.py:59}} May 28 12:44:20 l75lg1-v1 neutron-server[77618]: DEBUG neutron_lib.callbacks.manager [None req-52bb25b6-e201-48e8-b427-2e1e387fb2e6 None None] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4166243', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8754903016533', 'neutron.services.ovn_l3.plugin.OVNL3RouterPlugin._port_update-8754901907784'] for port (be7063e1-bd60-43c5-bc4e-91151583d1f2), after_update {{(pid=77618) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:44:20 l75lg1-v1 neutron-server[77618]: INFO neutron.wsgi [None req-4feaa811-f823-4f23-a948-967c1422d687 admin admin] 10.27.203.238 "POST /networking/v2.0/subnets HTTP/1.1" status: 201 len: 889 time: 2.2950535 May 28 12:44:20 l75lg1-v1 neutron-server[77618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fa9fc383-e562-41d6-800a-87c14f51ba90 None None] Pushing event updated for resources: {'Port': ['ID=be7063e1-bd60-43c5-bc4e-91151583d1f2,revision_number=6']} {{(pid=77618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 28 12:44:20 l75lg1-v1 neutron-server[77618]: DEBUG ovsdbapp.backend.ovs_idl.transaction [None req-c63b1acc-b5c6-4be8-9db9-04824fec27f2 None None] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=be7063e1-bd60-43c5-bc4e-91151583d1f2, resource={'id': 'be7063e1-bd60-43c5-bc4e-91151583d1f2', 'name': '', 'network_id': '5066e001-05ee-4812-ba7f-98a035d8bd0a', 'tenant_id': '', 'mac_address': 'fa:16:3e:62:f4:51', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '80c11046-4421-4321-813a-d46f0332997a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 28, 'fixed_ips': [{'subnet_id': 'cddf717c-a51e-4470-8ce9-c2ab09a80e38', 'ip_address': '172.24.4.236'}, {'subnet_id': '6178146d-51fe-4ab8-9844-d8c72981438d', 'ip_address': '2001:db8::d4'}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'l75lg1-v1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'port_filter': True, 'connectivity': 'l2', 'bridge_name': 'br-int', 'datapath_type': 'system'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2024-05-28T12:44:08Z', 'updated_at': '2024-05-28T12:44:18Z', 'revision_number': 6, 'project_id': '', 'network': {'id': '5066e001-05ee-4812-ba7f-98a035d8bd0a', 'name': 'public', 'tenant_id': 'ea8d517cde1d40bb82c97e080ce071f7', 'admin_state_up': True, 'mtu': 1500, 'status': 'ACTIVE', 'subnets': ['6178146d-51fe-4ab8-9844-d8c72981438d', 'cddf717c-a51e-4470-8ce9-c2ab09a80e38'], 'standard_attr_id': 23, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': True, 'vlan_transparent': None, 'description': '', 'port_security_enabled': True, 'is_default': True, 'tags': [], 'created_at': '2024-05-28T12:43:59Z', 'updated_at': '2024-05-28T12:44:17Z', 'revision_number': 3, 'project_id': 'ea8d517cde1d40bb82c97e080ce071f7', 'provider:network_type': 'flat', 'provider:physical_network': 'public', 'provider:segmentation_id': None}}, resource_type=ports, if_exists=True) {{(pid=77618) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:44:20 l75lg1-v1 neutron-server[77618]: DEBUG ovsdbapp.backend.ovs_idl.transaction [None req-c63b1acc-b5c6-4be8-9db9-04824fec27f2 None None] Running txn n=1 command(idx=1): SetLSwitchPortCommand(_result=None, lport=be7063e1-bd60-43c5-bc4e-91151583d1f2, external_ids_update=None, columns={'external_ids': {'neutron:port_name': '', 'neutron:device_id': '80c11046-4421-4321-813a-d46f0332997a', 'neutron:project_id': '', 'neutron:cidrs': '172.24.4.236/24 2001:db8::d4/64', 'neutron:device_owner': 'network:router_gateway', 'neutron:subnet_pool_addr_scope4': '', 'neutron:subnet_pool_addr_scope6': '', 'neutron:network_name': 'neutron-5066e001-05ee-4812-ba7f-98a035d8bd0a', 'neutron:security_group_ids': '', 'neutron:revision_number': '6', 'neutron:vnic_type': 'normal', 'neutron:port_capabilities': '', 'neutron:mtu': '', 'neutron:host_id': 'l75lg1-v1'}, 'parent_name': [], 'tag': [], 'options': {'requested-chassis': 'l75lg1-v1', 'mcast_flood_reports': 'true', 'exclude-lb-vips-from-garp': 'true', 'nat-addresses': 'router', 'router-port': 'lrp-be7063e1-bd60-43c5-bc4e-91151583d1f2'}, 'enabled': True, 'port_security': [], 'dhcpv4_options': [], 'dhcpv6_options': [], 'type': 'router', 'ha_chassis_group': []}, if_exists=False) {{(pid=77618) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:44:20 l75lg1-v1 neutron-server[77618]: DEBUG ovsdbapp.backend.ovs_idl.transaction [None req-c63b1acc-b5c6-4be8-9db9-04824fec27f2 None None] Running txn n=1 command(idx=2): PgDelPortCommand(_result=None, port_group=neutron_pg_drop, lsp=['be7063e1-bd60-43c5-bc4e-91151583d1f2'], if_exists=False) {{(pid=77618) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:44:20 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-53cecb61-7023-41e4-a5ea-23b1eb02606a None None] Hash Ring: Node c89b3497-133e-4a5a-b67a-3310d2cb2485 (host: l75lg1-v1) handling event "update" for row c100b146-635b-4ec8-a4a1-ddbd59917880 (table: Logical_Switch_Port) {{(pid=77619) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:44:20 l75lg1-v1 neutron-server[77618]: INFO neutron.db.ovn_revision_numbers_db [None req-52bb25b6-e201-48e8-b427-2e1e387fb2e6 None None] Successfully bumped revision number for resource be7063e1-bd60-43c5-bc4e-91151583d1f2 (type: ports) to 6 May 28 12:44:20 l75lg1-v1 neutron-server[77618]: INFO neutron.tests.unit.plugins.ml2.drivers.mechanism_logger [None req-52bb25b6-e201-48e8-b427-2e1e387fb2e6 None None] update_port_postcommit called with port settings {'id': 'be7063e1-bd60-43c5-bc4e-91151583d1f2', 'name': '', 'network_id': '5066e001-05ee-4812-ba7f-98a035d8bd0a', 'tenant_id': '', 'mac_address': 'fa:16:3e:62:f4:51', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '80c11046-4421-4321-813a-d46f0332997a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 28, 'fixed_ips': [{'subnet_id': 'cddf717c-a51e-4470-8ce9-c2ab09a80e38', 'ip_address': '172.24.4.236'}, {'subnet_id': '6178146d-51fe-4ab8-9844-d8c72981438d', 'ip_address': '2001:db8::d4'}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'l75lg1-v1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'port_filter': True, 'connectivity': 'l2', 'bridge_name': 'br-int', 'datapath_type': 'system'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2024-05-28T12:44:08Z', 'updated_at': '2024-05-28T12:44:18Z', 'revision_number': 6, 'project_id': ''} (original settings {'id': 'be7063e1-bd60-43c5-bc4e-91151583d1f2', 'name': '', 'network_id': '5066e001-05ee-4812-ba7f-98a035d8bd0a', 'tenant_id': '', 'mac_address': 'fa:16:3e:62:f4:51', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '80c11046-4421-4321-813a-d46f0332997a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 28, 'fixed_ips': [{'subnet_id': 'cddf717c-a51e-4470-8ce9-c2ab09a80e38', 'ip_address': '172.24.4.236'}, {'subnet_id': '6178146d-51fe-4ab8-9844-d8c72981438d', 'ip_address': '2001:db8::d4'}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'l75lg1-v1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'port_filter': True, 'connectivity': 'l2', 'bridge_name': 'br-int', 'datapath_type': 'system', 'bound_drivers': {'0': 'ovn'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2024-05-28T12:44:08Z', 'updated_at': '2024-05-28T12:44:18Z', 'revision_number': 6, 'project_id': ''}) host l75lg1-v1 (original host l75lg1-v1) vif type ovs (original vif type ovs) vif details {'port_filter': True, 'connectivity': 'l2', 'bridge_name': 'br-int', 'datapath_type': 'system'} (original vif details {'port_filter': True, 'connectivity': 'l2', 'bridge_name': 'br-int', 'datapath_type': 'system'}) binding levels [{'bound_driver': 'ovn', 'bound_segment': {'id': '3385f5f9-bbb0-40f0-9631-6fb158c3207c', 'network_type': 'flat', 'physical_network': 'public', 'segmentation_id': None, 'network_id': '5066e001-05ee-4812-ba7f-98a035d8bd0a'}}] (original binding levels [{'bound_driver': 'ovn', 'bound_segment': {'id': '3385f5f9-bbb0-40f0-9631-6fb158c3207c', 'network_type': 'flat', 'physical_network': 'public', 'segmentation_id': None, 'network_id': '5066e001-05ee-4812-ba7f-98a035d8bd0a'}}]) on network {'id': '5066e001-05ee-4812-ba7f-98a035d8bd0a', 'name': 'public', 'tenant_id': 'ea8d517cde1d40bb82c97e080ce071f7', 'admin_state_up': True, 'mtu': 1500, 'status': 'ACTIVE', 'subnets': ['6178146d-51fe-4ab8-9844-d8c72981438d', 'cddf717c-a51e-4470-8ce9-c2ab09a80e38'], 'standard_attr_id': 23, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': True, 'vlan_transparent': None, 'description': '', 'port_security_enabled': True, 'is_default': True, 'tags': [], 'created_at': '2024-05-28T12:43:59Z', 'updated_at': '2024-05-28T12:44:17Z', 'revision_number': 3, 'project_id': 'ea8d517cde1d40bb82c97e080ce071f7', 'provider:network_type': 'flat', 'provider:physical_network': 'public', 'provider:segmentation_id': None} with segments to bind None May 28 12:44:20 l75lg1-v1 neutron-server[77618]: DEBUG neutron.tests.unit.plugins.ml2.drivers.mechanism_logger [None req-52bb25b6-e201-48e8-b427-2e1e387fb2e6 None None] update_port_postcommit: May 28 12:44:20 l75lg1-v1 neutron-server[77618]: key[binding:vif_details], {'port_filter': True, 'connectivity': 'l2', 'bridge_name': 'br-int', 'datapath_type': 'system', 'bound_drivers': {'0': 'ovn'}} -> {'port_filter': True, 'connectivity': 'l2', 'bridge_name': 'br-int', 'datapath_type': 'system'} May 28 12:44:20 l75lg1-v1 neutron-server[77618]: {{(pid=77618) _log_diff_call /opt/stack/neutron/neutron/tests/unit/plugins/ml2/drivers/mechanism_logger.py:59}} May 28 12:44:20 l75lg1-v1 dstat.sh[49771]: 28-05 12:44:20| 12 1 86 1 0|2775M 6724M 267M 5932M| 14k 2116B| 0 928k| 0 113 |3167 4741 |1.23 1.73 1.25|1.0 0 25| 0 0 | 0 2048M| 23 126 0 36 0 May 28 12:44:21 l75lg1-v1 dstat.sh[49771]: 28-05 12:44:21| 8 3 88 0 0|2819M 6680M 267M 5933M| 23k 12k| 0 572k| 0 35.0 |2498 2603 |1.23 1.73 1.25|1.0 0 139| 0 0 | 0 2048M| 23 126 0 36 0 May 28 12:44:21 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b234e4b5-bd2d-4f46-bbe8-dbce1bea211e None None] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:44:21 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b234e4b5-bd2d-4f46-bbe8-dbce1bea211e None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:44:21 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b234e4b5-bd2d-4f46-bbe8-dbce1bea211e None None] PATH_INFO: `/` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:44:21 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 453/921] 10.27.203.238 () {58 vars in 1014 bytes} [Tue May 28 12:44:21 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:44:21 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167ba572-2b20-4e2e-a3e6-2f1215f1638a None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:44:21 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167ba572-2b20-4e2e-a3e6-2f1215f1638a None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:44:21 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167ba572-2b20-4e2e-a3e6-2f1215f1638a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:44:21 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-167ba572-2b20-4e2e-a3e6-2f1215f1638a None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:44:21 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-167ba572-2b20-4e2e-a3e6-2f1215f1638a None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:44:21 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-167ba572-2b20-4e2e-a3e6-2f1215f1638a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:44:21 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 469/922] 10.27.203.238 () {62 vars in 1111 bytes} [Tue May 28 12:44:21 2024] POST /identity/v3/auth/tokens => generated 3990 bytes in 23 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:44:21 l75lg1-v1 neutron-server[77618]: WARNING neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_client [None req-5ba0b4eb-00ab-4523-a874-41c9965d7fce None None] No hosting information found for port 268e1eb8-0568-4553-9120-b5ec7ec1d878: RuntimeError: No hosting information found for port 268e1eb8-0568-4553-9120-b5ec7ec1d878 May 28 12:44:21 l75lg1-v1 neutron-server[77619]: DEBUG neutron.wsgi [-] (77619) accepted ('10.27.203.238', 50992) {{(pid=77619) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 12:44:21 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b234e4b5-bd2d-4f46-bbe8-dbce1bea211e None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:44:21 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b234e4b5-bd2d-4f46-bbe8-dbce1bea211e None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:44:21 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e95a20a-5efc-47d6-b346-f2061097ac70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef17047035e4b518fd5360a01f2da1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:44:21 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e95a20a-5efc-47d6-b346-f2061097ac70 service neutron] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:44:21 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e95a20a-5efc-47d6-b346-f2061097ac70 service neutron] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:44:21 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e95a20a-5efc-47d6-b346-f2061097ac70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:44:21 l75lg1-v1 neutron-server[77618]: DEBUG ovsdbapp.backend.ovs_idl.transaction [None req-c63b1acc-b5c6-4be8-9db9-04824fec27f2 None None] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=lrp-268e1eb8-0568-4553-9120-b5ec7ec1d878, resource={'id': '268e1eb8-0568-4553-9120-b5ec7ec1d878', 'name': '', 'network_id': 'fb218033-3d98-4065-b336-c595d5e6ca77', 'tenant_id': '95de88f6d26e4420bc466ba67668171f', 'mac_address': 'fa:16:3e:7c:1e:ba', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '80c11046-4421-4321-813a-d46f0332997a', 'device_owner': 'network:router_interface', 'standard_attr_id': 29, 'fixed_ips': [{'subnet_id': '799ded51-0b75-4f67-94e9-0a7ea3c3f3d6', 'ip_address': 'fd12:3562:78f7::1'}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2024-05-28T12:44:14Z', 'updated_at': '2024-05-28T12:44:15Z', 'revision_number': 2, 'project_id': '95de88f6d26e4420bc466ba67668171f'}, resource_type=router_ports, if_exists=True) {{(pid=77618) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:44:21 l75lg1-v1 neutron-server[77618]: DEBUG ovsdbapp.backend.ovs_idl.transaction [None req-c63b1acc-b5c6-4be8-9db9-04824fec27f2 None None] Running txn n=1 command(idx=1): UpdateLRouterPortCommand(_result=None, name=lrp-268e1eb8-0568-4553-9120-b5ec7ec1d878, columns={'external_ids': {'neutron:revision_number': '2', 'neutron:subnet_ids': '799ded51-0b75-4f67-94e9-0a7ea3c3f3d6', 'neutron:network_name': 'neutron-fb218033-3d98-4065-b336-c595d5e6ca77', 'neutron:is_ext_gw': 'False', 'neutron:router_name': '80c11046-4421-4321-813a-d46f0332997a'}, 'options': {}, 'networks': ['fd12:3562:78f7::1/64'], 'ipv6_ra_configs': {'address_mode': 'slaac', 'send_periodic': 'true', 'mtu': '1442'}}, if_exists=False) {{(pid=77618) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:44:21 l75lg1-v1 neutron-server[77618]: DEBUG ovsdbapp.backend.ovs_idl.transaction [None req-c63b1acc-b5c6-4be8-9db9-04824fec27f2 None None] Running txn n=1 command(idx=2): SetLRouterPortInLSwitchPortCommand(_result=None, lswitch_port=268e1eb8-0568-4553-9120-b5ec7ec1d878, lrouter_port=lrp-268e1eb8-0568-4553-9120-b5ec7ec1d878, is_gw_port=False, if_exists=True, lsp_address=router) {{(pid=77618) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:44:21 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e95a20a-5efc-47d6-b346-f2061097ac70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:44:21 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e95a20a-5efc-47d6-b346-f2061097ac70 service neutron] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:44:21 l75lg1-v1 neutron-server[77618]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-c63b1acc-b5c6-4be8-9db9-04824fec27f2 None None] Hash Ring: Node 4c6fc793-7f5a-456f-b4d6-6e5bd97592f2 (host: l75lg1-v1) handling event "update" for row 405f016e-4603-441b-92fc-b9d9f18fb4ba (table: Logical_Router_Port) {{(pid=77618) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:44:21 l75lg1-v1 neutron-server[77618]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-c63b1acc-b5c6-4be8-9db9-04824fec27f2 None None] Hash Ring: Node 4c6fc793-7f5a-456f-b4d6-6e5bd97592f2 (host: l75lg1-v1) handling event "update" for row 7539fd27-b5ba-421e-bfc6-56dd4f7cb100 (table: Logical_Switch_Port) {{(pid=77618) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:44:21 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-03b5f984-1478-4ad6-9838-8e34c1689c5b None None] Hash Ring: Node c89b3497-133e-4a5a-b67a-3310d2cb2485 (host: l75lg1-v1) handling event "update" for row 2439b35e-7a69-4257-b5ed-684f318177a4 (table: Port_Binding) {{(pid=77619) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:44:21 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 454/923] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 12:44:21 2024] GET /identity/v3/auth/tokens => generated 3990 bytes in 22 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 12:44:21 l75lg1-v1 neutron-server[77618]: DEBUG ovsdbapp.backend.ovs_idl.event [None req-c63b1acc-b5c6-4be8-9db9-04824fec27f2 None None] Matched UPDATE: LogicalSwitchPortUpdateLogicalRouterPortEvent(events=('update',), table='Logical_Switch_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Switch_Port(up=[True], name=268e1eb8-0568-4553-9120-b5ec7ec1d878, external_ids={'neutron:cidrs': 'fd12:3562:78f7::1/64', 'neutron:device_id': '80c11046-4421-4321-813a-d46f0332997a', 'neutron:device_owner': 'network:router_interface', 'neutron:mtu': '', 'neutron:network_name': 'neutron-fb218033-3d98-4065-b336-c595d5e6ca77', 'neutron:port_capabilities': '', 'neutron:port_name': '', 'neutron:project_id': '95de88f6d26e4420bc466ba67668171f', 'neutron:revision_number': '2', 'neutron:security_group_ids': '', 'neutron:subnet_pool_addr_scope4': '', 'neutron:subnet_pool_addr_scope6': '', 'neutron:vnic_type': 'normal'}, ha_chassis_group=[], options={'router-port': 'lrp-268e1eb8-0568-4553-9120-b5ec7ec1d878'}, parent_name=[], enabled=[True], type=router, dhcpv6_options=[], tag_request=[], port_security=[], addresses=['router'], dynamic_addresses=[], dhcpv4_options=[], tag=[]) old=Logical_Switch_Port(options={'router-port': 'lrp-268e1eb8-0568-4553-9120-b5ec7ec1d878', 'mcast_flood_reports': 'true'}) {{(pid=77618) matches /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} May 28 12:44:21 l75lg1-v1 neutron-server[77619]: INFO neutron.wsgi [None req-fc02ae6f-bab9-4e49-a87a-3f9ff6b3a835 demo admin] 10.27.203.238 "GET /networking/v2.0/routers/80c11046-4421-4321-813a-d46f0332997a HTTP/1.1" status: 200 len: 1291 time: 0.1050565 May 28 12:44:21 l75lg1-v1 neutron-server[77618]: INFO neutron.db.ovn_revision_numbers_db [None req-5ba0b4eb-00ab-4523-a874-41c9965d7fce None None] Successfully bumped revision number for resource 268e1eb8-0568-4553-9120-b5ec7ec1d878 (type: router_ports) to 2 May 28 12:44:22 l75lg1-v1 neutron-server[77619]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2ffc2821-933e-431f-bb07-97b32be489b9 demo admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=77619) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:258}} May 28 12:44:22 l75lg1-v1 neutron-server[77619]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2ffc2821-933e-431f-bb07-97b32be489b9 demo admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=77619) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:258}} May 28 12:44:22 l75lg1-v1 neutron-server[77619]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2ffc2821-933e-431f-bb07-97b32be489b9 demo admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=77619) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:258}} May 28 12:44:22 l75lg1-v1 neutron-server[77619]: INFO neutron.wsgi [None req-2ffc2821-933e-431f-bb07-97b32be489b9 demo admin] 10.27.203.238 "GET /networking/v2.0/ports?device_id=80c11046-4421-4321-813a-d46f0332997a HTTP/1.1" status: 200 len: 2770 time: 0.0847640 May 28 12:44:22 l75lg1-v1 neutron-server[77618]: DEBUG ovsdbapp.backend.ovs_idl.transaction [None req-c63b1acc-b5c6-4be8-9db9-04824fec27f2 None None] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=lrp-268e1eb8-0568-4553-9120-b5ec7ec1d878, resource={'id': '268e1eb8-0568-4553-9120-b5ec7ec1d878', 'name': '', 'network_id': 'fb218033-3d98-4065-b336-c595d5e6ca77', 'tenant_id': '95de88f6d26e4420bc466ba67668171f', 'mac_address': 'fa:16:3e:7c:1e:ba', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '80c11046-4421-4321-813a-d46f0332997a', 'device_owner': 'network:router_interface', 'standard_attr_id': 29, 'fixed_ips': [{'subnet_id': '799ded51-0b75-4f67-94e9-0a7ea3c3f3d6', 'ip_address': 'fd12:3562:78f7::1'}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2024-05-28T12:44:14Z', 'updated_at': '2024-05-28T12:44:15Z', 'revision_number': 2, 'project_id': '95de88f6d26e4420bc466ba67668171f'}, resource_type=router_ports, if_exists=True) {{(pid=77618) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:44:22 l75lg1-v1 neutron-server[77618]: DEBUG ovsdbapp.backend.ovs_idl.transaction [None req-c63b1acc-b5c6-4be8-9db9-04824fec27f2 None None] Running txn n=1 command(idx=1): UpdateLRouterPortCommand(_result=None, name=lrp-268e1eb8-0568-4553-9120-b5ec7ec1d878, columns={'external_ids': {'neutron:revision_number': '2', 'neutron:subnet_ids': '799ded51-0b75-4f67-94e9-0a7ea3c3f3d6', 'neutron:network_name': 'neutron-fb218033-3d98-4065-b336-c595d5e6ca77', 'neutron:is_ext_gw': 'False', 'neutron:router_name': '80c11046-4421-4321-813a-d46f0332997a'}, 'options': {}, 'networks': ['fd12:3562:78f7::1/64'], 'ipv6_ra_configs': {'address_mode': 'slaac', 'send_periodic': 'true', 'mtu': '1442'}}, if_exists=False) {{(pid=77618) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:44:22 l75lg1-v1 neutron-server[77618]: DEBUG ovsdbapp.backend.ovs_idl.transaction [None req-c63b1acc-b5c6-4be8-9db9-04824fec27f2 None None] Running txn n=1 command(idx=2): SetLRouterPortInLSwitchPortCommand(_result=None, lswitch_port=268e1eb8-0568-4553-9120-b5ec7ec1d878, lrouter_port=lrp-268e1eb8-0568-4553-9120-b5ec7ec1d878, is_gw_port=False, if_exists=True, lsp_address=router) {{(pid=77618) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:44:22 l75lg1-v1 neutron-server[77618]: DEBUG ovsdbapp.backend.ovs_idl.transaction [None req-c63b1acc-b5c6-4be8-9db9-04824fec27f2 None None] Transaction caused no change {{(pid=77618) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} May 28 12:44:22 l75lg1-v1 neutron-server[77618]: DEBUG ovsdbapp.backend.ovs_idl.transaction [None req-c63b1acc-b5c6-4be8-9db9-04824fec27f2 None None] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=lrp-268e1eb8-0568-4553-9120-b5ec7ec1d878, resource={'id': '268e1eb8-0568-4553-9120-b5ec7ec1d878', 'name': '', 'network_id': 'fb218033-3d98-4065-b336-c595d5e6ca77', 'tenant_id': '95de88f6d26e4420bc466ba67668171f', 'mac_address': 'fa:16:3e:7c:1e:ba', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '80c11046-4421-4321-813a-d46f0332997a', 'device_owner': 'network:router_interface', 'standard_attr_id': 29, 'fixed_ips': [{'subnet_id': '799ded51-0b75-4f67-94e9-0a7ea3c3f3d6', 'ip_address': 'fd12:3562:78f7::1'}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2024-05-28T12:44:14Z', 'updated_at': '2024-05-28T12:44:15Z', 'revision_number': 2, 'project_id': '95de88f6d26e4420bc466ba67668171f'}, resource_type=router_ports, if_exists=True) {{(pid=77618) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:44:22 l75lg1-v1 neutron-server[77618]: DEBUG ovsdbapp.backend.ovs_idl.transaction [None req-c63b1acc-b5c6-4be8-9db9-04824fec27f2 None None] Running txn n=1 command(idx=1): UpdateLRouterPortCommand(_result=None, name=lrp-268e1eb8-0568-4553-9120-b5ec7ec1d878, columns={'external_ids': {'neutron:revision_number': '2', 'neutron:subnet_ids': '799ded51-0b75-4f67-94e9-0a7ea3c3f3d6', 'neutron:network_name': 'neutron-fb218033-3d98-4065-b336-c595d5e6ca77', 'neutron:is_ext_gw': 'False', 'neutron:router_name': '80c11046-4421-4321-813a-d46f0332997a'}, 'options': {}, 'networks': ['fd12:3562:78f7::1/64'], 'ipv6_ra_configs': {'address_mode': 'slaac', 'send_periodic': 'true', 'mtu': '1442'}}, if_exists=False) {{(pid=77618) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:44:22 l75lg1-v1 neutron-server[77618]: DEBUG ovsdbapp.backend.ovs_idl.transaction [None req-c63b1acc-b5c6-4be8-9db9-04824fec27f2 None None] Running txn n=1 command(idx=2): SetLRouterPortInLSwitchPortCommand(_result=None, lswitch_port=268e1eb8-0568-4553-9120-b5ec7ec1d878, lrouter_port=lrp-268e1eb8-0568-4553-9120-b5ec7ec1d878, is_gw_port=False, if_exists=True, lsp_address=router) {{(pid=77618) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:44:22 l75lg1-v1 neutron-server[77618]: DEBUG ovsdbapp.backend.ovs_idl.transaction [None req-c63b1acc-b5c6-4be8-9db9-04824fec27f2 None None] Transaction caused no change {{(pid=77618) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} May 28 12:44:22 l75lg1-v1 dstat.sh[49771]: 28-05 12:44:22| 14 1 84 0 0|2780M 6719M 267M 5933M| 14k 1058B| 0 512k| 0 49.0 |2359 3127 |1.21 1.72 1.25|1.0 0 8.0| 0 0 | 0 2048M| 23 126 0 37 0 May 28 12:44:23 l75lg1-v1 dstat.sh[49771]: 28-05 12:44:23| 4 8 87 0 0|2805M 6693M 267M 5933M| 21k 25k| 0 552k| 0 40.0 |5815 7136 |1.21 1.72 1.25|2.0 0 428| 0 0 | 0 2048M| 23 126 0 36 0 May 28 12:44:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "_check_child_processes" by "neutron.agent.linux.external_process.ProcessMonitor._check_child_processes" {{(pid=76818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:44:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_concurrency.lockutils [-] Lock "_check_child_processes" acquired by "neutron.agent.linux.external_process.ProcessMonitor._check_child_processes" :: waited 0.001s {{(pid=76818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:44:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_concurrency.lockutils [-] Lock "_check_child_processes" "released" by "neutron.agent.linux.external_process.ProcessMonitor._check_child_processes" :: held 0.000s {{(pid=76818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:44:24 l75lg1-v1 dstat.sh[49771]: 28-05 12:44:24| 11 6 81 0 0|2816M 6682M 267M 5933M| 15k 9815B| 136k 3114k|34.0 385 |7428 11k|1.21 1.72 1.25|2.0 0 212| 0 0 | 0 2048M| 23 126 0 37 0 May 28 12:44:25 l75lg1-v1 dstat.sh[49771]: 28-05 12:44:25| 13 10 75 1 0|2857M 6641M 267M 5933M| 19k 16k| 68k 1696k|17.0 120 |6646 8936 |1.21 1.72 1.25|1.0 0 398| 0 0 | 0 2048M| 23 126 0 32 0 May 28 12:44:25 l75lg1-v1 devstack@n-api-meta.service[80875]: [uWSGI] getting INI configuration from /etc/nova/nova-metadata-uwsgi.ini May 28 12:44:25 l75lg1-v1 devstack@n-api-meta.service[80875]: *** Starting uWSGI 2.0.20-debian (64bit) on [Tue May 28 12:44:25 2024] *** May 28 12:44:25 l75lg1-v1 devstack@n-api-meta.service[80875]: compiled with version: 11.2.0 on 21 March 2022 11:00:44 May 28 12:44:25 l75lg1-v1 devstack@n-api-meta.service[80875]: os: Linux-5.15.0-56-generic #62-Ubuntu SMP Tue Nov 22 19:54:14 UTC 2022 May 28 12:44:25 l75lg1-v1 devstack@n-api-meta.service[80875]: nodename: l75lg1-v1 May 28 12:44:25 l75lg1-v1 devstack@n-api-meta.service[80875]: machine: x86_64 May 28 12:44:25 l75lg1-v1 devstack@n-api-meta.service[80875]: clock source: unix May 28 12:44:25 l75lg1-v1 devstack@n-api-meta.service[80875]: pcre jit disabled May 28 12:44:25 l75lg1-v1 devstack@n-api-meta.service[80875]: detected number of CPU cores: 10 May 28 12:44:25 l75lg1-v1 devstack@n-api-meta.service[80875]: current working directory: / May 28 12:44:25 l75lg1-v1 devstack@n-api-meta.service[80875]: detected binary path: /usr/bin/uwsgi-core May 28 12:44:25 l75lg1-v1 devstack@n-api-meta.service[80875]: your processes number limit is 63557 May 28 12:44:25 l75lg1-v1 devstack@n-api-meta.service[80875]: your memory page size is 4096 bytes May 28 12:44:25 l75lg1-v1 devstack@n-api-meta.service[80875]: detected max file descriptor number: 2048 May 28 12:44:25 l75lg1-v1 devstack@n-api-meta.service[80875]: lock engine: pthread robust mutexes May 28 12:44:25 l75lg1-v1 devstack@n-api-meta.service[80875]: thunder lock: enabled May 28 12:44:25 l75lg1-v1 devstack@n-api-meta.service[80875]: uWSGI http bound on 0.0.0.0:8775 fd 5 May 28 12:44:25 l75lg1-v1 devstack@n-api-meta.service[80875]: uwsgi socket 0 bound to TCP address 127.0.0.1:35727 (port auto-assigned) fd 4 May 28 12:44:25 l75lg1-v1 devstack@n-api-meta.service[80875]: Python version: 3.10.12 (main, Nov 20 2023, 15:14:05) [GCC 11.4.0] May 28 12:44:25 l75lg1-v1 devstack@n-api-meta.service[80875]: PEP 405 virtualenv detected: /opt/stack/data/venv May 28 12:44:25 l75lg1-v1 devstack@n-api-meta.service[80875]: Set PythonHome to /opt/stack/data/venv May 28 12:44:26 l75lg1-v1 devstack@n-api-meta.service[80875]: Python main interpreter initialized at 0x56486b783280 May 28 12:44:26 l75lg1-v1 devstack@n-api-meta.service[80875]: python threads support enabled May 28 12:44:26 l75lg1-v1 devstack@n-api-meta.service[80875]: your server socket listen backlog is limited to 100 connections May 28 12:44:26 l75lg1-v1 devstack@n-api-meta.service[80875]: your mercy for graceful operations on workers is 80 seconds May 28 12:44:26 l75lg1-v1 devstack@n-api-meta.service[80875]: mapped 403077 bytes (393 KB) for 2 cores May 28 12:44:26 l75lg1-v1 devstack@n-api-meta.service[80875]: *** Operational MODE: preforking *** May 28 12:44:26 l75lg1-v1 devstack@n-api-meta.service[80875]: *** uWSGI is running in multiple interpreter mode *** May 28 12:44:26 l75lg1-v1 devstack@n-api-meta.service[80875]: spawned uWSGI master process (pid: 80875) May 28 12:44:26 l75lg1-v1 devstack@n-api-meta.service[80875]: spawned uWSGI worker 1 (pid: 80876, cores: 1) May 28 12:44:26 l75lg1-v1 devstack@n-api-meta.service[80875]: spawned uWSGI worker 2 (pid: 80877, cores: 1) May 28 12:44:26 l75lg1-v1 devstack@n-api-meta.service[80875]: spawned uWSGI http 1 (pid: 80878) May 28 12:44:26 l75lg1-v1 devstack@n-api-meta.service[80875]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 28 12:44:26 l75lg1-v1 dstat.sh[49771]: 28-05 12:44:26| 20 5 74 0 0|2924M 6574M 267M 5933M| 16k 8505B| 68k 200k|17.0 15.0 |6366 8069 |1.21 1.72 1.25|4.0 0 138| 0 0 | 0 2048M| 25 126 0 32 0 May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: INFO oslo_service.periodic_task [-] Skipping periodic task _discover_hosts_in_cells because its interval is negative May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: INFO dbcounter [None req-59aa5784-508c-4977-aa75-62b190a37bec None None] Registered counter for database nova_api May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_db.sqlalchemy.engines [None req-59aa5784-508c-4977-aa75-62b190a37bec None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80330) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:342}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG dbcounter [-] [80330] Writer thread running {{(pid=80330) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG nova.scheduler.host_manager [None req-59aa5784-508c-4977-aa75-62b190a37bec None None] Found 1 cells: 07f8d545-d202-434b-a916-12ac42ffae61 {{(pid=80330) refresh_cells_caches /opt/stack/nova/nova/scheduler/host_manager.py:746}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG nova.scheduler.host_manager [None req-59aa5784-508c-4977-aa75-62b190a37bec None None] Found 0 disabled cells: {{(pid=80330) refresh_cells_caches /opt/stack/nova/nova/scheduler/host_manager.py:758}} May 28 12:44:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c585c4-3a4d-4976-9650-427d7dff8d7e None None] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:44:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c585c4-3a4d-4976-9650-427d7dff8d7e None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:44:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c585c4-3a4d-4976-9650-427d7dff8d7e None None] PATH_INFO: `/` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:44:26 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 470/924] 10.27.203.238 () {58 vars in 1010 bytes} [Tue May 28 12:44:26 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:44:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b203d3f0-0631-4497-868f-10872dcfec18 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:44:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b203d3f0-0631-4497-868f-10872dcfec18 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:44:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b203d3f0-0631-4497-868f-10872dcfec18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:44:26 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-b203d3f0-0631-4497-868f-10872dcfec18 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:44:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-b203d3f0-0631-4497-868f-10872dcfec18 None None] MFA Rules not processed for user `c3fe870f285d4169bd917382dd02d7b0`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:44:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-b203d3f0-0631-4497-868f-10872dcfec18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:44:26 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 455/925] 10.27.203.238 () {62 vars in 1107 bytes} [Tue May 28 12:44:26 2024] POST /identity/v3/auth/tokens => generated 4060 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:44:26 l75lg1-v1 devstack@placement-api.service[78201]: DEBUG placement.requestlog [None req-4e68981f-8180-46f9-9831-20157672ea2c None None] Starting request: 10.27.203.238 "GET /placement/" {{(pid=78201) __call__ /opt/stack/placement/placement/requestlog.py:55}} May 28 12:44:26 l75lg1-v1 devstack@placement-api.service[78201]: INFO placement.requestlog [None req-4e68981f-8180-46f9-9831-20157672ea2c None None] 10.27.203.238 "GET /placement/" status: 200 len: 136 microversion: 1.0 May 28 12:44:26 l75lg1-v1 devstack@placement-api.service[78201]: [pid: 78201|app: 0|req: 1/2] 10.27.203.238 () {58 vars in 1005 bytes} [Tue May 28 12:44:26 2024] GET /placement => generated 136 bytes in 10 msecs (HTTP/1.1 200) 6 headers in 224 bytes (1 switches on core 0) May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG nova.context [None req-59aa5784-508c-4977-aa75-62b190a37bec None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),07f8d545-d202-434b-a916-12ac42ffae61(cell1) {{(pid=80330) load_cells /opt/stack/nova/nova/context.py:464}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_concurrency.lockutils [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=80330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_concurrency.lockutils [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_concurrency.lockutils [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_concurrency.lockutils [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] Acquiring lock "07f8d545-d202-434b-a916-12ac42ffae61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=80330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_concurrency.lockutils [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] Lock "07f8d545-d202-434b-a916-12ac42ffae61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_concurrency.lockutils [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] Lock "07f8d545-d202-434b-a916-12ac42ffae61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: INFO dbcounter [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] Registered counter for database nova_cell0 May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: INFO dbcounter [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] Registered counter for database nova_cell1 May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_db.sqlalchemy.engines [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80330) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:342}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_db.sqlalchemy.engines [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80330) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:342}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG dbcounter [-] [80330] Writer thread running {{(pid=80330) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG dbcounter [-] [80330] Writer thread running {{(pid=80330) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_concurrency.lockutils [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] Acquiring lock "singleton_lock" {{(pid=80330) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_concurrency.lockutils [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] Acquired lock "singleton_lock" {{(pid=80330) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_concurrency.lockutils [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] Releasing lock "singleton_lock" {{(pid=80330) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: INFO oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] Starting 2 workers May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] Started child 81194 {{(pid=80330) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:579}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] Started child 81196 {{(pid=80330) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:579}} May 28 12:44:26 l75lg1-v1 nova-scheduler[81194]: INFO nova.service [-] Starting scheduler node (version 29.1.0) May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] Full set of CONF: {{(pid=80330) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:653}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] ******************************************************************************** {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2600}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] Configuration options gathered from: {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2601}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] command line args: ['--config-file', '/etc/nova/nova.conf'] {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] config files: ['/etc/nova/nova.conf'] {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2603}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] ================================================================================ {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2605}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] allow_resize_to_same_host = True {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] arq_binding_timeout = 300 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] block_device_allocate_retries = 60 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] block_device_allocate_retries_interval = 3 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] cert = self.pem {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] compute_driver = libvirt.LibvirtDriver {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:26 l75lg1-v1 nova-scheduler[81196]: INFO nova.service [-] Starting scheduler node (version 29.1.0) May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] compute_monitors = [] {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] config_dir = [] {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] config_drive_format = iso9660 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] config_file = ['/etc/nova/nova.conf'] {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] config_source = [] {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] console_host = l75lg1-v1 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] control_exchange = nova {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] cpu_allocation_ratio = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] daemon = False {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] debug = True {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] default_access_ip_network_name = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] default_availability_zone = nova {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] default_ephemeral_format = ext4 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] default_green_pool_size = 1000 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] default_schedule_zone = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] disk_allocation_ratio = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] enable_new_services = True {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] enabled_apis = ['osapi_compute'] {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] enabled_ssl_apis = [] {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] flat_injected = False {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] force_config_drive = False {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] force_raw_images = True {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] graceful_shutdown_timeout = 5 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] heal_instance_info_cache_interval = 60 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] host = l75lg1-v1 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] initial_cpu_allocation_ratio = 4.0 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] initial_disk_allocation_ratio = 1.0 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] initial_ram_allocation_ratio = 1.0 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] instance_build_timeout = 0 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] instance_delete_interval = 300 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:26 l75lg1-v1 nova-scheduler[81196]: INFO dbcounter [None req-3b053516-8774-4a49-8f96-02e90560c900 None None] Registered counter for database nova_cell0 May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] instance_format = [instance: %(uuid)s] {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:26 l75lg1-v1 nova-scheduler[81194]: INFO dbcounter [None req-da23d2bf-6c0d-4b71-adc4-592dff8cdea1 None None] Registered counter for database nova_cell0 May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] instance_name_template = instance-%08x {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] instance_usage_audit = False {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] instance_usage_audit_period = month {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] instances_path = /opt/stack/data/nova/instances {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] internal_service_availability_zone = internal {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] key = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] live_migration_retry_count = 30 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] log_config_append = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] log_dir = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] log_file = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] log_options = True {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] log_rotate_interval = 1 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] log_rotate_interval_type = days {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] log_rotation_type = none {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] long_rpc_timeout = 1800 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] max_concurrent_builds = 10 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] max_concurrent_live_migrations = 1 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] max_concurrent_snapshots = 5 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] max_local_block_devices = 3 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] max_logfile_count = 30 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] max_logfile_size_mb = 200 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] maximum_instance_delete_attempts = 5 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] metadata_listen = 0.0.0.0 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] metadata_listen_port = 8775 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] metadata_workers = 2 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] migrate_max_retries = -1 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] mkisofs_cmd = genisoimage {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] my_block_storage_ip = 10.27.203.238 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] my_ip = 10.27.203.238 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] network_allocate_retries = 0 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] osapi_compute_listen = 0.0.0.0 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] osapi_compute_listen_port = 8774 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] osapi_compute_unique_server_name_scope = {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] osapi_compute_workers = 2 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] password_length = 12 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] periodic_enable = True {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] periodic_fuzzy_delay = 60 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] pointer_model = ps2mouse {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] preallocate_images = none {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] publish_errors = False {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] pybasedir = /opt/stack/nova {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] ram_allocation_ratio = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] rate_limit_burst = 0 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] rate_limit_except_level = CRITICAL {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] rate_limit_interval = 0 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] reboot_timeout = 0 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] reclaim_instance_interval = 0 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] record = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:26 l75lg1-v1 nova-scheduler[81196]: DEBUG oslo_db.sqlalchemy.engines [None req-3b053516-8774-4a49-8f96-02e90560c900 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81196) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:342}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] reimage_timeout_per_gb = 20 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] report_interval = 120 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] rescue_timeout = 0 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] reserved_host_cpus = 0 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] reserved_host_disk_mb = 0 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] reserved_host_memory_mb = 512 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] reserved_huge_pages = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] resize_confirm_window = 0 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] resize_fs_using_block_device = False {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] resume_guests_state_on_host_boot = False {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] run_external_periodic_tasks = True {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] running_deleted_instance_action = reap {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] running_deleted_instance_poll_interval = 1800 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] running_deleted_instance_timeout = 0 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] scheduler_instance_sync_interval = 120 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] service_down_time = 720 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] servicegroup_driver = db {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] shelved_offload_time = 0 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] shelved_poll_interval = 3600 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] shutdown_timeout = 0 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] source_is_ipv6 = False {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] ssl_only = False {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] state_path = /opt/stack/data/nova {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] sync_power_state_interval = 600 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] sync_power_state_pool_size = 1000 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] syslog_log_facility = LOG_USER {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] tempdir = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] timeout_nbd = 10 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] transport_url = **** {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] update_resources_interval = 0 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] use_cow_images = True {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] use_eventlog = False {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] use_journal = False {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] use_json = False {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] use_rootwrap_daemon = False {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] use_stderr = False {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] use_syslog = False {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] vcpu_pin_set = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] vif_plugging_is_fatal = True {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] vif_plugging_timeout = 300 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] virt_mkfs = [] {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] volume_usage_poll_interval = 0 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] watch_log_file = False {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] web = /usr/share/spice-html5 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:26 l75lg1-v1 nova-scheduler[81194]: DEBUG oslo_db.sqlalchemy.engines [None req-da23d2bf-6c0d-4b71-adc4-592dff8cdea1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81194) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:342}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] oslo_concurrency.disable_process_locking = False {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] api.auth_strategy = keystone {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] api.compute_link_prefix = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] api.dhcp_domain = novalocal {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] api.enable_instance_password = True {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] api.glance_link_prefix = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] api.instance_list_per_project_cells = False {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] api.list_records_by_skipping_down_cells = True {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] api.local_metadata_per_cell = False {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] api.max_limit = 1000 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] api.metadata_cache_expiration = 15 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] api.neutron_default_tenant_id = default {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] api.use_neutron_default_nets = False {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] api.vendordata_dynamic_ssl_certfile = {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] api.vendordata_dynamic_targets = [] {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] api.vendordata_jsonfile_path = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] api.vendordata_providers = ['StaticJSON'] {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] cache.backend = dogpile.cache.memcached {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] cache.backend_argument = **** {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] cache.config_prefix = cache.oslo {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] cache.dead_timeout = 60.0 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] cache.debug_cache_backend = False {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[81196]: DEBUG dbcounter [-] [81196] Writer thread running {{(pid=81196) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] cache.enable_retry_client = False {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] cache.enable_socket_keepalive = False {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] cache.enabled = True {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] cache.enforce_fips_mode = False {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] cache.expiration_time = 600 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] cache.hashclient_retry_attempts = 2 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] cache.hashclient_retry_delay = 1.0 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] cache.memcache_dead_retry = 300 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] cache.memcache_password = **** {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] cache.memcache_pool_maxsize = 10 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] cache.memcache_sasl_enabled = False {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] cache.memcache_socket_timeout = 1.0 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] cache.memcache_username = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] cache.proxies = [] {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] cache.redis_password = **** {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] cache.redis_sentinel_service_name = mymaster {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] cache.redis_server = localhost:6379 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] cache.redis_socket_timeout = 1.0 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] cache.redis_username = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] cache.retry_attempts = 2 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] cache.retry_delay = 0.0 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] cache.socket_keepalive_count = 1 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] cache.socket_keepalive_idle = 1 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] cache.socket_keepalive_interval = 1 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] cache.tls_allowed_ciphers = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] cache.tls_cafile = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] cache.tls_certfile = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] cache.tls_enabled = False {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] cache.tls_keyfile = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] cinder.auth_section = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] cinder.auth_type = password {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] cinder.cafile = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] cinder.catalog_info = volumev3::publicURL {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] cinder.certfile = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] cinder.collect_timing = False {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] cinder.cross_az_attach = True {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] cinder.debug = False {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] cinder.endpoint_template = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] cinder.http_retries = 3 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] cinder.insecure = False {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] cinder.keyfile = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] cinder.os_region_name = RegionOne {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] cinder.split_loggers = False {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] cinder.timeout = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] compute.cpu_dedicated_set = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] compute.cpu_shared_set = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] compute.image_type_exclude_list = [] {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] compute.max_concurrent_disk_ops = 0 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] compute.max_disk_devices_to_attach = -1 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] compute.resource_provider_association_refresh = 300 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] compute.shutdown_retry_interval = 10 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] conductor.workers = 2 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] console.allowed_origins = [] {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] console.ssl_ciphers = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] console.ssl_minimum_version = default {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] consoleauth.enforce_session_timeout = False {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] consoleauth.token_ttl = 600 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[81194]: DEBUG dbcounter [-] [81194] Writer thread running {{(pid=81194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] cyborg.cafile = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] cyborg.certfile = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] cyborg.collect_timing = False {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] cyborg.connect_retries = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] cyborg.connect_retry_delay = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] cyborg.endpoint_override = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] cyborg.insecure = False {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] cyborg.keyfile = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] cyborg.max_version = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] cyborg.min_version = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] cyborg.region_name = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] cyborg.retriable_status_codes = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] cyborg.service_name = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] cyborg.service_type = accelerator {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] cyborg.split_loggers = False {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] cyborg.status_code_retries = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] cyborg.status_code_retry_delay = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] cyborg.timeout = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] cyborg.version = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] database.backend = sqlalchemy {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] database.connection = **** {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] database.connection_debug = 0 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] database.connection_parameters = {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] database.connection_recycle_time = 3600 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] database.connection_trace = False {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] database.db_inc_retry_interval = True {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] database.db_max_retries = 20 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] database.db_max_retry_interval = 10 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] database.db_retry_interval = 1 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] database.max_overflow = 50 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] database.max_pool_size = 5 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] database.max_retries = 10 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[81196]: DEBUG nova.service [None req-3b053516-8774-4a49-8f96-02e90560c900 None None] Creating RPC server for service scheduler {{(pid=81196) start /opt/stack/nova/nova/service.py:186}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] database.mysql_wsrep_sync_wait = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] database.pool_timeout = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] database.retry_interval = 10 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] database.slave_connection = **** {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] database.sqlite_synchronous = True {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] database.use_db_reconnect = False {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] api_database.backend = sqlalchemy {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] api_database.connection = **** {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] api_database.connection_debug = 0 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] api_database.connection_parameters = {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] api_database.connection_recycle_time = 3600 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] api_database.connection_trace = False {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] api_database.db_inc_retry_interval = True {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] api_database.db_max_retries = 20 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] api_database.db_max_retry_interval = 10 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] api_database.db_retry_interval = 1 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] api_database.max_overflow = 50 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] api_database.max_pool_size = 5 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] api_database.max_retries = 10 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] api_database.mysql_sql_mode = TRADITIONAL {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] api_database.pool_timeout = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] api_database.retry_interval = 10 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] api_database.slave_connection = **** {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] api_database.sqlite_synchronous = True {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] devices.enabled_mdev_types = [] {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] ephemeral_storage_encryption.default_format = luks {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] ephemeral_storage_encryption.enabled = False {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] glance.api_servers = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] glance.cafile = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] glance.certfile = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] glance.collect_timing = False {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] glance.connect_retries = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] glance.connect_retry_delay = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] glance.debug = False {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] glance.default_trusted_certificate_ids = [] {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] glance.enable_certificate_validation = False {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] glance.enable_rbd_download = False {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] glance.endpoint_override = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] glance.insecure = False {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] glance.keyfile = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] glance.max_version = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] glance.min_version = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] glance.num_retries = 3 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] glance.rbd_ceph_conf = {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] glance.rbd_connect_timeout = 5 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] glance.rbd_pool = {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] glance.rbd_user = {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] glance.region_name = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] glance.retriable_status_codes = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] glance.service_name = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] glance.service_type = image {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] glance.split_loggers = False {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] glance.status_code_retries = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] glance.status_code_retry_delay = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] glance.timeout = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] glance.valid_interfaces = ['internal', 'public'] {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] glance.verify_glance_signatures = False {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] glance.version = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] guestfs.debug = False {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] mks.enabled = False {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] image_cache.manager_interval = 2400 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] image_cache.precache_concurrency = 1 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] image_cache.remove_unused_base_images = True {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] image_cache.subdirectory_name = _base {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] ironic.api_max_retries = 60 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] ironic.api_retry_interval = 2 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] ironic.auth_section = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] ironic.auth_type = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] ironic.cafile = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] ironic.certfile = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[81194]: DEBUG nova.service [None req-da23d2bf-6c0d-4b71-adc4-592dff8cdea1 None None] Creating RPC server for service scheduler {{(pid=81194) start /opt/stack/nova/nova/service.py:186}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] ironic.collect_timing = False {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] ironic.conductor_group = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] ironic.connect_retries = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] ironic.connect_retry_delay = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] ironic.endpoint_override = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] ironic.insecure = False {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[81196]: INFO oslo.messaging._drivers.impl_rabbit [None req-3b053516-8774-4a49-8f96-02e90560c900 None None] Creating fanout queue: scheduler_fanout_44122322c3144fc2acbf7e0084695e5e May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] ironic.keyfile = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] ironic.max_version = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] ironic.min_version = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] ironic.peer_list = [] {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] ironic.region_name = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] ironic.retriable_status_codes = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] ironic.serial_console_state_timeout = 10 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] ironic.service_name = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] ironic.service_type = baremetal {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] ironic.shard = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] ironic.split_loggers = False {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[81196]: DEBUG nova.service [None req-3b053516-8774-4a49-8f96-02e90560c900 None None] Join ServiceGroup membership for this service scheduler {{(pid=81196) start /opt/stack/nova/nova/service.py:203}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] ironic.status_code_retries = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[81196]: DEBUG nova.servicegroup.drivers.db [None req-3b053516-8774-4a49-8f96-02e90560c900 None None] DB_Driver: join new ServiceGroup member l75lg1-v1 to the scheduler group, service = {{(pid=81196) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] ironic.status_code_retry_delay = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] ironic.timeout = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] ironic.valid_interfaces = ['internal', 'public'] {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] ironic.version = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] key_manager.fixed_key = **** {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] barbican.barbican_api_version = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] barbican.barbican_endpoint = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] barbican.barbican_endpoint_type = public {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] barbican.barbican_region_name = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] barbican.cafile = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] barbican.certfile = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] barbican.collect_timing = False {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] barbican.insecure = False {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] barbican.keyfile = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] barbican.number_of_retries = 60 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] barbican.retry_delay = 1 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] barbican.send_service_user_token = False {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] barbican.split_loggers = False {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] barbican.timeout = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] barbican.verify_ssl = True {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] barbican.verify_ssl_path = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] barbican_service_user.auth_section = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] barbican_service_user.auth_type = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] barbican_service_user.cafile = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] barbican_service_user.certfile = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] barbican_service_user.collect_timing = False {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] barbican_service_user.insecure = False {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] barbican_service_user.keyfile = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] barbican_service_user.split_loggers = False {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] barbican_service_user.timeout = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] vault.approle_role_id = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] vault.approle_secret_id = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] vault.cafile = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] vault.certfile = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] vault.collect_timing = False {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] vault.insecure = False {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] vault.keyfile = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] vault.kv_mountpoint = secret {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] vault.kv_path = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] vault.kv_version = 2 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] vault.namespace = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] vault.root_token_id = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] vault.split_loggers = False {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] vault.ssl_ca_crt_file = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] vault.timeout = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] vault.use_ssl = False {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] keystone.auth_section = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] keystone.auth_type = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] keystone.cafile = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] keystone.certfile = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] keystone.collect_timing = False {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] keystone.connect_retries = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] keystone.connect_retry_delay = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] keystone.endpoint_override = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[81194]: INFO oslo.messaging._drivers.impl_rabbit [None req-da23d2bf-6c0d-4b71-adc4-592dff8cdea1 None None] Creating fanout queue: scheduler_fanout_7951416e2f1e408a9792229edd4f0e44 May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] keystone.insecure = False {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] keystone.keyfile = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] keystone.max_version = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] keystone.min_version = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] keystone.region_name = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] keystone.retriable_status_codes = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] keystone.service_name = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] keystone.service_type = identity {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] keystone.split_loggers = False {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] keystone.status_code_retries = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] keystone.status_code_retry_delay = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] keystone.timeout = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[81194]: DEBUG nova.service [None req-da23d2bf-6c0d-4b71-adc4-592dff8cdea1 None None] Join ServiceGroup membership for this service scheduler {{(pid=81194) start /opt/stack/nova/nova/service.py:203}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] keystone.valid_interfaces = ['internal', 'public'] {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] keystone.version = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[81194]: DEBUG nova.servicegroup.drivers.db [None req-da23d2bf-6c0d-4b71-adc4-592dff8cdea1 None None] DB_Driver: join new ServiceGroup member l75lg1-v1 to the scheduler group, service = {{(pid=81194) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] libvirt.connection_uri = {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] libvirt.cpu_mode = custom {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] libvirt.cpu_model_extra_flags = [] {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: WARNING oslo_config.cfg [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] libvirt.cpu_models = ['Nehalem'] {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] libvirt.cpu_power_governor_high = performance {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] libvirt.cpu_power_governor_low = powersave {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] libvirt.cpu_power_management = False {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] libvirt.device_detach_attempts = 8 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] libvirt.device_detach_timeout = 20 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] libvirt.disk_cachemodes = [] {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] libvirt.disk_prefix = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] libvirt.enabled_perf_events = [] {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] libvirt.file_backed_memory = 0 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] libvirt.gid_maps = [] {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] libvirt.hw_disk_discard = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] libvirt.hw_machine_type = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] libvirt.images_rbd_ceph_conf = {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] libvirt.images_rbd_glance_store_name = {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] libvirt.images_rbd_pool = rbd {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] libvirt.images_type = default {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] libvirt.images_volume_group = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] libvirt.inject_key = False {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] libvirt.inject_partition = -2 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] libvirt.inject_password = False {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] libvirt.iscsi_iface = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] libvirt.iser_use_multipath = False {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] libvirt.live_migration_bandwidth = 0 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] libvirt.live_migration_downtime = 500 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] libvirt.live_migration_inbound_addr = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] libvirt.live_migration_permit_post_copy = False {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] libvirt.live_migration_scheme = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] libvirt.live_migration_timeout_action = abort {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] libvirt.live_migration_tunnelled = False {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: WARNING oslo_config.cfg [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: live_migration_uri is deprecated for removal in favor of two other options that May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: allow to change live migration scheme and target URI: ``live_migration_scheme`` May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: and ``live_migration_inbound_addr`` respectively. May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: ). Its value may be silently ignored in the future. May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] libvirt.live_migration_uri = qemu+ssh://vastdata@%s/system {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] libvirt.live_migration_with_native_tls = False {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] libvirt.max_queues = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] libvirt.migration_inbound_addr = 10.27.203.238 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] libvirt.nfs_mount_options = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] libvirt.num_iser_scan_tries = 5 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] libvirt.num_memory_encrypted_guests = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] libvirt.num_pcie_ports = 0 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] libvirt.num_volume_scan_tries = 5 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] libvirt.pmem_namespaces = [] {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] libvirt.quobyte_client_cfg = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] libvirt.rbd_connect_timeout = 5 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] libvirt.rbd_secret_uuid = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] libvirt.rbd_user = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] libvirt.remote_filesystem_transport = ssh {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] libvirt.rescue_image_id = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] libvirt.rescue_kernel_id = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] libvirt.rescue_ramdisk_id = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] libvirt.rng_dev_path = /dev/urandom {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] libvirt.rx_queue_size = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] libvirt.smbfs_mount_options = {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] libvirt.snapshot_compression = False {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] libvirt.snapshot_image_format = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] libvirt.sparse_logical_volumes = False {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] libvirt.swtpm_enabled = False {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] libvirt.swtpm_group = tss {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] libvirt.swtpm_user = tss {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] libvirt.sysinfo_serial = unique {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] libvirt.tb_cache_size = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] libvirt.tx_queue_size = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] libvirt.uid_maps = [] {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] libvirt.use_virtio_for_bridges = True {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] libvirt.virt_type = qemu {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] libvirt.volume_clear = zero {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] libvirt.volume_clear_size = 0 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] libvirt.volume_use_multipath = False {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] libvirt.vzstorage_cache_path = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] libvirt.vzstorage_mount_group = qemu {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] libvirt.vzstorage_mount_opts = [] {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] libvirt.vzstorage_mount_perms = 0770 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] libvirt.vzstorage_mount_user = stack {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] neutron.auth_section = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] neutron.auth_type = password {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] neutron.cafile = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] neutron.certfile = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] neutron.collect_timing = False {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] neutron.connect_retries = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] neutron.connect_retry_delay = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] neutron.default_floating_pool = public {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] neutron.endpoint_override = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] neutron.extension_sync_interval = 600 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] neutron.http_retries = 3 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] neutron.insecure = False {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] neutron.keyfile = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] neutron.max_version = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] neutron.min_version = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] neutron.ovs_bridge = br-int {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] neutron.physnets = [] {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] neutron.region_name = RegionOne {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] neutron.retriable_status_codes = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] neutron.service_metadata_proxy = True {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] neutron.service_name = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] neutron.service_type = network {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] neutron.split_loggers = False {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] neutron.status_code_retries = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] neutron.status_code_retry_delay = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] neutron.timeout = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] neutron.valid_interfaces = ['internal', 'public'] {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] neutron.version = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] notifications.bdms_in_notifications = False {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] notifications.default_level = INFO {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] notifications.notification_format = unversioned {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] notifications.notify_on_state_change = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] pci.alias = [] {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] pci.device_spec = [] {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] pci.report_in_placement = False {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] placement.auth_section = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] placement.auth_type = password {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] placement.auth_url = http://10.27.203.238/identity {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] placement.cafile = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] placement.certfile = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] placement.collect_timing = False {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] placement.connect_retries = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] placement.connect_retry_delay = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] placement.default_domain_id = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] placement.default_domain_name = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] placement.domain_id = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] placement.domain_name = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] placement.endpoint_override = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] placement.insecure = False {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] placement.keyfile = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] placement.max_version = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] placement.min_version = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] placement.password = **** {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] placement.project_domain_id = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] placement.project_domain_name = Default {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] placement.project_id = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] placement.project_name = service {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] placement.region_name = RegionOne {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] placement.retriable_status_codes = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] placement.service_name = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] placement.service_type = placement {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] placement.split_loggers = False {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] placement.status_code_retries = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] placement.status_code_retry_delay = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] placement.system_scope = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] placement.timeout = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] placement.trust_id = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] placement.user_domain_id = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] placement.user_domain_name = Default {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] placement.user_id = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] placement.username = placement {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] placement.valid_interfaces = ['internal', 'public'] {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] placement.version = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] quota.cores = 20 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] quota.count_usage_from_placement = False {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] quota.driver = nova.quota.DbQuotaDriver {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] quota.injected_file_content_bytes = 10240 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] quota.injected_file_path_length = 255 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] quota.injected_files = 5 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] quota.instances = 10 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] quota.key_pairs = 100 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] quota.metadata_items = 128 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] quota.ram = 51200 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] quota.recheck_quota = True {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] quota.server_group_members = 10 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] quota.server_groups = 10 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] scheduler.image_metadata_prefilter = False {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] scheduler.max_attempts = 3 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] scheduler.max_placement_results = 1000 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] scheduler.query_placement_for_image_type_support = False {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] scheduler.workers = 2 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] filter_scheduler.host_subset_size = 1 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] filter_scheduler.isolated_hosts = [] {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] filter_scheduler.isolated_images = [] {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] filter_scheduler.pci_in_placement = False {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] filter_scheduler.track_instance_changes = False {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] metrics.required = True {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] metrics.weight_multiplier = 1.0 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] metrics.weight_of_unavailable = -10000.0 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] metrics.weight_setting = [] {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] serial_console.enabled = False {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] serial_console.port_range = 10000:20000 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] serial_console.serialproxy_port = 6083 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] service_user.auth_section = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] service_user.auth_type = password {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] service_user.cafile = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] service_user.certfile = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] service_user.collect_timing = False {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] service_user.insecure = False {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] service_user.keyfile = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] service_user.send_service_user_token = True {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] service_user.split_loggers = False {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] service_user.timeout = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] spice.agent_enabled = True {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] spice.enabled = False {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] spice.html5proxy_host = 0.0.0.0 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] spice.html5proxy_port = 6082 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] spice.image_compression = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] spice.jpeg_compression = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] spice.playback_compression = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] spice.server_listen = 127.0.0.1 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] spice.streaming_mode = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] spice.zlib_compression = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] upgrade_levels.baseapi = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] upgrade_levels.compute = auto {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] upgrade_levels.conductor = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] upgrade_levels.scheduler = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] vendordata_dynamic_auth.auth_section = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] vendordata_dynamic_auth.auth_type = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] vendordata_dynamic_auth.cafile = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] vendordata_dynamic_auth.certfile = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] vendordata_dynamic_auth.insecure = False {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] vendordata_dynamic_auth.keyfile = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] vendordata_dynamic_auth.timeout = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] vmware.api_retry_count = 10 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] vmware.ca_file = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] vmware.cache_prefix = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] vmware.cluster_name = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] vmware.connection_pool_size = 10 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] vmware.console_delay_seconds = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] vmware.datastore_regex = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] vmware.host_ip = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] vmware.host_password = **** {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] vmware.host_port = 443 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] vmware.host_username = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] vmware.insecure = False {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] vmware.integration_bridge = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] vmware.maximum_objects = 100 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] vmware.pbm_default_policy = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] vmware.pbm_enabled = False {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] vmware.pbm_wsdl_location = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] vmware.serial_port_proxy_uri = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] vmware.serial_port_service_uri = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] vmware.task_poll_interval = 0.5 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] vmware.use_linked_clone = True {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] vmware.vnc_keymap = en-us {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] vmware.vnc_port = 5900 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] vmware.vnc_port_total = 10000 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] vnc.auth_schemes = ['none'] {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] vnc.enabled = True {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] vnc.novncproxy_host = 0.0.0.0 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] vnc.novncproxy_port = 6080 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] vnc.server_listen = 127.0.0.1 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] vnc.vencrypt_ca_certs = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] vnc.vencrypt_client_cert = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] vnc.vencrypt_client_key = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] workarounds.disable_group_policy_check_upcall = False {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] workarounds.disable_rootwrap = False {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] workarounds.enable_numa_live_migration = False {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] workarounds.libvirt_disable_apic = False {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] wsgi.client_socket_timeout = 900 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] wsgi.default_pool_size = 1000 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] wsgi.keep_alive = True {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] wsgi.max_header_line = 16384 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] wsgi.secure_proxy_ssl_header = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] wsgi.ssl_ca_file = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] wsgi.ssl_cert_file = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] wsgi.ssl_key_file = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] wsgi.tcp_keepidle = 600 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] zvm.ca_file = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] zvm.cloud_connector_url = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] zvm.reachable_timeout = 300 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] oslo_policy.enforce_new_defaults = True {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] oslo_policy.enforce_scope = True {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] oslo_policy.policy_default_rule = default {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] oslo_policy.policy_file = policy.yaml {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] profiler.connection_string = messaging:// {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] profiler.enabled = False {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] profiler.es_doc_type = notification {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] profiler.es_scroll_size = 10000 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] profiler.es_scroll_time = 2m {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] profiler.filter_error_trace = False {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] profiler.hmac_keys = **** {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] profiler.sentinel_service_name = mymaster {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] profiler.socket_timeout = 0.1 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] profiler.trace_requests = False {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] profiler.trace_sqlalchemy = False {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] profiler_jaeger.process_tags = {} {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] profiler_jaeger.service_name_prefix = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] profiler_otlp.service_name_prefix = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] remote_debug.host = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] remote_debug.port = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] oslo_messaging_rabbit.hostname = l75lg1-v1 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] oslo_messaging_rabbit.processname = nova-scheduler {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] oslo_messaging_rabbit.ssl = False {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:26 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:27 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:27 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] oslo_messaging_rabbit.ssl_version = {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:27 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:27 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:27 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] oslo_messaging_notifications.retry = -1 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:27 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:27 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] oslo_messaging_notifications.transport_url = **** {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:27 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] oslo_limit.auth_section = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:27 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] oslo_limit.auth_type = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:27 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] oslo_limit.cafile = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:27 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] oslo_limit.certfile = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:27 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] oslo_limit.collect_timing = False {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:27 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] oslo_limit.connect_retries = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:27 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] oslo_limit.connect_retry_delay = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:27 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] oslo_limit.endpoint_id = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:27 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] oslo_limit.endpoint_override = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:27 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] oslo_limit.insecure = False {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:27 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] oslo_limit.keyfile = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:27 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] oslo_limit.max_version = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:27 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] oslo_limit.min_version = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:27 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] oslo_limit.region_name = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:27 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] oslo_limit.retriable_status_codes = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:27 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] oslo_limit.service_name = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:27 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] oslo_limit.service_type = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:27 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] oslo_limit.split_loggers = False {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:27 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] oslo_limit.status_code_retries = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:27 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] oslo_limit.status_code_retry_delay = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:27 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] oslo_limit.timeout = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:27 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] oslo_limit.valid_interfaces = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:27 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] oslo_limit.version = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:27 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] oslo_reports.file_event_handler = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:27 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:27 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] oslo_reports.log_dir = None {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:27 l75lg1-v1 nova-scheduler[80330]: DEBUG oslo_service.service [None req-6116bd47-2f8a-4ebc-a52e-dfcd34f408f3 None None] ******************************************************************************** {{(pid=80330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2624}} May 28 12:44:27 l75lg1-v1 dstat.sh[49771]: 28-05 12:44:27| 31 12 56 0 0|3048M 6448M 267M 5935M| 21k 22k| 0 652k| 0 51.0 |7328 12k|1.43 1.76 1.26|5.0 0 405| 0 0 | 0 2048M| 25 138 0 32 0 May 28 12:44:28 l75lg1-v1 dstat.sh[49771]: 28-05 12:44:28| 27 8 64 0 0|3140M 6356M 267M 5935M| 21k 9294B| 136k 272k|34.0 14.0 |8283 11k|1.43 1.76 1.26|5.0 0 189| 0 0 | 0 2048M| 25 138 0 32 0 May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2600}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2601}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2603}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2605}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] console_host = l75lg1-v1 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] default_green_pool_size = 1000 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] host = l75lg1-v1 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.27.203.238 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.27.203.238 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 120 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 720 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] cache.enforce_fips_mode = False {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = **** {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] cache.redis_password = **** {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] cache.redis_sentinel_service_name = mymaster {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] cache.redis_sentinels = ['localhost:26379'] {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] cache.redis_server = localhost:6379 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] cache.redis_socket_timeout = 1.0 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] cache.redis_username = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.enforce_session_timeout = False {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.retriable_status_codes = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.default_format = luks {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] glance.retriable_status_codes = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.conductor_group = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.retriable_status_codes = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.shard = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_path = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.auth_section = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.auth_type = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.retriable_status_codes = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: live_migration_uri is deprecated for removal in favor of two other options that May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: allow to change live migration scheme and target URI: ``live_migration_scheme`` May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: and ``live_migration_inbound_addr`` respectively. May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: ). Its value may be silently ignored in the future. May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://vastdata@%s/system {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.migration_inbound_addr = 10.27.203.238 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tb_cache_size = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = qemu {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.retriable_status_codes = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] placement.retriable_status_codes = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = True {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = True {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = **** {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_requests = False {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] profiler_jaeger.process_tags = {} {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] profiler_jaeger.service_name_prefix = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] profiler_otlp.service_name_prefix = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.retriable_status_codes = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.hostname = l75lg1-v1 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.processname = uwsgi {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.use_queue_manager = False {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=80877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2624}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2600}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2601}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2603}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2605}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] console_host = l75lg1-v1 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] default_green_pool_size = 1000 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] host = l75lg1-v1 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.27.203.238 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.27.203.238 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 120 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 720 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: INFO dbcounter [None req-82361cc2-7997-4f0f-9b41-2357742d8cb7 None None] Registered counter for database nova_api May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] cache.enforce_fips_mode = False {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = **** {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] cache.redis_password = **** {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] cache.redis_sentinel_service_name = mymaster {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] cache.redis_sentinels = ['localhost:26379'] {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] cache.redis_server = localhost:6379 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] cache.redis_socket_timeout = 1.0 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] cache.redis_username = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG oslo_db.sqlalchemy.engines [None req-82361cc2-7997-4f0f-9b41-2357742d8cb7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80877) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:342}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.enforce_session_timeout = False {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.retriable_status_codes = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.default_format = luks {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] glance.retriable_status_codes = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.conductor_group = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.retriable_status_codes = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.shard = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_path = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.auth_section = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.auth_type = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.retriable_status_codes = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: live_migration_uri is deprecated for removal in favor of two other options that May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: allow to change live migration scheme and target URI: ``live_migration_scheme`` May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: and ``live_migration_inbound_addr`` respectively. May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: ). Its value may be silently ignored in the future. May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://vastdata@%s/system {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.migration_inbound_addr = 10.27.203.238 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG dbcounter [-] [80877] Writer thread running {{(pid=80877) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tb_cache_size = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG nova.context [None req-82361cc2-7997-4f0f-9b41-2357742d8cb7 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),07f8d545-d202-434b-a916-12ac42ffae61(cell1) {{(pid=80877) load_cells /opt/stack/nova/nova/context.py:464}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = qemu {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG oslo_concurrency.lockutils [None req-82361cc2-7997-4f0f-9b41-2357742d8cb7 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=80877) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG oslo_concurrency.lockutils [None req-82361cc2-7997-4f0f-9b41-2357742d8cb7 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80877) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG oslo_concurrency.lockutils [None req-82361cc2-7997-4f0f-9b41-2357742d8cb7 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80877) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG oslo_concurrency.lockutils [None req-82361cc2-7997-4f0f-9b41-2357742d8cb7 None None] Acquiring lock "07f8d545-d202-434b-a916-12ac42ffae61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=80877) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG oslo_concurrency.lockutils [None req-82361cc2-7997-4f0f-9b41-2357742d8cb7 None None] Lock "07f8d545-d202-434b-a916-12ac42ffae61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80877) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.retriable_status_codes = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG oslo_concurrency.lockutils [None req-82361cc2-7997-4f0f-9b41-2357742d8cb7 None None] Lock "07f8d545-d202-434b-a916-12ac42ffae61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=80877) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: INFO dbcounter [None req-82361cc2-7997-4f0f-9b41-2357742d8cb7 None None] Registered counter for database nova_cell0 May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] placement.retriable_status_codes = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: INFO dbcounter [None req-82361cc2-7997-4f0f-9b41-2357742d8cb7 None None] Registered counter for database nova_cell1 May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG oslo_db.sqlalchemy.engines [None req-82361cc2-7997-4f0f-9b41-2357742d8cb7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80877) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:342}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG oslo_db.sqlalchemy.engines [None req-82361cc2-7997-4f0f-9b41-2357742d8cb7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80877) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:342}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = True {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = True {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = **** {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_requests = False {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] profiler_jaeger.process_tags = {} {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] profiler_jaeger.service_name_prefix = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] profiler_otlp.service_name_prefix = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.retriable_status_codes = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.hostname = l75lg1-v1 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.processname = uwsgi {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.use_queue_manager = False {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:28 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=80876) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2624}} May 28 12:44:29 l75lg1-v1 devstack@n-api-meta.service[80876]: INFO dbcounter [None req-6054569c-d495-45a3-850c-8f46aa4f0d1d None None] Registered counter for database nova_api May 28 12:44:29 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG oslo_db.sqlalchemy.engines [None req-6054569c-d495-45a3-850c-8f46aa4f0d1d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80876) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:342}} May 28 12:44:29 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG dbcounter [-] [80877] Writer thread running {{(pid=80877) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} May 28 12:44:29 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG dbcounter [-] [80876] Writer thread running {{(pid=80876) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} May 28 12:44:29 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG dbcounter [-] [80877] Writer thread running {{(pid=80877) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} May 28 12:44:29 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG nova.context [None req-6054569c-d495-45a3-850c-8f46aa4f0d1d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),07f8d545-d202-434b-a916-12ac42ffae61(cell1) {{(pid=80876) load_cells /opt/stack/nova/nova/context.py:464}} May 28 12:44:29 l75lg1-v1 devstack@n-api-meta.service[80877]: INFO dbcounter [None req-82361cc2-7997-4f0f-9b41-2357742d8cb7 None None] Registered counter for database nova_cell0 May 28 12:44:29 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG oslo_concurrency.lockutils [None req-6054569c-d495-45a3-850c-8f46aa4f0d1d None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=80876) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:44:29 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG oslo_concurrency.lockutils [None req-6054569c-d495-45a3-850c-8f46aa4f0d1d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80876) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:44:29 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG oslo_concurrency.lockutils [None req-6054569c-d495-45a3-850c-8f46aa4f0d1d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80876) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:44:29 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG oslo_concurrency.lockutils [None req-6054569c-d495-45a3-850c-8f46aa4f0d1d None None] Acquiring lock "07f8d545-d202-434b-a916-12ac42ffae61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=80876) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:44:29 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG oslo_concurrency.lockutils [None req-6054569c-d495-45a3-850c-8f46aa4f0d1d None None] Lock "07f8d545-d202-434b-a916-12ac42ffae61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=80876) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:44:29 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG oslo_concurrency.lockutils [None req-6054569c-d495-45a3-850c-8f46aa4f0d1d None None] Lock "07f8d545-d202-434b-a916-12ac42ffae61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=80876) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:44:29 l75lg1-v1 devstack@n-api-meta.service[80876]: INFO dbcounter [None req-6054569c-d495-45a3-850c-8f46aa4f0d1d None None] Registered counter for database nova_cell0 May 28 12:44:29 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG oslo_db.sqlalchemy.engines [None req-82361cc2-7997-4f0f-9b41-2357742d8cb7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80877) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:342}} May 28 12:44:29 l75lg1-v1 devstack@n-api-meta.service[80876]: INFO dbcounter [None req-6054569c-d495-45a3-850c-8f46aa4f0d1d None None] Registered counter for database nova_cell1 May 28 12:44:29 l75lg1-v1 devstack@n-api-meta.service[80877]: DEBUG dbcounter [-] [80877] Writer thread running {{(pid=80877) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} May 28 12:44:29 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG oslo_db.sqlalchemy.engines [None req-6054569c-d495-45a3-850c-8f46aa4f0d1d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80876) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:342}} May 28 12:44:29 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG oslo_db.sqlalchemy.engines [None req-6054569c-d495-45a3-850c-8f46aa4f0d1d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80876) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:342}} May 28 12:44:29 l75lg1-v1 devstack@n-api-meta.service[80877]: WARNING nova.api.metadata.handler [None req-82361cc2-7997-4f0f-9b41-2357742d8cb7 None None] metadata_proxy_shared_secret is not configured, the metadata information returned by the proxy cannot be trusted May 28 12:44:29 l75lg1-v1 devstack@n-api-meta.service[80877]: WSGI app 0 (mountpoint='') ready in 3 seconds on interpreter 0x56486b783280 pid: 80877 (default app) May 28 12:44:29 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG dbcounter [-] [80876] Writer thread running {{(pid=80876) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} May 28 12:44:29 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG dbcounter [-] [80876] Writer thread running {{(pid=80876) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} May 28 12:44:29 l75lg1-v1 devstack@n-api-meta.service[80876]: INFO dbcounter [None req-6054569c-d495-45a3-850c-8f46aa4f0d1d None None] Registered counter for database nova_cell0 May 28 12:44:29 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG oslo_db.sqlalchemy.engines [None req-6054569c-d495-45a3-850c-8f46aa4f0d1d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80876) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:342}} May 28 12:44:29 l75lg1-v1 dstat.sh[49771]: 28-05 12:44:29| 31 14 55 0 0|3238M 6255M 267M 5938M| 22k 28k| 0 1309k| 0 39.0 |9171 38k|1.43 1.76 1.26| 13 0 492| 0 0 | 0 2048M| 25 154 0 32 0 May 28 12:44:29 l75lg1-v1 devstack@n-api-meta.service[80876]: DEBUG dbcounter [-] [80876] Writer thread running {{(pid=80876) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} May 28 12:44:29 l75lg1-v1 devstack@n-api-meta.service[80876]: WARNING nova.api.metadata.handler [None req-6054569c-d495-45a3-850c-8f46aa4f0d1d None None] metadata_proxy_shared_secret is not configured, the metadata information returned by the proxy cannot be trusted May 28 12:44:29 l75lg1-v1 devstack@n-api-meta.service[80876]: WSGI app 0 (mountpoint='') ready in 3 seconds on interpreter 0x56486b783280 pid: 80876 (default app) May 28 12:44:30 l75lg1-v1 dstat.sh[49771]: 28-05 12:44:30| 19 10 70 0 0|3298M 6195M 267M 5938M| 13k 2130B| 136k 780k|34.0 32.0 |8272 57k|1.43 1.76 1.26|2.0 0 121| 0 0 | 0 2048M| 25 154 0 32 0 May 28 12:44:30 l75lg1-v1 neutron-server[77618]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.HashRingHealthCheckPeriodics.touch_hash_ring_nodes' {{(pid=77618) _process_scheduled /opt/stack/data/venv/lib/python3.10/site-packages/futurist/periodics.py:638}} May 28 12:44:30 l75lg1-v1 nova-novncproxy[81457]: INFO nova.console.websocketproxy [-] WebSocket server settings: May 28 12:44:30 l75lg1-v1 nova-novncproxy[81457]: INFO nova.console.websocketproxy [-] - Listen on 0.0.0.0:6080 May 28 12:44:30 l75lg1-v1 nova-novncproxy[81457]: INFO nova.console.websocketproxy [-] - Web server (no directory listings). Web root: /opt/stack/novnc May 28 12:44:30 l75lg1-v1 nova-novncproxy[81457]: INFO nova.console.websocketproxy [-] - No SSL/TLS support (no cert file) May 28 12:44:30 l75lg1-v1 nova-novncproxy[81457]: INFO nova.console.websocketproxy [-] - proxying from 0.0.0.0:6080 to None:None May 28 12:44:31 l75lg1-v1 dstat.sh[49771]: 28-05 12:44:31| 17 10 74 0 0|3358M 6135M 267M 5938M| 26k 23k| 68k 444k|17.0 40.0 |6672 8767 |1.43 1.76 1.26|4.0 0 425| 0 0 | 0 2048M| 26 154 0 21 0 May 28 12:44:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG dbcounter [-] [51267] Writing DB stats keystone:SELECT=53 {{(pid=51267) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:44:32 l75lg1-v1 neutron-server[77619]: DEBUG dbcounter [-] [77619] Writing DB stats neutron:SELECT=723,neutron:INSERT=699,neutron:UPDATE=17,neutron:DELETE=8 {{(pid=77619) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:44:32 l75lg1-v1 neutron-server[77619]: DEBUG dbcounter [-] [77619] Writing DB stats neutron:INSERT=47,neutron:SELECT=707,neutron:UPDATE=27,neutron:DELETE=4 {{(pid=77619) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:44:32 l75lg1-v1 dstat.sh[49771]: 28-05 12:44:32| 19 7 72 2 0|3402M 6090M 267M 5938M| 16k 17k| 68k 3587k|17.0 278 |8091 11k|1.56 1.78 1.27|3.0 0 227| 0 0 | 0 2048M| 26 158 0 21 0 May 28 12:44:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d935b1-9827-4424-b0ac-59f53e38018d None None] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:44:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d935b1-9827-4424-b0ac-59f53e38018d None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:44:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d935b1-9827-4424-b0ac-59f53e38018d None None] PATH_INFO: `/` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:44:32 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 471/926] 10.27.203.238 () {58 vars in 1010 bytes} [Tue May 28 12:44:32 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:44:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f994191-ee5b-4df0-bad3-feb25c757cf3 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:44:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f994191-ee5b-4df0-bad3-feb25c757cf3 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:44:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f994191-ee5b-4df0-bad3-feb25c757cf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:44:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG dbcounter [-] [51266] Writing DB stats keystone:SELECT=122 {{(pid=51266) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:44:32 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-9f994191-ee5b-4df0-bad3-feb25c757cf3 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:44:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-9f994191-ee5b-4df0-bad3-feb25c757cf3 None None] MFA Rules not processed for user `c3fe870f285d4169bd917382dd02d7b0`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:44:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-9f994191-ee5b-4df0-bad3-feb25c757cf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:44:32 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 456/927] 10.27.203.238 () {62 vars in 1107 bytes} [Tue May 28 12:44:32 2024] POST /identity/v3/auth/tokens => generated 4060 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:44:32 l75lg1-v1 devstack@placement-api.service[78202]: DEBUG placement.requestlog [None req-4a928847-2c51-45ae-9e2e-3e6a56b18251 None None] Starting request: 10.27.203.238 "GET /placement/" {{(pid=78202) __call__ /opt/stack/placement/placement/requestlog.py:55}} May 28 12:44:32 l75lg1-v1 devstack@placement-api.service[78202]: INFO placement.requestlog [None req-4a928847-2c51-45ae-9e2e-3e6a56b18251 None None] 10.27.203.238 "GET /placement/" status: 200 len: 136 microversion: 1.0 May 28 12:44:32 l75lg1-v1 devstack@placement-api.service[78202]: [pid: 78202|app: 0|req: 2/3] 10.27.203.238 () {58 vars in 1005 bytes} [Tue May 28 12:44:32 2024] GET /placement => generated 136 bytes in 1 msecs (HTTP/1.1 200) 6 headers in 224 bytes (1 switches on core 0) May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: INFO dbcounter [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] Registered counter for database nova_api May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_db.sqlalchemy.engines [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82177) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:342}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG dbcounter [-] [82177] Writer thread running {{(pid=82177) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG nova.context [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),07f8d545-d202-434b-a916-12ac42ffae61(cell1) {{(pid=82177) load_cells /opt/stack/nova/nova/context.py:464}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_concurrency.lockutils [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=82177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_concurrency.lockutils [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_concurrency.lockutils [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_concurrency.lockutils [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] Acquiring lock "07f8d545-d202-434b-a916-12ac42ffae61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=82177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_concurrency.lockutils [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] Lock "07f8d545-d202-434b-a916-12ac42ffae61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_concurrency.lockutils [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] Lock "07f8d545-d202-434b-a916-12ac42ffae61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: INFO dbcounter [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] Registered counter for database nova_cell0 May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: INFO dbcounter [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] Registered counter for database nova_cell1 May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_db.sqlalchemy.engines [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82177) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:342}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_db.sqlalchemy.engines [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82177) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:342}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG dbcounter [-] [82177] Writer thread running {{(pid=82177) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG dbcounter [-] [82177] Writer thread running {{(pid=82177) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_concurrency.lockutils [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] Acquiring lock "singleton_lock" {{(pid=82177) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_concurrency.lockutils [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] Acquired lock "singleton_lock" {{(pid=82177) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_concurrency.lockutils [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] Releasing lock "singleton_lock" {{(pid=82177) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: INFO oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] Starting 2 workers May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] Started child 83229 {{(pid=82177) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:579}} May 28 12:44:32 l75lg1-v1 nova-conductor[83229]: INFO nova.service [-] Starting conductor node (version 29.1.0) May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] Started child 83233 {{(pid=82177) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:579}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] Full set of CONF: {{(pid=82177) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:653}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] ******************************************************************************** {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2600}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] Configuration options gathered from: {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2601}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] command line args: ['--config-file', '/etc/nova/nova.conf'] {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] config files: ['/etc/nova/nova.conf'] {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2603}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] ================================================================================ {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2605}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] allow_resize_to_same_host = True {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] arq_binding_timeout = 300 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] block_device_allocate_retries = 60 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] block_device_allocate_retries_interval = 3 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] cert = self.pem {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] compute_driver = libvirt.LibvirtDriver {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:32 l75lg1-v1 nova-conductor[83233]: INFO nova.service [-] Starting conductor node (version 29.1.0) May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] compute_monitors = [] {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:32 l75lg1-v1 nova-conductor[83229]: INFO dbcounter [None req-548887bf-3ec6-4a2b-8940-78b7ec83c8c4 None None] Registered counter for database nova_cell0 May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] config_dir = [] {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] config_drive_format = iso9660 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] config_file = ['/etc/nova/nova.conf'] {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] config_source = [] {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] console_host = l75lg1-v1 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] control_exchange = nova {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] cpu_allocation_ratio = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] daemon = False {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] debug = True {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] default_access_ip_network_name = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] default_availability_zone = nova {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] default_ephemeral_format = ext4 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] default_green_pool_size = 1000 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] default_schedule_zone = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] disk_allocation_ratio = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] enable_new_services = True {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] enabled_apis = ['osapi_compute'] {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] enabled_ssl_apis = [] {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] flat_injected = False {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] force_config_drive = False {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] force_raw_images = True {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] graceful_shutdown_timeout = 5 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] heal_instance_info_cache_interval = 60 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] host = l75lg1-v1 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] initial_cpu_allocation_ratio = 4.0 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] initial_disk_allocation_ratio = 1.0 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] initial_ram_allocation_ratio = 1.0 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] instance_build_timeout = 0 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] instance_delete_interval = 300 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] instance_format = [instance: %(uuid)s] {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] instance_name_template = instance-%08x {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] instance_usage_audit = False {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] instance_usage_audit_period = month {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] instances_path = /opt/stack/data/nova/instances {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] internal_service_availability_zone = internal {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:32 l75lg1-v1 nova-conductor[83229]: DEBUG oslo_db.sqlalchemy.engines [None req-548887bf-3ec6-4a2b-8940-78b7ec83c8c4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83229) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:342}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] key = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] live_migration_retry_count = 30 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] log_config_append = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] log_dir = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] log_file = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] log_options = True {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] log_rotate_interval = 1 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:32 l75lg1-v1 nova-conductor[83233]: INFO dbcounter [None req-2b874e5a-ed68-429d-aa58-b43d4f2cac73 None None] Registered counter for database nova_cell0 May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] log_rotate_interval_type = days {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] log_rotation_type = none {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] long_rpc_timeout = 1800 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] max_concurrent_builds = 10 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] max_concurrent_live_migrations = 1 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] max_concurrent_snapshots = 5 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] max_local_block_devices = 3 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] max_logfile_count = 30 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] max_logfile_size_mb = 200 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] maximum_instance_delete_attempts = 5 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] metadata_listen = 0.0.0.0 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] metadata_listen_port = 8775 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] metadata_workers = 2 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] migrate_max_retries = -1 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] mkisofs_cmd = genisoimage {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] my_block_storage_ip = 10.27.203.238 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] my_ip = 10.27.203.238 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] network_allocate_retries = 0 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] osapi_compute_listen = 0.0.0.0 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] osapi_compute_listen_port = 8774 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] osapi_compute_unique_server_name_scope = {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] osapi_compute_workers = 2 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] password_length = 12 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] periodic_enable = True {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] periodic_fuzzy_delay = 60 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] pointer_model = ps2mouse {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] preallocate_images = none {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] publish_errors = False {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] pybasedir = /opt/stack/nova {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] ram_allocation_ratio = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] rate_limit_burst = 0 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] rate_limit_except_level = CRITICAL {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] rate_limit_interval = 0 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] reboot_timeout = 0 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] reclaim_instance_interval = 0 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] record = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] reimage_timeout_per_gb = 20 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] report_interval = 120 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:32 l75lg1-v1 nova-conductor[83229]: DEBUG dbcounter [-] [83229] Writer thread running {{(pid=83229) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] rescue_timeout = 0 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] reserved_host_cpus = 0 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] reserved_host_disk_mb = 0 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] reserved_host_memory_mb = 512 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] reserved_huge_pages = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] resize_confirm_window = 0 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] resize_fs_using_block_device = False {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] resume_guests_state_on_host_boot = False {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] rpc_response_timeout = 60 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] run_external_periodic_tasks = True {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] running_deleted_instance_action = reap {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] running_deleted_instance_poll_interval = 1800 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] running_deleted_instance_timeout = 0 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] scheduler_instance_sync_interval = 120 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] service_down_time = 720 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] servicegroup_driver = db {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] shelved_offload_time = 0 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] shelved_poll_interval = 3600 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] shutdown_timeout = 0 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] source_is_ipv6 = False {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] ssl_only = False {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] state_path = /opt/stack/data/nova {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] sync_power_state_interval = 600 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] sync_power_state_pool_size = 1000 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] syslog_log_facility = LOG_USER {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] tempdir = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] timeout_nbd = 10 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] transport_url = **** {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] update_resources_interval = 0 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] use_cow_images = True {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] use_eventlog = False {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] use_journal = False {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] use_json = False {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] use_rootwrap_daemon = False {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] use_stderr = False {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] use_syslog = False {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] vcpu_pin_set = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] vif_plugging_is_fatal = True {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] vif_plugging_timeout = 300 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] virt_mkfs = [] {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] volume_usage_poll_interval = 0 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] watch_log_file = False {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] web = /usr/share/spice-html5 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] oslo_concurrency.disable_process_locking = False {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[83233]: DEBUG oslo_db.sqlalchemy.engines [None req-2b874e5a-ed68-429d-aa58-b43d4f2cac73 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83233) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:342}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] api.auth_strategy = keystone {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] api.compute_link_prefix = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] api.dhcp_domain = novalocal {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] api.enable_instance_password = True {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] api.glance_link_prefix = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] api.instance_list_per_project_cells = False {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] api.list_records_by_skipping_down_cells = True {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] api.local_metadata_per_cell = False {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] api.max_limit = 1000 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] api.metadata_cache_expiration = 15 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] api.neutron_default_tenant_id = default {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] api.use_neutron_default_nets = False {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] api.vendordata_dynamic_ssl_certfile = {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] api.vendordata_dynamic_targets = [] {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] api.vendordata_jsonfile_path = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] api.vendordata_providers = ['StaticJSON'] {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] cache.backend = dogpile.cache.memcached {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] cache.backend_argument = **** {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] cache.config_prefix = cache.oslo {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] cache.dead_timeout = 60.0 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] cache.debug_cache_backend = False {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] cache.enable_retry_client = False {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] cache.enable_socket_keepalive = False {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] cache.enabled = True {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] cache.enforce_fips_mode = False {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] cache.expiration_time = 600 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] cache.hashclient_retry_attempts = 2 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] cache.hashclient_retry_delay = 1.0 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] cache.memcache_dead_retry = 300 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] cache.memcache_password = **** {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] cache.memcache_pool_maxsize = 10 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] cache.memcache_sasl_enabled = False {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] cache.memcache_socket_timeout = 1.0 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] cache.memcache_username = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] cache.proxies = [] {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] cache.redis_password = **** {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] cache.redis_sentinel_service_name = mymaster {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[83229]: DEBUG nova.service [None req-548887bf-3ec6-4a2b-8940-78b7ec83c8c4 None None] Creating RPC server for service conductor {{(pid=83229) start /opt/stack/nova/nova/service.py:186}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] cache.redis_server = localhost:6379 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] cache.redis_socket_timeout = 1.0 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] cache.redis_username = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] cache.retry_attempts = 2 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] cache.retry_delay = 0.0 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] cache.socket_keepalive_count = 1 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] cache.socket_keepalive_idle = 1 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] cache.socket_keepalive_interval = 1 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] cache.tls_allowed_ciphers = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] cache.tls_cafile = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] cache.tls_certfile = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] cache.tls_enabled = False {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] cache.tls_keyfile = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] cinder.auth_section = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] cinder.auth_type = password {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] cinder.cafile = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] cinder.catalog_info = volumev3::publicURL {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] cinder.certfile = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] cinder.collect_timing = False {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] cinder.cross_az_attach = True {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] cinder.debug = False {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] cinder.endpoint_template = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] cinder.http_retries = 3 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] cinder.insecure = False {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] cinder.keyfile = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] cinder.os_region_name = RegionOne {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] cinder.split_loggers = False {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] cinder.timeout = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] compute.cpu_dedicated_set = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] compute.cpu_shared_set = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] compute.image_type_exclude_list = [] {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] compute.max_concurrent_disk_ops = 0 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] compute.max_disk_devices_to_attach = -1 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] compute.resource_provider_association_refresh = 300 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] compute.shutdown_retry_interval = 10 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] conductor.workers = 2 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] console.allowed_origins = [] {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] console.ssl_ciphers = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] console.ssl_minimum_version = default {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] consoleauth.enforce_session_timeout = False {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] consoleauth.token_ttl = 600 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] cyborg.cafile = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] cyborg.certfile = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] cyborg.collect_timing = False {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] cyborg.connect_retries = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] cyborg.connect_retry_delay = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] cyborg.endpoint_override = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] cyborg.insecure = False {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] cyborg.keyfile = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] cyborg.max_version = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] cyborg.min_version = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] cyborg.region_name = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] cyborg.retriable_status_codes = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] cyborg.service_name = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] cyborg.service_type = accelerator {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] cyborg.split_loggers = False {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] cyborg.status_code_retries = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] cyborg.status_code_retry_delay = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] cyborg.timeout = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] cyborg.version = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] database.backend = sqlalchemy {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] database.connection = **** {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] database.connection_debug = 0 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] database.connection_parameters = {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] database.connection_recycle_time = 3600 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] database.connection_trace = False {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] database.db_inc_retry_interval = True {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] database.db_max_retries = 20 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] database.db_max_retry_interval = 10 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] database.db_retry_interval = 1 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] database.max_overflow = 50 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] database.max_pool_size = 5 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] database.max_retries = 10 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] database.mysql_wsrep_sync_wait = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] database.pool_timeout = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] database.retry_interval = 10 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] database.slave_connection = **** {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] database.sqlite_synchronous = True {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] database.use_db_reconnect = False {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] api_database.backend = sqlalchemy {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] api_database.connection = **** {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] api_database.connection_debug = 0 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] api_database.connection_parameters = {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] api_database.connection_recycle_time = 3600 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] api_database.connection_trace = False {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] api_database.db_inc_retry_interval = True {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] api_database.db_max_retries = 20 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] api_database.db_max_retry_interval = 10 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] api_database.db_retry_interval = 1 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] api_database.max_overflow = 50 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] api_database.max_pool_size = 5 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] api_database.max_retries = 10 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] api_database.mysql_sql_mode = TRADITIONAL {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] api_database.pool_timeout = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] api_database.retry_interval = 10 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] api_database.slave_connection = **** {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[83233]: DEBUG dbcounter [-] [83233] Writer thread running {{(pid=83233) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] api_database.sqlite_synchronous = True {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] devices.enabled_mdev_types = [] {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] ephemeral_storage_encryption.default_format = luks {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] ephemeral_storage_encryption.enabled = False {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[83229]: INFO oslo.messaging._drivers.impl_rabbit [None req-548887bf-3ec6-4a2b-8940-78b7ec83c8c4 None None] Creating fanout queue: conductor_fanout_6ea59e4d1a05487886d6f9f5ac6ab799 May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] glance.api_servers = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] glance.cafile = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] glance.certfile = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] glance.collect_timing = False {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] glance.connect_retries = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] glance.connect_retry_delay = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] glance.debug = False {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[83233]: DEBUG nova.service [None req-2b874e5a-ed68-429d-aa58-b43d4f2cac73 None None] Creating RPC server for service conductor {{(pid=83233) start /opt/stack/nova/nova/service.py:186}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] glance.default_trusted_certificate_ids = [] {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] glance.enable_certificate_validation = False {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] glance.enable_rbd_download = False {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] glance.endpoint_override = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] glance.insecure = False {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] glance.keyfile = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] glance.max_version = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] glance.min_version = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] glance.num_retries = 3 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] glance.rbd_ceph_conf = {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] glance.rbd_connect_timeout = 5 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[83229]: DEBUG nova.service [None req-548887bf-3ec6-4a2b-8940-78b7ec83c8c4 None None] Join ServiceGroup membership for this service conductor {{(pid=83229) start /opt/stack/nova/nova/service.py:203}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] glance.rbd_pool = {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] glance.rbd_user = {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[83229]: DEBUG nova.servicegroup.drivers.db [None req-548887bf-3ec6-4a2b-8940-78b7ec83c8c4 None None] DB_Driver: join new ServiceGroup member l75lg1-v1 to the conductor group, service = {{(pid=83229) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] glance.region_name = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] glance.retriable_status_codes = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] glance.service_name = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] glance.service_type = image {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] glance.split_loggers = False {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] glance.status_code_retries = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] glance.status_code_retry_delay = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] glance.timeout = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] glance.valid_interfaces = ['internal', 'public'] {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] glance.verify_glance_signatures = False {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] glance.version = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] guestfs.debug = False {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] mks.enabled = False {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] image_cache.manager_interval = 2400 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] image_cache.precache_concurrency = 1 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] image_cache.remove_unused_base_images = True {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] image_cache.subdirectory_name = _base {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] ironic.api_max_retries = 60 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] ironic.api_retry_interval = 2 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] ironic.auth_section = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] ironic.auth_type = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] ironic.cafile = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] ironic.certfile = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] ironic.collect_timing = False {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] ironic.conductor_group = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] ironic.connect_retries = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] ironic.connect_retry_delay = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] ironic.endpoint_override = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] ironic.insecure = False {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] ironic.keyfile = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] ironic.max_version = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] ironic.min_version = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] ironic.peer_list = [] {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] ironic.region_name = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] ironic.retriable_status_codes = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] ironic.serial_console_state_timeout = 10 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] ironic.service_name = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] ironic.service_type = baremetal {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] ironic.shard = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] ironic.split_loggers = False {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] ironic.status_code_retries = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] ironic.status_code_retry_delay = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] ironic.timeout = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] ironic.valid_interfaces = ['internal', 'public'] {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] ironic.version = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] key_manager.fixed_key = **** {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] barbican.barbican_api_version = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] barbican.barbican_endpoint = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] barbican.barbican_endpoint_type = public {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] barbican.barbican_region_name = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] barbican.cafile = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] barbican.certfile = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] barbican.collect_timing = False {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] barbican.insecure = False {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] barbican.keyfile = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] barbican.number_of_retries = 60 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] barbican.retry_delay = 1 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] barbican.send_service_user_token = False {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] barbican.split_loggers = False {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] barbican.timeout = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] barbican.verify_ssl = True {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] barbican.verify_ssl_path = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] barbican_service_user.auth_section = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] barbican_service_user.auth_type = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:32 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] barbican_service_user.cafile = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] barbican_service_user.certfile = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] barbican_service_user.collect_timing = False {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] barbican_service_user.insecure = False {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] barbican_service_user.keyfile = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] barbican_service_user.split_loggers = False {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] barbican_service_user.timeout = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] vault.approle_role_id = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] vault.approle_secret_id = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] vault.cafile = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] vault.certfile = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] vault.collect_timing = False {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] vault.insecure = False {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] vault.keyfile = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] vault.kv_mountpoint = secret {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] vault.kv_path = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] vault.kv_version = 2 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] vault.namespace = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] vault.root_token_id = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] vault.split_loggers = False {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] vault.ssl_ca_crt_file = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] vault.timeout = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] vault.use_ssl = False {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] keystone.auth_section = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] keystone.auth_type = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] keystone.cafile = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] keystone.certfile = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] keystone.collect_timing = False {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] keystone.connect_retries = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] keystone.connect_retry_delay = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] keystone.endpoint_override = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] keystone.insecure = False {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] keystone.keyfile = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] keystone.max_version = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] keystone.min_version = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] keystone.region_name = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] keystone.retriable_status_codes = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] keystone.service_name = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] keystone.service_type = identity {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] keystone.split_loggers = False {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] keystone.status_code_retries = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] keystone.status_code_retry_delay = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] keystone.timeout = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] keystone.valid_interfaces = ['internal', 'public'] {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] keystone.version = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] libvirt.connection_uri = {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] libvirt.cpu_mode = custom {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] libvirt.cpu_model_extra_flags = [] {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: WARNING oslo_config.cfg [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] libvirt.cpu_models = ['Nehalem'] {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] libvirt.cpu_power_governor_high = performance {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] libvirt.cpu_power_governor_low = powersave {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] libvirt.cpu_power_management = False {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] libvirt.device_detach_attempts = 8 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] libvirt.device_detach_timeout = 20 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] libvirt.disk_cachemodes = [] {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] libvirt.disk_prefix = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] libvirt.enabled_perf_events = [] {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] libvirt.file_backed_memory = 0 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] libvirt.gid_maps = [] {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[83233]: INFO oslo.messaging._drivers.impl_rabbit [None req-2b874e5a-ed68-429d-aa58-b43d4f2cac73 None None] Creating fanout queue: conductor_fanout_9e2d2c253d6e4d5fbb31e7523de3cbee May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] libvirt.hw_disk_discard = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] libvirt.hw_machine_type = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] libvirt.images_rbd_ceph_conf = {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] libvirt.images_rbd_glance_store_name = {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] libvirt.images_rbd_pool = rbd {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] libvirt.images_type = default {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] libvirt.images_volume_group = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] libvirt.inject_key = False {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] libvirt.inject_partition = -2 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] libvirt.inject_password = False {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] libvirt.iscsi_iface = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] libvirt.iser_use_multipath = False {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] libvirt.live_migration_bandwidth = 0 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] libvirt.live_migration_downtime = 500 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] libvirt.live_migration_inbound_addr = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] libvirt.live_migration_permit_post_copy = False {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] libvirt.live_migration_scheme = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[83233]: DEBUG nova.service [None req-2b874e5a-ed68-429d-aa58-b43d4f2cac73 None None] Join ServiceGroup membership for this service conductor {{(pid=83233) start /opt/stack/nova/nova/service.py:203}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] libvirt.live_migration_timeout_action = abort {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] libvirt.live_migration_tunnelled = False {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[83233]: DEBUG nova.servicegroup.drivers.db [None req-2b874e5a-ed68-429d-aa58-b43d4f2cac73 None None] DB_Driver: join new ServiceGroup member l75lg1-v1 to the conductor group, service = {{(pid=83233) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: WARNING oslo_config.cfg [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: live_migration_uri is deprecated for removal in favor of two other options that May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: allow to change live migration scheme and target URI: ``live_migration_scheme`` May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: and ``live_migration_inbound_addr`` respectively. May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: ). Its value may be silently ignored in the future. May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] libvirt.live_migration_uri = qemu+ssh://vastdata@%s/system {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] libvirt.live_migration_with_native_tls = False {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] libvirt.max_queues = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] libvirt.migration_inbound_addr = 10.27.203.238 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] libvirt.nfs_mount_options = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] libvirt.num_iser_scan_tries = 5 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] libvirt.num_memory_encrypted_guests = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] libvirt.num_pcie_ports = 0 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] libvirt.num_volume_scan_tries = 5 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] libvirt.pmem_namespaces = [] {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] libvirt.quobyte_client_cfg = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] libvirt.rbd_connect_timeout = 5 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] libvirt.rbd_secret_uuid = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] libvirt.rbd_user = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] libvirt.remote_filesystem_transport = ssh {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] libvirt.rescue_image_id = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] libvirt.rescue_kernel_id = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] libvirt.rescue_ramdisk_id = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] libvirt.rng_dev_path = /dev/urandom {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] libvirt.rx_queue_size = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] libvirt.smbfs_mount_options = {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] libvirt.snapshot_compression = False {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] libvirt.snapshot_image_format = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] libvirt.sparse_logical_volumes = False {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] libvirt.swtpm_enabled = False {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] libvirt.swtpm_group = tss {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] libvirt.swtpm_user = tss {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] libvirt.sysinfo_serial = unique {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] libvirt.tb_cache_size = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] libvirt.tx_queue_size = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] libvirt.uid_maps = [] {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] libvirt.use_virtio_for_bridges = True {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] libvirt.virt_type = qemu {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] libvirt.volume_clear = zero {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] libvirt.volume_clear_size = 0 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] libvirt.volume_use_multipath = False {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] libvirt.vzstorage_cache_path = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] libvirt.vzstorage_mount_group = qemu {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] libvirt.vzstorage_mount_opts = [] {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] libvirt.vzstorage_mount_perms = 0770 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] libvirt.vzstorage_mount_user = stack {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] neutron.auth_section = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] neutron.auth_type = password {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] neutron.cafile = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] neutron.certfile = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] neutron.collect_timing = False {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] neutron.connect_retries = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] neutron.connect_retry_delay = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] neutron.default_floating_pool = public {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] neutron.endpoint_override = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] neutron.extension_sync_interval = 600 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] neutron.http_retries = 3 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] neutron.insecure = False {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] neutron.keyfile = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] neutron.max_version = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] neutron.min_version = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] neutron.ovs_bridge = br-int {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] neutron.physnets = [] {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] neutron.region_name = RegionOne {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] neutron.retriable_status_codes = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] neutron.service_metadata_proxy = True {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] neutron.service_name = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] neutron.service_type = network {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] neutron.split_loggers = False {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] neutron.status_code_retries = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] neutron.status_code_retry_delay = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] neutron.timeout = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] neutron.valid_interfaces = ['internal', 'public'] {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] neutron.version = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] notifications.bdms_in_notifications = False {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] notifications.default_level = INFO {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] notifications.notification_format = unversioned {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] notifications.notify_on_state_change = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] pci.alias = [] {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] pci.device_spec = [] {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] pci.report_in_placement = False {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] placement.auth_section = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] placement.auth_type = password {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] placement.auth_url = http://10.27.203.238/identity {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] placement.cafile = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] placement.certfile = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] placement.collect_timing = False {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] placement.connect_retries = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] placement.connect_retry_delay = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] placement.default_domain_id = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] placement.default_domain_name = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] placement.domain_id = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] placement.domain_name = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] placement.endpoint_override = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] placement.insecure = False {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] placement.keyfile = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] placement.max_version = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] placement.min_version = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] placement.password = **** {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] placement.project_domain_id = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] placement.project_domain_name = Default {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] placement.project_id = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] placement.project_name = service {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] placement.region_name = RegionOne {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] placement.retriable_status_codes = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] placement.service_name = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] placement.service_type = placement {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] placement.split_loggers = False {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] placement.status_code_retries = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] placement.status_code_retry_delay = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] placement.system_scope = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] placement.timeout = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] placement.trust_id = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] placement.user_domain_id = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] placement.user_domain_name = Default {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] placement.user_id = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] placement.username = placement {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] placement.valid_interfaces = ['internal', 'public'] {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] placement.version = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] quota.cores = 20 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] quota.count_usage_from_placement = False {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] quota.driver = nova.quota.DbQuotaDriver {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] quota.injected_file_content_bytes = 10240 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] quota.injected_file_path_length = 255 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] quota.injected_files = 5 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] quota.instances = 10 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] quota.key_pairs = 100 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] quota.metadata_items = 128 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] quota.ram = 51200 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] quota.recheck_quota = True {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] quota.server_group_members = 10 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] quota.server_groups = 10 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] scheduler.image_metadata_prefilter = False {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] scheduler.max_attempts = 3 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] scheduler.max_placement_results = 1000 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] scheduler.query_placement_for_image_type_support = False {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] scheduler.workers = 2 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] filter_scheduler.host_subset_size = 1 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] filter_scheduler.isolated_hosts = [] {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] filter_scheduler.isolated_images = [] {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] filter_scheduler.pci_in_placement = False {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] filter_scheduler.track_instance_changes = False {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] metrics.required = True {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] metrics.weight_multiplier = 1.0 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] metrics.weight_of_unavailable = -10000.0 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] metrics.weight_setting = [] {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] serial_console.enabled = False {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] serial_console.port_range = 10000:20000 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] serial_console.serialproxy_port = 6083 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] service_user.auth_section = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] service_user.auth_type = password {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] service_user.cafile = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] service_user.certfile = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] service_user.collect_timing = False {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] service_user.insecure = False {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] service_user.keyfile = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] service_user.send_service_user_token = True {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] service_user.split_loggers = False {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] service_user.timeout = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] spice.agent_enabled = True {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] spice.enabled = False {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] spice.html5proxy_host = 0.0.0.0 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] spice.html5proxy_port = 6082 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] spice.image_compression = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] spice.jpeg_compression = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] spice.playback_compression = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] spice.server_listen = 127.0.0.1 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] spice.streaming_mode = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] spice.zlib_compression = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] upgrade_levels.baseapi = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] upgrade_levels.compute = auto {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] upgrade_levels.conductor = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] upgrade_levels.scheduler = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] vendordata_dynamic_auth.auth_section = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] vendordata_dynamic_auth.auth_type = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] vendordata_dynamic_auth.cafile = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] vendordata_dynamic_auth.certfile = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] vendordata_dynamic_auth.insecure = False {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] vendordata_dynamic_auth.keyfile = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] vendordata_dynamic_auth.timeout = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] vmware.api_retry_count = 10 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] vmware.ca_file = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] vmware.cache_prefix = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] vmware.cluster_name = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] vmware.connection_pool_size = 10 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] vmware.console_delay_seconds = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] vmware.datastore_regex = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] vmware.host_ip = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] vmware.host_password = **** {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] vmware.host_port = 443 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] vmware.host_username = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] vmware.insecure = False {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] vmware.integration_bridge = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] vmware.maximum_objects = 100 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] vmware.pbm_default_policy = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] vmware.pbm_enabled = False {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] vmware.pbm_wsdl_location = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] vmware.serial_port_proxy_uri = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] vmware.serial_port_service_uri = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] vmware.task_poll_interval = 0.5 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] vmware.use_linked_clone = True {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] vmware.vnc_keymap = en-us {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] vmware.vnc_port = 5900 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] vmware.vnc_port_total = 10000 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] vnc.auth_schemes = ['none'] {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] vnc.enabled = True {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] vnc.novncproxy_host = 0.0.0.0 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] vnc.novncproxy_port = 6080 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] vnc.server_listen = 127.0.0.1 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] vnc.vencrypt_ca_certs = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] vnc.vencrypt_client_cert = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] vnc.vencrypt_client_key = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] workarounds.disable_group_policy_check_upcall = False {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] workarounds.disable_rootwrap = False {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] workarounds.enable_numa_live_migration = False {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] workarounds.libvirt_disable_apic = False {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] wsgi.client_socket_timeout = 900 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] wsgi.default_pool_size = 1000 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] wsgi.keep_alive = True {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] wsgi.max_header_line = 16384 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] wsgi.secure_proxy_ssl_header = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] wsgi.ssl_ca_file = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] wsgi.ssl_cert_file = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] wsgi.ssl_key_file = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] wsgi.tcp_keepidle = 600 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] zvm.ca_file = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] zvm.cloud_connector_url = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] zvm.reachable_timeout = 300 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] oslo_policy.enforce_new_defaults = True {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] oslo_policy.enforce_scope = True {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] oslo_policy.policy_default_rule = default {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] oslo_policy.policy_file = policy.yaml {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] profiler.connection_string = messaging:// {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] profiler.enabled = False {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] profiler.es_doc_type = notification {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] profiler.es_scroll_size = 10000 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] profiler.es_scroll_time = 2m {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] profiler.filter_error_trace = False {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] profiler.hmac_keys = **** {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] profiler.sentinel_service_name = mymaster {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] profiler.socket_timeout = 0.1 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] profiler.trace_requests = False {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] profiler.trace_sqlalchemy = False {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] profiler_jaeger.process_tags = {} {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] profiler_jaeger.service_name_prefix = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] profiler_otlp.service_name_prefix = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] remote_debug.host = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] remote_debug.port = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] oslo_messaging_rabbit.hostname = l75lg1-v1 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] oslo_messaging_rabbit.processname = nova-conductor {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] oslo_messaging_rabbit.ssl = False {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] oslo_messaging_rabbit.ssl_version = {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] oslo_messaging_notifications.retry = -1 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] oslo_messaging_notifications.transport_url = **** {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] oslo_limit.auth_section = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] oslo_limit.auth_type = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] oslo_limit.cafile = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] oslo_limit.certfile = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] oslo_limit.collect_timing = False {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] oslo_limit.connect_retries = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] oslo_limit.connect_retry_delay = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] oslo_limit.endpoint_id = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] oslo_limit.endpoint_override = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] oslo_limit.insecure = False {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] oslo_limit.keyfile = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] oslo_limit.max_version = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] oslo_limit.min_version = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] oslo_limit.region_name = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] oslo_limit.retriable_status_codes = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] oslo_limit.service_name = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] oslo_limit.service_type = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] oslo_limit.split_loggers = False {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] oslo_limit.status_code_retries = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] oslo_limit.status_code_retry_delay = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] oslo_limit.timeout = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] oslo_limit.valid_interfaces = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] oslo_limit.version = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] oslo_reports.file_event_handler = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] oslo_reports.log_dir = None {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:33 l75lg1-v1 nova-conductor[82177]: DEBUG oslo_service.service [None req-c92141ae-c212-40a5-8ccb-cfd32bfff607 None None] ******************************************************************************** {{(pid=82177) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2624}} May 28 12:44:33 l75lg1-v1 dstat.sh[49771]: 28-05 12:44:33| 23 11 65 0 0|3522M 5969M 267M 5939M| 23k 34k| 0 747k| 0 52.9 |7606 14k|1.56 1.78 1.27|2.0 0 585| 0 0 | 0 2048M| 26 170 0 21 0 May 28 12:44:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d646426-d7cf-4c53-900b-5a857f409a9b None None] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:44:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d646426-d7cf-4c53-900b-5a857f409a9b None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:44:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d646426-d7cf-4c53-900b-5a857f409a9b None None] PATH_INFO: `/` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:44:34 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 472/928] 10.27.203.238 () {58 vars in 1010 bytes} [Tue May 28 12:44:34 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:44:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183d7532-6117-480f-a748-62b5cd2a0a8f None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:44:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183d7532-6117-480f-a748-62b5cd2a0a8f None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:44:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183d7532-6117-480f-a748-62b5cd2a0a8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:44:34 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-183d7532-6117-480f-a748-62b5cd2a0a8f None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:44:34 l75lg1-v1 dstat.sh[49771]: 28-05 12:44:34| 16 8 75 0 0|3569M 5923M 267M 5940M| 17k 6710B| 136k 8892k|34.0 520 |8098 11k|1.56 1.78 1.27|4.0 0 230| 0 0 | 0 2048M| 26 171 0 21 0 May 28 12:44:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-183d7532-6117-480f-a748-62b5cd2a0a8f None None] MFA Rules not processed for user `c3fe870f285d4169bd917382dd02d7b0`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:44:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-183d7532-6117-480f-a748-62b5cd2a0a8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:44:34 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 457/929] 10.27.203.238 () {62 vars in 1107 bytes} [Tue May 28 12:44:34 2024] POST /identity/v3/auth/tokens => generated 4060 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:44:34 l75lg1-v1 devstack@placement-api.service[78201]: DEBUG placement.requestlog [None req-77cb6e0d-9079-41c4-b2cb-b89cae7f154a None None] Starting request: 10.27.203.238 "GET /placement/" {{(pid=78201) __call__ /opt/stack/placement/placement/requestlog.py:55}} May 28 12:44:34 l75lg1-v1 devstack@placement-api.service[78201]: INFO placement.requestlog [None req-77cb6e0d-9079-41c4-b2cb-b89cae7f154a None None] 10.27.203.238 "GET /placement/" status: 200 len: 136 microversion: 1.0 May 28 12:44:34 l75lg1-v1 devstack@placement-api.service[78201]: [pid: 78201|app: 0|req: 2/4] 10.27.203.238 () {58 vars in 1005 bytes} [Tue May 28 12:44:34 2024] GET /placement => generated 136 bytes in 1 msecs (HTTP/1.1 200) 6 headers in 224 bytes (1 switches on core 0) May 28 12:44:34 l75lg1-v1 neutron-server[77623]: DEBUG dbcounter [-] [77623] Writing DB stats neutron:SELECT=1 {{(pid=77623) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: INFO dbcounter [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] Registered counter for database nova_cell1 May 28 12:44:34 l75lg1-v1 neutron-server[77623]: DEBUG dbcounter [-] [77623] Writing DB stats neutron:SELECT=5,neutron:INSERT=657 {{(pid=77623) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_db.sqlalchemy.engines [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82643) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:342}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG dbcounter [-] [82643] Writer thread running {{(pid=82643) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_concurrency.lockutils [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] Acquiring lock "singleton_lock" {{(pid=82643) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_concurrency.lockutils [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] Acquired lock "singleton_lock" {{(pid=82643) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_concurrency.lockutils [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] Releasing lock "singleton_lock" {{(pid=82643) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: INFO oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] Starting 2 workers May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] Started child 83647 {{(pid=82643) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:579}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] Started child 83648 {{(pid=82643) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:579}} May 28 12:44:34 l75lg1-v1 nova-conductor[83647]: INFO nova.service [-] Starting conductor node (version 29.1.0) May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] Full set of CONF: {{(pid=82643) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:653}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] ******************************************************************************** {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2600}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] Configuration options gathered from: {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2601}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] command line args: ['--config-file', '/etc/nova/nova_cell1.conf'] {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] config files: ['/etc/nova/nova_cell1.conf'] {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2603}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] ================================================================================ {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2605}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] allow_resize_to_same_host = False {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] arq_binding_timeout = 300 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] block_device_allocate_retries = 60 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] block_device_allocate_retries_interval = 3 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] cert = self.pem {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] compute_driver = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] compute_monitors = [] {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] config_dir = [] {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] config_drive_format = iso9660 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] config_file = ['/etc/nova/nova_cell1.conf'] {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] config_source = [] {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] console_host = l75lg1-v1 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] control_exchange = nova {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] cpu_allocation_ratio = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] daemon = False {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] debug = True {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] default_access_ip_network_name = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] default_availability_zone = nova {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] default_ephemeral_format = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] default_green_pool_size = 1000 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] default_schedule_zone = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:34 l75lg1-v1 nova-conductor[83647]: DEBUG oslo_db.sqlalchemy.engines [None req-36c1eca8-05b4-4bd1-937e-ade189d77401 None None] Parent process 82643 forked (83647) with an open database connection, which is being discarded and recreated. {{(pid=83647) checkout /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:438}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] disk_allocation_ratio = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] enable_new_services = True {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] enabled_apis = ['osapi_compute', 'metadata'] {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] enabled_ssl_apis = [] {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] flat_injected = False {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] force_config_drive = False {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] force_raw_images = True {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] graceful_shutdown_timeout = 60 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] heal_instance_info_cache_interval = 60 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:34 l75lg1-v1 nova-conductor[83648]: INFO nova.service [-] Starting conductor node (version 29.1.0) May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] host = l75lg1-v1 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] initial_cpu_allocation_ratio = 4.0 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] initial_disk_allocation_ratio = 1.0 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] initial_ram_allocation_ratio = 1.0 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] instance_build_timeout = 0 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] instance_delete_interval = 300 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] instance_format = [instance: %(uuid)s] {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] instance_name_template = instance-%08x {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] instance_usage_audit = False {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] instance_usage_audit_period = month {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] instances_path = /opt/stack/nova/instances {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] internal_service_availability_zone = internal {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] key = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] live_migration_retry_count = 30 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] log_config_append = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] log_dir = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] log_file = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] log_options = True {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] log_rotate_interval = 1 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] log_rotate_interval_type = days {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] log_rotation_type = none {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:34 l75lg1-v1 nova-conductor[83647]: DEBUG dbcounter [-] [83647] Writer thread running {{(pid=83647) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] long_rpc_timeout = 1800 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] max_concurrent_builds = 10 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] max_concurrent_live_migrations = 1 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] max_concurrent_snapshots = 5 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] max_local_block_devices = 3 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] max_logfile_count = 30 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] max_logfile_size_mb = 200 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] maximum_instance_delete_attempts = 5 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] metadata_listen = 0.0.0.0 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] metadata_listen_port = 8775 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] metadata_workers = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] migrate_max_retries = -1 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] mkisofs_cmd = genisoimage {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] my_block_storage_ip = 10.27.203.238 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] my_ip = 10.27.203.238 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] network_allocate_retries = 0 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] osapi_compute_listen = 0.0.0.0 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] osapi_compute_listen_port = 8774 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] osapi_compute_unique_server_name_scope = {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] osapi_compute_workers = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] password_length = 12 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] periodic_enable = True {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] periodic_fuzzy_delay = 60 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] pointer_model = usbtablet {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] preallocate_images = none {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] publish_errors = False {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] pybasedir = /opt/stack/nova {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] ram_allocation_ratio = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] rate_limit_burst = 0 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] rate_limit_except_level = CRITICAL {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] rate_limit_interval = 0 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] reboot_timeout = 0 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] reclaim_instance_interval = 0 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] record = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] reimage_timeout_per_gb = 20 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] report_interval = 10 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] rescue_timeout = 0 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] reserved_host_cpus = 0 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] reserved_host_disk_mb = 0 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] reserved_host_memory_mb = 512 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] reserved_huge_pages = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] resize_confirm_window = 0 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] resize_fs_using_block_device = False {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] resume_guests_state_on_host_boot = False {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] rpc_response_timeout = 60 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] run_external_periodic_tasks = True {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] running_deleted_instance_action = reap {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] running_deleted_instance_poll_interval = 1800 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] running_deleted_instance_timeout = 0 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] scheduler_instance_sync_interval = 120 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] service_down_time = 60 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] servicegroup_driver = db {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] shelved_offload_time = 0 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] shelved_poll_interval = 3600 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] shutdown_timeout = 60 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] source_is_ipv6 = False {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] ssl_only = False {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] state_path = /opt/stack/nova {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] sync_power_state_interval = 600 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] sync_power_state_pool_size = 1000 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] syslog_log_facility = LOG_USER {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] tempdir = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] timeout_nbd = 10 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] transport_url = **** {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] update_resources_interval = 0 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] use_cow_images = True {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] use_eventlog = False {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] use_journal = False {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] use_json = False {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] use_rootwrap_daemon = False {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] use_stderr = False {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] use_syslog = False {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] vcpu_pin_set = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] vif_plugging_is_fatal = True {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] vif_plugging_timeout = 300 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] virt_mkfs = [] {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] volume_usage_poll_interval = 0 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] watch_log_file = False {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] web = /usr/share/spice-html5 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] oslo_concurrency.disable_process_locking = False {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] oslo_concurrency.lock_path = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[83648]: DEBUG dbcounter [-] [83648] Writer thread running {{(pid=83648) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] api.auth_strategy = keystone {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] api.compute_link_prefix = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] api.dhcp_domain = novalocal {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] api.enable_instance_password = True {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] api.glance_link_prefix = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] api.instance_list_per_project_cells = False {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] api.list_records_by_skipping_down_cells = True {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] api.local_metadata_per_cell = False {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] api.max_limit = 1000 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] api.metadata_cache_expiration = 15 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] api.neutron_default_tenant_id = default {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] api.use_neutron_default_nets = False {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] api.vendordata_dynamic_ssl_certfile = {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] api.vendordata_dynamic_targets = [] {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] api.vendordata_jsonfile_path = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] api.vendordata_providers = ['StaticJSON'] {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] cache.backend = dogpile.cache.null {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] cache.backend_argument = **** {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] cache.config_prefix = cache.oslo {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] cache.dead_timeout = 60.0 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] cache.debug_cache_backend = False {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] cache.enable_retry_client = False {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] cache.enable_socket_keepalive = False {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] cache.enabled = False {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[83647]: DEBUG nova.service [None req-36c1eca8-05b4-4bd1-937e-ade189d77401 None None] Creating RPC server for service conductor {{(pid=83647) start /opt/stack/nova/nova/service.py:186}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] cache.enforce_fips_mode = False {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] cache.expiration_time = 600 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] cache.hashclient_retry_attempts = 2 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] cache.hashclient_retry_delay = 1.0 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] cache.memcache_dead_retry = 300 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] cache.memcache_password = **** {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] cache.memcache_pool_maxsize = 10 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] cache.memcache_sasl_enabled = False {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] cache.memcache_socket_timeout = 1.0 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] cache.memcache_username = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] cache.proxies = [] {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] cache.redis_password = **** {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] cache.redis_sentinel_service_name = mymaster {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] cache.redis_server = localhost:6379 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] cache.redis_socket_timeout = 1.0 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] cache.redis_username = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] cache.retry_attempts = 2 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] cache.retry_delay = 0.0 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] cache.socket_keepalive_count = 1 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] cache.socket_keepalive_idle = 1 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] cache.socket_keepalive_interval = 1 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] cache.tls_allowed_ciphers = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] cache.tls_cafile = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] cache.tls_certfile = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] cache.tls_enabled = False {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] cache.tls_keyfile = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] cinder.auth_section = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] cinder.auth_type = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] cinder.cafile = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] cinder.catalog_info = volumev3::publicURL {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] cinder.certfile = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] cinder.collect_timing = False {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] cinder.cross_az_attach = True {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] cinder.debug = False {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] cinder.endpoint_template = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] cinder.http_retries = 3 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] cinder.insecure = False {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] cinder.keyfile = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] cinder.os_region_name = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] cinder.split_loggers = False {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] cinder.timeout = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] compute.cpu_dedicated_set = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] compute.cpu_shared_set = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] compute.image_type_exclude_list = [] {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] compute.max_concurrent_disk_ops = 0 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] compute.max_disk_devices_to_attach = -1 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] compute.resource_provider_association_refresh = 300 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] compute.shutdown_retry_interval = 10 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] conductor.workers = 2 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] console.allowed_origins = [] {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] console.ssl_ciphers = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] console.ssl_minimum_version = default {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] consoleauth.enforce_session_timeout = False {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] consoleauth.token_ttl = 600 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] cyborg.cafile = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] cyborg.certfile = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] cyborg.collect_timing = False {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] cyborg.connect_retries = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] cyborg.connect_retry_delay = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] cyborg.endpoint_override = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] cyborg.insecure = False {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] cyborg.keyfile = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] cyborg.max_version = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] cyborg.min_version = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] cyborg.region_name = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] cyborg.retriable_status_codes = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] cyborg.service_name = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] cyborg.service_type = accelerator {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] cyborg.split_loggers = False {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] cyborg.status_code_retries = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] cyborg.status_code_retry_delay = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] cyborg.timeout = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] cyborg.version = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] database.backend = sqlalchemy {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] database.connection = **** {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] database.connection_debug = 0 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] database.connection_parameters = {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] database.connection_recycle_time = 3600 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] database.connection_trace = False {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] database.db_inc_retry_interval = True {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] database.db_max_retries = 20 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] database.db_max_retry_interval = 10 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] database.db_retry_interval = 1 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] database.max_overflow = 50 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] database.max_pool_size = 5 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] database.max_retries = 10 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] database.mysql_wsrep_sync_wait = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] database.pool_timeout = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] database.retry_interval = 10 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] database.slave_connection = **** {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] database.sqlite_synchronous = True {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] database.use_db_reconnect = False {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] api_database.backend = sqlalchemy {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] api_database.connection = **** {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] api_database.connection_debug = 0 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] api_database.connection_parameters = {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] api_database.connection_recycle_time = 3600 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] api_database.connection_trace = False {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] api_database.db_inc_retry_interval = True {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] api_database.db_max_retries = 20 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] api_database.db_max_retry_interval = 10 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] api_database.db_retry_interval = 1 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] api_database.max_overflow = 50 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] api_database.max_pool_size = 5 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] api_database.max_retries = 10 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[83648]: DEBUG nova.service [None req-20beb4eb-2eff-4a68-884b-e2270519b97e None None] Creating RPC server for service conductor {{(pid=83648) start /opt/stack/nova/nova/service.py:186}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] api_database.mysql_sql_mode = TRADITIONAL {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] api_database.pool_timeout = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] api_database.retry_interval = 10 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] api_database.slave_connection = **** {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] api_database.sqlite_synchronous = True {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] devices.enabled_mdev_types = [] {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] ephemeral_storage_encryption.default_format = luks {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] ephemeral_storage_encryption.enabled = False {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] glance.api_servers = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] glance.cafile = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] glance.certfile = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] glance.collect_timing = False {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] glance.connect_retries = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] glance.connect_retry_delay = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] glance.debug = False {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] glance.default_trusted_certificate_ids = [] {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[83647]: INFO oslo.messaging._drivers.impl_rabbit [None req-36c1eca8-05b4-4bd1-937e-ade189d77401 None None] Creating fanout queue: conductor_fanout_c60acc890e56488fb33a878b79ce9659 May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] glance.enable_certificate_validation = False {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] glance.enable_rbd_download = False {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] glance.endpoint_override = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] glance.insecure = False {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] glance.keyfile = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] glance.max_version = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] glance.min_version = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] glance.num_retries = 3 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] glance.rbd_ceph_conf = {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] glance.rbd_connect_timeout = 5 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] glance.rbd_pool = {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] glance.rbd_user = {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] glance.region_name = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] glance.retriable_status_codes = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] glance.service_name = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] glance.service_type = image {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] glance.split_loggers = False {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] glance.status_code_retries = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] glance.status_code_retry_delay = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] glance.timeout = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] glance.valid_interfaces = ['internal', 'public'] {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] glance.verify_glance_signatures = False {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] glance.version = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] guestfs.debug = False {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] mks.enabled = False {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[83647]: DEBUG nova.service [None req-36c1eca8-05b4-4bd1-937e-ade189d77401 None None] Join ServiceGroup membership for this service conductor {{(pid=83647) start /opt/stack/nova/nova/service.py:203}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] image_cache.manager_interval = 2400 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[83647]: DEBUG nova.servicegroup.drivers.db [None req-36c1eca8-05b4-4bd1-937e-ade189d77401 None None] DB_Driver: join new ServiceGroup member l75lg1-v1 to the conductor group, service = {{(pid=83647) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] image_cache.precache_concurrency = 1 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] image_cache.remove_unused_base_images = True {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] image_cache.subdirectory_name = _base {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] ironic.api_max_retries = 60 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] ironic.api_retry_interval = 2 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] ironic.auth_section = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] ironic.auth_type = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] ironic.cafile = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] ironic.certfile = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] ironic.collect_timing = False {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] ironic.conductor_group = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] ironic.connect_retries = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] ironic.connect_retry_delay = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] ironic.endpoint_override = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] ironic.insecure = False {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] ironic.keyfile = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] ironic.max_version = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] ironic.min_version = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] ironic.peer_list = [] {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] ironic.region_name = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] ironic.retriable_status_codes = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] ironic.serial_console_state_timeout = 10 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] ironic.service_name = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] ironic.service_type = baremetal {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] ironic.shard = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] ironic.split_loggers = False {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] ironic.status_code_retries = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] ironic.status_code_retry_delay = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] ironic.timeout = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] ironic.valid_interfaces = ['internal', 'public'] {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] ironic.version = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] key_manager.backend = barbican {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] key_manager.fixed_key = **** {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] barbican.barbican_api_version = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] barbican.barbican_endpoint = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] barbican.barbican_endpoint_type = public {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] barbican.barbican_region_name = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] barbican.cafile = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] barbican.certfile = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] barbican.collect_timing = False {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] barbican.insecure = False {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] barbican.keyfile = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] barbican.number_of_retries = 60 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] barbican.retry_delay = 1 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] barbican.send_service_user_token = False {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] barbican.split_loggers = False {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] barbican.timeout = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] barbican.verify_ssl = True {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] barbican.verify_ssl_path = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] barbican_service_user.auth_section = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] barbican_service_user.auth_type = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] barbican_service_user.cafile = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] barbican_service_user.certfile = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] barbican_service_user.collect_timing = False {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] barbican_service_user.insecure = False {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] barbican_service_user.keyfile = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] barbican_service_user.split_loggers = False {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] barbican_service_user.timeout = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] vault.approle_role_id = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] vault.approle_secret_id = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] vault.cafile = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] vault.certfile = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] vault.collect_timing = False {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] vault.insecure = False {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] vault.keyfile = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] vault.kv_mountpoint = secret {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] vault.kv_path = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] vault.kv_version = 2 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] vault.namespace = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] vault.root_token_id = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] vault.split_loggers = False {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] vault.ssl_ca_crt_file = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] vault.timeout = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] vault.use_ssl = False {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] keystone.auth_section = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] keystone.auth_type = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] keystone.cafile = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] keystone.certfile = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] keystone.collect_timing = False {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] keystone.connect_retries = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] keystone.connect_retry_delay = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] keystone.endpoint_override = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] keystone.insecure = False {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] keystone.keyfile = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] keystone.max_version = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] keystone.min_version = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] keystone.region_name = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] keystone.retriable_status_codes = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] keystone.service_name = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] keystone.service_type = identity {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] keystone.split_loggers = False {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] keystone.status_code_retries = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] keystone.status_code_retry_delay = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] keystone.timeout = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] keystone.valid_interfaces = ['internal', 'public'] {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] keystone.version = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] libvirt.connection_uri = {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[83648]: INFO oslo.messaging._drivers.impl_rabbit [None req-20beb4eb-2eff-4a68-884b-e2270519b97e None None] Creating fanout queue: conductor_fanout_2e00079f8a2e4fa286a168cd0e04b050 May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] libvirt.cpu_mode = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] libvirt.cpu_model_extra_flags = [] {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] libvirt.cpu_models = [] {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] libvirt.cpu_power_governor_high = performance {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] libvirt.cpu_power_governor_low = powersave {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] libvirt.cpu_power_management = False {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] libvirt.device_detach_attempts = 8 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] libvirt.device_detach_timeout = 20 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] libvirt.disk_cachemodes = [] {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] libvirt.disk_prefix = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] libvirt.enabled_perf_events = [] {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] libvirt.file_backed_memory = 0 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] libvirt.gid_maps = [] {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] libvirt.hw_disk_discard = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] libvirt.hw_machine_type = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] libvirt.images_rbd_ceph_conf = {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] libvirt.images_rbd_glance_store_name = {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] libvirt.images_rbd_pool = rbd {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] libvirt.images_type = default {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] libvirt.images_volume_group = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] libvirt.inject_key = False {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] libvirt.inject_partition = -2 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] libvirt.inject_password = False {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] libvirt.iscsi_iface = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] libvirt.iser_use_multipath = False {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] libvirt.live_migration_bandwidth = 0 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] libvirt.live_migration_downtime = 500 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] libvirt.live_migration_inbound_addr = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[83648]: DEBUG nova.service [None req-20beb4eb-2eff-4a68-884b-e2270519b97e None None] Join ServiceGroup membership for this service conductor {{(pid=83648) start /opt/stack/nova/nova/service.py:203}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] libvirt.live_migration_permit_post_copy = False {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] libvirt.live_migration_scheme = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] libvirt.live_migration_timeout_action = abort {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] libvirt.live_migration_tunnelled = False {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[83648]: DEBUG nova.servicegroup.drivers.db [None req-20beb4eb-2eff-4a68-884b-e2270519b97e None None] DB_Driver: join new ServiceGroup member l75lg1-v1 to the conductor group, service = {{(pid=83648) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] libvirt.live_migration_uri = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] libvirt.live_migration_with_native_tls = False {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] libvirt.max_queues = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] libvirt.migration_inbound_addr = 10.27.203.238 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] libvirt.nfs_mount_options = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] libvirt.nfs_mount_point_base = /opt/stack/nova/mnt {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] libvirt.num_iser_scan_tries = 5 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] libvirt.num_memory_encrypted_guests = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] libvirt.num_pcie_ports = 0 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] libvirt.num_volume_scan_tries = 5 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] libvirt.pmem_namespaces = [] {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] libvirt.quobyte_client_cfg = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] libvirt.quobyte_mount_point_base = /opt/stack/nova/mnt {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] libvirt.rbd_connect_timeout = 5 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] libvirt.rbd_secret_uuid = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] libvirt.rbd_user = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] libvirt.remote_filesystem_transport = ssh {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] libvirt.rescue_image_id = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] libvirt.rescue_kernel_id = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] libvirt.rescue_ramdisk_id = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] libvirt.rng_dev_path = /dev/urandom {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] libvirt.rx_queue_size = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] libvirt.smbfs_mount_options = {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] libvirt.smbfs_mount_point_base = /opt/stack/nova/mnt {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] libvirt.snapshot_compression = False {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] libvirt.snapshot_image_format = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] libvirt.snapshots_directory = /opt/stack/nova/instances/snapshots {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] libvirt.sparse_logical_volumes = False {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] libvirt.swtpm_enabled = False {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] libvirt.swtpm_group = tss {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] libvirt.swtpm_user = tss {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] libvirt.sysinfo_serial = unique {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] libvirt.tb_cache_size = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] libvirt.tx_queue_size = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] libvirt.uid_maps = [] {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] libvirt.use_virtio_for_bridges = True {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] libvirt.virt_type = kvm {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] libvirt.volume_clear = zero {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] libvirt.volume_clear_size = 0 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] libvirt.volume_use_multipath = False {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] libvirt.vzstorage_cache_path = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] libvirt.vzstorage_mount_group = qemu {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] libvirt.vzstorage_mount_opts = [] {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] libvirt.vzstorage_mount_perms = 0770 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] libvirt.vzstorage_mount_point_base = /opt/stack/nova/mnt {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] libvirt.vzstorage_mount_user = stack {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] neutron.auth_section = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] neutron.auth_type = password {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] neutron.cafile = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] neutron.certfile = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] neutron.collect_timing = False {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] neutron.connect_retries = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] neutron.connect_retry_delay = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] neutron.default_floating_pool = nova {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] neutron.endpoint_override = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] neutron.extension_sync_interval = 600 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] neutron.http_retries = 3 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] neutron.insecure = False {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] neutron.keyfile = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] neutron.max_version = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] neutron.min_version = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] neutron.ovs_bridge = br-int {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] neutron.physnets = [] {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] neutron.region_name = RegionOne {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] neutron.retriable_status_codes = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] neutron.service_metadata_proxy = False {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] neutron.service_name = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] neutron.service_type = network {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] neutron.split_loggers = False {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] neutron.status_code_retries = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] neutron.status_code_retry_delay = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] neutron.timeout = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] neutron.valid_interfaces = ['internal', 'public'] {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] neutron.version = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] notifications.bdms_in_notifications = False {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] notifications.default_level = INFO {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] notifications.notification_format = unversioned {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] notifications.notify_on_state_change = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] pci.alias = [] {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] pci.device_spec = [] {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] pci.report_in_placement = False {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] placement.auth_section = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] placement.auth_type = password {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] placement.auth_url = http://10.27.203.238/identity {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] placement.cafile = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] placement.certfile = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] placement.collect_timing = False {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] placement.connect_retries = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] placement.connect_retry_delay = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] placement.default_domain_id = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] placement.default_domain_name = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] placement.domain_id = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] placement.domain_name = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] placement.endpoint_override = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] placement.insecure = False {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] placement.keyfile = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] placement.max_version = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] placement.min_version = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] placement.password = **** {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] placement.project_domain_id = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] placement.project_domain_name = Default {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] placement.project_id = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] placement.project_name = service {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] placement.region_name = RegionOne {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] placement.retriable_status_codes = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] placement.service_name = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] placement.service_type = placement {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] placement.split_loggers = False {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] placement.status_code_retries = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] placement.status_code_retry_delay = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] placement.system_scope = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] placement.timeout = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] placement.trust_id = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] placement.user_domain_id = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] placement.user_domain_name = Default {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] placement.user_id = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] placement.username = placement {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] placement.valid_interfaces = ['internal', 'public'] {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] placement.version = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] quota.cores = 20 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] quota.count_usage_from_placement = False {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] quota.driver = nova.quota.DbQuotaDriver {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] quota.injected_file_content_bytes = 10240 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] quota.injected_file_path_length = 255 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] quota.injected_files = 5 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] quota.instances = 10 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] quota.key_pairs = 100 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] quota.metadata_items = 128 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] quota.ram = 51200 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] quota.recheck_quota = True {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] quota.server_group_members = 10 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] quota.server_groups = 10 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] scheduler.image_metadata_prefilter = False {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] scheduler.max_attempts = 3 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] scheduler.max_placement_results = 1000 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] scheduler.query_placement_for_image_type_support = False {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] scheduler.workers = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter'] {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] filter_scheduler.host_subset_size = 1 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] filter_scheduler.isolated_hosts = [] {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] filter_scheduler.isolated_images = [] {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] filter_scheduler.pci_in_placement = False {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] filter_scheduler.track_instance_changes = True {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] metrics.required = True {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] metrics.weight_multiplier = 1.0 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] metrics.weight_of_unavailable = -10000.0 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] metrics.weight_setting = [] {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] serial_console.enabled = False {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] serial_console.port_range = 10000:20000 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] serial_console.serialproxy_port = 6083 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] service_user.auth_section = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] service_user.auth_type = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] service_user.cafile = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] service_user.certfile = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] service_user.collect_timing = False {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] service_user.insecure = False {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] service_user.keyfile = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] service_user.send_service_user_token = False {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] service_user.split_loggers = False {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] service_user.timeout = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] spice.agent_enabled = True {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] spice.enabled = False {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] spice.html5proxy_host = 0.0.0.0 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] spice.html5proxy_port = 6082 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] spice.image_compression = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] spice.jpeg_compression = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] spice.playback_compression = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] spice.server_listen = 127.0.0.1 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] spice.streaming_mode = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] spice.zlib_compression = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] upgrade_levels.baseapi = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] upgrade_levels.compute = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] upgrade_levels.conductor = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] upgrade_levels.scheduler = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] vendordata_dynamic_auth.auth_section = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] vendordata_dynamic_auth.auth_type = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] vendordata_dynamic_auth.cafile = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] vendordata_dynamic_auth.certfile = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] vendordata_dynamic_auth.insecure = False {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] vendordata_dynamic_auth.keyfile = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] vendordata_dynamic_auth.timeout = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] vmware.api_retry_count = 10 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] vmware.ca_file = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] vmware.cache_prefix = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] vmware.cluster_name = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] vmware.connection_pool_size = 10 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] vmware.console_delay_seconds = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] vmware.datastore_regex = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] vmware.host_ip = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] vmware.host_password = **** {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] vmware.host_port = 443 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] vmware.host_username = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] vmware.insecure = False {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] vmware.integration_bridge = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] vmware.maximum_objects = 100 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] vmware.pbm_default_policy = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] vmware.pbm_enabled = False {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] vmware.pbm_wsdl_location = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] vmware.serial_port_proxy_uri = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] vmware.serial_port_service_uri = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] vmware.task_poll_interval = 0.5 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] vmware.use_linked_clone = True {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] vmware.vnc_keymap = en-us {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] vmware.vnc_port = 5900 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] vmware.vnc_port_total = 10000 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] vnc.auth_schemes = ['none'] {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] vnc.enabled = True {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] vnc.novncproxy_host = 0.0.0.0 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] vnc.novncproxy_port = 6080 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] vnc.server_listen = 127.0.0.1 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] vnc.vencrypt_ca_certs = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] vnc.vencrypt_client_cert = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] vnc.vencrypt_client_key = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] workarounds.disable_group_policy_check_upcall = False {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] workarounds.disable_rootwrap = False {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] workarounds.enable_numa_live_migration = False {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] workarounds.libvirt_disable_apic = False {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] wsgi.api_paste_config = api-paste.ini {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] wsgi.client_socket_timeout = 900 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] wsgi.default_pool_size = 1000 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] wsgi.keep_alive = True {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] wsgi.max_header_line = 16384 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] wsgi.secure_proxy_ssl_header = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] wsgi.ssl_ca_file = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] wsgi.ssl_cert_file = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] wsgi.ssl_key_file = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] wsgi.tcp_keepidle = 600 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] zvm.ca_file = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] zvm.cloud_connector_url = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] zvm.image_tmp_path = /opt/stack/nova/images {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] zvm.reachable_timeout = 300 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] oslo_policy.enforce_new_defaults = True {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] oslo_policy.enforce_scope = True {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] oslo_policy.policy_default_rule = default {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] oslo_policy.policy_file = policy.yaml {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] profiler.connection_string = messaging:// {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] profiler.enabled = False {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] profiler.es_doc_type = notification {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] profiler.es_scroll_size = 10000 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] profiler.es_scroll_time = 2m {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] profiler.filter_error_trace = False {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] profiler.hmac_keys = **** {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] profiler.sentinel_service_name = mymaster {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] profiler.socket_timeout = 0.1 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] profiler.trace_requests = False {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] profiler.trace_sqlalchemy = False {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] profiler_jaeger.process_tags = {} {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] profiler_jaeger.service_name_prefix = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] profiler_otlp.service_name_prefix = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] remote_debug.host = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] remote_debug.port = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] oslo_messaging_rabbit.hostname = l75lg1-v1 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] oslo_messaging_rabbit.processname = nova-conductor {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] oslo_messaging_rabbit.ssl = False {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] oslo_messaging_rabbit.ssl_version = {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] oslo_messaging_notifications.driver = [] {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] oslo_messaging_notifications.retry = -1 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] oslo_messaging_notifications.transport_url = **** {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] oslo_limit.auth_section = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] oslo_limit.auth_type = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] oslo_limit.cafile = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] oslo_limit.certfile = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] oslo_limit.collect_timing = False {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] oslo_limit.connect_retries = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] oslo_limit.connect_retry_delay = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] oslo_limit.endpoint_id = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] oslo_limit.endpoint_override = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] oslo_limit.insecure = False {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] oslo_limit.keyfile = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] oslo_limit.max_version = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] oslo_limit.min_version = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] oslo_limit.region_name = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] oslo_limit.retriable_status_codes = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] oslo_limit.service_name = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] oslo_limit.service_type = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] oslo_limit.split_loggers = False {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] oslo_limit.status_code_retries = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] oslo_limit.status_code_retry_delay = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] oslo_limit.timeout = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] oslo_limit.valid_interfaces = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] oslo_limit.version = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] oslo_reports.file_event_handler = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] oslo_reports.log_dir = None {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:34 l75lg1-v1 nova-conductor[82643]: DEBUG oslo_service.service [None req-70b50844-c8da-44ad-a158-b3d75f0b05c5 None None] ******************************************************************************** {{(pid=82643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2624}} May 28 12:44:35 l75lg1-v1 dstat.sh[49771]: 28-05 12:44:35| 21 5 73 1 0|3674M 5816M 267M 5941M| 20k 5122B| 0 580k| 0 57.0 |6517 10k|1.56 1.78 1.27|2.0 0 67| 0 0 | 0 2048M| 26 178 0 21 0 May 28 12:44:36 l75lg1-v1 dstat.sh[49771]: 28-05 12:44:36| 18 2 79 0 0|3760M 5730M 267M 5941M| 16k 0 | 0 432k| 0 24.0 |1764 2001 |1.56 1.78 1.27|3.0 0 1.0| 0 0 | 0 2048M| 26 178 0 21 0 May 28 12:44:36 l75lg1-v1 neutron-server[77623]: DEBUG neutron.db.agents_db [None req-fe40ce8c-640e-4db7-a17a-6e8888cce266 None None] Agent healthcheck: found 0 active agents {{(pid=77623) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:319}} May 28 12:44:36 l75lg1-v1 nova-scheduler[80330]: DEBUG dbcounter [-] [80330] Writing DB stats nova_api:SELECT=3 {{(pid=80330) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:44:36 l75lg1-v1 nova-scheduler[80330]: DEBUG dbcounter [-] [80330] Writing DB stats nova_cell0:SELECT=1 {{(pid=80330) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:44:36 l75lg1-v1 nova-scheduler[80330]: DEBUG dbcounter [-] [80330] Writing DB stats nova_cell1:SELECT=1 {{(pid=80330) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:44:37 l75lg1-v1 dstat.sh[49771]: 28-05 12:44:37| 19 2 79 0 0|3823M 5666M 267M 5941M| 15k 278B| 0 1309k| 0 173 |2246 2823 |1.67 1.80 1.28|3.0 0 4.0| 0 0 | 0 2048M| 26 186 0 21 0 May 28 12:44:37 l75lg1-v1 nova-compute[83654]: DEBUG os_vif [-] Loaded VIF plugin class '' with name 'linux_bridge' {{(pid=83654) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}} May 28 12:44:37 l75lg1-v1 nova-compute[83654]: DEBUG os_vif [-] Loaded VIF plugin class '' with name 'noop' {{(pid=83654) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}} May 28 12:44:37 l75lg1-v1 nova-compute[83654]: DEBUG os_vif [-] Loaded VIF plugin class '' with name 'ovs' {{(pid=83654) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}} May 28 12:44:37 l75lg1-v1 nova-compute[83654]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs May 28 12:44:37 l75lg1-v1 nova-compute[83654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=83654) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:390}} May 28 12:44:37 l75lg1-v1 nova-compute[83654]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.010s {{(pid=83654) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:428}} May 28 12:44:37 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] Creating reply queue: reply_37f4cbd1dd094961a22b8a65f222c327 May 28 12:44:37 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] Expecting reply to msg 462ff4a758f2480e9e159da996a9482b in queue reply_37f4cbd1dd094961a22b8a65f222c327 May 28 12:44:37 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [-] Received RPC response for msg 462ff4a758f2480e9e159da996a9482b May 28 12:44:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acf5a37-7fa1-4444-9aad-149eab7ddc75 None None] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:44:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acf5a37-7fa1-4444-9aad-149eab7ddc75 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:44:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acf5a37-7fa1-4444-9aad-149eab7ddc75 None None] PATH_INFO: `/` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:44:38 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 473/930] 10.27.203.238 () {58 vars in 1008 bytes} [Tue May 28 12:44:38 2024] GET /identity => generated 272 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:44:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730bb887-2d8e-4718-aad5-ad9d86975ab3 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:44:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730bb887-2d8e-4718-aad5-ad9d86975ab3 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:44:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730bb887-2d8e-4718-aad5-ad9d86975ab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:44:38 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-730bb887-2d8e-4718-aad5-ad9d86975ab3 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:44:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-730bb887-2d8e-4718-aad5-ad9d86975ab3 None None] MFA Rules not processed for user `c3fe870f285d4169bd917382dd02d7b0`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:44:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-730bb887-2d8e-4718-aad5-ad9d86975ab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:44:38 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 458/931] 10.27.203.238 () {62 vars in 1105 bytes} [Tue May 28 12:44:38 2024] POST /identity/v3/auth/tokens => generated 4060 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:44:38 l75lg1-v1 devstack@placement-api.service[78202]: DEBUG placement.requestlog [None req-a60a0dc5-ed78-4925-9a25-fe809a1451f2 None None] Starting request: 10.27.203.238 "GET /placement/" {{(pid=78202) __call__ /opt/stack/placement/placement/requestlog.py:55}} May 28 12:44:38 l75lg1-v1 devstack@placement-api.service[78202]: INFO placement.requestlog [None req-a60a0dc5-ed78-4925-9a25-fe809a1451f2 None None] 10.27.203.238 "GET /placement/" status: 200 len: 136 microversion: 1.0 May 28 12:44:38 l75lg1-v1 devstack@placement-api.service[78202]: [pid: 78202|app: 0|req: 3/5] 10.27.203.238 () {58 vars in 1003 bytes} [Tue May 28 12:44:38 2024] GET /placement => generated 136 bytes in 2 msecs (HTTP/1.1 200) 6 headers in 224 bytes (1 switches on core 0) May 28 12:44:38 l75lg1-v1 nova-compute[83654]: INFO nova.virt.driver [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] Loading compute driver 'libvirt.LibvirtDriver' May 28 12:44:38 l75lg1-v1 dstat.sh[49771]: 28-05 12:44:38| 15 6 78 0 0|3778M 5711M 267M 5942M| 24k 19k| 0 471k| 0 39.0 |4263 5416 |1.67 1.80 1.28|4.0 0 298| 0 0 | 0 2048M| 26 187 0 21 0 May 28 12:44:38 l75lg1-v1 nova-compute[83654]: INFO nova.compute.provider_config [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access. May 28 12:44:38 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] Expecting reply to msg f32a1ef98cf34b349d189014fc74eae3 in queue reply_37f4cbd1dd094961a22b8a65f222c327 May 28 12:44:38 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [-] Received RPC response for msg f32a1ef98cf34b349d189014fc74eae3 May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_concurrency.lockutils [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] Acquiring lock "singleton_lock" {{(pid=83654) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_concurrency.lockutils [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] Acquired lock "singleton_lock" {{(pid=83654) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_concurrency.lockutils [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] Releasing lock "singleton_lock" {{(pid=83654) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] Full set of CONF: {{(pid=83654) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:363}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] ******************************************************************************** {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2600}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] Configuration options gathered from: {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2601}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2603}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] ================================================================================ {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2605}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] allow_resize_to_same_host = True {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] arq_binding_timeout = 300 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] backdoor_port = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] backdoor_socket = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] block_device_allocate_retries = 60 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] block_device_allocate_retries_interval = 3 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] cert = self.pem {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] compute_driver = libvirt.LibvirtDriver {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] compute_monitors = [] {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] config_dir = [] {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] config_drive_format = iso9660 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] config_file = ['/etc/nova/nova-cpu.conf'] {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] config_source = [] {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] console_host = l75lg1-v1 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] control_exchange = nova {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] cpu_allocation_ratio = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] daemon = False {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] debug = True {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] default_access_ip_network_name = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] default_availability_zone = nova {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] default_ephemeral_format = ext4 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] default_green_pool_size = 1000 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] default_schedule_zone = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] disk_allocation_ratio = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] enable_new_services = True {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] enabled_apis = ['osapi_compute'] {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] enabled_ssl_apis = [] {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] flat_injected = False {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] force_config_drive = False {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] force_raw_images = True {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] graceful_shutdown_timeout = 5 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] heal_instance_info_cache_interval = 60 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] host = l75lg1-v1 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] initial_cpu_allocation_ratio = 4.0 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] initial_disk_allocation_ratio = 1.0 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] initial_ram_allocation_ratio = 1.0 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] instance_build_timeout = 0 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] instance_delete_interval = 300 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] instance_format = [instance: %(uuid)s] {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] instance_name_template = instance-%08x {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] instance_usage_audit = False {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] instance_usage_audit_period = month {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] instances_path = /opt/stack/data/nova/instances {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] internal_service_availability_zone = internal {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] key = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] live_migration_retry_count = 30 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] log_config_append = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] log_dir = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] log_file = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] log_options = True {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] log_rotate_interval = 1 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] log_rotate_interval_type = days {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] log_rotation_type = none {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] long_rpc_timeout = 1800 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] max_concurrent_builds = 10 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] max_concurrent_live_migrations = 1 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] max_concurrent_snapshots = 5 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] max_local_block_devices = 3 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] max_logfile_count = 30 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] max_logfile_size_mb = 200 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] maximum_instance_delete_attempts = 5 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] metadata_listen = 0.0.0.0 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] metadata_listen_port = 8775 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] metadata_workers = 2 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] migrate_max_retries = -1 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] mkisofs_cmd = genisoimage {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] my_block_storage_ip = 10.27.203.238 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] my_ip = 10.27.203.238 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] network_allocate_retries = 0 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] osapi_compute_listen = 0.0.0.0 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] osapi_compute_listen_port = 8774 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] osapi_compute_unique_server_name_scope = {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] osapi_compute_workers = 2 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] password_length = 12 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] periodic_enable = True {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] periodic_fuzzy_delay = 60 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] pointer_model = ps2mouse {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] preallocate_images = none {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] publish_errors = False {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] pybasedir = /opt/stack/nova {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] ram_allocation_ratio = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] rate_limit_burst = 0 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] rate_limit_except_level = CRITICAL {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] rate_limit_interval = 0 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] reboot_timeout = 0 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] reclaim_instance_interval = 0 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] record = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] reimage_timeout_per_gb = 180 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] report_interval = 120 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] rescue_timeout = 0 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] reserved_host_cpus = 0 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] reserved_host_disk_mb = 0 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] reserved_host_memory_mb = 512 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] reserved_huge_pages = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] resize_confirm_window = 0 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] resize_fs_using_block_device = False {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] resume_guests_state_on_host_boot = False {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] rpc_response_timeout = 60 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] run_external_periodic_tasks = True {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] running_deleted_instance_action = reap {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] running_deleted_instance_poll_interval = 1800 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] running_deleted_instance_timeout = 0 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] scheduler_instance_sync_interval = 120 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] service_down_time = 720 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] servicegroup_driver = db {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] shelved_offload_time = 0 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] shelved_poll_interval = 3600 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] shutdown_timeout = 0 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] source_is_ipv6 = False {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] ssl_only = False {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] state_path = /opt/stack/data/nova {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] sync_power_state_interval = 600 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] sync_power_state_pool_size = 1000 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] syslog_log_facility = LOG_USER {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] tempdir = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] timeout_nbd = 10 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] transport_url = **** {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] update_resources_interval = 0 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] use_cow_images = True {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] use_eventlog = False {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] use_journal = False {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] use_json = False {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] use_rootwrap_daemon = False {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] use_stderr = False {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] use_syslog = False {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] vcpu_pin_set = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] vif_plugging_is_fatal = True {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] vif_plugging_timeout = 300 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] virt_mkfs = [] {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] volume_usage_poll_interval = 0 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] watch_log_file = False {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] web = /usr/share/spice-html5 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] oslo_concurrency.disable_process_locking = False {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] oslo_messaging_metrics.metrics_process_name = {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] api.auth_strategy = keystone {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] api.compute_link_prefix = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] api.dhcp_domain = novalocal {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] api.enable_instance_password = True {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] api.glance_link_prefix = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] api.instance_list_cells_batch_strategy = distributed {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] api.instance_list_per_project_cells = False {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] api.list_records_by_skipping_down_cells = True {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] api.local_metadata_per_cell = False {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] api.max_limit = 1000 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] api.metadata_cache_expiration = 15 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] api.neutron_default_tenant_id = default {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] api.use_neutron_default_nets = False {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] api.vendordata_dynamic_failure_fatal = False {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] api.vendordata_dynamic_ssl_certfile = {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] api.vendordata_dynamic_targets = [] {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] api.vendordata_jsonfile_path = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] api.vendordata_providers = ['StaticJSON'] {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] cache.backend = dogpile.cache.memcached {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] cache.backend_argument = **** {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] cache.config_prefix = cache.oslo {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] cache.dead_timeout = 60.0 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] cache.debug_cache_backend = False {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] cache.enable_retry_client = False {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] cache.enable_socket_keepalive = False {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] cache.enabled = True {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] cache.enforce_fips_mode = False {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] cache.expiration_time = 600 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] cache.hashclient_retry_attempts = 2 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] cache.hashclient_retry_delay = 1.0 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] cache.memcache_dead_retry = 300 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] cache.memcache_password = **** {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] cache.memcache_pool_maxsize = 10 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] cache.memcache_pool_unused_timeout = 60 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] cache.memcache_sasl_enabled = False {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] cache.memcache_servers = ['localhost:11211'] {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] cache.memcache_socket_timeout = 1.0 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] cache.memcache_username = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] cache.proxies = [] {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] cache.redis_password = **** {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] cache.redis_sentinel_service_name = mymaster {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] cache.redis_server = localhost:6379 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] cache.redis_socket_timeout = 1.0 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] cache.redis_username = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] cache.retry_attempts = 2 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] cache.retry_delay = 0.0 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] cache.socket_keepalive_count = 1 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] cache.socket_keepalive_idle = 1 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] cache.socket_keepalive_interval = 1 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] cache.tls_allowed_ciphers = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] cache.tls_cafile = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] cache.tls_certfile = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] cache.tls_enabled = False {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] cache.tls_keyfile = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] cinder.auth_section = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] cinder.auth_type = password {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] cinder.cafile = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] cinder.catalog_info = volumev3::publicURL {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] cinder.certfile = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] cinder.collect_timing = False {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] cinder.cross_az_attach = True {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] cinder.debug = False {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] cinder.endpoint_template = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] cinder.http_retries = 3 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] cinder.insecure = False {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] cinder.keyfile = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] cinder.os_region_name = RegionOne {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] cinder.split_loggers = False {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] cinder.timeout = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] compute.cpu_dedicated_set = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] compute.cpu_shared_set = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] compute.image_type_exclude_list = [] {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] compute.live_migration_wait_for_vif_plug = True {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] compute.max_concurrent_disk_ops = 0 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] compute.max_disk_devices_to_attach = -1 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] compute.resource_provider_association_refresh = 300 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] compute.shutdown_retry_interval = 10 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] conductor.workers = 2 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] console.allowed_origins = [] {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] console.ssl_ciphers = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] console.ssl_minimum_version = default {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] consoleauth.enforce_session_timeout = False {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] consoleauth.token_ttl = 600 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] cyborg.cafile = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] cyborg.certfile = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] cyborg.collect_timing = False {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] cyborg.connect_retries = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] cyborg.connect_retry_delay = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] cyborg.endpoint_override = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] cyborg.insecure = False {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] cyborg.keyfile = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] cyborg.max_version = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] cyborg.min_version = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] cyborg.region_name = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] cyborg.retriable_status_codes = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] cyborg.service_name = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] cyborg.service_type = accelerator {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] cyborg.split_loggers = False {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] cyborg.status_code_retries = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] cyborg.status_code_retry_delay = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] cyborg.timeout = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] cyborg.version = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] database.backend = sqlalchemy {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] database.connection = **** {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] database.connection_debug = 0 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] database.connection_parameters = {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] database.connection_recycle_time = 3600 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] database.connection_trace = False {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] database.db_inc_retry_interval = True {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] database.db_max_retries = 20 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] database.db_max_retry_interval = 10 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] database.db_retry_interval = 1 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] database.max_overflow = 50 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] database.max_pool_size = 5 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] database.max_retries = 10 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] database.mysql_sql_mode = TRADITIONAL {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] database.mysql_wsrep_sync_wait = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] database.pool_timeout = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] database.retry_interval = 10 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] database.slave_connection = **** {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] database.sqlite_synchronous = True {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] api_database.backend = sqlalchemy {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] api_database.connection = **** {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] api_database.connection_debug = 0 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] api_database.connection_parameters = {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] api_database.connection_recycle_time = 3600 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] api_database.connection_trace = False {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] api_database.db_inc_retry_interval = True {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] api_database.db_max_retries = 20 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] api_database.db_max_retry_interval = 10 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] api_database.db_retry_interval = 1 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] api_database.max_overflow = 50 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] api_database.max_pool_size = 5 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] api_database.max_retries = 10 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] api_database.mysql_sql_mode = TRADITIONAL {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] api_database.mysql_wsrep_sync_wait = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] api_database.pool_timeout = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] api_database.retry_interval = 10 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] api_database.slave_connection = **** {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] api_database.sqlite_synchronous = True {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] devices.enabled_mdev_types = [] {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] ephemeral_storage_encryption.default_format = luks {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] ephemeral_storage_encryption.enabled = False {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] ephemeral_storage_encryption.key_size = 512 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] glance.api_servers = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] glance.cafile = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] glance.certfile = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] glance.collect_timing = False {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] glance.connect_retries = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] glance.connect_retry_delay = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] glance.debug = False {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] glance.default_trusted_certificate_ids = [] {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] glance.enable_certificate_validation = False {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] glance.enable_rbd_download = False {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] glance.endpoint_override = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] glance.insecure = False {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] glance.keyfile = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] glance.max_version = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] glance.min_version = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] glance.num_retries = 3 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] glance.rbd_ceph_conf = {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] glance.rbd_connect_timeout = 5 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] glance.rbd_pool = {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] glance.rbd_user = {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] glance.region_name = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] glance.retriable_status_codes = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] glance.service_name = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] glance.service_type = image {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] glance.split_loggers = False {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] glance.status_code_retries = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] glance.status_code_retry_delay = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] glance.timeout = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] glance.valid_interfaces = ['internal', 'public'] {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] glance.verify_glance_signatures = False {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] glance.version = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] guestfs.debug = False {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] mks.enabled = False {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] image_cache.manager_interval = 2400 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] image_cache.precache_concurrency = 1 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] image_cache.remove_unused_base_images = True {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] image_cache.subdirectory_name = _base {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] ironic.api_max_retries = 60 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] ironic.api_retry_interval = 2 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] ironic.auth_section = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] ironic.auth_type = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] ironic.cafile = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] ironic.certfile = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] ironic.collect_timing = False {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] ironic.conductor_group = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] ironic.connect_retries = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] ironic.connect_retry_delay = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] ironic.endpoint_override = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] ironic.insecure = False {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] ironic.keyfile = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] ironic.max_version = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] ironic.min_version = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] ironic.peer_list = [] {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] ironic.region_name = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] ironic.retriable_status_codes = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] ironic.serial_console_state_timeout = 10 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] ironic.service_name = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] ironic.service_type = baremetal {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] ironic.shard = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] ironic.split_loggers = False {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] ironic.status_code_retries = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] ironic.status_code_retry_delay = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] ironic.timeout = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] ironic.valid_interfaces = ['internal', 'public'] {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] ironic.version = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] key_manager.fixed_key = **** {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] barbican.barbican_api_version = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] barbican.barbican_endpoint = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] barbican.barbican_endpoint_type = public {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] barbican.barbican_region_name = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] barbican.cafile = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] barbican.certfile = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] barbican.collect_timing = False {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] barbican.insecure = False {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] barbican.keyfile = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] barbican.number_of_retries = 60 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] barbican.retry_delay = 1 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] barbican.send_service_user_token = False {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] barbican.split_loggers = False {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] barbican.timeout = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] barbican.verify_ssl = True {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] barbican.verify_ssl_path = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] barbican_service_user.auth_section = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] barbican_service_user.auth_type = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] barbican_service_user.cafile = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] barbican_service_user.certfile = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] barbican_service_user.collect_timing = False {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] barbican_service_user.insecure = False {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] barbican_service_user.keyfile = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] barbican_service_user.split_loggers = False {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] barbican_service_user.timeout = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] vault.approle_role_id = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] vault.approle_secret_id = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] vault.cafile = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] vault.certfile = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] vault.collect_timing = False {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] vault.insecure = False {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] vault.keyfile = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] vault.kv_mountpoint = secret {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] vault.kv_path = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] vault.kv_version = 2 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] vault.namespace = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] vault.root_token_id = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] vault.split_loggers = False {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] vault.ssl_ca_crt_file = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] vault.timeout = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] vault.use_ssl = False {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] keystone.auth_section = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] keystone.auth_type = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] keystone.cafile = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] keystone.certfile = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] keystone.collect_timing = False {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] keystone.connect_retries = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] keystone.connect_retry_delay = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] keystone.endpoint_override = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] keystone.insecure = False {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] keystone.keyfile = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] keystone.max_version = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] keystone.min_version = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] keystone.region_name = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] keystone.retriable_status_codes = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] keystone.service_name = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] keystone.service_type = identity {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] keystone.split_loggers = False {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] keystone.status_code_retries = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] keystone.status_code_retry_delay = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] keystone.timeout = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] keystone.valid_interfaces = ['internal', 'public'] {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] keystone.version = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] libvirt.connection_uri = {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] libvirt.cpu_mode = custom {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] libvirt.cpu_model_extra_flags = [] {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: WARNING oslo_config.cfg [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] libvirt.cpu_models = ['Nehalem'] {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] libvirt.cpu_power_governor_high = performance {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] libvirt.cpu_power_governor_low = powersave {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] libvirt.cpu_power_management = False {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] libvirt.device_detach_attempts = 8 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] libvirt.device_detach_timeout = 20 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] libvirt.disk_cachemodes = [] {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] libvirt.disk_prefix = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] libvirt.enabled_perf_events = [] {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] libvirt.file_backed_memory = 0 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] libvirt.gid_maps = [] {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] libvirt.hw_disk_discard = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] libvirt.hw_machine_type = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] libvirt.images_rbd_ceph_conf = {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] libvirt.images_rbd_glance_store_name = {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] libvirt.images_rbd_pool = rbd {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] libvirt.images_type = default {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] libvirt.images_volume_group = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] libvirt.inject_key = False {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] libvirt.inject_partition = -2 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] libvirt.inject_password = False {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] libvirt.iscsi_iface = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] libvirt.iser_use_multipath = False {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] libvirt.live_migration_bandwidth = 0 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] libvirt.live_migration_completion_timeout = 800 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] libvirt.live_migration_downtime = 500 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] libvirt.live_migration_downtime_delay = 75 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] libvirt.live_migration_downtime_steps = 10 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] libvirt.live_migration_inbound_addr = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] libvirt.live_migration_permit_auto_converge = False {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] libvirt.live_migration_permit_post_copy = False {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] libvirt.live_migration_scheme = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] libvirt.live_migration_timeout_action = abort {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] libvirt.live_migration_tunnelled = False {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: WARNING oslo_config.cfg [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( May 28 12:44:39 l75lg1-v1 nova-compute[83654]: live_migration_uri is deprecated for removal in favor of two other options that May 28 12:44:39 l75lg1-v1 nova-compute[83654]: allow to change live migration scheme and target URI: ``live_migration_scheme`` May 28 12:44:39 l75lg1-v1 nova-compute[83654]: and ``live_migration_inbound_addr`` respectively. May 28 12:44:39 l75lg1-v1 nova-compute[83654]: ). Its value may be silently ignored in the future. May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] libvirt.live_migration_uri = qemu+ssh://vastdata@%s/system {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] libvirt.live_migration_with_native_tls = False {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] libvirt.max_queues = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] libvirt.mem_stats_period_seconds = 10 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] libvirt.migration_inbound_addr = 10.27.203.238 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] libvirt.nfs_mount_options = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] libvirt.num_aoe_discover_tries = 3 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] libvirt.num_iser_scan_tries = 5 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] libvirt.num_memory_encrypted_guests = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] libvirt.num_nvme_discover_tries = 5 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] libvirt.num_pcie_ports = 0 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] libvirt.num_volume_scan_tries = 5 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] libvirt.pmem_namespaces = [] {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] libvirt.quobyte_client_cfg = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] libvirt.rbd_connect_timeout = 5 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] libvirt.rbd_secret_uuid = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] libvirt.rbd_user = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] libvirt.realtime_scheduler_priority = 1 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] libvirt.remote_filesystem_transport = ssh {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] libvirt.rescue_image_id = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] libvirt.rescue_kernel_id = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] libvirt.rescue_ramdisk_id = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] libvirt.rng_dev_path = /dev/urandom {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] libvirt.rx_queue_size = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] libvirt.smbfs_mount_options = {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] libvirt.snapshot_compression = False {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] libvirt.snapshot_image_format = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] libvirt.sparse_logical_volumes = False {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] libvirt.swtpm_enabled = False {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] libvirt.swtpm_group = tss {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] libvirt.swtpm_user = tss {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] libvirt.sysinfo_serial = unique {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] libvirt.tb_cache_size = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] libvirt.tx_queue_size = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] libvirt.uid_maps = [] {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] libvirt.use_virtio_for_bridges = True {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] libvirt.virt_type = qemu {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] libvirt.volume_clear = zero {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] libvirt.volume_clear_size = 0 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] libvirt.volume_use_multipath = False {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] libvirt.vzstorage_cache_path = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] libvirt.vzstorage_mount_group = qemu {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] libvirt.vzstorage_mount_opts = [] {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] libvirt.vzstorage_mount_perms = 0770 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] libvirt.vzstorage_mount_user = stack {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] neutron.auth_section = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] neutron.auth_type = password {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] neutron.cafile = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] neutron.certfile = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] neutron.collect_timing = False {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] neutron.connect_retries = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] neutron.connect_retry_delay = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] neutron.default_floating_pool = public {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] neutron.endpoint_override = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] neutron.extension_sync_interval = 600 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] neutron.http_retries = 3 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] neutron.insecure = False {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] neutron.keyfile = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] neutron.max_version = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] neutron.metadata_proxy_shared_secret = **** {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] neutron.min_version = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] neutron.ovs_bridge = br-int {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] neutron.physnets = [] {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] neutron.region_name = RegionOne {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] neutron.retriable_status_codes = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] neutron.service_metadata_proxy = True {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] neutron.service_name = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] neutron.service_type = network {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] neutron.split_loggers = False {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] neutron.status_code_retries = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] neutron.status_code_retry_delay = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] neutron.timeout = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] neutron.valid_interfaces = ['internal', 'public'] {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] neutron.version = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] notifications.bdms_in_notifications = False {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] notifications.default_level = INFO {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] notifications.notification_format = unversioned {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] notifications.notify_on_state_change = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] pci.alias = [] {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] pci.device_spec = [] {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] pci.report_in_placement = False {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] placement.auth_section = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] placement.auth_type = password {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] placement.auth_url = http://10.27.203.238/identity {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] placement.cafile = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] placement.certfile = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] placement.collect_timing = False {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] placement.connect_retries = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] placement.connect_retry_delay = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] placement.default_domain_id = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] placement.default_domain_name = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] placement.domain_id = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] placement.domain_name = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] placement.endpoint_override = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] placement.insecure = False {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] placement.keyfile = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] placement.max_version = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] placement.min_version = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] placement.password = **** {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] placement.project_domain_id = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] placement.project_domain_name = Default {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] placement.project_id = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] placement.project_name = service {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] placement.region_name = RegionOne {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] placement.retriable_status_codes = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] placement.service_name = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] placement.service_type = placement {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] placement.split_loggers = False {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] placement.status_code_retries = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] placement.status_code_retry_delay = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] placement.system_scope = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] placement.timeout = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] placement.trust_id = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] placement.user_domain_id = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] placement.user_domain_name = Default {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] placement.user_id = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] placement.username = placement {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] placement.valid_interfaces = ['internal', 'public'] {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] placement.version = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] quota.cores = 20 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] quota.count_usage_from_placement = False {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] quota.driver = nova.quota.DbQuotaDriver {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] quota.injected_file_content_bytes = 10240 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] quota.injected_file_path_length = 255 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] quota.injected_files = 5 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] quota.instances = 10 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] quota.key_pairs = 100 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] quota.metadata_items = 128 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] quota.ram = 51200 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] quota.recheck_quota = True {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] quota.server_group_members = 10 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] quota.server_groups = 10 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] scheduler.image_metadata_prefilter = False {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] scheduler.max_attempts = 3 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] scheduler.max_placement_results = 1000 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] scheduler.query_placement_for_image_type_support = False {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] scheduler.workers = 2 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] filter_scheduler.host_subset_size = 1 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] filter_scheduler.image_properties_default_architecture = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] filter_scheduler.isolated_hosts = [] {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] filter_scheduler.isolated_images = [] {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] filter_scheduler.max_instances_per_host = 50 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] filter_scheduler.pci_in_placement = False {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] filter_scheduler.track_instance_changes = False {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] metrics.required = True {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] metrics.weight_multiplier = 1.0 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] metrics.weight_of_unavailable = -10000.0 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] metrics.weight_setting = [] {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] serial_console.enabled = False {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] serial_console.port_range = 10000:20000 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] serial_console.serialproxy_port = 6083 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] service_user.auth_section = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] service_user.auth_type = password {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] service_user.cafile = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] service_user.certfile = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] service_user.collect_timing = False {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] service_user.insecure = False {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] service_user.keyfile = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] service_user.send_service_user_token = True {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] service_user.split_loggers = False {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] service_user.timeout = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] spice.agent_enabled = True {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] spice.enabled = False {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] spice.html5proxy_base_url = http://10.27.203.238:6081/spice_auto.html {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] spice.html5proxy_host = 0.0.0.0 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] spice.html5proxy_port = 6082 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] spice.image_compression = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] spice.jpeg_compression = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] spice.playback_compression = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] spice.server_listen = 127.0.0.1 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] spice.streaming_mode = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] spice.zlib_compression = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] upgrade_levels.baseapi = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] upgrade_levels.compute = auto {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] upgrade_levels.conductor = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] upgrade_levels.scheduler = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] vendordata_dynamic_auth.auth_section = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] vendordata_dynamic_auth.auth_type = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] vendordata_dynamic_auth.cafile = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] vendordata_dynamic_auth.certfile = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] vendordata_dynamic_auth.collect_timing = False {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] vendordata_dynamic_auth.insecure = False {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] vendordata_dynamic_auth.keyfile = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] vendordata_dynamic_auth.split_loggers = False {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] vendordata_dynamic_auth.timeout = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] vmware.api_retry_count = 10 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] vmware.ca_file = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] vmware.cache_prefix = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] vmware.cluster_name = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] vmware.connection_pool_size = 10 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] vmware.console_delay_seconds = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] vmware.datastore_regex = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] vmware.host_ip = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] vmware.host_password = **** {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] vmware.host_port = 443 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] vmware.host_username = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] vmware.insecure = False {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] vmware.integration_bridge = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] vmware.maximum_objects = 100 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] vmware.pbm_default_policy = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] vmware.pbm_enabled = False {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] vmware.pbm_wsdl_location = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] vmware.serial_port_proxy_uri = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] vmware.serial_port_service_uri = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] vmware.task_poll_interval = 0.5 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] vmware.use_linked_clone = True {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] vmware.vnc_keymap = en-us {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] vmware.vnc_port = 5900 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] vmware.vnc_port_total = 10000 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] vnc.auth_schemes = ['none'] {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] vnc.enabled = True {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] vnc.novncproxy_base_url = http://10.27.203.238:6080/vnc_lite.html {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] vnc.novncproxy_host = 0.0.0.0 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] vnc.novncproxy_port = 6080 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] vnc.server_listen = 0.0.0.0 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] vnc.server_proxyclient_address = 10.27.203.238 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] vnc.vencrypt_ca_certs = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] vnc.vencrypt_client_cert = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] vnc.vencrypt_client_key = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] workarounds.disable_fallback_pcpu_query = False {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] workarounds.disable_group_policy_check_upcall = True {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] workarounds.disable_rootwrap = False {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] workarounds.enable_numa_live_migration = False {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] workarounds.handle_virt_lifecycle_events = True {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] workarounds.libvirt_disable_apic = True {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] workarounds.never_download_image_if_on_rbd = False {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] wsgi.client_socket_timeout = 900 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] wsgi.default_pool_size = 1000 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] wsgi.keep_alive = True {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] wsgi.max_header_line = 16384 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] wsgi.secure_proxy_ssl_header = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] wsgi.ssl_ca_file = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] wsgi.ssl_cert_file = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] wsgi.ssl_key_file = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] wsgi.tcp_keepidle = 600 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] zvm.ca_file = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] zvm.cloud_connector_url = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] zvm.reachable_timeout = 300 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] oslo_policy.enforce_new_defaults = True {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] oslo_policy.enforce_scope = True {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] oslo_policy.policy_default_rule = default {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] oslo_policy.policy_file = policy.yaml {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] profiler.connection_string = messaging:// {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] profiler.enabled = False {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] profiler.es_doc_type = notification {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] profiler.es_scroll_size = 10000 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] profiler.es_scroll_time = 2m {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] profiler.filter_error_trace = False {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] profiler.hmac_keys = **** {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] profiler.sentinel_service_name = mymaster {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] profiler.socket_timeout = 0.1 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] profiler.trace_requests = False {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] profiler.trace_sqlalchemy = False {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] profiler_jaeger.process_tags = {} {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] profiler_jaeger.service_name_prefix = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] profiler_otlp.service_name_prefix = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] remote_debug.host = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] remote_debug.port = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] oslo_messaging_rabbit.hostname = l75lg1-v1 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] oslo_messaging_rabbit.processname = nova-compute {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] oslo_messaging_rabbit.ssl = False {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] oslo_messaging_rabbit.ssl_version = {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] oslo_messaging_notifications.retry = -1 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] oslo_messaging_notifications.transport_url = **** {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] oslo_limit.auth_section = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] oslo_limit.auth_type = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] oslo_limit.cafile = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] oslo_limit.certfile = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] oslo_limit.collect_timing = False {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] oslo_limit.connect_retries = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] oslo_limit.connect_retry_delay = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] oslo_limit.endpoint_id = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] oslo_limit.endpoint_override = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] oslo_limit.insecure = False {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] oslo_limit.keyfile = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] oslo_limit.max_version = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] oslo_limit.min_version = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] oslo_limit.region_name = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] oslo_limit.retriable_status_codes = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] oslo_limit.service_name = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] oslo_limit.service_type = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] oslo_limit.split_loggers = False {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] oslo_limit.status_code_retries = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] oslo_limit.status_code_retry_delay = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] oslo_limit.timeout = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] oslo_limit.valid_interfaces = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] oslo_limit.version = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] oslo_reports.file_event_handler = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] oslo_reports.file_event_handler_interval = 1 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] oslo_reports.log_dir = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] vif_plug_linux_bridge_privileged.group = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] vif_plug_linux_bridge_privileged.thread_pool_size = 10 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] vif_plug_linux_bridge_privileged.user = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] vif_plug_ovs_privileged.group = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] vif_plug_ovs_privileged.helper_command = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] vif_plug_ovs_privileged.thread_pool_size = 10 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] vif_plug_ovs_privileged.user = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] os_vif_linux_bridge.flat_interface = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] os_vif_linux_bridge.iptables_bottom_regex = {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] os_vif_linux_bridge.iptables_top_regex = {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] os_vif_linux_bridge.use_ipv6 = False {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] os_vif_linux_bridge.vlan_interface = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] os_vif_ovs.default_qos_type = linux-noop {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] os_vif_ovs.isolate_vif = False {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] os_vif_ovs.network_device_mtu = 1500 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] os_vif_ovs.ovs_vsctl_timeout = 120 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] os_vif_ovs.ovsdb_connection = tcp:127.0.0.1:6640 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] os_vif_ovs.ovsdb_interface = native {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] os_vif_ovs.per_port_bridge = False {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] os_brick.lock_path = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] privsep_osbrick.capabilities = [21] {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] privsep_osbrick.group = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] privsep_osbrick.helper_command = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] privsep_osbrick.logger_name = os_brick.privileged {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] privsep_osbrick.thread_pool_size = 10 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] privsep_osbrick.user = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] nova_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] nova_sys_admin.group = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] nova_sys_admin.helper_command = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] nova_sys_admin.logger_name = oslo_privsep.daemon {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] nova_sys_admin.thread_pool_size = 10 {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] nova_sys_admin.user = None {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.service [None req-0945f210-c10f-4d4e-8349-f80888e35acd None None] ******************************************************************************** {{(pid=83654) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2624}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: INFO nova.service [-] Starting compute node (version 29.1.0) May 28 12:44:39 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [None req-d5e2622c-e52e-4f3d-871c-2ddda502f287 None None] Expecting reply to msg 48eb408f3c68413ba4a4d73c865b1c8a in queue reply_37f4cbd1dd094961a22b8a65f222c327 May 28 12:44:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ec5f7a-08c0-4439-ab71-a6cebd5de6be None None] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:44:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ec5f7a-08c0-4439-ab71-a6cebd5de6be None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:44:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ec5f7a-08c0-4439-ab71-a6cebd5de6be None None] PATH_INFO: `/` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:44:39 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 474/932] 10.27.203.238 () {58 vars in 1014 bytes} [Tue May 28 12:44:39 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:44:39 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [-] Received RPC response for msg 48eb408f3c68413ba4a4d73c865b1c8a May 28 12:44:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ce8e92-0bd6-4587-b84b-787423c03212 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:44:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ce8e92-0bd6-4587-b84b-787423c03212 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:44:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ce8e92-0bd6-4587-b84b-787423c03212 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:44:39 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-80ce8e92-0bd6-4587-b84b-787423c03212 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:44:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-80ce8e92-0bd6-4587-b84b-787423c03212 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:44:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-80ce8e92-0bd6-4587-b84b-787423c03212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:44:39 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 459/933] 10.27.203.238 () {62 vars in 1111 bytes} [Tue May 28 12:44:39 2024] POST /identity/v3/auth/tokens => generated 3991 bytes in 24 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:44:39 l75lg1-v1 dstat.sh[49771]: 28-05 12:44:39| 19 9 72 0 0|3826M 5661M 267M 5944M| 17k 12k| 68k 1612k|17.0 32.0 |8896 14k|1.67 1.80 1.28|2.0 0 332| 0 0 | 0 2048M| 26 188 0 20 0 May 28 12:44:39 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi [None req-05d0d265-71fe-4459-b94b-819ae5ab8130 None None] Calling method '>' {{(pid=74000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} May 28 12:44:39 l75lg1-v1 devstack@n-api.service[74000]: INFO nova.api.openstack.requestlog [None req-05d0d265-71fe-4459-b94b-819ae5ab8130 None None] 10.27.203.238 "GET /compute/v2.1" status: 200 len: 390 microversion: 2.1 time: 0.001642 May 28 12:44:39 l75lg1-v1 devstack@n-api.service[74000]: [pid: 74000|app: 0|req: 2/2] 10.27.203.238 () {58 vars in 1013 bytes} [Tue May 28 12:44:39 2024] GET /compute/v2.1 => generated 390 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 12:44:39 l75lg1-v1 devstack@n-api.service[73999]: DEBUG dbcounter [-] [73999] Writing DB stats nova_api:SELECT=1 {{(pid=73999) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:44:39 l75lg1-v1 devstack@n-api.service[73999]: DEBUG dbcounter [-] [73999] Writing DB stats nova_cell0:SELECT=1 {{(pid=73999) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:44:39 l75lg1-v1 devstack@n-api.service[73999]: DEBUG dbcounter [-] [73999] Writing DB stats nova_cell1:SELECT=1 {{(pid=73999) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:44:39 l75lg1-v1 devstack@n-api.service[73999]: DEBUG dbcounter [-] [73999] Writing DB stats nova_cell0:SELECT=2,nova_cell0:INSERT=1 {{(pid=73999) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:44:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e99dce0-0d70-421a-a421-a2e2c6c3f7db None None] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:44:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e99dce0-0d70-421a-a421-a2e2c6c3f7db None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:44:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e99dce0-0d70-421a-a421-a2e2c6c3f7db None None] PATH_INFO: `/` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:44:39 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 475/934] 10.27.203.238 () {58 vars in 1050 bytes} [Tue May 28 12:44:39 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:44:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53aab36-8b3d-4c95-9217-21e4563b6299 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:44:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53aab36-8b3d-4c95-9217-21e4563b6299 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:44:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53aab36-8b3d-4c95-9217-21e4563b6299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:44:39 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-b53aab36-8b3d-4c95-9217-21e4563b6299 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:44:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-b53aab36-8b3d-4c95-9217-21e4563b6299 None None] MFA Rules not processed for user `befdd4414dc2432ab2baa1ae3fbffef7`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:44:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-b53aab36-8b3d-4c95-9217-21e4563b6299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:44:39 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 460/935] 10.27.203.238 () {62 vars in 1147 bytes} [Tue May 28 12:44:39 2024] POST /identity/v3/auth/tokens => generated 4055 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:44:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e99dce0-0d70-421a-a421-a2e2c6c3f7db None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:44:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e99dce0-0d70-421a-a421-a2e2c6c3f7db None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:44:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24802620-2e26-4ffd-93d2-848c2b6de107 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'befdd4414dc2432ab2baa1ae3fbffef7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'manager', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:44:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24802620-2e26-4ffd-93d2-848c2b6de107 service nova] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:44:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24802620-2e26-4ffd-93d2-848c2b6de107 service nova] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:44:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24802620-2e26-4ffd-93d2-848c2b6de107 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:44:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24802620-2e26-4ffd-93d2-848c2b6de107 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:44:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24802620-2e26-4ffd-93d2-848c2b6de107 service nova] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:44:39 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 476/936] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 12:44:39 2024] GET /identity/v3/auth/tokens => generated 3991 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 12:44:39 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi [None req-15b78bed-8d88-42cc-85f6-dad4c9e3fdcb admin admin] Calling method '>' {{(pid=73999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG nova.virt.libvirt.host [None req-d5e2622c-e52e-4f3d-871c-2ddda502f287 None None] Connecting to libvirt: qemu:///system {{(pid=83654) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:508}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG nova.virt.libvirt.host [None req-d5e2622c-e52e-4f3d-871c-2ddda502f287 None None] Registering for lifecycle events {{(pid=83654) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:514}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: libvirt: error : internal error: could not initialize domain event timer May 28 12:44:39 l75lg1-v1 nova-compute[83654]: WARNING nova.virt.libvirt.host [None req-d5e2622c-e52e-4f3d-871c-2ddda502f287 None None] URI qemu:///system does not support events: internal error: could not initialize domain event timer: libvirt.libvirtError: internal error: could not initialize domain event timer May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG nova.virt.libvirt.host [None req-d5e2622c-e52e-4f3d-871c-2ddda502f287 None None] Registering for connection events: {{(pid=83654) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:535}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG nova.virt.libvirt.host [None req-d5e2622c-e52e-4f3d-871c-2ddda502f287 None None] Starting native event thread {{(pid=83654) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:494}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG nova.virt.libvirt.host [None req-d5e2622c-e52e-4f3d-871c-2ddda502f287 None None] Starting green dispatch thread {{(pid=83654) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:500}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: DEBUG nova.virt.libvirt.host [None req-d5e2622c-e52e-4f3d-871c-2ddda502f287 None None] Starting connection event dispatch thread {{(pid=83654) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:503}} May 28 12:44:39 l75lg1-v1 nova-compute[83654]: INFO nova.virt.libvirt.driver [None req-d5e2622c-e52e-4f3d-871c-2ddda502f287 None None] Connection event '1' reason 'None' May 28 12:44:39 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [None req-d5e2622c-e52e-4f3d-871c-2ddda502f287 None None] Expecting reply to msg 6c82a23dbb054ba599d44a4e6dedfd00 in queue reply_37f4cbd1dd094961a22b8a65f222c327 May 28 12:44:39 l75lg1-v1 devstack@n-api.service[73999]: INFO nova.api.openstack.requestlog [None req-15b78bed-8d88-42cc-85f6-dad4c9e3fdcb admin admin] 10.27.203.238 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.298522 May 28 12:44:39 l75lg1-v1 devstack@n-api.service[73999]: [pid: 73999|app: 0|req: 1/3] 10.27.203.238 () {64 vars in 1374 bytes} [Tue May 28 12:44:39 2024] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 12:44:39 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [-] Received RPC response for msg 6c82a23dbb054ba599d44a4e6dedfd00 May 28 12:44:39 l75lg1-v1 devstack@c-api.service[84417]: [uWSGI] getting INI configuration from /etc/cinder/cinder-api-uwsgi.ini May 28 12:44:39 l75lg1-v1 devstack@c-api.service[84417]: *** Starting uWSGI 2.0.20-debian (64bit) on [Tue May 28 12:44:39 2024] *** May 28 12:44:39 l75lg1-v1 devstack@c-api.service[84417]: compiled with version: 11.2.0 on 21 March 2022 11:00:44 May 28 12:44:39 l75lg1-v1 devstack@c-api.service[84417]: os: Linux-5.15.0-56-generic #62-Ubuntu SMP Tue Nov 22 19:54:14 UTC 2022 May 28 12:44:39 l75lg1-v1 devstack@c-api.service[84417]: nodename: l75lg1-v1 May 28 12:44:39 l75lg1-v1 devstack@c-api.service[84417]: machine: x86_64 May 28 12:44:39 l75lg1-v1 devstack@c-api.service[84417]: clock source: unix May 28 12:44:39 l75lg1-v1 devstack@c-api.service[84417]: pcre jit disabled May 28 12:44:39 l75lg1-v1 devstack@c-api.service[84417]: detected number of CPU cores: 10 May 28 12:44:39 l75lg1-v1 devstack@c-api.service[84417]: current working directory: / May 28 12:44:39 l75lg1-v1 devstack@c-api.service[84417]: detected binary path: /usr/bin/uwsgi-core May 28 12:44:39 l75lg1-v1 devstack@c-api.service[84417]: your processes number limit is 63557 May 28 12:44:39 l75lg1-v1 devstack@c-api.service[84417]: your memory page size is 4096 bytes May 28 12:44:39 l75lg1-v1 devstack@c-api.service[84417]: detected max file descriptor number: 2048 May 28 12:44:39 l75lg1-v1 devstack@c-api.service[84417]: lock engine: pthread robust mutexes May 28 12:44:39 l75lg1-v1 devstack@c-api.service[84417]: thunder lock: enabled May 28 12:44:39 l75lg1-v1 devstack@c-api.service[84417]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/cinder-wsgi.socket fd 4 May 28 12:44:39 l75lg1-v1 devstack@c-api.service[84417]: Python version: 3.10.12 (main, Nov 20 2023, 15:14:05) [GCC 11.4.0] May 28 12:44:39 l75lg1-v1 devstack@c-api.service[84417]: PEP 405 virtualenv detected: /opt/stack/data/venv May 28 12:44:39 l75lg1-v1 devstack@c-api.service[84417]: Set PythonHome to /opt/stack/data/venv May 28 12:44:40 l75lg1-v1 devstack@c-api.service[84417]: Python main interpreter initialized at 0x55f73648cb70 May 28 12:44:40 l75lg1-v1 devstack@c-api.service[84417]: python threads support enabled May 28 12:44:40 l75lg1-v1 devstack@c-api.service[84417]: your server socket listen backlog is limited to 100 connections May 28 12:44:40 l75lg1-v1 devstack@c-api.service[84417]: your mercy for graceful operations on workers is 80 seconds May 28 12:44:40 l75lg1-v1 devstack@c-api.service[84417]: mapped 403077 bytes (393 KB) for 2 cores May 28 12:44:40 l75lg1-v1 devstack@c-api.service[84417]: *** Operational MODE: preforking *** May 28 12:44:40 l75lg1-v1 devstack@c-api.service[84417]: *** uWSGI is running in multiple interpreter mode *** May 28 12:44:40 l75lg1-v1 devstack@c-api.service[84417]: spawned uWSGI master process (pid: 84417) May 28 12:44:40 l75lg1-v1 devstack@c-api.service[84417]: spawned uWSGI worker 1 (pid: 84424, cores: 1) May 28 12:44:40 l75lg1-v1 devstack@c-api.service[84417]: spawned uWSGI worker 2 (pid: 84425, cores: 1) May 28 12:44:40 l75lg1-v1 devstack@c-api.service[84417]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 28 12:44:40 l75lg1-v1 nova-compute[83654]: WARNING nova.virt.libvirt.driver [None req-d5e2622c-e52e-4f3d-871c-2ddda502f287 None None] Cannot update service status on host "l75lg1-v1" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host l75lg1-v1 could not be found. May 28 12:44:40 l75lg1-v1 nova-compute[83654]: DEBUG nova.virt.libvirt.volume.mount [None req-d5e2622c-e52e-4f3d-871c-2ddda502f287 None None] Initialising _HostMountState generation 0 {{(pid=83654) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}} May 28 12:44:40 l75lg1-v1 dstat.sh[49771]: 28-05 12:44:40| 23 6 69 1 0|3845M 5641M 267M 5945M| 15k 5915B| 788k 8395k|33.0 416 |8088 10k|1.67 1.80 1.28|5.0 0 150| 0 0 | 0 2048M| 26 201 0 20 0 May 28 12:44:40 l75lg1-v1 neutron-server[77618]: DEBUG dbcounter [-] [77618] Writing DB stats neutron:SELECT=967,neutron:INSERT=14,neutron:UPDATE=27,neutron:DELETE=2 {{(pid=77618) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:44:40 l75lg1-v1 neutron-server[77618]: DEBUG dbcounter [-] [77618] Writing DB stats neutron:SELECT=958,neutron:INSERT=16,neutron:DELETE=3,neutron:UPDATE=12 {{(pid=77618) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:44:40 l75lg1-v1 devstack@c-api.service[84424]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_versionedobjects/fields.py:18: DeprecationWarning: The distutils package is deprecated and slated for removal in Python 3.12. Use setuptools or check PEP 632 for potential alternatives May 28 12:44:40 l75lg1-v1 devstack@c-api.service[84424]: from distutils import versionpredicate May 28 12:44:40 l75lg1-v1 devstack@c-api.service[84425]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_versionedobjects/fields.py:18: DeprecationWarning: The distutils package is deprecated and slated for removal in Python 3.12. Use setuptools or check PEP 632 for potential alternatives May 28 12:44:40 l75lg1-v1 devstack@c-api.service[84425]: from distutils import versionpredicate May 28 12:44:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a950a6-8f6d-474a-a641-248a0947fe83 None None] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:44:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a950a6-8f6d-474a-a641-248a0947fe83 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:44:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a950a6-8f6d-474a-a641-248a0947fe83 None None] PATH_INFO: `/` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:44:41 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 461/937] 10.27.203.238 () {58 vars in 1014 bytes} [Tue May 28 12:44:41 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:44:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a566324-da92-4a3f-b8a2-b2c69970419d None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:44:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a566324-da92-4a3f-b8a2-b2c69970419d None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:44:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a566324-da92-4a3f-b8a2-b2c69970419d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:44:41 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-5a566324-da92-4a3f-b8a2-b2c69970419d None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:44:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-5a566324-da92-4a3f-b8a2-b2c69970419d None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:44:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-5a566324-da92-4a3f-b8a2-b2c69970419d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:44:41 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 477/938] 10.27.203.238 () {62 vars in 1111 bytes} [Tue May 28 12:44:41 2024] POST /identity/v3/auth/tokens => generated 3991 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:44:41 l75lg1-v1 dstat.sh[49771]: 28-05 12:44:41| 36 6 58 0 0|3966M 5516M 267M 5948M| 15k 0 | 0 756k| 0 58.7 |4936 6390 |1.67 1.80 1.28|6.0 0 40| 0 0 | 0 2048M| 26 201 0 19 0 May 28 12:44:41 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi [None req-05d0d265-71fe-4459-b94b-819ae5ab8130 None None] Calling method '>' {{(pid=74000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} May 28 12:44:41 l75lg1-v1 devstack@n-api.service[74000]: INFO nova.api.openstack.requestlog [None req-05d0d265-71fe-4459-b94b-819ae5ab8130 None None] 10.27.203.238 "GET /compute/v2.1" status: 200 len: 390 microversion: 2.1 time: 0.001272 May 28 12:44:41 l75lg1-v1 devstack@n-api.service[74000]: [pid: 74000|app: 0|req: 3/4] 10.27.203.238 () {58 vars in 1013 bytes} [Tue May 28 12:44:41 2024] GET /compute/v2.1 => generated 390 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 12:44:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a950a6-8f6d-474a-a641-248a0947fe83 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:44:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a950a6-8f6d-474a-a641-248a0947fe83 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:44:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff233d26-54f5-4fe7-a90e-a65eec65f5a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'befdd4414dc2432ab2baa1ae3fbffef7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'manager', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:44:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff233d26-54f5-4fe7-a90e-a65eec65f5a8 service nova] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:44:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff233d26-54f5-4fe7-a90e-a65eec65f5a8 service nova] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:44:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff233d26-54f5-4fe7-a90e-a65eec65f5a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:44:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff233d26-54f5-4fe7-a90e-a65eec65f5a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:44:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff233d26-54f5-4fe7-a90e-a65eec65f5a8 service nova] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:44:41 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 462/939] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 12:44:41 2024] GET /identity/v3/auth/tokens => generated 3991 bytes in 22 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 12:44:41 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi [None req-6e2df421-cd42-41ae-801c-ee0434dd0fc8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "c1", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "cirros256", "os-flavor-access:is_public": true, "disk": 1, "ram": 256, "vcpus": 1, "rxtx_factor": 1.0}} {{(pid=73999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:518}} May 28 12:44:41 l75lg1-v1 devstack@n-api.service[73999]: INFO nova.api.openstack.requestlog [None req-6e2df421-cd42-41ae-801c-ee0434dd0fc8 admin admin] 10.27.203.238 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.61 time: 0.078524 May 28 12:44:41 l75lg1-v1 devstack@n-api.service[73999]: [pid: 73999|app: 0|req: 2/5] 10.27.203.238 () {68 vars in 1365 bytes} [Tue May 28 12:44:41 2024] POST /compute/v2.1/flavors => generated 411 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 12:44:41 l75lg1-v1 devstack@n-api.service[74000]: DEBUG dbcounter [-] [74000] Writing DB stats nova_api:SELECT=1 {{(pid=74000) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:44:41 l75lg1-v1 devstack@n-api.service[74000]: DEBUG dbcounter [-] [74000] Writing DB stats nova_cell1:SELECT=1 {{(pid=74000) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:44:41 l75lg1-v1 devstack@n-api.service[74000]: DEBUG dbcounter [-] [74000] Writing DB stats nova_cell0:SELECT=1 {{(pid=74000) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:44:41 l75lg1-v1 devstack@n-api.service[74000]: DEBUG dbcounter [-] [74000] Writing DB stats nova_cell0:SELECT=2,nova_cell0:INSERT=1 {{(pid=74000) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:44:41 l75lg1-v1 devstack@c-api.service[84425]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_policy/policy.py:1592: DeprecationWarning: volume_extension:quotas:show deprecated without deprecated_reason or deprecated_since. This will be an error in a future release May 28 12:44:41 l75lg1-v1 devstack@c-api.service[84425]: warnings.warn( May 28 12:44:41 l75lg1-v1 devstack@c-api.service[84424]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_policy/policy.py:1592: DeprecationWarning: volume_extension:quotas:show deprecated without deprecated_reason or deprecated_since. This will be an error in a future release May 28 12:44:41 l75lg1-v1 devstack@c-api.service[84424]: warnings.warn( May 28 12:44:41 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi [None req-093f3ce2-8873-4663-a4d1-538ec1baa1b9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=74000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:518}} May 28 12:44:41 l75lg1-v1 devstack@n-api.service[74000]: INFO nova.api.openstack.requestlog [None req-093f3ce2-8873-4663-a4d1-538ec1baa1b9 admin admin] 10.27.203.238 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.224027 May 28 12:44:41 l75lg1-v1 devstack@n-api.service[74000]: [pid: 74000|app: 0|req: 4/6] 10.27.203.238 () {68 vars in 1418 bytes} [Tue May 28 12:44:41 2024] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 12:44:41 l75lg1-v1 devstack@c-api.service[84425]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/image_util.py:16: DeprecationWarning: defusedxml.lxml is no longer supported and will be removed in a future release. May 28 12:44:41 l75lg1-v1 devstack@c-api.service[84425]: from defusedxml.lxml import parse May 28 12:44:41 l75lg1-v1 devstack@c-api.service[84424]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_vmware/image_util.py:16: DeprecationWarning: defusedxml.lxml is no longer supported and will be removed in a future release. May 28 12:44:41 l75lg1-v1 devstack@c-api.service[84424]: from defusedxml.lxml import parse May 28 12:44:41 l75lg1-v1 devstack@c-api.service[84425]: /opt/stack/cinder/cinder/db/sqlalchemy/models.py:37: MovedIn20Warning: The ``declarative_base()`` function is now available as sqlalchemy.orm.declarative_base(). (deprecated since: 2.0) (Background on SQLAlchemy 2.0 at: https://sqlalche.me/e/b8d9) May 28 12:44:41 l75lg1-v1 devstack@c-api.service[84425]: BASE = declarative_base() May 28 12:44:41 l75lg1-v1 devstack@c-api.service[84424]: /opt/stack/cinder/cinder/db/sqlalchemy/models.py:37: MovedIn20Warning: The ``declarative_base()`` function is now available as sqlalchemy.orm.declarative_base(). (deprecated since: 2.0) (Background on SQLAlchemy 2.0 at: https://sqlalche.me/e/b8d9) May 28 12:44:41 l75lg1-v1 devstack@c-api.service[84424]: BASE = declarative_base() May 28 12:44:41 l75lg1-v1 nova-scheduler[81196]: DEBUG dbcounter [-] [81196] Writing DB stats nova_cell0:SELECT=4,nova_cell0:INSERT=1,nova_cell0:UPDATE=1 {{(pid=81196) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:44:41 l75lg1-v1 nova-scheduler[81194]: DEBUG dbcounter [-] [81194] Writing DB stats nova_cell0:SELECT=4,nova_cell0:INSERT=1 {{(pid=81194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:44:41 l75lg1-v1 etcd[50438]: start time = 2024-05-28 12:44:41.917696965 +0000 UTC m=+526.449444399, time spent = 319.472µs, remote = 10.27.203.238:56390, response type = /etcdserverpb.Lease/LeaseGrant, request count = -1, request size = -1, response count = -1, response size = -1, request content = May 28 12:44:41 l75lg1-v1 etcd[50438]: start time = 2024-05-28 12:44:41.965603825 +0000 UTC m=+526.497351259, time spent = 283.882µs, remote = 10.27.203.238:56390, response type = /etcdserverpb.Lease/LeaseGrant, request count = -1, request size = -1, response count = -1, response size = -1, request content = May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG oslo.service.wsgi [-] Loading app osapi_volume from /etc/cinder/api-paste.ini {{(pid=84425) load_app /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/wsgi.py:349}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Initializing extension manager. {{(pid=84425) __init__ /opt/stack/cinder/cinder/api/extensions.py:125}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Loading extension cinder.api.contrib.standard_extensions {{(pid=84425) load_extension /opt/stack/cinder/cinder/api/extensions.py:199}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Calling extension factory cinder.api.contrib.standard_extensions {{(pid=84425) load_extension /opt/stack/cinder/cinder/api/extensions.py:205}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Loading extension cinder.api.contrib.volume_image_metadata.Volume_image_metadata {{(pid=84425) load_extension /opt/stack/cinder/cinder/api/extensions.py:199}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG oslo.service.wsgi [-] Loading app osapi_volume from /etc/cinder/api-paste.ini {{(pid=84424) load_app /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/wsgi.py:349}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Initializing extension manager. {{(pid=84424) __init__ /opt/stack/cinder/cinder/api/extensions.py:125}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Loading extension cinder.api.contrib.standard_extensions {{(pid=84424) load_extension /opt/stack/cinder/cinder/api/extensions.py:199}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Calling extension factory cinder.api.contrib.standard_extensions {{(pid=84424) load_extension /opt/stack/cinder/cinder/api/extensions.py:205}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Loading extension cinder.api.contrib.volume_image_metadata.Volume_image_metadata {{(pid=84424) load_extension /opt/stack/cinder/cinder/api/extensions.py:199}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: /opt/stack/cinder/cinder/api/validation/validators.py:126: DeprecationWarning: FormatChecker.cls_checks is deprecated. Call FormatChecker.checks on a specific FormatChecker instance instead. May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: @jsonschema.FormatChecker.cls_checks('date-time') May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: /opt/stack/cinder/cinder/api/validation/validators.py:126: DeprecationWarning: FormatChecker.cls_checks is deprecated. Call FormatChecker.checks on a specific FormatChecker instance instead. May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: @jsonschema.FormatChecker.cls_checks('date-time') May 28 12:44:42 l75lg1-v1 dstat.sh[49771]: 28-05 12:44:42| 34 7 58 0 0|3986M 5492M 267M 5952M| 14k 0 | 600k 1248k|7.05 108 |5687 7950 |1.86 1.84 1.30|7.0 0 53| 0 0 | 0 2048M| 26 219 0 19 0 May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Calling extension factory cinder.api.contrib.volume_image_metadata.Volume_image_metadata {{(pid=84425) load_extension /opt/stack/cinder/cinder/api/extensions.py:205}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext name: VolumeImageMetadata {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:179}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext alias: os-vol-image-meta {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:180}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext description: Show image metadata associated with the volume. {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:181}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext updated: 2012-12-07T00:00:00+00:00 {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:183}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Loaded extension: os-vol-image-meta {{(pid=84425) register /opt/stack/cinder/cinder/api/extensions.py:140}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Loading extension cinder.api.contrib.extended_services.Extended_services {{(pid=84425) load_extension /opt/stack/cinder/cinder/api/extensions.py:199}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Calling extension factory cinder.api.contrib.extended_services.Extended_services {{(pid=84425) load_extension /opt/stack/cinder/cinder/api/extensions.py:205}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext name: ExtendedServices {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:179}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext alias: os-extended-services {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:180}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext description: Extended services support. {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:181}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext updated: 2014-01-10T00:00:00-00:00 {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:183}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Loaded extension: os-extended-services {{(pid=84425) register /opt/stack/cinder/cinder/api/extensions.py:140}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Loading extension cinder.api.contrib.volume_actions.Volume_actions {{(pid=84425) load_extension /opt/stack/cinder/cinder/api/extensions.py:199}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Calling extension factory cinder.api.contrib.volume_actions.Volume_actions {{(pid=84425) load_extension /opt/stack/cinder/cinder/api/extensions.py:205}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext name: VolumeActions {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:179}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext alias: os-volume-actions {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:180}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext description: Enable volume actions. {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:181}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext updated: 2012-05-31T00:00:00+00:00 {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:183}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Loaded extension: os-volume-actions {{(pid=84425) register /opt/stack/cinder/cinder/api/extensions.py:140}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Loading extension cinder.api.contrib.volume_encryption_metadata.Volume_encryption_metadata {{(pid=84425) load_extension /opt/stack/cinder/cinder/api/extensions.py:199}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Calling extension factory cinder.api.contrib.volume_encryption_metadata.Volume_encryption_metadata {{(pid=84425) load_extension /opt/stack/cinder/cinder/api/extensions.py:205}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext name: VolumeEncryptionMetadata {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:179}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext alias: os-volume-encryption-metadata {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:180}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext description: Volume encryption metadata retrieval support. {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:181}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext updated: 2013-07-10T00:00:00+00:00 {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:183}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Loaded extension: os-volume-encryption-metadata {{(pid=84425) register /opt/stack/cinder/cinder/api/extensions.py:140}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Loading extension cinder.api.contrib.scheduler_hints.Scheduler_hints {{(pid=84425) load_extension /opt/stack/cinder/cinder/api/extensions.py:199}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Calling extension factory cinder.api.contrib.scheduler_hints.Scheduler_hints {{(pid=84425) load_extension /opt/stack/cinder/cinder/api/extensions.py:205}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext name: SchedulerHints {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:179}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext alias: OS-SCH-HNT {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:180}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext description: Pass arbitrary key/value pairs to the scheduler. {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:181}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext updated: 2013-04-18T00:00:00+00:00 {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:183}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Loaded extension: OS-SCH-HNT {{(pid=84425) register /opt/stack/cinder/cinder/api/extensions.py:140}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Loading extension cinder.api.contrib.volume_manage.Volume_manage {{(pid=84425) load_extension /opt/stack/cinder/cinder/api/extensions.py:199}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Calling extension factory cinder.api.contrib.volume_image_metadata.Volume_image_metadata {{(pid=84424) load_extension /opt/stack/cinder/cinder/api/extensions.py:205}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext name: VolumeImageMetadata {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:179}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext alias: os-vol-image-meta {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:180}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext description: Show image metadata associated with the volume. {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:181}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext updated: 2012-12-07T00:00:00+00:00 {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:183}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Loaded extension: os-vol-image-meta {{(pid=84424) register /opt/stack/cinder/cinder/api/extensions.py:140}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Loading extension cinder.api.contrib.extended_services.Extended_services {{(pid=84424) load_extension /opt/stack/cinder/cinder/api/extensions.py:199}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Calling extension factory cinder.api.contrib.extended_services.Extended_services {{(pid=84424) load_extension /opt/stack/cinder/cinder/api/extensions.py:205}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext name: ExtendedServices {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:179}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext alias: os-extended-services {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:180}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext description: Extended services support. {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:181}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext updated: 2014-01-10T00:00:00-00:00 {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:183}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Loaded extension: os-extended-services {{(pid=84424) register /opt/stack/cinder/cinder/api/extensions.py:140}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Loading extension cinder.api.contrib.volume_actions.Volume_actions {{(pid=84424) load_extension /opt/stack/cinder/cinder/api/extensions.py:199}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Calling extension factory cinder.api.contrib.volume_actions.Volume_actions {{(pid=84424) load_extension /opt/stack/cinder/cinder/api/extensions.py:205}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext name: VolumeActions {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:179}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext alias: os-volume-actions {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:180}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext description: Enable volume actions. {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:181}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext updated: 2012-05-31T00:00:00+00:00 {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:183}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Loaded extension: os-volume-actions {{(pid=84424) register /opt/stack/cinder/cinder/api/extensions.py:140}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Loading extension cinder.api.contrib.volume_encryption_metadata.Volume_encryption_metadata {{(pid=84424) load_extension /opt/stack/cinder/cinder/api/extensions.py:199}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Calling extension factory cinder.api.contrib.volume_encryption_metadata.Volume_encryption_metadata {{(pid=84424) load_extension /opt/stack/cinder/cinder/api/extensions.py:205}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext name: VolumeEncryptionMetadata {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:179}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext alias: os-volume-encryption-metadata {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:180}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext description: Volume encryption metadata retrieval support. {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:181}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext updated: 2013-07-10T00:00:00+00:00 {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:183}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Loaded extension: os-volume-encryption-metadata {{(pid=84424) register /opt/stack/cinder/cinder/api/extensions.py:140}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Loading extension cinder.api.contrib.scheduler_hints.Scheduler_hints {{(pid=84424) load_extension /opt/stack/cinder/cinder/api/extensions.py:199}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Calling extension factory cinder.api.contrib.scheduler_hints.Scheduler_hints {{(pid=84424) load_extension /opt/stack/cinder/cinder/api/extensions.py:205}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext name: SchedulerHints {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:179}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext alias: OS-SCH-HNT {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:180}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext description: Pass arbitrary key/value pairs to the scheduler. {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:181}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext updated: 2013-04-18T00:00:00+00:00 {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:183}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Loaded extension: OS-SCH-HNT {{(pid=84424) register /opt/stack/cinder/cinder/api/extensions.py:140}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Loading extension cinder.api.contrib.volume_manage.Volume_manage {{(pid=84424) load_extension /opt/stack/cinder/cinder/api/extensions.py:199}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Calling extension factory cinder.api.contrib.volume_manage.Volume_manage {{(pid=84425) load_extension /opt/stack/cinder/cinder/api/extensions.py:205}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext name: VolumeManage {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:179}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext alias: os-volume-manage {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:180}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Calling extension factory cinder.api.contrib.volume_manage.Volume_manage {{(pid=84424) load_extension /opt/stack/cinder/cinder/api/extensions.py:205}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext description: Allows existing backend storage to be 'managed' by Cinder. {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:181}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext name: VolumeManage {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:179}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext updated: 2014-02-10T00:00:00+00:00 {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:183}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext alias: os-volume-manage {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:180}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Loaded extension: os-volume-manage {{(pid=84425) register /opt/stack/cinder/cinder/api/extensions.py:140}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext description: Allows existing backend storage to be 'managed' by Cinder. {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:181}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Loading extension cinder.api.contrib.snapshot_manage.Snapshot_manage {{(pid=84425) load_extension /opt/stack/cinder/cinder/api/extensions.py:199}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext updated: 2014-02-10T00:00:00+00:00 {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:183}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Loaded extension: os-volume-manage {{(pid=84424) register /opt/stack/cinder/cinder/api/extensions.py:140}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Loading extension cinder.api.contrib.snapshot_manage.Snapshot_manage {{(pid=84424) load_extension /opt/stack/cinder/cinder/api/extensions.py:199}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Calling extension factory cinder.api.contrib.snapshot_manage.Snapshot_manage {{(pid=84425) load_extension /opt/stack/cinder/cinder/api/extensions.py:205}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext name: SnapshotManage {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:179}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext alias: os-snapshot-manage {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:180}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Calling extension factory cinder.api.contrib.snapshot_manage.Snapshot_manage {{(pid=84424) load_extension /opt/stack/cinder/cinder/api/extensions.py:205}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext description: Allows existing backend storage to be 'managed' by Cinder. {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:181}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext name: SnapshotManage {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:179}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext updated: 2014-12-31T00:00:00+00:00 {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:183}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext alias: os-snapshot-manage {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:180}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Loaded extension: os-snapshot-manage {{(pid=84425) register /opt/stack/cinder/cinder/api/extensions.py:140}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext description: Allows existing backend storage to be 'managed' by Cinder. {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:181}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Loading extension cinder.api.contrib.capabilities.Capabilities {{(pid=84425) load_extension /opt/stack/cinder/cinder/api/extensions.py:199}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext updated: 2014-12-31T00:00:00+00:00 {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:183}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Loaded extension: os-snapshot-manage {{(pid=84424) register /opt/stack/cinder/cinder/api/extensions.py:140}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Loading extension cinder.api.contrib.capabilities.Capabilities {{(pid=84424) load_extension /opt/stack/cinder/cinder/api/extensions.py:199}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Calling extension factory cinder.api.contrib.capabilities.Capabilities {{(pid=84425) load_extension /opt/stack/cinder/cinder/api/extensions.py:205}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext name: Capabilities {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:179}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext alias: capabilities {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:180}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext description: Capabilities support. {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:181}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext updated: 2015-08-31T00:00:00+00:00 {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:183}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Calling extension factory cinder.api.contrib.capabilities.Capabilities {{(pid=84424) load_extension /opt/stack/cinder/cinder/api/extensions.py:205}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Loaded extension: capabilities {{(pid=84425) register /opt/stack/cinder/cinder/api/extensions.py:140}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext name: Capabilities {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:179}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Loading extension cinder.api.contrib.volume_transfer.Volume_transfer {{(pid=84425) load_extension /opt/stack/cinder/cinder/api/extensions.py:199}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext alias: capabilities {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:180}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext description: Capabilities support. {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:181}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext updated: 2015-08-31T00:00:00+00:00 {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:183}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Loaded extension: capabilities {{(pid=84424) register /opt/stack/cinder/cinder/api/extensions.py:140}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Loading extension cinder.api.contrib.volume_transfer.Volume_transfer {{(pid=84424) load_extension /opt/stack/cinder/cinder/api/extensions.py:199}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Calling extension factory cinder.api.contrib.volume_transfer.Volume_transfer {{(pid=84425) load_extension /opt/stack/cinder/cinder/api/extensions.py:205}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext name: VolumeTransfer {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:179}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext alias: os-volume-transfer {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:180}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext description: Volume transfer management support. {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:181}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext updated: 2013-05-29T00:00:00+00:00 {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:183}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Calling extension factory cinder.api.contrib.volume_transfer.Volume_transfer {{(pid=84424) load_extension /opt/stack/cinder/cinder/api/extensions.py:205}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Loaded extension: os-volume-transfer {{(pid=84425) register /opt/stack/cinder/cinder/api/extensions.py:140}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext name: VolumeTransfer {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:179}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Loading extension cinder.api.contrib.volume_mig_status_attribute.Volume_mig_status_attribute {{(pid=84425) load_extension /opt/stack/cinder/cinder/api/extensions.py:199}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext alias: os-volume-transfer {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:180}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext description: Volume transfer management support. {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:181}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext updated: 2013-05-29T00:00:00+00:00 {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:183}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Loaded extension: os-volume-transfer {{(pid=84424) register /opt/stack/cinder/cinder/api/extensions.py:140}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Loading extension cinder.api.contrib.volume_mig_status_attribute.Volume_mig_status_attribute {{(pid=84424) load_extension /opt/stack/cinder/cinder/api/extensions.py:199}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Calling extension factory cinder.api.contrib.volume_mig_status_attribute.Volume_mig_status_attribute {{(pid=84425) load_extension /opt/stack/cinder/cinder/api/extensions.py:205}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext name: VolumeMigStatusAttribute {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:179}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext alias: os-vol-mig-status-attr {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:180}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext description: Expose migration_status as an attribute of a volume. {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:181}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext updated: 2013-08-08T00:00:00+00:00 {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:183}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Calling extension factory cinder.api.contrib.volume_mig_status_attribute.Volume_mig_status_attribute {{(pid=84424) load_extension /opt/stack/cinder/cinder/api/extensions.py:205}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Loaded extension: os-vol-mig-status-attr {{(pid=84425) register /opt/stack/cinder/cinder/api/extensions.py:140}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Loading extension cinder.api.contrib.volume_tenant_attribute.Volume_tenant_attribute {{(pid=84425) load_extension /opt/stack/cinder/cinder/api/extensions.py:199}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext name: VolumeMigStatusAttribute {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:179}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext alias: os-vol-mig-status-attr {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:180}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext description: Expose migration_status as an attribute of a volume. {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:181}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext updated: 2013-08-08T00:00:00+00:00 {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:183}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Loaded extension: os-vol-mig-status-attr {{(pid=84424) register /opt/stack/cinder/cinder/api/extensions.py:140}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Loading extension cinder.api.contrib.volume_tenant_attribute.Volume_tenant_attribute {{(pid=84424) load_extension /opt/stack/cinder/cinder/api/extensions.py:199}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Calling extension factory cinder.api.contrib.volume_tenant_attribute.Volume_tenant_attribute {{(pid=84425) load_extension /opt/stack/cinder/cinder/api/extensions.py:205}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext name: VolumeTenantAttribute {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:179}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext alias: os-vol-tenant-attr {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:180}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext description: Expose the internal project_id as an attribute of a volume. {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:181}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext updated: 2011-11-03T00:00:00+00:00 {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:183}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Loaded extension: os-vol-tenant-attr {{(pid=84425) register /opt/stack/cinder/cinder/api/extensions.py:140}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Calling extension factory cinder.api.contrib.volume_tenant_attribute.Volume_tenant_attribute {{(pid=84424) load_extension /opt/stack/cinder/cinder/api/extensions.py:205}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Loading extension cinder.api.contrib.admin_actions.Admin_actions {{(pid=84425) load_extension /opt/stack/cinder/cinder/api/extensions.py:199}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext name: VolumeTenantAttribute {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:179}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext alias: os-vol-tenant-attr {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:180}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext description: Expose the internal project_id as an attribute of a volume. {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:181}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext updated: 2011-11-03T00:00:00+00:00 {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:183}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Loaded extension: os-vol-tenant-attr {{(pid=84424) register /opt/stack/cinder/cinder/api/extensions.py:140}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Loading extension cinder.api.contrib.admin_actions.Admin_actions {{(pid=84424) load_extension /opt/stack/cinder/cinder/api/extensions.py:199}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Calling extension factory cinder.api.contrib.admin_actions.Admin_actions {{(pid=84425) load_extension /opt/stack/cinder/cinder/api/extensions.py:205}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext name: AdminActions {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:179}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext alias: os-admin-actions {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:180}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext description: Enable admin actions. {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:181}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext updated: 2012-08-25T00:00:00+00:00 {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:183}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Loaded extension: os-admin-actions {{(pid=84425) register /opt/stack/cinder/cinder/api/extensions.py:140}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Loading extension cinder.api.contrib.consistencygroups.Consistencygroups {{(pid=84425) load_extension /opt/stack/cinder/cinder/api/extensions.py:199}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Calling extension factory cinder.api.contrib.admin_actions.Admin_actions {{(pid=84424) load_extension /opt/stack/cinder/cinder/api/extensions.py:205}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext name: AdminActions {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:179}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext alias: os-admin-actions {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:180}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext description: Enable admin actions. {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:181}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext updated: 2012-08-25T00:00:00+00:00 {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:183}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Loaded extension: os-admin-actions {{(pid=84424) register /opt/stack/cinder/cinder/api/extensions.py:140}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Loading extension cinder.api.contrib.consistencygroups.Consistencygroups {{(pid=84424) load_extension /opt/stack/cinder/cinder/api/extensions.py:199}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Calling extension factory cinder.api.contrib.consistencygroups.Consistencygroups {{(pid=84425) load_extension /opt/stack/cinder/cinder/api/extensions.py:205}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext name: Consistencygroups {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:179}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext alias: consistencygroups {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:180}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext description: consistency groups support. {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:181}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext updated: 2014-08-18T00:00:00+00:00 {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:183}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Loaded extension: consistencygroups {{(pid=84425) register /opt/stack/cinder/cinder/api/extensions.py:140}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Loading extension cinder.api.contrib.backups.Backups {{(pid=84425) load_extension /opt/stack/cinder/cinder/api/extensions.py:199}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Calling extension factory cinder.api.contrib.consistencygroups.Consistencygroups {{(pid=84424) load_extension /opt/stack/cinder/cinder/api/extensions.py:205}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext name: Consistencygroups {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:179}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext alias: consistencygroups {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:180}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext description: consistency groups support. {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:181}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext updated: 2014-08-18T00:00:00+00:00 {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:183}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Loaded extension: consistencygroups {{(pid=84424) register /opt/stack/cinder/cinder/api/extensions.py:140}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Loading extension cinder.api.contrib.backups.Backups {{(pid=84424) load_extension /opt/stack/cinder/cinder/api/extensions.py:199}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Calling extension factory cinder.api.contrib.backups.Backups {{(pid=84425) load_extension /opt/stack/cinder/cinder/api/extensions.py:205}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext name: Backups {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:179}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext alias: backups {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:180}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext description: Backups support. {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:181}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext updated: 2012-12-12T00:00:00+00:00 {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:183}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Loaded extension: backups {{(pid=84425) register /opt/stack/cinder/cinder/api/extensions.py:140}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Loading extension cinder.api.contrib.types_manage.Types_manage {{(pid=84425) load_extension /opt/stack/cinder/cinder/api/extensions.py:199}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Calling extension factory cinder.api.contrib.backups.Backups {{(pid=84424) load_extension /opt/stack/cinder/cinder/api/extensions.py:205}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext name: Backups {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:179}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext alias: backups {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:180}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext description: Backups support. {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:181}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext updated: 2012-12-12T00:00:00+00:00 {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:183}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Loaded extension: backups {{(pid=84424) register /opt/stack/cinder/cinder/api/extensions.py:140}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Loading extension cinder.api.contrib.types_manage.Types_manage {{(pid=84424) load_extension /opt/stack/cinder/cinder/api/extensions.py:199}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Calling extension factory cinder.api.contrib.types_manage.Types_manage {{(pid=84425) load_extension /opt/stack/cinder/cinder/api/extensions.py:205}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Calling extension factory cinder.api.contrib.types_manage.Types_manage {{(pid=84424) load_extension /opt/stack/cinder/cinder/api/extensions.py:205}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext name: TypesManage {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:179}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext name: TypesManage {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:179}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext alias: os-types-manage {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:180}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext alias: os-types-manage {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:180}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext description: Types manage support. {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:181}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext updated: 2011-08-24T00:00:00+00:00 {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:183}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext description: Types manage support. {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:181}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Loaded extension: os-types-manage {{(pid=84425) register /opt/stack/cinder/cinder/api/extensions.py:140}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext updated: 2011-08-24T00:00:00+00:00 {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:183}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Loaded extension: os-types-manage {{(pid=84424) register /opt/stack/cinder/cinder/api/extensions.py:140}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Loading extension cinder.api.contrib.availability_zones.Availability_zones {{(pid=84425) load_extension /opt/stack/cinder/cinder/api/extensions.py:199}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Loading extension cinder.api.contrib.availability_zones.Availability_zones {{(pid=84424) load_extension /opt/stack/cinder/cinder/api/extensions.py:199}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Calling extension factory cinder.api.contrib.availability_zones.Availability_zones {{(pid=84425) load_extension /opt/stack/cinder/cinder/api/extensions.py:205}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext name: AvailabilityZones {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:179}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext alias: os-availability-zone {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:180}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Calling extension factory cinder.api.contrib.availability_zones.Availability_zones {{(pid=84424) load_extension /opt/stack/cinder/cinder/api/extensions.py:205}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext description: Describe Availability Zones. {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:181}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext name: AvailabilityZones {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:179}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext updated: 2013-06-27T00:00:00+00:00 {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:183}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext alias: os-availability-zone {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:180}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Loaded extension: os-availability-zone {{(pid=84425) register /opt/stack/cinder/cinder/api/extensions.py:140}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext description: Describe Availability Zones. {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:181}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Loading extension cinder.api.contrib.quota_classes.Quota_classes {{(pid=84425) load_extension /opt/stack/cinder/cinder/api/extensions.py:199}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext updated: 2013-06-27T00:00:00+00:00 {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:183}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Loaded extension: os-availability-zone {{(pid=84424) register /opt/stack/cinder/cinder/api/extensions.py:140}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Loading extension cinder.api.contrib.quota_classes.Quota_classes {{(pid=84424) load_extension /opt/stack/cinder/cinder/api/extensions.py:199}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Calling extension factory cinder.api.contrib.quota_classes.Quota_classes {{(pid=84425) load_extension /opt/stack/cinder/cinder/api/extensions.py:205}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Calling extension factory cinder.api.contrib.quota_classes.Quota_classes {{(pid=84424) load_extension /opt/stack/cinder/cinder/api/extensions.py:205}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext name: QuotaClasses {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:179}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext name: QuotaClasses {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:179}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext alias: os-quota-class-sets {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:180}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext alias: os-quota-class-sets {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:180}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext description: Quota classes management support. {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:181}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext description: Quota classes management support. {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:181}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext updated: 2012-03-12T00:00:00+00:00 {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:183}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext updated: 2012-03-12T00:00:00+00:00 {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:183}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Loaded extension: os-quota-class-sets {{(pid=84425) register /opt/stack/cinder/cinder/api/extensions.py:140}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Loaded extension: os-quota-class-sets {{(pid=84424) register /opt/stack/cinder/cinder/api/extensions.py:140}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Loading extension cinder.api.contrib.volume_type_encryption.Volume_type_encryption {{(pid=84425) load_extension /opt/stack/cinder/cinder/api/extensions.py:199}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Loading extension cinder.api.contrib.volume_type_encryption.Volume_type_encryption {{(pid=84424) load_extension /opt/stack/cinder/cinder/api/extensions.py:199}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Calling extension factory cinder.api.contrib.volume_type_encryption.Volume_type_encryption {{(pid=84425) load_extension /opt/stack/cinder/cinder/api/extensions.py:205}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext name: VolumeTypeEncryption {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:179}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Calling extension factory cinder.api.contrib.volume_type_encryption.Volume_type_encryption {{(pid=84424) load_extension /opt/stack/cinder/cinder/api/extensions.py:205}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext alias: encryption {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:180}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext name: VolumeTypeEncryption {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:179}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext description: Encryption support for volume types. {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:181}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext updated: 2013-07-01T00:00:00+00:00 {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:183}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext alias: encryption {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:180}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Loaded extension: encryption {{(pid=84425) register /opt/stack/cinder/cinder/api/extensions.py:140}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext description: Encryption support for volume types. {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:181}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Loading extension cinder.api.contrib.quotas.Quotas {{(pid=84425) load_extension /opt/stack/cinder/cinder/api/extensions.py:199}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext updated: 2013-07-01T00:00:00+00:00 {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:183}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Loaded extension: encryption {{(pid=84424) register /opt/stack/cinder/cinder/api/extensions.py:140}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Loading extension cinder.api.contrib.quotas.Quotas {{(pid=84424) load_extension /opt/stack/cinder/cinder/api/extensions.py:199}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Calling extension factory cinder.api.contrib.quotas.Quotas {{(pid=84425) load_extension /opt/stack/cinder/cinder/api/extensions.py:205}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext name: Quotas {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:179}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Calling extension factory cinder.api.contrib.quotas.Quotas {{(pid=84424) load_extension /opt/stack/cinder/cinder/api/extensions.py:205}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext alias: os-quota-sets {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:180}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext name: Quotas {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:179}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext description: Quota management support. {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:181}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext alias: os-quota-sets {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:180}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext updated: 2011-08-08T00:00:00+00:00 {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:183}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext description: Quota management support. {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:181}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Loaded extension: os-quota-sets {{(pid=84425) register /opt/stack/cinder/cinder/api/extensions.py:140}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext updated: 2011-08-08T00:00:00+00:00 {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:183}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Loading extension cinder.api.contrib.services.Services {{(pid=84425) load_extension /opt/stack/cinder/cinder/api/extensions.py:199}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Loaded extension: os-quota-sets {{(pid=84424) register /opt/stack/cinder/cinder/api/extensions.py:140}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Loading extension cinder.api.contrib.services.Services {{(pid=84424) load_extension /opt/stack/cinder/cinder/api/extensions.py:199}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Calling extension factory cinder.api.contrib.services.Services {{(pid=84425) load_extension /opt/stack/cinder/cinder/api/extensions.py:205}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext name: Services {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:179}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext alias: os-services {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:180}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext description: Services support. {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:181}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext updated: 2012-10-28T00:00:00-00:00 {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:183}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Loaded extension: os-services {{(pid=84425) register /opt/stack/cinder/cinder/api/extensions.py:140}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Calling extension factory cinder.api.contrib.services.Services {{(pid=84424) load_extension /opt/stack/cinder/cinder/api/extensions.py:205}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Loading extension cinder.api.contrib.cgsnapshots.Cgsnapshots {{(pid=84425) load_extension /opt/stack/cinder/cinder/api/extensions.py:199}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext name: Services {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:179}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext alias: os-services {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:180}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext description: Services support. {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:181}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext updated: 2012-10-28T00:00:00-00:00 {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:183}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Loaded extension: os-services {{(pid=84424) register /opt/stack/cinder/cinder/api/extensions.py:140}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Loading extension cinder.api.contrib.cgsnapshots.Cgsnapshots {{(pid=84424) load_extension /opt/stack/cinder/cinder/api/extensions.py:199}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Calling extension factory cinder.api.contrib.cgsnapshots.Cgsnapshots {{(pid=84425) load_extension /opt/stack/cinder/cinder/api/extensions.py:205}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext name: Cgsnapshots {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:179}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext alias: cgsnapshots {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:180}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext description: cgsnapshots support. {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:181}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext updated: 2014-08-18T00:00:00+00:00 {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:183}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Loaded extension: cgsnapshots {{(pid=84425) register /opt/stack/cinder/cinder/api/extensions.py:140}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Loading extension cinder.api.contrib.extended_snapshot_attributes.Extended_snapshot_attributes {{(pid=84425) load_extension /opt/stack/cinder/cinder/api/extensions.py:199}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Calling extension factory cinder.api.contrib.cgsnapshots.Cgsnapshots {{(pid=84424) load_extension /opt/stack/cinder/cinder/api/extensions.py:205}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext name: Cgsnapshots {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:179}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext alias: cgsnapshots {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:180}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext description: cgsnapshots support. {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:181}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext updated: 2014-08-18T00:00:00+00:00 {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:183}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Loaded extension: cgsnapshots {{(pid=84424) register /opt/stack/cinder/cinder/api/extensions.py:140}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Loading extension cinder.api.contrib.extended_snapshot_attributes.Extended_snapshot_attributes {{(pid=84424) load_extension /opt/stack/cinder/cinder/api/extensions.py:199}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Calling extension factory cinder.api.contrib.extended_snapshot_attributes.Extended_snapshot_attributes {{(pid=84425) load_extension /opt/stack/cinder/cinder/api/extensions.py:205}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext name: ExtendedSnapshotAttributes {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:179}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Calling extension factory cinder.api.contrib.extended_snapshot_attributes.Extended_snapshot_attributes {{(pid=84424) load_extension /opt/stack/cinder/cinder/api/extensions.py:205}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext name: ExtendedSnapshotAttributes {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:179}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext alias: os-extended-snapshot-attributes {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:180}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext description: Extended SnapshotAttributes support. {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:181}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext alias: os-extended-snapshot-attributes {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:180}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext updated: 2012-06-19T00:00:00+00:00 {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:183}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext description: Extended SnapshotAttributes support. {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:181}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Loaded extension: os-extended-snapshot-attributes {{(pid=84425) register /opt/stack/cinder/cinder/api/extensions.py:140}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext updated: 2012-06-19T00:00:00+00:00 {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:183}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Loaded extension: os-extended-snapshot-attributes {{(pid=84424) register /opt/stack/cinder/cinder/api/extensions.py:140}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Loading extension cinder.api.contrib.qos_specs_manage.Qos_specs_manage {{(pid=84425) load_extension /opt/stack/cinder/cinder/api/extensions.py:199}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Loading extension cinder.api.contrib.qos_specs_manage.Qos_specs_manage {{(pid=84424) load_extension /opt/stack/cinder/cinder/api/extensions.py:199}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Calling extension factory cinder.api.contrib.qos_specs_manage.Qos_specs_manage {{(pid=84425) load_extension /opt/stack/cinder/cinder/api/extensions.py:205}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext name: Qos_specs_manage {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:179}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext alias: qos-specs {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:180}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext description: QoS specs support. {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:181}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Calling extension factory cinder.api.contrib.qos_specs_manage.Qos_specs_manage {{(pid=84424) load_extension /opt/stack/cinder/cinder/api/extensions.py:205}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext updated: 2013-08-02T00:00:00+00:00 {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:183}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Loaded extension: qos-specs {{(pid=84425) register /opt/stack/cinder/cinder/api/extensions.py:140}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext name: Qos_specs_manage {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:179}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Loading extension cinder.api.contrib.volume_unmanage.Volume_unmanage {{(pid=84425) load_extension /opt/stack/cinder/cinder/api/extensions.py:199}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext alias: qos-specs {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:180}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext description: QoS specs support. {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:181}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext updated: 2013-08-02T00:00:00+00:00 {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:183}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Loaded extension: qos-specs {{(pid=84424) register /opt/stack/cinder/cinder/api/extensions.py:140}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Loading extension cinder.api.contrib.volume_unmanage.Volume_unmanage {{(pid=84424) load_extension /opt/stack/cinder/cinder/api/extensions.py:199}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Calling extension factory cinder.api.contrib.volume_unmanage.Volume_unmanage {{(pid=84425) load_extension /opt/stack/cinder/cinder/api/extensions.py:205}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext name: VolumeUnmanage {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:179}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext alias: os-volume-unmanage {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:180}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext description: Enable volume unmanage operation. {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:181}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext updated: 2012-05-31T00:00:00+00:00 {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:183}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Loaded extension: os-volume-unmanage {{(pid=84425) register /opt/stack/cinder/cinder/api/extensions.py:140}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Calling extension factory cinder.api.contrib.volume_unmanage.Volume_unmanage {{(pid=84424) load_extension /opt/stack/cinder/cinder/api/extensions.py:205}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Loading extension cinder.api.contrib.snapshot_actions.Snapshot_actions {{(pid=84425) load_extension /opt/stack/cinder/cinder/api/extensions.py:199}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext name: VolumeUnmanage {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:179}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext alias: os-volume-unmanage {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:180}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext description: Enable volume unmanage operation. {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:181}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext updated: 2012-05-31T00:00:00+00:00 {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:183}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Loaded extension: os-volume-unmanage {{(pid=84424) register /opt/stack/cinder/cinder/api/extensions.py:140}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Loading extension cinder.api.contrib.snapshot_actions.Snapshot_actions {{(pid=84424) load_extension /opt/stack/cinder/cinder/api/extensions.py:199}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Calling extension factory cinder.api.contrib.snapshot_actions.Snapshot_actions {{(pid=84425) load_extension /opt/stack/cinder/cinder/api/extensions.py:205}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext name: SnapshotActions {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:179}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext alias: os-snapshot-actions {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:180}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Calling extension factory cinder.api.contrib.snapshot_actions.Snapshot_actions {{(pid=84424) load_extension /opt/stack/cinder/cinder/api/extensions.py:205}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext description: Enable snapshot manager actions. {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:181}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext name: SnapshotActions {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:179}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext updated: 2013-07-16T00:00:00+00:00 {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:183}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext alias: os-snapshot-actions {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:180}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Loaded extension: os-snapshot-actions {{(pid=84425) register /opt/stack/cinder/cinder/api/extensions.py:140}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext description: Enable snapshot manager actions. {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:181}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Loading extension cinder.api.contrib.used_limits.Used_limits {{(pid=84425) load_extension /opt/stack/cinder/cinder/api/extensions.py:199}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext updated: 2013-07-16T00:00:00+00:00 {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:183}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Loaded extension: os-snapshot-actions {{(pid=84424) register /opt/stack/cinder/cinder/api/extensions.py:140}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Loading extension cinder.api.contrib.used_limits.Used_limits {{(pid=84424) load_extension /opt/stack/cinder/cinder/api/extensions.py:199}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Calling extension factory cinder.api.contrib.used_limits.Used_limits {{(pid=84425) load_extension /opt/stack/cinder/cinder/api/extensions.py:205}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext name: UsedLimits {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:179}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext alias: os-used-limits {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:180}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Calling extension factory cinder.api.contrib.used_limits.Used_limits {{(pid=84424) load_extension /opt/stack/cinder/cinder/api/extensions.py:205}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext description: Provide data on limited resources that are being used. {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:181}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext updated: 2013-10-03T00:00:00+00:00 {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:183}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext name: UsedLimits {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:179}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Loaded extension: os-used-limits {{(pid=84425) register /opt/stack/cinder/cinder/api/extensions.py:140}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext alias: os-used-limits {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:180}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Loading extension cinder.api.contrib.types_extra_specs.Types_extra_specs {{(pid=84425) load_extension /opt/stack/cinder/cinder/api/extensions.py:199}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext description: Provide data on limited resources that are being used. {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:181}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext updated: 2013-10-03T00:00:00+00:00 {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:183}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Loaded extension: os-used-limits {{(pid=84424) register /opt/stack/cinder/cinder/api/extensions.py:140}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Loading extension cinder.api.contrib.types_extra_specs.Types_extra_specs {{(pid=84424) load_extension /opt/stack/cinder/cinder/api/extensions.py:199}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Calling extension factory cinder.api.contrib.types_extra_specs.Types_extra_specs {{(pid=84425) load_extension /opt/stack/cinder/cinder/api/extensions.py:205}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext name: TypesExtraSpecs {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:179}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext alias: os-types-extra-specs {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:180}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext description: Type extra specs support. {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:181}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Calling extension factory cinder.api.contrib.types_extra_specs.Types_extra_specs {{(pid=84424) load_extension /opt/stack/cinder/cinder/api/extensions.py:205}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext updated: 2011-08-24T00:00:00+00:00 {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:183}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext name: TypesExtraSpecs {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:179}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Loaded extension: os-types-extra-specs {{(pid=84425) register /opt/stack/cinder/cinder/api/extensions.py:140}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext alias: os-types-extra-specs {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:180}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Loading extension cinder.api.contrib.volume_host_attribute.Volume_host_attribute {{(pid=84425) load_extension /opt/stack/cinder/cinder/api/extensions.py:199}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext description: Type extra specs support. {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:181}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext updated: 2011-08-24T00:00:00+00:00 {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:183}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Loaded extension: os-types-extra-specs {{(pid=84424) register /opt/stack/cinder/cinder/api/extensions.py:140}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Loading extension cinder.api.contrib.volume_host_attribute.Volume_host_attribute {{(pid=84424) load_extension /opt/stack/cinder/cinder/api/extensions.py:199}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Calling extension factory cinder.api.contrib.volume_host_attribute.Volume_host_attribute {{(pid=84425) load_extension /opt/stack/cinder/cinder/api/extensions.py:205}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext name: VolumeHostAttribute {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:179}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext alias: os-vol-host-attr {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:180}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext description: Expose host as an attribute of a volume. {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:181}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext updated: 2011-11-03T00:00:00+00:00 {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:183}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Calling extension factory cinder.api.contrib.volume_host_attribute.Volume_host_attribute {{(pid=84424) load_extension /opt/stack/cinder/cinder/api/extensions.py:205}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Loaded extension: os-vol-host-attr {{(pid=84425) register /opt/stack/cinder/cinder/api/extensions.py:140}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext name: VolumeHostAttribute {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:179}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Loading extension cinder.api.contrib.hosts.Hosts {{(pid=84425) load_extension /opt/stack/cinder/cinder/api/extensions.py:199}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext alias: os-vol-host-attr {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:180}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext description: Expose host as an attribute of a volume. {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:181}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext updated: 2011-11-03T00:00:00+00:00 {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:183}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Loaded extension: os-vol-host-attr {{(pid=84424) register /opt/stack/cinder/cinder/api/extensions.py:140}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Loading extension cinder.api.contrib.hosts.Hosts {{(pid=84424) load_extension /opt/stack/cinder/cinder/api/extensions.py:199}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Calling extension factory cinder.api.contrib.hosts.Hosts {{(pid=84425) load_extension /opt/stack/cinder/cinder/api/extensions.py:205}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext name: Hosts {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:179}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext alias: os-hosts {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:180}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext description: Admin-only host administration. {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:181}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext updated: 2011-06-29T00:00:00+00:00 {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:183}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Calling extension factory cinder.api.contrib.hosts.Hosts {{(pid=84424) load_extension /opt/stack/cinder/cinder/api/extensions.py:205}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Loaded extension: os-hosts {{(pid=84425) register /opt/stack/cinder/cinder/api/extensions.py:140}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext name: Hosts {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:179}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Loading extension cinder.api.contrib.scheduler_stats.Scheduler_stats {{(pid=84425) load_extension /opt/stack/cinder/cinder/api/extensions.py:199}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext alias: os-hosts {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:180}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext description: Admin-only host administration. {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:181}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext updated: 2011-06-29T00:00:00+00:00 {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:183}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Loaded extension: os-hosts {{(pid=84424) register /opt/stack/cinder/cinder/api/extensions.py:140}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Loading extension cinder.api.contrib.scheduler_stats.Scheduler_stats {{(pid=84424) load_extension /opt/stack/cinder/cinder/api/extensions.py:199}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Calling extension factory cinder.api.contrib.scheduler_stats.Scheduler_stats {{(pid=84425) load_extension /opt/stack/cinder/cinder/api/extensions.py:205}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext name: Scheduler_stats {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:179}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext alias: scheduler-stats {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:180}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext description: Scheduler stats support. {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:181}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext updated: 2014-09-07T00:00:00+00:00 {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:183}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Loaded extension: scheduler-stats {{(pid=84425) register /opt/stack/cinder/cinder/api/extensions.py:140}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Calling extension factory cinder.api.contrib.scheduler_stats.Scheduler_stats {{(pid=84424) load_extension /opt/stack/cinder/cinder/api/extensions.py:205}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Loading extension cinder.api.contrib.snapshot_unmanage.Snapshot_unmanage {{(pid=84425) load_extension /opt/stack/cinder/cinder/api/extensions.py:199}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext name: Scheduler_stats {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:179}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext alias: scheduler-stats {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:180}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext description: Scheduler stats support. {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:181}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext updated: 2014-09-07T00:00:00+00:00 {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:183}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Loaded extension: scheduler-stats {{(pid=84424) register /opt/stack/cinder/cinder/api/extensions.py:140}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Loading extension cinder.api.contrib.snapshot_unmanage.Snapshot_unmanage {{(pid=84424) load_extension /opt/stack/cinder/cinder/api/extensions.py:199}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Calling extension factory cinder.api.contrib.snapshot_unmanage.Snapshot_unmanage {{(pid=84425) load_extension /opt/stack/cinder/cinder/api/extensions.py:205}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext name: SnapshotUnmanage {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:179}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext alias: os-snapshot-unmanage {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:180}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext description: Enable volume unmanage operation. {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:181}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext updated: 2014-12-31T00:00:00+00:00 {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:183}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Loaded extension: os-snapshot-unmanage {{(pid=84425) register /opt/stack/cinder/cinder/api/extensions.py:140}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Loading extension cinder.api.contrib.volume_type_access.Volume_type_access {{(pid=84425) load_extension /opt/stack/cinder/cinder/api/extensions.py:199}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Calling extension factory cinder.api.contrib.snapshot_unmanage.Snapshot_unmanage {{(pid=84424) load_extension /opt/stack/cinder/cinder/api/extensions.py:205}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext name: SnapshotUnmanage {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:179}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext alias: os-snapshot-unmanage {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:180}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext description: Enable volume unmanage operation. {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:181}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext updated: 2014-12-31T00:00:00+00:00 {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:183}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Loaded extension: os-snapshot-unmanage {{(pid=84424) register /opt/stack/cinder/cinder/api/extensions.py:140}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Loading extension cinder.api.contrib.volume_type_access.Volume_type_access {{(pid=84424) load_extension /opt/stack/cinder/cinder/api/extensions.py:199}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Calling extension factory cinder.api.contrib.volume_type_access.Volume_type_access {{(pid=84425) load_extension /opt/stack/cinder/cinder/api/extensions.py:205}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext name: VolumeTypeAccess {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:179}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext alias: os-volume-type-access {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:180}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext description: Volume type access support. {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:181}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext updated: 2014-06-26T00:00:00Z {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:183}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Calling extension factory cinder.api.contrib.volume_type_access.Volume_type_access {{(pid=84424) load_extension /opt/stack/cinder/cinder/api/extensions.py:205}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Loaded extension: os-volume-type-access {{(pid=84425) register /opt/stack/cinder/cinder/api/extensions.py:140}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext name: VolumeTypeAccess {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:179}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext alias: os-volume-type-access {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:180}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext description: Volume type access support. {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:181}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext updated: 2014-06-26T00:00:00Z {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:183}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Loaded extension: os-volume-type-access {{(pid=84424) register /opt/stack/cinder/cinder/api/extensions.py:140}} May 28 12:44:42 l75lg1-v1 nova-conductor[82177]: DEBUG dbcounter [-] [82177] Writing DB stats nova_api:SELECT=1 {{(pid=82177) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Initializing extension manager. {{(pid=84425) __init__ /opt/stack/cinder/cinder/api/extensions.py:125}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Initializing extension manager. {{(pid=84424) __init__ /opt/stack/cinder/cinder/api/extensions.py:125}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Loading extension cinder.api.contrib.standard_extensions {{(pid=84425) load_extension /opt/stack/cinder/cinder/api/extensions.py:199}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Loading extension cinder.api.contrib.standard_extensions {{(pid=84424) load_extension /opt/stack/cinder/cinder/api/extensions.py:199}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Calling extension factory cinder.api.contrib.standard_extensions {{(pid=84425) load_extension /opt/stack/cinder/cinder/api/extensions.py:205}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Calling extension factory cinder.api.contrib.standard_extensions {{(pid=84424) load_extension /opt/stack/cinder/cinder/api/extensions.py:205}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Loading extension cinder.api.contrib.volume_image_metadata.Volume_image_metadata {{(pid=84425) load_extension /opt/stack/cinder/cinder/api/extensions.py:199}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Loading extension cinder.api.contrib.volume_image_metadata.Volume_image_metadata {{(pid=84424) load_extension /opt/stack/cinder/cinder/api/extensions.py:199}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Calling extension factory cinder.api.contrib.volume_image_metadata.Volume_image_metadata {{(pid=84425) load_extension /opt/stack/cinder/cinder/api/extensions.py:205}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Calling extension factory cinder.api.contrib.volume_image_metadata.Volume_image_metadata {{(pid=84424) load_extension /opt/stack/cinder/cinder/api/extensions.py:205}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext name: VolumeImageMetadata {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:179}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext name: VolumeImageMetadata {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:179}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext alias: os-vol-image-meta {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:180}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext alias: os-vol-image-meta {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:180}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext description: Show image metadata associated with the volume. {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:181}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext description: Show image metadata associated with the volume. {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:181}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext updated: 2012-12-07T00:00:00+00:00 {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:183}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext updated: 2012-12-07T00:00:00+00:00 {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:183}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Loaded extension: os-vol-image-meta {{(pid=84425) register /opt/stack/cinder/cinder/api/extensions.py:140}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Loaded extension: os-vol-image-meta {{(pid=84424) register /opt/stack/cinder/cinder/api/extensions.py:140}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Loading extension cinder.api.contrib.extended_services.Extended_services {{(pid=84425) load_extension /opt/stack/cinder/cinder/api/extensions.py:199}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Loading extension cinder.api.contrib.extended_services.Extended_services {{(pid=84424) load_extension /opt/stack/cinder/cinder/api/extensions.py:199}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Calling extension factory cinder.api.contrib.extended_services.Extended_services {{(pid=84425) load_extension /opt/stack/cinder/cinder/api/extensions.py:205}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Calling extension factory cinder.api.contrib.extended_services.Extended_services {{(pid=84424) load_extension /opt/stack/cinder/cinder/api/extensions.py:205}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext name: ExtendedServices {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:179}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext name: ExtendedServices {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:179}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext alias: os-extended-services {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:180}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext alias: os-extended-services {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:180}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext description: Extended services support. {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:181}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext description: Extended services support. {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:181}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext updated: 2014-01-10T00:00:00-00:00 {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:183}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext updated: 2014-01-10T00:00:00-00:00 {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:183}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Loaded extension: os-extended-services {{(pid=84425) register /opt/stack/cinder/cinder/api/extensions.py:140}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Loaded extension: os-extended-services {{(pid=84424) register /opt/stack/cinder/cinder/api/extensions.py:140}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Loading extension cinder.api.contrib.volume_actions.Volume_actions {{(pid=84425) load_extension /opt/stack/cinder/cinder/api/extensions.py:199}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Loading extension cinder.api.contrib.volume_actions.Volume_actions {{(pid=84424) load_extension /opt/stack/cinder/cinder/api/extensions.py:199}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Calling extension factory cinder.api.contrib.volume_actions.Volume_actions {{(pid=84425) load_extension /opt/stack/cinder/cinder/api/extensions.py:205}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Calling extension factory cinder.api.contrib.volume_actions.Volume_actions {{(pid=84424) load_extension /opt/stack/cinder/cinder/api/extensions.py:205}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext name: VolumeActions {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:179}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext name: VolumeActions {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:179}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext alias: os-volume-actions {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:180}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext alias: os-volume-actions {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:180}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext description: Enable volume actions. {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:181}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext description: Enable volume actions. {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:181}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext updated: 2012-05-31T00:00:00+00:00 {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:183}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext updated: 2012-05-31T00:00:00+00:00 {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:183}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Loaded extension: os-volume-actions {{(pid=84424) register /opt/stack/cinder/cinder/api/extensions.py:140}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Loading extension cinder.api.contrib.volume_encryption_metadata.Volume_encryption_metadata {{(pid=84424) load_extension /opt/stack/cinder/cinder/api/extensions.py:199}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Loaded extension: os-volume-actions {{(pid=84425) register /opt/stack/cinder/cinder/api/extensions.py:140}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Calling extension factory cinder.api.contrib.volume_encryption_metadata.Volume_encryption_metadata {{(pid=84424) load_extension /opt/stack/cinder/cinder/api/extensions.py:205}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Loading extension cinder.api.contrib.volume_encryption_metadata.Volume_encryption_metadata {{(pid=84425) load_extension /opt/stack/cinder/cinder/api/extensions.py:199}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext name: VolumeEncryptionMetadata {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:179}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext alias: os-volume-encryption-metadata {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:180}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Calling extension factory cinder.api.contrib.volume_encryption_metadata.Volume_encryption_metadata {{(pid=84425) load_extension /opt/stack/cinder/cinder/api/extensions.py:205}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext description: Volume encryption metadata retrieval support. {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:181}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext name: VolumeEncryptionMetadata {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:179}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext alias: os-volume-encryption-metadata {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:180}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext updated: 2013-07-10T00:00:00+00:00 {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:183}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext description: Volume encryption metadata retrieval support. {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:181}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Loaded extension: os-volume-encryption-metadata {{(pid=84424) register /opt/stack/cinder/cinder/api/extensions.py:140}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext updated: 2013-07-10T00:00:00+00:00 {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:183}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Loading extension cinder.api.contrib.scheduler_hints.Scheduler_hints {{(pid=84424) load_extension /opt/stack/cinder/cinder/api/extensions.py:199}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Loaded extension: os-volume-encryption-metadata {{(pid=84425) register /opt/stack/cinder/cinder/api/extensions.py:140}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Calling extension factory cinder.api.contrib.scheduler_hints.Scheduler_hints {{(pid=84424) load_extension /opt/stack/cinder/cinder/api/extensions.py:205}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Loading extension cinder.api.contrib.scheduler_hints.Scheduler_hints {{(pid=84425) load_extension /opt/stack/cinder/cinder/api/extensions.py:199}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext name: SchedulerHints {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:179}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Calling extension factory cinder.api.contrib.scheduler_hints.Scheduler_hints {{(pid=84425) load_extension /opt/stack/cinder/cinder/api/extensions.py:205}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext alias: OS-SCH-HNT {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:180}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext name: SchedulerHints {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:179}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext description: Pass arbitrary key/value pairs to the scheduler. {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:181}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext alias: OS-SCH-HNT {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:180}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext updated: 2013-04-18T00:00:00+00:00 {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:183}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext description: Pass arbitrary key/value pairs to the scheduler. {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:181}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Loaded extension: OS-SCH-HNT {{(pid=84424) register /opt/stack/cinder/cinder/api/extensions.py:140}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext updated: 2013-04-18T00:00:00+00:00 {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:183}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Loading extension cinder.api.contrib.volume_manage.Volume_manage {{(pid=84424) load_extension /opt/stack/cinder/cinder/api/extensions.py:199}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Loaded extension: OS-SCH-HNT {{(pid=84425) register /opt/stack/cinder/cinder/api/extensions.py:140}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Calling extension factory cinder.api.contrib.volume_manage.Volume_manage {{(pid=84424) load_extension /opt/stack/cinder/cinder/api/extensions.py:205}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Loading extension cinder.api.contrib.volume_manage.Volume_manage {{(pid=84425) load_extension /opt/stack/cinder/cinder/api/extensions.py:199}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext name: VolumeManage {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:179}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext alias: os-volume-manage {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:180}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Calling extension factory cinder.api.contrib.volume_manage.Volume_manage {{(pid=84425) load_extension /opt/stack/cinder/cinder/api/extensions.py:205}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext description: Allows existing backend storage to be 'managed' by Cinder. {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:181}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext name: VolumeManage {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:179}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext updated: 2014-02-10T00:00:00+00:00 {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:183}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext alias: os-volume-manage {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:180}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Loaded extension: os-volume-manage {{(pid=84424) register /opt/stack/cinder/cinder/api/extensions.py:140}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext description: Allows existing backend storage to be 'managed' by Cinder. {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:181}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Loading extension cinder.api.contrib.snapshot_manage.Snapshot_manage {{(pid=84424) load_extension /opt/stack/cinder/cinder/api/extensions.py:199}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext updated: 2014-02-10T00:00:00+00:00 {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:183}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Calling extension factory cinder.api.contrib.snapshot_manage.Snapshot_manage {{(pid=84424) load_extension /opt/stack/cinder/cinder/api/extensions.py:205}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Loaded extension: os-volume-manage {{(pid=84425) register /opt/stack/cinder/cinder/api/extensions.py:140}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext name: SnapshotManage {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:179}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Loading extension cinder.api.contrib.snapshot_manage.Snapshot_manage {{(pid=84425) load_extension /opt/stack/cinder/cinder/api/extensions.py:199}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext alias: os-snapshot-manage {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:180}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Calling extension factory cinder.api.contrib.snapshot_manage.Snapshot_manage {{(pid=84425) load_extension /opt/stack/cinder/cinder/api/extensions.py:205}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext description: Allows existing backend storage to be 'managed' by Cinder. {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:181}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext name: SnapshotManage {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:179}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext updated: 2014-12-31T00:00:00+00:00 {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:183}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext alias: os-snapshot-manage {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:180}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Loaded extension: os-snapshot-manage {{(pid=84424) register /opt/stack/cinder/cinder/api/extensions.py:140}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext description: Allows existing backend storage to be 'managed' by Cinder. {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:181}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Loading extension cinder.api.contrib.capabilities.Capabilities {{(pid=84424) load_extension /opt/stack/cinder/cinder/api/extensions.py:199}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext updated: 2014-12-31T00:00:00+00:00 {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:183}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Calling extension factory cinder.api.contrib.capabilities.Capabilities {{(pid=84424) load_extension /opt/stack/cinder/cinder/api/extensions.py:205}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Loaded extension: os-snapshot-manage {{(pid=84425) register /opt/stack/cinder/cinder/api/extensions.py:140}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext name: Capabilities {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:179}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Loading extension cinder.api.contrib.capabilities.Capabilities {{(pid=84425) load_extension /opt/stack/cinder/cinder/api/extensions.py:199}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext alias: capabilities {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:180}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Calling extension factory cinder.api.contrib.capabilities.Capabilities {{(pid=84425) load_extension /opt/stack/cinder/cinder/api/extensions.py:205}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext description: Capabilities support. {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:181}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext name: Capabilities {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:179}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext updated: 2015-08-31T00:00:00+00:00 {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:183}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext alias: capabilities {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:180}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Loaded extension: capabilities {{(pid=84424) register /opt/stack/cinder/cinder/api/extensions.py:140}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext description: Capabilities support. {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:181}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Loading extension cinder.api.contrib.volume_transfer.Volume_transfer {{(pid=84424) load_extension /opt/stack/cinder/cinder/api/extensions.py:199}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext updated: 2015-08-31T00:00:00+00:00 {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:183}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Loaded extension: capabilities {{(pid=84425) register /opt/stack/cinder/cinder/api/extensions.py:140}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Calling extension factory cinder.api.contrib.volume_transfer.Volume_transfer {{(pid=84424) load_extension /opt/stack/cinder/cinder/api/extensions.py:205}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Loading extension cinder.api.contrib.volume_transfer.Volume_transfer {{(pid=84425) load_extension /opt/stack/cinder/cinder/api/extensions.py:199}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext name: VolumeTransfer {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:179}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext alias: os-volume-transfer {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:180}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Calling extension factory cinder.api.contrib.volume_transfer.Volume_transfer {{(pid=84425) load_extension /opt/stack/cinder/cinder/api/extensions.py:205}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext name: VolumeTransfer {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:179}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext description: Volume transfer management support. {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:181}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext alias: os-volume-transfer {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:180}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext updated: 2013-05-29T00:00:00+00:00 {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:183}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext description: Volume transfer management support. {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:181}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Loaded extension: os-volume-transfer {{(pid=84424) register /opt/stack/cinder/cinder/api/extensions.py:140}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext updated: 2013-05-29T00:00:00+00:00 {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:183}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Loading extension cinder.api.contrib.volume_mig_status_attribute.Volume_mig_status_attribute {{(pid=84424) load_extension /opt/stack/cinder/cinder/api/extensions.py:199}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Loaded extension: os-volume-transfer {{(pid=84425) register /opt/stack/cinder/cinder/api/extensions.py:140}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Calling extension factory cinder.api.contrib.volume_mig_status_attribute.Volume_mig_status_attribute {{(pid=84424) load_extension /opt/stack/cinder/cinder/api/extensions.py:205}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Loading extension cinder.api.contrib.volume_mig_status_attribute.Volume_mig_status_attribute {{(pid=84425) load_extension /opt/stack/cinder/cinder/api/extensions.py:199}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext name: VolumeMigStatusAttribute {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:179}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Calling extension factory cinder.api.contrib.volume_mig_status_attribute.Volume_mig_status_attribute {{(pid=84425) load_extension /opt/stack/cinder/cinder/api/extensions.py:205}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext alias: os-vol-mig-status-attr {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:180}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext name: VolumeMigStatusAttribute {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:179}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext description: Expose migration_status as an attribute of a volume. {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:181}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext alias: os-vol-mig-status-attr {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:180}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext updated: 2013-08-08T00:00:00+00:00 {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:183}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext description: Expose migration_status as an attribute of a volume. {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:181}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Loaded extension: os-vol-mig-status-attr {{(pid=84424) register /opt/stack/cinder/cinder/api/extensions.py:140}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext updated: 2013-08-08T00:00:00+00:00 {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:183}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Loading extension cinder.api.contrib.volume_tenant_attribute.Volume_tenant_attribute {{(pid=84424) load_extension /opt/stack/cinder/cinder/api/extensions.py:199}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Loaded extension: os-vol-mig-status-attr {{(pid=84425) register /opt/stack/cinder/cinder/api/extensions.py:140}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Calling extension factory cinder.api.contrib.volume_tenant_attribute.Volume_tenant_attribute {{(pid=84424) load_extension /opt/stack/cinder/cinder/api/extensions.py:205}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Loading extension cinder.api.contrib.volume_tenant_attribute.Volume_tenant_attribute {{(pid=84425) load_extension /opt/stack/cinder/cinder/api/extensions.py:199}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext name: VolumeTenantAttribute {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:179}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Calling extension factory cinder.api.contrib.volume_tenant_attribute.Volume_tenant_attribute {{(pid=84425) load_extension /opt/stack/cinder/cinder/api/extensions.py:205}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext alias: os-vol-tenant-attr {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:180}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext name: VolumeTenantAttribute {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:179}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext description: Expose the internal project_id as an attribute of a volume. {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:181}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext alias: os-vol-tenant-attr {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:180}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext updated: 2011-11-03T00:00:00+00:00 {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:183}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext description: Expose the internal project_id as an attribute of a volume. {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:181}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Loaded extension: os-vol-tenant-attr {{(pid=84424) register /opt/stack/cinder/cinder/api/extensions.py:140}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext updated: 2011-11-03T00:00:00+00:00 {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:183}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Loading extension cinder.api.contrib.admin_actions.Admin_actions {{(pid=84424) load_extension /opt/stack/cinder/cinder/api/extensions.py:199}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Loaded extension: os-vol-tenant-attr {{(pid=84425) register /opt/stack/cinder/cinder/api/extensions.py:140}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Calling extension factory cinder.api.contrib.admin_actions.Admin_actions {{(pid=84424) load_extension /opt/stack/cinder/cinder/api/extensions.py:205}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Loading extension cinder.api.contrib.admin_actions.Admin_actions {{(pid=84425) load_extension /opt/stack/cinder/cinder/api/extensions.py:199}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext name: AdminActions {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:179}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Calling extension factory cinder.api.contrib.admin_actions.Admin_actions {{(pid=84425) load_extension /opt/stack/cinder/cinder/api/extensions.py:205}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext alias: os-admin-actions {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:180}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext name: AdminActions {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:179}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext description: Enable admin actions. {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:181}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext alias: os-admin-actions {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:180}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext description: Enable admin actions. {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:181}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext updated: 2012-08-25T00:00:00+00:00 {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:183}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext updated: 2012-08-25T00:00:00+00:00 {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:183}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Loaded extension: os-admin-actions {{(pid=84424) register /opt/stack/cinder/cinder/api/extensions.py:140}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Loaded extension: os-admin-actions {{(pid=84425) register /opt/stack/cinder/cinder/api/extensions.py:140}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Loading extension cinder.api.contrib.consistencygroups.Consistencygroups {{(pid=84424) load_extension /opt/stack/cinder/cinder/api/extensions.py:199}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Loading extension cinder.api.contrib.consistencygroups.Consistencygroups {{(pid=84425) load_extension /opt/stack/cinder/cinder/api/extensions.py:199}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Calling extension factory cinder.api.contrib.consistencygroups.Consistencygroups {{(pid=84424) load_extension /opt/stack/cinder/cinder/api/extensions.py:205}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Calling extension factory cinder.api.contrib.consistencygroups.Consistencygroups {{(pid=84425) load_extension /opt/stack/cinder/cinder/api/extensions.py:205}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext name: Consistencygroups {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:179}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext name: Consistencygroups {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:179}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext alias: consistencygroups {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:180}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext alias: consistencygroups {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:180}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext description: consistency groups support. {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:181}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext description: consistency groups support. {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:181}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext updated: 2014-08-18T00:00:00+00:00 {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:183}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext updated: 2014-08-18T00:00:00+00:00 {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:183}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Loaded extension: consistencygroups {{(pid=84424) register /opt/stack/cinder/cinder/api/extensions.py:140}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Loaded extension: consistencygroups {{(pid=84425) register /opt/stack/cinder/cinder/api/extensions.py:140}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Loading extension cinder.api.contrib.backups.Backups {{(pid=84424) load_extension /opt/stack/cinder/cinder/api/extensions.py:199}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Loading extension cinder.api.contrib.backups.Backups {{(pid=84425) load_extension /opt/stack/cinder/cinder/api/extensions.py:199}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Calling extension factory cinder.api.contrib.backups.Backups {{(pid=84424) load_extension /opt/stack/cinder/cinder/api/extensions.py:205}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Calling extension factory cinder.api.contrib.backups.Backups {{(pid=84425) load_extension /opt/stack/cinder/cinder/api/extensions.py:205}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext name: Backups {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:179}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext name: Backups {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:179}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext alias: backups {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:180}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext alias: backups {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:180}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext description: Backups support. {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:181}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext description: Backups support. {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:181}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext updated: 2012-12-12T00:00:00+00:00 {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:183}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext updated: 2012-12-12T00:00:00+00:00 {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:183}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Loaded extension: backups {{(pid=84424) register /opt/stack/cinder/cinder/api/extensions.py:140}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Loaded extension: backups {{(pid=84425) register /opt/stack/cinder/cinder/api/extensions.py:140}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Loading extension cinder.api.contrib.types_manage.Types_manage {{(pid=84425) load_extension /opt/stack/cinder/cinder/api/extensions.py:199}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Loading extension cinder.api.contrib.types_manage.Types_manage {{(pid=84424) load_extension /opt/stack/cinder/cinder/api/extensions.py:199}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Calling extension factory cinder.api.contrib.types_manage.Types_manage {{(pid=84425) load_extension /opt/stack/cinder/cinder/api/extensions.py:205}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Calling extension factory cinder.api.contrib.types_manage.Types_manage {{(pid=84424) load_extension /opt/stack/cinder/cinder/api/extensions.py:205}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext name: TypesManage {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:179}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext name: TypesManage {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:179}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext alias: os-types-manage {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:180}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext alias: os-types-manage {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:180}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext description: Types manage support. {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:181}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext description: Types manage support. {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:181}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext updated: 2011-08-24T00:00:00+00:00 {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:183}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext updated: 2011-08-24T00:00:00+00:00 {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:183}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Loaded extension: os-types-manage {{(pid=84425) register /opt/stack/cinder/cinder/api/extensions.py:140}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Loaded extension: os-types-manage {{(pid=84424) register /opt/stack/cinder/cinder/api/extensions.py:140}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Loading extension cinder.api.contrib.availability_zones.Availability_zones {{(pid=84425) load_extension /opt/stack/cinder/cinder/api/extensions.py:199}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Loading extension cinder.api.contrib.availability_zones.Availability_zones {{(pid=84424) load_extension /opt/stack/cinder/cinder/api/extensions.py:199}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Calling extension factory cinder.api.contrib.availability_zones.Availability_zones {{(pid=84425) load_extension /opt/stack/cinder/cinder/api/extensions.py:205}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Calling extension factory cinder.api.contrib.availability_zones.Availability_zones {{(pid=84424) load_extension /opt/stack/cinder/cinder/api/extensions.py:205}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext name: AvailabilityZones {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:179}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext name: AvailabilityZones {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:179}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext alias: os-availability-zone {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:180}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext alias: os-availability-zone {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:180}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext description: Describe Availability Zones. {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:181}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext description: Describe Availability Zones. {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:181}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext updated: 2013-06-27T00:00:00+00:00 {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:183}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext updated: 2013-06-27T00:00:00+00:00 {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:183}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Loaded extension: os-availability-zone {{(pid=84425) register /opt/stack/cinder/cinder/api/extensions.py:140}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Loaded extension: os-availability-zone {{(pid=84424) register /opt/stack/cinder/cinder/api/extensions.py:140}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Loading extension cinder.api.contrib.quota_classes.Quota_classes {{(pid=84425) load_extension /opt/stack/cinder/cinder/api/extensions.py:199}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Loading extension cinder.api.contrib.quota_classes.Quota_classes {{(pid=84424) load_extension /opt/stack/cinder/cinder/api/extensions.py:199}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Calling extension factory cinder.api.contrib.quota_classes.Quota_classes {{(pid=84425) load_extension /opt/stack/cinder/cinder/api/extensions.py:205}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Calling extension factory cinder.api.contrib.quota_classes.Quota_classes {{(pid=84424) load_extension /opt/stack/cinder/cinder/api/extensions.py:205}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext name: QuotaClasses {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:179}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext name: QuotaClasses {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:179}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext alias: os-quota-class-sets {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:180}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext alias: os-quota-class-sets {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:180}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext description: Quota classes management support. {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:181}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext description: Quota classes management support. {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:181}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext updated: 2012-03-12T00:00:00+00:00 {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:183}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext updated: 2012-03-12T00:00:00+00:00 {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:183}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Loaded extension: os-quota-class-sets {{(pid=84425) register /opt/stack/cinder/cinder/api/extensions.py:140}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Loaded extension: os-quota-class-sets {{(pid=84424) register /opt/stack/cinder/cinder/api/extensions.py:140}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Loading extension cinder.api.contrib.volume_type_encryption.Volume_type_encryption {{(pid=84425) load_extension /opt/stack/cinder/cinder/api/extensions.py:199}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Loading extension cinder.api.contrib.volume_type_encryption.Volume_type_encryption {{(pid=84424) load_extension /opt/stack/cinder/cinder/api/extensions.py:199}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Calling extension factory cinder.api.contrib.volume_type_encryption.Volume_type_encryption {{(pid=84425) load_extension /opt/stack/cinder/cinder/api/extensions.py:205}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Calling extension factory cinder.api.contrib.volume_type_encryption.Volume_type_encryption {{(pid=84424) load_extension /opt/stack/cinder/cinder/api/extensions.py:205}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext name: VolumeTypeEncryption {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:179}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext name: VolumeTypeEncryption {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:179}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext alias: encryption {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:180}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext alias: encryption {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:180}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext description: Encryption support for volume types. {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:181}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext description: Encryption support for volume types. {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:181}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext updated: 2013-07-01T00:00:00+00:00 {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:183}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext updated: 2013-07-01T00:00:00+00:00 {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:183}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Loaded extension: encryption {{(pid=84425) register /opt/stack/cinder/cinder/api/extensions.py:140}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Loaded extension: encryption {{(pid=84424) register /opt/stack/cinder/cinder/api/extensions.py:140}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Loading extension cinder.api.contrib.quotas.Quotas {{(pid=84425) load_extension /opt/stack/cinder/cinder/api/extensions.py:199}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Loading extension cinder.api.contrib.quotas.Quotas {{(pid=84424) load_extension /opt/stack/cinder/cinder/api/extensions.py:199}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Calling extension factory cinder.api.contrib.quotas.Quotas {{(pid=84424) load_extension /opt/stack/cinder/cinder/api/extensions.py:205}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Calling extension factory cinder.api.contrib.quotas.Quotas {{(pid=84425) load_extension /opt/stack/cinder/cinder/api/extensions.py:205}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext name: Quotas {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:179}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext name: Quotas {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:179}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext alias: os-quota-sets {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:180}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext description: Quota management support. {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:181}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext alias: os-quota-sets {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:180}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext updated: 2011-08-08T00:00:00+00:00 {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:183}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext description: Quota management support. {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:181}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Loaded extension: os-quota-sets {{(pid=84424) register /opt/stack/cinder/cinder/api/extensions.py:140}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext updated: 2011-08-08T00:00:00+00:00 {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:183}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Loaded extension: os-quota-sets {{(pid=84425) register /opt/stack/cinder/cinder/api/extensions.py:140}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Loading extension cinder.api.contrib.services.Services {{(pid=84424) load_extension /opt/stack/cinder/cinder/api/extensions.py:199}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Calling extension factory cinder.api.contrib.services.Services {{(pid=84424) load_extension /opt/stack/cinder/cinder/api/extensions.py:205}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Loading extension cinder.api.contrib.services.Services {{(pid=84425) load_extension /opt/stack/cinder/cinder/api/extensions.py:199}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext name: Services {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:179}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Calling extension factory cinder.api.contrib.services.Services {{(pid=84425) load_extension /opt/stack/cinder/cinder/api/extensions.py:205}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext alias: os-services {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:180}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext name: Services {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:179}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext description: Services support. {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:181}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext alias: os-services {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:180}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext updated: 2012-10-28T00:00:00-00:00 {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:183}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext description: Services support. {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:181}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Loaded extension: os-services {{(pid=84424) register /opt/stack/cinder/cinder/api/extensions.py:140}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext updated: 2012-10-28T00:00:00-00:00 {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:183}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Loading extension cinder.api.contrib.cgsnapshots.Cgsnapshots {{(pid=84424) load_extension /opt/stack/cinder/cinder/api/extensions.py:199}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Loaded extension: os-services {{(pid=84425) register /opt/stack/cinder/cinder/api/extensions.py:140}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Calling extension factory cinder.api.contrib.cgsnapshots.Cgsnapshots {{(pid=84424) load_extension /opt/stack/cinder/cinder/api/extensions.py:205}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Loading extension cinder.api.contrib.cgsnapshots.Cgsnapshots {{(pid=84425) load_extension /opt/stack/cinder/cinder/api/extensions.py:199}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext name: Cgsnapshots {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:179}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Calling extension factory cinder.api.contrib.cgsnapshots.Cgsnapshots {{(pid=84425) load_extension /opt/stack/cinder/cinder/api/extensions.py:205}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext alias: cgsnapshots {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:180}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext name: Cgsnapshots {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:179}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext description: cgsnapshots support. {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:181}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext alias: cgsnapshots {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:180}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext updated: 2014-08-18T00:00:00+00:00 {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:183}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext description: cgsnapshots support. {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:181}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Loaded extension: cgsnapshots {{(pid=84424) register /opt/stack/cinder/cinder/api/extensions.py:140}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext updated: 2014-08-18T00:00:00+00:00 {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:183}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Loading extension cinder.api.contrib.extended_snapshot_attributes.Extended_snapshot_attributes {{(pid=84424) load_extension /opt/stack/cinder/cinder/api/extensions.py:199}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Loaded extension: cgsnapshots {{(pid=84425) register /opt/stack/cinder/cinder/api/extensions.py:140}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Calling extension factory cinder.api.contrib.extended_snapshot_attributes.Extended_snapshot_attributes {{(pid=84424) load_extension /opt/stack/cinder/cinder/api/extensions.py:205}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Loading extension cinder.api.contrib.extended_snapshot_attributes.Extended_snapshot_attributes {{(pid=84425) load_extension /opt/stack/cinder/cinder/api/extensions.py:199}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext name: ExtendedSnapshotAttributes {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:179}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Calling extension factory cinder.api.contrib.extended_snapshot_attributes.Extended_snapshot_attributes {{(pid=84425) load_extension /opt/stack/cinder/cinder/api/extensions.py:205}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext alias: os-extended-snapshot-attributes {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:180}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext name: ExtendedSnapshotAttributes {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:179}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext description: Extended SnapshotAttributes support. {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:181}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext alias: os-extended-snapshot-attributes {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:180}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext updated: 2012-06-19T00:00:00+00:00 {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:183}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext description: Extended SnapshotAttributes support. {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:181}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Loaded extension: os-extended-snapshot-attributes {{(pid=84424) register /opt/stack/cinder/cinder/api/extensions.py:140}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext updated: 2012-06-19T00:00:00+00:00 {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:183}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Loading extension cinder.api.contrib.qos_specs_manage.Qos_specs_manage {{(pid=84424) load_extension /opt/stack/cinder/cinder/api/extensions.py:199}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Loaded extension: os-extended-snapshot-attributes {{(pid=84425) register /opt/stack/cinder/cinder/api/extensions.py:140}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Calling extension factory cinder.api.contrib.qos_specs_manage.Qos_specs_manage {{(pid=84424) load_extension /opt/stack/cinder/cinder/api/extensions.py:205}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Loading extension cinder.api.contrib.qos_specs_manage.Qos_specs_manage {{(pid=84425) load_extension /opt/stack/cinder/cinder/api/extensions.py:199}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext name: Qos_specs_manage {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:179}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Calling extension factory cinder.api.contrib.qos_specs_manage.Qos_specs_manage {{(pid=84425) load_extension /opt/stack/cinder/cinder/api/extensions.py:205}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext alias: qos-specs {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:180}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext name: Qos_specs_manage {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:179}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext description: QoS specs support. {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:181}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext alias: qos-specs {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:180}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext description: QoS specs support. {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:181}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext updated: 2013-08-02T00:00:00+00:00 {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:183}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Loaded extension: qos-specs {{(pid=84424) register /opt/stack/cinder/cinder/api/extensions.py:140}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext updated: 2013-08-02T00:00:00+00:00 {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:183}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Loaded extension: qos-specs {{(pid=84425) register /opt/stack/cinder/cinder/api/extensions.py:140}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Loading extension cinder.api.contrib.volume_unmanage.Volume_unmanage {{(pid=84424) load_extension /opt/stack/cinder/cinder/api/extensions.py:199}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Loading extension cinder.api.contrib.volume_unmanage.Volume_unmanage {{(pid=84425) load_extension /opt/stack/cinder/cinder/api/extensions.py:199}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Calling extension factory cinder.api.contrib.volume_unmanage.Volume_unmanage {{(pid=84424) load_extension /opt/stack/cinder/cinder/api/extensions.py:205}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Calling extension factory cinder.api.contrib.volume_unmanage.Volume_unmanage {{(pid=84425) load_extension /opt/stack/cinder/cinder/api/extensions.py:205}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext name: VolumeUnmanage {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:179}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext name: VolumeUnmanage {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:179}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext alias: os-volume-unmanage {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:180}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext description: Enable volume unmanage operation. {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:181}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext alias: os-volume-unmanage {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:180}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext updated: 2012-05-31T00:00:00+00:00 {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:183}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext description: Enable volume unmanage operation. {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:181}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Loaded extension: os-volume-unmanage {{(pid=84424) register /opt/stack/cinder/cinder/api/extensions.py:140}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext updated: 2012-05-31T00:00:00+00:00 {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:183}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Loaded extension: os-volume-unmanage {{(pid=84425) register /opt/stack/cinder/cinder/api/extensions.py:140}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Loading extension cinder.api.contrib.snapshot_actions.Snapshot_actions {{(pid=84424) load_extension /opt/stack/cinder/cinder/api/extensions.py:199}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Loading extension cinder.api.contrib.snapshot_actions.Snapshot_actions {{(pid=84425) load_extension /opt/stack/cinder/cinder/api/extensions.py:199}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Calling extension factory cinder.api.contrib.snapshot_actions.Snapshot_actions {{(pid=84424) load_extension /opt/stack/cinder/cinder/api/extensions.py:205}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Calling extension factory cinder.api.contrib.snapshot_actions.Snapshot_actions {{(pid=84425) load_extension /opt/stack/cinder/cinder/api/extensions.py:205}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext name: SnapshotActions {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:179}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext name: SnapshotActions {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:179}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext alias: os-snapshot-actions {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:180}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext alias: os-snapshot-actions {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:180}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext description: Enable snapshot manager actions. {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:181}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext description: Enable snapshot manager actions. {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:181}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext updated: 2013-07-16T00:00:00+00:00 {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:183}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext updated: 2013-07-16T00:00:00+00:00 {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:183}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Loaded extension: os-snapshot-actions {{(pid=84424) register /opt/stack/cinder/cinder/api/extensions.py:140}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Loaded extension: os-snapshot-actions {{(pid=84425) register /opt/stack/cinder/cinder/api/extensions.py:140}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Loading extension cinder.api.contrib.used_limits.Used_limits {{(pid=84424) load_extension /opt/stack/cinder/cinder/api/extensions.py:199}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Loading extension cinder.api.contrib.used_limits.Used_limits {{(pid=84425) load_extension /opt/stack/cinder/cinder/api/extensions.py:199}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Calling extension factory cinder.api.contrib.used_limits.Used_limits {{(pid=84424) load_extension /opt/stack/cinder/cinder/api/extensions.py:205}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Calling extension factory cinder.api.contrib.used_limits.Used_limits {{(pid=84425) load_extension /opt/stack/cinder/cinder/api/extensions.py:205}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext name: UsedLimits {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:179}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext name: UsedLimits {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:179}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext alias: os-used-limits {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:180}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext alias: os-used-limits {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:180}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext description: Provide data on limited resources that are being used. {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:181}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext description: Provide data on limited resources that are being used. {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:181}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext updated: 2013-10-03T00:00:00+00:00 {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:183}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext updated: 2013-10-03T00:00:00+00:00 {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:183}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Loaded extension: os-used-limits {{(pid=84424) register /opt/stack/cinder/cinder/api/extensions.py:140}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Loaded extension: os-used-limits {{(pid=84425) register /opt/stack/cinder/cinder/api/extensions.py:140}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Loading extension cinder.api.contrib.types_extra_specs.Types_extra_specs {{(pid=84425) load_extension /opt/stack/cinder/cinder/api/extensions.py:199}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Loading extension cinder.api.contrib.types_extra_specs.Types_extra_specs {{(pid=84424) load_extension /opt/stack/cinder/cinder/api/extensions.py:199}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Calling extension factory cinder.api.contrib.types_extra_specs.Types_extra_specs {{(pid=84425) load_extension /opt/stack/cinder/cinder/api/extensions.py:205}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Calling extension factory cinder.api.contrib.types_extra_specs.Types_extra_specs {{(pid=84424) load_extension /opt/stack/cinder/cinder/api/extensions.py:205}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext name: TypesExtraSpecs {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:179}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext name: TypesExtraSpecs {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:179}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext alias: os-types-extra-specs {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:180}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext alias: os-types-extra-specs {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:180}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext description: Type extra specs support. {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:181}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext description: Type extra specs support. {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:181}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext updated: 2011-08-24T00:00:00+00:00 {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:183}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext updated: 2011-08-24T00:00:00+00:00 {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:183}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Loaded extension: os-types-extra-specs {{(pid=84425) register /opt/stack/cinder/cinder/api/extensions.py:140}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Loaded extension: os-types-extra-specs {{(pid=84424) register /opt/stack/cinder/cinder/api/extensions.py:140}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Loading extension cinder.api.contrib.volume_host_attribute.Volume_host_attribute {{(pid=84425) load_extension /opt/stack/cinder/cinder/api/extensions.py:199}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Loading extension cinder.api.contrib.volume_host_attribute.Volume_host_attribute {{(pid=84424) load_extension /opt/stack/cinder/cinder/api/extensions.py:199}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Calling extension factory cinder.api.contrib.volume_host_attribute.Volume_host_attribute {{(pid=84425) load_extension /opt/stack/cinder/cinder/api/extensions.py:205}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Calling extension factory cinder.api.contrib.volume_host_attribute.Volume_host_attribute {{(pid=84424) load_extension /opt/stack/cinder/cinder/api/extensions.py:205}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext name: VolumeHostAttribute {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:179}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext name: VolumeHostAttribute {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:179}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext alias: os-vol-host-attr {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:180}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext alias: os-vol-host-attr {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:180}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext description: Expose host as an attribute of a volume. {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:181}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext description: Expose host as an attribute of a volume. {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:181}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext updated: 2011-11-03T00:00:00+00:00 {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:183}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext updated: 2011-11-03T00:00:00+00:00 {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:183}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Loaded extension: os-vol-host-attr {{(pid=84425) register /opt/stack/cinder/cinder/api/extensions.py:140}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Loaded extension: os-vol-host-attr {{(pid=84424) register /opt/stack/cinder/cinder/api/extensions.py:140}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Loading extension cinder.api.contrib.hosts.Hosts {{(pid=84425) load_extension /opt/stack/cinder/cinder/api/extensions.py:199}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Loading extension cinder.api.contrib.hosts.Hosts {{(pid=84424) load_extension /opt/stack/cinder/cinder/api/extensions.py:199}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Calling extension factory cinder.api.contrib.hosts.Hosts {{(pid=84425) load_extension /opt/stack/cinder/cinder/api/extensions.py:205}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Calling extension factory cinder.api.contrib.hosts.Hosts {{(pid=84424) load_extension /opt/stack/cinder/cinder/api/extensions.py:205}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext name: Hosts {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:179}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext name: Hosts {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:179}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext alias: os-hosts {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:180}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext alias: os-hosts {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:180}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext description: Admin-only host administration. {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:181}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext description: Admin-only host administration. {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:181}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext updated: 2011-06-29T00:00:00+00:00 {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:183}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext updated: 2011-06-29T00:00:00+00:00 {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:183}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Loaded extension: os-hosts {{(pid=84425) register /opt/stack/cinder/cinder/api/extensions.py:140}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Loaded extension: os-hosts {{(pid=84424) register /opt/stack/cinder/cinder/api/extensions.py:140}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Loading extension cinder.api.contrib.scheduler_stats.Scheduler_stats {{(pid=84425) load_extension /opt/stack/cinder/cinder/api/extensions.py:199}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Loading extension cinder.api.contrib.scheduler_stats.Scheduler_stats {{(pid=84424) load_extension /opt/stack/cinder/cinder/api/extensions.py:199}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Calling extension factory cinder.api.contrib.scheduler_stats.Scheduler_stats {{(pid=84425) load_extension /opt/stack/cinder/cinder/api/extensions.py:205}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext name: Scheduler_stats {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:179}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Calling extension factory cinder.api.contrib.scheduler_stats.Scheduler_stats {{(pid=84424) load_extension /opt/stack/cinder/cinder/api/extensions.py:205}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext alias: scheduler-stats {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:180}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext name: Scheduler_stats {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:179}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext description: Scheduler stats support. {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:181}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext alias: scheduler-stats {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:180}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext updated: 2014-09-07T00:00:00+00:00 {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:183}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext description: Scheduler stats support. {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:181}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Loaded extension: scheduler-stats {{(pid=84425) register /opt/stack/cinder/cinder/api/extensions.py:140}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext updated: 2014-09-07T00:00:00+00:00 {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:183}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Loading extension cinder.api.contrib.snapshot_unmanage.Snapshot_unmanage {{(pid=84425) load_extension /opt/stack/cinder/cinder/api/extensions.py:199}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Loaded extension: scheduler-stats {{(pid=84424) register /opt/stack/cinder/cinder/api/extensions.py:140}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Calling extension factory cinder.api.contrib.snapshot_unmanage.Snapshot_unmanage {{(pid=84425) load_extension /opt/stack/cinder/cinder/api/extensions.py:205}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Loading extension cinder.api.contrib.snapshot_unmanage.Snapshot_unmanage {{(pid=84424) load_extension /opt/stack/cinder/cinder/api/extensions.py:199}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext name: SnapshotUnmanage {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:179}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Calling extension factory cinder.api.contrib.snapshot_unmanage.Snapshot_unmanage {{(pid=84424) load_extension /opt/stack/cinder/cinder/api/extensions.py:205}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext alias: os-snapshot-unmanage {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:180}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext name: SnapshotUnmanage {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:179}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext description: Enable volume unmanage operation. {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:181}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext alias: os-snapshot-unmanage {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:180}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext updated: 2014-12-31T00:00:00+00:00 {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:183}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext description: Enable volume unmanage operation. {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:181}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Loaded extension: os-snapshot-unmanage {{(pid=84425) register /opt/stack/cinder/cinder/api/extensions.py:140}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext updated: 2014-12-31T00:00:00+00:00 {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:183}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Loading extension cinder.api.contrib.volume_type_access.Volume_type_access {{(pid=84425) load_extension /opt/stack/cinder/cinder/api/extensions.py:199}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Loaded extension: os-snapshot-unmanage {{(pid=84424) register /opt/stack/cinder/cinder/api/extensions.py:140}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Calling extension factory cinder.api.contrib.volume_type_access.Volume_type_access {{(pid=84425) load_extension /opt/stack/cinder/cinder/api/extensions.py:205}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Loading extension cinder.api.contrib.volume_type_access.Volume_type_access {{(pid=84424) load_extension /opt/stack/cinder/cinder/api/extensions.py:199}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext name: VolumeTypeAccess {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:179}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Calling extension factory cinder.api.contrib.volume_type_access.Volume_type_access {{(pid=84424) load_extension /opt/stack/cinder/cinder/api/extensions.py:205}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext alias: os-volume-type-access {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:180}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext name: VolumeTypeAccess {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:179}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext description: Volume type access support. {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:181}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext alias: os-volume-type-access {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:180}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Ext updated: 2014-06-26T00:00:00Z {{(pid=84425) _check_extension /opt/stack/cinder/cinder/api/extensions.py:183}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext description: Volume type access support. {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:181}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.extensions [-] Loaded extension: os-volume-type-access {{(pid=84425) register /opt/stack/cinder/cinder/api/extensions.py:140}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Ext updated: 2014-06-26T00:00:00Z {{(pid=84424) _check_extension /opt/stack/cinder/cinder/api/extensions.py:183}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.extensions [-] Loaded extension: os-volume-type-access {{(pid=84424) register /opt/stack/cinder/cinder/api/extensions.py:140}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: INFO dbcounter [None req-7576efc2-8dde-4661-818d-e6387f6bc9bd None None] Registered counter for database cinder May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: INFO dbcounter [None req-50368a6a-861f-4e95-ad7d-9a59403b74de None None] Registered counter for database cinder May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84424]: DEBUG oslo_db.sqlalchemy.engines [None req-7576efc2-8dde-4661-818d-e6387f6bc9bd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84424) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:342}} May 28 12:44:42 l75lg1-v1 devstack@c-api.service[84425]: DEBUG oslo_db.sqlalchemy.engines [None req-50368a6a-861f-4e95-ad7d-9a59403b74de None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84425) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:342}} May 28 12:44:42 l75lg1-v1 nova-conductor[82177]: DEBUG dbcounter [-] [82177] Writing DB stats nova_cell0:SELECT=1 {{(pid=82177) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:44:42 l75lg1-v1 nova-conductor[82177]: DEBUG dbcounter [-] [82177] Writing DB stats nova_cell1:SELECT=1 {{(pid=82177) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:44:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260f2efa-0937-42bd-a1f4-64e38b913bee None None] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:44:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260f2efa-0937-42bd-a1f4-64e38b913bee None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:44:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260f2efa-0937-42bd-a1f4-64e38b913bee None None] PATH_INFO: `/` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:44:43 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 478/940] 10.27.203.238 () {58 vars in 1014 bytes} [Tue May 28 12:44:43 2024] GET /identity => generated 272 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:44:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c000666d-d9b0-41dc-b68a-166ef2af5eb5 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:44:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c000666d-d9b0-41dc-b68a-166ef2af5eb5 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:44:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c000666d-d9b0-41dc-b68a-166ef2af5eb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:44:43 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-c000666d-d9b0-41dc-b68a-166ef2af5eb5 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:44:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-c000666d-d9b0-41dc-b68a-166ef2af5eb5 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:44:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-c000666d-d9b0-41dc-b68a-166ef2af5eb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:44:43 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 463/941] 10.27.203.238 () {62 vars in 1111 bytes} [Tue May 28 12:44:43 2024] POST /identity/v3/auth/tokens => generated 3991 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: DEBUG dbcounter [-] [84424] Writer thread running {{(pid=84424) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: INFO cinder.rpc [None req-7576efc2-8dde-4661-818d-e6387f6bc9bd None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: INFO cinder.rpc [None req-7576efc2-8dde-4661-818d-e6387f6bc9bd None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: INFO cinder.rpc [None req-7576efc2-8dde-4661-818d-e6387f6bc9bd None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: INFO cinder.rpc [None req-7576efc2-8dde-4661-818d-e6387f6bc9bd None None] Automatically selected cinder-volume RPC version 3.19 as minimum service version. May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: WARNING stevedore.named [None req-7576efc2-8dde-4661-818d-e6387f6bc9bd None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: WARNING castellan.key_manager [None req-7576efc2-8dde-4661-818d-e6387f6bc9bd None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: WARNING cinder.keymgr.conf_key_mgr [None req-7576efc2-8dde-4661-818d-e6387f6bc9bd None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: DEBUG oslo_db.sqlalchemy.engines [None req-7576efc2-8dde-4661-818d-e6387f6bc9bd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84424) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:342}} May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: INFO cinder.rpc [None req-7576efc2-8dde-4661-818d-e6387f6bc9bd None None] Automatically selected cinder-backup objects version 1.39 as minimum service version. May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84425]: DEBUG dbcounter [-] [84425] Writer thread running {{(pid=84425) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: INFO cinder.rpc [None req-7576efc2-8dde-4661-818d-e6387f6bc9bd None None] Automatically selected cinder-backup RPC version 2.4 as minimum service version. May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: WARNING stevedore.named [None req-7576efc2-8dde-4661-818d-e6387f6bc9bd None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: WARNING castellan.key_manager [None req-7576efc2-8dde-4661-818d-e6387f6bc9bd None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84425]: INFO cinder.rpc [None req-50368a6a-861f-4e95-ad7d-9a59403b74de None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: WARNING stevedore.named [None req-7576efc2-8dde-4661-818d-e6387f6bc9bd None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: WARNING castellan.key_manager [None req-7576efc2-8dde-4661-818d-e6387f6bc9bd None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: WARNING stevedore.named [None req-7576efc2-8dde-4661-818d-e6387f6bc9bd None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: WARNING castellan.key_manager [None req-7576efc2-8dde-4661-818d-e6387f6bc9bd None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84425]: INFO cinder.rpc [None req-50368a6a-861f-4e95-ad7d-9a59403b74de None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84425]: INFO cinder.rpc [None req-50368a6a-861f-4e95-ad7d-9a59403b74de None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84425]: INFO cinder.rpc [None req-50368a6a-861f-4e95-ad7d-9a59403b74de None None] Automatically selected cinder-volume RPC version 3.19 as minimum service version. May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84425]: WARNING stevedore.named [None req-50368a6a-861f-4e95-ad7d-9a59403b74de None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84425]: WARNING castellan.key_manager [None req-50368a6a-861f-4e95-ad7d-9a59403b74de None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84425]: WARNING cinder.keymgr.conf_key_mgr [None req-50368a6a-861f-4e95-ad7d-9a59403b74de None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84425]: DEBUG oslo_db.sqlalchemy.engines [None req-50368a6a-861f-4e95-ad7d-9a59403b74de None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84425) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:342}} May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: WARNING stevedore.named [None req-7576efc2-8dde-4661-818d-e6387f6bc9bd None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: WARNING castellan.key_manager [None req-7576efc2-8dde-4661-818d-e6387f6bc9bd None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84425]: INFO cinder.rpc [None req-50368a6a-861f-4e95-ad7d-9a59403b74de None None] Automatically selected cinder-backup objects version 1.39 as minimum service version. May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: WARNING stevedore.named [None req-7576efc2-8dde-4661-818d-e6387f6bc9bd None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: WARNING castellan.key_manager [None req-7576efc2-8dde-4661-818d-e6387f6bc9bd None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84425]: INFO cinder.rpc [None req-50368a6a-861f-4e95-ad7d-9a59403b74de None None] Automatically selected cinder-backup RPC version 2.4 as minimum service version. May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84425]: WARNING stevedore.named [None req-50368a6a-861f-4e95-ad7d-9a59403b74de None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84425]: WARNING castellan.key_manager [None req-50368a6a-861f-4e95-ad7d-9a59403b74de None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84425]: WARNING stevedore.named [None req-50368a6a-861f-4e95-ad7d-9a59403b74de None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84425]: WARNING castellan.key_manager [None req-50368a6a-861f-4e95-ad7d-9a59403b74de None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: WARNING stevedore.named [None req-7576efc2-8dde-4661-818d-e6387f6bc9bd None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: WARNING castellan.key_manager [None req-7576efc2-8dde-4661-818d-e6387f6bc9bd None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84425]: WARNING stevedore.named [None req-50368a6a-861f-4e95-ad7d-9a59403b74de None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84425]: WARNING castellan.key_manager [None req-50368a6a-861f-4e95-ad7d-9a59403b74de None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: WARNING stevedore.named [None req-7576efc2-8dde-4661-818d-e6387f6bc9bd None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: WARNING castellan.key_manager [None req-7576efc2-8dde-4661-818d-e6387f6bc9bd None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: WARNING stevedore.named [None req-7576efc2-8dde-4661-818d-e6387f6bc9bd None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: WARNING castellan.key_manager [None req-7576efc2-8dde-4661-818d-e6387f6bc9bd None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: WARNING stevedore.named [None req-7576efc2-8dde-4661-818d-e6387f6bc9bd None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: WARNING castellan.key_manager [None req-7576efc2-8dde-4661-818d-e6387f6bc9bd None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84425]: WARNING stevedore.named [None req-50368a6a-861f-4e95-ad7d-9a59403b74de None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84425]: WARNING castellan.key_manager [None req-50368a6a-861f-4e95-ad7d-9a59403b74de None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: WARNING stevedore.named [None req-7576efc2-8dde-4661-818d-e6387f6bc9bd None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: WARNING castellan.key_manager [None req-7576efc2-8dde-4661-818d-e6387f6bc9bd None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84425]: WARNING stevedore.named [None req-50368a6a-861f-4e95-ad7d-9a59403b74de None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84425]: WARNING castellan.key_manager [None req-50368a6a-861f-4e95-ad7d-9a59403b74de None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: WARNING stevedore.named [None req-7576efc2-8dde-4661-818d-e6387f6bc9bd None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: WARNING castellan.key_manager [None req-7576efc2-8dde-4661-818d-e6387f6bc9bd None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84425]: WARNING stevedore.named [None req-50368a6a-861f-4e95-ad7d-9a59403b74de None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84425]: WARNING castellan.key_manager [None req-50368a6a-861f-4e95-ad7d-9a59403b74de None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: WARNING stevedore.named [None req-7576efc2-8dde-4661-818d-e6387f6bc9bd None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: WARNING castellan.key_manager [None req-7576efc2-8dde-4661-818d-e6387f6bc9bd None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: WARNING stevedore.named [None req-7576efc2-8dde-4661-818d-e6387f6bc9bd None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: WARNING castellan.key_manager [None req-7576efc2-8dde-4661-818d-e6387f6bc9bd None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: WARNING stevedore.named [None req-7576efc2-8dde-4661-818d-e6387f6bc9bd None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: WARNING castellan.key_manager [None req-7576efc2-8dde-4661-818d-e6387f6bc9bd None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84425]: WARNING stevedore.named [None req-50368a6a-861f-4e95-ad7d-9a59403b74de None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84425]: WARNING castellan.key_manager [None req-50368a6a-861f-4e95-ad7d-9a59403b74de None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84425]: WARNING stevedore.named [None req-50368a6a-861f-4e95-ad7d-9a59403b74de None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84425]: WARNING castellan.key_manager [None req-50368a6a-861f-4e95-ad7d-9a59403b74de None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: WARNING stevedore.named [None req-7576efc2-8dde-4661-818d-e6387f6bc9bd None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: WARNING castellan.key_manager [None req-7576efc2-8dde-4661-818d-e6387f6bc9bd None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84425]: WARNING stevedore.named [None req-50368a6a-861f-4e95-ad7d-9a59403b74de None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84425]: WARNING castellan.key_manager [None req-50368a6a-861f-4e95-ad7d-9a59403b74de None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: WARNING stevedore.named [None req-7576efc2-8dde-4661-818d-e6387f6bc9bd None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: WARNING castellan.key_manager [None req-7576efc2-8dde-4661-818d-e6387f6bc9bd None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: WARNING stevedore.named [None req-7576efc2-8dde-4661-818d-e6387f6bc9bd None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: WARNING castellan.key_manager [None req-7576efc2-8dde-4661-818d-e6387f6bc9bd None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84425]: WARNING stevedore.named [None req-50368a6a-861f-4e95-ad7d-9a59403b74de None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84425]: WARNING castellan.key_manager [None req-50368a6a-861f-4e95-ad7d-9a59403b74de None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: WARNING stevedore.named [None req-7576efc2-8dde-4661-818d-e6387f6bc9bd None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: WARNING castellan.key_manager [None req-7576efc2-8dde-4661-818d-e6387f6bc9bd None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: WARNING stevedore.named [None req-7576efc2-8dde-4661-818d-e6387f6bc9bd None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: WARNING castellan.key_manager [None req-7576efc2-8dde-4661-818d-e6387f6bc9bd None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84425]: WARNING stevedore.named [None req-50368a6a-861f-4e95-ad7d-9a59403b74de None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: WARNING stevedore.named [None req-7576efc2-8dde-4661-818d-e6387f6bc9bd None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84425]: WARNING castellan.key_manager [None req-50368a6a-861f-4e95-ad7d-9a59403b74de None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: WARNING castellan.key_manager [None req-7576efc2-8dde-4661-818d-e6387f6bc9bd None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: WARNING stevedore.named [None req-7576efc2-8dde-4661-818d-e6387f6bc9bd None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: WARNING castellan.key_manager [None req-7576efc2-8dde-4661-818d-e6387f6bc9bd None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: WARNING stevedore.named [None req-7576efc2-8dde-4661-818d-e6387f6bc9bd None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: WARNING castellan.key_manager [None req-7576efc2-8dde-4661-818d-e6387f6bc9bd None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84425]: WARNING stevedore.named [None req-50368a6a-861f-4e95-ad7d-9a59403b74de None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84425]: WARNING castellan.key_manager [None req-50368a6a-861f-4e95-ad7d-9a59403b74de None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: WARNING stevedore.named [None req-7576efc2-8dde-4661-818d-e6387f6bc9bd None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: WARNING castellan.key_manager [None req-7576efc2-8dde-4661-818d-e6387f6bc9bd None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84425]: WARNING stevedore.named [None req-50368a6a-861f-4e95-ad7d-9a59403b74de None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84425]: WARNING castellan.key_manager [None req-50368a6a-861f-4e95-ad7d-9a59403b74de None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: WARNING stevedore.named [None req-7576efc2-8dde-4661-818d-e6387f6bc9bd None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: WARNING castellan.key_manager [None req-7576efc2-8dde-4661-818d-e6387f6bc9bd None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: WARNING cinder.api.contrib.hosts [None req-7576efc2-8dde-4661-818d-e6387f6bc9bd None None] Deprecated: The Host API is deprecated and will be be removed in a future version. May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.openstack [None req-7576efc2-8dde-4661-818d-e6387f6bc9bd None None] Extended resource: extensions {{(pid=84424) _setup_ext_routes /opt/stack/cinder/cinder/api/openstack/__init__.py:129}} May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84425]: WARNING stevedore.named [None req-50368a6a-861f-4e95-ad7d-9a59403b74de None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84425]: WARNING castellan.key_manager [None req-50368a6a-861f-4e95-ad7d-9a59403b74de None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.openstack [None req-7576efc2-8dde-4661-818d-e6387f6bc9bd None None] Extended resource: encryption {{(pid=84424) _setup_ext_routes /opt/stack/cinder/cinder/api/openstack/__init__.py:129}} May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.openstack [None req-7576efc2-8dde-4661-818d-e6387f6bc9bd None None] Extended resource: os-volume-manage {{(pid=84424) _setup_ext_routes /opt/stack/cinder/cinder/api/openstack/__init__.py:129}} May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.openstack [None req-7576efc2-8dde-4661-818d-e6387f6bc9bd None None] Extended resource: os-snapshot-manage {{(pid=84424) _setup_ext_routes /opt/stack/cinder/cinder/api/openstack/__init__.py:129}} May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84425]: WARNING stevedore.named [None req-50368a6a-861f-4e95-ad7d-9a59403b74de None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.openstack [None req-7576efc2-8dde-4661-818d-e6387f6bc9bd None None] Extended resource: capabilities {{(pid=84424) _setup_ext_routes /opt/stack/cinder/cinder/api/openstack/__init__.py:129}} May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84425]: WARNING castellan.key_manager [None req-50368a6a-861f-4e95-ad7d-9a59403b74de None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.openstack [None req-7576efc2-8dde-4661-818d-e6387f6bc9bd None None] Extended resource: os-volume-transfer {{(pid=84424) _setup_ext_routes /opt/stack/cinder/cinder/api/openstack/__init__.py:129}} May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.openstack [None req-7576efc2-8dde-4661-818d-e6387f6bc9bd None None] Extended resource: consistencygroups {{(pid=84424) _setup_ext_routes /opt/stack/cinder/cinder/api/openstack/__init__.py:129}} May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84425]: WARNING stevedore.named [None req-50368a6a-861f-4e95-ad7d-9a59403b74de None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84425]: WARNING castellan.key_manager [None req-50368a6a-861f-4e95-ad7d-9a59403b74de None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84425]: WARNING stevedore.named [None req-50368a6a-861f-4e95-ad7d-9a59403b74de None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84425]: WARNING castellan.key_manager [None req-50368a6a-861f-4e95-ad7d-9a59403b74de None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' May 28 12:44:43 l75lg1-v1 dstat.sh[49771]: 28-05 12:44:43| 36 6 57 0 0|4067M 5405M 267M 5958M| 15k 172B| 0 1706k| 0 119 |5596 9416 |1.86 1.84 1.30|4.0 0 47| 0 0 | 0 2048M| 26 225 0 23 0 May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84425]: WARNING stevedore.named [None req-50368a6a-861f-4e95-ad7d-9a59403b74de None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84425]: WARNING castellan.key_manager [None req-50368a6a-861f-4e95-ad7d-9a59403b74de None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.openstack [None req-7576efc2-8dde-4661-818d-e6387f6bc9bd None None] Extended resource: backups {{(pid=84424) _setup_ext_routes /opt/stack/cinder/cinder/api/openstack/__init__.py:129}} May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84425]: WARNING stevedore.named [None req-50368a6a-861f-4e95-ad7d-9a59403b74de None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84425]: WARNING castellan.key_manager [None req-50368a6a-861f-4e95-ad7d-9a59403b74de None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84425]: WARNING stevedore.named [None req-50368a6a-861f-4e95-ad7d-9a59403b74de None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84425]: WARNING castellan.key_manager [None req-50368a6a-861f-4e95-ad7d-9a59403b74de None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.openstack [None req-7576efc2-8dde-4661-818d-e6387f6bc9bd None None] Extended resource: os-availability-zone {{(pid=84424) _setup_ext_routes /opt/stack/cinder/cinder/api/openstack/__init__.py:129}} May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84425]: WARNING stevedore.named [None req-50368a6a-861f-4e95-ad7d-9a59403b74de None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84425]: WARNING castellan.key_manager [None req-50368a6a-861f-4e95-ad7d-9a59403b74de None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.openstack [None req-7576efc2-8dde-4661-818d-e6387f6bc9bd None None] Extended resource: os-quota-class-sets {{(pid=84424) _setup_ext_routes /opt/stack/cinder/cinder/api/openstack/__init__.py:129}} May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84425]: WARNING stevedore.named [None req-50368a6a-861f-4e95-ad7d-9a59403b74de None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84425]: WARNING castellan.key_manager [None req-50368a6a-861f-4e95-ad7d-9a59403b74de None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84425]: WARNING stevedore.named [None req-50368a6a-861f-4e95-ad7d-9a59403b74de None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84425]: WARNING castellan.key_manager [None req-50368a6a-861f-4e95-ad7d-9a59403b74de None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.openstack [None req-7576efc2-8dde-4661-818d-e6387f6bc9bd None None] Extended resource: encryption {{(pid=84424) _setup_ext_routes /opt/stack/cinder/cinder/api/openstack/__init__.py:129}} May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84425]: WARNING stevedore.named [None req-50368a6a-861f-4e95-ad7d-9a59403b74de None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84425]: WARNING castellan.key_manager [None req-50368a6a-861f-4e95-ad7d-9a59403b74de None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.openstack [None req-7576efc2-8dde-4661-818d-e6387f6bc9bd None None] Extended resource: os-quota-sets {{(pid=84424) _setup_ext_routes /opt/stack/cinder/cinder/api/openstack/__init__.py:129}} May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84425]: WARNING cinder.api.contrib.hosts [None req-50368a6a-861f-4e95-ad7d-9a59403b74de None None] Deprecated: The Host API is deprecated and will be be removed in a future version. May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.openstack [None req-50368a6a-861f-4e95-ad7d-9a59403b74de None None] Extended resource: extensions {{(pid=84425) _setup_ext_routes /opt/stack/cinder/cinder/api/openstack/__init__.py:129}} May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.openstack [None req-7576efc2-8dde-4661-818d-e6387f6bc9bd None None] Extended resource: os-services {{(pid=84424) _setup_ext_routes /opt/stack/cinder/cinder/api/openstack/__init__.py:129}} May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.openstack [None req-50368a6a-861f-4e95-ad7d-9a59403b74de None None] Extended resource: encryption {{(pid=84425) _setup_ext_routes /opt/stack/cinder/cinder/api/openstack/__init__.py:129}} May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.openstack [None req-7576efc2-8dde-4661-818d-e6387f6bc9bd None None] Extended resource: cgsnapshots {{(pid=84424) _setup_ext_routes /opt/stack/cinder/cinder/api/openstack/__init__.py:129}} May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.openstack [None req-50368a6a-861f-4e95-ad7d-9a59403b74de None None] Extended resource: os-volume-manage {{(pid=84425) _setup_ext_routes /opt/stack/cinder/cinder/api/openstack/__init__.py:129}} May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.openstack [None req-7576efc2-8dde-4661-818d-e6387f6bc9bd None None] Extended resource: qos-specs {{(pid=84424) _setup_ext_routes /opt/stack/cinder/cinder/api/openstack/__init__.py:129}} May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.openstack [None req-50368a6a-861f-4e95-ad7d-9a59403b74de None None] Extended resource: os-snapshot-manage {{(pid=84425) _setup_ext_routes /opt/stack/cinder/cinder/api/openstack/__init__.py:129}} May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.openstack [None req-7576efc2-8dde-4661-818d-e6387f6bc9bd None None] Extended resource: extra_specs {{(pid=84424) _setup_ext_routes /opt/stack/cinder/cinder/api/openstack/__init__.py:129}} May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.openstack [None req-50368a6a-861f-4e95-ad7d-9a59403b74de None None] Extended resource: capabilities {{(pid=84425) _setup_ext_routes /opt/stack/cinder/cinder/api/openstack/__init__.py:129}} May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.openstack [None req-7576efc2-8dde-4661-818d-e6387f6bc9bd None None] Extended resource: os-hosts {{(pid=84424) _setup_ext_routes /opt/stack/cinder/cinder/api/openstack/__init__.py:129}} May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.openstack [None req-50368a6a-861f-4e95-ad7d-9a59403b74de None None] Extended resource: os-volume-transfer {{(pid=84425) _setup_ext_routes /opt/stack/cinder/cinder/api/openstack/__init__.py:129}} May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.openstack [None req-7576efc2-8dde-4661-818d-e6387f6bc9bd None None] Extended resource: scheduler-stats {{(pid=84424) _setup_ext_routes /opt/stack/cinder/cinder/api/openstack/__init__.py:129}} May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.openstack [None req-50368a6a-861f-4e95-ad7d-9a59403b74de None None] Extended resource: consistencygroups {{(pid=84425) _setup_ext_routes /opt/stack/cinder/cinder/api/openstack/__init__.py:129}} May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.openstack [None req-7576efc2-8dde-4661-818d-e6387f6bc9bd None None] Extended resource: os-volume-type-access {{(pid=84424) _setup_ext_routes /opt/stack/cinder/cinder/api/openstack/__init__.py:129}} May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.openstack [None req-50368a6a-861f-4e95-ad7d-9a59403b74de None None] Extended resource: backups {{(pid=84425) _setup_ext_routes /opt/stack/cinder/cinder/api/openstack/__init__.py:129}} May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: WARNING stevedore.named [None req-7576efc2-8dde-4661-818d-e6387f6bc9bd None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: WARNING castellan.key_manager [None req-7576efc2-8dde-4661-818d-e6387f6bc9bd None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: WARNING stevedore.named [None req-7576efc2-8dde-4661-818d-e6387f6bc9bd None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: WARNING castellan.key_manager [None req-7576efc2-8dde-4661-818d-e6387f6bc9bd None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: WARNING stevedore.named [None req-7576efc2-8dde-4661-818d-e6387f6bc9bd None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.openstack [None req-50368a6a-861f-4e95-ad7d-9a59403b74de None None] Extended resource: os-availability-zone {{(pid=84425) _setup_ext_routes /opt/stack/cinder/cinder/api/openstack/__init__.py:129}} May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: WARNING castellan.key_manager [None req-7576efc2-8dde-4661-818d-e6387f6bc9bd None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: WARNING stevedore.named [None req-7576efc2-8dde-4661-818d-e6387f6bc9bd None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: WARNING castellan.key_manager [None req-7576efc2-8dde-4661-818d-e6387f6bc9bd None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.openstack [None req-50368a6a-861f-4e95-ad7d-9a59403b74de None None] Extended resource: os-quota-class-sets {{(pid=84425) _setup_ext_routes /opt/stack/cinder/cinder/api/openstack/__init__.py:129}} May 28 12:44:43 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi [None req-6e2df421-cd42-41ae-801c-ee0434dd0fc8 admin admin] Calling method '>' {{(pid=73999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: WARNING stevedore.named [None req-7576efc2-8dde-4661-818d-e6387f6bc9bd None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: WARNING castellan.key_manager [None req-7576efc2-8dde-4661-818d-e6387f6bc9bd None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' May 28 12:44:43 l75lg1-v1 devstack@n-api.service[73999]: INFO nova.api.openstack.requestlog [None req-6e2df421-cd42-41ae-801c-ee0434dd0fc8 admin admin] 10.27.203.238 "GET /compute/v2.1" status: 200 len: 390 microversion: 2.1 time: 0.001172 May 28 12:44:43 l75lg1-v1 devstack@n-api.service[73999]: [pid: 73999|app: 0|req: 3/7] 10.27.203.238 () {58 vars in 1013 bytes} [Tue May 28 12:44:43 2024] GET /compute/v2.1 => generated 390 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: WARNING stevedore.named [None req-7576efc2-8dde-4661-818d-e6387f6bc9bd None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.openstack [None req-50368a6a-861f-4e95-ad7d-9a59403b74de None None] Extended resource: encryption {{(pid=84425) _setup_ext_routes /opt/stack/cinder/cinder/api/openstack/__init__.py:129}} May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: WARNING castellan.key_manager [None req-7576efc2-8dde-4661-818d-e6387f6bc9bd None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: WARNING stevedore.named [None req-7576efc2-8dde-4661-818d-e6387f6bc9bd None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: WARNING castellan.key_manager [None req-7576efc2-8dde-4661-818d-e6387f6bc9bd None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.openstack [None req-50368a6a-861f-4e95-ad7d-9a59403b74de None None] Extended resource: os-quota-sets {{(pid=84425) _setup_ext_routes /opt/stack/cinder/cinder/api/openstack/__init__.py:129}} May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: WARNING stevedore.named [None req-7576efc2-8dde-4661-818d-e6387f6bc9bd None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: WARNING castellan.key_manager [None req-7576efc2-8dde-4661-818d-e6387f6bc9bd None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: WARNING stevedore.named [None req-7576efc2-8dde-4661-818d-e6387f6bc9bd None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.openstack [None req-50368a6a-861f-4e95-ad7d-9a59403b74de None None] Extended resource: os-services {{(pid=84425) _setup_ext_routes /opt/stack/cinder/cinder/api/openstack/__init__.py:129}} May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: WARNING castellan.key_manager [None req-7576efc2-8dde-4661-818d-e6387f6bc9bd None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.contrib.snapshot_actions [None req-7576efc2-8dde-4661-818d-e6387f6bc9bd None None] SnapshotActionsController initialized {{(pid=84424) __init__ /opt/stack/cinder/cinder/api/contrib/snapshot_actions.py:33}} May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: WARNING stevedore.named [None req-7576efc2-8dde-4661-818d-e6387f6bc9bd None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.openstack [None req-50368a6a-861f-4e95-ad7d-9a59403b74de None None] Extended resource: cgsnapshots {{(pid=84425) _setup_ext_routes /opt/stack/cinder/cinder/api/openstack/__init__.py:129}} May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: WARNING castellan.key_manager [None req-7576efc2-8dde-4661-818d-e6387f6bc9bd None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.openstack [None req-7576efc2-8dde-4661-818d-e6387f6bc9bd None None] Extension VolumeImageMetadata extending resource: volumes {{(pid=84424) _setup_extensions /opt/stack/cinder/cinder/api/openstack/__init__.py:159}} May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.openstack [None req-7576efc2-8dde-4661-818d-e6387f6bc9bd None None] Extension VolumeActions extending resource: volumes {{(pid=84424) _setup_extensions /opt/stack/cinder/cinder/api/openstack/__init__.py:159}} May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.openstack [None req-7576efc2-8dde-4661-818d-e6387f6bc9bd None None] Extension VolumeMigStatusAttribute extending resource: volumes {{(pid=84424) _setup_extensions /opt/stack/cinder/cinder/api/openstack/__init__.py:159}} May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.openstack [None req-7576efc2-8dde-4661-818d-e6387f6bc9bd None None] Extension VolumeTenantAttribute extending resource: volumes {{(pid=84424) _setup_extensions /opt/stack/cinder/cinder/api/openstack/__init__.py:159}} May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.openstack [None req-7576efc2-8dde-4661-818d-e6387f6bc9bd None None] Extension AdminActions extending resource: volumes {{(pid=84424) _setup_extensions /opt/stack/cinder/cinder/api/openstack/__init__.py:159}} May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.openstack [None req-7576efc2-8dde-4661-818d-e6387f6bc9bd None None] Extension AdminActions extending resource: snapshots {{(pid=84424) _setup_extensions /opt/stack/cinder/cinder/api/openstack/__init__.py:159}} May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.openstack [None req-50368a6a-861f-4e95-ad7d-9a59403b74de None None] Extended resource: qos-specs {{(pid=84425) _setup_ext_routes /opt/stack/cinder/cinder/api/openstack/__init__.py:129}} May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.openstack [None req-7576efc2-8dde-4661-818d-e6387f6bc9bd None None] Extension AdminActions extending resource: backups {{(pid=84424) _setup_extensions /opt/stack/cinder/cinder/api/openstack/__init__.py:159}} May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.openstack [None req-7576efc2-8dde-4661-818d-e6387f6bc9bd None None] Extension TypesManage extending resource: types {{(pid=84424) _setup_extensions /opt/stack/cinder/cinder/api/openstack/__init__.py:159}} May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.openstack [None req-7576efc2-8dde-4661-818d-e6387f6bc9bd None None] Extension VolumeTypeEncryption extending resource: types {{(pid=84424) _setup_extensions /opt/stack/cinder/cinder/api/openstack/__init__.py:159}} May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.openstack [None req-7576efc2-8dde-4661-818d-e6387f6bc9bd None None] Extension ExtendedSnapshotAttributes extending resource: snapshots {{(pid=84424) _setup_extensions /opt/stack/cinder/cinder/api/openstack/__init__.py:159}} May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.openstack [None req-7576efc2-8dde-4661-818d-e6387f6bc9bd None None] Extension VolumeUnmanage extending resource: volumes {{(pid=84424) _setup_extensions /opt/stack/cinder/cinder/api/openstack/__init__.py:159}} May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.openstack [None req-7576efc2-8dde-4661-818d-e6387f6bc9bd None None] Extension SnapshotActions extending resource: snapshots {{(pid=84424) _setup_extensions /opt/stack/cinder/cinder/api/openstack/__init__.py:159}} May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.openstack [None req-7576efc2-8dde-4661-818d-e6387f6bc9bd None None] Extension UsedLimits extending resource: limits {{(pid=84424) _setup_extensions /opt/stack/cinder/cinder/api/openstack/__init__.py:159}} May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.openstack [None req-7576efc2-8dde-4661-818d-e6387f6bc9bd None None] Extension VolumeHostAttribute extending resource: volumes {{(pid=84424) _setup_extensions /opt/stack/cinder/cinder/api/openstack/__init__.py:159}} May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.openstack [None req-7576efc2-8dde-4661-818d-e6387f6bc9bd None None] Extension SnapshotUnmanage extending resource: snapshots {{(pid=84424) _setup_extensions /opt/stack/cinder/cinder/api/openstack/__init__.py:159}} May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.openstack [None req-7576efc2-8dde-4661-818d-e6387f6bc9bd None None] Extension VolumeTypeAccess extending resource: types {{(pid=84424) _setup_extensions /opt/stack/cinder/cinder/api/openstack/__init__.py:159}} May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.openstack [None req-50368a6a-861f-4e95-ad7d-9a59403b74de None None] Extended resource: extra_specs {{(pid=84425) _setup_ext_routes /opt/stack/cinder/cinder/api/openstack/__init__.py:129}} May 28 12:44:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d48fe7d-c01f-4c3e-a4c3-ff8a12e014e7 None None] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:44:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d48fe7d-c01f-4c3e-a4c3-ff8a12e014e7 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:44:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d48fe7d-c01f-4c3e-a4c3-ff8a12e014e7 None None] PATH_INFO: `/` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: WARNING keystonemiddleware.auth_token [None req-7576efc2-8dde-4661-818d-e6387f6bc9bd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 28 12:44:43 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 479/942] 10.27.203.238 () {58 vars in 1050 bytes} [Tue May 28 12:44:43 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.openstack [None req-50368a6a-861f-4e95-ad7d-9a59403b74de None None] Extended resource: os-hosts {{(pid=84425) _setup_ext_routes /opt/stack/cinder/cinder/api/openstack/__init__.py:129}} May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.openstack [None req-50368a6a-861f-4e95-ad7d-9a59403b74de None None] Extended resource: scheduler-stats {{(pid=84425) _setup_ext_routes /opt/stack/cinder/cinder/api/openstack/__init__.py:129}} May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: WARNING keystonemiddleware.auth_token [None req-7576efc2-8dde-4661-818d-e6387f6bc9bd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 28 12:44:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bdbff3-54a5-4286-bf30-c1c2a80c0e3d None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:44:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bdbff3-54a5-4286-bf30-c1c2a80c0e3d None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:44:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bdbff3-54a5-4286-bf30-c1c2a80c0e3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.openstack [None req-50368a6a-861f-4e95-ad7d-9a59403b74de None None] Extended resource: os-volume-type-access {{(pid=84425) _setup_ext_routes /opt/stack/cinder/cinder/api/openstack/__init__.py:129}} May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84425]: WARNING stevedore.named [None req-50368a6a-861f-4e95-ad7d-9a59403b74de None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84425]: WARNING castellan.key_manager [None req-50368a6a-861f-4e95-ad7d-9a59403b74de None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: WSGI app 0 (mountpoint='') ready in 3 seconds on interpreter 0x55f73648cb70 pid: 84424 (default app) May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84425]: WARNING stevedore.named [None req-50368a6a-861f-4e95-ad7d-9a59403b74de None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84425]: WARNING castellan.key_manager [None req-50368a6a-861f-4e95-ad7d-9a59403b74de None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84425]: WARNING stevedore.named [None req-50368a6a-861f-4e95-ad7d-9a59403b74de None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84425]: WARNING castellan.key_manager [None req-50368a6a-861f-4e95-ad7d-9a59403b74de None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84425]: WARNING stevedore.named [None req-50368a6a-861f-4e95-ad7d-9a59403b74de None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84425]: WARNING castellan.key_manager [None req-50368a6a-861f-4e95-ad7d-9a59403b74de None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84425]: WARNING stevedore.named [None req-50368a6a-861f-4e95-ad7d-9a59403b74de None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84425]: WARNING castellan.key_manager [None req-50368a6a-861f-4e95-ad7d-9a59403b74de None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84425]: WARNING stevedore.named [None req-50368a6a-861f-4e95-ad7d-9a59403b74de None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84425]: WARNING castellan.key_manager [None req-50368a6a-861f-4e95-ad7d-9a59403b74de None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84425]: WARNING stevedore.named [None req-50368a6a-861f-4e95-ad7d-9a59403b74de None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84425]: WARNING castellan.key_manager [None req-50368a6a-861f-4e95-ad7d-9a59403b74de None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84425]: WARNING stevedore.named [None req-50368a6a-861f-4e95-ad7d-9a59403b74de None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84425]: WARNING castellan.key_manager [None req-50368a6a-861f-4e95-ad7d-9a59403b74de None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' May 28 12:44:43 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-44bdbff3-54a5-4286-bf30-c1c2a80c0e3d None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84425]: WARNING stevedore.named [None req-50368a6a-861f-4e95-ad7d-9a59403b74de None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_policy/policy.py:814: UserWarning: Policy "volume:attachment_create":"" was deprecated in X in favor of "volume:attachment_create":"rule:xena_system_admin_or_project_member". Reason: Default policies now support the three Keystone default roles, namely 'admin', 'member', and 'reader' to implement three Cinder "personas". See "Policy Personas and Permissions" in the "Cinder Service Configuration" documentation (Xena release) for details.. Either ensure your deployment is ready for the new default or copy/paste the deprecated policy into your policy file and maintain it manually. May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: warnings.warn(deprecated_msg) May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_policy/policy.py:814: UserWarning: Policy "volume:attachment_update":"rule:admin_or_owner" was deprecated in X in favor of "volume:attachment_update":"rule:xena_system_admin_or_project_member". Reason: Default policies now support the three Keystone default roles, namely 'admin', 'member', and 'reader' to implement three Cinder "personas". See "Policy Personas and Permissions" in the "Cinder Service Configuration" documentation (Xena release) for details.. Either ensure your deployment is ready for the new default or copy/paste the deprecated policy into your policy file and maintain it manually. May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: warnings.warn(deprecated_msg) May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_policy/policy.py:814: UserWarning: Policy "volume:attachment_delete":"rule:admin_or_owner" was deprecated in X in favor of "volume:attachment_delete":"rule:xena_system_admin_or_project_member". Reason: Default policies now support the three Keystone default roles, namely 'admin', 'member', and 'reader' to implement three Cinder "personas". See "Policy Personas and Permissions" in the "Cinder Service Configuration" documentation (Xena release) for details.. Either ensure your deployment is ready for the new default or copy/paste the deprecated policy into your policy file and maintain it manually. May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: warnings.warn(deprecated_msg) May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_policy/policy.py:814: UserWarning: Policy "volume:attachment_complete":"rule:admin_or_owner" was deprecated in X in favor of "volume:attachment_complete":"rule:xena_system_admin_or_project_member". Reason: Default policies now support the three Keystone default roles, namely 'admin', 'member', and 'reader' to implement three Cinder "personas". See "Policy Personas and Permissions" in the "Cinder Service Configuration" documentation (Xena release) for details.. Either ensure your deployment is ready for the new default or copy/paste the deprecated policy into your policy file and maintain it manually. May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: warnings.warn(deprecated_msg) May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_policy/policy.py:814: UserWarning: Policy "volume:multiattach_bootable_volume":"rule:admin_or_owner" was deprecated in X in favor of "volume:multiattach_bootable_volume":"rule:xena_system_admin_or_project_member". Reason: Default policies now support the three Keystone default roles, namely 'admin', 'member', and 'reader' to implement three Cinder "personas". See "Policy Personas and Permissions" in the "Cinder Service Configuration" documentation (Xena release) for details.. Either ensure your deployment is ready for the new default or copy/paste the deprecated policy into your policy file and maintain it manually. May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: warnings.warn(deprecated_msg) May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_policy/policy.py:814: UserWarning: Policy "message:get_all":"rule:admin_or_owner" was deprecated in X in favor of "message:get_all":"rule:xena_system_admin_or_project_reader". Reason: Default policies now support the three Keystone default roles, namely 'admin', 'member', and 'reader' to implement three Cinder "personas". See "Policy Personas and Permissions" in the "Cinder Service Configuration" documentation (Xena release) for details.. Either ensure your deployment is ready for the new default or copy/paste the deprecated policy into your policy file and maintain it manually. May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: warnings.warn(deprecated_msg) May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84425]: WARNING castellan.key_manager [None req-50368a6a-861f-4e95-ad7d-9a59403b74de None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_policy/policy.py:814: UserWarning: Policy "message:get":"rule:admin_or_owner" was deprecated in X in favor of "message:get":"rule:xena_system_admin_or_project_reader". Reason: Default policies now support the three Keystone default roles, namely 'admin', 'member', and 'reader' to implement three Cinder "personas". See "Policy Personas and Permissions" in the "Cinder Service Configuration" documentation (Xena release) for details.. Either ensure your deployment is ready for the new default or copy/paste the deprecated policy into your policy file and maintain it manually. May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: warnings.warn(deprecated_msg) May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_policy/policy.py:814: UserWarning: Policy "message:delete":"rule:admin_or_owner" was deprecated in X in favor of "message:delete":"rule:xena_system_admin_or_project_member". Reason: Default policies now support the three Keystone default roles, namely 'admin', 'member', and 'reader' to implement three Cinder "personas". See "Policy Personas and Permissions" in the "Cinder Service Configuration" documentation (Xena release) for details.. Either ensure your deployment is ready for the new default or copy/paste the deprecated policy into your policy file and maintain it manually. May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: warnings.warn(deprecated_msg) May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_policy/policy.py:814: UserWarning: Policy "volume:get_snapshot_metadata":"rule:admin_or_owner" was deprecated in X in favor of "volume:get_snapshot_metadata":"rule:xena_system_admin_or_project_reader". Reason: Default policies now support the three Keystone default roles, namely 'admin', 'member', and 'reader' to implement three Cinder "personas". See "Policy Personas and Permissions" in the "Cinder Service Configuration" documentation (Xena release) for details.. Either ensure your deployment is ready for the new default or copy/paste the deprecated policy into your policy file and maintain it manually. May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: warnings.warn(deprecated_msg) May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_policy/policy.py:814: UserWarning: Policy "volume:update_snapshot_metadata":"rule:admin_or_owner" was deprecated in X in favor of "volume:update_snapshot_metadata":"rule:xena_system_admin_or_project_member". Reason: Default policies now support the three Keystone default roles, namely 'admin', 'member', and 'reader' to implement three Cinder "personas". See "Policy Personas and Permissions" in the "Cinder Service Configuration" documentation (Xena release) for details.. Either ensure your deployment is ready for the new default or copy/paste the deprecated policy into your policy file and maintain it manually. May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: warnings.warn(deprecated_msg) May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_policy/policy.py:814: UserWarning: Policy "volume:delete_snapshot_metadata":"rule:admin_or_owner" was deprecated in X in favor of "volume:delete_snapshot_metadata":"rule:xena_system_admin_or_project_member". Reason: Default policies now support the three Keystone default roles, namely 'admin', 'member', and 'reader' to implement three Cinder "personas". See "Policy Personas and Permissions" in the "Cinder Service Configuration" documentation (Xena release) for details.. Either ensure your deployment is ready for the new default or copy/paste the deprecated policy into your policy file and maintain it manually. May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: warnings.warn(deprecated_msg) May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_policy/policy.py:814: UserWarning: Policy "volume:get_all_snapshots":"rule:admin_or_owner" was deprecated in X in favor of "volume:get_all_snapshots":"rule:xena_system_admin_or_project_reader". Reason: Default policies now support the three Keystone default roles, namely 'admin', 'member', and 'reader' to implement three Cinder "personas". See "Policy Personas and Permissions" in the "Cinder Service Configuration" documentation (Xena release) for details.. Either ensure your deployment is ready for the new default or copy/paste the deprecated policy into your policy file and maintain it manually. May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: warnings.warn(deprecated_msg) May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_policy/policy.py:814: UserWarning: Policy "volume_extension:extended_snapshot_attributes":"rule:admin_or_owner" was deprecated in X in favor of "volume_extension:extended_snapshot_attributes":"rule:xena_system_admin_or_project_reader". Reason: Default policies now support the three Keystone default roles, namely 'admin', 'member', and 'reader' to implement three Cinder "personas". See "Policy Personas and Permissions" in the "Cinder Service Configuration" documentation (Xena release) for details.. Either ensure your deployment is ready for the new default or copy/paste the deprecated policy into your policy file and maintain it manually. May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: warnings.warn(deprecated_msg) May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_policy/policy.py:814: UserWarning: Policy "volume:create_snapshot":"rule:admin_or_owner" was deprecated in X in favor of "volume:create_snapshot":"rule:xena_system_admin_or_project_member". Reason: Default policies now support the three Keystone default roles, namely 'admin', 'member', and 'reader' to implement three Cinder "personas". See "Policy Personas and Permissions" in the "Cinder Service Configuration" documentation (Xena release) for details.. Either ensure your deployment is ready for the new default or copy/paste the deprecated policy into your policy file and maintain it manually. May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: warnings.warn(deprecated_msg) May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_policy/policy.py:814: UserWarning: Policy "volume:get_snapshot":"rule:admin_or_owner" was deprecated in X in favor of "volume:get_snapshot":"rule:xena_system_admin_or_project_reader". Reason: Default policies now support the three Keystone default roles, namely 'admin', 'member', and 'reader' to implement three Cinder "personas". See "Policy Personas and Permissions" in the "Cinder Service Configuration" documentation (Xena release) for details.. Either ensure your deployment is ready for the new default or copy/paste the deprecated policy into your policy file and maintain it manually. May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: warnings.warn(deprecated_msg) May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_policy/policy.py:814: UserWarning: Policy "volume:update_snapshot":"rule:admin_or_owner" was deprecated in X in favor of "volume:update_snapshot":"rule:xena_system_admin_or_project_member". Reason: Default policies now support the three Keystone default roles, namely 'admin', 'member', and 'reader' to implement three Cinder "personas". See "Policy Personas and Permissions" in the "Cinder Service Configuration" documentation (Xena release) for details.. Either ensure your deployment is ready for the new default or copy/paste the deprecated policy into your policy file and maintain it manually. May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: warnings.warn(deprecated_msg) May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_policy/policy.py:814: UserWarning: Policy "volume:delete_snapshot":"rule:admin_or_owner" was deprecated in X in favor of "volume:delete_snapshot":"rule:xena_system_admin_or_project_member". Reason: Default policies now support the three Keystone default roles, namely 'admin', 'member', and 'reader' to implement three Cinder "personas". See "Policy Personas and Permissions" in the "Cinder Service Configuration" documentation (Xena release) for details.. Either ensure your deployment is ready for the new default or copy/paste the deprecated policy into your policy file and maintain it manually. May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: warnings.warn(deprecated_msg) May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_policy/policy.py:814: UserWarning: Policy "snapshot_extension:snapshot_actions:update_snapshot_status":"" was deprecated in X in favor of "snapshot_extension:snapshot_actions:update_snapshot_status":"rule:xena_system_admin_or_project_member". Reason: Default policies now support the three Keystone default roles, namely 'admin', 'member', and 'reader' to implement three Cinder "personas". See "Policy Personas and Permissions" in the "Cinder Service Configuration" documentation (Xena release) for details.. Either ensure your deployment is ready for the new default or copy/paste the deprecated policy into your policy file and maintain it manually. May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: warnings.warn(deprecated_msg) May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_policy/policy.py:814: UserWarning: Policy "backup:get_all":"rule:admin_or_owner" was deprecated in X in favor of "backup:get_all":"rule:xena_system_admin_or_project_reader". Reason: Default policies now support the three Keystone default roles, namely 'admin', 'member', and 'reader' to implement three Cinder "personas". See "Policy Personas and Permissions" in the "Cinder Service Configuration" documentation (Xena release) for details.. Either ensure your deployment is ready for the new default or copy/paste the deprecated policy into your policy file and maintain it manually. May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: warnings.warn(deprecated_msg) May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_policy/policy.py:814: UserWarning: Policy "backup:create":"" was deprecated in X in favor of "backup:create":"rule:xena_system_admin_or_project_member". Reason: Default policies now support the three Keystone default roles, namely 'admin', 'member', and 'reader' to implement three Cinder "personas". See "Policy Personas and Permissions" in the "Cinder Service Configuration" documentation (Xena release) for details.. Either ensure your deployment is ready for the new default or copy/paste the deprecated policy into your policy file and maintain it manually. May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: warnings.warn(deprecated_msg) May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_policy/policy.py:814: UserWarning: Policy "backup:get":"rule:admin_or_owner" was deprecated in X in favor of "backup:get":"rule:xena_system_admin_or_project_reader". Reason: Default policies now support the three Keystone default roles, namely 'admin', 'member', and 'reader' to implement three Cinder "personas". See "Policy Personas and Permissions" in the "Cinder Service Configuration" documentation (Xena release) for details.. Either ensure your deployment is ready for the new default or copy/paste the deprecated policy into your policy file and maintain it manually. May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: warnings.warn(deprecated_msg) May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_policy/policy.py:814: UserWarning: Policy "backup:update":"rule:admin_or_owner" was deprecated in X in favor of "backup:update":"rule:xena_system_admin_or_project_member". Reason: Default policies now support the three Keystone default roles, namely 'admin', 'member', and 'reader' to implement three Cinder "personas". See "Policy Personas and Permissions" in the "Cinder Service Configuration" documentation (Xena release) for details.. Either ensure your deployment is ready for the new default or copy/paste the deprecated policy into your policy file and maintain it manually. May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: warnings.warn(deprecated_msg) May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_policy/policy.py:814: UserWarning: Policy "backup:delete":"rule:admin_or_owner" was deprecated in X in favor of "backup:delete":"rule:xena_system_admin_or_project_member". Reason: Default policies now support the three Keystone default roles, namely 'admin', 'member', and 'reader' to implement three Cinder "personas". See "Policy Personas and Permissions" in the "Cinder Service Configuration" documentation (Xena release) for details.. Either ensure your deployment is ready for the new default or copy/paste the deprecated policy into your policy file and maintain it manually. May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: warnings.warn(deprecated_msg) May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_policy/policy.py:814: UserWarning: Policy "backup:restore":"rule:admin_or_owner" was deprecated in X in favor of "backup:restore":"rule:xena_system_admin_or_project_member". Reason: Default policies now support the three Keystone default roles, namely 'admin', 'member', and 'reader' to implement three Cinder "personas". See "Policy Personas and Permissions" in the "Cinder Service Configuration" documentation (Xena release) for details.. Either ensure your deployment is ready for the new default or copy/paste the deprecated policy into your policy file and maintain it manually. May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: warnings.warn(deprecated_msg) May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_policy/policy.py:814: UserWarning: Policy "group:get_all":"rule:admin_or_owner" was deprecated in X in favor of "group:get_all":"rule:xena_system_admin_or_project_reader". Reason: Default policies now support the three Keystone default roles, namely 'admin', 'member', and 'reader' to implement three Cinder "personas". See "Policy Personas and Permissions" in the "Cinder Service Configuration" documentation (Xena release) for details.. Either ensure your deployment is ready for the new default or copy/paste the deprecated policy into your policy file and maintain it manually. May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: warnings.warn(deprecated_msg) May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_policy/policy.py:814: UserWarning: Policy "group:create":"" was deprecated in X in favor of "group:create":"rule:xena_system_admin_or_project_member". Reason: Default policies now support the three Keystone default roles, namely 'admin', 'member', and 'reader' to implement three Cinder "personas". See "Policy Personas and Permissions" in the "Cinder Service Configuration" documentation (Xena release) for details.. Either ensure your deployment is ready for the new default or copy/paste the deprecated policy into your policy file and maintain it manually. May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: warnings.warn(deprecated_msg) May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_policy/policy.py:814: UserWarning: Policy "group:get":"rule:admin_or_owner" was deprecated in X in favor of "group:get":"rule:xena_system_admin_or_project_reader". Reason: Default policies now support the three Keystone default roles, namely 'admin', 'member', and 'reader' to implement three Cinder "personas". See "Policy Personas and Permissions" in the "Cinder Service Configuration" documentation (Xena release) for details.. Either ensure your deployment is ready for the new default or copy/paste the deprecated policy into your policy file and maintain it manually. May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: warnings.warn(deprecated_msg) May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_policy/policy.py:814: UserWarning: Policy "group:update":"rule:admin_or_owner" was deprecated in X in favor of "group:update":"rule:xena_system_admin_or_project_member". Reason: Default policies now support the three Keystone default roles, namely 'admin', 'member', and 'reader' to implement three Cinder "personas". See "Policy Personas and Permissions" in the "Cinder Service Configuration" documentation (Xena release) for details.. Either ensure your deployment is ready for the new default or copy/paste the deprecated policy into your policy file and maintain it manually. May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: warnings.warn(deprecated_msg) May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_policy/policy.py:814: UserWarning: Policy "group:get_all_group_snapshots":"rule:admin_or_owner" was deprecated in X in favor of "group:get_all_group_snapshots":"rule:xena_system_admin_or_project_reader". Reason: Default policies now support the three Keystone default roles, namely 'admin', 'member', and 'reader' to implement three Cinder "personas". See "Policy Personas and Permissions" in the "Cinder Service Configuration" documentation (Xena release) for details.. Either ensure your deployment is ready for the new default or copy/paste the deprecated policy into your policy file and maintain it manually. May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: warnings.warn(deprecated_msg) May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_policy/policy.py:814: UserWarning: Policy "group:create_group_snapshot":"" was deprecated in X in favor of "group:create_group_snapshot":"rule:xena_system_admin_or_project_member". Reason: Default policies now support the three Keystone default roles, namely 'admin', 'member', and 'reader' to implement three Cinder "personas". See "Policy Personas and Permissions" in the "Cinder Service Configuration" documentation (Xena release) for details.. Either ensure your deployment is ready for the new default or copy/paste the deprecated policy into your policy file and maintain it manually. May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: warnings.warn(deprecated_msg) May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_policy/policy.py:814: UserWarning: Policy "group:get_group_snapshot":"rule:admin_or_owner" was deprecated in X in favor of "group:get_group_snapshot":"rule:xena_system_admin_or_project_reader". Reason: Default policies now support the three Keystone default roles, namely 'admin', 'member', and 'reader' to implement three Cinder "personas". See "Policy Personas and Permissions" in the "Cinder Service Configuration" documentation (Xena release) for details.. Either ensure your deployment is ready for the new default or copy/paste the deprecated policy into your policy file and maintain it manually. May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: warnings.warn(deprecated_msg) May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_policy/policy.py:814: UserWarning: Policy "group:delete_group_snapshot":"rule:admin_or_owner" was deprecated in X in favor of "group:delete_group_snapshot":"rule:xena_system_admin_or_project_member". Reason: Default policies now support the three Keystone default roles, namely 'admin', 'member', and 'reader' to implement three Cinder "personas". See "Policy Personas and Permissions" in the "Cinder Service Configuration" documentation (Xena release) for details.. Either ensure your deployment is ready for the new default or copy/paste the deprecated policy into your policy file and maintain it manually. May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: warnings.warn(deprecated_msg) May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_policy/policy.py:814: UserWarning: Policy "group:update_group_snapshot":"rule:admin_or_owner" was deprecated in X in favor of "group:update_group_snapshot":"rule:xena_system_admin_or_project_member". Reason: Default policies now support the three Keystone default roles, namely 'admin', 'member', and 'reader' to implement three Cinder "personas". See "Policy Personas and Permissions" in the "Cinder Service Configuration" documentation (Xena release) for details.. Either ensure your deployment is ready for the new default or copy/paste the deprecated policy into your policy file and maintain it manually. May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: warnings.warn(deprecated_msg) May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_policy/policy.py:814: UserWarning: Policy "group:delete":"rule:admin_or_owner" was deprecated in X in favor of "group:delete":"rule:xena_system_admin_or_project_member". Reason: Default policies now support the three Keystone default roles, namely 'admin', 'member', and 'reader' to implement three Cinder "personas". See "Policy Personas and Permissions" in the "Cinder Service Configuration" documentation (Xena release) for details.. Either ensure your deployment is ready for the new default or copy/paste the deprecated policy into your policy file and maintain it manually. May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: warnings.warn(deprecated_msg) May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_policy/policy.py:814: UserWarning: Policy "group:enable_replication":"rule:admin_or_owner" was deprecated in X in favor of "group:enable_replication":"rule:xena_system_admin_or_project_member". Reason: Default policies now support the three Keystone default roles, namely 'admin', 'member', and 'reader' to implement three Cinder "personas". See "Policy Personas and Permissions" in the "Cinder Service Configuration" documentation (Xena release) for details.. Either ensure your deployment is ready for the new default or copy/paste the deprecated policy into your policy file and maintain it manually. May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: warnings.warn(deprecated_msg) May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_policy/policy.py:814: UserWarning: Policy "group:disable_replication":"rule:admin_or_owner" was deprecated in X in favor of "group:disable_replication":"rule:xena_system_admin_or_project_member". Reason: Default policies now support the three Keystone default roles, namely 'admin', 'member', and 'reader' to implement three Cinder "personas". See "Policy Personas and Permissions" in the "Cinder Service Configuration" documentation (Xena release) for details.. Either ensure your deployment is ready for the new default or copy/paste the deprecated policy into your policy file and maintain it manually. May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: warnings.warn(deprecated_msg) May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_policy/policy.py:814: UserWarning: Policy "group:failover_replication":"rule:admin_or_owner" was deprecated in X in favor of "group:failover_replication":"rule:xena_system_admin_or_project_member". Reason: Default policies now support the three Keystone default roles, namely 'admin', 'member', and 'reader' to implement three Cinder "personas". See "Policy Personas and Permissions" in the "Cinder Service Configuration" documentation (Xena release) for details.. Either ensure your deployment is ready for the new default or copy/paste the deprecated policy into your policy file and maintain it manually. May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: warnings.warn(deprecated_msg) May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.contrib.snapshot_actions [None req-50368a6a-861f-4e95-ad7d-9a59403b74de None None] SnapshotActionsController initialized {{(pid=84425) __init__ /opt/stack/cinder/cinder/api/contrib/snapshot_actions.py:33}} May 28 12:44:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-44bdbff3-54a5-4286-bf30-c1c2a80c0e3d None None] MFA Rules not processed for user `befdd4414dc2432ab2baa1ae3fbffef7`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_policy/policy.py:814: UserWarning: Policy "group:list_replication_targets":"rule:admin_or_owner" was deprecated in X in favor of "group:list_replication_targets":"rule:xena_system_admin_or_project_member". Reason: Default policies now support the three Keystone default roles, namely 'admin', 'member', and 'reader' to implement three Cinder "personas". See "Policy Personas and Permissions" in the "Cinder Service Configuration" documentation (Xena release) for details.. Either ensure your deployment is ready for the new default or copy/paste the deprecated policy into your policy file and maintain it manually. May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: warnings.warn(deprecated_msg) May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_policy/policy.py:814: UserWarning: Policy "volume_extension:quotas:show":"rule:admin_or_owner" was deprecated in None in favor of "volume_extension:quotas:show":"rule:xena_system_admin_or_project_reader". Reason: None. Either ensure your deployment is ready for the new default or copy/paste the deprecated policy into your policy file and maintain it manually. May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: warnings.warn(deprecated_msg) May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_policy/policy.py:814: UserWarning: Policy "limits_extension:used_limits":"rule:admin_or_owner" was deprecated in X in favor of "limits_extension:used_limits":"rule:xena_system_admin_or_project_reader". Reason: Default policies now support the three Keystone default roles, namely 'admin', 'member', and 'reader' to implement three Cinder "personas". See "Policy Personas and Permissions" in the "Cinder Service Configuration" documentation (Xena release) for details.. Either ensure your deployment is ready for the new default or copy/paste the deprecated policy into your policy file and maintain it manually. May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: warnings.warn(deprecated_msg) May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_policy/policy.py:814: UserWarning: Policy "volume_extension:type_get":"" was deprecated in X in favor of "volume_extension:type_get":"rule:xena_system_admin_or_project_reader". Reason: Default policies now support the three Keystone default roles, namely 'admin', 'member', and 'reader' to implement three Cinder "personas". See "Policy Personas and Permissions" in the "Cinder Service Configuration" documentation (Xena release) for details.. Either ensure your deployment is ready for the new default or copy/paste the deprecated policy into your policy file and maintain it manually. May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: warnings.warn(deprecated_msg) May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_policy/policy.py:814: UserWarning: Policy "volume_extension:type_get_all":"" was deprecated in X in favor of "volume_extension:type_get_all":"rule:xena_system_admin_or_project_reader". Reason: Default policies now support the three Keystone default roles, namely 'admin', 'member', and 'reader' to implement three Cinder "personas". See "Policy Personas and Permissions" in the "Cinder Service Configuration" documentation (Xena release) for details.. Either ensure your deployment is ready for the new default or copy/paste the deprecated policy into your policy file and maintain it manually. May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: warnings.warn(deprecated_msg) May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_policy/policy.py:814: UserWarning: Policy "volume_extension:access_types_extra_specs":"rule:admin_api" was deprecated in X in favor of "volume_extension:access_types_extra_specs":"rule:xena_system_admin_or_project_reader". Reason: Default policies now support the three Keystone default roles, namely 'admin', 'member', and 'reader' to implement three Cinder "personas". See "Policy Personas and Permissions" in the "Cinder Service Configuration" documentation (Xena release) for details.. Either ensure your deployment is ready for the new default or copy/paste the deprecated policy into your policy file and maintain it manually. May 28 12:44:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-44bdbff3-54a5-4286-bf30-c1c2a80c0e3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: warnings.warn(deprecated_msg) May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_policy/policy.py:814: UserWarning: Policy "volume_extension:volume_type_encryption:create":"rule:volume_extension:volume_type_encryption" was deprecated in X in favor of "volume_extension:volume_type_encryption:create":"rule:admin_api". Reason: Reason: 'volume_extension:volume_type_encryption' was a convenience policy that allowed you to set all volume encryption type policies to the same value. We are deprecating this rule to prepare for a future release in which the default values for policies that read, create/update, and delete encryption types will be different from each other.. Either ensure your deployment is ready for the new default or copy/paste the deprecated policy into your policy file and maintain it manually. May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: warnings.warn(deprecated_msg) May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_policy/policy.py:814: UserWarning: Policy "volume_extension:volume_type_encryption:get":"rule:volume_extension:volume_type_encryption" was deprecated in X in favor of "volume_extension:volume_type_encryption:get":"rule:admin_api". Reason: Reason: 'volume_extension:volume_type_encryption' was a convenience policy that allowed you to set all volume encryption type policies to the same value. We are deprecating this rule to prepare for a future release in which the default values for policies that read, create/update, and delete encryption types will be different from each other.. Either ensure your deployment is ready for the new default or copy/paste the deprecated policy into your policy file and maintain it manually. May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: warnings.warn(deprecated_msg) May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_policy/policy.py:814: UserWarning: Policy "volume_extension:volume_type_encryption:update":"rule:volume_extension:volume_type_encryption" was deprecated in X in favor of "volume_extension:volume_type_encryption:update":"rule:admin_api". Reason: Reason: 'volume_extension:volume_type_encryption' was a convenience policy that allowed you to set all volume encryption type policies to the same value. We are deprecating this rule to prepare for a future release in which the default values for policies that read, create/update, and delete encryption types will be different from each other.. Either ensure your deployment is ready for the new default or copy/paste the deprecated policy into your policy file and maintain it manually. May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: warnings.warn(deprecated_msg) May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_policy/policy.py:814: UserWarning: Policy "volume_extension:volume_type_encryption:delete":"rule:volume_extension:volume_type_encryption" was deprecated in X in favor of "volume_extension:volume_type_encryption:delete":"rule:admin_api". Reason: Reason: 'volume_extension:volume_type_encryption' was a convenience policy that allowed you to set all volume encryption type policies to the same value. We are deprecating this rule to prepare for a future release in which the default values for policies that read, create/update, and delete encryption types will be different from each other.. Either ensure your deployment is ready for the new default or copy/paste the deprecated policy into your policy file and maintain it manually. May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: warnings.warn(deprecated_msg) May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_policy/policy.py:814: UserWarning: Policy "volume_extension:volume_type_access":"rule:admin_or_owner" was deprecated in X in favor of "volume_extension:volume_type_access":"rule:xena_system_admin_or_project_member". Reason: Default policies now support the three Keystone default roles, namely 'admin', 'member', and 'reader' to implement three Cinder "personas". See "Policy Personas and Permissions" in the "Cinder Service Configuration" documentation (Xena release) for details.. Either ensure your deployment is ready for the new default or copy/paste the deprecated policy into your policy file and maintain it manually. May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: warnings.warn(deprecated_msg) May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_policy/policy.py:814: UserWarning: Policy "volume_extension:volume_type_access:get_all_for_type":"volume_extension:volume_type_access" was deprecated in X in favor of "volume_extension:volume_type_access:get_all_for_type":"rule:admin_api". Reason: Reason: 'volume_extension:volume_type_access:get_all_for_type' is a new policy that protects an API call formerly governed by 'volume_extension:volume_type_access', but which has been separated for finer-grained policy control.. Either ensure your deployment is ready for the new default or copy/paste the deprecated policy into your policy file and maintain it manually. May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: warnings.warn(deprecated_msg) May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_policy/policy.py:814: UserWarning: Policy "volume:extend":"rule:admin_or_owner" was deprecated in X in favor of "volume:extend":"rule:xena_system_admin_or_project_member". Reason: Default policies now support the three Keystone default roles, namely 'admin', 'member', and 'reader' to implement three Cinder "personas". See "Policy Personas and Permissions" in the "Cinder Service Configuration" documentation (Xena release) for details.. Either ensure your deployment is ready for the new default or copy/paste the deprecated policy into your policy file and maintain it manually. May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: warnings.warn(deprecated_msg) May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84425]: WARNING stevedore.named [None req-50368a6a-861f-4e95-ad7d-9a59403b74de None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_policy/policy.py:814: UserWarning: Policy "volume:extend_attached_volume":"rule:admin_or_owner" was deprecated in X in favor of "volume:extend_attached_volume":"rule:xena_system_admin_or_project_member". Reason: Default policies now support the three Keystone default roles, namely 'admin', 'member', and 'reader' to implement three Cinder "personas". See "Policy Personas and Permissions" in the "Cinder Service Configuration" documentation (Xena release) for details.. Either ensure your deployment is ready for the new default or copy/paste the deprecated policy into your policy file and maintain it manually. May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: warnings.warn(deprecated_msg) May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_policy/policy.py:814: UserWarning: Policy "volume:revert_to_snapshot":"rule:admin_or_owner" was deprecated in X in favor of "volume:revert_to_snapshot":"rule:xena_system_admin_or_project_member". Reason: Default policies now support the three Keystone default roles, namely 'admin', 'member', and 'reader' to implement three Cinder "personas". See "Policy Personas and Permissions" in the "Cinder Service Configuration" documentation (Xena release) for details.. Either ensure your deployment is ready for the new default or copy/paste the deprecated policy into your policy file and maintain it manually. May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: warnings.warn(deprecated_msg) May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_policy/policy.py:814: UserWarning: Policy "volume:retype":"rule:admin_or_owner" was deprecated in X in favor of "volume:retype":"rule:xena_system_admin_or_project_member". Reason: Default policies now support the three Keystone default roles, namely 'admin', 'member', and 'reader' to implement three Cinder "personas". See "Policy Personas and Permissions" in the "Cinder Service Configuration" documentation (Xena release) for details.. Either ensure your deployment is ready for the new default or copy/paste the deprecated policy into your policy file and maintain it manually. May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: warnings.warn(deprecated_msg) May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_policy/policy.py:814: UserWarning: Policy "volume:update_readonly_flag":"rule:admin_or_owner" was deprecated in X in favor of "volume:update_readonly_flag":"rule:xena_system_admin_or_project_member". Reason: Default policies now support the three Keystone default roles, namely 'admin', 'member', and 'reader' to implement three Cinder "personas". See "Policy Personas and Permissions" in the "Cinder Service Configuration" documentation (Xena release) for details.. Either ensure your deployment is ready for the new default or copy/paste the deprecated policy into your policy file and maintain it manually. May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: warnings.warn(deprecated_msg) May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_policy/policy.py:814: UserWarning: Policy "volume_extension:volume_actions:upload_image":"rule:admin_or_owner" was deprecated in X in favor of "volume_extension:volume_actions:upload_image":"rule:xena_system_admin_or_project_member". Reason: Default policies now support the three Keystone default roles, namely 'admin', 'member', and 'reader' to implement three Cinder "personas". See "Policy Personas and Permissions" in the "Cinder Service Configuration" documentation (Xena release) for details.. Either ensure your deployment is ready for the new default or copy/paste the deprecated policy into your policy file and maintain it manually. May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: warnings.warn(deprecated_msg) May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_policy/policy.py:814: UserWarning: Policy "volume_extension:volume_actions:initialize_connection":"rule:admin_or_owner" was deprecated in X in favor of "volume_extension:volume_actions:initialize_connection":"rule:xena_system_admin_or_project_member". Reason: Default policies now support the three Keystone default roles, namely 'admin', 'member', and 'reader' to implement three Cinder "personas". See "Policy Personas and Permissions" in the "Cinder Service Configuration" documentation (Xena release) for details.. Either ensure your deployment is ready for the new default or copy/paste the deprecated policy into your policy file and maintain it manually. May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: warnings.warn(deprecated_msg) May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_policy/policy.py:814: UserWarning: Policy "volume_extension:volume_actions:terminate_connection":"rule:admin_or_owner" was deprecated in X in favor of "volume_extension:volume_actions:terminate_connection":"rule:xena_system_admin_or_project_member". Reason: Default policies now support the three Keystone default roles, namely 'admin', 'member', and 'reader' to implement three Cinder "personas". See "Policy Personas and Permissions" in the "Cinder Service Configuration" documentation (Xena release) for details.. Either ensure your deployment is ready for the new default or copy/paste the deprecated policy into your policy file and maintain it manually. May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: warnings.warn(deprecated_msg) May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_policy/policy.py:814: UserWarning: Policy "volume_extension:volume_actions:roll_detaching":"rule:admin_or_owner" was deprecated in X in favor of "volume_extension:volume_actions:roll_detaching":"rule:xena_system_admin_or_project_member". Reason: Default policies now support the three Keystone default roles, namely 'admin', 'member', and 'reader' to implement three Cinder "personas". See "Policy Personas and Permissions" in the "Cinder Service Configuration" documentation (Xena release) for details.. Either ensure your deployment is ready for the new default or copy/paste the deprecated policy into your policy file and maintain it manually. May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: warnings.warn(deprecated_msg) May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_policy/policy.py:814: UserWarning: Policy "volume_extension:volume_actions:reserve":"rule:admin_or_owner" was deprecated in X in favor of "volume_extension:volume_actions:reserve":"rule:xena_system_admin_or_project_member". Reason: Default policies now support the three Keystone default roles, namely 'admin', 'member', and 'reader' to implement three Cinder "personas". See "Policy Personas and Permissions" in the "Cinder Service Configuration" documentation (Xena release) for details.. Either ensure your deployment is ready for the new default or copy/paste the deprecated policy into your policy file and maintain it manually. May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: warnings.warn(deprecated_msg) May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84425]: WARNING castellan.key_manager [None req-50368a6a-861f-4e95-ad7d-9a59403b74de None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_policy/policy.py:814: UserWarning: Policy "volume_extension:volume_actions:unreserve":"rule:admin_or_owner" was deprecated in X in favor of "volume_extension:volume_actions:unreserve":"rule:xena_system_admin_or_project_member". Reason: Default policies now support the three Keystone default roles, namely 'admin', 'member', and 'reader' to implement three Cinder "personas". See "Policy Personas and Permissions" in the "Cinder Service Configuration" documentation (Xena release) for details.. Either ensure your deployment is ready for the new default or copy/paste the deprecated policy into your policy file and maintain it manually. May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: warnings.warn(deprecated_msg) May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_policy/policy.py:814: UserWarning: Policy "volume_extension:volume_actions:begin_detaching":"rule:admin_or_owner" was deprecated in X in favor of "volume_extension:volume_actions:begin_detaching":"rule:xena_system_admin_or_project_member". Reason: Default policies now support the three Keystone default roles, namely 'admin', 'member', and 'reader' to implement three Cinder "personas". See "Policy Personas and Permissions" in the "Cinder Service Configuration" documentation (Xena release) for details.. Either ensure your deployment is ready for the new default or copy/paste the deprecated policy into your policy file and maintain it manually. May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: warnings.warn(deprecated_msg) May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_policy/policy.py:814: UserWarning: Policy "volume_extension:volume_actions:attach":"rule:admin_or_owner" was deprecated in X in favor of "volume_extension:volume_actions:attach":"rule:xena_system_admin_or_project_member". Reason: Default policies now support the three Keystone default roles, namely 'admin', 'member', and 'reader' to implement three Cinder "personas". See "Policy Personas and Permissions" in the "Cinder Service Configuration" documentation (Xena release) for details.. Either ensure your deployment is ready for the new default or copy/paste the deprecated policy into your policy file and maintain it manually. May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: warnings.warn(deprecated_msg) May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_policy/policy.py:814: UserWarning: Policy "volume_extension:volume_actions:detach":"rule:admin_or_owner" was deprecated in X in favor of "volume_extension:volume_actions:detach":"rule:xena_system_admin_or_project_member". Reason: Default policies now support the three Keystone default roles, namely 'admin', 'member', and 'reader' to implement three Cinder "personas". See "Policy Personas and Permissions" in the "Cinder Service Configuration" documentation (Xena release) for details.. Either ensure your deployment is ready for the new default or copy/paste the deprecated policy into your policy file and maintain it manually. May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: warnings.warn(deprecated_msg) May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_policy/policy.py:814: UserWarning: Policy "volume:get_all_transfers":"rule:admin_or_owner" was deprecated in X in favor of "volume:get_all_transfers":"rule:xena_system_admin_or_project_reader". Reason: Default policies now support the three Keystone default roles, namely 'admin', 'member', and 'reader' to implement three Cinder "personas". See "Policy Personas and Permissions" in the "Cinder Service Configuration" documentation (Xena release) for details.. Either ensure your deployment is ready for the new default or copy/paste the deprecated policy into your policy file and maintain it manually. May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: warnings.warn(deprecated_msg) May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_policy/policy.py:814: UserWarning: Policy "volume:create_transfer":"rule:admin_or_owner" was deprecated in X in favor of "volume:create_transfer":"rule:xena_system_admin_or_project_member". Reason: Default policies now support the three Keystone default roles, namely 'admin', 'member', and 'reader' to implement three Cinder "personas". See "Policy Personas and Permissions" in the "Cinder Service Configuration" documentation (Xena release) for details.. Either ensure your deployment is ready for the new default or copy/paste the deprecated policy into your policy file and maintain it manually. May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: warnings.warn(deprecated_msg) May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_policy/policy.py:814: UserWarning: Policy "volume:get_transfer":"rule:admin_or_owner" was deprecated in X in favor of "volume:get_transfer":"rule:xena_system_admin_or_project_reader". Reason: Default policies now support the three Keystone default roles, namely 'admin', 'member', and 'reader' to implement three Cinder "personas". See "Policy Personas and Permissions" in the "Cinder Service Configuration" documentation (Xena release) for details.. Either ensure your deployment is ready for the new default or copy/paste the deprecated policy into your policy file and maintain it manually. May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: warnings.warn(deprecated_msg) May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_policy/policy.py:814: UserWarning: Policy "volume:accept_transfer":"" was deprecated in X in favor of "volume:accept_transfer":"rule:xena_system_admin_or_project_member". Reason: Default policies now support the three Keystone default roles, namely 'admin', 'member', and 'reader' to implement three Cinder "personas". See "Policy Personas and Permissions" in the "Cinder Service Configuration" documentation (Xena release) for details.. Either ensure your deployment is ready for the new default or copy/paste the deprecated policy into your policy file and maintain it manually. May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: warnings.warn(deprecated_msg) May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_policy/policy.py:814: UserWarning: Policy "volume:delete_transfer":"rule:admin_or_owner" was deprecated in X in favor of "volume:delete_transfer":"rule:xena_system_admin_or_project_member". Reason: Default policies now support the three Keystone default roles, namely 'admin', 'member', and 'reader' to implement three Cinder "personas". See "Policy Personas and Permissions" in the "Cinder Service Configuration" documentation (Xena release) for details.. Either ensure your deployment is ready for the new default or copy/paste the deprecated policy into your policy file and maintain it manually. May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: warnings.warn(deprecated_msg) May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_policy/policy.py:814: UserWarning: Policy "volume:get_volume_metadata":"rule:admin_or_owner" was deprecated in X in favor of "volume:get_volume_metadata":"rule:xena_system_admin_or_project_reader". Reason: Default policies now support the three Keystone default roles, namely 'admin', 'member', and 'reader' to implement three Cinder "personas". See "Policy Personas and Permissions" in the "Cinder Service Configuration" documentation (Xena release) for details.. Either ensure your deployment is ready for the new default or copy/paste the deprecated policy into your policy file and maintain it manually. May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: warnings.warn(deprecated_msg) May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_policy/policy.py:814: UserWarning: Policy "volume:create_volume_metadata":"rule:admin_or_owner" was deprecated in X in favor of "volume:create_volume_metadata":"rule:xena_system_admin_or_project_member". Reason: Default policies now support the three Keystone default roles, namely 'admin', 'member', and 'reader' to implement three Cinder "personas". See "Policy Personas and Permissions" in the "Cinder Service Configuration" documentation (Xena release) for details.. Either ensure your deployment is ready for the new default or copy/paste the deprecated policy into your policy file and maintain it manually. May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: warnings.warn(deprecated_msg) May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_policy/policy.py:814: UserWarning: Policy "volume:update_volume_metadata":"rule:admin_or_owner" was deprecated in X in favor of "volume:update_volume_metadata":"rule:xena_system_admin_or_project_member". Reason: Default policies now support the three Keystone default roles, namely 'admin', 'member', and 'reader' to implement three Cinder "personas". See "Policy Personas and Permissions" in the "Cinder Service Configuration" documentation (Xena release) for details.. Either ensure your deployment is ready for the new default or copy/paste the deprecated policy into your policy file and maintain it manually. May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: warnings.warn(deprecated_msg) May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_policy/policy.py:814: UserWarning: Policy "volume:delete_volume_metadata":"rule:admin_or_owner" was deprecated in X in favor of "volume:delete_volume_metadata":"rule:xena_system_admin_or_project_member". Reason: Default policies now support the three Keystone default roles, namely 'admin', 'member', and 'reader' to implement three Cinder "personas". See "Policy Personas and Permissions" in the "Cinder Service Configuration" documentation (Xena release) for details.. Either ensure your deployment is ready for the new default or copy/paste the deprecated policy into your policy file and maintain it manually. May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: warnings.warn(deprecated_msg) May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_policy/policy.py:814: UserWarning: Policy "volume_extension:volume_image_metadata":"rule:admin_or_owner" was deprecated in X in favor of "volume_extension:volume_image_metadata:show":"rule:xena_system_admin_or_project_reader". Reason: volume_extension:volume_image_metadata has been replaced by more granular policies that separately govern show, set, and remove operations.. Either ensure your deployment is ready for the new default or copy/paste the deprecated policy into your policy file and maintain it manually. May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: warnings.warn(deprecated_msg) May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_policy/policy.py:814: UserWarning: Policy "volume_extension:volume_image_metadata":"rule:admin_or_owner" was deprecated in X in favor of "volume_extension:volume_image_metadata:set":"rule:xena_system_admin_or_project_member". Reason: volume_extension:volume_image_metadata has been replaced by more granular policies that separately govern show, set, and remove operations.. Either ensure your deployment is ready for the new default or copy/paste the deprecated policy into your policy file and maintain it manually. May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: warnings.warn(deprecated_msg) May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_policy/policy.py:814: UserWarning: Policy "volume_extension:volume_image_metadata":"rule:admin_or_owner" was deprecated in X in favor of "volume_extension:volume_image_metadata:remove":"rule:xena_system_admin_or_project_member". Reason: volume_extension:volume_image_metadata has been replaced by more granular policies that separately govern show, set, and remove operations.. Either ensure your deployment is ready for the new default or copy/paste the deprecated policy into your policy file and maintain it manually. May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: warnings.warn(deprecated_msg) May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_policy/policy.py:814: UserWarning: Policy "volume_extension:types_extra_specs:index":"" was deprecated in X in favor of "volume_extension:types_extra_specs:index":"rule:xena_system_admin_or_project_reader". Reason: Default policies now support the three Keystone default roles, namely 'admin', 'member', and 'reader' to implement three Cinder "personas". See "Policy Personas and Permissions" in the "Cinder Service Configuration" documentation (Xena release) for details.. Either ensure your deployment is ready for the new default or copy/paste the deprecated policy into your policy file and maintain it manually. May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: warnings.warn(deprecated_msg) May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_policy/policy.py:814: UserWarning: Policy "volume_extension:types_extra_specs:show":"" was deprecated in X in favor of "volume_extension:types_extra_specs:show":"rule:xena_system_admin_or_project_reader". Reason: Default policies now support the three Keystone default roles, namely 'admin', 'member', and 'reader' to implement three Cinder "personas". See "Policy Personas and Permissions" in the "Cinder Service Configuration" documentation (Xena release) for details.. Either ensure your deployment is ready for the new default or copy/paste the deprecated policy into your policy file and maintain it manually. May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: warnings.warn(deprecated_msg) May 28 12:44:43 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 464/943] 10.27.203.238 () {62 vars in 1147 bytes} [Tue May 28 12:44:43 2024] POST /identity/v3/auth/tokens => generated 4055 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_policy/policy.py:814: UserWarning: Policy "volume:create":"" was deprecated in X in favor of "volume:create":"rule:xena_system_admin_or_project_member". Reason: Default policies now support the three Keystone default roles, namely 'admin', 'member', and 'reader' to implement three Cinder "personas". See "Policy Personas and Permissions" in the "Cinder Service Configuration" documentation (Xena release) for details.. Either ensure your deployment is ready for the new default or copy/paste the deprecated policy into your policy file and maintain it manually. May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: warnings.warn(deprecated_msg) May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_policy/policy.py:814: UserWarning: Policy "volume:create_from_image":"" was deprecated in X in favor of "volume:create_from_image":"rule:xena_system_admin_or_project_member". Reason: Default policies now support the three Keystone default roles, namely 'admin', 'member', and 'reader' to implement three Cinder "personas". See "Policy Personas and Permissions" in the "Cinder Service Configuration" documentation (Xena release) for details.. Either ensure your deployment is ready for the new default or copy/paste the deprecated policy into your policy file and maintain it manually. May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: warnings.warn(deprecated_msg) May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_policy/policy.py:814: UserWarning: Policy "volume:get":"rule:admin_or_owner" was deprecated in X in favor of "volume:get":"rule:xena_system_admin_or_project_reader". Reason: Default policies now support the three Keystone default roles, namely 'admin', 'member', and 'reader' to implement three Cinder "personas". See "Policy Personas and Permissions" in the "Cinder Service Configuration" documentation (Xena release) for details.. Either ensure your deployment is ready for the new default or copy/paste the deprecated policy into your policy file and maintain it manually. May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: warnings.warn(deprecated_msg) May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_policy/policy.py:814: UserWarning: Policy "volume:get_all":"rule:admin_or_owner" was deprecated in X in favor of "volume:get_all":"rule:xena_system_admin_or_project_reader". Reason: Default policies now support the three Keystone default roles, namely 'admin', 'member', and 'reader' to implement three Cinder "personas". See "Policy Personas and Permissions" in the "Cinder Service Configuration" documentation (Xena release) for details.. Either ensure your deployment is ready for the new default or copy/paste the deprecated policy into your policy file and maintain it manually. May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: warnings.warn(deprecated_msg) May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_policy/policy.py:814: UserWarning: Policy "volume:update":"rule:admin_or_owner" was deprecated in X in favor of "volume:update":"rule:xena_system_admin_or_project_member". Reason: Default policies now support the three Keystone default roles, namely 'admin', 'member', and 'reader' to implement three Cinder "personas". See "Policy Personas and Permissions" in the "Cinder Service Configuration" documentation (Xena release) for details.. Either ensure your deployment is ready for the new default or copy/paste the deprecated policy into your policy file and maintain it manually. May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: warnings.warn(deprecated_msg) May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_policy/policy.py:814: UserWarning: Policy "volume:delete":"rule:admin_or_owner" was deprecated in X in favor of "volume:delete":"rule:xena_system_admin_or_project_member". Reason: Default policies now support the three Keystone default roles, namely 'admin', 'member', and 'reader' to implement three Cinder "personas". See "Policy Personas and Permissions" in the "Cinder Service Configuration" documentation (Xena release) for details.. Either ensure your deployment is ready for the new default or copy/paste the deprecated policy into your policy file and maintain it manually. May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: warnings.warn(deprecated_msg) May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_policy/policy.py:814: UserWarning: Policy "volume_extension:volume_tenant_attribute":"rule:admin_or_owner" was deprecated in X in favor of "volume_extension:volume_tenant_attribute":"rule:xena_system_admin_or_project_reader". Reason: Default policies now support the three Keystone default roles, namely 'admin', 'member', and 'reader' to implement three Cinder "personas". See "Policy Personas and Permissions" in the "Cinder Service Configuration" documentation (Xena release) for details.. Either ensure your deployment is ready for the new default or copy/paste the deprecated policy into your policy file and maintain it manually. May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: warnings.warn(deprecated_msg) May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_policy/policy.py:814: UserWarning: Policy "volume_extension:volume_encryption_metadata":"rule:admin_or_owner" was deprecated in X in favor of "volume_extension:volume_encryption_metadata":"rule:xena_system_admin_or_project_reader". Reason: Default policies now support the three Keystone default roles, namely 'admin', 'member', and 'reader' to implement three Cinder "personas". See "Policy Personas and Permissions" in the "Cinder Service Configuration" documentation (Xena release) for details.. Either ensure your deployment is ready for the new default or copy/paste the deprecated policy into your policy file and maintain it manually. May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: warnings.warn(deprecated_msg) May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_policy/policy.py:814: UserWarning: Policy "volume:multiattach":"rule:admin_or_owner" was deprecated in X in favor of "volume:multiattach":"rule:xena_system_admin_or_project_member". Reason: Default policies now support the three Keystone default roles, namely 'admin', 'member', and 'reader' to implement three Cinder "personas". See "Policy Personas and Permissions" in the "Cinder Service Configuration" documentation (Xena release) for details.. Either ensure your deployment is ready for the new default or copy/paste the deprecated policy into your policy file and maintain it manually. May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: warnings.warn(deprecated_msg) May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_policy/policy.py:814: UserWarning: Policy "volume_extension:default_set_or_update":"rule:system_or_domain_or_project_admin" was deprecated in X in favor of "volume_extension:default_set_or_update":"rule:admin_api". Reason: Default policies now support the three Keystone default roles, namely 'admin', 'member', and 'reader' to implement three Cinder "personas". See "Policy Personas and Permissions" in the "Cinder Service Configuration" documentation (Xena release) for details.. Either ensure your deployment is ready for the new default or copy/paste the deprecated policy into your policy file and maintain it manually. May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: warnings.warn(deprecated_msg) May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_policy/policy.py:814: UserWarning: Policy "volume_extension:default_get":"rule:system_or_domain_or_project_admin" was deprecated in X in favor of "volume_extension:default_get":"rule:admin_api". Reason: Default policies now support the three Keystone default roles, namely 'admin', 'member', and 'reader' to implement three Cinder "personas". See "Policy Personas and Permissions" in the "Cinder Service Configuration" documentation (Xena release) for details.. Either ensure your deployment is ready for the new default or copy/paste the deprecated policy into your policy file and maintain it manually. May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: warnings.warn(deprecated_msg) May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_policy/policy.py:814: UserWarning: Policy "volume_extension:default_get_all":"role:admin and system_scope:all" was deprecated in X in favor of "volume_extension:default_get_all":"rule:admin_api". Reason: Default policies now support the three Keystone default roles, namely 'admin', 'member', and 'reader' to implement three Cinder "personas". See "Policy Personas and Permissions" in the "Cinder Service Configuration" documentation (Xena release) for details.. Either ensure your deployment is ready for the new default or copy/paste the deprecated policy into your policy file and maintain it manually. May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: warnings.warn(deprecated_msg) May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_policy/policy.py:814: UserWarning: Policy "volume_extension:default_unset":"rule:system_or_domain_or_project_admin" was deprecated in X in favor of "volume_extension:default_unset":"rule:admin_api". Reason: Default policies now support the three Keystone default roles, namely 'admin', 'member', and 'reader' to implement three Cinder "personas". See "Policy Personas and Permissions" in the "Cinder Service Configuration" documentation (Xena release) for details.. Either ensure your deployment is ready for the new default or copy/paste the deprecated policy into your policy file and maintain it manually. May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: warnings.warn(deprecated_msg) May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.openstack [None req-50368a6a-861f-4e95-ad7d-9a59403b74de None None] Extension VolumeImageMetadata extending resource: volumes {{(pid=84425) _setup_extensions /opt/stack/cinder/cinder/api/openstack/__init__.py:159}} May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.openstack [None req-50368a6a-861f-4e95-ad7d-9a59403b74de None None] Extension VolumeActions extending resource: volumes {{(pid=84425) _setup_extensions /opt/stack/cinder/cinder/api/openstack/__init__.py:159}} May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.openstack [None req-50368a6a-861f-4e95-ad7d-9a59403b74de None None] Extension VolumeMigStatusAttribute extending resource: volumes {{(pid=84425) _setup_extensions /opt/stack/cinder/cinder/api/openstack/__init__.py:159}} May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.openstack [None req-50368a6a-861f-4e95-ad7d-9a59403b74de None None] Extension VolumeTenantAttribute extending resource: volumes {{(pid=84425) _setup_extensions /opt/stack/cinder/cinder/api/openstack/__init__.py:159}} May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.openstack [None req-50368a6a-861f-4e95-ad7d-9a59403b74de None None] Extension AdminActions extending resource: volumes {{(pid=84425) _setup_extensions /opt/stack/cinder/cinder/api/openstack/__init__.py:159}} May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.openstack [None req-50368a6a-861f-4e95-ad7d-9a59403b74de None None] Extension AdminActions extending resource: snapshots {{(pid=84425) _setup_extensions /opt/stack/cinder/cinder/api/openstack/__init__.py:159}} May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.openstack [None req-50368a6a-861f-4e95-ad7d-9a59403b74de None None] Extension AdminActions extending resource: backups {{(pid=84425) _setup_extensions /opt/stack/cinder/cinder/api/openstack/__init__.py:159}} May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.openstack [None req-50368a6a-861f-4e95-ad7d-9a59403b74de None None] Extension TypesManage extending resource: types {{(pid=84425) _setup_extensions /opt/stack/cinder/cinder/api/openstack/__init__.py:159}} May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.openstack [None req-50368a6a-861f-4e95-ad7d-9a59403b74de None None] Extension VolumeTypeEncryption extending resource: types {{(pid=84425) _setup_extensions /opt/stack/cinder/cinder/api/openstack/__init__.py:159}} May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.openstack [None req-50368a6a-861f-4e95-ad7d-9a59403b74de None None] Extension ExtendedSnapshotAttributes extending resource: snapshots {{(pid=84425) _setup_extensions /opt/stack/cinder/cinder/api/openstack/__init__.py:159}} May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.openstack [None req-50368a6a-861f-4e95-ad7d-9a59403b74de None None] Extension VolumeUnmanage extending resource: volumes {{(pid=84425) _setup_extensions /opt/stack/cinder/cinder/api/openstack/__init__.py:159}} May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.openstack [None req-50368a6a-861f-4e95-ad7d-9a59403b74de None None] Extension SnapshotActions extending resource: snapshots {{(pid=84425) _setup_extensions /opt/stack/cinder/cinder/api/openstack/__init__.py:159}} May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.openstack [None req-50368a6a-861f-4e95-ad7d-9a59403b74de None None] Extension UsedLimits extending resource: limits {{(pid=84425) _setup_extensions /opt/stack/cinder/cinder/api/openstack/__init__.py:159}} May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.openstack [None req-50368a6a-861f-4e95-ad7d-9a59403b74de None None] Extension VolumeHostAttribute extending resource: volumes {{(pid=84425) _setup_extensions /opt/stack/cinder/cinder/api/openstack/__init__.py:159}} May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.openstack [None req-50368a6a-861f-4e95-ad7d-9a59403b74de None None] Extension SnapshotUnmanage extending resource: snapshots {{(pid=84425) _setup_extensions /opt/stack/cinder/cinder/api/openstack/__init__.py:159}} May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.middleware.request_id [None req-cdd8afe4-3b62-4084-9ff1-dfa212a61a6b None None] RequestId filter calling following filter/app {{(pid=84424) _context_setter /opt/stack/cinder/cinder/api/middleware/request_id.py:62}} May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.openstack [None req-50368a6a-861f-4e95-ad7d-9a59403b74de None None] Extension VolumeTypeAccess extending resource: types {{(pid=84425) _setup_extensions /opt/stack/cinder/cinder/api/openstack/__init__.py:159}} May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84424]: [pid: 84424|app: 0|req: 1/1] 10.27.203.238 () {54 vars in 863 bytes} [Tue May 28 12:44:43 2024] GET /volume/v3 => generated 114 bytes in 20 msecs (HTTP/1.1 401) 5 headers in 231 bytes (1 switches on core 0) May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84425]: WARNING keystonemiddleware.auth_token [None req-50368a6a-861f-4e95-ad7d-9a59403b74de None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84425]: WARNING keystonemiddleware.auth_token [None req-50368a6a-861f-4e95-ad7d-9a59403b74de None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 28 12:44:43 l75lg1-v1 devstack@c-api.service[84425]: WSGI app 0 (mountpoint='') ready in 3 seconds on interpreter 0x55f73648cb70 pid: 84425 (default app) May 28 12:44:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d48fe7d-c01f-4c3e-a4c3-ff8a12e014e7 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:44:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d48fe7d-c01f-4c3e-a4c3-ff8a12e014e7 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:44:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44442f75-f55e-49c1-9f00-4339524f9675 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'befdd4414dc2432ab2baa1ae3fbffef7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'manager', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:44:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44442f75-f55e-49c1-9f00-4339524f9675 service nova] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:44:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44442f75-f55e-49c1-9f00-4339524f9675 service nova] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:44:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44442f75-f55e-49c1-9f00-4339524f9675 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:44:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44442f75-f55e-49c1-9f00-4339524f9675 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:44:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44442f75-f55e-49c1-9f00-4339524f9675 service nova] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:44:43 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 480/944] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 12:44:43 2024] GET /identity/v3/auth/tokens => generated 3991 bytes in 30 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 12:44:43 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi [None req-b927cfef-b6f0-4a61-8725-3e647b36c8e6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "swap": 0, "id": "d1", "ram": 512, "rxtx_factor": 1.0, "name": "ds512M", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 5}} {{(pid=74000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:518}} May 28 12:44:43 l75lg1-v1 devstack@n-api.service[74000]: INFO nova.api.openstack.requestlog [None req-b927cfef-b6f0-4a61-8725-3e647b36c8e6 admin admin] 10.27.203.238 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.145104 May 28 12:44:43 l75lg1-v1 devstack@n-api.service[74000]: [pid: 74000|app: 0|req: 5/8] 10.27.203.238 () {68 vars in 1365 bytes} [Tue May 28 12:44:43 2024] POST /compute/v2.1/flavors => generated 408 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 12:44:43 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi [None req-47419fe1-d116-49ea-b48b-8ae70ded6581 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=73999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:518}} May 28 12:44:43 l75lg1-v1 devstack@n-api.service[73999]: INFO nova.api.openstack.requestlog [None req-47419fe1-d116-49ea-b48b-8ae70ded6581 admin admin] 10.27.203.238 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.190145 May 28 12:44:43 l75lg1-v1 devstack@n-api.service[73999]: [pid: 73999|app: 0|req: 4/9] 10.27.203.238 () {68 vars in 1418 bytes} [Tue May 28 12:44:43 2024] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 12:44:44 l75lg1-v1 dstat.sh[49771]: 28-05 12:44:44| 21 12 65 1 0|4035M 5433M 267M 5962M| 23k 21k| 0 1486k| 0 109 |7670 12k|1.86 1.84 1.30|3.0 0 405| 0 0 | 0 2048M| 26 224 0 23 0 May 28 12:44:44 l75lg1-v1 nova-conductor[82643]: DEBUG dbcounter [-] [82643] Writing DB stats nova_cell1:SELECT=1 {{(pid=82643) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:44:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf26544b-3164-4d86-a64a-bfb806531648 None None] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:44:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf26544b-3164-4d86-a64a-bfb806531648 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:44:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf26544b-3164-4d86-a64a-bfb806531648 None None] PATH_INFO: `/` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:44:45 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 465/945] 10.27.203.238 () {58 vars in 1014 bytes} [Tue May 28 12:44:45 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:44:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00df9cc4-5b81-4b3e-9e04-e14574efed17 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:44:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00df9cc4-5b81-4b3e-9e04-e14574efed17 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:44:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00df9cc4-5b81-4b3e-9e04-e14574efed17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:44:45 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-00df9cc4-5b81-4b3e-9e04-e14574efed17 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:44:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-00df9cc4-5b81-4b3e-9e04-e14574efed17 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:44:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-00df9cc4-5b81-4b3e-9e04-e14574efed17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:44:45 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 481/946] 10.27.203.238 () {62 vars in 1111 bytes} [Tue May 28 12:44:45 2024] POST /identity/v3/auth/tokens => generated 3991 bytes in 24 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:44:45 l75lg1-v1 dstat.sh[49771]: 28-05 12:44:45| 20 8 71 0 0|4070M 5397M 267M 5963M| 23k 5542B| 136k 14M|34.0 45.0 |8947 13k|1.86 1.84 1.30|5.0 0 140| 0 0 | 0 2048M| 26 226 0 21 0 May 28 12:44:45 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi [None req-b927cfef-b6f0-4a61-8725-3e647b36c8e6 admin admin] Calling method '>' {{(pid=74000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} May 28 12:44:45 l75lg1-v1 devstack@n-api.service[74000]: INFO nova.api.openstack.requestlog [None req-b927cfef-b6f0-4a61-8725-3e647b36c8e6 admin admin] 10.27.203.238 "GET /compute/v2.1" status: 200 len: 390 microversion: 2.1 time: 0.001190 May 28 12:44:45 l75lg1-v1 devstack@n-api.service[74000]: [pid: 74000|app: 0|req: 6/10] 10.27.203.238 () {58 vars in 1013 bytes} [Tue May 28 12:44:45 2024] GET /compute/v2.1 => generated 390 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 12:44:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf26544b-3164-4d86-a64a-bfb806531648 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:44:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf26544b-3164-4d86-a64a-bfb806531648 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:44:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa81f18-a62d-4abc-88d6-9133b3205738 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'befdd4414dc2432ab2baa1ae3fbffef7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'manager', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:44:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa81f18-a62d-4abc-88d6-9133b3205738 service nova] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:44:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa81f18-a62d-4abc-88d6-9133b3205738 service nova] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:44:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa81f18-a62d-4abc-88d6-9133b3205738 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:44:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa81f18-a62d-4abc-88d6-9133b3205738 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:44:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa81f18-a62d-4abc-88d6-9133b3205738 service nova] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:44:45 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 466/947] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 12:44:45 2024] GET /identity/v3/auth/tokens => generated 3991 bytes in 24 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 12:44:45 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi [None req-1f98749b-5b70-4f88-8199-d748cfa7137b admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d2", "name": "ds1G", "swap": 0, "os-flavor-access:is_public": true, "ram": 1024, "disk": 10, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0}} {{(pid=73999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:518}} May 28 12:44:45 l75lg1-v1 devstack@n-api.service[73999]: INFO nova.api.openstack.requestlog [None req-1f98749b-5b70-4f88-8199-d748cfa7137b admin admin] 10.27.203.238 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.054790 May 28 12:44:45 l75lg1-v1 devstack@n-api.service[73999]: [pid: 73999|app: 0|req: 5/11] 10.27.203.238 () {68 vars in 1365 bytes} [Tue May 28 12:44:45 2024] POST /compute/v2.1/flavors => generated 408 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 12:44:45 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi [None req-77c62601-7a47-4c42-97cb-8b30a5f26a7e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=74000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:518}} May 28 12:44:45 l75lg1-v1 devstack@n-api.service[74000]: INFO nova.api.openstack.requestlog [None req-77c62601-7a47-4c42-97cb-8b30a5f26a7e admin admin] 10.27.203.238 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040678 May 28 12:44:45 l75lg1-v1 devstack@n-api.service[74000]: [pid: 74000|app: 0|req: 7/12] 10.27.203.238 () {68 vars in 1418 bytes} [Tue May 28 12:44:45 2024] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 12:44:45 l75lg1-v1 nova-compute[83654]: INFO nova.virt.libvirt.host [None req-d5e2622c-e52e-4f3d-871c-2ddda502f287 None None] Libvirt host capabilities May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: c5e6281c-cc67-45dc-80e6-b5292604d0a7 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: x86_64 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Broadwell-IBRS May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Intel May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: tcp May 28 12:44:45 l75lg1-v1 nova-compute[83654]: rdma May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: 16384188 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: 4096047 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: 0 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: 0 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: none May 28 12:44:45 l75lg1-v1 nova-compute[83654]: 0 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: dac May 28 12:44:45 l75lg1-v1 nova-compute[83654]: 0 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: +64055:+108 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: +64055:+108 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: hvm May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: 64 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/bin/qemu-system-alpha May 28 12:44:45 l75lg1-v1 nova-compute[83654]: clipper May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: hvm May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: 32 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/bin/qemu-system-arm May 28 12:44:45 l75lg1-v1 nova-compute[83654]: integratorcp May 28 12:44:45 l75lg1-v1 nova-compute[83654]: ast2600-evb May 28 12:44:45 l75lg1-v1 nova-compute[83654]: borzoi May 28 12:44:45 l75lg1-v1 nova-compute[83654]: spitz May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virt-2.7 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: nuri May 28 12:44:45 l75lg1-v1 nova-compute[83654]: mcimx7d-sabre May 28 12:44:45 l75lg1-v1 nova-compute[83654]: romulus-bmc May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virt-3.0 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virt-5.0 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: npcm750-evb May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virt-2.10 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: rainier-bmc May 28 12:44:45 l75lg1-v1 nova-compute[83654]: mps3-an547 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: musca-b1 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: realview-pbx-a9 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: versatileab May 28 12:44:45 l75lg1-v1 nova-compute[83654]: kzm May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virt-2.8 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: musca-a May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virt-3.1 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: mcimx6ul-evk May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virt-5.1 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: smdkc210 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: sx1 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virt-2.11 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: imx25-pdk May 28 12:44:45 l75lg1-v1 nova-compute[83654]: stm32vldiscovery May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virt-2.9 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: orangepi-pc May 28 12:44:45 l75lg1-v1 nova-compute[83654]: quanta-q71l-bmc May 28 12:44:45 l75lg1-v1 nova-compute[83654]: z2 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virt-5.2 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: xilinx-zynq-a9 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: tosa May 28 12:44:45 l75lg1-v1 nova-compute[83654]: mps2-an500 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virt-2.12 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: mps2-an521 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: sabrelite May 28 12:44:45 l75lg1-v1 nova-compute[83654]: mps2-an511 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: canon-a1100 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: realview-eb May 28 12:44:45 l75lg1-v1 nova-compute[83654]: quanta-gbs-bmc May 28 12:44:45 l75lg1-v1 nova-compute[83654]: emcraft-sf2 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: realview-pb-a8 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virt-4.0 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: raspi1ap May 28 12:44:45 l75lg1-v1 nova-compute[83654]: palmetto-bmc May 28 12:44:45 l75lg1-v1 nova-compute[83654]: sx1-v1 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: n810 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: g220a-bmc May 28 12:44:45 l75lg1-v1 nova-compute[83654]: n800 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: tacoma-bmc May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virt-4.1 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: quanta-gsj May 28 12:44:45 l75lg1-v1 nova-compute[83654]: versatilepb May 28 12:44:45 l75lg1-v1 nova-compute[83654]: terrier May 28 12:44:45 l75lg1-v1 nova-compute[83654]: mainstone May 28 12:44:45 l75lg1-v1 nova-compute[83654]: realview-eb-mpcore May 28 12:44:45 l75lg1-v1 nova-compute[83654]: supermicrox11-bmc May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virt-4.2 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: witherspoon-bmc May 28 12:44:45 l75lg1-v1 nova-compute[83654]: mps3-an524 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: swift-bmc May 28 12:44:45 l75lg1-v1 nova-compute[83654]: kudo-bmc May 28 12:44:45 l75lg1-v1 nova-compute[83654]: vexpress-a9 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: midway May 28 12:44:45 l75lg1-v1 nova-compute[83654]: musicpal May 28 12:44:45 l75lg1-v1 nova-compute[83654]: lm3s811evb May 28 12:44:45 l75lg1-v1 nova-compute[83654]: lm3s6965evb May 28 12:44:45 l75lg1-v1 nova-compute[83654]: microbit May 28 12:44:45 l75lg1-v1 nova-compute[83654]: mps2-an505 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: mps2-an385 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virt-6.0 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: cubieboard May 28 12:44:45 l75lg1-v1 nova-compute[83654]: verdex May 28 12:44:45 l75lg1-v1 nova-compute[83654]: netduino2 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: mps2-an386 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virt-6.1 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: raspi2b May 28 12:44:45 l75lg1-v1 nova-compute[83654]: vexpress-a15 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: fuji-bmc May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virt-6.2 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virt May 28 12:44:45 l75lg1-v1 nova-compute[83654]: sonorapass-bmc May 28 12:44:45 l75lg1-v1 nova-compute[83654]: cheetah May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virt-2.6 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: ast2500-evb May 28 12:44:45 l75lg1-v1 nova-compute[83654]: highbank May 28 12:44:45 l75lg1-v1 nova-compute[83654]: akita May 28 12:44:45 l75lg1-v1 nova-compute[83654]: connex May 28 12:44:45 l75lg1-v1 nova-compute[83654]: netduinoplus2 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: collie May 28 12:44:45 l75lg1-v1 nova-compute[83654]: raspi0 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: fp5280g2-bmc May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: hvm May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: 32 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/bin/qemu-system-arm May 28 12:44:45 l75lg1-v1 nova-compute[83654]: integratorcp May 28 12:44:45 l75lg1-v1 nova-compute[83654]: ast2600-evb May 28 12:44:45 l75lg1-v1 nova-compute[83654]: borzoi May 28 12:44:45 l75lg1-v1 nova-compute[83654]: spitz May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virt-2.7 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: nuri May 28 12:44:45 l75lg1-v1 nova-compute[83654]: mcimx7d-sabre May 28 12:44:45 l75lg1-v1 nova-compute[83654]: romulus-bmc May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virt-3.0 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virt-5.0 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: npcm750-evb May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virt-2.10 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: rainier-bmc May 28 12:44:45 l75lg1-v1 nova-compute[83654]: mps3-an547 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: musca-b1 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: realview-pbx-a9 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: versatileab May 28 12:44:45 l75lg1-v1 nova-compute[83654]: kzm May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virt-2.8 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: musca-a May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virt-3.1 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: mcimx6ul-evk May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virt-5.1 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: smdkc210 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: sx1 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virt-2.11 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: imx25-pdk May 28 12:44:45 l75lg1-v1 nova-compute[83654]: stm32vldiscovery May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virt-2.9 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: orangepi-pc May 28 12:44:45 l75lg1-v1 nova-compute[83654]: quanta-q71l-bmc May 28 12:44:45 l75lg1-v1 nova-compute[83654]: z2 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virt-5.2 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: xilinx-zynq-a9 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: tosa May 28 12:44:45 l75lg1-v1 nova-compute[83654]: mps2-an500 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virt-2.12 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: mps2-an521 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: sabrelite May 28 12:44:45 l75lg1-v1 nova-compute[83654]: mps2-an511 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: canon-a1100 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: realview-eb May 28 12:44:45 l75lg1-v1 nova-compute[83654]: quanta-gbs-bmc May 28 12:44:45 l75lg1-v1 nova-compute[83654]: emcraft-sf2 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: realview-pb-a8 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virt-4.0 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: raspi1ap May 28 12:44:45 l75lg1-v1 nova-compute[83654]: palmetto-bmc May 28 12:44:45 l75lg1-v1 nova-compute[83654]: sx1-v1 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: n810 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: g220a-bmc May 28 12:44:45 l75lg1-v1 nova-compute[83654]: n800 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: tacoma-bmc May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virt-4.1 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: quanta-gsj May 28 12:44:45 l75lg1-v1 nova-compute[83654]: versatilepb May 28 12:44:45 l75lg1-v1 nova-compute[83654]: terrier May 28 12:44:45 l75lg1-v1 nova-compute[83654]: mainstone May 28 12:44:45 l75lg1-v1 nova-compute[83654]: realview-eb-mpcore May 28 12:44:45 l75lg1-v1 nova-compute[83654]: supermicrox11-bmc May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virt-4.2 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: witherspoon-bmc May 28 12:44:45 l75lg1-v1 nova-compute[83654]: mps3-an524 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: swift-bmc May 28 12:44:45 l75lg1-v1 nova-compute[83654]: kudo-bmc May 28 12:44:45 l75lg1-v1 nova-compute[83654]: vexpress-a9 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: midway May 28 12:44:45 l75lg1-v1 nova-compute[83654]: musicpal May 28 12:44:45 l75lg1-v1 nova-compute[83654]: lm3s811evb May 28 12:44:45 l75lg1-v1 nova-compute[83654]: lm3s6965evb May 28 12:44:45 l75lg1-v1 nova-compute[83654]: microbit May 28 12:44:45 l75lg1-v1 nova-compute[83654]: mps2-an505 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: mps2-an385 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virt-6.0 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: cubieboard May 28 12:44:45 l75lg1-v1 nova-compute[83654]: verdex May 28 12:44:45 l75lg1-v1 nova-compute[83654]: netduino2 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: mps2-an386 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virt-6.1 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: raspi2b May 28 12:44:45 l75lg1-v1 nova-compute[83654]: vexpress-a15 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: fuji-bmc May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virt-6.2 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virt May 28 12:44:45 l75lg1-v1 nova-compute[83654]: sonorapass-bmc May 28 12:44:45 l75lg1-v1 nova-compute[83654]: cheetah May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virt-2.6 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: ast2500-evb May 28 12:44:45 l75lg1-v1 nova-compute[83654]: highbank May 28 12:44:45 l75lg1-v1 nova-compute[83654]: akita May 28 12:44:45 l75lg1-v1 nova-compute[83654]: connex May 28 12:44:45 l75lg1-v1 nova-compute[83654]: netduinoplus2 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: collie May 28 12:44:45 l75lg1-v1 nova-compute[83654]: raspi0 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: fp5280g2-bmc May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: hvm May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: 64 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/bin/qemu-system-aarch64 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: integratorcp May 28 12:44:45 l75lg1-v1 nova-compute[83654]: ast2600-evb May 28 12:44:45 l75lg1-v1 nova-compute[83654]: borzoi May 28 12:44:45 l75lg1-v1 nova-compute[83654]: spitz May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virt-2.7 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: nuri May 28 12:44:45 l75lg1-v1 nova-compute[83654]: mcimx7d-sabre May 28 12:44:45 l75lg1-v1 nova-compute[83654]: romulus-bmc May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virt-3.0 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virt-5.0 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: npcm750-evb May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virt-2.10 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: rainier-bmc May 28 12:44:45 l75lg1-v1 nova-compute[83654]: mps3-an547 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virt-2.8 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: musca-b1 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: realview-pbx-a9 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: versatileab May 28 12:44:45 l75lg1-v1 nova-compute[83654]: kzm May 28 12:44:45 l75lg1-v1 nova-compute[83654]: musca-a May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virt-3.1 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: mcimx6ul-evk May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virt-5.1 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: smdkc210 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: sx1 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virt-2.11 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: imx25-pdk May 28 12:44:45 l75lg1-v1 nova-compute[83654]: stm32vldiscovery May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virt-2.9 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: orangepi-pc May 28 12:44:45 l75lg1-v1 nova-compute[83654]: quanta-q71l-bmc May 28 12:44:45 l75lg1-v1 nova-compute[83654]: z2 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virt-5.2 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: xilinx-zynq-a9 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: xlnx-zcu102 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: tosa May 28 12:44:45 l75lg1-v1 nova-compute[83654]: mps2-an500 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virt-2.12 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: mps2-an521 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: sabrelite May 28 12:44:45 l75lg1-v1 nova-compute[83654]: mps2-an511 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: canon-a1100 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: realview-eb May 28 12:44:45 l75lg1-v1 nova-compute[83654]: quanta-gbs-bmc May 28 12:44:45 l75lg1-v1 nova-compute[83654]: emcraft-sf2 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: realview-pb-a8 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: sbsa-ref May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virt-4.0 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: raspi1ap May 28 12:44:45 l75lg1-v1 nova-compute[83654]: palmetto-bmc May 28 12:44:45 l75lg1-v1 nova-compute[83654]: sx1-v1 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: n810 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: g220a-bmc May 28 12:44:45 l75lg1-v1 nova-compute[83654]: n800 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: tacoma-bmc May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virt-4.1 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: quanta-gsj May 28 12:44:45 l75lg1-v1 nova-compute[83654]: versatilepb May 28 12:44:45 l75lg1-v1 nova-compute[83654]: terrier May 28 12:44:45 l75lg1-v1 nova-compute[83654]: mainstone May 28 12:44:45 l75lg1-v1 nova-compute[83654]: realview-eb-mpcore May 28 12:44:45 l75lg1-v1 nova-compute[83654]: supermicrox11-bmc May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virt-4.2 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: witherspoon-bmc May 28 12:44:45 l75lg1-v1 nova-compute[83654]: mps3-an524 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: swift-bmc May 28 12:44:45 l75lg1-v1 nova-compute[83654]: kudo-bmc May 28 12:44:45 l75lg1-v1 nova-compute[83654]: vexpress-a9 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: midway May 28 12:44:45 l75lg1-v1 nova-compute[83654]: musicpal May 28 12:44:45 l75lg1-v1 nova-compute[83654]: lm3s811evb May 28 12:44:45 l75lg1-v1 nova-compute[83654]: lm3s6965evb May 28 12:44:45 l75lg1-v1 nova-compute[83654]: microbit May 28 12:44:45 l75lg1-v1 nova-compute[83654]: mps2-an505 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: mps2-an385 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virt-6.0 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: raspi3ap May 28 12:44:45 l75lg1-v1 nova-compute[83654]: cubieboard May 28 12:44:45 l75lg1-v1 nova-compute[83654]: verdex May 28 12:44:45 l75lg1-v1 nova-compute[83654]: netduino2 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: xlnx-versal-virt May 28 12:44:45 l75lg1-v1 nova-compute[83654]: mps2-an386 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virt-6.1 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: raspi3b May 28 12:44:45 l75lg1-v1 nova-compute[83654]: raspi2b May 28 12:44:45 l75lg1-v1 nova-compute[83654]: vexpress-a15 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: fuji-bmc May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virt-6.2 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virt May 28 12:44:45 l75lg1-v1 nova-compute[83654]: sonorapass-bmc May 28 12:44:45 l75lg1-v1 nova-compute[83654]: cheetah May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virt-2.6 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: ast2500-evb May 28 12:44:45 l75lg1-v1 nova-compute[83654]: highbank May 28 12:44:45 l75lg1-v1 nova-compute[83654]: akita May 28 12:44:45 l75lg1-v1 nova-compute[83654]: connex May 28 12:44:45 l75lg1-v1 nova-compute[83654]: netduinoplus2 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: collie May 28 12:44:45 l75lg1-v1 nova-compute[83654]: raspi0 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: fp5280g2-bmc May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: hvm May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: 32 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/bin/qemu-system-cris May 28 12:44:45 l75lg1-v1 nova-compute[83654]: axis-dev88 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: hvm May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: 32 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/bin/qemu-system-i386 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-i440fx-jammy May 28 12:44:45 l75lg1-v1 nova-compute[83654]: ubuntu May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-i440fx-impish-hpb May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-q35-5.2 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-i440fx-2.12 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-i440fx-2.0 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-i440fx-xenial May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-i440fx-6.2 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-q35-4.2 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-i440fx-2.5 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-i440fx-4.2 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-i440fx-focal May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-i440fx-hirsute May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-q35-xenial May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-i440fx-jammy-hpb May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-i440fx-5.2 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-i440fx-1.5 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-q35-2.7 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-q35-eoan-hpb May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-i440fx-zesty May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-i440fx-disco-hpb May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-q35-groovy May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-i440fx-groovy May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-q35-artful May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-i440fx-2.2 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-i440fx-trusty May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-i440fx-eoan-hpb May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-q35-focal-hpb May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-q35-jammy-maxcpus May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-q35-bionic-hpb May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-i440fx-artful May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-i440fx-2.7 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-q35-6.1 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-i440fx-jammy-maxcpus May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-i440fx-yakkety May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-q35-2.4 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-q35-cosmic-hpb May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-q35-2.10 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: x-remote May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-i440fx-1.7 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-q35-5.1 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-q35-2.9 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-i440fx-2.11 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-i440fx-jammy-hpb-maxcpus May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-q35-3.1 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-i440fx-6.1 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-q35-4.1 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-q35-jammy May 28 12:44:45 l75lg1-v1 nova-compute[83654]: ubuntu-q35 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-i440fx-2.4 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-i440fx-4.1 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-q35-eoan May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-q35-jammy-hpb May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-i440fx-5.1 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-i440fx-2.9 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-i440fx-bionic-hpb May 28 12:44:45 l75lg1-v1 nova-compute[83654]: isapc May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-i440fx-1.4 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-q35-cosmic May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-q35-2.6 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-i440fx-3.1 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-q35-bionic May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-q35-disco-hpb May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-i440fx-cosmic May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-q35-2.12 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-i440fx-bionic May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-q35-groovy-hpb May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-q35-disco May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-i440fx-cosmic-hpb May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-i440fx-2.1 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-i440fx-wily May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-q35-impish May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-q35-6.0 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-i440fx-impish May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-i440fx-2.6 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-q35-impish-hpb May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-q35-hirsute May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-q35-4.0.1 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-q35-hirsute-hpb May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-i440fx-1.6 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-q35-5.0 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-q35-2.8 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-i440fx-2.10 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-q35-3.0 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-i440fx-6.0 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-q35-zesty May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-q35-4.0 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-q35-focal May 28 12:44:45 l75lg1-v1 nova-compute[83654]: microvm May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-i440fx-2.3 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-q35-jammy-hpb-maxcpus May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-i440fx-focal-hpb May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-i440fx-disco May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-i440fx-4.0 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-i440fx-groovy-hpb May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-i440fx-hirsute-hpb May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-i440fx-5.0 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-i440fx-2.8 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-q35-6.2 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: q35 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-i440fx-eoan May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-q35-2.5 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-i440fx-3.0 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-q35-yakkety May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-q35-2.11 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: hvm May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: 32 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/bin/qemu-system-m68k May 28 12:44:45 l75lg1-v1 nova-compute[83654]: mcf5208evb May 28 12:44:45 l75lg1-v1 nova-compute[83654]: an5206 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virt-6.0 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: q800 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virt-6.2 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virt May 28 12:44:45 l75lg1-v1 nova-compute[83654]: next-cube May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virt-6.1 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: hvm May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: 32 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/bin/qemu-system-microblaze May 28 12:44:45 l75lg1-v1 nova-compute[83654]: petalogix-s3adsp1800 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: petalogix-ml605 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: xlnx-zynqmp-pmu May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: hvm May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: 32 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/bin/qemu-system-microblazeel May 28 12:44:45 l75lg1-v1 nova-compute[83654]: petalogix-s3adsp1800 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: petalogix-ml605 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: xlnx-zynqmp-pmu May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: hvm May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: 32 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/bin/qemu-system-mips May 28 12:44:45 l75lg1-v1 nova-compute[83654]: malta May 28 12:44:45 l75lg1-v1 nova-compute[83654]: mipssim May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: hvm May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: 32 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/bin/qemu-system-mipsel May 28 12:44:45 l75lg1-v1 nova-compute[83654]: malta May 28 12:44:45 l75lg1-v1 nova-compute[83654]: mipssim May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: hvm May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: 64 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/bin/qemu-system-mips64 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: malta May 28 12:44:45 l75lg1-v1 nova-compute[83654]: mipssim May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pica61 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: magnum May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: hvm May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: 64 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/bin/qemu-system-mips64el May 28 12:44:45 l75lg1-v1 nova-compute[83654]: malta May 28 12:44:45 l75lg1-v1 nova-compute[83654]: loongson3-virt May 28 12:44:45 l75lg1-v1 nova-compute[83654]: mipssim May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pica61 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: magnum May 28 12:44:45 l75lg1-v1 nova-compute[83654]: boston May 28 12:44:45 l75lg1-v1 nova-compute[83654]: fuloong2e May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: hvm May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: 32 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/bin/qemu-system-ppc May 28 12:44:45 l75lg1-v1 nova-compute[83654]: g3beige May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtex-ml507 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: mac99 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: ppce500 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pegasos2 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: sam460ex May 28 12:44:45 l75lg1-v1 nova-compute[83654]: bamboo May 28 12:44:45 l75lg1-v1 nova-compute[83654]: 40p May 28 12:44:45 l75lg1-v1 nova-compute[83654]: ref405ep May 28 12:44:45 l75lg1-v1 nova-compute[83654]: mpc8544ds May 28 12:44:45 l75lg1-v1 nova-compute[83654]: taihu May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: hvm May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: 64 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/bin/qemu-system-ppc64 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pseries-jammy May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pseries May 28 12:44:45 l75lg1-v1 nova-compute[83654]: powernv9 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: powernv May 28 12:44:45 l75lg1-v1 nova-compute[83654]: taihu May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pseries-4.1 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: mpc8544ds May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pseries-6.1 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pseries-2.5 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: powernv10 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pseries-xenial May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pseries-4.2 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pseries-6.2 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pseries-yakkety May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pseries-2.6 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: ppce500 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pseries-bionic-sxxm May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pseries-2.7 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pseries-3.0 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pseries-5.0 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: 40p May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pseries-2.8 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pegasos2 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pseries-hirsute May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pseries-3.1 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pseries-5.1 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pseries-eoan May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pseries-2.9 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pseries-zesty May 28 12:44:45 l75lg1-v1 nova-compute[83654]: bamboo May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pseries-groovy May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pseries-focal May 28 12:44:45 l75lg1-v1 nova-compute[83654]: g3beige May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pseries-5.2 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pseries-disco May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pseries-2.12-sxxm May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pseries-2.10 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtex-ml507 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pseries-2.11 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pseries-2.1 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pseries-cosmic May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pseries-bionic May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pseries-2.12 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pseries-2.2 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: mac99 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pseries-impish May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pseries-artful May 28 12:44:45 l75lg1-v1 nova-compute[83654]: sam460ex May 28 12:44:45 l75lg1-v1 nova-compute[83654]: ref405ep May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pseries-2.3 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: powernv8 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pseries-4.0 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pseries-6.0 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pseries-2.4 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: hvm May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: 64 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/bin/qemu-system-ppc64le May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pseries-jammy May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pseries May 28 12:44:45 l75lg1-v1 nova-compute[83654]: powernv9 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: powernv May 28 12:44:45 l75lg1-v1 nova-compute[83654]: taihu May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pseries-4.1 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: mpc8544ds May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pseries-6.1 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pseries-2.5 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: powernv10 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pseries-xenial May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pseries-4.2 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pseries-6.2 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pseries-yakkety May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pseries-2.6 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: ppce500 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pseries-bionic-sxxm May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pseries-2.7 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pseries-3.0 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pseries-5.0 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: 40p May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pseries-2.8 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pegasos2 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pseries-hirsute May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pseries-3.1 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pseries-5.1 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pseries-eoan May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pseries-2.9 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pseries-zesty May 28 12:44:45 l75lg1-v1 nova-compute[83654]: bamboo May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pseries-groovy May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pseries-focal May 28 12:44:45 l75lg1-v1 nova-compute[83654]: g3beige May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pseries-5.2 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pseries-disco May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pseries-2.12-sxxm May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pseries-2.10 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtex-ml507 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pseries-2.11 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pseries-2.1 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pseries-cosmic May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pseries-bionic May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pseries-2.12 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pseries-2.2 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: mac99 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pseries-impish May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pseries-artful May 28 12:44:45 l75lg1-v1 nova-compute[83654]: sam460ex May 28 12:44:45 l75lg1-v1 nova-compute[83654]: ref405ep May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pseries-2.3 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: powernv8 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pseries-4.0 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pseries-6.0 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pseries-2.4 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: hvm May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: 32 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/bin/qemu-system-riscv32 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: spike May 28 12:44:45 l75lg1-v1 nova-compute[83654]: opentitan May 28 12:44:45 l75lg1-v1 nova-compute[83654]: sifive_u May 28 12:44:45 l75lg1-v1 nova-compute[83654]: sifive_e May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virt May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: hvm May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: 64 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/bin/qemu-system-riscv64 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: spike May 28 12:44:45 l75lg1-v1 nova-compute[83654]: microchip-icicle-kit May 28 12:44:45 l75lg1-v1 nova-compute[83654]: sifive_u May 28 12:44:45 l75lg1-v1 nova-compute[83654]: shakti_c May 28 12:44:45 l75lg1-v1 nova-compute[83654]: sifive_e May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virt May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: hvm May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: 64 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/bin/qemu-system-s390x May 28 12:44:45 l75lg1-v1 nova-compute[83654]: s390-ccw-virtio-jammy May 28 12:44:45 l75lg1-v1 nova-compute[83654]: s390-ccw-virtio May 28 12:44:45 l75lg1-v1 nova-compute[83654]: s390-ccw-virtio-4.0 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: s390-ccw-virtio-5.2 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: s390-ccw-virtio-artful May 28 12:44:45 l75lg1-v1 nova-compute[83654]: s390-ccw-virtio-3.1 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: s390-ccw-virtio-groovy May 28 12:44:45 l75lg1-v1 nova-compute[83654]: s390-ccw-virtio-hirsute May 28 12:44:45 l75lg1-v1 nova-compute[83654]: s390-ccw-virtio-disco May 28 12:44:45 l75lg1-v1 nova-compute[83654]: s390-ccw-virtio-2.12 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: s390-ccw-virtio-2.6 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: s390-ccw-virtio-yakkety May 28 12:44:45 l75lg1-v1 nova-compute[83654]: s390-ccw-virtio-eoan May 28 12:44:45 l75lg1-v1 nova-compute[83654]: s390-ccw-virtio-2.9 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: s390-ccw-virtio-6.0 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: s390-ccw-virtio-5.1 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: s390-ccw-virtio-3.0 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: s390-ccw-virtio-4.2 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: s390-ccw-virtio-2.5 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: s390-ccw-virtio-2.11 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: s390-ccw-virtio-xenial May 28 12:44:45 l75lg1-v1 nova-compute[83654]: s390-ccw-virtio-focal May 28 12:44:45 l75lg1-v1 nova-compute[83654]: s390-ccw-virtio-2.8 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: s390-ccw-virtio-impish May 28 12:44:45 l75lg1-v1 nova-compute[83654]: s390-ccw-virtio-bionic May 28 12:44:45 l75lg1-v1 nova-compute[83654]: s390-ccw-virtio-5.0 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: s390-ccw-virtio-6.2 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: s390-ccw-virtio-zesty May 28 12:44:45 l75lg1-v1 nova-compute[83654]: s390-ccw-virtio-4.1 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: s390-ccw-virtio-cosmic May 28 12:44:45 l75lg1-v1 nova-compute[83654]: s390-ccw-virtio-2.4 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: s390-ccw-virtio-2.10 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: s390-ccw-virtio-2.7 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: s390-ccw-virtio-6.1 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: hvm May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: 32 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/bin/qemu-system-sh4 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: shix May 28 12:44:45 l75lg1-v1 nova-compute[83654]: r2d May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: hvm May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: 64 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/bin/qemu-system-sh4eb May 28 12:44:45 l75lg1-v1 nova-compute[83654]: shix May 28 12:44:45 l75lg1-v1 nova-compute[83654]: r2d May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: hvm May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: 32 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/bin/qemu-system-sparc May 28 12:44:45 l75lg1-v1 nova-compute[83654]: SS-5 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: SS-20 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: LX May 28 12:44:45 l75lg1-v1 nova-compute[83654]: SPARCClassic May 28 12:44:45 l75lg1-v1 nova-compute[83654]: leon3_generic May 28 12:44:45 l75lg1-v1 nova-compute[83654]: SPARCbook May 28 12:44:45 l75lg1-v1 nova-compute[83654]: SS-4 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: SS-600MP May 28 12:44:45 l75lg1-v1 nova-compute[83654]: SS-10 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Voyager May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: hvm May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: 64 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/bin/qemu-system-sparc64 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: sun4u May 28 12:44:45 l75lg1-v1 nova-compute[83654]: niagara May 28 12:44:45 l75lg1-v1 nova-compute[83654]: sun4v May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: hvm May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: 64 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/bin/qemu-system-x86_64 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-i440fx-jammy May 28 12:44:45 l75lg1-v1 nova-compute[83654]: ubuntu May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-i440fx-impish-hpb May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-q35-5.2 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-i440fx-2.12 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-i440fx-2.0 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-i440fx-xenial May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-i440fx-6.2 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-q35-4.2 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-i440fx-2.5 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-i440fx-4.2 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-i440fx-hirsute May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-i440fx-focal May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-q35-xenial May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-i440fx-jammy-hpb May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-i440fx-5.2 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-i440fx-1.5 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-q35-2.7 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-q35-eoan-hpb May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-i440fx-zesty May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-i440fx-disco-hpb May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-q35-groovy May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-i440fx-groovy May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-q35-artful May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-i440fx-trusty May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-i440fx-2.2 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-q35-focal-hpb May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-i440fx-eoan-hpb May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-q35-jammy-maxcpus May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-i440fx-artful May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-q35-bionic-hpb May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-i440fx-2.7 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-q35-6.1 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-i440fx-jammy-maxcpus May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-i440fx-yakkety May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-q35-2.4 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-q35-cosmic-hpb May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-q35-2.10 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: x-remote May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-q35-5.1 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-i440fx-1.7 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-q35-2.9 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-i440fx-2.11 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-i440fx-jammy-hpb-maxcpus May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-q35-3.1 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-i440fx-6.1 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-q35-4.1 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-q35-jammy May 28 12:44:45 l75lg1-v1 nova-compute[83654]: ubuntu-q35 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-i440fx-2.4 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-i440fx-4.1 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-q35-eoan May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-q35-jammy-hpb May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-i440fx-5.1 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-i440fx-2.9 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-i440fx-bionic-hpb May 28 12:44:45 l75lg1-v1 nova-compute[83654]: isapc May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-i440fx-1.4 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-q35-cosmic May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-q35-2.6 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-i440fx-3.1 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-q35-bionic May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-q35-disco-hpb May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-i440fx-cosmic May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-q35-2.12 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-i440fx-bionic May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-q35-groovy-hpb May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-q35-disco May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-i440fx-cosmic-hpb May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-i440fx-2.1 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-i440fx-wily May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-q35-impish May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-i440fx-2.6 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-q35-6.0 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-i440fx-impish May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-q35-impish-hpb May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-q35-hirsute May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-q35-4.0.1 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-q35-hirsute-hpb May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-i440fx-1.6 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-q35-5.0 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-q35-2.8 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-i440fx-2.10 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-q35-3.0 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-q35-zesty May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-q35-4.0 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-q35-focal May 28 12:44:45 l75lg1-v1 nova-compute[83654]: microvm May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-i440fx-6.0 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-i440fx-2.3 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-q35-jammy-hpb-maxcpus May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-i440fx-disco May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-i440fx-focal-hpb May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-i440fx-4.0 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-i440fx-groovy-hpb May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-i440fx-hirsute-hpb May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-i440fx-5.0 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-i440fx-2.8 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-q35-6.2 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: q35 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-i440fx-eoan May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-q35-2.5 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-i440fx-3.0 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-q35-yakkety May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-q35-2.11 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: hvm May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: 32 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/bin/qemu-system-xtensa May 28 12:44:45 l75lg1-v1 nova-compute[83654]: sim May 28 12:44:45 l75lg1-v1 nova-compute[83654]: kc705 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: ml605 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: ml605-nommu May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virt May 28 12:44:45 l75lg1-v1 nova-compute[83654]: lx60-nommu May 28 12:44:45 l75lg1-v1 nova-compute[83654]: lx200 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: lx200-nommu May 28 12:44:45 l75lg1-v1 nova-compute[83654]: lx60 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: kc705-nommu May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: hvm May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: 32 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/bin/qemu-system-xtensaeb May 28 12:44:45 l75lg1-v1 nova-compute[83654]: sim May 28 12:44:45 l75lg1-v1 nova-compute[83654]: kc705 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: ml605 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: ml605-nommu May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virt May 28 12:44:45 l75lg1-v1 nova-compute[83654]: lx60-nommu May 28 12:44:45 l75lg1-v1 nova-compute[83654]: lx200 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: lx200-nommu May 28 12:44:45 l75lg1-v1 nova-compute[83654]: lx60 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: kc705-nommu May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: DEBUG nova.virt.libvirt.host [None req-d5e2622c-e52e-4f3d-871c-2ddda502f287 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=83654) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}} May 28 12:44:45 l75lg1-v1 nova-compute[83654]: DEBUG nova.virt.libvirt.host [None req-d5e2622c-e52e-4f3d-871c-2ddda502f287 None None] Libvirt host hypervisor capabilities for arch=alpha and machine_type=None: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/bin/qemu-system-alpha May 28 12:44:45 l75lg1-v1 nova-compute[83654]: qemu May 28 12:44:45 l75lg1-v1 nova-compute[83654]: clipper May 28 12:44:45 l75lg1-v1 nova-compute[83654]: alpha May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/share/OVMF/OVMF_CODE.fd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/share/OVMF/OVMF_CODE.secboot.fd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/share/AAVMF/AAVMF_CODE.fd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/share/AAVMF/AAVMF32_CODE.fd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/share/OVMF/OVMF_CODE.ms.fd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: rom May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pflash May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: yes May 28 12:44:45 l75lg1-v1 nova-compute[83654]: no May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: no May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: file May 28 12:44:45 l75lg1-v1 nova-compute[83654]: anonymous May 28 12:44:45 l75lg1-v1 nova-compute[83654]: memfd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: disk May 28 12:44:45 l75lg1-v1 nova-compute[83654]: cdrom May 28 12:44:45 l75lg1-v1 nova-compute[83654]: floppy May 28 12:44:45 l75lg1-v1 nova-compute[83654]: lun May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: fdc May 28 12:44:45 l75lg1-v1 nova-compute[83654]: scsi May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio May 28 12:44:45 l75lg1-v1 nova-compute[83654]: usb May 28 12:44:45 l75lg1-v1 nova-compute[83654]: sata May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio-transitional May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio-non-transitional May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: sdl May 28 12:44:45 l75lg1-v1 nova-compute[83654]: vnc May 28 12:44:45 l75lg1-v1 nova-compute[83654]: spice May 28 12:44:45 l75lg1-v1 nova-compute[83654]: egl-headless May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: subsystem May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: default May 28 12:44:45 l75lg1-v1 nova-compute[83654]: mandatory May 28 12:44:45 l75lg1-v1 nova-compute[83654]: requisite May 28 12:44:45 l75lg1-v1 nova-compute[83654]: optional May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: usb May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pci May 28 12:44:45 l75lg1-v1 nova-compute[83654]: scsi May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio-transitional May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio-non-transitional May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: random May 28 12:44:45 l75lg1-v1 nova-compute[83654]: egd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: builtin May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: path May 28 12:44:45 l75lg1-v1 nova-compute[83654]: handle May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtiofs May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: {{(pid=83654) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}} May 28 12:44:45 l75lg1-v1 nova-compute[83654]: DEBUG nova.virt.libvirt.host [None req-d5e2622c-e52e-4f3d-871c-2ddda502f287 None None] Getting domain capabilities for armv6l via machine types: {None, 'virt'} {{(pid=83654) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}} May 28 12:44:45 l75lg1-v1 nova-compute[83654]: DEBUG nova.virt.libvirt.host [None req-d5e2622c-e52e-4f3d-871c-2ddda502f287 None None] Libvirt host hypervisor capabilities for arch=armv6l and machine_type=None: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/bin/qemu-system-arm May 28 12:44:45 l75lg1-v1 nova-compute[83654]: qemu May 28 12:44:45 l75lg1-v1 nova-compute[83654]: integratorcp May 28 12:44:45 l75lg1-v1 nova-compute[83654]: armv6l May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/share/OVMF/OVMF_CODE.fd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/share/OVMF/OVMF_CODE.secboot.fd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/share/AAVMF/AAVMF_CODE.fd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/share/AAVMF/AAVMF32_CODE.fd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/share/OVMF/OVMF_CODE.ms.fd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: rom May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pflash May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: yes May 28 12:44:45 l75lg1-v1 nova-compute[83654]: no May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: no May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: on May 28 12:44:45 l75lg1-v1 nova-compute[83654]: off May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pxa270-c0 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: cortex-a15 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pxa270-b0 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: cortex-m4 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pxa270-a0 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: arm1176 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pxa270-b1 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: cortex-a7 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pxa270-a1 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: cortex-a8 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: cortex-r5 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: ti925t May 28 12:44:45 l75lg1-v1 nova-compute[83654]: cortex-r5f May 28 12:44:45 l75lg1-v1 nova-compute[83654]: arm1026 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: cortex-a9 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: cortex-m7 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pxa270 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pxa260 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pxa250 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pxa270-c5 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pxa261 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pxa262 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: sa1110 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: sa1100 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: max May 28 12:44:45 l75lg1-v1 nova-compute[83654]: cortex-m0 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: cortex-m33 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: arm946 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pxa255 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: arm11mpcore May 28 12:44:45 l75lg1-v1 nova-compute[83654]: cortex-m55 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: arm926 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: arm1136 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: arm1136-r2 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: cortex-m3 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: file May 28 12:44:45 l75lg1-v1 nova-compute[83654]: anonymous May 28 12:44:45 l75lg1-v1 nova-compute[83654]: memfd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: disk May 28 12:44:45 l75lg1-v1 nova-compute[83654]: cdrom May 28 12:44:45 l75lg1-v1 nova-compute[83654]: floppy May 28 12:44:45 l75lg1-v1 nova-compute[83654]: lun May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: fdc May 28 12:44:45 l75lg1-v1 nova-compute[83654]: scsi May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio May 28 12:44:45 l75lg1-v1 nova-compute[83654]: usb May 28 12:44:45 l75lg1-v1 nova-compute[83654]: sata May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio-transitional May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio-non-transitional May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: sdl May 28 12:44:45 l75lg1-v1 nova-compute[83654]: vnc May 28 12:44:45 l75lg1-v1 nova-compute[83654]: spice May 28 12:44:45 l75lg1-v1 nova-compute[83654]: egl-headless May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: subsystem May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: default May 28 12:44:45 l75lg1-v1 nova-compute[83654]: mandatory May 28 12:44:45 l75lg1-v1 nova-compute[83654]: requisite May 28 12:44:45 l75lg1-v1 nova-compute[83654]: optional May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: usb May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pci May 28 12:44:45 l75lg1-v1 nova-compute[83654]: scsi May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio-transitional May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio-non-transitional May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: random May 28 12:44:45 l75lg1-v1 nova-compute[83654]: egd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: builtin May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: path May 28 12:44:45 l75lg1-v1 nova-compute[83654]: handle May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtiofs May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: tpm-tis May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: passthrough May 28 12:44:45 l75lg1-v1 nova-compute[83654]: emulator May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: {{(pid=83654) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}} May 28 12:44:45 l75lg1-v1 nova-compute[83654]: DEBUG nova.virt.libvirt.host [None req-d5e2622c-e52e-4f3d-871c-2ddda502f287 None None] Libvirt host hypervisor capabilities for arch=armv6l and machine_type=virt: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/bin/qemu-system-arm May 28 12:44:45 l75lg1-v1 nova-compute[83654]: qemu May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virt-6.2 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: armv6l May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/share/OVMF/OVMF_CODE.fd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/share/OVMF/OVMF_CODE.secboot.fd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/share/AAVMF/AAVMF_CODE.fd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/share/AAVMF/AAVMF32_CODE.fd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/share/OVMF/OVMF_CODE.ms.fd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: rom May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pflash May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: yes May 28 12:44:45 l75lg1-v1 nova-compute[83654]: no May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: no May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: on May 28 12:44:45 l75lg1-v1 nova-compute[83654]: off May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pxa270-c0 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: cortex-a15 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pxa270-b0 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: cortex-m4 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pxa270-a0 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: arm1176 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pxa270-b1 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: cortex-a7 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pxa270-a1 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: cortex-a8 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: cortex-r5 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: ti925t May 28 12:44:45 l75lg1-v1 nova-compute[83654]: cortex-r5f May 28 12:44:45 l75lg1-v1 nova-compute[83654]: arm1026 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: cortex-a9 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: cortex-m7 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pxa270 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pxa260 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pxa250 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pxa270-c5 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pxa261 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pxa262 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: sa1110 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: sa1100 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: max May 28 12:44:45 l75lg1-v1 nova-compute[83654]: cortex-m0 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: cortex-m33 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: arm946 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pxa255 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: arm11mpcore May 28 12:44:45 l75lg1-v1 nova-compute[83654]: cortex-m55 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: arm926 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: arm1136 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: arm1136-r2 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: cortex-m3 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: file May 28 12:44:45 l75lg1-v1 nova-compute[83654]: anonymous May 28 12:44:45 l75lg1-v1 nova-compute[83654]: memfd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: disk May 28 12:44:45 l75lg1-v1 nova-compute[83654]: cdrom May 28 12:44:45 l75lg1-v1 nova-compute[83654]: floppy May 28 12:44:45 l75lg1-v1 nova-compute[83654]: lun May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: fdc May 28 12:44:45 l75lg1-v1 nova-compute[83654]: scsi May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio May 28 12:44:45 l75lg1-v1 nova-compute[83654]: usb May 28 12:44:45 l75lg1-v1 nova-compute[83654]: sata May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio-transitional May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio-non-transitional May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: sdl May 28 12:44:45 l75lg1-v1 nova-compute[83654]: vnc May 28 12:44:45 l75lg1-v1 nova-compute[83654]: spice May 28 12:44:45 l75lg1-v1 nova-compute[83654]: egl-headless May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: subsystem May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: default May 28 12:44:45 l75lg1-v1 nova-compute[83654]: mandatory May 28 12:44:45 l75lg1-v1 nova-compute[83654]: requisite May 28 12:44:45 l75lg1-v1 nova-compute[83654]: optional May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: usb May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pci May 28 12:44:45 l75lg1-v1 nova-compute[83654]: scsi May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio-transitional May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio-non-transitional May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: random May 28 12:44:45 l75lg1-v1 nova-compute[83654]: egd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: builtin May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: path May 28 12:44:45 l75lg1-v1 nova-compute[83654]: handle May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtiofs May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: tpm-tis May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: passthrough May 28 12:44:45 l75lg1-v1 nova-compute[83654]: emulator May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: 2 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: 3 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: {{(pid=83654) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}} May 28 12:44:45 l75lg1-v1 nova-compute[83654]: DEBUG nova.virt.libvirt.host [None req-d5e2622c-e52e-4f3d-871c-2ddda502f287 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=83654) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}} May 28 12:44:45 l75lg1-v1 nova-compute[83654]: DEBUG nova.virt.libvirt.host [None req-d5e2622c-e52e-4f3d-871c-2ddda502f287 None None] Libvirt host hypervisor capabilities for arch=armv7l and machine_type=virt: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/bin/qemu-system-arm May 28 12:44:45 l75lg1-v1 nova-compute[83654]: qemu May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virt-6.2 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: armv7l May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: efi May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/share/AAVMF/AAVMF32_CODE.fd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: rom May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pflash May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: yes May 28 12:44:45 l75lg1-v1 nova-compute[83654]: no May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: no May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: on May 28 12:44:45 l75lg1-v1 nova-compute[83654]: off May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pxa270-c0 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: cortex-a15 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pxa270-b0 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: cortex-m4 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pxa270-a0 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: arm1176 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pxa270-b1 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: cortex-a7 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pxa270-a1 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: cortex-a8 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: cortex-r5 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: ti925t May 28 12:44:45 l75lg1-v1 nova-compute[83654]: cortex-r5f May 28 12:44:45 l75lg1-v1 nova-compute[83654]: arm1026 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: cortex-a9 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: cortex-m7 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pxa270 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pxa260 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pxa250 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pxa270-c5 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pxa261 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pxa262 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: sa1110 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: sa1100 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: max May 28 12:44:45 l75lg1-v1 nova-compute[83654]: cortex-m0 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: cortex-m33 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: arm946 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pxa255 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: arm11mpcore May 28 12:44:45 l75lg1-v1 nova-compute[83654]: cortex-m55 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: arm926 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: arm1136 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: arm1136-r2 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: cortex-m3 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: file May 28 12:44:45 l75lg1-v1 nova-compute[83654]: anonymous May 28 12:44:45 l75lg1-v1 nova-compute[83654]: memfd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: disk May 28 12:44:45 l75lg1-v1 nova-compute[83654]: cdrom May 28 12:44:45 l75lg1-v1 nova-compute[83654]: floppy May 28 12:44:45 l75lg1-v1 nova-compute[83654]: lun May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: fdc May 28 12:44:45 l75lg1-v1 nova-compute[83654]: scsi May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio May 28 12:44:45 l75lg1-v1 nova-compute[83654]: usb May 28 12:44:45 l75lg1-v1 nova-compute[83654]: sata May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio-transitional May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio-non-transitional May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: sdl May 28 12:44:45 l75lg1-v1 nova-compute[83654]: vnc May 28 12:44:45 l75lg1-v1 nova-compute[83654]: spice May 28 12:44:45 l75lg1-v1 nova-compute[83654]: egl-headless May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: subsystem May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: default May 28 12:44:45 l75lg1-v1 nova-compute[83654]: mandatory May 28 12:44:45 l75lg1-v1 nova-compute[83654]: requisite May 28 12:44:45 l75lg1-v1 nova-compute[83654]: optional May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: usb May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pci May 28 12:44:45 l75lg1-v1 nova-compute[83654]: scsi May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio-transitional May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio-non-transitional May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: random May 28 12:44:45 l75lg1-v1 nova-compute[83654]: egd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: builtin May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: path May 28 12:44:45 l75lg1-v1 nova-compute[83654]: handle May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtiofs May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: tpm-tis May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: passthrough May 28 12:44:45 l75lg1-v1 nova-compute[83654]: emulator May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: 2 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: 3 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: {{(pid=83654) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}} May 28 12:44:45 l75lg1-v1 nova-compute[83654]: DEBUG nova.virt.libvirt.host [None req-d5e2622c-e52e-4f3d-871c-2ddda502f287 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=83654) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}} May 28 12:44:45 l75lg1-v1 nova-compute[83654]: DEBUG nova.virt.libvirt.host [None req-d5e2622c-e52e-4f3d-871c-2ddda502f287 None None] Libvirt host hypervisor capabilities for arch=aarch64 and machine_type=virt: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/bin/qemu-system-aarch64 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: qemu May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virt-6.2 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: aarch64 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: efi May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/share/AAVMF/AAVMF_CODE.ms.fd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/share/AAVMF/AAVMF_CODE.fd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: rom May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pflash May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: yes May 28 12:44:45 l75lg1-v1 nova-compute[83654]: no May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: no May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: on May 28 12:44:45 l75lg1-v1 nova-compute[83654]: off May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pxa270-c0 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: cortex-a15 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pxa270-b0 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: cortex-a57 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: cortex-m4 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pxa270-a0 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: arm1176 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pxa270-b1 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: cortex-a7 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pxa270-a1 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: a64fx May 28 12:44:45 l75lg1-v1 nova-compute[83654]: cortex-a8 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: cortex-r5 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: ti925t May 28 12:44:45 l75lg1-v1 nova-compute[83654]: cortex-r5f May 28 12:44:45 l75lg1-v1 nova-compute[83654]: arm1026 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: cortex-a9 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: cortex-m7 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pxa270 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pxa260 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pxa250 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pxa270-c5 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pxa261 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pxa262 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: sa1110 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: sa1100 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: max May 28 12:44:45 l75lg1-v1 nova-compute[83654]: cortex-a53 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: cortex-m0 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: cortex-m33 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: cortex-a72 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: arm946 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pxa255 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: arm11mpcore May 28 12:44:45 l75lg1-v1 nova-compute[83654]: cortex-m55 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: arm926 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: arm1136 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: arm1136-r2 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: cortex-m3 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: file May 28 12:44:45 l75lg1-v1 nova-compute[83654]: anonymous May 28 12:44:45 l75lg1-v1 nova-compute[83654]: memfd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: disk May 28 12:44:45 l75lg1-v1 nova-compute[83654]: cdrom May 28 12:44:45 l75lg1-v1 nova-compute[83654]: floppy May 28 12:44:45 l75lg1-v1 nova-compute[83654]: lun May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: fdc May 28 12:44:45 l75lg1-v1 nova-compute[83654]: scsi May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio May 28 12:44:45 l75lg1-v1 nova-compute[83654]: usb May 28 12:44:45 l75lg1-v1 nova-compute[83654]: sata May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio-transitional May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio-non-transitional May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: sdl May 28 12:44:45 l75lg1-v1 nova-compute[83654]: vnc May 28 12:44:45 l75lg1-v1 nova-compute[83654]: spice May 28 12:44:45 l75lg1-v1 nova-compute[83654]: egl-headless May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: subsystem May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: default May 28 12:44:45 l75lg1-v1 nova-compute[83654]: mandatory May 28 12:44:45 l75lg1-v1 nova-compute[83654]: requisite May 28 12:44:45 l75lg1-v1 nova-compute[83654]: optional May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: usb May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pci May 28 12:44:45 l75lg1-v1 nova-compute[83654]: scsi May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio-transitional May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio-non-transitional May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: random May 28 12:44:45 l75lg1-v1 nova-compute[83654]: egd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: builtin May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: path May 28 12:44:45 l75lg1-v1 nova-compute[83654]: handle May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtiofs May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: tpm-tis May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: passthrough May 28 12:44:45 l75lg1-v1 nova-compute[83654]: emulator May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: 2 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: 3 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: {{(pid=83654) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}} May 28 12:44:45 l75lg1-v1 nova-compute[83654]: DEBUG nova.virt.libvirt.host [None req-d5e2622c-e52e-4f3d-871c-2ddda502f287 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=83654) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}} May 28 12:44:45 l75lg1-v1 nova-compute[83654]: DEBUG nova.virt.libvirt.host [None req-d5e2622c-e52e-4f3d-871c-2ddda502f287 None None] Libvirt host hypervisor capabilities for arch=cris and machine_type=None: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/bin/qemu-system-cris May 28 12:44:45 l75lg1-v1 nova-compute[83654]: qemu May 28 12:44:45 l75lg1-v1 nova-compute[83654]: axis-dev88 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: cris May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/share/OVMF/OVMF_CODE.fd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/share/OVMF/OVMF_CODE.secboot.fd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/share/AAVMF/AAVMF_CODE.fd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/share/AAVMF/AAVMF32_CODE.fd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/share/OVMF/OVMF_CODE.ms.fd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: rom May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pflash May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: yes May 28 12:44:45 l75lg1-v1 nova-compute[83654]: no May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: no May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: file May 28 12:44:45 l75lg1-v1 nova-compute[83654]: anonymous May 28 12:44:45 l75lg1-v1 nova-compute[83654]: memfd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: disk May 28 12:44:45 l75lg1-v1 nova-compute[83654]: cdrom May 28 12:44:45 l75lg1-v1 nova-compute[83654]: floppy May 28 12:44:45 l75lg1-v1 nova-compute[83654]: lun May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: fdc May 28 12:44:45 l75lg1-v1 nova-compute[83654]: scsi May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: sdl May 28 12:44:45 l75lg1-v1 nova-compute[83654]: vnc May 28 12:44:45 l75lg1-v1 nova-compute[83654]: spice May 28 12:44:45 l75lg1-v1 nova-compute[83654]: egl-headless May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: subsystem May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: default May 28 12:44:45 l75lg1-v1 nova-compute[83654]: mandatory May 28 12:44:45 l75lg1-v1 nova-compute[83654]: requisite May 28 12:44:45 l75lg1-v1 nova-compute[83654]: optional May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pci May 28 12:44:45 l75lg1-v1 nova-compute[83654]: scsi May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: random May 28 12:44:45 l75lg1-v1 nova-compute[83654]: egd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: builtin May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: path May 28 12:44:45 l75lg1-v1 nova-compute[83654]: handle May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: {{(pid=83654) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}} May 28 12:44:45 l75lg1-v1 nova-compute[83654]: DEBUG nova.virt.libvirt.host [None req-d5e2622c-e52e-4f3d-871c-2ddda502f287 None None] Getting domain capabilities for i686 via machine types: {'ubuntu-q35', 'q35', 'ubuntu', 'pc'} {{(pid=83654) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}} May 28 12:44:45 l75lg1-v1 nova-compute[83654]: DEBUG nova.virt.libvirt.host [None req-d5e2622c-e52e-4f3d-871c-2ddda502f287 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/bin/qemu-system-i386 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: qemu May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-q35-jammy May 28 12:44:45 l75lg1-v1 nova-compute[83654]: i686 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/share/OVMF/OVMF_CODE.fd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/share/OVMF/OVMF_CODE.secboot.fd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/share/AAVMF/AAVMF_CODE.fd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/share/AAVMF/AAVMF32_CODE.fd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/share/OVMF/OVMF_CODE.ms.fd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: rom May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pflash May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: yes May 28 12:44:45 l75lg1-v1 nova-compute[83654]: no May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: no May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: on May 28 12:44:45 l75lg1-v1 nova-compute[83654]: off May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: EPYC May 28 12:44:45 l75lg1-v1 nova-compute[83654]: AMD May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: qemu64 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: qemu32 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: phenom May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pentium3 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pentium2 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pentium May 28 12:44:45 l75lg1-v1 nova-compute[83654]: n270 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: kvm64 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: kvm32 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: coreduo May 28 12:44:45 l75lg1-v1 nova-compute[83654]: core2duo May 28 12:44:45 l75lg1-v1 nova-compute[83654]: athlon May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Westmere-IBRS May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Westmere May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Snowridge May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Skylake-Server-noTSX-IBRS May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Skylake-Server-IBRS May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Skylake-Server May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Skylake-Client-noTSX-IBRS May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Skylake-Client-IBRS May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Skylake-Client May 28 12:44:45 l75lg1-v1 nova-compute[83654]: SandyBridge-IBRS May 28 12:44:45 l75lg1-v1 nova-compute[83654]: SandyBridge May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Penryn May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Opteron_G5 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Opteron_G4 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Opteron_G3 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Opteron_G2 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Opteron_G1 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Nehalem-IBRS May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Nehalem May 28 12:44:45 l75lg1-v1 nova-compute[83654]: IvyBridge-IBRS May 28 12:44:45 l75lg1-v1 nova-compute[83654]: IvyBridge May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Icelake-Server-noTSX May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Icelake-Server May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Icelake-Client-noTSX May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Icelake-Client May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Haswell-noTSX-IBRS May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Haswell-noTSX May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Haswell-IBRS May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Haswell May 28 12:44:45 l75lg1-v1 nova-compute[83654]: EPYC-Rome May 28 12:44:45 l75lg1-v1 nova-compute[83654]: EPYC-Milan May 28 12:44:45 l75lg1-v1 nova-compute[83654]: EPYC-IBPB May 28 12:44:45 l75lg1-v1 nova-compute[83654]: EPYC May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Dhyana May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Cooperlake May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Conroe May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Cascadelake-Server-noTSX May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Cascadelake-Server May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Broadwell-noTSX-IBRS May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Broadwell-noTSX May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Broadwell-IBRS May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Broadwell May 28 12:44:45 l75lg1-v1 nova-compute[83654]: 486 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: file May 28 12:44:45 l75lg1-v1 nova-compute[83654]: anonymous May 28 12:44:45 l75lg1-v1 nova-compute[83654]: memfd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: disk May 28 12:44:45 l75lg1-v1 nova-compute[83654]: cdrom May 28 12:44:45 l75lg1-v1 nova-compute[83654]: floppy May 28 12:44:45 l75lg1-v1 nova-compute[83654]: lun May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: fdc May 28 12:44:45 l75lg1-v1 nova-compute[83654]: scsi May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio May 28 12:44:45 l75lg1-v1 nova-compute[83654]: usb May 28 12:44:45 l75lg1-v1 nova-compute[83654]: sata May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio-transitional May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio-non-transitional May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: sdl May 28 12:44:45 l75lg1-v1 nova-compute[83654]: vnc May 28 12:44:45 l75lg1-v1 nova-compute[83654]: spice May 28 12:44:45 l75lg1-v1 nova-compute[83654]: egl-headless May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: subsystem May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: default May 28 12:44:45 l75lg1-v1 nova-compute[83654]: mandatory May 28 12:44:45 l75lg1-v1 nova-compute[83654]: requisite May 28 12:44:45 l75lg1-v1 nova-compute[83654]: optional May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: usb May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pci May 28 12:44:45 l75lg1-v1 nova-compute[83654]: scsi May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio-transitional May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio-non-transitional May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: random May 28 12:44:45 l75lg1-v1 nova-compute[83654]: egd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: builtin May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: path May 28 12:44:45 l75lg1-v1 nova-compute[83654]: handle May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtiofs May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: tpm-tis May 28 12:44:45 l75lg1-v1 nova-compute[83654]: tpm-crb May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: passthrough May 28 12:44:45 l75lg1-v1 nova-compute[83654]: emulator May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: {{(pid=83654) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}} May 28 12:44:45 l75lg1-v1 nova-compute[83654]: DEBUG nova.virt.libvirt.host [None req-d5e2622c-e52e-4f3d-871c-2ddda502f287 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/bin/qemu-system-i386 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: qemu May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-q35-6.2 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: i686 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/share/OVMF/OVMF_CODE.fd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/share/OVMF/OVMF_CODE.secboot.fd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/share/AAVMF/AAVMF_CODE.fd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/share/AAVMF/AAVMF32_CODE.fd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/share/OVMF/OVMF_CODE.ms.fd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: rom May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pflash May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: yes May 28 12:44:45 l75lg1-v1 nova-compute[83654]: no May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: no May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: on May 28 12:44:45 l75lg1-v1 nova-compute[83654]: off May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: EPYC May 28 12:44:45 l75lg1-v1 nova-compute[83654]: AMD May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: qemu64 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: qemu32 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: phenom May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pentium3 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pentium2 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pentium May 28 12:44:45 l75lg1-v1 nova-compute[83654]: n270 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: kvm64 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: kvm32 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: coreduo May 28 12:44:45 l75lg1-v1 nova-compute[83654]: core2duo May 28 12:44:45 l75lg1-v1 nova-compute[83654]: athlon May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Westmere-IBRS May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Westmere May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Snowridge May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Skylake-Server-noTSX-IBRS May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Skylake-Server-IBRS May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Skylake-Server May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Skylake-Client-noTSX-IBRS May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Skylake-Client-IBRS May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Skylake-Client May 28 12:44:45 l75lg1-v1 nova-compute[83654]: SandyBridge-IBRS May 28 12:44:45 l75lg1-v1 nova-compute[83654]: SandyBridge May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Penryn May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Opteron_G5 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Opteron_G4 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Opteron_G3 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Opteron_G2 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Opteron_G1 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Nehalem-IBRS May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Nehalem May 28 12:44:45 l75lg1-v1 nova-compute[83654]: IvyBridge-IBRS May 28 12:44:45 l75lg1-v1 nova-compute[83654]: IvyBridge May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Icelake-Server-noTSX May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Icelake-Server May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Icelake-Client-noTSX May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Icelake-Client May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Haswell-noTSX-IBRS May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Haswell-noTSX May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Haswell-IBRS May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Haswell May 28 12:44:45 l75lg1-v1 nova-compute[83654]: EPYC-Rome May 28 12:44:45 l75lg1-v1 nova-compute[83654]: EPYC-Milan May 28 12:44:45 l75lg1-v1 nova-compute[83654]: EPYC-IBPB May 28 12:44:45 l75lg1-v1 nova-compute[83654]: EPYC May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Dhyana May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Cooperlake May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Conroe May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Cascadelake-Server-noTSX May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Cascadelake-Server May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Broadwell-noTSX-IBRS May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Broadwell-noTSX May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Broadwell-IBRS May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Broadwell May 28 12:44:45 l75lg1-v1 nova-compute[83654]: 486 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: file May 28 12:44:45 l75lg1-v1 nova-compute[83654]: anonymous May 28 12:44:45 l75lg1-v1 nova-compute[83654]: memfd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: disk May 28 12:44:45 l75lg1-v1 nova-compute[83654]: cdrom May 28 12:44:45 l75lg1-v1 nova-compute[83654]: floppy May 28 12:44:45 l75lg1-v1 nova-compute[83654]: lun May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: fdc May 28 12:44:45 l75lg1-v1 nova-compute[83654]: scsi May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio May 28 12:44:45 l75lg1-v1 nova-compute[83654]: usb May 28 12:44:45 l75lg1-v1 nova-compute[83654]: sata May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio-transitional May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio-non-transitional May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: sdl May 28 12:44:45 l75lg1-v1 nova-compute[83654]: vnc May 28 12:44:45 l75lg1-v1 nova-compute[83654]: spice May 28 12:44:45 l75lg1-v1 nova-compute[83654]: egl-headless May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: subsystem May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: default May 28 12:44:45 l75lg1-v1 nova-compute[83654]: mandatory May 28 12:44:45 l75lg1-v1 nova-compute[83654]: requisite May 28 12:44:45 l75lg1-v1 nova-compute[83654]: optional May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: usb May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pci May 28 12:44:45 l75lg1-v1 nova-compute[83654]: scsi May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio-transitional May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio-non-transitional May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: random May 28 12:44:45 l75lg1-v1 nova-compute[83654]: egd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: builtin May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: path May 28 12:44:45 l75lg1-v1 nova-compute[83654]: handle May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtiofs May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: tpm-tis May 28 12:44:45 l75lg1-v1 nova-compute[83654]: tpm-crb May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: passthrough May 28 12:44:45 l75lg1-v1 nova-compute[83654]: emulator May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: {{(pid=83654) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}} May 28 12:44:45 l75lg1-v1 nova-compute[83654]: DEBUG nova.virt.libvirt.host [None req-d5e2622c-e52e-4f3d-871c-2ddda502f287 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/bin/qemu-system-i386 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: qemu May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-i440fx-jammy May 28 12:44:45 l75lg1-v1 nova-compute[83654]: i686 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/share/OVMF/OVMF_CODE.fd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/share/OVMF/OVMF_CODE.secboot.fd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/share/AAVMF/AAVMF_CODE.fd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/share/AAVMF/AAVMF32_CODE.fd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/share/OVMF/OVMF_CODE.ms.fd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: rom May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pflash May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: yes May 28 12:44:45 l75lg1-v1 nova-compute[83654]: no May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: no May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: on May 28 12:44:45 l75lg1-v1 nova-compute[83654]: off May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: EPYC May 28 12:44:45 l75lg1-v1 nova-compute[83654]: AMD May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: qemu64 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: qemu32 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: phenom May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pentium3 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pentium2 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pentium May 28 12:44:45 l75lg1-v1 nova-compute[83654]: n270 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: kvm64 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: kvm32 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: coreduo May 28 12:44:45 l75lg1-v1 nova-compute[83654]: core2duo May 28 12:44:45 l75lg1-v1 nova-compute[83654]: athlon May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Westmere-IBRS May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Westmere May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Snowridge May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Skylake-Server-noTSX-IBRS May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Skylake-Server-IBRS May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Skylake-Server May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Skylake-Client-noTSX-IBRS May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Skylake-Client-IBRS May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Skylake-Client May 28 12:44:45 l75lg1-v1 nova-compute[83654]: SandyBridge-IBRS May 28 12:44:45 l75lg1-v1 nova-compute[83654]: SandyBridge May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Penryn May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Opteron_G5 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Opteron_G4 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Opteron_G3 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Opteron_G2 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Opteron_G1 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Nehalem-IBRS May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Nehalem May 28 12:44:45 l75lg1-v1 nova-compute[83654]: IvyBridge-IBRS May 28 12:44:45 l75lg1-v1 nova-compute[83654]: IvyBridge May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Icelake-Server-noTSX May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Icelake-Server May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Icelake-Client-noTSX May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Icelake-Client May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Haswell-noTSX-IBRS May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Haswell-noTSX May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Haswell-IBRS May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Haswell May 28 12:44:45 l75lg1-v1 nova-compute[83654]: EPYC-Rome May 28 12:44:45 l75lg1-v1 nova-compute[83654]: EPYC-Milan May 28 12:44:45 l75lg1-v1 nova-compute[83654]: EPYC-IBPB May 28 12:44:45 l75lg1-v1 nova-compute[83654]: EPYC May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Dhyana May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Cooperlake May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Conroe May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Cascadelake-Server-noTSX May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Cascadelake-Server May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Broadwell-noTSX-IBRS May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Broadwell-noTSX May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Broadwell-IBRS May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Broadwell May 28 12:44:45 l75lg1-v1 nova-compute[83654]: 486 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: file May 28 12:44:45 l75lg1-v1 nova-compute[83654]: anonymous May 28 12:44:45 l75lg1-v1 nova-compute[83654]: memfd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: disk May 28 12:44:45 l75lg1-v1 nova-compute[83654]: cdrom May 28 12:44:45 l75lg1-v1 nova-compute[83654]: floppy May 28 12:44:45 l75lg1-v1 nova-compute[83654]: lun May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: ide May 28 12:44:45 l75lg1-v1 nova-compute[83654]: fdc May 28 12:44:45 l75lg1-v1 nova-compute[83654]: scsi May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio May 28 12:44:45 l75lg1-v1 nova-compute[83654]: usb May 28 12:44:45 l75lg1-v1 nova-compute[83654]: sata May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio-transitional May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio-non-transitional May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: sdl May 28 12:44:45 l75lg1-v1 nova-compute[83654]: vnc May 28 12:44:45 l75lg1-v1 nova-compute[83654]: spice May 28 12:44:45 l75lg1-v1 nova-compute[83654]: egl-headless May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: subsystem May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: default May 28 12:44:45 l75lg1-v1 nova-compute[83654]: mandatory May 28 12:44:45 l75lg1-v1 nova-compute[83654]: requisite May 28 12:44:45 l75lg1-v1 nova-compute[83654]: optional May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: usb May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pci May 28 12:44:45 l75lg1-v1 nova-compute[83654]: scsi May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio-transitional May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio-non-transitional May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: random May 28 12:44:45 l75lg1-v1 nova-compute[83654]: egd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: builtin May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: path May 28 12:44:45 l75lg1-v1 nova-compute[83654]: handle May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtiofs May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: tpm-tis May 28 12:44:45 l75lg1-v1 nova-compute[83654]: tpm-crb May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: passthrough May 28 12:44:45 l75lg1-v1 nova-compute[83654]: emulator May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: {{(pid=83654) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}} May 28 12:44:45 l75lg1-v1 nova-compute[83654]: DEBUG nova.virt.libvirt.host [None req-d5e2622c-e52e-4f3d-871c-2ddda502f287 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/bin/qemu-system-i386 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: qemu May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-i440fx-6.2 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: i686 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/share/OVMF/OVMF_CODE.fd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/share/OVMF/OVMF_CODE.secboot.fd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/share/AAVMF/AAVMF_CODE.fd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/share/AAVMF/AAVMF32_CODE.fd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/share/OVMF/OVMF_CODE.ms.fd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: rom May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pflash May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: yes May 28 12:44:45 l75lg1-v1 nova-compute[83654]: no May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: no May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: on May 28 12:44:45 l75lg1-v1 nova-compute[83654]: off May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: EPYC May 28 12:44:45 l75lg1-v1 nova-compute[83654]: AMD May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: qemu64 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: qemu32 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: phenom May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pentium3 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pentium2 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pentium May 28 12:44:45 l75lg1-v1 nova-compute[83654]: n270 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: kvm64 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: kvm32 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: coreduo May 28 12:44:45 l75lg1-v1 nova-compute[83654]: core2duo May 28 12:44:45 l75lg1-v1 nova-compute[83654]: athlon May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Westmere-IBRS May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Westmere May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Snowridge May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Skylake-Server-noTSX-IBRS May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Skylake-Server-IBRS May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Skylake-Server May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Skylake-Client-noTSX-IBRS May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Skylake-Client-IBRS May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Skylake-Client May 28 12:44:45 l75lg1-v1 nova-compute[83654]: SandyBridge-IBRS May 28 12:44:45 l75lg1-v1 nova-compute[83654]: SandyBridge May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Penryn May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Opteron_G5 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Opteron_G4 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Opteron_G3 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Opteron_G2 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Opteron_G1 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Nehalem-IBRS May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Nehalem May 28 12:44:45 l75lg1-v1 nova-compute[83654]: IvyBridge-IBRS May 28 12:44:45 l75lg1-v1 nova-compute[83654]: IvyBridge May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Icelake-Server-noTSX May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Icelake-Server May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Icelake-Client-noTSX May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Icelake-Client May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Haswell-noTSX-IBRS May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Haswell-noTSX May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Haswell-IBRS May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Haswell May 28 12:44:45 l75lg1-v1 nova-compute[83654]: EPYC-Rome May 28 12:44:45 l75lg1-v1 nova-compute[83654]: EPYC-Milan May 28 12:44:45 l75lg1-v1 nova-compute[83654]: EPYC-IBPB May 28 12:44:45 l75lg1-v1 nova-compute[83654]: EPYC May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Dhyana May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Cooperlake May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Conroe May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Cascadelake-Server-noTSX May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Cascadelake-Server May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Broadwell-noTSX-IBRS May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Broadwell-noTSX May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Broadwell-IBRS May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Broadwell May 28 12:44:45 l75lg1-v1 nova-compute[83654]: 486 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: file May 28 12:44:45 l75lg1-v1 nova-compute[83654]: anonymous May 28 12:44:45 l75lg1-v1 nova-compute[83654]: memfd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: disk May 28 12:44:45 l75lg1-v1 nova-compute[83654]: cdrom May 28 12:44:45 l75lg1-v1 nova-compute[83654]: floppy May 28 12:44:45 l75lg1-v1 nova-compute[83654]: lun May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: ide May 28 12:44:45 l75lg1-v1 nova-compute[83654]: fdc May 28 12:44:45 l75lg1-v1 nova-compute[83654]: scsi May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio May 28 12:44:45 l75lg1-v1 nova-compute[83654]: usb May 28 12:44:45 l75lg1-v1 nova-compute[83654]: sata May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio-transitional May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio-non-transitional May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: sdl May 28 12:44:45 l75lg1-v1 nova-compute[83654]: vnc May 28 12:44:45 l75lg1-v1 nova-compute[83654]: spice May 28 12:44:45 l75lg1-v1 nova-compute[83654]: egl-headless May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: subsystem May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: default May 28 12:44:45 l75lg1-v1 nova-compute[83654]: mandatory May 28 12:44:45 l75lg1-v1 nova-compute[83654]: requisite May 28 12:44:45 l75lg1-v1 nova-compute[83654]: optional May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: usb May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pci May 28 12:44:45 l75lg1-v1 nova-compute[83654]: scsi May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio-transitional May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio-non-transitional May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: random May 28 12:44:45 l75lg1-v1 nova-compute[83654]: egd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: builtin May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: path May 28 12:44:45 l75lg1-v1 nova-compute[83654]: handle May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtiofs May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: tpm-tis May 28 12:44:45 l75lg1-v1 nova-compute[83654]: tpm-crb May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: passthrough May 28 12:44:45 l75lg1-v1 nova-compute[83654]: emulator May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: {{(pid=83654) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}} May 28 12:44:45 l75lg1-v1 nova-compute[83654]: DEBUG nova.virt.libvirt.host [None req-d5e2622c-e52e-4f3d-871c-2ddda502f287 None None] Getting domain capabilities for m68k via machine types: {None, 'virt'} {{(pid=83654) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}} May 28 12:44:45 l75lg1-v1 nova-compute[83654]: DEBUG nova.virt.libvirt.host [None req-d5e2622c-e52e-4f3d-871c-2ddda502f287 None None] Libvirt host hypervisor capabilities for arch=m68k and machine_type=None: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/bin/qemu-system-m68k May 28 12:44:45 l75lg1-v1 nova-compute[83654]: qemu May 28 12:44:45 l75lg1-v1 nova-compute[83654]: mcf5208evb May 28 12:44:45 l75lg1-v1 nova-compute[83654]: m68k May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/share/OVMF/OVMF_CODE.fd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/share/OVMF/OVMF_CODE.secboot.fd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/share/AAVMF/AAVMF_CODE.fd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/share/AAVMF/AAVMF32_CODE.fd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/share/OVMF/OVMF_CODE.ms.fd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: rom May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pflash May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: yes May 28 12:44:45 l75lg1-v1 nova-compute[83654]: no May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: no May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: file May 28 12:44:45 l75lg1-v1 nova-compute[83654]: anonymous May 28 12:44:45 l75lg1-v1 nova-compute[83654]: memfd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: disk May 28 12:44:45 l75lg1-v1 nova-compute[83654]: cdrom May 28 12:44:45 l75lg1-v1 nova-compute[83654]: floppy May 28 12:44:45 l75lg1-v1 nova-compute[83654]: lun May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: fdc May 28 12:44:45 l75lg1-v1 nova-compute[83654]: scsi May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: sdl May 28 12:44:45 l75lg1-v1 nova-compute[83654]: vnc May 28 12:44:45 l75lg1-v1 nova-compute[83654]: spice May 28 12:44:45 l75lg1-v1 nova-compute[83654]: egl-headless May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: subsystem May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: default May 28 12:44:45 l75lg1-v1 nova-compute[83654]: mandatory May 28 12:44:45 l75lg1-v1 nova-compute[83654]: requisite May 28 12:44:45 l75lg1-v1 nova-compute[83654]: optional May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pci May 28 12:44:45 l75lg1-v1 nova-compute[83654]: scsi May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: random May 28 12:44:45 l75lg1-v1 nova-compute[83654]: egd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: builtin May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: path May 28 12:44:45 l75lg1-v1 nova-compute[83654]: handle May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtiofs May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: {{(pid=83654) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}} May 28 12:44:45 l75lg1-v1 nova-compute[83654]: DEBUG nova.virt.libvirt.host [None req-d5e2622c-e52e-4f3d-871c-2ddda502f287 None None] Libvirt host hypervisor capabilities for arch=m68k and machine_type=virt: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/bin/qemu-system-m68k May 28 12:44:45 l75lg1-v1 nova-compute[83654]: qemu May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virt-6.2 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: m68k May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/share/OVMF/OVMF_CODE.fd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/share/OVMF/OVMF_CODE.secboot.fd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/share/AAVMF/AAVMF_CODE.fd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/share/AAVMF/AAVMF32_CODE.fd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/share/OVMF/OVMF_CODE.ms.fd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: rom May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pflash May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: yes May 28 12:44:45 l75lg1-v1 nova-compute[83654]: no May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: no May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: file May 28 12:44:45 l75lg1-v1 nova-compute[83654]: anonymous May 28 12:44:45 l75lg1-v1 nova-compute[83654]: memfd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: disk May 28 12:44:45 l75lg1-v1 nova-compute[83654]: cdrom May 28 12:44:45 l75lg1-v1 nova-compute[83654]: floppy May 28 12:44:45 l75lg1-v1 nova-compute[83654]: lun May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: fdc May 28 12:44:45 l75lg1-v1 nova-compute[83654]: scsi May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: sdl May 28 12:44:45 l75lg1-v1 nova-compute[83654]: vnc May 28 12:44:45 l75lg1-v1 nova-compute[83654]: spice May 28 12:44:45 l75lg1-v1 nova-compute[83654]: egl-headless May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: subsystem May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: default May 28 12:44:45 l75lg1-v1 nova-compute[83654]: mandatory May 28 12:44:45 l75lg1-v1 nova-compute[83654]: requisite May 28 12:44:45 l75lg1-v1 nova-compute[83654]: optional May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pci May 28 12:44:45 l75lg1-v1 nova-compute[83654]: scsi May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: random May 28 12:44:45 l75lg1-v1 nova-compute[83654]: egd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: builtin May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: path May 28 12:44:45 l75lg1-v1 nova-compute[83654]: handle May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtiofs May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: {{(pid=83654) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}} May 28 12:44:45 l75lg1-v1 nova-compute[83654]: DEBUG nova.virt.libvirt.host [None req-d5e2622c-e52e-4f3d-871c-2ddda502f287 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=83654) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}} May 28 12:44:45 l75lg1-v1 nova-compute[83654]: DEBUG nova.virt.libvirt.host [None req-d5e2622c-e52e-4f3d-871c-2ddda502f287 None None] Libvirt host hypervisor capabilities for arch=microblaze and machine_type=None: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/bin/qemu-system-microblaze May 28 12:44:45 l75lg1-v1 nova-compute[83654]: qemu May 28 12:44:45 l75lg1-v1 nova-compute[83654]: petalogix-s3adsp1800 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: microblaze May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/share/OVMF/OVMF_CODE.fd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/share/OVMF/OVMF_CODE.secboot.fd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/share/AAVMF/AAVMF_CODE.fd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/share/AAVMF/AAVMF32_CODE.fd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/share/OVMF/OVMF_CODE.ms.fd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: rom May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pflash May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: yes May 28 12:44:45 l75lg1-v1 nova-compute[83654]: no May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: no May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: file May 28 12:44:45 l75lg1-v1 nova-compute[83654]: anonymous May 28 12:44:45 l75lg1-v1 nova-compute[83654]: memfd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: disk May 28 12:44:45 l75lg1-v1 nova-compute[83654]: cdrom May 28 12:44:45 l75lg1-v1 nova-compute[83654]: floppy May 28 12:44:45 l75lg1-v1 nova-compute[83654]: lun May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: fdc May 28 12:44:45 l75lg1-v1 nova-compute[83654]: scsi May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: sdl May 28 12:44:45 l75lg1-v1 nova-compute[83654]: vnc May 28 12:44:45 l75lg1-v1 nova-compute[83654]: spice May 28 12:44:45 l75lg1-v1 nova-compute[83654]: egl-headless May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: subsystem May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: default May 28 12:44:45 l75lg1-v1 nova-compute[83654]: mandatory May 28 12:44:45 l75lg1-v1 nova-compute[83654]: requisite May 28 12:44:45 l75lg1-v1 nova-compute[83654]: optional May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pci May 28 12:44:45 l75lg1-v1 nova-compute[83654]: scsi May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: random May 28 12:44:45 l75lg1-v1 nova-compute[83654]: egd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: builtin May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: path May 28 12:44:45 l75lg1-v1 nova-compute[83654]: handle May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: {{(pid=83654) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}} May 28 12:44:45 l75lg1-v1 nova-compute[83654]: DEBUG nova.virt.libvirt.host [None req-d5e2622c-e52e-4f3d-871c-2ddda502f287 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=83654) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}} May 28 12:44:45 l75lg1-v1 nova-compute[83654]: DEBUG nova.virt.libvirt.host [None req-d5e2622c-e52e-4f3d-871c-2ddda502f287 None None] Libvirt host hypervisor capabilities for arch=microblazeel and machine_type=None: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/bin/qemu-system-microblazeel May 28 12:44:45 l75lg1-v1 nova-compute[83654]: qemu May 28 12:44:45 l75lg1-v1 nova-compute[83654]: petalogix-s3adsp1800 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: microblazeel May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/share/OVMF/OVMF_CODE.fd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/share/OVMF/OVMF_CODE.secboot.fd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/share/AAVMF/AAVMF_CODE.fd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/share/AAVMF/AAVMF32_CODE.fd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/share/OVMF/OVMF_CODE.ms.fd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: rom May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pflash May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: yes May 28 12:44:45 l75lg1-v1 nova-compute[83654]: no May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: no May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: file May 28 12:44:45 l75lg1-v1 nova-compute[83654]: anonymous May 28 12:44:45 l75lg1-v1 nova-compute[83654]: memfd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: disk May 28 12:44:45 l75lg1-v1 nova-compute[83654]: cdrom May 28 12:44:45 l75lg1-v1 nova-compute[83654]: floppy May 28 12:44:45 l75lg1-v1 nova-compute[83654]: lun May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: fdc May 28 12:44:45 l75lg1-v1 nova-compute[83654]: scsi May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: sdl May 28 12:44:45 l75lg1-v1 nova-compute[83654]: vnc May 28 12:44:45 l75lg1-v1 nova-compute[83654]: spice May 28 12:44:45 l75lg1-v1 nova-compute[83654]: egl-headless May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: subsystem May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: default May 28 12:44:45 l75lg1-v1 nova-compute[83654]: mandatory May 28 12:44:45 l75lg1-v1 nova-compute[83654]: requisite May 28 12:44:45 l75lg1-v1 nova-compute[83654]: optional May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pci May 28 12:44:45 l75lg1-v1 nova-compute[83654]: scsi May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: random May 28 12:44:45 l75lg1-v1 nova-compute[83654]: egd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: builtin May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: path May 28 12:44:45 l75lg1-v1 nova-compute[83654]: handle May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: {{(pid=83654) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}} May 28 12:44:45 l75lg1-v1 nova-compute[83654]: DEBUG nova.virt.libvirt.host [None req-d5e2622c-e52e-4f3d-871c-2ddda502f287 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=83654) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}} May 28 12:44:45 l75lg1-v1 nova-compute[83654]: DEBUG nova.virt.libvirt.host [None req-d5e2622c-e52e-4f3d-871c-2ddda502f287 None None] Libvirt host hypervisor capabilities for arch=mips and machine_type=None: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/bin/qemu-system-mips May 28 12:44:45 l75lg1-v1 nova-compute[83654]: qemu May 28 12:44:45 l75lg1-v1 nova-compute[83654]: malta May 28 12:44:45 l75lg1-v1 nova-compute[83654]: mips May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/share/OVMF/OVMF_CODE.fd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/share/OVMF/OVMF_CODE.secboot.fd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/share/AAVMF/AAVMF_CODE.fd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/share/AAVMF/AAVMF32_CODE.fd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/share/OVMF/OVMF_CODE.ms.fd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: rom May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pflash May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: yes May 28 12:44:45 l75lg1-v1 nova-compute[83654]: no May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: no May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: file May 28 12:44:45 l75lg1-v1 nova-compute[83654]: anonymous May 28 12:44:45 l75lg1-v1 nova-compute[83654]: memfd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: disk May 28 12:44:45 l75lg1-v1 nova-compute[83654]: cdrom May 28 12:44:45 l75lg1-v1 nova-compute[83654]: floppy May 28 12:44:45 l75lg1-v1 nova-compute[83654]: lun May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: ide May 28 12:44:45 l75lg1-v1 nova-compute[83654]: fdc May 28 12:44:45 l75lg1-v1 nova-compute[83654]: scsi May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio May 28 12:44:45 l75lg1-v1 nova-compute[83654]: usb May 28 12:44:45 l75lg1-v1 nova-compute[83654]: sata May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio-transitional May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio-non-transitional May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: sdl May 28 12:44:45 l75lg1-v1 nova-compute[83654]: vnc May 28 12:44:45 l75lg1-v1 nova-compute[83654]: spice May 28 12:44:45 l75lg1-v1 nova-compute[83654]: egl-headless May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: subsystem May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: default May 28 12:44:45 l75lg1-v1 nova-compute[83654]: mandatory May 28 12:44:45 l75lg1-v1 nova-compute[83654]: requisite May 28 12:44:45 l75lg1-v1 nova-compute[83654]: optional May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: usb May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pci May 28 12:44:45 l75lg1-v1 nova-compute[83654]: scsi May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio-transitional May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio-non-transitional May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: random May 28 12:44:45 l75lg1-v1 nova-compute[83654]: egd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: builtin May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: path May 28 12:44:45 l75lg1-v1 nova-compute[83654]: handle May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtiofs May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: {{(pid=83654) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}} May 28 12:44:45 l75lg1-v1 nova-compute[83654]: DEBUG nova.virt.libvirt.host [None req-d5e2622c-e52e-4f3d-871c-2ddda502f287 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=83654) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}} May 28 12:44:45 l75lg1-v1 nova-compute[83654]: DEBUG nova.virt.libvirt.host [None req-d5e2622c-e52e-4f3d-871c-2ddda502f287 None None] Libvirt host hypervisor capabilities for arch=mipsel and machine_type=None: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/bin/qemu-system-mipsel May 28 12:44:45 l75lg1-v1 nova-compute[83654]: qemu May 28 12:44:45 l75lg1-v1 nova-compute[83654]: malta May 28 12:44:45 l75lg1-v1 nova-compute[83654]: mipsel May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/share/OVMF/OVMF_CODE.fd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/share/OVMF/OVMF_CODE.secboot.fd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/share/AAVMF/AAVMF_CODE.fd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/share/AAVMF/AAVMF32_CODE.fd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/share/OVMF/OVMF_CODE.ms.fd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: rom May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pflash May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: yes May 28 12:44:45 l75lg1-v1 nova-compute[83654]: no May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: no May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: file May 28 12:44:45 l75lg1-v1 nova-compute[83654]: anonymous May 28 12:44:45 l75lg1-v1 nova-compute[83654]: memfd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: disk May 28 12:44:45 l75lg1-v1 nova-compute[83654]: cdrom May 28 12:44:45 l75lg1-v1 nova-compute[83654]: floppy May 28 12:44:45 l75lg1-v1 nova-compute[83654]: lun May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: ide May 28 12:44:45 l75lg1-v1 nova-compute[83654]: fdc May 28 12:44:45 l75lg1-v1 nova-compute[83654]: scsi May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio May 28 12:44:45 l75lg1-v1 nova-compute[83654]: usb May 28 12:44:45 l75lg1-v1 nova-compute[83654]: sata May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio-transitional May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio-non-transitional May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: sdl May 28 12:44:45 l75lg1-v1 nova-compute[83654]: vnc May 28 12:44:45 l75lg1-v1 nova-compute[83654]: spice May 28 12:44:45 l75lg1-v1 nova-compute[83654]: egl-headless May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: subsystem May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: default May 28 12:44:45 l75lg1-v1 nova-compute[83654]: mandatory May 28 12:44:45 l75lg1-v1 nova-compute[83654]: requisite May 28 12:44:45 l75lg1-v1 nova-compute[83654]: optional May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: usb May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pci May 28 12:44:45 l75lg1-v1 nova-compute[83654]: scsi May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio-transitional May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio-non-transitional May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: random May 28 12:44:45 l75lg1-v1 nova-compute[83654]: egd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: builtin May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: path May 28 12:44:45 l75lg1-v1 nova-compute[83654]: handle May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtiofs May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: {{(pid=83654) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}} May 28 12:44:45 l75lg1-v1 nova-compute[83654]: DEBUG nova.virt.libvirt.host [None req-d5e2622c-e52e-4f3d-871c-2ddda502f287 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=83654) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}} May 28 12:44:45 l75lg1-v1 nova-compute[83654]: DEBUG nova.virt.libvirt.host [None req-d5e2622c-e52e-4f3d-871c-2ddda502f287 None None] Libvirt host hypervisor capabilities for arch=mips64 and machine_type=None: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/bin/qemu-system-mips64 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: qemu May 28 12:44:45 l75lg1-v1 nova-compute[83654]: malta May 28 12:44:45 l75lg1-v1 nova-compute[83654]: mips64 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/share/OVMF/OVMF_CODE.fd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/share/OVMF/OVMF_CODE.secboot.fd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/share/AAVMF/AAVMF_CODE.fd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/share/AAVMF/AAVMF32_CODE.fd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/share/OVMF/OVMF_CODE.ms.fd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: rom May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pflash May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: yes May 28 12:44:45 l75lg1-v1 nova-compute[83654]: no May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: no May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: file May 28 12:44:45 l75lg1-v1 nova-compute[83654]: anonymous May 28 12:44:45 l75lg1-v1 nova-compute[83654]: memfd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: disk May 28 12:44:45 l75lg1-v1 nova-compute[83654]: cdrom May 28 12:44:45 l75lg1-v1 nova-compute[83654]: floppy May 28 12:44:45 l75lg1-v1 nova-compute[83654]: lun May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: ide May 28 12:44:45 l75lg1-v1 nova-compute[83654]: fdc May 28 12:44:45 l75lg1-v1 nova-compute[83654]: scsi May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio May 28 12:44:45 l75lg1-v1 nova-compute[83654]: usb May 28 12:44:45 l75lg1-v1 nova-compute[83654]: sata May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio-transitional May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio-non-transitional May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: sdl May 28 12:44:45 l75lg1-v1 nova-compute[83654]: vnc May 28 12:44:45 l75lg1-v1 nova-compute[83654]: spice May 28 12:44:45 l75lg1-v1 nova-compute[83654]: egl-headless May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: subsystem May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: default May 28 12:44:45 l75lg1-v1 nova-compute[83654]: mandatory May 28 12:44:45 l75lg1-v1 nova-compute[83654]: requisite May 28 12:44:45 l75lg1-v1 nova-compute[83654]: optional May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: usb May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pci May 28 12:44:45 l75lg1-v1 nova-compute[83654]: scsi May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio-transitional May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio-non-transitional May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: random May 28 12:44:45 l75lg1-v1 nova-compute[83654]: egd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: builtin May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: path May 28 12:44:45 l75lg1-v1 nova-compute[83654]: handle May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtiofs May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: {{(pid=83654) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}} May 28 12:44:45 l75lg1-v1 nova-compute[83654]: DEBUG nova.virt.libvirt.host [None req-d5e2622c-e52e-4f3d-871c-2ddda502f287 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=83654) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}} May 28 12:44:45 l75lg1-v1 nova-compute[83654]: DEBUG nova.virt.libvirt.host [None req-d5e2622c-e52e-4f3d-871c-2ddda502f287 None None] Libvirt host hypervisor capabilities for arch=mips64el and machine_type=None: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/bin/qemu-system-mips64el May 28 12:44:45 l75lg1-v1 nova-compute[83654]: qemu May 28 12:44:45 l75lg1-v1 nova-compute[83654]: malta May 28 12:44:45 l75lg1-v1 nova-compute[83654]: mips64el May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/share/OVMF/OVMF_CODE.fd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/share/OVMF/OVMF_CODE.secboot.fd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/share/AAVMF/AAVMF_CODE.fd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/share/AAVMF/AAVMF32_CODE.fd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/share/OVMF/OVMF_CODE.ms.fd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: rom May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pflash May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: yes May 28 12:44:45 l75lg1-v1 nova-compute[83654]: no May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: no May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: file May 28 12:44:45 l75lg1-v1 nova-compute[83654]: anonymous May 28 12:44:45 l75lg1-v1 nova-compute[83654]: memfd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: disk May 28 12:44:45 l75lg1-v1 nova-compute[83654]: cdrom May 28 12:44:45 l75lg1-v1 nova-compute[83654]: floppy May 28 12:44:45 l75lg1-v1 nova-compute[83654]: lun May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: ide May 28 12:44:45 l75lg1-v1 nova-compute[83654]: fdc May 28 12:44:45 l75lg1-v1 nova-compute[83654]: scsi May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio May 28 12:44:45 l75lg1-v1 nova-compute[83654]: usb May 28 12:44:45 l75lg1-v1 nova-compute[83654]: sata May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio-transitional May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio-non-transitional May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: sdl May 28 12:44:45 l75lg1-v1 nova-compute[83654]: vnc May 28 12:44:45 l75lg1-v1 nova-compute[83654]: spice May 28 12:44:45 l75lg1-v1 nova-compute[83654]: egl-headless May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: subsystem May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: default May 28 12:44:45 l75lg1-v1 nova-compute[83654]: mandatory May 28 12:44:45 l75lg1-v1 nova-compute[83654]: requisite May 28 12:44:45 l75lg1-v1 nova-compute[83654]: optional May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: usb May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pci May 28 12:44:45 l75lg1-v1 nova-compute[83654]: scsi May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio-transitional May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio-non-transitional May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: random May 28 12:44:45 l75lg1-v1 nova-compute[83654]: egd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: builtin May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: path May 28 12:44:45 l75lg1-v1 nova-compute[83654]: handle May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtiofs May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: {{(pid=83654) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}} May 28 12:44:45 l75lg1-v1 nova-compute[83654]: DEBUG nova.virt.libvirt.host [None req-d5e2622c-e52e-4f3d-871c-2ddda502f287 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=83654) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}} May 28 12:44:45 l75lg1-v1 nova-compute[83654]: DEBUG nova.virt.libvirt.host [None req-d5e2622c-e52e-4f3d-871c-2ddda502f287 None None] Libvirt host hypervisor capabilities for arch=ppc and machine_type=None: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/bin/qemu-system-ppc May 28 12:44:45 l75lg1-v1 nova-compute[83654]: qemu May 28 12:44:45 l75lg1-v1 nova-compute[83654]: g3beige May 28 12:44:45 l75lg1-v1 nova-compute[83654]: ppc May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/share/OVMF/OVMF_CODE.fd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/share/OVMF/OVMF_CODE.secboot.fd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/share/AAVMF/AAVMF_CODE.fd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/share/AAVMF/AAVMF32_CODE.fd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/share/OVMF/OVMF_CODE.ms.fd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: rom May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pflash May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: yes May 28 12:44:45 l75lg1-v1 nova-compute[83654]: no May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: no May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: on May 28 12:44:45 l75lg1-v1 nova-compute[83654]: off May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: file May 28 12:44:45 l75lg1-v1 nova-compute[83654]: anonymous May 28 12:44:45 l75lg1-v1 nova-compute[83654]: memfd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: disk May 28 12:44:45 l75lg1-v1 nova-compute[83654]: cdrom May 28 12:44:45 l75lg1-v1 nova-compute[83654]: floppy May 28 12:44:45 l75lg1-v1 nova-compute[83654]: lun May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: ide May 28 12:44:45 l75lg1-v1 nova-compute[83654]: fdc May 28 12:44:45 l75lg1-v1 nova-compute[83654]: scsi May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio May 28 12:44:45 l75lg1-v1 nova-compute[83654]: usb May 28 12:44:45 l75lg1-v1 nova-compute[83654]: sata May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio-transitional May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio-non-transitional May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: sdl May 28 12:44:45 l75lg1-v1 nova-compute[83654]: vnc May 28 12:44:45 l75lg1-v1 nova-compute[83654]: spice May 28 12:44:45 l75lg1-v1 nova-compute[83654]: egl-headless May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: subsystem May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: default May 28 12:44:45 l75lg1-v1 nova-compute[83654]: mandatory May 28 12:44:45 l75lg1-v1 nova-compute[83654]: requisite May 28 12:44:45 l75lg1-v1 nova-compute[83654]: optional May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: usb May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pci May 28 12:44:45 l75lg1-v1 nova-compute[83654]: scsi May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio-transitional May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio-non-transitional May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: random May 28 12:44:45 l75lg1-v1 nova-compute[83654]: egd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: builtin May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: path May 28 12:44:45 l75lg1-v1 nova-compute[83654]: handle May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtiofs May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: {{(pid=83654) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}} May 28 12:44:45 l75lg1-v1 nova-compute[83654]: DEBUG nova.virt.libvirt.host [None req-d5e2622c-e52e-4f3d-871c-2ddda502f287 None None] Getting domain capabilities for ppc64 via machine types: {'pseries', 'powernv', None} {{(pid=83654) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}} May 28 12:44:45 l75lg1-v1 nova-compute[83654]: DEBUG nova.virt.libvirt.host [None req-d5e2622c-e52e-4f3d-871c-2ddda502f287 None None] Libvirt host hypervisor capabilities for arch=ppc64 and machine_type=pseries: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/bin/qemu-system-ppc64 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: qemu May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pseries-jammy May 28 12:44:45 l75lg1-v1 nova-compute[83654]: ppc64 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/share/OVMF/OVMF_CODE.fd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/share/OVMF/OVMF_CODE.secboot.fd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/share/AAVMF/AAVMF_CODE.fd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/share/AAVMF/AAVMF32_CODE.fd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/share/OVMF/OVMF_CODE.ms.fd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: rom May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pflash May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: yes May 28 12:44:45 l75lg1-v1 nova-compute[83654]: no May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: no May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: on May 28 12:44:45 l75lg1-v1 nova-compute[83654]: off May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: POWER9 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: POWER8 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: POWER7 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: file May 28 12:44:45 l75lg1-v1 nova-compute[83654]: anonymous May 28 12:44:45 l75lg1-v1 nova-compute[83654]: memfd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: disk May 28 12:44:45 l75lg1-v1 nova-compute[83654]: cdrom May 28 12:44:45 l75lg1-v1 nova-compute[83654]: lun May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: scsi May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio May 28 12:44:45 l75lg1-v1 nova-compute[83654]: usb May 28 12:44:45 l75lg1-v1 nova-compute[83654]: sata May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio-transitional May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio-non-transitional May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: sdl May 28 12:44:45 l75lg1-v1 nova-compute[83654]: vnc May 28 12:44:45 l75lg1-v1 nova-compute[83654]: spice May 28 12:44:45 l75lg1-v1 nova-compute[83654]: egl-headless May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: subsystem May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: default May 28 12:44:45 l75lg1-v1 nova-compute[83654]: mandatory May 28 12:44:45 l75lg1-v1 nova-compute[83654]: requisite May 28 12:44:45 l75lg1-v1 nova-compute[83654]: optional May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: usb May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pci May 28 12:44:45 l75lg1-v1 nova-compute[83654]: scsi May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio-transitional May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio-non-transitional May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: random May 28 12:44:45 l75lg1-v1 nova-compute[83654]: egd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: builtin May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: path May 28 12:44:45 l75lg1-v1 nova-compute[83654]: handle May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtiofs May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: tpm-spapr May 28 12:44:45 l75lg1-v1 nova-compute[83654]: spapr-tpm-proxy May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: passthrough May 28 12:44:45 l75lg1-v1 nova-compute[83654]: emulator May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: {{(pid=83654) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}} May 28 12:44:45 l75lg1-v1 nova-compute[83654]: DEBUG nova.virt.libvirt.host [None req-d5e2622c-e52e-4f3d-871c-2ddda502f287 None None] Libvirt host hypervisor capabilities for arch=ppc64 and machine_type=powernv: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/bin/qemu-system-ppc64 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: qemu May 28 12:44:45 l75lg1-v1 nova-compute[83654]: powernv9 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: ppc64 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/share/OVMF/OVMF_CODE.fd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/share/OVMF/OVMF_CODE.secboot.fd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/share/AAVMF/AAVMF_CODE.fd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/share/AAVMF/AAVMF32_CODE.fd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/share/OVMF/OVMF_CODE.ms.fd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: rom May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pflash May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: yes May 28 12:44:45 l75lg1-v1 nova-compute[83654]: no May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: no May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: on May 28 12:44:45 l75lg1-v1 nova-compute[83654]: off May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: POWER9 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: POWER8 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: POWER7 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: file May 28 12:44:45 l75lg1-v1 nova-compute[83654]: anonymous May 28 12:44:45 l75lg1-v1 nova-compute[83654]: memfd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: disk May 28 12:44:45 l75lg1-v1 nova-compute[83654]: cdrom May 28 12:44:45 l75lg1-v1 nova-compute[83654]: floppy May 28 12:44:45 l75lg1-v1 nova-compute[83654]: lun May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: fdc May 28 12:44:45 l75lg1-v1 nova-compute[83654]: scsi May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio May 28 12:44:45 l75lg1-v1 nova-compute[83654]: usb May 28 12:44:45 l75lg1-v1 nova-compute[83654]: sata May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio-transitional May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio-non-transitional May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: sdl May 28 12:44:45 l75lg1-v1 nova-compute[83654]: vnc May 28 12:44:45 l75lg1-v1 nova-compute[83654]: spice May 28 12:44:45 l75lg1-v1 nova-compute[83654]: egl-headless May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: subsystem May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: default May 28 12:44:45 l75lg1-v1 nova-compute[83654]: mandatory May 28 12:44:45 l75lg1-v1 nova-compute[83654]: requisite May 28 12:44:45 l75lg1-v1 nova-compute[83654]: optional May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: usb May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pci May 28 12:44:45 l75lg1-v1 nova-compute[83654]: scsi May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio-transitional May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio-non-transitional May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: random May 28 12:44:45 l75lg1-v1 nova-compute[83654]: egd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: builtin May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: path May 28 12:44:45 l75lg1-v1 nova-compute[83654]: handle May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtiofs May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: tpm-spapr May 28 12:44:45 l75lg1-v1 nova-compute[83654]: spapr-tpm-proxy May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: passthrough May 28 12:44:45 l75lg1-v1 nova-compute[83654]: emulator May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: {{(pid=83654) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}} May 28 12:44:45 l75lg1-v1 nova-compute[83654]: DEBUG nova.virt.libvirt.host [None req-d5e2622c-e52e-4f3d-871c-2ddda502f287 None None] Libvirt host hypervisor capabilities for arch=ppc64 and machine_type=None: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/bin/qemu-system-ppc64 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: qemu May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pseries-jammy May 28 12:44:45 l75lg1-v1 nova-compute[83654]: ppc64 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/share/OVMF/OVMF_CODE.fd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/share/OVMF/OVMF_CODE.secboot.fd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/share/AAVMF/AAVMF_CODE.fd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/share/AAVMF/AAVMF32_CODE.fd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/share/OVMF/OVMF_CODE.ms.fd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: rom May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pflash May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: yes May 28 12:44:45 l75lg1-v1 nova-compute[83654]: no May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: no May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: on May 28 12:44:45 l75lg1-v1 nova-compute[83654]: off May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: POWER9 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: POWER8 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: POWER7 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: file May 28 12:44:45 l75lg1-v1 nova-compute[83654]: anonymous May 28 12:44:45 l75lg1-v1 nova-compute[83654]: memfd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: disk May 28 12:44:45 l75lg1-v1 nova-compute[83654]: cdrom May 28 12:44:45 l75lg1-v1 nova-compute[83654]: lun May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: scsi May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio May 28 12:44:45 l75lg1-v1 nova-compute[83654]: usb May 28 12:44:45 l75lg1-v1 nova-compute[83654]: sata May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio-transitional May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio-non-transitional May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: sdl May 28 12:44:45 l75lg1-v1 nova-compute[83654]: vnc May 28 12:44:45 l75lg1-v1 nova-compute[83654]: spice May 28 12:44:45 l75lg1-v1 nova-compute[83654]: egl-headless May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: subsystem May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: default May 28 12:44:45 l75lg1-v1 nova-compute[83654]: mandatory May 28 12:44:45 l75lg1-v1 nova-compute[83654]: requisite May 28 12:44:45 l75lg1-v1 nova-compute[83654]: optional May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: usb May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pci May 28 12:44:45 l75lg1-v1 nova-compute[83654]: scsi May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio-transitional May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio-non-transitional May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: random May 28 12:44:45 l75lg1-v1 nova-compute[83654]: egd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: builtin May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: path May 28 12:44:45 l75lg1-v1 nova-compute[83654]: handle May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtiofs May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: tpm-spapr May 28 12:44:45 l75lg1-v1 nova-compute[83654]: spapr-tpm-proxy May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: passthrough May 28 12:44:45 l75lg1-v1 nova-compute[83654]: emulator May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: {{(pid=83654) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}} May 28 12:44:45 l75lg1-v1 nova-compute[83654]: DEBUG nova.virt.libvirt.host [None req-d5e2622c-e52e-4f3d-871c-2ddda502f287 None None] Getting domain capabilities for ppc64le via machine types: {'pseries', 'powernv'} {{(pid=83654) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}} May 28 12:44:45 l75lg1-v1 nova-compute[83654]: DEBUG nova.virt.libvirt.host [None req-d5e2622c-e52e-4f3d-871c-2ddda502f287 None None] Libvirt host hypervisor capabilities for arch=ppc64le and machine_type=pseries: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/bin/qemu-system-ppc64le May 28 12:44:45 l75lg1-v1 nova-compute[83654]: qemu May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pseries-jammy May 28 12:44:45 l75lg1-v1 nova-compute[83654]: ppc64le May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/share/OVMF/OVMF_CODE.fd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/share/OVMF/OVMF_CODE.secboot.fd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/share/AAVMF/AAVMF_CODE.fd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/share/AAVMF/AAVMF32_CODE.fd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/share/OVMF/OVMF_CODE.ms.fd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: rom May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pflash May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: yes May 28 12:44:45 l75lg1-v1 nova-compute[83654]: no May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: no May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: on May 28 12:44:45 l75lg1-v1 nova-compute[83654]: off May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: POWER9 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: POWER8 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: POWER7 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: file May 28 12:44:45 l75lg1-v1 nova-compute[83654]: anonymous May 28 12:44:45 l75lg1-v1 nova-compute[83654]: memfd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: disk May 28 12:44:45 l75lg1-v1 nova-compute[83654]: cdrom May 28 12:44:45 l75lg1-v1 nova-compute[83654]: lun May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: scsi May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio May 28 12:44:45 l75lg1-v1 nova-compute[83654]: usb May 28 12:44:45 l75lg1-v1 nova-compute[83654]: sata May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio-transitional May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio-non-transitional May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: sdl May 28 12:44:45 l75lg1-v1 nova-compute[83654]: vnc May 28 12:44:45 l75lg1-v1 nova-compute[83654]: spice May 28 12:44:45 l75lg1-v1 nova-compute[83654]: egl-headless May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: subsystem May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: default May 28 12:44:45 l75lg1-v1 nova-compute[83654]: mandatory May 28 12:44:45 l75lg1-v1 nova-compute[83654]: requisite May 28 12:44:45 l75lg1-v1 nova-compute[83654]: optional May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: usb May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pci May 28 12:44:45 l75lg1-v1 nova-compute[83654]: scsi May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio-transitional May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio-non-transitional May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: random May 28 12:44:45 l75lg1-v1 nova-compute[83654]: egd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: builtin May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: path May 28 12:44:45 l75lg1-v1 nova-compute[83654]: handle May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtiofs May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: tpm-spapr May 28 12:44:45 l75lg1-v1 nova-compute[83654]: spapr-tpm-proxy May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: passthrough May 28 12:44:45 l75lg1-v1 nova-compute[83654]: emulator May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: {{(pid=83654) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}} May 28 12:44:45 l75lg1-v1 nova-compute[83654]: DEBUG nova.virt.libvirt.host [None req-d5e2622c-e52e-4f3d-871c-2ddda502f287 None None] Libvirt host hypervisor capabilities for arch=ppc64le and machine_type=powernv: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/bin/qemu-system-ppc64le May 28 12:44:45 l75lg1-v1 nova-compute[83654]: qemu May 28 12:44:45 l75lg1-v1 nova-compute[83654]: powernv9 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: ppc64le May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/share/OVMF/OVMF_CODE.fd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/share/OVMF/OVMF_CODE.secboot.fd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/share/AAVMF/AAVMF_CODE.fd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/share/AAVMF/AAVMF32_CODE.fd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/share/OVMF/OVMF_CODE.ms.fd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: rom May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pflash May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: yes May 28 12:44:45 l75lg1-v1 nova-compute[83654]: no May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: no May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: on May 28 12:44:45 l75lg1-v1 nova-compute[83654]: off May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: POWER9 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: POWER8 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: POWER7 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: file May 28 12:44:45 l75lg1-v1 nova-compute[83654]: anonymous May 28 12:44:45 l75lg1-v1 nova-compute[83654]: memfd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: disk May 28 12:44:45 l75lg1-v1 nova-compute[83654]: cdrom May 28 12:44:45 l75lg1-v1 nova-compute[83654]: floppy May 28 12:44:45 l75lg1-v1 nova-compute[83654]: lun May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: fdc May 28 12:44:45 l75lg1-v1 nova-compute[83654]: scsi May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio May 28 12:44:45 l75lg1-v1 nova-compute[83654]: usb May 28 12:44:45 l75lg1-v1 nova-compute[83654]: sata May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio-transitional May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio-non-transitional May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: sdl May 28 12:44:45 l75lg1-v1 nova-compute[83654]: vnc May 28 12:44:45 l75lg1-v1 nova-compute[83654]: spice May 28 12:44:45 l75lg1-v1 nova-compute[83654]: egl-headless May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: subsystem May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: default May 28 12:44:45 l75lg1-v1 nova-compute[83654]: mandatory May 28 12:44:45 l75lg1-v1 nova-compute[83654]: requisite May 28 12:44:45 l75lg1-v1 nova-compute[83654]: optional May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: usb May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pci May 28 12:44:45 l75lg1-v1 nova-compute[83654]: scsi May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio-transitional May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio-non-transitional May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: random May 28 12:44:45 l75lg1-v1 nova-compute[83654]: egd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: builtin May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: path May 28 12:44:45 l75lg1-v1 nova-compute[83654]: handle May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtiofs May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: tpm-spapr May 28 12:44:45 l75lg1-v1 nova-compute[83654]: spapr-tpm-proxy May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: passthrough May 28 12:44:45 l75lg1-v1 nova-compute[83654]: emulator May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: {{(pid=83654) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}} May 28 12:44:45 l75lg1-v1 nova-compute[83654]: DEBUG nova.virt.libvirt.host [None req-d5e2622c-e52e-4f3d-871c-2ddda502f287 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=83654) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}} May 28 12:44:45 l75lg1-v1 nova-compute[83654]: DEBUG nova.virt.libvirt.host [None req-d5e2622c-e52e-4f3d-871c-2ddda502f287 None None] Libvirt host hypervisor capabilities for arch=riscv32 and machine_type=None: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/bin/qemu-system-riscv32 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: qemu May 28 12:44:45 l75lg1-v1 nova-compute[83654]: spike May 28 12:44:45 l75lg1-v1 nova-compute[83654]: riscv32 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/share/OVMF/OVMF_CODE.fd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/share/OVMF/OVMF_CODE.secboot.fd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/share/AAVMF/AAVMF_CODE.fd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/share/AAVMF/AAVMF32_CODE.fd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/share/OVMF/OVMF_CODE.ms.fd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: rom May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pflash May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: yes May 28 12:44:45 l75lg1-v1 nova-compute[83654]: no May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: no May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: file May 28 12:44:45 l75lg1-v1 nova-compute[83654]: anonymous May 28 12:44:45 l75lg1-v1 nova-compute[83654]: memfd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: disk May 28 12:44:45 l75lg1-v1 nova-compute[83654]: cdrom May 28 12:44:45 l75lg1-v1 nova-compute[83654]: floppy May 28 12:44:45 l75lg1-v1 nova-compute[83654]: lun May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: fdc May 28 12:44:45 l75lg1-v1 nova-compute[83654]: scsi May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio May 28 12:44:45 l75lg1-v1 nova-compute[83654]: usb May 28 12:44:45 l75lg1-v1 nova-compute[83654]: sata May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio-transitional May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio-non-transitional May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: sdl May 28 12:44:45 l75lg1-v1 nova-compute[83654]: vnc May 28 12:44:45 l75lg1-v1 nova-compute[83654]: spice May 28 12:44:45 l75lg1-v1 nova-compute[83654]: egl-headless May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: subsystem May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: default May 28 12:44:45 l75lg1-v1 nova-compute[83654]: mandatory May 28 12:44:45 l75lg1-v1 nova-compute[83654]: requisite May 28 12:44:45 l75lg1-v1 nova-compute[83654]: optional May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: usb May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pci May 28 12:44:45 l75lg1-v1 nova-compute[83654]: scsi May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio-transitional May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio-non-transitional May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: random May 28 12:44:45 l75lg1-v1 nova-compute[83654]: egd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: builtin May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: path May 28 12:44:45 l75lg1-v1 nova-compute[83654]: handle May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtiofs May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: {{(pid=83654) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}} May 28 12:44:45 l75lg1-v1 nova-compute[83654]: DEBUG nova.virt.libvirt.host [None req-d5e2622c-e52e-4f3d-871c-2ddda502f287 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=83654) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}} May 28 12:44:45 l75lg1-v1 nova-compute[83654]: DEBUG nova.virt.libvirt.host [None req-d5e2622c-e52e-4f3d-871c-2ddda502f287 None None] Libvirt host hypervisor capabilities for arch=riscv64 and machine_type=None: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/bin/qemu-system-riscv64 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: qemu May 28 12:44:45 l75lg1-v1 nova-compute[83654]: spike May 28 12:44:45 l75lg1-v1 nova-compute[83654]: riscv64 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/share/OVMF/OVMF_CODE.fd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/share/OVMF/OVMF_CODE.secboot.fd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/share/AAVMF/AAVMF_CODE.fd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/share/AAVMF/AAVMF32_CODE.fd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/share/OVMF/OVMF_CODE.ms.fd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: rom May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pflash May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: yes May 28 12:44:45 l75lg1-v1 nova-compute[83654]: no May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: no May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: file May 28 12:44:45 l75lg1-v1 nova-compute[83654]: anonymous May 28 12:44:45 l75lg1-v1 nova-compute[83654]: memfd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: disk May 28 12:44:45 l75lg1-v1 nova-compute[83654]: cdrom May 28 12:44:45 l75lg1-v1 nova-compute[83654]: floppy May 28 12:44:45 l75lg1-v1 nova-compute[83654]: lun May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: fdc May 28 12:44:45 l75lg1-v1 nova-compute[83654]: scsi May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio May 28 12:44:45 l75lg1-v1 nova-compute[83654]: usb May 28 12:44:45 l75lg1-v1 nova-compute[83654]: sata May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio-transitional May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio-non-transitional May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: sdl May 28 12:44:45 l75lg1-v1 nova-compute[83654]: vnc May 28 12:44:45 l75lg1-v1 nova-compute[83654]: spice May 28 12:44:45 l75lg1-v1 nova-compute[83654]: egl-headless May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: subsystem May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: default May 28 12:44:45 l75lg1-v1 nova-compute[83654]: mandatory May 28 12:44:45 l75lg1-v1 nova-compute[83654]: requisite May 28 12:44:45 l75lg1-v1 nova-compute[83654]: optional May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: usb May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pci May 28 12:44:45 l75lg1-v1 nova-compute[83654]: scsi May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio-transitional May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio-non-transitional May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: random May 28 12:44:45 l75lg1-v1 nova-compute[83654]: egd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: builtin May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: path May 28 12:44:45 l75lg1-v1 nova-compute[83654]: handle May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtiofs May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: {{(pid=83654) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}} May 28 12:44:45 l75lg1-v1 nova-compute[83654]: DEBUG nova.virt.libvirt.host [None req-d5e2622c-e52e-4f3d-871c-2ddda502f287 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=83654) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}} May 28 12:44:45 l75lg1-v1 nova-compute[83654]: DEBUG nova.virt.libvirt.host [None req-d5e2622c-e52e-4f3d-871c-2ddda502f287 None None] Libvirt host hypervisor capabilities for arch=s390x and machine_type=s390-ccw-virtio: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/bin/qemu-system-s390x May 28 12:44:45 l75lg1-v1 nova-compute[83654]: qemu May 28 12:44:45 l75lg1-v1 nova-compute[83654]: s390-ccw-virtio-jammy May 28 12:44:45 l75lg1-v1 nova-compute[83654]: s390x May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/share/OVMF/OVMF_CODE.fd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/share/OVMF/OVMF_CODE.secboot.fd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/share/AAVMF/AAVMF_CODE.fd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/share/AAVMF/AAVMF32_CODE.fd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/share/OVMF/OVMF_CODE.ms.fd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: rom May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pflash May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: yes May 28 12:44:45 l75lg1-v1 nova-compute[83654]: no May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: no May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: on May 28 12:44:45 l75lg1-v1 nova-compute[83654]: off May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: gen16a-base May 28 12:44:45 l75lg1-v1 nova-compute[83654]: z800-base May 28 12:44:45 l75lg1-v1 nova-compute[83654]: z890.2-base May 28 12:44:45 l75lg1-v1 nova-compute[83654]: gen16a May 28 12:44:45 l75lg1-v1 nova-compute[83654]: z9EC.2 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: z13.2 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: z990.5-base May 28 12:44:45 l75lg1-v1 nova-compute[83654]: z9BC-base May 28 12:44:45 l75lg1-v1 nova-compute[83654]: z890.2 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: z890 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: z9BC May 28 12:44:45 l75lg1-v1 nova-compute[83654]: z13 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: z196 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: z13s May 28 12:44:45 l75lg1-v1 nova-compute[83654]: z990.3 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: gen16b-base May 28 12:44:45 l75lg1-v1 nova-compute[83654]: z13s-base May 28 12:44:45 l75lg1-v1 nova-compute[83654]: z13.2-base May 28 12:44:45 l75lg1-v1 nova-compute[83654]: z9EC May 28 12:44:45 l75lg1-v1 nova-compute[83654]: gen15a May 28 12:44:45 l75lg1-v1 nova-compute[83654]: z14ZR1-base May 28 12:44:45 l75lg1-v1 nova-compute[83654]: z14.2-base May 28 12:44:45 l75lg1-v1 nova-compute[83654]: z900.3-base May 28 12:44:45 l75lg1-v1 nova-compute[83654]: z196.2-base May 28 12:44:45 l75lg1-v1 nova-compute[83654]: zBC12-base May 28 12:44:45 l75lg1-v1 nova-compute[83654]: z9BC.2-base May 28 12:44:45 l75lg1-v1 nova-compute[83654]: z900.2-base May 28 12:44:45 l75lg1-v1 nova-compute[83654]: z9EC.3 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: zEC12 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: z900 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: z114-base May 28 12:44:45 l75lg1-v1 nova-compute[83654]: zEC12-base May 28 12:44:45 l75lg1-v1 nova-compute[83654]: z10EC.2 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: z10EC-base May 28 12:44:45 l75lg1-v1 nova-compute[83654]: z900.3 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: z14ZR1 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: z10BC May 28 12:44:45 l75lg1-v1 nova-compute[83654]: z10BC.2-base May 28 12:44:45 l75lg1-v1 nova-compute[83654]: z9BC.2 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: z990.2 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: z990 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: z14 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: gen15b-base May 28 12:44:45 l75lg1-v1 nova-compute[83654]: z990.4 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: max May 28 12:44:45 l75lg1-v1 nova-compute[83654]: z10EC.2-base May 28 12:44:45 l75lg1-v1 nova-compute[83654]: gen16b May 28 12:44:45 l75lg1-v1 nova-compute[83654]: gen15a-base May 28 12:44:45 l75lg1-v1 nova-compute[83654]: z800 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: z10EC May 28 12:44:45 l75lg1-v1 nova-compute[83654]: zEC12.2 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: z990.2-base May 28 12:44:45 l75lg1-v1 nova-compute[83654]: z900-base May 28 12:44:45 l75lg1-v1 nova-compute[83654]: z10BC.2 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: z9EC-base May 28 12:44:45 l75lg1-v1 nova-compute[83654]: z9EC.3-base May 28 12:44:45 l75lg1-v1 nova-compute[83654]: z114 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: z890.3 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: z196-base May 28 12:44:45 l75lg1-v1 nova-compute[83654]: z9EC.2-base May 28 12:44:45 l75lg1-v1 nova-compute[83654]: z196.2 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: z14.2 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: z990-base May 28 12:44:45 l75lg1-v1 nova-compute[83654]: z900.2 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: z890-base May 28 12:44:45 l75lg1-v1 nova-compute[83654]: z10EC.3 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: z14-base May 28 12:44:45 l75lg1-v1 nova-compute[83654]: z990.4-base May 28 12:44:45 l75lg1-v1 nova-compute[83654]: z10EC.3-base May 28 12:44:45 l75lg1-v1 nova-compute[83654]: z10BC-base May 28 12:44:45 l75lg1-v1 nova-compute[83654]: z13-base May 28 12:44:45 l75lg1-v1 nova-compute[83654]: z990.3-base May 28 12:44:45 l75lg1-v1 nova-compute[83654]: zEC12.2-base May 28 12:44:45 l75lg1-v1 nova-compute[83654]: zBC12 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: z890.3-base May 28 12:44:45 l75lg1-v1 nova-compute[83654]: z990.5 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: gen15b May 28 12:44:45 l75lg1-v1 nova-compute[83654]: qemu May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: file May 28 12:44:45 l75lg1-v1 nova-compute[83654]: anonymous May 28 12:44:45 l75lg1-v1 nova-compute[83654]: memfd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: disk May 28 12:44:45 l75lg1-v1 nova-compute[83654]: cdrom May 28 12:44:45 l75lg1-v1 nova-compute[83654]: floppy May 28 12:44:45 l75lg1-v1 nova-compute[83654]: lun May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: fdc May 28 12:44:45 l75lg1-v1 nova-compute[83654]: scsi May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio-transitional May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio-non-transitional May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: sdl May 28 12:44:45 l75lg1-v1 nova-compute[83654]: vnc May 28 12:44:45 l75lg1-v1 nova-compute[83654]: spice May 28 12:44:45 l75lg1-v1 nova-compute[83654]: egl-headless May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: subsystem May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: default May 28 12:44:45 l75lg1-v1 nova-compute[83654]: mandatory May 28 12:44:45 l75lg1-v1 nova-compute[83654]: requisite May 28 12:44:45 l75lg1-v1 nova-compute[83654]: optional May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pci May 28 12:44:45 l75lg1-v1 nova-compute[83654]: scsi May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio-transitional May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio-non-transitional May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: random May 28 12:44:45 l75lg1-v1 nova-compute[83654]: egd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: builtin May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: path May 28 12:44:45 l75lg1-v1 nova-compute[83654]: handle May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtiofs May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: {{(pid=83654) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}} May 28 12:44:45 l75lg1-v1 nova-compute[83654]: DEBUG nova.virt.libvirt.host [None req-d5e2622c-e52e-4f3d-871c-2ddda502f287 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=83654) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}} May 28 12:44:45 l75lg1-v1 nova-compute[83654]: DEBUG nova.virt.libvirt.host [None req-d5e2622c-e52e-4f3d-871c-2ddda502f287 None None] Libvirt host hypervisor capabilities for arch=sh4 and machine_type=None: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/bin/qemu-system-sh4 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: qemu May 28 12:44:45 l75lg1-v1 nova-compute[83654]: shix May 28 12:44:45 l75lg1-v1 nova-compute[83654]: sh4 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/share/OVMF/OVMF_CODE.fd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/share/OVMF/OVMF_CODE.secboot.fd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/share/AAVMF/AAVMF_CODE.fd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/share/AAVMF/AAVMF32_CODE.fd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/share/OVMF/OVMF_CODE.ms.fd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: rom May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pflash May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: yes May 28 12:44:45 l75lg1-v1 nova-compute[83654]: no May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: no May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: file May 28 12:44:45 l75lg1-v1 nova-compute[83654]: anonymous May 28 12:44:45 l75lg1-v1 nova-compute[83654]: memfd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: disk May 28 12:44:45 l75lg1-v1 nova-compute[83654]: cdrom May 28 12:44:45 l75lg1-v1 nova-compute[83654]: floppy May 28 12:44:45 l75lg1-v1 nova-compute[83654]: lun May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: fdc May 28 12:44:45 l75lg1-v1 nova-compute[83654]: scsi May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio May 28 12:44:45 l75lg1-v1 nova-compute[83654]: usb May 28 12:44:45 l75lg1-v1 nova-compute[83654]: sata May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio-transitional May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio-non-transitional May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: sdl May 28 12:44:45 l75lg1-v1 nova-compute[83654]: vnc May 28 12:44:45 l75lg1-v1 nova-compute[83654]: spice May 28 12:44:45 l75lg1-v1 nova-compute[83654]: egl-headless May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: subsystem May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: default May 28 12:44:45 l75lg1-v1 nova-compute[83654]: mandatory May 28 12:44:45 l75lg1-v1 nova-compute[83654]: requisite May 28 12:44:45 l75lg1-v1 nova-compute[83654]: optional May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: usb May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pci May 28 12:44:45 l75lg1-v1 nova-compute[83654]: scsi May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio-transitional May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio-non-transitional May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: random May 28 12:44:45 l75lg1-v1 nova-compute[83654]: egd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: builtin May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: path May 28 12:44:45 l75lg1-v1 nova-compute[83654]: handle May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtiofs May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: {{(pid=83654) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}} May 28 12:44:45 l75lg1-v1 nova-compute[83654]: DEBUG nova.virt.libvirt.host [None req-d5e2622c-e52e-4f3d-871c-2ddda502f287 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=83654) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}} May 28 12:44:45 l75lg1-v1 nova-compute[83654]: DEBUG nova.virt.libvirt.host [None req-d5e2622c-e52e-4f3d-871c-2ddda502f287 None None] Libvirt host hypervisor capabilities for arch=sh4eb and machine_type=None: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/bin/qemu-system-sh4eb May 28 12:44:45 l75lg1-v1 nova-compute[83654]: qemu May 28 12:44:45 l75lg1-v1 nova-compute[83654]: shix May 28 12:44:45 l75lg1-v1 nova-compute[83654]: sh4eb May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/share/OVMF/OVMF_CODE.fd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/share/OVMF/OVMF_CODE.secboot.fd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/share/AAVMF/AAVMF_CODE.fd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/share/AAVMF/AAVMF32_CODE.fd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/share/OVMF/OVMF_CODE.ms.fd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: rom May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pflash May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: yes May 28 12:44:45 l75lg1-v1 nova-compute[83654]: no May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: no May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: file May 28 12:44:45 l75lg1-v1 nova-compute[83654]: anonymous May 28 12:44:45 l75lg1-v1 nova-compute[83654]: memfd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: disk May 28 12:44:45 l75lg1-v1 nova-compute[83654]: cdrom May 28 12:44:45 l75lg1-v1 nova-compute[83654]: floppy May 28 12:44:45 l75lg1-v1 nova-compute[83654]: lun May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: fdc May 28 12:44:45 l75lg1-v1 nova-compute[83654]: scsi May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio May 28 12:44:45 l75lg1-v1 nova-compute[83654]: usb May 28 12:44:45 l75lg1-v1 nova-compute[83654]: sata May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio-transitional May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio-non-transitional May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: sdl May 28 12:44:45 l75lg1-v1 nova-compute[83654]: vnc May 28 12:44:45 l75lg1-v1 nova-compute[83654]: spice May 28 12:44:45 l75lg1-v1 nova-compute[83654]: egl-headless May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: subsystem May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: default May 28 12:44:45 l75lg1-v1 nova-compute[83654]: mandatory May 28 12:44:45 l75lg1-v1 nova-compute[83654]: requisite May 28 12:44:45 l75lg1-v1 nova-compute[83654]: optional May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: usb May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pci May 28 12:44:45 l75lg1-v1 nova-compute[83654]: scsi May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio-transitional May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio-non-transitional May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: random May 28 12:44:45 l75lg1-v1 nova-compute[83654]: egd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: builtin May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: path May 28 12:44:45 l75lg1-v1 nova-compute[83654]: handle May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtiofs May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: {{(pid=83654) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}} May 28 12:44:45 l75lg1-v1 nova-compute[83654]: DEBUG nova.virt.libvirt.host [None req-d5e2622c-e52e-4f3d-871c-2ddda502f287 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=83654) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}} May 28 12:44:45 l75lg1-v1 nova-compute[83654]: DEBUG nova.virt.libvirt.host [None req-d5e2622c-e52e-4f3d-871c-2ddda502f287 None None] Libvirt host hypervisor capabilities for arch=sparc and machine_type=None: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/bin/qemu-system-sparc May 28 12:44:45 l75lg1-v1 nova-compute[83654]: qemu May 28 12:44:45 l75lg1-v1 nova-compute[83654]: SS-5 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: sparc May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/share/OVMF/OVMF_CODE.fd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/share/OVMF/OVMF_CODE.secboot.fd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/share/AAVMF/AAVMF_CODE.fd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/share/AAVMF/AAVMF32_CODE.fd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/share/OVMF/OVMF_CODE.ms.fd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: rom May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pflash May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: yes May 28 12:44:45 l75lg1-v1 nova-compute[83654]: no May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: no May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: file May 28 12:44:45 l75lg1-v1 nova-compute[83654]: anonymous May 28 12:44:45 l75lg1-v1 nova-compute[83654]: memfd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: disk May 28 12:44:45 l75lg1-v1 nova-compute[83654]: cdrom May 28 12:44:45 l75lg1-v1 nova-compute[83654]: floppy May 28 12:44:45 l75lg1-v1 nova-compute[83654]: lun May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: fdc May 28 12:44:45 l75lg1-v1 nova-compute[83654]: scsi May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: sdl May 28 12:44:45 l75lg1-v1 nova-compute[83654]: vnc May 28 12:44:45 l75lg1-v1 nova-compute[83654]: spice May 28 12:44:45 l75lg1-v1 nova-compute[83654]: egl-headless May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: subsystem May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: default May 28 12:44:45 l75lg1-v1 nova-compute[83654]: mandatory May 28 12:44:45 l75lg1-v1 nova-compute[83654]: requisite May 28 12:44:45 l75lg1-v1 nova-compute[83654]: optional May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pci May 28 12:44:45 l75lg1-v1 nova-compute[83654]: scsi May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: random May 28 12:44:45 l75lg1-v1 nova-compute[83654]: egd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: builtin May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: path May 28 12:44:45 l75lg1-v1 nova-compute[83654]: handle May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: {{(pid=83654) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}} May 28 12:44:45 l75lg1-v1 nova-compute[83654]: DEBUG nova.virt.libvirt.host [None req-d5e2622c-e52e-4f3d-871c-2ddda502f287 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=83654) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}} May 28 12:44:45 l75lg1-v1 nova-compute[83654]: DEBUG nova.virt.libvirt.host [None req-d5e2622c-e52e-4f3d-871c-2ddda502f287 None None] Libvirt host hypervisor capabilities for arch=sparc64 and machine_type=None: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/bin/qemu-system-sparc64 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: qemu May 28 12:44:45 l75lg1-v1 nova-compute[83654]: sun4u May 28 12:44:45 l75lg1-v1 nova-compute[83654]: sparc64 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/share/OVMF/OVMF_CODE.fd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/share/OVMF/OVMF_CODE.secboot.fd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/share/AAVMF/AAVMF_CODE.fd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/share/AAVMF/AAVMF32_CODE.fd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/share/OVMF/OVMF_CODE.ms.fd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: rom May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pflash May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: yes May 28 12:44:45 l75lg1-v1 nova-compute[83654]: no May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: no May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: file May 28 12:44:45 l75lg1-v1 nova-compute[83654]: anonymous May 28 12:44:45 l75lg1-v1 nova-compute[83654]: memfd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: disk May 28 12:44:45 l75lg1-v1 nova-compute[83654]: cdrom May 28 12:44:45 l75lg1-v1 nova-compute[83654]: floppy May 28 12:44:45 l75lg1-v1 nova-compute[83654]: lun May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: ide May 28 12:44:45 l75lg1-v1 nova-compute[83654]: fdc May 28 12:44:45 l75lg1-v1 nova-compute[83654]: scsi May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio May 28 12:44:45 l75lg1-v1 nova-compute[83654]: usb May 28 12:44:45 l75lg1-v1 nova-compute[83654]: sata May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio-transitional May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio-non-transitional May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: sdl May 28 12:44:45 l75lg1-v1 nova-compute[83654]: vnc May 28 12:44:45 l75lg1-v1 nova-compute[83654]: spice May 28 12:44:45 l75lg1-v1 nova-compute[83654]: egl-headless May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: subsystem May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: default May 28 12:44:45 l75lg1-v1 nova-compute[83654]: mandatory May 28 12:44:45 l75lg1-v1 nova-compute[83654]: requisite May 28 12:44:45 l75lg1-v1 nova-compute[83654]: optional May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: usb May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pci May 28 12:44:45 l75lg1-v1 nova-compute[83654]: scsi May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio-transitional May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio-non-transitional May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: random May 28 12:44:45 l75lg1-v1 nova-compute[83654]: egd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: builtin May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: path May 28 12:44:45 l75lg1-v1 nova-compute[83654]: handle May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtiofs May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: {{(pid=83654) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}} May 28 12:44:45 l75lg1-v1 nova-compute[83654]: DEBUG nova.virt.libvirt.host [None req-d5e2622c-e52e-4f3d-871c-2ddda502f287 None None] Getting domain capabilities for x86_64 via machine types: {'ubuntu-q35', 'q35', 'ubuntu', 'pc'} {{(pid=83654) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}} May 28 12:44:45 l75lg1-v1 nova-compute[83654]: DEBUG nova.virt.libvirt.host [None req-d5e2622c-e52e-4f3d-871c-2ddda502f287 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/bin/qemu-system-x86_64 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: qemu May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-q35-jammy May 28 12:44:45 l75lg1-v1 nova-compute[83654]: x86_64 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: efi May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/share/OVMF/OVMF_CODE_4M.ms.fd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/share/OVMF/OVMF_CODE_4M.secboot.fd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/share/OVMF/OVMF_CODE_4M.fd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: rom May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pflash May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: yes May 28 12:44:45 l75lg1-v1 nova-compute[83654]: no May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: yes May 28 12:44:45 l75lg1-v1 nova-compute[83654]: no May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: on May 28 12:44:45 l75lg1-v1 nova-compute[83654]: off May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: EPYC May 28 12:44:45 l75lg1-v1 nova-compute[83654]: AMD May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: qemu64 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: qemu32 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: phenom May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pentium3 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pentium2 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pentium May 28 12:44:45 l75lg1-v1 nova-compute[83654]: n270 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: kvm64 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: kvm32 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: coreduo May 28 12:44:45 l75lg1-v1 nova-compute[83654]: core2duo May 28 12:44:45 l75lg1-v1 nova-compute[83654]: athlon May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Westmere-IBRS May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Westmere May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Snowridge May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Skylake-Server-noTSX-IBRS May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Skylake-Server-IBRS May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Skylake-Server May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Skylake-Client-noTSX-IBRS May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Skylake-Client-IBRS May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Skylake-Client May 28 12:44:45 l75lg1-v1 nova-compute[83654]: SandyBridge-IBRS May 28 12:44:45 l75lg1-v1 nova-compute[83654]: SandyBridge May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Penryn May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Opteron_G5 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Opteron_G4 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Opteron_G3 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Opteron_G2 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Opteron_G1 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Nehalem-IBRS May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Nehalem May 28 12:44:45 l75lg1-v1 nova-compute[83654]: IvyBridge-IBRS May 28 12:44:45 l75lg1-v1 nova-compute[83654]: IvyBridge May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Icelake-Server-noTSX May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Icelake-Server May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Icelake-Client-noTSX May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Icelake-Client May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Haswell-noTSX-IBRS May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Haswell-noTSX May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Haswell-IBRS May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Haswell May 28 12:44:45 l75lg1-v1 nova-compute[83654]: EPYC-Rome May 28 12:44:45 l75lg1-v1 nova-compute[83654]: EPYC-Milan May 28 12:44:45 l75lg1-v1 nova-compute[83654]: EPYC-IBPB May 28 12:44:45 l75lg1-v1 nova-compute[83654]: EPYC May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Dhyana May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Cooperlake May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Conroe May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Cascadelake-Server-noTSX May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Cascadelake-Server May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Broadwell-noTSX-IBRS May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Broadwell-noTSX May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Broadwell-IBRS May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Broadwell May 28 12:44:45 l75lg1-v1 nova-compute[83654]: 486 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: file May 28 12:44:45 l75lg1-v1 nova-compute[83654]: anonymous May 28 12:44:45 l75lg1-v1 nova-compute[83654]: memfd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: disk May 28 12:44:45 l75lg1-v1 nova-compute[83654]: cdrom May 28 12:44:45 l75lg1-v1 nova-compute[83654]: floppy May 28 12:44:45 l75lg1-v1 nova-compute[83654]: lun May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: fdc May 28 12:44:45 l75lg1-v1 nova-compute[83654]: scsi May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio May 28 12:44:45 l75lg1-v1 nova-compute[83654]: usb May 28 12:44:45 l75lg1-v1 nova-compute[83654]: sata May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio-transitional May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio-non-transitional May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: sdl May 28 12:44:45 l75lg1-v1 nova-compute[83654]: vnc May 28 12:44:45 l75lg1-v1 nova-compute[83654]: spice May 28 12:44:45 l75lg1-v1 nova-compute[83654]: egl-headless May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: subsystem May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: default May 28 12:44:45 l75lg1-v1 nova-compute[83654]: mandatory May 28 12:44:45 l75lg1-v1 nova-compute[83654]: requisite May 28 12:44:45 l75lg1-v1 nova-compute[83654]: optional May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: usb May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pci May 28 12:44:45 l75lg1-v1 nova-compute[83654]: scsi May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio-transitional May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio-non-transitional May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: random May 28 12:44:45 l75lg1-v1 nova-compute[83654]: egd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: builtin May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: path May 28 12:44:45 l75lg1-v1 nova-compute[83654]: handle May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtiofs May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: tpm-tis May 28 12:44:45 l75lg1-v1 nova-compute[83654]: tpm-crb May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: passthrough May 28 12:44:45 l75lg1-v1 nova-compute[83654]: emulator May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: {{(pid=83654) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}} May 28 12:44:45 l75lg1-v1 nova-compute[83654]: DEBUG nova.virt.libvirt.host [None req-d5e2622c-e52e-4f3d-871c-2ddda502f287 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/bin/qemu-system-x86_64 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: qemu May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-q35-6.2 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: x86_64 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: efi May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/share/OVMF/OVMF_CODE_4M.ms.fd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/share/OVMF/OVMF_CODE_4M.secboot.fd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/share/OVMF/OVMF_CODE_4M.fd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: rom May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pflash May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: yes May 28 12:44:45 l75lg1-v1 nova-compute[83654]: no May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: yes May 28 12:44:45 l75lg1-v1 nova-compute[83654]: no May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: on May 28 12:44:45 l75lg1-v1 nova-compute[83654]: off May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: EPYC May 28 12:44:45 l75lg1-v1 nova-compute[83654]: AMD May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: qemu64 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: qemu32 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: phenom May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pentium3 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pentium2 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pentium May 28 12:44:45 l75lg1-v1 nova-compute[83654]: n270 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: kvm64 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: kvm32 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: coreduo May 28 12:44:45 l75lg1-v1 nova-compute[83654]: core2duo May 28 12:44:45 l75lg1-v1 nova-compute[83654]: athlon May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Westmere-IBRS May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Westmere May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Snowridge May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Skylake-Server-noTSX-IBRS May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Skylake-Server-IBRS May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Skylake-Server May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Skylake-Client-noTSX-IBRS May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Skylake-Client-IBRS May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Skylake-Client May 28 12:44:45 l75lg1-v1 nova-compute[83654]: SandyBridge-IBRS May 28 12:44:45 l75lg1-v1 nova-compute[83654]: SandyBridge May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Penryn May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Opteron_G5 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Opteron_G4 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Opteron_G3 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Opteron_G2 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Opteron_G1 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Nehalem-IBRS May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Nehalem May 28 12:44:45 l75lg1-v1 nova-compute[83654]: IvyBridge-IBRS May 28 12:44:45 l75lg1-v1 nova-compute[83654]: IvyBridge May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Icelake-Server-noTSX May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Icelake-Server May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Icelake-Client-noTSX May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Icelake-Client May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Haswell-noTSX-IBRS May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Haswell-noTSX May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Haswell-IBRS May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Haswell May 28 12:44:45 l75lg1-v1 nova-compute[83654]: EPYC-Rome May 28 12:44:45 l75lg1-v1 nova-compute[83654]: EPYC-Milan May 28 12:44:45 l75lg1-v1 nova-compute[83654]: EPYC-IBPB May 28 12:44:45 l75lg1-v1 nova-compute[83654]: EPYC May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Dhyana May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Cooperlake May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Conroe May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Cascadelake-Server-noTSX May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Cascadelake-Server May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Broadwell-noTSX-IBRS May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Broadwell-noTSX May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Broadwell-IBRS May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Broadwell May 28 12:44:45 l75lg1-v1 nova-compute[83654]: 486 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: file May 28 12:44:45 l75lg1-v1 nova-compute[83654]: anonymous May 28 12:44:45 l75lg1-v1 nova-compute[83654]: memfd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: disk May 28 12:44:45 l75lg1-v1 nova-compute[83654]: cdrom May 28 12:44:45 l75lg1-v1 nova-compute[83654]: floppy May 28 12:44:45 l75lg1-v1 nova-compute[83654]: lun May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: fdc May 28 12:44:45 l75lg1-v1 nova-compute[83654]: scsi May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio May 28 12:44:45 l75lg1-v1 nova-compute[83654]: usb May 28 12:44:45 l75lg1-v1 nova-compute[83654]: sata May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio-transitional May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio-non-transitional May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: sdl May 28 12:44:45 l75lg1-v1 nova-compute[83654]: vnc May 28 12:44:45 l75lg1-v1 nova-compute[83654]: spice May 28 12:44:45 l75lg1-v1 nova-compute[83654]: egl-headless May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: subsystem May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: default May 28 12:44:45 l75lg1-v1 nova-compute[83654]: mandatory May 28 12:44:45 l75lg1-v1 nova-compute[83654]: requisite May 28 12:44:45 l75lg1-v1 nova-compute[83654]: optional May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: usb May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pci May 28 12:44:45 l75lg1-v1 nova-compute[83654]: scsi May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio-transitional May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio-non-transitional May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: random May 28 12:44:45 l75lg1-v1 nova-compute[83654]: egd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: builtin May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: path May 28 12:44:45 l75lg1-v1 nova-compute[83654]: handle May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtiofs May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: tpm-tis May 28 12:44:45 l75lg1-v1 nova-compute[83654]: tpm-crb May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: passthrough May 28 12:44:45 l75lg1-v1 nova-compute[83654]: emulator May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: {{(pid=83654) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}} May 28 12:44:45 l75lg1-v1 nova-compute[83654]: DEBUG nova.virt.libvirt.host [None req-d5e2622c-e52e-4f3d-871c-2ddda502f287 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/bin/qemu-system-x86_64 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: qemu May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-i440fx-jammy May 28 12:44:45 l75lg1-v1 nova-compute[83654]: x86_64 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: efi May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/share/OVMF/OVMF_CODE_4M.fd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: rom May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pflash May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: yes May 28 12:44:45 l75lg1-v1 nova-compute[83654]: no May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: no May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: on May 28 12:44:45 l75lg1-v1 nova-compute[83654]: off May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: EPYC May 28 12:44:45 l75lg1-v1 nova-compute[83654]: AMD May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: qemu64 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: qemu32 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: phenom May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pentium3 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pentium2 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pentium May 28 12:44:45 l75lg1-v1 nova-compute[83654]: n270 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: kvm64 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: kvm32 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: coreduo May 28 12:44:45 l75lg1-v1 nova-compute[83654]: core2duo May 28 12:44:45 l75lg1-v1 nova-compute[83654]: athlon May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Westmere-IBRS May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Westmere May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Snowridge May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Skylake-Server-noTSX-IBRS May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Skylake-Server-IBRS May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Skylake-Server May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Skylake-Client-noTSX-IBRS May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Skylake-Client-IBRS May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Skylake-Client May 28 12:44:45 l75lg1-v1 nova-compute[83654]: SandyBridge-IBRS May 28 12:44:45 l75lg1-v1 nova-compute[83654]: SandyBridge May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Penryn May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Opteron_G5 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Opteron_G4 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Opteron_G3 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Opteron_G2 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Opteron_G1 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Nehalem-IBRS May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Nehalem May 28 12:44:45 l75lg1-v1 nova-compute[83654]: IvyBridge-IBRS May 28 12:44:45 l75lg1-v1 nova-compute[83654]: IvyBridge May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Icelake-Server-noTSX May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Icelake-Server May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Icelake-Client-noTSX May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Icelake-Client May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Haswell-noTSX-IBRS May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Haswell-noTSX May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Haswell-IBRS May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Haswell May 28 12:44:45 l75lg1-v1 nova-compute[83654]: EPYC-Rome May 28 12:44:45 l75lg1-v1 nova-compute[83654]: EPYC-Milan May 28 12:44:45 l75lg1-v1 nova-compute[83654]: EPYC-IBPB May 28 12:44:45 l75lg1-v1 nova-compute[83654]: EPYC May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Dhyana May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Cooperlake May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Conroe May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Cascadelake-Server-noTSX May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Cascadelake-Server May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Broadwell-noTSX-IBRS May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Broadwell-noTSX May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Broadwell-IBRS May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Broadwell May 28 12:44:45 l75lg1-v1 nova-compute[83654]: 486 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: file May 28 12:44:45 l75lg1-v1 nova-compute[83654]: anonymous May 28 12:44:45 l75lg1-v1 nova-compute[83654]: memfd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: disk May 28 12:44:45 l75lg1-v1 nova-compute[83654]: cdrom May 28 12:44:45 l75lg1-v1 nova-compute[83654]: floppy May 28 12:44:45 l75lg1-v1 nova-compute[83654]: lun May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: ide May 28 12:44:45 l75lg1-v1 nova-compute[83654]: fdc May 28 12:44:45 l75lg1-v1 nova-compute[83654]: scsi May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio May 28 12:44:45 l75lg1-v1 nova-compute[83654]: usb May 28 12:44:45 l75lg1-v1 nova-compute[83654]: sata May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio-transitional May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio-non-transitional May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: sdl May 28 12:44:45 l75lg1-v1 nova-compute[83654]: vnc May 28 12:44:45 l75lg1-v1 nova-compute[83654]: spice May 28 12:44:45 l75lg1-v1 nova-compute[83654]: egl-headless May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: subsystem May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: default May 28 12:44:45 l75lg1-v1 nova-compute[83654]: mandatory May 28 12:44:45 l75lg1-v1 nova-compute[83654]: requisite May 28 12:44:45 l75lg1-v1 nova-compute[83654]: optional May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: usb May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pci May 28 12:44:45 l75lg1-v1 nova-compute[83654]: scsi May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio-transitional May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio-non-transitional May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: random May 28 12:44:45 l75lg1-v1 nova-compute[83654]: egd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: builtin May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: path May 28 12:44:45 l75lg1-v1 nova-compute[83654]: handle May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtiofs May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: tpm-tis May 28 12:44:45 l75lg1-v1 nova-compute[83654]: tpm-crb May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: passthrough May 28 12:44:45 l75lg1-v1 nova-compute[83654]: emulator May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: {{(pid=83654) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}} May 28 12:44:45 l75lg1-v1 nova-compute[83654]: DEBUG nova.virt.libvirt.host [None req-d5e2622c-e52e-4f3d-871c-2ddda502f287 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/bin/qemu-system-x86_64 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: qemu May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pc-i440fx-6.2 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: x86_64 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: efi May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/share/OVMF/OVMF_CODE_4M.fd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: rom May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pflash May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: yes May 28 12:44:45 l75lg1-v1 nova-compute[83654]: no May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: no May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: on May 28 12:44:45 l75lg1-v1 nova-compute[83654]: off May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: EPYC May 28 12:44:45 l75lg1-v1 nova-compute[83654]: AMD May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: qemu64 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: qemu32 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: phenom May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pentium3 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pentium2 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pentium May 28 12:44:45 l75lg1-v1 nova-compute[83654]: n270 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: kvm64 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: kvm32 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: coreduo May 28 12:44:45 l75lg1-v1 nova-compute[83654]: core2duo May 28 12:44:45 l75lg1-v1 nova-compute[83654]: athlon May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Westmere-IBRS May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Westmere May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Snowridge May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Skylake-Server-noTSX-IBRS May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Skylake-Server-IBRS May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Skylake-Server May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Skylake-Client-noTSX-IBRS May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Skylake-Client-IBRS May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Skylake-Client May 28 12:44:45 l75lg1-v1 nova-compute[83654]: SandyBridge-IBRS May 28 12:44:45 l75lg1-v1 nova-compute[83654]: SandyBridge May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Penryn May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Opteron_G5 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Opteron_G4 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Opteron_G3 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Opteron_G2 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Opteron_G1 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Nehalem-IBRS May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Nehalem May 28 12:44:45 l75lg1-v1 nova-compute[83654]: IvyBridge-IBRS May 28 12:44:45 l75lg1-v1 nova-compute[83654]: IvyBridge May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Icelake-Server-noTSX May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Icelake-Server May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Icelake-Client-noTSX May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Icelake-Client May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Haswell-noTSX-IBRS May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Haswell-noTSX May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Haswell-IBRS May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Haswell May 28 12:44:45 l75lg1-v1 nova-compute[83654]: EPYC-Rome May 28 12:44:45 l75lg1-v1 nova-compute[83654]: EPYC-Milan May 28 12:44:45 l75lg1-v1 nova-compute[83654]: EPYC-IBPB May 28 12:44:45 l75lg1-v1 nova-compute[83654]: EPYC May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Dhyana May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Cooperlake May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Conroe May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Cascadelake-Server-noTSX May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Cascadelake-Server May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Broadwell-noTSX-IBRS May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Broadwell-noTSX May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Broadwell-IBRS May 28 12:44:45 l75lg1-v1 nova-compute[83654]: Broadwell May 28 12:44:45 l75lg1-v1 nova-compute[83654]: 486 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: file May 28 12:44:45 l75lg1-v1 nova-compute[83654]: anonymous May 28 12:44:45 l75lg1-v1 nova-compute[83654]: memfd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: disk May 28 12:44:45 l75lg1-v1 nova-compute[83654]: cdrom May 28 12:44:45 l75lg1-v1 nova-compute[83654]: floppy May 28 12:44:45 l75lg1-v1 nova-compute[83654]: lun May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: ide May 28 12:44:45 l75lg1-v1 nova-compute[83654]: fdc May 28 12:44:45 l75lg1-v1 nova-compute[83654]: scsi May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio May 28 12:44:45 l75lg1-v1 nova-compute[83654]: usb May 28 12:44:45 l75lg1-v1 nova-compute[83654]: sata May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio-transitional May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio-non-transitional May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: sdl May 28 12:44:45 l75lg1-v1 nova-compute[83654]: vnc May 28 12:44:45 l75lg1-v1 nova-compute[83654]: spice May 28 12:44:45 l75lg1-v1 nova-compute[83654]: egl-headless May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: subsystem May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: default May 28 12:44:45 l75lg1-v1 nova-compute[83654]: mandatory May 28 12:44:45 l75lg1-v1 nova-compute[83654]: requisite May 28 12:44:45 l75lg1-v1 nova-compute[83654]: optional May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: usb May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pci May 28 12:44:45 l75lg1-v1 nova-compute[83654]: scsi May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio-transitional May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio-non-transitional May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: random May 28 12:44:45 l75lg1-v1 nova-compute[83654]: egd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: builtin May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: path May 28 12:44:45 l75lg1-v1 nova-compute[83654]: handle May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtiofs May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: tpm-tis May 28 12:44:45 l75lg1-v1 nova-compute[83654]: tpm-crb May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: passthrough May 28 12:44:45 l75lg1-v1 nova-compute[83654]: emulator May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: {{(pid=83654) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}} May 28 12:44:45 l75lg1-v1 nova-compute[83654]: DEBUG nova.virt.libvirt.host [None req-d5e2622c-e52e-4f3d-871c-2ddda502f287 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=83654) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}} May 28 12:44:45 l75lg1-v1 nova-compute[83654]: DEBUG nova.virt.libvirt.host [None req-d5e2622c-e52e-4f3d-871c-2ddda502f287 None None] Libvirt host hypervisor capabilities for arch=xtensa and machine_type=None: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/bin/qemu-system-xtensa May 28 12:44:45 l75lg1-v1 nova-compute[83654]: qemu May 28 12:44:45 l75lg1-v1 nova-compute[83654]: sim May 28 12:44:45 l75lg1-v1 nova-compute[83654]: xtensa May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/share/OVMF/OVMF_CODE.fd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/share/OVMF/OVMF_CODE.secboot.fd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/share/AAVMF/AAVMF_CODE.fd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/share/AAVMF/AAVMF32_CODE.fd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/share/OVMF/OVMF_CODE.ms.fd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: rom May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pflash May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: yes May 28 12:44:45 l75lg1-v1 nova-compute[83654]: no May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: no May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: file May 28 12:44:45 l75lg1-v1 nova-compute[83654]: anonymous May 28 12:44:45 l75lg1-v1 nova-compute[83654]: memfd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: disk May 28 12:44:45 l75lg1-v1 nova-compute[83654]: cdrom May 28 12:44:45 l75lg1-v1 nova-compute[83654]: floppy May 28 12:44:45 l75lg1-v1 nova-compute[83654]: lun May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: fdc May 28 12:44:45 l75lg1-v1 nova-compute[83654]: scsi May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio May 28 12:44:45 l75lg1-v1 nova-compute[83654]: usb May 28 12:44:45 l75lg1-v1 nova-compute[83654]: sata May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio-transitional May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio-non-transitional May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: sdl May 28 12:44:45 l75lg1-v1 nova-compute[83654]: vnc May 28 12:44:45 l75lg1-v1 nova-compute[83654]: spice May 28 12:44:45 l75lg1-v1 nova-compute[83654]: egl-headless May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: subsystem May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: default May 28 12:44:45 l75lg1-v1 nova-compute[83654]: mandatory May 28 12:44:45 l75lg1-v1 nova-compute[83654]: requisite May 28 12:44:45 l75lg1-v1 nova-compute[83654]: optional May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: usb May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pci May 28 12:44:45 l75lg1-v1 nova-compute[83654]: scsi May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio-transitional May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio-non-transitional May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: random May 28 12:44:45 l75lg1-v1 nova-compute[83654]: egd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: builtin May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: path May 28 12:44:45 l75lg1-v1 nova-compute[83654]: handle May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtiofs May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: {{(pid=83654) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}} May 28 12:44:45 l75lg1-v1 nova-compute[83654]: DEBUG nova.virt.libvirt.host [None req-d5e2622c-e52e-4f3d-871c-2ddda502f287 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=83654) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}} May 28 12:44:45 l75lg1-v1 nova-compute[83654]: DEBUG nova.virt.libvirt.host [None req-d5e2622c-e52e-4f3d-871c-2ddda502f287 None None] Libvirt host hypervisor capabilities for arch=xtensaeb and machine_type=None: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/bin/qemu-system-xtensaeb May 28 12:44:45 l75lg1-v1 nova-compute[83654]: qemu May 28 12:44:45 l75lg1-v1 nova-compute[83654]: sim May 28 12:44:45 l75lg1-v1 nova-compute[83654]: xtensaeb May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/share/OVMF/OVMF_CODE.fd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/share/OVMF/OVMF_CODE.secboot.fd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/share/AAVMF/AAVMF_CODE.fd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/share/AAVMF/AAVMF32_CODE.fd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: /usr/share/OVMF/OVMF_CODE.ms.fd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: rom May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pflash May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: yes May 28 12:44:45 l75lg1-v1 nova-compute[83654]: no May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: no May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: file May 28 12:44:45 l75lg1-v1 nova-compute[83654]: anonymous May 28 12:44:45 l75lg1-v1 nova-compute[83654]: memfd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: disk May 28 12:44:45 l75lg1-v1 nova-compute[83654]: cdrom May 28 12:44:45 l75lg1-v1 nova-compute[83654]: floppy May 28 12:44:45 l75lg1-v1 nova-compute[83654]: lun May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: fdc May 28 12:44:45 l75lg1-v1 nova-compute[83654]: scsi May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio May 28 12:44:45 l75lg1-v1 nova-compute[83654]: usb May 28 12:44:45 l75lg1-v1 nova-compute[83654]: sata May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio-transitional May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio-non-transitional May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: sdl May 28 12:44:45 l75lg1-v1 nova-compute[83654]: vnc May 28 12:44:45 l75lg1-v1 nova-compute[83654]: spice May 28 12:44:45 l75lg1-v1 nova-compute[83654]: egl-headless May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: subsystem May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: default May 28 12:44:45 l75lg1-v1 nova-compute[83654]: mandatory May 28 12:44:45 l75lg1-v1 nova-compute[83654]: requisite May 28 12:44:45 l75lg1-v1 nova-compute[83654]: optional May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: usb May 28 12:44:45 l75lg1-v1 nova-compute[83654]: pci May 28 12:44:45 l75lg1-v1 nova-compute[83654]: scsi May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio-transitional May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtio-non-transitional May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: random May 28 12:44:45 l75lg1-v1 nova-compute[83654]: egd May 28 12:44:45 l75lg1-v1 nova-compute[83654]: builtin May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: path May 28 12:44:45 l75lg1-v1 nova-compute[83654]: handle May 28 12:44:45 l75lg1-v1 nova-compute[83654]: virtiofs May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: May 28 12:44:45 l75lg1-v1 nova-compute[83654]: {{(pid=83654) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}} May 28 12:44:45 l75lg1-v1 nova-compute[83654]: DEBUG nova.virt.libvirt.host [None req-d5e2622c-e52e-4f3d-871c-2ddda502f287 None None] Checking secure boot support for host arch (x86_64) {{(pid=83654) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1840}} May 28 12:44:45 l75lg1-v1 nova-compute[83654]: INFO nova.virt.libvirt.host [None req-d5e2622c-e52e-4f3d-871c-2ddda502f287 None None] Secure Boot support detected May 28 12:44:45 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [None req-d5e2622c-e52e-4f3d-871c-2ddda502f287 None None] Expecting reply to msg b9ffb469b7f64dfe8b1a0c8c166a6164 in queue reply_37f4cbd1dd094961a22b8a65f222c327 May 28 12:44:45 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [-] Received RPC response for msg b9ffb469b7f64dfe8b1a0c8c166a6164 May 28 12:44:46 l75lg1-v1 dstat.sh[49771]: 28-05 12:44:46| 29 13 57 0 0|4076M 5384M 267M 5970M| 26k 25k| 0 932k| 0 76.0 | 20k 36k|1.86 1.84 1.30|4.0 0 421| 0 0 | 0 2048M| 26 226 0 21 0 May 28 12:44:46 l75lg1-v1 nova-compute[83654]: INFO nova.virt.node [None req-d5e2622c-e52e-4f3d-871c-2ddda502f287 None None] Generated node identity ef90d7d1-0808-4a15-ad77-f9a7391af2f4 May 28 12:44:46 l75lg1-v1 nova-compute[83654]: INFO nova.virt.node [None req-d5e2622c-e52e-4f3d-871c-2ddda502f287 None None] Wrote node identity ef90d7d1-0808-4a15-ad77-f9a7391af2f4 to /opt/stack/data/nova/compute_id May 28 12:44:46 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [None req-d5e2622c-e52e-4f3d-871c-2ddda502f287 None None] Expecting reply to msg 4eb5ea4d7316473889219f75fa529111 in queue reply_37f4cbd1dd094961a22b8a65f222c327 May 28 12:44:46 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [-] Received RPC response for msg 4eb5ea4d7316473889219f75fa529111 May 28 12:44:46 l75lg1-v1 neutron-server[77623]: DEBUG dbcounter [-] [77623] Writing DB stats neutron:SELECT=1 {{(pid=77623) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:44:46 l75lg1-v1 nova-compute[83654]: WARNING nova.compute.manager [None req-d5e2622c-e52e-4f3d-871c-2ddda502f287 None None] Compute nodes ['ef90d7d1-0808-4a15-ad77-f9a7391af2f4'] for host l75lg1-v1 were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning. May 28 12:44:46 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [None req-d5e2622c-e52e-4f3d-871c-2ddda502f287 None None] Expecting reply to msg 37a9aa05efca4c219b3334126a58a902 in queue reply_37f4cbd1dd094961a22b8a65f222c327 May 28 12:44:46 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [-] Received RPC response for msg 37a9aa05efca4c219b3334126a58a902 May 28 12:44:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1181eea9-d016-4550-9d77-8c2cb8fbb065 None None] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:44:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1181eea9-d016-4550-9d77-8c2cb8fbb065 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:44:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1181eea9-d016-4550-9d77-8c2cb8fbb065 None None] PATH_INFO: `/` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:44:46 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 482/948] 10.27.203.238 () {58 vars in 1014 bytes} [Tue May 28 12:44:46 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:44:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ad86de-ca48-4a68-af88-e1740b67dcb2 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:44:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ad86de-ca48-4a68-af88-e1740b67dcb2 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:44:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ad86de-ca48-4a68-af88-e1740b67dcb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:44:46 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-f1ad86de-ca48-4a68-af88-e1740b67dcb2 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:44:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-f1ad86de-ca48-4a68-af88-e1740b67dcb2 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:44:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-f1ad86de-ca48-4a68-af88-e1740b67dcb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:44:46 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 467/949] 10.27.203.238 () {62 vars in 1111 bytes} [Tue May 28 12:44:46 2024] POST /identity/v3/auth/tokens => generated 3991 bytes in 23 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:44:47 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi [None req-1f98749b-5b70-4f88-8199-d748cfa7137b admin admin] Calling method '>' {{(pid=73999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} May 28 12:44:47 l75lg1-v1 devstack@n-api.service[73999]: INFO nova.api.openstack.requestlog [None req-1f98749b-5b70-4f88-8199-d748cfa7137b admin admin] 10.27.203.238 "GET /compute/v2.1" status: 200 len: 390 microversion: 2.1 time: 0.001137 May 28 12:44:47 l75lg1-v1 devstack@n-api.service[73999]: [pid: 73999|app: 0|req: 6/13] 10.27.203.238 () {58 vars in 1013 bytes} [Tue May 28 12:44:47 2024] GET /compute/v2.1 => generated 390 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 12:44:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1181eea9-d016-4550-9d77-8c2cb8fbb065 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:44:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1181eea9-d016-4550-9d77-8c2cb8fbb065 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:44:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3913de-b83c-412a-825f-a9dcb6413f25 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'befdd4414dc2432ab2baa1ae3fbffef7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'manager', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:44:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3913de-b83c-412a-825f-a9dcb6413f25 service nova] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:44:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3913de-b83c-412a-825f-a9dcb6413f25 service nova] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:44:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3913de-b83c-412a-825f-a9dcb6413f25 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:44:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3913de-b83c-412a-825f-a9dcb6413f25 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:44:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3913de-b83c-412a-825f-a9dcb6413f25 service nova] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:44:47 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 483/950] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 12:44:47 2024] GET /identity/v3/auth/tokens => generated 3991 bytes in 21 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 28 12:44:47 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi [None req-79039146-bb4d-46af-9a7e-fcf2e51e6a58 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 10, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "d3", "name": "ds2G", "ram": 2048}} {{(pid=74000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:518}} May 28 12:44:47 l75lg1-v1 dstat.sh[49771]: 28-05 12:44:47| 27 7 65 0 0|4147M 5312M 267M 5970M| 15k 3083B| 136k 256k|34.0 17.0 |8907 13k|2.19 1.90 1.32|5.0 0 104| 0 0 | 0 2048M| 26 227 0 21 0 May 28 12:44:47 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [None req-d5e2622c-e52e-4f3d-871c-2ddda502f287 None None] Expecting reply to msg c567daaf79f342ac8bad706634e93afa in queue reply_37f4cbd1dd094961a22b8a65f222c327 May 28 12:44:47 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [-] Received RPC response for msg c567daaf79f342ac8bad706634e93afa May 28 12:44:47 l75lg1-v1 devstack@n-api.service[74000]: INFO nova.api.openstack.requestlog [None req-79039146-bb4d-46af-9a7e-fcf2e51e6a58 admin admin] 10.27.203.238 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.175389 May 28 12:44:47 l75lg1-v1 devstack@n-api.service[74000]: [pid: 74000|app: 0|req: 8/14] 10.27.203.238 () {68 vars in 1365 bytes} [Tue May 28 12:44:47 2024] POST /compute/v2.1/flavors => generated 408 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 12:44:47 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi [None req-1eef6f30-ebbe-4800-b0fd-05daadba576c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=73999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:518}} May 28 12:44:47 l75lg1-v1 devstack@n-api.service[73999]: INFO nova.api.openstack.requestlog [None req-1eef6f30-ebbe-4800-b0fd-05daadba576c admin admin] 10.27.203.238 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.024764 May 28 12:44:47 l75lg1-v1 devstack@n-api.service[73999]: [pid: 73999|app: 0|req: 7/15] 10.27.203.238 () {68 vars in 1418 bytes} [Tue May 28 12:44:47 2024] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: INFO dbcounter [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] Registered counter for database cinder May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_db.sqlalchemy.engines [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85128) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:342}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG dbcounter [-] [85128] Writer thread running {{(pid=85128) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: INFO cinder.rpc [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: INFO cinder.rpc [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] Automatically selected cinder-volume RPC version 3.19 as minimum service version. May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_db.sqlalchemy.engines [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85128) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:342}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: INFO cinder.rpc [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] Automatically selected cinder-backup objects version 1.39 as minimum service version. May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: INFO cinder.rpc [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] Automatically selected cinder-backup RPC version 2.4 as minimum service version. May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: INFO cinder.rpc [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: INFO cinder.rpc [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_db.sqlalchemy.engines [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85128) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:342}} May 28 12:44:47 l75lg1-v1 nova-compute[83654]: INFO nova.compute.manager [None req-d5e2622c-e52e-4f3d-871c-2ddda502f287 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host May 28 12:44:47 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [None req-d5e2622c-e52e-4f3d-871c-2ddda502f287 None None] Expecting reply to msg 2b8614ab2def4d65ad831af8aa5c84f1 in queue reply_37f4cbd1dd094961a22b8a65f222c327 May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_concurrency.lockutils [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] Acquiring lock "singleton_lock" {{(pid=85128) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_concurrency.lockutils [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] Acquired lock "singleton_lock" {{(pid=85128) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_concurrency.lockutils [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] Releasing lock "singleton_lock" {{(pid=85128) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] ******************************************************************************** {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2600}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] Configuration options gathered from: {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2601}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2603}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] ================================================================================ {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2605}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] allocated_capacity_weight_multiplier = -1.0 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] allow_availability_zone_fallback = False {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] allow_compression_on_image_upload = False {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] allowed_direct_url_schemes = [] {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] api_rate_limit = True {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] auth_strategy = keystone {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] az_cache_duration = 3600 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] backdoor_port = None {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] backdoor_socket = None {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] backend_availability_zone = None {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] backup_api_class = cinder.backup.api.API {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] backup_name_template = backup-%s {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] backup_use_same_host = False {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] backup_use_temp_snapshot = False {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] capacity_weight_multiplier = 1.0 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [-] Received RPC response for msg 2b8614ab2def4d65ad831af8aa5c84f1 May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] chap_password = **** {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] chap_username = {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] cinder_internal_tenant_project_id = 98a6a2dcbf0248d5b353760f7757f713 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] cinder_internal_tenant_user_id = d8b9b336af4049a99b45df9eba13a358 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] cloned_volume_same_az = True {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] compression_format = gzip {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] compute_api_class = cinder.compute.nova.API {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] config_dir = [] {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] config_source = [] {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] control_exchange = openstack {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] debug = True {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] default_availability_zone = None {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] default_group_type = None {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] default_volume_type = lvmdriver-1 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] driver_client_cert = None {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] driver_client_cert_key = None {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] driver_data_namespace = None {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] driver_ssl_cert_path = None {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] driver_ssl_cert_verify = False {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] driver_use_ssl = False {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] enable_force_upload = False {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] enable_new_services = True {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] enable_unsupported_driver = False {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] enabled_backends = ['lvmdriver-1'] {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] enforce_multipath_for_image_xfer = False {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] filter_function = None {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] glance_api_insecure = False {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] glance_api_servers = ['http://10.27.203.238/image'] {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] glance_api_ssl_compression = False {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] glance_ca_certificates_file = None {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] glance_catalog_info = image:glance:publicURL {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] glance_certfile = None {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] glance_keyfile = None {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] glance_num_retries = 3 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] glance_request_timeout = None {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] goodness_function = None {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] graceful_shutdown_timeout = 5 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] group_api_class = cinder.group.api.API {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] host = l75lg1-v1 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] iet_conf = /etc/iet/ietd.conf {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] image_compress_on_upload = True {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] image_conversion_address_space_limit = 1 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] image_conversion_cpu_limit = 60 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] image_conversion_disable = False {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] image_upload_use_cinder_backend = False {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] image_upload_use_internal_tenant = False {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] image_volume_cache_enabled = False {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] image_volume_cache_max_count = 0 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] image_volume_cache_max_size_gb = 0 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] instance_format = [instance: %(uuid)s] {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] iscsi_iotype = fileio {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] iscsi_target_flags = {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] iscsi_write_cache = on {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] iser_helper = tgtadm {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] iser_ip_address = 10.27.203.238 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] iser_port = 3260 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] log_config_append = None {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] log_dir = None {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] log_file = None {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] log_options = True {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] log_rotate_interval = 1 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] log_rotate_interval_type = days {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] log_rotation_type = none {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] max_age = 0 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] max_logfile_count = 30 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] max_logfile_size_mb = 200 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] max_over_subscription_ratio = 20.0 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] message_reap_interval = 86400 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] message_ttl = 2592000 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] monkey_patch = False {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] monkey_patch_modules = [] {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] my_ip = 10.27.203.238 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] no_snapshot_gb_quota = False {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] num_iser_scan_tries = 3 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] num_shell_tries = 3 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] num_volume_device_scan_tries = 3 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] nvmeof_conn_info_version = 1 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] nvmet_ns_id = 10 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] nvmet_port_id = 1 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] osapi_max_limit = 1000 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] osapi_volume_ext_list = [] {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] osapi_volume_listen = 0.0.0.0 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] osapi_volume_listen_port = 8776 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] osapi_volume_use_ssl = False {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] osapi_volume_workers = 2 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] per_volume_size_limit = -1 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] periodic_fuzzy_delay = 60 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] periodic_interval = 60 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] project_id_regex = [0-9a-f\-]+ {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] public_endpoint = None {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] publish_errors = False {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] quota_backup_gigabytes = 1000 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] quota_backups = 10 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] quota_gigabytes = 1000 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] quota_groups = 10 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] quota_snapshots = 50 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] quota_volumes = 50 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] rate_limit_burst = 0 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] rate_limit_except_level = CRITICAL {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] rate_limit_interval = 0 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] replication_device = **** {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] report_discard_supported = False {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] report_interval = 120 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] reservation_clean_interval = 86400 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] reservation_expire = 86400 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] reserved_image_namespaces = [] {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] reserved_percentage = 0 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] rpc_response_timeout = 120 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] run_external_periodic_tasks = True {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] scheduler_default_filters = ['AvailabilityZoneFilter', 'CapacityFilter', 'CapabilitiesFilter'] {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] scheduler_default_weighers = ['CapacityWeigher'] {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] scheduler_driver = cinder.scheduler.filter_scheduler.FilterScheduler {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] scheduler_driver_init_wait_time = 60 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] scheduler_host_manager = cinder.scheduler.host_manager.HostManager {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] scheduler_json_config_location = {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] scheduler_max_attempts = 3 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] scheduler_weight_handler = cinder.scheduler.weights.OrderedHostWeightHandler {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] scst_target_driver = iscsi {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] scst_target_iqn_name = None {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] service_down_time = 720 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] snapshot_name_template = snapshot-%s {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] snapshot_same_host = True {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] split_loggers = False {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] state_path = /opt/stack/data/cinder {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] storage_availability_zone = nova {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] storage_protocol = iSCSI {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] syslog_log_facility = LOG_USER {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] target_helper = lioadm {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] target_ip_address = 10.27.203.238 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] target_port = 3260 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] target_protocol = iscsi {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] target_secondary_ip_addresses = [] {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] trace_flags = None {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] transfer_api_class = cinder.transfer.api.API {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] transport_url = **** {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] until_refresh = 0 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] use_chap_auth = False {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] use_default_quota_class = True {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] use_eventlog = False {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] use_journal = False {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] use_json = False {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] use_multipath_for_image_xfer = False {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] use_stderr = False {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] use_syslog = False {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] verify_glance_signatures = enabled {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] volume_api_class = cinder.volume.api.API {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] volume_backend_name = None {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] volume_clear = zero {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] volume_clear_ionice = None {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] volume_clear_size = 0 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] volume_copy_bps_limit = 0 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] volume_dd_blocksize = 1M {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] volume_name_template = volume-%s {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] volume_number_multiplier = -1.0 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] volume_usage_audit_period = month {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] watch_log_file = False {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] oslo_concurrency.disable_process_locking = False {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] keystone_authtoken.admin_password = **** {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] keystone_authtoken.admin_token = **** {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] keystone_authtoken.admin_user = None {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] keystone_authtoken.auth_admin_prefix = {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] keystone_authtoken.auth_port = 35357 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] keystone_authtoken.auth_protocol = https {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] keystone_authtoken.auth_section = None {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] keystone_authtoken.auth_type = password {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] keystone_authtoken.auth_uri = None {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] keystone_authtoken.auth_version = None {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] keystone_authtoken.cache = None {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] keystone_authtoken.certfile = None {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] keystone_authtoken.delay_auth_decision = False {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] keystone_authtoken.http_connect_timeout = None {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] keystone_authtoken.identity_uri = None {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] keystone_authtoken.include_service_catalog = True {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] keystone_authtoken.insecure = False {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] keystone_authtoken.interface = public {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] keystone_authtoken.keyfile = None {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] keystone_authtoken.region_name = None {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] keystone_authtoken.service_token_roles_required = False {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] keystone_authtoken.service_type = None {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] keystone_authtoken.token_cache_time = 300 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] keystone_authtoken.www_authenticate_uri = None {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] cache.backend = dogpile.cache.null {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] cache.backend_argument = **** {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] cache.config_prefix = cache.oslo {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] cache.dead_timeout = 60.0 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] cache.debug_cache_backend = False {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] cache.enable_retry_client = False {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] cache.enable_socket_keepalive = False {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] cache.enabled = False {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] cache.enforce_fips_mode = False {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] cache.expiration_time = 600 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] cache.hashclient_retry_attempts = 2 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] cache.hashclient_retry_delay = 1.0 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] cache.memcache_dead_retry = 300 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] cache.memcache_password = **** {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] cache.memcache_pool_maxsize = 10 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] cache.memcache_sasl_enabled = False {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] cache.memcache_socket_timeout = 1.0 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] cache.memcache_username = None {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] cache.proxies = [] {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] cache.redis_password = **** {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] cache.redis_sentinel_service_name = mymaster {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] cache.redis_server = localhost:6379 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] cache.redis_socket_timeout = 1.0 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] cache.redis_username = None {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] cache.retry_attempts = 2 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] cache.retry_delay = 0.0 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] cache.socket_keepalive_count = 1 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] cache.socket_keepalive_idle = 1 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] cache.socket_keepalive_interval = 1 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] cache.tls_allowed_ciphers = None {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] cache.tls_cafile = None {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] cache.tls_certfile = None {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] cache.tls_enabled = False {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] cache.tls_keyfile = None {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] coordination.backend_url = **** {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] database.backend = sqlalchemy {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] database.connection = **** {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] database.connection_debug = 0 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] database.connection_parameters = {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] database.connection_recycle_time = 3600 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] database.connection_trace = False {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] database.db_inc_retry_interval = True {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] database.db_max_retries = 20 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] database.db_max_retry_interval = 10 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] database.db_retry_interval = 1 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] database.max_overflow = 50 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] database.max_pool_size = 5 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] database.max_retries = 10 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] database.mysql_wsrep_sync_wait = None {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] database.pool_timeout = None {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] database.retry_interval = 10 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] database.slave_connection = **** {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] database.sqlite_synchronous = True {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] database.use_db_reconnect = False {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] oslo_policy.enforce_new_defaults = False {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] oslo_policy.enforce_scope = False {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] oslo_policy.policy_default_rule = default {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] oslo_policy.policy_file = policy.yaml {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] profiler.connection_string = messaging:// {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] profiler.enabled = False {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] profiler.es_doc_type = notification {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] profiler.es_scroll_size = 10000 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] profiler.es_scroll_time = 2m {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] profiler.filter_error_trace = False {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] profiler.hmac_keys = **** {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] profiler.sentinel_service_name = mymaster {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] profiler.socket_timeout = 0.1 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] profiler.trace_requests = False {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] profiler.trace_sqlalchemy = False {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] profiler_jaeger.process_tags = {} {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] profiler_jaeger.service_name_prefix = None {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] profiler_otlp.service_name_prefix = None {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] os_brick.lock_path = None {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] privsep_osbrick.capabilities = [21] {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] privsep_osbrick.group = None {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] privsep_osbrick.helper_command = None {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] privsep_osbrick.logger_name = os_brick.privileged {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] privsep_osbrick.thread_pool_size = 10 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] privsep_osbrick.user = None {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] cinder_sys_admin.group = None {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] cinder_sys_admin.helper_command = None {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] cinder_sys_admin.thread_pool_size = 10 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] cinder_sys_admin.user = None {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] service_user.auth_section = None {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] service_user.auth_type = None {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] service_user.cafile = None {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] service_user.certfile = None {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] service_user.collect_timing = False {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] service_user.insecure = False {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] service_user.keyfile = None {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] service_user.send_service_user_token = False {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] service_user.split_loggers = False {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] service_user.timeout = None {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] backend_defaults.backend_availability_zone = None {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] backend_defaults.chap_password = **** {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] backend_defaults.chap_username = {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] backend_defaults.driver_client_cert = None {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] backend_defaults.driver_client_cert_key = None {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] backend_defaults.driver_data_namespace = None {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] backend_defaults.driver_use_ssl = False {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] backend_defaults.enable_unsupported_driver = False {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] backend_defaults.filter_function = None {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] backend_defaults.goodness_function = None {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] backend_defaults.iet_conf = /etc/iet/ietd.conf {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] backend_defaults.iscsi_iotype = fileio {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] backend_defaults.iscsi_target_flags = {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] backend_defaults.iscsi_write_cache = on {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] backend_defaults.iser_helper = tgtadm {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] backend_defaults.iser_ip_address = 10.27.203.238 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] backend_defaults.iser_port = 3260 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] backend_defaults.num_shell_tries = 3 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] backend_defaults.nvmet_port_id = 1 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] backend_defaults.replication_device = **** {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] backend_defaults.report_discard_supported = False {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] backend_defaults.reserved_percentage = 0 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] backend_defaults.scst_target_driver = iscsi {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] backend_defaults.scst_target_iqn_name = None {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] backend_defaults.storage_protocol = iSCSI {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] backend_defaults.target_helper = tgtadm {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] backend_defaults.target_ip_address = 10.27.203.238 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] backend_defaults.target_port = 3260 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] backend_defaults.target_protocol = iscsi {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] backend_defaults.trace_flags = None {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] backend_defaults.unique_fqdn_network = True {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] backend_defaults.use_chap_auth = False {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] backend_defaults.volume_backend_name = None {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] backend_defaults.volume_clear = zero {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] backend_defaults.volume_clear_ionice = None {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] backend_defaults.volume_clear_size = 0 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] oslo_reports.file_event_handler = None {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] oslo_reports.log_dir = None {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] oslo_messaging_rabbit.hostname = l75lg1-v1 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] oslo_messaging_rabbit.processname = cinder-scheduler {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] oslo_messaging_rabbit.ssl = False {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] oslo_messaging_rabbit.ssl_version = {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] oslo_messaging_notifications.driver = [] {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] oslo_messaging_notifications.retry = -1 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] oslo_messaging_notifications.transport_url = **** {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] nova.auth_section = None {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] nova.auth_type = password {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] nova.certfile = None {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] nova.collect_timing = False {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] nova.insecure = False {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] nova.interface = public {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] nova.keyfile = None {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] nova.region_name = RegionOne {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] nova.split_loggers = False {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] nova.timeout = None {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] nova.token_auth_url = None {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] ******************************************************************************** {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2624}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] Full set of CONF: {{(pid=85128) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:363}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] ******************************************************************************** {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2600}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] Configuration options gathered from: {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2601}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2603}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] ================================================================================ {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2605}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] allocated_capacity_weight_multiplier = -1.0 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] allow_availability_zone_fallback = False {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] allow_compression_on_image_upload = False {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] allowed_direct_url_schemes = [] {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] api_rate_limit = True {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] auth_strategy = keystone {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] az_cache_duration = 3600 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] backdoor_port = None {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] backdoor_socket = None {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] backend_availability_zone = None {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] backup_api_class = cinder.backup.api.API {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] backup_name_template = backup-%s {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] backup_use_same_host = False {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] backup_use_temp_snapshot = False {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] capacity_weight_multiplier = 1.0 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] chap_password = **** {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] chap_username = {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] cinder_internal_tenant_project_id = 98a6a2dcbf0248d5b353760f7757f713 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] cinder_internal_tenant_user_id = d8b9b336af4049a99b45df9eba13a358 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] cloned_volume_same_az = True {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] compression_format = gzip {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] compute_api_class = cinder.compute.nova.API {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] config_dir = [] {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] config_source = [] {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] control_exchange = openstack {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] debug = True {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] default_availability_zone = None {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] default_group_type = None {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] default_volume_type = lvmdriver-1 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] driver_client_cert = None {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] driver_client_cert_key = None {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] driver_data_namespace = None {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] driver_ssl_cert_path = None {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] driver_ssl_cert_verify = False {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] driver_use_ssl = False {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] enable_force_upload = False {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] enable_new_services = True {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] enable_unsupported_driver = False {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] enabled_backends = ['lvmdriver-1'] {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] enforce_multipath_for_image_xfer = False {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] filter_function = None {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] glance_api_insecure = False {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] glance_api_servers = ['http://10.27.203.238/image'] {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] glance_api_ssl_compression = False {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] glance_ca_certificates_file = None {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] glance_catalog_info = image:glance:publicURL {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] glance_certfile = None {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] glance_keyfile = None {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] glance_num_retries = 3 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] glance_request_timeout = None {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] goodness_function = None {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] graceful_shutdown_timeout = 5 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] group_api_class = cinder.group.api.API {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] host = l75lg1-v1 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] iet_conf = /etc/iet/ietd.conf {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] image_compress_on_upload = True {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] image_conversion_address_space_limit = 1 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] image_conversion_cpu_limit = 60 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] image_conversion_disable = False {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] image_upload_use_cinder_backend = False {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] image_upload_use_internal_tenant = False {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] image_volume_cache_enabled = False {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] image_volume_cache_max_count = 0 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] image_volume_cache_max_size_gb = 0 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] instance_format = [instance: %(uuid)s] {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] iscsi_iotype = fileio {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] iscsi_target_flags = {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] iscsi_write_cache = on {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] iser_helper = tgtadm {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] iser_ip_address = 10.27.203.238 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] iser_port = 3260 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] log_config_append = None {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] log_dir = None {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] log_file = None {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] log_options = True {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] log_rotate_interval = 1 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] log_rotate_interval_type = days {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] log_rotation_type = none {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] max_age = 0 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] max_logfile_count = 30 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] max_logfile_size_mb = 200 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] max_over_subscription_ratio = 20.0 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] message_reap_interval = 86400 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] message_ttl = 2592000 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] monkey_patch = False {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] monkey_patch_modules = [] {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] my_ip = 10.27.203.238 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] no_snapshot_gb_quota = False {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] num_iser_scan_tries = 3 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] num_shell_tries = 3 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] num_volume_device_scan_tries = 3 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] nvmeof_conn_info_version = 1 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] nvmet_ns_id = 10 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] nvmet_port_id = 1 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] osapi_max_limit = 1000 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] osapi_volume_ext_list = [] {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] osapi_volume_listen = 0.0.0.0 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] osapi_volume_listen_port = 8776 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] osapi_volume_use_ssl = False {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] osapi_volume_workers = 2 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] per_volume_size_limit = -1 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] periodic_fuzzy_delay = 60 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] periodic_interval = 60 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] project_id_regex = [0-9a-f\-]+ {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] public_endpoint = None {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] publish_errors = False {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] quota_backup_gigabytes = 1000 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] quota_backups = 10 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] quota_gigabytes = 1000 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] quota_groups = 10 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] quota_snapshots = 50 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] quota_volumes = 50 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] rate_limit_burst = 0 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] rate_limit_except_level = CRITICAL {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] rate_limit_interval = 0 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] replication_device = **** {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] report_discard_supported = False {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] report_interval = 120 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] reservation_clean_interval = 86400 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] reservation_expire = 86400 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] reserved_image_namespaces = [] {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] reserved_percentage = 0 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] rpc_response_timeout = 120 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] run_external_periodic_tasks = True {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] scheduler_default_filters = ['AvailabilityZoneFilter', 'CapacityFilter', 'CapabilitiesFilter'] {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] scheduler_default_weighers = ['CapacityWeigher'] {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] scheduler_driver = cinder.scheduler.filter_scheduler.FilterScheduler {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] scheduler_driver_init_wait_time = 60 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] scheduler_host_manager = cinder.scheduler.host_manager.HostManager {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] scheduler_json_config_location = {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] scheduler_max_attempts = 3 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] scheduler_weight_handler = cinder.scheduler.weights.OrderedHostWeightHandler {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] scst_target_driver = iscsi {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] scst_target_iqn_name = None {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] service_down_time = 720 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] snapshot_name_template = snapshot-%s {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] snapshot_same_host = True {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] split_loggers = False {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] state_path = /opt/stack/data/cinder {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] storage_availability_zone = nova {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] storage_protocol = iSCSI {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] syslog_log_facility = LOG_USER {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] target_helper = lioadm {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] target_ip_address = 10.27.203.238 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] target_port = 3260 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] target_protocol = iscsi {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] target_secondary_ip_addresses = [] {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] trace_flags = None {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] transfer_api_class = cinder.transfer.api.API {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] transport_url = **** {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] until_refresh = 0 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] use_chap_auth = False {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] use_default_quota_class = True {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] use_eventlog = False {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] use_journal = False {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] use_json = False {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] use_multipath_for_image_xfer = False {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] use_stderr = False {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] use_syslog = False {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] verify_glance_signatures = enabled {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] volume_api_class = cinder.volume.api.API {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] volume_backend_name = None {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] volume_clear = zero {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] volume_clear_ionice = None {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] volume_clear_size = 0 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] volume_copy_bps_limit = 0 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] volume_dd_blocksize = 1M {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] volume_name_template = volume-%s {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] volume_number_multiplier = -1.0 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] volume_usage_audit_period = month {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] watch_log_file = False {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] oslo_concurrency.disable_process_locking = False {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] keystone_authtoken.admin_password = **** {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] keystone_authtoken.admin_token = **** {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] keystone_authtoken.admin_user = None {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] keystone_authtoken.auth_admin_prefix = {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] keystone_authtoken.auth_port = 35357 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] keystone_authtoken.auth_protocol = https {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] keystone_authtoken.auth_section = None {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] keystone_authtoken.auth_type = password {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] keystone_authtoken.auth_uri = None {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] keystone_authtoken.auth_version = None {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] keystone_authtoken.cache = None {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] keystone_authtoken.certfile = None {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] keystone_authtoken.delay_auth_decision = False {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] keystone_authtoken.http_connect_timeout = None {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] keystone_authtoken.identity_uri = None {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] keystone_authtoken.include_service_catalog = True {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] keystone_authtoken.insecure = False {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] keystone_authtoken.interface = public {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] keystone_authtoken.keyfile = None {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] keystone_authtoken.region_name = None {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] keystone_authtoken.service_token_roles_required = False {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] keystone_authtoken.service_type = None {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] keystone_authtoken.token_cache_time = 300 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] keystone_authtoken.www_authenticate_uri = None {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] cache.backend = dogpile.cache.null {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] cache.backend_argument = **** {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] cache.config_prefix = cache.oslo {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] cache.dead_timeout = 60.0 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] cache.debug_cache_backend = False {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] cache.enable_retry_client = False {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] cache.enable_socket_keepalive = False {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] cache.enabled = False {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] cache.enforce_fips_mode = False {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] cache.expiration_time = 600 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] cache.hashclient_retry_attempts = 2 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] cache.hashclient_retry_delay = 1.0 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] cache.memcache_dead_retry = 300 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] cache.memcache_password = **** {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] cache.memcache_pool_maxsize = 10 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] cache.memcache_sasl_enabled = False {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] cache.memcache_socket_timeout = 1.0 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] cache.memcache_username = None {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] cache.proxies = [] {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] cache.redis_password = **** {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] cache.redis_sentinel_service_name = mymaster {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] cache.redis_server = localhost:6379 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] cache.redis_socket_timeout = 1.0 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] cache.redis_username = None {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] cache.retry_attempts = 2 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] cache.retry_delay = 0.0 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] cache.socket_keepalive_count = 1 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] cache.socket_keepalive_idle = 1 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] cache.socket_keepalive_interval = 1 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] cache.tls_allowed_ciphers = None {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] cache.tls_cafile = None {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] cache.tls_certfile = None {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] cache.tls_enabled = False {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] cache.tls_keyfile = None {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] coordination.backend_url = **** {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] database.backend = sqlalchemy {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] database.connection = **** {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] database.connection_debug = 0 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] database.connection_parameters = {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] database.connection_recycle_time = 3600 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] database.connection_trace = False {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] database.db_inc_retry_interval = True {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] database.db_max_retries = 20 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] database.db_max_retry_interval = 10 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] database.db_retry_interval = 1 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] database.max_overflow = 50 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] database.max_pool_size = 5 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] database.max_retries = 10 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] database.mysql_wsrep_sync_wait = None {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] database.pool_timeout = None {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] database.retry_interval = 10 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] database.slave_connection = **** {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] database.sqlite_synchronous = True {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] database.use_db_reconnect = False {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] oslo_policy.enforce_new_defaults = False {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] oslo_policy.enforce_scope = False {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] oslo_policy.policy_default_rule = default {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] oslo_policy.policy_file = policy.yaml {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] profiler.connection_string = messaging:// {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] profiler.enabled = False {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] profiler.es_doc_type = notification {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] profiler.es_scroll_size = 10000 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] profiler.es_scroll_time = 2m {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] profiler.filter_error_trace = False {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] profiler.hmac_keys = **** {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] profiler.sentinel_service_name = mymaster {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] profiler.socket_timeout = 0.1 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] profiler.trace_requests = False {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] profiler.trace_sqlalchemy = False {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] profiler_jaeger.process_tags = {} {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] profiler_jaeger.service_name_prefix = None {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] profiler_otlp.service_name_prefix = None {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] os_brick.lock_path = None {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] privsep_osbrick.capabilities = [21] {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] privsep_osbrick.group = None {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] privsep_osbrick.helper_command = None {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] privsep_osbrick.logger_name = os_brick.privileged {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] privsep_osbrick.thread_pool_size = 10 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] privsep_osbrick.user = None {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] cinder_sys_admin.group = None {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] cinder_sys_admin.helper_command = None {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] cinder_sys_admin.thread_pool_size = 10 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] cinder_sys_admin.user = None {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] service_user.auth_section = None {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] service_user.auth_type = None {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] service_user.cafile = None {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] service_user.certfile = None {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] service_user.collect_timing = False {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] service_user.insecure = False {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] service_user.keyfile = None {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] service_user.send_service_user_token = False {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] service_user.split_loggers = False {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] service_user.timeout = None {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] backend_defaults.backend_availability_zone = None {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] backend_defaults.chap_password = **** {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] backend_defaults.chap_username = {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] backend_defaults.driver_client_cert = None {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] backend_defaults.driver_client_cert_key = None {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] backend_defaults.driver_data_namespace = None {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] backend_defaults.driver_use_ssl = False {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] backend_defaults.enable_unsupported_driver = False {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] backend_defaults.filter_function = None {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] backend_defaults.goodness_function = None {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] backend_defaults.iet_conf = /etc/iet/ietd.conf {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] backend_defaults.iscsi_iotype = fileio {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] backend_defaults.iscsi_target_flags = {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] backend_defaults.iscsi_write_cache = on {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] backend_defaults.iser_helper = tgtadm {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] backend_defaults.iser_ip_address = 10.27.203.238 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] backend_defaults.iser_port = 3260 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] backend_defaults.num_shell_tries = 3 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] backend_defaults.nvmet_port_id = 1 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] backend_defaults.replication_device = **** {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] backend_defaults.report_discard_supported = False {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] backend_defaults.reserved_percentage = 0 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] backend_defaults.scst_target_driver = iscsi {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] backend_defaults.scst_target_iqn_name = None {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] backend_defaults.storage_protocol = iSCSI {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] backend_defaults.target_helper = tgtadm {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] backend_defaults.target_ip_address = 10.27.203.238 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] backend_defaults.target_port = 3260 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] backend_defaults.target_protocol = iscsi {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] backend_defaults.trace_flags = None {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] backend_defaults.unique_fqdn_network = True {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] backend_defaults.use_chap_auth = False {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] backend_defaults.volume_backend_name = None {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] backend_defaults.volume_clear = zero {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] backend_defaults.volume_clear_ionice = None {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] backend_defaults.volume_clear_size = 0 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] oslo_reports.file_event_handler = None {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] oslo_reports.log_dir = None {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] oslo_messaging_rabbit.hostname = l75lg1-v1 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] oslo_messaging_rabbit.processname = cinder-scheduler {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] oslo_messaging_rabbit.ssl = False {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] oslo_messaging_rabbit.ssl_version = {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] oslo_messaging_notifications.driver = [] {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] oslo_messaging_notifications.retry = -1 {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] oslo_messaging_notifications.transport_url = **** {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] nova.auth_section = None {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] nova.auth_type = password {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] nova.certfile = None {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] nova.collect_timing = False {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] nova.insecure = False {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] nova.interface = public {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] nova.keyfile = None {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] nova.region_name = RegionOne {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] nova.split_loggers = False {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] nova.timeout = None {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] nova.token_auth_url = None {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.service [None req-83f13ff2-29f2-46b2-afbf-7ef2727964c0 None None] ******************************************************************************** {{(pid=85128) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2624}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: INFO cinder.service [-] Starting cinder-scheduler node (version 24.1.0) May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: INFO cinder.manager [None req-aaac144a-e56c-4f67-bafb-3444716c76b4 None None] Initiating service 1 cleanup May 28 12:44:47 l75lg1-v1 nova-conductor[83229]: DEBUG dbcounter [-] [83229] Writing DB stats nova_cell0:SELECT=4,nova_cell0:INSERT=1,nova_cell0:UPDATE=1 {{(pid=83229) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: INFO cinder.manager [None req-aaac144a-e56c-4f67-bafb-3444716c76b4 None None] Service 1 cleanup completed. May 28 12:44:47 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-aaac144a-e56c-4f67-bafb-3444716c76b4 None None] Creating RPC server for service cinder-scheduler {{(pid=85128) start /opt/stack/cinder/cinder/service.py:238}} May 28 12:44:48 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.service [None req-aaac144a-e56c-4f67-bafb-3444716c76b4 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=85128) start /opt/stack/cinder/cinder/service.py:244}} May 28 12:44:48 l75lg1-v1 cinder-scheduler[85128]: INFO oslo.messaging._drivers.impl_rabbit [None req-aaac144a-e56c-4f67-bafb-3444716c76b4 None None] Creating fanout queue: cinder-scheduler_fanout_6428a2d5315d4e95a20111bf099fa770 May 28 12:44:48 l75lg1-v1 nova-conductor[83233]: DEBUG dbcounter [-] [83233] Writing DB stats nova_cell0:SELECT=3 {{(pid=83233) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:44:48 l75lg1-v1 dstat.sh[49771]: 28-05 12:44:48| 35 5 59 1 0|4222M 5236M 267M 5971M| 18k 5164B| 0 980k| 0 97.0 |6876 11k|2.19 1.90 1.32|3.0 0 71| 0 0 | 0 2048M| 26 234 0 25 0 May 28 12:44:48 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [None req-d5e2622c-e52e-4f3d-871c-2ddda502f287 None None] Expecting reply to msg 8a7ef0d214374b06b6e743a83418b3b6 in queue reply_37f4cbd1dd094961a22b8a65f222c327 May 28 12:44:48 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [-] Received RPC response for msg 8a7ef0d214374b06b6e743a83418b3b6 May 28 12:44:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5f90b3-2fa0-414d-bee6-e153e67a3a44 None None] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:44:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5f90b3-2fa0-414d-bee6-e153e67a3a44 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:44:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5f90b3-2fa0-414d-bee6-e153e67a3a44 None None] PATH_INFO: `/` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:44:48 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 468/951] 10.27.203.238 () {58 vars in 1014 bytes} [Tue May 28 12:44:48 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:44:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a356390-96d2-418a-b770-6d164d2d5e26 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:44:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a356390-96d2-418a-b770-6d164d2d5e26 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:44:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a356390-96d2-418a-b770-6d164d2d5e26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:44:48 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-4a356390-96d2-418a-b770-6d164d2d5e26 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:44:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-4a356390-96d2-418a-b770-6d164d2d5e26 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:44:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-4a356390-96d2-418a-b770-6d164d2d5e26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:44:48 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 484/952] 10.27.203.238 () {62 vars in 1111 bytes} [Tue May 28 12:44:48 2024] POST /identity/v3/auth/tokens => generated 3991 bytes in 22 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:44:48 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.middleware.request_id [None req-c96200d1-9d58-4949-af5e-69a2071a5977 None None] RequestId filter calling following filter/app {{(pid=84424) _context_setter /opt/stack/cinder/cinder/api/middleware/request_id.py:62}} May 28 12:44:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788ab05d-9719-4be5-b2b6-f1029ec13635 None None] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:44:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788ab05d-9719-4be5-b2b6-f1029ec13635 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:44:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788ab05d-9719-4be5-b2b6-f1029ec13635 None None] PATH_INFO: `/` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:44:48 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 469/953] 10.27.203.238 () {58 vars in 1052 bytes} [Tue May 28 12:44:48 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:44:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397cbf3d-f6c2-44d5-a947-7996e5cec0f4 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:44:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397cbf3d-f6c2-44d5-a947-7996e5cec0f4 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:44:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397cbf3d-f6c2-44d5-a947-7996e5cec0f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:44:48 l75lg1-v1 nova-compute[83654]: WARNING nova.compute.manager [None req-d5e2622c-e52e-4f3d-871c-2ddda502f287 None None] No compute node record found for host l75lg1-v1. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host l75lg1-v1 could not be found. May 28 12:44:48 l75lg1-v1 nova-compute[83654]: DEBUG oslo_concurrency.lockutils [None req-d5e2622c-e52e-4f3d-871c-2ddda502f287 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=83654) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:44:48 l75lg1-v1 nova-compute[83654]: DEBUG oslo_concurrency.lockutils [None req-d5e2622c-e52e-4f3d-871c-2ddda502f287 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=83654) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:44:48 l75lg1-v1 nova-compute[83654]: DEBUG oslo_concurrency.lockutils [None req-d5e2622c-e52e-4f3d-871c-2ddda502f287 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=83654) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:44:48 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.resource_tracker [None req-d5e2622c-e52e-4f3d-871c-2ddda502f287 None None] Auditing locally available compute resources for l75lg1-v1 (node: l75lg1-v1) {{(pid=83654) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}} May 28 12:44:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91518f77-4f0d-4a39-a9df-1ce1c3d864b5 None None] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:44:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91518f77-4f0d-4a39-a9df-1ce1c3d864b5 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:44:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91518f77-4f0d-4a39-a9df-1ce1c3d864b5 None None] PATH_INFO: `/` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:44:48 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 470/954] 10.27.203.238 () {58 vars in 1014 bytes} [Tue May 28 12:44:48 2024] GET /identity => generated 272 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:44:48 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-397cbf3d-f6c2-44d5-a947-7996e5cec0f4 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:44:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4c06ff-4fa7-4e53-8657-4c19f5994606 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:44:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4c06ff-4fa7-4e53-8657-4c19f5994606 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:44:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4c06ff-4fa7-4e53-8657-4c19f5994606 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:44:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-397cbf3d-f6c2-44d5-a947-7996e5cec0f4 None None] MFA Rules not processed for user `d8b9b336af4049a99b45df9eba13a358`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:44:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-397cbf3d-f6c2-44d5-a947-7996e5cec0f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:44:48 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-3f4c06ff-4fa7-4e53-8657-4c19f5994606 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:44:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-3f4c06ff-4fa7-4e53-8657-4c19f5994606 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:44:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-3f4c06ff-4fa7-4e53-8657-4c19f5994606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:44:48 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 471/955] 10.27.203.238 () {62 vars in 1111 bytes} [Tue May 28 12:44:48 2024] POST /identity/v3/auth/tokens => generated 3991 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:44:48 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 485/956] 10.27.203.238 () {62 vars in 1149 bytes} [Tue May 28 12:44:48 2024] POST /identity/v3/auth/tokens => generated 3809 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:44:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4c06ff-4fa7-4e53-8657-4c19f5994606 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:44:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4c06ff-4fa7-4e53-8657-4c19f5994606 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:44:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c52acb-dfb3-48c2-9728-4ebc47267157 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8b9b336af4049a99b45df9eba13a358', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:44:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c52acb-dfb3-48c2-9728-4ebc47267157 service cinder] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:44:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c52acb-dfb3-48c2-9728-4ebc47267157 service cinder] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:44:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c52acb-dfb3-48c2-9728-4ebc47267157 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:44:48 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.resource_tracker [None req-d5e2622c-e52e-4f3d-871c-2ddda502f287 None None] Hypervisor/Node resource view: name=l75lg1-v1 free_ram=11413MB free_disk=17.520076751708984GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_01_1", "address": "0000:00:01.1", "product_id": "7010", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7010", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7000", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7000", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "0100", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_0100", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_09_0", "address": "0000:00:09.0", "product_id": "1001", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1001", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "293a", "vendor_id": "8086", "numa_node": null, "label": "label_8086_293a", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_2", "address": "0000:00:07.2", "product_id": "2936", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2936", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "1237", "vendor_id": "8086", "numa_node": null, "label": "label_8086_1237", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "2935", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2935", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "2934", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2934", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_05_0", "address": "0000:00:05.0", "product_id": "1000", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1000", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "1000", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1000", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_06_0", "address": "0000:00:06.0", "product_id": "2668", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2668", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "1000", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1000", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0a_0", "address": "0000:00:0a.0", "product_id": "1002", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1002", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_3", "address": "0000:00:01.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_08_0", "address": "0000:00:08.0", "product_id": "1003", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1003", "dev_type": "type-PCI"}] {{(pid=83654) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}} May 28 12:44:48 l75lg1-v1 nova-compute[83654]: DEBUG oslo_concurrency.lockutils [None req-d5e2622c-e52e-4f3d-871c-2ddda502f287 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=83654) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:44:48 l75lg1-v1 nova-compute[83654]: DEBUG oslo_concurrency.lockutils [None req-d5e2622c-e52e-4f3d-871c-2ddda502f287 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=83654) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:44:48 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [None req-d5e2622c-e52e-4f3d-871c-2ddda502f287 None None] Expecting reply to msg 41c292c444c64df082e5b8280300face in queue reply_37f4cbd1dd094961a22b8a65f222c327 May 28 12:44:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c52acb-dfb3-48c2-9728-4ebc47267157 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:44:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c52acb-dfb3-48c2-9728-4ebc47267157 service cinder] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:44:48 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 472/957] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 12:44:48 2024] GET /identity/v3/auth/tokens => generated 3991 bytes in 24 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 12:44:48 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [-] Received RPC response for msg 41c292c444c64df082e5b8280300face May 28 12:44:49 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=85683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} May 28 12:44:49 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=85683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} May 28 12:44:49 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=85683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} May 28 12:44:49 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi [None req-79039146-bb4d-46af-9a7e-fcf2e51e6a58 admin admin] Calling method '>' {{(pid=74000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} May 28 12:44:49 l75lg1-v1 devstack@n-api.service[74000]: INFO nova.api.openstack.requestlog [None req-79039146-bb4d-46af-9a7e-fcf2e51e6a58 admin admin] 10.27.203.238 "GET /compute/v2.1" status: 200 len: 390 microversion: 2.1 time: 0.001261 May 28 12:44:49 l75lg1-v1 devstack@n-api.service[74000]: [pid: 74000|app: 0|req: 9/16] 10.27.203.238 () {58 vars in 1013 bytes} [Tue May 28 12:44:49 2024] GET /compute/v2.1 => generated 390 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 12:44:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397cbf3d-f6c2-44d5-a947-7996e5cec0f4 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:44:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397cbf3d-f6c2-44d5-a947-7996e5cec0f4 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:44:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b3b1bc-c507-41f2-a339-aa24b5377a8f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'befdd4414dc2432ab2baa1ae3fbffef7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'manager', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:44:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b3b1bc-c507-41f2-a339-aa24b5377a8f service nova] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:44:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b3b1bc-c507-41f2-a339-aa24b5377a8f service nova] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:44:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b3b1bc-c507-41f2-a339-aa24b5377a8f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:44:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b3b1bc-c507-41f2-a339-aa24b5377a8f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:44:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b3b1bc-c507-41f2-a339-aa24b5377a8f service nova] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:44:49 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 486/958] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 12:44:49 2024] GET /identity/v3/auth/tokens => generated 3991 bytes in 22 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 12:44:49 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi [None req-4a1faf18-8f64-40df-befb-634336ed6ac2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "ram": 4096, "id": "d4", "disk": 20, "swap": 0, "name": "ds4G", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=73999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:518}} May 28 12:44:49 l75lg1-v1 devstack@n-api.service[73999]: INFO nova.api.openstack.requestlog [None req-4a1faf18-8f64-40df-befb-634336ed6ac2 admin admin] 10.27.203.238 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.055348 May 28 12:44:49 l75lg1-v1 devstack@n-api.service[73999]: [pid: 73999|app: 0|req: 8/17] 10.27.203.238 () {68 vars in 1365 bytes} [Tue May 28 12:44:49 2024] POST /compute/v2.1/flavors => generated 408 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 12:44:49 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi [None req-3e264988-7b29-415c-a85e-f88bf3b4ef43 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=74000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:518}} May 28 12:44:49 l75lg1-v1 devstack@n-api.service[74000]: INFO nova.api.openstack.requestlog [None req-3e264988-7b29-415c-a85e-f88bf3b4ef43 admin admin] 10.27.203.238 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028412 May 28 12:44:49 l75lg1-v1 devstack@n-api.service[74000]: [pid: 74000|app: 0|req: 10/18] 10.27.203.238 () {68 vars in 1418 bytes} [Tue May 28 12:44:49 2024] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 12:44:49 l75lg1-v1 dstat.sh[49771]: 28-05 12:44:49| 28 3 68 0 0|4312M 5146M 267M 5972M| 15k 0 | 0 544k| 0 52.0 |3993 6164 |2.19 1.90 1.32|3.0 0 1.0| 0 0 | 0 2048M| 26 237 0 23 0 May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84424]: INFO cinder.api.openstack.wsgi [None req-c96200d1-9d58-4949-af5e-69a2071a5977 admin admin] POST http://10.27.203.238/volume/v3/ea8d517cde1d40bb82c97e080ce071f7/types May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.openstack.wsgi [None req-c96200d1-9d58-4949-af5e-69a2071a5977 admin admin] Action: 'create', calling method: _create, body: {"volume_type": {"name": "lvmdriver-1", "description": null, "os-volume-type-access:is_public": true}} {{(pid=84424) _process_stack /opt/stack/cinder/cinder/api/openstack/wsgi.py:866}} May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84424]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_context/context.py:100: DeprecationWarning: Policy enforcement is depending on the value of is_admin. This key is deprecated. Please update your policy file to use the standard policy values. May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84424]: warnings.warn('Policy enforcement is depending on the value of ' May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84424]: DEBUG oslo_db.sqlalchemy.engines [None req-c96200d1-9d58-4949-af5e-69a2071a5977 admin admin] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84424) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:342}} May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84424]: INFO cinder.api.openstack.wsgi [None req-c96200d1-9d58-4949-af5e-69a2071a5977 admin admin] http://10.27.203.238/volume/v3/ea8d517cde1d40bb82c97e080ce071f7/types returned with HTTP 200 May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84424]: [pid: 84424|app: 0|req: 2/2] 10.27.203.238 () {64 vars in 1325 bytes} [Tue May 28 12:44:48 2024] POST /volume/v3/ea8d517cde1d40bb82c97e080ce071f7/types => generated 186 bytes in 555 msecs (HTTP/1.1 200) 7 headers in 285 bytes (1 switches on core 0) May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_policy/policy.py:814: UserWarning: Policy "volume:attachment_create":"" was deprecated in X in favor of "volume:attachment_create":"rule:xena_system_admin_or_project_member". Reason: Default policies now support the three Keystone default roles, namely 'admin', 'member', and 'reader' to implement three Cinder "personas". See "Policy Personas and Permissions" in the "Cinder Service Configuration" documentation (Xena release) for details.. Either ensure your deployment is ready for the new default or copy/paste the deprecated policy into your policy file and maintain it manually. May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: warnings.warn(deprecated_msg) May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_policy/policy.py:814: UserWarning: Policy "volume:attachment_update":"rule:admin_or_owner" was deprecated in X in favor of "volume:attachment_update":"rule:xena_system_admin_or_project_member". Reason: Default policies now support the three Keystone default roles, namely 'admin', 'member', and 'reader' to implement three Cinder "personas". See "Policy Personas and Permissions" in the "Cinder Service Configuration" documentation (Xena release) for details.. Either ensure your deployment is ready for the new default or copy/paste the deprecated policy into your policy file and maintain it manually. May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: warnings.warn(deprecated_msg) May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_policy/policy.py:814: UserWarning: Policy "volume:attachment_delete":"rule:admin_or_owner" was deprecated in X in favor of "volume:attachment_delete":"rule:xena_system_admin_or_project_member". Reason: Default policies now support the three Keystone default roles, namely 'admin', 'member', and 'reader' to implement three Cinder "personas". See "Policy Personas and Permissions" in the "Cinder Service Configuration" documentation (Xena release) for details.. Either ensure your deployment is ready for the new default or copy/paste the deprecated policy into your policy file and maintain it manually. May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: warnings.warn(deprecated_msg) May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_policy/policy.py:814: UserWarning: Policy "volume:attachment_complete":"rule:admin_or_owner" was deprecated in X in favor of "volume:attachment_complete":"rule:xena_system_admin_or_project_member". Reason: Default policies now support the three Keystone default roles, namely 'admin', 'member', and 'reader' to implement three Cinder "personas". See "Policy Personas and Permissions" in the "Cinder Service Configuration" documentation (Xena release) for details.. Either ensure your deployment is ready for the new default or copy/paste the deprecated policy into your policy file and maintain it manually. May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: warnings.warn(deprecated_msg) May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_policy/policy.py:814: UserWarning: Policy "volume:multiattach_bootable_volume":"rule:admin_or_owner" was deprecated in X in favor of "volume:multiattach_bootable_volume":"rule:xena_system_admin_or_project_member". Reason: Default policies now support the three Keystone default roles, namely 'admin', 'member', and 'reader' to implement three Cinder "personas". See "Policy Personas and Permissions" in the "Cinder Service Configuration" documentation (Xena release) for details.. Either ensure your deployment is ready for the new default or copy/paste the deprecated policy into your policy file and maintain it manually. May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: warnings.warn(deprecated_msg) May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_policy/policy.py:814: UserWarning: Policy "message:get_all":"rule:admin_or_owner" was deprecated in X in favor of "message:get_all":"rule:xena_system_admin_or_project_reader". Reason: Default policies now support the three Keystone default roles, namely 'admin', 'member', and 'reader' to implement three Cinder "personas". See "Policy Personas and Permissions" in the "Cinder Service Configuration" documentation (Xena release) for details.. Either ensure your deployment is ready for the new default or copy/paste the deprecated policy into your policy file and maintain it manually. May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: warnings.warn(deprecated_msg) May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_policy/policy.py:814: UserWarning: Policy "message:get":"rule:admin_or_owner" was deprecated in X in favor of "message:get":"rule:xena_system_admin_or_project_reader". Reason: Default policies now support the three Keystone default roles, namely 'admin', 'member', and 'reader' to implement three Cinder "personas". See "Policy Personas and Permissions" in the "Cinder Service Configuration" documentation (Xena release) for details.. Either ensure your deployment is ready for the new default or copy/paste the deprecated policy into your policy file and maintain it manually. May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: warnings.warn(deprecated_msg) May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_policy/policy.py:814: UserWarning: Policy "message:delete":"rule:admin_or_owner" was deprecated in X in favor of "message:delete":"rule:xena_system_admin_or_project_member". Reason: Default policies now support the three Keystone default roles, namely 'admin', 'member', and 'reader' to implement three Cinder "personas". See "Policy Personas and Permissions" in the "Cinder Service Configuration" documentation (Xena release) for details.. Either ensure your deployment is ready for the new default or copy/paste the deprecated policy into your policy file and maintain it manually. May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: warnings.warn(deprecated_msg) May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_policy/policy.py:814: UserWarning: Policy "volume:get_snapshot_metadata":"rule:admin_or_owner" was deprecated in X in favor of "volume:get_snapshot_metadata":"rule:xena_system_admin_or_project_reader". Reason: Default policies now support the three Keystone default roles, namely 'admin', 'member', and 'reader' to implement three Cinder "personas". See "Policy Personas and Permissions" in the "Cinder Service Configuration" documentation (Xena release) for details.. Either ensure your deployment is ready for the new default or copy/paste the deprecated policy into your policy file and maintain it manually. May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: warnings.warn(deprecated_msg) May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_policy/policy.py:814: UserWarning: Policy "volume:update_snapshot_metadata":"rule:admin_or_owner" was deprecated in X in favor of "volume:update_snapshot_metadata":"rule:xena_system_admin_or_project_member". Reason: Default policies now support the three Keystone default roles, namely 'admin', 'member', and 'reader' to implement three Cinder "personas". See "Policy Personas and Permissions" in the "Cinder Service Configuration" documentation (Xena release) for details.. Either ensure your deployment is ready for the new default or copy/paste the deprecated policy into your policy file and maintain it manually. May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: warnings.warn(deprecated_msg) May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_policy/policy.py:814: UserWarning: Policy "volume:delete_snapshot_metadata":"rule:admin_or_owner" was deprecated in X in favor of "volume:delete_snapshot_metadata":"rule:xena_system_admin_or_project_member". Reason: Default policies now support the three Keystone default roles, namely 'admin', 'member', and 'reader' to implement three Cinder "personas". See "Policy Personas and Permissions" in the "Cinder Service Configuration" documentation (Xena release) for details.. Either ensure your deployment is ready for the new default or copy/paste the deprecated policy into your policy file and maintain it manually. May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: warnings.warn(deprecated_msg) May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_policy/policy.py:814: UserWarning: Policy "volume:get_all_snapshots":"rule:admin_or_owner" was deprecated in X in favor of "volume:get_all_snapshots":"rule:xena_system_admin_or_project_reader". Reason: Default policies now support the three Keystone default roles, namely 'admin', 'member', and 'reader' to implement three Cinder "personas". See "Policy Personas and Permissions" in the "Cinder Service Configuration" documentation (Xena release) for details.. Either ensure your deployment is ready for the new default or copy/paste the deprecated policy into your policy file and maintain it manually. May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: warnings.warn(deprecated_msg) May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_policy/policy.py:814: UserWarning: Policy "volume_extension:extended_snapshot_attributes":"rule:admin_or_owner" was deprecated in X in favor of "volume_extension:extended_snapshot_attributes":"rule:xena_system_admin_or_project_reader". Reason: Default policies now support the three Keystone default roles, namely 'admin', 'member', and 'reader' to implement three Cinder "personas". See "Policy Personas and Permissions" in the "Cinder Service Configuration" documentation (Xena release) for details.. Either ensure your deployment is ready for the new default or copy/paste the deprecated policy into your policy file and maintain it manually. May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: warnings.warn(deprecated_msg) May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_policy/policy.py:814: UserWarning: Policy "volume:create_snapshot":"rule:admin_or_owner" was deprecated in X in favor of "volume:create_snapshot":"rule:xena_system_admin_or_project_member". Reason: Default policies now support the three Keystone default roles, namely 'admin', 'member', and 'reader' to implement three Cinder "personas". See "Policy Personas and Permissions" in the "Cinder Service Configuration" documentation (Xena release) for details.. Either ensure your deployment is ready for the new default or copy/paste the deprecated policy into your policy file and maintain it manually. May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: warnings.warn(deprecated_msg) May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_policy/policy.py:814: UserWarning: Policy "volume:get_snapshot":"rule:admin_or_owner" was deprecated in X in favor of "volume:get_snapshot":"rule:xena_system_admin_or_project_reader". Reason: Default policies now support the three Keystone default roles, namely 'admin', 'member', and 'reader' to implement three Cinder "personas". See "Policy Personas and Permissions" in the "Cinder Service Configuration" documentation (Xena release) for details.. Either ensure your deployment is ready for the new default or copy/paste the deprecated policy into your policy file and maintain it manually. May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: warnings.warn(deprecated_msg) May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_policy/policy.py:814: UserWarning: Policy "volume:update_snapshot":"rule:admin_or_owner" was deprecated in X in favor of "volume:update_snapshot":"rule:xena_system_admin_or_project_member". Reason: Default policies now support the three Keystone default roles, namely 'admin', 'member', and 'reader' to implement three Cinder "personas". See "Policy Personas and Permissions" in the "Cinder Service Configuration" documentation (Xena release) for details.. Either ensure your deployment is ready for the new default or copy/paste the deprecated policy into your policy file and maintain it manually. May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: warnings.warn(deprecated_msg) May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_policy/policy.py:814: UserWarning: Policy "volume:delete_snapshot":"rule:admin_or_owner" was deprecated in X in favor of "volume:delete_snapshot":"rule:xena_system_admin_or_project_member". Reason: Default policies now support the three Keystone default roles, namely 'admin', 'member', and 'reader' to implement three Cinder "personas". See "Policy Personas and Permissions" in the "Cinder Service Configuration" documentation (Xena release) for details.. Either ensure your deployment is ready for the new default or copy/paste the deprecated policy into your policy file and maintain it manually. May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: warnings.warn(deprecated_msg) May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_policy/policy.py:814: UserWarning: Policy "snapshot_extension:snapshot_actions:update_snapshot_status":"" was deprecated in X in favor of "snapshot_extension:snapshot_actions:update_snapshot_status":"rule:xena_system_admin_or_project_member". Reason: Default policies now support the three Keystone default roles, namely 'admin', 'member', and 'reader' to implement three Cinder "personas". See "Policy Personas and Permissions" in the "Cinder Service Configuration" documentation (Xena release) for details.. Either ensure your deployment is ready for the new default or copy/paste the deprecated policy into your policy file and maintain it manually. May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: warnings.warn(deprecated_msg) May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_policy/policy.py:814: UserWarning: Policy "backup:get_all":"rule:admin_or_owner" was deprecated in X in favor of "backup:get_all":"rule:xena_system_admin_or_project_reader". Reason: Default policies now support the three Keystone default roles, namely 'admin', 'member', and 'reader' to implement three Cinder "personas". See "Policy Personas and Permissions" in the "Cinder Service Configuration" documentation (Xena release) for details.. Either ensure your deployment is ready for the new default or copy/paste the deprecated policy into your policy file and maintain it manually. May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: warnings.warn(deprecated_msg) May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_policy/policy.py:814: UserWarning: Policy "backup:create":"" was deprecated in X in favor of "backup:create":"rule:xena_system_admin_or_project_member". Reason: Default policies now support the three Keystone default roles, namely 'admin', 'member', and 'reader' to implement three Cinder "personas". See "Policy Personas and Permissions" in the "Cinder Service Configuration" documentation (Xena release) for details.. Either ensure your deployment is ready for the new default or copy/paste the deprecated policy into your policy file and maintain it manually. May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: warnings.warn(deprecated_msg) May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_policy/policy.py:814: UserWarning: Policy "backup:get":"rule:admin_or_owner" was deprecated in X in favor of "backup:get":"rule:xena_system_admin_or_project_reader". Reason: Default policies now support the three Keystone default roles, namely 'admin', 'member', and 'reader' to implement three Cinder "personas". See "Policy Personas and Permissions" in the "Cinder Service Configuration" documentation (Xena release) for details.. Either ensure your deployment is ready for the new default or copy/paste the deprecated policy into your policy file and maintain it manually. May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: warnings.warn(deprecated_msg) May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_policy/policy.py:814: UserWarning: Policy "backup:update":"rule:admin_or_owner" was deprecated in X in favor of "backup:update":"rule:xena_system_admin_or_project_member". Reason: Default policies now support the three Keystone default roles, namely 'admin', 'member', and 'reader' to implement three Cinder "personas". See "Policy Personas and Permissions" in the "Cinder Service Configuration" documentation (Xena release) for details.. Either ensure your deployment is ready for the new default or copy/paste the deprecated policy into your policy file and maintain it manually. May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: warnings.warn(deprecated_msg) May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_policy/policy.py:814: UserWarning: Policy "backup:delete":"rule:admin_or_owner" was deprecated in X in favor of "backup:delete":"rule:xena_system_admin_or_project_member". Reason: Default policies now support the three Keystone default roles, namely 'admin', 'member', and 'reader' to implement three Cinder "personas". See "Policy Personas and Permissions" in the "Cinder Service Configuration" documentation (Xena release) for details.. Either ensure your deployment is ready for the new default or copy/paste the deprecated policy into your policy file and maintain it manually. May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: warnings.warn(deprecated_msg) May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_policy/policy.py:814: UserWarning: Policy "backup:restore":"rule:admin_or_owner" was deprecated in X in favor of "backup:restore":"rule:xena_system_admin_or_project_member". Reason: Default policies now support the three Keystone default roles, namely 'admin', 'member', and 'reader' to implement three Cinder "personas". See "Policy Personas and Permissions" in the "Cinder Service Configuration" documentation (Xena release) for details.. Either ensure your deployment is ready for the new default or copy/paste the deprecated policy into your policy file and maintain it manually. May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: warnings.warn(deprecated_msg) May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_policy/policy.py:814: UserWarning: Policy "group:get_all":"rule:admin_or_owner" was deprecated in X in favor of "group:get_all":"rule:xena_system_admin_or_project_reader". Reason: Default policies now support the three Keystone default roles, namely 'admin', 'member', and 'reader' to implement three Cinder "personas". See "Policy Personas and Permissions" in the "Cinder Service Configuration" documentation (Xena release) for details.. Either ensure your deployment is ready for the new default or copy/paste the deprecated policy into your policy file and maintain it manually. May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: warnings.warn(deprecated_msg) May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_policy/policy.py:814: UserWarning: Policy "group:create":"" was deprecated in X in favor of "group:create":"rule:xena_system_admin_or_project_member". Reason: Default policies now support the three Keystone default roles, namely 'admin', 'member', and 'reader' to implement three Cinder "personas". See "Policy Personas and Permissions" in the "Cinder Service Configuration" documentation (Xena release) for details.. Either ensure your deployment is ready for the new default or copy/paste the deprecated policy into your policy file and maintain it manually. May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: warnings.warn(deprecated_msg) May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_policy/policy.py:814: UserWarning: Policy "group:get":"rule:admin_or_owner" was deprecated in X in favor of "group:get":"rule:xena_system_admin_or_project_reader". Reason: Default policies now support the three Keystone default roles, namely 'admin', 'member', and 'reader' to implement three Cinder "personas". See "Policy Personas and Permissions" in the "Cinder Service Configuration" documentation (Xena release) for details.. Either ensure your deployment is ready for the new default or copy/paste the deprecated policy into your policy file and maintain it manually. May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: warnings.warn(deprecated_msg) May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_policy/policy.py:814: UserWarning: Policy "group:update":"rule:admin_or_owner" was deprecated in X in favor of "group:update":"rule:xena_system_admin_or_project_member". Reason: Default policies now support the three Keystone default roles, namely 'admin', 'member', and 'reader' to implement three Cinder "personas". See "Policy Personas and Permissions" in the "Cinder Service Configuration" documentation (Xena release) for details.. Either ensure your deployment is ready for the new default or copy/paste the deprecated policy into your policy file and maintain it manually. May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: warnings.warn(deprecated_msg) May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_policy/policy.py:814: UserWarning: Policy "group:get_all_group_snapshots":"rule:admin_or_owner" was deprecated in X in favor of "group:get_all_group_snapshots":"rule:xena_system_admin_or_project_reader". Reason: Default policies now support the three Keystone default roles, namely 'admin', 'member', and 'reader' to implement three Cinder "personas". See "Policy Personas and Permissions" in the "Cinder Service Configuration" documentation (Xena release) for details.. Either ensure your deployment is ready for the new default or copy/paste the deprecated policy into your policy file and maintain it manually. May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: warnings.warn(deprecated_msg) May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_policy/policy.py:814: UserWarning: Policy "group:create_group_snapshot":"" was deprecated in X in favor of "group:create_group_snapshot":"rule:xena_system_admin_or_project_member". Reason: Default policies now support the three Keystone default roles, namely 'admin', 'member', and 'reader' to implement three Cinder "personas". See "Policy Personas and Permissions" in the "Cinder Service Configuration" documentation (Xena release) for details.. Either ensure your deployment is ready for the new default or copy/paste the deprecated policy into your policy file and maintain it manually. May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: warnings.warn(deprecated_msg) May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_policy/policy.py:814: UserWarning: Policy "group:get_group_snapshot":"rule:admin_or_owner" was deprecated in X in favor of "group:get_group_snapshot":"rule:xena_system_admin_or_project_reader". Reason: Default policies now support the three Keystone default roles, namely 'admin', 'member', and 'reader' to implement three Cinder "personas". See "Policy Personas and Permissions" in the "Cinder Service Configuration" documentation (Xena release) for details.. Either ensure your deployment is ready for the new default or copy/paste the deprecated policy into your policy file and maintain it manually. May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: warnings.warn(deprecated_msg) May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_policy/policy.py:814: UserWarning: Policy "group:delete_group_snapshot":"rule:admin_or_owner" was deprecated in X in favor of "group:delete_group_snapshot":"rule:xena_system_admin_or_project_member". Reason: Default policies now support the three Keystone default roles, namely 'admin', 'member', and 'reader' to implement three Cinder "personas". See "Policy Personas and Permissions" in the "Cinder Service Configuration" documentation (Xena release) for details.. Either ensure your deployment is ready for the new default or copy/paste the deprecated policy into your policy file and maintain it manually. May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: warnings.warn(deprecated_msg) May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_policy/policy.py:814: UserWarning: Policy "group:update_group_snapshot":"rule:admin_or_owner" was deprecated in X in favor of "group:update_group_snapshot":"rule:xena_system_admin_or_project_member". Reason: Default policies now support the three Keystone default roles, namely 'admin', 'member', and 'reader' to implement three Cinder "personas". See "Policy Personas and Permissions" in the "Cinder Service Configuration" documentation (Xena release) for details.. Either ensure your deployment is ready for the new default or copy/paste the deprecated policy into your policy file and maintain it manually. May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: warnings.warn(deprecated_msg) May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_policy/policy.py:814: UserWarning: Policy "group:delete":"rule:admin_or_owner" was deprecated in X in favor of "group:delete":"rule:xena_system_admin_or_project_member". Reason: Default policies now support the three Keystone default roles, namely 'admin', 'member', and 'reader' to implement three Cinder "personas". See "Policy Personas and Permissions" in the "Cinder Service Configuration" documentation (Xena release) for details.. Either ensure your deployment is ready for the new default or copy/paste the deprecated policy into your policy file and maintain it manually. May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: warnings.warn(deprecated_msg) May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_policy/policy.py:814: UserWarning: Policy "group:enable_replication":"rule:admin_or_owner" was deprecated in X in favor of "group:enable_replication":"rule:xena_system_admin_or_project_member". Reason: Default policies now support the three Keystone default roles, namely 'admin', 'member', and 'reader' to implement three Cinder "personas". See "Policy Personas and Permissions" in the "Cinder Service Configuration" documentation (Xena release) for details.. Either ensure your deployment is ready for the new default or copy/paste the deprecated policy into your policy file and maintain it manually. May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: warnings.warn(deprecated_msg) May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_policy/policy.py:814: UserWarning: Policy "group:disable_replication":"rule:admin_or_owner" was deprecated in X in favor of "group:disable_replication":"rule:xena_system_admin_or_project_member". Reason: Default policies now support the three Keystone default roles, namely 'admin', 'member', and 'reader' to implement three Cinder "personas". See "Policy Personas and Permissions" in the "Cinder Service Configuration" documentation (Xena release) for details.. Either ensure your deployment is ready for the new default or copy/paste the deprecated policy into your policy file and maintain it manually. May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: warnings.warn(deprecated_msg) May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_policy/policy.py:814: UserWarning: Policy "group:failover_replication":"rule:admin_or_owner" was deprecated in X in favor of "group:failover_replication":"rule:xena_system_admin_or_project_member". Reason: Default policies now support the three Keystone default roles, namely 'admin', 'member', and 'reader' to implement three Cinder "personas". See "Policy Personas and Permissions" in the "Cinder Service Configuration" documentation (Xena release) for details.. Either ensure your deployment is ready for the new default or copy/paste the deprecated policy into your policy file and maintain it manually. May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: warnings.warn(deprecated_msg) May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_policy/policy.py:814: UserWarning: Policy "group:list_replication_targets":"rule:admin_or_owner" was deprecated in X in favor of "group:list_replication_targets":"rule:xena_system_admin_or_project_member". Reason: Default policies now support the three Keystone default roles, namely 'admin', 'member', and 'reader' to implement three Cinder "personas". See "Policy Personas and Permissions" in the "Cinder Service Configuration" documentation (Xena release) for details.. Either ensure your deployment is ready for the new default or copy/paste the deprecated policy into your policy file and maintain it manually. May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: warnings.warn(deprecated_msg) May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_policy/policy.py:814: UserWarning: Policy "volume_extension:quotas:show":"rule:admin_or_owner" was deprecated in None in favor of "volume_extension:quotas:show":"rule:xena_system_admin_or_project_reader". Reason: None. Either ensure your deployment is ready for the new default or copy/paste the deprecated policy into your policy file and maintain it manually. May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: warnings.warn(deprecated_msg) May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_policy/policy.py:814: UserWarning: Policy "limits_extension:used_limits":"rule:admin_or_owner" was deprecated in X in favor of "limits_extension:used_limits":"rule:xena_system_admin_or_project_reader". Reason: Default policies now support the three Keystone default roles, namely 'admin', 'member', and 'reader' to implement three Cinder "personas". See "Policy Personas and Permissions" in the "Cinder Service Configuration" documentation (Xena release) for details.. Either ensure your deployment is ready for the new default or copy/paste the deprecated policy into your policy file and maintain it manually. May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: warnings.warn(deprecated_msg) May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_policy/policy.py:814: UserWarning: Policy "volume_extension:type_get":"" was deprecated in X in favor of "volume_extension:type_get":"rule:xena_system_admin_or_project_reader". Reason: Default policies now support the three Keystone default roles, namely 'admin', 'member', and 'reader' to implement three Cinder "personas". See "Policy Personas and Permissions" in the "Cinder Service Configuration" documentation (Xena release) for details.. Either ensure your deployment is ready for the new default or copy/paste the deprecated policy into your policy file and maintain it manually. May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: warnings.warn(deprecated_msg) May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_policy/policy.py:814: UserWarning: Policy "volume_extension:type_get_all":"" was deprecated in X in favor of "volume_extension:type_get_all":"rule:xena_system_admin_or_project_reader". Reason: Default policies now support the three Keystone default roles, namely 'admin', 'member', and 'reader' to implement three Cinder "personas". See "Policy Personas and Permissions" in the "Cinder Service Configuration" documentation (Xena release) for details.. Either ensure your deployment is ready for the new default or copy/paste the deprecated policy into your policy file and maintain it manually. May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: warnings.warn(deprecated_msg) May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_policy/policy.py:814: UserWarning: Policy "volume_extension:access_types_extra_specs":"rule:admin_api" was deprecated in X in favor of "volume_extension:access_types_extra_specs":"rule:xena_system_admin_or_project_reader". Reason: Default policies now support the three Keystone default roles, namely 'admin', 'member', and 'reader' to implement three Cinder "personas". See "Policy Personas and Permissions" in the "Cinder Service Configuration" documentation (Xena release) for details.. Either ensure your deployment is ready for the new default or copy/paste the deprecated policy into your policy file and maintain it manually. May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: warnings.warn(deprecated_msg) May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_policy/policy.py:814: UserWarning: Policy "volume_extension:volume_type_encryption:create":"rule:volume_extension:volume_type_encryption" was deprecated in X in favor of "volume_extension:volume_type_encryption:create":"rule:admin_api". Reason: Reason: 'volume_extension:volume_type_encryption' was a convenience policy that allowed you to set all volume encryption type policies to the same value. We are deprecating this rule to prepare for a future release in which the default values for policies that read, create/update, and delete encryption types will be different from each other.. Either ensure your deployment is ready for the new default or copy/paste the deprecated policy into your policy file and maintain it manually. May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: warnings.warn(deprecated_msg) May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_policy/policy.py:814: UserWarning: Policy "volume_extension:volume_type_encryption:get":"rule:volume_extension:volume_type_encryption" was deprecated in X in favor of "volume_extension:volume_type_encryption:get":"rule:admin_api". Reason: Reason: 'volume_extension:volume_type_encryption' was a convenience policy that allowed you to set all volume encryption type policies to the same value. We are deprecating this rule to prepare for a future release in which the default values for policies that read, create/update, and delete encryption types will be different from each other.. Either ensure your deployment is ready for the new default or copy/paste the deprecated policy into your policy file and maintain it manually. May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: warnings.warn(deprecated_msg) May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_policy/policy.py:814: UserWarning: Policy "volume_extension:volume_type_encryption:update":"rule:volume_extension:volume_type_encryption" was deprecated in X in favor of "volume_extension:volume_type_encryption:update":"rule:admin_api". Reason: Reason: 'volume_extension:volume_type_encryption' was a convenience policy that allowed you to set all volume encryption type policies to the same value. We are deprecating this rule to prepare for a future release in which the default values for policies that read, create/update, and delete encryption types will be different from each other.. Either ensure your deployment is ready for the new default or copy/paste the deprecated policy into your policy file and maintain it manually. May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: warnings.warn(deprecated_msg) May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_policy/policy.py:814: UserWarning: Policy "volume_extension:volume_type_encryption:delete":"rule:volume_extension:volume_type_encryption" was deprecated in X in favor of "volume_extension:volume_type_encryption:delete":"rule:admin_api". Reason: Reason: 'volume_extension:volume_type_encryption' was a convenience policy that allowed you to set all volume encryption type policies to the same value. We are deprecating this rule to prepare for a future release in which the default values for policies that read, create/update, and delete encryption types will be different from each other.. Either ensure your deployment is ready for the new default or copy/paste the deprecated policy into your policy file and maintain it manually. May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: warnings.warn(deprecated_msg) May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_policy/policy.py:814: UserWarning: Policy "volume_extension:volume_type_access":"rule:admin_or_owner" was deprecated in X in favor of "volume_extension:volume_type_access":"rule:xena_system_admin_or_project_member". Reason: Default policies now support the three Keystone default roles, namely 'admin', 'member', and 'reader' to implement three Cinder "personas". See "Policy Personas and Permissions" in the "Cinder Service Configuration" documentation (Xena release) for details.. Either ensure your deployment is ready for the new default or copy/paste the deprecated policy into your policy file and maintain it manually. May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: warnings.warn(deprecated_msg) May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_policy/policy.py:814: UserWarning: Policy "volume_extension:volume_type_access:get_all_for_type":"volume_extension:volume_type_access" was deprecated in X in favor of "volume_extension:volume_type_access:get_all_for_type":"rule:admin_api". Reason: Reason: 'volume_extension:volume_type_access:get_all_for_type' is a new policy that protects an API call formerly governed by 'volume_extension:volume_type_access', but which has been separated for finer-grained policy control.. Either ensure your deployment is ready for the new default or copy/paste the deprecated policy into your policy file and maintain it manually. May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: warnings.warn(deprecated_msg) May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_policy/policy.py:814: UserWarning: Policy "volume:extend":"rule:admin_or_owner" was deprecated in X in favor of "volume:extend":"rule:xena_system_admin_or_project_member". Reason: Default policies now support the three Keystone default roles, namely 'admin', 'member', and 'reader' to implement three Cinder "personas". See "Policy Personas and Permissions" in the "Cinder Service Configuration" documentation (Xena release) for details.. Either ensure your deployment is ready for the new default or copy/paste the deprecated policy into your policy file and maintain it manually. May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: warnings.warn(deprecated_msg) May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_policy/policy.py:814: UserWarning: Policy "volume:extend_attached_volume":"rule:admin_or_owner" was deprecated in X in favor of "volume:extend_attached_volume":"rule:xena_system_admin_or_project_member". Reason: Default policies now support the three Keystone default roles, namely 'admin', 'member', and 'reader' to implement three Cinder "personas". See "Policy Personas and Permissions" in the "Cinder Service Configuration" documentation (Xena release) for details.. Either ensure your deployment is ready for the new default or copy/paste the deprecated policy into your policy file and maintain it manually. May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: warnings.warn(deprecated_msg) May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_policy/policy.py:814: UserWarning: Policy "volume:revert_to_snapshot":"rule:admin_or_owner" was deprecated in X in favor of "volume:revert_to_snapshot":"rule:xena_system_admin_or_project_member". Reason: Default policies now support the three Keystone default roles, namely 'admin', 'member', and 'reader' to implement three Cinder "personas". See "Policy Personas and Permissions" in the "Cinder Service Configuration" documentation (Xena release) for details.. Either ensure your deployment is ready for the new default or copy/paste the deprecated policy into your policy file and maintain it manually. May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: warnings.warn(deprecated_msg) May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_policy/policy.py:814: UserWarning: Policy "volume:retype":"rule:admin_or_owner" was deprecated in X in favor of "volume:retype":"rule:xena_system_admin_or_project_member". Reason: Default policies now support the three Keystone default roles, namely 'admin', 'member', and 'reader' to implement three Cinder "personas". See "Policy Personas and Permissions" in the "Cinder Service Configuration" documentation (Xena release) for details.. Either ensure your deployment is ready for the new default or copy/paste the deprecated policy into your policy file and maintain it manually. May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: warnings.warn(deprecated_msg) May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_policy/policy.py:814: UserWarning: Policy "volume:update_readonly_flag":"rule:admin_or_owner" was deprecated in X in favor of "volume:update_readonly_flag":"rule:xena_system_admin_or_project_member". Reason: Default policies now support the three Keystone default roles, namely 'admin', 'member', and 'reader' to implement three Cinder "personas". See "Policy Personas and Permissions" in the "Cinder Service Configuration" documentation (Xena release) for details.. Either ensure your deployment is ready for the new default or copy/paste the deprecated policy into your policy file and maintain it manually. May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: warnings.warn(deprecated_msg) May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_policy/policy.py:814: UserWarning: Policy "volume_extension:volume_actions:upload_image":"rule:admin_or_owner" was deprecated in X in favor of "volume_extension:volume_actions:upload_image":"rule:xena_system_admin_or_project_member". Reason: Default policies now support the three Keystone default roles, namely 'admin', 'member', and 'reader' to implement three Cinder "personas". See "Policy Personas and Permissions" in the "Cinder Service Configuration" documentation (Xena release) for details.. Either ensure your deployment is ready for the new default or copy/paste the deprecated policy into your policy file and maintain it manually. May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: warnings.warn(deprecated_msg) May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_policy/policy.py:814: UserWarning: Policy "volume_extension:volume_actions:initialize_connection":"rule:admin_or_owner" was deprecated in X in favor of "volume_extension:volume_actions:initialize_connection":"rule:xena_system_admin_or_project_member". Reason: Default policies now support the three Keystone default roles, namely 'admin', 'member', and 'reader' to implement three Cinder "personas". See "Policy Personas and Permissions" in the "Cinder Service Configuration" documentation (Xena release) for details.. Either ensure your deployment is ready for the new default or copy/paste the deprecated policy into your policy file and maintain it manually. May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: warnings.warn(deprecated_msg) May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_policy/policy.py:814: UserWarning: Policy "volume_extension:volume_actions:terminate_connection":"rule:admin_or_owner" was deprecated in X in favor of "volume_extension:volume_actions:terminate_connection":"rule:xena_system_admin_or_project_member". Reason: Default policies now support the three Keystone default roles, namely 'admin', 'member', and 'reader' to implement three Cinder "personas". See "Policy Personas and Permissions" in the "Cinder Service Configuration" documentation (Xena release) for details.. Either ensure your deployment is ready for the new default or copy/paste the deprecated policy into your policy file and maintain it manually. May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: warnings.warn(deprecated_msg) May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_policy/policy.py:814: UserWarning: Policy "volume_extension:volume_actions:roll_detaching":"rule:admin_or_owner" was deprecated in X in favor of "volume_extension:volume_actions:roll_detaching":"rule:xena_system_admin_or_project_member". Reason: Default policies now support the three Keystone default roles, namely 'admin', 'member', and 'reader' to implement three Cinder "personas". See "Policy Personas and Permissions" in the "Cinder Service Configuration" documentation (Xena release) for details.. Either ensure your deployment is ready for the new default or copy/paste the deprecated policy into your policy file and maintain it manually. May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: warnings.warn(deprecated_msg) May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_policy/policy.py:814: UserWarning: Policy "volume_extension:volume_actions:reserve":"rule:admin_or_owner" was deprecated in X in favor of "volume_extension:volume_actions:reserve":"rule:xena_system_admin_or_project_member". Reason: Default policies now support the three Keystone default roles, namely 'admin', 'member', and 'reader' to implement three Cinder "personas". See "Policy Personas and Permissions" in the "Cinder Service Configuration" documentation (Xena release) for details.. Either ensure your deployment is ready for the new default or copy/paste the deprecated policy into your policy file and maintain it manually. May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: warnings.warn(deprecated_msg) May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_policy/policy.py:814: UserWarning: Policy "volume_extension:volume_actions:unreserve":"rule:admin_or_owner" was deprecated in X in favor of "volume_extension:volume_actions:unreserve":"rule:xena_system_admin_or_project_member". Reason: Default policies now support the three Keystone default roles, namely 'admin', 'member', and 'reader' to implement three Cinder "personas". See "Policy Personas and Permissions" in the "Cinder Service Configuration" documentation (Xena release) for details.. Either ensure your deployment is ready for the new default or copy/paste the deprecated policy into your policy file and maintain it manually. May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: warnings.warn(deprecated_msg) May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_policy/policy.py:814: UserWarning: Policy "volume_extension:volume_actions:begin_detaching":"rule:admin_or_owner" was deprecated in X in favor of "volume_extension:volume_actions:begin_detaching":"rule:xena_system_admin_or_project_member". Reason: Default policies now support the three Keystone default roles, namely 'admin', 'member', and 'reader' to implement three Cinder "personas". See "Policy Personas and Permissions" in the "Cinder Service Configuration" documentation (Xena release) for details.. Either ensure your deployment is ready for the new default or copy/paste the deprecated policy into your policy file and maintain it manually. May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: warnings.warn(deprecated_msg) May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_policy/policy.py:814: UserWarning: Policy "volume_extension:volume_actions:attach":"rule:admin_or_owner" was deprecated in X in favor of "volume_extension:volume_actions:attach":"rule:xena_system_admin_or_project_member". Reason: Default policies now support the three Keystone default roles, namely 'admin', 'member', and 'reader' to implement three Cinder "personas". See "Policy Personas and Permissions" in the "Cinder Service Configuration" documentation (Xena release) for details.. Either ensure your deployment is ready for the new default or copy/paste the deprecated policy into your policy file and maintain it manually. May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: warnings.warn(deprecated_msg) May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_policy/policy.py:814: UserWarning: Policy "volume_extension:volume_actions:detach":"rule:admin_or_owner" was deprecated in X in favor of "volume_extension:volume_actions:detach":"rule:xena_system_admin_or_project_member". Reason: Default policies now support the three Keystone default roles, namely 'admin', 'member', and 'reader' to implement three Cinder "personas". See "Policy Personas and Permissions" in the "Cinder Service Configuration" documentation (Xena release) for details.. Either ensure your deployment is ready for the new default or copy/paste the deprecated policy into your policy file and maintain it manually. May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: warnings.warn(deprecated_msg) May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_policy/policy.py:814: UserWarning: Policy "volume:get_all_transfers":"rule:admin_or_owner" was deprecated in X in favor of "volume:get_all_transfers":"rule:xena_system_admin_or_project_reader". Reason: Default policies now support the three Keystone default roles, namely 'admin', 'member', and 'reader' to implement three Cinder "personas". See "Policy Personas and Permissions" in the "Cinder Service Configuration" documentation (Xena release) for details.. Either ensure your deployment is ready for the new default or copy/paste the deprecated policy into your policy file and maintain it manually. May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: warnings.warn(deprecated_msg) May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_policy/policy.py:814: UserWarning: Policy "volume:create_transfer":"rule:admin_or_owner" was deprecated in X in favor of "volume:create_transfer":"rule:xena_system_admin_or_project_member". Reason: Default policies now support the three Keystone default roles, namely 'admin', 'member', and 'reader' to implement three Cinder "personas". See "Policy Personas and Permissions" in the "Cinder Service Configuration" documentation (Xena release) for details.. Either ensure your deployment is ready for the new default or copy/paste the deprecated policy into your policy file and maintain it manually. May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: warnings.warn(deprecated_msg) May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_policy/policy.py:814: UserWarning: Policy "volume:get_transfer":"rule:admin_or_owner" was deprecated in X in favor of "volume:get_transfer":"rule:xena_system_admin_or_project_reader". Reason: Default policies now support the three Keystone default roles, namely 'admin', 'member', and 'reader' to implement three Cinder "personas". See "Policy Personas and Permissions" in the "Cinder Service Configuration" documentation (Xena release) for details.. Either ensure your deployment is ready for the new default or copy/paste the deprecated policy into your policy file and maintain it manually. May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: warnings.warn(deprecated_msg) May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_policy/policy.py:814: UserWarning: Policy "volume:accept_transfer":"" was deprecated in X in favor of "volume:accept_transfer":"rule:xena_system_admin_or_project_member". Reason: Default policies now support the three Keystone default roles, namely 'admin', 'member', and 'reader' to implement three Cinder "personas". See "Policy Personas and Permissions" in the "Cinder Service Configuration" documentation (Xena release) for details.. Either ensure your deployment is ready for the new default or copy/paste the deprecated policy into your policy file and maintain it manually. May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: warnings.warn(deprecated_msg) May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_policy/policy.py:814: UserWarning: Policy "volume:delete_transfer":"rule:admin_or_owner" was deprecated in X in favor of "volume:delete_transfer":"rule:xena_system_admin_or_project_member". Reason: Default policies now support the three Keystone default roles, namely 'admin', 'member', and 'reader' to implement three Cinder "personas". See "Policy Personas and Permissions" in the "Cinder Service Configuration" documentation (Xena release) for details.. Either ensure your deployment is ready for the new default or copy/paste the deprecated policy into your policy file and maintain it manually. May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: warnings.warn(deprecated_msg) May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_policy/policy.py:814: UserWarning: Policy "volume:get_volume_metadata":"rule:admin_or_owner" was deprecated in X in favor of "volume:get_volume_metadata":"rule:xena_system_admin_or_project_reader". Reason: Default policies now support the three Keystone default roles, namely 'admin', 'member', and 'reader' to implement three Cinder "personas". See "Policy Personas and Permissions" in the "Cinder Service Configuration" documentation (Xena release) for details.. Either ensure your deployment is ready for the new default or copy/paste the deprecated policy into your policy file and maintain it manually. May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: warnings.warn(deprecated_msg) May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_policy/policy.py:814: UserWarning: Policy "volume:create_volume_metadata":"rule:admin_or_owner" was deprecated in X in favor of "volume:create_volume_metadata":"rule:xena_system_admin_or_project_member". Reason: Default policies now support the three Keystone default roles, namely 'admin', 'member', and 'reader' to implement three Cinder "personas". See "Policy Personas and Permissions" in the "Cinder Service Configuration" documentation (Xena release) for details.. Either ensure your deployment is ready for the new default or copy/paste the deprecated policy into your policy file and maintain it manually. May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: warnings.warn(deprecated_msg) May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_policy/policy.py:814: UserWarning: Policy "volume:update_volume_metadata":"rule:admin_or_owner" was deprecated in X in favor of "volume:update_volume_metadata":"rule:xena_system_admin_or_project_member". Reason: Default policies now support the three Keystone default roles, namely 'admin', 'member', and 'reader' to implement three Cinder "personas". See "Policy Personas and Permissions" in the "Cinder Service Configuration" documentation (Xena release) for details.. Either ensure your deployment is ready for the new default or copy/paste the deprecated policy into your policy file and maintain it manually. May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: warnings.warn(deprecated_msg) May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_policy/policy.py:814: UserWarning: Policy "volume:delete_volume_metadata":"rule:admin_or_owner" was deprecated in X in favor of "volume:delete_volume_metadata":"rule:xena_system_admin_or_project_member". Reason: Default policies now support the three Keystone default roles, namely 'admin', 'member', and 'reader' to implement three Cinder "personas". See "Policy Personas and Permissions" in the "Cinder Service Configuration" documentation (Xena release) for details.. Either ensure your deployment is ready for the new default or copy/paste the deprecated policy into your policy file and maintain it manually. May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: warnings.warn(deprecated_msg) May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_policy/policy.py:814: UserWarning: Policy "volume_extension:volume_image_metadata":"rule:admin_or_owner" was deprecated in X in favor of "volume_extension:volume_image_metadata:show":"rule:xena_system_admin_or_project_reader". Reason: volume_extension:volume_image_metadata has been replaced by more granular policies that separately govern show, set, and remove operations.. Either ensure your deployment is ready for the new default or copy/paste the deprecated policy into your policy file and maintain it manually. May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: warnings.warn(deprecated_msg) May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_policy/policy.py:814: UserWarning: Policy "volume_extension:volume_image_metadata":"rule:admin_or_owner" was deprecated in X in favor of "volume_extension:volume_image_metadata:set":"rule:xena_system_admin_or_project_member". Reason: volume_extension:volume_image_metadata has been replaced by more granular policies that separately govern show, set, and remove operations.. Either ensure your deployment is ready for the new default or copy/paste the deprecated policy into your policy file and maintain it manually. May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: warnings.warn(deprecated_msg) May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_policy/policy.py:814: UserWarning: Policy "volume_extension:volume_image_metadata":"rule:admin_or_owner" was deprecated in X in favor of "volume_extension:volume_image_metadata:remove":"rule:xena_system_admin_or_project_member". Reason: volume_extension:volume_image_metadata has been replaced by more granular policies that separately govern show, set, and remove operations.. Either ensure your deployment is ready for the new default or copy/paste the deprecated policy into your policy file and maintain it manually. May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: warnings.warn(deprecated_msg) May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_policy/policy.py:814: UserWarning: Policy "volume_extension:types_extra_specs:index":"" was deprecated in X in favor of "volume_extension:types_extra_specs:index":"rule:xena_system_admin_or_project_reader". Reason: Default policies now support the three Keystone default roles, namely 'admin', 'member', and 'reader' to implement three Cinder "personas". See "Policy Personas and Permissions" in the "Cinder Service Configuration" documentation (Xena release) for details.. Either ensure your deployment is ready for the new default or copy/paste the deprecated policy into your policy file and maintain it manually. May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: warnings.warn(deprecated_msg) May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_policy/policy.py:814: UserWarning: Policy "volume_extension:types_extra_specs:show":"" was deprecated in X in favor of "volume_extension:types_extra_specs:show":"rule:xena_system_admin_or_project_reader". Reason: Default policies now support the three Keystone default roles, namely 'admin', 'member', and 'reader' to implement three Cinder "personas". See "Policy Personas and Permissions" in the "Cinder Service Configuration" documentation (Xena release) for details.. Either ensure your deployment is ready for the new default or copy/paste the deprecated policy into your policy file and maintain it manually. May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: warnings.warn(deprecated_msg) May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_policy/policy.py:814: UserWarning: Policy "volume:create":"" was deprecated in X in favor of "volume:create":"rule:xena_system_admin_or_project_member". Reason: Default policies now support the three Keystone default roles, namely 'admin', 'member', and 'reader' to implement three Cinder "personas". See "Policy Personas and Permissions" in the "Cinder Service Configuration" documentation (Xena release) for details.. Either ensure your deployment is ready for the new default or copy/paste the deprecated policy into your policy file and maintain it manually. May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: warnings.warn(deprecated_msg) May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_policy/policy.py:814: UserWarning: Policy "volume:create_from_image":"" was deprecated in X in favor of "volume:create_from_image":"rule:xena_system_admin_or_project_member". Reason: Default policies now support the three Keystone default roles, namely 'admin', 'member', and 'reader' to implement three Cinder "personas". See "Policy Personas and Permissions" in the "Cinder Service Configuration" documentation (Xena release) for details.. Either ensure your deployment is ready for the new default or copy/paste the deprecated policy into your policy file and maintain it manually. May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: warnings.warn(deprecated_msg) May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_policy/policy.py:814: UserWarning: Policy "volume:get":"rule:admin_or_owner" was deprecated in X in favor of "volume:get":"rule:xena_system_admin_or_project_reader". Reason: Default policies now support the three Keystone default roles, namely 'admin', 'member', and 'reader' to implement three Cinder "personas". See "Policy Personas and Permissions" in the "Cinder Service Configuration" documentation (Xena release) for details.. Either ensure your deployment is ready for the new default or copy/paste the deprecated policy into your policy file and maintain it manually. May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: warnings.warn(deprecated_msg) May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_policy/policy.py:814: UserWarning: Policy "volume:get_all":"rule:admin_or_owner" was deprecated in X in favor of "volume:get_all":"rule:xena_system_admin_or_project_reader". Reason: Default policies now support the three Keystone default roles, namely 'admin', 'member', and 'reader' to implement three Cinder "personas". See "Policy Personas and Permissions" in the "Cinder Service Configuration" documentation (Xena release) for details.. Either ensure your deployment is ready for the new default or copy/paste the deprecated policy into your policy file and maintain it manually. May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: warnings.warn(deprecated_msg) May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_policy/policy.py:814: UserWarning: Policy "volume:update":"rule:admin_or_owner" was deprecated in X in favor of "volume:update":"rule:xena_system_admin_or_project_member". Reason: Default policies now support the three Keystone default roles, namely 'admin', 'member', and 'reader' to implement three Cinder "personas". See "Policy Personas and Permissions" in the "Cinder Service Configuration" documentation (Xena release) for details.. Either ensure your deployment is ready for the new default or copy/paste the deprecated policy into your policy file and maintain it manually. May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: warnings.warn(deprecated_msg) May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_policy/policy.py:814: UserWarning: Policy "volume:delete":"rule:admin_or_owner" was deprecated in X in favor of "volume:delete":"rule:xena_system_admin_or_project_member". Reason: Default policies now support the three Keystone default roles, namely 'admin', 'member', and 'reader' to implement three Cinder "personas". See "Policy Personas and Permissions" in the "Cinder Service Configuration" documentation (Xena release) for details.. Either ensure your deployment is ready for the new default or copy/paste the deprecated policy into your policy file and maintain it manually. May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: warnings.warn(deprecated_msg) May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_policy/policy.py:814: UserWarning: Policy "volume_extension:volume_tenant_attribute":"rule:admin_or_owner" was deprecated in X in favor of "volume_extension:volume_tenant_attribute":"rule:xena_system_admin_or_project_reader". Reason: Default policies now support the three Keystone default roles, namely 'admin', 'member', and 'reader' to implement three Cinder "personas". See "Policy Personas and Permissions" in the "Cinder Service Configuration" documentation (Xena release) for details.. Either ensure your deployment is ready for the new default or copy/paste the deprecated policy into your policy file and maintain it manually. May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: warnings.warn(deprecated_msg) May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_policy/policy.py:814: UserWarning: Policy "volume_extension:volume_encryption_metadata":"rule:admin_or_owner" was deprecated in X in favor of "volume_extension:volume_encryption_metadata":"rule:xena_system_admin_or_project_reader". Reason: Default policies now support the three Keystone default roles, namely 'admin', 'member', and 'reader' to implement three Cinder "personas". See "Policy Personas and Permissions" in the "Cinder Service Configuration" documentation (Xena release) for details.. Either ensure your deployment is ready for the new default or copy/paste the deprecated policy into your policy file and maintain it manually. May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: warnings.warn(deprecated_msg) May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_policy/policy.py:814: UserWarning: Policy "volume:multiattach":"rule:admin_or_owner" was deprecated in X in favor of "volume:multiattach":"rule:xena_system_admin_or_project_member". Reason: Default policies now support the three Keystone default roles, namely 'admin', 'member', and 'reader' to implement three Cinder "personas". See "Policy Personas and Permissions" in the "Cinder Service Configuration" documentation (Xena release) for details.. Either ensure your deployment is ready for the new default or copy/paste the deprecated policy into your policy file and maintain it manually. May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: warnings.warn(deprecated_msg) May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_policy/policy.py:814: UserWarning: Policy "volume_extension:default_set_or_update":"rule:system_or_domain_or_project_admin" was deprecated in X in favor of "volume_extension:default_set_or_update":"rule:admin_api". Reason: Default policies now support the three Keystone default roles, namely 'admin', 'member', and 'reader' to implement three Cinder "personas". See "Policy Personas and Permissions" in the "Cinder Service Configuration" documentation (Xena release) for details.. Either ensure your deployment is ready for the new default or copy/paste the deprecated policy into your policy file and maintain it manually. May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: warnings.warn(deprecated_msg) May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_policy/policy.py:814: UserWarning: Policy "volume_extension:default_get":"rule:system_or_domain_or_project_admin" was deprecated in X in favor of "volume_extension:default_get":"rule:admin_api". Reason: Default policies now support the three Keystone default roles, namely 'admin', 'member', and 'reader' to implement three Cinder "personas". See "Policy Personas and Permissions" in the "Cinder Service Configuration" documentation (Xena release) for details.. Either ensure your deployment is ready for the new default or copy/paste the deprecated policy into your policy file and maintain it manually. May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: warnings.warn(deprecated_msg) May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_policy/policy.py:814: UserWarning: Policy "volume_extension:default_get_all":"role:admin and system_scope:all" was deprecated in X in favor of "volume_extension:default_get_all":"rule:admin_api". Reason: Default policies now support the three Keystone default roles, namely 'admin', 'member', and 'reader' to implement three Cinder "personas". See "Policy Personas and Permissions" in the "Cinder Service Configuration" documentation (Xena release) for details.. Either ensure your deployment is ready for the new default or copy/paste the deprecated policy into your policy file and maintain it manually. May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: warnings.warn(deprecated_msg) May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_policy/policy.py:814: UserWarning: Policy "volume_extension:default_unset":"rule:system_or_domain_or_project_admin" was deprecated in X in favor of "volume_extension:default_unset":"rule:admin_api". Reason: Default policies now support the three Keystone default roles, namely 'admin', 'member', and 'reader' to implement three Cinder "personas". See "Policy Personas and Permissions" in the "Cinder Service Configuration" documentation (Xena release) for details.. Either ensure your deployment is ready for the new default or copy/paste the deprecated policy into your policy file and maintain it manually. May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: warnings.warn(deprecated_msg) May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.middleware.request_id [req-c96200d1-9d58-4949-af5e-69a2071a5977 req-5de0bd31-50c9-4ff5-8ec3-c6e40efcc7ab None None] RequestId filter calling following filter/app {{(pid=84425) _context_setter /opt/stack/cinder/cinder/api/middleware/request_id.py:62}} May 28 12:44:49 l75lg1-v1 nova-compute[83654]: WARNING nova.compute.resource_tracker [None req-d5e2622c-e52e-4f3d-871c-2ddda502f287 None None] No compute node record for l75lg1-v1:ef90d7d1-0808-4a15-ad77-f9a7391af2f4: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host ef90d7d1-0808-4a15-ad77-f9a7391af2f4 could not be found. May 28 12:44:49 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [None req-d5e2622c-e52e-4f3d-871c-2ddda502f287 None None] Expecting reply to msg 6f2ca9cd6a784dfe901d28ebf79e1a65 in queue reply_37f4cbd1dd094961a22b8a65f222c327 May 28 12:44:49 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [-] Received RPC response for msg 6f2ca9cd6a784dfe901d28ebf79e1a65 May 28 12:44:49 l75lg1-v1 cinder-volume[85683]: INFO dbcounter [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] Registered counter for database cinder May 28 12:44:49 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_db.sqlalchemy.engines [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85683) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:342}} May 28 12:44:49 l75lg1-v1 cinder-volume[85683]: DEBUG dbcounter [-] [85683] Writer thread running {{(pid=85683) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} May 28 12:44:49 l75lg1-v1 cinder-volume[85683]: INFO cinder.rpc [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. May 28 12:44:49 l75lg1-v1 cinder-volume[85683]: INFO cinder.rpc [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. May 28 12:44:49 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_db.sqlalchemy.engines [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85683) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:342}} May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: INFO cinder.api.openstack.wsgi [req-c96200d1-9d58-4949-af5e-69a2071a5977 req-5de0bd31-50c9-4ff5-8ec3-c6e40efcc7ab admin admin] POST http://10.27.203.238/volume/v3/ea8d517cde1d40bb82c97e080ce071f7/types/2b79431a-206e-4367-9317-ca013633f41c/extra_specs May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.openstack.wsgi [req-c96200d1-9d58-4949-af5e-69a2071a5977 req-5de0bd31-50c9-4ff5-8ec3-c6e40efcc7ab admin admin] Action: 'create', calling method: create, body: {"extra_specs": {"volume_backend_name": "lvmdriver-1"}} {{(pid=84425) _process_stack /opt/stack/cinder/cinder/api/openstack/wsgi.py:866}} May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_context/context.py:100: DeprecationWarning: Policy enforcement is depending on the value of is_admin. This key is deprecated. Please update your policy file to use the standard policy values. May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: warnings.warn('Policy enforcement is depending on the value of ' May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: DEBUG oslo_db.sqlalchemy.engines [req-c96200d1-9d58-4949-af5e-69a2071a5977 req-5de0bd31-50c9-4ff5-8ec3-c6e40efcc7ab admin admin] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84425) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:342}} May 28 12:44:49 l75lg1-v1 cinder-volume[85683]: INFO cinder.volume.manager [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] Determined volume DB was empty at startup. May 28 12:44:49 l75lg1-v1 cinder-volume[85683]: DEBUG cinder.volume.manager [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] Cinder Volume DB check: vol_db_empty=True {{(pid=85683) __init__ /opt/stack/cinder/cinder/volume/manager.py:290}} May 28 12:44:49 l75lg1-v1 cinder-volume[85683]: INFO cinder.volume.manager [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] Service not found for updating active_backend_id, assuming default for driver init. May 28 12:44:49 l75lg1-v1 cinder-volume[85683]: WARNING stevedore.named [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager May 28 12:44:49 l75lg1-v1 cinder-volume[85683]: WARNING castellan.key_manager [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' May 28 12:44:49 l75lg1-v1 cinder-volume[85683]: WARNING cinder.keymgr.conf_key_mgr [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' May 28 12:44:49 l75lg1-v1 cinder-volume[85683]: DEBUG cinder.volume.drivers.lvm [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=85683) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} May 28 12:44:49 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_concurrency.processutils [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=85683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:390}} May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: INFO cinder.api.openstack.wsgi [req-c96200d1-9d58-4949-af5e-69a2071a5977 req-5de0bd31-50c9-4ff5-8ec3-c6e40efcc7ab admin admin] http://10.27.203.238/volume/v3/ea8d517cde1d40bb82c97e080ce071f7/types/2b79431a-206e-4367-9317-ca013633f41c/extra_specs returned with HTTP 200 May 28 12:44:49 l75lg1-v1 devstack@c-api.service[84425]: [pid: 84425|app: 0|req: 1/3] 10.27.203.238 () {66 vars in 1542 bytes} [Tue May 28 12:44:49 2024] POST /volume/v3/ea8d517cde1d40bb82c97e080ce071f7/types/2b79431a-206e-4367-9317-ca013633f41c/extra_specs => generated 55 bytes in 508 msecs (HTTP/1.1 200) 7 headers in 284 bytes (1 switches on core 0) May 28 12:44:49 l75lg1-v1 nova-compute[83654]: INFO nova.compute.resource_tracker [None req-d5e2622c-e52e-4f3d-871c-2ddda502f287 None None] Compute node record created for l75lg1-v1:l75lg1-v1 with uuid: ef90d7d1-0808-4a15-ad77-f9a7391af2f4 May 28 12:44:49 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [None req-d5e2622c-e52e-4f3d-871c-2ddda502f287 None None] Expecting reply to msg eb855bf07134426ab6c935cd2b02eb06 in queue reply_37f4cbd1dd094961a22b8a65f222c327 May 28 12:44:49 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [-] Received RPC response for msg eb855bf07134426ab6c935cd2b02eb06 May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_concurrency.processutils [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] CMD "cinder-rtstool verify" returned: 0 in 0.258s {{(pid=85683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:428}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_db.sqlalchemy.engines [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85683) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:342}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: INFO cinder.rpc [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: INFO cinder.rpc [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] Automatically selected cinder-volume RPC version 3.19 as minimum service version. May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: WARNING stevedore.named [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: WARNING castellan.key_manager [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: INFO cinder.volume.manager [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] Image-volume cache enabled for host l75lg1-v1@lvmdriver-1. May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_db.sqlalchemy.engines [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85683) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:342}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: INFO oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] Starting 1 workers May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] Started child 85846 {{(pid=85683) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:579}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] Full set of CONF: {{(pid=85683) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:653}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] ******************************************************************************** {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2600}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] Configuration options gathered from: {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2601}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2603}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] ================================================================================ {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2605}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] allow_availability_zone_fallback = False {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] allow_compression_on_image_upload = False {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85846]: INFO cinder.service [-] Starting cinder-volume node (version 24.1.0) May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] allowed_direct_url_schemes = [] {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] api_rate_limit = True {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] auth_strategy = keystone {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] az_cache_duration = 3600 {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] backend_availability_zone = None {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] backend_host = None {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] backend_name = None {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] backend_stats_polling_interval = 60 {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] backup_api_class = cinder.backup.api.API {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] backup_name_template = backup-%s {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] backup_use_same_host = False {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] backup_use_temp_snapshot = False {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] chap_password = **** {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] chap_username = {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] cinder_internal_tenant_project_id = 98a6a2dcbf0248d5b353760f7757f713 {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] cinder_internal_tenant_user_id = d8b9b336af4049a99b45df9eba13a358 {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] cloned_volume_same_az = True {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] cluster = None {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] compression_format = gzip {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] compute_api_class = cinder.compute.nova.API {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] config_dir = [] {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] config_source = [] {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] control_exchange = openstack {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] debug = True {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] default_availability_zone = None {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] default_group_type = None {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] default_volume_type = lvmdriver-1 {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] driver_client_cert = None {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] driver_client_cert_key = None {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] driver_data_namespace = None {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] driver_ssl_cert_path = None {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] driver_ssl_cert_verify = False {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] driver_use_ssl = False {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] enable_force_upload = False {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] enable_new_services = True {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] enable_unsupported_driver = False {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] enabled_backends = ['lvmdriver-1'] {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] enforce_multipath_for_image_xfer = False {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] filter_function = None {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] glance_api_insecure = False {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] glance_api_servers = ['http://10.27.203.238/image'] {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] glance_api_ssl_compression = False {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] glance_ca_certificates_file = None {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] glance_catalog_info = image:glance:publicURL {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] glance_certfile = None {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] glance_keyfile = None {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] glance_num_retries = 3 {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] glance_request_timeout = None {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] goodness_function = None {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] graceful_shutdown_timeout = 5 {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] group_api_class = cinder.group.api.API {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] host = l75lg1-v1 {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] iet_conf = /etc/iet/ietd.conf {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] image_compress_on_upload = True {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 etcd[50438]: start time = 2024-05-28 12:44:50.137229825 +0000 UTC m=+534.668977261, time spent = 328.715µs, remote = 10.27.203.238:56390, response type = /etcdserverpb.Lease/LeaseGrant, request count = -1, request size = -1, response count = -1, response size = -1, request content = May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] image_conversion_address_space_limit = 1 {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] image_conversion_cpu_limit = 60 {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] image_conversion_disable = False {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] image_upload_use_cinder_backend = False {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] image_upload_use_internal_tenant = False {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] image_volume_cache_enabled = False {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] image_volume_cache_max_count = 0 {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] image_volume_cache_max_size_gb = 0 {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] init_host_max_objects_retrieval = 0 {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] instance_format = [instance: %(uuid)s] {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] iscsi_iotype = fileio {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] iscsi_target_flags = {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] iscsi_write_cache = on {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85846]: INFO cinder.volume.manager [None req-88e367a6-06a3-43b8-9392-1c0aab82ac3e None None] Starting volume driver LVMVolumeDriver (3.0.0) May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] iser_helper = tgtadm {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] iser_ip_address = 10.27.203.238 {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] iser_port = 3260 {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-88e367a6-06a3-43b8-9392-1c0aab82ac3e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:390}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] log_config_append = None {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] log_dir = None {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] log_file = None {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] log_options = True {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] log_rotate_interval = 1 {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] log_rotate_interval_type = days {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] log_rotation_type = none {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] max_age = 0 {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] max_logfile_count = 30 {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] max_logfile_size_mb = 200 {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] max_over_subscription_ratio = 20.0 {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] message_reap_interval = 86400 {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] message_ttl = 2592000 {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] migration_create_volume_timeout_secs = 300 {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] monkey_patch = False {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] monkey_patch_modules = [] {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] my_ip = 10.27.203.238 {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] no_snapshot_gb_quota = False {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] num_iser_scan_tries = 3 {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] num_shell_tries = 3 {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] num_volume_device_scan_tries = 3 {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] nvmeof_conn_info_version = 1 {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] nvmet_ns_id = 10 {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] nvmet_port_id = 1 {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] osapi_max_limit = 1000 {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] osapi_volume_ext_list = [] {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] osapi_volume_listen = 0.0.0.0 {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] osapi_volume_listen_port = 8776 {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] osapi_volume_use_ssl = False {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] osapi_volume_workers = 2 {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] per_volume_size_limit = -1 {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] periodic_fuzzy_delay = 60 {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] periodic_interval = 60 {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] project_id_regex = [0-9a-f\-]+ {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-88e367a6-06a3-43b8-9392-1c0aab82ac3e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.015s {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:428}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] public_endpoint = None {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] publish_errors = False {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] quota_backup_gigabytes = 1000 {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] quota_backups = 10 {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] quota_gigabytes = 1000 {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-88e367a6-06a3-43b8-9392-1c0aab82ac3e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:390}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] quota_groups = 10 {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] quota_snapshots = 50 {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] quota_volumes = 50 {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] rate_limit_burst = 0 {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] rate_limit_except_level = CRITICAL {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] rate_limit_interval = 0 {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] reinit_driver_count = 3 {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] replication_device = **** {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] report_discard_supported = False {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] report_interval = 120 {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] reservation_clean_interval = 86400 {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] reservation_expire = 86400 {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] reserved_image_namespaces = [] {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] reserved_percentage = 0 {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] rpc_response_timeout = 120 {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] run_external_periodic_tasks = True {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] scst_target_driver = iscsi {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] scst_target_iqn_name = None {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] service_down_time = 720 {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] snapshot_name_template = snapshot-%s {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] snapshot_same_host = True {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] split_loggers = False {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] state_path = /opt/stack/data/cinder {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] storage_availability_zone = nova {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] storage_protocol = iSCSI {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] syslog_log_facility = LOG_USER {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] target_helper = lioadm {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] target_ip_address = 10.27.203.238 {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] target_port = 3260 {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] target_protocol = iscsi {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] target_secondary_ip_addresses = [] {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] trace_flags = None {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] transfer_api_class = cinder.transfer.api.API {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] transport_url = **** {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] until_refresh = 0 {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] use_chap_auth = False {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] use_default_quota_class = True {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] use_eventlog = False {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] use_journal = False {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] use_json = False {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] use_multipath_for_image_xfer = False {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] use_stderr = False {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] use_syslog = False {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-88e367a6-06a3-43b8-9392-1c0aab82ac3e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.014s {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:428}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] verify_glance_signatures = enabled {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-88e367a6-06a3-43b8-9392-1c0aab82ac3e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:390}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] volume_api_class = cinder.volume.api.API {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] volume_backend_name = None {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] volume_clear = zero {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] volume_clear_ionice = None {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] volume_clear_size = 0 {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] volume_copy_bps_limit = 0 {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] volume_dd_blocksize = 1M {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] volume_name_template = volume-%s {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] volume_service_inithost_offload = False {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] volume_usage_audit_period = month {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] watch_log_file = False {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] zoning_mode = None {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] os_brick.lock_path = /opt/stack/data/cinder {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] oslo_concurrency.disable_process_locking = False {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] oslo_messaging_metrics.metrics_process_name = {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] keystone_authtoken.admin_password = **** {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] keystone_authtoken.admin_tenant_name = admin {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] keystone_authtoken.admin_token = **** {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] keystone_authtoken.admin_user = None {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] keystone_authtoken.auth_admin_prefix = {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] keystone_authtoken.auth_port = 35357 {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] keystone_authtoken.auth_protocol = https {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] keystone_authtoken.auth_section = None {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] keystone_authtoken.auth_type = password {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] keystone_authtoken.auth_uri = None {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] keystone_authtoken.auth_version = None {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] keystone_authtoken.cache = None {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] keystone_authtoken.certfile = None {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] keystone_authtoken.delay_auth_decision = False {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] keystone_authtoken.http_connect_timeout = None {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] keystone_authtoken.identity_uri = None {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] keystone_authtoken.include_service_catalog = True {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] keystone_authtoken.insecure = False {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-88e367a6-06a3-43b8-9392-1c0aab82ac3e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.014s {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:428}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] keystone_authtoken.interface = public {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] keystone_authtoken.keyfile = None {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-88e367a6-06a3-43b8-9392-1c0aab82ac3e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:390}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] keystone_authtoken.memcache_secret_key = **** {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] keystone_authtoken.memcache_security_strategy = None {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] keystone_authtoken.region_name = None {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] keystone_authtoken.service_token_roles_required = False {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] keystone_authtoken.service_type = None {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] keystone_authtoken.token_cache_time = 300 {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] keystone_authtoken.www_authenticate_uri = None {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] cache.backend = dogpile.cache.null {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] cache.backend_argument = **** {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] cache.config_prefix = cache.oslo {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] cache.dead_timeout = 60.0 {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] cache.debug_cache_backend = False {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] cache.enable_retry_client = False {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] cache.enable_socket_keepalive = False {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] cache.enabled = False {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] cache.enforce_fips_mode = False {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] cache.expiration_time = 600 {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] cache.hashclient_retry_attempts = 2 {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] cache.hashclient_retry_delay = 1.0 {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] cache.memcache_dead_retry = 300 {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] cache.memcache_password = **** {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] cache.memcache_pool_maxsize = 10 {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] cache.memcache_pool_unused_timeout = 60 {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] cache.memcache_sasl_enabled = False {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] cache.memcache_servers = ['localhost:11211'] {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] cache.memcache_socket_timeout = 1.0 {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] cache.memcache_username = None {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] cache.proxies = [] {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] cache.redis_password = **** {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] cache.redis_sentinel_service_name = mymaster {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] cache.redis_server = localhost:6379 {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] cache.redis_socket_timeout = 1.0 {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] cache.redis_username = None {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] cache.retry_attempts = 2 {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] cache.retry_delay = 0.0 {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] cache.socket_keepalive_count = 1 {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] cache.socket_keepalive_idle = 1 {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] cache.socket_keepalive_interval = 1 {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] cache.tls_allowed_ciphers = None {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] cache.tls_cafile = None {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] cache.tls_certfile = None {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] cache.tls_enabled = False {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] cache.tls_keyfile = None {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] coordination.backend_url = **** {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] database.backend = sqlalchemy {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] database.connection = **** {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] database.connection_debug = 0 {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] database.connection_parameters = {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 sudo[85895]: vastdata : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] database.connection_recycle_time = 3600 {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] database.connection_trace = False {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] database.db_inc_retry_interval = True {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 sudo[85895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] database.db_max_retries = 20 {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] database.db_max_retry_interval = 10 {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] database.db_retry_interval = 1 {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] database.max_overflow = 50 {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] database.max_pool_size = 5 {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] database.max_retries = 10 {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] database.mysql_sql_mode = TRADITIONAL {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] database.mysql_wsrep_sync_wait = None {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] database.pool_timeout = None {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] database.retry_interval = 10 {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] database.slave_connection = **** {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] database.sqlite_synchronous = True {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] database.use_db_reconnect = False {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] oslo_policy.enforce_new_defaults = False {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] oslo_policy.enforce_scope = False {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] oslo_policy.policy_default_rule = default {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] oslo_policy.policy_file = policy.yaml {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] profiler.connection_string = messaging:// {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] profiler.enabled = False {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] profiler.es_doc_type = notification {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] profiler.es_scroll_size = 10000 {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] profiler.es_scroll_time = 2m {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] profiler.filter_error_trace = False {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] profiler.hmac_keys = **** {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] profiler.sentinel_service_name = mymaster {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] profiler.socket_timeout = 0.1 {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] profiler.trace_requests = False {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] profiler.trace_sqlalchemy = False {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] profiler_jaeger.process_tags = {} {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] profiler_jaeger.service_name_prefix = None {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] profiler_otlp.service_name_prefix = None {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] privsep_osbrick.capabilities = [21] {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] privsep_osbrick.group = None {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] privsep_osbrick.helper_command = None {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] privsep_osbrick.logger_name = os_brick.privileged {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] privsep_osbrick.thread_pool_size = 10 {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] privsep_osbrick.user = None {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] cinder_sys_admin.group = None {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] cinder_sys_admin.helper_command = None {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] cinder_sys_admin.thread_pool_size = 10 {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] cinder_sys_admin.user = None {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] service_user.auth_section = None {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] service_user.auth_type = None {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] service_user.cafile = None {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] service_user.certfile = None {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] service_user.collect_timing = False {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] service_user.insecure = False {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] service_user.keyfile = None {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] service_user.send_service_user_token = False {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] service_user.split_loggers = False {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] service_user.timeout = None {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] backend_defaults.backend_availability_zone = None {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] backend_defaults.chap_password = **** {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] backend_defaults.chap_username = {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] backend_defaults.driver_client_cert = None {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] backend_defaults.driver_client_cert_key = None {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] backend_defaults.driver_data_namespace = None {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] backend_defaults.driver_ssl_cert_path = None {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] backend_defaults.driver_use_ssl = False {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] backend_defaults.enable_unsupported_driver = False {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] backend_defaults.extra_capabilities = {} {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] backend_defaults.filter_function = None {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] backend_defaults.goodness_function = None {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] backend_defaults.iet_conf = /etc/iet/ietd.conf {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] backend_defaults.image_volume_cache_enabled = False {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] backend_defaults.iscsi_iotype = fileio {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] backend_defaults.iscsi_target_flags = {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] backend_defaults.iscsi_write_cache = on {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] backend_defaults.iser_helper = tgtadm {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] backend_defaults.iser_ip_address = 10.27.203.238 {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] backend_defaults.iser_port = 3260 {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] backend_defaults.lvm_mirrors = 0 {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] backend_defaults.lvm_share_target = False {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] backend_defaults.lvm_type = auto {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] backend_defaults.num_shell_tries = 3 {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] backend_defaults.nvmet_ns_id = 10 {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] backend_defaults.nvmet_port_id = 1 {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] backend_defaults.replication_device = **** {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] backend_defaults.report_discard_supported = False {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] backend_defaults.reserved_percentage = 0 {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] backend_defaults.scst_target_driver = iscsi {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] backend_defaults.scst_target_iqn_name = None {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] backend_defaults.storage_protocol = iSCSI {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] backend_defaults.target_helper = tgtadm {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] backend_defaults.target_ip_address = 10.27.203.238 {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] backend_defaults.target_port = 3260 {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] backend_defaults.target_protocol = iscsi {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 dstat.sh[49771]: 28-05 12:44:50| 28 5 65 1 0|4290M 5167M 267M 5972M| 17k 11k| 0 960k| 0 109 |6293 9110 |2.19 1.90 1.32|4.0 0 141| 0 0 | 0 2048M| 26 244 0 27 0 May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] backend_defaults.trace_flags = None {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] backend_defaults.unique_fqdn_network = True {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] backend_defaults.use_chap_auth = False {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] backend_defaults.volume_backend_name = None {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] backend_defaults.volume_clear = zero {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] backend_defaults.volume_clear_ionice = None {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] backend_defaults.volume_clear_size = 0 {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] backend_defaults.volume_group = cinder-volumes {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] oslo_reports.file_event_handler = None {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] oslo_reports.file_event_handler_interval = 1 {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] oslo_reports.log_dir = None {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] lvmdriver-1.backend_availability_zone = None {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] lvmdriver-1.backend_host = None {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] lvmdriver-1.chap_password = **** {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] lvmdriver-1.chap_username = None {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] lvmdriver-1.chiscsi_conf = None {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] lvmdriver-1.driver_client_cert = None {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] lvmdriver-1.driver_client_cert_key = None {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] lvmdriver-1.driver_data_namespace = None {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] lvmdriver-1.driver_use_ssl = None {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] lvmdriver-1.extra_capabilities = None {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] lvmdriver-1.filter_function = None {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] lvmdriver-1.goodness_function = None {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] lvmdriver-1.iet_conf = None {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] lvmdriver-1.iscsi_iotype = None {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] lvmdriver-1.iscsi_target_flags = None {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] lvmdriver-1.iscsi_write_cache = None {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] lvmdriver-1.iser_helper = None {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] lvmdriver-1.iser_ip_address = None {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] lvmdriver-1.iser_port = None {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] lvmdriver-1.iser_target_prefix = None {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] lvmdriver-1.lvm_conf_file = None {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] lvmdriver-1.lvm_mirrors = None {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] lvmdriver-1.lvm_share_target = None {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] lvmdriver-1.lvm_type = auto {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] lvmdriver-1.num_shell_tries = None {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] lvmdriver-1.nvmet_ns_id = None {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] lvmdriver-1.nvmet_port_id = None {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] lvmdriver-1.replication_device = **** {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] lvmdriver-1.report_discard_supported = None {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] lvmdriver-1.reserved_percentage = None {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] lvmdriver-1.scst_target_driver = None {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] lvmdriver-1.storage_protocol = None {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] lvmdriver-1.target_helper = lioadm {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] lvmdriver-1.target_ip_address = None {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] lvmdriver-1.target_port = 3260 {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] lvmdriver-1.target_protocol = iscsi {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] lvmdriver-1.trace_flags = None {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] lvmdriver-1.unique_fqdn_network = None {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] lvmdriver-1.use_chap_auth = None {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] lvmdriver-1.volume_clear = zero {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] lvmdriver-1.volume_clear_ionice = None {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] lvmdriver-1.volume_clear_size = None {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] lvmdriver-1.volumes_dir = None {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] oslo_messaging_rabbit.hostname = l75lg1-v1 {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] oslo_messaging_rabbit.ssl = False {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] oslo_messaging_rabbit.ssl_version = {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] oslo_messaging_notifications.driver = [] {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] oslo_messaging_notifications.retry = -1 {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] oslo_messaging_notifications.transport_url = **** {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] key_manager.fixed_key = **** {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] barbican.barbican_api_version = None {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] barbican.barbican_endpoint = None {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] barbican.barbican_endpoint_type = public {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] barbican.barbican_region_name = None {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] barbican.cafile = None {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] barbican.certfile = None {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] barbican.collect_timing = False {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] barbican.insecure = False {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] barbican.keyfile = None {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] barbican.number_of_retries = 60 {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] barbican.retry_delay = 1 {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] barbican.send_service_user_token = False {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] barbican.split_loggers = False {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] barbican.timeout = None {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] barbican.verify_ssl = True {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] barbican.verify_ssl_path = None {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] barbican_service_user.auth_section = None {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] barbican_service_user.auth_type = None {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] barbican_service_user.cafile = None {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] barbican_service_user.certfile = None {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] barbican_service_user.collect_timing = False {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] barbican_service_user.insecure = False {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] barbican_service_user.keyfile = None {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] barbican_service_user.split_loggers = False {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] barbican_service_user.timeout = None {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] vault.approle_role_id = None {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] vault.approle_secret_id = None {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] vault.cafile = None {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] vault.certfile = None {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] vault.collect_timing = False {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] vault.insecure = False {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] vault.keyfile = None {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] vault.kv_mountpoint = secret {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] vault.kv_path = None {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] vault.kv_version = 2 {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] vault.namespace = None {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] vault.root_token_id = None {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] vault.split_loggers = False {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] vault.ssl_ca_crt_file = None {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] vault.timeout = None {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] vault.use_ssl = False {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:50 l75lg1-v1 cinder-volume[85683]: DEBUG oslo_service.service [None req-c69b1951-641a-4530-9e53-6b503ec7d50e None None] ******************************************************************************** {{(pid=85683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2624}} May 28 12:44:50 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [None req-d5e2622c-e52e-4f3d-871c-2ddda502f287 None None] Expecting reply to msg 7e0ad967092c4db5831d2b5804ba564a in queue reply_37f4cbd1dd094961a22b8a65f222c327 May 28 12:44:50 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [-] Received RPC response for msg 7e0ad967092c4db5831d2b5804ba564a May 28 12:44:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16239331-7470-4e40-bb5c-4890f3938d1f None None] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:44:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16239331-7470-4e40-bb5c-4890f3938d1f None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:44:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16239331-7470-4e40-bb5c-4890f3938d1f None None] PATH_INFO: `/` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:44:50 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 473/959] 10.27.203.238 () {58 vars in 1014 bytes} [Tue May 28 12:44:50 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:44:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf21104-51e8-43c5-80d9-9345f3715d2e None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:44:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf21104-51e8-43c5-80d9-9345f3715d2e None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:44:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf21104-51e8-43c5-80d9-9345f3715d2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:44:50 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-5bf21104-51e8-43c5-80d9-9345f3715d2e None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:44:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-5bf21104-51e8-43c5-80d9-9345f3715d2e None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:44:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-5bf21104-51e8-43c5-80d9-9345f3715d2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:44:50 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 487/960] 10.27.203.238 () {62 vars in 1111 bytes} [Tue May 28 12:44:50 2024] POST /identity/v3/auth/tokens => generated 3991 bytes in 23 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:44:50 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi [None req-4a1faf18-8f64-40df-befb-634336ed6ac2 admin admin] Calling method '>' {{(pid=73999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} May 28 12:44:50 l75lg1-v1 devstack@n-api.service[73999]: INFO nova.api.openstack.requestlog [None req-4a1faf18-8f64-40df-befb-634336ed6ac2 admin admin] 10.27.203.238 "GET /compute/v2.1" status: 200 len: 390 microversion: 2.1 time: 0.001224 May 28 12:44:50 l75lg1-v1 sudo[85895]: pam_unix(sudo:session): session closed for user root May 28 12:44:50 l75lg1-v1 devstack@n-api.service[73999]: [pid: 73999|app: 0|req: 9/19] 10.27.203.238 () {58 vars in 1013 bytes} [Tue May 28 12:44:50 2024] GET /compute/v2.1 => generated 390 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 12:44:50 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-88e367a6-06a3-43b8-9392-1c0aab82ac3e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.541s {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:428}} May 28 12:44:50 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-88e367a6-06a3-43b8-9392-1c0aab82ac3e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:390}} May 28 12:44:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16239331-7470-4e40-bb5c-4890f3938d1f None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:44:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16239331-7470-4e40-bb5c-4890f3938d1f None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:44:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23a1942-0abc-4b1d-a351-294692df9d21 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'befdd4414dc2432ab2baa1ae3fbffef7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'manager', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:44:50 l75lg1-v1 sudo[86131]: vastdata : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool May 28 12:44:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23a1942-0abc-4b1d-a351-294692df9d21 service nova] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:44:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23a1942-0abc-4b1d-a351-294692df9d21 service nova] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:44:50 l75lg1-v1 sudo[86131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) May 28 12:44:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23a1942-0abc-4b1d-a351-294692df9d21 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:44:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23a1942-0abc-4b1d-a351-294692df9d21 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:44:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23a1942-0abc-4b1d-a351-294692df9d21 service nova] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:44:50 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 474/961] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 12:44:50 2024] GET /identity/v3/auth/tokens => generated 3991 bytes in 22 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 12:44:50 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi [None req-5793bd17-585b-4ac2-81ab-b96f2ae4e5ac admin admin] Calling method '>' {{(pid=74000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} May 28 12:44:50 l75lg1-v1 devstack@n-api.service[74000]: INFO nova.api.openstack.requestlog [None req-5793bd17-585b-4ac2-81ab-b96f2ae4e5ac admin admin] 10.27.203.238 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2126 microversion: 2.61 time: 0.048393 May 28 12:44:50 l75lg1-v1 devstack@n-api.service[74000]: [pid: 74000|app: 0|req: 11/20] 10.27.203.238 () {64 vars in 1374 bytes} [Tue May 28 12:44:50 2024] GET /compute/v2.1/flavors/detail?is_public=True => generated 2126 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 12:44:50 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [None req-d5e2622c-e52e-4f3d-871c-2ddda502f287 None None] Expecting reply to msg 8842c91b51b74b5280250787cb3b7c6b in queue reply_37f4cbd1dd094961a22b8a65f222c327 May 28 12:44:50 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [-] Received RPC response for msg 8842c91b51b74b5280250787cb3b7c6b May 28 12:44:51 l75lg1-v1 dstat.sh[49771]: 28-05 12:44:51| 22 10 67 0 0|4299M 5157M 267M 5973M| 18k 16k| 512k 716k|4.00 40.0 |7620 11k|2.19 1.90 1.32|9.0 0 401| 0 0 | 0 2048M| 26 244 0 26 0 May 28 12:44:51 l75lg1-v1 sudo[86131]: pam_unix(sudo:session): session closed for user root May 28 12:44:51 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-88e367a6-06a3-43b8-9392-1c0aab82ac3e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.552s {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:428}} May 28 12:44:51 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-88e367a6-06a3-43b8-9392-1c0aab82ac3e None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:479}} May 28 12:44:51 l75lg1-v1 cinder-volume[85846]: INFO cinder.brick.local_dev.lvm [None req-88e367a6-06a3-43b8-9392-1c0aab82ac3e None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool May 28 12:44:51 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-88e367a6-06a3-43b8-9392-1c0aab82ac3e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:390}} May 28 12:44:51 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-88e367a6-06a3-43b8-9392-1c0aab82ac3e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.012s {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:428}} May 28 12:44:51 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-88e367a6-06a3-43b8-9392-1c0aab82ac3e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:390}} May 28 12:44:51 l75lg1-v1 sudo[86326]: vastdata : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 May 28 12:44:51 l75lg1-v1 sudo[86326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) May 28 12:44:51 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.resource_tracker [None req-d5e2622c-e52e-4f3d-871c-2ddda502f287 None None] Total usable vcpus: 10, total allocated vcpus: 0 {{(pid=83654) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}} May 28 12:44:51 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.resource_tracker [None req-d5e2622c-e52e-4f3d-871c-2ddda502f287 None None] Final resource view: name=l75lg1-v1 phys_ram=16000MB used_ram=512MB phys_disk=28GB used_disk=0GB total_vcpus=10 used_vcpus=0 pci_stats=[] {{(pid=83654) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}} May 28 12:44:51 l75lg1-v1 devstack@placement-api.service[78201]: DEBUG placement.requestlog [req-7d865916-c487-4d4f-a3ad-b259f6e46f33 req-dc086eb8-d39a-440a-bff5-32b40592d169 None None] Starting request: 10.27.203.238 "GET /placement/resource_providers?in_tree=ef90d7d1-0808-4a15-ad77-f9a7391af2f4" {{(pid=78201) __call__ /opt/stack/placement/placement/requestlog.py:55}} May 28 12:44:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139e8d3a-5e79-4094-92d7-3f3b899f5644 None None] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:44:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139e8d3a-5e79-4094-92d7-3f3b899f5644 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:44:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139e8d3a-5e79-4094-92d7-3f3b899f5644 None None] PATH_INFO: `/` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:44:51 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 488/962] 10.27.203.238 () {58 vars in 1050 bytes} [Tue May 28 12:44:51 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:44:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccde3919-3514-4245-bf34-ddf17823e4be None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:44:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccde3919-3514-4245-bf34-ddf17823e4be None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:44:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccde3919-3514-4245-bf34-ddf17823e4be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:44:51 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-ccde3919-3514-4245-bf34-ddf17823e4be None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:44:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-ccde3919-3514-4245-bf34-ddf17823e4be None None] MFA Rules not processed for user `c3fe870f285d4169bd917382dd02d7b0`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:44:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-ccde3919-3514-4245-bf34-ddf17823e4be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:44:51 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 475/963] 10.27.203.238 () {62 vars in 1147 bytes} [Tue May 28 12:44:51 2024] POST /identity/v3/auth/tokens => generated 4060 bytes in 24 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:44:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139e8d3a-5e79-4094-92d7-3f3b899f5644 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:44:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139e8d3a-5e79-4094-92d7-3f3b899f5644 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:44:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67016cef-dee0-42f1-8518-19d5c89cd19e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3fe870f285d4169bd917382dd02d7b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'manager', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:44:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67016cef-dee0-42f1-8518-19d5c89cd19e service placement] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:44:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67016cef-dee0-42f1-8518-19d5c89cd19e service placement] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:44:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67016cef-dee0-42f1-8518-19d5c89cd19e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:44:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67016cef-dee0-42f1-8518-19d5c89cd19e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:44:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67016cef-dee0-42f1-8518-19d5c89cd19e service placement] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:44:51 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 489/964] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 12:44:51 2024] GET /identity/v3/auth/tokens => generated 4060 bytes in 25 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 12:44:51 l75lg1-v1 devstack@placement-api.service[78201]: INFO placement.requestlog [req-7d865916-c487-4d4f-a3ad-b259f6e46f33 req-dc086eb8-d39a-440a-bff5-32b40592d169 service placement] 10.27.203.238 "GET /placement/resource_providers?in_tree=ef90d7d1-0808-4a15-ad77-f9a7391af2f4" status: 200 len: 26 microversion: 1.14 May 28 12:44:51 l75lg1-v1 devstack@placement-api.service[78201]: [pid: 78201|app: 0|req: 3/6] 10.27.203.238 () {64 vars in 1466 bytes} [Tue May 28 12:44:51 2024] GET /placement/resource_providers?in_tree=ef90d7d1-0808-4a15-ad77-f9a7391af2f4 => generated 26 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 224 bytes (1 switches on core 0) May 28 12:44:51 l75lg1-v1 devstack@placement-api.service[78202]: DEBUG placement.requestlog [req-7d865916-c487-4d4f-a3ad-b259f6e46f33 req-d387e018-1e16-4d84-8cd0-b8c194f1f52f None None] Starting request: 10.27.203.238 "POST /placement/resource_providers" {{(pid=78202) __call__ /opt/stack/placement/placement/requestlog.py:55}} May 28 12:44:51 l75lg1-v1 devstack@placement-api.service[78202]: INFO placement.requestlog [req-7d865916-c487-4d4f-a3ad-b259f6e46f33 req-d387e018-1e16-4d84-8cd0-b8c194f1f52f service placement] 10.27.203.238 "POST /placement/resource_providers" status: 200 len: 832 microversion: 1.20 May 28 12:44:51 l75lg1-v1 devstack@placement-api.service[78202]: [pid: 78202|app: 0|req: 4/7] 10.27.203.238 () {68 vars in 1430 bytes} [Tue May 28 12:44:51 2024] POST /placement/resource_providers => generated 832 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 394 bytes (1 switches on core 0) May 28 12:44:51 l75lg1-v1 nova-compute[83654]: INFO nova.scheduler.client.report [None req-d5e2622c-e52e-4f3d-871c-2ddda502f287 None None] [req-d387e018-1e16-4d84-8cd0-b8c194f1f52f] Created resource provider record via placement API for resource provider with UUID ef90d7d1-0808-4a15-ad77-f9a7391af2f4 and name l75lg1-v1. May 28 12:44:51 l75lg1-v1 devstack@placement-api.service[78201]: DEBUG placement.requestlog [req-7d865916-c487-4d4f-a3ad-b259f6e46f33 req-f84eac54-a396-4fee-a0fd-7c1e9720ad9e None None] Starting request: 10.27.203.238 "GET /placement/resource_providers/ef90d7d1-0808-4a15-ad77-f9a7391af2f4/allocations" {{(pid=78201) __call__ /opt/stack/placement/placement/requestlog.py:55}} May 28 12:44:51 l75lg1-v1 devstack@placement-api.service[78201]: INFO placement.requestlog [req-7d865916-c487-4d4f-a3ad-b259f6e46f33 req-f84eac54-a396-4fee-a0fd-7c1e9720ad9e service placement] 10.27.203.238 "GET /placement/resource_providers/ef90d7d1-0808-4a15-ad77-f9a7391af2f4/allocations" status: 200 len: 54 microversion: 1.0 May 28 12:44:51 l75lg1-v1 devstack@placement-api.service[78201]: [pid: 78201|app: 0|req: 4/8] 10.27.203.238 () {62 vars in 1480 bytes} [Tue May 28 12:44:51 2024] GET /placement/resource_providers/ef90d7d1-0808-4a15-ad77-f9a7391af2f4/allocations => generated 54 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 223 bytes (1 switches on core 0) May 28 12:44:51 l75lg1-v1 nova-compute[83654]: DEBUG nova.virt.libvirt.host [None req-d5e2622c-e52e-4f3d-871c-2ddda502f287 None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=83654) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1856}} May 28 12:44:51 l75lg1-v1 nova-compute[83654]: INFO nova.virt.libvirt.host [None req-d5e2622c-e52e-4f3d-871c-2ddda502f287 None None] kernel doesn't support AMD SEV May 28 12:44:51 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.provider_tree [None req-d5e2622c-e52e-4f3d-871c-2ddda502f287 None None] Updating inventory in ProviderTree for provider ef90d7d1-0808-4a15-ad77-f9a7391af2f4 with inventory: {'MEMORY_MB': {'total': 16000, 'min_unit': 1, 'max_unit': 16000, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 10, 'min_unit': 1, 'max_unit': 10, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 28, 'min_unit': 1, 'max_unit': 28, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=83654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}} May 28 12:44:51 l75lg1-v1 nova-compute[83654]: DEBUG nova.virt.libvirt.driver [None req-d5e2622c-e52e-4f3d-871c-2ddda502f287 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=83654) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5710}} May 28 12:44:51 l75lg1-v1 nova-compute[83654]: DEBUG nova.virt.libvirt.driver [None req-d5e2622c-e52e-4f3d-871c-2ddda502f287 None None] Libvirt baseline CPU May 28 12:44:51 l75lg1-v1 nova-compute[83654]: x86_64 May 28 12:44:51 l75lg1-v1 nova-compute[83654]: Nehalem May 28 12:44:51 l75lg1-v1 nova-compute[83654]: Intel May 28 12:44:51 l75lg1-v1 nova-compute[83654]: May 28 12:44:51 l75lg1-v1 nova-compute[83654]: May 28 12:44:51 l75lg1-v1 nova-compute[83654]: {{(pid=83654) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:13088}} May 28 12:44:51 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [None req-d5e2622c-e52e-4f3d-871c-2ddda502f287 None None] Expecting reply to msg 1ad70fe424174f028d3f2de1309b7f68 in queue reply_37f4cbd1dd094961a22b8a65f222c327 May 28 12:44:51 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [-] Received RPC response for msg 1ad70fe424174f028d3f2de1309b7f68 May 28 12:44:51 l75lg1-v1 sudo[86326]: pam_unix(sudo:session): session closed for user root May 28 12:44:51 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-88e367a6-06a3-43b8-9392-1c0aab82ac3e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.523s {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:428}} May 28 12:44:51 l75lg1-v1 cinder-volume[85846]: DEBUG cinder.brick.local_dev.lvm [None req-88e367a6-06a3-43b8-9392-1c0aab82ac3e None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=85846) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} May 28 12:44:51 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-88e367a6-06a3-43b8-9392-1c0aab82ac3e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:390}} May 28 12:44:51 l75lg1-v1 sudo[86366]: vastdata : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool May 28 12:44:51 l75lg1-v1 sudo[86366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) May 28 12:44:52 l75lg1-v1 devstack@g-api.service[86372]: [uWSGI] getting INI configuration from /etc/glance/glance-uwsgi.ini May 28 12:44:52 l75lg1-v1 devstack@g-api.service[86372]: *** Starting uWSGI 2.0.20-debian (64bit) on [Tue May 28 12:44:52 2024] *** May 28 12:44:52 l75lg1-v1 devstack@g-api.service[86372]: compiled with version: 11.2.0 on 21 March 2022 11:00:44 May 28 12:44:52 l75lg1-v1 devstack@g-api.service[86372]: os: Linux-5.15.0-56-generic #62-Ubuntu SMP Tue Nov 22 19:54:14 UTC 2022 May 28 12:44:52 l75lg1-v1 devstack@g-api.service[86372]: nodename: l75lg1-v1 May 28 12:44:52 l75lg1-v1 devstack@g-api.service[86372]: machine: x86_64 May 28 12:44:52 l75lg1-v1 devstack@g-api.service[86372]: clock source: unix May 28 12:44:52 l75lg1-v1 devstack@g-api.service[86372]: pcre jit disabled May 28 12:44:52 l75lg1-v1 devstack@g-api.service[86372]: detected number of CPU cores: 10 May 28 12:44:52 l75lg1-v1 devstack@g-api.service[86372]: current working directory: / May 28 12:44:52 l75lg1-v1 devstack@g-api.service[86372]: detected binary path: /usr/bin/uwsgi-core May 28 12:44:52 l75lg1-v1 devstack@g-api.service[86372]: your processes number limit is 63557 May 28 12:44:52 l75lg1-v1 devstack@g-api.service[86372]: your memory page size is 4096 bytes May 28 12:44:52 l75lg1-v1 devstack@g-api.service[86372]: detected max file descriptor number: 2048 May 28 12:44:52 l75lg1-v1 devstack@g-api.service[86372]: lock engine: pthread robust mutexes May 28 12:44:52 l75lg1-v1 devstack@g-api.service[86372]: thunder lock: enabled May 28 12:44:52 l75lg1-v1 devstack@g-api.service[86372]: uwsgi socket 0 bound to TCP address 127.0.0.1:60999 fd 4 May 28 12:44:52 l75lg1-v1 devstack@g-api.service[86372]: Python version: 3.10.12 (main, Nov 20 2023, 15:14:05) [GCC 11.4.0] May 28 12:44:52 l75lg1-v1 devstack@g-api.service[86372]: PEP 405 virtualenv detected: /opt/stack/data/venv May 28 12:44:52 l75lg1-v1 devstack@g-api.service[86372]: Set PythonHome to /opt/stack/data/venv May 28 12:44:52 l75lg1-v1 devstack@g-api.service[86372]: Python main interpreter initialized at 0x55d5d3ba2160 May 28 12:44:52 l75lg1-v1 devstack@g-api.service[86372]: python threads support enabled May 28 12:44:52 l75lg1-v1 devstack@g-api.service[86372]: your server socket listen backlog is limited to 100 connections May 28 12:44:52 l75lg1-v1 devstack@g-api.service[86372]: your mercy for graceful operations on workers is 80 seconds May 28 12:44:52 l75lg1-v1 devstack@g-api.service[86372]: mapped 403077 bytes (393 KB) for 2 cores May 28 12:44:52 l75lg1-v1 devstack@g-api.service[86372]: *** Operational MODE: preforking *** May 28 12:44:52 l75lg1-v1 devstack@g-api.service[86372]: *** uWSGI is running in multiple interpreter mode *** May 28 12:44:52 l75lg1-v1 devstack@g-api.service[86372]: spawned uWSGI master process (pid: 86372) May 28 12:44:52 l75lg1-v1 devstack@g-api.service[86372]: spawned uWSGI worker 1 (pid: 86373, cores: 1) May 28 12:44:52 l75lg1-v1 devstack@g-api.service[86372]: spawned uWSGI worker 2 (pid: 86374, cores: 1) May 28 12:44:52 l75lg1-v1 devstack@g-api.service[86372]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 28 12:44:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f015eb89-03e9-4a94-b846-7e87fd2e6aa1 None None] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:44:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f015eb89-03e9-4a94-b846-7e87fd2e6aa1 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:44:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f015eb89-03e9-4a94-b846-7e87fd2e6aa1 None None] PATH_INFO: `/` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:44:52 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 476/965] 10.27.203.238 () {58 vars in 1014 bytes} [Tue May 28 12:44:52 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:44:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0359acd-535e-48d2-93ed-7c964b742fb7 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:44:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0359acd-535e-48d2-93ed-7c964b742fb7 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:44:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0359acd-535e-48d2-93ed-7c964b742fb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:44:52 l75lg1-v1 devstack@placement-api.service[78202]: DEBUG placement.requestlog [req-7d865916-c487-4d4f-a3ad-b259f6e46f33 req-9bf0f544-b9a7-44c4-a864-147249cf2d2e None None] Starting request: 10.27.203.238 "PUT /placement/resource_providers/ef90d7d1-0808-4a15-ad77-f9a7391af2f4/inventories" {{(pid=78202) __call__ /opt/stack/placement/placement/requestlog.py:55}} May 28 12:44:52 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-f0359acd-535e-48d2-93ed-7c964b742fb7 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:44:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-f0359acd-535e-48d2-93ed-7c964b742fb7 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:44:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-f0359acd-535e-48d2-93ed-7c964b742fb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:44:52 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 490/966] 10.27.203.238 () {62 vars in 1111 bytes} [Tue May 28 12:44:52 2024] POST /identity/v3/auth/tokens => generated 3991 bytes in 23 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:44:52 l75lg1-v1 dstat.sh[49771]: 28-05 12:44:52| 30 8 61 1 0|4352M 5104M 267M 5974M| 16k 5786B|1100k 881k|52.0 57.0 |8567 11k|2.26 1.92 1.33|6.0 1.0 121| 0 0 | 0 2048M| 27 249 0 26 0 May 28 12:44:52 l75lg1-v1 devstack@placement-api.service[78202]: INFO placement.requestlog [req-7d865916-c487-4d4f-a3ad-b259f6e46f33 req-9bf0f544-b9a7-44c4-a864-147249cf2d2e service placement] 10.27.203.238 "PUT /placement/resource_providers/ef90d7d1-0808-4a15-ad77-f9a7391af2f4/inventories" status: 200 len: 398 microversion: 1.26 May 28 12:44:52 l75lg1-v1 devstack@placement-api.service[78202]: [pid: 78202|app: 0|req: 5/9] 10.27.203.238 () {68 vars in 1577 bytes} [Tue May 28 12:44:52 2024] PUT /placement/resource_providers/ef90d7d1-0808-4a15-ad77-f9a7391af2f4/inventories => generated 398 bytes in 110 msecs (HTTP/1.1 200) 8 headers in 296 bytes (1 switches on core 0) May 28 12:44:52 l75lg1-v1 nova-compute[83654]: DEBUG nova.scheduler.client.report [None req-d5e2622c-e52e-4f3d-871c-2ddda502f287 None None] Updated inventory for provider ef90d7d1-0808-4a15-ad77-f9a7391af2f4 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16000, 'min_unit': 1, 'max_unit': 16000, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 10, 'min_unit': 1, 'max_unit': 10, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 28, 'min_unit': 1, 'max_unit': 28, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=83654) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}} May 28 12:44:52 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.provider_tree [None req-d5e2622c-e52e-4f3d-871c-2ddda502f287 None None] Updating resource provider ef90d7d1-0808-4a15-ad77-f9a7391af2f4 generation from 0 to 1 during operation: update_inventory {{(pid=83654) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}} May 28 12:44:52 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.provider_tree [None req-d5e2622c-e52e-4f3d-871c-2ddda502f287 None None] Updating inventory in ProviderTree for provider ef90d7d1-0808-4a15-ad77-f9a7391af2f4 with inventory: {'MEMORY_MB': {'total': 16000, 'reserved': 512, 'min_unit': 1, 'max_unit': 16000, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 10, 'reserved': 0, 'min_unit': 1, 'max_unit': 10, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 28, 'reserved': 0, 'min_unit': 1, 'max_unit': 28, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=83654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}} May 28 12:44:52 l75lg1-v1 devstack@placement-api.service[78201]: DEBUG placement.requestlog [req-7d865916-c487-4d4f-a3ad-b259f6e46f33 req-1cd97998-e824-4a2c-8f03-c8a5473fae10 None None] Starting request: 10.27.203.238 "GET /placement/traits?name=in:COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_LAN9118,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE42,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSSE3,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE41,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VIOMMU_MODEL_SMMUV3,COMPUTE_STORAGE_BUS_FDC" {{(pid=78201) __call__ /opt/stack/placement/placement/requestlog.py:55}} May 28 12:44:52 l75lg1-v1 devstack@placement-api.service[78201]: INFO placement.requestlog [req-7d865916-c487-4d4f-a3ad-b259f6e46f33 req-1cd97998-e824-4a2c-8f03-c8a5473fae10 service placement] 10.27.203.238 "GET /placement/traits?name=in:COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_LAN9118,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE42,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSSE3,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE41,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VIOMMU_MODEL_SMMUV3,COMPUTE_STORAGE_BUS_FDC" status: 200 len: 1436 microversion: 1.6 May 28 12:44:52 l75lg1-v1 devstack@placement-api.service[78201]: [pid: 78201|app: 0|req: 5/10] 10.27.203.238 () {64 vars in 3903 bytes} [Tue May 28 12:44:52 2024] GET /placement/traits?name=in:COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_LAN9118,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE42,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSSE3,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE41,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VIOMMU_MODEL_SMMUV3,COMPUTE_STORAGE_BUS_FDC => generated 1436 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 225 bytes (1 switches on core 0) May 28 12:44:52 l75lg1-v1 devstack@placement-api.service[78202]: DEBUG placement.requestlog [req-7d865916-c487-4d4f-a3ad-b259f6e46f33 req-0d737645-62b0-419f-8bcb-2236ff9cce68 None None] Starting request: 10.27.203.238 "PUT /placement/resource_providers/ef90d7d1-0808-4a15-ad77-f9a7391af2f4/traits" {{(pid=78202) __call__ /opt/stack/placement/placement/requestlog.py:55}} May 28 12:44:52 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi [None req-4a1faf18-8f64-40df-befb-634336ed6ac2 admin admin] Calling method '>' {{(pid=73999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} May 28 12:44:52 l75lg1-v1 devstack@n-api.service[73999]: INFO nova.api.openstack.requestlog [None req-4a1faf18-8f64-40df-befb-634336ed6ac2 admin admin] 10.27.203.238 "GET /compute/v2.1" status: 200 len: 390 microversion: 2.1 time: 0.001060 May 28 12:44:52 l75lg1-v1 devstack@n-api.service[73999]: [pid: 73999|app: 0|req: 10/21] 10.27.203.238 () {58 vars in 1013 bytes} [Tue May 28 12:44:52 2024] GET /compute/v2.1 => generated 390 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 12:44:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f015eb89-03e9-4a94-b846-7e87fd2e6aa1 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:44:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f015eb89-03e9-4a94-b846-7e87fd2e6aa1 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:44:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02ebd5a-6750-4407-af3f-18dd632c3b06 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'befdd4414dc2432ab2baa1ae3fbffef7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'manager', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:44:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02ebd5a-6750-4407-af3f-18dd632c3b06 service nova] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:44:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02ebd5a-6750-4407-af3f-18dd632c3b06 service nova] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:44:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02ebd5a-6750-4407-af3f-18dd632c3b06 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:44:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02ebd5a-6750-4407-af3f-18dd632c3b06 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:44:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02ebd5a-6750-4407-af3f-18dd632c3b06 service nova] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:44:52 l75lg1-v1 devstack@placement-api.service[78202]: INFO placement.requestlog [req-7d865916-c487-4d4f-a3ad-b259f6e46f33 req-0d737645-62b0-419f-8bcb-2236ff9cce68 service placement] 10.27.203.238 "PUT /placement/resource_providers/ef90d7d1-0808-4a15-ad77-f9a7391af2f4/traits" status: 200 len: 1471 microversion: 1.6 May 28 12:44:52 l75lg1-v1 devstack@placement-api.service[78202]: [pid: 78202|app: 0|req: 6/11] 10.27.203.238 () {68 vars in 1562 bytes} [Tue May 28 12:44:52 2024] PUT /placement/resource_providers/ef90d7d1-0808-4a15-ad77-f9a7391af2f4/traits => generated 1471 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 225 bytes (1 switches on core 0) May 28 12:44:52 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.provider_tree [None req-d5e2622c-e52e-4f3d-871c-2ddda502f287 None None] Updating resource provider ef90d7d1-0808-4a15-ad77-f9a7391af2f4 generation from 1 to 2 during operation: update_traits {{(pid=83654) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}} May 28 12:44:52 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [None req-d5e2622c-e52e-4f3d-871c-2ddda502f287 None None] Expecting reply to msg 5cf89e816ca142019d03b421d0916325 in queue reply_37f4cbd1dd094961a22b8a65f222c327 May 28 12:44:52 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 477/967] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 12:44:52 2024] GET /identity/v3/auth/tokens => generated 3991 bytes in 29 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 12:44:52 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi [None req-aaee8dd2-2896-4176-bae4-cf07a9d2525e admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "1", "os-flavor-access:is_public": true, "name": "m1.tiny", "ram": 512, "swap": 0, "disk": 1, "rxtx_factor": 1.0}} {{(pid=74000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:518}} May 28 12:44:52 l75lg1-v1 devstack@n-api.service[74000]: INFO nova.api.openstack.requestlog [None req-aaee8dd2-2896-4176-bae4-cf07a9d2525e admin admin] 10.27.203.238 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.059838 May 28 12:44:52 l75lg1-v1 devstack@n-api.service[74000]: [pid: 74000|app: 0|req: 12/22] 10.27.203.238 () {68 vars in 1365 bytes} [Tue May 28 12:44:52 2024] POST /compute/v2.1/flavors => generated 406 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 12:44:52 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [-] Received RPC response for msg 5cf89e816ca142019d03b421d0916325 May 28 12:44:52 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi [None req-42832026-4d78-4531-96be-abebadf97567 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=73999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:518}} May 28 12:44:52 l75lg1-v1 devstack@n-api.service[73999]: INFO nova.api.openstack.requestlog [None req-42832026-4d78-4531-96be-abebadf97567 admin admin] 10.27.203.238 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027970 May 28 12:44:52 l75lg1-v1 devstack@n-api.service[73999]: [pid: 73999|app: 0|req: 11/23] 10.27.203.238 () {68 vars in 1415 bytes} [Tue May 28 12:44:52 2024] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 12:44:52 l75lg1-v1 sudo[86366]: pam_unix(sudo:session): session closed for user root May 28 12:44:52 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-88e367a6-06a3-43b8-9392-1c0aab82ac3e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.865s {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:428}} May 28 12:44:52 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-88e367a6-06a3-43b8-9392-1c0aab82ac3e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:390}} May 28 12:44:52 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-88e367a6-06a3-43b8-9392-1c0aab82ac3e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.013s {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:428}} May 28 12:44:52 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-88e367a6-06a3-43b8-9392-1c0aab82ac3e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:390}} May 28 12:44:52 l75lg1-v1 sudo[86498]: vastdata : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool May 28 12:44:52 l75lg1-v1 sudo[86498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) May 28 12:44:52 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.resource_tracker [None req-d5e2622c-e52e-4f3d-871c-2ddda502f287 None None] Compute_service record updated for l75lg1-v1:l75lg1-v1 {{(pid=83654) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}} May 28 12:44:52 l75lg1-v1 nova-compute[83654]: DEBUG oslo_concurrency.lockutils [None req-d5e2622c-e52e-4f3d-871c-2ddda502f287 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 4.081s {{(pid=83654) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:44:52 l75lg1-v1 nova-compute[83654]: DEBUG nova.service [None req-d5e2622c-e52e-4f3d-871c-2ddda502f287 None None] Creating RPC server for service compute {{(pid=83654) start /opt/stack/nova/nova/service.py:186}} May 28 12:44:52 l75lg1-v1 nova-compute[83654]: INFO oslo.messaging._drivers.impl_rabbit [None req-d5e2622c-e52e-4f3d-871c-2ddda502f287 None None] Creating fanout queue: compute_fanout_5cd81292655c4cf39151a123fd219c85 May 28 12:44:52 l75lg1-v1 nova-compute[83654]: DEBUG nova.service [None req-d5e2622c-e52e-4f3d-871c-2ddda502f287 None None] Join ServiceGroup membership for this service compute {{(pid=83654) start /opt/stack/nova/nova/service.py:203}} May 28 12:44:52 l75lg1-v1 nova-compute[83654]: DEBUG nova.servicegroup.drivers.db [None req-d5e2622c-e52e-4f3d-871c-2ddda502f287 None None] DB_Driver: join new ServiceGroup member l75lg1-v1 to the compute group, service = {{(pid=83654) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}} May 28 12:44:53 l75lg1-v1 sudo[86498]: pam_unix(sudo:session): session closed for user root May 28 12:44:53 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-88e367a6-06a3-43b8-9392-1c0aab82ac3e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.469s {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:428}} May 28 12:44:53 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-88e367a6-06a3-43b8-9392-1c0aab82ac3e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:390}} May 28 12:44:53 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-88e367a6-06a3-43b8-9392-1c0aab82ac3e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.012s {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:428}} May 28 12:44:53 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-88e367a6-06a3-43b8-9392-1c0aab82ac3e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:390}} May 28 12:44:53 l75lg1-v1 sudo[86502]: vastdata : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster May 28 12:44:53 l75lg1-v1 sudo[86502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) May 28 12:44:53 l75lg1-v1 dstat.sh[49771]: 28-05 12:44:53| 36 5 57 2 0|4384M 5068M 268M 5977M| 13k 1277B|3239k 2220k|48.9 189 |5664 7963 |2.26 1.92 1.33|4.0 0 62| 0 0 | 0 2048M| 27 252 0 25 0 May 28 12:44:53 l75lg1-v1 devstack@g-api.service[86374]: INFO glance.async_ [-] Threadpool model set to 'NativeThreadPoolModel' May 28 12:44:53 l75lg1-v1 devstack@g-api.service[86373]: INFO glance.async_ [-] Threadpool model set to 'NativeThreadPoolModel' May 28 12:44:53 l75lg1-v1 devstack@g-api.service[86374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=86374) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:390}} May 28 12:44:53 l75lg1-v1 devstack@g-api.service[86374]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.008s {{(pid=86374) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:428}} May 28 12:44:53 l75lg1-v1 devstack@g-api.service[86373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:390}} May 28 12:44:53 l75lg1-v1 devstack@g-api.service[86373]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.008s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:428}} May 28 12:44:53 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance_store.common.attachment_state_manager [-] Initialising _AttachmentStateManager {{(pid=86374) __init__ /opt/stack/data/venv/lib/python3.10/site-packages/glance_store/common/attachment_state_manager.py:86}} May 28 12:44:53 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance_store.common.attachment_state_manager [-] Initialising _AttachmentStateManager {{(pid=86373) __init__ /opt/stack/data/venv/lib/python3.10/site-packages/glance_store/common/attachment_state_manager.py:86}} May 28 12:44:53 l75lg1-v1 sudo[86502]: pam_unix(sudo:session): session closed for user root May 28 12:44:53 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-88e367a6-06a3-43b8-9392-1c0aab82ac3e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.482s {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:428}} May 28 12:44:53 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-88e367a6-06a3-43b8-9392-1c0aab82ac3e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:390}} May 28 12:44:53 l75lg1-v1 sudo[86507]: vastdata : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 May 28 12:44:53 l75lg1-v1 sudo[86507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) May 28 12:44:53 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance_store.backend [-] Attempting to import store cinder {{(pid=86374) _load_store /opt/stack/data/venv/lib/python3.10/site-packages/glance_store/backend.py:216}} May 28 12:44:53 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance_store.backend [-] Attempting to import store file {{(pid=86374) _load_store /opt/stack/data/venv/lib/python3.10/site-packages/glance_store/backend.py:216}} May 28 12:44:53 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance_store.backend [-] Attempting to import store glance.store.cinder.Store {{(pid=86374) _load_store /opt/stack/data/venv/lib/python3.10/site-packages/glance_store/backend.py:216}} May 28 12:44:53 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance_store.backend [-] Attempting to import store glance.store.filesystem.Store {{(pid=86374) _load_store /opt/stack/data/venv/lib/python3.10/site-packages/glance_store/backend.py:216}} May 28 12:44:53 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance_store.backend [-] Attempting to import store glance.store.http.Store {{(pid=86374) _load_store /opt/stack/data/venv/lib/python3.10/site-packages/glance_store/backend.py:216}} May 28 12:44:53 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance_store.backend [-] Attempting to import store glance.store.rbd.Store {{(pid=86374) _load_store /opt/stack/data/venv/lib/python3.10/site-packages/glance_store/backend.py:216}} May 28 12:44:53 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance_store.backend [-] Attempting to import store glance.store.s3.Store {{(pid=86374) _load_store /opt/stack/data/venv/lib/python3.10/site-packages/glance_store/backend.py:216}} May 28 12:44:53 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance_store.backend [-] Attempting to import store glance.store.swift.Store {{(pid=86374) _load_store /opt/stack/data/venv/lib/python3.10/site-packages/glance_store/backend.py:216}} May 28 12:44:53 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance_store.backend [-] Attempting to import store glance.store.vmware_datastore.Store {{(pid=86374) _load_store /opt/stack/data/venv/lib/python3.10/site-packages/glance_store/backend.py:216}} May 28 12:44:53 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance_store.backend [-] Attempting to import store http {{(pid=86374) _load_store /opt/stack/data/venv/lib/python3.10/site-packages/glance_store/backend.py:216}} May 28 12:44:53 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance_store.backend [-] Attempting to import store no_conf {{(pid=86374) _load_store /opt/stack/data/venv/lib/python3.10/site-packages/glance_store/backend.py:216}} May 28 12:44:53 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance_store.backend [-] Attempting to import store rbd {{(pid=86374) _load_store /opt/stack/data/venv/lib/python3.10/site-packages/glance_store/backend.py:216}} May 28 12:44:53 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance_store.backend [-] Attempting to import store s3 {{(pid=86374) _load_store /opt/stack/data/venv/lib/python3.10/site-packages/glance_store/backend.py:216}} May 28 12:44:53 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance_store.backend [-] Attempting to import store swift {{(pid=86374) _load_store /opt/stack/data/venv/lib/python3.10/site-packages/glance_store/backend.py:216}} May 28 12:44:53 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance_store.backend [-] Attempting to import store vmware {{(pid=86374) _load_store /opt/stack/data/venv/lib/python3.10/site-packages/glance_store/backend.py:216}} May 28 12:44:53 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance_store.backend [-] Registering options for group glance_store {{(pid=86374) register_opts /opt/stack/data/venv/lib/python3.10/site-packages/glance_store/backend.py:145}} May 28 12:44:53 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance_store.backend [-] Registering options for group glance_store {{(pid=86374) register_opts /opt/stack/data/venv/lib/python3.10/site-packages/glance_store/backend.py:145}} May 28 12:44:53 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance_store.backend [-] Attempting to import store http {{(pid=86374) _load_store /opt/stack/data/venv/lib/python3.10/site-packages/glance_store/backend.py:216}} May 28 12:44:53 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance_store.capabilities [-] Store glance_store._drivers.http.Store doesn't support updating dynamic storage capabilities. Please overwrite 'update_capabilities' method of the store to implement updating logics if needed. {{(pid=86374) update_capabilities /opt/stack/data/venv/lib/python3.10/site-packages/glance_store/capabilities.py:91}} May 28 12:44:53 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance_store.backend [-] Registering store http with schemes ('http', 'https') {{(pid=86374) create_stores /opt/stack/data/venv/lib/python3.10/site-packages/glance_store/backend.py:262}} May 28 12:44:53 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance_store.driver [-] Late loading location class glance_store._drivers.http.StoreLocation {{(pid=86374) get_store_location_class /opt/stack/data/venv/lib/python3.10/site-packages/glance_store/driver.py:133}} May 28 12:44:53 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance_store.location [-] Registering scheme http with {'store': , 'location_class': , 'store_entry': 'http'} {{(pid=86374) register_scheme_map /opt/stack/data/venv/lib/python3.10/site-packages/glance_store/location.py:146}} May 28 12:44:53 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance_store.location [-] Registering scheme https with {'store': , 'location_class': , 'store_entry': 'http'} {{(pid=86374) register_scheme_map /opt/stack/data/venv/lib/python3.10/site-packages/glance_store/location.py:146}} May 28 12:44:53 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance_store.backend [-] Attempting to import store file {{(pid=86374) _load_store /opt/stack/data/venv/lib/python3.10/site-packages/glance_store/backend.py:216}} May 28 12:44:53 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance_store.capabilities [-] Store glance_store._drivers.filesystem.Store doesn't support updating dynamic storage capabilities. Please overwrite 'update_capabilities' method of the store to implement updating logics if needed. {{(pid=86374) update_capabilities /opt/stack/data/venv/lib/python3.10/site-packages/glance_store/capabilities.py:91}} May 28 12:44:53 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance_store.backend [-] Registering store file with schemes ('file', 'filesystem') {{(pid=86374) create_stores /opt/stack/data/venv/lib/python3.10/site-packages/glance_store/backend.py:262}} May 28 12:44:53 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance_store.driver [-] Late loading location class glance_store._drivers.filesystem.StoreLocation {{(pid=86374) get_store_location_class /opt/stack/data/venv/lib/python3.10/site-packages/glance_store/driver.py:133}} May 28 12:44:53 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance_store.location [-] Registering scheme file with {'store': , 'location_class': , 'store_entry': 'file'} {{(pid=86374) register_scheme_map /opt/stack/data/venv/lib/python3.10/site-packages/glance_store/location.py:146}} May 28 12:44:53 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance_store.location [-] Registering scheme filesystem with {'store': , 'location_class': , 'store_entry': 'file'} {{(pid=86374) register_scheme_map /opt/stack/data/venv/lib/python3.10/site-packages/glance_store/location.py:146}} May 28 12:44:53 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.sqlite_migration [-] SQLite caching database not located, skipping migration {{(pid=86374) get_db_path /opt/stack/glance/glance/sqlite_migration.py:68}} May 28 12:44:53 l75lg1-v1 devstack@g-api.service[86374]: WARNING glance.common.wsgi_app [-] Import methods are enabled but staging directory /tmp/staging/ does not exist; Imports will fail! May 28 12:44:53 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance_store.backend [-] Attempting to import store cinder {{(pid=86373) _load_store /opt/stack/data/venv/lib/python3.10/site-packages/glance_store/backend.py:216}} May 28 12:44:53 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance_store.backend [-] Attempting to import store file {{(pid=86373) _load_store /opt/stack/data/venv/lib/python3.10/site-packages/glance_store/backend.py:216}} May 28 12:44:53 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance_store.backend [-] Attempting to import store glance.store.cinder.Store {{(pid=86373) _load_store /opt/stack/data/venv/lib/python3.10/site-packages/glance_store/backend.py:216}} May 28 12:44:53 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance_store.backend [-] Attempting to import store glance.store.filesystem.Store {{(pid=86373) _load_store /opt/stack/data/venv/lib/python3.10/site-packages/glance_store/backend.py:216}} May 28 12:44:53 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance_store.backend [-] Attempting to import store glance.store.http.Store {{(pid=86373) _load_store /opt/stack/data/venv/lib/python3.10/site-packages/glance_store/backend.py:216}} May 28 12:44:53 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance_store.backend [-] Attempting to import store glance.store.rbd.Store {{(pid=86373) _load_store /opt/stack/data/venv/lib/python3.10/site-packages/glance_store/backend.py:216}} May 28 12:44:53 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance_store.backend [-] Attempting to import store glance.store.s3.Store {{(pid=86373) _load_store /opt/stack/data/venv/lib/python3.10/site-packages/glance_store/backend.py:216}} May 28 12:44:53 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance_store.backend [-] Attempting to import store glance.store.swift.Store {{(pid=86373) _load_store /opt/stack/data/venv/lib/python3.10/site-packages/glance_store/backend.py:216}} May 28 12:44:53 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance_store.backend [-] Attempting to import store glance.store.vmware_datastore.Store {{(pid=86373) _load_store /opt/stack/data/venv/lib/python3.10/site-packages/glance_store/backend.py:216}} May 28 12:44:53 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance_store.backend [-] Attempting to import store http {{(pid=86373) _load_store /opt/stack/data/venv/lib/python3.10/site-packages/glance_store/backend.py:216}} May 28 12:44:53 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance_store.backend [-] Attempting to import store no_conf {{(pid=86373) _load_store /opt/stack/data/venv/lib/python3.10/site-packages/glance_store/backend.py:216}} May 28 12:44:53 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance_store.backend [-] Attempting to import store rbd {{(pid=86373) _load_store /opt/stack/data/venv/lib/python3.10/site-packages/glance_store/backend.py:216}} May 28 12:44:53 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance_store.backend [-] Attempting to import store s3 {{(pid=86373) _load_store /opt/stack/data/venv/lib/python3.10/site-packages/glance_store/backend.py:216}} May 28 12:44:53 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance_store.backend [-] Attempting to import store swift {{(pid=86373) _load_store /opt/stack/data/venv/lib/python3.10/site-packages/glance_store/backend.py:216}} May 28 12:44:53 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance_store.backend [-] Attempting to import store vmware {{(pid=86373) _load_store /opt/stack/data/venv/lib/python3.10/site-packages/glance_store/backend.py:216}} May 28 12:44:53 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance_store.backend [-] Registering options for group glance_store {{(pid=86373) register_opts /opt/stack/data/venv/lib/python3.10/site-packages/glance_store/backend.py:145}} May 28 12:44:53 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance_store.backend [-] Registering options for group glance_store {{(pid=86373) register_opts /opt/stack/data/venv/lib/python3.10/site-packages/glance_store/backend.py:145}} May 28 12:44:53 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance_store.backend [-] Attempting to import store http {{(pid=86373) _load_store /opt/stack/data/venv/lib/python3.10/site-packages/glance_store/backend.py:216}} May 28 12:44:53 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance_store.capabilities [-] Store glance_store._drivers.http.Store doesn't support updating dynamic storage capabilities. Please overwrite 'update_capabilities' method of the store to implement updating logics if needed. {{(pid=86373) update_capabilities /opt/stack/data/venv/lib/python3.10/site-packages/glance_store/capabilities.py:91}} May 28 12:44:53 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance_store.backend [-] Registering store http with schemes ('http', 'https') {{(pid=86373) create_stores /opt/stack/data/venv/lib/python3.10/site-packages/glance_store/backend.py:262}} May 28 12:44:53 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance_store.driver [-] Late loading location class glance_store._drivers.http.StoreLocation {{(pid=86373) get_store_location_class /opt/stack/data/venv/lib/python3.10/site-packages/glance_store/driver.py:133}} May 28 12:44:53 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance_store.location [-] Registering scheme http with {'store': , 'location_class': , 'store_entry': 'http'} {{(pid=86373) register_scheme_map /opt/stack/data/venv/lib/python3.10/site-packages/glance_store/location.py:146}} May 28 12:44:53 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance_store.location [-] Registering scheme https with {'store': , 'location_class': , 'store_entry': 'http'} {{(pid=86373) register_scheme_map /opt/stack/data/venv/lib/python3.10/site-packages/glance_store/location.py:146}} May 28 12:44:53 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance_store.backend [-] Attempting to import store file {{(pid=86373) _load_store /opt/stack/data/venv/lib/python3.10/site-packages/glance_store/backend.py:216}} May 28 12:44:53 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance_store.capabilities [-] Store glance_store._drivers.filesystem.Store doesn't support updating dynamic storage capabilities. Please overwrite 'update_capabilities' method of the store to implement updating logics if needed. {{(pid=86373) update_capabilities /opt/stack/data/venv/lib/python3.10/site-packages/glance_store/capabilities.py:91}} May 28 12:44:53 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance_store.backend [-] Registering store file with schemes ('file', 'filesystem') {{(pid=86373) create_stores /opt/stack/data/venv/lib/python3.10/site-packages/glance_store/backend.py:262}} May 28 12:44:53 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance_store.driver [-] Late loading location class glance_store._drivers.filesystem.StoreLocation {{(pid=86373) get_store_location_class /opt/stack/data/venv/lib/python3.10/site-packages/glance_store/driver.py:133}} May 28 12:44:53 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance_store.location [-] Registering scheme file with {'store': , 'location_class': , 'store_entry': 'file'} {{(pid=86373) register_scheme_map /opt/stack/data/venv/lib/python3.10/site-packages/glance_store/location.py:146}} May 28 12:44:53 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance_store.location [-] Registering scheme filesystem with {'store': , 'location_class': , 'store_entry': 'file'} {{(pid=86373) register_scheme_map /opt/stack/data/venv/lib/python3.10/site-packages/glance_store/location.py:146}} May 28 12:44:53 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.sqlite_migration [-] SQLite caching database not located, skipping migration {{(pid=86373) get_db_path /opt/stack/glance/glance/sqlite_migration.py:68}} May 28 12:44:53 l75lg1-v1 devstack@g-api.service[86373]: WARNING glance.common.wsgi_app [-] Import methods are enabled but staging directory /tmp/staging/ does not exist; Imports will fail! May 28 12:44:53 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9dee3a-dc65-4b22-bcba-b06ce01389f3 None None] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:44:53 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9dee3a-dc65-4b22-bcba-b06ce01389f3 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:44:53 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9dee3a-dc65-4b22-bcba-b06ce01389f3 None None] PATH_INFO: `/` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:44:53 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 491/968] 10.27.203.238 () {58 vars in 1014 bytes} [Tue May 28 12:44:53 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:44:53 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9157bc09-7787-4893-9fe4-7f2cfa15fb4a None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:44:53 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9157bc09-7787-4893-9fe4-7f2cfa15fb4a None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:44:53 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9157bc09-7787-4893-9fe4-7f2cfa15fb4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:44:53 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-9157bc09-7787-4893-9fe4-7f2cfa15fb4a None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:44:53 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-9157bc09-7787-4893-9fe4-7f2cfa15fb4a None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:44:53 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-9157bc09-7787-4893-9fe4-7f2cfa15fb4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:44:53 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 478/969] 10.27.203.238 () {62 vars in 1111 bytes} [Tue May 28 12:44:53 2024] POST /identity/v3/auth/tokens => generated 3991 bytes in 23 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:44:54 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi [None req-aaee8dd2-2896-4176-bae4-cf07a9d2525e admin admin] Calling method '>' {{(pid=74000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} May 28 12:44:54 l75lg1-v1 devstack@n-api.service[74000]: INFO nova.api.openstack.requestlog [None req-aaee8dd2-2896-4176-bae4-cf07a9d2525e admin admin] 10.27.203.238 "GET /compute/v2.1" status: 200 len: 390 microversion: 2.1 time: 0.001095 May 28 12:44:54 l75lg1-v1 devstack@n-api.service[74000]: [pid: 74000|app: 0|req: 13/24] 10.27.203.238 () {58 vars in 1013 bytes} [Tue May 28 12:44:54 2024] GET /compute/v2.1 => generated 390 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 12:44:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9dee3a-dc65-4b22-bcba-b06ce01389f3 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:44:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9dee3a-dc65-4b22-bcba-b06ce01389f3 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:44:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63653e49-0f71-41d2-80be-fd5f8a00ef69 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'befdd4414dc2432ab2baa1ae3fbffef7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'manager', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:44:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63653e49-0f71-41d2-80be-fd5f8a00ef69 service nova] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:44:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63653e49-0f71-41d2-80be-fd5f8a00ef69 service nova] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:44:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63653e49-0f71-41d2-80be-fd5f8a00ef69 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:44:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63653e49-0f71-41d2-80be-fd5f8a00ef69 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:44:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63653e49-0f71-41d2-80be-fd5f8a00ef69 service nova] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:44:54 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 492/970] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 12:44:54 2024] GET /identity/v3/auth/tokens => generated 3991 bytes in 22 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 12:44:54 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi [None req-f97dcef2-5671-46d4-b90b-8169629e1c6f admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "ram": 2048, "disk": 20, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "m1.small", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "2"}} {{(pid=73999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:518}} May 28 12:44:54 l75lg1-v1 devstack@n-api.service[73999]: INFO nova.api.openstack.requestlog [None req-f97dcef2-5671-46d4-b90b-8169629e1c6f admin admin] 10.27.203.238 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.61 time: 0.046835 May 28 12:44:54 l75lg1-v1 devstack@n-api.service[73999]: [pid: 73999|app: 0|req: 12/25] 10.27.203.238 () {68 vars in 1365 bytes} [Tue May 28 12:44:54 2024] POST /compute/v2.1/flavors => generated 409 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 12:44:54 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi [None req-0c344f8c-5418-49b8-b448-7b7a0b619f8d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=74000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:518}} May 28 12:44:54 l75lg1-v1 dstat.sh[49771]: 28-05 12:44:54| 36 4 60 0 0|4514M 4938M 268M 5977M| 21k 0 | 770k 742k|6.02 47.1 |3095 3316 |2.26 1.92 1.33|6.0 1.0 6.0| 0 0 | 0 2048M| 27 253 0 25 0 May 28 12:44:54 l75lg1-v1 sudo[86507]: pam_unix(sudo:session): session closed for user root May 28 12:44:54 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-88e367a6-06a3-43b8-9392-1c0aab82ac3e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.572s {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:428}} May 28 12:44:54 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-88e367a6-06a3-43b8-9392-1c0aab82ac3e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:390}} May 28 12:44:54 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] Loading glance-api-keystone+cachemanagement from /etc/glance/glance-api-paste.ini {{(pid=86374) load_paste_app /opt/stack/glance/glance/common/config.py:700}} May 28 12:44:54 l75lg1-v1 sudo[86510]: vastdata : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 May 28 12:44:54 l75lg1-v1 sudo[86510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) May 28 12:44:54 l75lg1-v1 devstack@n-api.service[74000]: INFO nova.api.openstack.requestlog [None req-0c344f8c-5418-49b8-b448-7b7a0b619f8d admin admin] 10.27.203.238 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030321 May 28 12:44:54 l75lg1-v1 devstack@n-api.service[74000]: [pid: 74000|app: 0|req: 14/26] 10.27.203.238 () {68 vars in 1415 bytes} [Tue May 28 12:44:54 2024] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 12:44:54 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] Loading glance-api-keystone+cachemanagement from /etc/glance/glance-api-paste.ini {{(pid=86373) load_paste_app /opt/stack/glance/glance/common/config.py:700}} May 28 12:44:54 l75lg1-v1 sudo[86510]: pam_unix(sudo:session): session closed for user root May 28 12:44:54 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-88e367a6-06a3-43b8-9392-1c0aab82ac3e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.477s {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:428}} May 28 12:44:54 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-88e367a6-06a3-43b8-9392-1c0aab82ac3e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:390}} May 28 12:44:54 l75lg1-v1 sudo[86518]: vastdata : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 May 28 12:44:54 l75lg1-v1 sudo[86518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) May 28 12:44:54 l75lg1-v1 devstack@g-api.service[86373]: INFO glance.image_cache [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] Image cache loaded driver 'centralized_db'. May 28 12:44:54 l75lg1-v1 devstack@g-api.service[86374]: INFO glance.image_cache [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] Image cache loaded driver 'centralized_db'. May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: INFO dbcounter [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] Registered counter for database glance May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: INFO dbcounter [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] Registered counter for database glance May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG oslo_db.sqlalchemy.engines [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86373) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:342}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG oslo_db.sqlalchemy.engines [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86374) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:342}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG dbcounter [-] [86373] Writer thread running {{(pid=86373) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG dbcounter [-] [86374] Writer thread running {{(pid=86374) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.image_cache.drivers.centralized_db [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] Node reference is already recorded, ignoring it {{(pid=86374) configure /opt/stack/glance/glance/image_cache/drivers/centralized_db.py:71}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: INFO glance.image_cache [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] Image cache loaded driver 'centralized_db'. May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: INFO glance.image_cache [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] Image cache loaded driver 'centralized_db'. May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.image_cache.drivers.centralized_db [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] Node reference is already recorded, ignoring it {{(pid=86373) configure /opt/stack/glance/glance/image_cache/drivers/centralized_db.py:71}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.image_cache.drivers.centralized_db [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] Node reference is already recorded, ignoring it {{(pid=86374) configure /opt/stack/glance/glance/image_cache/drivers/centralized_db.py:71}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.api.v2.cached_images [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] Started cache worker thread {{(pid=86373) __init__ /opt/stack/glance/glance/api/v2/cached_images.py:69}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: INFO glance.image_cache [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] Image cache loaded driver 'centralized_db'. May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.api.v2.cached_images [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] Started cache worker thread {{(pid=86374) __init__ /opt/stack/glance/glance/api/v2/cached_images.py:69}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: INFO glance.image_cache [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] Image cache loaded driver 'centralized_db'. May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.image_cache.drivers.centralized_db [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] Node reference is already recorded, ignoring it {{(pid=86374) configure /opt/stack/glance/glance/image_cache/drivers/centralized_db.py:71}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.image_cache.drivers.centralized_db [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] Node reference is already recorded, ignoring it {{(pid=86373) configure /opt/stack/glance/glance/image_cache/drivers/centralized_db.py:71}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: INFO glance.api.middleware.cache_manage [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] Initialized image cache management middleware May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: INFO glance.api.middleware.cache_manage [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] Initialized image cache management middleware May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: INFO glance.image_cache [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] Image cache loaded driver 'centralized_db'. May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: INFO glance.image_cache [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] Image cache loaded driver 'centralized_db'. May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.image_cache.drivers.centralized_db [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] Node reference is already recorded, ignoring it {{(pid=86374) configure /opt/stack/glance/glance/image_cache/drivers/centralized_db.py:71}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.image_cache.drivers.centralized_db [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] Node reference is already recorded, ignoring it {{(pid=86373) configure /opt/stack/glance/glance/image_cache/drivers/centralized_db.py:71}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: INFO glance.api.middleware.cache [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] Initialized image cache middleware May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: INFO glance.api.middleware.cache [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] Initialized image cache middleware May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: WARNING keystonemiddleware.auth_token [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: WARNING keystonemiddleware.auth_token [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: WARNING keystonemiddleware.auth_token [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: WARNING keystonemiddleware.auth_token [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] ******************************************************************************** {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2600}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] Configuration options gathered from: {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2601}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] ******************************************************************************** {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2600}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] command line args: [] {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] Configuration options gathered from: {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2601}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] config files: ['/etc/glance/glance-image-import.conf', '/etc/glance/glance-api.conf'] {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2603}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] ================================================================================ {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2605}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] command line args: [] {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] allow_anonymous_access = False {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] config files: ['/etc/glance/glance-image-import.conf', '/etc/glance/glance-api.conf'] {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2603}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] api_limit_max = 1000 {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] ================================================================================ {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2605}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] backlog = 4096 {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] allow_anonymous_access = False {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] bind_host = 0.0.0.0 {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] api_limit_max = 1000 {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] bind_port = None {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] backlog = 4096 {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] client_socket_timeout = 900 {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] bind_host = 0.0.0.0 {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] config_dir = [] {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] bind_port = None {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] config_file = ['/etc/glance/glance-image-import.conf', '/etc/glance/glance-api.conf'] {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] config_source = [] {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] client_socket_timeout = 900 {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] control_exchange = glance {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] config_dir = [] {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] debug = True {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] config_file = ['/etc/glance/glance-image-import.conf', '/etc/glance/glance-api.conf'] {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] config_source = [] {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] control_exchange = glance {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] default_publisher_id = image.localhost {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] debug = True {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] delayed_delete = False {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] digest_algorithm = sha256 {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] disabled_notifications = [] {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] default_publisher_id = image.localhost {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] enabled_backends = None {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] delayed_delete = False {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] enabled_import_methods = ['glance-direct', 'web-download', 'copy-image'] {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] digest_algorithm = sha256 {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] hashing_algorithm = sha512 {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] disabled_notifications = [] {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] http_keepalive = True {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] enabled_backends = None {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] image_cache_dir = /opt/stack/data/glance/cache/ {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] enabled_import_methods = ['glance-direct', 'web-download', 'copy-image'] {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] image_cache_driver = centralized_db {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] hashing_algorithm = sha512 {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] image_cache_max_size = 10737418240 {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] http_keepalive = True {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:55 l75lg1-v1 sudo[86518]: pam_unix(sudo:session): session closed for user root May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] image_cache_sqlite_db = cache.db {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] image_cache_dir = /opt/stack/data/glance/cache/ {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] image_cache_stall_time = 86400 {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] image_cache_driver = centralized_db {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] image_location_quota = 10 {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] image_cache_max_size = 10737418240 {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] image_member_quota = 128 {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] image_cache_sqlite_db = cache.db {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] image_property_quota = 128 {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] image_cache_stall_time = 86400 {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] image_size_cap = 1099511627776 {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] image_location_quota = 10 {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] image_tag_quota = 128 {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] image_member_quota = 128 {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] instance_format = [instance: %(uuid)s] {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] image_property_quota = 128 {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] limit_param_default = 25 {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] image_size_cap = 1099511627776 {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] image_tag_quota = 128 {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] location_strategy = location_order {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] instance_format = [instance: %(uuid)s] {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] log_config_append = None {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:55 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-88e367a6-06a3-43b8-9392-1c0aab82ac3e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.478s {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:428}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] limit_param_default = 25 {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] log_dir = None {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] log_file = None {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] location_strategy = location_order {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] log_rotate_interval = 1 {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] log_config_append = None {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] log_rotate_interval_type = days {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] log_dir = None {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] log_rotation_type = none {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] log_file = None {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:55 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-88e367a6-06a3-43b8-9392-1c0aab82ac3e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:390}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] log_rotate_interval = 1 {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] log_rotate_interval_type = days {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] log_rotation_type = none {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] max_header_line = 16384 {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] max_logfile_count = 30 {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] max_logfile_size_mb = 200 {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] max_request_id_length = 64 {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] max_header_line = 16384 {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] metadata_encryption_key = **** {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] max_logfile_count = 30 {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] node_staging_uri = file:///tmp/staging/ {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] max_logfile_size_mb = 200 {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] property_protection_file = None {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] max_request_id_length = 64 {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] property_protection_rule_format = roles {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] metadata_encryption_key = **** {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] public_endpoint = http://10.27.203.238/image {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] node_staging_uri = file:///tmp/staging/ {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] publish_errors = False {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] property_protection_file = None {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] pydev_worker_debug_host = None {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] property_protection_rule_format = roles {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] pydev_worker_debug_port = 5678 {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] public_endpoint = http://10.27.203.238/image {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] rate_limit_burst = 0 {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] publish_errors = False {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] rate_limit_except_level = CRITICAL {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] pydev_worker_debug_host = None {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] rate_limit_interval = 0 {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] pydev_worker_debug_port = 5678 {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] scrub_pool_size = 1 {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] rate_limit_burst = 0 {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] scrub_time = 0 {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] rate_limit_except_level = CRITICAL {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] show_image_direct_url = False {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] rate_limit_interval = 0 {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] scrub_pool_size = 1 {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: WARNING oslo_config.cfg [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] Deprecated: Option "show_multiple_locations" from group "DEFAULT" is deprecated for removal (Use of this option, deprecated since Newton, is a security risk and will be removed once we figure out a way to satisfy those use cases that currently require it. An earlier announcement that the same functionality can be achieved with greater granularity by using policies is incorrect. You cannot work around this option via policy configuration at the present time, though that is the direction we believe the fix will take. Please keep an eye on the Glance release notes to stay up to date on progress in addressing this issue.). Its value may be silently ignored in the future. May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] scrub_time = 0 {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] show_image_direct_url = False {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] show_multiple_locations = False {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] syslog_log_facility = LOG_USER {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: WARNING oslo_config.cfg [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] Deprecated: Option "show_multiple_locations" from group "DEFAULT" is deprecated for removal (Use of this option, deprecated since Newton, is a security risk and will be removed once we figure out a way to satisfy those use cases that currently require it. An earlier announcement that the same functionality can be achieved with greater granularity by using policies is incorrect. You cannot work around this option via policy configuration at the present time, though that is the direction we believe the fix will take. Please keep an eye on the Glance release notes to stay up to date on progress in addressing this issue.). Its value may be silently ignored in the future. May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] tcp_keepidle = 600 {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] show_multiple_locations = False {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] transport_url = **** {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] syslog_log_facility = LOG_USER {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] use_eventlog = False {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] tcp_keepidle = 600 {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] use_journal = False {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] transport_url = **** {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] use_json = False {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] use_eventlog = False {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] use_keystone_limits = True {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] use_journal = False {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] use_stderr = False {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] use_json = False {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] use_syslog = False {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] use_keystone_limits = True {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] user_storage_quota = 0 {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] use_stderr = False {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] watch_log_file = False {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] use_syslog = False {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] worker_self_reference_url = http://127.0.0.1:60999 {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] user_storage_quota = 0 {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] workers = None {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] watch_log_file = False {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] oslo_concurrency.disable_process_locking = False {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] worker_self_reference_url = http://127.0.0.1:60999 {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] oslo_concurrency.lock_path = /opt/stack/data/glance/locks {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] workers = None {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] oslo_middleware.enable_proxy_headers_parsing = False {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] oslo_concurrency.disable_process_locking = False {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] oslo_concurrency.lock_path = /opt/stack/data/glance/locks {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] paste_deploy.config_file = None {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] oslo_middleware.enable_proxy_headers_parsing = False {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] paste_deploy.flavor = keystone+cachemanagement {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] image_format.container_formats = ['ami', 'ari', 'aki', 'bare', 'ovf', 'ova', 'docker', 'compressed'] {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] paste_deploy.config_file = None {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] paste_deploy.flavor = keystone+cachemanagement {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] image_format.disk_formats = ['ami', 'ari', 'aki', 'vhd', 'vhdx', 'vmdk', 'raw', 'qcow2', 'vdi', 'iso', 'ploop'] {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] image_format.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] image_format.container_formats = ['ami', 'ari', 'aki', 'bare', 'ovf', 'ova', 'docker', 'compressed'] {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] task.task_executor = taskflow {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] image_format.disk_formats = ['ami', 'ari', 'aki', 'vhd', 'vhdx', 'vmdk', 'raw', 'qcow2', 'vdi', 'iso', 'ploop'] {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] task.task_time_to_live = 48 {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] image_format.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] task.work_dir = None {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] task.task_executor = taskflow {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] wsgi.python_interpreter = None {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] task.task_time_to_live = 48 {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] wsgi.task_pool_threads = 16 {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] task.work_dir = None {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] oslo_policy.enforce_new_defaults = True {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] wsgi.python_interpreter = None {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] oslo_policy.enforce_scope = True {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] wsgi.task_pool_threads = 16 {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] oslo_policy.policy_default_rule = default {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] oslo_policy.enforce_new_defaults = True {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] oslo_policy.enforce_scope = True {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] oslo_policy.policy_file = policy.yaml {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] oslo_policy.policy_default_rule = default {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] oslo_policy.policy_file = policy.yaml {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] store_type_location_strategy.store_type_preference = [] {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] profiler.connection_string = messaging:// {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] profiler.enabled = False {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] store_type_location_strategy.store_type_preference = [] {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] profiler.es_doc_type = notification {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] profiler.connection_string = messaging:// {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] profiler.es_scroll_size = 10000 {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] profiler.enabled = False {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] profiler.es_scroll_time = 2m {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] profiler.es_doc_type = notification {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] profiler.filter_error_trace = False {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] profiler.es_scroll_size = 10000 {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] profiler.hmac_keys = **** {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] profiler.es_scroll_time = 2m {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] profiler.filter_error_trace = False {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] profiler.sentinel_service_name = mymaster {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] profiler.hmac_keys = **** {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] profiler.socket_timeout = 0.1 {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] profiler.sentinel_service_name = mymaster {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] profiler.trace_requests = False {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] profiler.socket_timeout = 0.1 {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] profiler.trace_sqlalchemy = False {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] profiler.trace_requests = False {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] profiler_jaeger.process_tags = {} {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] profiler.trace_sqlalchemy = False {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] profiler_jaeger.service_name_prefix = None {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] profiler_jaeger.process_tags = {} {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] profiler_otlp.service_name_prefix = None {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 sudo[86526]: vastdata : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] profiler_jaeger.service_name_prefix = None {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] import_filtering_opts.allowed_hosts = [] {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] profiler_otlp.service_name_prefix = None {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 sudo[86526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] import_filtering_opts.allowed_ports = [80, 443] {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] import_filtering_opts.allowed_hosts = [] {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] import_filtering_opts.allowed_schemes = ['http', 'https'] {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] import_filtering_opts.allowed_ports = [80, 443] {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] import_filtering_opts.disallowed_hosts = [] {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] import_filtering_opts.allowed_schemes = ['http', 'https'] {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] import_filtering_opts.disallowed_ports = [] {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] import_filtering_opts.disallowed_hosts = [] {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] import_filtering_opts.disallowed_schemes = [] {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] import_filtering_opts.disallowed_ports = [] {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] import_filtering_opts.disallowed_schemes = [] {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] os_brick.lock_path = None {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] privsep_osbrick.capabilities = [21] {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] os_brick.lock_path = None {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] privsep_osbrick.group = None {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] privsep_osbrick.capabilities = [21] {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] privsep_osbrick.helper_command = None {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] privsep_osbrick.group = None {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] privsep_osbrick.helper_command = None {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] privsep_osbrick.logger_name = os_brick.privileged {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] privsep_osbrick.logger_name = os_brick.privileged {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] privsep_osbrick.thread_pool_size = 10 {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] privsep_osbrick.thread_pool_size = 10 {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] privsep_osbrick.user = None {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] glance_store.cinder_api_insecure = False {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] privsep_osbrick.user = None {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] glance_store.cinder_ca_certificates_file = None {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] glance_store.cinder_catalog_info = volumev3::publicURL {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] glance_store.cinder_api_insecure = False {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] glance_store.cinder_do_extend_attached = False {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] glance_store.cinder_endpoint_template = None {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] glance_store.cinder_ca_certificates_file = None {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] glance_store.cinder_enforce_multipath = False {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] glance_store.cinder_catalog_info = volumev3::publicURL {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] glance_store.cinder_http_retries = 3 {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] glance_store.cinder_mount_point_base = /var/lib/glance/mnt {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] glance_store.cinder_do_extend_attached = False {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] glance_store.cinder_os_region_name = None {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] glance_store.cinder_state_transition_timeout = 300 {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] glance_store.cinder_endpoint_template = None {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] glance_store.cinder_store_auth_address = None {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] glance_store.cinder_store_password = **** {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] glance_store.cinder_enforce_multipath = False {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] glance_store.cinder_store_project_domain_name = Default {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] glance_store.cinder_store_project_name = None {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] glance_store.cinder_http_retries = 3 {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] glance_store.cinder_store_user_domain_name = Default {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] glance_store.cinder_store_user_name = None {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] glance_store.cinder_mount_point_base = /var/lib/glance/mnt {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] glance_store.cinder_use_multipath = False {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] glance_store.cinder_volume_type = None {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] glance_store.cinder_os_region_name = None {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] glance_store.default_store = file {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] glance_store.default_swift_reference = ref1 {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] glance_store.cinder_state_transition_timeout = 300 {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] glance_store.filesystem_store_chunk_size = 65536 {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] glance_store.cinder_store_auth_address = None {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] glance_store.filesystem_store_datadir = /opt/stack/data/glance/images/ {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] glance_store.filesystem_store_datadirs = None {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] glance_store.cinder_store_password = **** {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] glance_store.filesystem_store_file_perm = 0 {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] glance_store.filesystem_store_metadata_file = None {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] glance_store.cinder_store_project_domain_name = Default {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] glance_store.filesystem_thin_provisioning = False {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] glance_store.http_proxy_information = {} {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] glance_store.cinder_store_project_name = None {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] glance_store.https_ca_certificates_file = None {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] glance_store.https_insecure = True {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] glance_store.cinder_store_user_domain_name = Default {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] glance_store.rados_connect_timeout = -1 {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] glance_store.rbd_store_ceph_conf = {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] glance_store.cinder_store_user_name = None {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] glance_store.rbd_store_chunk_size = 8 {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] glance_store.rbd_store_pool = images {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] glance_store.cinder_use_multipath = False {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] glance_store.rbd_store_user = None {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] glance_store.rbd_thin_provisioning = False {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] glance_store.cinder_volume_type = None {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] glance_store.rootwrap_config = /etc/glance/rootwrap.conf {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] glance_store.s3_store_access_key = **** {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] glance_store.default_store = file {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] glance_store.s3_store_bucket = None {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] glance_store.s3_store_bucket_url_format = auto {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] glance_store.s3_store_create_bucket_on_put = False {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] glance_store.default_swift_reference = ref1 {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] glance_store.s3_store_host = None {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] glance_store.s3_store_large_object_chunk_size = 10 {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] glance_store.filesystem_store_chunk_size = 65536 {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] glance_store.s3_store_large_object_size = 100 {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] glance_store.s3_store_region_name = {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] glance_store.filesystem_store_datadir = /opt/stack/data/glance/images/ {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] glance_store.s3_store_secret_key = **** {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] glance_store.s3_store_thread_pools = 10 {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] glance_store.filesystem_store_datadirs = None {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] glance_store.stores = ['file', 'http'] {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] glance_store.swift_buffer_on_upload = False {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] glance_store.filesystem_store_file_perm = 0 {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] glance_store.swift_store_admin_tenants = [] {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] glance_store.swift_store_auth_address = None {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] glance_store.filesystem_store_metadata_file = None {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] glance_store.swift_store_auth_insecure = False {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] glance_store.swift_store_auth_version = 2 {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] glance_store.filesystem_thin_provisioning = False {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] glance_store.swift_store_cacert = None {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] glance_store.swift_store_config_file = None {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] glance_store.http_proxy_information = {} {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] glance_store.swift_store_container = glance {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] glance_store.swift_store_create_container_on_put = False {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] glance_store.https_ca_certificates_file = None {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] glance_store.swift_store_endpoint = None {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] glance_store.swift_store_endpoint_type = publicURL {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] glance_store.https_insecure = True {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] glance_store.swift_store_expire_soon_interval = 60 {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] glance_store.swift_store_key = **** {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] glance_store.rados_connect_timeout = -1 {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] glance_store.swift_store_large_object_chunk_size = 200 {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] glance_store.swift_store_large_object_size = 5120 {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] glance_store.rbd_store_ceph_conf = {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] glance_store.swift_store_multi_tenant = False {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] glance_store.swift_store_multiple_containers_seed = 0 {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] glance_store.rbd_store_chunk_size = 8 {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] glance_store.swift_store_region = None {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] glance_store.swift_store_retry_get_count = 0 {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] glance_store.rbd_store_pool = images {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] glance_store.swift_store_service_type = object-store {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] glance_store.swift_store_ssl_compression = True {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] glance_store.rbd_store_user = None {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] glance_store.swift_store_use_trusts = True {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] glance_store.swift_store_user = **** {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] glance_store.rbd_thin_provisioning = False {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] glance_store.swift_upload_buffer_dir = None {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] glance_store.vmware_api_retry_count = 10 {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] glance_store.rootwrap_config = /etc/glance/rootwrap.conf {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] glance_store.vmware_ca_file = None {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] glance_store.vmware_datastores = None {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] glance_store.s3_store_access_key = **** {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] glance_store.vmware_insecure = False {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] glance_store.vmware_server_host = None {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] glance_store.s3_store_bucket = None {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] glance_store.vmware_server_password = **** {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] glance_store.vmware_server_username = None {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] glance_store.vmware_store_image_dir = /openstack_glance {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] glance_store.s3_store_bucket_url_format = auto {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] glance_store.vmware_task_poll_interval = 5 {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] glance_store.s3_store_create_bucket_on_put = False {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] keystone_authtoken.admin_password = **** {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] keystone_authtoken.admin_tenant_name = admin {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] glance_store.s3_store_host = None {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] keystone_authtoken.admin_token = **** {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] keystone_authtoken.admin_user = None {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] glance_store.s3_store_large_object_chunk_size = 10 {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] keystone_authtoken.auth_admin_prefix = {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] glance_store.s3_store_large_object_size = 100 {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] keystone_authtoken.auth_port = 35357 {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] keystone_authtoken.auth_protocol = https {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] glance_store.s3_store_region_name = {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] keystone_authtoken.auth_section = None {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] keystone_authtoken.auth_type = password {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] glance_store.s3_store_secret_key = **** {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] keystone_authtoken.auth_uri = None {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] keystone_authtoken.auth_url = http://10.27.203.238/identity {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] glance_store.s3_store_thread_pools = 10 {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] keystone_authtoken.auth_version = None {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] keystone_authtoken.cache = None {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] glance_store.stores = ['file', 'http'] {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] keystone_authtoken.certfile = None {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] glance_store.swift_buffer_on_upload = False {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] keystone_authtoken.default_domain_id = None {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] keystone_authtoken.default_domain_name = None {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] glance_store.swift_store_admin_tenants = [] {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] keystone_authtoken.delay_auth_decision = False {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] keystone_authtoken.domain_id = None {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] glance_store.swift_store_auth_address = None {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] keystone_authtoken.domain_name = None {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] keystone_authtoken.http_connect_timeout = None {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] glance_store.swift_store_auth_insecure = False {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] keystone_authtoken.identity_uri = None {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] glance_store.swift_store_auth_version = 2 {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] keystone_authtoken.include_service_catalog = True {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] keystone_authtoken.insecure = False {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] glance_store.swift_store_cacert = None {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] keystone_authtoken.interface = public {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] keystone_authtoken.keyfile = None {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] glance_store.swift_store_config_file = None {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] glance_store.swift_store_container = glance {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] glance_store.swift_store_create_container_on_put = False {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] glance_store.swift_store_endpoint = None {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] glance_store.swift_store_endpoint_type = publicURL {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] keystone_authtoken.password = **** {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] glance_store.swift_store_expire_soon_interval = 60 {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] keystone_authtoken.project_domain_id = None {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] glance_store.swift_store_key = **** {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] keystone_authtoken.project_domain_name = Default {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] keystone_authtoken.project_id = None {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] glance_store.swift_store_large_object_chunk_size = 200 {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] keystone_authtoken.project_name = service {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] keystone_authtoken.region_name = None {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 dstat.sh[49771]: 28-05 12:44:55| 36 3 58 2 0|4511M 4940M 268M 5978M| 19k 0 | 512k 2952k|4.00 213 |3945 5931 |2.26 1.92 1.33|6.0 0 18| 0 0 | 0 2048M| 27 256 0 24 0 May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] glance_store.swift_store_large_object_size = 5120 {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] keystone_authtoken.service_token_roles_required = False {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] keystone_authtoken.service_type = None {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] glance_store.swift_store_multi_tenant = False {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] keystone_authtoken.system_scope = None {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] keystone_authtoken.timeout = None {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] glance_store.swift_store_multiple_containers_seed = 0 {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] keystone_authtoken.token_cache_time = 300 {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] keystone_authtoken.trust_id = None {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] glance_store.swift_store_region = None {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] keystone_authtoken.user_domain_id = None {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] keystone_authtoken.user_domain_name = Default {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] glance_store.swift_store_retry_get_count = 0 {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] keystone_authtoken.user_id = None {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] keystone_authtoken.username = glance {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] glance_store.swift_store_service_type = object-store {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] keystone_authtoken.www_authenticate_uri = None {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] cache.backend = dogpile.cache.null {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] glance_store.swift_store_ssl_compression = True {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] cache.backend_argument = **** {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] cache.config_prefix = cache.oslo {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] glance_store.swift_store_use_trusts = True {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] cache.dead_timeout = 60.0 {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] cache.debug_cache_backend = False {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] glance_store.swift_store_user = **** {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] cache.enable_retry_client = False {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] cache.enable_socket_keepalive = False {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] glance_store.swift_upload_buffer_dir = None {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] cache.enabled = False {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] cache.enforce_fips_mode = False {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] glance_store.vmware_api_retry_count = 10 {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] cache.expiration_time = 600 {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] cache.hashclient_retry_attempts = 2 {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] glance_store.vmware_ca_file = None {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] cache.hashclient_retry_delay = 1.0 {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] cache.memcache_dead_retry = 300 {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] glance_store.vmware_datastores = None {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] cache.memcache_password = **** {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] glance_store.vmware_insecure = False {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] cache.memcache_pool_maxsize = 10 {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] glance_store.vmware_server_host = None {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] cache.memcache_sasl_enabled = False {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] glance_store.vmware_server_password = **** {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] cache.memcache_socket_timeout = 1.0 {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] glance_store.vmware_server_username = None {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] cache.memcache_username = None {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] cache.proxies = [] {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] glance_store.vmware_store_image_dir = /openstack_glance {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] cache.redis_password = **** {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] cache.redis_sentinel_service_name = mymaster {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] glance_store.vmware_task_poll_interval = 5 {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] cache.redis_server = localhost:6379 {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] keystone_authtoken.admin_password = **** {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] cache.redis_socket_timeout = 1.0 {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] cache.redis_username = None {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] cache.retry_attempts = 2 {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] cache.retry_delay = 0.0 {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] keystone_authtoken.admin_token = **** {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] cache.socket_keepalive_count = 1 {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] cache.socket_keepalive_idle = 1 {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] keystone_authtoken.admin_user = None {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] cache.socket_keepalive_interval = 1 {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] cache.tls_allowed_ciphers = None {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] cache.tls_cafile = None {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] keystone_authtoken.auth_admin_prefix = {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] cache.tls_certfile = None {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] cache.tls_enabled = False {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] cache.tls_keyfile = None {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] oslo_limit.auth_section = None {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] keystone_authtoken.auth_port = 35357 {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] oslo_limit.auth_type = password {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] oslo_limit.auth_url = http://10.27.203.238/identity {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] keystone_authtoken.auth_protocol = https {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] oslo_limit.cafile = None {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] oslo_limit.certfile = None {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] keystone_authtoken.auth_section = None {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] oslo_limit.collect_timing = False {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] oslo_limit.connect_retries = None {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] keystone_authtoken.auth_type = password {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] oslo_limit.connect_retry_delay = None {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] oslo_limit.default_domain_id = None {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] keystone_authtoken.auth_uri = None {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] oslo_limit.default_domain_name = None {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] oslo_limit.domain_id = None {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] keystone_authtoken.auth_url = http://10.27.203.238/identity {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] oslo_limit.domain_name = None {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] oslo_limit.endpoint_id = 13c57d94d28f4be896335eeb1e8b02ca {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] keystone_authtoken.auth_version = None {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] oslo_limit.endpoint_override = None {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] oslo_limit.insecure = False {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] keystone_authtoken.cache = None {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] oslo_limit.keyfile = None {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] oslo_limit.max_version = None {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] oslo_limit.min_version = None {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] oslo_limit.password = **** {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] keystone_authtoken.certfile = None {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] oslo_limit.project_domain_id = None {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] oslo_limit.project_domain_name = None {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] keystone_authtoken.default_domain_id = None {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] oslo_limit.project_id = None {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] oslo_limit.project_name = None {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] keystone_authtoken.default_domain_name = None {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] oslo_limit.region_name = None {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] oslo_limit.retriable_status_codes = None {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] oslo_limit.service_name = None {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] oslo_limit.service_type = None {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] oslo_limit.split_loggers = False {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] keystone_authtoken.domain_id = None {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] oslo_limit.status_code_retries = None {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] oslo_limit.status_code_retry_delay = None {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] keystone_authtoken.domain_name = None {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] oslo_limit.system_scope = all {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] oslo_limit.timeout = None {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] oslo_limit.trust_id = None {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] oslo_limit.user_domain_id = None {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] oslo_limit.user_domain_name = Default {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] oslo_limit.user_id = None {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] oslo_limit.username = glance {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] oslo_limit.valid_interfaces = None {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] keystone_authtoken.identity_uri = None {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] oslo_limit.version = None {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] keystone_authtoken.include_service_catalog = True {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] oslo_messaging_notifications.retry = -1 {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] keystone_authtoken.insecure = False {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] oslo_messaging_notifications.transport_url = **** {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] keystone_authtoken.interface = public {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] keystone_authtoken.keyfile = None {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] oslo_messaging_rabbit.hostname = l75lg1-v1 {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] oslo_messaging_rabbit.processname = uwsgi {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] keystone_authtoken.password = **** {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] keystone_authtoken.project_domain_id = None {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] keystone_authtoken.project_domain_name = Default {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] oslo_messaging_rabbit.ssl = False {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] keystone_authtoken.project_id = None {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] keystone_authtoken.project_name = service {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] oslo_messaging_rabbit.ssl_version = {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] keystone_authtoken.region_name = None {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] key_manager.backend = barbican {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] key_manager.fixed_key = None {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] keystone_authtoken.service_token_roles_required = False {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] barbican.barbican_api_version = None {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] barbican.barbican_endpoint = None {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] keystone_authtoken.service_type = None {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] barbican.barbican_endpoint_type = public {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] barbican.barbican_region_name = None {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] keystone_authtoken.system_scope = None {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] barbican.cafile = None {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] barbican.certfile = None {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] keystone_authtoken.timeout = None {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] barbican.collect_timing = False {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] barbican.insecure = False {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] barbican.keyfile = None {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] barbican.number_of_retries = 60 {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] keystone_authtoken.trust_id = None {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] barbican.retry_delay = 1 {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] barbican.send_service_user_token = False {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] keystone_authtoken.user_domain_id = None {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] barbican.split_loggers = False {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] barbican.timeout = None {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] barbican.verify_ssl = True {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] keystone_authtoken.user_domain_name = Default {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] barbican.verify_ssl_path = None {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] barbican_service_user.auth_section = None {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] keystone_authtoken.user_id = None {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] barbican_service_user.auth_type = None {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] barbican_service_user.cafile = None {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] keystone_authtoken.username = glance {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] barbican_service_user.certfile = None {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] barbican_service_user.collect_timing = False {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] keystone_authtoken.www_authenticate_uri = None {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] barbican_service_user.insecure = False {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] barbican_service_user.keyfile = None {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] cache.backend = dogpile.cache.null {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] barbican_service_user.split_loggers = False {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] barbican_service_user.timeout = None {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] cache.backend_argument = **** {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] database.backend = sqlalchemy {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] database.connection = **** {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] database.connection_debug = 0 {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] cache.config_prefix = cache.oslo {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] database.connection_parameters = {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] database.connection_recycle_time = 3600 {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] cache.dead_timeout = 60.0 {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] database.connection_trace = False {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] database.db_inc_retry_interval = True {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] cache.debug_cache_backend = False {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] database.db_max_retries = 20 {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] database.db_max_retry_interval = 10 {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] cache.enable_retry_client = False {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] database.db_retry_interval = 1 {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] database.max_overflow = 50 {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] cache.enable_socket_keepalive = False {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] database.max_pool_size = 5 {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] database.max_retries = 10 {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] cache.enabled = False {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] database.mysql_wsrep_sync_wait = None {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] cache.enforce_fips_mode = False {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] database.pool_timeout = None {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] database.retry_interval = 10 {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] cache.expiration_time = 600 {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] database.slave_connection = **** {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] database.sqlite_synchronous = True {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] cache.hashclient_retry_attempts = 2 {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] database.use_db_reconnect = False {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] healthcheck.allowed_source_ranges = [] {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] cache.hashclient_retry_delay = 1.0 {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] healthcheck.backends = ['disable_by_file'] {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] healthcheck.detailed = False {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] healthcheck.disable_by_file_path = None {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] cache.memcache_dead_retry = 300 {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] healthcheck.ignore_proxied_requests = False {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] healthcheck.path = /healthcheck {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] cache.memcache_password = **** {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.common.config [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] ******************************************************************************** {{(pid=86374) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2624}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: WSGI app 0 (mountpoint='') ready in 3 seconds on interpreter 0x55d5d3ba2160 pid: 86374 (default app) May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.api.middleware.version_negotiation [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] Determining version of request: GET / Accept: */* {{(pid=86374) process_request /opt/stack/glance/glance/api/middleware/version_negotiation.py:44}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.api.middleware.version_negotiation [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] Using url versioning {{(pid=86374) process_request /opt/stack/glance/glance/api/middleware/version_negotiation.py:57}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] cache.memcache_pool_maxsize = 10 {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.api.middleware.version_negotiation [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] Unknown version. Returning version choices. {{(pid=86374) process_request /opt/stack/glance/glance/api/middleware/version_negotiation.py:64}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] cache.memcache_sasl_enabled = False {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86374]: [pid: 86374|app: 0|req: 1/1] 127.0.0.1 () {32 vars in 393 bytes} [Tue May 28 12:44:55 2024] GET / => generated 1323 bytes in 2 msecs (HTTP/1.1 300) 3 headers in 106 bytes (1 switches on core 0) May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] cache.memcache_socket_timeout = 1.0 {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] cache.memcache_username = None {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] cache.proxies = [] {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] cache.redis_password = **** {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] cache.redis_server = localhost:6379 {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] cache.redis_socket_timeout = 1.0 {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] cache.redis_username = None {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] cache.retry_attempts = 2 {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] cache.retry_delay = 0.0 {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] cache.socket_keepalive_count = 1 {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] cache.socket_keepalive_idle = 1 {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] cache.socket_keepalive_interval = 1 {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] cache.tls_allowed_ciphers = None {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] cache.tls_cafile = None {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] cache.tls_certfile = None {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] cache.tls_enabled = False {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] cache.tls_keyfile = None {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] oslo_limit.auth_section = None {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] oslo_limit.auth_type = password {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] oslo_limit.auth_url = http://10.27.203.238/identity {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] oslo_limit.cafile = None {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] oslo_limit.certfile = None {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] oslo_limit.collect_timing = False {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] oslo_limit.connect_retries = None {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] oslo_limit.connect_retry_delay = None {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] oslo_limit.default_domain_id = None {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] oslo_limit.default_domain_name = None {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] oslo_limit.domain_id = None {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] oslo_limit.domain_name = None {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] oslo_limit.endpoint_id = 13c57d94d28f4be896335eeb1e8b02ca {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] oslo_limit.endpoint_override = None {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] oslo_limit.insecure = False {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] oslo_limit.keyfile = None {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] oslo_limit.max_version = None {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] oslo_limit.min_version = None {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] oslo_limit.password = **** {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] oslo_limit.project_domain_id = None {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] oslo_limit.project_domain_name = None {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] oslo_limit.project_id = None {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] oslo_limit.project_name = None {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] oslo_limit.region_name = None {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] oslo_limit.retriable_status_codes = None {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] oslo_limit.service_name = None {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] oslo_limit.service_type = None {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] oslo_limit.split_loggers = False {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] oslo_limit.status_code_retries = None {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] oslo_limit.status_code_retry_delay = None {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] oslo_limit.system_scope = all {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] oslo_limit.timeout = None {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] oslo_limit.trust_id = None {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] oslo_limit.user_domain_id = None {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] oslo_limit.user_domain_name = Default {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] oslo_limit.user_id = None {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] oslo_limit.username = glance {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] oslo_limit.valid_interfaces = None {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] oslo_limit.version = None {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] oslo_messaging_notifications.retry = -1 {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] oslo_messaging_rabbit.hostname = l75lg1-v1 {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] oslo_messaging_rabbit.processname = uwsgi {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] oslo_messaging_rabbit.ssl = False {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] key_manager.backend = barbican {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] key_manager.fixed_key = None {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] barbican.barbican_api_version = None {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] barbican.barbican_endpoint = None {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] barbican.barbican_endpoint_type = public {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] barbican.barbican_region_name = None {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] barbican.cafile = None {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] barbican.certfile = None {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] barbican.collect_timing = False {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] barbican.insecure = False {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] barbican.keyfile = None {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] barbican.number_of_retries = 60 {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] barbican.retry_delay = 1 {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] barbican.send_service_user_token = False {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] barbican.split_loggers = False {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] barbican.timeout = None {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] barbican.verify_ssl = True {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] barbican.verify_ssl_path = None {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] barbican_service_user.auth_section = None {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] barbican_service_user.auth_type = None {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] barbican_service_user.cafile = None {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] barbican_service_user.certfile = None {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] barbican_service_user.collect_timing = False {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] barbican_service_user.insecure = False {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] barbican_service_user.keyfile = None {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] barbican_service_user.split_loggers = False {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] barbican_service_user.timeout = None {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] database.backend = sqlalchemy {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] database.connection = **** {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] database.connection_debug = 0 {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] database.connection_parameters = {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] database.connection_recycle_time = 3600 {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] database.connection_trace = False {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] database.db_inc_retry_interval = True {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] database.db_max_retries = 20 {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] database.db_max_retry_interval = 10 {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] database.db_retry_interval = 1 {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] database.max_overflow = 50 {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] database.max_pool_size = 5 {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] database.max_retries = 10 {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] database.mysql_wsrep_sync_wait = None {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] database.pool_timeout = None {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] database.retry_interval = 10 {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] database.slave_connection = **** {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] database.sqlite_synchronous = True {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] database.use_db_reconnect = False {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] healthcheck.allowed_source_ranges = [] {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] healthcheck.backends = ['disable_by_file'] {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] healthcheck.detailed = False {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] healthcheck.disable_by_file_path = None {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] healthcheck.ignore_proxied_requests = False {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] healthcheck.path = /healthcheck {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.common.config [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] ******************************************************************************** {{(pid=86373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2624}} May 28 12:44:55 l75lg1-v1 devstack@g-api.service[86373]: WSGI app 0 (mountpoint='') ready in 3 seconds on interpreter 0x55d5d3ba2160 pid: 86373 (default app) May 28 12:44:55 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6f1afd-4dff-41b5-8edf-20ea7ecdad3b None None] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:44:55 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6f1afd-4dff-41b5-8edf-20ea7ecdad3b None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:44:55 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6f1afd-4dff-41b5-8edf-20ea7ecdad3b None None] PATH_INFO: `/` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:44:55 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 479/971] 10.27.203.238 () {58 vars in 1014 bytes} [Tue May 28 12:44:55 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:44:55 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44481e9d-f1b1-4fe0-9e69-5636762efa18 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:44:55 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44481e9d-f1b1-4fe0-9e69-5636762efa18 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:44:55 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44481e9d-f1b1-4fe0-9e69-5636762efa18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:44:55 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-44481e9d-f1b1-4fe0-9e69-5636762efa18 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:44:55 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-44481e9d-f1b1-4fe0-9e69-5636762efa18 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:44:55 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-44481e9d-f1b1-4fe0-9e69-5636762efa18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:44:55 l75lg1-v1 sudo[86526]: pam_unix(sudo:session): session closed for user root May 28 12:44:55 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-88e367a6-06a3-43b8-9392-1c0aab82ac3e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.502s {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:428}} May 28 12:44:55 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-88e367a6-06a3-43b8-9392-1c0aab82ac3e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:390}} May 28 12:44:55 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 493/972] 10.27.203.238 () {62 vars in 1111 bytes} [Tue May 28 12:44:55 2024] POST /identity/v3/auth/tokens => generated 3991 bytes in 24 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:44:55 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-88e367a6-06a3-43b8-9392-1c0aab82ac3e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.012s {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:428}} May 28 12:44:55 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-88e367a6-06a3-43b8-9392-1c0aab82ac3e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:390}} May 28 12:44:55 l75lg1-v1 sudo[86639]: vastdata : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool May 28 12:44:55 l75lg1-v1 sudo[86639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) May 28 12:44:55 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi [None req-f97dcef2-5671-46d4-b90b-8169629e1c6f admin admin] Calling method '>' {{(pid=73999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} May 28 12:44:55 l75lg1-v1 devstack@n-api.service[73999]: INFO nova.api.openstack.requestlog [None req-f97dcef2-5671-46d4-b90b-8169629e1c6f admin admin] 10.27.203.238 "GET /compute/v2.1" status: 200 len: 390 microversion: 2.1 time: 0.001079 May 28 12:44:55 l75lg1-v1 devstack@n-api.service[73999]: [pid: 73999|app: 0|req: 13/27] 10.27.203.238 () {58 vars in 1013 bytes} [Tue May 28 12:44:55 2024] GET /compute/v2.1 => generated 390 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 12:44:55 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6f1afd-4dff-41b5-8edf-20ea7ecdad3b None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:44:55 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6f1afd-4dff-41b5-8edf-20ea7ecdad3b None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:44:55 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad038256-ea6e-4ade-b967-fafec941c466 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'befdd4414dc2432ab2baa1ae3fbffef7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'manager', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:44:55 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad038256-ea6e-4ade-b967-fafec941c466 service nova] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:44:55 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad038256-ea6e-4ade-b967-fafec941c466 service nova] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:44:55 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad038256-ea6e-4ade-b967-fafec941c466 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:44:55 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad038256-ea6e-4ade-b967-fafec941c466 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:44:55 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad038256-ea6e-4ade-b967-fafec941c466 service nova] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:44:55 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 480/973] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 12:44:55 2024] GET /identity/v3/auth/tokens => generated 3991 bytes in 22 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 12:44:55 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi [None req-38daf63e-d313-497f-a78a-9749340aa26e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 40, "os-flavor-access:is_public": true, "swap": 0, "vcpus": 2, "id": "3", "ram": 4096}} {{(pid=74000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:518}} May 28 12:44:55 l75lg1-v1 devstack@n-api.service[74000]: INFO nova.api.openstack.requestlog [None req-38daf63e-d313-497f-a78a-9749340aa26e admin admin] 10.27.203.238 "POST /compute/v2.1/flavors" status: 200 len: 410 microversion: 2.61 time: 0.053339 May 28 12:44:55 l75lg1-v1 devstack@n-api.service[74000]: [pid: 74000|app: 0|req: 15/28] 10.27.203.238 () {68 vars in 1365 bytes} [Tue May 28 12:44:55 2024] POST /compute/v2.1/flavors => generated 410 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 12:44:55 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi [None req-00015ded-0de4-4eff-afba-272a32c77dd1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=73999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:518}} May 28 12:44:55 l75lg1-v1 devstack@n-api.service[73999]: INFO nova.api.openstack.requestlog [None req-00015ded-0de4-4eff-afba-272a32c77dd1 admin admin] 10.27.203.238 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025143 May 28 12:44:55 l75lg1-v1 devstack@n-api.service[73999]: [pid: 73999|app: 0|req: 14/29] 10.27.203.238 () {68 vars in 1415 bytes} [Tue May 28 12:44:55 2024] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 12:44:56 l75lg1-v1 dstat.sh[49771]: 28-05 12:44:56| 19 4 76 0 0|4507M 4943M 268M 5979M| 15k 10k| 640k 468k|5.00 50.0 |3882 6444 |2.26 1.92 1.33|3.0 0 117| 0 0 | 0 2048M| 27 253 0 25 0 May 28 12:44:56 l75lg1-v1 sudo[86639]: pam_unix(sudo:session): session closed for user root May 28 12:44:56 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-88e367a6-06a3-43b8-9392-1c0aab82ac3e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.559s {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:428}} May 28 12:44:56 l75lg1-v1 cinder-volume[85846]: INFO cinder.volume.drivers.lvm [None req-88e367a6-06a3-43b8-9392-1c0aab82ac3e None None] Enabling LVM thin provisioning by default because a thin pool exists. May 28 12:44:56 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-88e367a6-06a3-43b8-9392-1c0aab82ac3e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:390}} May 28 12:44:56 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-88e367a6-06a3-43b8-9392-1c0aab82ac3e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.014s {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:428}} May 28 12:44:56 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-88e367a6-06a3-43b8-9392-1c0aab82ac3e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:390}} May 28 12:44:56 l75lg1-v1 sudo[86646]: vastdata : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool May 28 12:44:56 l75lg1-v1 sudo[86646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) May 28 12:44:56 l75lg1-v1 sudo[86646]: pam_unix(sudo:session): session closed for user root May 28 12:44:56 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-88e367a6-06a3-43b8-9392-1c0aab82ac3e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.513s {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:428}} May 28 12:44:56 l75lg1-v1 cinder-volume[85846]: DEBUG cinder.volume.drivers.lvm [None req-88e367a6-06a3-43b8-9392-1c0aab82ac3e None None] Updating volume stats {{(pid=85846) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}} May 28 12:44:56 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-88e367a6-06a3-43b8-9392-1c0aab82ac3e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:390}} May 28 12:44:56 l75lg1-v1 sudo[86649]: vastdata : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 May 28 12:44:56 l75lg1-v1 sudo[86649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) May 28 12:44:57 l75lg1-v1 dstat.sh[49771]: 28-05 12:44:57| 18 2 80 0 0|4560M 4890M 268M 5979M| 10k 86B| 512k 244k|4.00 17.0 |2172 2528 |2.24 1.92 1.33|2.0 0 7.0| 0 0 | 0 2048M| 27 253 0 25 0 May 28 12:44:57 l75lg1-v1 sudo[86649]: pam_unix(sudo:session): session closed for user root May 28 12:44:57 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-88e367a6-06a3-43b8-9392-1c0aab82ac3e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.492s {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:428}} May 28 12:44:57 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-88e367a6-06a3-43b8-9392-1c0aab82ac3e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:390}} May 28 12:44:57 l75lg1-v1 sudo[86652]: vastdata : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 May 28 12:44:57 l75lg1-v1 sudo[86652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) May 28 12:44:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46b8faa-724d-421f-a708-f3ee6236ff04 None None] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:44:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46b8faa-724d-421f-a708-f3ee6236ff04 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:44:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46b8faa-724d-421f-a708-f3ee6236ff04 None None] PATH_INFO: `/` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:44:57 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 494/974] 10.27.203.238 () {58 vars in 1014 bytes} [Tue May 28 12:44:57 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:44:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39ca49f-0bc4-495b-adc9-38547e9429b4 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:44:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39ca49f-0bc4-495b-adc9-38547e9429b4 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:44:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39ca49f-0bc4-495b-adc9-38547e9429b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:44:57 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-b39ca49f-0bc4-495b-adc9-38547e9429b4 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:44:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-b39ca49f-0bc4-495b-adc9-38547e9429b4 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:44:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-b39ca49f-0bc4-495b-adc9-38547e9429b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:44:57 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 481/975] 10.27.203.238 () {62 vars in 1111 bytes} [Tue May 28 12:44:57 2024] POST /identity/v3/auth/tokens => generated 3991 bytes in 24 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:44:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi [None req-38daf63e-d313-497f-a78a-9749340aa26e admin admin] Calling method '>' {{(pid=74000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} May 28 12:44:57 l75lg1-v1 devstack@n-api.service[74000]: INFO nova.api.openstack.requestlog [None req-38daf63e-d313-497f-a78a-9749340aa26e admin admin] 10.27.203.238 "GET /compute/v2.1" status: 200 len: 390 microversion: 2.1 time: 0.001581 May 28 12:44:57 l75lg1-v1 devstack@n-api.service[74000]: [pid: 74000|app: 0|req: 16/30] 10.27.203.238 () {58 vars in 1013 bytes} [Tue May 28 12:44:57 2024] GET /compute/v2.1 => generated 390 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 12:44:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46b8faa-724d-421f-a708-f3ee6236ff04 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:44:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46b8faa-724d-421f-a708-f3ee6236ff04 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:44:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc681d70-7872-4533-a772-47a347b17f8a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'befdd4414dc2432ab2baa1ae3fbffef7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'manager', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:44:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc681d70-7872-4533-a772-47a347b17f8a service nova] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:44:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc681d70-7872-4533-a772-47a347b17f8a service nova] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:44:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc681d70-7872-4533-a772-47a347b17f8a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:44:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc681d70-7872-4533-a772-47a347b17f8a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:44:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc681d70-7872-4533-a772-47a347b17f8a service nova] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:44:57 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 495/976] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 12:44:57 2024] GET /identity/v3/auth/tokens => generated 3991 bytes in 24 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 12:44:57 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi [None req-4a7b1035-2ab1-464a-9f4b-df681c1065eb admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 8192, "disk": 80, "os-flavor-access:is_public": true, "name": "m1.large", "id": "4", "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=73999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:518}} May 28 12:44:57 l75lg1-v1 devstack@n-api.service[73999]: INFO nova.api.openstack.requestlog [None req-4a7b1035-2ab1-464a-9f4b-df681c1065eb admin admin] 10.27.203.238 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.61 time: 0.056261 May 28 12:44:57 l75lg1-v1 devstack@n-api.service[73999]: [pid: 73999|app: 0|req: 15/31] 10.27.203.238 () {68 vars in 1365 bytes} [Tue May 28 12:44:57 2024] POST /compute/v2.1/flavors => generated 409 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 12:44:57 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi [None req-c0ba57f3-ad69-4e35-8e53-dc53036b3e32 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=74000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:518}} May 28 12:44:57 l75lg1-v1 devstack@n-api.service[74000]: INFO nova.api.openstack.requestlog [None req-c0ba57f3-ad69-4e35-8e53-dc53036b3e32 admin admin] 10.27.203.238 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036541 May 28 12:44:57 l75lg1-v1 devstack@n-api.service[74000]: [pid: 74000|app: 0|req: 17/32] 10.27.203.238 () {68 vars in 1415 bytes} [Tue May 28 12:44:57 2024] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 12:44:57 l75lg1-v1 sudo[86652]: pam_unix(sudo:session): session closed for user root May 28 12:44:57 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-88e367a6-06a3-43b8-9392-1c0aab82ac3e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.449s {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:428}} May 28 12:44:57 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-88e367a6-06a3-43b8-9392-1c0aab82ac3e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:390}} May 28 12:44:57 l75lg1-v1 sudo[86657]: vastdata : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool May 28 12:44:57 l75lg1-v1 sudo[86657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) May 28 12:44:57 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [-] Expecting reply to msg 3b62169484cd491b98224d194236d868 in queue reply_37f4cbd1dd094961a22b8a65f222c327 May 28 12:44:58 l75lg1-v1 cinder-scheduler[85128]: DEBUG dbcounter [-] [85128] Writing DB stats cinder:SELECT=10,cinder:INSERT=1 {{(pid=85128) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:44:58 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [-] Received RPC response for msg 3b62169484cd491b98224d194236d868 May 28 12:44:58 l75lg1-v1 sudo[86657]: pam_unix(sudo:session): session closed for user root May 28 12:44:58 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-88e367a6-06a3-43b8-9392-1c0aab82ac3e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.460s {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:428}} May 28 12:44:58 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-88e367a6-06a3-43b8-9392-1c0aab82ac3e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:390}} May 28 12:44:58 l75lg1-v1 sudo[86664]: vastdata : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 May 28 12:44:58 l75lg1-v1 sudo[86664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) May 28 12:44:58 l75lg1-v1 dstat.sh[49771]: 28-05 12:44:58| 17 2 79 1 0|4508M 4943M 268M 5979M| 14k 86B| 640k 528k|5.00 69.0 |3164 5552 |2.24 1.92 1.33|3.0 0 14| 0 0 | 0 2048M| 27 255 0 24 0 May 28 12:44:58 l75lg1-v1 sudo[86664]: pam_unix(sudo:session): session closed for user root May 28 12:44:58 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-88e367a6-06a3-43b8-9392-1c0aab82ac3e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.454s {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:428}} May 28 12:44:58 l75lg1-v1 cinder-volume[85846]: INFO cinder.volume.driver [None req-88e367a6-06a3-43b8-9392-1c0aab82ac3e None None] Driver hasn't implemented _init_vendor_properties() May 28 12:44:58 l75lg1-v1 cinder-volume[85846]: DEBUG cinder.volume.driver [None req-88e367a6-06a3-43b8-9392-1c0aab82ac3e None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:l75lg1-v1:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=85846) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:832}} May 28 12:44:58 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_db.sqlalchemy.engines [None req-88e367a6-06a3-43b8-9392-1c0aab82ac3e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85846) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:342}} May 28 12:44:58 l75lg1-v1 cinder-volume[85846]: DEBUG dbcounter [-] [85846] Writer thread running {{(pid=85846) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} May 28 12:44:58 l75lg1-v1 cinder-volume[85846]: DEBUG cinder.db.sqlalchemy.api [None req-88e367a6-06a3-43b8-9392-1c0aab82ac3e None None] Building query based on filter {{(pid=85846) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3880}} May 28 12:44:58 l75lg1-v1 cinder-volume[85846]: DEBUG cinder.image.image_utils [None req-88e367a6-06a3-43b8-9392-1c0aab82ac3e None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=85846) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1164}} May 28 12:44:58 l75lg1-v1 cinder-volume[85846]: INFO cinder.keymgr.migration [None req-613cd1a0-9887-4711-a089-d29c2ccaf9da None None] Not migrating encryption keys because the ConfKeyManager is still in use. May 28 12:44:58 l75lg1-v1 cinder-volume[85846]: DEBUG cinder.volume.drivers.lvm [None req-88e367a6-06a3-43b8-9392-1c0aab82ac3e None None] Updating volume stats {{(pid=85846) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}} May 28 12:44:58 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-88e367a6-06a3-43b8-9392-1c0aab82ac3e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:390}} May 28 12:44:58 l75lg1-v1 sudo[86668]: vastdata : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 May 28 12:44:58 l75lg1-v1 sudo[86668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) May 28 12:44:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd53231-3c6c-407a-a846-0ff284d69383 None None] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:44:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd53231-3c6c-407a-a846-0ff284d69383 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:44:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd53231-3c6c-407a-a846-0ff284d69383 None None] PATH_INFO: `/` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:44:59 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 482/977] 10.27.203.238 () {58 vars in 1014 bytes} [Tue May 28 12:44:59 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:44:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695b7cd0-ea29-4526-aa0b-33489f69c04e None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:44:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695b7cd0-ea29-4526-aa0b-33489f69c04e None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:44:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695b7cd0-ea29-4526-aa0b-33489f69c04e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:44:59 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-695b7cd0-ea29-4526-aa0b-33489f69c04e None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:44:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-695b7cd0-ea29-4526-aa0b-33489f69c04e None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:44:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-695b7cd0-ea29-4526-aa0b-33489f69c04e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:44:59 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 496/978] 10.27.203.238 () {62 vars in 1111 bytes} [Tue May 28 12:44:59 2024] POST /identity/v3/auth/tokens => generated 3991 bytes in 22 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:44:59 l75lg1-v1 sudo[86668]: pam_unix(sudo:session): session closed for user root May 28 12:44:59 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-88e367a6-06a3-43b8-9392-1c0aab82ac3e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.450s {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:428}} May 28 12:44:59 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-88e367a6-06a3-43b8-9392-1c0aab82ac3e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:390}} May 28 12:44:59 l75lg1-v1 sudo[86671]: vastdata : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 May 28 12:44:59 l75lg1-v1 sudo[86671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) May 28 12:44:59 l75lg1-v1 dstat.sh[49771]: 28-05 12:44:59| 17 3 80 0 0|4557M 4893M 268M 5979M| 13k 1637B| 512k 220k|4.00 18.0 |2241 2768 |2.24 1.92 1.33|3.0 0 7.0| 0 0 | 0 2048M| 27 258 0 24 0 May 28 12:44:59 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi [None req-4a7b1035-2ab1-464a-9f4b-df681c1065eb admin admin] Calling method '>' {{(pid=73999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} May 28 12:44:59 l75lg1-v1 devstack@n-api.service[73999]: INFO nova.api.openstack.requestlog [None req-4a7b1035-2ab1-464a-9f4b-df681c1065eb admin admin] 10.27.203.238 "GET /compute/v2.1" status: 200 len: 390 microversion: 2.1 time: 0.001127 May 28 12:44:59 l75lg1-v1 devstack@n-api.service[73999]: [pid: 73999|app: 0|req: 16/33] 10.27.203.238 () {58 vars in 1013 bytes} [Tue May 28 12:44:59 2024] GET /compute/v2.1 => generated 390 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 12:44:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd53231-3c6c-407a-a846-0ff284d69383 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:44:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd53231-3c6c-407a-a846-0ff284d69383 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:44:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4291067-76ec-4270-b8bb-026e9af5c003 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'befdd4414dc2432ab2baa1ae3fbffef7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'manager', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:44:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4291067-76ec-4270-b8bb-026e9af5c003 service nova] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:44:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4291067-76ec-4270-b8bb-026e9af5c003 service nova] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:44:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4291067-76ec-4270-b8bb-026e9af5c003 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:44:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4291067-76ec-4270-b8bb-026e9af5c003 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:44:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4291067-76ec-4270-b8bb-026e9af5c003 service nova] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:44:59 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 483/979] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 12:44:59 2024] GET /identity/v3/auth/tokens => generated 3991 bytes in 20 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 12:44:59 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi [None req-01935d90-cea8-4366-8c58-d36e228c38f3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 160, "swap": 0, "ram": 16384, "vcpus": 8, "id": "5", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "m1.xlarge", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=74000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:518}} May 28 12:44:59 l75lg1-v1 devstack@c-api.service[84424]: DEBUG dbcounter [-] [84424] Writing DB stats cinder:SELECT=9,cinder:INSERT=1 {{(pid=84424) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:44:59 l75lg1-v1 devstack@n-api.service[74000]: INFO nova.api.openstack.requestlog [None req-01935d90-cea8-4366-8c58-d36e228c38f3 admin admin] 10.27.203.238 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.61 time: 0.051049 May 28 12:44:59 l75lg1-v1 devstack@n-api.service[74000]: [pid: 74000|app: 0|req: 18/34] 10.27.203.238 () {68 vars in 1365 bytes} [Tue May 28 12:44:59 2024] POST /compute/v2.1/flavors => generated 412 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 12:44:59 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi [None req-8353abda-fbe0-4281-9f1e-cebb1c0c3174 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=73999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:518}} May 28 12:44:59 l75lg1-v1 devstack@n-api.service[73999]: INFO nova.api.openstack.requestlog [None req-8353abda-fbe0-4281-9f1e-cebb1c0c3174 admin admin] 10.27.203.238 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027582 May 28 12:44:59 l75lg1-v1 devstack@n-api.service[73999]: [pid: 73999|app: 0|req: 17/35] 10.27.203.238 () {68 vars in 1415 bytes} [Tue May 28 12:44:59 2024] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 12:44:59 l75lg1-v1 sudo[86671]: pam_unix(sudo:session): session closed for user root May 28 12:44:59 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-88e367a6-06a3-43b8-9392-1c0aab82ac3e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.480s {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:428}} May 28 12:44:59 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-88e367a6-06a3-43b8-9392-1c0aab82ac3e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:390}} May 28 12:44:59 l75lg1-v1 sudo[86708]: vastdata : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool May 28 12:44:59 l75lg1-v1 sudo[86708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) May 28 12:44:59 l75lg1-v1 devstack@c-api.service[84425]: DEBUG dbcounter [-] [84425] Writing DB stats cinder:SELECT=12,cinder:INSERT=1 {{(pid=84425) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:45:00 l75lg1-v1 cinder-volume[85683]: DEBUG dbcounter [-] [85683] Writing DB stats cinder:SELECT=7,cinder:INSERT=1 {{(pid=85683) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:45:00 l75lg1-v1 sudo[86708]: pam_unix(sudo:session): session closed for user root May 28 12:45:00 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-88e367a6-06a3-43b8-9392-1c0aab82ac3e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.510s {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:428}} May 28 12:45:00 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-88e367a6-06a3-43b8-9392-1c0aab82ac3e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:390}} May 28 12:45:00 l75lg1-v1 sudo[86713]: vastdata : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 May 28 12:45:00 l75lg1-v1 sudo[86713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) May 28 12:45:00 l75lg1-v1 dstat.sh[49771]: 28-05 12:45:00| 11 3 83 3 0|4503M 4947M 268M 5979M| 28k 7773B| 640k 13M|5.00 468 |3683 5130 |2.24 1.92 1.33|2.0 0 42| 0 0 | 0 2048M| 27 265 0 23 0 May 28 12:45:00 l75lg1-v1 neutron-server[77618]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.HashRingHealthCheckPeriodics.touch_hash_ring_nodes' {{(pid=77618) _process_scheduled /opt/stack/data/venv/lib/python3.10/site-packages/futurist/periodics.py:638}} May 28 12:45:00 l75lg1-v1 sudo[86713]: pam_unix(sudo:session): session closed for user root May 28 12:45:00 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-88e367a6-06a3-43b8-9392-1c0aab82ac3e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.473s {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:428}} May 28 12:45:00 l75lg1-v1 cinder-volume[85846]: DEBUG cinder.manager [None req-88e367a6-06a3-43b8-9392-1c0aab82ac3e None None] Notifying Schedulers of capabilities ... {{(pid=85846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 28 12:45:00 l75lg1-v1 cinder-volume[85846]: INFO cinder.volume.manager [None req-88e367a6-06a3-43b8-9392-1c0aab82ac3e None None] Driver initialization completed successfully. May 28 12:45:00 l75lg1-v1 cinder-volume[85846]: INFO cinder.manager [None req-88e367a6-06a3-43b8-9392-1c0aab82ac3e None None] Initiating service 2 cleanup May 28 12:45:00 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.scheduler.host_manager [None req-88e367a6-06a3-43b8-9392-1c0aab82ac3e None None] Received volume service update from l75lg1-v1@lvmdriver-1: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:l75lg1-v1:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up', 'allocated_capacity_gb': 0, 'cacheable': True}], 'shared_targets': False, 'sparse_copy_volume': True, 'filter_function': None, 'goodness_function': None} {{(pid=85128) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:628}} May 28 12:45:00 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.scheduler.host_manager [None req-88e367a6-06a3-43b8-9392-1c0aab82ac3e None None] Publish storage capacity: [{'type': 'pool', 'name_to_id': 'l75lg1-v1@lvmdriver-1#lvmdriver-1', 'total': 28.5, 'free': 28.5, 'allocated': 0.0, 'provisioned': 0.0, 'virtual_free': 570.0, 'reported_at': datetime.datetime(2024, 5, 28, 12, 45, 0, 713828)}, {'type': 'backend', 'name_to_id': 'l75lg1-v1@lvmdriver-1', 'total': 28.5, 'free': 28.5, 'allocated': 0.0, 'provisioned': 0.0, 'virtual_free': 570.0, 'reported_at': datetime.datetime(2024, 5, 28, 12, 45, 0, 713828)}]. {{(pid=85128) _notify_capacity_usage /opt/stack/cinder/cinder/scheduler/host_manager.py:977}} May 28 12:45:00 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.scheduler.host_manager [None req-88e367a6-06a3-43b8-9392-1c0aab82ac3e None None] Updating capabilities for l75lg1-v1@lvmdriver-1#lvmdriver-1: {'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:l75lg1-v1:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up', 'allocated_capacity_gb': 0, 'cacheable': True, 'volume_backend_name': 'lvmdriver-1', 'storage_protocol': ['iSCSI', 'iscsi'], 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'timestamp': datetime.datetime(2024, 5, 28, 12, 45, 0, 694421)} {{(pid=85128) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} May 28 12:45:00 l75lg1-v1 cinder-volume[85846]: INFO cinder.manager [None req-88e367a6-06a3-43b8-9392-1c0aab82ac3e None None] Service 2 cleanup completed. May 28 12:45:00 l75lg1-v1 cinder-volume[85846]: DEBUG cinder.service [None req-88e367a6-06a3-43b8-9392-1c0aab82ac3e None None] Creating RPC server for service cinder-volume {{(pid=85846) start /opt/stack/cinder/cinder/service.py:238}} May 28 12:45:00 l75lg1-v1 cinder-volume[85846]: DEBUG cinder.service [None req-88e367a6-06a3-43b8-9392-1c0aab82ac3e None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=85846) start /opt/stack/cinder/cinder/service.py:244}} May 28 12:45:00 l75lg1-v1 cinder-volume[85846]: INFO oslo.messaging._drivers.impl_rabbit [None req-88e367a6-06a3-43b8-9392-1c0aab82ac3e None None] Creating fanout queue: cinder-volume_fanout_0fdd80f556f94473848f0be999f1cddf May 28 12:45:00 l75lg1-v1 cinder-volume[85846]: INFO oslo.messaging._drivers.impl_rabbit [None req-88e367a6-06a3-43b8-9392-1c0aab82ac3e None None] Creating fanout queue: cinder-volume.l75lg1-v1@lvmdriver-1_fanout_b26cd05b22ff468f87a5684d4670f92d May 28 12:45:00 l75lg1-v1 cinder-volume[85846]: INFO cinder.volume.manager [None req-88e367a6-06a3-43b8-9392-1c0aab82ac3e None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) May 28 12:45:00 l75lg1-v1 cinder-volume[85846]: DEBUG cinder.volume.drivers.lvm [None req-88e367a6-06a3-43b8-9392-1c0aab82ac3e None None] Updating volume stats {{(pid=85846) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}} May 28 12:45:00 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-88e367a6-06a3-43b8-9392-1c0aab82ac3e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:390}} May 28 12:45:00 l75lg1-v1 sudo[86717]: vastdata : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 May 28 12:45:00 l75lg1-v1 sudo[86717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) May 28 12:45:00 l75lg1-v1 nova-conductor[83647]: DEBUG dbcounter [-] [83647] Writing DB stats nova_cell1:SELECT=9,nova_cell1:UPDATE=1 {{(pid=83647) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:45:01 l75lg1-v1 sudo[86717]: pam_unix(sudo:session): session closed for user root May 28 12:45:01 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-88e367a6-06a3-43b8-9392-1c0aab82ac3e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.465s {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:428}} May 28 12:45:01 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-88e367a6-06a3-43b8-9392-1c0aab82ac3e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:390}} May 28 12:45:01 l75lg1-v1 dstat.sh[49771]: 28-05 12:45:01| 9 3 88 0 0|4507M 4926M 268M 5996M| 18M 88k| 512k 344k|4.00 40.0 |7351 6712 |2.24 1.92 1.33|1.0 0 7.0| 0 0 | 0 2048M| 27 269 0 23 0 May 28 12:45:01 l75lg1-v1 sudo[86721]: vastdata : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 May 28 12:45:01 l75lg1-v1 sudo[86721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) May 28 12:45:01 l75lg1-v1 sudo[86721]: pam_unix(sudo:session): session closed for user root May 28 12:45:01 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-88e367a6-06a3-43b8-9392-1c0aab82ac3e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.469s {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:428}} May 28 12:45:01 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-88e367a6-06a3-43b8-9392-1c0aab82ac3e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:390}} May 28 12:45:01 l75lg1-v1 sudo[86861]: vastdata : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool May 28 12:45:01 l75lg1-v1 sudo[86861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) May 28 12:45:02 l75lg1-v1 sudo[86861]: pam_unix(sudo:session): session closed for user root May 28 12:45:02 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-88e367a6-06a3-43b8-9392-1c0aab82ac3e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.459s {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:428}} May 28 12:45:02 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-88e367a6-06a3-43b8-9392-1c0aab82ac3e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:390}} May 28 12:45:02 l75lg1-v1 sudo[86867]: vastdata : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 May 28 12:45:02 l75lg1-v1 sudo[86867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) May 28 12:45:02 l75lg1-v1 dstat.sh[49771]: 28-05 12:45:02| 15 4 80 0 0|4539M 4891M 268M 5999M|3012k 23k| 640k 7485k|5.00 553 |4163 3680 |2.14 1.91 1.33|3.0 0 147| 0 0 | 0 2048M| 27 268 0 22 0 May 28 12:45:02 l75lg1-v1 devstack@placement-api.service[78201]: DEBUG dbcounter [-] [78201] Writing DB stats placement:SELECT=4 {{(pid=78201) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:45:02 l75lg1-v1 devstack@placement-api.service[78202]: DEBUG dbcounter [-] [78202] Writing DB stats placement:INSERT=54,placement:UPDATE=3,placement:SELECT=6 {{(pid=78202) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:45:02 l75lg1-v1 sudo[86867]: pam_unix(sudo:session): session closed for user root May 28 12:45:02 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-88e367a6-06a3-43b8-9392-1c0aab82ac3e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.468s {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:428}} May 28 12:45:02 l75lg1-v1 cinder-volume[85846]: INFO cinder.volume.manager [None req-88e367a6-06a3-43b8-9392-1c0aab82ac3e None None] Driver post RPC initialization completed successfully. May 28 12:45:02 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32820394-7ab0-4d72-b0c2-d78392549357 None None] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:45:02 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32820394-7ab0-4d72-b0c2-d78392549357 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:45:02 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32820394-7ab0-4d72-b0c2-d78392549357 None None] PATH_INFO: `/` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:45:02 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 497/980] 10.27.203.238 () {58 vars in 1014 bytes} [Tue May 28 12:45:02 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:45:02 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fbba3c-8397-45b6-a420-f0ff9e60f017 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:45:02 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fbba3c-8397-45b6-a420-f0ff9e60f017 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:45:02 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fbba3c-8397-45b6-a420-f0ff9e60f017 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:45:02 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-13fbba3c-8397-45b6-a420-f0ff9e60f017 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:45:02 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-13fbba3c-8397-45b6-a420-f0ff9e60f017 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:45:02 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-13fbba3c-8397-45b6-a420-f0ff9e60f017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:45:02 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 484/981] 10.27.203.238 () {62 vars in 1111 bytes} [Tue May 28 12:45:02 2024] POST /identity/v3/auth/tokens => generated 3991 bytes in 23 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:45:03 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.api.middleware.version_negotiation [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] Determining version of request: GET / Accept: application/json {{(pid=86374) process_request /opt/stack/glance/glance/api/middleware/version_negotiation.py:44}} May 28 12:45:03 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.api.middleware.version_negotiation [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] Using url versioning {{(pid=86374) process_request /opt/stack/glance/glance/api/middleware/version_negotiation.py:57}} May 28 12:45:03 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.api.middleware.version_negotiation [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] Unknown version. Returning version choices. {{(pid=86374) process_request /opt/stack/glance/glance/api/middleware/version_negotiation.py:64}} May 28 12:45:03 l75lg1-v1 devstack@g-api.service[86374]: [pid: 86374|app: 0|req: 2/2] 127.0.0.1 () {34 vars in 509 bytes} [Tue May 28 12:45:03 2024] GET / => generated 1323 bytes in 2 msecs (HTTP/1.1 300) 3 headers in 106 bytes (1 switches on core 0) May 28 12:45:03 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.api.middleware.version_negotiation [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] Determining version of request: POST /v2/images Accept: */* {{(pid=86373) process_request /opt/stack/glance/glance/api/middleware/version_negotiation.py:44}} May 28 12:45:03 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.api.middleware.version_negotiation [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] Using url versioning {{(pid=86373) process_request /opt/stack/glance/glance/api/middleware/version_negotiation.py:57}} May 28 12:45:03 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.api.middleware.version_negotiation [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] Matched version: v2 {{(pid=86373) process_request /opt/stack/glance/glance/api/middleware/version_negotiation.py:69}} May 28 12:45:03 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.api.middleware.version_negotiation [None req-aa21b6d4-8dbe-4efa-801e-e5ad65781b16 None None] new path /v2/images {{(pid=86373) process_request /opt/stack/glance/glance/api/middleware/version_negotiation.py:70}} May 28 12:45:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3b37bb-bfa3-44db-b04d-6e6bd63eaf89 None None] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:45:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3b37bb-bfa3-44db-b04d-6e6bd63eaf89 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:45:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3b37bb-bfa3-44db-b04d-6e6bd63eaf89 None None] PATH_INFO: `/` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:45:03 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 498/982] 10.27.203.238 () {58 vars in 1055 bytes} [Tue May 28 12:45:03 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:45:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9615fd58-cf18-4746-9695-15fd97b4e50f None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:45:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9615fd58-cf18-4746-9695-15fd97b4e50f None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:45:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9615fd58-cf18-4746-9695-15fd97b4e50f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:45:03 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-9615fd58-cf18-4746-9695-15fd97b4e50f None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:45:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-9615fd58-cf18-4746-9695-15fd97b4e50f None None] MFA Rules not processed for user `d1436e60c2e34e0b8af9ae1c668bdf03`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:45:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-9615fd58-cf18-4746-9695-15fd97b4e50f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:45:03 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 485/983] 10.27.203.238 () {62 vars in 1152 bytes} [Tue May 28 12:45:03 2024] POST /identity/v3/auth/tokens => generated 3809 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:45:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3b37bb-bfa3-44db-b04d-6e6bd63eaf89 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:45:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3b37bb-bfa3-44db-b04d-6e6bd63eaf89 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:45:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db788cc-0f55-4581-809a-b0f5e2cdafca service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1436e60c2e34e0b8af9ae1c668bdf03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:45:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db788cc-0f55-4581-809a-b0f5e2cdafca service glance] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:45:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db788cc-0f55-4581-809a-b0f5e2cdafca service glance] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:45:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db788cc-0f55-4581-809a-b0f5e2cdafca service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:45:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db788cc-0f55-4581-809a-b0f5e2cdafca service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:45:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db788cc-0f55-4581-809a-b0f5e2cdafca service glance] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:45:03 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 499/984] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 12:45:03 2024] GET /identity/v3/auth/tokens => generated 3991 bytes in 23 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 12:45:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8944ebe4-7505-491c-91d5-651a81316901 None None] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:45:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8944ebe4-7505-491c-91d5-651a81316901 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:45:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8944ebe4-7505-491c-91d5-651a81316901 None None] PATH_INFO: `/` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:45:03 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 486/985] 10.27.203.238 () {58 vars in 1001 bytes} [Tue May 28 12:45:03 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:45:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538d4470-8d39-4ad6-bf36-e2c2058a30ec None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:45:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538d4470-8d39-4ad6-bf36-e2c2058a30ec None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:45:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538d4470-8d39-4ad6-bf36-e2c2058a30ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:45:03 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-538d4470-8d39-4ad6-bf36-e2c2058a30ec None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:45:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-538d4470-8d39-4ad6-bf36-e2c2058a30ec None None] MFA Rules not processed for user `d1436e60c2e34e0b8af9ae1c668bdf03`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:45:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-538d4470-8d39-4ad6-bf36-e2c2058a30ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:45:03 l75lg1-v1 dstat.sh[49771]: 28-05 12:45:03| 13 2 84 1 0|4561M 4868M 268M 6000M| 12k 0 | 256k 488k|2.00 61.0 |2984 4467 |2.14 1.91 1.33|1.0 0 1.0| 0 0 | 0 2048M| 27 274 0 23 0 May 28 12:45:03 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 500/986] 10.27.203.238 () {62 vars in 1098 bytes} [Tue May 28 12:45:03 2024] POST /identity/v3/auth/tokens => generated 2752 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 12:45:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8944ebe4-7505-491c-91d5-651a81316901 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:45:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8944ebe4-7505-491c-91d5-651a81316901 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:45:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ef5df1-7756-4fab-b1f7-7ec40164e627 None glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1436e60c2e34e0b8af9ae1c668bdf03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:45:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ef5df1-7756-4fab-b1f7-7ec40164e627 None glance] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:45:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ef5df1-7756-4fab-b1f7-7ec40164e627 None glance] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:45:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ef5df1-7756-4fab-b1f7-7ec40164e627 None glance] PATH_INFO: `/v3/limits/model` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:45:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ef5df1-7756-4fab-b1f7-7ec40164e627 None glance] RBAC: Authorizing `identity:get_limit_model()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:45:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ef5df1-7756-4fab-b1f7-7ec40164e627 None glance] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:45:03 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 487/987] 10.27.203.238 () {60 vars in 1217 bytes} [Tue May 28 12:45:03 2024] GET /identity/v3/limits/model => generated 131 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:45:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538d4470-8d39-4ad6-bf36-e2c2058a30ec None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:45:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538d4470-8d39-4ad6-bf36-e2c2058a30ec None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:45:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c948bdc8-d86a-40ab-8284-a4f78bd64636 None glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1436e60c2e34e0b8af9ae1c668bdf03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:45:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c948bdc8-d86a-40ab-8284-a4f78bd64636 None glance] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:45:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c948bdc8-d86a-40ab-8284-a4f78bd64636 None glance] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:45:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c948bdc8-d86a-40ab-8284-a4f78bd64636 None glance] PATH_INFO: `/v3/endpoints/13c57d94d28f4be896335eeb1e8b02ca` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:45:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c948bdc8-d86a-40ab-8284-a4f78bd64636 None glance] RBAC: Authorizing `identity:get_endpoint(endpoint_id=13c57d94d28f4be896335eeb1e8b02ca)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:45:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c948bdc8-d86a-40ab-8284-a4f78bd64636 None glance] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:45:03 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 501/988] 10.27.203.238 () {60 vars in 1307 bytes} [Tue May 28 12:45:03 2024] GET /identity/v3/endpoints/13c57d94d28f4be896335eeb1e8b02ca => generated 331 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:45:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ef5df1-7756-4fab-b1f7-7ec40164e627 None glance] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:45:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ef5df1-7756-4fab-b1f7-7ec40164e627 None glance] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:45:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c053c1-d5a1-413f-9de9-3dd68f8b3078 None glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1436e60c2e34e0b8af9ae1c668bdf03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:45:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c053c1-d5a1-413f-9de9-3dd68f8b3078 None glance] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:45:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c053c1-d5a1-413f-9de9-3dd68f8b3078 None glance] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:45:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c053c1-d5a1-413f-9de9-3dd68f8b3078 None glance] PATH_INFO: `/v3/limits` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:45:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c053c1-d5a1-413f-9de9-3dd68f8b3078 None glance] RBAC: Adding query filter params (service_id=b5d296eb68964f14a9e57eb9d15e174d, region_id=RegionOne, resource_name=image_count_total, project_id=ea8d517cde1d40bb82c97e080ce071f7) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:45:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c053c1-d5a1-413f-9de9-3dd68f8b3078 None glance] RBAC: Authorizing `identity:list_limits()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:45:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c053c1-d5a1-413f-9de9-3dd68f8b3078 None glance] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:45:03 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 488/989] 10.27.203.238 () {60 vars in 1491 bytes} [Tue May 28 12:45:03 2024] GET /identity/v3/limits?service_id=b5d296eb68964f14a9e57eb9d15e174d®ion_id=RegionOne&resource_name=image_count_total&project_id=ea8d517cde1d40bb82c97e080ce071f7 => generated 249 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:45:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c948bdc8-d86a-40ab-8284-a4f78bd64636 None glance] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:45:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c948bdc8-d86a-40ab-8284-a4f78bd64636 None glance] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:45:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f05177b-88ff-44c7-9ab7-e4af793118a2 None glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1436e60c2e34e0b8af9ae1c668bdf03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:45:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f05177b-88ff-44c7-9ab7-e4af793118a2 None glance] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:45:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f05177b-88ff-44c7-9ab7-e4af793118a2 None glance] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:45:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f05177b-88ff-44c7-9ab7-e4af793118a2 None glance] PATH_INFO: `/v3/registered_limits` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:45:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f05177b-88ff-44c7-9ab7-e4af793118a2 None glance] RBAC: Adding query filter params (service_id=b5d296eb68964f14a9e57eb9d15e174d, region_id=RegionOne, resource_name=image_count_total) {{(pid=51267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:45:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f05177b-88ff-44c7-9ab7-e4af793118a2 None glance] RBAC: Authorizing `identity:list_registered_limits()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:45:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f05177b-88ff-44c7-9ab7-e4af793118a2 None glance] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:45:03 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 502/990] 10.27.203.238 () {60 vars in 1436 bytes} [Tue May 28 12:45:03 2024] GET /identity/v3/registered_limits?service_id=b5d296eb68964f14a9e57eb9d15e174d®ion_id=RegionOne&resource_name=image_count_total => generated 532 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:45:03 l75lg1-v1 devstack@g-api.service[86373]: [pid: 86373|app: 0|req: 1/3] 127.0.0.1 () {40 vars in 772 bytes} [Tue May 28 12:45:03 2024] POST /v2/images => generated 807 bytes in 702 msecs (HTTP/1.1 201) 6 headers in 314 bytes (1 switches on core 0) May 28 12:45:03 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.api.middleware.version_negotiation [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] Determining version of request: PUT /v2/images/e858734c-ca0f-45cb-b278-37dcfb0db7c6/file Accept: {{(pid=86374) process_request /opt/stack/glance/glance/api/middleware/version_negotiation.py:44}} May 28 12:45:03 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.api.middleware.version_negotiation [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] Using url versioning {{(pid=86374) process_request /opt/stack/glance/glance/api/middleware/version_negotiation.py:57}} May 28 12:45:03 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.api.middleware.version_negotiation [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] Matched version: v2 {{(pid=86374) process_request /opt/stack/glance/glance/api/middleware/version_negotiation.py:69}} May 28 12:45:03 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.api.middleware.version_negotiation [None req-0a6058d0-0d2b-4419-aebc-9d5e384108ff None None] new path /v2/images/e858734c-ca0f-45cb-b278-37dcfb0db7c6/file {{(pid=86374) process_request /opt/stack/glance/glance/api/middleware/version_negotiation.py:70}} May 28 12:45:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe40f35-a063-4137-a150-51817c10f87d None None] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:45:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe40f35-a063-4137-a150-51817c10f87d None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:45:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe40f35-a063-4137-a150-51817c10f87d None None] PATH_INFO: `/` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:45:03 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 489/991] 10.27.203.238 () {58 vars in 1001 bytes} [Tue May 28 12:45:03 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:45:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b129ba-0f19-48d3-a926-759b959e8c08 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:45:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b129ba-0f19-48d3-a926-759b959e8c08 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:45:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b129ba-0f19-48d3-a926-759b959e8c08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:45:03 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-91b129ba-0f19-48d3-a926-759b959e8c08 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:45:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-91b129ba-0f19-48d3-a926-759b959e8c08 None None] MFA Rules not processed for user `d1436e60c2e34e0b8af9ae1c668bdf03`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:45:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-91b129ba-0f19-48d3-a926-759b959e8c08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:45:03 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 503/992] 10.27.203.238 () {62 vars in 1098 bytes} [Tue May 28 12:45:03 2024] POST /identity/v3/auth/tokens => generated 2752 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 12:45:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe40f35-a063-4137-a150-51817c10f87d None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:45:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe40f35-a063-4137-a150-51817c10f87d None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:45:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70b3a9a-4511-4d9c-87c2-9c6802c4c1e2 None glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1436e60c2e34e0b8af9ae1c668bdf03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:45:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70b3a9a-4511-4d9c-87c2-9c6802c4c1e2 None glance] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:45:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70b3a9a-4511-4d9c-87c2-9c6802c4c1e2 None glance] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:45:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70b3a9a-4511-4d9c-87c2-9c6802c4c1e2 None glance] PATH_INFO: `/v3/limits/model` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:45:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70b3a9a-4511-4d9c-87c2-9c6802c4c1e2 None glance] RBAC: Authorizing `identity:get_limit_model()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:45:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70b3a9a-4511-4d9c-87c2-9c6802c4c1e2 None glance] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:45:03 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 490/993] 10.27.203.238 () {60 vars in 1217 bytes} [Tue May 28 12:45:03 2024] GET /identity/v3/limits/model => generated 131 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:45:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b129ba-0f19-48d3-a926-759b959e8c08 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:45:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b129ba-0f19-48d3-a926-759b959e8c08 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:45:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb7d87f-1455-4449-945d-3ee324b2a759 None glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1436e60c2e34e0b8af9ae1c668bdf03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:45:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb7d87f-1455-4449-945d-3ee324b2a759 None glance] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:45:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb7d87f-1455-4449-945d-3ee324b2a759 None glance] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:45:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb7d87f-1455-4449-945d-3ee324b2a759 None glance] PATH_INFO: `/v3/endpoints/13c57d94d28f4be896335eeb1e8b02ca` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:45:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb7d87f-1455-4449-945d-3ee324b2a759 None glance] RBAC: Authorizing `identity:get_endpoint(endpoint_id=13c57d94d28f4be896335eeb1e8b02ca)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:45:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb7d87f-1455-4449-945d-3ee324b2a759 None glance] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:45:03 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 504/994] 10.27.203.238 () {60 vars in 1307 bytes} [Tue May 28 12:45:03 2024] GET /identity/v3/endpoints/13c57d94d28f4be896335eeb1e8b02ca => generated 331 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:45:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70b3a9a-4511-4d9c-87c2-9c6802c4c1e2 None glance] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:45:04 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70b3a9a-4511-4d9c-87c2-9c6802c4c1e2 None glance] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:45:04 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb29d20-d533-41c4-b00e-7ed4cd4e5d63 None glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1436e60c2e34e0b8af9ae1c668bdf03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:45:04 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb29d20-d533-41c4-b00e-7ed4cd4e5d63 None glance] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:45:04 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb29d20-d533-41c4-b00e-7ed4cd4e5d63 None glance] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:45:04 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb29d20-d533-41c4-b00e-7ed4cd4e5d63 None glance] PATH_INFO: `/v3/limits` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:45:04 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb29d20-d533-41c4-b00e-7ed4cd4e5d63 None glance] RBAC: Adding query filter params (service_id=b5d296eb68964f14a9e57eb9d15e174d, region_id=RegionOne, resource_name=image_size_total, project_id=ea8d517cde1d40bb82c97e080ce071f7) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:45:04 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb29d20-d533-41c4-b00e-7ed4cd4e5d63 None glance] RBAC: Authorizing `identity:list_limits()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:45:04 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb29d20-d533-41c4-b00e-7ed4cd4e5d63 None glance] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:45:04 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 491/995] 10.27.203.238 () {60 vars in 1489 bytes} [Tue May 28 12:45:03 2024] GET /identity/v3/limits?service_id=b5d296eb68964f14a9e57eb9d15e174d®ion_id=RegionOne&resource_name=image_size_total&project_id=ea8d517cde1d40bb82c97e080ce071f7 => generated 248 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:45:04 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb7d87f-1455-4449-945d-3ee324b2a759 None glance] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:45:04 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb7d87f-1455-4449-945d-3ee324b2a759 None glance] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:45:04 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edac60cb-df55-4fe0-8f82-56c4dd8718dd None glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1436e60c2e34e0b8af9ae1c668bdf03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:45:04 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edac60cb-df55-4fe0-8f82-56c4dd8718dd None glance] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:45:04 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edac60cb-df55-4fe0-8f82-56c4dd8718dd None glance] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:45:04 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edac60cb-df55-4fe0-8f82-56c4dd8718dd None glance] PATH_INFO: `/v3/registered_limits` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:45:04 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edac60cb-df55-4fe0-8f82-56c4dd8718dd None glance] RBAC: Adding query filter params (service_id=b5d296eb68964f14a9e57eb9d15e174d, region_id=RegionOne, resource_name=image_size_total) {{(pid=51267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:45:04 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edac60cb-df55-4fe0-8f82-56c4dd8718dd None glance] RBAC: Authorizing `identity:list_registered_limits()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:45:04 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edac60cb-df55-4fe0-8f82-56c4dd8718dd None glance] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:45:04 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 505/996] 10.27.203.238 () {60 vars in 1434 bytes} [Tue May 28 12:45:04 2024] GET /identity/v3/registered_limits?service_id=b5d296eb68964f14a9e57eb9d15e174d®ion_id=RegionOne&resource_name=image_size_total => generated 531 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:45:04 l75lg1-v1 devstack@g-api.service[86374]: INFO glance.api.v2.image_data [None req-a612c2c5-bdab-4a55-8f6b-1d81426dfcbd admin admin] Unable to create trust: no such option collect_timing in group [keystone_authtoken] Use the existing user token. May 28 12:45:04 l75lg1-v1 dstat.sh[49771]: 28-05 12:45:04| 10 1 88 0 0|4575M 4854M 268M 6000M| 13k 42B| 0 568k| 0 63.0 |4203 7470 |2.14 1.91 1.33|1.0 1.0 1.0| 0 0 | 0 2048M| 27 276 0 23 0 May 28 12:45:04 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb29d20-d533-41c4-b00e-7ed4cd4e5d63 None glance] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:45:04 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb29d20-d533-41c4-b00e-7ed4cd4e5d63 None glance] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:45:04 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e876652-07de-4db3-8dc4-a2f72756fbe3 None glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1436e60c2e34e0b8af9ae1c668bdf03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:45:04 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e876652-07de-4db3-8dc4-a2f72756fbe3 None glance] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:45:04 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e876652-07de-4db3-8dc4-a2f72756fbe3 None glance] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:45:04 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e876652-07de-4db3-8dc4-a2f72756fbe3 None glance] PATH_INFO: `/v3/limits/model` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:45:04 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e876652-07de-4db3-8dc4-a2f72756fbe3 None glance] RBAC: Authorizing `identity:get_limit_model()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:45:04 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e876652-07de-4db3-8dc4-a2f72756fbe3 None glance] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:45:04 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 492/997] 10.27.203.238 () {60 vars in 1217 bytes} [Tue May 28 12:45:04 2024] GET /identity/v3/limits/model => generated 131 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:45:04 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edac60cb-df55-4fe0-8f82-56c4dd8718dd None glance] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:45:04 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edac60cb-df55-4fe0-8f82-56c4dd8718dd None glance] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:45:04 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4254e5-726b-4c5f-8a49-5fef494a1a5b None glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1436e60c2e34e0b8af9ae1c668bdf03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:45:04 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4254e5-726b-4c5f-8a49-5fef494a1a5b None glance] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:45:04 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4254e5-726b-4c5f-8a49-5fef494a1a5b None glance] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:45:04 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4254e5-726b-4c5f-8a49-5fef494a1a5b None glance] PATH_INFO: `/v3/endpoints/13c57d94d28f4be896335eeb1e8b02ca` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:45:04 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4254e5-726b-4c5f-8a49-5fef494a1a5b None glance] RBAC: Authorizing `identity:get_endpoint(endpoint_id=13c57d94d28f4be896335eeb1e8b02ca)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:45:04 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4254e5-726b-4c5f-8a49-5fef494a1a5b None glance] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:45:04 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 506/998] 10.27.203.238 () {60 vars in 1307 bytes} [Tue May 28 12:45:04 2024] GET /identity/v3/endpoints/13c57d94d28f4be896335eeb1e8b02ca => generated 331 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:45:04 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e876652-07de-4db3-8dc4-a2f72756fbe3 None glance] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:45:04 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e876652-07de-4db3-8dc4-a2f72756fbe3 None glance] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:45:04 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ab47fd-62a5-4aa5-a47a-d85bbda20e93 None glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1436e60c2e34e0b8af9ae1c668bdf03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:45:04 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ab47fd-62a5-4aa5-a47a-d85bbda20e93 None glance] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:45:04 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ab47fd-62a5-4aa5-a47a-d85bbda20e93 None glance] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:45:04 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ab47fd-62a5-4aa5-a47a-d85bbda20e93 None glance] PATH_INFO: `/v3/limits` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:45:04 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ab47fd-62a5-4aa5-a47a-d85bbda20e93 None glance] RBAC: Adding query filter params (service_id=b5d296eb68964f14a9e57eb9d15e174d, region_id=RegionOne, resource_name=image_count_uploading, project_id=ea8d517cde1d40bb82c97e080ce071f7) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:45:04 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ab47fd-62a5-4aa5-a47a-d85bbda20e93 None glance] RBAC: Authorizing `identity:list_limits()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:45:04 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ab47fd-62a5-4aa5-a47a-d85bbda20e93 None glance] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:45:04 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 493/999] 10.27.203.238 () {60 vars in 1499 bytes} [Tue May 28 12:45:04 2024] GET /identity/v3/limits?service_id=b5d296eb68964f14a9e57eb9d15e174d®ion_id=RegionOne&resource_name=image_count_uploading&project_id=ea8d517cde1d40bb82c97e080ce071f7 => generated 253 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:45:04 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4254e5-726b-4c5f-8a49-5fef494a1a5b None glance] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:45:04 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4254e5-726b-4c5f-8a49-5fef494a1a5b None glance] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:45:04 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39084a93-507e-4e55-8328-7b2358bbf894 None glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1436e60c2e34e0b8af9ae1c668bdf03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:45:04 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39084a93-507e-4e55-8328-7b2358bbf894 None glance] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:45:04 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39084a93-507e-4e55-8328-7b2358bbf894 None glance] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:45:04 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39084a93-507e-4e55-8328-7b2358bbf894 None glance] PATH_INFO: `/v3/registered_limits` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:45:04 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39084a93-507e-4e55-8328-7b2358bbf894 None glance] RBAC: Adding query filter params (service_id=b5d296eb68964f14a9e57eb9d15e174d, region_id=RegionOne, resource_name=image_count_uploading) {{(pid=51267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:45:04 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39084a93-507e-4e55-8328-7b2358bbf894 None glance] RBAC: Authorizing `identity:list_registered_limits()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:45:04 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39084a93-507e-4e55-8328-7b2358bbf894 None glance] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:45:04 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 507/1000] 10.27.203.238 () {60 vars in 1444 bytes} [Tue May 28 12:45:04 2024] GET /identity/v3/registered_limits?service_id=b5d296eb68964f14a9e57eb9d15e174d®ion_id=RegionOne&resource_name=image_count_uploading => generated 540 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:45:04 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.location [None req-a612c2c5-bdab-4a55-8f6b-1d81426dfcbd admin admin] Enabling in-flight format inspection for qcow2 {{(pid=86374) set_data /opt/stack/glance/glance/location.py:581}} May 28 12:45:04 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance_store._drivers.filesystem [None req-a612c2c5-bdab-4a55-8f6b-1d81426dfcbd admin admin] Wrote 21430272 bytes to /opt/stack/data/glance/images/e858734c-ca0f-45cb-b278-37dcfb0db7c6 with checksum c8fc807773e5354afe61636071771906 and multihash 1103b92ce8ad966e41235a4de260deb791ff571670c0342666c8582fbb9caefe6af07ebb11d34f44f8414b609b29c1bdf1d72ffa6faa39c88e8721d09847952b {{(pid=86374) add /opt/stack/data/venv/lib/python3.10/site-packages/glance_store/_drivers/filesystem.py:773}} May 28 12:45:04 l75lg1-v1 devstack@g-api.service[86374]: INFO glance.location [None req-a612c2c5-bdab-4a55-8f6b-1d81426dfcbd admin admin] Image format matched and virtual size computed: 117440512 May 28 12:45:04 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance_store.backend [None req-a612c2c5-bdab-4a55-8f6b-1d81426dfcbd admin admin] Skipping store.set_acls... not implemented. {{(pid=86374) set_acls /opt/stack/data/venv/lib/python3.10/site-packages/glance_store/backend.py:508}} May 28 12:45:04 l75lg1-v1 devstack@g-api.service[86374]: [pid: 86374|app: 0|req: 3/4] 127.0.0.1 () {40 vars in 865 bytes} [Tue May 28 12:45:03 2024] PUT /v2/images/e858734c-ca0f-45cb-b278-37dcfb0db7c6/file => generated 0 bytes in 1067 msecs (HTTP/1.1 204) 4 headers in 171 bytes (1 switches on core 0) May 28 12:45:05 l75lg1-v1 dstat.sh[49771]: 28-05 12:45:05| 9 3 87 0 0|4511M 4897M 268M 6020M| 21k 20k| 0 1908k| 0 300 |4306 6447 |2.14 1.91 1.33|1.0 0 133| 0 0 | 0 2048M| 27 274 0 24 0 May 28 12:45:06 l75lg1-v1 dstat.sh[49771]: 28-05 12:45:06| 9 2 89 0 0|4559M 4849M 268M 6020M| 15k 1238B| 0 364k| 0 19.0 |1797 2384 |2.14 1.91 1.33|1.0 0 8.0| 0 0 | 0 2048M| 27 274 0 24 0 May 28 12:45:07 l75lg1-v1 dstat.sh[49771]: 28-05 12:45:07| 8 2 88 1 0|4518M 4843M 268M 6062M|9931B 912B| 0 4380k| 0 90.0 |1837 2673 |2.04 1.89 1.33|1.0 0 5.0| 0 0 | 0 2048M| 27 274 0 24 0 May 28 12:45:07 l75lg1-v1 nova-conductor[83648]: DEBUG dbcounter [-] [83648] Writing DB stats nova_cell1:SELECT=8,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=83648) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:45:08 l75lg1-v1 dstat.sh[49771]: 28-05 12:45:08| 10 1 89 0 0|4566M 4795M 268M 6062M| 17k 970B| 0 4400k| 0 302 |1867 2434 |2.04 1.89 1.33|2.0 0 3.0| 0 0 | 0 2048M| 27 276 0 23 0 May 28 12:45:09 l75lg1-v1 dstat.sh[49771]: 28-05 12:45:09| 10 2 88 0 0|4584M 4774M 268M 6065M| 13k 172B| 0 4099B| 0 1.00 | 12k 23k|2.04 1.89 1.33|2.0 0 4.0| 0 0 | 0 2048M| 27 276 0 24 0 May 28 12:45:09 l75lg1-v1 nova-conductor[83647]: DEBUG dbcounter [-] [83647] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=6,nova_cell1:UPDATE=3 {{(pid=83647) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:45:09 l75lg1-v1 nova-conductor[83648]: DEBUG dbcounter [-] [83648] Writing DB stats nova_cell1:SELECT=8,nova_cell1:INSERT=1 {{(pid=83648) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:45:10 l75lg1-v1 dstat.sh[49771]: 28-05 12:45:10| 10 1 88 0 0|4592M 4765M 268M 6065M| 14k 42B| 0 863k| 0 49.0 |1966 2846 |2.04 1.89 1.33|1.0 0 0| 0 0 | 0 2048M| 27 276 0 24 0 May 28 12:45:10 l75lg1-v1 neutron-server[77618]: DEBUG dbcounter [-] [77618] Writing DB stats neutron:UPDATE=1 {{(pid=77618) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:45:10 l75lg1-v1 neutron-server[77618]: DEBUG dbcounter [-] [77618] Writing DB stats neutron:SELECT=1 {{(pid=77618) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:45:10 l75lg1-v1 cinder-scheduler[85128]: DEBUG dbcounter [-] [85128] Writing DB stats cinder:SELECT=1 {{(pid=85128) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:45:11 l75lg1-v1 dstat.sh[49771]: 28-05 12:45:11| 8 2 89 0 0|4596M 4762M 268M 6065M| 13k 0 | 0 124k| 0 18.0 |1708 2453 |2.04 1.89 1.33|1.0 0 0| 0 0 | 0 2048M| 27 276 0 24 0 May 28 12:45:11 l75lg1-v1 neutron-server[77623]: DEBUG dbcounter [-] [77623] Writing DB stats neutron:SELECT=1 {{(pid=77623) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:45:11 l75lg1-v1 neutron-server[77623]: DEBUG dbcounter [-] [77623] Writing DB stats neutron:SELECT=2 {{(pid=77623) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:45:12 l75lg1-v1 dstat.sh[49771]: 28-05 12:45:12| 9 2 89 0 0|4601M 4756M 268M 6065M| 20k 0 | 0 64k| 0 8.00 |3801 6403 |1.96 1.88 1.33|1.0 0 2.0| 0 0 | 0 2048M| 27 276 0 24 0 May 28 12:45:12 l75lg1-v1 cinder-volume[85846]: DEBUG dbcounter [-] [85846] Writing DB stats cinder:SELECT=4 {{(pid=85846) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:45:12 l75lg1-v1 cinder-volume[85846]: DEBUG dbcounter [-] [85846] Writing DB stats cinder:SELECT=9,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=85846) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:45:13 l75lg1-v1 dstat.sh[49771]: 28-05 12:45:13| 9 1 89 0 0|4602M 4756M 268M 6065M| 11k 42B| 0 108k| 0 17.0 |1623 2282 |1.96 1.88 1.33|1.0 0 2.0| 0 0 | 0 2048M| 27 280 0 24 0 May 28 12:45:13 l75lg1-v1 neutron-server[77623]: DEBUG neutron.db.agents_db [None req-fe40ce8c-640e-4db7-a17a-6e8888cce266 None None] Agent healthcheck: found 0 active agents {{(pid=77623) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:319}} May 28 12:45:13 l75lg1-v1 devstack@g-api.service[86373]: DEBUG dbcounter [-] [86373] Writing DB stats glance:INSERT=9,glance:SELECT=5 {{(pid=86373) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:45:14 l75lg1-v1 dstat.sh[49771]: 28-05 12:45:14| 9 2 89 0 0|4602M 4756M 268M 6065M| 14k 0 | 0 88k| 0 8.00 |1600 2256 |1.96 1.88 1.33|1.0 0 1.0| 0 0 | 0 2048M| 27 282 0 23 0 May 28 12:45:14 l75lg1-v1 devstack@keystone.service[51266]: DEBUG dbcounter [-] [51266] Writing DB stats keystone:SELECT=230 {{(pid=51266) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:45:14 l75lg1-v1 devstack@keystone.service[51267]: DEBUG dbcounter [-] [51267] Writing DB stats keystone:SELECT=234 {{(pid=51267) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:45:14 l75lg1-v1 devstack@g-api.service[86374]: DEBUG dbcounter [-] [86374] Writing DB stats glance:INSERT=5,glance:SELECT=18,glance:UPDATE=2 {{(pid=86374) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:45:15 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.periodic_task [None req-004643cc-598d-4cdf-90a2-9860c40bfd3f None None] Running periodic task SchedulerManager._clean_expired_messages {{(pid=85128) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:45:15 l75lg1-v1 cinder-scheduler[85128]: INFO cinder.message.api [None req-004643cc-598d-4cdf-90a2-9860c40bfd3f None None] Deleted 0 expired messages. May 28 12:45:15 l75lg1-v1 cinder-scheduler[85128]: DEBUG oslo_service.periodic_task [None req-004643cc-598d-4cdf-90a2-9860c40bfd3f None None] Running periodic task SchedulerManager._clean_expired_reservation {{(pid=85128) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:45:15 l75lg1-v1 dstat.sh[49771]: 28-05 12:45:15| 9 2 88 0 0|4603M 4755M 268M 6065M| 17k 0 | 0 528k| 0 57.0 |2149 3325 |1.96 1.88 1.33|1.0 0 2.0| 0 0 | 0 2048M| 27 284 0 23 0 May 28 12:45:16 l75lg1-v1 dstat.sh[49771]: 28-05 12:45:16| 8 2 89 0 0|4603M 4755M 268M 6065M| 12k 0 | 0 3036k| 0 59.0 |1576 2401 |1.96 1.88 1.33|3.0 0 0| 0 0 | 0 2048M| 27 284 0 23 0 May 28 12:45:17 l75lg1-v1 dstat.sh[49771]: 28-05 12:45:17| 10 0 89 0 0|4603M 4755M 268M 6065M| 12k 172B| 0 388k| 0 18.0 |1426 2006 |1.88 1.86 1.33|2.0 0 0| 0 0 | 0 2048M| 27 284 0 23 0 May 28 12:45:18 l75lg1-v1 dstat.sh[49771]: 28-05 12:45:18| 10 0 89 0 0|4605M 4752M 268M 6065M| 15k 0 | 0 4096B| 0 1.00 |1415 2008 |1.88 1.86 1.33|1.0 0 2.0| 0 0 | 0 2048M| 27 284 0 22 0 May 28 12:45:19 l75lg1-v1 dstat.sh[49771]: 28-05 12:45:19| 10 0 89 0 0|4607M 4750M 268M 6065M| 13k 0 | 0 0 | 0 0 |1421 1953 |1.88 1.86 1.33|1.0 0 0| 0 0 | 0 2048M| 27 284 0 22 0 May 28 12:45:19 l75lg1-v1 nova-conductor[83647]: DEBUG dbcounter [-] [83647] Writing DB stats nova_cell1:SELECT=1,nova_cell1:UPDATE=1 {{(pid=83647) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:45:19 l75lg1-v1 nova-conductor[83648]: DEBUG dbcounter [-] [83648] Writing DB stats nova_cell1:SELECT=1 {{(pid=83648) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:45:20 l75lg1-v1 dstat.sh[49771]: 28-05 12:45:20| 10 2 88 0 0|4498M 4859M 268M 6066M| 13k 1914B| 0 392k| 0 45.0 |2902 3887 |1.88 1.86 1.33|6.0 0 46| 0 0 | 0 2048M| 27 284 0 22 0 May 28 12:45:21 l75lg1-v1 dstat.sh[49771]: 28-05 12:45:21| 13 3 85 0 0|4543M 4814M 268M 6066M| 20k 14k| 0 260k| 0 13.0 |2713 3544 |1.88 1.86 1.33|1.0 0 241| 0 0 | 0 2048M| 27 284 0 22 0 May 28 12:45:22 l75lg1-v1 dstat.sh[49771]: 28-05 12:45:22| 6 5 88 0 0|4515M 4842M 268M 6066M| 30k 23k| 0 4096B| 0 1.00 |3762 4202 |1.81 1.85 1.33|1.0 0 269| 0 0 | 0 2048M| 27 284 0 21 0 May 28 12:45:23 l75lg1-v1 dstat.sh[49771]: 28-05 12:45:23| 10 1 88 1 0|4557M 4800M 268M 6066M| 16k 0 | 0 15M| 0 370 |1672 2221 |1.81 1.85 1.33|1.0 0 0| 0 0 | 0 2048M| 27 284 0 21 0 May 28 12:45:23 l75lg1-v1 neutron-server[77623]: DEBUG dbcounter [-] [77623] Writing DB stats neutron:SELECT=1 {{(pid=77623) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:45:23 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755e72a0-75c0-452e-8e92-1b6f86829bc3 None None] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:45:23 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755e72a0-75c0-452e-8e92-1b6f86829bc3 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:45:23 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755e72a0-75c0-452e-8e92-1b6f86829bc3 None None] PATH_INFO: `/` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:45:23 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 494/1001] 10.27.203.238 () {58 vars in 1014 bytes} [Tue May 28 12:45:23 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:45:23 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63202130-d4fb-4058-bc44-f8c64035261d None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:45:23 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63202130-d4fb-4058-bc44-f8c64035261d None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:45:23 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63202130-d4fb-4058-bc44-f8c64035261d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:45:23 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-63202130-d4fb-4058-bc44-f8c64035261d None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:45:23 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-63202130-d4fb-4058-bc44-f8c64035261d None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:45:23 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-63202130-d4fb-4058-bc44-f8c64035261d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:45:23 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 508/1002] 10.27.203.238 () {62 vars in 1111 bytes} [Tue May 28 12:45:23 2024] POST /identity/v3/auth/tokens => generated 3991 bytes in 25 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:45:23 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi [None req-01935d90-cea8-4366-8c58-d36e228c38f3 admin admin] Calling method '>' {{(pid=74000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} May 28 12:45:23 l75lg1-v1 devstack@n-api.service[74000]: INFO nova.api.openstack.requestlog [None req-01935d90-cea8-4366-8c58-d36e228c38f3 admin admin] 10.27.203.238 "GET /compute/v2.1" status: 200 len: 390 microversion: 2.1 time: 0.001565 May 28 12:45:23 l75lg1-v1 devstack@n-api.service[74000]: [pid: 74000|app: 0|req: 19/36] 10.27.203.238 () {58 vars in 1013 bytes} [Tue May 28 12:45:23 2024] GET /compute/v2.1 => generated 390 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 12:45:23 l75lg1-v1 devstack@n-api.service[73999]: DEBUG dbcounter [-] [73999] Writing DB stats nova_api:SELECT=21,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=73999) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:45:23 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755e72a0-75c0-452e-8e92-1b6f86829bc3 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:45:23 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755e72a0-75c0-452e-8e92-1b6f86829bc3 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:45:23 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824213d5-6fad-4c03-9206-200557f80f7a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'befdd4414dc2432ab2baa1ae3fbffef7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'manager', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:45:23 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824213d5-6fad-4c03-9206-200557f80f7a service nova] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:45:23 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824213d5-6fad-4c03-9206-200557f80f7a service nova] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:45:23 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824213d5-6fad-4c03-9206-200557f80f7a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:45:23 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824213d5-6fad-4c03-9206-200557f80f7a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:45:23 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824213d5-6fad-4c03-9206-200557f80f7a service nova] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:45:23 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 495/1003] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 12:45:23 2024] GET /identity/v3/auth/tokens => generated 3991 bytes in 21 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 12:45:23 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi [None req-49c4168a-8dbf-48f0-8d37-9284415eccc2 admin admin] Calling method '>' {{(pid=73999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} May 28 12:45:23 l75lg1-v1 devstack@n-api.service[73999]: INFO nova.api.openstack.requestlog [None req-49c4168a-8dbf-48f0-8d37-9284415eccc2 admin admin] 10.27.203.238 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4242 microversion: 2.61 time: 0.042653 May 28 12:45:23 l75lg1-v1 devstack@n-api.service[73999]: [pid: 73999|app: 0|req: 18/37] 10.27.203.238 () {64 vars in 1374 bytes} [Tue May 28 12:45:23 2024] GET /compute/v2.1/flavors/detail?is_public=True => generated 4242 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 12:45:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "_check_child_processes" by "neutron.agent.linux.external_process.ProcessMonitor._check_child_processes" {{(pid=76818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:45:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_concurrency.lockutils [-] Lock "_check_child_processes" acquired by "neutron.agent.linux.external_process.ProcessMonitor._check_child_processes" :: waited 0.000s {{(pid=76818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:45:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_concurrency.lockutils [-] Lock "_check_child_processes" "released" by "neutron.agent.linux.external_process.ProcessMonitor._check_child_processes" :: held 0.000s {{(pid=76818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:45:24 l75lg1-v1 dstat.sh[49771]: 28-05 12:45:24| 12 1 86 0 0|4504M 4853M 268M 6066M| 15k 1734B| 0 632k| 0 21.0 |3122 4467 |1.81 1.85 1.33|1.0 0 70| 0 0 | 0 2048M| 27 284 0 20 0 May 28 12:45:25 l75lg1-v1 cinder-scheduler[85128]: DEBUG dbcounter [-] [85128] Writing DB stats cinder:DELETE=1,cinder:SELECT=1 {{(pid=85128) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:45:25 l75lg1-v1 dstat.sh[49771]: 28-05 12:45:25| 9 1 89 0 0|4550M 4806M 268M 6066M| 25k 172B| 0 284k| 0 35.0 |1994 2690 |1.81 1.85 1.33|1.0 0 0| 0 0 | 0 2048M| 27 284 0 20 0 May 28 12:45:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc73a2d-b975-45c8-acc7-bbbbd02dd640 None None] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:45:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc73a2d-b975-45c8-acc7-bbbbd02dd640 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:45:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc73a2d-b975-45c8-acc7-bbbbd02dd640 None None] PATH_INFO: `/` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:45:25 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 509/1004] 10.27.203.238 () {58 vars in 1014 bytes} [Tue May 28 12:45:25 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (2 switches on core 0) May 28 12:45:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6597ffd-3496-4197-8d07-c6baf82dc374 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:45:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6597ffd-3496-4197-8d07-c6baf82dc374 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:45:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6597ffd-3496-4197-8d07-c6baf82dc374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:45:25 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-e6597ffd-3496-4197-8d07-c6baf82dc374 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:45:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-e6597ffd-3496-4197-8d07-c6baf82dc374 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:45:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-e6597ffd-3496-4197-8d07-c6baf82dc374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:45:25 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 496/1005] 10.27.203.238 () {62 vars in 1111 bytes} [Tue May 28 12:45:25 2024] POST /identity/v3/auth/tokens => generated 3991 bytes in 24 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:45:25 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi [None req-01935d90-cea8-4366-8c58-d36e228c38f3 admin admin] Calling method '>' {{(pid=74000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} May 28 12:45:25 l75lg1-v1 devstack@n-api.service[74000]: INFO nova.api.openstack.requestlog [None req-01935d90-cea8-4366-8c58-d36e228c38f3 admin admin] 10.27.203.238 "GET /compute/v2.1" status: 200 len: 390 microversion: 2.1 time: 0.001276 May 28 12:45:25 l75lg1-v1 devstack@n-api.service[74000]: [pid: 74000|app: 0|req: 20/38] 10.27.203.238 () {58 vars in 1013 bytes} [Tue May 28 12:45:25 2024] GET /compute/v2.1 => generated 390 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 12:45:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc73a2d-b975-45c8-acc7-bbbbd02dd640 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:45:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc73a2d-b975-45c8-acc7-bbbbd02dd640 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:45:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ca4722-73bc-43d5-b67e-1973c8e0122f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'befdd4414dc2432ab2baa1ae3fbffef7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'manager', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:45:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ca4722-73bc-43d5-b67e-1973c8e0122f service nova] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:45:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ca4722-73bc-43d5-b67e-1973c8e0122f service nova] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:45:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ca4722-73bc-43d5-b67e-1973c8e0122f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:45:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ca4722-73bc-43d5-b67e-1973c8e0122f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:45:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ca4722-73bc-43d5-b67e-1973c8e0122f service nova] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:45:25 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 510/1006] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 12:45:25 2024] GET /identity/v3/auth/tokens => generated 3991 bytes in 31 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 12:45:25 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi [None req-fe4dbe66-5257-4fc6-8223-668fb1643639 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "disk": 5, "name": "manila-service-flavor", "rxtx_factor": 1.0, "ram": 512, "os-flavor-access:is_public": true, "id": "100", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=73999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:518}} May 28 12:45:25 l75lg1-v1 devstack@n-api.service[73999]: INFO nova.api.openstack.requestlog [None req-fe4dbe66-5257-4fc6-8223-668fb1643639 admin admin] 10.27.203.238 "POST /compute/v2.1/flavors" status: 200 len: 426 microversion: 2.61 time: 0.082326 May 28 12:45:25 l75lg1-v1 devstack@n-api.service[73999]: [pid: 73999|app: 0|req: 19/39] 10.27.203.238 () {68 vars in 1365 bytes} [Tue May 28 12:45:25 2024] POST /compute/v2.1/flavors => generated 426 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 12:45:26 l75lg1-v1 dstat.sh[49771]: 28-05 12:45:26| 9 2 89 0 0|4519M 4837M 268M 6066M| 16k 3388B| 0 1636k| 0 298 |2456 3195 |1.81 1.85 1.33|1.0 0 32| 0 0 | 0 2048M| 27 284 0 20 0 May 28 12:45:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c0bfe6-0f0b-44e1-a23d-1d52b90c33b9 None None] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:45:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c0bfe6-0f0b-44e1-a23d-1d52b90c33b9 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:45:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c0bfe6-0f0b-44e1-a23d-1d52b90c33b9 None None] PATH_INFO: `/` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:45:27 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 497/1007] 10.27.203.238 () {58 vars in 1014 bytes} [Tue May 28 12:45:27 2024] GET /identity => generated 272 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:45:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bced0e-ac6e-49cb-9c7b-19da9ea7c840 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:45:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bced0e-ac6e-49cb-9c7b-19da9ea7c840 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:45:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bced0e-ac6e-49cb-9c7b-19da9ea7c840 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:45:27 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-30bced0e-ac6e-49cb-9c7b-19da9ea7c840 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:45:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-30bced0e-ac6e-49cb-9c7b-19da9ea7c840 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:45:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-30bced0e-ac6e-49cb-9c7b-19da9ea7c840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:45:27 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 511/1008] 10.27.203.238 () {62 vars in 1111 bytes} [Tue May 28 12:45:27 2024] POST /identity/v3/auth/tokens => generated 3991 bytes in 23 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:45:27 l75lg1-v1 dstat.sh[49771]: 28-05 12:45:27| 10 1 89 0 0|4557M 4800M 268M 6066M| 16k 0 | 0 184k| 0 14.0 |1720 2325 |1.75 1.84 1.32|1.0 0 0| 0 0 | 0 2048M| 27 284 0 20 0 May 28 12:45:27 l75lg1-v1 neutron-server[77619]: DEBUG neutron.wsgi [-] (77619) accepted ('10.27.203.238', 33786) {{(pid=77619) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 12:45:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c0bfe6-0f0b-44e1-a23d-1d52b90c33b9 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:45:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c0bfe6-0f0b-44e1-a23d-1d52b90c33b9 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:45:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cae59b7-1266-431b-bf80-3e5fe6fcc0ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef17047035e4b518fd5360a01f2da1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:45:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cae59b7-1266-431b-bf80-3e5fe6fcc0ee service neutron] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:45:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cae59b7-1266-431b-bf80-3e5fe6fcc0ee service neutron] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:45:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cae59b7-1266-431b-bf80-3e5fe6fcc0ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:45:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cae59b7-1266-431b-bf80-3e5fe6fcc0ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:45:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cae59b7-1266-431b-bf80-3e5fe6fcc0ee service neutron] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:45:27 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 498/1009] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 12:45:27 2024] GET /identity/v3/auth/tokens => generated 3991 bytes in 22 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 12:45:27 l75lg1-v1 neutron-server[77619]: INFO neutron.wsgi [None req-27d282ab-c0fe-4e0d-af1b-80f38ce65702 admin admin] 10.27.203.238 "GET /networking/v2.0/security-groups?fields=id&fields=name&fields=description&fields=project_id&fields=tags HTTP/1.1" status: 200 len: 560 time: 0.1042778 May 28 12:45:28 l75lg1-v1 dstat.sh[49771]: 28-05 12:45:28| 10 1 88 0 0|4533M 4824M 268M 6066M| 13k 1314B| 0 11M| 0 130 |2137 2886 |1.75 1.84 1.32|3.0 1.0 28| 0 0 | 0 2048M| 27 284 0 22 0 May 28 12:45:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ddfb7c-f933-4a0d-b6a7-c6269be49688 None None] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:45:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ddfb7c-f933-4a0d-b6a7-c6269be49688 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:45:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ddfb7c-f933-4a0d-b6a7-c6269be49688 None None] PATH_INFO: `/` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:45:28 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 512/1010] 10.27.203.238 () {58 vars in 1014 bytes} [Tue May 28 12:45:28 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:45:28 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f375d9-dee5-414f-b6da-03478f5dd8c1 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:45:28 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f375d9-dee5-414f-b6da-03478f5dd8c1 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:45:28 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f375d9-dee5-414f-b6da-03478f5dd8c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:45:28 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-29f375d9-dee5-414f-b6da-03478f5dd8c1 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:45:28 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-29f375d9-dee5-414f-b6da-03478f5dd8c1 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:45:28 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-29f375d9-dee5-414f-b6da-03478f5dd8c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:45:28 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 499/1011] 10.27.203.238 () {62 vars in 1111 bytes} [Tue May 28 12:45:28 2024] POST /identity/v3/auth/tokens => generated 3991 bytes in 23 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:45:28 l75lg1-v1 neutron-server[77618]: DEBUG neutron.wsgi [-] (77618) accepted ('10.27.203.238', 33796) {{(pid=77618) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 12:45:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ddfb7c-f933-4a0d-b6a7-c6269be49688 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:45:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ddfb7c-f933-4a0d-b6a7-c6269be49688 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:45:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2610121e-ba7f-44a6-8de7-0b6758528a5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef17047035e4b518fd5360a01f2da1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:45:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2610121e-ba7f-44a6-8de7-0b6758528a5d service neutron] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:45:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2610121e-ba7f-44a6-8de7-0b6758528a5d service neutron] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:45:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2610121e-ba7f-44a6-8de7-0b6758528a5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:45:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2610121e-ba7f-44a6-8de7-0b6758528a5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:45:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2610121e-ba7f-44a6-8de7-0b6758528a5d service neutron] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:45:29 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 513/1012] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 12:45:29 2024] GET /identity/v3/auth/tokens => generated 3991 bytes in 23 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 12:45:29 l75lg1-v1 neutron-server[77618]: DEBUG neutron.api.v2.base [None req-ee81cb89-e494-479a-97ee-7b2ba8b6be19 admin admin] Request body: {'security_group': {'description': 'manila-service description', 'name': 'manila-service'}} {{(pid=77618) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:734}} May 28 12:45:29 l75lg1-v1 neutron-server[77618]: DEBUG neutron_lib.callbacks.manager [None req-ee81cb89-e494-479a-97ee-7b2ba8b6be19 admin admin] Publish callbacks [] for security_group (None), before_create {{(pid=77618) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:45:29 l75lg1-v1 neutron-server[77618]: DEBUG neutron_lib.callbacks.manager [None req-ee81cb89-e494-479a-97ee-7b2ba8b6be19 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver.OVNMechanismDriver._create_security_group_precommit-4094378'] for security_group (ca135474-48d5-4746-a063-2afb7533e575), precommit_create {{(pid=77618) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:45:29 l75lg1-v1 neutron-server[77618]: DEBUG neutron.db.ovn_revision_numbers_db [None req-ee81cb89-e494-479a-97ee-7b2ba8b6be19 admin admin] create_initial_revision uuid=ca135474-48d5-4746-a063-2afb7533e575, type=security_groups, rev=-1 {{(pid=77618) create_initial_revision /opt/stack/neutron/neutron/db/ovn_revision_numbers_db.py:108}} May 28 12:45:29 l75lg1-v1 neutron-server[77618]: DEBUG neutron_lib.callbacks.manager [None req-ee81cb89-e494-479a-97ee-7b2ba8b6be19 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver.OVNMechanismDriver._create_security_group-4094389', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4165855'] for security_group (ca135474-48d5-4746-a063-2afb7533e575), after_create {{(pid=77618) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:45:29 l75lg1-v1 neutron-server[77618]: DEBUG ovsdbapp.backend.ovs_idl.transaction [None req-c63b1acc-b5c6-4be8-9db9-04824fec27f2 None None] Running txn n=1 command(idx=0): PgAddCommand(_result=None, name=pg_ca135474_48d5_4746_a063_2afb7533e575, may_exist=False, columns={'acls': [], 'external_ids': {'neutron:security_group_id': 'ca135474-48d5-4746-a063-2afb7533e575'}}) {{(pid=77618) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:45:29 l75lg1-v1 neutron-server[77618]: DEBUG ovsdbapp.backend.ovs_idl.transaction [None req-c63b1acc-b5c6-4be8-9db9-04824fec27f2 None None] Running txn n=1 command(idx=1): PgAclAddCommand(_result=None, entity=pg_ca135474_48d5_4746_a063_2afb7533e575, direction=from-lport, priority=1002, match=inport == @pg_ca135474_48d5_4746_a063_2afb7533e575 && ip6, action=allow-related, log=False, may_exist=True, severity=[], name=[], meter=None, external_ids={'neutron:security_group_rule_id': '378b0043-49c6-4fa8-a8b0-88d5603baaac'}) {{(pid=77618) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:45:29 l75lg1-v1 neutron-server[77618]: DEBUG ovsdbapp.backend.ovs_idl.transaction [None req-c63b1acc-b5c6-4be8-9db9-04824fec27f2 None None] Running txn n=1 command(idx=2): PgAclAddCommand(_result=None, entity=pg_ca135474_48d5_4746_a063_2afb7533e575, direction=from-lport, priority=1002, match=inport == @pg_ca135474_48d5_4746_a063_2afb7533e575 && ip4, action=allow-related, log=False, may_exist=True, severity=[], name=[], meter=None, external_ids={'neutron:security_group_rule_id': 'aa6a2561-34b9-4f39-9bc5-ea99060d9df3'}) {{(pid=77618) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:45:29 l75lg1-v1 neutron-server[77621]: DEBUG neutron.common.ovn.hash_ring_manager [-] Hash Ring loaded. 2 active nodes. 0 offline nodes {{(pid=77621) _load_hash_ring /opt/stack/neutron/neutron/common/ovn/hash_ring_manager.py:99}} May 28 12:45:29 l75lg1-v1 neutron-server[77618]: DEBUG neutron.common.ovn.hash_ring_manager [None req-c63b1acc-b5c6-4be8-9db9-04824fec27f2 None None] Hash Ring loaded. 2 active nodes. 0 offline nodes {{(pid=77618) _load_hash_ring /opt/stack/neutron/neutron/common/ovn/hash_ring_manager.py:99}} May 28 12:45:29 l75lg1-v1 neutron-server[77619]: DEBUG neutron.common.ovn.hash_ring_manager [None req-53cecb61-7023-41e4-a5ea-23b1eb02606a None None] Hash Ring loaded. 2 active nodes. 0 offline nodes {{(pid=77619) _load_hash_ring /opt/stack/neutron/neutron/common/ovn/hash_ring_manager.py:99}} May 28 12:45:29 l75lg1-v1 neutron-server[77618]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-c63b1acc-b5c6-4be8-9db9-04824fec27f2 None None] Hash Ring: Node 4c6fc793-7f5a-456f-b4d6-6e5bd97592f2 (host: l75lg1-v1) handling event "create" for row 5c60168a-d6df-41ef-b13d-7b1ec331fb3d (table: ACL) {{(pid=77618) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:45:29 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-53cecb61-7023-41e4-a5ea-23b1eb02606a None None] Hash Ring: Node c89b3497-133e-4a5a-b67a-3310d2cb2485 (host: l75lg1-v1) handling event "create" for row 9914895c-20b9-4521-8fef-114c0a7f664c (table: ACL) {{(pid=77619) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:45:29 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-53cecb61-7023-41e4-a5ea-23b1eb02606a None None] Hash Ring: Node c89b3497-133e-4a5a-b67a-3310d2cb2485 (host: l75lg1-v1) handling event "create" for row ac525976-5c08-4f36-8fa8-52c01ba0315a (table: Port_Group) {{(pid=77619) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:45:29 l75lg1-v1 neutron-server[77618]: INFO neutron.db.ovn_revision_numbers_db [None req-ee81cb89-e494-479a-97ee-7b2ba8b6be19 admin admin] Successfully bumped revision number for resource ca135474-48d5-4746-a063-2afb7533e575 (type: security_groups) to 1 May 28 12:45:29 l75lg1-v1 neutron-server[77618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ee81cb89-e494-479a-97ee-7b2ba8b6be19 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ca135474-48d5-4746-a063-2afb7533e575,revision_number=1']} {{(pid=77618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 28 12:45:29 l75lg1-v1 neutron-server[77618]: DEBUG ovsdbapp.backend.ovs_idl.transaction [None req-c63b1acc-b5c6-4be8-9db9-04824fec27f2 None None] Running txn n=1 command(idx=0): CheckLivenessCommand(_result=None) {{(pid=77618) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:45:29 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-53cecb61-7023-41e4-a5ea-23b1eb02606a None None] Hash Ring: Node c89b3497-133e-4a5a-b67a-3310d2cb2485 (host: l75lg1-v1) handling event "update" for row 459958f3-26c0-486c-a7b4-0e57d78742d2 (table: NB_Global) {{(pid=77619) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:45:29 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-53cecb61-7023-41e4-a5ea-23b1eb02606a None None] Hash Ring: Node c89b3497-133e-4a5a-b67a-3310d2cb2485 (host: l75lg1-v1) handling event "update" for row 459958f3-26c0-486c-a7b4-0e57d78742d2 (table: NB_Global) {{(pid=77619) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:45:29 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched UPDATE: SbGlobalUpdateEvent(events=('update',), table='SB_Global', conditions=None, old_conditions=None), priority=20 to row=SB_Global(ipsec=False, ssl=[], nb_cfg=2, external_ids={}, options={'lb_hairpin_use_ct_mark': 'true', 'mac_prefix': '6e:b3:c1', 'max_tunid': '16711680', 'northd_internal_version': '22.03.3-20.21.0-62.4', 'svc_monitor_mac': '6e:c0:93:26:20:eb', 'fdb_removal_limit': '0', 'ignore_lsp_down': 'false', 'mac_binding_removal_limit': '0'}) old=SB_Global(nb_cfg=1) {{(pid=76818) matches /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} May 28 12:45:29 l75lg1-v1 neutron-server[77618]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ee81cb89-e494-479a-97ee-7b2ba8b6be19 admin admin] Tracked resource versions report: May 28 12:45:29 l75lg1-v1 neutron-server[77618]: pushed versions: May 28 12:45:29 l75lg1-v1 neutron-server[77618]: { 'AddressGroup': {'1.2'}, May 28 12:45:29 l75lg1-v1 neutron-server[77618]: 'Agent': {'1.1'}, May 28 12:45:29 l75lg1-v1 neutron-server[77618]: 'ConntrackHelper': {'1.0'}, May 28 12:45:29 l75lg1-v1 neutron-server[77618]: 'LocalIPAssociation': {'1.0'}, May 28 12:45:29 l75lg1-v1 neutron-server[77618]: 'Log': {'1.0'}, May 28 12:45:29 l75lg1-v1 neutron-server[77618]: 'NDPProxy': {'1.0'}, May 28 12:45:29 l75lg1-v1 neutron-server[77618]: 'Network': {'1.1'}, May 28 12:45:29 l75lg1-v1 neutron-server[77618]: 'Port': {'1.9'}, May 28 12:45:29 l75lg1-v1 neutron-server[77618]: 'PortForwarding': {'1.3'}, May 28 12:45:29 l75lg1-v1 neutron-server[77618]: 'QosPolicy': {'1.10'}, May 28 12:45:29 l75lg1-v1 neutron-server[77618]: 'SecurityGroup': {'1.6'}, May 28 12:45:29 l75lg1-v1 neutron-server[77618]: 'SecurityGroupRule': {'1.3'}, May 28 12:45:29 l75lg1-v1 neutron-server[77618]: 'SubPort': {'1.0'}, May 28 12:45:29 l75lg1-v1 neutron-server[77618]: 'Subnet': {'1.1'}, May 28 12:45:29 l75lg1-v1 neutron-server[77618]: 'Trunk': {'1.1'}} May 28 12:45:29 l75lg1-v1 neutron-server[77618]: consumer versions: May 28 12:45:29 l75lg1-v1 neutron-server[77618]: {OVN Controller Gateway agent@l75lg1-v1: {}, OVN Metadata agent@l75lg1-v1: {}} May 28 12:45:29 l75lg1-v1 neutron-server[77618]: {{(pid=77618) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:178}} May 28 12:45:29 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-53cecb61-7023-41e4-a5ea-23b1eb02606a None None] Hash Ring: Node c89b3497-133e-4a5a-b67a-3310d2cb2485 (host: l75lg1-v1) handling event "update" for row 459958f3-26c0-486c-a7b4-0e57d78742d2 (table: NB_Global) {{(pid=77619) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:45:29 l75lg1-v1 neutron-server[77621]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [-] ChassisAgentWriteEvent : Matched Chassis_Private, update, None None {{(pid=77621) matches /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:65}} May 28 12:45:29 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-03b5f984-1478-4ad6-9838-8e34c1689c5b None None] ChassisAgentWriteEvent : Matched Chassis_Private, update, None None {{(pid=77619) matches /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:65}} May 28 12:45:29 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata.agent [-] Delaying updating chassis table for 4 seconds {{(pid=76818) run /opt/stack/neutron/neutron/agent/ovn/metadata/agent.py:364}} May 28 12:45:29 l75lg1-v1 neutron-server[77618]: DEBUG neutron_lib.callbacks.manager [None req-ee81cb89-e494-479a-97ee-7b2ba8b6be19 admin admin] Publish callbacks [] for security_group (None), before_response {{(pid=77618) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:45:29 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-53cecb61-7023-41e4-a5ea-23b1eb02606a None None] Hash Ring: Node c89b3497-133e-4a5a-b67a-3310d2cb2485 (host: l75lg1-v1) handling event "update" for row 459958f3-26c0-486c-a7b4-0e57d78742d2 (table: NB_Global) {{(pid=77619) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:45:29 l75lg1-v1 neutron-server[77618]: INFO neutron.wsgi [None req-ee81cb89-e494-479a-97ee-7b2ba8b6be19 admin admin] 10.27.203.238 "POST /networking/v2.0/security-groups HTTP/1.1" status: 201 len: 1840 time: 0.2054913 May 28 12:45:29 l75lg1-v1 neutron-server[77618]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-d9d4969c-e9ae-4d76-91b0-9b7c8eb907b3 None None] ChassisAgentWriteEvent : Matched Chassis_Private, update, None None {{(pid=77618) matches /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:65}} May 28 12:45:29 l75lg1-v1 neutron-server[77619]: DEBUG neutron.common.ovn.hash_ring_manager [None req-03b5f984-1478-4ad6-9838-8e34c1689c5b None None] Hash Ring loaded. 2 active nodes. 0 offline nodes {{(pid=77619) _load_hash_ring /opt/stack/neutron/neutron/common/ovn/hash_ring_manager.py:99}} May 28 12:45:29 l75lg1-v1 neutron-server[77621]: DEBUG neutron.common.ovn.hash_ring_manager [-] Hash Ring loaded. 2 active nodes. 0 offline nodes {{(pid=77621) _load_hash_ring /opt/stack/neutron/neutron/common/ovn/hash_ring_manager.py:99}} May 28 12:45:29 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-03b5f984-1478-4ad6-9838-8e34c1689c5b None None] Hash Ring: Node c89b3497-133e-4a5a-b67a-3310d2cb2485 (host: l75lg1-v1) handling event "update" for row 6ef07056-3e6a-44fb-b483-fdb6022e4e42 (table: Chassis_Private) {{(pid=77619) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:45:29 l75lg1-v1 neutron-server[77618]: DEBUG neutron.common.ovn.hash_ring_manager [None req-d9d4969c-e9ae-4d76-91b0-9b7c8eb907b3 None None] Hash Ring loaded. 2 active nodes. 0 offline nodes {{(pid=77618) _load_hash_ring /opt/stack/neutron/neutron/common/ovn/hash_ring_manager.py:99}} May 28 12:45:29 l75lg1-v1 dstat.sh[49771]: 28-05 12:45:29| 10 1 85 3 0|4560M 4796M 268M 6066M| 17k 0 | 0 43M| 0 452 |3376 4967 |1.75 1.84 1.32|3.0 0 0| 0 0 | 0 2048M| 27 284 0 24 0 May 28 12:45:29 l75lg1-v1 nova-conductor[83647]: DEBUG dbcounter [-] [83647] Writing DB stats nova_cell1:SELECT=1,nova_cell1:UPDATE=1 {{(pid=83647) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:45:29 l75lg1-v1 nova-conductor[83648]: DEBUG dbcounter [-] [83648] Writing DB stats nova_cell1:SELECT=1 {{(pid=83648) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:45:30 l75lg1-v1 dstat.sh[49771]: 28-05 12:45:30| 10 1 88 1 0|4541M 4815M 268M 6066M| 11k 3870B| 0 452k| 0 54.0 |2141 3139 |1.75 1.84 1.32|1.0 0 9.0| 0 0 | 0 2048M| 27 284 0 24 0 May 28 12:45:30 l75lg1-v1 neutron-server[77618]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.HashRingHealthCheckPeriodics.touch_hash_ring_nodes' {{(pid=77618) _process_scheduled /opt/stack/data/venv/lib/python3.10/site-packages/futurist/periodics.py:638}} May 28 12:45:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7885fae4-9b5a-48d4-8886-dd293e11040f None None] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:45:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7885fae4-9b5a-48d4-8886-dd293e11040f None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:45:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7885fae4-9b5a-48d4-8886-dd293e11040f None None] PATH_INFO: `/` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:45:30 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 500/1013] 10.27.203.238 () {58 vars in 1014 bytes} [Tue May 28 12:45:30 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:45:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3dd145-b19a-43e5-be41-341be3e0767b None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:45:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3dd145-b19a-43e5-be41-341be3e0767b None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:45:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3dd145-b19a-43e5-be41-341be3e0767b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:45:30 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-2b3dd145-b19a-43e5-be41-341be3e0767b None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:45:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-2b3dd145-b19a-43e5-be41-341be3e0767b None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:45:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-2b3dd145-b19a-43e5-be41-341be3e0767b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:45:30 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 514/1014] 10.27.203.238 () {62 vars in 1111 bytes} [Tue May 28 12:45:30 2024] POST /identity/v3/auth/tokens => generated 3991 bytes in 23 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:45:30 l75lg1-v1 neutron-server[77619]: DEBUG neutron.wsgi [-] (77619) accepted ('10.27.203.238', 41338) {{(pid=77619) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 12:45:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7885fae4-9b5a-48d4-8886-dd293e11040f None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:45:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7885fae4-9b5a-48d4-8886-dd293e11040f None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:45:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48cf23a-daf3-4a84-b81d-f8575bbc0f57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef17047035e4b518fd5360a01f2da1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:45:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48cf23a-daf3-4a84-b81d-f8575bbc0f57 service neutron] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:45:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48cf23a-daf3-4a84-b81d-f8575bbc0f57 service neutron] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:45:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48cf23a-daf3-4a84-b81d-f8575bbc0f57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:45:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48cf23a-daf3-4a84-b81d-f8575bbc0f57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:45:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48cf23a-daf3-4a84-b81d-f8575bbc0f57 service neutron] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:45:30 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 501/1015] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 12:45:30 2024] GET /identity/v3/auth/tokens => generated 3991 bytes in 19 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 12:45:30 l75lg1-v1 neutron-server[77619]: INFO neutron.wsgi [None req-0dbf8043-62ac-4cf6-9fed-baac366e44c4 admin admin] 10.27.203.238 "GET /networking/v2.0/security-groups?fields=id&fields=name&fields=description&fields=project_id&fields=tags HTTP/1.1" status: 200 len: 741 time: 0.1069288 May 28 12:45:31 l75lg1-v1 dstat.sh[49771]: 28-05 12:45:31| 10 1 88 0 0|4507M 4850M 268M 6066M| 14k 1306B| 0 1232k| 0 218 |2539 3388 |1.75 1.84 1.32|1.0 0 21| 0 0 | 0 2048M| 27 284 0 25 0 May 28 12:45:32 l75lg1-v1 dstat.sh[49771]: 28-05 12:45:32| 9 1 89 0 0|4554M 4802M 268M 6066M| 16k 0 | 0 0 | 0 0 |1473 2001 |1.69 1.82 1.32|3.0 0 0| 0 0 | 0 2048M| 27 284 0 25 0 May 28 12:45:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cded86a-dfd6-48ea-94b0-f0ade0f7d8b3 None None] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:45:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cded86a-dfd6-48ea-94b0-f0ade0f7d8b3 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:45:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cded86a-dfd6-48ea-94b0-f0ade0f7d8b3 None None] PATH_INFO: `/` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:45:32 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 515/1016] 10.27.203.238 () {58 vars in 1014 bytes} [Tue May 28 12:45:32 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:45:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b645663-3d9f-416c-a58f-ed89e6221d23 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:45:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b645663-3d9f-416c-a58f-ed89e6221d23 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:45:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b645663-3d9f-416c-a58f-ed89e6221d23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:45:32 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-4b645663-3d9f-416c-a58f-ed89e6221d23 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:45:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-4b645663-3d9f-416c-a58f-ed89e6221d23 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:45:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-4b645663-3d9f-416c-a58f-ed89e6221d23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:45:32 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 502/1017] 10.27.203.238 () {62 vars in 1111 bytes} [Tue May 28 12:45:32 2024] POST /identity/v3/auth/tokens => generated 3991 bytes in 23 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:45:32 l75lg1-v1 neutron-server[77618]: DEBUG neutron.wsgi [-] (77618) accepted ('10.27.203.238', 41350) {{(pid=77618) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 12:45:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cded86a-dfd6-48ea-94b0-f0ade0f7d8b3 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:45:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cded86a-dfd6-48ea-94b0-f0ade0f7d8b3 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:45:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6105909-3ddb-454a-a9eb-66c6d038d340 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef17047035e4b518fd5360a01f2da1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:45:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6105909-3ddb-454a-a9eb-66c6d038d340 service neutron] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:45:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6105909-3ddb-454a-a9eb-66c6d038d340 service neutron] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:45:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6105909-3ddb-454a-a9eb-66c6d038d340 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:45:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6105909-3ddb-454a-a9eb-66c6d038d340 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:45:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6105909-3ddb-454a-a9eb-66c6d038d340 service neutron] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:45:32 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 516/1018] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 12:45:32 2024] GET /identity/v3/auth/tokens => generated 3991 bytes in 20 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 12:45:32 l75lg1-v1 neutron-server[77618]: INFO neutron.api.v2.resource [None req-1e606935-7c68-4d8c-a213-c6370161d9ab admin admin] show failed (client error): The resource could not be found. May 28 12:45:32 l75lg1-v1 neutron-server[77618]: INFO neutron.wsgi [None req-1e606935-7c68-4d8c-a213-c6370161d9ab admin admin] 10.27.203.238 "GET /networking/v2.0/security-groups/manila-service HTTP/1.1" status: 404 len: 330 time: 0.0330300 May 28 12:45:32 l75lg1-v1 neutron-server[77618]: INFO neutron.wsgi [None req-e448c00f-d81e-450f-be45-9576248cd226 admin admin] 10.27.203.238 "GET /networking/v2.0/security-groups?name=manila-service HTTP/1.1" status: 200 len: 1838 time: 0.0373878 May 28 12:45:32 l75lg1-v1 neutron-server[77618]: INFO neutron.wsgi [None req-aeffc144-701a-486a-ae4f-ba0cff9186ea admin admin] 10.27.203.238 "GET /networking/v2.0/security-group-rules?security_group_id=ca135474-48d5-4746-a063-2afb7533e575 HTTP/1.1" status: 200 len: 1382 time: 0.0282667 May 28 12:45:33 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=Chassis_Private, record=0da8323f-64af-4526-b223-049f5737145a, col_values=(('external_ids', {'neutron:ovn-metadata-sb-cfg': '2'}),), if_exists=True) {{(pid=76818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:45:33 l75lg1-v1 neutron-server[77621]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [-] ChassisMetadataAgentWriteEvent : Matched Chassis_Private, update, None None {{(pid=77621) matches /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:65}} May 28 12:45:33 l75lg1-v1 neutron-server[77618]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-d9d4969c-e9ae-4d76-91b0-9b7c8eb907b3 None None] ChassisMetadataAgentWriteEvent : Matched Chassis_Private, update, None None {{(pid=77618) matches /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:65}} May 28 12:45:33 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-03b5f984-1478-4ad6-9838-8e34c1689c5b None None] ChassisMetadataAgentWriteEvent : Matched Chassis_Private, update, None None {{(pid=77619) matches /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:65}} May 28 12:45:33 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-03b5f984-1478-4ad6-9838-8e34c1689c5b None None] Hash Ring: Node c89b3497-133e-4a5a-b67a-3310d2cb2485 (host: l75lg1-v1) handling event "update" for row 6ef07056-3e6a-44fb-b483-fdb6022e4e42 (table: Chassis_Private) {{(pid=77619) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:45:33 l75lg1-v1 dstat.sh[49771]: 28-05 12:45:33| 9 1 89 0 0|4527M 4830M 268M 6066M| 12k 1461B| 0 20M| 0 24.0 |2161 2869 |1.69 1.82 1.32|1.0 0 20| 0 0 | 0 2048M| 27 284 0 26 0 May 28 12:45:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14bd2d0-39eb-4788-a140-e7e0f388a79c None None] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:45:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14bd2d0-39eb-4788-a140-e7e0f388a79c None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:45:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14bd2d0-39eb-4788-a140-e7e0f388a79c None None] PATH_INFO: `/` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:45:34 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 503/1019] 10.27.203.238 () {58 vars in 1014 bytes} [Tue May 28 12:45:34 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:45:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61de8ce8-a30d-4dae-a13c-a1af63c5197c None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:45:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61de8ce8-a30d-4dae-a13c-a1af63c5197c None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:45:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61de8ce8-a30d-4dae-a13c-a1af63c5197c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:45:34 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-61de8ce8-a30d-4dae-a13c-a1af63c5197c None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:45:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-61de8ce8-a30d-4dae-a13c-a1af63c5197c None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:45:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-61de8ce8-a30d-4dae-a13c-a1af63c5197c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:45:34 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 517/1020] 10.27.203.238 () {62 vars in 1111 bytes} [Tue May 28 12:45:34 2024] POST /identity/v3/auth/tokens => generated 3991 bytes in 22 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:45:34 l75lg1-v1 neutron-server[77619]: DEBUG neutron.wsgi [-] (77619) accepted ('10.27.203.238', 41360) {{(pid=77619) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 12:45:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14bd2d0-39eb-4788-a140-e7e0f388a79c None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:45:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14bd2d0-39eb-4788-a140-e7e0f388a79c None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:45:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8d0c79-f05e-4d1f-9dcf-a7bc47b57154 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef17047035e4b518fd5360a01f2da1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:45:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8d0c79-f05e-4d1f-9dcf-a7bc47b57154 service neutron] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:45:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8d0c79-f05e-4d1f-9dcf-a7bc47b57154 service neutron] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:45:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8d0c79-f05e-4d1f-9dcf-a7bc47b57154 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:45:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8d0c79-f05e-4d1f-9dcf-a7bc47b57154 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:45:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8d0c79-f05e-4d1f-9dcf-a7bc47b57154 service neutron] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:45:34 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 504/1021] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 12:45:34 2024] GET /identity/v3/auth/tokens => generated 3991 bytes in 20 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 12:45:34 l75lg1-v1 dstat.sh[49771]: 28-05 12:45:34| 10 1 89 0 0|4559M 4798M 268M 6066M| 14k 0 | 0 4095B| 0 1.00 |1772 2504 |1.69 1.82 1.32|1.0 0 0| 0 0 | 0 2048M| 27 286 0 26 0 May 28 12:45:34 l75lg1-v1 neutron-server[77619]: INFO neutron.api.v2.resource [None req-9cf880a0-b688-46e4-b5ed-b78ced539560 admin admin] show failed (client error): The resource could not be found. May 28 12:45:34 l75lg1-v1 neutron-server[77619]: INFO neutron.wsgi [None req-9cf880a0-b688-46e4-b5ed-b78ced539560 admin admin] 10.27.203.238 "GET /networking/v2.0/security-groups/manila-service HTTP/1.1" status: 404 len: 330 time: 0.0362725 May 28 12:45:34 l75lg1-v1 neutron-server[77619]: INFO neutron.wsgi [None req-45dfb9c3-fe49-4142-9e35-369a64c6b9d8 admin admin] 10.27.203.238 "GET /networking/v2.0/security-groups?name=manila-service HTTP/1.1" status: 200 len: 1838 time: 0.0414343 May 28 12:45:34 l75lg1-v1 neutron-server[77619]: DEBUG neutron.api.v2.base [None req-34f501f8-3fc6-4e6b-b072-8446f54a4591 admin admin] Request body: {'security_group_rule': {'protocol': 'icmp', 'remote_ip_prefix': '0.0.0.0/0', 'ethertype': 'IPv4', 'security_group_id': 'ca135474-48d5-4746-a063-2afb7533e575', 'direction': 'ingress'}} {{(pid=77619) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:734}} May 28 12:45:34 l75lg1-v1 neutron-server[77619]: DEBUG neutron_lib.callbacks.manager [None req-34f501f8-3fc6-4e6b-b072-8446f54a4591 admin admin] Publish callbacks [] for security_group_rule (ff6bad2c-7206-40d2-bd20-136563b44370), before_create {{(pid=77619) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:45:34 l75lg1-v1 neutron-server[77619]: DEBUG neutron_lib.callbacks.manager [None req-34f501f8-3fc6-4e6b-b072-8446f54a4591 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver.OVNMechanismDriver._create_sg_rule_precommit-4094361'] for security_group_rule (ff6bad2c-7206-40d2-bd20-136563b44370), precommit_create {{(pid=77619) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:45:34 l75lg1-v1 neutron-server[77619]: DEBUG neutron.db.ovn_revision_numbers_db [None req-34f501f8-3fc6-4e6b-b072-8446f54a4591 admin admin] create_initial_revision uuid=ff6bad2c-7206-40d2-bd20-136563b44370, type=security_group_rules, rev=-1 {{(pid=77619) create_initial_revision /opt/stack/neutron/neutron/db/ovn_revision_numbers_db.py:108}} May 28 12:45:34 l75lg1-v1 neutron-server[77619]: DEBUG neutron_lib.callbacks.manager [None req-34f501f8-3fc6-4e6b-b072-8446f54a4591 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver.OVNMechanismDriver._process_sg_rule_notification-4094432', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4166594'] for security_group_rule (ff6bad2c-7206-40d2-bd20-136563b44370), after_create {{(pid=77619) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:45:34 l75lg1-v1 neutron-server[77619]: DEBUG ovsdbapp.backend.ovs_idl.transaction [None req-53cecb61-7023-41e4-a5ea-23b1eb02606a None None] Running txn n=1 command(idx=0): PgAclAddCommand(_result=None, entity=pg_ca135474_48d5_4746_a063_2afb7533e575, direction=to-lport, priority=1002, match=outport == @pg_ca135474_48d5_4746_a063_2afb7533e575 && ip4 && ip4.src == 0.0.0.0/0 && icmp4, action=allow-related, log=False, may_exist=True, severity=[], name=[], meter=None, external_ids={'neutron:security_group_rule_id': 'ff6bad2c-7206-40d2-bd20-136563b44370'}) {{(pid=77619) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:45:34 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-53cecb61-7023-41e4-a5ea-23b1eb02606a None None] Hash Ring: Node c89b3497-133e-4a5a-b67a-3310d2cb2485 (host: l75lg1-v1) handling event "create" for row 58d81bb5-be21-4aba-991e-f2aab48c7d41 (table: ACL) {{(pid=77619) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:45:34 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-53cecb61-7023-41e4-a5ea-23b1eb02606a None None] Hash Ring: Node c89b3497-133e-4a5a-b67a-3310d2cb2485 (host: l75lg1-v1) handling event "update" for row ac525976-5c08-4f36-8fa8-52c01ba0315a (table: Port_Group) {{(pid=77619) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:45:34 l75lg1-v1 neutron-server[77619]: INFO neutron.db.ovn_revision_numbers_db [None req-34f501f8-3fc6-4e6b-b072-8446f54a4591 admin admin] Successfully bumped revision number for resource ff6bad2c-7206-40d2-bd20-136563b44370 (type: security_group_rules) to 0 May 28 12:45:34 l75lg1-v1 neutron-server[77619]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-34f501f8-3fc6-4e6b-b072-8446f54a4591 admin admin] Pushing event updated for resources: {'SecurityGroupRule': ['ID=ff6bad2c-7206-40d2-bd20-136563b44370,revision_number=0']} {{(pid=77619) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 28 12:45:34 l75lg1-v1 neutron-server[77619]: DEBUG neutron_lib.callbacks.manager [None req-34f501f8-3fc6-4e6b-b072-8446f54a4591 admin admin] Publish callbacks [] for security_group_rule (None), before_response {{(pid=77619) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:45:34 l75lg1-v1 neutron-server[77619]: INFO neutron.wsgi [None req-34f501f8-3fc6-4e6b-b072-8446f54a4591 admin admin] 10.27.203.238 "POST /networking/v2.0/security-group-rules HTTP/1.1" status: 201 len: 820 time: 0.2796793 May 28 12:45:35 l75lg1-v1 dstat.sh[49771]: 28-05 12:45:35| 9 1 87 3 0|4526M 4830M 268M 6066M| 16k 3126B| 0 2428k| 0 212 |3117 4691 |1.69 1.82 1.32|1.0 0 24| 0 0 | 0 2048M| 27 284 0 27 0 May 28 12:45:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72589f42-fc71-4964-83e0-c28a9d92a618 None None] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:45:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72589f42-fc71-4964-83e0-c28a9d92a618 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:45:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72589f42-fc71-4964-83e0-c28a9d92a618 None None] PATH_INFO: `/` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:45:36 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 518/1022] 10.27.203.238 () {58 vars in 1014 bytes} [Tue May 28 12:45:36 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:45:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa6d43d-cfbe-4cee-8ee5-a940f64ddc66 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:45:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa6d43d-cfbe-4cee-8ee5-a940f64ddc66 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:45:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa6d43d-cfbe-4cee-8ee5-a940f64ddc66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:45:36 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-4fa6d43d-cfbe-4cee-8ee5-a940f64ddc66 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:45:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-4fa6d43d-cfbe-4cee-8ee5-a940f64ddc66 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:45:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-4fa6d43d-cfbe-4cee-8ee5-a940f64ddc66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:45:36 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 505/1023] 10.27.203.238 () {62 vars in 1111 bytes} [Tue May 28 12:45:36 2024] POST /identity/v3/auth/tokens => generated 3991 bytes in 23 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:45:36 l75lg1-v1 neutron-server[77618]: DEBUG neutron.wsgi [-] (77618) accepted ('10.27.203.238', 41366) {{(pid=77618) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 12:45:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72589f42-fc71-4964-83e0-c28a9d92a618 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:45:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72589f42-fc71-4964-83e0-c28a9d92a618 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:45:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5af728-0e0c-4e62-bf7e-1417db718d65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef17047035e4b518fd5360a01f2da1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:45:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5af728-0e0c-4e62-bf7e-1417db718d65 service neutron] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:45:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5af728-0e0c-4e62-bf7e-1417db718d65 service neutron] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:45:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5af728-0e0c-4e62-bf7e-1417db718d65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:45:36 l75lg1-v1 dstat.sh[49771]: 28-05 12:45:36| 9 1 89 0 0|4557M 4799M 268M 6066M| 12k 0 | 0 72k| 0 7.99 |1851 2546 |1.69 1.82 1.32|2.0 0 0| 0 0 | 0 2048M| 27 287 0 27 0 May 28 12:45:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5af728-0e0c-4e62-bf7e-1417db718d65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:45:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5af728-0e0c-4e62-bf7e-1417db718d65 service neutron] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:45:36 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 519/1024] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 12:45:36 2024] GET /identity/v3/auth/tokens => generated 3991 bytes in 23 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 12:45:36 l75lg1-v1 neutron-server[77618]: INFO neutron.api.v2.resource [None req-a0094e42-4ad4-45be-bf50-97fc969a8e48 admin admin] show failed (client error): The resource could not be found. May 28 12:45:36 l75lg1-v1 neutron-server[77618]: INFO neutron.wsgi [None req-a0094e42-4ad4-45be-bf50-97fc969a8e48 admin admin] 10.27.203.238 "GET /networking/v2.0/security-groups/manila-service HTTP/1.1" status: 404 len: 330 time: 0.0362756 May 28 12:45:36 l75lg1-v1 neutron-server[77618]: INFO neutron.wsgi [None req-9de168c0-204a-423a-b56c-9ce9e207da40 admin admin] 10.27.203.238 "GET /networking/v2.0/security-groups?name=manila-service HTTP/1.1" status: 200 len: 2467 time: 0.0301404 May 28 12:45:36 l75lg1-v1 neutron-server[77618]: INFO neutron.wsgi [None req-0819e947-6501-4461-b2b5-a9e69fae0524 admin admin] 10.27.203.238 "GET /networking/v2.0/security-group-rules?security_group_id=ca135474-48d5-4746-a063-2afb7533e575 HTTP/1.1" status: 200 len: 1975 time: 0.0281487 May 28 12:45:37 l75lg1-v1 dstat.sh[49771]: 28-05 12:45:37| 9 1 89 0 0|4532M 4824M 268M 6066M| 10k 1308B| 0 0 | 0 0 |1829 2435 |1.63 1.81 1.32|1.0 0 20| 0 0 | 0 2048M| 27 284 0 28 0 May 28 12:45:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29094e85-7b94-43bb-b0bf-8907ef669170 None None] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:45:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29094e85-7b94-43bb-b0bf-8907ef669170 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:45:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29094e85-7b94-43bb-b0bf-8907ef669170 None None] PATH_INFO: `/` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:45:37 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 506/1025] 10.27.203.238 () {58 vars in 1014 bytes} [Tue May 28 12:45:37 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:45:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c94cae2-6625-4eb9-a93b-7aa44b23ea8e None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:45:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c94cae2-6625-4eb9-a93b-7aa44b23ea8e None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:45:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c94cae2-6625-4eb9-a93b-7aa44b23ea8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:45:37 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-3c94cae2-6625-4eb9-a93b-7aa44b23ea8e None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:45:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-3c94cae2-6625-4eb9-a93b-7aa44b23ea8e None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:45:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-3c94cae2-6625-4eb9-a93b-7aa44b23ea8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:45:37 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 520/1026] 10.27.203.238 () {62 vars in 1111 bytes} [Tue May 28 12:45:37 2024] POST /identity/v3/auth/tokens => generated 3991 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:45:37 l75lg1-v1 neutron-server[77618]: DEBUG neutron.wsgi [-] (77618) accepted ('10.27.203.238', 41374) {{(pid=77618) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 12:45:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29094e85-7b94-43bb-b0bf-8907ef669170 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:45:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29094e85-7b94-43bb-b0bf-8907ef669170 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:45:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091175ec-6824-44e7-ae2b-b69778fe9790 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef17047035e4b518fd5360a01f2da1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:45:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091175ec-6824-44e7-ae2b-b69778fe9790 service neutron] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:45:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091175ec-6824-44e7-ae2b-b69778fe9790 service neutron] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:45:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091175ec-6824-44e7-ae2b-b69778fe9790 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:45:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091175ec-6824-44e7-ae2b-b69778fe9790 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:45:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091175ec-6824-44e7-ae2b-b69778fe9790 service neutron] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:45:37 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 507/1027] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 12:45:37 2024] GET /identity/v3/auth/tokens => generated 3991 bytes in 20 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 12:45:38 l75lg1-v1 neutron-server[77618]: INFO neutron.api.v2.resource [None req-e86cc81d-fbe2-418d-a570-e63a9a6fad8c admin admin] show failed (client error): The resource could not be found. May 28 12:45:38 l75lg1-v1 neutron-server[77618]: INFO neutron.wsgi [None req-e86cc81d-fbe2-418d-a570-e63a9a6fad8c admin admin] 10.27.203.238 "GET /networking/v2.0/security-groups/manila-service HTTP/1.1" status: 404 len: 330 time: 0.0326378 May 28 12:45:38 l75lg1-v1 neutron-server[77618]: INFO neutron.wsgi [None req-68d73458-f32d-42b1-ab86-b5234fcd9226 admin admin] 10.27.203.238 "GET /networking/v2.0/security-groups?name=manila-service HTTP/1.1" status: 200 len: 2467 time: 0.0291066 May 28 12:45:38 l75lg1-v1 neutron-server[77618]: DEBUG neutron.api.v2.base [None req-a5498be5-167e-406a-8bf8-34cc636e4805 admin admin] Request body: {'security_group_rule': {'security_group_id': 'ca135474-48d5-4746-a063-2afb7533e575', 'remote_ip_prefix': '0.0.0.0/0', 'ethertype': 'IPv4', 'port_range_max': 22, 'protocol': 'tcp', 'direction': 'ingress', 'port_range_min': 22}} {{(pid=77618) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:734}} May 28 12:45:38 l75lg1-v1 neutron-server[77618]: DEBUG neutron_lib.callbacks.manager [None req-a5498be5-167e-406a-8bf8-34cc636e4805 admin admin] Publish callbacks [] for security_group_rule (a86011f6-2df6-4537-8511-1ac256fbf15f), before_create {{(pid=77618) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:45:38 l75lg1-v1 neutron-server[77618]: DEBUG neutron_lib.callbacks.manager [None req-a5498be5-167e-406a-8bf8-34cc636e4805 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver.OVNMechanismDriver._create_sg_rule_precommit-4094361'] for security_group_rule (a86011f6-2df6-4537-8511-1ac256fbf15f), precommit_create {{(pid=77618) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:45:38 l75lg1-v1 neutron-server[77618]: DEBUG neutron.db.ovn_revision_numbers_db [None req-a5498be5-167e-406a-8bf8-34cc636e4805 admin admin] create_initial_revision uuid=a86011f6-2df6-4537-8511-1ac256fbf15f, type=security_group_rules, rev=-1 {{(pid=77618) create_initial_revision /opt/stack/neutron/neutron/db/ovn_revision_numbers_db.py:108}} May 28 12:45:38 l75lg1-v1 neutron-server[77618]: DEBUG neutron_lib.callbacks.manager [None req-a5498be5-167e-406a-8bf8-34cc636e4805 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver.OVNMechanismDriver._process_sg_rule_notification-4094432', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4166594'] for security_group_rule (a86011f6-2df6-4537-8511-1ac256fbf15f), after_create {{(pid=77618) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:45:38 l75lg1-v1 neutron-server[77618]: DEBUG ovsdbapp.backend.ovs_idl.transaction [None req-c63b1acc-b5c6-4be8-9db9-04824fec27f2 None None] Running txn n=1 command(idx=0): PgAclAddCommand(_result=None, entity=pg_ca135474_48d5_4746_a063_2afb7533e575, direction=to-lport, priority=1002, match=outport == @pg_ca135474_48d5_4746_a063_2afb7533e575 && ip4 && ip4.src == 0.0.0.0/0 && tcp && tcp.dst == 22, action=allow-related, log=False, may_exist=True, severity=[], name=[], meter=None, external_ids={'neutron:security_group_rule_id': 'a86011f6-2df6-4537-8511-1ac256fbf15f'}) {{(pid=77618) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:45:38 l75lg1-v1 neutron-server[77618]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-c63b1acc-b5c6-4be8-9db9-04824fec27f2 None None] Hash Ring: Node 4c6fc793-7f5a-456f-b4d6-6e5bd97592f2 (host: l75lg1-v1) handling event "create" for row 7537f838-b436-41ff-97ab-1f3e649452f6 (table: ACL) {{(pid=77618) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:45:38 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-53cecb61-7023-41e4-a5ea-23b1eb02606a None None] Hash Ring: Node c89b3497-133e-4a5a-b67a-3310d2cb2485 (host: l75lg1-v1) handling event "update" for row ac525976-5c08-4f36-8fa8-52c01ba0315a (table: Port_Group) {{(pid=77619) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:45:38 l75lg1-v1 neutron-server[77618]: INFO neutron.db.ovn_revision_numbers_db [None req-a5498be5-167e-406a-8bf8-34cc636e4805 admin admin] Successfully bumped revision number for resource a86011f6-2df6-4537-8511-1ac256fbf15f (type: security_group_rules) to 0 May 28 12:45:38 l75lg1-v1 dstat.sh[49771]: 28-05 12:45:38| 10 1 88 0 0|4554M 4802M 268M 6066M| 11k 0 | 0 452k| 0 69.0 |2703 4134 |1.63 1.81 1.32|2.0 1.0 2.0| 0 0 | 0 2048M| 27 286 0 28 0 May 28 12:45:38 l75lg1-v1 neutron-server[77618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a5498be5-167e-406a-8bf8-34cc636e4805 admin admin] Pushing event updated for resources: {'SecurityGroupRule': ['ID=a86011f6-2df6-4537-8511-1ac256fbf15f,revision_number=0']} {{(pid=77618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 28 12:45:38 l75lg1-v1 neutron-server[77618]: DEBUG neutron_lib.callbacks.manager [None req-a5498be5-167e-406a-8bf8-34cc636e4805 admin admin] Publish callbacks [] for security_group_rule (None), before_response {{(pid=77618) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:45:38 l75lg1-v1 neutron-server[77618]: INFO neutron.wsgi [None req-a5498be5-167e-406a-8bf8-34cc636e4805 admin admin] 10.27.203.238 "POST /networking/v2.0/security-group-rules HTTP/1.1" status: 201 len: 815 time: 0.2129364 May 28 12:45:39 l75lg1-v1 neutron-server[77621]: DEBUG dbcounter [-] [77621] Writing DB stats neutron:SELECT=2 {{(pid=77621) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:45:39 l75lg1-v1 neutron-server[77621]: DEBUG dbcounter [-] [77621] Writing DB stats neutron:SELECT=2 {{(pid=77621) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:45:39 l75lg1-v1 dstat.sh[49771]: 28-05 12:45:39| 10 1 87 2 0|4536M 4821M 268M 6066M| 15k 3134B| 0 3292k| 0 259 |2659 4105 |1.63 1.81 1.32|1.0 0 24| 0 0 | 0 2048M| 27 284 0 29 0 May 28 12:45:39 l75lg1-v1 nova-conductor[83648]: DEBUG dbcounter [-] [83648] Writing DB stats nova_cell1:SELECT=1 {{(pid=83648) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:45:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b293712d-e5c1-41b4-b1d4-4d72c813b881 None None] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:45:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b293712d-e5c1-41b4-b1d4-4d72c813b881 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:45:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b293712d-e5c1-41b4-b1d4-4d72c813b881 None None] PATH_INFO: `/` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:45:39 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 521/1028] 10.27.203.238 () {58 vars in 1014 bytes} [Tue May 28 12:45:39 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:45:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3f40eb-533e-44db-b7ac-7f7029fa70a9 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:45:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3f40eb-533e-44db-b7ac-7f7029fa70a9 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:45:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3f40eb-533e-44db-b7ac-7f7029fa70a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:45:39 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-4b3f40eb-533e-44db-b7ac-7f7029fa70a9 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:45:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-4b3f40eb-533e-44db-b7ac-7f7029fa70a9 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:45:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-4b3f40eb-533e-44db-b7ac-7f7029fa70a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:45:39 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 508/1029] 10.27.203.238 () {62 vars in 1111 bytes} [Tue May 28 12:45:39 2024] POST /identity/v3/auth/tokens => generated 3991 bytes in 23 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:45:39 l75lg1-v1 neutron-server[77618]: DEBUG neutron.wsgi [-] (77618) accepted ('10.27.203.238', 41378) {{(pid=77618) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 12:45:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b293712d-e5c1-41b4-b1d4-4d72c813b881 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:45:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b293712d-e5c1-41b4-b1d4-4d72c813b881 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:45:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0eabb8-f728-476e-a63e-c7d8c98cdc35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef17047035e4b518fd5360a01f2da1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:45:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0eabb8-f728-476e-a63e-c7d8c98cdc35 service neutron] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:45:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0eabb8-f728-476e-a63e-c7d8c98cdc35 service neutron] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:45:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0eabb8-f728-476e-a63e-c7d8c98cdc35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:45:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0eabb8-f728-476e-a63e-c7d8c98cdc35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:45:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0eabb8-f728-476e-a63e-c7d8c98cdc35 service neutron] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:45:39 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 522/1030] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 12:45:39 2024] GET /identity/v3/auth/tokens => generated 3991 bytes in 20 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 12:45:39 l75lg1-v1 neutron-server[77618]: INFO neutron.api.v2.resource [None req-7940473c-9ad4-450c-a410-eafb2d684cf9 admin admin] show failed (client error): The resource could not be found. May 28 12:45:39 l75lg1-v1 neutron-server[77618]: INFO neutron.wsgi [None req-7940473c-9ad4-450c-a410-eafb2d684cf9 admin admin] 10.27.203.238 "GET /networking/v2.0/security-groups/manila-service HTTP/1.1" status: 404 len: 330 time: 0.0327325 May 28 12:45:39 l75lg1-v1 neutron-server[77618]: INFO neutron.wsgi [None req-bd23519f-35cf-4b68-ba0e-be3c7d0003d6 admin admin] 10.27.203.238 "GET /networking/v2.0/security-groups?name=manila-service HTTP/1.1" status: 200 len: 3091 time: 0.0346794 May 28 12:45:39 l75lg1-v1 neutron-server[77618]: INFO neutron.wsgi [None req-ef512560-515c-4f23-a40f-652f97f51307 admin admin] 10.27.203.238 "GET /networking/v2.0/security-group-rules?security_group_id=ca135474-48d5-4746-a063-2afb7533e575 HTTP/1.1" status: 200 len: 2563 time: 0.0322425 May 28 12:45:40 l75lg1-v1 dstat.sh[49771]: 28-05 12:45:40| 10 1 88 0 0|4501M 4855M 268M 6066M| 11k 1478B| 0 340k| 0 36.0 |2355 3136 |1.63 1.81 1.32|1.0 0 20| 0 0 | 0 2048M| 27 284 0 30 0 May 28 12:45:41 l75lg1-v1 dstat.sh[49771]: 28-05 12:45:41| 10 1 89 0 0|4549M 4807M 268M 6066M| 12k 0 | 0 1452k| 0 255 |1617 2261 |1.63 1.81 1.32|1.0 0 0| 0 0 | 0 2048M| 27 284 0 30 0 May 28 12:45:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0395393-39bc-4310-8154-b10582da742d None None] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:45:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0395393-39bc-4310-8154-b10582da742d None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:45:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0395393-39bc-4310-8154-b10582da742d None None] PATH_INFO: `/` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:45:41 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 509/1031] 10.27.203.238 () {58 vars in 1014 bytes} [Tue May 28 12:45:41 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:45:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fd24fb-17de-4be8-8988-da46a648ec5b None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:45:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fd24fb-17de-4be8-8988-da46a648ec5b None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:45:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fd24fb-17de-4be8-8988-da46a648ec5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:45:41 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-c3fd24fb-17de-4be8-8988-da46a648ec5b None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:45:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-c3fd24fb-17de-4be8-8988-da46a648ec5b None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:45:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-c3fd24fb-17de-4be8-8988-da46a648ec5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:45:41 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 523/1032] 10.27.203.238 () {62 vars in 1111 bytes} [Tue May 28 12:45:41 2024] POST /identity/v3/auth/tokens => generated 3991 bytes in 23 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:45:41 l75lg1-v1 neutron-server[77619]: DEBUG neutron.wsgi [-] (77619) accepted ('10.27.203.238', 40486) {{(pid=77619) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 12:45:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0395393-39bc-4310-8154-b10582da742d None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:45:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0395393-39bc-4310-8154-b10582da742d None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:45:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3cf2c9-524a-4976-b30d-7996bfd8f954 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef17047035e4b518fd5360a01f2da1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:45:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3cf2c9-524a-4976-b30d-7996bfd8f954 service neutron] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:45:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3cf2c9-524a-4976-b30d-7996bfd8f954 service neutron] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:45:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3cf2c9-524a-4976-b30d-7996bfd8f954 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:45:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3cf2c9-524a-4976-b30d-7996bfd8f954 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:45:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3cf2c9-524a-4976-b30d-7996bfd8f954 service neutron] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:45:41 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 510/1033] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 12:45:41 2024] GET /identity/v3/auth/tokens => generated 3991 bytes in 21 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 12:45:41 l75lg1-v1 neutron-server[77619]: INFO neutron.api.v2.resource [None req-cc554101-97f6-449e-8a3b-2e723124452a admin admin] show failed (client error): The resource could not be found. May 28 12:45:41 l75lg1-v1 neutron-server[77619]: INFO neutron.wsgi [None req-cc554101-97f6-449e-8a3b-2e723124452a admin admin] 10.27.203.238 "GET /networking/v2.0/security-groups/manila-service HTTP/1.1" status: 404 len: 330 time: 0.0352194 May 28 12:45:41 l75lg1-v1 neutron-server[77619]: INFO neutron.wsgi [None req-e8e5fc7c-e2d8-4059-9645-8947fbdc6df6 admin admin] 10.27.203.238 "GET /networking/v2.0/security-groups?name=manila-service HTTP/1.1" status: 200 len: 3091 time: 0.0356975 May 28 12:45:41 l75lg1-v1 neutron-server[77619]: DEBUG neutron.api.v2.base [None req-9f5072ae-9e45-4f9e-978b-2f922482e058 admin admin] Request body: {'security_group_rule': {'remote_ip_prefix': '0.0.0.0/0', 'port_range_min': 2049, 'port_range_max': 2049, 'ethertype': 'IPv4', 'protocol': 'tcp', 'security_group_id': 'ca135474-48d5-4746-a063-2afb7533e575', 'direction': 'ingress'}} {{(pid=77619) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:734}} May 28 12:45:41 l75lg1-v1 neutron-server[77619]: DEBUG neutron_lib.callbacks.manager [None req-9f5072ae-9e45-4f9e-978b-2f922482e058 admin admin] Publish callbacks [] for security_group_rule (587ca406-78fc-4836-bc2c-dcb2017799ec), before_create {{(pid=77619) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:45:41 l75lg1-v1 neutron-server[77619]: DEBUG neutron_lib.callbacks.manager [None req-9f5072ae-9e45-4f9e-978b-2f922482e058 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver.OVNMechanismDriver._create_sg_rule_precommit-4094361'] for security_group_rule (587ca406-78fc-4836-bc2c-dcb2017799ec), precommit_create {{(pid=77619) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:45:41 l75lg1-v1 neutron-server[77619]: DEBUG neutron.db.ovn_revision_numbers_db [None req-9f5072ae-9e45-4f9e-978b-2f922482e058 admin admin] create_initial_revision uuid=587ca406-78fc-4836-bc2c-dcb2017799ec, type=security_group_rules, rev=-1 {{(pid=77619) create_initial_revision /opt/stack/neutron/neutron/db/ovn_revision_numbers_db.py:108}} May 28 12:45:41 l75lg1-v1 neutron-server[77619]: DEBUG neutron_lib.callbacks.manager [None req-9f5072ae-9e45-4f9e-978b-2f922482e058 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver.OVNMechanismDriver._process_sg_rule_notification-4094432', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4166594'] for security_group_rule (587ca406-78fc-4836-bc2c-dcb2017799ec), after_create {{(pid=77619) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:45:41 l75lg1-v1 neutron-server[77619]: DEBUG ovsdbapp.backend.ovs_idl.transaction [None req-53cecb61-7023-41e4-a5ea-23b1eb02606a None None] Running txn n=1 command(idx=0): PgAclAddCommand(_result=None, entity=pg_ca135474_48d5_4746_a063_2afb7533e575, direction=to-lport, priority=1002, match=outport == @pg_ca135474_48d5_4746_a063_2afb7533e575 && ip4 && ip4.src == 0.0.0.0/0 && tcp && tcp.dst == 2049, action=allow-related, log=False, may_exist=True, severity=[], name=[], meter=None, external_ids={'neutron:security_group_rule_id': '587ca406-78fc-4836-bc2c-dcb2017799ec'}) {{(pid=77619) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:45:41 l75lg1-v1 neutron-server[77618]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-c63b1acc-b5c6-4be8-9db9-04824fec27f2 None None] Hash Ring: Node 4c6fc793-7f5a-456f-b4d6-6e5bd97592f2 (host: l75lg1-v1) handling event "create" for row f7076f1d-e683-48ac-8353-bd29e9c37078 (table: ACL) {{(pid=77618) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:45:41 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-53cecb61-7023-41e4-a5ea-23b1eb02606a None None] Hash Ring: Node c89b3497-133e-4a5a-b67a-3310d2cb2485 (host: l75lg1-v1) handling event "update" for row ac525976-5c08-4f36-8fa8-52c01ba0315a (table: Port_Group) {{(pid=77619) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:45:41 l75lg1-v1 neutron-server[77619]: INFO neutron.db.ovn_revision_numbers_db [None req-9f5072ae-9e45-4f9e-978b-2f922482e058 admin admin] Successfully bumped revision number for resource 587ca406-78fc-4836-bc2c-dcb2017799ec (type: security_group_rules) to 0 May 28 12:45:41 l75lg1-v1 neutron-server[77619]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9f5072ae-9e45-4f9e-978b-2f922482e058 admin admin] Pushing event updated for resources: {'SecurityGroupRule': ['ID=587ca406-78fc-4836-bc2c-dcb2017799ec,revision_number=0']} {{(pid=77619) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 28 12:45:41 l75lg1-v1 neutron-server[77619]: DEBUG neutron_lib.callbacks.manager [None req-9f5072ae-9e45-4f9e-978b-2f922482e058 admin admin] Publish callbacks [] for security_group_rule (None), before_response {{(pid=77619) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:45:41 l75lg1-v1 neutron-server[77619]: INFO neutron.wsgi [None req-9f5072ae-9e45-4f9e-978b-2f922482e058 admin admin] 10.27.203.238 "POST /networking/v2.0/security-group-rules HTTP/1.1" status: 201 len: 819 time: 0.2241683 May 28 12:45:42 l75lg1-v1 dstat.sh[49771]: 28-05 12:45:42| 9 1 88 1 0|4503M 4853M 268M 6066M| 15k 3134B| 0 576k| 0 78.0 |3047 4515 |1.58 1.79 1.32|3.0 0 24| 0 0 | 0 2048M| 27 284 0 31 0 May 28 12:45:43 l75lg1-v1 dstat.sh[49771]: 28-05 12:45:43| 10 1 89 0 0|4551M 4806M 268M 6066M| 10k 0 | 0 280k| 0 18.0 |1525 2155 |1.58 1.79 1.32|1.0 0 0| 0 0 | 0 2048M| 27 284 0 31 0 May 28 12:45:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080bef36-8377-4e4c-ba00-384789e26135 None None] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:45:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080bef36-8377-4e4c-ba00-384789e26135 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:45:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080bef36-8377-4e4c-ba00-384789e26135 None None] PATH_INFO: `/` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:45:43 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 524/1034] 10.27.203.238 () {58 vars in 1014 bytes} [Tue May 28 12:45:43 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:45:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b670550-5987-48ef-a411-e62530eb710e None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:45:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b670550-5987-48ef-a411-e62530eb710e None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:45:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b670550-5987-48ef-a411-e62530eb710e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:45:43 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-3b670550-5987-48ef-a411-e62530eb710e None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:45:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-3b670550-5987-48ef-a411-e62530eb710e None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:45:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-3b670550-5987-48ef-a411-e62530eb710e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:45:43 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 511/1035] 10.27.203.238 () {62 vars in 1111 bytes} [Tue May 28 12:45:43 2024] POST /identity/v3/auth/tokens => generated 3991 bytes in 24 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:45:43 l75lg1-v1 neutron-server[77619]: DEBUG neutron.wsgi [-] (77619) accepted ('10.27.203.238', 40502) {{(pid=77619) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 12:45:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080bef36-8377-4e4c-ba00-384789e26135 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:45:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080bef36-8377-4e4c-ba00-384789e26135 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:45:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6e6582-c136-487d-862d-65120ed78fa0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef17047035e4b518fd5360a01f2da1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:45:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6e6582-c136-487d-862d-65120ed78fa0 service neutron] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:45:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6e6582-c136-487d-862d-65120ed78fa0 service neutron] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:45:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6e6582-c136-487d-862d-65120ed78fa0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:45:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6e6582-c136-487d-862d-65120ed78fa0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:45:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6e6582-c136-487d-862d-65120ed78fa0 service neutron] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:45:43 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 525/1036] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 12:45:43 2024] GET /identity/v3/auth/tokens => generated 3991 bytes in 20 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 12:45:43 l75lg1-v1 neutron-server[77619]: INFO neutron.api.v2.resource [None req-31705da7-253b-4f34-9597-dbf830c857df admin admin] show failed (client error): The resource could not be found. May 28 12:45:43 l75lg1-v1 neutron-server[77619]: INFO neutron.wsgi [None req-31705da7-253b-4f34-9597-dbf830c857df admin admin] 10.27.203.238 "GET /networking/v2.0/security-groups/manila-service HTTP/1.1" status: 404 len: 330 time: 0.0331416 May 28 12:45:43 l75lg1-v1 neutron-server[77619]: INFO neutron.wsgi [None req-e265ecd2-733e-4f1a-b75b-111de85ac48e admin admin] 10.27.203.238 "GET /networking/v2.0/security-groups?name=manila-service HTTP/1.1" status: 200 len: 3719 time: 0.0383706 May 28 12:45:43 l75lg1-v1 neutron-server[77619]: INFO neutron.wsgi [None req-492fbe70-e190-4c3b-b4f5-a0829c78f39b admin admin] 10.27.203.238 "GET /networking/v2.0/security-group-rules?security_group_id=ca135474-48d5-4746-a063-2afb7533e575 HTTP/1.1" status: 200 len: 3155 time: 0.0417871 May 28 12:45:44 l75lg1-v1 dstat.sh[49771]: 28-05 12:45:44| 10 1 89 0 0|4516M 4840M 268M 6066M| 12k 2333B| 0 224k| 0 19.0 |2097 2863 |1.58 1.79 1.32|4.0 0 20| 0 0 | 0 2048M| 27 284 0 32 0 May 28 12:45:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a4e254-3407-4151-9cb5-8aca374a15b5 None None] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:45:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a4e254-3407-4151-9cb5-8aca374a15b5 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:45:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a4e254-3407-4151-9cb5-8aca374a15b5 None None] PATH_INFO: `/` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:45:45 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 512/1037] 10.27.203.238 () {58 vars in 1014 bytes} [Tue May 28 12:45:45 2024] GET /identity => generated 272 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:45:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae66dab-2417-41c5-9ee9-c6db5584d6bc None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:45:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae66dab-2417-41c5-9ee9-c6db5584d6bc None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:45:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae66dab-2417-41c5-9ee9-c6db5584d6bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:45:45 l75lg1-v1 dstat.sh[49771]: 28-05 12:45:45| 10 1 89 0 0|4557M 4800M 268M 6066M| 15k 0 | 0 184k| 0 14.0 |1688 2362 |1.58 1.79 1.32|1.0 0 0| 0 0 | 0 2048M| 27 285 0 27 0 May 28 12:45:45 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-5ae66dab-2417-41c5-9ee9-c6db5584d6bc None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:45:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-5ae66dab-2417-41c5-9ee9-c6db5584d6bc None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:45:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-5ae66dab-2417-41c5-9ee9-c6db5584d6bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:45:45 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 526/1038] 10.27.203.238 () {62 vars in 1111 bytes} [Tue May 28 12:45:45 2024] POST /identity/v3/auth/tokens => generated 3991 bytes in 23 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:45:45 l75lg1-v1 neutron-server[77619]: DEBUG neutron.wsgi [-] (77619) accepted ('10.27.203.238', 40512) {{(pid=77619) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 12:45:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a4e254-3407-4151-9cb5-8aca374a15b5 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:45:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a4e254-3407-4151-9cb5-8aca374a15b5 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:45:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcb59df-bcf7-45a7-8e69-d2e8801186f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef17047035e4b518fd5360a01f2da1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:45:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcb59df-bcf7-45a7-8e69-d2e8801186f5 service neutron] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:45:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcb59df-bcf7-45a7-8e69-d2e8801186f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:45:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcb59df-bcf7-45a7-8e69-d2e8801186f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:45:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcb59df-bcf7-45a7-8e69-d2e8801186f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:45:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcb59df-bcf7-45a7-8e69-d2e8801186f5 service neutron] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:45:45 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 513/1039] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 12:45:45 2024] GET /identity/v3/auth/tokens => generated 3991 bytes in 21 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 12:45:45 l75lg1-v1 neutron-server[77619]: INFO neutron.api.v2.resource [None req-011615a1-f322-4afb-a045-5e73d91725a0 admin admin] show failed (client error): The resource could not be found. May 28 12:45:45 l75lg1-v1 neutron-server[77619]: INFO neutron.wsgi [None req-011615a1-f322-4afb-a045-5e73d91725a0 admin admin] 10.27.203.238 "GET /networking/v2.0/security-groups/manila-service HTTP/1.1" status: 404 len: 330 time: 0.0343447 May 28 12:45:45 l75lg1-v1 neutron-server[77619]: INFO neutron.wsgi [None req-0a50a427-71b6-4ea6-ae81-bdaa970fd2ce admin admin] 10.27.203.238 "GET /networking/v2.0/security-groups?name=manila-service HTTP/1.1" status: 200 len: 3719 time: 0.0389922 May 28 12:45:45 l75lg1-v1 neutron-server[77619]: DEBUG neutron.api.v2.base [None req-1fb4f555-f155-44ce-9986-4ecd7a38d938 admin admin] Request body: {'security_group_rule': {'port_range_min': 2049, 'port_range_max': 2049, 'protocol': 'udp', 'ethertype': 'IPv4', 'security_group_id': 'ca135474-48d5-4746-a063-2afb7533e575', 'direction': 'ingress', 'remote_ip_prefix': '0.0.0.0/0'}} {{(pid=77619) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:734}} May 28 12:45:45 l75lg1-v1 neutron-server[77619]: DEBUG neutron_lib.callbacks.manager [None req-1fb4f555-f155-44ce-9986-4ecd7a38d938 admin admin] Publish callbacks [] for security_group_rule (8a698dc2-2db4-42c4-94d5-d53e1902c28a), before_create {{(pid=77619) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:45:45 l75lg1-v1 neutron-server[77619]: DEBUG neutron_lib.callbacks.manager [None req-1fb4f555-f155-44ce-9986-4ecd7a38d938 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver.OVNMechanismDriver._create_sg_rule_precommit-4094361'] for security_group_rule (8a698dc2-2db4-42c4-94d5-d53e1902c28a), precommit_create {{(pid=77619) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:45:45 l75lg1-v1 neutron-server[77619]: DEBUG neutron.db.ovn_revision_numbers_db [None req-1fb4f555-f155-44ce-9986-4ecd7a38d938 admin admin] create_initial_revision uuid=8a698dc2-2db4-42c4-94d5-d53e1902c28a, type=security_group_rules, rev=-1 {{(pid=77619) create_initial_revision /opt/stack/neutron/neutron/db/ovn_revision_numbers_db.py:108}} May 28 12:45:45 l75lg1-v1 neutron-server[77619]: DEBUG neutron_lib.callbacks.manager [None req-1fb4f555-f155-44ce-9986-4ecd7a38d938 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver.OVNMechanismDriver._process_sg_rule_notification-4094432', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4166594'] for security_group_rule (8a698dc2-2db4-42c4-94d5-d53e1902c28a), after_create {{(pid=77619) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:45:45 l75lg1-v1 neutron-server[77619]: DEBUG ovsdbapp.backend.ovs_idl.transaction [None req-53cecb61-7023-41e4-a5ea-23b1eb02606a None None] Running txn n=1 command(idx=0): PgAclAddCommand(_result=None, entity=pg_ca135474_48d5_4746_a063_2afb7533e575, direction=to-lport, priority=1002, match=outport == @pg_ca135474_48d5_4746_a063_2afb7533e575 && ip4 && ip4.src == 0.0.0.0/0 && udp && udp.dst == 2049, action=allow-related, log=False, may_exist=True, severity=[], name=[], meter=None, external_ids={'neutron:security_group_rule_id': '8a698dc2-2db4-42c4-94d5-d53e1902c28a'}) {{(pid=77619) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:45:45 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-53cecb61-7023-41e4-a5ea-23b1eb02606a None None] Hash Ring: Node c89b3497-133e-4a5a-b67a-3310d2cb2485 (host: l75lg1-v1) handling event "create" for row eb3148cd-41ef-4e71-98e0-ead930efb9c5 (table: ACL) {{(pid=77619) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:45:45 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-53cecb61-7023-41e4-a5ea-23b1eb02606a None None] Hash Ring: Node c89b3497-133e-4a5a-b67a-3310d2cb2485 (host: l75lg1-v1) handling event "update" for row ac525976-5c08-4f36-8fa8-52c01ba0315a (table: Port_Group) {{(pid=77619) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:45:45 l75lg1-v1 neutron-server[77619]: INFO neutron.db.ovn_revision_numbers_db [None req-1fb4f555-f155-44ce-9986-4ecd7a38d938 admin admin] Successfully bumped revision number for resource 8a698dc2-2db4-42c4-94d5-d53e1902c28a (type: security_group_rules) to 0 May 28 12:45:45 l75lg1-v1 neutron-server[77619]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1fb4f555-f155-44ce-9986-4ecd7a38d938 admin admin] Pushing event updated for resources: {'SecurityGroupRule': ['ID=8a698dc2-2db4-42c4-94d5-d53e1902c28a,revision_number=0']} {{(pid=77619) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 28 12:45:45 l75lg1-v1 neutron-server[77619]: DEBUG neutron_lib.callbacks.manager [None req-1fb4f555-f155-44ce-9986-4ecd7a38d938 admin admin] Publish callbacks [] for security_group_rule (None), before_response {{(pid=77619) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:45:45 l75lg1-v1 neutron-server[77619]: INFO neutron.wsgi [None req-1fb4f555-f155-44ce-9986-4ecd7a38d938 admin admin] 10.27.203.238 "POST /networking/v2.0/security-group-rules HTTP/1.1" status: 201 len: 819 time: 0.2261655 May 28 12:45:46 l75lg1-v1 dstat.sh[49771]: 28-05 12:45:46| 10 1 87 2 0|4520M 4836M 268M 6066M| 10k 2914B| 0 1620k| 0 157 |3141 4839 |1.58 1.79 1.32|1.0 0 24| 0 0 | 0 2048M| 27 284 0 28 0 May 28 12:45:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360699d8-7d5b-4277-973b-3614547a05c9 None None] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:45:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360699d8-7d5b-4277-973b-3614547a05c9 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:45:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360699d8-7d5b-4277-973b-3614547a05c9 None None] PATH_INFO: `/` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:45:47 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 527/1040] 10.27.203.238 () {58 vars in 1014 bytes} [Tue May 28 12:45:47 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:45:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0110c64a-e4b1-4074-b2e4-bd88254b6a26 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:45:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0110c64a-e4b1-4074-b2e4-bd88254b6a26 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:45:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0110c64a-e4b1-4074-b2e4-bd88254b6a26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:45:47 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-0110c64a-e4b1-4074-b2e4-bd88254b6a26 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:45:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-0110c64a-e4b1-4074-b2e4-bd88254b6a26 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:45:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-0110c64a-e4b1-4074-b2e4-bd88254b6a26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:45:47 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 514/1041] 10.27.203.238 () {62 vars in 1111 bytes} [Tue May 28 12:45:47 2024] POST /identity/v3/auth/tokens => generated 3991 bytes in 23 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:45:47 l75lg1-v1 dstat.sh[49771]: 28-05 12:45:47| 10 0 89 0 0|4559M 4797M 268M 6066M|9557B 0 | 0 852k| 0 155 |1716 2474 |1.53 1.78 1.32|2.0 0 0| 0 0 | 0 2048M| 27 284 0 28 0 May 28 12:45:47 l75lg1-v1 neutron-server[77618]: DEBUG neutron.wsgi [-] (77618) accepted ('10.27.203.238', 40520) {{(pid=77618) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 12:45:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360699d8-7d5b-4277-973b-3614547a05c9 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:45:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360699d8-7d5b-4277-973b-3614547a05c9 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:45:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef139a0-79c9-467d-9acf-ebe753e7d6f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef17047035e4b518fd5360a01f2da1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:45:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef139a0-79c9-467d-9acf-ebe753e7d6f9 service neutron] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:45:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef139a0-79c9-467d-9acf-ebe753e7d6f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:45:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef139a0-79c9-467d-9acf-ebe753e7d6f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:45:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef139a0-79c9-467d-9acf-ebe753e7d6f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:45:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef139a0-79c9-467d-9acf-ebe753e7d6f9 service neutron] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:45:47 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 528/1042] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 12:45:47 2024] GET /identity/v3/auth/tokens => generated 3991 bytes in 19 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 12:45:47 l75lg1-v1 neutron-server[77618]: INFO neutron.api.v2.resource [None req-83d32670-ac54-4da8-8387-f431df9e94de admin admin] show failed (client error): The resource could not be found. May 28 12:45:47 l75lg1-v1 neutron-server[77618]: INFO neutron.wsgi [None req-83d32670-ac54-4da8-8387-f431df9e94de admin admin] 10.27.203.238 "GET /networking/v2.0/security-groups/manila-service HTTP/1.1" status: 404 len: 330 time: 0.0319092 May 28 12:45:47 l75lg1-v1 neutron-server[77618]: INFO neutron.wsgi [None req-3bb4728f-4057-41a4-8caf-c349bee60b63 admin admin] 10.27.203.238 "GET /networking/v2.0/security-groups?name=manila-service HTTP/1.1" status: 200 len: 4347 time: 0.0403726 May 28 12:45:47 l75lg1-v1 neutron-server[77618]: INFO neutron.wsgi [None req-eb6e9a22-cebb-4a0a-9210-0a3602d29b0a admin admin] 10.27.203.238 "GET /networking/v2.0/security-group-rules?security_group_id=ca135474-48d5-4746-a063-2afb7533e575 HTTP/1.1" status: 200 len: 3747 time: 0.0394635 May 28 12:45:47 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:45:47 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:45:47 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.manager [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Starting heal instance info cache {{(pid=83654) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}} May 28 12:45:47 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.manager [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Rebuilding the list of instances to heal {{(pid=83654) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9930}} May 28 12:45:47 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Expecting reply to msg 0ab4e0d246df49c3b3fd57da48682ad1 in queue reply_37f4cbd1dd094961a22b8a65f222c327 May 28 12:45:48 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [-] Received RPC response for msg 0ab4e0d246df49c3b3fd57da48682ad1 May 28 12:45:48 l75lg1-v1 dstat.sh[49771]: 28-05 12:45:48| 10 1 88 0 0|4533M 4823M 268M 6066M| 11k 1479B| 0 172k| 0 24.0 |2401 3432 |1.53 1.78 1.32|1.0 0 22| 0 0 | 0 2048M| 27 284 0 29 0 May 28 12:45:48 l75lg1-v1 neutron-server[77623]: DEBUG dbcounter [-] [77623] Writing DB stats neutron:DELETE=1,neutron:SELECT=1 {{(pid=77623) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:45:48 l75lg1-v1 neutron-server[77623]: DEBUG dbcounter [-] [77623] Writing DB stats neutron:SELECT=2 {{(pid=77623) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:45:48 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.manager [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Didn't find any instances for network info cache update. {{(pid=83654) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10012}} May 28 12:45:48 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:45:48 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:45:48 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:45:48 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:45:48 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:45:48 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._sync_power_states {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:45:48 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Expecting reply to msg 11a7623d7f344e9e94bd4f1cfba71d9d in queue reply_37f4cbd1dd094961a22b8a65f222c327 May 28 12:45:48 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [-] Received RPC response for msg 11a7623d7f344e9e94bd4f1cfba71d9d May 28 12:45:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fdb723-7e6e-47e5-a2e2-1c2c40bd30fc None None] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:45:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fdb723-7e6e-47e5-a2e2-1c2c40bd30fc None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:45:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fdb723-7e6e-47e5-a2e2-1c2c40bd30fc None None] PATH_INFO: `/` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:45:48 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 515/1043] 10.27.203.238 () {58 vars in 1014 bytes} [Tue May 28 12:45:48 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:45:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad618066-467b-40a3-854e-7cfa0e57a659 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:45:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad618066-467b-40a3-854e-7cfa0e57a659 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:45:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad618066-467b-40a3-854e-7cfa0e57a659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:45:48 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-ad618066-467b-40a3-854e-7cfa0e57a659 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:45:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-ad618066-467b-40a3-854e-7cfa0e57a659 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:45:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-ad618066-467b-40a3-854e-7cfa0e57a659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:45:48 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 529/1044] 10.27.203.238 () {62 vars in 1111 bytes} [Tue May 28 12:45:48 2024] POST /identity/v3/auth/tokens => generated 3991 bytes in 24 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:45:48 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:45:49 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.manager [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=83654) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10545}} May 28 12:45:49 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager.update_available_resource {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:45:49 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Expecting reply to msg 2270f60780864835a25207321adb64b1 in queue reply_37f4cbd1dd094961a22b8a65f222c327 May 28 12:45:49 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [-] Received RPC response for msg 2270f60780864835a25207321adb64b1 May 28 12:45:49 l75lg1-v1 neutron-server[77618]: DEBUG neutron.wsgi [-] (77618) accepted ('10.27.203.238', 40536) {{(pid=77618) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 12:45:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fdb723-7e6e-47e5-a2e2-1c2c40bd30fc None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:45:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fdb723-7e6e-47e5-a2e2-1c2c40bd30fc None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:45:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a0db67-9edd-4f12-8d20-494f2bed64af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef17047035e4b518fd5360a01f2da1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:45:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a0db67-9edd-4f12-8d20-494f2bed64af service neutron] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:45:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a0db67-9edd-4f12-8d20-494f2bed64af service neutron] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:45:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a0db67-9edd-4f12-8d20-494f2bed64af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:45:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a0db67-9edd-4f12-8d20-494f2bed64af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:45:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a0db67-9edd-4f12-8d20-494f2bed64af service neutron] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:45:49 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 516/1045] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 12:45:49 2024] GET /identity/v3/auth/tokens => generated 3991 bytes in 19 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 12:45:49 l75lg1-v1 neutron-server[77618]: INFO neutron.api.v2.resource [None req-cf4b2ae8-5a82-4976-8089-0b6ce30face2 admin admin] show failed (client error): The resource could not be found. May 28 12:45:49 l75lg1-v1 neutron-server[77618]: INFO neutron.wsgi [None req-cf4b2ae8-5a82-4976-8089-0b6ce30face2 admin admin] 10.27.203.238 "GET /networking/v2.0/security-groups/manila-service HTTP/1.1" status: 404 len: 330 time: 0.0317414 May 28 12:45:49 l75lg1-v1 neutron-server[77618]: INFO neutron.wsgi [None req-c4f0dabc-61b4-44f9-8e51-24e72a8d3a23 admin admin] 10.27.203.238 "GET /networking/v2.0/security-groups?name=manila-service HTTP/1.1" status: 200 len: 4347 time: 0.0400383 May 28 12:45:49 l75lg1-v1 neutron-server[77618]: DEBUG neutron.api.v2.base [None req-d7b0f62f-bcca-45b2-96df-ac34dc95d04c admin admin] Request body: {'security_group_rule': {'port_range_min': 445, 'port_range_max': 445, 'remote_ip_prefix': '0.0.0.0/0', 'ethertype': 'IPv4', 'security_group_id': 'ca135474-48d5-4746-a063-2afb7533e575', 'direction': 'ingress', 'protocol': 'udp'}} {{(pid=77618) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:734}} May 28 12:45:49 l75lg1-v1 neutron-server[77618]: DEBUG neutron_lib.callbacks.manager [None req-d7b0f62f-bcca-45b2-96df-ac34dc95d04c admin admin] Publish callbacks [] for security_group_rule (f577dd75-566c-408e-9c8b-c7236da3b28f), before_create {{(pid=77618) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:45:49 l75lg1-v1 dstat.sh[49771]: 28-05 12:45:49| 10 1 88 0 0|4560M 4796M 268M 6066M| 14k 0 | 0 328k| 0 37.0 |2335 3334 |1.53 1.78 1.32|3.0 0 0| 0 0 | 0 2048M| 27 286 0 25 0 May 28 12:45:49 l75lg1-v1 neutron-server[77618]: DEBUG neutron_lib.callbacks.manager [None req-d7b0f62f-bcca-45b2-96df-ac34dc95d04c admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver.OVNMechanismDriver._create_sg_rule_precommit-4094361'] for security_group_rule (f577dd75-566c-408e-9c8b-c7236da3b28f), precommit_create {{(pid=77618) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:45:49 l75lg1-v1 neutron-server[77618]: DEBUG neutron.db.ovn_revision_numbers_db [None req-d7b0f62f-bcca-45b2-96df-ac34dc95d04c admin admin] create_initial_revision uuid=f577dd75-566c-408e-9c8b-c7236da3b28f, type=security_group_rules, rev=-1 {{(pid=77618) create_initial_revision /opt/stack/neutron/neutron/db/ovn_revision_numbers_db.py:108}} May 28 12:45:49 l75lg1-v1 neutron-server[77618]: DEBUG neutron_lib.callbacks.manager [None req-d7b0f62f-bcca-45b2-96df-ac34dc95d04c admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver.OVNMechanismDriver._process_sg_rule_notification-4094432', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4166594'] for security_group_rule (f577dd75-566c-408e-9c8b-c7236da3b28f), after_create {{(pid=77618) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:45:49 l75lg1-v1 neutron-server[77618]: DEBUG ovsdbapp.backend.ovs_idl.transaction [None req-c63b1acc-b5c6-4be8-9db9-04824fec27f2 None None] Running txn n=1 command(idx=0): PgAclAddCommand(_result=None, entity=pg_ca135474_48d5_4746_a063_2afb7533e575, direction=to-lport, priority=1002, match=outport == @pg_ca135474_48d5_4746_a063_2afb7533e575 && ip4 && ip4.src == 0.0.0.0/0 && udp && udp.dst == 445, action=allow-related, log=False, may_exist=True, severity=[], name=[], meter=None, external_ids={'neutron:security_group_rule_id': 'f577dd75-566c-408e-9c8b-c7236da3b28f'}) {{(pid=77618) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:45:49 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-53cecb61-7023-41e4-a5ea-23b1eb02606a None None] Hash Ring: Node c89b3497-133e-4a5a-b67a-3310d2cb2485 (host: l75lg1-v1) handling event "create" for row 3a5f9a8c-6a93-40d9-bc1c-8bea1456be90 (table: ACL) {{(pid=77619) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:45:49 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-53cecb61-7023-41e4-a5ea-23b1eb02606a None None] Hash Ring: Node c89b3497-133e-4a5a-b67a-3310d2cb2485 (host: l75lg1-v1) handling event "update" for row ac525976-5c08-4f36-8fa8-52c01ba0315a (table: Port_Group) {{(pid=77619) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:45:49 l75lg1-v1 neutron-server[77618]: INFO neutron.db.ovn_revision_numbers_db [None req-d7b0f62f-bcca-45b2-96df-ac34dc95d04c admin admin] Successfully bumped revision number for resource f577dd75-566c-408e-9c8b-c7236da3b28f (type: security_group_rules) to 0 May 28 12:45:49 l75lg1-v1 neutron-server[77618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d7b0f62f-bcca-45b2-96df-ac34dc95d04c admin admin] Pushing event updated for resources: {'SecurityGroupRule': ['ID=f577dd75-566c-408e-9c8b-c7236da3b28f,revision_number=0']} {{(pid=77618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 28 12:45:49 l75lg1-v1 neutron-server[77618]: DEBUG neutron_lib.callbacks.manager [None req-d7b0f62f-bcca-45b2-96df-ac34dc95d04c admin admin] Publish callbacks [] for security_group_rule (None), before_response {{(pid=77618) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:45:49 l75lg1-v1 neutron-server[77618]: INFO neutron.wsgi [None req-d7b0f62f-bcca-45b2-96df-ac34dc95d04c admin admin] 10.27.203.238 "POST /networking/v2.0/security-group-rules HTTP/1.1" status: 201 len: 817 time: 0.2098601 May 28 12:45:49 l75lg1-v1 nova-compute[83654]: DEBUG oslo_concurrency.lockutils [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=83654) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:45:49 l75lg1-v1 nova-compute[83654]: DEBUG oslo_concurrency.lockutils [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=83654) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:45:49 l75lg1-v1 nova-compute[83654]: DEBUG oslo_concurrency.lockutils [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=83654) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:45:49 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.resource_tracker [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Auditing locally available compute resources for l75lg1-v1 (node: l75lg1-v1) {{(pid=83654) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}} May 28 12:45:49 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.resource_tracker [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Hypervisor/Node resource view: name=l75lg1-v1 free_ram=11130MB free_disk=17.37017822265625GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_01_1", "address": "0000:00:01.1", "product_id": "7010", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7010", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7000", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7000", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "0100", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_0100", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_09_0", "address": "0000:00:09.0", "product_id": "1001", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1001", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "293a", "vendor_id": "8086", "numa_node": null, "label": "label_8086_293a", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_2", "address": "0000:00:07.2", "product_id": "2936", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2936", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "1237", "vendor_id": "8086", "numa_node": null, "label": "label_8086_1237", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "2935", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2935", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "2934", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2934", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_05_0", "address": "0000:00:05.0", "product_id": "1000", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1000", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "1000", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1000", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_06_0", "address": "0000:00:06.0", "product_id": "2668", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2668", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "1000", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1000", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0a_0", "address": "0000:00:0a.0", "product_id": "1002", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1002", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_3", "address": "0000:00:01.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_08_0", "address": "0000:00:08.0", "product_id": "1003", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1003", "dev_type": "type-PCI"}] {{(pid=83654) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}} May 28 12:45:49 l75lg1-v1 nova-compute[83654]: DEBUG oslo_concurrency.lockutils [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=83654) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:45:49 l75lg1-v1 nova-compute[83654]: DEBUG oslo_concurrency.lockutils [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=83654) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:45:49 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Expecting reply to msg c4758488036a44e68bc0cdb1bcdd7410 in queue reply_37f4cbd1dd094961a22b8a65f222c327 May 28 12:45:49 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [-] Received RPC response for msg c4758488036a44e68bc0cdb1bcdd7410 May 28 12:45:50 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Expecting reply to msg e2b1c24102674814882477faa73a5052 in queue reply_37f4cbd1dd094961a22b8a65f222c327 May 28 12:45:50 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [-] Received RPC response for msg e2b1c24102674814882477faa73a5052 May 28 12:45:50 l75lg1-v1 dstat.sh[49771]: 28-05 12:45:50| 10 2 87 0 0|4530M 4825M 268M 6067M| 11k 3125B| 0 544k| 0 78.0 |3756 6088 |1.53 1.78 1.32|2.0 0 24| 0 0 | 0 2048M| 27 284 0 26 0 May 28 12:45:50 l75lg1-v1 neutron-server[77623]: DEBUG neutron.db.agents_db [None req-fe40ce8c-640e-4db7-a17a-6e8888cce266 None None] Agent healthcheck: found 0 active agents {{(pid=77623) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:319}} May 28 12:45:50 l75lg1-v1 devstack@placement-api.service[78201]: DEBUG placement.requestlog [req-5d7036cb-f615-4cfe-8258-b177e5774c70 req-5804377d-94db-465d-b5de-cd0a2e381ad0 None None] Starting request: 10.27.203.238 "GET /placement/resource_providers/ef90d7d1-0808-4a15-ad77-f9a7391af2f4/allocations" {{(pid=78201) __call__ /opt/stack/placement/placement/requestlog.py:55}} May 28 12:45:50 l75lg1-v1 devstack@placement-api.service[78201]: INFO placement.requestlog [req-5d7036cb-f615-4cfe-8258-b177e5774c70 req-5804377d-94db-465d-b5de-cd0a2e381ad0 service placement] 10.27.203.238 "GET /placement/resource_providers/ef90d7d1-0808-4a15-ad77-f9a7391af2f4/allocations" status: 200 len: 54 microversion: 1.0 May 28 12:45:50 l75lg1-v1 devstack@placement-api.service[78201]: [pid: 78201|app: 0|req: 6/12] 10.27.203.238 () {62 vars in 1480 bytes} [Tue May 28 12:45:50 2024] GET /placement/resource_providers/ef90d7d1-0808-4a15-ad77-f9a7391af2f4/allocations => generated 54 bytes in 13 msecs (HTTP/1.1 200) 6 headers in 223 bytes (1 switches on core 0) May 28 12:45:50 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.resource_tracker [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Total usable vcpus: 10, total allocated vcpus: 0 {{(pid=83654) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}} May 28 12:45:50 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.resource_tracker [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Final resource view: name=l75lg1-v1 phys_ram=16000MB used_ram=512MB phys_disk=28GB used_disk=0GB total_vcpus=10 used_vcpus=0 pci_stats=[] {{(pid=83654) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}} May 28 12:45:50 l75lg1-v1 devstack@placement-api.service[78202]: DEBUG placement.requestlog [req-5d7036cb-f615-4cfe-8258-b177e5774c70 req-a07c27c0-9aa6-44e8-b2e5-233ff154397b None None] Starting request: 10.27.203.238 "GET /placement/resource_providers/ef90d7d1-0808-4a15-ad77-f9a7391af2f4/allocations" {{(pid=78202) __call__ /opt/stack/placement/placement/requestlog.py:55}} May 28 12:45:50 l75lg1-v1 devstack@placement-api.service[78202]: INFO placement.requestlog [req-5d7036cb-f615-4cfe-8258-b177e5774c70 req-a07c27c0-9aa6-44e8-b2e5-233ff154397b service placement] 10.27.203.238 "GET /placement/resource_providers/ef90d7d1-0808-4a15-ad77-f9a7391af2f4/allocations" status: 200 len: 54 microversion: 1.0 May 28 12:45:50 l75lg1-v1 devstack@placement-api.service[78202]: [pid: 78202|app: 0|req: 7/13] 10.27.203.238 () {62 vars in 1480 bytes} [Tue May 28 12:45:50 2024] GET /placement/resource_providers/ef90d7d1-0808-4a15-ad77-f9a7391af2f4/allocations => generated 54 bytes in 14 msecs (HTTP/1.1 200) 6 headers in 223 bytes (1 switches on core 0) May 28 12:45:50 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.provider_tree [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Inventory has not changed in ProviderTree for provider: ef90d7d1-0808-4a15-ad77-f9a7391af2f4 {{(pid=83654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} May 28 12:45:50 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Expecting reply to msg da871820aa094480afc4b15263047740 in queue reply_37f4cbd1dd094961a22b8a65f222c327 May 28 12:45:50 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [-] Received RPC response for msg da871820aa094480afc4b15263047740 May 28 12:45:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15c9cec-faf7-43fd-b31e-cf6df3ae4f5d None None] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:45:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15c9cec-faf7-43fd-b31e-cf6df3ae4f5d None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:45:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15c9cec-faf7-43fd-b31e-cf6df3ae4f5d None None] PATH_INFO: `/` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:45:50 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 530/1046] 10.27.203.238 () {58 vars in 1014 bytes} [Tue May 28 12:45:50 2024] GET /identity => generated 272 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:45:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e2f074-cc72-4e7d-b32b-05605423d5f5 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:45:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e2f074-cc72-4e7d-b32b-05605423d5f5 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:45:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e2f074-cc72-4e7d-b32b-05605423d5f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:45:50 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-06e2f074-cc72-4e7d-b32b-05605423d5f5 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:45:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-06e2f074-cc72-4e7d-b32b-05605423d5f5 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:45:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-06e2f074-cc72-4e7d-b32b-05605423d5f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:45:50 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 517/1047] 10.27.203.238 () {62 vars in 1111 bytes} [Tue May 28 12:45:50 2024] POST /identity/v3/auth/tokens => generated 3991 bytes in 23 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:45:51 l75lg1-v1 neutron-server[77618]: DEBUG neutron.wsgi [-] (77618) accepted ('10.27.203.238', 51888) {{(pid=77618) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 12:45:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15c9cec-faf7-43fd-b31e-cf6df3ae4f5d None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:45:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15c9cec-faf7-43fd-b31e-cf6df3ae4f5d None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:45:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62247520-5eef-47b3-9a7a-79007c455d9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef17047035e4b518fd5360a01f2da1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:45:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62247520-5eef-47b3-9a7a-79007c455d9d service neutron] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:45:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62247520-5eef-47b3-9a7a-79007c455d9d service neutron] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:45:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62247520-5eef-47b3-9a7a-79007c455d9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:45:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62247520-5eef-47b3-9a7a-79007c455d9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:45:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62247520-5eef-47b3-9a7a-79007c455d9d service neutron] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:45:51 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 531/1048] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 12:45:51 2024] GET /identity/v3/auth/tokens => generated 3991 bytes in 20 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 12:45:51 l75lg1-v1 neutron-server[77618]: INFO neutron.api.v2.resource [None req-50000a78-d09c-4041-94ef-269af96a5c2b admin admin] show failed (client error): The resource could not be found. May 28 12:45:51 l75lg1-v1 neutron-server[77618]: INFO neutron.wsgi [None req-50000a78-d09c-4041-94ef-269af96a5c2b admin admin] 10.27.203.238 "GET /networking/v2.0/security-groups/manila-service HTTP/1.1" status: 404 len: 330 time: 0.0327950 May 28 12:45:51 l75lg1-v1 neutron-server[77618]: INFO neutron.wsgi [None req-97b0e54d-050d-4389-a4e5-742abb6d6bf3 admin admin] 10.27.203.238 "GET /networking/v2.0/security-groups?name=manila-service HTTP/1.1" status: 200 len: 4973 time: 0.0423756 May 28 12:45:51 l75lg1-v1 nova-compute[83654]: DEBUG nova.scheduler.client.report [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Inventory has not changed for provider ef90d7d1-0808-4a15-ad77-f9a7391af2f4 based on inventory data: {'MEMORY_MB': {'total': 16000, 'reserved': 512, 'min_unit': 1, 'max_unit': 16000, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 10, 'reserved': 0, 'min_unit': 1, 'max_unit': 10, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 28, 'reserved': 0, 'min_unit': 1, 'max_unit': 28, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=83654) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}} May 28 12:45:51 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Expecting reply to msg 78823adb951e45e7a51e02046ad45b51 in queue reply_37f4cbd1dd094961a22b8a65f222c327 May 28 12:45:51 l75lg1-v1 neutron-server[77618]: INFO neutron.wsgi [None req-8c5e7946-acf1-4e6e-b055-9bf0e10a9a98 admin admin] 10.27.203.238 "GET /networking/v2.0/security-group-rules?security_group_id=ca135474-48d5-4746-a063-2afb7533e575 HTTP/1.1" status: 200 len: 4337 time: 0.0426152 May 28 12:45:51 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [-] Received RPC response for msg 78823adb951e45e7a51e02046ad45b51 May 28 12:45:51 l75lg1-v1 dstat.sh[49771]: 28-05 12:45:51| 11 1 88 0 0|4555M 4801M 268M 6067M| 12k 0 | 0 328k| 0 34.0 |2479 3461 |1.53 1.78 1.32|1.0 0 0| 0 0 | 0 2048M| 27 284 0 23 0 May 28 12:45:51 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.resource_tracker [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Compute_service record updated for l75lg1-v1:l75lg1-v1 {{(pid=83654) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}} May 28 12:45:51 l75lg1-v1 nova-compute[83654]: DEBUG oslo_concurrency.lockutils [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.068s {{(pid=83654) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:45:51 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:45:52 l75lg1-v1 dstat.sh[49771]: 28-05 12:45:52| 10 1 89 0 0|4539M 4817M 268M 6067M| 16k 1307B| 0 1221k| 0 214 |1964 2616 |1.49 1.77 1.31|2.0 0 20| 0 0 | 0 2048M| 27 284 0 23 0 May 28 12:45:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb208f9-a9fd-474e-b79d-439e6195cdcf None None] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:45:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb208f9-a9fd-474e-b79d-439e6195cdcf None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:45:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb208f9-a9fd-474e-b79d-439e6195cdcf None None] PATH_INFO: `/` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:45:52 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 518/1049] 10.27.203.238 () {58 vars in 1014 bytes} [Tue May 28 12:45:52 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:45:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6ce91e-4706-445a-8be1-1d68f4643d89 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:45:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6ce91e-4706-445a-8be1-1d68f4643d89 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:45:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6ce91e-4706-445a-8be1-1d68f4643d89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:45:52 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-4d6ce91e-4706-445a-8be1-1d68f4643d89 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:45:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-4d6ce91e-4706-445a-8be1-1d68f4643d89 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:45:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-4d6ce91e-4706-445a-8be1-1d68f4643d89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:45:52 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 532/1050] 10.27.203.238 () {62 vars in 1111 bytes} [Tue May 28 12:45:52 2024] POST /identity/v3/auth/tokens => generated 3991 bytes in 23 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:45:52 l75lg1-v1 neutron-server[77619]: DEBUG neutron.wsgi [-] (77619) accepted ('10.27.203.238', 51894) {{(pid=77619) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 12:45:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb208f9-a9fd-474e-b79d-439e6195cdcf None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:45:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb208f9-a9fd-474e-b79d-439e6195cdcf None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:45:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6187ed3a-1490-4a02-a9a9-7eac885c6e11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef17047035e4b518fd5360a01f2da1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:45:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6187ed3a-1490-4a02-a9a9-7eac885c6e11 service neutron] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:45:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6187ed3a-1490-4a02-a9a9-7eac885c6e11 service neutron] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:45:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6187ed3a-1490-4a02-a9a9-7eac885c6e11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:45:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6187ed3a-1490-4a02-a9a9-7eac885c6e11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:45:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6187ed3a-1490-4a02-a9a9-7eac885c6e11 service neutron] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:45:52 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 519/1051] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 12:45:52 2024] GET /identity/v3/auth/tokens => generated 3991 bytes in 20 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 12:45:52 l75lg1-v1 neutron-server[77619]: INFO neutron.api.v2.resource [None req-1aed8860-45d2-458d-8cae-b4e65c3c082d admin admin] show failed (client error): The resource could not be found. May 28 12:45:52 l75lg1-v1 neutron-server[77619]: INFO neutron.wsgi [None req-1aed8860-45d2-458d-8cae-b4e65c3c082d admin admin] 10.27.203.238 "GET /networking/v2.0/security-groups/manila-service HTTP/1.1" status: 404 len: 330 time: 0.0328579 May 28 12:45:52 l75lg1-v1 neutron-server[77619]: INFO neutron.wsgi [None req-bd91db3b-7640-4a42-b2c6-63709431430b admin admin] 10.27.203.238 "GET /networking/v2.0/security-groups?name=manila-service HTTP/1.1" status: 200 len: 4973 time: 0.0436008 May 28 12:45:52 l75lg1-v1 neutron-server[77619]: DEBUG neutron.api.v2.base [None req-84a8f4c4-7116-46cd-a682-61cd3e76e2c2 admin admin] Request body: {'security_group_rule': {'remote_ip_prefix': '0.0.0.0/0', 'protocol': 'tcp', 'direction': 'ingress', 'port_range_min': 445, 'port_range_max': 445, 'security_group_id': 'ca135474-48d5-4746-a063-2afb7533e575', 'ethertype': 'IPv4'}} {{(pid=77619) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:734}} May 28 12:45:53 l75lg1-v1 neutron-server[77619]: DEBUG neutron_lib.callbacks.manager [None req-84a8f4c4-7116-46cd-a682-61cd3e76e2c2 admin admin] Publish callbacks [] for security_group_rule (7ff2547d-b232-4c31-af6e-0d8bcfbf432f), before_create {{(pid=77619) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:45:53 l75lg1-v1 neutron-server[77619]: DEBUG neutron_lib.callbacks.manager [None req-84a8f4c4-7116-46cd-a682-61cd3e76e2c2 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver.OVNMechanismDriver._create_sg_rule_precommit-4094361'] for security_group_rule (7ff2547d-b232-4c31-af6e-0d8bcfbf432f), precommit_create {{(pid=77619) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:45:53 l75lg1-v1 neutron-server[77619]: DEBUG neutron.db.ovn_revision_numbers_db [None req-84a8f4c4-7116-46cd-a682-61cd3e76e2c2 admin admin] create_initial_revision uuid=7ff2547d-b232-4c31-af6e-0d8bcfbf432f, type=security_group_rules, rev=-1 {{(pid=77619) create_initial_revision /opt/stack/neutron/neutron/db/ovn_revision_numbers_db.py:108}} May 28 12:45:53 l75lg1-v1 neutron-server[77619]: DEBUG neutron_lib.callbacks.manager [None req-84a8f4c4-7116-46cd-a682-61cd3e76e2c2 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver.OVNMechanismDriver._process_sg_rule_notification-4094432', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4166594'] for security_group_rule (7ff2547d-b232-4c31-af6e-0d8bcfbf432f), after_create {{(pid=77619) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:45:53 l75lg1-v1 neutron-server[77619]: DEBUG ovsdbapp.backend.ovs_idl.transaction [None req-53cecb61-7023-41e4-a5ea-23b1eb02606a None None] Running txn n=1 command(idx=0): PgAclAddCommand(_result=None, entity=pg_ca135474_48d5_4746_a063_2afb7533e575, direction=to-lport, priority=1002, match=outport == @pg_ca135474_48d5_4746_a063_2afb7533e575 && ip4 && ip4.src == 0.0.0.0/0 && tcp && tcp.dst == 445, action=allow-related, log=False, may_exist=True, severity=[], name=[], meter=None, external_ids={'neutron:security_group_rule_id': '7ff2547d-b232-4c31-af6e-0d8bcfbf432f'}) {{(pid=77619) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:45:53 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-53cecb61-7023-41e4-a5ea-23b1eb02606a None None] Hash Ring: Node c89b3497-133e-4a5a-b67a-3310d2cb2485 (host: l75lg1-v1) handling event "create" for row 78af12b2-a3a1-448d-b593-b53d5e3e9843 (table: ACL) {{(pid=77619) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:45:53 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-53cecb61-7023-41e4-a5ea-23b1eb02606a None None] Hash Ring: Node c89b3497-133e-4a5a-b67a-3310d2cb2485 (host: l75lg1-v1) handling event "update" for row ac525976-5c08-4f36-8fa8-52c01ba0315a (table: Port_Group) {{(pid=77619) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:45:53 l75lg1-v1 neutron-server[77619]: INFO neutron.db.ovn_revision_numbers_db [None req-84a8f4c4-7116-46cd-a682-61cd3e76e2c2 admin admin] Successfully bumped revision number for resource 7ff2547d-b232-4c31-af6e-0d8bcfbf432f (type: security_group_rules) to 0 May 28 12:45:53 l75lg1-v1 neutron-server[77619]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-84a8f4c4-7116-46cd-a682-61cd3e76e2c2 admin admin] Pushing event updated for resources: {'SecurityGroupRule': ['ID=7ff2547d-b232-4c31-af6e-0d8bcfbf432f,revision_number=0']} {{(pid=77619) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 28 12:45:53 l75lg1-v1 neutron-server[77619]: DEBUG neutron_lib.callbacks.manager [None req-84a8f4c4-7116-46cd-a682-61cd3e76e2c2 admin admin] Publish callbacks [] for security_group_rule (None), before_response {{(pid=77619) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:45:53 l75lg1-v1 neutron-server[77619]: INFO neutron.wsgi [None req-84a8f4c4-7116-46cd-a682-61cd3e76e2c2 admin admin] 10.27.203.238 "POST /networking/v2.0/security-group-rules HTTP/1.1" status: 201 len: 817 time: 0.3613648 May 28 12:45:53 l75lg1-v1 dstat.sh[49771]: 28-05 12:45:53| 10 0 89 0 0|4556M 4800M 268M 6067M| 12k 723B| 0 520k| 0 76.0 |2629 3948 |1.49 1.77 1.31|1.0 0 0| 0 0 | 0 2048M| 27 286 0 23 0 May 28 12:45:54 l75lg1-v1 dstat.sh[49771]: 28-05 12:45:54| 9 1 89 0 0|4538M 4817M 268M 6067M| 13k 3126B| 0 500k| 0 25.0 |1945 2709 |1.49 1.77 1.31|1.0 0 24| 0 0 | 0 2048M| 27 284 0 24 0 May 28 12:45:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2160c8c-2eb2-46a6-99f4-07944f004069 None None] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:45:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2160c8c-2eb2-46a6-99f4-07944f004069 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:45:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2160c8c-2eb2-46a6-99f4-07944f004069 None None] PATH_INFO: `/` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:45:54 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 533/1052] 10.27.203.238 () {58 vars in 1014 bytes} [Tue May 28 12:45:54 2024] GET /identity => generated 272 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:45:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf0384f-7ac2-4518-a698-e68b0d10b652 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:45:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf0384f-7ac2-4518-a698-e68b0d10b652 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:45:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf0384f-7ac2-4518-a698-e68b0d10b652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:45:54 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-bcf0384f-7ac2-4518-a698-e68b0d10b652 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:45:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-bcf0384f-7ac2-4518-a698-e68b0d10b652 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:45:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-bcf0384f-7ac2-4518-a698-e68b0d10b652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:45:54 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 520/1053] 10.27.203.238 () {62 vars in 1111 bytes} [Tue May 28 12:45:54 2024] POST /identity/v3/auth/tokens => generated 3991 bytes in 26 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:45:54 l75lg1-v1 neutron-server[77619]: DEBUG neutron.wsgi [-] (77619) accepted ('10.27.203.238', 51900) {{(pid=77619) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 12:45:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2160c8c-2eb2-46a6-99f4-07944f004069 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:45:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2160c8c-2eb2-46a6-99f4-07944f004069 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:45:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a569b24-97f6-4032-a979-76816360932f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef17047035e4b518fd5360a01f2da1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:45:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a569b24-97f6-4032-a979-76816360932f service neutron] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:45:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a569b24-97f6-4032-a979-76816360932f service neutron] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:45:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a569b24-97f6-4032-a979-76816360932f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:45:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a569b24-97f6-4032-a979-76816360932f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:45:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a569b24-97f6-4032-a979-76816360932f service neutron] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:45:54 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 534/1054] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 12:45:54 2024] GET /identity/v3/auth/tokens => generated 3991 bytes in 19 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 12:45:54 l75lg1-v1 neutron-server[77619]: INFO neutron.api.v2.resource [None req-e8a8ac37-6165-4800-964f-01cb5d27db46 admin admin] show failed (client error): The resource could not be found. May 28 12:45:54 l75lg1-v1 neutron-server[77619]: INFO neutron.wsgi [None req-e8a8ac37-6165-4800-964f-01cb5d27db46 admin admin] 10.27.203.238 "GET /networking/v2.0/security-groups/manila-service HTTP/1.1" status: 404 len: 330 time: 0.0321839 May 28 12:45:54 l75lg1-v1 neutron-server[77619]: INFO neutron.wsgi [None req-6155db57-b2a6-4f8c-abee-b7171b4d7622 admin admin] 10.27.203.238 "GET /networking/v2.0/security-groups?name=manila-service HTTP/1.1" status: 200 len: 5599 time: 0.0466552 May 28 12:45:54 l75lg1-v1 neutron-server[77619]: INFO neutron.wsgi [None req-91c4980a-e2d5-48c4-8ea5-73fe1eb7140b admin admin] 10.27.203.238 "GET /networking/v2.0/security-group-rules?security_group_id=ca135474-48d5-4746-a063-2afb7533e575 HTTP/1.1" status: 200 len: 4927 time: 0.0477464 May 28 12:45:55 l75lg1-v1 dstat.sh[49771]: 28-05 12:45:55| 9 1 89 0 0|4502M 4854M 268M 6067M| 16k 1306B| 0 240k| 0 19.0 |2015 3626 |1.49 1.77 1.31|2.0 0 20| 0 0 | 0 2048M| 27 284 0 25 0 May 28 12:45:56 l75lg1-v1 dstat.sh[49771]: 28-05 12:45:56| 10 1 89 0 0|4545M 4811M 268M 6067M| 11k 172B| 0 192k| 0 15.0 |1616 2281 |1.49 1.77 1.31|1.0 0 0| 0 0 | 0 2048M| 27 284 0 25 0 May 28 12:45:56 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d105f6-48d8-4676-8f30-724845e0ca20 None None] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:45:56 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d105f6-48d8-4676-8f30-724845e0ca20 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:45:56 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d105f6-48d8-4676-8f30-724845e0ca20 None None] PATH_INFO: `/` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:45:56 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 521/1055] 10.27.203.238 () {58 vars in 1014 bytes} [Tue May 28 12:45:56 2024] GET /identity => generated 272 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:45:56 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c4eff8-2268-4019-8360-512ba12d7696 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:45:56 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c4eff8-2268-4019-8360-512ba12d7696 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:45:56 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c4eff8-2268-4019-8360-512ba12d7696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:45:56 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-69c4eff8-2268-4019-8360-512ba12d7696 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:45:56 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-69c4eff8-2268-4019-8360-512ba12d7696 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:45:56 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-69c4eff8-2268-4019-8360-512ba12d7696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:45:56 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 535/1056] 10.27.203.238 () {62 vars in 1111 bytes} [Tue May 28 12:45:56 2024] POST /identity/v3/auth/tokens => generated 3991 bytes in 22 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 28 12:45:56 l75lg1-v1 neutron-server[77619]: DEBUG neutron.wsgi [-] (77619) accepted ('10.27.203.238', 51904) {{(pid=77619) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 12:45:56 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d105f6-48d8-4676-8f30-724845e0ca20 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:45:56 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d105f6-48d8-4676-8f30-724845e0ca20 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:45:56 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95ec661-5142-4428-b18d-afd569dc6ff6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef17047035e4b518fd5360a01f2da1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:45:56 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95ec661-5142-4428-b18d-afd569dc6ff6 service neutron] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:45:56 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95ec661-5142-4428-b18d-afd569dc6ff6 service neutron] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:45:56 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95ec661-5142-4428-b18d-afd569dc6ff6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:45:56 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95ec661-5142-4428-b18d-afd569dc6ff6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:45:56 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95ec661-5142-4428-b18d-afd569dc6ff6 service neutron] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:45:56 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 522/1057] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 12:45:56 2024] GET /identity/v3/auth/tokens => generated 3991 bytes in 20 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 12:45:56 l75lg1-v1 neutron-server[77619]: INFO neutron.api.v2.resource [None req-0402ee02-34b7-43c7-81f1-6d351d7a3b57 admin admin] show failed (client error): The resource could not be found. May 28 12:45:56 l75lg1-v1 neutron-server[77619]: INFO neutron.wsgi [None req-0402ee02-34b7-43c7-81f1-6d351d7a3b57 admin admin] 10.27.203.238 "GET /networking/v2.0/security-groups/manila-service HTTP/1.1" status: 404 len: 330 time: 0.0325005 May 28 12:45:56 l75lg1-v1 neutron-server[77619]: INFO neutron.wsgi [None req-f6a8614d-9710-408b-9a16-dc0c94dea1b4 admin admin] 10.27.203.238 "GET /networking/v2.0/security-groups?name=manila-service HTTP/1.1" status: 200 len: 5599 time: 0.0467820 May 28 12:45:56 l75lg1-v1 neutron-server[77619]: DEBUG neutron.api.v2.base [None req-4538a5e8-73b2-4857-8b78-3745a1ffd0a0 admin admin] Request body: {'security_group_rule': {'direction': 'ingress', 'port_range_max': 139, 'ethertype': 'IPv4', 'port_range_min': 137, 'remote_ip_prefix': '0.0.0.0/0', 'security_group_id': 'ca135474-48d5-4746-a063-2afb7533e575', 'protocol': 'tcp'}} {{(pid=77619) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:734}} May 28 12:45:56 l75lg1-v1 neutron-server[77619]: DEBUG neutron_lib.callbacks.manager [None req-4538a5e8-73b2-4857-8b78-3745a1ffd0a0 admin admin] Publish callbacks [] for security_group_rule (eff18c36-51e9-4cef-83bb-ac5afb5f27ed), before_create {{(pid=77619) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:45:57 l75lg1-v1 neutron-server[77619]: DEBUG neutron_lib.callbacks.manager [None req-4538a5e8-73b2-4857-8b78-3745a1ffd0a0 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver.OVNMechanismDriver._create_sg_rule_precommit-4094361'] for security_group_rule (eff18c36-51e9-4cef-83bb-ac5afb5f27ed), precommit_create {{(pid=77619) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:45:57 l75lg1-v1 neutron-server[77619]: DEBUG neutron.db.ovn_revision_numbers_db [None req-4538a5e8-73b2-4857-8b78-3745a1ffd0a0 admin admin] create_initial_revision uuid=eff18c36-51e9-4cef-83bb-ac5afb5f27ed, type=security_group_rules, rev=-1 {{(pid=77619) create_initial_revision /opt/stack/neutron/neutron/db/ovn_revision_numbers_db.py:108}} May 28 12:45:57 l75lg1-v1 neutron-server[77619]: DEBUG neutron_lib.callbacks.manager [None req-4538a5e8-73b2-4857-8b78-3745a1ffd0a0 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver.OVNMechanismDriver._process_sg_rule_notification-4094432', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4166594'] for security_group_rule (eff18c36-51e9-4cef-83bb-ac5afb5f27ed), after_create {{(pid=77619) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:45:57 l75lg1-v1 neutron-server[77619]: DEBUG ovsdbapp.backend.ovs_idl.transaction [None req-53cecb61-7023-41e4-a5ea-23b1eb02606a None None] Running txn n=1 command(idx=0): PgAclAddCommand(_result=None, entity=pg_ca135474_48d5_4746_a063_2afb7533e575, direction=to-lport, priority=1002, match=outport == @pg_ca135474_48d5_4746_a063_2afb7533e575 && ip4 && ip4.src == 0.0.0.0/0 && tcp && tcp.dst >= 137 && tcp.dst <= 139, action=allow-related, log=False, may_exist=True, severity=[], name=[], meter=None, external_ids={'neutron:security_group_rule_id': 'eff18c36-51e9-4cef-83bb-ac5afb5f27ed'}) {{(pid=77619) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:45:57 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-53cecb61-7023-41e4-a5ea-23b1eb02606a None None] Hash Ring: Node c89b3497-133e-4a5a-b67a-3310d2cb2485 (host: l75lg1-v1) handling event "create" for row 97a580d4-182a-40a3-a05c-66db8a55817d (table: ACL) {{(pid=77619) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:45:57 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-53cecb61-7023-41e4-a5ea-23b1eb02606a None None] Hash Ring: Node c89b3497-133e-4a5a-b67a-3310d2cb2485 (host: l75lg1-v1) handling event "update" for row ac525976-5c08-4f36-8fa8-52c01ba0315a (table: Port_Group) {{(pid=77619) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:45:57 l75lg1-v1 neutron-server[77619]: INFO neutron.db.ovn_revision_numbers_db [None req-4538a5e8-73b2-4857-8b78-3745a1ffd0a0 admin admin] Successfully bumped revision number for resource eff18c36-51e9-4cef-83bb-ac5afb5f27ed (type: security_group_rules) to 0 May 28 12:45:57 l75lg1-v1 neutron-server[77619]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4538a5e8-73b2-4857-8b78-3745a1ffd0a0 admin admin] Pushing event updated for resources: {'SecurityGroupRule': ['ID=eff18c36-51e9-4cef-83bb-ac5afb5f27ed,revision_number=0']} {{(pid=77619) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 28 12:45:57 l75lg1-v1 neutron-server[77619]: DEBUG neutron_lib.callbacks.manager [None req-4538a5e8-73b2-4857-8b78-3745a1ffd0a0 admin admin] Publish callbacks [] for security_group_rule (None), before_response {{(pid=77619) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:45:57 l75lg1-v1 neutron-server[77619]: INFO neutron.wsgi [None req-4538a5e8-73b2-4857-8b78-3745a1ffd0a0 admin admin] 10.27.203.238 "POST /networking/v2.0/security-group-rules HTTP/1.1" status: 201 len: 817 time: 0.2521610 May 28 12:45:57 l75lg1-v1 dstat.sh[49771]: 28-05 12:45:57| 10 1 89 1 0|4557M 4799M 268M 6067M| 13k 0 | 0 1304k| 0 221 |2853 4402 |1.53 1.77 1.32|3.0 0 0| 0 0 | 0 2048M| 27 284 0 25 0 May 28 12:45:58 l75lg1-v1 dstat.sh[49771]: 28-05 12:45:58| 9 2 88 0 0|4545M 4810M 268M 6067M| 15k 3168B| 0 304k| 0 33.0 |2081 2959 |1.53 1.77 1.32|2.0 0 26| 0 0 | 0 2048M| 27 284 0 25 0 May 28 12:45:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aa8c1a-08a8-40c0-a39a-78a9df4ee5b6 None None] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:45:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aa8c1a-08a8-40c0-a39a-78a9df4ee5b6 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:45:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aa8c1a-08a8-40c0-a39a-78a9df4ee5b6 None None] PATH_INFO: `/` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:45:58 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 536/1058] 10.27.203.238 () {58 vars in 1014 bytes} [Tue May 28 12:45:58 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:45:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a879a6-0a77-49ce-9bbf-e60553f631ac None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:45:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a879a6-0a77-49ce-9bbf-e60553f631ac None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:45:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a879a6-0a77-49ce-9bbf-e60553f631ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:45:58 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-52a879a6-0a77-49ce-9bbf-e60553f631ac None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:45:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-52a879a6-0a77-49ce-9bbf-e60553f631ac None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:45:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-52a879a6-0a77-49ce-9bbf-e60553f631ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:45:58 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 523/1059] 10.27.203.238 () {62 vars in 1111 bytes} [Tue May 28 12:45:58 2024] POST /identity/v3/auth/tokens => generated 3991 bytes in 23 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:45:58 l75lg1-v1 neutron-server[77619]: DEBUG neutron.wsgi [-] (77619) accepted ('10.27.203.238', 51914) {{(pid=77619) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 12:45:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aa8c1a-08a8-40c0-a39a-78a9df4ee5b6 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:45:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aa8c1a-08a8-40c0-a39a-78a9df4ee5b6 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:45:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf11fbd-c6ba-492c-9d70-b52738048b31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef17047035e4b518fd5360a01f2da1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:45:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf11fbd-c6ba-492c-9d70-b52738048b31 service neutron] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:45:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf11fbd-c6ba-492c-9d70-b52738048b31 service neutron] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:45:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf11fbd-c6ba-492c-9d70-b52738048b31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:45:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf11fbd-c6ba-492c-9d70-b52738048b31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:45:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf11fbd-c6ba-492c-9d70-b52738048b31 service neutron] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:45:58 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 537/1060] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 12:45:58 2024] GET /identity/v3/auth/tokens => generated 3991 bytes in 20 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 12:45:58 l75lg1-v1 neutron-server[77619]: INFO neutron.api.v2.resource [None req-f163e705-bde6-4e7a-ba8b-3d964c89ef91 admin admin] show failed (client error): The resource could not be found. May 28 12:45:58 l75lg1-v1 neutron-server[77619]: INFO neutron.wsgi [None req-f163e705-bde6-4e7a-ba8b-3d964c89ef91 admin admin] 10.27.203.238 "GET /networking/v2.0/security-groups/manila-service HTTP/1.1" status: 404 len: 330 time: 0.0330081 May 28 12:45:58 l75lg1-v1 neutron-server[77619]: INFO neutron.wsgi [None req-f9b8acdf-d221-4ceb-a8c6-d14e5ae9fddf admin admin] 10.27.203.238 "GET /networking/v2.0/security-groups?name=manila-service HTTP/1.1" status: 200 len: 6225 time: 0.0508235 May 28 12:45:58 l75lg1-v1 neutron-server[77619]: INFO neutron.wsgi [None req-a4aae7ad-dd63-4bc1-b761-a6b58a1e2e71 admin admin] 10.27.203.238 "GET /networking/v2.0/security-group-rules?security_group_id=ca135474-48d5-4746-a063-2afb7533e575 HTTP/1.1" status: 200 len: 5517 time: 0.0512929 May 28 12:45:59 l75lg1-v1 dstat.sh[49771]: 28-05 12:45:59| 10 1 89 0 0|4510M 4846M 268M 6067M| 19k 1305B| 0 996k| 0 82.0 |2237 2945 |1.53 1.77 1.32|1.0 0 20| 0 0 | 0 2048M| 27 284 0 26 0 May 28 12:45:59 l75lg1-v1 nova-conductor[83648]: DEBUG dbcounter [-] [83648] Writing DB stats nova_cell1:SELECT=3 {{(pid=83648) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:46:00 l75lg1-v1 dstat.sh[49771]: 28-05 12:46:00| 9 1 89 0 0|4556M 4800M 268M 6067M| 10k 0 | 0 380k| 0 37.0 |1803 2709 |1.53 1.77 1.32|2.0 0 0| 0 0 | 0 2048M| 27 284 0 26 0 May 28 12:46:00 l75lg1-v1 neutron-server[77618]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.HashRingHealthCheckPeriodics.touch_hash_ring_nodes' {{(pid=77618) _process_scheduled /opt/stack/data/venv/lib/python3.10/site-packages/futurist/periodics.py:638}} May 28 12:46:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b50c47-074e-425f-85fb-b45072c5a842 None None] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:46:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b50c47-074e-425f-85fb-b45072c5a842 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:46:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b50c47-074e-425f-85fb-b45072c5a842 None None] PATH_INFO: `/` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:46:00 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 524/1061] 10.27.203.238 () {58 vars in 1014 bytes} [Tue May 28 12:46:00 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:46:00 l75lg1-v1 neutron-server[77623]: DEBUG dbcounter [-] [77623] Writing DB stats neutron:SELECT=1 {{(pid=77623) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:46:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06fb697-5572-42a4-8abe-54a2bb3fd8be None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:46:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06fb697-5572-42a4-8abe-54a2bb3fd8be None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:46:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06fb697-5572-42a4-8abe-54a2bb3fd8be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:46:00 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-a06fb697-5572-42a4-8abe-54a2bb3fd8be None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:46:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-a06fb697-5572-42a4-8abe-54a2bb3fd8be None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:46:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-a06fb697-5572-42a4-8abe-54a2bb3fd8be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:46:00 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 538/1062] 10.27.203.238 () {62 vars in 1111 bytes} [Tue May 28 12:46:00 2024] POST /identity/v3/auth/tokens => generated 3991 bytes in 22 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:46:00 l75lg1-v1 neutron-server[77618]: DEBUG neutron.wsgi [-] (77618) accepted ('10.27.203.238', 54932) {{(pid=77618) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 12:46:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b50c47-074e-425f-85fb-b45072c5a842 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:46:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b50c47-074e-425f-85fb-b45072c5a842 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:46:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cfbd1d-aefa-4c37-8dd4-b8827b4d71bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef17047035e4b518fd5360a01f2da1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:46:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cfbd1d-aefa-4c37-8dd4-b8827b4d71bd service neutron] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:46:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cfbd1d-aefa-4c37-8dd4-b8827b4d71bd service neutron] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:46:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cfbd1d-aefa-4c37-8dd4-b8827b4d71bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:46:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cfbd1d-aefa-4c37-8dd4-b8827b4d71bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:46:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cfbd1d-aefa-4c37-8dd4-b8827b4d71bd service neutron] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:46:00 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 525/1063] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 12:46:00 2024] GET /identity/v3/auth/tokens => generated 3991 bytes in 20 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 12:46:00 l75lg1-v1 neutron-server[77618]: INFO neutron.api.v2.resource [None req-f5e17e97-ceab-42fc-bf98-25088770869d admin admin] show failed (client error): The resource could not be found. May 28 12:46:00 l75lg1-v1 neutron-server[77618]: INFO neutron.wsgi [None req-f5e17e97-ceab-42fc-bf98-25088770869d admin admin] 10.27.203.238 "GET /networking/v2.0/security-groups/manila-service HTTP/1.1" status: 404 len: 330 time: 0.0330806 May 28 12:46:00 l75lg1-v1 neutron-server[77618]: INFO neutron.wsgi [None req-b955a17d-5883-42ce-bba8-c666e268e0c3 admin admin] 10.27.203.238 "GET /networking/v2.0/security-groups?name=manila-service HTTP/1.1" status: 200 len: 6225 time: 0.0494540 May 28 12:46:00 l75lg1-v1 neutron-server[77618]: DEBUG neutron.api.v2.base [None req-df930dbd-b248-410b-bd3b-534479a92065 admin admin] Request body: {'security_group_rule': {'port_range_min': 137, 'security_group_id': 'ca135474-48d5-4746-a063-2afb7533e575', 'port_range_max': 139, 'remote_ip_prefix': '0.0.0.0/0', 'ethertype': 'IPv4', 'protocol': 'udp', 'direction': 'ingress'}} {{(pid=77618) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:734}} May 28 12:46:00 l75lg1-v1 devstack@placement-api.service[78201]: DEBUG dbcounter [-] [78201] Writing DB stats placement:SELECT=2 {{(pid=78201) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:46:00 l75lg1-v1 neutron-server[77618]: DEBUG neutron_lib.callbacks.manager [None req-df930dbd-b248-410b-bd3b-534479a92065 admin admin] Publish callbacks [] for security_group_rule (979b3813-be8d-4b18-b055-aad6aded7594), before_create {{(pid=77618) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:46:00 l75lg1-v1 devstack@placement-api.service[78202]: DEBUG dbcounter [-] [78202] Writing DB stats placement:SELECT=2 {{(pid=78202) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:46:00 l75lg1-v1 neutron-server[77618]: DEBUG neutron_lib.callbacks.manager [None req-df930dbd-b248-410b-bd3b-534479a92065 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver.OVNMechanismDriver._create_sg_rule_precommit-4094361'] for security_group_rule (979b3813-be8d-4b18-b055-aad6aded7594), precommit_create {{(pid=77618) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:46:00 l75lg1-v1 neutron-server[77618]: DEBUG neutron.db.ovn_revision_numbers_db [None req-df930dbd-b248-410b-bd3b-534479a92065 admin admin] create_initial_revision uuid=979b3813-be8d-4b18-b055-aad6aded7594, type=security_group_rules, rev=-1 {{(pid=77618) create_initial_revision /opt/stack/neutron/neutron/db/ovn_revision_numbers_db.py:108}} May 28 12:46:00 l75lg1-v1 neutron-server[77618]: DEBUG neutron_lib.callbacks.manager [None req-df930dbd-b248-410b-bd3b-534479a92065 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver.OVNMechanismDriver._process_sg_rule_notification-4094432', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4166594'] for security_group_rule (979b3813-be8d-4b18-b055-aad6aded7594), after_create {{(pid=77618) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:46:00 l75lg1-v1 neutron-server[77618]: DEBUG ovsdbapp.backend.ovs_idl.transaction [None req-c63b1acc-b5c6-4be8-9db9-04824fec27f2 None None] Running txn n=1 command(idx=0): PgAclAddCommand(_result=None, entity=pg_ca135474_48d5_4746_a063_2afb7533e575, direction=to-lport, priority=1002, match=outport == @pg_ca135474_48d5_4746_a063_2afb7533e575 && ip4 && ip4.src == 0.0.0.0/0 && udp && udp.dst >= 137 && udp.dst <= 139, action=allow-related, log=False, may_exist=True, severity=[], name=[], meter=None, external_ids={'neutron:security_group_rule_id': '979b3813-be8d-4b18-b055-aad6aded7594'}) {{(pid=77618) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:46:00 l75lg1-v1 neutron-server[77618]: DEBUG neutron.common.ovn.hash_ring_manager [None req-c63b1acc-b5c6-4be8-9db9-04824fec27f2 None None] Hash Ring loaded. 2 active nodes. 0 offline nodes {{(pid=77618) _load_hash_ring /opt/stack/neutron/neutron/common/ovn/hash_ring_manager.py:99}} May 28 12:46:00 l75lg1-v1 neutron-server[77621]: DEBUG neutron.common.ovn.hash_ring_manager [-] Hash Ring loaded. 2 active nodes. 0 offline nodes {{(pid=77621) _load_hash_ring /opt/stack/neutron/neutron/common/ovn/hash_ring_manager.py:99}} May 28 12:46:00 l75lg1-v1 neutron-server[77619]: DEBUG neutron.common.ovn.hash_ring_manager [None req-53cecb61-7023-41e4-a5ea-23b1eb02606a None None] Hash Ring loaded. 2 active nodes. 0 offline nodes {{(pid=77619) _load_hash_ring /opt/stack/neutron/neutron/common/ovn/hash_ring_manager.py:99}} May 28 12:46:00 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-53cecb61-7023-41e4-a5ea-23b1eb02606a None None] Hash Ring: Node c89b3497-133e-4a5a-b67a-3310d2cb2485 (host: l75lg1-v1) handling event "create" for row 7fac5f06-09a2-4bb1-825f-fb42a7f20761 (table: ACL) {{(pid=77619) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:46:00 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-53cecb61-7023-41e4-a5ea-23b1eb02606a None None] Hash Ring: Node c89b3497-133e-4a5a-b67a-3310d2cb2485 (host: l75lg1-v1) handling event "update" for row ac525976-5c08-4f36-8fa8-52c01ba0315a (table: Port_Group) {{(pid=77619) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:46:00 l75lg1-v1 neutron-server[77618]: INFO neutron.db.ovn_revision_numbers_db [None req-df930dbd-b248-410b-bd3b-534479a92065 admin admin] Successfully bumped revision number for resource 979b3813-be8d-4b18-b055-aad6aded7594 (type: security_group_rules) to 0 May 28 12:46:00 l75lg1-v1 neutron-server[77618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-df930dbd-b248-410b-bd3b-534479a92065 admin admin] Pushing event updated for resources: {'SecurityGroupRule': ['ID=979b3813-be8d-4b18-b055-aad6aded7594,revision_number=0']} {{(pid=77618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 28 12:46:00 l75lg1-v1 neutron-server[77618]: DEBUG neutron_lib.callbacks.manager [None req-df930dbd-b248-410b-bd3b-534479a92065 admin admin] Publish callbacks [] for security_group_rule (None), before_response {{(pid=77618) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:46:00 l75lg1-v1 neutron-server[77618]: INFO neutron.wsgi [None req-df930dbd-b248-410b-bd3b-534479a92065 admin admin] 10.27.203.238 "POST /networking/v2.0/security-group-rules HTTP/1.1" status: 201 len: 817 time: 0.2598825 May 28 12:46:01 l75lg1-v1 nova-conductor[83647]: DEBUG dbcounter [-] [83647] Writing DB stats nova_cell1:SELECT=4,nova_cell1:UPDATE=2 {{(pid=83647) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:46:01 l75lg1-v1 dstat.sh[49771]: 28-05 12:46:01| 10 1 87 1 0|4512M 4844M 268M 6067M| 14k 2920B| 0 820k| 0 120 |3610 5513 |1.53 1.77 1.32|2.0 0 20| 0 0 | 0 2048M| 27 284 0 27 0 May 28 12:46:02 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d29d61-5e5d-4966-b975-f36407603398 None None] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:46:02 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d29d61-5e5d-4966-b975-f36407603398 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:46:02 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d29d61-5e5d-4966-b975-f36407603398 None None] PATH_INFO: `/` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:46:02 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 539/1064] 10.27.203.238 () {58 vars in 1014 bytes} [Tue May 28 12:46:02 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:46:02 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0de7b3-51b6-497e-ae32-afcc34bdb0a8 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:46:02 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0de7b3-51b6-497e-ae32-afcc34bdb0a8 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:46:02 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0de7b3-51b6-497e-ae32-afcc34bdb0a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:46:02 l75lg1-v1 dstat.sh[49771]: 28-05 12:46:02| 10 1 89 0 0|4558M 4798M 268M 6067M| 21k 0 | 0 260k| 0 18.0 |1719 2331 |1.49 1.76 1.32|1.0 0 0| 0 0 | 0 2048M| 27 285 0 27 0 May 28 12:46:02 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-1c0de7b3-51b6-497e-ae32-afcc34bdb0a8 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:46:02 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-1c0de7b3-51b6-497e-ae32-afcc34bdb0a8 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:46:02 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-1c0de7b3-51b6-497e-ae32-afcc34bdb0a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:46:02 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 526/1065] 10.27.203.238 () {62 vars in 1111 bytes} [Tue May 28 12:46:02 2024] POST /identity/v3/auth/tokens => generated 3991 bytes in 23 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:46:02 l75lg1-v1 neutron-server[77619]: DEBUG neutron.wsgi [-] (77619) accepted ('10.27.203.238', 54942) {{(pid=77619) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 12:46:02 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d29d61-5e5d-4966-b975-f36407603398 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:46:02 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d29d61-5e5d-4966-b975-f36407603398 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:46:02 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf134ebd-cc31-43e1-a55c-200ad185c4b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef17047035e4b518fd5360a01f2da1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:46:02 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf134ebd-cc31-43e1-a55c-200ad185c4b1 service neutron] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:46:02 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf134ebd-cc31-43e1-a55c-200ad185c4b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:46:02 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf134ebd-cc31-43e1-a55c-200ad185c4b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:46:02 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf134ebd-cc31-43e1-a55c-200ad185c4b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:46:02 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf134ebd-cc31-43e1-a55c-200ad185c4b1 service neutron] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:46:02 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 540/1066] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 12:46:02 2024] GET /identity/v3/auth/tokens => generated 3991 bytes in 19 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 12:46:02 l75lg1-v1 neutron-server[77619]: INFO neutron.api.v2.resource [None req-f0c1b5da-e467-496b-b97e-7a3853af697b admin admin] show failed (client error): The resource could not be found. May 28 12:46:02 l75lg1-v1 neutron-server[77619]: INFO neutron.wsgi [None req-f0c1b5da-e467-496b-b97e-7a3853af697b admin admin] 10.27.203.238 "GET /networking/v2.0/security-groups/manila-service HTTP/1.1" status: 404 len: 330 time: 0.0322888 May 28 12:46:02 l75lg1-v1 neutron-server[77619]: INFO neutron.wsgi [None req-5a160487-dd52-4d33-b594-deee64af73c2 admin admin] 10.27.203.238 "GET /networking/v2.0/security-groups?name=manila-service HTTP/1.1" status: 200 len: 6851 time: 0.0539622 May 28 12:46:02 l75lg1-v1 neutron-server[77619]: INFO neutron.wsgi [None req-be178fb2-8ff1-4ff6-bae1-cf9d7f19ed6e admin admin] 10.27.203.238 "GET /networking/v2.0/security-group-rules?security_group_id=ca135474-48d5-4746-a063-2afb7533e575 HTTP/1.1" status: 200 len: 6107 time: 0.0559456 May 28 12:46:03 l75lg1-v1 dstat.sh[49771]: 28-05 12:46:03| 10 1 89 0 0|4524M 4831M 268M 6067M| 16k 5794B| 0 264k| 0 21.0 |2352 3041 |1.49 1.76 1.32|1.0 0 48| 0 0 | 0 2048M| 27 284 0 28 0 May 28 12:46:04 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652b94ca-fd03-4e34-8713-6ead7e7ee0f5 None None] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:46:04 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652b94ca-fd03-4e34-8713-6ead7e7ee0f5 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:46:04 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652b94ca-fd03-4e34-8713-6ead7e7ee0f5 None None] PATH_INFO: `/` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:46:04 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 527/1067] 10.27.203.238 () {58 vars in 1014 bytes} [Tue May 28 12:46:04 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:46:04 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba929ca0-f493-45fb-af70-eda42554a3bf None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:46:04 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba929ca0-f493-45fb-af70-eda42554a3bf None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:46:04 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba929ca0-f493-45fb-af70-eda42554a3bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:46:04 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-ba929ca0-f493-45fb-af70-eda42554a3bf None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:46:04 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-ba929ca0-f493-45fb-af70-eda42554a3bf None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:46:04 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-ba929ca0-f493-45fb-af70-eda42554a3bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:46:04 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 541/1068] 10.27.203.238 () {62 vars in 1111 bytes} [Tue May 28 12:46:04 2024] POST /identity/v3/auth/tokens => generated 3991 bytes in 22 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:46:04 l75lg1-v1 dstat.sh[49771]: 28-05 12:46:04| 9 1 89 0 0|4561M 4795M 268M 6067M| 16k 214B| 0 216k| 0 19.0 |1706 2251 |1.49 1.76 1.32|2.0 0 0| 0 0 | 0 2048M| 27 284 0 28 0 May 28 12:46:05 l75lg1-v1 dstat.sh[49771]: 28-05 12:46:05| 10 1 88 0 0|4537M 4818M 268M 6067M| 16k 1846B| 0 1080k| 0 81.0 |2130 2849 |1.49 1.76 1.32|1.0 0 27| 0 0 | 0 2048M| 27 284 0 25 0 May 28 12:46:05 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7e6504-d477-4d4a-ae13-60dd5c15996e None None] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:46:05 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7e6504-d477-4d4a-ae13-60dd5c15996e None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:46:05 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7e6504-d477-4d4a-ae13-60dd5c15996e None None] PATH_INFO: `/` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:46:05 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 528/1069] 10.27.203.238 () {58 vars in 1014 bytes} [Tue May 28 12:46:05 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:46:05 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7cfd70-75c0-4140-b781-f44f260ef681 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:46:05 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7cfd70-75c0-4140-b781-f44f260ef681 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:46:05 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7cfd70-75c0-4140-b781-f44f260ef681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:46:05 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-2c7cfd70-75c0-4140-b781-f44f260ef681 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:46:05 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-2c7cfd70-75c0-4140-b781-f44f260ef681 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:46:05 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-2c7cfd70-75c0-4140-b781-f44f260ef681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:46:05 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 542/1070] 10.27.203.238 () {62 vars in 1111 bytes} [Tue May 28 12:46:05 2024] POST /identity/v3/auth/tokens => generated 3991 bytes in 23 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:46:05 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.api.middleware.version_negotiation [None req-f52a0db2-5bc1-468f-ab7f-e64deaa5c901 admin admin] Determining version of request: GET / Accept: application/json {{(pid=86373) process_request /opt/stack/glance/glance/api/middleware/version_negotiation.py:44}} May 28 12:46:05 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.api.middleware.version_negotiation [None req-f52a0db2-5bc1-468f-ab7f-e64deaa5c901 admin admin] Using url versioning {{(pid=86373) process_request /opt/stack/glance/glance/api/middleware/version_negotiation.py:57}} May 28 12:46:05 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.api.middleware.version_negotiation [None req-f52a0db2-5bc1-468f-ab7f-e64deaa5c901 admin admin] Unknown version. Returning version choices. {{(pid=86373) process_request /opt/stack/glance/glance/api/middleware/version_negotiation.py:64}} May 28 12:46:05 l75lg1-v1 devstack@g-api.service[86373]: [pid: 86373|app: 0|req: 2/5] 127.0.0.1 () {34 vars in 509 bytes} [Tue May 28 12:46:05 2024] GET / => generated 1323 bytes in 3 msecs (HTTP/1.1 300) 3 headers in 106 bytes (1 switches on core 0) May 28 12:46:05 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.api.middleware.version_negotiation [None req-a612c2c5-bdab-4a55-8f6b-1d81426dfcbd admin admin] Determining version of request: GET /v2/images Accept: application/json {{(pid=86374) process_request /opt/stack/glance/glance/api/middleware/version_negotiation.py:44}} May 28 12:46:05 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.api.middleware.version_negotiation [None req-a612c2c5-bdab-4a55-8f6b-1d81426dfcbd admin admin] Using url versioning {{(pid=86374) process_request /opt/stack/glance/glance/api/middleware/version_negotiation.py:57}} May 28 12:46:05 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.api.middleware.version_negotiation [None req-a612c2c5-bdab-4a55-8f6b-1d81426dfcbd admin admin] Matched version: v2 {{(pid=86374) process_request /opt/stack/glance/glance/api/middleware/version_negotiation.py:69}} May 28 12:46:05 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.api.middleware.version_negotiation [None req-a612c2c5-bdab-4a55-8f6b-1d81426dfcbd admin admin] new path /v2/images {{(pid=86374) process_request /opt/stack/glance/glance/api/middleware/version_negotiation.py:70}} May 28 12:46:05 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77c8593-21d6-4d55-8794-4d1c1751b9c3 None None] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:46:05 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77c8593-21d6-4d55-8794-4d1c1751b9c3 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:46:05 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77c8593-21d6-4d55-8794-4d1c1751b9c3 None None] PATH_INFO: `/` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:46:05 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 529/1071] 10.27.203.238 () {58 vars in 1055 bytes} [Tue May 28 12:46:05 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:46:05 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d62cf64-42e7-40be-bfc8-032733ae03c8 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:46:05 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d62cf64-42e7-40be-bfc8-032733ae03c8 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:46:05 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d62cf64-42e7-40be-bfc8-032733ae03c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:46:05 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-3d62cf64-42e7-40be-bfc8-032733ae03c8 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:46:05 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-3d62cf64-42e7-40be-bfc8-032733ae03c8 None None] MFA Rules not processed for user `d1436e60c2e34e0b8af9ae1c668bdf03`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:46:05 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-3d62cf64-42e7-40be-bfc8-032733ae03c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:46:05 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 543/1072] 10.27.203.238 () {62 vars in 1152 bytes} [Tue May 28 12:46:05 2024] POST /identity/v3/auth/tokens => generated 3809 bytes in 23 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:46:05 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77c8593-21d6-4d55-8794-4d1c1751b9c3 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:46:05 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77c8593-21d6-4d55-8794-4d1c1751b9c3 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:46:05 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2b2b76-e945-4b9e-a595-d2b10f2d4ea1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1436e60c2e34e0b8af9ae1c668bdf03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:46:05 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2b2b76-e945-4b9e-a595-d2b10f2d4ea1 service glance] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:46:05 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2b2b76-e945-4b9e-a595-d2b10f2d4ea1 service glance] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:46:05 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2b2b76-e945-4b9e-a595-d2b10f2d4ea1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:46:05 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2b2b76-e945-4b9e-a595-d2b10f2d4ea1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:46:05 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2b2b76-e945-4b9e-a595-d2b10f2d4ea1 service glance] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:46:05 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 530/1073] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 12:46:05 2024] GET /identity/v3/auth/tokens => generated 3991 bytes in 24 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 12:46:06 l75lg1-v1 devstack@g-api.service[86374]: [pid: 86374|app: 0|req: 4/6] 127.0.0.1 () {36 vars in 731 bytes} [Tue May 28 12:46:05 2024] GET /v2/images => generated 1045 bytes in 88 msecs (HTTP/1.1 200) 4 headers in 158 bytes (1 switches on core 0) May 28 12:46:06 l75lg1-v1 dstat.sh[49771]: 28-05 12:46:06| 9 2 89 0 0|4503M 4853M 268M 6067M| 15k 4419B| 0 76k| 0 8.00 |2338 3212 |1.49 1.76 1.32| 0 0 37| 0 0 | 0 2048M| 27 284 0 28 0 May 28 12:46:07 l75lg1-v1 dstat.sh[49771]: 28-05 12:46:07| 0 0 99 0 0|4503M 4852M 268M 6067M| 15k 398B| 0 72k| 0 5.00 |1404 2126 |1.37 1.73 1.31| 0 0 0| 0 0 | 0 2048M| 27 284 0 28 0 May 28 12:46:08 l75lg1-v1 dstat.sh[49771]: 28-05 12:46:08| 0 0 99 0 0|4503M 4852M 268M 6067M|9699B 86B| 0 1280k| 0 240 |1529 2437 |1.37 1.73 1.31|1.0 0 2.0| 0 0 | 0 2048M| 27 284 0 28 0 May 28 12:46:09 l75lg1-v1 dstat.sh[49771]: 28-05 12:46:09| 1 0 99 0 0|4503M 4852M 268M 6067M| 21k 86B| 0 284k| 0 22.0 |1467 2195 |1.37 1.73 1.31| 0 0 0| 0 0 | 0 2048M| 27 284 0 27 0 May 28 12:46:09 l75lg1-v1 nova-conductor[83647]: DEBUG dbcounter [-] [83647] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=4 {{(pid=83647) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:46:09 l75lg1-v1 nova-conductor[83648]: DEBUG dbcounter [-] [83648] Writing DB stats nova_cell1:SELECT=3 {{(pid=83648) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:46:10 l75lg1-v1 dstat.sh[49771]: 28-05 12:46:10| 1 0 98 0 0|4504M 4852M 268M 6067M| 13k 2469B| 0 212k| 0 36.0 |1644 2606 |1.37 1.73 1.31| 0 0 0| 0 0 | 0 2048M| 27 286 0 27 0 May 28 12:46:10 l75lg1-v1 neutron-server[77621]: DEBUG dbcounter [-] [77621] Writing DB stats neutron:SELECT=2 {{(pid=77621) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:46:10 l75lg1-v1 neutron-server[77618]: DEBUG dbcounter [-] [77618] Writing DB stats neutron:SELECT=156,neutron:INSERT=11,neutron:UPDATE=5,neutron:DELETE=3 {{(pid=77618) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:46:10 l75lg1-v1 neutron-server[77618]: DEBUG dbcounter [-] [77618] Writing DB stats neutron:SELECT=139,neutron:INSERT=13,neutron:UPDATE=6,neutron:DELETE=5 {{(pid=77618) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:46:11 l75lg1-v1 dstat.sh[49771]: 28-05 12:46:11| 1 0 98 0 0|4504M 4851M 268M 6067M| 19k 2455B| 0 320k| 0 46.0 |1724 2590 |1.37 1.73 1.31| 0 0 0| 0 0 | 0 2048M| 27 285 0 28 0 May 28 12:46:12 l75lg1-v1 dstat.sh[49771]: 28-05 12:46:12| 1 0 99 0 0|4504M 4851M 268M 6067M| 13k 300B| 0 124k| 0 15.0 |1308 2161 |1.26 1.70 1.30| 0 0 0| 0 0 | 0 2048M| 27 285 0 28 0 May 28 12:46:12 l75lg1-v1 neutron-server[77619]: DEBUG dbcounter [-] [77619] Writing DB stats neutron:SELECT=188,neutron:UPDATE=6,neutron:DELETE=6,neutron:INSERT=8 {{(pid=77619) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:46:12 l75lg1-v1 neutron-server[77619]: DEBUG dbcounter [-] [77619] Writing DB stats neutron:SELECT=218,neutron:UPDATE=7,neutron:INSERT=17,neutron:DELETE=4 {{(pid=77619) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:46:13 l75lg1-v1 dstat.sh[49771]: 28-05 12:46:13| 1 0 98 1 0|4504M 4851M 268M 6067M| 12k 86B| 0 3060k| 0 236 |1903 2919 |1.26 1.70 1.30|1.0 0 0| 0 0 | 0 2048M| 27 285 0 27 0 May 28 12:46:14 l75lg1-v1 dstat.sh[49771]: 28-05 12:46:14| 0 0 99 0 0|4504M 4851M 268M 6067M| 17k 952B| 0 0 | 0 0 |1326 1987 |1.26 1.70 1.30| 0 0 0| 0 0 | 0 2048M| 27 286 0 27 0 May 28 12:46:15 l75lg1-v1 dstat.sh[49771]: 28-05 12:46:15| 1 0 99 0 0|4504M 4851M 268M 6067M| 231k 7719B| 0 8198B| 0 2.00 |1516 2138 |1.26 1.70 1.30|1.0 0 0| 0 0 | 0 2048M| 27 285 0 27 0 May 28 12:46:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG dbcounter [-] [51267] Writing DB stats keystone:SELECT=39 {{(pid=51267) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:46:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG dbcounter [-] [51266] Writing DB stats keystone:SELECT=35 {{(pid=51266) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:46:15 l75lg1-v1 devstack@g-api.service[86374]: DEBUG dbcounter [-] [86374] Writing DB stats glance:SELECT=1 {{(pid=86374) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:46:16 l75lg1-v1 dstat.sh[49771]: 28-05 12:46:16| 1 1 98 0 0|4509M 4839M 268M 6074M|6785k 65k| 0 124k| 0 13.0 |4124 3732 |1.26 1.70 1.30| 0 0 0| 0 0 | 0 2048M| 27 285 0 27 0 May 28 12:46:17 l75lg1-v1 dstat.sh[49771]: 28-05 12:46:17| 1 1 98 0 0|4510M 4827M 268M 6084M| 10M 60k| 0 0 | 0 0 |4514 3761 |1.16 1.67 1.29| 0 0 0| 0 0 | 0 2048M| 27 285 0 27 0 May 28 12:46:18 l75lg1-v1 dstat.sh[49771]: 28-05 12:46:18| 1 1 97 0 0|4511M 4811M 268M 6100M| 16M 111k| 0 364k| 0 68.9 |7579 6368 |1.16 1.67 1.29|1.0 0 2.0| 0 0 | 0 2048M| 27 285 0 27 0 May 28 12:46:19 l75lg1-v1 dstat.sh[49771]: 28-05 12:46:19| 1 1 97 0 0|4511M 4794M 268M 6117M| 17M 117k| 0 292k| 0 22.0 |7694 6356 |1.16 1.67 1.29|1.0 0 0| 0 0 | 0 2048M| 27 285 0 27 0 May 28 12:46:20 l75lg1-v1 dstat.sh[49771]: 28-05 12:46:20| 1 1 98 0 0|4515M 4777M 268M 6129M| 12M 77k| 0 228k| 0 27.0 |4984 5074 |1.16 1.67 1.29|1.0 0 0| 0 0 | 0 2048M| 27 285 0 27 0 May 28 12:46:21 l75lg1-v1 dstat.sh[49771]: 28-05 12:46:21| 1 1 98 0 0|4515M 4766M 268M 6139M| 10M 62k| 0 152k| 0 17.0 |4159 4507 |1.16 1.67 1.29|1.0 0 0| 0 0 | 0 2048M| 27 285 0 27 0 May 28 12:46:22 l75lg1-v1 dstat.sh[49771]: 28-05 12:46:22| 0 1 98 0 0|4515M 4758M 268M 6147M| 11M 68k| 0 0 | 0 0 |4289 4502 |1.07 1.64 1.29| 0 0 0| 0 0 | 0 2048M| 27 285 0 27 0 May 28 12:46:23 l75lg1-v1 dstat.sh[49771]: 28-05 12:46:23| 0 1 98 0 0|4515M 4747M 268M 6158M|8508k 81k| 0 0 | 0 0 |4129 4730 |1.07 1.64 1.29| 0 0 0| 0 0 | 0 2048M| 27 285 0 27 0 May 28 12:46:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "_check_child_processes" by "neutron.agent.linux.external_process.ProcessMonitor._check_child_processes" {{(pid=76818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:46:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_concurrency.lockutils [-] Lock "_check_child_processes" acquired by "neutron.agent.linux.external_process.ProcessMonitor._check_child_processes" :: waited 0.000s {{(pid=76818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:46:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_concurrency.lockutils [-] Lock "_check_child_processes" "released" by "neutron.agent.linux.external_process.ProcessMonitor._check_child_processes" :: held 0.000s {{(pid=76818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:46:24 l75lg1-v1 dstat.sh[49771]: 28-05 12:46:24| 3 1 95 0 0|4515M 4739M 268M 6165M|9036k 72k| 0 140k| 0 29.0 |4895 8812 |1.07 1.64 1.29|1.0 0 46| 0 0 | 0 2048M| 27 285 0 28 0 May 28 12:46:25 l75lg1-v1 dstat.sh[49771]: 28-05 12:46:25| 0 0 99 0 0|4515M 4732M 268M 6173M|6582k 33k| 0 0 | 0 0 |3088 2716 |1.07 1.64 1.29|2.0 0 0| 0 0 | 0 2048M| 27 285 0 28 0 May 28 12:46:25 l75lg1-v1 neutron-server[77623]: DEBUG dbcounter [-] [77623] Writing DB stats neutron:SELECT=1 {{(pid=77623) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:46:25 l75lg1-v1 neutron-server[77623]: DEBUG dbcounter [-] [77623] Writing DB stats neutron:SELECT=2 {{(pid=77623) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:46:25 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_service.periodic_task [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85846) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:46:25 l75lg1-v1 cinder-volume[85846]: DEBUG cinder.volume.drivers.lvm [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] Updating volume stats {{(pid=85846) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}} May 28 12:46:25 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:390}} May 28 12:46:25 l75lg1-v1 sudo[88265]: vastdata : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 May 28 12:46:25 l75lg1-v1 sudo[88265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) May 28 12:46:26 l75lg1-v1 sudo[88265]: pam_unix(sudo:session): session closed for user root May 28 12:46:26 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.472s {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:428}} May 28 12:46:26 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:390}} May 28 12:46:26 l75lg1-v1 sudo[88268]: vastdata : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 May 28 12:46:26 l75lg1-v1 sudo[88268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) May 28 12:46:26 l75lg1-v1 dstat.sh[49771]: 28-05 12:46:26| 5 1 93 0 0|4518M 4724M 268M 6177M|4655k 39k| 256k 72k|2.00 8.00 |3383 3426 |1.07 1.64 1.29|1.0 0 5.0| 0 0 | 0 2048M| 27 285 0 27 0 May 28 12:46:26 l75lg1-v1 sudo[88268]: pam_unix(sudo:session): session closed for user root May 28 12:46:26 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.492s {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:428}} May 28 12:46:26 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:390}} May 28 12:46:26 l75lg1-v1 sudo[88271]: vastdata : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool May 28 12:46:26 l75lg1-v1 sudo[88271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) May 28 12:46:27 l75lg1-v1 sudo[88271]: pam_unix(sudo:session): session closed for user root May 28 12:46:27 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.466s {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:428}} May 28 12:46:27 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:390}} May 28 12:46:27 l75lg1-v1 sudo[88274]: vastdata : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 May 28 12:46:27 l75lg1-v1 sudo[88274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) May 28 12:46:27 l75lg1-v1 dstat.sh[49771]: 28-05 12:46:27| 8 2 90 0 0|4513M 4724M 268M 6181M|4407k 58k| 640k 16k|5.00 3.00 |3756 4311 |1.06 1.63 1.28|2.0 0 6.0| 0 0 | 0 2048M| 27 285 0 27 0 May 28 12:46:27 l75lg1-v1 neutron-server[77623]: DEBUG neutron.db.agents_db [None req-fe40ce8c-640e-4db7-a17a-6e8888cce266 None None] Agent healthcheck: found 0 active agents {{(pid=77623) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:319}} May 28 12:46:27 l75lg1-v1 sudo[88274]: pam_unix(sudo:session): session closed for user root May 28 12:46:27 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.467s {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:428}} May 28 12:46:27 l75lg1-v1 cinder-volume[85846]: DEBUG cinder.manager [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] Notifying Schedulers of capabilities ... {{(pid=85846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 28 12:46:27 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.scheduler.host_manager [None req-fc97c3a3-7fc7-4ddf-86b5-8cd5d98b159f None None] Received volume service update from l75lg1-v1@lvmdriver-1: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:l75lg1-v1:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up', 'allocated_capacity_gb': 0, 'cacheable': True}], 'shared_targets': False, 'sparse_copy_volume': True, 'filter_function': None, 'goodness_function': None} {{(pid=85128) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:628}} May 28 12:46:28 l75lg1-v1 dstat.sh[49771]: 28-05 12:46:28| 3 1 95 0 0|4509M 4725M 268M 6185M|3430k 35k| 256k 104k|2.00 12.0 |3187 3621 |1.06 1.63 1.28|1.0 1.0 9.0| 0 0 | 0 2048M| 27 285 0 26 0 May 28 12:46:29 l75lg1-v1 dstat.sh[49771]: 28-05 12:46:29| 1 0 99 0 0|4509M 4722M 268M 6188M|3519k 52k| 0 688k| 0 123 |3225 3993 |1.06 1.63 1.28| 0 0 0| 0 0 | 0 2048M| 27 285 0 26 0 May 28 12:46:29 l75lg1-v1 nova-conductor[83647]: DEBUG dbcounter [-] [83647] Writing DB stats nova_cell1:SELECT=2,nova_cell1:UPDATE=1 {{(pid=83647) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:46:29 l75lg1-v1 nova-conductor[83647]: DEBUG dbcounter [-] [83647] Writing DB stats nova_cell1:UPDATE=1 {{(pid=83647) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:46:29 l75lg1-v1 nova-conductor[83648]: DEBUG dbcounter [-] [83648] Writing DB stats nova_cell1:SELECT=2 {{(pid=83648) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:46:30 l75lg1-v1 dstat.sh[49771]: 28-05 12:46:30| 1 0 98 0 0|4509M 4719M 268M 6190M|3064k 43k| 0 4560k| 0 90.0 |3275 4014 |1.06 1.63 1.28| 0 0 1.0| 0 0 | 0 2048M| 27 287 0 23 0 May 28 12:46:30 l75lg1-v1 neutron-server[77618]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.HashRingHealthCheckPeriodics.touch_hash_ring_nodes' {{(pid=77618) _process_scheduled /opt/stack/data/venv/lib/python3.10/site-packages/futurist/periodics.py:638}} May 28 12:46:31 l75lg1-v1 dstat.sh[49771]: 28-05 12:46:31| 1 0 98 1 0|4510M 4716M 268M 6193M|2707k 39k| 0 224k| 0 27.0 |3194 3537 |1.06 1.63 1.28|1.0 0 0| 0 0 | 0 2048M| 27 287 0 23 0 May 28 12:46:32 l75lg1-v1 dstat.sh[49771]: 28-05 12:46:32| 1 0 98 0 0|4510M 4713M 268M 6195M|2308k 31k| 0 236k| 0 28.0 |3430 3374 |0.98 1.61 1.28|1.0 0 0| 0 0 | 0 2048M| 27 287 0 22 0 May 28 12:46:33 l75lg1-v1 dstat.sh[49771]: 28-05 12:46:33| 0 0 98 0 0|4511M 4710M 268M 6197M|2064k 28k| 0 352k| 0 29.0 |3086 3090 |0.98 1.61 1.28| 0 0 0| 0 0 | 0 2048M| 27 287 0 22 0 May 28 12:46:34 l75lg1-v1 dstat.sh[49771]: 28-05 12:46:34| 0 0 99 0 0|4511M 4709M 268M 6199M|1646k 20k| 0 0 | 0 0 |2509 2539 |0.98 1.61 1.28|1.0 0 0| 0 0 | 0 2048M| 27 287 0 21 0 May 28 12:46:35 l75lg1-v1 dstat.sh[49771]: 28-05 12:46:35| 1 1 97 2 0|4511M 4708M 268M 6200M| 916k 10k| 0 60M| 0 118 |2218 2381 |0.98 1.61 1.28| 0 0 0| 0 0 | 0 2048M| 27 287 0 21 0 May 28 12:46:36 l75lg1-v1 dstat.sh[49771]: 28-05 12:46:36| 1 0 99 0 0|4511M 4708M 268M 6201M| 835k 12k| 0 69M| 0 85.9 |2172 2394 |0.98 1.61 1.28|1.0 0 0| 0 0 | 0 2048M| 27 287 0 20 0 May 28 12:46:37 l75lg1-v1 dstat.sh[49771]: 28-05 12:46:37| 1 0 99 0 0|4511M 4707M 268M 6201M| 629k 9686B| 0 0 | 0 0 |1857 2250 |0.90 1.58 1.27|1.0 0 0| 0 0 | 0 2048M| 27 287 0 20 0 May 28 12:46:37 l75lg1-v1 neutron-server[77623]: DEBUG dbcounter [-] [77623] Writing DB stats neutron:SELECT=1 {{(pid=77623) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:46:38 l75lg1-v1 dstat.sh[49771]: 28-05 12:46:38| 1 0 97 2 0|4511M 4706M 268M 6202M| 571k 10k| 0 228k| 0 27.0 |2447 3170 |0.90 1.58 1.27| 0 1.0 2.0| 0 0 | 0 2048M| 27 287 0 19 0 May 28 12:46:39 l75lg1-v1 dstat.sh[49771]: 28-05 12:46:39| 0 0 99 0 0|4511M 4705M 268M 6202M| 620k 12k| 0 488k| 0 45.0 |2245 2914 |0.90 1.58 1.27| 0 0 0| 0 0 | 0 2048M| 27 287 0 19 0 May 28 12:46:39 l75lg1-v1 nova-conductor[83647]: DEBUG dbcounter [-] [83647] Writing DB stats nova_cell1:SELECT=1,nova_cell1:UPDATE=1 {{(pid=83647) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:46:39 l75lg1-v1 nova-conductor[83648]: DEBUG dbcounter [-] [83648] Writing DB stats nova_cell1:SELECT=1 {{(pid=83648) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:46:40 l75lg1-v1 dstat.sh[49771]: 28-05 12:46:40| 1 0 98 1 0|4511M 4705M 268M 6203M| 566k 9392B| 0 520k| 0 90.0 |2196 2885 |0.90 1.58 1.27|1.0 0 0| 0 0 | 0 2048M| 27 287 0 18 0 May 28 12:46:40 l75lg1-v1 neutron-server[77618]: DEBUG dbcounter [-] [77618] Writing DB stats neutron:UPDATE=1 {{(pid=77618) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:46:40 l75lg1-v1 neutron-server[77618]: DEBUG dbcounter [-] [77618] Writing DB stats neutron:SELECT=1 {{(pid=77618) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:46:41 l75lg1-v1 dstat.sh[49771]: 28-05 12:46:41| 0 0 98 0 0|4511M 4704M 268M 6203M| 438k 7013B| 0 184k| 0 23.0 |1805 2270 |0.90 1.58 1.27| 0 0 0| 0 0 | 0 2048M| 27 287 0 18 0 May 28 12:46:41 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:46:41 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:46:41 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:46:41 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.manager [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Starting heal instance info cache {{(pid=83654) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}} May 28 12:46:41 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.manager [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Rebuilding the list of instances to heal {{(pid=83654) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9930}} May 28 12:46:41 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Expecting reply to msg 231fe4b0cc584088adc9507011fc88f7 in queue reply_37f4cbd1dd094961a22b8a65f222c327 May 28 12:46:41 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [-] Received RPC response for msg 231fe4b0cc584088adc9507011fc88f7 May 28 12:46:41 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.manager [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Didn't find any instances for network info cache update. {{(pid=83654) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10012}} May 28 12:46:41 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:46:41 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:46:41 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:46:41 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:46:41 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:46:41 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:46:41 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.manager [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=83654) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10545}} May 28 12:46:41 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager.update_available_resource {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:46:41 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Expecting reply to msg 7d3e162af3c949e288f88dcfe0f1f99f in queue reply_37f4cbd1dd094961a22b8a65f222c327 May 28 12:46:41 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [-] Received RPC response for msg 7d3e162af3c949e288f88dcfe0f1f99f May 28 12:46:41 l75lg1-v1 nova-scheduler[81196]: DEBUG dbcounter [-] [81196] Writing DB stats nova_cell0:SELECT=1,nova_cell0:UPDATE=1 {{(pid=81196) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:46:41 l75lg1-v1 nova-scheduler[81194]: DEBUG dbcounter [-] [81194] Writing DB stats nova_cell0:SELECT=1 {{(pid=81194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:46:42 l75lg1-v1 dstat.sh[49771]: 28-05 12:46:42| 1 0 98 0 0|4511M 4704M 268M 6203M| 333k 5876B| 0 100k| 0 12.0 |2143 2779 |0.83 1.55 1.26|1.0 0 0| 0 0 | 0 2048M| 27 287 0 17 0 May 28 12:46:42 l75lg1-v1 nova-compute[83654]: DEBUG oslo_concurrency.lockutils [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=83654) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:46:42 l75lg1-v1 nova-compute[83654]: DEBUG oslo_concurrency.lockutils [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=83654) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:46:42 l75lg1-v1 nova-compute[83654]: DEBUG oslo_concurrency.lockutils [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=83654) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:46:42 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.resource_tracker [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Auditing locally available compute resources for l75lg1-v1 (node: l75lg1-v1) {{(pid=83654) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}} May 28 12:46:42 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.resource_tracker [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Hypervisor/Node resource view: name=l75lg1-v1 free_ram=11175MB free_disk=17.236690521240234GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_01_1", "address": "0000:00:01.1", "product_id": "7010", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7010", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7000", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7000", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "0100", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_0100", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_09_0", "address": "0000:00:09.0", "product_id": "1001", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1001", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "293a", "vendor_id": "8086", "numa_node": null, "label": "label_8086_293a", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_2", "address": "0000:00:07.2", "product_id": "2936", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2936", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "1237", "vendor_id": "8086", "numa_node": null, "label": "label_8086_1237", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "2935", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2935", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "2934", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2934", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_05_0", "address": "0000:00:05.0", "product_id": "1000", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1000", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "1000", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1000", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_06_0", "address": "0000:00:06.0", "product_id": "2668", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2668", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "1000", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1000", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0a_0", "address": "0000:00:0a.0", "product_id": "1002", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1002", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_3", "address": "0000:00:01.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_08_0", "address": "0000:00:08.0", "product_id": "1003", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1003", "dev_type": "type-PCI"}] {{(pid=83654) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}} May 28 12:46:42 l75lg1-v1 nova-compute[83654]: DEBUG oslo_concurrency.lockutils [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=83654) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:46:42 l75lg1-v1 nova-compute[83654]: DEBUG oslo_concurrency.lockutils [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=83654) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:46:42 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Expecting reply to msg 874059f2590248f2a04a03f2d6e0e55e in queue reply_37f4cbd1dd094961a22b8a65f222c327 May 28 12:46:42 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [-] Received RPC response for msg 874059f2590248f2a04a03f2d6e0e55e May 28 12:46:42 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Expecting reply to msg 81571f8b687a4162b6ee9b471431f1ca in queue reply_37f4cbd1dd094961a22b8a65f222c327 May 28 12:46:42 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [-] Received RPC response for msg 81571f8b687a4162b6ee9b471431f1ca May 28 12:46:43 l75lg1-v1 dstat.sh[49771]: 28-05 12:46:43| 2 1 98 0 0|4512M 4703M 268M 6204M| 315k 5980B| 0 0 | 0 0 |3051 4541 |0.83 1.55 1.26| 0 0 0| 0 0 | 0 2048M| 27 287 0 17 0 May 28 12:46:43 l75lg1-v1 devstack@placement-api.service[78201]: DEBUG placement.requestlog [req-4b0e3336-b131-4dd8-8997-00f503ab0a01 req-55ea69c6-f8f2-4560-bd7b-3185e48da71f None None] Starting request: 10.27.203.238 "GET /placement/resource_providers/ef90d7d1-0808-4a15-ad77-f9a7391af2f4/allocations" {{(pid=78201) __call__ /opt/stack/placement/placement/requestlog.py:55}} May 28 12:46:43 l75lg1-v1 devstack@placement-api.service[78201]: INFO placement.requestlog [req-4b0e3336-b131-4dd8-8997-00f503ab0a01 req-55ea69c6-f8f2-4560-bd7b-3185e48da71f service placement] 10.27.203.238 "GET /placement/resource_providers/ef90d7d1-0808-4a15-ad77-f9a7391af2f4/allocations" status: 200 len: 54 microversion: 1.0 May 28 12:46:43 l75lg1-v1 devstack@placement-api.service[78201]: [pid: 78201|app: 0|req: 7/14] 10.27.203.238 () {62 vars in 1480 bytes} [Tue May 28 12:46:43 2024] GET /placement/resource_providers/ef90d7d1-0808-4a15-ad77-f9a7391af2f4/allocations => generated 54 bytes in 12 msecs (HTTP/1.1 200) 6 headers in 223 bytes (1 switches on core 0) May 28 12:46:43 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.resource_tracker [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Total usable vcpus: 10, total allocated vcpus: 0 {{(pid=83654) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}} May 28 12:46:43 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.resource_tracker [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Final resource view: name=l75lg1-v1 phys_ram=16000MB used_ram=512MB phys_disk=28GB used_disk=0GB total_vcpus=10 used_vcpus=0 pci_stats=[] {{(pid=83654) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}} May 28 12:46:43 l75lg1-v1 devstack@placement-api.service[78202]: DEBUG placement.requestlog [req-4b0e3336-b131-4dd8-8997-00f503ab0a01 req-a8efae4f-f2b8-42ff-97fe-871f6adfa4a1 None None] Starting request: 10.27.203.238 "GET /placement/resource_providers/ef90d7d1-0808-4a15-ad77-f9a7391af2f4/allocations" {{(pid=78202) __call__ /opt/stack/placement/placement/requestlog.py:55}} May 28 12:46:43 l75lg1-v1 devstack@placement-api.service[78202]: INFO placement.requestlog [req-4b0e3336-b131-4dd8-8997-00f503ab0a01 req-a8efae4f-f2b8-42ff-97fe-871f6adfa4a1 service placement] 10.27.203.238 "GET /placement/resource_providers/ef90d7d1-0808-4a15-ad77-f9a7391af2f4/allocations" status: 200 len: 54 microversion: 1.0 May 28 12:46:43 l75lg1-v1 devstack@placement-api.service[78202]: [pid: 78202|app: 0|req: 8/15] 10.27.203.238 () {62 vars in 1480 bytes} [Tue May 28 12:46:43 2024] GET /placement/resource_providers/ef90d7d1-0808-4a15-ad77-f9a7391af2f4/allocations => generated 54 bytes in 11 msecs (HTTP/1.1 200) 6 headers in 223 bytes (1 switches on core 0) May 28 12:46:43 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.provider_tree [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Inventory has not changed in ProviderTree for provider: ef90d7d1-0808-4a15-ad77-f9a7391af2f4 {{(pid=83654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} May 28 12:46:43 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Expecting reply to msg 23f590dcf77d48a1bebc47d2e636e865 in queue reply_37f4cbd1dd094961a22b8a65f222c327 May 28 12:46:43 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [-] Received RPC response for msg 23f590dcf77d48a1bebc47d2e636e865 May 28 12:46:43 l75lg1-v1 nova-compute[83654]: DEBUG nova.scheduler.client.report [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Inventory has not changed for provider ef90d7d1-0808-4a15-ad77-f9a7391af2f4 based on inventory data: {'MEMORY_MB': {'total': 16000, 'reserved': 512, 'min_unit': 1, 'max_unit': 16000, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 10, 'reserved': 0, 'min_unit': 1, 'max_unit': 10, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 28, 'reserved': 0, 'min_unit': 1, 'max_unit': 28, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=83654) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}} May 28 12:46:43 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.resource_tracker [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Compute_service record updated for l75lg1-v1:l75lg1-v1 {{(pid=83654) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}} May 28 12:46:43 l75lg1-v1 nova-compute[83654]: DEBUG oslo_concurrency.lockutils [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.554s {{(pid=83654) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:46:44 l75lg1-v1 dstat.sh[49771]: 28-05 12:46:44| 1 0 98 0 0|4512M 4703M 268M 6204M| 311k 6096B| 0 24k| 0 1.00 |1889 2523 |0.83 1.55 1.26| 0 0 0| 0 0 | 0 2048M| 27 287 0 16 0 May 28 12:46:45 l75lg1-v1 dstat.sh[49771]: 28-05 12:46:45| 0 0 99 0 0|4512M 4703M 268M 6204M| 332k 6490B| 0 4096B| 0 1.00 |1656 2252 |0.83 1.55 1.26| 0 0 0| 0 0 | 0 2048M| 27 287 0 16 0 May 28 12:46:46 l75lg1-v1 dstat.sh[49771]: 28-05 12:46:46| 0 0 99 0 0|4512M 4702M 268M 6205M| 345k 6731B| 0 508k| 0 92.0 |1754 2309 |0.83 1.55 1.26| 0 0 0| 0 0 | 0 2048M| 27 287 0 14 0 May 28 12:46:47 l75lg1-v1 dstat.sh[49771]: 28-05 12:46:47| 0 0 99 0 0|4512M 4701M 268M 6205M| 378k 7237B| 0 56k| 0 3.00 |1698 2326 |0.76 1.53 1.26| 0 0 0| 0 0 | 0 2048M| 27 287 0 14 0 May 28 12:46:47 l75lg1-v1 nova-conductor[83229]: DEBUG dbcounter [-] [83229] Writing DB stats nova_cell0:SELECT=1,nova_cell0:UPDATE=1 {{(pid=83229) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:46:48 l75lg1-v1 nova-conductor[83233]: DEBUG dbcounter [-] [83233] Writing DB stats nova_cell0:SELECT=1 {{(pid=83233) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:46:48 l75lg1-v1 dstat.sh[49771]: 28-05 12:46:48| 1 1 99 0 0|4512M 4701M 268M 6206M| 421k 8228B| 0 80k| 0 12.0 |1842 2395 |0.76 1.53 1.26| 0 0 2.0| 0 0 | 0 2048M| 27 287 0 13 0 May 28 12:46:49 l75lg1-v1 dstat.sh[49771]: 28-05 12:46:49| 1 0 98 0 0|4512M 4701M 268M 6206M| 534k 9504B| 0 408k| 0 42.0 |2075 2695 |0.76 1.53 1.26| 0 0 0| 0 0 | 0 2048M| 27 287 0 13 0 May 28 12:46:50 l75lg1-v1 dstat.sh[49771]: 28-05 12:46:50| 1 0 99 0 0|4512M 4699M 268M 6207M| 735k 14k| 0 192k| 0 27.0 |2252 2857 |0.76 1.53 1.26| 0 0 0| 0 0 | 0 2048M| 27 287 0 12 0 May 28 12:46:51 l75lg1-v1 dstat.sh[49771]: 28-05 12:46:51| 1 0 99 0 0|4512M 4699M 268M 6208M|1077k 18k| 0 332k| 0 56.0 |2386 2751 |0.76 1.53 1.26|1.0 0 0| 0 0 | 0 2048M| 27 287 0 12 0 May 28 12:46:52 l75lg1-v1 dstat.sh[49771]: 28-05 12:46:52| 1 1 99 0 0|4512M 4698M 268M 6209M|1176k 13k| 0 0 | 0 0 |2059 2304 |0.70 1.50 1.25| 0 0 0| 0 0 | 0 2048M| 27 287 0 11 0 May 28 12:46:52 l75lg1-v1 nova-conductor[83648]: DEBUG dbcounter [-] [83648] Writing DB stats nova_cell1:SELECT=2 {{(pid=83648) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:46:53 l75lg1-v1 dstat.sh[49771]: 28-05 12:46:53| 0 0 99 0 0|4513M 4696M 268M 6210M|1185k 20k| 0 36k| 0 4.00 |2463 2853 |0.70 1.50 1.25| 0 0 0| 0 0 | 0 2048M| 27 287 0 11 0 May 28 12:46:53 l75lg1-v1 devstack@placement-api.service[78201]: DEBUG dbcounter [-] [78201] Writing DB stats placement:SELECT=2 {{(pid=78201) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:46:53 l75lg1-v1 devstack@placement-api.service[78202]: DEBUG dbcounter [-] [78202] Writing DB stats placement:SELECT=2 {{(pid=78202) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:46:54 l75lg1-v1 dstat.sh[49771]: 28-05 12:46:54| 0 0 99 0 0|4512M 4695M 268M 6211M|1274k 22k| 0 60k| 0 7.99 |2584 2918 |0.70 1.50 1.25|2.0 0 0| 0 0 | 0 2048M| 27 287 0 10 0 May 28 12:46:55 l75lg1-v1 dstat.sh[49771]: 28-05 12:46:55| 1 0 99 0 0|4512M 4694M 268M 6213M|1482k 25k| 0 4101B| 0 1.00 |2596 2898 |0.70 1.50 1.25| 0 0 0| 0 0 | 0 2048M| 27 287 0 10 0 May 28 12:46:56 l75lg1-v1 dstat.sh[49771]: 28-05 12:46:56| 0 0 99 0 0|4513M 4692M 268M 6214M|1417k 24k| 0 0 | 0 0 |2311 2912 |0.70 1.50 1.25| 0 0 0| 0 0 | 0 2048M| 27 287 0 9 0 May 28 12:46:57 l75lg1-v1 dstat.sh[49771]: 28-05 12:46:57| 1 0 99 0 0|4513M 4691M 268M 6215M|1464k 25k| 0 244k| 0 48.0 |2334 3179 |0.64 1.48 1.24|1.0 0 0| 0 0 | 0 2048M| 27 287 0 9 0 May 28 12:46:57 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [-] Expecting reply to msg c0372623f0ec46a3b66ba0767aa31d93 in queue reply_37f4cbd1dd094961a22b8a65f222c327 May 28 12:46:58 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [-] Received RPC response for msg c0372623f0ec46a3b66ba0767aa31d93 May 28 12:46:58 l75lg1-v1 dstat.sh[49771]: 28-05 12:46:58| 1 0 99 0 0|4513M 4689M 268M 6216M|1178k 15k| 0 104k| 0 16.0 |2251 2934 |0.64 1.48 1.24| 0 0 2.0| 0 0 | 0 2048M| 27 287 0 8 0 May 28 12:46:59 l75lg1-v1 dstat.sh[49771]: 28-05 12:46:59| 1 0 98 0 0|4513M 4688M 268M 6217M|1232k 22k| 0 576k| 0 55.0 |2398 3438 |0.64 1.48 1.24| 0 0 0| 0 0 | 0 2048M| 27 287 0 8 0 May 28 12:46:59 l75lg1-v1 nova-conductor[83648]: DEBUG dbcounter [-] [83648] Writing DB stats nova_cell1:SELECT=3 {{(pid=83648) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:47:00 l75lg1-v1 dstat.sh[49771]: 28-05 12:47:00| 1 0 99 0 0|4513M 4686M 268M 6219M|1337k 24k| 0 236k| 0 30.0 |2929 3467 |0.64 1.48 1.24| 0 0 0| 0 0 | 0 2048M| 27 287 0 7 0 May 28 12:47:00 l75lg1-v1 neutron-server[77618]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.HashRingHealthCheckPeriodics.touch_hash_ring_nodes' {{(pid=77618) _process_scheduled /opt/stack/data/venv/lib/python3.10/site-packages/futurist/periodics.py:638}} May 28 12:47:01 l75lg1-v1 dstat.sh[49771]: 28-05 12:47:01| 1 0 98 0 0|4514M 4685M 268M 6220M|1477k 27k| 0 424k| 0 69.0 |2999 4127 |0.64 1.48 1.24|1.0 0 0| 0 0 | 0 2048M| 27 287 0 7 0 May 28 12:47:02 l75lg1-v1 dstat.sh[49771]: 28-05 12:47:02| 0 0 99 0 0|4515M 4682M 268M 6221M|1409k 26k| 0 400k| 0 72.0 |2967 3235 |0.59 1.45 1.24| 0 0 0| 0 0 | 0 2048M| 27 287 0 6 0 May 28 12:47:02 l75lg1-v1 neutron-server[77623]: DEBUG dbcounter [-] [77623] Writing DB stats neutron:SELECT=1 {{(pid=77623) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:47:02 l75lg1-v1 neutron-server[77623]: DEBUG dbcounter [-] [77623] Writing DB stats neutron:SELECT=2 {{(pid=77623) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:47:03 l75lg1-v1 dstat.sh[49771]: 28-05 12:47:03| 1 0 98 0 0|4516M 4679M 268M 6223M|1502k 28k| 0 276k| 0 40.0 |3424 3873 |0.59 1.45 1.24| 0 0 0| 0 0 | 0 2048M| 27 287 0 6 0 May 28 12:47:04 l75lg1-v1 dstat.sh[49771]: 28-05 12:47:04| 1 1 99 0 0|4518M 4677M 268M 6224M|1445k 27k| 0 112k| 0 9.00 |2989 3135 |0.59 1.45 1.24|1.0 0 0| 0 0 | 0 2048M| 27 287 0 5 0 May 28 12:47:04 l75lg1-v1 neutron-server[77623]: DEBUG neutron.db.agents_db [None req-fe40ce8c-640e-4db7-a17a-6e8888cce266 None None] Agent healthcheck: found 0 active agents {{(pid=77623) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:319}} May 28 12:47:05 l75lg1-v1 dstat.sh[49771]: 28-05 12:47:05| 0 0 98 0 0|4518M 4675M 268M 6225M|1381k 19k| 0 224k| 0 19.0 |2624 2747 |0.59 1.45 1.24| 0 0 0| 0 0 | 0 2048M| 27 287 0 5 0 May 28 12:47:06 l75lg1-v1 dstat.sh[49771]: 28-05 12:47:06| 1 0 99 0 0|4519M 4673M 268M 6226M| 868k 16k| 0 26M| 0 40.0 |2349 2648 |0.59 1.45 1.24| 0 1.0 0| 0 0 | 0 2048M| 27 287 0 5 0 May 28 12:47:07 l75lg1-v1 dstat.sh[49771]: 28-05 12:47:07| 1 0 98 1 0|4520M 4671M 268M 6227M| 869k 15k| 0 8191B| 0 4.00 |2340 2576 |0.54 1.43 1.23| 0 0 0| 0 0 | 0 2048M| 27 287 0 2 0 May 28 12:47:08 l75lg1-v1 dstat.sh[49771]: 28-05 12:47:08| 1 0 99 0 0|4520M 4670M 268M 6227M| 446k 9199B| 0 212k| 0 44.0 |1811 2181 |0.54 1.43 1.23| 0 0 2.0| 0 0 | 0 2048M| 27 287 0 2 0 May 28 12:47:09 l75lg1-v1 dstat.sh[49771]: 28-05 12:47:09| 0 0 99 0 0|4521M 4669M 268M 6228M| 291k 5754B| 0 372k| 0 38.0 |1935 2671 |0.54 1.43 1.23|1.0 0 0| 0 0 | 0 2048M| 27 287 0 2 0 May 28 12:47:09 l75lg1-v1 nova-conductor[83647]: DEBUG dbcounter [-] [83647] Writing DB stats nova_cell1:SELECT=2,nova_cell1:UPDATE=2 {{(pid=83647) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:47:09 l75lg1-v1 nova-conductor[83647]: DEBUG dbcounter [-] [83647] Writing DB stats nova_cell1:SELECT=5,nova_cell1:UPDATE=2 {{(pid=83647) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:47:09 l75lg1-v1 nova-conductor[83648]: DEBUG dbcounter [-] [83648] Writing DB stats nova_cell1:SELECT=1 {{(pid=83648) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:47:10 l75lg1-v1 dstat.sh[49771]: 28-05 12:47:10| 1 0 97 2 0|4521M 4669M 268M 6228M| 277k 5412B| 0 2292k| 0 198 |2458 3543 |0.54 1.43 1.23|1.0 0 0| 0 0 | 0 2048M| 27 287 0 2 0 May 28 12:47:10 l75lg1-v1 neutron-server[77618]: DEBUG dbcounter [-] [77618] Writing DB stats neutron:UPDATE=1 {{(pid=77618) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:47:10 l75lg1-v1 neutron-server[77618]: DEBUG dbcounter [-] [77618] Writing DB stats neutron:SELECT=1 {{(pid=77618) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:47:11 l75lg1-v1 cinder-scheduler[85128]: DEBUG dbcounter [-] [85128] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=85128) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:47:11 l75lg1-v1 dstat.sh[49771]: 28-05 12:47:11| 1 0 99 0 0|4521M 4669M 268M 6228M| 300k 5878B| 0 112k| 0 16.0 |1704 2414 |0.54 1.43 1.23|1.0 0 0| 0 0 | 0 2048M| 27 287 0 2 0 May 28 12:47:12 l75lg1-v1 dstat.sh[49771]: 28-05 12:47:12| 1 0 99 0 0|4521M 4668M 268M 6228M| 314k 6068B| 0 32k| 0 5.00 |1669 2368 |0.50 1.40 1.22| 0 0 0| 0 0 | 0 2048M| 27 287 0 2 0 May 28 12:47:12 l75lg1-v1 cinder-volume[85846]: DEBUG dbcounter [-] [85846] Writing DB stats cinder:SELECT=1 {{(pid=85846) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:47:12 l75lg1-v1 cinder-volume[85846]: DEBUG dbcounter [-] [85846] Writing DB stats cinder:UPDATE=1 {{(pid=85846) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:47:13 l75lg1-v1 dstat.sh[49771]: 28-05 12:47:13| 1 0 99 0 0|4521M 4668M 268M 6229M| 332k 8164B| 0 564k| 0 71.0 |1741 2409 |0.50 1.40 1.22| 0 0 0| 0 0 | 0 2048M| 27 287 0 1 0 May 28 12:47:14 l75lg1-v1 dstat.sh[49771]: 28-05 12:47:14| 0 0 99 0 0|4521M 4668M 268M 6229M| 379k 7698B| 0 0 | 0 0 |1586 2355 |0.50 1.40 1.22| 0 0 0| 0 0 | 0 2048M| 27 287 0 1 0 May 28 12:47:14 l75lg1-v1 neutron-server[77623]: DEBUG dbcounter [-] [77623] Writing DB stats neutron:SELECT=1 {{(pid=77623) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:47:15 l75lg1-v1 dstat.sh[49771]: 28-05 12:47:15| 1 0 99 0 0|4522M 4667M 268M 6230M| 436k 8397B| 0 40k| 0 5.00 |1790 2504 |0.50 1.40 1.22| 0 0 0| 0 0 | 0 2048M| 27 287 0 1 0 May 28 12:47:16 l75lg1-v1 dstat.sh[49771]: 28-05 12:47:16| 1 0 99 0 0|4521M 4666M 268M 6230M| 647k 12k| 0 0 | 0 0 |1883 2576 |0.50 1.40 1.22| 0 0 0| 0 0 | 0 2048M| 27 287 0 1 0 May 28 12:47:17 l75lg1-v1 dstat.sh[49771]: 28-05 12:47:17| 1 0 99 0 0|4521M 4666M 268M 6231M| 912k 16k| 0 0 | 0 0 |1920 2614 |0.46 1.38 1.21|1.0 0 0| 0 0 | 0 2048M| 27 287 0 1 0 May 28 12:47:18 l75lg1-v1 dstat.sh[49771]: 28-05 12:47:18| 1 1 99 0 0|4522M 4664M 268M 6232M| 935k 14k| 0 248k| 0 50.0 |2202 2583 |0.46 1.38 1.21| 0 0 2.0| 0 0 | 0 2048M| 27 287 0 1 0 May 28 12:47:19 l75lg1-v1 dstat.sh[49771]: 28-05 12:47:19| 0 0 99 0 0|4523M 4662M 268M 6233M|1023k 18k| 0 404k| 0 36.0 |2588 3223 |0.46 1.38 1.21| 0 0 0| 0 0 | 0 2048M| 27 287 0 1 0 May 28 12:47:19 l75lg1-v1 nova-conductor[83648]: DEBUG dbcounter [-] [83648] Writing DB stats nova_cell1:SELECT=1 {{(pid=83648) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:47:20 l75lg1-v1 dstat.sh[49771]: 28-05 12:47:20| 1 0 99 0 0|4524M 4660M 268M 6234M|1124k 20k| 0 168k| 0 25.0 |2680 3413 |0.46 1.38 1.21|1.0 0 0| 0 0 | 0 2048M| 27 287 0 1 0 May 28 12:47:21 l75lg1-v1 dstat.sh[49771]: 28-05 12:47:21| 1 0 99 0 0|4524M 4659M 268M 6235M| 942k 14k| 0 48k| 0 2.00 |1971 2616 |0.46 1.38 1.21| 0 0 0| 0 0 | 0 2048M| 27 287 0 1 0 May 28 12:47:22 l75lg1-v1 dstat.sh[49771]: 28-05 12:47:22| 0 0 99 0 0|4524M 4658M 268M 6236M| 969k 19k| 0 200k| 0 13.0 |2100 2877 |0.50 1.37 1.21| 0 0 0| 0 0 | 0 2048M| 27 287 0 1 0 May 28 12:47:23 l75lg1-v1 dstat.sh[49771]: 28-05 12:47:23| 1 0 99 0 0|4524M 4657M 268M 6236M| 956k 18k| 0 32k| 0 5.00 |2055 2769 |0.50 1.37 1.21| 0 0 0| 0 0 | 0 2048M| 27 287 0 1 0 May 28 12:47:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "_check_child_processes" by "neutron.agent.linux.external_process.ProcessMonitor._check_child_processes" {{(pid=76818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:47:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_concurrency.lockutils [-] Lock "_check_child_processes" acquired by "neutron.agent.linux.external_process.ProcessMonitor._check_child_processes" :: waited 0.000s {{(pid=76818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:47:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_concurrency.lockutils [-] Lock "_check_child_processes" "released" by "neutron.agent.linux.external_process.ProcessMonitor._check_child_processes" :: held 0.000s {{(pid=76818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:47:24 l75lg1-v1 dstat.sh[49771]: 28-05 12:47:24| 3 1 96 0 0|4526M 4654M 268M 6237M| 991k 19k| 0 200k| 0 41.0 |3107 4693 |0.50 1.37 1.21| 0 0 46| 0 0 | 0 2048M| 27 287 0 2 0 May 28 12:47:25 l75lg1-v1 dstat.sh[49771]: 28-05 12:47:25| 1 0 99 0 0|4526M 4653M 268M 6238M| 997k 19k| 0 0 | 0 0 |2135 2865 |0.50 1.37 1.21|1.0 0 0| 0 0 | 0 2048M| 27 287 0 1 0 May 28 12:47:25 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_service.periodic_task [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85846) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:47:25 l75lg1-v1 cinder-volume[85846]: DEBUG cinder.volume.drivers.lvm [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] Updating volume stats {{(pid=85846) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}} May 28 12:47:25 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:390}} May 28 12:47:25 l75lg1-v1 sudo[88342]: vastdata : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 May 28 12:47:25 l75lg1-v1 sudo[88342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) May 28 12:47:26 l75lg1-v1 sudo[88342]: pam_unix(sudo:session): session closed for user root May 28 12:47:26 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.455s {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:428}} May 28 12:47:26 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:390}} May 28 12:47:26 l75lg1-v1 sudo[88345]: vastdata : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 May 28 12:47:26 l75lg1-v1 sudo[88345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) May 28 12:47:26 l75lg1-v1 dstat.sh[49771]: 28-05 12:47:26| 5 2 94 0 0|4538M 4641M 268M 6239M| 700k 11k| 256k 0 |2.00 0 |2334 2421 |0.50 1.37 1.21|1.0 0 5.0| 0 0 | 0 2048M| 27 287 0 1 0 May 28 12:47:26 l75lg1-v1 sudo[88345]: pam_unix(sudo:session): session closed for user root May 28 12:47:26 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.465s {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:428}} May 28 12:47:26 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:390}} May 28 12:47:26 l75lg1-v1 sudo[88348]: vastdata : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool May 28 12:47:26 l75lg1-v1 sudo[88348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) May 28 12:47:27 l75lg1-v1 sudo[88348]: pam_unix(sudo:session): session closed for user root May 28 12:47:27 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.462s {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:428}} May 28 12:47:27 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:390}} May 28 12:47:27 l75lg1-v1 sudo[88351]: vastdata : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 May 28 12:47:27 l75lg1-v1 sudo[88351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) May 28 12:47:27 l75lg1-v1 dstat.sh[49771]: 28-05 12:47:27| 9 1 90 0 0|4546M 4632M 268M 6240M| 579k 11k| 640k 8192B|5.00 2.00 |2527 2846 |0.54 1.37 1.21|1.0 0 6.0| 0 0 | 0 2048M| 27 287 0 1 0 May 28 12:47:27 l75lg1-v1 sudo[88351]: pam_unix(sudo:session): session closed for user root May 28 12:47:27 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.456s {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:428}} May 28 12:47:27 l75lg1-v1 cinder-volume[85846]: DEBUG cinder.manager [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] Notifying Schedulers of capabilities ... {{(pid=85846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 28 12:47:27 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.scheduler.host_manager [None req-85c23a48-fa3d-4ddf-b17c-1349012190fe None None] Received volume service update from l75lg1-v1@lvmdriver-1: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:l75lg1-v1:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up', 'allocated_capacity_gb': 0, 'cacheable': True}], 'shared_targets': False, 'sparse_copy_volume': True, 'filter_function': None, 'goodness_function': None} {{(pid=85128) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:628}} May 28 12:47:28 l75lg1-v1 dstat.sh[49771]: 28-05 12:47:28| 3 1 96 0 0|4535M 4642M 268M 6240M| 628k 12k| 256k 48k|2.00 3.00 |2531 2856 |0.54 1.37 1.21|2.0 0 9.0| 0 0 | 0 2048M| 27 287 0 1 0 May 28 12:47:29 l75lg1-v1 dstat.sh[49771]: 28-05 12:47:29| 0 0 99 0 0|4536M 4641M 268M 6241M| 610k 12k| 0 480k| 0 91.0 |2138 2589 |0.54 1.37 1.21| 0 0 0| 0 0 | 0 2048M| 27 287 0 1 0 May 28 12:47:29 l75lg1-v1 nova-conductor[83647]: DEBUG dbcounter [-] [83647] Writing DB stats nova_cell1:SELECT=2,nova_cell1:UPDATE=2 {{(pid=83647) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:47:29 l75lg1-v1 nova-conductor[83648]: DEBUG dbcounter [-] [83648] Writing DB stats nova_cell1:SELECT=1 {{(pid=83648) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:47:30 l75lg1-v1 dstat.sh[49771]: 28-05 12:47:30| 1 0 98 1 0|4536M 4640M 268M 6241M| 656k 13k| 0 356k| 0 45.0 |2616 3364 |0.54 1.37 1.21| 0 0 0| 0 0 | 0 2048M| 27 287 0 1 0 May 28 12:47:30 l75lg1-v1 neutron-server[77618]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.HashRingHealthCheckPeriodics.touch_hash_ring_nodes' {{(pid=77618) _process_scheduled /opt/stack/data/venv/lib/python3.10/site-packages/futurist/periodics.py:638}} May 28 12:47:31 l75lg1-v1 dstat.sh[49771]: 28-05 12:47:31| 1 0 98 0 0|4536M 4640M 268M 6242M| 640k 12k| 0 196k| 0 26.0 |2634 3192 |0.54 1.37 1.21| 0 0 0| 0 0 | 0 2048M| 27 287 0 1 0 May 28 12:47:32 l75lg1-v1 dstat.sh[49771]: 28-05 12:47:32| 0 0 98 0 0|4536M 4639M 268M 6242M| 684k 13k| 0 0 | 0 0 |2178 2488 |0.50 1.34 1.20|1.0 0 0| 0 0 | 0 2048M| 27 287 0 1 0 May 28 12:47:33 l75lg1-v1 dstat.sh[49771]: 28-05 12:47:33| 1 0 99 0 0|4536M 4639M 268M 6243M| 786k 15k| 0 184k| 0 14.0 |2329 2742 |0.50 1.34 1.20| 0 0 0| 0 0 | 0 2048M| 27 287 0 1 0 May 28 12:47:34 l75lg1-v1 dstat.sh[49771]: 28-05 12:47:34| 0 0 99 0 0|4536M 4637M 268M 6244M| 957k 17k| 0 32k| 0 5.00 |2348 2717 |0.50 1.34 1.20|1.0 0 0| 0 0 | 0 2048M| 27 287 0 1 0 May 28 12:47:35 l75lg1-v1 dstat.sh[49771]: 28-05 12:47:35| 1 1 98 0 0|4536M 4636M 268M 6245M|1192k 21k| 0 260k| 0 53.0 |2486 2900 |0.50 1.34 1.20| 0 0 0| 0 0 | 0 2048M| 27 287 0 1 0 May 28 12:47:36 l75lg1-v1 dstat.sh[49771]: 28-05 12:47:36| 1 1 98 0 0|4535M 4636M 268M 6247M|1608k 27k| 0 0 | 0 0 |2636 2982 |0.50 1.34 1.20| 0 0 0| 0 0 | 0 2048M| 27 287 0 1 0 May 28 12:47:37 l75lg1-v1 dstat.sh[49771]: 28-05 12:47:37| 1 1 98 0 0|4534M 4635M 268M 6248M|2017k 32k| 0 21M| 0 49.0 |2899 3156 |0.46 1.32 1.20|2.0 0 0| 0 0 | 0 2048M| 27 287 0 1 0 May 28 12:47:38 l75lg1-v1 dstat.sh[49771]: 28-05 12:47:38| 1 1 97 0 0|4535M 4631M 268M 6251M|2780k 44k| 0 0 | 0 0 |3899 3735 |0.46 1.32 1.20|1.0 0 2.0| 0 0 | 0 2048M| 27 287 0 1 0 May 28 12:47:39 l75lg1-v1 dstat.sh[49771]: 28-05 12:47:39| 1 1 98 1 0|4536M 4628M 268M 6253M|2713k 34k| 0 92k| 0 5.01 |3060 3140 |0.46 1.32 1.20| 0 0 0| 0 0 | 0 2048M| 27 287 0 1 0 May 28 12:47:39 l75lg1-v1 neutron-server[77623]: DEBUG dbcounter [-] [77623] Writing DB stats neutron:SELECT=1 {{(pid=77623) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:47:39 l75lg1-v1 nova-conductor[83647]: DEBUG dbcounter [-] [83647] Writing DB stats nova_cell1:SELECT=1,nova_cell1:UPDATE=1 {{(pid=83647) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:47:39 l75lg1-v1 nova-conductor[83648]: DEBUG dbcounter [-] [83648] Writing DB stats nova_cell1:SELECT=1 {{(pid=83648) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:47:40 l75lg1-v1 dstat.sh[49771]: 28-05 12:47:40| 1 1 97 0 0|4536M 4625M 268M 6256M|2640k 44k| 0 648k| 0 99.0 |4418 4291 |0.46 1.32 1.20| 0 0 0| 0 0 | 0 2048M| 27 287 0 1 0 May 28 12:47:40 l75lg1-v1 neutron-server[77623]: DEBUG dbcounter [-] [77623] Writing DB stats neutron:SELECT=2,neutron:DELETE=1 {{(pid=77623) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:47:40 l75lg1-v1 neutron-server[77618]: DEBUG dbcounter [-] [77618] Writing DB stats neutron:UPDATE=1 {{(pid=77618) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:47:40 l75lg1-v1 neutron-server[77618]: DEBUG dbcounter [-] [77618] Writing DB stats neutron:SELECT=1 {{(pid=77618) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:47:41 l75lg1-v1 dstat.sh[49771]: 28-05 12:47:41| 1 1 97 0 0|4537M 4621M 268M 6259M|3033k 51k| 0 148k| 0 22.0 |4485 4202 |0.46 1.32 1.20| 0 0 0| 0 0 | 0 2048M| 27 287 0 1 0 May 28 12:47:41 l75lg1-v1 neutron-server[77623]: DEBUG neutron.db.agents_db [None req-fe40ce8c-640e-4db7-a17a-6e8888cce266 None None] Agent healthcheck: found 0 active agents {{(pid=77623) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:319}} May 28 12:47:42 l75lg1-v1 dstat.sh[49771]: 28-05 12:47:42| 1 1 98 0 0|4537M 4619M 268M 6262M|3082k 53k| 0 0 | 0 0 |4604 4319 |0.42 1.30 1.19|1.0 0 0| 0 0 | 0 2048M| 27 287 0 1 0 May 28 12:47:43 l75lg1-v1 dstat.sh[49771]: 28-05 12:47:43| 1 1 98 0 0|4538M 4614M 268M 6265M|3322k 56k| 0 0 | 0 0 |4696 4131 |0.42 1.30 1.19| 0 0 0| 0 0 | 0 2048M| 27 287 0 1 0 May 28 12:47:43 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:47:43 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:47:43 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.manager [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Starting heal instance info cache {{(pid=83654) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}} May 28 12:47:43 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.manager [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Rebuilding the list of instances to heal {{(pid=83654) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9930}} May 28 12:47:43 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Expecting reply to msg 3b68813b7df64918af6d08bf2affd10f in queue reply_37f4cbd1dd094961a22b8a65f222c327 May 28 12:47:43 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [-] Received RPC response for msg 3b68813b7df64918af6d08bf2affd10f May 28 12:47:44 l75lg1-v1 dstat.sh[49771]: 28-05 12:47:44| 1 1 98 0 0|4541M 4608M 268M 6268M|3358k 59k| 0 0 | 0 0 |4969 4427 |0.42 1.30 1.19|1.0 0 1.0| 0 0 | 0 2048M| 27 287 0 1 0 May 28 12:47:44 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.manager [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Didn't find any instances for network info cache update. {{(pid=83654) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10012}} May 28 12:47:44 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:47:44 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:47:44 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:47:44 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:47:44 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:47:44 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:47:44 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.manager [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=83654) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10545}} May 28 12:47:44 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager.update_available_resource {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:47:44 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Expecting reply to msg 33bc12d75fda488b9292ebe025e8a274 in queue reply_37f4cbd1dd094961a22b8a65f222c327 May 28 12:47:44 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [-] Received RPC response for msg 33bc12d75fda488b9292ebe025e8a274 May 28 12:47:44 l75lg1-v1 nova-compute[83654]: DEBUG oslo_concurrency.lockutils [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=83654) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:47:44 l75lg1-v1 nova-compute[83654]: DEBUG oslo_concurrency.lockutils [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=83654) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:47:44 l75lg1-v1 nova-compute[83654]: DEBUG oslo_concurrency.lockutils [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=83654) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:47:44 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.resource_tracker [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Auditing locally available compute resources for l75lg1-v1 (node: l75lg1-v1) {{(pid=83654) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}} May 28 12:47:44 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.resource_tracker [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Hypervisor/Node resource view: name=l75lg1-v1 free_ram=11143MB free_disk=17.171878814697266GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_01_1", "address": "0000:00:01.1", "product_id": "7010", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7010", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7000", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7000", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "0100", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_0100", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_09_0", "address": "0000:00:09.0", "product_id": "1001", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1001", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "293a", "vendor_id": "8086", "numa_node": null, "label": "label_8086_293a", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_2", "address": "0000:00:07.2", "product_id": "2936", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2936", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "1237", "vendor_id": "8086", "numa_node": null, "label": "label_8086_1237", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "2935", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2935", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "2934", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2934", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_05_0", "address": "0000:00:05.0", "product_id": "1000", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1000", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "1000", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1000", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_06_0", "address": "0000:00:06.0", "product_id": "2668", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2668", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "1000", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1000", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0a_0", "address": "0000:00:0a.0", "product_id": "1002", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1002", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_3", "address": "0000:00:01.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_08_0", "address": "0000:00:08.0", "product_id": "1003", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1003", "dev_type": "type-PCI"}] {{(pid=83654) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}} May 28 12:47:44 l75lg1-v1 nova-compute[83654]: DEBUG oslo_concurrency.lockutils [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=83654) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:47:44 l75lg1-v1 nova-compute[83654]: DEBUG oslo_concurrency.lockutils [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=83654) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:47:45 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Expecting reply to msg 237e2eef35524c0993628effa9d36b90 in queue reply_37f4cbd1dd094961a22b8a65f222c327 May 28 12:47:45 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [-] Received RPC response for msg 237e2eef35524c0993628effa9d36b90 May 28 12:47:45 l75lg1-v1 dstat.sh[49771]: 28-05 12:47:45| 2 1 96 0 0|4542M 4604M 268M 6271M|3210k 57k| 0 368k| 0 70.0 |6066 7012 |0.42 1.30 1.19|1.0 0 1.0| 0 0 | 0 2048M| 27 287 0 1 0 May 28 12:47:45 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Expecting reply to msg 9bad1226d1394984bb3d1bda15cbcda5 in queue reply_37f4cbd1dd094961a22b8a65f222c327 May 28 12:47:45 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [-] Received RPC response for msg 9bad1226d1394984bb3d1bda15cbcda5 May 28 12:47:46 l75lg1-v1 devstack@placement-api.service[78201]: DEBUG placement.requestlog [req-52980494-9d60-4e21-a6e6-d3879cc94078 req-66f32c32-f0c7-469b-ae94-7657e435fe9a None None] Starting request: 10.27.203.238 "GET /placement/resource_providers/ef90d7d1-0808-4a15-ad77-f9a7391af2f4/allocations" {{(pid=78201) __call__ /opt/stack/placement/placement/requestlog.py:55}} May 28 12:47:46 l75lg1-v1 devstack@placement-api.service[78201]: INFO placement.requestlog [req-52980494-9d60-4e21-a6e6-d3879cc94078 req-66f32c32-f0c7-469b-ae94-7657e435fe9a service placement] 10.27.203.238 "GET /placement/resource_providers/ef90d7d1-0808-4a15-ad77-f9a7391af2f4/allocations" status: 200 len: 54 microversion: 1.0 May 28 12:47:46 l75lg1-v1 devstack@placement-api.service[78201]: [pid: 78201|app: 0|req: 8/16] 10.27.203.238 () {62 vars in 1480 bytes} [Tue May 28 12:47:46 2024] GET /placement/resource_providers/ef90d7d1-0808-4a15-ad77-f9a7391af2f4/allocations => generated 54 bytes in 13 msecs (HTTP/1.1 200) 6 headers in 223 bytes (1 switches on core 0) May 28 12:47:46 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.resource_tracker [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Total usable vcpus: 10, total allocated vcpus: 0 {{(pid=83654) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}} May 28 12:47:46 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.resource_tracker [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Final resource view: name=l75lg1-v1 phys_ram=16000MB used_ram=512MB phys_disk=28GB used_disk=0GB total_vcpus=10 used_vcpus=0 pci_stats=[] {{(pid=83654) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}} May 28 12:47:46 l75lg1-v1 devstack@placement-api.service[78202]: DEBUG placement.requestlog [req-52980494-9d60-4e21-a6e6-d3879cc94078 req-236a49a5-b670-48fa-8d4b-4bd7baea475d None None] Starting request: 10.27.203.238 "GET /placement/resource_providers/ef90d7d1-0808-4a15-ad77-f9a7391af2f4/allocations" {{(pid=78202) __call__ /opt/stack/placement/placement/requestlog.py:55}} May 28 12:47:46 l75lg1-v1 devstack@placement-api.service[78202]: INFO placement.requestlog [req-52980494-9d60-4e21-a6e6-d3879cc94078 req-236a49a5-b670-48fa-8d4b-4bd7baea475d service placement] 10.27.203.238 "GET /placement/resource_providers/ef90d7d1-0808-4a15-ad77-f9a7391af2f4/allocations" status: 200 len: 54 microversion: 1.0 May 28 12:47:46 l75lg1-v1 devstack@placement-api.service[78202]: [pid: 78202|app: 0|req: 9/17] 10.27.203.238 () {62 vars in 1480 bytes} [Tue May 28 12:47:46 2024] GET /placement/resource_providers/ef90d7d1-0808-4a15-ad77-f9a7391af2f4/allocations => generated 54 bytes in 12 msecs (HTTP/1.1 200) 6 headers in 223 bytes (1 switches on core 0) May 28 12:47:46 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.provider_tree [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Inventory has not changed in ProviderTree for provider: ef90d7d1-0808-4a15-ad77-f9a7391af2f4 {{(pid=83654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} May 28 12:47:46 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Expecting reply to msg 69298640763c4528b48f45db673fbca8 in queue reply_37f4cbd1dd094961a22b8a65f222c327 May 28 12:47:46 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [-] Received RPC response for msg 69298640763c4528b48f45db673fbca8 May 28 12:47:46 l75lg1-v1 dstat.sh[49771]: 28-05 12:47:46| 2 1 97 0 0|4543M 4600M 268M 6274M|3377k 59k| 0 60k| 0 3.00 |5250 4836 |0.42 1.30 1.19|1.0 0 0| 0 0 | 0 2048M| 27 287 0 3 0 May 28 12:47:46 l75lg1-v1 nova-compute[83654]: DEBUG nova.scheduler.client.report [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Inventory has not changed for provider ef90d7d1-0808-4a15-ad77-f9a7391af2f4 based on inventory data: {'MEMORY_MB': {'total': 16000, 'reserved': 512, 'min_unit': 1, 'max_unit': 16000, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 10, 'reserved': 0, 'min_unit': 1, 'max_unit': 10, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 28, 'reserved': 0, 'min_unit': 1, 'max_unit': 28, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=83654) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}} May 28 12:47:46 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.resource_tracker [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Compute_service record updated for l75lg1-v1:l75lg1-v1 {{(pid=83654) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}} May 28 12:47:46 l75lg1-v1 nova-compute[83654]: DEBUG oslo_concurrency.lockutils [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.555s {{(pid=83654) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:47:47 l75lg1-v1 dstat.sh[49771]: 28-05 12:47:47| 1 0 98 0 0|4542M 4597M 268M 6277M|3302k 58k| 0 20k| 0 1.00 |4843 4506 |0.39 1.28 1.18| 0 0 0| 0 0 | 0 2048M| 27 287 0 3 0 May 28 12:47:48 l75lg1-v1 dstat.sh[49771]: 28-05 12:47:48| 1 1 98 0 0|4542M 4594M 268M 6280M|3280k 58k| 0 0 | 0 0 |4899 4515 |0.39 1.28 1.18| 0 0 2.0| 0 0 | 0 2048M| 27 287 0 3 0 May 28 12:47:49 l75lg1-v1 dstat.sh[49771]: 28-05 12:47:49| 1 1 98 0 0|4542M 4591M 268M 6284M|3499k 59k| 0 0 | 0 0 |4684 4320 |0.39 1.28 1.18| 0 0 0| 0 0 | 0 2048M| 27 287 0 3 0 May 28 12:47:50 l75lg1-v1 dstat.sh[49771]: 28-05 12:47:50| 1 0 98 0 0|4542M 4587M 268M 6287M|3449k 56k| 0 320k| 0 31.0 |4669 4633 |0.39 1.28 1.18|1.0 0 0| 0 0 | 0 2048M| 27 287 0 3 0 May 28 12:47:51 l75lg1-v1 dstat.sh[49771]: 28-05 12:47:51| 1 1 98 0 0|4543M 4583M 268M 6291M|3902k 62k| 0 356k| 0 69.0 |5097 4708 |0.39 1.28 1.18| 0 0 0| 0 0 | 0 2048M| 27 287 0 3 0 May 28 12:47:51 l75lg1-v1 neutron-server[77623]: DEBUG dbcounter [-] [77623] Writing DB stats neutron:SELECT=1 {{(pid=77623) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:47:52 l75lg1-v1 dstat.sh[49771]: 28-05 12:47:52| 0 0 98 0 0|4542M 4579M 268M 6295M|4160k 59k| 0 44k| 0 5.00 |4900 4608 |0.36 1.26 1.18| 0 0 0| 0 0 | 0 2048M| 27 287 0 3 0 May 28 12:47:53 l75lg1-v1 dstat.sh[49771]: 28-05 12:47:53| 1 0 98 0 0|4543M 4575M 268M 6299M|4494k 64k| 0 0 | 0 0 |5130 4701 |0.36 1.26 1.18| 0 0 0| 0 0 | 0 2048M| 27 287 0 3 0 May 28 12:47:54 l75lg1-v1 dstat.sh[49771]: 28-05 12:47:54| 1 0 98 0 0|4542M 4570M 268M 6304M|5214k 66k| 0 0 | 0 0 |5081 4627 |0.36 1.26 1.18| 0 0 0| 0 0 | 0 2048M| 27 287 0 3 0 May 28 12:47:55 l75lg1-v1 dstat.sh[49771]: 28-05 12:47:55| 1 1 99 0 0|4543M 4565M 268M 6308M|4817k 50k| 0 0 | 0 0 |4374 3796 |0.36 1.26 1.18| 0 0 0| 0 0 | 0 2048M| 27 287 0 3 0 May 28 12:47:56 l75lg1-v1 devstack@placement-api.service[78201]: DEBUG dbcounter [-] [78201] Writing DB stats placement:SELECT=2 {{(pid=78201) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:47:56 l75lg1-v1 devstack@placement-api.service[78202]: DEBUG dbcounter [-] [78202] Writing DB stats placement:SELECT=2 {{(pid=78202) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:47:56 l75lg1-v1 nova-conductor[83648]: DEBUG dbcounter [-] [83648] Writing DB stats nova_cell1:SELECT=2 {{(pid=83648) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:47:56 l75lg1-v1 dstat.sh[49771]: 28-05 12:47:56| 1 0 98 0 0|4544M 4559M 268M 6313M|4654k 65k| 0 312k| 0 53.0 |5371 4951 |0.36 1.26 1.18| 0 0 0| 0 0 | 0 2048M| 27 287 0 3 0 May 28 12:47:57 l75lg1-v1 dstat.sh[49771]: 28-05 12:47:57| 1 1 98 0 0|4545M 4553M 268M 6317M|4800k 49k| 0 8297k| 0 38.0 |4193 3912 |0.33 1.23 1.17| 0 0 0| 0 0 | 0 2048M| 27 287 0 3 0 May 28 12:47:58 l75lg1-v1 dstat.sh[49771]: 28-05 12:47:58| 1 0 99 0 0|4545M 4551M 268M 6319M|2266k 29k| 0 8189B| 0 1.00 |2658 2984 |0.33 1.23 1.17| 0 0 2.0| 0 0 | 0 2048M| 27 287 0 3 0 May 28 12:47:59 l75lg1-v1 dstat.sh[49771]: 28-05 12:47:59| 1 1 99 0 0|4545M 4549M 268M 6321M|2113k 39k| 0 0 | 0 0 |2783 3620 |0.33 1.23 1.17| 0 0 0| 0 0 | 0 2048M| 27 287 0 3 0 May 28 12:47:59 l75lg1-v1 nova-conductor[83647]: DEBUG dbcounter [-] [83647] Writing DB stats nova_cell1:SELECT=2,nova_cell1:UPDATE=2 {{(pid=83647) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:47:59 l75lg1-v1 nova-conductor[83648]: DEBUG dbcounter [-] [83648] Writing DB stats nova_cell1:SELECT=3 {{(pid=83648) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:48:00 l75lg1-v1 dstat.sh[49771]: 28-05 12:48:00| 1 1 98 1 0|4543M 4549M 268M 6323M|2166k 40k| 0 404k| 0 42.0 |3895 4579 |0.33 1.23 1.17| 0 0 0| 0 0 | 0 2048M| 27 287 0 3 0 May 28 12:48:00 l75lg1-v1 neutron-server[77618]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.HashRingHealthCheckPeriodics.touch_hash_ring_nodes' {{(pid=77618) _process_scheduled /opt/stack/data/venv/lib/python3.10/site-packages/futurist/periodics.py:638}} May 28 12:48:01 l75lg1-v1 dstat.sh[49771]: 28-05 12:48:01| 0 0 98 0 0|4544M 4546M 268M 6325M|2202k 42k| 0 432k| 0 82.0 |4195 4415 |0.33 1.23 1.17| 0 0 0| 0 0 | 0 2048M| 27 287 0 3 0 May 28 12:48:02 l75lg1-v1 dstat.sh[49771]: 28-05 12:48:02| 1 0 99 0 0|4544M 4544M 268M 6328M|2286k 42k| 0 0 | 0 0 |3738 3703 |0.30 1.21 1.16| 0 0 0| 0 0 | 0 2048M| 27 287 0 3 0 May 28 12:48:03 l75lg1-v1 dstat.sh[49771]: 28-05 12:48:03| 1 1 96 2 0|4545M 4541M 268M 6330M|2223k 40k| 0 72M| 0 94.0 |3453 4045 |0.30 1.21 1.16| 0 0 0| 0 0 | 0 2048M| 27 287 0 3 0 May 28 12:48:04 l75lg1-v1 dstat.sh[49771]: 28-05 12:48:04| 1 0 98 0 0|4545M 4538M 268M 6332M|2295k 42k| 0 40k| 0 7.00 |4050 3966 |0.30 1.21 1.16| 0 0 0| 0 0 | 0 2048M| 27 287 0 3 0 May 28 12:48:05 l75lg1-v1 dstat.sh[49771]: 28-05 12:48:05| 1 0 98 0 0|4544M 4537M 268M 6334M|2350k 44k| 0 0 | 0 0 |4159 4070 |0.30 1.21 1.16| 0 0 0| 0 0 | 0 2048M| 27 287 0 3 0 May 28 12:48:06 l75lg1-v1 dstat.sh[49771]: 28-05 12:48:06| 1 0 98 0 0|4545M 4535M 268M 6336M|2273k 40k| 0 0 | 0 0 |3899 3893 |0.30 1.21 1.16|1.0 0 0| 0 0 | 0 2048M| 27 287 0 3 0 May 28 12:48:07 l75lg1-v1 dstat.sh[49771]: 28-05 12:48:07| 1 0 98 0 0|4544M 4532M 268M 6338M|2531k 44k| 0 144k| 0 30.0 |3929 3875 |0.36 1.21 1.16| 0 0 0| 0 0 | 0 2048M| 27 287 0 3 0 May 28 12:48:08 l75lg1-v1 dstat.sh[49771]: 28-05 12:48:08| 1 1 98 0 0|4545M 4529M 268M 6341M|2603k 44k| 0 0 | 0 0 |3843 3751 |0.36 1.21 1.16| 0 0 2.0| 0 0 | 0 2048M| 27 287 0 3 0 May 28 12:48:09 l75lg1-v1 dstat.sh[49771]: 28-05 12:48:09| 1 0 98 0 0|4545M 4526M 268M 6344M|2912k 52k| 0 68k| 0 4.00 |4248 4071 |0.36 1.21 1.16| 0 0 0| 0 0 | 0 2048M| 27 287 0 3 0 May 28 12:48:09 l75lg1-v1 nova-conductor[83647]: DEBUG dbcounter [-] [83647] Writing DB stats nova_cell1:SELECT=3,nova_cell1:UPDATE=1 {{(pid=83647) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:48:09 l75lg1-v1 nova-conductor[83648]: DEBUG dbcounter [-] [83648] Writing DB stats nova_cell1:SELECT=1 {{(pid=83648) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:48:10 l75lg1-v1 dstat.sh[49771]: 28-05 12:48:10| 1 1 98 0 0|4545M 4523M 268M 6347M|3444k 60k| 0 352k| 0 38.0 |5116 4999 |0.36 1.21 1.16|1.0 0 0| 0 0 | 0 2048M| 27 287 0 3 0 May 28 12:48:10 l75lg1-v1 neutron-server[77618]: DEBUG dbcounter [-] [77618] Writing DB stats neutron:UPDATE=1 {{(pid=77618) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:48:10 l75lg1-v1 neutron-server[77618]: DEBUG dbcounter [-] [77618] Writing DB stats neutron:SELECT=1 {{(pid=77618) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:48:11 l75lg1-v1 dstat.sh[49771]: 28-05 12:48:11| 1 0 98 0 0|4545M 4519M 268M 6350M|3725k 59k| 0 104k| 0 15.0 |4993 4704 |0.36 1.21 1.16| 0 0 0| 0 0 | 0 2048M| 27 287 0 3 0 May 28 12:48:12 l75lg1-v1 dstat.sh[49771]: 28-05 12:48:12| 1 1 98 0 0|4546M 4514M 268M 6354M|4706k 70k| 0 256k| 0 53.0 |5935 5449 |0.33 1.19 1.16| 0 0 0| 0 0 | 0 2048M| 27 287 0 3 0 May 28 12:48:13 l75lg1-v1 dstat.sh[49771]: 28-05 12:48:13| 0 0 98 0 0|4548M 4507M 268M 6359M|4824k 53k| 0 0 | 0 0 |4774 4082 |0.33 1.19 1.16|1.0 0 0| 0 0 | 0 2048M| 27 287 0 3 0 May 28 12:48:14 l75lg1-v1 dstat.sh[49771]: 28-05 12:48:14| 1 1 99 0 0|4548M 4503M 268M 6363M|4261k 62k| 0 0 | 0 0 |5128 4732 |0.33 1.19 1.16|2.0 0 0| 0 0 | 0 2048M| 27 287 0 3 0 May 28 12:48:15 l75lg1-v1 dstat.sh[49771]: 28-05 12:48:15| 1 0 98 0 0|4547M 4500M 268M 6367M|3974k 53k| 0 172k| 0 3.00 |4571 3901 |0.33 1.19 1.16|1.0 0 0| 0 0 | 0 2048M| 27 287 0 3 0 May 28 12:48:16 l75lg1-v1 dstat.sh[49771]: 28-05 12:48:16| 1 0 98 0 0|4548M 4496M 268M 6370M|3539k 63k| 0 64k| 0 3.00 |5106 4677 |0.33 1.19 1.16| 0 0 0| 0 0 | 0 2048M| 27 287 0 3 0 May 28 12:48:16 l75lg1-v1 neutron-server[77623]: DEBUG dbcounter [-] [77623] Writing DB stats neutron:SELECT=2 {{(pid=77623) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:48:16 l75lg1-v1 neutron-server[77623]: DEBUG dbcounter [-] [77623] Writing DB stats neutron:SELECT=1 {{(pid=77623) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:48:17 l75lg1-v1 dstat.sh[49771]: 28-05 12:48:17| 1 0 99 0 0|4548M 4492M 268M 6374M|3817k 59k| 0 60k| 0 8.00 |4947 4606 |0.30 1.17 1.15| 0 0 0| 0 0 | 0 2048M| 27 287 0 3 0 May 28 12:48:18 l75lg1-v1 dstat.sh[49771]: 28-05 12:48:18| 1 0 98 0 0|4549M 4488M 268M 6378M|3875k 55k| 0 216k| 0 47.0 |4800 4566 |0.30 1.17 1.15| 0 0 2.0| 0 0 | 0 2048M| 27 287 0 3 0 May 28 12:48:18 l75lg1-v1 neutron-server[77623]: DEBUG neutron.db.agents_db [None req-fe40ce8c-640e-4db7-a17a-6e8888cce266 None None] Agent healthcheck: found 0 active agents {{(pid=77623) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:319}} May 28 12:48:19 l75lg1-v1 dstat.sh[49771]: 28-05 12:48:19| 1 0 99 0 0|4548M 4485M 268M 6381M|3301k 43k| 0 0 | 0 0 |3995 3644 |0.30 1.17 1.15|1.0 0 0| 0 0 | 0 2048M| 27 287 0 3 0 May 28 12:48:19 l75lg1-v1 nova-conductor[83647]: DEBUG dbcounter [-] [83647] Writing DB stats nova_cell1:SELECT=1,nova_cell1:UPDATE=1 {{(pid=83647) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:48:19 l75lg1-v1 nova-conductor[83648]: DEBUG dbcounter [-] [83648] Writing DB stats nova_cell1:SELECT=1 {{(pid=83648) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:48:20 l75lg1-v1 dstat.sh[49771]: 28-05 12:48:20| 1 0 98 0 0|4548M 4482M 268M 6384M|3107k 56k| 0 184k| 0 26.0 |4964 4970 |0.30 1.17 1.15| 0 0 0| 0 0 | 0 2048M| 27 287 0 3 0 May 28 12:48:21 l75lg1-v1 dstat.sh[49771]: 28-05 12:48:21| 1 0 98 0 0|4549M 4479M 268M 6387M|3203k 59k| 0 60k| 0 5.00 |5049 4826 |0.30 1.17 1.15|1.0 0 0| 0 0 | 0 2048M| 27 287 0 3 0 May 28 12:48:22 l75lg1-v1 dstat.sh[49771]: 28-05 12:48:22| 1 0 98 0 0|4549M 4475M 268M 6390M|3158k 50k| 0 216k| 0 13.0 |3409 3902 |0.28 1.15 1.14|1.0 0 0| 0 0 | 0 2048M| 27 287 0 3 0 May 28 12:48:23 l75lg1-v1 dstat.sh[49771]: 28-05 12:48:23| 1 0 98 0 0|4549M 4473M 268M 6392M|2519k 45k| 0 296k| 0 60.0 |4083 3931 |0.28 1.15 1.14| 0 0 0| 0 0 | 0 2048M| 27 287 0 3 0 May 28 12:48:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "_check_child_processes" by "neutron.agent.linux.external_process.ProcessMonitor._check_child_processes" {{(pid=76818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:48:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_concurrency.lockutils [-] Lock "_check_child_processes" acquired by "neutron.agent.linux.external_process.ProcessMonitor._check_child_processes" :: waited 0.000s {{(pid=76818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:48:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_concurrency.lockutils [-] Lock "_check_child_processes" "released" by "neutron.agent.linux.external_process.ProcessMonitor._check_child_processes" :: held 0.000s {{(pid=76818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:48:24 l75lg1-v1 dstat.sh[49771]: 28-05 12:48:24| 3 2 95 0 0|4545M 4474M 268M 6395M|2651k 50k| 0 0 | 0 0 |5344 5581 |0.28 1.15 1.14| 0 0 46| 0 0 | 0 2048M| 27 287 0 3 0 May 28 12:48:25 l75lg1-v1 dstat.sh[49771]: 28-05 12:48:25| 0 0 99 0 0|4545M 4472M 268M 6397M|2837k 53k| 0 0 | 0 0 |4782 4530 |0.28 1.15 1.14| 0 0 0| 0 0 | 0 2048M| 27 287 0 3 0 May 28 12:48:25 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_service.periodic_task [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85846) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:48:25 l75lg1-v1 cinder-volume[85846]: DEBUG cinder.volume.drivers.lvm [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] Updating volume stats {{(pid=85846) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}} May 28 12:48:25 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:390}} May 28 12:48:25 l75lg1-v1 sudo[88420]: vastdata : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 May 28 12:48:25 l75lg1-v1 sudo[88420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) May 28 12:48:26 l75lg1-v1 sudo[88420]: pam_unix(sudo:session): session closed for user root May 28 12:48:26 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.494s {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:428}} May 28 12:48:26 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:390}} May 28 12:48:26 l75lg1-v1 sudo[88423]: vastdata : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 May 28 12:48:26 l75lg1-v1 sudo[88423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) May 28 12:48:26 l75lg1-v1 dstat.sh[49771]: 28-05 12:48:26| 5 1 93 0 0|4545M 4469M 268M 6400M|2810k 52k| 256k 0 |2.00 0 |5028 4622 |0.28 1.15 1.14|1.0 0 5.0| 0 0 | 0 2048M| 27 287 0 3 0 May 28 12:48:26 l75lg1-v1 sudo[88423]: pam_unix(sudo:session): session closed for user root May 28 12:48:26 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.458s {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:428}} May 28 12:48:26 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:390}} May 28 12:48:26 l75lg1-v1 sudo[88426]: vastdata : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool May 28 12:48:26 l75lg1-v1 sudo[88426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) May 28 12:48:27 l75lg1-v1 sudo[88426]: pam_unix(sudo:session): session closed for user root May 28 12:48:27 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.487s {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:428}} May 28 12:48:27 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:390}} May 28 12:48:27 l75lg1-v1 sudo[88429]: vastdata : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 May 28 12:48:27 l75lg1-v1 sudo[88429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) May 28 12:48:27 l75lg1-v1 dstat.sh[49771]: 28-05 12:48:27| 8 2 89 0 0|4539M 4472M 268M 6402M|2838k 52k| 640k 16k|5.00 3.00 |3981 4782 |0.34 1.15 1.14|1.0 0 6.0| 0 0 | 0 2048M| 27 287 0 3 0 May 28 12:48:27 l75lg1-v1 sudo[88429]: pam_unix(sudo:session): session closed for user root May 28 12:48:27 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.464s {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:428}} May 28 12:48:27 l75lg1-v1 cinder-volume[85846]: DEBUG cinder.manager [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] Notifying Schedulers of capabilities ... {{(pid=85846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 28 12:48:27 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.scheduler.host_manager [None req-a6919f5a-57ab-4e29-ac69-54e85dddd589 None None] Received volume service update from l75lg1-v1@lvmdriver-1: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:l75lg1-v1:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up', 'allocated_capacity_gb': 0, 'cacheable': True}], 'shared_targets': False, 'sparse_copy_volume': True, 'filter_function': None, 'goodness_function': None} {{(pid=85128) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:628}} May 28 12:48:28 l75lg1-v1 dstat.sh[49771]: 28-05 12:48:28| 3 1 95 0 0|4535M 4473M 268M 6405M|2900k 53k| 256k 4278k|2.00 32.0 |4015 4782 |0.34 1.15 1.14| 0 0 9.0| 0 0 | 0 2048M| 27 287 0 3 0 May 28 12:48:28 l75lg1-v1 neutron-server[77623]: DEBUG dbcounter [-] [77623] Writing DB stats neutron:SELECT=1 {{(pid=77623) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:48:29 l75lg1-v1 dstat.sh[49771]: 28-05 12:48:29| 1 0 98 0 0|4535M 4470M 268M 6408M|2833k 52k| 0 612k| 0 113 |4572 4380 |0.34 1.15 1.14|1.0 0 0| 0 0 | 0 2048M| 27 287 0 3 0 May 28 12:48:29 l75lg1-v1 nova-conductor[83647]: DEBUG dbcounter [-] [83647] Writing DB stats nova_cell1:SELECT=1,nova_cell1:UPDATE=1 {{(pid=83647) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:48:29 l75lg1-v1 nova-conductor[83648]: DEBUG dbcounter [-] [83648] Writing DB stats nova_cell1:SELECT=1 {{(pid=83648) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:48:30 l75lg1-v1 dstat.sh[49771]: 28-05 12:48:30| 1 0 98 0 0|4536M 4467M 268M 6411M|2841k 45k| 0 340k| 0 39.0 |4448 4266 |0.34 1.15 1.14| 0 0 0| 0 0 | 0 2048M| 27 287 0 3 0 May 28 12:48:30 l75lg1-v1 neutron-server[77618]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.HashRingHealthCheckPeriodics.touch_hash_ring_nodes' {{(pid=77618) _process_scheduled /opt/stack/data/venv/lib/python3.10/site-packages/futurist/periodics.py:638}} May 28 12:48:30 l75lg1-v1 neutron-server[77622]: DEBUG futurist.periodics [None req-fbd03350-93f0-48b6-99af-923b4570b093 None None] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_for_inconsistencies' {{(pid=77622) _process_scheduled /opt/stack/data/venv/lib/python3.10/site-packages/futurist/periodics.py:638}} May 28 12:48:30 l75lg1-v1 neutron-server[77622]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-fbd03350-93f0-48b6-99af-923b4570b093 None None] Maintenance task: Synchronizing Neutron and OVN databases started {{(pid=77622) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:340}} May 28 12:48:30 l75lg1-v1 neutron-server[77622]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-fbd03350-93f0-48b6-99af-923b4570b093 None None] Maintenance task: Number of inconsistencies found at create/update: networks=2, security_groups=1 {{(pid=77622) _log /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:321}} May 28 12:48:30 l75lg1-v1 neutron-server[77622]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-fbd03350-93f0-48b6-99af-923b4570b093 None None] Maintenance task: Fixing resource fb218033-3d98-4065-b336-c595d5e6ca77 (type: networks) at create/update {{(pid=77622) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:350}} May 28 12:48:30 l75lg1-v1 neutron-server[77622]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-fb218033-3d98-4065-b336-c595d5e6ca77, resource={'id': 'fb218033-3d98-4065-b336-c595d5e6ca77', 'name': 'private', 'tenant_id': '95de88f6d26e4420bc466ba67668171f', 'admin_state_up': True, 'mtu': 1442, 'status': 'ACTIVE', 'subnets': ['5508b790-cc91-4b59-8d30-81ef4480e470', '799ded51-0b75-4f67-94e9-0a7ea3c3f3d6'], 'standard_attr_id': 12, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'vlan_transparent': None, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2024-05-28T12:43:43Z', 'updated_at': '2024-05-28T12:43:49Z', 'revision_number': 3, 'project_id': '95de88f6d26e4420bc466ba67668171f', 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 30276}, resource_type=networks, if_exists=True) {{(pid=77622) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:48:30 l75lg1-v1 neutron-server[77622]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Logical_Switch, record=neutron-fb218033-3d98-4065-b336-c595d5e6ca77, col_values=(('external_ids', {'neutron:network_name': 'private', 'neutron:mtu': '1442', 'neutron:revision_number': '3', 'neutron:availability_zone_hints': '', 'neutron:provnet-network-type': 'geneve'}), ('other_config', {'mcast_snoop': 'false', 'mcast_flood_unregistered': 'false', 'vlan-passthru': 'false'})), if_exists=True) {{(pid=77622) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:48:30 l75lg1-v1 neutron-server[77622]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLSwitchPortCommand(_result=None, lport=provnet-bb1bf6f8-e34d-458b-82c6-3d470163b0d7, external_ids_update=None, columns={'tag': 30276}, if_exists=True) {{(pid=77622) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:48:30 l75lg1-v1 neutron-server[77619]: DEBUG neutron.common.ovn.hash_ring_manager [None req-53cecb61-7023-41e4-a5ea-23b1eb02606a None None] Hash Ring loaded. 2 active nodes. 0 offline nodes {{(pid=77619) _load_hash_ring /opt/stack/neutron/neutron/common/ovn/hash_ring_manager.py:99}} May 28 12:48:30 l75lg1-v1 neutron-server[77621]: DEBUG neutron.common.ovn.hash_ring_manager [-] Hash Ring loaded. 2 active nodes. 0 offline nodes {{(pid=77621) _load_hash_ring /opt/stack/neutron/neutron/common/ovn/hash_ring_manager.py:99}} May 28 12:48:30 l75lg1-v1 neutron-server[77618]: DEBUG neutron.common.ovn.hash_ring_manager [None req-c63b1acc-b5c6-4be8-9db9-04824fec27f2 None None] Hash Ring loaded. 2 active nodes. 0 offline nodes {{(pid=77618) _load_hash_ring /opt/stack/neutron/neutron/common/ovn/hash_ring_manager.py:99}} May 28 12:48:30 l75lg1-v1 neutron-server[77618]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-c63b1acc-b5c6-4be8-9db9-04824fec27f2 None None] Hash Ring: Node 4c6fc793-7f5a-456f-b4d6-6e5bd97592f2 (host: l75lg1-v1) handling event "update" for row e0112af8-ce41-4b01-ad87-93806fb91451 (table: Logical_Switch) {{(pid=77618) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:48:30 l75lg1-v1 neutron-server[77622]: INFO neutron.db.ovn_revision_numbers_db [None req-fbd03350-93f0-48b6-99af-923b4570b093 None None] Successfully bumped revision number for resource fb218033-3d98-4065-b336-c595d5e6ca77 (type: networks) to 3 May 28 12:48:30 l75lg1-v1 neutron-server[77622]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-fbd03350-93f0-48b6-99af-923b4570b093 None None] Maintenance task: Fixing resource 5066e001-05ee-4812-ba7f-98a035d8bd0a (type: networks) at create/update {{(pid=77622) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:350}} May 28 12:48:30 l75lg1-v1 neutron-server[77622]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-5066e001-05ee-4812-ba7f-98a035d8bd0a, resource={'id': '5066e001-05ee-4812-ba7f-98a035d8bd0a', 'name': 'public', 'tenant_id': 'ea8d517cde1d40bb82c97e080ce071f7', 'admin_state_up': True, 'mtu': 1500, 'status': 'ACTIVE', 'subnets': ['6178146d-51fe-4ab8-9844-d8c72981438d', 'cddf717c-a51e-4470-8ce9-c2ab09a80e38'], 'standard_attr_id': 23, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': True, 'vlan_transparent': None, 'description': '', 'port_security_enabled': True, 'is_default': True, 'tags': [], 'created_at': '2024-05-28T12:43:59Z', 'updated_at': '2024-05-28T12:44:17Z', 'revision_number': 3, 'project_id': 'ea8d517cde1d40bb82c97e080ce071f7', 'provider:network_type': 'flat', 'provider:physical_network': 'public', 'provider:segmentation_id': None}, resource_type=networks, if_exists=True) {{(pid=77622) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:48:30 l75lg1-v1 neutron-server[77622]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Logical_Switch, record=neutron-5066e001-05ee-4812-ba7f-98a035d8bd0a, col_values=(('external_ids', {'neutron:network_name': 'public', 'neutron:mtu': '1500', 'neutron:revision_number': '3', 'neutron:availability_zone_hints': '', 'neutron:provnet-network-type': 'flat'}), ('other_config', {'mcast_snoop': 'false', 'mcast_flood_unregistered': 'false', 'vlan-passthru': 'false', 'fdb_age_threshold': '0'})), if_exists=True) {{(pid=77622) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:48:30 l75lg1-v1 neutron-server[77622]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLSwitchPortCommand(_result=None, lport=provnet-3385f5f9-bbb0-40f0-9631-6fb158c3207c, external_ids_update=None, columns={'tag': []}, if_exists=True) {{(pid=77622) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:48:30 l75lg1-v1 neutron-server[77618]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-c63b1acc-b5c6-4be8-9db9-04824fec27f2 None None] Hash Ring: Node 4c6fc793-7f5a-456f-b4d6-6e5bd97592f2 (host: l75lg1-v1) handling event "update" for row b946fae3-ebd4-42d6-9336-c908375c2ee1 (table: Logical_Switch) {{(pid=77618) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:48:31 l75lg1-v1 neutron-server[77622]: INFO neutron.db.ovn_revision_numbers_db [None req-fbd03350-93f0-48b6-99af-923b4570b093 None None] Successfully bumped revision number for resource 5066e001-05ee-4812-ba7f-98a035d8bd0a (type: networks) to 3 May 28 12:48:31 l75lg1-v1 neutron-server[77622]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-fbd03350-93f0-48b6-99af-923b4570b093 None None] Maintenance task: Fixing resource ca135474-48d5-4746-a063-2afb7533e575 (type: security_groups) at create/update {{(pid=77622) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:350}} May 28 12:48:31 l75lg1-v1 neutron-server[77622]: INFO neutron.db.ovn_revision_numbers_db [None req-fbd03350-93f0-48b6-99af-923b4570b093 None None] Successfully bumped revision number for resource ca135474-48d5-4746-a063-2afb7533e575 (type: security_groups) to 9 May 28 12:48:31 l75lg1-v1 neutron-server[77622]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-fbd03350-93f0-48b6-99af-923b4570b093 None None] Maintenance task: Synchronization completed (took 0.43 seconds) May 28 12:48:31 l75lg1-v1 neutron-server[77622]: DEBUG futurist.periodics [None req-fbd03350-93f0-48b6-99af-923b4570b093 None None] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.remove_duplicated_chassis_registers' {{(pid=77622) _process_scheduled /opt/stack/data/venv/lib/python3.10/site-packages/futurist/periodics.py:638}} May 28 12:48:31 l75lg1-v1 dstat.sh[49771]: 28-05 12:48:31| 5 1 93 1 0|4540M 4460M 268M 6413M|2197k 39k| 0 444k| 0 72.0 |5235 6178 |0.34 1.15 1.14|1.0 0 0| 0 0 | 0 2048M| 27 287 0 3 0 May 28 12:48:32 l75lg1-v1 dstat.sh[49771]: 28-05 12:48:32| 1 1 98 0 0|4540M 4458M 268M 6415M|2496k 47k| 0 288k| 0 32.0 |4590 4803 |0.31 1.13 1.14|1.0 0 0| 0 0 | 0 2048M| 27 287 0 3 0 May 28 12:48:33 l75lg1-v1 dstat.sh[49771]: 28-05 12:48:33| 0 1 97 1 0|4541M 4455M 268M 6417M|2122k 34k| 0 86M| 0 215 |3841 3861 |0.31 1.13 1.14| 0 0 0| 0 0 | 0 2048M| 27 287 0 3 0 May 28 12:48:34 l75lg1-v1 dstat.sh[49771]: 28-05 12:48:34| 1 0 97 2 0|4541M 4453M 268M 6419M|2046k 39k| 0 480k| 0 87.0 |3822 3871 |0.31 1.13 1.14| 0 0 0| 0 0 | 0 2048M| 27 287 0 3 0 May 28 12:48:35 l75lg1-v1 dstat.sh[49771]: 28-05 12:48:35| 1 0 99 0 0|4542M 4449M 268M 6421M|2190k 43k| 0 0 | 0 0 |3908 3969 |0.31 1.13 1.14|1.0 0 0| 0 0 | 0 2048M| 27 287 0 3 0 May 28 12:48:36 l75lg1-v1 dstat.sh[49771]: 28-05 12:48:36| 0 0 98 0 0|4543M 4447M 268M 6423M|2260k 41k| 0 4087B| 0 1.00 |3637 3741 |0.31 1.13 1.14|1.0 0 0| 0 0 | 0 2048M| 27 287 0 3 0 May 28 12:48:37 l75lg1-v1 dstat.sh[49771]: 28-05 12:48:37| 0 0 99 0 0|4543M 4445M 268M 6425M|1833k 28k| 0 0 | 0 0 |2448 2942 |0.28 1.11 1.13|1.0 0 0| 0 0 | 0 2048M| 27 287 0 3 0 May 28 12:48:38 l75lg1-v1 dstat.sh[49771]: 28-05 12:48:38| 1 0 98 0 0|4543M 4443M 268M 6426M|1884k 35k| 0 112k| 0 17.0 |3053 4003 |0.28 1.11 1.13| 0 0 2.0| 0 0 | 0 2048M| 27 287 0 3 0 May 28 12:48:39 l75lg1-v1 dstat.sh[49771]: 28-05 12:48:39| 1 0 98 0 0|4543M 4441M 268M 6428M|2074k 40k| 0 200k| 0 15.0 |3760 3801 |0.28 1.11 1.13| 0 0 0| 0 0 | 0 2048M| 27 287 0 3 0 May 28 12:48:39 l75lg1-v1 nova-conductor[83648]: DEBUG dbcounter [-] [83648] Writing DB stats nova_cell1:SELECT=1 {{(pid=83648) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:48:40 l75lg1-v1 dstat.sh[49771]: 28-05 12:48:40| 1 1 98 0 0|4544M 4438M 268M 6430M|2171k 40k| 0 296k| 0 54.0 |4074 4309 |0.28 1.11 1.13|2.0 0 0| 0 0 | 0 2048M| 27 287 0 3 0 May 28 12:48:40 l75lg1-v1 neutron-server[77619]: DEBUG dbcounter [-] [77619] Writing DB stats neutron:SELECT=1 {{(pid=77619) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:48:40 l75lg1-v1 neutron-server[77618]: DEBUG dbcounter [-] [77618] Writing DB stats neutron:SELECT=1 {{(pid=77618) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:48:40 l75lg1-v1 neutron-server[77621]: DEBUG dbcounter [-] [77621] Writing DB stats neutron:SELECT=2 {{(pid=77621) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:48:40 l75lg1-v1 neutron-server[77619]: DEBUG dbcounter [-] [77619] Writing DB stats neutron:SELECT=1 {{(pid=77619) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:48:40 l75lg1-v1 neutron-server[77618]: DEBUG dbcounter [-] [77618] Writing DB stats neutron:UPDATE=2,neutron:SELECT=2 {{(pid=77618) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:48:41 l75lg1-v1 neutron-server[77622]: DEBUG dbcounter [-] [77622] Writing DB stats neutron:SELECT=42,neutron:UPDATE=1 {{(pid=77622) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:48:41 l75lg1-v1 neutron-server[77622]: DEBUG dbcounter [-] [77622] Writing DB stats neutron:SELECT=40,neutron:UPDATE=2 {{(pid=77622) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:48:41 l75lg1-v1 dstat.sh[49771]: 28-05 12:48:41| 0 0 98 0 0|4544M 4436M 268M 6433M|2276k 42k| 0 236k| 0 40.0 |4208 4408 |0.28 1.11 1.13| 0 0 1.0| 0 0 | 0 2048M| 27 289 0 3 0 May 28 12:48:41 l75lg1-v1 nova-scheduler[81196]: DEBUG dbcounter [-] [81196] Writing DB stats nova_cell0:SELECT=1,nova_cell0:UPDATE=1 {{(pid=81196) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:48:41 l75lg1-v1 nova-scheduler[81194]: DEBUG dbcounter [-] [81194] Writing DB stats nova_cell0:SELECT=1 {{(pid=81194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:48:42 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:48:42 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:48:42 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.manager [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Starting heal instance info cache {{(pid=83654) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}} May 28 12:48:42 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.manager [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Rebuilding the list of instances to heal {{(pid=83654) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9930}} May 28 12:48:42 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Expecting reply to msg e9dad3e3925744cc9edf1c09a41a6bc2 in queue reply_37f4cbd1dd094961a22b8a65f222c327 May 28 12:48:42 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [-] Received RPC response for msg e9dad3e3925744cc9edf1c09a41a6bc2 May 28 12:48:42 l75lg1-v1 dstat.sh[49771]: 28-05 12:48:42| 1 0 98 0 0|4544M 4434M 268M 6434M|2051k 34k| 0 244k| 0 25.0 |3499 3634 |0.42 1.12 1.14| 0 0 0| 0 0 | 0 2048M| 27 289 0 3 0 May 28 12:48:42 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.manager [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Didn't find any instances for network info cache update. {{(pid=83654) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10012}} May 28 12:48:42 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:48:42 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:48:42 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:48:42 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:48:42 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:48:42 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:48:42 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.manager [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=83654) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10545}} May 28 12:48:42 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager.update_available_resource {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:48:42 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Expecting reply to msg 2b0b26f0513f486da395a7af5932d527 in queue reply_37f4cbd1dd094961a22b8a65f222c327 May 28 12:48:42 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [-] Received RPC response for msg 2b0b26f0513f486da395a7af5932d527 May 28 12:48:43 l75lg1-v1 nova-compute[83654]: DEBUG oslo_concurrency.lockutils [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=83654) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:48:43 l75lg1-v1 nova-compute[83654]: DEBUG oslo_concurrency.lockutils [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=83654) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:48:43 l75lg1-v1 nova-compute[83654]: DEBUG oslo_concurrency.lockutils [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=83654) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:48:43 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.resource_tracker [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Auditing locally available compute resources for l75lg1-v1 (node: l75lg1-v1) {{(pid=83654) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}} May 28 12:48:43 l75lg1-v1 dstat.sh[49771]: 28-05 12:48:43| 1 0 98 0 0|4544M 4433M 268M 6436M|1746k 32k| 0 0 | 0 0 |2772 3465 |0.42 1.12 1.14|1.0 0 0| 0 0 | 0 2048M| 27 289 0 3 0 May 28 12:48:43 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.resource_tracker [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Hypervisor/Node resource view: name=l75lg1-v1 free_ram=11136MB free_disk=17.009777069091797GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_01_1", "address": "0000:00:01.1", "product_id": "7010", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7010", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7000", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7000", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "0100", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_0100", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_09_0", "address": "0000:00:09.0", "product_id": "1001", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1001", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "293a", "vendor_id": "8086", "numa_node": null, "label": "label_8086_293a", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_2", "address": "0000:00:07.2", "product_id": "2936", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2936", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "1237", "vendor_id": "8086", "numa_node": null, "label": "label_8086_1237", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "2935", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2935", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "2934", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2934", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_05_0", "address": "0000:00:05.0", "product_id": "1000", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1000", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "1000", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1000", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_06_0", "address": "0000:00:06.0", "product_id": "2668", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2668", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "1000", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1000", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0a_0", "address": "0000:00:0a.0", "product_id": "1002", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1002", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_3", "address": "0000:00:01.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_08_0", "address": "0000:00:08.0", "product_id": "1003", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1003", "dev_type": "type-PCI"}] {{(pid=83654) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}} May 28 12:48:43 l75lg1-v1 nova-compute[83654]: DEBUG oslo_concurrency.lockutils [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=83654) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:48:43 l75lg1-v1 nova-compute[83654]: DEBUG oslo_concurrency.lockutils [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=83654) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:48:43 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Expecting reply to msg 6f2fe1b2dd29415191c39a760a91d0f9 in queue reply_37f4cbd1dd094961a22b8a65f222c327 May 28 12:48:43 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [-] Received RPC response for msg 6f2fe1b2dd29415191c39a760a91d0f9 May 28 12:48:43 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Expecting reply to msg ce99a61c05c442c98de163eb5eae15d0 in queue reply_37f4cbd1dd094961a22b8a65f222c327 May 28 12:48:43 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [-] Received RPC response for msg ce99a61c05c442c98de163eb5eae15d0 May 28 12:48:44 l75lg1-v1 dstat.sh[49771]: 28-05 12:48:44| 2 1 97 0 0|4544M 4430M 268M 6438M|2017k 36k| 0 16k| 0 1.00 |4619 5755 |0.42 1.12 1.14| 0 0 0| 0 0 | 0 2048M| 27 289 0 3 0 May 28 12:48:44 l75lg1-v1 devstack@placement-api.service[78201]: DEBUG placement.requestlog [req-ee55d716-a2d5-47eb-a26a-9502980453e5 req-8073f8a7-76aa-4328-a9ab-0d75bdece90f None None] Starting request: 10.27.203.238 "GET /placement/resource_providers/ef90d7d1-0808-4a15-ad77-f9a7391af2f4/allocations" {{(pid=78201) __call__ /opt/stack/placement/placement/requestlog.py:55}} May 28 12:48:44 l75lg1-v1 devstack@placement-api.service[78201]: INFO placement.requestlog [req-ee55d716-a2d5-47eb-a26a-9502980453e5 req-8073f8a7-76aa-4328-a9ab-0d75bdece90f service placement] 10.27.203.238 "GET /placement/resource_providers/ef90d7d1-0808-4a15-ad77-f9a7391af2f4/allocations" status: 200 len: 54 microversion: 1.0 May 28 12:48:44 l75lg1-v1 devstack@placement-api.service[78201]: [pid: 78201|app: 0|req: 9/18] 10.27.203.238 () {62 vars in 1480 bytes} [Tue May 28 12:48:44 2024] GET /placement/resource_providers/ef90d7d1-0808-4a15-ad77-f9a7391af2f4/allocations => generated 54 bytes in 12 msecs (HTTP/1.1 200) 6 headers in 223 bytes (1 switches on core 0) May 28 12:48:44 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.resource_tracker [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Total usable vcpus: 10, total allocated vcpus: 0 {{(pid=83654) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}} May 28 12:48:44 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.resource_tracker [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Final resource view: name=l75lg1-v1 phys_ram=16000MB used_ram=512MB phys_disk=28GB used_disk=0GB total_vcpus=10 used_vcpus=0 pci_stats=[] {{(pid=83654) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}} May 28 12:48:44 l75lg1-v1 devstack@placement-api.service[78202]: DEBUG placement.requestlog [req-ee55d716-a2d5-47eb-a26a-9502980453e5 req-64741b60-5635-4004-9b5b-c724154e096b None None] Starting request: 10.27.203.238 "GET /placement/resource_providers/ef90d7d1-0808-4a15-ad77-f9a7391af2f4/allocations" {{(pid=78202) __call__ /opt/stack/placement/placement/requestlog.py:55}} May 28 12:48:44 l75lg1-v1 devstack@placement-api.service[78202]: INFO placement.requestlog [req-ee55d716-a2d5-47eb-a26a-9502980453e5 req-64741b60-5635-4004-9b5b-c724154e096b service placement] 10.27.203.238 "GET /placement/resource_providers/ef90d7d1-0808-4a15-ad77-f9a7391af2f4/allocations" status: 200 len: 54 microversion: 1.0 May 28 12:48:44 l75lg1-v1 devstack@placement-api.service[78202]: [pid: 78202|app: 0|req: 10/19] 10.27.203.238 () {62 vars in 1480 bytes} [Tue May 28 12:48:44 2024] GET /placement/resource_providers/ef90d7d1-0808-4a15-ad77-f9a7391af2f4/allocations => generated 54 bytes in 12 msecs (HTTP/1.1 200) 6 headers in 223 bytes (1 switches on core 0) May 28 12:48:44 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.provider_tree [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Inventory has not changed in ProviderTree for provider: ef90d7d1-0808-4a15-ad77-f9a7391af2f4 {{(pid=83654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} May 28 12:48:44 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Expecting reply to msg 7f3952218d25457caffb3a240f21b4da in queue reply_37f4cbd1dd094961a22b8a65f222c327 May 28 12:48:44 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [-] Received RPC response for msg 7f3952218d25457caffb3a240f21b4da May 28 12:48:44 l75lg1-v1 nova-compute[83654]: DEBUG nova.scheduler.client.report [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Inventory has not changed for provider ef90d7d1-0808-4a15-ad77-f9a7391af2f4 based on inventory data: {'MEMORY_MB': {'total': 16000, 'reserved': 512, 'min_unit': 1, 'max_unit': 16000, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 10, 'reserved': 0, 'min_unit': 1, 'max_unit': 10, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 28, 'reserved': 0, 'min_unit': 1, 'max_unit': 28, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=83654) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}} May 28 12:48:44 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.resource_tracker [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Compute_service record updated for l75lg1-v1:l75lg1-v1 {{(pid=83654) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}} May 28 12:48:44 l75lg1-v1 nova-compute[83654]: DEBUG oslo_concurrency.lockutils [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.555s {{(pid=83654) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:48:45 l75lg1-v1 dstat.sh[49771]: 28-05 12:48:45| 1 0 98 0 0|4547M 4426M 268M 6440M|2109k 38k| 0 608k| 0 115 |3944 4037 |0.42 1.12 1.14| 0 0 0| 0 0 | 0 2048M| 27 289 0 3 0 May 28 12:48:46 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:48:46 l75lg1-v1 dstat.sh[49771]: 28-05 12:48:46| 0 0 98 0 0|4549M 4421M 268M 6442M|2234k 41k| 0 236k| 0 6.00 |3857 3883 |0.42 1.12 1.14| 0 0 0| 0 0 | 0 2048M| 27 289 0 3 0 May 28 12:48:47 l75lg1-v1 dstat.sh[49771]: 28-05 12:48:47| 1 0 99 0 0|4549M 4419M 268M 6444M|2285k 41k| 0 0 | 0 0 |3117 3793 |0.39 1.10 1.13| 0 0 0| 0 0 | 0 2048M| 27 289 0 1 0 May 28 12:48:47 l75lg1-v1 nova-conductor[83229]: DEBUG dbcounter [-] [83229] Writing DB stats nova_cell0:SELECT=1,nova_cell0:UPDATE=1 {{(pid=83229) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:48:48 l75lg1-v1 nova-conductor[83233]: DEBUG dbcounter [-] [83233] Writing DB stats nova_cell0:SELECT=1 {{(pid=83233) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:48:48 l75lg1-v1 dstat.sh[49771]: 28-05 12:48:48| 1 0 99 0 0|4549M 4417M 268M 6446M|2229k 41k| 0 108k| 0 12.0 |3788 3825 |0.39 1.10 1.13| 0 0 2.0| 0 0 | 0 2048M| 27 289 0 1 0 May 28 12:48:49 l75lg1-v1 dstat.sh[49771]: 28-05 12:48:49| 0 0 98 0 0|4549M 4415M 268M 6449M|2267k 40k| 0 16k| 0 1.00 |3634 3632 |0.39 1.10 1.13| 0 0 0| 0 0 | 0 2048M| 27 289 0 1 0 May 28 12:48:50 l75lg1-v1 dstat.sh[49771]: 28-05 12:48:50| 0 0 99 0 0|4549M 4412M 268M 6450M|1972k 31k| 0 544k| 0 85.0 |3477 3725 |0.39 1.10 1.13| 0 0 0| 0 0 | 0 2048M| 27 289 0 1 0 May 28 12:48:51 l75lg1-v1 dstat.sh[49771]: 28-05 12:48:51| 1 0 99 0 0|4549M 4411M 268M 6452M|1840k 33k| 0 4097B| 0 1.00 |3383 3636 |0.39 1.10 1.13| 0 0 0| 0 0 | 0 2048M| 27 289 0 1 0 May 28 12:48:52 l75lg1-v1 dstat.sh[49771]: 28-05 12:48:52| 0 0 98 0 0|4549M 4409M 268M 6454M|2037k 38k| 0 40k| 0 4.99 |3615 3760 |0.36 1.09 1.12|1.0 0 0| 0 0 | 0 2048M| 27 289 0 1 0 May 28 12:48:52 l75lg1-v1 nova-conductor[83648]: DEBUG dbcounter [-] [83648] Writing DB stats nova_cell1:SELECT=1 {{(pid=83648) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:48:53 l75lg1-v1 dstat.sh[49771]: 28-05 12:48:53| 1 0 99 0 0|4549M 4407M 268M 6456M|2154k 39k| 0 36k| 0 4.00 |3749 3777 |0.36 1.09 1.12| 0 0 0| 0 0 | 0 2048M| 27 289 0 1 0 May 28 12:48:53 l75lg1-v1 neutron-server[77623]: DEBUG dbcounter [-] [77623] Writing DB stats neutron:SELECT=1 {{(pid=77623) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:48:53 l75lg1-v1 neutron-server[77623]: DEBUG dbcounter [-] [77623] Writing DB stats neutron:SELECT=2 {{(pid=77623) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:48:53 l75lg1-v1 nova-conductor[83647]: DEBUG dbcounter [-] [83647] Writing DB stats nova_cell1:SELECT=2,nova_cell1:UPDATE=2 {{(pid=83647) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:48:54 l75lg1-v1 dstat.sh[49771]: 28-05 12:48:54| 1 0 98 0 0|4549M 4405M 268M 6458M|2286k 40k| 0 96k| 0 16.0 |2996 3903 |0.36 1.09 1.12| 0 0 0| 0 0 | 0 2048M| 27 289 0 1 0 May 28 12:48:54 l75lg1-v1 devstack@placement-api.service[78201]: DEBUG dbcounter [-] [78201] Writing DB stats placement:SELECT=2 {{(pid=78201) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:48:54 l75lg1-v1 devstack@placement-api.service[78202]: DEBUG dbcounter [-] [78202] Writing DB stats placement:SELECT=2 {{(pid=78202) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:48:55 l75lg1-v1 dstat.sh[49771]: 28-05 12:48:55| 1 0 99 0 0|4550M 4402M 268M 6460M|1764k 27k| 0 80k| 0 9.00 |2501 3058 |0.36 1.09 1.12| 0 0 0| 0 0 | 0 2048M| 27 289 0 1 0 May 28 12:48:55 l75lg1-v1 neutron-server[77623]: DEBUG neutron.db.agents_db [None req-fe40ce8c-640e-4db7-a17a-6e8888cce266 None None] Agent healthcheck: found 0 active agents {{(pid=77623) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:319}} May 28 12:48:56 l75lg1-v1 dstat.sh[49771]: 28-05 12:48:56| 1 0 99 0 0|4549M 4402M 268M 6461M|1518k 24k| 0 344k| 0 68.0 |2820 2916 |0.36 1.09 1.12| 0 0 0| 0 0 | 0 2048M| 27 289 0 1 0 May 28 12:48:57 l75lg1-v1 dstat.sh[49771]: 28-05 12:48:57| 1 0 99 0 0|4549M 4400M 268M 6463M|1375k 26k| 0 4097B| 0 1.00 |3071 3453 |0.33 1.07 1.12| 0 0 0| 0 0 | 0 2048M| 27 289 0 1 0 May 28 12:48:57 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [-] Expecting reply to msg ac32fb93fb30439d872c0b3c1e252ae7 in queue reply_37f4cbd1dd094961a22b8a65f222c327 May 28 12:48:58 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [-] Received RPC response for msg ac32fb93fb30439d872c0b3c1e252ae7 May 28 12:48:58 l75lg1-v1 dstat.sh[49771]: 28-05 12:48:58| 1 0 98 0 0|4550M 4398M 268M 6464M|1351k 23k| 0 108k| 0 18.0 |2786 3547 |0.33 1.07 1.12|1.0 0 2.0| 0 0 | 0 2048M| 27 289 0 1 0 May 28 12:48:59 l75lg1-v1 dstat.sh[49771]: 28-05 12:48:59| 0 0 99 0 0|4549M 4398M 268M 6465M|1127k 22k| 0 296k| 0 37.0 |2766 3135 |0.33 1.07 1.12| 0 0 0| 0 0 | 0 2048M| 27 289 0 1 0 May 28 12:48:59 l75lg1-v1 nova-conductor[83647]: DEBUG dbcounter [-] [83647] Writing DB stats nova_cell1:SELECT=4,nova_cell1:UPDATE=1 {{(pid=83647) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:48:59 l75lg1-v1 nova-conductor[83648]: DEBUG dbcounter [-] [83648] Writing DB stats nova_cell1:SELECT=3 {{(pid=83648) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:49:00 l75lg1-v1 dstat.sh[49771]: 28-05 12:49:00| 1 0 98 0 0|4549M 4396M 268M 6466M|1198k 22k| 0 232k| 0 36.0 |3093 3604 |0.33 1.07 1.12| 0 0 0| 0 0 | 0 2048M| 27 289 0 1 0 May 28 12:49:00 l75lg1-v1 neutron-server[77618]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.HashRingHealthCheckPeriodics.touch_hash_ring_nodes' {{(pid=77618) _process_scheduled /opt/stack/data/venv/lib/python3.10/site-packages/futurist/periodics.py:638}} May 28 12:49:01 l75lg1-v1 dstat.sh[49771]: 28-05 12:49:01| 1 0 98 0 0|4550M 4395M 268M 6467M| 992k 16k| 0 524k| 0 104 |2849 3438 |0.33 1.07 1.12| 0 0 0| 0 0 | 0 2048M| 27 289 0 1 0 May 28 12:49:02 l75lg1-v1 dstat.sh[49771]: 28-05 12:49:02| 1 0 99 0 0|4550M 4395M 268M 6467M| 534k 9478B| 0 0 | 0 0 |1889 2342 |0.30 1.05 1.11|1.0 0 0| 0 0 | 0 2048M| 27 289 0 1 0 May 28 12:49:03 l75lg1-v1 dstat.sh[49771]: 28-05 12:49:03| 0 0 99 0 0|4550M 4394M 268M 6468M| 522k 9595B| 0 96k| 0 19.0 |2066 2699 |0.30 1.05 1.11| 0 0 0| 0 0 | 0 2048M| 27 289 0 1 0 May 28 12:49:04 l75lg1-v1 dstat.sh[49771]: 28-05 12:49:04| 0 0 99 0 0|4550M 4394M 268M 6468M| 419k 7788B| 0 51M| 0 57.0 |1794 2326 |0.30 1.05 1.11| 0 0 0| 0 0 | 0 2048M| 27 289 0 1 0 May 28 12:49:05 l75lg1-v1 dstat.sh[49771]: 28-05 12:49:05| 1 0 98 1 0|4550M 4393M 268M 6469M| 459k 8796B| 0 536k| 0 37.0 |1952 2552 |0.30 1.05 1.11| 0 0 0| 0 0 | 0 2048M| 27 289 0 1 0 May 28 12:49:05 l75lg1-v1 neutron-server[77623]: DEBUG dbcounter [-] [77623] Writing DB stats neutron:SELECT=1 {{(pid=77623) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:49:06 l75lg1-v1 dstat.sh[49771]: 28-05 12:49:06| 1 0 98 0 0|4550M 4393M 268M 6469M| 440k 8045B| 0 232k| 0 46.0 |2046 2552 |0.30 1.05 1.11| 0 0 0| 0 0 | 0 2048M| 27 289 0 1 0 May 28 12:49:07 l75lg1-v1 dstat.sh[49771]: 28-05 12:49:07| 1 0 99 0 0|4550M 4392M 268M 6469M| 408k 7370B| 0 40k| 0 5.00 |1769 2299 |0.28 1.03 1.10| 0 0 0| 0 0 | 0 2048M| 27 289 0 1 0 May 28 12:49:08 l75lg1-v1 dstat.sh[49771]: 28-05 12:49:08| 0 0 99 0 0|4549M 4392M 268M 6470M| 316k 5861B| 0 4091B| 0 1.00 |1613 2247 |0.28 1.03 1.10| 0 0 2.0| 0 0 | 0 2048M| 27 289 0 1 0 May 28 12:49:09 l75lg1-v1 dstat.sh[49771]: 28-05 12:49:09| 1 0 99 0 0|4550M 4392M 268M 6470M| 363k 6609B| 0 8203B| 0 2.00 |1501 2177 |0.28 1.03 1.10| 0 0 0| 0 0 | 0 2048M| 27 289 0 1 0 May 28 12:49:09 l75lg1-v1 nova-conductor[83647]: DEBUG dbcounter [-] [83647] Writing DB stats nova_cell1:SELECT=1,nova_cell1:UPDATE=1 {{(pid=83647) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:49:09 l75lg1-v1 nova-conductor[83648]: DEBUG dbcounter [-] [83648] Writing DB stats nova_cell1:SELECT=2,nova_cell1:UPDATE=1 {{(pid=83648) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:49:10 l75lg1-v1 dstat.sh[49771]: 28-05 12:49:10| 1 0 98 0 0|4550M 4391M 268M 6470M| 365k 7493B| 0 372k| 0 44.9 |1953 2989 |0.28 1.03 1.10|1.0 0 0| 0 0 | 0 2048M| 27 289 0 1 0 May 28 12:49:10 l75lg1-v1 neutron-server[77618]: DEBUG dbcounter [-] [77618] Writing DB stats neutron:UPDATE=1,neutron:SELECT=1 {{(pid=77618) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:49:11 l75lg1-v1 cinder-scheduler[85128]: DEBUG dbcounter [-] [85128] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=85128) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:49:11 l75lg1-v1 dstat.sh[49771]: 28-05 12:49:11| 1 0 99 0 0|4550M 4391M 268M 6471M| 392k 7863B| 0 128k| 0 17.0 |1596 2414 |0.28 1.03 1.10| 0 0 0| 0 0 | 0 2048M| 27 289 0 1 0 May 28 12:49:12 l75lg1-v1 dstat.sh[49771]: 28-05 12:49:12| 1 0 99 0 0|4550M 4391M 268M 6471M| 398k 7920B| 0 336k| 0 64.0 |1663 2539 |0.25 1.02 1.10|1.0 0 0| 0 0 | 0 2048M| 27 289 0 1 0 May 28 12:49:12 l75lg1-v1 cinder-volume[85846]: DEBUG dbcounter [-] [85846] Writing DB stats cinder:SELECT=1 {{(pid=85846) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:49:12 l75lg1-v1 cinder-volume[85846]: DEBUG dbcounter [-] [85846] Writing DB stats cinder:UPDATE=1 {{(pid=85846) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:49:13 l75lg1-v1 dstat.sh[49771]: 28-05 12:49:13| 0 0 99 0 0|4550M 4390M 268M 6471M| 433k 8797B| 0 56k| 0 8.00 |1694 2388 |0.25 1.02 1.10|1.0 0 0| 0 0 | 0 2048M| 27 289 0 1 0 May 28 12:49:14 l75lg1-v1 dstat.sh[49771]: 28-05 12:49:14| 0 0 99 0 0|4550M 4390M 268M 6472M| 508k 9767B| 0 0 | 0 0 |1665 2439 |0.25 1.02 1.10| 0 0 0| 0 0 | 0 2048M| 27 289 0 1 0 May 28 12:49:15 l75lg1-v1 dstat.sh[49771]: 28-05 12:49:15| 1 0 99 0 0|4550M 4389M 268M 6473M| 691k 13k| 0 4096B| 0 1.00 |1816 2639 |0.25 1.02 1.10| 0 0 0| 0 0 | 0 2048M| 27 289 0 1 0 May 28 12:49:15 l75lg1-v1 neutron-server[77623]: DEBUG dbcounter [-] [77623] Writing DB stats neutron:SELECT=1 {{(pid=77623) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:49:16 l75lg1-v1 dstat.sh[49771]: 28-05 12:49:16| 1 0 99 0 0|4550M 4388M 268M 6473M| 960k 14k| 0 72k| 0 4.00 |1929 2491 |0.25 1.02 1.10| 0 0 0| 0 0 | 0 2048M| 27 289 0 1 0 May 28 12:49:17 l75lg1-v1 dstat.sh[49771]: 28-05 12:49:17| 0 0 99 0 0|4550M 4387M 268M 6474M| 773k 13k| 0 4094B| 0 1.00 |1802 2352 |0.23 1.00 1.09| 0 0 0| 0 0 | 0 2048M| 27 289 0 1 0 May 28 12:49:18 l75lg1-v1 dstat.sh[49771]: 28-05 12:49:18| 1 0 99 0 0|4550M 4387M 268M 6475M| 649k 11k| 0 244k| 0 50.0 |1776 2534 |0.23 1.00 1.09| 0 0 2.0| 0 0 | 0 2048M| 27 289 0 1 0 May 28 12:49:19 l75lg1-v1 dstat.sh[49771]: 28-05 12:49:19| 0 0 99 0 0|4550M 4386M 268M 6475M| 606k 11k| 0 0 | 0 0 |1892 2358 |0.23 1.00 1.09| 0 0 0| 0 0 | 0 2048M| 27 289 0 1 0 May 28 12:49:19 l75lg1-v1 nova-conductor[83648]: DEBUG dbcounter [-] [83648] Writing DB stats nova_cell1:SELECT=1 {{(pid=83648) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:49:20 l75lg1-v1 dstat.sh[49771]: 28-05 12:49:20| 0 0 99 0 0|4550M 4386M 268M 6476M| 573k 11k| 0 384k| 0 37.0 |2244 3037 |0.23 1.00 1.09| 0 0 0| 0 0 | 0 2048M| 27 289 0 1 0 May 28 12:49:21 l75lg1-v1 dstat.sh[49771]: 28-05 12:49:21| 0 0 99 0 0|4550M 4385M 268M 6476M| 622k 12k| 0 60k| 0 6.00 |2147 2678 |0.23 1.00 1.09|1.0 0 0| 0 0 | 0 2048M| 27 289 0 1 0 May 28 12:49:22 l75lg1-v1 dstat.sh[49771]: 28-05 12:49:22| 1 0 99 0 0|4550M 4385M 268M 6477M| 588k 10k| 0 0 | 0 0 |1864 2361 |0.21 0.98 1.09| 0 0 0| 0 0 | 0 2048M| 27 289 0 1 0 May 28 12:49:23 l75lg1-v1 dstat.sh[49771]: 28-05 12:49:23| 0 0 99 0 0|4550M 4384M 268M 6477M| 456k 7504B| 0 204k| 0 42.0 |1658 2196 |0.21 0.98 1.09| 0 0 0| 0 0 | 0 2048M| 27 289 0 1 0 May 28 12:49:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "_check_child_processes" by "neutron.agent.linux.external_process.ProcessMonitor._check_child_processes" {{(pid=76818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:49:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_concurrency.lockutils [-] Lock "_check_child_processes" acquired by "neutron.agent.linux.external_process.ProcessMonitor._check_child_processes" :: waited 0.000s {{(pid=76818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:49:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_concurrency.lockutils [-] Lock "_check_child_processes" "released" by "neutron.agent.linux.external_process.ProcessMonitor._check_child_processes" :: held 0.000s {{(pid=76818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:49:24 l75lg1-v1 dstat.sh[49771]: 28-05 12:49:24| 1 0 99 0 0|4561M 4372M 268M 6478M| 319k 5928B| 0 0 | 0 0 |1552 2069 |0.21 0.98 1.09|1.0 0 12| 0 0 | 0 2048M| 27 289 0 1 0 May 28 12:49:25 l75lg1-v1 dstat.sh[49771]: 28-05 12:49:25| 2 1 97 0 0|4545M 4388M 268M 6478M| 326k 6204B| 0 0 | 0 0 |2343 3545 |0.21 0.98 1.09|2.0 0 34| 0 0 | 0 2048M| 27 289 0 2 0 May 28 12:49:25 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_service.periodic_task [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85846) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:49:25 l75lg1-v1 cinder-volume[85846]: DEBUG cinder.volume.drivers.lvm [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] Updating volume stats {{(pid=85846) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}} May 28 12:49:25 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:390}} May 28 12:49:25 l75lg1-v1 sudo[88497]: vastdata : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 May 28 12:49:25 l75lg1-v1 sudo[88497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) May 28 12:49:26 l75lg1-v1 sudo[88497]: pam_unix(sudo:session): session closed for user root May 28 12:49:26 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.468s {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:428}} May 28 12:49:26 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:390}} May 28 12:49:26 l75lg1-v1 sudo[88500]: vastdata : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 May 28 12:49:26 l75lg1-v1 sudo[88500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) May 28 12:49:26 l75lg1-v1 dstat.sh[49771]: 28-05 12:49:26| 5 1 94 0 0|4545M 4388M 268M 6478M| 307k 6128B| 256k 44k|2.00 3.00 |1748 2212 |0.21 0.98 1.09|1.0 0 5.0| 0 0 | 0 2048M| 27 289 0 1 0 May 28 12:49:26 l75lg1-v1 sudo[88500]: pam_unix(sudo:session): session closed for user root May 28 12:49:26 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.462s {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:428}} May 28 12:49:26 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:390}} May 28 12:49:26 l75lg1-v1 sudo[88503]: vastdata : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool May 28 12:49:26 l75lg1-v1 sudo[88503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) May 28 12:49:27 l75lg1-v1 sudo[88503]: pam_unix(sudo:session): session closed for user root May 28 12:49:27 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.482s {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:428}} May 28 12:49:27 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:390}} May 28 12:49:27 l75lg1-v1 sudo[88506]: vastdata : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 May 28 12:49:27 l75lg1-v1 sudo[88506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) May 28 12:49:27 l75lg1-v1 dstat.sh[49771]: 28-05 12:49:27| 8 2 90 0 0|4548M 4384M 268M 6478M| 146k 3618B| 640k 4096B|5.00 1.00 |1943 2379 |0.28 0.98 1.08|1.0 0 6.0| 0 0 | 0 2048M| 27 289 0 1 0 May 28 12:49:27 l75lg1-v1 sudo[88506]: pam_unix(sudo:session): session closed for user root May 28 12:49:27 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.449s {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:428}} May 28 12:49:27 l75lg1-v1 cinder-volume[85846]: DEBUG cinder.manager [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] Notifying Schedulers of capabilities ... {{(pid=85846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 28 12:49:27 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.scheduler.host_manager [None req-411a7b98-003d-4340-b28d-4097f31f6fa6 None None] Received volume service update from l75lg1-v1@lvmdriver-1: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:l75lg1-v1:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up', 'allocated_capacity_gb': 0, 'cacheable': True}], 'shared_targets': False, 'sparse_copy_volume': True, 'filter_function': None, 'goodness_function': None} {{(pid=85128) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:628}} May 28 12:49:28 l75lg1-v1 dstat.sh[49771]: 28-05 12:49:28| 3 1 96 0 0|4540M 4393M 268M 6479M| 99k 2130B| 256k 0 |2.00 0 |1743 2380 |0.28 0.98 1.08|2.0 0 9.0| 0 0 | 0 2048M| 27 289 0 1 0 May 28 12:49:29 l75lg1-v1 dstat.sh[49771]: 28-05 12:49:29| 1 0 99 0 0|4540M 4393M 268M 6479M| 122k 2614B| 0 528k| 0 100 |1417 2125 |0.28 0.98 1.08| 0 0 0| 0 0 | 0 2048M| 27 289 0 1 0 May 28 12:49:29 l75lg1-v1 nova-conductor[83647]: DEBUG dbcounter [-] [83647] Writing DB stats nova_cell1:SELECT=2,nova_cell1:UPDATE=2 {{(pid=83647) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:49:29 l75lg1-v1 nova-conductor[83648]: DEBUG dbcounter [-] [83648] Writing DB stats nova_cell1:SELECT=1 {{(pid=83648) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:49:30 l75lg1-v1 dstat.sh[49771]: 28-05 12:49:30| 0 0 99 0 0|4540M 4393M 268M 6479M| 122k 2508B| 0 428k| 0 62.0 |1810 2750 |0.28 0.98 1.08| 0 0 0| 0 0 | 0 2048M| 27 289 0 1 0 May 28 12:49:30 l75lg1-v1 neutron-server[77618]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.HashRingHealthCheckPeriodics.touch_hash_ring_nodes' {{(pid=77618) _process_scheduled /opt/stack/data/venv/lib/python3.10/site-packages/futurist/periodics.py:638}} May 28 12:49:30 l75lg1-v1 neutron-server[77623]: DEBUG dbcounter [-] [77623] Writing DB stats neutron:SELECT=2 {{(pid=77623) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:49:31 l75lg1-v1 dstat.sh[49771]: 28-05 12:49:31| 1 0 99 0 0|4540M 4393M 268M 6479M| 136k 2376B| 0 112k| 0 20.0 |1727 2549 |0.28 0.98 1.08| 0 0 0| 0 0 | 0 2048M| 27 289 0 1 0 May 28 12:49:32 l75lg1-v1 dstat.sh[49771]: 28-05 12:49:32| 0 0 99 0 0|4539M 4393M 268M 6479M| 112k 2022B| 0 0 | 0 0 |1231 1916 |0.25 0.97 1.08|1.0 0 0| 0 0 | 0 2048M| 27 289 0 1 0 May 28 12:49:32 l75lg1-v1 neutron-server[77623]: DEBUG neutron.db.agents_db [None req-fe40ce8c-640e-4db7-a17a-6e8888cce266 None None] Agent healthcheck: found 0 active agents {{(pid=77623) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:319}} May 28 12:49:33 l75lg1-v1 dstat.sh[49771]: 28-05 12:49:33| 0 0 99 0 0|4539M 4393M 268M 6479M| 145k 2377B| 0 180k| 0 14.0 |1471 2141 |0.25 0.97 1.08|1.0 0 0| 0 0 | 0 2048M| 27 289 0 1 0 May 28 12:49:34 l75lg1-v1 dstat.sh[49771]: 28-05 12:49:34| 0 0 99 0 0|4539M 4393M 268M 6479M| 125k 2127B| 0 323k| 0 64.9 |1356 2031 |0.25 0.97 1.08| 0 0 0| 0 0 | 0 2048M| 27 289 0 1 0 May 28 12:49:35 l75lg1-v1 dstat.sh[49771]: 28-05 12:49:35| 1 0 99 0 0|4539M 4393M 268M 6479M| 135k 2445B| 0 11M| 0 21.0 |1421 2151 |0.25 0.97 1.08| 0 0 0| 0 0 | 0 2048M| 27 289 0 1 0 May 28 12:49:36 l75lg1-v1 dstat.sh[49771]: 28-05 12:49:36| 0 0 99 0 0|4539M 4393M 268M 6479M| 145k 2947B| 0 0 | 0 0 |1354 2105 |0.25 0.97 1.08| 0 0 0| 0 0 | 0 2048M| 27 289 0 1 0 May 28 12:49:37 l75lg1-v1 dstat.sh[49771]: 28-05 12:49:37| 1 0 99 0 0|4539M 4392M 268M 6480M| 150k 2870B| 0 0 | 0 0 |1358 2033 |0.23 0.95 1.07|1.0 0 0| 0 0 | 0 2048M| 27 289 0 1 0 May 28 12:49:37 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:49:37 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.manager [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Cleaning up deleted instances {{(pid=83654) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11226}} May 28 12:49:37 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Expecting reply to msg a97661f1613b4cd3abb8e115fa84f62b in queue reply_37f4cbd1dd094961a22b8a65f222c327 May 28 12:49:37 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [-] Received RPC response for msg a97661f1613b4cd3abb8e115fa84f62b May 28 12:49:38 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.manager [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] There are 0 instances to clean {{(pid=83654) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11235}} May 28 12:49:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:49:38 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.manager [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Cleaning up deleted instances with incomplete migration {{(pid=83654) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11264}} May 28 12:49:38 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Expecting reply to msg c671d531ac454cb98d9479a08be773e4 in queue reply_37f4cbd1dd094961a22b8a65f222c327 May 28 12:49:38 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [-] Received RPC response for msg c671d531ac454cb98d9479a08be773e4 May 28 12:49:38 l75lg1-v1 dstat.sh[49771]: 28-05 12:49:38| 1 0 98 0 0|4540M 4392M 268M 6480M| 150k 2901B| 0 0 | 0 0 |1741 2380 |0.23 0.95 1.07| 0 0 2.0| 0 0 | 0 2048M| 27 289 0 1 0 May 28 12:49:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:49:38 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Expecting reply to msg 6290bf074b8e4cd8abadeb7d6452afe2 in queue reply_37f4cbd1dd094961a22b8a65f222c327 May 28 12:49:38 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [-] Received RPC response for msg 6290bf074b8e4cd8abadeb7d6452afe2 May 28 12:49:39 l75lg1-v1 dstat.sh[49771]: 28-05 12:49:39| 1 0 99 0 0|4540M 4391M 268M 6480M| 167k 3366B| 0 88k| 0 5.00 |1686 2403 |0.23 0.95 1.07| 0 0 0| 0 0 | 0 2048M| 27 289 0 1 0 May 28 12:49:39 l75lg1-v1 nova-conductor[83647]: DEBUG dbcounter [-] [83647] Writing DB stats nova_cell1:SELECT=1,nova_cell1:UPDATE=1 {{(pid=83647) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:49:39 l75lg1-v1 nova-conductor[83648]: DEBUG dbcounter [-] [83648] Writing DB stats nova_cell1:SELECT=1 {{(pid=83648) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:49:40 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:49:40 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:49:40 l75lg1-v1 dstat.sh[49771]: 28-05 12:49:40| 1 0 98 0 0|4540M 4391M 268M 6480M| 182k 3501B| 0 424k| 0 80.1 |1934 2817 |0.23 0.95 1.07| 0 0 0| 0 0 | 0 2048M| 27 289 0 1 0 May 28 12:49:40 l75lg1-v1 neutron-server[77618]: DEBUG dbcounter [-] [77618] Writing DB stats neutron:UPDATE=1 {{(pid=77618) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:49:40 l75lg1-v1 neutron-server[77618]: DEBUG dbcounter [-] [77618] Writing DB stats neutron:SELECT=1 {{(pid=77618) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:49:41 l75lg1-v1 dstat.sh[49771]: 28-05 12:49:41| 1 0 99 0 0|4540M 4391M 268M 6480M| 214k 3603B| 0 72k| 0 8.99 |1681 2366 |0.23 0.95 1.07|1.0 0 0| 0 0 | 0 2048M| 27 289 0 1 0 May 28 12:49:41 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:49:41 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.manager [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Starting heal instance info cache {{(pid=83654) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}} May 28 12:49:41 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.manager [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Rebuilding the list of instances to heal {{(pid=83654) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9930}} May 28 12:49:41 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Expecting reply to msg 9fa9cc0a3db64edbad40dccf7f73225a in queue reply_37f4cbd1dd094961a22b8a65f222c327 May 28 12:49:41 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [-] Received RPC response for msg 9fa9cc0a3db64edbad40dccf7f73225a May 28 12:49:42 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.manager [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Didn't find any instances for network info cache update. {{(pid=83654) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10012}} May 28 12:49:42 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:49:42 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:49:42 l75lg1-v1 dstat.sh[49771]: 28-05 12:49:42| 1 0 98 0 0|4539M 4391M 268M 6480M| 216k 3922B| 0 188k| 0 13.0 |1714 2496 |0.22 0.93 1.07|1.0 0 0| 0 0 | 0 2048M| 27 289 0 1 0 May 28 12:49:42 l75lg1-v1 neutron-server[77623]: DEBUG dbcounter [-] [77623] Writing DB stats neutron:SELECT=2,neutron:DELETE=1 {{(pid=77623) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:49:42 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:49:42 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:49:42 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.manager [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=83654) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10545}} May 28 12:49:43 l75lg1-v1 dstat.sh[49771]: 28-05 12:49:43| 1 0 99 0 0|4539M 4391M 268M 6480M| 188k 3994B| 0 80k| 0 13.0 |1505 2255 |0.22 0.93 1.07|2.0 0 0| 0 0 | 0 2048M| 27 289 0 1 0 May 28 12:49:43 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager.update_available_resource {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:49:43 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Expecting reply to msg 588d945222b64da38845c33bb5d2bcce in queue reply_37f4cbd1dd094961a22b8a65f222c327 May 28 12:49:43 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [-] Received RPC response for msg 588d945222b64da38845c33bb5d2bcce May 28 12:49:44 l75lg1-v1 nova-compute[83654]: DEBUG oslo_concurrency.lockutils [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=83654) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:49:44 l75lg1-v1 nova-compute[83654]: DEBUG oslo_concurrency.lockutils [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=83654) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:49:44 l75lg1-v1 nova-compute[83654]: DEBUG oslo_concurrency.lockutils [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=83654) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:49:44 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.resource_tracker [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Auditing locally available compute resources for l75lg1-v1 (node: l75lg1-v1) {{(pid=83654) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}} May 28 12:49:44 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.resource_tracker [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Hypervisor/Node resource view: name=l75lg1-v1 free_ram=11140MB free_disk=16.966346740722656GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_01_1", "address": "0000:00:01.1", "product_id": "7010", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7010", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7000", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7000", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "0100", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_0100", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_09_0", "address": "0000:00:09.0", "product_id": "1001", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1001", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "293a", "vendor_id": "8086", "numa_node": null, "label": "label_8086_293a", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_2", "address": "0000:00:07.2", "product_id": "2936", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2936", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "1237", "vendor_id": "8086", "numa_node": null, "label": "label_8086_1237", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "2935", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2935", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "2934", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2934", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_05_0", "address": "0000:00:05.0", "product_id": "1000", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1000", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "1000", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1000", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_06_0", "address": "0000:00:06.0", "product_id": "2668", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2668", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "1000", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1000", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0a_0", "address": "0000:00:0a.0", "product_id": "1002", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1002", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_3", "address": "0000:00:01.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_08_0", "address": "0000:00:08.0", "product_id": "1003", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1003", "dev_type": "type-PCI"}] {{(pid=83654) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}} May 28 12:49:44 l75lg1-v1 nova-compute[83654]: DEBUG oslo_concurrency.lockutils [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=83654) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:49:44 l75lg1-v1 nova-compute[83654]: DEBUG oslo_concurrency.lockutils [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=83654) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:49:44 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Expecting reply to msg b8cd4d795a41478bb81e130800b74432 in queue reply_37f4cbd1dd094961a22b8a65f222c327 May 28 12:49:44 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [-] Received RPC response for msg b8cd4d795a41478bb81e130800b74432 May 28 12:49:44 l75lg1-v1 dstat.sh[49771]: 28-05 12:49:44| 2 1 98 0 0|4539M 4391M 268M 6481M| 239k 4554B| 0 0 | 0 0 |2595 4451 |0.22 0.93 1.07| 0 0 0| 0 0 | 0 2048M| 27 289 0 1 0 May 28 12:49:44 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Expecting reply to msg 528a7d61200c477496659b4803b20e6f in queue reply_37f4cbd1dd094961a22b8a65f222c327 May 28 12:49:44 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [-] Received RPC response for msg 528a7d61200c477496659b4803b20e6f May 28 12:49:45 l75lg1-v1 devstack@placement-api.service[78201]: DEBUG placement.requestlog [req-e3728354-4414-4cca-9ab5-90c0ec75a238 req-6dd9bda6-ee93-44c7-9e2b-3e707a4a736f None None] Starting request: 10.27.203.238 "GET /placement/resource_providers/ef90d7d1-0808-4a15-ad77-f9a7391af2f4/allocations" {{(pid=78201) __call__ /opt/stack/placement/placement/requestlog.py:55}} May 28 12:49:45 l75lg1-v1 devstack@placement-api.service[78201]: INFO placement.requestlog [req-e3728354-4414-4cca-9ab5-90c0ec75a238 req-6dd9bda6-ee93-44c7-9e2b-3e707a4a736f service placement] 10.27.203.238 "GET /placement/resource_providers/ef90d7d1-0808-4a15-ad77-f9a7391af2f4/allocations" status: 200 len: 54 microversion: 1.0 May 28 12:49:45 l75lg1-v1 devstack@placement-api.service[78201]: [pid: 78201|app: 0|req: 10/20] 10.27.203.238 () {62 vars in 1480 bytes} [Tue May 28 12:49:45 2024] GET /placement/resource_providers/ef90d7d1-0808-4a15-ad77-f9a7391af2f4/allocations => generated 54 bytes in 11 msecs (HTTP/1.1 200) 6 headers in 223 bytes (1 switches on core 0) May 28 12:49:45 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.resource_tracker [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Total usable vcpus: 10, total allocated vcpus: 0 {{(pid=83654) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}} May 28 12:49:45 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.resource_tracker [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Final resource view: name=l75lg1-v1 phys_ram=16000MB used_ram=512MB phys_disk=28GB used_disk=0GB total_vcpus=10 used_vcpus=0 pci_stats=[] {{(pid=83654) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}} May 28 12:49:45 l75lg1-v1 devstack@placement-api.service[78202]: DEBUG placement.requestlog [req-e3728354-4414-4cca-9ab5-90c0ec75a238 req-998103da-1ea7-474b-980b-906a6a841aea None None] Starting request: 10.27.203.238 "GET /placement/resource_providers/ef90d7d1-0808-4a15-ad77-f9a7391af2f4/allocations" {{(pid=78202) __call__ /opt/stack/placement/placement/requestlog.py:55}} May 28 12:49:45 l75lg1-v1 devstack@placement-api.service[78202]: INFO placement.requestlog [req-e3728354-4414-4cca-9ab5-90c0ec75a238 req-998103da-1ea7-474b-980b-906a6a841aea service placement] 10.27.203.238 "GET /placement/resource_providers/ef90d7d1-0808-4a15-ad77-f9a7391af2f4/allocations" status: 200 len: 54 microversion: 1.0 May 28 12:49:45 l75lg1-v1 devstack@placement-api.service[78202]: [pid: 78202|app: 0|req: 11/21] 10.27.203.238 () {62 vars in 1480 bytes} [Tue May 28 12:49:45 2024] GET /placement/resource_providers/ef90d7d1-0808-4a15-ad77-f9a7391af2f4/allocations => generated 54 bytes in 17 msecs (HTTP/1.1 200) 6 headers in 223 bytes (1 switches on core 0) May 28 12:49:45 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.provider_tree [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Inventory has not changed in ProviderTree for provider: ef90d7d1-0808-4a15-ad77-f9a7391af2f4 {{(pid=83654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} May 28 12:49:45 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Expecting reply to msg 647a2100a6fb4183a76f88857c202572 in queue reply_37f4cbd1dd094961a22b8a65f222c327 May 28 12:49:45 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [-] Received RPC response for msg 647a2100a6fb4183a76f88857c202572 May 28 12:49:45 l75lg1-v1 dstat.sh[49771]: 28-05 12:49:45| 1 0 98 0 0|4538M 4391M 268M 6481M| 204k 4608B| 0 428k| 0 83.0 |1802 2630 |0.22 0.93 1.07|2.0 0 0| 0 0 | 0 2048M| 27 289 0 3 0 May 28 12:49:45 l75lg1-v1 nova-compute[83654]: DEBUG nova.scheduler.client.report [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Inventory has not changed for provider ef90d7d1-0808-4a15-ad77-f9a7391af2f4 based on inventory data: {'MEMORY_MB': {'total': 16000, 'reserved': 512, 'min_unit': 1, 'max_unit': 16000, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 10, 'reserved': 0, 'min_unit': 1, 'max_unit': 10, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 28, 'reserved': 0, 'min_unit': 1, 'max_unit': 28, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=83654) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}} May 28 12:49:45 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.resource_tracker [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Compute_service record updated for l75lg1-v1:l75lg1-v1 {{(pid=83654) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}} May 28 12:49:45 l75lg1-v1 nova-compute[83654]: DEBUG oslo_concurrency.lockutils [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.559s {{(pid=83654) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:49:46 l75lg1-v1 dstat.sh[49771]: 28-05 12:49:46| 1 0 99 0 0|4539M 4391M 268M 6481M| 202k 3827B| 0 0 | 0 0 |1525 2173 |0.22 0.93 1.07| 0 0 0| 0 0 | 0 2048M| 27 289 0 3 0 May 28 12:49:47 l75lg1-v1 dstat.sh[49771]: 28-05 12:49:47| 1 0 99 0 0|4538M 4391M 268M 6481M| 123k 2705B| 0 20k| 0 1.00 |1364 2048 |0.20 0.92 1.06| 0 0 0| 0 0 | 0 2048M| 27 289 0 3 0 May 28 12:49:47 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:49:48 l75lg1-v1 dstat.sh[49771]: 28-05 12:49:48| 0 0 99 0 0|4539M 4390M 268M 6482M| 131k 2508B| 0 52k| 0 3.00 |1384 2172 |0.20 0.92 1.06| 0 0 2.0| 0 0 | 0 2048M| 27 289 0 3 0 May 28 12:49:49 l75lg1-v1 dstat.sh[49771]: 28-05 12:49:49| 1 0 99 0 0|4539M 4390M 268M 6482M| 152k 2884B| 0 0 | 0 0 |1355 2090 |0.20 0.92 1.06|1.0 0 0| 0 0 | 0 2048M| 27 289 0 3 0 May 28 12:49:50 l75lg1-v1 dstat.sh[49771]: 28-05 12:49:50| 0 0 99 0 0|4539M 4390M 268M 6482M| 170k 2967B| 0 623k| 0 91.9 |1765 2794 |0.20 0.92 1.06| 0 0 0| 0 0 | 0 2048M| 27 289 0 3 0 May 28 12:49:51 l75lg1-v1 dstat.sh[49771]: 28-05 12:49:51| 1 0 99 0 0|4539M 4390M 268M 6482M| 215k 3897B| 0 48k| 0 7.01 |1430 2171 |0.20 0.92 1.06|1.0 0 0| 0 0 | 0 2048M| 27 289 0 3 0 May 28 12:49:52 l75lg1-v1 dstat.sh[49771]: 28-05 12:49:52| 0 0 99 0 0|4540M 4389M 268M 6482M| 222k 4154B| 0 0 | 0 0 |1290 1998 |0.18 0.90 1.06| 0 0 0| 0 0 | 0 2048M| 27 289 0 3 0 May 28 12:49:53 l75lg1-v1 dstat.sh[49771]: 28-05 12:49:53| 1 0 99 0 0|4540M 4389M 268M 6483M| 365k 7103B| 0 12k| 0 2.00 |1489 2215 |0.18 0.90 1.06|1.0 0 0| 0 0 | 0 2048M| 27 289 0 3 0 May 28 12:49:54 l75lg1-v1 dstat.sh[49771]: 28-05 12:49:54| 1 0 99 0 0|4540M 4388M 268M 6483M| 572k 9813B| 0 0 | 0 0 |1571 2253 |0.18 0.90 1.06| 0 0 0| 0 0 | 0 2048M| 27 289 0 3 0 May 28 12:49:55 l75lg1-v1 devstack@placement-api.service[78201]: DEBUG dbcounter [-] [78201] Writing DB stats placement:SELECT=2 {{(pid=78201) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:49:55 l75lg1-v1 devstack@placement-api.service[78202]: DEBUG dbcounter [-] [78202] Writing DB stats placement:SELECT=2 {{(pid=78202) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:49:55 l75lg1-v1 nova-conductor[83648]: DEBUG dbcounter [-] [83648] Writing DB stats nova_cell1:SELECT=1 {{(pid=83648) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:49:55 l75lg1-v1 dstat.sh[49771]: 28-05 12:49:55| 0 0 99 0 0|4540M 4387M 268M 6484M| 909k 14k| 0 4500k| 0 38.0 |1827 2564 |0.18 0.90 1.06| 0 0 0| 0 0 | 0 2048M| 27 289 0 3 0 May 28 12:49:56 l75lg1-v1 dstat.sh[49771]: 28-05 12:49:56| 0 0 99 0 0|4540M 4386M 268M 6485M|1305k 20k| 0 260k| 0 51.0 |2140 2821 |0.18 0.90 1.06| 0 0 0| 0 0 | 0 2048M| 27 289 0 3 0 May 28 12:49:57 l75lg1-v1 dstat.sh[49771]: 28-05 12:49:57| 0 0 99 0 0|4540M 4385M 268M 6487M|1834k 29k| 0 4096B| 0 1.00 |2399 3250 |0.17 0.89 1.05| 0 0 0| 0 0 | 0 2048M| 27 289 0 3 0 May 28 12:49:58 l75lg1-v1 dstat.sh[49771]: 28-05 12:49:58| 1 0 99 0 0|4540M 4382M 268M 6489M|1891k 25k| 0 0 | 0 0 |2345 2984 |0.17 0.89 1.05| 0 0 2.0| 0 0 | 0 2048M| 27 289 0 3 0 May 28 12:49:59 l75lg1-v1 dstat.sh[49771]: 28-05 12:49:59| 0 0 99 0 0|4540M 4381M 268M 6490M|1591k 22k| 0 4096B| 0 1.00 |2162 2724 |0.17 0.89 1.05| 0 0 0| 0 0 | 0 2048M| 27 289 0 3 0 May 28 12:49:59 l75lg1-v1 nova-conductor[83647]: DEBUG dbcounter [-] [83647] Writing DB stats nova_cell1:SELECT=1 {{(pid=83647) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:49:59 l75lg1-v1 nova-conductor[83647]: DEBUG dbcounter [-] [83647] Writing DB stats nova_cell1:SELECT=4,nova_cell1:DELETE=1,nova_cell1:UPDATE=2 {{(pid=83647) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:49:59 l75lg1-v1 nova-conductor[83648]: DEBUG dbcounter [-] [83648] Writing DB stats nova_cell1:SELECT=5 {{(pid=83648) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:50:00 l75lg1-v1 dstat.sh[49771]: 28-05 12:50:00| 1 0 98 1 0|4540M 4380M 268M 6491M|1399k 20k| 0 1520k| 0 112 |2747 3662 |0.17 0.89 1.05|1.0 0 0| 0 0 | 0 2048M| 27 289 0 3 0 May 28 12:50:00 l75lg1-v1 neutron-server[77618]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.HashRingHealthCheckPeriodics.touch_hash_ring_nodes' {{(pid=77618) _process_scheduled /opt/stack/data/venv/lib/python3.10/site-packages/futurist/periodics.py:638}} May 28 12:50:01 l75lg1-v1 dstat.sh[49771]: 28-05 12:50:01| 1 0 99 0 0|4540M 4378M 268M 6492M| 815k 12k| 0 448k| 0 79.0 |2189 2898 |0.17 0.89 1.05| 0 0 0| 0 0 | 0 2048M| 27 289 0 3 0 May 28 12:50:02 l75lg1-v1 dstat.sh[49771]: 28-05 12:50:02| 0 0 99 0 0|4540M 4378M 268M 6493M| 611k 11k| 0 160k| 0 32.0 |1720 2429 |0.15 0.87 1.04|1.0 0 2.0| 0 0 | 0 2048M| 27 289 0 3 0 May 28 12:50:03 l75lg1-v1 dstat.sh[49771]: 28-05 12:50:03| 1 0 99 0 0|4540M 4377M 268M 6493M| 578k 10k| 0 156k| 0 15.0 |1766 2298 |0.15 0.87 1.04| 0 0 0| 0 0 | 0 2048M| 27 289 0 3 0 May 28 12:50:04 l75lg1-v1 dstat.sh[49771]: 28-05 12:50:04| 0 0 99 0 0|4540M 4377M 268M 6494M| 497k 9122B| 0 36k| 0 5.00 |1680 2293 |0.15 0.87 1.04| 0 0 0| 0 0 | 0 2048M| 27 289 0 3 0 May 28 12:50:05 l75lg1-v1 dstat.sh[49771]: 28-05 12:50:05| 1 0 99 0 0|4541M 4376M 268M 6494M| 383k 7651B| 0 8193B| 0 1.00 |1625 2332 |0.15 0.87 1.04| 0 0 0| 0 0 | 0 2048M| 27 289 0 3 0 May 28 12:50:06 l75lg1-v1 dstat.sh[49771]: 28-05 12:50:06| 0 0 99 0 0|4540M 4376M 268M 6494M| 348k 7274B| 0 0 | 0 0 |1730 2218 |0.15 0.87 1.04| 0 0 0| 0 0 | 0 2048M| 27 289 0 3 0 May 28 12:50:07 l75lg1-v1 dstat.sh[49771]: 28-05 12:50:07| 0 0 99 0 0|4540M 4376M 268M 6495M| 355k 7101B| 0 136k| 0 27.0 |1698 2282 |0.14 0.86 1.04| 0 0 0| 0 0 | 0 2048M| 27 289 0 3 0 May 28 12:50:07 l75lg1-v1 neutron-server[77623]: DEBUG dbcounter [-] [77623] Writing DB stats neutron:SELECT=1 {{(pid=77623) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:50:07 l75lg1-v1 neutron-server[77623]: DEBUG dbcounter [-] [77623] Writing DB stats neutron:SELECT=2 {{(pid=77623) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:50:08 l75lg1-v1 dstat.sh[49771]: 28-05 12:50:08| 1 0 98 0 0|4540M 4375M 268M 6495M| 372k 7198B| 0 76k| 0 8.00 |1708 2422 |0.14 0.86 1.04| 0 0 2.0| 0 0 | 0 2048M| 27 289 0 3 0 May 28 12:50:09 l75lg1-v1 dstat.sh[49771]: 28-05 12:50:09| 1 0 99 0 0|4540M 4375M 268M 6495M| 388k 7830B| 0 4097B| 0 1.00 |1654 2329 |0.14 0.86 1.04| 0 0 0| 0 0 | 0 2048M| 27 289 0 3 0 May 28 12:50:09 l75lg1-v1 neutron-server[77623]: DEBUG neutron.db.agents_db [None req-fe40ce8c-640e-4db7-a17a-6e8888cce266 None None] Agent healthcheck: found 0 active agents {{(pid=77623) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:319}} May 28 12:50:09 l75lg1-v1 nova-conductor[83648]: DEBUG dbcounter [-] [83648] Writing DB stats nova_cell1:SELECT=1 {{(pid=83648) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:50:10 l75lg1-v1 dstat.sh[49771]: 28-05 12:50:10| 0 0 98 0 0|4540M 4375M 268M 6496M| 378k 7434B| 0 332k| 0 33.0 |1864 2804 |0.14 0.86 1.04|1.0 0 0| 0 0 | 0 2048M| 27 289 0 3 0 May 28 12:50:10 l75lg1-v1 neutron-server[77618]: DEBUG dbcounter [-] [77618] Writing DB stats neutron:UPDATE=1 {{(pid=77618) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:50:10 l75lg1-v1 neutron-server[77618]: DEBUG dbcounter [-] [77618] Writing DB stats neutron:SELECT=1 {{(pid=77618) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:50:11 l75lg1-v1 dstat.sh[49771]: 28-05 12:50:11| 1 0 98 1 0|4540M 4374M 268M 6496M| 462k 9020B| 0 12M| 0 51.0 |1802 2533 |0.14 0.86 1.04| 0 0 0| 0 0 | 0 2048M| 27 289 0 3 0 May 28 12:50:12 l75lg1-v1 dstat.sh[49771]: 28-05 12:50:12| 1 0 99 0 0|4540M 4374M 268M 6497M| 528k 9865B| 0 287k| 0 61.8 |1715 2616 |0.13 0.84 1.03|1.0 0 0| 0 0 | 0 2048M| 27 289 0 3 0 May 28 12:50:13 l75lg1-v1 dstat.sh[49771]: 28-05 12:50:13| 1 1 99 0 0|4540M 4373M 268M 6497M| 673k 12k| 0 4109B| 0 1.00 |1835 2540 |0.13 0.84 1.03| 0 0 0| 0 0 | 0 2048M| 27 289 0 3 0 May 28 12:50:14 l75lg1-v1 dstat.sh[49771]: 28-05 12:50:14| 1 0 99 0 0|4540M 4372M 268M 6498M| 988k 17k| 0 0 | 0 0 |1997 2660 |0.13 0.84 1.03|1.0 0 0| 0 0 | 0 2048M| 27 289 0 3 0 May 28 12:50:15 l75lg1-v1 dstat.sh[49771]: 28-05 12:50:15| 1 0 99 0 0|4540M 4371M 268M 6499M|1274k 21k| 0 164k| 0 2.00 |2151 2885 |0.13 0.84 1.03| 0 0 0| 0 0 | 0 2048M| 27 289 0 3 0 May 28 12:50:16 l75lg1-v1 dstat.sh[49771]: 28-05 12:50:16| 1 0 99 0 0|4540M 4369M 268M 6501M|1847k 30k| 0 64k| 0 3.00 |2471 3109 |0.13 0.84 1.03|1.0 0 0| 0 0 | 0 2048M| 27 289 0 3 0 May 28 12:50:17 l75lg1-v1 dstat.sh[49771]: 28-05 12:50:17| 0 1 99 0 0|4540M 4367M 268M 6503M|2571k 40k| 0 4096B| 0 1.00 |2723 3411 |0.12 0.83 1.03| 0 0 0| 0 0 | 0 2048M| 27 289 0 3 0 May 28 12:50:18 l75lg1-v1 dstat.sh[49771]: 28-05 12:50:18| 1 0 99 0 0|4542M 4363M 268M 6506M|2423k 30k| 0 136k| 0 29.0 |2580 3012 |0.12 0.83 1.03| 0 0 2.0| 0 0 | 0 2048M| 27 289 0 3 0 May 28 12:50:19 l75lg1-v1 dstat.sh[49771]: 28-05 12:50:19| 1 0 99 0 0|4542M 4360M 268M 6508M|2622k 41k| 0 0 | 0 0 |2776 3553 |0.12 0.83 1.03| 0 0 0| 0 0 | 0 2048M| 27 289 0 3 0 May 28 12:50:19 l75lg1-v1 neutron-server[77623]: DEBUG dbcounter [-] [77623] Writing DB stats neutron:SELECT=1 {{(pid=77623) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:50:19 l75lg1-v1 nova-conductor[83647]: DEBUG dbcounter [-] [83647] Writing DB stats nova_cell1:SELECT=1 {{(pid=83647) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:50:19 l75lg1-v1 nova-conductor[83648]: DEBUG dbcounter [-] [83648] Writing DB stats nova_cell1:SELECT=1 {{(pid=83648) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:50:20 l75lg1-v1 dstat.sh[49771]: 28-05 12:50:20| 1 1 98 1 0|4541M 4359M 268M 6511M|2776k 45k| 0 360k| 0 41.0 |3311 4309 |0.12 0.83 1.03| 0 0 0| 0 0 | 0 2048M| 27 289 0 3 0 May 28 12:50:21 l75lg1-v1 dstat.sh[49771]: 28-05 12:50:21| 0 0 98 0 0|4541M 4355M 268M 6514M|3014k 49k| 0 96k| 0 7.00 |3179 3927 |0.12 0.83 1.03| 0 0 0| 0 0 | 0 2048M| 27 289 0 3 0 May 28 12:50:22 l75lg1-v1 dstat.sh[49771]: 28-05 12:50:22| 0 0 99 0 0|4541M 4352M 268M 6517M|3156k 53k| 0 0 | 0 0 |3226 4163 |0.19 0.83 1.03| 0 0 0| 0 0 | 0 2048M| 27 289 0 3 0 May 28 12:50:23 l75lg1-v1 dstat.sh[49771]: 28-05 12:50:23| 1 0 98 0 0|4541M 4350M 268M 6519M|2987k 52k| 0 272k| 0 56.0 |3322 4048 |0.19 0.83 1.03| 0 0 0| 0 0 | 0 2048M| 27 289 0 3 0 May 28 12:50:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "_check_child_processes" by "neutron.agent.linux.external_process.ProcessMonitor._check_child_processes" {{(pid=76818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:50:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_concurrency.lockutils [-] Lock "_check_child_processes" acquired by "neutron.agent.linux.external_process.ProcessMonitor._check_child_processes" :: waited 0.000s {{(pid=76818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:50:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_concurrency.lockutils [-] Lock "_check_child_processes" "released" by "neutron.agent.linux.external_process.ProcessMonitor._check_child_processes" :: held 0.000s {{(pid=76818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:50:24 l75lg1-v1 dstat.sh[49771]: 28-05 12:50:24| 1 1 99 0 0|4541M 4347M 268M 6522M|3217k 54k| 0 0 | 0 0 |3320 4054 |0.19 0.83 1.03|1.0 0 0| 0 0 | 0 2048M| 27 289 0 3 0 May 28 12:50:25 l75lg1-v1 dstat.sh[49771]: 28-05 12:50:25| 3 1 96 0 0|4535M 4349M 268M 6525M|3137k 54k| 0 0 | 0 0 |4576 6561 |0.19 0.83 1.03| 0 0 46| 0 0 | 0 2048M| 27 289 0 3 0 May 28 12:50:25 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_service.periodic_task [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85846) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:50:25 l75lg1-v1 cinder-volume[85846]: DEBUG cinder.volume.drivers.lvm [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] Updating volume stats {{(pid=85846) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}} May 28 12:50:25 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:390}} May 28 12:50:25 l75lg1-v1 sudo[88575]: vastdata : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 May 28 12:50:25 l75lg1-v1 sudo[88575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) May 28 12:50:26 l75lg1-v1 sudo[88575]: pam_unix(sudo:session): session closed for user root May 28 12:50:26 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.467s {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:428}} May 28 12:50:26 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:390}} May 28 12:50:26 l75lg1-v1 sudo[88578]: vastdata : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 May 28 12:50:26 l75lg1-v1 sudo[88578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) May 28 12:50:26 l75lg1-v1 dstat.sh[49771]: 28-05 12:50:26| 5 1 93 0 0|4543M 4338M 268M 6528M|3124k 55k| 256k 56k|2.00 3.00 |3706 4568 |0.19 0.83 1.03|2.0 0 5.0| 0 0 | 0 2048M| 27 289 0 3 0 May 28 12:50:26 l75lg1-v1 sudo[88578]: pam_unix(sudo:session): session closed for user root May 28 12:50:26 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.469s {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:428}} May 28 12:50:26 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:390}} May 28 12:50:26 l75lg1-v1 sudo[88581]: vastdata : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool May 28 12:50:26 l75lg1-v1 sudo[88581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) May 28 12:50:27 l75lg1-v1 sudo[88581]: pam_unix(sudo:session): session closed for user root May 28 12:50:27 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.472s {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:428}} May 28 12:50:27 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:390}} May 28 12:50:27 l75lg1-v1 sudo[88584]: vastdata : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 May 28 12:50:27 l75lg1-v1 sudo[88584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) May 28 12:50:27 l75lg1-v1 dstat.sh[49771]: 28-05 12:50:27| 8 2 90 0 0|4544M 4334M 268M 6531M|3292k 51k| 640k 8194B|5.00 1.00 |3684 4234 |0.25 0.83 1.03|1.0 0 6.0| 0 0 | 0 2048M| 27 289 0 3 0 May 28 12:50:27 l75lg1-v1 sudo[88584]: pam_unix(sudo:session): session closed for user root May 28 12:50:27 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.451s {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:428}} May 28 12:50:27 l75lg1-v1 cinder-volume[85846]: DEBUG cinder.manager [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] Notifying Schedulers of capabilities ... {{(pid=85846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 28 12:50:27 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.scheduler.host_manager [None req-22429147-7dc1-40fd-8dc4-8f585902661e None None] Received volume service update from l75lg1-v1@lvmdriver-1: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:l75lg1-v1:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up', 'allocated_capacity_gb': 0, 'cacheable': True}], 'shared_targets': False, 'sparse_copy_volume': True, 'filter_function': None, 'goodness_function': None} {{(pid=85128) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:628}} May 28 12:50:28 l75lg1-v1 dstat.sh[49771]: 28-05 12:50:28| 3 1 95 0 0|4537M 4338M 268M 6534M|3130k 49k| 256k 0 |2.00 0 |3440 4094 |0.25 0.83 1.03| 0 0 9.0| 0 0 | 0 2048M| 27 289 0 3 0 May 28 12:50:29 l75lg1-v1 dstat.sh[49771]: 28-05 12:50:29| 0 0 99 0 0|4538M 4334M 268M 6538M|3496k 55k| 0 520k| 0 98.0 |3242 4109 |0.25 0.83 1.03| 0 0 0| 0 0 | 0 2048M| 27 289 0 3 0 May 28 12:50:29 l75lg1-v1 nova-conductor[83647]: DEBUG dbcounter [-] [83647] Writing DB stats nova_cell1:SELECT=2,nova_cell1:UPDATE=3 {{(pid=83647) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:50:29 l75lg1-v1 nova-conductor[83648]: DEBUG dbcounter [-] [83648] Writing DB stats nova_cell1:SELECT=1 {{(pid=83648) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:50:30 l75lg1-v1 dstat.sh[49771]: 28-05 12:50:30| 1 0 98 0 0|4537M 4331M 268M 6541M|3582k 62k| 0 376k| 0 41.0 |3895 5204 |0.25 0.83 1.03| 0 0 0| 0 0 | 0 2048M| 27 289 0 3 0 May 28 12:50:30 l75lg1-v1 neutron-server[77618]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.HashRingHealthCheckPeriodics.touch_hash_ring_nodes' {{(pid=77618) _process_scheduled /opt/stack/data/venv/lib/python3.10/site-packages/futurist/periodics.py:638}} May 28 12:50:31 l75lg1-v1 dstat.sh[49771]: 28-05 12:50:31| 1 1 98 0 0|4539M 4325M 268M 6545M|3906k 57k| 0 48M| 0 91.0 |4827 5009 |0.25 0.83 1.03|1.0 0 0| 0 0 | 0 2048M| 27 289 0 3 0 May 28 12:50:32 l75lg1-v1 dstat.sh[49771]: 28-05 12:50:32| 1 1 97 1 0|4539M 4321M 268M 6549M|4561k 66k| 0 144k| 0 21.0 |4780 5370 |0.23 0.82 1.02|1.0 0 0| 0 0 | 0 2048M| 27 289 0 3 0 May 28 12:50:33 l75lg1-v1 dstat.sh[49771]: 28-05 12:50:33| 1 0 98 0 0|4540M 4316M 268M 6554M|4801k 63k| 0 296k| 0 23.0 |3844 4754 |0.23 0.82 1.02|1.0 0 0| 0 0 | 0 2048M| 27 289 0 3 0 May 28 12:50:34 l75lg1-v1 dstat.sh[49771]: 28-05 12:50:34| 1 1 98 0 0|4540M 4310M 268M 6559M|5719k 69k| 0 324k| 0 60.0 |3912 4977 |0.23 0.82 1.02|1.0 0 0| 0 0 | 0 2048M| 27 289 0 3 0 May 28 12:50:35 l75lg1-v1 dstat.sh[49771]: 28-05 12:50:35| 1 1 98 0 0|4542M 4302M 268M 6565M|6229k 60k| 0 8192B| 0 1.00 |3898 4146 |0.23 0.82 1.02| 0 0 0| 0 0 | 0 2048M| 27 289 0 3 0 May 28 12:50:36 l75lg1-v1 dstat.sh[49771]: 28-05 12:50:36| 1 0 98 0 0|4540M 4299M 268M 6570M|5227k 66k| 0 0 | 0 0 |4751 4670 |0.23 0.82 1.02|4.0 0 0| 0 0 | 0 2048M| 27 289 0 3 0 May 28 12:50:37 l75lg1-v1 dstat.sh[49771]: 28-05 12:50:37| 1 1 98 0 0|4541M 4293M 268M 6575M|5671k 69k| 0 0 | 0 0 |4944 4858 |0.21 0.81 1.01|1.0 0 0| 0 0 | 0 2048M| 27 289 0 3 0 May 28 12:50:38 l75lg1-v1 dstat.sh[49771]: 28-05 12:50:38| 1 1 98 0 0|4542M 4285M 268M 6581M|6124k 72k| 0 116k| 0 17.0 |5483 5478 |0.21 0.81 1.01|1.0 0 2.0| 0 0 | 0 2048M| 27 289 0 3 0 May 28 12:50:39 l75lg1-v1 dstat.sh[49771]: 28-05 12:50:39| 1 1 98 0 0|4543M 4278M 268M 6587M|6193k 67k| 0 196k| 0 14.0 |5179 4267 |0.21 0.81 1.01| 0 0 0| 0 0 | 0 2048M| 27 289 0 3 0 May 28 12:50:39 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:50:39 l75lg1-v1 nova-conductor[83648]: DEBUG dbcounter [-] [83648] Writing DB stats nova_cell1:SELECT=1 {{(pid=83648) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:50:40 l75lg1-v1 dstat.sh[49771]: 28-05 12:50:40| 1 0 98 0 0|4545M 4272M 268M 6591M|4811k 68k| 0 268k| 0 48.0 |4891 5383 |0.21 0.81 1.01| 0 0 0| 0 0 | 0 2048M| 27 289 0 3 0 May 28 12:50:40 l75lg1-v1 neutron-server[77618]: DEBUG dbcounter [-] [77618] Writing DB stats neutron:UPDATE=1,neutron:SELECT=1 {{(pid=77618) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:50:40 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:50:41 l75lg1-v1 dstat.sh[49771]: 28-05 12:50:41| 1 1 98 0 0|4546M 4265M 268M 6596M|5099k 63k| 0 60k| 0 9.00 |4464 5069 |0.21 0.81 1.01|1.0 0 0| 0 0 | 0 2048M| 27 289 0 3 0 May 28 12:50:41 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:50:41 l75lg1-v1 nova-scheduler[81196]: DEBUG dbcounter [-] [81196] Writing DB stats nova_cell0:SELECT=1,nova_cell0:UPDATE=1 {{(pid=81196) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:50:41 l75lg1-v1 nova-scheduler[81194]: DEBUG dbcounter [-] [81194] Writing DB stats nova_cell0:SELECT=1,nova_cell0:UPDATE=1 {{(pid=81194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:50:42 l75lg1-v1 dstat.sh[49771]: 28-05 12:50:42| 1 0 98 0 0|4547M 4259M 268M 6602M|5400k 66k| 0 300k| 0 29.0 |4286 5311 |0.20 0.79 1.01| 0 0 0| 0 0 | 0 2048M| 27 289 0 3 0 May 28 12:50:42 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:50:42 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:50:42 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.manager [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Starting heal instance info cache {{(pid=83654) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}} May 28 12:50:42 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.manager [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Rebuilding the list of instances to heal {{(pid=83654) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9930}} May 28 12:50:42 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Expecting reply to msg d8b55518025a4d2e8d4ed8d95ee0d863 in queue reply_37f4cbd1dd094961a22b8a65f222c327 May 28 12:50:42 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [-] Received RPC response for msg d8b55518025a4d2e8d4ed8d95ee0d863 May 28 12:50:43 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.manager [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Didn't find any instances for network info cache update. {{(pid=83654) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10012}} May 28 12:50:43 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:50:43 l75lg1-v1 dstat.sh[49771]: 28-05 12:50:43| 1 0 98 0 0|4547M 4254M 268M 6607M|5402k 66k| 0 36k| 0 5.00 |4037 5034 |0.20 0.79 1.01|1.0 0 0| 0 0 | 0 2048M| 27 289 0 3 0 May 28 12:50:44 l75lg1-v1 dstat.sh[49771]: 28-05 12:50:44| 1 1 98 0 0|4548M 4248M 268M 6612M|5579k 69k| 0 0 | 0 0 |4846 5045 |0.20 0.79 1.01| 0 0 0| 0 0 | 0 2048M| 27 289 0 3 0 May 28 12:50:44 l75lg1-v1 neutron-server[77623]: DEBUG dbcounter [-] [77623] Writing DB stats neutron:SELECT=1 {{(pid=77623) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:50:44 l75lg1-v1 neutron-server[77623]: DEBUG dbcounter [-] [77623] Writing DB stats neutron:SELECT=2 {{(pid=77623) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:50:44 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:50:44 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:50:44 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.manager [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=83654) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10545}} May 28 12:50:44 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager.update_available_resource {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:50:44 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Expecting reply to msg 4c5b55c374c44a07977c7f3e55d084ce in queue reply_37f4cbd1dd094961a22b8a65f222c327 May 28 12:50:44 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [-] Received RPC response for msg 4c5b55c374c44a07977c7f3e55d084ce May 28 12:50:45 l75lg1-v1 nova-compute[83654]: DEBUG oslo_concurrency.lockutils [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=83654) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:50:45 l75lg1-v1 nova-compute[83654]: DEBUG oslo_concurrency.lockutils [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=83654) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:50:45 l75lg1-v1 nova-compute[83654]: DEBUG oslo_concurrency.lockutils [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=83654) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:50:45 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.resource_tracker [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Auditing locally available compute resources for l75lg1-v1 (node: l75lg1-v1) {{(pid=83654) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}} May 28 12:50:45 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.resource_tracker [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Hypervisor/Node resource view: name=l75lg1-v1 free_ram=11125MB free_disk=16.833744049072266GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_01_1", "address": "0000:00:01.1", "product_id": "7010", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7010", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7000", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7000", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "0100", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_0100", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_09_0", "address": "0000:00:09.0", "product_id": "1001", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1001", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "293a", "vendor_id": "8086", "numa_node": null, "label": "label_8086_293a", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_2", "address": "0000:00:07.2", "product_id": "2936", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2936", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "1237", "vendor_id": "8086", "numa_node": null, "label": "label_8086_1237", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "2935", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2935", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "2934", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2934", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_05_0", "address": "0000:00:05.0", "product_id": "1000", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1000", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "1000", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1000", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_06_0", "address": "0000:00:06.0", "product_id": "2668", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2668", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "1000", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1000", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0a_0", "address": "0000:00:0a.0", "product_id": "1002", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1002", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_3", "address": "0000:00:01.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_08_0", "address": "0000:00:08.0", "product_id": "1003", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1003", "dev_type": "type-PCI"}] {{(pid=83654) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}} May 28 12:50:45 l75lg1-v1 nova-compute[83654]: DEBUG oslo_concurrency.lockutils [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=83654) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:50:45 l75lg1-v1 nova-compute[83654]: DEBUG oslo_concurrency.lockutils [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=83654) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:50:45 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Expecting reply to msg e5a51c3ed4ad4ce0a0c3441e95285529 in queue reply_37f4cbd1dd094961a22b8a65f222c327 May 28 12:50:45 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [-] Received RPC response for msg e5a51c3ed4ad4ce0a0c3441e95285529 May 28 12:50:45 l75lg1-v1 dstat.sh[49771]: 28-05 12:50:45| 1 1 97 0 0|4551M 4240M 268M 6617M|5588k 66k| 0 620k| 0 95.0 |6678 7164 |0.20 0.79 1.01|1.0 0 0| 0 0 | 0 2048M| 27 289 0 3 0 May 28 12:50:45 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Expecting reply to msg c1deac69f36643bfb1b572c1c9859511 in queue reply_37f4cbd1dd094961a22b8a65f222c327 May 28 12:50:45 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [-] Received RPC response for msg c1deac69f36643bfb1b572c1c9859511 May 28 12:50:46 l75lg1-v1 devstack@placement-api.service[78201]: DEBUG placement.requestlog [req-7dab7e9c-6f57-46e3-9db4-13a469c84795 req-624d823d-d3e5-4662-9e6a-6dd0daa50bf9 None None] Starting request: 10.27.203.238 "GET /placement/resource_providers/ef90d7d1-0808-4a15-ad77-f9a7391af2f4/allocations" {{(pid=78201) __call__ /opt/stack/placement/placement/requestlog.py:55}} May 28 12:50:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d62cf64-42e7-40be-bfc8-032733ae03c8 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:50:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d62cf64-42e7-40be-bfc8-032733ae03c8 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:50:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444b5217-3975-415a-a3bc-7c7371caff86 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3fe870f285d4169bd917382dd02d7b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'manager', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:50:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444b5217-3975-415a-a3bc-7c7371caff86 service placement] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:50:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444b5217-3975-415a-a3bc-7c7371caff86 service placement] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:50:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444b5217-3975-415a-a3bc-7c7371caff86 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:50:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444b5217-3975-415a-a3bc-7c7371caff86 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:50:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444b5217-3975-415a-a3bc-7c7371caff86 service placement] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:50:46 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 544/1074] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 12:50:46 2024] GET /identity/v3/auth/tokens => generated 4060 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 12:50:46 l75lg1-v1 dstat.sh[49771]: 28-05 12:50:46| 1 0 97 0 0|4550M 4236M 268M 6621M|3766k 39k| 0 20k| 0 1.00 |4099 3339 |0.20 0.79 1.01|2.0 0 0| 0 0 | 0 2048M| 27 290 0 2 0 May 28 12:50:46 l75lg1-v1 devstack@placement-api.service[78201]: INFO placement.requestlog [req-7dab7e9c-6f57-46e3-9db4-13a469c84795 req-624d823d-d3e5-4662-9e6a-6dd0daa50bf9 service placement] 10.27.203.238 "GET /placement/resource_providers/ef90d7d1-0808-4a15-ad77-f9a7391af2f4/allocations" status: 200 len: 54 microversion: 1.0 May 28 12:50:46 l75lg1-v1 devstack@placement-api.service[78201]: [pid: 78201|app: 0|req: 11/22] 10.27.203.238 () {62 vars in 1480 bytes} [Tue May 28 12:50:46 2024] GET /placement/resource_providers/ef90d7d1-0808-4a15-ad77-f9a7391af2f4/allocations => generated 54 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 223 bytes (1 switches on core 0) May 28 12:50:46 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.resource_tracker [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Total usable vcpus: 10, total allocated vcpus: 0 {{(pid=83654) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}} May 28 12:50:46 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.resource_tracker [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Final resource view: name=l75lg1-v1 phys_ram=16000MB used_ram=512MB phys_disk=28GB used_disk=0GB total_vcpus=10 used_vcpus=0 pci_stats=[] {{(pid=83654) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}} May 28 12:50:46 l75lg1-v1 devstack@placement-api.service[78202]: DEBUG placement.requestlog [req-7dab7e9c-6f57-46e3-9db4-13a469c84795 req-16a1f43e-259d-48b6-91fb-6453581ce218 None None] Starting request: 10.27.203.238 "GET /placement/resource_providers?in_tree=ef90d7d1-0808-4a15-ad77-f9a7391af2f4" {{(pid=78202) __call__ /opt/stack/placement/placement/requestlog.py:55}} May 28 12:50:46 l75lg1-v1 devstack@placement-api.service[78202]: INFO placement.requestlog [req-7dab7e9c-6f57-46e3-9db4-13a469c84795 req-16a1f43e-259d-48b6-91fb-6453581ce218 service placement] 10.27.203.238 "GET /placement/resource_providers?in_tree=ef90d7d1-0808-4a15-ad77-f9a7391af2f4" status: 200 len: 858 microversion: 1.14 May 28 12:50:46 l75lg1-v1 devstack@placement-api.service[78202]: [pid: 78202|app: 0|req: 12/23] 10.27.203.238 () {64 vars in 1466 bytes} [Tue May 28 12:50:46 2024] GET /placement/resource_providers?in_tree=ef90d7d1-0808-4a15-ad77-f9a7391af2f4 => generated 858 bytes in 18 msecs (HTTP/1.1 200) 6 headers in 225 bytes (1 switches on core 0) May 28 12:50:46 l75lg1-v1 nova-compute[83654]: DEBUG nova.scheduler.client.report [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Refreshing inventories for resource provider ef90d7d1-0808-4a15-ad77-f9a7391af2f4 {{(pid=83654) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}} May 28 12:50:46 l75lg1-v1 devstack@placement-api.service[78201]: DEBUG placement.requestlog [req-7dab7e9c-6f57-46e3-9db4-13a469c84795 req-cb82f111-a485-42bb-b951-704e69d57fed None None] Starting request: 10.27.203.238 "GET /placement/resource_providers/ef90d7d1-0808-4a15-ad77-f9a7391af2f4/inventories" {{(pid=78201) __call__ /opt/stack/placement/placement/requestlog.py:55}} May 28 12:50:46 l75lg1-v1 devstack@placement-api.service[78201]: INFO placement.requestlog [req-7dab7e9c-6f57-46e3-9db4-13a469c84795 req-cb82f111-a485-42bb-b951-704e69d57fed service placement] 10.27.203.238 "GET /placement/resource_providers/ef90d7d1-0808-4a15-ad77-f9a7391af2f4/inventories" status: 200 len: 398 microversion: 1.0 May 28 12:50:46 l75lg1-v1 devstack@placement-api.service[78201]: [pid: 78201|app: 0|req: 12/24] 10.27.203.238 () {62 vars in 1480 bytes} [Tue May 28 12:50:46 2024] GET /placement/resource_providers/ef90d7d1-0808-4a15-ad77-f9a7391af2f4/inventories => generated 398 bytes in 17 msecs (HTTP/1.1 200) 6 headers in 224 bytes (1 switches on core 0) May 28 12:50:46 l75lg1-v1 nova-compute[83654]: DEBUG nova.scheduler.client.report [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Updating ProviderTree inventory for provider ef90d7d1-0808-4a15-ad77-f9a7391af2f4 from _refresh_and_get_inventory using data: {'VCPU': {'total': 10, 'reserved': 0, 'min_unit': 1, 'max_unit': 10, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16000, 'reserved': 512, 'min_unit': 1, 'max_unit': 16000, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 28, 'reserved': 0, 'min_unit': 1, 'max_unit': 28, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=83654) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}} May 28 12:50:46 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.provider_tree [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Updating inventory in ProviderTree for provider ef90d7d1-0808-4a15-ad77-f9a7391af2f4 with inventory: {'VCPU': {'total': 10, 'reserved': 0, 'min_unit': 1, 'max_unit': 10, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16000, 'reserved': 512, 'min_unit': 1, 'max_unit': 16000, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 28, 'reserved': 0, 'min_unit': 1, 'max_unit': 28, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=83654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}} May 28 12:50:46 l75lg1-v1 devstack@placement-api.service[78202]: DEBUG placement.requestlog [req-7dab7e9c-6f57-46e3-9db4-13a469c84795 req-f501146e-b585-473f-9a9b-8746894fe3d2 None None] Starting request: 10.27.203.238 "GET /placement/resource_providers/ef90d7d1-0808-4a15-ad77-f9a7391af2f4/aggregates" {{(pid=78202) __call__ /opt/stack/placement/placement/requestlog.py:55}} May 28 12:50:46 l75lg1-v1 devstack@placement-api.service[78202]: INFO placement.requestlog [req-7dab7e9c-6f57-46e3-9db4-13a469c84795 req-f501146e-b585-473f-9a9b-8746894fe3d2 service placement] 10.27.203.238 "GET /placement/resource_providers/ef90d7d1-0808-4a15-ad77-f9a7391af2f4/aggregates" status: 200 len: 53 microversion: 1.19 May 28 12:50:46 l75lg1-v1 devstack@placement-api.service[78202]: [pid: 78202|app: 0|req: 13/25] 10.27.203.238 () {64 vars in 1521 bytes} [Tue May 28 12:50:46 2024] GET /placement/resource_providers/ef90d7d1-0808-4a15-ad77-f9a7391af2f4/aggregates => generated 53 bytes in 13 msecs (HTTP/1.1 200) 8 headers in 295 bytes (1 switches on core 0) May 28 12:50:46 l75lg1-v1 nova-compute[83654]: DEBUG nova.scheduler.client.report [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Refreshing aggregate associations for resource provider ef90d7d1-0808-4a15-ad77-f9a7391af2f4, aggregates: None {{(pid=83654) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}} May 28 12:50:46 l75lg1-v1 devstack@placement-api.service[78201]: DEBUG placement.requestlog [req-7dab7e9c-6f57-46e3-9db4-13a469c84795 req-1acbe6db-1603-455b-9ed4-052768af3be5 None None] Starting request: 10.27.203.238 "GET /placement/resource_providers/ef90d7d1-0808-4a15-ad77-f9a7391af2f4/traits" {{(pid=78201) __call__ /opt/stack/placement/placement/requestlog.py:55}} May 28 12:50:46 l75lg1-v1 devstack@placement-api.service[78201]: INFO placement.requestlog [req-7dab7e9c-6f57-46e3-9db4-13a469c84795 req-1acbe6db-1603-455b-9ed4-052768af3be5 service placement] 10.27.203.238 "GET /placement/resource_providers/ef90d7d1-0808-4a15-ad77-f9a7391af2f4/traits" status: 200 len: 1471 microversion: 1.6 May 28 12:50:46 l75lg1-v1 devstack@placement-api.service[78201]: [pid: 78201|app: 0|req: 13/26] 10.27.203.238 () {64 vars in 1508 bytes} [Tue May 28 12:50:46 2024] GET /placement/resource_providers/ef90d7d1-0808-4a15-ad77-f9a7391af2f4/traits => generated 1471 bytes in 21 msecs (HTTP/1.1 200) 6 headers in 225 bytes (1 switches on core 0) May 28 12:50:46 l75lg1-v1 nova-compute[83654]: DEBUG nova.scheduler.client.report [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Refreshing trait associations for resource provider ef90d7d1-0808-4a15-ad77-f9a7391af2f4, traits: COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_LAN9118,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NODE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSSE3,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_IDE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VIOMMU_MODEL_SMMUV3,COMPUTE_STORAGE_BUS_FDC {{(pid=83654) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}} May 28 12:50:46 l75lg1-v1 devstack@placement-api.service[78202]: DEBUG placement.requestlog [req-7dab7e9c-6f57-46e3-9db4-13a469c84795 req-a2961b74-5702-4ea5-aa50-983c758a7767 None None] Starting request: 10.27.203.238 "GET /placement/resource_providers/ef90d7d1-0808-4a15-ad77-f9a7391af2f4/allocations" {{(pid=78202) __call__ /opt/stack/placement/placement/requestlog.py:55}} May 28 12:50:46 l75lg1-v1 devstack@placement-api.service[78202]: INFO placement.requestlog [req-7dab7e9c-6f57-46e3-9db4-13a469c84795 req-a2961b74-5702-4ea5-aa50-983c758a7767 service placement] 10.27.203.238 "GET /placement/resource_providers/ef90d7d1-0808-4a15-ad77-f9a7391af2f4/allocations" status: 200 len: 54 microversion: 1.0 May 28 12:50:46 l75lg1-v1 devstack@placement-api.service[78202]: [pid: 78202|app: 0|req: 14/27] 10.27.203.238 () {62 vars in 1480 bytes} [Tue May 28 12:50:46 2024] GET /placement/resource_providers/ef90d7d1-0808-4a15-ad77-f9a7391af2f4/allocations => generated 54 bytes in 11 msecs (HTTP/1.1 200) 6 headers in 223 bytes (1 switches on core 0) May 28 12:50:46 l75lg1-v1 neutron-server[77623]: DEBUG neutron.db.agents_db [None req-fe40ce8c-640e-4db7-a17a-6e8888cce266 None None] Agent healthcheck: found 0 active agents {{(pid=77623) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:319}} May 28 12:50:46 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.provider_tree [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Inventory has not changed in ProviderTree for provider: ef90d7d1-0808-4a15-ad77-f9a7391af2f4 {{(pid=83654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} May 28 12:50:46 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Expecting reply to msg fbb95a59ce9044f0a9d51a709929c614 in queue reply_37f4cbd1dd094961a22b8a65f222c327 May 28 12:50:46 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [-] Received RPC response for msg fbb95a59ce9044f0a9d51a709929c614 May 28 12:50:46 l75lg1-v1 nova-compute[83654]: DEBUG nova.scheduler.client.report [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Inventory has not changed for provider ef90d7d1-0808-4a15-ad77-f9a7391af2f4 based on inventory data: {'VCPU': {'total': 10, 'reserved': 0, 'min_unit': 1, 'max_unit': 10, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16000, 'reserved': 512, 'min_unit': 1, 'max_unit': 16000, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 28, 'reserved': 0, 'min_unit': 1, 'max_unit': 28, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=83654) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}} May 28 12:50:46 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.resource_tracker [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Compute_service record updated for l75lg1-v1:l75lg1-v1 {{(pid=83654) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}} May 28 12:50:46 l75lg1-v1 nova-compute[83654]: DEBUG oslo_concurrency.lockutils [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.700s {{(pid=83654) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:50:47 l75lg1-v1 dstat.sh[49771]: 28-05 12:50:47| 2 0 97 0 0|4551M 4234M 268M 6622M|1856k 31k| 0 0 | 0 0 |3337 3606 |0.18 0.78 1.00| 0 0 0| 0 0 | 0 2048M| 27 289 0 3 0 May 28 12:50:47 l75lg1-v1 nova-conductor[83229]: DEBUG dbcounter [-] [83229] Writing DB stats nova_cell0:SELECT=1,nova_cell0:UPDATE=1 {{(pid=83229) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:50:48 l75lg1-v1 nova-conductor[83233]: DEBUG dbcounter [-] [83233] Writing DB stats nova_cell0:SELECT=1 {{(pid=83233) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:50:48 l75lg1-v1 dstat.sh[49771]: 28-05 12:50:48| 1 0 98 0 0|4550M 4233M 268M 6624M|1643k 31k| 0 136k| 0 12.0 |2588 3463 |0.18 0.78 1.00| 0 0 2.0| 0 0 | 0 2048M| 27 289 0 3 0 May 28 12:50:48 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:50:49 l75lg1-v1 dstat.sh[49771]: 28-05 12:50:49| 1 0 99 0 0|4550M 4231M 268M 6626M|1778k 33k| 0 0 | 0 0 |2580 3452 |0.18 0.78 1.00| 0 0 0| 0 0 | 0 2048M| 27 289 0 3 0 May 28 12:50:50 l75lg1-v1 dstat.sh[49771]: 28-05 12:50:50| 1 0 99 0 0|4550M 4229M 268M 6627M|1463k 26k| 0 284k| 0 31.0 |2866 3279 |0.18 0.78 1.00|1.0 0 0| 0 0 | 0 2048M| 27 289 0 3 0 May 28 12:50:51 l75lg1-v1 dstat.sh[49771]: 28-05 12:50:51| 0 0 98 0 0|4550M 4229M 268M 6628M|1223k 23k| 0 708k| 0 137 |2632 2878 |0.18 0.78 1.00| 0 0 0| 0 0 | 0 2048M| 27 289 0 3 0 May 28 12:50:52 l75lg1-v1 dstat.sh[49771]: 28-05 12:50:52| 1 0 99 0 0|4550M 4227M 268M 6630M|1038k 19k| 0 4098B| 0 1.00 |2194 2645 |0.17 0.77 1.00| 0 0 0| 0 0 | 0 2048M| 27 289 0 3 0 May 28 12:50:53 l75lg1-v1 dstat.sh[49771]: 28-05 12:50:53| 1 0 99 0 0|4550M 4226M 268M 6630M| 803k 15k| 0 0 | 0 0 |1889 2413 |0.17 0.77 1.00|1.0 0 0| 0 0 | 0 2048M| 27 289 0 3 0 May 28 12:50:54 l75lg1-v1 dstat.sh[49771]: 28-05 12:50:54| 0 0 99 0 0|4550M 4226M 268M 6631M| 663k 12k| 0 4093B| 0 1.00 |2113 2466 |0.17 0.77 1.00| 0 0 0| 0 0 | 0 2048M| 27 289 0 3 0 May 28 12:50:55 l75lg1-v1 dstat.sh[49771]: 28-05 12:50:55| 1 1 99 0 0|4550M 4226M 268M 6632M| 723k 15k| 0 0 | 0 0 |2272 2616 |0.17 0.77 1.00| 0 0 0| 0 0 | 0 2048M| 27 289 0 3 0 May 28 12:50:55 l75lg1-v1 nova-conductor[83648]: DEBUG dbcounter [-] [83648] Writing DB stats nova_cell1:SELECT=1 {{(pid=83648) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:50:56 l75lg1-v1 devstack@keystone.service[51267]: DEBUG dbcounter [-] [51267] Writing DB stats keystone:SELECT=11 {{(pid=51267) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:50:56 l75lg1-v1 dstat.sh[49771]: 28-05 12:50:56| 0 0 99 0 0|4550M 4224M 268M 6632M| 743k 15k| 0 244k| 0 38.0 |2329 2754 |0.17 0.77 1.00| 0 0 0| 0 0 | 0 2048M| 27 289 0 3 0 May 28 12:50:56 l75lg1-v1 devstack@placement-api.service[78201]: DEBUG dbcounter [-] [78201] Writing DB stats placement:SELECT=8 {{(pid=78201) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:50:56 l75lg1-v1 devstack@placement-api.service[78202]: DEBUG dbcounter [-] [78202] Writing DB stats placement:SELECT=6 {{(pid=78202) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:50:56 l75lg1-v1 neutron-server[77623]: DEBUG dbcounter [-] [77623] Writing DB stats neutron:SELECT=1 {{(pid=77623) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:50:57 l75lg1-v1 dstat.sh[49771]: 28-05 12:50:57| 1 0 98 1 0|4550M 4224M 268M 6633M| 731k 14k| 0 48M| 0 82.0 |2434 2990 |0.23 0.77 1.00| 0 0 0| 0 0 | 0 2048M| 27 289 0 3 0 May 28 12:50:57 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [-] Expecting reply to msg a4986233aae24f4ca00de9c109bb6dd7 in queue reply_37f4cbd1dd094961a22b8a65f222c327 May 28 12:50:58 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [-] Received RPC response for msg a4986233aae24f4ca00de9c109bb6dd7 May 28 12:50:58 l75lg1-v1 dstat.sh[49771]: 28-05 12:50:58| 1 0 97 1 0|4550M 4223M 268M 6634M| 745k 15k| 0 140k| 0 17.0 |2633 3361 |0.23 0.77 1.00| 0 0 2.0| 0 0 | 0 2048M| 27 289 0 3 0 May 28 12:50:59 l75lg1-v1 dstat.sh[49771]: 28-05 12:50:59| 1 0 99 0 0|4550M 4222M 268M 6634M| 763k 15k| 0 208k| 0 13.0 |2223 2858 |0.23 0.77 1.00| 0 0 0| 0 0 | 0 2048M| 27 289 0 3 0 May 28 12:50:59 l75lg1-v1 nova-conductor[83647]: DEBUG dbcounter [-] [83647] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=3 {{(pid=83647) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:50:59 l75lg1-v1 nova-conductor[83648]: DEBUG dbcounter [-] [83648] Writing DB stats nova_cell1:SELECT=3 {{(pid=83648) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:51:00 l75lg1-v1 dstat.sh[49771]: 28-05 12:51:00| 1 0 99 0 0|4550M 4222M 268M 6635M| 840k 17k| 0 156k| 0 26.0 |2283 3333 |0.23 0.77 1.00| 0 0 0| 0 0 | 0 2048M| 27 289 0 3 0 May 28 12:51:00 l75lg1-v1 neutron-server[77618]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.HashRingHealthCheckPeriodics.touch_hash_ring_nodes' {{(pid=77618) _process_scheduled /opt/stack/data/venv/lib/python3.10/site-packages/futurist/periodics.py:638}} May 28 12:51:01 l75lg1-v1 dstat.sh[49771]: 28-05 12:51:01| 1 0 98 0 0|4550M 4220M 268M 6636M| 981k 18k| 0 632k| 0 123 |2629 3737 |0.23 0.77 1.00| 0 0 0| 0 0 | 0 2048M| 27 289 0 3 0 May 28 12:51:02 l75lg1-v1 dstat.sh[49771]: 28-05 12:51:02| 0 0 99 0 0|4550M 4220M 268M 6637M|1161k 22k| 0 45M| 0 45.0 |2742 3108 |0.21 0.76 0.99| 0 0 0| 0 0 | 0 2048M| 27 289 0 3 0 May 28 12:51:03 l75lg1-v1 dstat.sh[49771]: 28-05 12:51:03| 1 0 98 1 0|4550M 4219M 268M 6638M|1511k 27k| 0 140k| 0 19.0 |3143 3659 |0.21 0.76 0.99|1.0 0 0| 0 0 | 0 2048M| 27 289 0 3 0 May 28 12:51:04 l75lg1-v1 dstat.sh[49771]: 28-05 12:51:04| 1 0 99 0 0|4550M 4217M 268M 6640M|1628k 26k| 0 4096B| 0 1.00 |2773 2879 |0.21 0.76 0.99| 0 0 0| 0 0 | 0 2048M| 27 289 0 3 0 May 28 12:51:05 l75lg1-v1 dstat.sh[49771]: 28-05 12:51:05| 1 0 99 0 0|4550M 4215M 268M 6641M|1539k 28k| 0 496k| 0 37.0 |3087 3395 |0.21 0.76 0.99|1.0 0 0| 0 0 | 0 2048M| 27 289 0 3 0 May 28 12:51:06 l75lg1-v1 dstat.sh[49771]: 28-05 12:51:06| 1 0 99 0 0|4550M 4213M 268M 6643M|1797k 33k| 0 36k| 0 5.00 |3311 3525 |0.21 0.76 0.99| 0 0 0| 0 0 | 0 2048M| 27 289 0 3 0 May 28 12:51:07 l75lg1-v1 dstat.sh[49771]: 28-05 12:51:07| 0 0 99 0 0|4550M 4211M 268M 6645M|1837k 33k| 0 144k| 0 30.0 |3240 3382 |0.20 0.74 0.99|1.0 0 0| 0 0 | 0 2048M| 27 289 0 3 0 May 28 12:51:08 l75lg1-v1 dstat.sh[49771]: 28-05 12:51:08| 1 0 98 0 0|4550M 4210M 268M 6646M|1921k 34k| 0 0 | 0 0 |3352 3429 |0.20 0.74 0.99|1.0 0 2.0| 0 0 | 0 2048M| 27 289 0 3 0 May 28 12:51:09 l75lg1-v1 dstat.sh[49771]: 28-05 12:51:09| 1 0 99 0 0|4550M 4208M 268M 6648M|1619k 24k| 0 8195B| 0 2.00 |2769 2842 |0.20 0.74 0.99|1.0 0 0| 0 0 | 0 2048M| 27 289 0 3 0 May 28 12:51:09 l75lg1-v1 nova-conductor[83647]: DEBUG dbcounter [-] [83647] Writing DB stats nova_cell1:SELECT=4,nova_cell1:UPDATE=3 {{(pid=83647) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:51:09 l75lg1-v1 nova-conductor[83648]: DEBUG dbcounter [-] [83648] Writing DB stats nova_cell1:SELECT=2,nova_cell1:UPDATE=1 {{(pid=83648) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:51:10 l75lg1-v1 dstat.sh[49771]: 28-05 12:51:10| 1 0 98 0 0|4551M 4206M 268M 6649M|1597k 29k| 0 360k| 0 43.0 |3361 3797 |0.20 0.74 0.99|1.0 0 0| 0 0 | 0 2048M| 27 289 0 3 0 May 28 12:51:10 l75lg1-v1 neutron-server[77618]: DEBUG dbcounter [-] [77618] Writing DB stats neutron:UPDATE=1 {{(pid=77618) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:51:10 l75lg1-v1 neutron-server[77618]: DEBUG dbcounter [-] [77618] Writing DB stats neutron:SELECT=1 {{(pid=77618) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:51:11 l75lg1-v1 cinder-scheduler[85128]: DEBUG dbcounter [-] [85128] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=85128) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:51:11 l75lg1-v1 dstat.sh[49771]: 28-05 12:51:11| 1 0 98 0 0|4551M 4204M 268M 6651M|1785k 29k| 0 152k| 0 21.0 |3192 3435 |0.20 0.74 0.99|2.0 0 0| 0 0 | 0 2048M| 27 289 0 3 0 May 28 12:51:12 l75lg1-v1 dstat.sh[49771]: 28-05 12:51:12| 0 0 99 0 0|4551M 4203M 268M 6653M|1875k 30k| 0 300k| 0 62.0 |2810 3314 |0.18 0.73 0.98| 0 0 0| 0 0 | 0 2048M| 27 289 0 3 0 May 28 12:51:12 l75lg1-v1 cinder-volume[85846]: DEBUG dbcounter [-] [85846] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=85846) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:51:13 l75lg1-v1 dstat.sh[49771]: 28-05 12:51:13| 0 1 98 0 0|4551M 4201M 268M 6654M|1413k 24k| 0 60k| 0 8.00 |2684 2929 |0.18 0.73 0.98|1.0 0 0| 0 0 | 0 2048M| 27 289 0 3 0 May 28 12:51:14 l75lg1-v1 dstat.sh[49771]: 28-05 12:51:14| 1 0 99 0 0|4551M 4200M 268M 6656M|1460k 22k| 0 4098B| 0 1.00 |2578 2753 |0.18 0.73 0.98|1.0 0 0| 0 0 | 0 2048M| 27 289 0 3 0 May 28 12:51:15 l75lg1-v1 dstat.sh[49771]: 28-05 12:51:15| 1 0 99 0 0|4551M 4199M 268M 6657M|1142k 21k| 0 12k| 0 2.00 |2572 2933 |0.18 0.73 0.98|1.0 0 0| 0 0 | 0 2048M| 27 289 0 3 0 May 28 12:51:16 l75lg1-v1 dstat.sh[49771]: 28-05 12:51:16| 0 0 99 0 0|4551M 4197M 268M 6658M|1269k 25k| 0 44k| 0 1.00 |2816 3107 |0.18 0.73 0.98|2.0 0 0| 0 0 | 0 2048M| 27 289 0 3 0 May 28 12:51:17 l75lg1-v1 dstat.sh[49771]: 28-05 12:51:17| 1 0 99 0 0|4551M 4196M 268M 6659M|1304k 24k| 0 0 | 0 0 |2713 3000 |0.17 0.72 0.97|1.0 0 0| 0 0 | 0 2048M| 27 289 0 3 0 May 28 12:51:18 l75lg1-v1 dstat.sh[49771]: 28-05 12:51:18| 1 0 99 0 0|4551M 4195M 268M 6660M|1024k 18k| 0 248k| 0 38.0 |2220 2812 |0.17 0.72 0.97|1.0 0 2.0| 0 0 | 0 2048M| 27 289 0 3 0 May 28 12:51:19 l75lg1-v1 dstat.sh[49771]: 28-05 12:51:19| 0 0 99 0 0|4551M 4194M 268M 6661M|1162k 21k| 0 0 | 0 0 |2205 2983 |0.17 0.72 0.97|1.0 0 0| 0 0 | 0 2048M| 27 289 0 3 0 May 28 12:51:19 l75lg1-v1 nova-conductor[83648]: DEBUG dbcounter [-] [83648] Writing DB stats nova_cell1:SELECT=1 {{(pid=83648) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:51:20 l75lg1-v1 dstat.sh[49771]: 28-05 12:51:20| 1 0 98 0 0|4551M 4193M 268M 6662M|1277k 24k| 0 340k| 0 34.0 |2703 3732 |0.17 0.72 0.97| 0 0 0| 0 0 | 0 2048M| 27 289 0 3 0 May 28 12:51:21 l75lg1-v1 dstat.sh[49771]: 28-05 12:51:21| 1 0 99 0 0|4551M 4191M 268M 6664M|1266k 24k| 0 76k| 0 7.00 |2433 3308 |0.17 0.72 0.97|1.0 0 0| 0 0 | 0 2048M| 27 289 0 3 0 May 28 12:51:21 l75lg1-v1 neutron-server[77623]: DEBUG dbcounter [-] [77623] Writing DB stats neutron:SELECT=2 {{(pid=77623) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:51:21 l75lg1-v1 neutron-server[77623]: DEBUG dbcounter [-] [77623] Writing DB stats neutron:SELECT=1 {{(pid=77623) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:51:22 l75lg1-v1 dstat.sh[49771]: 28-05 12:51:22| 0 0 99 0 0|4551M 4190M 268M 6665M|1339k 25k| 0 48k| 0 8.00 |2297 3205 |0.15 0.71 0.97|1.0 0 0| 0 0 | 0 2048M| 27 289 0 3 0 May 28 12:51:23 l75lg1-v1 dstat.sh[49771]: 28-05 12:51:23| 0 0 99 0 0|4551M 4189M 268M 6666M|1285k 24k| 0 252k| 0 54.0 |2170 2885 |0.15 0.71 0.97|1.0 0 0| 0 0 | 0 2048M| 27 289 0 3 0 May 28 12:51:23 l75lg1-v1 neutron-server[77623]: DEBUG neutron.db.agents_db [None req-fe40ce8c-640e-4db7-a17a-6e8888cce266 None None] Agent healthcheck: found 0 active agents {{(pid=77623) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:319}} May 28 12:51:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "_check_child_processes" by "neutron.agent.linux.external_process.ProcessMonitor._check_child_processes" {{(pid=76818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:51:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_concurrency.lockutils [-] Lock "_check_child_processes" acquired by "neutron.agent.linux.external_process.ProcessMonitor._check_child_processes" :: waited 0.000s {{(pid=76818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:51:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_concurrency.lockutils [-] Lock "_check_child_processes" "released" by "neutron.agent.linux.external_process.ProcessMonitor._check_child_processes" :: held 0.000s {{(pid=76818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:51:24 l75lg1-v1 dstat.sh[49771]: 28-05 12:51:24| 1 0 99 0 0|4551M 4187M 268M 6667M|1344k 25k| 0 0 | 0 0 |2142 2908 |0.15 0.71 0.97| 0 0 0| 0 0 | 0 2048M| 27 289 0 3 0 May 28 12:51:25 l75lg1-v1 dstat.sh[49771]: 28-05 12:51:25| 2 1 96 0 0|4543M 4195M 268M 6669M|1367k 25k| 0 0 | 0 0 |3182 4466 |0.15 0.71 0.97|1.0 0 46| 0 0 | 0 2048M| 27 289 0 4 0 May 28 12:51:25 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_service.periodic_task [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85846) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:51:25 l75lg1-v1 cinder-volume[85846]: DEBUG cinder.volume.drivers.lvm [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] Updating volume stats {{(pid=85846) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}} May 28 12:51:25 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:390}} May 28 12:51:25 l75lg1-v1 sudo[88651]: vastdata : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 May 28 12:51:25 l75lg1-v1 sudo[88651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) May 28 12:51:26 l75lg1-v1 dstat.sh[49771]: 28-05 12:51:26| 6 1 93 0 0|4564M 4172M 268M 6670M|1416k 26k| 0 0 | 0 0 |2470 3235 |0.15 0.71 0.97|1.0 0 2.0| 0 0 | 0 2048M| 27 289 0 4 0 May 28 12:51:26 l75lg1-v1 sudo[88651]: pam_unix(sudo:session): session closed for user root May 28 12:51:26 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.754s {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:428}} May 28 12:51:26 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:390}} May 28 12:51:26 l75lg1-v1 sudo[88655]: vastdata : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 May 28 12:51:26 l75lg1-v1 sudo[88655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) May 28 12:51:27 l75lg1-v1 sudo[88655]: pam_unix(sudo:session): session closed for user root May 28 12:51:27 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.774s {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:428}} May 28 12:51:27 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:390}} May 28 12:51:27 l75lg1-v1 sudo[88658]: vastdata : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool May 28 12:51:27 l75lg1-v1 sudo[88658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) May 28 12:51:27 l75lg1-v1 dstat.sh[49771]: 28-05 12:51:27| 8 2 89 0 0|4544M 4190M 268M 6671M|1595k 29k| 512k 812k|4.00 48.0 |3149 4011 |0.22 0.71 0.97|2.0 0 7.0| 0 0 | 0 2048M| 27 289 0 3 0 May 28 12:51:27 l75lg1-v1 sudo[88658]: pam_unix(sudo:session): session closed for user root May 28 12:51:27 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.459s {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:428}} May 28 12:51:27 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:390}} May 28 12:51:27 l75lg1-v1 sudo[88661]: vastdata : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 May 28 12:51:27 l75lg1-v1 sudo[88661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) May 28 12:51:28 l75lg1-v1 sudo[88661]: pam_unix(sudo:session): session closed for user root May 28 12:51:28 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.481s {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:428}} May 28 12:51:28 l75lg1-v1 cinder-volume[85846]: DEBUG cinder.manager [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] Notifying Schedulers of capabilities ... {{(pid=85846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 28 12:51:28 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.scheduler.host_manager [None req-7014eb53-c482-4be5-8ca4-face8b8eb67c None None] Received volume service update from l75lg1-v1@lvmdriver-1: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:l75lg1-v1:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up', 'allocated_capacity_gb': 0, 'cacheable': True}], 'shared_targets': False, 'sparse_copy_volume': True, 'filter_function': None, 'goodness_function': None} {{(pid=85128) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:628}} May 28 12:51:28 l75lg1-v1 dstat.sh[49771]: 28-05 12:51:28| 8 2 90 0 0|4540M 4193M 268M 6673M|1839k 31k| 640k 44k|5.00 6.00 |3142 3710 |0.22 0.71 0.97|1.0 0 12| 0 0 | 0 2048M| 27 289 0 3 0 May 28 12:51:29 l75lg1-v1 dstat.sh[49771]: 28-05 12:51:29| 1 0 99 0 0|4540M 4191M 268M 6675M|2091k 37k| 0 576k| 0 112 |2628 3529 |0.22 0.71 0.97|1.0 0 0| 0 0 | 0 2048M| 27 289 0 3 0 May 28 12:51:29 l75lg1-v1 nova-conductor[83647]: DEBUG dbcounter [-] [83647] Writing DB stats nova_cell1:SELECT=2,nova_cell1:UPDATE=1 {{(pid=83647) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:51:29 l75lg1-v1 nova-conductor[83648]: DEBUG dbcounter [-] [83648] Writing DB stats nova_cell1:SELECT=1 {{(pid=83648) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:51:30 l75lg1-v1 dstat.sh[49771]: 28-05 12:51:30| 1 0 98 0 0|4540M 4188M 268M 6678M|2683k 47k| 0 352k| 0 39.0 |3337 4511 |0.22 0.71 0.97|1.0 0 0| 0 0 | 0 2048M| 27 289 0 3 0 May 28 12:51:30 l75lg1-v1 neutron-server[77618]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.HashRingHealthCheckPeriodics.touch_hash_ring_nodes' {{(pid=77618) _process_scheduled /opt/stack/data/venv/lib/python3.10/site-packages/futurist/periodics.py:638}} May 28 12:51:31 l75lg1-v1 dstat.sh[49771]: 28-05 12:51:31| 1 0 98 0 0|4540M 4185M 268M 6680M|3190k 55k| 0 196k| 0 26.0 |3789 4808 |0.22 0.71 0.97| 0 0 0| 0 0 | 0 2048M| 27 289 0 3 0 May 28 12:51:32 l75lg1-v1 dstat.sh[49771]: 28-05 12:51:32| 1 0 99 0 0|4540M 4181M 268M 6684M|3911k 59k| 0 20k| 0 2.00 |3495 4430 |0.20 0.70 0.96|1.0 0 0| 0 0 | 0 2048M| 27 289 0 3 0 May 28 12:51:33 l75lg1-v1 dstat.sh[49771]: 28-05 12:51:33| 1 1 97 1 0|4540M 4176M 268M 6689M|5024k 66k| 0 48M| 0 82.0 |3934 4974 |0.20 0.70 0.96| 0 0 0| 0 0 | 0 2048M| 27 289 0 3 0 May 28 12:51:33 l75lg1-v1 neutron-server[77623]: DEBUG dbcounter [-] [77623] Writing DB stats neutron:SELECT=1 {{(pid=77623) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:51:34 l75lg1-v1 dstat.sh[49771]: 28-05 12:51:34| 1 0 98 0 0|4542M 4170M 268M 6694M|5833k 64k| 0 332k| 0 67.1 |4093 4565 |0.20 0.70 0.96|1.0 0 0| 0 0 | 0 2048M| 27 289 0 3 0 May 28 12:51:35 l75lg1-v1 dstat.sh[49771]: 28-05 12:51:35| 1 0 98 0 0|4543M 4163M 268M 6699M|4886k 46k| 0 0 | 0 0 |3496 3520 |0.20 0.70 0.96| 0 0 0| 0 0 | 0 2048M| 27 289 0 3 0 May 28 12:51:36 l75lg1-v1 dstat.sh[49771]: 28-05 12:51:36| 1 0 98 0 0|4543M 4159M 268M 6703M|3791k 59k| 0 0 | 0 0 |3521 4493 |0.20 0.70 0.96| 0 0 0| 0 0 | 0 2048M| 27 289 0 3 0 May 28 12:51:37 l75lg1-v1 dstat.sh[49771]: 28-05 12:51:37| 1 0 98 0 0|4543M 4155M 268M 6706M|3952k 58k| 0 0 | 0 0 |3573 4323 |0.19 0.69 0.96|2.0 0 0| 0 0 | 0 2048M| 27 289 0 3 0 May 28 12:51:38 l75lg1-v1 dstat.sh[49771]: 28-05 12:51:38| 1 0 98 0 0|4543M 4151M 268M 6710M|4227k 60k| 0 8192B| 0 1.00 |3647 4420 |0.19 0.69 0.96| 0 0 2.0| 0 0 | 0 2048M| 27 289 0 3 0 May 28 12:51:39 l75lg1-v1 dstat.sh[49771]: 28-05 12:51:39| 1 0 98 0 0|4543M 4148M 268M 6713M|3369k 45k| 0 76k| 0 4.00 |3196 3445 |0.19 0.69 0.96| 0 0 0| 0 0 | 0 2048M| 27 289 0 3 0 May 28 12:51:39 l75lg1-v1 nova-conductor[83647]: DEBUG dbcounter [-] [83647] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=1 {{(pid=83647) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:51:39 l75lg1-v1 nova-conductor[83648]: DEBUG dbcounter [-] [83648] Writing DB stats nova_cell1:SELECT=1 {{(pid=83648) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:51:40 l75lg1-v1 dstat.sh[49771]: 28-05 12:51:40| 1 0 98 0 0|4543M 4145M 268M 6717M|3255k 57k| 0 464k| 0 68.0 |3972 4977 |0.19 0.69 0.96| 0 0 0| 0 0 | 0 2048M| 27 289 0 3 0 May 28 12:51:40 l75lg1-v1 neutron-server[77623]: DEBUG dbcounter [-] [77623] Writing DB stats neutron:DELETE=1 {{(pid=77623) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:51:40 l75lg1-v1 neutron-server[77618]: DEBUG dbcounter [-] [77618] Writing DB stats neutron:UPDATE=1,neutron:SELECT=1 {{(pid=77618) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:51:40 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:51:41 l75lg1-v1 dstat.sh[49771]: 28-05 12:51:41| 1 0 98 0 0|4543M 4142M 268M 6719M|3526k 57k| 0 124k| 0 17.0 |3759 4363 |0.19 0.69 0.96| 0 0 0| 0 0 | 0 2048M| 27 289 0 3 0 May 28 12:51:41 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:51:42 l75lg1-v1 dstat.sh[49771]: 28-05 12:51:42| 1 1 99 0 0|4543M 4140M 268M 6722M|1977k 26k| 0 0 | 0 0 |2674 2535 |0.17 0.68 0.95| 0 0 0| 0 0 | 0 2048M| 27 289 0 3 0 May 28 12:51:43 l75lg1-v1 dstat.sh[49771]: 28-05 12:51:43| 1 0 99 0 0|4543M 4139M 268M 6723M|1089k 19k| 0 0 | 0 0 |2025 2474 |0.17 0.68 0.95| 0 0 0| 0 0 | 0 2048M| 27 289 0 3 0 May 28 12:51:43 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:51:43 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.manager [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Starting heal instance info cache {{(pid=83654) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}} May 28 12:51:43 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.manager [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Rebuilding the list of instances to heal {{(pid=83654) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9930}} May 28 12:51:43 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Expecting reply to msg e9483768f943492bb3c1ee3677351f1d in queue reply_37f4cbd1dd094961a22b8a65f222c327 May 28 12:51:43 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [-] Received RPC response for msg e9483768f943492bb3c1ee3677351f1d May 28 12:51:44 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.manager [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Didn't find any instances for network info cache update. {{(pid=83654) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10012}} May 28 12:51:44 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:51:44 l75lg1-v1 dstat.sh[49771]: 28-05 12:51:44| 1 0 99 0 0|4543M 4138M 268M 6723M| 779k 15k| 0 12k| 0 2.00 |2139 2286 |0.17 0.68 0.95| 0 0 0| 0 0 | 0 2048M| 27 289 0 3 0 May 28 12:51:44 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:51:44 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:51:44 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.manager [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=83654) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10545}} May 28 12:51:45 l75lg1-v1 dstat.sh[49771]: 28-05 12:51:45| 1 0 99 0 0|4543M 4138M 268M 6724M| 517k 11k| 0 372k| 0 76.0 |1788 2443 |0.17 0.68 0.95| 0 0 0| 0 0 | 0 2048M| 27 289 0 3 0 May 28 12:51:45 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:51:45 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager.update_available_resource {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:51:45 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Expecting reply to msg 4e7fb5ec0b73437fbd289078ab37eef3 in queue reply_37f4cbd1dd094961a22b8a65f222c327 May 28 12:51:45 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [-] Received RPC response for msg 4e7fb5ec0b73437fbd289078ab37eef3 May 28 12:51:46 l75lg1-v1 nova-compute[83654]: DEBUG oslo_concurrency.lockutils [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=83654) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:51:46 l75lg1-v1 nova-compute[83654]: DEBUG oslo_concurrency.lockutils [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=83654) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:51:46 l75lg1-v1 nova-compute[83654]: DEBUG oslo_concurrency.lockutils [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=83654) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:51:46 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.resource_tracker [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Auditing locally available compute resources for l75lg1-v1 (node: l75lg1-v1) {{(pid=83654) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}} May 28 12:51:46 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.resource_tracker [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Hypervisor/Node resource view: name=l75lg1-v1 free_ram=11129MB free_disk=16.728580474853516GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_01_1", "address": "0000:00:01.1", "product_id": "7010", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7010", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7000", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7000", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "0100", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_0100", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_09_0", "address": "0000:00:09.0", "product_id": "1001", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1001", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "293a", "vendor_id": "8086", "numa_node": null, "label": "label_8086_293a", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_2", "address": "0000:00:07.2", "product_id": "2936", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2936", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "1237", "vendor_id": "8086", "numa_node": null, "label": "label_8086_1237", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "2935", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2935", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "2934", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2934", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_05_0", "address": "0000:00:05.0", "product_id": "1000", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1000", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "1000", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1000", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_06_0", "address": "0000:00:06.0", "product_id": "2668", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2668", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "1000", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1000", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0a_0", "address": "0000:00:0a.0", "product_id": "1002", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1002", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_3", "address": "0000:00:01.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_08_0", "address": "0000:00:08.0", "product_id": "1003", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1003", "dev_type": "type-PCI"}] {{(pid=83654) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}} May 28 12:51:46 l75lg1-v1 nova-compute[83654]: DEBUG oslo_concurrency.lockutils [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=83654) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:51:46 l75lg1-v1 nova-compute[83654]: DEBUG oslo_concurrency.lockutils [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=83654) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:51:46 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Expecting reply to msg 4d41e7ca1df44fbfacd5d09e3428c26c in queue reply_37f4cbd1dd094961a22b8a65f222c327 May 28 12:51:46 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [-] Received RPC response for msg 4d41e7ca1df44fbfacd5d09e3428c26c May 28 12:51:46 l75lg1-v1 dstat.sh[49771]: 28-05 12:51:46| 2 0 97 0 0|4543M 4137M 268M 6725M| 439k 8959B| 0 72k| 0 3.00 |2969 4687 |0.17 0.68 0.95|1.0 0 0| 0 0 | 0 2048M| 27 289 0 3 0 May 28 12:51:46 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Expecting reply to msg 4064fd12a44b4c88ac0142966995f4ad in queue reply_37f4cbd1dd094961a22b8a65f222c327 May 28 12:51:46 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [-] Received RPC response for msg 4064fd12a44b4c88ac0142966995f4ad May 28 12:51:47 l75lg1-v1 devstack@placement-api.service[78201]: DEBUG placement.requestlog [req-8486da95-40f5-44a0-9907-54bad351cce4 req-4423c3c8-b402-40ac-8dae-fe0912038921 None None] Starting request: 10.27.203.238 "GET /placement/resource_providers/ef90d7d1-0808-4a15-ad77-f9a7391af2f4/allocations" {{(pid=78201) __call__ /opt/stack/placement/placement/requestlog.py:55}} May 28 12:51:47 l75lg1-v1 devstack@placement-api.service[78201]: INFO placement.requestlog [req-8486da95-40f5-44a0-9907-54bad351cce4 req-4423c3c8-b402-40ac-8dae-fe0912038921 service placement] 10.27.203.238 "GET /placement/resource_providers/ef90d7d1-0808-4a15-ad77-f9a7391af2f4/allocations" status: 200 len: 54 microversion: 1.0 May 28 12:51:47 l75lg1-v1 devstack@placement-api.service[78201]: [pid: 78201|app: 0|req: 14/28] 10.27.203.238 () {62 vars in 1480 bytes} [Tue May 28 12:51:47 2024] GET /placement/resource_providers/ef90d7d1-0808-4a15-ad77-f9a7391af2f4/allocations => generated 54 bytes in 12 msecs (HTTP/1.1 200) 6 headers in 223 bytes (1 switches on core 0) May 28 12:51:47 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.resource_tracker [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Total usable vcpus: 10, total allocated vcpus: 0 {{(pid=83654) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}} May 28 12:51:47 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.resource_tracker [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Final resource view: name=l75lg1-v1 phys_ram=16000MB used_ram=512MB phys_disk=28GB used_disk=0GB total_vcpus=10 used_vcpus=0 pci_stats=[] {{(pid=83654) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}} May 28 12:51:47 l75lg1-v1 devstack@placement-api.service[78202]: DEBUG placement.requestlog [req-8486da95-40f5-44a0-9907-54bad351cce4 req-d95a0a59-99c4-4c4c-9e17-38c1f01e5e08 None None] Starting request: 10.27.203.238 "GET /placement/resource_providers/ef90d7d1-0808-4a15-ad77-f9a7391af2f4/allocations" {{(pid=78202) __call__ /opt/stack/placement/placement/requestlog.py:55}} May 28 12:51:47 l75lg1-v1 devstack@placement-api.service[78202]: INFO placement.requestlog [req-8486da95-40f5-44a0-9907-54bad351cce4 req-d95a0a59-99c4-4c4c-9e17-38c1f01e5e08 service placement] 10.27.203.238 "GET /placement/resource_providers/ef90d7d1-0808-4a15-ad77-f9a7391af2f4/allocations" status: 200 len: 54 microversion: 1.0 May 28 12:51:47 l75lg1-v1 devstack@placement-api.service[78202]: [pid: 78202|app: 0|req: 15/29] 10.27.203.238 () {62 vars in 1480 bytes} [Tue May 28 12:51:47 2024] GET /placement/resource_providers/ef90d7d1-0808-4a15-ad77-f9a7391af2f4/allocations => generated 54 bytes in 11 msecs (HTTP/1.1 200) 6 headers in 223 bytes (1 switches on core 0) May 28 12:51:47 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.provider_tree [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Inventory has not changed in ProviderTree for provider: ef90d7d1-0808-4a15-ad77-f9a7391af2f4 {{(pid=83654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} May 28 12:51:47 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Expecting reply to msg 6565958af061443594183f532ec0f872 in queue reply_37f4cbd1dd094961a22b8a65f222c327 May 28 12:51:47 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [-] Received RPC response for msg 6565958af061443594183f532ec0f872 May 28 12:51:47 l75lg1-v1 dstat.sh[49771]: 28-05 12:51:47| 1 0 98 0 0|4543M 4137M 268M 6725M| 402k 7934B| 0 160k| 0 1.00 |2022 2711 |0.16 0.66 0.95| 0 0 0| 0 0 | 0 2048M| 27 289 0 3 0 May 28 12:51:47 l75lg1-v1 nova-compute[83654]: DEBUG nova.scheduler.client.report [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Inventory has not changed for provider ef90d7d1-0808-4a15-ad77-f9a7391af2f4 based on inventory data: {'VCPU': {'total': 10, 'reserved': 0, 'min_unit': 1, 'max_unit': 10, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16000, 'reserved': 512, 'min_unit': 1, 'max_unit': 16000, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 28, 'reserved': 0, 'min_unit': 1, 'max_unit': 28, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=83654) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}} May 28 12:51:47 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.resource_tracker [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Compute_service record updated for l75lg1-v1:l75lg1-v1 {{(pid=83654) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}} May 28 12:51:47 l75lg1-v1 nova-compute[83654]: DEBUG oslo_concurrency.lockutils [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.557s {{(pid=83654) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:51:48 l75lg1-v1 dstat.sh[49771]: 28-05 12:51:48| 1 0 99 0 0|4543M 4136M 268M 6725M| 299k 5994B| 0 0 | 0 0 |1708 2344 |0.16 0.66 0.95| 0 0 2.0| 0 0 | 0 2048M| 27 289 0 3 0 May 28 12:51:48 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:51:49 l75lg1-v1 dstat.sh[49771]: 28-05 12:51:49| 1 0 99 0 0|4543M 4136M 268M 6726M| 256k 5156B| 0 20k| 0 1.00 |1474 2168 |0.16 0.66 0.95| 0 0 0| 0 0 | 0 2048M| 27 289 0 3 0 May 28 12:51:50 l75lg1-v1 dstat.sh[49771]: 28-05 12:51:50| 1 0 99 0 0|4543M 4136M 268M 6726M| 218k 4410B| 0 548k| 0 93.0 |1767 2740 |0.16 0.66 0.95| 0 0 0| 0 0 | 0 2048M| 27 289 0 3 0 May 28 12:51:51 l75lg1-v1 dstat.sh[49771]: 28-05 12:51:51| 0 0 99 0 0|4543M 4136M 268M 6726M| 201k 4188B| 0 4096B| 0 1.00 |1475 2207 |0.16 0.66 0.95| 0 0 0| 0 0 | 0 2048M| 27 289 0 3 0 May 28 12:51:52 l75lg1-v1 dstat.sh[49771]: 28-05 12:51:52| 0 0 99 0 0|4543M 4136M 268M 6726M| 179k 3900B| 0 188k| 0 14.0 |1490 2159 |0.14 0.65 0.94| 0 0 0| 0 0 | 0 2048M| 27 289 0 3 0 May 28 12:51:53 l75lg1-v1 dstat.sh[49771]: 28-05 12:51:53| 0 0 99 0 0|4543M 4135M 268M 6726M| 170k 2977B| 0 48k| 0 5.00 |1481 2133 |0.14 0.65 0.94|1.0 0 0| 0 0 | 0 2048M| 27 289 0 3 0 May 28 12:51:54 l75lg1-v1 dstat.sh[49771]: 28-05 12:51:54| 0 0 99 0 0|4543M 4135M 268M 6726M| 136k 2447B| 0 12k| 0 2.00 |1443 2112 |0.14 0.65 0.94| 0 0 0| 0 0 | 0 2048M| 27 289 0 3 0 May 28 12:51:55 l75lg1-v1 dstat.sh[49771]: 28-05 12:51:55| 0 0 99 0 0|4543M 4135M 268M 6726M| 122k 2124B| 0 0 | 0 0 |1415 2089 |0.14 0.65 0.94| 0 0 0| 0 0 | 0 2048M| 27 289 0 3 0 May 28 12:51:55 l75lg1-v1 nova-conductor[83648]: DEBUG dbcounter [-] [83648] Writing DB stats nova_cell1:SELECT=1 {{(pid=83648) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:51:56 l75lg1-v1 dstat.sh[49771]: 28-05 12:51:56| 1 0 99 0 0|4543M 4135M 268M 6727M| 108k 2252B| 0 216k| 0 33.0 |1401 2064 |0.14 0.65 0.94| 0 0 0| 0 0 | 0 2048M| 27 289 0 3 0 May 28 12:51:57 l75lg1-v1 devstack@placement-api.service[78201]: DEBUG dbcounter [-] [78201] Writing DB stats placement:SELECT=2 {{(pid=78201) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:51:57 l75lg1-v1 devstack@placement-api.service[78202]: DEBUG dbcounter [-] [78202] Writing DB stats placement:SELECT=2 {{(pid=78202) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:51:57 l75lg1-v1 dstat.sh[49771]: 28-05 12:51:57| 0 0 99 0 0|4543M 4135M 268M 6727M| 147k 2112B| 0 68k| 0 9.00 |1603 2369 |0.13 0.64 0.94| 0 0 0| 0 0 | 0 2048M| 27 289 0 3 0 May 28 12:51:58 l75lg1-v1 dstat.sh[49771]: 28-05 12:51:58| 1 0 98 0 0|4543M 4135M 268M 6727M| 152k 2706B| 0 42M| 0 62.0 |1544 2163 |0.13 0.64 0.94| 0 0 2.0| 0 0 | 0 2048M| 27 289 0 3 0 May 28 12:51:58 l75lg1-v1 neutron-server[77623]: DEBUG dbcounter [-] [77623] Writing DB stats neutron:SELECT=1 {{(pid=77623) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:51:58 l75lg1-v1 neutron-server[77623]: DEBUG dbcounter [-] [77623] Writing DB stats neutron:SELECT=2 {{(pid=77623) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:51:59 l75lg1-v1 dstat.sh[49771]: 28-05 12:51:59| 0 0 98 1 0|4543M 4134M 268M 6727M| 177k 3232B| 0 76k| 0 8.00 |1474 2119 |0.13 0.64 0.94|1.0 0 0| 0 0 | 0 2048M| 27 289 0 3 0 May 28 12:51:59 l75lg1-v1 nova-conductor[83647]: DEBUG dbcounter [-] [83647] Writing DB stats nova_cell1:SELECT=3,nova_cell1:UPDATE=1 {{(pid=83647) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:51:59 l75lg1-v1 nova-conductor[83647]: DEBUG dbcounter [-] [83647] Writing DB stats nova_cell1:SELECT=2,nova_cell1:UPDATE=1 {{(pid=83647) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:51:59 l75lg1-v1 nova-conductor[83648]: DEBUG dbcounter [-] [83648] Writing DB stats nova_cell1:SELECT=3 {{(pid=83648) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:52:00 l75lg1-v1 dstat.sh[49771]: 28-05 12:52:00| 1 0 98 1 0|4543M 4134M 268M 6727M| 190k 3804B| 0 396k| 0 54.0 |1900 2908 |0.13 0.64 0.94| 0 0 0| 0 0 | 0 2048M| 27 289 0 3 0 May 28 12:52:00 l75lg1-v1 neutron-server[77618]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.HashRingHealthCheckPeriodics.touch_hash_ring_nodes' {{(pid=77618) _process_scheduled /opt/stack/data/venv/lib/python3.10/site-packages/futurist/periodics.py:638}} May 28 12:52:00 l75lg1-v1 neutron-server[77623]: DEBUG neutron.db.agents_db [None req-fe40ce8c-640e-4db7-a17a-6e8888cce266 None None] Agent healthcheck: found 0 active agents {{(pid=77623) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:319}} May 28 12:52:01 l75lg1-v1 dstat.sh[49771]: 28-05 12:52:01| 1 0 99 0 0|4543M 4134M 268M 6727M| 221k 4026B| 0 488k| 0 94.0 |1856 2699 |0.13 0.64 0.94| 0 0 0| 0 0 | 0 2048M| 27 289 0 3 0 May 28 12:52:02 l75lg1-v1 dstat.sh[49771]: 28-05 12:52:02| 0 0 99 0 0|4543M 4133M 268M 6728M| 315k 5522B| 0 0 | 0 0 |1508 2163 |0.12 0.63 0.93| 0 0 0| 0 0 | 0 2048M| 27 289 0 3 0 May 28 12:52:03 l75lg1-v1 dstat.sh[49771]: 28-05 12:52:03| 1 0 99 0 0|4543M 4133M 268M 6728M| 521k 9569B| 0 188k| 0 14.0 |1705 2397 |0.12 0.63 0.93| 0 0 0| 0 0 | 0 2048M| 27 289 0 3 0 May 28 12:52:04 l75lg1-v1 dstat.sh[49771]: 28-05 12:52:04| 1 0 99 0 0|4543M 4132M 268M 6729M| 765k 13k| 0 36k| 0 5.00 |1789 2418 |0.12 0.63 0.93| 0 0 0| 0 0 | 0 2048M| 27 289 0 3 0 May 28 12:52:05 l75lg1-v1 dstat.sh[49771]: 28-05 12:52:05| 1 0 99 0 0|4543M 4131M 268M 6730M|1137k 19k| 0 8195B| 0 1.00 |1961 2642 |0.12 0.63 0.93|1.0 0 0| 0 0 | 0 2048M| 27 289 0 3 0 May 28 12:52:06 l75lg1-v1 dstat.sh[49771]: 28-05 12:52:06| 0 0 99 0 0|4543M 4129M 268M 6731M|1657k 28k| 0 0 | 0 0 |2309 3115 |0.12 0.63 0.93| 0 0 0| 0 0 | 0 2048M| 27 289 0 3 0 May 28 12:52:07 l75lg1-v1 dstat.sh[49771]: 28-05 12:52:07| 1 0 99 0 0|4543M 4127M 268M 6733M|2270k 36k| 0 140k| 0 30.0 |2671 3285 |0.11 0.62 0.93| 0 0 0| 0 0 | 0 2048M| 27 289 0 3 0 May 28 12:52:08 l75lg1-v1 dstat.sh[49771]: 28-05 12:52:08| 1 1 98 0 0|4544M 4123M 268M 6736M|3367k 51k| 0 0 | 0 0 |3163 3588 |0.11 0.62 0.93| 0 0 2.0| 0 0 | 0 2048M| 27 289 0 3 0 May 28 12:52:09 l75lg1-v1 dstat.sh[49771]: 28-05 12:52:09| 1 1 99 0 0|4544M 4120M 268M 6740M|3969k 51k| 0 64k| 0 4.00 |3081 3639 |0.11 0.62 0.93| 0 0 0| 0 0 | 0 2048M| 27 289 0 3 0 May 28 12:52:09 l75lg1-v1 nova-conductor[83648]: DEBUG dbcounter [-] [83648] Writing DB stats nova_cell1:SELECT=1 {{(pid=83648) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:52:10 l75lg1-v1 dstat.sh[49771]: 28-05 12:52:10| 1 1 98 0 0|4545M 4114M 268M 6746M|5451k 63k| 0 280k| 0 33.0 |4058 4742 |0.11 0.62 0.93| 0 0 0| 0 0 | 0 2048M| 27 289 0 3 0 May 28 12:52:10 l75lg1-v1 neutron-server[77618]: DEBUG dbcounter [-] [77618] Writing DB stats neutron:UPDATE=1 {{(pid=77618) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:52:10 l75lg1-v1 neutron-server[77618]: DEBUG dbcounter [-] [77618] Writing DB stats neutron:SELECT=1 {{(pid=77618) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:52:10 l75lg1-v1 neutron-server[77623]: DEBUG dbcounter [-] [77623] Writing DB stats neutron:SELECT=1 {{(pid=77623) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:52:11 l75lg1-v1 dstat.sh[49771]: 28-05 12:52:11| 1 0 98 0 0|4548M 4104M 268M 6752M|6868k 73k| 0 160k| 0 18.0 |4562 4936 |0.11 0.62 0.93| 0 0 0| 0 0 | 0 2048M| 27 289 0 3 0 May 28 12:52:12 l75lg1-v1 dstat.sh[49771]: 28-05 12:52:12| 1 1 98 0 0|4549M 4095M 268M 6760M|8199k 79k| 0 276k| 0 57.0 |4524 5168 |0.10 0.61 0.92| 0 0 0| 0 0 | 0 2048M| 27 289 0 3 0 May 28 12:52:13 l75lg1-v1 dstat.sh[49771]: 28-05 12:52:13| 1 0 98 0 0|4548M 4088M 268M 6767M|7173k 65k| 0 0 | 0 0 |3900 3757 |0.10 0.61 0.92| 0 0 0| 0 0 | 0 2048M| 27 289 0 3 0 May 28 12:52:14 l75lg1-v1 dstat.sh[49771]: 28-05 12:52:14| 1 1 98 0 0|4551M 4079M 268M 6773M|8193k 71k| 0 0 | 0 0 |4146 4565 |0.10 0.61 0.92| 0 0 0| 0 0 | 0 2048M| 27 289 0 3 0 May 28 12:52:15 l75lg1-v1 dstat.sh[49771]: 28-05 12:52:15| 1 0 98 0 0|4551M 4072M 268M 6780M|5685k 60k| 0 4098B| 0 1.00 |3615 4220 |0.10 0.61 0.92|1.0 0 0| 0 0 | 0 2048M| 27 289 0 3 0 May 28 12:52:16 l75lg1-v1 dstat.sh[49771]: 28-05 12:52:16| 0 1 99 0 0|4551M 4067M 268M 6785M|4804k 47k| 0 40k| 0 3.00 |3297 3621 |0.10 0.61 0.92| 0 0 0| 0 0 | 0 2048M| 27 289 0 3 0 May 28 12:52:17 l75lg1-v1 dstat.sh[49771]: 28-05 12:52:17| 1 0 99 0 0|4548M 4065M 268M 6789M|4769k 63k| 0 4096B| 0 1.00 |4521 4163 |0.09 0.60 0.92| 0 0 0| 0 0 | 0 2048M| 27 289 0 3 0 May 28 12:52:18 l75lg1-v1 dstat.sh[49771]: 28-05 12:52:18| 1 0 98 0 0|4550M 4059M 268M 6794M|4679k 60k| 0 140k| 0 29.0 |4825 4498 |0.09 0.60 0.92| 0 0 2.0| 0 0 | 0 2048M| 27 289 0 3 0 May 28 12:52:19 l75lg1-v1 dstat.sh[49771]: 28-05 12:52:19| 1 1 98 0 0|4551M 4053M 268M 6799M|5282k 61k| 0 0 | 0 0 |4879 4564 |0.09 0.60 0.92|1.0 0 0| 0 0 | 0 2048M| 27 289 0 3 0 May 28 12:52:19 l75lg1-v1 nova-conductor[83647]: DEBUG dbcounter [-] [83647] Writing DB stats nova_cell1:SELECT=2,nova_cell1:UPDATE=2 {{(pid=83647) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:52:19 l75lg1-v1 nova-conductor[83648]: DEBUG dbcounter [-] [83648] Writing DB stats nova_cell1:SELECT=1 {{(pid=83648) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:52:20 l75lg1-v1 dstat.sh[49771]: 28-05 12:52:20| 1 0 98 0 0|4555M 4044M 268M 6803M|4978k 62k| 0 320k| 0 39.0 |5267 5147 |0.09 0.60 0.92|1.0 0 0| 0 0 | 0 2048M| 27 289 0 3 0 May 28 12:52:21 l75lg1-v1 dstat.sh[49771]: 28-05 12:52:21| 1 1 98 0 0|4555M 4038M 268M 6808M|5294k 63k| 0 100k| 0 8.00 |5119 4944 |0.09 0.60 0.92| 0 0 0| 0 0 | 0 2048M| 27 289 0 3 0 May 28 12:52:22 l75lg1-v1 dstat.sh[49771]: 28-05 12:52:22| 0 0 98 0 0|4555M 4033M 268M 6814M|5332k 65k| 0 0 | 0 0 |4283 4905 |0.09 0.59 0.91|1.0 0 0| 0 0 | 0 2048M| 27 289 0 3 0 May 28 12:52:23 l75lg1-v1 dstat.sh[49771]: 28-05 12:52:23| 1 0 98 0 0|4555M 4028M 268M 6818M|4954k 61k| 0 204k| 0 43.0 |4003 4627 |0.09 0.59 0.91|1.0 0 0| 0 0 | 0 2048M| 27 289 0 3 0 May 28 12:52:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "_check_child_processes" by "neutron.agent.linux.external_process.ProcessMonitor._check_child_processes" {{(pid=76818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:52:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_concurrency.lockutils [-] Lock "_check_child_processes" acquired by "neutron.agent.linux.external_process.ProcessMonitor._check_child_processes" :: waited 0.000s {{(pid=76818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:52:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_concurrency.lockutils [-] Lock "_check_child_processes" "released" by "neutron.agent.linux.external_process.ProcessMonitor._check_child_processes" :: held 0.000s {{(pid=76818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:52:24 l75lg1-v1 dstat.sh[49771]: 28-05 12:52:24| 1 1 98 0 0|4555M 4023M 268M 6823M|5433k 67k| 0 24M| 0 37.0 |4937 4899 |0.09 0.59 0.91|1.0 0 0| 0 0 | 0 2048M| 27 289 0 3 0 May 28 12:52:25 l75lg1-v1 dstat.sh[49771]: 28-05 12:52:25| 2 1 96 0 0|4547M 4027M 268M 6828M|5256k 64k| 0 0 | 0 0 |6326 6860 |0.09 0.59 0.91| 0 0 46| 0 0 | 0 2048M| 27 289 0 4 0 May 28 12:52:25 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_service.periodic_task [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85846) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:52:25 l75lg1-v1 cinder-volume[85846]: DEBUG cinder.volume.drivers.lvm [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] Updating volume stats {{(pid=85846) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}} May 28 12:52:25 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:390}} May 28 12:52:25 l75lg1-v1 sudo[88728]: vastdata : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 May 28 12:52:25 l75lg1-v1 sudo[88728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) May 28 12:52:26 l75lg1-v1 sudo[88728]: pam_unix(sudo:session): session closed for user root May 28 12:52:26 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.459s {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:428}} May 28 12:52:26 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:390}} May 28 12:52:26 l75lg1-v1 sudo[88731]: vastdata : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 May 28 12:52:26 l75lg1-v1 sudo[88731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) May 28 12:52:26 l75lg1-v1 dstat.sh[49771]: 28-05 12:52:26| 6 1 93 0 0|4550M 4018M 268M 6833M|5185k 63k| 256k 48k|2.00 3.00 |4320 4977 |0.09 0.59 0.91|1.0 0 5.0| 0 0 | 0 2048M| 27 289 0 3 0 May 28 12:52:26 l75lg1-v1 sudo[88731]: pam_unix(sudo:session): session closed for user root May 28 12:52:26 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.470s {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:428}} May 28 12:52:26 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:390}} May 28 12:52:26 l75lg1-v1 sudo[88734]: vastdata : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool May 28 12:52:26 l75lg1-v1 sudo[88734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) May 28 12:52:27 l75lg1-v1 sudo[88734]: pam_unix(sudo:session): session closed for user root May 28 12:52:27 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.462s {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:428}} May 28 12:52:27 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:390}} May 28 12:52:27 l75lg1-v1 sudo[88737]: vastdata : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 May 28 12:52:27 l75lg1-v1 sudo[88737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) May 28 12:52:27 l75lg1-v1 dstat.sh[49771]: 28-05 12:52:27| 8 2 89 0 0|4546M 4016M 268M 6839M|5748k 68k| 640k 4095B|5.00 1.00 |4594 5537 |0.16 0.60 0.91|2.0 0 6.0| 0 0 | 0 2048M| 27 289 0 3 0 May 28 12:52:27 l75lg1-v1 sudo[88737]: pam_unix(sudo:session): session closed for user root May 28 12:52:27 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.453s {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:428}} May 28 12:52:27 l75lg1-v1 cinder-volume[85846]: DEBUG cinder.manager [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] Notifying Schedulers of capabilities ... {{(pid=85846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 28 12:52:27 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.scheduler.host_manager [None req-1d245e07-2b10-41b6-9651-42cf780abd87 None None] Received volume service update from l75lg1-v1@lvmdriver-1: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:l75lg1-v1:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up', 'allocated_capacity_gb': 0, 'cacheable': True}], 'shared_targets': False, 'sparse_copy_volume': True, 'filter_function': None, 'goodness_function': None} {{(pid=85128) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:628}} May 28 12:52:28 l75lg1-v1 dstat.sh[49771]: 28-05 12:52:28| 3 1 95 0 0|4539M 4018M 268M 6844M|5581k 66k| 256k 0 |2.00 0 |4259 5140 |0.16 0.60 0.91| 0 0 9.0| 0 0 | 0 2048M| 27 289 0 3 0 May 28 12:52:29 l75lg1-v1 dstat.sh[49771]: 28-05 12:52:29| 1 1 98 1 0|4543M 4009M 268M 6848M|4407k 34k| 0 94M| 0 209 |3480 2557 |0.16 0.60 0.91|1.0 0 0| 0 0 | 0 2048M| 27 289 0 3 0 May 28 12:52:29 l75lg1-v1 nova-conductor[83647]: DEBUG dbcounter [-] [83647] Writing DB stats nova_cell1:SELECT=1,nova_cell1:UPDATE=1 {{(pid=83647) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:52:30 l75lg1-v1 dstat.sh[49771]: 28-05 12:52:30| 1 0 96 2 0|4543M 4007M 268M 6850M|2244k 39k| 0 328k| 0 34.0 |4032 4370 |0.16 0.60 0.91| 0 0 0| 0 0 | 0 2048M| 27 289 0 3 0 May 28 12:52:30 l75lg1-v1 neutron-server[77618]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.HashRingHealthCheckPeriodics.touch_hash_ring_nodes' {{(pid=77618) _process_scheduled /opt/stack/data/venv/lib/python3.10/site-packages/futurist/periodics.py:638}} May 28 12:52:31 l75lg1-v1 dstat.sh[49771]: 28-05 12:52:31| 1 0 98 0 0|4544M 4005M 268M 6852M|2244k 41k| 0 92k| 0 16.0 |4258 4382 |0.16 0.60 0.91|2.0 0 0| 0 0 | 0 2048M| 27 289 0 3 0 May 28 12:52:32 l75lg1-v1 dstat.sh[49771]: 28-05 12:52:32| 1 0 98 0 0|4544M 4002M 268M 6855M|2588k 48k| 0 124k| 0 16.0 |3512 4387 |0.15 0.59 0.91| 0 0 0| 0 0 | 0 2048M| 27 289 0 3 0 May 28 12:52:33 l75lg1-v1 dstat.sh[49771]: 28-05 12:52:33| 0 0 98 0 0|4545M 3998M 268M 6857M|2484k 46k| 0 436k| 0 34.0 |3875 4130 |0.15 0.59 0.91| 0 0 0| 0 0 | 0 2048M| 27 289 0 3 0 May 28 12:52:34 l75lg1-v1 dstat.sh[49771]: 28-05 12:52:34| 1 0 98 0 0|4546M 3995M 268M 6860M|2503k 46k| 0 312k| 0 56.0 |3697 4141 |0.15 0.59 0.91|1.0 0 0| 0 0 | 0 2048M| 27 289 0 3 0 May 28 12:52:35 l75lg1-v1 dstat.sh[49771]: 28-05 12:52:35| 1 0 99 0 0|4546M 3993M 268M 6862M|2116k 31k| 0 4100B| 0 1.00 |3228 3042 |0.15 0.59 0.91| 0 0 0| 0 0 | 0 2048M| 27 289 0 3 0 May 28 12:52:35 l75lg1-v1 neutron-server[77623]: DEBUG dbcounter [-] [77623] Writing DB stats neutron:SELECT=2 {{(pid=77623) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:52:35 l75lg1-v1 neutron-server[77623]: DEBUG dbcounter [-] [77623] Writing DB stats neutron:SELECT=1 {{(pid=77623) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:52:36 l75lg1-v1 dstat.sh[49771]: 28-05 12:52:36| 1 0 98 0 0|4546M 3991M 268M 6863M|2048k 37k| 0 60k| 0 8.00 |3683 3831 |0.15 0.59 0.91|1.0 0 0| 0 0 | 0 2048M| 27 289 0 3 0 May 28 12:52:37 l75lg1-v1 dstat.sh[49771]: 28-05 12:52:37| 1 0 99 0 0|4546M 3989M 268M 6866M|2384k 43k| 0 0 | 0 0 |3824 3800 |0.13 0.58 0.90|1.0 0 0| 0 0 | 0 2048M| 27 289 0 3 0 May 28 12:52:37 l75lg1-v1 neutron-server[77623]: DEBUG neutron.db.agents_db [None req-fe40ce8c-640e-4db7-a17a-6e8888cce266 None None] Agent healthcheck: found 0 active agents {{(pid=77623) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:319}} May 28 12:52:38 l75lg1-v1 dstat.sh[49771]: 28-05 12:52:38| 1 1 97 0 0|4547M 3986M 268M 6868M|2267k 44k| 0 100k| 0 16.0 |3399 4395 |0.13 0.58 0.90|2.0 0 36| 0 0 | 0 2048M| 27 288 0 3 1 May 28 12:52:39 l75lg1-v1 dstat.sh[49771]: 28-05 12:52:39| 8 2 89 0 0|4591M 3942M 268M 6868M| 12k 7858B| 0 8195B| 0 2.00 |2147 2751 |0.13 0.58 0.90|1.0 0 86| 0 0 | 0 2048M| 27 288 0 3 0 May 28 12:52:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ce2718-ef99-4b1d-8ff1-b84a1bf81473 None None] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:52:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ce2718-ef99-4b1d-8ff1-b84a1bf81473 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:52:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ce2718-ef99-4b1d-8ff1-b84a1bf81473 None None] PATH_INFO: `/` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:52:39 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 531/1075] 10.27.203.238 () {58 vars in 1014 bytes} [Tue May 28 12:52:39 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:52:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2884fa-8aca-43da-b45c-f6e56a4f2c71 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:52:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2884fa-8aca-43da-b45c-f6e56a4f2c71 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:52:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2884fa-8aca-43da-b45c-f6e56a4f2c71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:52:39 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-8d2884fa-8aca-43da-b45c-f6e56a4f2c71 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:52:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-8d2884fa-8aca-43da-b45c-f6e56a4f2c71 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:52:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-8d2884fa-8aca-43da-b45c-f6e56a4f2c71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:52:39 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 545/1076] 10.27.203.238 () {62 vars in 1111 bytes} [Tue May 28 12:52:39 2024] POST /identity/v3/auth/tokens => generated 3991 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:52:39 l75lg1-v1 nova-conductor[83648]: DEBUG dbcounter [-] [83648] Writing DB stats nova_cell1:SELECT=2,nova_cell1:UPDATE=1 {{(pid=83648) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:52:39 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.api.middleware.version_negotiation [None req-f52a0db2-5bc1-468f-ab7f-e64deaa5c901 admin admin] Determining version of request: GET / Accept: application/json {{(pid=86373) process_request /opt/stack/glance/glance/api/middleware/version_negotiation.py:44}} May 28 12:52:39 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.api.middleware.version_negotiation [None req-f52a0db2-5bc1-468f-ab7f-e64deaa5c901 admin admin] Using url versioning {{(pid=86373) process_request /opt/stack/glance/glance/api/middleware/version_negotiation.py:57}} May 28 12:52:39 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.api.middleware.version_negotiation [None req-f52a0db2-5bc1-468f-ab7f-e64deaa5c901 admin admin] Unknown version. Returning version choices. {{(pid=86373) process_request /opt/stack/glance/glance/api/middleware/version_negotiation.py:64}} May 28 12:52:39 l75lg1-v1 devstack@g-api.service[86373]: [pid: 86373|app: 0|req: 3/7] 127.0.0.1 () {34 vars in 509 bytes} [Tue May 28 12:52:39 2024] GET / => generated 1323 bytes in 2 msecs (HTTP/1.1 300) 3 headers in 106 bytes (1 switches on core 0) May 28 12:52:39 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.api.middleware.version_negotiation [None req-0ed9bfe4-09fa-48a7-8c77-140c47f654ba admin admin] Determining version of request: POST /v2/images Accept: */* {{(pid=86374) process_request /opt/stack/glance/glance/api/middleware/version_negotiation.py:44}} May 28 12:52:39 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.api.middleware.version_negotiation [None req-0ed9bfe4-09fa-48a7-8c77-140c47f654ba admin admin] Using url versioning {{(pid=86374) process_request /opt/stack/glance/glance/api/middleware/version_negotiation.py:57}} May 28 12:52:39 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.api.middleware.version_negotiation [None req-0ed9bfe4-09fa-48a7-8c77-140c47f654ba admin admin] Matched version: v2 {{(pid=86374) process_request /opt/stack/glance/glance/api/middleware/version_negotiation.py:69}} May 28 12:52:39 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.api.middleware.version_negotiation [None req-0ed9bfe4-09fa-48a7-8c77-140c47f654ba admin admin] new path /v2/images {{(pid=86374) process_request /opt/stack/glance/glance/api/middleware/version_negotiation.py:70}} May 28 12:52:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ce2718-ef99-4b1d-8ff1-b84a1bf81473 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:52:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ce2718-ef99-4b1d-8ff1-b84a1bf81473 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:52:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f9c13f-fd54-4f78-bea0-1813ee8599cc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1436e60c2e34e0b8af9ae1c668bdf03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:52:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f9c13f-fd54-4f78-bea0-1813ee8599cc service glance] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:52:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f9c13f-fd54-4f78-bea0-1813ee8599cc service glance] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:52:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f9c13f-fd54-4f78-bea0-1813ee8599cc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:52:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f9c13f-fd54-4f78-bea0-1813ee8599cc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:52:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f9c13f-fd54-4f78-bea0-1813ee8599cc service glance] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:52:39 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 532/1077] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 12:52:39 2024] GET /identity/v3/auth/tokens => generated 3991 bytes in 20 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 12:52:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2884fa-8aca-43da-b45c-f6e56a4f2c71 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:52:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2884fa-8aca-43da-b45c-f6e56a4f2c71 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:52:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be41b1a3-3d81-4261-b1ad-a5a68a976835 None glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1436e60c2e34e0b8af9ae1c668bdf03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:52:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be41b1a3-3d81-4261-b1ad-a5a68a976835 None glance] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:52:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be41b1a3-3d81-4261-b1ad-a5a68a976835 None glance] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:52:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be41b1a3-3d81-4261-b1ad-a5a68a976835 None glance] PATH_INFO: `/v3/limits/model` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:52:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be41b1a3-3d81-4261-b1ad-a5a68a976835 None glance] RBAC: Authorizing `identity:get_limit_model()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:52:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be41b1a3-3d81-4261-b1ad-a5a68a976835 None glance] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:52:39 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 546/1078] 10.27.203.238 () {60 vars in 1217 bytes} [Tue May 28 12:52:39 2024] GET /identity/v3/limits/model => generated 131 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:52:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f9c13f-fd54-4f78-bea0-1813ee8599cc service glance] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:52:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f9c13f-fd54-4f78-bea0-1813ee8599cc service glance] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:52:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ef9b4e-4120-47ce-b14d-7ccd8f584a0c None glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1436e60c2e34e0b8af9ae1c668bdf03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:52:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ef9b4e-4120-47ce-b14d-7ccd8f584a0c None glance] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:52:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ef9b4e-4120-47ce-b14d-7ccd8f584a0c None glance] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:52:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ef9b4e-4120-47ce-b14d-7ccd8f584a0c None glance] PATH_INFO: `/v3/endpoints/13c57d94d28f4be896335eeb1e8b02ca` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:52:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ef9b4e-4120-47ce-b14d-7ccd8f584a0c None glance] RBAC: Authorizing `identity:get_endpoint(endpoint_id=13c57d94d28f4be896335eeb1e8b02ca)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:52:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ef9b4e-4120-47ce-b14d-7ccd8f584a0c None glance] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:52:40 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 533/1079] 10.27.203.238 () {60 vars in 1307 bytes} [Tue May 28 12:52:39 2024] GET /identity/v3/endpoints/13c57d94d28f4be896335eeb1e8b02ca => generated 331 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:52:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be41b1a3-3d81-4261-b1ad-a5a68a976835 None glance] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:52:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be41b1a3-3d81-4261-b1ad-a5a68a976835 None glance] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:52:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35ad7cb-1fc2-499b-af8a-672372b8d022 None glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1436e60c2e34e0b8af9ae1c668bdf03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:52:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35ad7cb-1fc2-499b-af8a-672372b8d022 None glance] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:52:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35ad7cb-1fc2-499b-af8a-672372b8d022 None glance] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:52:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35ad7cb-1fc2-499b-af8a-672372b8d022 None glance] PATH_INFO: `/v3/limits` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:52:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35ad7cb-1fc2-499b-af8a-672372b8d022 None glance] RBAC: Adding query filter params (service_id=b5d296eb68964f14a9e57eb9d15e174d, region_id=RegionOne, resource_name=image_count_total, project_id=ea8d517cde1d40bb82c97e080ce071f7) {{(pid=51267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:52:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35ad7cb-1fc2-499b-af8a-672372b8d022 None glance] RBAC: Authorizing `identity:list_limits()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:52:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35ad7cb-1fc2-499b-af8a-672372b8d022 None glance] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:52:40 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 547/1080] 10.27.203.238 () {60 vars in 1491 bytes} [Tue May 28 12:52:40 2024] GET /identity/v3/limits?service_id=b5d296eb68964f14a9e57eb9d15e174d®ion_id=RegionOne&resource_name=image_count_total&project_id=ea8d517cde1d40bb82c97e080ce071f7 => generated 249 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:52:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ef9b4e-4120-47ce-b14d-7ccd8f584a0c None glance] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:52:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ef9b4e-4120-47ce-b14d-7ccd8f584a0c None glance] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:52:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51915f68-c493-415c-ab9f-256f38e065f6 None glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1436e60c2e34e0b8af9ae1c668bdf03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:52:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51915f68-c493-415c-ab9f-256f38e065f6 None glance] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:52:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51915f68-c493-415c-ab9f-256f38e065f6 None glance] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:52:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51915f68-c493-415c-ab9f-256f38e065f6 None glance] PATH_INFO: `/v3/registered_limits` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:52:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51915f68-c493-415c-ab9f-256f38e065f6 None glance] RBAC: Adding query filter params (service_id=b5d296eb68964f14a9e57eb9d15e174d, region_id=RegionOne, resource_name=image_count_total) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:52:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51915f68-c493-415c-ab9f-256f38e065f6 None glance] RBAC: Authorizing `identity:list_registered_limits()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:52:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51915f68-c493-415c-ab9f-256f38e065f6 None glance] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:52:40 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 534/1081] 10.27.203.238 () {60 vars in 1436 bytes} [Tue May 28 12:52:40 2024] GET /identity/v3/registered_limits?service_id=b5d296eb68964f14a9e57eb9d15e174d®ion_id=RegionOne&resource_name=image_count_total => generated 532 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:52:40 l75lg1-v1 dstat.sh[49771]: 28-05 12:52:40| 10 1 88 0 0|4606M 3926M 268M 6868M| 10k 0 | 0 480k| 0 89.0 |3047 5315 |0.13 0.58 0.90| 0 0 2.0| 0 0 | 0 2048M| 27 294 0 5 0 May 28 12:52:40 l75lg1-v1 devstack@g-api.service[86374]: [pid: 86374|app: 0|req: 5/8] 127.0.0.1 () {40 vars in 772 bytes} [Tue May 28 12:52:39 2024] POST /v2/images => generated 813 bytes in 396 msecs (HTTP/1.1 201) 6 headers in 314 bytes (1 switches on core 0) May 28 12:52:40 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.api.middleware.version_negotiation [None req-f52a0db2-5bc1-468f-ab7f-e64deaa5c901 admin admin] Determining version of request: PUT /v2/images/31e1897d-0863-48df-80d6-721d2c2d3179/file Accept: {{(pid=86373) process_request /opt/stack/glance/glance/api/middleware/version_negotiation.py:44}} May 28 12:52:40 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.api.middleware.version_negotiation [None req-f52a0db2-5bc1-468f-ab7f-e64deaa5c901 admin admin] Using url versioning {{(pid=86373) process_request /opt/stack/glance/glance/api/middleware/version_negotiation.py:57}} May 28 12:52:40 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.api.middleware.version_negotiation [None req-f52a0db2-5bc1-468f-ab7f-e64deaa5c901 admin admin] Matched version: v2 {{(pid=86373) process_request /opt/stack/glance/glance/api/middleware/version_negotiation.py:69}} May 28 12:52:40 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.api.middleware.version_negotiation [None req-f52a0db2-5bc1-468f-ab7f-e64deaa5c901 admin admin] new path /v2/images/31e1897d-0863-48df-80d6-721d2c2d3179/file {{(pid=86373) process_request /opt/stack/glance/glance/api/middleware/version_negotiation.py:70}} May 28 12:52:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35ad7cb-1fc2-499b-af8a-672372b8d022 None glance] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:52:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35ad7cb-1fc2-499b-af8a-672372b8d022 None glance] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:52:40 l75lg1-v1 neutron-server[77618]: DEBUG dbcounter [-] [77618] Writing DB stats neutron:UPDATE=1 {{(pid=77618) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:52:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0f07c1-fc2b-4222-a14f-abb738a6ad7a None glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1436e60c2e34e0b8af9ae1c668bdf03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:52:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0f07c1-fc2b-4222-a14f-abb738a6ad7a None glance] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:52:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0f07c1-fc2b-4222-a14f-abb738a6ad7a None glance] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:52:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0f07c1-fc2b-4222-a14f-abb738a6ad7a None glance] PATH_INFO: `/v3/limits/model` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:52:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0f07c1-fc2b-4222-a14f-abb738a6ad7a None glance] RBAC: Authorizing `identity:get_limit_model()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:52:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0f07c1-fc2b-4222-a14f-abb738a6ad7a None glance] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:52:40 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 548/1082] 10.27.203.238 () {60 vars in 1217 bytes} [Tue May 28 12:52:40 2024] GET /identity/v3/limits/model => generated 131 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:52:40 l75lg1-v1 neutron-server[77618]: DEBUG dbcounter [-] [77618] Writing DB stats neutron:SELECT=1 {{(pid=77618) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:52:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51915f68-c493-415c-ab9f-256f38e065f6 None glance] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:52:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51915f68-c493-415c-ab9f-256f38e065f6 None glance] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:52:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16791ac4-c295-46e8-95b3-dbfb0ccbc5ea None glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1436e60c2e34e0b8af9ae1c668bdf03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:52:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16791ac4-c295-46e8-95b3-dbfb0ccbc5ea None glance] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:52:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16791ac4-c295-46e8-95b3-dbfb0ccbc5ea None glance] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:52:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16791ac4-c295-46e8-95b3-dbfb0ccbc5ea None glance] PATH_INFO: `/v3/endpoints/13c57d94d28f4be896335eeb1e8b02ca` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:52:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16791ac4-c295-46e8-95b3-dbfb0ccbc5ea None glance] RBAC: Authorizing `identity:get_endpoint(endpoint_id=13c57d94d28f4be896335eeb1e8b02ca)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:52:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16791ac4-c295-46e8-95b3-dbfb0ccbc5ea None glance] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:52:40 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 535/1083] 10.27.203.238 () {60 vars in 1307 bytes} [Tue May 28 12:52:40 2024] GET /identity/v3/endpoints/13c57d94d28f4be896335eeb1e8b02ca => generated 331 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:52:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0f07c1-fc2b-4222-a14f-abb738a6ad7a None glance] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:52:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0f07c1-fc2b-4222-a14f-abb738a6ad7a None glance] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:52:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75687c2a-971b-4189-beb1-70faae1a03d0 None glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1436e60c2e34e0b8af9ae1c668bdf03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:52:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75687c2a-971b-4189-beb1-70faae1a03d0 None glance] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:52:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75687c2a-971b-4189-beb1-70faae1a03d0 None glance] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:52:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75687c2a-971b-4189-beb1-70faae1a03d0 None glance] PATH_INFO: `/v3/limits` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:52:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75687c2a-971b-4189-beb1-70faae1a03d0 None glance] RBAC: Adding query filter params (service_id=b5d296eb68964f14a9e57eb9d15e174d, region_id=RegionOne, resource_name=image_size_total, project_id=ea8d517cde1d40bb82c97e080ce071f7) {{(pid=51267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:52:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75687c2a-971b-4189-beb1-70faae1a03d0 None glance] RBAC: Authorizing `identity:list_limits()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:52:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75687c2a-971b-4189-beb1-70faae1a03d0 None glance] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:52:40 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 549/1084] 10.27.203.238 () {60 vars in 1489 bytes} [Tue May 28 12:52:40 2024] GET /identity/v3/limits?service_id=b5d296eb68964f14a9e57eb9d15e174d®ion_id=RegionOne&resource_name=image_size_total&project_id=ea8d517cde1d40bb82c97e080ce071f7 => generated 248 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:52:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16791ac4-c295-46e8-95b3-dbfb0ccbc5ea None glance] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:52:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16791ac4-c295-46e8-95b3-dbfb0ccbc5ea None glance] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:52:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acc9d81-3858-4d26-8160-f00bcfe99925 None glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1436e60c2e34e0b8af9ae1c668bdf03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:52:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acc9d81-3858-4d26-8160-f00bcfe99925 None glance] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:52:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acc9d81-3858-4d26-8160-f00bcfe99925 None glance] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:52:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acc9d81-3858-4d26-8160-f00bcfe99925 None glance] PATH_INFO: `/v3/registered_limits` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:52:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acc9d81-3858-4d26-8160-f00bcfe99925 None glance] RBAC: Adding query filter params (service_id=b5d296eb68964f14a9e57eb9d15e174d, region_id=RegionOne, resource_name=image_size_total) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:52:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acc9d81-3858-4d26-8160-f00bcfe99925 None glance] RBAC: Authorizing `identity:list_registered_limits()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:52:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acc9d81-3858-4d26-8160-f00bcfe99925 None glance] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:52:40 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 536/1085] 10.27.203.238 () {60 vars in 1434 bytes} [Tue May 28 12:52:40 2024] GET /identity/v3/registered_limits?service_id=b5d296eb68964f14a9e57eb9d15e174d®ion_id=RegionOne&resource_name=image_size_total => generated 531 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:52:40 l75lg1-v1 devstack@g-api.service[86373]: INFO glance.api.v2.image_data [None req-f6fbf2d2-1817-49f5-bad5-0a909ee041db admin admin] Unable to create trust: no such option collect_timing in group [keystone_authtoken] Use the existing user token. May 28 12:52:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75687c2a-971b-4189-beb1-70faae1a03d0 None glance] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:52:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75687c2a-971b-4189-beb1-70faae1a03d0 None glance] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:52:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70bb719-1f24-49b1-bbbb-03bc7c01cb0e None glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1436e60c2e34e0b8af9ae1c668bdf03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:52:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70bb719-1f24-49b1-bbbb-03bc7c01cb0e None glance] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:52:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70bb719-1f24-49b1-bbbb-03bc7c01cb0e None glance] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:52:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70bb719-1f24-49b1-bbbb-03bc7c01cb0e None glance] PATH_INFO: `/v3/limits/model` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:52:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70bb719-1f24-49b1-bbbb-03bc7c01cb0e None glance] RBAC: Authorizing `identity:get_limit_model()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:52:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70bb719-1f24-49b1-bbbb-03bc7c01cb0e None glance] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:52:40 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 550/1086] 10.27.203.238 () {60 vars in 1217 bytes} [Tue May 28 12:52:40 2024] GET /identity/v3/limits/model => generated 131 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:52:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acc9d81-3858-4d26-8160-f00bcfe99925 None glance] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:52:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acc9d81-3858-4d26-8160-f00bcfe99925 None glance] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:52:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65548c70-ea2f-47d5-b3af-f36662e50e41 None glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1436e60c2e34e0b8af9ae1c668bdf03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:52:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65548c70-ea2f-47d5-b3af-f36662e50e41 None glance] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:52:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65548c70-ea2f-47d5-b3af-f36662e50e41 None glance] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:52:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65548c70-ea2f-47d5-b3af-f36662e50e41 None glance] PATH_INFO: `/v3/endpoints/13c57d94d28f4be896335eeb1e8b02ca` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:52:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65548c70-ea2f-47d5-b3af-f36662e50e41 None glance] RBAC: Authorizing `identity:get_endpoint(endpoint_id=13c57d94d28f4be896335eeb1e8b02ca)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:52:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65548c70-ea2f-47d5-b3af-f36662e50e41 None glance] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:52:40 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 537/1087] 10.27.203.238 () {60 vars in 1307 bytes} [Tue May 28 12:52:40 2024] GET /identity/v3/endpoints/13c57d94d28f4be896335eeb1e8b02ca => generated 331 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:52:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70bb719-1f24-49b1-bbbb-03bc7c01cb0e None glance] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:52:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70bb719-1f24-49b1-bbbb-03bc7c01cb0e None glance] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:52:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283169dd-0eb7-40f2-81c8-a1d13ddb0b42 None glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1436e60c2e34e0b8af9ae1c668bdf03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:52:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283169dd-0eb7-40f2-81c8-a1d13ddb0b42 None glance] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:52:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283169dd-0eb7-40f2-81c8-a1d13ddb0b42 None glance] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:52:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283169dd-0eb7-40f2-81c8-a1d13ddb0b42 None glance] PATH_INFO: `/v3/limits` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:52:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283169dd-0eb7-40f2-81c8-a1d13ddb0b42 None glance] RBAC: Adding query filter params (service_id=b5d296eb68964f14a9e57eb9d15e174d, region_id=RegionOne, resource_name=image_count_uploading, project_id=ea8d517cde1d40bb82c97e080ce071f7) {{(pid=51267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:52:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283169dd-0eb7-40f2-81c8-a1d13ddb0b42 None glance] RBAC: Authorizing `identity:list_limits()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:52:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283169dd-0eb7-40f2-81c8-a1d13ddb0b42 None glance] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:52:40 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 551/1088] 10.27.203.238 () {60 vars in 1499 bytes} [Tue May 28 12:52:40 2024] GET /identity/v3/limits?service_id=b5d296eb68964f14a9e57eb9d15e174d®ion_id=RegionOne&resource_name=image_count_uploading&project_id=ea8d517cde1d40bb82c97e080ce071f7 => generated 253 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:52:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65548c70-ea2f-47d5-b3af-f36662e50e41 None glance] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:52:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65548c70-ea2f-47d5-b3af-f36662e50e41 None glance] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:52:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e91d1af-dc8c-43ed-a91e-473e770374a0 None glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1436e60c2e34e0b8af9ae1c668bdf03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:52:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e91d1af-dc8c-43ed-a91e-473e770374a0 None glance] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:52:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e91d1af-dc8c-43ed-a91e-473e770374a0 None glance] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:52:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e91d1af-dc8c-43ed-a91e-473e770374a0 None glance] PATH_INFO: `/v3/registered_limits` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:52:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e91d1af-dc8c-43ed-a91e-473e770374a0 None glance] RBAC: Adding query filter params (service_id=b5d296eb68964f14a9e57eb9d15e174d, region_id=RegionOne, resource_name=image_count_uploading) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:52:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e91d1af-dc8c-43ed-a91e-473e770374a0 None glance] RBAC: Authorizing `identity:list_registered_limits()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:52:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e91d1af-dc8c-43ed-a91e-473e770374a0 None glance] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:52:40 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 538/1089] 10.27.203.238 () {60 vars in 1444 bytes} [Tue May 28 12:52:40 2024] GET /identity/v3/registered_limits?service_id=b5d296eb68964f14a9e57eb9d15e174d®ion_id=RegionOne&resource_name=image_count_uploading => generated 540 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:52:40 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.location [None req-f6fbf2d2-1817-49f5-bad5-0a909ee041db admin admin] Enabling in-flight format inspection for qcow2 {{(pid=86373) set_data /opt/stack/glance/glance/location.py:581}} May 28 12:52:41 l75lg1-v1 dstat.sh[49771]: 28-05 12:52:41| 11 2 87 0 0|4618M 3868M 268M 6914M| 14k 0 | 0 264k| 0 33.0 |3885 6631 |0.13 0.58 0.90|1.0 0 1.0| 0 0 | 0 2048M| 27 295 0 7 0 May 28 12:52:41 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:52:41 l75lg1-v1 nova-scheduler[81196]: DEBUG dbcounter [-] [81196] Writing DB stats nova_cell0:SELECT=1,nova_cell0:UPDATE=1 {{(pid=81196) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:52:41 l75lg1-v1 nova-scheduler[81194]: DEBUG dbcounter [-] [81194] Writing DB stats nova_cell0:SELECT=1 {{(pid=81194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:52:42 l75lg1-v1 dstat.sh[49771]: 28-05 12:52:42| 10 3 86 0 0|4617M 3724M 268M 7054M| 17k 42B| 0 104k| 0 12.0 |1911 2579 |0.20 0.58 0.90|1.0 0 0| 0 0 | 0 2048M| 27 295 0 7 0 May 28 12:52:42 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:52:43 l75lg1-v1 dstat.sh[49771]: 28-05 12:52:43| 10 4 86 0 0|4619M 3577M 268M 7196M| 11k 0 | 0 0 | 0 0 |1733 2325 |0.20 0.58 0.90|2.0 0 0| 0 0 | 0 2048M| 27 295 0 7 0 May 28 12:52:44 l75lg1-v1 dstat.sh[49771]: 28-05 12:52:44| 10 4 86 0 0|4620M 3432M 268M 7336M| 13k 214B| 0 1162k| 0 73.1 |1926 2636 |0.20 0.58 0.90|1.0 0 0| 0 0 | 0 2048M| 27 295 0 7 0 May 28 12:52:44 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:52:45 l75lg1-v1 dstat.sh[49771]: 28-05 12:52:45| 10 4 86 0 0|4619M 3287M 268M 7477M| 17k 134B| 0 1332k| 0 241 |2001 2682 |0.20 0.58 0.90|1.0 0 0| 0 0 | 0 2048M| 27 295 0 7 0 May 28 12:52:45 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:52:45 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.manager [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Starting heal instance info cache {{(pid=83654) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}} May 28 12:52:45 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.manager [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Rebuilding the list of instances to heal {{(pid=83654) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9930}} May 28 12:52:45 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Expecting reply to msg b9bd68f55bcf4cd9aeb9245ba449e7c8 in queue reply_37f4cbd1dd094961a22b8a65f222c327 May 28 12:52:45 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [-] Received RPC response for msg b9bd68f55bcf4cd9aeb9245ba449e7c8 May 28 12:52:46 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.manager [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Didn't find any instances for network info cache update. {{(pid=83654) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10012}} May 28 12:52:46 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:52:46 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:52:46 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.manager [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=83654) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10545}} May 28 12:52:46 l75lg1-v1 dstat.sh[49771]: 28-05 12:52:46| 10 5 83 2 0|4620M 3141M 268M 7619M| 13k 0 | 0 144M| 0 127 |2009 2578 |0.20 0.58 0.90|1.0 0 0| 0 0 | 0 2048M| 27 295 0 7 0 May 28 12:52:46 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance_store._drivers.filesystem [None req-f6fbf2d2-1817-49f5-bad5-0a909ee041db admin admin] Wrote 837025792 bytes to /opt/stack/data/glance/images/31e1897d-0863-48df-80d6-721d2c2d3179 with checksum e18bfc677e90197c6bbf95c24ecf6ae8 and multihash c8a4af7490c9c1ddf1e2929a98adb9e9398b98d78f71a1fd6d01f30564e1b78292ea175088994834cf7635403a96d285ca09d1278eecea3a1fc8d77d5ee6c8a7 {{(pid=86373) add /opt/stack/data/venv/lib/python3.10/site-packages/glance_store/_drivers/filesystem.py:773}} May 28 12:52:46 l75lg1-v1 devstack@g-api.service[86373]: INFO glance.location [None req-f6fbf2d2-1817-49f5-bad5-0a909ee041db admin admin] Image format matched and virtual size computed: 3555459072 May 28 12:52:46 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:52:46 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:52:46 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager.update_available_resource {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:52:46 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Expecting reply to msg b3b244cb702d45f4a720ce9c7cf6490c in queue reply_37f4cbd1dd094961a22b8a65f222c327 May 28 12:52:46 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [-] Received RPC response for msg b3b244cb702d45f4a720ce9c7cf6490c May 28 12:52:46 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance_store.backend [None req-f6fbf2d2-1817-49f5-bad5-0a909ee041db admin admin] Skipping store.set_acls... not implemented. {{(pid=86373) set_acls /opt/stack/data/venv/lib/python3.10/site-packages/glance_store/backend.py:508}} May 28 12:52:46 l75lg1-v1 devstack@g-api.service[86373]: [pid: 86373|app: 0|req: 4/9] 127.0.0.1 () {40 vars in 866 bytes} [Tue May 28 12:52:40 2024] PUT /v2/images/31e1897d-0863-48df-80d6-721d2c2d3179/file => generated 0 bytes in 6566 msecs (HTTP/1.1 204) 4 headers in 171 bytes (1 switches on core 0) May 28 12:52:47 l75lg1-v1 nova-compute[83654]: DEBUG oslo_concurrency.lockutils [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=83654) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:52:47 l75lg1-v1 nova-compute[83654]: DEBUG oslo_concurrency.lockutils [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=83654) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:52:47 l75lg1-v1 nova-compute[83654]: DEBUG oslo_concurrency.lockutils [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=83654) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:52:47 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.resource_tracker [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Auditing locally available compute resources for l75lg1-v1 (node: l75lg1-v1) {{(pid=83654) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}} May 28 12:52:47 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.resource_tracker [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Hypervisor/Node resource view: name=l75lg1-v1 free_ram=11097MB free_disk=15.80902099609375GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_01_1", "address": "0000:00:01.1", "product_id": "7010", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7010", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7000", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7000", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "0100", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_0100", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_09_0", "address": "0000:00:09.0", "product_id": "1001", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1001", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "293a", "vendor_id": "8086", "numa_node": null, "label": "label_8086_293a", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_2", "address": "0000:00:07.2", "product_id": "2936", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2936", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "1237", "vendor_id": "8086", "numa_node": null, "label": "label_8086_1237", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "2935", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2935", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "2934", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2934", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_05_0", "address": "0000:00:05.0", "product_id": "1000", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1000", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "1000", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1000", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_06_0", "address": "0000:00:06.0", "product_id": "2668", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2668", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "1000", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1000", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0a_0", "address": "0000:00:0a.0", "product_id": "1002", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1002", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_3", "address": "0000:00:01.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_08_0", "address": "0000:00:08.0", "product_id": "1003", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1003", "dev_type": "type-PCI"}] {{(pid=83654) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}} May 28 12:52:47 l75lg1-v1 nova-compute[83654]: DEBUG oslo_concurrency.lockutils [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=83654) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:52:47 l75lg1-v1 nova-compute[83654]: DEBUG oslo_concurrency.lockutils [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=83654) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:52:47 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Expecting reply to msg 5d65e3ed4d5b4544bf22c6b9a387b84e in queue reply_37f4cbd1dd094961a22b8a65f222c327 May 28 12:52:47 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [-] Received RPC response for msg 5d65e3ed4d5b4544bf22c6b9a387b84e May 28 12:52:47 l75lg1-v1 dstat.sh[49771]: 28-05 12:52:47| 8 3 87 2 0|4555M 3156M 268M 7666M| 13k 9039B| 0 220k| 0 25.0 |3708 5875 |0.35 0.61 0.91|1.0 0 64| 0 0 | 0 2048M| 27 292 0 9 0 May 28 12:52:47 l75lg1-v1 neutron-server[77623]: DEBUG dbcounter [-] [77623] Writing DB stats neutron:SELECT=1 {{(pid=77623) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:52:47 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Expecting reply to msg 93723fb114b64a7c8837c43af08f818c in queue reply_37f4cbd1dd094961a22b8a65f222c327 May 28 12:52:47 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [-] Received RPC response for msg 93723fb114b64a7c8837c43af08f818c May 28 12:52:47 l75lg1-v1 nova-conductor[83229]: DEBUG dbcounter [-] [83229] Writing DB stats nova_cell0:SELECT=1,nova_cell0:UPDATE=1 {{(pid=83229) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:52:48 l75lg1-v1 nova-conductor[83233]: DEBUG dbcounter [-] [83233] Writing DB stats nova_cell0:SELECT=1 {{(pid=83233) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:52:48 l75lg1-v1 devstack@placement-api.service[78201]: DEBUG placement.requestlog [req-a77a7b47-ff15-4525-a566-a045f873b929 req-9d29da74-0bf6-4bdd-a62b-5f368658b629 None None] Starting request: 10.27.203.238 "GET /placement/resource_providers/ef90d7d1-0808-4a15-ad77-f9a7391af2f4/allocations" {{(pid=78201) __call__ /opt/stack/placement/placement/requestlog.py:55}} May 28 12:52:48 l75lg1-v1 devstack@placement-api.service[78201]: INFO placement.requestlog [req-a77a7b47-ff15-4525-a566-a045f873b929 req-9d29da74-0bf6-4bdd-a62b-5f368658b629 service placement] 10.27.203.238 "GET /placement/resource_providers/ef90d7d1-0808-4a15-ad77-f9a7391af2f4/allocations" status: 200 len: 54 microversion: 1.0 May 28 12:52:48 l75lg1-v1 devstack@placement-api.service[78201]: [pid: 78201|app: 0|req: 15/30] 10.27.203.238 () {62 vars in 1480 bytes} [Tue May 28 12:52:48 2024] GET /placement/resource_providers/ef90d7d1-0808-4a15-ad77-f9a7391af2f4/allocations => generated 54 bytes in 12 msecs (HTTP/1.1 200) 6 headers in 223 bytes (1 switches on core 0) May 28 12:52:48 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.resource_tracker [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Total usable vcpus: 10, total allocated vcpus: 0 {{(pid=83654) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}} May 28 12:52:48 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.resource_tracker [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Final resource view: name=l75lg1-v1 phys_ram=16000MB used_ram=512MB phys_disk=28GB used_disk=0GB total_vcpus=10 used_vcpus=0 pci_stats=[] {{(pid=83654) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}} May 28 12:52:48 l75lg1-v1 devstack@placement-api.service[78202]: DEBUG placement.requestlog [req-a77a7b47-ff15-4525-a566-a045f873b929 req-63e81ac0-aa9a-410e-bbd6-668789f4d8c3 None None] Starting request: 10.27.203.238 "GET /placement/resource_providers/ef90d7d1-0808-4a15-ad77-f9a7391af2f4/allocations" {{(pid=78202) __call__ /opt/stack/placement/placement/requestlog.py:55}} May 28 12:52:48 l75lg1-v1 devstack@placement-api.service[78202]: INFO placement.requestlog [req-a77a7b47-ff15-4525-a566-a045f873b929 req-63e81ac0-aa9a-410e-bbd6-668789f4d8c3 service placement] 10.27.203.238 "GET /placement/resource_providers/ef90d7d1-0808-4a15-ad77-f9a7391af2f4/allocations" status: 200 len: 54 microversion: 1.0 May 28 12:52:48 l75lg1-v1 devstack@placement-api.service[78202]: [pid: 78202|app: 0|req: 16/31] 10.27.203.238 () {62 vars in 1480 bytes} [Tue May 28 12:52:48 2024] GET /placement/resource_providers/ef90d7d1-0808-4a15-ad77-f9a7391af2f4/allocations => generated 54 bytes in 12 msecs (HTTP/1.1 200) 6 headers in 223 bytes (1 switches on core 0) May 28 12:52:48 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.provider_tree [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Inventory has not changed in ProviderTree for provider: ef90d7d1-0808-4a15-ad77-f9a7391af2f4 {{(pid=83654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} May 28 12:52:48 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Expecting reply to msg bfd781d29ad04a9f9a0ef4d3c98f0b28 in queue reply_37f4cbd1dd094961a22b8a65f222c327 May 28 12:52:48 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [-] Received RPC response for msg bfd781d29ad04a9f9a0ef4d3c98f0b28 May 28 12:52:48 l75lg1-v1 dstat.sh[49771]: 28-05 12:52:48| 11 1 88 0 0|4601M 3111M 268M 7666M| 15k 0 | 0 120k| 0 16.0 |2010 2662 |0.35 0.61 0.91|1.0 0 2.0| 0 0 | 0 2048M| 27 292 0 11 0 May 28 12:52:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4788df-1c3e-4368-956e-5adfc262ad7c None None] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:52:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4788df-1c3e-4368-956e-5adfc262ad7c None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:52:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4788df-1c3e-4368-956e-5adfc262ad7c None None] PATH_INFO: `/` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:52:48 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 552/1090] 10.27.203.238 () {58 vars in 1014 bytes} [Tue May 28 12:52:48 2024] GET /identity => generated 272 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:52:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205196de-4de1-4edb-84d5-8cd34610cc23 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:52:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205196de-4de1-4edb-84d5-8cd34610cc23 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:52:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205196de-4de1-4edb-84d5-8cd34610cc23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:52:48 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-205196de-4de1-4edb-84d5-8cd34610cc23 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:52:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-205196de-4de1-4edb-84d5-8cd34610cc23 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:52:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-205196de-4de1-4edb-84d5-8cd34610cc23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:52:48 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 539/1091] 10.27.203.238 () {62 vars in 1111 bytes} [Tue May 28 12:52:48 2024] POST /identity/v3/auth/tokens => generated 3991 bytes in 23 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:52:48 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi [None req-01935d90-cea8-4366-8c58-d36e228c38f3 admin admin] Calling method '>' {{(pid=74000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} May 28 12:52:48 l75lg1-v1 devstack@n-api.service[74000]: INFO nova.api.openstack.requestlog [None req-01935d90-cea8-4366-8c58-d36e228c38f3 admin admin] 10.27.203.238 "GET /compute/v2.1" status: 200 len: 390 microversion: 2.1 time: 0.001111 May 28 12:52:48 l75lg1-v1 devstack@n-api.service[74000]: [pid: 74000|app: 0|req: 21/40] 10.27.203.238 () {58 vars in 1013 bytes} [Tue May 28 12:52:48 2024] GET /compute/v2.1 => generated 390 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 12:52:48 l75lg1-v1 devstack@n-api.service[73999]: DEBUG dbcounter [-] [73999] Writing DB stats nova_api:SELECT=2,nova_api:INSERT=1 {{(pid=73999) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:52:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4788df-1c3e-4368-956e-5adfc262ad7c None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:52:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4788df-1c3e-4368-956e-5adfc262ad7c None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:52:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17e0eae-2df4-4b0b-b1b2-d7d11430f29e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'befdd4414dc2432ab2baa1ae3fbffef7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'manager', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:52:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17e0eae-2df4-4b0b-b1b2-d7d11430f29e service nova] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:52:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17e0eae-2df4-4b0b-b1b2-d7d11430f29e service nova] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:52:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17e0eae-2df4-4b0b-b1b2-d7d11430f29e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:52:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17e0eae-2df4-4b0b-b1b2-d7d11430f29e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:52:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17e0eae-2df4-4b0b-b1b2-d7d11430f29e service nova] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:52:48 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 553/1092] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 12:52:48 2024] GET /identity/v3/auth/tokens => generated 3991 bytes in 22 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 12:52:48 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi [None req-53306fe7-d71a-4c3c-866c-8b542f967d42 admin admin] Calling method '.version_select at 0x7f2e59402b00>' {{(pid=73999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} May 28 12:52:48 l75lg1-v1 devstack@n-api.service[73999]: WARNING oslo_db.sqlalchemy.utils [None req-53306fe7-d71a-4c3c-866c-8b542f967d42 admin admin] Unique keys not in sort_keys. The sorting order may be unstable. May 28 12:52:48 l75lg1-v1 devstack@n-api.service[73999]: INFO nova.api.openstack.requestlog [None req-53306fe7-d71a-4c3c-866c-8b542f967d42 admin admin] 10.27.203.238 "GET /compute/v2.1/os-keypairs" status: 200 len: 16 microversion: 2.10 time: 0.048065 May 28 12:52:48 l75lg1-v1 devstack@n-api.service[73999]: [pid: 73999|app: 0|req: 20/41] 10.27.203.238 () {64 vars in 1336 bytes} [Tue May 28 12:52:48 2024] GET /compute/v2.1/os-keypairs => generated 16 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 12:52:48 l75lg1-v1 nova-compute[83654]: DEBUG nova.scheduler.client.report [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Inventory has not changed for provider ef90d7d1-0808-4a15-ad77-f9a7391af2f4 based on inventory data: {'VCPU': {'total': 10, 'reserved': 0, 'min_unit': 1, 'max_unit': 10, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16000, 'reserved': 512, 'min_unit': 1, 'max_unit': 16000, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 28, 'reserved': 0, 'min_unit': 1, 'max_unit': 28, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=83654) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}} May 28 12:52:48 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Expecting reply to msg 018f1465ffe240eeb489d53debbc4dfb in queue reply_37f4cbd1dd094961a22b8a65f222c327 May 28 12:52:48 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [-] Received RPC response for msg 018f1465ffe240eeb489d53debbc4dfb May 28 12:52:49 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.resource_tracker [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Compute_service record updated for l75lg1-v1:l75lg1-v1 {{(pid=83654) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}} May 28 12:52:49 l75lg1-v1 dstat.sh[49771]: 28-05 12:52:49| 10 1 88 0 0|4573M 3138M 268M 7667M| 13k 1710B| 0 12M| 0 85.0 |2628 3501 |0.35 0.61 0.91|2.0 0 24| 0 0 | 0 2048M| 27 292 0 10 0 May 28 12:52:49 l75lg1-v1 nova-compute[83654]: DEBUG oslo_concurrency.lockutils [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.076s {{(pid=83654) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:52:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd53a474-735f-42ab-9675-1db48ab2cbe6 None None] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:52:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd53a474-735f-42ab-9675-1db48ab2cbe6 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:52:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd53a474-735f-42ab-9675-1db48ab2cbe6 None None] PATH_INFO: `/` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:52:49 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 540/1093] 10.27.203.238 () {58 vars in 1014 bytes} [Tue May 28 12:52:49 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:52:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb8427d-c73e-4cd3-a9a5-7d66a578a0be None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:52:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb8427d-c73e-4cd3-a9a5-7d66a578a0be None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:52:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb8427d-c73e-4cd3-a9a5-7d66a578a0be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:52:49 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-bfb8427d-c73e-4cd3-a9a5-7d66a578a0be None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:52:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-bfb8427d-c73e-4cd3-a9a5-7d66a578a0be None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:52:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-bfb8427d-c73e-4cd3-a9a5-7d66a578a0be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:52:49 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 554/1094] 10.27.203.238 () {62 vars in 1111 bytes} [Tue May 28 12:52:49 2024] POST /identity/v3/auth/tokens => generated 3991 bytes in 24 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:52:50 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi [None req-01935d90-cea8-4366-8c58-d36e228c38f3 admin admin] Calling method '>' {{(pid=74000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} May 28 12:52:50 l75lg1-v1 devstack@n-api.service[74000]: INFO nova.api.openstack.requestlog [None req-01935d90-cea8-4366-8c58-d36e228c38f3 admin admin] 10.27.203.238 "GET /compute/v2.1" status: 200 len: 390 microversion: 2.1 time: 0.001105 May 28 12:52:50 l75lg1-v1 devstack@n-api.service[74000]: [pid: 74000|app: 0|req: 22/42] 10.27.203.238 () {58 vars in 1013 bytes} [Tue May 28 12:52:50 2024] GET /compute/v2.1 => generated 390 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 12:52:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd53a474-735f-42ab-9675-1db48ab2cbe6 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:52:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd53a474-735f-42ab-9675-1db48ab2cbe6 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:52:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd99acdf-fb1f-4afd-8bee-de3c90555eda service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'befdd4414dc2432ab2baa1ae3fbffef7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'manager', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:52:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd99acdf-fb1f-4afd-8bee-de3c90555eda service nova] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:52:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd99acdf-fb1f-4afd-8bee-de3c90555eda service nova] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:52:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd99acdf-fb1f-4afd-8bee-de3c90555eda service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:52:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd99acdf-fb1f-4afd-8bee-de3c90555eda service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:52:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd99acdf-fb1f-4afd-8bee-de3c90555eda service nova] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:52:50 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 541/1095] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 12:52:50 2024] GET /identity/v3/auth/tokens => generated 3991 bytes in 21 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 12:52:50 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi [None req-5961e952-ee70-4915-9047-a6de1e535ada admin admin] Action: 'create', calling method: .version_select at 0x7f2e59403010>, body: {"keypair": {"public_key": "ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBLsP8Kxn2qMfWtSFs9yODfUu0uOyMBq+pDWpK2l6vn50RrjMaQE6LCklINybCs/Z8R1n7b/M9XRQwRiTyJIkcY= vastdata@l75lg1-v1\n", "name": "manila-service"}} {{(pid=73999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:518}} May 28 12:52:50 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.quota [None req-5961e952-ee70-4915-9047-a6de1e535ada admin admin] Getting quotas for project ea8d517cde1d40bb82c97e080ce071f7. Resources: {'key_pairs'} {{(pid=73999) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 12:52:50 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.quota [None req-5961e952-ee70-4915-9047-a6de1e535ada admin admin] Getting quotas for user e48f0d07e6644786b1da9213d53cc1e1 and project ea8d517cde1d40bb82c97e080ce071f7. Resources: {'key_pairs'} {{(pid=73999) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 12:52:50 l75lg1-v1 devstack@g-api.service[86374]: DEBUG dbcounter [-] [86374] Writing DB stats glance:SELECT=5,glance:INSERT=5 {{(pid=86374) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:52:50 l75lg1-v1 dstat.sh[49771]: 28-05 12:52:50| 10 1 88 1 0|4601M 3110M 268M 7667M| 11k 0 | 0 1072k| 0 204 |2329 3378 |0.35 0.61 0.91| 0 1.0 0| 0 0 | 0 2048M| 27 294 0 10 0 May 28 12:52:50 l75lg1-v1 devstack@n-api.service[73999]: INFO nova.api.openstack.requestlog [None req-5961e952-ee70-4915-9047-a6de1e535ada admin admin] 10.27.203.238 "POST /compute/v2.1/os-keypairs" status: 201 len: 366 microversion: 2.10 time: 0.126907 May 28 12:52:50 l75lg1-v1 devstack@n-api.service[73999]: [pid: 73999|app: 0|req: 21/43] 10.27.203.238 () {68 vars in 1377 bytes} [Tue May 28 12:52:50 2024] POST /compute/v2.1/os-keypairs => generated 366 bytes in 128 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 28 12:52:51 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:52:51 l75lg1-v1 dstat.sh[49771]: 28-05 12:52:51| 4 7 87 0 0|4553M 3159M 268M 7667M| 20k 25k| 0 180k| 0 26.0 |5086 5942 |0.35 0.61 0.91|2.0 0 391| 0 0 | 0 2048M| 27 293 0 10 0 May 28 12:52:52 l75lg1-v1 dstat.sh[49771]: 28-05 12:52:52| 2 4 76 18 0|4552M 3159M 268M 7667M| 17k 5833B| 0 344M| 0 305 |2834 3554 |0.48 0.63 0.91| 0 4.0 143| 0 0 | 0 2048M| 27 293 0 10 0 May 28 12:52:53 l75lg1-v1 dstat.sh[49771]: 28-05 12:52:53| 6 5 65 24 0|4556M 3155M 268M 7667M| 11k 625B| 104k 281M|26.0 259 |6500 10k|0.48 0.63 0.91|2.0 1.0 76| 0 0 | 0 2048M| 27 293 0 10 0 May 28 12:52:53 l75lg1-v1 devstack@m-api.service[89577]: [uWSGI] getting INI configuration from /etc/manila/manila-uwsgi.ini May 28 12:52:53 l75lg1-v1 devstack@m-api.service[89577]: *** Starting uWSGI 2.0.20-debian (64bit) on [Tue May 28 12:52:53 2024] *** May 28 12:52:53 l75lg1-v1 devstack@m-api.service[89577]: compiled with version: 11.2.0 on 21 March 2022 11:00:44 May 28 12:52:53 l75lg1-v1 devstack@m-api.service[89577]: os: Linux-5.15.0-56-generic #62-Ubuntu SMP Tue Nov 22 19:54:14 UTC 2022 May 28 12:52:53 l75lg1-v1 devstack@m-api.service[89577]: nodename: l75lg1-v1 May 28 12:52:53 l75lg1-v1 devstack@m-api.service[89577]: machine: x86_64 May 28 12:52:53 l75lg1-v1 devstack@m-api.service[89577]: clock source: unix May 28 12:52:53 l75lg1-v1 devstack@m-api.service[89577]: pcre jit disabled May 28 12:52:53 l75lg1-v1 devstack@m-api.service[89577]: detected number of CPU cores: 10 May 28 12:52:53 l75lg1-v1 devstack@m-api.service[89577]: current working directory: / May 28 12:52:53 l75lg1-v1 devstack@m-api.service[89577]: detected binary path: /usr/bin/uwsgi-core May 28 12:52:53 l75lg1-v1 devstack@m-api.service[89577]: your processes number limit is 63557 May 28 12:52:53 l75lg1-v1 devstack@m-api.service[89577]: your memory page size is 4096 bytes May 28 12:52:53 l75lg1-v1 devstack@m-api.service[89577]: detected max file descriptor number: 2048 May 28 12:52:53 l75lg1-v1 devstack@m-api.service[89577]: lock engine: pthread robust mutexes May 28 12:52:53 l75lg1-v1 devstack@m-api.service[89577]: thunder lock: enabled May 28 12:52:53 l75lg1-v1 devstack@m-api.service[89577]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/manila-wsgi.socket fd 4 May 28 12:52:53 l75lg1-v1 devstack@m-api.service[89577]: Python version: 3.10.12 (main, Nov 20 2023, 15:14:05) [GCC 11.4.0] May 28 12:52:53 l75lg1-v1 devstack@m-api.service[89577]: PEP 405 virtualenv detected: /opt/stack/data/venv May 28 12:52:53 l75lg1-v1 devstack@m-api.service[89577]: Set PythonHome to /opt/stack/data/venv May 28 12:52:53 l75lg1-v1 devstack@m-api.service[89577]: Python main interpreter initialized at 0x55a780bd3b70 May 28 12:52:53 l75lg1-v1 devstack@m-api.service[89577]: python threads support enabled May 28 12:52:53 l75lg1-v1 devstack@m-api.service[89577]: your server socket listen backlog is limited to 100 connections May 28 12:52:53 l75lg1-v1 devstack@m-api.service[89577]: your mercy for graceful operations on workers is 80 seconds May 28 12:52:53 l75lg1-v1 devstack@m-api.service[89577]: mapped 403077 bytes (393 KB) for 2 cores May 28 12:52:53 l75lg1-v1 devstack@m-api.service[89577]: *** Operational MODE: preforking *** May 28 12:52:53 l75lg1-v1 devstack@m-api.service[89577]: *** uWSGI is running in multiple interpreter mode *** May 28 12:52:53 l75lg1-v1 devstack@m-api.service[89577]: spawned uWSGI master process (pid: 89577) May 28 12:52:53 l75lg1-v1 devstack@m-api.service[89577]: spawned uWSGI worker 1 (pid: 89578, cores: 1) May 28 12:52:53 l75lg1-v1 devstack@m-api.service[89577]: spawned uWSGI worker 2 (pid: 89579, cores: 1) May 28 12:52:53 l75lg1-v1 devstack@m-api.service[89577]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 28 12:52:54 l75lg1-v1 dstat.sh[49771]: 28-05 12:52:54| 15 4 79 2 0|4618M 3093M 268M 7667M| 27k 6926B| 0 42M| 0 115 |4008 4372 |0.48 0.63 0.91|3.0 0 90| 0 0 | 0 2048M| 27 294 0 10 0 May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89579]: DEBUG manila.wsgi.wsgi [-] ******************************************************************************** {{(pid=89579) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2600}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89579]: DEBUG manila.wsgi.wsgi [-] Configuration options gathered from: {{(pid=89579) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2601}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89579]: DEBUG manila.wsgi.wsgi [-] command line args: [] {{(pid=89579) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89579]: DEBUG manila.wsgi.wsgi [-] config files: ['/etc/manila/manila.conf'] {{(pid=89579) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2603}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89579]: DEBUG manila.wsgi.wsgi [-] ================================================================================ {{(pid=89579) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2605}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89579]: DEBUG manila.wsgi.wsgi [-] admin_only_metadata = ['__affinity_same_host', '__affinity_different_host'] {{(pid=89579) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89579]: DEBUG manila.wsgi.wsgi [-] api_rate_limit = True {{(pid=89579) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89579]: DEBUG manila.wsgi.wsgi [-] auth_strategy = keystone {{(pid=89579) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89579]: DEBUG manila.wsgi.wsgi [-] cleanup_interval = 1800 {{(pid=89579) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89579]: DEBUG manila.wsgi.wsgi [-] config_dir = [] {{(pid=89579) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89579]: DEBUG manila.wsgi.wsgi [-] config_file = ['/etc/manila/manila.conf'] {{(pid=89579) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89579]: DEBUG manila.wsgi.wsgi [-] config_source = [] {{(pid=89579) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89579]: DEBUG manila.wsgi.wsgi [-] data_manager = manila.data.manager.DataManager {{(pid=89579) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89579]: DEBUG manila.wsgi.wsgi [-] data_topic = manila-data {{(pid=89579) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89579]: DEBUG manila.wsgi.wsgi [-] db_backend = sqlalchemy {{(pid=89579) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89579]: DEBUG manila.wsgi.wsgi [-] debug = True {{(pid=89579) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89579]: DEBUG manila.wsgi.wsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=89579) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89579]: DEBUG manila.wsgi.wsgi [-] default_share_group_type = default {{(pid=89579) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89579]: DEBUG manila.wsgi.wsgi [-] default_share_type = default {{(pid=89579) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89579]: DEBUG manila.wsgi.wsgi [-] enable_new_services = True {{(pid=89579) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89579]: DEBUG manila.wsgi.wsgi [-] enabled_share_backends = ['generic1', 'generic2'] {{(pid=89579) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89579]: DEBUG manila.wsgi.wsgi [-] enabled_share_protocols = ['NFS', 'CIFS'] {{(pid=89579) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89579]: DEBUG manila.wsgi.wsgi [-] fatal_exception_format_errors = False {{(pid=89579) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89579]: DEBUG manila.wsgi.wsgi [-] host = l75lg1-v1 {{(pid=89579) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89579]: DEBUG manila.wsgi.wsgi [-] instance_format = [instance: %(uuid)s] {{(pid=89579) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89579]: DEBUG manila.wsgi.wsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=89579) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89579]: DEBUG manila.wsgi.wsgi [-] log_config_append = None {{(pid=89579) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89579]: DEBUG manila.wsgi.wsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=89579) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89579]: DEBUG manila.wsgi.wsgi [-] log_dir = None {{(pid=89579) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89579]: DEBUG manila.wsgi.wsgi [-] log_file = None {{(pid=89579) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89579]: DEBUG manila.wsgi.wsgi [-] log_rotate_interval = 1 {{(pid=89579) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89579]: DEBUG manila.wsgi.wsgi [-] log_rotate_interval_type = days {{(pid=89579) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89579]: DEBUG manila.wsgi.wsgi [-] log_rotation_type = none {{(pid=89579) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89579]: DEBUG manila.wsgi.wsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=89579) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89579]: DEBUG manila.wsgi.wsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=89579) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89579]: DEBUG manila.wsgi.wsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=89579) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89579]: DEBUG manila.wsgi.wsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=89579) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89579]: DEBUG manila.wsgi.wsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=89579) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89579]: DEBUG manila.wsgi.wsgi [-] max_logfile_count = 30 {{(pid=89579) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89579]: DEBUG manila.wsgi.wsgi [-] max_logfile_size_mb = 200 {{(pid=89579) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89579]: DEBUG manila.wsgi.wsgi [-] monkey_patch = False {{(pid=89579) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89579]: DEBUG manila.wsgi.wsgi [-] monkey_patch_modules = [] {{(pid=89579) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89579]: DEBUG manila.wsgi.wsgi [-] my_ip = 10.27.203.238 {{(pid=89579) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89579]: DEBUG manila.wsgi.wsgi [-] osapi_share_ext_list = [] {{(pid=89579) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89579]: DEBUG manila.wsgi.wsgi [-] osapi_share_extension = ['manila.api.contrib.standard_extensions'] {{(pid=89579) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89579]: DEBUG manila.wsgi.wsgi [-] osapi_share_listen = :: {{(pid=89579) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89579]: DEBUG manila.wsgi.wsgi [-] osapi_share_listen_port = 8786 {{(pid=89579) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89579]: DEBUG manila.wsgi.wsgi [-] osapi_share_use_ssl = False {{(pid=89579) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89579]: DEBUG manila.wsgi.wsgi [-] osapi_share_workers = 1 {{(pid=89579) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89579]: DEBUG manila.wsgi.wsgi [-] periodic_fuzzy_delay = 60 {{(pid=89579) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89579]: DEBUG manila.wsgi.wsgi [-] periodic_interval = 60 {{(pid=89579) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89579]: DEBUG manila.wsgi.wsgi [-] publish_errors = False {{(pid=89579) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89579]: DEBUG manila.wsgi.wsgi [-] rate_limit_burst = 0 {{(pid=89579) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89579]: DEBUG manila.wsgi.wsgi [-] rate_limit_except_level = CRITICAL {{(pid=89579) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89579]: DEBUG manila.wsgi.wsgi [-] rate_limit_interval = 0 {{(pid=89579) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89579]: DEBUG manila.wsgi.wsgi [-] report_interval = 10 {{(pid=89579) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89579]: DEBUG manila.wsgi.wsgi [-] rootwrap_config = /etc/manila/rootwrap.conf {{(pid=89579) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89579]: DEBUG manila.wsgi.wsgi [-] scheduler_manager = manila.scheduler.manager.SchedulerManager {{(pid=89579) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89579]: DEBUG manila.wsgi.wsgi [-] scheduler_topic = manila-scheduler {{(pid=89579) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89579]: DEBUG manila.wsgi.wsgi [-] service_down_time = 60 {{(pid=89579) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89579]: DEBUG manila.wsgi.wsgi [-] share_api_class = manila.share.api.API {{(pid=89579) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89579]: DEBUG manila.wsgi.wsgi [-] share_backup_name_template = share-backup-%s {{(pid=89579) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89579]: DEBUG manila.wsgi.wsgi [-] share_manager = manila.share.manager.ShareManager {{(pid=89579) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89579]: DEBUG manila.wsgi.wsgi [-] share_name_template = share-%s {{(pid=89579) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89579]: DEBUG manila.wsgi.wsgi [-] share_snapshot_name_template = share-snapshot-%s {{(pid=89579) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89579]: DEBUG manila.wsgi.wsgi [-] share_topic = manila-share {{(pid=89579) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89579]: DEBUG manila.wsgi.wsgi [-] soft_deleted_share_retention_time = 604800 {{(pid=89579) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89579]: DEBUG manila.wsgi.wsgi [-] state_path = /opt/stack/data/manila {{(pid=89579) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89579]: DEBUG manila.wsgi.wsgi [-] storage_availability_zone = nova {{(pid=89579) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89579]: DEBUG manila.wsgi.wsgi [-] syslog_log_facility = LOG_USER {{(pid=89579) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89579]: DEBUG manila.wsgi.wsgi [-] transfer_retention_time = 300 {{(pid=89579) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89579]: DEBUG manila.wsgi.wsgi [-] use_eventlog = False {{(pid=89579) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89579]: DEBUG manila.wsgi.wsgi [-] use_journal = False {{(pid=89579) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89579]: DEBUG manila.wsgi.wsgi [-] use_json = False {{(pid=89579) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89578]: DEBUG manila.wsgi.wsgi [-] ******************************************************************************** {{(pid=89578) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2600}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89579]: DEBUG manila.wsgi.wsgi [-] use_stderr = False {{(pid=89579) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89579]: DEBUG manila.wsgi.wsgi [-] use_syslog = False {{(pid=89579) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89578]: DEBUG manila.wsgi.wsgi [-] Configuration options gathered from: {{(pid=89578) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2601}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89579]: DEBUG manila.wsgi.wsgi [-] watch_log_file = False {{(pid=89579) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89579]: DEBUG manila.wsgi.wsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=89579) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89578]: DEBUG manila.wsgi.wsgi [-] command line args: [] {{(pid=89578) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89579]: DEBUG manila.wsgi.wsgi [-] oslo_concurrency.lock_path = /opt/stack/manila/manila_locks {{(pid=89579) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89578]: DEBUG manila.wsgi.wsgi [-] config files: ['/etc/manila/manila.conf'] {{(pid=89578) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2603}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89579]: DEBUG manila.wsgi.wsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=89579) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89578]: DEBUG manila.wsgi.wsgi [-] ================================================================================ {{(pid=89578) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2605}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89579]: DEBUG manila.wsgi.wsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=89579) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89578]: DEBUG manila.wsgi.wsgi [-] admin_only_metadata = ['__affinity_same_host', '__affinity_different_host'] {{(pid=89578) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89579]: DEBUG manila.wsgi.wsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=89579) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89578]: DEBUG manila.wsgi.wsgi [-] api_rate_limit = True {{(pid=89578) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89579]: DEBUG manila.wsgi.wsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=89579) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89578]: DEBUG manila.wsgi.wsgi [-] auth_strategy = keystone {{(pid=89578) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89579]: DEBUG manila.wsgi.wsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=89579) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89578]: DEBUG manila.wsgi.wsgi [-] cleanup_interval = 1800 {{(pid=89578) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89579]: DEBUG manila.wsgi.wsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=89579) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89578]: DEBUG manila.wsgi.wsgi [-] config_dir = [] {{(pid=89578) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89579]: DEBUG manila.wsgi.wsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=89579) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89578]: DEBUG manila.wsgi.wsgi [-] config_file = ['/etc/manila/manila.conf'] {{(pid=89578) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89579]: DEBUG manila.wsgi.wsgi [-] oslo_policy.enforce_scope = False {{(pid=89579) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89578]: DEBUG manila.wsgi.wsgi [-] config_source = [] {{(pid=89578) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89579]: DEBUG manila.wsgi.wsgi [-] oslo_policy.policy_default_rule = default {{(pid=89579) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89578]: DEBUG manila.wsgi.wsgi [-] data_manager = manila.data.manager.DataManager {{(pid=89578) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89579]: DEBUG manila.wsgi.wsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=89579) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89578]: DEBUG manila.wsgi.wsgi [-] data_topic = manila-data {{(pid=89578) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89579]: DEBUG manila.wsgi.wsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=89579) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89578]: DEBUG manila.wsgi.wsgi [-] db_backend = sqlalchemy {{(pid=89578) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89578]: DEBUG manila.wsgi.wsgi [-] debug = True {{(pid=89578) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89579]: DEBUG manila.wsgi.wsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=89579) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89578]: DEBUG manila.wsgi.wsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=89578) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89579]: DEBUG manila.wsgi.wsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=89579) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89578]: DEBUG manila.wsgi.wsgi [-] default_share_group_type = default {{(pid=89578) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89579]: DEBUG manila.wsgi.wsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=89579) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89578]: DEBUG manila.wsgi.wsgi [-] default_share_type = default {{(pid=89578) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89579]: DEBUG manila.wsgi.wsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=89579) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89578]: DEBUG manila.wsgi.wsgi [-] enable_new_services = True {{(pid=89578) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89579]: DEBUG manila.wsgi.wsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=89579) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89578]: DEBUG manila.wsgi.wsgi [-] enabled_share_backends = ['generic1', 'generic2'] {{(pid=89578) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89579]: DEBUG manila.wsgi.wsgi [-] database.backend = sqlalchemy {{(pid=89579) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89578]: DEBUG manila.wsgi.wsgi [-] enabled_share_protocols = ['NFS', 'CIFS'] {{(pid=89578) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89579]: DEBUG manila.wsgi.wsgi [-] database.connection = **** {{(pid=89579) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89578]: DEBUG manila.wsgi.wsgi [-] fatal_exception_format_errors = False {{(pid=89578) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89579]: DEBUG manila.wsgi.wsgi [-] database.connection_debug = 0 {{(pid=89579) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89579]: DEBUG manila.wsgi.wsgi [-] database.connection_parameters = {{(pid=89579) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89578]: DEBUG manila.wsgi.wsgi [-] host = l75lg1-v1 {{(pid=89578) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89579]: DEBUG manila.wsgi.wsgi [-] database.connection_recycle_time = 3600 {{(pid=89579) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89578]: DEBUG manila.wsgi.wsgi [-] instance_format = [instance: %(uuid)s] {{(pid=89578) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89579]: DEBUG manila.wsgi.wsgi [-] database.connection_trace = False {{(pid=89579) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89578]: DEBUG manila.wsgi.wsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=89578) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89579]: DEBUG manila.wsgi.wsgi [-] database.db_inc_retry_interval = True {{(pid=89579) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89578]: DEBUG manila.wsgi.wsgi [-] log_config_append = None {{(pid=89578) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89578]: DEBUG manila.wsgi.wsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=89578) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89579]: DEBUG manila.wsgi.wsgi [-] database.db_max_retries = 20 {{(pid=89579) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89578]: DEBUG manila.wsgi.wsgi [-] log_dir = None {{(pid=89578) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89579]: DEBUG manila.wsgi.wsgi [-] database.db_max_retry_interval = 10 {{(pid=89579) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89578]: DEBUG manila.wsgi.wsgi [-] log_file = None {{(pid=89578) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89579]: DEBUG manila.wsgi.wsgi [-] database.db_retry_interval = 1 {{(pid=89579) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89578]: DEBUG manila.wsgi.wsgi [-] log_rotate_interval = 1 {{(pid=89578) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89579]: DEBUG manila.wsgi.wsgi [-] database.max_overflow = 50 {{(pid=89579) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89578]: DEBUG manila.wsgi.wsgi [-] log_rotate_interval_type = days {{(pid=89578) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89579]: DEBUG manila.wsgi.wsgi [-] database.max_pool_size = 40 {{(pid=89579) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89578]: DEBUG manila.wsgi.wsgi [-] log_rotation_type = none {{(pid=89578) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89579]: DEBUG manila.wsgi.wsgi [-] database.max_retries = 10 {{(pid=89579) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89578]: DEBUG manila.wsgi.wsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=89578) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89578]: DEBUG manila.wsgi.wsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=89578) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89579]: DEBUG manila.wsgi.wsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=89579) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89578]: DEBUG manila.wsgi.wsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=89578) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89579]: DEBUG manila.wsgi.wsgi [-] database.mysql_wsrep_sync_wait = None {{(pid=89579) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89578]: DEBUG manila.wsgi.wsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=89578) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89579]: DEBUG manila.wsgi.wsgi [-] database.pool_timeout = None {{(pid=89579) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89578]: DEBUG manila.wsgi.wsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=89578) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89579]: DEBUG manila.wsgi.wsgi [-] database.retry_interval = 10 {{(pid=89579) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89578]: DEBUG manila.wsgi.wsgi [-] max_logfile_count = 30 {{(pid=89578) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89579]: DEBUG manila.wsgi.wsgi [-] database.slave_connection = **** {{(pid=89579) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89578]: DEBUG manila.wsgi.wsgi [-] max_logfile_size_mb = 200 {{(pid=89578) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89579]: DEBUG manila.wsgi.wsgi [-] database.sqlite_synchronous = True {{(pid=89579) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89578]: DEBUG manila.wsgi.wsgi [-] monkey_patch = False {{(pid=89578) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89579]: DEBUG manila.wsgi.wsgi [-] database.use_db_reconnect = False {{(pid=89579) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89578]: DEBUG manila.wsgi.wsgi [-] monkey_patch_modules = [] {{(pid=89578) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89579]: DEBUG manila.wsgi.wsgi [-] coordination.backend_url = **** {{(pid=89579) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89578]: DEBUG manila.wsgi.wsgi [-] my_ip = 10.27.203.238 {{(pid=89578) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89579]: DEBUG manila.wsgi.wsgi [-] profiler.connection_string = messaging:// {{(pid=89579) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89578]: DEBUG manila.wsgi.wsgi [-] osapi_share_ext_list = [] {{(pid=89578) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89579]: DEBUG manila.wsgi.wsgi [-] profiler.enabled = False {{(pid=89579) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89578]: DEBUG manila.wsgi.wsgi [-] osapi_share_extension = ['manila.api.contrib.standard_extensions'] {{(pid=89578) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89579]: DEBUG manila.wsgi.wsgi [-] profiler.es_doc_type = notification {{(pid=89579) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89578]: DEBUG manila.wsgi.wsgi [-] osapi_share_listen = :: {{(pid=89578) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89579]: DEBUG manila.wsgi.wsgi [-] profiler.es_scroll_size = 10000 {{(pid=89579) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89578]: DEBUG manila.wsgi.wsgi [-] osapi_share_listen_port = 8786 {{(pid=89578) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89579]: DEBUG manila.wsgi.wsgi [-] profiler.es_scroll_time = 2m {{(pid=89579) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89578]: DEBUG manila.wsgi.wsgi [-] osapi_share_use_ssl = False {{(pid=89578) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89578]: DEBUG manila.wsgi.wsgi [-] osapi_share_workers = 1 {{(pid=89578) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89579]: DEBUG manila.wsgi.wsgi [-] profiler.filter_error_trace = False {{(pid=89579) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89578]: DEBUG manila.wsgi.wsgi [-] periodic_fuzzy_delay = 60 {{(pid=89578) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89579]: DEBUG manila.wsgi.wsgi [-] profiler.hmac_keys = **** {{(pid=89579) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89578]: DEBUG manila.wsgi.wsgi [-] periodic_interval = 60 {{(pid=89578) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89579]: DEBUG manila.wsgi.wsgi [-] profiler.sentinel_service_name = mymaster {{(pid=89579) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89578]: DEBUG manila.wsgi.wsgi [-] publish_errors = False {{(pid=89578) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89579]: DEBUG manila.wsgi.wsgi [-] profiler.socket_timeout = 0.1 {{(pid=89579) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89578]: DEBUG manila.wsgi.wsgi [-] rate_limit_burst = 0 {{(pid=89578) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89579]: DEBUG manila.wsgi.wsgi [-] profiler.trace_requests = False {{(pid=89579) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89578]: DEBUG manila.wsgi.wsgi [-] rate_limit_except_level = CRITICAL {{(pid=89578) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89579]: DEBUG manila.wsgi.wsgi [-] profiler.trace_sqlalchemy = False {{(pid=89579) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89578]: DEBUG manila.wsgi.wsgi [-] rate_limit_interval = 0 {{(pid=89578) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89578]: DEBUG manila.wsgi.wsgi [-] report_interval = 10 {{(pid=89578) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89579]: DEBUG manila.wsgi.wsgi [-] profiler_jaeger.process_tags = {} {{(pid=89579) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89579]: DEBUG manila.wsgi.wsgi [-] profiler_jaeger.service_name_prefix = None {{(pid=89579) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89578]: DEBUG manila.wsgi.wsgi [-] rootwrap_config = /etc/manila/rootwrap.conf {{(pid=89578) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89579]: DEBUG manila.wsgi.wsgi [-] profiler_otlp.service_name_prefix = None {{(pid=89579) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89578]: DEBUG manila.wsgi.wsgi [-] scheduler_manager = manila.scheduler.manager.SchedulerManager {{(pid=89578) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89579]: DEBUG manila.wsgi.wsgi [-] oslo_reports.file_event_handler = None {{(pid=89579) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89578]: DEBUG manila.wsgi.wsgi [-] scheduler_topic = manila-scheduler {{(pid=89578) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89579]: DEBUG manila.wsgi.wsgi [-] oslo_reports.file_event_handler_interval = 1 {{(pid=89579) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89578]: DEBUG manila.wsgi.wsgi [-] service_down_time = 60 {{(pid=89578) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89579]: DEBUG manila.wsgi.wsgi [-] oslo_reports.log_dir = None {{(pid=89579) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89578]: DEBUG manila.wsgi.wsgi [-] share_api_class = manila.share.api.API {{(pid=89578) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89579]: DEBUG manila.wsgi.wsgi [-] ******************************************************************************** {{(pid=89579) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2624}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89578]: DEBUG manila.wsgi.wsgi [-] share_backup_name_template = share-backup-%s {{(pid=89578) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89578]: DEBUG manila.wsgi.wsgi [-] share_manager = manila.share.manager.ShareManager {{(pid=89578) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89578]: DEBUG manila.wsgi.wsgi [-] share_name_template = share-%s {{(pid=89578) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89578]: DEBUG manila.wsgi.wsgi [-] share_snapshot_name_template = share-snapshot-%s {{(pid=89578) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89578]: DEBUG manila.wsgi.wsgi [-] share_topic = manila-share {{(pid=89578) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89578]: DEBUG manila.wsgi.wsgi [-] soft_deleted_share_retention_time = 604800 {{(pid=89578) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89578]: DEBUG manila.wsgi.wsgi [-] state_path = /opt/stack/data/manila {{(pid=89578) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89578]: DEBUG manila.wsgi.wsgi [-] storage_availability_zone = nova {{(pid=89578) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89578]: DEBUG manila.wsgi.wsgi [-] syslog_log_facility = LOG_USER {{(pid=89578) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89578]: DEBUG manila.wsgi.wsgi [-] transfer_retention_time = 300 {{(pid=89578) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89578]: DEBUG manila.wsgi.wsgi [-] use_eventlog = False {{(pid=89578) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89578]: DEBUG manila.wsgi.wsgi [-] use_journal = False {{(pid=89578) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89578]: DEBUG manila.wsgi.wsgi [-] use_json = False {{(pid=89578) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89578]: DEBUG manila.wsgi.wsgi [-] use_stderr = False {{(pid=89578) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89578]: DEBUG manila.wsgi.wsgi [-] use_syslog = False {{(pid=89578) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89578]: DEBUG manila.wsgi.wsgi [-] watch_log_file = False {{(pid=89578) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89578]: DEBUG manila.wsgi.wsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=89578) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89578]: DEBUG manila.wsgi.wsgi [-] oslo_concurrency.lock_path = /opt/stack/manila/manila_locks {{(pid=89578) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89578]: DEBUG manila.wsgi.wsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=89578) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89578]: DEBUG manila.wsgi.wsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=89578) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89578]: DEBUG manila.wsgi.wsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=89578) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89578]: DEBUG manila.wsgi.wsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=89578) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89578]: DEBUG manila.wsgi.wsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=89578) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89578]: DEBUG manila.wsgi.wsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=89578) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89578]: DEBUG manila.wsgi.wsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=89578) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89578]: DEBUG manila.wsgi.wsgi [-] oslo_policy.enforce_scope = False {{(pid=89578) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89578]: DEBUG manila.wsgi.wsgi [-] oslo_policy.policy_default_rule = default {{(pid=89578) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89578]: DEBUG manila.wsgi.wsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=89578) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89578]: DEBUG manila.wsgi.wsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=89578) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89578]: DEBUG manila.wsgi.wsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=89578) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89578]: DEBUG manila.wsgi.wsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=89578) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89578]: DEBUG manila.wsgi.wsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=89578) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89578]: DEBUG manila.wsgi.wsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=89578) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89578]: DEBUG manila.wsgi.wsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=89578) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89578]: DEBUG manila.wsgi.wsgi [-] database.backend = sqlalchemy {{(pid=89578) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89578]: DEBUG manila.wsgi.wsgi [-] database.connection = **** {{(pid=89578) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89578]: DEBUG manila.wsgi.wsgi [-] database.connection_debug = 0 {{(pid=89578) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89578]: DEBUG manila.wsgi.wsgi [-] database.connection_parameters = {{(pid=89578) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89578]: DEBUG manila.wsgi.wsgi [-] database.connection_recycle_time = 3600 {{(pid=89578) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89578]: DEBUG manila.wsgi.wsgi [-] database.connection_trace = False {{(pid=89578) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89578]: DEBUG manila.wsgi.wsgi [-] database.db_inc_retry_interval = True {{(pid=89578) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89578]: DEBUG manila.wsgi.wsgi [-] database.db_max_retries = 20 {{(pid=89578) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89578]: DEBUG manila.wsgi.wsgi [-] database.db_max_retry_interval = 10 {{(pid=89578) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89578]: DEBUG manila.wsgi.wsgi [-] database.db_retry_interval = 1 {{(pid=89578) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89578]: DEBUG manila.wsgi.wsgi [-] database.max_overflow = 50 {{(pid=89578) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89578]: DEBUG manila.wsgi.wsgi [-] database.max_pool_size = 40 {{(pid=89578) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89578]: DEBUG manila.wsgi.wsgi [-] database.max_retries = 10 {{(pid=89578) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89578]: DEBUG manila.wsgi.wsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=89578) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89578]: DEBUG manila.wsgi.wsgi [-] database.mysql_wsrep_sync_wait = None {{(pid=89578) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89578]: DEBUG manila.wsgi.wsgi [-] database.pool_timeout = None {{(pid=89578) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89578]: DEBUG manila.wsgi.wsgi [-] database.retry_interval = 10 {{(pid=89578) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89578]: DEBUG manila.wsgi.wsgi [-] database.slave_connection = **** {{(pid=89578) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89578]: DEBUG manila.wsgi.wsgi [-] database.sqlite_synchronous = True {{(pid=89578) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89578]: DEBUG manila.wsgi.wsgi [-] database.use_db_reconnect = False {{(pid=89578) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89578]: DEBUG manila.wsgi.wsgi [-] coordination.backend_url = **** {{(pid=89578) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89578]: DEBUG manila.wsgi.wsgi [-] profiler.connection_string = messaging:// {{(pid=89578) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89578]: DEBUG manila.wsgi.wsgi [-] profiler.enabled = False {{(pid=89578) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89578]: DEBUG manila.wsgi.wsgi [-] profiler.es_doc_type = notification {{(pid=89578) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89578]: DEBUG manila.wsgi.wsgi [-] profiler.es_scroll_size = 10000 {{(pid=89578) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89578]: DEBUG manila.wsgi.wsgi [-] profiler.es_scroll_time = 2m {{(pid=89578) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89578]: DEBUG manila.wsgi.wsgi [-] profiler.filter_error_trace = False {{(pid=89578) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89578]: DEBUG manila.wsgi.wsgi [-] profiler.hmac_keys = **** {{(pid=89578) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89578]: DEBUG manila.wsgi.wsgi [-] profiler.sentinel_service_name = mymaster {{(pid=89578) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89578]: DEBUG manila.wsgi.wsgi [-] profiler.socket_timeout = 0.1 {{(pid=89578) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89578]: DEBUG manila.wsgi.wsgi [-] profiler.trace_requests = False {{(pid=89578) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89578]: DEBUG manila.wsgi.wsgi [-] profiler.trace_sqlalchemy = False {{(pid=89578) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89578]: DEBUG manila.wsgi.wsgi [-] profiler_jaeger.process_tags = {} {{(pid=89578) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89578]: DEBUG manila.wsgi.wsgi [-] profiler_jaeger.service_name_prefix = None {{(pid=89578) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89578]: DEBUG manila.wsgi.wsgi [-] profiler_otlp.service_name_prefix = None {{(pid=89578) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89578]: DEBUG manila.wsgi.wsgi [-] oslo_reports.file_event_handler = None {{(pid=89578) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89578]: DEBUG manila.wsgi.wsgi [-] oslo_reports.file_event_handler_interval = 1 {{(pid=89578) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89578]: DEBUG manila.wsgi.wsgi [-] oslo_reports.log_dir = None {{(pid=89578) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89578]: DEBUG manila.wsgi.wsgi [-] ******************************************************************************** {{(pid=89578) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2624}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89579]: DEBUG oslo.service.wsgi [-] Loading app osapi_share from /etc/manila/api-paste.ini {{(pid=89579) load_app /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/wsgi.py:349}} May 28 12:52:54 l75lg1-v1 devstack@m-api.service[89578]: DEBUG oslo.service.wsgi [-] Loading app osapi_share from /etc/manila/api-paste.ini {{(pid=89578) load_app /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/wsgi.py:349}} May 28 12:52:55 l75lg1-v1 devstack@m-api.service[89579]: INFO manila.api.extensions [-] Initializing extension manager. May 28 12:52:55 l75lg1-v1 devstack@m-api.service[89579]: DEBUG manila.api.extensions [-] Loading extension manila.api.contrib.standard_extensions {{(pid=89579) load_extension /opt/stack/manila/manila/api/extensions.py:194}} May 28 12:52:55 l75lg1-v1 devstack@m-api.service[89579]: DEBUG manila.api.extensions [-] Calling extension factory manila.api.contrib.standard_extensions {{(pid=89579) load_extension /opt/stack/manila/manila/api/extensions.py:200}} May 28 12:52:55 l75lg1-v1 devstack@m-api.service[89579]: DEBUG manila.api.openstack [-] Extended resource: extensions {{(pid=89579) _setup_ext_routes /opt/stack/manila/manila/api/openstack/__init__.py:130}} May 28 12:52:55 l75lg1-v1 devstack@m-api.service[89578]: INFO manila.api.extensions [-] Initializing extension manager. May 28 12:52:55 l75lg1-v1 devstack@m-api.service[89578]: DEBUG manila.api.extensions [-] Loading extension manila.api.contrib.standard_extensions {{(pid=89578) load_extension /opt/stack/manila/manila/api/extensions.py:194}} May 28 12:52:55 l75lg1-v1 devstack@m-api.service[89578]: DEBUG manila.api.extensions [-] Calling extension factory manila.api.contrib.standard_extensions {{(pid=89578) load_extension /opt/stack/manila/manila/api/extensions.py:200}} May 28 12:52:55 l75lg1-v1 devstack@m-api.service[89578]: DEBUG manila.api.openstack [-] Extended resource: extensions {{(pid=89578) _setup_ext_routes /opt/stack/manila/manila/api/openstack/__init__.py:130}} May 28 12:52:55 l75lg1-v1 dstat.sh[49771]: 28-05 12:52:55| 19 2 79 0 0|4690M 3021M 268M 7668M| 16k 172B| 0 3064k| 0 436 |1903 3066 |0.48 0.63 0.91|3.0 0 0| 0 0 | 0 2048M| 27 294 0 10 0 May 28 12:52:55 l75lg1-v1 devstack@m-api.service[89579]: INFO manila.api.extensions [-] Initializing extension manager. May 28 12:52:55 l75lg1-v1 devstack@m-api.service[89579]: DEBUG manila.api.extensions [-] Loading extension manila.api.contrib.standard_extensions {{(pid=89579) load_extension /opt/stack/manila/manila/api/extensions.py:194}} May 28 12:52:55 l75lg1-v1 devstack@m-api.service[89579]: DEBUG manila.api.extensions [-] Calling extension factory manila.api.contrib.standard_extensions {{(pid=89579) load_extension /opt/stack/manila/manila/api/extensions.py:200}} May 28 12:52:55 l75lg1-v1 devstack@m-api.service[89578]: INFO manila.api.extensions [-] Initializing extension manager. May 28 12:52:55 l75lg1-v1 devstack@m-api.service[89578]: DEBUG manila.api.extensions [-] Loading extension manila.api.contrib.standard_extensions {{(pid=89578) load_extension /opt/stack/manila/manila/api/extensions.py:194}} May 28 12:52:55 l75lg1-v1 devstack@m-api.service[89578]: DEBUG manila.api.extensions [-] Calling extension factory manila.api.contrib.standard_extensions {{(pid=89578) load_extension /opt/stack/manila/manila/api/extensions.py:200}} May 28 12:52:55 l75lg1-v1 devstack@m-api.service[89579]: DEBUG manila.api.openstack [-] Extended resource: extensions {{(pid=89579) _setup_ext_routes /opt/stack/manila/manila/api/openstack/__init__.py:130}} May 28 12:52:55 l75lg1-v1 devstack@m-api.service[89578]: DEBUG manila.api.openstack [-] Extended resource: extensions {{(pid=89578) _setup_ext_routes /opt/stack/manila/manila/api/openstack/__init__.py:130}} May 28 12:52:55 l75lg1-v1 devstack@m-api.service[89579]: WARNING keystonemiddleware.auth_token [-] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 28 12:52:55 l75lg1-v1 devstack@m-api.service[89578]: WARNING keystonemiddleware.auth_token [-] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 28 12:52:55 l75lg1-v1 devstack@m-api.service[89579]: WARNING keystonemiddleware.auth_token [-] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 28 12:52:55 l75lg1-v1 devstack@m-api.service[89578]: WARNING keystonemiddleware.auth_token [-] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 28 12:52:55 l75lg1-v1 devstack@m-api.service[89579]: INFO manila.api.extensions [-] Initializing extension manager. May 28 12:52:55 l75lg1-v1 devstack@m-api.service[89579]: DEBUG manila.api.extensions [-] Loading extension manila.api.contrib.standard_extensions {{(pid=89579) load_extension /opt/stack/manila/manila/api/extensions.py:194}} May 28 12:52:55 l75lg1-v1 devstack@m-api.service[89579]: DEBUG manila.api.extensions [-] Calling extension factory manila.api.contrib.standard_extensions {{(pid=89579) load_extension /opt/stack/manila/manila/api/extensions.py:200}} May 28 12:52:55 l75lg1-v1 devstack@m-api.service[89578]: INFO manila.api.extensions [-] Initializing extension manager. May 28 12:52:55 l75lg1-v1 devstack@m-api.service[89578]: DEBUG manila.api.extensions [-] Loading extension manila.api.contrib.standard_extensions {{(pid=89578) load_extension /opt/stack/manila/manila/api/extensions.py:194}} May 28 12:52:55 l75lg1-v1 devstack@m-api.service[89578]: DEBUG manila.api.extensions [-] Calling extension factory manila.api.contrib.standard_extensions {{(pid=89578) load_extension /opt/stack/manila/manila/api/extensions.py:200}} May 28 12:52:55 l75lg1-v1 devstack@m-api.service[89579]: DEBUG manila.api.openstack [-] Extended resource: extensions {{(pid=89579) _setup_ext_routes /opt/stack/manila/manila/api/openstack/__init__.py:130}} May 28 12:52:55 l75lg1-v1 devstack@m-api.service[89579]: WARNING keystonemiddleware.auth_token [-] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 28 12:52:55 l75lg1-v1 devstack@m-api.service[89579]: WARNING keystonemiddleware.auth_token [-] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 28 12:52:55 l75lg1-v1 devstack@m-api.service[89579]: WSGI app 0 (mountpoint='') ready in 2 seconds on interpreter 0x55a780bd3b70 pid: 89579 (default app) May 28 12:52:55 l75lg1-v1 devstack@m-api.service[89579]: INFO manila.api.openstack.wsgi [-] GET http://10.27.203.238/share/ May 28 12:52:55 l75lg1-v1 devstack@m-api.service[89579]: DEBUG manila.api.openstack.wsgi [-] No Content-Type provided in request {{(pid=89579) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:648}} May 28 12:52:55 l75lg1-v1 devstack@m-api.service[89579]: DEBUG manila.api.openstack.wsgi [-] Calling method 'VersionsController.all' {{(pid=89579) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:52:55 l75lg1-v1 devstack@m-api.service[89579]: INFO manila.api.openstack.wsgi [-] http://10.27.203.238/share/ returned with HTTP 300 May 28 12:52:55 l75lg1-v1 devstack@m-api.service[89579]: [pid: 89579|app: 0|req: 1/1] 10.27.203.238 () {54 vars in 854 bytes} [Tue May 28 12:52:55 2024] GET /share => generated 740 bytes in 10 msecs (HTTP/1.1 300) 3 headers in 105 bytes (1 switches on core 0) May 28 12:52:55 l75lg1-v1 devstack@m-api.service[89578]: DEBUG manila.api.openstack [-] Extended resource: extensions {{(pid=89578) _setup_ext_routes /opt/stack/manila/manila/api/openstack/__init__.py:130}} May 28 12:52:55 l75lg1-v1 devstack@m-api.service[89578]: WARNING keystonemiddleware.auth_token [-] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 28 12:52:55 l75lg1-v1 devstack@m-api.service[89578]: WARNING keystonemiddleware.auth_token [-] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 28 12:52:55 l75lg1-v1 devstack@m-api.service[89578]: WSGI app 0 (mountpoint='') ready in 2 seconds on interpreter 0x55a780bd3b70 pid: 89578 (default app) May 28 12:52:56 l75lg1-v1 dstat.sh[49771]: 28-05 12:52:56| 13 3 83 0 0|4749M 2960M 268M 7668M| 17k 8419B| 0 780k| 0 71.0 |2871 3295 |0.48 0.63 0.91|1.0 0 110| 0 0 | 0 2048M| 27 293 0 10 0 May 28 12:52:56 l75lg1-v1 devstack@g-api.service[86373]: DEBUG dbcounter [-] [86373] Writing DB stats glance:SELECT=19,glance:UPDATE=2,glance:INSERT=1 {{(pid=86373) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:52:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a33b8c-35cf-4e1d-a0ef-c65e15a054cd None None] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:52:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a33b8c-35cf-4e1d-a0ef-c65e15a054cd None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:52:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a33b8c-35cf-4e1d-a0ef-c65e15a054cd None None] PATH_INFO: `/` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:52:57 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 555/1096] 10.27.203.238 () {58 vars in 1014 bytes} [Tue May 28 12:52:57 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:52:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e38b67a-3212-4e94-99ea-5e39e508b552 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:52:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e38b67a-3212-4e94-99ea-5e39e508b552 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:52:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e38b67a-3212-4e94-99ea-5e39e508b552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:52:57 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-4e38b67a-3212-4e94-99ea-5e39e508b552 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:52:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-4e38b67a-3212-4e94-99ea-5e39e508b552 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:52:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-4e38b67a-3212-4e94-99ea-5e39e508b552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:52:57 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 542/1097] 10.27.203.238 () {62 vars in 1111 bytes} [Tue May 28 12:52:57 2024] POST /identity/v3/auth/tokens => generated 3991 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 28 12:52:57 l75lg1-v1 dstat.sh[49771]: 28-05 12:52:57| 10 1 88 1 0|4788M 2922M 268M 7669M| 13k 0 | 0 2168k| 0 114 |2261 3389 |0.52 0.64 0.92|1.0 1.0 0| 0 0 | 0 2048M| 27 293 0 10 0 May 28 12:52:57 l75lg1-v1 devstack@m-api.service[89579]: INFO manila.api.openstack.wsgi [-] GET http://10.27.203.238/share// May 28 12:52:57 l75lg1-v1 devstack@m-api.service[89579]: DEBUG manila.api.openstack.wsgi [-] No Content-Type provided in request {{(pid=89579) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:648}} May 28 12:52:57 l75lg1-v1 devstack@m-api.service[89579]: DEBUG manila.api.openstack.wsgi [-] Calling method 'VersionsController.all' {{(pid=89579) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:52:57 l75lg1-v1 devstack@m-api.service[89579]: INFO manila.api.openstack.wsgi [-] http://10.27.203.238/share// returned with HTTP 300 May 28 12:52:57 l75lg1-v1 devstack@m-api.service[89579]: [pid: 89579|app: 0|req: 2/2] 10.27.203.238 () {62 vars in 1190 bytes} [Tue May 28 12:52:57 2024] GET /share/ => generated 752 bytes in 2 msecs (HTTP/1.1 300) 3 headers in 105 bytes (1 switches on core 0) May 28 12:52:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57002406-01eb-405b-9aae-2436a61d6b2c None None] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:52:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57002406-01eb-405b-9aae-2436a61d6b2c None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:52:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57002406-01eb-405b-9aae-2436a61d6b2c None None] PATH_INFO: `/` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:52:57 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 556/1098] 10.27.203.238 () {58 vars in 1052 bytes} [Tue May 28 12:52:57 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:52:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa3813f-9d52-427e-8bf9-70aed1f3e6be None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:52:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa3813f-9d52-427e-8bf9-70aed1f3e6be None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:52:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa3813f-9d52-427e-8bf9-70aed1f3e6be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:52:57 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-bfa3813f-9d52-427e-8bf9-70aed1f3e6be None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:52:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-bfa3813f-9d52-427e-8bf9-70aed1f3e6be None None] MFA Rules not processed for user `f110cf6300f049c897d0aab63218d1e5`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:52:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-bfa3813f-9d52-427e-8bf9-70aed1f3e6be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:52:57 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 543/1099] 10.27.203.238 () {62 vars in 1149 bytes} [Tue May 28 12:52:57 2024] POST /identity/v3/auth/tokens => generated 3809 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:52:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57002406-01eb-405b-9aae-2436a61d6b2c None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:52:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57002406-01eb-405b-9aae-2436a61d6b2c None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:52:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1067a4-56f4-46b1-afc6-6e5f28921bf5 service manila] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f110cf6300f049c897d0aab63218d1e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:52:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1067a4-56f4-46b1-afc6-6e5f28921bf5 service manila] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:52:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1067a4-56f4-46b1-afc6-6e5f28921bf5 service manila] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:52:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1067a4-56f4-46b1-afc6-6e5f28921bf5 service manila] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:52:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1067a4-56f4-46b1-afc6-6e5f28921bf5 service manila] RBAC: Authorizing `identity:validate_token()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:52:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1067a4-56f4-46b1-afc6-6e5f28921bf5 service manila] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:52:57 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 557/1100] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 12:52:57 2024] GET /identity/v3/auth/tokens => generated 3991 bytes in 24 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 12:52:57 l75lg1-v1 devstack@m-api.service[89578]: INFO manila.api.openstack.wsgi [None req-de379c39-efe4-4be6-9cff-097b56e9a28b admin admin] GET http://10.27.203.238/share/v2/types May 28 12:52:57 l75lg1-v1 devstack@m-api.service[89578]: DEBUG manila.api.openstack.wsgi [None req-de379c39-efe4-4be6-9cff-097b56e9a28b admin admin] No Content-Type provided in request {{(pid=89578) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:648}} May 28 12:52:57 l75lg1-v1 devstack@m-api.service[89578]: DEBUG manila.api.openstack.wsgi [None req-de379c39-efe4-4be6-9cff-097b56e9a28b admin admin] Calling method 'ShareTypesController.index' {{(pid=89578) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:52:57 l75lg1-v1 devstack@m-api.service[89578]: DEBUG oslo_db.api [None req-de379c39-efe4-4be6-9cff-097b56e9a28b admin admin] Loading backend 'sqlalchemy' from 'manila.db.sqlalchemy.api' {{(pid=89578) _load_backend /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/api.py:259}} May 28 12:52:58 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [-] Expecting reply to msg 8ab48bdd18ff46539c3e28976267e78a in queue reply_37f4cbd1dd094961a22b8a65f222c327 May 28 12:52:58 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [-] Received RPC response for msg 8ab48bdd18ff46539c3e28976267e78a May 28 12:52:58 l75lg1-v1 devstack@m-api.service[89578]: DEBUG passlib.utils.compat [None req-de379c39-efe4-4be6-9cff-097b56e9a28b admin admin] loaded lazy attr 'SafeConfigParser': {{(pid=89578) __getattr__ /opt/stack/data/venv/lib/python3.10/site-packages/passlib/utils/compat/__init__.py:449}} May 28 12:52:58 l75lg1-v1 devstack@m-api.service[89578]: DEBUG passlib.utils.compat [None req-de379c39-efe4-4be6-9cff-097b56e9a28b admin admin] loaded lazy attr 'NativeStringIO': {{(pid=89578) __getattr__ /opt/stack/data/venv/lib/python3.10/site-packages/passlib/utils/compat/__init__.py:449}} May 28 12:52:58 l75lg1-v1 devstack@m-api.service[89578]: DEBUG passlib.utils.compat [None req-de379c39-efe4-4be6-9cff-097b56e9a28b admin admin] loaded lazy attr 'BytesIO': {{(pid=89578) __getattr__ /opt/stack/data/venv/lib/python3.10/site-packages/passlib/utils/compat/__init__.py:449}} May 28 12:52:58 l75lg1-v1 devstack@placement-api.service[78201]: DEBUG dbcounter [-] [78201] Writing DB stats placement:SELECT=2 {{(pid=78201) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:52:58 l75lg1-v1 devstack@placement-api.service[78202]: DEBUG dbcounter [-] [78202] Writing DB stats placement:SELECT=2 {{(pid=78202) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:52:58 l75lg1-v1 dstat.sh[49771]: 28-05 12:52:58| 10 1 88 1 0|4798M 2911M 268M 7669M| 15k 0 | 0 1100k| 0 83.0 |2477 3697 |0.52 0.64 0.92|2.0 0 2.0| 0 0 | 0 2048M| 27 296 0 10 0 May 28 12:52:58 l75lg1-v1 devstack@m-api.service[89578]: INFO dbcounter [None req-de379c39-efe4-4be6-9cff-097b56e9a28b admin admin] Registered counter for database manila May 28 12:52:58 l75lg1-v1 devstack@m-api.service[89578]: DEBUG oslo_db.sqlalchemy.engines [None req-de379c39-efe4-4be6-9cff-097b56e9a28b admin admin] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=89578) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:342}} May 28 12:52:58 l75lg1-v1 devstack@m-api.service[89578]: DEBUG dbcounter [-] [89578] Writer thread running {{(pid=89578) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} May 28 12:52:58 l75lg1-v1 devstack@m-api.service[89578]: INFO manila.api.openstack.wsgi [None req-de379c39-efe4-4be6-9cff-097b56e9a28b admin admin] http://10.27.203.238/share/v2/types returned with HTTP 200 May 28 12:52:58 l75lg1-v1 devstack@m-api.service[89578]: [pid: 89578|app: 0|req: 1/3] 10.27.203.238 () {62 vars in 1213 bytes} [Tue May 28 12:52:57 2024] GET /share/v2/types => generated 39 bytes in 1268 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:52:59 l75lg1-v1 dstat.sh[49771]: 28-05 12:52:59| 10 1 89 0 0|4774M 2935M 268M 7669M| 16k 2050B| 0 0 | 0 0 |1979 2471 |0.52 0.64 0.92|2.0 0 30| 0 0 | 0 2048M| 27 297 0 10 0 May 28 12:52:59 l75lg1-v1 nova-conductor[83647]: DEBUG dbcounter [-] [83647] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=3 {{(pid=83647) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:52:59 l75lg1-v1 nova-conductor[83648]: DEBUG dbcounter [-] [83648] Writing DB stats nova_cell1:SELECT=2 {{(pid=83648) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:53:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632de9e1-b671-42d6-a689-f6ece034ff4f None None] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:53:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632de9e1-b671-42d6-a689-f6ece034ff4f None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:53:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632de9e1-b671-42d6-a689-f6ece034ff4f None None] PATH_INFO: `/` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:53:00 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 544/1101] 10.27.203.238 () {58 vars in 1014 bytes} [Tue May 28 12:53:00 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:53:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152b4869-0e4c-4f47-a020-d471b06ce74a None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:53:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152b4869-0e4c-4f47-a020-d471b06ce74a None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:53:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152b4869-0e4c-4f47-a020-d471b06ce74a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:53:00 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-152b4869-0e4c-4f47-a020-d471b06ce74a None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:53:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-152b4869-0e4c-4f47-a020-d471b06ce74a None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:53:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-152b4869-0e4c-4f47-a020-d471b06ce74a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:53:00 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 558/1102] 10.27.203.238 () {62 vars in 1111 bytes} [Tue May 28 12:53:00 2024] POST /identity/v3/auth/tokens => generated 3991 bytes in 23 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:53:00 l75lg1-v1 dstat.sh[49771]: 28-05 12:53:00| 10 1 89 0 0|4813M 2897M 268M 7669M| 12k 0 | 0 188k| 0 26.0 |1906 2803 |0.52 0.64 0.92|2.0 0 0| 0 0 | 0 2048M| 27 297 0 10 0 May 28 12:53:00 l75lg1-v1 neutron-server[77618]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.HashRingHealthCheckPeriodics.touch_hash_ring_nodes' {{(pid=77618) _process_scheduled /opt/stack/data/venv/lib/python3.10/site-packages/futurist/periodics.py:638}} May 28 12:53:00 l75lg1-v1 devstack@m-api.service[89579]: INFO manila.api.openstack.wsgi [-] GET http://10.27.203.238/share// May 28 12:53:00 l75lg1-v1 devstack@m-api.service[89579]: DEBUG manila.api.openstack.wsgi [-] No Content-Type provided in request {{(pid=89579) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:648}} May 28 12:53:00 l75lg1-v1 devstack@m-api.service[89579]: DEBUG manila.api.openstack.wsgi [-] Calling method 'VersionsController.all' {{(pid=89579) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:53:00 l75lg1-v1 devstack@m-api.service[89579]: INFO manila.api.openstack.wsgi [-] http://10.27.203.238/share// returned with HTTP 300 May 28 12:53:00 l75lg1-v1 devstack@m-api.service[89579]: [pid: 89579|app: 0|req: 3/4] 10.27.203.238 () {62 vars in 1190 bytes} [Tue May 28 12:53:00 2024] GET /share/ => generated 752 bytes in 2 msecs (HTTP/1.1 300) 3 headers in 105 bytes (1 switches on core 0) May 28 12:53:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632de9e1-b671-42d6-a689-f6ece034ff4f None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:53:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632de9e1-b671-42d6-a689-f6ece034ff4f None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:53:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb045b3-5646-42f1-b8f0-a2e0445e3a6a service manila] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f110cf6300f049c897d0aab63218d1e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:53:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb045b3-5646-42f1-b8f0-a2e0445e3a6a service manila] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:53:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb045b3-5646-42f1-b8f0-a2e0445e3a6a service manila] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:53:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb045b3-5646-42f1-b8f0-a2e0445e3a6a service manila] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:53:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb045b3-5646-42f1-b8f0-a2e0445e3a6a service manila] RBAC: Authorizing `identity:validate_token()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:53:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb045b3-5646-42f1-b8f0-a2e0445e3a6a service manila] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:53:00 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 545/1103] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 12:53:00 2024] GET /identity/v3/auth/tokens => generated 3991 bytes in 19 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 12:53:00 l75lg1-v1 devstack@m-api.service[89578]: INFO manila.api.openstack.wsgi [None req-4368663c-cb3d-4d0f-898c-4c5806e265dd admin admin] POST http://10.27.203.238/share/v2/types May 28 12:53:00 l75lg1-v1 devstack@m-api.service[89578]: DEBUG manila.api.openstack.wsgi [None req-4368663c-cb3d-4d0f-898c-4c5806e265dd admin admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share_type": {"name": "default", "share_type_access:is_public": true, "extra_specs": {"driver_handles_share_servers": true}}} {{(pid=89578) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:53:00 l75lg1-v1 devstack@m-api.service[89578]: INFO manila.api.openstack.wsgi [None req-4368663c-cb3d-4d0f-898c-4c5806e265dd admin admin] http://10.27.203.238/share/v2/types returned with HTTP 200 May 28 12:53:00 l75lg1-v1 devstack@m-api.service[89578]: [pid: 89578|app: 0|req: 2/5] 10.27.203.238 () {66 vars in 1267 bytes} [Tue May 28 12:53:00 2024] POST /share/v2/types => generated 561 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:53:01 l75lg1-v1 dstat.sh[49771]: 28-05 12:53:01| 9 1 88 0 0|4787M 2923M 268M 7669M| 17k 3244B| 0 312k| 0 52.0 |2748 3778 |0.52 0.64 0.92|1.0 0 33| 0 0 | 0 2048M| 27 297 0 10 0 May 28 12:53:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd217888-a7c5-4fd1-9e35-096c278c5ecd None None] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:53:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd217888-a7c5-4fd1-9e35-096c278c5ecd None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:53:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd217888-a7c5-4fd1-9e35-096c278c5ecd None None] PATH_INFO: `/` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:53:01 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 559/1104] 10.27.203.238 () {58 vars in 1014 bytes} [Tue May 28 12:53:01 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:53:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3f5268-2e9c-49bb-a78b-daa344b15ee4 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:53:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3f5268-2e9c-49bb-a78b-daa344b15ee4 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:53:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3f5268-2e9c-49bb-a78b-daa344b15ee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:53:01 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-cf3f5268-2e9c-49bb-a78b-daa344b15ee4 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:53:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-cf3f5268-2e9c-49bb-a78b-daa344b15ee4 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:53:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-cf3f5268-2e9c-49bb-a78b-daa344b15ee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:53:01 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 546/1105] 10.27.203.238 () {62 vars in 1111 bytes} [Tue May 28 12:53:01 2024] POST /identity/v3/auth/tokens => generated 3991 bytes in 22 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:53:02 l75lg1-v1 devstack@m-api.service[89579]: INFO manila.api.openstack.wsgi [-] GET http://10.27.203.238/share// May 28 12:53:02 l75lg1-v1 devstack@m-api.service[89579]: DEBUG manila.api.openstack.wsgi [-] No Content-Type provided in request {{(pid=89579) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:648}} May 28 12:53:02 l75lg1-v1 devstack@m-api.service[89579]: DEBUG manila.api.openstack.wsgi [-] Calling method 'VersionsController.all' {{(pid=89579) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:53:02 l75lg1-v1 devstack@m-api.service[89579]: INFO manila.api.openstack.wsgi [-] http://10.27.203.238/share// returned with HTTP 300 May 28 12:53:02 l75lg1-v1 devstack@m-api.service[89579]: [pid: 89579|app: 0|req: 4/6] 10.27.203.238 () {62 vars in 1190 bytes} [Tue May 28 12:53:02 2024] GET /share/ => generated 752 bytes in 2 msecs (HTTP/1.1 300) 3 headers in 105 bytes (1 switches on core 0) May 28 12:53:02 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd217888-a7c5-4fd1-9e35-096c278c5ecd None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:53:02 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd217888-a7c5-4fd1-9e35-096c278c5ecd None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:53:02 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72900bbf-e9a1-4b36-9fbf-40a2b3c526b4 service manila] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f110cf6300f049c897d0aab63218d1e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:53:02 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72900bbf-e9a1-4b36-9fbf-40a2b3c526b4 service manila] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:53:02 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72900bbf-e9a1-4b36-9fbf-40a2b3c526b4 service manila] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:53:02 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72900bbf-e9a1-4b36-9fbf-40a2b3c526b4 service manila] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:53:02 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72900bbf-e9a1-4b36-9fbf-40a2b3c526b4 service manila] RBAC: Authorizing `identity:validate_token()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:53:02 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72900bbf-e9a1-4b36-9fbf-40a2b3c526b4 service manila] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:53:02 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 560/1106] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 12:53:02 2024] GET /identity/v3/auth/tokens => generated 3991 bytes in 19 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 12:53:02 l75lg1-v1 devstack@m-api.service[89578]: INFO manila.api.openstack.wsgi [None req-3aec5b81-5710-41d5-8eeb-dcb15bf852eb admin admin] GET http://10.27.203.238/share/v2/share-group-types May 28 12:53:02 l75lg1-v1 devstack@m-api.service[89578]: DEBUG manila.api.openstack.wsgi [None req-3aec5b81-5710-41d5-8eeb-dcb15bf852eb admin admin] No Content-Type provided in request {{(pid=89578) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:648}} May 28 12:53:02 l75lg1-v1 devstack@m-api.service[89578]: DEBUG manila.api.openstack.wsgi [None req-3aec5b81-5710-41d5-8eeb-dcb15bf852eb admin admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=89578) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:53:02 l75lg1-v1 devstack@m-api.service[89578]: INFO manila.api.openstack.wsgi [None req-3aec5b81-5710-41d5-8eeb-dcb15bf852eb admin admin] http://10.27.203.238/share/v2/share-group-types returned with HTTP 200 May 28 12:53:02 l75lg1-v1 devstack@m-api.service[89578]: [pid: 89578|app: 0|req: 3/7] 10.27.203.238 () {62 vars in 1249 bytes} [Tue May 28 12:53:02 2024] GET /share/v2/share-group-types => generated 25 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:53:02 l75lg1-v1 dstat.sh[49771]: 28-05 12:53:02| 10 1 89 0 0|4814M 2895M 268M 7669M| 14k 0 | 0 180k| 0 11.0 |1893 2683 |0.56 0.64 0.92|2.0 0 0| 0 0 | 0 2048M| 27 297 0 10 0 May 28 12:53:03 l75lg1-v1 dstat.sh[49771]: 28-05 12:53:03| 10 1 89 0 0|4796M 2913M 268M 7669M| 13k 1850B| 0 200k| 0 27.0 |1981 2783 |0.56 0.64 0.92|2.0 0 24| 0 0 | 0 2048M| 27 297 0 10 0 May 28 12:53:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966b0644-301b-4505-aa30-f2795d74394c None None] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:53:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966b0644-301b-4505-aa30-f2795d74394c None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:53:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966b0644-301b-4505-aa30-f2795d74394c None None] PATH_INFO: `/` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:53:03 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 547/1107] 10.27.203.238 () {58 vars in 1014 bytes} [Tue May 28 12:53:03 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:53:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1a3de7-d2ea-403e-b8fa-9c29591d75f0 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:53:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1a3de7-d2ea-403e-b8fa-9c29591d75f0 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:53:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1a3de7-d2ea-403e-b8fa-9c29591d75f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:53:03 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-0f1a3de7-d2ea-403e-b8fa-9c29591d75f0 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:53:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-0f1a3de7-d2ea-403e-b8fa-9c29591d75f0 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:53:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-0f1a3de7-d2ea-403e-b8fa-9c29591d75f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:53:03 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 561/1108] 10.27.203.238 () {62 vars in 1111 bytes} [Tue May 28 12:53:03 2024] POST /identity/v3/auth/tokens => generated 3991 bytes in 22 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:53:03 l75lg1-v1 devstack@m-api.service[89579]: INFO manila.api.openstack.wsgi [-] GET http://10.27.203.238/share// May 28 12:53:03 l75lg1-v1 devstack@m-api.service[89579]: DEBUG manila.api.openstack.wsgi [-] No Content-Type provided in request {{(pid=89579) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:648}} May 28 12:53:03 l75lg1-v1 devstack@m-api.service[89579]: DEBUG manila.api.openstack.wsgi [-] Calling method 'VersionsController.all' {{(pid=89579) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:53:03 l75lg1-v1 devstack@m-api.service[89579]: INFO manila.api.openstack.wsgi [-] http://10.27.203.238/share// returned with HTTP 300 May 28 12:53:03 l75lg1-v1 devstack@m-api.service[89579]: [pid: 89579|app: 0|req: 5/8] 10.27.203.238 () {62 vars in 1190 bytes} [Tue May 28 12:53:03 2024] GET /share/ => generated 752 bytes in 2 msecs (HTTP/1.1 300) 3 headers in 105 bytes (1 switches on core 0) May 28 12:53:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966b0644-301b-4505-aa30-f2795d74394c None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:53:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966b0644-301b-4505-aa30-f2795d74394c None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:53:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33414e42-0cb3-49e6-b034-6f49e8711de4 service manila] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f110cf6300f049c897d0aab63218d1e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:53:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33414e42-0cb3-49e6-b034-6f49e8711de4 service manila] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:53:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33414e42-0cb3-49e6-b034-6f49e8711de4 service manila] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:53:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33414e42-0cb3-49e6-b034-6f49e8711de4 service manila] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:53:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33414e42-0cb3-49e6-b034-6f49e8711de4 service manila] RBAC: Authorizing `identity:validate_token()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:53:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33414e42-0cb3-49e6-b034-6f49e8711de4 service manila] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:53:03 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 548/1109] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 12:53:03 2024] GET /identity/v3/auth/tokens => generated 3991 bytes in 19 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 12:53:03 l75lg1-v1 devstack@m-api.service[89578]: INFO manila.api.openstack.wsgi [None req-65dfd117-478c-4b68-9dba-e1d152ff53e2 admin admin] GET http://10.27.203.238/share/v2/types?all_tenants=1&is_public=all May 28 12:53:03 l75lg1-v1 devstack@m-api.service[89578]: DEBUG manila.api.openstack.wsgi [None req-65dfd117-478c-4b68-9dba-e1d152ff53e2 admin admin] No Content-Type provided in request {{(pid=89578) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:648}} May 28 12:53:03 l75lg1-v1 devstack@m-api.service[89578]: DEBUG manila.api.openstack.wsgi [None req-65dfd117-478c-4b68-9dba-e1d152ff53e2 admin admin] Calling method 'ShareTypesController.index' {{(pid=89578) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:53:03 l75lg1-v1 devstack@m-api.service[89578]: INFO manila.api.openstack.wsgi [None req-65dfd117-478c-4b68-9dba-e1d152ff53e2 admin admin] http://10.27.203.238/share/v2/types?all_tenants=1&is_public=all returned with HTTP 200 May 28 12:53:03 l75lg1-v1 devstack@m-api.service[89578]: [pid: 89578|app: 0|req: 4/9] 10.27.203.238 () {62 vars in 1268 bytes} [Tue May 28 12:53:03 2024] GET /share/v2/types?all_tenants=1&is_public=all => generated 571 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 231 bytes (2 switches on core 0) May 28 12:53:04 l75lg1-v1 dstat.sh[49771]: 28-05 12:53:04| 10 1 89 0 0|4819M 2890M 268M 7669M| 11k 0 | 0 116k| 0 10.0 |1921 2639 |0.56 0.64 0.92|1.0 0 0| 0 0 | 0 2048M| 27 300 0 10 0 May 28 12:53:04 l75lg1-v1 devstack@m-api.service[89579]: INFO manila.api.openstack.wsgi [None req-84b44e13-e4c8-4ab0-9c2a-227582e7ac3e admin admin] GET http://10.27.203.238/share/v2/types?all_tenants=1&is_public=all May 28 12:53:04 l75lg1-v1 devstack@m-api.service[89579]: DEBUG manila.api.openstack.wsgi [None req-84b44e13-e4c8-4ab0-9c2a-227582e7ac3e admin admin] No Content-Type provided in request {{(pid=89579) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:648}} May 28 12:53:04 l75lg1-v1 devstack@m-api.service[89579]: DEBUG manila.api.openstack.wsgi [None req-84b44e13-e4c8-4ab0-9c2a-227582e7ac3e admin admin] Calling method 'ShareTypesController.index' {{(pid=89579) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:53:04 l75lg1-v1 devstack@m-api.service[89579]: DEBUG oslo_db.api [None req-84b44e13-e4c8-4ab0-9c2a-227582e7ac3e admin admin] Loading backend 'sqlalchemy' from 'manila.db.sqlalchemy.api' {{(pid=89579) _load_backend /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/api.py:259}} May 28 12:53:04 l75lg1-v1 devstack@m-api.service[89579]: DEBUG passlib.utils.compat [None req-84b44e13-e4c8-4ab0-9c2a-227582e7ac3e admin admin] loaded lazy attr 'SafeConfigParser': {{(pid=89579) __getattr__ /opt/stack/data/venv/lib/python3.10/site-packages/passlib/utils/compat/__init__.py:449}} May 28 12:53:04 l75lg1-v1 devstack@m-api.service[89579]: DEBUG passlib.utils.compat [None req-84b44e13-e4c8-4ab0-9c2a-227582e7ac3e admin admin] loaded lazy attr 'NativeStringIO': {{(pid=89579) __getattr__ /opt/stack/data/venv/lib/python3.10/site-packages/passlib/utils/compat/__init__.py:449}} May 28 12:53:04 l75lg1-v1 devstack@m-api.service[89579]: DEBUG passlib.utils.compat [None req-84b44e13-e4c8-4ab0-9c2a-227582e7ac3e admin admin] loaded lazy attr 'BytesIO': {{(pid=89579) __getattr__ /opt/stack/data/venv/lib/python3.10/site-packages/passlib/utils/compat/__init__.py:449}} May 28 12:53:04 l75lg1-v1 devstack@m-api.service[89579]: INFO dbcounter [None req-84b44e13-e4c8-4ab0-9c2a-227582e7ac3e admin admin] Registered counter for database manila May 28 12:53:04 l75lg1-v1 devstack@m-api.service[89579]: DEBUG oslo_db.sqlalchemy.engines [None req-84b44e13-e4c8-4ab0-9c2a-227582e7ac3e admin admin] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=89579) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:342}} May 28 12:53:05 l75lg1-v1 devstack@m-api.service[89579]: DEBUG dbcounter [-] [89579] Writer thread running {{(pid=89579) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} May 28 12:53:05 l75lg1-v1 devstack@m-api.service[89579]: INFO manila.api.openstack.wsgi [None req-84b44e13-e4c8-4ab0-9c2a-227582e7ac3e admin admin] http://10.27.203.238/share/v2/types?all_tenants=1&is_public=all returned with HTTP 200 May 28 12:53:05 l75lg1-v1 devstack@m-api.service[89579]: [pid: 89579|app: 0|req: 6/10] 10.27.203.238 () {62 vars in 1268 bytes} [Tue May 28 12:53:03 2024] GET /share/v2/types?all_tenants=1&is_public=all => generated 571 bytes in 1120 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:53:05 l75lg1-v1 devstack@m-api.service[89578]: INFO manila.api.openstack.wsgi [None req-ddeb17f9-c572-4255-87b5-acfc14474c36 admin admin] POST http://10.27.203.238/share/v2/share-group-types May 28 12:53:05 l75lg1-v1 devstack@m-api.service[89578]: DEBUG manila.api.openstack.wsgi [None req-ddeb17f9-c572-4255-87b5-acfc14474c36 admin admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share_group_type": {"name": "default", "is_public": true, "group_specs": {}, "share_types": ["default"]}} {{(pid=89578) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:53:05 l75lg1-v1 devstack@m-api.service[89578]: INFO manila.api.openstack.wsgi [None req-ddeb17f9-c572-4255-87b5-acfc14474c36 admin admin] http://10.27.203.238/share/v2/share-group-types returned with HTTP 200 May 28 12:53:05 l75lg1-v1 devstack@m-api.service[89578]: [pid: 89578|app: 0|req: 5/11] 10.27.203.238 () {66 vars in 1303 bytes} [Tue May 28 12:53:05 2024] POST /share/v2/share-group-types => generated 202 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:53:05 l75lg1-v1 dstat.sh[49771]: 28-05 12:53:05| 10 1 89 0 0|4833M 2876M 268M 7669M| 13k 0 | 0 208k| 0 26.0 |1860 2705 |0.56 0.64 0.92|1.0 0 2.0| 0 0 | 0 2048M| 27 301 0 10 0 May 28 12:53:06 l75lg1-v1 dstat.sh[49771]: 28-05 12:53:06| 10 2 89 0 0|4820M 2890M 268M 7669M| 11k 4505B| 0 112k| 0 10.0 |1960 2608 |0.56 0.64 0.92|2.0 0 34| 0 0 | 0 2048M| 27 301 0 10 0 May 28 12:53:06 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4215e62-21fd-4108-8cea-87d2624ec2e2 None None] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:53:06 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4215e62-21fd-4108-8cea-87d2624ec2e2 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:53:06 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4215e62-21fd-4108-8cea-87d2624ec2e2 None None] PATH_INFO: `/` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:53:06 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 562/1110] 10.27.203.238 () {58 vars in 1014 bytes} [Tue May 28 12:53:06 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:53:06 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd2d60e-b886-4576-8018-9bf0c5927f4e None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:53:06 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd2d60e-b886-4576-8018-9bf0c5927f4e None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:53:06 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd2d60e-b886-4576-8018-9bf0c5927f4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:53:06 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-9bd2d60e-b886-4576-8018-9bf0c5927f4e None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:53:06 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-9bd2d60e-b886-4576-8018-9bf0c5927f4e None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:53:06 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-9bd2d60e-b886-4576-8018-9bf0c5927f4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:53:06 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 549/1111] 10.27.203.238 () {62 vars in 1111 bytes} [Tue May 28 12:53:06 2024] POST /identity/v3/auth/tokens => generated 3991 bytes in 22 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:53:06 l75lg1-v1 devstack@m-api.service[89579]: INFO manila.api.openstack.wsgi [None req-84b44e13-e4c8-4ab0-9c2a-227582e7ac3e admin admin] GET http://10.27.203.238/share// May 28 12:53:06 l75lg1-v1 devstack@m-api.service[89579]: DEBUG manila.api.openstack.wsgi [None req-84b44e13-e4c8-4ab0-9c2a-227582e7ac3e admin admin] No Content-Type provided in request {{(pid=89579) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:648}} May 28 12:53:06 l75lg1-v1 devstack@m-api.service[89579]: DEBUG manila.api.openstack.wsgi [None req-84b44e13-e4c8-4ab0-9c2a-227582e7ac3e admin admin] Calling method 'VersionsController.all' {{(pid=89579) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:53:06 l75lg1-v1 devstack@m-api.service[89579]: INFO manila.api.openstack.wsgi [None req-84b44e13-e4c8-4ab0-9c2a-227582e7ac3e admin admin] http://10.27.203.238/share// returned with HTTP 300 May 28 12:53:06 l75lg1-v1 devstack@m-api.service[89579]: [pid: 89579|app: 0|req: 7/12] 10.27.203.238 () {62 vars in 1190 bytes} [Tue May 28 12:53:06 2024] GET /share/ => generated 752 bytes in 2 msecs (HTTP/1.1 300) 3 headers in 105 bytes (1 switches on core 0) May 28 12:53:06 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4215e62-21fd-4108-8cea-87d2624ec2e2 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:53:06 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4215e62-21fd-4108-8cea-87d2624ec2e2 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:53:06 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec7ed9c-9023-441b-ac6e-e220318274d9 service manila] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f110cf6300f049c897d0aab63218d1e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:53:06 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec7ed9c-9023-441b-ac6e-e220318274d9 service manila] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:53:06 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec7ed9c-9023-441b-ac6e-e220318274d9 service manila] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:53:06 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec7ed9c-9023-441b-ac6e-e220318274d9 service manila] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:53:06 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec7ed9c-9023-441b-ac6e-e220318274d9 service manila] RBAC: Authorizing `identity:validate_token()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:53:06 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec7ed9c-9023-441b-ac6e-e220318274d9 service manila] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:53:06 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 563/1112] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 12:53:06 2024] GET /identity/v3/auth/tokens => generated 3991 bytes in 19 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 12:53:06 l75lg1-v1 devstack@m-api.service[89578]: INFO manila.api.openstack.wsgi [None req-aafb39d1-bfa2-49c8-ac13-ce82aacb4cf7 admin admin] POST http://10.27.203.238/share/v2/types May 28 12:53:06 l75lg1-v1 devstack@m-api.service[89578]: DEBUG manila.api.openstack.wsgi [None req-aafb39d1-bfa2-49c8-ac13-ce82aacb4cf7 admin admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share_type": {"name": "dhss_true", "share_type_access:is_public": true, "extra_specs": {"driver_handles_share_servers": true}}} {{(pid=89578) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:53:06 l75lg1-v1 devstack@m-api.service[89578]: INFO manila.api.openstack.wsgi [None req-aafb39d1-bfa2-49c8-ac13-ce82aacb4cf7 admin admin] http://10.27.203.238/share/v2/types returned with HTTP 200 May 28 12:53:06 l75lg1-v1 devstack@m-api.service[89578]: [pid: 89578|app: 0|req: 6/13] 10.27.203.238 () {66 vars in 1267 bytes} [Tue May 28 12:53:06 2024] POST /share/v2/types => generated 567 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:53:07 l75lg1-v1 dstat.sh[49771]: 28-05 12:53:07| 9 1 89 1 0|4786M 2923M 268M 7669M| 12k 2474B| 0 903k| 0 68.9 |2499 3424 |0.60 0.65 0.92|2.0 0 24| 0 0 | 0 2048M| 27 301 0 10 0 May 28 12:53:08 l75lg1-v1 nova-conductor[83648]: DEBUG dbcounter [-] [83648] Writing DB stats nova_cell1:SELECT=4,nova_cell1:UPDATE=1 {{(pid=83648) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:53:08 l75lg1-v1 dstat.sh[49771]: 28-05 12:53:08| 10 1 89 0 0|4829M 2880M 268M 7669M| 17k 0 | 0 316k| 0 37.0 |1855 2399 |0.60 0.65 0.92|2.0 0 2.0| 0 0 | 0 2048M| 27 301 0 10 0 May 28 12:53:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16cefac-c921-4982-b641-577233b78bc4 None None] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:53:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16cefac-c921-4982-b641-577233b78bc4 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:53:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16cefac-c921-4982-b641-577233b78bc4 None None] PATH_INFO: `/` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:53:08 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 550/1113] 10.27.203.238 () {58 vars in 1014 bytes} [Tue May 28 12:53:08 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:53:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117f80a5-315a-4c13-acc2-23e2a957a5a2 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:53:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117f80a5-315a-4c13-acc2-23e2a957a5a2 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:53:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117f80a5-315a-4c13-acc2-23e2a957a5a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:53:08 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-117f80a5-315a-4c13-acc2-23e2a957a5a2 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:53:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-117f80a5-315a-4c13-acc2-23e2a957a5a2 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:53:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-117f80a5-315a-4c13-acc2-23e2a957a5a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:53:08 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 564/1114] 10.27.203.238 () {62 vars in 1111 bytes} [Tue May 28 12:53:08 2024] POST /identity/v3/auth/tokens => generated 3991 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:53:08 l75lg1-v1 devstack@m-api.service[89579]: INFO manila.api.openstack.wsgi [None req-84b44e13-e4c8-4ab0-9c2a-227582e7ac3e admin admin] GET http://10.27.203.238/share// May 28 12:53:08 l75lg1-v1 devstack@m-api.service[89579]: DEBUG manila.api.openstack.wsgi [None req-84b44e13-e4c8-4ab0-9c2a-227582e7ac3e admin admin] No Content-Type provided in request {{(pid=89579) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:648}} May 28 12:53:08 l75lg1-v1 devstack@m-api.service[89579]: DEBUG manila.api.openstack.wsgi [None req-84b44e13-e4c8-4ab0-9c2a-227582e7ac3e admin admin] Calling method 'VersionsController.all' {{(pid=89579) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:53:08 l75lg1-v1 devstack@m-api.service[89579]: INFO manila.api.openstack.wsgi [None req-84b44e13-e4c8-4ab0-9c2a-227582e7ac3e admin admin] http://10.27.203.238/share// returned with HTTP 300 May 28 12:53:08 l75lg1-v1 devstack@m-api.service[89579]: [pid: 89579|app: 0|req: 8/14] 10.27.203.238 () {62 vars in 1190 bytes} [Tue May 28 12:53:08 2024] GET /share/ => generated 752 bytes in 3 msecs (HTTP/1.1 300) 3 headers in 105 bytes (1 switches on core 0) May 28 12:53:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16cefac-c921-4982-b641-577233b78bc4 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:53:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16cefac-c921-4982-b641-577233b78bc4 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:53:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8913591-e161-448e-9dbb-f18106f2a878 service manila] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f110cf6300f049c897d0aab63218d1e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:53:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8913591-e161-448e-9dbb-f18106f2a878 service manila] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:53:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8913591-e161-448e-9dbb-f18106f2a878 service manila] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:53:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8913591-e161-448e-9dbb-f18106f2a878 service manila] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:53:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8913591-e161-448e-9dbb-f18106f2a878 service manila] RBAC: Authorizing `identity:validate_token()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:53:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8913591-e161-448e-9dbb-f18106f2a878 service manila] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:53:08 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 551/1115] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 12:53:08 2024] GET /identity/v3/auth/tokens => generated 3991 bytes in 22 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 12:53:08 l75lg1-v1 devstack@m-api.service[89578]: INFO manila.api.openstack.wsgi [None req-fbdd2058-0e62-485c-bc9b-437e91cc34e3 admin admin] POST http://10.27.203.238/share/v2/types May 28 12:53:08 l75lg1-v1 devstack@m-api.service[89578]: DEBUG manila.api.openstack.wsgi [None req-fbdd2058-0e62-485c-bc9b-437e91cc34e3 admin admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share_type": {"name": "dhss_false", "share_type_access:is_public": true, "extra_specs": {"driver_handles_share_servers": false}}} {{(pid=89578) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:53:08 l75lg1-v1 devstack@m-api.service[89578]: INFO manila.api.openstack.wsgi [None req-fbdd2058-0e62-485c-bc9b-437e91cc34e3 admin admin] http://10.27.203.238/share/v2/types returned with HTTP 200 May 28 12:53:08 l75lg1-v1 devstack@m-api.service[89578]: [pid: 89578|app: 0|req: 7/15] 10.27.203.238 () {66 vars in 1267 bytes} [Tue May 28 12:53:08 2024] POST /share/v2/types => generated 573 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:53:09 l75lg1-v1 dstat.sh[49771]: 28-05 12:53:09| 7 3 88 0 0|4776M 2933M 268M 7669M| 18k 18k| 0 416k| 0 37.0 |3817 4671 |0.60 0.65 0.92|2.0 0 214| 0 0 | 0 2048M| 27 301 0 10 0 May 28 12:53:09 l75lg1-v1 nova-conductor[83647]: DEBUG dbcounter [-] [83647] Writing DB stats nova_cell1:SELECT=4,nova_cell1:UPDATE=4 {{(pid=83647) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:53:09 l75lg1-v1 nova-conductor[83648]: DEBUG dbcounter [-] [83648] Writing DB stats nova_cell1:SELECT=1 {{(pid=83648) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:53:10 l75lg1-v1 dstat.sh[49771]: 28-05 12:53:10| 1 0 99 0 0|4776M 2934M 268M 7669M| 11k 655B| 0 144k| 0 26.0 |1676 2596 |0.60 0.65 0.92|1.0 0 9.0| 0 0 | 0 2048M| 27 301 0 10 0 May 28 12:53:10 l75lg1-v1 neutron-server[77618]: DEBUG dbcounter [-] [77618] Writing DB stats neutron:UPDATE=1 {{(pid=77618) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:53:10 l75lg1-v1 neutron-server[77618]: DEBUG dbcounter [-] [77618] Writing DB stats neutron:SELECT=1 {{(pid=77618) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:53:11 l75lg1-v1 cinder-scheduler[85128]: DEBUG dbcounter [-] [85128] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=85128) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:53:11 l75lg1-v1 dstat.sh[49771]: 28-05 12:53:11| 10 1 89 0 0|4822M 2887M 268M 7669M| 11k 640B| 0 1797k| 0 323 |1823 2348 |0.60 0.65 0.92|1.0 0 5.0| 0 0 | 0 2048M| 27 301 0 10 0 May 28 12:53:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e159ec1-6e47-4edc-848f-a9dd46a9d102 None None] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:53:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e159ec1-6e47-4edc-848f-a9dd46a9d102 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:53:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e159ec1-6e47-4edc-848f-a9dd46a9d102 None None] PATH_INFO: `/` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:53:11 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 565/1116] 10.27.203.238 () {58 vars in 1014 bytes} [Tue May 28 12:53:11 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:53:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183c1435-5b1e-4b8a-b8be-f9f79b199d73 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:53:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183c1435-5b1e-4b8a-b8be-f9f79b199d73 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:53:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183c1435-5b1e-4b8a-b8be-f9f79b199d73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:53:11 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-183c1435-5b1e-4b8a-b8be-f9f79b199d73 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:53:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-183c1435-5b1e-4b8a-b8be-f9f79b199d73 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:53:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-183c1435-5b1e-4b8a-b8be-f9f79b199d73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:53:11 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 552/1117] 10.27.203.238 () {62 vars in 1111 bytes} [Tue May 28 12:53:11 2024] POST /identity/v3/auth/tokens => generated 3991 bytes in 23 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:53:11 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi [None req-01935d90-cea8-4366-8c58-d36e228c38f3 admin admin] Calling method '>' {{(pid=74000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} May 28 12:53:11 l75lg1-v1 devstack@n-api.service[74000]: INFO nova.api.openstack.requestlog [None req-01935d90-cea8-4366-8c58-d36e228c38f3 admin admin] 10.27.203.238 "GET /compute/v2.1" status: 200 len: 390 microversion: 2.1 time: 0.001675 May 28 12:53:11 l75lg1-v1 devstack@n-api.service[74000]: [pid: 74000|app: 0|req: 23/44] 10.27.203.238 () {58 vars in 1013 bytes} [Tue May 28 12:53:11 2024] GET /compute/v2.1 => generated 390 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 12:53:11 l75lg1-v1 devstack@n-api.service[73999]: DEBUG dbcounter [-] [73999] Writing DB stats nova_cell0:SELECT=2 {{(pid=73999) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:53:11 l75lg1-v1 devstack@n-api.service[73999]: DEBUG dbcounter [-] [73999] Writing DB stats nova_api:SELECT=6,nova_api:INSERT=1 {{(pid=73999) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:53:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e159ec1-6e47-4edc-848f-a9dd46a9d102 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:53:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e159ec1-6e47-4edc-848f-a9dd46a9d102 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:53:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a3784d-7dd9-4c1d-91c8-bc86a1c191b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'befdd4414dc2432ab2baa1ae3fbffef7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'manager', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:53:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a3784d-7dd9-4c1d-91c8-bc86a1c191b3 service nova] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:53:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a3784d-7dd9-4c1d-91c8-bc86a1c191b3 service nova] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:53:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a3784d-7dd9-4c1d-91c8-bc86a1c191b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:53:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a3784d-7dd9-4c1d-91c8-bc86a1c191b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:53:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a3784d-7dd9-4c1d-91c8-bc86a1c191b3 service nova] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:53:11 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 566/1118] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 12:53:11 2024] GET /identity/v3/auth/tokens => generated 3991 bytes in 21 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 12:53:11 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi [None req-af68ccc5-2cdd-4c21-b1e4-1f0f45a74a00 admin admin] Calling method '>' {{(pid=73999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} May 28 12:53:11 l75lg1-v1 devstack@n-api.service[73999]: DEBUG oslo_concurrency.lockutils [None req-af68ccc5-2cdd-4c21-b1e4-1f0f45a74a00 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=73999) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:53:11 l75lg1-v1 devstack@n-api.service[73999]: DEBUG oslo_concurrency.lockutils [None req-af68ccc5-2cdd-4c21-b1e4-1f0f45a74a00 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=73999) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:53:11 l75lg1-v1 devstack@n-api.service[73999]: DEBUG oslo_concurrency.lockutils [None req-af68ccc5-2cdd-4c21-b1e4-1f0f45a74a00 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=73999) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:53:11 l75lg1-v1 devstack@n-api.service[73999]: DEBUG oslo_concurrency.lockutils [None req-af68ccc5-2cdd-4c21-b1e4-1f0f45a74a00 admin admin] Acquiring lock "07f8d545-d202-434b-a916-12ac42ffae61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=73999) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:53:11 l75lg1-v1 devstack@n-api.service[73999]: DEBUG oslo_concurrency.lockutils [None req-af68ccc5-2cdd-4c21-b1e4-1f0f45a74a00 admin admin] Lock "07f8d545-d202-434b-a916-12ac42ffae61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=73999) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:53:11 l75lg1-v1 devstack@n-api.service[73999]: DEBUG oslo_concurrency.lockutils [None req-af68ccc5-2cdd-4c21-b1e4-1f0f45a74a00 admin admin] Lock "07f8d545-d202-434b-a916-12ac42ffae61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=73999) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:53:11 l75lg1-v1 devstack@n-api.service[73999]: INFO nova.api.openstack.requestlog [None req-af68ccc5-2cdd-4c21-b1e4-1f0f45a74a00 admin admin] 10.27.203.238 "GET /compute/v2.1/os-services?binary=nova-compute&host=l75lg1-v1" status: 200 len: 252 microversion: 2.69 time: 0.065474 May 28 12:53:11 l75lg1-v1 devstack@n-api.service[73999]: [pid: 73999|app: 0|req: 22/45] 10.27.203.238 () {64 vars in 1405 bytes} [Tue May 28 12:53:11 2024] GET /compute/v2.1/os-services?binary=nova-compute&host=l75lg1-v1 => generated 252 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 12:53:12 l75lg1-v1 dstat.sh[49771]: 28-05 12:53:12| 8 2 88 0 0|4776M 2933M 268M 7669M| 21k 15k| 0 284k| 0 25.0 |3037 3844 |0.63 0.66 0.92|1.0 0 85| 0 0 | 0 2048M| 27 305 0 10 0 May 28 12:53:12 l75lg1-v1 neutron-server[77623]: DEBUG dbcounter [-] [77623] Writing DB stats neutron:SELECT=1 {{(pid=77623) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:53:12 l75lg1-v1 neutron-server[77623]: DEBUG dbcounter [-] [77623] Writing DB stats neutron:SELECT=2 {{(pid=77623) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:53:12 l75lg1-v1 cinder-volume[85846]: DEBUG dbcounter [-] [85846] Writing DB stats cinder:SELECT=1 {{(pid=85846) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:53:12 l75lg1-v1 cinder-volume[85846]: DEBUG dbcounter [-] [85846] Writing DB stats cinder:UPDATE=1 {{(pid=85846) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:53:13 l75lg1-v1 dstat.sh[49771]: 28-05 12:53:13| 5 7 87 0 0|4776M 2933M 268M 7669M| 14k 67k| 0 172k| 0 19.0 |4752 5381 |0.63 0.66 0.92|1.0 0 227| 0 0 | 0 2048M| 27 305 0 10 0 May 28 12:53:14 l75lg1-v1 dstat.sh[49771]: 28-05 12:53:14| 9 2 89 0 0|4818M 2891M 268M 7669M| 10k 5819B| 0 136k| 0 18.0 |1998 2716 |0.63 0.66 0.92|1.0 0 40| 0 0 | 0 2048M| 27 305 0 10 0 May 28 12:53:14 l75lg1-v1 neutron-server[77623]: DEBUG neutron.db.agents_db [None req-fe40ce8c-640e-4db7-a17a-6e8888cce266 None None] Agent healthcheck: found 0 active agents {{(pid=77623) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:319}} May 28 12:53:15 l75lg1-v1 devstack@m-api.service[89579]: DEBUG dbcounter [-] [89579] Writing DB stats manila:SELECT=1 {{(pid=89579) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:53:15 l75lg1-v1 dstat.sh[49771]: 28-05 12:53:15| 9 1 89 0 0|4859M 2850M 268M 7669M| 13k 0 | 0 36k| 0 5.00 |1607 2282 |0.63 0.66 0.92|1.0 0 1.0| 0 0 | 0 2048M| 27 307 0 10 0 May 28 12:53:16 l75lg1-v1 dstat.sh[49771]: 28-05 12:53:16| 10 0 89 0 0|4894M 2815M 268M 7669M|9513B 1320B| 0 116k| 0 21.0 |1733 2549 |0.63 0.66 0.92|1.0 0 2.0| 0 0 | 0 2048M| 27 311 0 10 0 May 28 12:53:17 l75lg1-v1 dstat.sh[49771]: 28-05 12:53:17| 10 1 89 0 0|4799M 2910M 268M 7669M| 16k 588B| 0 420k| 0 39.0 |2078 2978 |0.66 0.66 0.92|1.0 0 3.0| 0 0 | 0 2048M| 27 307 0 10 0 May 28 12:53:18 l75lg1-v1 dstat.sh[49771]: 28-05 12:53:18| 10 1 89 0 0|4839M 2870M 268M 7669M| 19k 0 | 0 192k| 0 10.0 |1717 2317 |0.66 0.66 0.92|1.0 0 2.0| 0 0 | 0 2048M| 27 307 0 10 0 May 28 12:53:18 l75lg1-v1 devstack@m-api.service[89578]: DEBUG dbcounter [-] [89578] Writing DB stats manila:SELECT=9,manila:INSERT=8 {{(pid=89578) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:53:19 l75lg1-v1 dstat.sh[49771]: 28-05 12:53:19| 10 1 89 0 0|4881M 2827M 268M 7669M| 21k 172B| 0 480k| 0 43.0 |1775 2357 |0.66 0.66 0.92|1.0 0 1.0| 0 0 | 0 2048M| 27 309 0 10 0 May 28 12:53:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cb6ee2-a456-480b-b17c-9f3254cf2f6d None None] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:53:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cb6ee2-a456-480b-b17c-9f3254cf2f6d None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:53:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cb6ee2-a456-480b-b17c-9f3254cf2f6d None None] PATH_INFO: `/` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:53:19 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 553/1119] 10.27.203.238 () {58 vars in 1007 bytes} [Tue May 28 12:53:19 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:53:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b74820a-c9e6-4a9f-ae51-b48fcf8a15b7 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:53:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b74820a-c9e6-4a9f-ae51-b48fcf8a15b7 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:53:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b74820a-c9e6-4a9f-ae51-b48fcf8a15b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:53:19 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-4b74820a-c9e6-4a9f-ae51-b48fcf8a15b7 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:53:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-4b74820a-c9e6-4a9f-ae51-b48fcf8a15b7 None None] MFA Rules not processed for user `c3fe870f285d4169bd917382dd02d7b0`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:53:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-4b74820a-c9e6-4a9f-ae51-b48fcf8a15b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:53:19 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 567/1120] 10.27.203.238 () {62 vars in 1104 bytes} [Tue May 28 12:53:19 2024] POST /identity/v3/auth/tokens => generated 4060 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:53:19 l75lg1-v1 devstack@placement-api.service[78201]: DEBUG placement.requestlog [None req-14689d1b-739b-4226-ac9f-4ab09d16db5f None None] Starting request: 10.27.203.238 "GET /placement//" {{(pid=78201) __call__ /opt/stack/placement/placement/requestlog.py:55}} May 28 12:53:19 l75lg1-v1 devstack@placement-api.service[78201]: INFO placement.requestlog [None req-14689d1b-739b-4226-ac9f-4ab09d16db5f None None] 10.27.203.238 "GET /placement//" status: 200 len: 136 microversion: 1.0 May 28 12:53:19 l75lg1-v1 devstack@placement-api.service[78201]: [pid: 78201|app: 0|req: 16/32] 10.27.203.238 () {60 vars in 1195 bytes} [Tue May 28 12:53:19 2024] GET /placement/ => generated 136 bytes in 1 msecs (HTTP/1.1 200) 6 headers in 224 bytes (1 switches on core 0) May 28 12:53:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d614b5-7abd-4ed5-ad5e-4a4b18ba07b0 None None] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:53:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d614b5-7abd-4ed5-ad5e-4a4b18ba07b0 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:53:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d614b5-7abd-4ed5-ad5e-4a4b18ba07b0 None None] PATH_INFO: `/` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:53:19 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 554/1121] 10.27.203.238 () {58 vars in 1007 bytes} [Tue May 28 12:53:19 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:53:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b07e20-0c13-40c3-b731-79cd84d6e8b5 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:53:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b07e20-0c13-40c3-b731-79cd84d6e8b5 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:53:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b07e20-0c13-40c3-b731-79cd84d6e8b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:53:19 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-f9b07e20-0c13-40c3-b731-79cd84d6e8b5 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:53:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-f9b07e20-0c13-40c3-b731-79cd84d6e8b5 None None] MFA Rules not processed for user `befdd4414dc2432ab2baa1ae3fbffef7`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:53:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-f9b07e20-0c13-40c3-b731-79cd84d6e8b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:53:19 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 568/1122] 10.27.203.238 () {62 vars in 1104 bytes} [Tue May 28 12:53:19 2024] POST /identity/v3/auth/tokens => generated 4055 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:53:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc2750f-c200-4f12-abf2-af7537383c94 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:53:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc2750f-c200-4f12-abf2-af7537383c94 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:53:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc2750f-c200-4f12-abf2-af7537383c94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:53:19 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-5dc2750f-c200-4f12-abf2-af7537383c94 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:53:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-5dc2750f-c200-4f12-abf2-af7537383c94 None None] MFA Rules not processed for user `befdd4414dc2432ab2baa1ae3fbffef7`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:53:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-5dc2750f-c200-4f12-abf2-af7537383c94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:53:19 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 555/1123] 10.27.203.238 () {62 vars in 1104 bytes} [Tue May 28 12:53:19 2024] POST /identity/v3/auth/tokens => generated 4055 bytes in 23 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:53:19 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.middleware.request_id [None req-5467384a-6f13-4e56-aaca-8c89af0b32bd None None] RequestId filter calling following filter/app {{(pid=84424) _context_setter /opt/stack/cinder/cinder/api/middleware/request_id.py:62}} May 28 12:53:19 l75lg1-v1 devstack@c-api.service[84424]: INFO cinder.api.openstack.wsgi [None req-5467384a-6f13-4e56-aaca-8c89af0b32bd None None] GET http://10.27.203.238/volume// May 28 12:53:19 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.openstack.wsgi [None req-5467384a-6f13-4e56-aaca-8c89af0b32bd None None] Empty body provided in request {{(pid=84424) get_body /opt/stack/cinder/cinder/api/openstack/wsgi.py:715}} May 28 12:53:19 l75lg1-v1 devstack@c-api.service[84424]: DEBUG cinder.api.openstack.wsgi [None req-5467384a-6f13-4e56-aaca-8c89af0b32bd None None] Calling method 'all' {{(pid=84424) _process_stack /opt/stack/cinder/cinder/api/openstack/wsgi.py:868}} May 28 12:53:19 l75lg1-v1 devstack@c-api.service[84424]: INFO cinder.api.openstack.wsgi [None req-5467384a-6f13-4e56-aaca-8c89af0b32bd None None] http://10.27.203.238/volume// returned with HTTP 300 May 28 12:53:19 l75lg1-v1 devstack@c-api.service[84424]: [pid: 84424|app: 0|req: 3/4] 10.27.203.238 () {62 vars in 1394 bytes} [Tue May 28 12:53:19 2024] GET /volume/ => generated 388 bytes in 5 msecs (HTTP/1.1 300) 7 headers in 299 bytes (1 switches on core 0) May 28 12:53:19 l75lg1-v1 nova-conductor[83647]: DEBUG dbcounter [-] [83647] Writing DB stats nova_cell1:SELECT=1,nova_cell1:UPDATE=1 {{(pid=83647) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:53:19 l75lg1-v1 nova-conductor[83648]: DEBUG dbcounter [-] [83648] Writing DB stats nova_cell1:SELECT=1 {{(pid=83648) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:53:20 l75lg1-v1 dstat.sh[49771]: 28-05 12:53:20| 10 1 89 0 0|4779M 2929M 268M 7669M| 14k 2112B| 0 1016k| 0 148 |2547 3675 |0.66 0.66 0.92|1.0 0 15| 0 0 | 0 2048M| 27 309 0 10 0 May 28 12:53:21 l75lg1-v1 dstat.sh[49771]: 28-05 12:53:21| 9 1 89 0 0|4826M 2882M 268M 7669M| 15k 0 | 0 44k| 0 2.00 |1571 2228 |0.66 0.66 0.92|2.0 0 0| 0 0 | 0 2048M| 27 309 0 10 0 May 28 12:53:22 l75lg1-v1 dstat.sh[49771]: 28-05 12:53:22| 10 1 89 0 0|4836M 2873M 268M 7670M| 18k 0 | 0 132k| 0 17.0 |1583 2158 |0.69 0.67 0.92|3.0 0 0| 0 0 | 0 2048M| 27 309 0 10 0 May 28 12:53:23 l75lg1-v1 dstat.sh[49771]: 28-05 12:53:23| 6 6 88 0 0|4790M 2918M 268M 7670M| 21k 44k| 513k 240k|4.00 7.01 |4120 4501 |0.69 0.67 0.92|2.0 0 318| 0 0 | 0 2048M| 27 309 0 10 0 May 28 12:53:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "_check_child_processes" by "neutron.agent.linux.external_process.ProcessMonitor._check_child_processes" {{(pid=76818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:53:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_concurrency.lockutils [-] Lock "_check_child_processes" acquired by "neutron.agent.linux.external_process.ProcessMonitor._check_child_processes" :: waited 0.001s {{(pid=76818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:53:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_concurrency.lockutils [-] Lock "_check_child_processes" "released" by "neutron.agent.linux.external_process.ProcessMonitor._check_child_processes" :: held 0.000s {{(pid=76818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:53:24 l75lg1-v1 dstat.sh[49771]: 28-05 12:53:24| 9 2 89 0 0|4810M 2899M 268M 7670M| 11k 3975B| 0 28k| 0 2.00 |1903 2417 |0.69 0.67 0.92|2.0 0 52| 0 0 | 0 2048M| 27 309 0 10 0 May 28 12:53:24 l75lg1-v1 neutron-server[77623]: DEBUG dbcounter [-] [77623] Writing DB stats neutron:SELECT=1 {{(pid=77623) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:53:25 l75lg1-v1 dstat.sh[49771]: 28-05 12:53:25| 12 1 86 0 0|4821M 2888M 268M 7670M| 14k 284B| 0 216k| 0 8.00 |2891 4579 |0.69 0.67 0.92|1.0 0 47| 0 0 | 0 2048M| 27 309 0 10 0 May 28 12:53:25 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_service.periodic_task [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85846) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:53:25 l75lg1-v1 cinder-volume[85846]: DEBUG cinder.volume.drivers.lvm [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] Updating volume stats {{(pid=85846) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}} May 28 12:53:25 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:390}} May 28 12:53:25 l75lg1-v1 sudo[90949]: vastdata : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 May 28 12:53:25 l75lg1-v1 sudo[90949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) May 28 12:53:26 l75lg1-v1 sudo[90949]: pam_unix(sudo:session): session closed for user root May 28 12:53:26 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.467s {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:428}} May 28 12:53:26 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:390}} May 28 12:53:26 l75lg1-v1 sudo[90960]: vastdata : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 May 28 12:53:26 l75lg1-v1 sudo[90960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) May 28 12:53:26 l75lg1-v1 dstat.sh[49771]: 28-05 12:53:26| 14 3 83 0 0|4815M 2893M 268M 7670M| 13k 6530B| 384k 2672k|3.00 431 | 11k 22k|0.69 0.67 0.92|2.0 0 17| 0 0 | 0 2048M| 27 309 0 10 0 May 28 12:53:26 l75lg1-v1 sudo[90960]: pam_unix(sudo:session): session closed for user root May 28 12:53:26 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.511s {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:428}} May 28 12:53:26 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:390}} May 28 12:53:26 l75lg1-v1 sudo[90963]: vastdata : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool May 28 12:53:26 l75lg1-v1 sudo[90963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) May 28 12:53:27 l75lg1-v1 sudo[90963]: pam_unix(sudo:session): session closed for user root May 28 12:53:27 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.471s {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:428}} May 28 12:53:27 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:390}} May 28 12:53:27 l75lg1-v1 sudo[90966]: vastdata : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 May 28 12:53:27 l75lg1-v1 sudo[90966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) May 28 12:53:27 l75lg1-v1 dstat.sh[49771]: 28-05 12:53:27| 18 2 79 1 0|4821M 2888M 268M 7670M| 16k 7270B| 640k 472k|5.00 35.0 |2458 2937 |0.79 0.69 0.92|3.0 0 6.0| 0 0 | 0 2048M| 27 309 0 10 0 May 28 12:53:27 l75lg1-v1 sudo[90966]: pam_unix(sudo:session): session closed for user root May 28 12:53:27 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.470s {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:428}} May 28 12:53:27 l75lg1-v1 cinder-volume[85846]: DEBUG cinder.manager [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] Notifying Schedulers of capabilities ... {{(pid=85846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 28 12:53:27 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.scheduler.host_manager [None req-cf1e2a92-0d49-4e6f-b307-a896bcd4734e None None] Received volume service update from l75lg1-v1@lvmdriver-1: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:l75lg1-v1:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up', 'allocated_capacity_gb': 0, 'cacheable': True}], 'shared_targets': False, 'sparse_copy_volume': True, 'filter_function': None, 'goodness_function': None} {{(pid=85128) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:628}} May 28 12:53:28 l75lg1-v1 dstat.sh[49771]: 28-05 12:53:28| 13 1 85 0 0|4821M 2887M 268M 7670M| 14k 0 | 256k 0 |2.00 0 |1940 2270 |0.79 0.69 0.92|1.0 0 9.0| 0 0 | 0 2048M| 27 309 0 10 0 May 28 12:53:29 l75lg1-v1 dstat.sh[49771]: 28-05 12:53:29| 9 2 88 0 0|4847M 2861M 268M 7670M| 18k 1768B| 0 40k| 0 5.00 |9937 20k|0.79 0.69 0.92|1.0 0 6.0| 0 0 | 0 2048M| 27 309 0 10 0 May 28 12:53:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG dbcounter [-] [51267] Writing DB stats keystone:SELECT=189 {{(pid=51267) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:53:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG dbcounter [-] [51266] Writing DB stats keystone:SELECT=196 {{(pid=51266) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:53:29 l75lg1-v1 nova-conductor[83647]: DEBUG dbcounter [-] [83647] Writing DB stats nova_cell1:SELECT=1,nova_cell1:UPDATE=1 {{(pid=83647) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:53:29 l75lg1-v1 nova-conductor[83648]: DEBUG dbcounter [-] [83648] Writing DB stats nova_cell1:SELECT=1 {{(pid=83648) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:53:30 l75lg1-v1 dstat.sh[49771]: 28-05 12:53:30| 9 2 88 1 0|4823M 2902M 268M 7656M| 13k 0 | 0 2652k| 0 120 |2040 2893 |0.79 0.69 0.92|1.0 0 7.0| 0 0 | 0 2048M| 27 309 0 10 0 May 28 12:53:30 l75lg1-v1 neutron-server[77618]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.HashRingHealthCheckPeriodics.touch_hash_ring_nodes' {{(pid=77618) _process_scheduled /opt/stack/data/venv/lib/python3.10/site-packages/futurist/periodics.py:638}} May 28 12:53:30 l75lg1-v1 neutron-server[77622]: DEBUG futurist.periodics [None req-fbd03350-93f0-48b6-99af-923b4570b093 None None] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_for_inconsistencies' {{(pid=77622) _process_scheduled /opt/stack/data/venv/lib/python3.10/site-packages/futurist/periodics.py:638}} May 28 12:53:30 l75lg1-v1 neutron-server[77622]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-fbd03350-93f0-48b6-99af-923b4570b093 None None] Maintenance task: No inconsistencies found. Skipping {{(pid=77622) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:337}} May 28 12:53:31 l75lg1-v1 neutron-server[77622]: DEBUG futurist.periodics [None req-fbd03350-93f0-48b6-99af-923b4570b093 None None] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.remove_duplicated_chassis_registers' {{(pid=77622) _process_scheduled /opt/stack/data/venv/lib/python3.10/site-packages/futurist/periodics.py:638}} May 28 12:53:31 l75lg1-v1 dstat.sh[49771]: 28-05 12:53:31| 9 2 88 0 0|4810M 2915M 268M 7656M| 24k 11k| 0 84k| 0 16.0 |2958 3534 |0.79 0.69 0.92|1.0 0 138| 0 0 | 0 2048M| 27 309 0 10 0 May 28 12:53:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aed8036-e172-4ae8-ba1f-4184814932c7 None None] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:53:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aed8036-e172-4ae8-ba1f-4184814932c7 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:53:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aed8036-e172-4ae8-ba1f-4184814932c7 None None] PATH_INFO: `/` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:53:32 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 569/1124] 10.27.203.238 () {58 vars in 1014 bytes} [Tue May 28 12:53:32 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:53:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6ea8e4-5be6-4370-9b5e-e2ac5951b7b5 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:53:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6ea8e4-5be6-4370-9b5e-e2ac5951b7b5 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:53:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6ea8e4-5be6-4370-9b5e-e2ac5951b7b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:53:32 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-1a6ea8e4-5be6-4370-9b5e-e2ac5951b7b5 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:53:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-1a6ea8e4-5be6-4370-9b5e-e2ac5951b7b5 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:53:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-1a6ea8e4-5be6-4370-9b5e-e2ac5951b7b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:53:32 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 556/1125] 10.27.203.238 () {62 vars in 1111 bytes} [Tue May 28 12:53:32 2024] POST /identity/v3/auth/tokens => generated 3991 bytes in 23 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:53:32 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.api.middleware.version_negotiation [None req-84e3042c-1473-401c-814a-24133eef81d3 admin admin] Determining version of request: GET / Accept: application/json {{(pid=86374) process_request /opt/stack/glance/glance/api/middleware/version_negotiation.py:44}} May 28 12:53:32 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.api.middleware.version_negotiation [None req-84e3042c-1473-401c-814a-24133eef81d3 admin admin] Using url versioning {{(pid=86374) process_request /opt/stack/glance/glance/api/middleware/version_negotiation.py:57}} May 28 12:53:32 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.api.middleware.version_negotiation [None req-84e3042c-1473-401c-814a-24133eef81d3 admin admin] Unknown version. Returning version choices. {{(pid=86374) process_request /opt/stack/glance/glance/api/middleware/version_negotiation.py:64}} May 28 12:53:32 l75lg1-v1 devstack@g-api.service[86374]: [pid: 86374|app: 0|req: 6/10] 127.0.0.1 () {34 vars in 509 bytes} [Tue May 28 12:53:32 2024] GET / => generated 1323 bytes in 3 msecs (HTTP/1.1 300) 3 headers in 106 bytes (1 switches on core 0) May 28 12:53:32 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.api.middleware.version_negotiation [None req-f6fbf2d2-1817-49f5-bad5-0a909ee041db admin admin] Determining version of request: GET /v2/images Accept: application/json {{(pid=86373) process_request /opt/stack/glance/glance/api/middleware/version_negotiation.py:44}} May 28 12:53:32 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.api.middleware.version_negotiation [None req-f6fbf2d2-1817-49f5-bad5-0a909ee041db admin admin] Using url versioning {{(pid=86373) process_request /opt/stack/glance/glance/api/middleware/version_negotiation.py:57}} May 28 12:53:32 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.api.middleware.version_negotiation [None req-f6fbf2d2-1817-49f5-bad5-0a909ee041db admin admin] Matched version: v2 {{(pid=86373) process_request /opt/stack/glance/glance/api/middleware/version_negotiation.py:69}} May 28 12:53:32 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.api.middleware.version_negotiation [None req-f6fbf2d2-1817-49f5-bad5-0a909ee041db admin admin] new path /v2/images {{(pid=86373) process_request /opt/stack/glance/glance/api/middleware/version_negotiation.py:70}} May 28 12:53:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aed8036-e172-4ae8-ba1f-4184814932c7 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:53:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aed8036-e172-4ae8-ba1f-4184814932c7 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:53:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58491c3a-58ad-4d58-a4c1-a4045440e5d1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1436e60c2e34e0b8af9ae1c668bdf03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:53:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58491c3a-58ad-4d58-a4c1-a4045440e5d1 service glance] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:53:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58491c3a-58ad-4d58-a4c1-a4045440e5d1 service glance] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:53:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58491c3a-58ad-4d58-a4c1-a4045440e5d1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:53:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58491c3a-58ad-4d58-a4c1-a4045440e5d1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:53:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58491c3a-58ad-4d58-a4c1-a4045440e5d1 service glance] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:53:32 l75lg1-v1 dstat.sh[49771]: 28-05 12:53:32| 10 1 89 0 0|4839M 2886M 268M 7656M| 16k 0 | 0 0 | 0 0 |1616 2299 |0.81 0.70 0.92|2.0 0 0| 0 0 | 0 2048M| 27 313 0 11 0 May 28 12:53:32 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 570/1126] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 12:53:32 2024] GET /identity/v3/auth/tokens => generated 3991 bytes in 19 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 12:53:32 l75lg1-v1 devstack@g-api.service[86373]: [pid: 86373|app: 0|req: 5/11] 127.0.0.1 () {36 vars in 731 bytes} [Tue May 28 12:53:32 2024] GET /v2/images => generated 2031 bytes in 56 msecs (HTTP/1.1 200) 4 headers in 158 bytes (1 switches on core 0) May 28 12:53:33 l75lg1-v1 dstat.sh[49771]: 28-05 12:53:33| 9 1 89 0 0|4811M 2913M 268M 7656M| 11k 6465B| 0 4094B| 0 1.00 |2158 2763 |0.81 0.70 0.92|3.0 0 80| 0 0 | 0 2048M| 27 309 0 13 0 May 28 12:53:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c540cd1-830c-44d7-a448-8690caa078f5 None None] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:53:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c540cd1-830c-44d7-a448-8690caa078f5 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:53:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c540cd1-830c-44d7-a448-8690caa078f5 None None] PATH_INFO: `/` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:53:33 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 557/1127] 10.27.203.238 () {58 vars in 1014 bytes} [Tue May 28 12:53:33 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:53:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c0ac2e-7588-4b62-913e-c7ac788e691d None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:53:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c0ac2e-7588-4b62-913e-c7ac788e691d None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:53:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c0ac2e-7588-4b62-913e-c7ac788e691d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:53:33 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-30c0ac2e-7588-4b62-913e-c7ac788e691d None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:53:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-30c0ac2e-7588-4b62-913e-c7ac788e691d None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:53:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-30c0ac2e-7588-4b62-913e-c7ac788e691d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:53:33 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 571/1128] 10.27.203.238 () {62 vars in 1111 bytes} [Tue May 28 12:53:33 2024] POST /identity/v3/auth/tokens => generated 3991 bytes in 22 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:53:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c540cd1-830c-44d7-a448-8690caa078f5 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:53:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c540cd1-830c-44d7-a448-8690caa078f5 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:53:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fe4479-3668-4685-91e9-c27e91b9ccd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8d517cde1d40bb82c97e080ce071f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:53:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fe4479-3668-4685-91e9-c27e91b9ccd2 admin admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:53:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fe4479-3668-4685-91e9-c27e91b9ccd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:53:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fe4479-3668-4685-91e9-c27e91b9ccd2 admin admin] PATH_INFO: `/v3/projects` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:53:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fe4479-3668-4685-91e9-c27e91b9ccd2 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:53:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fe4479-3668-4685-91e9-c27e91b9ccd2 admin admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:53:34 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 558/1129] 10.27.203.238 () {60 vars in 1196 bytes} [Tue May 28 12:53:33 2024] GET /identity/v3/projects => generated 1618 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:53:34 l75lg1-v1 dstat.sh[49771]: 28-05 12:53:34| 9 2 89 0 0|4779M 2945M 268M 7656M| 15k 2271B| 0 0 | 0 0 |1908 2701 |0.81 0.70 0.92|2.0 0 34| 0 0 | 0 2048M| 27 309 0 13 0 May 28 12:53:35 l75lg1-v1 dstat.sh[49771]: 28-05 12:53:35| 10 1 89 0 0|4826M 2898M 268M 7656M| 20k 528B| 0 32k| 0 2.00 |1715 2201 |0.81 0.70 0.92|1.0 0 6.0| 0 0 | 0 2048M| 27 309 0 13 0 May 28 12:53:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb24cf85-7f04-4129-aa7a-efcd3b8904e9 None None] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:53:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb24cf85-7f04-4129-aa7a-efcd3b8904e9 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:53:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb24cf85-7f04-4129-aa7a-efcd3b8904e9 None None] PATH_INFO: `/` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:53:35 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 572/1130] 10.27.203.238 () {58 vars in 1014 bytes} [Tue May 28 12:53:35 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:53:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d94a1a2-d708-4cb7-8352-e537d5887bcb None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:53:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d94a1a2-d708-4cb7-8352-e537d5887bcb None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:53:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d94a1a2-d708-4cb7-8352-e537d5887bcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:53:35 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-5d94a1a2-d708-4cb7-8352-e537d5887bcb None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:53:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-5d94a1a2-d708-4cb7-8352-e537d5887bcb None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:53:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-5d94a1a2-d708-4cb7-8352-e537d5887bcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:53:35 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 559/1131] 10.27.203.238 () {62 vars in 1111 bytes} [Tue May 28 12:53:35 2024] POST /identity/v3/auth/tokens => generated 3991 bytes in 22 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:53:35 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi [None req-01935d90-cea8-4366-8c58-d36e228c38f3 admin admin] Calling method '>' {{(pid=74000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} May 28 12:53:35 l75lg1-v1 devstack@n-api.service[74000]: INFO nova.api.openstack.requestlog [None req-01935d90-cea8-4366-8c58-d36e228c38f3 admin admin] 10.27.203.238 "GET /compute/v2.1" status: 200 len: 390 microversion: 2.1 time: 0.001063 May 28 12:53:35 l75lg1-v1 devstack@n-api.service[74000]: [pid: 74000|app: 0|req: 24/46] 10.27.203.238 () {58 vars in 1013 bytes} [Tue May 28 12:53:35 2024] GET /compute/v2.1 => generated 390 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 12:53:35 l75lg1-v1 devstack@n-api.service[73999]: DEBUG dbcounter [-] [73999] Writing DB stats nova_cell1:SELECT=1 {{(pid=73999) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:53:35 l75lg1-v1 devstack@n-api.service[73999]: DEBUG dbcounter [-] [73999] Writing DB stats nova_cell0:SELECT=1 {{(pid=73999) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:53:35 l75lg1-v1 devstack@n-api.service[73999]: DEBUG dbcounter [-] [73999] Writing DB stats nova_api:SELECT=2 {{(pid=73999) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:53:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb24cf85-7f04-4129-aa7a-efcd3b8904e9 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:53:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb24cf85-7f04-4129-aa7a-efcd3b8904e9 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:53:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700e28c8-3414-4a56-91a3-2e519ed38989 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'befdd4414dc2432ab2baa1ae3fbffef7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'manager', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:53:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700e28c8-3414-4a56-91a3-2e519ed38989 service nova] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:53:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700e28c8-3414-4a56-91a3-2e519ed38989 service nova] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:53:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700e28c8-3414-4a56-91a3-2e519ed38989 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:53:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700e28c8-3414-4a56-91a3-2e519ed38989 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:53:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700e28c8-3414-4a56-91a3-2e519ed38989 service nova] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:53:35 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 573/1132] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 12:53:35 2024] GET /identity/v3/auth/tokens => generated 3991 bytes in 24 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 12:53:35 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi [None req-66c278e9-4aa3-451c-a2a2-9bce6556eed8 admin admin] Calling method '>' {{(pid=73999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} May 28 12:53:35 l75lg1-v1 devstack@n-api.service[73999]: INFO nova.api.openstack.requestlog [None req-66c278e9-4aa3-451c-a2a2-9bce6556eed8 admin admin] 10.27.203.238 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4658 microversion: 2.61 time: 0.052088 May 28 12:53:35 l75lg1-v1 devstack@n-api.service[73999]: [pid: 73999|app: 0|req: 23/47] 10.27.203.238 () {64 vars in 1374 bytes} [Tue May 28 12:53:35 2024] GET /compute/v2.1/flavors/detail?is_public=True => generated 4658 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 12:53:36 l75lg1-v1 dstat.sh[49771]: 28-05 12:53:36| 10 1 89 0 0|4790M 2934M 268M 7656M| 15k 4552B| 0 412k| 0 28.0 |2209 2867 |0.81 0.70 0.92|2.0 0 32| 0 0 | 0 2048M| 27 309 0 13 0 May 28 12:53:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f8ac83-3dcb-4642-ac50-2a8252931742 None None] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:53:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f8ac83-3dcb-4642-ac50-2a8252931742 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:53:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f8ac83-3dcb-4642-ac50-2a8252931742 None None] PATH_INFO: `/` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:53:37 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 560/1133] 10.27.203.238 () {58 vars in 1014 bytes} [Tue May 28 12:53:37 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:53:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c3226a-618e-4ad0-8a34-376878cccb0b None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:53:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c3226a-618e-4ad0-8a34-376878cccb0b None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:53:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c3226a-618e-4ad0-8a34-376878cccb0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:53:37 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-f6c3226a-618e-4ad0-8a34-376878cccb0b None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:53:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-f6c3226a-618e-4ad0-8a34-376878cccb0b None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:53:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-f6c3226a-618e-4ad0-8a34-376878cccb0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:53:37 l75lg1-v1 dstat.sh[49771]: 28-05 12:53:37| 10 1 89 0 0|4831M 2893M 268M 7656M| 13k 0 | 0 1240k| 0 250 |1674 2401 |0.82 0.70 0.92|2.0 0 0| 0 0 | 0 2048M| 27 310 0 13 0 May 28 12:53:37 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 574/1134] 10.27.203.238 () {62 vars in 1111 bytes} [Tue May 28 12:53:37 2024] POST /identity/v3/auth/tokens => generated 3991 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:53:37 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.api.middleware.version_negotiation [None req-84e3042c-1473-401c-814a-24133eef81d3 admin admin] Determining version of request: GET / Accept: application/json {{(pid=86374) process_request /opt/stack/glance/glance/api/middleware/version_negotiation.py:44}} May 28 12:53:37 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.api.middleware.version_negotiation [None req-84e3042c-1473-401c-814a-24133eef81d3 admin admin] Using url versioning {{(pid=86374) process_request /opt/stack/glance/glance/api/middleware/version_negotiation.py:57}} May 28 12:53:37 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.api.middleware.version_negotiation [None req-84e3042c-1473-401c-814a-24133eef81d3 admin admin] Unknown version. Returning version choices. {{(pid=86374) process_request /opt/stack/glance/glance/api/middleware/version_negotiation.py:64}} May 28 12:53:37 l75lg1-v1 devstack@g-api.service[86374]: [pid: 86374|app: 0|req: 7/12] 127.0.0.1 () {34 vars in 509 bytes} [Tue May 28 12:53:37 2024] GET / => generated 1323 bytes in 1 msecs (HTTP/1.1 300) 3 headers in 106 bytes (1 switches on core 0) May 28 12:53:37 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.api.middleware.version_negotiation [None req-e04ade6e-921a-4fae-8b62-322bd2514a96 admin admin] Determining version of request: GET /v2/images/e858734c-ca0f-45cb-b278-37dcfb0db7c6 Accept: */* {{(pid=86373) process_request /opt/stack/glance/glance/api/middleware/version_negotiation.py:44}} May 28 12:53:37 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.api.middleware.version_negotiation [None req-e04ade6e-921a-4fae-8b62-322bd2514a96 admin admin] Using url versioning {{(pid=86373) process_request /opt/stack/glance/glance/api/middleware/version_negotiation.py:57}} May 28 12:53:37 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.api.middleware.version_negotiation [None req-e04ade6e-921a-4fae-8b62-322bd2514a96 admin admin] Matched version: v2 {{(pid=86373) process_request /opt/stack/glance/glance/api/middleware/version_negotiation.py:69}} May 28 12:53:37 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.api.middleware.version_negotiation [None req-e04ade6e-921a-4fae-8b62-322bd2514a96 admin admin] new path /v2/images/e858734c-ca0f-45cb-b278-37dcfb0db7c6 {{(pid=86373) process_request /opt/stack/glance/glance/api/middleware/version_negotiation.py:70}} May 28 12:53:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f8ac83-3dcb-4642-ac50-2a8252931742 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:53:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f8ac83-3dcb-4642-ac50-2a8252931742 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:53:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d84741-3dd6-4c0f-b863-9d931540a252 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1436e60c2e34e0b8af9ae1c668bdf03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:53:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d84741-3dd6-4c0f-b863-9d931540a252 service glance] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:53:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d84741-3dd6-4c0f-b863-9d931540a252 service glance] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:53:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d84741-3dd6-4c0f-b863-9d931540a252 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:53:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d84741-3dd6-4c0f-b863-9d931540a252 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:53:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d84741-3dd6-4c0f-b863-9d931540a252 service glance] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:53:37 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 561/1135] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 12:53:37 2024] GET /identity/v3/auth/tokens => generated 3991 bytes in 20 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 12:53:37 l75lg1-v1 devstack@g-api.service[86373]: [pid: 86373|app: 0|req: 6/13] 127.0.0.1 () {36 vars in 792 bytes} [Tue May 28 12:53:37 2024] GET /v2/images/e858734c-ca0f-45cb-b278-37dcfb0db7c6 => generated 976 bytes in 38 msecs (HTTP/1.1 200) 4 headers in 157 bytes (1 switches on core 0) May 28 12:53:38 l75lg1-v1 dstat.sh[49771]: 28-05 12:53:38| 9 1 89 0 0|4796M 2928M 268M 7656M| 12k 1196B| 0 0 | 0 0 |2017 2804 |0.82 0.70 0.92|4.0 0 18| 0 0 | 0 2048M| 27 309 0 15 0 May 28 12:53:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0dc8e7-1e93-4f7f-9e3b-44dbd5cd5173 None None] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:53:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0dc8e7-1e93-4f7f-9e3b-44dbd5cd5173 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:53:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0dc8e7-1e93-4f7f-9e3b-44dbd5cd5173 None None] PATH_INFO: `/` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:53:39 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 575/1136] 10.27.203.238 () {58 vars in 1014 bytes} [Tue May 28 12:53:38 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:53:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcfba91-4560-47fc-9825-261bf5fbcf19 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:53:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcfba91-4560-47fc-9825-261bf5fbcf19 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:53:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcfba91-4560-47fc-9825-261bf5fbcf19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:53:39 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-7fcfba91-4560-47fc-9825-261bf5fbcf19 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:53:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-7fcfba91-4560-47fc-9825-261bf5fbcf19 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:53:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-7fcfba91-4560-47fc-9825-261bf5fbcf19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:53:39 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 562/1137] 10.27.203.238 () {62 vars in 1111 bytes} [Tue May 28 12:53:39 2024] POST /identity/v3/auth/tokens => generated 3991 bytes in 25 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:53:39 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi [None req-01935d90-cea8-4366-8c58-d36e228c38f3 admin admin] Calling method '>' {{(pid=74000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} May 28 12:53:39 l75lg1-v1 devstack@n-api.service[74000]: INFO nova.api.openstack.requestlog [None req-01935d90-cea8-4366-8c58-d36e228c38f3 admin admin] 10.27.203.238 "GET /compute/v2.1" status: 200 len: 390 microversion: 2.1 time: 0.001359 May 28 12:53:39 l75lg1-v1 devstack@n-api.service[74000]: [pid: 74000|app: 0|req: 25/48] 10.27.203.238 () {58 vars in 1013 bytes} [Tue May 28 12:53:39 2024] GET /compute/v2.1 => generated 390 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 12:53:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0dc8e7-1e93-4f7f-9e3b-44dbd5cd5173 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:53:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0dc8e7-1e93-4f7f-9e3b-44dbd5cd5173 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:53:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe25db94-3396-4720-bbbf-bbe938c092fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'befdd4414dc2432ab2baa1ae3fbffef7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'manager', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:53:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe25db94-3396-4720-bbbf-bbe938c092fe service nova] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:53:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe25db94-3396-4720-bbbf-bbe938c092fe service nova] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:53:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe25db94-3396-4720-bbbf-bbe938c092fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:53:39 l75lg1-v1 dstat.sh[49771]: 28-05 12:53:39| 10 1 89 0 0|4827M 2898M 268M 7656M| 17k 0 | 0 4096B| 0 1.00 |1766 2462 |0.82 0.70 0.92|4.0 0 0| 0 0 | 0 2048M| 27 311 0 15 0 May 28 12:53:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe25db94-3396-4720-bbbf-bbe938c092fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:53:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe25db94-3396-4720-bbbf-bbe938c092fe service nova] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:53:39 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 576/1138] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 12:53:39 2024] GET /identity/v3/auth/tokens => generated 3991 bytes in 21 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 12:53:39 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi [None req-474845e8-e46d-4682-8c02-63530abc7034 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 128, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "name": "m1.nano", "rxtx_factor": 1.0, "disk": 1, "vcpus": 1, "id": "42"}} {{(pid=73999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:518}} May 28 12:53:39 l75lg1-v1 devstack@n-api.service[73999]: INFO nova.api.openstack.requestlog [None req-474845e8-e46d-4682-8c02-63530abc7034 admin admin] 10.27.203.238 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.61 time: 0.054978 May 28 12:53:39 l75lg1-v1 devstack@n-api.service[73999]: [pid: 73999|app: 0|req: 24/49] 10.27.203.238 () {68 vars in 1365 bytes} [Tue May 28 12:53:39 2024] POST /compute/v2.1/flavors => generated 409 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 12:53:39 l75lg1-v1 devstack@n-api.service[74000]: DEBUG dbcounter [-] [74000] Writing DB stats nova_api:SELECT=21,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=74000) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:53:39 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi [None req-b2c85469-1ceb-484a-8578-dc43a40a66d0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=74000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:518}} May 28 12:53:39 l75lg1-v1 devstack@n-api.service[74000]: INFO nova.api.openstack.requestlog [None req-b2c85469-1ceb-484a-8578-dc43a40a66d0 admin admin] 10.27.203.238 "POST /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030345 May 28 12:53:39 l75lg1-v1 devstack@n-api.service[74000]: [pid: 74000|app: 0|req: 26/50] 10.27.203.238 () {68 vars in 1418 bytes} [Tue May 28 12:53:39 2024] POST /compute/v2.1/flavors/42/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 12:53:39 l75lg1-v1 nova-conductor[83647]: DEBUG dbcounter [-] [83647] Writing DB stats nova_cell1:SELECT=1,nova_cell1:UPDATE=1 {{(pid=83647) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:53:39 l75lg1-v1 nova-conductor[83648]: DEBUG dbcounter [-] [83648] Writing DB stats nova_cell1:SELECT=1 {{(pid=83648) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:53:40 l75lg1-v1 dstat.sh[49771]: 28-05 12:53:40| 10 2 88 1 0|4794M 2930M 268M 7656M| 17k 4010B| 0 528k| 0 84.0 |2704 3794 |0.82 0.70 0.92|3.0 0 27| 0 0 | 0 2048M| 27 309 0 16 0 May 28 12:53:40 l75lg1-v1 neutron-server[77618]: DEBUG dbcounter [-] [77618] Writing DB stats neutron:UPDATE=1 {{(pid=77618) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:53:40 l75lg1-v1 neutron-server[77618]: DEBUG dbcounter [-] [77618] Writing DB stats neutron:SELECT=1 {{(pid=77618) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:53:40 l75lg1-v1 neutron-server[77622]: DEBUG dbcounter [-] [77622] Writing DB stats neutron:SELECT=2 {{(pid=77622) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:53:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54067983-06d9-4737-9619-de46d02bcb50 None None] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:53:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54067983-06d9-4737-9619-de46d02bcb50 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:53:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54067983-06d9-4737-9619-de46d02bcb50 None None] PATH_INFO: `/` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:53:40 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 563/1139] 10.27.203.238 () {58 vars in 1014 bytes} [Tue May 28 12:53:40 2024] GET /identity => generated 272 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:53:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b093d3-06fb-4583-9b80-514c0f3eecf2 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:53:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b093d3-06fb-4583-9b80-514c0f3eecf2 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:53:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b093d3-06fb-4583-9b80-514c0f3eecf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:53:40 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-f8b093d3-06fb-4583-9b80-514c0f3eecf2 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:53:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-f8b093d3-06fb-4583-9b80-514c0f3eecf2 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:53:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-f8b093d3-06fb-4583-9b80-514c0f3eecf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:53:40 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 577/1140] 10.27.203.238 () {62 vars in 1111 bytes} [Tue May 28 12:53:40 2024] POST /identity/v3/auth/tokens => generated 3991 bytes in 23 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:53:40 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.api.middleware.version_negotiation [None req-84e3042c-1473-401c-814a-24133eef81d3 admin admin] Determining version of request: GET / Accept: application/json {{(pid=86374) process_request /opt/stack/glance/glance/api/middleware/version_negotiation.py:44}} May 28 12:53:41 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.api.middleware.version_negotiation [None req-84e3042c-1473-401c-814a-24133eef81d3 admin admin] Using url versioning {{(pid=86374) process_request /opt/stack/glance/glance/api/middleware/version_negotiation.py:57}} May 28 12:53:41 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.api.middleware.version_negotiation [None req-84e3042c-1473-401c-814a-24133eef81d3 admin admin] Unknown version. Returning version choices. {{(pid=86374) process_request /opt/stack/glance/glance/api/middleware/version_negotiation.py:64}} May 28 12:53:41 l75lg1-v1 devstack@g-api.service[86374]: [pid: 86374|app: 0|req: 8/14] 127.0.0.1 () {34 vars in 509 bytes} [Tue May 28 12:53:40 2024] GET / => generated 1323 bytes in 2 msecs (HTTP/1.1 300) 3 headers in 106 bytes (1 switches on core 0) May 28 12:53:41 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.api.middleware.version_negotiation [None req-7785377b-5b79-4b15-aaf1-215692c64777 admin admin] Determining version of request: GET /v2/images/31e1897d-0863-48df-80d6-721d2c2d3179 Accept: */* {{(pid=86373) process_request /opt/stack/glance/glance/api/middleware/version_negotiation.py:44}} May 28 12:53:41 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.api.middleware.version_negotiation [None req-7785377b-5b79-4b15-aaf1-215692c64777 admin admin] Using url versioning {{(pid=86373) process_request /opt/stack/glance/glance/api/middleware/version_negotiation.py:57}} May 28 12:53:41 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.api.middleware.version_negotiation [None req-7785377b-5b79-4b15-aaf1-215692c64777 admin admin] Matched version: v2 {{(pid=86373) process_request /opt/stack/glance/glance/api/middleware/version_negotiation.py:69}} May 28 12:53:41 l75lg1-v1 devstack@g-api.service[86373]: DEBUG glance.api.middleware.version_negotiation [None req-7785377b-5b79-4b15-aaf1-215692c64777 admin admin] new path /v2/images/31e1897d-0863-48df-80d6-721d2c2d3179 {{(pid=86373) process_request /opt/stack/glance/glance/api/middleware/version_negotiation.py:70}} May 28 12:53:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54067983-06d9-4737-9619-de46d02bcb50 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:53:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54067983-06d9-4737-9619-de46d02bcb50 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:53:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b53ee79-3750-4628-8950-3e0cba48a267 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1436e60c2e34e0b8af9ae1c668bdf03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:53:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b53ee79-3750-4628-8950-3e0cba48a267 service glance] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:53:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b53ee79-3750-4628-8950-3e0cba48a267 service glance] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:53:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b53ee79-3750-4628-8950-3e0cba48a267 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:53:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b53ee79-3750-4628-8950-3e0cba48a267 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:53:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b53ee79-3750-4628-8950-3e0cba48a267 service glance] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:53:41 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 564/1141] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 12:53:41 2024] GET /identity/v3/auth/tokens => generated 3991 bytes in 20 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 12:53:41 l75lg1-v1 devstack@g-api.service[86373]: [pid: 86373|app: 0|req: 7/15] 127.0.0.1 () {36 vars in 792 bytes} [Tue May 28 12:53:41 2024] GET /v2/images/31e1897d-0863-48df-80d6-721d2c2d3179 => generated 984 bytes in 41 msecs (HTTP/1.1 200) 4 headers in 157 bytes (1 switches on core 0) May 28 12:53:41 l75lg1-v1 dstat.sh[49771]: 28-05 12:53:41| 9 1 89 0 0|4764M 2960M 268M 7656M| 11k 752B| 0 1472k| 0 109 |2069 2863 |0.82 0.70 0.92|2.0 0 11| 0 0 | 0 2048M| 27 309 0 18 0 May 28 12:53:41 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:53:42 l75lg1-v1 dstat.sh[49771]: 28-05 12:53:42| 10 1 89 0 0|4803M 2921M 268M 7656M| 16k 624B| 0 0 | 0 0 |1710 2290 |0.84 0.71 0.93|2.0 0 5.0| 0 0 | 0 2048M| 27 309 0 14 0 May 28 12:53:42 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:53:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3ecee2-d7ce-4055-9299-bc57432b35da None None] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:53:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3ecee2-d7ce-4055-9299-bc57432b35da None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:53:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3ecee2-d7ce-4055-9299-bc57432b35da None None] PATH_INFO: `/` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:53:42 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 578/1142] 10.27.203.238 () {58 vars in 1014 bytes} [Tue May 28 12:53:42 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:53:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274e06bb-c914-48bc-b075-19c7f5c2d32e None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:53:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274e06bb-c914-48bc-b075-19c7f5c2d32e None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:53:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274e06bb-c914-48bc-b075-19c7f5c2d32e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:53:42 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-274e06bb-c914-48bc-b075-19c7f5c2d32e None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:53:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-274e06bb-c914-48bc-b075-19c7f5c2d32e None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:53:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-274e06bb-c914-48bc-b075-19c7f5c2d32e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:53:42 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 565/1143] 10.27.203.238 () {62 vars in 1111 bytes} [Tue May 28 12:53:42 2024] POST /identity/v3/auth/tokens => generated 3991 bytes in 24 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:53:42 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi [None req-474845e8-e46d-4682-8c02-63530abc7034 admin admin] Calling method '>' {{(pid=73999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} May 28 12:53:42 l75lg1-v1 devstack@n-api.service[73999]: INFO nova.api.openstack.requestlog [None req-474845e8-e46d-4682-8c02-63530abc7034 admin admin] 10.27.203.238 "GET /compute/v2.1" status: 200 len: 390 microversion: 2.1 time: 0.001414 May 28 12:53:42 l75lg1-v1 devstack@n-api.service[73999]: [pid: 73999|app: 0|req: 25/51] 10.27.203.238 () {58 vars in 1013 bytes} [Tue May 28 12:53:42 2024] GET /compute/v2.1 => generated 390 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 12:53:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3ecee2-d7ce-4055-9299-bc57432b35da None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:53:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3ecee2-d7ce-4055-9299-bc57432b35da None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:53:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e8712f-995f-4288-adc6-b92cb48d58ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'befdd4414dc2432ab2baa1ae3fbffef7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'manager', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:53:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e8712f-995f-4288-adc6-b92cb48d58ac service nova] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:53:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e8712f-995f-4288-adc6-b92cb48d58ac service nova] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:53:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e8712f-995f-4288-adc6-b92cb48d58ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:53:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e8712f-995f-4288-adc6-b92cb48d58ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:53:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e8712f-995f-4288-adc6-b92cb48d58ac service nova] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:53:42 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 579/1144] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 12:53:42 2024] GET /identity/v3/auth/tokens => generated 3991 bytes in 21 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 12:53:42 l75lg1-v1 devstack@n-api.service[74000]: DEBUG nova.api.openstack.wsgi [None req-5d9f81ce-b00d-4db0-a0ac-34db1e4aaae9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 192, "disk": 1, "vcpus": 1, "id": "84", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "m1.micro"}} {{(pid=74000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:518}} May 28 12:53:42 l75lg1-v1 devstack@n-api.service[74000]: INFO nova.api.openstack.requestlog [None req-5d9f81ce-b00d-4db0-a0ac-34db1e4aaae9 admin admin] 10.27.203.238 "POST /compute/v2.1/flavors" status: 200 len: 410 microversion: 2.61 time: 0.051097 May 28 12:53:42 l75lg1-v1 devstack@n-api.service[74000]: [pid: 74000|app: 0|req: 27/52] 10.27.203.238 () {68 vars in 1365 bytes} [Tue May 28 12:53:42 2024] POST /compute/v2.1/flavors => generated 410 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 12:53:42 l75lg1-v1 devstack@n-api.service[73999]: DEBUG nova.api.openstack.wsgi [None req-0aaa508d-df2f-479b-ab45-b22bf7f198df admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=73999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:518}} May 28 12:53:43 l75lg1-v1 devstack@n-api.service[73999]: INFO nova.api.openstack.requestlog [None req-0aaa508d-df2f-479b-ab45-b22bf7f198df admin admin] 10.27.203.238 "POST /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036800 May 28 12:53:43 l75lg1-v1 devstack@n-api.service[73999]: [pid: 73999|app: 0|req: 26/53] 10.27.203.238 () {68 vars in 1418 bytes} [Tue May 28 12:53:42 2024] POST /compute/v2.1/flavors/84/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 12:53:43 l75lg1-v1 dstat.sh[49771]: 28-05 12:53:43| 10 1 88 1 0|4765M 2959M 268M 7656M| 14k 2240B| 0 912k| 0 86.0 |2516 3713 |0.84 0.71 0.93|3.0 1.0 26| 0 0 | 0 2048M| 27 309 0 14 0 May 28 12:53:44 l75lg1-v1 dstat.sh[49771]: 28-05 12:53:44| 10 1 89 0 0|4803M 2922M 268M 7656M| 14k 2199B| 0 160k| 0 18.0 |1960 2554 |0.84 0.71 0.93|1.0 0 28| 0 0 | 0 2048M| 27 309 0 14 0 May 28 12:53:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f9eb78-bc81-41c2-a481-091120495236 None None] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:53:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f9eb78-bc81-41c2-a481-091120495236 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:53:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f9eb78-bc81-41c2-a481-091120495236 None None] PATH_INFO: `/` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:53:44 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 566/1145] 10.27.203.238 () {58 vars in 1014 bytes} [Tue May 28 12:53:44 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:53:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64493229-8ad4-47f0-8d1f-82b81af7eabd None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:53:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64493229-8ad4-47f0-8d1f-82b81af7eabd None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:53:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64493229-8ad4-47f0-8d1f-82b81af7eabd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:53:44 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-64493229-8ad4-47f0-8d1f-82b81af7eabd None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:53:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-64493229-8ad4-47f0-8d1f-82b81af7eabd None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:53:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-64493229-8ad4-47f0-8d1f-82b81af7eabd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:53:44 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 580/1146] 10.27.203.238 () {62 vars in 1111 bytes} [Tue May 28 12:53:44 2024] POST /identity/v3/auth/tokens => generated 3991 bytes in 23 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:53:44 l75lg1-v1 neutron-server[77618]: DEBUG neutron.wsgi [-] (77618) accepted ('10.27.203.238', 35078) {{(pid=77618) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 12:53:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f9eb78-bc81-41c2-a481-091120495236 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:53:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-c3f9eb78-bc81-41c2-a481-091120495236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:53:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f9eb78-bc81-41c2-a481-091120495236 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:53:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64ffb61-3191-4ecc-ad36-d91c3107a208 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef17047035e4b518fd5360a01f2da1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:53:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64ffb61-3191-4ecc-ad36-d91c3107a208 service neutron] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:53:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64ffb61-3191-4ecc-ad36-d91c3107a208 service neutron] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:53:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64ffb61-3191-4ecc-ad36-d91c3107a208 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:53:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64ffb61-3191-4ecc-ad36-d91c3107a208 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:53:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64ffb61-3191-4ecc-ad36-d91c3107a208 service neutron] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:53:44 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 567/1147] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 12:53:44 2024] GET /identity/v3/auth/tokens => generated 3991 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 12:53:44 l75lg1-v1 neutron-server[77618]: DEBUG neutron.wsgi [None req-fef23839-5e56-4bde-bc5b-78110e01b2a6 admin admin] http://10.27.203.238:9696/networking/v2.0/extensions returned with HTTP 200 {{(pid=77618) __call__ /opt/stack/neutron/neutron/wsgi.py:730}} May 28 12:53:44 l75lg1-v1 neutron-server[77618]: INFO neutron.wsgi [None req-fef23839-5e56-4bde-bc5b-78110e01b2a6 admin admin] 10.27.203.238 "GET /networking/v2.0/extensions HTTP/1.1" status: 200 len: 13594 time: 0.0828419 May 28 12:53:45 l75lg1-v1 dstat.sh[49771]: 28-05 12:53:45| 9 1 89 0 0|4761M 2964M 268M 7656M| 19k 4433B| 0 84k| 0 8.99 |2194 2883 |0.84 0.71 0.93|1.0 0 27| 0 0 | 0 2048M| 27 309 0 16 0 May 28 12:53:45 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:53:45 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.manager [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Starting heal instance info cache {{(pid=83654) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}} May 28 12:53:45 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.manager [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Rebuilding the list of instances to heal {{(pid=83654) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9930}} May 28 12:53:45 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Expecting reply to msg 754d8d6aa7fb4286b5adc6c6fef1e49a in queue reply_37f4cbd1dd094961a22b8a65f222c327 May 28 12:53:45 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [-] Received RPC response for msg 754d8d6aa7fb4286b5adc6c6fef1e49a May 28 12:53:46 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.manager [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Didn't find any instances for network info cache update. {{(pid=83654) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10012}} May 28 12:53:46 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:53:46 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:53:46 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:53:46 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.manager [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=83654) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10545}} May 28 12:53:46 l75lg1-v1 dstat.sh[49771]: 28-05 12:53:46| 9 1 89 0 0|4809M 2915M 268M 7657M| 13k 0 | 0 40k| 0 1.00 |1732 2343 |0.84 0.71 0.93|2.0 0 0| 0 0 | 0 2048M| 27 309 0 16 0 May 28 12:53:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b076e13-312e-4ab9-afd1-e1989204efbb None None] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:53:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b076e13-312e-4ab9-afd1-e1989204efbb None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:53:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b076e13-312e-4ab9-afd1-e1989204efbb None None] PATH_INFO: `/` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:53:46 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 581/1148] 10.27.203.238 () {58 vars in 1014 bytes} [Tue May 28 12:53:46 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:53:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c044862e-976a-4327-9575-b771268191e8 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:53:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c044862e-976a-4327-9575-b771268191e8 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:53:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c044862e-976a-4327-9575-b771268191e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:53:46 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-c044862e-976a-4327-9575-b771268191e8 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:53:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-c044862e-976a-4327-9575-b771268191e8 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:53:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-c044862e-976a-4327-9575-b771268191e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:53:46 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 568/1149] 10.27.203.238 () {62 vars in 1111 bytes} [Tue May 28 12:53:46 2024] POST /identity/v3/auth/tokens => generated 3991 bytes in 23 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:53:46 l75lg1-v1 neutron-server[77618]: DEBUG neutron.wsgi [-] (77618) accepted ('10.27.203.238', 35082) {{(pid=77618) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 12:53:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b076e13-312e-4ab9-afd1-e1989204efbb None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:53:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b076e13-312e-4ab9-afd1-e1989204efbb None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:53:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7a910d-72e4-4e49-9d85-4e17717d4607 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef17047035e4b518fd5360a01f2da1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:53:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7a910d-72e4-4e49-9d85-4e17717d4607 service neutron] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:53:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7a910d-72e4-4e49-9d85-4e17717d4607 service neutron] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:53:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7a910d-72e4-4e49-9d85-4e17717d4607 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:53:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7a910d-72e4-4e49-9d85-4e17717d4607 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:53:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7a910d-72e4-4e49-9d85-4e17717d4607 service neutron] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:53:46 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 582/1150] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 12:53:46 2024] GET /identity/v3/auth/tokens => generated 3991 bytes in 19 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 12:53:46 l75lg1-v1 neutron-server[77618]: INFO neutron.pecan_wsgi.hooks.translation [None req-cb8f2257-eb8d-4db0-aa6b-1fd7df579e30 admin admin] GET failed (client error): The resource could not be found. May 28 12:53:46 l75lg1-v1 neutron-server[77618]: INFO neutron.wsgi [None req-cb8f2257-eb8d-4db0-aa6b-1fd7df579e30 admin admin] 10.27.203.238 "GET /networking/v2.0/networks/public HTTP/1.1" status: 404 len: 314 time: 0.0373516 May 28 12:53:46 l75lg1-v1 neutron-server[77618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-510134d4-5a90-42de-b7fc-e761369788ad admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=77618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:258}} May 28 12:53:46 l75lg1-v1 neutron-server[77618]: INFO neutron.wsgi [None req-510134d4-5a90-42de-b7fc-e761369788ad admin admin] 10.27.203.238 "GET /networking/v2.0/networks?name=public HTTP/1.1" status: 200 len: 920 time: 0.1019747 May 28 12:53:47 l75lg1-v1 dstat.sh[49771]: 28-05 12:53:47| 10 1 89 0 0|4778M 2946M 268M 7657M| 15k 626B| 0 1372k| 0 262 |2004 2727 |0.85 0.71 0.93|3.0 0 8.0| 0 0 | 0 2048M| 27 309 0 17 0 May 28 12:53:47 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:53:47 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager.update_available_resource {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:53:47 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Expecting reply to msg b99838f09e6549189c63c5eda04bcda8 in queue reply_37f4cbd1dd094961a22b8a65f222c327 May 28 12:53:47 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [-] Received RPC response for msg b99838f09e6549189c63c5eda04bcda8 May 28 12:53:48 l75lg1-v1 nova-compute[83654]: DEBUG oslo_concurrency.lockutils [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=83654) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:53:48 l75lg1-v1 nova-compute[83654]: DEBUG oslo_concurrency.lockutils [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=83654) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:53:48 l75lg1-v1 nova-compute[83654]: DEBUG oslo_concurrency.lockutils [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=83654) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:53:48 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.resource_tracker [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Auditing locally available compute resources for l75lg1-v1 (node: l75lg1-v1) {{(pid=83654) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}} May 28 12:53:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93579d4f-3cc4-4432-8f63-aee2e401af09 None None] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:53:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93579d4f-3cc4-4432-8f63-aee2e401af09 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:53:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93579d4f-3cc4-4432-8f63-aee2e401af09 None None] PATH_INFO: `/` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:53:48 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 569/1151] 10.27.203.238 () {58 vars in 1014 bytes} [Tue May 28 12:53:48 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:53:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eb72a4-4d7b-4a70-b61a-679936b82972 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:53:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eb72a4-4d7b-4a70-b61a-679936b82972 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:53:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eb72a4-4d7b-4a70-b61a-679936b82972 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:53:48 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-23eb72a4-4d7b-4a70-b61a-679936b82972 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:53:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-23eb72a4-4d7b-4a70-b61a-679936b82972 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:53:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-23eb72a4-4d7b-4a70-b61a-679936b82972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:53:48 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 583/1152] 10.27.203.238 () {62 vars in 1111 bytes} [Tue May 28 12:53:48 2024] POST /identity/v3/auth/tokens => generated 3991 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:53:48 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.resource_tracker [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Hypervisor/Node resource view: name=l75lg1-v1 free_ram=10834MB free_disk=15.82107925415039GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_01_1", "address": "0000:00:01.1", "product_id": "7010", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7010", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7000", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7000", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "0100", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_0100", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_09_0", "address": "0000:00:09.0", "product_id": "1001", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1001", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "293a", "vendor_id": "8086", "numa_node": null, "label": "label_8086_293a", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_2", "address": "0000:00:07.2", "product_id": "2936", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2936", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "1237", "vendor_id": "8086", "numa_node": null, "label": "label_8086_1237", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "2935", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2935", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "2934", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2934", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_05_0", "address": "0000:00:05.0", "product_id": "1000", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1000", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "1000", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1000", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_06_0", "address": "0000:00:06.0", "product_id": "2668", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2668", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "1000", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1000", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0a_0", "address": "0000:00:0a.0", "product_id": "1002", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1002", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_3", "address": "0000:00:01.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_08_0", "address": "0000:00:08.0", "product_id": "1003", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1003", "dev_type": "type-PCI"}] {{(pid=83654) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}} May 28 12:53:48 l75lg1-v1 nova-compute[83654]: DEBUG oslo_concurrency.lockutils [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=83654) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:53:48 l75lg1-v1 nova-compute[83654]: DEBUG oslo_concurrency.lockutils [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=83654) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:53:48 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Expecting reply to msg 2aa73782c8fa4431a598ac248ae687a2 in queue reply_37f4cbd1dd094961a22b8a65f222c327 May 28 12:53:48 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [-] Received RPC response for msg 2aa73782c8fa4431a598ac248ae687a2 May 28 12:53:48 l75lg1-v1 dstat.sh[49771]: 28-05 12:53:48| 10 2 88 0 0|4815M 2909M 268M 7657M| 12k 0 | 0 8184B| 0 2.00 |2901 4706 |0.85 0.71 0.93|2.0 0 2.0| 0 0 | 0 2048M| 27 309 0 15 0 May 28 12:53:48 l75lg1-v1 neutron-server[77619]: DEBUG neutron.wsgi [-] (77619) accepted ('10.27.203.238', 35088) {{(pid=77619) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 12:53:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93579d4f-3cc4-4432-8f63-aee2e401af09 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:53:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-93579d4f-3cc4-4432-8f63-aee2e401af09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:53:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93579d4f-3cc4-4432-8f63-aee2e401af09 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:53:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a545658-456a-48fa-ab32-8a6a58b7d1db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef17047035e4b518fd5360a01f2da1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:53:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a545658-456a-48fa-ab32-8a6a58b7d1db service neutron] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:53:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a545658-456a-48fa-ab32-8a6a58b7d1db service neutron] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:53:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a545658-456a-48fa-ab32-8a6a58b7d1db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:53:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a545658-456a-48fa-ab32-8a6a58b7d1db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:53:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a545658-456a-48fa-ab32-8a6a58b7d1db service neutron] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:53:48 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 570/1153] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 12:53:48 2024] GET /identity/v3/auth/tokens => generated 3991 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 12:53:48 l75lg1-v1 neutron-server[77619]: DEBUG neutron.api.v2.base [None req-f5b0e9bb-2fbc-4411-939c-b2dda8d87918 admin admin] Request body: {'network': {'name': 'shared', 'admin_state_up': True, 'shared': True}} {{(pid=77619) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:734}} May 28 12:53:48 l75lg1-v1 neutron-server[77619]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f5b0e9bb-2fbc-4411-939c-b2dda8d87918 admin admin] Made reservation on behalf of ea8d517cde1d40bb82c97e080ce071f7 for: {'network': 1} {{(pid=77619) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 28 12:53:48 l75lg1-v1 neutron-server[77619]: DEBUG neutron_lib.callbacks.manager [None req-f5b0e9bb-2fbc-4411-939c-b2dda8d87918 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1015114'] for network (None), before_create {{(pid=77619) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:53:48 l75lg1-v1 neutron-server[77619]: WARNING neutron.services.revisions.revision_plugin [None req-f5b0e9bb-2fbc-4411-939c-b2dda8d87918 admin admin] Could not find related network for resource to bump revision. May 28 12:53:48 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-f5b0e9bb-2fbc-4411-939c-b2dda8d87918 admin admin] geneve segment allocate from pool success with {'geneve_vni': 39669} {{(pid=77619) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 28 12:53:48 l75lg1-v1 neutron-server[77619]: DEBUG neutron_lib.callbacks.manager [None req-f5b0e9bb-2fbc-4411-939c-b2dda8d87918 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-910805'] for segment (6d6f6abd-d338-4b73-9dee-7ce52718541b), precommit_create {{(pid=77619) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:53:48 l75lg1-v1 neutron-server[77619]: INFO neutron.db.segments_db [None req-f5b0e9bb-2fbc-4411-939c-b2dda8d87918 admin admin] Added segment 6d6f6abd-d338-4b73-9dee-7ce52718541b of type geneve for network a709f3ff-68d5-435a-bc2b-36acb8ce95d4 May 28 12:53:48 l75lg1-v1 neutron-server[77619]: DEBUG neutron_lib.callbacks.manager [None req-f5b0e9bb-2fbc-4411-939c-b2dda8d87918 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8754901908252'] for network (a709f3ff-68d5-435a-bc2b-36acb8ce95d4), precommit_create {{(pid=77619) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:53:48 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver [None req-f5b0e9bb-2fbc-4411-939c-b2dda8d87918 admin admin] Validating network segment with type geneve, segmentation ID 39669, physical network None {{(pid=77619) _validate_network_segments /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/mech_driver.py:520}} May 28 12:53:48 l75lg1-v1 neutron-server[77619]: DEBUG neutron.db.ovn_revision_numbers_db [None req-f5b0e9bb-2fbc-4411-939c-b2dda8d87918 admin admin] create_initial_revision uuid=a709f3ff-68d5-435a-bc2b-36acb8ce95d4, type=networks, rev=-1 {{(pid=77619) create_initial_revision /opt/stack/neutron/neutron/db/ovn_revision_numbers_db.py:108}} May 28 12:53:48 l75lg1-v1 neutron-server[77619]: INFO neutron.tests.unit.plugins.ml2.drivers.mechanism_logger [None req-f5b0e9bb-2fbc-4411-939c-b2dda8d87918 admin admin] create_network_precommit called with network settings {'id': 'a709f3ff-68d5-435a-bc2b-36acb8ce95d4', 'name': 'shared', 'tenant_id': 'ea8d517cde1d40bb82c97e080ce071f7', 'admin_state_up': True, 'mtu': 1442, 'status': 'ACTIVE', 'subnets': [], 'standard_attr_id': 42, 'shared': True, 'project_id': 'ea8d517cde1d40bb82c97e080ce071f7', 'port_security_enabled': True, 'router:external': False, 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 39669, 'is_default': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'vlan_transparent': None, 'description': '', 'tags': [], 'created_at': '2024-05-28T12:53:48Z', 'updated_at': '2024-05-28T12:53:48Z', 'revision_number': 1} (original settings None) and network segments [{'id': '6d6f6abd-d338-4b73-9dee-7ce52718541b', 'network_type': 'geneve', 'physical_network': None, 'segmentation_id': 39669, 'network_id': 'a709f3ff-68d5-435a-bc2b-36acb8ce95d4'}] May 28 12:53:48 l75lg1-v1 neutron-server[77619]: DEBUG neutron.tests.unit.plugins.ml2.drivers.mechanism_logger [None req-f5b0e9bb-2fbc-4411-939c-b2dda8d87918 admin admin] create_network_precommit: May 28 12:53:48 l75lg1-v1 neutron-server[77619]: key[tenant_id], None -> ea8d517cde1d40bb82c97e080ce071f7 May 28 12:53:48 l75lg1-v1 neutron-server[77619]: key[provider:network_type], None -> geneve May 28 12:53:48 l75lg1-v1 neutron-server[77619]: key[project_id], None -> ea8d517cde1d40bb82c97e080ce071f7 May 28 12:53:48 l75lg1-v1 neutron-server[77619]: key[ipv6_address_scope], None -> None May 28 12:53:48 l75lg1-v1 neutron-server[77619]: key[subnets], None -> [] May 28 12:53:48 l75lg1-v1 neutron-server[77619]: key[admin_state_up], None -> True May 28 12:53:48 l75lg1-v1 neutron-server[77619]: key[id], None -> a709f3ff-68d5-435a-bc2b-36acb8ce95d4 May 28 12:53:48 l75lg1-v1 neutron-server[77619]: key[ipv4_address_scope], None -> None May 28 12:53:48 l75lg1-v1 neutron-server[77619]: key[tags], None -> [] May 28 12:53:48 l75lg1-v1 neutron-server[77619]: key[created_at], None -> 2024-05-28T12:53:48Z May 28 12:53:48 l75lg1-v1 neutron-server[77619]: key[status], None -> ACTIVE May 28 12:53:48 l75lg1-v1 neutron-server[77619]: key[is_default], None -> False May 28 12:53:48 l75lg1-v1 neutron-server[77619]: key[port_security_enabled], None -> True May 28 12:53:48 l75lg1-v1 neutron-server[77619]: key[vlan_transparent], None -> None May 28 12:53:48 l75lg1-v1 neutron-server[77619]: key[updated_at], None -> 2024-05-28T12:53:48Z May 28 12:53:48 l75lg1-v1 neutron-server[77619]: key[standard_attr_id], None -> 42 May 28 12:53:48 l75lg1-v1 neutron-server[77619]: key[availability_zone_hints], None -> [] May 28 12:53:48 l75lg1-v1 neutron-server[77619]: key[provider:physical_network], None -> None May 28 12:53:48 l75lg1-v1 neutron-server[77619]: key[shared], None -> True May 28 12:53:48 l75lg1-v1 neutron-server[77619]: key[mtu], None -> 1442 May 28 12:53:48 l75lg1-v1 neutron-server[77619]: key[provider:segmentation_id], None -> 39669 May 28 12:53:48 l75lg1-v1 neutron-server[77619]: key[description], None -> May 28 12:53:48 l75lg1-v1 neutron-server[77619]: key[availability_zones], None -> [] May 28 12:53:48 l75lg1-v1 neutron-server[77619]: key[revision_number], None -> 1 May 28 12:53:48 l75lg1-v1 neutron-server[77619]: key[router:external], None -> False May 28 12:53:48 l75lg1-v1 neutron-server[77619]: key[name], None -> shared May 28 12:53:48 l75lg1-v1 neutron-server[77619]: {{(pid=77619) _log_diff_call /opt/stack/neutron/neutron/tests/unit/plugins/ml2/drivers/mechanism_logger.py:59}} May 28 12:53:48 l75lg1-v1 neutron-server[77619]: DEBUG neutron_lib.callbacks.manager [None req-f5b0e9bb-2fbc-4411-939c-b2dda8d87918 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4165676'] for network (a709f3ff-68d5-435a-bc2b-36acb8ce95d4), after_create {{(pid=77619) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:53:48 l75lg1-v1 neutron-server[77619]: DEBUG ovsdbapp.backend.ovs_idl.transaction [None req-53cecb61-7023-41e4-a5ea-23b1eb02606a None None] Running txn n=1 command(idx=0): LsAddCommand(_result=None, switch=neutron-a709f3ff-68d5-435a-bc2b-36acb8ce95d4, columns={'external_ids': {'neutron:network_name': 'shared', 'neutron:mtu': '1442', 'neutron:revision_number': '1', 'neutron:availability_zone_hints': '', 'neutron:provnet-network-type': 'geneve'}, 'other_config': {'mcast_snoop': 'false', 'mcast_flood_unregistered': 'false', 'vlan-passthru': 'false'}}, may_exist=True) {{(pid=77619) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:53:48 l75lg1-v1 neutron-server[77621]: DEBUG neutron.common.ovn.hash_ring_manager [-] Hash Ring loaded. 2 active nodes. 0 offline nodes {{(pid=77621) _load_hash_ring /opt/stack/neutron/neutron/common/ovn/hash_ring_manager.py:99}} May 28 12:53:48 l75lg1-v1 neutron-server[77618]: DEBUG neutron.common.ovn.hash_ring_manager [None req-c63b1acc-b5c6-4be8-9db9-04824fec27f2 None None] Hash Ring loaded. 2 active nodes. 0 offline nodes {{(pid=77618) _load_hash_ring /opt/stack/neutron/neutron/common/ovn/hash_ring_manager.py:99}} May 28 12:53:48 l75lg1-v1 neutron-server[77619]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f5b0e9bb-2fbc-4411-939c-b2dda8d87918 admin admin] Pushing event updated for resources: {'Network': ['ID=a709f3ff-68d5-435a-bc2b-36acb8ce95d4,revision_number=1']} {{(pid=77619) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 28 12:53:48 l75lg1-v1 neutron-server[77621]: DEBUG neutron.common.ovn.hash_ring_manager [-] Hash Ring loaded. 2 active nodes. 0 offline nodes {{(pid=77621) _load_hash_ring /opt/stack/neutron/neutron/common/ovn/hash_ring_manager.py:99}} May 28 12:53:48 l75lg1-v1 neutron-server[77619]: DEBUG neutron.common.ovn.hash_ring_manager [None req-03b5f984-1478-4ad6-9838-8e34c1689c5b None None] Hash Ring loaded. 2 active nodes. 0 offline nodes {{(pid=77619) _load_hash_ring /opt/stack/neutron/neutron/common/ovn/hash_ring_manager.py:99}} May 28 12:53:48 l75lg1-v1 neutron-server[77618]: DEBUG neutron.common.ovn.hash_ring_manager [None req-d9d4969c-e9ae-4d76-91b0-9b7c8eb907b3 None None] Hash Ring loaded. 2 active nodes. 0 offline nodes {{(pid=77618) _load_hash_ring /opt/stack/neutron/neutron/common/ovn/hash_ring_manager.py:99}} May 28 12:53:48 l75lg1-v1 neutron-server[77619]: DEBUG neutron.common.ovn.hash_ring_manager [None req-53cecb61-7023-41e4-a5ea-23b1eb02606a None None] Hash Ring loaded. 2 active nodes. 0 offline nodes {{(pid=77619) _load_hash_ring /opt/stack/neutron/neutron/common/ovn/hash_ring_manager.py:99}} May 28 12:53:48 l75lg1-v1 neutron-server[77618]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-d9d4969c-e9ae-4d76-91b0-9b7c8eb907b3 None None] Hash Ring: Node 4c6fc793-7f5a-456f-b4d6-6e5bd97592f2 (host: l75lg1-v1) handling event "create" for row 2269a637-ebbd-4498-9e25-71daefcd2350 (table: Datapath_Binding) {{(pid=77618) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:53:48 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-53cecb61-7023-41e4-a5ea-23b1eb02606a None None] Hash Ring: Node c89b3497-133e-4a5a-b67a-3310d2cb2485 (host: l75lg1-v1) handling event "create" for row 4bac71c1-337b-4851-b33f-9c363a194860 (table: Logical_Switch) {{(pid=77619) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:53:48 l75lg1-v1 neutron-server[77619]: DEBUG ovsdbapp.backend.ovs_idl.transaction [None req-53cecb61-7023-41e4-a5ea-23b1eb02606a None None] Running txn n=1 command(idx=0): CheckLivenessCommand(_result=None) {{(pid=77619) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:53:48 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched UPDATE: SbGlobalUpdateEvent(events=('update',), table='SB_Global', conditions=None, old_conditions=None), priority=20 to row=SB_Global(ipsec=False, ssl=[], nb_cfg=3, external_ids={}, options={'lb_hairpin_use_ct_mark': 'true', 'mac_prefix': '6e:b3:c1', 'max_tunid': '16711680', 'northd_internal_version': '22.03.3-20.21.0-62.4', 'svc_monitor_mac': '6e:c0:93:26:20:eb', 'fdb_removal_limit': '0', 'ignore_lsp_down': 'false', 'mac_binding_removal_limit': '0'}) old=SB_Global(nb_cfg=2) {{(pid=76818) matches /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} May 28 12:53:48 l75lg1-v1 neutron-server[77618]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-d9d4969c-e9ae-4d76-91b0-9b7c8eb907b3 None None] ChassisAgentWriteEvent : Matched Chassis_Private, update, None None {{(pid=77618) matches /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:65}} May 28 12:53:48 l75lg1-v1 neutron-server[77621]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [-] ChassisAgentWriteEvent : Matched Chassis_Private, update, None None {{(pid=77621) matches /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:65}} May 28 12:53:48 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata.agent [-] Delaying updating chassis table for 5 seconds {{(pid=76818) run /opt/stack/neutron/neutron/agent/ovn/metadata/agent.py:364}} May 28 12:53:48 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-53cecb61-7023-41e4-a5ea-23b1eb02606a None None] Hash Ring: Node c89b3497-133e-4a5a-b67a-3310d2cb2485 (host: l75lg1-v1) handling event "update" for row 459958f3-26c0-486c-a7b4-0e57d78742d2 (table: NB_Global) {{(pid=77619) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:53:48 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-53cecb61-7023-41e4-a5ea-23b1eb02606a None None] Hash Ring: Node c89b3497-133e-4a5a-b67a-3310d2cb2485 (host: l75lg1-v1) handling event "update" for row 459958f3-26c0-486c-a7b4-0e57d78742d2 (table: NB_Global) {{(pid=77619) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:53:48 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-03b5f984-1478-4ad6-9838-8e34c1689c5b None None] ChassisAgentWriteEvent : Matched Chassis_Private, update, None None {{(pid=77619) matches /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:65}} May 28 12:53:48 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-53cecb61-7023-41e4-a5ea-23b1eb02606a None None] Hash Ring: Node c89b3497-133e-4a5a-b67a-3310d2cb2485 (host: l75lg1-v1) handling event "update" for row 459958f3-26c0-486c-a7b4-0e57d78742d2 (table: NB_Global) {{(pid=77619) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:53:48 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-53cecb61-7023-41e4-a5ea-23b1eb02606a None None] Hash Ring: Node c89b3497-133e-4a5a-b67a-3310d2cb2485 (host: l75lg1-v1) handling event "update" for row 459958f3-26c0-486c-a7b4-0e57d78742d2 (table: NB_Global) {{(pid=77619) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:53:48 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-03b5f984-1478-4ad6-9838-8e34c1689c5b None None] Hash Ring: Node c89b3497-133e-4a5a-b67a-3310d2cb2485 (host: l75lg1-v1) handling event "update" for row 6ef07056-3e6a-44fb-b483-fdb6022e4e42 (table: Chassis_Private) {{(pid=77619) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:53:48 l75lg1-v1 neutron-server[77619]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f5b0e9bb-2fbc-4411-939c-b2dda8d87918 admin admin] Tracked resource versions report: May 28 12:53:48 l75lg1-v1 neutron-server[77619]: pushed versions: May 28 12:53:48 l75lg1-v1 neutron-server[77619]: { 'AddressGroup': {'1.2'}, May 28 12:53:48 l75lg1-v1 neutron-server[77619]: 'Agent': {'1.1'}, May 28 12:53:48 l75lg1-v1 neutron-server[77619]: 'ConntrackHelper': {'1.0'}, May 28 12:53:48 l75lg1-v1 neutron-server[77619]: 'LocalIPAssociation': {'1.0'}, May 28 12:53:48 l75lg1-v1 neutron-server[77619]: 'Log': {'1.0'}, May 28 12:53:48 l75lg1-v1 neutron-server[77619]: 'NDPProxy': {'1.0'}, May 28 12:53:48 l75lg1-v1 neutron-server[77619]: 'Network': {'1.1'}, May 28 12:53:48 l75lg1-v1 neutron-server[77619]: 'Port': {'1.9'}, May 28 12:53:48 l75lg1-v1 neutron-server[77619]: 'PortForwarding': {'1.3'}, May 28 12:53:48 l75lg1-v1 neutron-server[77619]: 'QosPolicy': {'1.10'}, May 28 12:53:48 l75lg1-v1 neutron-server[77619]: 'SecurityGroup': {'1.6'}, May 28 12:53:48 l75lg1-v1 neutron-server[77619]: 'SecurityGroupRule': {'1.3'}, May 28 12:53:48 l75lg1-v1 neutron-server[77619]: 'SubPort': {'1.0'}, May 28 12:53:48 l75lg1-v1 neutron-server[77619]: 'Subnet': {'1.1'}, May 28 12:53:48 l75lg1-v1 neutron-server[77619]: 'Trunk': {'1.1'}} May 28 12:53:48 l75lg1-v1 neutron-server[77619]: consumer versions: May 28 12:53:48 l75lg1-v1 neutron-server[77619]: {OVN Controller Gateway agent@l75lg1-v1: {}} May 28 12:53:48 l75lg1-v1 neutron-server[77619]: {{(pid=77619) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:178}} May 28 12:53:48 l75lg1-v1 neutron-server[77619]: INFO neutron.db.ovn_revision_numbers_db [None req-f5b0e9bb-2fbc-4411-939c-b2dda8d87918 admin admin] Successfully bumped revision number for resource a709f3ff-68d5-435a-bc2b-36acb8ce95d4 (type: networks) to 1 May 28 12:53:48 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Expecting reply to msg 25973d0368f7427abfda8c6127947e8f in queue reply_37f4cbd1dd094961a22b8a65f222c327 May 28 12:53:48 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [-] Received RPC response for msg 25973d0368f7427abfda8c6127947e8f May 28 12:53:48 l75lg1-v1 neutron-server[77619]: DEBUG neutron_lib.callbacks.manager [None req-f5b0e9bb-2fbc-4411-939c-b2dda8d87918 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1015114'] for port (None), before_create {{(pid=77619) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:53:48 l75lg1-v1 neutron-server[77619]: DEBUG neutron_lib.callbacks.manager [None req-f5b0e9bb-2fbc-4411-939c-b2dda8d87918 admin admin] Publish callbacks [] for port (37903648-aa27-42fa-926e-18741dbbf141), precommit_create {{(pid=77619) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:53:48 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver [None req-f5b0e9bb-2fbc-4411-939c-b2dda8d87918 admin admin] No provisioning block for port 37903648-aa27-42fa-926e-18741dbbf141 since it does not have a host {{(pid=77619) _is_port_provisioning_required /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/mech_driver.py:720}} May 28 12:53:48 l75lg1-v1 neutron-server[77619]: DEBUG neutron.db.ovn_revision_numbers_db [None req-f5b0e9bb-2fbc-4411-939c-b2dda8d87918 admin admin] create_initial_revision uuid=37903648-aa27-42fa-926e-18741dbbf141, type=ports, rev=-1 {{(pid=77619) create_initial_revision /opt/stack/neutron/neutron/db/ovn_revision_numbers_db.py:108}} May 28 12:53:48 l75lg1-v1 neutron-server[77619]: INFO neutron.tests.unit.plugins.ml2.drivers.mechanism_logger [None req-f5b0e9bb-2fbc-4411-939c-b2dda8d87918 admin admin] create_port_precommit called with port settings {'id': '37903648-aa27-42fa-926e-18741dbbf141', 'name': '', 'network_id': 'a709f3ff-68d5-435a-bc2b-36acb8ce95d4', 'tenant_id': 'ea8d517cde1d40bb82c97e080ce071f7', 'mac_address': 'fa:16:3e:bd:a4:f6', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ovnmeta-a709f3ff-68d5-435a-bc2b-36acb8ce95d4', 'device_owner': 'network:distributed', 'standard_attr_id': 44, 'fixed_ips': [], 'project_id': 'ea8d517cde1d40bb82c97e080ce071f7', 'port_security_enabled': False, 'security_groups': [], 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'allowed_address_pairs': []} (original settings None) host (original host None) vif type unbound (original vif type None) vif details {} (original vif details None) binding levels None (original binding levels None) on network {'id': 'a709f3ff-68d5-435a-bc2b-36acb8ce95d4', 'name': 'shared', 'tenant_id': 'ea8d517cde1d40bb82c97e080ce071f7', 'admin_state_up': True, 'mtu': 1442, 'status': 'ACTIVE', 'subnets': [], 'standard_attr_id': 42, 'shared': True, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'vlan_transparent': None, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2024-05-28T12:53:48Z', 'updated_at': '2024-05-28T12:53:48Z', 'revision_number': 1, 'project_id': 'ea8d517cde1d40bb82c97e080ce071f7', 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 39669} with segments to bind None May 28 12:53:48 l75lg1-v1 neutron-server[77619]: DEBUG neutron.tests.unit.plugins.ml2.drivers.mechanism_logger [None req-f5b0e9bb-2fbc-4411-939c-b2dda8d87918 admin admin] create_port_precommit: May 28 12:53:48 l75lg1-v1 neutron-server[77619]: key[tenant_id], None -> ea8d517cde1d40bb82c97e080ce071f7 May 28 12:53:48 l75lg1-v1 neutron-server[77619]: key[network_id], None -> a709f3ff-68d5-435a-bc2b-36acb8ce95d4 May 28 12:53:48 l75lg1-v1 neutron-server[77619]: key[allowed_address_pairs], None -> [] May 28 12:53:48 l75lg1-v1 neutron-server[77619]: key[binding:vif_type], None -> unbound May 28 12:53:48 l75lg1-v1 neutron-server[77619]: key[project_id], None -> ea8d517cde1d40bb82c97e080ce071f7 May 28 12:53:48 l75lg1-v1 neutron-server[77619]: key[admin_state_up], None -> True May 28 12:53:48 l75lg1-v1 neutron-server[77619]: key[id], None -> 37903648-aa27-42fa-926e-18741dbbf141 May 28 12:53:48 l75lg1-v1 neutron-server[77619]: key[security_groups], None -> [] May 28 12:53:48 l75lg1-v1 neutron-server[77619]: key[binding:vnic_type], None -> normal May 28 12:53:48 l75lg1-v1 neutron-server[77619]: key[name], None -> May 28 12:53:48 l75lg1-v1 neutron-server[77619]: key[status], None -> DOWN May 28 12:53:48 l75lg1-v1 neutron-server[77619]: key[binding:profile], None -> {} May 28 12:53:48 l75lg1-v1 neutron-server[77619]: key[port_security_enabled], None -> False May 28 12:53:48 l75lg1-v1 neutron-server[77619]: key[standard_attr_id], None -> 44 May 28 12:53:48 l75lg1-v1 neutron-server[77619]: key[device_owner], None -> network:distributed May 28 12:53:48 l75lg1-v1 neutron-server[77619]: key[device_id], None -> ovnmeta-a709f3ff-68d5-435a-bc2b-36acb8ce95d4 May 28 12:53:48 l75lg1-v1 neutron-server[77619]: key[mac_address], None -> fa:16:3e:bd:a4:f6 May 28 12:53:48 l75lg1-v1 neutron-server[77619]: key[binding:host_id], None -> May 28 12:53:48 l75lg1-v1 neutron-server[77619]: key[binding:vif_details], None -> {} May 28 12:53:48 l75lg1-v1 neutron-server[77619]: key[fixed_ips], None -> [] May 28 12:53:48 l75lg1-v1 neutron-server[77619]: {{(pid=77619) _log_diff_call /opt/stack/neutron/neutron/tests/unit/plugins/ml2/drivers/mechanism_logger.py:59}} May 28 12:53:48 l75lg1-v1 neutron-server[77619]: DEBUG neutron_lib.callbacks.manager [None req-f5b0e9bb-2fbc-4411-939c-b2dda8d87918 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4166243'] for port (37903648-aa27-42fa-926e-18741dbbf141), after_create {{(pid=77619) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:53:48 l75lg1-v1 neutron-server[77619]: DEBUG ovsdbapp.backend.ovs_idl.transaction [None req-53cecb61-7023-41e4-a5ea-23b1eb02606a None None] Running txn n=1 command(idx=0): AddLSwitchPortCommand(_result=None, lport=37903648-aa27-42fa-926e-18741dbbf141, lswitch=neutron-a709f3ff-68d5-435a-bc2b-36acb8ce95d4, may_exist=True, columns={'addresses': ['fa:16:3e:bd:a4:f6'], 'external_ids': {'neutron:port_name': '', 'neutron:device_id': 'ovnmeta-a709f3ff-68d5-435a-bc2b-36acb8ce95d4', 'neutron:project_id': 'ea8d517cde1d40bb82c97e080ce071f7', 'neutron:cidrs': '', 'neutron:device_owner': 'network:distributed', 'neutron:subnet_pool_addr_scope4': '', 'neutron:subnet_pool_addr_scope6': '', 'neutron:network_name': 'neutron-a709f3ff-68d5-435a-bc2b-36acb8ce95d4', 'neutron:security_group_ids': '', 'neutron:revision_number': '1', 'neutron:vnic_type': 'normal', 'neutron:port_capabilities': '', 'neutron:mtu': ''}, 'parent_name': [], 'tag': [], 'enabled': True, 'options': {}, 'type': 'localport', 'port_security': [], 'dhcpv4_options': [], 'dhcpv6_options': []}) {{(pid=77619) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:53:48 l75lg1-v1 neutron-server[77619]: DEBUG ovsdbapp.backend.ovs_idl.transaction [None req-53cecb61-7023-41e4-a5ea-23b1eb02606a None None] Running txn n=1 command(idx=1): QoSDelCommand(_result=None, switch=neutron-a709f3ff-68d5-435a-bc2b-36acb8ce95d4, conditions=[('direction', '=', 'to-lport'), ('priority', '=', 2002), ('match', '=', 'outport == "37903648-aa27-42fa-926e-18741dbbf141"')], if_exists=True) {{(pid=77619) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:53:48 l75lg1-v1 neutron-server[77619]: DEBUG ovsdbapp.backend.ovs_idl.transaction [None req-53cecb61-7023-41e4-a5ea-23b1eb02606a None None] Running txn n=1 command(idx=2): UpdateLSwitchPortQosOptionsCommand(_result=None, lport=AddLSwitchPortCommand(_result=0fd216a1-67fb-4cd3-87b3-c86ad7e90c42, lport=37903648-aa27-42fa-926e-18741dbbf141, lswitch=neutron-a709f3ff-68d5-435a-bc2b-36acb8ce95d4, may_exist=True, columns={'addresses': ['fa:16:3e:bd:a4:f6'], 'external_ids': {'neutron:port_name': '', 'neutron:device_id': 'ovnmeta-a709f3ff-68d5-435a-bc2b-36acb8ce95d4', 'neutron:project_id': 'ea8d517cde1d40bb82c97e080ce071f7', 'neutron:cidrs': '', 'neutron:device_owner': 'network:distributed', 'neutron:subnet_pool_addr_scope4': '', 'neutron:subnet_pool_addr_scope6': '', 'neutron:network_name': 'neutron-a709f3ff-68d5-435a-bc2b-36acb8ce95d4', 'neutron:security_group_ids': '', 'neutron:revision_number': '1', 'neutron:vnic_type': 'normal', 'neutron:port_capabilities': '', 'neutron:mtu': ''}, 'parent_name': [], 'enabled': True, 'options': {}, 'type': 'localport', 'port_security': []}), if_exists=True, qos={'qos_min_rate': None}) {{(pid=77619) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:53:48 l75lg1-v1 neutron-server[77619]: DEBUG ovsdbapp.backend.ovs_idl.transaction [None req-53cecb61-7023-41e4-a5ea-23b1eb02606a None None] Running txn n=1 command(idx=3): QoSDelCommand(_result=None, switch=neutron-a709f3ff-68d5-435a-bc2b-36acb8ce95d4, conditions=[('direction', '=', 'from-lport'), ('priority', '=', 2002), ('match', '=', 'inport == "37903648-aa27-42fa-926e-18741dbbf141"')], if_exists=True) {{(pid=77619) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:53:48 l75lg1-v1 neutron-server[77619]: DEBUG ovsdbapp.backend.ovs_idl.transaction [None req-53cecb61-7023-41e4-a5ea-23b1eb02606a None None] Running txn n=1 command(idx=4): UpdateLSwitchPortQosOptionsCommand(_result=None, lport=AddLSwitchPortCommand(_result=0fd216a1-67fb-4cd3-87b3-c86ad7e90c42, lport=37903648-aa27-42fa-926e-18741dbbf141, lswitch=neutron-a709f3ff-68d5-435a-bc2b-36acb8ce95d4, may_exist=True, columns={'addresses': ['fa:16:3e:bd:a4:f6'], 'external_ids': {'neutron:port_name': '', 'neutron:device_id': 'ovnmeta-a709f3ff-68d5-435a-bc2b-36acb8ce95d4', 'neutron:project_id': 'ea8d517cde1d40bb82c97e080ce071f7', 'neutron:cidrs': '', 'neutron:device_owner': 'network:distributed', 'neutron:subnet_pool_addr_scope4': '', 'neutron:subnet_pool_addr_scope6': '', 'neutron:network_name': 'neutron-a709f3ff-68d5-435a-bc2b-36acb8ce95d4', 'neutron:security_group_ids': '', 'neutron:revision_number': '1', 'neutron:vnic_type': 'normal', 'neutron:port_capabilities': '', 'neutron:mtu': ''}, 'parent_name': [], 'enabled': True, 'options': {}, 'type': 'localport', 'port_security': []}), if_exists=True, qos={'qos_min_rate': None}) {{(pid=77619) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:53:48 l75lg1-v1 neutron-server[77618]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-d9d4969c-e9ae-4d76-91b0-9b7c8eb907b3 None None] Hash Ring: Node 4c6fc793-7f5a-456f-b4d6-6e5bd97592f2 (host: l75lg1-v1) handling event "create" for row 4c4b2f66-8824-416e-b517-d8fc7efd0348 (table: Port_Binding) {{(pid=77618) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:53:48 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-53cecb61-7023-41e4-a5ea-23b1eb02606a None None] Hash Ring: Node c89b3497-133e-4a5a-b67a-3310d2cb2485 (host: l75lg1-v1) handling event "update" for row 4bac71c1-337b-4851-b33f-9c363a194860 (table: Logical_Switch) {{(pid=77619) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:53:48 l75lg1-v1 neutron-server[77618]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-c63b1acc-b5c6-4be8-9db9-04824fec27f2 None None] Hash Ring: Node 4c6fc793-7f5a-456f-b4d6-6e5bd97592f2 (host: l75lg1-v1) handling event "create" for row 49aed43b-f08e-4b11-8864-76e6c8fee08d (table: Logical_Switch_Port) {{(pid=77618) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:53:48 l75lg1-v1 neutron-server[77618]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-c63b1acc-b5c6-4be8-9db9-04824fec27f2 None None] Hash Ring: Node 4c6fc793-7f5a-456f-b4d6-6e5bd97592f2 (host: l75lg1-v1) handling event "update" for row 49aed43b-f08e-4b11-8864-76e6c8fee08d (table: Logical_Switch_Port) {{(pid=77618) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:53:48 l75lg1-v1 neutron-server[77619]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f5b0e9bb-2fbc-4411-939c-b2dda8d87918 admin admin] Pushing event updated for resources: {'Port': ['ID=37903648-aa27-42fa-926e-18741dbbf141,revision_number=1']} {{(pid=77619) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 28 12:53:48 l75lg1-v1 neutron-server[77619]: INFO neutron.db.ovn_revision_numbers_db [None req-f5b0e9bb-2fbc-4411-939c-b2dda8d87918 admin admin] Successfully bumped revision number for resource 37903648-aa27-42fa-926e-18741dbbf141 (type: ports) to 1 May 28 12:53:48 l75lg1-v1 neutron-server[77619]: INFO neutron.tests.unit.plugins.ml2.drivers.mechanism_logger [None req-f5b0e9bb-2fbc-4411-939c-b2dda8d87918 admin admin] create_port_postcommit called with port settings {'id': '37903648-aa27-42fa-926e-18741dbbf141', 'name': '', 'network_id': 'a709f3ff-68d5-435a-bc2b-36acb8ce95d4', 'tenant_id': 'ea8d517cde1d40bb82c97e080ce071f7', 'mac_address': 'fa:16:3e:bd:a4:f6', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ovnmeta-a709f3ff-68d5-435a-bc2b-36acb8ce95d4', 'device_owner': 'network:distributed', 'standard_attr_id': 44, 'fixed_ips': [], 'project_id': 'ea8d517cde1d40bb82c97e080ce071f7', 'port_security_enabled': False, 'security_groups': [], 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'description': '', 'tags': [], 'created_at': '2024-05-28T12:53:48Z', 'updated_at': '2024-05-28T12:53:48Z', 'revision_number': 1, 'network': {'id': 'a709f3ff-68d5-435a-bc2b-36acb8ce95d4', 'name': 'shared', 'tenant_id': 'ea8d517cde1d40bb82c97e080ce071f7', 'admin_state_up': True, 'mtu': 1442, 'status': 'ACTIVE', 'subnets': [], 'standard_attr_id': 42, 'shared': True, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'vlan_transparent': None, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2024-05-28T12:53:48Z', 'updated_at': '2024-05-28T12:53:48Z', 'revision_number': 1, 'project_id': 'ea8d517cde1d40bb82c97e080ce071f7', 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 39669}} (original settings None) host (original host None) vif type unbound (original vif type None) vif details {} (original vif details None) binding levels None (original binding levels None) on network {'id': 'a709f3ff-68d5-435a-bc2b-36acb8ce95d4', 'name': 'shared', 'tenant_id': 'ea8d517cde1d40bb82c97e080ce071f7', 'admin_state_up': True, 'mtu': 1442, 'status': 'ACTIVE', 'subnets': [], 'standard_attr_id': 42, 'shared': True, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'vlan_transparent': None, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2024-05-28T12:53:48Z', 'updated_at': '2024-05-28T12:53:48Z', 'revision_number': 1, 'project_id': 'ea8d517cde1d40bb82c97e080ce071f7', 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 39669} with segments to bind None May 28 12:53:48 l75lg1-v1 neutron-server[77619]: DEBUG neutron.tests.unit.plugins.ml2.drivers.mechanism_logger [None req-f5b0e9bb-2fbc-4411-939c-b2dda8d87918 admin admin] create_port_postcommit: May 28 12:53:48 l75lg1-v1 neutron-server[77619]: key[tenant_id], None -> ea8d517cde1d40bb82c97e080ce071f7 May 28 12:53:48 l75lg1-v1 neutron-server[77619]: key[network_id], None -> a709f3ff-68d5-435a-bc2b-36acb8ce95d4 May 28 12:53:48 l75lg1-v1 neutron-server[77619]: key[allowed_address_pairs], None -> [] May 28 12:53:48 l75lg1-v1 neutron-server[77619]: key[binding:vif_type], None -> unbound May 28 12:53:48 l75lg1-v1 neutron-server[77619]: key[project_id], None -> ea8d517cde1d40bb82c97e080ce071f7 May 28 12:53:48 l75lg1-v1 neutron-server[77619]: key[admin_state_up], None -> True May 28 12:53:48 l75lg1-v1 neutron-server[77619]: key[id], None -> 37903648-aa27-42fa-926e-18741dbbf141 May 28 12:53:48 l75lg1-v1 neutron-server[77619]: key[security_groups], None -> [] May 28 12:53:48 l75lg1-v1 neutron-server[77619]: key[extra_dhcp_opts], None -> [] May 28 12:53:48 l75lg1-v1 neutron-server[77619]: key[binding:vnic_type], None -> normal May 28 12:53:48 l75lg1-v1 neutron-server[77619]: key[tags], None -> [] May 28 12:53:48 l75lg1-v1 neutron-server[77619]: key[name], None -> May 28 12:53:48 l75lg1-v1 neutron-server[77619]: key[created_at], None -> 2024-05-28T12:53:48Z May 28 12:53:48 l75lg1-v1 neutron-server[77619]: key[status], None -> DOWN May 28 12:53:48 l75lg1-v1 neutron-server[77619]: key[binding:profile], None -> {} May 28 12:53:48 l75lg1-v1 neutron-server[77619]: key[port_security_enabled], None -> False May 28 12:53:48 l75lg1-v1 neutron-server[77619]: key[updated_at], None -> 2024-05-28T12:53:48Z May 28 12:53:48 l75lg1-v1 neutron-server[77619]: key[network], None -> {'id': 'a709f3ff-68d5-435a-bc2b-36acb8ce95d4', 'name': 'shared', 'tenant_id': 'ea8d517cde1d40bb82c97e080ce071f7', 'admin_state_up': True, 'mtu': 1442, 'status': 'ACTIVE', 'subnets': [], 'standard_attr_id': 42, 'shared': True, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'vlan_transparent': None, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2024-05-28T12:53:48Z', 'updated_at': '2024-05-28T12:53:48Z', 'revision_number': 1, 'project_id': 'ea8d517cde1d40bb82c97e080ce071f7', 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 39669} May 28 12:53:48 l75lg1-v1 neutron-server[77619]: key[standard_attr_id], None -> 44 May 28 12:53:48 l75lg1-v1 neutron-server[77619]: key[device_owner], None -> network:distributed May 28 12:53:48 l75lg1-v1 neutron-server[77619]: key[device_id], None -> ovnmeta-a709f3ff-68d5-435a-bc2b-36acb8ce95d4 May 28 12:53:48 l75lg1-v1 neutron-server[77619]: key[mac_address], None -> fa:16:3e:bd:a4:f6 May 28 12:53:48 l75lg1-v1 neutron-server[77619]: key[description], None -> May 28 12:53:48 l75lg1-v1 neutron-server[77619]: key[binding:host_id], None -> May 28 12:53:48 l75lg1-v1 neutron-server[77619]: key[binding:vif_details], None -> {} May 28 12:53:48 l75lg1-v1 neutron-server[77619]: key[revision_number], None -> 1 May 28 12:53:48 l75lg1-v1 neutron-server[77619]: key[fixed_ips], None -> [] May 28 12:53:48 l75lg1-v1 neutron-server[77619]: {{(pid=77619) _log_diff_call /opt/stack/neutron/neutron/tests/unit/plugins/ml2/drivers/mechanism_logger.py:59}} May 28 12:53:48 l75lg1-v1 neutron-server[77619]: INFO neutron.tests.unit.plugins.ml2.drivers.mechanism_logger [None req-f5b0e9bb-2fbc-4411-939c-b2dda8d87918 admin admin] create_network_postcommit called with network settings {'id': 'a709f3ff-68d5-435a-bc2b-36acb8ce95d4', 'name': 'shared', 'tenant_id': 'ea8d517cde1d40bb82c97e080ce071f7', 'admin_state_up': True, 'mtu': 1442, 'status': 'ACTIVE', 'subnets': [], 'standard_attr_id': 42, 'shared': True, 'project_id': 'ea8d517cde1d40bb82c97e080ce071f7', 'port_security_enabled': True, 'router:external': False, 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 39669, 'is_default': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'vlan_transparent': None, 'description': '', 'tags': [], 'created_at': '2024-05-28T12:53:48Z', 'updated_at': '2024-05-28T12:53:48Z', 'revision_number': 1} (original settings None) and network segments [{'id': '6d6f6abd-d338-4b73-9dee-7ce52718541b', 'network_type': 'geneve', 'physical_network': None, 'segmentation_id': 39669, 'network_id': 'a709f3ff-68d5-435a-bc2b-36acb8ce95d4'}] May 28 12:53:48 l75lg1-v1 neutron-server[77619]: DEBUG neutron.tests.unit.plugins.ml2.drivers.mechanism_logger [None req-f5b0e9bb-2fbc-4411-939c-b2dda8d87918 admin admin] create_network_postcommit: May 28 12:53:48 l75lg1-v1 neutron-server[77619]: key[tenant_id], None -> ea8d517cde1d40bb82c97e080ce071f7 May 28 12:53:48 l75lg1-v1 neutron-server[77619]: key[provider:network_type], None -> geneve May 28 12:53:48 l75lg1-v1 neutron-server[77619]: key[project_id], None -> ea8d517cde1d40bb82c97e080ce071f7 May 28 12:53:48 l75lg1-v1 neutron-server[77619]: key[ipv6_address_scope], None -> None May 28 12:53:48 l75lg1-v1 neutron-server[77619]: key[subnets], None -> [] May 28 12:53:48 l75lg1-v1 neutron-server[77619]: key[admin_state_up], None -> True May 28 12:53:48 l75lg1-v1 neutron-server[77619]: key[id], None -> a709f3ff-68d5-435a-bc2b-36acb8ce95d4 May 28 12:53:48 l75lg1-v1 neutron-server[77619]: key[ipv4_address_scope], None -> None May 28 12:53:48 l75lg1-v1 neutron-server[77619]: key[tags], None -> [] May 28 12:53:48 l75lg1-v1 neutron-server[77619]: key[created_at], None -> 2024-05-28T12:53:48Z May 28 12:53:48 l75lg1-v1 neutron-server[77619]: key[status], None -> ACTIVE May 28 12:53:48 l75lg1-v1 neutron-server[77619]: key[is_default], None -> False May 28 12:53:48 l75lg1-v1 neutron-server[77619]: key[port_security_enabled], None -> True May 28 12:53:48 l75lg1-v1 neutron-server[77619]: key[vlan_transparent], None -> None May 28 12:53:48 l75lg1-v1 neutron-server[77619]: key[updated_at], None -> 2024-05-28T12:53:48Z May 28 12:53:48 l75lg1-v1 neutron-server[77619]: key[standard_attr_id], None -> 42 May 28 12:53:48 l75lg1-v1 neutron-server[77619]: key[availability_zone_hints], None -> [] May 28 12:53:48 l75lg1-v1 neutron-server[77619]: key[provider:physical_network], None -> None May 28 12:53:48 l75lg1-v1 neutron-server[77619]: key[shared], None -> True May 28 12:53:48 l75lg1-v1 neutron-server[77619]: key[mtu], None -> 1442 May 28 12:53:48 l75lg1-v1 neutron-server[77619]: key[provider:segmentation_id], None -> 39669 May 28 12:53:48 l75lg1-v1 neutron-server[77619]: key[description], None -> May 28 12:53:48 l75lg1-v1 neutron-server[77619]: key[availability_zones], None -> [] May 28 12:53:48 l75lg1-v1 neutron-server[77619]: key[revision_number], None -> 1 May 28 12:53:48 l75lg1-v1 neutron-server[77619]: key[router:external], None -> False May 28 12:53:48 l75lg1-v1 neutron-server[77619]: key[name], None -> shared May 28 12:53:48 l75lg1-v1 neutron-server[77619]: {{(pid=77619) _log_diff_call /opt/stack/neutron/neutron/tests/unit/plugins/ml2/drivers/mechanism_logger.py:59}} May 28 12:53:48 l75lg1-v1 neutron-server[77619]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f5b0e9bb-2fbc-4411-939c-b2dda8d87918 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=77619) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:258}} May 28 12:53:48 l75lg1-v1 neutron-server[77619]: DEBUG neutron_lib.callbacks.manager [None req-f5b0e9bb-2fbc-4411-939c-b2dda8d87918 admin admin] Publish callbacks [] for network (None), before_response {{(pid=77619) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:53:48 l75lg1-v1 neutron-server[77619]: INFO neutron.wsgi [None req-f5b0e9bb-2fbc-4411-939c-b2dda8d87918 admin admin] 10.27.203.238 "POST /networking/v2.0/networks HTTP/1.1" status: 201 len: 845 time: 0.6014402 May 28 12:53:49 l75lg1-v1 devstack@placement-api.service[78202]: DEBUG placement.requestlog [req-6cbe5dc8-0fa7-4a1b-a13b-4206ab9a8b4e req-43015381-72e7-4429-b0a7-641e0694cdb4 None None] Starting request: 10.27.203.238 "GET /placement/resource_providers/ef90d7d1-0808-4a15-ad77-f9a7391af2f4/allocations" {{(pid=78202) __call__ /opt/stack/placement/placement/requestlog.py:55}} May 28 12:53:49 l75lg1-v1 devstack@placement-api.service[78202]: INFO placement.requestlog [req-6cbe5dc8-0fa7-4a1b-a13b-4206ab9a8b4e req-43015381-72e7-4429-b0a7-641e0694cdb4 service placement] 10.27.203.238 "GET /placement/resource_providers/ef90d7d1-0808-4a15-ad77-f9a7391af2f4/allocations" status: 200 len: 54 microversion: 1.0 May 28 12:53:49 l75lg1-v1 devstack@placement-api.service[78202]: [pid: 78202|app: 0|req: 17/33] 10.27.203.238 () {62 vars in 1480 bytes} [Tue May 28 12:53:49 2024] GET /placement/resource_providers/ef90d7d1-0808-4a15-ad77-f9a7391af2f4/allocations => generated 54 bytes in 20 msecs (HTTP/1.1 200) 6 headers in 223 bytes (1 switches on core 0) May 28 12:53:49 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.resource_tracker [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Total usable vcpus: 10, total allocated vcpus: 0 {{(pid=83654) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}} May 28 12:53:49 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.resource_tracker [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Final resource view: name=l75lg1-v1 phys_ram=16000MB used_ram=512MB phys_disk=28GB used_disk=0GB total_vcpus=10 used_vcpus=0 pci_stats=[] {{(pid=83654) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}} May 28 12:53:49 l75lg1-v1 devstack@placement-api.service[78201]: DEBUG placement.requestlog [req-6cbe5dc8-0fa7-4a1b-a13b-4206ab9a8b4e req-cfc0f873-d95b-4153-8414-b547395ae380 None None] Starting request: 10.27.203.238 "GET /placement/resource_providers/ef90d7d1-0808-4a15-ad77-f9a7391af2f4/allocations" {{(pid=78201) __call__ /opt/stack/placement/placement/requestlog.py:55}} May 28 12:53:49 l75lg1-v1 devstack@placement-api.service[78201]: INFO placement.requestlog [req-6cbe5dc8-0fa7-4a1b-a13b-4206ab9a8b4e req-cfc0f873-d95b-4153-8414-b547395ae380 service placement] 10.27.203.238 "GET /placement/resource_providers/ef90d7d1-0808-4a15-ad77-f9a7391af2f4/allocations" status: 200 len: 54 microversion: 1.0 May 28 12:53:49 l75lg1-v1 devstack@placement-api.service[78201]: [pid: 78201|app: 0|req: 17/34] 10.27.203.238 () {62 vars in 1480 bytes} [Tue May 28 12:53:49 2024] GET /placement/resource_providers/ef90d7d1-0808-4a15-ad77-f9a7391af2f4/allocations => generated 54 bytes in 17 msecs (HTTP/1.1 200) 6 headers in 223 bytes (1 switches on core 0) May 28 12:53:49 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.provider_tree [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Inventory has not changed in ProviderTree for provider: ef90d7d1-0808-4a15-ad77-f9a7391af2f4 {{(pid=83654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} May 28 12:53:49 l75lg1-v1 dstat.sh[49771]: 28-05 12:53:49| 11 1 84 2 0|4759M 2965M 268M 7657M| 19k 2626B| 0 2039k| 0 247 |4667 7497 |0.85 0.71 0.93|2.0 1.0 3.0| 0 0 | 0 2048M| 27 311 0 19 0 May 28 12:53:49 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Expecting reply to msg 0a5b80c8786a4dfc92d65b97106b6559 in queue reply_37f4cbd1dd094961a22b8a65f222c327 May 28 12:53:49 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [-] Received RPC response for msg 0a5b80c8786a4dfc92d65b97106b6559 May 28 12:53:49 l75lg1-v1 neutron-server[77623]: DEBUG dbcounter [-] [77623] Writing DB stats neutron:SELECT=1 {{(pid=77623) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:53:49 l75lg1-v1 neutron-server[77623]: DEBUG dbcounter [-] [77623] Writing DB stats neutron:DELETE=1,neutron:SELECT=2 {{(pid=77623) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:53:49 l75lg1-v1 nova-compute[83654]: DEBUG nova.scheduler.client.report [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Inventory has not changed for provider ef90d7d1-0808-4a15-ad77-f9a7391af2f4 based on inventory data: {'VCPU': {'total': 10, 'reserved': 0, 'min_unit': 1, 'max_unit': 10, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16000, 'reserved': 512, 'min_unit': 1, 'max_unit': 16000, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 28, 'reserved': 0, 'min_unit': 1, 'max_unit': 28, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=83654) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}} May 28 12:53:49 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.resource_tracker [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Compute_service record updated for l75lg1-v1:l75lg1-v1 {{(pid=83654) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}} May 28 12:53:49 l75lg1-v1 nova-compute[83654]: DEBUG oslo_concurrency.lockutils [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.573s {{(pid=83654) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:53:50 l75lg1-v1 dstat.sh[49771]: 28-05 12:53:50| 10 1 87 2 0|4802M 2922M 268M 7657M| 14k 172B| 0 1789k| 0 159 |2443 3426 |0.85 0.71 0.93|1.0 0 0| 0 0 | 0 2048M| 27 311 0 16 0 May 28 12:53:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61954780-4807-4c85-8a49-f62b4ad1178c None None] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:53:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61954780-4807-4c85-8a49-f62b4ad1178c None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:53:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61954780-4807-4c85-8a49-f62b4ad1178c None None] PATH_INFO: `/` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:53:50 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 584/1154] 10.27.203.238 () {58 vars in 1014 bytes} [Tue May 28 12:53:50 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:53:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2448232e-d6ac-4869-9472-5fbf08f629c3 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:53:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2448232e-d6ac-4869-9472-5fbf08f629c3 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:53:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2448232e-d6ac-4869-9472-5fbf08f629c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:53:50 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-2448232e-d6ac-4869-9472-5fbf08f629c3 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:53:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-2448232e-d6ac-4869-9472-5fbf08f629c3 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:53:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-2448232e-d6ac-4869-9472-5fbf08f629c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:53:50 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 571/1155] 10.27.203.238 () {62 vars in 1111 bytes} [Tue May 28 12:53:50 2024] POST /identity/v3/auth/tokens => generated 3991 bytes in 24 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:53:50 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:53:50 l75lg1-v1 neutron-server[77618]: DEBUG neutron.wsgi [-] (77618) accepted ('10.27.203.238', 59728) {{(pid=77618) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 12:53:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61954780-4807-4c85-8a49-f62b4ad1178c None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:53:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61954780-4807-4c85-8a49-f62b4ad1178c None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:53:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922a1917-e40d-44cf-97bf-62cb33accc77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef17047035e4b518fd5360a01f2da1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:53:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922a1917-e40d-44cf-97bf-62cb33accc77 service neutron] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:53:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922a1917-e40d-44cf-97bf-62cb33accc77 service neutron] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:53:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922a1917-e40d-44cf-97bf-62cb33accc77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:53:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922a1917-e40d-44cf-97bf-62cb33accc77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:53:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922a1917-e40d-44cf-97bf-62cb33accc77 service neutron] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:53:50 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 585/1156] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 12:53:50 2024] GET /identity/v3/auth/tokens => generated 3991 bytes in 20 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 12:53:50 l75lg1-v1 neutron-server[77618]: INFO neutron.pecan_wsgi.hooks.translation [None req-940b5d42-b615-435f-9b68-862979f6a76c admin admin] GET failed (client error): The resource could not be found. May 28 12:53:50 l75lg1-v1 neutron-server[77618]: INFO neutron.wsgi [None req-940b5d42-b615-435f-9b68-862979f6a76c admin admin] 10.27.203.238 "GET /networking/v2.0/networks/shared HTTP/1.1" status: 404 len: 314 time: 0.0388124 May 28 12:53:50 l75lg1-v1 neutron-server[77618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7190eb40-e309-4f89-98c0-63c46097f974 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=77618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:258}} May 28 12:53:50 l75lg1-v1 neutron-server[77618]: INFO neutron.wsgi [None req-7190eb40-e309-4f89-98c0-63c46097f974 admin admin] 10.27.203.238 "GET /networking/v2.0/networks?name=shared HTTP/1.1" status: 200 len: 824 time: 0.0446403 May 28 12:53:50 l75lg1-v1 neutron-server[77618]: DEBUG neutron.api.v2.base [None req-70a221f5-3b56-4c9c-b26e-981e55758b7f admin admin] Request body: {'subnet': {'ip_version': 4, 'description': 'shared-subnet', 'network_id': 'a709f3ff-68d5-435a-bc2b-36acb8ce95d4', 'name': 'shared-subnet', 'cidr': '192.168.233.0/24'}} {{(pid=77618) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:734}} May 28 12:53:50 l75lg1-v1 neutron-server[77618]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-70a221f5-3b56-4c9c-b26e-981e55758b7f admin admin] Made reservation on behalf of ea8d517cde1d40bb82c97e080ce071f7 for: {'subnet': 1} {{(pid=77618) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 28 12:53:50 l75lg1-v1 neutron-server[77618]: DEBUG neutron_lib.callbacks.manager [None req-70a221f5-3b56-4c9c-b26e-981e55758b7f admin admin] Publish callbacks [] for subnet (None), before_create {{(pid=77618) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:53:50 l75lg1-v1 neutron-server[77618]: DEBUG neutron.db.ovn_revision_numbers_db [None req-70a221f5-3b56-4c9c-b26e-981e55758b7f admin admin] create_initial_revision uuid=e4fad118-aaed-4b8f-af24-7f60741ecf53, type=subnets, rev=-1 {{(pid=77618) create_initial_revision /opt/stack/neutron/neutron/db/ovn_revision_numbers_db.py:108}} May 28 12:53:50 l75lg1-v1 neutron-server[77618]: INFO neutron.tests.unit.plugins.ml2.drivers.mechanism_logger [None req-70a221f5-3b56-4c9c-b26e-981e55758b7f admin admin] create_subnet_precommit called with subnet settings {'id': 'e4fad118-aaed-4b8f-af24-7f60741ecf53', 'name': 'shared-subnet', 'tenant_id': 'ea8d517cde1d40bb82c97e080ce071f7', 'network_id': 'a709f3ff-68d5-435a-bc2b-36acb8ce95d4', 'ip_version': 4, 'subnetpool_id': None, 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'standard_attr_id': 45, 'gateway_ip': '192.168.233.1', 'cidr': '192.168.233.0/24', 'allocation_pools': [{'start': '192.168.233.2', 'end': '192.168.233.254'}], 'host_routes': [], 'dns_nameservers': [], 'shared': True, 'description': 'shared-subnet', 'service_types': [], 'tags': [], 'created_at': '2024-05-28T12:53:50Z', 'updated_at': '2024-05-28T12:53:50Z', 'revision_number': 0, 'project_id': 'ea8d517cde1d40bb82c97e080ce071f7'} (original settings None) May 28 12:53:50 l75lg1-v1 neutron-server[77618]: DEBUG neutron.tests.unit.plugins.ml2.drivers.mechanism_logger [None req-70a221f5-3b56-4c9c-b26e-981e55758b7f admin admin] create_subnet_precommit: May 28 12:53:50 l75lg1-v1 neutron-server[77618]: key[tenant_id], None -> ea8d517cde1d40bb82c97e080ce071f7 May 28 12:53:50 l75lg1-v1 neutron-server[77618]: key[network_id], None -> a709f3ff-68d5-435a-bc2b-36acb8ce95d4 May 28 12:53:50 l75lg1-v1 neutron-server[77618]: key[revision_number], None -> 0 May 28 12:53:50 l75lg1-v1 neutron-server[77618]: key[project_id], None -> ea8d517cde1d40bb82c97e080ce071f7 May 28 12:53:50 l75lg1-v1 neutron-server[77618]: key[id], None -> e4fad118-aaed-4b8f-af24-7f60741ecf53 May 28 12:53:50 l75lg1-v1 neutron-server[77618]: key[tags], None -> [] May 28 12:53:50 l75lg1-v1 neutron-server[77618]: key[created_at], None -> 2024-05-28T12:53:50Z May 28 12:53:50 l75lg1-v1 neutron-server[77618]: key[allocation_pools], None -> [{'start': '192.168.233.2', 'end': '192.168.233.254'}] May 28 12:53:50 l75lg1-v1 neutron-server[77618]: key[subnetpool_id], None -> None May 28 12:53:50 l75lg1-v1 neutron-server[77618]: key[host_routes], None -> [] May 28 12:53:50 l75lg1-v1 neutron-server[77618]: key[gateway_ip], None -> 192.168.233.1 May 28 12:53:50 l75lg1-v1 neutron-server[77618]: key[service_types], None -> [] May 28 12:53:50 l75lg1-v1 neutron-server[77618]: key[updated_at], None -> 2024-05-28T12:53:50Z May 28 12:53:50 l75lg1-v1 neutron-server[77618]: key[standard_attr_id], None -> 45 May 28 12:53:50 l75lg1-v1 neutron-server[77618]: key[ip_version], None -> 4 May 28 12:53:50 l75lg1-v1 neutron-server[77618]: key[cidr], None -> 192.168.233.0/24 May 28 12:53:50 l75lg1-v1 neutron-server[77618]: key[dns_nameservers], None -> [] May 28 12:53:50 l75lg1-v1 neutron-server[77618]: key[ipv6_address_mode], None -> None May 28 12:53:50 l75lg1-v1 neutron-server[77618]: key[description], None -> shared-subnet May 28 12:53:50 l75lg1-v1 neutron-server[77618]: key[ipv6_ra_mode], None -> None May 28 12:53:50 l75lg1-v1 neutron-server[77618]: key[enable_dhcp], None -> True May 28 12:53:50 l75lg1-v1 neutron-server[77618]: key[shared], None -> True May 28 12:53:50 l75lg1-v1 neutron-server[77618]: key[name], None -> shared-subnet May 28 12:53:50 l75lg1-v1 neutron-server[77618]: {{(pid=77618) _log_diff_call /opt/stack/neutron/neutron/tests/unit/plugins/ml2/drivers/mechanism_logger.py:59}} May 28 12:53:50 l75lg1-v1 neutron-server[77618]: DEBUG neutron_lib.callbacks.manager [None req-70a221f5-3b56-4c9c-b26e-981e55758b7f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4166501'] for subnet (e4fad118-aaed-4b8f-af24-7f60741ecf53), after_create {{(pid=77618) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:53:51 l75lg1-v1 devstack@g-api.service[86373]: DEBUG dbcounter [-] [86373] Writing DB stats glance:SELECT=5 {{(pid=86373) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:53:51 l75lg1-v1 neutron-server[77618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-70a221f5-3b56-4c9c-b26e-981e55758b7f admin admin] Pushing event updated for resources: {'Subnet': ['ID=e4fad118-aaed-4b8f-af24-7f60741ecf53,revision_number=0']} {{(pid=77618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 28 12:53:51 l75lg1-v1 neutron-server[77618]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-70a221f5-3b56-4c9c-b26e-981e55758b7f admin admin] Tracked resource versions report: May 28 12:53:51 l75lg1-v1 neutron-server[77618]: pushed versions: May 28 12:53:51 l75lg1-v1 neutron-server[77618]: { 'AddressGroup': {'1.2'}, May 28 12:53:51 l75lg1-v1 neutron-server[77618]: 'Agent': {'1.1'}, May 28 12:53:51 l75lg1-v1 neutron-server[77618]: 'ConntrackHelper': {'1.0'}, May 28 12:53:51 l75lg1-v1 neutron-server[77618]: 'LocalIPAssociation': {'1.0'}, May 28 12:53:51 l75lg1-v1 neutron-server[77618]: 'Log': {'1.0'}, May 28 12:53:51 l75lg1-v1 neutron-server[77618]: 'NDPProxy': {'1.0'}, May 28 12:53:51 l75lg1-v1 neutron-server[77618]: 'Network': {'1.1'}, May 28 12:53:51 l75lg1-v1 neutron-server[77618]: 'Port': {'1.9'}, May 28 12:53:51 l75lg1-v1 neutron-server[77618]: 'PortForwarding': {'1.3'}, May 28 12:53:51 l75lg1-v1 neutron-server[77618]: 'QosPolicy': {'1.10'}, May 28 12:53:51 l75lg1-v1 neutron-server[77618]: 'SecurityGroup': {'1.6'}, May 28 12:53:51 l75lg1-v1 neutron-server[77618]: 'SecurityGroupRule': {'1.3'}, May 28 12:53:51 l75lg1-v1 neutron-server[77618]: 'SubPort': {'1.0'}, May 28 12:53:51 l75lg1-v1 neutron-server[77618]: 'Subnet': {'1.1'}, May 28 12:53:51 l75lg1-v1 neutron-server[77618]: 'Trunk': {'1.1'}} May 28 12:53:51 l75lg1-v1 neutron-server[77618]: consumer versions: May 28 12:53:51 l75lg1-v1 neutron-server[77618]: {OVN Controller Gateway agent@l75lg1-v1: {}} May 28 12:53:51 l75lg1-v1 neutron-server[77618]: {{(pid=77618) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:178}} May 28 12:53:51 l75lg1-v1 neutron-server[77618]: DEBUG neutron_lib.callbacks.manager [None req-70a221f5-3b56-4c9c-b26e-981e55758b7f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1015114', 'neutron.services.ovn_l3.plugin.OVNL3RouterPlugin._port_update-8754901907784', 'neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_internal_ip_change_for_fip-8754903031884'] for port (37903648-aa27-42fa-926e-18741dbbf141), before_update {{(pid=77618) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:53:51 l75lg1-v1 neutron-server[77618]: DEBUG neutron.db.db_base_plugin_common [None req-70a221f5-3b56-4c9c-b26e-981e55758b7f admin admin] Allocated IP 192.168.233.2 (a709f3ff-68d5-435a-bc2b-36acb8ce95d4/e4fad118-aaed-4b8f-af24-7f60741ecf53/37903648-aa27-42fa-926e-18741dbbf141) {{(pid=77618) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:134}} May 28 12:53:51 l75lg1-v1 dstat.sh[49771]: 28-05 12:53:51| 10 1 87 1 0|4816M 2908M 268M 7657M| 14k 0 | 0 1324k| 0 137 |3145 4916 |0.85 0.71 0.93|2.0 1.0 0| 0 0 | 0 2048M| 27 313 0 16 0 May 28 12:53:51 l75lg1-v1 neutron-server[77618]: DEBUG neutron_lib.callbacks.manager [None req-70a221f5-3b56-4c9c-b26e-981e55758b7f admin admin] Publish callbacks [] for port (37903648-aa27-42fa-926e-18741dbbf141), precommit_update {{(pid=77618) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:53:51 l75lg1-v1 neutron-server[77618]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver [None req-70a221f5-3b56-4c9c-b26e-981e55758b7f admin admin] No provisioning block for port 37903648-aa27-42fa-926e-18741dbbf141 since it does not have a host {{(pid=77618) _is_port_provisioning_required /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/mech_driver.py:720}} May 28 12:53:51 l75lg1-v1 neutron-server[77618]: INFO neutron.tests.unit.plugins.ml2.drivers.mechanism_logger [None req-70a221f5-3b56-4c9c-b26e-981e55758b7f admin admin] update_port_precommit called with port settings {'id': '37903648-aa27-42fa-926e-18741dbbf141', 'name': '', 'network_id': 'a709f3ff-68d5-435a-bc2b-36acb8ce95d4', 'tenant_id': 'ea8d517cde1d40bb82c97e080ce071f7', 'mac_address': 'fa:16:3e:bd:a4:f6', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ovnmeta-a709f3ff-68d5-435a-bc2b-36acb8ce95d4', 'device_owner': 'network:distributed', 'standard_attr_id': 44, 'fixed_ips': [{'subnet_id': 'e4fad118-aaed-4b8f-af24-7f60741ecf53', 'ip_address': '192.168.233.2'}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2024-05-28T12:53:48Z', 'updated_at': '2024-05-28T12:53:51Z', 'revision_number': 2, 'project_id': 'ea8d517cde1d40bb82c97e080ce071f7'} (original settings {'id': '37903648-aa27-42fa-926e-18741dbbf141', 'name': '', 'network_id': 'a709f3ff-68d5-435a-bc2b-36acb8ce95d4', 'tenant_id': 'ea8d517cde1d40bb82c97e080ce071f7', 'mac_address': 'fa:16:3e:bd:a4:f6', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ovnmeta-a709f3ff-68d5-435a-bc2b-36acb8ce95d4', 'device_owner': 'network:distributed', 'standard_attr_id': 44, 'fixed_ips': [], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2024-05-28T12:53:48Z', 'updated_at': '2024-05-28T12:53:48Z', 'revision_number': 1, 'project_id': 'ea8d517cde1d40bb82c97e080ce071f7'}) host (original host ) vif type unbound (original vif type unbound) vif details {} (original vif details {}) binding levels None (original binding levels None) on network {'id': 'a709f3ff-68d5-435a-bc2b-36acb8ce95d4', 'name': 'shared', 'tenant_id': 'ea8d517cde1d40bb82c97e080ce071f7', 'admin_state_up': True, 'mtu': 1442, 'status': 'ACTIVE', 'subnets': ['e4fad118-aaed-4b8f-af24-7f60741ecf53'], 'standard_attr_id': 42, 'shared': True, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'vlan_transparent': None, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2024-05-28T12:53:48Z', 'updated_at': '2024-05-28T12:53:50Z', 'revision_number': 2, 'project_id': 'ea8d517cde1d40bb82c97e080ce071f7', 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 39669} with segments to bind None May 28 12:53:51 l75lg1-v1 neutron-server[77618]: DEBUG neutron.tests.unit.plugins.ml2.drivers.mechanism_logger [None req-70a221f5-3b56-4c9c-b26e-981e55758b7f admin admin] update_port_precommit: May 28 12:53:51 l75lg1-v1 neutron-server[77618]: key[fixed_ips], [] -> [{'subnet_id': 'e4fad118-aaed-4b8f-af24-7f60741ecf53', 'ip_address': '192.168.233.2'}] May 28 12:53:51 l75lg1-v1 neutron-server[77618]: key[updated_at], 2024-05-28T12:53:48Z -> 2024-05-28T12:53:51Z May 28 12:53:51 l75lg1-v1 neutron-server[77618]: key[revision_number], 1 -> 2 May 28 12:53:51 l75lg1-v1 neutron-server[77618]: {{(pid=77618) _log_diff_call /opt/stack/neutron/neutron/tests/unit/plugins/ml2/drivers/mechanism_logger.py:59}} May 28 12:53:51 l75lg1-v1 neutron-server[77618]: DEBUG neutron_lib.callbacks.manager [None req-70a221f5-3b56-4c9c-b26e-981e55758b7f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4166243', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8754903016533', 'neutron.services.ovn_l3.plugin.OVNL3RouterPlugin._port_update-8754901907784'] for port (37903648-aa27-42fa-926e-18741dbbf141), after_update {{(pid=77618) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:53:51 l75lg1-v1 neutron-server[77618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1ddbcb2d-7827-4380-9419-fb2919d45e51 None None] Pushing event updated for resources: {'Port': ['ID=37903648-aa27-42fa-926e-18741dbbf141,revision_number=2']} {{(pid=77618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 28 12:53:51 l75lg1-v1 neutron-server[77623]: DEBUG neutron.db.agents_db [None req-fe40ce8c-640e-4db7-a17a-6e8888cce266 None None] Agent healthcheck: found 0 active agents {{(pid=77623) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:319}} May 28 12:53:51 l75lg1-v1 neutron-server[77618]: DEBUG ovsdbapp.backend.ovs_idl.transaction [None req-c63b1acc-b5c6-4be8-9db9-04824fec27f2 None None] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=37903648-aa27-42fa-926e-18741dbbf141, resource={'id': '37903648-aa27-42fa-926e-18741dbbf141', 'name': '', 'network_id': 'a709f3ff-68d5-435a-bc2b-36acb8ce95d4', 'tenant_id': 'ea8d517cde1d40bb82c97e080ce071f7', 'mac_address': 'fa:16:3e:bd:a4:f6', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ovnmeta-a709f3ff-68d5-435a-bc2b-36acb8ce95d4', 'device_owner': 'network:distributed', 'standard_attr_id': 44, 'fixed_ips': [{'subnet_id': 'e4fad118-aaed-4b8f-af24-7f60741ecf53', 'ip_address': '192.168.233.2'}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2024-05-28T12:53:48Z', 'updated_at': '2024-05-28T12:53:51Z', 'revision_number': 2, 'project_id': 'ea8d517cde1d40bb82c97e080ce071f7', 'network': {'id': 'a709f3ff-68d5-435a-bc2b-36acb8ce95d4', 'name': 'shared', 'tenant_id': 'ea8d517cde1d40bb82c97e080ce071f7', 'admin_state_up': True, 'mtu': 1442, 'status': 'ACTIVE', 'subnets': ['e4fad118-aaed-4b8f-af24-7f60741ecf53'], 'standard_attr_id': 42, 'shared': True, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'vlan_transparent': None, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2024-05-28T12:53:48Z', 'updated_at': '2024-05-28T12:53:50Z', 'revision_number': 2, 'project_id': 'ea8d517cde1d40bb82c97e080ce071f7', 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 39669}}, resource_type=ports, if_exists=True) {{(pid=77618) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:53:51 l75lg1-v1 neutron-server[77618]: DEBUG ovsdbapp.backend.ovs_idl.transaction [None req-c63b1acc-b5c6-4be8-9db9-04824fec27f2 None None] Running txn n=1 command(idx=1): AddDHCPOptionsCommand(_result=None, columns={'cidr': '192.168.233.0/24', 'options': {'server_id': '192.168.233.1', 'lease_time': '43200', 'mtu': '1442', 'router': '192.168.233.1', 'server_mac': 'fa:16:3e:ed:9a:22', 'dns_server': '{127.0.0.53}', 'classless_static_route': '{169.254.169.254/32,192.168.233.2, 0.0.0.0/0,192.168.233.1}'}, 'external_ids': {'subnet_id': 'e4fad118-aaed-4b8f-af24-7f60741ecf53', 'neutron:revision_number': '0'}}, may_exist=True, subnet_id=e4fad118-aaed-4b8f-af24-7f60741ecf53, port_id=None, new_insert=False) {{(pid=77618) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:53:51 l75lg1-v1 neutron-server[77618]: DEBUG ovsdbapp.backend.ovs_idl.transaction [None req-c63b1acc-b5c6-4be8-9db9-04824fec27f2 None None] Running txn n=1 command(idx=2): SetLSwitchPortCommand(_result=None, lport=37903648-aa27-42fa-926e-18741dbbf141, external_ids_update=None, columns={'external_ids': {'neutron:port_name': '', 'neutron:device_id': 'ovnmeta-a709f3ff-68d5-435a-bc2b-36acb8ce95d4', 'neutron:project_id': 'ea8d517cde1d40bb82c97e080ce071f7', 'neutron:cidrs': '192.168.233.2/24', 'neutron:device_owner': 'network:distributed', 'neutron:subnet_pool_addr_scope4': '', 'neutron:subnet_pool_addr_scope6': '', 'neutron:network_name': 'neutron-a709f3ff-68d5-435a-bc2b-36acb8ce95d4', 'neutron:security_group_ids': '', 'neutron:revision_number': '2', 'neutron:vnic_type': 'normal', 'neutron:port_capabilities': '', 'neutron:mtu': ''}, 'parent_name': [], 'tag': [], 'options': {}, 'enabled': True, 'port_security': [], 'dhcpv4_options': [], 'dhcpv6_options': [], 'type': 'localport', 'addresses': ['fa:16:3e:bd:a4:f6 192.168.233.2'], 'ha_chassis_group': []}, if_exists=False) {{(pid=77618) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:53:51 l75lg1-v1 neutron-server[77618]: DEBUG ovsdbapp.backend.ovs_idl.transaction [None req-c63b1acc-b5c6-4be8-9db9-04824fec27f2 None None] Running txn n=1 command(idx=3): PgDelPortCommand(_result=None, port_group=neutron_pg_drop, lsp=['37903648-aa27-42fa-926e-18741dbbf141'], if_exists=False) {{(pid=77618) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:53:51 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-53cecb61-7023-41e4-a5ea-23b1eb02606a None None] Hash Ring: Node c89b3497-133e-4a5a-b67a-3310d2cb2485 (host: l75lg1-v1) handling event "create" for row 1ebc6876-deed-4e6d-b34f-83e951ff142c (table: DHCP_Options) {{(pid=77619) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:53:51 l75lg1-v1 neutron-server[77618]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-c63b1acc-b5c6-4be8-9db9-04824fec27f2 None None] Hash Ring: Node 4c6fc793-7f5a-456f-b4d6-6e5bd97592f2 (host: l75lg1-v1) handling event "update" for row 49aed43b-f08e-4b11-8864-76e6c8fee08d (table: Logical_Switch_Port) {{(pid=77618) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:53:51 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched UPDATE: PortBindingUpdatedEvent(events=('update',), table='Port_Binding', conditions=None, old_conditions=None), priority=20 to row=Port_Binding(parent_port=[], mac=['fa:16:3e:bd:a4:f6 192.168.233.2'], chassis=[], ha_chassis_group=[], options={}, type=localport, tag=[], requested_chassis=[], tunnel_key=1, up=[False], logical_port=37903648-aa27-42fa-926e-18741dbbf141, gateway_chassis=[], encap=[], external_ids={'neutron:cidrs': '192.168.233.2/24', 'neutron:device_id': 'ovnmeta-a709f3ff-68d5-435a-bc2b-36acb8ce95d4', 'neutron:device_owner': 'network:distributed', 'neutron:mtu': '', 'neutron:network_name': 'neutron-a709f3ff-68d5-435a-bc2b-36acb8ce95d4', 'neutron:port_capabilities': '', 'neutron:port_name': '', 'neutron:project_id': 'ea8d517cde1d40bb82c97e080ce071f7', 'neutron:revision_number': '2', 'neutron:security_group_ids': '', 'neutron:subnet_pool_addr_scope4': '', 'neutron:subnet_pool_addr_scope6': '', 'neutron:vnic_type': 'normal'}, virtual_parent=[], nat_addresses=[], datapath=2269a637-ebbd-4498-9e25-71daefcd2350) old=Port_Binding(mac=['fa:16:3e:bd:a4:f6'], external_ids={'neutron:cidrs': '', 'neutron:device_id': 'ovnmeta-a709f3ff-68d5-435a-bc2b-36acb8ce95d4', 'neutron:device_owner': 'network:distributed', 'neutron:mtu': '', 'neutron:network_name': 'neutron-a709f3ff-68d5-435a-bc2b-36acb8ce95d4', 'neutron:port_capabilities': '', 'neutron:port_name': '', 'neutron:project_id': 'ea8d517cde1d40bb82c97e080ce071f7', 'neutron:revision_number': '1', 'neutron:security_group_ids': '', 'neutron:subnet_pool_addr_scope4': '', 'neutron:subnet_pool_addr_scope6': '', 'neutron:vnic_type': 'normal'}) {{(pid=76818) matches /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} May 28 12:53:51 l75lg1-v1 neutron-server[77618]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-d9d4969c-e9ae-4d76-91b0-9b7c8eb907b3 None None] Hash Ring: Node 4c6fc793-7f5a-456f-b4d6-6e5bd97592f2 (host: l75lg1-v1) handling event "update" for row 4c4b2f66-8824-416e-b517-d8fc7efd0348 (table: Port_Binding) {{(pid=77618) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:53:51 l75lg1-v1 neutron-ovn-metadata-agent[76818]: INFO neutron.agent.ovn.metadata.agent [-] Metadata Port 37903648-aa27-42fa-926e-18741dbbf141 in datapath a709f3ff-68d5-435a-bc2b-36acb8ce95d4 updated May 28 12:53:51 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata.agent [-] No valid VIF ports were found for network a709f3ff-68d5-435a-bc2b-36acb8ce95d4, tearing the namespace down if needed {{(pid=76818) _get_provision_params /opt/stack/neutron/neutron/agent/ovn/metadata/agent.py:720}} May 28 12:53:51 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e9e5151-f7bc-4705-a9dd-02ee4985ba26]: (4, False) {{(pid=79043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} May 28 12:53:51 l75lg1-v1 neutron-server[77618]: INFO neutron.db.ovn_revision_numbers_db [None req-70a221f5-3b56-4c9c-b26e-981e55758b7f admin admin] Successfully bumped revision number for resource 37903648-aa27-42fa-926e-18741dbbf141 (type: ports) to 2 May 28 12:53:51 l75lg1-v1 neutron-server[77618]: INFO neutron.tests.unit.plugins.ml2.drivers.mechanism_logger [None req-70a221f5-3b56-4c9c-b26e-981e55758b7f admin admin] update_port_postcommit called with port settings {'id': '37903648-aa27-42fa-926e-18741dbbf141', 'name': '', 'network_id': 'a709f3ff-68d5-435a-bc2b-36acb8ce95d4', 'tenant_id': 'ea8d517cde1d40bb82c97e080ce071f7', 'mac_address': 'fa:16:3e:bd:a4:f6', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ovnmeta-a709f3ff-68d5-435a-bc2b-36acb8ce95d4', 'device_owner': 'network:distributed', 'standard_attr_id': 44, 'fixed_ips': [{'subnet_id': 'e4fad118-aaed-4b8f-af24-7f60741ecf53', 'ip_address': '192.168.233.2'}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2024-05-28T12:53:48Z', 'updated_at': '2024-05-28T12:53:51Z', 'revision_number': 2, 'project_id': 'ea8d517cde1d40bb82c97e080ce071f7'} (original settings {'id': '37903648-aa27-42fa-926e-18741dbbf141', 'name': '', 'network_id': 'a709f3ff-68d5-435a-bc2b-36acb8ce95d4', 'tenant_id': 'ea8d517cde1d40bb82c97e080ce071f7', 'mac_address': 'fa:16:3e:bd:a4:f6', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ovnmeta-a709f3ff-68d5-435a-bc2b-36acb8ce95d4', 'device_owner': 'network:distributed', 'standard_attr_id': 44, 'fixed_ips': [], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2024-05-28T12:53:48Z', 'updated_at': '2024-05-28T12:53:48Z', 'revision_number': 1, 'project_id': 'ea8d517cde1d40bb82c97e080ce071f7'}) host (original host ) vif type unbound (original vif type unbound) vif details {} (original vif details {}) binding levels None (original binding levels None) on network {'id': 'a709f3ff-68d5-435a-bc2b-36acb8ce95d4', 'name': 'shared', 'tenant_id': 'ea8d517cde1d40bb82c97e080ce071f7', 'admin_state_up': True, 'mtu': 1442, 'status': 'ACTIVE', 'subnets': ['e4fad118-aaed-4b8f-af24-7f60741ecf53'], 'standard_attr_id': 42, 'shared': True, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'vlan_transparent': None, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2024-05-28T12:53:48Z', 'updated_at': '2024-05-28T12:53:50Z', 'revision_number': 2, 'project_id': 'ea8d517cde1d40bb82c97e080ce071f7', 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 39669} with segments to bind None May 28 12:53:51 l75lg1-v1 neutron-server[77618]: DEBUG neutron.tests.unit.plugins.ml2.drivers.mechanism_logger [None req-70a221f5-3b56-4c9c-b26e-981e55758b7f admin admin] update_port_postcommit: May 28 12:53:51 l75lg1-v1 neutron-server[77618]: key[fixed_ips], [] -> [{'subnet_id': 'e4fad118-aaed-4b8f-af24-7f60741ecf53', 'ip_address': '192.168.233.2'}] May 28 12:53:51 l75lg1-v1 neutron-server[77618]: key[updated_at], 2024-05-28T12:53:48Z -> 2024-05-28T12:53:51Z May 28 12:53:51 l75lg1-v1 neutron-server[77618]: key[revision_number], 1 -> 2 May 28 12:53:51 l75lg1-v1 neutron-server[77618]: {{(pid=77618) _log_diff_call /opt/stack/neutron/neutron/tests/unit/plugins/ml2/drivers/mechanism_logger.py:59}} May 28 12:53:51 l75lg1-v1 neutron-server[77618]: DEBUG neutron.plugins.ml2.plugin [None req-70a221f5-3b56-4c9c-b26e-981e55758b7f admin admin] In _notify_port_updated(), no bound segment for port 37903648-aa27-42fa-926e-18741dbbf141 on network a709f3ff-68d5-435a-bc2b-36acb8ce95d4 {{(pid=77618) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:981}} May 28 12:53:51 l75lg1-v1 neutron-server[77618]: INFO neutron.db.ovn_revision_numbers_db [None req-70a221f5-3b56-4c9c-b26e-981e55758b7f admin admin] Successfully bumped revision number for resource e4fad118-aaed-4b8f-af24-7f60741ecf53 (type: subnets) to 0 May 28 12:53:51 l75lg1-v1 neutron-server[77618]: INFO neutron.tests.unit.plugins.ml2.drivers.mechanism_logger [None req-70a221f5-3b56-4c9c-b26e-981e55758b7f admin admin] create_subnet_postcommit called with subnet settings {'id': 'e4fad118-aaed-4b8f-af24-7f60741ecf53', 'name': 'shared-subnet', 'tenant_id': 'ea8d517cde1d40bb82c97e080ce071f7', 'network_id': 'a709f3ff-68d5-435a-bc2b-36acb8ce95d4', 'ip_version': 4, 'subnetpool_id': None, 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'standard_attr_id': 45, 'gateway_ip': '192.168.233.1', 'cidr': '192.168.233.0/24', 'allocation_pools': [{'start': '192.168.233.2', 'end': '192.168.233.254'}], 'host_routes': [], 'dns_nameservers': [], 'shared': True, 'description': 'shared-subnet', 'service_types': [], 'tags': [], 'created_at': '2024-05-28T12:53:50Z', 'updated_at': '2024-05-28T12:53:50Z', 'revision_number': 0, 'project_id': 'ea8d517cde1d40bb82c97e080ce071f7', 'network': {'id': 'a709f3ff-68d5-435a-bc2b-36acb8ce95d4', 'name': 'shared', 'tenant_id': 'ea8d517cde1d40bb82c97e080ce071f7', 'admin_state_up': True, 'mtu': 1442, 'status': 'ACTIVE', 'subnets': ['e4fad118-aaed-4b8f-af24-7f60741ecf53'], 'standard_attr_id': 42, 'shared': True, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'vlan_transparent': None, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2024-05-28T12:53:48Z', 'updated_at': '2024-05-28T12:53:50Z', 'revision_number': 2, 'project_id': 'ea8d517cde1d40bb82c97e080ce071f7', 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 39669}} (original settings None) May 28 12:53:51 l75lg1-v1 neutron-server[77618]: DEBUG neutron.tests.unit.plugins.ml2.drivers.mechanism_logger [None req-70a221f5-3b56-4c9c-b26e-981e55758b7f admin admin] create_subnet_postcommit: May 28 12:53:51 l75lg1-v1 neutron-server[77618]: key[tenant_id], None -> ea8d517cde1d40bb82c97e080ce071f7 May 28 12:53:51 l75lg1-v1 neutron-server[77618]: key[network_id], None -> a709f3ff-68d5-435a-bc2b-36acb8ce95d4 May 28 12:53:51 l75lg1-v1 neutron-server[77618]: key[revision_number], None -> 0 May 28 12:53:51 l75lg1-v1 neutron-server[77618]: key[project_id], None -> ea8d517cde1d40bb82c97e080ce071f7 May 28 12:53:51 l75lg1-v1 neutron-server[77618]: key[id], None -> e4fad118-aaed-4b8f-af24-7f60741ecf53 May 28 12:53:51 l75lg1-v1 neutron-server[77618]: key[tags], None -> [] May 28 12:53:51 l75lg1-v1 neutron-server[77618]: key[created_at], None -> 2024-05-28T12:53:50Z May 28 12:53:51 l75lg1-v1 neutron-server[77618]: key[allocation_pools], None -> [{'start': '192.168.233.2', 'end': '192.168.233.254'}] May 28 12:53:51 l75lg1-v1 neutron-server[77618]: key[subnetpool_id], None -> None May 28 12:53:51 l75lg1-v1 neutron-server[77618]: key[host_routes], None -> [] May 28 12:53:51 l75lg1-v1 neutron-server[77618]: key[gateway_ip], None -> 192.168.233.1 May 28 12:53:51 l75lg1-v1 neutron-server[77618]: key[service_types], None -> [] May 28 12:53:51 l75lg1-v1 neutron-server[77618]: key[updated_at], None -> 2024-05-28T12:53:50Z May 28 12:53:51 l75lg1-v1 neutron-server[77618]: key[network], None -> {'id': 'a709f3ff-68d5-435a-bc2b-36acb8ce95d4', 'name': 'shared', 'tenant_id': 'ea8d517cde1d40bb82c97e080ce071f7', 'admin_state_up': True, 'mtu': 1442, 'status': 'ACTIVE', 'subnets': ['e4fad118-aaed-4b8f-af24-7f60741ecf53'], 'standard_attr_id': 42, 'shared': True, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'vlan_transparent': None, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2024-05-28T12:53:48Z', 'updated_at': '2024-05-28T12:53:50Z', 'revision_number': 2, 'project_id': 'ea8d517cde1d40bb82c97e080ce071f7', 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 39669} May 28 12:53:51 l75lg1-v1 neutron-server[77618]: key[standard_attr_id], None -> 45 May 28 12:53:51 l75lg1-v1 neutron-server[77618]: key[ip_version], None -> 4 May 28 12:53:51 l75lg1-v1 neutron-server[77618]: key[cidr], None -> 192.168.233.0/24 May 28 12:53:51 l75lg1-v1 neutron-server[77618]: key[dns_nameservers], None -> [] May 28 12:53:51 l75lg1-v1 neutron-server[77618]: key[ipv6_address_mode], None -> None May 28 12:53:51 l75lg1-v1 neutron-server[77618]: key[description], None -> shared-subnet May 28 12:53:51 l75lg1-v1 neutron-server[77618]: key[ipv6_ra_mode], None -> None May 28 12:53:51 l75lg1-v1 neutron-server[77618]: key[enable_dhcp], None -> True May 28 12:53:51 l75lg1-v1 neutron-server[77618]: key[shared], None -> True May 28 12:53:51 l75lg1-v1 neutron-server[77618]: key[name], None -> shared-subnet May 28 12:53:51 l75lg1-v1 neutron-server[77618]: {{(pid=77618) _log_diff_call /opt/stack/neutron/neutron/tests/unit/plugins/ml2/drivers/mechanism_logger.py:59}} May 28 12:53:51 l75lg1-v1 neutron-server[77618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-70a221f5-3b56-4c9c-b26e-981e55758b7f admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=77618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:258}} May 28 12:53:51 l75lg1-v1 neutron-server[77618]: DEBUG neutron_lib.callbacks.manager [None req-70a221f5-3b56-4c9c-b26e-981e55758b7f admin admin] Publish callbacks [] for subnet (None), before_response {{(pid=77618) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:53:51 l75lg1-v1 neutron-server[77618]: INFO neutron.wsgi [None req-70a221f5-3b56-4c9c-b26e-981e55758b7f admin admin] 10.27.203.238 "POST /networking/v2.0/subnets HTTP/1.1" status: 201 len: 845 time: 0.6510837 May 28 12:53:52 l75lg1-v1 dstat.sh[49771]: 28-05 12:53:52| 7 5 87 1 0|4770M 2954M 268M 7657M| 23k 16k| 0 576k| 0 92.0 |4884 6494 |0.78 0.70 0.92|1.0 0 331| 0 0 | 0 2048M| 27 311 0 17 0 May 28 12:53:53 l75lg1-v1 dstat.sh[49771]: 28-05 12:53:53| 3 9 87 0 0|4783M 2941M 268M 7657M| 26k 31k| 0 2052k| 0 329 |6036 6836 |0.78 0.70 0.92|2.0 0 651| 0 0 | 0 2048M| 27 311 0 17 0 May 28 12:53:53 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=Chassis_Private, record=0da8323f-64af-4526-b223-049f5737145a, col_values=(('external_ids', {'neutron:ovn-metadata-sb-cfg': '3'}),), if_exists=True) {{(pid=76818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:53:53 l75lg1-v1 neutron-server[77621]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [-] ChassisMetadataAgentWriteEvent : Matched Chassis_Private, update, None None {{(pid=77621) matches /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:65}} May 28 12:53:53 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-03b5f984-1478-4ad6-9838-8e34c1689c5b None None] ChassisMetadataAgentWriteEvent : Matched Chassis_Private, update, None None {{(pid=77619) matches /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:65}} May 28 12:53:53 l75lg1-v1 neutron-server[77618]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-d9d4969c-e9ae-4d76-91b0-9b7c8eb907b3 None None] ChassisMetadataAgentWriteEvent : Matched Chassis_Private, update, None None {{(pid=77618) matches /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:65}} May 28 12:53:53 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-03b5f984-1478-4ad6-9838-8e34c1689c5b None None] Hash Ring: Node c89b3497-133e-4a5a-b67a-3310d2cb2485 (host: l75lg1-v1) handling event "update" for row 6ef07056-3e6a-44fb-b483-fdb6022e4e42 (table: Chassis_Private) {{(pid=77619) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:53:54 l75lg1-v1 dstat.sh[49771]: 28-05 12:53:54| 3 9 86 1 0|4778M 2946M 268M 7657M| 28k 32k| 0 1159k| 0 84.0 |6161 7113 |0.78 0.70 0.92|1.0 1.0 663| 0 0 | 0 2048M| 27 311 0 17 0 May 28 12:53:55 l75lg1-v1 dstat.sh[49771]: 28-05 12:53:55| 4 9 86 1 0|4774M 2950M 268M 7657M| 33k 38k| 0 1837k| 0 147 |6565 7645 |0.78 0.70 0.92|1.0 0 674| 0 0 | 0 2048M| 27 311 0 17 0 May 28 12:53:56 l75lg1-v1 dstat.sh[49771]: 28-05 12:53:56| 8 3 89 0 0|4799M 3012M 268M 7579M| 11k 6214B| 0 156k| 0 8.00 |2728 3644 |0.78 0.70 0.92|1.0 0 124| 0 0 | 0 2048M| 27 311 0 17 0 May 28 12:53:57 l75lg1-v1 dstat.sh[49771]: 28-05 12:53:57| 9 2 88 0 0|4810M 2985M 269M 7594M| 17k 230B| 0 12k| 0 3.00 |8565 16k|0.80 0.70 0.92|1.0 0 4.0| 0 0 | 0 2048M| 27 311 0 17 0 May 28 12:53:57 l75lg1-v1 nova-conductor[83648]: DEBUG dbcounter [-] [83648] Writing DB stats nova_cell1:SELECT=1 {{(pid=83648) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:53:58 l75lg1-v1 dstat.sh[49771]: 28-05 12:53:58| 5 1 94 0 0|4813M 2980M 269M 7595M| 19k 606B| 0 2496k| 0 8.00 |1672 2329 |0.80 0.70 0.92| 0 0 5.0| 0 0 | 0 2048M| 27 311 0 17 0 May 28 12:53:58 l75lg1-v1 neutron-server[77621]: DEBUG dbcounter [-] [77621] Writing DB stats neutron:SELECT=1 {{(pid=77621) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:53:58 l75lg1-v1 neutron-server[77621]: DEBUG dbcounter [-] [77621] Writing DB stats neutron:SELECT=3 {{(pid=77621) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:53:58 l75lg1-v1 neutron-server[77619]: DEBUG dbcounter [-] [77619] Writing DB stats neutron:SELECT=58,neutron:UPDATE=4,neutron:INSERT=6,neutron:DELETE=1 {{(pid=77619) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:53:58 l75lg1-v1 neutron-server[77619]: DEBUG dbcounter [-] [77619] Writing DB stats neutron:SELECT=50,neutron:INSERT=8,neutron:UPDATE=5,neutron:DELETE=1 {{(pid=77619) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:53:59 l75lg1-v1 devstack@placement-api.service[78202]: DEBUG dbcounter [-] [78202] Writing DB stats placement:SELECT=2 {{(pid=78202) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:53:59 l75lg1-v1 devstack@placement-api.service[78201]: DEBUG dbcounter [-] [78201] Writing DB stats placement:SELECT=2 {{(pid=78201) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:53:59 l75lg1-v1 dstat.sh[49771]: 28-05 12:53:59| 1 0 98 1 0|4813M 2980M 269M 7595M| 20k 86B| 0 392k| 0 48.0 |1784 2730 |0.80 0.70 0.92| 0 0 1.0| 0 0 | 0 2048M| 27 311 0 17 0 May 28 12:53:59 l75lg1-v1 nova-conductor[83647]: DEBUG dbcounter [-] [83647] Writing DB stats nova_cell1:SELECT=3,nova_cell1:UPDATE=1 {{(pid=83647) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:53:59 l75lg1-v1 nova-conductor[83647]: DEBUG dbcounter [-] [83647] Writing DB stats nova_cell1:SELECT=2,nova_cell1:UPDATE=1 {{(pid=83647) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:53:59 l75lg1-v1 nova-conductor[83648]: DEBUG dbcounter [-] [83648] Writing DB stats nova_cell1:SELECT=3 {{(pid=83648) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:54:00 l75lg1-v1 dstat.sh[49771]: 28-05 12:54:00| 1 0 98 0 0|4813M 2980M 269M 7595M| 15k 128B| 0 368k| 0 50.0 |1814 2805 |0.80 0.70 0.92| 0 0 0| 0 0 | 0 2048M| 27 311 0 17 0 May 28 12:54:00 l75lg1-v1 neutron-server[77618]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.HashRingHealthCheckPeriodics.touch_hash_ring_nodes' {{(pid=77618) _process_scheduled /opt/stack/data/venv/lib/python3.10/site-packages/futurist/periodics.py:638}} May 28 12:54:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG dbcounter [-] [51266] Writing DB stats keystone:SELECT=42 {{(pid=51266) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:54:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG dbcounter [-] [51267] Writing DB stats keystone:SELECT=36 {{(pid=51267) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:54:01 l75lg1-v1 dstat.sh[49771]: 28-05 12:54:01| 1 0 98 0 0|4813M 2980M 269M 7595M| 17k 765B| 0 136k| 0 24.0 |1867 2856 |0.80 0.70 0.92| 0 0 0| 0 0 | 0 2048M| 27 312 0 17 0 May 28 12:54:01 l75lg1-v1 neutron-server[77623]: DEBUG dbcounter [-] [77623] Writing DB stats neutron:SELECT=1 {{(pid=77623) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:54:01 l75lg1-v1 neutron-server[77618]: DEBUG dbcounter [-] [77618] Writing DB stats neutron:SELECT=89,neutron:INSERT=1,neutron:UPDATE=3,neutron:DELETE=2 {{(pid=77618) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:54:02 l75lg1-v1 dstat.sh[49771]: 28-05 12:54:02| 6 0 92 0 0|4813M 2980M 269M 7595M| 25k 1244B| 0 396k| 0 51.0 |2019 2950 |0.82 0.71 0.92|1.0 0 0| 0 0 | 0 2048M| 27 312 0 17 0 May 28 12:54:03 l75lg1-v1 dstat.sh[49771]: 28-05 12:54:03| 1 0 98 0 0|4813M 2979M 269M 7595M| 14k 264B| 0 564k| 0 122 |1341 2038 |0.82 0.71 0.92| 0 0 0| 0 0 | 0 2048M| 27 312 0 17 0 May 28 12:54:04 l75lg1-v1 dstat.sh[49771]: 28-05 12:54:04| 0 0 99 0 0|4813M 2980M 269M 7595M| 14k 258B| 0 504k| 0 33.0 |1371 2082 |0.82 0.71 0.92| 0 0 0| 0 0 | 0 2048M| 27 312 0 17 0 May 28 12:54:05 l75lg1-v1 dstat.sh[49771]: 28-05 12:54:05| 1 0 99 0 0|4814M 2979M 269M 7595M| 14k 86B| 0 28k| 0 5.00 |1360 2111 |0.82 0.71 0.92| 0 0 0| 0 0 | 0 2048M| 27 312 0 17 0 May 28 12:54:06 l75lg1-v1 dstat.sh[49771]: 28-05 12:54:06| 1 0 99 0 0|4814M 2979M 269M 7595M| 19k 258B| 0 0 | 0 0 |1443 2153 |0.82 0.71 0.92| 0 0 0| 0 0 | 0 2048M| 27 312 0 17 0 May 28 12:54:07 l75lg1-v1 dstat.sh[49771]: 28-05 12:54:07| 0 0 99 0 0|4814M 2979M 269M 7595M| 15k 218B| 0 4097B| 0 1.00 |1315 1988 |0.75 0.70 0.92| 0 0 0| 0 0 | 0 2048M| 27 311 0 17 1 May 28 12:54:08 l75lg1-v1 dstat.sh[49771]: 28-05 12:54:08| 1 0 99 0 0|4814M 2979M 269M 7595M| 13k 128B| 0 0 | 0 0 |1320 2074 |0.75 0.70 0.92|1.0 0 2.0| 0 0 | 0 2048M| 27 311 0 17 1 May 28 12:54:09 l75lg1-v1 dstat.sh[49771]: 28-05 12:54:09| 1 0 99 0 0|4814M 2979M 269M 7595M| 18k 86B| 0 140k| 0 33.0 |1337 2031 |0.75 0.70 0.92|2.0 0 0| 0 0 | 0 2048M| 27 311 0 17 1 May 28 12:54:09 l75lg1-v1 nova-conductor[83648]: DEBUG dbcounter [-] [83648] Writing DB stats nova_cell1:SELECT=1 {{(pid=83648) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:54:10 l75lg1-v1 dstat.sh[49771]: 28-05 12:54:10| 0 0 98 0 0|4814M 2979M 269M 7595M|9585B 86B| 0 391k| 0 40.9 |1507 2529 |0.75 0.70 0.92|1.0 0 0| 0 0 | 0 2048M| 27 311 0 17 1 May 28 12:54:10 l75lg1-v1 neutron-server[77618]: DEBUG dbcounter [-] [77618] Writing DB stats neutron:SELECT=116,neutron:UPDATE=5,neutron:INSERT=10 {{(pid=77618) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:54:11 l75lg1-v1 dstat.sh[49771]: 28-05 12:54:11| 1 0 99 0 0|4814M 2979M 269M 7595M| 11k 86B| 0 2720k| 0 119 |1401 2116 |0.75 0.70 0.92| 0 0 0| 0 0 | 0 2048M| 27 311 0 17 1 May 28 12:54:12 l75lg1-v1 dstat.sh[49771]: 28-05 12:54:12| 0 0 99 0 0|4814M 2979M 269M 7595M| 18k 86B| 0 36k| 0 6.00 |1320 2145 |0.69 0.69 0.91| 0 0 0| 0 0 | 0 2048M| 27 311 0 17 1 May 28 12:54:13 l75lg1-v1 dstat.sh[49771]: 28-05 12:54:13| 1 0 99 0 0|4814M 2979M 269M 7595M| 13k 86B| 0 8191B| 0 1.00 |1189 1926 |0.69 0.69 0.91| 0 0 0| 0 0 | 0 2048M| 27 311 0 17 1 May 28 12:54:14 l75lg1-v1 dstat.sh[49771]: 28-05 12:54:14| 0 0 99 0 0|4814M 2979M 269M 7595M| 13k 258B| 0 240k| 0 55.0 |1205 1986 |0.69 0.69 0.91| 0 0 0| 0 0 | 0 2048M| 27 311 0 17 1 May 28 12:54:15 l75lg1-v1 dstat.sh[49771]: 28-05 12:54:15| 3 0 97 0 0|4816M 2977M 269M 7595M| 21k 4315B| 0 304k| 0 13.0 |1382 2065 |0.69 0.69 0.91|1.0 0 0| 0 0 | 0 2048M| 27 312 0 17 1 May 28 12:54:15 l75lg1-v1 neutron-server[77623]: DEBUG dbcounter [-] [77623] Writing DB stats neutron:SELECT=1 {{(pid=77623) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:54:16 l75lg1-v1 dstat.sh[49771]: 28-05 12:54:16| 6 0 93 0 0|4826M 2967M 269M 7595M| 25k 5075B| 0 732k| 0 33.0 |1592 2255 |0.69 0.69 0.91|1.0 0 0| 0 0 | 0 2048M| 27 312 0 17 1 May 28 12:54:17 l75lg1-v1 dstat.sh[49771]: 28-05 12:54:17| 3 0 96 0 0|4826M 2967M 269M 7596M| 24k 7251B| 0 808k| 0 32.0 |1518 2225 |0.72 0.69 0.91| 0 0 0| 0 0 | 0 2048M| 27 312 0 17 1 May 28 12:54:18 l75lg1-v1 dstat.sh[49771]: 28-05 12:54:18| 4 0 95 0 0|4829M 2963M 269M 7596M| 21k 7120B| 0 832k| 0 36.0 |1637 2386 |0.72 0.69 0.91| 0 0 2.0| 0 0 | 0 2048M| 27 312 0 17 1 May 28 12:54:19 l75lg1-v1 dstat.sh[49771]: 28-05 12:54:19| 8 0 92 0 0|4843M 2949M 269M 7596M| 23k 2557B| 0 568k| 0 18.0 |1641 2279 |0.72 0.69 0.91|1.0 0 0| 0 0 | 0 2048M| 27 312 0 17 1 May 28 12:54:19 l75lg1-v1 nova-conductor[83647]: DEBUG dbcounter [-] [83647] Writing DB stats nova_cell1:SELECT=2,nova_cell1:UPDATE=1 {{(pid=83647) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:54:19 l75lg1-v1 nova-conductor[83648]: DEBUG dbcounter [-] [83648] Writing DB stats nova_cell1:SELECT=1 {{(pid=83648) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:54:20 l75lg1-v1 dstat.sh[49771]: 28-05 12:54:20| 5 0 93 1 0|4844M 2948M 269M 7596M| 21k 6542B| 0 1412k| 0 122 |1895 2833 |0.72 0.69 0.91| 0 0 0| 0 0 | 0 2048M| 27 312 0 17 1 May 28 12:54:21 l75lg1-v1 dstat.sh[49771]: 28-05 12:54:21| 5 0 94 1 0|4846M 2946M 269M 7596M| 25k 5564B| 0 16M| 0 188 |1864 2693 |0.72 0.69 0.91| 0 1.0 0| 0 0 | 0 2048M| 27 312 0 17 1 May 28 12:54:22 l75lg1-v1 dstat.sh[49771]: 28-05 12:54:22| 6 0 93 1 0|4853M 2940M 269M 7596M| 24k 4408B| 0 3072k| 0 198 |1572 2160 |0.74 0.70 0.91|1.0 0 0| 0 0 | 0 2048M| 27 312 0 17 1 May 28 12:54:23 l75lg1-v1 dstat.sh[49771]: 28-05 12:54:23| 9 0 91 0 0|4854M 2925M 269M 7609M| 16k 1661B| 0 188k| 0 8.00 |1475 2046 |0.74 0.70 0.91|1.0 0 0| 0 0 | 0 2048M| 27 312 0 17 1 May 28 12:54:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "_check_child_processes" by "neutron.agent.linux.external_process.ProcessMonitor._check_child_processes" {{(pid=76818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:54:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_concurrency.lockutils [-] Lock "_check_child_processes" acquired by "neutron.agent.linux.external_process.ProcessMonitor._check_child_processes" :: waited 0.000s {{(pid=76818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:54:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_concurrency.lockutils [-] Lock "_check_child_processes" "released" by "neutron.agent.linux.external_process.ProcessMonitor._check_child_processes" :: held 0.000s {{(pid=76818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:54:24 l75lg1-v1 dstat.sh[49771]: 28-05 12:54:24| 9 1 89 1 0|4861M 2900M 269M 7625M| 13k 0 | 0 1728k| 0 81.0 |1851 2505 |0.74 0.70 0.91|1.0 0 0| 0 0 | 0 2048M| 27 312 0 17 1 May 28 12:54:25 l75lg1-v1 dstat.sh[49771]: 28-05 12:54:25| 9 2 88 1 0|4894M 2851M 269M 7641M| 11k 0 | 0 2688k| 0 208 |2521 3611 |0.74 0.70 0.91|3.0 0 44| 0 0 | 0 2048M| 27 312 0 17 1 May 28 12:54:25 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_service.periodic_task [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85846) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:54:25 l75lg1-v1 cinder-volume[85846]: DEBUG cinder.volume.drivers.lvm [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] Updating volume stats {{(pid=85846) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}} May 28 12:54:25 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:390}} May 28 12:54:25 l75lg1-v1 sudo[93938]: vastdata : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 May 28 12:54:25 l75lg1-v1 sudo[93938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) May 28 12:54:26 l75lg1-v1 sudo[93938]: pam_unix(sudo:session): session closed for user root May 28 12:54:26 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.456s {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:428}} May 28 12:54:26 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:390}} May 28 12:54:26 l75lg1-v1 sudo[93941]: vastdata : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 May 28 12:54:26 l75lg1-v1 sudo[93941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) May 28 12:54:26 l75lg1-v1 dstat.sh[49771]: 28-05 12:54:26| 13 2 83 1 0|4875M 2856M 269M 7652M| 14k 0 | 256k 2248k|2.00 116 |2854 3889 |0.74 0.70 0.91|2.0 0 7.0| 0 0 | 0 2048M| 27 312 0 18 1 May 28 12:54:26 l75lg1-v1 neutron-server[77623]: DEBUG dbcounter [-] [77623] Writing DB stats neutron:SELECT=1 {{(pid=77623) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:54:26 l75lg1-v1 neutron-server[77623]: DEBUG dbcounter [-] [77623] Writing DB stats neutron:SELECT=2 {{(pid=77623) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:54:26 l75lg1-v1 sudo[93941]: pam_unix(sudo:session): session closed for user root May 28 12:54:26 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.454s {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:428}} May 28 12:54:26 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:390}} May 28 12:54:26 l75lg1-v1 sudo[93944]: vastdata : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool May 28 12:54:26 l75lg1-v1 sudo[93944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) May 28 12:54:27 l75lg1-v1 sudo[93944]: pam_unix(sudo:session): session closed for user root May 28 12:54:27 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.460s {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:428}} May 28 12:54:27 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:390}} May 28 12:54:27 l75lg1-v1 sudo[93947]: vastdata : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 May 28 12:54:27 l75lg1-v1 sudo[93947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) May 28 12:54:27 l75lg1-v1 dstat.sh[49771]: 28-05 12:54:27| 16 3 80 1 0|4883M 2843M 269M 7655M| 16k 132B| 640k 2368k|5.00 89.0 |2470 3034 |0.84 0.72 0.92|2.0 0 6.0| 0 0 | 0 2048M| 27 311 0 17 1 May 28 12:54:27 l75lg1-v1 sudo[93947]: pam_unix(sudo:session): session closed for user root May 28 12:54:27 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.473s {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:428}} May 28 12:54:27 l75lg1-v1 cinder-volume[85846]: DEBUG cinder.manager [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] Notifying Schedulers of capabilities ... {{(pid=85846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 28 12:54:27 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.scheduler.host_manager [None req-6a607f9e-9f9c-4d71-a677-ee6355e337e1 None None] Received volume service update from l75lg1-v1@lvmdriver-1: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:l75lg1-v1:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up', 'allocated_capacity_gb': 0, 'cacheable': True}], 'shared_targets': False, 'sparse_copy_volume': True, 'filter_function': None, 'goodness_function': None} {{(pid=85128) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:628}} May 28 12:54:28 l75lg1-v1 dstat.sh[49771]: 28-05 12:54:28| 12 2 86 0 0|4818M 2907M 269M 7655M| 23k 258B| 256k 16k|2.00 3.00 |2111 2364 |0.84 0.72 0.92|2.0 0 15| 0 0 | 0 2048M| 27 311 0 17 0 May 28 12:54:28 l75lg1-v1 neutron-server[77623]: DEBUG neutron.db.agents_db [None req-fe40ce8c-640e-4db7-a17a-6e8888cce266 None None] Agent healthcheck: found 0 active agents {{(pid=77623) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:319}} May 28 12:54:29 l75lg1-v1 dstat.sh[49771]: 28-05 12:54:29| 10 2 87 0 0|4841M 2883M 269M 7657M| 26k 0 | 0 0 | 0 0 | 10k 20k|0.84 0.72 0.92|2.0 0 12| 0 0 | 0 2048M| 27 311 0 17 0 May 28 12:54:29 l75lg1-v1 nova-conductor[83648]: DEBUG dbcounter [-] [83648] Writing DB stats nova_cell1:SELECT=1 {{(pid=83648) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:54:30 l75lg1-v1 dstat.sh[49771]: 28-05 12:54:30| 10 1 89 0 0|4824M 2900M 269M 7657M| 27k 172B| 0 1728k| 0 23.0 |2006 2635 |0.84 0.72 0.92|2.0 0 1.0| 0 0 | 0 2048M| 27 311 0 17 0 May 28 12:54:30 l75lg1-v1 neutron-server[77618]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.HashRingHealthCheckPeriodics.touch_hash_ring_nodes' {{(pid=77618) _process_scheduled /opt/stack/data/venv/lib/python3.10/site-packages/futurist/periodics.py:638}} May 28 12:54:31 l75lg1-v1 dstat.sh[49771]: 28-05 12:54:31| 10 2 87 0 0|4823M 2900M 269M 7657M| 18k 0 | 0 964k| 0 149 | 11k 21k|0.84 0.72 0.92|1.0 0 12| 0 0 | 0 2048M| 27 311 0 17 0 May 28 12:54:32 l75lg1-v1 dstat.sh[49771]: 28-05 12:54:32| 10 1 88 0 0|4776M 2947M 269M 7657M| 29k 1706B| 0 468k| 0 30.0 |2164 2741 |0.85 0.72 0.92|1.0 0 8.0| 0 0 | 0 2048M| 27 311 0 17 0 May 28 12:54:33 l75lg1-v1 dstat.sh[49771]: 28-05 12:54:33| 10 2 87 0 0|4807M 2916M 269M 7657M| 35k 638B| 0 4095B| 0 1.00 | 11k 21k|0.85 0.72 0.92|2.0 0 46| 0 0 | 0 2048M| 27 311 0 14 0 May 28 12:54:34 l75lg1-v1 dstat.sh[49771]: 28-05 12:54:34| 9 2 88 0 0|4828M 2895M 269M 7657M| 26k 1586B| 0 552k| 0 30.0 |4208 6956 |0.85 0.72 0.92|2.0 0 10| 0 0 | 0 2048M| 27 311 0 14 0 May 28 12:54:35 l75lg1-v1 dstat.sh[49771]: 28-05 12:54:35| 9 3 87 0 0|4828M 2895M 269M 7657M| 40k 0 | 0 112k| 0 6.00 |9202 17k|0.85 0.72 0.92|3.0 0 13| 0 0 | 0 2048M| 27 311 0 14 0 May 28 12:54:36 l75lg1-v1 dstat.sh[49771]: 28-05 12:54:36| 10 2 87 0 0|4819M 2904M 269M 7657M| 46k 0 | 0 244k| 0 39.0 | 10k 20k|0.85 0.72 0.92|2.0 0 8.0| 0 0 | 0 2048M| 27 311 0 14 0 May 28 12:54:37 l75lg1-v1 dstat.sh[49771]: 28-05 12:54:37| 10 1 88 0 0|4811M 2912M 269M 7657M| 40k 1514B| 0 16k| 0 3.00 |1949 2263 |0.87 0.73 0.92|1.0 0 6.0| 0 0 | 0 2048M| 27 311 0 14 0 May 28 12:54:37 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:54:37 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.manager [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Cleaning up deleted instances {{(pid=83654) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11226}} May 28 12:54:37 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Expecting reply to msg 833fa56953c94ba8911e2434a05d227d in queue reply_37f4cbd1dd094961a22b8a65f222c327 May 28 12:54:37 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [-] Received RPC response for msg 833fa56953c94ba8911e2434a05d227d May 28 12:54:38 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.manager [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] There are 0 instances to clean {{(pid=83654) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11235}} May 28 12:54:38 l75lg1-v1 dstat.sh[49771]: 28-05 12:54:38| 10 1 88 0 0|4816M 2907M 269M 7657M| 38k 8996B| 0 484k| 0 29.0 |2347 2890 |0.87 0.73 0.92|1.0 0 5.0| 0 0 | 0 2048M| 27 311 0 14 0 May 28 12:54:38 l75lg1-v1 neutron-server[77623]: DEBUG dbcounter [-] [77623] Writing DB stats neutron:SELECT=1 {{(pid=77623) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:54:38 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:54:38 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Expecting reply to msg fc0fe44a14054d279f33f92cc70b3855 in queue reply_37f4cbd1dd094961a22b8a65f222c327 May 28 12:54:38 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [-] Received RPC response for msg fc0fe44a14054d279f33f92cc70b3855 May 28 12:54:39 l75lg1-v1 dstat.sh[49771]: 28-05 12:54:39| 10 1 88 0 0|4776M 2947M 269M 7657M| 31k 7020B| 0 80k| 0 11.0 |2566 3198 |0.87 0.73 0.92|1.0 0 66| 0 0 | 0 2048M| 27 311 0 12 0 May 28 12:54:40 l75lg1-v1 dstat.sh[49771]: 28-05 12:54:40| 9 3 88 0 0|4792M 2916M 270M 7670M| 30k 404B| 0 1482k| 0 31.0 |9358 18k|0.87 0.73 0.92|1.0 0 16| 0 0 | 0 2048M| 27 311 0 12 0 May 28 12:54:40 l75lg1-v1 neutron-server[77618]: DEBUG dbcounter [-] [77618] Writing DB stats neutron:UPDATE=1,neutron:SELECT=1 {{(pid=77618) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:54:41 l75lg1-v1 dstat.sh[49771]: 28-05 12:54:41| 9 1 89 0 0|4808M 2896M 270M 7673M| 28k 227B| 0 231k| 0 7.98 |1894 2497 |0.87 0.73 0.92|1.0 0 3.0| 0 0 | 0 2048M| 27 311 0 11 0 May 28 12:54:41 l75lg1-v1 nova-scheduler[81196]: DEBUG dbcounter [-] [81196] Writing DB stats nova_cell0:SELECT=1,nova_cell0:UPDATE=1 {{(pid=81196) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:54:41 l75lg1-v1 nova-scheduler[81194]: DEBUG dbcounter [-] [81194] Writing DB stats nova_cell0:SELECT=1 {{(pid=81194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:54:42 l75lg1-v1 dstat.sh[49771]: 28-05 12:54:42| 1 1 98 0 0|4808M 2896M 270M 7673M| 36k 128B| 0 986k| 0 81.2 |1691 2282 |0.80 0.72 0.91|1.0 0 0| 0 0 | 0 2048M| 27 311 0 11 0 May 28 12:54:43 l75lg1-v1 dstat.sh[49771]: 28-05 12:54:43| 1 1 99 0 0|4808M 2896M 270M 7673M| 33k 86B| 0 8200B| 0 1.00 |1526 2062 |0.80 0.72 0.91| 0 0 0| 0 0 | 0 2048M| 27 311 0 9 0 May 28 12:54:44 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:54:44 l75lg1-v1 dstat.sh[49771]: 28-05 12:54:44| 1 1 99 0 0|4808M 2896M 270M 7673M| 25k 74B| 0 0 | 0 0 |1468 2059 |0.80 0.72 0.91| 0 0 0| 0 0 | 0 2048M| 27 311 1 9 0 May 28 12:54:44 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:54:45 l75lg1-v1 dstat.sh[49771]: 28-05 12:54:45| 4 0 95 0 0|4808M 2896M 270M 7673M| 27k 1888B| 0 84k| 0 6.00 |1481 2052 |0.80 0.72 0.91|1.0 0 0| 0 0 | 0 2048M| 27 312 0 7 0 May 28 12:54:45 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:54:45 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.manager [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Starting heal instance info cache {{(pid=83654) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}} May 28 12:54:45 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.manager [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Rebuilding the list of instances to heal {{(pid=83654) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9930}} May 28 12:54:45 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Expecting reply to msg 34e4213527ea42bd97e66bce417d211b in queue reply_37f4cbd1dd094961a22b8a65f222c327 May 28 12:54:45 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [-] Received RPC response for msg 34e4213527ea42bd97e66bce417d211b May 28 12:54:46 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.manager [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Didn't find any instances for network info cache update. {{(pid=83654) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10012}} May 28 12:54:46 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:54:46 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.manager [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=83654) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10545}} May 28 12:54:46 l75lg1-v1 dstat.sh[49771]: 28-05 12:54:46| 5 1 94 0 0|4809M 2895M 270M 7673M| 24k 394B| 0 0 | 0 0 |1739 2201 |0.80 0.72 0.91| 0 0 0| 0 0 | 0 2048M| 27 312 0 7 0 May 28 12:54:47 l75lg1-v1 dstat.sh[49771]: 28-05 12:54:47| 1 1 96 2 0|4809M 2895M 270M 7673M| 20k 86B| 0 44M| 0 554 |1999 2915 |0.73 0.70 0.91| 0 1.0 0| 0 0 | 0 2048M| 27 312 0 6 0 May 28 12:54:47 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:54:47 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:54:47 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:54:47 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:54:47 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.manager [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Cleaning up deleted instances with incomplete migration {{(pid=83654) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11264}} May 28 12:54:47 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Expecting reply to msg 4b0344c1ef224e72b0e3ba140cb062a7 in queue reply_37f4cbd1dd094961a22b8a65f222c327 May 28 12:54:47 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [-] Received RPC response for msg 4b0344c1ef224e72b0e3ba140cb062a7 May 28 12:54:47 l75lg1-v1 nova-conductor[83229]: DEBUG dbcounter [-] [83229] Writing DB stats nova_cell0:SELECT=1,nova_cell0:UPDATE=1 {{(pid=83229) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:54:48 l75lg1-v1 nova-conductor[83233]: DEBUG dbcounter [-] [83233] Writing DB stats nova_cell0:SELECT=1 {{(pid=83233) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:54:48 l75lg1-v1 dstat.sh[49771]: 28-05 12:54:48| 1 0 98 1 0|4809M 2895M 270M 7673M| 18k 86B| 0 1144k| 0 86.0 |1834 2641 |0.73 0.70 0.91|1.0 0 2.0| 0 0 | 0 2048M| 27 312 0 6 0 May 28 12:54:48 l75lg1-v1 nova-conductor[83647]: DEBUG dbcounter [-] [83647] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:DELETE=1 {{(pid=83647) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:54:49 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager.update_available_resource {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:54:49 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Expecting reply to msg 5d04ebdd40b741c08a616a76f028beb1 in queue reply_37f4cbd1dd094961a22b8a65f222c327 May 28 12:54:49 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [-] Received RPC response for msg 5d04ebdd40b741c08a616a76f028beb1 May 28 12:54:49 l75lg1-v1 dstat.sh[49771]: 28-05 12:54:49| 1 0 99 0 0|4809M 2894M 270M 7673M| 22k 86B| 0 96k| 0 14.0 |1630 2268 |0.73 0.70 0.91| 0 0 0| 0 0 | 0 2048M| 27 312 0 4 0 May 28 12:54:49 l75lg1-v1 nova-compute[83654]: DEBUG oslo_concurrency.lockutils [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=83654) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:54:49 l75lg1-v1 nova-compute[83654]: DEBUG oslo_concurrency.lockutils [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=83654) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:54:49 l75lg1-v1 nova-compute[83654]: DEBUG oslo_concurrency.lockutils [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=83654) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:54:49 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.resource_tracker [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Auditing locally available compute resources for l75lg1-v1 (node: l75lg1-v1) {{(pid=83654) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}} May 28 12:54:49 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.resource_tracker [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Hypervisor/Node resource view: name=l75lg1-v1 free_ram=10837MB free_disk=15.80435562133789GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_01_1", "address": "0000:00:01.1", "product_id": "7010", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7010", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7000", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7000", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "0100", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_0100", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_09_0", "address": "0000:00:09.0", "product_id": "1001", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1001", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "293a", "vendor_id": "8086", "numa_node": null, "label": "label_8086_293a", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_2", "address": "0000:00:07.2", "product_id": "2936", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2936", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "1237", "vendor_id": "8086", "numa_node": null, "label": "label_8086_1237", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "2935", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2935", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "2934", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2934", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_05_0", "address": "0000:00:05.0", "product_id": "1000", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1000", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "1000", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1000", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_06_0", "address": "0000:00:06.0", "product_id": "2668", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2668", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "1000", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1000", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0a_0", "address": "0000:00:0a.0", "product_id": "1002", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1002", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_3", "address": "0000:00:01.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_08_0", "address": "0000:00:08.0", "product_id": "1003", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1003", "dev_type": "type-PCI"}] {{(pid=83654) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}} May 28 12:54:49 l75lg1-v1 nova-compute[83654]: DEBUG oslo_concurrency.lockutils [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=83654) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:54:49 l75lg1-v1 nova-compute[83654]: DEBUG oslo_concurrency.lockutils [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=83654) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:54:49 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Expecting reply to msg 64e607be5e0e452fb33e1248ab884884 in queue reply_37f4cbd1dd094961a22b8a65f222c327 May 28 12:54:49 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [-] Received RPC response for msg 64e607be5e0e452fb33e1248ab884884 May 28 12:54:50 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Expecting reply to msg 81630984901740e09042d05cb0216a7b in queue reply_37f4cbd1dd094961a22b8a65f222c327 May 28 12:54:50 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [-] Received RPC response for msg 81630984901740e09042d05cb0216a7b May 28 12:54:50 l75lg1-v1 dstat.sh[49771]: 28-05 12:54:50| 1 1 97 0 0|4809M 2894M 270M 7674M| 24k 194B| 0 356k| 0 30.0 |3009 4794 |0.73 0.70 0.91| 0 0 0| 0 0 | 0 2048M| 27 311 0 4 1 May 28 12:54:50 l75lg1-v1 devstack@placement-api.service[78202]: DEBUG placement.requestlog [req-e55fc806-8c1f-436d-9ce0-8b5af89e773c req-06691c1f-409c-454c-aac0-a446a65e69cb None None] Starting request: 10.27.203.238 "GET /placement/resource_providers/ef90d7d1-0808-4a15-ad77-f9a7391af2f4/allocations" {{(pid=78202) __call__ /opt/stack/placement/placement/requestlog.py:55}} May 28 12:54:50 l75lg1-v1 devstack@placement-api.service[78202]: INFO placement.requestlog [req-e55fc806-8c1f-436d-9ce0-8b5af89e773c req-06691c1f-409c-454c-aac0-a446a65e69cb service placement] 10.27.203.238 "GET /placement/resource_providers/ef90d7d1-0808-4a15-ad77-f9a7391af2f4/allocations" status: 200 len: 54 microversion: 1.0 May 28 12:54:50 l75lg1-v1 devstack@placement-api.service[78202]: [pid: 78202|app: 0|req: 18/35] 10.27.203.238 () {62 vars in 1480 bytes} [Tue May 28 12:54:50 2024] GET /placement/resource_providers/ef90d7d1-0808-4a15-ad77-f9a7391af2f4/allocations => generated 54 bytes in 12 msecs (HTTP/1.1 200) 6 headers in 223 bytes (1 switches on core 0) May 28 12:54:50 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.resource_tracker [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Total usable vcpus: 10, total allocated vcpus: 0 {{(pid=83654) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}} May 28 12:54:50 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.resource_tracker [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Final resource view: name=l75lg1-v1 phys_ram=16000MB used_ram=512MB phys_disk=28GB used_disk=0GB total_vcpus=10 used_vcpus=0 pci_stats=[] {{(pid=83654) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}} May 28 12:54:50 l75lg1-v1 devstack@placement-api.service[78201]: DEBUG placement.requestlog [req-e55fc806-8c1f-436d-9ce0-8b5af89e773c req-1f2cdc66-b6b5-41a4-a7be-5872bb675e15 None None] Starting request: 10.27.203.238 "GET /placement/resource_providers/ef90d7d1-0808-4a15-ad77-f9a7391af2f4/allocations" {{(pid=78201) __call__ /opt/stack/placement/placement/requestlog.py:55}} May 28 12:54:50 l75lg1-v1 devstack@placement-api.service[78201]: INFO placement.requestlog [req-e55fc806-8c1f-436d-9ce0-8b5af89e773c req-1f2cdc66-b6b5-41a4-a7be-5872bb675e15 service placement] 10.27.203.238 "GET /placement/resource_providers/ef90d7d1-0808-4a15-ad77-f9a7391af2f4/allocations" status: 200 len: 54 microversion: 1.0 May 28 12:54:50 l75lg1-v1 devstack@placement-api.service[78201]: [pid: 78201|app: 0|req: 18/36] 10.27.203.238 () {62 vars in 1480 bytes} [Tue May 28 12:54:50 2024] GET /placement/resource_providers/ef90d7d1-0808-4a15-ad77-f9a7391af2f4/allocations => generated 54 bytes in 13 msecs (HTTP/1.1 200) 6 headers in 223 bytes (1 switches on core 0) May 28 12:54:50 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.provider_tree [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Inventory has not changed in ProviderTree for provider: ef90d7d1-0808-4a15-ad77-f9a7391af2f4 {{(pid=83654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} May 28 12:54:50 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Expecting reply to msg 466a507f07ce48e48083bfde5d5cedea in queue reply_37f4cbd1dd094961a22b8a65f222c327 May 28 12:54:50 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [-] Received RPC response for msg 466a507f07ce48e48083bfde5d5cedea May 28 12:54:51 l75lg1-v1 nova-compute[83654]: DEBUG nova.scheduler.client.report [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Inventory has not changed for provider ef90d7d1-0808-4a15-ad77-f9a7391af2f4 based on inventory data: {'VCPU': {'total': 10, 'reserved': 0, 'min_unit': 1, 'max_unit': 10, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16000, 'reserved': 512, 'min_unit': 1, 'max_unit': 16000, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 28, 'reserved': 0, 'min_unit': 1, 'max_unit': 28, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=83654) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}} May 28 12:54:51 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.resource_tracker [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Compute_service record updated for l75lg1-v1:l75lg1-v1 {{(pid=83654) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}} May 28 12:54:51 l75lg1-v1 nova-compute[83654]: DEBUG oslo_concurrency.lockutils [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.556s {{(pid=83654) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:54:51 l75lg1-v1 dstat.sh[49771]: 28-05 12:54:51| 1 0 98 0 0|4809M 2894M 270M 7674M| 21k 258B| 0 4095B| 0 1.00 |1910 2610 |0.73 0.70 0.91| 0 0 0| 0 0 | 0 2048M| 27 311 0 4 1 May 28 12:54:51 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:54:51 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:54:52 l75lg1-v1 dstat.sh[49771]: 28-05 12:54:52| 1 1 98 0 0|4814M 2890M 270M 7674M| 22k 86B| 0 39M| 0 280 |1724 2528 |0.67 0.69 0.90| 0 0 0| 0 0 | 0 2048M| 27 311 0 4 1 May 28 12:54:53 l75lg1-v1 dstat.sh[49771]: 28-05 12:54:53| 0 0 98 1 0|4814M 2890M 270M 7674M| 24k 86B| 0 1380k| 0 116 |1407 2006 |0.67 0.69 0.90| 0 0 0| 0 0 | 0 2048M| 27 311 0 3 1 May 28 12:54:54 l75lg1-v1 dstat.sh[49771]: 28-05 12:54:54| 0 0 99 0 0|4815M 2889M 270M 7674M| 18k 258B| 0 20k| 0 1.00 |1359 2074 |0.67 0.69 0.90|1.0 0 0| 0 0 | 0 2048M| 27 311 0 3 1 May 28 12:54:55 l75lg1-v1 dstat.sh[49771]: 28-05 12:54:55| 0 0 99 0 0|4815M 2889M 270M 7674M| 18k 86B| 0 0 | 0 0 |1324 1972 |0.67 0.69 0.90| 0 0 0| 0 0 | 0 2048M| 27 311 0 3 1 May 28 12:54:56 l75lg1-v1 dstat.sh[49771]: 28-05 12:54:56| 0 0 99 0 0|4815M 2889M 270M 7674M| 23k 86B| 0 4096B| 0 1.00 |1372 2015 |0.67 0.69 0.90| 0 0 0| 0 0 | 0 2048M| 27 311 0 3 1 May 28 12:54:57 l75lg1-v1 dstat.sh[49771]: 28-05 12:54:57| 0 0 99 0 0|4815M 2889M 270M 7674M| 20k 86B| 0 4096B| 0 1.00 |1385 1980 |0.62 0.68 0.90| 0 0 0| 0 0 | 0 2048M| 27 311 0 3 1 May 28 12:54:58 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [-] Expecting reply to msg aafac1739ec94dbfb45b07e94390625c in queue reply_37f4cbd1dd094961a22b8a65f222c327 May 28 12:54:58 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [-] Received RPC response for msg aafac1739ec94dbfb45b07e94390625c May 28 12:54:58 l75lg1-v1 dstat.sh[49771]: 28-05 12:54:58| 1 0 98 0 0|4816M 2888M 270M 7674M| 15k 1814B| 0 404k| 0 63.0 |1713 2653 |0.62 0.68 0.90|1.0 0 2.0| 0 0 | 0 2048M| 27 312 0 3 1 May 28 12:54:59 l75lg1-v1 dstat.sh[49771]: 28-05 12:54:59| 6 0 93 0 0|4828M 2876M 270M 7674M| 27k 5063B| 0 683k| 0 28.0 |1657 2249 |0.62 0.68 0.90|1.0 0 0| 0 0 | 0 2048M| 27 312 0 3 1 May 28 12:54:59 l75lg1-v1 nova-conductor[83647]: DEBUG dbcounter [-] [83647] Writing DB stats nova_cell1:UPDATE=4,nova_cell1:SELECT=5 {{(pid=83647) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:55:00 l75lg1-v1 dstat.sh[49771]: 28-05 12:55:00| 5 0 94 1 0|4828M 2876M 270M 7674M| 24k 7457B| 0 1200k| 0 71.0 |1968 2841 |0.62 0.68 0.90|1.0 0 0| 0 0 | 0 2048M| 27 312 0 3 1 May 28 12:55:00 l75lg1-v1 neutron-server[77618]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.HashRingHealthCheckPeriodics.touch_hash_ring_nodes' {{(pid=77618) _process_scheduled /opt/stack/data/venv/lib/python3.10/site-packages/futurist/periodics.py:638}} May 28 12:55:00 l75lg1-v1 devstack@placement-api.service[78202]: DEBUG dbcounter [-] [78202] Writing DB stats placement:SELECT=2 {{(pid=78202) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:55:00 l75lg1-v1 devstack@placement-api.service[78201]: DEBUG dbcounter [-] [78201] Writing DB stats placement:SELECT=2 {{(pid=78201) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:55:01 l75lg1-v1 dstat.sh[49771]: 28-05 12:55:01| 3 1 95 1 0|4830M 2874M 270M 7674M| 59k 6643B| 0 1208k| 0 76.0 |2473 3423 |0.62 0.68 0.90| 0 0 0| 0 0 | 0 2048M| 27 312 0 3 1 May 28 12:55:02 l75lg1-v1 dstat.sh[49771]: 28-05 12:55:02| 0 0 99 0 0|4830M 2873M 270M 7674M| 24k 258B| 0 0 | 0 0 |1483 2170 |0.65 0.69 0.90|1.0 0 3.0| 0 0 | 0 2048M| 27 312 0 3 1 May 28 12:55:03 l75lg1-v1 dstat.sh[49771]: 28-05 12:55:03| 1 0 98 1 0|4830M 2873M 270M 7674M| 26k 86B| 0 1160k| 0 202 |1834 2639 |0.65 0.69 0.90| 0 0 2.0| 0 0 | 0 2048M| 27 312 0 3 1 May 28 12:55:03 l75lg1-v1 neutron-server[77623]: DEBUG dbcounter [-] [77623] Writing DB stats neutron:SELECT=1 {{(pid=77623) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:55:03 l75lg1-v1 neutron-server[77623]: DEBUG dbcounter [-] [77623] Writing DB stats neutron:SELECT=2 {{(pid=77623) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:55:04 l75lg1-v1 dstat.sh[49771]: 28-05 12:55:04| 1 0 99 0 0|4830M 2873M 270M 7674M| 21k 74B| 0 48k| 0 8.00 |1407 2082 |0.65 0.69 0.90| 0 0 0| 0 0 | 0 2048M| 27 312 1 3 1 May 28 12:55:05 l75lg1-v1 dstat.sh[49771]: 28-05 12:55:05| 3 0 95 1 0|4832M 2871M 270M 7674M| 122k 11k| 0 1224k| 0 67.0 |1782 2454 |0.65 0.69 0.90|1.0 0 0| 0 0 | 0 2048M| 27 313 0 3 1 May 28 12:55:05 l75lg1-v1 neutron-server[77623]: DEBUG neutron.db.agents_db [None req-fe40ce8c-640e-4db7-a17a-6e8888cce266 None None] Agent healthcheck: found 0 active agents {{(pid=77623) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:319}} May 28 12:55:06 l75lg1-v1 dstat.sh[49771]: 28-05 12:55:06| 6 0 93 0 0|4847M 2856M 270M 7674M| 23k 4943B| 0 488k| 0 20.0 |1675 2308 |0.65 0.69 0.90|1.0 0 0| 0 0 | 0 2048M| 27 313 0 3 1 May 28 12:55:07 l75lg1-v1 dstat.sh[49771]: 28-05 12:55:07| 6 0 93 0 0|4851M 2852M 270M 7674M| 29k 5078B| 0 680k| 0 28.0 |1727 2229 |0.68 0.69 0.90|1.0 0 0| 0 0 | 0 2048M| 27 313 0 3 1 May 28 12:55:08 l75lg1-v1 nova-conductor[83648]: DEBUG dbcounter [-] [83648] Writing DB stats nova_cell1:SELECT=5,nova_cell1:UPDATE=1 {{(pid=83648) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:55:08 l75lg1-v1 dstat.sh[49771]: 28-05 12:55:08| 5 0 94 0 0|4854M 2849M 270M 7674M| 30k 6597B| 0 752k| 0 36.0 |1784 2375 |0.68 0.69 0.90|1.0 0 2.0| 0 0 | 0 2048M| 27 313 0 3 1 May 28 12:55:09 l75lg1-v1 dstat.sh[49771]: 28-05 12:55:09| 6 1 93 0 0|4864M 2838M 270M 7674M| 206k 11k| 0 1101k| 0 90.1 |1986 2403 |0.68 0.69 0.90|1.0 0 0| 0 0 | 0 2048M| 27 313 0 3 1 May 28 12:55:09 l75lg1-v1 nova-conductor[83648]: DEBUG dbcounter [-] [83648] Writing DB stats nova_cell1:SELECT=4 {{(pid=83648) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:55:10 l75lg1-v1 dstat.sh[49771]: 28-05 12:55:10| 3 0 95 1 0|4864M 2838M 270M 7675M| 60k 9802B| 0 1864k| 0 113 |2236 3133 |0.68 0.69 0.90| 0 0 0| 0 0 | 0 2048M| 27 313 0 3 1 May 28 12:55:10 l75lg1-v1 neutron-server[77618]: DEBUG dbcounter [-] [77618] Writing DB stats neutron:UPDATE=1 {{(pid=77618) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:55:10 l75lg1-v1 neutron-server[77618]: DEBUG dbcounter [-] [77618] Writing DB stats neutron:SELECT=1 {{(pid=77618) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:55:11 l75lg1-v1 cinder-scheduler[85128]: DEBUG dbcounter [-] [85128] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=85128) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:55:11 l75lg1-v1 dstat.sh[49771]: 28-05 12:55:11| 3 0 95 1 0|4864M 2838M 270M 7675M| 88k 9778B| 0 1672k| 0 94.0 |2088 2723 |0.68 0.69 0.90|1.0 0 0| 0 0 | 0 2048M| 27 313 0 3 1 May 28 12:55:12 l75lg1-v1 dstat.sh[49771]: 28-05 12:55:12| 5 0 94 1 0|4866M 2836M 270M 7675M| 44k 6223B| 0 960k| 0 53.0 |1870 2472 |0.62 0.68 0.89|1.0 0 0| 0 0 | 0 2048M| 27 313 0 3 1 May 28 12:55:12 l75lg1-v1 cinder-volume[85846]: DEBUG dbcounter [-] [85846] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=85846) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:55:13 l75lg1-v1 dstat.sh[49771]: 28-05 12:55:13| 7 0 92 0 0|4869M 2833M 270M 7675M| 22k 3330B| 0 464k| 0 24.0 |1600 2184 |0.62 0.68 0.89|1.0 0 0| 0 0 | 0 2048M| 27 313 0 3 1 May 28 12:55:14 l75lg1-v1 dstat.sh[49771]: 28-05 12:55:14| 3 1 95 1 0|4870M 2815M 270M 7691M|4446k 39k| 0 5326k| 0 102 |3363 3305 |0.62 0.68 0.89|1.0 0 3.0| 0 0 | 0 2048M| 27 313 0 3 1 May 28 12:55:15 l75lg1-v1 dstat.sh[49771]: 28-05 12:55:15| 2 1 96 1 0|4870M 2794M 270M 7711M|3256k 22k| 0 4833k| 0 89.0 |2672 3034 |0.62 0.68 0.89|1.0 0 8.0| 0 0 | 0 2048M| 27 313 0 3 1 May 28 12:55:15 l75lg1-v1 neutron-server[77623]: DEBUG dbcounter [-] [77623] Writing DB stats neutron:SELECT=1 {{(pid=77623) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:55:16 l75lg1-v1 dstat.sh[49771]: 28-05 12:55:16| 10 3 86 0 0|4879M 2783M 270M 7714M| 106k 132B| 0 576k| 0 26.0 |2909 4169 |0.62 0.68 0.89|2.0 0 229| 0 0 | 0 2048M| 27 313 0 3 1 May 28 12:55:17 l75lg1-v1 dstat.sh[49771]: 28-05 12:55:17| 8 1 89 1 0|4881M 2757M 272M 7731M| 14k 0 | 0 3747k| 0 124 |2038 2924 |0.65 0.68 0.90| 0 1.0 0| 0 0 | 0 2048M| 27 313 0 3 1 May 28 12:55:18 l75lg1-v1 dstat.sh[49771]: 28-05 12:55:18| 9 1 89 1 0|4883M 2737M 273M 7747M| 13k 172B| 0 2743k| 0 66.0 |1798 2616 |0.65 0.68 0.90|1.0 0 2.0| 0 0 | 0 2048M| 27 313 0 3 1 May 28 12:55:19 l75lg1-v1 dstat.sh[49771]: 28-05 12:55:19| 9 1 89 1 0|4899M 2710M 273M 7756M| 19k 0 | 0 2392k| 0 191 |1914 2650 |0.65 0.68 0.90|1.0 0 0| 0 0 | 0 2048M| 27 313 0 3 1 May 28 12:55:19 l75lg1-v1 nova-conductor[83647]: DEBUG dbcounter [-] [83647] Writing DB stats nova_cell1:SELECT=1 {{(pid=83647) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:55:19 l75lg1-v1 nova-conductor[83647]: DEBUG dbcounter [-] [83647] Writing DB stats nova_cell1:SELECT=3,nova_cell1:UPDATE=2 {{(pid=83647) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:55:19 l75lg1-v1 nova-conductor[83648]: DEBUG dbcounter [-] [83648] Writing DB stats nova_cell1:SELECT=1 {{(pid=83648) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:55:20 l75lg1-v1 dstat.sh[49771]: 28-05 12:55:20| 9 1 89 1 0|4899M 2672M 274M 7791M| 14k 0 | 0 2444k| 0 107 |2129 3180 |0.65 0.68 0.90|1.0 0 0| 0 0 | 0 2048M| 27 313 0 3 1 May 28 12:55:21 l75lg1-v1 dstat.sh[49771]: 28-05 12:55:21| 9 1 89 1 0|4890M 2668M 274M 7801M| 11k 0 | 0 2188k| 0 106 |2037 2951 |0.65 0.68 0.90|1.0 0 0| 0 0 | 0 2048M| 27 313 0 3 1 May 28 12:55:22 l75lg1-v1 dstat.sh[49771]: 28-05 12:55:22| 9 1 90 0 0|4886M 2648M 275M 7822M| 12k 0 | 0 1916k| 0 34.0 |1529 2334 |0.68 0.69 0.90|1.0 0 0| 0 0 | 0 2048M| 27 313 0 3 1 May 28 12:55:23 l75lg1-v1 dstat.sh[49771]: 28-05 12:55:23| 8 1 89 2 0|4883M 2629M 276M 7841M| 17k 0 | 0 12M| 0 411 |2021 2705 |0.68 0.69 0.90|1.0 0 0| 0 0 | 0 2048M| 27 313 0 3 1 May 28 12:55:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "_check_child_processes" by "neutron.agent.linux.external_process.ProcessMonitor._check_child_processes" {{(pid=76818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:55:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_concurrency.lockutils [-] Lock "_check_child_processes" acquired by "neutron.agent.linux.external_process.ProcessMonitor._check_child_processes" :: waited 0.000s {{(pid=76818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:55:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_concurrency.lockutils [-] Lock "_check_child_processes" "released" by "neutron.agent.linux.external_process.ProcessMonitor._check_child_processes" :: held 0.000s {{(pid=76818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:55:24 l75lg1-v1 dstat.sh[49771]: 28-05 12:55:24| 3 0 96 0 0|4884M 2626M 276M 7843M| 17k 222B| 0 712k| 0 24.0 |1517 2204 |0.68 0.69 0.90| 0 0 0| 0 0 | 0 2048M| 27 313 0 3 1 May 28 12:55:25 l75lg1-v1 dstat.sh[49771]: 28-05 12:55:25| 1 0 99 0 0|4884M 2626M 276M 7843M| 12k 86B| 0 272k| 0 61.0 |1221 1984 |0.68 0.69 0.90| 0 0 0| 0 0 | 0 2048M| 27 313 0 3 1 May 28 12:55:25 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_service.periodic_task [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85846) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:55:25 l75lg1-v1 cinder-volume[85846]: DEBUG cinder.volume.drivers.lvm [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] Updating volume stats {{(pid=85846) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}} May 28 12:55:25 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:390}} May 28 12:55:25 l75lg1-v1 sudo[94469]: vastdata : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 May 28 12:55:25 l75lg1-v1 sudo[94469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) May 28 12:55:26 l75lg1-v1 sudo[94469]: pam_unix(sudo:session): session closed for user root May 28 12:55:26 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.465s {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:428}} May 28 12:55:26 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:390}} May 28 12:55:26 l75lg1-v1 sudo[94472]: vastdata : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 May 28 12:55:26 l75lg1-v1 sudo[94472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) May 28 12:55:26 l75lg1-v1 dstat.sh[49771]: 28-05 12:55:26| 6 2 91 0 0|4886M 2623M 276M 7843M| 17k 258B| 256k 0 |2.00 0 |2572 3977 |0.68 0.69 0.90|1.0 0 51| 0 0 | 0 2048M| 27 313 0 3 1 May 28 12:55:26 l75lg1-v1 sudo[94472]: pam_unix(sudo:session): session closed for user root May 28 12:55:26 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.449s {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:428}} May 28 12:55:26 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:390}} May 28 12:55:26 l75lg1-v1 sudo[94475]: vastdata : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool May 28 12:55:26 l75lg1-v1 sudo[94475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) May 28 12:55:27 l75lg1-v1 sudo[94475]: pam_unix(sudo:session): session closed for user root May 28 12:55:27 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.470s {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:428}} May 28 12:55:27 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:390}} May 28 12:55:27 l75lg1-v1 sudo[94478]: vastdata : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 May 28 12:55:27 l75lg1-v1 sudo[94478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) May 28 12:55:27 l75lg1-v1 dstat.sh[49771]: 28-05 12:55:27| 9 1 90 0 0|4892M 2618M 276M 7843M| 17k 86B| 640k 4096B|5.00 1.00 |1824 2373 |0.71 0.70 0.90|1.0 0 6.0| 0 0 | 0 2048M| 27 313 0 3 1 May 28 12:55:27 l75lg1-v1 sudo[94478]: pam_unix(sudo:session): session closed for user root May 28 12:55:27 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.448s {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:428}} May 28 12:55:27 l75lg1-v1 cinder-volume[85846]: DEBUG cinder.manager [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] Notifying Schedulers of capabilities ... {{(pid=85846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 28 12:55:27 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.scheduler.host_manager [None req-464ad12c-5efd-4670-b64a-cafa30582726 None None] Received volume service update from l75lg1-v1@lvmdriver-1: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:l75lg1-v1:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up', 'allocated_capacity_gb': 0, 'cacheable': True}], 'shared_targets': False, 'sparse_copy_volume': True, 'filter_function': None, 'goodness_function': None} {{(pid=85128) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:628}} May 28 12:55:28 l75lg1-v1 dstat.sh[49771]: 28-05 12:55:28| 3 1 96 0 0|4884M 2626M 276M 7843M| 15k 86B| 256k 0 |2.00 0 |1652 2228 |0.71 0.70 0.90|1.0 0 9.0| 0 0 | 0 2048M| 27 313 0 3 1 May 28 12:55:29 l75lg1-v1 dstat.sh[49771]: 28-05 12:55:29| 0 0 99 0 0|4883M 2626M 276M 7843M| 14k 170B| 0 244k| 0 5.00 |1240 1950 |0.71 0.70 0.90| 0 0 0| 0 0 | 0 2048M| 27 313 0 3 1 May 28 12:55:29 l75lg1-v1 nova-conductor[83647]: DEBUG dbcounter [-] [83647] Writing DB stats nova_cell1:SELECT=1,nova_cell1:UPDATE=1 {{(pid=83647) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:55:29 l75lg1-v1 nova-conductor[83648]: DEBUG dbcounter [-] [83648] Writing DB stats nova_cell1:SELECT=1 {{(pid=83648) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:55:30 l75lg1-v1 dstat.sh[49771]: 28-05 12:55:30| 1 0 99 0 0|4883M 2626M 276M 7843M| 14k 86B| 0 812k| 0 146 |1681 2668 |0.71 0.70 0.90|1.0 0 0| 0 0 | 0 2048M| 27 313 0 3 1 May 28 12:55:30 l75lg1-v1 neutron-server[77618]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.HashRingHealthCheckPeriodics.touch_hash_ring_nodes' {{(pid=77618) _process_scheduled /opt/stack/data/venv/lib/python3.10/site-packages/futurist/periodics.py:638}} May 28 12:55:31 l75lg1-v1 dstat.sh[49771]: 28-05 12:55:31| 0 0 99 0 0|4883M 2626M 276M 7843M|9522B 86B| 0 84k| 0 16.0 |1677 2679 |0.71 0.70 0.90| 0 0 0| 0 0 | 0 2048M| 27 313 0 3 1 May 28 12:55:32 l75lg1-v1 dstat.sh[49771]: 28-05 12:55:32| 1 0 99 0 0|4883M 2626M 276M 7843M| 11k 86B| 0 0 | 0 0 |1191 1926 |0.65 0.68 0.89| 0 0 0| 0 0 | 0 2048M| 27 313 0 3 1 May 28 12:55:33 l75lg1-v1 dstat.sh[49771]: 28-05 12:55:33| 0 0 99 0 0|4884M 2626M 276M 7843M| 14k 86B| 0 524k| 0 28.0 |1272 2033 |0.65 0.68 0.89| 0 0 0| 0 0 | 0 2048M| 27 313 0 3 1 May 28 12:55:34 l75lg1-v1 dstat.sh[49771]: 28-05 12:55:34| 0 0 99 0 0|4883M 2627M 276M 7843M| 10k 258B| 0 32k| 0 5.00 |1307 2060 |0.65 0.68 0.89| 0 0 0| 0 0 | 0 2048M| 27 313 0 3 1 May 28 12:55:35 l75lg1-v1 dstat.sh[49771]: 28-05 12:55:35| 0 0 99 0 0|4882M 2628M 276M 7843M| 13k 86B| 0 256k| 0 56.0 |1249 1954 |0.65 0.68 0.89| 0 0 0| 0 0 | 0 2048M| 27 313 0 3 1 May 28 12:55:36 l75lg1-v1 dstat.sh[49771]: 28-05 12:55:36| 4 0 96 0 0|4881M 2659M 276M 7812M| 20k 2467B| 0 140k| 0 8.00 |1453 2094 |0.65 0.68 0.89|1.0 0 0| 0 0 | 0 2048M| 27 311 0 3 0 May 28 12:55:37 l75lg1-v1 dstat.sh[49771]: 28-05 12:55:37| 10 1 89 0 0|4819M 2722M 276M 7812M| 12k 142B| 0 4096B| 0 1.00 |1553 1938 |0.68 0.69 0.89|1.0 0 6.0| 0 0 | 0 2048M| 27 311 0 3 0 May 28 12:55:38 l75lg1-v1 dstat.sh[49771]: 28-05 12:55:38| 9 2 88 0 0|4841M 2697M 276M 7814M|9435B 0 | 0 0 | 0 0 | 10k 21k|0.68 0.69 0.89|3.0 0 14| 0 0 | 0 2048M| 27 311 0 3 0 May 28 12:55:39 l75lg1-v1 dstat.sh[49771]: 28-05 12:55:39| 9 1 89 0 0|4817M 2721M 276M 7814M| 11k 172B| 0 88k| 0 2.00 |1593 1982 |0.68 0.69 0.89|1.0 0 0| 0 0 | 0 2048M| 27 311 0 3 0 May 28 12:55:39 l75lg1-v1 nova-conductor[83647]: DEBUG dbcounter [-] [83647] Writing DB stats nova_cell1:SELECT=1,nova_cell1:UPDATE=1 {{(pid=83647) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:55:39 l75lg1-v1 nova-conductor[83648]: DEBUG dbcounter [-] [83648] Writing DB stats nova_cell1:SELECT=1 {{(pid=83648) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:55:40 l75lg1-v1 dstat.sh[49771]: 28-05 12:55:40| 10 1 87 0 0|4837M 2702M 276M 7814M| 15k 0 | 0 2181k| 0 42.0 | 10k 21k|0.68 0.69 0.89|1.0 0 6.0| 0 0 | 0 2048M| 27 311 0 3 0 May 28 12:55:40 l75lg1-v1 neutron-server[77618]: DEBUG dbcounter [-] [77618] Writing DB stats neutron:UPDATE=1,neutron:SELECT=1 {{(pid=77618) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:55:40 l75lg1-v1 neutron-server[77623]: DEBUG dbcounter [-] [77623] Writing DB stats neutron:DELETE=1,neutron:SELECT=1 {{(pid=77623) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:55:40 l75lg1-v1 neutron-server[77623]: DEBUG dbcounter [-] [77623] Writing DB stats neutron:SELECT=2 {{(pid=77623) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:55:41 l75lg1-v1 dstat.sh[49771]: 28-05 12:55:41| 9 1 89 0 0|4819M 2720M 276M 7814M| 11k 42B| 0 548k| 0 78.0 |1869 2475 |0.68 0.69 0.89|1.0 0 7.0| 0 0 | 0 2048M| 27 311 0 3 0 May 28 12:55:42 l75lg1-v1 dstat.sh[49771]: 28-05 12:55:42| 10 1 89 0 0|4790M 2749M 276M 7814M| 11k 2086B| 0 12k| 0 2.00 |1754 2391 |0.70 0.69 0.89|1.0 0 6.0| 0 0 | 0 2048M| 27 311 0 3 0 May 28 12:55:42 l75lg1-v1 neutron-server[77623]: DEBUG neutron.db.agents_db [None req-fe40ce8c-640e-4db7-a17a-6e8888cce266 None None] Agent healthcheck: found 0 active agents {{(pid=77623) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:319}} May 28 12:55:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571dbc5c-2f76-4fe0-8af0-1bd12490e912 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:55:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571dbc5c-2f76-4fe0-8af0-1bd12490e912 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:55:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571dbc5c-2f76-4fe0-8af0-1bd12490e912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:55:42 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-571dbc5c-2f76-4fe0-8af0-1bd12490e912 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:55:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-571dbc5c-2f76-4fe0-8af0-1bd12490e912 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:55:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-571dbc5c-2f76-4fe0-8af0-1bd12490e912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:55:42 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 572/1157] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:55:42 2024] POST /identity/v3/auth/tokens => generated 3991 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:55:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea050a77-7e14-4358-a58f-1a153ade2eac None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:55:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea050a77-7e14-4358-a58f-1a153ade2eac None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:55:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea050a77-7e14-4358-a58f-1a153ade2eac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:55:43 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-ea050a77-7e14-4358-a58f-1a153ade2eac None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:55:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-ea050a77-7e14-4358-a58f-1a153ade2eac None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:55:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-ea050a77-7e14-4358-a58f-1a153ade2eac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:55:43 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 586/1158] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:55:42 2024] POST /identity/v3/auth/tokens => generated 3991 bytes in 24 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:55:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571dbc5c-2f76-4fe0-8af0-1bd12490e912 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:55:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571dbc5c-2f76-4fe0-8af0-1bd12490e912 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:55:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae8d100-1312-4a9e-9421-b458a77b3a9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8d517cde1d40bb82c97e080ce071f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:55:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae8d100-1312-4a9e-9421-b458a77b3a9e admin admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:55:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae8d100-1312-4a9e-9421-b458a77b3a9e admin admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:55:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae8d100-1312-4a9e-9421-b458a77b3a9e admin admin] PATH_INFO: `/v3/domains` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:55:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae8d100-1312-4a9e-9421-b458a77b3a9e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:55:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae8d100-1312-4a9e-9421-b458a77b3a9e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:55:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae8d100-1312-4a9e-9421-b458a77b3a9e admin admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:55:43 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 573/1159] 10.27.203.238 () {62 vars in 1241 bytes} [Tue May 28 12:55:43 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:55:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea050a77-7e14-4358-a58f-1a153ade2eac None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:55:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea050a77-7e14-4358-a58f-1a153ade2eac None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:55:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec97e83-aaf1-4c0d-8a4e-eca57b33e282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8d517cde1d40bb82c97e080ce071f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:55:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec97e83-aaf1-4c0d-8a4e-eca57b33e282 admin admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:55:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec97e83-aaf1-4c0d-8a4e-eca57b33e282 admin admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:55:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec97e83-aaf1-4c0d-8a4e-eca57b33e282 admin admin] PATH_INFO: `/v3/projects` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:55:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec97e83-aaf1-4c0d-8a4e-eca57b33e282 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:55:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec97e83-aaf1-4c0d-8a4e-eca57b33e282 admin admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:55:43 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 587/1160] 10.27.203.238 () {64 vars in 1241 bytes} [Tue May 28 12:55:43 2024] POST /identity/v3/projects => generated 379 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:55:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae8d100-1312-4a9e-9421-b458a77b3a9e admin admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:55:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae8d100-1312-4a9e-9421-b458a77b3a9e admin admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:55:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cae1c13-bb7c-49c0-8b54-1f2fb8fc94a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8d517cde1d40bb82c97e080ce071f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:55:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cae1c13-bb7c-49c0-8b54-1f2fb8fc94a4 admin admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:55:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cae1c13-bb7c-49c0-8b54-1f2fb8fc94a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:55:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cae1c13-bb7c-49c0-8b54-1f2fb8fc94a4 admin admin] PATH_INFO: `/v3/users` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:55:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cae1c13-bb7c-49c0-8b54-1f2fb8fc94a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:55:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cae1c13-bb7c-49c0-8b54-1f2fb8fc94a4 admin admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:55:43 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-3cae1c13-bb7c-49c0-8b54-1f2fb8fc94a4 admin admin] Truncating password to algorithm specific maximum length 72 characters. May 28 12:55:43 l75lg1-v1 dstat.sh[49771]: 28-05 12:55:43| 9 1 88 1 0|4819M 2716M 276M 7817M| 15k 1886B| 448k 33M|6.00 241 |2653 4154 |0.70 0.69 0.89| 0 1.0 0| 0 0 | 0 2048M| 27 312 0 3 0 May 28 12:55:43 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 574/1161] 10.27.203.238 () {64 vars in 1232 bytes} [Tue May 28 12:55:43 2024] POST /identity/v3/users => generated 298 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:55:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec97e83-aaf1-4c0d-8a4e-eca57b33e282 admin admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:55:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec97e83-aaf1-4c0d-8a4e-eca57b33e282 admin admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:55:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416196df-c0a4-4167-8d93-98da81071960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8d517cde1d40bb82c97e080ce071f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:55:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416196df-c0a4-4167-8d93-98da81071960 admin admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:55:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416196df-c0a4-4167-8d93-98da81071960 admin admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:55:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416196df-c0a4-4167-8d93-98da81071960 admin admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:55:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416196df-c0a4-4167-8d93-98da81071960 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:55:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416196df-c0a4-4167-8d93-98da81071960 admin admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:55:43 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 588/1162] 10.27.203.238 () {62 vars in 1210 bytes} [Tue May 28 12:55:43 2024] GET /identity/v3/roles => generated 1680 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:55:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cae1c13-bb7c-49c0-8b54-1f2fb8fc94a4 admin admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:55:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cae1c13-bb7c-49c0-8b54-1f2fb8fc94a4 admin admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:55:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3336ad97-af5a-4fc5-975d-778f7913a15a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8d517cde1d40bb82c97e080ce071f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:55:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3336ad97-af5a-4fc5-975d-778f7913a15a admin admin] REQUEST_METHOD: `PUT` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:55:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3336ad97-af5a-4fc5-975d-778f7913a15a admin admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:55:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3336ad97-af5a-4fc5-975d-778f7913a15a admin admin] PATH_INFO: `/v3/projects/1ce45b549dc44e58a41b07cf9193b9da/users/e496a45948804c6f87f1a143a67322f2/roles/44620cad10ae407c90c91e2c296adb04` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:55:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3336ad97-af5a-4fc5-975d-778f7913a15a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ce45b549dc44e58a41b07cf9193b9da, user_id=e496a45948804c6f87f1a143a67322f2, role_id=44620cad10ae407c90c91e2c296adb04)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:55:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3336ad97-af5a-4fc5-975d-778f7913a15a admin admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:55:43 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 575/1163] 10.27.203.238 () {64 vars in 1571 bytes} [Tue May 28 12:55:43 2024] PUT /identity/v3/projects/1ce45b549dc44e58a41b07cf9193b9da/users/e496a45948804c6f87f1a143a67322f2/roles/44620cad10ae407c90c91e2c296adb04 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:55:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ce2e17-d3f6-4c19-ae92-a442190e59b4 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:55:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ce2e17-d3f6-4c19-ae92-a442190e59b4 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:55:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ce2e17-d3f6-4c19-ae92-a442190e59b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:55:43 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-05ce2e17-d3f6-4c19-ae92-a442190e59b4 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:55:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-05ce2e17-d3f6-4c19-ae92-a442190e59b4 None None] MFA Rules not processed for user `e496a45948804c6f87f1a143a67322f2`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:55:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-05ce2e17-d3f6-4c19-ae92-a442190e59b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:55:43 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 589/1164] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:55:43 2024] POST /identity/v3/auth/tokens => generated 3950 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:55:43 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.middleware.request_id [None req-2905af46-723a-4033-85b0-16ed04a937a8 None None] RequestId filter calling following filter/app {{(pid=84425) _context_setter /opt/stack/cinder/cinder/api/middleware/request_id.py:62}} May 28 12:55:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc13d7e-b7f5-4884-84a4-4bbbb1ab805d None None] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:55:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc13d7e-b7f5-4884-84a4-4bbbb1ab805d None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:55:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc13d7e-b7f5-4884-84a4-4bbbb1ab805d None None] PATH_INFO: `/` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:55:43 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 576/1165] 10.27.203.238 () {58 vars in 1052 bytes} [Tue May 28 12:55:43 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:55:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e787611-0c37-4cbf-b13d-32e32a02cb6a None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:55:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e787611-0c37-4cbf-b13d-32e32a02cb6a None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:55:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e787611-0c37-4cbf-b13d-32e32a02cb6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:55:43 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-5e787611-0c37-4cbf-b13d-32e32a02cb6a None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:55:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-5e787611-0c37-4cbf-b13d-32e32a02cb6a None None] MFA Rules not processed for user `d8b9b336af4049a99b45df9eba13a358`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:55:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-5e787611-0c37-4cbf-b13d-32e32a02cb6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:55:43 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 590/1166] 10.27.203.238 () {62 vars in 1149 bytes} [Tue May 28 12:55:43 2024] POST /identity/v3/auth/tokens => generated 3809 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:55:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc13d7e-b7f5-4884-84a4-4bbbb1ab805d None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:55:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc13d7e-b7f5-4884-84a4-4bbbb1ab805d None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:55:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbb3d10-132f-4cb3-bed3-6e0180cdbd5a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8b9b336af4049a99b45df9eba13a358', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:55:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbb3d10-132f-4cb3-bed3-6e0180cdbd5a service cinder] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:55:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbb3d10-132f-4cb3-bed3-6e0180cdbd5a service cinder] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:55:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbb3d10-132f-4cb3-bed3-6e0180cdbd5a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:55:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbb3d10-132f-4cb3-bed3-6e0180cdbd5a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:55:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbb3d10-132f-4cb3-bed3-6e0180cdbd5a service cinder] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:55:43 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 577/1167] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 12:55:43 2024] GET /identity/v3/auth/tokens => generated 3950 bytes in 24 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 12:55:43 l75lg1-v1 devstack@c-api.service[84425]: INFO cinder.api.openstack.wsgi [None req-2905af46-723a-4033-85b0-16ed04a937a8 tempest-verify_tempest_config-842415714 tempest-verify_tempest_config-842415714-project-member] GET http://10.27.203.238/volume/v3/1ce45b549dc44e58a41b07cf9193b9da/extensions May 28 12:55:43 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.openstack.wsgi [None req-2905af46-723a-4033-85b0-16ed04a937a8 tempest-verify_tempest_config-842415714 tempest-verify_tempest_config-842415714-project-member] Empty body provided in request {{(pid=84425) get_body /opt/stack/cinder/cinder/api/openstack/wsgi.py:715}} May 28 12:55:43 l75lg1-v1 devstack@c-api.service[84425]: DEBUG cinder.api.openstack.wsgi [None req-2905af46-723a-4033-85b0-16ed04a937a8 tempest-verify_tempest_config-842415714 tempest-verify_tempest_config-842415714-project-member] Calling method 'index' {{(pid=84425) _process_stack /opt/stack/cinder/cinder/api/openstack/wsgi.py:868}} May 28 12:55:43 l75lg1-v1 devstack@c-api.service[84425]: INFO cinder.api.openstack.wsgi [None req-2905af46-723a-4033-85b0-16ed04a937a8 tempest-verify_tempest_config-842415714 tempest-verify_tempest_config-842415714-project-member] http://10.27.203.238/volume/v3/1ce45b549dc44e58a41b07cf9193b9da/extensions returned with HTTP 200 May 28 12:55:43 l75lg1-v1 devstack@c-api.service[84425]: [pid: 84425|app: 0|req: 2/5] 10.27.203.238 () {62 vars in 1311 bytes} [Tue May 28 12:55:43 2024] GET /volume/v3/1ce45b549dc44e58a41b07cf9193b9da/extensions => generated 5245 bytes in 129 msecs (HTTP/1.1 200) 7 headers in 286 bytes (1 switches on core 0) May 28 12:55:43 l75lg1-v1 neutron-server[77618]: DEBUG neutron.wsgi [-] (77618) accepted ('10.27.203.238', 45580) {{(pid=77618) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 12:55:43 l75lg1-v1 neutron-server[77618]: DEBUG neutron.wsgi [None req-8642f423-20e9-4075-9b7b-d320ef3dfc8e tempest-verify_tempest_config-842415714 tempest-verify_tempest_config-842415714-project-member] http://10.27.203.238:9696/networking/v2.0/extensions returned with HTTP 200 {{(pid=77618) __call__ /opt/stack/neutron/neutron/wsgi.py:730}} May 28 12:55:43 l75lg1-v1 neutron-server[77618]: INFO neutron.wsgi [None req-8642f423-20e9-4075-9b7b-d320ef3dfc8e tempest-verify_tempest_config-842415714 tempest-verify_tempest_config-842415714-project-member] 10.27.203.238 "GET /networking/v2.0/extensions HTTP/1.1" status: 200 len: 13589 time: 0.0055673 May 28 12:55:43 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.api.middleware.version_negotiation [None req-84e3042c-1473-401c-814a-24133eef81d3 admin admin] Determining version of request: GET / Accept: application/json {{(pid=86374) process_request /opt/stack/glance/glance/api/middleware/version_negotiation.py:44}} May 28 12:55:43 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.api.middleware.version_negotiation [None req-84e3042c-1473-401c-814a-24133eef81d3 admin admin] Using url versioning {{(pid=86374) process_request /opt/stack/glance/glance/api/middleware/version_negotiation.py:57}} May 28 12:55:43 l75lg1-v1 devstack@g-api.service[86374]: DEBUG glance.api.middleware.version_negotiation [None req-84e3042c-1473-401c-814a-24133eef81d3 admin admin] Unknown version. Returning version choices. {{(pid=86374) process_request /opt/stack/glance/glance/api/middleware/version_negotiation.py:64}} May 28 12:55:43 l75lg1-v1 devstack@g-api.service[86374]: [pid: 86374|app: 0|req: 9/16] 127.0.0.1 () {36 vars in 481 bytes} [Tue May 28 12:55:43 2024] GET / => generated 1323 bytes in 2 msecs (HTTP/1.1 300) 3 headers in 106 bytes (1 switches on core 0) May 28 12:55:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fab944a-a0e8-42fb-bd18-5d5b1431a6ab None None] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:55:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fab944a-a0e8-42fb-bd18-5d5b1431a6ab None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:55:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fab944a-a0e8-42fb-bd18-5d5b1431a6ab None None] PATH_INFO: `/` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:55:43 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 591/1168] 10.27.203.238 () {56 vars in 918 bytes} [Tue May 28 12:55:43 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:55:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbb3d10-132f-4cb3-bed3-6e0180cdbd5a service cinder] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:55:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbb3d10-132f-4cb3-bed3-6e0180cdbd5a service cinder] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:55:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e5512f-d6dd-41d5-987f-9dd9145937dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8d517cde1d40bb82c97e080ce071f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:55:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e5512f-d6dd-41d5-987f-9dd9145937dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:55:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e5512f-d6dd-41d5-987f-9dd9145937dc admin admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:55:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e5512f-d6dd-41d5-987f-9dd9145937dc admin admin] PATH_INFO: `/v3/users/e496a45948804c6f87f1a143a67322f2` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:55:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e5512f-d6dd-41d5-987f-9dd9145937dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=e496a45948804c6f87f1a143a67322f2)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:55:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e5512f-d6dd-41d5-987f-9dd9145937dc admin admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:55:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-d3e5512f-d6dd-41d5-987f-9dd9145937dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e496a45948804c6f87f1a143a67322f2', 'request_id': 'req-d3e5512f-d6dd-41d5-987f-9dd9145937dc'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:55:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-d3e5512f-d6dd-41d5-987f-9dd9145937dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e496a45948804c6f87f1a143a67322f2', 'request_id': 'req-d3e5512f-d6dd-41d5-987f-9dd9145937dc'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:55:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-d3e5512f-d6dd-41d5-987f-9dd9145937dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e496a45948804c6f87f1a143a67322f2', 'request_id': 'req-d3e5512f-d6dd-41d5-987f-9dd9145937dc'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:55:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-d3e5512f-d6dd-41d5-987f-9dd9145937dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e496a45948804c6f87f1a143a67322f2', 'request_id': 'req-d3e5512f-d6dd-41d5-987f-9dd9145937dc'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:55:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-d3e5512f-d6dd-41d5-987f-9dd9145937dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e496a45948804c6f87f1a143a67322f2', 'request_id': 'req-d3e5512f-d6dd-41d5-987f-9dd9145937dc'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:55:43 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 578/1169] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 12:55:43 2024] DELETE /identity/v3/users/e496a45948804c6f87f1a143a67322f2 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:55:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122e7962-4d39-4bd5-b3ea-1bc54a36c58a None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:55:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122e7962-4d39-4bd5-b3ea-1bc54a36c58a None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:55:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122e7962-4d39-4bd5-b3ea-1bc54a36c58a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:55:43 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-122e7962-4d39-4bd5-b3ea-1bc54a36c58a None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:55:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-122e7962-4d39-4bd5-b3ea-1bc54a36c58a None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:55:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-122e7962-4d39-4bd5-b3ea-1bc54a36c58a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:55:43 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 592/1170] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:55:43 2024] POST /identity/v3/auth/tokens => generated 3991 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:55:43 l75lg1-v1 neutron-server[77618]: DEBUG neutron.wsgi [-] (77618) accepted ('10.27.203.238', 45582) {{(pid=77618) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 12:55:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e5512f-d6dd-41d5-987f-9dd9145937dc admin admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:55:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-d3e5512f-d6dd-41d5-987f-9dd9145937dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:55:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e5512f-d6dd-41d5-987f-9dd9145937dc admin admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:55:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef052a9-b855-4e9a-81dd-263b28c6db50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef17047035e4b518fd5360a01f2da1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:55:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef052a9-b855-4e9a-81dd-263b28c6db50 service neutron] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:55:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef052a9-b855-4e9a-81dd-263b28c6db50 service neutron] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:55:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef052a9-b855-4e9a-81dd-263b28c6db50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:55:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef052a9-b855-4e9a-81dd-263b28c6db50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:55:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef052a9-b855-4e9a-81dd-263b28c6db50 service neutron] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:55:43 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 579/1171] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 12:55:43 2024] GET /identity/v3/auth/tokens => generated 3991 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 12:55:43 l75lg1-v1 neutron-server[77618]: DEBUG neutron_lib.callbacks.manager [None req-d2210570-728e-4bb6-b6f4-91ab21c056c1 admin admin] Publish callbacks [] for security_group (None), before_create {{(pid=77618) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:55:43 l75lg1-v1 neutron-server[77618]: DEBUG neutron_lib.callbacks.manager [None req-d2210570-728e-4bb6-b6f4-91ab21c056c1 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver.OVNMechanismDriver._create_security_group_precommit-4094378'] for security_group (aae75f3d-f7bc-45c1-b968-ba738f307d6a), precommit_create {{(pid=77618) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:55:43 l75lg1-v1 neutron-server[77618]: DEBUG neutron.db.ovn_revision_numbers_db [None req-d2210570-728e-4bb6-b6f4-91ab21c056c1 admin admin] create_initial_revision uuid=aae75f3d-f7bc-45c1-b968-ba738f307d6a, type=security_groups, rev=-1 {{(pid=77618) create_initial_revision /opt/stack/neutron/neutron/db/ovn_revision_numbers_db.py:108}} May 28 12:55:44 l75lg1-v1 neutron-server[77618]: DEBUG neutron_lib.callbacks.manager [None req-d2210570-728e-4bb6-b6f4-91ab21c056c1 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver.OVNMechanismDriver._create_security_group-4094389', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4165855'] for security_group (aae75f3d-f7bc-45c1-b968-ba738f307d6a), after_create {{(pid=77618) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:55:44 l75lg1-v1 neutron-server[77618]: DEBUG ovsdbapp.backend.ovs_idl.transaction [None req-c63b1acc-b5c6-4be8-9db9-04824fec27f2 None None] Running txn n=1 command(idx=0): PgAddCommand(_result=None, name=pg_aae75f3d_f7bc_45c1_b968_ba738f307d6a, may_exist=False, columns={'acls': [], 'external_ids': {'neutron:security_group_id': 'aae75f3d-f7bc-45c1-b968-ba738f307d6a'}}) {{(pid=77618) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:55:44 l75lg1-v1 neutron-server[77618]: DEBUG ovsdbapp.backend.ovs_idl.transaction [None req-c63b1acc-b5c6-4be8-9db9-04824fec27f2 None None] Running txn n=1 command(idx=1): PgAclAddCommand(_result=None, entity=pg_aae75f3d_f7bc_45c1_b968_ba738f307d6a, direction=to-lport, priority=1002, match=outport == @pg_aae75f3d_f7bc_45c1_b968_ba738f307d6a && ip4 && ip4.src == $pg_aae75f3d_f7bc_45c1_b968_ba738f307d6a_ip4, action=allow-related, log=False, may_exist=True, severity=[], name=[], meter=None, external_ids={'neutron:security_group_rule_id': '06aba718-ecb0-4632-9a0a-5473213c0d1d'}) {{(pid=77618) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:55:44 l75lg1-v1 neutron-server[77618]: DEBUG ovsdbapp.backend.ovs_idl.transaction [None req-c63b1acc-b5c6-4be8-9db9-04824fec27f2 None None] Running txn n=1 command(idx=2): PgAclAddCommand(_result=None, entity=pg_aae75f3d_f7bc_45c1_b968_ba738f307d6a, direction=from-lport, priority=1002, match=inport == @pg_aae75f3d_f7bc_45c1_b968_ba738f307d6a && ip4, action=allow-related, log=False, may_exist=True, severity=[], name=[], meter=None, external_ids={'neutron:security_group_rule_id': '10f8b965-c5e5-4001-8973-3d0482a71a1a'}) {{(pid=77618) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:55:44 l75lg1-v1 neutron-server[77618]: DEBUG ovsdbapp.backend.ovs_idl.transaction [None req-c63b1acc-b5c6-4be8-9db9-04824fec27f2 None None] Running txn n=1 command(idx=3): PgAclAddCommand(_result=None, entity=pg_aae75f3d_f7bc_45c1_b968_ba738f307d6a, direction=to-lport, priority=1002, match=outport == @pg_aae75f3d_f7bc_45c1_b968_ba738f307d6a && ip6 && ip6.src == $pg_aae75f3d_f7bc_45c1_b968_ba738f307d6a_ip6, action=allow-related, log=False, may_exist=True, severity=[], name=[], meter=None, external_ids={'neutron:security_group_rule_id': 'd2871d38-5b22-4fe8-ba12-20d4286a4c19'}) {{(pid=77618) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:55:44 l75lg1-v1 neutron-server[77618]: DEBUG ovsdbapp.backend.ovs_idl.transaction [None req-c63b1acc-b5c6-4be8-9db9-04824fec27f2 None None] Running txn n=1 command(idx=4): PgAclAddCommand(_result=None, entity=pg_aae75f3d_f7bc_45c1_b968_ba738f307d6a, direction=from-lport, priority=1002, match=inport == @pg_aae75f3d_f7bc_45c1_b968_ba738f307d6a && ip6, action=allow-related, log=False, may_exist=True, severity=[], name=[], meter=None, external_ids={'neutron:security_group_rule_id': 'f41da805-ad86-4180-bc0b-3daddaa5a5d3'}) {{(pid=77618) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:55:44 l75lg1-v1 neutron-server[77618]: DEBUG neutron.common.ovn.hash_ring_manager [None req-c63b1acc-b5c6-4be8-9db9-04824fec27f2 None None] Hash Ring loaded. 2 active nodes. 0 offline nodes {{(pid=77618) _load_hash_ring /opt/stack/neutron/neutron/common/ovn/hash_ring_manager.py:99}} May 28 12:55:44 l75lg1-v1 neutron-server[77621]: DEBUG neutron.common.ovn.hash_ring_manager [-] Hash Ring loaded. 2 active nodes. 0 offline nodes {{(pid=77621) _load_hash_ring /opt/stack/neutron/neutron/common/ovn/hash_ring_manager.py:99}} May 28 12:55:44 l75lg1-v1 neutron-server[77619]: DEBUG neutron.common.ovn.hash_ring_manager [None req-53cecb61-7023-41e4-a5ea-23b1eb02606a None None] Hash Ring loaded. 2 active nodes. 0 offline nodes {{(pid=77619) _load_hash_ring /opt/stack/neutron/neutron/common/ovn/hash_ring_manager.py:99}} May 28 12:55:44 l75lg1-v1 neutron-server[77618]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-c63b1acc-b5c6-4be8-9db9-04824fec27f2 None None] Hash Ring: Node 4c6fc793-7f5a-456f-b4d6-6e5bd97592f2 (host: l75lg1-v1) handling event "create" for row 631874a5-911f-4ff4-8d95-128281239aa8 (table: ACL) {{(pid=77618) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:55:44 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-53cecb61-7023-41e4-a5ea-23b1eb02606a None None] Hash Ring: Node c89b3497-133e-4a5a-b67a-3310d2cb2485 (host: l75lg1-v1) handling event "create" for row 2eba7967-2489-457e-8c6b-5dde26fcf021 (table: ACL) {{(pid=77619) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:55:44 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-53cecb61-7023-41e4-a5ea-23b1eb02606a None None] Hash Ring: Node c89b3497-133e-4a5a-b67a-3310d2cb2485 (host: l75lg1-v1) handling event "create" for row 987c95fd-1845-45a3-a2c7-792476bdce1a (table: ACL) {{(pid=77619) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:55:44 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-53cecb61-7023-41e4-a5ea-23b1eb02606a None None] Hash Ring: Node c89b3497-133e-4a5a-b67a-3310d2cb2485 (host: l75lg1-v1) handling event "create" for row e236af51-0669-4334-be36-d86ce079b30c (table: ACL) {{(pid=77619) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:55:44 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-53cecb61-7023-41e4-a5ea-23b1eb02606a None None] Hash Ring: Node c89b3497-133e-4a5a-b67a-3310d2cb2485 (host: l75lg1-v1) handling event "create" for row 662d9d9d-aa6b-42c2-a8f4-3c4a179b0630 (table: Port_Group) {{(pid=77619) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:55:44 l75lg1-v1 neutron-server[77618]: INFO neutron.db.ovn_revision_numbers_db [None req-d2210570-728e-4bb6-b6f4-91ab21c056c1 admin admin] Successfully bumped revision number for resource aae75f3d-f7bc-45c1-b968-ba738f307d6a (type: security_groups) to 1 May 28 12:55:44 l75lg1-v1 neutron-server[77618]: INFO neutron.wsgi [None req-d2210570-728e-4bb6-b6f4-91ab21c056c1 admin admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=1ce45b549dc44e58a41b07cf9193b9da&name=default HTTP/1.1" status: 200 len: 3116 time: 0.2755125 May 28 12:55:44 l75lg1-v1 neutron-server[77618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d2210570-728e-4bb6-b6f4-91ab21c056c1 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=aae75f3d-f7bc-45c1-b968-ba738f307d6a,revision_number=1']} {{(pid=77618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 28 12:55:44 l75lg1-v1 neutron-server[77619]: DEBUG neutron.wsgi [-] (77619) accepted ('10.27.203.238', 45590) {{(pid=77619) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 12:55:44 l75lg1-v1 neutron-server[77618]: DEBUG ovsdbapp.backend.ovs_idl.transaction [None req-c63b1acc-b5c6-4be8-9db9-04824fec27f2 None None] Running txn n=1 command(idx=0): CheckLivenessCommand(_result=None) {{(pid=77618) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:55:44 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-53cecb61-7023-41e4-a5ea-23b1eb02606a None None] Hash Ring: Node c89b3497-133e-4a5a-b67a-3310d2cb2485 (host: l75lg1-v1) handling event "update" for row 459958f3-26c0-486c-a7b4-0e57d78742d2 (table: NB_Global) {{(pid=77619) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:55:44 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched UPDATE: SbGlobalUpdateEvent(events=('update',), table='SB_Global', conditions=None, old_conditions=None), priority=20 to row=SB_Global(ipsec=False, ssl=[], nb_cfg=4, external_ids={}, options={'lb_hairpin_use_ct_mark': 'true', 'mac_prefix': '6e:b3:c1', 'max_tunid': '16711680', 'northd_internal_version': '22.03.3-20.21.0-62.4', 'svc_monitor_mac': '6e:c0:93:26:20:eb', 'fdb_removal_limit': '0', 'ignore_lsp_down': 'false', 'mac_binding_removal_limit': '0'}) old=SB_Global(nb_cfg=3) {{(pid=76818) matches /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} May 28 12:55:44 l75lg1-v1 neutron-server[77618]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d2210570-728e-4bb6-b6f4-91ab21c056c1 admin admin] Tracked resource versions report: May 28 12:55:44 l75lg1-v1 neutron-server[77618]: pushed versions: May 28 12:55:44 l75lg1-v1 neutron-server[77618]: { 'AddressGroup': {'1.2'}, May 28 12:55:44 l75lg1-v1 neutron-server[77618]: 'Agent': {'1.1'}, May 28 12:55:44 l75lg1-v1 neutron-server[77618]: 'ConntrackHelper': {'1.0'}, May 28 12:55:44 l75lg1-v1 neutron-server[77618]: 'LocalIPAssociation': {'1.0'}, May 28 12:55:44 l75lg1-v1 neutron-server[77618]: 'Log': {'1.0'}, May 28 12:55:44 l75lg1-v1 neutron-server[77618]: 'NDPProxy': {'1.0'}, May 28 12:55:44 l75lg1-v1 neutron-server[77618]: 'Network': {'1.1'}, May 28 12:55:44 l75lg1-v1 neutron-server[77618]: 'Port': {'1.9'}, May 28 12:55:44 l75lg1-v1 neutron-server[77618]: 'PortForwarding': {'1.3'}, May 28 12:55:44 l75lg1-v1 neutron-server[77618]: 'QosPolicy': {'1.10'}, May 28 12:55:44 l75lg1-v1 neutron-server[77618]: 'SecurityGroup': {'1.6'}, May 28 12:55:44 l75lg1-v1 neutron-server[77618]: 'SecurityGroupRule': {'1.3'}, May 28 12:55:44 l75lg1-v1 neutron-server[77618]: 'SubPort': {'1.0'}, May 28 12:55:44 l75lg1-v1 neutron-server[77618]: 'Subnet': {'1.1'}, May 28 12:55:44 l75lg1-v1 neutron-server[77618]: 'Trunk': {'1.1'}} May 28 12:55:44 l75lg1-v1 neutron-server[77618]: consumer versions: May 28 12:55:44 l75lg1-v1 neutron-server[77618]: {OVN Controller Gateway agent@l75lg1-v1: {}, OVN Metadata agent@l75lg1-v1: {}} May 28 12:55:44 l75lg1-v1 neutron-server[77618]: {{(pid=77618) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:178}} May 28 12:55:44 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata.agent [-] Delaying updating chassis table for 8 seconds {{(pid=76818) run /opt/stack/neutron/neutron/agent/ovn/metadata/agent.py:364}} May 28 12:55:44 l75lg1-v1 neutron-server[77618]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-d9d4969c-e9ae-4d76-91b0-9b7c8eb907b3 None None] ChassisAgentWriteEvent : Matched Chassis_Private, update, None None {{(pid=77618) matches /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:65}} May 28 12:55:44 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-53cecb61-7023-41e4-a5ea-23b1eb02606a None None] Hash Ring: Node c89b3497-133e-4a5a-b67a-3310d2cb2485 (host: l75lg1-v1) handling event "update" for row 459958f3-26c0-486c-a7b4-0e57d78742d2 (table: NB_Global) {{(pid=77619) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:55:44 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-03b5f984-1478-4ad6-9838-8e34c1689c5b None None] ChassisAgentWriteEvent : Matched Chassis_Private, update, None None {{(pid=77619) matches /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:65}} May 28 12:55:44 l75lg1-v1 neutron-server[77621]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [-] ChassisAgentWriteEvent : Matched Chassis_Private, update, None None {{(pid=77621) matches /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:65}} May 28 12:55:44 l75lg1-v1 neutron-server[77618]: DEBUG neutron.common.ovn.hash_ring_manager [None req-d9d4969c-e9ae-4d76-91b0-9b7c8eb907b3 None None] Hash Ring loaded. 2 active nodes. 0 offline nodes {{(pid=77618) _load_hash_ring /opt/stack/neutron/neutron/common/ovn/hash_ring_manager.py:99}} May 28 12:55:44 l75lg1-v1 neutron-server[77621]: DEBUG neutron.common.ovn.hash_ring_manager [-] Hash Ring loaded. 2 active nodes. 0 offline nodes {{(pid=77621) _load_hash_ring /opt/stack/neutron/neutron/common/ovn/hash_ring_manager.py:99}} May 28 12:55:44 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-53cecb61-7023-41e4-a5ea-23b1eb02606a None None] Hash Ring: Node c89b3497-133e-4a5a-b67a-3310d2cb2485 (host: l75lg1-v1) handling event "update" for row 459958f3-26c0-486c-a7b4-0e57d78742d2 (table: NB_Global) {{(pid=77619) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:55:44 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-53cecb61-7023-41e4-a5ea-23b1eb02606a None None] Hash Ring: Node c89b3497-133e-4a5a-b67a-3310d2cb2485 (host: l75lg1-v1) handling event "update" for row 459958f3-26c0-486c-a7b4-0e57d78742d2 (table: NB_Global) {{(pid=77619) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:55:44 l75lg1-v1 neutron-server[77619]: DEBUG neutron.common.ovn.hash_ring_manager [None req-03b5f984-1478-4ad6-9838-8e34c1689c5b None None] Hash Ring loaded. 2 active nodes. 0 offline nodes {{(pid=77619) _load_hash_ring /opt/stack/neutron/neutron/common/ovn/hash_ring_manager.py:99}} May 28 12:55:44 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-03b5f984-1478-4ad6-9838-8e34c1689c5b None None] Hash Ring: Node c89b3497-133e-4a5a-b67a-3310d2cb2485 (host: l75lg1-v1) handling event "update" for row 6ef07056-3e6a-44fb-b483-fdb6022e4e42 (table: Chassis_Private) {{(pid=77619) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:55:44 l75lg1-v1 neutron-server[77619]: DEBUG neutron_lib.callbacks.manager [None req-5143fef4-c903-443a-bfca-0c10861e7920 admin admin] Publish callbacks [] for security_group (aae75f3d-f7bc-45c1-b968-ba738f307d6a), before_delete {{(pid=77619) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:55:44 l75lg1-v1 dstat.sh[49771]: 28-05 12:55:44| 10 1 85 3 0|4825M 2710M 276M 7817M| 20k 796B| 0 7690k| 0 289 |6319 11k|0.70 0.69 0.89|1.0 0 0| 0 0 | 0 2048M| 27 315 0 9 0 May 28 12:55:44 l75lg1-v1 neutron-server[77619]: DEBUG neutron_lib.callbacks.manager [None req-5143fef4-c903-443a-bfca-0c10861e7920 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver.OVNMechanismDriver._delete_security_group_precommit-4094396'] for security_group (aae75f3d-f7bc-45c1-b968-ba738f307d6a), precommit_delete {{(pid=77619) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:55:44 l75lg1-v1 neutron-server[77619]: DEBUG ovsdbapp.backend.ovs_idl.transaction [None req-53cecb61-7023-41e4-a5ea-23b1eb02606a None None] Running txn n=1 command(idx=0): PgAclDelCommand(_result=None, entity=pg_aae75f3d_f7bc_45c1_b968_ba738f307d6a, conditions=[('direction', '=', 'to-lport'), ('priority', '=', 1002), ('match', '=', 'outport == @pg_aae75f3d_f7bc_45c1_b968_ba738f307d6a && ip4 && ip4.src == $pg_aae75f3d_f7bc_45c1_b968_ba738f307d6a_ip4')]) {{(pid=77619) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:55:44 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-53cecb61-7023-41e4-a5ea-23b1eb02606a None None] Hash Ring: Node c89b3497-133e-4a5a-b67a-3310d2cb2485 (host: l75lg1-v1) handling event "delete" for row 2eba7967-2489-457e-8c6b-5dde26fcf021 (table: ACL) {{(pid=77619) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:55:44 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-53cecb61-7023-41e4-a5ea-23b1eb02606a None None] Hash Ring: Node c89b3497-133e-4a5a-b67a-3310d2cb2485 (host: l75lg1-v1) handling event "update" for row 662d9d9d-aa6b-42c2-a8f4-3c4a179b0630 (table: Port_Group) {{(pid=77619) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:55:44 l75lg1-v1 neutron-server[77619]: DEBUG neutron.db.ovn_revision_numbers_db [None req-5143fef4-c903-443a-bfca-0c10861e7920 admin admin] delete_revision(06aba718-ecb0-4632-9a0a-5473213c0d1d) {{(pid=77619) delete_revision /opt/stack/neutron/neutron/db/ovn_revision_numbers_db.py:122}} May 28 12:55:44 l75lg1-v1 neutron-server[77619]: DEBUG ovsdbapp.backend.ovs_idl.transaction [None req-53cecb61-7023-41e4-a5ea-23b1eb02606a None None] Running txn n=1 command(idx=0): PgAclDelCommand(_result=None, entity=pg_aae75f3d_f7bc_45c1_b968_ba738f307d6a, conditions=[('direction', '=', 'to-lport'), ('priority', '=', 1002), ('match', '=', 'outport == @pg_aae75f3d_f7bc_45c1_b968_ba738f307d6a && ip6 && ip6.src == $pg_aae75f3d_f7bc_45c1_b968_ba738f307d6a_ip6')]) {{(pid=77619) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:55:44 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-53cecb61-7023-41e4-a5ea-23b1eb02606a None None] Hash Ring: Node c89b3497-133e-4a5a-b67a-3310d2cb2485 (host: l75lg1-v1) handling event "update" for row 662d9d9d-aa6b-42c2-a8f4-3c4a179b0630 (table: Port_Group) {{(pid=77619) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:55:44 l75lg1-v1 neutron-server[77618]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-c63b1acc-b5c6-4be8-9db9-04824fec27f2 None None] Hash Ring: Node 4c6fc793-7f5a-456f-b4d6-6e5bd97592f2 (host: l75lg1-v1) handling event "delete" for row 631874a5-911f-4ff4-8d95-128281239aa8 (table: ACL) {{(pid=77618) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:55:44 l75lg1-v1 neutron-server[77619]: DEBUG neutron.db.ovn_revision_numbers_db [None req-5143fef4-c903-443a-bfca-0c10861e7920 admin admin] delete_revision(d2871d38-5b22-4fe8-ba12-20d4286a4c19) {{(pid=77619) delete_revision /opt/stack/neutron/neutron/db/ovn_revision_numbers_db.py:122}} May 28 12:55:44 l75lg1-v1 neutron-server[77619]: DEBUG neutron_lib.callbacks.manager [None req-5143fef4-c903-443a-bfca-0c10861e7920 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver.OVNMechanismDriver._delete_security_group-4094343', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4165855'] for security_group (aae75f3d-f7bc-45c1-b968-ba738f307d6a), after_delete {{(pid=77619) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:55:44 l75lg1-v1 neutron-server[77619]: DEBUG ovsdbapp.backend.ovs_idl.transaction [None req-53cecb61-7023-41e4-a5ea-23b1eb02606a None None] Running txn n=1 command(idx=0): PgDelCommand(_result=None, name=pg_aae75f3d_f7bc_45c1_b968_ba738f307d6a, if_exists=True) {{(pid=77619) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:55:44 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-53cecb61-7023-41e4-a5ea-23b1eb02606a None None] Hash Ring: Node c89b3497-133e-4a5a-b67a-3310d2cb2485 (host: l75lg1-v1) handling event "delete" for row 987c95fd-1845-45a3-a2c7-792476bdce1a (table: ACL) {{(pid=77619) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:55:44 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-53cecb61-7023-41e4-a5ea-23b1eb02606a None None] Hash Ring: Node c89b3497-133e-4a5a-b67a-3310d2cb2485 (host: l75lg1-v1) handling event "delete" for row e236af51-0669-4334-be36-d86ce079b30c (table: ACL) {{(pid=77619) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:55:44 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-53cecb61-7023-41e4-a5ea-23b1eb02606a None None] Hash Ring: Node c89b3497-133e-4a5a-b67a-3310d2cb2485 (host: l75lg1-v1) handling event "delete" for row 662d9d9d-aa6b-42c2-a8f4-3c4a179b0630 (table: Port_Group) {{(pid=77619) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:55:44 l75lg1-v1 neutron-server[77619]: DEBUG neutron.db.ovn_revision_numbers_db [None req-5143fef4-c903-443a-bfca-0c10861e7920 admin admin] delete_revision(aae75f3d-f7bc-45c1-b968-ba738f307d6a) {{(pid=77619) delete_revision /opt/stack/neutron/neutron/db/ovn_revision_numbers_db.py:122}} May 28 12:55:44 l75lg1-v1 neutron-server[77619]: DEBUG neutron_lib.callbacks.manager [None req-5143fef4-c903-443a-bfca-0c10861e7920 admin admin] Publish callbacks [] for security_group (None), before_response {{(pid=77619) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:55:44 l75lg1-v1 neutron-server[77619]: INFO neutron.wsgi [None req-5143fef4-c903-443a-bfca-0c10861e7920 admin admin] 10.27.203.238 "DELETE /networking/v2.0/security-groups/aae75f3d-f7bc-45c1-b968-ba738f307d6a HTTP/1.1" status: 204 len: 168 time: 0.3272655 May 28 12:55:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122e7962-4d39-4bd5-b3ea-1bc54a36c58a None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:55:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-122e7962-4d39-4bd5-b3ea-1bc54a36c58a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:55:44 l75lg1-v1 neutron-server[77619]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5143fef4-c903-443a-bfca-0c10861e7920 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=aae75f3d-f7bc-45c1-b968-ba738f307d6a,revision_number=None']} {{(pid=77619) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 28 12:55:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122e7962-4d39-4bd5-b3ea-1bc54a36c58a None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:55:44 l75lg1-v1 neutron-server[77619]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5143fef4-c903-443a-bfca-0c10861e7920 admin admin] Tracked resource versions report: May 28 12:55:44 l75lg1-v1 neutron-server[77619]: pushed versions: May 28 12:55:44 l75lg1-v1 neutron-server[77619]: { 'AddressGroup': {'1.2'}, May 28 12:55:44 l75lg1-v1 neutron-server[77619]: 'Agent': {'1.1'}, May 28 12:55:44 l75lg1-v1 neutron-server[77619]: 'ConntrackHelper': {'1.0'}, May 28 12:55:44 l75lg1-v1 neutron-server[77619]: 'LocalIPAssociation': {'1.0'}, May 28 12:55:44 l75lg1-v1 neutron-server[77619]: 'Log': {'1.0'}, May 28 12:55:44 l75lg1-v1 neutron-server[77619]: 'NDPProxy': {'1.0'}, May 28 12:55:44 l75lg1-v1 neutron-server[77619]: 'Network': {'1.1'}, May 28 12:55:44 l75lg1-v1 neutron-server[77619]: 'Port': {'1.9'}, May 28 12:55:44 l75lg1-v1 neutron-server[77619]: 'PortForwarding': {'1.3'}, May 28 12:55:44 l75lg1-v1 neutron-server[77619]: 'QosPolicy': {'1.10'}, May 28 12:55:44 l75lg1-v1 neutron-server[77619]: 'SecurityGroup': {'1.6'}, May 28 12:55:44 l75lg1-v1 neutron-server[77619]: 'SecurityGroupRule': {'1.3'}, May 28 12:55:44 l75lg1-v1 neutron-server[77619]: 'SubPort': {'1.0'}, May 28 12:55:44 l75lg1-v1 neutron-server[77619]: 'Subnet': {'1.1'}, May 28 12:55:44 l75lg1-v1 neutron-server[77619]: 'Trunk': {'1.1'}} May 28 12:55:44 l75lg1-v1 neutron-server[77619]: consumer versions: May 28 12:55:44 l75lg1-v1 neutron-server[77619]: {OVN Controller Gateway agent@l75lg1-v1: {}, OVN Metadata agent@l75lg1-v1: {}} May 28 12:55:44 l75lg1-v1 neutron-server[77619]: {{(pid=77619) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:178}} May 28 12:55:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a7b4a3-8f6e-4043-ac1a-6a043b3b40bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8d517cde1d40bb82c97e080ce071f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:55:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a7b4a3-8f6e-4043-ac1a-6a043b3b40bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:55:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a7b4a3-8f6e-4043-ac1a-6a043b3b40bf admin admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:55:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a7b4a3-8f6e-4043-ac1a-6a043b3b40bf admin admin] PATH_INFO: `/v3/projects/1ce45b549dc44e58a41b07cf9193b9da` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:55:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a7b4a3-8f6e-4043-ac1a-6a043b3b40bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ce45b549dc44e58a41b07cf9193b9da)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:55:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a7b4a3-8f6e-4043-ac1a-6a043b3b40bf admin admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:55:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-41a7b4a3-8f6e-4043-ac1a-6a043b3b40bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ce45b549dc44e58a41b07cf9193b9da', 'request_id': 'req-41a7b4a3-8f6e-4043-ac1a-6a043b3b40bf'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:55:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-41a7b4a3-8f6e-4043-ac1a-6a043b3b40bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ce45b549dc44e58a41b07cf9193b9da', 'request_id': 'req-41a7b4a3-8f6e-4043-ac1a-6a043b3b40bf'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:55:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-41a7b4a3-8f6e-4043-ac1a-6a043b3b40bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ce45b549dc44e58a41b07cf9193b9da', 'request_id': 'req-41a7b4a3-8f6e-4043-ac1a-6a043b3b40bf'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:55:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-41a7b4a3-8f6e-4043-ac1a-6a043b3b40bf admin admin] The token cache is being invalidate because project 1ce45b549dc44e58a41b07cf9193b9da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 12:55:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-41a7b4a3-8f6e-4043-ac1a-6a043b3b40bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:55:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-41a7b4a3-8f6e-4043-ac1a-6a043b3b40bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:55:44 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 593/1172] 10.27.203.238 () {62 vars in 1321 bytes} [Tue May 28 12:55:44 2024] DELETE /identity/v3/projects/1ce45b549dc44e58a41b07cf9193b9da => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:55:44 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:55:45 l75lg1-v1 dstat.sh[49771]: 28-05 12:55:45| 6 5 87 1 0|4778M 2756M 276M 7817M| 20k 36k| 128k 1068k|1.00 127 |5468 7267 |0.70 0.69 0.89|2.0 1.0 314| 0 0 | 0 2048M| 27 313 0 10 0 May 28 12:55:46 l75lg1-v1 dstat.sh[49771]: 28-05 12:55:46| 9 2 87 2 0|4821M 2713M 276M 7817M| 15k 4037B| 0 4225k| 0 472 |2569 3525 |0.70 0.69 0.89|1.0 0 54| 0 0 | 0 2048M| 27 313 0 10 0 May 28 12:55:46 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:55:46 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:55:46 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.manager [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=83654) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10545}} May 28 12:55:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa484b1-2862-4a36-ae52-5b9e85650e58 None None] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:55:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa484b1-2862-4a36-ae52-5b9e85650e58 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:55:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa484b1-2862-4a36-ae52-5b9e85650e58 None None] PATH_INFO: `/` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:55:46 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 580/1173] 10.27.203.238 () {58 vars in 1014 bytes} [Tue May 28 12:55:46 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:55:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f10592b-1ddc-4623-af2f-e1aa500c1268 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:55:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f10592b-1ddc-4623-af2f-e1aa500c1268 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:55:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f10592b-1ddc-4623-af2f-e1aa500c1268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:55:46 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-3f10592b-1ddc-4623-af2f-e1aa500c1268 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:55:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-3f10592b-1ddc-4623-af2f-e1aa500c1268 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:55:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-3f10592b-1ddc-4623-af2f-e1aa500c1268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:55:46 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 594/1174] 10.27.203.238 () {62 vars in 1111 bytes} [Tue May 28 12:55:46 2024] POST /identity/v3/auth/tokens => generated 3991 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:55:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa484b1-2862-4a36-ae52-5b9e85650e58 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:55:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa484b1-2862-4a36-ae52-5b9e85650e58 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:55:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017a6546-18f6-4ccc-bcfe-707d835f5856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8d517cde1d40bb82c97e080ce071f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:55:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017a6546-18f6-4ccc-bcfe-707d835f5856 admin admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:55:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017a6546-18f6-4ccc-bcfe-707d835f5856 admin admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:55:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017a6546-18f6-4ccc-bcfe-707d835f5856 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:55:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017a6546-18f6-4ccc-bcfe-707d835f5856 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:55:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017a6546-18f6-4ccc-bcfe-707d835f5856 admin admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:55:46 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 581/1175] 10.27.203.238 () {62 vars in 1412 bytes} [Tue May 28 12:55:46 2024] GET /identity/v3/auth/tokens => generated 3991 bytes in 21 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 12:55:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f10592b-1ddc-4623-af2f-e1aa500c1268 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:55:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f10592b-1ddc-4623-af2f-e1aa500c1268 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:55:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d126fd8-d101-48d2-9eb8-50807dc113ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8d517cde1d40bb82c97e080ce071f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:55:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d126fd8-d101-48d2-9eb8-50807dc113ac admin admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:55:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d126fd8-d101-48d2-9eb8-50807dc113ac admin admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:55:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d126fd8-d101-48d2-9eb8-50807dc113ac admin admin] PATH_INFO: `/v3/projects/service` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:55:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d126fd8-d101-48d2-9eb8-50807dc113ac admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:55:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d126fd8-d101-48d2-9eb8-50807dc113ac admin admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:55:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-8d126fd8-d101-48d2-9eb8-50807dc113ac admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 28 12:55:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:55:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:55:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:55:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:55:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:55:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:55:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:55:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:55:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:55:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:55:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:55:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 28 12:55:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._get_project(project_id) May 28 12:55:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 28 12:55:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 28 12:55:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:55:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:55:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:55:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:55:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:55:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:55:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:55:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 12:55:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:55:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 12:55:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:55:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:55:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:55:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 12:55:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:55:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 12:55:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 28 12:55:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 28 12:55:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 28 12:55:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 28 12:55:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 28 12:55:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 28 12:55:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 28 12:55:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 12:55:46 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 595/1176] 10.27.203.238 () {60 vars in 1220 bytes} [Tue May 28 12:55:46 2024] GET /identity/v3/projects/service => generated 88 bytes in 23 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 28 12:55:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017a6546-18f6-4ccc-bcfe-707d835f5856 admin admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:55:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017a6546-18f6-4ccc-bcfe-707d835f5856 admin admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:55:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b99a9bf-a8e7-4346-aa9e-b629a92dcc0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8d517cde1d40bb82c97e080ce071f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:55:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b99a9bf-a8e7-4346-aa9e-b629a92dcc0e admin admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:55:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b99a9bf-a8e7-4346-aa9e-b629a92dcc0e admin admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:55:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b99a9bf-a8e7-4346-aa9e-b629a92dcc0e admin admin] PATH_INFO: `/v3/projects` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:55:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b99a9bf-a8e7-4346-aa9e-b629a92dcc0e admin admin] RBAC: Adding query filter params (name=service) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:55:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b99a9bf-a8e7-4346-aa9e-b629a92dcc0e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:55:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b99a9bf-a8e7-4346-aa9e-b629a92dcc0e admin admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:55:46 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 582/1177] 10.27.203.238 () {60 vars in 1221 bytes} [Tue May 28 12:55:46 2024] GET /identity/v3/projects?name=service => generated 415 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:55:47 l75lg1-v1 dstat.sh[49771]: 28-05 12:55:47| 10 1 89 0 0|4779M 2755M 276M 7818M| 15k 1503B| 0 604k| 0 33.0 |2500 3377 |0.81 0.72 0.90|1.0 1.0 23| 0 0 | 0 2048M| 27 313 0 10 0 May 28 12:55:47 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:55:47 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.manager [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Starting heal instance info cache {{(pid=83654) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}} May 28 12:55:47 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.manager [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Rebuilding the list of instances to heal {{(pid=83654) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9930}} May 28 12:55:47 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Expecting reply to msg 457c6e851ca442e19f16609146ce06fe in queue reply_37f4cbd1dd094961a22b8a65f222c327 May 28 12:55:47 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [-] Received RPC response for msg 457c6e851ca442e19f16609146ce06fe May 28 12:55:48 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.manager [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Didn't find any instances for network info cache update. {{(pid=83654) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10012}} May 28 12:55:48 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:55:48 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:55:48 l75lg1-v1 dstat.sh[49771]: 28-05 12:55:48| 10 1 89 0 0|4826M 2708M 276M 7818M| 15k 0 | 0 1324k| 0 93.0 |2066 2822 |0.81 0.72 0.90|1.0 0 2.0| 0 0 | 0 2048M| 27 313 0 10 0 May 28 12:55:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf5d517-723e-4e8e-84a1-46054aa0b38e None None] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:55:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf5d517-723e-4e8e-84a1-46054aa0b38e None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:55:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf5d517-723e-4e8e-84a1-46054aa0b38e None None] PATH_INFO: `/` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:55:48 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 596/1178] 10.27.203.238 () {58 vars in 1014 bytes} [Tue May 28 12:55:48 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:55:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0cc7a9-8108-4563-baf3-8c70920572e0 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:55:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0cc7a9-8108-4563-baf3-8c70920572e0 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:55:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0cc7a9-8108-4563-baf3-8c70920572e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:55:48 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-ee0cc7a9-8108-4563-baf3-8c70920572e0 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:55:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-ee0cc7a9-8108-4563-baf3-8c70920572e0 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:55:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-ee0cc7a9-8108-4563-baf3-8c70920572e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:55:48 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 583/1179] 10.27.203.238 () {62 vars in 1111 bytes} [Tue May 28 12:55:48 2024] POST /identity/v3/auth/tokens => generated 3991 bytes in 26 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:55:48 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._sync_power_states {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:55:48 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Expecting reply to msg 9f83a89fa1af445aa016425ecc2d43ad in queue reply_37f4cbd1dd094961a22b8a65f222c327 May 28 12:55:48 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [-] Received RPC response for msg 9f83a89fa1af445aa016425ecc2d43ad May 28 12:55:48 l75lg1-v1 neutron-server[77619]: DEBUG neutron.wsgi [-] (77619) accepted ('10.27.203.238', 45598) {{(pid=77619) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 12:55:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf5d517-723e-4e8e-84a1-46054aa0b38e None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:55:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-fbf5d517-723e-4e8e-84a1-46054aa0b38e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:55:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf5d517-723e-4e8e-84a1-46054aa0b38e None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:55:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43352d0c-5580-46f5-826b-75e4d75b00ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef17047035e4b518fd5360a01f2da1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:55:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43352d0c-5580-46f5-826b-75e4d75b00ed service neutron] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:55:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43352d0c-5580-46f5-826b-75e4d75b00ed service neutron] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:55:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43352d0c-5580-46f5-826b-75e4d75b00ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:55:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43352d0c-5580-46f5-826b-75e4d75b00ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:55:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43352d0c-5580-46f5-826b-75e4d75b00ed service neutron] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:55:48 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 597/1180] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 12:55:48 2024] GET /identity/v3/auth/tokens => generated 3991 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 12:55:48 l75lg1-v1 neutron-server[77619]: INFO neutron.pecan_wsgi.hooks.translation [None req-530fba3c-9879-465a-bd98-dec2f8a20878 admin admin] GET failed (client error): The resource could not be found. May 28 12:55:48 l75lg1-v1 neutron-server[77619]: INFO neutron.wsgi [None req-530fba3c-9879-465a-bd98-dec2f8a20878 admin admin] 10.27.203.238 "GET /networking/v2.0/networks/admin_net HTTP/1.1" status: 404 len: 317 time: 0.0791030 May 28 12:55:48 l75lg1-v1 neutron-server[77619]: INFO neutron.wsgi [None req-32075262-272e-4f94-9362-c257abca1b55 admin admin] 10.27.203.238 "GET /networking/v2.0/networks?name=admin_net HTTP/1.1" status: 200 len: 213 time: 0.0222976 May 28 12:55:49 l75lg1-v1 dstat.sh[49771]: 28-05 12:55:49| 10 2 87 0 0|4793M 2741M 276M 7818M| 15k 1868B| 0 100M| 0 650 |3862 5411 |0.81 0.72 0.90|2.0 0 24| 0 0 | 0 2048M| 27 313 0 11 0 May 28 12:55:49 l75lg1-v1 nova-conductor[83648]: DEBUG dbcounter [-] [83648] Writing DB stats nova_cell1:SELECT=1 {{(pid=83648) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:55:50 l75lg1-v1 dstat.sh[49771]: 28-05 12:55:50| 10 1 89 0 0|4830M 2704M 276M 7818M| 14k 172B| 0 1656k| 0 33.0 |1890 2713 |0.81 0.72 0.90|1.0 0 0| 0 0 | 0 2048M| 27 312 0 11 0 May 28 12:55:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7157bd9-0fac-4f93-ae71-a818181e0309 None None] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:55:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7157bd9-0fac-4f93-ae71-a818181e0309 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:55:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7157bd9-0fac-4f93-ae71-a818181e0309 None None] PATH_INFO: `/` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:55:50 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 584/1181] 10.27.203.238 () {58 vars in 1014 bytes} [Tue May 28 12:55:50 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:55:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2447f3-6237-4a65-8013-d2bc7b95c649 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:55:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2447f3-6237-4a65-8013-d2bc7b95c649 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:55:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2447f3-6237-4a65-8013-d2bc7b95c649 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:55:50 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-ad2447f3-6237-4a65-8013-d2bc7b95c649 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:55:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-ad2447f3-6237-4a65-8013-d2bc7b95c649 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:55:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-ad2447f3-6237-4a65-8013-d2bc7b95c649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:55:50 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 598/1182] 10.27.203.238 () {62 vars in 1111 bytes} [Tue May 28 12:55:50 2024] POST /identity/v3/auth/tokens => generated 3991 bytes in 23 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:55:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7157bd9-0fac-4f93-ae71-a818181e0309 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:55:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7157bd9-0fac-4f93-ae71-a818181e0309 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:55:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cb8978-a234-459d-b08f-f6afda5bd2eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8d517cde1d40bb82c97e080ce071f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:55:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cb8978-a234-459d-b08f-f6afda5bd2eb admin admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:55:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cb8978-a234-459d-b08f-f6afda5bd2eb admin admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:55:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cb8978-a234-459d-b08f-f6afda5bd2eb admin admin] PATH_INFO: `/v3/projects/98a6a2dcbf0248d5b353760f7757f713` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:55:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cb8978-a234-459d-b08f-f6afda5bd2eb admin admin] RBAC: Authorizing `identity:get_project(project_id=98a6a2dcbf0248d5b353760f7757f713)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:55:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cb8978-a234-459d-b08f-f6afda5bd2eb admin admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:55:50 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 585/1183] 10.27.203.238 () {60 vars in 1295 bytes} [Tue May 28 12:55:50 2024] GET /identity/v3/projects/98a6a2dcbf0248d5b353760f7757f713 => generated 303 bytes in 17 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:55:50 l75lg1-v1 neutron-server[77618]: DEBUG neutron.wsgi [-] (77618) accepted ('10.27.203.238', 49074) {{(pid=77618) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 12:55:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2447f3-6237-4a65-8013-d2bc7b95c649 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:55:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-ad2447f3-6237-4a65-8013-d2bc7b95c649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:55:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2447f3-6237-4a65-8013-d2bc7b95c649 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:55:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cca85f-2b8e-4415-bf49-f33305e8524d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef17047035e4b518fd5360a01f2da1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:55:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cca85f-2b8e-4415-bf49-f33305e8524d service neutron] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:55:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cca85f-2b8e-4415-bf49-f33305e8524d service neutron] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:55:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cca85f-2b8e-4415-bf49-f33305e8524d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:55:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cca85f-2b8e-4415-bf49-f33305e8524d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:55:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cca85f-2b8e-4415-bf49-f33305e8524d service neutron] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:55:50 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 599/1184] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 12:55:50 2024] GET /identity/v3/auth/tokens => generated 3991 bytes in 20 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 12:55:50 l75lg1-v1 neutron-server[77618]: DEBUG neutron.api.v2.base [None req-df03e1eb-be6c-4481-9810-b4bdaa2ecb40 admin admin] Request body: {'network': {'name': 'admin_net', 'admin_state_up': True, 'project_id': '98a6a2dcbf0248d5b353760f7757f713'}} {{(pid=77618) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:734}} May 28 12:55:50 l75lg1-v1 neutron-server[77618]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-df03e1eb-be6c-4481-9810-b4bdaa2ecb40 admin admin] Made reservation on behalf of 98a6a2dcbf0248d5b353760f7757f713 for: {'network': 1} {{(pid=77618) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 28 12:55:50 l75lg1-v1 neutron-server[77618]: DEBUG neutron_lib.callbacks.manager [None req-df03e1eb-be6c-4481-9810-b4bdaa2ecb40 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1015114'] for network (None), before_create {{(pid=77618) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:55:50 l75lg1-v1 neutron-server[77618]: DEBUG neutron_lib.callbacks.manager [None req-df03e1eb-be6c-4481-9810-b4bdaa2ecb40 admin admin] Publish callbacks [] for security_group (None), before_create {{(pid=77618) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:55:50 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:55:50 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:55:50 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager.update_available_resource {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:55:50 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Expecting reply to msg 2b874c35340140ff9392c56b12ae7194 in queue reply_37f4cbd1dd094961a22b8a65f222c327 May 28 12:55:50 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [-] Received RPC response for msg 2b874c35340140ff9392c56b12ae7194 May 28 12:55:50 l75lg1-v1 neutron-server[77618]: DEBUG neutron_lib.callbacks.manager [None req-df03e1eb-be6c-4481-9810-b4bdaa2ecb40 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver.OVNMechanismDriver._create_security_group_precommit-4094378'] for security_group (706c7dfb-0f0b-49a2-9d9a-2192aaf6ea1e), precommit_create {{(pid=77618) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:55:50 l75lg1-v1 neutron-server[77618]: DEBUG neutron.db.ovn_revision_numbers_db [None req-df03e1eb-be6c-4481-9810-b4bdaa2ecb40 admin admin] create_initial_revision uuid=706c7dfb-0f0b-49a2-9d9a-2192aaf6ea1e, type=security_groups, rev=-1 {{(pid=77618) create_initial_revision /opt/stack/neutron/neutron/db/ovn_revision_numbers_db.py:108}} May 28 12:55:50 l75lg1-v1 neutron-server[77618]: DEBUG neutron_lib.callbacks.manager [None req-df03e1eb-be6c-4481-9810-b4bdaa2ecb40 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver.OVNMechanismDriver._create_security_group-4094389', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4165855'] for security_group (706c7dfb-0f0b-49a2-9d9a-2192aaf6ea1e), after_create {{(pid=77618) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:55:50 l75lg1-v1 neutron-server[77618]: DEBUG ovsdbapp.backend.ovs_idl.transaction [None req-c63b1acc-b5c6-4be8-9db9-04824fec27f2 None None] Running txn n=1 command(idx=0): PgAddCommand(_result=None, name=pg_706c7dfb_0f0b_49a2_9d9a_2192aaf6ea1e, may_exist=False, columns={'acls': [], 'external_ids': {'neutron:security_group_id': '706c7dfb-0f0b-49a2-9d9a-2192aaf6ea1e'}}) {{(pid=77618) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:55:50 l75lg1-v1 neutron-server[77618]: DEBUG ovsdbapp.backend.ovs_idl.transaction [None req-c63b1acc-b5c6-4be8-9db9-04824fec27f2 None None] Running txn n=1 command(idx=1): PgAclAddCommand(_result=None, entity=pg_706c7dfb_0f0b_49a2_9d9a_2192aaf6ea1e, direction=from-lport, priority=1002, match=inport == @pg_706c7dfb_0f0b_49a2_9d9a_2192aaf6ea1e && ip6, action=allow-related, log=False, may_exist=True, severity=[], name=[], meter=None, external_ids={'neutron:security_group_rule_id': '18d867c7-f171-47bb-9e25-f22db0138b6c'}) {{(pid=77618) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:55:50 l75lg1-v1 neutron-server[77618]: DEBUG ovsdbapp.backend.ovs_idl.transaction [None req-c63b1acc-b5c6-4be8-9db9-04824fec27f2 None None] Running txn n=1 command(idx=2): PgAclAddCommand(_result=None, entity=pg_706c7dfb_0f0b_49a2_9d9a_2192aaf6ea1e, direction=from-lport, priority=1002, match=inport == @pg_706c7dfb_0f0b_49a2_9d9a_2192aaf6ea1e && ip4, action=allow-related, log=False, may_exist=True, severity=[], name=[], meter=None, external_ids={'neutron:security_group_rule_id': '1f10c842-0ff3-48b6-bb46-fee36fc543e9'}) {{(pid=77618) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:55:50 l75lg1-v1 neutron-server[77618]: DEBUG ovsdbapp.backend.ovs_idl.transaction [None req-c63b1acc-b5c6-4be8-9db9-04824fec27f2 None None] Running txn n=1 command(idx=3): PgAclAddCommand(_result=None, entity=pg_706c7dfb_0f0b_49a2_9d9a_2192aaf6ea1e, direction=to-lport, priority=1002, match=outport == @pg_706c7dfb_0f0b_49a2_9d9a_2192aaf6ea1e && ip6 && ip6.src == $pg_706c7dfb_0f0b_49a2_9d9a_2192aaf6ea1e_ip6, action=allow-related, log=False, may_exist=True, severity=[], name=[], meter=None, external_ids={'neutron:security_group_rule_id': '98df76e4-ab4a-49bc-8ac9-9989d09deabf'}) {{(pid=77618) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:55:50 l75lg1-v1 neutron-server[77618]: DEBUG ovsdbapp.backend.ovs_idl.transaction [None req-c63b1acc-b5c6-4be8-9db9-04824fec27f2 None None] Running txn n=1 command(idx=4): PgAclAddCommand(_result=None, entity=pg_706c7dfb_0f0b_49a2_9d9a_2192aaf6ea1e, direction=to-lport, priority=1002, match=outport == @pg_706c7dfb_0f0b_49a2_9d9a_2192aaf6ea1e && ip4 && ip4.src == $pg_706c7dfb_0f0b_49a2_9d9a_2192aaf6ea1e_ip4, action=allow-related, log=False, may_exist=True, severity=[], name=[], meter=None, external_ids={'neutron:security_group_rule_id': 'c94d0319-ac81-4494-b22d-dc08e8773b6f'}) {{(pid=77618) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:55:50 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-53cecb61-7023-41e4-a5ea-23b1eb02606a None None] Hash Ring: Node c89b3497-133e-4a5a-b67a-3310d2cb2485 (host: l75lg1-v1) handling event "create" for row 403530aa-816d-40f4-9d7f-104111eeaa56 (table: ACL) {{(pid=77619) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:55:50 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-53cecb61-7023-41e4-a5ea-23b1eb02606a None None] Hash Ring: Node c89b3497-133e-4a5a-b67a-3310d2cb2485 (host: l75lg1-v1) handling event "create" for row cf747eae-d041-4d9d-9ae2-75b4252d1b75 (table: ACL) {{(pid=77619) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:55:50 l75lg1-v1 neutron-server[77618]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-c63b1acc-b5c6-4be8-9db9-04824fec27f2 None None] Hash Ring: Node 4c6fc793-7f5a-456f-b4d6-6e5bd97592f2 (host: l75lg1-v1) handling event "create" for row 14d58919-5ddc-44d1-ba18-e208686d6a9f (table: ACL) {{(pid=77618) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:55:50 l75lg1-v1 neutron-server[77618]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-c63b1acc-b5c6-4be8-9db9-04824fec27f2 None None] Hash Ring: Node 4c6fc793-7f5a-456f-b4d6-6e5bd97592f2 (host: l75lg1-v1) handling event "create" for row e76c5091-9bf9-427b-af47-977712ff612c (table: ACL) {{(pid=77618) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:55:50 l75lg1-v1 neutron-server[77618]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-c63b1acc-b5c6-4be8-9db9-04824fec27f2 None None] Hash Ring: Node 4c6fc793-7f5a-456f-b4d6-6e5bd97592f2 (host: l75lg1-v1) handling event "create" for row cb44ae84-1fb7-4720-bc81-1e208c9ea9d1 (table: Port_Group) {{(pid=77618) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:55:50 l75lg1-v1 neutron-server[77618]: INFO neutron.db.ovn_revision_numbers_db [None req-df03e1eb-be6c-4481-9810-b4bdaa2ecb40 admin admin] Successfully bumped revision number for resource 706c7dfb-0f0b-49a2-9d9a-2192aaf6ea1e (type: security_groups) to 1 May 28 12:55:50 l75lg1-v1 neutron-server[77618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-df03e1eb-be6c-4481-9810-b4bdaa2ecb40 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=706c7dfb-0f0b-49a2-9d9a-2192aaf6ea1e,revision_number=1']} {{(pid=77618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 28 12:55:50 l75lg1-v1 neutron-server[77618]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-df03e1eb-be6c-4481-9810-b4bdaa2ecb40 admin admin] geneve segment allocate from pool success with {'geneve_vni': 32656} {{(pid=77618) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 28 12:55:50 l75lg1-v1 neutron-server[77618]: DEBUG neutron_lib.callbacks.manager [None req-df03e1eb-be6c-4481-9810-b4bdaa2ecb40 admin admin] Publish callbacks ['neutron.services.segments.db._add_segment_host_mapping_for_segment-8754903005233', 'neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-910805'] for segment (ce8322a7-55e6-4ca6-9e93-5a845a3474f8), precommit_create {{(pid=77618) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:55:50 l75lg1-v1 neutron-server[77618]: INFO neutron.db.segments_db [None req-df03e1eb-be6c-4481-9810-b4bdaa2ecb40 admin admin] Added segment ce8322a7-55e6-4ca6-9e93-5a845a3474f8 of type geneve for network 9aaf4bd9-9f34-40ad-a4e7-932bff23895a May 28 12:55:50 l75lg1-v1 neutron-server[77618]: DEBUG neutron_lib.callbacks.manager [None req-df03e1eb-be6c-4481-9810-b4bdaa2ecb40 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8754901908252'] for network (9aaf4bd9-9f34-40ad-a4e7-932bff23895a), precommit_create {{(pid=77618) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:55:50 l75lg1-v1 neutron-server[77618]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver [None req-df03e1eb-be6c-4481-9810-b4bdaa2ecb40 admin admin] Validating network segment with type geneve, segmentation ID 32656, physical network None {{(pid=77618) _validate_network_segments /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/mech_driver.py:520}} May 28 12:55:50 l75lg1-v1 neutron-server[77618]: DEBUG neutron.db.ovn_revision_numbers_db [None req-df03e1eb-be6c-4481-9810-b4bdaa2ecb40 admin admin] create_initial_revision uuid=9aaf4bd9-9f34-40ad-a4e7-932bff23895a, type=networks, rev=-1 {{(pid=77618) create_initial_revision /opt/stack/neutron/neutron/db/ovn_revision_numbers_db.py:108}} May 28 12:55:50 l75lg1-v1 neutron-server[77618]: INFO neutron.tests.unit.plugins.ml2.drivers.mechanism_logger [None req-df03e1eb-be6c-4481-9810-b4bdaa2ecb40 admin admin] create_network_precommit called with network settings {'id': '9aaf4bd9-9f34-40ad-a4e7-932bff23895a', 'name': 'admin_net', 'tenant_id': '98a6a2dcbf0248d5b353760f7757f713', 'admin_state_up': True, 'mtu': 1442, 'status': 'ACTIVE', 'subnets': [], 'standard_attr_id': 56, 'shared': False, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'port_security_enabled': True, 'router:external': False, 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 32656, 'is_default': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'vlan_transparent': None, 'description': '', 'tags': [], 'created_at': '2024-05-28T12:55:50Z', 'updated_at': '2024-05-28T12:55:50Z', 'revision_number': 1} (original settings None) and network segments [{'id': 'ce8322a7-55e6-4ca6-9e93-5a845a3474f8', 'network_type': 'geneve', 'physical_network': None, 'segmentation_id': 32656, 'network_id': '9aaf4bd9-9f34-40ad-a4e7-932bff23895a'}] May 28 12:55:50 l75lg1-v1 neutron-server[77618]: DEBUG neutron.tests.unit.plugins.ml2.drivers.mechanism_logger [None req-df03e1eb-be6c-4481-9810-b4bdaa2ecb40 admin admin] create_network_precommit: May 28 12:55:50 l75lg1-v1 neutron-server[77618]: key[tenant_id], None -> 98a6a2dcbf0248d5b353760f7757f713 May 28 12:55:50 l75lg1-v1 neutron-server[77618]: key[provider:network_type], None -> geneve May 28 12:55:50 l75lg1-v1 neutron-server[77618]: key[project_id], None -> 98a6a2dcbf0248d5b353760f7757f713 May 28 12:55:50 l75lg1-v1 neutron-server[77618]: key[ipv6_address_scope], None -> None May 28 12:55:50 l75lg1-v1 neutron-server[77618]: key[subnets], None -> [] May 28 12:55:50 l75lg1-v1 neutron-server[77618]: key[admin_state_up], None -> True May 28 12:55:50 l75lg1-v1 neutron-server[77618]: key[id], None -> 9aaf4bd9-9f34-40ad-a4e7-932bff23895a May 28 12:55:50 l75lg1-v1 neutron-server[77618]: key[ipv4_address_scope], None -> None May 28 12:55:50 l75lg1-v1 neutron-server[77618]: key[tags], None -> [] May 28 12:55:50 l75lg1-v1 neutron-server[77618]: key[created_at], None -> 2024-05-28T12:55:50Z May 28 12:55:50 l75lg1-v1 neutron-server[77618]: key[status], None -> ACTIVE May 28 12:55:50 l75lg1-v1 neutron-server[77618]: key[is_default], None -> False May 28 12:55:50 l75lg1-v1 neutron-server[77618]: key[port_security_enabled], None -> True May 28 12:55:50 l75lg1-v1 neutron-server[77618]: key[vlan_transparent], None -> None May 28 12:55:50 l75lg1-v1 neutron-server[77618]: key[updated_at], None -> 2024-05-28T12:55:50Z May 28 12:55:50 l75lg1-v1 neutron-server[77618]: key[standard_attr_id], None -> 56 May 28 12:55:50 l75lg1-v1 neutron-server[77618]: key[availability_zone_hints], None -> [] May 28 12:55:50 l75lg1-v1 neutron-server[77618]: key[provider:physical_network], None -> None May 28 12:55:50 l75lg1-v1 neutron-server[77618]: key[shared], None -> False May 28 12:55:50 l75lg1-v1 neutron-server[77618]: key[mtu], None -> 1442 May 28 12:55:50 l75lg1-v1 neutron-server[77618]: key[provider:segmentation_id], None -> 32656 May 28 12:55:50 l75lg1-v1 neutron-server[77618]: key[description], None -> May 28 12:55:50 l75lg1-v1 neutron-server[77618]: key[availability_zones], None -> [] May 28 12:55:50 l75lg1-v1 neutron-server[77618]: key[revision_number], None -> 1 May 28 12:55:50 l75lg1-v1 neutron-server[77618]: key[router:external], None -> False May 28 12:55:50 l75lg1-v1 neutron-server[77618]: key[name], None -> admin_net May 28 12:55:50 l75lg1-v1 neutron-server[77618]: {{(pid=77618) _log_diff_call /opt/stack/neutron/neutron/tests/unit/plugins/ml2/drivers/mechanism_logger.py:59}} May 28 12:55:50 l75lg1-v1 neutron-server[77618]: DEBUG neutron_lib.callbacks.manager [None req-df03e1eb-be6c-4481-9810-b4bdaa2ecb40 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4165676'] for network (9aaf4bd9-9f34-40ad-a4e7-932bff23895a), after_create {{(pid=77618) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:55:51 l75lg1-v1 neutron-server[77618]: DEBUG ovsdbapp.backend.ovs_idl.transaction [None req-c63b1acc-b5c6-4be8-9db9-04824fec27f2 None None] Running txn n=1 command(idx=0): LsAddCommand(_result=None, switch=neutron-9aaf4bd9-9f34-40ad-a4e7-932bff23895a, columns={'external_ids': {'neutron:network_name': 'admin_net', 'neutron:mtu': '1442', 'neutron:revision_number': '1', 'neutron:availability_zone_hints': '', 'neutron:provnet-network-type': 'geneve'}, 'other_config': {'mcast_snoop': 'false', 'mcast_flood_unregistered': 'false', 'vlan-passthru': 'false'}}, may_exist=True) {{(pid=77618) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:55:51 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-53cecb61-7023-41e4-a5ea-23b1eb02606a None None] Hash Ring: Node c89b3497-133e-4a5a-b67a-3310d2cb2485 (host: l75lg1-v1) handling event "create" for row e86fe565-3ce6-403d-9fe7-8fd8a269888e (table: Logical_Switch) {{(pid=77619) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:55:51 l75lg1-v1 neutron-server[77618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-df03e1eb-be6c-4481-9810-b4bdaa2ecb40 admin admin] Pushing event updated for resources: {'Network': ['ID=9aaf4bd9-9f34-40ad-a4e7-932bff23895a,revision_number=1']} {{(pid=77618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 28 12:55:51 l75lg1-v1 neutron-server[77618]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-d9d4969c-e9ae-4d76-91b0-9b7c8eb907b3 None None] Hash Ring: Node 4c6fc793-7f5a-456f-b4d6-6e5bd97592f2 (host: l75lg1-v1) handling event "create" for row 9f58042b-d3de-4a35-b332-2827607743db (table: Datapath_Binding) {{(pid=77618) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:55:51 l75lg1-v1 nova-compute[83654]: DEBUG oslo_concurrency.lockutils [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=83654) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:55:51 l75lg1-v1 nova-compute[83654]: DEBUG oslo_concurrency.lockutils [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=83654) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:55:51 l75lg1-v1 neutron-server[77618]: INFO neutron.db.ovn_revision_numbers_db [None req-df03e1eb-be6c-4481-9810-b4bdaa2ecb40 admin admin] Successfully bumped revision number for resource 9aaf4bd9-9f34-40ad-a4e7-932bff23895a (type: networks) to 1 May 28 12:55:51 l75lg1-v1 nova-compute[83654]: DEBUG oslo_concurrency.lockutils [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=83654) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:55:51 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.resource_tracker [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Auditing locally available compute resources for l75lg1-v1 (node: l75lg1-v1) {{(pid=83654) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}} May 28 12:55:51 l75lg1-v1 neutron-server[77618]: DEBUG neutron_lib.callbacks.manager [None req-df03e1eb-be6c-4481-9810-b4bdaa2ecb40 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1015114'] for port (None), before_create {{(pid=77618) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:55:51 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.resource_tracker [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Hypervisor/Node resource view: name=l75lg1-v1 free_ram=10796MB free_disk=15.65890121459961GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_01_1", "address": "0000:00:01.1", "product_id": "7010", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7010", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7000", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7000", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "0100", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_0100", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_09_0", "address": "0000:00:09.0", "product_id": "1001", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1001", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "293a", "vendor_id": "8086", "numa_node": null, "label": "label_8086_293a", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_2", "address": "0000:00:07.2", "product_id": "2936", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2936", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "1237", "vendor_id": "8086", "numa_node": null, "label": "label_8086_1237", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "2935", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2935", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "2934", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2934", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_05_0", "address": "0000:00:05.0", "product_id": "1000", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1000", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "1000", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1000", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_06_0", "address": "0000:00:06.0", "product_id": "2668", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2668", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "1000", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1000", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0a_0", "address": "0000:00:0a.0", "product_id": "1002", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1002", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_3", "address": "0000:00:01.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_08_0", "address": "0000:00:08.0", "product_id": "1003", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1003", "dev_type": "type-PCI"}] {{(pid=83654) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}} May 28 12:55:51 l75lg1-v1 nova-compute[83654]: DEBUG oslo_concurrency.lockutils [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=83654) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:55:51 l75lg1-v1 nova-compute[83654]: DEBUG oslo_concurrency.lockutils [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=83654) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:55:51 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Expecting reply to msg ebee640967174a4da6ed00b13671990e in queue reply_37f4cbd1dd094961a22b8a65f222c327 May 28 12:55:51 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [-] Received RPC response for msg ebee640967174a4da6ed00b13671990e May 28 12:55:51 l75lg1-v1 neutron-server[77618]: DEBUG neutron_lib.callbacks.manager [None req-df03e1eb-be6c-4481-9810-b4bdaa2ecb40 admin admin] Publish callbacks [] for port (697c3f9b-2b19-40c6-ada6-113c7f2f97f3), precommit_create {{(pid=77618) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:55:51 l75lg1-v1 neutron-server[77618]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver [None req-df03e1eb-be6c-4481-9810-b4bdaa2ecb40 admin admin] No provisioning block for port 697c3f9b-2b19-40c6-ada6-113c7f2f97f3 since it does not have a host {{(pid=77618) _is_port_provisioning_required /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/mech_driver.py:720}} May 28 12:55:51 l75lg1-v1 neutron-server[77618]: DEBUG neutron.db.ovn_revision_numbers_db [None req-df03e1eb-be6c-4481-9810-b4bdaa2ecb40 admin admin] create_initial_revision uuid=697c3f9b-2b19-40c6-ada6-113c7f2f97f3, type=ports, rev=-1 {{(pid=77618) create_initial_revision /opt/stack/neutron/neutron/db/ovn_revision_numbers_db.py:108}} May 28 12:55:51 l75lg1-v1 neutron-server[77618]: INFO neutron.tests.unit.plugins.ml2.drivers.mechanism_logger [None req-df03e1eb-be6c-4481-9810-b4bdaa2ecb40 admin admin] create_port_precommit called with port settings {'id': '697c3f9b-2b19-40c6-ada6-113c7f2f97f3', 'name': '', 'network_id': '9aaf4bd9-9f34-40ad-a4e7-932bff23895a', 'tenant_id': '98a6a2dcbf0248d5b353760f7757f713', 'mac_address': 'fa:16:3e:0e:5c:95', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ovnmeta-9aaf4bd9-9f34-40ad-a4e7-932bff23895a', 'device_owner': 'network:distributed', 'standard_attr_id': 58, 'fixed_ips': [], 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'port_security_enabled': False, 'security_groups': [], 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'allowed_address_pairs': []} (original settings None) host (original host None) vif type unbound (original vif type None) vif details {} (original vif details None) binding levels None (original binding levels None) on network {'id': '9aaf4bd9-9f34-40ad-a4e7-932bff23895a', 'name': 'admin_net', 'tenant_id': '98a6a2dcbf0248d5b353760f7757f713', 'admin_state_up': True, 'mtu': 1442, 'status': 'ACTIVE', 'subnets': [], 'standard_attr_id': 56, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'vlan_transparent': None, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2024-05-28T12:55:50Z', 'updated_at': '2024-05-28T12:55:50Z', 'revision_number': 1, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 32656} with segments to bind None May 28 12:55:51 l75lg1-v1 neutron-server[77618]: DEBUG neutron.tests.unit.plugins.ml2.drivers.mechanism_logger [None req-df03e1eb-be6c-4481-9810-b4bdaa2ecb40 admin admin] create_port_precommit: May 28 12:55:51 l75lg1-v1 neutron-server[77618]: key[tenant_id], None -> 98a6a2dcbf0248d5b353760f7757f713 May 28 12:55:51 l75lg1-v1 neutron-server[77618]: key[network_id], None -> 9aaf4bd9-9f34-40ad-a4e7-932bff23895a May 28 12:55:51 l75lg1-v1 neutron-server[77618]: key[allowed_address_pairs], None -> [] May 28 12:55:51 l75lg1-v1 neutron-server[77618]: key[binding:vif_type], None -> unbound May 28 12:55:51 l75lg1-v1 neutron-server[77618]: key[project_id], None -> 98a6a2dcbf0248d5b353760f7757f713 May 28 12:55:51 l75lg1-v1 neutron-server[77618]: key[admin_state_up], None -> True May 28 12:55:51 l75lg1-v1 neutron-server[77618]: key[id], None -> 697c3f9b-2b19-40c6-ada6-113c7f2f97f3 May 28 12:55:51 l75lg1-v1 neutron-server[77618]: key[security_groups], None -> [] May 28 12:55:51 l75lg1-v1 neutron-server[77618]: key[binding:vnic_type], None -> normal May 28 12:55:51 l75lg1-v1 neutron-server[77618]: key[name], None -> May 28 12:55:51 l75lg1-v1 neutron-server[77618]: key[status], None -> DOWN May 28 12:55:51 l75lg1-v1 neutron-server[77618]: key[binding:profile], None -> {} May 28 12:55:51 l75lg1-v1 neutron-server[77618]: key[port_security_enabled], None -> False May 28 12:55:51 l75lg1-v1 neutron-server[77618]: key[standard_attr_id], None -> 58 May 28 12:55:51 l75lg1-v1 neutron-server[77618]: key[device_owner], None -> network:distributed May 28 12:55:51 l75lg1-v1 neutron-server[77618]: key[device_id], None -> ovnmeta-9aaf4bd9-9f34-40ad-a4e7-932bff23895a May 28 12:55:51 l75lg1-v1 neutron-server[77618]: key[mac_address], None -> fa:16:3e:0e:5c:95 May 28 12:55:51 l75lg1-v1 neutron-server[77618]: key[binding:host_id], None -> May 28 12:55:51 l75lg1-v1 neutron-server[77618]: key[binding:vif_details], None -> {} May 28 12:55:51 l75lg1-v1 neutron-server[77618]: key[fixed_ips], None -> [] May 28 12:55:51 l75lg1-v1 neutron-server[77618]: {{(pid=77618) _log_diff_call /opt/stack/neutron/neutron/tests/unit/plugins/ml2/drivers/mechanism_logger.py:59}} May 28 12:55:51 l75lg1-v1 dstat.sh[49771]: 28-05 12:55:51| 11 2 86 1 0|4832M 2701M 276M 7818M| 13k 0 | 0 1136k| 0 198 |5381 9428 |0.81 0.72 0.90|1.0 0 0| 0 0 | 0 2048M| 27 314 0 11 0 May 28 12:55:51 l75lg1-v1 neutron-server[77618]: DEBUG neutron_lib.callbacks.manager [None req-df03e1eb-be6c-4481-9810-b4bdaa2ecb40 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4166243'] for port (697c3f9b-2b19-40c6-ada6-113c7f2f97f3), after_create {{(pid=77618) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:55:51 l75lg1-v1 neutron-server[77618]: DEBUG ovsdbapp.backend.ovs_idl.transaction [None req-c63b1acc-b5c6-4be8-9db9-04824fec27f2 None None] Running txn n=1 command(idx=0): AddLSwitchPortCommand(_result=None, lport=697c3f9b-2b19-40c6-ada6-113c7f2f97f3, lswitch=neutron-9aaf4bd9-9f34-40ad-a4e7-932bff23895a, may_exist=True, columns={'addresses': ['fa:16:3e:0e:5c:95'], 'external_ids': {'neutron:port_name': '', 'neutron:device_id': 'ovnmeta-9aaf4bd9-9f34-40ad-a4e7-932bff23895a', 'neutron:project_id': '98a6a2dcbf0248d5b353760f7757f713', 'neutron:cidrs': '', 'neutron:device_owner': 'network:distributed', 'neutron:subnet_pool_addr_scope4': '', 'neutron:subnet_pool_addr_scope6': '', 'neutron:network_name': 'neutron-9aaf4bd9-9f34-40ad-a4e7-932bff23895a', 'neutron:security_group_ids': '', 'neutron:revision_number': '1', 'neutron:vnic_type': 'normal', 'neutron:port_capabilities': '', 'neutron:mtu': ''}, 'parent_name': [], 'tag': [], 'enabled': True, 'options': {}, 'type': 'localport', 'port_security': [], 'dhcpv4_options': [], 'dhcpv6_options': []}) {{(pid=77618) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:55:51 l75lg1-v1 neutron-server[77618]: DEBUG ovsdbapp.backend.ovs_idl.transaction [None req-c63b1acc-b5c6-4be8-9db9-04824fec27f2 None None] Running txn n=1 command(idx=1): QoSDelCommand(_result=None, switch=neutron-9aaf4bd9-9f34-40ad-a4e7-932bff23895a, conditions=[('direction', '=', 'to-lport'), ('priority', '=', 2002), ('match', '=', 'outport == "697c3f9b-2b19-40c6-ada6-113c7f2f97f3"')], if_exists=True) {{(pid=77618) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:55:51 l75lg1-v1 neutron-server[77618]: DEBUG ovsdbapp.backend.ovs_idl.transaction [None req-c63b1acc-b5c6-4be8-9db9-04824fec27f2 None None] Running txn n=1 command(idx=2): UpdateLSwitchPortQosOptionsCommand(_result=None, lport=AddLSwitchPortCommand(_result=8619ec72-30ea-42ac-ba29-2a3a5382537b, lport=697c3f9b-2b19-40c6-ada6-113c7f2f97f3, lswitch=neutron-9aaf4bd9-9f34-40ad-a4e7-932bff23895a, may_exist=True, columns={'addresses': ['fa:16:3e:0e:5c:95'], 'external_ids': {'neutron:port_name': '', 'neutron:device_id': 'ovnmeta-9aaf4bd9-9f34-40ad-a4e7-932bff23895a', 'neutron:project_id': '98a6a2dcbf0248d5b353760f7757f713', 'neutron:cidrs': '', 'neutron:device_owner': 'network:distributed', 'neutron:subnet_pool_addr_scope4': '', 'neutron:subnet_pool_addr_scope6': '', 'neutron:network_name': 'neutron-9aaf4bd9-9f34-40ad-a4e7-932bff23895a', 'neutron:security_group_ids': '', 'neutron:revision_number': '1', 'neutron:vnic_type': 'normal', 'neutron:port_capabilities': '', 'neutron:mtu': ''}, 'parent_name': [], 'enabled': True, 'options': {}, 'type': 'localport', 'port_security': []}), if_exists=True, qos={'qos_min_rate': None}) {{(pid=77618) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:55:51 l75lg1-v1 neutron-server[77618]: DEBUG ovsdbapp.backend.ovs_idl.transaction [None req-c63b1acc-b5c6-4be8-9db9-04824fec27f2 None None] Running txn n=1 command(idx=3): QoSDelCommand(_result=None, switch=neutron-9aaf4bd9-9f34-40ad-a4e7-932bff23895a, conditions=[('direction', '=', 'from-lport'), ('priority', '=', 2002), ('match', '=', 'inport == "697c3f9b-2b19-40c6-ada6-113c7f2f97f3"')], if_exists=True) {{(pid=77618) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:55:51 l75lg1-v1 neutron-server[77618]: DEBUG ovsdbapp.backend.ovs_idl.transaction [None req-c63b1acc-b5c6-4be8-9db9-04824fec27f2 None None] Running txn n=1 command(idx=4): UpdateLSwitchPortQosOptionsCommand(_result=None, lport=AddLSwitchPortCommand(_result=8619ec72-30ea-42ac-ba29-2a3a5382537b, lport=697c3f9b-2b19-40c6-ada6-113c7f2f97f3, lswitch=neutron-9aaf4bd9-9f34-40ad-a4e7-932bff23895a, may_exist=True, columns={'addresses': ['fa:16:3e:0e:5c:95'], 'external_ids': {'neutron:port_name': '', 'neutron:device_id': 'ovnmeta-9aaf4bd9-9f34-40ad-a4e7-932bff23895a', 'neutron:project_id': '98a6a2dcbf0248d5b353760f7757f713', 'neutron:cidrs': '', 'neutron:device_owner': 'network:distributed', 'neutron:subnet_pool_addr_scope4': '', 'neutron:subnet_pool_addr_scope6': '', 'neutron:network_name': 'neutron-9aaf4bd9-9f34-40ad-a4e7-932bff23895a', 'neutron:security_group_ids': '', 'neutron:revision_number': '1', 'neutron:vnic_type': 'normal', 'neutron:port_capabilities': '', 'neutron:mtu': ''}, 'parent_name': [], 'enabled': True, 'options': {}, 'type': 'localport', 'port_security': []}), if_exists=True, qos={'qos_min_rate': None}) {{(pid=77618) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:55:51 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-53cecb61-7023-41e4-a5ea-23b1eb02606a None None] Hash Ring: Node c89b3497-133e-4a5a-b67a-3310d2cb2485 (host: l75lg1-v1) handling event "update" for row e86fe565-3ce6-403d-9fe7-8fd8a269888e (table: Logical_Switch) {{(pid=77619) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:55:51 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-53cecb61-7023-41e4-a5ea-23b1eb02606a None None] Hash Ring: Node c89b3497-133e-4a5a-b67a-3310d2cb2485 (host: l75lg1-v1) handling event "create" for row 1d620e47-24ba-4564-ae82-dc3bfefa0442 (table: Logical_Switch_Port) {{(pid=77619) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:55:51 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-53cecb61-7023-41e4-a5ea-23b1eb02606a None None] Hash Ring: Node c89b3497-133e-4a5a-b67a-3310d2cb2485 (host: l75lg1-v1) handling event "update" for row 1d620e47-24ba-4564-ae82-dc3bfefa0442 (table: Logical_Switch_Port) {{(pid=77619) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:55:51 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-03b5f984-1478-4ad6-9838-8e34c1689c5b None None] Hash Ring: Node c89b3497-133e-4a5a-b67a-3310d2cb2485 (host: l75lg1-v1) handling event "create" for row 8be8a11a-9fe6-42e0-ac2d-449bf7a8ef24 (table: Port_Binding) {{(pid=77619) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:55:51 l75lg1-v1 neutron-server[77618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-df03e1eb-be6c-4481-9810-b4bdaa2ecb40 admin admin] Pushing event updated for resources: {'Port': ['ID=697c3f9b-2b19-40c6-ada6-113c7f2f97f3,revision_number=1']} {{(pid=77618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 28 12:55:51 l75lg1-v1 neutron-server[77618]: INFO neutron.db.ovn_revision_numbers_db [None req-df03e1eb-be6c-4481-9810-b4bdaa2ecb40 admin admin] Successfully bumped revision number for resource 697c3f9b-2b19-40c6-ada6-113c7f2f97f3 (type: ports) to 1 May 28 12:55:51 l75lg1-v1 neutron-server[77618]: INFO neutron.tests.unit.plugins.ml2.drivers.mechanism_logger [None req-df03e1eb-be6c-4481-9810-b4bdaa2ecb40 admin admin] create_port_postcommit called with port settings {'id': '697c3f9b-2b19-40c6-ada6-113c7f2f97f3', 'name': '', 'network_id': '9aaf4bd9-9f34-40ad-a4e7-932bff23895a', 'tenant_id': '98a6a2dcbf0248d5b353760f7757f713', 'mac_address': 'fa:16:3e:0e:5c:95', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ovnmeta-9aaf4bd9-9f34-40ad-a4e7-932bff23895a', 'device_owner': 'network:distributed', 'standard_attr_id': 58, 'fixed_ips': [], 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'port_security_enabled': False, 'security_groups': [], 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'description': '', 'tags': [], 'created_at': '2024-05-28T12:55:51Z', 'updated_at': '2024-05-28T12:55:51Z', 'revision_number': 1, 'network': {'id': '9aaf4bd9-9f34-40ad-a4e7-932bff23895a', 'name': 'admin_net', 'tenant_id': '98a6a2dcbf0248d5b353760f7757f713', 'admin_state_up': True, 'mtu': 1442, 'status': 'ACTIVE', 'subnets': [], 'standard_attr_id': 56, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'vlan_transparent': None, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2024-05-28T12:55:50Z', 'updated_at': '2024-05-28T12:55:50Z', 'revision_number': 1, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 32656}} (original settings None) host (original host None) vif type unbound (original vif type None) vif details {} (original vif details None) binding levels None (original binding levels None) on network {'id': '9aaf4bd9-9f34-40ad-a4e7-932bff23895a', 'name': 'admin_net', 'tenant_id': '98a6a2dcbf0248d5b353760f7757f713', 'admin_state_up': True, 'mtu': 1442, 'status': 'ACTIVE', 'subnets': [], 'standard_attr_id': 56, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'vlan_transparent': None, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2024-05-28T12:55:50Z', 'updated_at': '2024-05-28T12:55:50Z', 'revision_number': 1, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 32656} with segments to bind None May 28 12:55:51 l75lg1-v1 neutron-server[77618]: DEBUG neutron.tests.unit.plugins.ml2.drivers.mechanism_logger [None req-df03e1eb-be6c-4481-9810-b4bdaa2ecb40 admin admin] create_port_postcommit: May 28 12:55:51 l75lg1-v1 neutron-server[77618]: key[tenant_id], None -> 98a6a2dcbf0248d5b353760f7757f713 May 28 12:55:51 l75lg1-v1 neutron-server[77618]: key[network_id], None -> 9aaf4bd9-9f34-40ad-a4e7-932bff23895a May 28 12:55:51 l75lg1-v1 neutron-server[77618]: key[allowed_address_pairs], None -> [] May 28 12:55:51 l75lg1-v1 neutron-server[77618]: key[binding:vif_type], None -> unbound May 28 12:55:51 l75lg1-v1 neutron-server[77618]: key[project_id], None -> 98a6a2dcbf0248d5b353760f7757f713 May 28 12:55:51 l75lg1-v1 neutron-server[77618]: key[admin_state_up], None -> True May 28 12:55:51 l75lg1-v1 neutron-server[77618]: key[id], None -> 697c3f9b-2b19-40c6-ada6-113c7f2f97f3 May 28 12:55:51 l75lg1-v1 neutron-server[77618]: key[security_groups], None -> [] May 28 12:55:51 l75lg1-v1 neutron-server[77618]: key[extra_dhcp_opts], None -> [] May 28 12:55:51 l75lg1-v1 neutron-server[77618]: key[binding:vnic_type], None -> normal May 28 12:55:51 l75lg1-v1 neutron-server[77618]: key[tags], None -> [] May 28 12:55:51 l75lg1-v1 neutron-server[77618]: key[name], None -> May 28 12:55:51 l75lg1-v1 neutron-server[77618]: key[created_at], None -> 2024-05-28T12:55:51Z May 28 12:55:51 l75lg1-v1 neutron-server[77618]: key[status], None -> DOWN May 28 12:55:51 l75lg1-v1 neutron-server[77618]: key[binding:profile], None -> {} May 28 12:55:51 l75lg1-v1 neutron-server[77618]: key[port_security_enabled], None -> False May 28 12:55:51 l75lg1-v1 neutron-server[77618]: key[updated_at], None -> 2024-05-28T12:55:51Z May 28 12:55:51 l75lg1-v1 neutron-server[77618]: key[network], None -> {'id': '9aaf4bd9-9f34-40ad-a4e7-932bff23895a', 'name': 'admin_net', 'tenant_id': '98a6a2dcbf0248d5b353760f7757f713', 'admin_state_up': True, 'mtu': 1442, 'status': 'ACTIVE', 'subnets': [], 'standard_attr_id': 56, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'vlan_transparent': None, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2024-05-28T12:55:50Z', 'updated_at': '2024-05-28T12:55:50Z', 'revision_number': 1, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 32656} May 28 12:55:51 l75lg1-v1 neutron-server[77618]: key[standard_attr_id], None -> 58 May 28 12:55:51 l75lg1-v1 neutron-server[77618]: key[device_owner], None -> network:distributed May 28 12:55:51 l75lg1-v1 neutron-server[77618]: key[device_id], None -> ovnmeta-9aaf4bd9-9f34-40ad-a4e7-932bff23895a May 28 12:55:51 l75lg1-v1 neutron-server[77618]: key[mac_address], None -> fa:16:3e:0e:5c:95 May 28 12:55:51 l75lg1-v1 neutron-server[77618]: key[description], None -> May 28 12:55:51 l75lg1-v1 neutron-server[77618]: key[binding:host_id], None -> May 28 12:55:51 l75lg1-v1 neutron-server[77618]: key[binding:vif_details], None -> {} May 28 12:55:51 l75lg1-v1 neutron-server[77618]: key[revision_number], None -> 1 May 28 12:55:51 l75lg1-v1 neutron-server[77618]: key[fixed_ips], None -> [] May 28 12:55:51 l75lg1-v1 neutron-server[77618]: {{(pid=77618) _log_diff_call /opt/stack/neutron/neutron/tests/unit/plugins/ml2/drivers/mechanism_logger.py:59}} May 28 12:55:51 l75lg1-v1 neutron-server[77618]: INFO neutron.tests.unit.plugins.ml2.drivers.mechanism_logger [None req-df03e1eb-be6c-4481-9810-b4bdaa2ecb40 admin admin] create_network_postcommit called with network settings {'id': '9aaf4bd9-9f34-40ad-a4e7-932bff23895a', 'name': 'admin_net', 'tenant_id': '98a6a2dcbf0248d5b353760f7757f713', 'admin_state_up': True, 'mtu': 1442, 'status': 'ACTIVE', 'subnets': [], 'standard_attr_id': 56, 'shared': False, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'port_security_enabled': True, 'router:external': False, 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 32656, 'is_default': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'vlan_transparent': None, 'description': '', 'tags': [], 'created_at': '2024-05-28T12:55:50Z', 'updated_at': '2024-05-28T12:55:50Z', 'revision_number': 1} (original settings None) and network segments [{'id': 'ce8322a7-55e6-4ca6-9e93-5a845a3474f8', 'network_type': 'geneve', 'physical_network': None, 'segmentation_id': 32656, 'network_id': '9aaf4bd9-9f34-40ad-a4e7-932bff23895a'}] May 28 12:55:51 l75lg1-v1 neutron-server[77618]: DEBUG neutron.tests.unit.plugins.ml2.drivers.mechanism_logger [None req-df03e1eb-be6c-4481-9810-b4bdaa2ecb40 admin admin] create_network_postcommit: May 28 12:55:51 l75lg1-v1 neutron-server[77618]: key[tenant_id], None -> 98a6a2dcbf0248d5b353760f7757f713 May 28 12:55:51 l75lg1-v1 neutron-server[77618]: key[provider:network_type], None -> geneve May 28 12:55:51 l75lg1-v1 neutron-server[77618]: key[project_id], None -> 98a6a2dcbf0248d5b353760f7757f713 May 28 12:55:51 l75lg1-v1 neutron-server[77618]: key[ipv6_address_scope], None -> None May 28 12:55:51 l75lg1-v1 neutron-server[77618]: key[subnets], None -> [] May 28 12:55:51 l75lg1-v1 neutron-server[77618]: key[admin_state_up], None -> True May 28 12:55:51 l75lg1-v1 neutron-server[77618]: key[id], None -> 9aaf4bd9-9f34-40ad-a4e7-932bff23895a May 28 12:55:51 l75lg1-v1 neutron-server[77618]: key[ipv4_address_scope], None -> None May 28 12:55:51 l75lg1-v1 neutron-server[77618]: key[tags], None -> [] May 28 12:55:51 l75lg1-v1 neutron-server[77618]: key[created_at], None -> 2024-05-28T12:55:50Z May 28 12:55:51 l75lg1-v1 neutron-server[77618]: key[status], None -> ACTIVE May 28 12:55:51 l75lg1-v1 neutron-server[77618]: key[is_default], None -> False May 28 12:55:51 l75lg1-v1 neutron-server[77618]: key[port_security_enabled], None -> True May 28 12:55:51 l75lg1-v1 neutron-server[77618]: key[vlan_transparent], None -> None May 28 12:55:51 l75lg1-v1 neutron-server[77618]: key[updated_at], None -> 2024-05-28T12:55:50Z May 28 12:55:51 l75lg1-v1 neutron-server[77618]: key[standard_attr_id], None -> 56 May 28 12:55:51 l75lg1-v1 neutron-server[77618]: key[availability_zone_hints], None -> [] May 28 12:55:51 l75lg1-v1 neutron-server[77618]: key[provider:physical_network], None -> None May 28 12:55:51 l75lg1-v1 neutron-server[77618]: key[shared], None -> False May 28 12:55:51 l75lg1-v1 neutron-server[77618]: key[mtu], None -> 1442 May 28 12:55:51 l75lg1-v1 neutron-server[77618]: key[provider:segmentation_id], None -> 32656 May 28 12:55:51 l75lg1-v1 neutron-server[77618]: key[description], None -> May 28 12:55:51 l75lg1-v1 neutron-server[77618]: key[availability_zones], None -> [] May 28 12:55:51 l75lg1-v1 neutron-server[77618]: key[revision_number], None -> 1 May 28 12:55:51 l75lg1-v1 neutron-server[77618]: key[router:external], None -> False May 28 12:55:51 l75lg1-v1 neutron-server[77618]: key[name], None -> admin_net May 28 12:55:51 l75lg1-v1 neutron-server[77618]: {{(pid=77618) _log_diff_call /opt/stack/neutron/neutron/tests/unit/plugins/ml2/drivers/mechanism_logger.py:59}} May 28 12:55:51 l75lg1-v1 neutron-server[77618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-df03e1eb-be6c-4481-9810-b4bdaa2ecb40 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=77618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:258}} May 28 12:55:51 l75lg1-v1 neutron-server[77618]: DEBUG neutron_lib.callbacks.manager [None req-df03e1eb-be6c-4481-9810-b4bdaa2ecb40 admin admin] Publish callbacks [] for network (None), before_response {{(pid=77618) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:55:51 l75lg1-v1 neutron-server[77618]: INFO neutron.wsgi [None req-df03e1eb-be6c-4481-9810-b4bdaa2ecb40 admin admin] 10.27.203.238 "POST /networking/v2.0/networks HTTP/1.1" status: 201 len: 849 time: 0.8608704 May 28 12:55:51 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Expecting reply to msg 582f6f83128d4ca487d4d2a55fec43f8 in queue reply_37f4cbd1dd094961a22b8a65f222c327 May 28 12:55:51 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [-] Received RPC response for msg 582f6f83128d4ca487d4d2a55fec43f8 May 28 12:55:52 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=Chassis_Private, record=0da8323f-64af-4526-b223-049f5737145a, col_values=(('external_ids', {'neutron:ovn-metadata-sb-cfg': '4'}),), if_exists=True) {{(pid=76818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:55:52 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-03b5f984-1478-4ad6-9838-8e34c1689c5b None None] ChassisMetadataAgentWriteEvent : Matched Chassis_Private, update, None None {{(pid=77619) matches /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:65}} May 28 12:55:52 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-03b5f984-1478-4ad6-9838-8e34c1689c5b None None] Hash Ring: Node c89b3497-133e-4a5a-b67a-3310d2cb2485 (host: l75lg1-v1) handling event "update" for row 6ef07056-3e6a-44fb-b483-fdb6022e4e42 (table: Chassis_Private) {{(pid=77619) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:55:52 l75lg1-v1 neutron-server[77618]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-d9d4969c-e9ae-4d76-91b0-9b7c8eb907b3 None None] ChassisMetadataAgentWriteEvent : Matched Chassis_Private, update, None None {{(pid=77618) matches /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:65}} May 28 12:55:52 l75lg1-v1 neutron-server[77621]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [-] ChassisMetadataAgentWriteEvent : Matched Chassis_Private, update, None None {{(pid=77621) matches /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:65}} May 28 12:55:52 l75lg1-v1 devstack@placement-api.service[78202]: DEBUG placement.requestlog [req-67c84f27-7ed4-4159-a745-f545b812d021 req-7254d379-577c-4742-9adb-e918c5ac64f7 None None] Starting request: 10.27.203.238 "GET /placement/resource_providers/ef90d7d1-0808-4a15-ad77-f9a7391af2f4/allocations" {{(pid=78202) __call__ /opt/stack/placement/placement/requestlog.py:55}} May 28 12:55:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c56cd0-c305-43a8-a773-2bd2f71839e1 None None] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:55:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c56cd0-c305-43a8-a773-2bd2f71839e1 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:55:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c56cd0-c305-43a8-a773-2bd2f71839e1 None None] PATH_INFO: `/` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:55:52 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 586/1185] 10.27.203.238 () {58 vars in 1050 bytes} [Tue May 28 12:55:52 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:55:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a180e26b-f95b-42c6-a5a6-4cd407df33b0 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:55:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a180e26b-f95b-42c6-a5a6-4cd407df33b0 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:55:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a180e26b-f95b-42c6-a5a6-4cd407df33b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:55:52 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-a180e26b-f95b-42c6-a5a6-4cd407df33b0 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:55:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-a180e26b-f95b-42c6-a5a6-4cd407df33b0 None None] MFA Rules not processed for user `c3fe870f285d4169bd917382dd02d7b0`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:55:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-a180e26b-f95b-42c6-a5a6-4cd407df33b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:55:52 l75lg1-v1 dstat.sh[49771]: 28-05 12:55:52| 11 1 87 0 0|4812M 2721M 276M 7818M| 12k 3584B| 0 368k| 0 48.0 |2873 4236 |0.82 0.72 0.90|3.0 0 21| 0 0 | 0 2048M| 27 314 0 13 0 May 28 12:55:52 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 600/1186] 10.27.203.238 () {62 vars in 1147 bytes} [Tue May 28 12:55:52 2024] POST /identity/v3/auth/tokens => generated 4060 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:55:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c56cd0-c305-43a8-a773-2bd2f71839e1 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:55:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c56cd0-c305-43a8-a773-2bd2f71839e1 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:55:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667fadcc-0700-4b68-980c-42d78c8fc9d5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3fe870f285d4169bd917382dd02d7b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'manager', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:55:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667fadcc-0700-4b68-980c-42d78c8fc9d5 service placement] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:55:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667fadcc-0700-4b68-980c-42d78c8fc9d5 service placement] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:55:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667fadcc-0700-4b68-980c-42d78c8fc9d5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:55:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-667fadcc-0700-4b68-980c-42d78c8fc9d5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:55:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667fadcc-0700-4b68-980c-42d78c8fc9d5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:55:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667fadcc-0700-4b68-980c-42d78c8fc9d5 service placement] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:55:52 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 587/1187] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 12:55:52 2024] GET /identity/v3/auth/tokens => generated 4060 bytes in 27 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 12:55:52 l75lg1-v1 devstack@placement-api.service[78202]: INFO placement.requestlog [req-67c84f27-7ed4-4159-a745-f545b812d021 req-7254d379-577c-4742-9adb-e918c5ac64f7 service placement] 10.27.203.238 "GET /placement/resource_providers/ef90d7d1-0808-4a15-ad77-f9a7391af2f4/allocations" status: 200 len: 54 microversion: 1.0 May 28 12:55:52 l75lg1-v1 devstack@placement-api.service[78202]: [pid: 78202|app: 0|req: 19/37] 10.27.203.238 () {62 vars in 1480 bytes} [Tue May 28 12:55:52 2024] GET /placement/resource_providers/ef90d7d1-0808-4a15-ad77-f9a7391af2f4/allocations => generated 54 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 223 bytes (1 switches on core 0) May 28 12:55:52 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.resource_tracker [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Total usable vcpus: 10, total allocated vcpus: 0 {{(pid=83654) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}} May 28 12:55:52 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.resource_tracker [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Final resource view: name=l75lg1-v1 phys_ram=16000MB used_ram=512MB phys_disk=28GB used_disk=0GB total_vcpus=10 used_vcpus=0 pci_stats=[] {{(pid=83654) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}} May 28 12:55:52 l75lg1-v1 devstack@placement-api.service[78201]: DEBUG placement.requestlog [req-67c84f27-7ed4-4159-a745-f545b812d021 req-6a6239d7-1e46-4395-be0e-97b2c554731a None None] Starting request: 10.27.203.238 "GET /placement/resource_providers?in_tree=ef90d7d1-0808-4a15-ad77-f9a7391af2f4" {{(pid=78201) __call__ /opt/stack/placement/placement/requestlog.py:55}} May 28 12:55:52 l75lg1-v1 devstack@placement-api.service[78201]: INFO placement.requestlog [req-67c84f27-7ed4-4159-a745-f545b812d021 req-6a6239d7-1e46-4395-be0e-97b2c554731a service placement] 10.27.203.238 "GET /placement/resource_providers?in_tree=ef90d7d1-0808-4a15-ad77-f9a7391af2f4" status: 200 len: 858 microversion: 1.14 May 28 12:55:52 l75lg1-v1 devstack@placement-api.service[78201]: [pid: 78201|app: 0|req: 19/38] 10.27.203.238 () {64 vars in 1466 bytes} [Tue May 28 12:55:52 2024] GET /placement/resource_providers?in_tree=ef90d7d1-0808-4a15-ad77-f9a7391af2f4 => generated 858 bytes in 27 msecs (HTTP/1.1 200) 6 headers in 225 bytes (1 switches on core 0) May 28 12:55:52 l75lg1-v1 nova-compute[83654]: DEBUG nova.scheduler.client.report [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Refreshing inventories for resource provider ef90d7d1-0808-4a15-ad77-f9a7391af2f4 {{(pid=83654) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}} May 28 12:55:52 l75lg1-v1 devstack@placement-api.service[78202]: DEBUG placement.requestlog [req-67c84f27-7ed4-4159-a745-f545b812d021 req-b12c9e2f-cce9-4064-9c83-60aa5e988a52 None None] Starting request: 10.27.203.238 "GET /placement/resource_providers/ef90d7d1-0808-4a15-ad77-f9a7391af2f4/inventories" {{(pid=78202) __call__ /opt/stack/placement/placement/requestlog.py:55}} May 28 12:55:52 l75lg1-v1 devstack@placement-api.service[78202]: INFO placement.requestlog [req-67c84f27-7ed4-4159-a745-f545b812d021 req-b12c9e2f-cce9-4064-9c83-60aa5e988a52 service placement] 10.27.203.238 "GET /placement/resource_providers/ef90d7d1-0808-4a15-ad77-f9a7391af2f4/inventories" status: 200 len: 398 microversion: 1.0 May 28 12:55:52 l75lg1-v1 devstack@placement-api.service[78202]: [pid: 78202|app: 0|req: 20/39] 10.27.203.238 () {62 vars in 1480 bytes} [Tue May 28 12:55:52 2024] GET /placement/resource_providers/ef90d7d1-0808-4a15-ad77-f9a7391af2f4/inventories => generated 398 bytes in 13 msecs (HTTP/1.1 200) 6 headers in 224 bytes (1 switches on core 0) May 28 12:55:52 l75lg1-v1 nova-compute[83654]: DEBUG nova.scheduler.client.report [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Updating ProviderTree inventory for provider ef90d7d1-0808-4a15-ad77-f9a7391af2f4 from _refresh_and_get_inventory using data: {'VCPU': {'total': 10, 'reserved': 0, 'min_unit': 1, 'max_unit': 10, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16000, 'reserved': 512, 'min_unit': 1, 'max_unit': 16000, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 28, 'reserved': 0, 'min_unit': 1, 'max_unit': 28, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=83654) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}} May 28 12:55:52 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.provider_tree [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Updating inventory in ProviderTree for provider ef90d7d1-0808-4a15-ad77-f9a7391af2f4 with inventory: {'VCPU': {'total': 10, 'reserved': 0, 'min_unit': 1, 'max_unit': 10, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16000, 'reserved': 512, 'min_unit': 1, 'max_unit': 16000, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 28, 'reserved': 0, 'min_unit': 1, 'max_unit': 28, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=83654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}} May 28 12:55:52 l75lg1-v1 devstack@placement-api.service[78201]: DEBUG placement.requestlog [req-67c84f27-7ed4-4159-a745-f545b812d021 req-59cc9846-a6a6-4259-a1bc-f5cf913ac43f None None] Starting request: 10.27.203.238 "GET /placement/resource_providers/ef90d7d1-0808-4a15-ad77-f9a7391af2f4/aggregates" {{(pid=78201) __call__ /opt/stack/placement/placement/requestlog.py:55}} May 28 12:55:52 l75lg1-v1 devstack@placement-api.service[78201]: INFO placement.requestlog [req-67c84f27-7ed4-4159-a745-f545b812d021 req-59cc9846-a6a6-4259-a1bc-f5cf913ac43f service placement] 10.27.203.238 "GET /placement/resource_providers/ef90d7d1-0808-4a15-ad77-f9a7391af2f4/aggregates" status: 200 len: 53 microversion: 1.19 May 28 12:55:52 l75lg1-v1 devstack@placement-api.service[78201]: [pid: 78201|app: 0|req: 20/40] 10.27.203.238 () {64 vars in 1521 bytes} [Tue May 28 12:55:52 2024] GET /placement/resource_providers/ef90d7d1-0808-4a15-ad77-f9a7391af2f4/aggregates => generated 53 bytes in 16 msecs (HTTP/1.1 200) 8 headers in 295 bytes (1 switches on core 0) May 28 12:55:52 l75lg1-v1 nova-compute[83654]: DEBUG nova.scheduler.client.report [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Refreshing aggregate associations for resource provider ef90d7d1-0808-4a15-ad77-f9a7391af2f4, aggregates: None {{(pid=83654) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}} May 28 12:55:52 l75lg1-v1 devstack@placement-api.service[78202]: DEBUG placement.requestlog [req-67c84f27-7ed4-4159-a745-f545b812d021 req-21689afc-5482-416f-8be2-60f087a22f14 None None] Starting request: 10.27.203.238 "GET /placement/resource_providers/ef90d7d1-0808-4a15-ad77-f9a7391af2f4/traits" {{(pid=78202) __call__ /opt/stack/placement/placement/requestlog.py:55}} May 28 12:55:52 l75lg1-v1 neutron-server[77623]: DEBUG dbcounter [-] [77623] Writing DB stats neutron:SELECT=1 {{(pid=77623) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:55:52 l75lg1-v1 devstack@placement-api.service[78202]: INFO placement.requestlog [req-67c84f27-7ed4-4159-a745-f545b812d021 req-21689afc-5482-416f-8be2-60f087a22f14 service placement] 10.27.203.238 "GET /placement/resource_providers/ef90d7d1-0808-4a15-ad77-f9a7391af2f4/traits" status: 200 len: 1471 microversion: 1.6 May 28 12:55:52 l75lg1-v1 devstack@placement-api.service[78202]: [pid: 78202|app: 0|req: 21/41] 10.27.203.238 () {64 vars in 1508 bytes} [Tue May 28 12:55:52 2024] GET /placement/resource_providers/ef90d7d1-0808-4a15-ad77-f9a7391af2f4/traits => generated 1471 bytes in 20 msecs (HTTP/1.1 200) 6 headers in 225 bytes (1 switches on core 0) May 28 12:55:52 l75lg1-v1 nova-compute[83654]: DEBUG nova.scheduler.client.report [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Refreshing trait associations for resource provider ef90d7d1-0808-4a15-ad77-f9a7391af2f4, traits: COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_LAN9118,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NODE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSSE3,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_IDE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VIOMMU_MODEL_SMMUV3,COMPUTE_STORAGE_BUS_FDC {{(pid=83654) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}} May 28 12:55:52 l75lg1-v1 devstack@placement-api.service[78201]: DEBUG placement.requestlog [req-67c84f27-7ed4-4159-a745-f545b812d021 req-6a62fb5f-b976-45a7-8911-8e8941439abb None None] Starting request: 10.27.203.238 "GET /placement/resource_providers/ef90d7d1-0808-4a15-ad77-f9a7391af2f4/allocations" {{(pid=78201) __call__ /opt/stack/placement/placement/requestlog.py:55}} May 28 12:55:52 l75lg1-v1 devstack@placement-api.service[78201]: INFO placement.requestlog [req-67c84f27-7ed4-4159-a745-f545b812d021 req-6a62fb5f-b976-45a7-8911-8e8941439abb service placement] 10.27.203.238 "GET /placement/resource_providers/ef90d7d1-0808-4a15-ad77-f9a7391af2f4/allocations" status: 200 len: 54 microversion: 1.0 May 28 12:55:52 l75lg1-v1 devstack@placement-api.service[78201]: [pid: 78201|app: 0|req: 21/42] 10.27.203.238 () {62 vars in 1480 bytes} [Tue May 28 12:55:52 2024] GET /placement/resource_providers/ef90d7d1-0808-4a15-ad77-f9a7391af2f4/allocations => generated 54 bytes in 16 msecs (HTTP/1.1 200) 6 headers in 223 bytes (1 switches on core 0) May 28 12:55:52 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.provider_tree [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Inventory has not changed in ProviderTree for provider: ef90d7d1-0808-4a15-ad77-f9a7391af2f4 {{(pid=83654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} May 28 12:55:52 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Expecting reply to msg 67318bdf749d4e54976baba02f3b791e in queue reply_37f4cbd1dd094961a22b8a65f222c327 May 28 12:55:52 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [-] Received RPC response for msg 67318bdf749d4e54976baba02f3b791e May 28 12:55:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e22929-17a0-418f-bd89-cd745dfef5eb None None] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:55:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e22929-17a0-418f-bd89-cd745dfef5eb None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:55:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e22929-17a0-418f-bd89-cd745dfef5eb None None] PATH_INFO: `/` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:55:52 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 601/1188] 10.27.203.238 () {58 vars in 1014 bytes} [Tue May 28 12:55:52 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:55:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dff59fa-a589-4b1e-9e42-d08bdf740749 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:55:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dff59fa-a589-4b1e-9e42-d08bdf740749 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:55:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dff59fa-a589-4b1e-9e42-d08bdf740749 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:55:52 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-0dff59fa-a589-4b1e-9e42-d08bdf740749 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:55:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-0dff59fa-a589-4b1e-9e42-d08bdf740749 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:55:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-0dff59fa-a589-4b1e-9e42-d08bdf740749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:55:52 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 588/1189] 10.27.203.238 () {62 vars in 1111 bytes} [Tue May 28 12:55:52 2024] POST /identity/v3/auth/tokens => generated 3991 bytes in 22 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:55:52 l75lg1-v1 nova-compute[83654]: DEBUG nova.scheduler.client.report [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Inventory has not changed for provider ef90d7d1-0808-4a15-ad77-f9a7391af2f4 based on inventory data: {'VCPU': {'total': 10, 'reserved': 0, 'min_unit': 1, 'max_unit': 10, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16000, 'reserved': 512, 'min_unit': 1, 'max_unit': 16000, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 28, 'reserved': 0, 'min_unit': 1, 'max_unit': 28, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=83654) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}} May 28 12:55:52 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.resource_tracker [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Compute_service record updated for l75lg1-v1:l75lg1-v1 {{(pid=83654) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}} May 28 12:55:52 l75lg1-v1 nova-compute[83654]: DEBUG oslo_concurrency.lockutils [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.780s {{(pid=83654) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:55:53 l75lg1-v1 neutron-server[77618]: DEBUG neutron.wsgi [-] (77618) accepted ('10.27.203.238', 49086) {{(pid=77618) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 12:55:53 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e22929-17a0-418f-bd89-cd745dfef5eb None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:55:53 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e22929-17a0-418f-bd89-cd745dfef5eb None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:55:53 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c73cfb-67f5-4c9f-8849-ceee4a562b23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef17047035e4b518fd5360a01f2da1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:55:53 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c73cfb-67f5-4c9f-8849-ceee4a562b23 service neutron] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:55:53 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c73cfb-67f5-4c9f-8849-ceee4a562b23 service neutron] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:55:53 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c73cfb-67f5-4c9f-8849-ceee4a562b23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:55:53 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c73cfb-67f5-4c9f-8849-ceee4a562b23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:55:53 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c73cfb-67f5-4c9f-8849-ceee4a562b23 service neutron] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:55:53 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 602/1190] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 12:55:53 2024] GET /identity/v3/auth/tokens => generated 3991 bytes in 30 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 12:55:53 l75lg1-v1 neutron-server[77618]: INFO neutron.pecan_wsgi.hooks.translation [None req-1f14de9a-3d27-4af5-b2de-8e9d4ba16f16 admin admin] GET failed (client error): The resource could not be found. May 28 12:55:53 l75lg1-v1 neutron-server[77618]: INFO neutron.wsgi [None req-1f14de9a-3d27-4af5-b2de-8e9d4ba16f16 admin admin] 10.27.203.238 "GET /networking/v2.0/networks/admin_net HTTP/1.1" status: 404 len: 317 time: 0.0471084 May 28 12:55:53 l75lg1-v1 neutron-server[77618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-55d233bf-a39f-4510-b2c8-635be7219e9d admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=77618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:258}} May 28 12:55:53 l75lg1-v1 neutron-server[77618]: INFO neutron.wsgi [None req-55d233bf-a39f-4510-b2c8-635be7219e9d admin admin] 10.27.203.238 "GET /networking/v2.0/networks?name=admin_net HTTP/1.1" status: 200 len: 828 time: 0.0425515 May 28 12:55:53 l75lg1-v1 dstat.sh[49771]: 28-05 12:55:53| 12 1 86 0 0|4828M 2705M 276M 7818M| 15k 0 | 0 676k| 0 49.0 |2760 3778 |0.82 0.72 0.90|1.0 1.0 0| 0 0 | 0 2048M| 27 312 0 13 0 May 28 12:55:54 l75lg1-v1 neutron-server[77621]: DEBUG dbcounter [-] [77621] Writing DB stats neutron:SELECT=1 {{(pid=77621) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:55:54 l75lg1-v1 neutron-server[77621]: DEBUG dbcounter [-] [77621] Writing DB stats neutron:SELECT=3 {{(pid=77621) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:55:54 l75lg1-v1 dstat.sh[49771]: 28-05 12:55:54| 9 2 88 1 0|4810M 2723M 276M 7818M| 11k 1520B| 0 812k| 0 75.0 |2075 2749 |0.82 0.72 0.90|1.0 0 23| 0 0 | 0 2048M| 27 312 0 13 0 May 28 12:55:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38776fda-64c8-4362-9d44-e6dde49a35d3 None None] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:55:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38776fda-64c8-4362-9d44-e6dde49a35d3 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:55:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38776fda-64c8-4362-9d44-e6dde49a35d3 None None] PATH_INFO: `/` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:55:54 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 589/1191] 10.27.203.238 () {58 vars in 1014 bytes} [Tue May 28 12:55:54 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:55:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a339867a-9409-441b-94c7-92ce5830facc None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:55:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a339867a-9409-441b-94c7-92ce5830facc None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:55:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a339867a-9409-441b-94c7-92ce5830facc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:55:54 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-a339867a-9409-441b-94c7-92ce5830facc None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:55:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-a339867a-9409-441b-94c7-92ce5830facc None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:55:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-a339867a-9409-441b-94c7-92ce5830facc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:55:54 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 603/1192] 10.27.203.238 () {62 vars in 1111 bytes} [Tue May 28 12:55:54 2024] POST /identity/v3/auth/tokens => generated 3991 bytes in 24 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:55:54 l75lg1-v1 neutron-server[77619]: DEBUG neutron.wsgi [-] (77619) accepted ('10.27.203.238', 49098) {{(pid=77619) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 12:55:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38776fda-64c8-4362-9d44-e6dde49a35d3 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:55:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38776fda-64c8-4362-9d44-e6dde49a35d3 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:55:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14208561-8089-4d00-9d5e-b2adbc6db1f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef17047035e4b518fd5360a01f2da1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:55:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14208561-8089-4d00-9d5e-b2adbc6db1f7 service neutron] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:55:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14208561-8089-4d00-9d5e-b2adbc6db1f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:55:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14208561-8089-4d00-9d5e-b2adbc6db1f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:55:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14208561-8089-4d00-9d5e-b2adbc6db1f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:55:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14208561-8089-4d00-9d5e-b2adbc6db1f7 service neutron] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:55:54 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 590/1193] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 12:55:54 2024] GET /identity/v3/auth/tokens => generated 3991 bytes in 29 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 12:55:54 l75lg1-v1 neutron-server[77619]: INFO neutron.pecan_wsgi.hooks.translation [None req-34114b03-47c9-4033-acbf-13fac2d70344 admin admin] GET failed (client error): The resource could not be found. May 28 12:55:54 l75lg1-v1 neutron-server[77619]: INFO neutron.wsgi [None req-34114b03-47c9-4033-acbf-13fac2d70344 admin admin] 10.27.203.238 "GET /networking/v2.0/subnets/admin_subnet HTTP/1.1" status: 404 len: 318 time: 0.0504653 May 28 12:55:54 l75lg1-v1 neutron-server[77619]: INFO neutron.wsgi [None req-3fc6f895-7216-4c18-907e-bbc0534d44d4 admin admin] 10.27.203.238 "GET /networking/v2.0/subnets?name=admin_subnet HTTP/1.1" status: 200 len: 212 time: 0.0280213 May 28 12:55:55 l75lg1-v1 dstat.sh[49771]: 28-05 12:55:55| 10 1 89 0 0|4773M 2760M 276M 7818M| 10k 1948B| 0 684k| 0 43.0 |2159 2828 |0.82 0.72 0.90|1.0 2.0 24| 0 0 | 0 2048M| 27 312 0 14 0 May 28 12:55:56 l75lg1-v1 dstat.sh[49771]: 28-05 12:55:56| 9 1 88 1 0|4821M 2713M 276M 7818M| 14k 0 | 0 4292k| 0 493 |2077 2939 |0.82 0.72 0.90|2.0 0 0| 0 0 | 0 2048M| 27 312 0 14 0 May 28 12:55:56 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e5b6ec-1b47-4d8f-b2f8-14d2bcdd2f70 None None] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:55:56 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e5b6ec-1b47-4d8f-b2f8-14d2bcdd2f70 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:55:56 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e5b6ec-1b47-4d8f-b2f8-14d2bcdd2f70 None None] PATH_INFO: `/` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:55:56 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 604/1194] 10.27.203.238 () {58 vars in 1014 bytes} [Tue May 28 12:55:56 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:55:56 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e92f14-8274-4a0a-b624-d6c2ef913c7b None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:55:56 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e92f14-8274-4a0a-b624-d6c2ef913c7b None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:55:56 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e92f14-8274-4a0a-b624-d6c2ef913c7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:55:56 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-e7e92f14-8274-4a0a-b624-d6c2ef913c7b None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:55:56 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-e7e92f14-8274-4a0a-b624-d6c2ef913c7b None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:55:56 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-e7e92f14-8274-4a0a-b624-d6c2ef913c7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:55:56 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 591/1195] 10.27.203.238 () {62 vars in 1111 bytes} [Tue May 28 12:55:56 2024] POST /identity/v3/auth/tokens => generated 3991 bytes in 22 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:55:56 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e5b6ec-1b47-4d8f-b2f8-14d2bcdd2f70 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:55:56 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e5b6ec-1b47-4d8f-b2f8-14d2bcdd2f70 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:55:56 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df882a9c-f7cc-49a3-ae9b-9df4b8079765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8d517cde1d40bb82c97e080ce071f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:55:56 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df882a9c-f7cc-49a3-ae9b-9df4b8079765 admin admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:55:56 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df882a9c-f7cc-49a3-ae9b-9df4b8079765 admin admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:55:56 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df882a9c-f7cc-49a3-ae9b-9df4b8079765 admin admin] PATH_INFO: `/v3/projects/98a6a2dcbf0248d5b353760f7757f713` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:55:56 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df882a9c-f7cc-49a3-ae9b-9df4b8079765 admin admin] RBAC: Authorizing `identity:get_project(project_id=98a6a2dcbf0248d5b353760f7757f713)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:55:56 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df882a9c-f7cc-49a3-ae9b-9df4b8079765 admin admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:55:56 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 605/1196] 10.27.203.238 () {60 vars in 1295 bytes} [Tue May 28 12:55:56 2024] GET /identity/v3/projects/98a6a2dcbf0248d5b353760f7757f713 => generated 303 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:55:56 l75lg1-v1 neutron-server[77618]: DEBUG neutron.wsgi [-] (77618) accepted ('10.27.203.238', 49112) {{(pid=77618) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 12:55:56 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e92f14-8274-4a0a-b624-d6c2ef913c7b None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:55:56 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e92f14-8274-4a0a-b624-d6c2ef913c7b None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:55:56 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8deaf9-7e01-4bdb-9543-b31254c796fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef17047035e4b518fd5360a01f2da1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:55:56 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8deaf9-7e01-4bdb-9543-b31254c796fd service neutron] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:55:56 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8deaf9-7e01-4bdb-9543-b31254c796fd service neutron] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:55:56 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8deaf9-7e01-4bdb-9543-b31254c796fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:55:56 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8deaf9-7e01-4bdb-9543-b31254c796fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:55:56 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8deaf9-7e01-4bdb-9543-b31254c796fd service neutron] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:55:56 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 592/1197] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 12:55:56 2024] GET /identity/v3/auth/tokens => generated 3991 bytes in 19 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 12:55:56 l75lg1-v1 neutron-server[77618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8b148df8-4ccf-48ea-aa2d-65ff6e0a1f82 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=77618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:258}} May 28 12:55:56 l75lg1-v1 neutron-server[77618]: INFO neutron.wsgi [None req-8b148df8-4ccf-48ea-aa2d-65ff6e0a1f82 admin admin] 10.27.203.238 "GET /networking/v2.0/networks/9aaf4bd9-9f34-40ad-a4e7-932bff23895a HTTP/1.1" status: 200 len: 825 time: 0.0686510 May 28 12:55:56 l75lg1-v1 neutron-server[77618]: DEBUG neutron.api.v2.base [None req-77b1d9fb-45f5-48db-a3e5-f333f4c76eda admin admin] Request body: {'subnet': {'gateway_ip': None, 'network_id': '9aaf4bd9-9f34-40ad-a4e7-932bff23895a', 'cidr': '10.2.5.0/24', 'name': 'admin_subnet', 'ip_version': 4, 'project_id': '98a6a2dcbf0248d5b353760f7757f713'}} {{(pid=77618) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:734}} May 28 12:55:56 l75lg1-v1 neutron-server[77618]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-77b1d9fb-45f5-48db-a3e5-f333f4c76eda admin admin] Made reservation on behalf of 98a6a2dcbf0248d5b353760f7757f713 for: {'subnet': 1} {{(pid=77618) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 28 12:55:56 l75lg1-v1 neutron-server[77618]: DEBUG neutron_lib.callbacks.manager [None req-77b1d9fb-45f5-48db-a3e5-f333f4c76eda admin admin] Publish callbacks [] for subnet (None), before_create {{(pid=77618) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:55:56 l75lg1-v1 neutron-server[77618]: DEBUG neutron.db.ovn_revision_numbers_db [None req-77b1d9fb-45f5-48db-a3e5-f333f4c76eda admin admin] create_initial_revision uuid=d5781979-4de3-490b-a4f1-017afe11a304, type=subnets, rev=-1 {{(pid=77618) create_initial_revision /opt/stack/neutron/neutron/db/ovn_revision_numbers_db.py:108}} May 28 12:55:56 l75lg1-v1 neutron-server[77618]: INFO neutron.tests.unit.plugins.ml2.drivers.mechanism_logger [None req-77b1d9fb-45f5-48db-a3e5-f333f4c76eda admin admin] create_subnet_precommit called with subnet settings {'id': 'd5781979-4de3-490b-a4f1-017afe11a304', 'name': 'admin_subnet', 'tenant_id': '98a6a2dcbf0248d5b353760f7757f713', 'network_id': '9aaf4bd9-9f34-40ad-a4e7-932bff23895a', 'ip_version': 4, 'subnetpool_id': None, 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'standard_attr_id': 59, 'gateway_ip': None, 'cidr': '10.2.5.0/24', 'allocation_pools': [{'start': '10.2.5.1', 'end': '10.2.5.254'}], 'host_routes': [], 'dns_nameservers': [], 'shared': False, 'description': '', 'service_types': [], 'tags': [], 'created_at': '2024-05-28T12:55:56Z', 'updated_at': '2024-05-28T12:55:56Z', 'revision_number': 0, 'project_id': '98a6a2dcbf0248d5b353760f7757f713'} (original settings None) May 28 12:55:56 l75lg1-v1 neutron-server[77618]: DEBUG neutron.tests.unit.plugins.ml2.drivers.mechanism_logger [None req-77b1d9fb-45f5-48db-a3e5-f333f4c76eda admin admin] create_subnet_precommit: May 28 12:55:56 l75lg1-v1 neutron-server[77618]: key[tenant_id], None -> 98a6a2dcbf0248d5b353760f7757f713 May 28 12:55:56 l75lg1-v1 neutron-server[77618]: key[network_id], None -> 9aaf4bd9-9f34-40ad-a4e7-932bff23895a May 28 12:55:56 l75lg1-v1 neutron-server[77618]: key[revision_number], None -> 0 May 28 12:55:56 l75lg1-v1 neutron-server[77618]: key[project_id], None -> 98a6a2dcbf0248d5b353760f7757f713 May 28 12:55:56 l75lg1-v1 neutron-server[77618]: key[id], None -> d5781979-4de3-490b-a4f1-017afe11a304 May 28 12:55:56 l75lg1-v1 neutron-server[77618]: key[tags], None -> [] May 28 12:55:56 l75lg1-v1 neutron-server[77618]: key[created_at], None -> 2024-05-28T12:55:56Z May 28 12:55:56 l75lg1-v1 neutron-server[77618]: key[allocation_pools], None -> [{'start': '10.2.5.1', 'end': '10.2.5.254'}] May 28 12:55:56 l75lg1-v1 neutron-server[77618]: key[subnetpool_id], None -> None May 28 12:55:56 l75lg1-v1 neutron-server[77618]: key[host_routes], None -> [] May 28 12:55:56 l75lg1-v1 neutron-server[77618]: key[gateway_ip], None -> None May 28 12:55:56 l75lg1-v1 neutron-server[77618]: key[service_types], None -> [] May 28 12:55:56 l75lg1-v1 neutron-server[77618]: key[updated_at], None -> 2024-05-28T12:55:56Z May 28 12:55:56 l75lg1-v1 neutron-server[77618]: key[standard_attr_id], None -> 59 May 28 12:55:56 l75lg1-v1 neutron-server[77618]: key[ip_version], None -> 4 May 28 12:55:56 l75lg1-v1 neutron-server[77618]: key[cidr], None -> 10.2.5.0/24 May 28 12:55:56 l75lg1-v1 neutron-server[77618]: key[dns_nameservers], None -> [] May 28 12:55:56 l75lg1-v1 neutron-server[77618]: key[ipv6_address_mode], None -> None May 28 12:55:56 l75lg1-v1 neutron-server[77618]: key[description], None -> May 28 12:55:56 l75lg1-v1 neutron-server[77618]: key[ipv6_ra_mode], None -> None May 28 12:55:56 l75lg1-v1 neutron-server[77618]: key[enable_dhcp], None -> True May 28 12:55:56 l75lg1-v1 neutron-server[77618]: key[shared], None -> False May 28 12:55:56 l75lg1-v1 neutron-server[77618]: key[name], None -> admin_subnet May 28 12:55:56 l75lg1-v1 neutron-server[77618]: {{(pid=77618) _log_diff_call /opt/stack/neutron/neutron/tests/unit/plugins/ml2/drivers/mechanism_logger.py:59}} May 28 12:55:56 l75lg1-v1 neutron-server[77618]: DEBUG neutron_lib.callbacks.manager [None req-77b1d9fb-45f5-48db-a3e5-f333f4c76eda admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4166501'] for subnet (d5781979-4de3-490b-a4f1-017afe11a304), after_create {{(pid=77618) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:55:56 l75lg1-v1 neutron-server[77618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-77b1d9fb-45f5-48db-a3e5-f333f4c76eda admin admin] Pushing event updated for resources: {'Subnet': ['ID=d5781979-4de3-490b-a4f1-017afe11a304,revision_number=0']} {{(pid=77618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 28 12:55:56 l75lg1-v1 neutron-server[77618]: DEBUG neutron_lib.callbacks.manager [None req-77b1d9fb-45f5-48db-a3e5-f333f4c76eda admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1015114', 'neutron.services.ovn_l3.plugin.OVNL3RouterPlugin._port_update-8754901907784', 'neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_internal_ip_change_for_fip-8754903031884'] for port (697c3f9b-2b19-40c6-ada6-113c7f2f97f3), before_update {{(pid=77618) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:55:57 l75lg1-v1 neutron-server[77618]: DEBUG neutron.db.db_base_plugin_common [None req-77b1d9fb-45f5-48db-a3e5-f333f4c76eda admin admin] Allocated IP 10.2.5.1 (9aaf4bd9-9f34-40ad-a4e7-932bff23895a/d5781979-4de3-490b-a4f1-017afe11a304/697c3f9b-2b19-40c6-ada6-113c7f2f97f3) {{(pid=77618) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:134}} May 28 12:55:57 l75lg1-v1 neutron-server[77618]: DEBUG neutron_lib.callbacks.manager [None req-77b1d9fb-45f5-48db-a3e5-f333f4c76eda admin admin] Publish callbacks [] for port (697c3f9b-2b19-40c6-ada6-113c7f2f97f3), precommit_update {{(pid=77618) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:55:57 l75lg1-v1 neutron-server[77618]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver [None req-77b1d9fb-45f5-48db-a3e5-f333f4c76eda admin admin] No provisioning block for port 697c3f9b-2b19-40c6-ada6-113c7f2f97f3 since it does not have a host {{(pid=77618) _is_port_provisioning_required /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/mech_driver.py:720}} May 28 12:55:57 l75lg1-v1 neutron-server[77618]: INFO neutron.tests.unit.plugins.ml2.drivers.mechanism_logger [None req-77b1d9fb-45f5-48db-a3e5-f333f4c76eda admin admin] update_port_precommit called with port settings {'id': '697c3f9b-2b19-40c6-ada6-113c7f2f97f3', 'name': '', 'network_id': '9aaf4bd9-9f34-40ad-a4e7-932bff23895a', 'tenant_id': '98a6a2dcbf0248d5b353760f7757f713', 'mac_address': 'fa:16:3e:0e:5c:95', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ovnmeta-9aaf4bd9-9f34-40ad-a4e7-932bff23895a', 'device_owner': 'network:distributed', 'standard_attr_id': 58, 'fixed_ips': [{'subnet_id': 'd5781979-4de3-490b-a4f1-017afe11a304', 'ip_address': '10.2.5.1'}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2024-05-28T12:55:51Z', 'updated_at': '2024-05-28T12:55:57Z', 'revision_number': 2, 'project_id': '98a6a2dcbf0248d5b353760f7757f713'} (original settings {'id': '697c3f9b-2b19-40c6-ada6-113c7f2f97f3', 'name': '', 'network_id': '9aaf4bd9-9f34-40ad-a4e7-932bff23895a', 'tenant_id': '98a6a2dcbf0248d5b353760f7757f713', 'mac_address': 'fa:16:3e:0e:5c:95', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ovnmeta-9aaf4bd9-9f34-40ad-a4e7-932bff23895a', 'device_owner': 'network:distributed', 'standard_attr_id': 58, 'fixed_ips': [], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2024-05-28T12:55:51Z', 'updated_at': '2024-05-28T12:55:51Z', 'revision_number': 1, 'project_id': '98a6a2dcbf0248d5b353760f7757f713'}) host (original host ) vif type unbound (original vif type unbound) vif details {} (original vif details {}) binding levels None (original binding levels None) on network {'id': '9aaf4bd9-9f34-40ad-a4e7-932bff23895a', 'name': 'admin_net', 'tenant_id': '98a6a2dcbf0248d5b353760f7757f713', 'admin_state_up': True, 'mtu': 1442, 'status': 'ACTIVE', 'subnets': ['d5781979-4de3-490b-a4f1-017afe11a304'], 'standard_attr_id': 56, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'vlan_transparent': None, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2024-05-28T12:55:50Z', 'updated_at': '2024-05-28T12:55:56Z', 'revision_number': 2, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 32656} with segments to bind None May 28 12:55:57 l75lg1-v1 neutron-server[77618]: DEBUG neutron.tests.unit.plugins.ml2.drivers.mechanism_logger [None req-77b1d9fb-45f5-48db-a3e5-f333f4c76eda admin admin] update_port_precommit: May 28 12:55:57 l75lg1-v1 neutron-server[77618]: key[fixed_ips], [] -> [{'subnet_id': 'd5781979-4de3-490b-a4f1-017afe11a304', 'ip_address': '10.2.5.1'}] May 28 12:55:57 l75lg1-v1 neutron-server[77618]: key[updated_at], 2024-05-28T12:55:51Z -> 2024-05-28T12:55:57Z May 28 12:55:57 l75lg1-v1 neutron-server[77618]: key[revision_number], 1 -> 2 May 28 12:55:57 l75lg1-v1 neutron-server[77618]: {{(pid=77618) _log_diff_call /opt/stack/neutron/neutron/tests/unit/plugins/ml2/drivers/mechanism_logger.py:59}} May 28 12:55:57 l75lg1-v1 neutron-server[77618]: DEBUG neutron_lib.callbacks.manager [None req-77b1d9fb-45f5-48db-a3e5-f333f4c76eda admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4166243', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8754903016533', 'neutron.services.ovn_l3.plugin.OVNL3RouterPlugin._port_update-8754901907784'] for port (697c3f9b-2b19-40c6-ada6-113c7f2f97f3), after_update {{(pid=77618) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:55:57 l75lg1-v1 neutron-server[77618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b7b95f6f-272e-4bd8-adb7-98a20db0c8a4 None None] Pushing event updated for resources: {'Port': ['ID=697c3f9b-2b19-40c6-ada6-113c7f2f97f3,revision_number=2']} {{(pid=77618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 28 12:55:57 l75lg1-v1 dstat.sh[49771]: 28-05 12:55:57| 10 1 88 1 0|4829M 2704M 276M 7818M| 10k 172B| 0 1516k| 0 160 |3610 6054 |0.84 0.73 0.90|1.0 2.0 0| 0 0 | 0 2048M| 27 314 0 14 0 May 28 12:55:57 l75lg1-v1 neutron-server[77618]: DEBUG ovsdbapp.backend.ovs_idl.transaction [None req-c63b1acc-b5c6-4be8-9db9-04824fec27f2 None None] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=697c3f9b-2b19-40c6-ada6-113c7f2f97f3, resource={'id': '697c3f9b-2b19-40c6-ada6-113c7f2f97f3', 'name': '', 'network_id': '9aaf4bd9-9f34-40ad-a4e7-932bff23895a', 'tenant_id': '98a6a2dcbf0248d5b353760f7757f713', 'mac_address': 'fa:16:3e:0e:5c:95', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ovnmeta-9aaf4bd9-9f34-40ad-a4e7-932bff23895a', 'device_owner': 'network:distributed', 'standard_attr_id': 58, 'fixed_ips': [{'subnet_id': 'd5781979-4de3-490b-a4f1-017afe11a304', 'ip_address': '10.2.5.1'}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2024-05-28T12:55:51Z', 'updated_at': '2024-05-28T12:55:57Z', 'revision_number': 2, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'network': {'id': '9aaf4bd9-9f34-40ad-a4e7-932bff23895a', 'name': 'admin_net', 'tenant_id': '98a6a2dcbf0248d5b353760f7757f713', 'admin_state_up': True, 'mtu': 1442, 'status': 'ACTIVE', 'subnets': ['d5781979-4de3-490b-a4f1-017afe11a304'], 'standard_attr_id': 56, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'vlan_transparent': None, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2024-05-28T12:55:50Z', 'updated_at': '2024-05-28T12:55:56Z', 'revision_number': 2, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 32656}}, resource_type=ports, if_exists=True) {{(pid=77618) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:55:57 l75lg1-v1 neutron-server[77618]: DEBUG ovsdbapp.backend.ovs_idl.transaction [None req-c63b1acc-b5c6-4be8-9db9-04824fec27f2 None None] Running txn n=1 command(idx=1): AddDHCPOptionsCommand(_result=None, columns={'cidr': '10.2.5.0/24', 'options': {'server_id': '10.2.5.1', 'lease_time': '43200', 'mtu': '1442', 'server_mac': 'fa:16:3e:3e:ee:df', 'dns_server': '{127.0.0.53}', 'classless_static_route': '{169.254.169.254/32,10.2.5.1}'}, 'external_ids': {'subnet_id': 'd5781979-4de3-490b-a4f1-017afe11a304', 'neutron:revision_number': '0'}}, may_exist=True, subnet_id=d5781979-4de3-490b-a4f1-017afe11a304, port_id=None, new_insert=False) {{(pid=77618) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:55:57 l75lg1-v1 neutron-server[77618]: DEBUG ovsdbapp.backend.ovs_idl.transaction [None req-c63b1acc-b5c6-4be8-9db9-04824fec27f2 None None] Running txn n=1 command(idx=2): SetLSwitchPortCommand(_result=None, lport=697c3f9b-2b19-40c6-ada6-113c7f2f97f3, external_ids_update=None, columns={'external_ids': {'neutron:port_name': '', 'neutron:device_id': 'ovnmeta-9aaf4bd9-9f34-40ad-a4e7-932bff23895a', 'neutron:project_id': '98a6a2dcbf0248d5b353760f7757f713', 'neutron:cidrs': '10.2.5.1/24', 'neutron:device_owner': 'network:distributed', 'neutron:subnet_pool_addr_scope4': '', 'neutron:subnet_pool_addr_scope6': '', 'neutron:network_name': 'neutron-9aaf4bd9-9f34-40ad-a4e7-932bff23895a', 'neutron:security_group_ids': '', 'neutron:revision_number': '2', 'neutron:vnic_type': 'normal', 'neutron:port_capabilities': '', 'neutron:mtu': ''}, 'parent_name': [], 'tag': [], 'options': {}, 'enabled': True, 'port_security': [], 'dhcpv4_options': [], 'dhcpv6_options': [], 'type': 'localport', 'addresses': ['fa:16:3e:0e:5c:95 10.2.5.1'], 'ha_chassis_group': []}, if_exists=False) {{(pid=77618) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:55:57 l75lg1-v1 neutron-server[77618]: DEBUG ovsdbapp.backend.ovs_idl.transaction [None req-c63b1acc-b5c6-4be8-9db9-04824fec27f2 None None] Running txn n=1 command(idx=3): PgDelPortCommand(_result=None, port_group=neutron_pg_drop, lsp=['697c3f9b-2b19-40c6-ada6-113c7f2f97f3'], if_exists=False) {{(pid=77618) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:55:57 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-53cecb61-7023-41e4-a5ea-23b1eb02606a None None] Hash Ring: Node c89b3497-133e-4a5a-b67a-3310d2cb2485 (host: l75lg1-v1) handling event "update" for row 1d620e47-24ba-4564-ae82-dc3bfefa0442 (table: Logical_Switch_Port) {{(pid=77619) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:55:57 l75lg1-v1 neutron-server[77618]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-c63b1acc-b5c6-4be8-9db9-04824fec27f2 None None] Hash Ring: Node 4c6fc793-7f5a-456f-b4d6-6e5bd97592f2 (host: l75lg1-v1) handling event "create" for row 94959b07-bcd6-4d66-b78b-787c59b1d5b6 (table: DHCP_Options) {{(pid=77618) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:55:57 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-03b5f984-1478-4ad6-9838-8e34c1689c5b None None] Hash Ring: Node c89b3497-133e-4a5a-b67a-3310d2cb2485 (host: l75lg1-v1) handling event "update" for row 8be8a11a-9fe6-42e0-ac2d-449bf7a8ef24 (table: Port_Binding) {{(pid=77619) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:55:57 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched UPDATE: PortBindingUpdatedEvent(events=('update',), table='Port_Binding', conditions=None, old_conditions=None), priority=20 to row=Port_Binding(parent_port=[], mac=['fa:16:3e:0e:5c:95 10.2.5.1'], chassis=[], ha_chassis_group=[], options={}, type=localport, tag=[], requested_chassis=[], tunnel_key=1, up=[False], logical_port=697c3f9b-2b19-40c6-ada6-113c7f2f97f3, gateway_chassis=[], encap=[], external_ids={'neutron:cidrs': '10.2.5.1/24', 'neutron:device_id': 'ovnmeta-9aaf4bd9-9f34-40ad-a4e7-932bff23895a', 'neutron:device_owner': 'network:distributed', 'neutron:mtu': '', 'neutron:network_name': 'neutron-9aaf4bd9-9f34-40ad-a4e7-932bff23895a', 'neutron:port_capabilities': '', 'neutron:port_name': '', 'neutron:project_id': '98a6a2dcbf0248d5b353760f7757f713', 'neutron:revision_number': '2', 'neutron:security_group_ids': '', 'neutron:subnet_pool_addr_scope4': '', 'neutron:subnet_pool_addr_scope6': '', 'neutron:vnic_type': 'normal'}, virtual_parent=[], nat_addresses=[], datapath=9f58042b-d3de-4a35-b332-2827607743db) old=Port_Binding(mac=['fa:16:3e:0e:5c:95'], external_ids={'neutron:cidrs': '', 'neutron:device_id': 'ovnmeta-9aaf4bd9-9f34-40ad-a4e7-932bff23895a', 'neutron:device_owner': 'network:distributed', 'neutron:mtu': '', 'neutron:network_name': 'neutron-9aaf4bd9-9f34-40ad-a4e7-932bff23895a', 'neutron:port_capabilities': '', 'neutron:port_name': '', 'neutron:project_id': '98a6a2dcbf0248d5b353760f7757f713', 'neutron:revision_number': '1', 'neutron:security_group_ids': '', 'neutron:subnet_pool_addr_scope4': '', 'neutron:subnet_pool_addr_scope6': '', 'neutron:vnic_type': 'normal'}) {{(pid=76818) matches /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} May 28 12:55:57 l75lg1-v1 neutron-ovn-metadata-agent[76818]: INFO neutron.agent.ovn.metadata.agent [-] Metadata Port 697c3f9b-2b19-40c6-ada6-113c7f2f97f3 in datapath 9aaf4bd9-9f34-40ad-a4e7-932bff23895a updated May 28 12:55:57 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata.agent [-] No valid VIF ports were found for network 9aaf4bd9-9f34-40ad-a4e7-932bff23895a, tearing the namespace down if needed {{(pid=76818) _get_provision_params /opt/stack/neutron/neutron/agent/ovn/metadata/agent.py:720}} May 28 12:55:57 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo.privsep.daemon [-] privsep: reply[178654e2-2975-443d-bd92-7d3c0dc0aa38]: (4, False) {{(pid=79043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} May 28 12:55:57 l75lg1-v1 neutron-server[77618]: INFO neutron.db.ovn_revision_numbers_db [None req-77b1d9fb-45f5-48db-a3e5-f333f4c76eda admin admin] Successfully bumped revision number for resource 697c3f9b-2b19-40c6-ada6-113c7f2f97f3 (type: ports) to 2 May 28 12:55:57 l75lg1-v1 neutron-server[77618]: INFO neutron.tests.unit.plugins.ml2.drivers.mechanism_logger [None req-77b1d9fb-45f5-48db-a3e5-f333f4c76eda admin admin] update_port_postcommit called with port settings {'id': '697c3f9b-2b19-40c6-ada6-113c7f2f97f3', 'name': '', 'network_id': '9aaf4bd9-9f34-40ad-a4e7-932bff23895a', 'tenant_id': '98a6a2dcbf0248d5b353760f7757f713', 'mac_address': 'fa:16:3e:0e:5c:95', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ovnmeta-9aaf4bd9-9f34-40ad-a4e7-932bff23895a', 'device_owner': 'network:distributed', 'standard_attr_id': 58, 'fixed_ips': [{'subnet_id': 'd5781979-4de3-490b-a4f1-017afe11a304', 'ip_address': '10.2.5.1'}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2024-05-28T12:55:51Z', 'updated_at': '2024-05-28T12:55:57Z', 'revision_number': 2, 'project_id': '98a6a2dcbf0248d5b353760f7757f713'} (original settings {'id': '697c3f9b-2b19-40c6-ada6-113c7f2f97f3', 'name': '', 'network_id': '9aaf4bd9-9f34-40ad-a4e7-932bff23895a', 'tenant_id': '98a6a2dcbf0248d5b353760f7757f713', 'mac_address': 'fa:16:3e:0e:5c:95', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ovnmeta-9aaf4bd9-9f34-40ad-a4e7-932bff23895a', 'device_owner': 'network:distributed', 'standard_attr_id': 58, 'fixed_ips': [], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2024-05-28T12:55:51Z', 'updated_at': '2024-05-28T12:55:51Z', 'revision_number': 1, 'project_id': '98a6a2dcbf0248d5b353760f7757f713'}) host (original host ) vif type unbound (original vif type unbound) vif details {} (original vif details {}) binding levels None (original binding levels None) on network {'id': '9aaf4bd9-9f34-40ad-a4e7-932bff23895a', 'name': 'admin_net', 'tenant_id': '98a6a2dcbf0248d5b353760f7757f713', 'admin_state_up': True, 'mtu': 1442, 'status': 'ACTIVE', 'subnets': ['d5781979-4de3-490b-a4f1-017afe11a304'], 'standard_attr_id': 56, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'vlan_transparent': None, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2024-05-28T12:55:50Z', 'updated_at': '2024-05-28T12:55:56Z', 'revision_number': 2, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 32656} with segments to bind None May 28 12:55:57 l75lg1-v1 neutron-server[77618]: DEBUG neutron.tests.unit.plugins.ml2.drivers.mechanism_logger [None req-77b1d9fb-45f5-48db-a3e5-f333f4c76eda admin admin] update_port_postcommit: May 28 12:55:57 l75lg1-v1 neutron-server[77618]: key[fixed_ips], [] -> [{'subnet_id': 'd5781979-4de3-490b-a4f1-017afe11a304', 'ip_address': '10.2.5.1'}] May 28 12:55:57 l75lg1-v1 neutron-server[77618]: key[updated_at], 2024-05-28T12:55:51Z -> 2024-05-28T12:55:57Z May 28 12:55:57 l75lg1-v1 neutron-server[77618]: key[revision_number], 1 -> 2 May 28 12:55:57 l75lg1-v1 neutron-server[77618]: {{(pid=77618) _log_diff_call /opt/stack/neutron/neutron/tests/unit/plugins/ml2/drivers/mechanism_logger.py:59}} May 28 12:55:57 l75lg1-v1 neutron-server[77618]: DEBUG neutron.plugins.ml2.plugin [None req-77b1d9fb-45f5-48db-a3e5-f333f4c76eda admin admin] In _notify_port_updated(), no bound segment for port 697c3f9b-2b19-40c6-ada6-113c7f2f97f3 on network 9aaf4bd9-9f34-40ad-a4e7-932bff23895a {{(pid=77618) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:981}} May 28 12:55:57 l75lg1-v1 neutron-server[77618]: INFO neutron.db.ovn_revision_numbers_db [None req-77b1d9fb-45f5-48db-a3e5-f333f4c76eda admin admin] Successfully bumped revision number for resource d5781979-4de3-490b-a4f1-017afe11a304 (type: subnets) to 0 May 28 12:55:57 l75lg1-v1 neutron-server[77618]: INFO neutron.tests.unit.plugins.ml2.drivers.mechanism_logger [None req-77b1d9fb-45f5-48db-a3e5-f333f4c76eda admin admin] create_subnet_postcommit called with subnet settings {'id': 'd5781979-4de3-490b-a4f1-017afe11a304', 'name': 'admin_subnet', 'tenant_id': '98a6a2dcbf0248d5b353760f7757f713', 'network_id': '9aaf4bd9-9f34-40ad-a4e7-932bff23895a', 'ip_version': 4, 'subnetpool_id': None, 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'standard_attr_id': 59, 'gateway_ip': None, 'cidr': '10.2.5.0/24', 'allocation_pools': [{'start': '10.2.5.1', 'end': '10.2.5.254'}], 'host_routes': [], 'dns_nameservers': [], 'shared': False, 'description': '', 'service_types': [], 'tags': [], 'created_at': '2024-05-28T12:55:56Z', 'updated_at': '2024-05-28T12:55:56Z', 'revision_number': 0, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'network': {'id': '9aaf4bd9-9f34-40ad-a4e7-932bff23895a', 'name': 'admin_net', 'tenant_id': '98a6a2dcbf0248d5b353760f7757f713', 'admin_state_up': True, 'mtu': 1442, 'status': 'ACTIVE', 'subnets': ['d5781979-4de3-490b-a4f1-017afe11a304'], 'standard_attr_id': 56, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'vlan_transparent': None, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2024-05-28T12:55:50Z', 'updated_at': '2024-05-28T12:55:56Z', 'revision_number': 2, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 32656}} (original settings None) May 28 12:55:57 l75lg1-v1 neutron-server[77618]: DEBUG neutron.tests.unit.plugins.ml2.drivers.mechanism_logger [None req-77b1d9fb-45f5-48db-a3e5-f333f4c76eda admin admin] create_subnet_postcommit: May 28 12:55:57 l75lg1-v1 neutron-server[77618]: key[tenant_id], None -> 98a6a2dcbf0248d5b353760f7757f713 May 28 12:55:57 l75lg1-v1 neutron-server[77618]: key[network_id], None -> 9aaf4bd9-9f34-40ad-a4e7-932bff23895a May 28 12:55:57 l75lg1-v1 neutron-server[77618]: key[revision_number], None -> 0 May 28 12:55:57 l75lg1-v1 neutron-server[77618]: key[project_id], None -> 98a6a2dcbf0248d5b353760f7757f713 May 28 12:55:57 l75lg1-v1 neutron-server[77618]: key[id], None -> d5781979-4de3-490b-a4f1-017afe11a304 May 28 12:55:57 l75lg1-v1 neutron-server[77618]: key[tags], None -> [] May 28 12:55:57 l75lg1-v1 neutron-server[77618]: key[created_at], None -> 2024-05-28T12:55:56Z May 28 12:55:57 l75lg1-v1 neutron-server[77618]: key[allocation_pools], None -> [{'start': '10.2.5.1', 'end': '10.2.5.254'}] May 28 12:55:57 l75lg1-v1 neutron-server[77618]: key[subnetpool_id], None -> None May 28 12:55:57 l75lg1-v1 neutron-server[77618]: key[host_routes], None -> [] May 28 12:55:57 l75lg1-v1 neutron-server[77618]: key[gateway_ip], None -> None May 28 12:55:57 l75lg1-v1 neutron-server[77618]: key[service_types], None -> [] May 28 12:55:57 l75lg1-v1 neutron-server[77618]: key[updated_at], None -> 2024-05-28T12:55:56Z May 28 12:55:57 l75lg1-v1 neutron-server[77618]: key[network], None -> {'id': '9aaf4bd9-9f34-40ad-a4e7-932bff23895a', 'name': 'admin_net', 'tenant_id': '98a6a2dcbf0248d5b353760f7757f713', 'admin_state_up': True, 'mtu': 1442, 'status': 'ACTIVE', 'subnets': ['d5781979-4de3-490b-a4f1-017afe11a304'], 'standard_attr_id': 56, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'vlan_transparent': None, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2024-05-28T12:55:50Z', 'updated_at': '2024-05-28T12:55:56Z', 'revision_number': 2, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 32656} May 28 12:55:57 l75lg1-v1 neutron-server[77618]: key[standard_attr_id], None -> 59 May 28 12:55:57 l75lg1-v1 neutron-server[77618]: key[ip_version], None -> 4 May 28 12:55:57 l75lg1-v1 neutron-server[77618]: key[cidr], None -> 10.2.5.0/24 May 28 12:55:57 l75lg1-v1 neutron-server[77618]: key[dns_nameservers], None -> [] May 28 12:55:57 l75lg1-v1 neutron-server[77618]: key[ipv6_address_mode], None -> None May 28 12:55:57 l75lg1-v1 neutron-server[77618]: key[description], None -> May 28 12:55:57 l75lg1-v1 neutron-server[77618]: key[ipv6_ra_mode], None -> None May 28 12:55:57 l75lg1-v1 neutron-server[77618]: key[enable_dhcp], None -> True May 28 12:55:57 l75lg1-v1 neutron-server[77618]: key[shared], None -> False May 28 12:55:57 l75lg1-v1 neutron-server[77618]: key[name], None -> admin_subnet May 28 12:55:57 l75lg1-v1 neutron-server[77618]: {{(pid=77618) _log_diff_call /opt/stack/neutron/neutron/tests/unit/plugins/ml2/drivers/mechanism_logger.py:59}} May 28 12:55:57 l75lg1-v1 neutron-server[77618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-77b1d9fb-45f5-48db-a3e5-f333f4c76eda admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=77618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:258}} May 28 12:55:57 l75lg1-v1 neutron-server[77618]: DEBUG neutron_lib.callbacks.manager [None req-77b1d9fb-45f5-48db-a3e5-f333f4c76eda admin admin] Publish callbacks [] for subnet (None), before_response {{(pid=77618) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:55:57 l75lg1-v1 neutron-server[77618]: INFO neutron.wsgi [None req-77b1d9fb-45f5-48db-a3e5-f333f4c76eda admin admin] 10.27.203.238 "POST /networking/v2.0/subnets HTTP/1.1" status: 201 len: 805 time: 0.6428056 May 28 12:55:58 l75lg1-v1 dstat.sh[49771]: 28-05 12:55:58| 10 1 88 1 0|4804M 2729M 276M 7818M| 11k 3048B| 0 1880k| 0 156 |2777 4298 |0.84 0.73 0.90|2.0 0 23| 0 0 | 0 2048M| 27 312 0 15 0 May 28 12:55:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40891fa-2968-4e1d-a691-0b4ab7175a6f None None] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:55:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40891fa-2968-4e1d-a691-0b4ab7175a6f None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:55:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40891fa-2968-4e1d-a691-0b4ab7175a6f None None] PATH_INFO: `/` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:55:58 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 606/1198] 10.27.203.238 () {58 vars in 1014 bytes} [Tue May 28 12:55:58 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:55:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c175a68-1d14-4513-82cc-baa64391bbe1 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:55:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c175a68-1d14-4513-82cc-baa64391bbe1 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:55:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c175a68-1d14-4513-82cc-baa64391bbe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:55:58 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-9c175a68-1d14-4513-82cc-baa64391bbe1 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:55:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-9c175a68-1d14-4513-82cc-baa64391bbe1 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:55:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-9c175a68-1d14-4513-82cc-baa64391bbe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:55:58 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 593/1199] 10.27.203.238 () {62 vars in 1111 bytes} [Tue May 28 12:55:58 2024] POST /identity/v3/auth/tokens => generated 3991 bytes in 23 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:55:58 l75lg1-v1 neutron-server[77619]: DEBUG neutron.wsgi [-] (77619) accepted ('10.27.203.238', 49128) {{(pid=77619) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 12:55:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40891fa-2968-4e1d-a691-0b4ab7175a6f None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:55:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40891fa-2968-4e1d-a691-0b4ab7175a6f None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:55:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d0408a-b75b-40d4-a81f-4e43f289a160 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef17047035e4b518fd5360a01f2da1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:55:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d0408a-b75b-40d4-a81f-4e43f289a160 service neutron] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:55:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d0408a-b75b-40d4-a81f-4e43f289a160 service neutron] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:55:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d0408a-b75b-40d4-a81f-4e43f289a160 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:55:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d0408a-b75b-40d4-a81f-4e43f289a160 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:55:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d0408a-b75b-40d4-a81f-4e43f289a160 service neutron] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:55:58 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 607/1200] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 12:55:58 2024] GET /identity/v3/auth/tokens => generated 3991 bytes in 21 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 12:55:59 l75lg1-v1 neutron-server[77619]: INFO neutron.pecan_wsgi.hooks.translation [None req-dccab9ef-ffb4-4664-bf5d-0eb5a8924812 admin admin] GET failed (client error): The resource could not be found. May 28 12:55:59 l75lg1-v1 neutron-server[77619]: INFO neutron.wsgi [None req-dccab9ef-ffb4-4664-bf5d-0eb5a8924812 admin admin] 10.27.203.238 "GET /networking/v2.0/subnets/admin_subnet HTTP/1.1" status: 404 len: 318 time: 0.0413361 May 28 12:55:59 l75lg1-v1 neutron-server[77619]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2d65e55d-9e2c-4978-b988-b39f4a5133ac admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=77619) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:258}} May 28 12:55:59 l75lg1-v1 neutron-server[77619]: INFO neutron.wsgi [None req-2d65e55d-9e2c-4978-b988-b39f4a5133ac admin admin] 10.27.203.238 "GET /networking/v2.0/subnets?name=admin_subnet HTTP/1.1" status: 200 len: 803 time: 0.0354953 May 28 12:55:59 l75lg1-v1 dstat.sh[49771]: 28-05 12:55:59| 10 1 89 0 0|4770M 2763M 276M 7818M|9243B 618B| 0 0 | 0 0 |1822 2539 |0.84 0.73 0.90|2.0 0 8.0| 0 0 | 0 2048M| 27 312 0 16 0 May 28 12:56:00 l75lg1-v1 dstat.sh[49771]: 28-05 12:56:00| 3 9 87 0 0|4782M 2751M 276M 7819M| 24k 32k| 0 196k| 0 29.0 |5753 6649 |0.84 0.73 0.90|1.0 0 505| 0 0 | 0 2048M| 27 312 0 16 0 May 28 12:56:00 l75lg1-v1 neutron-server[77618]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.HashRingHealthCheckPeriodics.touch_hash_ring_nodes' {{(pid=77618) _process_scheduled /opt/stack/data/venv/lib/python3.10/site-packages/futurist/periodics.py:638}} May 28 12:56:01 l75lg1-v1 nova-conductor[83648]: DEBUG dbcounter [-] [83648] Writing DB stats nova_cell1:SELECT=3 {{(pid=83648) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:56:01 l75lg1-v1 dstat.sh[49771]: 28-05 12:56:01| 8 6 85 0 0|4794M 2739M 276M 7819M| 12k 4243B| 104k 240k|26.0 25.0 |7469 11k|0.84 0.73 0.90|1.0 0 169| 0 0 | 0 2048M| 27 312 0 16 0 May 28 12:56:02 l75lg1-v1 dstat.sh[49771]: 28-05 12:56:02| 14 8 77 0 0|4836M 2697M 276M 7819M| 17k 21k| 0 288k| 0 19.0 |7046 8741 |0.93 0.75 0.91|7.0 0 392| 0 0 | 0 2048M| 27 312 0 16 0 May 28 12:56:02 l75lg1-v1 devstack@placement-api.service[78202]: DEBUG dbcounter [-] [78202] Writing DB stats placement:SELECT=8 {{(pid=78202) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:56:02 l75lg1-v1 devstack@placement-api.service[78201]: DEBUG dbcounter [-] [78201] Writing DB stats placement:SELECT=6 {{(pid=78201) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=95722) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=95722) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=95722) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: INFO oslo_service.periodic_task [-] Skipping periodic task update_share_usage_size because it is disabled May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_concurrency.lockutils [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] Acquiring lock "instantiate_neutron_api" by "manila.network.neutron.neutron_network_plugin.NeutronNetworkPlugin.neutron_api" {{(pid=95722) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_concurrency.lockutils [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] Lock "instantiate_neutron_api" acquired by "manila.network.neutron.neutron_network_plugin.NeutronNetworkPlugin.neutron_api" :: waited 0.001s {{(pid=95722) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_concurrency.lockutils [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] Lock "instantiate_neutron_api" "released" by "manila.network.neutron.neutron_network_plugin.NeutronNetworkPlugin.neutron_api" :: held 0.001s {{(pid=95722) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: INFO oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] Starting 1 workers May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] Started child 96150 {{(pid=95722) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:579}} May 28 12:56:02 l75lg1-v1 manila-share[96150]: INFO manila.service [-] Starting manila-share node (version 18.1.0) May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_concurrency.lockutils [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] Acquiring lock "instantiate_neutron_api" by "manila.network.neutron.neutron_network_plugin.NeutronNetworkPlugin.neutron_api" {{(pid=95722) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:56:02 l75lg1-v1 manila-share[96150]: DEBUG oslo_db.api [None req-6022b604-d44b-429a-b4ab-92e16635bedf None None] Loading backend 'sqlalchemy' from 'manila.db.sqlalchemy.api' {{(pid=96150) _load_backend /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/api.py:259}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_concurrency.lockutils [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] Lock "instantiate_neutron_api" acquired by "manila.network.neutron.neutron_network_plugin.NeutronNetworkPlugin.neutron_api" :: waited 0.001s {{(pid=95722) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_concurrency.lockutils [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] Lock "instantiate_neutron_api" "released" by "manila.network.neutron.neutron_network_plugin.NeutronNetworkPlugin.neutron_api" :: held 0.002s {{(pid=95722) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: INFO oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] Starting 1 workers May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] Started child 96151 {{(pid=95722) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:579}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] Full set of CONF: {{(pid=95722) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:653}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] ******************************************************************************** {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2600}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] Configuration options gathered from: {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2601}} May 28 12:56:02 l75lg1-v1 manila-share[96151]: INFO manila.service [-] Starting manila-share node (version 18.1.0) May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] command line args: ['--config-file', '/etc/manila/manila.conf'] {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] config files: ['/etc/manila/manila.conf'] {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2603}} May 28 12:56:02 l75lg1-v1 manila-share[96151]: DEBUG oslo_db.api [None req-2cf6ab01-c9ac-4126-b67e-f98b4a543484 None None] Loading backend 'sqlalchemy' from 'manila.db.sqlalchemy.api' {{(pid=96151) _load_backend /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/api.py:259}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] ================================================================================ {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2605}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] admin_network_config_group = None {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] admin_only_metadata = ['__affinity_same_host', '__affinity_different_host'] {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] api_rate_limit = True {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] auth_strategy = keystone {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] automatic_share_server_cleanup = True {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] backend_availability_zone = None {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] check_for_expired_shares_in_recycle_bin_interval = 3600 {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] check_for_expired_transfers = 300 {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] cinder_volume_type = None {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] cleanup_interval = 1800 {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] compute_api_class = manila.compute.nova.API {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] config_dir = [] {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] config_file = ['/etc/manila/manila.conf'] {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] config_source = [] {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] control_exchange = openstack {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] data_manager = manila.data.manager.DataManager {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] data_topic = manila-data {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] db_backend = sqlalchemy {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] db_driver = manila.db {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] debug = True {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] default_share_group_type = default {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] default_share_type = default {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] delete_share_server_with_last_share = False {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] driver_backup_continue_update_interval = 60 {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] driver_handles_share_servers = None {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] driver_restore_continue_update_interval = 60 {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] enable_gathering_share_usage_size = False {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] enable_new_services = True {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] enable_periodic_hooks = False {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] enable_post_hooks = False {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] enable_pre_hooks = False {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] enabled_share_backends = ['generic1', 'generic2'] {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] enabled_share_protocols = ['NFS', 'CIFS'] {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] fatal_exception_format_errors = False {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] filter_function = None {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] ganesha_config_dir = /etc/ganesha {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] ganesha_config_path = /etc/ganesha/ganesha.conf {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] ganesha_db_path = /opt/stack/data/manila/manila-ganesha.db {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] ganesha_export_dir = /etc/ganesha/export.d {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] ganesha_export_template_dir = /etc/manila/ganesha-export-templ.d {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] ganesha_rados_export_counter = ganesha-export-counter {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] ganesha_rados_export_index = ganesha-export-index {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] ganesha_rados_store_enable = False {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] ganesha_rados_store_pool_name = None {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] ganesha_service_name = ganesha.nfsd {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] goodness_function = None {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] graceful_shutdown_timeout = 60 {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] hook_drivers = [] {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] host = l75lg1-v1 {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] image_api_class = manila.image.glance.API {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] instance_format = [instance: %(uuid)s] {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] is_deferred_deletion_enabled = False {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] log_config_append = None {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] log_dir = None {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] log_file = None {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] log_options = True {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] log_rotate_interval = 1 {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] log_rotate_interval_type = days {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] log_rotation_type = none {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] max_logfile_count = 30 {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] max_logfile_size_mb = 200 {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] max_over_subscription_ratio = 20.0 {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] max_share_server_size = -1 {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] max_shares_per_share_server = -1 {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] max_time_to_attach = 120 {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] max_time_to_create_volume = 180 {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] max_time_to_extend_volume = 180 {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] message_reap_interval = 86400 {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] message_ttl = 2592000 {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] migration_create_delete_share_timeout = 300 {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] migration_driver_continue_update_interval = 60 {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] migration_ignore_files = ['lost+found'] {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] migration_wait_access_rules_timeout = 180 {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] monkey_patch = False {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] monkey_patch_modules = [] {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] my_ip = 10.27.203.238 {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] network_config_group = None {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] num_shell_tries = 3 {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] osapi_max_limit = 1000 {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] osapi_share_base_URL = None {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] osapi_share_ext_list = [] {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] osapi_share_extension = ['manila.api.contrib.standard_extensions'] {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] osapi_share_listen = :: {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] osapi_share_listen_port = 8786 {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] osapi_share_use_ssl = False {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] osapi_share_workers = 1 {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] periodic_deferred_delete_interval = 10 {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] periodic_fuzzy_delay = 60 {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] periodic_hooks_interval = 300.0 {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] periodic_interval = 60 {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] project_id_regex = [0-9a-f\-]+ {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] protocol_access_mapping = {'ip': ['nfs'], 'user': ['cifs']} {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] publish_errors = False {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] rate_limit_burst = 0 {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] rate_limit_except_level = CRITICAL {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] rate_limit_interval = 0 {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] replica_state_update_interval = 300 {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] replication_domain = None {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] report_interval = 10 {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] reserved_share_extend_percentage = 0 {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] reserved_share_from_snapshot_percentage = 0 {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] reserved_share_percentage = 0 {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] rootwrap_config = /etc/manila/rootwrap.conf {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] rpc_response_timeout = 60 {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] run_external_periodic_tasks = True {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] scheduler_manager = manila.scheduler.manager.SchedulerManager {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] scheduler_topic = manila-scheduler {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] server_migration_driver_continue_update_interval = 900 {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] service_down_time = 60 {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] service_instance_smb_config_path = /shares/smb.conf {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] share_api_class = manila.share.api.API {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] share_backend_name = None {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] share_backup_name_template = share-backup-%s {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] share_driver = manila.share.drivers.generic.GenericShareDriver {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] share_helpers = ['CIFS=manila.share.drivers.helpers.CIFSHelperIPAccess', 'NFS=manila.share.drivers.helpers.NFSHelper'] {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] share_manager = manila.share.manager.ShareManager {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] share_mount_path = /shares {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] share_mount_template = mount -vt %(proto)s %(options)s %(export)s %(path)s {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] share_name_template = share-%s {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] share_service_inithost_offload = False {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] share_snapshot_name_template = share-snapshot-%s {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] share_topic = manila-share {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] share_transfer_key_length = 16 {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] share_transfer_salt_length = 8 {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] share_unmount_template = umount -v %(path)s {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] share_usage_size_update_interval = 300 {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] share_volume_fstype = ext4 {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] smb_template_config_path = /opt/stack/data/manila/smb.conf {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] soft_deleted_share_retention_time = 604800 {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] ssh_conn_timeout = 60 {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] ssh_max_pool_conn = 10 {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] ssh_min_pool_conn = 1 {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] state_path = /opt/stack/data/manila {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] storage_availability_zone = nova {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] suppress_post_hooks_errors = False {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] suppress_pre_hooks_errors = False {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] syslog_log_facility = LOG_USER {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] transfer_retention_time = 300 {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] transport_url = **** {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] unmanage_remove_access_rules = False {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] unused_share_server_cleanup_interval = 10 {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] use_eventlog = False {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] use_journal = False {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] use_json = False {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] use_scheduler_creating_share_from_snapshot = False {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] use_stderr = False {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] use_syslog = False {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] volume_api_class = manila.volume.cinder.API {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] volume_name_template = manila-share-%s {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] volume_snapshot_name_template = manila-snapshot-%s {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] watch_log_file = False {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] oslo_concurrency.disable_process_locking = False {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] oslo_concurrency.lock_path = /opt/stack/manila/manila_locks {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] oslo_messaging_metrics.metrics_process_name = {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] oslo_policy.enforce_new_defaults = False {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] oslo_policy.enforce_scope = False {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] oslo_policy.policy_default_rule = default {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] oslo_policy.policy_file = policy.yaml {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] coordination.backend_url = **** {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] database.backend = sqlalchemy {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] database.connection = **** {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] database.connection_debug = 0 {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] database.connection_parameters = {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] database.connection_recycle_time = 3600 {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] database.connection_trace = False {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] database.db_inc_retry_interval = True {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] database.db_max_retries = 20 {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] database.db_max_retry_interval = 10 {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] database.db_retry_interval = 1 {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] database.max_overflow = 50 {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] database.max_pool_size = 40 {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] database.max_retries = 10 {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] database.mysql_sql_mode = TRADITIONAL {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] database.mysql_wsrep_sync_wait = None {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] database.pool_timeout = None {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] database.retry_interval = 10 {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] database.slave_connection = **** {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] database.sqlite_synchronous = True {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] database.use_db_reconnect = False {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] profiler.connection_string = messaging:// {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] profiler.enabled = False {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] profiler.es_doc_type = notification {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] profiler.es_scroll_size = 10000 {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] profiler.es_scroll_time = 2m {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] profiler.filter_error_trace = False {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] profiler.hmac_keys = **** {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] profiler.sentinel_service_name = mymaster {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] profiler.socket_timeout = 0.1 {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] profiler.trace_requests = False {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] profiler.trace_sqlalchemy = False {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] profiler_jaeger.process_tags = {} {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] profiler_jaeger.service_name_prefix = None {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] profiler_otlp.service_name_prefix = None {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] oslo_reports.file_event_handler = None {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] oslo_reports.file_event_handler_interval = 1 {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] oslo_reports.log_dir = None {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] oslo_messaging_rabbit.hostname = l75lg1-v1 {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] oslo_messaging_rabbit.processname = manila-share {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] oslo_messaging_rabbit.ssl = False {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] oslo_messaging_rabbit.ssl_version = {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] oslo_messaging_notifications.driver = [] {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] oslo_messaging_notifications.retry = -1 {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] oslo_messaging_notifications.transport_url = **** {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] quota.backup_gigabytes = 1000 {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] quota.backups = 10 {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] quota.driver = manila.quota.DbQuotaDriver {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] quota.gigabytes = 1000 {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] quota.max_age = 0 {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] quota.per_share_gigabytes = -1 {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] quota.replica_gigabytes = 1000 {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] quota.reservation_expire = 86400 {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] quota.share_group_snapshots = 50 {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] quota.share_groups = 50 {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] quota.share_networks = 10 {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] quota.share_replicas = 100 {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] quota.shares = 50 {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] quota.snapshot_gigabytes = 1000 {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] quota.snapshots = 50 {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] quota.until_refresh = 0 {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] generic1.admin_network_config_group = None {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] generic1.admin_network_id = 9aaf4bd9-9f34-40ad-a4e7-932bff23895a {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] generic1.admin_subnet_id = d5781979-4de3-490b-a4f1-017afe11a304 {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] generic1.automatic_share_server_cleanup = True {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] generic1.backend_availability_zone = None {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] generic1.check_for_expired_shares_in_recycle_bin_interval = 3600 {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] generic1.check_for_expired_transfers = 300 {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] generic1.cinder_volume_type = None {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] generic1.connect_share_server_to_tenant_network = False {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] generic1.delete_share_server_with_last_share = False {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] generic1.driver_backup_continue_update_interval = 60 {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] generic1.driver_handles_share_servers = True {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] generic1.driver_restore_continue_update_interval = 60 {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] generic1.drivers_private_storage_class = manila.share.drivers_private_data.SqlStorageDriver {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] generic1.enable_gathering_share_usage_size = False {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] generic1.filter_function = None {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] generic1.goodness_function = None {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] generic1.hook_drivers = [] {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] generic1.interface_driver = manila.network.linux.interface.OVSInterfaceDriver {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] generic1.limit_ssh_access = False {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] generic1.manila_service_keypair_name = manila-service {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] generic1.max_over_subscription_ratio = 20.0 {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] generic1.max_share_server_size = -1 {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] generic1.max_shares_per_share_server = -1 {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] generic1.max_time_to_attach = 120 {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] generic1.max_time_to_build_instance = 300 {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] generic1.max_time_to_create_volume = 180 {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] generic1.max_time_to_extend_volume = 180 {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] generic1.migration_driver_continue_update_interval = 60 {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] generic1.migration_ignore_files = ['lost+found'] {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] generic1.network_api_class = manila.network.neutron.neutron_network_plugin.NeutronNetworkPlugin {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] generic1.network_config_group = None {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] generic1.network_plugin_ipv4_enabled = True {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] generic1.network_plugin_ipv6_enabled = False {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] generic1.neutron_physical_net_name = None {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] generic1.num_shell_tries = 3 {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] generic1.path_to_private_key = /home/vastdata/.ssh/id_ecdsa {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] generic1.path_to_public_key = /home/vastdata/.ssh/id_ecdsa.pub {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] generic1.periodic_deferred_delete_interval = 300 {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] generic1.protocol_access_mapping = {'ip': ['nfs'], 'user': ['cifs']} {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] generic1.replica_state_update_interval = 300 {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] generic1.replication_domain = None {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] generic1.reserved_share_extend_percentage = 0 {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] generic1.reserved_share_from_snapshot_percentage = 0 {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] generic1.reserved_share_percentage = 0 {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] generic1.server_migration_driver_continue_update_interval = 900 {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] generic1.service_image_name = manila-service-image-master {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] generic1.service_instance_flavor_id = 100 {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] generic1.service_instance_name_template = %s {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] generic1.service_instance_password = **** {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] generic1.service_instance_security_group = manila-service {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] generic1.service_instance_smb_config_path = /shares/smb.conf {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] generic1.service_instance_user = manila {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] generic1.service_network_cidr = 10.254.0.0/16 {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] generic1.service_network_division_mask = 28 {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] generic1.service_network_host = None {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] generic1.service_network_name = manila_service_network {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] generic1.share_backend_name = GENERIC1 {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] generic1.share_driver = manila.share.drivers.generic.GenericShareDriver {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] generic1.share_helpers = ['CIFS=manila.share.drivers.helpers.CIFSHelperIPAccess', 'NFS=manila.share.drivers.helpers.NFSHelper'] {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] generic1.share_mount_path = /shares {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] generic1.share_mount_template = mount -vt %(proto)s %(options)s %(export)s %(path)s {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] generic1.share_service_inithost_offload = False {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] generic1.share_unmount_template = umount -v %(path)s {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] generic1.share_usage_size_update_interval = 300 {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] generic1.share_volume_fstype = ext4 {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] generic1.smb_template_config_path = /opt/stack/data/manila/smb.conf {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] generic1.ssh_conn_timeout = 180 {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] generic1.ssh_max_pool_conn = 10 {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] generic1.ssh_min_pool_conn = 1 {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] generic1.unmanage_remove_access_rules = False {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] generic1.unused_share_server_cleanup_interval = 10 {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] generic1.volume_name_template = manila-share-%s {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] generic1.volume_snapshot_name_template = manila-snapshot-%s {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] neutron.auth_section = None {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] neutron.auth_strategy = keystone {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] neutron.auth_type = password {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] neutron.cafile = /opt/stack/data/ca-bundle.pem {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] neutron.certfile = None {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] neutron.collect_timing = False {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] neutron.endpoint_type = publicURL {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] neutron.insecure = False {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] neutron.keyfile = None {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] neutron.region_name = None {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] neutron.split_loggers = False {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] neutron.timeout = None {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] neutron.url = None {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] neutron.url_timeout = 30 {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] glance.api_microversion = 2 {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] glance.auth_section = None {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] glance.auth_type = password {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] glance.certfile = None {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] glance.collect_timing = False {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] glance.endpoint_type = publicURL {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:02 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] glance.insecure = False {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:03 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] glance.keyfile = None {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:03 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] glance.region_name = RegionOne {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:03 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] glance.split_loggers = False {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:03 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] glance.timeout = None {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:03 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] nova.api_microversion = 2.10 {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:03 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] nova.auth_section = None {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:03 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] nova.auth_type = password {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:03 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:03 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] nova.certfile = None {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:03 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] nova.collect_timing = False {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:03 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] nova.endpoint_type = publicURL {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:03 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] nova.insecure = False {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:03 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] nova.keyfile = None {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:03 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] nova.region_name = None {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:03 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] nova.split_loggers = False {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:03 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] nova.timeout = None {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:03 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] generic2.admin_network_config_group = None {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:03 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] generic2.admin_network_id = 9aaf4bd9-9f34-40ad-a4e7-932bff23895a {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:03 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] generic2.admin_subnet_id = d5781979-4de3-490b-a4f1-017afe11a304 {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:03 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] generic2.automatic_share_server_cleanup = True {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:03 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] generic2.backend_availability_zone = None {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:03 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] generic2.check_for_expired_shares_in_recycle_bin_interval = 3600 {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:03 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] generic2.check_for_expired_transfers = 300 {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:03 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] generic2.cinder_volume_type = None {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:03 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] generic2.connect_share_server_to_tenant_network = False {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:03 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] generic2.delete_share_server_with_last_share = False {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:03 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] generic2.driver_backup_continue_update_interval = 60 {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:03 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] generic2.driver_handles_share_servers = True {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:03 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] generic2.driver_restore_continue_update_interval = 60 {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:03 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] generic2.drivers_private_storage_class = manila.share.drivers_private_data.SqlStorageDriver {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:03 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] generic2.enable_gathering_share_usage_size = False {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:03 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] generic2.filter_function = None {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:03 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] generic2.goodness_function = None {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:03 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] generic2.hook_drivers = [] {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:03 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] generic2.interface_driver = manila.network.linux.interface.OVSInterfaceDriver {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:03 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] generic2.limit_ssh_access = False {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:03 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] generic2.manila_service_keypair_name = manila-service {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:03 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] generic2.max_over_subscription_ratio = 20.0 {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:03 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] generic2.max_share_server_size = -1 {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:03 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] generic2.max_shares_per_share_server = -1 {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:03 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] generic2.max_time_to_attach = 120 {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:03 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] generic2.max_time_to_build_instance = 300 {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:03 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] generic2.max_time_to_create_volume = 180 {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:03 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] generic2.max_time_to_extend_volume = 180 {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:03 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] generic2.migration_driver_continue_update_interval = 60 {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:03 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] generic2.migration_ignore_files = ['lost+found'] {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:03 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] generic2.network_api_class = manila.network.neutron.neutron_network_plugin.NeutronNetworkPlugin {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:03 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] generic2.network_config_group = None {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:03 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] generic2.network_plugin_ipv4_enabled = True {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:03 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] generic2.network_plugin_ipv6_enabled = False {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:03 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] generic2.neutron_physical_net_name = None {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:03 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] generic2.num_shell_tries = 3 {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:03 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] generic2.path_to_private_key = /home/vastdata/.ssh/id_ecdsa {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:03 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] generic2.path_to_public_key = /home/vastdata/.ssh/id_ecdsa.pub {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:03 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] generic2.periodic_deferred_delete_interval = 300 {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:03 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] generic2.protocol_access_mapping = {'ip': ['nfs'], 'user': ['cifs']} {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:03 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] generic2.replica_state_update_interval = 300 {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:03 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] generic2.replication_domain = None {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:03 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] generic2.reserved_share_extend_percentage = 0 {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:03 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] generic2.reserved_share_from_snapshot_percentage = 0 {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:03 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] generic2.reserved_share_percentage = 0 {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:03 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] generic2.server_migration_driver_continue_update_interval = 900 {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:03 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] generic2.service_image_name = manila-service-image-master {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:03 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] generic2.service_instance_flavor_id = 100 {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:03 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] generic2.service_instance_name_template = %s {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:03 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] generic2.service_instance_password = **** {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:03 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] generic2.service_instance_security_group = manila-service {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:03 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] generic2.service_instance_smb_config_path = /shares/smb.conf {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:03 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] generic2.service_instance_user = manila {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:03 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] generic2.service_network_cidr = 10.254.0.0/16 {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:03 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] generic2.service_network_division_mask = 28 {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:03 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] generic2.service_network_host = None {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:03 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] generic2.service_network_name = manila_service_network {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:03 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] generic2.share_backend_name = GENERIC2 {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:03 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] generic2.share_driver = manila.share.drivers.generic.GenericShareDriver {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:03 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] generic2.share_helpers = ['CIFS=manila.share.drivers.helpers.CIFSHelperIPAccess', 'NFS=manila.share.drivers.helpers.NFSHelper'] {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:03 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] generic2.share_mount_path = /shares {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:03 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] generic2.share_mount_template = mount -vt %(proto)s %(options)s %(export)s %(path)s {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:03 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] generic2.share_service_inithost_offload = False {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:03 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] generic2.share_unmount_template = umount -v %(path)s {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:03 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] generic2.share_usage_size_update_interval = 300 {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:03 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] generic2.share_volume_fstype = ext4 {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:03 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] generic2.smb_template_config_path = /opt/stack/data/manila/smb.conf {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:03 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] generic2.ssh_conn_timeout = 180 {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:03 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] generic2.ssh_max_pool_conn = 10 {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:03 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] generic2.ssh_min_pool_conn = 1 {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:03 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] generic2.unmanage_remove_access_rules = False {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:03 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] generic2.unused_share_server_cleanup_interval = 10 {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:03 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] generic2.volume_name_template = manila-share-%s {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:03 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] generic2.volume_snapshot_name_template = manila-snapshot-%s {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:03 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] ******************************************************************************** {{(pid=95722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2624}} May 28 12:56:03 l75lg1-v1 manila-share[96151]: DEBUG passlib.utils.compat [None req-2cf6ab01-c9ac-4126-b67e-f98b4a543484 None None] loaded lazy attr 'SafeConfigParser': {{(pid=96151) __getattr__ /opt/stack/data/venv/lib/python3.10/site-packages/passlib/utils/compat/__init__.py:449}} May 28 12:56:03 l75lg1-v1 manila-share[96151]: DEBUG passlib.utils.compat [None req-2cf6ab01-c9ac-4126-b67e-f98b4a543484 None None] loaded lazy attr 'NativeStringIO': {{(pid=96151) __getattr__ /opt/stack/data/venv/lib/python3.10/site-packages/passlib/utils/compat/__init__.py:449}} May 28 12:56:03 l75lg1-v1 manila-share[96151]: DEBUG passlib.utils.compat [None req-2cf6ab01-c9ac-4126-b67e-f98b4a543484 None None] loaded lazy attr 'BytesIO': {{(pid=96151) __getattr__ /opt/stack/data/venv/lib/python3.10/site-packages/passlib/utils/compat/__init__.py:449}} May 28 12:56:03 l75lg1-v1 manila-share[96150]: DEBUG passlib.utils.compat [None req-6022b604-d44b-429a-b4ab-92e16635bedf None None] loaded lazy attr 'SafeConfigParser': {{(pid=96150) __getattr__ /opt/stack/data/venv/lib/python3.10/site-packages/passlib/utils/compat/__init__.py:449}} May 28 12:56:03 l75lg1-v1 manila-share[96150]: DEBUG passlib.utils.compat [None req-6022b604-d44b-429a-b4ab-92e16635bedf None None] loaded lazy attr 'NativeStringIO': {{(pid=96150) __getattr__ /opt/stack/data/venv/lib/python3.10/site-packages/passlib/utils/compat/__init__.py:449}} May 28 12:56:03 l75lg1-v1 manila-share[96150]: DEBUG passlib.utils.compat [None req-6022b604-d44b-429a-b4ab-92e16635bedf None None] loaded lazy attr 'BytesIO': {{(pid=96150) __getattr__ /opt/stack/data/venv/lib/python3.10/site-packages/passlib/utils/compat/__init__.py:449}} May 28 12:56:03 l75lg1-v1 dstat.sh[49771]: 28-05 12:56:03| 22 8 69 0 0|4955M 2576M 277M 7820M| 19k 11k| 104k 876k|26.0 52.0 |7583 11k|0.93 0.75 0.91|4.0 0 168| 0 0 | 0 2048M| 27 312 0 16 0 May 28 12:56:03 l75lg1-v1 manila-share[96151]: INFO dbcounter [None req-2cf6ab01-c9ac-4126-b67e-f98b4a543484 None None] Registered counter for database manila May 28 12:56:03 l75lg1-v1 manila-share[96151]: DEBUG oslo_db.sqlalchemy.engines [None req-2cf6ab01-c9ac-4126-b67e-f98b4a543484 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=96151) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:342}} May 28 12:56:03 l75lg1-v1 manila-share[96150]: INFO dbcounter [None req-6022b604-d44b-429a-b4ab-92e16635bedf None None] Registered counter for database manila May 28 12:56:03 l75lg1-v1 manila-share[96150]: DEBUG oslo_db.sqlalchemy.engines [None req-6022b604-d44b-429a-b4ab-92e16635bedf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=96150) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:342}} May 28 12:56:03 l75lg1-v1 manila-share[96151]: DEBUG dbcounter [-] [96151] Writer thread running {{(pid=96151) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} May 28 12:56:03 l75lg1-v1 manila-share[96150]: DEBUG dbcounter [-] [96150] Writer thread running {{(pid=96150) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR oslo_service.service [None req-6022b604-d44b-429a-b4ab-92e16635bedf None None] Error starting thread.: oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'nova-False' for key 'availability_zones.az_name_uc'") May 28 12:56:03 l75lg1-v1 manila-share[96150]: [SQL: INSERT INTO availability_zones (id, deleted, name, created_at, updated_at, deleted_at) VALUES (%(id)s, %(deleted)s, %(name)s, %(created_at)s, %(updated_at)s, %(deleted_at)s)] May 28 12:56:03 l75lg1-v1 manila-share[96150]: [parameters: {'id': 'c5ec5845-9c50-4cca-a99a-56b044c45220', 'deleted': 'False', 'name': 'nova', 'created_at': datetime.datetime(2024, 5, 28, 12, 56, 3, 590975), 'updated_at': None, 'deleted_at': None}] May 28 12:56:03 l75lg1-v1 manila-share[96150]: (Background on this error at: https://sqlalche.me/e/20/gkpj) May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR oslo_service.service Traceback (most recent call last): May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR oslo_service.service File "/opt/stack/manila/manila/service.py", line 146, in start May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR oslo_service.service service_ref = db.service_get_by_args(ctxt, May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR oslo_service.service File "/opt/stack/manila/manila/db/api.py", line 122, in service_get_by_args May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR oslo_service.service return IMPL.service_get_by_args(context, host, binary) May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR oslo_service.service File "/opt/stack/manila/manila/db/sqlalchemy/api.py", line 148, in wrapper May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR oslo_service.service return f(*args, **kwargs) May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR oslo_service.service File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/enginefacade.py", line 998, in wrapper May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR oslo_service.service return fn(*args, **kwargs) May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR oslo_service.service File "/opt/stack/manila/manila/db/sqlalchemy/api.py", line 662, in service_get_by_args May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR oslo_service.service raise exception.HostBinaryNotFound(host=host, binary=binary) May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR oslo_service.service manila.exception.HostBinaryNotFound: Could not find binary manila-share on host l75lg1-v1@generic1. May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR oslo_service.service May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR oslo_service.service During handling of the above exception, another exception occurred: May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR oslo_service.service May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR oslo_service.service Traceback (most recent call last): May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR oslo_service.service File "/opt/stack/manila/manila/db/sqlalchemy/api.py", line 6210, in _availability_zone_create_if_not_exist May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR oslo_service.service return _availability_zone_get(context, name) May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR oslo_service.service File "/opt/stack/manila/manila/db/sqlalchemy/api.py", line 166, in wrapper May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR oslo_service.service return f(*args, **kwargs) May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR oslo_service.service File "/opt/stack/manila/manila/db/sqlalchemy/api.py", line 6201, in _availability_zone_get May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR oslo_service.service raise exception.AvailabilityZoneNotFound(id=id_or_name) May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR oslo_service.service manila.exception.AvailabilityZoneNotFound: Availability zone nova could not be found. May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR oslo_service.service May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR oslo_service.service During handling of the above exception, another exception occurred: May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR oslo_service.service May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR oslo_service.service Traceback (most recent call last): May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR oslo_service.service File "/opt/stack/data/venv/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1967, in _exec_single_context May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR oslo_service.service self.dialect.do_execute( May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR oslo_service.service File "/opt/stack/data/venv/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 924, in do_execute May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR oslo_service.service cursor.execute(statement, parameters) May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR oslo_service.service File "/opt/stack/data/venv/lib/python3.10/site-packages/pymysql/cursors.py", line 153, in execute May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR oslo_service.service result = self._query(query) May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR oslo_service.service File "/opt/stack/data/venv/lib/python3.10/site-packages/pymysql/cursors.py", line 322, in _query May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR oslo_service.service conn.query(q) May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR oslo_service.service File "/opt/stack/data/venv/lib/python3.10/site-packages/pymysql/connections.py", line 558, in query May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR oslo_service.service self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR oslo_service.service File "/opt/stack/data/venv/lib/python3.10/site-packages/pymysql/connections.py", line 822, in _read_query_result May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR oslo_service.service result.read() May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR oslo_service.service File "/opt/stack/data/venv/lib/python3.10/site-packages/pymysql/connections.py", line 1200, in read May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR oslo_service.service first_packet = self.connection._read_packet() May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR oslo_service.service File "/opt/stack/data/venv/lib/python3.10/site-packages/pymysql/connections.py", line 772, in _read_packet May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR oslo_service.service packet.raise_for_error() May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR oslo_service.service File "/opt/stack/data/venv/lib/python3.10/site-packages/pymysql/protocol.py", line 221, in raise_for_error May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR oslo_service.service err.raise_mysql_exception(self._data) May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR oslo_service.service File "/opt/stack/data/venv/lib/python3.10/site-packages/pymysql/err.py", line 143, in raise_mysql_exception May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR oslo_service.service raise errorclass(errno, errval) May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR oslo_service.service pymysql.err.IntegrityError: (1062, "Duplicate entry 'nova-False' for key 'availability_zones.az_name_uc'") May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR oslo_service.service May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR oslo_service.service The above exception was the direct cause of the following exception: May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR oslo_service.service May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR oslo_service.service Traceback (most recent call last): May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR oslo_service.service File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py", line 810, in run_service May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR oslo_service.service service.start() May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR oslo_service.service File "/opt/stack/manila/manila/service.py", line 152, in start May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR oslo_service.service self._create_service_ref(ctxt) May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR oslo_service.service File "/opt/stack/manila/manila/service.py", line 194, in _create_service_ref May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR oslo_service.service service_ref = db.service_create(context, service_args) May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR oslo_service.service File "/opt/stack/manila/manila/db/api.py", line 127, in service_create May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR oslo_service.service return IMPL.service_create(context, values) May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR oslo_service.service File "/opt/stack/manila/manila/db/sqlalchemy/api.py", line 148, in wrapper May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR oslo_service.service return f(*args, **kwargs) May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR oslo_service.service File "/opt/stack/manila/manila/db/sqlalchemy/api.py", line 246, in wrapper May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR oslo_service.service ensure_availability_zone_exists(context, values, strict=strict) May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR oslo_service.service File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/enginefacade.py", line 998, in wrapper May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR oslo_service.service return fn(*args, **kwargs) May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR oslo_service.service File "/opt/stack/manila/manila/db/sqlalchemy/api.py", line 6178, in ensure_availability_zone_exists May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR oslo_service.service az_ref = _availability_zone_create_if_not_exist(context, az_name) May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR oslo_service.service File "/opt/stack/manila/manila/db/sqlalchemy/api.py", line 166, in wrapper May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR oslo_service.service return f(*args, **kwargs) May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR oslo_service.service File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/api.py", line 144, in wrapper May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR oslo_service.service with excutils.save_and_reraise_exception() as ectxt: May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR oslo_service.service File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__ May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR oslo_service.service self.force_reraise() May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR oslo_service.service File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR oslo_service.service raise self.value May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR oslo_service.service File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/api.py", line 142, in wrapper May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR oslo_service.service return f(*args, **kwargs) May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR oslo_service.service File "/opt/stack/manila/manila/db/sqlalchemy/api.py", line 6214, in _availability_zone_create_if_not_exist May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR oslo_service.service az.save(context.session) May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR oslo_service.service File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/models.py", line 38, in save May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR oslo_service.service session.flush() May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR oslo_service.service File "/opt/stack/data/venv/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 4341, in flush May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR oslo_service.service self._flush(objects) May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR oslo_service.service File "/opt/stack/data/venv/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 4476, in _flush May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR oslo_service.service with util.safe_reraise(): May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR oslo_service.service File "/opt/stack/data/venv/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 146, in __exit__ May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR oslo_service.service raise exc_value.with_traceback(exc_tb) May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR oslo_service.service File "/opt/stack/data/venv/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 4437, in _flush May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR oslo_service.service flush_context.execute() May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR oslo_service.service File "/opt/stack/data/venv/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 466, in execute May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR oslo_service.service rec.execute(self) May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR oslo_service.service File "/opt/stack/data/venv/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 642, in execute May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR oslo_service.service util.preloaded.orm_persistence.save_obj( May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR oslo_service.service File "/opt/stack/data/venv/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 93, in save_obj May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR oslo_service.service _emit_insert_statements( May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR oslo_service.service File "/opt/stack/data/venv/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1048, in _emit_insert_statements May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR oslo_service.service result = connection.execute( May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR oslo_service.service File "/opt/stack/data/venv/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1418, in execute May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR oslo_service.service return meth( May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR oslo_service.service File "/opt/stack/data/venv/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 515, in _execute_on_connection May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR oslo_service.service return connection._execute_clauseelement( May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR oslo_service.service File "/opt/stack/data/venv/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1640, in _execute_clauseelement May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR oslo_service.service ret = self._execute_context( May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR oslo_service.service File "/opt/stack/data/venv/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1846, in _execute_context May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR oslo_service.service return self._exec_single_context( May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR oslo_service.service File "/opt/stack/data/venv/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1986, in _exec_single_context May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR oslo_service.service self._handle_dbapi_exception( May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR oslo_service.service File "/opt/stack/data/venv/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 2350, in _handle_dbapi_exception May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR oslo_service.service raise newraise.with_traceback(exc_info[2]) from e May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR oslo_service.service File "/opt/stack/data/venv/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1967, in _exec_single_context May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR oslo_service.service self.dialect.do_execute( May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR oslo_service.service File "/opt/stack/data/venv/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 924, in do_execute May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR oslo_service.service cursor.execute(statement, parameters) May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR oslo_service.service File "/opt/stack/data/venv/lib/python3.10/site-packages/pymysql/cursors.py", line 153, in execute May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR oslo_service.service result = self._query(query) May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR oslo_service.service File "/opt/stack/data/venv/lib/python3.10/site-packages/pymysql/cursors.py", line 322, in _query May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR oslo_service.service conn.query(q) May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR oslo_service.service File "/opt/stack/data/venv/lib/python3.10/site-packages/pymysql/connections.py", line 558, in query May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR oslo_service.service self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR oslo_service.service File "/opt/stack/data/venv/lib/python3.10/site-packages/pymysql/connections.py", line 822, in _read_query_result May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR oslo_service.service result.read() May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR oslo_service.service File "/opt/stack/data/venv/lib/python3.10/site-packages/pymysql/connections.py", line 1200, in read May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR oslo_service.service first_packet = self.connection._read_packet() May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR oslo_service.service File "/opt/stack/data/venv/lib/python3.10/site-packages/pymysql/connections.py", line 772, in _read_packet May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR oslo_service.service packet.raise_for_error() May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR oslo_service.service File "/opt/stack/data/venv/lib/python3.10/site-packages/pymysql/protocol.py", line 221, in raise_for_error May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR oslo_service.service err.raise_mysql_exception(self._data) May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR oslo_service.service File "/opt/stack/data/venv/lib/python3.10/site-packages/pymysql/err.py", line 143, in raise_mysql_exception May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR oslo_service.service raise errorclass(errno, errval) May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR oslo_service.service oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'nova-False' for key 'availability_zones.az_name_uc'") May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR oslo_service.service [SQL: INSERT INTO availability_zones (id, deleted, name, created_at, updated_at, deleted_at) VALUES (%(id)s, %(deleted)s, %(name)s, %(created_at)s, %(updated_at)s, %(deleted_at)s)] May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR oslo_service.service [parameters: {'id': 'c5ec5845-9c50-4cca-a99a-56b044c45220', 'deleted': 'False', 'name': 'nova', 'created_at': datetime.datetime(2024, 5, 28, 12, 56, 3, 590975), 'updated_at': None, 'deleted_at': None}] May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR oslo_service.service (Background on this error at: https://sqlalche.me/e/20/gkpj) May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR oslo_service.service May 28 12:56:03 l75lg1-v1 manila-share[96151]: DEBUG manila.share.manager [None req-2cf6ab01-c9ac-4126-b67e-f98b4a543484 None None] Start initialization of driver: 'GenericShareDriver@l75lg1-v1@generic2' {{(pid=96151) _driver_setup /opt/stack/manila/manila/share/manager.py:369}} May 28 12:56:03 l75lg1-v1 manila-share[96150]: CRITICAL manila [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] Unhandled error: manila.exception.ServiceNotFound: Service None could not be found. May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila Traceback (most recent call last): May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila File "/opt/stack/manila/manila/service.py", line 146, in start May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila service_ref = db.service_get_by_args(ctxt, May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila File "/opt/stack/manila/manila/db/api.py", line 122, in service_get_by_args May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila return IMPL.service_get_by_args(context, host, binary) May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila File "/opt/stack/manila/manila/db/sqlalchemy/api.py", line 148, in wrapper May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila return f(*args, **kwargs) May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/enginefacade.py", line 998, in wrapper May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila return fn(*args, **kwargs) May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila File "/opt/stack/manila/manila/db/sqlalchemy/api.py", line 662, in service_get_by_args May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila raise exception.HostBinaryNotFound(host=host, binary=binary) May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila manila.exception.HostBinaryNotFound: Could not find binary manila-share on host l75lg1-v1@generic1. May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila During handling of the above exception, another exception occurred: May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila Traceback (most recent call last): May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila File "/opt/stack/manila/manila/db/sqlalchemy/api.py", line 6210, in _availability_zone_create_if_not_exist May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila return _availability_zone_get(context, name) May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila File "/opt/stack/manila/manila/db/sqlalchemy/api.py", line 166, in wrapper May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila return f(*args, **kwargs) May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila File "/opt/stack/manila/manila/db/sqlalchemy/api.py", line 6201, in _availability_zone_get May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila raise exception.AvailabilityZoneNotFound(id=id_or_name) May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila manila.exception.AvailabilityZoneNotFound: Availability zone nova could not be found. May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila During handling of the above exception, another exception occurred: May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila Traceback (most recent call last): May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila File "/opt/stack/data/venv/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1967, in _exec_single_context May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila self.dialect.do_execute( May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila File "/opt/stack/data/venv/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 924, in do_execute May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila cursor.execute(statement, parameters) May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila File "/opt/stack/data/venv/lib/python3.10/site-packages/pymysql/cursors.py", line 153, in execute May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila result = self._query(query) May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila File "/opt/stack/data/venv/lib/python3.10/site-packages/pymysql/cursors.py", line 322, in _query May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila conn.query(q) May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila File "/opt/stack/data/venv/lib/python3.10/site-packages/pymysql/connections.py", line 558, in query May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila File "/opt/stack/data/venv/lib/python3.10/site-packages/pymysql/connections.py", line 822, in _read_query_result May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila result.read() May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila File "/opt/stack/data/venv/lib/python3.10/site-packages/pymysql/connections.py", line 1200, in read May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila first_packet = self.connection._read_packet() May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila File "/opt/stack/data/venv/lib/python3.10/site-packages/pymysql/connections.py", line 772, in _read_packet May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila packet.raise_for_error() May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila File "/opt/stack/data/venv/lib/python3.10/site-packages/pymysql/protocol.py", line 221, in raise_for_error May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila err.raise_mysql_exception(self._data) May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila File "/opt/stack/data/venv/lib/python3.10/site-packages/pymysql/err.py", line 143, in raise_mysql_exception May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila raise errorclass(errno, errval) May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila pymysql.err.IntegrityError: (1062, "Duplicate entry 'nova-False' for key 'availability_zones.az_name_uc'") May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila The above exception was the direct cause of the following exception: May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila Traceback (most recent call last): May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py", line 810, in run_service May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila service.start() May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila File "/opt/stack/manila/manila/service.py", line 152, in start May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila self._create_service_ref(ctxt) May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila File "/opt/stack/manila/manila/service.py", line 194, in _create_service_ref May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila service_ref = db.service_create(context, service_args) May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila File "/opt/stack/manila/manila/db/api.py", line 127, in service_create May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila return IMPL.service_create(context, values) May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila File "/opt/stack/manila/manila/db/sqlalchemy/api.py", line 148, in wrapper May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila return f(*args, **kwargs) May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila File "/opt/stack/manila/manila/db/sqlalchemy/api.py", line 246, in wrapper May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila ensure_availability_zone_exists(context, values, strict=strict) May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/enginefacade.py", line 998, in wrapper May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila return fn(*args, **kwargs) May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila File "/opt/stack/manila/manila/db/sqlalchemy/api.py", line 6178, in ensure_availability_zone_exists May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila az_ref = _availability_zone_create_if_not_exist(context, az_name) May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila File "/opt/stack/manila/manila/db/sqlalchemy/api.py", line 166, in wrapper May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila return f(*args, **kwargs) May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/api.py", line 144, in wrapper May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila with excutils.save_and_reraise_exception() as ectxt: May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__ May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila self.force_reraise() May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila raise self.value May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/api.py", line 142, in wrapper May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila return f(*args, **kwargs) May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila File "/opt/stack/manila/manila/db/sqlalchemy/api.py", line 6214, in _availability_zone_create_if_not_exist May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila az.save(context.session) May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/models.py", line 38, in save May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila session.flush() May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila File "/opt/stack/data/venv/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 4341, in flush May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila self._flush(objects) May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila File "/opt/stack/data/venv/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 4476, in _flush May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila with util.safe_reraise(): May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila File "/opt/stack/data/venv/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 146, in __exit__ May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila raise exc_value.with_traceback(exc_tb) May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila File "/opt/stack/data/venv/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 4437, in _flush May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila flush_context.execute() May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila File "/opt/stack/data/venv/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 466, in execute May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila rec.execute(self) May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila File "/opt/stack/data/venv/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 642, in execute May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila util.preloaded.orm_persistence.save_obj( May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila File "/opt/stack/data/venv/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 93, in save_obj May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila _emit_insert_statements( May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila File "/opt/stack/data/venv/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1048, in _emit_insert_statements May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila result = connection.execute( May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila File "/opt/stack/data/venv/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1418, in execute May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila return meth( May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila File "/opt/stack/data/venv/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 515, in _execute_on_connection May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila return connection._execute_clauseelement( May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila File "/opt/stack/data/venv/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1640, in _execute_clauseelement May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila ret = self._execute_context( May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila File "/opt/stack/data/venv/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1846, in _execute_context May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila return self._exec_single_context( May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila File "/opt/stack/data/venv/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1986, in _exec_single_context May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila self._handle_dbapi_exception( May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila File "/opt/stack/data/venv/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 2350, in _handle_dbapi_exception May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila raise newraise.with_traceback(exc_info[2]) from e May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila File "/opt/stack/data/venv/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1967, in _exec_single_context May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila self.dialect.do_execute( May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila File "/opt/stack/data/venv/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 924, in do_execute May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila cursor.execute(statement, parameters) May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila File "/opt/stack/data/venv/lib/python3.10/site-packages/pymysql/cursors.py", line 153, in execute May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila result = self._query(query) May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila File "/opt/stack/data/venv/lib/python3.10/site-packages/pymysql/cursors.py", line 322, in _query May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila conn.query(q) May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila File "/opt/stack/data/venv/lib/python3.10/site-packages/pymysql/connections.py", line 558, in query May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila File "/opt/stack/data/venv/lib/python3.10/site-packages/pymysql/connections.py", line 822, in _read_query_result May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila result.read() May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila File "/opt/stack/data/venv/lib/python3.10/site-packages/pymysql/connections.py", line 1200, in read May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila first_packet = self.connection._read_packet() May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila File "/opt/stack/data/venv/lib/python3.10/site-packages/pymysql/connections.py", line 772, in _read_packet May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila packet.raise_for_error() May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila File "/opt/stack/data/venv/lib/python3.10/site-packages/pymysql/protocol.py", line 221, in raise_for_error May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila err.raise_mysql_exception(self._data) May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila File "/opt/stack/data/venv/lib/python3.10/site-packages/pymysql/err.py", line 143, in raise_mysql_exception May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila raise errorclass(errno, errval) May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'nova-False' for key 'availability_zones.az_name_uc'") May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila [SQL: INSERT INTO availability_zones (id, deleted, name, created_at, updated_at, deleted_at) VALUES (%(id)s, %(deleted)s, %(name)s, %(created_at)s, %(updated_at)s, %(deleted_at)s)] May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila [parameters: {'id': 'c5ec5845-9c50-4cca-a99a-56b044c45220', 'deleted': 'False', 'name': 'nova', 'created_at': datetime.datetime(2024, 5, 28, 12, 56, 3, 590975), 'updated_at': None, 'deleted_at': None}] May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila (Background on this error at: https://sqlalche.me/e/20/gkpj) May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila During handling of the above exception, another exception occurred: May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila Traceback (most recent call last): May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py", line 513, in _child_wait_for_exit_or_signal May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila launcher.wait() May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py", line 297, in wait May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila self.services.wait() May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py", line 779, in wait May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila self.tg.wait() May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/threadgroup.py", line 366, in wait May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila self._wait_threads() May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/threadgroup.py", line 341, in _wait_threads May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila self._perform_action_on_threads( May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/threadgroup.py", line 268, in _perform_action_on_threads May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila action_func(x) May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/threadgroup.py", line 342, in May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila lambda x: x.wait(), May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/threadgroup.py", line 61, in wait May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila return self.thread.wait() May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 225, in wait May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila return self._exit_event.wait() May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/event.py", line 124, in wait May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila result = hub.switch() May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/hub.py", line 310, in switch May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila return self.greenlet.switch() May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/hub.py", line 352, in run May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila self.fire_timers(self.clock()) May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/hub.py", line 471, in fire_timers May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila timer() May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/timer.py", line 59, in __call__ May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila cb(*args, **kw) May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 265, in main May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila result = function(*args, **kwargs) May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py", line 813, in run_service May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila raise SystemExit(1) May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila SystemExit: 1 May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila During handling of the above exception, another exception occurred: May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila Traceback (most recent call last): May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila File "/opt/stack/data/venv/bin/manila-share", line 10, in May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila sys.exit(main()) May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila File "/opt/stack/manila/manila/cmd/share.py", line 60, in main May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila launcher.launch_service(server) May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py", line 606, in launch_service May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila self._start_child(wrap) May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py", line 570, in _start_child May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila status, signo = self._child_wait_for_exit_or_signal( May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py", line 520, in _child_wait_for_exit_or_signal May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila launcher.stop() May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py", line 289, in stop May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila self.services.stop() May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py", line 765, in stop May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila service.stop() May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila File "/opt/stack/manila/manila/service.py", line 257, in stop May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila db.service_update(context.get_admin_context(), May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila File "/opt/stack/manila/manila/db/api.py", line 136, in service_update May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila return IMPL.service_update(context, service_id, values) May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila File "/opt/stack/manila/manila/db/sqlalchemy/api.py", line 148, in wrapper May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila return f(*args, **kwargs) May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila File "/opt/stack/manila/manila/db/sqlalchemy/api.py", line 247, in wrapper May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila return f(context, *args, **kwargs) May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/api.py", line 144, in wrapper May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila with excutils.save_and_reraise_exception() as ectxt: May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__ May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila self.force_reraise() May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila raise self.value May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/api.py", line 142, in wrapper May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila return f(*args, **kwargs) May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/enginefacade.py", line 998, in wrapper May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila return fn(*args, **kwargs) May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila File "/opt/stack/manila/manila/db/sqlalchemy/api.py", line 685, in service_update May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila service_ref = _service_get(context, service_id) May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila File "/opt/stack/manila/manila/db/sqlalchemy/api.py", line 148, in wrapper May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila return f(*args, **kwargs) May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila File "/opt/stack/manila/manila/db/sqlalchemy/api.py", line 561, in _service_get May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila raise exception.ServiceNotFound(service_id=service_id) May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila manila.exception.ServiceNotFound: Service None could not be found. May 28 12:56:03 l75lg1-v1 manila-share[96150]: ERROR manila May 28 12:56:03 l75lg1-v1 manila-share[96151]: DEBUG oslo_concurrency.lockutils [None req-2cf6ab01-c9ac-4126-b67e-f98b4a543484 None None] Acquiring lock "instantiate_network_helper" by "manila.share.drivers.service_instance.ServiceInstanceManager.network_helper" {{(pid=96151) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:56:03 l75lg1-v1 manila-share[96151]: DEBUG oslo_concurrency.lockutils [None req-2cf6ab01-c9ac-4126-b67e-f98b4a543484 None None] Lock "instantiate_network_helper" acquired by "manila.share.drivers.service_instance.ServiceInstanceManager.network_helper" :: waited 0.001s {{(pid=96151) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:56:03 l75lg1-v1 manila-share[96151]: DEBUG oslo_concurrency.lockutils [None req-2cf6ab01-c9ac-4126-b67e-f98b4a543484 None None] Acquiring lock "service_network_id_neutron_net_helper" by "manila.share.drivers.service_instance.NeutronNetworkHelper.service_network_id" {{(pid=96151) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:56:03 l75lg1-v1 manila-share[96151]: DEBUG oslo_concurrency.lockutils [None req-2cf6ab01-c9ac-4126-b67e-f98b4a543484 None None] Lock "service_network_id_neutron_net_helper" acquired by "manila.share.drivers.service_instance.NeutronNetworkHelper.service_network_id" :: waited 0.000s {{(pid=96151) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:56:03 l75lg1-v1 manila-share[96151]: DEBUG manila.coordination [None req-2cf6ab01-c9ac-4126-b67e-f98b4a543484 None None] Lock "service_instance_get_service_network" acquired by "_get_service_network_id". {{(pid=96151) _synchronized /opt/stack/manila/manila/coordination.py:199}} May 28 12:56:03 l75lg1-v1 manila-share[96151]: DEBUG oslo_concurrency.lockutils [None req-2cf6ab01-c9ac-4126-b67e-f98b4a543484 None None] Acquiring lock "instantiate_neutron_api_neutron_net_helper" by "manila.share.drivers.service_instance.NeutronNetworkHelper.neutron_api" {{(pid=96151) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:56:03 l75lg1-v1 manila-share[96151]: DEBUG oslo_concurrency.lockutils [None req-2cf6ab01-c9ac-4126-b67e-f98b4a543484 None None] Lock "instantiate_neutron_api_neutron_net_helper" acquired by "manila.share.drivers.service_instance.NeutronNetworkHelper.neutron_api" :: waited 0.000s {{(pid=96151) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:56:03 l75lg1-v1 manila-share[96151]: DEBUG oslo_concurrency.lockutils [None req-2cf6ab01-c9ac-4126-b67e-f98b4a543484 None None] Lock "instantiate_neutron_api_neutron_net_helper" "released" by "manila.share.drivers.service_instance.NeutronNetworkHelper.neutron_api" :: held 0.001s {{(pid=96151) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:56:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f84df26-5459-4161-abf9-d075cd8039c1 None None] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f84df26-5459-4161-abf9-d075cd8039c1 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f84df26-5459-4161-abf9-d075cd8039c1 None None] PATH_INFO: `/` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:03 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 594/1201] 10.27.203.238 () {58 vars in 1008 bytes} [Tue May 28 12:56:03 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:56:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab8aa4a-892d-4284-8c59-58e8c86ccdc2 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab8aa4a-892d-4284-8c59-58e8c86ccdc2 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab8aa4a-892d-4284-8c59-58e8c86ccdc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:03 l75lg1-v1 manila-share[95722]: INFO oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] Child 96150 exited with status 1 May 28 12:56:03 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-1ab8aa4a-892d-4284-8c59-58e8c86ccdc2 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:56:03 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] Started child 96506 {{(pid=95722) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:579}} May 28 12:56:03 l75lg1-v1 manila-share[96506]: INFO manila.service [-] Starting manila-share node (version 18.1.0) May 28 12:56:03 l75lg1-v1 manila-share[96506]: DEBUG oslo_db.api [None req-6c173bbc-673a-4c3c-a470-52ad1ebf882a None None] Loading backend 'sqlalchemy' from 'manila.db.sqlalchemy.api' {{(pid=96506) _load_backend /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/api.py:259}} May 28 12:56:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-1ab8aa4a-892d-4284-8c59-58e8c86ccdc2 None None] MFA Rules not processed for user `8ef17047035e4b518fd5360a01f2da1a`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:56:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-1ab8aa4a-892d-4284-8c59-58e8c86ccdc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:03 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 608/1202] 10.27.203.238 () {62 vars in 1105 bytes} [Tue May 28 12:56:03 2024] POST /identity/v3/auth/tokens => generated 3810 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:56:03 l75lg1-v1 neutron-server[77619]: DEBUG neutron.wsgi [-] (77619) accepted ('10.27.203.238', 58548) {{(pid=77619) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 12:56:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f84df26-5459-4161-abf9-d075cd8039c1 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f84df26-5459-4161-abf9-d075cd8039c1 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346f192c-05c1-4686-8956-482857069902 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef17047035e4b518fd5360a01f2da1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346f192c-05c1-4686-8956-482857069902 service neutron] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346f192c-05c1-4686-8956-482857069902 service neutron] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346f192c-05c1-4686-8956-482857069902 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346f192c-05c1-4686-8956-482857069902 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346f192c-05c1-4686-8956-482857069902 service neutron] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:03 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 595/1203] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 12:56:03 2024] GET /identity/v3/auth/tokens => generated 3810 bytes in 17 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 12:56:03 l75lg1-v1 neutron-server[77619]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ecf8e699-2fe9-48eb-9951-41ad4d81c42f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=77619) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:258}} May 28 12:56:03 l75lg1-v1 neutron-server[77619]: INFO neutron.wsgi [None req-ecf8e699-2fe9-48eb-9951-41ad4d81c42f service neutron] 10.27.203.238 "GET /networking/v2.0/networks?tenant_id=98a6a2dcbf0248d5b353760f7757f713&shared=False HTTP/1.1" status: 200 len: 866 time: 0.1298873 May 28 12:56:03 l75lg1-v1 manila-share[96151]: DEBUG oslo_concurrency.lockutils [None req-2cf6ab01-c9ac-4126-b67e-f98b4a543484 None None] Acquiring lock "instantiate_neutron_api_neutron_net_helper" by "manila.share.drivers.service_instance.NeutronNetworkHelper.neutron_api" {{(pid=96151) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:56:03 l75lg1-v1 manila-share[96151]: DEBUG oslo_concurrency.lockutils [None req-2cf6ab01-c9ac-4126-b67e-f98b4a543484 None None] Lock "instantiate_neutron_api_neutron_net_helper" acquired by "manila.share.drivers.service_instance.NeutronNetworkHelper.neutron_api" :: waited 0.001s {{(pid=96151) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:56:03 l75lg1-v1 manila-share[96151]: DEBUG oslo_concurrency.lockutils [None req-2cf6ab01-c9ac-4126-b67e-f98b4a543484 None None] Lock "instantiate_neutron_api_neutron_net_helper" "released" by "manila.share.drivers.service_instance.NeutronNetworkHelper.neutron_api" :: held 0.000s {{(pid=96151) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:56:03 l75lg1-v1 manila-share[96151]: DEBUG oslo_concurrency.lockutils [None req-2cf6ab01-c9ac-4126-b67e-f98b4a543484 None None] Acquiring lock "instantiate_neutron_api_neutron_net_helper" by "manila.share.drivers.service_instance.NeutronNetworkHelper.neutron_api" {{(pid=96151) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:56:03 l75lg1-v1 manila-share[96151]: DEBUG oslo_concurrency.lockutils [None req-2cf6ab01-c9ac-4126-b67e-f98b4a543484 None None] Lock "instantiate_neutron_api_neutron_net_helper" acquired by "manila.share.drivers.service_instance.NeutronNetworkHelper.neutron_api" :: waited 0.000s {{(pid=96151) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:56:03 l75lg1-v1 manila-share[96151]: DEBUG oslo_concurrency.lockutils [None req-2cf6ab01-c9ac-4126-b67e-f98b4a543484 None None] Lock "instantiate_neutron_api_neutron_net_helper" "released" by "manila.share.drivers.service_instance.NeutronNetworkHelper.neutron_api" :: held 0.000s {{(pid=96151) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:56:03 l75lg1-v1 neutron-server[77619]: DEBUG neutron.api.v2.base [None req-3f0971f2-d131-470b-b3f2-8cf70c341311 service neutron] Request body: {'network': {'tenant_id': '98a6a2dcbf0248d5b353760f7757f713', 'name': 'manila_service_network'}} {{(pid=77619) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:734}} May 28 12:56:04 l75lg1-v1 neutron-server[77619]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3f0971f2-d131-470b-b3f2-8cf70c341311 service neutron] Made reservation on behalf of 98a6a2dcbf0248d5b353760f7757f713 for: {'network': 1} {{(pid=77619) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 28 12:56:04 l75lg1-v1 manila-share[96506]: DEBUG passlib.utils.compat [None req-6c173bbc-673a-4c3c-a470-52ad1ebf882a None None] loaded lazy attr 'SafeConfigParser': {{(pid=96506) __getattr__ /opt/stack/data/venv/lib/python3.10/site-packages/passlib/utils/compat/__init__.py:449}} May 28 12:56:04 l75lg1-v1 manila-share[96506]: DEBUG passlib.utils.compat [None req-6c173bbc-673a-4c3c-a470-52ad1ebf882a None None] loaded lazy attr 'NativeStringIO': {{(pid=96506) __getattr__ /opt/stack/data/venv/lib/python3.10/site-packages/passlib/utils/compat/__init__.py:449}} May 28 12:56:04 l75lg1-v1 neutron-server[77619]: DEBUG neutron_lib.callbacks.manager [None req-3f0971f2-d131-470b-b3f2-8cf70c341311 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1015114'] for network (None), before_create {{(pid=77619) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:56:04 l75lg1-v1 manila-share[96506]: DEBUG passlib.utils.compat [None req-6c173bbc-673a-4c3c-a470-52ad1ebf882a None None] loaded lazy attr 'BytesIO': {{(pid=96506) __getattr__ /opt/stack/data/venv/lib/python3.10/site-packages/passlib/utils/compat/__init__.py:449}} May 28 12:56:04 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-3f0971f2-d131-470b-b3f2-8cf70c341311 service neutron] geneve segment allocate from pool success with {'geneve_vni': 34166} {{(pid=77619) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 28 12:56:04 l75lg1-v1 neutron-server[77619]: DEBUG neutron_lib.callbacks.manager [None req-3f0971f2-d131-470b-b3f2-8cf70c341311 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-910805'] for segment (103e5ede-1b45-4a70-9058-2b289cceb77f), precommit_create {{(pid=77619) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:56:04 l75lg1-v1 neutron-server[77619]: INFO neutron.db.segments_db [None req-3f0971f2-d131-470b-b3f2-8cf70c341311 service neutron] Added segment 103e5ede-1b45-4a70-9058-2b289cceb77f of type geneve for network 638fa003-195c-4f96-8899-6458dfcc8bbc May 28 12:56:04 l75lg1-v1 neutron-server[77619]: DEBUG neutron_lib.callbacks.manager [None req-3f0971f2-d131-470b-b3f2-8cf70c341311 service neutron] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8754901908252'] for network (638fa003-195c-4f96-8899-6458dfcc8bbc), precommit_create {{(pid=77619) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:56:04 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver [None req-3f0971f2-d131-470b-b3f2-8cf70c341311 service neutron] Validating network segment with type geneve, segmentation ID 34166, physical network None {{(pid=77619) _validate_network_segments /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/mech_driver.py:520}} May 28 12:56:04 l75lg1-v1 neutron-server[77619]: DEBUG neutron.db.ovn_revision_numbers_db [None req-3f0971f2-d131-470b-b3f2-8cf70c341311 service neutron] create_initial_revision uuid=638fa003-195c-4f96-8899-6458dfcc8bbc, type=networks, rev=-1 {{(pid=77619) create_initial_revision /opt/stack/neutron/neutron/db/ovn_revision_numbers_db.py:108}} May 28 12:56:04 l75lg1-v1 neutron-server[77619]: INFO neutron.tests.unit.plugins.ml2.drivers.mechanism_logger [None req-3f0971f2-d131-470b-b3f2-8cf70c341311 service neutron] create_network_precommit called with network settings {'id': '638fa003-195c-4f96-8899-6458dfcc8bbc', 'name': 'manila_service_network', 'tenant_id': '98a6a2dcbf0248d5b353760f7757f713', 'admin_state_up': True, 'mtu': 1442, 'status': 'ACTIVE', 'subnets': [], 'standard_attr_id': 60, 'shared': False, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'port_security_enabled': True, 'router:external': False, 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 34166, 'is_default': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'vlan_transparent': None, 'description': '', 'tags': [], 'created_at': '2024-05-28T12:56:04Z', 'updated_at': '2024-05-28T12:56:04Z', 'revision_number': 1} (original settings None) and network segments [{'id': '103e5ede-1b45-4a70-9058-2b289cceb77f', 'network_type': 'geneve', 'physical_network': None, 'segmentation_id': 34166, 'network_id': '638fa003-195c-4f96-8899-6458dfcc8bbc'}] May 28 12:56:04 l75lg1-v1 neutron-server[77619]: DEBUG neutron.tests.unit.plugins.ml2.drivers.mechanism_logger [None req-3f0971f2-d131-470b-b3f2-8cf70c341311 service neutron] create_network_precommit: May 28 12:56:04 l75lg1-v1 neutron-server[77619]: key[tenant_id], None -> 98a6a2dcbf0248d5b353760f7757f713 May 28 12:56:04 l75lg1-v1 neutron-server[77619]: key[provider:network_type], None -> geneve May 28 12:56:04 l75lg1-v1 neutron-server[77619]: key[project_id], None -> 98a6a2dcbf0248d5b353760f7757f713 May 28 12:56:04 l75lg1-v1 neutron-server[77619]: key[ipv6_address_scope], None -> None May 28 12:56:04 l75lg1-v1 neutron-server[77619]: key[subnets], None -> [] May 28 12:56:04 l75lg1-v1 neutron-server[77619]: key[admin_state_up], None -> True May 28 12:56:04 l75lg1-v1 neutron-server[77619]: key[id], None -> 638fa003-195c-4f96-8899-6458dfcc8bbc May 28 12:56:04 l75lg1-v1 neutron-server[77619]: key[ipv4_address_scope], None -> None May 28 12:56:04 l75lg1-v1 neutron-server[77619]: key[tags], None -> [] May 28 12:56:04 l75lg1-v1 neutron-server[77619]: key[created_at], None -> 2024-05-28T12:56:04Z May 28 12:56:04 l75lg1-v1 neutron-server[77619]: key[status], None -> ACTIVE May 28 12:56:04 l75lg1-v1 neutron-server[77619]: key[is_default], None -> False May 28 12:56:04 l75lg1-v1 neutron-server[77619]: key[port_security_enabled], None -> True May 28 12:56:04 l75lg1-v1 neutron-server[77619]: key[vlan_transparent], None -> None May 28 12:56:04 l75lg1-v1 neutron-server[77619]: key[updated_at], None -> 2024-05-28T12:56:04Z May 28 12:56:04 l75lg1-v1 neutron-server[77619]: key[standard_attr_id], None -> 60 May 28 12:56:04 l75lg1-v1 neutron-server[77619]: key[availability_zone_hints], None -> [] May 28 12:56:04 l75lg1-v1 neutron-server[77619]: key[provider:physical_network], None -> None May 28 12:56:04 l75lg1-v1 neutron-server[77619]: key[shared], None -> False May 28 12:56:04 l75lg1-v1 neutron-server[77619]: key[mtu], None -> 1442 May 28 12:56:04 l75lg1-v1 neutron-server[77619]: key[provider:segmentation_id], None -> 34166 May 28 12:56:04 l75lg1-v1 neutron-server[77619]: key[description], None -> May 28 12:56:04 l75lg1-v1 neutron-server[77619]: key[availability_zones], None -> [] May 28 12:56:04 l75lg1-v1 neutron-server[77619]: key[revision_number], None -> 1 May 28 12:56:04 l75lg1-v1 neutron-server[77619]: key[router:external], None -> False May 28 12:56:04 l75lg1-v1 neutron-server[77619]: key[name], None -> manila_service_network May 28 12:56:04 l75lg1-v1 neutron-server[77619]: {{(pid=77619) _log_diff_call /opt/stack/neutron/neutron/tests/unit/plugins/ml2/drivers/mechanism_logger.py:59}} May 28 12:56:04 l75lg1-v1 neutron-server[77619]: DEBUG neutron_lib.callbacks.manager [None req-3f0971f2-d131-470b-b3f2-8cf70c341311 service neutron] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4165676'] for network (638fa003-195c-4f96-8899-6458dfcc8bbc), after_create {{(pid=77619) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:56:04 l75lg1-v1 neutron-server[77619]: DEBUG ovsdbapp.backend.ovs_idl.transaction [None req-53cecb61-7023-41e4-a5ea-23b1eb02606a None None] Running txn n=1 command(idx=0): LsAddCommand(_result=None, switch=neutron-638fa003-195c-4f96-8899-6458dfcc8bbc, columns={'external_ids': {'neutron:network_name': 'manila_service_network', 'neutron:mtu': '1442', 'neutron:revision_number': '1', 'neutron:availability_zone_hints': '', 'neutron:provnet-network-type': 'geneve'}, 'other_config': {'mcast_snoop': 'false', 'mcast_flood_unregistered': 'false', 'vlan-passthru': 'false'}}, may_exist=True) {{(pid=77619) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:56:04 l75lg1-v1 neutron-server[77618]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-c63b1acc-b5c6-4be8-9db9-04824fec27f2 None None] Hash Ring: Node 4c6fc793-7f5a-456f-b4d6-6e5bd97592f2 (host: l75lg1-v1) handling event "create" for row 805d6ab3-14ec-4e2e-94f6-e4eb06fe959b (table: Logical_Switch) {{(pid=77618) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:56:04 l75lg1-v1 neutron-server[77619]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3f0971f2-d131-470b-b3f2-8cf70c341311 service neutron] Pushing event updated for resources: {'Network': ['ID=638fa003-195c-4f96-8899-6458dfcc8bbc,revision_number=1']} {{(pid=77619) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 28 12:56:04 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-03b5f984-1478-4ad6-9838-8e34c1689c5b None None] Hash Ring: Node c89b3497-133e-4a5a-b67a-3310d2cb2485 (host: l75lg1-v1) handling event "create" for row 2ef15622-104a-4d13-a81a-f08de5446b4d (table: Datapath_Binding) {{(pid=77619) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:56:04 l75lg1-v1 neutron-server[77619]: INFO neutron.db.ovn_revision_numbers_db [None req-3f0971f2-d131-470b-b3f2-8cf70c341311 service neutron] Successfully bumped revision number for resource 638fa003-195c-4f96-8899-6458dfcc8bbc (type: networks) to 1 May 28 12:56:04 l75lg1-v1 dstat.sh[49771]: 28-05 12:56:04| 33 10 55 1 0|5023M 2508M 277M 7821M| 30k 9790B| 52k 1195k|13.0 130 |7237 12k|0.93 0.75 0.91|5.0 1.0 270| 0 0 | 0 2048M| 27 316 0 16 0 May 28 12:56:04 l75lg1-v1 neutron-server[77619]: DEBUG neutron_lib.callbacks.manager [None req-3f0971f2-d131-470b-b3f2-8cf70c341311 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1015114'] for port (None), before_create {{(pid=77619) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:56:04 l75lg1-v1 manila-share[96506]: INFO dbcounter [None req-6c173bbc-673a-4c3c-a470-52ad1ebf882a None None] Registered counter for database manila May 28 12:56:04 l75lg1-v1 manila-share[96506]: DEBUG oslo_db.sqlalchemy.engines [None req-6c173bbc-673a-4c3c-a470-52ad1ebf882a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=96506) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:342}} May 28 12:56:04 l75lg1-v1 neutron-server[77619]: DEBUG neutron_lib.callbacks.manager [None req-3f0971f2-d131-470b-b3f2-8cf70c341311 service neutron] Publish callbacks [] for port (617d23f0-3fe7-4455-8222-fdb898c06ffa), precommit_create {{(pid=77619) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:56:04 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver [None req-3f0971f2-d131-470b-b3f2-8cf70c341311 service neutron] No provisioning block for port 617d23f0-3fe7-4455-8222-fdb898c06ffa since it does not have a host {{(pid=77619) _is_port_provisioning_required /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/mech_driver.py:720}} May 28 12:56:04 l75lg1-v1 neutron-server[77619]: DEBUG neutron.db.ovn_revision_numbers_db [None req-3f0971f2-d131-470b-b3f2-8cf70c341311 service neutron] create_initial_revision uuid=617d23f0-3fe7-4455-8222-fdb898c06ffa, type=ports, rev=-1 {{(pid=77619) create_initial_revision /opt/stack/neutron/neutron/db/ovn_revision_numbers_db.py:108}} May 28 12:56:04 l75lg1-v1 neutron-server[77619]: INFO neutron.tests.unit.plugins.ml2.drivers.mechanism_logger [None req-3f0971f2-d131-470b-b3f2-8cf70c341311 service neutron] create_port_precommit called with port settings {'id': '617d23f0-3fe7-4455-8222-fdb898c06ffa', 'name': '', 'network_id': '638fa003-195c-4f96-8899-6458dfcc8bbc', 'tenant_id': '98a6a2dcbf0248d5b353760f7757f713', 'mac_address': 'fa:16:3e:a5:9a:02', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ovnmeta-638fa003-195c-4f96-8899-6458dfcc8bbc', 'device_owner': 'network:distributed', 'standard_attr_id': 62, 'fixed_ips': [], 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'port_security_enabled': False, 'security_groups': [], 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'allowed_address_pairs': []} (original settings None) host (original host None) vif type unbound (original vif type None) vif details {} (original vif details None) binding levels None (original binding levels None) on network {'id': '638fa003-195c-4f96-8899-6458dfcc8bbc', 'name': 'manila_service_network', 'tenant_id': '98a6a2dcbf0248d5b353760f7757f713', 'admin_state_up': True, 'mtu': 1442, 'status': 'ACTIVE', 'subnets': [], 'standard_attr_id': 60, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'vlan_transparent': None, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2024-05-28T12:56:04Z', 'updated_at': '2024-05-28T12:56:04Z', 'revision_number': 1, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 34166} with segments to bind None May 28 12:56:04 l75lg1-v1 neutron-server[77619]: DEBUG neutron.tests.unit.plugins.ml2.drivers.mechanism_logger [None req-3f0971f2-d131-470b-b3f2-8cf70c341311 service neutron] create_port_precommit: May 28 12:56:04 l75lg1-v1 neutron-server[77619]: key[tenant_id], None -> 98a6a2dcbf0248d5b353760f7757f713 May 28 12:56:04 l75lg1-v1 neutron-server[77619]: key[network_id], None -> 638fa003-195c-4f96-8899-6458dfcc8bbc May 28 12:56:04 l75lg1-v1 neutron-server[77619]: key[allowed_address_pairs], None -> [] May 28 12:56:04 l75lg1-v1 neutron-server[77619]: key[binding:vif_type], None -> unbound May 28 12:56:04 l75lg1-v1 neutron-server[77619]: key[project_id], None -> 98a6a2dcbf0248d5b353760f7757f713 May 28 12:56:04 l75lg1-v1 neutron-server[77619]: key[admin_state_up], None -> True May 28 12:56:04 l75lg1-v1 neutron-server[77619]: key[id], None -> 617d23f0-3fe7-4455-8222-fdb898c06ffa May 28 12:56:04 l75lg1-v1 neutron-server[77619]: key[security_groups], None -> [] May 28 12:56:04 l75lg1-v1 neutron-server[77619]: key[binding:vnic_type], None -> normal May 28 12:56:04 l75lg1-v1 neutron-server[77619]: key[name], None -> May 28 12:56:04 l75lg1-v1 neutron-server[77619]: key[status], None -> DOWN May 28 12:56:04 l75lg1-v1 neutron-server[77619]: key[binding:profile], None -> {} May 28 12:56:04 l75lg1-v1 neutron-server[77619]: key[port_security_enabled], None -> False May 28 12:56:04 l75lg1-v1 neutron-server[77619]: key[standard_attr_id], None -> 62 May 28 12:56:04 l75lg1-v1 neutron-server[77619]: key[device_owner], None -> network:distributed May 28 12:56:04 l75lg1-v1 neutron-server[77619]: key[device_id], None -> ovnmeta-638fa003-195c-4f96-8899-6458dfcc8bbc May 28 12:56:04 l75lg1-v1 neutron-server[77619]: key[mac_address], None -> fa:16:3e:a5:9a:02 May 28 12:56:04 l75lg1-v1 neutron-server[77619]: key[binding:host_id], None -> May 28 12:56:04 l75lg1-v1 neutron-server[77619]: key[binding:vif_details], None -> {} May 28 12:56:04 l75lg1-v1 neutron-server[77619]: key[fixed_ips], None -> [] May 28 12:56:04 l75lg1-v1 neutron-server[77619]: {{(pid=77619) _log_diff_call /opt/stack/neutron/neutron/tests/unit/plugins/ml2/drivers/mechanism_logger.py:59}} May 28 12:56:04 l75lg1-v1 neutron-server[77619]: DEBUG neutron_lib.callbacks.manager [None req-3f0971f2-d131-470b-b3f2-8cf70c341311 service neutron] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4166243'] for port (617d23f0-3fe7-4455-8222-fdb898c06ffa), after_create {{(pid=77619) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:56:04 l75lg1-v1 neutron-server[77619]: DEBUG ovsdbapp.backend.ovs_idl.transaction [None req-53cecb61-7023-41e4-a5ea-23b1eb02606a None None] Running txn n=1 command(idx=0): AddLSwitchPortCommand(_result=None, lport=617d23f0-3fe7-4455-8222-fdb898c06ffa, lswitch=neutron-638fa003-195c-4f96-8899-6458dfcc8bbc, may_exist=True, columns={'addresses': ['fa:16:3e:a5:9a:02'], 'external_ids': {'neutron:port_name': '', 'neutron:device_id': 'ovnmeta-638fa003-195c-4f96-8899-6458dfcc8bbc', 'neutron:project_id': '98a6a2dcbf0248d5b353760f7757f713', 'neutron:cidrs': '', 'neutron:device_owner': 'network:distributed', 'neutron:subnet_pool_addr_scope4': '', 'neutron:subnet_pool_addr_scope6': '', 'neutron:network_name': 'neutron-638fa003-195c-4f96-8899-6458dfcc8bbc', 'neutron:security_group_ids': '', 'neutron:revision_number': '1', 'neutron:vnic_type': 'normal', 'neutron:port_capabilities': '', 'neutron:mtu': ''}, 'parent_name': [], 'tag': [], 'enabled': True, 'options': {}, 'type': 'localport', 'port_security': [], 'dhcpv4_options': [], 'dhcpv6_options': []}) {{(pid=77619) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:56:04 l75lg1-v1 neutron-server[77619]: DEBUG ovsdbapp.backend.ovs_idl.transaction [None req-53cecb61-7023-41e4-a5ea-23b1eb02606a None None] Running txn n=1 command(idx=1): QoSDelCommand(_result=None, switch=neutron-638fa003-195c-4f96-8899-6458dfcc8bbc, conditions=[('direction', '=', 'to-lport'), ('priority', '=', 2002), ('match', '=', 'outport == "617d23f0-3fe7-4455-8222-fdb898c06ffa"')], if_exists=True) {{(pid=77619) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:56:04 l75lg1-v1 neutron-server[77619]: DEBUG ovsdbapp.backend.ovs_idl.transaction [None req-53cecb61-7023-41e4-a5ea-23b1eb02606a None None] Running txn n=1 command(idx=2): UpdateLSwitchPortQosOptionsCommand(_result=None, lport=AddLSwitchPortCommand(_result=b24fc319-4281-4d27-a420-89df29f106e4, lport=617d23f0-3fe7-4455-8222-fdb898c06ffa, lswitch=neutron-638fa003-195c-4f96-8899-6458dfcc8bbc, may_exist=True, columns={'addresses': ['fa:16:3e:a5:9a:02'], 'external_ids': {'neutron:port_name': '', 'neutron:device_id': 'ovnmeta-638fa003-195c-4f96-8899-6458dfcc8bbc', 'neutron:project_id': '98a6a2dcbf0248d5b353760f7757f713', 'neutron:cidrs': '', 'neutron:device_owner': 'network:distributed', 'neutron:subnet_pool_addr_scope4': '', 'neutron:subnet_pool_addr_scope6': '', 'neutron:network_name': 'neutron-638fa003-195c-4f96-8899-6458dfcc8bbc', 'neutron:security_group_ids': '', 'neutron:revision_number': '1', 'neutron:vnic_type': 'normal', 'neutron:port_capabilities': '', 'neutron:mtu': ''}, 'parent_name': [], 'enabled': True, 'options': {}, 'type': 'localport', 'port_security': []}), if_exists=True, qos={'qos_min_rate': None}) {{(pid=77619) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:56:04 l75lg1-v1 neutron-server[77619]: DEBUG ovsdbapp.backend.ovs_idl.transaction [None req-53cecb61-7023-41e4-a5ea-23b1eb02606a None None] Running txn n=1 command(idx=3): QoSDelCommand(_result=None, switch=neutron-638fa003-195c-4f96-8899-6458dfcc8bbc, conditions=[('direction', '=', 'from-lport'), ('priority', '=', 2002), ('match', '=', 'inport == "617d23f0-3fe7-4455-8222-fdb898c06ffa"')], if_exists=True) {{(pid=77619) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:56:04 l75lg1-v1 neutron-server[77619]: DEBUG ovsdbapp.backend.ovs_idl.transaction [None req-53cecb61-7023-41e4-a5ea-23b1eb02606a None None] Running txn n=1 command(idx=4): UpdateLSwitchPortQosOptionsCommand(_result=None, lport=AddLSwitchPortCommand(_result=b24fc319-4281-4d27-a420-89df29f106e4, lport=617d23f0-3fe7-4455-8222-fdb898c06ffa, lswitch=neutron-638fa003-195c-4f96-8899-6458dfcc8bbc, may_exist=True, columns={'addresses': ['fa:16:3e:a5:9a:02'], 'external_ids': {'neutron:port_name': '', 'neutron:device_id': 'ovnmeta-638fa003-195c-4f96-8899-6458dfcc8bbc', 'neutron:project_id': '98a6a2dcbf0248d5b353760f7757f713', 'neutron:cidrs': '', 'neutron:device_owner': 'network:distributed', 'neutron:subnet_pool_addr_scope4': '', 'neutron:subnet_pool_addr_scope6': '', 'neutron:network_name': 'neutron-638fa003-195c-4f96-8899-6458dfcc8bbc', 'neutron:security_group_ids': '', 'neutron:revision_number': '1', 'neutron:vnic_type': 'normal', 'neutron:port_capabilities': '', 'neutron:mtu': ''}, 'parent_name': [], 'enabled': True, 'options': {}, 'type': 'localport', 'port_security': []}), if_exists=True, qos={'qos_min_rate': None}) {{(pid=77619) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:56:04 l75lg1-v1 neutron-server[77618]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-c63b1acc-b5c6-4be8-9db9-04824fec27f2 None None] Hash Ring: Node 4c6fc793-7f5a-456f-b4d6-6e5bd97592f2 (host: l75lg1-v1) handling event "update" for row 805d6ab3-14ec-4e2e-94f6-e4eb06fe959b (table: Logical_Switch) {{(pid=77618) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:56:04 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-03b5f984-1478-4ad6-9838-8e34c1689c5b None None] Hash Ring: Node c89b3497-133e-4a5a-b67a-3310d2cb2485 (host: l75lg1-v1) handling event "create" for row d1771025-b4d2-47ad-a1cf-1910b75ca6d2 (table: Port_Binding) {{(pid=77619) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:56:04 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-53cecb61-7023-41e4-a5ea-23b1eb02606a None None] Hash Ring: Node c89b3497-133e-4a5a-b67a-3310d2cb2485 (host: l75lg1-v1) handling event "create" for row 1b6bad1b-085f-413b-98ac-7fb57246a540 (table: Logical_Switch_Port) {{(pid=77619) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:56:04 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-53cecb61-7023-41e4-a5ea-23b1eb02606a None None] Hash Ring: Node c89b3497-133e-4a5a-b67a-3310d2cb2485 (host: l75lg1-v1) handling event "update" for row 1b6bad1b-085f-413b-98ac-7fb57246a540 (table: Logical_Switch_Port) {{(pid=77619) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:56:04 l75lg1-v1 neutron-server[77619]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3f0971f2-d131-470b-b3f2-8cf70c341311 service neutron] Pushing event updated for resources: {'Port': ['ID=617d23f0-3fe7-4455-8222-fdb898c06ffa,revision_number=1']} {{(pid=77619) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 28 12:56:04 l75lg1-v1 neutron-server[77619]: INFO neutron.db.ovn_revision_numbers_db [None req-3f0971f2-d131-470b-b3f2-8cf70c341311 service neutron] Successfully bumped revision number for resource 617d23f0-3fe7-4455-8222-fdb898c06ffa (type: ports) to 1 May 28 12:56:04 l75lg1-v1 neutron-server[77619]: INFO neutron.tests.unit.plugins.ml2.drivers.mechanism_logger [None req-3f0971f2-d131-470b-b3f2-8cf70c341311 service neutron] create_port_postcommit called with port settings {'id': '617d23f0-3fe7-4455-8222-fdb898c06ffa', 'name': '', 'network_id': '638fa003-195c-4f96-8899-6458dfcc8bbc', 'tenant_id': '98a6a2dcbf0248d5b353760f7757f713', 'mac_address': 'fa:16:3e:a5:9a:02', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ovnmeta-638fa003-195c-4f96-8899-6458dfcc8bbc', 'device_owner': 'network:distributed', 'standard_attr_id': 62, 'fixed_ips': [], 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'port_security_enabled': False, 'security_groups': [], 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'description': '', 'tags': [], 'created_at': '2024-05-28T12:56:04Z', 'updated_at': '2024-05-28T12:56:04Z', 'revision_number': 1, 'network': {'id': '638fa003-195c-4f96-8899-6458dfcc8bbc', 'name': 'manila_service_network', 'tenant_id': '98a6a2dcbf0248d5b353760f7757f713', 'admin_state_up': True, 'mtu': 1442, 'status': 'ACTIVE', 'subnets': [], 'standard_attr_id': 60, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'vlan_transparent': None, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2024-05-28T12:56:04Z', 'updated_at': '2024-05-28T12:56:04Z', 'revision_number': 1, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 34166}} (original settings None) host (original host None) vif type unbound (original vif type None) vif details {} (original vif details None) binding levels None (original binding levels None) on network {'id': '638fa003-195c-4f96-8899-6458dfcc8bbc', 'name': 'manila_service_network', 'tenant_id': '98a6a2dcbf0248d5b353760f7757f713', 'admin_state_up': True, 'mtu': 1442, 'status': 'ACTIVE', 'subnets': [], 'standard_attr_id': 60, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'vlan_transparent': None, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2024-05-28T12:56:04Z', 'updated_at': '2024-05-28T12:56:04Z', 'revision_number': 1, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 34166} with segments to bind None May 28 12:56:04 l75lg1-v1 neutron-server[77619]: DEBUG neutron.tests.unit.plugins.ml2.drivers.mechanism_logger [None req-3f0971f2-d131-470b-b3f2-8cf70c341311 service neutron] create_port_postcommit: May 28 12:56:04 l75lg1-v1 neutron-server[77619]: key[tenant_id], None -> 98a6a2dcbf0248d5b353760f7757f713 May 28 12:56:04 l75lg1-v1 neutron-server[77619]: key[network_id], None -> 638fa003-195c-4f96-8899-6458dfcc8bbc May 28 12:56:04 l75lg1-v1 neutron-server[77619]: key[allowed_address_pairs], None -> [] May 28 12:56:04 l75lg1-v1 neutron-server[77619]: key[binding:vif_type], None -> unbound May 28 12:56:04 l75lg1-v1 neutron-server[77619]: key[project_id], None -> 98a6a2dcbf0248d5b353760f7757f713 May 28 12:56:04 l75lg1-v1 neutron-server[77619]: key[admin_state_up], None -> True May 28 12:56:04 l75lg1-v1 neutron-server[77619]: key[id], None -> 617d23f0-3fe7-4455-8222-fdb898c06ffa May 28 12:56:04 l75lg1-v1 neutron-server[77619]: key[security_groups], None -> [] May 28 12:56:04 l75lg1-v1 neutron-server[77619]: key[extra_dhcp_opts], None -> [] May 28 12:56:04 l75lg1-v1 neutron-server[77619]: key[binding:vnic_type], None -> normal May 28 12:56:04 l75lg1-v1 neutron-server[77619]: key[tags], None -> [] May 28 12:56:04 l75lg1-v1 neutron-server[77619]: key[name], None -> May 28 12:56:04 l75lg1-v1 neutron-server[77619]: key[created_at], None -> 2024-05-28T12:56:04Z May 28 12:56:04 l75lg1-v1 neutron-server[77619]: key[status], None -> DOWN May 28 12:56:04 l75lg1-v1 neutron-server[77619]: key[binding:profile], None -> {} May 28 12:56:04 l75lg1-v1 neutron-server[77619]: key[port_security_enabled], None -> False May 28 12:56:04 l75lg1-v1 neutron-server[77619]: key[updated_at], None -> 2024-05-28T12:56:04Z May 28 12:56:04 l75lg1-v1 neutron-server[77619]: key[network], None -> {'id': '638fa003-195c-4f96-8899-6458dfcc8bbc', 'name': 'manila_service_network', 'tenant_id': '98a6a2dcbf0248d5b353760f7757f713', 'admin_state_up': True, 'mtu': 1442, 'status': 'ACTIVE', 'subnets': [], 'standard_attr_id': 60, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'vlan_transparent': None, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2024-05-28T12:56:04Z', 'updated_at': '2024-05-28T12:56:04Z', 'revision_number': 1, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 34166} May 28 12:56:04 l75lg1-v1 neutron-server[77619]: key[standard_attr_id], None -> 62 May 28 12:56:04 l75lg1-v1 neutron-server[77619]: key[device_owner], None -> network:distributed May 28 12:56:04 l75lg1-v1 neutron-server[77619]: key[device_id], None -> ovnmeta-638fa003-195c-4f96-8899-6458dfcc8bbc May 28 12:56:04 l75lg1-v1 neutron-server[77619]: key[mac_address], None -> fa:16:3e:a5:9a:02 May 28 12:56:04 l75lg1-v1 neutron-server[77619]: key[description], None -> May 28 12:56:04 l75lg1-v1 neutron-server[77619]: key[binding:host_id], None -> May 28 12:56:04 l75lg1-v1 neutron-server[77619]: key[binding:vif_details], None -> {} May 28 12:56:04 l75lg1-v1 neutron-server[77619]: key[revision_number], None -> 1 May 28 12:56:04 l75lg1-v1 neutron-server[77619]: key[fixed_ips], None -> [] May 28 12:56:04 l75lg1-v1 neutron-server[77619]: {{(pid=77619) _log_diff_call /opt/stack/neutron/neutron/tests/unit/plugins/ml2/drivers/mechanism_logger.py:59}} May 28 12:56:04 l75lg1-v1 neutron-server[77619]: INFO neutron.tests.unit.plugins.ml2.drivers.mechanism_logger [None req-3f0971f2-d131-470b-b3f2-8cf70c341311 service neutron] create_network_postcommit called with network settings {'id': '638fa003-195c-4f96-8899-6458dfcc8bbc', 'name': 'manila_service_network', 'tenant_id': '98a6a2dcbf0248d5b353760f7757f713', 'admin_state_up': True, 'mtu': 1442, 'status': 'ACTIVE', 'subnets': [], 'standard_attr_id': 60, 'shared': False, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'port_security_enabled': True, 'router:external': False, 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 34166, 'is_default': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'vlan_transparent': None, 'description': '', 'tags': [], 'created_at': '2024-05-28T12:56:04Z', 'updated_at': '2024-05-28T12:56:04Z', 'revision_number': 1} (original settings None) and network segments [{'id': '103e5ede-1b45-4a70-9058-2b289cceb77f', 'network_type': 'geneve', 'physical_network': None, 'segmentation_id': 34166, 'network_id': '638fa003-195c-4f96-8899-6458dfcc8bbc'}] May 28 12:56:04 l75lg1-v1 neutron-server[77619]: DEBUG neutron.tests.unit.plugins.ml2.drivers.mechanism_logger [None req-3f0971f2-d131-470b-b3f2-8cf70c341311 service neutron] create_network_postcommit: May 28 12:56:04 l75lg1-v1 neutron-server[77619]: key[tenant_id], None -> 98a6a2dcbf0248d5b353760f7757f713 May 28 12:56:04 l75lg1-v1 neutron-server[77619]: key[provider:network_type], None -> geneve May 28 12:56:04 l75lg1-v1 neutron-server[77619]: key[project_id], None -> 98a6a2dcbf0248d5b353760f7757f713 May 28 12:56:04 l75lg1-v1 neutron-server[77619]: key[ipv6_address_scope], None -> None May 28 12:56:04 l75lg1-v1 neutron-server[77619]: key[subnets], None -> [] May 28 12:56:04 l75lg1-v1 neutron-server[77619]: key[admin_state_up], None -> True May 28 12:56:04 l75lg1-v1 neutron-server[77619]: key[id], None -> 638fa003-195c-4f96-8899-6458dfcc8bbc May 28 12:56:04 l75lg1-v1 neutron-server[77619]: key[ipv4_address_scope], None -> None May 28 12:56:04 l75lg1-v1 neutron-server[77619]: key[tags], None -> [] May 28 12:56:04 l75lg1-v1 neutron-server[77619]: key[created_at], None -> 2024-05-28T12:56:04Z May 28 12:56:04 l75lg1-v1 neutron-server[77619]: key[status], None -> ACTIVE May 28 12:56:04 l75lg1-v1 neutron-server[77619]: key[is_default], None -> False May 28 12:56:04 l75lg1-v1 neutron-server[77619]: key[port_security_enabled], None -> True May 28 12:56:04 l75lg1-v1 neutron-server[77619]: key[vlan_transparent], None -> None May 28 12:56:04 l75lg1-v1 neutron-server[77619]: key[updated_at], None -> 2024-05-28T12:56:04Z May 28 12:56:04 l75lg1-v1 neutron-server[77619]: key[standard_attr_id], None -> 60 May 28 12:56:04 l75lg1-v1 neutron-server[77619]: key[availability_zone_hints], None -> [] May 28 12:56:04 l75lg1-v1 neutron-server[77619]: key[provider:physical_network], None -> None May 28 12:56:04 l75lg1-v1 neutron-server[77619]: key[shared], None -> False May 28 12:56:04 l75lg1-v1 neutron-server[77619]: key[mtu], None -> 1442 May 28 12:56:04 l75lg1-v1 neutron-server[77619]: key[provider:segmentation_id], None -> 34166 May 28 12:56:04 l75lg1-v1 neutron-server[77619]: key[description], None -> May 28 12:56:04 l75lg1-v1 neutron-server[77619]: key[availability_zones], None -> [] May 28 12:56:04 l75lg1-v1 neutron-server[77619]: key[revision_number], None -> 1 May 28 12:56:04 l75lg1-v1 neutron-server[77619]: key[router:external], None -> False May 28 12:56:04 l75lg1-v1 neutron-server[77619]: key[name], None -> manila_service_network May 28 12:56:04 l75lg1-v1 neutron-server[77619]: {{(pid=77619) _log_diff_call /opt/stack/neutron/neutron/tests/unit/plugins/ml2/drivers/mechanism_logger.py:59}} May 28 12:56:04 l75lg1-v1 neutron-server[77619]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3f0971f2-d131-470b-b3f2-8cf70c341311 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=77619) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:258}} May 28 12:56:04 l75lg1-v1 neutron-server[77619]: DEBUG neutron_lib.callbacks.manager [None req-3f0971f2-d131-470b-b3f2-8cf70c341311 service neutron] Publish callbacks [] for network (None), before_response {{(pid=77619) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:56:04 l75lg1-v1 neutron-server[77619]: INFO neutron.wsgi [None req-3f0971f2-d131-470b-b3f2-8cf70c341311 service neutron] 10.27.203.238 "POST /networking/v2.0/networks HTTP/1.1" status: 201 len: 862 time: 0.4895084 May 28 12:56:04 l75lg1-v1 manila-share[96151]: DEBUG oslo_concurrency.lockutils [None req-2cf6ab01-c9ac-4126-b67e-f98b4a543484 None None] Lock "service_network_id_neutron_net_helper" "released" by "manila.share.drivers.service_instance.NeutronNetworkHelper.service_network_id" :: held 0.811s {{(pid=96151) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:56:04 l75lg1-v1 manila-share[96151]: DEBUG manila.share.drivers.service_instance [None req-2cf6ab01-c9ac-4126-b67e-f98b4a543484 None None] Plugging service instance into service network 638fa003-195c-4f96-8899-6458dfcc8bbc. {{(pid=96151) setup_connectivity_with_service_instances /opt/stack/manila/manila/share/drivers/service_instance.py:980}} May 28 12:56:04 l75lg1-v1 manila-share[96151]: DEBUG oslo_concurrency.lockutils [None req-2cf6ab01-c9ac-4126-b67e-f98b4a543484 None None] Acquiring lock "service_network_id_neutron_net_helper" by "manila.share.drivers.service_instance.NeutronNetworkHelper.service_network_id" {{(pid=96151) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:56:04 l75lg1-v1 manila-share[96151]: DEBUG oslo_concurrency.lockutils [None req-2cf6ab01-c9ac-4126-b67e-f98b4a543484 None None] Lock "service_network_id_neutron_net_helper" acquired by "manila.share.drivers.service_instance.NeutronNetworkHelper.service_network_id" :: waited 0.000s {{(pid=96151) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:56:04 l75lg1-v1 manila-share[96151]: DEBUG oslo_concurrency.lockutils [None req-2cf6ab01-c9ac-4126-b67e-f98b4a543484 None None] Lock "service_network_id_neutron_net_helper" "released" by "manila.share.drivers.service_instance.NeutronNetworkHelper.service_network_id" :: held 0.000s {{(pid=96151) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:56:04 l75lg1-v1 manila-share[96151]: DEBUG oslo_concurrency.lockutils [None req-2cf6ab01-c9ac-4126-b67e-f98b4a543484 None None] Acquiring lock "service_instance_get_service_port" by "manila.share.drivers.service_instance.NeutronNetworkHelper._get_service_port" {{(pid=96151) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:56:04 l75lg1-v1 manila-share[96151]: DEBUG oslo_concurrency.lockutils [None req-2cf6ab01-c9ac-4126-b67e-f98b4a543484 None None] Lock "service_instance_get_service_port" acquired by "manila.share.drivers.service_instance.NeutronNetworkHelper._get_service_port" :: waited 0.001s {{(pid=96151) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:56:04 l75lg1-v1 manila-share[96151]: DEBUG oslo_concurrency.lockutils [None req-2cf6ab01-c9ac-4126-b67e-f98b4a543484 None None] Acquiring lock "instantiate_neutron_api_neutron_net_helper" by "manila.share.drivers.service_instance.NeutronNetworkHelper.neutron_api" {{(pid=96151) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:56:04 l75lg1-v1 manila-share[96151]: DEBUG oslo_concurrency.lockutils [None req-2cf6ab01-c9ac-4126-b67e-f98b4a543484 None None] Lock "instantiate_neutron_api_neutron_net_helper" acquired by "manila.share.drivers.service_instance.NeutronNetworkHelper.neutron_api" :: waited 0.000s {{(pid=96151) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:56:04 l75lg1-v1 manila-share[96151]: DEBUG oslo_concurrency.lockutils [None req-2cf6ab01-c9ac-4126-b67e-f98b4a543484 None None] Lock "instantiate_neutron_api_neutron_net_helper" "released" by "manila.share.drivers.service_instance.NeutronNetworkHelper.neutron_api" :: held 0.000s {{(pid=96151) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=96156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=96156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=96156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] ******************************************************************************** {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2600}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] Configuration options gathered from: {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2601}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] command line args: ['--config-file', '/etc/manila/manila.conf'] {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] config files: ['/etc/manila/manila.conf'] {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2603}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] ================================================================================ {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2605}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] admin_network_config_group = None {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] admin_only_metadata = ['__affinity_same_host', '__affinity_different_host'] {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] api_rate_limit = True {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] auth_strategy = keystone {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] backdoor_port = None {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] backdoor_socket = None {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] backend_availability_zone = None {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] capacity_weight_multiplier = 1.0 {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] cleanup_interval = 1800 {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] config_dir = [] {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] config_file = ['/etc/manila/manila.conf'] {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] config_source = [] {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] control_exchange = openstack {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] data_manager = manila.data.manager.DataManager {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] data_topic = manila-data {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] db_backend = sqlalchemy {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] db_driver = manila.db {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] debug = True {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] default_share_group_type = default {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] default_share_type = default {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] driver_handles_share_servers = None {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] enable_new_services = True {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] enabled_share_backends = ['generic1', 'generic2'] {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] enabled_share_protocols = ['NFS', 'CIFS'] {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] fatal_exception_format_errors = False {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] filter_function = None {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] ganesha_config_dir = /etc/ganesha {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] ganesha_config_path = /etc/ganesha/ganesha.conf {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] ganesha_db_path = /opt/stack/data/manila/manila-ganesha.db {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] ganesha_export_dir = /etc/ganesha/export.d {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] ganesha_export_template_dir = /etc/manila/ganesha-export-templ.d {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] ganesha_rados_export_counter = ganesha-export-counter {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] ganesha_rados_export_index = ganesha-export-index {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] ganesha_rados_store_enable = False {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] ganesha_rados_store_pool_name = None {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] ganesha_service_name = ganesha.nfsd {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] goodness_function = None {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] graceful_shutdown_timeout = 60 {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] host = l75lg1-v1 {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] instance_format = [instance: %(uuid)s] {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] is_deferred_deletion_enabled = False {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] log_config_append = None {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] log_dir = None {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] log_file = None {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] log_options = True {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] log_rotate_interval = 1 {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] log_rotate_interval_type = days {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] log_rotation_type = none {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] max_logfile_count = 30 {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] max_logfile_size_mb = 200 {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] max_over_subscription_ratio = 20.0 {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] max_share_server_size = -1 {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] max_shares_per_share_server = -1 {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] message_reap_interval = 86400 {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] message_ttl = 2592000 {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] migration_ignore_files = ['lost+found'] {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] monkey_patch = False {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] monkey_patch_modules = [] {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] my_ip = 10.27.203.238 {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] network_config_group = None {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] num_shell_tries = 3 {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] osapi_max_limit = 1000 {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] osapi_share_base_URL = None {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] osapi_share_ext_list = [] {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] osapi_share_extension = ['manila.api.contrib.standard_extensions'] {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] osapi_share_listen = :: {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] osapi_share_listen_port = 8786 {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] osapi_share_use_ssl = False {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] osapi_share_workers = 1 {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] periodic_fuzzy_delay = 60 {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] periodic_interval = 60 {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] pool_weight_multiplier = 1.0 {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] project_id_regex = [0-9a-f\-]+ {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] protocol_access_mapping = {'ip': ['nfs'], 'user': ['cifs']} {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] publish_errors = False {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] rate_limit_burst = 0 {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] rate_limit_except_level = CRITICAL {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] rate_limit_interval = 0 {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] replication_domain = None {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] report_interval = 10 {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] reserved_share_extend_percentage = 0 {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] reserved_share_from_snapshot_percentage = 0 {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] reserved_share_percentage = 0 {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] rootwrap_config = /etc/manila/rootwrap.conf {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] rpc_response_timeout = 60 {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] run_external_periodic_tasks = True {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] scheduler_default_extend_filters = ['CapacityFilter', 'DriverFilter'] {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] scheduler_default_filters = ['OnlyHostFilter', 'AvailabilityZoneFilter', 'CapacityFilter', 'CapabilitiesFilter', 'DriverFilter', 'ShareReplicationFilter', 'CreateFromSnapshotFilter', 'AffinityFilter', 'AntiAffinityFilter'] {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] scheduler_default_share_group_filters = ['AvailabilityZoneFilter', 'ConsistentSnapshotFilter'] {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] scheduler_default_weighers = ['CapacityWeigher', 'GoodnessWeigher', 'HostAffinityWeigher'] {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] scheduler_driver = manila.scheduler.drivers.filter.FilterScheduler {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] scheduler_host_manager = manila.scheduler.host_manager.HostManager {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] scheduler_json_config_location = {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] scheduler_manager = manila.scheduler.manager.SchedulerManager {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] scheduler_max_attempts = 3 {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] scheduler_topic = manila-scheduler {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] service_down_time = 60 {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] share_api_class = manila.share.api.API {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] share_backend_name = None {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] share_backup_name_template = share-backup-%s {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] share_manager = manila.share.manager.ShareManager {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] share_mount_template = mount -vt %(proto)s %(options)s %(export)s %(path)s {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] share_name_template = share-%s {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] share_snapshot_name_template = share-snapshot-%s {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] share_topic = manila-share {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] share_unmount_template = umount -v %(path)s {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] soft_deleted_share_retention_time = 604800 {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] ssh_conn_timeout = 60 {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] ssh_max_pool_conn = 10 {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] ssh_min_pool_conn = 1 {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] state_path = /opt/stack/data/manila {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] storage_availability_zone = nova {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] syslog_log_facility = LOG_USER {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] transfer_retention_time = 300 {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] transport_url = **** {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] use_eventlog = False {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] use_journal = False {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] use_json = False {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] use_scheduler_creating_share_from_snapshot = False {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] use_stderr = False {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] use_syslog = False {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] watch_log_file = False {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] oslo_concurrency.disable_process_locking = False {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] oslo_concurrency.lock_path = /opt/stack/manila/manila_locks {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] oslo_messaging_metrics.metrics_process_name = {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] oslo_policy.enforce_new_defaults = False {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] oslo_policy.enforce_scope = False {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] oslo_policy.policy_default_rule = default {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] oslo_policy.policy_file = policy.yaml {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] coordination.backend_url = **** {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] database.backend = sqlalchemy {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] database.connection = **** {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] database.connection_debug = 0 {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] database.connection_parameters = {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] database.connection_recycle_time = 3600 {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] database.connection_trace = False {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] database.db_inc_retry_interval = True {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] database.db_max_retries = 20 {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] database.db_max_retry_interval = 10 {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] database.db_retry_interval = 1 {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] database.max_overflow = 50 {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] database.max_pool_size = 40 {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] database.max_retries = 10 {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] database.mysql_sql_mode = TRADITIONAL {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] database.mysql_wsrep_sync_wait = None {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] database.pool_timeout = None {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] database.retry_interval = 10 {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] database.slave_connection = **** {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] database.sqlite_synchronous = True {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] database.use_db_reconnect = False {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] profiler.connection_string = messaging:// {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] profiler.enabled = False {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] profiler.es_doc_type = notification {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] profiler.es_scroll_size = 10000 {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] profiler.es_scroll_time = 2m {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] profiler.filter_error_trace = False {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] profiler.hmac_keys = **** {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] profiler.sentinel_service_name = mymaster {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] profiler.socket_timeout = 0.1 {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] profiler.trace_requests = False {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] profiler.trace_sqlalchemy = False {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] profiler_jaeger.process_tags = {} {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] profiler_jaeger.service_name_prefix = None {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] profiler_otlp.service_name_prefix = None {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] oslo_reports.file_event_handler = None {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] oslo_reports.file_event_handler_interval = 1 {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] oslo_reports.log_dir = None {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] oslo_messaging_rabbit.hostname = l75lg1-v1 {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] oslo_messaging_rabbit.processname = manila-scheduler {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] oslo_messaging_rabbit.ssl = False {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] oslo_messaging_rabbit.ssl_version = {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] oslo_messaging_rabbit.use_queue_manager = False {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] oslo_messaging_notifications.driver = [] {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] oslo_messaging_notifications.retry = -1 {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] oslo_messaging_notifications.transport_url = **** {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] quota.backup_gigabytes = 1000 {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] quota.backups = 10 {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] quota.driver = manila.quota.DbQuotaDriver {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] quota.gigabytes = 1000 {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] quota.max_age = 0 {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] quota.per_share_gigabytes = -1 {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] quota.replica_gigabytes = 1000 {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] quota.reservation_expire = 86400 {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] quota.share_group_snapshots = 50 {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] quota.share_groups = 50 {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] quota.share_networks = 10 {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 neutron-server[77619]: INFO neutron.wsgi [None req-52ebffa5-ceb0-4d24-91c6-0a55de99e9e6 service neutron] 10.27.203.238 "GET /networking/v2.0/ports?device_id=manila-share&binding%3Ahost_id=l75lg1-v1 HTTP/1.1" status: 200 len: 210 time: 0.0438323 May 28 12:56:04 l75lg1-v1 manila-share[96151]: DEBUG oslo_concurrency.lockutils [None req-2cf6ab01-c9ac-4126-b67e-f98b4a543484 None None] Acquiring lock "instantiate_neutron_api_neutron_net_helper" by "manila.share.drivers.service_instance.NeutronNetworkHelper.neutron_api" {{(pid=96151) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:56:04 l75lg1-v1 manila-share[96151]: DEBUG oslo_concurrency.lockutils [None req-2cf6ab01-c9ac-4126-b67e-f98b4a543484 None None] Lock "instantiate_neutron_api_neutron_net_helper" acquired by "manila.share.drivers.service_instance.NeutronNetworkHelper.neutron_api" :: waited 0.000s {{(pid=96151) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:56:04 l75lg1-v1 manila-share[96151]: DEBUG oslo_concurrency.lockutils [None req-2cf6ab01-c9ac-4126-b67e-f98b4a543484 None None] Lock "instantiate_neutron_api_neutron_net_helper" "released" by "manila.share.drivers.service_instance.NeutronNetworkHelper.neutron_api" :: held 0.000s {{(pid=96151) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:56:04 l75lg1-v1 manila-share[96151]: DEBUG oslo_concurrency.lockutils [None req-2cf6ab01-c9ac-4126-b67e-f98b4a543484 None None] Acquiring lock "instantiate_neutron_api_neutron_net_helper" by "manila.share.drivers.service_instance.NeutronNetworkHelper.neutron_api" {{(pid=96151) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:56:04 l75lg1-v1 manila-share[96151]: DEBUG oslo_concurrency.lockutils [None req-2cf6ab01-c9ac-4126-b67e-f98b4a543484 None None] Lock "instantiate_neutron_api_neutron_net_helper" acquired by "manila.share.drivers.service_instance.NeutronNetworkHelper.neutron_api" :: waited 0.000s {{(pid=96151) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:56:04 l75lg1-v1 manila-share[96151]: DEBUG oslo_concurrency.lockutils [None req-2cf6ab01-c9ac-4126-b67e-f98b4a543484 None None] Lock "instantiate_neutron_api_neutron_net_helper" "released" by "manila.share.drivers.service_instance.NeutronNetworkHelper.neutron_api" :: held 0.000s {{(pid=96151) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] quota.share_replicas = 100 {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] quota.shares = 50 {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] quota.snapshot_gigabytes = 1000 {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] quota.snapshots = 50 {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] quota.until_refresh = 0 {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] netapp_active_iq.aiq_eval_method = 0 {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] netapp_active_iq.aiq_hostname = None {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] netapp_active_iq.aiq_password = **** {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] netapp_active_iq.aiq_port = None {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] netapp_active_iq.aiq_priority_order = ['ops', 'latency', 'volume_count', 'size'] {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] netapp_active_iq.aiq_ssl_cert_path = None {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] netapp_active_iq.aiq_ssl_verify = False {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] netapp_active_iq.aiq_transport_type = https {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] netapp_active_iq.aiq_username = None {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [-] ******************************************************************************** {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2624}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] Full set of CONF: {{(pid=96156) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:363}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2600}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] Configuration options gathered from: {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2601}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] command line args: ['--config-file', '/etc/manila/manila.conf'] {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] config files: ['/etc/manila/manila.conf'] {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2603}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] ================================================================================ {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2605}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] admin_network_config_group = None {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] admin_only_metadata = ['__affinity_same_host', '__affinity_different_host'] {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 neutron-server[77619]: DEBUG neutron.wsgi [None req-1be7ed70-8153-4339-a166-ecef8661942f service neutron] http://10.27.203.238:9696/networking/v2.0/extensions returned with HTTP 200 {{(pid=77619) __call__ /opt/stack/neutron/neutron/wsgi.py:730}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] api_rate_limit = True {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] auth_strategy = keystone {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] backdoor_port = None {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] backdoor_socket = None {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] backend_availability_zone = None {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] capacity_weight_multiplier = 1.0 {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] cleanup_interval = 1800 {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] config_dir = [] {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 neutron-server[77619]: INFO neutron.wsgi [None req-1be7ed70-8153-4339-a166-ecef8661942f service neutron] 10.27.203.238 "GET /networking/v2.0/extensions HTTP/1.1" status: 200 len: 13594 time: 0.0039525 May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] config_file = ['/etc/manila/manila.conf'] {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] config_source = [] {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] control_exchange = openstack {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] data_manager = manila.data.manager.DataManager {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] data_topic = manila-data {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] db_backend = sqlalchemy {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] db_driver = manila.db {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] debug = True {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] default_share_group_type = default {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] default_share_type = default {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] driver_handles_share_servers = None {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] enable_new_services = True {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] enabled_share_backends = ['generic1', 'generic2'] {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] enabled_share_protocols = ['NFS', 'CIFS'] {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] fatal_exception_format_errors = False {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] filter_function = None {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] ganesha_config_dir = /etc/ganesha {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] ganesha_config_path = /etc/ganesha/ganesha.conf {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] ganesha_db_path = /opt/stack/data/manila/manila-ganesha.db {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] ganesha_export_dir = /etc/ganesha/export.d {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] ganesha_export_template_dir = /etc/manila/ganesha-export-templ.d {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] ganesha_rados_export_counter = ganesha-export-counter {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] ganesha_rados_export_index = ganesha-export-index {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] ganesha_rados_store_enable = False {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] ganesha_rados_store_pool_name = None {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] ganesha_service_name = ganesha.nfsd {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] goodness_function = None {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] graceful_shutdown_timeout = 60 {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] host = l75lg1-v1 {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] instance_format = [instance: %(uuid)s] {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] is_deferred_deletion_enabled = False {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] log_config_append = None {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] log_dir = None {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] log_file = None {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] log_options = True {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] log_rotate_interval = 1 {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] log_rotate_interval_type = days {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] log_rotation_type = none {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 neutron-server[77619]: DEBUG neutron.api.v2.base [None req-ec97c996-f7e8-431b-b5eb-1a158aa2427f service neutron] Request body: {'port': {'network_id': '638fa003-195c-4f96-8899-6458dfcc8bbc', 'admin_state_up': True, 'tenant_id': '98a6a2dcbf0248d5b353760f7757f713', 'port_security_enabled': False, 'binding:host_id': 'l75lg1-v1', 'device_owner': 'manila:share', 'device_id': 'manila-share'}} {{(pid=77619) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:734}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] max_logfile_count = 30 {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] max_logfile_size_mb = 200 {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] max_over_subscription_ratio = 20.0 {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] max_share_server_size = -1 {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] max_shares_per_share_server = -1 {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] message_reap_interval = 86400 {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] message_ttl = 2592000 {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] migration_ignore_files = ['lost+found'] {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] monkey_patch = False {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] monkey_patch_modules = [] {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] my_ip = 10.27.203.238 {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] network_config_group = None {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] num_shell_tries = 3 {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] osapi_max_limit = 1000 {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] osapi_share_base_URL = None {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] osapi_share_ext_list = [] {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] osapi_share_extension = ['manila.api.contrib.standard_extensions'] {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] osapi_share_listen = :: {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] osapi_share_listen_port = 8786 {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] osapi_share_use_ssl = False {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] osapi_share_workers = 1 {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] periodic_fuzzy_delay = 60 {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] periodic_interval = 60 {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] pool_weight_multiplier = 1.0 {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] project_id_regex = [0-9a-f\-]+ {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] protocol_access_mapping = {'ip': ['nfs'], 'user': ['cifs']} {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] publish_errors = False {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] rate_limit_burst = 0 {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] rate_limit_except_level = CRITICAL {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] rate_limit_interval = 0 {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] replication_domain = None {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] report_interval = 10 {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] reserved_share_extend_percentage = 0 {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] reserved_share_from_snapshot_percentage = 0 {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] reserved_share_percentage = 0 {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] rootwrap_config = /etc/manila/rootwrap.conf {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] rpc_response_timeout = 60 {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] run_external_periodic_tasks = True {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] scheduler_default_extend_filters = ['CapacityFilter', 'DriverFilter'] {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] scheduler_default_filters = ['OnlyHostFilter', 'AvailabilityZoneFilter', 'CapacityFilter', 'CapabilitiesFilter', 'DriverFilter', 'ShareReplicationFilter', 'CreateFromSnapshotFilter', 'AffinityFilter', 'AntiAffinityFilter'] {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] scheduler_default_share_group_filters = ['AvailabilityZoneFilter', 'ConsistentSnapshotFilter'] {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] scheduler_default_weighers = ['CapacityWeigher', 'GoodnessWeigher', 'HostAffinityWeigher'] {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] scheduler_driver = manila.scheduler.drivers.filter.FilterScheduler {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] scheduler_host_manager = manila.scheduler.host_manager.HostManager {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] scheduler_json_config_location = {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] scheduler_manager = manila.scheduler.manager.SchedulerManager {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] scheduler_max_attempts = 3 {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] scheduler_topic = manila-scheduler {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] service_down_time = 60 {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] share_api_class = manila.share.api.API {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] share_backend_name = None {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] share_backup_name_template = share-backup-%s {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] share_manager = manila.share.manager.ShareManager {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] share_mount_template = mount -vt %(proto)s %(options)s %(export)s %(path)s {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] share_name_template = share-%s {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] share_snapshot_name_template = share-snapshot-%s {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] share_topic = manila-share {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] share_unmount_template = umount -v %(path)s {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] soft_deleted_share_retention_time = 604800 {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] ssh_conn_timeout = 60 {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] ssh_max_pool_conn = 10 {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] ssh_min_pool_conn = 1 {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] state_path = /opt/stack/data/manila {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] storage_availability_zone = nova {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] syslog_log_facility = LOG_USER {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] transfer_retention_time = 300 {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] transport_url = **** {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] use_eventlog = False {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] use_journal = False {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] use_json = False {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] use_scheduler_creating_share_from_snapshot = False {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] use_stderr = False {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] use_syslog = False {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] watch_log_file = False {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] oslo_concurrency.disable_process_locking = False {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-share[96506]: DEBUG dbcounter [-] [96506] Writer thread running {{(pid=96506) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] oslo_concurrency.lock_path = /opt/stack/manila/manila_locks {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_process_name = {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] oslo_policy.enforce_new_defaults = False {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] oslo_policy.enforce_scope = False {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] oslo_policy.policy_default_rule = default {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] oslo_policy.policy_file = policy.yaml {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] coordination.backend_url = **** {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] database.backend = sqlalchemy {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] database.connection = **** {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] database.connection_debug = 0 {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] database.connection_parameters = {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] database.connection_recycle_time = 3600 {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] database.connection_trace = False {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] database.db_inc_retry_interval = True {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] database.db_max_retries = 20 {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] database.db_max_retry_interval = 10 {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] database.db_retry_interval = 1 {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] database.max_overflow = 50 {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] database.max_pool_size = 40 {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] database.max_retries = 10 {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] database.mysql_sql_mode = TRADITIONAL {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] database.mysql_wsrep_sync_wait = None {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] database.pool_timeout = None {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] database.retry_interval = 10 {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] database.slave_connection = **** {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] database.sqlite_synchronous = True {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] database.use_db_reconnect = False {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] profiler.connection_string = messaging:// {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] profiler.enabled = False {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] profiler.es_doc_type = notification {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] profiler.es_scroll_size = 10000 {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] profiler.es_scroll_time = 2m {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] profiler.filter_error_trace = False {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] profiler.hmac_keys = **** {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] profiler.sentinel_service_name = mymaster {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] profiler.socket_timeout = 0.1 {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] profiler.trace_requests = False {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] profiler.trace_sqlalchemy = False {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 neutron-server[77619]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ec97c996-f7e8-431b-b5eb-1a158aa2427f service neutron] Made reservation on behalf of 98a6a2dcbf0248d5b353760f7757f713 for: {'port': 1} {{(pid=77619) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] profiler_jaeger.process_tags = {} {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] profiler_jaeger.service_name_prefix = None {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] profiler_otlp.service_name_prefix = None {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] oslo_reports.file_event_handler = None {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] oslo_reports.file_event_handler_interval = 1 {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] oslo_reports.log_dir = None {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.hostname = l75lg1-v1 {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.processname = manila-scheduler {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 neutron-server[77619]: DEBUG neutron_lib.callbacks.manager [None req-ec97c996-f7e8-431b-b5eb-1a158aa2427f service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1015114'] for port (None), before_create {{(pid=77619) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl = False {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_version = {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.use_queue_manager = False {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] oslo_messaging_notifications.driver = [] {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] oslo_messaging_notifications.retry = -1 {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] oslo_messaging_notifications.transport_url = **** {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] quota.backup_gigabytes = 1000 {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] quota.backups = 10 {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] quota.driver = manila.quota.DbQuotaDriver {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] quota.gigabytes = 1000 {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] quota.max_age = 0 {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] quota.per_share_gigabytes = -1 {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] quota.replica_gigabytes = 1000 {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] quota.reservation_expire = 86400 {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] quota.share_group_snapshots = 50 {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] quota.share_groups = 50 {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] quota.share_networks = 10 {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] quota.share_replicas = 100 {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] quota.shares = 50 {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] quota.snapshot_gigabytes = 1000 {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] quota.snapshots = 50 {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] quota.until_refresh = 0 {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] netapp_active_iq.aiq_eval_method = 0 {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] netapp_active_iq.aiq_hostname = None {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] netapp_active_iq.aiq_password = **** {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] netapp_active_iq.aiq_port = None {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] netapp_active_iq.aiq_priority_order = ['ops', 'latency', 'volume_count', 'size'] {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] netapp_active_iq.aiq_ssl_cert_path = None {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] netapp_active_iq.aiq_ssl_verify = False {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] netapp_active_iq.aiq_transport_type = https {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] netapp_active_iq.aiq_username = None {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=96156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2624}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: INFO manila.service [-] Starting manila-scheduler node (version 18.1.0) May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_db.api [None req-3eaf3fba-24e4-42cf-adb4-93f739d9a927 None None] Loading backend 'sqlalchemy' from 'manila.db.sqlalchemy.api' {{(pid=96156) _load_backend /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/api.py:259}} May 28 12:56:04 l75lg1-v1 manila-share[96506]: DEBUG manila.share.manager [None req-6c173bbc-673a-4c3c-a470-52ad1ebf882a None None] Start initialization of driver: 'GenericShareDriver@l75lg1-v1@generic1' {{(pid=96506) _driver_setup /opt/stack/manila/manila/share/manager.py:369}} May 28 12:56:04 l75lg1-v1 manila-share[96506]: DEBUG oslo_concurrency.lockutils [None req-6c173bbc-673a-4c3c-a470-52ad1ebf882a None None] Acquiring lock "instantiate_network_helper" by "manila.share.drivers.service_instance.ServiceInstanceManager.network_helper" {{(pid=96506) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:56:04 l75lg1-v1 manila-share[96506]: DEBUG oslo_concurrency.lockutils [None req-6c173bbc-673a-4c3c-a470-52ad1ebf882a None None] Lock "instantiate_network_helper" acquired by "manila.share.drivers.service_instance.ServiceInstanceManager.network_helper" :: waited 0.001s {{(pid=96506) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:56:04 l75lg1-v1 manila-share[96506]: DEBUG oslo_concurrency.lockutils [None req-6c173bbc-673a-4c3c-a470-52ad1ebf882a None None] Acquiring lock "service_network_id_neutron_net_helper" by "manila.share.drivers.service_instance.NeutronNetworkHelper.service_network_id" {{(pid=96506) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:56:04 l75lg1-v1 manila-share[96506]: DEBUG oslo_concurrency.lockutils [None req-6c173bbc-673a-4c3c-a470-52ad1ebf882a None None] Lock "service_network_id_neutron_net_helper" acquired by "manila.share.drivers.service_instance.NeutronNetworkHelper.service_network_id" :: waited 0.001s {{(pid=96506) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:56:04 l75lg1-v1 manila-share[96506]: DEBUG manila.coordination [None req-6c173bbc-673a-4c3c-a470-52ad1ebf882a None None] Lock "service_instance_get_service_network" acquired by "_get_service_network_id". {{(pid=96506) _synchronized /opt/stack/manila/manila/coordination.py:199}} May 28 12:56:04 l75lg1-v1 manila-share[96506]: DEBUG oslo_concurrency.lockutils [None req-6c173bbc-673a-4c3c-a470-52ad1ebf882a None None] Acquiring lock "instantiate_neutron_api_neutron_net_helper" by "manila.share.drivers.service_instance.NeutronNetworkHelper.neutron_api" {{(pid=96506) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:56:04 l75lg1-v1 manila-share[96506]: DEBUG oslo_concurrency.lockutils [None req-6c173bbc-673a-4c3c-a470-52ad1ebf882a None None] Lock "instantiate_neutron_api_neutron_net_helper" acquired by "manila.share.drivers.service_instance.NeutronNetworkHelper.neutron_api" :: waited 0.000s {{(pid=96506) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:56:04 l75lg1-v1 manila-share[96506]: DEBUG oslo_concurrency.lockutils [None req-6c173bbc-673a-4c3c-a470-52ad1ebf882a None None] Lock "instantiate_neutron_api_neutron_net_helper" "released" by "manila.share.drivers.service_instance.NeutronNetworkHelper.neutron_api" :: held 0.001s {{(pid=96506) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:56:04 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88bf862-7d83-4cbb-a6dc-34c56c33b316 None None] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:04 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88bf862-7d83-4cbb-a6dc-34c56c33b316 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:04 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88bf862-7d83-4cbb-a6dc-34c56c33b316 None None] PATH_INFO: `/` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:04 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 609/1204] 10.27.203.238 () {58 vars in 1008 bytes} [Tue May 28 12:56:04 2024] GET /identity => generated 272 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:56:04 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9596043-c854-4646-938b-9816fc5b65a1 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:04 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9596043-c854-4646-938b-9816fc5b65a1 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:04 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9596043-c854-4646-938b-9816fc5b65a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:04 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-b9596043-c854-4646-938b-9816fc5b65a1 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:56:04 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-b9596043-c854-4646-938b-9816fc5b65a1 None None] MFA Rules not processed for user `8ef17047035e4b518fd5360a01f2da1a`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:56:04 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-b9596043-c854-4646-938b-9816fc5b65a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:04 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 596/1205] 10.27.203.238 () {62 vars in 1105 bytes} [Tue May 28 12:56:04 2024] POST /identity/v3/auth/tokens => generated 3810 bytes in 25 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:56:04 l75lg1-v1 neutron-server[77618]: DEBUG neutron.wsgi [-] (77618) accepted ('10.27.203.238', 58550) {{(pid=77618) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 12:56:04 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88bf862-7d83-4cbb-a6dc-34c56c33b316 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:04 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88bf862-7d83-4cbb-a6dc-34c56c33b316 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:04 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb638d21-7be5-4e28-917e-abad407af45c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef17047035e4b518fd5360a01f2da1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:04 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb638d21-7be5-4e28-917e-abad407af45c service neutron] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:04 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb638d21-7be5-4e28-917e-abad407af45c service neutron] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:04 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb638d21-7be5-4e28-917e-abad407af45c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:04 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb638d21-7be5-4e28-917e-abad407af45c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:04 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb638d21-7be5-4e28-917e-abad407af45c service neutron] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:04 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 610/1206] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 12:56:04 2024] GET /identity/v3/auth/tokens => generated 3810 bytes in 21 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 12:56:04 l75lg1-v1 neutron-server[77619]: DEBUG neutron_lib.callbacks.manager [None req-ec97c996-f7e8-431b-b5eb-1a158aa2427f service neutron] Publish callbacks [] for port (b338c4f5-8673-429c-875b-cc66f586099b), precommit_create {{(pid=77619) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG passlib.utils.compat [None req-3eaf3fba-24e4-42cf-adb4-93f739d9a927 None None] loaded lazy attr 'SafeConfigParser': {{(pid=96156) __getattr__ /opt/stack/data/venv/lib/python3.10/site-packages/passlib/utils/compat/__init__.py:449}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG passlib.utils.compat [None req-3eaf3fba-24e4-42cf-adb4-93f739d9a927 None None] loaded lazy attr 'NativeStringIO': {{(pid=96156) __getattr__ /opt/stack/data/venv/lib/python3.10/site-packages/passlib/utils/compat/__init__.py:449}} May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: DEBUG passlib.utils.compat [None req-3eaf3fba-24e4-42cf-adb4-93f739d9a927 None None] loaded lazy attr 'BytesIO': {{(pid=96156) __getattr__ /opt/stack/data/venv/lib/python3.10/site-packages/passlib/utils/compat/__init__.py:449}} May 28 12:56:04 l75lg1-v1 neutron-server[77619]: DEBUG neutron.db.provisioning_blocks [None req-ec97c996-f7e8-431b-b5eb-1a158aa2427f service neutron] Transition to ACTIVE for port object b338c4f5-8673-429c-875b-cc66f586099b will not be triggered until provisioned by entity L2. {{(pid=77619) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:74}} May 28 12:56:04 l75lg1-v1 neutron-server[77619]: DEBUG neutron.db.ovn_revision_numbers_db [None req-ec97c996-f7e8-431b-b5eb-1a158aa2427f service neutron] create_initial_revision uuid=b338c4f5-8673-429c-875b-cc66f586099b, type=ports, rev=-1 {{(pid=77619) create_initial_revision /opt/stack/neutron/neutron/db/ovn_revision_numbers_db.py:108}} May 28 12:56:04 l75lg1-v1 neutron-server[77619]: INFO neutron.tests.unit.plugins.ml2.drivers.mechanism_logger [None req-ec97c996-f7e8-431b-b5eb-1a158aa2427f service neutron] create_port_precommit called with port settings {'id': 'b338c4f5-8673-429c-875b-cc66f586099b', 'name': '', 'network_id': '638fa003-195c-4f96-8899-6458dfcc8bbc', 'tenant_id': '98a6a2dcbf0248d5b353760f7757f713', 'mac_address': 'fa:16:3e:59:b7:84', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'manila-share', 'device_owner': 'manila:share', 'standard_attr_id': 63, 'fixed_ips': [], 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'port_security_enabled': False, 'security_groups': [], 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'l75lg1-v1', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'allowed_address_pairs': []} (original settings None) host l75lg1-v1 (original host None) vif type unbound (original vif type None) vif details {} (original vif details None) binding levels None (original binding levels None) on network {'id': '638fa003-195c-4f96-8899-6458dfcc8bbc', 'name': 'manila_service_network', 'tenant_id': '98a6a2dcbf0248d5b353760f7757f713', 'admin_state_up': True, 'mtu': 1442, 'status': 'ACTIVE', 'subnets': [], 'standard_attr_id': 60, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'vlan_transparent': None, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2024-05-28T12:56:04Z', 'updated_at': '2024-05-28T12:56:04Z', 'revision_number': 1, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 34166} with segments to bind None May 28 12:56:04 l75lg1-v1 neutron-server[77619]: DEBUG neutron.tests.unit.plugins.ml2.drivers.mechanism_logger [None req-ec97c996-f7e8-431b-b5eb-1a158aa2427f service neutron] create_port_precommit: May 28 12:56:04 l75lg1-v1 neutron-server[77619]: key[tenant_id], None -> 98a6a2dcbf0248d5b353760f7757f713 May 28 12:56:04 l75lg1-v1 neutron-server[77619]: key[network_id], None -> 638fa003-195c-4f96-8899-6458dfcc8bbc May 28 12:56:04 l75lg1-v1 neutron-server[77619]: key[allowed_address_pairs], None -> [] May 28 12:56:04 l75lg1-v1 neutron-server[77619]: key[binding:vif_type], None -> unbound May 28 12:56:04 l75lg1-v1 neutron-server[77619]: key[project_id], None -> 98a6a2dcbf0248d5b353760f7757f713 May 28 12:56:04 l75lg1-v1 neutron-server[77619]: key[admin_state_up], None -> True May 28 12:56:04 l75lg1-v1 neutron-server[77619]: key[id], None -> b338c4f5-8673-429c-875b-cc66f586099b May 28 12:56:04 l75lg1-v1 neutron-server[77619]: key[security_groups], None -> [] May 28 12:56:04 l75lg1-v1 neutron-server[77619]: key[binding:vnic_type], None -> normal May 28 12:56:04 l75lg1-v1 neutron-server[77619]: key[name], None -> May 28 12:56:04 l75lg1-v1 neutron-server[77619]: key[status], None -> DOWN May 28 12:56:04 l75lg1-v1 neutron-server[77619]: key[binding:profile], None -> {} May 28 12:56:04 l75lg1-v1 neutron-server[77619]: key[port_security_enabled], None -> False May 28 12:56:04 l75lg1-v1 neutron-server[77619]: key[standard_attr_id], None -> 63 May 28 12:56:04 l75lg1-v1 neutron-server[77619]: key[device_owner], None -> manila:share May 28 12:56:04 l75lg1-v1 neutron-server[77619]: key[device_id], None -> manila-share May 28 12:56:04 l75lg1-v1 neutron-server[77619]: key[mac_address], None -> fa:16:3e:59:b7:84 May 28 12:56:04 l75lg1-v1 neutron-server[77619]: key[binding:host_id], None -> l75lg1-v1 May 28 12:56:04 l75lg1-v1 neutron-server[77619]: key[binding:vif_details], None -> {} May 28 12:56:04 l75lg1-v1 neutron-server[77619]: key[fixed_ips], None -> [] May 28 12:56:04 l75lg1-v1 neutron-server[77619]: {{(pid=77619) _log_diff_call /opt/stack/neutron/neutron/tests/unit/plugins/ml2/drivers/mechanism_logger.py:59}} May 28 12:56:04 l75lg1-v1 neutron-server[77619]: DEBUG neutron_lib.callbacks.manager [None req-ec97c996-f7e8-431b-b5eb-1a158aa2427f service neutron] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4166243'] for port (b338c4f5-8673-429c-875b-cc66f586099b), after_create {{(pid=77619) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:56:04 l75lg1-v1 neutron-server[77619]: DEBUG ovsdbapp.backend.ovs_idl.transaction [None req-53cecb61-7023-41e4-a5ea-23b1eb02606a None None] Running txn n=1 command(idx=0): AddLSwitchPortCommand(_result=None, lport=b338c4f5-8673-429c-875b-cc66f586099b, lswitch=neutron-638fa003-195c-4f96-8899-6458dfcc8bbc, may_exist=True, columns={'addresses': ['unknown'], 'external_ids': {'neutron:port_name': '', 'neutron:device_id': 'manila-share', 'neutron:project_id': '98a6a2dcbf0248d5b353760f7757f713', 'neutron:cidrs': '', 'neutron:device_owner': 'manila:share', 'neutron:subnet_pool_addr_scope4': '', 'neutron:subnet_pool_addr_scope6': '', 'neutron:network_name': 'neutron-638fa003-195c-4f96-8899-6458dfcc8bbc', 'neutron:security_group_ids': '', 'neutron:revision_number': '1', 'neutron:vnic_type': 'normal', 'neutron:port_capabilities': '', 'neutron:mtu': ''}, 'parent_name': [], 'tag': [], 'enabled': True, 'options': {'requested-chassis': 'l75lg1-v1', 'mcast_flood_reports': 'true'}, 'type': '', 'port_security': [], 'dhcpv4_options': [], 'dhcpv6_options': []}) {{(pid=77619) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:56:04 l75lg1-v1 neutron-server[77619]: DEBUG ovsdbapp.backend.ovs_idl.transaction [None req-53cecb61-7023-41e4-a5ea-23b1eb02606a None None] Running txn n=1 command(idx=1): QoSDelCommand(_result=None, switch=neutron-638fa003-195c-4f96-8899-6458dfcc8bbc, conditions=[('direction', '=', 'to-lport'), ('priority', '=', 2002), ('match', '=', 'outport == "b338c4f5-8673-429c-875b-cc66f586099b"')], if_exists=True) {{(pid=77619) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:56:04 l75lg1-v1 neutron-server[77619]: DEBUG ovsdbapp.backend.ovs_idl.transaction [None req-53cecb61-7023-41e4-a5ea-23b1eb02606a None None] Running txn n=1 command(idx=2): UpdateLSwitchPortQosOptionsCommand(_result=None, lport=AddLSwitchPortCommand(_result=51545c43-6452-44e3-b722-7fc623989789, lport=b338c4f5-8673-429c-875b-cc66f586099b, lswitch=neutron-638fa003-195c-4f96-8899-6458dfcc8bbc, may_exist=True, columns={'addresses': ['unknown'], 'external_ids': {'neutron:port_name': '', 'neutron:device_id': 'manila-share', 'neutron:project_id': '98a6a2dcbf0248d5b353760f7757f713', 'neutron:cidrs': '', 'neutron:device_owner': 'manila:share', 'neutron:subnet_pool_addr_scope4': '', 'neutron:subnet_pool_addr_scope6': '', 'neutron:network_name': 'neutron-638fa003-195c-4f96-8899-6458dfcc8bbc', 'neutron:security_group_ids': '', 'neutron:revision_number': '1', 'neutron:vnic_type': 'normal', 'neutron:port_capabilities': '', 'neutron:mtu': ''}, 'parent_name': [], 'enabled': True, 'options': {'requested-chassis': 'l75lg1-v1', 'mcast_flood_reports': 'true'}, 'type': '', 'port_security': []}), if_exists=True, qos={'qos_min_rate': None}) {{(pid=77619) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:56:04 l75lg1-v1 neutron-server[77619]: DEBUG ovsdbapp.backend.ovs_idl.transaction [None req-53cecb61-7023-41e4-a5ea-23b1eb02606a None None] Running txn n=1 command(idx=3): QoSDelCommand(_result=None, switch=neutron-638fa003-195c-4f96-8899-6458dfcc8bbc, conditions=[('direction', '=', 'from-lport'), ('priority', '=', 2002), ('match', '=', 'inport == "b338c4f5-8673-429c-875b-cc66f586099b"')], if_exists=True) {{(pid=77619) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:56:04 l75lg1-v1 neutron-server[77619]: DEBUG ovsdbapp.backend.ovs_idl.transaction [None req-53cecb61-7023-41e4-a5ea-23b1eb02606a None None] Running txn n=1 command(idx=4): UpdateLSwitchPortQosOptionsCommand(_result=None, lport=AddLSwitchPortCommand(_result=51545c43-6452-44e3-b722-7fc623989789, lport=b338c4f5-8673-429c-875b-cc66f586099b, lswitch=neutron-638fa003-195c-4f96-8899-6458dfcc8bbc, may_exist=True, columns={'addresses': ['unknown'], 'external_ids': {'neutron:port_name': '', 'neutron:device_id': 'manila-share', 'neutron:project_id': '98a6a2dcbf0248d5b353760f7757f713', 'neutron:cidrs': '', 'neutron:device_owner': 'manila:share', 'neutron:subnet_pool_addr_scope4': '', 'neutron:subnet_pool_addr_scope6': '', 'neutron:network_name': 'neutron-638fa003-195c-4f96-8899-6458dfcc8bbc', 'neutron:security_group_ids': '', 'neutron:revision_number': '1', 'neutron:vnic_type': 'normal', 'neutron:port_capabilities': '', 'neutron:mtu': ''}, 'parent_name': [], 'enabled': True, 'options': {'requested-chassis': 'l75lg1-v1', 'mcast_flood_reports': 'true'}, 'type': '', 'port_security': []}), if_exists=True, qos={'qos_min_rate': None}) {{(pid=77619) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:56:04 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-53cecb61-7023-41e4-a5ea-23b1eb02606a None None] Hash Ring: Node c89b3497-133e-4a5a-b67a-3310d2cb2485 (host: l75lg1-v1) handling event "create" for row 17d3c686-794f-4634-9d44-bd127b700ee4 (table: Logical_Switch_Port) {{(pid=77619) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:56:04 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-53cecb61-7023-41e4-a5ea-23b1eb02606a None None] Hash Ring: Node c89b3497-133e-4a5a-b67a-3310d2cb2485 (host: l75lg1-v1) handling event "update" for row 17d3c686-794f-4634-9d44-bd127b700ee4 (table: Logical_Switch_Port) {{(pid=77619) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:56:04 l75lg1-v1 neutron-server[77618]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-d9d4969c-e9ae-4d76-91b0-9b7c8eb907b3 None None] Hash Ring: Node 4c6fc793-7f5a-456f-b4d6-6e5bd97592f2 (host: l75lg1-v1) handling event "create" for row 4b597082-5316-4c1f-b2c1-bb5589b3b367 (table: Port_Binding) {{(pid=77618) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:56:04 l75lg1-v1 neutron-server[77618]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-c63b1acc-b5c6-4be8-9db9-04824fec27f2 None None] Hash Ring: Node 4c6fc793-7f5a-456f-b4d6-6e5bd97592f2 (host: l75lg1-v1) handling event "update" for row 805d6ab3-14ec-4e2e-94f6-e4eb06fe959b (table: Logical_Switch) {{(pid=77618) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:56:04 l75lg1-v1 neutron-server[77619]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ec97c996-f7e8-431b-b5eb-1a158aa2427f service neutron] Pushing event updated for resources: {'Port': ['ID=b338c4f5-8673-429c-875b-cc66f586099b,revision_number=1']} {{(pid=77619) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 28 12:56:04 l75lg1-v1 neutron-server[77619]: INFO neutron.db.ovn_revision_numbers_db [None req-ec97c996-f7e8-431b-b5eb-1a158aa2427f service neutron] Successfully bumped revision number for resource b338c4f5-8673-429c-875b-cc66f586099b (type: ports) to 1 May 28 12:56:04 l75lg1-v1 neutron-server[77619]: INFO neutron.tests.unit.plugins.ml2.drivers.mechanism_logger [None req-ec97c996-f7e8-431b-b5eb-1a158aa2427f service neutron] create_port_postcommit called with port settings {'id': 'b338c4f5-8673-429c-875b-cc66f586099b', 'name': '', 'network_id': '638fa003-195c-4f96-8899-6458dfcc8bbc', 'tenant_id': '98a6a2dcbf0248d5b353760f7757f713', 'mac_address': 'fa:16:3e:59:b7:84', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'manila-share', 'device_owner': 'manila:share', 'standard_attr_id': 63, 'fixed_ips': [], 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'port_security_enabled': False, 'security_groups': [], 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'l75lg1-v1', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'description': '', 'tags': [], 'created_at': '2024-05-28T12:56:04Z', 'updated_at': '2024-05-28T12:56:04Z', 'revision_number': 1, 'network': {'id': '638fa003-195c-4f96-8899-6458dfcc8bbc', 'name': 'manila_service_network', 'tenant_id': '98a6a2dcbf0248d5b353760f7757f713', 'admin_state_up': True, 'mtu': 1442, 'status': 'ACTIVE', 'subnets': [], 'standard_attr_id': 60, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'vlan_transparent': None, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2024-05-28T12:56:04Z', 'updated_at': '2024-05-28T12:56:04Z', 'revision_number': 1, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 34166}} (original settings None) host l75lg1-v1 (original host None) vif type unbound (original vif type None) vif details {} (original vif details None) binding levels None (original binding levels None) on network {'id': '638fa003-195c-4f96-8899-6458dfcc8bbc', 'name': 'manila_service_network', 'tenant_id': '98a6a2dcbf0248d5b353760f7757f713', 'admin_state_up': True, 'mtu': 1442, 'status': 'ACTIVE', 'subnets': [], 'standard_attr_id': 60, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'vlan_transparent': None, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2024-05-28T12:56:04Z', 'updated_at': '2024-05-28T12:56:04Z', 'revision_number': 1, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 34166} with segments to bind None May 28 12:56:04 l75lg1-v1 neutron-server[77619]: DEBUG neutron.tests.unit.plugins.ml2.drivers.mechanism_logger [None req-ec97c996-f7e8-431b-b5eb-1a158aa2427f service neutron] create_port_postcommit: May 28 12:56:04 l75lg1-v1 neutron-server[77619]: key[tenant_id], None -> 98a6a2dcbf0248d5b353760f7757f713 May 28 12:56:04 l75lg1-v1 neutron-server[77619]: key[network_id], None -> 638fa003-195c-4f96-8899-6458dfcc8bbc May 28 12:56:04 l75lg1-v1 neutron-server[77619]: key[allowed_address_pairs], None -> [] May 28 12:56:04 l75lg1-v1 neutron-server[77619]: key[binding:vif_type], None -> unbound May 28 12:56:04 l75lg1-v1 neutron-server[77619]: key[project_id], None -> 98a6a2dcbf0248d5b353760f7757f713 May 28 12:56:04 l75lg1-v1 neutron-server[77619]: key[admin_state_up], None -> True May 28 12:56:04 l75lg1-v1 neutron-server[77619]: key[id], None -> b338c4f5-8673-429c-875b-cc66f586099b May 28 12:56:04 l75lg1-v1 neutron-server[77619]: key[security_groups], None -> [] May 28 12:56:04 l75lg1-v1 neutron-server[77619]: key[extra_dhcp_opts], None -> [] May 28 12:56:04 l75lg1-v1 neutron-server[77619]: key[binding:vnic_type], None -> normal May 28 12:56:04 l75lg1-v1 neutron-server[77619]: key[tags], None -> [] May 28 12:56:04 l75lg1-v1 neutron-server[77619]: key[name], None -> May 28 12:56:04 l75lg1-v1 neutron-server[77619]: key[created_at], None -> 2024-05-28T12:56:04Z May 28 12:56:04 l75lg1-v1 neutron-server[77619]: key[status], None -> DOWN May 28 12:56:04 l75lg1-v1 neutron-server[77619]: key[binding:profile], None -> {} May 28 12:56:04 l75lg1-v1 neutron-server[77619]: key[port_security_enabled], None -> False May 28 12:56:04 l75lg1-v1 neutron-server[77619]: key[updated_at], None -> 2024-05-28T12:56:04Z May 28 12:56:04 l75lg1-v1 neutron-server[77619]: key[network], None -> {'id': '638fa003-195c-4f96-8899-6458dfcc8bbc', 'name': 'manila_service_network', 'tenant_id': '98a6a2dcbf0248d5b353760f7757f713', 'admin_state_up': True, 'mtu': 1442, 'status': 'ACTIVE', 'subnets': [], 'standard_attr_id': 60, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'vlan_transparent': None, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2024-05-28T12:56:04Z', 'updated_at': '2024-05-28T12:56:04Z', 'revision_number': 1, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 34166} May 28 12:56:04 l75lg1-v1 neutron-server[77619]: key[standard_attr_id], None -> 63 May 28 12:56:04 l75lg1-v1 neutron-server[77619]: key[device_owner], None -> manila:share May 28 12:56:04 l75lg1-v1 neutron-server[77619]: key[device_id], None -> manila-share May 28 12:56:04 l75lg1-v1 neutron-server[77619]: key[mac_address], None -> fa:16:3e:59:b7:84 May 28 12:56:04 l75lg1-v1 neutron-server[77619]: key[description], None -> May 28 12:56:04 l75lg1-v1 neutron-server[77619]: key[binding:host_id], None -> l75lg1-v1 May 28 12:56:04 l75lg1-v1 neutron-server[77619]: key[binding:vif_details], None -> {} May 28 12:56:04 l75lg1-v1 neutron-server[77619]: key[revision_number], None -> 1 May 28 12:56:04 l75lg1-v1 neutron-server[77619]: key[fixed_ips], None -> [] May 28 12:56:04 l75lg1-v1 neutron-server[77619]: {{(pid=77619) _log_diff_call /opt/stack/neutron/neutron/tests/unit/plugins/ml2/drivers/mechanism_logger.py:59}} May 28 12:56:04 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.managers [None req-ec97c996-f7e8-431b-b5eb-1a158aa2427f service neutron] Attempting to bind port b338c4f5-8673-429c-875b-cc66f586099b on host l75lg1-v1 for vnic_type normal with profile {{(pid=77619) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:810}} May 28 12:56:04 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.managers [None req-ec97c996-f7e8-431b-b5eb-1a158aa2427f service neutron] Attempting to bind port b338c4f5-8673-429c-875b-cc66f586099b by drivers ovn,logger on host l75lg1-v1 at level 0 using segments [{'id': '103e5ede-1b45-4a70-9058-2b289cceb77f', 'network_type': 'geneve', 'physical_network': None, 'segmentation_id': 34166, 'network_id': '638fa003-195c-4f96-8899-6458dfcc8bbc'}] {{(pid=77619) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:835}} May 28 12:56:04 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver [None req-ec97c996-f7e8-431b-b5eb-1a158aa2427f service neutron] Attempting to bind port b338c4f5-8673-429c-875b-cc66f586099b on host l75lg1-v1 for network segment with type geneve, segmentation ID 34166, physical network None {{(pid=77619) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/mech_driver.py:1009}} May 28 12:56:04 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.managers [None req-ec97c996-f7e8-431b-b5eb-1a158aa2427f service neutron] Bound port: b338c4f5-8673-429c-875b-cc66f586099b, host: l75lg1-v1, vif_type: ovs, vif_details: {"port_filter": true, "connectivity": "l2", "bridge_name": "br-int", "datapath_type": "system"}, binding_levels: [{'bound_driver': 'ovn', 'bound_segment': {'id': '103e5ede-1b45-4a70-9058-2b289cceb77f', 'network_type': 'geneve', 'physical_network': None, 'segmentation_id': 34166, 'network_id': '638fa003-195c-4f96-8899-6458dfcc8bbc'}}] {{(pid=77619) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:947}} May 28 12:56:04 l75lg1-v1 neutron-server[77619]: DEBUG neutron_lib.callbacks.manager [None req-ec97c996-f7e8-431b-b5eb-1a158aa2427f service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1015114', 'neutron.services.ovn_l3.plugin.OVNL3RouterPlugin._port_update-8754901907784', 'neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_internal_ip_change_for_fip-8754903031884'] for port (b338c4f5-8673-429c-875b-cc66f586099b), before_update {{(pid=77619) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:56:04 l75lg1-v1 neutron-server[77618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d41dd5b5-8e25-45a0-82f3-12fc895c7c14 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=77618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:258}} May 28 12:56:04 l75lg1-v1 neutron-server[77618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d41dd5b5-8e25-45a0-82f3-12fc895c7c14 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=77618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:258}} May 28 12:56:04 l75lg1-v1 neutron-server[77618]: INFO neutron.wsgi [None req-d41dd5b5-8e25-45a0-82f3-12fc895c7c14 service neutron] 10.27.203.238 "GET /networking/v2.0/networks?tenant_id=98a6a2dcbf0248d5b353760f7757f713&shared=False HTTP/1.1" status: 200 len: 1495 time: 0.1698678 May 28 12:56:04 l75lg1-v1 manila-share[96506]: DEBUG oslo_concurrency.lockutils [None req-6c173bbc-673a-4c3c-a470-52ad1ebf882a None None] Lock "service_network_id_neutron_net_helper" "released" by "manila.share.drivers.service_instance.NeutronNetworkHelper.service_network_id" :: held 0.218s {{(pid=96506) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:56:04 l75lg1-v1 manila-share[96506]: DEBUG manila.share.drivers.service_instance [None req-6c173bbc-673a-4c3c-a470-52ad1ebf882a None None] Plugging service instance into service network 638fa003-195c-4f96-8899-6458dfcc8bbc. {{(pid=96506) setup_connectivity_with_service_instances /opt/stack/manila/manila/share/drivers/service_instance.py:980}} May 28 12:56:04 l75lg1-v1 manila-share[96506]: DEBUG oslo_concurrency.lockutils [None req-6c173bbc-673a-4c3c-a470-52ad1ebf882a None None] Acquiring lock "service_network_id_neutron_net_helper" by "manila.share.drivers.service_instance.NeutronNetworkHelper.service_network_id" {{(pid=96506) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:56:04 l75lg1-v1 manila-share[96506]: DEBUG oslo_concurrency.lockutils [None req-6c173bbc-673a-4c3c-a470-52ad1ebf882a None None] Lock "service_network_id_neutron_net_helper" acquired by "manila.share.drivers.service_instance.NeutronNetworkHelper.service_network_id" :: waited 0.000s {{(pid=96506) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:56:04 l75lg1-v1 manila-share[96506]: DEBUG oslo_concurrency.lockutils [None req-6c173bbc-673a-4c3c-a470-52ad1ebf882a None None] Lock "service_network_id_neutron_net_helper" "released" by "manila.share.drivers.service_instance.NeutronNetworkHelper.service_network_id" :: held 0.000s {{(pid=96506) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:56:04 l75lg1-v1 manila-share[96506]: DEBUG oslo_concurrency.lockutils [None req-6c173bbc-673a-4c3c-a470-52ad1ebf882a None None] Acquiring lock "service_instance_get_service_port" by "manila.share.drivers.service_instance.NeutronNetworkHelper._get_service_port" {{(pid=96506) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:56:04 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.db [None req-ec97c996-f7e8-431b-b5eb-1a158aa2427f service neutron] For port b338c4f5-8673-429c-875b-cc66f586099b, host l75lg1-v1, cleared binding levels {{(pid=77619) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} May 28 12:56:04 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.db [None req-ec97c996-f7e8-431b-b5eb-1a158aa2427f service neutron] For port b338c4f5-8673-429c-875b-cc66f586099b, host l75lg1-v1, set binding levels [PortBindingLevel(driver='ovn',host='l75lg1-v1',level=0,port_id=b338c4f5-8673-429c-875b-cc66f586099b,segment=NetworkSegment(103e5ede-1b45-4a70-9058-2b289cceb77f),segment_id=103e5ede-1b45-4a70-9058-2b289cceb77f)] {{(pid=77619) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} May 28 12:56:04 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver [None req-ec97c996-f7e8-431b-b5eb-1a158aa2427f service neutron] No provisioning block for port b338c4f5-8673-429c-875b-cc66f586099b since host unchanged {{(pid=77619) _is_port_provisioning_required /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/mech_driver.py:725}} May 28 12:56:04 l75lg1-v1 neutron-server[77619]: INFO neutron.tests.unit.plugins.ml2.drivers.mechanism_logger [None req-ec97c996-f7e8-431b-b5eb-1a158aa2427f service neutron] update_port_precommit called with port settings {'id': 'b338c4f5-8673-429c-875b-cc66f586099b', 'name': '', 'network_id': '638fa003-195c-4f96-8899-6458dfcc8bbc', 'tenant_id': '98a6a2dcbf0248d5b353760f7757f713', 'mac_address': 'fa:16:3e:59:b7:84', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'manila-share', 'device_owner': 'manila:share', 'standard_attr_id': 63, 'fixed_ips': [], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'l75lg1-v1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'port_filter': True, 'connectivity': 'l2', 'bridge_name': 'br-int', 'datapath_type': 'system'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2024-05-28T12:56:04Z', 'updated_at': '2024-05-28T12:56:04Z', 'revision_number': 1, 'project_id': '98a6a2dcbf0248d5b353760f7757f713'} (original settings {'id': 'b338c4f5-8673-429c-875b-cc66f586099b', 'name': '', 'network_id': '638fa003-195c-4f96-8899-6458dfcc8bbc', 'tenant_id': '98a6a2dcbf0248d5b353760f7757f713', 'mac_address': 'fa:16:3e:59:b7:84', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'manila-share', 'device_owner': 'manila:share', 'standard_attr_id': 63, 'fixed_ips': [], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'l75lg1-v1', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2024-05-28T12:56:04Z', 'updated_at': '2024-05-28T12:56:04Z', 'revision_number': 1, 'project_id': '98a6a2dcbf0248d5b353760f7757f713'}) host l75lg1-v1 (original host l75lg1-v1) vif type ovs (original vif type unbound) vif details {'port_filter': True, 'connectivity': 'l2', 'bridge_name': 'br-int', 'datapath_type': 'system'} (original vif details {}) binding levels [{'bound_driver': 'ovn', 'bound_segment': {'id': '103e5ede-1b45-4a70-9058-2b289cceb77f', 'network_type': 'geneve', 'physical_network': None, 'segmentation_id': 34166, 'network_id': '638fa003-195c-4f96-8899-6458dfcc8bbc'}}] (original binding levels None) on network {'id': '638fa003-195c-4f96-8899-6458dfcc8bbc', 'name': 'manila_service_network', 'tenant_id': '98a6a2dcbf0248d5b353760f7757f713', 'admin_state_up': True, 'mtu': 1442, 'status': 'ACTIVE', 'subnets': [], 'standard_attr_id': 60, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'vlan_transparent': None, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2024-05-28T12:56:04Z', 'updated_at': '2024-05-28T12:56:04Z', 'revision_number': 1, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 34166} with segments to bind None May 28 12:56:04 l75lg1-v1 neutron-server[77619]: DEBUG neutron.tests.unit.plugins.ml2.drivers.mechanism_logger [None req-ec97c996-f7e8-431b-b5eb-1a158aa2427f service neutron] update_port_precommit: May 28 12:56:04 l75lg1-v1 neutron-server[77619]: key[binding:vif_type], unbound -> ovs May 28 12:56:04 l75lg1-v1 neutron-server[77619]: key[binding:vif_details], {} -> {'port_filter': True, 'connectivity': 'l2', 'bridge_name': 'br-int', 'datapath_type': 'system'} May 28 12:56:04 l75lg1-v1 neutron-server[77619]: {{(pid=77619) _log_diff_call /opt/stack/neutron/neutron/tests/unit/plugins/ml2/drivers/mechanism_logger.py:59}} May 28 12:56:04 l75lg1-v1 neutron-server[77619]: DEBUG neutron_lib.callbacks.manager [None req-ec97c996-f7e8-431b-b5eb-1a158aa2427f service neutron] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4166243', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8754903016533', 'neutron.services.ovn_l3.plugin.OVNL3RouterPlugin._port_update-8754901907784'] for port (b338c4f5-8673-429c-875b-cc66f586099b), after_update {{(pid=77619) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:56:04 l75lg1-v1 neutron-server[77619]: DEBUG ovsdbapp.backend.ovs_idl.transaction [None req-53cecb61-7023-41e4-a5ea-23b1eb02606a None None] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=b338c4f5-8673-429c-875b-cc66f586099b, resource={'id': 'b338c4f5-8673-429c-875b-cc66f586099b', 'name': '', 'network_id': '638fa003-195c-4f96-8899-6458dfcc8bbc', 'tenant_id': '98a6a2dcbf0248d5b353760f7757f713', 'mac_address': 'fa:16:3e:59:b7:84', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'manila-share', 'device_owner': 'manila:share', 'standard_attr_id': 63, 'fixed_ips': [], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'l75lg1-v1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'port_filter': True, 'connectivity': 'l2', 'bridge_name': 'br-int', 'datapath_type': 'system'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2024-05-28T12:56:04Z', 'updated_at': '2024-05-28T12:56:04Z', 'revision_number': 1, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'network': {'id': '638fa003-195c-4f96-8899-6458dfcc8bbc', 'name': 'manila_service_network', 'tenant_id': '98a6a2dcbf0248d5b353760f7757f713', 'admin_state_up': True, 'mtu': 1442, 'status': 'ACTIVE', 'subnets': [], 'standard_attr_id': 60, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'vlan_transparent': None, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2024-05-28T12:56:04Z', 'updated_at': '2024-05-28T12:56:04Z', 'revision_number': 1, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 34166}}, resource_type=ports, if_exists=True) {{(pid=77619) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:56:04 l75lg1-v1 neutron-server[77619]: DEBUG ovsdbapp.backend.ovs_idl.transaction [None req-53cecb61-7023-41e4-a5ea-23b1eb02606a None None] Running txn n=1 command(idx=1): SetLSwitchPortCommand(_result=None, lport=b338c4f5-8673-429c-875b-cc66f586099b, external_ids_update=None, columns={'external_ids': {'neutron:port_name': '', 'neutron:device_id': 'manila-share', 'neutron:project_id': '98a6a2dcbf0248d5b353760f7757f713', 'neutron:cidrs': '', 'neutron:device_owner': 'manila:share', 'neutron:subnet_pool_addr_scope4': '', 'neutron:subnet_pool_addr_scope6': '', 'neutron:network_name': 'neutron-638fa003-195c-4f96-8899-6458dfcc8bbc', 'neutron:security_group_ids': '', 'neutron:revision_number': '1', 'neutron:vnic_type': 'normal', 'neutron:port_capabilities': '', 'neutron:mtu': ''}, 'parent_name': [], 'tag': [], 'options': {'requested-chassis': 'l75lg1-v1', 'mcast_flood_reports': 'true'}, 'enabled': True, 'port_security': [], 'dhcpv4_options': [], 'dhcpv6_options': [], 'type': '', 'addresses': ['unknown'], 'ha_chassis_group': []}, if_exists=False) {{(pid=77619) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:56:04 l75lg1-v1 neutron-server[77619]: DEBUG ovsdbapp.backend.ovs_idl.transaction [None req-53cecb61-7023-41e4-a5ea-23b1eb02606a None None] Running txn n=1 command(idx=2): PgDelPortCommand(_result=None, port_group=neutron_pg_drop, lsp=['b338c4f5-8673-429c-875b-cc66f586099b'], if_exists=False) {{(pid=77619) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:56:04 l75lg1-v1 neutron-server[77619]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ec97c996-f7e8-431b-b5eb-1a158aa2427f service neutron] Pushing event updated for resources: {'Port': ['ID=b338c4f5-8673-429c-875b-cc66f586099b,revision_number=3']} {{(pid=77619) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 28 12:56:04 l75lg1-v1 neutron-server[77619]: INFO neutron.db.ovn_revision_numbers_db [None req-ec97c996-f7e8-431b-b5eb-1a158aa2427f service neutron] Successfully bumped revision number for resource b338c4f5-8673-429c-875b-cc66f586099b (type: ports) to 1 May 28 12:56:04 l75lg1-v1 manila-scheduler[96156]: INFO dbcounter [None req-3eaf3fba-24e4-42cf-adb4-93f739d9a927 None None] Registered counter for database manila May 28 12:56:04 l75lg1-v1 neutron-server[77619]: INFO neutron.tests.unit.plugins.ml2.drivers.mechanism_logger [None req-ec97c996-f7e8-431b-b5eb-1a158aa2427f service neutron] update_port_postcommit called with port settings {'id': 'b338c4f5-8673-429c-875b-cc66f586099b', 'name': '', 'network_id': '638fa003-195c-4f96-8899-6458dfcc8bbc', 'tenant_id': '98a6a2dcbf0248d5b353760f7757f713', 'mac_address': 'fa:16:3e:59:b7:84', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'manila-share', 'device_owner': 'manila:share', 'standard_attr_id': 63, 'fixed_ips': [], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'l75lg1-v1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'port_filter': True, 'connectivity': 'l2', 'bridge_name': 'br-int', 'datapath_type': 'system'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2024-05-28T12:56:04Z', 'updated_at': '2024-05-28T12:56:04Z', 'revision_number': 1, 'project_id': '98a6a2dcbf0248d5b353760f7757f713'} (original settings {'id': 'b338c4f5-8673-429c-875b-cc66f586099b', 'name': '', 'network_id': '638fa003-195c-4f96-8899-6458dfcc8bbc', 'tenant_id': '98a6a2dcbf0248d5b353760f7757f713', 'mac_address': 'fa:16:3e:59:b7:84', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'manila-share', 'device_owner': 'manila:share', 'standard_attr_id': 63, 'fixed_ips': [], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'l75lg1-v1', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2024-05-28T12:56:04Z', 'updated_at': '2024-05-28T12:56:04Z', 'revision_number': 1, 'project_id': '98a6a2dcbf0248d5b353760f7757f713'}) host l75lg1-v1 (original host l75lg1-v1) vif type ovs (original vif type unbound) vif details {'port_filter': True, 'connectivity': 'l2', 'bridge_name': 'br-int', 'datapath_type': 'system'} (original vif details {}) binding levels [{'bound_driver': 'ovn', 'bound_segment': {'id': '103e5ede-1b45-4a70-9058-2b289cceb77f', 'network_type': 'geneve', 'physical_network': None, 'segmentation_id': 34166, 'network_id': '638fa003-195c-4f96-8899-6458dfcc8bbc'}}] (original binding levels None) on network {'id': '638fa003-195c-4f96-8899-6458dfcc8bbc', 'name': 'manila_service_network', 'tenant_id': '98a6a2dcbf0248d5b353760f7757f713', 'admin_state_up': True, 'mtu': 1442, 'status': 'ACTIVE', 'subnets': [], 'standard_attr_id': 60, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'vlan_transparent': None, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2024-05-28T12:56:04Z', 'updated_at': '2024-05-28T12:56:04Z', 'revision_number': 1, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 34166} with segments to bind None May 28 12:56:04 l75lg1-v1 neutron-server[77619]: DEBUG neutron.tests.unit.plugins.ml2.drivers.mechanism_logger [None req-ec97c996-f7e8-431b-b5eb-1a158aa2427f service neutron] update_port_postcommit: May 28 12:56:04 l75lg1-v1 neutron-server[77619]: key[binding:vif_type], unbound -> ovs May 28 12:56:04 l75lg1-v1 neutron-server[77619]: key[binding:vif_details], {} -> {'port_filter': True, 'connectivity': 'l2', 'bridge_name': 'br-int', 'datapath_type': 'system'} May 28 12:56:04 l75lg1-v1 neutron-server[77619]: {{(pid=77619) _log_diff_call /opt/stack/neutron/neutron/tests/unit/plugins/ml2/drivers/mechanism_logger.py:59}} May 28 12:56:04 l75lg1-v1 neutron-server[77619]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ec97c996-f7e8-431b-b5eb-1a158aa2427f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=77619) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:258}} May 28 12:56:04 l75lg1-v1 neutron-server[77619]: DEBUG neutron_lib.callbacks.manager [None req-ec97c996-f7e8-431b-b5eb-1a158aa2427f service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4016492'] for port (None), before_response {{(pid=77619) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:56:05 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_db.sqlalchemy.engines [None req-3eaf3fba-24e4-42cf-adb4-93f739d9a927 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=96156) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:342}} May 28 12:56:05 l75lg1-v1 neutron-server[77619]: INFO neutron.wsgi [None req-ec97c996-f7e8-431b-b5eb-1a158aa2427f service neutron] 10.27.203.238 "POST /networking/v2.0/ports HTTP/1.1" status: 201 len: 993 time: 0.4707680 May 28 12:56:05 l75lg1-v1 manila-share[96151]: DEBUG oslo_concurrency.lockutils [None req-2cf6ab01-c9ac-4126-b67e-f98b4a543484 None None] Lock "service_instance_get_service_port" "released" by "manila.share.drivers.service_instance.NeutronNetworkHelper._get_service_port" :: held 0.532s {{(pid=96151) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:56:05 l75lg1-v1 manila-share[96151]: DEBUG oslo_concurrency.lockutils [None req-2cf6ab01-c9ac-4126-b67e-f98b4a543484 None None] Acquiring lock "service_instance_add_fixed_ips_to_service_port" by "manila.share.drivers.service_instance.NeutronNetworkHelper._add_fixed_ips_to_service_port" {{(pid=96151) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:56:05 l75lg1-v1 manila-share[96151]: DEBUG oslo_concurrency.lockutils [None req-2cf6ab01-c9ac-4126-b67e-f98b4a543484 None None] Lock "service_instance_add_fixed_ips_to_service_port" acquired by "manila.share.drivers.service_instance.NeutronNetworkHelper._add_fixed_ips_to_service_port" :: waited 0.001s {{(pid=96151) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:56:05 l75lg1-v1 manila-share[96151]: DEBUG oslo_concurrency.lockutils [None req-2cf6ab01-c9ac-4126-b67e-f98b4a543484 None None] Acquiring lock "instantiate_neutron_api_neutron_net_helper" by "manila.share.drivers.service_instance.NeutronNetworkHelper.neutron_api" {{(pid=96151) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:56:05 l75lg1-v1 manila-share[96151]: DEBUG oslo_concurrency.lockutils [None req-2cf6ab01-c9ac-4126-b67e-f98b4a543484 None None] Lock "instantiate_neutron_api_neutron_net_helper" acquired by "manila.share.drivers.service_instance.NeutronNetworkHelper.neutron_api" :: waited 0.000s {{(pid=96151) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:56:05 l75lg1-v1 manila-share[96151]: DEBUG oslo_concurrency.lockutils [None req-2cf6ab01-c9ac-4126-b67e-f98b4a543484 None None] Lock "instantiate_neutron_api_neutron_net_helper" "released" by "manila.share.drivers.service_instance.NeutronNetworkHelper.neutron_api" :: held 0.000s {{(pid=96151) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:56:05 l75lg1-v1 manila-share[96151]: DEBUG oslo_concurrency.lockutils [None req-2cf6ab01-c9ac-4126-b67e-f98b4a543484 None None] Acquiring lock "service_network_id_neutron_net_helper" by "manila.share.drivers.service_instance.NeutronNetworkHelper.service_network_id" {{(pid=96151) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:56:05 l75lg1-v1 manila-share[96151]: DEBUG oslo_concurrency.lockutils [None req-2cf6ab01-c9ac-4126-b67e-f98b4a543484 None None] Lock "service_network_id_neutron_net_helper" acquired by "manila.share.drivers.service_instance.NeutronNetworkHelper.service_network_id" :: waited 0.000s {{(pid=96151) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:56:05 l75lg1-v1 manila-share[96151]: DEBUG oslo_concurrency.lockutils [None req-2cf6ab01-c9ac-4126-b67e-f98b4a543484 None None] Lock "service_network_id_neutron_net_helper" "released" by "manila.share.drivers.service_instance.NeutronNetworkHelper.service_network_id" :: held 0.000s {{(pid=96151) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:56:05 l75lg1-v1 manila-share[96506]: DEBUG oslo_concurrency.lockutils [None req-6c173bbc-673a-4c3c-a470-52ad1ebf882a None None] Lock "service_instance_get_service_port" acquired by "manila.share.drivers.service_instance.NeutronNetworkHelper._get_service_port" :: waited 0.213s {{(pid=96506) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:56:05 l75lg1-v1 manila-share[96506]: DEBUG oslo_concurrency.lockutils [None req-6c173bbc-673a-4c3c-a470-52ad1ebf882a None None] Acquiring lock "instantiate_neutron_api_neutron_net_helper" by "manila.share.drivers.service_instance.NeutronNetworkHelper.neutron_api" {{(pid=96506) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:56:05 l75lg1-v1 manila-share[96506]: DEBUG oslo_concurrency.lockutils [None req-6c173bbc-673a-4c3c-a470-52ad1ebf882a None None] Lock "instantiate_neutron_api_neutron_net_helper" acquired by "manila.share.drivers.service_instance.NeutronNetworkHelper.neutron_api" :: waited 0.000s {{(pid=96506) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:56:05 l75lg1-v1 manila-share[96506]: DEBUG oslo_concurrency.lockutils [None req-6c173bbc-673a-4c3c-a470-52ad1ebf882a None None] Lock "instantiate_neutron_api_neutron_net_helper" "released" by "manila.share.drivers.service_instance.NeutronNetworkHelper.neutron_api" :: held 0.000s {{(pid=96506) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:56:05 l75lg1-v1 neutron-server[77619]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fc5e4cfa-fe4a-45a7-9d73-83fb42c0950e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=77619) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:258}} May 28 12:56:05 l75lg1-v1 neutron-server[77619]: INFO neutron.wsgi [None req-fc5e4cfa-fe4a-45a7-9d73-83fb42c0950e service neutron] 10.27.203.238 "GET /networking/v2.0/networks/638fa003-195c-4f96-8899-6458dfcc8bbc HTTP/1.1" status: 200 len: 838 time: 0.0481648 May 28 12:56:05 l75lg1-v1 manila-share[96151]: DEBUG oslo_concurrency.lockutils [None req-2cf6ab01-c9ac-4126-b67e-f98b4a543484 None None] Lock "service_instance_add_fixed_ips_to_service_port" "released" by "manila.share.drivers.service_instance.NeutronNetworkHelper._add_fixed_ips_to_service_port" :: held 0.055s {{(pid=96151) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:56:05 l75lg1-v1 manila-share[96151]: DEBUG oslo_concurrency.lockutils [None req-2cf6ab01-c9ac-4126-b67e-f98b4a543484 None None] Acquiring lock "service_instance_plug_interface_in_host" by "manila.share.drivers.service_instance.NeutronNetworkHelper._plug_interface_in_host" {{(pid=96151) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:56:05 l75lg1-v1 manila-share[96151]: DEBUG oslo_concurrency.lockutils [None req-2cf6ab01-c9ac-4126-b67e-f98b4a543484 None None] Lock "service_instance_plug_interface_in_host" acquired by "manila.share.drivers.service_instance.NeutronNetworkHelper._plug_interface_in_host" :: waited 0.001s {{(pid=96151) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:56:05 l75lg1-v1 manila-share[96151]: DEBUG manila.share.drivers.service_instance [None req-2cf6ab01-c9ac-4126-b67e-f98b4a543484 None None] Plug interface into host - interface_name: tapb338c4f5-86, device: tapb338c4f5-86, port: {'id': 'b338c4f5-8673-429c-875b-cc66f586099b', 'name': '', 'network_id': '638fa003-195c-4f96-8899-6458dfcc8bbc', 'tenant_id': '98a6a2dcbf0248d5b353760f7757f713', 'mac_address': 'fa:16:3e:59:b7:84', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'manila-share', 'device_owner': 'manila:share', 'fixed_ips': [], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'l75lg1-v1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'port_filter': True, 'connectivity': 'l2', 'bridge_name': 'br-int', 'datapath_type': 'system'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2024-05-28T12:56:04Z', 'updated_at': '2024-05-28T12:56:04Z', 'revision_number': 1, 'project_id': '98a6a2dcbf0248d5b353760f7757f713'} {{(pid=96151) _plug_interface_in_host /opt/stack/manila/manila/share/drivers/service_instance.py:1005}} May 28 12:56:05 l75lg1-v1 manila-share[96151]: DEBUG oslo_concurrency.lockutils [None req-2cf6ab01-c9ac-4126-b67e-f98b4a543484 None None] Acquiring lock "linux_interface_device_name_tapb338c4f5-86" by "manila.network.linux.interface.device_name_synchronized..wrapped_func..source_func" {{(pid=96151) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:56:05 l75lg1-v1 manila-share[96151]: DEBUG oslo_concurrency.lockutils [None req-2cf6ab01-c9ac-4126-b67e-f98b4a543484 None None] Lock "linux_interface_device_name_tapb338c4f5-86" acquired by "manila.network.linux.interface.device_name_synchronized..wrapped_func..source_func" :: waited 0.000s {{(pid=96151) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:56:05 l75lg1-v1 manila-share[96151]: DEBUG oslo_concurrency.processutils [None req-2cf6ab01-c9ac-4126-b67e-f98b4a543484 None None] Running cmd (subprocess): ip -o link show br-int {{(pid=96151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:390}} May 28 12:56:05 l75lg1-v1 manila-share[96151]: DEBUG oslo_concurrency.processutils [None req-2cf6ab01-c9ac-4126-b67e-f98b4a543484 None None] CMD "ip -o link show br-int" returned: 0 in 0.012s {{(pid=96151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:428}} May 28 12:56:05 l75lg1-v1 manila-share[96151]: DEBUG oslo_concurrency.processutils [None req-2cf6ab01-c9ac-4126-b67e-f98b4a543484 None None] Running cmd (subprocess): ip -o link show tapb338c4f5-86 {{(pid=96151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:390}} May 28 12:56:05 l75lg1-v1 manila-share[96151]: DEBUG oslo_concurrency.processutils [None req-2cf6ab01-c9ac-4126-b67e-f98b4a543484 None None] CMD "ip -o link show tapb338c4f5-86" returned: 1 in 0.011s {{(pid=96151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:428}} May 28 12:56:05 l75lg1-v1 manila-share[96151]: DEBUG oslo_concurrency.processutils [None req-2cf6ab01-c9ac-4126-b67e-f98b4a543484 None None] 'ip -o link show tapb338c4f5-86' failed. Not Retrying. {{(pid=96151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:479}} May 28 12:56:05 l75lg1-v1 manila-share[96151]: INFO manila.network.linux.interface [None req-2cf6ab01-c9ac-4126-b67e-f98b4a543484 None None] Device tapb338c4f5-86 does not exist - creating .... May 28 12:56:05 l75lg1-v1 manila-share[96151]: DEBUG oslo_concurrency.processutils [None req-2cf6ab01-c9ac-4126-b67e-f98b4a543484 None None] Running cmd (subprocess): sudo manila-rootwrap /etc/manila/rootwrap.conf ovs-vsctl -- --may-exist add-port br-int tapb338c4f5-86 -- set Interface tapb338c4f5-86 type=internal -- set Interface tapb338c4f5-86 external-ids:iface-id=b338c4f5-8673-429c-875b-cc66f586099b -- set Interface tapb338c4f5-86 external-ids:iface-status=active -- set Interface tapb338c4f5-86 external-ids:attached-mac=fa:16:3e:59:b7:84 {{(pid=96151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:390}} May 28 12:56:05 l75lg1-v1 sudo[96771]: vastdata : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/manila-rootwrap /etc/manila/rootwrap.conf ovs-vsctl -- --may-exist add-port br-int tapb338c4f5-86 -- set Interface tapb338c4f5-86 type=internal -- set Interface tapb338c4f5-86 external-ids:iface-id=b338c4f5-8673-429c-875b-cc66f586099b -- set Interface tapb338c4f5-86 external-ids:iface-status=active -- set Interface tapb338c4f5-86 external-ids:attached-mac=fa:16:3e:59:b7:84 May 28 12:56:05 l75lg1-v1 sudo[96771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) May 28 12:56:05 l75lg1-v1 neutron-server[77618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3c75b09d-044e-449b-9cac-fd6e47a773d8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=77618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:258}} May 28 12:56:05 l75lg1-v1 neutron-server[77618]: INFO neutron.wsgi [None req-3c75b09d-044e-449b-9cac-fd6e47a773d8 service neutron] 10.27.203.238 "GET /networking/v2.0/ports?device_id=manila-share&binding%3Ahost_id=l75lg1-v1 HTTP/1.1" status: 200 len: 1019 time: 0.0838110 May 28 12:56:05 l75lg1-v1 manila-share[96506]: DEBUG oslo_concurrency.lockutils [None req-6c173bbc-673a-4c3c-a470-52ad1ebf882a None None] Lock "service_instance_get_service_port" "released" by "manila.share.drivers.service_instance.NeutronNetworkHelper._get_service_port" :: held 0.089s {{(pid=96506) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:56:05 l75lg1-v1 manila-share[96506]: DEBUG oslo_concurrency.lockutils [None req-6c173bbc-673a-4c3c-a470-52ad1ebf882a None None] Acquiring lock "service_instance_add_fixed_ips_to_service_port" by "manila.share.drivers.service_instance.NeutronNetworkHelper._add_fixed_ips_to_service_port" {{(pid=96506) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:56:05 l75lg1-v1 manila-share[96506]: DEBUG oslo_concurrency.lockutils [None req-6c173bbc-673a-4c3c-a470-52ad1ebf882a None None] Lock "service_instance_add_fixed_ips_to_service_port" acquired by "manila.share.drivers.service_instance.NeutronNetworkHelper._add_fixed_ips_to_service_port" :: waited 0.000s {{(pid=96506) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:56:05 l75lg1-v1 manila-share[96506]: DEBUG oslo_concurrency.lockutils [None req-6c173bbc-673a-4c3c-a470-52ad1ebf882a None None] Acquiring lock "instantiate_neutron_api_neutron_net_helper" by "manila.share.drivers.service_instance.NeutronNetworkHelper.neutron_api" {{(pid=96506) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:56:05 l75lg1-v1 manila-share[96506]: DEBUG oslo_concurrency.lockutils [None req-6c173bbc-673a-4c3c-a470-52ad1ebf882a None None] Lock "instantiate_neutron_api_neutron_net_helper" acquired by "manila.share.drivers.service_instance.NeutronNetworkHelper.neutron_api" :: waited 0.000s {{(pid=96506) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:56:05 l75lg1-v1 manila-share[96506]: DEBUG oslo_concurrency.lockutils [None req-6c173bbc-673a-4c3c-a470-52ad1ebf882a None None] Lock "instantiate_neutron_api_neutron_net_helper" "released" by "manila.share.drivers.service_instance.NeutronNetworkHelper.neutron_api" :: held 0.000s {{(pid=96506) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:56:05 l75lg1-v1 manila-share[96506]: DEBUG oslo_concurrency.lockutils [None req-6c173bbc-673a-4c3c-a470-52ad1ebf882a None None] Acquiring lock "service_network_id_neutron_net_helper" by "manila.share.drivers.service_instance.NeutronNetworkHelper.service_network_id" {{(pid=96506) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:56:05 l75lg1-v1 manila-share[96506]: DEBUG oslo_concurrency.lockutils [None req-6c173bbc-673a-4c3c-a470-52ad1ebf882a None None] Lock "service_network_id_neutron_net_helper" acquired by "manila.share.drivers.service_instance.NeutronNetworkHelper.service_network_id" :: waited 0.000s {{(pid=96506) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:56:05 l75lg1-v1 manila-share[96506]: DEBUG oslo_concurrency.lockutils [None req-6c173bbc-673a-4c3c-a470-52ad1ebf882a None None] Lock "service_network_id_neutron_net_helper" "released" by "manila.share.drivers.service_instance.NeutronNetworkHelper.service_network_id" :: held 0.000s {{(pid=96506) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:56:05 l75lg1-v1 neutron-server[77618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f1ca1f39-ff09-43df-b127-05f2c03bdd89 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=77618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:258}} May 28 12:56:05 l75lg1-v1 neutron-server[77618]: INFO neutron.wsgi [None req-f1ca1f39-ff09-43df-b127-05f2c03bdd89 service neutron] 10.27.203.238 "GET /networking/v2.0/networks/638fa003-195c-4f96-8899-6458dfcc8bbc HTTP/1.1" status: 200 len: 838 time: 0.0472925 May 28 12:56:05 l75lg1-v1 manila-share[96506]: DEBUG oslo_concurrency.lockutils [None req-6c173bbc-673a-4c3c-a470-52ad1ebf882a None None] Lock "service_instance_add_fixed_ips_to_service_port" "released" by "manila.share.drivers.service_instance.NeutronNetworkHelper._add_fixed_ips_to_service_port" :: held 0.053s {{(pid=96506) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:56:05 l75lg1-v1 manila-share[96506]: DEBUG oslo_concurrency.lockutils [None req-6c173bbc-673a-4c3c-a470-52ad1ebf882a None None] Acquiring lock "service_instance_plug_interface_in_host" by "manila.share.drivers.service_instance.NeutronNetworkHelper._plug_interface_in_host" {{(pid=96506) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:56:05 l75lg1-v1 dstat.sh[49771]: 28-05 12:56:05| 37 11 50 2 0|5099M 2430M 277M 7822M| 18k 17k| 76k 2959k|14.0 312 | 11k 20k|0.93 0.75 0.91|5.0 1.0 294| 0 0 | 0 2048M| 27 322 0 16 0 May 28 12:56:05 l75lg1-v1 manila-scheduler[96156]: DEBUG dbcounter [-] [96156] Writer thread running {{(pid=96156) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} May 28 12:56:05 l75lg1-v1 manila-scheduler[96156]: DEBUG manila.service [None req-3eaf3fba-24e4-42cf-adb4-93f739d9a927 None None] Creating RPC server for service manila-scheduler. {{(pid=96156) start /opt/stack/manila/manila/service.py:159}} May 28 12:56:05 l75lg1-v1 manila-scheduler[96156]: INFO oslo.messaging._drivers.impl_rabbit [None req-3eaf3fba-24e4-42cf-adb4-93f739d9a927 None None] Creating fanout queue: manila-scheduler_fanout_5f36a28b6ab44b819bc16153126e23ca May 28 12:56:05 l75lg1-v1 ovs-vsctl[96917]: ovs|00001|vsctl|INFO|Called as /bin/ovs-vsctl -- --may-exist add-port br-int tapb338c4f5-86 -- set Interface tapb338c4f5-86 type=internal -- set Interface tapb338c4f5-86 external-ids:iface-id=b338c4f5-8673-429c-875b-cc66f586099b -- set Interface tapb338c4f5-86 external-ids:iface-status=active -- set Interface tapb338c4f5-86 external-ids:attached-mac=fa:16:3e:59:b7:84 May 28 12:56:05 l75lg1-v1 neutron-server[77618]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-d9d4969c-e9ae-4d76-91b0-9b7c8eb907b3 None None] Hash Ring: Node 4c6fc793-7f5a-456f-b4d6-6e5bd97592f2 (host: l75lg1-v1) handling event "update" for row 4b597082-5316-4c1f-b2c1-bb5589b3b367 (table: Port_Binding) {{(pid=77618) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:56:05 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched UPDATE: PortBindingUpdatedEvent(events=('update',), table='Port_Binding', conditions=None, old_conditions=None), priority=20 to row=Port_Binding(parent_port=[], mac=['unknown'], chassis=[], ha_chassis_group=[], options={'mcast_flood_reports': 'true', 'requested-chassis': 'l75lg1-v1'}, type=, tag=[], requested_chassis=[], tunnel_key=2, up=[False], logical_port=b338c4f5-8673-429c-875b-cc66f586099b, gateway_chassis=[], encap=[], external_ids={'neutron:cidrs': '', 'neutron:device_id': 'manila-share', 'neutron:device_owner': 'manila:share', 'neutron:mtu': '', 'neutron:network_name': 'neutron-638fa003-195c-4f96-8899-6458dfcc8bbc', 'neutron:port_capabilities': '', 'neutron:port_name': '', 'neutron:project_id': '98a6a2dcbf0248d5b353760f7757f713', 'neutron:revision_number': '1', 'neutron:security_group_ids': '', 'neutron:subnet_pool_addr_scope4': '', 'neutron:subnet_pool_addr_scope6': '', 'neutron:vnic_type': 'normal'}, virtual_parent=[], nat_addresses=[], datapath=2ef15622-104a-4d13-a81a-f08de5446b4d) old=Port_Binding(chassis=[]) {{(pid=76818) matches /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} May 28 12:56:05 l75lg1-v1 neutron-ovn-metadata-agent[76818]: INFO neutron.agent.ovn.metadata.agent [-] Port b338c4f5-8673-429c-875b-cc66f586099b in datapath 638fa003-195c-4f96-8899-6458dfcc8bbc bound to our chassis May 28 12:56:05 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata.agent [-] Port 4b597082-5316-4c1f-b2c1-bb5589b3b367 IP addresses were not retrieved from the Port_Binding MAC column ['unknown'] {{(pid=76818) _get_port_ip4_ips /opt/stack/neutron/neutron/agent/ovn/metadata/agent.py:628}} May 28 12:56:05 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata.agent [-] No valid VIF ports were found for network 638fa003-195c-4f96-8899-6458dfcc8bbc, tearing the namespace down if needed {{(pid=76818) _get_provision_params /opt/stack/neutron/neutron/agent/ovn/metadata/agent.py:720}} May 28 12:56:05 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo.privsep.daemon [-] privsep: reply[122ec5e1-1c93-47c1-b6ce-a707f5c199cc]: (4, False) {{(pid=79043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} May 28 12:56:05 l75lg1-v1 neutron-server[77618]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-d9d4969c-e9ae-4d76-91b0-9b7c8eb907b3 None None] Hash Ring: Node 4c6fc793-7f5a-456f-b4d6-6e5bd97592f2 (host: l75lg1-v1) handling event "update" for row 4b597082-5316-4c1f-b2c1-bb5589b3b367 (table: Port_Binding) {{(pid=77618) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:56:05 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-53cecb61-7023-41e4-a5ea-23b1eb02606a None None] Hash Ring: Node c89b3497-133e-4a5a-b67a-3310d2cb2485 (host: l75lg1-v1) handling event "update" for row 17d3c686-794f-4634-9d44-bd127b700ee4 (table: Logical_Switch_Port) {{(pid=77619) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:56:05 l75lg1-v1 neutron-server[77619]: DEBUG ovsdbapp.backend.ovs_idl.event [None req-53cecb61-7023-41e4-a5ea-23b1eb02606a None None] Matched UPDATE: LogicalSwitchPortUpdateUpEvent(events=('update',), table='Logical_Switch_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Switch_Port(up=[True], name=b338c4f5-8673-429c-875b-cc66f586099b, external_ids={'neutron:cidrs': '', 'neutron:device_id': 'manila-share', 'neutron:device_owner': 'manila:share', 'neutron:mtu': '', 'neutron:network_name': 'neutron-638fa003-195c-4f96-8899-6458dfcc8bbc', 'neutron:port_capabilities': '', 'neutron:port_name': '', 'neutron:project_id': '98a6a2dcbf0248d5b353760f7757f713', 'neutron:revision_number': '1', 'neutron:security_group_ids': '', 'neutron:subnet_pool_addr_scope4': '', 'neutron:subnet_pool_addr_scope6': '', 'neutron:vnic_type': 'normal'}, ha_chassis_group=[], options={'mcast_flood_reports': 'true', 'requested-chassis': 'l75lg1-v1'}, parent_name=[], enabled=[True], type=, dhcpv6_options=[], tag_request=[], port_security=[], addresses=['unknown'], dynamic_addresses=[], dhcpv4_options=[], tag=[]) old=Logical_Switch_Port(up=[False]) {{(pid=77619) matches /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} May 28 12:56:05 l75lg1-v1 neutron-server[77619]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver [None req-0dcde142-d2d2-4b7c-90f1-6c1ed20bcda3 None None] OVN reports status up for port: b338c4f5-8673-429c-875b-cc66f586099b May 28 12:56:05 l75lg1-v1 neutron-server[77619]: DEBUG neutron.db.provisioning_blocks [None req-0dcde142-d2d2-4b7c-90f1-6c1ed20bcda3 None None] Provisioning for port b338c4f5-8673-429c-875b-cc66f586099b completed by entity L2. {{(pid=77619) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:136}} May 28 12:56:05 l75lg1-v1 sudo[96771]: pam_unix(sudo:session): session closed for user root May 28 12:56:05 l75lg1-v1 manila-share[96151]: DEBUG oslo_concurrency.processutils [None req-2cf6ab01-c9ac-4126-b67e-f98b4a543484 None None] CMD "sudo manila-rootwrap /etc/manila/rootwrap.conf ovs-vsctl -- --may-exist add-port br-int tapb338c4f5-86 -- set Interface tapb338c4f5-86 type=internal -- set Interface tapb338c4f5-86 external-ids:iface-id=b338c4f5-8673-429c-875b-cc66f586099b -- set Interface tapb338c4f5-86 external-ids:iface-status=active -- set Interface tapb338c4f5-86 external-ids:attached-mac=fa:16:3e:59:b7:84" returned: 0 in 0.447s {{(pid=96151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:428}} May 28 12:56:05 l75lg1-v1 manila-share[96151]: DEBUG oslo_concurrency.processutils [None req-2cf6ab01-c9ac-4126-b67e-f98b4a543484 None None] Running cmd (subprocess): sudo manila-rootwrap /etc/manila/rootwrap.conf ip link set tapb338c4f5-86 address fa:16:3e:59:b7:84 {{(pid=96151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:390}} May 28 12:56:05 l75lg1-v1 neutron-server[77619]: DEBUG neutron.db.provisioning_blocks [None req-0dcde142-d2d2-4b7c-90f1-6c1ed20bcda3 None None] Provisioning complete for port b338c4f5-8673-429c-875b-cc66f586099b triggered by entity L2. {{(pid=77619) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:144}} May 28 12:56:05 l75lg1-v1 neutron-server[77619]: DEBUG neutron_lib.callbacks.manager [None req-0dcde142-d2d2-4b7c-90f1-6c1ed20bcda3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-857483'] for port (b338c4f5-8673-429c-875b-cc66f586099b), provisioning_complete {{(pid=77619) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:56:05 l75lg1-v1 neutron-server[77619]: INFO neutron.plugins.ml2.plugin [None req-0dcde142-d2d2-4b7c-90f1-6c1ed20bcda3 None None] Attempt 1 to provision port b338c4f5-8673-429c-875b-cc66f586099b May 28 12:56:05 l75lg1-v1 sudo[96942]: vastdata : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/manila-rootwrap /etc/manila/rootwrap.conf ip link set tapb338c4f5-86 address fa:16:3e:59:b7:84 May 28 12:56:05 l75lg1-v1 sudo[96942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) May 28 12:56:05 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.plugin [None req-0dcde142-d2d2-4b7c-90f1-6c1ed20bcda3 None None] Current status of the port b338c4f5-8673-429c-875b-cc66f586099b is: DOWN; New status is: ACTIVE {{(pid=77619) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2395}} May 28 12:56:05 l75lg1-v1 neutron-server[77619]: DEBUG neutron_lib.callbacks.manager [None req-0dcde142-d2d2-4b7c-90f1-6c1ed20bcda3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1015114', 'neutron.services.ovn_l3.plugin.OVNL3RouterPlugin._port_update-8754901907784', 'neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_internal_ip_change_for_fip-8754903031884'] for port (b338c4f5-8673-429c-875b-cc66f586099b), before_update {{(pid=77619) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:56:05 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.db [None req-0dcde142-d2d2-4b7c-90f1-6c1ed20bcda3 None None] For port b338c4f5-8673-429c-875b-cc66f586099b, host l75lg1-v1, got binding levels [PortBindingLevel(driver='ovn',host='l75lg1-v1',level=0,port_id=b338c4f5-8673-429c-875b-cc66f586099b,segment=NetworkSegment(103e5ede-1b45-4a70-9058-2b289cceb77f),segment_id=103e5ede-1b45-4a70-9058-2b289cceb77f)] {{(pid=77619) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} May 28 12:56:05 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver [None req-0dcde142-d2d2-4b7c-90f1-6c1ed20bcda3 None None] No provisioning block for port b338c4f5-8673-429c-875b-cc66f586099b since it is active {{(pid=77619) _is_port_provisioning_required /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/mech_driver.py:715}} May 28 12:56:05 l75lg1-v1 neutron-server[77619]: INFO neutron.tests.unit.plugins.ml2.drivers.mechanism_logger [None req-0dcde142-d2d2-4b7c-90f1-6c1ed20bcda3 None None] update_port_precommit called with port settings {'id': 'b338c4f5-8673-429c-875b-cc66f586099b', 'name': '', 'network_id': '638fa003-195c-4f96-8899-6458dfcc8bbc', 'tenant_id': '98a6a2dcbf0248d5b353760f7757f713', 'mac_address': 'fa:16:3e:59:b7:84', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'manila-share', 'device_owner': 'manila:share', 'standard_attr_id': 63, 'fixed_ips': [], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'l75lg1-v1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'port_filter': True, 'connectivity': 'l2', 'bridge_name': 'br-int', 'datapath_type': 'system', 'bound_drivers': {'0': 'ovn'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2024-05-28T12:56:04Z', 'updated_at': '2024-05-28T12:56:05Z', 'revision_number': 4, 'project_id': '98a6a2dcbf0248d5b353760f7757f713'} (original settings {'id': 'b338c4f5-8673-429c-875b-cc66f586099b', 'name': '', 'network_id': '638fa003-195c-4f96-8899-6458dfcc8bbc', 'tenant_id': '98a6a2dcbf0248d5b353760f7757f713', 'mac_address': 'fa:16:3e:59:b7:84', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'manila-share', 'device_owner': 'manila:share', 'standard_attr_id': 63, 'fixed_ips': [], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'l75lg1-v1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'port_filter': True, 'connectivity': 'l2', 'bridge_name': 'br-int', 'datapath_type': 'system', 'bound_drivers': {'0': 'ovn'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2024-05-28T12:56:04Z', 'updated_at': '2024-05-28T12:56:04Z', 'revision_number': 3, 'project_id': '98a6a2dcbf0248d5b353760f7757f713'}) host l75lg1-v1 (original host l75lg1-v1) vif type ovs (original vif type ovs) vif details {'port_filter': True, 'connectivity': 'l2', 'bridge_name': 'br-int', 'datapath_type': 'system'} (original vif details {'port_filter': True, 'connectivity': 'l2', 'bridge_name': 'br-int', 'datapath_type': 'system'}) binding levels [{'bound_driver': 'ovn', 'bound_segment': {'id': '103e5ede-1b45-4a70-9058-2b289cceb77f', 'network_type': 'geneve', 'physical_network': None, 'segmentation_id': 34166, 'network_id': '638fa003-195c-4f96-8899-6458dfcc8bbc'}}] (original binding levels [{'bound_driver': 'ovn', 'bound_segment': {'id': '103e5ede-1b45-4a70-9058-2b289cceb77f', 'network_type': 'geneve', 'physical_network': None, 'segmentation_id': 34166, 'network_id': '638fa003-195c-4f96-8899-6458dfcc8bbc'}}]) on network {'id': '638fa003-195c-4f96-8899-6458dfcc8bbc', 'name': 'manila_service_network', 'tenant_id': '98a6a2dcbf0248d5b353760f7757f713', 'admin_state_up': True, 'mtu': 1442, 'status': 'ACTIVE', 'subnets': [], 'standard_attr_id': 60, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'vlan_transparent': None, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2024-05-28T12:56:04Z', 'updated_at': '2024-05-28T12:56:04Z', 'revision_number': 1, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 34166} with segments to bind None May 28 12:56:05 l75lg1-v1 neutron-server[77619]: DEBUG neutron.tests.unit.plugins.ml2.drivers.mechanism_logger [None req-0dcde142-d2d2-4b7c-90f1-6c1ed20bcda3 None None] update_port_precommit: May 28 12:56:05 l75lg1-v1 neutron-server[77619]: key[status], DOWN -> ACTIVE May 28 12:56:05 l75lg1-v1 neutron-server[77619]: key[updated_at], 2024-05-28T12:56:04Z -> 2024-05-28T12:56:05Z May 28 12:56:05 l75lg1-v1 neutron-server[77619]: key[revision_number], 3 -> 4 May 28 12:56:05 l75lg1-v1 neutron-server[77619]: {{(pid=77619) _log_diff_call /opt/stack/neutron/neutron/tests/unit/plugins/ml2/drivers/mechanism_logger.py:59}} May 28 12:56:05 l75lg1-v1 neutron-server[77619]: DEBUG ovsdbapp.backend.ovs_idl.transaction [None req-53cecb61-7023-41e4-a5ea-23b1eb02606a None None] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=b338c4f5-8673-429c-875b-cc66f586099b, resource={'id': 'b338c4f5-8673-429c-875b-cc66f586099b', 'name': '', 'network_id': '638fa003-195c-4f96-8899-6458dfcc8bbc', 'tenant_id': '98a6a2dcbf0248d5b353760f7757f713', 'mac_address': 'fa:16:3e:59:b7:84', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'manila-share', 'device_owner': 'manila:share', 'standard_attr_id': 63, 'fixed_ips': [], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'l75lg1-v1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'port_filter': True, 'connectivity': 'l2', 'bridge_name': 'br-int', 'datapath_type': 'system', 'bound_drivers': {'0': 'ovn'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2024-05-28T12:56:04Z', 'updated_at': '2024-05-28T12:56:05Z', 'revision_number': 4, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'network': {'id': '638fa003-195c-4f96-8899-6458dfcc8bbc', 'name': 'manila_service_network', 'tenant_id': '98a6a2dcbf0248d5b353760f7757f713', 'admin_state_up': True, 'mtu': 1442, 'status': 'ACTIVE', 'subnets': [], 'standard_attr_id': 60, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'vlan_transparent': None, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2024-05-28T12:56:04Z', 'updated_at': '2024-05-28T12:56:04Z', 'revision_number': 1, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 34166}}, resource_type=ports, if_exists=True) {{(pid=77619) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:56:05 l75lg1-v1 neutron-server[77619]: DEBUG ovsdbapp.backend.ovs_idl.transaction [None req-53cecb61-7023-41e4-a5ea-23b1eb02606a None None] Running txn n=1 command(idx=1): SetLSwitchPortCommand(_result=None, lport=b338c4f5-8673-429c-875b-cc66f586099b, external_ids_update=None, columns={'external_ids': {'neutron:port_name': '', 'neutron:device_id': 'manila-share', 'neutron:project_id': '98a6a2dcbf0248d5b353760f7757f713', 'neutron:cidrs': '', 'neutron:device_owner': 'manila:share', 'neutron:subnet_pool_addr_scope4': '', 'neutron:subnet_pool_addr_scope6': '', 'neutron:network_name': 'neutron-638fa003-195c-4f96-8899-6458dfcc8bbc', 'neutron:security_group_ids': '', 'neutron:revision_number': '4', 'neutron:vnic_type': 'normal', 'neutron:port_capabilities': '', 'neutron:mtu': ''}, 'parent_name': [], 'tag': [], 'options': {'requested-chassis': 'l75lg1-v1', 'mcast_flood_reports': 'true'}, 'enabled': True, 'port_security': [], 'dhcpv4_options': [], 'dhcpv6_options': [], 'type': '', 'addresses': ['unknown'], 'ha_chassis_group': []}, if_exists=False) {{(pid=77619) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:56:05 l75lg1-v1 neutron-server[77619]: DEBUG ovsdbapp.backend.ovs_idl.transaction [None req-53cecb61-7023-41e4-a5ea-23b1eb02606a None None] Running txn n=1 command(idx=2): PgDelPortCommand(_result=None, port_group=neutron_pg_drop, lsp=['b338c4f5-8673-429c-875b-cc66f586099b'], if_exists=False) {{(pid=77619) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:56:05 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-53cecb61-7023-41e4-a5ea-23b1eb02606a None None] Hash Ring: Node c89b3497-133e-4a5a-b67a-3310d2cb2485 (host: l75lg1-v1) handling event "update" for row 17d3c686-794f-4634-9d44-bd127b700ee4 (table: Logical_Switch_Port) {{(pid=77619) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:56:05 l75lg1-v1 neutron-server[77618]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-d9d4969c-e9ae-4d76-91b0-9b7c8eb907b3 None None] Hash Ring: Node 4c6fc793-7f5a-456f-b4d6-6e5bd97592f2 (host: l75lg1-v1) handling event "update" for row 4b597082-5316-4c1f-b2c1-bb5589b3b367 (table: Port_Binding) {{(pid=77618) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:56:05 l75lg1-v1 neutron-server[77619]: INFO neutron.db.ovn_revision_numbers_db [None req-0dcde142-d2d2-4b7c-90f1-6c1ed20bcda3 None None] Successfully bumped revision number for resource b338c4f5-8673-429c-875b-cc66f586099b (type: ports) to 4 May 28 12:56:05 l75lg1-v1 neutron-server[77619]: INFO neutron.tests.unit.plugins.ml2.drivers.mechanism_logger [None req-0dcde142-d2d2-4b7c-90f1-6c1ed20bcda3 None None] update_port_postcommit called with port settings {'id': 'b338c4f5-8673-429c-875b-cc66f586099b', 'name': '', 'network_id': '638fa003-195c-4f96-8899-6458dfcc8bbc', 'tenant_id': '98a6a2dcbf0248d5b353760f7757f713', 'mac_address': 'fa:16:3e:59:b7:84', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'manila-share', 'device_owner': 'manila:share', 'standard_attr_id': 63, 'fixed_ips': [], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'l75lg1-v1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'port_filter': True, 'connectivity': 'l2', 'bridge_name': 'br-int', 'datapath_type': 'system', 'bound_drivers': {'0': 'ovn'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2024-05-28T12:56:04Z', 'updated_at': '2024-05-28T12:56:05Z', 'revision_number': 4, 'project_id': '98a6a2dcbf0248d5b353760f7757f713'} (original settings {'id': 'b338c4f5-8673-429c-875b-cc66f586099b', 'name': '', 'network_id': '638fa003-195c-4f96-8899-6458dfcc8bbc', 'tenant_id': '98a6a2dcbf0248d5b353760f7757f713', 'mac_address': 'fa:16:3e:59:b7:84', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'manila-share', 'device_owner': 'manila:share', 'standard_attr_id': 63, 'fixed_ips': [], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'l75lg1-v1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'port_filter': True, 'connectivity': 'l2', 'bridge_name': 'br-int', 'datapath_type': 'system', 'bound_drivers': {'0': 'ovn'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2024-05-28T12:56:04Z', 'updated_at': '2024-05-28T12:56:04Z', 'revision_number': 3, 'project_id': '98a6a2dcbf0248d5b353760f7757f713'}) host l75lg1-v1 (original host l75lg1-v1) vif type ovs (original vif type ovs) vif details {'port_filter': True, 'connectivity': 'l2', 'bridge_name': 'br-int', 'datapath_type': 'system'} (original vif details {'port_filter': True, 'connectivity': 'l2', 'bridge_name': 'br-int', 'datapath_type': 'system'}) binding levels [{'bound_driver': 'ovn', 'bound_segment': {'id': '103e5ede-1b45-4a70-9058-2b289cceb77f', 'network_type': 'geneve', 'physical_network': None, 'segmentation_id': 34166, 'network_id': '638fa003-195c-4f96-8899-6458dfcc8bbc'}}] (original binding levels [{'bound_driver': 'ovn', 'bound_segment': {'id': '103e5ede-1b45-4a70-9058-2b289cceb77f', 'network_type': 'geneve', 'physical_network': None, 'segmentation_id': 34166, 'network_id': '638fa003-195c-4f96-8899-6458dfcc8bbc'}}]) on network {'id': '638fa003-195c-4f96-8899-6458dfcc8bbc', 'name': 'manila_service_network', 'tenant_id': '98a6a2dcbf0248d5b353760f7757f713', 'admin_state_up': True, 'mtu': 1442, 'status': 'ACTIVE', 'subnets': [], 'standard_attr_id': 60, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'vlan_transparent': None, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2024-05-28T12:56:04Z', 'updated_at': '2024-05-28T12:56:04Z', 'revision_number': 1, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 34166} with segments to bind None May 28 12:56:05 l75lg1-v1 neutron-server[77619]: DEBUG neutron.tests.unit.plugins.ml2.drivers.mechanism_logger [None req-0dcde142-d2d2-4b7c-90f1-6c1ed20bcda3 None None] update_port_postcommit: May 28 12:56:05 l75lg1-v1 neutron-server[77619]: key[status], DOWN -> ACTIVE May 28 12:56:05 l75lg1-v1 neutron-server[77619]: key[updated_at], 2024-05-28T12:56:04Z -> 2024-05-28T12:56:05Z May 28 12:56:05 l75lg1-v1 neutron-server[77619]: key[revision_number], 3 -> 4 May 28 12:56:05 l75lg1-v1 neutron-server[77619]: {{(pid=77619) _log_diff_call /opt/stack/neutron/neutron/tests/unit/plugins/ml2/drivers/mechanism_logger.py:59}} May 28 12:56:05 l75lg1-v1 neutron-server[77619]: DEBUG neutron_lib.callbacks.manager [None req-0dcde142-d2d2-4b7c-90f1-6c1ed20bcda3 None None] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4166243', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8754903016533', 'neutron.services.ovn_l3.plugin.OVNL3RouterPlugin._port_update-8754901907784'] for port (b338c4f5-8673-429c-875b-cc66f586099b), after_update {{(pid=77619) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:56:05 l75lg1-v1 neutron-server[77619]: DEBUG ovsdbapp.backend.ovs_idl.transaction [None req-53cecb61-7023-41e4-a5ea-23b1eb02606a None None] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=Logical_Switch_Port, record=b338c4f5-8673-429c-875b-cc66f586099b, col_values=(('external_ids', {'neutron:host_id': 'l75lg1-v1'}),), if_exists=True) {{(pid=77619) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:56:05 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-53cecb61-7023-41e4-a5ea-23b1eb02606a None None] Hash Ring: Node c89b3497-133e-4a5a-b67a-3310d2cb2485 (host: l75lg1-v1) handling event "update" for row 17d3c686-794f-4634-9d44-bd127b700ee4 (table: Logical_Switch_Port) {{(pid=77619) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:56:05 l75lg1-v1 neutron-server[77618]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-d9d4969c-e9ae-4d76-91b0-9b7c8eb907b3 None None] Hash Ring: Node 4c6fc793-7f5a-456f-b4d6-6e5bd97592f2 (host: l75lg1-v1) handling event "update" for row 4b597082-5316-4c1f-b2c1-bb5589b3b367 (table: Port_Binding) {{(pid=77618) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:56:05 l75lg1-v1 sudo[96942]: pam_unix(sudo:session): session closed for user root May 28 12:56:05 l75lg1-v1 manila-share[96151]: DEBUG oslo_concurrency.processutils [None req-2cf6ab01-c9ac-4126-b67e-f98b4a543484 None None] CMD "sudo manila-rootwrap /etc/manila/rootwrap.conf ip link set tapb338c4f5-86 address fa:16:3e:59:b7:84" returned: 0 in 0.420s {{(pid=96151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:428}} May 28 12:56:05 l75lg1-v1 manila-share[96151]: DEBUG oslo_concurrency.processutils [None req-2cf6ab01-c9ac-4126-b67e-f98b4a543484 None None] Running cmd (subprocess): sudo manila-rootwrap /etc/manila/rootwrap.conf ip link set tapb338c4f5-86 up {{(pid=96151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:390}} May 28 12:56:05 l75lg1-v1 neutron-server[77619]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-07081744-de35-4c11-9d3b-7244d86bce68 None None] Pushing event updated for resources: {'Port': ['ID=b338c4f5-8673-429c-875b-cc66f586099b,revision_number=4']} {{(pid=77619) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 28 12:56:05 l75lg1-v1 sudo[97055]: vastdata : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/manila-rootwrap /etc/manila/rootwrap.conf ip link set tapb338c4f5-86 up May 28 12:56:05 l75lg1-v1 sudo[97055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=96589) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=96589) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=96589) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] ******************************************************************************** {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2600}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] Configuration options gathered from: {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2601}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] command line args: ['--config-file', '/etc/manila/manila.conf'] {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] config files: ['/etc/manila/manila.conf'] {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2603}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] ================================================================================ {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2605}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] admin_only_metadata = ['__affinity_same_host', '__affinity_different_host'] {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] api_rate_limit = True {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] auth_strategy = keystone {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] backdoor_port = None {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] backdoor_socket = None {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] backup_continue_update_interval = 10 {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] backup_driver = manila.data.drivers.nfs.NFSBackupDriver {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] backup_ignore_files = ['lost+found'] {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] backup_mount_export = None {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] backup_mount_options = {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] backup_mount_proto = nfs {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] backup_mount_template = mount -vt %(proto)s %(options)s %(export)s %(path)s {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] backup_mount_tmp_location = /tmp/ {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] backup_protocol_access_mapping = {'ip': ['nfs']} {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] backup_share_mount_template = mount -vt %(proto)s %(options)s %(export)s %(path)s {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] backup_share_unmount_template = umount -v %(path)s {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] backup_unmount_template = umount -v %(path)s {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] check_hash = True {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] cleanup_interval = 1800 {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] config_dir = [] {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] config_file = ['/etc/manila/manila.conf'] {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] config_source = [] {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] control_exchange = openstack {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] data_access_wait_access_rules_timeout = 180 {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] data_manager = manila.data.manager.DataManager {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] data_node_access_admin_user = None {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] data_node_access_cert = None {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] data_node_access_ips = ['10.2.5.0/24'] {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] data_node_mount_options = {} {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] data_topic = manila-data {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] db_backend = sqlalchemy {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] db_driver = manila.db {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] debug = True {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] default_share_group_type = default {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] default_share_type = default {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] enable_new_services = True {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] enabled_share_backends = ['generic1', 'generic2'] {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] enabled_share_protocols = ['NFS', 'CIFS'] {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] fatal_exception_format_errors = False {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] graceful_shutdown_timeout = 60 {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] host = l75lg1-v1 {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] instance_format = [instance: %(uuid)s] {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] is_deferred_deletion_enabled = False {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] log_config_append = None {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] log_dir = None {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] log_file = None {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] log_options = True {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] log_rotate_interval = 1 {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] log_rotate_interval_type = days {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] log_rotation_type = none {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] max_logfile_count = 30 {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] max_logfile_size_mb = 200 {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] monkey_patch = False {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] monkey_patch_modules = [] {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] mount_tmp_location = /tmp/ {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] my_ip = 10.27.203.238 {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] osapi_max_limit = 1000 {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] osapi_share_base_URL = None {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] osapi_share_ext_list = [] {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] osapi_share_extension = ['manila.api.contrib.standard_extensions'] {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] osapi_share_listen = :: {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] osapi_share_listen_port = 8786 {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] osapi_share_use_ssl = False {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] osapi_share_workers = 1 {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] periodic_fuzzy_delay = 60 {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] periodic_interval = 60 {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] project_id_regex = [0-9a-f\-]+ {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] publish_errors = False {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] rate_limit_burst = 0 {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] rate_limit_except_level = CRITICAL {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] rate_limit_interval = 0 {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] report_interval = 10 {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] restore_continue_update_interval = 10 {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] rootwrap_config = /etc/manila/rootwrap.conf {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] run_external_periodic_tasks = True {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] scheduler_manager = manila.scheduler.manager.SchedulerManager {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] scheduler_topic = manila-scheduler {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] service_down_time = 60 {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] share_api_class = manila.share.api.API {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] share_backup_name_template = share-backup-%s {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] share_manager = manila.share.manager.ShareManager {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] share_name_template = share-%s {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] share_snapshot_name_template = share-snapshot-%s {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] share_topic = manila-share {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] soft_deleted_share_retention_time = 604800 {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] state_path = /opt/stack/data/manila {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] storage_availability_zone = nova {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] syslog_log_facility = LOG_USER {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] transfer_retention_time = 300 {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] transport_url = **** {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] use_eventlog = False {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] use_journal = False {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] use_json = False {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] use_scheduler_creating_share_from_snapshot = False {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] use_stderr = False {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] use_syslog = False {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] watch_log_file = False {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] oslo_concurrency.disable_process_locking = False {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] oslo_concurrency.lock_path = /opt/stack/manila/manila_locks {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] oslo_messaging_metrics.metrics_process_name = {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] oslo_policy.enforce_new_defaults = False {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] oslo_policy.enforce_scope = False {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] oslo_policy.policy_default_rule = default {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] oslo_policy.policy_file = policy.yaml {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] coordination.backend_url = **** {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] database.backend = sqlalchemy {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] database.connection = **** {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] database.connection_debug = 0 {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] database.connection_parameters = {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] database.connection_recycle_time = 3600 {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] database.connection_trace = False {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] database.db_inc_retry_interval = True {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] database.db_max_retries = 20 {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] database.db_max_retry_interval = 10 {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] database.db_retry_interval = 1 {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] database.max_overflow = 50 {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] database.max_pool_size = 40 {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] database.max_retries = 10 {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] database.mysql_sql_mode = TRADITIONAL {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] database.mysql_wsrep_sync_wait = None {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] database.pool_timeout = None {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] database.retry_interval = 10 {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] database.slave_connection = **** {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] database.sqlite_synchronous = True {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] database.use_db_reconnect = False {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] profiler.connection_string = messaging:// {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] profiler.enabled = False {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] profiler.es_doc_type = notification {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] profiler.es_scroll_size = 10000 {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] profiler.es_scroll_time = 2m {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] profiler.filter_error_trace = False {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] profiler.hmac_keys = **** {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] profiler.sentinel_service_name = mymaster {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] profiler.socket_timeout = 0.1 {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] profiler.trace_requests = False {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] profiler.trace_sqlalchemy = False {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] profiler_jaeger.process_tags = {} {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] profiler_jaeger.service_name_prefix = None {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] profiler_otlp.service_name_prefix = None {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] oslo_reports.file_event_handler = None {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] oslo_reports.file_event_handler_interval = 1 {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] oslo_reports.log_dir = None {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] oslo_messaging_rabbit.hostname = l75lg1-v1 {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] oslo_messaging_rabbit.processname = manila-data {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] oslo_messaging_rabbit.ssl = False {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] oslo_messaging_rabbit.ssl_version = {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] oslo_messaging_rabbit.use_queue_manager = False {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] oslo_messaging_notifications.driver = [] {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] oslo_messaging_notifications.retry = -1 {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] oslo_messaging_notifications.transport_url = **** {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] quota.backup_gigabytes = 1000 {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] quota.backups = 10 {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] quota.driver = manila.quota.DbQuotaDriver {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] quota.gigabytes = 1000 {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] quota.max_age = 0 {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] quota.per_share_gigabytes = -1 {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] quota.replica_gigabytes = 1000 {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] quota.reservation_expire = 86400 {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] quota.share_group_snapshots = 50 {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] quota.share_groups = 50 {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] quota.share_networks = 10 {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] quota.share_replicas = 100 {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] quota.shares = 50 {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] quota.snapshot_gigabytes = 1000 {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] quota.snapshots = 50 {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] quota.until_refresh = 0 {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [-] ******************************************************************************** {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2624}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] Full set of CONF: {{(pid=96589) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:363}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2600}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] Configuration options gathered from: {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2601}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] command line args: ['--config-file', '/etc/manila/manila.conf'] {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] config files: ['/etc/manila/manila.conf'] {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2603}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] ================================================================================ {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2605}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] admin_only_metadata = ['__affinity_same_host', '__affinity_different_host'] {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] api_rate_limit = True {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] auth_strategy = keystone {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] backdoor_port = None {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] backdoor_socket = None {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] backup_continue_update_interval = 10 {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] backup_driver = manila.data.drivers.nfs.NFSBackupDriver {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] backup_ignore_files = ['lost+found'] {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] backup_mount_export = None {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] backup_mount_options = {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] backup_mount_proto = nfs {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] backup_mount_template = mount -vt %(proto)s %(options)s %(export)s %(path)s {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] backup_mount_tmp_location = /tmp/ {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] backup_protocol_access_mapping = {'ip': ['nfs']} {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] backup_share_mount_template = mount -vt %(proto)s %(options)s %(export)s %(path)s {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] backup_share_unmount_template = umount -v %(path)s {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] backup_unmount_template = umount -v %(path)s {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] check_hash = True {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] cleanup_interval = 1800 {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] config_dir = [] {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] config_file = ['/etc/manila/manila.conf'] {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] config_source = [] {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] control_exchange = openstack {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] data_access_wait_access_rules_timeout = 180 {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] data_manager = manila.data.manager.DataManager {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] data_node_access_admin_user = None {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] data_node_access_cert = None {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] data_node_access_ips = ['10.2.5.0/24'] {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] data_node_mount_options = {} {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] data_topic = manila-data {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] db_backend = sqlalchemy {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] db_driver = manila.db {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] debug = True {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] default_share_group_type = default {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] default_share_type = default {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] enable_new_services = True {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] enabled_share_backends = ['generic1', 'generic2'] {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] enabled_share_protocols = ['NFS', 'CIFS'] {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] fatal_exception_format_errors = False {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] graceful_shutdown_timeout = 60 {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] host = l75lg1-v1 {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] instance_format = [instance: %(uuid)s] {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] is_deferred_deletion_enabled = False {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] log_config_append = None {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] log_dir = None {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] log_file = None {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] log_options = True {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] log_rotate_interval = 1 {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] log_rotate_interval_type = days {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] log_rotation_type = none {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] max_logfile_count = 30 {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] max_logfile_size_mb = 200 {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] monkey_patch = False {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] monkey_patch_modules = [] {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] mount_tmp_location = /tmp/ {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] my_ip = 10.27.203.238 {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] osapi_max_limit = 1000 {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] osapi_share_base_URL = None {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] osapi_share_ext_list = [] {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] osapi_share_extension = ['manila.api.contrib.standard_extensions'] {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] osapi_share_listen = :: {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] osapi_share_listen_port = 8786 {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] osapi_share_use_ssl = False {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] osapi_share_workers = 1 {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] periodic_fuzzy_delay = 60 {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] periodic_interval = 60 {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] project_id_regex = [0-9a-f\-]+ {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] publish_errors = False {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] rate_limit_burst = 0 {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] rate_limit_except_level = CRITICAL {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] rate_limit_interval = 0 {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] report_interval = 10 {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] restore_continue_update_interval = 10 {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] rootwrap_config = /etc/manila/rootwrap.conf {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] run_external_periodic_tasks = True {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] scheduler_manager = manila.scheduler.manager.SchedulerManager {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] scheduler_topic = manila-scheduler {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] service_down_time = 60 {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] share_api_class = manila.share.api.API {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] share_backup_name_template = share-backup-%s {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] share_manager = manila.share.manager.ShareManager {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] share_name_template = share-%s {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] share_snapshot_name_template = share-snapshot-%s {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] share_topic = manila-share {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] soft_deleted_share_retention_time = 604800 {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] state_path = /opt/stack/data/manila {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] storage_availability_zone = nova {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] syslog_log_facility = LOG_USER {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] transfer_retention_time = 300 {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] transport_url = **** {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] use_eventlog = False {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] use_journal = False {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] use_json = False {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] use_scheduler_creating_share_from_snapshot = False {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] use_stderr = False {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] use_syslog = False {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] watch_log_file = False {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] oslo_concurrency.disable_process_locking = False {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] oslo_concurrency.lock_path = /opt/stack/manila/manila_locks {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_process_name = {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] oslo_policy.enforce_new_defaults = False {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] oslo_policy.enforce_scope = False {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] oslo_policy.policy_default_rule = default {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] oslo_policy.policy_file = policy.yaml {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] coordination.backend_url = **** {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] database.backend = sqlalchemy {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] database.connection = **** {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] database.connection_debug = 0 {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] database.connection_parameters = {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] database.connection_recycle_time = 3600 {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] database.connection_trace = False {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] database.db_inc_retry_interval = True {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] database.db_max_retries = 20 {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] database.db_max_retry_interval = 10 {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] database.db_retry_interval = 1 {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] database.max_overflow = 50 {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] database.max_pool_size = 40 {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] database.max_retries = 10 {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] database.mysql_sql_mode = TRADITIONAL {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] database.mysql_wsrep_sync_wait = None {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] database.pool_timeout = None {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] database.retry_interval = 10 {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] database.slave_connection = **** {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] database.sqlite_synchronous = True {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] database.use_db_reconnect = False {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] profiler.connection_string = messaging:// {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] profiler.enabled = False {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] profiler.es_doc_type = notification {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] profiler.es_scroll_size = 10000 {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] profiler.es_scroll_time = 2m {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] profiler.filter_error_trace = False {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] profiler.hmac_keys = **** {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] profiler.sentinel_service_name = mymaster {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] profiler.socket_timeout = 0.1 {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] profiler.trace_requests = False {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] profiler.trace_sqlalchemy = False {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] profiler_jaeger.process_tags = {} {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] profiler_jaeger.service_name_prefix = None {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] profiler_otlp.service_name_prefix = None {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] oslo_reports.file_event_handler = None {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] oslo_reports.file_event_handler_interval = 1 {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] oslo_reports.log_dir = None {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.hostname = l75lg1-v1 {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.processname = manila-data {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl = False {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_version = {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.use_queue_manager = False {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] oslo_messaging_notifications.driver = [] {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] oslo_messaging_notifications.retry = -1 {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] oslo_messaging_notifications.transport_url = **** {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] quota.backup_gigabytes = 1000 {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] quota.backups = 10 {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] quota.driver = manila.quota.DbQuotaDriver {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] quota.gigabytes = 1000 {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] quota.max_age = 0 {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] quota.per_share_gigabytes = -1 {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] quota.replica_gigabytes = 1000 {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] quota.reservation_expire = 86400 {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] quota.share_group_snapshots = 50 {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] quota.share_groups = 50 {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] quota.share_networks = 10 {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] quota.share_replicas = 100 {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] quota.shares = 50 {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] quota.snapshot_gigabytes = 1000 {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] quota.snapshots = 50 {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] quota.until_refresh = 0 {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=96589) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2624}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: INFO manila.service [-] Starting manila-data node (version 18.1.0) May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_db.api [None req-a377e1e8-311a-47f0-b22c-98dec19daf2b None None] Loading backend 'sqlalchemy' from 'manila.db.sqlalchemy.api' {{(pid=96589) _load_backend /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/api.py:259}} May 28 12:56:06 l75lg1-v1 dstat.sh[49771]: 28-05 12:56:06| 30 8 58 2 0|5143M 2386M 277M 7823M| 37k 58k| 0 4361k| 0 343 |8922 14k|0.93 0.75 0.91|3.0 0 478| 0 0 | 0 2048M| 27 324 0 18 0 May 28 12:56:06 l75lg1-v1 neutron-server[77618]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-d9d4969c-e9ae-4d76-91b0-9b7c8eb907b3 None None] Hash Ring: Node 4c6fc793-7f5a-456f-b4d6-6e5bd97592f2 (host: l75lg1-v1) handling event "create" for row b7ac3d85-3bb3-40cc-8ca1-9f4cb4f1a02e (table: FDB) {{(pid=77618) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG passlib.utils.compat [None req-a377e1e8-311a-47f0-b22c-98dec19daf2b None None] loaded lazy attr 'SafeConfigParser': {{(pid=96589) __getattr__ /opt/stack/data/venv/lib/python3.10/site-packages/passlib/utils/compat/__init__.py:449}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG passlib.utils.compat [None req-a377e1e8-311a-47f0-b22c-98dec19daf2b None None] loaded lazy attr 'NativeStringIO': {{(pid=96589) __getattr__ /opt/stack/data/venv/lib/python3.10/site-packages/passlib/utils/compat/__init__.py:449}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG passlib.utils.compat [None req-a377e1e8-311a-47f0-b22c-98dec19daf2b None None] loaded lazy attr 'BytesIO': {{(pid=96589) __getattr__ /opt/stack/data/venv/lib/python3.10/site-packages/passlib/utils/compat/__init__.py:449}} May 28 12:56:06 l75lg1-v1 sudo[97055]: pam_unix(sudo:session): session closed for user root May 28 12:56:06 l75lg1-v1 manila-share[96151]: DEBUG oslo_concurrency.processutils [None req-2cf6ab01-c9ac-4126-b67e-f98b4a543484 None None] CMD "sudo manila-rootwrap /etc/manila/rootwrap.conf ip link set tapb338c4f5-86 up" returned: 0 in 0.427s {{(pid=96151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:428}} May 28 12:56:06 l75lg1-v1 manila-share[96151]: DEBUG oslo_concurrency.lockutils [None req-2cf6ab01-c9ac-4126-b67e-f98b4a543484 None None] Lock "linux_interface_device_name_tapb338c4f5-86" "released" by "manila.network.linux.interface.device_name_synchronized..wrapped_func..source_func" :: held 1.325s {{(pid=96151) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:56:06 l75lg1-v1 manila-share[96151]: DEBUG oslo_concurrency.lockutils [None req-2cf6ab01-c9ac-4126-b67e-f98b4a543484 None None] Acquiring lock "linux_interface_device_name_tapb338c4f5-86" by "manila.network.linux.interface.device_name_synchronized..wrapped_func..source_func" {{(pid=96151) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:56:06 l75lg1-v1 manila-share[96151]: DEBUG oslo_concurrency.lockutils [None req-2cf6ab01-c9ac-4126-b67e-f98b4a543484 None None] Lock "linux_interface_device_name_tapb338c4f5-86" acquired by "manila.network.linux.interface.device_name_synchronized..wrapped_func..source_func" :: waited 0.001s {{(pid=96151) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:56:06 l75lg1-v1 manila-share[96151]: DEBUG oslo_concurrency.processutils [None req-2cf6ab01-c9ac-4126-b67e-f98b4a543484 None None] Running cmd (subprocess): ip addr show tapb338c4f5-86 permanent scope global {{(pid=96151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:390}} May 28 12:56:06 l75lg1-v1 manila-share[96151]: DEBUG oslo_concurrency.processutils [None req-2cf6ab01-c9ac-4126-b67e-f98b4a543484 None None] CMD "ip addr show tapb338c4f5-86 permanent scope global" returned: 0 in 0.013s {{(pid=96151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:428}} May 28 12:56:06 l75lg1-v1 manila-share[96151]: DEBUG oslo_concurrency.processutils [None req-2cf6ab01-c9ac-4126-b67e-f98b4a543484 None None] Running cmd (subprocess): ip route list proto kernel dev tapb338c4f5-86 {{(pid=96151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:390}} May 28 12:56:06 l75lg1-v1 manila-share[96151]: DEBUG oslo_concurrency.processutils [None req-2cf6ab01-c9ac-4126-b67e-f98b4a543484 None None] CMD "ip route list proto kernel dev tapb338c4f5-86" returned: 0 in 0.013s {{(pid=96151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:428}} May 28 12:56:06 l75lg1-v1 manila-share[96151]: DEBUG oslo_concurrency.processutils [None req-2cf6ab01-c9ac-4126-b67e-f98b4a543484 None None] Running cmd (subprocess): ip addr show tapb338c4f5-86 {{(pid=96151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:390}} May 28 12:56:06 l75lg1-v1 manila-share[96151]: DEBUG oslo_concurrency.processutils [None req-2cf6ab01-c9ac-4126-b67e-f98b4a543484 None None] CMD "ip addr show tapb338c4f5-86" returned: 0 in 0.012s {{(pid=96151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:428}} May 28 12:56:06 l75lg1-v1 manila-share[96151]: DEBUG oslo_concurrency.processutils [None req-2cf6ab01-c9ac-4126-b67e-f98b4a543484 None None] Running cmd (subprocess): ip -o link list {{(pid=96151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:390}} May 28 12:56:06 l75lg1-v1 manila-share[96151]: DEBUG oslo_concurrency.processutils [None req-2cf6ab01-c9ac-4126-b67e-f98b4a543484 None None] CMD "ip -o link list" returned: 0 in 0.013s {{(pid=96151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:428}} May 28 12:56:06 l75lg1-v1 manila-share[96151]: DEBUG oslo_concurrency.lockutils [None req-2cf6ab01-c9ac-4126-b67e-f98b4a543484 None None] Lock "linux_interface_device_name_tapb338c4f5-86" "released" by "manila.network.linux.interface.device_name_synchronized..wrapped_func..source_func" :: held 0.057s {{(pid=96151) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:56:06 l75lg1-v1 manila-share[96151]: DEBUG oslo_concurrency.lockutils [None req-2cf6ab01-c9ac-4126-b67e-f98b4a543484 None None] Lock "service_instance_plug_interface_in_host" "released" by "manila.share.drivers.service_instance.NeutronNetworkHelper._plug_interface_in_host" :: held 1.385s {{(pid=96151) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:56:06 l75lg1-v1 manila-share[96151]: DEBUG manila.share.drivers.service_instance [None req-2cf6ab01-c9ac-4126-b67e-f98b4a543484 None None] Plugging service instance into admin network 9aaf4bd9-9f34-40ad-a4e7-932bff23895a. {{(pid=96151) setup_connectivity_with_service_instances /opt/stack/manila/manila/share/drivers/service_instance.py:990}} May 28 12:56:06 l75lg1-v1 manila-share[96151]: DEBUG oslo_concurrency.lockutils [None req-2cf6ab01-c9ac-4126-b67e-f98b4a543484 None None] Acquiring lock "service_instance_get_service_port" by "manila.share.drivers.service_instance.NeutronNetworkHelper._get_service_port" {{(pid=96151) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:56:06 l75lg1-v1 manila-share[96151]: DEBUG oslo_concurrency.lockutils [None req-2cf6ab01-c9ac-4126-b67e-f98b4a543484 None None] Lock "service_instance_get_service_port" acquired by "manila.share.drivers.service_instance.NeutronNetworkHelper._get_service_port" :: waited 0.001s {{(pid=96151) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:56:06 l75lg1-v1 manila-share[96151]: DEBUG oslo_concurrency.lockutils [None req-2cf6ab01-c9ac-4126-b67e-f98b4a543484 None None] Acquiring lock "instantiate_neutron_api_neutron_net_helper" by "manila.share.drivers.service_instance.NeutronNetworkHelper.neutron_api" {{(pid=96151) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:56:06 l75lg1-v1 manila-share[96151]: DEBUG oslo_concurrency.lockutils [None req-2cf6ab01-c9ac-4126-b67e-f98b4a543484 None None] Lock "instantiate_neutron_api_neutron_net_helper" acquired by "manila.share.drivers.service_instance.NeutronNetworkHelper.neutron_api" :: waited 0.000s {{(pid=96151) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:56:06 l75lg1-v1 manila-share[96151]: DEBUG oslo_concurrency.lockutils [None req-2cf6ab01-c9ac-4126-b67e-f98b4a543484 None None] Lock "instantiate_neutron_api_neutron_net_helper" "released" by "manila.share.drivers.service_instance.NeutronNetworkHelper.neutron_api" :: held 0.000s {{(pid=96151) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:56:06 l75lg1-v1 manila-share[96506]: DEBUG oslo_concurrency.lockutils [None req-6c173bbc-673a-4c3c-a470-52ad1ebf882a None None] Lock "service_instance_plug_interface_in_host" acquired by "manila.share.drivers.service_instance.NeutronNetworkHelper._plug_interface_in_host" :: waited 1.257s {{(pid=96506) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:56:06 l75lg1-v1 manila-share[96506]: DEBUG manila.share.drivers.service_instance [None req-6c173bbc-673a-4c3c-a470-52ad1ebf882a None None] Plug interface into host - interface_name: tapb338c4f5-86, device: tapb338c4f5-86, port: {'id': 'b338c4f5-8673-429c-875b-cc66f586099b', 'name': '', 'network_id': '638fa003-195c-4f96-8899-6458dfcc8bbc', 'tenant_id': '98a6a2dcbf0248d5b353760f7757f713', 'mac_address': 'fa:16:3e:59:b7:84', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'manila-share', 'device_owner': 'manila:share', 'fixed_ips': [], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'l75lg1-v1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'port_filter': True, 'connectivity': 'l2', 'bridge_name': 'br-int', 'datapath_type': 'system', 'bound_drivers': {'0': 'ovn'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2024-05-28T12:56:04Z', 'updated_at': '2024-05-28T12:56:04Z', 'revision_number': 3, 'project_id': '98a6a2dcbf0248d5b353760f7757f713'} {{(pid=96506) _plug_interface_in_host /opt/stack/manila/manila/share/drivers/service_instance.py:1005}} May 28 12:56:06 l75lg1-v1 manila-share[96506]: DEBUG oslo_concurrency.lockutils [None req-6c173bbc-673a-4c3c-a470-52ad1ebf882a None None] Acquiring lock "linux_interface_device_name_tapb338c4f5-86" by "manila.network.linux.interface.device_name_synchronized..wrapped_func..source_func" {{(pid=96506) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:56:06 l75lg1-v1 manila-share[96506]: DEBUG oslo_concurrency.lockutils [None req-6c173bbc-673a-4c3c-a470-52ad1ebf882a None None] Lock "linux_interface_device_name_tapb338c4f5-86" acquired by "manila.network.linux.interface.device_name_synchronized..wrapped_func..source_func" :: waited 0.001s {{(pid=96506) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:56:06 l75lg1-v1 manila-share[96506]: DEBUG oslo_concurrency.processutils [None req-6c173bbc-673a-4c3c-a470-52ad1ebf882a None None] Running cmd (subprocess): ip -o link show br-int {{(pid=96506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:390}} May 28 12:56:06 l75lg1-v1 manila-share[96506]: DEBUG oslo_concurrency.processutils [None req-6c173bbc-673a-4c3c-a470-52ad1ebf882a None None] CMD "ip -o link show br-int" returned: 0 in 0.011s {{(pid=96506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:428}} May 28 12:56:06 l75lg1-v1 manila-share[96506]: DEBUG oslo_concurrency.processutils [None req-6c173bbc-673a-4c3c-a470-52ad1ebf882a None None] Running cmd (subprocess): ip -o link show tapb338c4f5-86 {{(pid=96506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:390}} May 28 12:56:06 l75lg1-v1 neutron-server[77619]: INFO neutron.wsgi [None req-8918126e-9e29-42bb-846f-eb4060dd968b service neutron] 10.27.203.238 "GET /networking/v2.0/ports?device_id=manila-admin-share&binding%3Ahost_id=l75lg1-v1 HTTP/1.1" status: 200 len: 210 time: 0.0221686 May 28 12:56:06 l75lg1-v1 manila-share[96151]: DEBUG oslo_concurrency.lockutils [None req-2cf6ab01-c9ac-4126-b67e-f98b4a543484 None None] Acquiring lock "instantiate_neutron_api_neutron_net_helper" by "manila.share.drivers.service_instance.NeutronNetworkHelper.neutron_api" {{(pid=96151) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:56:06 l75lg1-v1 manila-share[96151]: DEBUG oslo_concurrency.lockutils [None req-2cf6ab01-c9ac-4126-b67e-f98b4a543484 None None] Lock "instantiate_neutron_api_neutron_net_helper" acquired by "manila.share.drivers.service_instance.NeutronNetworkHelper.neutron_api" :: waited 0.001s {{(pid=96151) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:56:06 l75lg1-v1 manila-share[96151]: DEBUG oslo_concurrency.lockutils [None req-2cf6ab01-c9ac-4126-b67e-f98b4a543484 None None] Lock "instantiate_neutron_api_neutron_net_helper" "released" by "manila.share.drivers.service_instance.NeutronNetworkHelper.neutron_api" :: held 0.000s {{(pid=96151) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:56:06 l75lg1-v1 manila-share[96151]: DEBUG oslo_concurrency.lockutils [None req-2cf6ab01-c9ac-4126-b67e-f98b4a543484 None None] Acquiring lock "instantiate_neutron_api_neutron_net_helper" by "manila.share.drivers.service_instance.NeutronNetworkHelper.neutron_api" {{(pid=96151) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:56:06 l75lg1-v1 manila-share[96151]: DEBUG oslo_concurrency.lockutils [None req-2cf6ab01-c9ac-4126-b67e-f98b4a543484 None None] Lock "instantiate_neutron_api_neutron_net_helper" acquired by "manila.share.drivers.service_instance.NeutronNetworkHelper.neutron_api" :: waited 0.000s {{(pid=96151) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:56:06 l75lg1-v1 manila-share[96151]: DEBUG oslo_concurrency.lockutils [None req-2cf6ab01-c9ac-4126-b67e-f98b4a543484 None None] Lock "instantiate_neutron_api_neutron_net_helper" "released" by "manila.share.drivers.service_instance.NeutronNetworkHelper.neutron_api" :: held 0.000s {{(pid=96151) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:56:06 l75lg1-v1 manila-share[96506]: DEBUG oslo_concurrency.processutils [None req-6c173bbc-673a-4c3c-a470-52ad1ebf882a None None] CMD "ip -o link show tapb338c4f5-86" returned: 0 in 0.010s {{(pid=96506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:428}} May 28 12:56:06 l75lg1-v1 manila-share[96506]: INFO manila.network.linux.interface [None req-6c173bbc-673a-4c3c-a470-52ad1ebf882a None None] Device tapb338c4f5-86 already exists. May 28 12:56:06 l75lg1-v1 manila-share[96506]: DEBUG oslo_concurrency.processutils [None req-6c173bbc-673a-4c3c-a470-52ad1ebf882a None None] Running cmd (subprocess): ip -o link show tapb338c4f5-86 {{(pid=96506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:390}} May 28 12:56:06 l75lg1-v1 neutron-server[77619]: DEBUG neutron.api.v2.base [None req-931c3c0e-c8dd-49a1-acc2-117e5d5ec393 service neutron] Request body: {'port': {'network_id': '9aaf4bd9-9f34-40ad-a4e7-932bff23895a', 'admin_state_up': True, 'tenant_id': '98a6a2dcbf0248d5b353760f7757f713', 'port_security_enabled': False, 'binding:host_id': 'l75lg1-v1', 'fixed_ips': [{'subnet_id': 'd5781979-4de3-490b-a4f1-017afe11a304'}], 'device_owner': 'manila:share', 'device_id': 'manila-admin-share'}} {{(pid=77619) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:734}} May 28 12:56:06 l75lg1-v1 manila-share[96506]: DEBUG oslo_concurrency.processutils [None req-6c173bbc-673a-4c3c-a470-52ad1ebf882a None None] CMD "ip -o link show tapb338c4f5-86" returned: 0 in 0.012s {{(pid=96506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:428}} May 28 12:56:06 l75lg1-v1 manila-share[96506]: DEBUG oslo_concurrency.processutils [None req-6c173bbc-673a-4c3c-a470-52ad1ebf882a None None] Running cmd (subprocess): sudo manila-rootwrap /etc/manila/rootwrap.conf ip link set tapb338c4f5-86 up {{(pid=96506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:390}} May 28 12:56:06 l75lg1-v1 sudo[97604]: vastdata : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/manila-rootwrap /etc/manila/rootwrap.conf ip link set tapb338c4f5-86 up May 28 12:56:06 l75lg1-v1 sudo[97604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) May 28 12:56:06 l75lg1-v1 neutron-server[77619]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-931c3c0e-c8dd-49a1-acc2-117e5d5ec393 service neutron] Made reservation on behalf of 98a6a2dcbf0248d5b353760f7757f713 for: {'port': 1} {{(pid=77619) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 28 12:56:06 l75lg1-v1 neutron-server[77619]: DEBUG neutron_lib.callbacks.manager [None req-931c3c0e-c8dd-49a1-acc2-117e5d5ec393 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1015114'] for port (None), before_create {{(pid=77619) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:56:06 l75lg1-v1 neutron-server[77619]: DEBUG neutron.db.db_base_plugin_common [None req-931c3c0e-c8dd-49a1-acc2-117e5d5ec393 service neutron] Allocated IP 10.2.5.104 (9aaf4bd9-9f34-40ad-a4e7-932bff23895a/d5781979-4de3-490b-a4f1-017afe11a304/ee263a3a-4660-4a5c-90cd-7a1cce9cbb6c) {{(pid=77619) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:134}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: INFO dbcounter [None req-a377e1e8-311a-47f0-b22c-98dec19daf2b None None] Registered counter for database manila May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG oslo_db.sqlalchemy.engines [None req-a377e1e8-311a-47f0-b22c-98dec19daf2b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=96589) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:342}} May 28 12:56:06 l75lg1-v1 neutron-server[77619]: DEBUG neutron_lib.callbacks.manager [None req-931c3c0e-c8dd-49a1-acc2-117e5d5ec393 service neutron] Publish callbacks [] for port (ee263a3a-4660-4a5c-90cd-7a1cce9cbb6c), precommit_create {{(pid=77619) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:56:06 l75lg1-v1 neutron-server[77619]: DEBUG neutron.db.provisioning_blocks [None req-931c3c0e-c8dd-49a1-acc2-117e5d5ec393 service neutron] Transition to ACTIVE for port object ee263a3a-4660-4a5c-90cd-7a1cce9cbb6c will not be triggered until provisioned by entity L2. {{(pid=77619) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:74}} May 28 12:56:06 l75lg1-v1 neutron-server[77619]: DEBUG neutron.db.ovn_revision_numbers_db [None req-931c3c0e-c8dd-49a1-acc2-117e5d5ec393 service neutron] create_initial_revision uuid=ee263a3a-4660-4a5c-90cd-7a1cce9cbb6c, type=ports, rev=-1 {{(pid=77619) create_initial_revision /opt/stack/neutron/neutron/db/ovn_revision_numbers_db.py:108}} May 28 12:56:06 l75lg1-v1 neutron-server[77619]: INFO neutron.tests.unit.plugins.ml2.drivers.mechanism_logger [None req-931c3c0e-c8dd-49a1-acc2-117e5d5ec393 service neutron] create_port_precommit called with port settings {'id': 'ee263a3a-4660-4a5c-90cd-7a1cce9cbb6c', 'name': '', 'network_id': '9aaf4bd9-9f34-40ad-a4e7-932bff23895a', 'tenant_id': '98a6a2dcbf0248d5b353760f7757f713', 'mac_address': 'fa:16:3e:bd:2e:11', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'manila-admin-share', 'device_owner': 'manila:share', 'standard_attr_id': 64, 'fixed_ips': [{'subnet_id': 'd5781979-4de3-490b-a4f1-017afe11a304', 'ip_address': '10.2.5.104'}], 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'port_security_enabled': False, 'security_groups': [], 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'l75lg1-v1', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'allowed_address_pairs': []} (original settings None) host l75lg1-v1 (original host None) vif type unbound (original vif type None) vif details {} (original vif details None) binding levels None (original binding levels None) on network {'id': '9aaf4bd9-9f34-40ad-a4e7-932bff23895a', 'name': 'admin_net', 'tenant_id': '98a6a2dcbf0248d5b353760f7757f713', 'admin_state_up': True, 'mtu': 1442, 'status': 'ACTIVE', 'subnets': ['d5781979-4de3-490b-a4f1-017afe11a304'], 'standard_attr_id': 56, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'vlan_transparent': None, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2024-05-28T12:55:50Z', 'updated_at': '2024-05-28T12:55:56Z', 'revision_number': 2, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 32656} with segments to bind None May 28 12:56:06 l75lg1-v1 neutron-server[77619]: DEBUG neutron.tests.unit.plugins.ml2.drivers.mechanism_logger [None req-931c3c0e-c8dd-49a1-acc2-117e5d5ec393 service neutron] create_port_precommit: May 28 12:56:06 l75lg1-v1 neutron-server[77619]: key[tenant_id], None -> 98a6a2dcbf0248d5b353760f7757f713 May 28 12:56:06 l75lg1-v1 neutron-server[77619]: key[network_id], None -> 9aaf4bd9-9f34-40ad-a4e7-932bff23895a May 28 12:56:06 l75lg1-v1 neutron-server[77619]: key[allowed_address_pairs], None -> [] May 28 12:56:06 l75lg1-v1 neutron-server[77619]: key[binding:vif_type], None -> unbound May 28 12:56:06 l75lg1-v1 neutron-server[77619]: key[project_id], None -> 98a6a2dcbf0248d5b353760f7757f713 May 28 12:56:06 l75lg1-v1 neutron-server[77619]: key[admin_state_up], None -> True May 28 12:56:06 l75lg1-v1 neutron-server[77619]: key[id], None -> ee263a3a-4660-4a5c-90cd-7a1cce9cbb6c May 28 12:56:06 l75lg1-v1 neutron-server[77619]: key[security_groups], None -> [] May 28 12:56:06 l75lg1-v1 neutron-server[77619]: key[binding:vnic_type], None -> normal May 28 12:56:06 l75lg1-v1 neutron-server[77619]: key[name], None -> May 28 12:56:06 l75lg1-v1 neutron-server[77619]: key[status], None -> DOWN May 28 12:56:06 l75lg1-v1 neutron-server[77619]: key[binding:profile], None -> {} May 28 12:56:06 l75lg1-v1 neutron-server[77619]: key[port_security_enabled], None -> False May 28 12:56:06 l75lg1-v1 neutron-server[77619]: key[standard_attr_id], None -> 64 May 28 12:56:06 l75lg1-v1 neutron-server[77619]: key[device_owner], None -> manila:share May 28 12:56:06 l75lg1-v1 neutron-server[77619]: key[device_id], None -> manila-admin-share May 28 12:56:06 l75lg1-v1 neutron-server[77619]: key[mac_address], None -> fa:16:3e:bd:2e:11 May 28 12:56:06 l75lg1-v1 neutron-server[77619]: key[binding:host_id], None -> l75lg1-v1 May 28 12:56:06 l75lg1-v1 neutron-server[77619]: key[binding:vif_details], None -> {} May 28 12:56:06 l75lg1-v1 neutron-server[77619]: key[fixed_ips], None -> [{'subnet_id': 'd5781979-4de3-490b-a4f1-017afe11a304', 'ip_address': '10.2.5.104'}] May 28 12:56:06 l75lg1-v1 neutron-server[77619]: {{(pid=77619) _log_diff_call /opt/stack/neutron/neutron/tests/unit/plugins/ml2/drivers/mechanism_logger.py:59}} May 28 12:56:06 l75lg1-v1 neutron-server[77619]: DEBUG neutron_lib.callbacks.manager [None req-931c3c0e-c8dd-49a1-acc2-117e5d5ec393 service neutron] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4166243'] for port (ee263a3a-4660-4a5c-90cd-7a1cce9cbb6c), after_create {{(pid=77619) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:56:06 l75lg1-v1 neutron-server[77619]: DEBUG ovsdbapp.backend.ovs_idl.transaction [None req-53cecb61-7023-41e4-a5ea-23b1eb02606a None None] Running txn n=1 command(idx=0): AddLSwitchPortCommand(_result=None, lport=ee263a3a-4660-4a5c-90cd-7a1cce9cbb6c, lswitch=neutron-9aaf4bd9-9f34-40ad-a4e7-932bff23895a, may_exist=True, columns={'addresses': ['fa:16:3e:bd:2e:11 10.2.5.104', 'unknown'], 'external_ids': {'neutron:port_name': '', 'neutron:device_id': 'manila-admin-share', 'neutron:project_id': '98a6a2dcbf0248d5b353760f7757f713', 'neutron:cidrs': '10.2.5.104/24', 'neutron:device_owner': 'manila:share', 'neutron:subnet_pool_addr_scope4': '', 'neutron:subnet_pool_addr_scope6': '', 'neutron:network_name': 'neutron-9aaf4bd9-9f34-40ad-a4e7-932bff23895a', 'neutron:security_group_ids': '', 'neutron:revision_number': '1', 'neutron:vnic_type': 'normal', 'neutron:port_capabilities': '', 'neutron:mtu': ''}, 'parent_name': [], 'tag': [], 'enabled': True, 'options': {'requested-chassis': 'l75lg1-v1', 'mcast_flood_reports': 'true'}, 'type': '', 'port_security': [], 'dhcpv4_options': [UUID('94959b07-bcd6-4d66-b78b-787c59b1d5b6')], 'dhcpv6_options': []}) {{(pid=77619) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:56:06 l75lg1-v1 neutron-server[77619]: DEBUG ovsdbapp.backend.ovs_idl.transaction [None req-53cecb61-7023-41e4-a5ea-23b1eb02606a None None] Running txn n=1 command(idx=1): QoSDelCommand(_result=None, switch=neutron-9aaf4bd9-9f34-40ad-a4e7-932bff23895a, conditions=[('direction', '=', 'to-lport'), ('priority', '=', 2002), ('match', '=', 'outport == "ee263a3a-4660-4a5c-90cd-7a1cce9cbb6c"')], if_exists=True) {{(pid=77619) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:56:06 l75lg1-v1 neutron-server[77619]: DEBUG ovsdbapp.backend.ovs_idl.transaction [None req-53cecb61-7023-41e4-a5ea-23b1eb02606a None None] Running txn n=1 command(idx=2): UpdateLSwitchPortQosOptionsCommand(_result=None, lport=AddLSwitchPortCommand(_result=e258544b-ffbc-42cd-8cb2-eddda3014531, lport=ee263a3a-4660-4a5c-90cd-7a1cce9cbb6c, lswitch=neutron-9aaf4bd9-9f34-40ad-a4e7-932bff23895a, may_exist=True, columns={'addresses': ['fa:16:3e:bd:2e:11 10.2.5.104', 'unknown'], 'external_ids': {'neutron:port_name': '', 'neutron:device_id': 'manila-admin-share', 'neutron:project_id': '98a6a2dcbf0248d5b353760f7757f713', 'neutron:cidrs': '10.2.5.104/24', 'neutron:device_owner': 'manila:share', 'neutron:subnet_pool_addr_scope4': '', 'neutron:subnet_pool_addr_scope6': '', 'neutron:network_name': 'neutron-9aaf4bd9-9f34-40ad-a4e7-932bff23895a', 'neutron:security_group_ids': '', 'neutron:revision_number': '1', 'neutron:vnic_type': 'normal', 'neutron:port_capabilities': '', 'neutron:mtu': ''}, 'parent_name': [], 'enabled': True, 'options': {'requested-chassis': 'l75lg1-v1', 'mcast_flood_reports': 'true'}, 'type': '', 'port_security': []}), if_exists=True, qos={'qos_min_rate': None}) {{(pid=77619) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:56:06 l75lg1-v1 neutron-server[77619]: DEBUG ovsdbapp.backend.ovs_idl.transaction [None req-53cecb61-7023-41e4-a5ea-23b1eb02606a None None] Running txn n=1 command(idx=3): QoSDelCommand(_result=None, switch=neutron-9aaf4bd9-9f34-40ad-a4e7-932bff23895a, conditions=[('direction', '=', 'from-lport'), ('priority', '=', 2002), ('match', '=', 'inport == "ee263a3a-4660-4a5c-90cd-7a1cce9cbb6c"')], if_exists=True) {{(pid=77619) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:56:06 l75lg1-v1 neutron-server[77619]: DEBUG ovsdbapp.backend.ovs_idl.transaction [None req-53cecb61-7023-41e4-a5ea-23b1eb02606a None None] Running txn n=1 command(idx=4): UpdateLSwitchPortQosOptionsCommand(_result=None, lport=AddLSwitchPortCommand(_result=e258544b-ffbc-42cd-8cb2-eddda3014531, lport=ee263a3a-4660-4a5c-90cd-7a1cce9cbb6c, lswitch=neutron-9aaf4bd9-9f34-40ad-a4e7-932bff23895a, may_exist=True, columns={'addresses': ['fa:16:3e:bd:2e:11 10.2.5.104', 'unknown'], 'external_ids': {'neutron:port_name': '', 'neutron:device_id': 'manila-admin-share', 'neutron:project_id': '98a6a2dcbf0248d5b353760f7757f713', 'neutron:cidrs': '10.2.5.104/24', 'neutron:device_owner': 'manila:share', 'neutron:subnet_pool_addr_scope4': '', 'neutron:subnet_pool_addr_scope6': '', 'neutron:network_name': 'neutron-9aaf4bd9-9f34-40ad-a4e7-932bff23895a', 'neutron:security_group_ids': '', 'neutron:revision_number': '1', 'neutron:vnic_type': 'normal', 'neutron:port_capabilities': '', 'neutron:mtu': ''}, 'parent_name': [], 'enabled': True, 'options': {'requested-chassis': 'l75lg1-v1', 'mcast_flood_reports': 'true'}, 'type': '', 'port_security': []}), if_exists=True, qos={'qos_min_rate': None}) {{(pid=77619) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:56:06 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-53cecb61-7023-41e4-a5ea-23b1eb02606a None None] Hash Ring: Node c89b3497-133e-4a5a-b67a-3310d2cb2485 (host: l75lg1-v1) handling event "update" for row e86fe565-3ce6-403d-9fe7-8fd8a269888e (table: Logical_Switch) {{(pid=77619) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:56:06 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-53cecb61-7023-41e4-a5ea-23b1eb02606a None None] Hash Ring: Node c89b3497-133e-4a5a-b67a-3310d2cb2485 (host: l75lg1-v1) handling event "create" for row f10c31c0-cca8-4d9c-9172-c5c200d33f0a (table: Logical_Switch_Port) {{(pid=77619) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:56:06 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-53cecb61-7023-41e4-a5ea-23b1eb02606a None None] Hash Ring: Node c89b3497-133e-4a5a-b67a-3310d2cb2485 (host: l75lg1-v1) handling event "update" for row f10c31c0-cca8-4d9c-9172-c5c200d33f0a (table: Logical_Switch_Port) {{(pid=77619) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:56:06 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-03b5f984-1478-4ad6-9838-8e34c1689c5b None None] Hash Ring: Node c89b3497-133e-4a5a-b67a-3310d2cb2485 (host: l75lg1-v1) handling event "create" for row 5ed3c2b8-2c64-42b6-9990-9af55bb24c0b (table: Port_Binding) {{(pid=77619) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:56:06 l75lg1-v1 neutron-server[77619]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-931c3c0e-c8dd-49a1-acc2-117e5d5ec393 service neutron] Pushing event updated for resources: {'Port': ['ID=ee263a3a-4660-4a5c-90cd-7a1cce9cbb6c,revision_number=1']} {{(pid=77619) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 28 12:56:06 l75lg1-v1 neutron-server[77619]: INFO neutron.db.ovn_revision_numbers_db [None req-931c3c0e-c8dd-49a1-acc2-117e5d5ec393 service neutron] Successfully bumped revision number for resource ee263a3a-4660-4a5c-90cd-7a1cce9cbb6c (type: ports) to 1 May 28 12:56:06 l75lg1-v1 neutron-server[77619]: INFO neutron.tests.unit.plugins.ml2.drivers.mechanism_logger [None req-931c3c0e-c8dd-49a1-acc2-117e5d5ec393 service neutron] create_port_postcommit called with port settings {'id': 'ee263a3a-4660-4a5c-90cd-7a1cce9cbb6c', 'name': '', 'network_id': '9aaf4bd9-9f34-40ad-a4e7-932bff23895a', 'tenant_id': '98a6a2dcbf0248d5b353760f7757f713', 'mac_address': 'fa:16:3e:bd:2e:11', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'manila-admin-share', 'device_owner': 'manila:share', 'standard_attr_id': 64, 'fixed_ips': [{'subnet_id': 'd5781979-4de3-490b-a4f1-017afe11a304', 'ip_address': '10.2.5.104'}], 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'port_security_enabled': False, 'security_groups': [], 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'l75lg1-v1', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'description': '', 'tags': [], 'created_at': '2024-05-28T12:56:06Z', 'updated_at': '2024-05-28T12:56:06Z', 'revision_number': 1, 'network': {'id': '9aaf4bd9-9f34-40ad-a4e7-932bff23895a', 'name': 'admin_net', 'tenant_id': '98a6a2dcbf0248d5b353760f7757f713', 'admin_state_up': True, 'mtu': 1442, 'status': 'ACTIVE', 'subnets': ['d5781979-4de3-490b-a4f1-017afe11a304'], 'standard_attr_id': 56, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'vlan_transparent': None, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2024-05-28T12:55:50Z', 'updated_at': '2024-05-28T12:55:56Z', 'revision_number': 2, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 32656}} (original settings None) host l75lg1-v1 (original host None) vif type unbound (original vif type None) vif details {} (original vif details None) binding levels None (original binding levels None) on network {'id': '9aaf4bd9-9f34-40ad-a4e7-932bff23895a', 'name': 'admin_net', 'tenant_id': '98a6a2dcbf0248d5b353760f7757f713', 'admin_state_up': True, 'mtu': 1442, 'status': 'ACTIVE', 'subnets': ['d5781979-4de3-490b-a4f1-017afe11a304'], 'standard_attr_id': 56, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'vlan_transparent': None, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2024-05-28T12:55:50Z', 'updated_at': '2024-05-28T12:55:56Z', 'revision_number': 2, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 32656} with segments to bind None May 28 12:56:06 l75lg1-v1 neutron-server[77619]: DEBUG neutron.tests.unit.plugins.ml2.drivers.mechanism_logger [None req-931c3c0e-c8dd-49a1-acc2-117e5d5ec393 service neutron] create_port_postcommit: May 28 12:56:06 l75lg1-v1 neutron-server[77619]: key[tenant_id], None -> 98a6a2dcbf0248d5b353760f7757f713 May 28 12:56:06 l75lg1-v1 neutron-server[77619]: key[network_id], None -> 9aaf4bd9-9f34-40ad-a4e7-932bff23895a May 28 12:56:06 l75lg1-v1 neutron-server[77619]: key[allowed_address_pairs], None -> [] May 28 12:56:06 l75lg1-v1 neutron-server[77619]: key[binding:vif_type], None -> unbound May 28 12:56:06 l75lg1-v1 neutron-server[77619]: key[project_id], None -> 98a6a2dcbf0248d5b353760f7757f713 May 28 12:56:06 l75lg1-v1 neutron-server[77619]: key[admin_state_up], None -> True May 28 12:56:06 l75lg1-v1 neutron-server[77619]: key[id], None -> ee263a3a-4660-4a5c-90cd-7a1cce9cbb6c May 28 12:56:06 l75lg1-v1 neutron-server[77619]: key[security_groups], None -> [] May 28 12:56:06 l75lg1-v1 neutron-server[77619]: key[extra_dhcp_opts], None -> [] May 28 12:56:06 l75lg1-v1 neutron-server[77619]: key[binding:vnic_type], None -> normal May 28 12:56:06 l75lg1-v1 neutron-server[77619]: key[tags], None -> [] May 28 12:56:06 l75lg1-v1 neutron-server[77619]: key[name], None -> May 28 12:56:06 l75lg1-v1 neutron-server[77619]: key[created_at], None -> 2024-05-28T12:56:06Z May 28 12:56:06 l75lg1-v1 neutron-server[77619]: key[status], None -> DOWN May 28 12:56:06 l75lg1-v1 neutron-server[77619]: key[binding:profile], None -> {} May 28 12:56:06 l75lg1-v1 neutron-server[77619]: key[port_security_enabled], None -> False May 28 12:56:06 l75lg1-v1 neutron-server[77619]: key[updated_at], None -> 2024-05-28T12:56:06Z May 28 12:56:06 l75lg1-v1 neutron-server[77619]: key[network], None -> {'id': '9aaf4bd9-9f34-40ad-a4e7-932bff23895a', 'name': 'admin_net', 'tenant_id': '98a6a2dcbf0248d5b353760f7757f713', 'admin_state_up': True, 'mtu': 1442, 'status': 'ACTIVE', 'subnets': ['d5781979-4de3-490b-a4f1-017afe11a304'], 'standard_attr_id': 56, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'vlan_transparent': None, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2024-05-28T12:55:50Z', 'updated_at': '2024-05-28T12:55:56Z', 'revision_number': 2, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 32656} May 28 12:56:06 l75lg1-v1 neutron-server[77619]: key[standard_attr_id], None -> 64 May 28 12:56:06 l75lg1-v1 neutron-server[77619]: key[device_owner], None -> manila:share May 28 12:56:06 l75lg1-v1 neutron-server[77619]: key[device_id], None -> manila-admin-share May 28 12:56:06 l75lg1-v1 neutron-server[77619]: key[mac_address], None -> fa:16:3e:bd:2e:11 May 28 12:56:06 l75lg1-v1 neutron-server[77619]: key[description], None -> May 28 12:56:06 l75lg1-v1 neutron-server[77619]: key[binding:host_id], None -> l75lg1-v1 May 28 12:56:06 l75lg1-v1 neutron-server[77619]: key[binding:vif_details], None -> {} May 28 12:56:06 l75lg1-v1 neutron-server[77619]: key[revision_number], None -> 1 May 28 12:56:06 l75lg1-v1 neutron-server[77619]: key[fixed_ips], None -> [{'subnet_id': 'd5781979-4de3-490b-a4f1-017afe11a304', 'ip_address': '10.2.5.104'}] May 28 12:56:06 l75lg1-v1 neutron-server[77619]: {{(pid=77619) _log_diff_call /opt/stack/neutron/neutron/tests/unit/plugins/ml2/drivers/mechanism_logger.py:59}} May 28 12:56:06 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.managers [None req-931c3c0e-c8dd-49a1-acc2-117e5d5ec393 service neutron] Attempting to bind port ee263a3a-4660-4a5c-90cd-7a1cce9cbb6c on host l75lg1-v1 for vnic_type normal with profile {{(pid=77619) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:810}} May 28 12:56:06 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.managers [None req-931c3c0e-c8dd-49a1-acc2-117e5d5ec393 service neutron] Attempting to bind port ee263a3a-4660-4a5c-90cd-7a1cce9cbb6c by drivers ovn,logger on host l75lg1-v1 at level 0 using segments [{'id': 'ce8322a7-55e6-4ca6-9e93-5a845a3474f8', 'network_type': 'geneve', 'physical_network': None, 'segmentation_id': 32656, 'network_id': '9aaf4bd9-9f34-40ad-a4e7-932bff23895a'}] {{(pid=77619) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:835}} May 28 12:56:06 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver [None req-931c3c0e-c8dd-49a1-acc2-117e5d5ec393 service neutron] Attempting to bind port ee263a3a-4660-4a5c-90cd-7a1cce9cbb6c on host l75lg1-v1 for network segment with type geneve, segmentation ID 32656, physical network None {{(pid=77619) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/mech_driver.py:1009}} May 28 12:56:06 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.managers [None req-931c3c0e-c8dd-49a1-acc2-117e5d5ec393 service neutron] Bound port: ee263a3a-4660-4a5c-90cd-7a1cce9cbb6c, host: l75lg1-v1, vif_type: ovs, vif_details: {"port_filter": true, "connectivity": "l2", "bridge_name": "br-int", "datapath_type": "system"}, binding_levels: [{'bound_driver': 'ovn', 'bound_segment': {'id': 'ce8322a7-55e6-4ca6-9e93-5a845a3474f8', 'network_type': 'geneve', 'physical_network': None, 'segmentation_id': 32656, 'network_id': '9aaf4bd9-9f34-40ad-a4e7-932bff23895a'}}] {{(pid=77619) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:947}} May 28 12:56:06 l75lg1-v1 neutron-server[77619]: DEBUG neutron_lib.callbacks.manager [None req-931c3c0e-c8dd-49a1-acc2-117e5d5ec393 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1015114', 'neutron.services.ovn_l3.plugin.OVNL3RouterPlugin._port_update-8754901907784', 'neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_internal_ip_change_for_fip-8754903031884'] for port (ee263a3a-4660-4a5c-90cd-7a1cce9cbb6c), before_update {{(pid=77619) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG dbcounter [-] [96589] Writer thread running {{(pid=96589) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} May 28 12:56:06 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.db [None req-931c3c0e-c8dd-49a1-acc2-117e5d5ec393 service neutron] For port ee263a3a-4660-4a5c-90cd-7a1cce9cbb6c, host l75lg1-v1, cleared binding levels {{(pid=77619) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: DEBUG manila.service [None req-a377e1e8-311a-47f0-b22c-98dec19daf2b None None] Creating RPC server for service manila-data. {{(pid=96589) start /opt/stack/manila/manila/service.py:159}} May 28 12:56:06 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.db [None req-931c3c0e-c8dd-49a1-acc2-117e5d5ec393 service neutron] For port ee263a3a-4660-4a5c-90cd-7a1cce9cbb6c, host l75lg1-v1, set binding levels [PortBindingLevel(driver='ovn',host='l75lg1-v1',level=0,port_id=ee263a3a-4660-4a5c-90cd-7a1cce9cbb6c,segment=NetworkSegment(ce8322a7-55e6-4ca6-9e93-5a845a3474f8),segment_id=ce8322a7-55e6-4ca6-9e93-5a845a3474f8)] {{(pid=77619) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} May 28 12:56:06 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver [None req-931c3c0e-c8dd-49a1-acc2-117e5d5ec393 service neutron] No provisioning block for port ee263a3a-4660-4a5c-90cd-7a1cce9cbb6c since host unchanged {{(pid=77619) _is_port_provisioning_required /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/mech_driver.py:725}} May 28 12:56:06 l75lg1-v1 neutron-server[77619]: INFO neutron.tests.unit.plugins.ml2.drivers.mechanism_logger [None req-931c3c0e-c8dd-49a1-acc2-117e5d5ec393 service neutron] update_port_precommit called with port settings {'id': 'ee263a3a-4660-4a5c-90cd-7a1cce9cbb6c', 'name': '', 'network_id': '9aaf4bd9-9f34-40ad-a4e7-932bff23895a', 'tenant_id': '98a6a2dcbf0248d5b353760f7757f713', 'mac_address': 'fa:16:3e:bd:2e:11', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'manila-admin-share', 'device_owner': 'manila:share', 'standard_attr_id': 64, 'fixed_ips': [{'subnet_id': 'd5781979-4de3-490b-a4f1-017afe11a304', 'ip_address': '10.2.5.104'}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'l75lg1-v1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'port_filter': True, 'connectivity': 'l2', 'bridge_name': 'br-int', 'datapath_type': 'system'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2024-05-28T12:56:06Z', 'updated_at': '2024-05-28T12:56:06Z', 'revision_number': 1, 'project_id': '98a6a2dcbf0248d5b353760f7757f713'} (original settings {'id': 'ee263a3a-4660-4a5c-90cd-7a1cce9cbb6c', 'name': '', 'network_id': '9aaf4bd9-9f34-40ad-a4e7-932bff23895a', 'tenant_id': '98a6a2dcbf0248d5b353760f7757f713', 'mac_address': 'fa:16:3e:bd:2e:11', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'manila-admin-share', 'device_owner': 'manila:share', 'standard_attr_id': 64, 'fixed_ips': [{'subnet_id': 'd5781979-4de3-490b-a4f1-017afe11a304', 'ip_address': '10.2.5.104'}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'l75lg1-v1', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2024-05-28T12:56:06Z', 'updated_at': '2024-05-28T12:56:06Z', 'revision_number': 1, 'project_id': '98a6a2dcbf0248d5b353760f7757f713'}) host l75lg1-v1 (original host l75lg1-v1) vif type ovs (original vif type unbound) vif details {'port_filter': True, 'connectivity': 'l2', 'bridge_name': 'br-int', 'datapath_type': 'system'} (original vif details {}) binding levels [{'bound_driver': 'ovn', 'bound_segment': {'id': 'ce8322a7-55e6-4ca6-9e93-5a845a3474f8', 'network_type': 'geneve', 'physical_network': None, 'segmentation_id': 32656, 'network_id': '9aaf4bd9-9f34-40ad-a4e7-932bff23895a'}}] (original binding levels None) on network {'id': '9aaf4bd9-9f34-40ad-a4e7-932bff23895a', 'name': 'admin_net', 'tenant_id': '98a6a2dcbf0248d5b353760f7757f713', 'admin_state_up': True, 'mtu': 1442, 'status': 'ACTIVE', 'subnets': ['d5781979-4de3-490b-a4f1-017afe11a304'], 'standard_attr_id': 56, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'vlan_transparent': None, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2024-05-28T12:55:50Z', 'updated_at': '2024-05-28T12:55:56Z', 'revision_number': 2, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 32656} with segments to bind None May 28 12:56:06 l75lg1-v1 neutron-server[77619]: DEBUG neutron.tests.unit.plugins.ml2.drivers.mechanism_logger [None req-931c3c0e-c8dd-49a1-acc2-117e5d5ec393 service neutron] update_port_precommit: May 28 12:56:06 l75lg1-v1 neutron-server[77619]: key[binding:vif_type], unbound -> ovs May 28 12:56:06 l75lg1-v1 neutron-server[77619]: key[binding:vif_details], {} -> {'port_filter': True, 'connectivity': 'l2', 'bridge_name': 'br-int', 'datapath_type': 'system'} May 28 12:56:06 l75lg1-v1 neutron-server[77619]: {{(pid=77619) _log_diff_call /opt/stack/neutron/neutron/tests/unit/plugins/ml2/drivers/mechanism_logger.py:59}} May 28 12:56:06 l75lg1-v1 sudo[97604]: pam_unix(sudo:session): session closed for user root May 28 12:56:06 l75lg1-v1 neutron-server[77619]: DEBUG neutron_lib.callbacks.manager [None req-931c3c0e-c8dd-49a1-acc2-117e5d5ec393 service neutron] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4166243', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8754903016533', 'neutron.services.ovn_l3.plugin.OVNL3RouterPlugin._port_update-8754901907784'] for port (ee263a3a-4660-4a5c-90cd-7a1cce9cbb6c), after_update {{(pid=77619) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:56:06 l75lg1-v1 manila-share[96506]: DEBUG oslo_concurrency.processutils [None req-6c173bbc-673a-4c3c-a470-52ad1ebf882a None None] CMD "sudo manila-rootwrap /etc/manila/rootwrap.conf ip link set tapb338c4f5-86 up" returned: 0 in 0.414s {{(pid=96506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:428}} May 28 12:56:06 l75lg1-v1 manila-share[96506]: DEBUG oslo_concurrency.lockutils [None req-6c173bbc-673a-4c3c-a470-52ad1ebf882a None None] Lock "linux_interface_device_name_tapb338c4f5-86" "released" by "manila.network.linux.interface.device_name_synchronized..wrapped_func..source_func" :: held 0.453s {{(pid=96506) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:56:06 l75lg1-v1 manila-share[96506]: DEBUG oslo_concurrency.lockutils [None req-6c173bbc-673a-4c3c-a470-52ad1ebf882a None None] Acquiring lock "linux_interface_device_name_tapb338c4f5-86" by "manila.network.linux.interface.device_name_synchronized..wrapped_func..source_func" {{(pid=96506) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:56:06 l75lg1-v1 manila-share[96506]: DEBUG oslo_concurrency.lockutils [None req-6c173bbc-673a-4c3c-a470-52ad1ebf882a None None] Lock "linux_interface_device_name_tapb338c4f5-86" acquired by "manila.network.linux.interface.device_name_synchronized..wrapped_func..source_func" :: waited 0.001s {{(pid=96506) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:56:06 l75lg1-v1 manila-share[96506]: DEBUG oslo_concurrency.processutils [None req-6c173bbc-673a-4c3c-a470-52ad1ebf882a None None] Running cmd (subprocess): ip addr show tapb338c4f5-86 permanent scope global {{(pid=96506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:390}} May 28 12:56:06 l75lg1-v1 manila-data[96589]: INFO oslo.messaging._drivers.impl_rabbit [None req-a377e1e8-311a-47f0-b22c-98dec19daf2b None None] Creating fanout queue: manila-data_fanout_068265cc1cde44479683418af90c74b4 May 28 12:56:06 l75lg1-v1 manila-share[96506]: DEBUG oslo_concurrency.processutils [None req-6c173bbc-673a-4c3c-a470-52ad1ebf882a None None] CMD "ip addr show tapb338c4f5-86 permanent scope global" returned: 0 in 0.010s {{(pid=96506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:428}} May 28 12:56:06 l75lg1-v1 manila-share[96506]: DEBUG oslo_concurrency.processutils [None req-6c173bbc-673a-4c3c-a470-52ad1ebf882a None None] Running cmd (subprocess): ip route list proto kernel dev tapb338c4f5-86 {{(pid=96506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:390}} May 28 12:56:06 l75lg1-v1 manila-share[96506]: DEBUG oslo_concurrency.processutils [None req-6c173bbc-673a-4c3c-a470-52ad1ebf882a None None] CMD "ip route list proto kernel dev tapb338c4f5-86" returned: 0 in 0.010s {{(pid=96506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:428}} May 28 12:56:06 l75lg1-v1 manila-share[96506]: DEBUG oslo_concurrency.processutils [None req-6c173bbc-673a-4c3c-a470-52ad1ebf882a None None] Running cmd (subprocess): ip addr show tapb338c4f5-86 {{(pid=96506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:390}} May 28 12:56:06 l75lg1-v1 manila-share[96506]: DEBUG oslo_concurrency.processutils [None req-6c173bbc-673a-4c3c-a470-52ad1ebf882a None None] CMD "ip addr show tapb338c4f5-86" returned: 0 in 0.012s {{(pid=96506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:428}} May 28 12:56:06 l75lg1-v1 manila-share[96506]: DEBUG oslo_concurrency.processutils [None req-6c173bbc-673a-4c3c-a470-52ad1ebf882a None None] Running cmd (subprocess): ip -o link list {{(pid=96506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:390}} May 28 12:56:06 l75lg1-v1 neutron-server[77619]: DEBUG ovsdbapp.backend.ovs_idl.transaction [None req-53cecb61-7023-41e4-a5ea-23b1eb02606a None None] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=ee263a3a-4660-4a5c-90cd-7a1cce9cbb6c, resource={'id': 'ee263a3a-4660-4a5c-90cd-7a1cce9cbb6c', 'name': '', 'network_id': '9aaf4bd9-9f34-40ad-a4e7-932bff23895a', 'tenant_id': '98a6a2dcbf0248d5b353760f7757f713', 'mac_address': 'fa:16:3e:bd:2e:11', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'manila-admin-share', 'device_owner': 'manila:share', 'standard_attr_id': 64, 'fixed_ips': [{'subnet_id': 'd5781979-4de3-490b-a4f1-017afe11a304', 'ip_address': '10.2.5.104'}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'l75lg1-v1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'port_filter': True, 'connectivity': 'l2', 'bridge_name': 'br-int', 'datapath_type': 'system'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2024-05-28T12:56:06Z', 'updated_at': '2024-05-28T12:56:06Z', 'revision_number': 1, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'network': {'id': '9aaf4bd9-9f34-40ad-a4e7-932bff23895a', 'name': 'admin_net', 'tenant_id': '98a6a2dcbf0248d5b353760f7757f713', 'admin_state_up': True, 'mtu': 1442, 'status': 'ACTIVE', 'subnets': ['d5781979-4de3-490b-a4f1-017afe11a304'], 'standard_attr_id': 56, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'vlan_transparent': None, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2024-05-28T12:55:50Z', 'updated_at': '2024-05-28T12:55:56Z', 'revision_number': 2, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 32656}}, resource_type=ports, if_exists=True) {{(pid=77619) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:56:06 l75lg1-v1 neutron-server[77619]: DEBUG ovsdbapp.backend.ovs_idl.transaction [None req-53cecb61-7023-41e4-a5ea-23b1eb02606a None None] Running txn n=1 command(idx=1): SetLSwitchPortCommand(_result=None, lport=ee263a3a-4660-4a5c-90cd-7a1cce9cbb6c, external_ids_update=None, columns={'external_ids': {'neutron:port_name': '', 'neutron:device_id': 'manila-admin-share', 'neutron:project_id': '98a6a2dcbf0248d5b353760f7757f713', 'neutron:cidrs': '10.2.5.104/24', 'neutron:device_owner': 'manila:share', 'neutron:subnet_pool_addr_scope4': '', 'neutron:subnet_pool_addr_scope6': '', 'neutron:network_name': 'neutron-9aaf4bd9-9f34-40ad-a4e7-932bff23895a', 'neutron:security_group_ids': '', 'neutron:revision_number': '1', 'neutron:vnic_type': 'normal', 'neutron:port_capabilities': '', 'neutron:mtu': ''}, 'parent_name': [], 'tag': [], 'options': {'requested-chassis': 'l75lg1-v1', 'mcast_flood_reports': 'true'}, 'enabled': True, 'port_security': [], 'dhcpv4_options': [UUID('94959b07-bcd6-4d66-b78b-787c59b1d5b6')], 'dhcpv6_options': [], 'type': '', 'addresses': ['fa:16:3e:bd:2e:11 10.2.5.104', 'unknown'], 'ha_chassis_group': []}, if_exists=False) {{(pid=77619) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:56:06 l75lg1-v1 neutron-server[77619]: DEBUG ovsdbapp.backend.ovs_idl.transaction [None req-53cecb61-7023-41e4-a5ea-23b1eb02606a None None] Running txn n=1 command(idx=2): PgDelPortCommand(_result=None, port_group=neutron_pg_drop, lsp=['ee263a3a-4660-4a5c-90cd-7a1cce9cbb6c'], if_exists=False) {{(pid=77619) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:56:06 l75lg1-v1 manila-share[96506]: DEBUG oslo_concurrency.processutils [None req-6c173bbc-673a-4c3c-a470-52ad1ebf882a None None] CMD "ip -o link list" returned: 0 in 0.010s {{(pid=96506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:428}} May 28 12:56:06 l75lg1-v1 manila-share[96506]: DEBUG oslo_concurrency.lockutils [None req-6c173bbc-673a-4c3c-a470-52ad1ebf882a None None] Lock "linux_interface_device_name_tapb338c4f5-86" "released" by "manila.network.linux.interface.device_name_synchronized..wrapped_func..source_func" :: held 0.047s {{(pid=96506) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:56:06 l75lg1-v1 manila-share[96506]: DEBUG oslo_concurrency.lockutils [None req-6c173bbc-673a-4c3c-a470-52ad1ebf882a None None] Lock "service_instance_plug_interface_in_host" "released" by "manila.share.drivers.service_instance.NeutronNetworkHelper._plug_interface_in_host" :: held 0.503s {{(pid=96506) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:56:06 l75lg1-v1 manila-share[96506]: DEBUG manila.share.drivers.service_instance [None req-6c173bbc-673a-4c3c-a470-52ad1ebf882a None None] Plugging service instance into admin network 9aaf4bd9-9f34-40ad-a4e7-932bff23895a. {{(pid=96506) setup_connectivity_with_service_instances /opt/stack/manila/manila/share/drivers/service_instance.py:990}} May 28 12:56:06 l75lg1-v1 manila-share[96506]: DEBUG oslo_concurrency.lockutils [None req-6c173bbc-673a-4c3c-a470-52ad1ebf882a None None] Acquiring lock "service_instance_get_service_port" by "manila.share.drivers.service_instance.NeutronNetworkHelper._get_service_port" {{(pid=96506) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:56:06 l75lg1-v1 neutron-server[77619]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-931c3c0e-c8dd-49a1-acc2-117e5d5ec393 service neutron] Pushing event updated for resources: {'Port': ['ID=ee263a3a-4660-4a5c-90cd-7a1cce9cbb6c,revision_number=3']} {{(pid=77619) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 28 12:56:07 l75lg1-v1 neutron-server[77619]: INFO neutron.db.ovn_revision_numbers_db [None req-931c3c0e-c8dd-49a1-acc2-117e5d5ec393 service neutron] Successfully bumped revision number for resource ee263a3a-4660-4a5c-90cd-7a1cce9cbb6c (type: ports) to 1 May 28 12:56:07 l75lg1-v1 neutron-server[77619]: INFO neutron.tests.unit.plugins.ml2.drivers.mechanism_logger [None req-931c3c0e-c8dd-49a1-acc2-117e5d5ec393 service neutron] update_port_postcommit called with port settings {'id': 'ee263a3a-4660-4a5c-90cd-7a1cce9cbb6c', 'name': '', 'network_id': '9aaf4bd9-9f34-40ad-a4e7-932bff23895a', 'tenant_id': '98a6a2dcbf0248d5b353760f7757f713', 'mac_address': 'fa:16:3e:bd:2e:11', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'manila-admin-share', 'device_owner': 'manila:share', 'standard_attr_id': 64, 'fixed_ips': [{'subnet_id': 'd5781979-4de3-490b-a4f1-017afe11a304', 'ip_address': '10.2.5.104'}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'l75lg1-v1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'port_filter': True, 'connectivity': 'l2', 'bridge_name': 'br-int', 'datapath_type': 'system'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2024-05-28T12:56:06Z', 'updated_at': '2024-05-28T12:56:06Z', 'revision_number': 1, 'project_id': '98a6a2dcbf0248d5b353760f7757f713'} (original settings {'id': 'ee263a3a-4660-4a5c-90cd-7a1cce9cbb6c', 'name': '', 'network_id': '9aaf4bd9-9f34-40ad-a4e7-932bff23895a', 'tenant_id': '98a6a2dcbf0248d5b353760f7757f713', 'mac_address': 'fa:16:3e:bd:2e:11', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'manila-admin-share', 'device_owner': 'manila:share', 'standard_attr_id': 64, 'fixed_ips': [{'subnet_id': 'd5781979-4de3-490b-a4f1-017afe11a304', 'ip_address': '10.2.5.104'}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'l75lg1-v1', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2024-05-28T12:56:06Z', 'updated_at': '2024-05-28T12:56:06Z', 'revision_number': 1, 'project_id': '98a6a2dcbf0248d5b353760f7757f713'}) host l75lg1-v1 (original host l75lg1-v1) vif type ovs (original vif type unbound) vif details {'port_filter': True, 'connectivity': 'l2', 'bridge_name': 'br-int', 'datapath_type': 'system'} (original vif details {}) binding levels [{'bound_driver': 'ovn', 'bound_segment': {'id': 'ce8322a7-55e6-4ca6-9e93-5a845a3474f8', 'network_type': 'geneve', 'physical_network': None, 'segmentation_id': 32656, 'network_id': '9aaf4bd9-9f34-40ad-a4e7-932bff23895a'}}] (original binding levels None) on network {'id': '9aaf4bd9-9f34-40ad-a4e7-932bff23895a', 'name': 'admin_net', 'tenant_id': '98a6a2dcbf0248d5b353760f7757f713', 'admin_state_up': True, 'mtu': 1442, 'status': 'ACTIVE', 'subnets': ['d5781979-4de3-490b-a4f1-017afe11a304'], 'standard_attr_id': 56, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'vlan_transparent': None, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2024-05-28T12:55:50Z', 'updated_at': '2024-05-28T12:55:56Z', 'revision_number': 2, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 32656} with segments to bind None May 28 12:56:07 l75lg1-v1 neutron-server[77619]: DEBUG neutron.tests.unit.plugins.ml2.drivers.mechanism_logger [None req-931c3c0e-c8dd-49a1-acc2-117e5d5ec393 service neutron] update_port_postcommit: May 28 12:56:07 l75lg1-v1 neutron-server[77619]: key[binding:vif_type], unbound -> ovs May 28 12:56:07 l75lg1-v1 neutron-server[77619]: key[binding:vif_details], {} -> {'port_filter': True, 'connectivity': 'l2', 'bridge_name': 'br-int', 'datapath_type': 'system'} May 28 12:56:07 l75lg1-v1 neutron-server[77619]: {{(pid=77619) _log_diff_call /opt/stack/neutron/neutron/tests/unit/plugins/ml2/drivers/mechanism_logger.py:59}} May 28 12:56:07 l75lg1-v1 neutron-server[77619]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-931c3c0e-c8dd-49a1-acc2-117e5d5ec393 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=77619) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:258}} May 28 12:56:07 l75lg1-v1 neutron-server[77619]: DEBUG neutron_lib.callbacks.manager [None req-931c3c0e-c8dd-49a1-acc2-117e5d5ec393 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-4016492'] for port (None), before_response {{(pid=77619) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:56:07 l75lg1-v1 neutron-server[77619]: INFO neutron.wsgi [None req-931c3c0e-c8dd-49a1-acc2-117e5d5ec393 service neutron] 10.27.203.238 "POST /networking/v2.0/ports HTTP/1.1" status: 201 len: 1077 time: 0.5370753 May 28 12:56:07 l75lg1-v1 manila-share[96151]: DEBUG oslo_concurrency.lockutils [None req-2cf6ab01-c9ac-4126-b67e-f98b4a543484 None None] Lock "service_instance_get_service_port" "released" by "manila.share.drivers.service_instance.NeutronNetworkHelper._get_service_port" :: held 0.575s {{(pid=96151) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:56:07 l75lg1-v1 manila-share[96151]: DEBUG oslo_concurrency.lockutils [None req-2cf6ab01-c9ac-4126-b67e-f98b4a543484 None None] Acquiring lock "service_instance_plug_interface_in_host" by "manila.share.drivers.service_instance.NeutronNetworkHelper._plug_interface_in_host" {{(pid=96151) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:56:07 l75lg1-v1 manila-share[96151]: DEBUG oslo_concurrency.lockutils [None req-2cf6ab01-c9ac-4126-b67e-f98b4a543484 None None] Lock "service_instance_plug_interface_in_host" acquired by "manila.share.drivers.service_instance.NeutronNetworkHelper._plug_interface_in_host" :: waited 0.000s {{(pid=96151) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:56:07 l75lg1-v1 manila-share[96151]: DEBUG manila.share.drivers.service_instance [None req-2cf6ab01-c9ac-4126-b67e-f98b4a543484 None None] Plug interface into host - interface_name: tapee263a3a-46, device: tapee263a3a-46, port: {'id': 'ee263a3a-4660-4a5c-90cd-7a1cce9cbb6c', 'name': '', 'network_id': '9aaf4bd9-9f34-40ad-a4e7-932bff23895a', 'tenant_id': '98a6a2dcbf0248d5b353760f7757f713', 'mac_address': 'fa:16:3e:bd:2e:11', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'manila-admin-share', 'device_owner': 'manila:share', 'fixed_ips': [{'subnet_id': 'd5781979-4de3-490b-a4f1-017afe11a304', 'ip_address': '10.2.5.104'}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'l75lg1-v1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'port_filter': True, 'connectivity': 'l2', 'bridge_name': 'br-int', 'datapath_type': 'system'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2024-05-28T12:56:06Z', 'updated_at': '2024-05-28T12:56:06Z', 'revision_number': 1, 'project_id': '98a6a2dcbf0248d5b353760f7757f713'} {{(pid=96151) _plug_interface_in_host /opt/stack/manila/manila/share/drivers/service_instance.py:1005}} May 28 12:56:07 l75lg1-v1 manila-share[96151]: DEBUG oslo_concurrency.lockutils [None req-2cf6ab01-c9ac-4126-b67e-f98b4a543484 None None] Acquiring lock "linux_interface_device_name_tapee263a3a-46" by "manila.network.linux.interface.device_name_synchronized..wrapped_func..source_func" {{(pid=96151) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:56:07 l75lg1-v1 manila-share[96151]: DEBUG oslo_concurrency.lockutils [None req-2cf6ab01-c9ac-4126-b67e-f98b4a543484 None None] Lock "linux_interface_device_name_tapee263a3a-46" acquired by "manila.network.linux.interface.device_name_synchronized..wrapped_func..source_func" :: waited 0.000s {{(pid=96151) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:56:07 l75lg1-v1 manila-share[96151]: DEBUG oslo_concurrency.processutils [None req-2cf6ab01-c9ac-4126-b67e-f98b4a543484 None None] Running cmd (subprocess): ip -o link show br-int {{(pid=96151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:390}} May 28 12:56:07 l75lg1-v1 manila-share[96151]: DEBUG oslo_concurrency.processutils [None req-2cf6ab01-c9ac-4126-b67e-f98b4a543484 None None] CMD "ip -o link show br-int" returned: 0 in 0.012s {{(pid=96151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:428}} May 28 12:56:07 l75lg1-v1 manila-share[96151]: DEBUG oslo_concurrency.processutils [None req-2cf6ab01-c9ac-4126-b67e-f98b4a543484 None None] Running cmd (subprocess): ip -o link show tapee263a3a-46 {{(pid=96151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:390}} May 28 12:56:07 l75lg1-v1 manila-share[96151]: DEBUG oslo_concurrency.processutils [None req-2cf6ab01-c9ac-4126-b67e-f98b4a543484 None None] CMD "ip -o link show tapee263a3a-46" returned: 1 in 0.010s {{(pid=96151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:428}} May 28 12:56:07 l75lg1-v1 manila-share[96151]: DEBUG oslo_concurrency.processutils [None req-2cf6ab01-c9ac-4126-b67e-f98b4a543484 None None] 'ip -o link show tapee263a3a-46' failed. Not Retrying. {{(pid=96151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:479}} May 28 12:56:07 l75lg1-v1 manila-share[96151]: INFO manila.network.linux.interface [None req-2cf6ab01-c9ac-4126-b67e-f98b4a543484 None None] Device tapee263a3a-46 does not exist - creating .... May 28 12:56:07 l75lg1-v1 manila-share[96151]: DEBUG oslo_concurrency.processutils [None req-2cf6ab01-c9ac-4126-b67e-f98b4a543484 None None] Running cmd (subprocess): sudo manila-rootwrap /etc/manila/rootwrap.conf ovs-vsctl -- --may-exist add-port br-int tapee263a3a-46 -- set Interface tapee263a3a-46 type=internal -- set Interface tapee263a3a-46 external-ids:iface-id=ee263a3a-4660-4a5c-90cd-7a1cce9cbb6c -- set Interface tapee263a3a-46 external-ids:iface-status=active -- set Interface tapee263a3a-46 external-ids:attached-mac=fa:16:3e:bd:2e:11 {{(pid=96151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:390}} May 28 12:56:07 l75lg1-v1 manila-share[96506]: DEBUG oslo_concurrency.lockutils [None req-6c173bbc-673a-4c3c-a470-52ad1ebf882a None None] Lock "service_instance_get_service_port" acquired by "manila.share.drivers.service_instance.NeutronNetworkHelper._get_service_port" :: waited 0.101s {{(pid=96506) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:56:07 l75lg1-v1 manila-share[96506]: DEBUG oslo_concurrency.lockutils [None req-6c173bbc-673a-4c3c-a470-52ad1ebf882a None None] Acquiring lock "instantiate_neutron_api_neutron_net_helper" by "manila.share.drivers.service_instance.NeutronNetworkHelper.neutron_api" {{(pid=96506) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:56:07 l75lg1-v1 manila-share[96506]: DEBUG oslo_concurrency.lockutils [None req-6c173bbc-673a-4c3c-a470-52ad1ebf882a None None] Lock "instantiate_neutron_api_neutron_net_helper" acquired by "manila.share.drivers.service_instance.NeutronNetworkHelper.neutron_api" :: waited 0.000s {{(pid=96506) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:56:07 l75lg1-v1 manila-share[96506]: DEBUG oslo_concurrency.lockutils [None req-6c173bbc-673a-4c3c-a470-52ad1ebf882a None None] Lock "instantiate_neutron_api_neutron_net_helper" "released" by "manila.share.drivers.service_instance.NeutronNetworkHelper.neutron_api" :: held 0.000s {{(pid=96506) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:56:07 l75lg1-v1 sudo[98048]: vastdata : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/manila-rootwrap /etc/manila/rootwrap.conf ovs-vsctl -- --may-exist add-port br-int tapee263a3a-46 -- set Interface tapee263a3a-46 type=internal -- set Interface tapee263a3a-46 external-ids:iface-id=ee263a3a-4660-4a5c-90cd-7a1cce9cbb6c -- set Interface tapee263a3a-46 external-ids:iface-status=active -- set Interface tapee263a3a-46 external-ids:attached-mac=fa:16:3e:bd:2e:11 May 28 12:56:07 l75lg1-v1 sudo[98048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) May 28 12:56:07 l75lg1-v1 neutron-server[77618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-12bd9d35-5ca7-4e9b-b5db-39f477b277ee service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=77618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:258}} May 28 12:56:07 l75lg1-v1 neutron-server[77618]: INFO neutron.wsgi [None req-12bd9d35-5ca7-4e9b-b5db-39f477b277ee service neutron] 10.27.203.238 "GET /networking/v2.0/ports?device_id=manila-admin-share&binding%3Ahost_id=l75lg1-v1 HTTP/1.1" status: 200 len: 1103 time: 0.0428147 May 28 12:56:07 l75lg1-v1 manila-share[96506]: DEBUG oslo_concurrency.lockutils [None req-6c173bbc-673a-4c3c-a470-52ad1ebf882a None None] Lock "service_instance_get_service_port" "released" by "manila.share.drivers.service_instance.NeutronNetworkHelper._get_service_port" :: held 0.053s {{(pid=96506) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:56:07 l75lg1-v1 manila-share[96506]: DEBUG oslo_concurrency.lockutils [None req-6c173bbc-673a-4c3c-a470-52ad1ebf882a None None] Acquiring lock "service_instance_plug_interface_in_host" by "manila.share.drivers.service_instance.NeutronNetworkHelper._plug_interface_in_host" {{(pid=96506) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:56:07 l75lg1-v1 dstat.sh[49771]: 28-05 12:56:07| 24 10 64 1 0|5149M 2378M 277M 7823M| 29k 63k| 16k 7688k|4.00 356 |9268 14k|1.18 0.80 0.93|2.0 0 746| 0 0 | 0 2048M| 27 327 0 18 0 May 28 12:56:07 l75lg1-v1 ovs-vsctl[98066]: ovs|00001|vsctl|INFO|Called as /bin/ovs-vsctl -- --may-exist add-port br-int tapee263a3a-46 -- set Interface tapee263a3a-46 type=internal -- set Interface tapee263a3a-46 external-ids:iface-id=ee263a3a-4660-4a5c-90cd-7a1cce9cbb6c -- set Interface tapee263a3a-46 external-ids:iface-status=active -- set Interface tapee263a3a-46 external-ids:attached-mac=fa:16:3e:bd:2e:11 May 28 12:56:07 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-03b5f984-1478-4ad6-9838-8e34c1689c5b None None] Hash Ring: Node c89b3497-133e-4a5a-b67a-3310d2cb2485 (host: l75lg1-v1) handling event "update" for row 5ed3c2b8-2c64-42b6-9990-9af55bb24c0b (table: Port_Binding) {{(pid=77619) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:56:07 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched UPDATE: PortBindingUpdatedEvent(events=('update',), table='Port_Binding', conditions=None, old_conditions=None), priority=20 to row=Port_Binding(parent_port=[], mac=['fa:16:3e:bd:2e:11 10.2.5.104', 'unknown'], chassis=[], ha_chassis_group=[], options={'mcast_flood_reports': 'true', 'requested-chassis': 'l75lg1-v1'}, type=, tag=[], requested_chassis=[], tunnel_key=2, up=[False], logical_port=ee263a3a-4660-4a5c-90cd-7a1cce9cbb6c, gateway_chassis=[], encap=[], external_ids={'neutron:cidrs': '10.2.5.104/24', 'neutron:device_id': 'manila-admin-share', 'neutron:device_owner': 'manila:share', 'neutron:mtu': '', 'neutron:network_name': 'neutron-9aaf4bd9-9f34-40ad-a4e7-932bff23895a', 'neutron:port_capabilities': '', 'neutron:port_name': '', 'neutron:project_id': '98a6a2dcbf0248d5b353760f7757f713', 'neutron:revision_number': '1', 'neutron:security_group_ids': '', 'neutron:subnet_pool_addr_scope4': '', 'neutron:subnet_pool_addr_scope6': '', 'neutron:vnic_type': 'normal'}, virtual_parent=[], nat_addresses=[], datapath=9f58042b-d3de-4a35-b332-2827607743db) old=Port_Binding(chassis=[]) {{(pid=76818) matches /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} May 28 12:56:07 l75lg1-v1 neutron-ovn-metadata-agent[76818]: INFO neutron.agent.ovn.metadata.agent [-] Port ee263a3a-4660-4a5c-90cd-7a1cce9cbb6c in datapath 9aaf4bd9-9f34-40ad-a4e7-932bff23895a bound to our chassis May 28 12:56:07 l75lg1-v1 neutron-ovn-metadata-agent[76818]: INFO neutron.agent.ovn.metadata.agent [-] Provisioning metadata for network 9aaf4bd9-9f34-40ad-a4e7-932bff23895a May 28 12:56:07 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-03b5f984-1478-4ad6-9838-8e34c1689c5b None None] Hash Ring: Node c89b3497-133e-4a5a-b67a-3310d2cb2485 (host: l75lg1-v1) handling event "update" for row 5ed3c2b8-2c64-42b6-9990-9af55bb24c0b (table: Port_Binding) {{(pid=77619) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:56:07 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-53cecb61-7023-41e4-a5ea-23b1eb02606a None None] Hash Ring: Node c89b3497-133e-4a5a-b67a-3310d2cb2485 (host: l75lg1-v1) handling event "update" for row f10c31c0-cca8-4d9c-9172-c5c200d33f0a (table: Logical_Switch_Port) {{(pid=77619) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:56:07 l75lg1-v1 neutron-server[77619]: DEBUG ovsdbapp.backend.ovs_idl.event [None req-53cecb61-7023-41e4-a5ea-23b1eb02606a None None] Matched UPDATE: LogicalSwitchPortUpdateUpEvent(events=('update',), table='Logical_Switch_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Switch_Port(up=[True], name=ee263a3a-4660-4a5c-90cd-7a1cce9cbb6c, external_ids={'neutron:cidrs': '10.2.5.104/24', 'neutron:device_id': 'manila-admin-share', 'neutron:device_owner': 'manila:share', 'neutron:mtu': '', 'neutron:network_name': 'neutron-9aaf4bd9-9f34-40ad-a4e7-932bff23895a', 'neutron:port_capabilities': '', 'neutron:port_name': '', 'neutron:project_id': '98a6a2dcbf0248d5b353760f7757f713', 'neutron:revision_number': '1', 'neutron:security_group_ids': '', 'neutron:subnet_pool_addr_scope4': '', 'neutron:subnet_pool_addr_scope6': '', 'neutron:vnic_type': 'normal'}, ha_chassis_group=[], options={'mcast_flood_reports': 'true', 'requested-chassis': 'l75lg1-v1'}, parent_name=[], enabled=[True], type=, dhcpv6_options=[], tag_request=[], port_security=[], addresses=['fa:16:3e:bd:2e:11 10.2.5.104', 'unknown'], dynamic_addresses=[], dhcpv4_options=[], tag=[]) old=Logical_Switch_Port(up=[False]) {{(pid=77619) matches /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} May 28 12:56:07 l75lg1-v1 neutron-server[77619]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver [None req-0dcde142-d2d2-4b7c-90f1-6c1ed20bcda3 None None] OVN reports status up for port: ee263a3a-4660-4a5c-90cd-7a1cce9cbb6c May 28 12:56:07 l75lg1-v1 neutron-server[77619]: DEBUG neutron.db.provisioning_blocks [None req-0dcde142-d2d2-4b7c-90f1-6c1ed20bcda3 None None] Provisioning for port ee263a3a-4660-4a5c-90cd-7a1cce9cbb6c completed by entity L2. {{(pid=77619) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:136}} May 28 12:56:07 l75lg1-v1 sudo[98048]: pam_unix(sudo:session): session closed for user root May 28 12:56:07 l75lg1-v1 manila-share[96151]: DEBUG oslo_concurrency.processutils [None req-2cf6ab01-c9ac-4126-b67e-f98b4a543484 None None] CMD "sudo manila-rootwrap /etc/manila/rootwrap.conf ovs-vsctl -- --may-exist add-port br-int tapee263a3a-46 -- set Interface tapee263a3a-46 type=internal -- set Interface tapee263a3a-46 external-ids:iface-id=ee263a3a-4660-4a5c-90cd-7a1cce9cbb6c -- set Interface tapee263a3a-46 external-ids:iface-status=active -- set Interface tapee263a3a-46 external-ids:attached-mac=fa:16:3e:bd:2e:11" returned: 0 in 0.431s {{(pid=96151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:428}} May 28 12:56:07 l75lg1-v1 manila-share[96151]: DEBUG oslo_concurrency.processutils [None req-2cf6ab01-c9ac-4126-b67e-f98b4a543484 None None] Running cmd (subprocess): sudo manila-rootwrap /etc/manila/rootwrap.conf ip link set tapee263a3a-46 address fa:16:3e:bd:2e:11 {{(pid=96151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:390}} May 28 12:56:07 l75lg1-v1 neutron-server[77619]: DEBUG neutron.db.provisioning_blocks [None req-0dcde142-d2d2-4b7c-90f1-6c1ed20bcda3 None None] Provisioning complete for port ee263a3a-4660-4a5c-90cd-7a1cce9cbb6c triggered by entity L2. {{(pid=77619) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:144}} May 28 12:56:07 l75lg1-v1 neutron-server[77619]: DEBUG neutron_lib.callbacks.manager [None req-0dcde142-d2d2-4b7c-90f1-6c1ed20bcda3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-857483'] for port (ee263a3a-4660-4a5c-90cd-7a1cce9cbb6c), provisioning_complete {{(pid=77619) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:56:07 l75lg1-v1 neutron-server[77619]: INFO neutron.plugins.ml2.plugin [None req-0dcde142-d2d2-4b7c-90f1-6c1ed20bcda3 None None] Attempt 1 to provision port ee263a3a-4660-4a5c-90cd-7a1cce9cbb6c May 28 12:56:07 l75lg1-v1 sudo[98076]: vastdata : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/manila-rootwrap /etc/manila/rootwrap.conf ip link set tapee263a3a-46 address fa:16:3e:bd:2e:11 May 28 12:56:07 l75lg1-v1 sudo[98076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) May 28 12:56:07 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.plugin [None req-0dcde142-d2d2-4b7c-90f1-6c1ed20bcda3 None None] Current status of the port ee263a3a-4660-4a5c-90cd-7a1cce9cbb6c is: DOWN; New status is: ACTIVE {{(pid=77619) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2395}} May 28 12:56:07 l75lg1-v1 neutron-server[77619]: DEBUG neutron_lib.callbacks.manager [None req-0dcde142-d2d2-4b7c-90f1-6c1ed20bcda3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1015114', 'neutron.services.ovn_l3.plugin.OVNL3RouterPlugin._port_update-8754901907784', 'neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_internal_ip_change_for_fip-8754903031884'] for port (ee263a3a-4660-4a5c-90cd-7a1cce9cbb6c), before_update {{(pid=77619) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:56:07 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.db [None req-0dcde142-d2d2-4b7c-90f1-6c1ed20bcda3 None None] For port ee263a3a-4660-4a5c-90cd-7a1cce9cbb6c, host l75lg1-v1, got binding levels [PortBindingLevel(driver='ovn',host='l75lg1-v1',level=0,port_id=ee263a3a-4660-4a5c-90cd-7a1cce9cbb6c,segment=NetworkSegment(ce8322a7-55e6-4ca6-9e93-5a845a3474f8),segment_id=ce8322a7-55e6-4ca6-9e93-5a845a3474f8)] {{(pid=77619) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} May 28 12:56:07 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver [None req-0dcde142-d2d2-4b7c-90f1-6c1ed20bcda3 None None] No provisioning block for port ee263a3a-4660-4a5c-90cd-7a1cce9cbb6c since it is active {{(pid=77619) _is_port_provisioning_required /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/mech_driver.py:715}} May 28 12:56:07 l75lg1-v1 neutron-server[77619]: INFO neutron.tests.unit.plugins.ml2.drivers.mechanism_logger [None req-0dcde142-d2d2-4b7c-90f1-6c1ed20bcda3 None None] update_port_precommit called with port settings {'id': 'ee263a3a-4660-4a5c-90cd-7a1cce9cbb6c', 'name': '', 'network_id': '9aaf4bd9-9f34-40ad-a4e7-932bff23895a', 'tenant_id': '98a6a2dcbf0248d5b353760f7757f713', 'mac_address': 'fa:16:3e:bd:2e:11', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'manila-admin-share', 'device_owner': 'manila:share', 'standard_attr_id': 64, 'fixed_ips': [{'subnet_id': 'd5781979-4de3-490b-a4f1-017afe11a304', 'ip_address': '10.2.5.104'}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'l75lg1-v1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'port_filter': True, 'connectivity': 'l2', 'bridge_name': 'br-int', 'datapath_type': 'system', 'bound_drivers': {'0': 'ovn'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2024-05-28T12:56:06Z', 'updated_at': '2024-05-28T12:56:07Z', 'revision_number': 4, 'project_id': '98a6a2dcbf0248d5b353760f7757f713'} (original settings {'id': 'ee263a3a-4660-4a5c-90cd-7a1cce9cbb6c', 'name': '', 'network_id': '9aaf4bd9-9f34-40ad-a4e7-932bff23895a', 'tenant_id': '98a6a2dcbf0248d5b353760f7757f713', 'mac_address': 'fa:16:3e:bd:2e:11', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'manila-admin-share', 'device_owner': 'manila:share', 'standard_attr_id': 64, 'fixed_ips': [{'subnet_id': 'd5781979-4de3-490b-a4f1-017afe11a304', 'ip_address': '10.2.5.104'}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'l75lg1-v1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'port_filter': True, 'connectivity': 'l2', 'bridge_name': 'br-int', 'datapath_type': 'system', 'bound_drivers': {'0': 'ovn'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2024-05-28T12:56:06Z', 'updated_at': '2024-05-28T12:56:06Z', 'revision_number': 3, 'project_id': '98a6a2dcbf0248d5b353760f7757f713'}) host l75lg1-v1 (original host l75lg1-v1) vif type ovs (original vif type ovs) vif details {'port_filter': True, 'connectivity': 'l2', 'bridge_name': 'br-int', 'datapath_type': 'system'} (original vif details {'port_filter': True, 'connectivity': 'l2', 'bridge_name': 'br-int', 'datapath_type': 'system'}) binding levels [{'bound_driver': 'ovn', 'bound_segment': {'id': 'ce8322a7-55e6-4ca6-9e93-5a845a3474f8', 'network_type': 'geneve', 'physical_network': None, 'segmentation_id': 32656, 'network_id': '9aaf4bd9-9f34-40ad-a4e7-932bff23895a'}}] (original binding levels [{'bound_driver': 'ovn', 'bound_segment': {'id': 'ce8322a7-55e6-4ca6-9e93-5a845a3474f8', 'network_type': 'geneve', 'physical_network': None, 'segmentation_id': 32656, 'network_id': '9aaf4bd9-9f34-40ad-a4e7-932bff23895a'}}]) on network {'id': '9aaf4bd9-9f34-40ad-a4e7-932bff23895a', 'name': 'admin_net', 'tenant_id': '98a6a2dcbf0248d5b353760f7757f713', 'admin_state_up': True, 'mtu': 1442, 'status': 'ACTIVE', 'subnets': ['d5781979-4de3-490b-a4f1-017afe11a304'], 'standard_attr_id': 56, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'vlan_transparent': None, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2024-05-28T12:55:50Z', 'updated_at': '2024-05-28T12:55:56Z', 'revision_number': 2, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 32656} with segments to bind None May 28 12:56:07 l75lg1-v1 neutron-server[77619]: DEBUG neutron.tests.unit.plugins.ml2.drivers.mechanism_logger [None req-0dcde142-d2d2-4b7c-90f1-6c1ed20bcda3 None None] update_port_precommit: May 28 12:56:07 l75lg1-v1 neutron-server[77619]: key[status], DOWN -> ACTIVE May 28 12:56:07 l75lg1-v1 neutron-server[77619]: key[updated_at], 2024-05-28T12:56:06Z -> 2024-05-28T12:56:07Z May 28 12:56:07 l75lg1-v1 neutron-server[77619]: key[revision_number], 3 -> 4 May 28 12:56:07 l75lg1-v1 neutron-server[77619]: {{(pid=77619) _log_diff_call /opt/stack/neutron/neutron/tests/unit/plugins/ml2/drivers/mechanism_logger.py:59}} May 28 12:56:07 l75lg1-v1 neutron-server[77619]: DEBUG ovsdbapp.backend.ovs_idl.transaction [None req-53cecb61-7023-41e4-a5ea-23b1eb02606a None None] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=ee263a3a-4660-4a5c-90cd-7a1cce9cbb6c, resource={'id': 'ee263a3a-4660-4a5c-90cd-7a1cce9cbb6c', 'name': '', 'network_id': '9aaf4bd9-9f34-40ad-a4e7-932bff23895a', 'tenant_id': '98a6a2dcbf0248d5b353760f7757f713', 'mac_address': 'fa:16:3e:bd:2e:11', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'manila-admin-share', 'device_owner': 'manila:share', 'standard_attr_id': 64, 'fixed_ips': [{'subnet_id': 'd5781979-4de3-490b-a4f1-017afe11a304', 'ip_address': '10.2.5.104'}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'l75lg1-v1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'port_filter': True, 'connectivity': 'l2', 'bridge_name': 'br-int', 'datapath_type': 'system', 'bound_drivers': {'0': 'ovn'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2024-05-28T12:56:06Z', 'updated_at': '2024-05-28T12:56:07Z', 'revision_number': 4, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'network': {'id': '9aaf4bd9-9f34-40ad-a4e7-932bff23895a', 'name': 'admin_net', 'tenant_id': '98a6a2dcbf0248d5b353760f7757f713', 'admin_state_up': True, 'mtu': 1442, 'status': 'ACTIVE', 'subnets': ['d5781979-4de3-490b-a4f1-017afe11a304'], 'standard_attr_id': 56, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'vlan_transparent': None, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2024-05-28T12:55:50Z', 'updated_at': '2024-05-28T12:55:56Z', 'revision_number': 2, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 32656}}, resource_type=ports, if_exists=True) {{(pid=77619) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:56:07 l75lg1-v1 neutron-server[77619]: DEBUG ovsdbapp.backend.ovs_idl.transaction [None req-53cecb61-7023-41e4-a5ea-23b1eb02606a None None] Running txn n=1 command(idx=1): SetLSwitchPortCommand(_result=None, lport=ee263a3a-4660-4a5c-90cd-7a1cce9cbb6c, external_ids_update=None, columns={'external_ids': {'neutron:port_name': '', 'neutron:device_id': 'manila-admin-share', 'neutron:project_id': '98a6a2dcbf0248d5b353760f7757f713', 'neutron:cidrs': '10.2.5.104/24', 'neutron:device_owner': 'manila:share', 'neutron:subnet_pool_addr_scope4': '', 'neutron:subnet_pool_addr_scope6': '', 'neutron:network_name': 'neutron-9aaf4bd9-9f34-40ad-a4e7-932bff23895a', 'neutron:security_group_ids': '', 'neutron:revision_number': '4', 'neutron:vnic_type': 'normal', 'neutron:port_capabilities': '', 'neutron:mtu': ''}, 'parent_name': [], 'tag': [], 'options': {'requested-chassis': 'l75lg1-v1', 'mcast_flood_reports': 'true'}, 'enabled': True, 'port_security': [], 'dhcpv4_options': [UUID('94959b07-bcd6-4d66-b78b-787c59b1d5b6')], 'dhcpv6_options': [], 'type': '', 'addresses': ['fa:16:3e:bd:2e:11 10.2.5.104', 'unknown'], 'ha_chassis_group': []}, if_exists=False) {{(pid=77619) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:56:07 l75lg1-v1 neutron-server[77619]: DEBUG ovsdbapp.backend.ovs_idl.transaction [None req-53cecb61-7023-41e4-a5ea-23b1eb02606a None None] Running txn n=1 command(idx=2): PgDelPortCommand(_result=None, port_group=neutron_pg_drop, lsp=['ee263a3a-4660-4a5c-90cd-7a1cce9cbb6c'], if_exists=False) {{(pid=77619) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:56:07 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-53cecb61-7023-41e4-a5ea-23b1eb02606a None None] Hash Ring: Node c89b3497-133e-4a5a-b67a-3310d2cb2485 (host: l75lg1-v1) handling event "update" for row f10c31c0-cca8-4d9c-9172-c5c200d33f0a (table: Logical_Switch_Port) {{(pid=77619) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:56:07 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-03b5f984-1478-4ad6-9838-8e34c1689c5b None None] Hash Ring: Node c89b3497-133e-4a5a-b67a-3310d2cb2485 (host: l75lg1-v1) handling event "update" for row 5ed3c2b8-2c64-42b6-9990-9af55bb24c0b (table: Port_Binding) {{(pid=77619) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:56:07 l75lg1-v1 neutron-server[77619]: INFO neutron.db.ovn_revision_numbers_db [None req-0dcde142-d2d2-4b7c-90f1-6c1ed20bcda3 None None] Successfully bumped revision number for resource ee263a3a-4660-4a5c-90cd-7a1cce9cbb6c (type: ports) to 4 May 28 12:56:07 l75lg1-v1 neutron-server[77619]: INFO neutron.tests.unit.plugins.ml2.drivers.mechanism_logger [None req-0dcde142-d2d2-4b7c-90f1-6c1ed20bcda3 None None] update_port_postcommit called with port settings {'id': 'ee263a3a-4660-4a5c-90cd-7a1cce9cbb6c', 'name': '', 'network_id': '9aaf4bd9-9f34-40ad-a4e7-932bff23895a', 'tenant_id': '98a6a2dcbf0248d5b353760f7757f713', 'mac_address': 'fa:16:3e:bd:2e:11', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'manila-admin-share', 'device_owner': 'manila:share', 'standard_attr_id': 64, 'fixed_ips': [{'subnet_id': 'd5781979-4de3-490b-a4f1-017afe11a304', 'ip_address': '10.2.5.104'}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'l75lg1-v1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'port_filter': True, 'connectivity': 'l2', 'bridge_name': 'br-int', 'datapath_type': 'system', 'bound_drivers': {'0': 'ovn'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2024-05-28T12:56:06Z', 'updated_at': '2024-05-28T12:56:07Z', 'revision_number': 4, 'project_id': '98a6a2dcbf0248d5b353760f7757f713'} (original settings {'id': 'ee263a3a-4660-4a5c-90cd-7a1cce9cbb6c', 'name': '', 'network_id': '9aaf4bd9-9f34-40ad-a4e7-932bff23895a', 'tenant_id': '98a6a2dcbf0248d5b353760f7757f713', 'mac_address': 'fa:16:3e:bd:2e:11', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'manila-admin-share', 'device_owner': 'manila:share', 'standard_attr_id': 64, 'fixed_ips': [{'subnet_id': 'd5781979-4de3-490b-a4f1-017afe11a304', 'ip_address': '10.2.5.104'}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'l75lg1-v1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'port_filter': True, 'connectivity': 'l2', 'bridge_name': 'br-int', 'datapath_type': 'system', 'bound_drivers': {'0': 'ovn'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2024-05-28T12:56:06Z', 'updated_at': '2024-05-28T12:56:06Z', 'revision_number': 3, 'project_id': '98a6a2dcbf0248d5b353760f7757f713'}) host l75lg1-v1 (original host l75lg1-v1) vif type ovs (original vif type ovs) vif details {'port_filter': True, 'connectivity': 'l2', 'bridge_name': 'br-int', 'datapath_type': 'system'} (original vif details {'port_filter': True, 'connectivity': 'l2', 'bridge_name': 'br-int', 'datapath_type': 'system'}) binding levels [{'bound_driver': 'ovn', 'bound_segment': {'id': 'ce8322a7-55e6-4ca6-9e93-5a845a3474f8', 'network_type': 'geneve', 'physical_network': None, 'segmentation_id': 32656, 'network_id': '9aaf4bd9-9f34-40ad-a4e7-932bff23895a'}}] (original binding levels [{'bound_driver': 'ovn', 'bound_segment': {'id': 'ce8322a7-55e6-4ca6-9e93-5a845a3474f8', 'network_type': 'geneve', 'physical_network': None, 'segmentation_id': 32656, 'network_id': '9aaf4bd9-9f34-40ad-a4e7-932bff23895a'}}]) on network {'id': '9aaf4bd9-9f34-40ad-a4e7-932bff23895a', 'name': 'admin_net', 'tenant_id': '98a6a2dcbf0248d5b353760f7757f713', 'admin_state_up': True, 'mtu': 1442, 'status': 'ACTIVE', 'subnets': ['d5781979-4de3-490b-a4f1-017afe11a304'], 'standard_attr_id': 56, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'vlan_transparent': None, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2024-05-28T12:55:50Z', 'updated_at': '2024-05-28T12:55:56Z', 'revision_number': 2, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 32656} with segments to bind None May 28 12:56:07 l75lg1-v1 neutron-server[77619]: DEBUG neutron.tests.unit.plugins.ml2.drivers.mechanism_logger [None req-0dcde142-d2d2-4b7c-90f1-6c1ed20bcda3 None None] update_port_postcommit: May 28 12:56:07 l75lg1-v1 neutron-server[77619]: key[status], DOWN -> ACTIVE May 28 12:56:07 l75lg1-v1 neutron-server[77619]: key[updated_at], 2024-05-28T12:56:06Z -> 2024-05-28T12:56:07Z May 28 12:56:07 l75lg1-v1 neutron-server[77619]: key[revision_number], 3 -> 4 May 28 12:56:07 l75lg1-v1 neutron-server[77619]: {{(pid=77619) _log_diff_call /opt/stack/neutron/neutron/tests/unit/plugins/ml2/drivers/mechanism_logger.py:59}} May 28 12:56:07 l75lg1-v1 neutron-server[77619]: DEBUG neutron_lib.callbacks.manager [None req-0dcde142-d2d2-4b7c-90f1-6c1ed20bcda3 None None] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4166243', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8754903016533', 'neutron.services.ovn_l3.plugin.OVNL3RouterPlugin._port_update-8754901907784'] for port (ee263a3a-4660-4a5c-90cd-7a1cce9cbb6c), after_update {{(pid=77619) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} May 28 12:56:07 l75lg1-v1 neutron-server[77619]: DEBUG ovsdbapp.backend.ovs_idl.transaction [None req-53cecb61-7023-41e4-a5ea-23b1eb02606a None None] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=Logical_Switch_Port, record=ee263a3a-4660-4a5c-90cd-7a1cce9cbb6c, col_values=(('external_ids', {'neutron:host_id': 'l75lg1-v1'}),), if_exists=True) {{(pid=77619) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:56:07 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-53cecb61-7023-41e4-a5ea-23b1eb02606a None None] Hash Ring: Node c89b3497-133e-4a5a-b67a-3310d2cb2485 (host: l75lg1-v1) handling event "update" for row f10c31c0-cca8-4d9c-9172-c5c200d33f0a (table: Logical_Switch_Port) {{(pid=77619) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:56:07 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-03b5f984-1478-4ad6-9838-8e34c1689c5b None None] Hash Ring: Node c89b3497-133e-4a5a-b67a-3310d2cb2485 (host: l75lg1-v1) handling event "update" for row 5ed3c2b8-2c64-42b6-9990-9af55bb24c0b (table: Port_Binding) {{(pid=77619) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:56:07 l75lg1-v1 neutron-server[77619]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-737c3ed0-3fb2-4b2c-b8bf-0d85c85a3ee0 None None] Pushing event updated for resources: {'Port': ['ID=ee263a3a-4660-4a5c-90cd-7a1cce9cbb6c,revision_number=4']} {{(pid=77619) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 28 12:56:07 l75lg1-v1 sudo[98076]: pam_unix(sudo:session): session closed for user root May 28 12:56:07 l75lg1-v1 manila-share[96151]: DEBUG oslo_concurrency.processutils [None req-2cf6ab01-c9ac-4126-b67e-f98b4a543484 None None] CMD "sudo manila-rootwrap /etc/manila/rootwrap.conf ip link set tapee263a3a-46 address fa:16:3e:bd:2e:11" returned: 0 in 0.446s {{(pid=96151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:428}} May 28 12:56:07 l75lg1-v1 manila-share[96151]: DEBUG oslo_concurrency.processutils [None req-2cf6ab01-c9ac-4126-b67e-f98b4a543484 None None] Running cmd (subprocess): sudo manila-rootwrap /etc/manila/rootwrap.conf ip link set tapee263a3a-46 up {{(pid=96151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:390}} May 28 12:56:07 l75lg1-v1 sudo[98127]: vastdata : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/manila-rootwrap /etc/manila/rootwrap.conf ip link set tapee263a3a-46 up May 28 12:56:07 l75lg1-v1 sudo[98127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) May 28 12:56:08 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo.privsep.daemon [-] privsep: reply[33bd2423-0bea-4e92-a345-64b7f44b4ce1]: (4, False) {{(pid=79043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} May 28 12:56:08 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.ovn.metadata.agent [-] Creating VETH tap9aaf4bd9-91 in ovnmeta-9aaf4bd9-9f34-40ad-a4e7-932bff23895a namespace {{(pid=76818) provision_datapath /opt/stack/neutron/neutron/agent/ovn/metadata/agent.py:757}} May 28 12:56:08 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.privileged.agent.linux.ip_lib [-] Interface tap9aaf4bd9-90 not found in namespace None {{(pid=79043) get_link_id /opt/stack/neutron/neutron/privileged/agent/linux/ip_lib.py:204}} May 28 12:56:08 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo.privsep.daemon [-] privsep: reply[91062093-4cf7-4da7-9013-de458292b169]: (4, False) {{(pid=79043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} May 28 12:56:08 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e95e080-fa38-4e18-a6f8-245122c44761]: (4, False) {{(pid=79043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} May 28 12:56:08 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo.privsep.daemon [-] privsep: reply[ded4302c-a153-4eb8-9cf3-bd3a38131f59]: (4, None) {{(pid=77584) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} May 28 12:56:08 l75lg1-v1 dstat.sh[49771]: 28-05 12:56:08| 24 5 70 0 0|5186M 2341M 277M 7824M| 17k 8147B| 52k 880k|10.0 68.0 |5010 6969 |1.18 0.80 0.93|3.0 0 121| 0 0 | 0 2048M| 28 327 0 18 0 May 28 12:56:08 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ea0d496-1c80-41a2-a8f8-7a575eca9928]: (4, ('net.ipv4.conf.all.promote_secondaries = 1\n', '', 0)) {{(pid=79043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} May 28 12:56:08 l75lg1-v1 neutron-ovn-metadata-agent[76818]: INFO oslo.privsep.daemon [-] Running privsep helper: ['sudo', '/opt/stack/data/venv/bin/neutron-rootwrap', '/etc/neutron/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/neutron/neutron_ovn_metadata_agent.ini', '--privsep_context', 'neutron.privileged.link_cmd', '--privsep_sock_path', '/tmp/tmp8k667nnz/privsep.sock'] May 28 12:56:08 l75lg1-v1 sudo[98188]: vastdata : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/neutron-rootwrap /etc/neutron/rootwrap.conf privsep-helper --config-file /etc/neutron/neutron_ovn_metadata_agent.ini --privsep_context neutron.privileged.link_cmd --privsep_sock_path /tmp/tmp8k667nnz/privsep.sock May 28 12:56:08 l75lg1-v1 sudo[98188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) May 28 12:56:08 l75lg1-v1 neutron-server[77618]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-d9d4969c-e9ae-4d76-91b0-9b7c8eb907b3 None None] Hash Ring: Node 4c6fc793-7f5a-456f-b4d6-6e5bd97592f2 (host: l75lg1-v1) handling event "create" for row ee3bb9b7-3e10-4604-a562-f3c2f98e52a3 (table: FDB) {{(pid=77618) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:56:08 l75lg1-v1 sudo[98127]: pam_unix(sudo:session): session closed for user root May 28 12:56:08 l75lg1-v1 manila-share[96151]: DEBUG oslo_concurrency.processutils [None req-2cf6ab01-c9ac-4126-b67e-f98b4a543484 None None] CMD "sudo manila-rootwrap /etc/manila/rootwrap.conf ip link set tapee263a3a-46 up" returned: 0 in 0.457s {{(pid=96151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:428}} May 28 12:56:08 l75lg1-v1 manila-share[96151]: DEBUG oslo_concurrency.lockutils [None req-2cf6ab01-c9ac-4126-b67e-f98b4a543484 None None] Lock "linux_interface_device_name_tapee263a3a-46" "released" by "manila.network.linux.interface.device_name_synchronized..wrapped_func..source_func" :: held 1.364s {{(pid=96151) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:56:08 l75lg1-v1 manila-share[96151]: DEBUG oslo_concurrency.lockutils [None req-2cf6ab01-c9ac-4126-b67e-f98b4a543484 None None] Acquiring lock "instantiate_neutron_api_neutron_net_helper" by "manila.share.drivers.service_instance.NeutronNetworkHelper.neutron_api" {{(pid=96151) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:56:08 l75lg1-v1 manila-share[96151]: DEBUG oslo_concurrency.lockutils [None req-2cf6ab01-c9ac-4126-b67e-f98b4a543484 None None] Lock "instantiate_neutron_api_neutron_net_helper" acquired by "manila.share.drivers.service_instance.NeutronNetworkHelper.neutron_api" :: waited 0.000s {{(pid=96151) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:56:08 l75lg1-v1 manila-share[96151]: DEBUG oslo_concurrency.lockutils [None req-2cf6ab01-c9ac-4126-b67e-f98b4a543484 None None] Lock "instantiate_neutron_api_neutron_net_helper" "released" by "manila.share.drivers.service_instance.NeutronNetworkHelper.neutron_api" :: held 0.000s {{(pid=96151) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:56:08 l75lg1-v1 neutron-server[77619]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-93d7dec4-ebcb-4075-8f03-8510896f1c5a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=77619) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:258}} May 28 12:56:08 l75lg1-v1 neutron-server[77619]: INFO neutron.wsgi [None req-93d7dec4-ebcb-4075-8f03-8510896f1c5a service neutron] 10.27.203.238 "GET /networking/v2.0/subnets/d5781979-4de3-490b-a4f1-017afe11a304 HTTP/1.1" status: 200 len: 800 time: 0.0502465 May 28 12:56:08 l75lg1-v1 manila-share[96151]: DEBUG oslo_concurrency.lockutils [None req-2cf6ab01-c9ac-4126-b67e-f98b4a543484 None None] Acquiring lock "linux_interface_device_name_tapee263a3a-46" by "manila.network.linux.interface.device_name_synchronized..wrapped_func..source_func" {{(pid=96151) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:56:08 l75lg1-v1 manila-share[96151]: DEBUG oslo_concurrency.lockutils [None req-2cf6ab01-c9ac-4126-b67e-f98b4a543484 None None] Lock "linux_interface_device_name_tapee263a3a-46" acquired by "manila.network.linux.interface.device_name_synchronized..wrapped_func..source_func" :: waited 0.001s {{(pid=96151) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:56:08 l75lg1-v1 manila-share[96151]: DEBUG oslo_concurrency.processutils [None req-2cf6ab01-c9ac-4126-b67e-f98b4a543484 None None] Running cmd (subprocess): sudo manila-rootwrap /etc/manila/rootwrap.conf ip route list {{(pid=96151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:390}} May 28 12:56:08 l75lg1-v1 sudo[98240]: vastdata : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/manila-rootwrap /etc/manila/rootwrap.conf ip route list May 28 12:56:08 l75lg1-v1 sudo[98240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) May 28 12:56:08 l75lg1-v1 devstack@m-api.service[89577]: Tue May 28 12:56:08 2024 - graceful shutdown triggered... May 28 12:56:08 l75lg1-v1 devstack@m-api.service[89579]: Gracefully killing worker 2 (pid: 89579)... May 28 12:56:08 l75lg1-v1 devstack@m-api.service[89578]: Gracefully killing worker 1 (pid: 89578)... May 28 12:56:08 l75lg1-v1 manila-share[95722]: INFO oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] Caught SIGTERM, stopping children May 28 12:56:08 l75lg1-v1 manila-share[95722]: DEBUG oslo_concurrency.lockutils [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] Acquiring lock "singleton_lock" {{(pid=95722) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} May 28 12:56:08 l75lg1-v1 manila-share[95722]: DEBUG oslo_concurrency.lockutils [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] Acquired lock "singleton_lock" {{(pid=95722) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} May 28 12:56:08 l75lg1-v1 manila-share[95722]: DEBUG oslo_concurrency.lockutils [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] Releasing lock "singleton_lock" {{(pid=95722) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} May 28 12:56:08 l75lg1-v1 manila-share[95722]: DEBUG oslo_service.service [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] Stop services. {{(pid=95722) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:699}} May 28 12:56:08 l75lg1-v1 manila-share[95722]: DEBUG oslo_db.api [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] Loading backend 'sqlalchemy' from 'manila.db.sqlalchemy.api' {{(pid=95722) _load_backend /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/api.py:259}} May 28 12:56:08 l75lg1-v1 sudo[98240]: pam_unix(sudo:session): session closed for user root May 28 12:56:08 l75lg1-v1 manila-share[96151]: DEBUG oslo_concurrency.processutils [None req-2cf6ab01-c9ac-4126-b67e-f98b4a543484 None None] CMD "sudo manila-rootwrap /etc/manila/rootwrap.conf ip route list" returned: 0 in 0.451s {{(pid=96151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:428}} May 28 12:56:08 l75lg1-v1 manila-share[96151]: DEBUG oslo_concurrency.processutils [None req-2cf6ab01-c9ac-4126-b67e-f98b4a543484 None None] Running cmd (subprocess): ip addr show tapee263a3a-46 permanent scope global {{(pid=96151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:390}} May 28 12:56:08 l75lg1-v1 manila-share[96151]: DEBUG oslo_concurrency.processutils [None req-2cf6ab01-c9ac-4126-b67e-f98b4a543484 None None] CMD "ip addr show tapee263a3a-46 permanent scope global" returned: 0 in 0.013s {{(pid=96151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:428}} May 28 12:56:08 l75lg1-v1 manila-share[96151]: DEBUG oslo_concurrency.processutils [None req-2cf6ab01-c9ac-4126-b67e-f98b4a543484 None None] Running cmd (subprocess): sudo manila-rootwrap /etc/manila/rootwrap.conf ip -4 addr add 10.2.5.104/24 brd 10.2.5.255 scope global dev tapee263a3a-46 {{(pid=96151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:390}} May 28 12:56:08 l75lg1-v1 sudo[98305]: vastdata : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/manila-rootwrap /etc/manila/rootwrap.conf ip -4 addr add 10.2.5.104/24 brd 10.2.5.255 scope global dev tapee263a3a-46 May 28 12:56:08 l75lg1-v1 sudo[98305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) May 28 12:56:09 l75lg1-v1 manila-data[96589]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=96589) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} May 28 12:56:09 l75lg1-v1 manila-data[96589]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=96589) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} May 28 12:56:09 l75lg1-v1 manila-data[96589]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=96589) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} May 28 12:56:09 l75lg1-v1 manila-data[96589]: WARNING amqp [-] Received method (60, 30) during closing channel 1. This method will be ignored May 28 12:56:09 l75lg1-v1 manila-share[95722]: DEBUG passlib.utils.compat [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] loaded lazy attr 'SafeConfigParser': {{(pid=95722) __getattr__ /opt/stack/data/venv/lib/python3.10/site-packages/passlib/utils/compat/__init__.py:449}} May 28 12:56:09 l75lg1-v1 manila-share[95722]: DEBUG passlib.utils.compat [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] loaded lazy attr 'NativeStringIO': {{(pid=95722) __getattr__ /opt/stack/data/venv/lib/python3.10/site-packages/passlib/utils/compat/__init__.py:449}} May 28 12:56:09 l75lg1-v1 manila-share[95722]: DEBUG passlib.utils.compat [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] loaded lazy attr 'BytesIO': {{(pid=95722) __getattr__ /opt/stack/data/venv/lib/python3.10/site-packages/passlib/utils/compat/__init__.py:449}} May 28 12:56:09 l75lg1-v1 dstat.sh[49771]: 28-05 12:56:09| 32 5 62 0 0|5264M 2263M 277M 7824M| 20k 11k| 0 380k| 0 37.0 |4412 5218 |1.18 0.80 0.93|7.0 0 121| 0 0 | 0 2048M| 29 328 0 18 0 May 28 12:56:09 l75lg1-v1 manila-share[95722]: INFO dbcounter [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] Registered counter for database manila May 28 12:56:09 l75lg1-v1 manila-share[95722]: DEBUG oslo_db.sqlalchemy.engines [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=95722) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:342}} May 28 12:56:09 l75lg1-v1 sudo[98188]: pam_unix(sudo:session): session closed for user root May 28 12:56:09 l75lg1-v1 sudo[98305]: pam_unix(sudo:session): session closed for user root May 28 12:56:09 l75lg1-v1 manila-share[96151]: DEBUG oslo_concurrency.processutils [None req-2cf6ab01-c9ac-4126-b67e-f98b4a543484 None None] CMD "sudo manila-rootwrap /etc/manila/rootwrap.conf ip -4 addr add 10.2.5.104/24 brd 10.2.5.255 scope global dev tapee263a3a-46" returned: 0 in 0.462s {{(pid=96151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:428}} May 28 12:56:09 l75lg1-v1 manila-share[96151]: DEBUG oslo_concurrency.processutils [None req-2cf6ab01-c9ac-4126-b67e-f98b4a543484 None None] Running cmd (subprocess): ip route list proto kernel dev tapee263a3a-46 {{(pid=96151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:390}} May 28 12:56:09 l75lg1-v1 neutron-ovn-metadata-agent[76818]: INFO oslo.privsep.daemon [-] Spawned new privsep daemon via rootwrap May 28 12:56:09 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo.privsep.daemon [-] Accepted privsep connection to /tmp/tmp8k667nnz/privsep.sock {{(pid=76818) __init__ /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:362}} May 28 12:56:09 l75lg1-v1 neutron-ovn-metadata-agent[76818]: INFO oslo.privsep.daemon [-] privsep daemon starting May 28 12:56:09 l75lg1-v1 neutron-ovn-metadata-agent[76818]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 May 28 12:56:09 l75lg1-v1 neutron-ovn-metadata-agent[76818]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_NET_ADMIN|CAP_SYS_ADMIN/none May 28 12:56:09 l75lg1-v1 neutron-ovn-metadata-agent[76818]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 98307 May 28 12:56:09 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo.privsep.daemon [-] privsep: reply[78322c2b-0781-4644-85d9-467537b6ef93]: (2,) {{(pid=98307) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} May 28 12:56:09 l75lg1-v1 manila-share[96151]: DEBUG oslo_concurrency.processutils [None req-2cf6ab01-c9ac-4126-b67e-f98b4a543484 None None] CMD "ip route list proto kernel dev tapee263a3a-46" returned: 0 in 0.011s {{(pid=96151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:428}} May 28 12:56:09 l75lg1-v1 manila-share[96151]: DEBUG oslo_concurrency.processutils [None req-2cf6ab01-c9ac-4126-b67e-f98b4a543484 None None] Running cmd (subprocess): ip route list proto kernel exact 10.2.5.0/24 {{(pid=96151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:390}} May 28 12:56:09 l75lg1-v1 manila-share[96151]: DEBUG oslo_concurrency.processutils [None req-2cf6ab01-c9ac-4126-b67e-f98b4a543484 None None] CMD "ip route list proto kernel exact 10.2.5.0/24" returned: 0 in 0.012s {{(pid=96151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:428}} May 28 12:56:09 l75lg1-v1 manila-share[96151]: DEBUG oslo_concurrency.processutils [None req-2cf6ab01-c9ac-4126-b67e-f98b4a543484 None None] Running cmd (subprocess): ip addr show tapee263a3a-46 {{(pid=96151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:390}} May 28 12:56:09 l75lg1-v1 manila-share[96151]: DEBUG oslo_concurrency.processutils [None req-2cf6ab01-c9ac-4126-b67e-f98b4a543484 None None] CMD "ip addr show tapee263a3a-46" returned: 0 in 0.011s {{(pid=96151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:428}} May 28 12:56:09 l75lg1-v1 manila-share[96151]: DEBUG oslo_concurrency.processutils [None req-2cf6ab01-c9ac-4126-b67e-f98b4a543484 None None] Running cmd (subprocess): ip -o link list {{(pid=96151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:390}} May 28 12:56:09 l75lg1-v1 manila-share[96151]: DEBUG oslo_concurrency.processutils [None req-2cf6ab01-c9ac-4126-b67e-f98b4a543484 None None] CMD "ip -o link list" returned: 0 in 0.012s {{(pid=96151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:428}} May 28 12:56:09 l75lg1-v1 manila-share[96151]: DEBUG oslo_concurrency.processutils [None req-2cf6ab01-c9ac-4126-b67e-f98b4a543484 None None] Running cmd (subprocess): ip addr show tapb338c4f5-86 {{(pid=96151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:390}} May 28 12:56:09 l75lg1-v1 manila-scheduler[96156]: INFO manila.coordination [None req-3fc83d32-56d5-4cef-98bf-b2d6839afcdb None None] Stopped Coordinator (Agent ID: e904bfb6-cc88-4b2b-9230-24c19150e415, prefix: manila-) May 28 12:56:09 l75lg1-v1 manila-share[96151]: DEBUG oslo_concurrency.processutils [None req-2cf6ab01-c9ac-4126-b67e-f98b4a543484 None None] CMD "ip addr show tapb338c4f5-86" returned: 0 in 0.014s {{(pid=96151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:428}} May 28 12:56:09 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=96156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} May 28 12:56:09 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=96156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} May 28 12:56:09 l75lg1-v1 manila-scheduler[96156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=96156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} May 28 12:56:09 l75lg1-v1 manila-share[96151]: DEBUG oslo_concurrency.lockutils [None req-2cf6ab01-c9ac-4126-b67e-f98b4a543484 None None] Lock "linux_interface_device_name_tapee263a3a-46" "released" by "manila.network.linux.interface.device_name_synchronized..wrapped_func..source_func" :: held 0.997s {{(pid=96151) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:56:09 l75lg1-v1 manila-share[96151]: DEBUG oslo_concurrency.lockutils [None req-2cf6ab01-c9ac-4126-b67e-f98b4a543484 None None] Lock "service_instance_plug_interface_in_host" "released" by "manila.share.drivers.service_instance.NeutronNetworkHelper._plug_interface_in_host" :: held 2.420s {{(pid=96151) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:56:09 l75lg1-v1 manila-share[96151]: DEBUG oslo_concurrency.lockutils [None req-2cf6ab01-c9ac-4126-b67e-f98b4a543484 None None] Lock "instantiate_network_helper" "released" by "manila.share.drivers.service_instance.ServiceInstanceManager.network_helper" :: held 5.789s {{(pid=96151) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:56:09 l75lg1-v1 manila-share[96151]: DEBUG oslo_concurrency.lockutils [None req-2cf6ab01-c9ac-4126-b67e-f98b4a543484 None None] Acquiring lock "service_network_id_neutron_net_helper" by "manila.share.drivers.service_instance.NeutronNetworkHelper.service_network_id" {{(pid=96151) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:56:09 l75lg1-v1 manila-share[96151]: DEBUG oslo_concurrency.lockutils [None req-2cf6ab01-c9ac-4126-b67e-f98b4a543484 None None] Lock "service_network_id_neutron_net_helper" acquired by "manila.share.drivers.service_instance.NeutronNetworkHelper.service_network_id" :: waited 0.000s {{(pid=96151) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:56:09 l75lg1-v1 manila-share[96151]: DEBUG oslo_concurrency.lockutils [None req-2cf6ab01-c9ac-4126-b67e-f98b4a543484 None None] Lock "service_network_id_neutron_net_helper" "released" by "manila.share.drivers.service_instance.NeutronNetworkHelper.service_network_id" :: held 0.000s {{(pid=96151) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:56:09 l75lg1-v1 manila-share[96151]: DEBUG manila.share.drivers.service_instance [None req-2cf6ab01-c9ac-4126-b67e-f98b4a543484 None None] Plugging service instance into service network 638fa003-195c-4f96-8899-6458dfcc8bbc. {{(pid=96151) setup_connectivity_with_service_instances /opt/stack/manila/manila/share/drivers/service_instance.py:980}} May 28 12:56:09 l75lg1-v1 manila-share[96151]: DEBUG oslo_concurrency.lockutils [None req-2cf6ab01-c9ac-4126-b67e-f98b4a543484 None None] Acquiring lock "service_network_id_neutron_net_helper" by "manila.share.drivers.service_instance.NeutronNetworkHelper.service_network_id" {{(pid=96151) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:56:09 l75lg1-v1 manila-share[96151]: DEBUG oslo_concurrency.lockutils [None req-2cf6ab01-c9ac-4126-b67e-f98b4a543484 None None] Lock "service_network_id_neutron_net_helper" acquired by "manila.share.drivers.service_instance.NeutronNetworkHelper.service_network_id" :: waited 0.000s {{(pid=96151) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:56:09 l75lg1-v1 manila-share[96151]: DEBUG oslo_concurrency.lockutils [None req-2cf6ab01-c9ac-4126-b67e-f98b4a543484 None None] Lock "service_network_id_neutron_net_helper" "released" by "manila.share.drivers.service_instance.NeutronNetworkHelper.service_network_id" :: held 0.000s {{(pid=96151) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:56:09 l75lg1-v1 manila-share[96151]: DEBUG oslo_concurrency.lockutils [None req-2cf6ab01-c9ac-4126-b67e-f98b4a543484 None None] Acquiring lock "service_instance_get_service_port" by "manila.share.drivers.service_instance.NeutronNetworkHelper._get_service_port" {{(pid=96151) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:56:09 l75lg1-v1 manila-share[96151]: DEBUG oslo_concurrency.lockutils [None req-2cf6ab01-c9ac-4126-b67e-f98b4a543484 None None] Lock "service_instance_get_service_port" acquired by "manila.share.drivers.service_instance.NeutronNetworkHelper._get_service_port" :: waited 0.000s {{(pid=96151) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:56:09 l75lg1-v1 manila-share[96151]: DEBUG oslo_concurrency.lockutils [None req-2cf6ab01-c9ac-4126-b67e-f98b4a543484 None None] Acquiring lock "instantiate_neutron_api_neutron_net_helper" by "manila.share.drivers.service_instance.NeutronNetworkHelper.neutron_api" {{(pid=96151) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:56:09 l75lg1-v1 manila-share[96151]: DEBUG oslo_concurrency.lockutils [None req-2cf6ab01-c9ac-4126-b67e-f98b4a543484 None None] Lock "instantiate_neutron_api_neutron_net_helper" acquired by "manila.share.drivers.service_instance.NeutronNetworkHelper.neutron_api" :: waited 0.000s {{(pid=96151) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:56:09 l75lg1-v1 manila-share[96151]: DEBUG oslo_concurrency.lockutils [None req-2cf6ab01-c9ac-4126-b67e-f98b4a543484 None None] Lock "instantiate_neutron_api_neutron_net_helper" "released" by "manila.share.drivers.service_instance.NeutronNetworkHelper.neutron_api" :: held 0.000s {{(pid=96151) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:56:09 l75lg1-v1 manila-scheduler[96156]: WARNING amqp [-] Received method (60, 30) during closing channel 1. This method will be ignored May 28 12:56:09 l75lg1-v1 manila-share[96506]: DEBUG oslo_concurrency.lockutils [None req-6c173bbc-673a-4c3c-a470-52ad1ebf882a None None] Lock "service_instance_plug_interface_in_host" acquired by "manila.share.drivers.service_instance.NeutronNetworkHelper._plug_interface_in_host" :: waited 2.358s {{(pid=96506) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:56:09 l75lg1-v1 manila-share[96506]: DEBUG manila.share.drivers.service_instance [None req-6c173bbc-673a-4c3c-a470-52ad1ebf882a None None] Plug interface into host - interface_name: tapee263a3a-46, device: tapee263a3a-46, port: {'id': 'ee263a3a-4660-4a5c-90cd-7a1cce9cbb6c', 'name': '', 'network_id': '9aaf4bd9-9f34-40ad-a4e7-932bff23895a', 'tenant_id': '98a6a2dcbf0248d5b353760f7757f713', 'mac_address': 'fa:16:3e:bd:2e:11', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'manila-admin-share', 'device_owner': 'manila:share', 'fixed_ips': [{'subnet_id': 'd5781979-4de3-490b-a4f1-017afe11a304', 'ip_address': '10.2.5.104'}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'l75lg1-v1', 'binding:vif_type': 'ovs', 'binding:vif_details': {'port_filter': True, 'connectivity': 'l2', 'bridge_name': 'br-int', 'datapath_type': 'system', 'bound_drivers': {'0': 'ovn'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2024-05-28T12:56:06Z', 'updated_at': '2024-05-28T12:56:06Z', 'revision_number': 3, 'project_id': '98a6a2dcbf0248d5b353760f7757f713'} {{(pid=96506) _plug_interface_in_host /opt/stack/manila/manila/share/drivers/service_instance.py:1005}} May 28 12:56:09 l75lg1-v1 manila-share[96506]: DEBUG oslo_concurrency.lockutils [None req-6c173bbc-673a-4c3c-a470-52ad1ebf882a None None] Acquiring lock "linux_interface_device_name_tapee263a3a-46" by "manila.network.linux.interface.device_name_synchronized..wrapped_func..source_func" {{(pid=96506) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:56:09 l75lg1-v1 manila-share[96506]: DEBUG oslo_concurrency.lockutils [None req-6c173bbc-673a-4c3c-a470-52ad1ebf882a None None] Lock "linux_interface_device_name_tapee263a3a-46" acquired by "manila.network.linux.interface.device_name_synchronized..wrapped_func..source_func" :: waited 0.000s {{(pid=96506) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:56:09 l75lg1-v1 manila-share[96506]: DEBUG oslo_concurrency.processutils [None req-6c173bbc-673a-4c3c-a470-52ad1ebf882a None None] Running cmd (subprocess): ip -o link show br-int {{(pid=96506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:390}} May 28 12:56:09 l75lg1-v1 manila-share[96506]: DEBUG oslo_concurrency.processutils [None req-6c173bbc-673a-4c3c-a470-52ad1ebf882a None None] CMD "ip -o link show br-int" returned: 0 in 0.011s {{(pid=96506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:428}} May 28 12:56:09 l75lg1-v1 manila-share[96506]: DEBUG oslo_concurrency.processutils [None req-6c173bbc-673a-4c3c-a470-52ad1ebf882a None None] Running cmd (subprocess): ip -o link show tapee263a3a-46 {{(pid=96506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:390}} May 28 12:56:09 l75lg1-v1 neutron-server[77619]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-dbc5d477-b16d-43d3-8881-c87c9cc4c639 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=77619) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:258}} May 28 12:56:09 l75lg1-v1 neutron-server[77619]: INFO neutron.wsgi [None req-dbc5d477-b16d-43d3-8881-c87c9cc4c639 service neutron] 10.27.203.238 "GET /networking/v2.0/ports?device_id=manila-share&binding%3Ahost_id=l75lg1-v1 HTTP/1.1" status: 200 len: 1021 time: 0.0487270 May 28 12:56:09 l75lg1-v1 manila-share[96151]: DEBUG oslo_concurrency.lockutils [None req-2cf6ab01-c9ac-4126-b67e-f98b4a543484 None None] Lock "service_instance_get_service_port" "released" by "manila.share.drivers.service_instance.NeutronNetworkHelper._get_service_port" :: held 0.056s {{(pid=96151) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:56:09 l75lg1-v1 manila-share[96151]: DEBUG oslo_concurrency.lockutils [None req-2cf6ab01-c9ac-4126-b67e-f98b4a543484 None None] Acquiring lock "service_instance_add_fixed_ips_to_service_port" by "manila.share.drivers.service_instance.NeutronNetworkHelper._add_fixed_ips_to_service_port" {{(pid=96151) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:56:09 l75lg1-v1 manila-share[96151]: DEBUG oslo_concurrency.lockutils [None req-2cf6ab01-c9ac-4126-b67e-f98b4a543484 None None] Lock "service_instance_add_fixed_ips_to_service_port" acquired by "manila.share.drivers.service_instance.NeutronNetworkHelper._add_fixed_ips_to_service_port" :: waited 0.000s {{(pid=96151) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:56:09 l75lg1-v1 manila-share[96151]: DEBUG oslo_concurrency.lockutils [None req-2cf6ab01-c9ac-4126-b67e-f98b4a543484 None None] Acquiring lock "instantiate_neutron_api_neutron_net_helper" by "manila.share.drivers.service_instance.NeutronNetworkHelper.neutron_api" {{(pid=96151) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:56:09 l75lg1-v1 manila-share[96151]: DEBUG oslo_concurrency.lockutils [None req-2cf6ab01-c9ac-4126-b67e-f98b4a543484 None None] Lock "instantiate_neutron_api_neutron_net_helper" acquired by "manila.share.drivers.service_instance.NeutronNetworkHelper.neutron_api" :: waited 0.000s {{(pid=96151) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:56:09 l75lg1-v1 manila-share[96151]: DEBUG oslo_concurrency.lockutils [None req-2cf6ab01-c9ac-4126-b67e-f98b4a543484 None None] Lock "instantiate_neutron_api_neutron_net_helper" "released" by "manila.share.drivers.service_instance.NeutronNetworkHelper.neutron_api" :: held 0.000s {{(pid=96151) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:56:09 l75lg1-v1 manila-share[96151]: DEBUG oslo_concurrency.lockutils [None req-2cf6ab01-c9ac-4126-b67e-f98b4a543484 None None] Acquiring lock "service_network_id_neutron_net_helper" by "manila.share.drivers.service_instance.NeutronNetworkHelper.service_network_id" {{(pid=96151) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:56:09 l75lg1-v1 manila-share[96151]: DEBUG oslo_concurrency.lockutils [None req-2cf6ab01-c9ac-4126-b67e-f98b4a543484 None None] Lock "service_network_id_neutron_net_helper" acquired by "manila.share.drivers.service_instance.NeutronNetworkHelper.service_network_id" :: waited 0.000s {{(pid=96151) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:56:09 l75lg1-v1 manila-share[96151]: DEBUG oslo_concurrency.lockutils [None req-2cf6ab01-c9ac-4126-b67e-f98b4a543484 None None] Lock "service_network_id_neutron_net_helper" "released" by "manila.share.drivers.service_instance.NeutronNetworkHelper.service_network_id" :: held 0.000s {{(pid=96151) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:56:09 l75lg1-v1 manila-share[96506]: DEBUG oslo_concurrency.processutils [None req-6c173bbc-673a-4c3c-a470-52ad1ebf882a None None] CMD "ip -o link show tapee263a3a-46" returned: 0 in 0.036s {{(pid=96506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:428}} May 28 12:56:09 l75lg1-v1 manila-share[96506]: INFO manila.network.linux.interface [None req-6c173bbc-673a-4c3c-a470-52ad1ebf882a None None] Device tapee263a3a-46 already exists. May 28 12:56:09 l75lg1-v1 manila-share[96506]: DEBUG oslo_concurrency.processutils [None req-6c173bbc-673a-4c3c-a470-52ad1ebf882a None None] Running cmd (subprocess): ip -o link show tapee263a3a-46 {{(pid=96506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:390}} May 28 12:56:09 l75lg1-v1 manila-share[96506]: DEBUG oslo_concurrency.processutils [None req-6c173bbc-673a-4c3c-a470-52ad1ebf882a None None] CMD "ip -o link show tapee263a3a-46" returned: 0 in 0.012s {{(pid=96506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:428}} May 28 12:56:09 l75lg1-v1 manila-share[96506]: DEBUG oslo_concurrency.processutils [None req-6c173bbc-673a-4c3c-a470-52ad1ebf882a None None] Running cmd (subprocess): sudo manila-rootwrap /etc/manila/rootwrap.conf ip link set tapee263a3a-46 up {{(pid=96506) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:390}} May 28 12:56:09 l75lg1-v1 manila-share[95722]: DEBUG dbcounter [-] [95722] Writer thread running {{(pid=95722) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} May 28 12:56:09 l75lg1-v1 sudo[98322]: vastdata : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/manila-rootwrap /etc/manila/rootwrap.conf ip link set tapee263a3a-46 up May 28 12:56:09 l75lg1-v1 neutron-server[77619]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-324c9c5b-67b1-43c0-bff9-83a2d4a51caf service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=77619) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:258}} May 28 12:56:09 l75lg1-v1 sudo[98322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) May 28 12:56:09 l75lg1-v1 neutron-server[77619]: INFO neutron.wsgi [None req-324c9c5b-67b1-43c0-bff9-83a2d4a51caf service neutron] 10.27.203.238 "GET /networking/v2.0/networks/638fa003-195c-4f96-8899-6458dfcc8bbc HTTP/1.1" status: 200 len: 838 time: 0.0477471 May 28 12:56:09 l75lg1-v1 manila-share[95722]: CRITICAL manila [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] Unhandled error: manila.exception.ServiceNotFound: Service None could not be found. May 28 12:56:09 l75lg1-v1 manila-share[95722]: ERROR manila Traceback (most recent call last): May 28 12:56:09 l75lg1-v1 manila-share[95722]: ERROR manila File "/opt/stack/data/venv/bin/manila-share", line 10, in May 28 12:56:09 l75lg1-v1 manila-share[95722]: ERROR manila sys.exit(main()) May 28 12:56:09 l75lg1-v1 manila-share[95722]: ERROR manila File "/opt/stack/manila/manila/cmd/share.py", line 64, in main May 28 12:56:09 l75lg1-v1 manila-share[95722]: ERROR manila launcher.wait() May 28 12:56:09 l75lg1-v1 manila-share[95722]: ERROR manila File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py", line 693, in wait May 28 12:56:09 l75lg1-v1 manila-share[95722]: ERROR manila self.stop() May 28 12:56:09 l75lg1-v1 manila-share[95722]: ERROR manila File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py", line 702, in stop May 28 12:56:09 l75lg1-v1 manila-share[95722]: ERROR manila service.stop() May 28 12:56:09 l75lg1-v1 manila-share[95722]: ERROR manila File "/opt/stack/manila/manila/service.py", line 257, in stop May 28 12:56:09 l75lg1-v1 manila-share[95722]: ERROR manila db.service_update(context.get_admin_context(), May 28 12:56:09 l75lg1-v1 manila-share[95722]: ERROR manila File "/opt/stack/manila/manila/db/api.py", line 136, in service_update May 28 12:56:09 l75lg1-v1 manila-share[95722]: ERROR manila return IMPL.service_update(context, service_id, values) May 28 12:56:09 l75lg1-v1 manila-share[95722]: ERROR manila File "/opt/stack/manila/manila/db/sqlalchemy/api.py", line 148, in wrapper May 28 12:56:09 l75lg1-v1 manila-share[95722]: ERROR manila return f(*args, **kwargs) May 28 12:56:09 l75lg1-v1 manila-share[95722]: ERROR manila File "/opt/stack/manila/manila/db/sqlalchemy/api.py", line 247, in wrapper May 28 12:56:09 l75lg1-v1 manila-share[95722]: ERROR manila return f(context, *args, **kwargs) May 28 12:56:09 l75lg1-v1 manila-share[95722]: ERROR manila File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/api.py", line 144, in wrapper May 28 12:56:09 l75lg1-v1 manila-share[95722]: ERROR manila with excutils.save_and_reraise_exception() as ectxt: May 28 12:56:09 l75lg1-v1 manila-share[95722]: ERROR manila File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__ May 28 12:56:09 l75lg1-v1 manila-share[95722]: ERROR manila self.force_reraise() May 28 12:56:09 l75lg1-v1 manila-share[95722]: ERROR manila File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise May 28 12:56:09 l75lg1-v1 manila-share[95722]: ERROR manila raise self.value May 28 12:56:09 l75lg1-v1 manila-share[95722]: ERROR manila File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/api.py", line 142, in wrapper May 28 12:56:09 l75lg1-v1 manila-share[95722]: ERROR manila return f(*args, **kwargs) May 28 12:56:09 l75lg1-v1 manila-share[95722]: ERROR manila File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/enginefacade.py", line 998, in wrapper May 28 12:56:09 l75lg1-v1 manila-share[95722]: ERROR manila return fn(*args, **kwargs) May 28 12:56:09 l75lg1-v1 manila-share[95722]: ERROR manila File "/opt/stack/manila/manila/db/sqlalchemy/api.py", line 685, in service_update May 28 12:56:09 l75lg1-v1 manila-share[95722]: ERROR manila service_ref = _service_get(context, service_id) May 28 12:56:09 l75lg1-v1 manila-share[95722]: ERROR manila File "/opt/stack/manila/manila/db/sqlalchemy/api.py", line 148, in wrapper May 28 12:56:09 l75lg1-v1 manila-share[95722]: ERROR manila return f(*args, **kwargs) May 28 12:56:09 l75lg1-v1 manila-share[95722]: ERROR manila File "/opt/stack/manila/manila/db/sqlalchemy/api.py", line 561, in _service_get May 28 12:56:09 l75lg1-v1 manila-share[95722]: ERROR manila raise exception.ServiceNotFound(service_id=service_id) May 28 12:56:09 l75lg1-v1 manila-share[95722]: ERROR manila manila.exception.ServiceNotFound: Service None could not be found. May 28 12:56:09 l75lg1-v1 manila-share[95722]: ERROR manila May 28 12:56:09 l75lg1-v1 manila-share[96151]: DEBUG oslo_concurrency.lockutils [None req-2cf6ab01-c9ac-4126-b67e-f98b4a543484 None None] Lock "service_instance_add_fixed_ips_to_service_port" "released" by "manila.share.drivers.service_instance.NeutronNetworkHelper._add_fixed_ips_to_service_port" :: held 0.054s {{(pid=96151) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:56:09 l75lg1-v1 manila-share[96151]: DEBUG oslo_concurrency.lockutils [None req-2cf6ab01-c9ac-4126-b67e-f98b4a543484 None None] Acquiring lock "service_instance_plug_interface_in_host" by "manila.share.drivers.service_instance.NeutronNetworkHelper._plug_interface_in_host" {{(pid=96151) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:56:09 l75lg1-v1 nova-conductor[83647]: DEBUG dbcounter [-] [83647] Writing DB stats nova_cell1:SELECT=3,nova_cell1:UPDATE=1 {{(pid=83647) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:56:09 l75lg1-v1 manila-share[96506]: INFO oslo_service.service [-] Parent process has died unexpectedly, exiting May 28 12:56:09 l75lg1-v1 manila-share[96151]: INFO oslo_service.service [-] Parent process has died unexpectedly, exiting May 28 12:56:09 l75lg1-v1 manila-share[96506]: INFO manila.coordination [None req-42f39601-c826-4dd4-9527-c90d5fbad2d2 None None] Stopped Coordinator (Agent ID: 656d2c43-7e1e-4f6e-8158-2c3a1ba730a6, prefix: manila-) May 28 12:56:09 l75lg1-v1 manila-share[96506]: DEBUG oslo_concurrency.lockutils [None req-6c173bbc-673a-4c3c-a470-52ad1ebf882a None None] Lock "linux_interface_device_name_tapee263a3a-46" "released" by "manila.network.linux.interface.device_name_synchronized..wrapped_func..source_func" :: held 0.284s {{(pid=96506) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:56:09 l75lg1-v1 manila-share[96506]: DEBUG oslo_concurrency.lockutils [None req-6c173bbc-673a-4c3c-a470-52ad1ebf882a None None] Lock "service_instance_plug_interface_in_host" "released" by "manila.share.drivers.service_instance.NeutronNetworkHelper._plug_interface_in_host" :: held 0.286s {{(pid=96506) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:56:09 l75lg1-v1 manila-share[96506]: DEBUG oslo_concurrency.lockutils [None req-6c173bbc-673a-4c3c-a470-52ad1ebf882a None None] Lock "instantiate_network_helper" "released" by "manila.share.drivers.service_instance.ServiceInstanceManager.network_helper" :: held 5.137s {{(pid=96506) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:56:09 l75lg1-v1 manila-share[96151]: INFO manila.coordination [None req-5be8873b-9201-40a8-83fb-8f10a0bdd2c7 None None] Stopped Coordinator (Agent ID: 656d2c43-7e1e-4f6e-8158-2c3a1ba730a6, prefix: manila-) May 28 12:56:09 l75lg1-v1 manila-share[96151]: DEBUG oslo_concurrency.lockutils [None req-2cf6ab01-c9ac-4126-b67e-f98b4a543484 None None] Lock "service_instance_plug_interface_in_host" "released" by "manila.share.drivers.service_instance.NeutronNetworkHelper._plug_interface_in_host" :: held N/A {{(pid=96151) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:56:09 l75lg1-v1 manila-share[96506]: INFO manila.coordination [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] Stopped Coordinator (Agent ID: 656d2c43-7e1e-4f6e-8158-2c3a1ba730a6, prefix: manila-) May 28 12:56:09 l75lg1-v1 manila-share[96506]: DEBUG oslo_concurrency.lockutils [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] Acquiring lock "singleton_lock" {{(pid=96506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} May 28 12:56:09 l75lg1-v1 manila-share[96506]: DEBUG oslo_concurrency.lockutils [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] Acquired lock "singleton_lock" {{(pid=96506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} May 28 12:56:09 l75lg1-v1 manila-share[96506]: DEBUG oslo_concurrency.lockutils [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] Releasing lock "singleton_lock" {{(pid=96506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} May 28 12:56:09 l75lg1-v1 manila-share[96151]: INFO manila.coordination [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] Stopped Coordinator (Agent ID: 656d2c43-7e1e-4f6e-8158-2c3a1ba730a6, prefix: manila-) May 28 12:56:09 l75lg1-v1 manila-share[96151]: DEBUG oslo_concurrency.lockutils [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] Acquiring lock "singleton_lock" {{(pid=96151) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} May 28 12:56:09 l75lg1-v1 manila-share[96151]: DEBUG oslo_concurrency.lockutils [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] Acquired lock "singleton_lock" {{(pid=96151) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} May 28 12:56:09 l75lg1-v1 manila-share[96151]: DEBUG oslo_concurrency.lockutils [None req-45320605-1c82-44eb-9197-26b0c901b8ea None None] Releasing lock "singleton_lock" {{(pid=96151) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} May 28 12:56:09 l75lg1-v1 devstack@m-api.service[89577]: worker 1 buried after 1 seconds May 28 12:56:09 l75lg1-v1 devstack@m-api.service[89577]: worker 2 buried after 1 seconds May 28 12:56:09 l75lg1-v1 devstack@m-api.service[89577]: goodbye to uWSGI. May 28 12:56:09 l75lg1-v1 devstack@m-api.service[98325]: [uWSGI] getting INI configuration from /etc/manila/manila-uwsgi.ini May 28 12:56:09 l75lg1-v1 devstack@m-api.service[98325]: *** Starting uWSGI 2.0.20-debian (64bit) on [Tue May 28 12:56:09 2024] *** May 28 12:56:09 l75lg1-v1 devstack@m-api.service[98325]: compiled with version: 11.2.0 on 21 March 2022 11:00:44 May 28 12:56:09 l75lg1-v1 devstack@m-api.service[98325]: os: Linux-5.15.0-56-generic #62-Ubuntu SMP Tue Nov 22 19:54:14 UTC 2022 May 28 12:56:09 l75lg1-v1 devstack@m-api.service[98325]: nodename: l75lg1-v1 May 28 12:56:09 l75lg1-v1 devstack@m-api.service[98325]: machine: x86_64 May 28 12:56:09 l75lg1-v1 devstack@m-api.service[98325]: clock source: unix May 28 12:56:09 l75lg1-v1 devstack@m-api.service[98325]: pcre jit disabled May 28 12:56:09 l75lg1-v1 devstack@m-api.service[98325]: detected number of CPU cores: 10 May 28 12:56:09 l75lg1-v1 devstack@m-api.service[98325]: current working directory: / May 28 12:56:09 l75lg1-v1 devstack@m-api.service[98325]: detected binary path: /usr/bin/uwsgi-core May 28 12:56:09 l75lg1-v1 devstack@m-api.service[98325]: your processes number limit is 63557 May 28 12:56:09 l75lg1-v1 devstack@m-api.service[98325]: your memory page size is 4096 bytes May 28 12:56:09 l75lg1-v1 devstack@m-api.service[98325]: detected max file descriptor number: 2048 May 28 12:56:09 l75lg1-v1 devstack@m-api.service[98325]: lock engine: pthread robust mutexes May 28 12:56:09 l75lg1-v1 devstack@m-api.service[98325]: thunder lock: enabled May 28 12:56:09 l75lg1-v1 devstack@m-api.service[98325]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/manila-wsgi.socket fd 4 May 28 12:56:09 l75lg1-v1 devstack@m-api.service[98325]: Python version: 3.10.12 (main, Nov 20 2023, 15:14:05) [GCC 11.4.0] May 28 12:56:09 l75lg1-v1 devstack@m-api.service[98325]: PEP 405 virtualenv detected: /opt/stack/data/venv May 28 12:56:09 l75lg1-v1 devstack@m-api.service[98325]: Set PythonHome to /opt/stack/data/venv May 28 12:56:09 l75lg1-v1 nova-conductor[83648]: DEBUG dbcounter [-] [83648] Writing DB stats nova_cell1:SELECT=2 {{(pid=83648) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:56:10 l75lg1-v1 devstack@m-api.service[98325]: Python main interpreter initialized at 0x55bf59851b70 May 28 12:56:10 l75lg1-v1 devstack@m-api.service[98325]: python threads support enabled May 28 12:56:10 l75lg1-v1 devstack@m-api.service[98325]: your server socket listen backlog is limited to 100 connections May 28 12:56:10 l75lg1-v1 devstack@m-api.service[98325]: your mercy for graceful operations on workers is 80 seconds May 28 12:56:10 l75lg1-v1 devstack@m-api.service[98325]: mapped 403077 bytes (393 KB) for 2 cores May 28 12:56:10 l75lg1-v1 devstack@m-api.service[98325]: *** Operational MODE: preforking *** May 28 12:56:10 l75lg1-v1 devstack@m-api.service[98325]: *** uWSGI is running in multiple interpreter mode *** May 28 12:56:10 l75lg1-v1 devstack@m-api.service[98325]: spawned uWSGI master process (pid: 98325) May 28 12:56:10 l75lg1-v1 devstack@m-api.service[98325]: spawned uWSGI worker 1 (pid: 98329, cores: 1) May 28 12:56:10 l75lg1-v1 devstack@m-api.service[98325]: spawned uWSGI worker 2 (pid: 98330, cores: 1) May 28 12:56:10 l75lg1-v1 devstack@m-api.service[98325]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 28 12:56:10 l75lg1-v1 sudo[98322]: pam_unix(sudo:session): session closed for user root May 28 12:56:10 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "context-manager" by "neutron_lib.db.api._create_context_manager" {{(pid=98307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:56:10 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_concurrency.lockutils [-] Lock "context-manager" acquired by "neutron_lib.db.api._create_context_manager" :: waited 0.000s {{(pid=98307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:56:10 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_concurrency.lockutils [-] Lock "context-manager" "released" by "neutron_lib.db.api._create_context_manager" :: held 0.000s {{(pid=98307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:56:10 l75lg1-v1 dstat.sh[49771]: 28-05 12:56:10| 52 7 41 0 0|4766M 2760M 277M 7824M| 16k 8946B| 0 1000k| 0 94.0 |4692 5482 |1.18 0.80 0.93|6.0 0 29| 0 0 | 0 2048M| 29 301 0 22 0 May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=98318) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=98318) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=98318) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] ******************************************************************************** {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2600}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] Configuration options gathered from: {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2601}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] command line args: ['--config-file', '/etc/manila/manila.conf'] {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] config files: ['/etc/manila/manila.conf'] {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2603}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] ================================================================================ {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2605}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] admin_only_metadata = ['__affinity_same_host', '__affinity_different_host'] {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] api_rate_limit = True {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] auth_strategy = keystone {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] backdoor_port = None {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] backdoor_socket = None {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] backup_continue_update_interval = 10 {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] backup_driver = manila.data.drivers.nfs.NFSBackupDriver {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] backup_ignore_files = ['lost+found'] {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] backup_mount_export = None {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] backup_mount_options = {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] backup_mount_proto = nfs {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] backup_mount_template = mount -vt %(proto)s %(options)s %(export)s %(path)s {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] backup_mount_tmp_location = /tmp/ {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] backup_protocol_access_mapping = {'ip': ['nfs']} {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] backup_share_mount_template = mount -vt %(proto)s %(options)s %(export)s %(path)s {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] backup_share_unmount_template = umount -v %(path)s {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] backup_unmount_template = umount -v %(path)s {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] check_hash = True {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] cleanup_interval = 1800 {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] config_dir = [] {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] config_file = ['/etc/manila/manila.conf'] {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] config_source = [] {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] control_exchange = openstack {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] data_access_wait_access_rules_timeout = 180 {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] data_manager = manila.data.manager.DataManager {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] data_node_access_admin_user = None {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] data_node_access_cert = None {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] data_node_access_ips = ['10.2.5.0/24'] {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] data_node_mount_options = {} {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] data_topic = manila-data {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] db_backend = sqlalchemy {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] db_driver = manila.db {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] debug = True {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] default_share_group_type = default {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] default_share_type = default {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] enable_new_services = True {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] enabled_share_backends = ['vast'] {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] enabled_share_protocols = ['NFS', 'CIFS'] {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] fatal_exception_format_errors = False {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] graceful_shutdown_timeout = 60 {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] host = l75lg1-v1 {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] instance_format = [instance: %(uuid)s] {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] is_deferred_deletion_enabled = False {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] log_config_append = None {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] log_dir = None {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] log_file = None {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] log_options = True {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] log_rotate_interval = 1 {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] log_rotate_interval_type = days {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] log_rotation_type = none {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] max_logfile_count = 30 {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] max_logfile_size_mb = 200 {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] monkey_patch = False {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] monkey_patch_modules = [] {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] mount_tmp_location = /tmp/ {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] my_ip = 10.27.203.238 {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] osapi_max_limit = 1000 {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] osapi_share_base_URL = None {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] osapi_share_ext_list = [] {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] osapi_share_extension = ['manila.api.contrib.standard_extensions'] {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] osapi_share_listen = :: {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] osapi_share_listen_port = 8786 {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] osapi_share_use_ssl = False {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] osapi_share_workers = 1 {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] periodic_fuzzy_delay = 60 {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] periodic_interval = 60 {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] project_id_regex = [0-9a-f\-]+ {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] publish_errors = False {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] rate_limit_burst = 0 {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] rate_limit_except_level = CRITICAL {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] rate_limit_interval = 0 {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] report_interval = 10 {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] restore_continue_update_interval = 10 {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] rootwrap_config = /etc/manila/rootwrap.conf {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] run_external_periodic_tasks = True {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] scheduler_manager = manila.scheduler.manager.SchedulerManager {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] scheduler_topic = manila-scheduler {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] service_down_time = 60 {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] share_api_class = manila.share.api.API {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] share_backup_name_template = share-backup-%s {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] share_manager = manila.share.manager.ShareManager {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] share_name_template = share-%s {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] share_snapshot_name_template = share-snapshot-%s {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] share_topic = manila-share {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] soft_deleted_share_retention_time = 604800 {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] state_path = /opt/stack/data/manila {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] storage_availability_zone = nova {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] syslog_log_facility = LOG_USER {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] transfer_retention_time = 300 {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] transport_url = **** {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] use_eventlog = False {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] use_journal = False {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] use_json = False {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] use_scheduler_creating_share_from_snapshot = False {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] use_stderr = False {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] use_syslog = False {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] watch_log_file = False {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] oslo_concurrency.disable_process_locking = False {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] oslo_concurrency.lock_path = /opt/stack/manila/manila_locks {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] oslo_messaging_metrics.metrics_process_name = {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] oslo_policy.enforce_new_defaults = False {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] oslo_policy.enforce_scope = False {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] oslo_policy.policy_default_rule = default {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] oslo_policy.policy_file = policy.yaml {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] coordination.backend_url = **** {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] database.backend = sqlalchemy {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] database.connection = **** {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] database.connection_debug = 0 {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] database.connection_parameters = {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] database.connection_recycle_time = 3600 {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] database.connection_trace = False {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] database.db_inc_retry_interval = True {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] database.db_max_retries = 20 {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] database.db_max_retry_interval = 10 {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] database.db_retry_interval = 1 {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] database.max_overflow = 50 {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] database.max_pool_size = 40 {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] database.max_retries = 10 {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] database.mysql_sql_mode = TRADITIONAL {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] database.mysql_wsrep_sync_wait = None {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] database.pool_timeout = None {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] database.retry_interval = 10 {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] database.slave_connection = **** {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] database.sqlite_synchronous = True {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] database.use_db_reconnect = False {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] profiler.connection_string = messaging:// {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] profiler.enabled = False {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] profiler.es_doc_type = notification {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] profiler.es_scroll_size = 10000 {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] profiler.es_scroll_time = 2m {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] profiler.filter_error_trace = False {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] profiler.hmac_keys = **** {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] profiler.sentinel_service_name = mymaster {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] profiler.socket_timeout = 0.1 {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] profiler.trace_requests = False {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] profiler.trace_sqlalchemy = False {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] profiler_jaeger.process_tags = {} {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] profiler_jaeger.service_name_prefix = None {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] profiler_otlp.service_name_prefix = None {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] oslo_reports.file_event_handler = None {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] oslo_reports.file_event_handler_interval = 1 {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] oslo_reports.log_dir = None {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] oslo_messaging_rabbit.hostname = l75lg1-v1 {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] oslo_messaging_rabbit.processname = manila-data {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] oslo_messaging_rabbit.ssl = False {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] oslo_messaging_rabbit.ssl_version = {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] oslo_messaging_rabbit.use_queue_manager = False {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] oslo_messaging_notifications.driver = [] {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] oslo_messaging_notifications.retry = -1 {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] oslo_messaging_notifications.transport_url = **** {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] quota.backup_gigabytes = 1000 {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] quota.backups = 10 {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] quota.driver = manila.quota.DbQuotaDriver {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] quota.gigabytes = 1000 {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] quota.max_age = 0 {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] quota.per_share_gigabytes = -1 {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] quota.replica_gigabytes = 1000 {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] quota.reservation_expire = 86400 {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] quota.share_group_snapshots = 50 {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] quota.share_groups = 50 {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] quota.share_networks = 10 {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] quota.share_replicas = 100 {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] quota.shares = 50 {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] quota.snapshot_gigabytes = 1000 {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] quota.snapshots = 50 {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] quota.until_refresh = 0 {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG manila.service [-] ******************************************************************************** {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2624}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] Full set of CONF: {{(pid=98318) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:363}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2600}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] Configuration options gathered from: {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2601}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] command line args: ['--config-file', '/etc/manila/manila.conf'] {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] config files: ['/etc/manila/manila.conf'] {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2603}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] ================================================================================ {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2605}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] admin_only_metadata = ['__affinity_same_host', '__affinity_different_host'] {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] api_rate_limit = True {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] auth_strategy = keystone {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] backdoor_port = None {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] backdoor_socket = None {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] backup_continue_update_interval = 10 {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] backup_driver = manila.data.drivers.nfs.NFSBackupDriver {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] backup_ignore_files = ['lost+found'] {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] backup_mount_export = None {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] backup_mount_options = {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] backup_mount_proto = nfs {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] backup_mount_template = mount -vt %(proto)s %(options)s %(export)s %(path)s {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] backup_mount_tmp_location = /tmp/ {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] backup_protocol_access_mapping = {'ip': ['nfs']} {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] backup_share_mount_template = mount -vt %(proto)s %(options)s %(export)s %(path)s {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] backup_share_unmount_template = umount -v %(path)s {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] backup_unmount_template = umount -v %(path)s {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] check_hash = True {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] cleanup_interval = 1800 {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] config_dir = [] {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] config_file = ['/etc/manila/manila.conf'] {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] config_source = [] {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] control_exchange = openstack {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] data_access_wait_access_rules_timeout = 180 {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] data_manager = manila.data.manager.DataManager {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] data_node_access_admin_user = None {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] data_node_access_cert = None {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] data_node_access_ips = ['10.2.5.0/24'] {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] data_node_mount_options = {} {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] data_topic = manila-data {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] db_backend = sqlalchemy {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] db_driver = manila.db {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] debug = True {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] default_share_group_type = default {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] default_share_type = default {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] enable_new_services = True {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] enabled_share_backends = ['vast'] {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] enabled_share_protocols = ['NFS', 'CIFS'] {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] fatal_exception_format_errors = False {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] graceful_shutdown_timeout = 60 {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] host = l75lg1-v1 {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] instance_format = [instance: %(uuid)s] {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] is_deferred_deletion_enabled = False {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] log_config_append = None {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] log_dir = None {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] log_file = None {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] log_options = True {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] log_rotate_interval = 1 {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] log_rotate_interval_type = days {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] log_rotation_type = none {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] max_logfile_count = 30 {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] max_logfile_size_mb = 200 {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] monkey_patch = False {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] monkey_patch_modules = [] {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] mount_tmp_location = /tmp/ {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] my_ip = 10.27.203.238 {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] osapi_max_limit = 1000 {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] osapi_share_base_URL = None {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] osapi_share_ext_list = [] {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] osapi_share_extension = ['manila.api.contrib.standard_extensions'] {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] osapi_share_listen = :: {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] osapi_share_listen_port = 8786 {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] osapi_share_use_ssl = False {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] osapi_share_workers = 1 {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] periodic_fuzzy_delay = 60 {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] periodic_interval = 60 {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] project_id_regex = [0-9a-f\-]+ {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] publish_errors = False {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] rate_limit_burst = 0 {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] rate_limit_except_level = CRITICAL {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] rate_limit_interval = 0 {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] report_interval = 10 {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] restore_continue_update_interval = 10 {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] rootwrap_config = /etc/manila/rootwrap.conf {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] run_external_periodic_tasks = True {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] scheduler_manager = manila.scheduler.manager.SchedulerManager {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] scheduler_topic = manila-scheduler {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] service_down_time = 60 {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] share_api_class = manila.share.api.API {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] share_backup_name_template = share-backup-%s {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] share_manager = manila.share.manager.ShareManager {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] share_name_template = share-%s {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] share_snapshot_name_template = share-snapshot-%s {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] share_topic = manila-share {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] soft_deleted_share_retention_time = 604800 {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] state_path = /opt/stack/data/manila {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] storage_availability_zone = nova {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] syslog_log_facility = LOG_USER {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] transfer_retention_time = 300 {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] transport_url = **** {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] use_eventlog = False {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] use_journal = False {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] use_json = False {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] use_scheduler_creating_share_from_snapshot = False {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] use_stderr = False {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] use_syslog = False {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] watch_log_file = False {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] oslo_concurrency.disable_process_locking = False {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] oslo_concurrency.lock_path = /opt/stack/manila/manila_locks {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_process_name = {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] oslo_policy.enforce_new_defaults = False {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] oslo_policy.enforce_scope = False {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] oslo_policy.policy_default_rule = default {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] oslo_policy.policy_file = policy.yaml {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] coordination.backend_url = **** {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] database.backend = sqlalchemy {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] database.connection = **** {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] database.connection_debug = 0 {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] database.connection_parameters = {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] database.connection_recycle_time = 3600 {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] database.connection_trace = False {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] database.db_inc_retry_interval = True {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] database.db_max_retries = 20 {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] database.db_max_retry_interval = 10 {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] database.db_retry_interval = 1 {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] database.max_overflow = 50 {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] database.max_pool_size = 40 {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] database.max_retries = 10 {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] database.mysql_sql_mode = TRADITIONAL {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] database.mysql_wsrep_sync_wait = None {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] database.pool_timeout = None {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] database.retry_interval = 10 {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] database.slave_connection = **** {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] database.sqlite_synchronous = True {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] database.use_db_reconnect = False {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] profiler.connection_string = messaging:// {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] profiler.enabled = False {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] profiler.es_doc_type = notification {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] profiler.es_scroll_size = 10000 {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] profiler.es_scroll_time = 2m {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] profiler.filter_error_trace = False {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] profiler.hmac_keys = **** {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] profiler.sentinel_service_name = mymaster {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] profiler.socket_timeout = 0.1 {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] profiler.trace_requests = False {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] profiler.trace_sqlalchemy = False {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] profiler_jaeger.process_tags = {} {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] profiler_jaeger.service_name_prefix = None {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] profiler_otlp.service_name_prefix = None {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] oslo_reports.file_event_handler = None {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] oslo_reports.file_event_handler_interval = 1 {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] oslo_reports.log_dir = None {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.hostname = l75lg1-v1 {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.processname = manila-data {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl = False {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_version = {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.use_queue_manager = False {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] oslo_messaging_notifications.driver = [] {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] oslo_messaging_notifications.retry = -1 {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] oslo_messaging_notifications.transport_url = **** {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] quota.backup_gigabytes = 1000 {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] quota.backups = 10 {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] quota.driver = manila.quota.DbQuotaDriver {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] quota.gigabytes = 1000 {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] quota.max_age = 0 {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] quota.per_share_gigabytes = -1 {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] quota.replica_gigabytes = 1000 {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] quota.reservation_expire = 86400 {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] quota.share_group_snapshots = 50 {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] quota.share_groups = 50 {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] quota.share_networks = 10 {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] quota.share_replicas = 100 {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] quota.shares = 50 {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] quota.snapshot_gigabytes = 1000 {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] quota.snapshots = 50 {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] quota.until_refresh = 0 {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=98318) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2624}} May 28 12:56:10 l75lg1-v1 manila-data[98318]: INFO manila.service [-] Starting manila-data node (version 18.1.0) May 28 12:56:10 l75lg1-v1 manila-data[98318]: DEBUG oslo_db.api [None req-39c34f51-e98b-453d-aa4f-07fda4596a3f None None] Loading backend 'sqlalchemy' from 'manila.db.sqlalchemy.api' {{(pid=98318) _load_backend /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/api.py:259}} May 28 12:56:10 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo.privsep.daemon [-] privsep: reply[c222a284-abbb-4ee4-bf3c-187ecab80c02]: (4, None) {{(pid=98307) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} May 28 12:56:10 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3e94227-3a68-41e3-a92f-d2ba88acf36b]: (4, None) {{(pid=79043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=98324) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=98324) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=98324) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} May 28 12:56:11 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1998c06-33b7-43c9-9bf8-6e5f54bc5256]: (4, None) {{(pid=98307) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} May 28 12:56:11 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3864285-ae7a-428d-a646-c8944e23eebb]: (4, None) {{(pid=98307) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} May 28 12:56:11 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo.privsep.daemon [-] privsep: reply[2823e435-c536-4f42-be4d-0565da91a17c]: (4, None) {{(pid=98307) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} May 28 12:56:11 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba969f34-3e4b-436b-99cd-5ebc8551031a]: (4, [{'family': 0, '__align': (), 'ifi_type': 1, 'index': 2, 'flags': 69699, 'change': 0, 'attrs': [['IFLA_IFNAME', 'tap9aaf4bd9-91'], ['IFLA_TXQLEN', 1000], ['IFLA_OPERSTATE', 'UP'], ['IFLA_LINKMODE', 0], ['IFLA_MTU', 1500], ['IFLA_MIN_MTU', 68], ['IFLA_MAX_MTU', 65535], ['IFLA_GROUP', 0], ['IFLA_PROMISCUITY', 0], ['IFLA_NUM_TX_QUEUES', 10], ['IFLA_GSO_MAX_SEGS', 65535], ['IFLA_GSO_MAX_SIZE', 65536], ['IFLA_NUM_RX_QUEUES', 10], ['IFLA_CARRIER', 1], ['IFLA_QDISC', 'noqueue'], ['IFLA_CARRIER_CHANGES', 2], ['IFLA_CARRIER_UP_COUNT', 1], ['IFLA_CARRIER_DOWN_COUNT', 1], ['IFLA_PROTO_DOWN', 0], ['IFLA_MAP', {'mem_start': 0, 'mem_end': 0, 'base_addr': 0, 'irq': 0, 'dma': 0, 'port': 0}], ['IFLA_ADDRESS', 'fa:16:3e:0e:5c:95'], ['IFLA_BROADCAST', 'ff:ff:ff:ff:ff:ff'], ['IFLA_STATS64', {'rx_packets': 1, 'tx_packets': 1, 'rx_bytes': 110, 'tx_bytes': 90, 'rx_errors': 0, 'tx_errors': 0, 'rx_dropped': 0, 'tx_dropped': 0, 'multicast': 0, 'collisions': 0, 'rx_length_errors': 0, 'rx_over_errors': 0, 'rx_crc_errors': 0, 'rx_frame_errors': 0, 'rx_fifo_errors': 0, 'rx_missed_errors': 0, 'tx_aborted_errors': 0, 'tx_carrier_errors': 0, 'tx_fifo_errors': 0, 'tx_heartbeat_errors': 0, 'tx_window_errors': 0, 'rx_compressed': 0, 'tx_compressed': 0}], ['IFLA_STATS', {'rx_packets': 1, 'tx_packets': 1, 'rx_bytes': 110, 'tx_bytes': 90, 'rx_errors': 0, 'tx_errors': 0, 'rx_dropped': 0, 'tx_dropped': 0, 'multicast': 0, 'collisions': 0, 'rx_length_errors': 0, 'rx_over_errors': 0, 'rx_crc_errors': 0, 'rx_frame_errors': 0, 'rx_fifo_errors': 0, 'rx_missed_errors': 0, 'tx_aborted_errors': 0, 'tx_carrier_errors': 0, 'tx_fifo_errors': 0, 'tx_heartbeat_errors': 0, 'tx_window_errors': 0, 'rx_compressed': 0, 'tx_compressed': 0}], ['IFLA_XDP', {'attrs': [['IFLA_XDP_ATTACHED', None]]}], ['IFLA_LINKINFO', {'attrs': [['IFLA_INFO_KIND', 'veth']]}], ['IFLA_LINK_NETNSID', 0], ['IFLA_LINK', 12], ['IFLA_AF_SPEC', {'attrs': [['AF_INET', {'dummy': 65668, 'forwarding': 1, 'mc_forwarding': 0, 'proxy_arp': 0, 'accept_redirects': 1, 'secure_redirects': 1, 'send_redirects': 1, 'shared_media': 1, 'rp_filter': 2, 'accept_source_route': 0, 'bootp_relay': 0, 'log_martians': 0, 'tag': 0, 'arpfilter': 0, 'medium_id': 0, 'noxfrm': 0, 'nopolicy': 0, 'force_igmp_version': 0, 'arp_announce': 0, 'arp_ignore': 0, 'promote_secondaries': 1, 'arp_accept': 0, 'arp_notify': 0, 'accept_local': 0, 'src_vmark': 0, 'proxy_arp_pvlan': 0, 'route_localnet': 0, 'igmpv2_unsolicited_report_interval': 10000, 'igmpv3_unsolicited_report_interval': 1000}], ['AF_INET6', {'attrs': [['IFLA_INET6_FLAGS', 2147483648], ['IFLA_INET6_CACHEINFO', {'max_reasm_len': 65535, 'tstamp': 310169, 'reachable_time': 38132, 'retrans_time': 1000}], ['IFLA_INET6_CONF', {'forwarding': 0, 'hop_limit': 64, 'mtu': 1500, 'accept_ra': 1, 'accept_redirects': 1, 'autoconf': 1, 'dad_transmits': 1, 'router_solicitations': 4294967295, 'router_solicitation_interval': 4000, 'router_solicitation_delay': 1000, 'use_tempaddr': 0, 'temp_valid_lft': 604800, 'temp_preferred_lft': 86400, 'regen_max_retry': 3, 'max_desync_factor': 600, 'max_addresses': 16, 'force_mld_version': 0, 'accept_ra_defrtr': 1, 'accept_ra_pinfo': 1, 'accept_ra_rtr_pref': 1, 'router_probe_interval': 60000, 'accept_ra_rt_info_max_plen': 0, 'proxy_ndp': 0, 'optimistic_dad': 0, 'accept_source_route': 0, 'mc_forwarding': 0, 'disable_ipv6': 0, 'accept_dad': 1, 'force_tllao': 0, 'ndisc_notify': 0}], ['IFLA_INET6_STATS', {'num': 37, 'inpkts': 1, 'inoctets': 96, 'indelivers': 0, 'outforwdatagrams': 0, 'outpkts': 1, 'outoctets': 76, 'inhdrerrors': 0, 'intoobigerrors': 0, 'innoroutes': 0, 'inaddrerrors': 0, 'inunknownprotos': 0, 'intruncatedpkts': 0, 'indiscards': 0, 'outdiscards': 0, 'outnoroutes': 0, 'reasmtimeout': 0, 'reasmreqds': 0, 'reasmoks': 0, 'reasmfails': 0, 'fragoks': 0, 'fragfails': 0, 'fragcreates': 0, 'inmcastpkts': 1, 'outmcastpkts': 1, 'inbcastpkts': 0, 'outbcastpkts': 0, 'inmcastoctets': 96, 'outmcastoctets': 76, 'inbcastoctets': 0, 'outbcastoctets': 0, 'csumerrors': 0, 'noectpkts': 1, 'ect1pkts': 0, 'ect0pkts': 0, 'cepkts': 0}], ['IFLA_INET6_ICMP6STATS', {'num': 6, 'inmsgs': 0, 'inerrors': 0, 'outmsgs': 1, 'outerrors': 0, 'csumerrors': 0}], ['IFLA_INET6_TOKEN', '::'], ['IFLA_INET6_ADDR_GEN_MODE', 0]]}]]}]], 'header': {'length': 1380, 'type': 16, 'flags': 2, 'sequence_number': 255, 'pid': 98470, 'error': None, 'target': 'ovnmeta-9aaf4bd9-9f34-40ad-a4e7-932bff23895a', 'stats': (0, 0, 0)}, 'state': 'up', 'event': 'RTM_NEWLINK'}]) {{(pid=79043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} May 28 12:56:11 l75lg1-v1 manila-data[98318]: DEBUG passlib.utils.compat [None req-39c34f51-e98b-453d-aa4f-07fda4596a3f None None] loaded lazy attr 'SafeConfigParser': {{(pid=98318) __getattr__ /opt/stack/data/venv/lib/python3.10/site-packages/passlib/utils/compat/__init__.py:449}} May 28 12:56:11 l75lg1-v1 manila-data[98318]: DEBUG passlib.utils.compat [None req-39c34f51-e98b-453d-aa4f-07fda4596a3f None None] loaded lazy attr 'NativeStringIO': {{(pid=98318) __getattr__ /opt/stack/data/venv/lib/python3.10/site-packages/passlib/utils/compat/__init__.py:449}} May 28 12:56:11 l75lg1-v1 manila-data[98318]: DEBUG passlib.utils.compat [None req-39c34f51-e98b-453d-aa4f-07fda4596a3f None None] loaded lazy attr 'BytesIO': {{(pid=98318) __getattr__ /opt/stack/data/venv/lib/python3.10/site-packages/passlib/utils/compat/__init__.py:449}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: INFO oslo_service.periodic_task [-] Skipping periodic task update_share_usage_size because it is disabled May 28 12:56:11 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo.privsep.daemon [-] privsep: reply[531bf2ad-ae14-41e9-9c45-bac435b84259]: (4, ({'family': 10, 'prefixlen': 64, 'flags': 192, 'scope': 253, 'index': 2, 'attrs': [['IFA_ADDRESS', 'fe80::f816:3eff:fe0e:5c95'], ['IFA_CACHEINFO', {'ifa_preferred': 4294967295, 'ifa_valid': 4294967295, 'cstamp': 310169, 'tstamp': 310169}], ['IFA_FLAGS', 192]], 'header': {'length': 72, 'type': 20, 'flags': 2, 'sequence_number': 255, 'pid': 98472, 'error': None, 'target': 'ovnmeta-9aaf4bd9-9f34-40ad-a4e7-932bff23895a', 'stats': (0, 0, 0)}, 'event': 'RTM_NEWADDR'},)) {{(pid=79043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} May 28 12:56:11 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo.privsep.daemon [-] privsep: reply[79da5cd6-7c32-435a-9eb2-2ff35d941f8d]: (4, [{'family': 0, '__align': (), 'ifi_type': 1, 'index': 2, 'flags': 69699, 'change': 0, 'attrs': [['IFLA_IFNAME', 'tap9aaf4bd9-91'], ['IFLA_TXQLEN', 1000], ['IFLA_OPERSTATE', 'UP'], ['IFLA_LINKMODE', 0], ['IFLA_MTU', 1500], ['IFLA_MIN_MTU', 68], ['IFLA_MAX_MTU', 65535], ['IFLA_GROUP', 0], ['IFLA_PROMISCUITY', 0], ['IFLA_NUM_TX_QUEUES', 10], ['IFLA_GSO_MAX_SEGS', 65535], ['IFLA_GSO_MAX_SIZE', 65536], ['IFLA_NUM_RX_QUEUES', 10], ['IFLA_CARRIER', 1], ['IFLA_QDISC', 'noqueue'], ['IFLA_CARRIER_CHANGES', 2], ['IFLA_CARRIER_UP_COUNT', 1], ['IFLA_CARRIER_DOWN_COUNT', 1], ['IFLA_PROTO_DOWN', 0], ['IFLA_MAP', {'mem_start': 0, 'mem_end': 0, 'base_addr': 0, 'irq': 0, 'dma': 0, 'port': 0}], ['IFLA_ADDRESS', 'fa:16:3e:0e:5c:95'], ['IFLA_BROADCAST', 'ff:ff:ff:ff:ff:ff'], ['IFLA_STATS64', {'rx_packets': 1, 'tx_packets': 1, 'rx_bytes': 110, 'tx_bytes': 90, 'rx_errors': 0, 'tx_errors': 0, 'rx_dropped': 0, 'tx_dropped': 0, 'multicast': 0, 'collisions': 0, 'rx_length_errors': 0, 'rx_over_errors': 0, 'rx_crc_errors': 0, 'rx_frame_errors': 0, 'rx_fifo_errors': 0, 'rx_missed_errors': 0, 'tx_aborted_errors': 0, 'tx_carrier_errors': 0, 'tx_fifo_errors': 0, 'tx_heartbeat_errors': 0, 'tx_window_errors': 0, 'rx_compressed': 0, 'tx_compressed': 0}], ['IFLA_STATS', {'rx_packets': 1, 'tx_packets': 1, 'rx_bytes': 110, 'tx_bytes': 90, 'rx_errors': 0, 'tx_errors': 0, 'rx_dropped': 0, 'tx_dropped': 0, 'multicast': 0, 'collisions': 0, 'rx_length_errors': 0, 'rx_over_errors': 0, 'rx_crc_errors': 0, 'rx_frame_errors': 0, 'rx_fifo_errors': 0, 'rx_missed_errors': 0, 'tx_aborted_errors': 0, 'tx_carrier_errors': 0, 'tx_fifo_errors': 0, 'tx_heartbeat_errors': 0, 'tx_window_errors': 0, 'rx_compressed': 0, 'tx_compressed': 0}], ['IFLA_XDP', {'attrs': [['IFLA_XDP_ATTACHED', None]]}], ['IFLA_LINKINFO', {'attrs': [['IFLA_INFO_KIND', 'veth']]}], ['IFLA_LINK_NETNSID', 0], ['IFLA_LINK', 12], ['IFLA_AF_SPEC', {'attrs': [['AF_INET', {'dummy': 65668, 'forwarding': 1, 'mc_forwarding': 0, 'proxy_arp': 0, 'accept_redirects': 1, 'secure_redirects': 1, 'send_redirects': 1, 'shared_media': 1, 'rp_filter': 2, 'accept_source_route': 0, 'bootp_relay': 0, 'log_martians': 0, 'tag': 0, 'arpfilter': 0, 'medium_id': 0, 'noxfrm': 0, 'nopolicy': 0, 'force_igmp_version': 0, 'arp_announce': 0, 'arp_ignore': 0, 'promote_secondaries': 1, 'arp_accept': 0, 'arp_notify': 0, 'accept_local': 0, 'src_vmark': 0, 'proxy_arp_pvlan': 0, 'route_localnet': 0, 'igmpv2_unsolicited_report_interval': 10000, 'igmpv3_unsolicited_report_interval': 1000}], ['AF_INET6', {'attrs': [['IFLA_INET6_FLAGS', 2147483648], ['IFLA_INET6_CACHEINFO', {'max_reasm_len': 65535, 'tstamp': 310169, 'reachable_time': 38132, 'retrans_time': 1000}], ['IFLA_INET6_CONF', {'forwarding': 0, 'hop_limit': 64, 'mtu': 1500, 'accept_ra': 1, 'accept_redirects': 1, 'autoconf': 1, 'dad_transmits': 1, 'router_solicitations': 4294967295, 'router_solicitation_interval': 4000, 'router_solicitation_delay': 1000, 'use_tempaddr': 0, 'temp_valid_lft': 604800, 'temp_preferred_lft': 86400, 'regen_max_retry': 3, 'max_desync_factor': 600, 'max_addresses': 16, 'force_mld_version': 0, 'accept_ra_defrtr': 1, 'accept_ra_pinfo': 1, 'accept_ra_rtr_pref': 1, 'router_probe_interval': 60000, 'accept_ra_rt_info_max_plen': 0, 'proxy_ndp': 0, 'optimistic_dad': 0, 'accept_source_route': 0, 'mc_forwarding': 0, 'disable_ipv6': 0, 'accept_dad': 1, 'force_tllao': 0, 'ndisc_notify': 0}], ['IFLA_INET6_STATS', {'num': 37, 'inpkts': 1, 'inoctets': 96, 'indelivers': 0, 'outforwdatagrams': 0, 'outpkts': 1, 'outoctets': 76, 'inhdrerrors': 0, 'intoobigerrors': 0, 'innoroutes': 0, 'inaddrerrors': 0, 'inunknownprotos': 0, 'intruncatedpkts': 0, 'indiscards': 0, 'outdiscards': 0, 'outnoroutes': 0, 'reasmtimeout': 0, 'reasmreqds': 0, 'reasmoks': 0, 'reasmfails': 0, 'fragoks': 0, 'fragfails': 0, 'fragcreates': 0, 'inmcastpkts': 1, 'outmcastpkts': 1, 'inbcastpkts': 0, 'outbcastpkts': 0, 'inmcastoctets': 96, 'outmcastoctets': 76, 'inbcastoctets': 0, 'outbcastoctets': 0, 'csumerrors': 0, 'noectpkts': 1, 'ect1pkts': 0, 'ect0pkts': 0, 'cepkts': 0}], ['IFLA_INET6_ICMP6STATS', {'num': 6, 'inmsgs': 0, 'inerrors': 0, 'outmsgs': 1, 'outerrors': 0, 'csumerrors': 0}], ['IFLA_INET6_TOKEN', '::'], ['IFLA_INET6_ADDR_GEN_MODE', 0]]}]]}]], 'header': {'length': 1380, 'type': 16, 'flags': 0, 'sequence_number': 255, 'pid': 98473, 'error': None, 'target': 'ovnmeta-9aaf4bd9-9f34-40ad-a4e7-932bff23895a', 'stats': (0, 0, 0)}, 'state': 'up', 'event': 'RTM_NEWLINK'}]) {{(pid=79043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: INFO oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] Starting 1 workers May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] Started child 98474 {{(pid=98324) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:579}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] Full set of CONF: {{(pid=98324) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:653}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] ******************************************************************************** {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2600}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] Configuration options gathered from: {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2601}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] command line args: ['--config-file', '/etc/manila/manila.conf'] {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} May 28 12:56:11 l75lg1-v1 manila-share[98474]: INFO manila.service [-] Starting manila-share node (version 18.1.0) May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] config files: ['/etc/manila/manila.conf'] {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2603}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] ================================================================================ {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2605}} May 28 12:56:11 l75lg1-v1 manila-share[98474]: DEBUG oslo_db.api [None req-0d0953db-ffb1-4877-9695-c201826f4008 None None] Loading backend 'sqlalchemy' from 'manila.db.sqlalchemy.api' {{(pid=98474) _load_backend /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/api.py:259}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] admin_network_config_group = None {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] admin_only_metadata = ['__affinity_same_host', '__affinity_different_host'] {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] api_rate_limit = True {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] auth_strategy = keystone {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] automatic_share_server_cleanup = True {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] backend_availability_zone = None {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] check_for_expired_shares_in_recycle_bin_interval = 3600 {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] check_for_expired_transfers = 300 {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] cleanup_interval = 1800 {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] config_dir = [] {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] config_file = ['/etc/manila/manila.conf'] {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] config_source = [] {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] control_exchange = openstack {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] data_manager = manila.data.manager.DataManager {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] data_topic = manila-data {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] db_backend = sqlalchemy {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] db_driver = manila.db {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] debug = True {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] default_share_group_type = default {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] default_share_type = default {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] delete_share_server_with_last_share = False {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] driver_backup_continue_update_interval = 60 {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] driver_handles_share_servers = None {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] driver_restore_continue_update_interval = 60 {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] enable_gathering_share_usage_size = False {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] enable_new_services = True {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] enable_periodic_hooks = False {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] enable_post_hooks = False {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] enable_pre_hooks = False {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] enabled_share_backends = ['vast'] {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] enabled_share_protocols = ['NFS', 'CIFS'] {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] fatal_exception_format_errors = False {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] filter_function = None {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] ganesha_config_dir = /etc/ganesha {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] ganesha_config_path = /etc/ganesha/ganesha.conf {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] ganesha_db_path = /opt/stack/data/manila/manila-ganesha.db {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] ganesha_export_dir = /etc/ganesha/export.d {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] ganesha_export_template_dir = /etc/manila/ganesha-export-templ.d {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] ganesha_rados_export_counter = ganesha-export-counter {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] ganesha_rados_export_index = ganesha-export-index {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] ganesha_rados_store_enable = False {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] ganesha_rados_store_pool_name = None {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] ganesha_service_name = ganesha.nfsd {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] goodness_function = None {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] graceful_shutdown_timeout = 60 {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] hook_drivers = [] {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] host = l75lg1-v1 {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] instance_format = [instance: %(uuid)s] {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] is_deferred_deletion_enabled = False {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] log_config_append = None {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] log_dir = None {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] log_file = None {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] log_options = True {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] log_rotate_interval = 1 {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] log_rotate_interval_type = days {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] log_rotation_type = none {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] max_logfile_count = 30 {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] max_logfile_size_mb = 200 {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] max_over_subscription_ratio = 20.0 {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] max_share_server_size = -1 {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] max_shares_per_share_server = -1 {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] message_reap_interval = 86400 {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] message_ttl = 2592000 {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] migration_create_delete_share_timeout = 300 {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] migration_driver_continue_update_interval = 60 {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] migration_ignore_files = ['lost+found'] {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] migration_wait_access_rules_timeout = 180 {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] monkey_patch = False {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] monkey_patch_modules = [] {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] my_ip = 10.27.203.238 {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] network_config_group = None {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] num_shell_tries = 3 {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] osapi_max_limit = 1000 {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] osapi_share_base_URL = None {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] osapi_share_ext_list = [] {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] osapi_share_extension = ['manila.api.contrib.standard_extensions'] {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] osapi_share_listen = :: {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] osapi_share_listen_port = 8786 {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] osapi_share_use_ssl = False {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] osapi_share_workers = 1 {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] periodic_deferred_delete_interval = 10 {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] periodic_fuzzy_delay = 60 {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] periodic_hooks_interval = 300.0 {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] periodic_interval = 60 {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] project_id_regex = [0-9a-f\-]+ {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] protocol_access_mapping = {'ip': ['nfs'], 'user': ['cifs']} {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] publish_errors = False {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] rate_limit_burst = 0 {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] rate_limit_except_level = CRITICAL {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] rate_limit_interval = 0 {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] replica_state_update_interval = 300 {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] replication_domain = None {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] report_interval = 10 {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] reserved_share_extend_percentage = 0 {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] reserved_share_from_snapshot_percentage = 0 {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] reserved_share_percentage = 0 {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] rootwrap_config = /etc/manila/rootwrap.conf {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] rpc_response_timeout = 60 {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] run_external_periodic_tasks = True {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] scheduler_manager = manila.scheduler.manager.SchedulerManager {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] scheduler_topic = manila-scheduler {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] server_migration_driver_continue_update_interval = 900 {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] service_down_time = 60 {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] share_api_class = manila.share.api.API {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] share_backend_name = None {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] share_backup_name_template = share-backup-%s {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] share_driver = manila.share.drivers.generic.GenericShareDriver {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] share_manager = manila.share.manager.ShareManager {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] share_mount_template = mount -vt %(proto)s %(options)s %(export)s %(path)s {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] share_name_template = share-%s {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] share_service_inithost_offload = False {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] share_snapshot_name_template = share-snapshot-%s {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] share_topic = manila-share {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] share_transfer_key_length = 16 {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] share_transfer_salt_length = 8 {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] share_unmount_template = umount -v %(path)s {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] share_usage_size_update_interval = 300 {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] soft_deleted_share_retention_time = 604800 {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] ssh_conn_timeout = 60 {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] ssh_max_pool_conn = 10 {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] ssh_min_pool_conn = 1 {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] state_path = /opt/stack/data/manila {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] storage_availability_zone = nova {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] suppress_post_hooks_errors = False {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] suppress_pre_hooks_errors = False {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] syslog_log_facility = LOG_USER {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] transfer_retention_time = 300 {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] transport_url = **** {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] unmanage_remove_access_rules = False {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] unused_share_server_cleanup_interval = 10 {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] use_eventlog = False {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] use_journal = False {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] use_json = False {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] use_scheduler_creating_share_from_snapshot = False {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] use_stderr = False {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] use_syslog = False {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] vast_mgmt_host = None {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] vast_mgmt_password = **** {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] vast_mgmt_port = 0 {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] vast_mgmt_user = None {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] vast_root_export = manila {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] vast_vippool_name = None {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] watch_log_file = False {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] oslo_concurrency.disable_process_locking = False {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] oslo_concurrency.lock_path = /opt/stack/manila/manila_locks {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] oslo_messaging_metrics.metrics_process_name = {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] oslo_policy.enforce_new_defaults = False {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] oslo_policy.enforce_scope = False {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] oslo_policy.policy_default_rule = default {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] oslo_policy.policy_file = policy.yaml {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] coordination.backend_url = **** {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] database.backend = sqlalchemy {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] database.connection = **** {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] database.connection_debug = 0 {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] database.connection_parameters = {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] database.connection_recycle_time = 3600 {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] database.connection_trace = False {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] database.db_inc_retry_interval = True {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] database.db_max_retries = 20 {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] database.db_max_retry_interval = 10 {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] database.db_retry_interval = 1 {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] database.max_overflow = 50 {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] database.max_pool_size = 40 {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] database.max_retries = 10 {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] database.mysql_sql_mode = TRADITIONAL {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] database.mysql_wsrep_sync_wait = None {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] database.pool_timeout = None {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] database.retry_interval = 10 {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] database.slave_connection = **** {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] database.sqlite_synchronous = True {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] database.use_db_reconnect = False {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] profiler.connection_string = messaging:// {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] profiler.enabled = False {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] profiler.es_doc_type = notification {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] profiler.es_scroll_size = 10000 {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] profiler.es_scroll_time = 2m {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] profiler.filter_error_trace = False {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] profiler.hmac_keys = **** {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] profiler.sentinel_service_name = mymaster {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] profiler.socket_timeout = 0.1 {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] profiler.trace_requests = False {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] profiler.trace_sqlalchemy = False {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] profiler_jaeger.process_tags = {} {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] profiler_jaeger.service_name_prefix = None {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] profiler_otlp.service_name_prefix = None {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] oslo_reports.file_event_handler = None {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] oslo_reports.file_event_handler_interval = 1 {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] oslo_reports.log_dir = None {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] oslo_messaging_rabbit.hostname = l75lg1-v1 {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] oslo_messaging_rabbit.processname = manila-share {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] oslo_messaging_rabbit.ssl = False {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] oslo_messaging_rabbit.ssl_version = {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] oslo_messaging_notifications.driver = [] {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] oslo_messaging_notifications.retry = -1 {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] oslo_messaging_notifications.transport_url = **** {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] quota.backup_gigabytes = 1000 {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] quota.backups = 10 {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] quota.driver = manila.quota.DbQuotaDriver {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] quota.gigabytes = 1000 {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] quota.max_age = 0 {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] quota.per_share_gigabytes = -1 {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] quota.replica_gigabytes = 1000 {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] quota.reservation_expire = 86400 {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] quota.share_group_snapshots = 50 {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] quota.share_groups = 50 {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] quota.share_networks = 10 {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] quota.share_replicas = 100 {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] quota.shares = 50 {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] quota.snapshot_gigabytes = 1000 {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] quota.snapshots = 50 {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] quota.until_refresh = 0 {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] vast.admin_network_config_group = None {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] vast.automatic_share_server_cleanup = True {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] vast.backend_availability_zone = None {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] vast.check_for_expired_shares_in_recycle_bin_interval = 3600 {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] vast.check_for_expired_transfers = 300 {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] vast.delete_share_server_with_last_share = False {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] vast.driver_backup_continue_update_interval = 60 {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] vast.driver_handles_share_servers = False {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] vast.driver_restore_continue_update_interval = 60 {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] vast.drivers_private_storage_class = manila.share.drivers_private_data.SqlStorageDriver {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] vast.enable_gathering_share_usage_size = False {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] vast.filter_function = None {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] vast.goodness_function = None {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] vast.hook_drivers = [] {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] vast.max_over_subscription_ratio = 20.0 {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] vast.max_share_server_size = -1 {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] vast.max_shares_per_share_server = -1 {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] vast.migration_driver_continue_update_interval = 60 {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] vast.migration_ignore_files = ['lost+found'] {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] vast.network_config_group = None {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] vast.num_shell_tries = 3 {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] vast.periodic_deferred_delete_interval = 300 {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] vast.protocol_access_mapping = {'ip': ['nfs'], 'user': ['cifs']} {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] vast.replica_state_update_interval = 300 {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] vast.replication_domain = None {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] vast.reserved_share_extend_percentage = 0 {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] vast.reserved_share_from_snapshot_percentage = 0 {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] vast.reserved_share_percentage = 0 {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] vast.server_migration_driver_continue_update_interval = 900 {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] vast.share_backend_name = vast {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] vast.share_driver = manila.share.drivers.vastdata.VASTShareDriver {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] vast.share_mount_template = mount -vt %(proto)s %(options)s %(export)s %(path)s {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] vast.share_service_inithost_offload = False {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] vast.share_unmount_template = umount -v %(path)s {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] vast.share_usage_size_update_interval = 300 {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] vast.unmanage_remove_access_rules = False {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] vast.unused_share_server_cleanup_interval = 10 {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] vast.vast_mgmt_host = 127.0.0.1 {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] vast.vast_mgmt_password = **** {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] vast.vast_mgmt_port = 40443 {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] vast.vast_mgmt_user = admin {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] vast.vast_root_export = manila {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] vast.vast_vippool_name = vippool-1 {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-share[98324]: DEBUG oslo_service.service [None req-29afc41b-7925-408f-9e4a-9281e39cf74d None None] ******************************************************************************** {{(pid=98324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2624}} May 28 12:56:11 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bb1b585-a9e0-4ccd-933d-44780e3ada6c]: (4, None) {{(pid=79043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} May 28 12:56:11 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9aaf4bd9-90, bridge=br-ex, if_exists=True) {{(pid=76818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:56:11 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} May 28 12:56:11 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9aaf4bd9-90, may_exist=True, interface_attrs={}) {{(pid=76818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:56:11 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=Interface, record=tap9aaf4bd9-90, col_values=(('external_ids', {'iface-id': '697c3f9b-2b19-40c6-ada6-113c7f2f97f3'}),), if_exists=True) {{(pid=76818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:56:11 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.linux.utils [-] Unable to access /opt/stack/data/neutron/external/pids/9aaf4bd9-9f34-40ad-a4e7-932bff23895a.pid.haproxy; Error: [Errno 2] No such file or directory: '/opt/stack/data/neutron/external/pids/9aaf4bd9-9f34-40ad-a4e7-932bff23895a.pid.haproxy' {{(pid=76818) get_value_from_file /opt/stack/neutron/neutron/agent/linux/utils.py:252}} May 28 12:56:11 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.linux.utils [-] Unable to access /opt/stack/data/neutron/external/pids/9aaf4bd9-9f34-40ad-a4e7-932bff23895a.pid.haproxy; Error: [Errno 2] No such file or directory: '/opt/stack/data/neutron/external/pids/9aaf4bd9-9f34-40ad-a4e7-932bff23895a.pid.haproxy' {{(pid=76818) get_value_from_file /opt/stack/neutron/neutron/agent/linux/utils.py:252}} May 28 12:56:11 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.linux.external_process [-] No haproxy process started for 9aaf4bd9-9f34-40ad-a4e7-932bff23895a {{(pid=76818) disable /opt/stack/neutron/neutron/agent/linux/external_process.py:145}} May 28 12:56:11 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.linux.utils [-] Unable to access /opt/stack/data/neutron/external/pids/9aaf4bd9-9f34-40ad-a4e7-932bff23895a.pid.haproxy; Error: [Errno 2] No such file or directory: '/opt/stack/data/neutron/external/pids/9aaf4bd9-9f34-40ad-a4e7-932bff23895a.pid.haproxy' {{(pid=76818) get_value_from_file /opt/stack/neutron/neutron/agent/linux/utils.py:252}} May 28 12:56:11 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo.privsep.daemon [-] privsep: reply[807bcda1-c80f-4bcb-9f5c-6670c5166fed]: (4, None) {{(pid=79043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} May 28 12:56:11 l75lg1-v1 dstat.sh[49771]: 28-05 12:56:11| 58 9 32 0 0|5068M 2458M 277M 7826M| 19k 9992B| 60k 276k|4.00 16.0 |7270 9756 |1.18 0.80 0.93| 11 0 145| 0 0 | 0 2048M| 29 302 0 22 0 May 28 12:56:11 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo.privsep.daemon [-] privsep: reply[1919a12e-f56a-451b-8703-9be5ce527642]: (4, [{'family': 0, '__align': (), 'ifi_type': 1, 'index': 2, 'flags': 69699, 'change': 0, 'attrs': [['IFLA_IFNAME', 'tap9aaf4bd9-91'], ['IFLA_TXQLEN', 1000], ['IFLA_OPERSTATE', 'UP'], ['IFLA_LINKMODE', 0], ['IFLA_MTU', 1500], ['IFLA_MIN_MTU', 68], ['IFLA_MAX_MTU', 65535], ['IFLA_GROUP', 0], ['IFLA_PROMISCUITY', 0], ['IFLA_NUM_TX_QUEUES', 10], ['IFLA_GSO_MAX_SEGS', 65535], ['IFLA_GSO_MAX_SIZE', 65536], ['IFLA_NUM_RX_QUEUES', 10], ['IFLA_CARRIER', 1], ['IFLA_QDISC', 'noqueue'], ['IFLA_CARRIER_CHANGES', 2], ['IFLA_CARRIER_UP_COUNT', 1], ['IFLA_CARRIER_DOWN_COUNT', 1], ['IFLA_PROTO_DOWN', 0], ['IFLA_MAP', {'mem_start': 0, 'mem_end': 0, 'base_addr': 0, 'irq': 0, 'dma': 0, 'port': 0}], ['IFLA_ADDRESS', 'fa:16:3e:0e:5c:95'], ['IFLA_BROADCAST', 'ff:ff:ff:ff:ff:ff'], ['IFLA_STATS64', {'rx_packets': 1, 'tx_packets': 2, 'rx_bytes': 110, 'tx_bytes': 200, 'rx_errors': 0, 'tx_errors': 0, 'rx_dropped': 0, 'tx_dropped': 0, 'multicast': 0, 'collisions': 0, 'rx_length_errors': 0, 'rx_over_errors': 0, 'rx_crc_errors': 0, 'rx_frame_errors': 0, 'rx_fifo_errors': 0, 'rx_missed_errors': 0, 'tx_aborted_errors': 0, 'tx_carrier_errors': 0, 'tx_fifo_errors': 0, 'tx_heartbeat_errors': 0, 'tx_window_errors': 0, 'rx_compressed': 0, 'tx_compressed': 0}], ['IFLA_STATS', {'rx_packets': 1, 'tx_packets': 2, 'rx_bytes': 110, 'tx_bytes': 200, 'rx_errors': 0, 'tx_errors': 0, 'rx_dropped': 0, 'tx_dropped': 0, 'multicast': 0, 'collisions': 0, 'rx_length_errors': 0, 'rx_over_errors': 0, 'rx_crc_errors': 0, 'rx_frame_errors': 0, 'rx_fifo_errors': 0, 'rx_missed_errors': 0, 'tx_aborted_errors': 0, 'tx_carrier_errors': 0, 'tx_fifo_errors': 0, 'tx_heartbeat_errors': 0, 'tx_window_errors': 0, 'rx_compressed': 0, 'tx_compressed': 0}], ['IFLA_XDP', {'attrs': [['IFLA_XDP_ATTACHED', None]]}], ['IFLA_LINKINFO', {'attrs': [['IFLA_INFO_KIND', 'veth']]}], ['IFLA_LINK_NETNSID', 0], ['IFLA_LINK', 12], ['IFLA_AF_SPEC', {'attrs': [['AF_INET', {'dummy': 65668, 'forwarding': 1, 'mc_forwarding': 0, 'proxy_arp': 0, 'accept_redirects': 1, 'secure_redirects': 1, 'send_redirects': 1, 'shared_media': 1, 'rp_filter': 2, 'accept_source_route': 0, 'bootp_relay': 0, 'log_martians': 0, 'tag': 0, 'arpfilter': 0, 'medium_id': 0, 'noxfrm': 0, 'nopolicy': 0, 'force_igmp_version': 0, 'arp_announce': 0, 'arp_ignore': 0, 'promote_secondaries': 1, 'arp_accept': 0, 'arp_notify': 0, 'accept_local': 0, 'src_vmark': 0, 'proxy_arp_pvlan': 0, 'route_localnet': 0, 'igmpv2_unsolicited_report_interval': 10000, 'igmpv3_unsolicited_report_interval': 1000}], ['AF_INET6', {'attrs': [['IFLA_INET6_FLAGS', 2147483648], ['IFLA_INET6_CACHEINFO', {'max_reasm_len': 65535, 'tstamp': 310169, 'reachable_time': 38132, 'retrans_time': 1000}], ['IFLA_INET6_CONF', {'forwarding': 0, 'hop_limit': 64, 'mtu': 1500, 'accept_ra': 1, 'accept_redirects': 1, 'autoconf': 1, 'dad_transmits': 1, 'router_solicitations': 4294967295, 'router_solicitation_interval': 4000, 'router_solicitation_delay': 1000, 'use_tempaddr': 0, 'temp_valid_lft': 604800, 'temp_preferred_lft': 86400, 'regen_max_retry': 3, 'max_desync_factor': 600, 'max_addresses': 16, 'force_mld_version': 0, 'accept_ra_defrtr': 1, 'accept_ra_pinfo': 1, 'accept_ra_rtr_pref': 1, 'router_probe_interval': 60000, 'accept_ra_rt_info_max_plen': 0, 'proxy_ndp': 0, 'optimistic_dad': 0, 'accept_source_route': 0, 'mc_forwarding': 0, 'disable_ipv6': 0, 'accept_dad': 1, 'force_tllao': 0, 'ndisc_notify': 0}], ['IFLA_INET6_STATS', {'num': 37, 'inpkts': 1, 'inoctets': 96, 'indelivers': 0, 'outforwdatagrams': 0, 'outpkts': 2, 'outoctets': 172, 'inhdrerrors': 0, 'intoobigerrors': 0, 'innoroutes': 0, 'inaddrerrors': 0, 'inunknownprotos': 0, 'intruncatedpkts': 0, 'indiscards': 0, 'outdiscards': 0, 'outnoroutes': 0, 'reasmtimeout': 0, 'reasmreqds': 0, 'reasmoks': 0, 'reasmfails': 0, 'fragoks': 0, 'fragfails': 0, 'fragcreates': 0, 'inmcastpkts': 1, 'outmcastpkts': 2, 'inbcastpkts': 0, 'outbcastpkts': 0, 'inmcastoctets': 96, 'outmcastoctets': 172, 'inbcastoctets': 0, 'outbcastoctets': 0, 'csumerrors': 0, 'noectpkts': 1, 'ect1pkts': 0, 'ect0pkts': 0, 'cepkts': 0}], ['IFLA_INET6_ICMP6STATS', {'num': 6, 'inmsgs': 0, 'inerrors': 0, 'outmsgs': 2, 'outerrors': 0, 'csumerrors': 0}], ['IFLA_INET6_TOKEN', '::'], ['IFLA_INET6_ADDR_GEN_MODE', 0]]}]]}]], 'header': {'length': 1380, 'type': 16, 'flags': 2, 'sequence_number': 255, 'pid': 98482, 'error': None, 'target': 'ovnmeta-9aaf4bd9-9f34-40ad-a4e7-932bff23895a', 'stats': (0, 0, 0)}, 'state': 'up', 'event': 'RTM_NEWLINK'}]) {{(pid=79043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} May 28 12:56:11 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e5c578a-289e-4104-b159-8e76fa4974e7]: (4, ({'family': 10, 'prefixlen': 128, 'flags': 192, 'scope': 253, 'index': 2, 'attrs': [['IFA_ADDRESS', 'fe80::a9fe:a9fe'], ['IFA_CACHEINFO', {'ifa_preferred': 4294967295, 'ifa_valid': 4294967295, 'cstamp': 310178, 'tstamp': 310178}], ['IFA_FLAGS', 192]], 'header': {'length': 72, 'type': 20, 'flags': 2, 'sequence_number': 255, 'pid': 98483, 'error': None, 'target': 'ovnmeta-9aaf4bd9-9f34-40ad-a4e7-932bff23895a', 'stats': (0, 0, 0)}, 'event': 'RTM_NEWADDR'},)) {{(pid=79043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=98327) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=98327) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=98327) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] ******************************************************************************** {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2600}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] Configuration options gathered from: {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2601}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] command line args: ['--config-file', '/etc/manila/manila.conf'] {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] config files: ['/etc/manila/manila.conf'] {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2603}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] ================================================================================ {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2605}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] admin_network_config_group = None {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] admin_only_metadata = ['__affinity_same_host', '__affinity_different_host'] {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] api_rate_limit = True {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] auth_strategy = keystone {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] backdoor_port = None {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] backdoor_socket = None {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] backend_availability_zone = None {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] capacity_weight_multiplier = 1.0 {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] cleanup_interval = 1800 {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] config_dir = [] {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] config_file = ['/etc/manila/manila.conf'] {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] config_source = [] {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] control_exchange = openstack {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] data_manager = manila.data.manager.DataManager {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] data_topic = manila-data {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] db_backend = sqlalchemy {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] db_driver = manila.db {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] debug = True {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] default_share_group_type = default {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] default_share_type = default {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] driver_handles_share_servers = None {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] enable_new_services = True {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] enabled_share_backends = ['vast'] {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] enabled_share_protocols = ['NFS', 'CIFS'] {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] fatal_exception_format_errors = False {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] filter_function = None {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] ganesha_config_dir = /etc/ganesha {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo.privsep.daemon [-] privsep: reply[2847876b-e9d3-4deb-8cc7-4de0e87162d3]: (4, [{'family': 0, '__align': (), 'ifi_type': 1, 'index': 2, 'flags': 69699, 'change': 0, 'attrs': [['IFLA_IFNAME', 'tap9aaf4bd9-91'], ['IFLA_TXQLEN', 1000], ['IFLA_OPERSTATE', 'UP'], ['IFLA_LINKMODE', 0], ['IFLA_MTU', 1500], ['IFLA_MIN_MTU', 68], ['IFLA_MAX_MTU', 65535], ['IFLA_GROUP', 0], ['IFLA_PROMISCUITY', 0], ['IFLA_NUM_TX_QUEUES', 10], ['IFLA_GSO_MAX_SEGS', 65535], ['IFLA_GSO_MAX_SIZE', 65536], ['IFLA_NUM_RX_QUEUES', 10], ['IFLA_CARRIER', 1], ['IFLA_QDISC', 'noqueue'], ['IFLA_CARRIER_CHANGES', 2], ['IFLA_CARRIER_UP_COUNT', 1], ['IFLA_CARRIER_DOWN_COUNT', 1], ['IFLA_PROTO_DOWN', 0], ['IFLA_MAP', {'mem_start': 0, 'mem_end': 0, 'base_addr': 0, 'irq': 0, 'dma': 0, 'port': 0}], ['IFLA_ADDRESS', 'fa:16:3e:0e:5c:95'], ['IFLA_BROADCAST', 'ff:ff:ff:ff:ff:ff'], ['IFLA_STATS64', {'rx_packets': 1, 'tx_packets': 2, 'rx_bytes': 110, 'tx_bytes': 200, 'rx_errors': 0, 'tx_errors': 0, 'rx_dropped': 0, 'tx_dropped': 0, 'multicast': 0, 'collisions': 0, 'rx_length_errors': 0, 'rx_over_errors': 0, 'rx_crc_errors': 0, 'rx_frame_errors': 0, 'rx_fifo_errors': 0, 'rx_missed_errors': 0, 'tx_aborted_errors': 0, 'tx_carrier_errors': 0, 'tx_fifo_errors': 0, 'tx_heartbeat_errors': 0, 'tx_window_errors': 0, 'rx_compressed': 0, 'tx_compressed': 0}], ['IFLA_STATS', {'rx_packets': 1, 'tx_packets': 2, 'rx_bytes': 110, 'tx_bytes': 200, 'rx_errors': 0, 'tx_errors': 0, 'rx_dropped': 0, 'tx_dropped': 0, 'multicast': 0, 'collisions': 0, 'rx_length_errors': 0, 'rx_over_errors': 0, 'rx_crc_errors': 0, 'rx_frame_errors': 0, 'rx_fifo_errors': 0, 'rx_missed_errors': 0, 'tx_aborted_errors': 0, 'tx_carrier_errors': 0, 'tx_fifo_errors': 0, 'tx_heartbeat_errors': 0, 'tx_window_errors': 0, 'rx_compressed': 0, 'tx_compressed': 0}], ['IFLA_XDP', {'attrs': [['IFLA_XDP_ATTACHED', None]]}], ['IFLA_LINKINFO', {'attrs': [['IFLA_INFO_KIND', 'veth']]}], ['IFLA_LINK_NETNSID', 0], ['IFLA_LINK', 12], ['IFLA_AF_SPEC', {'attrs': [['AF_INET', {'dummy': 65668, 'forwarding': 1, 'mc_forwarding': 0, 'proxy_arp': 0, 'accept_redirects': 1, 'secure_redirects': 1, 'send_redirects': 1, 'shared_media': 1, 'rp_filter': 2, 'accept_source_route': 0, 'bootp_relay': 0, 'log_martians': 0, 'tag': 0, 'arpfilter': 0, 'medium_id': 0, 'noxfrm': 0, 'nopolicy': 0, 'force_igmp_version': 0, 'arp_announce': 0, 'arp_ignore': 0, 'promote_secondaries': 1, 'arp_accept': 0, 'arp_notify': 0, 'accept_local': 0, 'src_vmark': 0, 'proxy_arp_pvlan': 0, 'route_localnet': 0, 'igmpv2_unsolicited_report_interval': 10000, 'igmpv3_unsolicited_report_interval': 1000}], ['AF_INET6', {'attrs': [['IFLA_INET6_FLAGS', 2147483648], ['IFLA_INET6_CACHEINFO', {'max_reasm_len': 65535, 'tstamp': 310169, 'reachable_time': 38132, 'retrans_time': 1000}], ['IFLA_INET6_CONF', {'forwarding': 0, 'hop_limit': 64, 'mtu': 1500, 'accept_ra': 1, 'accept_redirects': 1, 'autoconf': 1, 'dad_transmits': 1, 'router_solicitations': 4294967295, 'router_solicitation_interval': 4000, 'router_solicitation_delay': 1000, 'use_tempaddr': 0, 'temp_valid_lft': 604800, 'temp_preferred_lft': 86400, 'regen_max_retry': 3, 'max_desync_factor': 600, 'max_addresses': 16, 'force_mld_version': 0, 'accept_ra_defrtr': 1, 'accept_ra_pinfo': 1, 'accept_ra_rtr_pref': 1, 'router_probe_interval': 60000, 'accept_ra_rt_info_max_plen': 0, 'proxy_ndp': 0, 'optimistic_dad': 0, 'accept_source_route': 0, 'mc_forwarding': 0, 'disable_ipv6': 0, 'accept_dad': 1, 'force_tllao': 0, 'ndisc_notify': 0}], ['IFLA_INET6_STATS', {'num': 37, 'inpkts': 1, 'inoctets': 96, 'indelivers': 0, 'outforwdatagrams': 0, 'outpkts': 2, 'outoctets': 172, 'inhdrerrors': 0, 'intoobigerrors': 0, 'innoroutes': 0, 'inaddrerrors': 0, 'inunknownprotos': 0, 'intruncatedpkts': 0, 'indiscards': 0, 'outdiscards': 0, 'outnoroutes': 0, 'reasmtimeout': 0, 'reasmreqds': 0, 'reasmoks': 0, 'reasmfails': 0, 'fragoks': 0, 'fragfails': 0, 'fragcreates': 0, 'inmcastpkts': 1, 'outmcastpkts': 2, 'inbcastpkts': 0, 'outbcastpkts': 0, 'inmcastoctets': 96, 'outmcastoctets': 172, 'inbcastoctets': 0, 'outbcastoctets': 0, 'csumerrors': 0, 'noectpkts': 1, 'ect1pkts': 0, 'ect0pkts': 0, 'cepkts': 0}], ['IFLA_INET6_ICMP6STATS', {'num': 6, 'inmsgs': 0, 'inerrors': 0, 'outmsgs': 2, 'outerrors': 0, 'csumerrors': 0}], ['IFLA_INET6_TOKEN', '::'], ['IFLA_INET6_ADDR_GEN_MODE', 0]]}]]}]], 'header': {'length': 1380, 'type': 16, 'flags': 0, 'sequence_number': 255, 'pid': 98484, 'error': None, 'target': 'ovnmeta-9aaf4bd9-9f34-40ad-a4e7-932bff23895a', 'stats': (0, 0, 0)}, 'state': 'up', 'event': 'RTM_NEWLINK'}]) {{(pid=79043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] ganesha_config_path = /etc/ganesha/ganesha.conf {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] ganesha_db_path = /opt/stack/data/manila/manila-ganesha.db {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] ganesha_export_dir = /etc/ganesha/export.d {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] ganesha_export_template_dir = /etc/manila/ganesha-export-templ.d {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] ganesha_rados_export_counter = ganesha-export-counter {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] ganesha_rados_export_index = ganesha-export-index {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] ganesha_rados_store_enable = False {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] ganesha_rados_store_pool_name = None {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] ganesha_service_name = ganesha.nfsd {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] goodness_function = None {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] graceful_shutdown_timeout = 60 {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] host = l75lg1-v1 {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] instance_format = [instance: %(uuid)s] {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] is_deferred_deletion_enabled = False {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] log_config_append = None {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] log_dir = None {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] log_file = None {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] log_options = True {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] log_rotate_interval = 1 {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] log_rotate_interval_type = days {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] log_rotation_type = none {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-share[98474]: DEBUG passlib.utils.compat [None req-0d0953db-ffb1-4877-9695-c201826f4008 None None] loaded lazy attr 'SafeConfigParser': {{(pid=98474) __getattr__ /opt/stack/data/venv/lib/python3.10/site-packages/passlib/utils/compat/__init__.py:449}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-share[98474]: DEBUG passlib.utils.compat [None req-0d0953db-ffb1-4877-9695-c201826f4008 None None] loaded lazy attr 'NativeStringIO': {{(pid=98474) __getattr__ /opt/stack/data/venv/lib/python3.10/site-packages/passlib/utils/compat/__init__.py:449}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-share[98474]: DEBUG passlib.utils.compat [None req-0d0953db-ffb1-4877-9695-c201826f4008 None None] loaded lazy attr 'BytesIO': {{(pid=98474) __getattr__ /opt/stack/data/venv/lib/python3.10/site-packages/passlib/utils/compat/__init__.py:449}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] max_logfile_count = 30 {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] max_logfile_size_mb = 200 {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] max_over_subscription_ratio = 20.0 {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] max_share_server_size = -1 {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] max_shares_per_share_server = -1 {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] message_reap_interval = 86400 {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] message_ttl = 2592000 {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] migration_ignore_files = ['lost+found'] {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] monkey_patch = False {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] monkey_patch_modules = [] {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] my_ip = 10.27.203.238 {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] network_config_group = None {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] num_shell_tries = 3 {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] osapi_max_limit = 1000 {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] osapi_share_base_URL = None {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] osapi_share_ext_list = [] {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] osapi_share_extension = ['manila.api.contrib.standard_extensions'] {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] osapi_share_listen = :: {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] osapi_share_listen_port = 8786 {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] osapi_share_use_ssl = False {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] osapi_share_workers = 1 {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] periodic_fuzzy_delay = 60 {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] periodic_interval = 60 {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] pool_weight_multiplier = 1.0 {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] project_id_regex = [0-9a-f\-]+ {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] protocol_access_mapping = {'ip': ['nfs'], 'user': ['cifs']} {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] publish_errors = False {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] rate_limit_burst = 0 {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] rate_limit_except_level = CRITICAL {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] rate_limit_interval = 0 {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] replication_domain = None {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] report_interval = 10 {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] reserved_share_extend_percentage = 0 {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] reserved_share_from_snapshot_percentage = 0 {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] reserved_share_percentage = 0 {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] rootwrap_config = /etc/manila/rootwrap.conf {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] rpc_response_timeout = 60 {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] run_external_periodic_tasks = True {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] scheduler_default_extend_filters = ['CapacityFilter', 'DriverFilter'] {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] scheduler_default_filters = ['OnlyHostFilter', 'AvailabilityZoneFilter', 'CapacityFilter', 'CapabilitiesFilter', 'DriverFilter', 'ShareReplicationFilter', 'CreateFromSnapshotFilter', 'AffinityFilter', 'AntiAffinityFilter'] {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] scheduler_default_share_group_filters = ['AvailabilityZoneFilter', 'ConsistentSnapshotFilter'] {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] scheduler_default_weighers = ['CapacityWeigher', 'GoodnessWeigher', 'HostAffinityWeigher'] {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] scheduler_driver = manila.scheduler.drivers.filter.FilterScheduler {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] scheduler_host_manager = manila.scheduler.host_manager.HostManager {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] scheduler_json_config_location = {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] scheduler_manager = manila.scheduler.manager.SchedulerManager {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] scheduler_max_attempts = 3 {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] scheduler_topic = manila-scheduler {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] service_down_time = 60 {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] share_api_class = manila.share.api.API {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] share_backend_name = None {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] share_backup_name_template = share-backup-%s {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] share_manager = manila.share.manager.ShareManager {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] share_mount_template = mount -vt %(proto)s %(options)s %(export)s %(path)s {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] share_name_template = share-%s {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] share_snapshot_name_template = share-snapshot-%s {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] share_topic = manila-share {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] share_unmount_template = umount -v %(path)s {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] soft_deleted_share_retention_time = 604800 {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] ssh_conn_timeout = 60 {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] ssh_max_pool_conn = 10 {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] ssh_min_pool_conn = 1 {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] state_path = /opt/stack/data/manila {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] storage_availability_zone = nova {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] syslog_log_facility = LOG_USER {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] transfer_retention_time = 300 {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] transport_url = **** {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] use_eventlog = False {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] use_journal = False {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] use_json = False {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] use_scheduler_creating_share_from_snapshot = False {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] use_stderr = False {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] use_syslog = False {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] watch_log_file = False {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] oslo_concurrency.disable_process_locking = False {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] oslo_concurrency.lock_path = /opt/stack/manila/manila_locks {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] oslo_messaging_metrics.metrics_process_name = {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] oslo_policy.enforce_new_defaults = False {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] oslo_policy.enforce_scope = False {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] oslo_policy.policy_default_rule = default {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] oslo_policy.policy_file = policy.yaml {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] coordination.backend_url = **** {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] database.backend = sqlalchemy {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] database.connection = **** {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] database.connection_debug = 0 {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] database.connection_parameters = {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] database.connection_recycle_time = 3600 {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] database.connection_trace = False {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] database.db_inc_retry_interval = True {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] database.db_max_retries = 20 {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] database.db_max_retry_interval = 10 {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] database.db_retry_interval = 1 {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] database.max_overflow = 50 {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] database.max_pool_size = 40 {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] database.max_retries = 10 {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] database.mysql_sql_mode = TRADITIONAL {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] database.mysql_wsrep_sync_wait = None {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] database.pool_timeout = None {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] database.retry_interval = 10 {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] database.slave_connection = **** {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] database.sqlite_synchronous = True {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] database.use_db_reconnect = False {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] profiler.connection_string = messaging:// {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] profiler.enabled = False {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] profiler.es_doc_type = notification {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] profiler.es_scroll_size = 10000 {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] profiler.es_scroll_time = 2m {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] profiler.filter_error_trace = False {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] profiler.hmac_keys = **** {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] profiler.sentinel_service_name = mymaster {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] profiler.socket_timeout = 0.1 {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] profiler.trace_requests = False {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] profiler.trace_sqlalchemy = False {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] profiler_jaeger.process_tags = {} {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] profiler_jaeger.service_name_prefix = None {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] profiler_otlp.service_name_prefix = None {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] oslo_reports.file_event_handler = None {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] oslo_reports.file_event_handler_interval = 1 {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] oslo_reports.log_dir = None {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] oslo_messaging_rabbit.hostname = l75lg1-v1 {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] oslo_messaging_rabbit.processname = manila-scheduler {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] oslo_messaging_rabbit.ssl = False {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] oslo_messaging_rabbit.ssl_version = {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] oslo_messaging_rabbit.use_queue_manager = False {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] oslo_messaging_notifications.driver = [] {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] oslo_messaging_notifications.retry = -1 {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] oslo_messaging_notifications.transport_url = **** {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] quota.backup_gigabytes = 1000 {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] quota.backups = 10 {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] quota.driver = manila.quota.DbQuotaDriver {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] quota.gigabytes = 1000 {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] quota.max_age = 0 {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] quota.per_share_gigabytes = -1 {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] quota.replica_gigabytes = 1000 {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] quota.reservation_expire = 86400 {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] quota.share_group_snapshots = 50 {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] quota.share_groups = 50 {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] quota.share_networks = 10 {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] quota.share_replicas = 100 {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] quota.shares = 50 {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] quota.snapshot_gigabytes = 1000 {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] quota.snapshots = 50 {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] quota.until_refresh = 0 {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] netapp_active_iq.aiq_eval_method = 0 {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] netapp_active_iq.aiq_hostname = None {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] netapp_active_iq.aiq_password = **** {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] netapp_active_iq.aiq_port = None {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] netapp_active_iq.aiq_priority_order = ['ops', 'latency', 'volume_count', 'size'] {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] netapp_active_iq.aiq_ssl_cert_path = None {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] netapp_active_iq.aiq_ssl_verify = False {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] netapp_active_iq.aiq_transport_type = https {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] netapp_active_iq.aiq_username = None {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [-] ******************************************************************************** {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2624}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] Full set of CONF: {{(pid=98327) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:363}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2600}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] Configuration options gathered from: {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2601}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] command line args: ['--config-file', '/etc/manila/manila.conf'] {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] config files: ['/etc/manila/manila.conf'] {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2603}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] ================================================================================ {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2605}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] admin_network_config_group = None {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] admin_only_metadata = ['__affinity_same_host', '__affinity_different_host'] {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] api_rate_limit = True {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] auth_strategy = keystone {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] backdoor_port = None {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] backdoor_socket = None {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] backend_availability_zone = None {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] capacity_weight_multiplier = 1.0 {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] cleanup_interval = 1800 {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] config_dir = [] {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] config_file = ['/etc/manila/manila.conf'] {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] config_source = [] {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] control_exchange = openstack {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] data_manager = manila.data.manager.DataManager {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] data_topic = manila-data {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] db_backend = sqlalchemy {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] db_driver = manila.db {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] debug = True {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] default_share_group_type = default {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] default_share_type = default {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] driver_handles_share_servers = None {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] enable_new_services = True {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] enabled_share_backends = ['vast'] {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] enabled_share_protocols = ['NFS', 'CIFS'] {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] fatal_exception_format_errors = False {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] filter_function = None {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] ganesha_config_dir = /etc/ganesha {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] ganesha_config_path = /etc/ganesha/ganesha.conf {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] ganesha_db_path = /opt/stack/data/manila/manila-ganesha.db {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] ganesha_export_dir = /etc/ganesha/export.d {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] ganesha_export_template_dir = /etc/manila/ganesha-export-templ.d {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] ganesha_rados_export_counter = ganesha-export-counter {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] ganesha_rados_export_index = ganesha-export-index {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] ganesha_rados_store_enable = False {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] ganesha_rados_store_pool_name = None {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] ganesha_service_name = ganesha.nfsd {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] goodness_function = None {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] graceful_shutdown_timeout = 60 {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] host = l75lg1-v1 {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] instance_format = [instance: %(uuid)s] {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] is_deferred_deletion_enabled = False {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] log_config_append = None {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] log_dir = None {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] log_file = None {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] log_options = True {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] log_rotate_interval = 1 {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] log_rotate_interval_type = days {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] log_rotation_type = none {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] max_logfile_count = 30 {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] max_logfile_size_mb = 200 {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] max_over_subscription_ratio = 20.0 {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] max_share_server_size = -1 {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] max_shares_per_share_server = -1 {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] message_reap_interval = 86400 {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] message_ttl = 2592000 {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] migration_ignore_files = ['lost+found'] {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] monkey_patch = False {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] monkey_patch_modules = [] {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] my_ip = 10.27.203.238 {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] network_config_group = None {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] num_shell_tries = 3 {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] osapi_max_limit = 1000 {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] osapi_share_base_URL = None {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] osapi_share_ext_list = [] {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] osapi_share_extension = ['manila.api.contrib.standard_extensions'] {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] osapi_share_listen = :: {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] osapi_share_listen_port = 8786 {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] osapi_share_use_ssl = False {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] osapi_share_workers = 1 {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] periodic_fuzzy_delay = 60 {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] periodic_interval = 60 {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] pool_weight_multiplier = 1.0 {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] project_id_regex = [0-9a-f\-]+ {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] protocol_access_mapping = {'ip': ['nfs'], 'user': ['cifs']} {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] publish_errors = False {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] rate_limit_burst = 0 {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] rate_limit_except_level = CRITICAL {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] rate_limit_interval = 0 {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] replication_domain = None {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] report_interval = 10 {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] reserved_share_extend_percentage = 0 {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] reserved_share_from_snapshot_percentage = 0 {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] reserved_share_percentage = 0 {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] rootwrap_config = /etc/manila/rootwrap.conf {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] rpc_response_timeout = 60 {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] run_external_periodic_tasks = True {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] scheduler_default_extend_filters = ['CapacityFilter', 'DriverFilter'] {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] scheduler_default_filters = ['OnlyHostFilter', 'AvailabilityZoneFilter', 'CapacityFilter', 'CapabilitiesFilter', 'DriverFilter', 'ShareReplicationFilter', 'CreateFromSnapshotFilter', 'AffinityFilter', 'AntiAffinityFilter'] {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] scheduler_default_share_group_filters = ['AvailabilityZoneFilter', 'ConsistentSnapshotFilter'] {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] scheduler_default_weighers = ['CapacityWeigher', 'GoodnessWeigher', 'HostAffinityWeigher'] {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] scheduler_driver = manila.scheduler.drivers.filter.FilterScheduler {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] scheduler_host_manager = manila.scheduler.host_manager.HostManager {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] scheduler_json_config_location = {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] scheduler_manager = manila.scheduler.manager.SchedulerManager {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] scheduler_max_attempts = 3 {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] scheduler_topic = manila-scheduler {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] service_down_time = 60 {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] share_api_class = manila.share.api.API {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] share_backend_name = None {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] share_backup_name_template = share-backup-%s {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] share_manager = manila.share.manager.ShareManager {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] share_mount_template = mount -vt %(proto)s %(options)s %(export)s %(path)s {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] share_name_template = share-%s {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] share_snapshot_name_template = share-snapshot-%s {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] share_topic = manila-share {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] share_unmount_template = umount -v %(path)s {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] soft_deleted_share_retention_time = 604800 {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] ssh_conn_timeout = 60 {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] ssh_max_pool_conn = 10 {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] ssh_min_pool_conn = 1 {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] state_path = /opt/stack/data/manila {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] storage_availability_zone = nova {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] syslog_log_facility = LOG_USER {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] transfer_retention_time = 300 {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] transport_url = **** {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] use_eventlog = False {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] use_journal = False {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] use_json = False {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] use_scheduler_creating_share_from_snapshot = False {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] use_stderr = False {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] use_syslog = False {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] watch_log_file = False {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] oslo_concurrency.disable_process_locking = False {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] oslo_concurrency.lock_path = /opt/stack/manila/manila_locks {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_process_name = {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] oslo_policy.enforce_new_defaults = False {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] oslo_policy.enforce_scope = False {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] oslo_policy.policy_default_rule = default {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] oslo_policy.policy_file = policy.yaml {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] coordination.backend_url = **** {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] database.backend = sqlalchemy {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] database.connection = **** {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] database.connection_debug = 0 {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] database.connection_parameters = {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] database.connection_recycle_time = 3600 {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] database.connection_trace = False {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] database.db_inc_retry_interval = True {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] database.db_max_retries = 20 {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] database.db_max_retry_interval = 10 {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] database.db_retry_interval = 1 {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] database.max_overflow = 50 {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] database.max_pool_size = 40 {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] database.max_retries = 10 {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] database.mysql_sql_mode = TRADITIONAL {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] database.mysql_wsrep_sync_wait = None {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] database.pool_timeout = None {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] database.retry_interval = 10 {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] database.slave_connection = **** {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] database.sqlite_synchronous = True {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] database.use_db_reconnect = False {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] profiler.connection_string = messaging:// {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] profiler.enabled = False {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] profiler.es_doc_type = notification {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] profiler.es_scroll_size = 10000 {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] profiler.es_scroll_time = 2m {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] profiler.filter_error_trace = False {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] profiler.hmac_keys = **** {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] profiler.sentinel_service_name = mymaster {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] profiler.socket_timeout = 0.1 {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] profiler.trace_requests = False {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] profiler.trace_sqlalchemy = False {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] profiler_jaeger.process_tags = {} {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] profiler_jaeger.service_name_prefix = None {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] profiler_otlp.service_name_prefix = None {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] oslo_reports.file_event_handler = None {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] oslo_reports.file_event_handler_interval = 1 {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] oslo_reports.log_dir = None {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.hostname = l75lg1-v1 {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.processname = manila-scheduler {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl = False {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_version = {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.use_queue_manager = False {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] oslo_messaging_notifications.driver = [] {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] oslo_messaging_notifications.retry = -1 {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] oslo_messaging_notifications.transport_url = **** {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] quota.backup_gigabytes = 1000 {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] quota.backups = 10 {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] quota.driver = manila.quota.DbQuotaDriver {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] quota.gigabytes = 1000 {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] quota.max_age = 0 {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] quota.per_share_gigabytes = -1 {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] quota.replica_gigabytes = 1000 {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] quota.reservation_expire = 86400 {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] quota.share_group_snapshots = 50 {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] quota.share_groups = 50 {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] quota.share_networks = 10 {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] quota.share_replicas = 100 {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] quota.shares = 50 {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] quota.snapshot_gigabytes = 1000 {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] quota.snapshots = 50 {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] quota.until_refresh = 0 {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] netapp_active_iq.aiq_eval_method = 0 {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] netapp_active_iq.aiq_hostname = None {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] netapp_active_iq.aiq_password = **** {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] netapp_active_iq.aiq_port = None {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] netapp_active_iq.aiq_priority_order = ['ops', 'latency', 'volume_count', 'size'] {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] netapp_active_iq.aiq_ssl_cert_path = None {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] netapp_active_iq.aiq_ssl_verify = False {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] netapp_active_iq.aiq_transport_type = https {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] netapp_active_iq.aiq_username = None {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=98327) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2624}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: INFO manila.service [-] Starting manila-scheduler node (version 18.1.0) May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_db.api [None req-48cd7331-f674-4f74-a622-62655141ecee None None] Loading backend 'sqlalchemy' from 'manila.db.sqlalchemy.api' {{(pid=98327) _load_backend /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/api.py:259}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.wsgi.wsgi [-] ******************************************************************************** {{(pid=98330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2600}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.wsgi.wsgi [-] Configuration options gathered from: {{(pid=98330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2601}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.wsgi.wsgi [-] command line args: [] {{(pid=98330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.wsgi.wsgi [-] config files: ['/etc/manila/manila.conf'] {{(pid=98330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2603}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.wsgi.wsgi [-] ================================================================================ {{(pid=98330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2605}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.wsgi.wsgi [-] admin_only_metadata = ['__affinity_same_host', '__affinity_different_host'] {{(pid=98330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.wsgi.wsgi [-] api_rate_limit = True {{(pid=98330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.wsgi.wsgi [-] auth_strategy = keystone {{(pid=98330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.wsgi.wsgi [-] cleanup_interval = 1800 {{(pid=98330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.wsgi.wsgi [-] config_dir = [] {{(pid=98330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.wsgi.wsgi [-] config_file = ['/etc/manila/manila.conf'] {{(pid=98330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.wsgi.wsgi [-] config_source = [] {{(pid=98330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.wsgi.wsgi [-] data_manager = manila.data.manager.DataManager {{(pid=98330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.wsgi.wsgi [-] data_topic = manila-data {{(pid=98330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.wsgi.wsgi [-] db_backend = sqlalchemy {{(pid=98330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.wsgi.wsgi [-] debug = True {{(pid=98330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.wsgi.wsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=98330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.wsgi.wsgi [-] default_share_group_type = default {{(pid=98330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.wsgi.wsgi [-] default_share_type = default {{(pid=98330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.wsgi.wsgi [-] enable_new_services = True {{(pid=98330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.wsgi.wsgi [-] enabled_share_backends = ['vast'] {{(pid=98330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.wsgi.wsgi [-] enabled_share_protocols = ['NFS', 'CIFS'] {{(pid=98330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.wsgi.wsgi [-] fatal_exception_format_errors = False {{(pid=98330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.wsgi.wsgi [-] host = l75lg1-v1 {{(pid=98330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.wsgi.wsgi [-] instance_format = [instance: %(uuid)s] {{(pid=98330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.wsgi.wsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=98330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.wsgi.wsgi [-] log_config_append = None {{(pid=98330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.wsgi.wsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=98330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.wsgi.wsgi [-] log_dir = None {{(pid=98330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.wsgi.wsgi [-] log_file = None {{(pid=98330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.wsgi.wsgi [-] log_rotate_interval = 1 {{(pid=98330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.wsgi.wsgi [-] log_rotate_interval_type = days {{(pid=98330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.wsgi.wsgi [-] log_rotation_type = none {{(pid=98330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.wsgi.wsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=98330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.wsgi.wsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=98330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.wsgi.wsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=98330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.wsgi.wsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=98330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.wsgi.wsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=98330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.wsgi.wsgi [-] max_logfile_count = 30 {{(pid=98330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.wsgi.wsgi [-] max_logfile_size_mb = 200 {{(pid=98330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.wsgi.wsgi [-] monkey_patch = False {{(pid=98330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.wsgi.wsgi [-] monkey_patch_modules = [] {{(pid=98330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.wsgi.wsgi [-] my_ip = 10.27.203.238 {{(pid=98330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.wsgi.wsgi [-] osapi_share_ext_list = [] {{(pid=98330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.wsgi.wsgi [-] osapi_share_extension = ['manila.api.contrib.standard_extensions'] {{(pid=98330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.wsgi.wsgi [-] osapi_share_listen = :: {{(pid=98330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 manila-data[98318]: INFO dbcounter [None req-39c34f51-e98b-453d-aa4f-07fda4596a3f None None] Registered counter for database manila May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.wsgi.wsgi [-] osapi_share_listen_port = 8786 {{(pid=98330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.wsgi.wsgi [-] osapi_share_use_ssl = False {{(pid=98330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.wsgi.wsgi [-] osapi_share_workers = 1 {{(pid=98330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.wsgi.wsgi [-] periodic_fuzzy_delay = 60 {{(pid=98330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.wsgi.wsgi [-] periodic_interval = 60 {{(pid=98330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.wsgi.wsgi [-] publish_errors = False {{(pid=98330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.wsgi.wsgi [-] rate_limit_burst = 0 {{(pid=98330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.wsgi.wsgi [-] rate_limit_except_level = CRITICAL {{(pid=98330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.wsgi.wsgi [-] rate_limit_interval = 0 {{(pid=98330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.wsgi.wsgi [-] report_interval = 10 {{(pid=98330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.wsgi.wsgi [-] rootwrap_config = /etc/manila/rootwrap.conf {{(pid=98330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.wsgi.wsgi [-] scheduler_manager = manila.scheduler.manager.SchedulerManager {{(pid=98330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.wsgi.wsgi [-] scheduler_topic = manila-scheduler {{(pid=98330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.wsgi.wsgi [-] service_down_time = 60 {{(pid=98330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.wsgi.wsgi [-] share_api_class = manila.share.api.API {{(pid=98330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.wsgi.wsgi [-] share_backup_name_template = share-backup-%s {{(pid=98330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.wsgi.wsgi [-] share_manager = manila.share.manager.ShareManager {{(pid=98330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.wsgi.wsgi [-] share_name_template = share-%s {{(pid=98330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.wsgi.wsgi [-] share_snapshot_name_template = share-snapshot-%s {{(pid=98330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.wsgi.wsgi [-] share_topic = manila-share {{(pid=98330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.wsgi.wsgi [-] soft_deleted_share_retention_time = 604800 {{(pid=98330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.wsgi.wsgi [-] state_path = /opt/stack/data/manila {{(pid=98330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.wsgi.wsgi [-] storage_availability_zone = nova {{(pid=98330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.wsgi.wsgi [-] syslog_log_facility = LOG_USER {{(pid=98330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.wsgi.wsgi [-] transfer_retention_time = 300 {{(pid=98330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.wsgi.wsgi [-] use_eventlog = False {{(pid=98330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.wsgi.wsgi [-] use_journal = False {{(pid=98330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.wsgi.wsgi [-] use_json = False {{(pid=98330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.wsgi.wsgi [-] use_stderr = False {{(pid=98330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.wsgi.wsgi [-] use_syslog = False {{(pid=98330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.wsgi.wsgi [-] watch_log_file = False {{(pid=98330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.wsgi.wsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=98330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.wsgi.wsgi [-] oslo_concurrency.lock_path = /opt/stack/manila/manila_locks {{(pid=98330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.wsgi.wsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=98330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.wsgi.wsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=98330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.wsgi.wsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=98330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.wsgi.wsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=98330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.wsgi.wsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=98330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.wsgi.wsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=98330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.wsgi.wsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=98330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.wsgi.wsgi [-] oslo_policy.enforce_scope = False {{(pid=98330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.wsgi.wsgi [-] oslo_policy.policy_default_rule = default {{(pid=98330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.wsgi.wsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=98330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.wsgi.wsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=98330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.wsgi.wsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=98330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.wsgi.wsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=98330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.wsgi.wsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=98330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.wsgi.wsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=98330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.wsgi.wsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=98330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.wsgi.wsgi [-] database.backend = sqlalchemy {{(pid=98330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.wsgi.wsgi [-] database.connection = **** {{(pid=98330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.wsgi.wsgi [-] database.connection_debug = 0 {{(pid=98330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.wsgi.wsgi [-] database.connection_parameters = {{(pid=98330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.wsgi.wsgi [-] database.connection_recycle_time = 3600 {{(pid=98330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.wsgi.wsgi [-] database.connection_trace = False {{(pid=98330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.wsgi.wsgi [-] database.db_inc_retry_interval = True {{(pid=98330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.wsgi.wsgi [-] database.db_max_retries = 20 {{(pid=98330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.wsgi.wsgi [-] database.db_max_retry_interval = 10 {{(pid=98330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.wsgi.wsgi [-] database.db_retry_interval = 1 {{(pid=98330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.wsgi.wsgi [-] database.max_overflow = 50 {{(pid=98330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.wsgi.wsgi [-] database.max_pool_size = 40 {{(pid=98330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.wsgi.wsgi [-] database.max_retries = 10 {{(pid=98330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.wsgi.wsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=98330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.wsgi.wsgi [-] database.mysql_wsrep_sync_wait = None {{(pid=98330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.wsgi.wsgi [-] database.pool_timeout = None {{(pid=98330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.wsgi.wsgi [-] database.retry_interval = 10 {{(pid=98330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.wsgi.wsgi [-] database.slave_connection = **** {{(pid=98330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.wsgi.wsgi [-] database.sqlite_synchronous = True {{(pid=98330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.wsgi.wsgi [-] database.use_db_reconnect = False {{(pid=98330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.wsgi.wsgi [-] coordination.backend_url = **** {{(pid=98330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.wsgi.wsgi [-] profiler.connection_string = messaging:// {{(pid=98330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.wsgi.wsgi [-] profiler.enabled = False {{(pid=98330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.wsgi.wsgi [-] profiler.es_doc_type = notification {{(pid=98330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.wsgi.wsgi [-] profiler.es_scroll_size = 10000 {{(pid=98330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.wsgi.wsgi [-] profiler.es_scroll_time = 2m {{(pid=98330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.wsgi.wsgi [-] profiler.filter_error_trace = False {{(pid=98330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.wsgi.wsgi [-] profiler.hmac_keys = **** {{(pid=98330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.wsgi.wsgi [-] profiler.sentinel_service_name = mymaster {{(pid=98330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.wsgi.wsgi [-] profiler.socket_timeout = 0.1 {{(pid=98330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.wsgi.wsgi [-] profiler.trace_requests = False {{(pid=98330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.wsgi.wsgi [-] profiler.trace_sqlalchemy = False {{(pid=98330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.wsgi.wsgi [-] profiler_jaeger.process_tags = {} {{(pid=98330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.wsgi.wsgi [-] profiler_jaeger.service_name_prefix = None {{(pid=98330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.wsgi.wsgi [-] profiler_otlp.service_name_prefix = None {{(pid=98330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.wsgi.wsgi [-] oslo_reports.file_event_handler = None {{(pid=98330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.wsgi.wsgi [-] oslo_reports.file_event_handler_interval = 1 {{(pid=98330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.wsgi.wsgi [-] oslo_reports.log_dir = None {{(pid=98330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.wsgi.wsgi [-] ******************************************************************************** {{(pid=98330) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2624}} May 28 12:56:11 l75lg1-v1 manila-data[98318]: DEBUG oslo_db.sqlalchemy.engines [None req-39c34f51-e98b-453d-aa4f-07fda4596a3f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=98318) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:342}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.wsgi.wsgi [-] ******************************************************************************** {{(pid=98329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2600}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.wsgi.wsgi [-] Configuration options gathered from: {{(pid=98329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2601}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.wsgi.wsgi [-] command line args: [] {{(pid=98329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.wsgi.wsgi [-] config files: ['/etc/manila/manila.conf'] {{(pid=98329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2603}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.wsgi.wsgi [-] ================================================================================ {{(pid=98329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2605}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.wsgi.wsgi [-] admin_only_metadata = ['__affinity_same_host', '__affinity_different_host'] {{(pid=98329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.wsgi.wsgi [-] api_rate_limit = True {{(pid=98329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.wsgi.wsgi [-] auth_strategy = keystone {{(pid=98329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.wsgi.wsgi [-] cleanup_interval = 1800 {{(pid=98329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.wsgi.wsgi [-] config_dir = [] {{(pid=98329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.wsgi.wsgi [-] config_file = ['/etc/manila/manila.conf'] {{(pid=98329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.wsgi.wsgi [-] config_source = [] {{(pid=98329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.wsgi.wsgi [-] data_manager = manila.data.manager.DataManager {{(pid=98329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.wsgi.wsgi [-] data_topic = manila-data {{(pid=98329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.wsgi.wsgi [-] db_backend = sqlalchemy {{(pid=98329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.wsgi.wsgi [-] debug = True {{(pid=98329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.wsgi.wsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=98329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.wsgi.wsgi [-] default_share_group_type = default {{(pid=98329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.wsgi.wsgi [-] default_share_type = default {{(pid=98329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.wsgi.wsgi [-] enable_new_services = True {{(pid=98329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.wsgi.wsgi [-] enabled_share_backends = ['vast'] {{(pid=98329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.wsgi.wsgi [-] enabled_share_protocols = ['NFS', 'CIFS'] {{(pid=98329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.wsgi.wsgi [-] fatal_exception_format_errors = False {{(pid=98329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.wsgi.wsgi [-] host = l75lg1-v1 {{(pid=98329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.wsgi.wsgi [-] instance_format = [instance: %(uuid)s] {{(pid=98329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.wsgi.wsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=98329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.wsgi.wsgi [-] log_config_append = None {{(pid=98329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.wsgi.wsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=98329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.wsgi.wsgi [-] log_dir = None {{(pid=98329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.wsgi.wsgi [-] log_file = None {{(pid=98329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.wsgi.wsgi [-] log_rotate_interval = 1 {{(pid=98329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.wsgi.wsgi [-] log_rotate_interval_type = days {{(pid=98329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.wsgi.wsgi [-] log_rotation_type = none {{(pid=98329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.wsgi.wsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=98329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.wsgi.wsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=98329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.wsgi.wsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=98329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.wsgi.wsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=98329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.wsgi.wsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=98329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.wsgi.wsgi [-] max_logfile_count = 30 {{(pid=98329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.wsgi.wsgi [-] max_logfile_size_mb = 200 {{(pid=98329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.wsgi.wsgi [-] monkey_patch = False {{(pid=98329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.wsgi.wsgi [-] monkey_patch_modules = [] {{(pid=98329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.wsgi.wsgi [-] my_ip = 10.27.203.238 {{(pid=98329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.wsgi.wsgi [-] osapi_share_ext_list = [] {{(pid=98329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.wsgi.wsgi [-] osapi_share_extension = ['manila.api.contrib.standard_extensions'] {{(pid=98329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.wsgi.wsgi [-] osapi_share_listen = :: {{(pid=98329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.wsgi.wsgi [-] osapi_share_listen_port = 8786 {{(pid=98329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.wsgi.wsgi [-] osapi_share_use_ssl = False {{(pid=98329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.wsgi.wsgi [-] osapi_share_workers = 1 {{(pid=98329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.wsgi.wsgi [-] periodic_fuzzy_delay = 60 {{(pid=98329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.wsgi.wsgi [-] periodic_interval = 60 {{(pid=98329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.wsgi.wsgi [-] publish_errors = False {{(pid=98329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.wsgi.wsgi [-] rate_limit_burst = 0 {{(pid=98329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.wsgi.wsgi [-] rate_limit_except_level = CRITICAL {{(pid=98329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.wsgi.wsgi [-] rate_limit_interval = 0 {{(pid=98329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.wsgi.wsgi [-] report_interval = 10 {{(pid=98329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.wsgi.wsgi [-] rootwrap_config = /etc/manila/rootwrap.conf {{(pid=98329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.wsgi.wsgi [-] scheduler_manager = manila.scheduler.manager.SchedulerManager {{(pid=98329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.wsgi.wsgi [-] scheduler_topic = manila-scheduler {{(pid=98329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.wsgi.wsgi [-] service_down_time = 60 {{(pid=98329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.wsgi.wsgi [-] share_api_class = manila.share.api.API {{(pid=98329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.wsgi.wsgi [-] share_backup_name_template = share-backup-%s {{(pid=98329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.wsgi.wsgi [-] share_manager = manila.share.manager.ShareManager {{(pid=98329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.wsgi.wsgi [-] share_name_template = share-%s {{(pid=98329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.wsgi.wsgi [-] share_snapshot_name_template = share-snapshot-%s {{(pid=98329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.wsgi.wsgi [-] share_topic = manila-share {{(pid=98329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.wsgi.wsgi [-] soft_deleted_share_retention_time = 604800 {{(pid=98329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.wsgi.wsgi [-] state_path = /opt/stack/data/manila {{(pid=98329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.wsgi.wsgi [-] storage_availability_zone = nova {{(pid=98329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.wsgi.wsgi [-] syslog_log_facility = LOG_USER {{(pid=98329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.wsgi.wsgi [-] transfer_retention_time = 300 {{(pid=98329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.wsgi.wsgi [-] use_eventlog = False {{(pid=98329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.wsgi.wsgi [-] use_journal = False {{(pid=98329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.wsgi.wsgi [-] use_json = False {{(pid=98329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.wsgi.wsgi [-] use_stderr = False {{(pid=98329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.wsgi.wsgi [-] use_syslog = False {{(pid=98329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.wsgi.wsgi [-] watch_log_file = False {{(pid=98329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.wsgi.wsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=98329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.wsgi.wsgi [-] oslo_concurrency.lock_path = /opt/stack/manila/manila_locks {{(pid=98329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.wsgi.wsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=98329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.wsgi.wsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=98329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.wsgi.wsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=98329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.wsgi.wsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=98329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.wsgi.wsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=98329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.wsgi.wsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=98329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.wsgi.wsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=98329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.wsgi.wsgi [-] oslo_policy.enforce_scope = False {{(pid=98329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.wsgi.wsgi [-] oslo_policy.policy_default_rule = default {{(pid=98329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.wsgi.wsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=98329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.wsgi.wsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=98329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.wsgi.wsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=98329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.wsgi.wsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=98329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.wsgi.wsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=98329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.wsgi.wsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=98329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.wsgi.wsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=98329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.wsgi.wsgi [-] database.backend = sqlalchemy {{(pid=98329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.wsgi.wsgi [-] database.connection = **** {{(pid=98329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.wsgi.wsgi [-] database.connection_debug = 0 {{(pid=98329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.wsgi.wsgi [-] database.connection_parameters = {{(pid=98329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.wsgi.wsgi [-] database.connection_recycle_time = 3600 {{(pid=98329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.wsgi.wsgi [-] database.connection_trace = False {{(pid=98329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.wsgi.wsgi [-] database.db_inc_retry_interval = True {{(pid=98329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.wsgi.wsgi [-] database.db_max_retries = 20 {{(pid=98329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.wsgi.wsgi [-] database.db_max_retry_interval = 10 {{(pid=98329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.wsgi.wsgi [-] database.db_retry_interval = 1 {{(pid=98329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.wsgi.wsgi [-] database.max_overflow = 50 {{(pid=98329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.wsgi.wsgi [-] database.max_pool_size = 40 {{(pid=98329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.wsgi.wsgi [-] database.max_retries = 10 {{(pid=98329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.wsgi.wsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=98329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.wsgi.wsgi [-] database.mysql_wsrep_sync_wait = None {{(pid=98329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.wsgi.wsgi [-] database.pool_timeout = None {{(pid=98329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.wsgi.wsgi [-] database.retry_interval = 10 {{(pid=98329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.wsgi.wsgi [-] database.slave_connection = **** {{(pid=98329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.wsgi.wsgi [-] database.sqlite_synchronous = True {{(pid=98329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.wsgi.wsgi [-] database.use_db_reconnect = False {{(pid=98329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.wsgi.wsgi [-] coordination.backend_url = **** {{(pid=98329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.wsgi.wsgi [-] profiler.connection_string = messaging:// {{(pid=98329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.wsgi.wsgi [-] profiler.enabled = False {{(pid=98329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.wsgi.wsgi [-] profiler.es_doc_type = notification {{(pid=98329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.wsgi.wsgi [-] profiler.es_scroll_size = 10000 {{(pid=98329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.wsgi.wsgi [-] profiler.es_scroll_time = 2m {{(pid=98329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.wsgi.wsgi [-] profiler.filter_error_trace = False {{(pid=98329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.wsgi.wsgi [-] profiler.hmac_keys = **** {{(pid=98329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.wsgi.wsgi [-] profiler.sentinel_service_name = mymaster {{(pid=98329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.wsgi.wsgi [-] profiler.socket_timeout = 0.1 {{(pid=98329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.wsgi.wsgi [-] profiler.trace_requests = False {{(pid=98329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.wsgi.wsgi [-] profiler.trace_sqlalchemy = False {{(pid=98329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.wsgi.wsgi [-] profiler_jaeger.process_tags = {} {{(pid=98329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.wsgi.wsgi [-] profiler_jaeger.service_name_prefix = None {{(pid=98329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.wsgi.wsgi [-] profiler_otlp.service_name_prefix = None {{(pid=98329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.wsgi.wsgi [-] oslo_reports.file_event_handler = None {{(pid=98329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.wsgi.wsgi [-] oslo_reports.file_event_handler_interval = 1 {{(pid=98329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.wsgi.wsgi [-] oslo_reports.log_dir = None {{(pid=98329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2620}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.wsgi.wsgi [-] ******************************************************************************** {{(pid=98329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2624}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo.service.wsgi [-] Loading app osapi_share from /etc/manila/api-paste.ini {{(pid=98330) load_app /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/wsgi.py:349}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.extensions [-] Initializing extension manager. May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.extensions [-] Loading extension manila.api.contrib.standard_extensions {{(pid=98330) load_extension /opt/stack/manila/manila/api/extensions.py:194}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.extensions [-] Calling extension factory manila.api.contrib.standard_extensions {{(pid=98330) load_extension /opt/stack/manila/manila/api/extensions.py:200}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack [-] Extended resource: extensions {{(pid=98330) _setup_ext_routes /opt/stack/manila/manila/api/openstack/__init__.py:130}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG passlib.utils.compat [None req-48cd7331-f674-4f74-a622-62655141ecee None None] loaded lazy attr 'SafeConfigParser': {{(pid=98327) __getattr__ /opt/stack/data/venv/lib/python3.10/site-packages/passlib/utils/compat/__init__.py:449}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG passlib.utils.compat [None req-48cd7331-f674-4f74-a622-62655141ecee None None] loaded lazy attr 'NativeStringIO': {{(pid=98327) __getattr__ /opt/stack/data/venv/lib/python3.10/site-packages/passlib/utils/compat/__init__.py:449}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG passlib.utils.compat [None req-48cd7331-f674-4f74-a622-62655141ecee None None] loaded lazy attr 'BytesIO': {{(pid=98327) __getattr__ /opt/stack/data/venv/lib/python3.10/site-packages/passlib/utils/compat/__init__.py:449}} May 28 12:56:11 l75lg1-v1 manila-share[98474]: INFO dbcounter [None req-0d0953db-ffb1-4877-9695-c201826f4008 None None] Registered counter for database manila May 28 12:56:11 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5a7cc4a-c961-4096-9a72-6d58c4bd4159]: (4, [{'family': 0, '__align': (), 'ifi_type': 1, 'index': 2, 'flags': 69699, 'change': 0, 'attrs': [['IFLA_IFNAME', 'tap9aaf4bd9-91'], ['IFLA_TXQLEN', 1000], ['IFLA_OPERSTATE', 'UP'], ['IFLA_LINKMODE', 0], ['IFLA_MTU', 1500], ['IFLA_MIN_MTU', 68], ['IFLA_MAX_MTU', 65535], ['IFLA_GROUP', 0], ['IFLA_PROMISCUITY', 0], ['IFLA_NUM_TX_QUEUES', 10], ['IFLA_GSO_MAX_SEGS', 65535], ['IFLA_GSO_MAX_SIZE', 65536], ['IFLA_NUM_RX_QUEUES', 10], ['IFLA_CARRIER', 1], ['IFLA_QDISC', 'noqueue'], ['IFLA_CARRIER_CHANGES', 2], ['IFLA_CARRIER_UP_COUNT', 1], ['IFLA_CARRIER_DOWN_COUNT', 1], ['IFLA_PROTO_DOWN', 0], ['IFLA_MAP', {'mem_start': 0, 'mem_end': 0, 'base_addr': 0, 'irq': 0, 'dma': 0, 'port': 0}], ['IFLA_ADDRESS', 'fa:16:3e:0e:5c:95'], ['IFLA_BROADCAST', 'ff:ff:ff:ff:ff:ff'], ['IFLA_STATS64', {'rx_packets': 2, 'tx_packets': 3, 'rx_bytes': 220, 'tx_bytes': 286, 'rx_errors': 0, 'tx_errors': 0, 'rx_dropped': 0, 'tx_dropped': 0, 'multicast': 0, 'collisions': 0, 'rx_length_errors': 0, 'rx_over_errors': 0, 'rx_crc_errors': 0, 'rx_frame_errors': 0, 'rx_fifo_errors': 0, 'rx_missed_errors': 0, 'tx_aborted_errors': 0, 'tx_carrier_errors': 0, 'tx_fifo_errors': 0, 'tx_heartbeat_errors': 0, 'tx_window_errors': 0, 'rx_compressed': 0, 'tx_compressed': 0}], ['IFLA_STATS', {'rx_packets': 2, 'tx_packets': 3, 'rx_bytes': 220, 'tx_bytes': 286, 'rx_errors': 0, 'tx_errors': 0, 'rx_dropped': 0, 'tx_dropped': 0, 'multicast': 0, 'collisions': 0, 'rx_length_errors': 0, 'rx_over_errors': 0, 'rx_crc_errors': 0, 'rx_frame_errors': 0, 'rx_fifo_errors': 0, 'rx_missed_errors': 0, 'tx_aborted_errors': 0, 'tx_carrier_errors': 0, 'tx_fifo_errors': 0, 'tx_heartbeat_errors': 0, 'tx_window_errors': 0, 'rx_compressed': 0, 'tx_compressed': 0}], ['IFLA_XDP', {'attrs': [['IFLA_XDP_ATTACHED', None]]}], ['IFLA_LINKINFO', {'attrs': [['IFLA_INFO_KIND', 'veth']]}], ['IFLA_LINK_NETNSID', 0], ['IFLA_LINK', 12], ['IFLA_AF_SPEC', {'attrs': [['AF_INET', {'dummy': 65668, 'forwarding': 1, 'mc_forwarding': 0, 'proxy_arp': 0, 'accept_redirects': 1, 'secure_redirects': 1, 'send_redirects': 1, 'shared_media': 1, 'rp_filter': 2, 'accept_source_route': 0, 'bootp_relay': 0, 'log_martians': 0, 'tag': 0, 'arpfilter': 0, 'medium_id': 0, 'noxfrm': 0, 'nopolicy': 0, 'force_igmp_version': 0, 'arp_announce': 0, 'arp_ignore': 0, 'promote_secondaries': 1, 'arp_accept': 0, 'arp_notify': 0, 'accept_local': 0, 'src_vmark': 0, 'proxy_arp_pvlan': 0, 'route_localnet': 0, 'igmpv2_unsolicited_report_interval': 10000, 'igmpv3_unsolicited_report_interval': 1000}], ['AF_INET6', {'attrs': [['IFLA_INET6_FLAGS', 2147483648], ['IFLA_INET6_CACHEINFO', {'max_reasm_len': 65535, 'tstamp': 310169, 'reachable_time': 38132, 'retrans_time': 1000}], ['IFLA_INET6_CONF', {'forwarding': 0, 'hop_limit': 64, 'mtu': 1500, 'accept_ra': 1, 'accept_redirects': 1, 'autoconf': 1, 'dad_transmits': 1, 'router_solicitations': 4294967295, 'router_solicitation_interval': 4000, 'router_solicitation_delay': 1000, 'use_tempaddr': 0, 'temp_valid_lft': 604800, 'temp_preferred_lft': 86400, 'regen_max_retry': 3, 'max_desync_factor': 600, 'max_addresses': 16, 'force_mld_version': 0, 'accept_ra_defrtr': 1, 'accept_ra_pinfo': 1, 'accept_ra_rtr_pref': 1, 'router_probe_interval': 60000, 'accept_ra_rt_info_max_plen': 0, 'proxy_ndp': 0, 'optimistic_dad': 0, 'accept_source_route': 0, 'mc_forwarding': 0, 'disable_ipv6': 0, 'accept_dad': 1, 'force_tllao': 0, 'ndisc_notify': 0}], ['IFLA_INET6_STATS', {'num': 37, 'inpkts': 2, 'inoctets': 192, 'indelivers': 0, 'outforwdatagrams': 0, 'outpkts': 3, 'outoctets': 244, 'inhdrerrors': 0, 'intoobigerrors': 0, 'innoroutes': 0, 'inaddrerrors': 0, 'inunknownprotos': 0, 'intruncatedpkts': 0, 'indiscards': 0, 'outdiscards': 0, 'outnoroutes': 0, 'reasmtimeout': 0, 'reasmreqds': 0, 'reasmoks': 0, 'reasmfails': 0, 'fragoks': 0, 'fragfails': 0, 'fragcreates': 0, 'inmcastpkts': 2, 'outmcastpkts': 3, 'inbcastpkts': 0, 'outbcastpkts': 0, 'inmcastoctets': 192, 'outmcastoctets': 244, 'inbcastoctets': 0, 'outbcastoctets': 0, 'csumerrors': 0, 'noectpkts': 2, 'ect1pkts': 0, 'ect0pkts': 0, 'cepkts': 0}], ['IFLA_INET6_ICMP6STATS', {'num': 6, 'inmsgs': 0, 'inerrors': 0, 'outmsgs': 3, 'outerrors': 0, 'csumerrors': 0}], ['IFLA_INET6_TOKEN', '::'], ['IFLA_INET6_ADDR_GEN_MODE', 0]]}]]}]], 'header': {'length': 1380, 'type': 16, 'flags': 2, 'sequence_number': 255, 'pid': 98485, 'error': None, 'target': 'ovnmeta-9aaf4bd9-9f34-40ad-a4e7-932bff23895a', 'stats': (0, 0, 0)}, 'state': 'up', 'event': 'RTM_NEWLINK'}]) {{(pid=79043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98329]: DEBUG oslo.service.wsgi [-] Loading app osapi_share from /etc/manila/api-paste.ini {{(pid=98329) load_app /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/wsgi.py:349}} May 28 12:56:11 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b2ad272-039e-40da-888b-d729089c55bb]: (4, ({'family': 10, 'prefixlen': 128, 'flags': 192, 'scope': 253, 'index': 2, 'attrs': [['IFA_ADDRESS', 'fe80::a9fe:a9fe'], ['IFA_CACHEINFO', {'ifa_preferred': 4294967295, 'ifa_valid': 4294967295, 'cstamp': 310178, 'tstamp': 310178}], ['IFA_FLAGS', 192]], 'header': {'length': 72, 'type': 20, 'flags': 2, 'sequence_number': 255, 'pid': 98486, 'error': None, 'target': 'ovnmeta-9aaf4bd9-9f34-40ad-a4e7-932bff23895a', 'stats': (0, 0, 0)}, 'event': 'RTM_NEWADDR'},)) {{(pid=79043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} May 28 12:56:11 l75lg1-v1 manila-share[98474]: DEBUG oslo_db.sqlalchemy.engines [None req-0d0953db-ffb1-4877-9695-c201826f4008 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=98474) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:342}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.extensions [-] Initializing extension manager. May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.extensions [-] Loading extension manila.api.contrib.standard_extensions {{(pid=98329) load_extension /opt/stack/manila/manila/api/extensions.py:194}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.extensions [-] Calling extension factory manila.api.contrib.standard_extensions {{(pid=98329) load_extension /opt/stack/manila/manila/api/extensions.py:200}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack [-] Extended resource: extensions {{(pid=98329) _setup_ext_routes /opt/stack/manila/manila/api/openstack/__init__.py:130}} May 28 12:56:11 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo.privsep.daemon [-] privsep: reply[7014e428-2ca8-4183-8a9f-bba1d2deb38f]: (4, [{'family': 0, '__align': (), 'ifi_type': 1, 'index': 2, 'flags': 69699, 'change': 0, 'attrs': [['IFLA_IFNAME', 'tap9aaf4bd9-91'], ['IFLA_TXQLEN', 1000], ['IFLA_OPERSTATE', 'UP'], ['IFLA_LINKMODE', 0], ['IFLA_MTU', 1500], ['IFLA_MIN_MTU', 68], ['IFLA_MAX_MTU', 65535], ['IFLA_GROUP', 0], ['IFLA_PROMISCUITY', 0], ['IFLA_NUM_TX_QUEUES', 10], ['IFLA_GSO_MAX_SEGS', 65535], ['IFLA_GSO_MAX_SIZE', 65536], ['IFLA_NUM_RX_QUEUES', 10], ['IFLA_CARRIER', 1], ['IFLA_QDISC', 'noqueue'], ['IFLA_CARRIER_CHANGES', 2], ['IFLA_CARRIER_UP_COUNT', 1], ['IFLA_CARRIER_DOWN_COUNT', 1], ['IFLA_PROTO_DOWN', 0], ['IFLA_MAP', {'mem_start': 0, 'mem_end': 0, 'base_addr': 0, 'irq': 0, 'dma': 0, 'port': 0}], ['IFLA_ADDRESS', 'fa:16:3e:0e:5c:95'], ['IFLA_BROADCAST', 'ff:ff:ff:ff:ff:ff'], ['IFLA_STATS64', {'rx_packets': 2, 'tx_packets': 3, 'rx_bytes': 220, 'tx_bytes': 286, 'rx_errors': 0, 'tx_errors': 0, 'rx_dropped': 0, 'tx_dropped': 0, 'multicast': 0, 'collisions': 0, 'rx_length_errors': 0, 'rx_over_errors': 0, 'rx_crc_errors': 0, 'rx_frame_errors': 0, 'rx_fifo_errors': 0, 'rx_missed_errors': 0, 'tx_aborted_errors': 0, 'tx_carrier_errors': 0, 'tx_fifo_errors': 0, 'tx_heartbeat_errors': 0, 'tx_window_errors': 0, 'rx_compressed': 0, 'tx_compressed': 0}], ['IFLA_STATS', {'rx_packets': 2, 'tx_packets': 3, 'rx_bytes': 220, 'tx_bytes': 286, 'rx_errors': 0, 'tx_errors': 0, 'rx_dropped': 0, 'tx_dropped': 0, 'multicast': 0, 'collisions': 0, 'rx_length_errors': 0, 'rx_over_errors': 0, 'rx_crc_errors': 0, 'rx_frame_errors': 0, 'rx_fifo_errors': 0, 'rx_missed_errors': 0, 'tx_aborted_errors': 0, 'tx_carrier_errors': 0, 'tx_fifo_errors': 0, 'tx_heartbeat_errors': 0, 'tx_window_errors': 0, 'rx_compressed': 0, 'tx_compressed': 0}], ['IFLA_XDP', {'attrs': [['IFLA_XDP_ATTACHED', None]]}], ['IFLA_LINKINFO', {'attrs': [['IFLA_INFO_KIND', 'veth']]}], ['IFLA_LINK_NETNSID', 0], ['IFLA_LINK', 12], ['IFLA_AF_SPEC', {'attrs': [['AF_INET', {'dummy': 65668, 'forwarding': 1, 'mc_forwarding': 0, 'proxy_arp': 0, 'accept_redirects': 1, 'secure_redirects': 1, 'send_redirects': 1, 'shared_media': 1, 'rp_filter': 2, 'accept_source_route': 0, 'bootp_relay': 0, 'log_martians': 0, 'tag': 0, 'arpfilter': 0, 'medium_id': 0, 'noxfrm': 0, 'nopolicy': 0, 'force_igmp_version': 0, 'arp_announce': 0, 'arp_ignore': 0, 'promote_secondaries': 1, 'arp_accept': 0, 'arp_notify': 0, 'accept_local': 0, 'src_vmark': 0, 'proxy_arp_pvlan': 0, 'route_localnet': 0, 'igmpv2_unsolicited_report_interval': 10000, 'igmpv3_unsolicited_report_interval': 1000}], ['AF_INET6', {'attrs': [['IFLA_INET6_FLAGS', 2147483648], ['IFLA_INET6_CACHEINFO', {'max_reasm_len': 65535, 'tstamp': 310169, 'reachable_time': 38132, 'retrans_time': 1000}], ['IFLA_INET6_CONF', {'forwarding': 0, 'hop_limit': 64, 'mtu': 1500, 'accept_ra': 1, 'accept_redirects': 1, 'autoconf': 1, 'dad_transmits': 1, 'router_solicitations': 4294967295, 'router_solicitation_interval': 4000, 'router_solicitation_delay': 1000, 'use_tempaddr': 0, 'temp_valid_lft': 604800, 'temp_preferred_lft': 86400, 'regen_max_retry': 3, 'max_desync_factor': 600, 'max_addresses': 16, 'force_mld_version': 0, 'accept_ra_defrtr': 1, 'accept_ra_pinfo': 1, 'accept_ra_rtr_pref': 1, 'router_probe_interval': 60000, 'accept_ra_rt_info_max_plen': 0, 'proxy_ndp': 0, 'optimistic_dad': 0, 'accept_source_route': 0, 'mc_forwarding': 0, 'disable_ipv6': 0, 'accept_dad': 1, 'force_tllao': 0, 'ndisc_notify': 0}], ['IFLA_INET6_STATS', {'num': 37, 'inpkts': 2, 'inoctets': 192, 'indelivers': 0, 'outforwdatagrams': 0, 'outpkts': 3, 'outoctets': 244, 'inhdrerrors': 0, 'intoobigerrors': 0, 'innoroutes': 0, 'inaddrerrors': 0, 'inunknownprotos': 0, 'intruncatedpkts': 0, 'indiscards': 0, 'outdiscards': 0, 'outnoroutes': 0, 'reasmtimeout': 0, 'reasmreqds': 0, 'reasmoks': 0, 'reasmfails': 0, 'fragoks': 0, 'fragfails': 0, 'fragcreates': 0, 'inmcastpkts': 2, 'outmcastpkts': 3, 'inbcastpkts': 0, 'outbcastpkts': 0, 'inmcastoctets': 192, 'outmcastoctets': 244, 'inbcastoctets': 0, 'outbcastoctets': 0, 'csumerrors': 0, 'noectpkts': 2, 'ect1pkts': 0, 'ect0pkts': 0, 'cepkts': 0}], ['IFLA_INET6_ICMP6STATS', {'num': 6, 'inmsgs': 0, 'inerrors': 0, 'outmsgs': 3, 'outerrors': 0, 'csumerrors': 0}], ['IFLA_INET6_TOKEN', '::'], ['IFLA_INET6_ADDR_GEN_MODE', 0]]}]]}]], 'header': {'length': 1380, 'type': 16, 'flags': 0, 'sequence_number': 255, 'pid': 98487, 'error': None, 'target': 'ovnmeta-9aaf4bd9-9f34-40ad-a4e7-932bff23895a', 'stats': (0, 0, 0)}, 'state': 'up', 'event': 'RTM_NEWLINK'}]) {{(pid=79043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} May 28 12:56:11 l75lg1-v1 manila-data[98318]: DEBUG dbcounter [-] [98318] Writer thread running {{(pid=98318) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} May 28 12:56:11 l75lg1-v1 manila-data[98318]: DEBUG manila.service [None req-39c34f51-e98b-453d-aa4f-07fda4596a3f None None] Creating RPC server for service manila-data. {{(pid=98318) start /opt/stack/manila/manila/service.py:159}} May 28 12:56:11 l75lg1-v1 manila-data[98318]: INFO oslo.messaging._drivers.impl_rabbit [None req-39c34f51-e98b-453d-aa4f-07fda4596a3f None None] Creating fanout queue: manila-data_fanout_f8bad68dfbdd41639c8bbbf2fdef641b May 28 12:56:11 l75lg1-v1 manila-share[98474]: DEBUG dbcounter [-] [98474] Writer thread running {{(pid=98474) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: INFO dbcounter [None req-48cd7331-f674-4f74-a622-62655141ecee None None] Registered counter for database manila May 28 12:56:11 l75lg1-v1 manila-share[98474]: DEBUG manila.share.manager [None req-0d0953db-ffb1-4877-9695-c201826f4008 None None] Start initialization of driver: 'VASTShareDriver@l75lg1-v1@vast' {{(pid=98474) _driver_setup /opt/stack/manila/manila/share/manager.py:369}} May 28 12:56:11 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_db.sqlalchemy.engines [None req-48cd7331-f674-4f74-a622-62655141ecee None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=98327) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:342}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.extensions [-] Initializing extension manager. May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.extensions [-] Loading extension manila.api.contrib.standard_extensions {{(pid=98330) load_extension /opt/stack/manila/manila/api/extensions.py:194}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.extensions [-] Calling extension factory manila.api.contrib.standard_extensions {{(pid=98330) load_extension /opt/stack/manila/manila/api/extensions.py:200}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack [-] Extended resource: extensions {{(pid=98330) _setup_ext_routes /opt/stack/manila/manila/api/openstack/__init__.py:130}} May 28 12:56:11 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo.privsep.daemon [-] privsep: reply[c64ea3c6-059b-4848-af05-d7f1ff2700f6]: (4, [{'family': 0, '__align': (), 'ifi_type': 1, 'index': 2, 'flags': 69699, 'change': 0, 'attrs': [['IFLA_IFNAME', 'tap9aaf4bd9-91'], ['IFLA_TXQLEN', 1000], ['IFLA_OPERSTATE', 'UP'], ['IFLA_LINKMODE', 0], ['IFLA_MTU', 1500], ['IFLA_MIN_MTU', 68], ['IFLA_MAX_MTU', 65535], ['IFLA_GROUP', 0], ['IFLA_PROMISCUITY', 0], ['IFLA_NUM_TX_QUEUES', 10], ['IFLA_GSO_MAX_SEGS', 65535], ['IFLA_GSO_MAX_SIZE', 65536], ['IFLA_NUM_RX_QUEUES', 10], ['IFLA_CARRIER', 1], ['IFLA_QDISC', 'noqueue'], ['IFLA_CARRIER_CHANGES', 2], ['IFLA_CARRIER_UP_COUNT', 1], ['IFLA_CARRIER_DOWN_COUNT', 1], ['IFLA_PROTO_DOWN', 0], ['IFLA_MAP', {'mem_start': 0, 'mem_end': 0, 'base_addr': 0, 'irq': 0, 'dma': 0, 'port': 0}], ['IFLA_ADDRESS', 'fa:16:3e:0e:5c:95'], ['IFLA_BROADCAST', 'ff:ff:ff:ff:ff:ff'], ['IFLA_STATS64', {'rx_packets': 3, 'tx_packets': 4, 'rx_bytes': 306, 'tx_bytes': 372, 'rx_errors': 0, 'tx_errors': 0, 'rx_dropped': 0, 'tx_dropped': 0, 'multicast': 0, 'collisions': 0, 'rx_length_errors': 0, 'rx_over_errors': 0, 'rx_crc_errors': 0, 'rx_frame_errors': 0, 'rx_fifo_errors': 0, 'rx_missed_errors': 0, 'tx_aborted_errors': 0, 'tx_carrier_errors': 0, 'tx_fifo_errors': 0, 'tx_heartbeat_errors': 0, 'tx_window_errors': 0, 'rx_compressed': 0, 'tx_compressed': 0}], ['IFLA_STATS', {'rx_packets': 3, 'tx_packets': 4, 'rx_bytes': 306, 'tx_bytes': 372, 'rx_errors': 0, 'tx_errors': 0, 'rx_dropped': 0, 'tx_dropped': 0, 'multicast': 0, 'collisions': 0, 'rx_length_errors': 0, 'rx_over_errors': 0, 'rx_crc_errors': 0, 'rx_frame_errors': 0, 'rx_fifo_errors': 0, 'rx_missed_errors': 0, 'tx_aborted_errors': 0, 'tx_carrier_errors': 0, 'tx_fifo_errors': 0, 'tx_heartbeat_errors': 0, 'tx_window_errors': 0, 'rx_compressed': 0, 'tx_compressed': 0}], ['IFLA_XDP', {'attrs': [['IFLA_XDP_ATTACHED', None]]}], ['IFLA_LINKINFO', {'attrs': [['IFLA_INFO_KIND', 'veth']]}], ['IFLA_LINK_NETNSID', 0], ['IFLA_LINK', 12], ['IFLA_AF_SPEC', {'attrs': [['AF_INET', {'dummy': 65668, 'forwarding': 1, 'mc_forwarding': 0, 'proxy_arp': 0, 'accept_redirects': 1, 'secure_redirects': 1, 'send_redirects': 1, 'shared_media': 1, 'rp_filter': 2, 'accept_source_route': 0, 'bootp_relay': 0, 'log_martians': 0, 'tag': 0, 'arpfilter': 0, 'medium_id': 0, 'noxfrm': 0, 'nopolicy': 0, 'force_igmp_version': 0, 'arp_announce': 0, 'arp_ignore': 0, 'promote_secondaries': 1, 'arp_accept': 0, 'arp_notify': 0, 'accept_local': 0, 'src_vmark': 0, 'proxy_arp_pvlan': 0, 'route_localnet': 0, 'igmpv2_unsolicited_report_interval': 10000, 'igmpv3_unsolicited_report_interval': 1000}], ['AF_INET6', {'attrs': [['IFLA_INET6_FLAGS', 2147483648], ['IFLA_INET6_CACHEINFO', {'max_reasm_len': 65535, 'tstamp': 310169, 'reachable_time': 38132, 'retrans_time': 1000}], ['IFLA_INET6_CONF', {'forwarding': 0, 'hop_limit': 64, 'mtu': 1500, 'accept_ra': 1, 'accept_redirects': 1, 'autoconf': 1, 'dad_transmits': 1, 'router_solicitations': 4294967295, 'router_solicitation_interval': 4000, 'router_solicitation_delay': 1000, 'use_tempaddr': 0, 'temp_valid_lft': 604800, 'temp_preferred_lft': 86400, 'regen_max_retry': 3, 'max_desync_factor': 600, 'max_addresses': 16, 'force_mld_version': 0, 'accept_ra_defrtr': 1, 'accept_ra_pinfo': 1, 'accept_ra_rtr_pref': 1, 'router_probe_interval': 60000, 'accept_ra_rt_info_max_plen': 0, 'proxy_ndp': 0, 'optimistic_dad': 0, 'accept_source_route': 0, 'mc_forwarding': 0, 'disable_ipv6': 0, 'accept_dad': 1, 'force_tllao': 0, 'ndisc_notify': 0}], ['IFLA_INET6_STATS', {'num': 37, 'inpkts': 3, 'inoctets': 264, 'indelivers': 0, 'outforwdatagrams': 0, 'outpkts': 4, 'outoctets': 316, 'inhdrerrors': 0, 'intoobigerrors': 0, 'innoroutes': 0, 'inaddrerrors': 0, 'inunknownprotos': 0, 'intruncatedpkts': 0, 'indiscards': 0, 'outdiscards': 0, 'outnoroutes': 0, 'reasmtimeout': 0, 'reasmreqds': 0, 'reasmoks': 0, 'reasmfails': 0, 'fragoks': 0, 'fragfails': 0, 'fragcreates': 0, 'inmcastpkts': 3, 'outmcastpkts': 4, 'inbcastpkts': 0, 'outbcastpkts': 0, 'inmcastoctets': 264, 'outmcastoctets': 316, 'inbcastoctets': 0, 'outbcastoctets': 0, 'csumerrors': 0, 'noectpkts': 3, 'ect1pkts': 0, 'ect0pkts': 0, 'cepkts': 0}], ['IFLA_INET6_ICMP6STATS', {'num': 6, 'inmsgs': 0, 'inerrors': 0, 'outmsgs': 4, 'outerrors': 0, 'csumerrors': 0}], ['IFLA_INET6_TOKEN', '::'], ['IFLA_INET6_ADDR_GEN_MODE', 0]]}]]}]], 'header': {'length': 1380, 'type': 16, 'flags': 2, 'sequence_number': 255, 'pid': 98488, 'error': None, 'target': 'ovnmeta-9aaf4bd9-9f34-40ad-a4e7-932bff23895a', 'stats': (0, 0, 0)}, 'state': 'up', 'event': 'RTM_NEWLINK'}]) {{(pid=79043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98330]: WARNING keystonemiddleware.auth_token [-] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 28 12:56:11 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo.privsep.daemon [-] privsep: reply[55db3a6a-5fdb-4899-852d-40f7f5394273]: (4, ({'family': 10, 'prefixlen': 128, 'flags': 192, 'scope': 253, 'index': 2, 'attrs': [['IFA_ADDRESS', 'fe80::a9fe:a9fe'], ['IFA_CACHEINFO', {'ifa_preferred': 4294967295, 'ifa_valid': 4294967295, 'cstamp': 310178, 'tstamp': 310178}], ['IFA_FLAGS', 192]], 'header': {'length': 72, 'type': 20, 'flags': 2, 'sequence_number': 255, 'pid': 98490, 'error': None, 'target': 'ovnmeta-9aaf4bd9-9f34-40ad-a4e7-932bff23895a', 'stats': (0, 0, 0)}, 'event': 'RTM_NEWADDR'},)) {{(pid=79043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98330]: WARNING keystonemiddleware.auth_token [-] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.extensions [-] Initializing extension manager. May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.extensions [-] Loading extension manila.api.contrib.standard_extensions {{(pid=98329) load_extension /opt/stack/manila/manila/api/extensions.py:194}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.extensions [-] Calling extension factory manila.api.contrib.standard_extensions {{(pid=98329) load_extension /opt/stack/manila/manila/api/extensions.py:200}} May 28 12:56:11 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e3aa62d-11c9-4560-af4b-a20e94a23f13]: (4, [{'family': 0, '__align': (), 'ifi_type': 1, 'index': 2, 'flags': 69699, 'change': 0, 'attrs': [['IFLA_IFNAME', 'tap9aaf4bd9-91'], ['IFLA_TXQLEN', 1000], ['IFLA_OPERSTATE', 'UP'], ['IFLA_LINKMODE', 0], ['IFLA_MTU', 1500], ['IFLA_MIN_MTU', 68], ['IFLA_MAX_MTU', 65535], ['IFLA_GROUP', 0], ['IFLA_PROMISCUITY', 0], ['IFLA_NUM_TX_QUEUES', 10], ['IFLA_GSO_MAX_SEGS', 65535], ['IFLA_GSO_MAX_SIZE', 65536], ['IFLA_NUM_RX_QUEUES', 10], ['IFLA_CARRIER', 1], ['IFLA_QDISC', 'noqueue'], ['IFLA_CARRIER_CHANGES', 2], ['IFLA_CARRIER_UP_COUNT', 1], ['IFLA_CARRIER_DOWN_COUNT', 1], ['IFLA_PROTO_DOWN', 0], ['IFLA_MAP', {'mem_start': 0, 'mem_end': 0, 'base_addr': 0, 'irq': 0, 'dma': 0, 'port': 0}], ['IFLA_ADDRESS', 'fa:16:3e:0e:5c:95'], ['IFLA_BROADCAST', 'ff:ff:ff:ff:ff:ff'], ['IFLA_STATS64', {'rx_packets': 3, 'tx_packets': 4, 'rx_bytes': 306, 'tx_bytes': 372, 'rx_errors': 0, 'tx_errors': 0, 'rx_dropped': 0, 'tx_dropped': 0, 'multicast': 0, 'collisions': 0, 'rx_length_errors': 0, 'rx_over_errors': 0, 'rx_crc_errors': 0, 'rx_frame_errors': 0, 'rx_fifo_errors': 0, 'rx_missed_errors': 0, 'tx_aborted_errors': 0, 'tx_carrier_errors': 0, 'tx_fifo_errors': 0, 'tx_heartbeat_errors': 0, 'tx_window_errors': 0, 'rx_compressed': 0, 'tx_compressed': 0}], ['IFLA_STATS', {'rx_packets': 3, 'tx_packets': 4, 'rx_bytes': 306, 'tx_bytes': 372, 'rx_errors': 0, 'tx_errors': 0, 'rx_dropped': 0, 'tx_dropped': 0, 'multicast': 0, 'collisions': 0, 'rx_length_errors': 0, 'rx_over_errors': 0, 'rx_crc_errors': 0, 'rx_frame_errors': 0, 'rx_fifo_errors': 0, 'rx_missed_errors': 0, 'tx_aborted_errors': 0, 'tx_carrier_errors': 0, 'tx_fifo_errors': 0, 'tx_heartbeat_errors': 0, 'tx_window_errors': 0, 'rx_compressed': 0, 'tx_compressed': 0}], ['IFLA_XDP', {'attrs': [['IFLA_XDP_ATTACHED', None]]}], ['IFLA_LINKINFO', {'attrs': [['IFLA_INFO_KIND', 'veth']]}], ['IFLA_LINK_NETNSID', 0], ['IFLA_LINK', 12], ['IFLA_AF_SPEC', {'attrs': [['AF_INET', {'dummy': 65668, 'forwarding': 1, 'mc_forwarding': 0, 'proxy_arp': 0, 'accept_redirects': 1, 'secure_redirects': 1, 'send_redirects': 1, 'shared_media': 1, 'rp_filter': 2, 'accept_source_route': 0, 'bootp_relay': 0, 'log_martians': 0, 'tag': 0, 'arpfilter': 0, 'medium_id': 0, 'noxfrm': 0, 'nopolicy': 0, 'force_igmp_version': 0, 'arp_announce': 0, 'arp_ignore': 0, 'promote_secondaries': 1, 'arp_accept': 0, 'arp_notify': 0, 'accept_local': 0, 'src_vmark': 0, 'proxy_arp_pvlan': 0, 'route_localnet': 0, 'igmpv2_unsolicited_report_interval': 10000, 'igmpv3_unsolicited_report_interval': 1000}], ['AF_INET6', {'attrs': [['IFLA_INET6_FLAGS', 2147483648], ['IFLA_INET6_CACHEINFO', {'max_reasm_len': 65535, 'tstamp': 310169, 'reachable_time': 38132, 'retrans_time': 1000}], ['IFLA_INET6_CONF', {'forwarding': 0, 'hop_limit': 64, 'mtu': 1500, 'accept_ra': 1, 'accept_redirects': 1, 'autoconf': 1, 'dad_transmits': 1, 'router_solicitations': 4294967295, 'router_solicitation_interval': 4000, 'router_solicitation_delay': 1000, 'use_tempaddr': 0, 'temp_valid_lft': 604800, 'temp_preferred_lft': 86400, 'regen_max_retry': 3, 'max_desync_factor': 600, 'max_addresses': 16, 'force_mld_version': 0, 'accept_ra_defrtr': 1, 'accept_ra_pinfo': 1, 'accept_ra_rtr_pref': 1, 'router_probe_interval': 60000, 'accept_ra_rt_info_max_plen': 0, 'proxy_ndp': 0, 'optimistic_dad': 0, 'accept_source_route': 0, 'mc_forwarding': 0, 'disable_ipv6': 0, 'accept_dad': 1, 'force_tllao': 0, 'ndisc_notify': 0}], ['IFLA_INET6_STATS', {'num': 37, 'inpkts': 3, 'inoctets': 264, 'indelivers': 0, 'outforwdatagrams': 0, 'outpkts': 4, 'outoctets': 316, 'inhdrerrors': 0, 'intoobigerrors': 0, 'innoroutes': 0, 'inaddrerrors': 0, 'inunknownprotos': 0, 'intruncatedpkts': 0, 'indiscards': 0, 'outdiscards': 0, 'outnoroutes': 0, 'reasmtimeout': 0, 'reasmreqds': 0, 'reasmoks': 0, 'reasmfails': 0, 'fragoks': 0, 'fragfails': 0, 'fragcreates': 0, 'inmcastpkts': 3, 'outmcastpkts': 4, 'inbcastpkts': 0, 'outbcastpkts': 0, 'inmcastoctets': 264, 'outmcastoctets': 316, 'inbcastoctets': 0, 'outbcastoctets': 0, 'csumerrors': 0, 'noectpkts': 3, 'ect1pkts': 0, 'ect0pkts': 0, 'cepkts': 0}], ['IFLA_INET6_ICMP6STATS', {'num': 6, 'inmsgs': 0, 'inerrors': 0, 'outmsgs': 4, 'outerrors': 0, 'csumerrors': 0}], ['IFLA_INET6_TOKEN', '::'], ['IFLA_INET6_ADDR_GEN_MODE', 0]]}]]}]], 'header': {'length': 1380, 'type': 16, 'flags': 0, 'sequence_number': 255, 'pid': 98491, 'error': None, 'target': 'ovnmeta-9aaf4bd9-9f34-40ad-a4e7-932bff23895a', 'stats': (0, 0, 0)}, 'state': 'up', 'event': 'RTM_NEWLINK'}]) {{(pid=79043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.extensions [-] Initializing extension manager. May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.extensions [-] Loading extension manila.api.contrib.standard_extensions {{(pid=98330) load_extension /opt/stack/manila/manila/api/extensions.py:194}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.extensions [-] Calling extension factory manila.api.contrib.standard_extensions {{(pid=98330) load_extension /opt/stack/manila/manila/api/extensions.py:200}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack [-] Extended resource: extensions {{(pid=98329) _setup_ext_routes /opt/stack/manila/manila/api/openstack/__init__.py:130}} May 28 12:56:11 l75lg1-v1 devstack@m-api.service[98329]: WARNING keystonemiddleware.auth_token [-] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 28 12:56:12 l75lg1-v1 devstack@m-api.service[98329]: WARNING keystonemiddleware.auth_token [-] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 28 12:56:12 l75lg1-v1 manila-scheduler[98327]: DEBUG dbcounter [-] [98327] Writer thread running {{(pid=98327) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} May 28 12:56:12 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.extensions [-] Initializing extension manager. May 28 12:56:12 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.extensions [-] Loading extension manila.api.contrib.standard_extensions {{(pid=98329) load_extension /opt/stack/manila/manila/api/extensions.py:194}} May 28 12:56:12 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.extensions [-] Calling extension factory manila.api.contrib.standard_extensions {{(pid=98329) load_extension /opt/stack/manila/manila/api/extensions.py:200}} May 28 12:56:12 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.service [None req-48cd7331-f674-4f74-a622-62655141ecee None None] Creating RPC server for service manila-scheduler. {{(pid=98327) start /opt/stack/manila/manila/service.py:159}} May 28 12:56:12 l75lg1-v1 manila-scheduler[98327]: INFO oslo.messaging._drivers.impl_rabbit [None req-48cd7331-f674-4f74-a622-62655141ecee None None] Creating fanout queue: manila-scheduler_fanout_1876c35b15d0405a85d083208ed6a35d May 28 12:56:12 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack [-] Extended resource: extensions {{(pid=98330) _setup_ext_routes /opt/stack/manila/manila/api/openstack/__init__.py:130}} May 28 12:56:12 l75lg1-v1 devstack@m-api.service[98330]: WARNING keystonemiddleware.auth_token [-] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 28 12:56:12 l75lg1-v1 devstack@m-api.service[98330]: WARNING keystonemiddleware.auth_token [-] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 28 12:56:12 l75lg1-v1 devstack@m-api.service[98330]: WSGI app 0 (mountpoint='') ready in 2 seconds on interpreter 0x55bf59851b70 pid: 98330 (default app) May 28 12:56:12 l75lg1-v1 manila-share[98474]: DEBUG manila.share.drivers.vastdata [None req-0d0953db-ffb1-4877-9695-c201826f4008 None None] setup complete {{(pid=98474) do_setup /opt/stack/manila/manila/share/drivers/vastdata/__init__.py:117}} May 28 12:56:12 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffbd5d0e-e4aa-49a2-82d0-7ad9c395cbd1]: (4, [{'family': 0, '__align': (), 'ifi_type': 1, 'index': 2, 'flags': 69699, 'change': 0, 'attrs': [['IFLA_IFNAME', 'tap9aaf4bd9-91'], ['IFLA_TXQLEN', 1000], ['IFLA_OPERSTATE', 'UP'], ['IFLA_LINKMODE', 0], ['IFLA_MTU', 1500], ['IFLA_MIN_MTU', 68], ['IFLA_MAX_MTU', 65535], ['IFLA_GROUP', 0], ['IFLA_PROMISCUITY', 0], ['IFLA_NUM_TX_QUEUES', 10], ['IFLA_GSO_MAX_SEGS', 65535], ['IFLA_GSO_MAX_SIZE', 65536], ['IFLA_NUM_RX_QUEUES', 10], ['IFLA_CARRIER', 1], ['IFLA_QDISC', 'noqueue'], ['IFLA_CARRIER_CHANGES', 2], ['IFLA_CARRIER_UP_COUNT', 1], ['IFLA_CARRIER_DOWN_COUNT', 1], ['IFLA_PROTO_DOWN', 0], ['IFLA_MAP', {'mem_start': 0, 'mem_end': 0, 'base_addr': 0, 'irq': 0, 'dma': 0, 'port': 0}], ['IFLA_ADDRESS', 'fa:16:3e:0e:5c:95'], ['IFLA_BROADCAST', 'ff:ff:ff:ff:ff:ff'], ['IFLA_STATS64', {'rx_packets': 3, 'tx_packets': 5, 'rx_bytes': 306, 'tx_bytes': 482, 'rx_errors': 0, 'tx_errors': 0, 'rx_dropped': 0, 'tx_dropped': 0, 'multicast': 0, 'collisions': 0, 'rx_length_errors': 0, 'rx_over_errors': 0, 'rx_crc_errors': 0, 'rx_frame_errors': 0, 'rx_fifo_errors': 0, 'rx_missed_errors': 0, 'tx_aborted_errors': 0, 'tx_carrier_errors': 0, 'tx_fifo_errors': 0, 'tx_heartbeat_errors': 0, 'tx_window_errors': 0, 'rx_compressed': 0, 'tx_compressed': 0}], ['IFLA_STATS', {'rx_packets': 3, 'tx_packets': 5, 'rx_bytes': 306, 'tx_bytes': 482, 'rx_errors': 0, 'tx_errors': 0, 'rx_dropped': 0, 'tx_dropped': 0, 'multicast': 0, 'collisions': 0, 'rx_length_errors': 0, 'rx_over_errors': 0, 'rx_crc_errors': 0, 'rx_frame_errors': 0, 'rx_fifo_errors': 0, 'rx_missed_errors': 0, 'tx_aborted_errors': 0, 'tx_carrier_errors': 0, 'tx_fifo_errors': 0, 'tx_heartbeat_errors': 0, 'tx_window_errors': 0, 'rx_compressed': 0, 'tx_compressed': 0}], ['IFLA_XDP', {'attrs': [['IFLA_XDP_ATTACHED', None]]}], ['IFLA_LINKINFO', {'attrs': [['IFLA_INFO_KIND', 'veth']]}], ['IFLA_LINK_NETNSID', 0], ['IFLA_LINK', 12], ['IFLA_AF_SPEC', {'attrs': [['AF_INET', {'dummy': 65668, 'forwarding': 1, 'mc_forwarding': 0, 'proxy_arp': 0, 'accept_redirects': 1, 'secure_redirects': 1, 'send_redirects': 1, 'shared_media': 1, 'rp_filter': 2, 'accept_source_route': 0, 'bootp_relay': 0, 'log_martians': 0, 'tag': 0, 'arpfilter': 0, 'medium_id': 0, 'noxfrm': 0, 'nopolicy': 0, 'force_igmp_version': 0, 'arp_announce': 0, 'arp_ignore': 0, 'promote_secondaries': 1, 'arp_accept': 0, 'arp_notify': 0, 'accept_local': 0, 'src_vmark': 0, 'proxy_arp_pvlan': 0, 'route_localnet': 0, 'igmpv2_unsolicited_report_interval': 10000, 'igmpv3_unsolicited_report_interval': 1000}], ['AF_INET6', {'attrs': [['IFLA_INET6_FLAGS', 2147483648], ['IFLA_INET6_CACHEINFO', {'max_reasm_len': 65535, 'tstamp': 310169, 'reachable_time': 38132, 'retrans_time': 1000}], ['IFLA_INET6_CONF', {'forwarding': 0, 'hop_limit': 64, 'mtu': 1500, 'accept_ra': 1, 'accept_redirects': 1, 'autoconf': 1, 'dad_transmits': 1, 'router_solicitations': 4294967295, 'router_solicitation_interval': 4000, 'router_solicitation_delay': 1000, 'use_tempaddr': 0, 'temp_valid_lft': 604800, 'temp_preferred_lft': 86400, 'regen_max_retry': 3, 'max_desync_factor': 600, 'max_addresses': 16, 'force_mld_version': 0, 'accept_ra_defrtr': 1, 'accept_ra_pinfo': 1, 'accept_ra_rtr_pref': 1, 'router_probe_interval': 60000, 'accept_ra_rt_info_max_plen': 0, 'proxy_ndp': 0, 'optimistic_dad': 0, 'accept_source_route': 0, 'mc_forwarding': 0, 'disable_ipv6': 0, 'accept_dad': 1, 'force_tllao': 0, 'ndisc_notify': 0}], ['IFLA_INET6_STATS', {'num': 37, 'inpkts': 3, 'inoctets': 264, 'indelivers': 0, 'outforwdatagrams': 0, 'outpkts': 5, 'outoctets': 412, 'inhdrerrors': 0, 'intoobigerrors': 0, 'innoroutes': 0, 'inaddrerrors': 0, 'inunknownprotos': 0, 'intruncatedpkts': 0, 'indiscards': 0, 'outdiscards': 0, 'outnoroutes': 0, 'reasmtimeout': 0, 'reasmreqds': 0, 'reasmoks': 0, 'reasmfails': 0, 'fragoks': 0, 'fragfails': 0, 'fragcreates': 0, 'inmcastpkts': 3, 'outmcastpkts': 5, 'inbcastpkts': 0, 'outbcastpkts': 0, 'inmcastoctets': 264, 'outmcastoctets': 412, 'inbcastoctets': 0, 'outbcastoctets': 0, 'csumerrors': 0, 'noectpkts': 3, 'ect1pkts': 0, 'ect0pkts': 0, 'cepkts': 0}], ['IFLA_INET6_ICMP6STATS', {'num': 6, 'inmsgs': 0, 'inerrors': 0, 'outmsgs': 5, 'outerrors': 0, 'csumerrors': 0}], ['IFLA_INET6_TOKEN', '::'], ['IFLA_INET6_ADDR_GEN_MODE', 0]]}]]}]], 'header': {'length': 1380, 'type': 16, 'flags': 2, 'sequence_number': 255, 'pid': 98494, 'error': None, 'target': 'ovnmeta-9aaf4bd9-9f34-40ad-a4e7-932bff23895a', 'stats': (0, 0, 0)}, 'state': 'up', 'event': 'RTM_NEWLINK'}]) {{(pid=79043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} May 28 12:56:12 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack [-] Extended resource: extensions {{(pid=98329) _setup_ext_routes /opt/stack/manila/manila/api/openstack/__init__.py:130}} May 28 12:56:12 l75lg1-v1 manila-share[98474]: DEBUG manila.share.manager [None req-0d0953db-ffb1-4877-9695-c201826f4008 None None] The backend l75lg1-v1@vast does not support get backend info method. {{(pid=98474) ensure_driver_resources /opt/stack/manila/manila/share/manager.py:422}} May 28 12:56:12 l75lg1-v1 devstack@m-api.service[98329]: WARNING keystonemiddleware.auth_token [-] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 28 12:56:12 l75lg1-v1 devstack@m-api.service[98329]: WARNING keystonemiddleware.auth_token [-] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 28 12:56:12 l75lg1-v1 devstack@m-api.service[98329]: WSGI app 0 (mountpoint='') ready in 2 seconds on interpreter 0x55bf59851b70 pid: 98329 (default app) May 28 12:56:12 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bf68ba0-1fed-4d94-9a85-d4314131fe03]: (4, ({'family': 10, 'prefixlen': 128, 'flags': 192, 'scope': 253, 'index': 2, 'attrs': [['IFA_ADDRESS', 'fe80::a9fe:a9fe'], ['IFA_CACHEINFO', {'ifa_preferred': 4294967295, 'ifa_valid': 4294967295, 'cstamp': 310178, 'tstamp': 310178}], ['IFA_FLAGS', 192]], 'header': {'length': 72, 'type': 20, 'flags': 2, 'sequence_number': 255, 'pid': 98495, 'error': None, 'target': 'ovnmeta-9aaf4bd9-9f34-40ad-a4e7-932bff23895a', 'stats': (0, 0, 0)}, 'event': 'RTM_NEWADDR'},)) {{(pid=79043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} May 28 12:56:12 l75lg1-v1 manila-share[98474]: DEBUG manila.share.manager [None req-0d0953db-ffb1-4877-9695-c201826f4008 None None] Re-exporting 0 shares {{(pid=98474) ensure_driver_resources /opt/stack/manila/manila/share/manager.py:440}} May 28 12:56:12 l75lg1-v1 manila-share[98474]: INFO manila.share.manager [None req-0d0953db-ffb1-4877-9695-c201826f4008 None None] Updating share status May 28 12:56:12 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0d0953db-ffb1-4877-9695-c201826f4008 None None] >>> [GET] https://127.0.0.1:40443/api/monitors/ad_hoc_query/ May 28 12:56:12 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0d0953db-ffb1-4877-9695-c201826f4008 None None] {'allow_redirects': True, May 28 12:56:12 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0d0953db-ffb1-4877-9695-c201826f4008 None None] 'params': {'object_type': 'cluster', May 28 12:56:12 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0d0953db-ffb1-4877-9695-c201826f4008 None None] 'prop_list': ['Capacity,drr', May 28 12:56:12 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0d0953db-ffb1-4877-9695-c201826f4008 None None] 'Capacity,logical_space', May 28 12:56:12 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0d0953db-ffb1-4877-9695-c201826f4008 None None] 'Capacity,logical_space_in_use', May 28 12:56:12 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0d0953db-ffb1-4877-9695-c201826f4008 None None] 'Capacity,physical_space', May 28 12:56:12 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0d0953db-ffb1-4877-9695-c201826f4008 None None] 'Capacity,physical_space_in_use'], May 28 12:56:12 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0d0953db-ffb1-4877-9695-c201826f4008 None None] 'time_frame': '1m'}} May 28 12:56:12 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cfbd194-72a8-4dc4-9083-afdfb50d7ad1]: (4, [{'family': 0, '__align': (), 'ifi_type': 1, 'index': 2, 'flags': 69699, 'change': 0, 'attrs': [['IFLA_IFNAME', 'tap9aaf4bd9-91'], ['IFLA_TXQLEN', 1000], ['IFLA_OPERSTATE', 'UP'], ['IFLA_LINKMODE', 0], ['IFLA_MTU', 1500], ['IFLA_MIN_MTU', 68], ['IFLA_MAX_MTU', 65535], ['IFLA_GROUP', 0], ['IFLA_PROMISCUITY', 0], ['IFLA_NUM_TX_QUEUES', 10], ['IFLA_GSO_MAX_SEGS', 65535], ['IFLA_GSO_MAX_SIZE', 65536], ['IFLA_NUM_RX_QUEUES', 10], ['IFLA_CARRIER', 1], ['IFLA_QDISC', 'noqueue'], ['IFLA_CARRIER_CHANGES', 2], ['IFLA_CARRIER_UP_COUNT', 1], ['IFLA_CARRIER_DOWN_COUNT', 1], ['IFLA_PROTO_DOWN', 0], ['IFLA_MAP', {'mem_start': 0, 'mem_end': 0, 'base_addr': 0, 'irq': 0, 'dma': 0, 'port': 0}], ['IFLA_ADDRESS', 'fa:16:3e:0e:5c:95'], ['IFLA_BROADCAST', 'ff:ff:ff:ff:ff:ff'], ['IFLA_STATS64', {'rx_packets': 3, 'tx_packets': 5, 'rx_bytes': 306, 'tx_bytes': 482, 'rx_errors': 0, 'tx_errors': 0, 'rx_dropped': 0, 'tx_dropped': 0, 'multicast': 0, 'collisions': 0, 'rx_length_errors': 0, 'rx_over_errors': 0, 'rx_crc_errors': 0, 'rx_frame_errors': 0, 'rx_fifo_errors': 0, 'rx_missed_errors': 0, 'tx_aborted_errors': 0, 'tx_carrier_errors': 0, 'tx_fifo_errors': 0, 'tx_heartbeat_errors': 0, 'tx_window_errors': 0, 'rx_compressed': 0, 'tx_compressed': 0}], ['IFLA_STATS', {'rx_packets': 3, 'tx_packets': 5, 'rx_bytes': 306, 'tx_bytes': 482, 'rx_errors': 0, 'tx_errors': 0, 'rx_dropped': 0, 'tx_dropped': 0, 'multicast': 0, 'collisions': 0, 'rx_length_errors': 0, 'rx_over_errors': 0, 'rx_crc_errors': 0, 'rx_frame_errors': 0, 'rx_fifo_errors': 0, 'rx_missed_errors': 0, 'tx_aborted_errors': 0, 'tx_carrier_errors': 0, 'tx_fifo_errors': 0, 'tx_heartbeat_errors': 0, 'tx_window_errors': 0, 'rx_compressed': 0, 'tx_compressed': 0}], ['IFLA_XDP', {'attrs': [['IFLA_XDP_ATTACHED', None]]}], ['IFLA_LINKINFO', {'attrs': [['IFLA_INFO_KIND', 'veth']]}], ['IFLA_LINK_NETNSID', 0], ['IFLA_LINK', 12], ['IFLA_AF_SPEC', {'attrs': [['AF_INET', {'dummy': 65668, 'forwarding': 1, 'mc_forwarding': 0, 'proxy_arp': 0, 'accept_redirects': 1, 'secure_redirects': 1, 'send_redirects': 1, 'shared_media': 1, 'rp_filter': 2, 'accept_source_route': 0, 'bootp_relay': 0, 'log_martians': 0, 'tag': 0, 'arpfilter': 0, 'medium_id': 0, 'noxfrm': 0, 'nopolicy': 0, 'force_igmp_version': 0, 'arp_announce': 0, 'arp_ignore': 0, 'promote_secondaries': 1, 'arp_accept': 0, 'arp_notify': 0, 'accept_local': 0, 'src_vmark': 0, 'proxy_arp_pvlan': 0, 'route_localnet': 0, 'igmpv2_unsolicited_report_interval': 10000, 'igmpv3_unsolicited_report_interval': 1000}], ['AF_INET6', {'attrs': [['IFLA_INET6_FLAGS', 2147483648], ['IFLA_INET6_CACHEINFO', {'max_reasm_len': 65535, 'tstamp': 310169, 'reachable_time': 38132, 'retrans_time': 1000}], ['IFLA_INET6_CONF', {'forwarding': 0, 'hop_limit': 64, 'mtu': 1500, 'accept_ra': 1, 'accept_redirects': 1, 'autoconf': 1, 'dad_transmits': 1, 'router_solicitations': 4294967295, 'router_solicitation_interval': 4000, 'router_solicitation_delay': 1000, 'use_tempaddr': 0, 'temp_valid_lft': 604800, 'temp_preferred_lft': 86400, 'regen_max_retry': 3, 'max_desync_factor': 600, 'max_addresses': 16, 'force_mld_version': 0, 'accept_ra_defrtr': 1, 'accept_ra_pinfo': 1, 'accept_ra_rtr_pref': 1, 'router_probe_interval': 60000, 'accept_ra_rt_info_max_plen': 0, 'proxy_ndp': 0, 'optimistic_dad': 0, 'accept_source_route': 0, 'mc_forwarding': 0, 'disable_ipv6': 0, 'accept_dad': 1, 'force_tllao': 0, 'ndisc_notify': 0}], ['IFLA_INET6_STATS', {'num': 37, 'inpkts': 3, 'inoctets': 264, 'indelivers': 0, 'outforwdatagrams': 0, 'outpkts': 5, 'outoctets': 412, 'inhdrerrors': 0, 'intoobigerrors': 0, 'innoroutes': 0, 'inaddrerrors': 0, 'inunknownprotos': 0, 'intruncatedpkts': 0, 'indiscards': 0, 'outdiscards': 0, 'outnoroutes': 0, 'reasmtimeout': 0, 'reasmreqds': 0, 'reasmoks': 0, 'reasmfails': 0, 'fragoks': 0, 'fragfails': 0, 'fragcreates': 0, 'inmcastpkts': 3, 'outmcastpkts': 5, 'inbcastpkts': 0, 'outbcastpkts': 0, 'inmcastoctets': 264, 'outmcastoctets': 412, 'inbcastoctets': 0, 'outbcastoctets': 0, 'csumerrors': 0, 'noectpkts': 3, 'ect1pkts': 0, 'ect0pkts': 0, 'cepkts': 0}], ['IFLA_INET6_ICMP6STATS', {'num': 6, 'inmsgs': 0, 'inerrors': 0, 'outmsgs': 5, 'outerrors': 0, 'csumerrors': 0}], ['IFLA_INET6_TOKEN', '::'], ['IFLA_INET6_ADDR_GEN_MODE', 0]]}]]}]], 'header': {'length': 1380, 'type': 16, 'flags': 0, 'sequence_number': 255, 'pid': 98496, 'error': None, 'target': 'ovnmeta-9aaf4bd9-9f34-40ad-a4e7-932bff23895a', 'stats': (0, 0, 0)}, 'state': 'up', 'event': 'RTM_NEWLINK'}]) {{(pid=79043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} May 28 12:56:12 l75lg1-v1 dstat.sh[49771]: 28-05 12:56:12| 46 6 46 1 0|5171M 2352M 277M 7827M| 16k 3806B| 0 12M| 0 932 |7306 11k|1.48 0.87 0.95|1.0 1.0 16| 0 0 | 0 2048M| 29 313 0 22 0 May 28 12:56:12 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0d0953db-ffb1-4877-9695-c201826f4008 None None] <<< [GET] https://127.0.0.1:40443/api/monitors/ad_hoc_query/ May 28 12:56:12 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0d0953db-ffb1-4877-9695-c201826f4008 None None] Bunch(data=[['2024-05-28T12:56:08Z', 1, 431530592.0, 2223930.0, 5.29, 711246584217.0, 2236629909504.0], ['2024-05-28T12:55:58Z', 1, 431465056.0, 2223930.0, 5.29, 711246584217.0, 2236629909504.0], ['2024-05-28T12:55:48Z', 1, 431350368.0, 2223930.0, 5.29, 711246584217.0, 2236629909504.0], ['2024-05-28T12:55:38Z', 1, 431276640.0, 2223930.0, 5.29, 711246584217.0, 2236629909504.0], ['2024-05-28T12:55:28Z', 1, 431170144.0, 2223930.0, 5.29, 711246584217.0, 2236629909504.0], ['2024-05-28T12:55:18Z', 1, 430572128.0, 2223930.0, 5.29, 711246584217.0, 2236629909504.0]], granularity=None, object_ids=[1], prop_list=['timestamp', 'object_id', 'Capacity,logical_space_in_use', 'Capacity,physical_space_in_use', 'Capacity,drr', 'Capacity,physical_space', 'Capacity,logical_space']) May 28 12:56:12 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0d0953db-ffb1-4877-9695-c201826f4008 None None] --- [GET] https://127.0.0.1:40443/api/monitors/ad_hoc_query/: Done May 28 12:56:12 l75lg1-v1 manila-share[98474]: DEBUG manila.share.driver [None req-0d0953db-ffb1-4877-9695-c201826f4008 None None] Updating share stats. {{(pid=98474) _update_share_stats /opt/stack/manila/manila/share/driver.py:1326}} May 28 12:56:12 l75lg1-v1 manila-share[98474]: DEBUG manila.manager [None req-0d0953db-ffb1-4877-9695-c201826f4008 None None] Notifying Schedulers of capabilities ... {{(pid=98474) _publish_service_capabilities /opt/stack/manila/manila/manager.py:172}} May 28 12:56:12 l75lg1-v1 manila-share[98474]: INFO manila.share.manager [None req-0d0953db-ffb1-4877-9695-c201826f4008 None None] Finished initialization of driver: 'VASTShareDriver@l75lg1-v1@vast' May 28 12:56:12 l75lg1-v1 manila-share[98474]: DEBUG manila.service [None req-0d0953db-ffb1-4877-9695-c201826f4008 None None] Creating RPC server for service manila-share. {{(pid=98474) start /opt/stack/manila/manila/service.py:159}} May 28 12:56:12 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.host_manager [None req-0b7b0145-33cd-4b73-8fc0-0cbf268d3c58 None None] Received share service update from l75lg1-v1@vast: {'share_backend_name': 'vast', 'driver_handles_share_servers': False, 'vendor_name': 'VAST STORAGE', 'driver_version': '1.0', 'storage_protocol': 'NFS', 'total_capacity_gb': 2083.02392578125, 'free_capacity_gb': 2082.6229242384434, 'reserved_percentage': 0, 'reserved_snapshot_percentage': 0, 'reserved_share_extend_percentage': 0, 'qos': False, 'pools': None, 'snapshot_support': True, 'create_share_from_snapshot_support': False, 'revert_to_snapshot_support': False, 'mount_snapshot_support': False, 'replication_domain': None, 'filter_function': None, 'goodness_function': None, 'security_service_update_support': False, 'network_allocation_update_support': False, 'share_server_multiple_subnet_support': False, 'mount_point_name_support': False, 'data_reduction': 5.29, 'provisioned_capacity_gb': 0.40100154280662537, 'share_group_stats': {'consistent_snapshot_support': None}, 'ipv4_support': True, 'ipv6_support': False} {{(pid=98327) update_service_capabilities /opt/stack/manila/manila/scheduler/host_manager.py:632}} May 28 12:56:12 l75lg1-v1 manila-share[98474]: INFO oslo.messaging._drivers.impl_rabbit [None req-0d0953db-ffb1-4877-9695-c201826f4008 None None] Creating fanout queue: manila-share_fanout_772d12a9b74c43b6b2facbfd75de5786 May 28 12:56:12 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7f54ece-af70-4690-bd5d-c6e590681f94]: (4, [{'family': 0, '__align': (), 'ifi_type': 1, 'index': 2, 'flags': 69699, 'change': 0, 'attrs': [['IFLA_IFNAME', 'tap9aaf4bd9-91'], ['IFLA_TXQLEN', 1000], ['IFLA_OPERSTATE', 'UP'], ['IFLA_LINKMODE', 0], ['IFLA_MTU', 1500], ['IFLA_MIN_MTU', 68], ['IFLA_MAX_MTU', 65535], ['IFLA_GROUP', 0], ['IFLA_PROMISCUITY', 0], ['IFLA_NUM_TX_QUEUES', 10], ['IFLA_GSO_MAX_SEGS', 65535], ['IFLA_GSO_MAX_SIZE', 65536], ['IFLA_NUM_RX_QUEUES', 10], ['IFLA_CARRIER', 1], ['IFLA_QDISC', 'noqueue'], ['IFLA_CARRIER_CHANGES', 2], ['IFLA_CARRIER_UP_COUNT', 1], ['IFLA_CARRIER_DOWN_COUNT', 1], ['IFLA_PROTO_DOWN', 0], ['IFLA_MAP', {'mem_start': 0, 'mem_end': 0, 'base_addr': 0, 'irq': 0, 'dma': 0, 'port': 0}], ['IFLA_ADDRESS', 'fa:16:3e:0e:5c:95'], ['IFLA_BROADCAST', 'ff:ff:ff:ff:ff:ff'], ['IFLA_STATS64', {'rx_packets': 3, 'tx_packets': 5, 'rx_bytes': 306, 'tx_bytes': 482, 'rx_errors': 0, 'tx_errors': 0, 'rx_dropped': 0, 'tx_dropped': 0, 'multicast': 0, 'collisions': 0, 'rx_length_errors': 0, 'rx_over_errors': 0, 'rx_crc_errors': 0, 'rx_frame_errors': 0, 'rx_fifo_errors': 0, 'rx_missed_errors': 0, 'tx_aborted_errors': 0, 'tx_carrier_errors': 0, 'tx_fifo_errors': 0, 'tx_heartbeat_errors': 0, 'tx_window_errors': 0, 'rx_compressed': 0, 'tx_compressed': 0}], ['IFLA_STATS', {'rx_packets': 3, 'tx_packets': 5, 'rx_bytes': 306, 'tx_bytes': 482, 'rx_errors': 0, 'tx_errors': 0, 'rx_dropped': 0, 'tx_dropped': 0, 'multicast': 0, 'collisions': 0, 'rx_length_errors': 0, 'rx_over_errors': 0, 'rx_crc_errors': 0, 'rx_frame_errors': 0, 'rx_fifo_errors': 0, 'rx_missed_errors': 0, 'tx_aborted_errors': 0, 'tx_carrier_errors': 0, 'tx_fifo_errors': 0, 'tx_heartbeat_errors': 0, 'tx_window_errors': 0, 'rx_compressed': 0, 'tx_compressed': 0}], ['IFLA_XDP', {'attrs': [['IFLA_XDP_ATTACHED', None]]}], ['IFLA_LINKINFO', {'attrs': [['IFLA_INFO_KIND', 'veth']]}], ['IFLA_LINK_NETNSID', 0], ['IFLA_LINK', 12], ['IFLA_AF_SPEC', {'attrs': [['AF_INET', {'dummy': 65668, 'forwarding': 1, 'mc_forwarding': 0, 'proxy_arp': 0, 'accept_redirects': 1, 'secure_redirects': 1, 'send_redirects': 1, 'shared_media': 1, 'rp_filter': 2, 'accept_source_route': 0, 'bootp_relay': 0, 'log_martians': 0, 'tag': 0, 'arpfilter': 0, 'medium_id': 0, 'noxfrm': 0, 'nopolicy': 0, 'force_igmp_version': 0, 'arp_announce': 0, 'arp_ignore': 0, 'promote_secondaries': 1, 'arp_accept': 0, 'arp_notify': 0, 'accept_local': 0, 'src_vmark': 0, 'proxy_arp_pvlan': 0, 'route_localnet': 0, 'igmpv2_unsolicited_report_interval': 10000, 'igmpv3_unsolicited_report_interval': 1000}], ['AF_INET6', {'attrs': [['IFLA_INET6_FLAGS', 2147483648], ['IFLA_INET6_CACHEINFO', {'max_reasm_len': 65535, 'tstamp': 310169, 'reachable_time': 38132, 'retrans_time': 1000}], ['IFLA_INET6_CONF', {'forwarding': 0, 'hop_limit': 64, 'mtu': 1500, 'accept_ra': 1, 'accept_redirects': 1, 'autoconf': 1, 'dad_transmits': 1, 'router_solicitations': 4294967295, 'router_solicitation_interval': 4000, 'router_solicitation_delay': 1000, 'use_tempaddr': 0, 'temp_valid_lft': 604800, 'temp_preferred_lft': 86400, 'regen_max_retry': 3, 'max_desync_factor': 600, 'max_addresses': 16, 'force_mld_version': 0, 'accept_ra_defrtr': 1, 'accept_ra_pinfo': 1, 'accept_ra_rtr_pref': 1, 'router_probe_interval': 60000, 'accept_ra_rt_info_max_plen': 0, 'proxy_ndp': 0, 'optimistic_dad': 0, 'accept_source_route': 0, 'mc_forwarding': 0, 'disable_ipv6': 0, 'accept_dad': 1, 'force_tllao': 0, 'ndisc_notify': 0}], ['IFLA_INET6_STATS', {'num': 37, 'inpkts': 3, 'inoctets': 264, 'indelivers': 0, 'outforwdatagrams': 0, 'outpkts': 5, 'outoctets': 412, 'inhdrerrors': 0, 'intoobigerrors': 0, 'innoroutes': 0, 'inaddrerrors': 0, 'inunknownprotos': 0, 'intruncatedpkts': 0, 'indiscards': 0, 'outdiscards': 0, 'outnoroutes': 0, 'reasmtimeout': 0, 'reasmreqds': 0, 'reasmoks': 0, 'reasmfails': 0, 'fragoks': 0, 'fragfails': 0, 'fragcreates': 0, 'inmcastpkts': 3, 'outmcastpkts': 5, 'inbcastpkts': 0, 'outbcastpkts': 0, 'inmcastoctets': 264, 'outmcastoctets': 412, 'inbcastoctets': 0, 'outbcastoctets': 0, 'csumerrors': 0, 'noectpkts': 3, 'ect1pkts': 0, 'ect0pkts': 0, 'cepkts': 0}], ['IFLA_INET6_ICMP6STATS', {'num': 6, 'inmsgs': 0, 'inerrors': 0, 'outmsgs': 5, 'outerrors': 0, 'csumerrors': 0}], ['IFLA_INET6_TOKEN', '::'], ['IFLA_INET6_ADDR_GEN_MODE', 0]]}]]}]], 'header': {'length': 1380, 'type': 16, 'flags': 2, 'sequence_number': 255, 'pid': 98547, 'error': None, 'target': 'ovnmeta-9aaf4bd9-9f34-40ad-a4e7-932bff23895a', 'stats': (0, 0, 0)}, 'state': 'up', 'event': 'RTM_NEWLINK'}]) {{(pid=79043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} May 28 12:56:12 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7e76e67-a87d-460f-8796-dd44bf3281d3]: (4, ({'family': 10, 'prefixlen': 128, 'flags': 192, 'scope': 253, 'index': 2, 'attrs': [['IFA_ADDRESS', 'fe80::a9fe:a9fe'], ['IFA_CACHEINFO', {'ifa_preferred': 4294967295, 'ifa_valid': 4294967295, 'cstamp': 310178, 'tstamp': 310178}], ['IFA_FLAGS', 192]], 'header': {'length': 72, 'type': 20, 'flags': 2, 'sequence_number': 255, 'pid': 98548, 'error': None, 'target': 'ovnmeta-9aaf4bd9-9f34-40ad-a4e7-932bff23895a', 'stats': (0, 0, 0)}, 'event': 'RTM_NEWADDR'},)) {{(pid=79043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} May 28 12:56:12 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b02cd9f-3b38-4fbc-a7e8-1a880ac26b38]: (4, [{'family': 0, '__align': (), 'ifi_type': 1, 'index': 2, 'flags': 69699, 'change': 0, 'attrs': [['IFLA_IFNAME', 'tap9aaf4bd9-91'], ['IFLA_TXQLEN', 1000], ['IFLA_OPERSTATE', 'UP'], ['IFLA_LINKMODE', 0], ['IFLA_MTU', 1500], ['IFLA_MIN_MTU', 68], ['IFLA_MAX_MTU', 65535], ['IFLA_GROUP', 0], ['IFLA_PROMISCUITY', 0], ['IFLA_NUM_TX_QUEUES', 10], ['IFLA_GSO_MAX_SEGS', 65535], ['IFLA_GSO_MAX_SIZE', 65536], ['IFLA_NUM_RX_QUEUES', 10], ['IFLA_CARRIER', 1], ['IFLA_QDISC', 'noqueue'], ['IFLA_CARRIER_CHANGES', 2], ['IFLA_CARRIER_UP_COUNT', 1], ['IFLA_CARRIER_DOWN_COUNT', 1], ['IFLA_PROTO_DOWN', 0], ['IFLA_MAP', {'mem_start': 0, 'mem_end': 0, 'base_addr': 0, 'irq': 0, 'dma': 0, 'port': 0}], ['IFLA_ADDRESS', 'fa:16:3e:0e:5c:95'], ['IFLA_BROADCAST', 'ff:ff:ff:ff:ff:ff'], ['IFLA_STATS64', {'rx_packets': 3, 'tx_packets': 5, 'rx_bytes': 306, 'tx_bytes': 482, 'rx_errors': 0, 'tx_errors': 0, 'rx_dropped': 0, 'tx_dropped': 0, 'multicast': 0, 'collisions': 0, 'rx_length_errors': 0, 'rx_over_errors': 0, 'rx_crc_errors': 0, 'rx_frame_errors': 0, 'rx_fifo_errors': 0, 'rx_missed_errors': 0, 'tx_aborted_errors': 0, 'tx_carrier_errors': 0, 'tx_fifo_errors': 0, 'tx_heartbeat_errors': 0, 'tx_window_errors': 0, 'rx_compressed': 0, 'tx_compressed': 0}], ['IFLA_STATS', {'rx_packets': 3, 'tx_packets': 5, 'rx_bytes': 306, 'tx_bytes': 482, 'rx_errors': 0, 'tx_errors': 0, 'rx_dropped': 0, 'tx_dropped': 0, 'multicast': 0, 'collisions': 0, 'rx_length_errors': 0, 'rx_over_errors': 0, 'rx_crc_errors': 0, 'rx_frame_errors': 0, 'rx_fifo_errors': 0, 'rx_missed_errors': 0, 'tx_aborted_errors': 0, 'tx_carrier_errors': 0, 'tx_fifo_errors': 0, 'tx_heartbeat_errors': 0, 'tx_window_errors': 0, 'rx_compressed': 0, 'tx_compressed': 0}], ['IFLA_XDP', {'attrs': [['IFLA_XDP_ATTACHED', None]]}], ['IFLA_LINKINFO', {'attrs': [['IFLA_INFO_KIND', 'veth']]}], ['IFLA_LINK_NETNSID', 0], ['IFLA_LINK', 12], ['IFLA_AF_SPEC', {'attrs': [['AF_INET', {'dummy': 65668, 'forwarding': 1, 'mc_forwarding': 0, 'proxy_arp': 0, 'accept_redirects': 1, 'secure_redirects': 1, 'send_redirects': 1, 'shared_media': 1, 'rp_filter': 2, 'accept_source_route': 0, 'bootp_relay': 0, 'log_martians': 0, 'tag': 0, 'arpfilter': 0, 'medium_id': 0, 'noxfrm': 0, 'nopolicy': 0, 'force_igmp_version': 0, 'arp_announce': 0, 'arp_ignore': 0, 'promote_secondaries': 1, 'arp_accept': 0, 'arp_notify': 0, 'accept_local': 0, 'src_vmark': 0, 'proxy_arp_pvlan': 0, 'route_localnet': 0, 'igmpv2_unsolicited_report_interval': 10000, 'igmpv3_unsolicited_report_interval': 1000}], ['AF_INET6', {'attrs': [['IFLA_INET6_FLAGS', 2147483648], ['IFLA_INET6_CACHEINFO', {'max_reasm_len': 65535, 'tstamp': 310169, 'reachable_time': 38132, 'retrans_time': 1000}], ['IFLA_INET6_CONF', {'forwarding': 0, 'hop_limit': 64, 'mtu': 1500, 'accept_ra': 1, 'accept_redirects': 1, 'autoconf': 1, 'dad_transmits': 1, 'router_solicitations': 4294967295, 'router_solicitation_interval': 4000, 'router_solicitation_delay': 1000, 'use_tempaddr': 0, 'temp_valid_lft': 604800, 'temp_preferred_lft': 86400, 'regen_max_retry': 3, 'max_desync_factor': 600, 'max_addresses': 16, 'force_mld_version': 0, 'accept_ra_defrtr': 1, 'accept_ra_pinfo': 1, 'accept_ra_rtr_pref': 1, 'router_probe_interval': 60000, 'accept_ra_rt_info_max_plen': 0, 'proxy_ndp': 0, 'optimistic_dad': 0, 'accept_source_route': 0, 'mc_forwarding': 0, 'disable_ipv6': 0, 'accept_dad': 1, 'force_tllao': 0, 'ndisc_notify': 0}], ['IFLA_INET6_STATS', {'num': 37, 'inpkts': 3, 'inoctets': 264, 'indelivers': 0, 'outforwdatagrams': 0, 'outpkts': 5, 'outoctets': 412, 'inhdrerrors': 0, 'intoobigerrors': 0, 'innoroutes': 0, 'inaddrerrors': 0, 'inunknownprotos': 0, 'intruncatedpkts': 0, 'indiscards': 0, 'outdiscards': 0, 'outnoroutes': 0, 'reasmtimeout': 0, 'reasmreqds': 0, 'reasmoks': 0, 'reasmfails': 0, 'fragoks': 0, 'fragfails': 0, 'fragcreates': 0, 'inmcastpkts': 3, 'outmcastpkts': 5, 'inbcastpkts': 0, 'outbcastpkts': 0, 'inmcastoctets': 264, 'outmcastoctets': 412, 'inbcastoctets': 0, 'outbcastoctets': 0, 'csumerrors': 0, 'noectpkts': 3, 'ect1pkts': 0, 'ect0pkts': 0, 'cepkts': 0}], ['IFLA_INET6_ICMP6STATS', {'num': 6, 'inmsgs': 0, 'inerrors': 0, 'outmsgs': 5, 'outerrors': 0, 'csumerrors': 0}], ['IFLA_INET6_TOKEN', '::'], ['IFLA_INET6_ADDR_GEN_MODE', 0]]}]]}]], 'header': {'length': 1380, 'type': 16, 'flags': 0, 'sequence_number': 255, 'pid': 98552, 'error': None, 'target': 'ovnmeta-9aaf4bd9-9f34-40ad-a4e7-932bff23895a', 'stats': (0, 0, 0)}, 'state': 'up', 'event': 'RTM_NEWLINK'}]) {{(pid=79043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} May 28 12:56:12 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo.privsep.daemon [-] privsep: reply[403747af-8b11-429d-ae99-4dd7fa76fe69]: (4, [{'family': 0, '__align': (), 'ifi_type': 1, 'index': 2, 'flags': 69699, 'change': 0, 'attrs': [['IFLA_IFNAME', 'tap9aaf4bd9-91'], ['IFLA_TXQLEN', 1000], ['IFLA_OPERSTATE', 'UP'], ['IFLA_LINKMODE', 0], ['IFLA_MTU', 1500], ['IFLA_MIN_MTU', 68], ['IFLA_MAX_MTU', 65535], ['IFLA_GROUP', 0], ['IFLA_PROMISCUITY', 0], ['IFLA_NUM_TX_QUEUES', 10], ['IFLA_GSO_MAX_SEGS', 65535], ['IFLA_GSO_MAX_SIZE', 65536], ['IFLA_NUM_RX_QUEUES', 10], ['IFLA_CARRIER', 1], ['IFLA_QDISC', 'noqueue'], ['IFLA_CARRIER_CHANGES', 2], ['IFLA_CARRIER_UP_COUNT', 1], ['IFLA_CARRIER_DOWN_COUNT', 1], ['IFLA_PROTO_DOWN', 0], ['IFLA_MAP', {'mem_start': 0, 'mem_end': 0, 'base_addr': 0, 'irq': 0, 'dma': 0, 'port': 0}], ['IFLA_ADDRESS', 'fa:16:3e:0e:5c:95'], ['IFLA_BROADCAST', 'ff:ff:ff:ff:ff:ff'], ['IFLA_STATS64', {'rx_packets': 3, 'tx_packets': 7, 'rx_bytes': 306, 'tx_bytes': 662, 'rx_errors': 0, 'tx_errors': 0, 'rx_dropped': 0, 'tx_dropped': 0, 'multicast': 0, 'collisions': 0, 'rx_length_errors': 0, 'rx_over_errors': 0, 'rx_crc_errors': 0, 'rx_frame_errors': 0, 'rx_fifo_errors': 0, 'rx_missed_errors': 0, 'tx_aborted_errors': 0, 'tx_carrier_errors': 0, 'tx_fifo_errors': 0, 'tx_heartbeat_errors': 0, 'tx_window_errors': 0, 'rx_compressed': 0, 'tx_compressed': 0}], ['IFLA_STATS', {'rx_packets': 3, 'tx_packets': 7, 'rx_bytes': 306, 'tx_bytes': 662, 'rx_errors': 0, 'tx_errors': 0, 'rx_dropped': 0, 'tx_dropped': 0, 'multicast': 0, 'collisions': 0, 'rx_length_errors': 0, 'rx_over_errors': 0, 'rx_crc_errors': 0, 'rx_frame_errors': 0, 'rx_fifo_errors': 0, 'rx_missed_errors': 0, 'tx_aborted_errors': 0, 'tx_carrier_errors': 0, 'tx_fifo_errors': 0, 'tx_heartbeat_errors': 0, 'tx_window_errors': 0, 'rx_compressed': 0, 'tx_compressed': 0}], ['IFLA_XDP', {'attrs': [['IFLA_XDP_ATTACHED', None]]}], ['IFLA_LINKINFO', {'attrs': [['IFLA_INFO_KIND', 'veth']]}], ['IFLA_LINK_NETNSID', 0], ['IFLA_LINK', 12], ['IFLA_AF_SPEC', {'attrs': [['AF_INET', {'dummy': 65668, 'forwarding': 1, 'mc_forwarding': 0, 'proxy_arp': 0, 'accept_redirects': 1, 'secure_redirects': 1, 'send_redirects': 1, 'shared_media': 1, 'rp_filter': 2, 'accept_source_route': 0, 'bootp_relay': 0, 'log_martians': 0, 'tag': 0, 'arpfilter': 0, 'medium_id': 0, 'noxfrm': 0, 'nopolicy': 0, 'force_igmp_version': 0, 'arp_announce': 0, 'arp_ignore': 0, 'promote_secondaries': 1, 'arp_accept': 0, 'arp_notify': 0, 'accept_local': 0, 'src_vmark': 0, 'proxy_arp_pvlan': 0, 'route_localnet': 0, 'igmpv2_unsolicited_report_interval': 10000, 'igmpv3_unsolicited_report_interval': 1000}], ['AF_INET6', {'attrs': [['IFLA_INET6_FLAGS', 2147483664], ['IFLA_INET6_CACHEINFO', {'max_reasm_len': 65535, 'tstamp': 310169, 'reachable_time': 38132, 'retrans_time': 1000}], ['IFLA_INET6_CONF', {'forwarding': 0, 'hop_limit': 64, 'mtu': 1500, 'accept_ra': 1, 'accept_redirects': 1, 'autoconf': 1, 'dad_transmits': 1, 'router_solicitations': 4294967295, 'router_solicitation_interval': 4000, 'router_solicitation_delay': 1000, 'use_tempaddr': 0, 'temp_valid_lft': 604800, 'temp_preferred_lft': 86400, 'regen_max_retry': 3, 'max_desync_factor': 600, 'max_addresses': 16, 'force_mld_version': 0, 'accept_ra_defrtr': 1, 'accept_ra_pinfo': 1, 'accept_ra_rtr_pref': 1, 'router_probe_interval': 60000, 'accept_ra_rt_info_max_plen': 0, 'proxy_ndp': 0, 'optimistic_dad': 0, 'accept_source_route': 0, 'mc_forwarding': 0, 'disable_ipv6': 0, 'accept_dad': 1, 'force_tllao': 0, 'ndisc_notify': 0}], ['IFLA_INET6_STATS', {'num': 37, 'inpkts': 3, 'inoctets': 264, 'indelivers': 0, 'outforwdatagrams': 0, 'outpkts': 7, 'outoctets': 564, 'inhdrerrors': 0, 'intoobigerrors': 0, 'innoroutes': 0, 'inaddrerrors': 0, 'inunknownprotos': 0, 'intruncatedpkts': 0, 'indiscards': 0, 'outdiscards': 0, 'outnoroutes': 0, 'reasmtimeout': 0, 'reasmreqds': 0, 'reasmoks': 0, 'reasmfails': 0, 'fragoks': 0, 'fragfails': 0, 'fragcreates': 0, 'inmcastpkts': 3, 'outmcastpkts': 7, 'inbcastpkts': 0, 'outbcastpkts': 0, 'inmcastoctets': 264, 'outmcastoctets': 564, 'inbcastoctets': 0, 'outbcastoctets': 0, 'csumerrors': 0, 'noectpkts': 3, 'ect1pkts': 0, 'ect0pkts': 0, 'cepkts': 0}], ['IFLA_INET6_ICMP6STATS', {'num': 6, 'inmsgs': 0, 'inerrors': 0, 'outmsgs': 7, 'outerrors': 0, 'csumerrors': 0}], ['IFLA_INET6_TOKEN', '::'], ['IFLA_INET6_ADDR_GEN_MODE', 0]]}]]}]], 'header': {'length': 1380, 'type': 16, 'flags': 2, 'sequence_number': 255, 'pid': 98556, 'error': None, 'target': 'ovnmeta-9aaf4bd9-9f34-40ad-a4e7-932bff23895a', 'stats': (0, 0, 0)}, 'state': 'up', 'event': 'RTM_NEWLINK'}]) {{(pid=79043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} May 28 12:56:12 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo.privsep.daemon [-] privsep: reply[223066f3-e541-4e2f-9681-f6e0b2a58ed8]: (4, ({'family': 10, 'prefixlen': 128, 'flags': 128, 'scope': 253, 'index': 2, 'attrs': [['IFA_ADDRESS', 'fe80::a9fe:a9fe'], ['IFA_CACHEINFO', {'ifa_preferred': 4294967295, 'ifa_valid': 4294967295, 'cstamp': 310178, 'tstamp': 310178}], ['IFA_FLAGS', 128]], 'header': {'length': 72, 'type': 20, 'flags': 2, 'sequence_number': 255, 'pid': 98577, 'error': None, 'target': 'ovnmeta-9aaf4bd9-9f34-40ad-a4e7-932bff23895a', 'stats': (0, 0, 0)}, 'event': 'RTM_NEWADDR'},)) {{(pid=79043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} May 28 12:56:12 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf112bf7-0c81-4a2a-9e27-7bdd2e5d550a]: (4, [{'family': 0, '__align': (), 'ifi_type': 1, 'index': 2, 'flags': 69699, 'change': 0, 'attrs': [['IFLA_IFNAME', 'tap9aaf4bd9-91'], ['IFLA_TXQLEN', 1000], ['IFLA_OPERSTATE', 'UP'], ['IFLA_LINKMODE', 0], ['IFLA_MTU', 1500], ['IFLA_MIN_MTU', 68], ['IFLA_MAX_MTU', 65535], ['IFLA_GROUP', 0], ['IFLA_PROMISCUITY', 0], ['IFLA_NUM_TX_QUEUES', 10], ['IFLA_GSO_MAX_SEGS', 65535], ['IFLA_GSO_MAX_SIZE', 65536], ['IFLA_NUM_RX_QUEUES', 10], ['IFLA_CARRIER', 1], ['IFLA_QDISC', 'noqueue'], ['IFLA_CARRIER_CHANGES', 2], ['IFLA_CARRIER_UP_COUNT', 1], ['IFLA_CARRIER_DOWN_COUNT', 1], ['IFLA_PROTO_DOWN', 0], ['IFLA_MAP', {'mem_start': 0, 'mem_end': 0, 'base_addr': 0, 'irq': 0, 'dma': 0, 'port': 0}], ['IFLA_ADDRESS', 'fa:16:3e:0e:5c:95'], ['IFLA_BROADCAST', 'ff:ff:ff:ff:ff:ff'], ['IFLA_STATS64', {'rx_packets': 3, 'tx_packets': 7, 'rx_bytes': 306, 'tx_bytes': 662, 'rx_errors': 0, 'tx_errors': 0, 'rx_dropped': 0, 'tx_dropped': 0, 'multicast': 0, 'collisions': 0, 'rx_length_errors': 0, 'rx_over_errors': 0, 'rx_crc_errors': 0, 'rx_frame_errors': 0, 'rx_fifo_errors': 0, 'rx_missed_errors': 0, 'tx_aborted_errors': 0, 'tx_carrier_errors': 0, 'tx_fifo_errors': 0, 'tx_heartbeat_errors': 0, 'tx_window_errors': 0, 'rx_compressed': 0, 'tx_compressed': 0}], ['IFLA_STATS', {'rx_packets': 3, 'tx_packets': 7, 'rx_bytes': 306, 'tx_bytes': 662, 'rx_errors': 0, 'tx_errors': 0, 'rx_dropped': 0, 'tx_dropped': 0, 'multicast': 0, 'collisions': 0, 'rx_length_errors': 0, 'rx_over_errors': 0, 'rx_crc_errors': 0, 'rx_frame_errors': 0, 'rx_fifo_errors': 0, 'rx_missed_errors': 0, 'tx_aborted_errors': 0, 'tx_carrier_errors': 0, 'tx_fifo_errors': 0, 'tx_heartbeat_errors': 0, 'tx_window_errors': 0, 'rx_compressed': 0, 'tx_compressed': 0}], ['IFLA_XDP', {'attrs': [['IFLA_XDP_ATTACHED', None]]}], ['IFLA_LINKINFO', {'attrs': [['IFLA_INFO_KIND', 'veth']]}], ['IFLA_LINK_NETNSID', 0], ['IFLA_LINK', 12], ['IFLA_AF_SPEC', {'attrs': [['AF_INET', {'dummy': 65668, 'forwarding': 1, 'mc_forwarding': 0, 'proxy_arp': 0, 'accept_redirects': 1, 'secure_redirects': 1, 'send_redirects': 1, 'shared_media': 1, 'rp_filter': 2, 'accept_source_route': 0, 'bootp_relay': 0, 'log_martians': 0, 'tag': 0, 'arpfilter': 0, 'medium_id': 0, 'noxfrm': 0, 'nopolicy': 0, 'force_igmp_version': 0, 'arp_announce': 0, 'arp_ignore': 0, 'promote_secondaries': 1, 'arp_accept': 0, 'arp_notify': 0, 'accept_local': 0, 'src_vmark': 0, 'proxy_arp_pvlan': 0, 'route_localnet': 0, 'igmpv2_unsolicited_report_interval': 10000, 'igmpv3_unsolicited_report_interval': 1000}], ['AF_INET6', {'attrs': [['IFLA_INET6_FLAGS', 2147483664], ['IFLA_INET6_CACHEINFO', {'max_reasm_len': 65535, 'tstamp': 310169, 'reachable_time': 38132, 'retrans_time': 1000}], ['IFLA_INET6_CONF', {'forwarding': 0, 'hop_limit': 64, 'mtu': 1500, 'accept_ra': 1, 'accept_redirects': 1, 'autoconf': 1, 'dad_transmits': 1, 'router_solicitations': 4294967295, 'router_solicitation_interval': 4000, 'router_solicitation_delay': 1000, 'use_tempaddr': 0, 'temp_valid_lft': 604800, 'temp_preferred_lft': 86400, 'regen_max_retry': 3, 'max_desync_factor': 600, 'max_addresses': 16, 'force_mld_version': 0, 'accept_ra_defrtr': 1, 'accept_ra_pinfo': 1, 'accept_ra_rtr_pref': 1, 'router_probe_interval': 60000, 'accept_ra_rt_info_max_plen': 0, 'proxy_ndp': 0, 'optimistic_dad': 0, 'accept_source_route': 0, 'mc_forwarding': 0, 'disable_ipv6': 0, 'accept_dad': 1, 'force_tllao': 0, 'ndisc_notify': 0}], ['IFLA_INET6_STATS', {'num': 37, 'inpkts': 3, 'inoctets': 264, 'indelivers': 0, 'outforwdatagrams': 0, 'outpkts': 7, 'outoctets': 564, 'inhdrerrors': 0, 'intoobigerrors': 0, 'innoroutes': 0, 'inaddrerrors': 0, 'inunknownprotos': 0, 'intruncatedpkts': 0, 'indiscards': 0, 'outdiscards': 0, 'outnoroutes': 0, 'reasmtimeout': 0, 'reasmreqds': 0, 'reasmoks': 0, 'reasmfails': 0, 'fragoks': 0, 'fragfails': 0, 'fragcreates': 0, 'inmcastpkts': 3, 'outmcastpkts': 7, 'inbcastpkts': 0, 'outbcastpkts': 0, 'inmcastoctets': 264, 'outmcastoctets': 564, 'inbcastoctets': 0, 'outbcastoctets': 0, 'csumerrors': 0, 'noectpkts': 3, 'ect1pkts': 0, 'ect0pkts': 0, 'cepkts': 0}], ['IFLA_INET6_ICMP6STATS', {'num': 6, 'inmsgs': 0, 'inerrors': 0, 'outmsgs': 7, 'outerrors': 0, 'csumerrors': 0}], ['IFLA_INET6_TOKEN', '::'], ['IFLA_INET6_ADDR_GEN_MODE', 0]]}]]}]], 'header': {'length': 1380, 'type': 16, 'flags': 0, 'sequence_number': 255, 'pid': 98594, 'error': None, 'target': 'ovnmeta-9aaf4bd9-9f34-40ad-a4e7-932bff23895a', 'stats': (0, 0, 0)}, 'state': 'up', 'event': 'RTM_NEWLINK'}]) {{(pid=79043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} May 28 12:56:12 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.linux.utils [-] Unable to access /opt/stack/data/neutron/external/pids/9aaf4bd9-9f34-40ad-a4e7-932bff23895a.pid.haproxy; Error: [Errno 2] No such file or directory: '/opt/stack/data/neutron/external/pids/9aaf4bd9-9f34-40ad-a4e7-932bff23895a.pid.haproxy' {{(pid=76818) get_value_from_file /opt/stack/neutron/neutron/agent/linux/utils.py:252}} May 28 12:56:12 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2e12e09-8f78-4153-97a5-6846bdbb2406]: (4, None) {{(pid=79043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}} May 28 12:56:12 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.metadata.driver_base [-] haproxy_cfg = May 28 12:56:12 l75lg1-v1 neutron-ovn-metadata-agent[76818]: global May 28 12:56:12 l75lg1-v1 neutron-ovn-metadata-agent[76818]: log /dev/log local0 debug May 28 12:56:12 l75lg1-v1 neutron-ovn-metadata-agent[76818]: log-tag haproxy-metadata-proxy-9aaf4bd9-9f34-40ad-a4e7-932bff23895a May 28 12:56:12 l75lg1-v1 neutron-ovn-metadata-agent[76818]: user vastdata May 28 12:56:12 l75lg1-v1 neutron-ovn-metadata-agent[76818]: group vastdata May 28 12:56:12 l75lg1-v1 neutron-ovn-metadata-agent[76818]: maxconn 1024 May 28 12:56:12 l75lg1-v1 neutron-ovn-metadata-agent[76818]: pidfile /opt/stack/data/neutron/external/pids/9aaf4bd9-9f34-40ad-a4e7-932bff23895a.pid.haproxy May 28 12:56:12 l75lg1-v1 neutron-ovn-metadata-agent[76818]: daemon May 28 12:56:12 l75lg1-v1 neutron-ovn-metadata-agent[76818]: defaults May 28 12:56:12 l75lg1-v1 neutron-ovn-metadata-agent[76818]: log global May 28 12:56:12 l75lg1-v1 neutron-ovn-metadata-agent[76818]: mode http May 28 12:56:12 l75lg1-v1 neutron-ovn-metadata-agent[76818]: option httplog May 28 12:56:12 l75lg1-v1 neutron-ovn-metadata-agent[76818]: option dontlognull May 28 12:56:12 l75lg1-v1 neutron-ovn-metadata-agent[76818]: option http-server-close May 28 12:56:12 l75lg1-v1 neutron-ovn-metadata-agent[76818]: option forwardfor May 28 12:56:12 l75lg1-v1 neutron-ovn-metadata-agent[76818]: retries 3 May 28 12:56:12 l75lg1-v1 neutron-ovn-metadata-agent[76818]: timeout http-request 30s May 28 12:56:12 l75lg1-v1 neutron-ovn-metadata-agent[76818]: timeout connect 30s May 28 12:56:12 l75lg1-v1 neutron-ovn-metadata-agent[76818]: timeout client 32s May 28 12:56:12 l75lg1-v1 neutron-ovn-metadata-agent[76818]: timeout server 32s May 28 12:56:12 l75lg1-v1 neutron-ovn-metadata-agent[76818]: timeout http-keep-alive 30s May 28 12:56:12 l75lg1-v1 neutron-ovn-metadata-agent[76818]: listen listener May 28 12:56:12 l75lg1-v1 neutron-ovn-metadata-agent[76818]: bind 169.254.169.254:80 May 28 12:56:12 l75lg1-v1 neutron-ovn-metadata-agent[76818]: bind fe80::a9fe:a9fe:80 interface tap9aaf4bd9-91 May 28 12:56:12 l75lg1-v1 neutron-ovn-metadata-agent[76818]: server metadata /opt/stack/data/neutron/metadata_proxy May 28 12:56:12 l75lg1-v1 neutron-ovn-metadata-agent[76818]: http-request add-header X-OVN-Network-ID 9aaf4bd9-9f34-40ad-a4e7-932bff23895a May 28 12:56:12 l75lg1-v1 neutron-ovn-metadata-agent[76818]: {{(pid=76818) create_config_file /opt/stack/neutron/neutron/agent/metadata/driver_base.py:136}} May 28 12:56:12 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG neutron.agent.linux.utils [-] Running command (rootwrap daemon): ['ip', 'netns', 'exec', 'ovnmeta-9aaf4bd9-9f34-40ad-a4e7-932bff23895a', 'env', 'PROCESS_TAG=haproxy-9aaf4bd9-9f34-40ad-a4e7-932bff23895a', 'haproxy', '-f', '/opt/stack/data/neutron/ovn-metadata-proxy/9aaf4bd9-9f34-40ad-a4e7-932bff23895a.conf'] {{(pid=76818) execute_rootwrap_daemon /opt/stack/neutron/neutron/agent/linux/utils.py:108}} May 28 12:56:12 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_rootwrap.client [-] Popen for ['sudo', '/opt/stack/data/venv/bin/neutron-rootwrap-daemon', '/etc/neutron/rootwrap.conf'] command has been instantiated {{(pid=76818) _initialize /opt/stack/data/venv/lib/python3.10/site-packages/oslo_rootwrap/client.py:74}} May 28 12:56:12 l75lg1-v1 sudo[98605]: vastdata : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf May 28 12:56:12 l75lg1-v1 sudo[98605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) May 28 12:56:13 l75lg1-v1 neutron-ovn-metadata-agent[76818]: INFO oslo_rootwrap.client [-] Spawned new rootwrap daemon process with pid=98605 May 28 12:56:13 l75lg1-v1 dstat.sh[49771]: 28-05 12:56:13| 5 4 89 2 0|5207M 2316M 277M 7827M| 26k 12k| 32k 3420k|2.00 223 |4540 6906 |1.48 0.87 0.95| 0 0 132| 0 0 | 0 2048M| 29 314 0 22 0 May 28 12:56:14 l75lg1-v1 dstat.sh[49771]: 28-05 12:56:14| 1 0 99 0 0|5207M 2316M 277M 7827M|8042B 0 | 0 228k| 0 11.0 |1485 2593 |1.48 0.87 0.95| 0 0 0| 0 0 | 0 2048M| 29 314 0 22 0 May 28 12:56:14 l75lg1-v1 devstack@keystone.service[51266]: DEBUG dbcounter [-] [51266] Writing DB stats keystone:SELECT=96,keystone:INSERT=5,keystone:DELETE=10 {{(pid=51266) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:56:14 l75lg1-v1 devstack@keystone.service[51267]: DEBUG dbcounter [-] [51267] Writing DB stats keystone:SELECT=170,keystone:INSERT=2,keystone:DELETE=7 {{(pid=51267) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:56:15 l75lg1-v1 dstat.sh[49771]: 28-05 12:56:15| 1 0 98 0 0|5189M 2334M 277M 7827M|9194B 0 | 0 276k| 0 43.0 |2036 3362 |1.48 0.87 0.95| 0 0 1.0| 0 0 | 0 2048M| 29 314 0 22 0 May 28 12:56:16 l75lg1-v1 dstat.sh[49771]: 28-05 12:56:16| 1 0 99 0 0|5189M 2334M 277M 7827M|9521B 0 | 0 36k| 0 6.00 |1546 2596 |1.48 0.87 0.95| 0 0 0| 0 0 | 0 2048M| 29 314 0 22 0 May 28 12:56:17 l75lg1-v1 neutron-server[77618]: DEBUG dbcounter [-] [77618] Writing DB stats neutron:SELECT=195,neutron:INSERT=27,neutron:UPDATE=13,neutron:DELETE=1 {{(pid=77618) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:56:17 l75lg1-v1 neutron-server[77618]: DEBUG dbcounter [-] [77618] Writing DB stats neutron:SELECT=204,neutron:INSERT=21,neutron:UPDATE=6,neutron:DELETE=3 {{(pid=77618) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:56:17 l75lg1-v1 dstat.sh[49771]: 28-05 12:56:17| 2 1 96 0 0|5199M 2324M 277M 7827M| 19k 4382B| 0 720k| 0 80.0 |2766 4362 |1.36 0.86 0.94|2.0 0 51| 0 0 | 0 2048M| 29 315 0 22 0 May 28 12:56:17 l75lg1-v1 neutron-server[77623]: DEBUG dbcounter [-] [77623] Writing DB stats neutron:SELECT=2 {{(pid=77623) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:56:17 l75lg1-v1 neutron-server[77623]: DEBUG dbcounter [-] [77623] Writing DB stats neutron:SELECT=1 {{(pid=77623) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:56:18 l75lg1-v1 dstat.sh[49771]: 28-05 12:56:18| 10 1 89 0 0|5242M 2281M 277M 7827M|9342B 0 | 0 76k| 0 13.0 |1950 2899 |1.36 0.86 0.94|1.0 0 4.0| 0 0 | 0 2048M| 29 315 0 22 0 May 28 12:56:19 l75lg1-v1 dstat.sh[49771]: 28-05 12:56:19| 10 1 89 0 0|5289M 2233M 277M 7828M| 11k 0 | 0 208k| 0 1.00 |1644 3028 |1.36 0.86 0.94|1.0 0 0| 0 0 | 0 2048M| 29 315 0 22 0 May 28 12:56:19 l75lg1-v1 neutron-server[77623]: DEBUG neutron.db.agents_db [None req-fe40ce8c-640e-4db7-a17a-6e8888cce266 None None] Agent healthcheck: found 0 active agents {{(pid=77623) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:319}} May 28 12:56:19 l75lg1-v1 neutron-server[77619]: DEBUG dbcounter [-] [77619] Writing DB stats neutron:SELECT=273,neutron:UPDATE=12,neutron:DELETE=6,neutron:INSERT=14 {{(pid=77619) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:56:19 l75lg1-v1 neutron-server[77619]: DEBUG dbcounter [-] [77619] Writing DB stats neutron:SELECT=321,neutron:UPDATE=20,neutron:DELETE=7,neutron:INSERT=19 {{(pid=77619) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:56:19 l75lg1-v1 nova-conductor[83647]: DEBUG dbcounter [-] [83647] Writing DB stats nova_cell1:SELECT=4,nova_cell1:UPDATE=3 {{(pid=83647) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:56:19 l75lg1-v1 nova-conductor[83648]: DEBUG dbcounter [-] [83648] Writing DB stats nova_cell1:SELECT=1 {{(pid=83648) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:56:20 l75lg1-v1 dstat.sh[49771]: 28-05 12:56:20| 10 1 88 1 0|5306M 2212M 277M 7831M| 18k 416B| 0 1789k| 0 75.1 |2425 4123 |1.36 0.86 0.94|2.0 0 0| 0 0 | 0 2048M| 29 315 0 22 0 May 28 12:56:21 l75lg1-v1 dstat.sh[49771]: 28-05 12:56:21| 35 4 60 0 0|5437M 2080M 277M 7832M| 14k 172B| 0 60k| 0 4.00 |3262 5063 |1.36 0.86 0.94|5.0 0 15| 0 0 | 0 2048M| 29 315 0 22 0 May 28 12:56:21 l75lg1-v1 manila-data[98318]: DEBUG dbcounter [-] [98318] Writing DB stats manila:SELECT=5,manila:UPDATE=1 {{(pid=98318) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:56:21 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5c5549-5d17-4bd2-a666-eb820ee2290e None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:21 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5c5549-5d17-4bd2-a666-eb820ee2290e None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:21 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5c5549-5d17-4bd2-a666-eb820ee2290e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:21 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a150b5c-3cbc-44a7-b7bf-1331cac0f035 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:21 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a150b5c-3cbc-44a7-b7bf-1331cac0f035 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:21 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a150b5c-3cbc-44a7-b7bf-1331cac0f035 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:21 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-fa5c5549-5d17-4bd2-a666-eb820ee2290e None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:56:21 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-fa5c5549-5d17-4bd2-a666-eb820ee2290e None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:56:21 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-fa5c5549-5d17-4bd2-a666-eb820ee2290e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:21 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 597/1207] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:56:21 2024] POST /identity/v3/auth/tokens => generated 312 bytes in 19 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 28 12:56:21 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162fb0c2-0c5d-4458-92e3-cfd76956d114 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:21 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162fb0c2-0c5d-4458-92e3-cfd76956d114 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:21 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162fb0c2-0c5d-4458-92e3-cfd76956d114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:21 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-1a150b5c-3cbc-44a7-b7bf-1331cac0f035 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:56:21 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-1a150b5c-3cbc-44a7-b7bf-1331cac0f035 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:56:21 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-1a150b5c-3cbc-44a7-b7bf-1331cac0f035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:21 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 611/1208] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:56:21 2024] POST /identity/v3/auth/tokens => generated 312 bytes in 18 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 28 12:56:21 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87165a6a-1dc4-48ff-ad49-c02bb4f1d7f8 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:21 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87165a6a-1dc4-48ff-ad49-c02bb4f1d7f8 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:21 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87165a6a-1dc4-48ff-ad49-c02bb4f1d7f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:21 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-162fb0c2-0c5d-4458-92e3-cfd76956d114 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:56:21 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-162fb0c2-0c5d-4458-92e3-cfd76956d114 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:56:21 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-162fb0c2-0c5d-4458-92e3-cfd76956d114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:21 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 598/1209] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:56:21 2024] POST /identity/v3/auth/tokens => generated 312 bytes in 18 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 28 12:56:21 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf6b6cf-d418-48c3-b33d-385413f28d05 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:21 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf6b6cf-d418-48c3-b33d-385413f28d05 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:21 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf6b6cf-d418-48c3-b33d-385413f28d05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:21 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-87165a6a-1dc4-48ff-ad49-c02bb4f1d7f8 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:56:21 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-87165a6a-1dc4-48ff-ad49-c02bb4f1d7f8 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:56:21 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-87165a6a-1dc4-48ff-ad49-c02bb4f1d7f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:21 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-daf6b6cf-d418-48c3-b33d-385413f28d05 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:56:21 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-daf6b6cf-d418-48c3-b33d-385413f28d05 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:56:21 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-daf6b6cf-d418-48c3-b33d-385413f28d05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:21 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 599/1210] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:56:21 2024] POST /identity/v3/auth/tokens => generated 312 bytes in 18 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 28 12:56:21 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390d2af6-55be-4470-a0ba-157867d141ac None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:21 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390d2af6-55be-4470-a0ba-157867d141ac None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:21 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390d2af6-55be-4470-a0ba-157867d141ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:21 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-390d2af6-55be-4470-a0ba-157867d141ac None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:56:21 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-390d2af6-55be-4470-a0ba-157867d141ac None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:56:21 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-390d2af6-55be-4470-a0ba-157867d141ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:21 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 612/1211] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:56:21 2024] POST /identity/v3/auth/tokens => generated 2960 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 12:56:21 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e16249-ae62-488a-9d3f-b3af689ce965 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:21 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e16249-ae62-488a-9d3f-b3af689ce965 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:21 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e16249-ae62-488a-9d3f-b3af689ce965 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:21 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 600/1212] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:56:21 2024] POST /identity/v3/auth/tokens => generated 2960 bytes in 21 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 12:56:21 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5cf5c3-3d7c-45bb-a99d-77fa39f9cf4a None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:21 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5cf5c3-3d7c-45bb-a99d-77fa39f9cf4a None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:21 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5cf5c3-3d7c-45bb-a99d-77fa39f9cf4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:21 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-15e16249-ae62-488a-9d3f-b3af689ce965 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:56:21 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-15e16249-ae62-488a-9d3f-b3af689ce965 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:56:21 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-15e16249-ae62-488a-9d3f-b3af689ce965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:21 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-6e5cf5c3-3d7c-45bb-a99d-77fa39f9cf4a None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-6e5cf5c3-3d7c-45bb-a99d-77fa39f9cf4a None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-6e5cf5c3-3d7c-45bb-a99d-77fa39f9cf4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 613/1213] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:56:21 2024] POST /identity/v3/auth/tokens => generated 2960 bytes in 20 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e16249-ae62-488a-9d3f-b3af689ce965 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 601/1214] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:56:21 2024] POST /identity/v3/auth/tokens => generated 2960 bytes in 21 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5cf5c3-3d7c-45bb-a99d-77fa39f9cf4a None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e16249-ae62-488a-9d3f-b3af689ce965 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c3eae7-e453-4bbf-956a-f1b6e882f0b4 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c3eae7-e453-4bbf-956a-f1b6e882f0b4 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c3eae7-e453-4bbf-956a-f1b6e882f0b4 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c3eae7-e453-4bbf-956a-f1b6e882f0b4 None admin] PATH_INFO: `/v3/domains` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5cf5c3-3d7c-45bb-a99d-77fa39f9cf4a None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c3eae7-e453-4bbf-956a-f1b6e882f0b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=51267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c3eae7-e453-4bbf-956a-f1b6e882f0b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c3eae7-e453-4bbf-956a-f1b6e882f0b4 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174f0b0f-5af4-486d-9134-bb301f049692 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174f0b0f-5af4-486d-9134-bb301f049692 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174f0b0f-5af4-486d-9134-bb301f049692 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174f0b0f-5af4-486d-9134-bb301f049692 None admin] PATH_INFO: `/v3/domains` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174f0b0f-5af4-486d-9134-bb301f049692 None admin] RBAC: Adding query filter params (name=Default) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174f0b0f-5af4-486d-9134-bb301f049692 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174f0b0f-5af4-486d-9134-bb301f049692 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 614/1215] 10.27.203.238 () {62 vars in 1220 bytes} [Tue May 28 12:56:22 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c3eae7-e453-4bbf-956a-f1b6e882f0b4 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 602/1216] 10.27.203.238 () {62 vars in 1220 bytes} [Tue May 28 12:56:22 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:56:22 l75lg1-v1 manila-scheduler[98327]: DEBUG dbcounter [-] [98327] Writing DB stats manila:SELECT=4,manila:UPDATE=1 {{(pid=98327) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174f0b0f-5af4-486d-9134-bb301f049692 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c3eae7-e453-4bbf-956a-f1b6e882f0b4 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1525e9-84a2-4191-84fb-dd8ee04c9ef3 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1525e9-84a2-4191-84fb-dd8ee04c9ef3 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1525e9-84a2-4191-84fb-dd8ee04c9ef3 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1525e9-84a2-4191-84fb-dd8ee04c9ef3 None admin] PATH_INFO: `/v3/domains` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1525e9-84a2-4191-84fb-dd8ee04c9ef3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=51267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1525e9-84a2-4191-84fb-dd8ee04c9ef3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174f0b0f-5af4-486d-9134-bb301f049692 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1525e9-84a2-4191-84fb-dd8ee04c9ef3 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def1c045-d013-4fc5-9719-aec72dc6f474 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def1c045-d013-4fc5-9719-aec72dc6f474 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def1c045-d013-4fc5-9719-aec72dc6f474 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def1c045-d013-4fc5-9719-aec72dc6f474 None admin] PATH_INFO: `/v3/domains` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def1c045-d013-4fc5-9719-aec72dc6f474 None admin] RBAC: Adding query filter params (name=Default) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def1c045-d013-4fc5-9719-aec72dc6f474 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def1c045-d013-4fc5-9719-aec72dc6f474 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 615/1217] 10.27.203.238 () {62 vars in 1220 bytes} [Tue May 28 12:56:22 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1525e9-84a2-4191-84fb-dd8ee04c9ef3 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1525e9-84a2-4191-84fb-dd8ee04c9ef3 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 603/1218] 10.27.203.238 () {62 vars in 1220 bytes} [Tue May 28 12:56:22 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def1c045-d013-4fc5-9719-aec72dc6f474 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec12883-5515-44ed-976f-206b8e229efa None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec12883-5515-44ed-976f-206b8e229efa None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec12883-5515-44ed-976f-206b8e229efa None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec12883-5515-44ed-976f-206b8e229efa None admin] PATH_INFO: `/v3/projects` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec12883-5515-44ed-976f-206b8e229efa None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec12883-5515-44ed-976f-206b8e229efa None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def1c045-d013-4fc5-9719-aec72dc6f474 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621bb599-c5d4-426e-8827-93284b3af08f None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621bb599-c5d4-426e-8827-93284b3af08f None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621bb599-c5d4-426e-8827-93284b3af08f None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621bb599-c5d4-426e-8827-93284b3af08f None admin] PATH_INFO: `/v3/projects` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621bb599-c5d4-426e-8827-93284b3af08f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621bb599-c5d4-426e-8827-93284b3af08f None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 616/1219] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 12:56:22 2024] POST /identity/v3/projects => generated 387 bytes in 32 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec12883-5515-44ed-976f-206b8e229efa None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 604/1220] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 12:56:22 2024] POST /identity/v3/projects => generated 375 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621bb599-c5d4-426e-8827-93284b3af08f None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec12883-5515-44ed-976f-206b8e229efa None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621bb599-c5d4-426e-8827-93284b3af08f None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c72bad-cc7e-4ad3-831e-0607b5b71a55 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c72bad-cc7e-4ad3-831e-0607b5b71a55 None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c72bad-cc7e-4ad3-831e-0607b5b71a55 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c72bad-cc7e-4ad3-831e-0607b5b71a55 None admin] PATH_INFO: `/v3/projects` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c72bad-cc7e-4ad3-831e-0607b5b71a55 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c72bad-cc7e-4ad3-831e-0607b5b71a55 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a68960-75db-4344-b6cd-7d98b2239b62 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a68960-75db-4344-b6cd-7d98b2239b62 None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a68960-75db-4344-b6cd-7d98b2239b62 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a68960-75db-4344-b6cd-7d98b2239b62 None admin] PATH_INFO: `/v3/projects` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a68960-75db-4344-b6cd-7d98b2239b62 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a68960-75db-4344-b6cd-7d98b2239b62 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 617/1221] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 12:56:22 2024] POST /identity/v3/projects => generated 405 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c72bad-cc7e-4ad3-831e-0607b5b71a55 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 605/1222] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 12:56:22 2024] POST /identity/v3/projects => generated 371 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a68960-75db-4344-b6cd-7d98b2239b62 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c72bad-cc7e-4ad3-831e-0607b5b71a55 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:22 l75lg1-v1 manila-share[98474]: DEBUG dbcounter [-] [98474] Writing DB stats manila:SELECT=4,manila:INSERT=1 {{(pid=98474) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62297c7c-73f9-447c-88b9-74120faded3a None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62297c7c-73f9-447c-88b9-74120faded3a None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62297c7c-73f9-447c-88b9-74120faded3a None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62297c7c-73f9-447c-88b9-74120faded3a None admin] PATH_INFO: `/v3/users` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a68960-75db-4344-b6cd-7d98b2239b62 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62297c7c-73f9-447c-88b9-74120faded3a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62297c7c-73f9-447c-88b9-74120faded3a None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-62297c7c-73f9-447c-88b9-74120faded3a None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9a57c0-9fba-4a39-9d7e-88a04c0c6379 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9a57c0-9fba-4a39-9d7e-88a04c0c6379 None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9a57c0-9fba-4a39-9d7e-88a04c0c6379 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9a57c0-9fba-4a39-9d7e-88a04c0c6379 None admin] PATH_INFO: `/v3/users` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9a57c0-9fba-4a39-9d7e-88a04c0c6379 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9a57c0-9fba-4a39-9d7e-88a04c0c6379 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-db9a57c0-9fba-4a39-9d7e-88a04c0c6379 None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 618/1223] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 12:56:22 2024] POST /identity/v3/users => generated 302 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494f87cf-f39b-4245-96e3-4b57b4827bb7 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494f87cf-f39b-4245-96e3-4b57b4827bb7 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494f87cf-f39b-4245-96e3-4b57b4827bb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 606/1224] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 12:56:22 2024] POST /identity/v3/users => generated 296 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:56:22 l75lg1-v1 dstat.sh[49771]: 28-05 12:56:22| 40 5 52 1 0|5552M 1965M 277M 7832M| 54k 444k| 0 1884k| 0 155 | 16k 26k|1.66 0.93 0.96|4.0 2.0 0| 0 0 | 0 2048M| 29 326 0 22 0 May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9a57c0-9fba-4a39-9d7e-88a04c0c6379 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-494f87cf-f39b-4245-96e3-4b57b4827bb7 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9a57c0-9fba-4a39-9d7e-88a04c0c6379 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-494f87cf-f39b-4245-96e3-4b57b4827bb7 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-494f87cf-f39b-4245-96e3-4b57b4827bb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abdd19e-0312-48ba-96ba-028c267eab15 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abdd19e-0312-48ba-96ba-028c267eab15 None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abdd19e-0312-48ba-96ba-028c267eab15 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abdd19e-0312-48ba-96ba-028c267eab15 None admin] PATH_INFO: `/v3/users` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 619/1225] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:56:22 2024] POST /identity/v3/auth/tokens => generated 312 bytes in 22 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abdd19e-0312-48ba-96ba-028c267eab15 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494f87cf-f39b-4245-96e3-4b57b4827bb7 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abdd19e-0312-48ba-96ba-028c267eab15 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-9abdd19e-0312-48ba-96ba-028c267eab15 None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494f87cf-f39b-4245-96e3-4b57b4827bb7 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7514b8a-3f47-4dac-ad50-14783dddc065 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7514b8a-3f47-4dac-ad50-14783dddc065 None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7514b8a-3f47-4dac-ad50-14783dddc065 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7514b8a-3f47-4dac-ad50-14783dddc065 None admin] PATH_INFO: `/v3/users` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7514b8a-3f47-4dac-ad50-14783dddc065 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7514b8a-3f47-4dac-ad50-14783dddc065 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-c7514b8a-3f47-4dac-ad50-14783dddc065 None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 607/1226] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 12:56:22 2024] POST /identity/v3/users => generated 310 bytes in 32 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abdd19e-0312-48ba-96ba-028c267eab15 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abdd19e-0312-48ba-96ba-028c267eab15 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b419a79c-10c7-4c71-b189-2828a142ba83 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b419a79c-10c7-4c71-b189-2828a142ba83 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b419a79c-10c7-4c71-b189-2828a142ba83 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b419a79c-10c7-4c71-b189-2828a142ba83 None admin] PATH_INFO: `/v3/roles` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b419a79c-10c7-4c71-b189-2828a142ba83 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b419a79c-10c7-4c71-b189-2828a142ba83 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 620/1227] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 12:56:22 2024] POST /identity/v3/users => generated 293 bytes in 33 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7514b8a-3f47-4dac-ad50-14783dddc065 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7514b8a-3f47-4dac-ad50-14783dddc065 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4e726b-69c3-4c3a-8e3d-7a1383eb7db0 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4e726b-69c3-4c3a-8e3d-7a1383eb7db0 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4e726b-69c3-4c3a-8e3d-7a1383eb7db0 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4e726b-69c3-4c3a-8e3d-7a1383eb7db0 None admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4e726b-69c3-4c3a-8e3d-7a1383eb7db0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4e726b-69c3-4c3a-8e3d-7a1383eb7db0 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 608/1228] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 12:56:22 2024] GET /identity/v3/roles => generated 1680 bytes in 19 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b38ad62-f252-4b53-83bf-549af983bdb3 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b38ad62-f252-4b53-83bf-549af983bdb3 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b38ad62-f252-4b53-83bf-549af983bdb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 621/1229] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 12:56:22 2024] GET /identity/v3/roles => generated 1680 bytes in 15 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4e726b-69c3-4c3a-8e3d-7a1383eb7db0 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4e726b-69c3-4c3a-8e3d-7a1383eb7db0 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-4b38ad62-f252-4b53-83bf-549af983bdb3 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408347d4-4218-4a3f-8894-8e855499f6a3 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408347d4-4218-4a3f-8894-8e855499f6a3 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408347d4-4218-4a3f-8894-8e855499f6a3 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408347d4-4218-4a3f-8894-8e855499f6a3 None admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408347d4-4218-4a3f-8894-8e855499f6a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408347d4-4218-4a3f-8894-8e855499f6a3 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-4b38ad62-f252-4b53-83bf-549af983bdb3 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-4b38ad62-f252-4b53-83bf-549af983bdb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 609/1230] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:56:22 2024] POST /identity/v3/auth/tokens => generated 2960 bytes in 21 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 622/1231] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 12:56:22 2024] GET /identity/v3/roles => generated 1680 bytes in 15 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b38ad62-f252-4b53-83bf-549af983bdb3 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408347d4-4218-4a3f-8894-8e855499f6a3 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b38ad62-f252-4b53-83bf-549af983bdb3 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408347d4-4218-4a3f-8894-8e855499f6a3 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a56c54-cc8d-4862-b7fc-10a6ca9bfb9b None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a56c54-cc8d-4862-b7fc-10a6ca9bfb9b None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a56c54-cc8d-4862-b7fc-10a6ca9bfb9b None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a56c54-cc8d-4862-b7fc-10a6ca9bfb9b None admin] PATH_INFO: `/v3/roles` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903968ba-5329-44c5-a772-129b6d44e86f None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a56c54-cc8d-4862-b7fc-10a6ca9bfb9b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903968ba-5329-44c5-a772-129b6d44e86f None admin] REQUEST_METHOD: `PUT` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903968ba-5329-44c5-a772-129b6d44e86f None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903968ba-5329-44c5-a772-129b6d44e86f None admin] PATH_INFO: `/v3/projects/f65d9e20f04c46548e43d5b813dea402/users/d39535fed98e4d65bc3b89975b5f70f9/roles/44620cad10ae407c90c91e2c296adb04` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a56c54-cc8d-4862-b7fc-10a6ca9bfb9b None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 610/1232] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 12:56:22 2024] GET /identity/v3/roles => generated 1680 bytes in 14 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a56c54-cc8d-4862-b7fc-10a6ca9bfb9b None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a56c54-cc8d-4862-b7fc-10a6ca9bfb9b None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903968ba-5329-44c5-a772-129b6d44e86f None admin] RBAC: Authorizing `identity:create_grant(project_id=f65d9e20f04c46548e43d5b813dea402, user_id=d39535fed98e4d65bc3b89975b5f70f9, role_id=44620cad10ae407c90c91e2c296adb04)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903968ba-5329-44c5-a772-129b6d44e86f None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5734d977-825d-4bcf-a5a7-cbae7b98e0bb None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5734d977-825d-4bcf-a5a7-cbae7b98e0bb None admin] REQUEST_METHOD: `PUT` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5734d977-825d-4bcf-a5a7-cbae7b98e0bb None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5734d977-825d-4bcf-a5a7-cbae7b98e0bb None admin] PATH_INFO: `/v3/projects/8424fd15a45946d88b09f929bb149784/users/e69e25494813402195766fc7ed35b358/roles/44620cad10ae407c90c91e2c296adb04` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5734d977-825d-4bcf-a5a7-cbae7b98e0bb None admin] RBAC: Authorizing `identity:create_grant(project_id=8424fd15a45946d88b09f929bb149784, user_id=e69e25494813402195766fc7ed35b358, role_id=44620cad10ae407c90c91e2c296adb04)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5734d977-825d-4bcf-a5a7-cbae7b98e0bb None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 623/1233] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 12:56:22 2024] PUT /identity/v3/projects/f65d9e20f04c46548e43d5b813dea402/users/d39535fed98e4d65bc3b89975b5f70f9/roles/44620cad10ae407c90c91e2c296adb04 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903968ba-5329-44c5-a772-129b6d44e86f None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 611/1234] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 12:56:22 2024] PUT /identity/v3/projects/8424fd15a45946d88b09f929bb149784/users/e69e25494813402195766fc7ed35b358/roles/44620cad10ae407c90c91e2c296adb04 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5734d977-825d-4bcf-a5a7-cbae7b98e0bb None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903968ba-5329-44c5-a772-129b6d44e86f None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5734d977-825d-4bcf-a5a7-cbae7b98e0bb None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5689558c-475e-4dbc-924f-118547a7f3e4 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5689558c-475e-4dbc-924f-118547a7f3e4 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5689558c-475e-4dbc-924f-118547a7f3e4 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5689558c-475e-4dbc-924f-118547a7f3e4 None admin] PATH_INFO: `/v3/domains` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5689558c-475e-4dbc-924f-118547a7f3e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5689558c-475e-4dbc-924f-118547a7f3e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5689558c-475e-4dbc-924f-118547a7f3e4 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1238464f-0644-495c-b3ce-05397cd24a2d None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1238464f-0644-495c-b3ce-05397cd24a2d None admin] REQUEST_METHOD: `PUT` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1238464f-0644-495c-b3ce-05397cd24a2d None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1238464f-0644-495c-b3ce-05397cd24a2d None admin] PATH_INFO: `/v3/projects/8cf929567af24bf185c33b3a12b4533c/users/52e0c20c9fad483c8d05bec6f25acd61/roles/e7989893488f483baa107be56668c4f8` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 612/1235] 10.27.203.238 () {62 vars in 1220 bytes} [Tue May 28 12:56:22 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5689558c-475e-4dbc-924f-118547a7f3e4 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5689558c-475e-4dbc-924f-118547a7f3e4 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f478a9eb-c3f2-4ddf-8e21-cd221c3074e9 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f478a9eb-c3f2-4ddf-8e21-cd221c3074e9 None admin] REQUEST_METHOD: `PUT` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f478a9eb-c3f2-4ddf-8e21-cd221c3074e9 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f478a9eb-c3f2-4ddf-8e21-cd221c3074e9 None admin] PATH_INFO: `/v3/projects/a3499cb78849424db45e54caac01de92/users/45c250a71fab4a03be12a8532abf88a1/roles/e7989893488f483baa107be56668c4f8` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1238464f-0644-495c-b3ce-05397cd24a2d None admin] RBAC: Authorizing `identity:create_grant(project_id=8cf929567af24bf185c33b3a12b4533c, user_id=52e0c20c9fad483c8d05bec6f25acd61, role_id=e7989893488f483baa107be56668c4f8)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1238464f-0644-495c-b3ce-05397cd24a2d None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f478a9eb-c3f2-4ddf-8e21-cd221c3074e9 None admin] RBAC: Authorizing `identity:create_grant(project_id=a3499cb78849424db45e54caac01de92, user_id=45c250a71fab4a03be12a8532abf88a1, role_id=e7989893488f483baa107be56668c4f8)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f478a9eb-c3f2-4ddf-8e21-cd221c3074e9 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 624/1236] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 12:56:22 2024] PUT /identity/v3/projects/8cf929567af24bf185c33b3a12b4533c/users/52e0c20c9fad483c8d05bec6f25acd61/roles/e7989893488f483baa107be56668c4f8 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e680c538-2d1d-4160-914e-0b689827ebf1 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e680c538-2d1d-4160-914e-0b689827ebf1 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e680c538-2d1d-4160-914e-0b689827ebf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-e680c538-2d1d-4160-914e-0b689827ebf1 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 613/1237] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 12:56:22 2024] PUT /identity/v3/projects/a3499cb78849424db45e54caac01de92/users/45c250a71fab4a03be12a8532abf88a1/roles/e7989893488f483baa107be56668c4f8 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980ed0d6-74dd-407e-9b90-1757b2107475 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980ed0d6-74dd-407e-9b90-1757b2107475 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980ed0d6-74dd-407e-9b90-1757b2107475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-e680c538-2d1d-4160-914e-0b689827ebf1 None None] MFA Rules not processed for user `d39535fed98e4d65bc3b89975b5f70f9`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-e680c538-2d1d-4160-914e-0b689827ebf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-980ed0d6-74dd-407e-9b90-1757b2107475 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-980ed0d6-74dd-407e-9b90-1757b2107475 None None] MFA Rules not processed for user `e69e25494813402195766fc7ed35b358`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-980ed0d6-74dd-407e-9b90-1757b2107475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 625/1238] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:56:22 2024] POST /identity/v3/auth/tokens => generated 3958 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e680c538-2d1d-4160-914e-0b689827ebf1 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 614/1239] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:56:22 2024] POST /identity/v3/auth/tokens => generated 3946 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980ed0d6-74dd-407e-9b90-1757b2107475 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e680c538-2d1d-4160-914e-0b689827ebf1 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8327c974-d4fd-41a8-81a7-8e8dbf6395a5 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8327c974-d4fd-41a8-81a7-8e8dbf6395a5 None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8327c974-d4fd-41a8-81a7-8e8dbf6395a5 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8327c974-d4fd-41a8-81a7-8e8dbf6395a5 None admin] PATH_INFO: `/v3/projects` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8327c974-d4fd-41a8-81a7-8e8dbf6395a5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8327c974-d4fd-41a8-81a7-8e8dbf6395a5 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980ed0d6-74dd-407e-9b90-1757b2107475 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5a41fd-11d1-4806-9a74-274fd367dbaf None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5a41fd-11d1-4806-9a74-274fd367dbaf None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5a41fd-11d1-4806-9a74-274fd367dbaf None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5a41fd-11d1-4806-9a74-274fd367dbaf None admin] PATH_INFO: `/v3/roles` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5a41fd-11d1-4806-9a74-274fd367dbaf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5a41fd-11d1-4806-9a74-274fd367dbaf None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 615/1240] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 12:56:22 2024] GET /identity/v3/roles => generated 1680 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5a41fd-11d1-4806-9a74-274fd367dbaf None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5a41fd-11d1-4806-9a74-274fd367dbaf None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed782c4-c25f-4358-9da8-4c4a5d0f1dcd None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed782c4-c25f-4358-9da8-4c4a5d0f1dcd None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed782c4-c25f-4358-9da8-4c4a5d0f1dcd None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed782c4-c25f-4358-9da8-4c4a5d0f1dcd None admin] PATH_INFO: `/v3/roles` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed782c4-c25f-4358-9da8-4c4a5d0f1dcd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 626/1241] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 12:56:22 2024] POST /identity/v3/projects => generated 399 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed782c4-c25f-4358-9da8-4c4a5d0f1dcd None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8327c974-d4fd-41a8-81a7-8e8dbf6395a5 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 616/1242] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 12:56:22 2024] GET /identity/v3/roles => generated 1680 bytes in 15 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed782c4-c25f-4358-9da8-4c4a5d0f1dcd None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed782c4-c25f-4358-9da8-4c4a5d0f1dcd None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8327c974-d4fd-41a8-81a7-8e8dbf6395a5 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabfcd31-db37-42fb-9ac1-85d3af5de21f None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabfcd31-db37-42fb-9ac1-85d3af5de21f None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabfcd31-db37-42fb-9ac1-85d3af5de21f None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabfcd31-db37-42fb-9ac1-85d3af5de21f None admin] PATH_INFO: `/v3/projects` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabfcd31-db37-42fb-9ac1-85d3af5de21f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabfcd31-db37-42fb-9ac1-85d3af5de21f None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fbe5bb-790d-4dfd-93bd-02a918ff23af None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fbe5bb-790d-4dfd-93bd-02a918ff23af None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fbe5bb-790d-4dfd-93bd-02a918ff23af None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fbe5bb-790d-4dfd-93bd-02a918ff23af None admin] PATH_INFO: `/v3/projects` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fbe5bb-790d-4dfd-93bd-02a918ff23af None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fbe5bb-790d-4dfd-93bd-02a918ff23af None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 627/1243] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 12:56:22 2024] POST /identity/v3/projects => generated 387 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabfcd31-db37-42fb-9ac1-85d3af5de21f None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 617/1244] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 12:56:22 2024] POST /identity/v3/projects => generated 375 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fbe5bb-790d-4dfd-93bd-02a918ff23af None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabfcd31-db37-42fb-9ac1-85d3af5de21f None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fbe5bb-790d-4dfd-93bd-02a918ff23af None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f71135-31b0-4764-957b-610e80331f30 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f71135-31b0-4764-957b-610e80331f30 None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f71135-31b0-4764-957b-610e80331f30 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f71135-31b0-4764-957b-610e80331f30 None admin] PATH_INFO: `/v3/users` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f71135-31b0-4764-957b-610e80331f30 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f71135-31b0-4764-957b-610e80331f30 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-00f71135-31b0-4764-957b-610e80331f30 None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b248fcf3-183e-4787-ad64-4470d878f57f None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b248fcf3-183e-4787-ad64-4470d878f57f None admin] REQUEST_METHOD: `PUT` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b248fcf3-183e-4787-ad64-4470d878f57f None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b248fcf3-183e-4787-ad64-4470d878f57f None admin] PATH_INFO: `/v3/projects/8cf929567af24bf185c33b3a12b4533c/users/52e0c20c9fad483c8d05bec6f25acd61/roles/e7989893488f483baa107be56668c4f8` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b248fcf3-183e-4787-ad64-4470d878f57f None admin] RBAC: Authorizing `identity:create_grant(project_id=8cf929567af24bf185c33b3a12b4533c, user_id=52e0c20c9fad483c8d05bec6f25acd61, role_id=e7989893488f483baa107be56668c4f8)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b248fcf3-183e-4787-ad64-4470d878f57f None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 628/1245] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 12:56:22 2024] PUT /identity/v3/projects/8cf929567af24bf185c33b3a12b4533c/users/52e0c20c9fad483c8d05bec6f25acd61/roles/e7989893488f483baa107be56668c4f8 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b248fcf3-183e-4787-ad64-4470d878f57f None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 618/1246] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 12:56:22 2024] POST /identity/v3/users => generated 308 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f71135-31b0-4764-957b-610e80331f30 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f71135-31b0-4764-957b-610e80331f30 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b248fcf3-183e-4787-ad64-4470d878f57f None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27f06be-29ec-43af-b317-0e43469ff726 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27f06be-29ec-43af-b317-0e43469ff726 None admin] REQUEST_METHOD: `PUT` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27f06be-29ec-43af-b317-0e43469ff726 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27f06be-29ec-43af-b317-0e43469ff726 None admin] PATH_INFO: `/v3/projects/a3499cb78849424db45e54caac01de92/users/45c250a71fab4a03be12a8532abf88a1/roles/e7989893488f483baa107be56668c4f8` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27f06be-29ec-43af-b317-0e43469ff726 None admin] RBAC: Authorizing `identity:create_grant(project_id=a3499cb78849424db45e54caac01de92, user_id=45c250a71fab4a03be12a8532abf88a1, role_id=e7989893488f483baa107be56668c4f8)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef6c487-f6d6-42d3-af2b-4fcd8b804a82 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef6c487-f6d6-42d3-af2b-4fcd8b804a82 None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef6c487-f6d6-42d3-af2b-4fcd8b804a82 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef6c487-f6d6-42d3-af2b-4fcd8b804a82 None admin] PATH_INFO: `/v3/users` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27f06be-29ec-43af-b317-0e43469ff726 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef6c487-f6d6-42d3-af2b-4fcd8b804a82 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef6c487-f6d6-42d3-af2b-4fcd8b804a82 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-8ef6c487-f6d6-42d3-af2b-4fcd8b804a82 None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 629/1247] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 12:56:22 2024] PUT /identity/v3/projects/a3499cb78849424db45e54caac01de92/users/45c250a71fab4a03be12a8532abf88a1/roles/e7989893488f483baa107be56668c4f8 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27f06be-29ec-43af-b317-0e43469ff726 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 619/1248] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 12:56:22 2024] POST /identity/v3/users => generated 302 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d047da9a-b9fa-4fac-9b10-a04fa7800040 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d047da9a-b9fa-4fac-9b10-a04fa7800040 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d047da9a-b9fa-4fac-9b10-a04fa7800040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-d047da9a-b9fa-4fac-9b10-a04fa7800040 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27f06be-29ec-43af-b317-0e43469ff726 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a69a80-6f64-45c3-8e7d-a6b9badbcf46 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a69a80-6f64-45c3-8e7d-a6b9badbcf46 None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a69a80-6f64-45c3-8e7d-a6b9badbcf46 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a69a80-6f64-45c3-8e7d-a6b9badbcf46 None admin] PATH_INFO: `/v3/users` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-d047da9a-b9fa-4fac-9b10-a04fa7800040 None None] MFA Rules not processed for user `52e0c20c9fad483c8d05bec6f25acd61`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a69a80-6f64-45c3-8e7d-a6b9badbcf46 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-d047da9a-b9fa-4fac-9b10-a04fa7800040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a69a80-6f64-45c3-8e7d-a6b9badbcf46 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-d8a69a80-6f64-45c3-8e7d-a6b9badbcf46 None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 630/1249] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 12:56:22 2024] POST /identity/v3/users => generated 296 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a69a80-6f64-45c3-8e7d-a6b9badbcf46 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a69a80-6f64-45c3-8e7d-a6b9badbcf46 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477e5560-79dd-4683-8096-cde7ffd3ad18 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477e5560-79dd-4683-8096-cde7ffd3ad18 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477e5560-79dd-4683-8096-cde7ffd3ad18 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477e5560-79dd-4683-8096-cde7ffd3ad18 None admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477e5560-79dd-4683-8096-cde7ffd3ad18 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477e5560-79dd-4683-8096-cde7ffd3ad18 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 631/1250] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 12:56:22 2024] GET /identity/v3/roles => generated 1680 bytes in 18 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831be51b-fca5-4d5b-9fda-7ee2acdf1128 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831be51b-fca5-4d5b-9fda-7ee2acdf1128 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831be51b-fca5-4d5b-9fda-7ee2acdf1128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 620/1251] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:56:22 2024] POST /identity/v3/auth/tokens => generated 4099 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d047da9a-b9fa-4fac-9b10-a04fa7800040 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d047da9a-b9fa-4fac-9b10-a04fa7800040 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649ee9f3-d04e-4fd4-b0a6-8c112b3d2e16 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649ee9f3-d04e-4fd4-b0a6-8c112b3d2e16 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649ee9f3-d04e-4fd4-b0a6-8c112b3d2e16 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649ee9f3-d04e-4fd4-b0a6-8c112b3d2e16 None admin] PATH_INFO: `/v3/roles` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649ee9f3-d04e-4fd4-b0a6-8c112b3d2e16 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649ee9f3-d04e-4fd4-b0a6-8c112b3d2e16 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-831be51b-fca5-4d5b-9fda-7ee2acdf1128 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 621/1252] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 12:56:22 2024] GET /identity/v3/roles => generated 1680 bytes in 15 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649ee9f3-d04e-4fd4-b0a6-8c112b3d2e16 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-831be51b-fca5-4d5b-9fda-7ee2acdf1128 None None] MFA Rules not processed for user `45c250a71fab4a03be12a8532abf88a1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649ee9f3-d04e-4fd4-b0a6-8c112b3d2e16 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-831be51b-fca5-4d5b-9fda-7ee2acdf1128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03c8b45-628f-47ea-8de1-85960284dbd0 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03c8b45-628f-47ea-8de1-85960284dbd0 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03c8b45-628f-47ea-8de1-85960284dbd0 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03c8b45-628f-47ea-8de1-85960284dbd0 None admin] PATH_INFO: `/v3/roles` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03c8b45-628f-47ea-8de1-85960284dbd0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03c8b45-628f-47ea-8de1-85960284dbd0 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 622/1253] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 12:56:22 2024] GET /identity/v3/roles => generated 1680 bytes in 14 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03c8b45-628f-47ea-8de1-85960284dbd0 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03c8b45-628f-47ea-8de1-85960284dbd0 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81525a33-7d5d-4628-94f7-99a5e0045558 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81525a33-7d5d-4628-94f7-99a5e0045558 None admin] REQUEST_METHOD: `PUT` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81525a33-7d5d-4628-94f7-99a5e0045558 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81525a33-7d5d-4628-94f7-99a5e0045558 None admin] PATH_INFO: `/v3/projects/cfaeb31ba56441e0b06355cc09ec1103/users/fc670cd52975471e86e32fd1f5a5229e/roles/44620cad10ae407c90c91e2c296adb04` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81525a33-7d5d-4628-94f7-99a5e0045558 None admin] RBAC: Authorizing `identity:create_grant(project_id=cfaeb31ba56441e0b06355cc09ec1103, user_id=fc670cd52975471e86e32fd1f5a5229e, role_id=44620cad10ae407c90c91e2c296adb04)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81525a33-7d5d-4628-94f7-99a5e0045558 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 623/1254] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 12:56:22 2024] PUT /identity/v3/projects/cfaeb31ba56441e0b06355cc09ec1103/users/fc670cd52975471e86e32fd1f5a5229e/roles/44620cad10ae407c90c91e2c296adb04 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bd624f-9248-4d0a-ad4e-cdf87a117bbc None None] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bd624f-9248-4d0a-ad4e-cdf87a117bbc None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bd624f-9248-4d0a-ad4e-cdf87a117bbc None None] PATH_INFO: `/` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 624/1255] 10.27.203.238 () {58 vars in 1052 bytes} [Tue May 28 12:56:22 2024] GET /identity => generated 272 bytes in 1 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bd624f-9248-4d0a-ad4e-cdf87a117bbc None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 632/1256] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:56:22 2024] POST /identity/v3/auth/tokens => generated 4065 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831be51b-fca5-4d5b-9fda-7ee2acdf1128 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831be51b-fca5-4d5b-9fda-7ee2acdf1128 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bd624f-9248-4d0a-ad4e-cdf87a117bbc None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2d9f89-ae08-4acd-aadd-bade583eafcf None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2d9f89-ae08-4acd-aadd-bade583eafcf None admin] REQUEST_METHOD: `PUT` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2d9f89-ae08-4acd-aadd-bade583eafcf None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2d9f89-ae08-4acd-aadd-bade583eafcf None admin] PATH_INFO: `/v3/projects/a1081c7165a546ba892481e67689dc5b/users/ae1ab8d3c7fc4adfac5cafc1d232caef/roles/44620cad10ae407c90c91e2c296adb04` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fe84a9-81e0-4a50-b3df-40fd7b4a2abf None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fe84a9-81e0-4a50-b3df-40fd7b4a2abf None admin] REQUEST_METHOD: `PUT` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fe84a9-81e0-4a50-b3df-40fd7b4a2abf None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fe84a9-81e0-4a50-b3df-40fd7b4a2abf None admin] PATH_INFO: `/v3/projects/c7f3335cb99f4306a8a60853bfd867c3/users/0dc74ee9978c4df8b2e1e0046193d9ca/roles/44620cad10ae407c90c91e2c296adb04` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2d9f89-ae08-4acd-aadd-bade583eafcf None admin] RBAC: Authorizing `identity:create_grant(project_id=a1081c7165a546ba892481e67689dc5b, user_id=ae1ab8d3c7fc4adfac5cafc1d232caef, role_id=44620cad10ae407c90c91e2c296adb04)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2d9f89-ae08-4acd-aadd-bade583eafcf None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fe84a9-81e0-4a50-b3df-40fd7b4a2abf None admin] RBAC: Authorizing `identity:create_grant(project_id=c7f3335cb99f4306a8a60853bfd867c3, user_id=0dc74ee9978c4df8b2e1e0046193d9ca, role_id=44620cad10ae407c90c91e2c296adb04)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fe84a9-81e0-4a50-b3df-40fd7b4a2abf None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 625/1257] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 12:56:22 2024] PUT /identity/v3/projects/a1081c7165a546ba892481e67689dc5b/users/ae1ab8d3c7fc4adfac5cafc1d232caef/roles/44620cad10ae407c90c91e2c296adb04 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdcb9d2-3d1e-4be6-9041-27d7dffdc645 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdcb9d2-3d1e-4be6-9041-27d7dffdc645 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdcb9d2-3d1e-4be6-9041-27d7dffdc645 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 633/1258] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 12:56:22 2024] PUT /identity/v3/projects/c7f3335cb99f4306a8a60853bfd867c3/users/0dc74ee9978c4df8b2e1e0046193d9ca/roles/44620cad10ae407c90c91e2c296adb04 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31e2b7f-2552-4a98-bcde-794e5e3e2438 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31e2b7f-2552-4a98-bcde-794e5e3e2438 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31e2b7f-2552-4a98-bcde-794e5e3e2438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-cfdcb9d2-3d1e-4be6-9041-27d7dffdc645 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-a31e2b7f-2552-4a98-bcde-794e5e3e2438 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-cfdcb9d2-3d1e-4be6-9041-27d7dffdc645 None None] MFA Rules not processed for user `fc670cd52975471e86e32fd1f5a5229e`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-a31e2b7f-2552-4a98-bcde-794e5e3e2438 None None] MFA Rules not processed for user `f110cf6300f049c897d0aab63218d1e5`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-cfdcb9d2-3d1e-4be6-9041-27d7dffdc645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-a31e2b7f-2552-4a98-bcde-794e5e3e2438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 634/1259] 10.27.203.238 () {62 vars in 1149 bytes} [Tue May 28 12:56:22 2024] POST /identity/v3/auth/tokens => generated 3809 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09498e4e-87f6-40b8-b9d6-b1b8add70045 None None] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09498e4e-87f6-40b8-b9d6-b1b8add70045 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09498e4e-87f6-40b8-b9d6-b1b8add70045 None None] PATH_INFO: `/` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 635/1260] 10.27.203.238 () {58 vars in 1052 bytes} [Tue May 28 12:56:22 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a106d2-e395-47e5-a6f2-6f843008ba9e None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a106d2-e395-47e5-a6f2-6f843008ba9e None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a106d2-e395-47e5-a6f2-6f843008ba9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 626/1261] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:56:22 2024] POST /identity/v3/auth/tokens => generated 3970 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f51f20-59af-4565-9f73-206c067a3340 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f51f20-59af-4565-9f73-206c067a3340 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f51f20-59af-4565-9f73-206c067a3340 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-43a106d2-e395-47e5-a6f2-6f843008ba9e None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-55f51f20-59af-4565-9f73-206c067a3340 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-43a106d2-e395-47e5-a6f2-6f843008ba9e None None] MFA Rules not processed for user `ae1ab8d3c7fc4adfac5cafc1d232caef`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-43a106d2-e395-47e5-a6f2-6f843008ba9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-55f51f20-59af-4565-9f73-206c067a3340 None None] MFA Rules not processed for user `0dc74ee9978c4df8b2e1e0046193d9ca`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-55f51f20-59af-4565-9f73-206c067a3340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 636/1262] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:56:22 2024] POST /identity/v3/auth/tokens => generated 3958 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a106d2-e395-47e5-a6f2-6f843008ba9e None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 627/1263] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:56:23 2024] POST /identity/v3/auth/tokens => generated 3946 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdf4840-962c-41e5-ae0f-07d158d7a776 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdf4840-962c-41e5-ae0f-07d158d7a776 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdf4840-962c-41e5-ae0f-07d158d7a776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a106d2-e395-47e5-a6f2-6f843008ba9e None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0be2c6d-8095-4766-b56d-e08deb9dd140 service manila] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f110cf6300f049c897d0aab63218d1e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0be2c6d-8095-4766-b56d-e08deb9dd140 service manila] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0be2c6d-8095-4766-b56d-e08deb9dd140 service manila] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0be2c6d-8095-4766-b56d-e08deb9dd140 service manila] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-bfdf4840-962c-41e5-ae0f-07d158d7a776 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-bfdf4840-962c-41e5-ae0f-07d158d7a776 None None] MFA Rules not processed for user `f110cf6300f049c897d0aab63218d1e5`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-bfdf4840-962c-41e5-ae0f-07d158d7a776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 628/1264] 10.27.203.238 () {62 vars in 1149 bytes} [Tue May 28 12:56:23 2024] POST /identity/v3/auth/tokens => generated 3809 bytes in 21 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdf4840-962c-41e5-ae0f-07d158d7a776 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdf4840-962c-41e5-ae0f-07d158d7a776 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0be2c6d-8095-4766-b56d-e08deb9dd140 service manila] RBAC: Authorizing `identity:validate_token()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5b33dc-c975-41ac-b644-b3f9a3744ea9 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0be2c6d-8095-4766-b56d-e08deb9dd140 service manila] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5b33dc-c975-41ac-b644-b3f9a3744ea9 None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5b33dc-c975-41ac-b644-b3f9a3744ea9 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5b33dc-c975-41ac-b644-b3f9a3744ea9 None admin] PATH_INFO: `/v3/projects` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5b33dc-c975-41ac-b644-b3f9a3744ea9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5b33dc-c975-41ac-b644-b3f9a3744ea9 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 637/1265] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 12:56:23 2024] GET /identity/v3/auth/tokens => generated 4099 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0be2c6d-8095-4766-b56d-e08deb9dd140 service manila] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0be2c6d-8095-4766-b56d-e08deb9dd140 service manila] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95bca21-b2b2-418e-93da-10915f905b8f None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95bca21-b2b2-418e-93da-10915f905b8f None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95bca21-b2b2-418e-93da-10915f905b8f None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95bca21-b2b2-418e-93da-10915f905b8f None admin] PATH_INFO: `/v3/projects` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95bca21-b2b2-418e-93da-10915f905b8f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95bca21-b2b2-418e-93da-10915f905b8f None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 629/1266] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 12:56:23 2024] POST /identity/v3/projects => generated 401 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5b33dc-c975-41ac-b644-b3f9a3744ea9 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 638/1267] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 12:56:23 2024] POST /identity/v3/projects => generated 385 bytes in 33 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95bca21-b2b2-418e-93da-10915f905b8f None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5b33dc-c975-41ac-b644-b3f9a3744ea9 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37837414-efa8-4ac8-9058-79aba6f8038b None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37837414-efa8-4ac8-9058-79aba6f8038b None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37837414-efa8-4ac8-9058-79aba6f8038b None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37837414-efa8-4ac8-9058-79aba6f8038b None admin] PATH_INFO: `/v3/projects` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37837414-efa8-4ac8-9058-79aba6f8038b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37837414-efa8-4ac8-9058-79aba6f8038b None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95bca21-b2b2-418e-93da-10915f905b8f None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea695e9-057d-49c8-8a7a-5c900ccf4a4d service manila] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f110cf6300f049c897d0aab63218d1e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea695e9-057d-49c8-8a7a-5c900ccf4a4d service manila] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea695e9-057d-49c8-8a7a-5c900ccf4a4d service manila] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea695e9-057d-49c8-8a7a-5c900ccf4a4d service manila] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 630/1268] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 12:56:23 2024] POST /identity/v3/projects => generated 377 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37837414-efa8-4ac8-9058-79aba6f8038b None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:23 l75lg1-v1 dstat.sh[49771]: 28-05 12:56:23| 21 2 74 3 0|5556M 1960M 277M 7833M| 14k 334B| 0 2421k| 0 323 | 12k 21k|1.66 0.93 0.96|4.0 1.0 0| 0 0 | 0 2048M| 29 331 0 22 0 May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea695e9-057d-49c8-8a7a-5c900ccf4a4d service manila] RBAC: Authorizing `identity:validate_token()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea695e9-057d-49c8-8a7a-5c900ccf4a4d service manila] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 639/1269] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 12:56:23 2024] GET /identity/v3/auth/tokens => generated 4065 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea695e9-057d-49c8-8a7a-5c900ccf4a4d service manila] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37837414-efa8-4ac8-9058-79aba6f8038b None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea695e9-057d-49c8-8a7a-5c900ccf4a4d service manila] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab2a660-870e-4e76-a746-2ca8a569573b None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c57a190-11f8-4fe3-b320-14884423ff71 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab2a660-870e-4e76-a746-2ca8a569573b None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab2a660-870e-4e76-a746-2ca8a569573b None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c57a190-11f8-4fe3-b320-14884423ff71 None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab2a660-870e-4e76-a746-2ca8a569573b None admin] PATH_INFO: `/v3/users` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c57a190-11f8-4fe3-b320-14884423ff71 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c57a190-11f8-4fe3-b320-14884423ff71 None admin] PATH_INFO: `/v3/users` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab2a660-870e-4e76-a746-2ca8a569573b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c57a190-11f8-4fe3-b320-14884423ff71 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab2a660-870e-4e76-a746-2ca8a569573b None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c57a190-11f8-4fe3-b320-14884423ff71 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-fab2a660-870e-4e76-a746-2ca8a569573b None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-6c57a190-11f8-4fe3-b320-14884423ff71 None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 631/1270] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 12:56:23 2024] POST /identity/v3/users => generated 309 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab2a660-870e-4e76-a746-2ca8a569573b None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 640/1271] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 12:56:23 2024] POST /identity/v3/users => generated 300 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab2a660-870e-4e76-a746-2ca8a569573b None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de8c04b-eabe-4b7e-89cd-e52cd75e55cb None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de8c04b-eabe-4b7e-89cd-e52cd75e55cb None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de8c04b-eabe-4b7e-89cd-e52cd75e55cb None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de8c04b-eabe-4b7e-89cd-e52cd75e55cb None admin] PATH_INFO: `/v3/users` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de8c04b-eabe-4b7e-89cd-e52cd75e55cb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de8c04b-eabe-4b7e-89cd-e52cd75e55cb None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-2de8c04b-eabe-4b7e-89cd-e52cd75e55cb None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c57a190-11f8-4fe3-b320-14884423ff71 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c57a190-11f8-4fe3-b320-14884423ff71 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9eb8b4-0fbe-4424-9b90-11165625e84b None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9eb8b4-0fbe-4424-9b90-11165625e84b None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9eb8b4-0fbe-4424-9b90-11165625e84b None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9eb8b4-0fbe-4424-9b90-11165625e84b None admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9eb8b4-0fbe-4424-9b90-11165625e84b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9eb8b4-0fbe-4424-9b90-11165625e84b None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 641/1272] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 12:56:23 2024] GET /identity/v3/roles => generated 1680 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9eb8b4-0fbe-4424-9b90-11165625e84b None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9eb8b4-0fbe-4424-9b90-11165625e84b None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39e690d-3731-4d8a-8f46-9f6e8f355efe None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39e690d-3731-4d8a-8f46-9f6e8f355efe None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39e690d-3731-4d8a-8f46-9f6e8f355efe None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39e690d-3731-4d8a-8f46-9f6e8f355efe None admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39e690d-3731-4d8a-8f46-9f6e8f355efe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39e690d-3731-4d8a-8f46-9f6e8f355efe None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 642/1273] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 12:56:23 2024] GET /identity/v3/roles => generated 1680 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39e690d-3731-4d8a-8f46-9f6e8f355efe None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39e690d-3731-4d8a-8f46-9f6e8f355efe None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca10c77-996c-4eae-8d18-f10de9835695 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca10c77-996c-4eae-8d18-f10de9835695 None admin] REQUEST_METHOD: `PUT` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca10c77-996c-4eae-8d18-f10de9835695 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca10c77-996c-4eae-8d18-f10de9835695 None admin] PATH_INFO: `/v3/projects/7c36a466cc2a42b195f921474b0f4de5/users/7aee50b56a654f16a4b22ad15fdd1521/roles/e7989893488f483baa107be56668c4f8` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 632/1274] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 12:56:23 2024] POST /identity/v3/users => generated 296 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de8c04b-eabe-4b7e-89cd-e52cd75e55cb None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de8c04b-eabe-4b7e-89cd-e52cd75e55cb None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cc6d47-c5ab-4b14-99c3-98210c70b874 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cc6d47-c5ab-4b14-99c3-98210c70b874 None admin] REQUEST_METHOD: `PUT` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cc6d47-c5ab-4b14-99c3-98210c70b874 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cc6d47-c5ab-4b14-99c3-98210c70b874 None admin] PATH_INFO: `/v3/projects/18b363e2f0074cd392cfa81c7fd69bb7/users/452d391264e944fa9af8299320217344/roles/44620cad10ae407c90c91e2c296adb04` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cc6d47-c5ab-4b14-99c3-98210c70b874 None admin] RBAC: Authorizing `identity:create_grant(project_id=18b363e2f0074cd392cfa81c7fd69bb7, user_id=452d391264e944fa9af8299320217344, role_id=44620cad10ae407c90c91e2c296adb04)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cc6d47-c5ab-4b14-99c3-98210c70b874 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca10c77-996c-4eae-8d18-f10de9835695 None admin] RBAC: Authorizing `identity:create_grant(project_id=7c36a466cc2a42b195f921474b0f4de5, user_id=7aee50b56a654f16a4b22ad15fdd1521, role_id=e7989893488f483baa107be56668c4f8)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca10c77-996c-4eae-8d18-f10de9835695 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 643/1275] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 12:56:23 2024] PUT /identity/v3/projects/7c36a466cc2a42b195f921474b0f4de5/users/7aee50b56a654f16a4b22ad15fdd1521/roles/e7989893488f483baa107be56668c4f8 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 633/1276] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 12:56:23 2024] PUT /identity/v3/projects/18b363e2f0074cd392cfa81c7fd69bb7/users/452d391264e944fa9af8299320217344/roles/44620cad10ae407c90c91e2c296adb04 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca10c77-996c-4eae-8d18-f10de9835695 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cc6d47-c5ab-4b14-99c3-98210c70b874 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca10c77-996c-4eae-8d18-f10de9835695 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cc6d47-c5ab-4b14-99c3-98210c70b874 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7e55e4-41c0-4348-a20e-4b792b1558c2 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7e55e4-41c0-4348-a20e-4b792b1558c2 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7e55e4-41c0-4348-a20e-4b792b1558c2 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eee86a-7269-444d-abe5-5949d67db720 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7e55e4-41c0-4348-a20e-4b792b1558c2 None admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eee86a-7269-444d-abe5-5949d67db720 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7e55e4-41c0-4348-a20e-4b792b1558c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eee86a-7269-444d-abe5-5949d67db720 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eee86a-7269-444d-abe5-5949d67db720 None admin] PATH_INFO: `/v3/roles` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8eee86a-7269-444d-abe5-5949d67db720 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7e55e4-41c0-4348-a20e-4b792b1558c2 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8eee86a-7269-444d-abe5-5949d67db720 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 634/1277] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 12:56:23 2024] GET /identity/v3/roles => generated 1680 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b069ab14-b31c-4ef9-b379-7e9f8d00e5f5 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b069ab14-b31c-4ef9-b379-7e9f8d00e5f5 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b069ab14-b31c-4ef9-b379-7e9f8d00e5f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 644/1278] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 12:56:23 2024] GET /identity/v3/roles => generated 1680 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7e55e4-41c0-4348-a20e-4b792b1558c2 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7e55e4-41c0-4348-a20e-4b792b1558c2 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d522b4-277c-4157-b8f6-776d89e891af None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d522b4-277c-4157-b8f6-776d89e891af None admin] REQUEST_METHOD: `PUT` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d522b4-277c-4157-b8f6-776d89e891af None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d522b4-277c-4157-b8f6-776d89e891af None admin] PATH_INFO: `/v3/projects/7c36a466cc2a42b195f921474b0f4de5/users/7aee50b56a654f16a4b22ad15fdd1521/roles/e7989893488f483baa107be56668c4f8` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d522b4-277c-4157-b8f6-776d89e891af None admin] RBAC: Authorizing `identity:create_grant(project_id=7c36a466cc2a42b195f921474b0f4de5, user_id=7aee50b56a654f16a4b22ad15fdd1521, role_id=e7989893488f483baa107be56668c4f8)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-b069ab14-b31c-4ef9-b379-7e9f8d00e5f5 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d522b4-277c-4157-b8f6-776d89e891af None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 645/1279] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 12:56:23 2024] PUT /identity/v3/projects/7c36a466cc2a42b195f921474b0f4de5/users/7aee50b56a654f16a4b22ad15fdd1521/roles/e7989893488f483baa107be56668c4f8 => generated 0 bytes in 18 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-b069ab14-b31c-4ef9-b379-7e9f8d00e5f5 None None] MFA Rules not processed for user `452d391264e944fa9af8299320217344`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-b069ab14-b31c-4ef9-b379-7e9f8d00e5f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d522b4-277c-4157-b8f6-776d89e891af None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:23 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-f17411af-d50c-460f-9662-2c5d602e4dfa tempest-ExportLocationsAPIOnlyNegativeTest-900714483 tempest-ExportLocationsAPIOnlyNegativeTest-900714483-project-admin] GET http://10.27.203.238/share/v2/8cf929567af24bf185c33b3a12b4533c/shares/fake-inexistent-share-id/export_locations May 28 12:56:23 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-f17411af-d50c-460f-9662-2c5d602e4dfa tempest-ExportLocationsAPIOnlyNegativeTest-900714483 tempest-ExportLocationsAPIOnlyNegativeTest-900714483-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:23 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-f17411af-d50c-460f-9662-2c5d602e4dfa tempest-ExportLocationsAPIOnlyNegativeTest-900714483 tempest-ExportLocationsAPIOnlyNegativeTest-900714483-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:23 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_db.api [None req-f17411af-d50c-460f-9662-2c5d602e4dfa tempest-ExportLocationsAPIOnlyNegativeTest-900714483 tempest-ExportLocationsAPIOnlyNegativeTest-900714483-project-admin] Loading backend 'sqlalchemy' from 'manila.db.sqlalchemy.api' {{(pid=98330) _load_backend /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/api.py:259}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d522b4-277c-4157-b8f6-776d89e891af None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f137cb-37cc-49ad-a070-10ecc597a31f None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f137cb-37cc-49ad-a070-10ecc597a31f None admin] REQUEST_METHOD: `PUT` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f137cb-37cc-49ad-a070-10ecc597a31f None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f137cb-37cc-49ad-a070-10ecc597a31f None admin] PATH_INFO: `/v3/projects/87c113478e754c47aea49a8b703cd2f6/users/76cf7583288d4a4eac3cf2f7fac50a81/roles/e7989893488f483baa107be56668c4f8` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f137cb-37cc-49ad-a070-10ecc597a31f None admin] RBAC: Authorizing `identity:create_grant(project_id=87c113478e754c47aea49a8b703cd2f6, user_id=76cf7583288d4a4eac3cf2f7fac50a81, role_id=e7989893488f483baa107be56668c4f8)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f137cb-37cc-49ad-a070-10ecc597a31f None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 635/1280] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:56:23 2024] POST /identity/v3/auth/tokens => generated 3972 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb909df-811a-42b6-b2a1-7c8c9910e8e5 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb909df-811a-42b6-b2a1-7c8c9910e8e5 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb909df-811a-42b6-b2a1-7c8c9910e8e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 646/1281] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 12:56:23 2024] PUT /identity/v3/projects/87c113478e754c47aea49a8b703cd2f6/users/76cf7583288d4a4eac3cf2f7fac50a81/roles/e7989893488f483baa107be56668c4f8 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f137cb-37cc-49ad-a070-10ecc597a31f None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-8fb909df-811a-42b6-b2a1-7c8c9910e8e5 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-8fb909df-811a-42b6-b2a1-7c8c9910e8e5 None None] MFA Rules not processed for user `7aee50b56a654f16a4b22ad15fdd1521`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-8fb909df-811a-42b6-b2a1-7c8c9910e8e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f137cb-37cc-49ad-a070-10ecc597a31f None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc44c981-fba6-4c47-9a62-5f0399b8bd88 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc44c981-fba6-4c47-9a62-5f0399b8bd88 None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc44c981-fba6-4c47-9a62-5f0399b8bd88 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc44c981-fba6-4c47-9a62-5f0399b8bd88 None admin] PATH_INFO: `/v3/projects` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc44c981-fba6-4c47-9a62-5f0399b8bd88 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc44c981-fba6-4c47-9a62-5f0399b8bd88 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 647/1282] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 12:56:23 2024] POST /identity/v3/projects => generated 401 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc44c981-fba6-4c47-9a62-5f0399b8bd88 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:23 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-33af43ff-9efc-4576-b4a5-046e28d76e7f tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] POST http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/types May 28 12:56:23 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-33af43ff-9efc-4576-b4a5-046e28d76e7f tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share_type": {"name": "tempest-typeshare-type-109533419", "extra_specs": {"driver_handles_share_servers": "False", "snapshot_support": true}, "share_type_access:is_public": true}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:56:23 l75lg1-v1 devstack@m-api.service[98329]: DEBUG oslo_db.api [None req-33af43ff-9efc-4576-b4a5-046e28d76e7f tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Loading backend 'sqlalchemy' from 'manila.db.sqlalchemy.api' {{(pid=98329) _load_backend /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/api.py:259}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 636/1283] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:56:23 2024] POST /identity/v3/auth/tokens => generated 4079 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb909df-811a-42b6-b2a1-7c8c9910e8e5 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb909df-811a-42b6-b2a1-7c8c9910e8e5 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc44c981-fba6-4c47-9a62-5f0399b8bd88 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b678be6-7b49-4b5c-a7a2-30ca367965ad None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b678be6-7b49-4b5c-a7a2-30ca367965ad None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b678be6-7b49-4b5c-a7a2-30ca367965ad None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b678be6-7b49-4b5c-a7a2-30ca367965ad None admin] PATH_INFO: `/v3/users` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b678be6-7b49-4b5c-a7a2-30ca367965ad None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b671d3d6-8d8f-4448-86f8-27fe1061af4c None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b678be6-7b49-4b5c-a7a2-30ca367965ad None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b671d3d6-8d8f-4448-86f8-27fe1061af4c None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b671d3d6-8d8f-4448-86f8-27fe1061af4c None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b671d3d6-8d8f-4448-86f8-27fe1061af4c None admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b671d3d6-8d8f-4448-86f8-27fe1061af4c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b671d3d6-8d8f-4448-86f8-27fe1061af4c None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-1b678be6-7b49-4b5c-a7a2-30ca367965ad None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 648/1284] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 12:56:23 2024] GET /identity/v3/roles => generated 1680 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b671d3d6-8d8f-4448-86f8-27fe1061af4c None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 637/1285] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 12:56:23 2024] POST /identity/v3/users => generated 308 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b678be6-7b49-4b5c-a7a2-30ca367965ad None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b678be6-7b49-4b5c-a7a2-30ca367965ad None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:23 l75lg1-v1 devstack@m-api.service[98330]: DEBUG passlib.utils.compat [None req-f17411af-d50c-460f-9662-2c5d602e4dfa tempest-ExportLocationsAPIOnlyNegativeTest-900714483 tempest-ExportLocationsAPIOnlyNegativeTest-900714483-project-admin] loaded lazy attr 'SafeConfigParser': {{(pid=98330) __getattr__ /opt/stack/data/venv/lib/python3.10/site-packages/passlib/utils/compat/__init__.py:449}} May 28 12:56:23 l75lg1-v1 devstack@m-api.service[98330]: DEBUG passlib.utils.compat [None req-f17411af-d50c-460f-9662-2c5d602e4dfa tempest-ExportLocationsAPIOnlyNegativeTest-900714483 tempest-ExportLocationsAPIOnlyNegativeTest-900714483-project-admin] loaded lazy attr 'NativeStringIO': {{(pid=98330) __getattr__ /opt/stack/data/venv/lib/python3.10/site-packages/passlib/utils/compat/__init__.py:449}} May 28 12:56:23 l75lg1-v1 devstack@m-api.service[98330]: DEBUG passlib.utils.compat [None req-f17411af-d50c-460f-9662-2c5d602e4dfa tempest-ExportLocationsAPIOnlyNegativeTest-900714483 tempest-ExportLocationsAPIOnlyNegativeTest-900714483-project-admin] loaded lazy attr 'BytesIO': {{(pid=98330) __getattr__ /opt/stack/data/venv/lib/python3.10/site-packages/passlib/utils/compat/__init__.py:449}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ae08e9-6fb5-4adf-b347-9f1c3c39c2b7 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ae08e9-6fb5-4adf-b347-9f1c3c39c2b7 None admin] REQUEST_METHOD: `PUT` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ae08e9-6fb5-4adf-b347-9f1c3c39c2b7 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ae08e9-6fb5-4adf-b347-9f1c3c39c2b7 None admin] PATH_INFO: `/v3/projects/87c113478e754c47aea49a8b703cd2f6/users/76cf7583288d4a4eac3cf2f7fac50a81/roles/e7989893488f483baa107be56668c4f8` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ae08e9-6fb5-4adf-b347-9f1c3c39c2b7 None admin] RBAC: Authorizing `identity:create_grant(project_id=87c113478e754c47aea49a8b703cd2f6, user_id=76cf7583288d4a4eac3cf2f7fac50a81, role_id=e7989893488f483baa107be56668c4f8)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ae08e9-6fb5-4adf-b347-9f1c3c39c2b7 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 638/1286] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 12:56:23 2024] PUT /identity/v3/projects/87c113478e754c47aea49a8b703cd2f6/users/76cf7583288d4a4eac3cf2f7fac50a81/roles/e7989893488f483baa107be56668c4f8 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ae08e9-6fb5-4adf-b347-9f1c3c39c2b7 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b671d3d6-8d8f-4448-86f8-27fe1061af4c None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ae08e9-6fb5-4adf-b347-9f1c3c39c2b7 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bde5bdb-1469-4f3f-9e8a-7a0abb2431bb None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bde5bdb-1469-4f3f-9e8a-7a0abb2431bb None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bde5bdb-1469-4f3f-9e8a-7a0abb2431bb None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bde5bdb-1469-4f3f-9e8a-7a0abb2431bb None admin] PATH_INFO: `/v3/roles` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bde5bdb-1469-4f3f-9e8a-7a0abb2431bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bde5bdb-1469-4f3f-9e8a-7a0abb2431bb None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 639/1287] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 12:56:23 2024] GET /identity/v3/roles => generated 1680 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44876937-3d54-4317-a193-0a7e07dda307 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44876937-3d54-4317-a193-0a7e07dda307 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44876937-3d54-4317-a193-0a7e07dda307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-44876937-3d54-4317-a193-0a7e07dda307 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-44876937-3d54-4317-a193-0a7e07dda307 None None] MFA Rules not processed for user `76cf7583288d4a4eac3cf2f7fac50a81`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-44876937-3d54-4317-a193-0a7e07dda307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb992b4-ac42-4b61-b3d8-524861469746 tempest-AdminActionsNegativeTest-763023849 tempest-AdminActionsNegativeTest-763023849-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7aee50b56a654f16a4b22ad15fdd1521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c36a466cc2a42b195f921474b0f4de5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb992b4-ac42-4b61-b3d8-524861469746 tempest-AdminActionsNegativeTest-763023849 tempest-AdminActionsNegativeTest-763023849-project-admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb992b4-ac42-4b61-b3d8-524861469746 tempest-AdminActionsNegativeTest-763023849 tempest-AdminActionsNegativeTest-763023849-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb992b4-ac42-4b61-b3d8-524861469746 tempest-AdminActionsNegativeTest-763023849 tempest-AdminActionsNegativeTest-763023849-project-admin] PATH_INFO: `/v3/domains` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb992b4-ac42-4b61-b3d8-524861469746 tempest-AdminActionsNegativeTest-763023849 tempest-AdminActionsNegativeTest-763023849-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=51267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb992b4-ac42-4b61-b3d8-524861469746 tempest-AdminActionsNegativeTest-763023849 tempest-AdminActionsNegativeTest-763023849-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb992b4-ac42-4b61-b3d8-524861469746 tempest-AdminActionsNegativeTest-763023849 tempest-AdminActionsNegativeTest-763023849-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 649/1288] 10.27.203.238 () {62 vars in 1241 bytes} [Tue May 28 12:56:23 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb992b4-ac42-4b61-b3d8-524861469746 tempest-AdminActionsNegativeTest-763023849 tempest-AdminActionsNegativeTest-763023849-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb992b4-ac42-4b61-b3d8-524861469746 tempest-AdminActionsNegativeTest-763023849 tempest-AdminActionsNegativeTest-763023849-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8323b6cf-5ce6-4ba2-88e8-bbcc80299ff4 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8323b6cf-5ce6-4ba2-88e8-bbcc80299ff4 None admin] REQUEST_METHOD: `PUT` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8323b6cf-5ce6-4ba2-88e8-bbcc80299ff4 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8323b6cf-5ce6-4ba2-88e8-bbcc80299ff4 None admin] PATH_INFO: `/v3/projects/e597e913ff9348f29791175d986c8a59/users/34c3c14495e243028b5a760f7c1d86bd/roles/e7989893488f483baa107be56668c4f8` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:23 l75lg1-v1 devstack@m-api.service[98329]: DEBUG passlib.utils.compat [None req-33af43ff-9efc-4576-b4a5-046e28d76e7f tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] loaded lazy attr 'SafeConfigParser': {{(pid=98329) __getattr__ /opt/stack/data/venv/lib/python3.10/site-packages/passlib/utils/compat/__init__.py:449}} May 28 12:56:23 l75lg1-v1 devstack@m-api.service[98329]: DEBUG passlib.utils.compat [None req-33af43ff-9efc-4576-b4a5-046e28d76e7f tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] loaded lazy attr 'NativeStringIO': {{(pid=98329) __getattr__ /opt/stack/data/venv/lib/python3.10/site-packages/passlib/utils/compat/__init__.py:449}} May 28 12:56:23 l75lg1-v1 devstack@m-api.service[98329]: DEBUG passlib.utils.compat [None req-33af43ff-9efc-4576-b4a5-046e28d76e7f tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] loaded lazy attr 'BytesIO': {{(pid=98329) __getattr__ /opt/stack/data/venv/lib/python3.10/site-packages/passlib/utils/compat/__init__.py:449}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8323b6cf-5ce6-4ba2-88e8-bbcc80299ff4 None admin] RBAC: Authorizing `identity:create_grant(project_id=e597e913ff9348f29791175d986c8a59, user_id=34c3c14495e243028b5a760f7c1d86bd, role_id=e7989893488f483baa107be56668c4f8)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8323b6cf-5ce6-4ba2-88e8-bbcc80299ff4 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 650/1289] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 12:56:23 2024] PUT /identity/v3/projects/e597e913ff9348f29791175d986c8a59/users/34c3c14495e243028b5a760f7c1d86bd/roles/e7989893488f483baa107be56668c4f8 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8323b6cf-5ce6-4ba2-88e8-bbcc80299ff4 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 640/1290] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:56:23 2024] POST /identity/v3/auth/tokens => generated 4071 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44876937-3d54-4317-a193-0a7e07dda307 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44876937-3d54-4317-a193-0a7e07dda307 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7382c721-c37e-47e1-b301-db7fe7cb7456 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7382c721-c37e-47e1-b301-db7fe7cb7456 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7382c721-c37e-47e1-b301-db7fe7cb7456 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7382c721-c37e-47e1-b301-db7fe7cb7456 None admin] PATH_INFO: `/v3/roles` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7382c721-c37e-47e1-b301-db7fe7cb7456 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7382c721-c37e-47e1-b301-db7fe7cb7456 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 641/1291] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 12:56:23 2024] GET /identity/v3/roles => generated 1680 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7382c721-c37e-47e1-b301-db7fe7cb7456 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8323b6cf-5ce6-4ba2-88e8-bbcc80299ff4 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c869e181-63f3-41d0-9063-4795fafd2447 tempest-AdminActionsNegativeTest-763023849 tempest-AdminActionsNegativeTest-763023849-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7aee50b56a654f16a4b22ad15fdd1521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c36a466cc2a42b195f921474b0f4de5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c869e181-63f3-41d0-9063-4795fafd2447 tempest-AdminActionsNegativeTest-763023849 tempest-AdminActionsNegativeTest-763023849-project-admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c869e181-63f3-41d0-9063-4795fafd2447 tempest-AdminActionsNegativeTest-763023849 tempest-AdminActionsNegativeTest-763023849-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c869e181-63f3-41d0-9063-4795fafd2447 tempest-AdminActionsNegativeTest-763023849 tempest-AdminActionsNegativeTest-763023849-project-admin] PATH_INFO: `/v3/users` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c869e181-63f3-41d0-9063-4795fafd2447 tempest-AdminActionsNegativeTest-763023849 tempest-AdminActionsNegativeTest-763023849-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c869e181-63f3-41d0-9063-4795fafd2447 tempest-AdminActionsNegativeTest-763023849 tempest-AdminActionsNegativeTest-763023849-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-c869e181-63f3-41d0-9063-4795fafd2447 tempest-AdminActionsNegativeTest-763023849 tempest-AdminActionsNegativeTest-763023849-project-admin] Truncating password to algorithm specific maximum length 72 characters. May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 651/1292] 10.27.203.238 () {64 vars in 1232 bytes} [Tue May 28 12:56:23 2024] POST /identity/v3/users => generated 435 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c869e181-63f3-41d0-9063-4795fafd2447 tempest-AdminActionsNegativeTest-763023849 tempest-AdminActionsNegativeTest-763023849-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c869e181-63f3-41d0-9063-4795fafd2447 tempest-AdminActionsNegativeTest-763023849 tempest-AdminActionsNegativeTest-763023849-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40dc9cc-7116-4ee9-860b-c5120a9ba8cd None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40dc9cc-7116-4ee9-860b-c5120a9ba8cd None admin] REQUEST_METHOD: `PUT` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40dc9cc-7116-4ee9-860b-c5120a9ba8cd None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40dc9cc-7116-4ee9-860b-c5120a9ba8cd None admin] PATH_INFO: `/v3/projects/e597e913ff9348f29791175d986c8a59/users/34c3c14495e243028b5a760f7c1d86bd/roles/e7989893488f483baa107be56668c4f8` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40dc9cc-7116-4ee9-860b-c5120a9ba8cd None admin] RBAC: Authorizing `identity:create_grant(project_id=e597e913ff9348f29791175d986c8a59, user_id=34c3c14495e243028b5a760f7c1d86bd, role_id=e7989893488f483baa107be56668c4f8)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40dc9cc-7116-4ee9-860b-c5120a9ba8cd None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7382c721-c37e-47e1-b301-db7fe7cb7456 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41632ffa-f393-461d-9c29-efd83dba1578 tempest-ExportLocationsTest-1017217578 tempest-ExportLocationsTest-1017217578-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cf7583288d4a4eac3cf2f7fac50a81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87c113478e754c47aea49a8b703cd2f6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41632ffa-f393-461d-9c29-efd83dba1578 tempest-ExportLocationsTest-1017217578 tempest-ExportLocationsTest-1017217578-project-admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41632ffa-f393-461d-9c29-efd83dba1578 tempest-ExportLocationsTest-1017217578 tempest-ExportLocationsTest-1017217578-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41632ffa-f393-461d-9c29-efd83dba1578 tempest-ExportLocationsTest-1017217578 tempest-ExportLocationsTest-1017217578-project-admin] PATH_INFO: `/v3/domains` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41632ffa-f393-461d-9c29-efd83dba1578 tempest-ExportLocationsTest-1017217578 tempest-ExportLocationsTest-1017217578-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41632ffa-f393-461d-9c29-efd83dba1578 tempest-ExportLocationsTest-1017217578 tempest-ExportLocationsTest-1017217578-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 652/1293] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 12:56:23 2024] PUT /identity/v3/projects/e597e913ff9348f29791175d986c8a59/users/34c3c14495e243028b5a760f7c1d86bd/roles/e7989893488f483baa107be56668c4f8 => generated 0 bytes in 19 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41632ffa-f393-461d-9c29-efd83dba1578 tempest-ExportLocationsTest-1017217578 tempest-ExportLocationsTest-1017217578-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40dc9cc-7116-4ee9-860b-c5120a9ba8cd None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 642/1294] 10.27.203.238 () {62 vars in 1241 bytes} [Tue May 28 12:56:23 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613e5fbd-9e0e-4ffd-a0a4-d724a7d648f8 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613e5fbd-9e0e-4ffd-a0a4-d724a7d648f8 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613e5fbd-9e0e-4ffd-a0a4-d724a7d648f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:23 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-613e5fbd-9e0e-4ffd-a0a4-d724a7d648f8 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:56:24 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-613e5fbd-9e0e-4ffd-a0a4-d724a7d648f8 None None] MFA Rules not processed for user `34c3c14495e243028b5a760f7c1d86bd`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:56:24 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-613e5fbd-9e0e-4ffd-a0a4-d724a7d648f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:24 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40dc9cc-7116-4ee9-860b-c5120a9ba8cd None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:24 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33fd28f-a3d1-4a15-a1b9-cf325835bc46 tempest-AdminActionsNegativeTest-763023849 tempest-AdminActionsNegativeTest-763023849-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7aee50b56a654f16a4b22ad15fdd1521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c36a466cc2a42b195f921474b0f4de5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:24 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33fd28f-a3d1-4a15-a1b9-cf325835bc46 tempest-AdminActionsNegativeTest-763023849 tempest-AdminActionsNegativeTest-763023849-project-admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:24 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33fd28f-a3d1-4a15-a1b9-cf325835bc46 tempest-AdminActionsNegativeTest-763023849 tempest-AdminActionsNegativeTest-763023849-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:24 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33fd28f-a3d1-4a15-a1b9-cf325835bc46 tempest-AdminActionsNegativeTest-763023849 tempest-AdminActionsNegativeTest-763023849-project-admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:24 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33fd28f-a3d1-4a15-a1b9-cf325835bc46 tempest-AdminActionsNegativeTest-763023849 tempest-AdminActionsNegativeTest-763023849-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:24 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33fd28f-a3d1-4a15-a1b9-cf325835bc46 tempest-AdminActionsNegativeTest-763023849 tempest-AdminActionsNegativeTest-763023849-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:24 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 653/1295] 10.27.203.238 () {62 vars in 1210 bytes} [Tue May 28 12:56:23 2024] GET /identity/v3/roles => generated 1680 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:56:24 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33fd28f-a3d1-4a15-a1b9-cf325835bc46 tempest-AdminActionsNegativeTest-763023849 tempest-AdminActionsNegativeTest-763023849-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:24 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 643/1296] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:56:23 2024] POST /identity/v3/auth/tokens => generated 4095 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:56:24 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613e5fbd-9e0e-4ffd-a0a4-d724a7d648f8 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:24 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613e5fbd-9e0e-4ffd-a0a4-d724a7d648f8 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:24 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50151859-df4b-406f-aacf-5b9bcd92abb2 tempest-AdminActionsNegativeTest-763023849 tempest-AdminActionsNegativeTest-763023849-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7aee50b56a654f16a4b22ad15fdd1521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c36a466cc2a42b195f921474b0f4de5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:24 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50151859-df4b-406f-aacf-5b9bcd92abb2 tempest-AdminActionsNegativeTest-763023849 tempest-AdminActionsNegativeTest-763023849-project-admin] REQUEST_METHOD: `PUT` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:24 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50151859-df4b-406f-aacf-5b9bcd92abb2 tempest-AdminActionsNegativeTest-763023849 tempest-AdminActionsNegativeTest-763023849-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:24 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50151859-df4b-406f-aacf-5b9bcd92abb2 tempest-AdminActionsNegativeTest-763023849 tempest-AdminActionsNegativeTest-763023849-project-admin] PATH_INFO: `/v3/projects/7c36a466cc2a42b195f921474b0f4de5/users/b9078b0601ac4efa93bdcc390f3d1208/roles/44620cad10ae407c90c91e2c296adb04` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:24 l75lg1-v1 devstack@m-api.service[98330]: INFO dbcounter [None req-f17411af-d50c-460f-9662-2c5d602e4dfa tempest-ExportLocationsAPIOnlyNegativeTest-900714483 tempest-ExportLocationsAPIOnlyNegativeTest-900714483-project-admin] Registered counter for database manila May 28 12:56:24 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50151859-df4b-406f-aacf-5b9bcd92abb2 tempest-AdminActionsNegativeTest-763023849 tempest-AdminActionsNegativeTest-763023849-project-admin] RBAC: Authorizing `identity:create_grant(project_id=7c36a466cc2a42b195f921474b0f4de5, user_id=b9078b0601ac4efa93bdcc390f3d1208, role_id=44620cad10ae407c90c91e2c296adb04)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:24 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50151859-df4b-406f-aacf-5b9bcd92abb2 tempest-AdminActionsNegativeTest-763023849 tempest-AdminActionsNegativeTest-763023849-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:24 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33fd28f-a3d1-4a15-a1b9-cf325835bc46 tempest-AdminActionsNegativeTest-763023849 tempest-AdminActionsNegativeTest-763023849-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:24 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_db.sqlalchemy.engines [None req-f17411af-d50c-460f-9662-2c5d602e4dfa tempest-ExportLocationsAPIOnlyNegativeTest-900714483 tempest-ExportLocationsAPIOnlyNegativeTest-900714483-project-admin] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=98330) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:342}} May 28 12:56:24 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c224a8-b9b8-4185-a157-0cd9f740ac44 tempest-ExportLocationsTest-1017217578 tempest-ExportLocationsTest-1017217578-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cf7583288d4a4eac3cf2f7fac50a81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87c113478e754c47aea49a8b703cd2f6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:24 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c224a8-b9b8-4185-a157-0cd9f740ac44 tempest-ExportLocationsTest-1017217578 tempest-ExportLocationsTest-1017217578-project-admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:24 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c224a8-b9b8-4185-a157-0cd9f740ac44 tempest-ExportLocationsTest-1017217578 tempest-ExportLocationsTest-1017217578-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:24 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c224a8-b9b8-4185-a157-0cd9f740ac44 tempest-ExportLocationsTest-1017217578 tempest-ExportLocationsTest-1017217578-project-admin] PATH_INFO: `/v3/users` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:24 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c224a8-b9b8-4185-a157-0cd9f740ac44 tempest-ExportLocationsTest-1017217578 tempest-ExportLocationsTest-1017217578-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:24 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c224a8-b9b8-4185-a157-0cd9f740ac44 tempest-ExportLocationsTest-1017217578 tempest-ExportLocationsTest-1017217578-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:24 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-94c224a8-b9b8-4185-a157-0cd9f740ac44 tempest-ExportLocationsTest-1017217578 tempest-ExportLocationsTest-1017217578-project-admin] Truncating password to algorithm specific maximum length 72 characters. May 28 12:56:24 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 644/1297] 10.27.203.238 () {64 vars in 1571 bytes} [Tue May 28 12:56:24 2024] PUT /identity/v3/projects/7c36a466cc2a42b195f921474b0f4de5/users/b9078b0601ac4efa93bdcc390f3d1208/roles/44620cad10ae407c90c91e2c296adb04 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:56:24 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50151859-df4b-406f-aacf-5b9bcd92abb2 tempest-AdminActionsNegativeTest-763023849 tempest-AdminActionsNegativeTest-763023849-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:24 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 654/1298] 10.27.203.238 () {64 vars in 1232 bytes} [Tue May 28 12:56:24 2024] POST /identity/v3/users => generated 435 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:56:24 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c224a8-b9b8-4185-a157-0cd9f740ac44 tempest-ExportLocationsTest-1017217578 tempest-ExportLocationsTest-1017217578-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:24 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c224a8-b9b8-4185-a157-0cd9f740ac44 tempest-ExportLocationsTest-1017217578 tempest-ExportLocationsTest-1017217578-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:24 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50151859-df4b-406f-aacf-5b9bcd92abb2 tempest-AdminActionsNegativeTest-763023849 tempest-AdminActionsNegativeTest-763023849-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:24 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9a9928-8beb-453f-8f4c-681a36da69d5 tempest-AdminActionsAPIOnlyNegativeTest-1820624707 tempest-AdminActionsAPIOnlyNegativeTest-1820624707-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c3c14495e243028b5a760f7c1d86bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e597e913ff9348f29791175d986c8a59', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:24 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9a9928-8beb-453f-8f4c-681a36da69d5 tempest-AdminActionsAPIOnlyNegativeTest-1820624707 tempest-AdminActionsAPIOnlyNegativeTest-1820624707-project-admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:24 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9a9928-8beb-453f-8f4c-681a36da69d5 tempest-AdminActionsAPIOnlyNegativeTest-1820624707 tempest-AdminActionsAPIOnlyNegativeTest-1820624707-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:24 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9a9928-8beb-453f-8f4c-681a36da69d5 tempest-AdminActionsAPIOnlyNegativeTest-1820624707 tempest-AdminActionsAPIOnlyNegativeTest-1820624707-project-admin] PATH_INFO: `/v3/domains` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:24 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9a9928-8beb-453f-8f4c-681a36da69d5 tempest-AdminActionsAPIOnlyNegativeTest-1820624707 tempest-AdminActionsAPIOnlyNegativeTest-1820624707-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:56:24 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9a9928-8beb-453f-8f4c-681a36da69d5 tempest-AdminActionsAPIOnlyNegativeTest-1820624707 tempest-AdminActionsAPIOnlyNegativeTest-1820624707-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:24 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9a9928-8beb-453f-8f4c-681a36da69d5 tempest-AdminActionsAPIOnlyNegativeTest-1820624707 tempest-AdminActionsAPIOnlyNegativeTest-1820624707-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:24 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 645/1299] 10.27.203.238 () {62 vars in 1241 bytes} [Tue May 28 12:56:24 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:56:24 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9a9928-8beb-453f-8f4c-681a36da69d5 tempest-AdminActionsAPIOnlyNegativeTest-1820624707 tempest-AdminActionsAPIOnlyNegativeTest-1820624707-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:24 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9a9928-8beb-453f-8f4c-681a36da69d5 tempest-AdminActionsAPIOnlyNegativeTest-1820624707 tempest-AdminActionsAPIOnlyNegativeTest-1820624707-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:24 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50392938-25c8-45e9-8e54-daebcd0149b4 tempest-AdminActionsAPIOnlyNegativeTest-1820624707 tempest-AdminActionsAPIOnlyNegativeTest-1820624707-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c3c14495e243028b5a760f7c1d86bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e597e913ff9348f29791175d986c8a59', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:24 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50392938-25c8-45e9-8e54-daebcd0149b4 tempest-AdminActionsAPIOnlyNegativeTest-1820624707 tempest-AdminActionsAPIOnlyNegativeTest-1820624707-project-admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:24 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50392938-25c8-45e9-8e54-daebcd0149b4 tempest-AdminActionsAPIOnlyNegativeTest-1820624707 tempest-AdminActionsAPIOnlyNegativeTest-1820624707-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:24 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50392938-25c8-45e9-8e54-daebcd0149b4 tempest-AdminActionsAPIOnlyNegativeTest-1820624707 tempest-AdminActionsAPIOnlyNegativeTest-1820624707-project-admin] PATH_INFO: `/v3/users` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:24 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50392938-25c8-45e9-8e54-daebcd0149b4 tempest-AdminActionsAPIOnlyNegativeTest-1820624707 tempest-AdminActionsAPIOnlyNegativeTest-1820624707-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:24 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50392938-25c8-45e9-8e54-daebcd0149b4 tempest-AdminActionsAPIOnlyNegativeTest-1820624707 tempest-AdminActionsAPIOnlyNegativeTest-1820624707-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:24 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-50392938-25c8-45e9-8e54-daebcd0149b4 tempest-AdminActionsAPIOnlyNegativeTest-1820624707 tempest-AdminActionsAPIOnlyNegativeTest-1820624707-project-admin] Truncating password to algorithm specific maximum length 72 characters. May 28 12:56:24 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa53a2a-2012-40e3-8e81-781b194b9bfa tempest-ExportLocationsTest-1017217578 tempest-ExportLocationsTest-1017217578-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cf7583288d4a4eac3cf2f7fac50a81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87c113478e754c47aea49a8b703cd2f6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:24 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa53a2a-2012-40e3-8e81-781b194b9bfa tempest-ExportLocationsTest-1017217578 tempest-ExportLocationsTest-1017217578-project-admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:24 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa53a2a-2012-40e3-8e81-781b194b9bfa tempest-ExportLocationsTest-1017217578 tempest-ExportLocationsTest-1017217578-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:24 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa53a2a-2012-40e3-8e81-781b194b9bfa tempest-ExportLocationsTest-1017217578 tempest-ExportLocationsTest-1017217578-project-admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "_check_child_processes" by "neutron.agent.linux.external_process.ProcessMonitor._check_child_processes" {{(pid=76818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:56:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_concurrency.lockutils [-] Lock "_check_child_processes" acquired by "neutron.agent.linux.external_process.ProcessMonitor._check_child_processes" :: waited 0.001s {{(pid=76818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:56:24 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa53a2a-2012-40e3-8e81-781b194b9bfa tempest-ExportLocationsTest-1017217578 tempest-ExportLocationsTest-1017217578-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_concurrency.lockutils [-] Lock "_check_child_processes" "released" by "neutron.agent.linux.external_process.ProcessMonitor._check_child_processes" :: held 0.001s {{(pid=76818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:56:24 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa53a2a-2012-40e3-8e81-781b194b9bfa tempest-ExportLocationsTest-1017217578 tempest-ExportLocationsTest-1017217578-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:24 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 655/1300] 10.27.203.238 () {62 vars in 1210 bytes} [Tue May 28 12:56:24 2024] GET /identity/v3/roles => generated 1680 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 28 12:56:24 l75lg1-v1 devstack@m-api.service[98329]: INFO dbcounter [None req-33af43ff-9efc-4576-b4a5-046e28d76e7f tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Registered counter for database manila May 28 12:56:24 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa53a2a-2012-40e3-8e81-781b194b9bfa tempest-ExportLocationsTest-1017217578 tempest-ExportLocationsTest-1017217578-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:24 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 646/1301] 10.27.203.238 () {64 vars in 1232 bytes} [Tue May 28 12:56:24 2024] POST /identity/v3/users => generated 431 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:56:24 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa53a2a-2012-40e3-8e81-781b194b9bfa tempest-ExportLocationsTest-1017217578 tempest-ExportLocationsTest-1017217578-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:24 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50392938-25c8-45e9-8e54-daebcd0149b4 tempest-AdminActionsAPIOnlyNegativeTest-1820624707 tempest-AdminActionsAPIOnlyNegativeTest-1820624707-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:24 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50392938-25c8-45e9-8e54-daebcd0149b4 tempest-AdminActionsAPIOnlyNegativeTest-1820624707 tempest-AdminActionsAPIOnlyNegativeTest-1820624707-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:24 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0685b101-a7b2-4752-ab22-90c2b1af527d tempest-ExportLocationsTest-1017217578 tempest-ExportLocationsTest-1017217578-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cf7583288d4a4eac3cf2f7fac50a81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87c113478e754c47aea49a8b703cd2f6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:24 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0685b101-a7b2-4752-ab22-90c2b1af527d tempest-ExportLocationsTest-1017217578 tempest-ExportLocationsTest-1017217578-project-admin] REQUEST_METHOD: `PUT` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:24 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0685b101-a7b2-4752-ab22-90c2b1af527d tempest-ExportLocationsTest-1017217578 tempest-ExportLocationsTest-1017217578-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:24 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0685b101-a7b2-4752-ab22-90c2b1af527d tempest-ExportLocationsTest-1017217578 tempest-ExportLocationsTest-1017217578-project-admin] PATH_INFO: `/v3/projects/87c113478e754c47aea49a8b703cd2f6/users/8688f80695814f34bfb56342c4e54028/roles/44620cad10ae407c90c91e2c296adb04` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:24 l75lg1-v1 devstack@m-api.service[98329]: DEBUG oslo_db.sqlalchemy.engines [None req-33af43ff-9efc-4576-b4a5-046e28d76e7f tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=98329) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:342}} May 28 12:56:24 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e014aa56-ca68-4e26-bc21-bb73f0f03f76 tempest-AdminActionsAPIOnlyNegativeTest-1820624707 tempest-AdminActionsAPIOnlyNegativeTest-1820624707-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c3c14495e243028b5a760f7c1d86bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e597e913ff9348f29791175d986c8a59', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:24 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e014aa56-ca68-4e26-bc21-bb73f0f03f76 tempest-AdminActionsAPIOnlyNegativeTest-1820624707 tempest-AdminActionsAPIOnlyNegativeTest-1820624707-project-admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:24 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e014aa56-ca68-4e26-bc21-bb73f0f03f76 tempest-AdminActionsAPIOnlyNegativeTest-1820624707 tempest-AdminActionsAPIOnlyNegativeTest-1820624707-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:24 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e014aa56-ca68-4e26-bc21-bb73f0f03f76 tempest-AdminActionsAPIOnlyNegativeTest-1820624707 tempest-AdminActionsAPIOnlyNegativeTest-1820624707-project-admin] PATH_INFO: `/v3/roles` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:24 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e014aa56-ca68-4e26-bc21-bb73f0f03f76 tempest-AdminActionsAPIOnlyNegativeTest-1820624707 tempest-AdminActionsAPIOnlyNegativeTest-1820624707-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:24 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e014aa56-ca68-4e26-bc21-bb73f0f03f76 tempest-AdminActionsAPIOnlyNegativeTest-1820624707 tempest-AdminActionsAPIOnlyNegativeTest-1820624707-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:24 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 647/1302] 10.27.203.238 () {62 vars in 1210 bytes} [Tue May 28 12:56:24 2024] GET /identity/v3/roles => generated 1680 bytes in 18 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 28 12:56:24 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e014aa56-ca68-4e26-bc21-bb73f0f03f76 tempest-AdminActionsAPIOnlyNegativeTest-1820624707 tempest-AdminActionsAPIOnlyNegativeTest-1820624707-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:24 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0685b101-a7b2-4752-ab22-90c2b1af527d tempest-ExportLocationsTest-1017217578 tempest-ExportLocationsTest-1017217578-project-admin] RBAC: Authorizing `identity:create_grant(project_id=87c113478e754c47aea49a8b703cd2f6, user_id=8688f80695814f34bfb56342c4e54028, role_id=44620cad10ae407c90c91e2c296adb04)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:24 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0685b101-a7b2-4752-ab22-90c2b1af527d tempest-ExportLocationsTest-1017217578 tempest-ExportLocationsTest-1017217578-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:24 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e014aa56-ca68-4e26-bc21-bb73f0f03f76 tempest-AdminActionsAPIOnlyNegativeTest-1820624707 tempest-AdminActionsAPIOnlyNegativeTest-1820624707-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:24 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d16a81-d273-4794-b716-93a451f7eca9 tempest-AdminActionsAPIOnlyNegativeTest-1820624707 tempest-AdminActionsAPIOnlyNegativeTest-1820624707-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c3c14495e243028b5a760f7c1d86bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e597e913ff9348f29791175d986c8a59', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:24 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d16a81-d273-4794-b716-93a451f7eca9 tempest-AdminActionsAPIOnlyNegativeTest-1820624707 tempest-AdminActionsAPIOnlyNegativeTest-1820624707-project-admin] REQUEST_METHOD: `PUT` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:24 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d16a81-d273-4794-b716-93a451f7eca9 tempest-AdminActionsAPIOnlyNegativeTest-1820624707 tempest-AdminActionsAPIOnlyNegativeTest-1820624707-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:24 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d16a81-d273-4794-b716-93a451f7eca9 tempest-AdminActionsAPIOnlyNegativeTest-1820624707 tempest-AdminActionsAPIOnlyNegativeTest-1820624707-project-admin] PATH_INFO: `/v3/projects/e597e913ff9348f29791175d986c8a59/users/14783f4fbce14880b4db4a628827607e/roles/44620cad10ae407c90c91e2c296adb04` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:24 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d16a81-d273-4794-b716-93a451f7eca9 tempest-AdminActionsAPIOnlyNegativeTest-1820624707 tempest-AdminActionsAPIOnlyNegativeTest-1820624707-project-admin] RBAC: Authorizing `identity:create_grant(project_id=e597e913ff9348f29791175d986c8a59, user_id=14783f4fbce14880b4db4a628827607e, role_id=44620cad10ae407c90c91e2c296adb04)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:24 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 656/1303] 10.27.203.238 () {64 vars in 1571 bytes} [Tue May 28 12:56:24 2024] PUT /identity/v3/projects/87c113478e754c47aea49a8b703cd2f6/users/8688f80695814f34bfb56342c4e54028/roles/44620cad10ae407c90c91e2c296adb04 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:56:24 l75lg1-v1 dstat.sh[49771]: 28-05 12:56:24| 37 3 56 4 0|5591M 1924M 277M 7834M| 14k 0 | 0 10M| 0 521 | 12k 19k|1.66 0.93 0.96|5.0 1.0 0| 0 0 | 0 2048M| 29 334 0 23 0 May 28 12:56:24 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d16a81-d273-4794-b716-93a451f7eca9 tempest-AdminActionsAPIOnlyNegativeTest-1820624707 tempest-AdminActionsAPIOnlyNegativeTest-1820624707-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:24 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 648/1304] 10.27.203.238 () {64 vars in 1571 bytes} [Tue May 28 12:56:24 2024] PUT /identity/v3/projects/e597e913ff9348f29791175d986c8a59/users/14783f4fbce14880b4db4a628827607e/roles/44620cad10ae407c90c91e2c296adb04 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:56:24 l75lg1-v1 devstack@m-api.service[98330]: DEBUG dbcounter [-] [98330] Writer thread running {{(pid=98330) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} May 28 12:56:24 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-f17411af-d50c-460f-9662-2c5d602e4dfa tempest-ExportLocationsAPIOnlyNegativeTest-900714483 tempest-ExportLocationsAPIOnlyNegativeTest-900714483-project-admin] HTTP exception thrown: Share 'fake-inexistent-share-id' not found. May 28 12:56:24 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-f17411af-d50c-460f-9662-2c5d602e4dfa tempest-ExportLocationsAPIOnlyNegativeTest-900714483 tempest-ExportLocationsAPIOnlyNegativeTest-900714483-project-admin] http://10.27.203.238/share/v2/8cf929567af24bf185c33b3a12b4533c/shares/fake-inexistent-share-id/export_locations returned with HTTP 404 May 28 12:56:24 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1/1] 10.27.203.238 () {64 vars in 1466 bytes} [Tue May 28 12:56:22 2024] GET /share/v2/8cf929567af24bf185c33b3a12b4533c/shares/fake-inexistent-share-id/export_locations => generated 89 bytes in 1517 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 12:56:24 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0685b101-a7b2-4752-ab22-90c2b1af527d tempest-ExportLocationsTest-1017217578 tempest-ExportLocationsTest-1017217578-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:24 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0685b101-a7b2-4752-ab22-90c2b1af527d tempest-ExportLocationsTest-1017217578 tempest-ExportLocationsTest-1017217578-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:24 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c96c58-a2f7-4b2d-a2f2-5f3720678b18 service manila] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f110cf6300f049c897d0aab63218d1e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:24 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c96c58-a2f7-4b2d-a2f2-5f3720678b18 service manila] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:24 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c96c58-a2f7-4b2d-a2f2-5f3720678b18 service manila] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:24 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c96c58-a2f7-4b2d-a2f2-5f3720678b18 service manila] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:24 l75lg1-v1 devstack@m-api.service[98329]: DEBUG dbcounter [-] [98329] Writer thread running {{(pid=98329) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} May 28 12:56:24 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c96c58-a2f7-4b2d-a2f2-5f3720678b18 service manila] RBAC: Authorizing `identity:validate_token()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:24 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c96c58-a2f7-4b2d-a2f2-5f3720678b18 service manila] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:24 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 657/1305] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 12:56:24 2024] GET /identity/v3/auth/tokens => generated 4079 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 12:56:24 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-33af43ff-9efc-4576-b4a5-046e28d76e7f tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/types returned with HTTP 200 May 28 12:56:24 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1/2] 10.27.203.238 () {66 vars in 1359 bytes} [Tue May 28 12:56:22 2024] POST /share/v2/a3499cb78849424db45e54caac01de92/types => generated 677 bytes in 1585 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:56:24 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-81462ad5-8035-4fde-8466-b168dd101681 tempest-AdminActionsNegativeTest-763023849 tempest-AdminActionsNegativeTest-763023849-project-admin] POST http://10.27.203.238/share/v2/7c36a466cc2a42b195f921474b0f4de5/types May 28 12:56:24 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-81462ad5-8035-4fde-8466-b168dd101681 tempest-AdminActionsNegativeTest-763023849 tempest-AdminActionsNegativeTest-763023849-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share_type": {"name": "tempest-typeshare-type-1815928635", "extra_specs": {"driver_handles_share_servers": "False", "snapshot_support": true}, "share_type_access:is_public": true}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:56:24 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d16a81-d273-4794-b716-93a451f7eca9 tempest-AdminActionsAPIOnlyNegativeTest-1820624707 tempest-AdminActionsAPIOnlyNegativeTest-1820624707-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:24 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d16a81-d273-4794-b716-93a451f7eca9 tempest-AdminActionsAPIOnlyNegativeTest-1820624707 tempest-AdminActionsAPIOnlyNegativeTest-1820624707-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:24 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459579cd-5ac6-460f-979f-73dcaa12cd70 service manila] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f110cf6300f049c897d0aab63218d1e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:24 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459579cd-5ac6-460f-979f-73dcaa12cd70 service manila] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:24 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459579cd-5ac6-460f-979f-73dcaa12cd70 service manila] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:24 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459579cd-5ac6-460f-979f-73dcaa12cd70 service manila] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:24 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-81462ad5-8035-4fde-8466-b168dd101681 tempest-AdminActionsNegativeTest-763023849 tempest-AdminActionsNegativeTest-763023849-project-admin] http://10.27.203.238/share/v2/7c36a466cc2a42b195f921474b0f4de5/types returned with HTTP 200 May 28 12:56:24 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 2/3] 10.27.203.238 () {66 vars in 1359 bytes} [Tue May 28 12:56:24 2024] POST /share/v2/7c36a466cc2a42b195f921474b0f4de5/types => generated 679 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:56:24 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c96c58-a2f7-4b2d-a2f2-5f3720678b18 service manila] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:24 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c96c58-a2f7-4b2d-a2f2-5f3720678b18 service manila] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:24 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a8622a-a5ba-42d4-aee3-325a09635bba service manila] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f110cf6300f049c897d0aab63218d1e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:24 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a8622a-a5ba-42d4-aee3-325a09635bba service manila] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:24 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a8622a-a5ba-42d4-aee3-325a09635bba service manila] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:24 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a8622a-a5ba-42d4-aee3-325a09635bba service manila] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:24 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459579cd-5ac6-460f-979f-73dcaa12cd70 service manila] RBAC: Authorizing `identity:validate_token()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:24 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459579cd-5ac6-460f-979f-73dcaa12cd70 service manila] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:24 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 649/1306] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 12:56:24 2024] GET /identity/v3/auth/tokens => generated 4071 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 12:56:24 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-12ceea52-5200-4498-9ddc-21a857e33788 tempest-ExportLocationsTest-1017217578 tempest-ExportLocationsTest-1017217578-project-admin] POST http://10.27.203.238/share/v2/87c113478e754c47aea49a8b703cd2f6/types May 28 12:56:24 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-12ceea52-5200-4498-9ddc-21a857e33788 tempest-ExportLocationsTest-1017217578 tempest-ExportLocationsTest-1017217578-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share_type": {"name": "tempest-typeshare-type-287102790", "extra_specs": {"driver_handles_share_servers": "False"}, "share_type_access:is_public": true}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:56:24 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-12ceea52-5200-4498-9ddc-21a857e33788 tempest-ExportLocationsTest-1017217578 tempest-ExportLocationsTest-1017217578-project-admin] http://10.27.203.238/share/v2/87c113478e754c47aea49a8b703cd2f6/types returned with HTTP 200 May 28 12:56:24 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 2/4] 10.27.203.238 () {66 vars in 1359 bytes} [Tue May 28 12:56:24 2024] POST /share/v2/87c113478e754c47aea49a8b703cd2f6/types => generated 621 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:56:24 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-bb0bb333-bed4-42d9-b60c-c80deadc5f39 tempest-ExportLocationsAPIOnlyNegativeTest-900714483 tempest-ExportLocationsAPIOnlyNegativeTest-900714483-project-admin] GET http://10.27.203.238/share/v2/8cf929567af24bf185c33b3a12b4533c/share_instances/fake-inexistent-share-instance-id/export_locations May 28 12:56:24 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-bb0bb333-bed4-42d9-b60c-c80deadc5f39 tempest-ExportLocationsAPIOnlyNegativeTest-900714483 tempest-ExportLocationsAPIOnlyNegativeTest-900714483-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:24 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-bb0bb333-bed4-42d9-b60c-c80deadc5f39 tempest-ExportLocationsAPIOnlyNegativeTest-900714483 tempest-ExportLocationsAPIOnlyNegativeTest-900714483-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:24 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a8622a-a5ba-42d4-aee3-325a09635bba service manila] RBAC: Authorizing `identity:validate_token()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:24 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a8622a-a5ba-42d4-aee3-325a09635bba service manila] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:24 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 658/1307] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 12:56:24 2024] GET /identity/v3/auth/tokens => generated 4095 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 12:56:24 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-51789c80-8a98-4fff-b882-764c8c0a59ba tempest-AdminActionsAPIOnlyNegativeTest-1820624707 tempest-AdminActionsAPIOnlyNegativeTest-1820624707-project-admin] POST http://10.27.203.238/share/v2/e597e913ff9348f29791175d986c8a59/shares/fake/action May 28 12:56:24 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-51789c80-8a98-4fff-b882-764c8c0a59ba tempest-AdminActionsAPIOnlyNegativeTest-1820624707 tempest-AdminActionsAPIOnlyNegativeTest-1820624707-project-admin] Action body: b'{"force_delete": null}' {{(pid=98330) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:56:24 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-51789c80-8a98-4fff-b882-764c8c0a59ba tempest-AdminActionsAPIOnlyNegativeTest-1820624707 tempest-AdminActionsAPIOnlyNegativeTest-1820624707-project-admin] Action: 'action', calling method: Controller.__getattribute__..version_select, body: {"force_delete": null} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:56:24 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-bb0bb333-bed4-42d9-b60c-c80deadc5f39 tempest-ExportLocationsAPIOnlyNegativeTest-900714483 tempest-ExportLocationsAPIOnlyNegativeTest-900714483-project-admin] HTTP exception thrown: Share instance 'fake-inexistent-share-instance-id' not found. May 28 12:56:24 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-bb0bb333-bed4-42d9-b60c-c80deadc5f39 tempest-ExportLocationsAPIOnlyNegativeTest-900714483 tempest-ExportLocationsAPIOnlyNegativeTest-900714483-project-admin] http://10.27.203.238/share/v2/8cf929567af24bf185c33b3a12b4533c/share_instances/fake-inexistent-share-instance-id/export_locations returned with HTTP 404 May 28 12:56:24 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 3/5] 10.27.203.238 () {64 vars in 1520 bytes} [Tue May 28 12:56:24 2024] GET /share/v2/8cf929567af24bf185c33b3a12b4533c/share_instances/fake-inexistent-share-instance-id/export_locations => generated 107 bytes in 31 msecs (HTTP/1.1 404) 6 headers in 238 bytes (1 switches on core 0) May 28 12:56:24 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-51789c80-8a98-4fff-b882-764c8c0a59ba tempest-AdminActionsAPIOnlyNegativeTest-1820624707 tempest-AdminActionsAPIOnlyNegativeTest-1820624707-project-admin] HTTP exception thrown: Resource could not be found. May 28 12:56:24 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-51789c80-8a98-4fff-b882-764c8c0a59ba tempest-AdminActionsAPIOnlyNegativeTest-1820624707 tempest-AdminActionsAPIOnlyNegativeTest-1820624707-project-admin] http://10.27.203.238/share/v2/e597e913ff9348f29791175d986c8a59/shares/fake/action returned with HTTP 404 May 28 12:56:24 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 3/6] 10.27.203.238 () {66 vars in 1397 bytes} [Tue May 28 12:56:24 2024] POST /share/v2/e597e913ff9348f29791175d986c8a59/shares/fake/action => generated 78 bytes in 73 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 12:56:24 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-3a47ce09-c8c0-4938-92e8-423050f78f81 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] POST http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/shares May 28 12:56:24 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-3a47ce09-c8c0-4938-92e8-423050f78f81 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share": {"share_proto": "nfs", "description": "Tempest's share", "snapshot_id": null, "name": "tempest-tempest-created-share-150519761", "size": 1, "metadata": {}, "is_public": false, "share_type": "ed6e3c4a-7505-47e7-9c77-78267ba93d85"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:56:24 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459579cd-5ac6-460f-979f-73dcaa12cd70 service manila] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:24 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.v1.shares [None req-3a47ce09-c8c0-4938-92e8-423050f78f81 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Create NFS share of 1 GB May 28 12:56:24 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-fc403043-74e2-4b87-a388-18694293b445 tempest-AdminActionsNegativeTest-763023849 tempest-AdminActionsNegativeTest-763023849-project-admin] POST http://10.27.203.238/share/v2/7c36a466cc2a42b195f921474b0f4de5/shares May 28 12:56:24 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-fc403043-74e2-4b87-a388-18694293b445 tempest-AdminActionsNegativeTest-763023849 tempest-AdminActionsNegativeTest-763023849-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share": {"share_proto": "nfs", "description": "Tempest's share", "snapshot_id": null, "name": "tempest-tempest-created-share-661839522", "size": 1, "metadata": {}, "is_public": false, "share_type": "27f6d0df-1d2a-4709-a297-418caab2a49e"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:56:24 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.v1.shares [None req-fc403043-74e2-4b87-a388-18694293b445 tempest-AdminActionsNegativeTest-763023849 tempest-AdminActionsNegativeTest-763023849-project-admin] Create NFS share of 1 GB May 28 12:56:24 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459579cd-5ac6-460f-979f-73dcaa12cd70 service manila] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:24 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e6cb21-5e19-4c43-bb39-660ad562920f None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:24 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e6cb21-5e19-4c43-bb39-660ad562920f None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:24 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e6cb21-5e19-4c43-bb39-660ad562920f None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:24 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e6cb21-5e19-4c43-bb39-660ad562920f None admin] PATH_INFO: `/v3/users/52e0c20c9fad483c8d05bec6f25acd61` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:24 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e6cb21-5e19-4c43-bb39-660ad562920f None admin] RBAC: Authorizing `identity:delete_user(user_id=52e0c20c9fad483c8d05bec6f25acd61)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:24 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e6cb21-5e19-4c43-bb39-660ad562920f None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:24 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_db.api [None req-fc403043-74e2-4b87-a388-18694293b445 tempest-AdminActionsNegativeTest-763023849 tempest-AdminActionsNegativeTest-763023849-project-admin] DB error: (pymysql.err.OperationalError) (1213, 'Deadlock found when trying to get lock; try restarting transaction') May 28 12:56:24 l75lg1-v1 devstack@m-api.service[98330]: [SQL: INSERT INTO quota_usages (project_id, user_id, share_type_id, resource, in_use, reserved, until_refresh, created_at, updated_at, deleted_at, deleted) VALUES (%(project_id)s, %(user_id)s, %(share_type_id)s, %(resource)s, %(in_use)s, %(reserved)s, %(until_refresh)s, %(created_at)s, %(updated_at)s, %(deleted_at)s, %(deleted)s)] May 28 12:56:24 l75lg1-v1 devstack@m-api.service[98330]: [parameters: {'project_id': '7c36a466cc2a42b195f921474b0f4de5', 'user_id': '7aee50b56a654f16a4b22ad15fdd1521', 'share_type_id': None, 'resource': 'gigabytes', 'in_use': 0, 'reserved': 0, 'until_refresh': None, 'created_at': datetime.datetime(2024, 5, 28, 12, 56, 24, 650933), 'updated_at': datetime.datetime(2024, 5, 28, 12, 56, 24, 649445), 'deleted_at': None, 'deleted': 0}] May 28 12:56:24 l75lg1-v1 devstack@m-api.service[98330]: (Background on this error at: https://sqlalche.me/e/20/e3q8) {{(pid=98330) _is_exception_expected /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/api.py:184}} May 28 12:56:24 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_db.api [None req-fc403043-74e2-4b87-a388-18694293b445 tempest-AdminActionsNegativeTest-763023849 tempest-AdminActionsNegativeTest-763023849-project-admin] Performing DB retry for function manila.db.sqlalchemy.api._quota_reserve {{(pid=98330) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/api.py:155}} May 28 12:56:24 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-f8e6cb21-5e19-4c43-bb39-660ad562920f None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52e0c20c9fad483c8d05bec6f25acd61', 'request_id': 'req-f8e6cb21-5e19-4c43-bb39-660ad562920f'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:24 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-f8e6cb21-5e19-4c43-bb39-660ad562920f None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52e0c20c9fad483c8d05bec6f25acd61', 'request_id': 'req-f8e6cb21-5e19-4c43-bb39-660ad562920f'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:24 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-f8e6cb21-5e19-4c43-bb39-660ad562920f None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52e0c20c9fad483c8d05bec6f25acd61', 'request_id': 'req-f8e6cb21-5e19-4c43-bb39-660ad562920f'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:24 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-f8e6cb21-5e19-4c43-bb39-660ad562920f None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52e0c20c9fad483c8d05bec6f25acd61', 'request_id': 'req-f8e6cb21-5e19-4c43-bb39-660ad562920f'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:24 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-f8e6cb21-5e19-4c43-bb39-660ad562920f None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52e0c20c9fad483c8d05bec6f25acd61', 'request_id': 'req-f8e6cb21-5e19-4c43-bb39-660ad562920f'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:24 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 650/1308] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 12:56:24 2024] DELETE /identity/v3/users/52e0c20c9fad483c8d05bec6f25acd61 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:56:24 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.quota [None req-3a47ce09-c8c0-4938-92e8-423050f78f81 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Created reservations ['62be1646-ff3e-4c7c-80ec-8e947c6f0dce', '35a69495-a231-423b-9758-d9877e006657', '3590523d-b4a3-48a5-947f-13b5054d5653', 'be27fd20-d832-4b51-902e-742907dfad0f'] {{(pid=98329) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 12:56:24 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f47bfa5-218e-4bf7-a89e-8e1db63eba9f None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:24 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f47bfa5-218e-4bf7-a89e-8e1db63eba9f None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:24 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f47bfa5-218e-4bf7-a89e-8e1db63eba9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:24 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-8f47bfa5-218e-4bf7-a89e-8e1db63eba9f None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:56:24 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-8f47bfa5-218e-4bf7-a89e-8e1db63eba9f None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:56:24 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-8f47bfa5-218e-4bf7-a89e-8e1db63eba9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:24 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 659/1309] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:56:24 2024] POST /identity/v3/auth/tokens => generated 2960 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 12:56:24 l75lg1-v1 neutron-server[77618]: DEBUG neutron.wsgi [-] (77618) accepted ('10.27.203.238', 55926) {{(pid=77618) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 12:56:24 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e6cb21-5e19-4c43-bb39-660ad562920f None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:24 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-f8e6cb21-5e19-4c43-bb39-660ad562920f None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:24 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.quota [None req-3a47ce09-c8c0-4938-92e8-423050f78f81 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Committed reservations ['62be1646-ff3e-4c7c-80ec-8e947c6f0dce', '35a69495-a231-423b-9758-d9877e006657', '3590523d-b4a3-48a5-947f-13b5054d5653', 'be27fd20-d832-4b51-902e-742907dfad0f'] {{(pid=98329) commit /opt/stack/manila/manila/quota.py:1063}} May 28 12:56:24 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e6cb21-5e19-4c43-bb39-660ad562920f None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:24 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baa5b9b-ef1c-44cf-83a7-aeccbb0e931f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef17047035e4b518fd5360a01f2da1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:24 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baa5b9b-ef1c-44cf-83a7-aeccbb0e931f service neutron] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:24 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baa5b9b-ef1c-44cf-83a7-aeccbb0e931f service neutron] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:24 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baa5b9b-ef1c-44cf-83a7-aeccbb0e931f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:24 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8baa5b9b-ef1c-44cf-83a7-aeccbb0e931f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:24 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8baa5b9b-ef1c-44cf-83a7-aeccbb0e931f service neutron] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:24 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 651/1310] 10.27.203.238 () {64 vars in 1432 bytes} [Tue May 28 12:56:24 2024] GET /identity/v3/auth/tokens => generated 2960 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 28 12:56:24 l75lg1-v1 neutron-server[77618]: INFO neutron.wsgi [None req-701af86f-b505-4801-9808-1cb61dfd809f None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=8cf929567af24bf185c33b3a12b4533c&name=default HTTP/1.1" status: 200 len: 216 time: 0.0749912 May 28 12:56:24 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f47bfa5-218e-4bf7-a89e-8e1db63eba9f None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:24 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-8f47bfa5-218e-4bf7-a89e-8e1db63eba9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:24 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f47bfa5-218e-4bf7-a89e-8e1db63eba9f None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:24 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41916f5d-299c-435b-b4a3-45d51558a288 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:24 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41916f5d-299c-435b-b4a3-45d51558a288 None admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:24 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41916f5d-299c-435b-b4a3-45d51558a288 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:24 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41916f5d-299c-435b-b4a3-45d51558a288 None admin] PATH_INFO: `/v3/projects/8cf929567af24bf185c33b3a12b4533c` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:24 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41916f5d-299c-435b-b4a3-45d51558a288 None admin] RBAC: Authorizing `identity:delete_project(project_id=8cf929567af24bf185c33b3a12b4533c)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:24 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41916f5d-299c-435b-b4a3-45d51558a288 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:24 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-3a47ce09-c8c0-4938-92e8-423050f78f81 tempest-AdminActionsTest-1749172189 None] Starting with 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:80}} May 28 12:56:24 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-41916f5d-299c-435b-b4a3-45d51558a288 None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8cf929567af24bf185c33b3a12b4533c', 'request_id': 'req-41916f5d-299c-435b-b4a3-45d51558a288'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:24 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-3a47ce09-c8c0-4938-92e8-423050f78f81 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/shares returned with HTTP 200 May 28 12:56:24 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 4/7] 10.27.203.238 () {66 vars in 1362 bytes} [Tue May 28 12:56:24 2024] POST /share/v2/a3499cb78849424db45e54caac01de92/shares => generated 1347 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:56:24 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-41916f5d-299c-435b-b4a3-45d51558a288 None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8cf929567af24bf185c33b3a12b4533c', 'request_id': 'req-41916f5d-299c-435b-b4a3-45d51558a288'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:24 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-b0b36f71-852d-463a-b1c8-4066ce824def tempest-ExportLocationsTest-1017217578 tempest-ExportLocationsTest-1017217578-project-admin] POST http://10.27.203.238/share/v2/87c113478e754c47aea49a8b703cd2f6/shares May 28 12:56:24 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-b0b36f71-852d-463a-b1c8-4066ce824def tempest-ExportLocationsTest-1017217578 tempest-ExportLocationsTest-1017217578-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share": {"share_proto": "nfs", "description": "Tempest's share", "snapshot_id": null, "name": "tempest-tempest-created-share-1018303722", "size": 1, "metadata": {}, "is_public": false, "share_type": "873cf5f5-29fa-4edc-838b-4dbf288089b4"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:56:24 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.v1.shares [None req-b0b36f71-852d-463a-b1c8-4066ce824def tempest-ExportLocationsTest-1017217578 tempest-ExportLocationsTest-1017217578-project-admin] Create NFS share of 1 GB May 28 12:56:24 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-41916f5d-299c-435b-b4a3-45d51558a288 None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8cf929567af24bf185c33b3a12b4533c', 'request_id': 'req-41916f5d-299c-435b-b4a3-45d51558a288'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:24 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-3a47ce09-c8c0-4938-92e8-423050f78f81 tempest-AdminActionsTest-1749172189 None] Filter OnlyHostFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:56:24 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-3a47ce09-c8c0-4938-92e8-423050f78f81 tempest-AdminActionsTest-1749172189 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:56:24 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.capacity [None req-3a47ce09-c8c0-4938-92e8-423050f78f81 tempest-AdminActionsTest-1749172189 None] Space information for share creation on host l75lg1-v1@vast#vast (requested / avail): 1/2082 {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/capacity.py:83}} May 28 12:56:24 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-3a47ce09-c8c0-4938-92e8-423050f78f81 tempest-AdminActionsTest-1749172189 None] Filter CapacityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:56:24 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-3a47ce09-c8c0-4938-92e8-423050f78f81 tempest-AdminActionsTest-1749172189 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:56:24 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-3a47ce09-c8c0-4938-92e8-423050f78f81 tempest-AdminActionsTest-1749172189 None] Driver Filter: Checking host 'l75lg1-v1@vast#vast' {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:37}} May 28 12:56:24 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-3a47ce09-c8c0-4938-92e8-423050f78f81 tempest-AdminActionsTest-1749172189 None] Filter function not set :: passing host. {{(pid=98327) _check_filter_function /opt/stack/manila/manila/scheduler/filters/driver.py:53}} May 28 12:56:24 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-3a47ce09-c8c0-4938-92e8-423050f78f81 tempest-AdminActionsTest-1749172189 None] Result: True {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:40}} May 28 12:56:24 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-3a47ce09-c8c0-4938-92e8-423050f78f81 tempest-AdminActionsTest-1749172189 None] Done checking host 'l75lg1-v1@vast#vast' {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:41}} May 28 12:56:24 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-3a47ce09-c8c0-4938-92e8-423050f78f81 tempest-AdminActionsTest-1749172189 None] Filter DriverFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:56:24 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-3a47ce09-c8c0-4938-92e8-423050f78f81 tempest-AdminActionsTest-1749172189 None] Filter ShareReplicationFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:56:24 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-3a47ce09-c8c0-4938-92e8-423050f78f81 tempest-AdminActionsTest-1749172189 None] Filter CreateFromSnapshotFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:56:24 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-3a47ce09-c8c0-4938-92e8-423050f78f81 tempest-AdminActionsTest-1749172189 None] Filter AffinityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:56:24 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-3a47ce09-c8c0-4938-92e8-423050f78f81 tempest-AdminActionsTest-1749172189 None] Filter AntiAffinityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:56:24 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.drivers.filter [None req-3a47ce09-c8c0-4938-92e8-423050f78f81 tempest-AdminActionsTest-1749172189 None] Filtered share [host: 'l75lg1-v1@vast#vast', free_capacity_gb: 2082.6229242384434, pools: None] {{(pid=98327) _schedule_share /opt/stack/manila/manila/scheduler/drivers/filter.py:268}} May 28 12:56:24 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-3a47ce09-c8c0-4938-92e8-423050f78f81 tempest-AdminActionsTest-1749172189 None] Checking host 'l75lg1-v1@vast#vast' {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:46}} May 28 12:56:24 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.weighers.goodness [None req-3a47ce09-c8c0-4938-92e8-423050f78f81 tempest-AdminActionsTest-1749172189 None] Goodness function not set :: defaulting to minimal goodness rating of 0. May 28 12:56:24 l75lg1-v1 manila-scheduler[98327]: INFO manila.scheduler.weighers.goodness [None req-3a47ce09-c8c0-4938-92e8-423050f78f81 tempest-AdminActionsTest-1749172189 None] Goodness function result for host l75lg1-v1@vast#vast: 0. May 28 12:56:24 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-3a47ce09-c8c0-4938-92e8-423050f78f81 tempest-AdminActionsTest-1749172189 None] Goodness: 0 {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:48}} May 28 12:56:24 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-3a47ce09-c8c0-4938-92e8-423050f78f81 tempest-AdminActionsTest-1749172189 None] Done checking host 'l75lg1-v1@vast#vast' {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:49}} May 28 12:56:24 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.drivers.filter [None req-3a47ce09-c8c0-4938-92e8-423050f78f81 tempest-AdminActionsTest-1749172189 None] Choosing for share: WeighedHost [host: l75lg1-v1@vast#vast, weight: 0.0] {{(pid=98327) _schedule_share /opt/stack/manila/manila/scheduler/drivers/filter.py:274}} May 28 12:56:24 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-41916f5d-299c-435b-b4a3-45d51558a288 None admin] The token cache is being invalidate because project 8cf929567af24bf185c33b3a12b4533c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 12:56:24 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-41916f5d-299c-435b-b4a3-45d51558a288 None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:24 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-41916f5d-299c-435b-b4a3-45d51558a288 None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:24 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 660/1311] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 12:56:24 2024] DELETE /identity/v3/projects/8cf929567af24bf185c33b3a12b4533c => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:56:24 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc407cc0-2122-49a2-8bcf-e1c55cf2e8ea None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:24 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc407cc0-2122-49a2-8bcf-e1c55cf2e8ea None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:24 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc407cc0-2122-49a2-8bcf-e1c55cf2e8ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:24 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-fc407cc0-2122-49a2-8bcf-e1c55cf2e8ea None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:56:24 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-fc407cc0-2122-49a2-8bcf-e1c55cf2e8ea None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:56:24 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-fc407cc0-2122-49a2-8bcf-e1c55cf2e8ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:24 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 652/1312] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:56:24 2024] POST /identity/v3/auth/tokens => generated 312 bytes in 20 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 28 12:56:24 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634822c6-b3bc-4191-905a-f9496faacabf None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:24 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634822c6-b3bc-4191-905a-f9496faacabf None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:24 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634822c6-b3bc-4191-905a-f9496faacabf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:24 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-634822c6-b3bc-4191-905a-f9496faacabf None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:56:24 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-634822c6-b3bc-4191-905a-f9496faacabf None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:56:24 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-634822c6-b3bc-4191-905a-f9496faacabf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:24 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.quota [None req-b0b36f71-852d-463a-b1c8-4066ce824def tempest-ExportLocationsTest-1017217578 tempest-ExportLocationsTest-1017217578-project-admin] Created reservations ['7349b654-f794-46dc-82cb-b2996f719566', '67a58022-f4e5-4923-966c-2def7dcff764', 'aba6a136-0d68-44e3-bd74-a62bbad93524', '21ba239b-da22-4cff-8f72-46fc6c4d7810'] {{(pid=98329) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 12:56:24 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 661/1313] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:56:24 2024] POST /identity/v3/auth/tokens => generated 2960 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 12:56:24 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc407cc0-2122-49a2-8bcf-e1c55cf2e8ea None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc407cc0-2122-49a2-8bcf-e1c55cf2e8ea None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b8df7e-9d57-4356-bba9-71b481480305 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b8df7e-9d57-4356-bba9-71b481480305 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b8df7e-9d57-4356-bba9-71b481480305 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b8df7e-9d57-4356-bba9-71b481480305 None admin] PATH_INFO: `/v3/domains` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b8df7e-9d57-4356-bba9-71b481480305 None admin] RBAC: Adding query filter params (name=Default) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b8df7e-9d57-4356-bba9-71b481480305 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b8df7e-9d57-4356-bba9-71b481480305 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 653/1314] 10.27.203.238 () {62 vars in 1220 bytes} [Tue May 28 12:56:24 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634822c6-b3bc-4191-905a-f9496faacabf None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:25 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.quota [None req-b0b36f71-852d-463a-b1c8-4066ce824def tempest-ExportLocationsTest-1017217578 tempest-ExportLocationsTest-1017217578-project-admin] Committed reservations ['7349b654-f794-46dc-82cb-b2996f719566', '67a58022-f4e5-4923-966c-2def7dcff764', 'aba6a136-0d68-44e3-bd74-a62bbad93524', '21ba239b-da22-4cff-8f72-46fc6c4d7810'] {{(pid=98329) commit /opt/stack/manila/manila/quota.py:1063}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634822c6-b3bc-4191-905a-f9496faacabf None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1274ca2b-384d-4caf-abbd-3f3d3f9510bd None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1274ca2b-384d-4caf-abbd-3f3d3f9510bd None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1274ca2b-384d-4caf-abbd-3f3d3f9510bd None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1274ca2b-384d-4caf-abbd-3f3d3f9510bd None admin] PATH_INFO: `/v3/projects` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1274ca2b-384d-4caf-abbd-3f3d3f9510bd None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1274ca2b-384d-4caf-abbd-3f3d3f9510bd None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 662/1315] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 12:56:25 2024] POST /identity/v3/projects => generated 381 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b8df7e-9d57-4356-bba9-71b481480305 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b8df7e-9d57-4356-bba9-71b481480305 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:25 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-b0b36f71-852d-463a-b1c8-4066ce824def tempest-ExportLocationsTest-1017217578 None] Starting with 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:80}} May 28 12:56:25 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-b0b36f71-852d-463a-b1c8-4066ce824def tempest-ExportLocationsTest-1017217578 None] Filter OnlyHostFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:56:25 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-b0b36f71-852d-463a-b1c8-4066ce824def tempest-ExportLocationsTest-1017217578 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:56:25 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.capacity [None req-b0b36f71-852d-463a-b1c8-4066ce824def tempest-ExportLocationsTest-1017217578 None] Space information for share creation on host l75lg1-v1@vast#vast (requested / avail): 1/2081 {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/capacity.py:83}} May 28 12:56:25 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-b0b36f71-852d-463a-b1c8-4066ce824def tempest-ExportLocationsTest-1017217578 None] Filter CapacityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:56:25 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-b0b36f71-852d-463a-b1c8-4066ce824def tempest-ExportLocationsTest-1017217578 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:56:25 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-b0b36f71-852d-463a-b1c8-4066ce824def tempest-ExportLocationsTest-1017217578 None] Driver Filter: Checking host 'l75lg1-v1@vast#vast' {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:37}} May 28 12:56:25 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-b0b36f71-852d-463a-b1c8-4066ce824def tempest-ExportLocationsTest-1017217578 None] Filter function not set :: passing host. {{(pid=98327) _check_filter_function /opt/stack/manila/manila/scheduler/filters/driver.py:53}} May 28 12:56:25 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-b0b36f71-852d-463a-b1c8-4066ce824def tempest-ExportLocationsTest-1017217578 None] Result: True {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:40}} May 28 12:56:25 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-b0b36f71-852d-463a-b1c8-4066ce824def tempest-ExportLocationsTest-1017217578 None] Done checking host 'l75lg1-v1@vast#vast' {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:41}} May 28 12:56:25 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-b0b36f71-852d-463a-b1c8-4066ce824def tempest-ExportLocationsTest-1017217578 None] Filter DriverFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:56:25 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-b0b36f71-852d-463a-b1c8-4066ce824def tempest-ExportLocationsTest-1017217578 None] Filter ShareReplicationFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:56:25 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-b0b36f71-852d-463a-b1c8-4066ce824def tempest-ExportLocationsTest-1017217578 None] Filter CreateFromSnapshotFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:56:25 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-b0b36f71-852d-463a-b1c8-4066ce824def tempest-ExportLocationsTest-1017217578 None] Filter AffinityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:56:25 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-b0b36f71-852d-463a-b1c8-4066ce824def tempest-ExportLocationsTest-1017217578 None] Filter AntiAffinityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:56:25 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.drivers.filter [None req-b0b36f71-852d-463a-b1c8-4066ce824def tempest-ExportLocationsTest-1017217578 None] Filtered share [host: 'l75lg1-v1@vast#vast', free_capacity_gb: 2081.6229242384434, pools: None] {{(pid=98327) _schedule_share /opt/stack/manila/manila/scheduler/drivers/filter.py:268}} May 28 12:56:25 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-b0b36f71-852d-463a-b1c8-4066ce824def tempest-ExportLocationsTest-1017217578 None] Checking host 'l75lg1-v1@vast#vast' {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:46}} May 28 12:56:25 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.weighers.goodness [None req-b0b36f71-852d-463a-b1c8-4066ce824def tempest-ExportLocationsTest-1017217578 None] Goodness function not set :: defaulting to minimal goodness rating of 0. May 28 12:56:25 l75lg1-v1 manila-scheduler[98327]: INFO manila.scheduler.weighers.goodness [None req-b0b36f71-852d-463a-b1c8-4066ce824def tempest-ExportLocationsTest-1017217578 None] Goodness function result for host l75lg1-v1@vast#vast: 0. May 28 12:56:25 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-b0b36f71-852d-463a-b1c8-4066ce824def tempest-ExportLocationsTest-1017217578 None] Goodness: 0 {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:48}} May 28 12:56:25 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-b0b36f71-852d-463a-b1c8-4066ce824def tempest-ExportLocationsTest-1017217578 None] Done checking host 'l75lg1-v1@vast#vast' {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:49}} May 28 12:56:25 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.drivers.filter [None req-b0b36f71-852d-463a-b1c8-4066ce824def tempest-ExportLocationsTest-1017217578 None] Choosing for share: WeighedHost [host: l75lg1-v1@vast#vast, weight: 0.0] {{(pid=98327) _schedule_share /opt/stack/manila/manila/scheduler/drivers/filter.py:274}} May 28 12:56:25 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-b0b36f71-852d-463a-b1c8-4066ce824def tempest-ExportLocationsTest-1017217578 tempest-ExportLocationsTest-1017217578-project-admin] http://10.27.203.238/share/v2/87c113478e754c47aea49a8b703cd2f6/shares returned with HTTP 200 May 28 12:56:25 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 5/8] 10.27.203.238 () {66 vars in 1362 bytes} [Tue May 28 12:56:24 2024] POST /share/v2/87c113478e754c47aea49a8b703cd2f6/shares => generated 1349 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:56:25 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-e071ab4a-7d48-4d08-9520-e4cd5618505e tempest-AdminActionsAPIOnlyNegativeTest-1820624707 tempest-AdminActionsAPIOnlyNegativeTest-1820624707-project-admin] POST http://10.27.203.238/share/v2/e597e913ff9348f29791175d986c8a59/share_instances/fake/action May 28 12:56:25 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-e071ab4a-7d48-4d08-9520-e4cd5618505e tempest-AdminActionsAPIOnlyNegativeTest-1820624707 tempest-AdminActionsAPIOnlyNegativeTest-1820624707-project-admin] Action body: b'{"force_delete": null}' {{(pid=98329) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:56:25 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-e071ab4a-7d48-4d08-9520-e4cd5618505e tempest-AdminActionsAPIOnlyNegativeTest-1820624707 tempest-AdminActionsAPIOnlyNegativeTest-1820624707-project-admin] Action: 'action', calling method: Controller.__getattribute__..version_select, body: {"force_delete": null} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:56:25 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-3a47ce09-c8c0-4938-92e8-423050f78f81 tempest-AdminActionsTest-1749172189 None] >>> [GET] https://127.0.0.1:40443/api/vippools/ May 28 12:56:25 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-3a47ce09-c8c0-4938-92e8-423050f78f81 tempest-AdminActionsTest-1749172189 None] {'allow_redirects': True, 'params': {'name': 'vippool-1'}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39a4236-1648-45df-b2e2-c58646adfb67 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39a4236-1648-45df-b2e2-c58646adfb67 None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39a4236-1648-45df-b2e2-c58646adfb67 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39a4236-1648-45df-b2e2-c58646adfb67 None admin] PATH_INFO: `/v3/users` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:25 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-e071ab4a-7d48-4d08-9520-e4cd5618505e tempest-AdminActionsAPIOnlyNegativeTest-1820624707 tempest-AdminActionsAPIOnlyNegativeTest-1820624707-project-admin] HTTP exception thrown: Resource could not be found. May 28 12:56:25 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-e071ab4a-7d48-4d08-9520-e4cd5618505e tempest-AdminActionsAPIOnlyNegativeTest-1820624707 tempest-AdminActionsAPIOnlyNegativeTest-1820624707-project-admin] http://10.27.203.238/share/v2/e597e913ff9348f29791175d986c8a59/share_instances/fake/action returned with HTTP 404 May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39a4236-1648-45df-b2e2-c58646adfb67 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:25 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 6/9] 10.27.203.238 () {66 vars in 1424 bytes} [Tue May 28 12:56:25 2024] POST /share/v2/e597e913ff9348f29791175d986c8a59/share_instances/fake/action => generated 78 bytes in 14 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39a4236-1648-45df-b2e2-c58646adfb67 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:25 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-6fc4c9fe-e117-41f1-9a0f-df2f051a6da1 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] GET http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/shares/df0ea844-5fc1-4d04-8afb-5048ec5dc33f May 28 12:56:25 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-6fc4c9fe-e117-41f1-9a0f-df2f051a6da1 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:25 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-6fc4c9fe-e117-41f1-9a0f-df2f051a6da1 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-e39a4236-1648-45df-b2e2-c58646adfb67 None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 654/1316] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 12:56:25 2024] POST /identity/v3/users => generated 298 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1274ca2b-384d-4caf-abbd-3f3d3f9510bd None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1274ca2b-384d-4caf-abbd-3f3d3f9510bd None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7580941-7e85-42dd-8665-e61457289969 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7580941-7e85-42dd-8665-e61457289969 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7580941-7e85-42dd-8665-e61457289969 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7580941-7e85-42dd-8665-e61457289969 None admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7580941-7e85-42dd-8665-e61457289969 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7580941-7e85-42dd-8665-e61457289969 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 663/1317] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 12:56:25 2024] GET /identity/v3/roles => generated 1680 bytes in 18 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39a4236-1648-45df-b2e2-c58646adfb67 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39a4236-1648-45df-b2e2-c58646adfb67 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5718289e-41d3-4cb3-886e-6d4a45357456 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5718289e-41d3-4cb3-886e-6d4a45357456 None admin] REQUEST_METHOD: `PUT` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5718289e-41d3-4cb3-886e-6d4a45357456 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5718289e-41d3-4cb3-886e-6d4a45357456 None admin] PATH_INFO: `/v3/projects/2bd1b57c2edf4e92abdd1caa7cd467b8/users/8d7bbb6785df4869bd2645ce98ef1595/roles/e7989893488f483baa107be56668c4f8` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5718289e-41d3-4cb3-886e-6d4a45357456 None admin] RBAC: Authorizing `identity:create_grant(project_id=2bd1b57c2edf4e92abdd1caa7cd467b8, user_id=8d7bbb6785df4869bd2645ce98ef1595, role_id=e7989893488f483baa107be56668c4f8)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5718289e-41d3-4cb3-886e-6d4a45357456 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:25 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b0b36f71-852d-463a-b1c8-4066ce824def tempest-ExportLocationsTest-1017217578 None] >>> [GET] https://127.0.0.1:40443/api/vippools/ May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 655/1318] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 12:56:25 2024] PUT /identity/v3/projects/2bd1b57c2edf4e92abdd1caa7cd467b8/users/8d7bbb6785df4869bd2645ce98ef1595/roles/e7989893488f483baa107be56668c4f8 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:56:25 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b0b36f71-852d-463a-b1c8-4066ce824def tempest-ExportLocationsTest-1017217578 None] {'allow_redirects': True, 'params': {'name': 'vippool-1'}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7580941-7e85-42dd-8665-e61457289969 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7580941-7e85-42dd-8665-e61457289969 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed70166c-e88a-4f6d-85bb-50417a85410e None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed70166c-e88a-4f6d-85bb-50417a85410e None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed70166c-e88a-4f6d-85bb-50417a85410e None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed70166c-e88a-4f6d-85bb-50417a85410e None admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed70166c-e88a-4f6d-85bb-50417a85410e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed70166c-e88a-4f6d-85bb-50417a85410e None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:25 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-6fc4c9fe-e117-41f1-9a0f-df2f051a6da1 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/shares/df0ea844-5fc1-4d04-8afb-5048ec5dc33f returned with HTTP 200 May 28 12:56:25 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 7/10] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:56:25 2024] GET /share/v2/a3499cb78849424db45e54caac01de92/shares/df0ea844-5fc1-4d04-8afb-5048ec5dc33f => generated 1368 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 664/1319] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 12:56:25 2024] GET /identity/v3/roles => generated 1680 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:56:25 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-14d9ecfd-df39-49b2-a90a-4ab748d701c9 tempest-ExportLocationsTest-1017217578 tempest-ExportLocationsTest-1017217578-project-admin] GET http://10.27.203.238/share/v2/87c113478e754c47aea49a8b703cd2f6/shares/a96dff4b-6e98-4085-9f3b-45735d209546 May 28 12:56:25 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-14d9ecfd-df39-49b2-a90a-4ab748d701c9 tempest-ExportLocationsTest-1017217578 tempest-ExportLocationsTest-1017217578-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:25 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-14d9ecfd-df39-49b2-a90a-4ab748d701c9 tempest-ExportLocationsTest-1017217578 tempest-ExportLocationsTest-1017217578-project-admin] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5718289e-41d3-4cb3-886e-6d4a45357456 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:25 l75lg1-v1 dstat.sh[49771]: 28-05 12:56:25| 22 3 71 3 0|5612M 1903M 277M 7834M| 18k 8361B| 0 6473k| 0 707 |9845 17k|1.66 0.93 0.96|2.0 1.0 4.0| 0 0 | 0 2048M| 29 336 0 24 0 May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5718289e-41d3-4cb3-886e-6d4a45357456 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99673f82-4ec0-4efb-be0a-82046d4d078a None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99673f82-4ec0-4efb-be0a-82046d4d078a None admin] REQUEST_METHOD: `PUT` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99673f82-4ec0-4efb-be0a-82046d4d078a None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99673f82-4ec0-4efb-be0a-82046d4d078a None admin] PATH_INFO: `/v3/projects/2bd1b57c2edf4e92abdd1caa7cd467b8/users/8d7bbb6785df4869bd2645ce98ef1595/roles/e7989893488f483baa107be56668c4f8` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99673f82-4ec0-4efb-be0a-82046d4d078a None admin] RBAC: Authorizing `identity:create_grant(project_id=2bd1b57c2edf4e92abdd1caa7cd467b8, user_id=8d7bbb6785df4869bd2645ce98ef1595, role_id=e7989893488f483baa107be56668c4f8)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99673f82-4ec0-4efb-be0a-82046d4d078a None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 656/1320] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 12:56:25 2024] PUT /identity/v3/projects/2bd1b57c2edf4e92abdd1caa7cd467b8/users/8d7bbb6785df4869bd2645ce98ef1595/roles/e7989893488f483baa107be56668c4f8 => generated 0 bytes in 22 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4f1e25-58d8-4522-bdb4-5c475abaf361 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4f1e25-58d8-4522-bdb4-5c475abaf361 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4f1e25-58d8-4522-bdb4-5c475abaf361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:25 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-14d9ecfd-df39-49b2-a90a-4ab748d701c9 tempest-ExportLocationsTest-1017217578 tempest-ExportLocationsTest-1017217578-project-admin] http://10.27.203.238/share/v2/87c113478e754c47aea49a8b703cd2f6/shares/a96dff4b-6e98-4085-9f3b-45735d209546 returned with HTTP 200 May 28 12:56:25 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 8/11] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:56:25 2024] GET /share/v2/87c113478e754c47aea49a8b703cd2f6/shares/a96dff4b-6e98-4085-9f3b-45735d209546 => generated 1370 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:56:25 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-09de2944-f2ae-49aa-b1fa-de211fb69d13 tempest-AdminActionsAPIOnlyNegativeTest-1820624707 tempest-AdminActionsAPIOnlyNegativeTest-1820624707-project-admin] POST http://10.27.203.238/share/v2/e597e913ff9348f29791175d986c8a59/snapshots/fake/action May 28 12:56:25 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-09de2944-f2ae-49aa-b1fa-de211fb69d13 tempest-AdminActionsAPIOnlyNegativeTest-1820624707 tempest-AdminActionsAPIOnlyNegativeTest-1820624707-project-admin] Action body: b'{"force_delete": null}' {{(pid=98329) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:56:25 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-09de2944-f2ae-49aa-b1fa-de211fb69d13 tempest-AdminActionsAPIOnlyNegativeTest-1820624707 tempest-AdminActionsAPIOnlyNegativeTest-1820624707-project-admin] Action: 'action', calling method: Controller.__getattribute__..version_select, body: {"force_delete": null} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-5b4f1e25-58d8-4522-bdb4-5c475abaf361 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-5b4f1e25-58d8-4522-bdb4-5c475abaf361 None None] MFA Rules not processed for user `8d7bbb6785df4869bd2645ce98ef1595`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-5b4f1e25-58d8-4522-bdb4-5c475abaf361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:25 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-09de2944-f2ae-49aa-b1fa-de211fb69d13 tempest-AdminActionsAPIOnlyNegativeTest-1820624707 tempest-AdminActionsAPIOnlyNegativeTest-1820624707-project-admin] HTTP exception thrown: Snapshot %(snapshot_id)s could not be found. May 28 12:56:25 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-09de2944-f2ae-49aa-b1fa-de211fb69d13 tempest-AdminActionsAPIOnlyNegativeTest-1820624707 tempest-AdminActionsAPIOnlyNegativeTest-1820624707-project-admin] http://10.27.203.238/share/v2/e597e913ff9348f29791175d986c8a59/snapshots/fake/action returned with HTTP 404 May 28 12:56:25 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 9/12] 10.27.203.238 () {66 vars in 1406 bytes} [Tue May 28 12:56:25 2024] POST /share/v2/e597e913ff9348f29791175d986c8a59/snapshots/fake/action => generated 78 bytes in 34 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99673f82-4ec0-4efb-be0a-82046d4d078a None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-99673f82-4ec0-4efb-be0a-82046d4d078a None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 665/1321] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:56:25 2024] POST /identity/v3/auth/tokens => generated 4075 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4f1e25-58d8-4522-bdb4-5c475abaf361 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99673f82-4ec0-4efb-be0a-82046d4d078a None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c242fbfb-3bda-4981-a06f-5ae695685878 service manila] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f110cf6300f049c897d0aab63218d1e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c242fbfb-3bda-4981-a06f-5ae695685878 service manila] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c242fbfb-3bda-4981-a06f-5ae695685878 service manila] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c242fbfb-3bda-4981-a06f-5ae695685878 service manila] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-c242fbfb-3bda-4981-a06f-5ae695685878 service manila] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4f1e25-58d8-4522-bdb4-5c475abaf361 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135474c8-4b19-4281-b97c-5107d893e742 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135474c8-4b19-4281-b97c-5107d893e742 None admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135474c8-4b19-4281-b97c-5107d893e742 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135474c8-4b19-4281-b97c-5107d893e742 None admin] PATH_INFO: `/v3/users/8d7bbb6785df4869bd2645ce98ef1595` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135474c8-4b19-4281-b97c-5107d893e742 None admin] RBAC: Authorizing `identity:delete_user(user_id=8d7bbb6785df4869bd2645ce98ef1595)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135474c8-4b19-4281-b97c-5107d893e742 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c242fbfb-3bda-4981-a06f-5ae695685878 service manila] RBAC: Authorizing `identity:validate_token()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c242fbfb-3bda-4981-a06f-5ae695685878 service manila] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 657/1322] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 12:56:25 2024] GET /identity/v3/auth/tokens => generated 3970 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 12:56:25 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-3a47ce09-c8c0-4938-92e8-423050f78f81 tempest-AdminActionsTest-1749172189 None] <<< [GET] https://127.0.0.1:40443/api/vippools/ May 28 12:56:25 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-3a47ce09-c8c0-4938-92e8-423050f78f81 tempest-AdminActionsTest-1749172189 None] [Bunch(active_cnode_ids=[], active_interfaces=4, cluster='loop75-kfs', cluster_id=1, cnode_ids=[], cnodes=[], domain_name='vippool-1', enable_l3=False, enable_weighted_balancing=False, enabled=True, end_ip='172.21.75.4', guid='f2abaede-b397-413a-8faa-3aeead6d3b28', gw_ip='', gw_ipv6='', id=2, ip_ranges=[['172.21.75.1', '172.21.75.4']], name='vippool-1', peer_asn=0, port_membership='ALL', ranges_summary='172.21.75.[1-4]', role='PROTOCOLS', start_ip='172.21.75.1', subnet_cidr=16, subnet_cidr_ipv6=None, sync='SYNCED', sync_time='2024-05-28T12:50:09.644123Z', tenant_id=1, tenant_name='default', title='172.21.75.1 - 172.21.75.4', url='https://127.0.0.1:40443/api/vippools/2/', vast_asn=0, vlan=0, vms_preferred=False)] May 28 12:56:25 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-3a47ce09-c8c0-4938-92e8-423050f78f81 tempest-AdminActionsTest-1749172189 None] --- [GET] https://127.0.0.1:40443/api/vippools/: Done May 28 12:56:25 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-3a47ce09-c8c0-4938-92e8-423050f78f81 tempest-AdminActionsTest-1749172189 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:56:25 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-3a47ce09-c8c0-4938-92e8-423050f78f81 tempest-AdminActionsTest-1749172189 None] {'allow_redirects': True, May 28 12:56:25 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-3a47ce09-c8c0-4938-92e8-423050f78f81 tempest-AdminActionsTest-1749172189 None] 'params': {'name': '77a25e6b-f137-4342-8eb9-9ced679515e2'}} May 28 12:56:25 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-8ad82e00-1c03-492a-ad5b-1b4608ecb63c tempest-AdminActionsAPIOnlyNegativeTest-627411180 tempest-AdminActionsAPIOnlyNegativeTest-627411180-project-member] POST http://10.27.203.238/share/v2/cfaeb31ba56441e0b06355cc09ec1103/shares/fake_share/action May 28 12:56:25 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-8ad82e00-1c03-492a-ad5b-1b4608ecb63c tempest-AdminActionsAPIOnlyNegativeTest-627411180 tempest-AdminActionsAPIOnlyNegativeTest-627411180-project-member] Action body: b'{"migration_start": {"host": "fake_host", "force_host_assisted_migration": false, "new_share_network_id": null, "new_share_type_id": null, "writable": false, "preserve_metadata": false, "preserve_snapshots": false, "nondisruptive": false}}' {{(pid=98329) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:56:25 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-8ad82e00-1c03-492a-ad5b-1b4608ecb63c tempest-AdminActionsAPIOnlyNegativeTest-627411180 tempest-AdminActionsAPIOnlyNegativeTest-627411180-project-member] Action: 'action', calling method: Controller.__getattribute__..version_select, body: {"migration_start": {"host": "fake_host", "force_host_assisted_migration": false, "new_share_network_id": null, "new_share_type_id": null, "writable": false, "preserve_metadata": false, "preserve_snapshots": false, "nondisruptive": false}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:56:25 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-8ad82e00-1c03-492a-ad5b-1b4608ecb63c tempest-AdminActionsAPIOnlyNegativeTest-627411180 tempest-AdminActionsAPIOnlyNegativeTest-627411180-project-member] http://10.27.203.238/share/v2/cfaeb31ba56441e0b06355cc09ec1103/shares/fake_share/action returned with HTTP 404 May 28 12:56:25 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 10/13] 10.27.203.238 () {68 vars in 1464 bytes} [Tue May 28 12:56:25 2024] POST /share/v2/cfaeb31ba56441e0b06355cc09ec1103/shares/fake_share/action => generated 78 bytes in 111 msecs (HTTP/1.1 404) 7 headers in 280 bytes (2 switches on core 0) May 28 12:56:25 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-04c9c305-88a3-44a2-b77a-5c2172d6d530 tempest-AdminActionsAPIOnlyNegativeTest-627411180 tempest-AdminActionsAPIOnlyNegativeTest-627411180-project-member] POST http://10.27.203.238/share/v2/cfaeb31ba56441e0b06355cc09ec1103/shares/fake_share/action May 28 12:56:25 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-04c9c305-88a3-44a2-b77a-5c2172d6d530 tempest-AdminActionsAPIOnlyNegativeTest-627411180 tempest-AdminActionsAPIOnlyNegativeTest-627411180-project-member] Action body: b'{"migration_complete": null}' {{(pid=98329) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:56:25 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-04c9c305-88a3-44a2-b77a-5c2172d6d530 tempest-AdminActionsAPIOnlyNegativeTest-627411180 tempest-AdminActionsAPIOnlyNegativeTest-627411180-project-member] Action: 'action', calling method: Controller.__getattribute__..version_select, body: {"migration_complete": null} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:56:25 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-04c9c305-88a3-44a2-b77a-5c2172d6d530 tempest-AdminActionsAPIOnlyNegativeTest-627411180 tempest-AdminActionsAPIOnlyNegativeTest-627411180-project-member] http://10.27.203.238/share/v2/cfaeb31ba56441e0b06355cc09ec1103/shares/fake_share/action returned with HTTP 404 May 28 12:56:25 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 11/14] 10.27.203.238 () {68 vars in 1463 bytes} [Tue May 28 12:56:25 2024] POST /share/v2/cfaeb31ba56441e0b06355cc09ec1103/shares/fake_share/action => generated 78 bytes in 5 msecs (HTTP/1.1 404) 7 headers in 280 bytes (1 switches on core 0) May 28 12:56:25 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-cc06ad48-54b7-44bd-a34f-49ec41781ff9 tempest-AdminActionsAPIOnlyNegativeTest-627411180 tempest-AdminActionsAPIOnlyNegativeTest-627411180-project-member] POST http://10.27.203.238/share/v2/cfaeb31ba56441e0b06355cc09ec1103/shares/fake_share/action May 28 12:56:25 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-cc06ad48-54b7-44bd-a34f-49ec41781ff9 tempest-AdminActionsAPIOnlyNegativeTest-627411180 tempest-AdminActionsAPIOnlyNegativeTest-627411180-project-member] Action body: b'{"reset_task_state": {"task_state": "fake_task_state"}}' {{(pid=98329) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:56:25 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-cc06ad48-54b7-44bd-a34f-49ec41781ff9 tempest-AdminActionsAPIOnlyNegativeTest-627411180 tempest-AdminActionsAPIOnlyNegativeTest-627411180-project-member] Action: 'action', calling method: Controller.__getattribute__..version_select, body: {"reset_task_state": {"task_state": "fake_task_state"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:56:25 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-cc06ad48-54b7-44bd-a34f-49ec41781ff9 tempest-AdminActionsAPIOnlyNegativeTest-627411180 tempest-AdminActionsAPIOnlyNegativeTest-627411180-project-member] http://10.27.203.238/share/v2/cfaeb31ba56441e0b06355cc09ec1103/shares/fake_share/action returned with HTTP 404 May 28 12:56:25 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 12/15] 10.27.203.238 () {68 vars in 1463 bytes} [Tue May 28 12:56:25 2024] POST /share/v2/cfaeb31ba56441e0b06355cc09ec1103/shares/fake_share/action => generated 78 bytes in 5 msecs (HTTP/1.1 404) 7 headers in 280 bytes (2 switches on core 0) May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-135474c8-4b19-4281-b97c-5107d893e742 None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d7bbb6785df4869bd2645ce98ef1595', 'request_id': 'req-135474c8-4b19-4281-b97c-5107d893e742'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:25 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-a645b40b-47a5-4980-a21b-e6c235c767e3 tempest-AdminActionsAPIOnlyNegativeTest-627411180 tempest-AdminActionsAPIOnlyNegativeTest-627411180-project-member] POST http://10.27.203.238/share/v2/cfaeb31ba56441e0b06355cc09ec1103/shares/fake_share/action May 28 12:56:25 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-a645b40b-47a5-4980-a21b-e6c235c767e3 tempest-AdminActionsAPIOnlyNegativeTest-627411180 tempest-AdminActionsAPIOnlyNegativeTest-627411180-project-member] Action body: b'{"migration_get_progress": null}' {{(pid=98329) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:56:25 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-a645b40b-47a5-4980-a21b-e6c235c767e3 tempest-AdminActionsAPIOnlyNegativeTest-627411180 tempest-AdminActionsAPIOnlyNegativeTest-627411180-project-member] Action: 'action', calling method: Controller.__getattribute__..version_select, body: {"migration_get_progress": null} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:56:25 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-a645b40b-47a5-4980-a21b-e6c235c767e3 tempest-AdminActionsAPIOnlyNegativeTest-627411180 tempest-AdminActionsAPIOnlyNegativeTest-627411180-project-member] http://10.27.203.238/share/v2/cfaeb31ba56441e0b06355cc09ec1103/shares/fake_share/action returned with HTTP 404 May 28 12:56:25 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 13/16] 10.27.203.238 () {68 vars in 1463 bytes} [Tue May 28 12:56:25 2024] POST /share/v2/cfaeb31ba56441e0b06355cc09ec1103/shares/fake_share/action => generated 78 bytes in 5 msecs (HTTP/1.1 404) 7 headers in 280 bytes (2 switches on core 0) May 28 12:56:25 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-7e3f9868-4e6f-4fe2-a482-01995e1e0703 tempest-AdminActionsAPIOnlyNegativeTest-627411180 tempest-AdminActionsAPIOnlyNegativeTest-627411180-project-member] POST http://10.27.203.238/share/v2/cfaeb31ba56441e0b06355cc09ec1103/shares/fake_share/action May 28 12:56:25 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-7e3f9868-4e6f-4fe2-a482-01995e1e0703 tempest-AdminActionsAPIOnlyNegativeTest-627411180 tempest-AdminActionsAPIOnlyNegativeTest-627411180-project-member] Action body: b'{"migration_cancel": null}' {{(pid=98329) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:56:25 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-7e3f9868-4e6f-4fe2-a482-01995e1e0703 tempest-AdminActionsAPIOnlyNegativeTest-627411180 tempest-AdminActionsAPIOnlyNegativeTest-627411180-project-member] Action: 'action', calling method: Controller.__getattribute__..version_select, body: {"migration_cancel": null} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:56:25 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-7e3f9868-4e6f-4fe2-a482-01995e1e0703 tempest-AdminActionsAPIOnlyNegativeTest-627411180 tempest-AdminActionsAPIOnlyNegativeTest-627411180-project-member] http://10.27.203.238/share/v2/cfaeb31ba56441e0b06355cc09ec1103/shares/fake_share/action returned with HTTP 404 May 28 12:56:25 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 14/17] 10.27.203.238 () {68 vars in 1463 bytes} [Tue May 28 12:56:25 2024] POST /share/v2/cfaeb31ba56441e0b06355cc09ec1103/shares/fake_share/action => generated 78 bytes in 5 msecs (HTTP/1.1 404) 7 headers in 280 bytes (1 switches on core 0) May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-135474c8-4b19-4281-b97c-5107d893e742 None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d7bbb6785df4869bd2645ce98ef1595', 'request_id': 'req-135474c8-4b19-4281-b97c-5107d893e742'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-135474c8-4b19-4281-b97c-5107d893e742 None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d7bbb6785df4869bd2645ce98ef1595', 'request_id': 'req-135474c8-4b19-4281-b97c-5107d893e742'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-135474c8-4b19-4281-b97c-5107d893e742 None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d7bbb6785df4869bd2645ce98ef1595', 'request_id': 'req-135474c8-4b19-4281-b97c-5107d893e742'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:25 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-ed678b2b-5b65-4e6b-adf9-7c0136849b14 tempest-AdminActionsAPIOnlyNegativeTest-1820624707 tempest-AdminActionsAPIOnlyNegativeTest-1820624707-project-admin] POST http://10.27.203.238/share/v2/e597e913ff9348f29791175d986c8a59/share_instances/fake/action May 28 12:56:25 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-ed678b2b-5b65-4e6b-adf9-7c0136849b14 tempest-AdminActionsAPIOnlyNegativeTest-1820624707 tempest-AdminActionsAPIOnlyNegativeTest-1820624707-project-admin] Action body: b'{"reset_status": {"status": "error"}}' {{(pid=98329) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:56:25 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-ed678b2b-5b65-4e6b-adf9-7c0136849b14 tempest-AdminActionsAPIOnlyNegativeTest-1820624707 tempest-AdminActionsAPIOnlyNegativeTest-1820624707-project-admin] Action: 'action', calling method: Controller.__getattribute__..version_select, body: {"reset_status": {"status": "error"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:56:25 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-ed678b2b-5b65-4e6b-adf9-7c0136849b14 tempest-AdminActionsAPIOnlyNegativeTest-1820624707 tempest-AdminActionsAPIOnlyNegativeTest-1820624707-project-admin] Updating share_instance 'fake' with '{'status': 'error'}' {{(pid=98329) _reset_status /opt/stack/manila/manila/api/openstack/wsgi.py:1257}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-135474c8-4b19-4281-b97c-5107d893e742 None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d7bbb6785df4869bd2645ce98ef1595', 'request_id': 'req-135474c8-4b19-4281-b97c-5107d893e742'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:25 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-ed678b2b-5b65-4e6b-adf9-7c0136849b14 tempest-AdminActionsAPIOnlyNegativeTest-1820624707 tempest-AdminActionsAPIOnlyNegativeTest-1820624707-project-admin] HTTP exception thrown: Resource could not be found. May 28 12:56:25 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-ed678b2b-5b65-4e6b-adf9-7c0136849b14 tempest-AdminActionsAPIOnlyNegativeTest-1820624707 tempest-AdminActionsAPIOnlyNegativeTest-1820624707-project-admin] http://10.27.203.238/share/v2/e597e913ff9348f29791175d986c8a59/share_instances/fake/action returned with HTTP 404 May 28 12:56:25 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 15/18] 10.27.203.238 () {66 vars in 1424 bytes} [Tue May 28 12:56:25 2024] POST /share/v2/e597e913ff9348f29791175d986c8a59/share_instances/fake/action => generated 78 bytes in 13 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 12:56:25 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-0caa20d0-f1ab-4a51-9ec5-a89d70026799 tempest-AdminActionsAPIOnlyNegativeTest-1820624707 tempest-AdminActionsAPIOnlyNegativeTest-1820624707-project-admin] POST http://10.27.203.238/share/v2/e597e913ff9348f29791175d986c8a59/shares/fake/action May 28 12:56:25 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-0caa20d0-f1ab-4a51-9ec5-a89d70026799 tempest-AdminActionsAPIOnlyNegativeTest-1820624707 tempest-AdminActionsAPIOnlyNegativeTest-1820624707-project-admin] Action body: b'{"reset_status": {"status": "error"}}' {{(pid=98329) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:56:25 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-0caa20d0-f1ab-4a51-9ec5-a89d70026799 tempest-AdminActionsAPIOnlyNegativeTest-1820624707 tempest-AdminActionsAPIOnlyNegativeTest-1820624707-project-admin] Action: 'action', calling method: Controller.__getattribute__..version_select, body: {"reset_status": {"status": "error"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 666/1323] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 12:56:25 2024] DELETE /identity/v3/users/8d7bbb6785df4869bd2645ce98ef1595 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8b206b-5b5f-422f-8df3-87342c725b67 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8b206b-5b5f-422f-8df3-87342c725b67 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8b206b-5b5f-422f-8df3-87342c725b67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:25 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-0caa20d0-f1ab-4a51-9ec5-a89d70026799 tempest-AdminActionsAPIOnlyNegativeTest-1820624707 tempest-AdminActionsAPIOnlyNegativeTest-1820624707-project-admin] HTTP exception thrown: Share fake not found May 28 12:56:25 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-0caa20d0-f1ab-4a51-9ec5-a89d70026799 tempest-AdminActionsAPIOnlyNegativeTest-1820624707 tempest-AdminActionsAPIOnlyNegativeTest-1820624707-project-admin] http://10.27.203.238/share/v2/e597e913ff9348f29791175d986c8a59/shares/fake/action returned with HTTP 404 May 28 12:56:25 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 16/19] 10.27.203.238 () {66 vars in 1397 bytes} [Tue May 28 12:56:25 2024] POST /share/v2/e597e913ff9348f29791175d986c8a59/shares/fake/action => generated 78 bytes in 11 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 12:56:25 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-5d17a7bb-d983-4db0-97ee-48c7f9bfbf92 tempest-AdminActionsAPIOnlyNegativeTest-1820624707 tempest-AdminActionsAPIOnlyNegativeTest-1820624707-project-admin] POST http://10.27.203.238/share/v2/e597e913ff9348f29791175d986c8a59/snapshots/fake/action May 28 12:56:25 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-5d17a7bb-d983-4db0-97ee-48c7f9bfbf92 tempest-AdminActionsAPIOnlyNegativeTest-1820624707 tempest-AdminActionsAPIOnlyNegativeTest-1820624707-project-admin] Action body: b'{"reset_status": {"status": "error"}}' {{(pid=98329) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:56:25 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-5d17a7bb-d983-4db0-97ee-48c7f9bfbf92 tempest-AdminActionsAPIOnlyNegativeTest-1820624707 tempest-AdminActionsAPIOnlyNegativeTest-1820624707-project-admin] Action: 'action', calling method: Controller.__getattribute__..version_select, body: {"reset_status": {"status": "error"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:56:25 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-5d17a7bb-d983-4db0-97ee-48c7f9bfbf92 tempest-AdminActionsAPIOnlyNegativeTest-1820624707 tempest-AdminActionsAPIOnlyNegativeTest-1820624707-project-admin] Updating share_snapshot 'fake' with '{'status': 'error'}' {{(pid=98329) _reset_status /opt/stack/manila/manila/api/openstack/wsgi.py:1257}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-9d8b206b-5b5f-422f-8df3-87342c725b67 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-9d8b206b-5b5f-422f-8df3-87342c725b67 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-9d8b206b-5b5f-422f-8df3-87342c725b67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:25 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-5d17a7bb-d983-4db0-97ee-48c7f9bfbf92 tempest-AdminActionsAPIOnlyNegativeTest-1820624707 tempest-AdminActionsAPIOnlyNegativeTest-1820624707-project-admin] HTTP exception thrown: Snapshot %(snapshot_id)s could not be found. May 28 12:56:25 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-5d17a7bb-d983-4db0-97ee-48c7f9bfbf92 tempest-AdminActionsAPIOnlyNegativeTest-1820624707 tempest-AdminActionsAPIOnlyNegativeTest-1820624707-project-admin] http://10.27.203.238/share/v2/e597e913ff9348f29791175d986c8a59/snapshots/fake/action returned with HTTP 404 May 28 12:56:25 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 17/20] 10.27.203.238 () {66 vars in 1406 bytes} [Tue May 28 12:56:25 2024] POST /share/v2/e597e913ff9348f29791175d986c8a59/snapshots/fake/action => generated 78 bytes in 22 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 12:56:25 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-620bd19f-1744-4f85-9c47-7334991ca66b tempest-AdminActionsAPIOnlyNegativeTest-1820624707 tempest-AdminActionsAPIOnlyNegativeTest-1820624707-project-admin] POST http://10.27.203.238/share/v2/e597e913ff9348f29791175d986c8a59/shares/fake_share/action May 28 12:56:25 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-620bd19f-1744-4f85-9c47-7334991ca66b tempest-AdminActionsAPIOnlyNegativeTest-1820624707 tempest-AdminActionsAPIOnlyNegativeTest-1820624707-project-admin] Action body: b'{"reset_task_state": {"task_state": "migration_error"}}' {{(pid=98329) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:56:25 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-620bd19f-1744-4f85-9c47-7334991ca66b tempest-AdminActionsAPIOnlyNegativeTest-1820624707 tempest-AdminActionsAPIOnlyNegativeTest-1820624707-project-admin] Action: 'action', calling method: Controller.__getattribute__..version_select, body: {"reset_task_state": {"task_state": "migration_error"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 658/1324] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:56:25 2024] POST /identity/v3/auth/tokens => generated 2960 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 12:56:25 l75lg1-v1 neutron-server[77618]: DEBUG neutron.wsgi [-] (77618) accepted ('10.27.203.238', 55936) {{(pid=77618) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 12:56:25 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault [None req-620bd19f-1744-4f85-9c47-7334991ca66b tempest-AdminActionsAPIOnlyNegativeTest-1820624707 tempest-AdminActionsAPIOnlyNegativeTest-1820624707-project-admin] Caught error: Share fake_share could not be found.: manila.exception.ShareNotFound: Share fake_share could not be found. May 28 12:56:25 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault Traceback (most recent call last): May 28 12:56:25 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/api/v2/shares.py", line 456, in reset_task_state May 28 12:56:25 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault share = self.share_api.get(context, id) May 28 12:56:25 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/share/api.py", line 2211, in get May 28 12:56:25 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault rv = self.db.share_get(context, share_id) May 28 12:56:25 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/db/api.py", line 404, in share_get May 28 12:56:25 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault return IMPL.share_get(context, share_id, **kwargs) May 28 12:56:25 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/db/sqlalchemy/api.py", line 166, in wrapper May 28 12:56:25 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault return f(*args, **kwargs) May 28 12:56:25 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/enginefacade.py", line 998, in wrapper May 28 12:56:25 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault return fn(*args, **kwargs) May 28 12:56:25 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/db/sqlalchemy/api.py", line 2367, in share_get May 28 12:56:25 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault return _share_get(context, share_id, **kwargs) May 28 12:56:25 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/db/sqlalchemy/api.py", line 2378, in _share_get May 28 12:56:25 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault raise exception.NotFound() May 28 12:56:25 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault manila.exception.NotFound: Resource could not be found. May 28 12:56:25 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault May 28 12:56:25 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault During handling of the above exception, another exception occurred: May 28 12:56:25 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault May 28 12:56:25 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault Traceback (most recent call last): May 28 12:56:25 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/api/middleware/fault.py", line 76, in __call__ May 28 12:56:25 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault return req.get_response(self.application) May 28 12:56:25 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/request.py", line 1313, in send May 28 12:56:25 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault status, headers, app_iter = self.call_application( May 28 12:56:25 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/request.py", line 1278, in call_application May 28 12:56:25 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault app_iter = application(self.environ, start_response) May 28 12:56:25 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 129, in __call__ May 28 12:56:25 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault resp = self.call_func(req, *args, **kw) May 28 12:56:25 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 193, in call_func May 28 12:56:25 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault return self.func(req, *args, **kwargs) May 28 12:56:25 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_middleware/base.py", line 124, in __call__ May 28 12:56:25 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault response = req.get_response(self.application) May 28 12:56:25 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/request.py", line 1313, in send May 28 12:56:25 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault status, headers, app_iter = self.call_application( May 28 12:56:25 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/request.py", line 1278, in call_application May 28 12:56:25 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault app_iter = application(self.environ, start_response) May 28 12:56:25 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 143, in __call__ May 28 12:56:25 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault return resp(environ, start_response) May 28 12:56:25 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 129, in __call__ May 28 12:56:25 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault resp = self.call_func(req, *args, **kw) May 28 12:56:25 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 193, in call_func May 28 12:56:25 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault return self.func(req, *args, **kwargs) May 28 12:56:25 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/osprofiler/web.py", line 111, in __call__ May 28 12:56:25 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault return request.get_response(self.application) May 28 12:56:25 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/request.py", line 1313, in send May 28 12:56:25 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault status, headers, app_iter = self.call_application( May 28 12:56:25 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/request.py", line 1278, in call_application May 28 12:56:25 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault app_iter = application(self.environ, start_response) May 28 12:56:25 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 129, in __call__ May 28 12:56:25 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault resp = self.call_func(req, *args, **kw) May 28 12:56:25 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 193, in call_func May 28 12:56:25 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault return self.func(req, *args, **kwargs) May 28 12:56:25 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py", line 340, in __call__ May 28 12:56:25 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault response = req.get_response(self._app) May 28 12:56:25 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/request.py", line 1313, in send May 28 12:56:25 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault status, headers, app_iter = self.call_application( May 28 12:56:25 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/request.py", line 1278, in call_application May 28 12:56:25 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault app_iter = application(self.environ, start_response) May 28 12:56:25 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 143, in __call__ May 28 12:56:25 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault return resp(environ, start_response) May 28 12:56:25 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 143, in __call__ May 28 12:56:25 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault return resp(environ, start_response) May 28 12:56:25 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/routes/middleware.py", line 153, in __call__ May 28 12:56:25 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault response = self.app(environ, start_response) May 28 12:56:25 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 143, in __call__ May 28 12:56:25 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault return resp(environ, start_response) May 28 12:56:25 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 129, in __call__ May 28 12:56:25 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault resp = self.call_func(req, *args, **kw) May 28 12:56:25 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 193, in call_func May 28 12:56:25 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault return self.func(req, *args, **kwargs) May 28 12:56:25 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/api/openstack/wsgi.py", line 764, in __call__ May 28 12:56:25 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault return self._process_stack(request, action, action_args, May 28 12:56:25 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/api/openstack/wsgi.py", line 829, in _process_stack May 28 12:56:25 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault action_result = self.dispatch(meth, request, action_args) May 28 12:56:25 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/api/openstack/wsgi.py", line 924, in dispatch May 28 12:56:25 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault return method(req=request, **action_args) May 28 12:56:25 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/api/openstack/wsgi.py", line 1066, in version_select May 28 12:56:25 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault return func.func(self, *args, **kwargs) May 28 12:56:25 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/api/openstack/wsgi.py", line 1160, in wrapper May 28 12:56:25 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault return f(self, req, *args, **kwargs) May 28 12:56:25 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/api/v2/shares.py", line 458, in reset_task_state May 28 12:56:25 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault raise exception.ShareNotFound(share_id=id) May 28 12:56:25 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault manila.exception.ShareNotFound: Share fake_share could not be found. May 28 12:56:25 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault May 28 12:56:25 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.middleware.fault [None req-620bd19f-1744-4f85-9c47-7334991ca66b tempest-AdminActionsAPIOnlyNegativeTest-1820624707 tempest-AdminActionsAPIOnlyNegativeTest-1820624707-project-admin] http://10.27.203.238/share/v2/e597e913ff9348f29791175d986c8a59/shares/fake_share/action returned with HTTP 404 May 28 12:56:25 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 18/21] 10.27.203.238 () {68 vars in 1463 bytes} [Tue May 28 12:56:25 2024] POST /share/v2/e597e913ff9348f29791175d986c8a59/shares/fake_share/action => generated 97 bytes in 21 msecs (HTTP/1.1 404) 7 headers in 280 bytes (1 switches on core 0) May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135474c8-4b19-4281-b97c-5107d893e742 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-135474c8-4b19-4281-b97c-5107d893e742 None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:25 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-1581e5b8-5b2c-4fae-a8e1-2f96af2874fa tempest-AdminActionsAPIOnlyNegativeTest-627411180 tempest-AdminActionsAPIOnlyNegativeTest-627411180-project-member] GET http://10.27.203.238/share/v2/cfaeb31ba56441e0b06355cc09ec1103/share_instances May 28 12:56:25 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-1581e5b8-5b2c-4fae-a8e1-2f96af2874fa tempest-AdminActionsAPIOnlyNegativeTest-627411180 tempest-AdminActionsAPIOnlyNegativeTest-627411180-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:25 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-1581e5b8-5b2c-4fae-a8e1-2f96af2874fa tempest-AdminActionsAPIOnlyNegativeTest-627411180 tempest-AdminActionsAPIOnlyNegativeTest-627411180-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:25 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.policy [None req-1581e5b8-5b2c-4fae-a8e1-2f96af2874fa tempest-AdminActionsAPIOnlyNegativeTest-627411180 tempest-AdminActionsAPIOnlyNegativeTest-627411180-project-member] Policy check for share_instance:index failed with credentials {'is_admin': False, 'user_id': 'fc670cd52975471e86e32fd1f5a5229e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfaeb31ba56441e0b06355cc09ec1103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98329) authorize /opt/stack/manila/manila/policy.py:208}} May 28 12:56:25 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-1581e5b8-5b2c-4fae-a8e1-2f96af2874fa tempest-AdminActionsAPIOnlyNegativeTest-627411180 tempest-AdminActionsAPIOnlyNegativeTest-627411180-project-member] HTTP exception thrown: Access was denied to this resource. May 28 12:56:25 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-1581e5b8-5b2c-4fae-a8e1-2f96af2874fa tempest-AdminActionsAPIOnlyNegativeTest-627411180 tempest-AdminActionsAPIOnlyNegativeTest-627411180-project-member] http://10.27.203.238/share/v2/cfaeb31ba56441e0b06355cc09ec1103/share_instances returned with HTTP 403 May 28 12:56:25 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 19/22] 10.27.203.238 () {64 vars in 1367 bytes} [Tue May 28 12:56:25 2024] GET /share/v2/cfaeb31ba56441e0b06355cc09ec1103/share_instances => generated 78 bytes in 6 msecs (HTTP/1.1 403) 6 headers in 237 bytes (2 switches on core 0) May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8b206b-5b5f-422f-8df3-87342c725b67 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-9d8b206b-5b5f-422f-8df3-87342c725b67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135474c8-4b19-4281-b97c-5107d893e742 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1b19c9-f93e-412e-ae7b-9f769a116fee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef17047035e4b518fd5360a01f2da1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1b19c9-f93e-412e-ae7b-9f769a116fee service neutron] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1b19c9-f93e-412e-ae7b-9f769a116fee service neutron] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1b19c9-f93e-412e-ae7b-9f769a116fee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1b19c9-f93e-412e-ae7b-9f769a116fee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1b19c9-f93e-412e-ae7b-9f769a116fee service neutron] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 667/1325] 10.27.203.238 () {64 vars in 1432 bytes} [Tue May 28 12:56:25 2024] GET /identity/v3/auth/tokens => generated 2960 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8b206b-5b5f-422f-8df3-87342c725b67 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11c94cd-ca62-4164-aef4-6d10794e7c07 tempest-AdminActionsAPIOnlyNegativeTest-1820624707 tempest-AdminActionsAPIOnlyNegativeTest-1820624707-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c3c14495e243028b5a760f7c1d86bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e597e913ff9348f29791175d986c8a59', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11c94cd-ca62-4164-aef4-6d10794e7c07 tempest-AdminActionsAPIOnlyNegativeTest-1820624707 tempest-AdminActionsAPIOnlyNegativeTest-1820624707-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11c94cd-ca62-4164-aef4-6d10794e7c07 tempest-AdminActionsAPIOnlyNegativeTest-1820624707 tempest-AdminActionsAPIOnlyNegativeTest-1820624707-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11c94cd-ca62-4164-aef4-6d10794e7c07 tempest-AdminActionsAPIOnlyNegativeTest-1820624707 tempest-AdminActionsAPIOnlyNegativeTest-1820624707-project-admin] PATH_INFO: `/v3/users/14783f4fbce14880b4db4a628827607e` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11c94cd-ca62-4164-aef4-6d10794e7c07 tempest-AdminActionsAPIOnlyNegativeTest-1820624707 tempest-AdminActionsAPIOnlyNegativeTest-1820624707-project-admin] RBAC: Authorizing `identity:delete_user(user_id=14783f4fbce14880b4db4a628827607e)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11c94cd-ca62-4164-aef4-6d10794e7c07 tempest-AdminActionsAPIOnlyNegativeTest-1820624707 tempest-AdminActionsAPIOnlyNegativeTest-1820624707-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:25 l75lg1-v1 neutron-server[77618]: INFO neutron.wsgi [None req-e6397a97-ec31-4329-a443-a8a3c7a4e310 None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=2bd1b57c2edf4e92abdd1caa7cd467b8&name=default HTTP/1.1" status: 200 len: 216 time: 0.0764155 May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1b19c9-f93e-412e-ae7b-9f769a116fee service neutron] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-1e1b19c9-f93e-412e-ae7b-9f769a116fee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1b19c9-f93e-412e-ae7b-9f769a116fee service neutron] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4082bcd7-c7d5-4e34-ab00-ff02c92e4db8 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4082bcd7-c7d5-4e34-ab00-ff02c92e4db8 None admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4082bcd7-c7d5-4e34-ab00-ff02c92e4db8 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4082bcd7-c7d5-4e34-ab00-ff02c92e4db8 None admin] PATH_INFO: `/v3/projects/2bd1b57c2edf4e92abdd1caa7cd467b8` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4082bcd7-c7d5-4e34-ab00-ff02c92e4db8 None admin] RBAC: Authorizing `identity:delete_project(project_id=2bd1b57c2edf4e92abdd1caa7cd467b8)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4082bcd7-c7d5-4e34-ab00-ff02c92e4db8 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-c11c94cd-ca62-4164-aef4-6d10794e7c07 tempest-AdminActionsAPIOnlyNegativeTest-1820624707 tempest-AdminActionsAPIOnlyNegativeTest-1820624707-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14783f4fbce14880b4db4a628827607e', 'request_id': 'req-c11c94cd-ca62-4164-aef4-6d10794e7c07'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-c11c94cd-ca62-4164-aef4-6d10794e7c07 tempest-AdminActionsAPIOnlyNegativeTest-1820624707 tempest-AdminActionsAPIOnlyNegativeTest-1820624707-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14783f4fbce14880b4db4a628827607e', 'request_id': 'req-c11c94cd-ca62-4164-aef4-6d10794e7c07'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-c11c94cd-ca62-4164-aef4-6d10794e7c07 tempest-AdminActionsAPIOnlyNegativeTest-1820624707 tempest-AdminActionsAPIOnlyNegativeTest-1820624707-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14783f4fbce14880b4db4a628827607e', 'request_id': 'req-c11c94cd-ca62-4164-aef4-6d10794e7c07'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-c11c94cd-ca62-4164-aef4-6d10794e7c07 tempest-AdminActionsAPIOnlyNegativeTest-1820624707 tempest-AdminActionsAPIOnlyNegativeTest-1820624707-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14783f4fbce14880b4db4a628827607e', 'request_id': 'req-c11c94cd-ca62-4164-aef4-6d10794e7c07'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-c11c94cd-ca62-4164-aef4-6d10794e7c07 tempest-AdminActionsAPIOnlyNegativeTest-1820624707 tempest-AdminActionsAPIOnlyNegativeTest-1820624707-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14783f4fbce14880b4db4a628827607e', 'request_id': 'req-c11c94cd-ca62-4164-aef4-6d10794e7c07'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-4082bcd7-c7d5-4e34-ab00-ff02c92e4db8 None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2bd1b57c2edf4e92abdd1caa7cd467b8', 'request_id': 'req-4082bcd7-c7d5-4e34-ab00-ff02c92e4db8'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-4082bcd7-c7d5-4e34-ab00-ff02c92e4db8 None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2bd1b57c2edf4e92abdd1caa7cd467b8', 'request_id': 'req-4082bcd7-c7d5-4e34-ab00-ff02c92e4db8'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-4082bcd7-c7d5-4e34-ab00-ff02c92e4db8 None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2bd1b57c2edf4e92abdd1caa7cd467b8', 'request_id': 'req-4082bcd7-c7d5-4e34-ab00-ff02c92e4db8'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:25 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b0b36f71-852d-463a-b1c8-4066ce824def tempest-ExportLocationsTest-1017217578 None] <<< [GET] https://127.0.0.1:40443/api/vippools/ May 28 12:56:25 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b0b36f71-852d-463a-b1c8-4066ce824def tempest-ExportLocationsTest-1017217578 None] [Bunch(active_cnode_ids=[], active_interfaces=4, cluster='loop75-kfs', cluster_id=1, cnode_ids=[], cnodes=[], domain_name='vippool-1', enable_l3=False, enable_weighted_balancing=False, enabled=True, end_ip='172.21.75.4', guid='f2abaede-b397-413a-8faa-3aeead6d3b28', gw_ip='', gw_ipv6='', id=2, ip_ranges=[['172.21.75.1', '172.21.75.4']], name='vippool-1', peer_asn=0, port_membership='ALL', ranges_summary='172.21.75.[1-4]', role='PROTOCOLS', start_ip='172.21.75.1', subnet_cidr=16, subnet_cidr_ipv6=None, sync='SYNCED', sync_time='2024-05-28T12:50:09.644123Z', tenant_id=1, tenant_name='default', title='172.21.75.1 - 172.21.75.4', url='https://127.0.0.1:40443/api/vippools/2/', vast_asn=0, vlan=0, vms_preferred=False)] May 28 12:56:25 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b0b36f71-852d-463a-b1c8-4066ce824def tempest-ExportLocationsTest-1017217578 None] --- [GET] https://127.0.0.1:40443/api/vippools/: Done May 28 12:56:25 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b0b36f71-852d-463a-b1c8-4066ce824def tempest-ExportLocationsTest-1017217578 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:56:25 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b0b36f71-852d-463a-b1c8-4066ce824def tempest-ExportLocationsTest-1017217578 None] {'allow_redirects': True, May 28 12:56:25 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b0b36f71-852d-463a-b1c8-4066ce824def tempest-ExportLocationsTest-1017217578 None] 'params': {'name': '83d10127-dfed-433a-90d1-4f0a7f981edc'}} May 28 12:56:25 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_service.periodic_task [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85846) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:56:25 l75lg1-v1 cinder-volume[85846]: DEBUG cinder.volume.drivers.lvm [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] Updating volume stats {{(pid=85846) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 659/1326] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 12:56:25 2024] DELETE /identity/v3/users/14783f4fbce14880b4db4a628827607e => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:56:25 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:390}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11c94cd-ca62-4164-aef4-6d10794e7c07 tempest-AdminActionsAPIOnlyNegativeTest-1820624707 tempest-AdminActionsAPIOnlyNegativeTest-1820624707-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-4082bcd7-c7d5-4e34-ab00-ff02c92e4db8 None admin] The token cache is being invalidate because project 2bd1b57c2edf4e92abdd1caa7cd467b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-4082bcd7-c7d5-4e34-ab00-ff02c92e4db8 None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-c11c94cd-ca62-4164-aef4-6d10794e7c07 tempest-AdminActionsAPIOnlyNegativeTest-1820624707 tempest-AdminActionsAPIOnlyNegativeTest-1820624707-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-4082bcd7-c7d5-4e34-ab00-ff02c92e4db8 None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 668/1327] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 12:56:25 2024] DELETE /identity/v3/projects/2bd1b57c2edf4e92abdd1caa7cd467b8 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932bca20-ab3c-4af0-9cf4-8178672d9d1f None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932bca20-ab3c-4af0-9cf4-8178672d9d1f None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932bca20-ab3c-4af0-9cf4-8178672d9d1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:25 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.quota [None req-fc403043-74e2-4b87-a388-18694293b445 tempest-AdminActionsNegativeTest-763023849 tempest-AdminActionsNegativeTest-763023849-project-admin] Created reservations ['a8e3f93a-621b-40d7-8705-6b1dacc1a2bc', 'e4128179-0d8e-466c-8ef4-9ed4ae6a8c8f', '0ee700a6-9065-4eec-acf1-7aea296b11e9', '3cd8d529-eeff-4c5e-8bed-80df08ee4b30'] {{(pid=98330) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 12:56:25 l75lg1-v1 sudo[98751]: vastdata : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 May 28 12:56:25 l75lg1-v1 sudo[98751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) May 28 12:56:25 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-3a47ce09-c8c0-4938-92e8-423050f78f81 tempest-AdminActionsTest-1749172189 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:56:25 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-3a47ce09-c8c0-4938-92e8-423050f78f81 tempest-AdminActionsTest-1749172189 None] [] May 28 12:56:25 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-3a47ce09-c8c0-4938-92e8-423050f78f81 tempest-AdminActionsTest-1749172189 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 12:56:25 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-3a47ce09-c8c0-4938-92e8-423050f78f81 tempest-AdminActionsTest-1749172189 None] >>> [POST] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:56:25 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-3a47ce09-c8c0-4938-92e8-423050f78f81 tempest-AdminActionsTest-1749172189 None] {'data': '{"name": "77a25e6b-f137-4342-8eb9-9ced679515e2"}', May 28 12:56:25 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-3a47ce09-c8c0-4938-92e8-423050f78f81 tempest-AdminActionsTest-1749172189 None] 'json': None, May 28 12:56:25 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-3a47ce09-c8c0-4938-92e8-423050f78f81 tempest-AdminActionsTest-1749172189 None] 'params': None} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-932bca20-ab3c-4af0-9cf4-8178672d9d1f None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-932bca20-ab3c-4af0-9cf4-8178672d9d1f None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-932bca20-ab3c-4af0-9cf4-8178672d9d1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 669/1328] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:56:25 2024] POST /identity/v3/auth/tokens => generated 312 bytes in 20 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6210962-2bac-48ae-a978-3a14c82e339f None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6210962-2bac-48ae-a978-3a14c82e339f None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6210962-2bac-48ae-a978-3a14c82e339f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11c94cd-ca62-4164-aef4-6d10794e7c07 tempest-AdminActionsAPIOnlyNegativeTest-1820624707 tempest-AdminActionsAPIOnlyNegativeTest-1820624707-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a855132e-648f-416a-9cf8-c69489ce9f8a None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a855132e-648f-416a-9cf8-c69489ce9f8a None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a855132e-648f-416a-9cf8-c69489ce9f8a None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a855132e-648f-416a-9cf8-c69489ce9f8a None admin] PATH_INFO: `/v3/users/fc670cd52975471e86e32fd1f5a5229e` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a855132e-648f-416a-9cf8-c69489ce9f8a None admin] RBAC: Authorizing `identity:delete_user(user_id=fc670cd52975471e86e32fd1f5a5229e)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a855132e-648f-416a-9cf8-c69489ce9f8a None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-d6210962-2bac-48ae-a978-3a14c82e339f None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-d6210962-2bac-48ae-a978-3a14c82e339f None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-d6210962-2bac-48ae-a978-3a14c82e339f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 670/1329] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:56:25 2024] POST /identity/v3/auth/tokens => generated 2960 bytes in 23 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6210962-2bac-48ae-a978-3a14c82e339f None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6210962-2bac-48ae-a978-3a14c82e339f None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9318e75-40d1-43f1-b751-e86779db9c01 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9318e75-40d1-43f1-b751-e86779db9c01 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9318e75-40d1-43f1-b751-e86779db9c01 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9318e75-40d1-43f1-b751-e86779db9c01 None admin] PATH_INFO: `/v3/domains` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9318e75-40d1-43f1-b751-e86779db9c01 None admin] RBAC: Adding query filter params (name=Default) {{(pid=51267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9318e75-40d1-43f1-b751-e86779db9c01 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9318e75-40d1-43f1-b751-e86779db9c01 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 671/1330] 10.27.203.238 () {62 vars in 1220 bytes} [Tue May 28 12:56:25 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:56:25 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.quota [None req-fc403043-74e2-4b87-a388-18694293b445 tempest-AdminActionsNegativeTest-763023849 tempest-AdminActionsNegativeTest-763023849-project-admin] Committed reservations ['a8e3f93a-621b-40d7-8705-6b1dacc1a2bc', 'e4128179-0d8e-466c-8ef4-9ed4ae6a8c8f', '0ee700a6-9065-4eec-acf1-7aea296b11e9', '3cd8d529-eeff-4c5e-8bed-80df08ee4b30'] {{(pid=98330) commit /opt/stack/manila/manila/quota.py:1063}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9318e75-40d1-43f1-b751-e86779db9c01 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9318e75-40d1-43f1-b751-e86779db9c01 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f585df-c394-4bae-9df2-5ba235476217 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f585df-c394-4bae-9df2-5ba235476217 None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f585df-c394-4bae-9df2-5ba235476217 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f585df-c394-4bae-9df2-5ba235476217 None admin] PATH_INFO: `/v3/projects` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f585df-c394-4bae-9df2-5ba235476217 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f585df-c394-4bae-9df2-5ba235476217 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-a855132e-648f-416a-9cf8-c69489ce9f8a None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc670cd52975471e86e32fd1f5a5229e', 'request_id': 'req-a855132e-648f-416a-9cf8-c69489ce9f8a'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-a855132e-648f-416a-9cf8-c69489ce9f8a None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc670cd52975471e86e32fd1f5a5229e', 'request_id': 'req-a855132e-648f-416a-9cf8-c69489ce9f8a'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-a855132e-648f-416a-9cf8-c69489ce9f8a None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc670cd52975471e86e32fd1f5a5229e', 'request_id': 'req-a855132e-648f-416a-9cf8-c69489ce9f8a'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-a855132e-648f-416a-9cf8-c69489ce9f8a None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc670cd52975471e86e32fd1f5a5229e', 'request_id': 'req-a855132e-648f-416a-9cf8-c69489ce9f8a'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-a855132e-648f-416a-9cf8-c69489ce9f8a None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc670cd52975471e86e32fd1f5a5229e', 'request_id': 'req-a855132e-648f-416a-9cf8-c69489ce9f8a'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 672/1331] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 12:56:25 2024] POST /identity/v3/projects => generated 387 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f585df-c394-4bae-9df2-5ba235476217 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-15f585df-c394-4bae-9df2-5ba235476217 None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 660/1332] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 12:56:25 2024] DELETE /identity/v3/users/fc670cd52975471e86e32fd1f5a5229e => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a855132e-648f-416a-9cf8-c69489ce9f8a None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-a855132e-648f-416a-9cf8-c69489ce9f8a None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f585df-c394-4bae-9df2-5ba235476217 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a855132e-648f-416a-9cf8-c69489ce9f8a None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee3a40a-a46d-4114-884d-d6943aaea76e None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee3a40a-a46d-4114-884d-d6943aaea76e None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee3a40a-a46d-4114-884d-d6943aaea76e None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee3a40a-a46d-4114-884d-d6943aaea76e None admin] PATH_INFO: `/v3/users/452d391264e944fa9af8299320217344` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee3a40a-a46d-4114-884d-d6943aaea76e None admin] RBAC: Authorizing `identity:delete_user(user_id=452d391264e944fa9af8299320217344)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee3a40a-a46d-4114-884d-d6943aaea76e None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ca85f9-4878-4eed-9fbf-4db175316589 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ca85f9-4878-4eed-9fbf-4db175316589 None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ca85f9-4878-4eed-9fbf-4db175316589 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ca85f9-4878-4eed-9fbf-4db175316589 None admin] PATH_INFO: `/v3/users` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ca85f9-4878-4eed-9fbf-4db175316589 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ca85f9-4878-4eed-9fbf-4db175316589 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-c3ca85f9-4878-4eed-9fbf-4db175316589 None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 12:56:25 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-fc403043-74e2-4b87-a388-18694293b445 tempest-AdminActionsNegativeTest-763023849 None] Starting with 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:80}} May 28 12:56:25 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-fc403043-74e2-4b87-a388-18694293b445 tempest-AdminActionsNegativeTest-763023849 None] Filter OnlyHostFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:56:25 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-fc403043-74e2-4b87-a388-18694293b445 tempest-AdminActionsNegativeTest-763023849 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:56:25 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.capacity [None req-fc403043-74e2-4b87-a388-18694293b445 tempest-AdminActionsNegativeTest-763023849 None] Space information for share creation on host l75lg1-v1@vast#vast (requested / avail): 1/2080 {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/capacity.py:83}} May 28 12:56:25 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-fc403043-74e2-4b87-a388-18694293b445 tempest-AdminActionsNegativeTest-763023849 None] Filter CapacityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:56:25 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-fc403043-74e2-4b87-a388-18694293b445 tempest-AdminActionsNegativeTest-763023849 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:56:25 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-fc403043-74e2-4b87-a388-18694293b445 tempest-AdminActionsNegativeTest-763023849 None] Driver Filter: Checking host 'l75lg1-v1@vast#vast' {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:37}} May 28 12:56:25 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-fc403043-74e2-4b87-a388-18694293b445 tempest-AdminActionsNegativeTest-763023849 None] Filter function not set :: passing host. {{(pid=98327) _check_filter_function /opt/stack/manila/manila/scheduler/filters/driver.py:53}} May 28 12:56:25 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-fc403043-74e2-4b87-a388-18694293b445 tempest-AdminActionsNegativeTest-763023849 None] Result: True {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:40}} May 28 12:56:25 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-fc403043-74e2-4b87-a388-18694293b445 tempest-AdminActionsNegativeTest-763023849 None] Done checking host 'l75lg1-v1@vast#vast' {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:41}} May 28 12:56:25 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-fc403043-74e2-4b87-a388-18694293b445 tempest-AdminActionsNegativeTest-763023849 None] Filter DriverFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:56:25 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-fc403043-74e2-4b87-a388-18694293b445 tempest-AdminActionsNegativeTest-763023849 None] Filter ShareReplicationFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:56:25 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-fc403043-74e2-4b87-a388-18694293b445 tempest-AdminActionsNegativeTest-763023849 None] Filter CreateFromSnapshotFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:56:25 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-fc403043-74e2-4b87-a388-18694293b445 tempest-AdminActionsNegativeTest-763023849 None] Filter AffinityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:56:25 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-fc403043-74e2-4b87-a388-18694293b445 tempest-AdminActionsNegativeTest-763023849 None] Filter AntiAffinityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:56:25 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.drivers.filter [None req-fc403043-74e2-4b87-a388-18694293b445 tempest-AdminActionsNegativeTest-763023849 None] Filtered share [host: 'l75lg1-v1@vast#vast', free_capacity_gb: 2080.6229242384434, pools: None] {{(pid=98327) _schedule_share /opt/stack/manila/manila/scheduler/drivers/filter.py:268}} May 28 12:56:25 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-fc403043-74e2-4b87-a388-18694293b445 tempest-AdminActionsNegativeTest-763023849 None] Checking host 'l75lg1-v1@vast#vast' {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:46}} May 28 12:56:25 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.weighers.goodness [None req-fc403043-74e2-4b87-a388-18694293b445 tempest-AdminActionsNegativeTest-763023849 None] Goodness function not set :: defaulting to minimal goodness rating of 0. May 28 12:56:25 l75lg1-v1 manila-scheduler[98327]: INFO manila.scheduler.weighers.goodness [None req-fc403043-74e2-4b87-a388-18694293b445 tempest-AdminActionsNegativeTest-763023849 None] Goodness function result for host l75lg1-v1@vast#vast: 0. May 28 12:56:25 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-fc403043-74e2-4b87-a388-18694293b445 tempest-AdminActionsNegativeTest-763023849 tempest-AdminActionsNegativeTest-763023849-project-admin] http://10.27.203.238/share/v2/7c36a466cc2a42b195f921474b0f4de5/shares returned with HTTP 200 May 28 12:56:25 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-fc403043-74e2-4b87-a388-18694293b445 tempest-AdminActionsNegativeTest-763023849 None] Goodness: 0 {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:48}} May 28 12:56:25 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 4/23] 10.27.203.238 () {66 vars in 1362 bytes} [Tue May 28 12:56:24 2024] POST /share/v2/7c36a466cc2a42b195f921474b0f4de5/shares => generated 1349 bytes in 1334 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:56:25 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-fc403043-74e2-4b87-a388-18694293b445 tempest-AdminActionsNegativeTest-763023849 None] Done checking host 'l75lg1-v1@vast#vast' {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:49}} May 28 12:56:25 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.drivers.filter [None req-fc403043-74e2-4b87-a388-18694293b445 tempest-AdminActionsNegativeTest-763023849 None] Choosing for share: WeighedHost [host: l75lg1-v1@vast#vast, weight: 0.0] {{(pid=98327) _schedule_share /opt/stack/manila/manila/scheduler/drivers/filter.py:274}} May 28 12:56:25 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-1b5c2b0f-ac79-4a1b-bc5f-fdca26e52edb tempest-AdminActionsNegativeTest-763023849 tempest-AdminActionsNegativeTest-763023849-project-admin] GET http://10.27.203.238/share/v2/7c36a466cc2a42b195f921474b0f4de5/shares/415272bd-25d1-465a-87fc-b0fdbc8c093c May 28 12:56:25 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-1b5c2b0f-ac79-4a1b-bc5f-fdca26e52edb tempest-AdminActionsNegativeTest-763023849 tempest-AdminActionsNegativeTest-763023849-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:25 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-1b5c2b0f-ac79-4a1b-bc5f-fdca26e52edb tempest-AdminActionsNegativeTest-763023849 tempest-AdminActionsNegativeTest-763023849-project-admin] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 673/1333] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 12:56:25 2024] POST /identity/v3/users => generated 301 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:56:25 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-1b5c2b0f-ac79-4a1b-bc5f-fdca26e52edb tempest-AdminActionsNegativeTest-763023849 tempest-AdminActionsNegativeTest-763023849-project-admin] http://10.27.203.238/share/v2/7c36a466cc2a42b195f921474b0f4de5/shares/415272bd-25d1-465a-87fc-b0fdbc8c093c returned with HTTP 200 May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ca85f9-4878-4eed-9fbf-4db175316589 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:25 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 20/24] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:56:25 2024] GET /share/v2/7c36a466cc2a42b195f921474b0f4de5/shares/415272bd-25d1-465a-87fc-b0fdbc8c093c => generated 1349 bytes in 27 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ca85f9-4878-4eed-9fbf-4db175316589 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-eee3a40a-a46d-4114-884d-d6943aaea76e None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '452d391264e944fa9af8299320217344', 'request_id': 'req-eee3a40a-a46d-4114-884d-d6943aaea76e'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-eee3a40a-a46d-4114-884d-d6943aaea76e None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '452d391264e944fa9af8299320217344', 'request_id': 'req-eee3a40a-a46d-4114-884d-d6943aaea76e'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-eee3a40a-a46d-4114-884d-d6943aaea76e None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '452d391264e944fa9af8299320217344', 'request_id': 'req-eee3a40a-a46d-4114-884d-d6943aaea76e'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-eee3a40a-a46d-4114-884d-d6943aaea76e None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '452d391264e944fa9af8299320217344', 'request_id': 'req-eee3a40a-a46d-4114-884d-d6943aaea76e'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-eee3a40a-a46d-4114-884d-d6943aaea76e None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '452d391264e944fa9af8299320217344', 'request_id': 'req-eee3a40a-a46d-4114-884d-d6943aaea76e'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced3dd25-837b-4ec5-ae97-0b6c92203e2b None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced3dd25-837b-4ec5-ae97-0b6c92203e2b None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced3dd25-837b-4ec5-ae97-0b6c92203e2b None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced3dd25-837b-4ec5-ae97-0b6c92203e2b None admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced3dd25-837b-4ec5-ae97-0b6c92203e2b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced3dd25-837b-4ec5-ae97-0b6c92203e2b None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:25 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 674/1334] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 12:56:25 2024] GET /identity/v3/roles => generated 1680 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced3dd25-837b-4ec5-ae97-0b6c92203e2b None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 661/1335] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 12:56:25 2024] DELETE /identity/v3/users/452d391264e944fa9af8299320217344 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-ced3dd25-837b-4ec5-ae97-0b6c92203e2b None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee3a40a-a46d-4114-884d-d6943aaea76e None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-eee3a40a-a46d-4114-884d-d6943aaea76e None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced3dd25-837b-4ec5-ae97-0b6c92203e2b None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:26 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b0b36f71-852d-463a-b1c8-4066ce824def tempest-ExportLocationsTest-1017217578 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:56:26 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b0b36f71-852d-463a-b1c8-4066ce824def tempest-ExportLocationsTest-1017217578 None] [] May 28 12:56:26 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b0b36f71-852d-463a-b1c8-4066ce824def tempest-ExportLocationsTest-1017217578 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 12:56:26 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b0b36f71-852d-463a-b1c8-4066ce824def tempest-ExportLocationsTest-1017217578 None] >>> [POST] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:56:26 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b0b36f71-852d-463a-b1c8-4066ce824def tempest-ExportLocationsTest-1017217578 None] {'data': '{"name": "83d10127-dfed-433a-90d1-4f0a7f981edc"}', May 28 12:56:26 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b0b36f71-852d-463a-b1c8-4066ce824def tempest-ExportLocationsTest-1017217578 None] 'json': None, May 28 12:56:26 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b0b36f71-852d-463a-b1c8-4066ce824def tempest-ExportLocationsTest-1017217578 None] 'params': None} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee3a40a-a46d-4114-884d-d6943aaea76e None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347c8e9d-f428-4fa7-bdff-c0813ca6130d None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347c8e9d-f428-4fa7-bdff-c0813ca6130d None admin] REQUEST_METHOD: `PUT` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347c8e9d-f428-4fa7-bdff-c0813ca6130d None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347c8e9d-f428-4fa7-bdff-c0813ca6130d None admin] PATH_INFO: `/v3/projects/d447f446627b49f099c61266fa885395/users/1f52ef3085674f5d89dd02e8ef064c08/roles/e7989893488f483baa107be56668c4f8` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256299b2-3961-4661-90b6-ef9de9abe8fe None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256299b2-3961-4661-90b6-ef9de9abe8fe None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256299b2-3961-4661-90b6-ef9de9abe8fe None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256299b2-3961-4661-90b6-ef9de9abe8fe None admin] PATH_INFO: `/v3/users/34c3c14495e243028b5a760f7c1d86bd` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256299b2-3961-4661-90b6-ef9de9abe8fe None admin] RBAC: Authorizing `identity:delete_user(user_id=34c3c14495e243028b5a760f7c1d86bd)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256299b2-3961-4661-90b6-ef9de9abe8fe None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347c8e9d-f428-4fa7-bdff-c0813ca6130d None admin] RBAC: Authorizing `identity:create_grant(project_id=d447f446627b49f099c61266fa885395, user_id=1f52ef3085674f5d89dd02e8ef064c08, role_id=e7989893488f483baa107be56668c4f8)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347c8e9d-f428-4fa7-bdff-c0813ca6130d None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:26 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-fc403043-74e2-4b87-a388-18694293b445 tempest-AdminActionsNegativeTest-763023849 None] >>> [GET] https://127.0.0.1:40443/api/vippools/ May 28 12:56:26 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-fc403043-74e2-4b87-a388-18694293b445 tempest-AdminActionsNegativeTest-763023849 None] {'allow_redirects': True, 'params': {'name': 'vippool-1'}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 675/1336] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 12:56:26 2024] PUT /identity/v3/projects/d447f446627b49f099c61266fa885395/users/1f52ef3085674f5d89dd02e8ef064c08/roles/e7989893488f483baa107be56668c4f8 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347c8e9d-f428-4fa7-bdff-c0813ca6130d None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-256299b2-3961-4661-90b6-ef9de9abe8fe None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34c3c14495e243028b5a760f7c1d86bd', 'request_id': 'req-256299b2-3961-4661-90b6-ef9de9abe8fe'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-256299b2-3961-4661-90b6-ef9de9abe8fe None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34c3c14495e243028b5a760f7c1d86bd', 'request_id': 'req-256299b2-3961-4661-90b6-ef9de9abe8fe'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-256299b2-3961-4661-90b6-ef9de9abe8fe None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34c3c14495e243028b5a760f7c1d86bd', 'request_id': 'req-256299b2-3961-4661-90b6-ef9de9abe8fe'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347c8e9d-f428-4fa7-bdff-c0813ca6130d None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-256299b2-3961-4661-90b6-ef9de9abe8fe None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34c3c14495e243028b5a760f7c1d86bd', 'request_id': 'req-256299b2-3961-4661-90b6-ef9de9abe8fe'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-256299b2-3961-4661-90b6-ef9de9abe8fe None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34c3c14495e243028b5a760f7c1d86bd', 'request_id': 'req-256299b2-3961-4661-90b6-ef9de9abe8fe'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 662/1337] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 12:56:26 2024] DELETE /identity/v3/users/34c3c14495e243028b5a760f7c1d86bd => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3094dd4d-8fc5-458e-bb30-b69b40d92085 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3094dd4d-8fc5-458e-bb30-b69b40d92085 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3094dd4d-8fc5-458e-bb30-b69b40d92085 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9ab7db-a9e3-4ae8-ba29-7ccdc1df1da1 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9ab7db-a9e3-4ae8-ba29-7ccdc1df1da1 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9ab7db-a9e3-4ae8-ba29-7ccdc1df1da1 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9ab7db-a9e3-4ae8-ba29-7ccdc1df1da1 None admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9ab7db-a9e3-4ae8-ba29-7ccdc1df1da1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9ab7db-a9e3-4ae8-ba29-7ccdc1df1da1 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-3094dd4d-8fc5-458e-bb30-b69b40d92085 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 676/1338] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 12:56:26 2024] GET /identity/v3/roles => generated 1680 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-3094dd4d-8fc5-458e-bb30-b69b40d92085 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9ab7db-a9e3-4ae8-ba29-7ccdc1df1da1 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-3094dd4d-8fc5-458e-bb30-b69b40d92085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-ab9ab7db-a9e3-4ae8-ba29-7ccdc1df1da1 None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9ab7db-a9e3-4ae8-ba29-7ccdc1df1da1 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 663/1339] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:56:26 2024] POST /identity/v3/auth/tokens => generated 2960 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 28 12:56:26 l75lg1-v1 neutron-server[77618]: DEBUG neutron.wsgi [-] (77618) accepted ('10.27.203.238', 55938) {{(pid=77618) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3094dd4d-8fc5-458e-bb30-b69b40d92085 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-3094dd4d-8fc5-458e-bb30-b69b40d92085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19ea9a8-bac1-4557-9057-4d8106e059e0 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19ea9a8-bac1-4557-9057-4d8106e059e0 None admin] REQUEST_METHOD: `PUT` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19ea9a8-bac1-4557-9057-4d8106e059e0 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19ea9a8-bac1-4557-9057-4d8106e059e0 None admin] PATH_INFO: `/v3/projects/d447f446627b49f099c61266fa885395/users/1f52ef3085674f5d89dd02e8ef064c08/roles/e7989893488f483baa107be56668c4f8` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19ea9a8-bac1-4557-9057-4d8106e059e0 None admin] RBAC: Authorizing `identity:create_grant(project_id=d447f446627b49f099c61266fa885395, user_id=1f52ef3085674f5d89dd02e8ef064c08, role_id=e7989893488f483baa107be56668c4f8)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19ea9a8-bac1-4557-9057-4d8106e059e0 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 677/1340] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 12:56:26 2024] PUT /identity/v3/projects/d447f446627b49f099c61266fa885395/users/1f52ef3085674f5d89dd02e8ef064c08/roles/e7989893488f483baa107be56668c4f8 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8039a7b-2f50-42fc-aaba-7a8d60b96179 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8039a7b-2f50-42fc-aaba-7a8d60b96179 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8039a7b-2f50-42fc-aaba-7a8d60b96179 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-d8039a7b-2f50-42fc-aaba-7a8d60b96179 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:56:26 l75lg1-v1 sudo[98751]: pam_unix(sudo:session): session closed for user root May 28 12:56:26 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.496s {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:428}} May 28 12:56:26 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:390}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-d8039a7b-2f50-42fc-aaba-7a8d60b96179 None None] MFA Rules not processed for user `1f52ef3085674f5d89dd02e8ef064c08`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-d8039a7b-2f50-42fc-aaba-7a8d60b96179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3094dd4d-8fc5-458e-bb30-b69b40d92085 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:26 l75lg1-v1 sudo[98756]: vastdata : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 May 28 12:56:26 l75lg1-v1 sudo[98756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) May 28 12:56:26 l75lg1-v1 dstat.sh[49771]: 28-05 12:56:26| 28 5 64 3 0|5623M 1891M 277M 7835M| 25k 19k| 256k 3457k|2.00 451 | 13k 25k|1.66 0.93 0.96|5.0 1.0 53| 0 0 | 0 2048M| 29 341 0 26 0 May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701f17d8-ea4d-44c5-b14d-f36ba48b8747 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef17047035e4b518fd5360a01f2da1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701f17d8-ea4d-44c5-b14d-f36ba48b8747 service neutron] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701f17d8-ea4d-44c5-b14d-f36ba48b8747 service neutron] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701f17d8-ea4d-44c5-b14d-f36ba48b8747 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 678/1341] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:56:26 2024] POST /identity/v3/auth/tokens => generated 4081 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8039a7b-2f50-42fc-aaba-7a8d60b96179 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8039a7b-2f50-42fc-aaba-7a8d60b96179 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701f17d8-ea4d-44c5-b14d-f36ba48b8747 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701f17d8-ea4d-44c5-b14d-f36ba48b8747 service neutron] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb82eef-58de-4428-8bba-a392fecd6a8c None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb82eef-58de-4428-8bba-a392fecd6a8c None admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb82eef-58de-4428-8bba-a392fecd6a8c None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb82eef-58de-4428-8bba-a392fecd6a8c None admin] PATH_INFO: `/v3/users/1f52ef3085674f5d89dd02e8ef064c08` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 664/1342] 10.27.203.238 () {64 vars in 1432 bytes} [Tue May 28 12:56:26 2024] GET /identity/v3/auth/tokens => generated 2960 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb82eef-58de-4428-8bba-a392fecd6a8c None admin] RBAC: Authorizing `identity:delete_user(user_id=1f52ef3085674f5d89dd02e8ef064c08)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb82eef-58de-4428-8bba-a392fecd6a8c None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:26 l75lg1-v1 neutron-server[77618]: INFO neutron.wsgi [None req-516cd091-4dff-403b-b93e-86657938ac2a None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=cfaeb31ba56441e0b06355cc09ec1103&name=default HTTP/1.1" status: 200 len: 216 time: 0.1248348 May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701f17d8-ea4d-44c5-b14d-f36ba48b8747 service neutron] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-701f17d8-ea4d-44c5-b14d-f36ba48b8747 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701f17d8-ea4d-44c5-b14d-f36ba48b8747 service neutron] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8314e6b1-28d8-4112-9fb9-86e8156c19a3 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8314e6b1-28d8-4112-9fb9-86e8156c19a3 None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8314e6b1-28d8-4112-9fb9-86e8156c19a3 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8314e6b1-28d8-4112-9fb9-86e8156c19a3 None admin] PATH_INFO: `/v3/projects/cfaeb31ba56441e0b06355cc09ec1103` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8314e6b1-28d8-4112-9fb9-86e8156c19a3 None admin] RBAC: Authorizing `identity:delete_project(project_id=cfaeb31ba56441e0b06355cc09ec1103)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8314e6b1-28d8-4112-9fb9-86e8156c19a3 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-6fb82eef-58de-4428-8bba-a392fecd6a8c None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f52ef3085674f5d89dd02e8ef064c08', 'request_id': 'req-6fb82eef-58de-4428-8bba-a392fecd6a8c'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-6fb82eef-58de-4428-8bba-a392fecd6a8c None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f52ef3085674f5d89dd02e8ef064c08', 'request_id': 'req-6fb82eef-58de-4428-8bba-a392fecd6a8c'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-6fb82eef-58de-4428-8bba-a392fecd6a8c None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f52ef3085674f5d89dd02e8ef064c08', 'request_id': 'req-6fb82eef-58de-4428-8bba-a392fecd6a8c'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-6fb82eef-58de-4428-8bba-a392fecd6a8c None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f52ef3085674f5d89dd02e8ef064c08', 'request_id': 'req-6fb82eef-58de-4428-8bba-a392fecd6a8c'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-6fb82eef-58de-4428-8bba-a392fecd6a8c None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f52ef3085674f5d89dd02e8ef064c08', 'request_id': 'req-6fb82eef-58de-4428-8bba-a392fecd6a8c'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-8314e6b1-28d8-4112-9fb9-86e8156c19a3 None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cfaeb31ba56441e0b06355cc09ec1103', 'request_id': 'req-8314e6b1-28d8-4112-9fb9-86e8156c19a3'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 679/1343] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 12:56:26 2024] DELETE /identity/v3/users/1f52ef3085674f5d89dd02e8ef064c08 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:56:26 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-fc403043-74e2-4b87-a388-18694293b445 tempest-AdminActionsNegativeTest-763023849 None] <<< [GET] https://127.0.0.1:40443/api/vippools/ May 28 12:56:26 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-fc403043-74e2-4b87-a388-18694293b445 tempest-AdminActionsNegativeTest-763023849 None] [Bunch(active_cnode_ids=[], active_interfaces=4, cluster='loop75-kfs', cluster_id=1, cnode_ids=[], cnodes=[], domain_name='vippool-1', enable_l3=False, enable_weighted_balancing=False, enabled=True, end_ip='172.21.75.4', guid='f2abaede-b397-413a-8faa-3aeead6d3b28', gw_ip='', gw_ipv6='', id=2, ip_ranges=[['172.21.75.1', '172.21.75.4']], name='vippool-1', peer_asn=0, port_membership='ALL', ranges_summary='172.21.75.[1-4]', role='PROTOCOLS', start_ip='172.21.75.1', subnet_cidr=16, subnet_cidr_ipv6=None, sync='SYNCED', sync_time='2024-05-28T12:50:09.644123Z', tenant_id=1, tenant_name='default', title='172.21.75.1 - 172.21.75.4', url='https://127.0.0.1:40443/api/vippools/2/', vast_asn=0, vlan=0, vms_preferred=False)] May 28 12:56:26 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-fc403043-74e2-4b87-a388-18694293b445 tempest-AdminActionsNegativeTest-763023849 None] --- [GET] https://127.0.0.1:40443/api/vippools/: Done May 28 12:56:26 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-fc403043-74e2-4b87-a388-18694293b445 tempest-AdminActionsNegativeTest-763023849 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:56:26 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-fc403043-74e2-4b87-a388-18694293b445 tempest-AdminActionsNegativeTest-763023849 None] {'allow_redirects': True, May 28 12:56:26 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-fc403043-74e2-4b87-a388-18694293b445 tempest-AdminActionsNegativeTest-763023849 None] 'params': {'name': '5ae9ae15-dc00-44c8-891a-9758f2b29855'}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d511e7e-7c5b-429b-9f65-0e0a02d03779 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d511e7e-7c5b-429b-9f65-0e0a02d03779 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d511e7e-7c5b-429b-9f65-0e0a02d03779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-8314e6b1-28d8-4112-9fb9-86e8156c19a3 None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cfaeb31ba56441e0b06355cc09ec1103', 'request_id': 'req-8314e6b1-28d8-4112-9fb9-86e8156c19a3'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-7d511e7e-7c5b-429b-9f65-0e0a02d03779 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-7d511e7e-7c5b-429b-9f65-0e0a02d03779 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-7d511e7e-7c5b-429b-9f65-0e0a02d03779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-8314e6b1-28d8-4112-9fb9-86e8156c19a3 None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cfaeb31ba56441e0b06355cc09ec1103', 'request_id': 'req-8314e6b1-28d8-4112-9fb9-86e8156c19a3'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-8314e6b1-28d8-4112-9fb9-86e8156c19a3 None admin] The token cache is being invalidate because project cfaeb31ba56441e0b06355cc09ec1103 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-8314e6b1-28d8-4112-9fb9-86e8156c19a3 None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-8314e6b1-28d8-4112-9fb9-86e8156c19a3 None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 665/1344] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 12:56:26 2024] DELETE /identity/v3/projects/cfaeb31ba56441e0b06355cc09ec1103 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:56:26 l75lg1-v1 neutron-server[77618]: DEBUG neutron.wsgi [-] (77618) accepted ('10.27.203.238', 55940) {{(pid=77618) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 12:56:26 l75lg1-v1 neutron-server[77618]: INFO neutron.wsgi [None req-1391b7a3-e040-4296-814f-d87a8701a364 None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=e597e913ff9348f29791175d986c8a59&name=default HTTP/1.1" status: 200 len: 216 time: 0.0086899 May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8314e6b1-28d8-4112-9fb9-86e8156c19a3 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-8314e6b1-28d8-4112-9fb9-86e8156c19a3 None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 680/1345] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:56:26 2024] POST /identity/v3/auth/tokens => generated 2960 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 12:56:26 l75lg1-v1 neutron-server[77618]: DEBUG neutron.wsgi [-] (77618) accepted ('10.27.203.238', 55948) {{(pid=77618) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d511e7e-7c5b-429b-9f65-0e0a02d03779 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-7d511e7e-7c5b-429b-9f65-0e0a02d03779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8314e6b1-28d8-4112-9fb9-86e8156c19a3 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b8748a-989a-40db-87de-2079da0bca08 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b8748a-989a-40db-87de-2079da0bca08 None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b8748a-989a-40db-87de-2079da0bca08 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b8748a-989a-40db-87de-2079da0bca08 None admin] PATH_INFO: `/v3/projects/e597e913ff9348f29791175d986c8a59` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b8748a-989a-40db-87de-2079da0bca08 None admin] RBAC: Authorizing `identity:delete_project(project_id=e597e913ff9348f29791175d986c8a59)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b8748a-989a-40db-87de-2079da0bca08 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d511e7e-7c5b-429b-9f65-0e0a02d03779 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52ffd37-5411-4607-bce9-c64faf87f90d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef17047035e4b518fd5360a01f2da1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52ffd37-5411-4607-bce9-c64faf87f90d service neutron] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52ffd37-5411-4607-bce9-c64faf87f90d service neutron] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52ffd37-5411-4607-bce9-c64faf87f90d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52ffd37-5411-4607-bce9-c64faf87f90d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52ffd37-5411-4607-bce9-c64faf87f90d service neutron] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 681/1346] 10.27.203.238 () {64 vars in 1432 bytes} [Tue May 28 12:56:26 2024] GET /identity/v3/auth/tokens => generated 2960 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 28 12:56:26 l75lg1-v1 neutron-server[77618]: INFO neutron.wsgi [None req-2689eb08-898d-499e-af55-d91f6314e0df None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=d447f446627b49f099c61266fa885395&name=default HTTP/1.1" status: 200 len: 216 time: 0.0715518 May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52ffd37-5411-4607-bce9-c64faf87f90d service neutron] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-f52ffd37-5411-4607-bce9-c64faf87f90d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-14b8748a-989a-40db-87de-2079da0bca08 None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e597e913ff9348f29791175d986c8a59', 'request_id': 'req-14b8748a-989a-40db-87de-2079da0bca08'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52ffd37-5411-4607-bce9-c64faf87f90d service neutron] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-14b8748a-989a-40db-87de-2079da0bca08 None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e597e913ff9348f29791175d986c8a59', 'request_id': 'req-14b8748a-989a-40db-87de-2079da0bca08'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-14b8748a-989a-40db-87de-2079da0bca08 None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e597e913ff9348f29791175d986c8a59', 'request_id': 'req-14b8748a-989a-40db-87de-2079da0bca08'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf3b80c-2e94-4027-adde-24d112d40dd0 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf3b80c-2e94-4027-adde-24d112d40dd0 None admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf3b80c-2e94-4027-adde-24d112d40dd0 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf3b80c-2e94-4027-adde-24d112d40dd0 None admin] PATH_INFO: `/v3/projects/d447f446627b49f099c61266fa885395` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf3b80c-2e94-4027-adde-24d112d40dd0 None admin] RBAC: Authorizing `identity:delete_project(project_id=d447f446627b49f099c61266fa885395)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf3b80c-2e94-4027-adde-24d112d40dd0 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-14b8748a-989a-40db-87de-2079da0bca08 None admin] The token cache is being invalidate because project e597e913ff9348f29791175d986c8a59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-14b8748a-989a-40db-87de-2079da0bca08 None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-14b8748a-989a-40db-87de-2079da0bca08 None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 666/1347] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 12:56:26 2024] DELETE /identity/v3/projects/e597e913ff9348f29791175d986c8a59 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:56:26 l75lg1-v1 neutron-server[77618]: DEBUG neutron.wsgi [-] (77618) accepted ('10.27.203.238', 55960) {{(pid=77618) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 12:56:26 l75lg1-v1 neutron-server[77618]: INFO neutron.wsgi [None req-4fde015c-ce8e-4b6d-b218-0a952f577770 None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=18b363e2f0074cd392cfa81c7fd69bb7&name=default HTTP/1.1" status: 200 len: 216 time: 0.0088754 May 28 12:56:26 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-3a47ce09-c8c0-4938-92e8-423050f78f81 tempest-AdminActionsTest-1749172189 None] <<< [POST] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:56:26 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-3a47ce09-c8c0-4938-92e8-423050f78f81 tempest-AdminActionsTest-1749172189 None] Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=0, created='2024-05-28T12:56:26.078547Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='39b426f6-8567-435f-897e-d24be3444de1', id=4, internal=False, is_s3_default_policy=False, name='77a25e6b-f137-4342-8eb9-9ced679515e2', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=[], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['*'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['*'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T12:56:26.460809Z', tenant_id=1, tenant_name='default', title='77a25e6b-f137-4342-8eb9-9ced679515e2', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/4/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[]) May 28 12:56:26 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-3a47ce09-c8c0-4938-92e8-423050f78f81 tempest-AdminActionsTest-1749172189 None] --- [POST] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 12:56:26 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-3a47ce09-c8c0-4938-92e8-423050f78f81 tempest-AdminActionsTest-1749172189 None] >>> [GET] https://127.0.0.1:40443/api/quotas/ May 28 12:56:26 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-3a47ce09-c8c0-4938-92e8-423050f78f81 tempest-AdminActionsTest-1749172189 None] {'allow_redirects': True, May 28 12:56:26 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-3a47ce09-c8c0-4938-92e8-423050f78f81 tempest-AdminActionsTest-1749172189 None] 'params': {'name': '77a25e6b-f137-4342-8eb9-9ced679515e2'}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b8748a-989a-40db-87de-2079da0bca08 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-14b8748a-989a-40db-87de-2079da0bca08 None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b8748a-989a-40db-87de-2079da0bca08 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-1cf3b80c-2e94-4027-adde-24d112d40dd0 None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd447f446627b49f099c61266fa885395', 'request_id': 'req-1cf3b80c-2e94-4027-adde-24d112d40dd0'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-1cf3b80c-2e94-4027-adde-24d112d40dd0 None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd447f446627b49f099c61266fa885395', 'request_id': 'req-1cf3b80c-2e94-4027-adde-24d112d40dd0'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-1cf3b80c-2e94-4027-adde-24d112d40dd0 None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd447f446627b49f099c61266fa885395', 'request_id': 'req-1cf3b80c-2e94-4027-adde-24d112d40dd0'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e831818b-49e0-416b-8ee2-b7f8a5612aa2 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e831818b-49e0-416b-8ee2-b7f8a5612aa2 None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-1cf3b80c-2e94-4027-adde-24d112d40dd0 None admin] The token cache is being invalidate because project d447f446627b49f099c61266fa885395 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e831818b-49e0-416b-8ee2-b7f8a5612aa2 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-1cf3b80c-2e94-4027-adde-24d112d40dd0 None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e831818b-49e0-416b-8ee2-b7f8a5612aa2 None admin] PATH_INFO: `/v3/projects/18b363e2f0074cd392cfa81c7fd69bb7` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-1cf3b80c-2e94-4027-adde-24d112d40dd0 None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e831818b-49e0-416b-8ee2-b7f8a5612aa2 None admin] RBAC: Authorizing `identity:delete_project(project_id=18b363e2f0074cd392cfa81c7fd69bb7)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 682/1348] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 12:56:26 2024] DELETE /identity/v3/projects/d447f446627b49f099c61266fa885395 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e831818b-49e0-416b-8ee2-b7f8a5612aa2 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d036959-5a08-4c7c-b90c-caf047d11d44 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d036959-5a08-4c7c-b90c-caf047d11d44 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d036959-5a08-4c7c-b90c-caf047d11d44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-1d036959-5a08-4c7c-b90c-caf047d11d44 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-1d036959-5a08-4c7c-b90c-caf047d11d44 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-1d036959-5a08-4c7c-b90c-caf047d11d44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 683/1349] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:56:26 2024] POST /identity/v3/auth/tokens => generated 312 bytes in 19 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aebdf7-def4-4d65-a909-c83aa58656af None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aebdf7-def4-4d65-a909-c83aa58656af None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aebdf7-def4-4d65-a909-c83aa58656af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-e831818b-49e0-416b-8ee2-b7f8a5612aa2 None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18b363e2f0074cd392cfa81c7fd69bb7', 'request_id': 'req-e831818b-49e0-416b-8ee2-b7f8a5612aa2'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-20aebdf7-def4-4d65-a909-c83aa58656af None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-e831818b-49e0-416b-8ee2-b7f8a5612aa2 None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18b363e2f0074cd392cfa81c7fd69bb7', 'request_id': 'req-e831818b-49e0-416b-8ee2-b7f8a5612aa2'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-20aebdf7-def4-4d65-a909-c83aa58656af None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-20aebdf7-def4-4d65-a909-c83aa58656af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-e831818b-49e0-416b-8ee2-b7f8a5612aa2 None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18b363e2f0074cd392cfa81c7fd69bb7', 'request_id': 'req-e831818b-49e0-416b-8ee2-b7f8a5612aa2'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-e831818b-49e0-416b-8ee2-b7f8a5612aa2 None admin] The token cache is being invalidate because project 18b363e2f0074cd392cfa81c7fd69bb7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-e831818b-49e0-416b-8ee2-b7f8a5612aa2 None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-e831818b-49e0-416b-8ee2-b7f8a5612aa2 None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 667/1350] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 12:56:26 2024] DELETE /identity/v3/projects/18b363e2f0074cd392cfa81c7fd69bb7 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 684/1351] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:56:26 2024] POST /identity/v3/auth/tokens => generated 2960 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa0bc6c-2a3e-493c-84b8-75f9a439fe58 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa0bc6c-2a3e-493c-84b8-75f9a439fe58 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa0bc6c-2a3e-493c-84b8-75f9a439fe58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aebdf7-def4-4d65-a909-c83aa58656af None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:26 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-fc403043-74e2-4b87-a388-18694293b445 tempest-AdminActionsNegativeTest-763023849 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:56:26 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-fc403043-74e2-4b87-a388-18694293b445 tempest-AdminActionsNegativeTest-763023849 None] [] May 28 12:56:26 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-fc403043-74e2-4b87-a388-18694293b445 tempest-AdminActionsNegativeTest-763023849 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aebdf7-def4-4d65-a909-c83aa58656af None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:26 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-fc403043-74e2-4b87-a388-18694293b445 tempest-AdminActionsNegativeTest-763023849 None] >>> [POST] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:56:26 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-fc403043-74e2-4b87-a388-18694293b445 tempest-AdminActionsNegativeTest-763023849 None] {'data': '{"name": "5ae9ae15-dc00-44c8-891a-9758f2b29855"}', May 28 12:56:26 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-fc403043-74e2-4b87-a388-18694293b445 tempest-AdminActionsNegativeTest-763023849 None] 'json': None, May 28 12:56:26 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-fc403043-74e2-4b87-a388-18694293b445 tempest-AdminActionsNegativeTest-763023849 None] 'params': None} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-0aa0bc6c-2a3e-493c-84b8-75f9a439fe58 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f356fc-861e-4460-a733-61e49a8c9ea2 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f356fc-861e-4460-a733-61e49a8c9ea2 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f356fc-861e-4460-a733-61e49a8c9ea2 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f356fc-861e-4460-a733-61e49a8c9ea2 None admin] PATH_INFO: `/v3/domains` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f356fc-861e-4460-a733-61e49a8c9ea2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=51267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f356fc-861e-4460-a733-61e49a8c9ea2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-0aa0bc6c-2a3e-493c-84b8-75f9a439fe58 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f356fc-861e-4460-a733-61e49a8c9ea2 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-0aa0bc6c-2a3e-493c-84b8-75f9a439fe58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 668/1352] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:56:26 2024] POST /identity/v3/auth/tokens => generated 312 bytes in 21 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b55ef4-fbf1-4bdd-8984-2e1be779d02c None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 685/1353] 10.27.203.238 () {62 vars in 1220 bytes} [Tue May 28 12:56:26 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b55ef4-fbf1-4bdd-8984-2e1be779d02c None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b55ef4-fbf1-4bdd-8984-2e1be779d02c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:26 l75lg1-v1 sudo[98756]: pam_unix(sudo:session): session closed for user root May 28 12:56:26 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.486s {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:428}} May 28 12:56:26 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:390}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f356fc-861e-4460-a733-61e49a8c9ea2 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f356fc-861e-4460-a733-61e49a8c9ea2 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29e7f97-8e2b-44f6-9c0b-438d28f75988 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29e7f97-8e2b-44f6-9c0b-438d28f75988 None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-22b55ef4-fbf1-4bdd-8984-2e1be779d02c None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29e7f97-8e2b-44f6-9c0b-438d28f75988 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29e7f97-8e2b-44f6-9c0b-438d28f75988 None admin] PATH_INFO: `/v3/projects` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29e7f97-8e2b-44f6-9c0b-438d28f75988 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29e7f97-8e2b-44f6-9c0b-438d28f75988 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-22b55ef4-fbf1-4bdd-8984-2e1be779d02c None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-22b55ef4-fbf1-4bdd-8984-2e1be779d02c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:26 l75lg1-v1 sudo[98759]: vastdata : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool May 28 12:56:26 l75lg1-v1 sudo[98759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 669/1354] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:56:26 2024] POST /identity/v3/auth/tokens => generated 2960 bytes in 24 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b55ef4-fbf1-4bdd-8984-2e1be779d02c None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b55ef4-fbf1-4bdd-8984-2e1be779d02c None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf87030a-8d9c-43f1-af3f-0554af813e4f None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf87030a-8d9c-43f1-af3f-0554af813e4f None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf87030a-8d9c-43f1-af3f-0554af813e4f None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf87030a-8d9c-43f1-af3f-0554af813e4f None admin] PATH_INFO: `/v3/domains` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf87030a-8d9c-43f1-af3f-0554af813e4f None admin] RBAC: Adding query filter params (name=Default) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf87030a-8d9c-43f1-af3f-0554af813e4f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf87030a-8d9c-43f1-af3f-0554af813e4f None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 686/1355] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 12:56:26 2024] POST /identity/v3/projects => generated 387 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29e7f97-8e2b-44f6-9c0b-438d28f75988 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 670/1356] 10.27.203.238 () {62 vars in 1220 bytes} [Tue May 28 12:56:26 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf87030a-8d9c-43f1-af3f-0554af813e4f None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf87030a-8d9c-43f1-af3f-0554af813e4f None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29e7f97-8e2b-44f6-9c0b-438d28f75988 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bba07cd-5a16-4fc3-9284-cfd7d768dfd7 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bba07cd-5a16-4fc3-9284-cfd7d768dfd7 None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bba07cd-5a16-4fc3-9284-cfd7d768dfd7 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bba07cd-5a16-4fc3-9284-cfd7d768dfd7 None admin] PATH_INFO: `/v3/users` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bba07cd-5a16-4fc3-9284-cfd7d768dfd7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bba07cd-5a16-4fc3-9284-cfd7d768dfd7 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73a0a28-98d9-466e-be67-ab4ac4f0fd16 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73a0a28-98d9-466e-be67-ab4ac4f0fd16 None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73a0a28-98d9-466e-be67-ab4ac4f0fd16 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-9bba07cd-5a16-4fc3-9284-cfd7d768dfd7 None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73a0a28-98d9-466e-be67-ab4ac4f0fd16 None admin] PATH_INFO: `/v3/projects` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73a0a28-98d9-466e-be67-ab4ac4f0fd16 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73a0a28-98d9-466e-be67-ab4ac4f0fd16 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:26 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b0b36f71-852d-463a-b1c8-4066ce824def tempest-ExportLocationsTest-1017217578 None] <<< [POST] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:56:26 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b0b36f71-852d-463a-b1c8-4066ce824def tempest-ExportLocationsTest-1017217578 None] Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=0, created='2024-05-28T12:56:26.373168Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='22ae3b95-a3e6-48fb-b74b-1172b78a702b', id=5, internal=False, is_s3_default_policy=False, name='83d10127-dfed-433a-90d1-4f0a7f981edc', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=[], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['*'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['*'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T12:56:26.706386Z', tenant_id=1, tenant_name='default', title='83d10127-dfed-433a-90d1-4f0a7f981edc', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/5/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[]) May 28 12:56:26 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b0b36f71-852d-463a-b1c8-4066ce824def tempest-ExportLocationsTest-1017217578 None] --- [POST] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 12:56:26 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b0b36f71-852d-463a-b1c8-4066ce824def tempest-ExportLocationsTest-1017217578 None] >>> [GET] https://127.0.0.1:40443/api/quotas/ May 28 12:56:26 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b0b36f71-852d-463a-b1c8-4066ce824def tempest-ExportLocationsTest-1017217578 None] {'allow_redirects': True, May 28 12:56:26 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b0b36f71-852d-463a-b1c8-4066ce824def tempest-ExportLocationsTest-1017217578 None] 'params': {'name': '83d10127-dfed-433a-90d1-4f0a7f981edc'}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 687/1357] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 12:56:26 2024] POST /identity/v3/users => generated 301 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bba07cd-5a16-4fc3-9284-cfd7d768dfd7 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bba07cd-5a16-4fc3-9284-cfd7d768dfd7 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 671/1358] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 12:56:26 2024] POST /identity/v3/projects => generated 407 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73a0a28-98d9-466e-be67-ab4ac4f0fd16 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd04ea1-1f39-4bfa-bb6f-2c3847551cb9 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd04ea1-1f39-4bfa-bb6f-2c3847551cb9 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd04ea1-1f39-4bfa-bb6f-2c3847551cb9 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd04ea1-1f39-4bfa-bb6f-2c3847551cb9 None admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd04ea1-1f39-4bfa-bb6f-2c3847551cb9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd04ea1-1f39-4bfa-bb6f-2c3847551cb9 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:26 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-3a47ce09-c8c0-4938-92e8-423050f78f81 tempest-AdminActionsTest-1749172189 None] <<< [GET] https://127.0.0.1:40443/api/quotas/ May 28 12:56:26 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-3a47ce09-c8c0-4938-92e8-423050f78f81 tempest-AdminActionsTest-1749172189 None] [] May 28 12:56:26 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-3a47ce09-c8c0-4938-92e8-423050f78f81 tempest-AdminActionsTest-1749172189 None] --- [GET] https://127.0.0.1:40443/api/quotas/: Done May 28 12:56:26 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-3a47ce09-c8c0-4938-92e8-423050f78f81 tempest-AdminActionsTest-1749172189 None] >>> [POST] https://127.0.0.1:40443/api/quotas/ May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73a0a28-98d9-466e-be67-ab4ac4f0fd16 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:26 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-3a47ce09-c8c0-4938-92e8-423050f78f81 tempest-AdminActionsTest-1749172189 None] {'data': '{"name": "77a25e6b-f137-4342-8eb9-9ced679515e2", "path": ' May 28 12:56:26 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-3a47ce09-c8c0-4938-92e8-423050f78f81 tempest-AdminActionsTest-1749172189 None] '"/manila/manila-77a25e6b-f137-4342-8eb9-9ced679515e2", "create_dir": ' May 28 12:56:26 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-3a47ce09-c8c0-4938-92e8-423050f78f81 tempest-AdminActionsTest-1749172189 None] 'true, "hard_limit": 1073741824}', May 28 12:56:26 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-3a47ce09-c8c0-4938-92e8-423050f78f81 tempest-AdminActionsTest-1749172189 None] 'json': None, May 28 12:56:26 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-3a47ce09-c8c0-4938-92e8-423050f78f81 tempest-AdminActionsTest-1749172189 None] 'params': None} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ebc135-c22e-4169-b5f2-4bed8c2dec1f None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ebc135-c22e-4169-b5f2-4bed8c2dec1f None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ebc135-c22e-4169-b5f2-4bed8c2dec1f None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ebc135-c22e-4169-b5f2-4bed8c2dec1f None admin] PATH_INFO: `/v3/users` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 688/1359] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 12:56:26 2024] GET /identity/v3/roles => generated 1680 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ebc135-c22e-4169-b5f2-4bed8c2dec1f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ebc135-c22e-4169-b5f2-4bed8c2dec1f None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd04ea1-1f39-4bfa-bb6f-2c3847551cb9 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-99ebc135-c22e-4169-b5f2-4bed8c2dec1f None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd04ea1-1f39-4bfa-bb6f-2c3847551cb9 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09af23dc-3c60-4e39-a070-1eb61b01827a None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09af23dc-3c60-4e39-a070-1eb61b01827a None admin] REQUEST_METHOD: `PUT` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09af23dc-3c60-4e39-a070-1eb61b01827a None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09af23dc-3c60-4e39-a070-1eb61b01827a None admin] PATH_INFO: `/v3/projects/aad888a9f2a84f389022db73cc1424a3/users/2a14b5073e084364801a58ca6689b9be/roles/e7989893488f483baa107be56668c4f8` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 672/1360] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 12:56:26 2024] POST /identity/v3/users => generated 311 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09af23dc-3c60-4e39-a070-1eb61b01827a None admin] RBAC: Authorizing `identity:create_grant(project_id=aad888a9f2a84f389022db73cc1424a3, user_id=2a14b5073e084364801a58ca6689b9be, role_id=e7989893488f483baa107be56668c4f8)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09af23dc-3c60-4e39-a070-1eb61b01827a None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ebc135-c22e-4169-b5f2-4bed8c2dec1f None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ebc135-c22e-4169-b5f2-4bed8c2dec1f None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fc70bb-9e91-4a0b-a232-8abf7e0c8877 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fc70bb-9e91-4a0b-a232-8abf7e0c8877 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fc70bb-9e91-4a0b-a232-8abf7e0c8877 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fc70bb-9e91-4a0b-a232-8abf7e0c8877 None admin] PATH_INFO: `/v3/roles` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fc70bb-9e91-4a0b-a232-8abf7e0c8877 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fc70bb-9e91-4a0b-a232-8abf7e0c8877 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 673/1361] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 12:56:26 2024] GET /identity/v3/roles => generated 1680 bytes in 15 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fc70bb-9e91-4a0b-a232-8abf7e0c8877 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 689/1362] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 12:56:26 2024] PUT /identity/v3/projects/aad888a9f2a84f389022db73cc1424a3/users/2a14b5073e084364801a58ca6689b9be/roles/e7989893488f483baa107be56668c4f8 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09af23dc-3c60-4e39-a070-1eb61b01827a None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fc70bb-9e91-4a0b-a232-8abf7e0c8877 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09af23dc-3c60-4e39-a070-1eb61b01827a None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ea9a07-07e8-4522-a811-21ff7f1ff37d None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ea9a07-07e8-4522-a811-21ff7f1ff37d None admin] REQUEST_METHOD: `PUT` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ea9a07-07e8-4522-a811-21ff7f1ff37d None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ea9a07-07e8-4522-a811-21ff7f1ff37d None admin] PATH_INFO: `/v3/projects/c2264365bbdd4560b06cc04deee5dbc4/users/43966c9b7c6046c98d943d31f23360b1/roles/e7989893488f483baa107be56668c4f8` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ff0013-a705-46ee-b9e7-52a84f0f3ef0 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ff0013-a705-46ee-b9e7-52a84f0f3ef0 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ff0013-a705-46ee-b9e7-52a84f0f3ef0 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ff0013-a705-46ee-b9e7-52a84f0f3ef0 None admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ff0013-a705-46ee-b9e7-52a84f0f3ef0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ff0013-a705-46ee-b9e7-52a84f0f3ef0 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 690/1363] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 12:56:26 2024] GET /identity/v3/roles => generated 1680 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ea9a07-07e8-4522-a811-21ff7f1ff37d None admin] RBAC: Authorizing `identity:create_grant(project_id=c2264365bbdd4560b06cc04deee5dbc4, user_id=43966c9b7c6046c98d943d31f23360b1, role_id=e7989893488f483baa107be56668c4f8)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ea9a07-07e8-4522-a811-21ff7f1ff37d None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ff0013-a705-46ee-b9e7-52a84f0f3ef0 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ff0013-a705-46ee-b9e7-52a84f0f3ef0 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1989d130-edf0-4a1d-84af-59af81605832 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1989d130-edf0-4a1d-84af-59af81605832 None admin] REQUEST_METHOD: `PUT` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1989d130-edf0-4a1d-84af-59af81605832 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1989d130-edf0-4a1d-84af-59af81605832 None admin] PATH_INFO: `/v3/projects/aad888a9f2a84f389022db73cc1424a3/users/2a14b5073e084364801a58ca6689b9be/roles/e7989893488f483baa107be56668c4f8` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1989d130-edf0-4a1d-84af-59af81605832 None admin] RBAC: Authorizing `identity:create_grant(project_id=aad888a9f2a84f389022db73cc1424a3, user_id=2a14b5073e084364801a58ca6689b9be, role_id=e7989893488f483baa107be56668c4f8)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1989d130-edf0-4a1d-84af-59af81605832 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 691/1364] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 12:56:26 2024] PUT /identity/v3/projects/aad888a9f2a84f389022db73cc1424a3/users/2a14b5073e084364801a58ca6689b9be/roles/e7989893488f483baa107be56668c4f8 => generated 0 bytes in 19 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbc7969-6e71-4231-9b89-5363e74c08cd None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbc7969-6e71-4231-9b89-5363e74c08cd None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbc7969-6e71-4231-9b89-5363e74c08cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-afbc7969-6e71-4231-9b89-5363e74c08cd None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 674/1365] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 12:56:26 2024] PUT /identity/v3/projects/c2264365bbdd4560b06cc04deee5dbc4/users/43966c9b7c6046c98d943d31f23360b1/roles/e7989893488f483baa107be56668c4f8 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ea9a07-07e8-4522-a811-21ff7f1ff37d None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-afbc7969-6e71-4231-9b89-5363e74c08cd None None] MFA Rules not processed for user `2a14b5073e084364801a58ca6689b9be`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:56:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-afbc7969-6e71-4231-9b89-5363e74c08cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ea9a07-07e8-4522-a811-21ff7f1ff37d None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13747c04-3b37-423e-9e4a-cdc108a4b588 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13747c04-3b37-423e-9e4a-cdc108a4b588 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13747c04-3b37-423e-9e4a-cdc108a4b588 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13747c04-3b37-423e-9e4a-cdc108a4b588 None admin] PATH_INFO: `/v3/roles` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13747c04-3b37-423e-9e4a-cdc108a4b588 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13747c04-3b37-423e-9e4a-cdc108a4b588 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:27 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 675/1366] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 12:56:26 2024] GET /identity/v3/roles => generated 1680 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:56:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13747c04-3b37-423e-9e4a-cdc108a4b588 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13747c04-3b37-423e-9e4a-cdc108a4b588 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78208604-19e3-49d5-8c03-de1729816e22 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78208604-19e3-49d5-8c03-de1729816e22 None admin] REQUEST_METHOD: `PUT` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:27 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 692/1367] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:56:26 2024] POST /identity/v3/auth/tokens => generated 4081 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 28 12:56:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78208604-19e3-49d5-8c03-de1729816e22 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78208604-19e3-49d5-8c03-de1729816e22 None admin] PATH_INFO: `/v3/projects/c2264365bbdd4560b06cc04deee5dbc4/users/43966c9b7c6046c98d943d31f23360b1/roles/e7989893488f483baa107be56668c4f8` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78208604-19e3-49d5-8c03-de1729816e22 None admin] RBAC: Authorizing `identity:create_grant(project_id=c2264365bbdd4560b06cc04deee5dbc4, user_id=43966c9b7c6046c98d943d31f23360b1, role_id=e7989893488f483baa107be56668c4f8)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78208604-19e3-49d5-8c03-de1729816e22 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d8b3b4-a9ea-4d18-85e7-ef42e1bb1fb6 None None] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d8b3b4-a9ea-4d18-85e7-ef42e1bb1fb6 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d8b3b4-a9ea-4d18-85e7-ef42e1bb1fb6 None None] PATH_INFO: `/` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:27 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 693/1368] 10.27.203.238 () {58 vars in 1052 bytes} [Tue May 28 12:56:27 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:56:27 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 676/1369] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 12:56:27 2024] PUT /identity/v3/projects/c2264365bbdd4560b06cc04deee5dbc4/users/43966c9b7c6046c98d943d31f23360b1/roles/e7989893488f483baa107be56668c4f8 => generated 0 bytes in 21 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:56:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da4996e-fe85-4528-8de3-7f0da3510744 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da4996e-fe85-4528-8de3-7f0da3510744 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da4996e-fe85-4528-8de3-7f0da3510744 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba6043d-31de-4eb0-b488-16684594cbc9 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba6043d-31de-4eb0-b488-16684594cbc9 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba6043d-31de-4eb0-b488-16684594cbc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:27 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-2da4996e-fe85-4528-8de3-7f0da3510744 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:56:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-2da4996e-fe85-4528-8de3-7f0da3510744 None None] MFA Rules not processed for user `f110cf6300f049c897d0aab63218d1e5`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:56:27 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-5ba6043d-31de-4eb0-b488-16684594cbc9 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:56:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-2da4996e-fe85-4528-8de3-7f0da3510744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-5ba6043d-31de-4eb0-b488-16684594cbc9 None None] MFA Rules not processed for user `43966c9b7c6046c98d943d31f23360b1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:56:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-5ba6043d-31de-4eb0-b488-16684594cbc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:27 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 694/1370] 10.27.203.238 () {62 vars in 1149 bytes} [Tue May 28 12:56:27 2024] POST /identity/v3/auth/tokens => generated 3809 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 28 12:56:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da4996e-fe85-4528-8de3-7f0da3510744 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da4996e-fe85-4528-8de3-7f0da3510744 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518a6575-be1d-4bd1-8754-e4afef84e00f service manila] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f110cf6300f049c897d0aab63218d1e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518a6575-be1d-4bd1-8754-e4afef84e00f service manila] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518a6575-be1d-4bd1-8754-e4afef84e00f service manila] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518a6575-be1d-4bd1-8754-e4afef84e00f service manila] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:27 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 677/1371] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:56:27 2024] POST /identity/v3/auth/tokens => generated 4101 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 28 12:56:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba6043d-31de-4eb0-b488-16684594cbc9 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba6043d-31de-4eb0-b488-16684594cbc9 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd741ec-cc23-4cac-b695-59b82105494a None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd741ec-cc23-4cac-b695-59b82105494a None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd741ec-cc23-4cac-b695-59b82105494a None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd741ec-cc23-4cac-b695-59b82105494a None admin] PATH_INFO: `/v3/users/43966c9b7c6046c98d943d31f23360b1` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd741ec-cc23-4cac-b695-59b82105494a None admin] RBAC: Authorizing `identity:delete_user(user_id=43966c9b7c6046c98d943d31f23360b1)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518a6575-be1d-4bd1-8754-e4afef84e00f service manila] RBAC: Authorizing `identity:validate_token()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd741ec-cc23-4cac-b695-59b82105494a None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518a6575-be1d-4bd1-8754-e4afef84e00f service manila] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:27 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 695/1372] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 12:56:27 2024] GET /identity/v3/auth/tokens => generated 4081 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 28 12:56:27 l75lg1-v1 sudo[98759]: pam_unix(sudo:session): session closed for user root May 28 12:56:27 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.494s {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:428}} May 28 12:56:27 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:390}} May 28 12:56:27 l75lg1-v1 sudo[98762]: vastdata : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 May 28 12:56:27 l75lg1-v1 sudo[98762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) May 28 12:56:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-9fd741ec-cc23-4cac-b695-59b82105494a None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43966c9b7c6046c98d943d31f23360b1', 'request_id': 'req-9fd741ec-cc23-4cac-b695-59b82105494a'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-9fd741ec-cc23-4cac-b695-59b82105494a None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43966c9b7c6046c98d943d31f23360b1', 'request_id': 'req-9fd741ec-cc23-4cac-b695-59b82105494a'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:27 l75lg1-v1 dstat.sh[49771]: 28-05 12:56:27| 26 4 67 2 0|5625M 1888M 277M 7836M| 23k 5244B| 640k 8828k|5.00 930 | 12k 21k|1.76 0.96 0.98|4.0 0 6.0| 0 0 | 0 2048M| 29 341 0 30 0 May 28 12:56:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-9fd741ec-cc23-4cac-b695-59b82105494a None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43966c9b7c6046c98d943d31f23360b1', 'request_id': 'req-9fd741ec-cc23-4cac-b695-59b82105494a'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-9fd741ec-cc23-4cac-b695-59b82105494a None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43966c9b7c6046c98d943d31f23360b1', 'request_id': 'req-9fd741ec-cc23-4cac-b695-59b82105494a'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-9fd741ec-cc23-4cac-b695-59b82105494a None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43966c9b7c6046c98d943d31f23360b1', 'request_id': 'req-9fd741ec-cc23-4cac-b695-59b82105494a'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:27 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b0b36f71-852d-463a-b1c8-4066ce824def tempest-ExportLocationsTest-1017217578 None] <<< [GET] https://127.0.0.1:40443/api/quotas/ May 28 12:56:27 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b0b36f71-852d-463a-b1c8-4066ce824def tempest-ExportLocationsTest-1017217578 None] [] May 28 12:56:27 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b0b36f71-852d-463a-b1c8-4066ce824def tempest-ExportLocationsTest-1017217578 None] --- [GET] https://127.0.0.1:40443/api/quotas/: Done May 28 12:56:27 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b0b36f71-852d-463a-b1c8-4066ce824def tempest-ExportLocationsTest-1017217578 None] >>> [POST] https://127.0.0.1:40443/api/quotas/ May 28 12:56:27 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b0b36f71-852d-463a-b1c8-4066ce824def tempest-ExportLocationsTest-1017217578 None] {'data': '{"name": "83d10127-dfed-433a-90d1-4f0a7f981edc", "path": ' May 28 12:56:27 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b0b36f71-852d-463a-b1c8-4066ce824def tempest-ExportLocationsTest-1017217578 None] '"/manila/manila-83d10127-dfed-433a-90d1-4f0a7f981edc", "create_dir": ' May 28 12:56:27 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b0b36f71-852d-463a-b1c8-4066ce824def tempest-ExportLocationsTest-1017217578 None] 'true, "hard_limit": 1073741824}', May 28 12:56:27 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b0b36f71-852d-463a-b1c8-4066ce824def tempest-ExportLocationsTest-1017217578 None] 'json': None, May 28 12:56:27 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b0b36f71-852d-463a-b1c8-4066ce824def tempest-ExportLocationsTest-1017217578 None] 'params': None} May 28 12:56:27 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 678/1373] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 12:56:27 2024] DELETE /identity/v3/users/43966c9b7c6046c98d943d31f23360b1 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:56:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d370a27-2cea-4c67-bb89-4ed0d8bdf854 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d370a27-2cea-4c67-bb89-4ed0d8bdf854 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d370a27-2cea-4c67-bb89-4ed0d8bdf854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:27 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-1d370a27-2cea-4c67-bb89-4ed0d8bdf854 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:56:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-1d370a27-2cea-4c67-bb89-4ed0d8bdf854 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:56:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-1d370a27-2cea-4c67-bb89-4ed0d8bdf854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:27 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 696/1374] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:56:27 2024] POST /identity/v3/auth/tokens => generated 2960 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 12:56:27 l75lg1-v1 neutron-server[77619]: DEBUG neutron.wsgi [-] (77619) accepted ('10.27.203.238', 55970) {{(pid=77619) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 12:56:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd741ec-cc23-4cac-b695-59b82105494a None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-9fd741ec-cc23-4cac-b695-59b82105494a None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd741ec-cc23-4cac-b695-59b82105494a None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cd392c-9cfe-41a9-acd9-858ab54308b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef17047035e4b518fd5360a01f2da1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cd392c-9cfe-41a9-acd9-858ab54308b1 service neutron] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cd392c-9cfe-41a9-acd9-858ab54308b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cd392c-9cfe-41a9-acd9-858ab54308b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cd392c-9cfe-41a9-acd9-858ab54308b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cd392c-9cfe-41a9-acd9-858ab54308b1 service neutron] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:27 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 679/1375] 10.27.203.238 () {64 vars in 1432 bytes} [Tue May 28 12:56:27 2024] GET /identity/v3/auth/tokens => generated 2960 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 28 12:56:27 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-5b301749-2f66-4b1c-acd6-5c25d5f53538 tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] POST http://10.27.203.238/share/v1/aad888a9f2a84f389022db73cc1424a3/security-services May 28 12:56:27 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-5b301749-2f66-4b1c-acd6-5c25d5f53538 tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] Action: 'create', calling method: SecurityServiceController.create, body: {"security_service": {"type": "ldap", "name": "ss_ldap", "dns_ip": "1.1.1.1", "server": "fake_server_1", "domain": "fake_domain_1", "user": "fake_user", "password": "***"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:56:27 l75lg1-v1 neutron-server[77619]: INFO neutron.wsgi [None req-cd3287d9-6b1e-4966-8811-553aa03178a3 None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=c2264365bbdd4560b06cc04deee5dbc4&name=default HTTP/1.1" status: 200 len: 216 time: 0.0887549 May 28 12:56:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d370a27-2cea-4c67-bb89-4ed0d8bdf854 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-1d370a27-2cea-4c67-bb89-4ed0d8bdf854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:27 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-5b301749-2f66-4b1c-acd6-5c25d5f53538 tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] http://10.27.203.238/share/v1/aad888a9f2a84f389022db73cc1424a3/security-services returned with HTTP 200 May 28 12:56:27 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 5/25] 10.27.203.238 () {64 vars in 1352 bytes} [Tue May 28 12:56:27 2024] POST /share/v1/aad888a9f2a84f389022db73cc1424a3/security-services => generated 371 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:56:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d370a27-2cea-4c67-bb89-4ed0d8bdf854 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eed86b8-32f3-49c3-b96f-aa8ba98f06bb None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eed86b8-32f3-49c3-b96f-aa8ba98f06bb None admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eed86b8-32f3-49c3-b96f-aa8ba98f06bb None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eed86b8-32f3-49c3-b96f-aa8ba98f06bb None admin] PATH_INFO: `/v3/projects/c2264365bbdd4560b06cc04deee5dbc4` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eed86b8-32f3-49c3-b96f-aa8ba98f06bb None admin] RBAC: Authorizing `identity:delete_project(project_id=c2264365bbdd4560b06cc04deee5dbc4)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eed86b8-32f3-49c3-b96f-aa8ba98f06bb None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-5eed86b8-32f3-49c3-b96f-aa8ba98f06bb None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2264365bbdd4560b06cc04deee5dbc4', 'request_id': 'req-5eed86b8-32f3-49c3-b96f-aa8ba98f06bb'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-5eed86b8-32f3-49c3-b96f-aa8ba98f06bb None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2264365bbdd4560b06cc04deee5dbc4', 'request_id': 'req-5eed86b8-32f3-49c3-b96f-aa8ba98f06bb'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-5eed86b8-32f3-49c3-b96f-aa8ba98f06bb None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2264365bbdd4560b06cc04deee5dbc4', 'request_id': 'req-5eed86b8-32f3-49c3-b96f-aa8ba98f06bb'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-5eed86b8-32f3-49c3-b96f-aa8ba98f06bb None admin] The token cache is being invalidate because project c2264365bbdd4560b06cc04deee5dbc4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 12:56:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-5eed86b8-32f3-49c3-b96f-aa8ba98f06bb None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-5eed86b8-32f3-49c3-b96f-aa8ba98f06bb None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:27 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 697/1376] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 12:56:27 2024] DELETE /identity/v3/projects/c2264365bbdd4560b06cc04deee5dbc4 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:56:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63054509-75ef-4a93-8b2a-6d90647caa1b None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63054509-75ef-4a93-8b2a-6d90647caa1b None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63054509-75ef-4a93-8b2a-6d90647caa1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:27 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-63054509-75ef-4a93-8b2a-6d90647caa1b None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:56:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-63054509-75ef-4a93-8b2a-6d90647caa1b None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:56:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-63054509-75ef-4a93-8b2a-6d90647caa1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:27 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 680/1377] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:56:27 2024] POST /identity/v3/auth/tokens => generated 312 bytes in 19 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 28 12:56:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6418676-43e5-4f27-bcd8-19bf7f4ca386 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6418676-43e5-4f27-bcd8-19bf7f4ca386 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6418676-43e5-4f27-bcd8-19bf7f4ca386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:27 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-17ec4757-1b28-4783-a903-a1da007b9343 tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] POST http://10.27.203.238/share/v1/aad888a9f2a84f389022db73cc1424a3/security-services May 28 12:56:27 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-17ec4757-1b28-4783-a903-a1da007b9343 tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] Action: 'create', calling method: SecurityServiceController.create, body: {"security_service": {"type": "kerberos", "name": "ss_kerberos", "dns_ip": "2.2.2.2", "server": "fake_server_2", "domain": "fake_domain_2", "user": "test_user", "password": "***"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:56:27 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-d6418676-43e5-4f27-bcd8-19bf7f4ca386 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:56:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-d6418676-43e5-4f27-bcd8-19bf7f4ca386 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:56:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-d6418676-43e5-4f27-bcd8-19bf7f4ca386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:27 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-17ec4757-1b28-4783-a903-a1da007b9343 tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] http://10.27.203.238/share/v1/aad888a9f2a84f389022db73cc1424a3/security-services returned with HTTP 200 May 28 12:56:27 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 21/26] 10.27.203.238 () {64 vars in 1352 bytes} [Tue May 28 12:56:27 2024] POST /share/v1/aad888a9f2a84f389022db73cc1424a3/security-services => generated 379 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:56:27 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-b99e98d7-dbe7-4452-af5e-763a52b8750b tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] GET http://10.27.203.238/share/v1/aad888a9f2a84f389022db73cc1424a3/security-services May 28 12:56:27 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-b99e98d7-dbe7-4452-af5e-763a52b8750b tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:27 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-b99e98d7-dbe7-4452-af5e-763a52b8750b tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] Calling method 'SecurityServiceController.index' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:27 l75lg1-v1 sudo[98762]: pam_unix(sudo:session): session closed for user root May 28 12:56:27 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.458s {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:428}} May 28 12:56:27 l75lg1-v1 cinder-volume[85846]: DEBUG cinder.manager [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] Notifying Schedulers of capabilities ... {{(pid=85846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 28 12:56:27 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 698/1378] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:56:27 2024] POST /identity/v3/auth/tokens => generated 2960 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 12:56:27 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-b99e98d7-dbe7-4452-af5e-763a52b8750b tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] http://10.27.203.238/share/v1/aad888a9f2a84f389022db73cc1424a3/security-services returned with HTTP 200 May 28 12:56:27 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 6/27] 10.27.203.238 () {62 vars in 1330 bytes} [Tue May 28 12:56:27 2024] GET /share/v1/aad888a9f2a84f389022db73cc1424a3/security-services => generated 231 bytes in 13 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:56:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63054509-75ef-4a93-8b2a-6d90647caa1b None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:27 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.scheduler.host_manager [None req-0a9aa82b-04bd-4131-b2bb-134ed8441a69 None None] Received volume service update from l75lg1-v1@lvmdriver-1: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:l75lg1-v1:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up', 'allocated_capacity_gb': 0, 'cacheable': True}], 'shared_targets': False, 'sparse_copy_volume': True, 'filter_function': None, 'goodness_function': None} {{(pid=85128) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:628}} May 28 12:56:27 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-d83d8eae-3f27-4ad0-b383-78f0b676933c tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] DELETE http://10.27.203.238/share/v1/aad888a9f2a84f389022db73cc1424a3/security-services/2aec6c13-cc77-4ea0-8325-253f717d87a1 May 28 12:56:27 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-d83d8eae-3f27-4ad0-b383-78f0b676933c tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:27 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-d83d8eae-3f27-4ad0-b383-78f0b676933c tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] Calling method 'SecurityServiceController.delete' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:27 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.v1.security_service [None req-d83d8eae-3f27-4ad0-b383-78f0b676933c tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] Delete security service with id: 2aec6c13-cc77-4ea0-8325-253f717d87a1 May 28 12:56:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63054509-75ef-4a93-8b2a-6d90647caa1b None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58c2ab9-8dcd-4146-bd15-22f19cc4a0e4 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58c2ab9-8dcd-4146-bd15-22f19cc4a0e4 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58c2ab9-8dcd-4146-bd15-22f19cc4a0e4 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58c2ab9-8dcd-4146-bd15-22f19cc4a0e4 None admin] PATH_INFO: `/v3/domains` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58c2ab9-8dcd-4146-bd15-22f19cc4a0e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:56:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58c2ab9-8dcd-4146-bd15-22f19cc4a0e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58c2ab9-8dcd-4146-bd15-22f19cc4a0e4 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:27 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 681/1379] 10.27.203.238 () {62 vars in 1220 bytes} [Tue May 28 12:56:27 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:56:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6418676-43e5-4f27-bcd8-19bf7f4ca386 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6418676-43e5-4f27-bcd8-19bf7f4ca386 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:27 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-fc403043-74e2-4b87-a388-18694293b445 tempest-AdminActionsNegativeTest-763023849 None] <<< [POST] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:56:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b164ba6e-00f1-4cf9-ac7b-a7fa5d944bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:27 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-fc403043-74e2-4b87-a388-18694293b445 tempest-AdminActionsNegativeTest-763023849 None] Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=0, created='2024-05-28T12:56:27.043058Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='df7184f7-8dea-4f79-a7b5-b5704f7a5e52', id=6, internal=False, is_s3_default_policy=False, name='5ae9ae15-dc00-44c8-891a-9758f2b29855', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=[], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['*'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['*'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T12:56:27.624226Z', tenant_id=1, tenant_name='default', title='5ae9ae15-dc00-44c8-891a-9758f2b29855', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/6/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[]) May 28 12:56:27 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-fc403043-74e2-4b87-a388-18694293b445 tempest-AdminActionsNegativeTest-763023849 None] --- [POST] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 12:56:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b164ba6e-00f1-4cf9-ac7b-a7fa5d944bc7 None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:27 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-fc403043-74e2-4b87-a388-18694293b445 tempest-AdminActionsNegativeTest-763023849 None] >>> [GET] https://127.0.0.1:40443/api/quotas/ May 28 12:56:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b164ba6e-00f1-4cf9-ac7b-a7fa5d944bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b164ba6e-00f1-4cf9-ac7b-a7fa5d944bc7 None admin] PATH_INFO: `/v3/projects` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:27 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-fc403043-74e2-4b87-a388-18694293b445 tempest-AdminActionsNegativeTest-763023849 None] {'allow_redirects': True, May 28 12:56:27 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-fc403043-74e2-4b87-a388-18694293b445 tempest-AdminActionsNegativeTest-763023849 None] 'params': {'name': '5ae9ae15-dc00-44c8-891a-9758f2b29855'}} May 28 12:56:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b164ba6e-00f1-4cf9-ac7b-a7fa5d944bc7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b164ba6e-00f1-4cf9-ac7b-a7fa5d944bc7 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:27 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-d83d8eae-3f27-4ad0-b383-78f0b676933c tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] http://10.27.203.238/share/v1/aad888a9f2a84f389022db73cc1424a3/security-services/2aec6c13-cc77-4ea0-8325-253f717d87a1 returned with HTTP 202 May 28 12:56:27 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 22/28] 10.27.203.238 () {62 vars in 1444 bytes} [Tue May 28 12:56:27 2024] DELETE /share/v1/aad888a9f2a84f389022db73cc1424a3/security-services/2aec6c13-cc77-4ea0-8325-253f717d87a1 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 6 headers in 242 bytes (1 switches on core 0) May 28 12:56:27 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-ce85628e-2d72-4a90-87fa-1a04710ac332 tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] GET http://10.27.203.238/share/v1/aad888a9f2a84f389022db73cc1424a3/security-services/2aec6c13-cc77-4ea0-8325-253f717d87a1 May 28 12:56:27 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-ce85628e-2d72-4a90-87fa-1a04710ac332 tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:27 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-ce85628e-2d72-4a90-87fa-1a04710ac332 tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] Calling method 'SecurityServiceController.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:27 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-ce85628e-2d72-4a90-87fa-1a04710ac332 tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] HTTP exception thrown: The resource could not be found. May 28 12:56:27 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-ce85628e-2d72-4a90-87fa-1a04710ac332 tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] http://10.27.203.238/share/v1/aad888a9f2a84f389022db73cc1424a3/security-services/2aec6c13-cc77-4ea0-8325-253f717d87a1 returned with HTTP 404 May 28 12:56:27 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 7/29] 10.27.203.238 () {62 vars in 1441 bytes} [Tue May 28 12:56:27 2024] GET /share/v1/aad888a9f2a84f389022db73cc1424a3/security-services/2aec6c13-cc77-4ea0-8325-253f717d87a1 => generated 78 bytes in 9 msecs (HTTP/1.1 404) 6 headers in 236 bytes (1 switches on core 0) May 28 12:56:27 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 699/1380] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 12:56:27 2024] POST /identity/v3/projects => generated 405 bytes in 36 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:56:27 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-a0ebc208-c829-4d5f-95ad-bf5a2999e155 tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] DELETE http://10.27.203.238/share/v1/aad888a9f2a84f389022db73cc1424a3/security-services/f18fa27f-01af-4574-b730-b63fb70e3b8f May 28 12:56:27 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-a0ebc208-c829-4d5f-95ad-bf5a2999e155 tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58c2ab9-8dcd-4146-bd15-22f19cc4a0e4 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:27 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-a0ebc208-c829-4d5f-95ad-bf5a2999e155 tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] Calling method 'SecurityServiceController.delete' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:27 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.v1.security_service [None req-a0ebc208-c829-4d5f-95ad-bf5a2999e155 tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] Delete security service with id: f18fa27f-01af-4574-b730-b63fb70e3b8f May 28 12:56:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58c2ab9-8dcd-4146-bd15-22f19cc4a0e4 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:27 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-a0ebc208-c829-4d5f-95ad-bf5a2999e155 tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] http://10.27.203.238/share/v1/aad888a9f2a84f389022db73cc1424a3/security-services/f18fa27f-01af-4574-b730-b63fb70e3b8f returned with HTTP 202 May 28 12:56:27 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 23/30] 10.27.203.238 () {62 vars in 1444 bytes} [Tue May 28 12:56:27 2024] DELETE /share/v1/aad888a9f2a84f389022db73cc1424a3/security-services/f18fa27f-01af-4574-b730-b63fb70e3b8f => generated 0 bytes in 32 msecs (HTTP/1.1 202) 6 headers in 242 bytes (1 switches on core 0) May 28 12:56:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f75e99b-cde4-4b91-a333-1f10882ec256 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f75e99b-cde4-4b91-a333-1f10882ec256 None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f75e99b-cde4-4b91-a333-1f10882ec256 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f75e99b-cde4-4b91-a333-1f10882ec256 None admin] PATH_INFO: `/v3/users` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f75e99b-cde4-4b91-a333-1f10882ec256 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f75e99b-cde4-4b91-a333-1f10882ec256 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:27 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-ecd08217-09ee-4a79-8079-69abfb200d6e tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] GET http://10.27.203.238/share/v1/aad888a9f2a84f389022db73cc1424a3/security-services/f18fa27f-01af-4574-b730-b63fb70e3b8f May 28 12:56:27 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-ecd08217-09ee-4a79-8079-69abfb200d6e tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:27 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-ecd08217-09ee-4a79-8079-69abfb200d6e tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] Calling method 'SecurityServiceController.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:27 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-1f75e99b-cde4-4b91-a333-1f10882ec256 None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 12:56:27 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-ecd08217-09ee-4a79-8079-69abfb200d6e tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] HTTP exception thrown: The resource could not be found. May 28 12:56:27 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-ecd08217-09ee-4a79-8079-69abfb200d6e tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] http://10.27.203.238/share/v1/aad888a9f2a84f389022db73cc1424a3/security-services/f18fa27f-01af-4574-b730-b63fb70e3b8f returned with HTTP 404 May 28 12:56:27 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 8/31] 10.27.203.238 () {62 vars in 1441 bytes} [Tue May 28 12:56:27 2024] GET /share/v1/aad888a9f2a84f389022db73cc1424a3/security-services/f18fa27f-01af-4574-b730-b63fb70e3b8f => generated 78 bytes in 8 msecs (HTTP/1.1 404) 6 headers in 236 bytes (1 switches on core 0) May 28 12:56:27 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-4200c555-b702-4bca-b505-0f9695325a30 tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] POST http://10.27.203.238/share/v1/aad888a9f2a84f389022db73cc1424a3/security-services May 28 12:56:27 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-4200c555-b702-4bca-b505-0f9695325a30 tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] Action: 'create', calling method: SecurityServiceController.create, body: {"security_service": {"type": "ldap", "name": "ss_ldap", "dns_ip": "1.1.1.1", "server": "fake_server_1", "domain": "fake_domain_1", "user": "fake_user", "password": "***"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:56:27 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 682/1381] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 12:56:27 2024] POST /identity/v3/users => generated 310 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:56:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b164ba6e-00f1-4cf9-ac7b-a7fa5d944bc7 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:27 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-4200c555-b702-4bca-b505-0f9695325a30 tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] http://10.27.203.238/share/v1/aad888a9f2a84f389022db73cc1424a3/security-services returned with HTTP 200 May 28 12:56:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b164ba6e-00f1-4cf9-ac7b-a7fa5d944bc7 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:27 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 24/32] 10.27.203.238 () {64 vars in 1352 bytes} [Tue May 28 12:56:27 2024] POST /share/v1/aad888a9f2a84f389022db73cc1424a3/security-services => generated 371 bytes in 19 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:56:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f400d4-10ef-4bcd-91f0-e5cc3fb3b991 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f400d4-10ef-4bcd-91f0-e5cc3fb3b991 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f400d4-10ef-4bcd-91f0-e5cc3fb3b991 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f400d4-10ef-4bcd-91f0-e5cc3fb3b991 None admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f400d4-10ef-4bcd-91f0-e5cc3fb3b991 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:27 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-b6071e65-a09a-4001-a3bc-f18f3733a045 tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] POST http://10.27.203.238/share/v1/aad888a9f2a84f389022db73cc1424a3/security-services May 28 12:56:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f400d4-10ef-4bcd-91f0-e5cc3fb3b991 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:27 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-b6071e65-a09a-4001-a3bc-f18f3733a045 tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] Action: 'create', calling method: SecurityServiceController.create, body: {"security_service": {"type": "kerberos", "name": "ss_kerberos", "dns_ip": "2.2.2.2", "server": "fake_server_2", "domain": "fake_domain_2", "user": "test_user", "password": "***"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:56:27 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 700/1382] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 12:56:27 2024] GET /identity/v3/roles => generated 1680 bytes in 18 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:56:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f75e99b-cde4-4b91-a333-1f10882ec256 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f75e99b-cde4-4b91-a333-1f10882ec256 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:27 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-b6071e65-a09a-4001-a3bc-f18f3733a045 tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] http://10.27.203.238/share/v1/aad888a9f2a84f389022db73cc1424a3/security-services returned with HTTP 200 May 28 12:56:27 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 9/33] 10.27.203.238 () {64 vars in 1352 bytes} [Tue May 28 12:56:27 2024] POST /share/v1/aad888a9f2a84f389022db73cc1424a3/security-services => generated 379 bytes in 19 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:56:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c480bcb0-c20e-45bb-9cb7-3879525d1fdd None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c480bcb0-c20e-45bb-9cb7-3879525d1fdd None admin] REQUEST_METHOD: `PUT` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c480bcb0-c20e-45bb-9cb7-3879525d1fdd None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c480bcb0-c20e-45bb-9cb7-3879525d1fdd None admin] PATH_INFO: `/v3/projects/9a18b6f332ad4f09b5fcc66fa2715ca5/users/3dfc7bfaf8e1490faa53aed3f9e45fdf/roles/e7989893488f483baa107be56668c4f8` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:27 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-69d480e9-e5fe-4e4b-bf9b-9eb621b52441 tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] GET http://10.27.203.238/share/v1/aad888a9f2a84f389022db73cc1424a3/security-services?all_tenants=1 May 28 12:56:27 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-69d480e9-e5fe-4e4b-bf9b-9eb621b52441 tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:27 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-69d480e9-e5fe-4e4b-bf9b-9eb621b52441 tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] Calling method 'SecurityServiceController.index' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:27 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-69d480e9-e5fe-4e4b-bf9b-9eb621b52441 tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] http://10.27.203.238/share/v1/aad888a9f2a84f389022db73cc1424a3/security-services?all_tenants=1 returned with HTTP 200 May 28 12:56:27 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 25/34] 10.27.203.238 () {62 vars in 1357 bytes} [Tue May 28 12:56:27 2024] GET /share/v1/aad888a9f2a84f389022db73cc1424a3/security-services?all_tenants=1 => generated 231 bytes in 11 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:56:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c480bcb0-c20e-45bb-9cb7-3879525d1fdd None admin] RBAC: Authorizing `identity:create_grant(project_id=9a18b6f332ad4f09b5fcc66fa2715ca5, user_id=3dfc7bfaf8e1490faa53aed3f9e45fdf, role_id=e7989893488f483baa107be56668c4f8)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c480bcb0-c20e-45bb-9cb7-3879525d1fdd None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:27 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-9f3b2e4c-dccc-464a-ac22-8b30c1c8f24b tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] DELETE http://10.27.203.238/share/v1/aad888a9f2a84f389022db73cc1424a3/security-services/b96f9b99-f768-4b78-a295-6ca8873de397 May 28 12:56:27 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-9f3b2e4c-dccc-464a-ac22-8b30c1c8f24b tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:27 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-9f3b2e4c-dccc-464a-ac22-8b30c1c8f24b tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] Calling method 'SecurityServiceController.delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:27 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.v1.security_service [None req-9f3b2e4c-dccc-464a-ac22-8b30c1c8f24b tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] Delete security service with id: b96f9b99-f768-4b78-a295-6ca8873de397 May 28 12:56:27 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 683/1383] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 12:56:27 2024] PUT /identity/v3/projects/9a18b6f332ad4f09b5fcc66fa2715ca5/users/3dfc7bfaf8e1490faa53aed3f9e45fdf/roles/e7989893488f483baa107be56668c4f8 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:56:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f400d4-10ef-4bcd-91f0-e5cc3fb3b991 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f400d4-10ef-4bcd-91f0-e5cc3fb3b991 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:27 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-9f3b2e4c-dccc-464a-ac22-8b30c1c8f24b tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] http://10.27.203.238/share/v1/aad888a9f2a84f389022db73cc1424a3/security-services/b96f9b99-f768-4b78-a295-6ca8873de397 returned with HTTP 202 May 28 12:56:27 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 10/35] 10.27.203.238 () {62 vars in 1444 bytes} [Tue May 28 12:56:27 2024] DELETE /share/v1/aad888a9f2a84f389022db73cc1424a3/security-services/b96f9b99-f768-4b78-a295-6ca8873de397 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 6 headers in 242 bytes (1 switches on core 0) May 28 12:56:27 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-497258a1-03c7-47cd-b537-ce0e16120ead tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] GET http://10.27.203.238/share/v1/aad888a9f2a84f389022db73cc1424a3/security-services/b96f9b99-f768-4b78-a295-6ca8873de397 May 28 12:56:27 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-497258a1-03c7-47cd-b537-ce0e16120ead tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:27 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-497258a1-03c7-47cd-b537-ce0e16120ead tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] Calling method 'SecurityServiceController.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:27 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-497258a1-03c7-47cd-b537-ce0e16120ead tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] HTTP exception thrown: The resource could not be found. May 28 12:56:27 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-497258a1-03c7-47cd-b537-ce0e16120ead tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] http://10.27.203.238/share/v1/aad888a9f2a84f389022db73cc1424a3/security-services/b96f9b99-f768-4b78-a295-6ca8873de397 returned with HTTP 404 May 28 12:56:27 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 26/36] 10.27.203.238 () {62 vars in 1441 bytes} [Tue May 28 12:56:27 2024] GET /share/v1/aad888a9f2a84f389022db73cc1424a3/security-services/b96f9b99-f768-4b78-a295-6ca8873de397 => generated 78 bytes in 9 msecs (HTTP/1.1 404) 6 headers in 236 bytes (1 switches on core 0) May 28 12:56:27 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-9c6ce7e0-677c-4f49-a9ec-24ad0bd9b9e0 tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] DELETE http://10.27.203.238/share/v1/aad888a9f2a84f389022db73cc1424a3/security-services/6b50079e-2ec0-4eb5-b940-46784b41555f May 28 12:56:27 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-9c6ce7e0-677c-4f49-a9ec-24ad0bd9b9e0 tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:27 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-9c6ce7e0-677c-4f49-a9ec-24ad0bd9b9e0 tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] Calling method 'SecurityServiceController.delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:27 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.v1.security_service [None req-9c6ce7e0-677c-4f49-a9ec-24ad0bd9b9e0 tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] Delete security service with id: 6b50079e-2ec0-4eb5-b940-46784b41555f May 28 12:56:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb589a6-8d9b-4f1c-ae65-a5282ade32dc None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb589a6-8d9b-4f1c-ae65-a5282ade32dc None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb589a6-8d9b-4f1c-ae65-a5282ade32dc None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb589a6-8d9b-4f1c-ae65-a5282ade32dc None admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb589a6-8d9b-4f1c-ae65-a5282ade32dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb589a6-8d9b-4f1c-ae65-a5282ade32dc None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:27 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 701/1384] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 12:56:27 2024] GET /identity/v3/roles => generated 1680 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:56:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c480bcb0-c20e-45bb-9cb7-3879525d1fdd None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:27 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-9c6ce7e0-677c-4f49-a9ec-24ad0bd9b9e0 tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] http://10.27.203.238/share/v1/aad888a9f2a84f389022db73cc1424a3/security-services/6b50079e-2ec0-4eb5-b940-46784b41555f returned with HTTP 202 May 28 12:56:27 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 11/37] 10.27.203.238 () {62 vars in 1444 bytes} [Tue May 28 12:56:27 2024] DELETE /share/v1/aad888a9f2a84f389022db73cc1424a3/security-services/6b50079e-2ec0-4eb5-b940-46784b41555f => generated 0 bytes in 29 msecs (HTTP/1.1 202) 6 headers in 242 bytes (1 switches on core 0) May 28 12:56:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c480bcb0-c20e-45bb-9cb7-3879525d1fdd None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacf92f6-560c-4f2f-985c-90312e8f9dd9 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacf92f6-560c-4f2f-985c-90312e8f9dd9 None admin] REQUEST_METHOD: `PUT` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacf92f6-560c-4f2f-985c-90312e8f9dd9 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacf92f6-560c-4f2f-985c-90312e8f9dd9 None admin] PATH_INFO: `/v3/projects/9a18b6f332ad4f09b5fcc66fa2715ca5/users/3dfc7bfaf8e1490faa53aed3f9e45fdf/roles/e7989893488f483baa107be56668c4f8` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:27 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-a8eef533-7820-417c-ac71-ece489a41178 tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] GET http://10.27.203.238/share/v1/aad888a9f2a84f389022db73cc1424a3/security-services/6b50079e-2ec0-4eb5-b940-46784b41555f May 28 12:56:27 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-a8eef533-7820-417c-ac71-ece489a41178 tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacf92f6-560c-4f2f-985c-90312e8f9dd9 None admin] RBAC: Authorizing `identity:create_grant(project_id=9a18b6f332ad4f09b5fcc66fa2715ca5, user_id=3dfc7bfaf8e1490faa53aed3f9e45fdf, role_id=e7989893488f483baa107be56668c4f8)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:27 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-a8eef533-7820-417c-ac71-ece489a41178 tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] Calling method 'SecurityServiceController.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacf92f6-560c-4f2f-985c-90312e8f9dd9 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:27 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-a8eef533-7820-417c-ac71-ece489a41178 tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] HTTP exception thrown: The resource could not be found. May 28 12:56:27 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-a8eef533-7820-417c-ac71-ece489a41178 tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] http://10.27.203.238/share/v1/aad888a9f2a84f389022db73cc1424a3/security-services/6b50079e-2ec0-4eb5-b940-46784b41555f returned with HTTP 404 May 28 12:56:27 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 27/38] 10.27.203.238 () {62 vars in 1441 bytes} [Tue May 28 12:56:27 2024] GET /share/v1/aad888a9f2a84f389022db73cc1424a3/security-services/6b50079e-2ec0-4eb5-b940-46784b41555f => generated 78 bytes in 9 msecs (HTTP/1.1 404) 6 headers in 236 bytes (1 switches on core 0) May 28 12:56:27 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 684/1385] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 12:56:27 2024] PUT /identity/v3/projects/9a18b6f332ad4f09b5fcc66fa2715ca5/users/3dfc7bfaf8e1490faa53aed3f9e45fdf/roles/e7989893488f483baa107be56668c4f8 => generated 0 bytes in 19 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:56:27 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-c11eb4c8-35a2-49df-8a7f-429b09a9ba04 tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] POST http://10.27.203.238/share/v1/aad888a9f2a84f389022db73cc1424a3/security-services May 28 12:56:27 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-c11eb4c8-35a2-49df-8a7f-429b09a9ba04 tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] Action: 'create', calling method: SecurityServiceController.create, body: {"security_service": {"type": "ldap", "name": "ss_ldap", "dns_ip": "1.1.1.1", "server": "fake_server_1", "domain": "fake_domain_1", "user": "fake_user", "password": "***"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:56:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6dd4e5-3ebf-4334-a84c-2685a65ae535 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6dd4e5-3ebf-4334-a84c-2685a65ae535 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6dd4e5-3ebf-4334-a84c-2685a65ae535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:27 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-3a47ce09-c8c0-4938-92e8-423050f78f81 tempest-AdminActionsTest-1749172189 None] <<< [POST] https://127.0.0.1:40443/api/quotas/ May 28 12:56:27 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-3a47ce09-c8c0-4938-92e8-423050f78f81 tempest-AdminActionsTest-1749172189 None] Bunch(cluster='loop75-kfs', cluster_id=1, default_email=None, default_group_quota=None, default_user_quota=None, enable_alarms=True, enable_email_providers=True, grace_period=None, group_quotas=[], guid='209d2cc0-7c6b-437e-821d-b7267f7260be', hard_limit=1073741824, hard_limit_inodes=None, id=1, internal=False, is_user_quota=False, last_user_quotas_update=None, name='77a25e6b-f137-4342-8eb9-9ced679515e2', num_blocked_users=0, num_exceeded_users=0, path='/manila/manila-77a25e6b-f137-4342-8eb9-9ced679515e2', percent_capacity=0, percent_inodes=None, pretty_grace_period=None, pretty_grace_period_expiration=None, pretty_state='OK (CREATED)', soft_limit=None, soft_limit_inodes=None, state='OK', sync_state='CREATED', system_id=1, tenant_id=1, tenant_name='default', time_to_block=None, title='77a25e6b-f137-4342-8eb9-9ced679515e2', url='https://127.0.0.1:40443/api/quotas/1/', used_capacity=0, used_capacity_tb=0.0, used_effective_capacity=0, used_effective_capacity_tb=0.0, used_inodes=0, used_limited_capacity=0, user_quotas=[]) May 28 12:56:27 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-3a47ce09-c8c0-4938-92e8-423050f78f81 tempest-AdminActionsTest-1749172189 None] --- [POST] https://127.0.0.1:40443/api/quotas/: Done May 28 12:56:27 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-c11eb4c8-35a2-49df-8a7f-429b09a9ba04 tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] http://10.27.203.238/share/v1/aad888a9f2a84f389022db73cc1424a3/security-services returned with HTTP 200 May 28 12:56:27 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-3a47ce09-c8c0-4938-92e8-423050f78f81 tempest-AdminActionsTest-1749172189 None] >>> [GET] https://127.0.0.1:40443/api/views/ May 28 12:56:27 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 12/39] 10.27.203.238 () {64 vars in 1352 bytes} [Tue May 28 12:56:27 2024] POST /share/v1/aad888a9f2a84f389022db73cc1424a3/security-services => generated 371 bytes in 14 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:56:27 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-3a47ce09-c8c0-4938-92e8-423050f78f81 tempest-AdminActionsTest-1749172189 None] {'allow_redirects': True, May 28 12:56:27 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-3a47ce09-c8c0-4938-92e8-423050f78f81 tempest-AdminActionsTest-1749172189 None] 'params': {'name': '77a25e6b-f137-4342-8eb9-9ced679515e2'}} May 28 12:56:27 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-ad6dd4e5-3ebf-4334-a84c-2685a65ae535 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:56:27 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-67abd489-82e3-4041-ab40-f657bca46d85 tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] POST http://10.27.203.238/share/v1/aad888a9f2a84f389022db73cc1424a3/security-services May 28 12:56:27 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-67abd489-82e3-4041-ab40-f657bca46d85 tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] Action: 'create', calling method: SecurityServiceController.create, body: {"security_service": {"type": "kerberos", "name": "ss_kerberos", "dns_ip": "2.2.2.2", "server": "fake_server_2", "domain": "fake_domain_2", "user": "test_user", "password": "***"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:56:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-ad6dd4e5-3ebf-4334-a84c-2685a65ae535 None None] MFA Rules not processed for user `3dfc7bfaf8e1490faa53aed3f9e45fdf`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:56:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-ad6dd4e5-3ebf-4334-a84c-2685a65ae535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:27 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-67abd489-82e3-4041-ab40-f657bca46d85 tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] http://10.27.203.238/share/v1/aad888a9f2a84f389022db73cc1424a3/security-services returned with HTTP 200 May 28 12:56:27 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 28/40] 10.27.203.238 () {64 vars in 1352 bytes} [Tue May 28 12:56:27 2024] POST /share/v1/aad888a9f2a84f389022db73cc1424a3/security-services => generated 379 bytes in 16 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:56:27 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-d26939ae-a935-444a-a459-6be5f07ec8df tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] GET http://10.27.203.238/share/v1/aad888a9f2a84f389022db73cc1424a3/security-services/detail?name=ss_ldap&type=ldap&user=fake_user&server=fake_server_1&dns_ip=1.1.1.1&domain=fake_domain_1 May 28 12:56:27 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-d26939ae-a935-444a-a459-6be5f07ec8df tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:27 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-d26939ae-a935-444a-a459-6be5f07ec8df tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] Calling method 'SecurityServiceController.detail' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:27 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-d26939ae-a935-444a-a459-6be5f07ec8df tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] http://10.27.203.238/share/v1/aad888a9f2a84f389022db73cc1424a3/security-services/detail?name=ss_ldap&type=ldap&user=fake_user&server=fake_server_1&dns_ip=1.1.1.1&domain=fake_domain_1 returned with HTTP 200 May 28 12:56:27 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 13/41] 10.27.203.238 () {62 vars in 1540 bytes} [Tue May 28 12:56:27 2024] GET /share/v1/aad888a9f2a84f389022db73cc1424a3/security-services/detail?name=ss_ldap&type=ldap&user=fake_user&server=fake_server_1&dns_ip=1.1.1.1&domain=fake_domain_1 => generated 396 bytes in 13 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:56:27 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-67800c86-8c44-49a2-8314-def38f6590cc tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] DELETE http://10.27.203.238/share/v1/aad888a9f2a84f389022db73cc1424a3/security-services/76893ab6-b678-4aa1-b0c5-9340c97c7d25 May 28 12:56:27 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-67800c86-8c44-49a2-8314-def38f6590cc tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:27 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-67800c86-8c44-49a2-8314-def38f6590cc tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] Calling method 'SecurityServiceController.delete' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:27 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.v1.security_service [None req-67800c86-8c44-49a2-8314-def38f6590cc tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] Delete security service with id: 76893ab6-b678-4aa1-b0c5-9340c97c7d25 May 28 12:56:27 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-fc403043-74e2-4b87-a388-18694293b445 tempest-AdminActionsNegativeTest-763023849 None] <<< [GET] https://127.0.0.1:40443/api/quotas/ May 28 12:56:27 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-fc403043-74e2-4b87-a388-18694293b445 tempest-AdminActionsNegativeTest-763023849 None] [] May 28 12:56:27 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-fc403043-74e2-4b87-a388-18694293b445 tempest-AdminActionsNegativeTest-763023849 None] --- [GET] https://127.0.0.1:40443/api/quotas/: Done May 28 12:56:27 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-fc403043-74e2-4b87-a388-18694293b445 tempest-AdminActionsNegativeTest-763023849 None] >>> [POST] https://127.0.0.1:40443/api/quotas/ May 28 12:56:27 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-fc403043-74e2-4b87-a388-18694293b445 tempest-AdminActionsNegativeTest-763023849 None] {'data': '{"name": "5ae9ae15-dc00-44c8-891a-9758f2b29855", "path": ' May 28 12:56:27 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-fc403043-74e2-4b87-a388-18694293b445 tempest-AdminActionsNegativeTest-763023849 None] '"/manila/manila-5ae9ae15-dc00-44c8-891a-9758f2b29855", "create_dir": ' May 28 12:56:27 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-fc403043-74e2-4b87-a388-18694293b445 tempest-AdminActionsNegativeTest-763023849 None] 'true, "hard_limit": 1073741824}', May 28 12:56:27 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-fc403043-74e2-4b87-a388-18694293b445 tempest-AdminActionsNegativeTest-763023849 None] 'json': None, May 28 12:56:27 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-fc403043-74e2-4b87-a388-18694293b445 tempest-AdminActionsNegativeTest-763023849 None] 'params': None} May 28 12:56:27 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 702/1386] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:56:27 2024] POST /identity/v3/auth/tokens => generated 4099 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:56:27 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-67800c86-8c44-49a2-8314-def38f6590cc tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] http://10.27.203.238/share/v1/aad888a9f2a84f389022db73cc1424a3/security-services/76893ab6-b678-4aa1-b0c5-9340c97c7d25 returned with HTTP 202 May 28 12:56:27 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 29/42] 10.27.203.238 () {62 vars in 1444 bytes} [Tue May 28 12:56:27 2024] DELETE /share/v1/aad888a9f2a84f389022db73cc1424a3/security-services/76893ab6-b678-4aa1-b0c5-9340c97c7d25 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 6 headers in 242 bytes (1 switches on core 0) May 28 12:56:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacf92f6-560c-4f2f-985c-90312e8f9dd9 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:27 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-ac3d9335-5be9-4e1d-a7bc-1e8459879595 tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] GET http://10.27.203.238/share/v1/aad888a9f2a84f389022db73cc1424a3/security-services/76893ab6-b678-4aa1-b0c5-9340c97c7d25 May 28 12:56:27 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-ac3d9335-5be9-4e1d-a7bc-1e8459879595 tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:27 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-ac3d9335-5be9-4e1d-a7bc-1e8459879595 tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] Calling method 'SecurityServiceController.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-ac3d9335-5be9-4e1d-a7bc-1e8459879595 tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] HTTP exception thrown: The resource could not be found. May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-ac3d9335-5be9-4e1d-a7bc-1e8459879595 tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] http://10.27.203.238/share/v1/aad888a9f2a84f389022db73cc1424a3/security-services/76893ab6-b678-4aa1-b0c5-9340c97c7d25 returned with HTTP 404 May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 14/43] 10.27.203.238 () {62 vars in 1441 bytes} [Tue May 28 12:56:27 2024] GET /share/v1/aad888a9f2a84f389022db73cc1424a3/security-services/76893ab6-b678-4aa1-b0c5-9340c97c7d25 => generated 78 bytes in 8 msecs (HTTP/1.1 404) 6 headers in 236 bytes (1 switches on core 0) May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-7ef28392-481c-4f8d-b354-849e427e1e72 tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] DELETE http://10.27.203.238/share/v1/aad888a9f2a84f389022db73cc1424a3/security-services/299e1756-600e-4b91-99a4-40fc43e63acb May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-7ef28392-481c-4f8d-b354-849e427e1e72 tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-7ef28392-481c-4f8d-b354-849e427e1e72 tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] Calling method 'SecurityServiceController.delete' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.v1.security_service [None req-7ef28392-481c-4f8d-b354-849e427e1e72 tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] Delete security service with id: 299e1756-600e-4b91-99a4-40fc43e63acb May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacf92f6-560c-4f2f-985c-90312e8f9dd9 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e5b8f4-7b34-4db0-8913-efb74edb8343 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e5b8f4-7b34-4db0-8913-efb74edb8343 None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e5b8f4-7b34-4db0-8913-efb74edb8343 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e5b8f4-7b34-4db0-8913-efb74edb8343 None admin] PATH_INFO: `/v3/users/3dfc7bfaf8e1490faa53aed3f9e45fdf` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-7ef28392-481c-4f8d-b354-849e427e1e72 tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] http://10.27.203.238/share/v1/aad888a9f2a84f389022db73cc1424a3/security-services/299e1756-600e-4b91-99a4-40fc43e63acb returned with HTTP 202 May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 30/44] 10.27.203.238 () {62 vars in 1444 bytes} [Tue May 28 12:56:28 2024] DELETE /share/v1/aad888a9f2a84f389022db73cc1424a3/security-services/299e1756-600e-4b91-99a4-40fc43e63acb => generated 0 bytes in 22 msecs (HTTP/1.1 202) 6 headers in 242 bytes (1 switches on core 0) May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e5b8f4-7b34-4db0-8913-efb74edb8343 None admin] RBAC: Authorizing `identity:delete_user(user_id=3dfc7bfaf8e1490faa53aed3f9e45fdf)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e5b8f4-7b34-4db0-8913-efb74edb8343 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-39c9de18-4d29-4c66-b045-fd3fc3165b2f tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] GET http://10.27.203.238/share/v1/aad888a9f2a84f389022db73cc1424a3/security-services/299e1756-600e-4b91-99a4-40fc43e63acb May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-39c9de18-4d29-4c66-b045-fd3fc3165b2f tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-39c9de18-4d29-4c66-b045-fd3fc3165b2f tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] Calling method 'SecurityServiceController.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-39c9de18-4d29-4c66-b045-fd3fc3165b2f tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] HTTP exception thrown: The resource could not be found. May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-39c9de18-4d29-4c66-b045-fd3fc3165b2f tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] http://10.27.203.238/share/v1/aad888a9f2a84f389022db73cc1424a3/security-services/299e1756-600e-4b91-99a4-40fc43e63acb returned with HTTP 404 May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 15/45] 10.27.203.238 () {62 vars in 1441 bytes} [Tue May 28 12:56:28 2024] GET /share/v1/aad888a9f2a84f389022db73cc1424a3/security-services/299e1756-600e-4b91-99a4-40fc43e63acb => generated 78 bytes in 8 msecs (HTTP/1.1 404) 6 headers in 236 bytes (1 switches on core 0) May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-dbca736b-d18e-4074-9166-ff01ccf804e7 tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] POST http://10.27.203.238/share/v1/aad888a9f2a84f389022db73cc1424a3/security-services May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-dbca736b-d18e-4074-9166-ff01ccf804e7 tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] Action: 'create', calling method: SecurityServiceController.create, body: {"security_service": {"type": "ldap", "name": "ss_ldap", "dns_ip": "1.1.1.1", "server": "fake_server_1", "domain": "fake_domain_1", "user": "fake_user", "password": "***"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-dbca736b-d18e-4074-9166-ff01ccf804e7 tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] http://10.27.203.238/share/v1/aad888a9f2a84f389022db73cc1424a3/security-services returned with HTTP 200 May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 31/46] 10.27.203.238 () {64 vars in 1352 bytes} [Tue May 28 12:56:28 2024] POST /share/v1/aad888a9f2a84f389022db73cc1424a3/security-services => generated 371 bytes in 19 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-0bc87fc2-4a90-49a6-b3fb-cc051ab48870 tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] POST http://10.27.203.238/share/v1/aad888a9f2a84f389022db73cc1424a3/security-services May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-0bc87fc2-4a90-49a6-b3fb-cc051ab48870 tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] Action: 'create', calling method: SecurityServiceController.create, body: {"security_service": {"type": "kerberos", "name": "ss_kerberos", "dns_ip": "2.2.2.2", "server": "fake_server_2", "domain": "fake_domain_2", "user": "test_user", "password": "***"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-83e5b8f4-7b34-4db0-8913-efb74edb8343 None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3dfc7bfaf8e1490faa53aed3f9e45fdf', 'request_id': 'req-83e5b8f4-7b34-4db0-8913-efb74edb8343'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-83e5b8f4-7b34-4db0-8913-efb74edb8343 None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3dfc7bfaf8e1490faa53aed3f9e45fdf', 'request_id': 'req-83e5b8f4-7b34-4db0-8913-efb74edb8343'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-0bc87fc2-4a90-49a6-b3fb-cc051ab48870 tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] http://10.27.203.238/share/v1/aad888a9f2a84f389022db73cc1424a3/security-services returned with HTTP 200 May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 16/47] 10.27.203.238 () {64 vars in 1352 bytes} [Tue May 28 12:56:28 2024] POST /share/v1/aad888a9f2a84f389022db73cc1424a3/security-services => generated 379 bytes in 20 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-83e5b8f4-7b34-4db0-8913-efb74edb8343 None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3dfc7bfaf8e1490faa53aed3f9e45fdf', 'request_id': 'req-83e5b8f4-7b34-4db0-8913-efb74edb8343'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-79724aa5-92ff-4faf-a0c0-e744583ec1f4 tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] GET http://10.27.203.238/share/v1/aad888a9f2a84f389022db73cc1424a3/security-services?fake_opt=some_value May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-79724aa5-92ff-4faf-a0c0-e744583ec1f4 tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-79724aa5-92ff-4faf-a0c0-e744583ec1f4 tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] Calling method 'SecurityServiceController.index' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-83e5b8f4-7b34-4db0-8913-efb74edb8343 None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3dfc7bfaf8e1490faa53aed3f9e45fdf', 'request_id': 'req-83e5b8f4-7b34-4db0-8913-efb74edb8343'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-83e5b8f4-7b34-4db0-8913-efb74edb8343 None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3dfc7bfaf8e1490faa53aed3f9e45fdf', 'request_id': 'req-83e5b8f4-7b34-4db0-8913-efb74edb8343'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-79724aa5-92ff-4faf-a0c0-e744583ec1f4 tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] http://10.27.203.238/share/v1/aad888a9f2a84f389022db73cc1424a3/security-services?fake_opt=some_value returned with HTTP 200 May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 32/48] 10.27.203.238 () {62 vars in 1369 bytes} [Tue May 28 12:56:28 2024] GET /share/v1/aad888a9f2a84f389022db73cc1424a3/security-services?fake_opt=some_value => generated 25 bytes in 10 msecs (HTTP/1.1 200) 6 headers in 229 bytes (1 switches on core 0) May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-4d69dd4d-3fdb-4c66-8da1-c03269188b82 tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] DELETE http://10.27.203.238/share/v1/aad888a9f2a84f389022db73cc1424a3/security-services/bb922e9f-2a11-4f31-a3f4-5c665846fbdd May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-4d69dd4d-3fdb-4c66-8da1-c03269188b82 tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-4d69dd4d-3fdb-4c66-8da1-c03269188b82 tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] Calling method 'SecurityServiceController.delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.v1.security_service [None req-4d69dd4d-3fdb-4c66-8da1-c03269188b82 tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] Delete security service with id: bb922e9f-2a11-4f31-a3f4-5c665846fbdd May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 685/1387] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 12:56:27 2024] DELETE /identity/v3/users/3dfc7bfaf8e1490faa53aed3f9e45fdf => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400dc74f-cd20-4c66-9a53-ef911ab05599 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400dc74f-cd20-4c66-9a53-ef911ab05599 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400dc74f-cd20-4c66-9a53-ef911ab05599 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:28 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b0b36f71-852d-463a-b1c8-4066ce824def tempest-ExportLocationsTest-1017217578 None] <<< [POST] https://127.0.0.1:40443/api/quotas/ May 28 12:56:28 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b0b36f71-852d-463a-b1c8-4066ce824def tempest-ExportLocationsTest-1017217578 None] Bunch(cluster='loop75-kfs', cluster_id=1, default_email=None, default_group_quota=None, default_user_quota=None, enable_alarms=True, enable_email_providers=True, grace_period=None, group_quotas=[], guid='2f4b2691-bd87-4624-b3a8-06e9739344e3', hard_limit=1073741824, hard_limit_inodes=None, id=2, internal=False, is_user_quota=False, last_user_quotas_update=None, name='83d10127-dfed-433a-90d1-4f0a7f981edc', num_blocked_users=0, num_exceeded_users=0, path='/manila/manila-83d10127-dfed-433a-90d1-4f0a7f981edc', percent_capacity=0, percent_inodes=None, pretty_grace_period=None, pretty_grace_period_expiration=None, pretty_state='OK (CREATED)', soft_limit=None, soft_limit_inodes=None, state='OK', sync_state='CREATED', system_id=2, tenant_id=1, tenant_name='default', time_to_block=None, title='83d10127-dfed-433a-90d1-4f0a7f981edc', url='https://127.0.0.1:40443/api/quotas/2/', used_capacity=0, used_capacity_tb=0.0, used_effective_capacity=0, used_effective_capacity_tb=0.0, used_inodes=0, used_limited_capacity=0, user_quotas=[]) May 28 12:56:28 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b0b36f71-852d-463a-b1c8-4066ce824def tempest-ExportLocationsTest-1017217578 None] --- [POST] https://127.0.0.1:40443/api/quotas/: Done May 28 12:56:28 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b0b36f71-852d-463a-b1c8-4066ce824def tempest-ExportLocationsTest-1017217578 None] >>> [GET] https://127.0.0.1:40443/api/views/ May 28 12:56:28 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b0b36f71-852d-463a-b1c8-4066ce824def tempest-ExportLocationsTest-1017217578 None] {'allow_redirects': True, May 28 12:56:28 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b0b36f71-852d-463a-b1c8-4066ce824def tempest-ExportLocationsTest-1017217578 None] 'params': {'name': '83d10127-dfed-433a-90d1-4f0a7f981edc'}} May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-4d69dd4d-3fdb-4c66-8da1-c03269188b82 tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] http://10.27.203.238/share/v1/aad888a9f2a84f389022db73cc1424a3/security-services/bb922e9f-2a11-4f31-a3f4-5c665846fbdd returned with HTTP 202 May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 17/49] 10.27.203.238 () {62 vars in 1444 bytes} [Tue May 28 12:56:28 2024] DELETE /share/v1/aad888a9f2a84f389022db73cc1424a3/security-services/bb922e9f-2a11-4f31-a3f4-5c665846fbdd => generated 0 bytes in 22 msecs (HTTP/1.1 202) 6 headers in 242 bytes (1 switches on core 0) May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-400dc74f-cd20-4c66-9a53-ef911ab05599 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-8feec714-2250-40d9-a422-42206890dcd6 tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] GET http://10.27.203.238/share/v1/aad888a9f2a84f389022db73cc1424a3/security-services/bb922e9f-2a11-4f31-a3f4-5c665846fbdd May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-8feec714-2250-40d9-a422-42206890dcd6 tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-8feec714-2250-40d9-a422-42206890dcd6 tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] Calling method 'SecurityServiceController.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-400dc74f-cd20-4c66-9a53-ef911ab05599 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-400dc74f-cd20-4c66-9a53-ef911ab05599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-8feec714-2250-40d9-a422-42206890dcd6 tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] HTTP exception thrown: The resource could not be found. May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-8feec714-2250-40d9-a422-42206890dcd6 tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] http://10.27.203.238/share/v1/aad888a9f2a84f389022db73cc1424a3/security-services/bb922e9f-2a11-4f31-a3f4-5c665846fbdd returned with HTTP 404 May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 33/50] 10.27.203.238 () {62 vars in 1441 bytes} [Tue May 28 12:56:28 2024] GET /share/v1/aad888a9f2a84f389022db73cc1424a3/security-services/bb922e9f-2a11-4f31-a3f4-5c665846fbdd => generated 78 bytes in 11 msecs (HTTP/1.1 404) 6 headers in 236 bytes (1 switches on core 0) May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-73edf76b-bd00-445a-aa29-d825f507b16a tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] DELETE http://10.27.203.238/share/v1/aad888a9f2a84f389022db73cc1424a3/security-services/f5ed17cf-0d5c-4eea-8c8c-6c85a6b0408e May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-73edf76b-bd00-445a-aa29-d825f507b16a tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-73edf76b-bd00-445a-aa29-d825f507b16a tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] Calling method 'SecurityServiceController.delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.v1.security_service [None req-73edf76b-bd00-445a-aa29-d825f507b16a tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] Delete security service with id: f5ed17cf-0d5c-4eea-8c8c-6c85a6b0408e May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 703/1388] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:56:28 2024] POST /identity/v3/auth/tokens => generated 2960 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-73edf76b-bd00-445a-aa29-d825f507b16a tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] http://10.27.203.238/share/v1/aad888a9f2a84f389022db73cc1424a3/security-services/f5ed17cf-0d5c-4eea-8c8c-6c85a6b0408e returned with HTTP 202 May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 18/51] 10.27.203.238 () {62 vars in 1444 bytes} [Tue May 28 12:56:28 2024] DELETE /share/v1/aad888a9f2a84f389022db73cc1424a3/security-services/f5ed17cf-0d5c-4eea-8c8c-6c85a6b0408e => generated 0 bytes in 22 msecs (HTTP/1.1 202) 6 headers in 242 bytes (1 switches on core 0) May 28 12:56:28 l75lg1-v1 neutron-server[77618]: DEBUG neutron.wsgi [-] (77618) accepted ('10.27.203.238', 55972) {{(pid=77618) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-b55ba0b0-530f-4247-bb40-e37c1ae145a8 tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] GET http://10.27.203.238/share/v1/aad888a9f2a84f389022db73cc1424a3/security-services/f5ed17cf-0d5c-4eea-8c8c-6c85a6b0408e May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-b55ba0b0-530f-4247-bb40-e37c1ae145a8 tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e5b8f4-7b34-4db0-8913-efb74edb8343 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-b55ba0b0-530f-4247-bb40-e37c1ae145a8 tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] Calling method 'SecurityServiceController.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-83e5b8f4-7b34-4db0-8913-efb74edb8343 None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-b55ba0b0-530f-4247-bb40-e37c1ae145a8 tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] HTTP exception thrown: The resource could not be found. May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-b55ba0b0-530f-4247-bb40-e37c1ae145a8 tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] http://10.27.203.238/share/v1/aad888a9f2a84f389022db73cc1424a3/security-services/f5ed17cf-0d5c-4eea-8c8c-6c85a6b0408e returned with HTTP 404 May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 34/52] 10.27.203.238 () {62 vars in 1441 bytes} [Tue May 28 12:56:28 2024] GET /share/v1/aad888a9f2a84f389022db73cc1424a3/security-services/f5ed17cf-0d5c-4eea-8c8c-6c85a6b0408e => generated 78 bytes in 9 msecs (HTTP/1.1 404) 6 headers in 236 bytes (1 switches on core 0) May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-ee1d6e76-e3b3-4002-9a39-a633f90d3f1b tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] POST http://10.27.203.238/share/v1/aad888a9f2a84f389022db73cc1424a3/security-services May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-ee1d6e76-e3b3-4002-9a39-a633f90d3f1b tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] Action: 'create', calling method: SecurityServiceController.create, body: {"security_service": {"type": "ldap", "name": "ss_ldap", "dns_ip": "1.1.1.1", "server": "fake_server_1", "domain": "fake_domain_1", "user": "fake_user", "password": "***"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-ee1d6e76-e3b3-4002-9a39-a633f90d3f1b tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] http://10.27.203.238/share/v1/aad888a9f2a84f389022db73cc1424a3/security-services returned with HTTP 200 May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 19/53] 10.27.203.238 () {64 vars in 1352 bytes} [Tue May 28 12:56:28 2024] POST /share/v1/aad888a9f2a84f389022db73cc1424a3/security-services => generated 371 bytes in 22 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-fafc90ee-cf73-4395-8e38-2246763559dd tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] POST http://10.27.203.238/share/v1/aad888a9f2a84f389022db73cc1424a3/security-services May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-fafc90ee-cf73-4395-8e38-2246763559dd tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] Action: 'create', calling method: SecurityServiceController.create, body: {"security_service": {"type": "kerberos", "name": "ss_kerberos", "dns_ip": "2.2.2.2", "server": "fake_server_2", "domain": "fake_domain_2", "user": "test_user", "password": "***"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e5b8f4-7b34-4db0-8913-efb74edb8343 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebe7968-5a9e-4d96-b886-9b669d2a5090 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef17047035e4b518fd5360a01f2da1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebe7968-5a9e-4d96-b886-9b669d2a5090 service neutron] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebe7968-5a9e-4d96-b886-9b669d2a5090 service neutron] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebe7968-5a9e-4d96-b886-9b669d2a5090 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-fafc90ee-cf73-4395-8e38-2246763559dd tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] http://10.27.203.238/share/v1/aad888a9f2a84f389022db73cc1424a3/security-services returned with HTTP 200 May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebe7968-5a9e-4d96-b886-9b669d2a5090 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 35/54] 10.27.203.238 () {64 vars in 1352 bytes} [Tue May 28 12:56:28 2024] POST /share/v1/aad888a9f2a84f389022db73cc1424a3/security-services => generated 379 bytes in 24 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebe7968-5a9e-4d96-b886-9b669d2a5090 service neutron] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 686/1389] 10.27.203.238 () {64 vars in 1432 bytes} [Tue May 28 12:56:28 2024] GET /identity/v3/auth/tokens => generated 2960 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-c5a7034c-7c22-446c-bfa9-40c879c627ab tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] DELETE http://10.27.203.238/share/v1/aad888a9f2a84f389022db73cc1424a3/security-services/cee3ed96-9df7-4c79-96c0-cb9b7d3bc9e0 May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-c5a7034c-7c22-446c-bfa9-40c879c627ab tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-c5a7034c-7c22-446c-bfa9-40c879c627ab tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] Calling method 'SecurityServiceController.delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.v1.security_service [None req-c5a7034c-7c22-446c-bfa9-40c879c627ab tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] Delete security service with id: cee3ed96-9df7-4c79-96c0-cb9b7d3bc9e0 May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-1268d53b-e22b-45b5-9f6d-eea7d9d0e0c6 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] GET http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/shares/df0ea844-5fc1-4d04-8afb-5048ec5dc33f May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-1268d53b-e22b-45b5-9f6d-eea7d9d0e0c6 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-1268d53b-e22b-45b5-9f6d-eea7d9d0e0c6 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:28 l75lg1-v1 neutron-server[77618]: INFO neutron.wsgi [None req-43cff959-7b26-48a0-8722-7299aa98dc6e None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=9a18b6f332ad4f09b5fcc66fa2715ca5&name=default HTTP/1.1" status: 200 len: 216 time: 0.0837071 May 28 12:56:28 l75lg1-v1 dstat.sh[49771]: 28-05 12:56:28| 21 3 71 5 0|5628M 1885M 277M 7836M| 18k 16k| 256k 8689k|2.00 773 | 11k 19k|1.76 0.96 0.98|4.0 1.0 9.0| 0 0 | 0 2048M| 29 345 0 31 0 May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400dc74f-cd20-4c66-9a53-ef911ab05599 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-400dc74f-cd20-4c66-9a53-ef911ab05599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-c5a7034c-7c22-446c-bfa9-40c879c627ab tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] http://10.27.203.238/share/v1/aad888a9f2a84f389022db73cc1424a3/security-services/cee3ed96-9df7-4c79-96c0-cb9b7d3bc9e0 returned with HTTP 202 May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 20/55] 10.27.203.238 () {62 vars in 1444 bytes} [Tue May 28 12:56:28 2024] DELETE /share/v1/aad888a9f2a84f389022db73cc1424a3/security-services/cee3ed96-9df7-4c79-96c0-cb9b7d3bc9e0 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 6 headers in 242 bytes (1 switches on core 0) May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400dc74f-cd20-4c66-9a53-ef911ab05599 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-a15bfc84-6d59-4d23-9fb0-74a9f0d64975 tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] GET http://10.27.203.238/share/v1/aad888a9f2a84f389022db73cc1424a3/security-services/cee3ed96-9df7-4c79-96c0-cb9b7d3bc9e0 May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-a15bfc84-6d59-4d23-9fb0-74a9f0d64975 tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-a15bfc84-6d59-4d23-9fb0-74a9f0d64975 tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] Calling method 'SecurityServiceController.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6baef8-4b17-40c5-bcc7-f7ae13cf90f3 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6baef8-4b17-40c5-bcc7-f7ae13cf90f3 None admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6baef8-4b17-40c5-bcc7-f7ae13cf90f3 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6baef8-4b17-40c5-bcc7-f7ae13cf90f3 None admin] PATH_INFO: `/v3/projects/9a18b6f332ad4f09b5fcc66fa2715ca5` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6baef8-4b17-40c5-bcc7-f7ae13cf90f3 None admin] RBAC: Authorizing `identity:delete_project(project_id=9a18b6f332ad4f09b5fcc66fa2715ca5)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6baef8-4b17-40c5-bcc7-f7ae13cf90f3 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-a15bfc84-6d59-4d23-9fb0-74a9f0d64975 tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] HTTP exception thrown: The resource could not be found. May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-a15bfc84-6d59-4d23-9fb0-74a9f0d64975 tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] http://10.27.203.238/share/v1/aad888a9f2a84f389022db73cc1424a3/security-services/cee3ed96-9df7-4c79-96c0-cb9b7d3bc9e0 returned with HTTP 404 May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 21/56] 10.27.203.238 () {62 vars in 1441 bytes} [Tue May 28 12:56:28 2024] GET /share/v1/aad888a9f2a84f389022db73cc1424a3/security-services/cee3ed96-9df7-4c79-96c0-cb9b7d3bc9e0 => generated 78 bytes in 12 msecs (HTTP/1.1 404) 6 headers in 236 bytes (1 switches on core 0) May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-9c812d12-5362-4a95-8d10-db56fa93d436 tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] DELETE http://10.27.203.238/share/v1/aad888a9f2a84f389022db73cc1424a3/security-services/68ba56a6-ae5f-4f6f-9a79-319920dd7f48 May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-1268d53b-e22b-45b5-9f6d-eea7d9d0e0c6 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/shares/df0ea844-5fc1-4d04-8afb-5048ec5dc33f returned with HTTP 200 May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-9c812d12-5362-4a95-8d10-db56fa93d436 tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-9c812d12-5362-4a95-8d10-db56fa93d436 tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] Calling method 'SecurityServiceController.delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.v1.security_service [None req-9c812d12-5362-4a95-8d10-db56fa93d436 tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] Delete security service with id: 68ba56a6-ae5f-4f6f-9a79-319920dd7f48 May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 36/57] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:56:28 2024] GET /share/v2/a3499cb78849424db45e54caac01de92/shares/df0ea844-5fc1-4d04-8afb-5048ec5dc33f => generated 1368 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-6ad7b621-c8e0-4922-bc46-2884741158f8 tempest-ExportLocationsTest-1017217578 tempest-ExportLocationsTest-1017217578-project-admin] GET http://10.27.203.238/share/v2/87c113478e754c47aea49a8b703cd2f6/shares/a96dff4b-6e98-4085-9f3b-45735d209546 May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-6ad7b621-c8e0-4922-bc46-2884741158f8 tempest-ExportLocationsTest-1017217578 tempest-ExportLocationsTest-1017217578-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-6ad7b621-c8e0-4922-bc46-2884741158f8 tempest-ExportLocationsTest-1017217578 tempest-ExportLocationsTest-1017217578-project-admin] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-9c812d12-5362-4a95-8d10-db56fa93d436 tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] http://10.27.203.238/share/v1/aad888a9f2a84f389022db73cc1424a3/security-services/68ba56a6-ae5f-4f6f-9a79-319920dd7f48 returned with HTTP 202 May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 22/58] 10.27.203.238 () {62 vars in 1444 bytes} [Tue May 28 12:56:28 2024] DELETE /share/v1/aad888a9f2a84f389022db73cc1424a3/security-services/68ba56a6-ae5f-4f6f-9a79-319920dd7f48 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 6 headers in 242 bytes (1 switches on core 0) May 28 12:56:28 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-3a47ce09-c8c0-4938-92e8-423050f78f81 tempest-AdminActionsTest-1749172189 None] <<< [GET] https://127.0.0.1:40443/api/views/ May 28 12:56:28 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-3a47ce09-c8c0-4938-92e8-423050f78f81 tempest-AdminActionsTest-1749172189 None] [] May 28 12:56:28 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-3a47ce09-c8c0-4938-92e8-423050f78f81 tempest-AdminActionsTest-1749172189 None] --- [GET] https://127.0.0.1:40443/api/views/: Done May 28 12:56:28 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-3a47ce09-c8c0-4938-92e8-423050f78f81 tempest-AdminActionsTest-1749172189 None] >>> [POST] https://127.0.0.1:40443/api/views/ May 28 12:56:28 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-3a47ce09-c8c0-4938-92e8-423050f78f81 tempest-AdminActionsTest-1749172189 None] {'data': '{"name": "77a25e6b-f137-4342-8eb9-9ced679515e2", "path": ' May 28 12:56:28 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-3a47ce09-c8c0-4938-92e8-423050f78f81 tempest-AdminActionsTest-1749172189 None] '"/manila/manila-77a25e6b-f137-4342-8eb9-9ced679515e2", "policy_id": ' May 28 12:56:28 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-3a47ce09-c8c0-4938-92e8-423050f78f81 tempest-AdminActionsTest-1749172189 None] '4, "create_dir": true, "protocols": ["NFS"]}', May 28 12:56:28 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-3a47ce09-c8c0-4938-92e8-423050f78f81 tempest-AdminActionsTest-1749172189 None] 'json': None, May 28 12:56:28 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-3a47ce09-c8c0-4938-92e8-423050f78f81 tempest-AdminActionsTest-1749172189 None] 'params': None} May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-6ad7b621-c8e0-4922-bc46-2884741158f8 tempest-ExportLocationsTest-1017217578 tempest-ExportLocationsTest-1017217578-project-admin] http://10.27.203.238/share/v2/87c113478e754c47aea49a8b703cd2f6/shares/a96dff4b-6e98-4085-9f3b-45735d209546 returned with HTTP 200 May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-d2d7b76a-98b5-4caf-a84c-ca907d40ea27 tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] GET http://10.27.203.238/share/v1/aad888a9f2a84f389022db73cc1424a3/security-services/68ba56a6-ae5f-4f6f-9a79-319920dd7f48 May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-d2d7b76a-98b5-4caf-a84c-ca907d40ea27 tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 37/59] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:56:28 2024] GET /share/v2/87c113478e754c47aea49a8b703cd2f6/shares/a96dff4b-6e98-4085-9f3b-45735d209546 => generated 1370 bytes in 28 msecs (HTTP/1.1 200) 6 headers in 232 bytes (2 switches on core 0) May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-d2d7b76a-98b5-4caf-a84c-ca907d40ea27 tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] Calling method 'SecurityServiceController.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-ab6baef8-4b17-40c5-bcc7-f7ae13cf90f3 None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a18b6f332ad4f09b5fcc66fa2715ca5', 'request_id': 'req-ab6baef8-4b17-40c5-bcc7-f7ae13cf90f3'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-d2d7b76a-98b5-4caf-a84c-ca907d40ea27 tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] HTTP exception thrown: The resource could not be found. May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-d2d7b76a-98b5-4caf-a84c-ca907d40ea27 tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] http://10.27.203.238/share/v1/aad888a9f2a84f389022db73cc1424a3/security-services/68ba56a6-ae5f-4f6f-9a79-319920dd7f48 returned with HTTP 404 May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 23/60] 10.27.203.238 () {62 vars in 1441 bytes} [Tue May 28 12:56:28 2024] GET /share/v1/aad888a9f2a84f389022db73cc1424a3/security-services/68ba56a6-ae5f-4f6f-9a79-319920dd7f48 => generated 78 bytes in 8 msecs (HTTP/1.1 404) 6 headers in 236 bytes (1 switches on core 0) May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-ab6baef8-4b17-40c5-bcc7-f7ae13cf90f3 None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a18b6f332ad4f09b5fcc66fa2715ca5', 'request_id': 'req-ab6baef8-4b17-40c5-bcc7-f7ae13cf90f3'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-ab6baef8-4b17-40c5-bcc7-f7ae13cf90f3 None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a18b6f332ad4f09b5fcc66fa2715ca5', 'request_id': 'req-ab6baef8-4b17-40c5-bcc7-f7ae13cf90f3'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-2c16c2a5-ad0f-4539-ac99-6dc636804202 tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] POST http://10.27.203.238/share/v1/aad888a9f2a84f389022db73cc1424a3/security-services May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-2c16c2a5-ad0f-4539-ac99-6dc636804202 tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] Action: 'create', calling method: SecurityServiceController.create, body: {"security_service": {"type": "ldap", "name": "ss_ldap", "dns_ip": "1.1.1.1", "server": "fake_server_1", "domain": "fake_domain_1", "user": "fake_user", "password": "***"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-2c16c2a5-ad0f-4539-ac99-6dc636804202 tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] http://10.27.203.238/share/v1/aad888a9f2a84f389022db73cc1424a3/security-services returned with HTTP 200 May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 38/61] 10.27.203.238 () {64 vars in 1352 bytes} [Tue May 28 12:56:28 2024] POST /share/v1/aad888a9f2a84f389022db73cc1424a3/security-services => generated 371 bytes in 23 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-ab6baef8-4b17-40c5-bcc7-f7ae13cf90f3 None admin] The token cache is being invalidate because project 9a18b6f332ad4f09b5fcc66fa2715ca5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-ab6baef8-4b17-40c5-bcc7-f7ae13cf90f3 None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-ab6baef8-4b17-40c5-bcc7-f7ae13cf90f3 None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 704/1390] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 12:56:28 2024] DELETE /identity/v3/projects/9a18b6f332ad4f09b5fcc66fa2715ca5 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-1cbfcdd9-078c-46c7-b4ab-e839042eb74a tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] POST http://10.27.203.238/share/v1/aad888a9f2a84f389022db73cc1424a3/security-services May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-1cbfcdd9-078c-46c7-b4ab-e839042eb74a tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] Action: 'create', calling method: SecurityServiceController.create, body: {"security_service": {"type": "kerberos", "name": "ss_kerberos", "dns_ip": "2.2.2.2", "server": "fake_server_2", "domain": "fake_domain_2", "user": "test_user", "password": "***"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2822737-7ed3-42ad-893b-9521c9e0e56d None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2822737-7ed3-42ad-893b-9521c9e0e56d None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2822737-7ed3-42ad-893b-9521c9e0e56d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-1cbfcdd9-078c-46c7-b4ab-e839042eb74a tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] http://10.27.203.238/share/v1/aad888a9f2a84f389022db73cc1424a3/security-services returned with HTTP 200 May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 24/62] 10.27.203.238 () {64 vars in 1352 bytes} [Tue May 28 12:56:28 2024] POST /share/v1/aad888a9f2a84f389022db73cc1424a3/security-services => generated 379 bytes in 16 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-f2822737-7ed3-42ad-893b-9521c9e0e56d None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-f2822737-7ed3-42ad-893b-9521c9e0e56d None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-a5ccd676-e18d-49e8-acd8-790fc39f1718 tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] GET http://10.27.203.238/share/v2/aad888a9f2a84f389022db73cc1424a3/security-services/detail May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-f2822737-7ed3-42ad-893b-9521c9e0e56d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-a5ccd676-e18d-49e8-acd8-790fc39f1718 tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-a5ccd676-e18d-49e8-acd8-790fc39f1718 tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] Calling method 'SecurityServiceController.detail' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 687/1391] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:56:28 2024] POST /identity/v3/auth/tokens => generated 312 bytes in 21 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf94dce-1e5a-43b7-9a68-f5feb8da728d None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf94dce-1e5a-43b7-9a68-f5feb8da728d None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf94dce-1e5a-43b7-9a68-f5feb8da728d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-a5ccd676-e18d-49e8-acd8-790fc39f1718 tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] http://10.27.203.238/share/v2/aad888a9f2a84f389022db73cc1424a3/security-services/detail returned with HTTP 200 May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 39/63] 10.27.203.238 () {64 vars in 1394 bytes} [Tue May 28 12:56:28 2024] GET /share/v2/aad888a9f2a84f389022db73cc1424a3/security-services/detail => generated 777 bytes in 19 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-1a16a0aa-ac9c-46c3-aa27-218f9bebb621 tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] DELETE http://10.27.203.238/share/v1/aad888a9f2a84f389022db73cc1424a3/security-services/b9329bd7-ddbe-4e94-82a7-45fb3e202e38 May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-1a16a0aa-ac9c-46c3-aa27-218f9bebb621 tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-1a16a0aa-ac9c-46c3-aa27-218f9bebb621 tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] Calling method 'SecurityServiceController.delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.v1.security_service [None req-1a16a0aa-ac9c-46c3-aa27-218f9bebb621 tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] Delete security service with id: b9329bd7-ddbe-4e94-82a7-45fb3e202e38 May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-fdf94dce-1e5a-43b7-9a68-f5feb8da728d None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-fdf94dce-1e5a-43b7-9a68-f5feb8da728d None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-fdf94dce-1e5a-43b7-9a68-f5feb8da728d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-1a16a0aa-ac9c-46c3-aa27-218f9bebb621 tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] http://10.27.203.238/share/v1/aad888a9f2a84f389022db73cc1424a3/security-services/b9329bd7-ddbe-4e94-82a7-45fb3e202e38 returned with HTTP 202 May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 25/64] 10.27.203.238 () {62 vars in 1444 bytes} [Tue May 28 12:56:28 2024] DELETE /share/v1/aad888a9f2a84f389022db73cc1424a3/security-services/b9329bd7-ddbe-4e94-82a7-45fb3e202e38 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 6 headers in 242 bytes (1 switches on core 0) May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-4b243219-7409-4a06-a1bc-862ecf997a59 tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] GET http://10.27.203.238/share/v1/aad888a9f2a84f389022db73cc1424a3/security-services/b9329bd7-ddbe-4e94-82a7-45fb3e202e38 May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-4b243219-7409-4a06-a1bc-862ecf997a59 tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-4b243219-7409-4a06-a1bc-862ecf997a59 tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] Calling method 'SecurityServiceController.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 705/1392] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:56:28 2024] POST /identity/v3/auth/tokens => generated 2960 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-4b243219-7409-4a06-a1bc-862ecf997a59 tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] HTTP exception thrown: The resource could not be found. May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-4b243219-7409-4a06-a1bc-862ecf997a59 tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] http://10.27.203.238/share/v1/aad888a9f2a84f389022db73cc1424a3/security-services/b9329bd7-ddbe-4e94-82a7-45fb3e202e38 returned with HTTP 404 May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 40/65] 10.27.203.238 () {62 vars in 1441 bytes} [Tue May 28 12:56:28 2024] GET /share/v1/aad888a9f2a84f389022db73cc1424a3/security-services/b9329bd7-ddbe-4e94-82a7-45fb3e202e38 => generated 78 bytes in 8 msecs (HTTP/1.1 404) 6 headers in 236 bytes (1 switches on core 0) May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2822737-7ed3-42ad-893b-9521c9e0e56d None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-ff34628a-7a11-43b4-b067-68c2e3bebebc tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] DELETE http://10.27.203.238/share/v1/aad888a9f2a84f389022db73cc1424a3/security-services/735b0fae-0304-4c20-8240-64713221bc68 May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-ff34628a-7a11-43b4-b067-68c2e3bebebc tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-ff34628a-7a11-43b4-b067-68c2e3bebebc tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] Calling method 'SecurityServiceController.delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.v1.security_service [None req-ff34628a-7a11-43b4-b067-68c2e3bebebc tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] Delete security service with id: 735b0fae-0304-4c20-8240-64713221bc68 May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2822737-7ed3-42ad-893b-9521c9e0e56d None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c248258c-2bf3-4d23-9722-fcd9f2648d57 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c248258c-2bf3-4d23-9722-fcd9f2648d57 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c248258c-2bf3-4d23-9722-fcd9f2648d57 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c248258c-2bf3-4d23-9722-fcd9f2648d57 None admin] PATH_INFO: `/v3/domains` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c248258c-2bf3-4d23-9722-fcd9f2648d57 None admin] RBAC: Adding query filter params (name=Default) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c248258c-2bf3-4d23-9722-fcd9f2648d57 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c248258c-2bf3-4d23-9722-fcd9f2648d57 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-ff34628a-7a11-43b4-b067-68c2e3bebebc tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] http://10.27.203.238/share/v1/aad888a9f2a84f389022db73cc1424a3/security-services/735b0fae-0304-4c20-8240-64713221bc68 returned with HTTP 202 May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 688/1393] 10.27.203.238 () {62 vars in 1220 bytes} [Tue May 28 12:56:28 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 26/66] 10.27.203.238 () {62 vars in 1444 bytes} [Tue May 28 12:56:28 2024] DELETE /share/v1/aad888a9f2a84f389022db73cc1424a3/security-services/735b0fae-0304-4c20-8240-64713221bc68 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 6 headers in 242 bytes (1 switches on core 0) May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf94dce-1e5a-43b7-9a68-f5feb8da728d None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf94dce-1e5a-43b7-9a68-f5feb8da728d None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-72f06fd5-6ac8-45bd-aaf6-650d0e10f743 tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] GET http://10.27.203.238/share/v1/aad888a9f2a84f389022db73cc1424a3/security-services/735b0fae-0304-4c20-8240-64713221bc68 May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-72f06fd5-6ac8-45bd-aaf6-650d0e10f743 tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-72f06fd5-6ac8-45bd-aaf6-650d0e10f743 tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] Calling method 'SecurityServiceController.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8677a84d-fa1a-49e3-8694-3d2defe0b24b None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8677a84d-fa1a-49e3-8694-3d2defe0b24b None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8677a84d-fa1a-49e3-8694-3d2defe0b24b None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8677a84d-fa1a-49e3-8694-3d2defe0b24b None admin] PATH_INFO: `/v3/projects` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8677a84d-fa1a-49e3-8694-3d2defe0b24b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-72f06fd5-6ac8-45bd-aaf6-650d0e10f743 tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] HTTP exception thrown: The resource could not be found. May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-72f06fd5-6ac8-45bd-aaf6-650d0e10f743 tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] http://10.27.203.238/share/v1/aad888a9f2a84f389022db73cc1424a3/security-services/735b0fae-0304-4c20-8240-64713221bc68 returned with HTTP 404 May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8677a84d-fa1a-49e3-8694-3d2defe0b24b None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 41/67] 10.27.203.238 () {62 vars in 1441 bytes} [Tue May 28 12:56:28 2024] GET /share/v1/aad888a9f2a84f389022db73cc1424a3/security-services/735b0fae-0304-4c20-8240-64713221bc68 => generated 78 bytes in 9 msecs (HTTP/1.1 404) 6 headers in 236 bytes (1 switches on core 0) May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-721c5032-cace-4776-b4f1-6e77489d4301 tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] POST http://10.27.203.238/share/v1/aad888a9f2a84f389022db73cc1424a3/security-services May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-721c5032-cace-4776-b4f1-6e77489d4301 tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] Action: 'create', calling method: SecurityServiceController.create, body: {"security_service": {"type": "ldap", "name": "ss_ldap", "dns_ip": "1.1.1.1", "server": "fake_server_1", "domain": "fake_domain_1", "user": "fake_user", "password": "***"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-721c5032-cace-4776-b4f1-6e77489d4301 tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] http://10.27.203.238/share/v1/aad888a9f2a84f389022db73cc1424a3/security-services returned with HTTP 200 May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 27/68] 10.27.203.238 () {64 vars in 1352 bytes} [Tue May 28 12:56:28 2024] POST /share/v1/aad888a9f2a84f389022db73cc1424a3/security-services => generated 371 bytes in 16 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-86aed1f0-0b01-4cfd-b861-128f22413e3b tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] POST http://10.27.203.238/share/v1/aad888a9f2a84f389022db73cc1424a3/security-services May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-86aed1f0-0b01-4cfd-b861-128f22413e3b tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] Action: 'create', calling method: SecurityServiceController.create, body: {"security_service": {"type": "kerberos", "name": "ss_kerberos", "dns_ip": "2.2.2.2", "server": "fake_server_2", "domain": "fake_domain_2", "user": "test_user", "password": "***"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 706/1394] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 12:56:28 2024] POST /identity/v3/projects => generated 379 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c248258c-2bf3-4d23-9722-fcd9f2648d57 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c248258c-2bf3-4d23-9722-fcd9f2648d57 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-86aed1f0-0b01-4cfd-b861-128f22413e3b tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] http://10.27.203.238/share/v1/aad888a9f2a84f389022db73cc1424a3/security-services returned with HTTP 200 May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 42/69] 10.27.203.238 () {64 vars in 1352 bytes} [Tue May 28 12:56:28 2024] POST /share/v1/aad888a9f2a84f389022db73cc1424a3/security-services => generated 379 bytes in 23 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-69e91692-b7a7-4f10-bf36-288ce8467c56 tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] GET http://10.27.203.238/share/v2/aad888a9f2a84f389022db73cc1424a3/security-services/detail May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-69e91692-b7a7-4f10-bf36-288ce8467c56 tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-69e91692-b7a7-4f10-bf36-288ce8467c56 tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] Calling method 'SecurityServiceController.detail' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4ebc9f-9fbc-4fa8-9b53-3e2183a2f38c None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4ebc9f-9fbc-4fa8-9b53-3e2183a2f38c None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4ebc9f-9fbc-4fa8-9b53-3e2183a2f38c None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4ebc9f-9fbc-4fa8-9b53-3e2183a2f38c None admin] PATH_INFO: `/v3/users` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4ebc9f-9fbc-4fa8-9b53-3e2183a2f38c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4ebc9f-9fbc-4fa8-9b53-3e2183a2f38c None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-69e91692-b7a7-4f10-bf36-288ce8467c56 tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] http://10.27.203.238/share/v2/aad888a9f2a84f389022db73cc1424a3/security-services/detail returned with HTTP 200 May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 28/70] 10.27.203.238 () {64 vars in 1394 bytes} [Tue May 28 12:56:28 2024] GET /share/v2/aad888a9f2a84f389022db73cc1424a3/security-services/detail => generated 801 bytes in 15 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-5e4ebc9f-9fbc-4fa8-9b53-3e2183a2f38c None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-b20dc2b5-93dd-40ad-a8cd-1b49c8e44f44 tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] DELETE http://10.27.203.238/share/v1/aad888a9f2a84f389022db73cc1424a3/security-services/aea0839a-8c96-42ac-b1fa-b4dce5e6e816 May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-b20dc2b5-93dd-40ad-a8cd-1b49c8e44f44 tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-b20dc2b5-93dd-40ad-a8cd-1b49c8e44f44 tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] Calling method 'SecurityServiceController.delete' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.v1.security_service [None req-b20dc2b5-93dd-40ad-a8cd-1b49c8e44f44 tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] Delete security service with id: aea0839a-8c96-42ac-b1fa-b4dce5e6e816 May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 689/1395] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 12:56:28 2024] POST /identity/v3/users => generated 297 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-b20dc2b5-93dd-40ad-a8cd-1b49c8e44f44 tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] http://10.27.203.238/share/v1/aad888a9f2a84f389022db73cc1424a3/security-services/aea0839a-8c96-42ac-b1fa-b4dce5e6e816 returned with HTTP 202 May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 43/71] 10.27.203.238 () {62 vars in 1444 bytes} [Tue May 28 12:56:28 2024] DELETE /share/v1/aad888a9f2a84f389022db73cc1424a3/security-services/aea0839a-8c96-42ac-b1fa-b4dce5e6e816 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 6 headers in 242 bytes (1 switches on core 0) May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8677a84d-fa1a-49e3-8694-3d2defe0b24b None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8677a84d-fa1a-49e3-8694-3d2defe0b24b None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-a4bcb2de-ee08-49c2-a883-00580b03e1e1 tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] GET http://10.27.203.238/share/v1/aad888a9f2a84f389022db73cc1424a3/security-services/aea0839a-8c96-42ac-b1fa-b4dce5e6e816 May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-a4bcb2de-ee08-49c2-a883-00580b03e1e1 tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-a4bcb2de-ee08-49c2-a883-00580b03e1e1 tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] Calling method 'SecurityServiceController.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818ea60d-be8e-4dcf-924d-90e24ae12264 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818ea60d-be8e-4dcf-924d-90e24ae12264 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818ea60d-be8e-4dcf-924d-90e24ae12264 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818ea60d-be8e-4dcf-924d-90e24ae12264 None admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818ea60d-be8e-4dcf-924d-90e24ae12264 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818ea60d-be8e-4dcf-924d-90e24ae12264 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-a4bcb2de-ee08-49c2-a883-00580b03e1e1 tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] HTTP exception thrown: The resource could not be found. May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-a4bcb2de-ee08-49c2-a883-00580b03e1e1 tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] http://10.27.203.238/share/v1/aad888a9f2a84f389022db73cc1424a3/security-services/aea0839a-8c96-42ac-b1fa-b4dce5e6e816 returned with HTTP 404 May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 29/72] 10.27.203.238 () {62 vars in 1441 bytes} [Tue May 28 12:56:28 2024] GET /share/v1/aad888a9f2a84f389022db73cc1424a3/security-services/aea0839a-8c96-42ac-b1fa-b4dce5e6e816 => generated 78 bytes in 8 msecs (HTTP/1.1 404) 6 headers in 236 bytes (1 switches on core 0) May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-24a7983d-fd33-4d26-9378-3e8a6f2d75ad tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] DELETE http://10.27.203.238/share/v1/aad888a9f2a84f389022db73cc1424a3/security-services/66af5f3a-1c25-4430-ac8a-a1b2a9cd9595 May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-24a7983d-fd33-4d26-9378-3e8a6f2d75ad tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 707/1396] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 12:56:28 2024] GET /identity/v3/roles => generated 1680 bytes in 17 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-24a7983d-fd33-4d26-9378-3e8a6f2d75ad tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] Calling method 'SecurityServiceController.delete' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.v1.security_service [None req-24a7983d-fd33-4d26-9378-3e8a6f2d75ad tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] Delete security service with id: 66af5f3a-1c25-4430-ac8a-a1b2a9cd9595 May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4ebc9f-9fbc-4fa8-9b53-3e2183a2f38c None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4ebc9f-9fbc-4fa8-9b53-3e2183a2f38c None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1998bf3-d151-4ec8-a0e8-d7577bc5eef1 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1998bf3-d151-4ec8-a0e8-d7577bc5eef1 None admin] REQUEST_METHOD: `PUT` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1998bf3-d151-4ec8-a0e8-d7577bc5eef1 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1998bf3-d151-4ec8-a0e8-d7577bc5eef1 None admin] PATH_INFO: `/v3/projects/ac91c51acffe4a73a9c0536ad383dcfe/users/25f4074db0594587837805c5c45a0541/roles/e7989893488f483baa107be56668c4f8` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-24a7983d-fd33-4d26-9378-3e8a6f2d75ad tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] http://10.27.203.238/share/v1/aad888a9f2a84f389022db73cc1424a3/security-services/66af5f3a-1c25-4430-ac8a-a1b2a9cd9595 returned with HTTP 202 May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 44/73] 10.27.203.238 () {62 vars in 1444 bytes} [Tue May 28 12:56:28 2024] DELETE /share/v1/aad888a9f2a84f389022db73cc1424a3/security-services/66af5f3a-1c25-4430-ac8a-a1b2a9cd9595 => generated 0 bytes in 21 msecs (HTTP/1.1 202) 6 headers in 242 bytes (1 switches on core 0) May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-b9a0f0af-5100-4472-8344-dcc697240cf8 tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] GET http://10.27.203.238/share/v1/aad888a9f2a84f389022db73cc1424a3/security-services/66af5f3a-1c25-4430-ac8a-a1b2a9cd9595 May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1998bf3-d151-4ec8-a0e8-d7577bc5eef1 None admin] RBAC: Authorizing `identity:create_grant(project_id=ac91c51acffe4a73a9c0536ad383dcfe, user_id=25f4074db0594587837805c5c45a0541, role_id=e7989893488f483baa107be56668c4f8)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-b9a0f0af-5100-4472-8344-dcc697240cf8 tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-b9a0f0af-5100-4472-8344-dcc697240cf8 tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] Calling method 'SecurityServiceController.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1998bf3-d151-4ec8-a0e8-d7577bc5eef1 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-b9a0f0af-5100-4472-8344-dcc697240cf8 tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] HTTP exception thrown: The resource could not be found. May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-b9a0f0af-5100-4472-8344-dcc697240cf8 tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] http://10.27.203.238/share/v1/aad888a9f2a84f389022db73cc1424a3/security-services/66af5f3a-1c25-4430-ac8a-a1b2a9cd9595 returned with HTTP 404 May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 30/74] 10.27.203.238 () {62 vars in 1441 bytes} [Tue May 28 12:56:28 2024] GET /share/v1/aad888a9f2a84f389022db73cc1424a3/security-services/66af5f3a-1c25-4430-ac8a-a1b2a9cd9595 => generated 78 bytes in 8 msecs (HTTP/1.1 404) 6 headers in 236 bytes (1 switches on core 0) May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-35f4347c-cdbc-412e-88e1-c3038427996f tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] POST http://10.27.203.238/share/v1/aad888a9f2a84f389022db73cc1424a3/security-services May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-35f4347c-cdbc-412e-88e1-c3038427996f tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] Action: 'create', calling method: SecurityServiceController.create, body: {"security_service": {"type": "ldap", "name": "ss_ldap", "dns_ip": "1.1.1.1", "server": "fake_server_1", "domain": "fake_domain_1", "user": "fake_user", "password": "***"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 690/1397] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 12:56:28 2024] PUT /identity/v3/projects/ac91c51acffe4a73a9c0536ad383dcfe/users/25f4074db0594587837805c5c45a0541/roles/e7989893488f483baa107be56668c4f8 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818ea60d-be8e-4dcf-924d-90e24ae12264 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818ea60d-be8e-4dcf-924d-90e24ae12264 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-35f4347c-cdbc-412e-88e1-c3038427996f tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] http://10.27.203.238/share/v1/aad888a9f2a84f389022db73cc1424a3/security-services returned with HTTP 200 May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 45/75] 10.27.203.238 () {64 vars in 1352 bytes} [Tue May 28 12:56:28 2024] POST /share/v1/aad888a9f2a84f389022db73cc1424a3/security-services => generated 371 bytes in 15 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-2fe44b53-f89f-4ee4-9242-0687ccc960d1 tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] POST http://10.27.203.238/share/v1/aad888a9f2a84f389022db73cc1424a3/security-services May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-2fe44b53-f89f-4ee4-9242-0687ccc960d1 tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] Action: 'create', calling method: SecurityServiceController.create, body: {"security_service": {"type": "kerberos", "name": "ss_kerberos", "dns_ip": "2.2.2.2", "server": "fake_server_2", "domain": "fake_domain_2", "user": "test_user", "password": "***"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-2fe44b53-f89f-4ee4-9242-0687ccc960d1 tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] http://10.27.203.238/share/v1/aad888a9f2a84f389022db73cc1424a3/security-services returned with HTTP 200 May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 31/76] 10.27.203.238 () {64 vars in 1352 bytes} [Tue May 28 12:56:28 2024] POST /share/v1/aad888a9f2a84f389022db73cc1424a3/security-services => generated 379 bytes in 15 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c35024-8f89-456f-b930-90e2fc7866e2 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c35024-8f89-456f-b930-90e2fc7866e2 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c35024-8f89-456f-b930-90e2fc7866e2 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c35024-8f89-456f-b930-90e2fc7866e2 None admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c35024-8f89-456f-b930-90e2fc7866e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-1768cc03-5ef7-428c-8d63-47a13dded45c tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] GET http://10.27.203.238/share/v2/aad888a9f2a84f389022db73cc1424a3/security-services/detail May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-1768cc03-5ef7-428c-8d63-47a13dded45c tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-1768cc03-5ef7-428c-8d63-47a13dded45c tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] Calling method 'SecurityServiceController.detail' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c35024-8f89-456f-b930-90e2fc7866e2 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 708/1398] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 12:56:28 2024] GET /identity/v3/roles => generated 1680 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1998bf3-d151-4ec8-a0e8-d7577bc5eef1 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-1768cc03-5ef7-428c-8d63-47a13dded45c tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] http://10.27.203.238/share/v2/aad888a9f2a84f389022db73cc1424a3/security-services/detail returned with HTTP 200 May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 46/77] 10.27.203.238 () {64 vars in 1394 bytes} [Tue May 28 12:56:28 2024] GET /share/v2/aad888a9f2a84f389022db73cc1424a3/security-services/detail => generated 851 bytes in 16 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1998bf3-d151-4ec8-a0e8-d7577bc5eef1 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070bd54d-51a1-4ea2-925c-0653787dcb30 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070bd54d-51a1-4ea2-925c-0653787dcb30 None admin] REQUEST_METHOD: `PUT` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070bd54d-51a1-4ea2-925c-0653787dcb30 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070bd54d-51a1-4ea2-925c-0653787dcb30 None admin] PATH_INFO: `/v3/projects/ac91c51acffe4a73a9c0536ad383dcfe/users/25f4074db0594587837805c5c45a0541/roles/e7989893488f483baa107be56668c4f8` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-d25cea9b-922f-479d-aa6c-e82bed0627cb tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] DELETE http://10.27.203.238/share/v1/aad888a9f2a84f389022db73cc1424a3/security-services/ff89cdd9-a3ee-46f9-b438-f240fe7aaf71 May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-d25cea9b-922f-479d-aa6c-e82bed0627cb tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-d25cea9b-922f-479d-aa6c-e82bed0627cb tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] Calling method 'SecurityServiceController.delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.v1.security_service [None req-d25cea9b-922f-479d-aa6c-e82bed0627cb tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] Delete security service with id: ff89cdd9-a3ee-46f9-b438-f240fe7aaf71 May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070bd54d-51a1-4ea2-925c-0653787dcb30 None admin] RBAC: Authorizing `identity:create_grant(project_id=ac91c51acffe4a73a9c0536ad383dcfe, user_id=25f4074db0594587837805c5c45a0541, role_id=e7989893488f483baa107be56668c4f8)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070bd54d-51a1-4ea2-925c-0653787dcb30 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 691/1399] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 12:56:28 2024] PUT /identity/v3/projects/ac91c51acffe4a73a9c0536ad383dcfe/users/25f4074db0594587837805c5c45a0541/roles/e7989893488f483baa107be56668c4f8 => generated 0 bytes in 20 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbadf97-96bb-4aea-a140-c429d00af55a None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbadf97-96bb-4aea-a140-c429d00af55a None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbadf97-96bb-4aea-a140-c429d00af55a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-d25cea9b-922f-479d-aa6c-e82bed0627cb tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] http://10.27.203.238/share/v1/aad888a9f2a84f389022db73cc1424a3/security-services/ff89cdd9-a3ee-46f9-b438-f240fe7aaf71 returned with HTTP 202 May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 32/78] 10.27.203.238 () {62 vars in 1444 bytes} [Tue May 28 12:56:28 2024] DELETE /share/v1/aad888a9f2a84f389022db73cc1424a3/security-services/ff89cdd9-a3ee-46f9-b438-f240fe7aaf71 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 6 headers in 242 bytes (1 switches on core 0) May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-dbbadf97-96bb-4aea-a140-c429d00af55a None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-1763df65-5176-4531-80d1-990ef3c51ada tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] GET http://10.27.203.238/share/v1/aad888a9f2a84f389022db73cc1424a3/security-services/ff89cdd9-a3ee-46f9-b438-f240fe7aaf71 May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-1763df65-5176-4531-80d1-990ef3c51ada tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-1763df65-5176-4531-80d1-990ef3c51ada tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] Calling method 'SecurityServiceController.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-1763df65-5176-4531-80d1-990ef3c51ada tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] HTTP exception thrown: The resource could not be found. May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-1763df65-5176-4531-80d1-990ef3c51ada tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] http://10.27.203.238/share/v1/aad888a9f2a84f389022db73cc1424a3/security-services/ff89cdd9-a3ee-46f9-b438-f240fe7aaf71 returned with HTTP 404 May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 47/79] 10.27.203.238 () {62 vars in 1441 bytes} [Tue May 28 12:56:28 2024] GET /share/v1/aad888a9f2a84f389022db73cc1424a3/security-services/ff89cdd9-a3ee-46f9-b438-f240fe7aaf71 => generated 78 bytes in 9 msecs (HTTP/1.1 404) 6 headers in 236 bytes (1 switches on core 0) May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-dbbadf97-96bb-4aea-a140-c429d00af55a None None] MFA Rules not processed for user `25f4074db0594587837805c5c45a0541`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-dbbadf97-96bb-4aea-a140-c429d00af55a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-805560b7-1c70-4cb8-8f7e-81b8a87cac08 tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] DELETE http://10.27.203.238/share/v1/aad888a9f2a84f389022db73cc1424a3/security-services/736bf31f-5bfe-4114-8500-661dc713e67c May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-805560b7-1c70-4cb8-8f7e-81b8a87cac08 tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-805560b7-1c70-4cb8-8f7e-81b8a87cac08 tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] Calling method 'SecurityServiceController.delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.v1.security_service [None req-805560b7-1c70-4cb8-8f7e-81b8a87cac08 tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] Delete security service with id: 736bf31f-5bfe-4114-8500-661dc713e67c May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-805560b7-1c70-4cb8-8f7e-81b8a87cac08 tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] http://10.27.203.238/share/v1/aad888a9f2a84f389022db73cc1424a3/security-services/736bf31f-5bfe-4114-8500-661dc713e67c returned with HTTP 202 May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 33/80] 10.27.203.238 () {62 vars in 1444 bytes} [Tue May 28 12:56:28 2024] DELETE /share/v1/aad888a9f2a84f389022db73cc1424a3/security-services/736bf31f-5bfe-4114-8500-661dc713e67c => generated 0 bytes in 23 msecs (HTTP/1.1 202) 6 headers in 242 bytes (1 switches on core 0) May 28 12:56:28 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b0b36f71-852d-463a-b1c8-4066ce824def tempest-ExportLocationsTest-1017217578 None] <<< [GET] https://127.0.0.1:40443/api/views/ May 28 12:56:28 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b0b36f71-852d-463a-b1c8-4066ce824def tempest-ExportLocationsTest-1017217578 None] [] May 28 12:56:28 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b0b36f71-852d-463a-b1c8-4066ce824def tempest-ExportLocationsTest-1017217578 None] --- [GET] https://127.0.0.1:40443/api/views/: Done May 28 12:56:28 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b0b36f71-852d-463a-b1c8-4066ce824def tempest-ExportLocationsTest-1017217578 None] >>> [POST] https://127.0.0.1:40443/api/views/ May 28 12:56:28 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b0b36f71-852d-463a-b1c8-4066ce824def tempest-ExportLocationsTest-1017217578 None] {'data': '{"name": "83d10127-dfed-433a-90d1-4f0a7f981edc", "path": ' May 28 12:56:28 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b0b36f71-852d-463a-b1c8-4066ce824def tempest-ExportLocationsTest-1017217578 None] '"/manila/manila-83d10127-dfed-433a-90d1-4f0a7f981edc", "policy_id": ' May 28 12:56:28 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b0b36f71-852d-463a-b1c8-4066ce824def tempest-ExportLocationsTest-1017217578 None] '5, "create_dir": true, "protocols": ["NFS"]}', May 28 12:56:28 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b0b36f71-852d-463a-b1c8-4066ce824def tempest-ExportLocationsTest-1017217578 None] 'json': None, May 28 12:56:28 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b0b36f71-852d-463a-b1c8-4066ce824def tempest-ExportLocationsTest-1017217578 None] 'params': None} May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-9a29de60-f21e-4ecf-907c-ca6bda598f0f tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] GET http://10.27.203.238/share/v1/aad888a9f2a84f389022db73cc1424a3/security-services/736bf31f-5bfe-4114-8500-661dc713e67c May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-9a29de60-f21e-4ecf-907c-ca6bda598f0f tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-9a29de60-f21e-4ecf-907c-ca6bda598f0f tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] Calling method 'SecurityServiceController.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-9a29de60-f21e-4ecf-907c-ca6bda598f0f tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] HTTP exception thrown: The resource could not be found. May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-9a29de60-f21e-4ecf-907c-ca6bda598f0f tempest-SecurityServiceAdminTest-1059168241 tempest-SecurityServiceAdminTest-1059168241-project-admin] http://10.27.203.238/share/v1/aad888a9f2a84f389022db73cc1424a3/security-services/736bf31f-5bfe-4114-8500-661dc713e67c returned with HTTP 404 May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 48/81] 10.27.203.238 () {62 vars in 1441 bytes} [Tue May 28 12:56:28 2024] GET /share/v1/aad888a9f2a84f389022db73cc1424a3/security-services/736bf31f-5bfe-4114-8500-661dc713e67c => generated 78 bytes in 8 msecs (HTTP/1.1 404) 6 headers in 236 bytes (1 switches on core 0) May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070bd54d-51a1-4ea2-925c-0653787dcb30 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-070bd54d-51a1-4ea2-925c-0653787dcb30 None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 709/1400] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:56:28 2024] POST /identity/v3/auth/tokens => generated 4073 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbadf97-96bb-4aea-a140-c429d00af55a None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbadf97-96bb-4aea-a140-c429d00af55a None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa3d044-795f-4b77-9b73-b072d783f8ef None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070bd54d-51a1-4ea2-925c-0653787dcb30 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa3d044-795f-4b77-9b73-b072d783f8ef None admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa3d044-795f-4b77-9b73-b072d783f8ef None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa3d044-795f-4b77-9b73-b072d783f8ef None admin] PATH_INFO: `/v3/users/25f4074db0594587837805c5c45a0541` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa3d044-795f-4b77-9b73-b072d783f8ef None admin] RBAC: Authorizing `identity:delete_user(user_id=25f4074db0594587837805c5c45a0541)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa3d044-795f-4b77-9b73-b072d783f8ef None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfdb966-6df7-43f4-a32e-e03e4a7bd17b None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfdb966-6df7-43f4-a32e-e03e4a7bd17b None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfdb966-6df7-43f4-a32e-e03e4a7bd17b None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfdb966-6df7-43f4-a32e-e03e4a7bd17b None admin] PATH_INFO: `/v3/users/2a14b5073e084364801a58ca6689b9be` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfdb966-6df7-43f4-a32e-e03e4a7bd17b None admin] RBAC: Authorizing `identity:delete_user(user_id=2a14b5073e084364801a58ca6689b9be)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfdb966-6df7-43f4-a32e-e03e4a7bd17b None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-ffa3d044-795f-4b77-9b73-b072d783f8ef None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25f4074db0594587837805c5c45a0541', 'request_id': 'req-ffa3d044-795f-4b77-9b73-b072d783f8ef'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:28 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-fc403043-74e2-4b87-a388-18694293b445 tempest-AdminActionsNegativeTest-763023849 None] <<< [POST] https://127.0.0.1:40443/api/quotas/ May 28 12:56:28 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-fc403043-74e2-4b87-a388-18694293b445 tempest-AdminActionsNegativeTest-763023849 None] Bunch(cluster='loop75-kfs', cluster_id=1, default_email=None, default_group_quota=None, default_user_quota=None, enable_alarms=True, enable_email_providers=True, grace_period=None, group_quotas=[], guid='ff6f6fdd-2236-48ab-83ca-902f3e1f5933', hard_limit=1073741824, hard_limit_inodes=None, id=3, internal=False, is_user_quota=False, last_user_quotas_update=None, name='5ae9ae15-dc00-44c8-891a-9758f2b29855', num_blocked_users=0, num_exceeded_users=0, path='/manila/manila-5ae9ae15-dc00-44c8-891a-9758f2b29855', percent_capacity=0, percent_inodes=None, pretty_grace_period=None, pretty_grace_period_expiration=None, pretty_state='OK (CREATED)', soft_limit=None, soft_limit_inodes=None, state='OK', sync_state='CREATED', system_id=3, tenant_id=1, tenant_name='default', time_to_block=None, title='5ae9ae15-dc00-44c8-891a-9758f2b29855', url='https://127.0.0.1:40443/api/quotas/3/', used_capacity=0, used_capacity_tb=0.0, used_effective_capacity=0, used_effective_capacity_tb=0.0, used_inodes=0, used_limited_capacity=0, user_quotas=[]) May 28 12:56:28 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-fc403043-74e2-4b87-a388-18694293b445 tempest-AdminActionsNegativeTest-763023849 None] --- [POST] https://127.0.0.1:40443/api/quotas/: Done May 28 12:56:28 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-fc403043-74e2-4b87-a388-18694293b445 tempest-AdminActionsNegativeTest-763023849 None] >>> [GET] https://127.0.0.1:40443/api/views/ May 28 12:56:28 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-fc403043-74e2-4b87-a388-18694293b445 tempest-AdminActionsNegativeTest-763023849 None] {'allow_redirects': True, May 28 12:56:28 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-fc403043-74e2-4b87-a388-18694293b445 tempest-AdminActionsNegativeTest-763023849 None] 'params': {'name': '5ae9ae15-dc00-44c8-891a-9758f2b29855'}} May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-ecfdb966-6df7-43f4-a32e-e03e4a7bd17b None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a14b5073e084364801a58ca6689b9be', 'request_id': 'req-ecfdb966-6df7-43f4-a32e-e03e4a7bd17b'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-ecfdb966-6df7-43f4-a32e-e03e4a7bd17b None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a14b5073e084364801a58ca6689b9be', 'request_id': 'req-ecfdb966-6df7-43f4-a32e-e03e4a7bd17b'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-ffa3d044-795f-4b77-9b73-b072d783f8ef None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25f4074db0594587837805c5c45a0541', 'request_id': 'req-ffa3d044-795f-4b77-9b73-b072d783f8ef'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-ffa3d044-795f-4b77-9b73-b072d783f8ef None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25f4074db0594587837805c5c45a0541', 'request_id': 'req-ffa3d044-795f-4b77-9b73-b072d783f8ef'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-ffa3d044-795f-4b77-9b73-b072d783f8ef None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25f4074db0594587837805c5c45a0541', 'request_id': 'req-ffa3d044-795f-4b77-9b73-b072d783f8ef'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-ecfdb966-6df7-43f4-a32e-e03e4a7bd17b None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a14b5073e084364801a58ca6689b9be', 'request_id': 'req-ecfdb966-6df7-43f4-a32e-e03e4a7bd17b'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-ecfdb966-6df7-43f4-a32e-e03e4a7bd17b None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a14b5073e084364801a58ca6689b9be', 'request_id': 'req-ecfdb966-6df7-43f4-a32e-e03e4a7bd17b'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-ecfdb966-6df7-43f4-a32e-e03e4a7bd17b None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a14b5073e084364801a58ca6689b9be', 'request_id': 'req-ecfdb966-6df7-43f4-a32e-e03e4a7bd17b'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-ffa3d044-795f-4b77-9b73-b072d783f8ef None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25f4074db0594587837805c5c45a0541', 'request_id': 'req-ffa3d044-795f-4b77-9b73-b072d783f8ef'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 710/1401] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 12:56:28 2024] DELETE /identity/v3/users/25f4074db0594587837805c5c45a0541 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a845c2eb-0389-4b16-b71e-c76358d9aa61 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a845c2eb-0389-4b16-b71e-c76358d9aa61 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a845c2eb-0389-4b16-b71e-c76358d9aa61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 692/1402] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 12:56:28 2024] DELETE /identity/v3/users/2a14b5073e084364801a58ca6689b9be => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464f42f7-2179-471a-8360-b359c0cd2aef None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464f42f7-2179-471a-8360-b359c0cd2aef None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464f42f7-2179-471a-8360-b359c0cd2aef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-a845c2eb-0389-4b16-b71e-c76358d9aa61 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-a845c2eb-0389-4b16-b71e-c76358d9aa61 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-a845c2eb-0389-4b16-b71e-c76358d9aa61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-464f42f7-2179-471a-8360-b359c0cd2aef None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-464f42f7-2179-471a-8360-b359c0cd2aef None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-464f42f7-2179-471a-8360-b359c0cd2aef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 711/1403] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:56:28 2024] POST /identity/v3/auth/tokens => generated 2960 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 12:56:28 l75lg1-v1 neutron-server[77618]: DEBUG neutron.wsgi [-] (77618) accepted ('10.27.203.238', 55980) {{(pid=77618) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a845c2eb-0389-4b16-b71e-c76358d9aa61 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-a845c2eb-0389-4b16-b71e-c76358d9aa61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 693/1404] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:56:28 2024] POST /identity/v3/auth/tokens => generated 2960 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 28 12:56:28 l75lg1-v1 neutron-server[77619]: DEBUG neutron.wsgi [-] (77619) accepted ('10.27.203.238', 55986) {{(pid=77619) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464f42f7-2179-471a-8360-b359c0cd2aef None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-464f42f7-2179-471a-8360-b359c0cd2aef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a845c2eb-0389-4b16-b71e-c76358d9aa61 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ba343e-7328-41bd-8306-bf37094f4ab7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef17047035e4b518fd5360a01f2da1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ba343e-7328-41bd-8306-bf37094f4ab7 service neutron] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ba343e-7328-41bd-8306-bf37094f4ab7 service neutron] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ba343e-7328-41bd-8306-bf37094f4ab7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ba343e-7328-41bd-8306-bf37094f4ab7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ba343e-7328-41bd-8306-bf37094f4ab7 service neutron] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464f42f7-2179-471a-8360-b359c0cd2aef None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 712/1405] 10.27.203.238 () {64 vars in 1432 bytes} [Tue May 28 12:56:28 2024] GET /identity/v3/auth/tokens => generated 2960 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d37647-8db4-451a-9cd5-14a77ed99faf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef17047035e4b518fd5360a01f2da1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d37647-8db4-451a-9cd5-14a77ed99faf service neutron] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d37647-8db4-451a-9cd5-14a77ed99faf service neutron] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d37647-8db4-451a-9cd5-14a77ed99faf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-cafb1fb4-d973-4b50-ba2d-fffa45448838 tempest-AdminActionsNegativeTest-763023849 tempest-AdminActionsNegativeTest-763023849-project-admin] GET http://10.27.203.238/share/v2/7c36a466cc2a42b195f921474b0f4de5/shares/415272bd-25d1-465a-87fc-b0fdbc8c093c May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-cafb1fb4-d973-4b50-ba2d-fffa45448838 tempest-AdminActionsNegativeTest-763023849 tempest-AdminActionsNegativeTest-763023849-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-cafb1fb4-d973-4b50-ba2d-fffa45448838 tempest-AdminActionsNegativeTest-763023849 tempest-AdminActionsNegativeTest-763023849-project-admin] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d37647-8db4-451a-9cd5-14a77ed99faf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d37647-8db4-451a-9cd5-14a77ed99faf service neutron] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:28 l75lg1-v1 neutron-server[77618]: INFO neutron.wsgi [None req-9d671c15-2f66-421a-834e-827454dd4571 None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=ac91c51acffe4a73a9c0536ad383dcfe&name=default HTTP/1.1" status: 200 len: 216 time: 0.0742719 May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 694/1406] 10.27.203.238 () {64 vars in 1432 bytes} [Tue May 28 12:56:28 2024] GET /identity/v3/auth/tokens => generated 2960 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ba343e-7328-41bd-8306-bf37094f4ab7 service neutron] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-d2ba343e-7328-41bd-8306-bf37094f4ab7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ba343e-7328-41bd-8306-bf37094f4ab7 service neutron] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:28 l75lg1-v1 neutron-server[77619]: INFO neutron.wsgi [None req-de551b90-9eb3-487c-8f4e-11d1310d5191 None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=aad888a9f2a84f389022db73cc1424a3&name=default HTTP/1.1" status: 200 len: 216 time: 0.0775049 May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d37647-8db4-451a-9cd5-14a77ed99faf service neutron] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b6cfc9-6287-4f9c-b6f9-86d1e8fe9a97 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b6cfc9-6287-4f9c-b6f9-86d1e8fe9a97 None admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b6cfc9-6287-4f9c-b6f9-86d1e8fe9a97 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b6cfc9-6287-4f9c-b6f9-86d1e8fe9a97 None admin] PATH_INFO: `/v3/projects/ac91c51acffe4a73a9c0536ad383dcfe` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-cafb1fb4-d973-4b50-ba2d-fffa45448838 tempest-AdminActionsNegativeTest-763023849 tempest-AdminActionsNegativeTest-763023849-project-admin] http://10.27.203.238/share/v2/7c36a466cc2a42b195f921474b0f4de5/shares/415272bd-25d1-465a-87fc-b0fdbc8c093c returned with HTTP 200 May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-40d37647-8db4-451a-9cd5-14a77ed99faf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b6cfc9-6287-4f9c-b6f9-86d1e8fe9a97 None admin] RBAC: Authorizing `identity:delete_project(project_id=ac91c51acffe4a73a9c0536ad383dcfe)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:28 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 34/82] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:56:28 2024] GET /share/v2/7c36a466cc2a42b195f921474b0f4de5/shares/415272bd-25d1-465a-87fc-b0fdbc8c093c => generated 1370 bytes in 28 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:56:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b6cfc9-6287-4f9c-b6f9-86d1e8fe9a97 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d37647-8db4-451a-9cd5-14a77ed99faf service neutron] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7643032-05e3-424b-b591-491b0b8a4510 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7643032-05e3-424b-b591-491b0b8a4510 None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7643032-05e3-424b-b591-491b0b8a4510 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7643032-05e3-424b-b591-491b0b8a4510 None admin] PATH_INFO: `/v3/projects/aad888a9f2a84f389022db73cc1424a3` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7643032-05e3-424b-b591-491b0b8a4510 None admin] RBAC: Authorizing `identity:delete_project(project_id=aad888a9f2a84f389022db73cc1424a3)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7643032-05e3-424b-b591-491b0b8a4510 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-50b6cfc9-6287-4f9c-b6f9-86d1e8fe9a97 None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac91c51acffe4a73a9c0536ad383dcfe', 'request_id': 'req-50b6cfc9-6287-4f9c-b6f9-86d1e8fe9a97'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-50b6cfc9-6287-4f9c-b6f9-86d1e8fe9a97 None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac91c51acffe4a73a9c0536ad383dcfe', 'request_id': 'req-50b6cfc9-6287-4f9c-b6f9-86d1e8fe9a97'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-50b6cfc9-6287-4f9c-b6f9-86d1e8fe9a97 None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac91c51acffe4a73a9c0536ad383dcfe', 'request_id': 'req-50b6cfc9-6287-4f9c-b6f9-86d1e8fe9a97'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-b7643032-05e3-424b-b591-491b0b8a4510 None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aad888a9f2a84f389022db73cc1424a3', 'request_id': 'req-b7643032-05e3-424b-b591-491b0b8a4510'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-b7643032-05e3-424b-b591-491b0b8a4510 None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aad888a9f2a84f389022db73cc1424a3', 'request_id': 'req-b7643032-05e3-424b-b591-491b0b8a4510'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-50b6cfc9-6287-4f9c-b6f9-86d1e8fe9a97 None admin] The token cache is being invalidate because project ac91c51acffe4a73a9c0536ad383dcfe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-50b6cfc9-6287-4f9c-b6f9-86d1e8fe9a97 None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-50b6cfc9-6287-4f9c-b6f9-86d1e8fe9a97 None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 713/1407] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 12:56:28 2024] DELETE /identity/v3/projects/ac91c51acffe4a73a9c0536ad383dcfe => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-b7643032-05e3-424b-b591-491b0b8a4510 None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aad888a9f2a84f389022db73cc1424a3', 'request_id': 'req-b7643032-05e3-424b-b591-491b0b8a4510'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa476991-217a-4d66-9c05-3dfffec2875a None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa476991-217a-4d66-9c05-3dfffec2875a None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa476991-217a-4d66-9c05-3dfffec2875a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-b7643032-05e3-424b-b591-491b0b8a4510 None admin] The token cache is being invalidate because project aad888a9f2a84f389022db73cc1424a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-b7643032-05e3-424b-b591-491b0b8a4510 None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-b7643032-05e3-424b-b591-491b0b8a4510 None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 695/1408] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 12:56:28 2024] DELETE /identity/v3/projects/aad888a9f2a84f389022db73cc1424a3 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-aa476991-217a-4d66-9c05-3dfffec2875a None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-aa476991-217a-4d66-9c05-3dfffec2875a None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-aa476991-217a-4d66-9c05-3dfffec2875a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b21cab-c159-4e5b-b0f5-824d55bd327d None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b21cab-c159-4e5b-b0f5-824d55bd327d None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b21cab-c159-4e5b-b0f5-824d55bd327d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 714/1409] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:56:29 2024] POST /identity/v3/auth/tokens => generated 312 bytes in 20 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44edeb35-5968-4407-9502-f2eb3be2f1a2 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44edeb35-5968-4407-9502-f2eb3be2f1a2 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44edeb35-5968-4407-9502-f2eb3be2f1a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-d4b21cab-c159-4e5b-b0f5-824d55bd327d None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-d4b21cab-c159-4e5b-b0f5-824d55bd327d None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-d4b21cab-c159-4e5b-b0f5-824d55bd327d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-44edeb35-5968-4407-9502-f2eb3be2f1a2 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 696/1410] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:56:29 2024] POST /identity/v3/auth/tokens => generated 312 bytes in 20 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-44edeb35-5968-4407-9502-f2eb3be2f1a2 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-44edeb35-5968-4407-9502-f2eb3be2f1a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e208a69f-264d-4f78-9a55-44690bb4f847 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e208a69f-264d-4f78-9a55-44690bb4f847 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e208a69f-264d-4f78-9a55-44690bb4f847 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-e208a69f-264d-4f78-9a55-44690bb4f847 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-e208a69f-264d-4f78-9a55-44690bb4f847 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-e208a69f-264d-4f78-9a55-44690bb4f847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 715/1411] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:56:29 2024] POST /identity/v3/auth/tokens => generated 2960 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44edeb35-5968-4407-9502-f2eb3be2f1a2 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44edeb35-5968-4407-9502-f2eb3be2f1a2 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532865a7-c243-4b65-a98e-2ca7a2f1fe38 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532865a7-c243-4b65-a98e-2ca7a2f1fe38 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532865a7-c243-4b65-a98e-2ca7a2f1fe38 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532865a7-c243-4b65-a98e-2ca7a2f1fe38 None admin] PATH_INFO: `/v3/domains` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532865a7-c243-4b65-a98e-2ca7a2f1fe38 None admin] RBAC: Adding query filter params (name=Default) {{(pid=51267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532865a7-c243-4b65-a98e-2ca7a2f1fe38 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532865a7-c243-4b65-a98e-2ca7a2f1fe38 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 697/1412] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:56:29 2024] POST /identity/v3/auth/tokens => generated 2960 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 716/1413] 10.27.203.238 () {62 vars in 1220 bytes} [Tue May 28 12:56:29 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e208a69f-264d-4f78-9a55-44690bb4f847 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532865a7-c243-4b65-a98e-2ca7a2f1fe38 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532865a7-c243-4b65-a98e-2ca7a2f1fe38 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e208a69f-264d-4f78-9a55-44690bb4f847 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095ac378-f6f2-40d2-beb6-7873229de40e None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095ac378-f6f2-40d2-beb6-7873229de40e None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095ac378-f6f2-40d2-beb6-7873229de40e None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095ac378-f6f2-40d2-beb6-7873229de40e None admin] PATH_INFO: `/v3/projects` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095ac378-f6f2-40d2-beb6-7873229de40e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fa05e2-35e4-41e2-a868-57af7f3a319d None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095ac378-f6f2-40d2-beb6-7873229de40e None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fa05e2-35e4-41e2-a868-57af7f3a319d None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fa05e2-35e4-41e2-a868-57af7f3a319d None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fa05e2-35e4-41e2-a868-57af7f3a319d None admin] PATH_INFO: `/v3/domains` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fa05e2-35e4-41e2-a868-57af7f3a319d None admin] RBAC: Adding query filter params (name=Default) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fa05e2-35e4-41e2-a868-57af7f3a319d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fa05e2-35e4-41e2-a868-57af7f3a319d None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 698/1414] 10.27.203.238 () {62 vars in 1220 bytes} [Tue May 28 12:56:29 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fa05e2-35e4-41e2-a868-57af7f3a319d None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fa05e2-35e4-41e2-a868-57af7f3a319d None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeebbf2-3334-4ac5-9ace-a829703619e7 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeebbf2-3334-4ac5-9ace-a829703619e7 None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeebbf2-3334-4ac5-9ace-a829703619e7 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeebbf2-3334-4ac5-9ace-a829703619e7 None admin] PATH_INFO: `/v3/projects` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaeebbf2-3334-4ac5-9ace-a829703619e7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaeebbf2-3334-4ac5-9ace-a829703619e7 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 717/1415] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 12:56:29 2024] POST /identity/v3/projects => generated 375 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095ac378-f6f2-40d2-beb6-7873229de40e None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 699/1416] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 12:56:29 2024] POST /identity/v3/projects => generated 395 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeebbf2-3334-4ac5-9ace-a829703619e7 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095ac378-f6f2-40d2-beb6-7873229de40e None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:29 l75lg1-v1 dstat.sh[49771]: 28-05 12:56:29| 19 2 75 3 0|5628M 1884M 277M 7837M| 17k 20k| 0 2757k| 0 411 | 11k 20k|1.76 0.96 0.98|4.0 1.0 0| 0 0 | 0 2048M| 29 343 0 36 0 May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeebbf2-3334-4ac5-9ace-a829703619e7 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6bea56-cbad-459d-b329-e7dd7144cb2f None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6bea56-cbad-459d-b329-e7dd7144cb2f None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6bea56-cbad-459d-b329-e7dd7144cb2f None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6bea56-cbad-459d-b329-e7dd7144cb2f None admin] PATH_INFO: `/v3/users` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6bea56-cbad-459d-b329-e7dd7144cb2f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55110bad-e8db-4b45-8752-c233d5df51f1 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55110bad-e8db-4b45-8752-c233d5df51f1 None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6bea56-cbad-459d-b329-e7dd7144cb2f None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55110bad-e8db-4b45-8752-c233d5df51f1 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55110bad-e8db-4b45-8752-c233d5df51f1 None admin] PATH_INFO: `/v3/users` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55110bad-e8db-4b45-8752-c233d5df51f1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55110bad-e8db-4b45-8752-c233d5df51f1 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-fe6bea56-cbad-459d-b329-e7dd7144cb2f None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-55110bad-e8db-4b45-8752-c233d5df51f1 None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 718/1417] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 12:56:29 2024] POST /identity/v3/users => generated 295 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6bea56-cbad-459d-b329-e7dd7144cb2f None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 700/1418] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 12:56:29 2024] POST /identity/v3/users => generated 306 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6bea56-cbad-459d-b329-e7dd7144cb2f None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55110bad-e8db-4b45-8752-c233d5df51f1 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497293ae-b107-4cb5-8c41-a4e6bfcf1052 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497293ae-b107-4cb5-8c41-a4e6bfcf1052 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497293ae-b107-4cb5-8c41-a4e6bfcf1052 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497293ae-b107-4cb5-8c41-a4e6bfcf1052 None admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497293ae-b107-4cb5-8c41-a4e6bfcf1052 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497293ae-b107-4cb5-8c41-a4e6bfcf1052 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55110bad-e8db-4b45-8752-c233d5df51f1 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da6cce8-f84c-4852-887d-038e20548193 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da6cce8-f84c-4852-887d-038e20548193 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da6cce8-f84c-4852-887d-038e20548193 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 719/1419] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 12:56:29 2024] GET /identity/v3/roles => generated 1680 bytes in 16 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da6cce8-f84c-4852-887d-038e20548193 None admin] PATH_INFO: `/v3/roles` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da6cce8-f84c-4852-887d-038e20548193 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da6cce8-f84c-4852-887d-038e20548193 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497293ae-b107-4cb5-8c41-a4e6bfcf1052 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:29 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-3a47ce09-c8c0-4938-92e8-423050f78f81 tempest-AdminActionsTest-1749172189 None] <<< [POST] https://127.0.0.1:40443/api/views/ May 28 12:56:29 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-3a47ce09-c8c0-4938-92e8-423050f78f81 tempest-AdminActionsTest-1749172189 None] Bunch(abac_tags=[], abe_max_depth=None, abe_protocols=[], alias='', allow_anonymous_access=False, allow_s3_anonymous_access=False, auto_commit='0d', bucket='', bucket_creators=[], bucket_creators_groups=[], bucket_owner=None, bulk_permission_update_progress=None, bulk_permission_update_state=None, cluster='loop75-kfs', cluster_id=1, created='2024-05-28T12:56:28.966384Z', enabled=True, files_retention_mode='NONE', guid='2129ed17-4cc5-4119-86d1-459930d8696c', id=3, ignore_oos=False, internal=False, is_remote=False, is_seamless=False, logical_capacity=0, max_retention_period=None, min_retention_period=None, name='77a25e6b-f137-4342-8eb9-9ced679515e2', nfs_interop_flags='BOTH_NFS3_AND_NFS4_INTEROP_DISABLED', path='/manila/manila-77a25e6b-f137-4342-8eb9-9ced679515e2', physical_capacity=0, policy='77a25e6b-f137-4342-8eb9-9ced679515e2', policy_id=4, protocols=['NFS'], qos_policy=None, qos_policy_id=None, s3_locks=False, s3_locks_retention_mode='NONE', s3_locks_retention_period='', s3_object_ownership_rule='ObjectWriter', s3_unverified_lookup=False, s3_versioning=False, select_for_live_monitoring=False, share='', share_acl=Bunch(acl=[], enabled=False), sync='SYNCED', sync_time='2024-05-28T12:56:29.242403Z', tenant_id=1, tenant_name='default', title='/manila/manila-77a25e6b-f137-4342-8eb9-9ced679515e2', url='https://127.0.0.1:40443/api/views/3/') May 28 12:56:29 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-3a47ce09-c8c0-4938-92e8-423050f78f81 tempest-AdminActionsTest-1749172189 None] --- [POST] https://127.0.0.1:40443/api/views/: Done May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497293ae-b107-4cb5-8c41-a4e6bfcf1052 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 701/1420] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 12:56:29 2024] GET /identity/v3/roles => generated 1680 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c692b8c6-8fa9-422b-a323-927c093f1f2d None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c692b8c6-8fa9-422b-a323-927c093f1f2d None admin] REQUEST_METHOD: `PUT` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c692b8c6-8fa9-422b-a323-927c093f1f2d None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c692b8c6-8fa9-422b-a323-927c093f1f2d None admin] PATH_INFO: `/v3/projects/fb2c57cefad04e97a990bd936225014d/users/cade0f2d0a774d6b8f7d1abf63c40a18/roles/e7989893488f483baa107be56668c4f8` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da6cce8-f84c-4852-887d-038e20548193 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da6cce8-f84c-4852-887d-038e20548193 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6184556d-3232-4b05-adc8-e31bce74ea8c None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6184556d-3232-4b05-adc8-e31bce74ea8c None admin] REQUEST_METHOD: `PUT` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6184556d-3232-4b05-adc8-e31bce74ea8c None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6184556d-3232-4b05-adc8-e31bce74ea8c None admin] PATH_INFO: `/v3/projects/1bca8eeba9b24ed3933a4e22129b02fa/users/9f5e944b30cb44d1922375f0e0fb9892/roles/44620cad10ae407c90c91e2c296adb04` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c692b8c6-8fa9-422b-a323-927c093f1f2d None admin] RBAC: Authorizing `identity:create_grant(project_id=fb2c57cefad04e97a990bd936225014d, user_id=cade0f2d0a774d6b8f7d1abf63c40a18, role_id=e7989893488f483baa107be56668c4f8)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c692b8c6-8fa9-422b-a323-927c093f1f2d None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6184556d-3232-4b05-adc8-e31bce74ea8c None admin] RBAC: Authorizing `identity:create_grant(project_id=1bca8eeba9b24ed3933a4e22129b02fa, user_id=9f5e944b30cb44d1922375f0e0fb9892, role_id=44620cad10ae407c90c91e2c296adb04)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6184556d-3232-4b05-adc8-e31bce74ea8c None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 720/1421] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 12:56:29 2024] PUT /identity/v3/projects/fb2c57cefad04e97a990bd936225014d/users/cade0f2d0a774d6b8f7d1abf63c40a18/roles/e7989893488f483baa107be56668c4f8 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c692b8c6-8fa9-422b-a323-927c093f1f2d None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 702/1422] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 12:56:29 2024] PUT /identity/v3/projects/1bca8eeba9b24ed3933a4e22129b02fa/users/9f5e944b30cb44d1922375f0e0fb9892/roles/44620cad10ae407c90c91e2c296adb04 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edf1611-416e-4510-adc4-ae873a77c5fe None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edf1611-416e-4510-adc4-ae873a77c5fe None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edf1611-416e-4510-adc4-ae873a77c5fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-5edf1611-416e-4510-adc4-ae873a77c5fe None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:56:29 l75lg1-v1 manila-share[98474]: INFO manila.share.manager [None req-3a47ce09-c8c0-4938-92e8-423050f78f81 tempest-AdminActionsTest-1749172189 None] Share instance 77a25e6b-f137-4342-8eb9-9ced679515e2 created successfully. May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c692b8c6-8fa9-422b-a323-927c093f1f2d None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-5edf1611-416e-4510-adc4-ae873a77c5fe None None] MFA Rules not processed for user `9f5e944b30cb44d1922375f0e0fb9892`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-5edf1611-416e-4510-adc4-ae873a77c5fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe378d81-06d5-4736-b4bb-06372ef82b73 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe378d81-06d5-4736-b4bb-06372ef82b73 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe378d81-06d5-4736-b4bb-06372ef82b73 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe378d81-06d5-4736-b4bb-06372ef82b73 None admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe378d81-06d5-4736-b4bb-06372ef82b73 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe378d81-06d5-4736-b4bb-06372ef82b73 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 721/1423] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 12:56:29 2024] GET /identity/v3/roles => generated 1680 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:56:29 l75lg1-v1 neutron-server[77623]: DEBUG dbcounter [-] [77623] Writing DB stats neutron:SELECT=1 {{(pid=77623) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe378d81-06d5-4736-b4bb-06372ef82b73 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe378d81-06d5-4736-b4bb-06372ef82b73 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4bd0e9-9b4b-4aef-9b16-99a65bfc65c6 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4bd0e9-9b4b-4aef-9b16-99a65bfc65c6 None admin] REQUEST_METHOD: `PUT` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4bd0e9-9b4b-4aef-9b16-99a65bfc65c6 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4bd0e9-9b4b-4aef-9b16-99a65bfc65c6 None admin] PATH_INFO: `/v3/projects/fb2c57cefad04e97a990bd936225014d/users/cade0f2d0a774d6b8f7d1abf63c40a18/roles/e7989893488f483baa107be56668c4f8` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4bd0e9-9b4b-4aef-9b16-99a65bfc65c6 None admin] RBAC: Authorizing `identity:create_grant(project_id=fb2c57cefad04e97a990bd936225014d, user_id=cade0f2d0a774d6b8f7d1abf63c40a18, role_id=e7989893488f483baa107be56668c4f8)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4bd0e9-9b4b-4aef-9b16-99a65bfc65c6 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 722/1424] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 12:56:29 2024] PUT /identity/v3/projects/fb2c57cefad04e97a990bd936225014d/users/cade0f2d0a774d6b8f7d1abf63c40a18/roles/e7989893488f483baa107be56668c4f8 => generated 0 bytes in 19 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 703/1425] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:56:29 2024] POST /identity/v3/auth/tokens => generated 3966 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8a22ef-0d94-4989-b219-a5e425df583c None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8a22ef-0d94-4989-b219-a5e425df583c None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8a22ef-0d94-4989-b219-a5e425df583c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edf1611-416e-4510-adc4-ae873a77c5fe None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edf1611-416e-4510-adc4-ae873a77c5fe None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-3e8a22ef-0d94-4989-b219-a5e425df583c None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-3e8a22ef-0d94-4989-b219-a5e425df583c None None] MFA Rules not processed for user `cade0f2d0a774d6b8f7d1abf63c40a18`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-3e8a22ef-0d94-4989-b219-a5e425df583c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1734092-f7ea-4f87-b2be-4259cc92b964 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1734092-f7ea-4f87-b2be-4259cc92b964 None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1734092-f7ea-4f87-b2be-4259cc92b964 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1734092-f7ea-4f87-b2be-4259cc92b964 None admin] PATH_INFO: `/v3/projects` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1734092-f7ea-4f87-b2be-4259cc92b964 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1734092-f7ea-4f87-b2be-4259cc92b964 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:29 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-fc403043-74e2-4b87-a388-18694293b445 tempest-AdminActionsNegativeTest-763023849 None] <<< [GET] https://127.0.0.1:40443/api/views/ May 28 12:56:29 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-fc403043-74e2-4b87-a388-18694293b445 tempest-AdminActionsNegativeTest-763023849 None] [] May 28 12:56:29 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-fc403043-74e2-4b87-a388-18694293b445 tempest-AdminActionsNegativeTest-763023849 None] --- [GET] https://127.0.0.1:40443/api/views/: Done May 28 12:56:29 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-fc403043-74e2-4b87-a388-18694293b445 tempest-AdminActionsNegativeTest-763023849 None] >>> [POST] https://127.0.0.1:40443/api/views/ May 28 12:56:29 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-fc403043-74e2-4b87-a388-18694293b445 tempest-AdminActionsNegativeTest-763023849 None] {'data': '{"name": "5ae9ae15-dc00-44c8-891a-9758f2b29855", "path": ' May 28 12:56:29 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-fc403043-74e2-4b87-a388-18694293b445 tempest-AdminActionsNegativeTest-763023849 None] '"/manila/manila-5ae9ae15-dc00-44c8-891a-9758f2b29855", "policy_id": ' May 28 12:56:29 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-fc403043-74e2-4b87-a388-18694293b445 tempest-AdminActionsNegativeTest-763023849 None] '6, "create_dir": true, "protocols": ["NFS"]}', May 28 12:56:29 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-fc403043-74e2-4b87-a388-18694293b445 tempest-AdminActionsNegativeTest-763023849 None] 'json': None, May 28 12:56:29 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-fc403043-74e2-4b87-a388-18694293b445 tempest-AdminActionsNegativeTest-763023849 None] 'params': None} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 704/1426] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 12:56:29 2024] POST /identity/v3/projects => generated 397 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:56:29 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b0b36f71-852d-463a-b1c8-4066ce824def tempest-ExportLocationsTest-1017217578 None] <<< [POST] https://127.0.0.1:40443/api/views/ May 28 12:56:29 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b0b36f71-852d-463a-b1c8-4066ce824def tempest-ExportLocationsTest-1017217578 None] Bunch(abac_tags=[], abe_max_depth=None, abe_protocols=[], alias='', allow_anonymous_access=False, allow_s3_anonymous_access=False, auto_commit='0d', bucket='', bucket_creators=[], bucket_creators_groups=[], bucket_owner=None, bulk_permission_update_progress=None, bulk_permission_update_state=None, cluster='loop75-kfs', cluster_id=1, created='2024-05-28T12:56:29.152322Z', enabled=True, files_retention_mode='NONE', guid='ab5b9fdb-7f1c-4d56-8c1d-0f4b364a9d90', id=4, ignore_oos=False, internal=False, is_remote=False, is_seamless=False, logical_capacity=0, max_retention_period=None, min_retention_period=None, name='83d10127-dfed-433a-90d1-4f0a7f981edc', nfs_interop_flags='BOTH_NFS3_AND_NFS4_INTEROP_DISABLED', path='/manila/manila-83d10127-dfed-433a-90d1-4f0a7f981edc', physical_capacity=0, policy='83d10127-dfed-433a-90d1-4f0a7f981edc', policy_id=5, protocols=['NFS'], qos_policy=None, qos_policy_id=None, s3_locks=False, s3_locks_retention_mode='NONE', s3_locks_retention_period='', s3_object_ownership_rule='ObjectWriter', s3_unverified_lookup=False, s3_versioning=False, select_for_live_monitoring=False, share='', share_acl=Bunch(acl=[], enabled=False), sync='SYNCED', sync_time='2024-05-28T12:56:29.438641Z', tenant_id=1, tenant_name='default', title='/manila/manila-83d10127-dfed-433a-90d1-4f0a7f981edc', url='https://127.0.0.1:40443/api/views/4/') May 28 12:56:29 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b0b36f71-852d-463a-b1c8-4066ce824def tempest-ExportLocationsTest-1017217578 None] --- [POST] https://127.0.0.1:40443/api/views/: Done May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1734092-f7ea-4f87-b2be-4259cc92b964 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 723/1427] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:56:29 2024] POST /identity/v3/auth/tokens => generated 4069 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8a22ef-0d94-4989-b219-a5e425df583c None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-3e8a22ef-0d94-4989-b219-a5e425df583c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1734092-f7ea-4f87-b2be-4259cc92b964 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57f3d81-14b2-4a74-99f7-a0442156ef11 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57f3d81-14b2-4a74-99f7-a0442156ef11 None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57f3d81-14b2-4a74-99f7-a0442156ef11 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57f3d81-14b2-4a74-99f7-a0442156ef11 None admin] PATH_INFO: `/v3/users` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57f3d81-14b2-4a74-99f7-a0442156ef11 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:29 l75lg1-v1 manila-share[98474]: INFO manila.share.manager [None req-b0b36f71-852d-463a-b1c8-4066ce824def tempest-ExportLocationsTest-1017217578 None] Share instance 83d10127-dfed-433a-90d1-4f0a7f981edc created successfully. May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57f3d81-14b2-4a74-99f7-a0442156ef11 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-e57f3d81-14b2-4a74-99f7-a0442156ef11 None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 705/1428] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 12:56:29 2024] POST /identity/v3/users => generated 307 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57f3d81-14b2-4a74-99f7-a0442156ef11 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8a22ef-0d94-4989-b219-a5e425df583c None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57f3d81-14b2-4a74-99f7-a0442156ef11 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6d3cde-c6c2-460f-81db-9914263fdcb1 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6d3cde-c6c2-460f-81db-9914263fdcb1 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6d3cde-c6c2-460f-81db-9914263fdcb1 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6d3cde-c6c2-460f-81db-9914263fdcb1 None admin] PATH_INFO: `/v3/roles` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6d3cde-c6c2-460f-81db-9914263fdcb1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6d3cde-c6c2-460f-81db-9914263fdcb1 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 706/1429] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 12:56:29 2024] GET /identity/v3/roles => generated 1680 bytes in 17 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6d3cde-c6c2-460f-81db-9914263fdcb1 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6d3cde-c6c2-460f-81db-9914263fdcb1 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a08d91-963f-416a-a9ab-a2c8336211dc None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a08d91-963f-416a-a9ab-a2c8336211dc None admin] REQUEST_METHOD: `PUT` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a08d91-963f-416a-a9ab-a2c8336211dc None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a08d91-963f-416a-a9ab-a2c8336211dc None admin] PATH_INFO: `/v3/projects/253ed41a20ee44d78459dfca720df0c1/users/a92743ff6cad4a188702b79ad1cbd4cd/roles/44620cad10ae407c90c91e2c296adb04` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ca9473-ae1c-44d9-b485-6dd7e9cbec42 service manila] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f110cf6300f049c897d0aab63218d1e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ca9473-ae1c-44d9-b485-6dd7e9cbec42 service manila] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ca9473-ae1c-44d9-b485-6dd7e9cbec42 service manila] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ca9473-ae1c-44d9-b485-6dd7e9cbec42 service manila] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a08d91-963f-416a-a9ab-a2c8336211dc None admin] RBAC: Authorizing `identity:create_grant(project_id=253ed41a20ee44d78459dfca720df0c1, user_id=a92743ff6cad4a188702b79ad1cbd4cd, role_id=44620cad10ae407c90c91e2c296adb04)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a08d91-963f-416a-a9ab-a2c8336211dc None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 707/1430] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 12:56:29 2024] PUT /identity/v3/projects/253ed41a20ee44d78459dfca720df0c1/users/a92743ff6cad4a188702b79ad1cbd4cd/roles/44620cad10ae407c90c91e2c296adb04 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7121d09-2093-417b-874f-48c469ca7ded None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7121d09-2093-417b-874f-48c469ca7ded None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7121d09-2093-417b-874f-48c469ca7ded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-a7121d09-2093-417b-874f-48c469ca7ded None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-a7121d09-2093-417b-874f-48c469ca7ded None None] MFA Rules not processed for user `a92743ff6cad4a188702b79ad1cbd4cd`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-a7121d09-2093-417b-874f-48c469ca7ded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ca9473-ae1c-44d9-b485-6dd7e9cbec42 service manila] RBAC: Authorizing `identity:validate_token()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ca9473-ae1c-44d9-b485-6dd7e9cbec42 service manila] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 724/1431] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 12:56:29 2024] GET /identity/v3/auth/tokens => generated 4069 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 12:56:29 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-ab24d62d-d33c-4d16-a3d5-b4e16d78f37a tempest-ShareInstancesTest-1546991288 tempest-ShareInstancesTest-1546991288-project-admin] POST http://10.27.203.238/share/v2/fb2c57cefad04e97a990bd936225014d/types May 28 12:56:29 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-ab24d62d-d33c-4d16-a3d5-b4e16d78f37a tempest-ShareInstancesTest-1546991288 tempest-ShareInstancesTest-1546991288-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share_type": {"name": "tempest-typeshare-type-153024600", "extra_specs": {"driver_handles_share_servers": "False"}, "share_type_access:is_public": true}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:56:29 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-ab24d62d-d33c-4d16-a3d5-b4e16d78f37a tempest-ShareInstancesTest-1546991288 tempest-ShareInstancesTest-1546991288-project-admin] http://10.27.203.238/share/v2/fb2c57cefad04e97a990bd936225014d/types returned with HTTP 200 May 28 12:56:29 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 49/83] 10.27.203.238 () {66 vars in 1359 bytes} [Tue May 28 12:56:29 2024] POST /share/v2/fb2c57cefad04e97a990bd936225014d/types => generated 621 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:56:29 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-434ed059-1547-4868-b57b-46613126e982 tempest-ShareInstancesTest-1546991288 tempest-ShareInstancesTest-1546991288-project-admin] POST http://10.27.203.238/share/v2/fb2c57cefad04e97a990bd936225014d/shares May 28 12:56:29 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-434ed059-1547-4868-b57b-46613126e982 tempest-ShareInstancesTest-1546991288 tempest-ShareInstancesTest-1546991288-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share": {"share_proto": "nfs", "description": "Tempest's share", "snapshot_id": null, "name": "tempest-tempest-created-share-594040996", "size": 1, "metadata": {}, "is_public": false, "share_type": "95f6e9a5-0efd-43ed-82de-580b838468cd"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:56:29 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.v1.shares [None req-434ed059-1547-4868-b57b-46613126e982 tempest-ShareInstancesTest-1546991288 tempest-ShareInstancesTest-1546991288-project-admin] Create NFS share of 1 GB May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 708/1432] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:56:29 2024] POST /identity/v3/auth/tokens => generated 3968 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ca9473-ae1c-44d9-b485-6dd7e9cbec42 service manila] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ca9473-ae1c-44d9-b485-6dd7e9cbec42 service manila] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f442b9-a27e-46fc-8cb4-83d200127f9e None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f442b9-a27e-46fc-8cb4-83d200127f9e None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f442b9-a27e-46fc-8cb4-83d200127f9e None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f442b9-a27e-46fc-8cb4-83d200127f9e None admin] PATH_INFO: `/v3/projects` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f442b9-a27e-46fc-8cb4-83d200127f9e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f442b9-a27e-46fc-8cb4-83d200127f9e None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 725/1433] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 12:56:29 2024] POST /identity/v3/projects => generated 397 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:56:29 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.quota [None req-434ed059-1547-4868-b57b-46613126e982 tempest-ShareInstancesTest-1546991288 tempest-ShareInstancesTest-1546991288-project-admin] Created reservations ['a4e29364-d518-41b6-b010-666187b5aa83', '20cac7db-e7c2-467f-9dcf-dabe12f510b9', 'ed656b05-25b8-4636-8e7b-d9c9b3921d57', 'd6d1ce5a-b69b-4f2d-8456-e7cc77baa559'] {{(pid=98330) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7121d09-2093-417b-874f-48c469ca7ded None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7121d09-2093-417b-874f-48c469ca7ded None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247ab734-005a-49c0-825d-9131c3956b86 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247ab734-005a-49c0-825d-9131c3956b86 None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247ab734-005a-49c0-825d-9131c3956b86 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247ab734-005a-49c0-825d-9131c3956b86 None admin] PATH_INFO: `/v3/users` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247ab734-005a-49c0-825d-9131c3956b86 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247ab734-005a-49c0-825d-9131c3956b86 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:29 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.quota [None req-434ed059-1547-4868-b57b-46613126e982 tempest-ShareInstancesTest-1546991288 tempest-ShareInstancesTest-1546991288-project-admin] Committed reservations ['a4e29364-d518-41b6-b010-666187b5aa83', '20cac7db-e7c2-467f-9dcf-dabe12f510b9', 'ed656b05-25b8-4636-8e7b-d9c9b3921d57', 'd6d1ce5a-b69b-4f2d-8456-e7cc77baa559'] {{(pid=98330) commit /opt/stack/manila/manila/quota.py:1063}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-247ab734-005a-49c0-825d-9131c3956b86 None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 709/1434] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 12:56:29 2024] POST /identity/v3/users => generated 306 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f442b9-a27e-46fc-8cb4-83d200127f9e None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f442b9-a27e-46fc-8cb4-83d200127f9e None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e868326-629e-44c5-81f5-0227cec46761 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e868326-629e-44c5-81f5-0227cec46761 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e868326-629e-44c5-81f5-0227cec46761 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e868326-629e-44c5-81f5-0227cec46761 None admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e868326-629e-44c5-81f5-0227cec46761 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e868326-629e-44c5-81f5-0227cec46761 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 726/1435] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 12:56:29 2024] GET /identity/v3/roles => generated 1680 bytes in 18 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247ab734-005a-49c0-825d-9131c3956b86 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247ab734-005a-49c0-825d-9131c3956b86 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:29 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-434ed059-1547-4868-b57b-46613126e982 tempest-ShareInstancesTest-1546991288 None] Starting with 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:80}} May 28 12:56:29 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-434ed059-1547-4868-b57b-46613126e982 tempest-ShareInstancesTest-1546991288 None] Filter OnlyHostFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:56:29 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-434ed059-1547-4868-b57b-46613126e982 tempest-ShareInstancesTest-1546991288 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:56:29 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.capacity [None req-434ed059-1547-4868-b57b-46613126e982 tempest-ShareInstancesTest-1546991288 None] Space information for share creation on host l75lg1-v1@vast#vast (requested / avail): 1/2079 {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/capacity.py:83}} May 28 12:56:29 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-434ed059-1547-4868-b57b-46613126e982 tempest-ShareInstancesTest-1546991288 None] Filter CapacityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:56:29 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-434ed059-1547-4868-b57b-46613126e982 tempest-ShareInstancesTest-1546991288 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:56:29 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-434ed059-1547-4868-b57b-46613126e982 tempest-ShareInstancesTest-1546991288 None] Driver Filter: Checking host 'l75lg1-v1@vast#vast' {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:37}} May 28 12:56:29 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-434ed059-1547-4868-b57b-46613126e982 tempest-ShareInstancesTest-1546991288 None] Filter function not set :: passing host. {{(pid=98327) _check_filter_function /opt/stack/manila/manila/scheduler/filters/driver.py:53}} May 28 12:56:29 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-434ed059-1547-4868-b57b-46613126e982 tempest-ShareInstancesTest-1546991288 None] Result: True {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:40}} May 28 12:56:29 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-434ed059-1547-4868-b57b-46613126e982 tempest-ShareInstancesTest-1546991288 None] Done checking host 'l75lg1-v1@vast#vast' {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:41}} May 28 12:56:29 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-434ed059-1547-4868-b57b-46613126e982 tempest-ShareInstancesTest-1546991288 None] Filter DriverFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:56:29 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-434ed059-1547-4868-b57b-46613126e982 tempest-ShareInstancesTest-1546991288 None] Filter ShareReplicationFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:56:29 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-434ed059-1547-4868-b57b-46613126e982 tempest-ShareInstancesTest-1546991288 None] Filter CreateFromSnapshotFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:56:29 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-434ed059-1547-4868-b57b-46613126e982 tempest-ShareInstancesTest-1546991288 None] Filter AffinityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5873516-88a6-46a0-aed6-176961460053 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:29 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-434ed059-1547-4868-b57b-46613126e982 tempest-ShareInstancesTest-1546991288 tempest-ShareInstancesTest-1546991288-project-admin] http://10.27.203.238/share/v2/fb2c57cefad04e97a990bd936225014d/shares returned with HTTP 200 May 28 12:56:29 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-434ed059-1547-4868-b57b-46613126e982 tempest-ShareInstancesTest-1546991288 None] Filter AntiAffinityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:56:29 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 35/84] 10.27.203.238 () {66 vars in 1362 bytes} [Tue May 28 12:56:29 2024] POST /share/v2/fb2c57cefad04e97a990bd936225014d/shares => generated 1348 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5873516-88a6-46a0-aed6-176961460053 None admin] REQUEST_METHOD: `PUT` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:29 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.drivers.filter [None req-434ed059-1547-4868-b57b-46613126e982 tempest-ShareInstancesTest-1546991288 None] Filtered share [host: 'l75lg1-v1@vast#vast', free_capacity_gb: 2079.6229242384434, pools: None] {{(pid=98327) _schedule_share /opt/stack/manila/manila/scheduler/drivers/filter.py:268}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5873516-88a6-46a0-aed6-176961460053 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5873516-88a6-46a0-aed6-176961460053 None admin] PATH_INFO: `/v3/projects/65281ccd31474a87add11c1811bbcba4/users/841e80f8aabe4ccda3a5ddaf7fd39c3d/roles/e7989893488f483baa107be56668c4f8` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:29 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-434ed059-1547-4868-b57b-46613126e982 tempest-ShareInstancesTest-1546991288 None] Checking host 'l75lg1-v1@vast#vast' {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:46}} May 28 12:56:29 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.weighers.goodness [None req-434ed059-1547-4868-b57b-46613126e982 tempest-ShareInstancesTest-1546991288 None] Goodness function not set :: defaulting to minimal goodness rating of 0. May 28 12:56:29 l75lg1-v1 manila-scheduler[98327]: INFO manila.scheduler.weighers.goodness [None req-434ed059-1547-4868-b57b-46613126e982 tempest-ShareInstancesTest-1546991288 None] Goodness function result for host l75lg1-v1@vast#vast: 0. May 28 12:56:29 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-434ed059-1547-4868-b57b-46613126e982 tempest-ShareInstancesTest-1546991288 None] Goodness: 0 {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:48}} May 28 12:56:29 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-434ed059-1547-4868-b57b-46613126e982 tempest-ShareInstancesTest-1546991288 None] Done checking host 'l75lg1-v1@vast#vast' {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:49}} May 28 12:56:29 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.drivers.filter [None req-434ed059-1547-4868-b57b-46613126e982 tempest-ShareInstancesTest-1546991288 None] Choosing for share: WeighedHost [host: l75lg1-v1@vast#vast, weight: 0.0] {{(pid=98327) _schedule_share /opt/stack/manila/manila/scheduler/drivers/filter.py:274}} May 28 12:56:29 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-0341ae0b-f649-4759-94c6-bfa72a443f2d tempest-ShareInstancesTest-1546991288 tempest-ShareInstancesTest-1546991288-project-admin] GET http://10.27.203.238/share/v2/fb2c57cefad04e97a990bd936225014d/shares/2dfffda2-1f3a-4d2e-9044-2255a211a9f0 May 28 12:56:29 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-0341ae0b-f649-4759-94c6-bfa72a443f2d tempest-ShareInstancesTest-1546991288 tempest-ShareInstancesTest-1546991288-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:29 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-0341ae0b-f649-4759-94c6-bfa72a443f2d tempest-ShareInstancesTest-1546991288 tempest-ShareInstancesTest-1546991288-project-admin] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5873516-88a6-46a0-aed6-176961460053 None admin] RBAC: Authorizing `identity:create_grant(project_id=65281ccd31474a87add11c1811bbcba4, user_id=841e80f8aabe4ccda3a5ddaf7fd39c3d, role_id=e7989893488f483baa107be56668c4f8)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5873516-88a6-46a0-aed6-176961460053 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 710/1436] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 12:56:29 2024] PUT /identity/v3/projects/65281ccd31474a87add11c1811bbcba4/users/841e80f8aabe4ccda3a5ddaf7fd39c3d/roles/e7989893488f483baa107be56668c4f8 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e868326-629e-44c5-81f5-0227cec46761 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:29 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-0341ae0b-f649-4759-94c6-bfa72a443f2d tempest-ShareInstancesTest-1546991288 tempest-ShareInstancesTest-1546991288-project-admin] http://10.27.203.238/share/v2/fb2c57cefad04e97a990bd936225014d/shares/2dfffda2-1f3a-4d2e-9044-2255a211a9f0 returned with HTTP 200 May 28 12:56:29 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 50/85] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:56:29 2024] GET /share/v2/fb2c57cefad04e97a990bd936225014d/shares/2dfffda2-1f3a-4d2e-9044-2255a211a9f0 => generated 1348 bytes in 29 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e868326-629e-44c5-81f5-0227cec46761 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d57ded-0dfd-41cf-87e3-3692c642004c None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d57ded-0dfd-41cf-87e3-3692c642004c None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d57ded-0dfd-41cf-87e3-3692c642004c None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d57ded-0dfd-41cf-87e3-3692c642004c None admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d57ded-0dfd-41cf-87e3-3692c642004c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d57ded-0dfd-41cf-87e3-3692c642004c None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 727/1437] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 12:56:29 2024] GET /identity/v3/roles => generated 1680 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5873516-88a6-46a0-aed6-176961460053 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5873516-88a6-46a0-aed6-176961460053 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e3084e-37c4-4d56-87ef-78a400f92332 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e3084e-37c4-4d56-87ef-78a400f92332 None admin] REQUEST_METHOD: `PUT` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e3084e-37c4-4d56-87ef-78a400f92332 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e3084e-37c4-4d56-87ef-78a400f92332 None admin] PATH_INFO: `/v3/projects/65281ccd31474a87add11c1811bbcba4/users/841e80f8aabe4ccda3a5ddaf7fd39c3d/roles/e7989893488f483baa107be56668c4f8` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e3084e-37c4-4d56-87ef-78a400f92332 None admin] RBAC: Authorizing `identity:create_grant(project_id=65281ccd31474a87add11c1811bbcba4, user_id=841e80f8aabe4ccda3a5ddaf7fd39c3d, role_id=e7989893488f483baa107be56668c4f8)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e3084e-37c4-4d56-87ef-78a400f92332 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 711/1438] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 12:56:29 2024] PUT /identity/v3/projects/65281ccd31474a87add11c1811bbcba4/users/841e80f8aabe4ccda3a5ddaf7fd39c3d/roles/e7989893488f483baa107be56668c4f8 => generated 0 bytes in 21 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:56:29 l75lg1-v1 nova-conductor[83648]: DEBUG dbcounter [-] [83648] Writing DB stats nova_cell1:SELECT=1 {{(pid=83648) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2b3964-0670-4ece-bc5b-a95805a7cedf None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2b3964-0670-4ece-bc5b-a95805a7cedf None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2b3964-0670-4ece-bc5b-a95805a7cedf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-cc2b3964-0670-4ece-bc5b-a95805a7cedf None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-cc2b3964-0670-4ece-bc5b-a95805a7cedf None None] MFA Rules not processed for user `841e80f8aabe4ccda3a5ddaf7fd39c3d`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:56:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-cc2b3964-0670-4ece-bc5b-a95805a7cedf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:29 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-434ed059-1547-4868-b57b-46613126e982 tempest-ShareInstancesTest-1546991288 None] >>> [GET] https://127.0.0.1:40443/api/vippools/ May 28 12:56:29 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-434ed059-1547-4868-b57b-46613126e982 tempest-ShareInstancesTest-1546991288 None] {'allow_redirects': True, 'params': {'name': 'vippool-1'}} May 28 12:56:30 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 728/1439] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:56:29 2024] POST /identity/v3/auth/tokens => generated 4091 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:56:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e3084e-37c4-4d56-87ef-78a400f92332 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e3084e-37c4-4d56-87ef-78a400f92332 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d4e9ad-4379-4e72-bbde-e114f9236742 tempest-ShareServersNegativeAdminTest-1564821148 tempest-ShareServersNegativeAdminTest-1564821148-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '841e80f8aabe4ccda3a5ddaf7fd39c3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65281ccd31474a87add11c1811bbcba4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d4e9ad-4379-4e72-bbde-e114f9236742 tempest-ShareServersNegativeAdminTest-1564821148 tempest-ShareServersNegativeAdminTest-1564821148-project-admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d4e9ad-4379-4e72-bbde-e114f9236742 tempest-ShareServersNegativeAdminTest-1564821148 tempest-ShareServersNegativeAdminTest-1564821148-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d4e9ad-4379-4e72-bbde-e114f9236742 tempest-ShareServersNegativeAdminTest-1564821148 tempest-ShareServersNegativeAdminTest-1564821148-project-admin] PATH_INFO: `/v3/domains` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d4e9ad-4379-4e72-bbde-e114f9236742 tempest-ShareServersNegativeAdminTest-1564821148 tempest-ShareServersNegativeAdminTest-1564821148-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:56:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d4e9ad-4379-4e72-bbde-e114f9236742 tempest-ShareServersNegativeAdminTest-1564821148 tempest-ShareServersNegativeAdminTest-1564821148-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d4e9ad-4379-4e72-bbde-e114f9236742 tempest-ShareServersNegativeAdminTest-1564821148 tempest-ShareServersNegativeAdminTest-1564821148-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:30 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 712/1440] 10.27.203.238 () {62 vars in 1241 bytes} [Tue May 28 12:56:30 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:56:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2b3964-0670-4ece-bc5b-a95805a7cedf None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2b3964-0670-4ece-bc5b-a95805a7cedf None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8686c4-8a7d-4841-a363-3847c5636523 tempest-ShareServersNegativeAdminTest-1564821148 tempest-ShareServersNegativeAdminTest-1564821148-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '841e80f8aabe4ccda3a5ddaf7fd39c3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65281ccd31474a87add11c1811bbcba4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8686c4-8a7d-4841-a363-3847c5636523 tempest-ShareServersNegativeAdminTest-1564821148 tempest-ShareServersNegativeAdminTest-1564821148-project-admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8686c4-8a7d-4841-a363-3847c5636523 tempest-ShareServersNegativeAdminTest-1564821148 tempest-ShareServersNegativeAdminTest-1564821148-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8686c4-8a7d-4841-a363-3847c5636523 tempest-ShareServersNegativeAdminTest-1564821148 tempest-ShareServersNegativeAdminTest-1564821148-project-admin] PATH_INFO: `/v3/users` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8686c4-8a7d-4841-a363-3847c5636523 tempest-ShareServersNegativeAdminTest-1564821148 tempest-ShareServersNegativeAdminTest-1564821148-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8686c4-8a7d-4841-a363-3847c5636523 tempest-ShareServersNegativeAdminTest-1564821148 tempest-ShareServersNegativeAdminTest-1564821148-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:30 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-3b8686c4-8a7d-4841-a363-3847c5636523 tempest-ShareServersNegativeAdminTest-1564821148 tempest-ShareServersNegativeAdminTest-1564821148-project-admin] Truncating password to algorithm specific maximum length 72 characters. May 28 12:56:30 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 729/1441] 10.27.203.238 () {64 vars in 1232 bytes} [Tue May 28 12:56:30 2024] POST /identity/v3/users => generated 433 bytes in 29 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:56:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d4e9ad-4379-4e72-bbde-e114f9236742 tempest-ShareServersNegativeAdminTest-1564821148 tempest-ShareServersNegativeAdminTest-1564821148-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d4e9ad-4379-4e72-bbde-e114f9236742 tempest-ShareServersNegativeAdminTest-1564821148 tempest-ShareServersNegativeAdminTest-1564821148-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c9d74c-af22-492c-82d8-ac3788b05806 tempest-ShareServersNegativeAdminTest-1564821148 tempest-ShareServersNegativeAdminTest-1564821148-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '841e80f8aabe4ccda3a5ddaf7fd39c3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65281ccd31474a87add11c1811bbcba4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c9d74c-af22-492c-82d8-ac3788b05806 tempest-ShareServersNegativeAdminTest-1564821148 tempest-ShareServersNegativeAdminTest-1564821148-project-admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c9d74c-af22-492c-82d8-ac3788b05806 tempest-ShareServersNegativeAdminTest-1564821148 tempest-ShareServersNegativeAdminTest-1564821148-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c9d74c-af22-492c-82d8-ac3788b05806 tempest-ShareServersNegativeAdminTest-1564821148 tempest-ShareServersNegativeAdminTest-1564821148-project-admin] PATH_INFO: `/v3/roles` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c9d74c-af22-492c-82d8-ac3788b05806 tempest-ShareServersNegativeAdminTest-1564821148 tempest-ShareServersNegativeAdminTest-1564821148-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c9d74c-af22-492c-82d8-ac3788b05806 tempest-ShareServersNegativeAdminTest-1564821148 tempest-ShareServersNegativeAdminTest-1564821148-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:30 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 713/1442] 10.27.203.238 () {62 vars in 1210 bytes} [Tue May 28 12:56:30 2024] GET /identity/v3/roles => generated 1680 bytes in 19 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:56:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8686c4-8a7d-4841-a363-3847c5636523 tempest-ShareServersNegativeAdminTest-1564821148 tempest-ShareServersNegativeAdminTest-1564821148-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8686c4-8a7d-4841-a363-3847c5636523 tempest-ShareServersNegativeAdminTest-1564821148 tempest-ShareServersNegativeAdminTest-1564821148-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd47eb50-d0bf-4846-a08e-aa988f39405e tempest-ShareServersNegativeAdminTest-1564821148 tempest-ShareServersNegativeAdminTest-1564821148-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '841e80f8aabe4ccda3a5ddaf7fd39c3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65281ccd31474a87add11c1811bbcba4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd47eb50-d0bf-4846-a08e-aa988f39405e tempest-ShareServersNegativeAdminTest-1564821148 tempest-ShareServersNegativeAdminTest-1564821148-project-admin] REQUEST_METHOD: `PUT` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd47eb50-d0bf-4846-a08e-aa988f39405e tempest-ShareServersNegativeAdminTest-1564821148 tempest-ShareServersNegativeAdminTest-1564821148-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd47eb50-d0bf-4846-a08e-aa988f39405e tempest-ShareServersNegativeAdminTest-1564821148 tempest-ShareServersNegativeAdminTest-1564821148-project-admin] PATH_INFO: `/v3/projects/65281ccd31474a87add11c1811bbcba4/users/981b3e419ab1466ba64538f100d39f99/roles/44620cad10ae407c90c91e2c296adb04` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd47eb50-d0bf-4846-a08e-aa988f39405e tempest-ShareServersNegativeAdminTest-1564821148 tempest-ShareServersNegativeAdminTest-1564821148-project-admin] RBAC: Authorizing `identity:create_grant(project_id=65281ccd31474a87add11c1811bbcba4, user_id=981b3e419ab1466ba64538f100d39f99, role_id=44620cad10ae407c90c91e2c296adb04)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd47eb50-d0bf-4846-a08e-aa988f39405e tempest-ShareServersNegativeAdminTest-1564821148 tempest-ShareServersNegativeAdminTest-1564821148-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:30 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 730/1443] 10.27.203.238 () {64 vars in 1571 bytes} [Tue May 28 12:56:30 2024] PUT /identity/v3/projects/65281ccd31474a87add11c1811bbcba4/users/981b3e419ab1466ba64538f100d39f99/roles/44620cad10ae407c90c91e2c296adb04 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:56:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c9d74c-af22-492c-82d8-ac3788b05806 tempest-ShareServersNegativeAdminTest-1564821148 tempest-ShareServersNegativeAdminTest-1564821148-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-58c9d74c-af22-492c-82d8-ac3788b05806 tempest-ShareServersNegativeAdminTest-1564821148 tempest-ShareServersNegativeAdminTest-1564821148-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c9d74c-af22-492c-82d8-ac3788b05806 tempest-ShareServersNegativeAdminTest-1564821148 tempest-ShareServersNegativeAdminTest-1564821148-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:30 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-fc403043-74e2-4b87-a388-18694293b445 tempest-AdminActionsNegativeTest-763023849 None] <<< [POST] https://127.0.0.1:40443/api/views/ May 28 12:56:30 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-fc403043-74e2-4b87-a388-18694293b445 tempest-AdminActionsNegativeTest-763023849 None] Bunch(abac_tags=[], abe_max_depth=None, abe_protocols=[], alias='', allow_anonymous_access=False, allow_s3_anonymous_access=False, auto_commit='0d', bucket='', bucket_creators=[], bucket_creators_groups=[], bucket_owner=None, bulk_permission_update_progress=None, bulk_permission_update_state=None, cluster='loop75-kfs', cluster_id=1, created='2024-05-28T12:56:29.916189Z', enabled=True, files_retention_mode='NONE', guid='dbf223a9-d53e-4626-9dec-c695925bacad', id=5, ignore_oos=False, internal=False, is_remote=False, is_seamless=False, logical_capacity=0, max_retention_period=None, min_retention_period=None, name='5ae9ae15-dc00-44c8-891a-9758f2b29855', nfs_interop_flags='BOTH_NFS3_AND_NFS4_INTEROP_DISABLED', path='/manila/manila-5ae9ae15-dc00-44c8-891a-9758f2b29855', physical_capacity=0, policy='5ae9ae15-dc00-44c8-891a-9758f2b29855', policy_id=6, protocols=['NFS'], qos_policy=None, qos_policy_id=None, s3_locks=False, s3_locks_retention_mode='NONE', s3_locks_retention_period='', s3_object_ownership_rule='ObjectWriter', s3_unverified_lookup=False, s3_versioning=False, select_for_live_monitoring=False, share='', share_acl=Bunch(acl=[], enabled=False), sync='SYNCED', sync_time='2024-05-28T12:56:30.167373Z', tenant_id=1, tenant_name='default', title='/manila/manila-5ae9ae15-dc00-44c8-891a-9758f2b29855', url='https://127.0.0.1:40443/api/views/5/') May 28 12:56:30 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-fc403043-74e2-4b87-a388-18694293b445 tempest-AdminActionsNegativeTest-763023849 None] --- [POST] https://127.0.0.1:40443/api/views/: Done May 28 12:56:30 l75lg1-v1 dstat.sh[49771]: 28-05 12:56:30| 18 2 77 3 0|5629M 1883M 277M 7838M| 21k 2003B| 0 3044k| 0 441 | 11k 19k|1.76 0.96 0.98|2.0 0 0| 0 0 | 0 2048M| 29 343 0 36 0 May 28 12:56:30 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-434ed059-1547-4868-b57b-46613126e982 tempest-ShareInstancesTest-1546991288 None] <<< [GET] https://127.0.0.1:40443/api/vippools/ May 28 12:56:30 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-434ed059-1547-4868-b57b-46613126e982 tempest-ShareInstancesTest-1546991288 None] [Bunch(active_cnode_ids=[], active_interfaces=4, cluster='loop75-kfs', cluster_id=1, cnode_ids=[], cnodes=[], domain_name='vippool-1', enable_l3=False, enable_weighted_balancing=False, enabled=True, end_ip='172.21.75.4', guid='f2abaede-b397-413a-8faa-3aeead6d3b28', gw_ip='', gw_ipv6='', id=2, ip_ranges=[['172.21.75.1', '172.21.75.4']], name='vippool-1', peer_asn=0, port_membership='ALL', ranges_summary='172.21.75.[1-4]', role='PROTOCOLS', start_ip='172.21.75.1', subnet_cidr=16, subnet_cidr_ipv6=None, sync='SYNCED', sync_time='2024-05-28T12:50:09.644123Z', tenant_id=1, tenant_name='default', title='172.21.75.1 - 172.21.75.4', url='https://127.0.0.1:40443/api/vippools/2/', vast_asn=0, vlan=0, vms_preferred=False)] May 28 12:56:30 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-434ed059-1547-4868-b57b-46613126e982 tempest-ShareInstancesTest-1546991288 None] --- [GET] https://127.0.0.1:40443/api/vippools/: Done May 28 12:56:30 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-434ed059-1547-4868-b57b-46613126e982 tempest-ShareInstancesTest-1546991288 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:56:30 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-434ed059-1547-4868-b57b-46613126e982 tempest-ShareInstancesTest-1546991288 None] {'allow_redirects': True, May 28 12:56:30 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-434ed059-1547-4868-b57b-46613126e982 tempest-ShareInstancesTest-1546991288 None] 'params': {'name': '7f6a42fa-4d45-471e-a438-36876fc6eac8'}} May 28 12:56:30 l75lg1-v1 manila-share[98474]: INFO manila.share.manager [None req-fc403043-74e2-4b87-a388-18694293b445 tempest-AdminActionsNegativeTest-763023849 None] Share instance 5ae9ae15-dc00-44c8-891a-9758f2b29855 created successfully. May 28 12:56:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90484be3-8928-405a-9a9e-7b78236d1dcf service manila] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f110cf6300f049c897d0aab63218d1e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90484be3-8928-405a-9a9e-7b78236d1dcf service manila] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90484be3-8928-405a-9a9e-7b78236d1dcf service manila] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90484be3-8928-405a-9a9e-7b78236d1dcf service manila] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:30 l75lg1-v1 neutron-server[77618]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.HashRingHealthCheckPeriodics.touch_hash_ring_nodes' {{(pid=77618) _process_scheduled /opt/stack/data/venv/lib/python3.10/site-packages/futurist/periodics.py:638}} May 28 12:56:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90484be3-8928-405a-9a9e-7b78236d1dcf service manila] RBAC: Authorizing `identity:validate_token()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90484be3-8928-405a-9a9e-7b78236d1dcf service manila] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:30 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 714/1444] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 12:56:30 2024] GET /identity/v3/auth/tokens => generated 3966 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 12:56:30 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-b07578b2-34f9-472a-935f-8af1fd797531 tempest-ShareServersNegativeAdminTest-723866093 tempest-ShareServersNegativeAdminTest-723866093-project-member] DELETE http://10.27.203.238/share/v2/1bca8eeba9b24ed3933a4e22129b02fa/share-servers/fake_nonexistent_share_server_id May 28 12:56:30 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-b07578b2-34f9-472a-935f-8af1fd797531 tempest-ShareServersNegativeAdminTest-723866093 tempest-ShareServersNegativeAdminTest-723866093-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:30 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-b07578b2-34f9-472a-935f-8af1fd797531 tempest-ShareServersNegativeAdminTest-723866093 tempest-ShareServersNegativeAdminTest-723866093-project-member] Calling method 'ShareServerController.delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:30 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.policy [None req-b07578b2-34f9-472a-935f-8af1fd797531 tempest-ShareServersNegativeAdminTest-723866093 tempest-ShareServersNegativeAdminTest-723866093-project-member] Policy check for share_server:delete failed with credentials {'is_admin': False, 'user_id': '9f5e944b30cb44d1922375f0e0fb9892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bca8eeba9b24ed3933a4e22129b02fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98330) authorize /opt/stack/manila/manila/policy.py:208}} May 28 12:56:30 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-b07578b2-34f9-472a-935f-8af1fd797531 tempest-ShareServersNegativeAdminTest-723866093 tempest-ShareServersNegativeAdminTest-723866093-project-member] HTTP exception thrown: Access was denied to this resource. May 28 12:56:30 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-b07578b2-34f9-472a-935f-8af1fd797531 tempest-ShareServersNegativeAdminTest-723866093 tempest-ShareServersNegativeAdminTest-723866093-project-member] http://10.27.203.238/share/v2/1bca8eeba9b24ed3933a4e22129b02fa/share-servers/fake_nonexistent_share_server_id returned with HTTP 403 May 28 12:56:30 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 36/86] 10.27.203.238 () {64 vars in 1463 bytes} [Tue May 28 12:56:30 2024] DELETE /share/v2/1bca8eeba9b24ed3933a4e22129b02fa/share-servers/fake_nonexistent_share_server_id => generated 78 bytes in 186 msecs (HTTP/1.1 403) 6 headers in 237 bytes (1 switches on core 0) May 28 12:56:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd47eb50-d0bf-4846-a08e-aa988f39405e tempest-ShareServersNegativeAdminTest-1564821148 tempest-ShareServersNegativeAdminTest-1564821148-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd47eb50-d0bf-4846-a08e-aa988f39405e tempest-ShareServersNegativeAdminTest-1564821148 tempest-ShareServersNegativeAdminTest-1564821148-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0ba47e-f40d-49ff-9c48-52d05a343cb3 service manila] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f110cf6300f049c897d0aab63218d1e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0ba47e-f40d-49ff-9c48-52d05a343cb3 service manila] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0ba47e-f40d-49ff-9c48-52d05a343cb3 service manila] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0ba47e-f40d-49ff-9c48-52d05a343cb3 service manila] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0ba47e-f40d-49ff-9c48-52d05a343cb3 service manila] RBAC: Authorizing `identity:validate_token()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0ba47e-f40d-49ff-9c48-52d05a343cb3 service manila] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:30 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 731/1445] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 12:56:30 2024] GET /identity/v3/auth/tokens => generated 4091 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 12:56:30 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-0fa1d167-09e3-4306-a433-16073acea15b tempest-ShareServersNegativeAdminTest-1564821148 tempest-ShareServersNegativeAdminTest-1564821148-project-admin] DELETE http://10.27.203.238/share/v2/65281ccd31474a87add11c1811bbcba4/share-servers/fake_nonexistent_share_server_id May 28 12:56:30 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-0fa1d167-09e3-4306-a433-16073acea15b tempest-ShareServersNegativeAdminTest-1564821148 tempest-ShareServersNegativeAdminTest-1564821148-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:30 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-0fa1d167-09e3-4306-a433-16073acea15b tempest-ShareServersNegativeAdminTest-1564821148 tempest-ShareServersNegativeAdminTest-1564821148-project-admin] Calling method 'ShareServerController.delete' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:30 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-0fa1d167-09e3-4306-a433-16073acea15b tempest-ShareServersNegativeAdminTest-1564821148 tempest-ShareServersNegativeAdminTest-1564821148-project-admin] HTTP exception thrown: Share server fake_nonexistent_share_server_id could not be found. May 28 12:56:30 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-0fa1d167-09e3-4306-a433-16073acea15b tempest-ShareServersNegativeAdminTest-1564821148 tempest-ShareServersNegativeAdminTest-1564821148-project-admin] http://10.27.203.238/share/v2/65281ccd31474a87add11c1811bbcba4/share-servers/fake_nonexistent_share_server_id returned with HTTP 404 May 28 12:56:30 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 51/87] 10.27.203.238 () {64 vars in 1463 bytes} [Tue May 28 12:56:30 2024] DELETE /share/v2/65281ccd31474a87add11c1811bbcba4/share-servers/fake_nonexistent_share_server_id => generated 111 bytes in 110 msecs (HTTP/1.1 404) 6 headers in 238 bytes (1 switches on core 0) May 28 12:56:30 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-d645f870-366d-41f2-b29a-b3e7786c6941 tempest-ShareServersNegativeAdminTest-1564821148 tempest-ShareServersNegativeAdminTest-1564821148-project-admin] GET http://10.27.203.238/share/v2/65281ccd31474a87add11c1811bbcba4/share-servers?host=tempest-fake_host-916450029 May 28 12:56:30 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-d645f870-366d-41f2-b29a-b3e7786c6941 tempest-ShareServersNegativeAdminTest-1564821148 tempest-ShareServersNegativeAdminTest-1564821148-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:30 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-d645f870-366d-41f2-b29a-b3e7786c6941 tempest-ShareServersNegativeAdminTest-1564821148 tempest-ShareServersNegativeAdminTest-1564821148-project-admin] Calling method 'ShareServerController.index' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:30 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-d645f870-366d-41f2-b29a-b3e7786c6941 tempest-ShareServersNegativeAdminTest-1564821148 tempest-ShareServersNegativeAdminTest-1564821148-project-admin] http://10.27.203.238/share/v2/65281ccd31474a87add11c1811bbcba4/share-servers?host=tempest-fake_host-916450029 returned with HTTP 200 May 28 12:56:30 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 37/88] 10.27.203.238 () {64 vars in 1426 bytes} [Tue May 28 12:56:30 2024] GET /share/v2/65281ccd31474a87add11c1811bbcba4/share-servers?host=tempest-fake_host-916450029 => generated 21 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 230 bytes (2 switches on core 0) May 28 12:56:30 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-05c498a0-0030-414b-907f-2e0bc1c5102e tempest-ShareServersNegativeAdminTest-1564821148 tempest-ShareServersNegativeAdminTest-1564821148-project-admin] GET http://10.27.203.238/share/v2/65281ccd31474a87add11c1811bbcba4/share-servers?project_id=tempest-fake_project_id-680908979 May 28 12:56:30 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-05c498a0-0030-414b-907f-2e0bc1c5102e tempest-ShareServersNegativeAdminTest-1564821148 tempest-ShareServersNegativeAdminTest-1564821148-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:30 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-05c498a0-0030-414b-907f-2e0bc1c5102e tempest-ShareServersNegativeAdminTest-1564821148 tempest-ShareServersNegativeAdminTest-1564821148-project-admin] Calling method 'ShareServerController.index' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:30 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-05c498a0-0030-414b-907f-2e0bc1c5102e tempest-ShareServersNegativeAdminTest-1564821148 tempest-ShareServersNegativeAdminTest-1564821148-project-admin] http://10.27.203.238/share/v2/65281ccd31474a87add11c1811bbcba4/share-servers?project_id=tempest-fake_project_id-680908979 returned with HTTP 200 May 28 12:56:30 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 52/89] 10.27.203.238 () {64 vars in 1450 bytes} [Tue May 28 12:56:30 2024] GET /share/v2/65281ccd31474a87add11c1811bbcba4/share-servers?project_id=tempest-fake_project_id-680908979 => generated 21 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:56:30 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-e465e0c7-80aa-427c-8b14-13d39916b49f tempest-ShareServersNegativeAdminTest-1564821148 tempest-ShareServersNegativeAdminTest-1564821148-project-admin] GET http://10.27.203.238/share/v2/65281ccd31474a87add11c1811bbcba4/share-servers?share_network=tempest-fake_share_network-1095767685 May 28 12:56:30 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-e465e0c7-80aa-427c-8b14-13d39916b49f tempest-ShareServersNegativeAdminTest-1564821148 tempest-ShareServersNegativeAdminTest-1564821148-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:30 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-e465e0c7-80aa-427c-8b14-13d39916b49f tempest-ShareServersNegativeAdminTest-1564821148 tempest-ShareServersNegativeAdminTest-1564821148-project-admin] Calling method 'ShareServerController.index' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:30 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-e465e0c7-80aa-427c-8b14-13d39916b49f tempest-ShareServersNegativeAdminTest-1564821148 tempest-ShareServersNegativeAdminTest-1564821148-project-admin] http://10.27.203.238/share/v2/65281ccd31474a87add11c1811bbcba4/share-servers?share_network=tempest-fake_share_network-1095767685 returned with HTTP 200 May 28 12:56:30 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 38/90] 10.27.203.238 () {64 vars in 1464 bytes} [Tue May 28 12:56:30 2024] GET /share/v2/65281ccd31474a87add11c1811bbcba4/share-servers?share_network=tempest-fake_share_network-1095767685 => generated 21 bytes in 18 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:56:30 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-cd3b362b-fa74-49a0-aafd-b8f92d5bc16c tempest-ShareServersNegativeAdminTest-1564821148 tempest-ShareServersNegativeAdminTest-1564821148-project-admin] GET http://10.27.203.238/share/v2/65281ccd31474a87add11c1811bbcba4/share-servers?status=tempest-fake_status-2041252487 May 28 12:56:30 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-cd3b362b-fa74-49a0-aafd-b8f92d5bc16c tempest-ShareServersNegativeAdminTest-1564821148 tempest-ShareServersNegativeAdminTest-1564821148-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:30 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-cd3b362b-fa74-49a0-aafd-b8f92d5bc16c tempest-ShareServersNegativeAdminTest-1564821148 tempest-ShareServersNegativeAdminTest-1564821148-project-admin] Calling method 'ShareServerController.index' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:30 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-cd3b362b-fa74-49a0-aafd-b8f92d5bc16c tempest-ShareServersNegativeAdminTest-1564821148 tempest-ShareServersNegativeAdminTest-1564821148-project-admin] http://10.27.203.238/share/v2/65281ccd31474a87add11c1811bbcba4/share-servers?status=tempest-fake_status-2041252487 returned with HTTP 200 May 28 12:56:30 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 53/91] 10.27.203.238 () {64 vars in 1436 bytes} [Tue May 28 12:56:30 2024] GET /share/v2/65281ccd31474a87add11c1811bbcba4/share-servers?status=tempest-fake_status-2041252487 => generated 21 bytes in 17 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:56:30 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-b5cebc05-79ae-4d34-8d01-a87539a9cbef tempest-ShareServersNegativeAdminTest-1564821148 tempest-ShareServersNegativeAdminTest-1564821148-project-admin] GET http://10.27.203.238/share/v2/65281ccd31474a87add11c1811bbcba4/share-servers?fake_filter_key=ACTIVE May 28 12:56:30 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-b5cebc05-79ae-4d34-8d01-a87539a9cbef tempest-ShareServersNegativeAdminTest-1564821148 tempest-ShareServersNegativeAdminTest-1564821148-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:30 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-b5cebc05-79ae-4d34-8d01-a87539a9cbef tempest-ShareServersNegativeAdminTest-1564821148 tempest-ShareServersNegativeAdminTest-1564821148-project-admin] Calling method 'ShareServerController.index' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:30 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-b5cebc05-79ae-4d34-8d01-a87539a9cbef tempest-ShareServersNegativeAdminTest-1564821148 tempest-ShareServersNegativeAdminTest-1564821148-project-admin] http://10.27.203.238/share/v2/65281ccd31474a87add11c1811bbcba4/share-servers?fake_filter_key=ACTIVE returned with HTTP 200 May 28 12:56:30 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 39/92] 10.27.203.238 () {64 vars in 1406 bytes} [Tue May 28 12:56:30 2024] GET /share/v2/65281ccd31474a87add11c1811bbcba4/share-servers?fake_filter_key=ACTIVE => generated 21 bytes in 19 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:56:30 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-6ba22478-7bf8-4d72-9cbc-5a25f60c9831 tempest-ShareServersNegativeAdminTest-1564821148 tempest-ShareServersNegativeAdminTest-1564821148-project-admin] GET http://10.27.203.238/share/v2/65281ccd31474a87add11c1811bbcba4/share-servers?host=123 May 28 12:56:30 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-6ba22478-7bf8-4d72-9cbc-5a25f60c9831 tempest-ShareServersNegativeAdminTest-1564821148 tempest-ShareServersNegativeAdminTest-1564821148-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:30 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-6ba22478-7bf8-4d72-9cbc-5a25f60c9831 tempest-ShareServersNegativeAdminTest-1564821148 tempest-ShareServersNegativeAdminTest-1564821148-project-admin] Calling method 'ShareServerController.index' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:30 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-6ba22478-7bf8-4d72-9cbc-5a25f60c9831 tempest-ShareServersNegativeAdminTest-1564821148 tempest-ShareServersNegativeAdminTest-1564821148-project-admin] http://10.27.203.238/share/v2/65281ccd31474a87add11c1811bbcba4/share-servers?host=123 returned with HTTP 200 May 28 12:56:30 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 54/93] 10.27.203.238 () {64 vars in 1378 bytes} [Tue May 28 12:56:30 2024] GET /share/v2/65281ccd31474a87add11c1811bbcba4/share-servers?host=123 => generated 21 bytes in 19 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:56:30 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-40f8d340-3ca0-4fe6-bd9a-2c37049c1303 tempest-ShareServersNegativeAdminTest-1564821148 tempest-ShareServersNegativeAdminTest-1564821148-project-admin] GET http://10.27.203.238/share/v2/65281ccd31474a87add11c1811bbcba4/share-servers/fake_id/details May 28 12:56:30 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-40f8d340-3ca0-4fe6-bd9a-2c37049c1303 tempest-ShareServersNegativeAdminTest-1564821148 tempest-ShareServersNegativeAdminTest-1564821148-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:30 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-40f8d340-3ca0-4fe6-bd9a-2c37049c1303 tempest-ShareServersNegativeAdminTest-1564821148 tempest-ShareServersNegativeAdminTest-1564821148-project-admin] Calling method 'ShareServerController.details' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:30 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-40f8d340-3ca0-4fe6-bd9a-2c37049c1303 tempest-ShareServersNegativeAdminTest-1564821148 tempest-ShareServersNegativeAdminTest-1564821148-project-admin] HTTP exception thrown: Share server fake_id could not be found. May 28 12:56:30 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-40f8d340-3ca0-4fe6-bd9a-2c37049c1303 tempest-ShareServersNegativeAdminTest-1564821148 tempest-ShareServersNegativeAdminTest-1564821148-project-admin] http://10.27.203.238/share/v2/65281ccd31474a87add11c1811bbcba4/share-servers/fake_id/details returned with HTTP 404 May 28 12:56:30 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 40/94] 10.27.203.238 () {64 vars in 1409 bytes} [Tue May 28 12:56:30 2024] GET /share/v2/65281ccd31474a87add11c1811bbcba4/share-servers/fake_id/details => generated 86 bytes in 37 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 12:56:30 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-b9156bd4-d8f2-462d-b275-19c1021d4c2b tempest-ShareServersNegativeAdminTest-1564821148 tempest-ShareServersNegativeAdminTest-1564821148-project-admin] GET http://10.27.203.238/share/v2/65281ccd31474a87add11c1811bbcba4/share-servers/fake_id May 28 12:56:30 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-b9156bd4-d8f2-462d-b275-19c1021d4c2b tempest-ShareServersNegativeAdminTest-1564821148 tempest-ShareServersNegativeAdminTest-1564821148-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:30 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-b9156bd4-d8f2-462d-b275-19c1021d4c2b tempest-ShareServersNegativeAdminTest-1564821148 tempest-ShareServersNegativeAdminTest-1564821148-project-admin] Calling method 'ShareServerController.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:30 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-b9156bd4-d8f2-462d-b275-19c1021d4c2b tempest-ShareServersNegativeAdminTest-1564821148 tempest-ShareServersNegativeAdminTest-1564821148-project-admin] HTTP exception thrown: Share server fake_id could not be found. May 28 12:56:30 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-b9156bd4-d8f2-462d-b275-19c1021d4c2b tempest-ShareServersNegativeAdminTest-1564821148 tempest-ShareServersNegativeAdminTest-1564821148-project-admin] http://10.27.203.238/share/v2/65281ccd31474a87add11c1811bbcba4/share-servers/fake_id returned with HTTP 404 May 28 12:56:30 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 55/95] 10.27.203.238 () {64 vars in 1385 bytes} [Tue May 28 12:56:30 2024] GET /share/v2/65281ccd31474a87add11c1811bbcba4/share-servers/fake_id => generated 86 bytes in 17 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 12:56:30 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-e5727095-fc1c-4545-b5e3-cdd5b0f4672e tempest-ShareServersNegativeAdminTest-723866093 tempest-ShareServersNegativeAdminTest-723866093-project-member] GET http://10.27.203.238/share/v2/1bca8eeba9b24ed3933a4e22129b02fa/share-servers May 28 12:56:30 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-e5727095-fc1c-4545-b5e3-cdd5b0f4672e tempest-ShareServersNegativeAdminTest-723866093 tempest-ShareServersNegativeAdminTest-723866093-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:30 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-e5727095-fc1c-4545-b5e3-cdd5b0f4672e tempest-ShareServersNegativeAdminTest-723866093 tempest-ShareServersNegativeAdminTest-723866093-project-member] Calling method 'ShareServerController.index' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:30 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.policy [None req-e5727095-fc1c-4545-b5e3-cdd5b0f4672e tempest-ShareServersNegativeAdminTest-723866093 tempest-ShareServersNegativeAdminTest-723866093-project-member] Policy check for share_server:index failed with credentials {'is_admin': False, 'user_id': '9f5e944b30cb44d1922375f0e0fb9892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bca8eeba9b24ed3933a4e22129b02fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98330) authorize /opt/stack/manila/manila/policy.py:208}} May 28 12:56:30 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-e5727095-fc1c-4545-b5e3-cdd5b0f4672e tempest-ShareServersNegativeAdminTest-723866093 tempest-ShareServersNegativeAdminTest-723866093-project-member] HTTP exception thrown: Access was denied to this resource. May 28 12:56:30 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-e5727095-fc1c-4545-b5e3-cdd5b0f4672e tempest-ShareServersNegativeAdminTest-723866093 tempest-ShareServersNegativeAdminTest-723866093-project-member] http://10.27.203.238/share/v2/1bca8eeba9b24ed3933a4e22129b02fa/share-servers returned with HTTP 403 May 28 12:56:30 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 41/96] 10.27.203.238 () {64 vars in 1361 bytes} [Tue May 28 12:56:30 2024] GET /share/v2/1bca8eeba9b24ed3933a4e22129b02fa/share-servers => generated 78 bytes in 6 msecs (HTTP/1.1 403) 6 headers in 237 bytes (1 switches on core 0) May 28 12:56:30 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-7514a690-1875-48e5-93ba-584e14578475 tempest-ShareServersNegativeAdminTest-723866093 tempest-ShareServersNegativeAdminTest-723866093-project-member] GET http://10.27.203.238/share/v2/1bca8eeba9b24ed3933a4e22129b02fa/share-servers/fake_id/details May 28 12:56:30 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-7514a690-1875-48e5-93ba-584e14578475 tempest-ShareServersNegativeAdminTest-723866093 tempest-ShareServersNegativeAdminTest-723866093-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:30 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-7514a690-1875-48e5-93ba-584e14578475 tempest-ShareServersNegativeAdminTest-723866093 tempest-ShareServersNegativeAdminTest-723866093-project-member] Calling method 'ShareServerController.details' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:30 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.policy [None req-7514a690-1875-48e5-93ba-584e14578475 tempest-ShareServersNegativeAdminTest-723866093 tempest-ShareServersNegativeAdminTest-723866093-project-member] Policy check for share_server:details failed with credentials {'is_admin': False, 'user_id': '9f5e944b30cb44d1922375f0e0fb9892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bca8eeba9b24ed3933a4e22129b02fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98329) authorize /opt/stack/manila/manila/policy.py:208}} May 28 12:56:30 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-7514a690-1875-48e5-93ba-584e14578475 tempest-ShareServersNegativeAdminTest-723866093 tempest-ShareServersNegativeAdminTest-723866093-project-member] HTTP exception thrown: Access was denied to this resource. May 28 12:56:30 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-7514a690-1875-48e5-93ba-584e14578475 tempest-ShareServersNegativeAdminTest-723866093 tempest-ShareServersNegativeAdminTest-723866093-project-member] http://10.27.203.238/share/v2/1bca8eeba9b24ed3933a4e22129b02fa/share-servers/fake_id/details returned with HTTP 403 May 28 12:56:30 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 56/97] 10.27.203.238 () {64 vars in 1409 bytes} [Tue May 28 12:56:30 2024] GET /share/v2/1bca8eeba9b24ed3933a4e22129b02fa/share-servers/fake_id/details => generated 78 bytes in 7 msecs (HTTP/1.1 403) 6 headers in 237 bytes (1 switches on core 0) May 28 12:56:30 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-17f15889-a975-4880-8a8d-111d7c3bcd2d tempest-ShareServersNegativeAdminTest-723866093 tempest-ShareServersNegativeAdminTest-723866093-project-member] GET http://10.27.203.238/share/v2/1bca8eeba9b24ed3933a4e22129b02fa/share-servers/fake_id May 28 12:56:30 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-17f15889-a975-4880-8a8d-111d7c3bcd2d tempest-ShareServersNegativeAdminTest-723866093 tempest-ShareServersNegativeAdminTest-723866093-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:30 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-17f15889-a975-4880-8a8d-111d7c3bcd2d tempest-ShareServersNegativeAdminTest-723866093 tempest-ShareServersNegativeAdminTest-723866093-project-member] Calling method 'ShareServerController.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:30 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.policy [None req-17f15889-a975-4880-8a8d-111d7c3bcd2d tempest-ShareServersNegativeAdminTest-723866093 tempest-ShareServersNegativeAdminTest-723866093-project-member] Policy check for share_server:show failed with credentials {'is_admin': False, 'user_id': '9f5e944b30cb44d1922375f0e0fb9892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bca8eeba9b24ed3933a4e22129b02fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98330) authorize /opt/stack/manila/manila/policy.py:208}} May 28 12:56:30 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-17f15889-a975-4880-8a8d-111d7c3bcd2d tempest-ShareServersNegativeAdminTest-723866093 tempest-ShareServersNegativeAdminTest-723866093-project-member] HTTP exception thrown: Access was denied to this resource. May 28 12:56:30 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-17f15889-a975-4880-8a8d-111d7c3bcd2d tempest-ShareServersNegativeAdminTest-723866093 tempest-ShareServersNegativeAdminTest-723866093-project-member] http://10.27.203.238/share/v2/1bca8eeba9b24ed3933a4e22129b02fa/share-servers/fake_id returned with HTTP 403 May 28 12:56:30 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 42/98] 10.27.203.238 () {64 vars in 1385 bytes} [Tue May 28 12:56:30 2024] GET /share/v2/1bca8eeba9b24ed3933a4e22129b02fa/share-servers/fake_id => generated 78 bytes in 6 msecs (HTTP/1.1 403) 6 headers in 237 bytes (1 switches on core 0) May 28 12:56:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90484be3-8928-405a-9a9e-7b78236d1dcf service manila] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90484be3-8928-405a-9a9e-7b78236d1dcf service manila] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c20fb8-0252-4cbc-bf3c-8ad4ee220ffb tempest-ShareServersNegativeAdminTest-1564821148 tempest-ShareServersNegativeAdminTest-1564821148-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '841e80f8aabe4ccda3a5ddaf7fd39c3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65281ccd31474a87add11c1811bbcba4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c20fb8-0252-4cbc-bf3c-8ad4ee220ffb tempest-ShareServersNegativeAdminTest-1564821148 tempest-ShareServersNegativeAdminTest-1564821148-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c20fb8-0252-4cbc-bf3c-8ad4ee220ffb tempest-ShareServersNegativeAdminTest-1564821148 tempest-ShareServersNegativeAdminTest-1564821148-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c20fb8-0252-4cbc-bf3c-8ad4ee220ffb tempest-ShareServersNegativeAdminTest-1564821148 tempest-ShareServersNegativeAdminTest-1564821148-project-admin] PATH_INFO: `/v3/users/981b3e419ab1466ba64538f100d39f99` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c20fb8-0252-4cbc-bf3c-8ad4ee220ffb tempest-ShareServersNegativeAdminTest-1564821148 tempest-ShareServersNegativeAdminTest-1564821148-project-admin] RBAC: Authorizing `identity:delete_user(user_id=981b3e419ab1466ba64538f100d39f99)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c20fb8-0252-4cbc-bf3c-8ad4ee220ffb tempest-ShareServersNegativeAdminTest-1564821148 tempest-ShareServersNegativeAdminTest-1564821148-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-c9c20fb8-0252-4cbc-bf3c-8ad4ee220ffb tempest-ShareServersNegativeAdminTest-1564821148 tempest-ShareServersNegativeAdminTest-1564821148-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '981b3e419ab1466ba64538f100d39f99', 'request_id': 'req-c9c20fb8-0252-4cbc-bf3c-8ad4ee220ffb'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-c9c20fb8-0252-4cbc-bf3c-8ad4ee220ffb tempest-ShareServersNegativeAdminTest-1564821148 tempest-ShareServersNegativeAdminTest-1564821148-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '981b3e419ab1466ba64538f100d39f99', 'request_id': 'req-c9c20fb8-0252-4cbc-bf3c-8ad4ee220ffb'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-c9c20fb8-0252-4cbc-bf3c-8ad4ee220ffb tempest-ShareServersNegativeAdminTest-1564821148 tempest-ShareServersNegativeAdminTest-1564821148-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '981b3e419ab1466ba64538f100d39f99', 'request_id': 'req-c9c20fb8-0252-4cbc-bf3c-8ad4ee220ffb'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-c9c20fb8-0252-4cbc-bf3c-8ad4ee220ffb tempest-ShareServersNegativeAdminTest-1564821148 tempest-ShareServersNegativeAdminTest-1564821148-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '981b3e419ab1466ba64538f100d39f99', 'request_id': 'req-c9c20fb8-0252-4cbc-bf3c-8ad4ee220ffb'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-c9c20fb8-0252-4cbc-bf3c-8ad4ee220ffb tempest-ShareServersNegativeAdminTest-1564821148 tempest-ShareServersNegativeAdminTest-1564821148-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '981b3e419ab1466ba64538f100d39f99', 'request_id': 'req-c9c20fb8-0252-4cbc-bf3c-8ad4ee220ffb'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:30 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-434ed059-1547-4868-b57b-46613126e982 tempest-ShareInstancesTest-1546991288 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:56:30 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-434ed059-1547-4868-b57b-46613126e982 tempest-ShareInstancesTest-1546991288 None] [] May 28 12:56:30 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-434ed059-1547-4868-b57b-46613126e982 tempest-ShareInstancesTest-1546991288 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 12:56:30 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-434ed059-1547-4868-b57b-46613126e982 tempest-ShareInstancesTest-1546991288 None] >>> [POST] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:56:30 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-434ed059-1547-4868-b57b-46613126e982 tempest-ShareInstancesTest-1546991288 None] {'data': '{"name": "7f6a42fa-4d45-471e-a438-36876fc6eac8"}', May 28 12:56:30 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-434ed059-1547-4868-b57b-46613126e982 tempest-ShareInstancesTest-1546991288 None] 'json': None, May 28 12:56:30 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-434ed059-1547-4868-b57b-46613126e982 tempest-ShareInstancesTest-1546991288 None] 'params': None} May 28 12:56:30 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 715/1446] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 12:56:30 2024] DELETE /identity/v3/users/981b3e419ab1466ba64538f100d39f99 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:56:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0ba47e-f40d-49ff-9c48-52d05a343cb3 service manila] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0ba47e-f40d-49ff-9c48-52d05a343cb3 service manila] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06bdd81-8e5c-45a2-97eb-b937ccf1ebb9 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06bdd81-8e5c-45a2-97eb-b937ccf1ebb9 None admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06bdd81-8e5c-45a2-97eb-b937ccf1ebb9 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06bdd81-8e5c-45a2-97eb-b937ccf1ebb9 None admin] PATH_INFO: `/v3/users/9f5e944b30cb44d1922375f0e0fb9892` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06bdd81-8e5c-45a2-97eb-b937ccf1ebb9 None admin] RBAC: Authorizing `identity:delete_user(user_id=9f5e944b30cb44d1922375f0e0fb9892)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06bdd81-8e5c-45a2-97eb-b937ccf1ebb9 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-b06bdd81-8e5c-45a2-97eb-b937ccf1ebb9 None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f5e944b30cb44d1922375f0e0fb9892', 'request_id': 'req-b06bdd81-8e5c-45a2-97eb-b937ccf1ebb9'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-b06bdd81-8e5c-45a2-97eb-b937ccf1ebb9 None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f5e944b30cb44d1922375f0e0fb9892', 'request_id': 'req-b06bdd81-8e5c-45a2-97eb-b937ccf1ebb9'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-b06bdd81-8e5c-45a2-97eb-b937ccf1ebb9 None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f5e944b30cb44d1922375f0e0fb9892', 'request_id': 'req-b06bdd81-8e5c-45a2-97eb-b937ccf1ebb9'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-b06bdd81-8e5c-45a2-97eb-b937ccf1ebb9 None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f5e944b30cb44d1922375f0e0fb9892', 'request_id': 'req-b06bdd81-8e5c-45a2-97eb-b937ccf1ebb9'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-b06bdd81-8e5c-45a2-97eb-b937ccf1ebb9 None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f5e944b30cb44d1922375f0e0fb9892', 'request_id': 'req-b06bdd81-8e5c-45a2-97eb-b937ccf1ebb9'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:30 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 732/1447] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 12:56:30 2024] DELETE /identity/v3/users/9f5e944b30cb44d1922375f0e0fb9892 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:56:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c20fb8-0252-4cbc-bf3c-8ad4ee220ffb tempest-ShareServersNegativeAdminTest-1564821148 tempest-ShareServersNegativeAdminTest-1564821148-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-c9c20fb8-0252-4cbc-bf3c-8ad4ee220ffb tempest-ShareServersNegativeAdminTest-1564821148 tempest-ShareServersNegativeAdminTest-1564821148-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c20fb8-0252-4cbc-bf3c-8ad4ee220ffb tempest-ShareServersNegativeAdminTest-1564821148 tempest-ShareServersNegativeAdminTest-1564821148-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ddab3f-e5b5-41ae-95cb-d00291103ff4 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ddab3f-e5b5-41ae-95cb-d00291103ff4 None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ddab3f-e5b5-41ae-95cb-d00291103ff4 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ddab3f-e5b5-41ae-95cb-d00291103ff4 None admin] PATH_INFO: `/v3/users/a92743ff6cad4a188702b79ad1cbd4cd` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ddab3f-e5b5-41ae-95cb-d00291103ff4 None admin] RBAC: Authorizing `identity:delete_user(user_id=a92743ff6cad4a188702b79ad1cbd4cd)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ddab3f-e5b5-41ae-95cb-d00291103ff4 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-e6ddab3f-e5b5-41ae-95cb-d00291103ff4 None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a92743ff6cad4a188702b79ad1cbd4cd', 'request_id': 'req-e6ddab3f-e5b5-41ae-95cb-d00291103ff4'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-e6ddab3f-e5b5-41ae-95cb-d00291103ff4 None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a92743ff6cad4a188702b79ad1cbd4cd', 'request_id': 'req-e6ddab3f-e5b5-41ae-95cb-d00291103ff4'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-e6ddab3f-e5b5-41ae-95cb-d00291103ff4 None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a92743ff6cad4a188702b79ad1cbd4cd', 'request_id': 'req-e6ddab3f-e5b5-41ae-95cb-d00291103ff4'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-e6ddab3f-e5b5-41ae-95cb-d00291103ff4 None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a92743ff6cad4a188702b79ad1cbd4cd', 'request_id': 'req-e6ddab3f-e5b5-41ae-95cb-d00291103ff4'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-e6ddab3f-e5b5-41ae-95cb-d00291103ff4 None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a92743ff6cad4a188702b79ad1cbd4cd', 'request_id': 'req-e6ddab3f-e5b5-41ae-95cb-d00291103ff4'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:31 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 716/1448] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 12:56:30 2024] DELETE /identity/v3/users/a92743ff6cad4a188702b79ad1cbd4cd => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:56:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06bdd81-8e5c-45a2-97eb-b937ccf1ebb9 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-b06bdd81-8e5c-45a2-97eb-b937ccf1ebb9 None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06bdd81-8e5c-45a2-97eb-b937ccf1ebb9 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21aa44c-7842-4ea2-a822-0249271316fe None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21aa44c-7842-4ea2-a822-0249271316fe None admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21aa44c-7842-4ea2-a822-0249271316fe None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21aa44c-7842-4ea2-a822-0249271316fe None admin] PATH_INFO: `/v3/users/841e80f8aabe4ccda3a5ddaf7fd39c3d` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21aa44c-7842-4ea2-a822-0249271316fe None admin] RBAC: Authorizing `identity:delete_user(user_id=841e80f8aabe4ccda3a5ddaf7fd39c3d)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21aa44c-7842-4ea2-a822-0249271316fe None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-d21aa44c-7842-4ea2-a822-0249271316fe None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '841e80f8aabe4ccda3a5ddaf7fd39c3d', 'request_id': 'req-d21aa44c-7842-4ea2-a822-0249271316fe'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-d21aa44c-7842-4ea2-a822-0249271316fe None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '841e80f8aabe4ccda3a5ddaf7fd39c3d', 'request_id': 'req-d21aa44c-7842-4ea2-a822-0249271316fe'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-d21aa44c-7842-4ea2-a822-0249271316fe None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '841e80f8aabe4ccda3a5ddaf7fd39c3d', 'request_id': 'req-d21aa44c-7842-4ea2-a822-0249271316fe'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-d21aa44c-7842-4ea2-a822-0249271316fe None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '841e80f8aabe4ccda3a5ddaf7fd39c3d', 'request_id': 'req-d21aa44c-7842-4ea2-a822-0249271316fe'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-d21aa44c-7842-4ea2-a822-0249271316fe None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '841e80f8aabe4ccda3a5ddaf7fd39c3d', 'request_id': 'req-d21aa44c-7842-4ea2-a822-0249271316fe'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:31 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 733/1449] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 12:56:31 2024] DELETE /identity/v3/users/841e80f8aabe4ccda3a5ddaf7fd39c3d => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:56:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf657e6-abaf-4ee1-8694-8748e154455a None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf657e6-abaf-4ee1-8694-8748e154455a None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf657e6-abaf-4ee1-8694-8748e154455a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:31 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-faf657e6-abaf-4ee1-8694-8748e154455a None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:56:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-faf657e6-abaf-4ee1-8694-8748e154455a None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:56:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-faf657e6-abaf-4ee1-8694-8748e154455a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:31 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 717/1450] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:56:31 2024] POST /identity/v3/auth/tokens => generated 2960 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 12:56:31 l75lg1-v1 neutron-server[77618]: DEBUG neutron.wsgi [-] (77618) accepted ('10.27.203.238', 49390) {{(pid=77618) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 12:56:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21aa44c-7842-4ea2-a822-0249271316fe None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-d21aa44c-7842-4ea2-a822-0249271316fe None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:31 l75lg1-v1 dstat.sh[49771]: 28-05 12:56:31| 9 1 86 2 0|5629M 1882M 277M 7838M| 14k 17k| 0 2160k| 0 293 |7242 13k|1.76 0.96 0.98|1.0 1.0 0| 0 0 | 0 2048M| 29 344 0 36 0 May 28 12:56:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21aa44c-7842-4ea2-a822-0249271316fe None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb0b6e4-8f66-4a9c-8e31-6d331fde329d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef17047035e4b518fd5360a01f2da1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb0b6e4-8f66-4a9c-8e31-6d331fde329d service neutron] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb0b6e4-8f66-4a9c-8e31-6d331fde329d service neutron] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb0b6e4-8f66-4a9c-8e31-6d331fde329d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:31 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-94566135-6cc9-45d6-a016-308f46949c43 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] GET http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/shares/df0ea844-5fc1-4d04-8afb-5048ec5dc33f May 28 12:56:31 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-94566135-6cc9-45d6-a016-308f46949c43 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:31 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-94566135-6cc9-45d6-a016-308f46949c43 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb0b6e4-8f66-4a9c-8e31-6d331fde329d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb0b6e4-8f66-4a9c-8e31-6d331fde329d service neutron] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:31 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 734/1451] 10.27.203.238 () {64 vars in 1432 bytes} [Tue May 28 12:56:31 2024] GET /identity/v3/auth/tokens => generated 2960 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 28 12:56:31 l75lg1-v1 neutron-server[77618]: INFO neutron.wsgi [None req-4f9c1f5f-a369-443a-9283-37a9b59516fb None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=65281ccd31474a87add11c1811bbcba4&name=default HTTP/1.1" status: 200 len: 216 time: 0.0792894 May 28 12:56:31 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-94566135-6cc9-45d6-a016-308f46949c43 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/shares/df0ea844-5fc1-4d04-8afb-5048ec5dc33f returned with HTTP 200 May 28 12:56:31 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 57/99] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:56:31 2024] GET /share/v2/a3499cb78849424db45e54caac01de92/shares/df0ea844-5fc1-4d04-8afb-5048ec5dc33f => generated 1371 bytes in 24 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:56:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf657e6-abaf-4ee1-8694-8748e154455a None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-faf657e6-abaf-4ee1-8694-8748e154455a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:31 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-e504dc46-eaa3-4400-8c1a-fd6c685a886b tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] GET http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/shares/df0ea844-5fc1-4d04-8afb-5048ec5dc33f May 28 12:56:31 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-e504dc46-eaa3-4400-8c1a-fd6c685a886b tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:31 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-e504dc46-eaa3-4400-8c1a-fd6c685a886b tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:31 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-2df4b070-0041-4a4f-93cd-a0b462ad892b tempest-ExportLocationsTest-1017217578 tempest-ExportLocationsTest-1017217578-project-admin] GET http://10.27.203.238/share/v2/87c113478e754c47aea49a8b703cd2f6/shares/a96dff4b-6e98-4085-9f3b-45735d209546 May 28 12:56:31 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-2df4b070-0041-4a4f-93cd-a0b462ad892b tempest-ExportLocationsTest-1017217578 tempest-ExportLocationsTest-1017217578-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:31 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-2df4b070-0041-4a4f-93cd-a0b462ad892b tempest-ExportLocationsTest-1017217578 tempest-ExportLocationsTest-1017217578-project-admin] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf657e6-abaf-4ee1-8694-8748e154455a None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaed821-d16c-4705-93fc-9ad59883612b None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaed821-d16c-4705-93fc-9ad59883612b None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaed821-d16c-4705-93fc-9ad59883612b None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaed821-d16c-4705-93fc-9ad59883612b None admin] PATH_INFO: `/v3/projects/65281ccd31474a87add11c1811bbcba4` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaed821-d16c-4705-93fc-9ad59883612b None admin] RBAC: Authorizing `identity:delete_project(project_id=65281ccd31474a87add11c1811bbcba4)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaed821-d16c-4705-93fc-9ad59883612b None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:31 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-e504dc46-eaa3-4400-8c1a-fd6c685a886b tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/shares/df0ea844-5fc1-4d04-8afb-5048ec5dc33f returned with HTTP 200 May 28 12:56:31 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 43/100] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:56:31 2024] GET /share/v2/a3499cb78849424db45e54caac01de92/shares/df0ea844-5fc1-4d04-8afb-5048ec5dc33f => generated 1371 bytes in 25 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:56:31 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-2df4b070-0041-4a4f-93cd-a0b462ad892b tempest-ExportLocationsTest-1017217578 tempest-ExportLocationsTest-1017217578-project-admin] http://10.27.203.238/share/v2/87c113478e754c47aea49a8b703cd2f6/shares/a96dff4b-6e98-4085-9f3b-45735d209546 returned with HTTP 200 May 28 12:56:31 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 58/101] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:56:31 2024] GET /share/v2/87c113478e754c47aea49a8b703cd2f6/shares/a96dff4b-6e98-4085-9f3b-45735d209546 => generated 1373 bytes in 23 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:56:31 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-adcf8b0b-8542-4875-8f1a-d5e27c653459 tempest-ExportLocationsTest-1017217578 tempest-ExportLocationsTest-1017217578-project-admin] GET http://10.27.203.238/share/v2/87c113478e754c47aea49a8b703cd2f6/shares/a96dff4b-6e98-4085-9f3b-45735d209546 May 28 12:56:31 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-adcf8b0b-8542-4875-8f1a-d5e27c653459 tempest-ExportLocationsTest-1017217578 tempest-ExportLocationsTest-1017217578-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:31 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-adcf8b0b-8542-4875-8f1a-d5e27c653459 tempest-ExportLocationsTest-1017217578 tempest-ExportLocationsTest-1017217578-project-admin] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:31 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-eda6b89b-13db-4842-b681-6d99576fdbea tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] POST http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/shares May 28 12:56:31 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-eda6b89b-13db-4842-b681-6d99576fdbea tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share": {"share_proto": "nfs", "description": "Tempest's share", "snapshot_id": null, "name": "tempest-tempest-created-share-628294412", "size": 1, "metadata": {}, "is_public": false, "share_type": "ed6e3c4a-7505-47e7-9c77-78267ba93d85"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:56:31 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.v1.shares [None req-eda6b89b-13db-4842-b681-6d99576fdbea tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Create NFS share of 1 GB May 28 12:56:31 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-adcf8b0b-8542-4875-8f1a-d5e27c653459 tempest-ExportLocationsTest-1017217578 tempest-ExportLocationsTest-1017217578-project-admin] http://10.27.203.238/share/v2/87c113478e754c47aea49a8b703cd2f6/shares/a96dff4b-6e98-4085-9f3b-45735d209546 returned with HTTP 200 May 28 12:56:31 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 44/102] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:56:31 2024] GET /share/v2/87c113478e754c47aea49a8b703cd2f6/shares/a96dff4b-6e98-4085-9f3b-45735d209546 => generated 1373 bytes in 24 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:56:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-0eaed821-d16c-4705-93fc-9ad59883612b None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65281ccd31474a87add11c1811bbcba4', 'request_id': 'req-0eaed821-d16c-4705-93fc-9ad59883612b'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:31 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-eddf66c1-632b-4c14-9340-8d62ef5e62ab tempest-ExportLocationsTest-1017217578 tempest-ExportLocationsTest-1017217578-project-admin] GET http://10.27.203.238/share/v2/87c113478e754c47aea49a8b703cd2f6/shares/a96dff4b-6e98-4085-9f3b-45735d209546/instances May 28 12:56:31 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-eddf66c1-632b-4c14-9340-8d62ef5e62ab tempest-ExportLocationsTest-1017217578 tempest-ExportLocationsTest-1017217578-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:31 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-eddf66c1-632b-4c14-9340-8d62ef5e62ab tempest-ExportLocationsTest-1017217578 tempest-ExportLocationsTest-1017217578-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-0eaed821-d16c-4705-93fc-9ad59883612b None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65281ccd31474a87add11c1811bbcba4', 'request_id': 'req-0eaed821-d16c-4705-93fc-9ad59883612b'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:31 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-eddf66c1-632b-4c14-9340-8d62ef5e62ab tempest-ExportLocationsTest-1017217578 tempest-ExportLocationsTest-1017217578-project-admin] http://10.27.203.238/share/v2/87c113478e754c47aea49a8b703cd2f6/shares/a96dff4b-6e98-4085-9f3b-45735d209546/instances returned with HTTP 200 May 28 12:56:31 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 45/103] 10.27.203.238 () {64 vars in 1481 bytes} [Tue May 28 12:56:31 2024] GET /share/v2/87c113478e754c47aea49a8b703cd2f6/shares/a96dff4b-6e98-4085-9f3b-45735d209546/instances => generated 509 bytes in 25 msecs (HTTP/1.1 200) 6 headers in 231 bytes (2 switches on core 0) May 28 12:56:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-0eaed821-d16c-4705-93fc-9ad59883612b None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65281ccd31474a87add11c1811bbcba4', 'request_id': 'req-0eaed821-d16c-4705-93fc-9ad59883612b'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:31 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-32949149-41c8-48f4-81ae-2115f6a18b02 tempest-ExportLocationsTest-1017217578 tempest-ExportLocationsTest-1017217578-project-admin] GET http://10.27.203.238/share/v2/87c113478e754c47aea49a8b703cd2f6/shares/a96dff4b-6e98-4085-9f3b-45735d209546/export_locations May 28 12:56:31 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-32949149-41c8-48f4-81ae-2115f6a18b02 tempest-ExportLocationsTest-1017217578 tempest-ExportLocationsTest-1017217578-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:31 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-32949149-41c8-48f4-81ae-2115f6a18b02 tempest-ExportLocationsTest-1017217578 tempest-ExportLocationsTest-1017217578-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-0eaed821-d16c-4705-93fc-9ad59883612b None admin] The token cache is being invalidate because project 65281ccd31474a87add11c1811bbcba4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 12:56:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-0eaed821-d16c-4705-93fc-9ad59883612b None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-0eaed821-d16c-4705-93fc-9ad59883612b None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:31 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 718/1452] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 12:56:31 2024] DELETE /identity/v3/projects/65281ccd31474a87add11c1811bbcba4 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:56:31 l75lg1-v1 neutron-server[77618]: DEBUG neutron.wsgi [-] (77618) accepted ('10.27.203.238', 49406) {{(pid=77618) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 12:56:31 l75lg1-v1 neutron-server[77618]: INFO neutron.wsgi [None req-bdd16f9b-04b8-4937-b541-c90f214ac328 None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=253ed41a20ee44d78459dfca720df0c1&name=default HTTP/1.1" status: 200 len: 216 time: 0.0079978 May 28 12:56:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb0b6e4-8f66-4a9c-8e31-6d331fde329d service neutron] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:31 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.quota [None req-eda6b89b-13db-4842-b681-6d99576fdbea tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Created reservations ['45ce1fb4-a484-4858-a653-77ab8485e675', 'e6f6721b-cb4b-464f-bee7-64ca39ba0b6c', 'a6602a6b-5071-4051-9dd6-fb2dced579a9', 'bf3a6311-2777-4f84-ada1-6016ebcb1b42'] {{(pid=98329) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 12:56:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb0b6e4-8f66-4a9c-8e31-6d331fde329d service neutron] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34677f9-ec9e-4551-b155-15d68308aacf None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34677f9-ec9e-4551-b155-15d68308aacf None admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34677f9-ec9e-4551-b155-15d68308aacf None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34677f9-ec9e-4551-b155-15d68308aacf None admin] PATH_INFO: `/v3/projects/253ed41a20ee44d78459dfca720df0c1` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34677f9-ec9e-4551-b155-15d68308aacf None admin] RBAC: Authorizing `identity:delete_project(project_id=253ed41a20ee44d78459dfca720df0c1)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34677f9-ec9e-4551-b155-15d68308aacf None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:31 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.quota [None req-eda6b89b-13db-4842-b681-6d99576fdbea tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Committed reservations ['45ce1fb4-a484-4858-a653-77ab8485e675', 'e6f6721b-cb4b-464f-bee7-64ca39ba0b6c', 'a6602a6b-5071-4051-9dd6-fb2dced579a9', 'bf3a6311-2777-4f84-ada1-6016ebcb1b42'] {{(pid=98329) commit /opt/stack/manila/manila/quota.py:1063}} May 28 12:56:31 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-32949149-41c8-48f4-81ae-2115f6a18b02 tempest-ExportLocationsTest-1017217578 tempest-ExportLocationsTest-1017217578-project-admin] http://10.27.203.238/share/v2/87c113478e754c47aea49a8b703cd2f6/shares/a96dff4b-6e98-4085-9f3b-45735d209546/export_locations returned with HTTP 200 May 28 12:56:31 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 46/104] 10.27.203.238 () {64 vars in 1502 bytes} [Tue May 28 12:56:31 2024] GET /share/v2/87c113478e754c47aea49a8b703cd2f6/shares/a96dff4b-6e98-4085-9f3b-45735d209546/export_locations => generated 250 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:56:31 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-1159c575-bad5-45a5-a633-638f79a76e39 tempest-ExportLocationsTest-1017217578 tempest-ExportLocationsTest-1017217578-project-admin] GET http://10.27.203.238/share/v2/87c113478e754c47aea49a8b703cd2f6/shares/a96dff4b-6e98-4085-9f3b-45735d209546/export_locations/eedb4e84-98d3-4acc-9a51-8fd62cf7e963 May 28 12:56:31 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-1159c575-bad5-45a5-a633-638f79a76e39 tempest-ExportLocationsTest-1017217578 tempest-ExportLocationsTest-1017217578-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:31 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-1159c575-bad5-45a5-a633-638f79a76e39 tempest-ExportLocationsTest-1017217578 tempest-ExportLocationsTest-1017217578-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-e34677f9-ec9e-4551-b155-15d68308aacf None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '253ed41a20ee44d78459dfca720df0c1', 'request_id': 'req-e34677f9-ec9e-4551-b155-15d68308aacf'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-e34677f9-ec9e-4551-b155-15d68308aacf None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '253ed41a20ee44d78459dfca720df0c1', 'request_id': 'req-e34677f9-ec9e-4551-b155-15d68308aacf'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:31 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-434ed059-1547-4868-b57b-46613126e982 tempest-ShareInstancesTest-1546991288 None] <<< [POST] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:56:31 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-434ed059-1547-4868-b57b-46613126e982 tempest-ShareInstancesTest-1546991288 None] Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=0, created='2024-05-28T12:56:31.146488Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='9c6e129d-4015-4f5a-81b2-c773c3140a6c', id=7, internal=False, is_s3_default_policy=False, name='7f6a42fa-4d45-471e-a438-36876fc6eac8', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=[], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['*'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['*'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T12:56:31.440893Z', tenant_id=1, tenant_name='default', title='7f6a42fa-4d45-471e-a438-36876fc6eac8', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/7/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[]) May 28 12:56:31 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-434ed059-1547-4868-b57b-46613126e982 tempest-ShareInstancesTest-1546991288 None] --- [POST] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 12:56:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-e34677f9-ec9e-4551-b155-15d68308aacf None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '253ed41a20ee44d78459dfca720df0c1', 'request_id': 'req-e34677f9-ec9e-4551-b155-15d68308aacf'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:31 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-434ed059-1547-4868-b57b-46613126e982 tempest-ShareInstancesTest-1546991288 None] >>> [GET] https://127.0.0.1:40443/api/quotas/ May 28 12:56:31 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-434ed059-1547-4868-b57b-46613126e982 tempest-ShareInstancesTest-1546991288 None] {'allow_redirects': True, May 28 12:56:31 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-434ed059-1547-4868-b57b-46613126e982 tempest-ShareInstancesTest-1546991288 None] 'params': {'name': '7f6a42fa-4d45-471e-a438-36876fc6eac8'}} May 28 12:56:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-e34677f9-ec9e-4551-b155-15d68308aacf None admin] The token cache is being invalidate because project 253ed41a20ee44d78459dfca720df0c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 12:56:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-e34677f9-ec9e-4551-b155-15d68308aacf None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-e34677f9-ec9e-4551-b155-15d68308aacf None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:31 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 735/1453] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 12:56:31 2024] DELETE /identity/v3/projects/253ed41a20ee44d78459dfca720df0c1 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:56:31 l75lg1-v1 neutron-server[77618]: DEBUG neutron.wsgi [-] (77618) accepted ('10.27.203.238', 49422) {{(pid=77618) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 12:56:31 l75lg1-v1 neutron-server[77618]: INFO neutron.wsgi [None req-9649c2f4-d23c-423e-8faf-889f5486fb13 None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=1bca8eeba9b24ed3933a4e22129b02fa&name=default HTTP/1.1" status: 200 len: 216 time: 0.0081241 May 28 12:56:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaed821-d16c-4705-93fc-9ad59883612b None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-0eaed821-d16c-4705-93fc-9ad59883612b None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:31 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-1159c575-bad5-45a5-a633-638f79a76e39 tempest-ExportLocationsTest-1017217578 tempest-ExportLocationsTest-1017217578-project-admin] http://10.27.203.238/share/v2/87c113478e754c47aea49a8b703cd2f6/shares/a96dff4b-6e98-4085-9f3b-45735d209546/export_locations/eedb4e84-98d3-4acc-9a51-8fd62cf7e963 returned with HTTP 200 May 28 12:56:31 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 47/105] 10.27.203.238 () {64 vars in 1613 bytes} [Tue May 28 12:56:31 2024] GET /share/v2/87c113478e754c47aea49a8b703cd2f6/shares/a96dff4b-6e98-4085-9f3b-45735d209546/export_locations/eedb4e84-98d3-4acc-9a51-8fd62cf7e963 => generated 335 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 231 bytes (2 switches on core 0) May 28 12:56:31 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-eda6b89b-13db-4842-b681-6d99576fdbea tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/shares returned with HTTP 200 May 28 12:56:31 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 59/106] 10.27.203.238 () {66 vars in 1362 bytes} [Tue May 28 12:56:31 2024] POST /share/v2/a3499cb78849424db45e54caac01de92/shares => generated 1347 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:56:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaed821-d16c-4705-93fc-9ad59883612b None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:31 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-456ab8ad-096f-4eb9-a81e-296cb62416b2 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] GET http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/shares/a6fffe7e-d89b-4b6c-ada2-53d5855ef606 May 28 12:56:31 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-68544184-860b-445c-abd3-96e866a51d4d tempest-ExportLocationsTest-1017217578 tempest-ExportLocationsTest-1017217578-project-admin] GET http://10.27.203.238/share/v2/87c113478e754c47aea49a8b703cd2f6/shares/a96dff4b-6e98-4085-9f3b-45735d209546/export_locations May 28 12:56:31 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-456ab8ad-096f-4eb9-a81e-296cb62416b2 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:31 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-68544184-860b-445c-abd3-96e866a51d4d tempest-ExportLocationsTest-1017217578 tempest-ExportLocationsTest-1017217578-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:31 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-68544184-860b-445c-abd3-96e866a51d4d tempest-ExportLocationsTest-1017217578 tempest-ExportLocationsTest-1017217578-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:31 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-456ab8ad-096f-4eb9-a81e-296cb62416b2 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:31 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-456ab8ad-096f-4eb9-a81e-296cb62416b2 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/shares/a6fffe7e-d89b-4b6c-ada2-53d5855ef606 returned with HTTP 200 May 28 12:56:31 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 48/107] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:56:31 2024] GET /share/v2/a3499cb78849424db45e54caac01de92/shares/a6fffe7e-d89b-4b6c-ada2-53d5855ef606 => generated 1347 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:56:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd624170-5761-4079-9054-3c605ae9f525 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd624170-5761-4079-9054-3c605ae9f525 None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd624170-5761-4079-9054-3c605ae9f525 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd624170-5761-4079-9054-3c605ae9f525 None admin] PATH_INFO: `/v3/projects/1bca8eeba9b24ed3933a4e22129b02fa` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd624170-5761-4079-9054-3c605ae9f525 None admin] RBAC: Authorizing `identity:delete_project(project_id=1bca8eeba9b24ed3933a4e22129b02fa)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd624170-5761-4079-9054-3c605ae9f525 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:31 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-eda6b89b-13db-4842-b681-6d99576fdbea tempest-AdminActionsTest-1749172189 None] Starting with 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:80}} May 28 12:56:31 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-eda6b89b-13db-4842-b681-6d99576fdbea tempest-AdminActionsTest-1749172189 None] Filter OnlyHostFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:56:31 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-eda6b89b-13db-4842-b681-6d99576fdbea tempest-AdminActionsTest-1749172189 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:56:31 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.capacity [None req-eda6b89b-13db-4842-b681-6d99576fdbea tempest-AdminActionsTest-1749172189 None] Space information for share creation on host l75lg1-v1@vast#vast (requested / avail): 1/2078 {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/capacity.py:83}} May 28 12:56:31 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-eda6b89b-13db-4842-b681-6d99576fdbea tempest-AdminActionsTest-1749172189 None] Filter CapacityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:56:31 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-eda6b89b-13db-4842-b681-6d99576fdbea tempest-AdminActionsTest-1749172189 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:56:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-fd624170-5761-4079-9054-3c605ae9f525 None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1bca8eeba9b24ed3933a4e22129b02fa', 'request_id': 'req-fd624170-5761-4079-9054-3c605ae9f525'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:31 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-eda6b89b-13db-4842-b681-6d99576fdbea tempest-AdminActionsTest-1749172189 None] Driver Filter: Checking host 'l75lg1-v1@vast#vast' {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:37}} May 28 12:56:31 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-eda6b89b-13db-4842-b681-6d99576fdbea tempest-AdminActionsTest-1749172189 None] Filter function not set :: passing host. {{(pid=98327) _check_filter_function /opt/stack/manila/manila/scheduler/filters/driver.py:53}} May 28 12:56:31 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-eda6b89b-13db-4842-b681-6d99576fdbea tempest-AdminActionsTest-1749172189 None] Result: True {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:40}} May 28 12:56:31 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-eda6b89b-13db-4842-b681-6d99576fdbea tempest-AdminActionsTest-1749172189 None] Done checking host 'l75lg1-v1@vast#vast' {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:41}} May 28 12:56:31 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-eda6b89b-13db-4842-b681-6d99576fdbea tempest-AdminActionsTest-1749172189 None] Filter DriverFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:56:31 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-eda6b89b-13db-4842-b681-6d99576fdbea tempest-AdminActionsTest-1749172189 None] Filter ShareReplicationFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:56:31 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-eda6b89b-13db-4842-b681-6d99576fdbea tempest-AdminActionsTest-1749172189 None] Filter CreateFromSnapshotFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:56:31 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-eda6b89b-13db-4842-b681-6d99576fdbea tempest-AdminActionsTest-1749172189 None] Filter AffinityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:56:31 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-eda6b89b-13db-4842-b681-6d99576fdbea tempest-AdminActionsTest-1749172189 None] Filter AntiAffinityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:56:31 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.drivers.filter [None req-eda6b89b-13db-4842-b681-6d99576fdbea tempest-AdminActionsTest-1749172189 None] Filtered share [host: 'l75lg1-v1@vast#vast', free_capacity_gb: 2078.6229242384434, pools: None] {{(pid=98327) _schedule_share /opt/stack/manila/manila/scheduler/drivers/filter.py:268}} May 28 12:56:31 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-eda6b89b-13db-4842-b681-6d99576fdbea tempest-AdminActionsTest-1749172189 None] Checking host 'l75lg1-v1@vast#vast' {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:46}} May 28 12:56:31 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.weighers.goodness [None req-eda6b89b-13db-4842-b681-6d99576fdbea tempest-AdminActionsTest-1749172189 None] Goodness function not set :: defaulting to minimal goodness rating of 0. May 28 12:56:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-fd624170-5761-4079-9054-3c605ae9f525 None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1bca8eeba9b24ed3933a4e22129b02fa', 'request_id': 'req-fd624170-5761-4079-9054-3c605ae9f525'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:31 l75lg1-v1 manila-scheduler[98327]: INFO manila.scheduler.weighers.goodness [None req-eda6b89b-13db-4842-b681-6d99576fdbea tempest-AdminActionsTest-1749172189 None] Goodness function result for host l75lg1-v1@vast#vast: 0. May 28 12:56:31 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-eda6b89b-13db-4842-b681-6d99576fdbea tempest-AdminActionsTest-1749172189 None] Goodness: 0 {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:48}} May 28 12:56:31 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-eda6b89b-13db-4842-b681-6d99576fdbea tempest-AdminActionsTest-1749172189 None] Done checking host 'l75lg1-v1@vast#vast' {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:49}} May 28 12:56:31 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.drivers.filter [None req-eda6b89b-13db-4842-b681-6d99576fdbea tempest-AdminActionsTest-1749172189 None] Choosing for share: WeighedHost [host: l75lg1-v1@vast#vast, weight: 0.0] {{(pid=98327) _schedule_share /opt/stack/manila/manila/scheduler/drivers/filter.py:274}} May 28 12:56:31 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-68544184-860b-445c-abd3-96e866a51d4d tempest-ExportLocationsTest-1017217578 tempest-ExportLocationsTest-1017217578-project-admin] http://10.27.203.238/share/v2/87c113478e754c47aea49a8b703cd2f6/shares/a96dff4b-6e98-4085-9f3b-45735d209546/export_locations returned with HTTP 200 May 28 12:56:31 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 60/108] 10.27.203.238 () {64 vars in 1502 bytes} [Tue May 28 12:56:31 2024] GET /share/v2/87c113478e754c47aea49a8b703cd2f6/shares/a96dff4b-6e98-4085-9f3b-45735d209546/export_locations => generated 250 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:56:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61524ed4-2b1d-4309-a705-218b86c2903c None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61524ed4-2b1d-4309-a705-218b86c2903c None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61524ed4-2b1d-4309-a705-218b86c2903c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-fd624170-5761-4079-9054-3c605ae9f525 None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1bca8eeba9b24ed3933a4e22129b02fa', 'request_id': 'req-fd624170-5761-4079-9054-3c605ae9f525'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-fd624170-5761-4079-9054-3c605ae9f525 None admin] The token cache is being invalidate because project 1bca8eeba9b24ed3933a4e22129b02fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 12:56:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-fd624170-5761-4079-9054-3c605ae9f525 None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-fd624170-5761-4079-9054-3c605ae9f525 None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:31 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 719/1454] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 12:56:31 2024] DELETE /identity/v3/projects/1bca8eeba9b24ed3933a4e22129b02fa => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:56:31 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-61524ed4-2b1d-4309-a705-218b86c2903c None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:56:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422a4928-858a-41b1-b3e7-1c8219f84e84 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422a4928-858a-41b1-b3e7-1c8219f84e84 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422a4928-858a-41b1-b3e7-1c8219f84e84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-61524ed4-2b1d-4309-a705-218b86c2903c None None] MFA Rules not processed for user `8688f80695814f34bfb56342c4e54028`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:56:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-61524ed4-2b1d-4309-a705-218b86c2903c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:31 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-422a4928-858a-41b1-b3e7-1c8219f84e84 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:56:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-422a4928-858a-41b1-b3e7-1c8219f84e84 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:56:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-422a4928-858a-41b1-b3e7-1c8219f84e84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:31 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 720/1455] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:56:31 2024] POST /identity/v3/auth/tokens => generated 312 bytes in 22 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 28 12:56:31 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 736/1456] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:56:31 2024] POST /identity/v3/auth/tokens => generated 3953 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:56:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422a4928-858a-41b1-b3e7-1c8219f84e84 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-422a4928-858a-41b1-b3e7-1c8219f84e84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab86437-7271-40c2-a010-73e4b95bda47 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab86437-7271-40c2-a010-73e4b95bda47 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab86437-7271-40c2-a010-73e4b95bda47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:31 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-bab86437-7271-40c2-a010-73e4b95bda47 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:56:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-bab86437-7271-40c2-a010-73e4b95bda47 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:56:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-bab86437-7271-40c2-a010-73e4b95bda47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:31 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-eda6b89b-13db-4842-b681-6d99576fdbea tempest-AdminActionsTest-1749172189 None] >>> [GET] https://127.0.0.1:40443/api/vippools/ May 28 12:56:31 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-eda6b89b-13db-4842-b681-6d99576fdbea tempest-AdminActionsTest-1749172189 None] {'allow_redirects': True, 'params': {'name': 'vippool-1'}} May 28 12:56:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422a4928-858a-41b1-b3e7-1c8219f84e84 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3610eb58-8970-4403-8375-90a3801cd324 service manila] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f110cf6300f049c897d0aab63218d1e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3610eb58-8970-4403-8375-90a3801cd324 service manila] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3610eb58-8970-4403-8375-90a3801cd324 service manila] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3610eb58-8970-4403-8375-90a3801cd324 service manila] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3610eb58-8970-4403-8375-90a3801cd324 service manila] RBAC: Authorizing `identity:validate_token()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3610eb58-8970-4403-8375-90a3801cd324 service manila] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:31 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 737/1457] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:56:31 2024] POST /identity/v3/auth/tokens => generated 2960 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 12:56:31 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 721/1458] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 12:56:31 2024] GET /identity/v3/auth/tokens => generated 3953 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 12:56:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab86437-7271-40c2-a010-73e4b95bda47 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:31 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-2cbffdf7-48d4-410a-869b-a6235293979b tempest-ExportLocationsTest-1017217578 tempest-manila_87c113478e754c47aea49a8b703cd2f6-1658868277] GET http://10.27.203.238/share/v2/87c113478e754c47aea49a8b703cd2f6/shares/a96dff4b-6e98-4085-9f3b-45735d209546/export_locations/eedb4e84-98d3-4acc-9a51-8fd62cf7e963 May 28 12:56:31 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-2cbffdf7-48d4-410a-869b-a6235293979b tempest-ExportLocationsTest-1017217578 tempest-manila_87c113478e754c47aea49a8b703cd2f6-1658868277] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:31 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-2cbffdf7-48d4-410a-869b-a6235293979b tempest-ExportLocationsTest-1017217578 tempest-manila_87c113478e754c47aea49a8b703cd2f6-1658868277] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab86437-7271-40c2-a010-73e4b95bda47 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327d0a00-d530-41eb-b9ab-ce57272fdf1e None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327d0a00-d530-41eb-b9ab-ce57272fdf1e None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327d0a00-d530-41eb-b9ab-ce57272fdf1e None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327d0a00-d530-41eb-b9ab-ce57272fdf1e None admin] PATH_INFO: `/v3/domains` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327d0a00-d530-41eb-b9ab-ce57272fdf1e None admin] RBAC: Adding query filter params (name=Default) {{(pid=51267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:56:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327d0a00-d530-41eb-b9ab-ce57272fdf1e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327d0a00-d530-41eb-b9ab-ce57272fdf1e None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:31 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-434ed059-1547-4868-b57b-46613126e982 tempest-ShareInstancesTest-1546991288 None] <<< [GET] https://127.0.0.1:40443/api/quotas/ May 28 12:56:31 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-434ed059-1547-4868-b57b-46613126e982 tempest-ShareInstancesTest-1546991288 None] [] May 28 12:56:31 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-434ed059-1547-4868-b57b-46613126e982 tempest-ShareInstancesTest-1546991288 None] --- [GET] https://127.0.0.1:40443/api/quotas/: Done May 28 12:56:31 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-434ed059-1547-4868-b57b-46613126e982 tempest-ShareInstancesTest-1546991288 None] >>> [POST] https://127.0.0.1:40443/api/quotas/ May 28 12:56:31 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-434ed059-1547-4868-b57b-46613126e982 tempest-ShareInstancesTest-1546991288 None] {'data': '{"name": "7f6a42fa-4d45-471e-a438-36876fc6eac8", "path": ' May 28 12:56:31 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-434ed059-1547-4868-b57b-46613126e982 tempest-ShareInstancesTest-1546991288 None] '"/manila/manila-7f6a42fa-4d45-471e-a438-36876fc6eac8", "create_dir": ' May 28 12:56:31 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-434ed059-1547-4868-b57b-46613126e982 tempest-ShareInstancesTest-1546991288 None] 'true, "hard_limit": 1073741824}', May 28 12:56:31 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-434ed059-1547-4868-b57b-46613126e982 tempest-ShareInstancesTest-1546991288 None] 'json': None, May 28 12:56:31 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-434ed059-1547-4868-b57b-46613126e982 tempest-ShareInstancesTest-1546991288 None] 'params': None} May 28 12:56:31 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 738/1459] 10.27.203.238 () {62 vars in 1220 bytes} [Tue May 28 12:56:31 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:56:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3610eb58-8970-4403-8375-90a3801cd324 service manila] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3610eb58-8970-4403-8375-90a3801cd324 service manila] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d705e0-b056-406f-9ad8-55284c4e2712 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d705e0-b056-406f-9ad8-55284c4e2712 None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d705e0-b056-406f-9ad8-55284c4e2712 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d705e0-b056-406f-9ad8-55284c4e2712 None admin] PATH_INFO: `/v3/projects` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d705e0-b056-406f-9ad8-55284c4e2712 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d705e0-b056-406f-9ad8-55284c4e2712 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:31 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-2cbffdf7-48d4-410a-869b-a6235293979b tempest-ExportLocationsTest-1017217578 tempest-manila_87c113478e754c47aea49a8b703cd2f6-1658868277] http://10.27.203.238/share/v2/87c113478e754c47aea49a8b703cd2f6/shares/a96dff4b-6e98-4085-9f3b-45735d209546/export_locations/eedb4e84-98d3-4acc-9a51-8fd62cf7e963 returned with HTTP 200 May 28 12:56:31 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 49/109] 10.27.203.238 () {64 vars in 1613 bytes} [Tue May 28 12:56:31 2024] GET /share/v2/87c113478e754c47aea49a8b703cd2f6/shares/a96dff4b-6e98-4085-9f3b-45735d209546/export_locations/eedb4e84-98d3-4acc-9a51-8fd62cf7e963 => generated 250 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:56:31 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-7506548c-5f56-4a7a-983d-b1027936936e tempest-ExportLocationsTest-1017217578 tempest-ExportLocationsTest-1017217578-project-admin] GET http://10.27.203.238/share/v2/87c113478e754c47aea49a8b703cd2f6/share_instances/83d10127-dfed-433a-90d1-4f0a7f981edc/export_locations May 28 12:56:31 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-7506548c-5f56-4a7a-983d-b1027936936e tempest-ExportLocationsTest-1017217578 tempest-ExportLocationsTest-1017217578-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:31 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-7506548c-5f56-4a7a-983d-b1027936936e tempest-ExportLocationsTest-1017217578 tempest-ExportLocationsTest-1017217578-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:31 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 722/1460] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 12:56:31 2024] POST /identity/v3/projects => generated 387 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:56:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327d0a00-d530-41eb-b9ab-ce57272fdf1e None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327d0a00-d530-41eb-b9ab-ce57272fdf1e None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e691f8-1168-46d1-bf40-285b12c74cc1 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e691f8-1168-46d1-bf40-285b12c74cc1 None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e691f8-1168-46d1-bf40-285b12c74cc1 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e691f8-1168-46d1-bf40-285b12c74cc1 None admin] PATH_INFO: `/v3/users` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e691f8-1168-46d1-bf40-285b12c74cc1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e691f8-1168-46d1-bf40-285b12c74cc1 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:31 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-02e691f8-1168-46d1-bf40-285b12c74cc1 None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 12:56:31 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-7506548c-5f56-4a7a-983d-b1027936936e tempest-ExportLocationsTest-1017217578 tempest-ExportLocationsTest-1017217578-project-admin] http://10.27.203.238/share/v2/87c113478e754c47aea49a8b703cd2f6/share_instances/83d10127-dfed-433a-90d1-4f0a7f981edc/export_locations returned with HTTP 200 May 28 12:56:31 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 61/110] 10.27.203.238 () {64 vars in 1529 bytes} [Tue May 28 12:56:31 2024] GET /share/v2/87c113478e754c47aea49a8b703cd2f6/share_instances/83d10127-dfed-433a-90d1-4f0a7f981edc/export_locations => generated 250 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 231 bytes (2 switches on core 0) May 28 12:56:31 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 739/1461] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 12:56:31 2024] POST /identity/v3/users => generated 301 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:56:31 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-4415844f-fc68-4e29-afdb-46f20145dd5f tempest-ExportLocationsTest-1017217578 tempest-ExportLocationsTest-1017217578-project-admin] GET http://10.27.203.238/share/v2/87c113478e754c47aea49a8b703cd2f6/share_instances/83d10127-dfed-433a-90d1-4f0a7f981edc/export_locations/eedb4e84-98d3-4acc-9a51-8fd62cf7e963 May 28 12:56:31 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-4415844f-fc68-4e29-afdb-46f20145dd5f tempest-ExportLocationsTest-1017217578 tempest-ExportLocationsTest-1017217578-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:31 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-4415844f-fc68-4e29-afdb-46f20145dd5f tempest-ExportLocationsTest-1017217578 tempest-ExportLocationsTest-1017217578-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d705e0-b056-406f-9ad8-55284c4e2712 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d705e0-b056-406f-9ad8-55284c4e2712 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a6ad2a-7925-46bc-9f05-68164162c63e None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a6ad2a-7925-46bc-9f05-68164162c63e None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a6ad2a-7925-46bc-9f05-68164162c63e None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a6ad2a-7925-46bc-9f05-68164162c63e None admin] PATH_INFO: `/v3/roles` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a6ad2a-7925-46bc-9f05-68164162c63e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a6ad2a-7925-46bc-9f05-68164162c63e None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:31 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 723/1462] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 12:56:31 2024] GET /identity/v3/roles => generated 1680 bytes in 18 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:56:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e691f8-1168-46d1-bf40-285b12c74cc1 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e691f8-1168-46d1-bf40-285b12c74cc1 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc479a91-a5d1-4c5e-9296-4b30af65e476 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc479a91-a5d1-4c5e-9296-4b30af65e476 None admin] REQUEST_METHOD: `PUT` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc479a91-a5d1-4c5e-9296-4b30af65e476 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc479a91-a5d1-4c5e-9296-4b30af65e476 None admin] PATH_INFO: `/v3/projects/73271c28550c4c2385cd380c1293f3c1/users/c28f300e47a9400b97d511422835a798/roles/e7989893488f483baa107be56668c4f8` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc479a91-a5d1-4c5e-9296-4b30af65e476 None admin] RBAC: Authorizing `identity:create_grant(project_id=73271c28550c4c2385cd380c1293f3c1, user_id=c28f300e47a9400b97d511422835a798, role_id=e7989893488f483baa107be56668c4f8)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc479a91-a5d1-4c5e-9296-4b30af65e476 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:31 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 740/1463] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 12:56:31 2024] PUT /identity/v3/projects/73271c28550c4c2385cd380c1293f3c1/users/c28f300e47a9400b97d511422835a798/roles/e7989893488f483baa107be56668c4f8 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:56:31 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-4415844f-fc68-4e29-afdb-46f20145dd5f tempest-ExportLocationsTest-1017217578 tempest-ExportLocationsTest-1017217578-project-admin] http://10.27.203.238/share/v2/87c113478e754c47aea49a8b703cd2f6/share_instances/83d10127-dfed-433a-90d1-4f0a7f981edc/export_locations/eedb4e84-98d3-4acc-9a51-8fd62cf7e963 returned with HTTP 200 May 28 12:56:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a6ad2a-7925-46bc-9f05-68164162c63e None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:31 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 50/111] 10.27.203.238 () {64 vars in 1640 bytes} [Tue May 28 12:56:31 2024] GET /share/v2/87c113478e754c47aea49a8b703cd2f6/share_instances/83d10127-dfed-433a-90d1-4f0a7f981edc/export_locations/eedb4e84-98d3-4acc-9a51-8fd62cf7e963 => generated 335 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:56:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a6ad2a-7925-46bc-9f05-68164162c63e None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:31 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-367a9258-7083-4c1a-8c6f-d5fa8f1a9aa0 tempest-ExportLocationsTest-1017217578 tempest-ExportLocationsTest-1017217578-project-admin] GET http://10.27.203.238/share/v2/87c113478e754c47aea49a8b703cd2f6/shares/a96dff4b-6e98-4085-9f3b-45735d209546/export_locations May 28 12:56:31 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-367a9258-7083-4c1a-8c6f-d5fa8f1a9aa0 tempest-ExportLocationsTest-1017217578 tempest-ExportLocationsTest-1017217578-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:31 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-367a9258-7083-4c1a-8c6f-d5fa8f1a9aa0 tempest-ExportLocationsTest-1017217578 tempest-ExportLocationsTest-1017217578-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baca886-dc20-4e79-887b-25248b6f5873 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baca886-dc20-4e79-887b-25248b6f5873 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baca886-dc20-4e79-887b-25248b6f5873 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baca886-dc20-4e79-887b-25248b6f5873 None admin] PATH_INFO: `/v3/roles` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7baca886-dc20-4e79-887b-25248b6f5873 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7baca886-dc20-4e79-887b-25248b6f5873 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:32 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-ecb95707-8f18-40dd-b714-aff88d0aa86d tempest-AdminActionsNegativeTest-763023849 tempest-AdminActionsNegativeTest-763023849-project-admin] GET http://10.27.203.238/share/v2/7c36a466cc2a42b195f921474b0f4de5/shares/415272bd-25d1-465a-87fc-b0fdbc8c093c May 28 12:56:32 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-ecb95707-8f18-40dd-b714-aff88d0aa86d tempest-AdminActionsNegativeTest-763023849 tempest-AdminActionsNegativeTest-763023849-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:32 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-ecb95707-8f18-40dd-b714-aff88d0aa86d tempest-AdminActionsNegativeTest-763023849 tempest-AdminActionsNegativeTest-763023849-project-admin] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:32 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 724/1464] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 12:56:31 2024] GET /identity/v3/roles => generated 1680 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:56:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc479a91-a5d1-4c5e-9296-4b30af65e476 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc479a91-a5d1-4c5e-9296-4b30af65e476 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfbab54-af7c-4a04-91d3-4e72ef789475 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfbab54-af7c-4a04-91d3-4e72ef789475 None admin] REQUEST_METHOD: `PUT` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfbab54-af7c-4a04-91d3-4e72ef789475 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfbab54-af7c-4a04-91d3-4e72ef789475 None admin] PATH_INFO: `/v3/projects/73271c28550c4c2385cd380c1293f3c1/users/c28f300e47a9400b97d511422835a798/roles/e7989893488f483baa107be56668c4f8` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfbab54-af7c-4a04-91d3-4e72ef789475 None admin] RBAC: Authorizing `identity:create_grant(project_id=73271c28550c4c2385cd380c1293f3c1, user_id=c28f300e47a9400b97d511422835a798, role_id=e7989893488f483baa107be56668c4f8)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfbab54-af7c-4a04-91d3-4e72ef789475 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:32 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 741/1465] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 12:56:32 2024] PUT /identity/v3/projects/73271c28550c4c2385cd380c1293f3c1/users/c28f300e47a9400b97d511422835a798/roles/e7989893488f483baa107be56668c4f8 => generated 0 bytes in 19 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:56:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c035f4-7622-4f0b-848c-64850e8c3b86 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c035f4-7622-4f0b-848c-64850e8c3b86 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c035f4-7622-4f0b-848c-64850e8c3b86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:32 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-ecb95707-8f18-40dd-b714-aff88d0aa86d tempest-AdminActionsNegativeTest-763023849 tempest-AdminActionsNegativeTest-763023849-project-admin] http://10.27.203.238/share/v2/7c36a466cc2a42b195f921474b0f4de5/shares/415272bd-25d1-465a-87fc-b0fdbc8c093c returned with HTTP 200 May 28 12:56:32 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 51/112] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:56:31 2024] GET /share/v2/7c36a466cc2a42b195f921474b0f4de5/shares/415272bd-25d1-465a-87fc-b0fdbc8c093c => generated 1373 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:56:32 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-498fa27a-75dd-43e1-936c-a443b5922a22 tempest-AdminActionsNegativeTest-763023849 tempest-AdminActionsNegativeTest-763023849-project-admin] GET http://10.27.203.238/share/v2/7c36a466cc2a42b195f921474b0f4de5/shares/415272bd-25d1-465a-87fc-b0fdbc8c093c/instances May 28 12:56:32 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-498fa27a-75dd-43e1-936c-a443b5922a22 tempest-AdminActionsNegativeTest-763023849 tempest-AdminActionsNegativeTest-763023849-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:32 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-367a9258-7083-4c1a-8c6f-d5fa8f1a9aa0 tempest-ExportLocationsTest-1017217578 tempest-ExportLocationsTest-1017217578-project-admin] http://10.27.203.238/share/v2/87c113478e754c47aea49a8b703cd2f6/shares/a96dff4b-6e98-4085-9f3b-45735d209546/export_locations returned with HTTP 200 May 28 12:56:32 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-498fa27a-75dd-43e1-936c-a443b5922a22 tempest-AdminActionsNegativeTest-763023849 tempest-AdminActionsNegativeTest-763023849-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:32 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 62/113] 10.27.203.238 () {64 vars in 1502 bytes} [Tue May 28 12:56:31 2024] GET /share/v2/87c113478e754c47aea49a8b703cd2f6/shares/a96dff4b-6e98-4085-9f3b-45735d209546/export_locations => generated 230 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:56:32 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-eda6b89b-13db-4842-b681-6d99576fdbea tempest-AdminActionsTest-1749172189 None] <<< [GET] https://127.0.0.1:40443/api/vippools/ May 28 12:56:32 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-a1c035f4-7622-4f0b-848c-64850e8c3b86 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:56:32 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-eda6b89b-13db-4842-b681-6d99576fdbea tempest-AdminActionsTest-1749172189 None] [Bunch(active_cnode_ids=[], active_interfaces=4, cluster='loop75-kfs', cluster_id=1, cnode_ids=[], cnodes=[], domain_name='vippool-1', enable_l3=False, enable_weighted_balancing=False, enabled=True, end_ip='172.21.75.4', guid='f2abaede-b397-413a-8faa-3aeead6d3b28', gw_ip='', gw_ipv6='', id=2, ip_ranges=[['172.21.75.1', '172.21.75.4']], name='vippool-1', peer_asn=0, port_membership='ALL', ranges_summary='172.21.75.[1-4]', role='PROTOCOLS', start_ip='172.21.75.1', subnet_cidr=16, subnet_cidr_ipv6=None, sync='SYNCED', sync_time='2024-05-28T12:50:09.644123Z', tenant_id=1, tenant_name='default', title='172.21.75.1 - 172.21.75.4', url='https://127.0.0.1:40443/api/vippools/2/', vast_asn=0, vlan=0, vms_preferred=False)] May 28 12:56:32 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-eda6b89b-13db-4842-b681-6d99576fdbea tempest-AdminActionsTest-1749172189 None] --- [GET] https://127.0.0.1:40443/api/vippools/: Done May 28 12:56:32 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-eda6b89b-13db-4842-b681-6d99576fdbea tempest-AdminActionsTest-1749172189 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:56:32 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-eda6b89b-13db-4842-b681-6d99576fdbea tempest-AdminActionsTest-1749172189 None] {'allow_redirects': True, May 28 12:56:32 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-eda6b89b-13db-4842-b681-6d99576fdbea tempest-AdminActionsTest-1749172189 None] 'params': {'name': '766fa507-2a4c-47eb-bfef-fa764b38b24c'}} May 28 12:56:32 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-d494dc7d-fa36-452f-a685-b13232107a7a tempest-ExportLocationsTest-1017217578 tempest-manila_87c113478e754c47aea49a8b703cd2f6-1658868277] GET http://10.27.203.238/share/v2/87c113478e754c47aea49a8b703cd2f6/shares/a96dff4b-6e98-4085-9f3b-45735d209546/export_locations May 28 12:56:32 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-d494dc7d-fa36-452f-a685-b13232107a7a tempest-ExportLocationsTest-1017217578 tempest-manila_87c113478e754c47aea49a8b703cd2f6-1658868277] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:32 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-d494dc7d-fa36-452f-a685-b13232107a7a tempest-ExportLocationsTest-1017217578 tempest-manila_87c113478e754c47aea49a8b703cd2f6-1658868277] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-a1c035f4-7622-4f0b-848c-64850e8c3b86 None None] MFA Rules not processed for user `c28f300e47a9400b97d511422835a798`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:56:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-a1c035f4-7622-4f0b-848c-64850e8c3b86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:32 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-498fa27a-75dd-43e1-936c-a443b5922a22 tempest-AdminActionsNegativeTest-763023849 tempest-AdminActionsNegativeTest-763023849-project-admin] http://10.27.203.238/share/v2/7c36a466cc2a42b195f921474b0f4de5/shares/415272bd-25d1-465a-87fc-b0fdbc8c093c/instances returned with HTTP 200 May 28 12:56:32 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 52/114] 10.27.203.238 () {64 vars in 1481 bytes} [Tue May 28 12:56:32 2024] GET /share/v2/7c36a466cc2a42b195f921474b0f4de5/shares/415272bd-25d1-465a-87fc-b0fdbc8c093c/instances => generated 509 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:56:32 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-f14b81f1-4795-434b-97aa-9964eeaa9857 tempest-AdminActionsNegativeTest-763023849 tempest-AdminActionsNegativeTest-763023849-project-admin] POST http://10.27.203.238/share/v2/7c36a466cc2a42b195f921474b0f4de5/snapshots May 28 12:56:32 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-f14b81f1-4795-434b-97aa-9964eeaa9857 tempest-AdminActionsNegativeTest-763023849 tempest-AdminActionsNegativeTest-763023849-project-admin] Action: 'create', calling method: ShareSnapshotMixin.create, body: {"snapshot": {"name": "tempest-tempest-created-share-snap-386634132", "force": false, "description": "Tempest's snapshot", "share_id": "415272bd-25d1-465a-87fc-b0fdbc8c093c"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:56:32 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.v1.share_snapshots [None req-f14b81f1-4795-434b-97aa-9964eeaa9857 tempest-AdminActionsNegativeTest-763023849 tempest-AdminActionsNegativeTest-763023849-project-admin] Create snapshot from share 415272bd-25d1-465a-87fc-b0fdbc8c093c May 28 12:56:32 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 725/1466] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:56:32 2024] POST /identity/v3/auth/tokens => generated 4081 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:56:32 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-d494dc7d-fa36-452f-a685-b13232107a7a tempest-ExportLocationsTest-1017217578 tempest-manila_87c113478e754c47aea49a8b703cd2f6-1658868277] http://10.27.203.238/share/v2/87c113478e754c47aea49a8b703cd2f6/shares/a96dff4b-6e98-4085-9f3b-45735d209546/export_locations returned with HTTP 200 May 28 12:56:32 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 63/115] 10.27.203.238 () {64 vars in 1502 bytes} [Tue May 28 12:56:32 2024] GET /share/v2/87c113478e754c47aea49a8b703cd2f6/shares/a96dff4b-6e98-4085-9f3b-45735d209546/export_locations => generated 165 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:56:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfbab54-af7c-4a04-91d3-4e72ef789475 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-9dfbab54-af7c-4a04-91d3-4e72ef789475 None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:32 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.quota [None req-f14b81f1-4795-434b-97aa-9964eeaa9857 tempest-AdminActionsNegativeTest-763023849 tempest-AdminActionsNegativeTest-763023849-project-admin] Created reservations ['6eafc178-ddee-4c00-b1a0-415fdeb804b7', 'fc5da1ca-3e56-49a0-a92a-4d08021944d5', 'f7669f3f-8bff-4b03-8829-83a9c63c43c1', '9a95918f-d9a1-4f7f-8a59-57c85718932b'] {{(pid=98330) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 12:56:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfbab54-af7c-4a04-91d3-4e72ef789475 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02996558-333b-4e38-a094-e8cded09a681 service manila] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f110cf6300f049c897d0aab63218d1e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02996558-333b-4e38-a094-e8cded09a681 service manila] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02996558-333b-4e38-a094-e8cded09a681 service manila] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02996558-333b-4e38-a094-e8cded09a681 service manila] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02996558-333b-4e38-a094-e8cded09a681 service manila] RBAC: Authorizing `identity:validate_token()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02996558-333b-4e38-a094-e8cded09a681 service manila] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:32 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 742/1467] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 12:56:32 2024] GET /identity/v3/auth/tokens => generated 4081 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 12:56:32 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-9727582e-cd55-469c-a821-3bf34112c767 tempest-ExtraSpecsWriteAdminTest-1668668484 tempest-ExtraSpecsWriteAdminTest-1668668484-project-admin] POST http://10.27.203.238/share/v2/73271c28550c4c2385cd380c1293f3c1/types May 28 12:56:32 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-9727582e-cd55-469c-a821-3bf34112c767 tempest-ExtraSpecsWriteAdminTest-1668668484 tempest-ExtraSpecsWriteAdminTest-1668668484-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share_type": {"name": "tempest-share-type-695886510", "extra_specs": {"driver_handles_share_servers": "False"}, "share_type_access:is_public": true}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:56:32 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-9727582e-cd55-469c-a821-3bf34112c767 tempest-ExtraSpecsWriteAdminTest-1668668484 tempest-ExtraSpecsWriteAdminTest-1668668484-project-admin] http://10.27.203.238/share/v2/73271c28550c4c2385cd380c1293f3c1/types returned with HTTP 200 May 28 12:56:32 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 64/116] 10.27.203.238 () {66 vars in 1359 bytes} [Tue May 28 12:56:32 2024] POST /share/v2/73271c28550c4c2385cd380c1293f3c1/types => generated 613 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:56:32 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-181048d9-86c3-4e4d-9c43-3d7532a23c76 tempest-ExportLocationsTest-1017217578 tempest-ExportLocationsTest-1017217578-project-admin] GET http://10.27.203.238/share/v2/87c113478e754c47aea49a8b703cd2f6/shares/a96dff4b-6e98-4085-9f3b-45735d209546/export_locations May 28 12:56:32 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-181048d9-86c3-4e4d-9c43-3d7532a23c76 tempest-ExportLocationsTest-1017217578 tempest-ExportLocationsTest-1017217578-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:32 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-181048d9-86c3-4e4d-9c43-3d7532a23c76 tempest-ExportLocationsTest-1017217578 tempest-ExportLocationsTest-1017217578-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:32 l75lg1-v1 dstat.sh[49771]: 28-05 12:56:32| 24 2 70 3 0|5636M 1875M 277M 7838M| 14k 12k| 0 12M| 0 1143 | 11k 19k|1.78 0.98 0.98|3.0 1.0 0| 0 0 | 0 2048M| 29 344 0 42 0 May 28 12:56:32 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-181048d9-86c3-4e4d-9c43-3d7532a23c76 tempest-ExportLocationsTest-1017217578 tempest-ExportLocationsTest-1017217578-project-admin] http://10.27.203.238/share/v2/87c113478e754c47aea49a8b703cd2f6/shares/a96dff4b-6e98-4085-9f3b-45735d209546/export_locations returned with HTTP 200 May 28 12:56:32 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 65/117] 10.27.203.238 () {64 vars in 1502 bytes} [Tue May 28 12:56:32 2024] GET /share/v2/87c113478e754c47aea49a8b703cd2f6/shares/a96dff4b-6e98-4085-9f3b-45735d209546/export_locations => generated 250 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:56:32 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-2d383c47-3f6a-4e2a-8616-03da4ceaf7cc tempest-ExtraSpecsWriteAdminTest-1668668484 tempest-ExtraSpecsWriteAdminTest-1668668484-project-admin] POST http://10.27.203.238/share/v1/73271c28550c4c2385cd380c1293f3c1/types/4aaa6f85-331c-40c5-b20c-3c742bcbe038/extra_specs May 28 12:56:32 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-2d383c47-3f6a-4e2a-8616-03da4ceaf7cc tempest-ExtraSpecsWriteAdminTest-1668668484 tempest-ExtraSpecsWriteAdminTest-1668668484-project-admin] Action: 'create', calling method: ShareTypeExtraSpecsController.create, body: {"extra_specs": {"key1": "value1", "key2": "value2"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:56:32 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-2d383c47-3f6a-4e2a-8616-03da4ceaf7cc tempest-ExtraSpecsWriteAdminTest-1668668484 tempest-ExtraSpecsWriteAdminTest-1668668484-project-admin] http://10.27.203.238/share/v1/73271c28550c4c2385cd380c1293f3c1/types/4aaa6f85-331c-40c5-b20c-3c742bcbe038/extra_specs returned with HTTP 200 May 28 12:56:32 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 66/118] 10.27.203.238 () {64 vars in 1462 bytes} [Tue May 28 12:56:32 2024] POST /share/v1/73271c28550c4c2385cd380c1293f3c1/types/4aaa6f85-331c-40c5-b20c-3c742bcbe038/extra_specs => generated 53 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 229 bytes (1 switches on core 0) May 28 12:56:32 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-7098f3df-29c3-48f9-ae5e-4d52776403a6 tempest-ExportLocationsTest-1017217578 tempest-ExportLocationsTest-1017217578-project-admin] GET http://10.27.203.238/share/v2/87c113478e754c47aea49a8b703cd2f6/share_instances/83d10127-dfed-433a-90d1-4f0a7f981edc/export_locations May 28 12:56:32 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-7098f3df-29c3-48f9-ae5e-4d52776403a6 tempest-ExportLocationsTest-1017217578 tempest-ExportLocationsTest-1017217578-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:32 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-7098f3df-29c3-48f9-ae5e-4d52776403a6 tempest-ExportLocationsTest-1017217578 tempest-ExportLocationsTest-1017217578-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:32 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.quota [None req-f14b81f1-4795-434b-97aa-9964eeaa9857 tempest-AdminActionsNegativeTest-763023849 tempest-AdminActionsNegativeTest-763023849-project-admin] Committed reservations ['6eafc178-ddee-4c00-b1a0-415fdeb804b7', 'fc5da1ca-3e56-49a0-a92a-4d08021944d5', 'f7669f3f-8bff-4b03-8829-83a9c63c43c1', '9a95918f-d9a1-4f7f-8a59-57c85718932b'] {{(pid=98330) commit /opt/stack/manila/manila/quota.py:1063}} May 28 12:56:32 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-f14b81f1-4795-434b-97aa-9964eeaa9857 tempest-AdminActionsNegativeTest-763023849 tempest-AdminActionsNegativeTest-763023849-project-admin] http://10.27.203.238/share/v2/7c36a466cc2a42b195f921474b0f4de5/snapshots returned with HTTP 202 May 28 12:56:32 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 53/119] 10.27.203.238 () {66 vars in 1371 bytes} [Tue May 28 12:56:32 2024] POST /share/v2/7c36a466cc2a42b195f921474b0f4de5/snapshots => generated 749 bytes in 315 msecs (HTTP/1.1 202) 6 headers in 237 bytes (2 switches on core 0) May 28 12:56:32 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-7098f3df-29c3-48f9-ae5e-4d52776403a6 tempest-ExportLocationsTest-1017217578 tempest-ExportLocationsTest-1017217578-project-admin] http://10.27.203.238/share/v2/87c113478e754c47aea49a8b703cd2f6/share_instances/83d10127-dfed-433a-90d1-4f0a7f981edc/export_locations returned with HTTP 200 May 28 12:56:32 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 67/120] 10.27.203.238 () {64 vars in 1529 bytes} [Tue May 28 12:56:32 2024] GET /share/v2/87c113478e754c47aea49a8b703cd2f6/share_instances/83d10127-dfed-433a-90d1-4f0a7f981edc/export_locations => generated 230 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:56:32 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-1b66a39e-dd53-488f-a1e4-4ccb327d5d7f tempest-ExtraSpecsWriteAdminTest-1668668484 tempest-ExtraSpecsWriteAdminTest-1668668484-project-admin] DELETE http://10.27.203.238/share/v1/73271c28550c4c2385cd380c1293f3c1/types/4aaa6f85-331c-40c5-b20c-3c742bcbe038/extra_specs/key1 May 28 12:56:32 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-1b66a39e-dd53-488f-a1e4-4ccb327d5d7f tempest-ExtraSpecsWriteAdminTest-1668668484 tempest-ExtraSpecsWriteAdminTest-1668668484-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:32 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-1b66a39e-dd53-488f-a1e4-4ccb327d5d7f tempest-ExtraSpecsWriteAdminTest-1668668484 tempest-ExtraSpecsWriteAdminTest-1668668484-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:32 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-5e1bb9a2-9729-4925-abf9-544b2548226a tempest-AdminActionsNegativeTest-763023849 tempest-AdminActionsNegativeTest-763023849-project-admin] GET http://10.27.203.238/share/v2/7c36a466cc2a42b195f921474b0f4de5/snapshots/330a4554-af48-41d4-8b48-7c7fa0931581 May 28 12:56:32 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-5e1bb9a2-9729-4925-abf9-544b2548226a tempest-AdminActionsNegativeTest-763023849 tempest-AdminActionsNegativeTest-763023849-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:32 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-5e1bb9a2-9729-4925-abf9-544b2548226a tempest-AdminActionsNegativeTest-763023849 tempest-AdminActionsNegativeTest-763023849-project-admin] Calling method 'ShareSnapshotMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:32 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-1b66a39e-dd53-488f-a1e4-4ccb327d5d7f tempest-ExtraSpecsWriteAdminTest-1668668484 tempest-ExtraSpecsWriteAdminTest-1668668484-project-admin] http://10.27.203.238/share/v1/73271c28550c4c2385cd380c1293f3c1/types/4aaa6f85-331c-40c5-b20c-3c742bcbe038/extra_specs/key1 returned with HTTP 202 May 28 12:56:32 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 54/121] 10.27.203.238 () {62 vars in 1459 bytes} [Tue May 28 12:56:32 2024] DELETE /share/v1/73271c28550c4c2385cd380c1293f3c1/types/4aaa6f85-331c-40c5-b20c-3c742bcbe038/extra_specs/key1 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 6 headers in 242 bytes (1 switches on core 0) May 28 12:56:32 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-c1d2ab20-52d9-4225-a09b-fa386bf60bf4 tempest-ExportLocationsTest-1017217578 tempest-ExportLocationsTest-1017217578-project-admin] GET http://10.27.203.238/share/v2/87c113478e754c47aea49a8b703cd2f6/share_instances/83d10127-dfed-433a-90d1-4f0a7f981edc/export_locations May 28 12:56:32 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-c1d2ab20-52d9-4225-a09b-fa386bf60bf4 tempest-ExportLocationsTest-1017217578 tempest-ExportLocationsTest-1017217578-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:32 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-c1d2ab20-52d9-4225-a09b-fa386bf60bf4 tempest-ExportLocationsTest-1017217578 tempest-ExportLocationsTest-1017217578-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:32 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-c1d2ab20-52d9-4225-a09b-fa386bf60bf4 tempest-ExportLocationsTest-1017217578 tempest-ExportLocationsTest-1017217578-project-admin] http://10.27.203.238/share/v2/87c113478e754c47aea49a8b703cd2f6/share_instances/83d10127-dfed-433a-90d1-4f0a7f981edc/export_locations returned with HTTP 200 May 28 12:56:32 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 55/122] 10.27.203.238 () {64 vars in 1529 bytes} [Tue May 28 12:56:32 2024] GET /share/v2/87c113478e754c47aea49a8b703cd2f6/share_instances/83d10127-dfed-433a-90d1-4f0a7f981edc/export_locations => generated 250 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:56:32 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-62e2adce-b47d-4f28-9779-16e6675e1acf tempest-ExtraSpecsWriteAdminTest-1668668484 tempest-ExtraSpecsWriteAdminTest-1668668484-project-admin] GET http://10.27.203.238/share/v1/73271c28550c4c2385cd380c1293f3c1/types/4aaa6f85-331c-40c5-b20c-3c742bcbe038/extra_specs May 28 12:56:32 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-62e2adce-b47d-4f28-9779-16e6675e1acf tempest-ExtraSpecsWriteAdminTest-1668668484 tempest-ExtraSpecsWriteAdminTest-1668668484-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:32 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-62e2adce-b47d-4f28-9779-16e6675e1acf tempest-ExtraSpecsWriteAdminTest-1668668484 tempest-ExtraSpecsWriteAdminTest-1668668484-project-admin] Calling method 'ShareTypeExtraSpecsController.index' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:32 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-62e2adce-b47d-4f28-9779-16e6675e1acf tempest-ExtraSpecsWriteAdminTest-1668668484 tempest-ExtraSpecsWriteAdminTest-1668668484-project-admin] http://10.27.203.238/share/v1/73271c28550c4c2385cd380c1293f3c1/types/4aaa6f85-331c-40c5-b20c-3c742bcbe038/extra_specs returned with HTTP 200 May 28 12:56:32 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 56/123] 10.27.203.238 () {62 vars in 1441 bytes} [Tue May 28 12:56:32 2024] GET /share/v1/73271c28550c4c2385cd380c1293f3c1/types/4aaa6f85-331c-40c5-b20c-3c742bcbe038/extra_specs => generated 76 bytes in 18 msecs (HTTP/1.1 200) 6 headers in 229 bytes (1 switches on core 0) May 28 12:56:32 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-9a41b76a-9a27-4f29-9e1f-9025c745bd2f tempest-ExportLocationsTest-1017217578 tempest-ExportLocationsTest-1017217578-project-admin] GET http://10.27.203.238/share/v2/87c113478e754c47aea49a8b703cd2f6/shares/a96dff4b-6e98-4085-9f3b-45735d209546/export_locations May 28 12:56:32 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-9a41b76a-9a27-4f29-9e1f-9025c745bd2f tempest-ExportLocationsTest-1017217578 tempest-ExportLocationsTest-1017217578-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:32 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-9a41b76a-9a27-4f29-9e1f-9025c745bd2f tempest-ExportLocationsTest-1017217578 tempest-ExportLocationsTest-1017217578-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:32 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f14b81f1-4795-434b-97aa-9964eeaa9857 tempest-AdminActionsNegativeTest-763023849 None] >>> [POST] https://127.0.0.1:40443/api/snapshots/ May 28 12:56:32 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f14b81f1-4795-434b-97aa-9964eeaa9857 tempest-AdminActionsNegativeTest-763023849 None] {'data': '{"path": "/manila/manila-5ae9ae15-dc00-44c8-891a-9758f2b29855", ' May 28 12:56:32 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f14b81f1-4795-434b-97aa-9964eeaa9857 tempest-AdminActionsNegativeTest-763023849 None] '"name": "share-snapshot-2c33c0a4-eec6-45e7-9277-173d95361e7a"}', May 28 12:56:32 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f14b81f1-4795-434b-97aa-9964eeaa9857 tempest-AdminActionsNegativeTest-763023849 None] 'json': None, May 28 12:56:32 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f14b81f1-4795-434b-97aa-9964eeaa9857 tempest-AdminActionsNegativeTest-763023849 None] 'params': None} May 28 12:56:32 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-5e1bb9a2-9729-4925-abf9-544b2548226a tempest-AdminActionsNegativeTest-763023849 tempest-AdminActionsNegativeTest-763023849-project-admin] http://10.27.203.238/share/v2/7c36a466cc2a42b195f921474b0f4de5/snapshots/330a4554-af48-41d4-8b48-7c7fa0931581 returned with HTTP 200 May 28 12:56:32 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 68/124] 10.27.203.238 () {64 vars in 1460 bytes} [Tue May 28 12:56:32 2024] GET /share/v2/7c36a466cc2a42b195f921474b0f4de5/snapshots/330a4554-af48-41d4-8b48-7c7fa0931581 => generated 749 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:56:32 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-4904616c-4abf-49c8-ac18-f4cfa62fff7a tempest-ExtraSpecsWriteAdminTest-1668668484 tempest-ExtraSpecsWriteAdminTest-1668668484-project-admin] POST http://10.27.203.238/share/v2/73271c28550c4c2385cd380c1293f3c1/types May 28 12:56:32 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-4904616c-4abf-49c8-ac18-f4cfa62fff7a tempest-ExtraSpecsWriteAdminTest-1668668484 tempest-ExtraSpecsWriteAdminTest-1668668484-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share_type": {"name": "tempest-share-type-2113033476", "extra_specs": {"driver_handles_share_servers": "False"}, "share_type_access:is_public": true}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:56:32 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-eda6b89b-13db-4842-b681-6d99576fdbea tempest-AdminActionsTest-1749172189 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:56:32 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-eda6b89b-13db-4842-b681-6d99576fdbea tempest-AdminActionsTest-1749172189 None] [] May 28 12:56:32 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-eda6b89b-13db-4842-b681-6d99576fdbea tempest-AdminActionsTest-1749172189 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 12:56:32 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-eda6b89b-13db-4842-b681-6d99576fdbea tempest-AdminActionsTest-1749172189 None] >>> [POST] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:56:32 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-eda6b89b-13db-4842-b681-6d99576fdbea tempest-AdminActionsTest-1749172189 None] {'data': '{"name": "766fa507-2a4c-47eb-bfef-fa764b38b24c"}', May 28 12:56:32 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-eda6b89b-13db-4842-b681-6d99576fdbea tempest-AdminActionsTest-1749172189 None] 'json': None, May 28 12:56:32 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-eda6b89b-13db-4842-b681-6d99576fdbea tempest-AdminActionsTest-1749172189 None] 'params': None} May 28 12:56:32 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-9a41b76a-9a27-4f29-9e1f-9025c745bd2f tempest-ExportLocationsTest-1017217578 tempest-ExportLocationsTest-1017217578-project-admin] http://10.27.203.238/share/v2/87c113478e754c47aea49a8b703cd2f6/shares/a96dff4b-6e98-4085-9f3b-45735d209546/export_locations returned with HTTP 200 May 28 12:56:32 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 57/125] 10.27.203.238 () {64 vars in 1502 bytes} [Tue May 28 12:56:32 2024] GET /share/v2/87c113478e754c47aea49a8b703cd2f6/shares/a96dff4b-6e98-4085-9f3b-45735d209546/export_locations => generated 250 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:56:32 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-4904616c-4abf-49c8-ac18-f4cfa62fff7a tempest-ExtraSpecsWriteAdminTest-1668668484 tempest-ExtraSpecsWriteAdminTest-1668668484-project-admin] http://10.27.203.238/share/v2/73271c28550c4c2385cd380c1293f3c1/types returned with HTTP 200 May 28 12:56:32 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-77ad3804-80b3-4181-a87c-3f2d965d9d9d tempest-ExportLocationsTest-1017217578 tempest-ExportLocationsTest-1017217578-project-admin] GET http://10.27.203.238/share/v2/87c113478e754c47aea49a8b703cd2f6/share_instances/83d10127-dfed-433a-90d1-4f0a7f981edc/export_locations May 28 12:56:32 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 69/126] 10.27.203.238 () {66 vars in 1359 bytes} [Tue May 28 12:56:32 2024] POST /share/v2/73271c28550c4c2385cd380c1293f3c1/types => generated 615 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:56:32 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-77ad3804-80b3-4181-a87c-3f2d965d9d9d tempest-ExportLocationsTest-1017217578 tempest-ExportLocationsTest-1017217578-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:32 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-77ad3804-80b3-4181-a87c-3f2d965d9d9d tempest-ExportLocationsTest-1017217578 tempest-ExportLocationsTest-1017217578-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:32 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-9fdb4a2a-06d4-4428-bea3-69c593aa551f tempest-ExtraSpecsWriteAdminTest-1668668484 tempest-ExtraSpecsWriteAdminTest-1668668484-project-admin] POST http://10.27.203.238/share/v1/73271c28550c4c2385cd380c1293f3c1/types/1f9564e3-da3e-4b85-9d38-c179d1fbba01/extra_specs May 28 12:56:32 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-9fdb4a2a-06d4-4428-bea3-69c593aa551f tempest-ExtraSpecsWriteAdminTest-1668668484 tempest-ExtraSpecsWriteAdminTest-1668668484-project-admin] Action: 'create', calling method: ShareTypeExtraSpecsController.create, body: {"extra_specs": {"key1": "value1", "key2": "value2"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:56:32 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-9fdb4a2a-06d4-4428-bea3-69c593aa551f tempest-ExtraSpecsWriteAdminTest-1668668484 tempest-ExtraSpecsWriteAdminTest-1668668484-project-admin] http://10.27.203.238/share/v1/73271c28550c4c2385cd380c1293f3c1/types/1f9564e3-da3e-4b85-9d38-c179d1fbba01/extra_specs returned with HTTP 200 May 28 12:56:32 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 70/127] 10.27.203.238 () {64 vars in 1462 bytes} [Tue May 28 12:56:32 2024] POST /share/v1/73271c28550c4c2385cd380c1293f3c1/types/1f9564e3-da3e-4b85-9d38-c179d1fbba01/extra_specs => generated 53 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 229 bytes (1 switches on core 0) May 28 12:56:32 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-f20e2f12-bf35-48b6-b074-12e1d0e79362 tempest-ExtraSpecsWriteAdminTest-1668668484 tempest-ExtraSpecsWriteAdminTest-1668668484-project-admin] POST http://10.27.203.238/share/v2/73271c28550c4c2385cd380c1293f3c1/types/1f9564e3-da3e-4b85-9d38-c179d1fbba01/extra_specs May 28 12:56:32 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-f20e2f12-bf35-48b6-b074-12e1d0e79362 tempest-ExtraSpecsWriteAdminTest-1668668484 tempest-ExtraSpecsWriteAdminTest-1668668484-project-admin] Action: 'create', calling method: ShareTypeExtraSpecsController.create, body: {"extra_specs": {"snapshot_support": "True"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:56:32 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-77ad3804-80b3-4181-a87c-3f2d965d9d9d tempest-ExportLocationsTest-1017217578 tempest-ExportLocationsTest-1017217578-project-admin] http://10.27.203.238/share/v2/87c113478e754c47aea49a8b703cd2f6/share_instances/83d10127-dfed-433a-90d1-4f0a7f981edc/export_locations returned with HTTP 200 May 28 12:56:32 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 58/128] 10.27.203.238 () {64 vars in 1529 bytes} [Tue May 28 12:56:32 2024] GET /share/v2/87c113478e754c47aea49a8b703cd2f6/share_instances/83d10127-dfed-433a-90d1-4f0a7f981edc/export_locations => generated 250 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 231 bytes (2 switches on core 0) May 28 12:56:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c035f4-7622-4f0b-848c-64850e8c3b86 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-a1c035f4-7622-4f0b-848c-64850e8c3b86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:32 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-f20e2f12-bf35-48b6-b074-12e1d0e79362 tempest-ExtraSpecsWriteAdminTest-1668668484 tempest-ExtraSpecsWriteAdminTest-1668668484-project-admin] http://10.27.203.238/share/v2/73271c28550c4c2385cd380c1293f3c1/types/1f9564e3-da3e-4b85-9d38-c179d1fbba01/extra_specs returned with HTTP 200 May 28 12:56:32 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 71/129] 10.27.203.238 () {66 vars in 1505 bytes} [Tue May 28 12:56:32 2024] POST /share/v2/73271c28550c4c2385cd380c1293f3c1/types/1f9564e3-da3e-4b85-9d38-c179d1fbba01/extra_specs => generated 45 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 230 bytes (2 switches on core 0) May 28 12:56:32 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-d724807c-524b-4013-9762-fa7f449851f4 tempest-ExtraSpecsWriteAdminTest-1668668484 tempest-ExtraSpecsWriteAdminTest-1668668484-project-admin] GET http://10.27.203.238/share/v1/73271c28550c4c2385cd380c1293f3c1/types/1f9564e3-da3e-4b85-9d38-c179d1fbba01/extra_specs May 28 12:56:32 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-d724807c-524b-4013-9762-fa7f449851f4 tempest-ExtraSpecsWriteAdminTest-1668668484 tempest-ExtraSpecsWriteAdminTest-1668668484-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:32 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-d724807c-524b-4013-9762-fa7f449851f4 tempest-ExtraSpecsWriteAdminTest-1668668484 tempest-ExtraSpecsWriteAdminTest-1668668484-project-admin] Calling method 'ShareTypeExtraSpecsController.index' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:32 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-d724807c-524b-4013-9762-fa7f449851f4 tempest-ExtraSpecsWriteAdminTest-1668668484 tempest-ExtraSpecsWriteAdminTest-1668668484-project-admin] http://10.27.203.238/share/v1/73271c28550c4c2385cd380c1293f3c1/types/1f9564e3-da3e-4b85-9d38-c179d1fbba01/extra_specs returned with HTTP 200 May 28 12:56:32 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 59/130] 10.27.203.238 () {62 vars in 1441 bytes} [Tue May 28 12:56:32 2024] GET /share/v1/73271c28550c4c2385cd380c1293f3c1/types/1f9564e3-da3e-4b85-9d38-c179d1fbba01/extra_specs => generated 122 bytes in 16 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:56:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c035f4-7622-4f0b-848c-64850e8c3b86 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:32 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-4686cf6e-f608-4e4c-a0fe-23a3c670a8a6 tempest-ExtraSpecsWriteAdminTest-1668668484 tempest-ExtraSpecsWriteAdminTest-1668668484-project-admin] DELETE http://10.27.203.238/share/v2/73271c28550c4c2385cd380c1293f3c1/types/1f9564e3-da3e-4b85-9d38-c179d1fbba01/extra_specs/snapshot_support May 28 12:56:32 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-4686cf6e-f608-4e4c-a0fe-23a3c670a8a6 tempest-ExtraSpecsWriteAdminTest-1668668484 tempest-ExtraSpecsWriteAdminTest-1668668484-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:32 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-4686cf6e-f608-4e4c-a0fe-23a3c670a8a6 tempest-ExtraSpecsWriteAdminTest-1668668484 tempest-ExtraSpecsWriteAdminTest-1668668484-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41bfb12-74cf-4a03-9125-b888f672deee tempest-ExportLocationsTest-1017217578 tempest-ExportLocationsTest-1017217578-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cf7583288d4a4eac3cf2f7fac50a81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87c113478e754c47aea49a8b703cd2f6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41bfb12-74cf-4a03-9125-b888f672deee tempest-ExportLocationsTest-1017217578 tempest-ExportLocationsTest-1017217578-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41bfb12-74cf-4a03-9125-b888f672deee tempest-ExportLocationsTest-1017217578 tempest-ExportLocationsTest-1017217578-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41bfb12-74cf-4a03-9125-b888f672deee tempest-ExportLocationsTest-1017217578 tempest-ExportLocationsTest-1017217578-project-admin] PATH_INFO: `/v3/users/8688f80695814f34bfb56342c4e54028` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41bfb12-74cf-4a03-9125-b888f672deee tempest-ExportLocationsTest-1017217578 tempest-ExportLocationsTest-1017217578-project-admin] RBAC: Authorizing `identity:delete_user(user_id=8688f80695814f34bfb56342c4e54028)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41bfb12-74cf-4a03-9125-b888f672deee tempest-ExportLocationsTest-1017217578 tempest-ExportLocationsTest-1017217578-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:32 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-4686cf6e-f608-4e4c-a0fe-23a3c670a8a6 tempest-ExtraSpecsWriteAdminTest-1668668484 tempest-ExtraSpecsWriteAdminTest-1668668484-project-admin] http://10.27.203.238/share/v2/73271c28550c4c2385cd380c1293f3c1/types/1f9564e3-da3e-4b85-9d38-c179d1fbba01/extra_specs/snapshot_support returned with HTTP 202 May 28 12:56:32 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 72/131] 10.27.203.238 () {64 vars in 1538 bytes} [Tue May 28 12:56:32 2024] DELETE /share/v2/73271c28550c4c2385cd380c1293f3c1/types/1f9564e3-da3e-4b85-9d38-c179d1fbba01/extra_specs/snapshot_support => generated 0 bytes in 27 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:56:32 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-44357268-290e-4882-b4e1-c95c2782745b tempest-ExtraSpecsWriteAdminTest-1668668484 tempest-ExtraSpecsWriteAdminTest-1668668484-project-admin] GET http://10.27.203.238/share/v1/73271c28550c4c2385cd380c1293f3c1/types/1f9564e3-da3e-4b85-9d38-c179d1fbba01/extra_specs May 28 12:56:32 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-44357268-290e-4882-b4e1-c95c2782745b tempest-ExtraSpecsWriteAdminTest-1668668484 tempest-ExtraSpecsWriteAdminTest-1668668484-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:32 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-44357268-290e-4882-b4e1-c95c2782745b tempest-ExtraSpecsWriteAdminTest-1668668484 tempest-ExtraSpecsWriteAdminTest-1668668484-project-admin] Calling method 'ShareTypeExtraSpecsController.index' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:32 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-44357268-290e-4882-b4e1-c95c2782745b tempest-ExtraSpecsWriteAdminTest-1668668484 tempest-ExtraSpecsWriteAdminTest-1668668484-project-admin] http://10.27.203.238/share/v1/73271c28550c4c2385cd380c1293f3c1/types/1f9564e3-da3e-4b85-9d38-c179d1fbba01/extra_specs returned with HTTP 200 May 28 12:56:32 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 60/132] 10.27.203.238 () {62 vars in 1441 bytes} [Tue May 28 12:56:32 2024] GET /share/v1/73271c28550c4c2385cd380c1293f3c1/types/1f9564e3-da3e-4b85-9d38-c179d1fbba01/extra_specs => generated 94 bytes in 12 msecs (HTTP/1.1 200) 6 headers in 229 bytes (1 switches on core 0) May 28 12:56:32 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-b0ff8027-9df3-4fa9-aff6-159d700e2c3c tempest-ExtraSpecsWriteAdminTest-1668668484 tempest-ExtraSpecsWriteAdminTest-1668668484-project-admin] POST http://10.27.203.238/share/v2/73271c28550c4c2385cd380c1293f3c1/types May 28 12:56:32 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-b0ff8027-9df3-4fa9-aff6-159d700e2c3c tempest-ExtraSpecsWriteAdminTest-1668668484 tempest-ExtraSpecsWriteAdminTest-1668668484-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share_type": {"name": "tempest-share-type-1829620667", "extra_specs": {"driver_handles_share_servers": "False"}, "share_type_access:is_public": true}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:56:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-d41bfb12-74cf-4a03-9125-b888f672deee tempest-ExportLocationsTest-1017217578 tempest-ExportLocationsTest-1017217578-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8688f80695814f34bfb56342c4e54028', 'request_id': 'req-d41bfb12-74cf-4a03-9125-b888f672deee'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-d41bfb12-74cf-4a03-9125-b888f672deee tempest-ExportLocationsTest-1017217578 tempest-ExportLocationsTest-1017217578-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8688f80695814f34bfb56342c4e54028', 'request_id': 'req-d41bfb12-74cf-4a03-9125-b888f672deee'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:32 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-434ed059-1547-4868-b57b-46613126e982 tempest-ShareInstancesTest-1546991288 None] <<< [POST] https://127.0.0.1:40443/api/quotas/ May 28 12:56:32 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-434ed059-1547-4868-b57b-46613126e982 tempest-ShareInstancesTest-1546991288 None] Bunch(cluster='loop75-kfs', cluster_id=1, default_email=None, default_group_quota=None, default_user_quota=None, enable_alarms=True, enable_email_providers=True, grace_period=None, group_quotas=[], guid='1273b39d-5d19-4c05-8891-017862c1ae23', hard_limit=1073741824, hard_limit_inodes=None, id=4, internal=False, is_user_quota=False, last_user_quotas_update=None, name='7f6a42fa-4d45-471e-a438-36876fc6eac8', num_blocked_users=0, num_exceeded_users=0, path='/manila/manila-7f6a42fa-4d45-471e-a438-36876fc6eac8', percent_capacity=0, percent_inodes=None, pretty_grace_period=None, pretty_grace_period_expiration=None, pretty_state='OK (CREATED)', soft_limit=None, soft_limit_inodes=None, state='OK', sync_state='CREATED', system_id=4, tenant_id=1, tenant_name='default', time_to_block=None, title='7f6a42fa-4d45-471e-a438-36876fc6eac8', url='https://127.0.0.1:40443/api/quotas/4/', used_capacity=0, used_capacity_tb=0.0, used_effective_capacity=0, used_effective_capacity_tb=0.0, used_inodes=0, used_limited_capacity=0, user_quotas=[]) May 28 12:56:32 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-434ed059-1547-4868-b57b-46613126e982 tempest-ShareInstancesTest-1546991288 None] --- [POST] https://127.0.0.1:40443/api/quotas/: Done May 28 12:56:32 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-434ed059-1547-4868-b57b-46613126e982 tempest-ShareInstancesTest-1546991288 None] >>> [GET] https://127.0.0.1:40443/api/views/ May 28 12:56:32 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-434ed059-1547-4868-b57b-46613126e982 tempest-ShareInstancesTest-1546991288 None] {'allow_redirects': True, May 28 12:56:32 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-434ed059-1547-4868-b57b-46613126e982 tempest-ShareInstancesTest-1546991288 None] 'params': {'name': '7f6a42fa-4d45-471e-a438-36876fc6eac8'}} May 28 12:56:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-d41bfb12-74cf-4a03-9125-b888f672deee tempest-ExportLocationsTest-1017217578 tempest-ExportLocationsTest-1017217578-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8688f80695814f34bfb56342c4e54028', 'request_id': 'req-d41bfb12-74cf-4a03-9125-b888f672deee'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-d41bfb12-74cf-4a03-9125-b888f672deee tempest-ExportLocationsTest-1017217578 tempest-ExportLocationsTest-1017217578-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8688f80695814f34bfb56342c4e54028', 'request_id': 'req-d41bfb12-74cf-4a03-9125-b888f672deee'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-d41bfb12-74cf-4a03-9125-b888f672deee tempest-ExportLocationsTest-1017217578 tempest-ExportLocationsTest-1017217578-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8688f80695814f34bfb56342c4e54028', 'request_id': 'req-d41bfb12-74cf-4a03-9125-b888f672deee'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:32 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-b0ff8027-9df3-4fa9-aff6-159d700e2c3c tempest-ExtraSpecsWriteAdminTest-1668668484 tempest-ExtraSpecsWriteAdminTest-1668668484-project-admin] http://10.27.203.238/share/v2/73271c28550c4c2385cd380c1293f3c1/types returned with HTTP 200 May 28 12:56:32 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 73/133] 10.27.203.238 () {66 vars in 1359 bytes} [Tue May 28 12:56:32 2024] POST /share/v2/73271c28550c4c2385cd380c1293f3c1/types => generated 615 bytes in 31 msecs (HTTP/1.1 200) 6 headers in 231 bytes (2 switches on core 0) May 28 12:56:32 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-7cc32104-9e9c-48a4-91a0-9bd56799e7bb tempest-ExtraSpecsWriteAdminTest-1668668484 tempest-ExtraSpecsWriteAdminTest-1668668484-project-admin] POST http://10.27.203.238/share/v1/73271c28550c4c2385cd380c1293f3c1/types/4e7f8947-f44e-47de-9f91-c282f21e158d/extra_specs May 28 12:56:32 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-7cc32104-9e9c-48a4-91a0-9bd56799e7bb tempest-ExtraSpecsWriteAdminTest-1668668484 tempest-ExtraSpecsWriteAdminTest-1668668484-project-admin] Action: 'create', calling method: ShareTypeExtraSpecsController.create, body: {"extra_specs": {"key1": "value1", "key2": "value2"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:56:32 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 726/1468] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 12:56:32 2024] DELETE /identity/v3/users/8688f80695814f34bfb56342c4e54028 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:56:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02996558-333b-4e38-a094-e8cded09a681 service manila] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02996558-333b-4e38-a094-e8cded09a681 service manila] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:32 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-7cc32104-9e9c-48a4-91a0-9bd56799e7bb tempest-ExtraSpecsWriteAdminTest-1668668484 tempest-ExtraSpecsWriteAdminTest-1668668484-project-admin] http://10.27.203.238/share/v1/73271c28550c4c2385cd380c1293f3c1/types/4e7f8947-f44e-47de-9f91-c282f21e158d/extra_specs returned with HTTP 200 May 28 12:56:32 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 61/134] 10.27.203.238 () {64 vars in 1462 bytes} [Tue May 28 12:56:32 2024] POST /share/v1/73271c28550c4c2385cd380c1293f3c1/types/4e7f8947-f44e-47de-9f91-c282f21e158d/extra_specs => generated 53 bytes in 23 msecs (HTTP/1.1 200) 6 headers in 229 bytes (1 switches on core 0) May 28 12:56:32 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-3af4d1dc-601f-4239-a85d-5e6c7b6b4e89 tempest-ExtraSpecsWriteAdminTest-1668668484 tempest-ExtraSpecsWriteAdminTest-1668668484-project-admin] POST http://10.27.203.238/share/v2/73271c28550c4c2385cd380c1293f3c1/types/4e7f8947-f44e-47de-9f91-c282f21e158d/extra_specs May 28 12:56:32 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-3af4d1dc-601f-4239-a85d-5e6c7b6b4e89 tempest-ExtraSpecsWriteAdminTest-1668668484 tempest-ExtraSpecsWriteAdminTest-1668668484-project-admin] Action: 'create', calling method: ShareTypeExtraSpecsController.create, body: {"extra_specs": {"snapshot_support": "True"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:56:32 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-3af4d1dc-601f-4239-a85d-5e6c7b6b4e89 tempest-ExtraSpecsWriteAdminTest-1668668484 tempest-ExtraSpecsWriteAdminTest-1668668484-project-admin] http://10.27.203.238/share/v2/73271c28550c4c2385cd380c1293f3c1/types/4e7f8947-f44e-47de-9f91-c282f21e158d/extra_specs returned with HTTP 200 May 28 12:56:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8f65ce-f21d-42e6-b1d0-4523510ba8a1 service manila] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f110cf6300f049c897d0aab63218d1e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8f65ce-f21d-42e6-b1d0-4523510ba8a1 service manila] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:32 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 62/135] 10.27.203.238 () {66 vars in 1505 bytes} [Tue May 28 12:56:32 2024] POST /share/v2/73271c28550c4c2385cd380c1293f3c1/types/4e7f8947-f44e-47de-9f91-c282f21e158d/extra_specs => generated 45 bytes in 25 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:56:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8f65ce-f21d-42e6-b1d0-4523510ba8a1 service manila] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8f65ce-f21d-42e6-b1d0-4523510ba8a1 service manila] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-7e8f65ce-f21d-42e6-b1d0-4523510ba8a1 service manila] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:32 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-a0b76b0d-1579-4ec0-8459-827b8b453938 tempest-ExtraSpecsWriteAdminTest-1668668484 tempest-ExtraSpecsWriteAdminTest-1668668484-project-admin] GET http://10.27.203.238/share/v1/73271c28550c4c2385cd380c1293f3c1/types/4e7f8947-f44e-47de-9f91-c282f21e158d/extra_specs May 28 12:56:32 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-a0b76b0d-1579-4ec0-8459-827b8b453938 tempest-ExtraSpecsWriteAdminTest-1668668484 tempest-ExtraSpecsWriteAdminTest-1668668484-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:32 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-a0b76b0d-1579-4ec0-8459-827b8b453938 tempest-ExtraSpecsWriteAdminTest-1668668484 tempest-ExtraSpecsWriteAdminTest-1668668484-project-admin] Calling method 'ShareTypeExtraSpecsController.index' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:32 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-a0b76b0d-1579-4ec0-8459-827b8b453938 tempest-ExtraSpecsWriteAdminTest-1668668484 tempest-ExtraSpecsWriteAdminTest-1668668484-project-admin] http://10.27.203.238/share/v1/73271c28550c4c2385cd380c1293f3c1/types/4e7f8947-f44e-47de-9f91-c282f21e158d/extra_specs returned with HTTP 200 May 28 12:56:32 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 63/136] 10.27.203.238 () {62 vars in 1441 bytes} [Tue May 28 12:56:32 2024] GET /share/v1/73271c28550c4c2385cd380c1293f3c1/types/4e7f8947-f44e-47de-9f91-c282f21e158d/extra_specs => generated 122 bytes in 18 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:56:32 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-da5f0187-4c38-4904-8347-05cae1e9dfe4 tempest-ExtraSpecsWriteAdminTest-1668668484 tempest-ExtraSpecsWriteAdminTest-1668668484-project-admin] DELETE http://10.27.203.238/share/v2/73271c28550c4c2385cd380c1293f3c1/types/4e7f8947-f44e-47de-9f91-c282f21e158d/extra_specs/snapshot_support May 28 12:56:32 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-da5f0187-4c38-4904-8347-05cae1e9dfe4 tempest-ExtraSpecsWriteAdminTest-1668668484 tempest-ExtraSpecsWriteAdminTest-1668668484-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:32 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-da5f0187-4c38-4904-8347-05cae1e9dfe4 tempest-ExtraSpecsWriteAdminTest-1668668484 tempest-ExtraSpecsWriteAdminTest-1668668484-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8f65ce-f21d-42e6-b1d0-4523510ba8a1 service manila] RBAC: Authorizing `identity:validate_token()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:32 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-da5f0187-4c38-4904-8347-05cae1e9dfe4 tempest-ExtraSpecsWriteAdminTest-1668668484 tempest-ExtraSpecsWriteAdminTest-1668668484-project-admin] http://10.27.203.238/share/v2/73271c28550c4c2385cd380c1293f3c1/types/4e7f8947-f44e-47de-9f91-c282f21e158d/extra_specs/snapshot_support returned with HTTP 202 May 28 12:56:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8f65ce-f21d-42e6-b1d0-4523510ba8a1 service manila] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:32 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 64/137] 10.27.203.238 () {64 vars in 1538 bytes} [Tue May 28 12:56:32 2024] DELETE /share/v2/73271c28550c4c2385cd380c1293f3c1/types/4e7f8947-f44e-47de-9f91-c282f21e158d/extra_specs/snapshot_support => generated 0 bytes in 25 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:56:32 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 743/1469] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 12:56:32 2024] GET /identity/v3/auth/tokens => generated 3946 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 12:56:32 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-21b354e3-e7aa-46b2-a90b-59b29770d585 tempest-ShareInstancesTest-1546991288 tempest-ShareInstancesTest-1546991288-project-admin] GET http://10.27.203.238/share/v2/fb2c57cefad04e97a990bd936225014d/shares/2dfffda2-1f3a-4d2e-9044-2255a211a9f0 May 28 12:56:32 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-21b354e3-e7aa-46b2-a90b-59b29770d585 tempest-ShareInstancesTest-1546991288 tempest-ShareInstancesTest-1546991288-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:32 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-21b354e3-e7aa-46b2-a90b-59b29770d585 tempest-ShareInstancesTest-1546991288 tempest-ShareInstancesTest-1546991288-project-admin] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:32 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-8cbe61c0-88bf-4a0a-a5d1-72112a483709 tempest-ExportLocationsTest-252994736 tempest-ExportLocationsTest-252994736-project-member] GET http://10.27.203.238/share/v2/8424fd15a45946d88b09f929bb149784/share-replicas/detail?share_id=a96dff4b-6e98-4085-9f3b-45735d209546 May 28 12:56:32 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-8cbe61c0-88bf-4a0a-a5d1-72112a483709 tempest-ExportLocationsTest-252994736 tempest-ExportLocationsTest-252994736-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:32 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-8cbe61c0-88bf-4a0a-a5d1-72112a483709 tempest-ExportLocationsTest-252994736 tempest-ExportLocationsTest-252994736-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:32 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-8cbe61c0-88bf-4a0a-a5d1-72112a483709 tempest-ExportLocationsTest-252994736 tempest-ExportLocationsTest-252994736-project-member] http://10.27.203.238/share/v2/8424fd15a45946d88b09f929bb149784/share-replicas/detail?share_id=a96dff4b-6e98-4085-9f3b-45735d209546 returned with HTTP 200 May 28 12:56:32 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 74/138] 10.27.203.238 () {64 vars in 1476 bytes} [Tue May 28 12:56:32 2024] GET /share/v2/8424fd15a45946d88b09f929bb149784/share-replicas/detail?share_id=a96dff4b-6e98-4085-9f3b-45735d209546 => generated 22 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:56:32 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-bcfcfafc-e23a-4650-a091-368c789ab80a tempest-ExtraSpecsWriteAdminTest-1668668484 tempest-ExtraSpecsWriteAdminTest-1668668484-project-admin] GET http://10.27.203.238/share/v1/73271c28550c4c2385cd380c1293f3c1/types/4e7f8947-f44e-47de-9f91-c282f21e158d/extra_specs May 28 12:56:32 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-bcfcfafc-e23a-4650-a091-368c789ab80a tempest-ExtraSpecsWriteAdminTest-1668668484 tempest-ExtraSpecsWriteAdminTest-1668668484-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:32 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-bcfcfafc-e23a-4650-a091-368c789ab80a tempest-ExtraSpecsWriteAdminTest-1668668484 tempest-ExtraSpecsWriteAdminTest-1668668484-project-admin] Calling method 'ShareTypeExtraSpecsController.index' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:32 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-21b354e3-e7aa-46b2-a90b-59b29770d585 tempest-ShareInstancesTest-1546991288 tempest-ShareInstancesTest-1546991288-project-admin] http://10.27.203.238/share/v2/fb2c57cefad04e97a990bd936225014d/shares/2dfffda2-1f3a-4d2e-9044-2255a211a9f0 returned with HTTP 200 May 28 12:56:32 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 65/139] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:56:32 2024] GET /share/v2/fb2c57cefad04e97a990bd936225014d/shares/2dfffda2-1f3a-4d2e-9044-2255a211a9f0 => generated 1369 bytes in 30 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:56:32 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-72f3d118-a786-4564-9cb7-cb9c1235c2d6 tempest-ExportLocationsTest-1017217578 tempest-ExportLocationsTest-1017217578-project-admin] DELETE http://10.27.203.238/share/v2/87c113478e754c47aea49a8b703cd2f6/shares/a96dff4b-6e98-4085-9f3b-45735d209546 May 28 12:56:32 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-72f3d118-a786-4564-9cb7-cb9c1235c2d6 tempest-ExportLocationsTest-1017217578 tempest-ExportLocationsTest-1017217578-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:32 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-72f3d118-a786-4564-9cb7-cb9c1235c2d6 tempest-ExportLocationsTest-1017217578 tempest-ExportLocationsTest-1017217578-project-admin] Calling method 'ShareMixin.delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:32 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.v1.shares [None req-72f3d118-a786-4564-9cb7-cb9c1235c2d6 tempest-ExportLocationsTest-1017217578 tempest-ExportLocationsTest-1017217578-project-admin] Delete share with id: a96dff4b-6e98-4085-9f3b-45735d209546 May 28 12:56:32 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-bcfcfafc-e23a-4650-a091-368c789ab80a tempest-ExtraSpecsWriteAdminTest-1668668484 tempest-ExtraSpecsWriteAdminTest-1668668484-project-admin] http://10.27.203.238/share/v1/73271c28550c4c2385cd380c1293f3c1/types/4e7f8947-f44e-47de-9f91-c282f21e158d/extra_specs returned with HTTP 200 May 28 12:56:32 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 75/140] 10.27.203.238 () {62 vars in 1441 bytes} [Tue May 28 12:56:32 2024] GET /share/v1/73271c28550c4c2385cd380c1293f3c1/types/4e7f8947-f44e-47de-9f91-c282f21e158d/extra_specs => generated 94 bytes in 16 msecs (HTTP/1.1 200) 6 headers in 229 bytes (1 switches on core 0) May 28 12:56:32 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-32c7259e-df90-4448-ae5d-977cb8647237 tempest-ExtraSpecsWriteAdminTest-1668668484 tempest-ExtraSpecsWriteAdminTest-1668668484-project-admin] POST http://10.27.203.238/share/v2/73271c28550c4c2385cd380c1293f3c1/types May 28 12:56:32 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-32c7259e-df90-4448-ae5d-977cb8647237 tempest-ExtraSpecsWriteAdminTest-1668668484 tempest-ExtraSpecsWriteAdminTest-1668668484-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share_type": {"name": "tempest-share-type-1726401272", "extra_specs": {"driver_handles_share_servers": "False"}, "share_type_access:is_public": true}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:56:32 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-32c7259e-df90-4448-ae5d-977cb8647237 tempest-ExtraSpecsWriteAdminTest-1668668484 tempest-ExtraSpecsWriteAdminTest-1668668484-project-admin] http://10.27.203.238/share/v2/73271c28550c4c2385cd380c1293f3c1/types returned with HTTP 200 May 28 12:56:32 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 76/141] 10.27.203.238 () {66 vars in 1359 bytes} [Tue May 28 12:56:32 2024] POST /share/v2/73271c28550c4c2385cd380c1293f3c1/types => generated 615 bytes in 22 msecs (HTTP/1.1 200) 6 headers in 231 bytes (2 switches on core 0) May 28 12:56:32 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-334413c3-6b52-4e77-8b61-b31cedb49d8d tempest-ExtraSpecsWriteAdminTest-1668668484 tempest-ExtraSpecsWriteAdminTest-1668668484-project-admin] POST http://10.27.203.238/share/v1/73271c28550c4c2385cd380c1293f3c1/types/aa8fa602-1119-4925-89a0-ec003e82aaa8/extra_specs May 28 12:56:32 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-334413c3-6b52-4e77-8b61-b31cedb49d8d tempest-ExtraSpecsWriteAdminTest-1668668484 tempest-ExtraSpecsWriteAdminTest-1668668484-project-admin] Action: 'create', calling method: ShareTypeExtraSpecsController.create, body: {"extra_specs": {"key1": "value1", "key2": "value2"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:56:32 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-334413c3-6b52-4e77-8b61-b31cedb49d8d tempest-ExtraSpecsWriteAdminTest-1668668484 tempest-ExtraSpecsWriteAdminTest-1668668484-project-admin] http://10.27.203.238/share/v1/73271c28550c4c2385cd380c1293f3c1/types/aa8fa602-1119-4925-89a0-ec003e82aaa8/extra_specs returned with HTTP 200 May 28 12:56:32 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 77/142] 10.27.203.238 () {64 vars in 1462 bytes} [Tue May 28 12:56:32 2024] POST /share/v1/73271c28550c4c2385cd380c1293f3c1/types/aa8fa602-1119-4925-89a0-ec003e82aaa8/extra_specs => generated 53 bytes in 23 msecs (HTTP/1.1 200) 6 headers in 229 bytes (1 switches on core 0) May 28 12:56:32 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-fd0e244a-83bf-4863-8409-3ae3ec83f46f tempest-ExtraSpecsWriteAdminTest-1668668484 tempest-ExtraSpecsWriteAdminTest-1668668484-project-admin] POST http://10.27.203.238/share/v1/73271c28550c4c2385cd380c1293f3c1/types/aa8fa602-1119-4925-89a0-ec003e82aaa8/extra_specs May 28 12:56:32 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-fd0e244a-83bf-4863-8409-3ae3ec83f46f tempest-ExtraSpecsWriteAdminTest-1668668484 tempest-ExtraSpecsWriteAdminTest-1668668484-project-admin] Action: 'create', calling method: ShareTypeExtraSpecsController.create, body: {"extra_specs": {"key1": "value1", "key2": "value2_updated"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:56:33 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-fd0e244a-83bf-4863-8409-3ae3ec83f46f tempest-ExtraSpecsWriteAdminTest-1668668484 tempest-ExtraSpecsWriteAdminTest-1668668484-project-admin] http://10.27.203.238/share/v1/73271c28550c4c2385cd380c1293f3c1/types/aa8fa602-1119-4925-89a0-ec003e82aaa8/extra_specs returned with HTTP 200 May 28 12:56:33 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 78/143] 10.27.203.238 () {64 vars in 1462 bytes} [Tue May 28 12:56:32 2024] POST /share/v1/73271c28550c4c2385cd380c1293f3c1/types/aa8fa602-1119-4925-89a0-ec003e82aaa8/extra_specs => generated 61 bytes in 22 msecs (HTTP/1.1 200) 6 headers in 229 bytes (2 switches on core 0) May 28 12:56:33 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-3fc1debf-c5c5-4480-ad34-0326f6951c5d tempest-ExtraSpecsWriteAdminTest-1668668484 tempest-ExtraSpecsWriteAdminTest-1668668484-project-admin] GET http://10.27.203.238/share/v1/73271c28550c4c2385cd380c1293f3c1/types/aa8fa602-1119-4925-89a0-ec003e82aaa8/extra_specs May 28 12:56:33 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-3fc1debf-c5c5-4480-ad34-0326f6951c5d tempest-ExtraSpecsWriteAdminTest-1668668484 tempest-ExtraSpecsWriteAdminTest-1668668484-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:33 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-3fc1debf-c5c5-4480-ad34-0326f6951c5d tempest-ExtraSpecsWriteAdminTest-1668668484 tempest-ExtraSpecsWriteAdminTest-1668668484-project-admin] Calling method 'ShareTypeExtraSpecsController.index' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:33 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-3fc1debf-c5c5-4480-ad34-0326f6951c5d tempest-ExtraSpecsWriteAdminTest-1668668484 tempest-ExtraSpecsWriteAdminTest-1668668484-project-admin] http://10.27.203.238/share/v1/73271c28550c4c2385cd380c1293f3c1/types/aa8fa602-1119-4925-89a0-ec003e82aaa8/extra_specs returned with HTTP 200 May 28 12:56:33 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 79/144] 10.27.203.238 () {62 vars in 1441 bytes} [Tue May 28 12:56:33 2024] GET /share/v1/73271c28550c4c2385cd380c1293f3c1/types/aa8fa602-1119-4925-89a0-ec003e82aaa8/extra_specs => generated 102 bytes in 12 msecs (HTTP/1.1 200) 6 headers in 230 bytes (2 switches on core 0) May 28 12:56:33 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-e2aea304-9b43-4a24-af0b-b16dd722b841 tempest-ExtraSpecsWriteAdminTest-1668668484 tempest-ExtraSpecsWriteAdminTest-1668668484-project-admin] POST http://10.27.203.238/share/v2/73271c28550c4c2385cd380c1293f3c1/types May 28 12:56:33 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-e2aea304-9b43-4a24-af0b-b16dd722b841 tempest-ExtraSpecsWriteAdminTest-1668668484 tempest-ExtraSpecsWriteAdminTest-1668668484-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share_type": {"name": "tempest-share-type-24709967", "extra_specs": {"driver_handles_share_servers": "False"}, "share_type_access:is_public": true}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:56:33 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-e2aea304-9b43-4a24-af0b-b16dd722b841 tempest-ExtraSpecsWriteAdminTest-1668668484 tempest-ExtraSpecsWriteAdminTest-1668668484-project-admin] http://10.27.203.238/share/v2/73271c28550c4c2385cd380c1293f3c1/types returned with HTTP 200 May 28 12:56:33 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 80/145] 10.27.203.238 () {66 vars in 1359 bytes} [Tue May 28 12:56:33 2024] POST /share/v2/73271c28550c4c2385cd380c1293f3c1/types => generated 611 bytes in 22 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:56:33 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-7a7c1f08-845e-4659-95fc-083649b8b26b tempest-ExtraSpecsWriteAdminTest-1668668484 tempest-ExtraSpecsWriteAdminTest-1668668484-project-admin] POST http://10.27.203.238/share/v1/73271c28550c4c2385cd380c1293f3c1/types/49229b13-e3b4-45a3-a2f2-986781a3892b/extra_specs May 28 12:56:33 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-7a7c1f08-845e-4659-95fc-083649b8b26b tempest-ExtraSpecsWriteAdminTest-1668668484 tempest-ExtraSpecsWriteAdminTest-1668668484-project-admin] Action: 'create', calling method: ShareTypeExtraSpecsController.create, body: {"extra_specs": {"key1": "value1", "key2": "value2"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:56:33 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-7a7c1f08-845e-4659-95fc-083649b8b26b tempest-ExtraSpecsWriteAdminTest-1668668484 tempest-ExtraSpecsWriteAdminTest-1668668484-project-admin] http://10.27.203.238/share/v1/73271c28550c4c2385cd380c1293f3c1/types/49229b13-e3b4-45a3-a2f2-986781a3892b/extra_specs returned with HTTP 200 May 28 12:56:33 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 81/146] 10.27.203.238 () {64 vars in 1462 bytes} [Tue May 28 12:56:33 2024] POST /share/v1/73271c28550c4c2385cd380c1293f3c1/types/49229b13-e3b4-45a3-a2f2-986781a3892b/extra_specs => generated 53 bytes in 22 msecs (HTTP/1.1 200) 6 headers in 229 bytes (1 switches on core 0) May 28 12:56:33 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-5a400cc2-9bc3-4c41-9674-47b58b0ea95e tempest-ExtraSpecsWriteAdminTest-1668668484 tempest-ExtraSpecsWriteAdminTest-1668668484-project-admin] PUT http://10.27.203.238/share/v1/73271c28550c4c2385cd380c1293f3c1/types/49229b13-e3b4-45a3-a2f2-986781a3892b/extra_specs/key1 May 28 12:56:33 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-5a400cc2-9bc3-4c41-9674-47b58b0ea95e tempest-ExtraSpecsWriteAdminTest-1668668484 tempest-ExtraSpecsWriteAdminTest-1668668484-project-admin] Action: 'update', calling method: ShareTypeExtraSpecsController.update, body: {"key1": "fake_value1_updated"} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:56:33 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-5a400cc2-9bc3-4c41-9674-47b58b0ea95e tempest-ExtraSpecsWriteAdminTest-1668668484 tempest-ExtraSpecsWriteAdminTest-1668668484-project-admin] http://10.27.203.238/share/v1/73271c28550c4c2385cd380c1293f3c1/types/49229b13-e3b4-45a3-a2f2-986781a3892b/extra_specs/key1 returned with HTTP 200 May 28 12:56:33 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 82/147] 10.27.203.238 () {64 vars in 1476 bytes} [Tue May 28 12:56:33 2024] PUT /share/v1/73271c28550c4c2385cd380c1293f3c1/types/49229b13-e3b4-45a3-a2f2-986781a3892b/extra_specs/key1 => generated 31 bytes in 20 msecs (HTTP/1.1 200) 6 headers in 229 bytes (2 switches on core 0) May 28 12:56:33 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-634d2b16-10eb-4f92-bf70-f3c19e4204c7 tempest-ExtraSpecsWriteAdminTest-1668668484 tempest-ExtraSpecsWriteAdminTest-1668668484-project-admin] GET http://10.27.203.238/share/v1/73271c28550c4c2385cd380c1293f3c1/types/49229b13-e3b4-45a3-a2f2-986781a3892b/extra_specs May 28 12:56:33 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-634d2b16-10eb-4f92-bf70-f3c19e4204c7 tempest-ExtraSpecsWriteAdminTest-1668668484 tempest-ExtraSpecsWriteAdminTest-1668668484-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:33 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-634d2b16-10eb-4f92-bf70-f3c19e4204c7 tempest-ExtraSpecsWriteAdminTest-1668668484 tempest-ExtraSpecsWriteAdminTest-1668668484-project-admin] Calling method 'ShareTypeExtraSpecsController.index' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:33 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-634d2b16-10eb-4f92-bf70-f3c19e4204c7 tempest-ExtraSpecsWriteAdminTest-1668668484 tempest-ExtraSpecsWriteAdminTest-1668668484-project-admin] http://10.27.203.238/share/v1/73271c28550c4c2385cd380c1293f3c1/types/49229b13-e3b4-45a3-a2f2-986781a3892b/extra_specs returned with HTTP 200 May 28 12:56:33 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 83/148] 10.27.203.238 () {62 vars in 1441 bytes} [Tue May 28 12:56:33 2024] GET /share/v1/73271c28550c4c2385cd380c1293f3c1/types/49229b13-e3b4-45a3-a2f2-986781a3892b/extra_specs => generated 107 bytes in 13 msecs (HTTP/1.1 200) 6 headers in 230 bytes (2 switches on core 0) May 28 12:56:33 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-935e9d28-b8bc-4d9a-8a16-20f650b14ef8 tempest-ExtraSpecsWriteAdminTest-1668668484 tempest-ExtraSpecsWriteAdminTest-1668668484-project-admin] DELETE http://10.27.203.238/share/v2/73271c28550c4c2385cd380c1293f3c1/types/49229b13-e3b4-45a3-a2f2-986781a3892b May 28 12:56:33 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-935e9d28-b8bc-4d9a-8a16-20f650b14ef8 tempest-ExtraSpecsWriteAdminTest-1668668484 tempest-ExtraSpecsWriteAdminTest-1668668484-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:33 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-935e9d28-b8bc-4d9a-8a16-20f650b14ef8 tempest-ExtraSpecsWriteAdminTest-1668668484 tempest-ExtraSpecsWriteAdminTest-1668668484-project-admin] Calling method 'ShareTypesController._delete' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:33 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-935e9d28-b8bc-4d9a-8a16-20f650b14ef8 tempest-ExtraSpecsWriteAdminTest-1668668484 tempest-ExtraSpecsWriteAdminTest-1668668484-project-admin] http://10.27.203.238/share/v2/73271c28550c4c2385cd380c1293f3c1/types/49229b13-e3b4-45a3-a2f2-986781a3892b returned with HTTP 202 May 28 12:56:33 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 84/149] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:56:33 2024] DELETE /share/v2/73271c28550c4c2385cd380c1293f3c1/types/49229b13-e3b4-45a3-a2f2-986781a3892b => generated 0 bytes in 57 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:56:33 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-0b1afbeb-4d29-4df6-856b-0c24ae1c4268 tempest-ExtraSpecsWriteAdminTest-1668668484 tempest-ExtraSpecsWriteAdminTest-1668668484-project-admin] GET http://10.27.203.238/share/v2/73271c28550c4c2385cd380c1293f3c1/types/49229b13-e3b4-45a3-a2f2-986781a3892b May 28 12:56:33 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-0b1afbeb-4d29-4df6-856b-0c24ae1c4268 tempest-ExtraSpecsWriteAdminTest-1668668484 tempest-ExtraSpecsWriteAdminTest-1668668484-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:33 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-0b1afbeb-4d29-4df6-856b-0c24ae1c4268 tempest-ExtraSpecsWriteAdminTest-1668668484 tempest-ExtraSpecsWriteAdminTest-1668668484-project-admin] Calling method 'ShareTypesController.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:33 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-0b1afbeb-4d29-4df6-856b-0c24ae1c4268 tempest-ExtraSpecsWriteAdminTest-1668668484 tempest-ExtraSpecsWriteAdminTest-1668668484-project-admin] HTTP exception thrown: Share type not found. May 28 12:56:33 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-0b1afbeb-4d29-4df6-856b-0c24ae1c4268 tempest-ExtraSpecsWriteAdminTest-1668668484 tempest-ExtraSpecsWriteAdminTest-1668668484-project-admin] http://10.27.203.238/share/v2/73271c28550c4c2385cd380c1293f3c1/types/49229b13-e3b4-45a3-a2f2-986781a3892b returned with HTTP 404 May 28 12:56:33 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 85/150] 10.27.203.238 () {64 vars in 1448 bytes} [Tue May 28 12:56:33 2024] GET /share/v2/73271c28550c4c2385cd380c1293f3c1/types/49229b13-e3b4-45a3-a2f2-986781a3892b => generated 67 bytes in 10 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 12:56:33 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-0517d2e2-e3fc-49e5-aff7-a8ce1702604a tempest-ExtraSpecsWriteAdminTest-1668668484 tempest-ExtraSpecsWriteAdminTest-1668668484-project-admin] DELETE http://10.27.203.238/share/v2/73271c28550c4c2385cd380c1293f3c1/types/aa8fa602-1119-4925-89a0-ec003e82aaa8 May 28 12:56:33 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-0517d2e2-e3fc-49e5-aff7-a8ce1702604a tempest-ExtraSpecsWriteAdminTest-1668668484 tempest-ExtraSpecsWriteAdminTest-1668668484-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:33 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-0517d2e2-e3fc-49e5-aff7-a8ce1702604a tempest-ExtraSpecsWriteAdminTest-1668668484 tempest-ExtraSpecsWriteAdminTest-1668668484-project-admin] Calling method 'ShareTypesController._delete' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:33 l75lg1-v1 dstat.sh[49771]: 28-05 12:56:33| 20 3 72 6 0|5642M 1868M 277M 7839M| 20k 18k| 0 9526k| 0 854 |9689 16k|1.78 0.98 0.98| 0 2.0 0| 0 0 | 0 2048M| 29 343 0 44 0 May 28 12:56:33 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-72f3d118-a786-4564-9cb7-cb9c1235c2d6 tempest-ExportLocationsTest-1017217578 tempest-ExportLocationsTest-1017217578-project-admin] http://10.27.203.238/share/v2/87c113478e754c47aea49a8b703cd2f6/shares/a96dff4b-6e98-4085-9f3b-45735d209546 returned with HTTP 202 May 28 12:56:33 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 66/151] 10.27.203.238 () {64 vars in 1454 bytes} [Tue May 28 12:56:32 2024] DELETE /share/v2/87c113478e754c47aea49a8b703cd2f6/shares/a96dff4b-6e98-4085-9f3b-45735d209546 => generated 0 bytes in 319 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:56:33 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-0517d2e2-e3fc-49e5-aff7-a8ce1702604a tempest-ExtraSpecsWriteAdminTest-1668668484 tempest-ExtraSpecsWriteAdminTest-1668668484-project-admin] http://10.27.203.238/share/v2/73271c28550c4c2385cd380c1293f3c1/types/aa8fa602-1119-4925-89a0-ec003e82aaa8 returned with HTTP 202 May 28 12:56:33 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 86/152] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:56:33 2024] DELETE /share/v2/73271c28550c4c2385cd380c1293f3c1/types/aa8fa602-1119-4925-89a0-ec003e82aaa8 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:56:33 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-50590e7f-d81a-4482-9e79-a3e7920b5983 tempest-ExportLocationsTest-1017217578 tempest-ExportLocationsTest-1017217578-project-admin] GET http://10.27.203.238/share/v2/87c113478e754c47aea49a8b703cd2f6/shares/a96dff4b-6e98-4085-9f3b-45735d209546 May 28 12:56:33 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-50590e7f-d81a-4482-9e79-a3e7920b5983 tempest-ExportLocationsTest-1017217578 tempest-ExportLocationsTest-1017217578-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:33 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-50590e7f-d81a-4482-9e79-a3e7920b5983 tempest-ExportLocationsTest-1017217578 tempest-ExportLocationsTest-1017217578-project-admin] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:33 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-3023636b-fe21-4082-98cd-c8ac2920964e tempest-ExtraSpecsWriteAdminTest-1668668484 tempest-ExtraSpecsWriteAdminTest-1668668484-project-admin] GET http://10.27.203.238/share/v2/73271c28550c4c2385cd380c1293f3c1/types/aa8fa602-1119-4925-89a0-ec003e82aaa8 May 28 12:56:33 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-3023636b-fe21-4082-98cd-c8ac2920964e tempest-ExtraSpecsWriteAdminTest-1668668484 tempest-ExtraSpecsWriteAdminTest-1668668484-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:33 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-3023636b-fe21-4082-98cd-c8ac2920964e tempest-ExtraSpecsWriteAdminTest-1668668484 tempest-ExtraSpecsWriteAdminTest-1668668484-project-admin] Calling method 'ShareTypesController.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:33 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-3023636b-fe21-4082-98cd-c8ac2920964e tempest-ExtraSpecsWriteAdminTest-1668668484 tempest-ExtraSpecsWriteAdminTest-1668668484-project-admin] HTTP exception thrown: Share type not found. May 28 12:56:33 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-3023636b-fe21-4082-98cd-c8ac2920964e tempest-ExtraSpecsWriteAdminTest-1668668484 tempest-ExtraSpecsWriteAdminTest-1668668484-project-admin] http://10.27.203.238/share/v2/73271c28550c4c2385cd380c1293f3c1/types/aa8fa602-1119-4925-89a0-ec003e82aaa8 returned with HTTP 404 May 28 12:56:33 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 87/153] 10.27.203.238 () {64 vars in 1448 bytes} [Tue May 28 12:56:33 2024] GET /share/v2/73271c28550c4c2385cd380c1293f3c1/types/aa8fa602-1119-4925-89a0-ec003e82aaa8 => generated 67 bytes in 9 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 12:56:33 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-273749e5-7b1d-4432-bae9-275e0fb5de30 tempest-ExtraSpecsWriteAdminTest-1668668484 tempest-ExtraSpecsWriteAdminTest-1668668484-project-admin] DELETE http://10.27.203.238/share/v2/73271c28550c4c2385cd380c1293f3c1/types/4e7f8947-f44e-47de-9f91-c282f21e158d May 28 12:56:33 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-273749e5-7b1d-4432-bae9-275e0fb5de30 tempest-ExtraSpecsWriteAdminTest-1668668484 tempest-ExtraSpecsWriteAdminTest-1668668484-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:33 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-273749e5-7b1d-4432-bae9-275e0fb5de30 tempest-ExtraSpecsWriteAdminTest-1668668484 tempest-ExtraSpecsWriteAdminTest-1668668484-project-admin] Calling method 'ShareTypesController._delete' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:33 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-50590e7f-d81a-4482-9e79-a3e7920b5983 tempest-ExportLocationsTest-1017217578 tempest-ExportLocationsTest-1017217578-project-admin] http://10.27.203.238/share/v2/87c113478e754c47aea49a8b703cd2f6/shares/a96dff4b-6e98-4085-9f3b-45735d209546 returned with HTTP 200 May 28 12:56:33 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 67/154] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:56:33 2024] GET /share/v2/87c113478e754c47aea49a8b703cd2f6/shares/a96dff4b-6e98-4085-9f3b-45735d209546 => generated 1372 bytes in 28 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:56:33 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-434ed059-1547-4868-b57b-46613126e982 tempest-ShareInstancesTest-1546991288 None] <<< [GET] https://127.0.0.1:40443/api/views/ May 28 12:56:33 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-434ed059-1547-4868-b57b-46613126e982 tempest-ShareInstancesTest-1546991288 None] [] May 28 12:56:33 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-434ed059-1547-4868-b57b-46613126e982 tempest-ShareInstancesTest-1546991288 None] --- [GET] https://127.0.0.1:40443/api/views/: Done May 28 12:56:33 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-434ed059-1547-4868-b57b-46613126e982 tempest-ShareInstancesTest-1546991288 None] >>> [POST] https://127.0.0.1:40443/api/views/ May 28 12:56:33 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-434ed059-1547-4868-b57b-46613126e982 tempest-ShareInstancesTest-1546991288 None] {'data': '{"name": "7f6a42fa-4d45-471e-a438-36876fc6eac8", "path": ' May 28 12:56:33 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-434ed059-1547-4868-b57b-46613126e982 tempest-ShareInstancesTest-1546991288 None] '"/manila/manila-7f6a42fa-4d45-471e-a438-36876fc6eac8", "policy_id": ' May 28 12:56:33 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-434ed059-1547-4868-b57b-46613126e982 tempest-ShareInstancesTest-1546991288 None] '7, "create_dir": true, "protocols": ["NFS"]}', May 28 12:56:33 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-434ed059-1547-4868-b57b-46613126e982 tempest-ShareInstancesTest-1546991288 None] 'json': None, May 28 12:56:33 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-434ed059-1547-4868-b57b-46613126e982 tempest-ShareInstancesTest-1546991288 None] 'params': None} May 28 12:56:33 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-273749e5-7b1d-4432-bae9-275e0fb5de30 tempest-ExtraSpecsWriteAdminTest-1668668484 tempest-ExtraSpecsWriteAdminTest-1668668484-project-admin] http://10.27.203.238/share/v2/73271c28550c4c2385cd380c1293f3c1/types/4e7f8947-f44e-47de-9f91-c282f21e158d returned with HTTP 202 May 28 12:56:33 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 88/155] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:56:33 2024] DELETE /share/v2/73271c28550c4c2385cd380c1293f3c1/types/4e7f8947-f44e-47de-9f91-c282f21e158d => generated 0 bytes in 38 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:56:33 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-f0b5986b-f8d8-46e8-b33e-15638a631628 tempest-ExtraSpecsWriteAdminTest-1668668484 tempest-ExtraSpecsWriteAdminTest-1668668484-project-admin] GET http://10.27.203.238/share/v2/73271c28550c4c2385cd380c1293f3c1/types/4e7f8947-f44e-47de-9f91-c282f21e158d May 28 12:56:33 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-f0b5986b-f8d8-46e8-b33e-15638a631628 tempest-ExtraSpecsWriteAdminTest-1668668484 tempest-ExtraSpecsWriteAdminTest-1668668484-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:33 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-f0b5986b-f8d8-46e8-b33e-15638a631628 tempest-ExtraSpecsWriteAdminTest-1668668484 tempest-ExtraSpecsWriteAdminTest-1668668484-project-admin] Calling method 'ShareTypesController.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:33 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-72f3d118-a786-4564-9cb7-cb9c1235c2d6 tempest-ExportLocationsTest-1017217578 None] Acquiring lock "locked_access_rules_operation_by_share_instance_83d10127-dfed-433a-90d1-4f0a7f981edc" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:56:33 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-f0b5986b-f8d8-46e8-b33e-15638a631628 tempest-ExtraSpecsWriteAdminTest-1668668484 tempest-ExtraSpecsWriteAdminTest-1668668484-project-admin] HTTP exception thrown: Share type not found. May 28 12:56:33 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-f0b5986b-f8d8-46e8-b33e-15638a631628 tempest-ExtraSpecsWriteAdminTest-1668668484 tempest-ExtraSpecsWriteAdminTest-1668668484-project-admin] http://10.27.203.238/share/v2/73271c28550c4c2385cd380c1293f3c1/types/4e7f8947-f44e-47de-9f91-c282f21e158d returned with HTTP 404 May 28 12:56:33 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-72f3d118-a786-4564-9cb7-cb9c1235c2d6 tempest-ExportLocationsTest-1017217578 None] Lock "locked_access_rules_operation_by_share_instance_83d10127-dfed-433a-90d1-4f0a7f981edc" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:56:33 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 68/156] 10.27.203.238 () {64 vars in 1448 bytes} [Tue May 28 12:56:33 2024] GET /share/v2/73271c28550c4c2385cd380c1293f3c1/types/4e7f8947-f44e-47de-9f91-c282f21e158d => generated 67 bytes in 10 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 12:56:33 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-72f3d118-a786-4564-9cb7-cb9c1235c2d6 tempest-ExportLocationsTest-1017217578 None] Lock "locked_access_rules_operation_by_share_instance_83d10127-dfed-433a-90d1-4f0a7f981edc" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.006s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:56:33 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-72f3d118-a786-4564-9cb7-cb9c1235c2d6 tempest-ExportLocationsTest-1017217578 None] Acquiring lock "locked_access_rules_operation_by_share_instance_83d10127-dfed-433a-90d1-4f0a7f981edc" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:56:33 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-2b6981c3-7640-4dd4-afa6-3b38be3c036e tempest-ExtraSpecsWriteAdminTest-1668668484 tempest-ExtraSpecsWriteAdminTest-1668668484-project-admin] DELETE http://10.27.203.238/share/v2/73271c28550c4c2385cd380c1293f3c1/types/1f9564e3-da3e-4b85-9d38-c179d1fbba01 May 28 12:56:33 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-72f3d118-a786-4564-9cb7-cb9c1235c2d6 tempest-ExportLocationsTest-1017217578 None] Lock "locked_access_rules_operation_by_share_instance_83d10127-dfed-433a-90d1-4f0a7f981edc" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:56:33 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-2b6981c3-7640-4dd4-afa6-3b38be3c036e tempest-ExtraSpecsWriteAdminTest-1668668484 tempest-ExtraSpecsWriteAdminTest-1668668484-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:33 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-2b6981c3-7640-4dd4-afa6-3b38be3c036e tempest-ExtraSpecsWriteAdminTest-1668668484 tempest-ExtraSpecsWriteAdminTest-1668668484-project-admin] Calling method 'ShareTypesController._delete' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:33 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-72f3d118-a786-4564-9cb7-cb9c1235c2d6 tempest-ExportLocationsTest-1017217578 None] Lock "locked_access_rules_operation_by_share_instance_83d10127-dfed-433a-90d1-4f0a7f981edc" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.004s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:56:33 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-72f3d118-a786-4564-9cb7-cb9c1235c2d6 tempest-ExportLocationsTest-1017217578 None] Acquiring lock "locked_access_rules_operation_by_share_instance_83d10127-dfed-433a-90d1-4f0a7f981edc" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:56:33 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-72f3d118-a786-4564-9cb7-cb9c1235c2d6 tempest-ExportLocationsTest-1017217578 None] Lock "locked_access_rules_operation_by_share_instance_83d10127-dfed-433a-90d1-4f0a7f981edc" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:56:33 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-72f3d118-a786-4564-9cb7-cb9c1235c2d6 tempest-ExportLocationsTest-1017217578 None] Lock "locked_access_rules_operation_by_share_instance_83d10127-dfed-433a-90d1-4f0a7f981edc" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.006s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:56:33 l75lg1-v1 manila-share[98474]: DEBUG manila.share.access [None req-72f3d118-a786-4564-9cb7-cb9c1235c2d6 tempest-ExportLocationsTest-1017217578 None] All access rules have been synced for share instance 83d10127-dfed-433a-90d1-4f0a7f981edc belonging to share a96dff4b-6e98-4085-9f3b-45735d209546. {{(pid=98474) update_access_rules /opt/stack/manila/manila/share/access.py:304}} May 28 12:56:33 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-72f3d118-a786-4564-9cb7-cb9c1235c2d6 tempest-ExportLocationsTest-1017217578 None] deleting '/manila/manila-83d10127-dfed-433a-90d1-4f0a7f981edc' May 28 12:56:33 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-72f3d118-a786-4564-9cb7-cb9c1235c2d6 tempest-ExportLocationsTest-1017217578 None] >>> [GET] https://127.0.0.1:40443/api/versions/ May 28 12:56:33 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-72f3d118-a786-4564-9cb7-cb9c1235c2d6 tempest-ExportLocationsTest-1017217578 None] {'params': {'status': 'success'}} May 28 12:56:33 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-2b6981c3-7640-4dd4-afa6-3b38be3c036e tempest-ExtraSpecsWriteAdminTest-1668668484 tempest-ExtraSpecsWriteAdminTest-1668668484-project-admin] http://10.27.203.238/share/v2/73271c28550c4c2385cd380c1293f3c1/types/1f9564e3-da3e-4b85-9d38-c179d1fbba01 returned with HTTP 202 May 28 12:56:33 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 89/157] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:56:33 2024] DELETE /share/v2/73271c28550c4c2385cd380c1293f3c1/types/1f9564e3-da3e-4b85-9d38-c179d1fbba01 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:56:33 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-d720050b-0eea-4012-b998-04f5fbb9b7d2 tempest-ExtraSpecsWriteAdminTest-1668668484 tempest-ExtraSpecsWriteAdminTest-1668668484-project-admin] GET http://10.27.203.238/share/v2/73271c28550c4c2385cd380c1293f3c1/types/1f9564e3-da3e-4b85-9d38-c179d1fbba01 May 28 12:56:33 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-d720050b-0eea-4012-b998-04f5fbb9b7d2 tempest-ExtraSpecsWriteAdminTest-1668668484 tempest-ExtraSpecsWriteAdminTest-1668668484-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:33 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-d720050b-0eea-4012-b998-04f5fbb9b7d2 tempest-ExtraSpecsWriteAdminTest-1668668484 tempest-ExtraSpecsWriteAdminTest-1668668484-project-admin] Calling method 'ShareTypesController.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:33 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-d720050b-0eea-4012-b998-04f5fbb9b7d2 tempest-ExtraSpecsWriteAdminTest-1668668484 tempest-ExtraSpecsWriteAdminTest-1668668484-project-admin] HTTP exception thrown: Share type not found. May 28 12:56:33 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-d720050b-0eea-4012-b998-04f5fbb9b7d2 tempest-ExtraSpecsWriteAdminTest-1668668484 tempest-ExtraSpecsWriteAdminTest-1668668484-project-admin] http://10.27.203.238/share/v2/73271c28550c4c2385cd380c1293f3c1/types/1f9564e3-da3e-4b85-9d38-c179d1fbba01 returned with HTTP 404 May 28 12:56:33 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 69/158] 10.27.203.238 () {64 vars in 1448 bytes} [Tue May 28 12:56:33 2024] GET /share/v2/73271c28550c4c2385cd380c1293f3c1/types/1f9564e3-da3e-4b85-9d38-c179d1fbba01 => generated 67 bytes in 10 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 12:56:33 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-05e6285e-45f7-4fa1-b671-dcad5853af27 tempest-ExtraSpecsWriteAdminTest-1668668484 tempest-ExtraSpecsWriteAdminTest-1668668484-project-admin] DELETE http://10.27.203.238/share/v2/73271c28550c4c2385cd380c1293f3c1/types/4aaa6f85-331c-40c5-b20c-3c742bcbe038 May 28 12:56:33 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-05e6285e-45f7-4fa1-b671-dcad5853af27 tempest-ExtraSpecsWriteAdminTest-1668668484 tempest-ExtraSpecsWriteAdminTest-1668668484-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:33 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-05e6285e-45f7-4fa1-b671-dcad5853af27 tempest-ExtraSpecsWriteAdminTest-1668668484 tempest-ExtraSpecsWriteAdminTest-1668668484-project-admin] Calling method 'ShareTypesController._delete' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:33 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-05e6285e-45f7-4fa1-b671-dcad5853af27 tempest-ExtraSpecsWriteAdminTest-1668668484 tempest-ExtraSpecsWriteAdminTest-1668668484-project-admin] http://10.27.203.238/share/v2/73271c28550c4c2385cd380c1293f3c1/types/4aaa6f85-331c-40c5-b20c-3c742bcbe038 returned with HTTP 202 May 28 12:56:33 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 90/159] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:56:33 2024] DELETE /share/v2/73271c28550c4c2385cd380c1293f3c1/types/4aaa6f85-331c-40c5-b20c-3c742bcbe038 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:56:33 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-9c89046c-1424-4021-bd70-959ca1015cc7 tempest-ExtraSpecsWriteAdminTest-1668668484 tempest-ExtraSpecsWriteAdminTest-1668668484-project-admin] GET http://10.27.203.238/share/v2/73271c28550c4c2385cd380c1293f3c1/types/4aaa6f85-331c-40c5-b20c-3c742bcbe038 May 28 12:56:33 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-9c89046c-1424-4021-bd70-959ca1015cc7 tempest-ExtraSpecsWriteAdminTest-1668668484 tempest-ExtraSpecsWriteAdminTest-1668668484-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:33 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-9c89046c-1424-4021-bd70-959ca1015cc7 tempest-ExtraSpecsWriteAdminTest-1668668484 tempest-ExtraSpecsWriteAdminTest-1668668484-project-admin] Calling method 'ShareTypesController.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:33 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-9c89046c-1424-4021-bd70-959ca1015cc7 tempest-ExtraSpecsWriteAdminTest-1668668484 tempest-ExtraSpecsWriteAdminTest-1668668484-project-admin] HTTP exception thrown: Share type not found. May 28 12:56:33 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-9c89046c-1424-4021-bd70-959ca1015cc7 tempest-ExtraSpecsWriteAdminTest-1668668484 tempest-ExtraSpecsWriteAdminTest-1668668484-project-admin] http://10.27.203.238/share/v2/73271c28550c4c2385cd380c1293f3c1/types/4aaa6f85-331c-40c5-b20c-3c742bcbe038 returned with HTTP 404 May 28 12:56:33 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 70/160] 10.27.203.238 () {64 vars in 1448 bytes} [Tue May 28 12:56:33 2024] GET /share/v2/73271c28550c4c2385cd380c1293f3c1/types/4aaa6f85-331c-40c5-b20c-3c742bcbe038 => generated 67 bytes in 10 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 12:56:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41bfb12-74cf-4a03-9125-b888f672deee tempest-ExportLocationsTest-1017217578 tempest-ExportLocationsTest-1017217578-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-d41bfb12-74cf-4a03-9125-b888f672deee tempest-ExportLocationsTest-1017217578 tempest-ExportLocationsTest-1017217578-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41bfb12-74cf-4a03-9125-b888f672deee tempest-ExportLocationsTest-1017217578 tempest-ExportLocationsTest-1017217578-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b9c678-993f-433f-abd2-e38ec4fb5f5f None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b9c678-993f-433f-abd2-e38ec4fb5f5f None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b9c678-993f-433f-abd2-e38ec4fb5f5f None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b9c678-993f-433f-abd2-e38ec4fb5f5f None admin] PATH_INFO: `/v3/users/c28f300e47a9400b97d511422835a798` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b9c678-993f-433f-abd2-e38ec4fb5f5f None admin] RBAC: Authorizing `identity:delete_user(user_id=c28f300e47a9400b97d511422835a798)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b9c678-993f-433f-abd2-e38ec4fb5f5f None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:33 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-eda6b89b-13db-4842-b681-6d99576fdbea tempest-AdminActionsTest-1749172189 None] <<< [POST] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:56:33 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-eda6b89b-13db-4842-b681-6d99576fdbea tempest-AdminActionsTest-1749172189 None] Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=0, created='2024-05-28T12:56:33.089480Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='06991041-961d-463f-93e4-93972c4c58c5', id=8, internal=False, is_s3_default_policy=False, name='766fa507-2a4c-47eb-bfef-fa764b38b24c', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=[], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['*'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['*'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T12:56:33.452941Z', tenant_id=1, tenant_name='default', title='766fa507-2a4c-47eb-bfef-fa764b38b24c', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/8/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[]) May 28 12:56:33 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-eda6b89b-13db-4842-b681-6d99576fdbea tempest-AdminActionsTest-1749172189 None] --- [POST] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 12:56:33 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-eda6b89b-13db-4842-b681-6d99576fdbea tempest-AdminActionsTest-1749172189 None] >>> [GET] https://127.0.0.1:40443/api/quotas/ May 28 12:56:33 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-eda6b89b-13db-4842-b681-6d99576fdbea tempest-AdminActionsTest-1749172189 None] {'allow_redirects': True, May 28 12:56:33 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-eda6b89b-13db-4842-b681-6d99576fdbea tempest-AdminActionsTest-1749172189 None] 'params': {'name': '766fa507-2a4c-47eb-bfef-fa764b38b24c'}} May 28 12:56:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-30b9c678-993f-433f-abd2-e38ec4fb5f5f None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c28f300e47a9400b97d511422835a798', 'request_id': 'req-30b9c678-993f-433f-abd2-e38ec4fb5f5f'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-30b9c678-993f-433f-abd2-e38ec4fb5f5f None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c28f300e47a9400b97d511422835a798', 'request_id': 'req-30b9c678-993f-433f-abd2-e38ec4fb5f5f'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-30b9c678-993f-433f-abd2-e38ec4fb5f5f None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c28f300e47a9400b97d511422835a798', 'request_id': 'req-30b9c678-993f-433f-abd2-e38ec4fb5f5f'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-30b9c678-993f-433f-abd2-e38ec4fb5f5f None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c28f300e47a9400b97d511422835a798', 'request_id': 'req-30b9c678-993f-433f-abd2-e38ec4fb5f5f'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-30b9c678-993f-433f-abd2-e38ec4fb5f5f None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c28f300e47a9400b97d511422835a798', 'request_id': 'req-30b9c678-993f-433f-abd2-e38ec4fb5f5f'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:33 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 727/1470] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 12:56:33 2024] DELETE /identity/v3/users/c28f300e47a9400b97d511422835a798 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:56:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170c9ae1-16d2-4bb8-af83-c226f0bcb387 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170c9ae1-16d2-4bb8-af83-c226f0bcb387 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170c9ae1-16d2-4bb8-af83-c226f0bcb387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:33 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-170c9ae1-16d2-4bb8-af83-c226f0bcb387 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:56:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-170c9ae1-16d2-4bb8-af83-c226f0bcb387 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:56:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-170c9ae1-16d2-4bb8-af83-c226f0bcb387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:33 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 744/1471] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:56:33 2024] POST /identity/v3/auth/tokens => generated 2960 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 28 12:56:33 l75lg1-v1 neutron-server[77619]: DEBUG neutron.wsgi [-] (77619) accepted ('10.27.203.238', 49424) {{(pid=77619) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 12:56:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b9c678-993f-433f-abd2-e38ec4fb5f5f None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-30b9c678-993f-433f-abd2-e38ec4fb5f5f None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b9c678-993f-433f-abd2-e38ec4fb5f5f None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9779287-9db1-405e-a854-9101034355db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef17047035e4b518fd5360a01f2da1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9779287-9db1-405e-a854-9101034355db service neutron] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9779287-9db1-405e-a854-9101034355db service neutron] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9779287-9db1-405e-a854-9101034355db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9779287-9db1-405e-a854-9101034355db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9779287-9db1-405e-a854-9101034355db service neutron] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:33 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 728/1472] 10.27.203.238 () {64 vars in 1432 bytes} [Tue May 28 12:56:33 2024] GET /identity/v3/auth/tokens => generated 2960 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 28 12:56:33 l75lg1-v1 neutron-server[77619]: INFO neutron.wsgi [None req-1b64fb14-73e7-41d7-ad0a-f9438d8ee300 None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=73271c28550c4c2385cd380c1293f3c1&name=default HTTP/1.1" status: 200 len: 216 time: 0.0743384 May 28 12:56:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170c9ae1-16d2-4bb8-af83-c226f0bcb387 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-170c9ae1-16d2-4bb8-af83-c226f0bcb387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:33 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-72f3d118-a786-4564-9cb7-cb9c1235c2d6 tempest-ExportLocationsTest-1017217578 None] <<< [GET] https://127.0.0.1:40443/api/versions/ May 28 12:56:33 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-72f3d118-a786-4564-9cb7-cb9c1235c2d6 tempest-ExportLocationsTest-1017217578 None] [Bunch(build='manila-tempest-vlad-devstack-1343237', carriers_fw_version='', cluster='N/A', created='2024-05-28T11:50:38.299555Z', enable_dr=True, force=False, guid=None, id=1, name=None, os_version='1.1.1', skip_hw_check=False, status='success', sys_version='5.2.0.4', title='sys_version: 5.2.0.4 - build: manila-tempest-vlad-devstack-1343237 - os_version: 1.1.1 - (DB ID: 1) (using: default)', url='https://127.0.0.1:40443/api/versions/1/')] May 28 12:56:33 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-72f3d118-a786-4564-9cb7-cb9c1235c2d6 tempest-ExportLocationsTest-1017217578 None] --- [GET] https://127.0.0.1:40443/api/versions/: Done May 28 12:56:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170c9ae1-16d2-4bb8-af83-c226f0bcb387 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:33 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-72f3d118-a786-4564-9cb7-cb9c1235c2d6 tempest-ExportLocationsTest-1017217578 None] >>> [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/ May 28 12:56:33 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-72f3d118-a786-4564-9cb7-cb9c1235c2d6 tempest-ExportLocationsTest-1017217578 None] {'data': '{"path": "/manila/manila-83d10127-dfed-433a-90d1-4f0a7f981edc"}', May 28 12:56:33 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-72f3d118-a786-4564-9cb7-cb9c1235c2d6 tempest-ExportLocationsTest-1017217578 None] 'params': None} May 28 12:56:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6252a90d-4c3a-44e4-9c20-6ac82e420aa2 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6252a90d-4c3a-44e4-9c20-6ac82e420aa2 None admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6252a90d-4c3a-44e4-9c20-6ac82e420aa2 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6252a90d-4c3a-44e4-9c20-6ac82e420aa2 None admin] PATH_INFO: `/v3/projects/73271c28550c4c2385cd380c1293f3c1` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6252a90d-4c3a-44e4-9c20-6ac82e420aa2 None admin] RBAC: Authorizing `identity:delete_project(project_id=73271c28550c4c2385cd380c1293f3c1)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6252a90d-4c3a-44e4-9c20-6ac82e420aa2 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-6252a90d-4c3a-44e4-9c20-6ac82e420aa2 None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73271c28550c4c2385cd380c1293f3c1', 'request_id': 'req-6252a90d-4c3a-44e4-9c20-6ac82e420aa2'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-6252a90d-4c3a-44e4-9c20-6ac82e420aa2 None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73271c28550c4c2385cd380c1293f3c1', 'request_id': 'req-6252a90d-4c3a-44e4-9c20-6ac82e420aa2'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-6252a90d-4c3a-44e4-9c20-6ac82e420aa2 None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73271c28550c4c2385cd380c1293f3c1', 'request_id': 'req-6252a90d-4c3a-44e4-9c20-6ac82e420aa2'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-6252a90d-4c3a-44e4-9c20-6ac82e420aa2 None admin] The token cache is being invalidate because project 73271c28550c4c2385cd380c1293f3c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 12:56:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-6252a90d-4c3a-44e4-9c20-6ac82e420aa2 None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-6252a90d-4c3a-44e4-9c20-6ac82e420aa2 None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:33 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 745/1473] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 12:56:33 2024] DELETE /identity/v3/projects/73271c28550c4c2385cd380c1293f3c1 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:56:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd4a56f-f694-4058-bfbe-d4aecbc45cca None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd4a56f-f694-4058-bfbe-d4aecbc45cca None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd4a56f-f694-4058-bfbe-d4aecbc45cca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:33 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-7cd4a56f-f694-4058-bfbe-d4aecbc45cca None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:56:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-7cd4a56f-f694-4058-bfbe-d4aecbc45cca None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:56:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-7cd4a56f-f694-4058-bfbe-d4aecbc45cca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:33 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 729/1474] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:56:33 2024] POST /identity/v3/auth/tokens => generated 312 bytes in 20 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 28 12:56:33 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-72f3d118-a786-4564-9cb7-cb9c1235c2d6 tempest-ExportLocationsTest-1017217578 None] <<< [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/ May 28 12:56:33 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-72f3d118-a786-4564-9cb7-cb9c1235c2d6 tempest-ExportLocationsTest-1017217578 None] 'OK' May 28 12:56:33 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-72f3d118-a786-4564-9cb7-cb9c1235c2d6 tempest-ExportLocationsTest-1017217578 None] --- [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/: Done May 28 12:56:33 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-72f3d118-a786-4564-9cb7-cb9c1235c2d6 tempest-ExportLocationsTest-1017217578 None] >>> [GET] https://127.0.0.1:40443/api/views/ May 28 12:56:33 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-72f3d118-a786-4564-9cb7-cb9c1235c2d6 tempest-ExportLocationsTest-1017217578 None] {'allow_redirects': True, May 28 12:56:33 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-72f3d118-a786-4564-9cb7-cb9c1235c2d6 tempest-ExportLocationsTest-1017217578 None] 'params': {'name': '83d10127-dfed-433a-90d1-4f0a7f981edc'}} May 28 12:56:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399b4973-d29a-4973-9cbe-c2a547d6c425 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399b4973-d29a-4973-9cbe-c2a547d6c425 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399b4973-d29a-4973-9cbe-c2a547d6c425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:33 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-399b4973-d29a-4973-9cbe-c2a547d6c425 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:56:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-399b4973-d29a-4973-9cbe-c2a547d6c425 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:56:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-399b4973-d29a-4973-9cbe-c2a547d6c425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:33 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-eda6b89b-13db-4842-b681-6d99576fdbea tempest-AdminActionsTest-1749172189 None] <<< [GET] https://127.0.0.1:40443/api/quotas/ May 28 12:56:33 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-eda6b89b-13db-4842-b681-6d99576fdbea tempest-AdminActionsTest-1749172189 None] [] May 28 12:56:33 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-eda6b89b-13db-4842-b681-6d99576fdbea tempest-AdminActionsTest-1749172189 None] --- [GET] https://127.0.0.1:40443/api/quotas/: Done May 28 12:56:33 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-eda6b89b-13db-4842-b681-6d99576fdbea tempest-AdminActionsTest-1749172189 None] >>> [POST] https://127.0.0.1:40443/api/quotas/ May 28 12:56:33 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-eda6b89b-13db-4842-b681-6d99576fdbea tempest-AdminActionsTest-1749172189 None] {'data': '{"name": "766fa507-2a4c-47eb-bfef-fa764b38b24c", "path": ' May 28 12:56:33 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-eda6b89b-13db-4842-b681-6d99576fdbea tempest-AdminActionsTest-1749172189 None] '"/manila/manila-766fa507-2a4c-47eb-bfef-fa764b38b24c", "create_dir": ' May 28 12:56:33 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-eda6b89b-13db-4842-b681-6d99576fdbea tempest-AdminActionsTest-1749172189 None] 'true, "hard_limit": 1073741824}', May 28 12:56:33 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-eda6b89b-13db-4842-b681-6d99576fdbea tempest-AdminActionsTest-1749172189 None] 'json': None, May 28 12:56:33 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-eda6b89b-13db-4842-b681-6d99576fdbea tempest-AdminActionsTest-1749172189 None] 'params': None} May 28 12:56:33 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 746/1475] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:56:33 2024] POST /identity/v3/auth/tokens => generated 2960 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 12:56:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd4a56f-f694-4058-bfbe-d4aecbc45cca None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd4a56f-f694-4058-bfbe-d4aecbc45cca None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92143c8a-0207-4b32-b961-bde42cbf8360 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92143c8a-0207-4b32-b961-bde42cbf8360 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92143c8a-0207-4b32-b961-bde42cbf8360 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92143c8a-0207-4b32-b961-bde42cbf8360 None admin] PATH_INFO: `/v3/domains` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92143c8a-0207-4b32-b961-bde42cbf8360 None admin] RBAC: Adding query filter params (name=Default) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:56:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92143c8a-0207-4b32-b961-bde42cbf8360 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92143c8a-0207-4b32-b961-bde42cbf8360 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:33 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 730/1476] 10.27.203.238 () {62 vars in 1220 bytes} [Tue May 28 12:56:33 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:56:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399b4973-d29a-4973-9cbe-c2a547d6c425 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399b4973-d29a-4973-9cbe-c2a547d6c425 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bef3fc2-1085-43f0-b8b5-d1c6e70dac97 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bef3fc2-1085-43f0-b8b5-d1c6e70dac97 None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bef3fc2-1085-43f0-b8b5-d1c6e70dac97 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bef3fc2-1085-43f0-b8b5-d1c6e70dac97 None admin] PATH_INFO: `/v3/projects` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bef3fc2-1085-43f0-b8b5-d1c6e70dac97 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bef3fc2-1085-43f0-b8b5-d1c6e70dac97 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:33 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 747/1477] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 12:56:33 2024] POST /identity/v3/projects => generated 391 bytes in 35 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:56:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92143c8a-0207-4b32-b961-bde42cbf8360 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92143c8a-0207-4b32-b961-bde42cbf8360 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14fbf62-f9c5-4f00-abfc-8da925f5b770 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14fbf62-f9c5-4f00-abfc-8da925f5b770 None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14fbf62-f9c5-4f00-abfc-8da925f5b770 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14fbf62-f9c5-4f00-abfc-8da925f5b770 None admin] PATH_INFO: `/v3/users` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14fbf62-f9c5-4f00-abfc-8da925f5b770 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14fbf62-f9c5-4f00-abfc-8da925f5b770 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:33 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-e14fbf62-f9c5-4f00-abfc-8da925f5b770 None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 12:56:33 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 731/1478] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 12:56:33 2024] POST /identity/v3/users => generated 304 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:56:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bef3fc2-1085-43f0-b8b5-d1c6e70dac97 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bef3fc2-1085-43f0-b8b5-d1c6e70dac97 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63824d2-6c64-4eb0-afcc-3e9112ee5f27 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63824d2-6c64-4eb0-afcc-3e9112ee5f27 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63824d2-6c64-4eb0-afcc-3e9112ee5f27 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63824d2-6c64-4eb0-afcc-3e9112ee5f27 None admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63824d2-6c64-4eb0-afcc-3e9112ee5f27 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63824d2-6c64-4eb0-afcc-3e9112ee5f27 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:34 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 748/1479] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 12:56:33 2024] GET /identity/v3/roles => generated 1680 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:56:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14fbf62-f9c5-4f00-abfc-8da925f5b770 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14fbf62-f9c5-4f00-abfc-8da925f5b770 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d8eeed-2229-42a8-b835-6eb600d1355c None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d8eeed-2229-42a8-b835-6eb600d1355c None admin] REQUEST_METHOD: `PUT` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d8eeed-2229-42a8-b835-6eb600d1355c None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d8eeed-2229-42a8-b835-6eb600d1355c None admin] PATH_INFO: `/v3/projects/31fdadaf536c476bbd07252e22564086/users/c1f3057b628142deb7b3386d2703a5de/roles/44620cad10ae407c90c91e2c296adb04` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d8eeed-2229-42a8-b835-6eb600d1355c None admin] RBAC: Authorizing `identity:create_grant(project_id=31fdadaf536c476bbd07252e22564086, user_id=c1f3057b628142deb7b3386d2703a5de, role_id=44620cad10ae407c90c91e2c296adb04)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d8eeed-2229-42a8-b835-6eb600d1355c None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:34 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 732/1480] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 12:56:34 2024] PUT /identity/v3/projects/31fdadaf536c476bbd07252e22564086/users/c1f3057b628142deb7b3386d2703a5de/roles/44620cad10ae407c90c91e2c296adb04 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:56:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edc7529-e4ee-41bf-adfe-ac79aaf59b43 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edc7529-e4ee-41bf-adfe-ac79aaf59b43 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edc7529-e4ee-41bf-adfe-ac79aaf59b43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:34 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-0edc7529-e4ee-41bf-adfe-ac79aaf59b43 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:56:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-0edc7529-e4ee-41bf-adfe-ac79aaf59b43 None None] MFA Rules not processed for user `c1f3057b628142deb7b3386d2703a5de`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:56:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-0edc7529-e4ee-41bf-adfe-ac79aaf59b43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:34 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 749/1481] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:56:34 2024] POST /identity/v3/auth/tokens => generated 3962 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:56:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d8eeed-2229-42a8-b835-6eb600d1355c None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d8eeed-2229-42a8-b835-6eb600d1355c None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019d3b53-76c2-4711-98b4-30ad0b655663 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019d3b53-76c2-4711-98b4-30ad0b655663 None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019d3b53-76c2-4711-98b4-30ad0b655663 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019d3b53-76c2-4711-98b4-30ad0b655663 None admin] PATH_INFO: `/v3/projects` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019d3b53-76c2-4711-98b4-30ad0b655663 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019d3b53-76c2-4711-98b4-30ad0b655663 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:34 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-72f3d118-a786-4564-9cb7-cb9c1235c2d6 tempest-ExportLocationsTest-1017217578 None] <<< [GET] https://127.0.0.1:40443/api/views/ May 28 12:56:34 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-72f3d118-a786-4564-9cb7-cb9c1235c2d6 tempest-ExportLocationsTest-1017217578 None] [Bunch(abac_tags=[], abe_max_depth=None, abe_protocols=[], alias='', allow_anonymous_access=False, allow_s3_anonymous_access=False, auto_commit='0d', bucket='', bucket_creators=[], bucket_creators_groups=[], bucket_owner=None, bulk_permission_update_progress=None, bulk_permission_update_state=None, cluster='loop75-kfs', cluster_id=1, created='2024-05-28T12:56:29.152322Z', enabled=True, files_retention_mode='NONE', guid='ab5b9fdb-7f1c-4d56-8c1d-0f4b364a9d90', id=4, ignore_oos=False, internal=False, is_remote=False, is_seamless=False, logical_capacity=0, max_retention_period=None, min_retention_period=None, name='83d10127-dfed-433a-90d1-4f0a7f981edc', nfs_interop_flags='BOTH_NFS3_AND_NFS4_INTEROP_DISABLED', path='/manila/manila-83d10127-dfed-433a-90d1-4f0a7f981edc', physical_capacity=0, policy='83d10127-dfed-433a-90d1-4f0a7f981edc', policy_id=5, protocols=['NFS'], qos_policy=None, qos_policy_id=None, s3_locks=False, s3_locks_retention_mode='NONE', s3_locks_retention_period='', s3_unverified_lookup=False, s3_versioning=False, select_for_live_monitoring=False, share='', share_acl=Bunch(acl=[], enabled=False), sync='SYNCED', sync_time='2024-05-28T12:56:29.438641Z', tenant_id=1, tenant_name='default', title='/manila/manila-83d10127-dfed-433a-90d1-4f0a7f981edc', url='https://127.0.0.1:40443/api/views/4/')] May 28 12:56:34 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-72f3d118-a786-4564-9cb7-cb9c1235c2d6 tempest-ExportLocationsTest-1017217578 None] --- [GET] https://127.0.0.1:40443/api/views/: Done May 28 12:56:34 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-72f3d118-a786-4564-9cb7-cb9c1235c2d6 tempest-ExportLocationsTest-1017217578 None] >>> [DELETE] https://127.0.0.1:40443/api/views/4/ May 28 12:56:34 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 733/1482] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 12:56:34 2024] POST /identity/v3/projects => generated 393 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:56:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edc7529-e4ee-41bf-adfe-ac79aaf59b43 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edc7529-e4ee-41bf-adfe-ac79aaf59b43 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef791ec-4b4b-495b-a98a-b8a819360f45 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef791ec-4b4b-495b-a98a-b8a819360f45 None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef791ec-4b4b-495b-a98a-b8a819360f45 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef791ec-4b4b-495b-a98a-b8a819360f45 None admin] PATH_INFO: `/v3/users` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef791ec-4b4b-495b-a98a-b8a819360f45 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef791ec-4b4b-495b-a98a-b8a819360f45 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:34 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-aef791ec-4b4b-495b-a98a-b8a819360f45 None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 12:56:34 l75lg1-v1 dstat.sh[49771]: 28-05 12:56:34| 11 1 85 2 0|5645M 1866M 277M 7839M| 25k 6831B| 0 2104k| 0 260 |7745 13k|1.78 0.98 0.98|4.0 0 0| 0 0 | 0 2048M| 29 344 0 45 0 May 28 12:56:34 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 750/1483] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 12:56:34 2024] POST /identity/v3/users => generated 305 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:56:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019d3b53-76c2-4711-98b4-30ad0b655663 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019d3b53-76c2-4711-98b4-30ad0b655663 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ab9864-7f42-4e89-b964-3a353808f6d8 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ab9864-7f42-4e89-b964-3a353808f6d8 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ab9864-7f42-4e89-b964-3a353808f6d8 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ab9864-7f42-4e89-b964-3a353808f6d8 None admin] PATH_INFO: `/v3/roles` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ab9864-7f42-4e89-b964-3a353808f6d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ab9864-7f42-4e89-b964-3a353808f6d8 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:34 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 734/1484] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 12:56:34 2024] GET /identity/v3/roles => generated 1680 bytes in 18 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:56:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef791ec-4b4b-495b-a98a-b8a819360f45 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef791ec-4b4b-495b-a98a-b8a819360f45 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423cd0ad-d75a-4651-9b91-ec46fdc281bb None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423cd0ad-d75a-4651-9b91-ec46fdc281bb None admin] REQUEST_METHOD: `PUT` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423cd0ad-d75a-4651-9b91-ec46fdc281bb None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423cd0ad-d75a-4651-9b91-ec46fdc281bb None admin] PATH_INFO: `/v3/projects/ac20784a3f664ed6873784a747ff7b1f/users/3ac8b349ef07449984ca9e0c30f45410/roles/44620cad10ae407c90c91e2c296adb04` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423cd0ad-d75a-4651-9b91-ec46fdc281bb None admin] RBAC: Authorizing `identity:create_grant(project_id=ac20784a3f664ed6873784a747ff7b1f, user_id=3ac8b349ef07449984ca9e0c30f45410, role_id=44620cad10ae407c90c91e2c296adb04)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423cd0ad-d75a-4651-9b91-ec46fdc281bb None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:34 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 751/1485] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 12:56:34 2024] PUT /identity/v3/projects/ac20784a3f664ed6873784a747ff7b1f/users/3ac8b349ef07449984ca9e0c30f45410/roles/44620cad10ae407c90c91e2c296adb04 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:56:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e16ce0-f792-4800-b08b-030c0711cc40 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e16ce0-f792-4800-b08b-030c0711cc40 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e16ce0-f792-4800-b08b-030c0711cc40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:34 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-434ed059-1547-4868-b57b-46613126e982 tempest-ShareInstancesTest-1546991288 None] <<< [POST] https://127.0.0.1:40443/api/views/ May 28 12:56:34 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-434ed059-1547-4868-b57b-46613126e982 tempest-ShareInstancesTest-1546991288 None] Bunch(abac_tags=[], abe_max_depth=None, abe_protocols=[], alias='', allow_anonymous_access=False, allow_s3_anonymous_access=False, auto_commit='0d', bucket='', bucket_creators=[], bucket_creators_groups=[], bucket_owner=None, bulk_permission_update_progress=None, bulk_permission_update_state=None, cluster='loop75-kfs', cluster_id=1, created='2024-05-28T12:56:33.976793Z', enabled=True, files_retention_mode='NONE', guid='68da276e-4e24-4262-b2a6-11db5e88b70b', id=6, ignore_oos=False, internal=False, is_remote=False, is_seamless=False, logical_capacity=0, max_retention_period=None, min_retention_period=None, name='7f6a42fa-4d45-471e-a438-36876fc6eac8', nfs_interop_flags='BOTH_NFS3_AND_NFS4_INTEROP_DISABLED', path='/manila/manila-7f6a42fa-4d45-471e-a438-36876fc6eac8', physical_capacity=0, policy='7f6a42fa-4d45-471e-a438-36876fc6eac8', policy_id=7, protocols=['NFS'], qos_policy=None, qos_policy_id=None, s3_locks=False, s3_locks_retention_mode='NONE', s3_locks_retention_period='', s3_object_ownership_rule='ObjectWriter', s3_unverified_lookup=False, s3_versioning=False, select_for_live_monitoring=False, share='', share_acl=Bunch(acl=[], enabled=False), sync='SYNCED', sync_time='2024-05-28T12:56:34.260977Z', tenant_id=1, tenant_name='default', title='/manila/manila-7f6a42fa-4d45-471e-a438-36876fc6eac8', url='https://127.0.0.1:40443/api/views/6/') May 28 12:56:34 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-434ed059-1547-4868-b57b-46613126e982 tempest-ShareInstancesTest-1546991288 None] --- [POST] https://127.0.0.1:40443/api/views/: Done May 28 12:56:34 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-a4e16ce0-f792-4800-b08b-030c0711cc40 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:56:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-a4e16ce0-f792-4800-b08b-030c0711cc40 None None] MFA Rules not processed for user `3ac8b349ef07449984ca9e0c30f45410`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:56:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-a4e16ce0-f792-4800-b08b-030c0711cc40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:34 l75lg1-v1 manila-share[98474]: INFO manila.share.manager [None req-434ed059-1547-4868-b57b-46613126e982 tempest-ShareInstancesTest-1546991288 None] Share instance 7f6a42fa-4d45-471e-a438-36876fc6eac8 created successfully. May 28 12:56:34 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 735/1486] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:56:34 2024] POST /identity/v3/auth/tokens => generated 3964 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:56:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423cd0ad-d75a-4651-9b91-ec46fdc281bb None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423cd0ad-d75a-4651-9b91-ec46fdc281bb None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4807b017-0fdd-4bdc-98ee-1d683085de90 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4807b017-0fdd-4bdc-98ee-1d683085de90 None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4807b017-0fdd-4bdc-98ee-1d683085de90 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4807b017-0fdd-4bdc-98ee-1d683085de90 None admin] PATH_INFO: `/v3/projects` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4807b017-0fdd-4bdc-98ee-1d683085de90 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4807b017-0fdd-4bdc-98ee-1d683085de90 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:34 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 752/1487] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 12:56:34 2024] POST /identity/v3/projects => generated 393 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:56:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e16ce0-f792-4800-b08b-030c0711cc40 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e16ce0-f792-4800-b08b-030c0711cc40 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f72ca1-44c8-4e43-893e-ab69632e54b1 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f72ca1-44c8-4e43-893e-ab69632e54b1 None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f72ca1-44c8-4e43-893e-ab69632e54b1 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f72ca1-44c8-4e43-893e-ab69632e54b1 None admin] PATH_INFO: `/v3/users` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f72ca1-44c8-4e43-893e-ab69632e54b1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f72ca1-44c8-4e43-893e-ab69632e54b1 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:34 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-a8f72ca1-44c8-4e43-893e-ab69632e54b1 None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 12:56:34 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 736/1488] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 12:56:34 2024] POST /identity/v3/users => generated 304 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:56:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4807b017-0fdd-4bdc-98ee-1d683085de90 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4807b017-0fdd-4bdc-98ee-1d683085de90 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebd7e93-41ac-479a-9017-b042be3a6ea6 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebd7e93-41ac-479a-9017-b042be3a6ea6 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebd7e93-41ac-479a-9017-b042be3a6ea6 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebd7e93-41ac-479a-9017-b042be3a6ea6 None admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebd7e93-41ac-479a-9017-b042be3a6ea6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebd7e93-41ac-479a-9017-b042be3a6ea6 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:34 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 753/1489] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 12:56:34 2024] GET /identity/v3/roles => generated 1680 bytes in 17 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:56:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f72ca1-44c8-4e43-893e-ab69632e54b1 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f72ca1-44c8-4e43-893e-ab69632e54b1 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e8ad7c-ba42-4c88-8660-0df7d90eb560 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e8ad7c-ba42-4c88-8660-0df7d90eb560 None admin] REQUEST_METHOD: `PUT` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e8ad7c-ba42-4c88-8660-0df7d90eb560 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e8ad7c-ba42-4c88-8660-0df7d90eb560 None admin] PATH_INFO: `/v3/projects/d0b0ae94b0c5486f9028712057ebacb5/users/9cd0d153d5584483989830faec045a2d/roles/e7989893488f483baa107be56668c4f8` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e8ad7c-ba42-4c88-8660-0df7d90eb560 None admin] RBAC: Authorizing `identity:create_grant(project_id=d0b0ae94b0c5486f9028712057ebacb5, user_id=9cd0d153d5584483989830faec045a2d, role_id=e7989893488f483baa107be56668c4f8)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e8ad7c-ba42-4c88-8660-0df7d90eb560 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:34 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 737/1490] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 12:56:34 2024] PUT /identity/v3/projects/d0b0ae94b0c5486f9028712057ebacb5/users/9cd0d153d5584483989830faec045a2d/roles/e7989893488f483baa107be56668c4f8 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:56:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebd7e93-41ac-479a-9017-b042be3a6ea6 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebd7e93-41ac-479a-9017-b042be3a6ea6 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:34 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-18880b75-6e5d-4c3d-95f9-0a8437fab297 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] GET http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/shares/a6fffe7e-d89b-4b6c-ada2-53d5855ef606 May 28 12:56:34 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-18880b75-6e5d-4c3d-95f9-0a8437fab297 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:34 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-18880b75-6e5d-4c3d-95f9-0a8437fab297 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcae771-6acf-4d57-b990-ead4323de61c None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcae771-6acf-4d57-b990-ead4323de61c None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcae771-6acf-4d57-b990-ead4323de61c None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcae771-6acf-4d57-b990-ead4323de61c None admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcae771-6acf-4d57-b990-ead4323de61c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcae771-6acf-4d57-b990-ead4323de61c None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:34 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-18880b75-6e5d-4c3d-95f9-0a8437fab297 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/shares/a6fffe7e-d89b-4b6c-ada2-53d5855ef606 returned with HTTP 200 May 28 12:56:34 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 91/161] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:56:34 2024] GET /share/v2/a3499cb78849424db45e54caac01de92/shares/a6fffe7e-d89b-4b6c-ada2-53d5855ef606 => generated 1368 bytes in 25 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:56:34 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 754/1491] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 12:56:34 2024] GET /identity/v3/roles => generated 1680 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:56:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e8ad7c-ba42-4c88-8660-0df7d90eb560 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e8ad7c-ba42-4c88-8660-0df7d90eb560 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f8e702-0642-42cb-a7b7-664e9d7a9563 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f8e702-0642-42cb-a7b7-664e9d7a9563 None admin] REQUEST_METHOD: `PUT` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f8e702-0642-42cb-a7b7-664e9d7a9563 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f8e702-0642-42cb-a7b7-664e9d7a9563 None admin] PATH_INFO: `/v3/projects/d0b0ae94b0c5486f9028712057ebacb5/users/9cd0d153d5584483989830faec045a2d/roles/e7989893488f483baa107be56668c4f8` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f8e702-0642-42cb-a7b7-664e9d7a9563 None admin] RBAC: Authorizing `identity:create_grant(project_id=d0b0ae94b0c5486f9028712057ebacb5, user_id=9cd0d153d5584483989830faec045a2d, role_id=e7989893488f483baa107be56668c4f8)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f8e702-0642-42cb-a7b7-664e9d7a9563 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:34 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 738/1492] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 12:56:34 2024] PUT /identity/v3/projects/d0b0ae94b0c5486f9028712057ebacb5/users/9cd0d153d5584483989830faec045a2d/roles/e7989893488f483baa107be56668c4f8 => generated 0 bytes in 19 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:56:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d8ad42-c1fe-4460-bcdd-4858280e676e None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d8ad42-c1fe-4460-bcdd-4858280e676e None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d8ad42-c1fe-4460-bcdd-4858280e676e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:34 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-d0d8ad42-c1fe-4460-bcdd-4858280e676e None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:56:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-d0d8ad42-c1fe-4460-bcdd-4858280e676e None None] MFA Rules not processed for user `9cd0d153d5584483989830faec045a2d`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:56:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-d0d8ad42-c1fe-4460-bcdd-4858280e676e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:34 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 755/1493] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:56:34 2024] POST /identity/v3/auth/tokens => generated 4087 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:56:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f8e702-0642-42cb-a7b7-664e9d7a9563 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f8e702-0642-42cb-a7b7-664e9d7a9563 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f42694-d411-4d52-a9de-4bc85775cb1b tempest-ShareTypesAdminNegativeTest-1627064547 tempest-ShareTypesAdminNegativeTest-1627064547-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cd0d153d5584483989830faec045a2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0b0ae94b0c5486f9028712057ebacb5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f42694-d411-4d52-a9de-4bc85775cb1b tempest-ShareTypesAdminNegativeTest-1627064547 tempest-ShareTypesAdminNegativeTest-1627064547-project-admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f42694-d411-4d52-a9de-4bc85775cb1b tempest-ShareTypesAdminNegativeTest-1627064547 tempest-ShareTypesAdminNegativeTest-1627064547-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f42694-d411-4d52-a9de-4bc85775cb1b tempest-ShareTypesAdminNegativeTest-1627064547 tempest-ShareTypesAdminNegativeTest-1627064547-project-admin] PATH_INFO: `/v3/domains` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f42694-d411-4d52-a9de-4bc85775cb1b tempest-ShareTypesAdminNegativeTest-1627064547 tempest-ShareTypesAdminNegativeTest-1627064547-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:56:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f42694-d411-4d52-a9de-4bc85775cb1b tempest-ShareTypesAdminNegativeTest-1627064547 tempest-ShareTypesAdminNegativeTest-1627064547-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f42694-d411-4d52-a9de-4bc85775cb1b tempest-ShareTypesAdminNegativeTest-1627064547 tempest-ShareTypesAdminNegativeTest-1627064547-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:34 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 739/1494] 10.27.203.238 () {62 vars in 1241 bytes} [Tue May 28 12:56:34 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:56:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d8ad42-c1fe-4460-bcdd-4858280e676e None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d8ad42-c1fe-4460-bcdd-4858280e676e None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341b8a21-6d1c-4ce9-b46f-80c5d7396753 tempest-ShareTypesAdminNegativeTest-1627064547 tempest-ShareTypesAdminNegativeTest-1627064547-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cd0d153d5584483989830faec045a2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0b0ae94b0c5486f9028712057ebacb5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341b8a21-6d1c-4ce9-b46f-80c5d7396753 tempest-ShareTypesAdminNegativeTest-1627064547 tempest-ShareTypesAdminNegativeTest-1627064547-project-admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341b8a21-6d1c-4ce9-b46f-80c5d7396753 tempest-ShareTypesAdminNegativeTest-1627064547 tempest-ShareTypesAdminNegativeTest-1627064547-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341b8a21-6d1c-4ce9-b46f-80c5d7396753 tempest-ShareTypesAdminNegativeTest-1627064547 tempest-ShareTypesAdminNegativeTest-1627064547-project-admin] PATH_INFO: `/v3/users` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341b8a21-6d1c-4ce9-b46f-80c5d7396753 tempest-ShareTypesAdminNegativeTest-1627064547 tempest-ShareTypesAdminNegativeTest-1627064547-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341b8a21-6d1c-4ce9-b46f-80c5d7396753 tempest-ShareTypesAdminNegativeTest-1627064547 tempest-ShareTypesAdminNegativeTest-1627064547-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:34 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-341b8a21-6d1c-4ce9-b46f-80c5d7396753 tempest-ShareTypesAdminNegativeTest-1627064547 tempest-ShareTypesAdminNegativeTest-1627064547-project-admin] Truncating password to algorithm specific maximum length 72 characters. May 28 12:56:34 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 756/1495] 10.27.203.238 () {64 vars in 1232 bytes} [Tue May 28 12:56:34 2024] POST /identity/v3/users => generated 435 bytes in 35 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:56:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f42694-d411-4d52-a9de-4bc85775cb1b tempest-ShareTypesAdminNegativeTest-1627064547 tempest-ShareTypesAdminNegativeTest-1627064547-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f42694-d411-4d52-a9de-4bc85775cb1b tempest-ShareTypesAdminNegativeTest-1627064547 tempest-ShareTypesAdminNegativeTest-1627064547-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4b4e4a-3b01-472b-bca7-d157b70fbbb6 tempest-ShareTypesAdminNegativeTest-1627064547 tempest-ShareTypesAdminNegativeTest-1627064547-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cd0d153d5584483989830faec045a2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0b0ae94b0c5486f9028712057ebacb5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4b4e4a-3b01-472b-bca7-d157b70fbbb6 tempest-ShareTypesAdminNegativeTest-1627064547 tempest-ShareTypesAdminNegativeTest-1627064547-project-admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4b4e4a-3b01-472b-bca7-d157b70fbbb6 tempest-ShareTypesAdminNegativeTest-1627064547 tempest-ShareTypesAdminNegativeTest-1627064547-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4b4e4a-3b01-472b-bca7-d157b70fbbb6 tempest-ShareTypesAdminNegativeTest-1627064547 tempest-ShareTypesAdminNegativeTest-1627064547-project-admin] PATH_INFO: `/v3/roles` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4b4e4a-3b01-472b-bca7-d157b70fbbb6 tempest-ShareTypesAdminNegativeTest-1627064547 tempest-ShareTypesAdminNegativeTest-1627064547-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4b4e4a-3b01-472b-bca7-d157b70fbbb6 tempest-ShareTypesAdminNegativeTest-1627064547 tempest-ShareTypesAdminNegativeTest-1627064547-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:34 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 740/1496] 10.27.203.238 () {62 vars in 1210 bytes} [Tue May 28 12:56:34 2024] GET /identity/v3/roles => generated 1680 bytes in 17 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:56:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341b8a21-6d1c-4ce9-b46f-80c5d7396753 tempest-ShareTypesAdminNegativeTest-1627064547 tempest-ShareTypesAdminNegativeTest-1627064547-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341b8a21-6d1c-4ce9-b46f-80c5d7396753 tempest-ShareTypesAdminNegativeTest-1627064547 tempest-ShareTypesAdminNegativeTest-1627064547-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a996872-4ed1-4cc4-8bbf-c9a58d498271 tempest-ShareTypesAdminNegativeTest-1627064547 tempest-ShareTypesAdminNegativeTest-1627064547-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cd0d153d5584483989830faec045a2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0b0ae94b0c5486f9028712057ebacb5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a996872-4ed1-4cc4-8bbf-c9a58d498271 tempest-ShareTypesAdminNegativeTest-1627064547 tempest-ShareTypesAdminNegativeTest-1627064547-project-admin] REQUEST_METHOD: `PUT` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a996872-4ed1-4cc4-8bbf-c9a58d498271 tempest-ShareTypesAdminNegativeTest-1627064547 tempest-ShareTypesAdminNegativeTest-1627064547-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a996872-4ed1-4cc4-8bbf-c9a58d498271 tempest-ShareTypesAdminNegativeTest-1627064547 tempest-ShareTypesAdminNegativeTest-1627064547-project-admin] PATH_INFO: `/v3/projects/d0b0ae94b0c5486f9028712057ebacb5/users/b06cddbef69143b790020ff2c97c502e/roles/44620cad10ae407c90c91e2c296adb04` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a996872-4ed1-4cc4-8bbf-c9a58d498271 tempest-ShareTypesAdminNegativeTest-1627064547 tempest-ShareTypesAdminNegativeTest-1627064547-project-admin] RBAC: Authorizing `identity:create_grant(project_id=d0b0ae94b0c5486f9028712057ebacb5, user_id=b06cddbef69143b790020ff2c97c502e, role_id=44620cad10ae407c90c91e2c296adb04)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a996872-4ed1-4cc4-8bbf-c9a58d498271 tempest-ShareTypesAdminNegativeTest-1627064547 tempest-ShareTypesAdminNegativeTest-1627064547-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:34 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-eda6b89b-13db-4842-b681-6d99576fdbea tempest-AdminActionsTest-1749172189 None] <<< [POST] https://127.0.0.1:40443/api/quotas/ May 28 12:56:34 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-eda6b89b-13db-4842-b681-6d99576fdbea tempest-AdminActionsTest-1749172189 None] Bunch(cluster='loop75-kfs', cluster_id=1, default_email=None, default_group_quota=None, default_user_quota=None, enable_alarms=True, enable_email_providers=True, grace_period=None, group_quotas=[], guid='a5c17ca9-e184-4bb4-abf0-b6f53ca0e25d', hard_limit=1073741824, hard_limit_inodes=None, id=5, internal=False, is_user_quota=False, last_user_quotas_update=None, name='766fa507-2a4c-47eb-bfef-fa764b38b24c', num_blocked_users=0, num_exceeded_users=0, path='/manila/manila-766fa507-2a4c-47eb-bfef-fa764b38b24c', percent_capacity=0, percent_inodes=None, pretty_grace_period=None, pretty_grace_period_expiration=None, pretty_state='OK (CREATED)', soft_limit=None, soft_limit_inodes=None, state='OK', sync_state='CREATED', system_id=5, tenant_id=1, tenant_name='default', time_to_block=None, title='766fa507-2a4c-47eb-bfef-fa764b38b24c', url='https://127.0.0.1:40443/api/quotas/5/', used_capacity=0, used_capacity_tb=0.0, used_effective_capacity=0, used_effective_capacity_tb=0.0, used_inodes=0, used_limited_capacity=0, user_quotas=[]) May 28 12:56:34 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-eda6b89b-13db-4842-b681-6d99576fdbea tempest-AdminActionsTest-1749172189 None] --- [POST] https://127.0.0.1:40443/api/quotas/: Done May 28 12:56:34 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-eda6b89b-13db-4842-b681-6d99576fdbea tempest-AdminActionsTest-1749172189 None] >>> [GET] https://127.0.0.1:40443/api/views/ May 28 12:56:34 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-eda6b89b-13db-4842-b681-6d99576fdbea tempest-AdminActionsTest-1749172189 None] {'allow_redirects': True, May 28 12:56:34 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-eda6b89b-13db-4842-b681-6d99576fdbea tempest-AdminActionsTest-1749172189 None] 'params': {'name': '766fa507-2a4c-47eb-bfef-fa764b38b24c'}} May 28 12:56:34 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 757/1497] 10.27.203.238 () {64 vars in 1571 bytes} [Tue May 28 12:56:34 2024] PUT /identity/v3/projects/d0b0ae94b0c5486f9028712057ebacb5/users/b06cddbef69143b790020ff2c97c502e/roles/44620cad10ae407c90c91e2c296adb04 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:56:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4b4e4a-3b01-472b-bca7-d157b70fbbb6 tempest-ShareTypesAdminNegativeTest-1627064547 tempest-ShareTypesAdminNegativeTest-1627064547-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-1e4b4e4a-3b01-472b-bca7-d157b70fbbb6 tempest-ShareTypesAdminNegativeTest-1627064547 tempest-ShareTypesAdminNegativeTest-1627064547-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4b4e4a-3b01-472b-bca7-d157b70fbbb6 tempest-ShareTypesAdminNegativeTest-1627064547 tempest-ShareTypesAdminNegativeTest-1627064547-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d52b0b-b8ae-4b54-bf71-d3a4ea187b91 service manila] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f110cf6300f049c897d0aab63218d1e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d52b0b-b8ae-4b54-bf71-d3a4ea187b91 service manila] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d52b0b-b8ae-4b54-bf71-d3a4ea187b91 service manila] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d52b0b-b8ae-4b54-bf71-d3a4ea187b91 service manila] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d52b0b-b8ae-4b54-bf71-d3a4ea187b91 service manila] RBAC: Authorizing `identity:validate_token()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d52b0b-b8ae-4b54-bf71-d3a4ea187b91 service manila] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:35 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 741/1498] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 12:56:34 2024] GET /identity/v3/auth/tokens => generated 4087 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-481aac51-420f-4fea-985c-d87ed040c387 tempest-ShareTypesAdminNegativeTest-1627064547 tempest-ShareTypesAdminNegativeTest-1627064547-project-admin] POST http://10.27.203.238/share/v2/d0b0ae94b0c5486f9028712057ebacb5/types May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-481aac51-420f-4fea-985c-d87ed040c387 tempest-ShareTypesAdminNegativeTest-1627064547 tempest-ShareTypesAdminNegativeTest-1627064547-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share_type": {"name": "tempest-typeshare-type-1920536704", "extra_specs": {"driver_handles_share_servers": "False", "key": "value"}, "share_type_access:is_public": true}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-481aac51-420f-4fea-985c-d87ed040c387 tempest-ShareTypesAdminNegativeTest-1627064547 tempest-ShareTypesAdminNegativeTest-1627064547-project-admin] http://10.27.203.238/share/v2/d0b0ae94b0c5486f9028712057ebacb5/types returned with HTTP 200 May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 71/162] 10.27.203.238 () {66 vars in 1359 bytes} [Tue May 28 12:56:34 2024] POST /share/v2/d0b0ae94b0c5486f9028712057ebacb5/types => generated 655 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-45b645af-62c3-4594-8171-97521ab349e2 tempest-ShareTypesAdminNegativeTest-1627064547 tempest-ShareTypesAdminNegativeTest-1627064547-project-admin] POST http://10.27.203.238/share/v2/d0b0ae94b0c5486f9028712057ebacb5/types/c6854d67-4ef8-4cfb-9af5-e3cd2d5bb434/action May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-45b645af-62c3-4594-8171-97521ab349e2 tempest-ShareTypesAdminNegativeTest-1627064547 tempest-ShareTypesAdminNegativeTest-1627064547-project-admin] Action body: b'{"addProjectAccess": {"project": "d0b0ae94b0c5486f9028712057ebacb5"}}' {{(pid=98329) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-45b645af-62c3-4594-8171-97521ab349e2 tempest-ShareTypesAdminNegativeTest-1627064547 tempest-ShareTypesAdminNegativeTest-1627064547-project-admin] Action: 'action', calling method: ShareTypesController._add_project_access, body: {"addProjectAccess": {"project": "d0b0ae94b0c5486f9028712057ebacb5"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-45b645af-62c3-4594-8171-97521ab349e2 tempest-ShareTypesAdminNegativeTest-1627064547 tempest-ShareTypesAdminNegativeTest-1627064547-project-admin] HTTP exception thrown: Type access modification is not applicable to public share type. May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-45b645af-62c3-4594-8171-97521ab349e2 tempest-ShareTypesAdminNegativeTest-1627064547 tempest-ShareTypesAdminNegativeTest-1627064547-project-admin] http://10.27.203.238/share/v2/d0b0ae94b0c5486f9028712057ebacb5/types/c6854d67-4ef8-4cfb-9af5-e3cd2d5bb434/action returned with HTTP 409 May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 92/163] 10.27.203.238 () {66 vars in 1490 bytes} [Tue May 28 12:56:35 2024] POST /share/v2/d0b0ae94b0c5486f9028712057ebacb5/types/c6854d67-4ef8-4cfb-9af5-e3cd2d5bb434/action => generated 116 bytes in 10 msecs (HTTP/1.1 409) 6 headers in 237 bytes (1 switches on core 0) May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-d726b9b2-edc9-4de4-8465-c12dae15ae43 tempest-ShareTypesAdminNegativeTest-1627064547 tempest-ShareTypesAdminNegativeTest-1627064547-project-admin] POST http://10.27.203.238/share/v2/d0b0ae94b0c5486f9028712057ebacb5/types/tempest-fake-1112648523/action May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-d726b9b2-edc9-4de4-8465-c12dae15ae43 tempest-ShareTypesAdminNegativeTest-1627064547 tempest-ShareTypesAdminNegativeTest-1627064547-project-admin] Action body: b'{"addProjectAccess": {"project": "d0b0ae94b0c5486f9028712057ebacb5"}}' {{(pid=98330) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-d726b9b2-edc9-4de4-8465-c12dae15ae43 tempest-ShareTypesAdminNegativeTest-1627064547 tempest-ShareTypesAdminNegativeTest-1627064547-project-admin] Action: 'action', calling method: ShareTypesController._add_project_access, body: {"addProjectAccess": {"project": "d0b0ae94b0c5486f9028712057ebacb5"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-d726b9b2-edc9-4de4-8465-c12dae15ae43 tempest-ShareTypesAdminNegativeTest-1627064547 tempest-ShareTypesAdminNegativeTest-1627064547-project-admin] HTTP exception thrown: Share type %(share_type_id)s could not be found. May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-d726b9b2-edc9-4de4-8465-c12dae15ae43 tempest-ShareTypesAdminNegativeTest-1627064547 tempest-ShareTypesAdminNegativeTest-1627064547-project-admin] http://10.27.203.238/share/v2/d0b0ae94b0c5486f9028712057ebacb5/types/tempest-fake-1112648523/action returned with HTTP 404 May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 72/164] 10.27.203.238 () {66 vars in 1451 bytes} [Tue May 28 12:56:35 2024] POST /share/v2/d0b0ae94b0c5486f9028712057ebacb5/types/tempest-fake-1112648523/action => generated 94 bytes in 10 msecs (HTTP/1.1 404) 6 headers in 237 bytes (2 switches on core 0) May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-da25271a-2e1b-4924-ae93-1ca118adf1ea tempest-ShareTypesAdminNegativeTest-1627064547 tempest-ShareTypesAdminNegativeTest-1627064547-project-admin] POST http://10.27.203.238/share/v2/d0b0ae94b0c5486f9028712057ebacb5/types May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-da25271a-2e1b-4924-ae93-1ca118adf1ea tempest-ShareTypesAdminNegativeTest-1627064547 tempest-ShareTypesAdminNegativeTest-1627064547-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share_type": {"name": "tempest-tempest_type_name-1607986929", "extra_specs": {"driver_handles_share_servers": "False"}, "os-share-type-access:is_public": true, "description": "tempest_type_description"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-da25271a-2e1b-4924-ae93-1ca118adf1ea tempest-ShareTypesAdminNegativeTest-1627064547 tempest-ShareTypesAdminNegativeTest-1627064547-project-admin] HTTP exception thrown: 'description' key is not supported by this microversion. Use 2.41 or greater microversion to be able to use 'description' in share type. May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-da25271a-2e1b-4924-ae93-1ca118adf1ea tempest-ShareTypesAdminNegativeTest-1627064547 tempest-ShareTypesAdminNegativeTest-1627064547-project-admin] http://10.27.203.238/share/v2/d0b0ae94b0c5486f9028712057ebacb5/types returned with HTTP 400 May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 93/165] 10.27.203.238 () {66 vars in 1358 bytes} [Tue May 28 12:56:35 2024] POST /share/v2/d0b0ae94b0c5486f9028712057ebacb5/types => generated 180 bytes in 6 msecs (HTTP/1.1 400) 6 headers in 239 bytes (1 switches on core 0) May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-8e870c15-5684-4e6f-80ba-3e2b84b74d88 tempest-ShareTypesAdminNegativeTest-1627064547 tempest-ShareTypesAdminNegativeTest-1627064547-project-admin] POST http://10.27.203.238/share/v2/d0b0ae94b0c5486f9028712057ebacb5/types May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-8e870c15-5684-4e6f-80ba-3e2b84b74d88 tempest-ShareTypesAdminNegativeTest-1627064547 tempest-ShareTypesAdminNegativeTest-1627064547-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share_type": {"name": "tempest-tempest_type_name-1661143969", "extra_specs": {"driver_handles_share_servers": "False"}, "os-share-type-access:is_public": true, "description": "tempest_type_description"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-8e870c15-5684-4e6f-80ba-3e2b84b74d88 tempest-ShareTypesAdminNegativeTest-1627064547 tempest-ShareTypesAdminNegativeTest-1627064547-project-admin] HTTP exception thrown: 'description' key is not supported by this microversion. Use 2.41 or greater microversion to be able to use 'description' in share type. May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-8e870c15-5684-4e6f-80ba-3e2b84b74d88 tempest-ShareTypesAdminNegativeTest-1627064547 tempest-ShareTypesAdminNegativeTest-1627064547-project-admin] http://10.27.203.238/share/v2/d0b0ae94b0c5486f9028712057ebacb5/types returned with HTTP 400 May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 73/166] 10.27.203.238 () {66 vars in 1358 bytes} [Tue May 28 12:56:35 2024] POST /share/v2/d0b0ae94b0c5486f9028712057ebacb5/types => generated 180 bytes in 7 msecs (HTTP/1.1 400) 6 headers in 239 bytes (1 switches on core 0) May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-7f83eba2-e56c-4c1f-bc2d-03eb6161a329 tempest-ShareTypesAdminNegativeTest-1627064547 tempest-ShareTypesAdminNegativeTest-1627064547-project-admin] POST http://10.27.203.238/share/v2/d0b0ae94b0c5486f9028712057ebacb5/types May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-7f83eba2-e56c-4c1f-bc2d-03eb6161a329 tempest-ShareTypesAdminNegativeTest-1627064547 tempest-ShareTypesAdminNegativeTest-1627064547-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share_type": {"name": "tempest-tempest_type_name-1456674347", "extra_specs": {"driver_handles_share_servers": "False"}, "share_type_access:is_public": true, "description": "tempest_type_description"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-7f83eba2-e56c-4c1f-bc2d-03eb6161a329 tempest-ShareTypesAdminNegativeTest-1627064547 tempest-ShareTypesAdminNegativeTest-1627064547-project-admin] HTTP exception thrown: 'description' key is not supported by this microversion. Use 2.41 or greater microversion to be able to use 'description' in share type. May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-7f83eba2-e56c-4c1f-bc2d-03eb6161a329 tempest-ShareTypesAdminNegativeTest-1627064547 tempest-ShareTypesAdminNegativeTest-1627064547-project-admin] http://10.27.203.238/share/v2/d0b0ae94b0c5486f9028712057ebacb5/types returned with HTTP 400 May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 94/167] 10.27.203.238 () {66 vars in 1359 bytes} [Tue May 28 12:56:35 2024] POST /share/v2/d0b0ae94b0c5486f9028712057ebacb5/types => generated 180 bytes in 6 msecs (HTTP/1.1 400) 6 headers in 240 bytes (2 switches on core 0) May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-9933990e-74ac-46f9-bfa0-ca7c643ca9b3 tempest-ShareTypesAdminNegativeTest-1627064547 tempest-ShareTypesAdminNegativeTest-1627064547-project-admin] POST http://10.27.203.238/share/v2/d0b0ae94b0c5486f9028712057ebacb5/types May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-9933990e-74ac-46f9-bfa0-ca7c643ca9b3 tempest-ShareTypesAdminNegativeTest-1627064547 tempest-ShareTypesAdminNegativeTest-1627064547-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share_type": {"name": "", "extra_specs": null, "share_type_access:is_public": true}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-9933990e-74ac-46f9-bfa0-ca7c643ca9b3 tempest-ShareTypesAdminNegativeTest-1627064547 tempest-ShareTypesAdminNegativeTest-1627064547-project-admin] HTTP exception thrown: Type name or description is not valid. May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-9933990e-74ac-46f9-bfa0-ca7c643ca9b3 tempest-ShareTypesAdminNegativeTest-1627064547 tempest-ShareTypesAdminNegativeTest-1627064547-project-admin] http://10.27.203.238/share/v2/d0b0ae94b0c5486f9028712057ebacb5/types returned with HTTP 400 May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 74/168] 10.27.203.238 () {66 vars in 1358 bytes} [Tue May 28 12:56:35 2024] POST /share/v2/d0b0ae94b0c5486f9028712057ebacb5/types => generated 82 bytes in 6 msecs (HTTP/1.1 400) 6 headers in 239 bytes (1 switches on core 0) May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-116c6469-f2c6-44be-be87-ce0a0453eb52 tempest-ShareTypesAdminNegativeTest-1627064547 tempest-ShareTypesAdminNegativeTest-1627064547-project-admin] POST http://10.27.203.238/share/v2/d0b0ae94b0c5486f9028712057ebacb5/types May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-116c6469-f2c6-44be-be87-ce0a0453eb52 tempest-ShareTypesAdminNegativeTest-1627064547 tempest-ShareTypesAdminNegativeTest-1627064547-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share_type": {"name": "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx", "extra_specs": {"driver_handles_share_servers": "False"}, "share_type_access:is_public": true}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-116c6469-f2c6-44be-be87-ce0a0453eb52 tempest-ShareTypesAdminNegativeTest-1627064547 tempest-ShareTypesAdminNegativeTest-1627064547-project-admin] HTTP exception thrown: Type name or description is not valid. May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-116c6469-f2c6-44be-be87-ce0a0453eb52 tempest-ShareTypesAdminNegativeTest-1627064547 tempest-ShareTypesAdminNegativeTest-1627064547-project-admin] http://10.27.203.238/share/v2/d0b0ae94b0c5486f9028712057ebacb5/types returned with HTTP 400 May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 95/169] 10.27.203.238 () {66 vars in 1359 bytes} [Tue May 28 12:56:35 2024] POST /share/v2/d0b0ae94b0c5486f9028712057ebacb5/types => generated 82 bytes in 6 msecs (HTTP/1.1 400) 6 headers in 239 bytes (1 switches on core 0) May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-89d898f0-800b-4102-bf5b-23f88a3aa79c tempest-ShareTypesAdminNegativeTest-1627064547 tempest-ShareTypesAdminNegativeTest-1627064547-project-admin] POST http://10.27.203.238/share/v2/d0b0ae94b0c5486f9028712057ebacb5/types May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-89d898f0-800b-4102-bf5b-23f88a3aa79c tempest-ShareTypesAdminNegativeTest-1627064547 tempest-ShareTypesAdminNegativeTest-1627064547-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share_type": {"name": "tempest-share-type-1974138976", "extra_specs": {"driver_handles_share_servers": "False"}, "share_type_access:is_public": false}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-89d898f0-800b-4102-bf5b-23f88a3aa79c tempest-ShareTypesAdminNegativeTest-1627064547 tempest-ShareTypesAdminNegativeTest-1627064547-project-admin] http://10.27.203.238/share/v2/d0b0ae94b0c5486f9028712057ebacb5/types returned with HTTP 200 May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 75/170] 10.27.203.238 () {66 vars in 1359 bytes} [Tue May 28 12:56:35 2024] POST /share/v2/d0b0ae94b0c5486f9028712057ebacb5/types => generated 617 bytes in 20 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-4e37ecc1-3aad-4fdf-9673-7f09e9c865bd tempest-ShareTypesAdminNegativeTest-1627064547 tempest-ShareTypesAdminNegativeTest-1627064547-project-admin] GET http://10.27.203.238/share/v2/d0b0ae94b0c5486f9028712057ebacb5/types May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-4e37ecc1-3aad-4fdf-9673-7f09e9c865bd tempest-ShareTypesAdminNegativeTest-1627064547 tempest-ShareTypesAdminNegativeTest-1627064547-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-4e37ecc1-3aad-4fdf-9673-7f09e9c865bd tempest-ShareTypesAdminNegativeTest-1627064547 tempest-ShareTypesAdminNegativeTest-1627064547-project-admin] Calling method 'ShareTypesController.index' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-4e37ecc1-3aad-4fdf-9673-7f09e9c865bd tempest-ShareTypesAdminNegativeTest-1627064547 tempest-ShareTypesAdminNegativeTest-1627064547-project-admin] http://10.27.203.238/share/v2/d0b0ae94b0c5486f9028712057ebacb5/types returned with HTTP 200 May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 96/171] 10.27.203.238 () {64 vars in 1337 bytes} [Tue May 28 12:56:35 2024] GET /share/v2/d0b0ae94b0c5486f9028712057ebacb5/types => generated 4769 bytes in 20 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-78269c89-9de0-41cb-b8c2-324a2a0dd140 tempest-ShareTypesAdminNegativeTest-1627064547 tempest-ShareTypesAdminNegativeTest-1627064547-project-admin] GET http://10.27.203.238/share/v2/d0b0ae94b0c5486f9028712057ebacb5/types/1c6c966c-975d-4db8-8676-711254e7af36/share_type_access May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-78269c89-9de0-41cb-b8c2-324a2a0dd140 tempest-ShareTypesAdminNegativeTest-1627064547 tempest-ShareTypesAdminNegativeTest-1627064547-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-78269c89-9de0-41cb-b8c2-324a2a0dd140 tempest-ShareTypesAdminNegativeTest-1627064547 tempest-ShareTypesAdminNegativeTest-1627064547-project-admin] Calling method 'ShareTypesController.share_type_access' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-78269c89-9de0-41cb-b8c2-324a2a0dd140 tempest-ShareTypesAdminNegativeTest-1627064547 tempest-ShareTypesAdminNegativeTest-1627064547-project-admin] http://10.27.203.238/share/v2/d0b0ae94b0c5486f9028712057ebacb5/types/1c6c966c-975d-4db8-8676-711254e7af36/share_type_access returned with HTTP 200 May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 76/172] 10.27.203.238 () {64 vars in 1502 bytes} [Tue May 28 12:56:35 2024] GET /share/v2/d0b0ae94b0c5486f9028712057ebacb5/types/1c6c966c-975d-4db8-8676-711254e7af36/share_type_access => generated 25 bytes in 19 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:56:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a996872-4ed1-4cc4-8bbf-c9a58d498271 tempest-ShareTypesAdminNegativeTest-1627064547 tempest-ShareTypesAdminNegativeTest-1627064547-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-1a996872-4ed1-4cc4-8bbf-c9a58d498271 tempest-ShareTypesAdminNegativeTest-1627064547 tempest-ShareTypesAdminNegativeTest-1627064547-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a996872-4ed1-4cc4-8bbf-c9a58d498271 tempest-ShareTypesAdminNegativeTest-1627064547 tempest-ShareTypesAdminNegativeTest-1627064547-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9417777-3132-42b4-82bd-be66e9b007b6 service manila] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f110cf6300f049c897d0aab63218d1e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9417777-3132-42b4-82bd-be66e9b007b6 service manila] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9417777-3132-42b4-82bd-be66e9b007b6 service manila] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9417777-3132-42b4-82bd-be66e9b007b6 service manila] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:35 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-eda6b89b-13db-4842-b681-6d99576fdbea tempest-AdminActionsTest-1749172189 None] <<< [GET] https://127.0.0.1:40443/api/views/ May 28 12:56:35 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-eda6b89b-13db-4842-b681-6d99576fdbea tempest-AdminActionsTest-1749172189 None] [] May 28 12:56:35 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-eda6b89b-13db-4842-b681-6d99576fdbea tempest-AdminActionsTest-1749172189 None] --- [GET] https://127.0.0.1:40443/api/views/: Done May 28 12:56:35 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-eda6b89b-13db-4842-b681-6d99576fdbea tempest-AdminActionsTest-1749172189 None] >>> [POST] https://127.0.0.1:40443/api/views/ May 28 12:56:35 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-eda6b89b-13db-4842-b681-6d99576fdbea tempest-AdminActionsTest-1749172189 None] {'data': '{"name": "766fa507-2a4c-47eb-bfef-fa764b38b24c", "path": ' May 28 12:56:35 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-eda6b89b-13db-4842-b681-6d99576fdbea tempest-AdminActionsTest-1749172189 None] '"/manila/manila-766fa507-2a4c-47eb-bfef-fa764b38b24c", "policy_id": ' May 28 12:56:35 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-eda6b89b-13db-4842-b681-6d99576fdbea tempest-AdminActionsTest-1749172189 None] '8, "create_dir": true, "protocols": ["NFS"]}', May 28 12:56:35 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-eda6b89b-13db-4842-b681-6d99576fdbea tempest-AdminActionsTest-1749172189 None] 'json': None, May 28 12:56:35 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-eda6b89b-13db-4842-b681-6d99576fdbea tempest-AdminActionsTest-1749172189 None] 'params': None} May 28 12:56:35 l75lg1-v1 dstat.sh[49771]: 28-05 12:56:35| 10 1 86 2 0|5644M 1865M 277M 7839M| 18k 10k| 0 1588k| 0 219 |7443 12k|1.78 0.98 0.98|5.0 0 0| 0 0 | 0 2048M| 29 345 0 45 0 May 28 12:56:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9417777-3132-42b4-82bd-be66e9b007b6 service manila] RBAC: Authorizing `identity:validate_token()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9417777-3132-42b4-82bd-be66e9b007b6 service manila] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:35 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 758/1499] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 12:56:35 2024] GET /identity/v3/auth/tokens => generated 3964 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-ab112757-d2af-4342-b921-5d2e26fd6746 tempest-ShareTypesAdminNegativeTest-1434460062 tempest-ShareTypesAdminNegativeTest-1434460062-project-member] POST http://10.27.203.238/share/v2/ac20784a3f664ed6873784a747ff7b1f/shares May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-ab112757-d2af-4342-b921-5d2e26fd6746 tempest-ShareTypesAdminNegativeTest-1434460062 tempest-ShareTypesAdminNegativeTest-1434460062-project-member] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share": {"share_proto": "nfs", "description": "tempest-tempest-created-share-desc-1439140861", "snapshot_id": null, "name": "tempest-tempest-created-share-154481916", "size": 1, "metadata": {}, "is_public": false, "share_type": "tempest-share-type-1974138976"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.v1.shares [None req-ab112757-d2af-4342-b921-5d2e26fd6746 tempest-ShareTypesAdminNegativeTest-1434460062 tempest-ShareTypesAdminNegativeTest-1434460062-project-member] Create NFS share of 1 GB May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-ab112757-d2af-4342-b921-5d2e26fd6746 tempest-ShareTypesAdminNegativeTest-1434460062 tempest-ShareTypesAdminNegativeTest-1434460062-project-member] HTTP exception thrown: Share type not found. May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-ab112757-d2af-4342-b921-5d2e26fd6746 tempest-ShareTypesAdminNegativeTest-1434460062 tempest-ShareTypesAdminNegativeTest-1434460062-project-member] http://10.27.203.238/share/v2/ac20784a3f664ed6873784a747ff7b1f/shares returned with HTTP 404 May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 97/173] 10.27.203.238 () {66 vars in 1362 bytes} [Tue May 28 12:56:35 2024] POST /share/v2/ac20784a3f664ed6873784a747ff7b1f/shares => generated 67 bytes in 85 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-fb1a3399-0ef1-42e0-82fb-0f368d68b471 tempest-ShareTypesAdminNegativeTest-1434460062 tempest-ShareTypesAdminNegativeTest-1434460062-project-member] GET http://10.27.203.238/share/v2/ac20784a3f664ed6873784a747ff7b1f/shares/detail May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-fb1a3399-0ef1-42e0-82fb-0f368d68b471 tempest-ShareTypesAdminNegativeTest-1434460062 tempest-ShareTypesAdminNegativeTest-1434460062-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-fb1a3399-0ef1-42e0-82fb-0f368d68b471 tempest-ShareTypesAdminNegativeTest-1434460062 tempest-ShareTypesAdminNegativeTest-1434460062-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.common [None req-fb1a3399-0ef1-42e0-82fb-0f368d68b471 tempest-ShareTypesAdminNegativeTest-1434460062 tempest-ShareTypesAdminNegativeTest-1434460062-project-member] Removing options '' from query {{(pid=98330) remove_invalid_options /opt/stack/manila/manila/api/common.py:441}} May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.share.api [None req-fb1a3399-0ef1-42e0-82fb-0f368d68b471 tempest-ShareTypesAdminNegativeTest-1434460062 tempest-ShareTypesAdminNegativeTest-1434460062-project-member] Searching for shares by: {} {{(pid=98330) _get_all /opt/stack/manila/manila/share/api.py:2235}} May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-fb1a3399-0ef1-42e0-82fb-0f368d68b471 tempest-ShareTypesAdminNegativeTest-1434460062 tempest-ShareTypesAdminNegativeTest-1434460062-project-member] http://10.27.203.238/share/v2/ac20784a3f664ed6873784a747ff7b1f/shares/detail returned with HTTP 200 May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 77/174] 10.27.203.238 () {64 vars in 1361 bytes} [Tue May 28 12:56:35 2024] GET /share/v2/ac20784a3f664ed6873784a747ff7b1f/shares/detail => generated 14 bytes in 20 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-83b06584-0217-470d-b50c-247b5f765d21 tempest-ShareTypesAdminNegativeTest-1627064547 tempest-ShareTypesAdminNegativeTest-1627064547-project-admin] POST http://10.27.203.238/share/v2/d0b0ae94b0c5486f9028712057ebacb5/shares May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-83b06584-0217-470d-b50c-247b5f765d21 tempest-ShareTypesAdminNegativeTest-1627064547 tempest-ShareTypesAdminNegativeTest-1627064547-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share": {"share_proto": "nfs", "description": "tempest-tempest-created-share-desc-2011380036", "snapshot_id": null, "name": "tempest-tempest-created-share-1264103137", "size": 1, "metadata": {}, "is_public": false, "share_type": "tempest-fake-1175917276"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.v1.shares [None req-83b06584-0217-470d-b50c-247b5f765d21 tempest-ShareTypesAdminNegativeTest-1627064547 tempest-ShareTypesAdminNegativeTest-1627064547-project-admin] Create NFS share of 1 GB May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-83b06584-0217-470d-b50c-247b5f765d21 tempest-ShareTypesAdminNegativeTest-1627064547 tempest-ShareTypesAdminNegativeTest-1627064547-project-admin] HTTP exception thrown: Share type not found. May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-83b06584-0217-470d-b50c-247b5f765d21 tempest-ShareTypesAdminNegativeTest-1627064547 tempest-ShareTypesAdminNegativeTest-1627064547-project-admin] http://10.27.203.238/share/v2/d0b0ae94b0c5486f9028712057ebacb5/shares returned with HTTP 404 May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 98/175] 10.27.203.238 () {66 vars in 1362 bytes} [Tue May 28 12:56:35 2024] POST /share/v2/d0b0ae94b0c5486f9028712057ebacb5/shares => generated 67 bytes in 12 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-4a8ea84a-5952-4d1d-a244-cc14eba566c7 tempest-ShareTypesAdminNegativeTest-1627064547 tempest-ShareTypesAdminNegativeTest-1627064547-project-admin] GET http://10.27.203.238/share/v2/d0b0ae94b0c5486f9028712057ebacb5/types/tempest-fake-1595854568 May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-4a8ea84a-5952-4d1d-a244-cc14eba566c7 tempest-ShareTypesAdminNegativeTest-1627064547 tempest-ShareTypesAdminNegativeTest-1627064547-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-4a8ea84a-5952-4d1d-a244-cc14eba566c7 tempest-ShareTypesAdminNegativeTest-1627064547 tempest-ShareTypesAdminNegativeTest-1627064547-project-admin] Calling method 'ShareTypesController.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-4a8ea84a-5952-4d1d-a244-cc14eba566c7 tempest-ShareTypesAdminNegativeTest-1627064547 tempest-ShareTypesAdminNegativeTest-1627064547-project-admin] HTTP exception thrown: Share type not found. May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-4a8ea84a-5952-4d1d-a244-cc14eba566c7 tempest-ShareTypesAdminNegativeTest-1627064547 tempest-ShareTypesAdminNegativeTest-1627064547-project-admin] http://10.27.203.238/share/v2/d0b0ae94b0c5486f9028712057ebacb5/types/tempest-fake-1595854568 returned with HTTP 404 May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 78/176] 10.27.203.238 () {64 vars in 1409 bytes} [Tue May 28 12:56:35 2024] GET /share/v2/d0b0ae94b0c5486f9028712057ebacb5/types/tempest-fake-1595854568 => generated 67 bytes in 10 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-2fbf43a4-809a-4d01-90da-3a536956a6fc tempest-ShareTypesAdminNegativeTest-1627064547 tempest-ShareTypesAdminNegativeTest-1627064547-project-admin] POST http://10.27.203.238/share/v2/d0b0ae94b0c5486f9028712057ebacb5/types May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-2fbf43a4-809a-4d01-90da-3a536956a6fc tempest-ShareTypesAdminNegativeTest-1627064547 tempest-ShareTypesAdminNegativeTest-1627064547-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share_type": {"name": "tempest-typeshare-type-1855293278", "extra_specs": {"driver_handles_share_servers": "False", "key": "value"}, "share_type_access:is_public": true}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-2fbf43a4-809a-4d01-90da-3a536956a6fc tempest-ShareTypesAdminNegativeTest-1627064547 tempest-ShareTypesAdminNegativeTest-1627064547-project-admin] http://10.27.203.238/share/v2/d0b0ae94b0c5486f9028712057ebacb5/types returned with HTTP 200 May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 99/177] 10.27.203.238 () {66 vars in 1359 bytes} [Tue May 28 12:56:35 2024] POST /share/v2/d0b0ae94b0c5486f9028712057ebacb5/types => generated 655 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-692e3079-e409-4b49-8198-53408bac8cfe tempest-ShareTypesAdminNegativeTest-1627064547 tempest-ShareTypesAdminNegativeTest-1627064547-project-admin] POST http://10.27.203.238/share/v2/d0b0ae94b0c5486f9028712057ebacb5/types/464d4b8f-a4d6-45e1-be34-68f5407e2641/action May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-692e3079-e409-4b49-8198-53408bac8cfe tempest-ShareTypesAdminNegativeTest-1627064547 tempest-ShareTypesAdminNegativeTest-1627064547-project-admin] Action body: b'{"removeProjectAccess": {"project": "d0b0ae94b0c5486f9028712057ebacb5"}}' {{(pid=98330) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-692e3079-e409-4b49-8198-53408bac8cfe tempest-ShareTypesAdminNegativeTest-1627064547 tempest-ShareTypesAdminNegativeTest-1627064547-project-admin] Action: 'action', calling method: ShareTypesController._remove_project_access, body: {"removeProjectAccess": {"project": "d0b0ae94b0c5486f9028712057ebacb5"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-692e3079-e409-4b49-8198-53408bac8cfe tempest-ShareTypesAdminNegativeTest-1627064547 tempest-ShareTypesAdminNegativeTest-1627064547-project-admin] HTTP exception thrown: Type access modification is not applicable to public share type. May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-692e3079-e409-4b49-8198-53408bac8cfe tempest-ShareTypesAdminNegativeTest-1627064547 tempest-ShareTypesAdminNegativeTest-1627064547-project-admin] http://10.27.203.238/share/v2/d0b0ae94b0c5486f9028712057ebacb5/types/464d4b8f-a4d6-45e1-be34-68f5407e2641/action returned with HTTP 409 May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 79/178] 10.27.203.238 () {66 vars in 1490 bytes} [Tue May 28 12:56:35 2024] POST /share/v2/d0b0ae94b0c5486f9028712057ebacb5/types/464d4b8f-a4d6-45e1-be34-68f5407e2641/action => generated 116 bytes in 11 msecs (HTTP/1.1 409) 6 headers in 237 bytes (1 switches on core 0) May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-12ea99e1-a804-465a-b3b7-d655ccb4aa61 tempest-ShareTypesAdminNegativeTest-1627064547 tempest-ShareTypesAdminNegativeTest-1627064547-project-admin] POST http://10.27.203.238/share/v2/d0b0ae94b0c5486f9028712057ebacb5/types/tempest-fake-1612087282/action May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-12ea99e1-a804-465a-b3b7-d655ccb4aa61 tempest-ShareTypesAdminNegativeTest-1627064547 tempest-ShareTypesAdminNegativeTest-1627064547-project-admin] Action body: b'{"removeProjectAccess": {"project": "d0b0ae94b0c5486f9028712057ebacb5"}}' {{(pid=98329) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-12ea99e1-a804-465a-b3b7-d655ccb4aa61 tempest-ShareTypesAdminNegativeTest-1627064547 tempest-ShareTypesAdminNegativeTest-1627064547-project-admin] Action: 'action', calling method: ShareTypesController._remove_project_access, body: {"removeProjectAccess": {"project": "d0b0ae94b0c5486f9028712057ebacb5"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-12ea99e1-a804-465a-b3b7-d655ccb4aa61 tempest-ShareTypesAdminNegativeTest-1627064547 tempest-ShareTypesAdminNegativeTest-1627064547-project-admin] HTTP exception thrown: Share type %(share_type_id)s could not be found. May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-12ea99e1-a804-465a-b3b7-d655ccb4aa61 tempest-ShareTypesAdminNegativeTest-1627064547 tempest-ShareTypesAdminNegativeTest-1627064547-project-admin] http://10.27.203.238/share/v2/d0b0ae94b0c5486f9028712057ebacb5/types/tempest-fake-1612087282/action returned with HTTP 404 May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 100/179] 10.27.203.238 () {66 vars in 1451 bytes} [Tue May 28 12:56:35 2024] POST /share/v2/d0b0ae94b0c5486f9028712057ebacb5/types/tempest-fake-1612087282/action => generated 94 bytes in 10 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-b098e68c-b585-47bf-afa8-3d39eb8acf0a tempest-ShareTypesAdminNegativeTest-1627064547 tempest-ShareTypesAdminNegativeTest-1627064547-project-admin] POST http://10.27.203.238/share/v2/d0b0ae94b0c5486f9028712057ebacb5/types May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-b098e68c-b585-47bf-afa8-3d39eb8acf0a tempest-ShareTypesAdminNegativeTest-1627064547 tempest-ShareTypesAdminNegativeTest-1627064547-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share_type": {"name": "tempest-typeshare-type-133120713", "extra_specs": {"driver_handles_share_servers": "False", "key": "value"}, "share_type_access:is_public": true}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-b098e68c-b585-47bf-afa8-3d39eb8acf0a tempest-ShareTypesAdminNegativeTest-1627064547 tempest-ShareTypesAdminNegativeTest-1627064547-project-admin] http://10.27.203.238/share/v2/d0b0ae94b0c5486f9028712057ebacb5/types returned with HTTP 200 May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 80/180] 10.27.203.238 () {66 vars in 1359 bytes} [Tue May 28 12:56:35 2024] POST /share/v2/d0b0ae94b0c5486f9028712057ebacb5/types => generated 653 bytes in 22 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-942e2925-2583-4b26-b1ab-9f0d1d6cdc15 tempest-ShareTypesAdminNegativeTest-1627064547 tempest-ShareTypesAdminNegativeTest-1627064547-project-admin] POST http://10.27.203.238/share/v2/d0b0ae94b0c5486f9028712057ebacb5/types May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-942e2925-2583-4b26-b1ab-9f0d1d6cdc15 tempest-ShareTypesAdminNegativeTest-1627064547 tempest-ShareTypesAdminNegativeTest-1627064547-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share_type": {"name": "tempest-typeshare-type-133120713", "extra_specs": {"driver_handles_share_servers": "False"}, "share_type_access:is_public": true}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-942e2925-2583-4b26-b1ab-9f0d1d6cdc15 tempest-ShareTypesAdminNegativeTest-1627064547 tempest-ShareTypesAdminNegativeTest-1627064547-project-admin] HTTP exception thrown: Share Type %(id)s already exists. May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-942e2925-2583-4b26-b1ab-9f0d1d6cdc15 tempest-ShareTypesAdminNegativeTest-1627064547 tempest-ShareTypesAdminNegativeTest-1627064547-project-admin] http://10.27.203.238/share/v2/d0b0ae94b0c5486f9028712057ebacb5/types returned with HTTP 409 May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 101/181] 10.27.203.238 () {66 vars in 1359 bytes} [Tue May 28 12:56:35 2024] POST /share/v2/d0b0ae94b0c5486f9028712057ebacb5/types => generated 85 bytes in 13 msecs (HTTP/1.1 409) 6 headers in 236 bytes (1 switches on core 0) May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-2a55394d-2107-4957-a745-47c8e22fb10b tempest-ShareTypesAdminNegativeTest-1627064547 tempest-ShareTypesAdminNegativeTest-1627064547-project-admin] DELETE http://10.27.203.238/share/v2/d0b0ae94b0c5486f9028712057ebacb5/types/tempest-fake-1722436066 May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-2a55394d-2107-4957-a745-47c8e22fb10b tempest-ShareTypesAdminNegativeTest-1627064547 tempest-ShareTypesAdminNegativeTest-1627064547-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-2a55394d-2107-4957-a745-47c8e22fb10b tempest-ShareTypesAdminNegativeTest-1627064547 tempest-ShareTypesAdminNegativeTest-1627064547-project-admin] Calling method 'ShareTypesController._delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-2a55394d-2107-4957-a745-47c8e22fb10b tempest-ShareTypesAdminNegativeTest-1627064547 tempest-ShareTypesAdminNegativeTest-1627064547-project-admin] HTTP exception thrown: The resource could not be found. May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-2a55394d-2107-4957-a745-47c8e22fb10b tempest-ShareTypesAdminNegativeTest-1627064547 tempest-ShareTypesAdminNegativeTest-1627064547-project-admin] http://10.27.203.238/share/v2/d0b0ae94b0c5486f9028712057ebacb5/types/tempest-fake-1722436066 returned with HTTP 404 May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 81/182] 10.27.203.238 () {64 vars in 1412 bytes} [Tue May 28 12:56:35 2024] DELETE /share/v2/d0b0ae94b0c5486f9028712057ebacb5/types/tempest-fake-1722436066 => generated 78 bytes in 10 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 12:56:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d52b0b-b8ae-4b54-bf71-d3a4ea187b91 service manila] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d52b0b-b8ae-4b54-bf71-d3a4ea187b91 service manila] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d580ed-e916-4847-b242-196470cf4544 tempest-ShareTypesAdminNegativeTest-1627064547 tempest-ShareTypesAdminNegativeTest-1627064547-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cd0d153d5584483989830faec045a2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0b0ae94b0c5486f9028712057ebacb5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d580ed-e916-4847-b242-196470cf4544 tempest-ShareTypesAdminNegativeTest-1627064547 tempest-ShareTypesAdminNegativeTest-1627064547-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d580ed-e916-4847-b242-196470cf4544 tempest-ShareTypesAdminNegativeTest-1627064547 tempest-ShareTypesAdminNegativeTest-1627064547-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d580ed-e916-4847-b242-196470cf4544 tempest-ShareTypesAdminNegativeTest-1627064547 tempest-ShareTypesAdminNegativeTest-1627064547-project-admin] PATH_INFO: `/v3/users/981b3e419ab1466ba64538f100d39f99` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d580ed-e916-4847-b242-196470cf4544 tempest-ShareTypesAdminNegativeTest-1627064547 tempest-ShareTypesAdminNegativeTest-1627064547-project-admin] RBAC: Authorizing `identity:delete_user(user_id=981b3e419ab1466ba64538f100d39f99)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d580ed-e916-4847-b242-196470cf4544 tempest-ShareTypesAdminNegativeTest-1627064547 tempest-ShareTypesAdminNegativeTest-1627064547-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:35 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-09d580ed-e916-4847-b242-196470cf4544 tempest-ShareTypesAdminNegativeTest-1627064547 tempest-ShareTypesAdminNegativeTest-1627064547-project-admin] Could not find user: 981b3e419ab1466ba64538f100d39f99.: keystone.exception.UserNotFound: Could not find user: 981b3e419ab1466ba64538f100d39f99. May 28 12:56:35 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:56:35 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:56:35 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:56:35 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:56:35 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:56:35 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:56:35 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:56:35 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:56:35 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:56:35 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:56:35 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:56:35 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 12:56:35 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 12:56:35 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:56:35 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:56:35 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 12:56:35 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:56:35 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 12:56:35 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:56:35 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 12:56:35 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 12:56:35 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:56:35 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:56:35 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 12:56:35 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:56:35 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 12:56:35 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:56:35 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:56:35 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:56:35 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:56:35 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:56:35 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:56:35 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 12:56:35 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:56:35 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 12:56:35 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:56:35 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:56:35 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:56:35 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 12:56:35 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:56:35 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 12:56:35 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 12:56:35 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 12:56:35 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 12:56:35 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 12:56:35 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 12:56:35 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 12:56:35 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 981b3e419ab1466ba64538f100d39f99. May 28 12:56:35 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 12:56:35 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 742/1500] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 12:56:35 2024] DELETE /identity/v3/users/981b3e419ab1466ba64538f100d39f99 => generated 110 bytes in 23 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 12:56:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9417777-3132-42b4-82bd-be66e9b007b6 service manila] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9417777-3132-42b4-82bd-be66e9b007b6 service manila] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:35 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f14b81f1-4795-434b-97aa-9964eeaa9857 tempest-AdminActionsNegativeTest-763023849 None] <<< [POST] https://127.0.0.1:40443/api/snapshots/ May 28 12:56:35 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f14b81f1-4795-434b-97aa-9964eeaa9857 tempest-AdminActionsNegativeTest-763023849 None] Bunch(access_path='/.vast_all_snapshots/1000000000_share-snapshot-2c33c0a4-eec6-45e7-9277-173d95361e7a', aggr_phys_estimation=0, cluster='loop75-kfs', created='2024-05-28T12:56:32.882997Z', eta_sec=30819899002.50999, expiration_time='3001-01-19T07:59:58Z', guid='aa09c396-dd1a-4133-8358-a6aa81bdc288', id=1, indestructible=False, locked=False, name='share-snapshot-2c33c0a4-eec6-45e7-9277-173d95361e7a', path='/manila/manila-5ae9ae15-dc00-44c8-891a-9758f2b29855/', policy=None, policy_id=None, protection_policy_id=None, state='SUCCEED', tenant_id=1, tenant_name='default', title='share-snapshot-2c33c0a4-eec6-45e7-9277-173d95361e7a(/manila/manila-5ae9ae15-dc00-44c8-891a-9758f2b29855/)', type='local', unique_phys_estimation=0, url='https://127.0.0.1:40443/api/snapshots/1/') May 28 12:56:35 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f14b81f1-4795-434b-97aa-9964eeaa9857 tempest-AdminActionsNegativeTest-763023849 None] --- [POST] https://127.0.0.1:40443/api/snapshots/: Done May 28 12:56:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53a4a79-f5a2-47eb-a38b-d67c46253c7a tempest-ShareTypesAdminNegativeTest-1627064547 tempest-ShareTypesAdminNegativeTest-1627064547-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cd0d153d5584483989830faec045a2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0b0ae94b0c5486f9028712057ebacb5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53a4a79-f5a2-47eb-a38b-d67c46253c7a tempest-ShareTypesAdminNegativeTest-1627064547 tempest-ShareTypesAdminNegativeTest-1627064547-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53a4a79-f5a2-47eb-a38b-d67c46253c7a tempest-ShareTypesAdminNegativeTest-1627064547 tempest-ShareTypesAdminNegativeTest-1627064547-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53a4a79-f5a2-47eb-a38b-d67c46253c7a tempest-ShareTypesAdminNegativeTest-1627064547 tempest-ShareTypesAdminNegativeTest-1627064547-project-admin] PATH_INFO: `/v3/users/b06cddbef69143b790020ff2c97c502e` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53a4a79-f5a2-47eb-a38b-d67c46253c7a tempest-ShareTypesAdminNegativeTest-1627064547 tempest-ShareTypesAdminNegativeTest-1627064547-project-admin] RBAC: Authorizing `identity:delete_user(user_id=b06cddbef69143b790020ff2c97c502e)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53a4a79-f5a2-47eb-a38b-d67c46253c7a tempest-ShareTypesAdminNegativeTest-1627064547 tempest-ShareTypesAdminNegativeTest-1627064547-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-f53a4a79-f5a2-47eb-a38b-d67c46253c7a tempest-ShareTypesAdminNegativeTest-1627064547 tempest-ShareTypesAdminNegativeTest-1627064547-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b06cddbef69143b790020ff2c97c502e', 'request_id': 'req-f53a4a79-f5a2-47eb-a38b-d67c46253c7a'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-f53a4a79-f5a2-47eb-a38b-d67c46253c7a tempest-ShareTypesAdminNegativeTest-1627064547 tempest-ShareTypesAdminNegativeTest-1627064547-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b06cddbef69143b790020ff2c97c502e', 'request_id': 'req-f53a4a79-f5a2-47eb-a38b-d67c46253c7a'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-f53a4a79-f5a2-47eb-a38b-d67c46253c7a tempest-ShareTypesAdminNegativeTest-1627064547 tempest-ShareTypesAdminNegativeTest-1627064547-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b06cddbef69143b790020ff2c97c502e', 'request_id': 'req-f53a4a79-f5a2-47eb-a38b-d67c46253c7a'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-f53a4a79-f5a2-47eb-a38b-d67c46253c7a tempest-ShareTypesAdminNegativeTest-1627064547 tempest-ShareTypesAdminNegativeTest-1627064547-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b06cddbef69143b790020ff2c97c502e', 'request_id': 'req-f53a4a79-f5a2-47eb-a38b-d67c46253c7a'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-f53a4a79-f5a2-47eb-a38b-d67c46253c7a tempest-ShareTypesAdminNegativeTest-1627064547 tempest-ShareTypesAdminNegativeTest-1627064547-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b06cddbef69143b790020ff2c97c502e', 'request_id': 'req-f53a4a79-f5a2-47eb-a38b-d67c46253c7a'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:35 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 759/1501] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 12:56:35 2024] DELETE /identity/v3/users/b06cddbef69143b790020ff2c97c502e => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-d0acc5ad-389c-4a5d-bda4-5a5adba624f0 tempest-ShareTypesAdminNegativeTest-1627064547 tempest-ShareTypesAdminNegativeTest-1627064547-project-admin] DELETE http://10.27.203.238/share/v2/d0b0ae94b0c5486f9028712057ebacb5/types/a4b4598c-1e75-494e-b544-01e4095f45cb May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-d0acc5ad-389c-4a5d-bda4-5a5adba624f0 tempest-ShareTypesAdminNegativeTest-1627064547 tempest-ShareTypesAdminNegativeTest-1627064547-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-d0acc5ad-389c-4a5d-bda4-5a5adba624f0 tempest-ShareTypesAdminNegativeTest-1627064547 tempest-ShareTypesAdminNegativeTest-1627064547-project-admin] Calling method 'ShareTypesController._delete' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-8d4d7fcb-5956-4fc3-9373-948256c7bc2d tempest-AdminActionsNegativeTest-763023849 tempest-AdminActionsNegativeTest-763023849-project-admin] GET http://10.27.203.238/share/v2/7c36a466cc2a42b195f921474b0f4de5/snapshots/330a4554-af48-41d4-8b48-7c7fa0931581 May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-8d4d7fcb-5956-4fc3-9373-948256c7bc2d tempest-AdminActionsNegativeTest-763023849 tempest-AdminActionsNegativeTest-763023849-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-8d4d7fcb-5956-4fc3-9373-948256c7bc2d tempest-AdminActionsNegativeTest-763023849 tempest-AdminActionsNegativeTest-763023849-project-admin] Calling method 'ShareSnapshotMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-8d4d7fcb-5956-4fc3-9373-948256c7bc2d tempest-AdminActionsNegativeTest-763023849 tempest-AdminActionsNegativeTest-763023849-project-admin] http://10.27.203.238/share/v2/7c36a466cc2a42b195f921474b0f4de5/snapshots/330a4554-af48-41d4-8b48-7c7fa0931581 returned with HTTP 200 May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 82/183] 10.27.203.238 () {64 vars in 1460 bytes} [Tue May 28 12:56:35 2024] GET /share/v2/7c36a466cc2a42b195f921474b0f4de5/snapshots/330a4554-af48-41d4-8b48-7c7fa0931581 => generated 750 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-d0acc5ad-389c-4a5d-bda4-5a5adba624f0 tempest-ShareTypesAdminNegativeTest-1627064547 tempest-ShareTypesAdminNegativeTest-1627064547-project-admin] http://10.27.203.238/share/v2/d0b0ae94b0c5486f9028712057ebacb5/types/a4b4598c-1e75-494e-b544-01e4095f45cb returned with HTTP 202 May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 102/184] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:56:35 2024] DELETE /share/v2/d0b0ae94b0c5486f9028712057ebacb5/types/a4b4598c-1e75-494e-b544-01e4095f45cb => generated 0 bytes in 39 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-65929265-468d-49b7-800e-20bbbdc7519e tempest-AdminActionsNegativeTest-763023849 tempest-AdminActionsNegativeTest-763023849-project-admin] POST http://10.27.203.238/share/v2/7c36a466cc2a42b195f921474b0f4de5/share_instances/5ae9ae15-dc00-44c8-891a-9758f2b29855/action May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-65929265-468d-49b7-800e-20bbbdc7519e tempest-AdminActionsNegativeTest-763023849 tempest-AdminActionsNegativeTest-763023849-project-admin] Action body: b'{"reset_status": {"status": "fake"}}' {{(pid=98330) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-65929265-468d-49b7-800e-20bbbdc7519e tempest-AdminActionsNegativeTest-763023849 tempest-AdminActionsNegativeTest-763023849-project-admin] Action: 'action', calling method: Controller.__getattribute__..version_select, body: {"reset_status": {"status": "fake"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-65929265-468d-49b7-800e-20bbbdc7519e tempest-AdminActionsNegativeTest-763023849 tempest-AdminActionsNegativeTest-763023849-project-admin] HTTP exception thrown: Invalid state. Valid states: deleting, migrating_to, available, error_deleting, server_migrating, error, migrating, creating. May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-65929265-468d-49b7-800e-20bbbdc7519e tempest-AdminActionsNegativeTest-763023849 tempest-AdminActionsNegativeTest-763023849-project-admin] http://10.27.203.238/share/v2/7c36a466cc2a42b195f921474b0f4de5/share_instances/5ae9ae15-dc00-44c8-891a-9758f2b29855/action returned with HTTP 400 May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 83/185] 10.27.203.238 () {66 vars in 1520 bytes} [Tue May 28 12:56:35 2024] POST /share/v2/7c36a466cc2a42b195f921474b0f4de5/share_instances/5ae9ae15-dc00-44c8-891a-9758f2b29855/action => generated 169 bytes in 5 msecs (HTTP/1.1 400) 6 headers in 240 bytes (1 switches on core 0) May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-bec8533c-a71c-40a4-8181-47bee9f5a794 tempest-ShareTypesAdminNegativeTest-1627064547 tempest-ShareTypesAdminNegativeTest-1627064547-project-admin] GET http://10.27.203.238/share/v2/d0b0ae94b0c5486f9028712057ebacb5/types/a4b4598c-1e75-494e-b544-01e4095f45cb May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-bec8533c-a71c-40a4-8181-47bee9f5a794 tempest-ShareTypesAdminNegativeTest-1627064547 tempest-ShareTypesAdminNegativeTest-1627064547-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-bec8533c-a71c-40a4-8181-47bee9f5a794 tempest-ShareTypesAdminNegativeTest-1627064547 tempest-ShareTypesAdminNegativeTest-1627064547-project-admin] Calling method 'ShareTypesController.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-bec8533c-a71c-40a4-8181-47bee9f5a794 tempest-ShareTypesAdminNegativeTest-1627064547 tempest-ShareTypesAdminNegativeTest-1627064547-project-admin] HTTP exception thrown: Share type not found. May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-bec8533c-a71c-40a4-8181-47bee9f5a794 tempest-ShareTypesAdminNegativeTest-1627064547 tempest-ShareTypesAdminNegativeTest-1627064547-project-admin] http://10.27.203.238/share/v2/d0b0ae94b0c5486f9028712057ebacb5/types/a4b4598c-1e75-494e-b544-01e4095f45cb returned with HTTP 404 May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 103/186] 10.27.203.238 () {64 vars in 1448 bytes} [Tue May 28 12:56:35 2024] GET /share/v2/d0b0ae94b0c5486f9028712057ebacb5/types/a4b4598c-1e75-494e-b544-01e4095f45cb => generated 67 bytes in 11 msecs (HTTP/1.1 404) 6 headers in 237 bytes (2 switches on core 0) May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-78e85f61-3e3f-4c69-8b04-9d4f04cbe773 tempest-AdminActionsNegativeTest-763023849 tempest-AdminActionsNegativeTest-763023849-project-admin] POST http://10.27.203.238/share/v2/7c36a466cc2a42b195f921474b0f4de5/shares/415272bd-25d1-465a-87fc-b0fdbc8c093c/action May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-78e85f61-3e3f-4c69-8b04-9d4f04cbe773 tempest-AdminActionsNegativeTest-763023849 tempest-AdminActionsNegativeTest-763023849-project-admin] Action body: b'{"reset_status": {"status": "fake"}}' {{(pid=98330) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-a96a239c-9acb-4d60-8a5a-40dd124b6d63 tempest-ShareTypesAdminNegativeTest-1627064547 tempest-ShareTypesAdminNegativeTest-1627064547-project-admin] DELETE http://10.27.203.238/share/v2/d0b0ae94b0c5486f9028712057ebacb5/types/464d4b8f-a4d6-45e1-be34-68f5407e2641 May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-78e85f61-3e3f-4c69-8b04-9d4f04cbe773 tempest-AdminActionsNegativeTest-763023849 tempest-AdminActionsNegativeTest-763023849-project-admin] Action: 'action', calling method: Controller.__getattribute__..version_select, body: {"reset_status": {"status": "fake"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-a96a239c-9acb-4d60-8a5a-40dd124b6d63 tempest-ShareTypesAdminNegativeTest-1627064547 tempest-ShareTypesAdminNegativeTest-1627064547-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-a96a239c-9acb-4d60-8a5a-40dd124b6d63 tempest-ShareTypesAdminNegativeTest-1627064547 tempest-ShareTypesAdminNegativeTest-1627064547-project-admin] Calling method 'ShareTypesController._delete' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-78e85f61-3e3f-4c69-8b04-9d4f04cbe773 tempest-AdminActionsNegativeTest-763023849 tempest-AdminActionsNegativeTest-763023849-project-admin] HTTP exception thrown: Invalid state. Valid states: deleting, migrating_to, available, error_deleting, server_migrating, error, migrating, creating. May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-78e85f61-3e3f-4c69-8b04-9d4f04cbe773 tempest-AdminActionsNegativeTest-763023849 tempest-AdminActionsNegativeTest-763023849-project-admin] http://10.27.203.238/share/v2/7c36a466cc2a42b195f921474b0f4de5/shares/415272bd-25d1-465a-87fc-b0fdbc8c093c/action returned with HTTP 400 May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 84/187] 10.27.203.238 () {66 vars in 1493 bytes} [Tue May 28 12:56:35 2024] POST /share/v2/7c36a466cc2a42b195f921474b0f4de5/shares/415272bd-25d1-465a-87fc-b0fdbc8c093c/action => generated 169 bytes in 23 msecs (HTTP/1.1 400) 6 headers in 240 bytes (1 switches on core 0) May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-b1375666-6bec-4735-8aa9-7b11d894932f tempest-AdminActionsNegativeTest-763023849 tempest-AdminActionsNegativeTest-763023849-project-admin] POST http://10.27.203.238/share/v2/7c36a466cc2a42b195f921474b0f4de5/snapshots/330a4554-af48-41d4-8b48-7c7fa0931581/action May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-b1375666-6bec-4735-8aa9-7b11d894932f tempest-AdminActionsNegativeTest-763023849 tempest-AdminActionsNegativeTest-763023849-project-admin] Action body: b'{"reset_status": {"status": "fake"}}' {{(pid=98330) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-b1375666-6bec-4735-8aa9-7b11d894932f tempest-AdminActionsNegativeTest-763023849 tempest-AdminActionsNegativeTest-763023849-project-admin] Action: 'action', calling method: Controller.__getattribute__..version_select, body: {"reset_status": {"status": "fake"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-b1375666-6bec-4735-8aa9-7b11d894932f tempest-AdminActionsNegativeTest-763023849 tempest-AdminActionsNegativeTest-763023849-project-admin] HTTP exception thrown: Invalid state. Valid states: deleting, migrating_to, available, error_deleting, server_migrating, error, migrating, creating. May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-b1375666-6bec-4735-8aa9-7b11d894932f tempest-AdminActionsNegativeTest-763023849 tempest-AdminActionsNegativeTest-763023849-project-admin] http://10.27.203.238/share/v2/7c36a466cc2a42b195f921474b0f4de5/snapshots/330a4554-af48-41d4-8b48-7c7fa0931581/action returned with HTTP 400 May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 85/188] 10.27.203.238 () {66 vars in 1502 bytes} [Tue May 28 12:56:35 2024] POST /share/v2/7c36a466cc2a42b195f921474b0f4de5/snapshots/330a4554-af48-41d4-8b48-7c7fa0931581/action => generated 169 bytes in 5 msecs (HTTP/1.1 400) 6 headers in 240 bytes (2 switches on core 0) May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-a96a239c-9acb-4d60-8a5a-40dd124b6d63 tempest-ShareTypesAdminNegativeTest-1627064547 tempest-ShareTypesAdminNegativeTest-1627064547-project-admin] http://10.27.203.238/share/v2/d0b0ae94b0c5486f9028712057ebacb5/types/464d4b8f-a4d6-45e1-be34-68f5407e2641 returned with HTTP 202 May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 104/189] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:56:35 2024] DELETE /share/v2/d0b0ae94b0c5486f9028712057ebacb5/types/464d4b8f-a4d6-45e1-be34-68f5407e2641 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 6 headers in 243 bytes (2 switches on core 0) May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-b1808b63-2bb9-48db-becb-4d703530ee80 tempest-ShareTypesAdminNegativeTest-1627064547 tempest-ShareTypesAdminNegativeTest-1627064547-project-admin] GET http://10.27.203.238/share/v2/d0b0ae94b0c5486f9028712057ebacb5/types/464d4b8f-a4d6-45e1-be34-68f5407e2641 May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-806b0aa1-31fa-4831-9fdf-910d410a14e3 tempest-AdminActionsNegativeTest-763023849 tempest-AdminActionsNegativeTest-763023849-project-admin] POST http://10.27.203.238/share/v2/7c36a466cc2a42b195f921474b0f4de5/shares/415272bd-25d1-465a-87fc-b0fdbc8c093c/action May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-b1808b63-2bb9-48db-becb-4d703530ee80 tempest-ShareTypesAdminNegativeTest-1627064547 tempest-ShareTypesAdminNegativeTest-1627064547-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-806b0aa1-31fa-4831-9fdf-910d410a14e3 tempest-AdminActionsNegativeTest-763023849 tempest-AdminActionsNegativeTest-763023849-project-admin] Action body: b'{"reset_task_state": {"task_state": "fake_state"}}' {{(pid=98329) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-b1808b63-2bb9-48db-becb-4d703530ee80 tempest-ShareTypesAdminNegativeTest-1627064547 tempest-ShareTypesAdminNegativeTest-1627064547-project-admin] Calling method 'ShareTypesController.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-806b0aa1-31fa-4831-9fdf-910d410a14e3 tempest-AdminActionsNegativeTest-763023849 tempest-AdminActionsNegativeTest-763023849-project-admin] Action: 'action', calling method: ShareController.reset_task_state, body: {"reset_task_state": {"task_state": "fake_state"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-b1808b63-2bb9-48db-becb-4d703530ee80 tempest-ShareTypesAdminNegativeTest-1627064547 tempest-ShareTypesAdminNegativeTest-1627064547-project-admin] HTTP exception thrown: Share type not found. May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-b1808b63-2bb9-48db-becb-4d703530ee80 tempest-ShareTypesAdminNegativeTest-1627064547 tempest-ShareTypesAdminNegativeTest-1627064547-project-admin] http://10.27.203.238/share/v2/d0b0ae94b0c5486f9028712057ebacb5/types/464d4b8f-a4d6-45e1-be34-68f5407e2641 returned with HTTP 404 May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 86/190] 10.27.203.238 () {64 vars in 1448 bytes} [Tue May 28 12:56:35 2024] GET /share/v2/d0b0ae94b0c5486f9028712057ebacb5/types/464d4b8f-a4d6-45e1-be34-68f5407e2641 => generated 67 bytes in 10 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-3fe1fe58-8cc6-4edd-a1d2-acfa593ce560 tempest-ShareTypesAdminNegativeTest-1627064547 tempest-ShareTypesAdminNegativeTest-1627064547-project-admin] DELETE http://10.27.203.238/share/v2/d0b0ae94b0c5486f9028712057ebacb5/types/1c6c966c-975d-4db8-8676-711254e7af36 May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-3fe1fe58-8cc6-4edd-a1d2-acfa593ce560 tempest-ShareTypesAdminNegativeTest-1627064547 tempest-ShareTypesAdminNegativeTest-1627064547-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-3fe1fe58-8cc6-4edd-a1d2-acfa593ce560 tempest-ShareTypesAdminNegativeTest-1627064547 tempest-ShareTypesAdminNegativeTest-1627064547-project-admin] Calling method 'ShareTypesController._delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-806b0aa1-31fa-4831-9fdf-910d410a14e3 tempest-AdminActionsNegativeTest-763023849 tempest-AdminActionsNegativeTest-763023849-project-admin] HTTP exception thrown: Invalid state. Valid states: migration_completing, migration_driver_in_progress, migration_starting, data_copying_starting, migration_error, migration_driver_phase1_done, data_copying_cancelled, data_copying_error, migration_in_progress, None, data_copying_completed, migration_success, data_copying_completing, migration_cancelled, data_copying_in_progress. May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-806b0aa1-31fa-4831-9fdf-910d410a14e3 tempest-AdminActionsNegativeTest-763023849 tempest-AdminActionsNegativeTest-763023849-project-admin] http://10.27.203.238/share/v2/7c36a466cc2a42b195f921474b0f4de5/shares/415272bd-25d1-465a-87fc-b0fdbc8c093c/action returned with HTTP 400 May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 105/191] 10.27.203.238 () {68 vars in 1541 bytes} [Tue May 28 12:56:35 2024] POST /share/v2/7c36a466cc2a42b195f921474b0f4de5/shares/415272bd-25d1-465a-87fc-b0fdbc8c093c/action => generated 402 bytes in 26 msecs (HTTP/1.1 400) 7 headers in 283 bytes (2 switches on core 0) May 28 12:56:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d580ed-e916-4847-b242-196470cf4544 tempest-ShareTypesAdminNegativeTest-1627064547 tempest-ShareTypesAdminNegativeTest-1627064547-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-09d580ed-e916-4847-b242-196470cf4544 tempest-ShareTypesAdminNegativeTest-1627064547 tempest-ShareTypesAdminNegativeTest-1627064547-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d580ed-e916-4847-b242-196470cf4544 tempest-ShareTypesAdminNegativeTest-1627064547 tempest-ShareTypesAdminNegativeTest-1627064547-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-3fe1fe58-8cc6-4edd-a1d2-acfa593ce560 tempest-ShareTypesAdminNegativeTest-1627064547 tempest-ShareTypesAdminNegativeTest-1627064547-project-admin] http://10.27.203.238/share/v2/d0b0ae94b0c5486f9028712057ebacb5/types/1c6c966c-975d-4db8-8676-711254e7af36 returned with HTTP 202 May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 87/192] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:56:35 2024] DELETE /share/v2/d0b0ae94b0c5486f9028712057ebacb5/types/1c6c966c-975d-4db8-8676-711254e7af36 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-c61604ee-0d53-4e49-a114-51c1d0bd5a2c tempest-ShareTypesAdminNegativeTest-1627064547 tempest-ShareTypesAdminNegativeTest-1627064547-project-admin] GET http://10.27.203.238/share/v2/d0b0ae94b0c5486f9028712057ebacb5/types/1c6c966c-975d-4db8-8676-711254e7af36 May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-c61604ee-0d53-4e49-a114-51c1d0bd5a2c tempest-ShareTypesAdminNegativeTest-1627064547 tempest-ShareTypesAdminNegativeTest-1627064547-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-c61604ee-0d53-4e49-a114-51c1d0bd5a2c tempest-ShareTypesAdminNegativeTest-1627064547 tempest-ShareTypesAdminNegativeTest-1627064547-project-admin] Calling method 'ShareTypesController.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-c61604ee-0d53-4e49-a114-51c1d0bd5a2c tempest-ShareTypesAdminNegativeTest-1627064547 tempest-ShareTypesAdminNegativeTest-1627064547-project-admin] HTTP exception thrown: Share type not found. May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-c61604ee-0d53-4e49-a114-51c1d0bd5a2c tempest-ShareTypesAdminNegativeTest-1627064547 tempest-ShareTypesAdminNegativeTest-1627064547-project-admin] http://10.27.203.238/share/v2/d0b0ae94b0c5486f9028712057ebacb5/types/1c6c966c-975d-4db8-8676-711254e7af36 returned with HTTP 404 May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 88/193] 10.27.203.238 () {64 vars in 1448 bytes} [Tue May 28 12:56:35 2024] GET /share/v2/d0b0ae94b0c5486f9028712057ebacb5/types/1c6c966c-975d-4db8-8676-711254e7af36 => generated 67 bytes in 9 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-37844283-21f0-4a96-abb7-cc2501d11daa tempest-ShareTypesAdminNegativeTest-1627064547 tempest-ShareTypesAdminNegativeTest-1627064547-project-admin] DELETE http://10.27.203.238/share/v2/d0b0ae94b0c5486f9028712057ebacb5/types/c6854d67-4ef8-4cfb-9af5-e3cd2d5bb434 May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-37844283-21f0-4a96-abb7-cc2501d11daa tempest-ShareTypesAdminNegativeTest-1627064547 tempest-ShareTypesAdminNegativeTest-1627064547-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc5199e-67f5-4072-99a3-0729c0f6575b service manila] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f110cf6300f049c897d0aab63218d1e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-37844283-21f0-4a96-abb7-cc2501d11daa tempest-ShareTypesAdminNegativeTest-1627064547 tempest-ShareTypesAdminNegativeTest-1627064547-project-admin] Calling method 'ShareTypesController._delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc5199e-67f5-4072-99a3-0729c0f6575b service manila] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc5199e-67f5-4072-99a3-0729c0f6575b service manila] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc5199e-67f5-4072-99a3-0729c0f6575b service manila] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-8cc5199e-67f5-4072-99a3-0729c0f6575b service manila] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-37844283-21f0-4a96-abb7-cc2501d11daa tempest-ShareTypesAdminNegativeTest-1627064547 tempest-ShareTypesAdminNegativeTest-1627064547-project-admin] http://10.27.203.238/share/v2/d0b0ae94b0c5486f9028712057ebacb5/types/c6854d67-4ef8-4cfb-9af5-e3cd2d5bb434 returned with HTTP 202 May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 89/194] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:56:35 2024] DELETE /share/v2/d0b0ae94b0c5486f9028712057ebacb5/types/c6854d67-4ef8-4cfb-9af5-e3cd2d5bb434 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-5dba2dce-0bc1-4131-9c38-e242e89b0aad tempest-ShareTypesAdminNegativeTest-1627064547 tempest-ShareTypesAdminNegativeTest-1627064547-project-admin] GET http://10.27.203.238/share/v2/d0b0ae94b0c5486f9028712057ebacb5/types/c6854d67-4ef8-4cfb-9af5-e3cd2d5bb434 May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-5dba2dce-0bc1-4131-9c38-e242e89b0aad tempest-ShareTypesAdminNegativeTest-1627064547 tempest-ShareTypesAdminNegativeTest-1627064547-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-5dba2dce-0bc1-4131-9c38-e242e89b0aad tempest-ShareTypesAdminNegativeTest-1627064547 tempest-ShareTypesAdminNegativeTest-1627064547-project-admin] Calling method 'ShareTypesController.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc5199e-67f5-4072-99a3-0729c0f6575b service manila] RBAC: Authorizing `identity:validate_token()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc5199e-67f5-4072-99a3-0729c0f6575b service manila] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-5dba2dce-0bc1-4131-9c38-e242e89b0aad tempest-ShareTypesAdminNegativeTest-1627064547 tempest-ShareTypesAdminNegativeTest-1627064547-project-admin] HTTP exception thrown: Share type not found. May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-5dba2dce-0bc1-4131-9c38-e242e89b0aad tempest-ShareTypesAdminNegativeTest-1627064547 tempest-ShareTypesAdminNegativeTest-1627064547-project-admin] http://10.27.203.238/share/v2/d0b0ae94b0c5486f9028712057ebacb5/types/c6854d67-4ef8-4cfb-9af5-e3cd2d5bb434 returned with HTTP 404 May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 90/195] 10.27.203.238 () {64 vars in 1448 bytes} [Tue May 28 12:56:35 2024] GET /share/v2/d0b0ae94b0c5486f9028712057ebacb5/types/c6854d67-4ef8-4cfb-9af5-e3cd2d5bb434 => generated 67 bytes in 10 msecs (HTTP/1.1 404) 6 headers in 237 bytes (2 switches on core 0) May 28 12:56:35 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 743/1502] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 12:56:35 2024] GET /identity/v3/auth/tokens => generated 3958 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 12:56:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53a4a79-f5a2-47eb-a38b-d67c46253c7a tempest-ShareTypesAdminNegativeTest-1627064547 tempest-ShareTypesAdminNegativeTest-1627064547-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-f53a4a79-f5a2-47eb-a38b-d67c46253c7a tempest-ShareTypesAdminNegativeTest-1627064547 tempest-ShareTypesAdminNegativeTest-1627064547-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-6fc29df4-85dd-4f6a-ab1f-db36602365db tempest-AdminActionsNegativeTest-1149948660 tempest-AdminActionsNegativeTest-1149948660-project-member] POST http://10.27.203.238/share/v2/f65d9e20f04c46548e43d5b813dea402/share_instances/5ae9ae15-dc00-44c8-891a-9758f2b29855/action May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-6fc29df4-85dd-4f6a-ab1f-db36602365db tempest-AdminActionsNegativeTest-1149948660 tempest-AdminActionsNegativeTest-1149948660-project-member] Action body: b'{"force_delete": null}' {{(pid=98329) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-6fc29df4-85dd-4f6a-ab1f-db36602365db tempest-AdminActionsNegativeTest-1149948660 tempest-AdminActionsNegativeTest-1149948660-project-member] Action: 'action', calling method: ShareInstancesController.instance_force_delete, body: {"force_delete": null} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.policy [None req-6fc29df4-85dd-4f6a-ab1f-db36602365db tempest-AdminActionsNegativeTest-1149948660 tempest-AdminActionsNegativeTest-1149948660-project-member] Policy check for share_instance:force_delete failed with credentials {'is_admin': False, 'user_id': 'd39535fed98e4d65bc3b89975b5f70f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65d9e20f04c46548e43d5b813dea402', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98329) authorize /opt/stack/manila/manila/policy.py:208}} May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-6fc29df4-85dd-4f6a-ab1f-db36602365db tempest-AdminActionsNegativeTest-1149948660 tempest-AdminActionsNegativeTest-1149948660-project-member] HTTP exception thrown: Access was denied to this resource. May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-6fc29df4-85dd-4f6a-ab1f-db36602365db tempest-AdminActionsNegativeTest-1149948660 tempest-AdminActionsNegativeTest-1149948660-project-member] http://10.27.203.238/share/v2/f65d9e20f04c46548e43d5b813dea402/share_instances/5ae9ae15-dc00-44c8-891a-9758f2b29855/action returned with HTTP 403 May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 106/196] 10.27.203.238 () {66 vars in 1520 bytes} [Tue May 28 12:56:35 2024] POST /share/v2/f65d9e20f04c46548e43d5b813dea402/share_instances/5ae9ae15-dc00-44c8-891a-9758f2b29855/action => generated 78 bytes in 104 msecs (HTTP/1.1 403) 6 headers in 237 bytes (2 switches on core 0) May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-36b88400-9b58-47a8-a935-94ef8e13fc31 tempest-AdminActionsNegativeTest-1149948660 tempest-AdminActionsNegativeTest-1149948660-project-member] POST http://10.27.203.238/share/v2/f65d9e20f04c46548e43d5b813dea402/shares/415272bd-25d1-465a-87fc-b0fdbc8c093c/action May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-36b88400-9b58-47a8-a935-94ef8e13fc31 tempest-AdminActionsNegativeTest-1149948660 tempest-AdminActionsNegativeTest-1149948660-project-member] Action body: b'{"force_delete": null}' {{(pid=98330) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-36b88400-9b58-47a8-a935-94ef8e13fc31 tempest-AdminActionsNegativeTest-1149948660 tempest-AdminActionsNegativeTest-1149948660-project-member] Action: 'action', calling method: ShareController.share_force_delete, body: {"force_delete": null} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.policy [None req-36b88400-9b58-47a8-a935-94ef8e13fc31 tempest-AdminActionsNegativeTest-1149948660 tempest-AdminActionsNegativeTest-1149948660-project-member] Policy check for share:force_delete failed with credentials {'is_admin': False, 'user_id': 'd39535fed98e4d65bc3b89975b5f70f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65d9e20f04c46548e43d5b813dea402', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98330) authorize /opt/stack/manila/manila/policy.py:208}} May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-36b88400-9b58-47a8-a935-94ef8e13fc31 tempest-AdminActionsNegativeTest-1149948660 tempest-AdminActionsNegativeTest-1149948660-project-member] HTTP exception thrown: Access was denied to this resource. May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-36b88400-9b58-47a8-a935-94ef8e13fc31 tempest-AdminActionsNegativeTest-1149948660 tempest-AdminActionsNegativeTest-1149948660-project-member] http://10.27.203.238/share/v2/f65d9e20f04c46548e43d5b813dea402/shares/415272bd-25d1-465a-87fc-b0fdbc8c093c/action returned with HTTP 403 May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 91/197] 10.27.203.238 () {66 vars in 1493 bytes} [Tue May 28 12:56:35 2024] POST /share/v2/f65d9e20f04c46548e43d5b813dea402/shares/415272bd-25d1-465a-87fc-b0fdbc8c093c/action => generated 78 bytes in 6 msecs (HTTP/1.1 403) 6 headers in 237 bytes (1 switches on core 0) May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-abb11821-eb92-43c1-9185-47e1ab657543 tempest-AdminActionsNegativeTest-1149948660 tempest-AdminActionsNegativeTest-1149948660-project-member] POST http://10.27.203.238/share/v2/f65d9e20f04c46548e43d5b813dea402/snapshots/330a4554-af48-41d4-8b48-7c7fa0931581/action May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-abb11821-eb92-43c1-9185-47e1ab657543 tempest-AdminActionsNegativeTest-1149948660 tempest-AdminActionsNegativeTest-1149948660-project-member] Action body: b'{"force_delete": null}' {{(pid=98329) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-abb11821-eb92-43c1-9185-47e1ab657543 tempest-AdminActionsNegativeTest-1149948660 tempest-AdminActionsNegativeTest-1149948660-project-member] Action: 'action', calling method: ShareSnapshotsController.snapshot_force_delete, body: {"force_delete": null} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.policy [None req-abb11821-eb92-43c1-9185-47e1ab657543 tempest-AdminActionsNegativeTest-1149948660 tempest-AdminActionsNegativeTest-1149948660-project-member] Policy check for share_snapshot:force_delete failed with credentials {'is_admin': False, 'user_id': 'd39535fed98e4d65bc3b89975b5f70f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65d9e20f04c46548e43d5b813dea402', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98329) authorize /opt/stack/manila/manila/policy.py:208}} May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-abb11821-eb92-43c1-9185-47e1ab657543 tempest-AdminActionsNegativeTest-1149948660 tempest-AdminActionsNegativeTest-1149948660-project-member] HTTP exception thrown: Access was denied to this resource. May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-abb11821-eb92-43c1-9185-47e1ab657543 tempest-AdminActionsNegativeTest-1149948660 tempest-AdminActionsNegativeTest-1149948660-project-member] http://10.27.203.238/share/v2/f65d9e20f04c46548e43d5b813dea402/snapshots/330a4554-af48-41d4-8b48-7c7fa0931581/action returned with HTTP 403 May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 107/198] 10.27.203.238 () {66 vars in 1502 bytes} [Tue May 28 12:56:35 2024] POST /share/v2/f65d9e20f04c46548e43d5b813dea402/snapshots/330a4554-af48-41d4-8b48-7c7fa0931581/action => generated 78 bytes in 6 msecs (HTTP/1.1 403) 6 headers in 237 bytes (1 switches on core 0) May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-024c3a25-b21f-4f0f-b5ef-f4d05b08c18e tempest-AdminActionsNegativeTest-1149948660 tempest-AdminActionsNegativeTest-1149948660-project-member] GET http://10.27.203.238/share/v2/f65d9e20f04c46548e43d5b813dea402/shares/415272bd-25d1-465a-87fc-b0fdbc8c093c/instances May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-024c3a25-b21f-4f0f-b5ef-f4d05b08c18e tempest-AdminActionsNegativeTest-1149948660 tempest-AdminActionsNegativeTest-1149948660-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-024c3a25-b21f-4f0f-b5ef-f4d05b08c18e tempest-AdminActionsNegativeTest-1149948660 tempest-AdminActionsNegativeTest-1149948660-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.policy [None req-024c3a25-b21f-4f0f-b5ef-f4d05b08c18e tempest-AdminActionsNegativeTest-1149948660 tempest-AdminActionsNegativeTest-1149948660-project-member] Policy check for share_instance:index failed with credentials {'is_admin': False, 'user_id': 'd39535fed98e4d65bc3b89975b5f70f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65d9e20f04c46548e43d5b813dea402', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98330) authorize /opt/stack/manila/manila/policy.py:208}} May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-024c3a25-b21f-4f0f-b5ef-f4d05b08c18e tempest-AdminActionsNegativeTest-1149948660 tempest-AdminActionsNegativeTest-1149948660-project-member] HTTP exception thrown: Access was denied to this resource. May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-024c3a25-b21f-4f0f-b5ef-f4d05b08c18e tempest-AdminActionsNegativeTest-1149948660 tempest-AdminActionsNegativeTest-1149948660-project-member] http://10.27.203.238/share/v2/f65d9e20f04c46548e43d5b813dea402/shares/415272bd-25d1-465a-87fc-b0fdbc8c093c/instances returned with HTTP 403 May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 92/199] 10.27.203.238 () {64 vars in 1481 bytes} [Tue May 28 12:56:35 2024] GET /share/v2/f65d9e20f04c46548e43d5b813dea402/shares/415272bd-25d1-465a-87fc-b0fdbc8c093c/instances => generated 78 bytes in 7 msecs (HTTP/1.1 403) 6 headers in 237 bytes (1 switches on core 0) May 28 12:56:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53a4a79-f5a2-47eb-a38b-d67c46253c7a tempest-ShareTypesAdminNegativeTest-1627064547 tempest-ShareTypesAdminNegativeTest-1627064547-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288ef87d-dce1-471b-8d31-cbc3ce05fcc0 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288ef87d-dce1-471b-8d31-cbc3ce05fcc0 None admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288ef87d-dce1-471b-8d31-cbc3ce05fcc0 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288ef87d-dce1-471b-8d31-cbc3ce05fcc0 None admin] PATH_INFO: `/v3/users/c1f3057b628142deb7b3386d2703a5de` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288ef87d-dce1-471b-8d31-cbc3ce05fcc0 None admin] RBAC: Authorizing `identity:delete_user(user_id=c1f3057b628142deb7b3386d2703a5de)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-b34df9cc-ce28-4de3-9f33-5bf5439d38d0 tempest-AdminActionsNegativeTest-1149948660 tempest-AdminActionsNegativeTest-1149948660-project-member] GET http://10.27.203.238/share/v2/f65d9e20f04c46548e43d5b813dea402/share_instances/5ae9ae15-dc00-44c8-891a-9758f2b29855 May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-b34df9cc-ce28-4de3-9f33-5bf5439d38d0 tempest-AdminActionsNegativeTest-1149948660 tempest-AdminActionsNegativeTest-1149948660-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-b34df9cc-ce28-4de3-9f33-5bf5439d38d0 tempest-AdminActionsNegativeTest-1149948660 tempest-AdminActionsNegativeTest-1149948660-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288ef87d-dce1-471b-8d31-cbc3ce05fcc0 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.policy [None req-b34df9cc-ce28-4de3-9f33-5bf5439d38d0 tempest-AdminActionsNegativeTest-1149948660 tempest-AdminActionsNegativeTest-1149948660-project-member] Policy check for share_instance:show failed with credentials {'is_admin': False, 'user_id': 'd39535fed98e4d65bc3b89975b5f70f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65d9e20f04c46548e43d5b813dea402', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98329) authorize /opt/stack/manila/manila/policy.py:208}} May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-b34df9cc-ce28-4de3-9f33-5bf5439d38d0 tempest-AdminActionsNegativeTest-1149948660 tempest-AdminActionsNegativeTest-1149948660-project-member] HTTP exception thrown: Access was denied to this resource. May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-b34df9cc-ce28-4de3-9f33-5bf5439d38d0 tempest-AdminActionsNegativeTest-1149948660 tempest-AdminActionsNegativeTest-1149948660-project-member] http://10.27.203.238/share/v2/f65d9e20f04c46548e43d5b813dea402/share_instances/5ae9ae15-dc00-44c8-891a-9758f2b29855 returned with HTTP 403 May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 108/200] 10.27.203.238 () {64 vars in 1478 bytes} [Tue May 28 12:56:35 2024] GET /share/v2/f65d9e20f04c46548e43d5b813dea402/share_instances/5ae9ae15-dc00-44c8-891a-9758f2b29855 => generated 78 bytes in 8 msecs (HTTP/1.1 403) 6 headers in 237 bytes (1 switches on core 0) May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-0afa53b1-aa53-4169-a330-c200210f632a tempest-AdminActionsNegativeTest-1149948660 tempest-AdminActionsNegativeTest-1149948660-project-member] POST http://10.27.203.238/share/v2/f65d9e20f04c46548e43d5b813dea402/share_instances/5ae9ae15-dc00-44c8-891a-9758f2b29855/action May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-0afa53b1-aa53-4169-a330-c200210f632a tempest-AdminActionsNegativeTest-1149948660 tempest-AdminActionsNegativeTest-1149948660-project-member] Action body: b'{"reset_status": {"status": "error"}}' {{(pid=98330) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-0afa53b1-aa53-4169-a330-c200210f632a tempest-AdminActionsNegativeTest-1149948660 tempest-AdminActionsNegativeTest-1149948660-project-member] Action: 'action', calling method: ShareInstancesController.instance_reset_status, body: {"reset_status": {"status": "error"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.policy [None req-0afa53b1-aa53-4169-a330-c200210f632a tempest-AdminActionsNegativeTest-1149948660 tempest-AdminActionsNegativeTest-1149948660-project-member] Policy check for share_instance:reset_status failed with credentials {'is_admin': False, 'user_id': 'd39535fed98e4d65bc3b89975b5f70f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65d9e20f04c46548e43d5b813dea402', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98330) authorize /opt/stack/manila/manila/policy.py:208}} May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-0afa53b1-aa53-4169-a330-c200210f632a tempest-AdminActionsNegativeTest-1149948660 tempest-AdminActionsNegativeTest-1149948660-project-member] HTTP exception thrown: Access was denied to this resource. May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-0afa53b1-aa53-4169-a330-c200210f632a tempest-AdminActionsNegativeTest-1149948660 tempest-AdminActionsNegativeTest-1149948660-project-member] http://10.27.203.238/share/v2/f65d9e20f04c46548e43d5b813dea402/share_instances/5ae9ae15-dc00-44c8-891a-9758f2b29855/action returned with HTTP 403 May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 93/201] 10.27.203.238 () {66 vars in 1520 bytes} [Tue May 28 12:56:35 2024] POST /share/v2/f65d9e20f04c46548e43d5b813dea402/share_instances/5ae9ae15-dc00-44c8-891a-9758f2b29855/action => generated 78 bytes in 7 msecs (HTTP/1.1 403) 6 headers in 237 bytes (1 switches on core 0) May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-e43dda89-4b4d-4711-b754-4dbbce9e3981 tempest-AdminActionsNegativeTest-1149948660 tempest-AdminActionsNegativeTest-1149948660-project-member] POST http://10.27.203.238/share/v2/f65d9e20f04c46548e43d5b813dea402/shares/415272bd-25d1-465a-87fc-b0fdbc8c093c/action May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-e43dda89-4b4d-4711-b754-4dbbce9e3981 tempest-AdminActionsNegativeTest-1149948660 tempest-AdminActionsNegativeTest-1149948660-project-member] Action body: b'{"reset_status": {"status": "error"}}' {{(pid=98329) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-e43dda89-4b4d-4711-b754-4dbbce9e3981 tempest-AdminActionsNegativeTest-1149948660 tempest-AdminActionsNegativeTest-1149948660-project-member] Action: 'action', calling method: ShareController.share_reset_status, body: {"reset_status": {"status": "error"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.policy [None req-e43dda89-4b4d-4711-b754-4dbbce9e3981 tempest-AdminActionsNegativeTest-1149948660 tempest-AdminActionsNegativeTest-1149948660-project-member] Policy check for share:reset_status failed with credentials {'is_admin': False, 'user_id': 'd39535fed98e4d65bc3b89975b5f70f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65d9e20f04c46548e43d5b813dea402', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98329) authorize /opt/stack/manila/manila/policy.py:208}} May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-e43dda89-4b4d-4711-b754-4dbbce9e3981 tempest-AdminActionsNegativeTest-1149948660 tempest-AdminActionsNegativeTest-1149948660-project-member] HTTP exception thrown: Access was denied to this resource. May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-e43dda89-4b4d-4711-b754-4dbbce9e3981 tempest-AdminActionsNegativeTest-1149948660 tempest-AdminActionsNegativeTest-1149948660-project-member] http://10.27.203.238/share/v2/f65d9e20f04c46548e43d5b813dea402/shares/415272bd-25d1-465a-87fc-b0fdbc8c093c/action returned with HTTP 403 May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 109/202] 10.27.203.238 () {66 vars in 1493 bytes} [Tue May 28 12:56:35 2024] POST /share/v2/f65d9e20f04c46548e43d5b813dea402/shares/415272bd-25d1-465a-87fc-b0fdbc8c093c/action => generated 78 bytes in 7 msecs (HTTP/1.1 403) 6 headers in 237 bytes (1 switches on core 0) May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-4833d80d-5fd7-4007-a495-093117e88af4 tempest-AdminActionsNegativeTest-1149948660 tempest-AdminActionsNegativeTest-1149948660-project-member] POST http://10.27.203.238/share/v2/f65d9e20f04c46548e43d5b813dea402/snapshots/330a4554-af48-41d4-8b48-7c7fa0931581/action May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-4833d80d-5fd7-4007-a495-093117e88af4 tempest-AdminActionsNegativeTest-1149948660 tempest-AdminActionsNegativeTest-1149948660-project-member] Action body: b'{"reset_status": {"status": "error"}}' {{(pid=98330) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-4833d80d-5fd7-4007-a495-093117e88af4 tempest-AdminActionsNegativeTest-1149948660 tempest-AdminActionsNegativeTest-1149948660-project-member] Action: 'action', calling method: ShareSnapshotsController.snapshot_reset_status, body: {"reset_status": {"status": "error"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.policy [None req-4833d80d-5fd7-4007-a495-093117e88af4 tempest-AdminActionsNegativeTest-1149948660 tempest-AdminActionsNegativeTest-1149948660-project-member] Policy check for share_snapshot:reset_status failed with credentials {'is_admin': False, 'user_id': 'd39535fed98e4d65bc3b89975b5f70f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65d9e20f04c46548e43d5b813dea402', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98330) authorize /opt/stack/manila/manila/policy.py:208}} May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-4833d80d-5fd7-4007-a495-093117e88af4 tempest-AdminActionsNegativeTest-1149948660 tempest-AdminActionsNegativeTest-1149948660-project-member] HTTP exception thrown: Access was denied to this resource. May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-4833d80d-5fd7-4007-a495-093117e88af4 tempest-AdminActionsNegativeTest-1149948660 tempest-AdminActionsNegativeTest-1149948660-project-member] http://10.27.203.238/share/v2/f65d9e20f04c46548e43d5b813dea402/snapshots/330a4554-af48-41d4-8b48-7c7fa0931581/action returned with HTTP 403 May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 94/203] 10.27.203.238 () {66 vars in 1502 bytes} [Tue May 28 12:56:35 2024] POST /share/v2/f65d9e20f04c46548e43d5b813dea402/snapshots/330a4554-af48-41d4-8b48-7c7fa0931581/action => generated 78 bytes in 6 msecs (HTTP/1.1 403) 6 headers in 237 bytes (1 switches on core 0) May 28 12:56:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc5199e-67f5-4072-99a3-0729c0f6575b service manila] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-8cc5199e-67f5-4072-99a3-0729c0f6575b service manila] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-288ef87d-dce1-471b-8d31-cbc3ce05fcc0 None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1f3057b628142deb7b3386d2703a5de', 'request_id': 'req-288ef87d-dce1-471b-8d31-cbc3ce05fcc0'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-288ef87d-dce1-471b-8d31-cbc3ce05fcc0 None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1f3057b628142deb7b3386d2703a5de', 'request_id': 'req-288ef87d-dce1-471b-8d31-cbc3ce05fcc0'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-288ef87d-dce1-471b-8d31-cbc3ce05fcc0 None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1f3057b628142deb7b3386d2703a5de', 'request_id': 'req-288ef87d-dce1-471b-8d31-cbc3ce05fcc0'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-288ef87d-dce1-471b-8d31-cbc3ce05fcc0 None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1f3057b628142deb7b3386d2703a5de', 'request_id': 'req-288ef87d-dce1-471b-8d31-cbc3ce05fcc0'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-288ef87d-dce1-471b-8d31-cbc3ce05fcc0 None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1f3057b628142deb7b3386d2703a5de', 'request_id': 'req-288ef87d-dce1-471b-8d31-cbc3ce05fcc0'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:35 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 760/1503] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 12:56:35 2024] DELETE /identity/v3/users/c1f3057b628142deb7b3386d2703a5de => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:56:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288ef87d-dce1-471b-8d31-cbc3ce05fcc0 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-288ef87d-dce1-471b-8d31-cbc3ce05fcc0 None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-fb9f8281-3160-4f16-9106-fa90d51f1ad7 tempest-ShareInstancesTest-1546991288 tempest-ShareInstancesTest-1546991288-project-admin] GET http://10.27.203.238/share/v2/fb2c57cefad04e97a990bd936225014d/shares/2dfffda2-1f3a-4d2e-9044-2255a211a9f0 May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-fb9f8281-3160-4f16-9106-fa90d51f1ad7 tempest-ShareInstancesTest-1546991288 tempest-ShareInstancesTest-1546991288-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-fb9f8281-3160-4f16-9106-fa90d51f1ad7 tempest-ShareInstancesTest-1546991288 tempest-ShareInstancesTest-1546991288-project-admin] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc5199e-67f5-4072-99a3-0729c0f6575b service manila] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-fb9f8281-3160-4f16-9106-fa90d51f1ad7 tempest-ShareInstancesTest-1546991288 tempest-ShareInstancesTest-1546991288-project-admin] http://10.27.203.238/share/v2/fb2c57cefad04e97a990bd936225014d/shares/2dfffda2-1f3a-4d2e-9044-2255a211a9f0 returned with HTTP 200 May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 110/204] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:56:35 2024] GET /share/v2/fb2c57cefad04e97a990bd936225014d/shares/2dfffda2-1f3a-4d2e-9044-2255a211a9f0 => generated 1372 bytes in 25 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:56:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288ef87d-dce1-471b-8d31-cbc3ce05fcc0 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0196c1-06c7-4885-b36c-326a9575ef6c None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0196c1-06c7-4885-b36c-326a9575ef6c None admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0196c1-06c7-4885-b36c-326a9575ef6c None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0196c1-06c7-4885-b36c-326a9575ef6c None admin] PATH_INFO: `/v3/users/3ac8b349ef07449984ca9e0c30f45410` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0196c1-06c7-4885-b36c-326a9575ef6c None admin] RBAC: Authorizing `identity:delete_user(user_id=3ac8b349ef07449984ca9e0c30f45410)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-b6834cc6-37a1-4096-a51c-018ceea56c47 tempest-ShareInstancesTest-1546991288 tempest-ShareInstancesTest-1546991288-project-admin] GET http://10.27.203.238/share/v2/fb2c57cefad04e97a990bd936225014d/shares/2dfffda2-1f3a-4d2e-9044-2255a211a9f0/instances May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-b6834cc6-37a1-4096-a51c-018ceea56c47 tempest-ShareInstancesTest-1546991288 tempest-ShareInstancesTest-1546991288-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0196c1-06c7-4885-b36c-326a9575ef6c None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-b6834cc6-37a1-4096-a51c-018ceea56c47 tempest-ShareInstancesTest-1546991288 tempest-ShareInstancesTest-1546991288-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f76e96d-2488-458a-a2e8-87027b11430a tempest-AdminActionsNegativeTest-763023849 tempest-AdminActionsNegativeTest-763023849-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7aee50b56a654f16a4b22ad15fdd1521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c36a466cc2a42b195f921474b0f4de5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f76e96d-2488-458a-a2e8-87027b11430a tempest-AdminActionsNegativeTest-763023849 tempest-AdminActionsNegativeTest-763023849-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f76e96d-2488-458a-a2e8-87027b11430a tempest-AdminActionsNegativeTest-763023849 tempest-AdminActionsNegativeTest-763023849-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f76e96d-2488-458a-a2e8-87027b11430a tempest-AdminActionsNegativeTest-763023849 tempest-AdminActionsNegativeTest-763023849-project-admin] PATH_INFO: `/v3/users/b9078b0601ac4efa93bdcc390f3d1208` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-b6834cc6-37a1-4096-a51c-018ceea56c47 tempest-ShareInstancesTest-1546991288 tempest-ShareInstancesTest-1546991288-project-admin] http://10.27.203.238/share/v2/fb2c57cefad04e97a990bd936225014d/shares/2dfffda2-1f3a-4d2e-9044-2255a211a9f0/instances returned with HTTP 200 May 28 12:56:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f76e96d-2488-458a-a2e8-87027b11430a tempest-AdminActionsNegativeTest-763023849 tempest-AdminActionsNegativeTest-763023849-project-admin] RBAC: Authorizing `identity:delete_user(user_id=b9078b0601ac4efa93bdcc390f3d1208)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 95/205] 10.27.203.238 () {64 vars in 1480 bytes} [Tue May 28 12:56:35 2024] GET /share/v2/fb2c57cefad04e97a990bd936225014d/shares/2dfffda2-1f3a-4d2e-9044-2255a211a9f0/instances => generated 474 bytes in 23 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:56:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f76e96d-2488-458a-a2e8-87027b11430a tempest-AdminActionsNegativeTest-763023849 tempest-AdminActionsNegativeTest-763023849-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-3d6395be-a1a4-4b99-a1a1-ae2be92d8dbe tempest-ShareInstancesTest-1546991288 tempest-ShareInstancesTest-1546991288-project-admin] GET http://10.27.203.238/share/v2/fb2c57cefad04e97a990bd936225014d/shares/2dfffda2-1f3a-4d2e-9044-2255a211a9f0/instances May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-3d6395be-a1a4-4b99-a1a1-ae2be92d8dbe tempest-ShareInstancesTest-1546991288 tempest-ShareInstancesTest-1546991288-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:35 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-3d6395be-a1a4-4b99-a1a1-ae2be92d8dbe tempest-ShareInstancesTest-1546991288 tempest-ShareInstancesTest-1546991288-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:36 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-3d6395be-a1a4-4b99-a1a1-ae2be92d8dbe tempest-ShareInstancesTest-1546991288 tempest-ShareInstancesTest-1546991288-project-admin] http://10.27.203.238/share/v2/fb2c57cefad04e97a990bd936225014d/shares/2dfffda2-1f3a-4d2e-9044-2255a211a9f0/instances returned with HTTP 200 May 28 12:56:36 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 111/206] 10.27.203.238 () {64 vars in 1480 bytes} [Tue May 28 12:56:35 2024] GET /share/v2/fb2c57cefad04e97a990bd936225014d/shares/2dfffda2-1f3a-4d2e-9044-2255a211a9f0/instances => generated 474 bytes in 24 msecs (HTTP/1.1 200) 6 headers in 230 bytes (2 switches on core 0) May 28 12:56:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-9f0196c1-06c7-4885-b36c-326a9575ef6c None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ac8b349ef07449984ca9e0c30f45410', 'request_id': 'req-9f0196c1-06c7-4885-b36c-326a9575ef6c'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:36 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-db36707c-77f6-4115-925d-fad47fbb6ae1 tempest-ShareInstancesTest-1546991288 tempest-ShareInstancesTest-1546991288-project-admin] GET http://10.27.203.238/share/v2/fb2c57cefad04e97a990bd936225014d/share_instances/7f6a42fa-4d45-471e-a438-36876fc6eac8 May 28 12:56:36 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-db36707c-77f6-4115-925d-fad47fbb6ae1 tempest-ShareInstancesTest-1546991288 tempest-ShareInstancesTest-1546991288-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:36 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-db36707c-77f6-4115-925d-fad47fbb6ae1 tempest-ShareInstancesTest-1546991288 tempest-ShareInstancesTest-1546991288-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-9f0196c1-06c7-4885-b36c-326a9575ef6c None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ac8b349ef07449984ca9e0c30f45410', 'request_id': 'req-9f0196c1-06c7-4885-b36c-326a9575ef6c'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-9f0196c1-06c7-4885-b36c-326a9575ef6c None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ac8b349ef07449984ca9e0c30f45410', 'request_id': 'req-9f0196c1-06c7-4885-b36c-326a9575ef6c'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-9f0196c1-06c7-4885-b36c-326a9575ef6c None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ac8b349ef07449984ca9e0c30f45410', 'request_id': 'req-9f0196c1-06c7-4885-b36c-326a9575ef6c'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:36 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-db36707c-77f6-4115-925d-fad47fbb6ae1 tempest-ShareInstancesTest-1546991288 tempest-ShareInstancesTest-1546991288-project-admin] http://10.27.203.238/share/v2/fb2c57cefad04e97a990bd936225014d/share_instances/7f6a42fa-4d45-471e-a438-36876fc6eac8 returned with HTTP 200 May 28 12:56:36 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 96/207] 10.27.203.238 () {64 vars in 1477 bytes} [Tue May 28 12:56:36 2024] GET /share/v2/fb2c57cefad04e97a990bd936225014d/share_instances/7f6a42fa-4d45-471e-a438-36876fc6eac8 => generated 471 bytes in 15 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:56:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-9f0196c1-06c7-4885-b36c-326a9575ef6c None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ac8b349ef07449984ca9e0c30f45410', 'request_id': 'req-9f0196c1-06c7-4885-b36c-326a9575ef6c'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-4f76e96d-2488-458a-a2e8-87027b11430a tempest-AdminActionsNegativeTest-763023849 tempest-AdminActionsNegativeTest-763023849-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9078b0601ac4efa93bdcc390f3d1208', 'request_id': 'req-4f76e96d-2488-458a-a2e8-87027b11430a'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:36 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-f5b77cfc-024e-41c1-bf8e-2a42dcda3960 tempest-ShareInstancesTest-1546991288 tempest-ShareInstancesTest-1546991288-project-admin] GET http://10.27.203.238/share/v2/fb2c57cefad04e97a990bd936225014d/shares/2dfffda2-1f3a-4d2e-9044-2255a211a9f0/instances May 28 12:56:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-4f76e96d-2488-458a-a2e8-87027b11430a tempest-AdminActionsNegativeTest-763023849 tempest-AdminActionsNegativeTest-763023849-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9078b0601ac4efa93bdcc390f3d1208', 'request_id': 'req-4f76e96d-2488-458a-a2e8-87027b11430a'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:36 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-f5b77cfc-024e-41c1-bf8e-2a42dcda3960 tempest-ShareInstancesTest-1546991288 tempest-ShareInstancesTest-1546991288-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:36 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-f5b77cfc-024e-41c1-bf8e-2a42dcda3960 tempest-ShareInstancesTest-1546991288 tempest-ShareInstancesTest-1546991288-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-4f76e96d-2488-458a-a2e8-87027b11430a tempest-AdminActionsNegativeTest-763023849 tempest-AdminActionsNegativeTest-763023849-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9078b0601ac4efa93bdcc390f3d1208', 'request_id': 'req-4f76e96d-2488-458a-a2e8-87027b11430a'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:36 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 761/1504] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 12:56:35 2024] DELETE /identity/v3/users/3ac8b349ef07449984ca9e0c30f45410 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 28 12:56:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0196c1-06c7-4885-b36c-326a9575ef6c None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-4f76e96d-2488-458a-a2e8-87027b11430a tempest-AdminActionsNegativeTest-763023849 tempest-AdminActionsNegativeTest-763023849-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9078b0601ac4efa93bdcc390f3d1208', 'request_id': 'req-4f76e96d-2488-458a-a2e8-87027b11430a'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-4f76e96d-2488-458a-a2e8-87027b11430a tempest-AdminActionsNegativeTest-763023849 tempest-AdminActionsNegativeTest-763023849-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9078b0601ac4efa93bdcc390f3d1208', 'request_id': 'req-4f76e96d-2488-458a-a2e8-87027b11430a'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-9f0196c1-06c7-4885-b36c-326a9575ef6c None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:36 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-f5b77cfc-024e-41c1-bf8e-2a42dcda3960 tempest-ShareInstancesTest-1546991288 tempest-ShareInstancesTest-1546991288-project-admin] http://10.27.203.238/share/v2/fb2c57cefad04e97a990bd936225014d/shares/2dfffda2-1f3a-4d2e-9044-2255a211a9f0/instances returned with HTTP 200 May 28 12:56:36 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 112/208] 10.27.203.238 () {64 vars in 1480 bytes} [Tue May 28 12:56:36 2024] GET /share/v2/fb2c57cefad04e97a990bd936225014d/shares/2dfffda2-1f3a-4d2e-9044-2255a211a9f0/instances => generated 299 bytes in 25 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:56:36 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 744/1505] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 12:56:35 2024] DELETE /identity/v3/users/b9078b0601ac4efa93bdcc390f3d1208 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:56:36 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-c87ba54b-43c0-4a99-bf7f-601a65c9779e tempest-ShareInstancesTest-1546991288 tempest-ShareInstancesTest-1546991288-project-admin] GET http://10.27.203.238/share/v2/fb2c57cefad04e97a990bd936225014d/share_instances/7f6a42fa-4d45-471e-a438-36876fc6eac8 May 28 12:56:36 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-c87ba54b-43c0-4a99-bf7f-601a65c9779e tempest-ShareInstancesTest-1546991288 tempest-ShareInstancesTest-1546991288-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:36 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-c87ba54b-43c0-4a99-bf7f-601a65c9779e tempest-ShareInstancesTest-1546991288 tempest-ShareInstancesTest-1546991288-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:36 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-af8708ad-a253-409a-9d16-73df554028fe tempest-AdminActionsNegativeTest-763023849 tempest-AdminActionsNegativeTest-763023849-project-admin] DELETE http://10.27.203.238/share/v2/7c36a466cc2a42b195f921474b0f4de5/snapshots/330a4554-af48-41d4-8b48-7c7fa0931581 May 28 12:56:36 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-af8708ad-a253-409a-9d16-73df554028fe tempest-AdminActionsNegativeTest-763023849 tempest-AdminActionsNegativeTest-763023849-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:36 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-af8708ad-a253-409a-9d16-73df554028fe tempest-AdminActionsNegativeTest-763023849 tempest-AdminActionsNegativeTest-763023849-project-admin] Calling method 'ShareSnapshotMixin.delete' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:36 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.v1.share_snapshots [None req-af8708ad-a253-409a-9d16-73df554028fe tempest-AdminActionsNegativeTest-763023849 tempest-AdminActionsNegativeTest-763023849-project-admin] Delete snapshot with id: 330a4554-af48-41d4-8b48-7c7fa0931581 May 28 12:56:36 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.periodic_task [None req-51f4229a-f349-47fa-92eb-6fc5f8342c9d None None] Running periodic task SchedulerManager._expire_reservations {{(pid=98327) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:56:36 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-c87ba54b-43c0-4a99-bf7f-601a65c9779e tempest-ShareInstancesTest-1546991288 tempest-ShareInstancesTest-1546991288-project-admin] http://10.27.203.238/share/v2/fb2c57cefad04e97a990bd936225014d/share_instances/7f6a42fa-4d45-471e-a438-36876fc6eac8 returned with HTTP 200 May 28 12:56:36 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 97/209] 10.27.203.238 () {64 vars in 1477 bytes} [Tue May 28 12:56:36 2024] GET /share/v2/fb2c57cefad04e97a990bd936225014d/share_instances/7f6a42fa-4d45-471e-a438-36876fc6eac8 => generated 296 bytes in 16 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:56:36 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.periodic_task [None req-51f4229a-f349-47fa-92eb-6fc5f8342c9d None None] Running periodic task SchedulerManager._clean_expired_messages {{(pid=98327) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:56:36 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.coordination [None req-51f4229a-f349-47fa-92eb-6fc5f8342c9d None None] Lock "locked-clean-expired-messages" acquired by "_clean_expired_messages". {{(pid=98327) _synchronized /opt/stack/manila/manila/coordination.py:199}} May 28 12:56:36 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-73387e9d-1544-483f-89b0-e86499cb4e03 tempest-ShareInstancesTest-1546991288 tempest-ShareInstancesTest-1546991288-project-admin] GET http://10.27.203.238/share/v2/fb2c57cefad04e97a990bd936225014d/shares/2dfffda2-1f3a-4d2e-9044-2255a211a9f0/instances May 28 12:56:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0196c1-06c7-4885-b36c-326a9575ef6c None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:36 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-73387e9d-1544-483f-89b0-e86499cb4e03 tempest-ShareInstancesTest-1546991288 tempest-ShareInstancesTest-1546991288-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:36 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-73387e9d-1544-483f-89b0-e86499cb4e03 tempest-ShareInstancesTest-1546991288 tempest-ShareInstancesTest-1546991288-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:36 l75lg1-v1 manila-scheduler[98327]: INFO manila.message.api [None req-51f4229a-f349-47fa-92eb-6fc5f8342c9d None None] Deleted 0 expired messages. May 28 12:56:36 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-73387e9d-1544-483f-89b0-e86499cb4e03 tempest-ShareInstancesTest-1546991288 tempest-ShareInstancesTest-1546991288-project-admin] http://10.27.203.238/share/v2/fb2c57cefad04e97a990bd936225014d/shares/2dfffda2-1f3a-4d2e-9044-2255a211a9f0/instances returned with HTTP 200 May 28 12:56:36 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 98/210] 10.27.203.238 () {64 vars in 1481 bytes} [Tue May 28 12:56:36 2024] GET /share/v2/fb2c57cefad04e97a990bd936225014d/shares/2dfffda2-1f3a-4d2e-9044-2255a211a9f0/instances => generated 332 bytes in 26 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:56:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575e161a-c9de-4cbd-b14c-ce0ec579c2fb None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575e161a-c9de-4cbd-b14c-ce0ec579c2fb None admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:36 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-07e7c147-f1ed-4bb9-935f-3fe50e2031b5 tempest-ShareInstancesTest-1546991288 tempest-ShareInstancesTest-1546991288-project-admin] GET http://10.27.203.238/share/v2/fb2c57cefad04e97a990bd936225014d/share_instances/7f6a42fa-4d45-471e-a438-36876fc6eac8 May 28 12:56:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575e161a-c9de-4cbd-b14c-ce0ec579c2fb None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575e161a-c9de-4cbd-b14c-ce0ec579c2fb None admin] PATH_INFO: `/v3/users/9cd0d153d5584483989830faec045a2d` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:36 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-07e7c147-f1ed-4bb9-935f-3fe50e2031b5 tempest-ShareInstancesTest-1546991288 tempest-ShareInstancesTest-1546991288-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:36 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-07e7c147-f1ed-4bb9-935f-3fe50e2031b5 tempest-ShareInstancesTest-1546991288 tempest-ShareInstancesTest-1546991288-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575e161a-c9de-4cbd-b14c-ce0ec579c2fb None admin] RBAC: Authorizing `identity:delete_user(user_id=9cd0d153d5584483989830faec045a2d)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575e161a-c9de-4cbd-b14c-ce0ec579c2fb None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:36 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-07e7c147-f1ed-4bb9-935f-3fe50e2031b5 tempest-ShareInstancesTest-1546991288 tempest-ShareInstancesTest-1546991288-project-admin] http://10.27.203.238/share/v2/fb2c57cefad04e97a990bd936225014d/share_instances/7f6a42fa-4d45-471e-a438-36876fc6eac8 returned with HTTP 200 May 28 12:56:36 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 99/211] 10.27.203.238 () {64 vars in 1478 bytes} [Tue May 28 12:56:36 2024] GET /share/v2/fb2c57cefad04e97a990bd936225014d/share_instances/7f6a42fa-4d45-471e-a438-36876fc6eac8 => generated 329 bytes in 14 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:56:36 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-f58da3fa-6a04-40f1-b688-e1b0a4c17924 tempest-ShareInstancesTest-1546991288 tempest-ShareInstancesTest-1546991288-project-admin] GET http://10.27.203.238/share/v2/fb2c57cefad04e97a990bd936225014d/shares/2dfffda2-1f3a-4d2e-9044-2255a211a9f0/instances May 28 12:56:36 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-f58da3fa-6a04-40f1-b688-e1b0a4c17924 tempest-ShareInstancesTest-1546991288 tempest-ShareInstancesTest-1546991288-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:36 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-f58da3fa-6a04-40f1-b688-e1b0a4c17924 tempest-ShareInstancesTest-1546991288 tempest-ShareInstancesTest-1546991288-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:36 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-f58da3fa-6a04-40f1-b688-e1b0a4c17924 tempest-ShareInstancesTest-1546991288 tempest-ShareInstancesTest-1546991288-project-admin] http://10.27.203.238/share/v2/fb2c57cefad04e97a990bd936225014d/shares/2dfffda2-1f3a-4d2e-9044-2255a211a9f0/instances returned with HTTP 200 May 28 12:56:36 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 100/212] 10.27.203.238 () {64 vars in 1481 bytes} [Tue May 28 12:56:36 2024] GET /share/v2/fb2c57cefad04e97a990bd936225014d/shares/2dfffda2-1f3a-4d2e-9044-2255a211a9f0/instances => generated 445 bytes in 25 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:56:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-575e161a-c9de-4cbd-b14c-ce0ec579c2fb None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9cd0d153d5584483989830faec045a2d', 'request_id': 'req-575e161a-c9de-4cbd-b14c-ce0ec579c2fb'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:36 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-550fde56-1412-4a88-a90c-50e9a18fd15e tempest-ShareInstancesTest-1546991288 tempest-ShareInstancesTest-1546991288-project-admin] GET http://10.27.203.238/share/v2/fb2c57cefad04e97a990bd936225014d/share_instances/7f6a42fa-4d45-471e-a438-36876fc6eac8 May 28 12:56:36 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-550fde56-1412-4a88-a90c-50e9a18fd15e tempest-ShareInstancesTest-1546991288 tempest-ShareInstancesTest-1546991288-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:36 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-550fde56-1412-4a88-a90c-50e9a18fd15e tempest-ShareInstancesTest-1546991288 tempest-ShareInstancesTest-1546991288-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-575e161a-c9de-4cbd-b14c-ce0ec579c2fb None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9cd0d153d5584483989830faec045a2d', 'request_id': 'req-575e161a-c9de-4cbd-b14c-ce0ec579c2fb'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-575e161a-c9de-4cbd-b14c-ce0ec579c2fb None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9cd0d153d5584483989830faec045a2d', 'request_id': 'req-575e161a-c9de-4cbd-b14c-ce0ec579c2fb'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-575e161a-c9de-4cbd-b14c-ce0ec579c2fb None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9cd0d153d5584483989830faec045a2d', 'request_id': 'req-575e161a-c9de-4cbd-b14c-ce0ec579c2fb'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:36 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-550fde56-1412-4a88-a90c-50e9a18fd15e tempest-ShareInstancesTest-1546991288 tempest-ShareInstancesTest-1546991288-project-admin] http://10.27.203.238/share/v2/fb2c57cefad04e97a990bd936225014d/share_instances/7f6a42fa-4d45-471e-a438-36876fc6eac8 returned with HTTP 200 May 28 12:56:36 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 101/213] 10.27.203.238 () {64 vars in 1478 bytes} [Tue May 28 12:56:36 2024] GET /share/v2/fb2c57cefad04e97a990bd936225014d/share_instances/7f6a42fa-4d45-471e-a438-36876fc6eac8 => generated 442 bytes in 15 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:56:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-575e161a-c9de-4cbd-b14c-ce0ec579c2fb None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9cd0d153d5584483989830faec045a2d', 'request_id': 'req-575e161a-c9de-4cbd-b14c-ce0ec579c2fb'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:36 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-69bcfaf0-5766-40a8-ae3d-e4288cad2958 tempest-ShareInstancesTest-1546991288 tempest-ShareInstancesTest-1546991288-project-admin] GET http://10.27.203.238/share/v2/fb2c57cefad04e97a990bd936225014d/shares/2dfffda2-1f3a-4d2e-9044-2255a211a9f0/instances May 28 12:56:36 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-69bcfaf0-5766-40a8-ae3d-e4288cad2958 tempest-ShareInstancesTest-1546991288 tempest-ShareInstancesTest-1546991288-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:36 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-69bcfaf0-5766-40a8-ae3d-e4288cad2958 tempest-ShareInstancesTest-1546991288 tempest-ShareInstancesTest-1546991288-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:36 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 762/1506] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 12:56:36 2024] DELETE /identity/v3/users/9cd0d153d5584483989830faec045a2d => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:56:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cc92a0-4ad1-468f-85e0-cc350308928f None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cc92a0-4ad1-468f-85e0-cc350308928f None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cc92a0-4ad1-468f-85e0-cc350308928f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:36 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-69bcfaf0-5766-40a8-ae3d-e4288cad2958 tempest-ShareInstancesTest-1546991288 tempest-ShareInstancesTest-1546991288-project-admin] http://10.27.203.238/share/v2/fb2c57cefad04e97a990bd936225014d/shares/2dfffda2-1f3a-4d2e-9044-2255a211a9f0/instances returned with HTTP 200 May 28 12:56:36 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-af8708ad-a253-409a-9d16-73df554028fe tempest-AdminActionsNegativeTest-763023849 tempest-AdminActionsNegativeTest-763023849-project-admin] http://10.27.203.238/share/v2/7c36a466cc2a42b195f921474b0f4de5/snapshots/330a4554-af48-41d4-8b48-7c7fa0931581 returned with HTTP 202 May 28 12:56:36 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 102/214] 10.27.203.238 () {64 vars in 1481 bytes} [Tue May 28 12:56:36 2024] GET /share/v2/fb2c57cefad04e97a990bd936225014d/shares/2dfffda2-1f3a-4d2e-9044-2255a211a9f0/instances => generated 465 bytes in 26 msecs (HTTP/1.1 200) 6 headers in 231 bytes (2 switches on core 0) May 28 12:56:36 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 113/215] 10.27.203.238 () {64 vars in 1463 bytes} [Tue May 28 12:56:36 2024] DELETE /share/v2/7c36a466cc2a42b195f921474b0f4de5/snapshots/330a4554-af48-41d4-8b48-7c7fa0931581 => generated 0 bytes in 135 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:56:36 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-51cc92a0-4ad1-468f-85e0-cc350308928f None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:56:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-51cc92a0-4ad1-468f-85e0-cc350308928f None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:56:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-51cc92a0-4ad1-468f-85e0-cc350308928f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:36 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-339c47a0-c873-4b99-b7bf-072386788763 tempest-ShareInstancesTest-1546991288 tempest-ShareInstancesTest-1546991288-project-admin] GET http://10.27.203.238/share/v2/fb2c57cefad04e97a990bd936225014d/share_instances/7f6a42fa-4d45-471e-a438-36876fc6eac8 May 28 12:56:36 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-339c47a0-c873-4b99-b7bf-072386788763 tempest-ShareInstancesTest-1546991288 tempest-ShareInstancesTest-1546991288-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:36 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-339c47a0-c873-4b99-b7bf-072386788763 tempest-ShareInstancesTest-1546991288 tempest-ShareInstancesTest-1546991288-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:36 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-8189bf80-c9ae-48f7-a45b-24fe6cc6324d tempest-AdminActionsNegativeTest-763023849 tempest-AdminActionsNegativeTest-763023849-project-admin] GET http://10.27.203.238/share/v2/7c36a466cc2a42b195f921474b0f4de5/snapshots/330a4554-af48-41d4-8b48-7c7fa0931581 May 28 12:56:36 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-8189bf80-c9ae-48f7-a45b-24fe6cc6324d tempest-AdminActionsNegativeTest-763023849 tempest-AdminActionsNegativeTest-763023849-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:36 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-8189bf80-c9ae-48f7-a45b-24fe6cc6324d tempest-AdminActionsNegativeTest-763023849 tempest-AdminActionsNegativeTest-763023849-project-admin] Calling method 'ShareSnapshotMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:36 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-339c47a0-c873-4b99-b7bf-072386788763 tempest-ShareInstancesTest-1546991288 tempest-ShareInstancesTest-1546991288-project-admin] http://10.27.203.238/share/v2/fb2c57cefad04e97a990bd936225014d/share_instances/7f6a42fa-4d45-471e-a438-36876fc6eac8 returned with HTTP 200 May 28 12:56:36 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 103/216] 10.27.203.238 () {64 vars in 1478 bytes} [Tue May 28 12:56:36 2024] GET /share/v2/fb2c57cefad04e97a990bd936225014d/share_instances/7f6a42fa-4d45-471e-a438-36876fc6eac8 => generated 462 bytes in 17 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:56:36 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-d1e8a092-bc6d-4f78-a57d-ba25792ea218 tempest-ShareInstancesTest-1546991288 tempest-ShareInstancesTest-1546991288-project-admin] GET http://10.27.203.238/share/v2/fb2c57cefad04e97a990bd936225014d/share_instances May 28 12:56:36 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-d1e8a092-bc6d-4f78-a57d-ba25792ea218 tempest-ShareInstancesTest-1546991288 tempest-ShareInstancesTest-1546991288-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:36 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-d1e8a092-bc6d-4f78-a57d-ba25792ea218 tempest-ShareInstancesTest-1546991288 tempest-ShareInstancesTest-1546991288-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:36 l75lg1-v1 dstat.sh[49771]: 28-05 12:56:36| 19 2 76 2 0|5647M 1862M 277M 7840M| 20k 35k| 0 2440k| 0 356 | 11k 18k|1.78 0.98 0.98|6.0 1.0 0| 0 0 | 0 2048M| 29 346 0 46 0 May 28 12:56:36 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-d1e8a092-bc6d-4f78-a57d-ba25792ea218 tempest-ShareInstancesTest-1546991288 tempest-ShareInstancesTest-1546991288-project-admin] http://10.27.203.238/share/v2/fb2c57cefad04e97a990bd936225014d/share_instances returned with HTTP 200 May 28 12:56:36 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 104/217] 10.27.203.238 () {64 vars in 1366 bytes} [Tue May 28 12:56:36 2024] GET /share/v2/fb2c57cefad04e97a990bd936225014d/share_instances => generated 2158 bytes in 29 msecs (HTTP/1.1 200) 6 headers in 231 bytes (2 switches on core 0) May 28 12:56:36 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-8189bf80-c9ae-48f7-a45b-24fe6cc6324d tempest-AdminActionsNegativeTest-763023849 tempest-AdminActionsNegativeTest-763023849-project-admin] http://10.27.203.238/share/v2/7c36a466cc2a42b195f921474b0f4de5/snapshots/330a4554-af48-41d4-8b48-7c7fa0931581 returned with HTTP 200 May 28 12:56:36 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 745/1507] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:56:36 2024] POST /identity/v3/auth/tokens => generated 2960 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 12:56:36 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 114/218] 10.27.203.238 () {64 vars in 1460 bytes} [Tue May 28 12:56:36 2024] GET /share/v2/7c36a466cc2a42b195f921474b0f4de5/snapshots/330a4554-af48-41d4-8b48-7c7fa0931581 => generated 749 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 231 bytes (2 switches on core 0) May 28 12:56:36 l75lg1-v1 neutron-server[77618]: DEBUG neutron.wsgi [-] (77618) accepted ('10.27.203.238', 49430) {{(pid=77618) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 12:56:36 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-bbf701c1-c4e3-4a7b-a987-9c11ed6047a5 tempest-ShareInstancesTest-1546991288 tempest-ShareInstancesTest-1546991288-project-admin] GET http://10.27.203.238/share/v2/fb2c57cefad04e97a990bd936225014d/shares/2dfffda2-1f3a-4d2e-9044-2255a211a9f0/instances May 28 12:56:36 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-bbf701c1-c4e3-4a7b-a987-9c11ed6047a5 tempest-ShareInstancesTest-1546991288 tempest-ShareInstancesTest-1546991288-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:36 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-bbf701c1-c4e3-4a7b-a987-9c11ed6047a5 tempest-ShareInstancesTest-1546991288 tempest-ShareInstancesTest-1546991288-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575e161a-c9de-4cbd-b14c-ce0ec579c2fb None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-575e161a-c9de-4cbd-b14c-ce0ec579c2fb None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:36 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-bbf701c1-c4e3-4a7b-a987-9c11ed6047a5 tempest-ShareInstancesTest-1546991288 tempest-ShareInstancesTest-1546991288-project-admin] http://10.27.203.238/share/v2/fb2c57cefad04e97a990bd936225014d/shares/2dfffda2-1f3a-4d2e-9044-2255a211a9f0/instances returned with HTTP 200 May 28 12:56:36 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 105/219] 10.27.203.238 () {64 vars in 1481 bytes} [Tue May 28 12:56:36 2024] GET /share/v2/fb2c57cefad04e97a990bd936225014d/shares/2dfffda2-1f3a-4d2e-9044-2255a211a9f0/instances => generated 509 bytes in 25 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:56:36 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-de72324c-db7f-4150-b0ed-d74ce2e3cb47 tempest-ExportLocationsTest-1017217578 tempest-ExportLocationsTest-1017217578-project-admin] GET http://10.27.203.238/share/v2/87c113478e754c47aea49a8b703cd2f6/shares/a96dff4b-6e98-4085-9f3b-45735d209546 May 28 12:56:36 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-de72324c-db7f-4150-b0ed-d74ce2e3cb47 tempest-ExportLocationsTest-1017217578 tempest-ExportLocationsTest-1017217578-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:36 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-de72324c-db7f-4150-b0ed-d74ce2e3cb47 tempest-ExportLocationsTest-1017217578 tempest-ExportLocationsTest-1017217578-project-admin] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:36 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-c9595cd5-0f0d-4984-af9e-b96c43cce74c tempest-ShareInstancesTest-1546991288 tempest-ShareInstancesTest-1546991288-project-admin] GET http://10.27.203.238/share/v2/fb2c57cefad04e97a990bd936225014d/share_instances/7f6a42fa-4d45-471e-a438-36876fc6eac8/export_locations May 28 12:56:36 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-c9595cd5-0f0d-4984-af9e-b96c43cce74c tempest-ShareInstancesTest-1546991288 tempest-ShareInstancesTest-1546991288-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:36 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-c9595cd5-0f0d-4984-af9e-b96c43cce74c tempest-ShareInstancesTest-1546991288 tempest-ShareInstancesTest-1546991288-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:36 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-eda6b89b-13db-4842-b681-6d99576fdbea tempest-AdminActionsTest-1749172189 None] <<< [POST] https://127.0.0.1:40443/api/views/ May 28 12:56:36 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-eda6b89b-13db-4842-b681-6d99576fdbea tempest-AdminActionsTest-1749172189 None] Bunch(abac_tags=[], abe_max_depth=None, abe_protocols=[], alias='', allow_anonymous_access=False, allow_s3_anonymous_access=False, auto_commit='0d', bucket='', bucket_creators=[], bucket_creators_groups=[], bucket_owner=None, bulk_permission_update_progress=None, bulk_permission_update_state=None, cluster='loop75-kfs', cluster_id=1, created='2024-05-28T12:56:35.674217Z', enabled=True, files_retention_mode='NONE', guid='f1412880-5ed7-4a00-917b-8d42d0aaf91b', id=7, ignore_oos=False, internal=False, is_remote=False, is_seamless=False, logical_capacity=0, max_retention_period=None, min_retention_period=None, name='766fa507-2a4c-47eb-bfef-fa764b38b24c', nfs_interop_flags='BOTH_NFS3_AND_NFS4_INTEROP_DISABLED', path='/manila/manila-766fa507-2a4c-47eb-bfef-fa764b38b24c', physical_capacity=0, policy='766fa507-2a4c-47eb-bfef-fa764b38b24c', policy_id=8, protocols=['NFS'], qos_policy=None, qos_policy_id=None, s3_locks=False, s3_locks_retention_mode='NONE', s3_locks_retention_period='', s3_object_ownership_rule='ObjectWriter', s3_unverified_lookup=False, s3_versioning=False, select_for_live_monitoring=False, share='', share_acl=Bunch(acl=[], enabled=False), sync='SYNCED', sync_time='2024-05-28T12:56:36.217355Z', tenant_id=1, tenant_name='default', title='/manila/manila-766fa507-2a4c-47eb-bfef-fa764b38b24c', url='https://127.0.0.1:40443/api/views/7/') May 28 12:56:36 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-eda6b89b-13db-4842-b681-6d99576fdbea tempest-AdminActionsTest-1749172189 None] --- [POST] https://127.0.0.1:40443/api/views/: Done May 28 12:56:36 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-72f3d118-a786-4564-9cb7-cb9c1235c2d6 tempest-ExportLocationsTest-1017217578 None] <<< [DELETE] https://127.0.0.1:40443/api/views/4/ May 28 12:56:36 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-72f3d118-a786-4564-9cb7-cb9c1235c2d6 tempest-ExportLocationsTest-1017217578 None] --- [DELETE] https://127.0.0.1:40443/api/views/4/: Done May 28 12:56:36 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-72f3d118-a786-4564-9cb7-cb9c1235c2d6 tempest-ExportLocationsTest-1017217578 None] >>> [GET] https://127.0.0.1:40443/api/quotas/ May 28 12:56:36 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-72f3d118-a786-4564-9cb7-cb9c1235c2d6 tempest-ExportLocationsTest-1017217578 None] {'allow_redirects': True, May 28 12:56:36 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-72f3d118-a786-4564-9cb7-cb9c1235c2d6 tempest-ExportLocationsTest-1017217578 None] 'params': {'name': '83d10127-dfed-433a-90d1-4f0a7f981edc'}} May 28 12:56:36 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-af8708ad-a253-409a-9d16-73df554028fe tempest-AdminActionsNegativeTest-763023849 None] >>> [GET] https://127.0.0.1:40443/api/snapshots/ May 28 12:56:36 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-af8708ad-a253-409a-9d16-73df554028fe tempest-AdminActionsNegativeTest-763023849 None] {'allow_redirects': True, May 28 12:56:36 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-af8708ad-a253-409a-9d16-73df554028fe tempest-AdminActionsNegativeTest-763023849 None] 'params': {'name': 'share-snapshot-2c33c0a4-eec6-45e7-9277-173d95361e7a'}} May 28 12:56:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575e161a-c9de-4cbd-b14c-ce0ec579c2fb None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:36 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-de72324c-db7f-4150-b0ed-d74ce2e3cb47 tempest-ExportLocationsTest-1017217578 tempest-ExportLocationsTest-1017217578-project-admin] http://10.27.203.238/share/v2/87c113478e754c47aea49a8b703cd2f6/shares/a96dff4b-6e98-4085-9f3b-45735d209546 returned with HTTP 200 May 28 12:56:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e56a1f-ede3-478a-907e-b5ac9eb8579e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef17047035e4b518fd5360a01f2da1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:36 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 115/220] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:56:36 2024] GET /share/v2/87c113478e754c47aea49a8b703cd2f6/shares/a96dff4b-6e98-4085-9f3b-45735d209546 => generated 1372 bytes in 26 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:56:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e56a1f-ede3-478a-907e-b5ac9eb8579e service neutron] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e56a1f-ede3-478a-907e-b5ac9eb8579e service neutron] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e56a1f-ede3-478a-907e-b5ac9eb8579e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e56a1f-ede3-478a-907e-b5ac9eb8579e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e56a1f-ede3-478a-907e-b5ac9eb8579e service neutron] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:36 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 763/1508] 10.27.203.238 () {64 vars in 1432 bytes} [Tue May 28 12:56:36 2024] GET /identity/v3/auth/tokens => generated 2960 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 28 12:56:36 l75lg1-v1 neutron-server[77618]: INFO neutron.wsgi [None req-e37e1c8e-f89a-4c00-90e5-3fd36bb8ffd3 None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=ac20784a3f664ed6873784a747ff7b1f&name=default HTTP/1.1" status: 200 len: 216 time: 0.0715203 May 28 12:56:36 l75lg1-v1 manila-share[98474]: INFO manila.share.manager [None req-eda6b89b-13db-4842-b681-6d99576fdbea tempest-AdminActionsTest-1749172189 None] Share instance 766fa507-2a4c-47eb-bfef-fa764b38b24c created successfully. May 28 12:56:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cc92a0-4ad1-468f-85e0-cc350308928f None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-51cc92a0-4ad1-468f-85e0-cc350308928f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:36 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-c9595cd5-0f0d-4984-af9e-b96c43cce74c tempest-ShareInstancesTest-1546991288 tempest-ShareInstancesTest-1546991288-project-admin] http://10.27.203.238/share/v2/fb2c57cefad04e97a990bd936225014d/share_instances/7f6a42fa-4d45-471e-a438-36876fc6eac8/export_locations returned with HTTP 200 May 28 12:56:36 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 106/221] 10.27.203.238 () {64 vars in 1529 bytes} [Tue May 28 12:56:36 2024] GET /share/v2/fb2c57cefad04e97a990bd936225014d/share_instances/7f6a42fa-4d45-471e-a438-36876fc6eac8/export_locations => generated 250 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:56:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cc92a0-4ad1-468f-85e0-cc350308928f None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:36 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-1077573d-06e8-4c25-b180-9f654d5ee9f5 tempest-ShareInstancesTest-1546991288 tempest-ShareInstancesTest-1546991288-project-admin] GET http://10.27.203.238/share/v2/fb2c57cefad04e97a990bd936225014d/share_instances?export_location_path=172.21.75.1%3A%2Fmanila%2Fmanila-7f6a42fa-4d45-471e-a438-36876fc6eac8 May 28 12:56:36 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-1077573d-06e8-4c25-b180-9f654d5ee9f5 tempest-ShareInstancesTest-1546991288 tempest-ShareInstancesTest-1546991288-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:36 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-1077573d-06e8-4c25-b180-9f654d5ee9f5 tempest-ShareInstancesTest-1546991288 tempest-ShareInstancesTest-1546991288-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66335a61-e455-4718-986b-b554b6cbad6c None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66335a61-e455-4718-986b-b554b6cbad6c None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66335a61-e455-4718-986b-b554b6cbad6c None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66335a61-e455-4718-986b-b554b6cbad6c None admin] PATH_INFO: `/v3/projects/ac20784a3f664ed6873784a747ff7b1f` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66335a61-e455-4718-986b-b554b6cbad6c None admin] RBAC: Authorizing `identity:delete_project(project_id=ac20784a3f664ed6873784a747ff7b1f)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66335a61-e455-4718-986b-b554b6cbad6c None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:36 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-1077573d-06e8-4c25-b180-9f654d5ee9f5 tempest-ShareInstancesTest-1546991288 tempest-ShareInstancesTest-1546991288-project-admin] http://10.27.203.238/share/v2/fb2c57cefad04e97a990bd936225014d/share_instances?export_location_path=172.21.75.1%3A%2Fmanila%2Fmanila-7f6a42fa-4d45-471e-a438-36876fc6eac8 returned with HTTP 200 May 28 12:56:36 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 116/222] 10.27.203.238 () {64 vars in 1548 bytes} [Tue May 28 12:56:36 2024] GET /share/v2/fb2c57cefad04e97a990bd936225014d/share_instances?export_location_path=172.21.75.1%3A%2Fmanila%2Fmanila-7f6a42fa-4d45-471e-a438-36876fc6eac8 => generated 509 bytes in 26 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:56:36 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-90ba398a-4957-4d0b-b0cf-c6d70a9dbe87 tempest-ShareInstancesTest-1546991288 tempest-ShareInstancesTest-1546991288-project-admin] GET http://10.27.203.238/share/v2/fb2c57cefad04e97a990bd936225014d/shares/2dfffda2-1f3a-4d2e-9044-2255a211a9f0/instances May 28 12:56:36 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-90ba398a-4957-4d0b-b0cf-c6d70a9dbe87 tempest-ShareInstancesTest-1546991288 tempest-ShareInstancesTest-1546991288-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:36 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-90ba398a-4957-4d0b-b0cf-c6d70a9dbe87 tempest-ShareInstancesTest-1546991288 tempest-ShareInstancesTest-1546991288-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-66335a61-e455-4718-986b-b554b6cbad6c None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac20784a3f664ed6873784a747ff7b1f', 'request_id': 'req-66335a61-e455-4718-986b-b554b6cbad6c'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-66335a61-e455-4718-986b-b554b6cbad6c None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac20784a3f664ed6873784a747ff7b1f', 'request_id': 'req-66335a61-e455-4718-986b-b554b6cbad6c'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:36 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-90ba398a-4957-4d0b-b0cf-c6d70a9dbe87 tempest-ShareInstancesTest-1546991288 tempest-ShareInstancesTest-1546991288-project-admin] http://10.27.203.238/share/v2/fb2c57cefad04e97a990bd936225014d/shares/2dfffda2-1f3a-4d2e-9044-2255a211a9f0/instances returned with HTTP 200 May 28 12:56:36 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 107/223] 10.27.203.238 () {64 vars in 1481 bytes} [Tue May 28 12:56:36 2024] GET /share/v2/fb2c57cefad04e97a990bd936225014d/shares/2dfffda2-1f3a-4d2e-9044-2255a211a9f0/instances => generated 509 bytes in 26 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:56:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-66335a61-e455-4718-986b-b554b6cbad6c None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac20784a3f664ed6873784a747ff7b1f', 'request_id': 'req-66335a61-e455-4718-986b-b554b6cbad6c'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:36 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-6f248e8c-121b-4a94-83e6-81e42a0db5d5 tempest-ShareInstancesTest-1546991288 tempest-ShareInstancesTest-1546991288-project-admin] GET http://10.27.203.238/share/v2/fb2c57cefad04e97a990bd936225014d/share_instances/7f6a42fa-4d45-471e-a438-36876fc6eac8/export_locations May 28 12:56:36 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-6f248e8c-121b-4a94-83e6-81e42a0db5d5 tempest-ShareInstancesTest-1546991288 tempest-ShareInstancesTest-1546991288-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:36 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-6f248e8c-121b-4a94-83e6-81e42a0db5d5 tempest-ShareInstancesTest-1546991288 tempest-ShareInstancesTest-1546991288-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-66335a61-e455-4718-986b-b554b6cbad6c None admin] The token cache is being invalidate because project ac20784a3f664ed6873784a747ff7b1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 12:56:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-66335a61-e455-4718-986b-b554b6cbad6c None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-66335a61-e455-4718-986b-b554b6cbad6c None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:36 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 746/1509] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 12:56:36 2024] DELETE /identity/v3/projects/ac20784a3f664ed6873784a747ff7b1f => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:56:36 l75lg1-v1 neutron-server[77618]: DEBUG neutron.wsgi [-] (77618) accepted ('10.27.203.238', 49446) {{(pid=77618) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 12:56:36 l75lg1-v1 neutron-server[77618]: INFO neutron.wsgi [None req-5254f383-cb27-438e-8cd3-77c21b5d855f None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=d0b0ae94b0c5486f9028712057ebacb5&name=default HTTP/1.1" status: 200 len: 216 time: 0.0090506 May 28 12:56:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e56a1f-ede3-478a-907e-b5ac9eb8579e service neutron] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e56a1f-ede3-478a-907e-b5ac9eb8579e service neutron] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:36 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-6f248e8c-121b-4a94-83e6-81e42a0db5d5 tempest-ShareInstancesTest-1546991288 tempest-ShareInstancesTest-1546991288-project-admin] http://10.27.203.238/share/v2/fb2c57cefad04e97a990bd936225014d/share_instances/7f6a42fa-4d45-471e-a438-36876fc6eac8/export_locations returned with HTTP 200 May 28 12:56:36 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 117/224] 10.27.203.238 () {64 vars in 1529 bytes} [Tue May 28 12:56:36 2024] GET /share/v2/fb2c57cefad04e97a990bd936225014d/share_instances/7f6a42fa-4d45-471e-a438-36876fc6eac8/export_locations => generated 250 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:56:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33ba564-92f3-4501-8a17-71f69c5a86cb None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33ba564-92f3-4501-8a17-71f69c5a86cb None admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33ba564-92f3-4501-8a17-71f69c5a86cb None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33ba564-92f3-4501-8a17-71f69c5a86cb None admin] PATH_INFO: `/v3/projects/d0b0ae94b0c5486f9028712057ebacb5` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33ba564-92f3-4501-8a17-71f69c5a86cb None admin] RBAC: Authorizing `identity:delete_project(project_id=d0b0ae94b0c5486f9028712057ebacb5)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:36 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-c6118acf-586e-489f-b13f-404ce1c55949 tempest-ShareInstancesTest-1546991288 tempest-ShareInstancesTest-1546991288-project-admin] GET http://10.27.203.238/share/v2/fb2c57cefad04e97a990bd936225014d/share_instances?export_location_id=9e3d1933-8340-4f36-9bea-ce3fd1418c9b May 28 12:56:36 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-c6118acf-586e-489f-b13f-404ce1c55949 tempest-ShareInstancesTest-1546991288 tempest-ShareInstancesTest-1546991288-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33ba564-92f3-4501-8a17-71f69c5a86cb None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:36 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-c6118acf-586e-489f-b13f-404ce1c55949 tempest-ShareInstancesTest-1546991288 tempest-ShareInstancesTest-1546991288-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:36 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-c6118acf-586e-489f-b13f-404ce1c55949 tempest-ShareInstancesTest-1546991288 tempest-ShareInstancesTest-1546991288-project-admin] http://10.27.203.238/share/v2/fb2c57cefad04e97a990bd936225014d/share_instances?export_location_id=9e3d1933-8340-4f36-9bea-ce3fd1418c9b returned with HTTP 200 May 28 12:56:36 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 108/225] 10.27.203.238 () {64 vars in 1478 bytes} [Tue May 28 12:56:36 2024] GET /share/v2/fb2c57cefad04e97a990bd936225014d/share_instances?export_location_id=9e3d1933-8340-4f36-9bea-ce3fd1418c9b => generated 509 bytes in 28 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:56:36 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-96fcae40-186c-4b6a-ba9d-3ab03e4ba4f1 tempest-ShareInstancesTest-1546991288 tempest-ShareInstancesTest-1546991288-project-admin] GET http://10.27.203.238/share/v2/fb2c57cefad04e97a990bd936225014d/share-replicas/detail?share_id=2dfffda2-1f3a-4d2e-9044-2255a211a9f0 May 28 12:56:36 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-96fcae40-186c-4b6a-ba9d-3ab03e4ba4f1 tempest-ShareInstancesTest-1546991288 tempest-ShareInstancesTest-1546991288-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:36 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-96fcae40-186c-4b6a-ba9d-3ab03e4ba4f1 tempest-ShareInstancesTest-1546991288 tempest-ShareInstancesTest-1546991288-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-b33ba564-92f3-4501-8a17-71f69c5a86cb None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0b0ae94b0c5486f9028712057ebacb5', 'request_id': 'req-b33ba564-92f3-4501-8a17-71f69c5a86cb'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-b33ba564-92f3-4501-8a17-71f69c5a86cb None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0b0ae94b0c5486f9028712057ebacb5', 'request_id': 'req-b33ba564-92f3-4501-8a17-71f69c5a86cb'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:36 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-96fcae40-186c-4b6a-ba9d-3ab03e4ba4f1 tempest-ShareInstancesTest-1546991288 tempest-ShareInstancesTest-1546991288-project-admin] http://10.27.203.238/share/v2/fb2c57cefad04e97a990bd936225014d/share-replicas/detail?share_id=2dfffda2-1f3a-4d2e-9044-2255a211a9f0 returned with HTTP 200 May 28 12:56:36 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 118/226] 10.27.203.238 () {64 vars in 1476 bytes} [Tue May 28 12:56:36 2024] GET /share/v2/fb2c57cefad04e97a990bd936225014d/share-replicas/detail?share_id=2dfffda2-1f3a-4d2e-9044-2255a211a9f0 => generated 22 bytes in 16 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:56:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-b33ba564-92f3-4501-8a17-71f69c5a86cb None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0b0ae94b0c5486f9028712057ebacb5', 'request_id': 'req-b33ba564-92f3-4501-8a17-71f69c5a86cb'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:36 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-f77454c8-a7d3-43f9-807d-8f8535202188 tempest-ShareInstancesTest-1546991288 tempest-ShareInstancesTest-1546991288-project-admin] DELETE http://10.27.203.238/share/v2/fb2c57cefad04e97a990bd936225014d/shares/2dfffda2-1f3a-4d2e-9044-2255a211a9f0 May 28 12:56:36 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-f77454c8-a7d3-43f9-807d-8f8535202188 tempest-ShareInstancesTest-1546991288 tempest-ShareInstancesTest-1546991288-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:36 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-f77454c8-a7d3-43f9-807d-8f8535202188 tempest-ShareInstancesTest-1546991288 tempest-ShareInstancesTest-1546991288-project-admin] Calling method 'ShareMixin.delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:36 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.v1.shares [None req-f77454c8-a7d3-43f9-807d-8f8535202188 tempest-ShareInstancesTest-1546991288 tempest-ShareInstancesTest-1546991288-project-admin] Delete share with id: 2dfffda2-1f3a-4d2e-9044-2255a211a9f0 May 28 12:56:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-b33ba564-92f3-4501-8a17-71f69c5a86cb None admin] The token cache is being invalidate because project d0b0ae94b0c5486f9028712057ebacb5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 12:56:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-b33ba564-92f3-4501-8a17-71f69c5a86cb None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-b33ba564-92f3-4501-8a17-71f69c5a86cb None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:36 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 764/1510] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 12:56:36 2024] DELETE /identity/v3/projects/d0b0ae94b0c5486f9028712057ebacb5 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:56:36 l75lg1-v1 neutron-server[77619]: DEBUG neutron.wsgi [-] (77619) accepted ('10.27.203.238', 49448) {{(pid=77619) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 12:56:36 l75lg1-v1 neutron-server[77619]: INFO neutron.wsgi [None req-9fd0f709-2233-4bf8-a406-6ccde020f8bf None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=31fdadaf536c476bbd07252e22564086&name=default HTTP/1.1" status: 200 len: 216 time: 0.0102346 May 28 12:56:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66335a61-e455-4718-986b-b554b6cbad6c None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-66335a61-e455-4718-986b-b554b6cbad6c None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66335a61-e455-4718-986b-b554b6cbad6c None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d50971-029a-46f1-91d5-74adb5746c7d None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d50971-029a-46f1-91d5-74adb5746c7d None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d50971-029a-46f1-91d5-74adb5746c7d None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d50971-029a-46f1-91d5-74adb5746c7d None admin] PATH_INFO: `/v3/projects/31fdadaf536c476bbd07252e22564086` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d50971-029a-46f1-91d5-74adb5746c7d None admin] RBAC: Authorizing `identity:delete_project(project_id=31fdadaf536c476bbd07252e22564086)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d50971-029a-46f1-91d5-74adb5746c7d None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:36 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-72f3d118-a786-4564-9cb7-cb9c1235c2d6 tempest-ExportLocationsTest-1017217578 None] <<< [GET] https://127.0.0.1:40443/api/quotas/ May 28 12:56:36 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-72f3d118-a786-4564-9cb7-cb9c1235c2d6 tempest-ExportLocationsTest-1017217578 None] [Bunch(cluster='loop75-kfs', cluster_id=1, default_email=None, default_group_quota=None, default_user_quota=None, enable_alarms=True, enable_email_providers=True, grace_period=None, guid='2f4b2691-bd87-4624-b3a8-06e9739344e3', hard_limit=1073741824, hard_limit_inodes=None, id=2, internal=False, is_user_quota=False, last_user_quotas_update=None, name='83d10127-dfed-433a-90d1-4f0a7f981edc', num_blocked_users=0, num_exceeded_users=0, path='/manila/manila-83d10127-dfed-433a-90d1-4f0a7f981edc', percent_capacity=0, percent_inodes=None, pretty_grace_period=None, pretty_grace_period_expiration=None, pretty_state='OK (CREATED)', soft_limit=None, soft_limit_inodes=None, state='OK', sync_state='CREATED', system_id=2, tenant_id=1, tenant_name='default', time_to_block=None, title='83d10127-dfed-433a-90d1-4f0a7f981edc', url='https://127.0.0.1:40443/api/quotas/2/', used_capacity=0, used_capacity_tb=0.0, used_effective_capacity=0, used_effective_capacity_tb=0.0, used_inodes=0, used_limited_capacity=0)] May 28 12:56:36 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-72f3d118-a786-4564-9cb7-cb9c1235c2d6 tempest-ExportLocationsTest-1017217578 None] --- [GET] https://127.0.0.1:40443/api/quotas/: Done May 28 12:56:36 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-72f3d118-a786-4564-9cb7-cb9c1235c2d6 tempest-ExportLocationsTest-1017217578 None] >>> [DELETE] https://127.0.0.1:40443/api/quotas/2/ May 28 12:56:36 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-af8708ad-a253-409a-9d16-73df554028fe tempest-AdminActionsNegativeTest-763023849 None] <<< [GET] https://127.0.0.1:40443/api/snapshots/ May 28 12:56:36 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-af8708ad-a253-409a-9d16-73df554028fe tempest-AdminActionsNegativeTest-763023849 None] [Bunch(access_path='/.vast_all_snapshots/1000000000_share-snapshot-2c33c0a4-eec6-45e7-9277-173d95361e7a', aggr_phys_estimation=0, cluster='loop75-kfs', created='2024-05-28T12:56:32.882997Z', eta_sec=30819899001.3882, expiration_time='3001-01-19T07:59:58Z', guid='aa09c396-dd1a-4133-8358-a6aa81bdc288', id=1, indestructible=False, locked=False, name='share-snapshot-2c33c0a4-eec6-45e7-9277-173d95361e7a', path='/manila/manila-5ae9ae15-dc00-44c8-891a-9758f2b29855/', policy=None, policy_id=None, protection_policy_id=None, state='SUCCEED', tenant_id=1, tenant_name='default', title='share-snapshot-2c33c0a4-eec6-45e7-9277-173d95361e7a(/manila/manila-5ae9ae15-dc00-44c8-891a-9758f2b29855/)', type='local', unique_phys_estimation=0, url='https://127.0.0.1:40443/api/snapshots/1/')] May 28 12:56:36 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-af8708ad-a253-409a-9d16-73df554028fe tempest-AdminActionsNegativeTest-763023849 None] --- [GET] https://127.0.0.1:40443/api/snapshots/: Done May 28 12:56:36 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-af8708ad-a253-409a-9d16-73df554028fe tempest-AdminActionsNegativeTest-763023849 None] >>> [DELETE] https://127.0.0.1:40443/api/snapshots/1/ May 28 12:56:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-d4d50971-029a-46f1-91d5-74adb5746c7d None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31fdadaf536c476bbd07252e22564086', 'request_id': 'req-d4d50971-029a-46f1-91d5-74adb5746c7d'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-d4d50971-029a-46f1-91d5-74adb5746c7d None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31fdadaf536c476bbd07252e22564086', 'request_id': 'req-d4d50971-029a-46f1-91d5-74adb5746c7d'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:36 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-f77454c8-a7d3-43f9-807d-8f8535202188 tempest-ShareInstancesTest-1546991288 tempest-ShareInstancesTest-1546991288-project-admin] http://10.27.203.238/share/v2/fb2c57cefad04e97a990bd936225014d/shares/2dfffda2-1f3a-4d2e-9044-2255a211a9f0 returned with HTTP 202 May 28 12:56:36 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 109/227] 10.27.203.238 () {64 vars in 1454 bytes} [Tue May 28 12:56:36 2024] DELETE /share/v2/fb2c57cefad04e97a990bd936225014d/shares/2dfffda2-1f3a-4d2e-9044-2255a211a9f0 => generated 0 bytes in 155 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:56:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-d4d50971-029a-46f1-91d5-74adb5746c7d None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31fdadaf536c476bbd07252e22564086', 'request_id': 'req-d4d50971-029a-46f1-91d5-74adb5746c7d'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:36 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-46bb1e67-9da7-47f3-a1f1-1dde25b18f6d tempest-ShareInstancesTest-1546991288 tempest-ShareInstancesTest-1546991288-project-admin] GET http://10.27.203.238/share/v2/fb2c57cefad04e97a990bd936225014d/shares/2dfffda2-1f3a-4d2e-9044-2255a211a9f0 May 28 12:56:36 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-46bb1e67-9da7-47f3-a1f1-1dde25b18f6d tempest-ShareInstancesTest-1546991288 tempest-ShareInstancesTest-1546991288-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:36 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-46bb1e67-9da7-47f3-a1f1-1dde25b18f6d tempest-ShareInstancesTest-1546991288 tempest-ShareInstancesTest-1546991288-project-admin] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-d4d50971-029a-46f1-91d5-74adb5746c7d None admin] The token cache is being invalidate because project 31fdadaf536c476bbd07252e22564086 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 12:56:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-d4d50971-029a-46f1-91d5-74adb5746c7d None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-d4d50971-029a-46f1-91d5-74adb5746c7d None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:36 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 747/1511] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 12:56:36 2024] DELETE /identity/v3/projects/31fdadaf536c476bbd07252e22564086 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:56:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989ab608-9d16-4454-b904-dd309d8a1801 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989ab608-9d16-4454-b904-dd309d8a1801 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989ab608-9d16-4454-b904-dd309d8a1801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:36 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-989ab608-9d16-4454-b904-dd309d8a1801 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:56:36 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-46bb1e67-9da7-47f3-a1f1-1dde25b18f6d tempest-ShareInstancesTest-1546991288 tempest-ShareInstancesTest-1546991288-project-admin] http://10.27.203.238/share/v2/fb2c57cefad04e97a990bd936225014d/shares/2dfffda2-1f3a-4d2e-9044-2255a211a9f0 returned with HTTP 200 May 28 12:56:36 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 119/228] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:56:36 2024] GET /share/v2/fb2c57cefad04e97a990bd936225014d/shares/2dfffda2-1f3a-4d2e-9044-2255a211a9f0 => generated 1371 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:56:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-989ab608-9d16-4454-b904-dd309d8a1801 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:56:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-989ab608-9d16-4454-b904-dd309d8a1801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:36 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 765/1512] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:56:36 2024] POST /identity/v3/auth/tokens => generated 312 bytes in 26 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 28 12:56:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5f1f1f-6eeb-4d90-b807-92fc3890b50c None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5f1f1f-6eeb-4d90-b807-92fc3890b50c None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5f1f1f-6eeb-4d90-b807-92fc3890b50c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:36 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-0b5f1f1f-6eeb-4d90-b807-92fc3890b50c None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:56:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-0b5f1f1f-6eeb-4d90-b807-92fc3890b50c None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:56:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-0b5f1f1f-6eeb-4d90-b807-92fc3890b50c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:36 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-f77454c8-a7d3-43f9-807d-8f8535202188 tempest-ShareInstancesTest-1546991288 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7f6a42fa-4d45-471e-a438-36876fc6eac8" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:56:36 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-f77454c8-a7d3-43f9-807d-8f8535202188 tempest-ShareInstancesTest-1546991288 None] Lock "locked_access_rules_operation_by_share_instance_7f6a42fa-4d45-471e-a438-36876fc6eac8" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:56:36 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-f77454c8-a7d3-43f9-807d-8f8535202188 tempest-ShareInstancesTest-1546991288 None] Lock "locked_access_rules_operation_by_share_instance_7f6a42fa-4d45-471e-a438-36876fc6eac8" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:56:36 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-f77454c8-a7d3-43f9-807d-8f8535202188 tempest-ShareInstancesTest-1546991288 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7f6a42fa-4d45-471e-a438-36876fc6eac8" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:56:36 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-f77454c8-a7d3-43f9-807d-8f8535202188 tempest-ShareInstancesTest-1546991288 None] Lock "locked_access_rules_operation_by_share_instance_7f6a42fa-4d45-471e-a438-36876fc6eac8" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:56:36 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-f77454c8-a7d3-43f9-807d-8f8535202188 tempest-ShareInstancesTest-1546991288 None] Lock "locked_access_rules_operation_by_share_instance_7f6a42fa-4d45-471e-a438-36876fc6eac8" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:56:36 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-f77454c8-a7d3-43f9-807d-8f8535202188 tempest-ShareInstancesTest-1546991288 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7f6a42fa-4d45-471e-a438-36876fc6eac8" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:56:36 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-f77454c8-a7d3-43f9-807d-8f8535202188 tempest-ShareInstancesTest-1546991288 None] Lock "locked_access_rules_operation_by_share_instance_7f6a42fa-4d45-471e-a438-36876fc6eac8" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:56:36 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-f77454c8-a7d3-43f9-807d-8f8535202188 tempest-ShareInstancesTest-1546991288 None] Lock "locked_access_rules_operation_by_share_instance_7f6a42fa-4d45-471e-a438-36876fc6eac8" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:56:36 l75lg1-v1 manila-share[98474]: DEBUG manila.share.access [None req-f77454c8-a7d3-43f9-807d-8f8535202188 tempest-ShareInstancesTest-1546991288 None] All access rules have been synced for share instance 7f6a42fa-4d45-471e-a438-36876fc6eac8 belonging to share 2dfffda2-1f3a-4d2e-9044-2255a211a9f0. {{(pid=98474) update_access_rules /opt/stack/manila/manila/share/access.py:304}} May 28 12:56:36 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-f77454c8-a7d3-43f9-807d-8f8535202188 tempest-ShareInstancesTest-1546991288 None] deleting '/manila/manila-7f6a42fa-4d45-471e-a438-36876fc6eac8' May 28 12:56:36 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f77454c8-a7d3-43f9-807d-8f8535202188 tempest-ShareInstancesTest-1546991288 None] >>> [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/ May 28 12:56:36 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f77454c8-a7d3-43f9-807d-8f8535202188 tempest-ShareInstancesTest-1546991288 None] {'data': '{"path": "/manila/manila-7f6a42fa-4d45-471e-a438-36876fc6eac8"}', May 28 12:56:36 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f77454c8-a7d3-43f9-807d-8f8535202188 tempest-ShareInstancesTest-1546991288 None] 'params': None} May 28 12:56:36 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 748/1513] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:56:36 2024] POST /identity/v3/auth/tokens => generated 2960 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 12:56:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989ab608-9d16-4454-b904-dd309d8a1801 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989ab608-9d16-4454-b904-dd309d8a1801 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3310f2c3-ae30-4d16-9025-bb4d56695117 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3310f2c3-ae30-4d16-9025-bb4d56695117 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3310f2c3-ae30-4d16-9025-bb4d56695117 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3310f2c3-ae30-4d16-9025-bb4d56695117 None admin] PATH_INFO: `/v3/domains` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3310f2c3-ae30-4d16-9025-bb4d56695117 None admin] RBAC: Adding query filter params (name=Default) {{(pid=51267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:56:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3310f2c3-ae30-4d16-9025-bb4d56695117 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3310f2c3-ae30-4d16-9025-bb4d56695117 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:36 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 766/1514] 10.27.203.238 () {62 vars in 1220 bytes} [Tue May 28 12:56:36 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:56:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5f1f1f-6eeb-4d90-b807-92fc3890b50c None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5f1f1f-6eeb-4d90-b807-92fc3890b50c None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becb0193-3e7c-4ae6-b09a-acc7f911aaf7 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becb0193-3e7c-4ae6-b09a-acc7f911aaf7 None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becb0193-3e7c-4ae6-b09a-acc7f911aaf7 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becb0193-3e7c-4ae6-b09a-acc7f911aaf7 None admin] PATH_INFO: `/v3/projects` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becb0193-3e7c-4ae6-b09a-acc7f911aaf7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becb0193-3e7c-4ae6-b09a-acc7f911aaf7 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:36 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f77454c8-a7d3-43f9-807d-8f8535202188 tempest-ShareInstancesTest-1546991288 None] <<< [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/ May 28 12:56:36 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f77454c8-a7d3-43f9-807d-8f8535202188 tempest-ShareInstancesTest-1546991288 None] 'OK' May 28 12:56:36 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f77454c8-a7d3-43f9-807d-8f8535202188 tempest-ShareInstancesTest-1546991288 None] --- [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/: Done May 28 12:56:36 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f77454c8-a7d3-43f9-807d-8f8535202188 tempest-ShareInstancesTest-1546991288 None] >>> [GET] https://127.0.0.1:40443/api/views/ May 28 12:56:36 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f77454c8-a7d3-43f9-807d-8f8535202188 tempest-ShareInstancesTest-1546991288 None] {'allow_redirects': True, May 28 12:56:36 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f77454c8-a7d3-43f9-807d-8f8535202188 tempest-ShareInstancesTest-1546991288 None] 'params': {'name': '7f6a42fa-4d45-471e-a438-36876fc6eac8'}} May 28 12:56:36 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 749/1515] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 12:56:36 2024] POST /identity/v3/projects => generated 397 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:56:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3310f2c3-ae30-4d16-9025-bb4d56695117 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3310f2c3-ae30-4d16-9025-bb4d56695117 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c0a87a-77d7-47ca-bb0a-9f60701fe040 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c0a87a-77d7-47ca-bb0a-9f60701fe040 None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c0a87a-77d7-47ca-bb0a-9f60701fe040 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c0a87a-77d7-47ca-bb0a-9f60701fe040 None admin] PATH_INFO: `/v3/users` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c0a87a-77d7-47ca-bb0a-9f60701fe040 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c0a87a-77d7-47ca-bb0a-9f60701fe040 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:36 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-e7c0a87a-77d7-47ca-bb0a-9f60701fe040 None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 12:56:36 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 767/1516] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 12:56:36 2024] POST /identity/v3/users => generated 306 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:56:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becb0193-3e7c-4ae6-b09a-acc7f911aaf7 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becb0193-3e7c-4ae6-b09a-acc7f911aaf7 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5f287d-7e35-41ed-adf0-f08a4318aa56 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5f287d-7e35-41ed-adf0-f08a4318aa56 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5f287d-7e35-41ed-adf0-f08a4318aa56 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5f287d-7e35-41ed-adf0-f08a4318aa56 None admin] PATH_INFO: `/v3/roles` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5f287d-7e35-41ed-adf0-f08a4318aa56 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5f287d-7e35-41ed-adf0-f08a4318aa56 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:36 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 750/1517] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 12:56:36 2024] GET /identity/v3/roles => generated 1680 bytes in 18 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:56:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c0a87a-77d7-47ca-bb0a-9f60701fe040 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c0a87a-77d7-47ca-bb0a-9f60701fe040 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2689a95-4324-4576-9b68-db44141cf40c None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2689a95-4324-4576-9b68-db44141cf40c None admin] REQUEST_METHOD: `PUT` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2689a95-4324-4576-9b68-db44141cf40c None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2689a95-4324-4576-9b68-db44141cf40c None admin] PATH_INFO: `/v3/projects/165110569f0f417d96d713b9e114929c/users/713466dc171f4a81bb59ce986a29f74d/roles/e7989893488f483baa107be56668c4f8` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2689a95-4324-4576-9b68-db44141cf40c None admin] RBAC: Authorizing `identity:create_grant(project_id=165110569f0f417d96d713b9e114929c, user_id=713466dc171f4a81bb59ce986a29f74d, role_id=e7989893488f483baa107be56668c4f8)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2689a95-4324-4576-9b68-db44141cf40c None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:36 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 768/1518] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 12:56:36 2024] PUT /identity/v3/projects/165110569f0f417d96d713b9e114929c/users/713466dc171f4a81bb59ce986a29f74d/roles/e7989893488f483baa107be56668c4f8 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:56:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5f287d-7e35-41ed-adf0-f08a4318aa56 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5f287d-7e35-41ed-adf0-f08a4318aa56 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232167a7-dca3-4850-8fff-1cacee4213ae None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232167a7-dca3-4850-8fff-1cacee4213ae None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232167a7-dca3-4850-8fff-1cacee4213ae None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232167a7-dca3-4850-8fff-1cacee4213ae None admin] PATH_INFO: `/v3/roles` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232167a7-dca3-4850-8fff-1cacee4213ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232167a7-dca3-4850-8fff-1cacee4213ae None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:36 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 751/1519] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 12:56:36 2024] GET /identity/v3/roles => generated 1680 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:56:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2689a95-4324-4576-9b68-db44141cf40c None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2689a95-4324-4576-9b68-db44141cf40c None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb4ec23-b6cb-4466-ae00-b473904a635a None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb4ec23-b6cb-4466-ae00-b473904a635a None admin] REQUEST_METHOD: `PUT` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb4ec23-b6cb-4466-ae00-b473904a635a None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb4ec23-b6cb-4466-ae00-b473904a635a None admin] PATH_INFO: `/v3/projects/165110569f0f417d96d713b9e114929c/users/713466dc171f4a81bb59ce986a29f74d/roles/e7989893488f483baa107be56668c4f8` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb4ec23-b6cb-4466-ae00-b473904a635a None admin] RBAC: Authorizing `identity:create_grant(project_id=165110569f0f417d96d713b9e114929c, user_id=713466dc171f4a81bb59ce986a29f74d, role_id=e7989893488f483baa107be56668c4f8)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb4ec23-b6cb-4466-ae00-b473904a635a None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:37 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 769/1520] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 12:56:36 2024] PUT /identity/v3/projects/165110569f0f417d96d713b9e114929c/users/713466dc171f4a81bb59ce986a29f74d/roles/e7989893488f483baa107be56668c4f8 => generated 0 bytes in 19 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:56:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9f495b-eb5e-4518-8521-da7e20f80c94 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9f495b-eb5e-4518-8521-da7e20f80c94 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9f495b-eb5e-4518-8521-da7e20f80c94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:37 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-4e9f495b-eb5e-4518-8521-da7e20f80c94 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:56:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-4e9f495b-eb5e-4518-8521-da7e20f80c94 None None] MFA Rules not processed for user `713466dc171f4a81bb59ce986a29f74d`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:56:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-4e9f495b-eb5e-4518-8521-da7e20f80c94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:37 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 752/1521] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:56:37 2024] POST /identity/v3/auth/tokens => generated 4091 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:56:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb4ec23-b6cb-4466-ae00-b473904a635a None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb4ec23-b6cb-4466-ae00-b473904a635a None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b59078f-5094-4c4d-aad1-495e6c351275 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b59078f-5094-4c4d-aad1-495e6c351275 None admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b59078f-5094-4c4d-aad1-495e6c351275 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b59078f-5094-4c4d-aad1-495e6c351275 None admin] PATH_INFO: `/v3/users/713466dc171f4a81bb59ce986a29f74d` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b59078f-5094-4c4d-aad1-495e6c351275 None admin] RBAC: Authorizing `identity:delete_user(user_id=713466dc171f4a81bb59ce986a29f74d)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b59078f-5094-4c4d-aad1-495e6c351275 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-0b59078f-5094-4c4d-aad1-495e6c351275 None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '713466dc171f4a81bb59ce986a29f74d', 'request_id': 'req-0b59078f-5094-4c4d-aad1-495e6c351275'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-0b59078f-5094-4c4d-aad1-495e6c351275 None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '713466dc171f4a81bb59ce986a29f74d', 'request_id': 'req-0b59078f-5094-4c4d-aad1-495e6c351275'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-0b59078f-5094-4c4d-aad1-495e6c351275 None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '713466dc171f4a81bb59ce986a29f74d', 'request_id': 'req-0b59078f-5094-4c4d-aad1-495e6c351275'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-0b59078f-5094-4c4d-aad1-495e6c351275 None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '713466dc171f4a81bb59ce986a29f74d', 'request_id': 'req-0b59078f-5094-4c4d-aad1-495e6c351275'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-0b59078f-5094-4c4d-aad1-495e6c351275 None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '713466dc171f4a81bb59ce986a29f74d', 'request_id': 'req-0b59078f-5094-4c4d-aad1-495e6c351275'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:37 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 770/1522] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 12:56:37 2024] DELETE /identity/v3/users/713466dc171f4a81bb59ce986a29f74d => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:56:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3425e614-99a7-4821-9df9-b29a6a956707 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3425e614-99a7-4821-9df9-b29a6a956707 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3425e614-99a7-4821-9df9-b29a6a956707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:37 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-3425e614-99a7-4821-9df9-b29a6a956707 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:56:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-3425e614-99a7-4821-9df9-b29a6a956707 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:56:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-3425e614-99a7-4821-9df9-b29a6a956707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:37 l75lg1-v1 dstat.sh[49771]: 28-05 12:56:37| 17 1 79 2 0|5650M 1859M 277M 7840M| 22k 11k| 0 2380k| 0 292 |9074 16k|1.72 0.98 0.98|1.0 1.0 1.0| 0 0 | 0 2048M| 29 346 0 50 0 May 28 12:56:37 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 753/1523] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:56:37 2024] POST /identity/v3/auth/tokens => generated 2960 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 12:56:37 l75lg1-v1 neutron-server[77619]: DEBUG neutron.wsgi [-] (77619) accepted ('10.27.203.238', 49458) {{(pid=77619) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 12:56:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b59078f-5094-4c4d-aad1-495e6c351275 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-0b59078f-5094-4c4d-aad1-495e6c351275 None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b59078f-5094-4c4d-aad1-495e6c351275 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b2e41b-c30f-472e-bd97-f9dc7669e6ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef17047035e4b518fd5360a01f2da1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b2e41b-c30f-472e-bd97-f9dc7669e6ed service neutron] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b2e41b-c30f-472e-bd97-f9dc7669e6ed service neutron] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b2e41b-c30f-472e-bd97-f9dc7669e6ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b2e41b-c30f-472e-bd97-f9dc7669e6ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b2e41b-c30f-472e-bd97-f9dc7669e6ed service neutron] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:37 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 771/1524] 10.27.203.238 () {64 vars in 1432 bytes} [Tue May 28 12:56:37 2024] GET /identity/v3/auth/tokens => generated 2960 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 28 12:56:37 l75lg1-v1 neutron-server[77619]: INFO neutron.wsgi [None req-ec83f00e-97a0-475a-b0b2-6ce8a21db913 None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=165110569f0f417d96d713b9e114929c&name=default HTTP/1.1" status: 200 len: 216 time: 0.0738328 May 28 12:56:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3425e614-99a7-4821-9df9-b29a6a956707 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-3425e614-99a7-4821-9df9-b29a6a956707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3425e614-99a7-4821-9df9-b29a6a956707 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e75279-ac5b-487b-99b0-6297f2bfcfac None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e75279-ac5b-487b-99b0-6297f2bfcfac None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e75279-ac5b-487b-99b0-6297f2bfcfac None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e75279-ac5b-487b-99b0-6297f2bfcfac None admin] PATH_INFO: `/v3/projects/165110569f0f417d96d713b9e114929c` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e75279-ac5b-487b-99b0-6297f2bfcfac None admin] RBAC: Authorizing `identity:delete_project(project_id=165110569f0f417d96d713b9e114929c)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e75279-ac5b-487b-99b0-6297f2bfcfac None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-90e75279-ac5b-487b-99b0-6297f2bfcfac None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '165110569f0f417d96d713b9e114929c', 'request_id': 'req-90e75279-ac5b-487b-99b0-6297f2bfcfac'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-90e75279-ac5b-487b-99b0-6297f2bfcfac None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '165110569f0f417d96d713b9e114929c', 'request_id': 'req-90e75279-ac5b-487b-99b0-6297f2bfcfac'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:37 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f77454c8-a7d3-43f9-807d-8f8535202188 tempest-ShareInstancesTest-1546991288 None] <<< [GET] https://127.0.0.1:40443/api/views/ May 28 12:56:37 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f77454c8-a7d3-43f9-807d-8f8535202188 tempest-ShareInstancesTest-1546991288 None] [Bunch(abac_tags=[], abe_max_depth=None, abe_protocols=[], alias='', allow_anonymous_access=False, allow_s3_anonymous_access=False, auto_commit='0d', bucket='', bucket_creators=[], bucket_creators_groups=[], bucket_owner=None, bulk_permission_update_progress=None, bulk_permission_update_state=None, cluster='loop75-kfs', cluster_id=1, created='2024-05-28T12:56:33.976793Z', enabled=True, files_retention_mode='NONE', guid='68da276e-4e24-4262-b2a6-11db5e88b70b', id=6, ignore_oos=False, internal=False, is_remote=False, is_seamless=False, logical_capacity=0, max_retention_period=None, min_retention_period=None, name='7f6a42fa-4d45-471e-a438-36876fc6eac8', nfs_interop_flags='BOTH_NFS3_AND_NFS4_INTEROP_DISABLED', path='/manila/manila-7f6a42fa-4d45-471e-a438-36876fc6eac8', physical_capacity=0, policy='7f6a42fa-4d45-471e-a438-36876fc6eac8', policy_id=7, protocols=['NFS'], qos_policy=None, qos_policy_id=None, s3_locks=False, s3_locks_retention_mode='NONE', s3_locks_retention_period='', s3_unverified_lookup=False, s3_versioning=False, select_for_live_monitoring=False, share='', share_acl=Bunch(acl=[], enabled=False), sync='SYNCED', sync_time='2024-05-28T12:56:34.260977Z', tenant_id=1, tenant_name='default', title='/manila/manila-7f6a42fa-4d45-471e-a438-36876fc6eac8', url='https://127.0.0.1:40443/api/views/6/')] May 28 12:56:37 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f77454c8-a7d3-43f9-807d-8f8535202188 tempest-ShareInstancesTest-1546991288 None] --- [GET] https://127.0.0.1:40443/api/views/: Done May 28 12:56:37 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f77454c8-a7d3-43f9-807d-8f8535202188 tempest-ShareInstancesTest-1546991288 None] >>> [DELETE] https://127.0.0.1:40443/api/views/6/ May 28 12:56:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-90e75279-ac5b-487b-99b0-6297f2bfcfac None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '165110569f0f417d96d713b9e114929c', 'request_id': 'req-90e75279-ac5b-487b-99b0-6297f2bfcfac'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-90e75279-ac5b-487b-99b0-6297f2bfcfac None admin] The token cache is being invalidate because project 165110569f0f417d96d713b9e114929c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 12:56:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-90e75279-ac5b-487b-99b0-6297f2bfcfac None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-90e75279-ac5b-487b-99b0-6297f2bfcfac None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:37 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 754/1525] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 12:56:37 2024] DELETE /identity/v3/projects/165110569f0f417d96d713b9e114929c => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:56:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876e9cda-f774-4550-b0c0-b1f512859593 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876e9cda-f774-4550-b0c0-b1f512859593 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876e9cda-f774-4550-b0c0-b1f512859593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:37 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-876e9cda-f774-4550-b0c0-b1f512859593 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:56:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-876e9cda-f774-4550-b0c0-b1f512859593 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:56:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-876e9cda-f774-4550-b0c0-b1f512859593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:37 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 772/1526] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:56:37 2024] POST /identity/v3/auth/tokens => generated 312 bytes in 25 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 28 12:56:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7de600f-5833-4f15-ab04-286bf98b2474 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7de600f-5833-4f15-ab04-286bf98b2474 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7de600f-5833-4f15-ab04-286bf98b2474 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:37 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-e7de600f-5833-4f15-ab04-286bf98b2474 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:56:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-e7de600f-5833-4f15-ab04-286bf98b2474 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:56:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-e7de600f-5833-4f15-ab04-286bf98b2474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:37 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 755/1527] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:56:37 2024] POST /identity/v3/auth/tokens => generated 2960 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 12:56:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876e9cda-f774-4550-b0c0-b1f512859593 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876e9cda-f774-4550-b0c0-b1f512859593 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da88705-435e-407d-bf8e-4469a0f1ff67 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da88705-435e-407d-bf8e-4469a0f1ff67 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da88705-435e-407d-bf8e-4469a0f1ff67 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da88705-435e-407d-bf8e-4469a0f1ff67 None admin] PATH_INFO: `/v3/domains` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da88705-435e-407d-bf8e-4469a0f1ff67 None admin] RBAC: Adding query filter params (name=Default) {{(pid=51267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:56:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da88705-435e-407d-bf8e-4469a0f1ff67 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da88705-435e-407d-bf8e-4469a0f1ff67 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:37 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 773/1528] 10.27.203.238 () {62 vars in 1220 bytes} [Tue May 28 12:56:37 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:56:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7de600f-5833-4f15-ab04-286bf98b2474 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7de600f-5833-4f15-ab04-286bf98b2474 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:37 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-d1398587-9ef9-4c66-a88b-57675e0a8e84 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] GET http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/shares/a6fffe7e-d89b-4b6c-ada2-53d5855ef606 May 28 12:56:37 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-d1398587-9ef9-4c66-a88b-57675e0a8e84 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:37 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-d1398587-9ef9-4c66-a88b-57675e0a8e84 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f6e472-3027-47f2-b600-20f1a94e13d0 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f6e472-3027-47f2-b600-20f1a94e13d0 None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f6e472-3027-47f2-b600-20f1a94e13d0 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f6e472-3027-47f2-b600-20f1a94e13d0 None admin] PATH_INFO: `/v3/projects` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f6e472-3027-47f2-b600-20f1a94e13d0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f6e472-3027-47f2-b600-20f1a94e13d0 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:37 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-d1398587-9ef9-4c66-a88b-57675e0a8e84 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/shares/a6fffe7e-d89b-4b6c-ada2-53d5855ef606 returned with HTTP 200 May 28 12:56:37 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 110/229] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:56:37 2024] GET /share/v2/a3499cb78849424db45e54caac01de92/shares/a6fffe7e-d89b-4b6c-ada2-53d5855ef606 => generated 1371 bytes in 26 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:56:37 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-9116cb2a-8eea-4ded-b17a-cd46aed26add tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] POST http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/shares/a6fffe7e-d89b-4b6c-ada2-53d5855ef606/action May 28 12:56:37 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-9116cb2a-8eea-4ded-b17a-cd46aed26add tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Action body: b'{"extend": {"new_size": 2, "force": true}}' {{(pid=98329) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:56:37 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-9116cb2a-8eea-4ded-b17a-cd46aed26add tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Action: 'action', calling method: Controller.__getattribute__..version_select, body: {"extend": {"new_size": 2, "force": true}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:56:37 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 756/1529] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 12:56:37 2024] POST /identity/v3/projects => generated 403 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:56:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da88705-435e-407d-bf8e-4469a0f1ff67 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da88705-435e-407d-bf8e-4469a0f1ff67 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c664965-1aa6-44ae-a329-747980fc754d None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c664965-1aa6-44ae-a329-747980fc754d None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c664965-1aa6-44ae-a329-747980fc754d None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c664965-1aa6-44ae-a329-747980fc754d None admin] PATH_INFO: `/v3/users` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c664965-1aa6-44ae-a329-747980fc754d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c664965-1aa6-44ae-a329-747980fc754d None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:37 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-6c664965-1aa6-44ae-a329-747980fc754d None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 12:56:37 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 774/1530] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 12:56:37 2024] POST /identity/v3/users => generated 309 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:56:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f6e472-3027-47f2-b600-20f1a94e13d0 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f6e472-3027-47f2-b600-20f1a94e13d0 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b265c7d4-0b1a-419c-a570-b62b1084502f None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b265c7d4-0b1a-419c-a570-b62b1084502f None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b265c7d4-0b1a-419c-a570-b62b1084502f None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b265c7d4-0b1a-419c-a570-b62b1084502f None admin] PATH_INFO: `/v3/roles` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b265c7d4-0b1a-419c-a570-b62b1084502f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b265c7d4-0b1a-419c-a570-b62b1084502f None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:37 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.quota [None req-9116cb2a-8eea-4ded-b17a-cd46aed26add tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Created reservations ['6de33a8f-87ba-4ab5-a937-7be576a0d694', '6f076f71-02dd-41ea-8dcc-db05dc609e2b'] {{(pid=98329) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 12:56:37 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 757/1531] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 12:56:37 2024] GET /identity/v3/roles => generated 1680 bytes in 19 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:56:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c664965-1aa6-44ae-a329-747980fc754d None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c664965-1aa6-44ae-a329-747980fc754d None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4693c0c-d92d-4f96-b0fa-f4dd50d42725 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4693c0c-d92d-4f96-b0fa-f4dd50d42725 None admin] REQUEST_METHOD: `PUT` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4693c0c-d92d-4f96-b0fa-f4dd50d42725 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4693c0c-d92d-4f96-b0fa-f4dd50d42725 None admin] PATH_INFO: `/v3/projects/1f98449f95ae46dc9620fdf74759f276/users/7fb9164c23d94b91b7eb24b67e86801e/roles/e7989893488f483baa107be56668c4f8` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4693c0c-d92d-4f96-b0fa-f4dd50d42725 None admin] RBAC: Authorizing `identity:create_grant(project_id=1f98449f95ae46dc9620fdf74759f276, user_id=7fb9164c23d94b91b7eb24b67e86801e, role_id=e7989893488f483baa107be56668c4f8)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4693c0c-d92d-4f96-b0fa-f4dd50d42725 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:37 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.share.api [None req-9116cb2a-8eea-4ded-b17a-cd46aed26add tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Extend share request issued successfully. May 28 12:56:37 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-9116cb2a-8eea-4ded-b17a-cd46aed26add tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/shares/a6fffe7e-d89b-4b6c-ada2-53d5855ef606/action returned with HTTP 202 May 28 12:56:37 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 120/230] 10.27.203.238 () {66 vars in 1493 bytes} [Tue May 28 12:56:37 2024] POST /share/v2/a3499cb78849424db45e54caac01de92/shares/a6fffe7e-d89b-4b6c-ada2-53d5855ef606/action => generated 0 bytes in 151 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:56:37 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-56c9592b-88b3-4bc0-9b08-686f6be6a037 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] GET http://10.27.203.238/share/v1/a3499cb78849424db45e54caac01de92/shares/a6fffe7e-d89b-4b6c-ada2-53d5855ef606 May 28 12:56:37 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-56c9592b-88b3-4bc0-9b08-686f6be6a037 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:37 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-56c9592b-88b3-4bc0-9b08-686f6be6a037 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:37 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 775/1532] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 12:56:37 2024] PUT /identity/v3/projects/1f98449f95ae46dc9620fdf74759f276/users/7fb9164c23d94b91b7eb24b67e86801e/roles/e7989893488f483baa107be56668c4f8 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:56:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b265c7d4-0b1a-419c-a570-b62b1084502f None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b265c7d4-0b1a-419c-a570-b62b1084502f None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:37 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-56c9592b-88b3-4bc0-9b08-686f6be6a037 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v1/a3499cb78849424db45e54caac01de92/shares/a6fffe7e-d89b-4b6c-ada2-53d5855ef606 returned with HTTP 200 May 28 12:56:37 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 111/231] 10.27.203.238 () {62 vars in 1408 bytes} [Tue May 28 12:56:37 2024] GET /share/v1/a3499cb78849424db45e54caac01de92/shares/a6fffe7e-d89b-4b6c-ada2-53d5855ef606 => generated 953 bytes in 28 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:56:37 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9116cb2a-8eea-4ded-b17a-cd46aed26add tempest-AdminActionsTest-1749172189 None] >>> [GET] https://127.0.0.1:40443/api/quotas/ May 28 12:56:37 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9116cb2a-8eea-4ded-b17a-cd46aed26add tempest-AdminActionsTest-1749172189 None] {'allow_redirects': True, May 28 12:56:37 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9116cb2a-8eea-4ded-b17a-cd46aed26add tempest-AdminActionsTest-1749172189 None] 'params': {'name': '766fa507-2a4c-47eb-bfef-fa764b38b24c'}} May 28 12:56:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a69363-cfa6-4469-a8cf-991e2cf6b01d None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a69363-cfa6-4469-a8cf-991e2cf6b01d None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a69363-cfa6-4469-a8cf-991e2cf6b01d None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a69363-cfa6-4469-a8cf-991e2cf6b01d None admin] PATH_INFO: `/v3/roles` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a69363-cfa6-4469-a8cf-991e2cf6b01d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a69363-cfa6-4469-a8cf-991e2cf6b01d None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:37 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-af8708ad-a253-409a-9d16-73df554028fe tempest-AdminActionsNegativeTest-763023849 None] <<< [DELETE] https://127.0.0.1:40443/api/snapshots/1/ May 28 12:56:37 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-af8708ad-a253-409a-9d16-73df554028fe tempest-AdminActionsNegativeTest-763023849 None] --- [DELETE] https://127.0.0.1:40443/api/snapshots/1/: Done May 28 12:56:37 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 758/1533] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 12:56:37 2024] GET /identity/v3/roles => generated 1680 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:56:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4693c0c-d92d-4f96-b0fa-f4dd50d42725 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4693c0c-d92d-4f96-b0fa-f4dd50d42725 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42af7f96-9561-4eb3-9ecc-09a16190d71a None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42af7f96-9561-4eb3-9ecc-09a16190d71a None admin] REQUEST_METHOD: `PUT` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42af7f96-9561-4eb3-9ecc-09a16190d71a None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42af7f96-9561-4eb3-9ecc-09a16190d71a None admin] PATH_INFO: `/v3/projects/1f98449f95ae46dc9620fdf74759f276/users/7fb9164c23d94b91b7eb24b67e86801e/roles/e7989893488f483baa107be56668c4f8` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42af7f96-9561-4eb3-9ecc-09a16190d71a None admin] RBAC: Authorizing `identity:create_grant(project_id=1f98449f95ae46dc9620fdf74759f276, user_id=7fb9164c23d94b91b7eb24b67e86801e, role_id=e7989893488f483baa107be56668c4f8)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42af7f96-9561-4eb3-9ecc-09a16190d71a None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:37 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 776/1534] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 12:56:37 2024] PUT /identity/v3/projects/1f98449f95ae46dc9620fdf74759f276/users/7fb9164c23d94b91b7eb24b67e86801e/roles/e7989893488f483baa107be56668c4f8 => generated 0 bytes in 19 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:56:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70361e6d-8fbd-4a2d-875f-ca38e57d3cbf None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70361e6d-8fbd-4a2d-875f-ca38e57d3cbf None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70361e6d-8fbd-4a2d-875f-ca38e57d3cbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:37 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-70361e6d-8fbd-4a2d-875f-ca38e57d3cbf None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:56:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-70361e6d-8fbd-4a2d-875f-ca38e57d3cbf None None] MFA Rules not processed for user `7fb9164c23d94b91b7eb24b67e86801e`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:56:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-70361e6d-8fbd-4a2d-875f-ca38e57d3cbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:37 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 759/1535] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:56:37 2024] POST /identity/v3/auth/tokens => generated 4097 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:56:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42af7f96-9561-4eb3-9ecc-09a16190d71a None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42af7f96-9561-4eb3-9ecc-09a16190d71a None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48550ca9-6da9-435b-8d03-f32f15301666 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48550ca9-6da9-435b-8d03-f32f15301666 None admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48550ca9-6da9-435b-8d03-f32f15301666 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48550ca9-6da9-435b-8d03-f32f15301666 None admin] PATH_INFO: `/v3/users/7fb9164c23d94b91b7eb24b67e86801e` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48550ca9-6da9-435b-8d03-f32f15301666 None admin] RBAC: Authorizing `identity:delete_user(user_id=7fb9164c23d94b91b7eb24b67e86801e)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48550ca9-6da9-435b-8d03-f32f15301666 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:37 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-af8708ad-a253-409a-9d16-73df554028fe tempest-AdminActionsNegativeTest-763023849 None] Created reservations ['45ebab6f-a303-4abd-af08-7beabd109e06', '08df032c-5894-4c96-aad4-f68863e9640a', '96a1aeb0-6e8f-432e-b707-fa36d0c6b312', '63a65f01-6851-4fbe-84aa-7d0825a008c2'] {{(pid=98474) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 12:56:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-48550ca9-6da9-435b-8d03-f32f15301666 None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7fb9164c23d94b91b7eb24b67e86801e', 'request_id': 'req-48550ca9-6da9-435b-8d03-f32f15301666'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-48550ca9-6da9-435b-8d03-f32f15301666 None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7fb9164c23d94b91b7eb24b67e86801e', 'request_id': 'req-48550ca9-6da9-435b-8d03-f32f15301666'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-48550ca9-6da9-435b-8d03-f32f15301666 None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7fb9164c23d94b91b7eb24b67e86801e', 'request_id': 'req-48550ca9-6da9-435b-8d03-f32f15301666'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-48550ca9-6da9-435b-8d03-f32f15301666 None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7fb9164c23d94b91b7eb24b67e86801e', 'request_id': 'req-48550ca9-6da9-435b-8d03-f32f15301666'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:38 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-af8708ad-a253-409a-9d16-73df554028fe tempest-AdminActionsNegativeTest-763023849 None] Committed reservations ['45ebab6f-a303-4abd-af08-7beabd109e06', '08df032c-5894-4c96-aad4-f68863e9640a', '96a1aeb0-6e8f-432e-b707-fa36d0c6b312', '63a65f01-6851-4fbe-84aa-7d0825a008c2'] {{(pid=98474) commit /opt/stack/manila/manila/quota.py:1063}} May 28 12:56:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-48550ca9-6da9-435b-8d03-f32f15301666 None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7fb9164c23d94b91b7eb24b67e86801e', 'request_id': 'req-48550ca9-6da9-435b-8d03-f32f15301666'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:38 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 777/1536] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 12:56:37 2024] DELETE /identity/v3/users/7fb9164c23d94b91b7eb24b67e86801e => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:56:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4e8e1b-4462-40ad-845a-916bd366c3c1 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4e8e1b-4462-40ad-845a-916bd366c3c1 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4e8e1b-4462-40ad-845a-916bd366c3c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:38 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-df4e8e1b-4462-40ad-845a-916bd366c3c1 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:56:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-df4e8e1b-4462-40ad-845a-916bd366c3c1 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:56:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-df4e8e1b-4462-40ad-845a-916bd366c3c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:38 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 760/1537] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:56:38 2024] POST /identity/v3/auth/tokens => generated 2960 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 12:56:38 l75lg1-v1 neutron-server[77619]: DEBUG neutron.wsgi [-] (77619) accepted ('10.27.203.238', 49470) {{(pid=77619) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 12:56:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48550ca9-6da9-435b-8d03-f32f15301666 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-48550ca9-6da9-435b-8d03-f32f15301666 None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:38 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9116cb2a-8eea-4ded-b17a-cd46aed26add tempest-AdminActionsTest-1749172189 None] <<< [GET] https://127.0.0.1:40443/api/quotas/ May 28 12:56:38 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9116cb2a-8eea-4ded-b17a-cd46aed26add tempest-AdminActionsTest-1749172189 None] [Bunch(cluster='loop75-kfs', cluster_id=1, default_email=None, default_group_quota=None, default_user_quota=None, enable_alarms=True, enable_email_providers=True, grace_period=None, guid='a5c17ca9-e184-4bb4-abf0-b6f53ca0e25d', hard_limit=1073741824, hard_limit_inodes=None, id=5, internal=False, is_user_quota=False, last_user_quotas_update=None, name='766fa507-2a4c-47eb-bfef-fa764b38b24c', num_blocked_users=0, num_exceeded_users=0, path='/manila/manila-766fa507-2a4c-47eb-bfef-fa764b38b24c', percent_capacity=0, percent_inodes=None, pretty_grace_period=None, pretty_grace_period_expiration=None, pretty_state='OK (CREATED)', soft_limit=None, soft_limit_inodes=None, state='OK', sync_state='CREATED', system_id=5, tenant_id=1, tenant_name='default', time_to_block=None, title='766fa507-2a4c-47eb-bfef-fa764b38b24c', url='https://127.0.0.1:40443/api/quotas/5/', used_capacity=0, used_capacity_tb=0.0, used_effective_capacity=0, used_effective_capacity_tb=0.0, used_inodes=0, used_limited_capacity=0)] May 28 12:56:38 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9116cb2a-8eea-4ded-b17a-cd46aed26add tempest-AdminActionsTest-1749172189 None] --- [GET] https://127.0.0.1:40443/api/quotas/: Done May 28 12:56:38 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9116cb2a-8eea-4ded-b17a-cd46aed26add tempest-AdminActionsTest-1749172189 None] >>> [PATCH] https://127.0.0.1:40443/api/quotas/5/ May 28 12:56:38 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9116cb2a-8eea-4ded-b17a-cd46aed26add tempest-AdminActionsTest-1749172189 None] {'data': '{"hard_limit": 2147483648}', 'params': None} May 28 12:56:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48550ca9-6da9-435b-8d03-f32f15301666 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52916588-5a84-4918-a0ef-4973399903b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef17047035e4b518fd5360a01f2da1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52916588-5a84-4918-a0ef-4973399903b0 service neutron] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52916588-5a84-4918-a0ef-4973399903b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52916588-5a84-4918-a0ef-4973399903b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52916588-5a84-4918-a0ef-4973399903b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52916588-5a84-4918-a0ef-4973399903b0 service neutron] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:38 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 778/1538] 10.27.203.238 () {64 vars in 1432 bytes} [Tue May 28 12:56:38 2024] GET /identity/v3/auth/tokens => generated 2960 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 28 12:56:38 l75lg1-v1 neutron-server[77619]: INFO neutron.wsgi [None req-d4e2042b-0077-49a4-b4bd-434796cd63f4 None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=1f98449f95ae46dc9620fdf74759f276&name=default HTTP/1.1" status: 200 len: 216 time: 0.0697944 May 28 12:56:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4e8e1b-4462-40ad-845a-916bd366c3c1 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-df4e8e1b-4462-40ad-845a-916bd366c3c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4e8e1b-4462-40ad-845a-916bd366c3c1 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94a91d3-9e7d-4b18-9dae-a59ee38b9765 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94a91d3-9e7d-4b18-9dae-a59ee38b9765 None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94a91d3-9e7d-4b18-9dae-a59ee38b9765 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94a91d3-9e7d-4b18-9dae-a59ee38b9765 None admin] PATH_INFO: `/v3/projects/1f98449f95ae46dc9620fdf74759f276` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94a91d3-9e7d-4b18-9dae-a59ee38b9765 None admin] RBAC: Authorizing `identity:delete_project(project_id=1f98449f95ae46dc9620fdf74759f276)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94a91d3-9e7d-4b18-9dae-a59ee38b9765 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:38 l75lg1-v1 dstat.sh[49771]: 28-05 12:56:38| 13 1 80 5 0|5652M 1857M 277M 7840M| 16k 2808B| 0 8412k| 0 635 |9151 16k|1.72 0.98 0.98|2.0 1.0 2.0| 0 0 | 0 2048M| 29 346 0 52 0 May 28 12:56:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-a94a91d3-9e7d-4b18-9dae-a59ee38b9765 None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f98449f95ae46dc9620fdf74759f276', 'request_id': 'req-a94a91d3-9e7d-4b18-9dae-a59ee38b9765'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-a94a91d3-9e7d-4b18-9dae-a59ee38b9765 None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f98449f95ae46dc9620fdf74759f276', 'request_id': 'req-a94a91d3-9e7d-4b18-9dae-a59ee38b9765'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-a94a91d3-9e7d-4b18-9dae-a59ee38b9765 None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f98449f95ae46dc9620fdf74759f276', 'request_id': 'req-a94a91d3-9e7d-4b18-9dae-a59ee38b9765'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-a94a91d3-9e7d-4b18-9dae-a59ee38b9765 None admin] The token cache is being invalidate because project 1f98449f95ae46dc9620fdf74759f276 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 12:56:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-a94a91d3-9e7d-4b18-9dae-a59ee38b9765 None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-a94a91d3-9e7d-4b18-9dae-a59ee38b9765 None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:38 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 761/1539] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 12:56:38 2024] DELETE /identity/v3/projects/1f98449f95ae46dc9620fdf74759f276 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:56:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d1967f-43ed-4686-9b60-8ded8e68e273 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d1967f-43ed-4686-9b60-8ded8e68e273 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d1967f-43ed-4686-9b60-8ded8e68e273 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:38 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-63d1967f-43ed-4686-9b60-8ded8e68e273 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:56:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-63d1967f-43ed-4686-9b60-8ded8e68e273 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:56:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-63d1967f-43ed-4686-9b60-8ded8e68e273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:38 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 779/1540] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:56:38 2024] POST /identity/v3/auth/tokens => generated 312 bytes in 19 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 28 12:56:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8dee83-777d-45ef-853c-74d752438527 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8dee83-777d-45ef-853c-74d752438527 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8dee83-777d-45ef-853c-74d752438527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:38 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-5f8dee83-777d-45ef-853c-74d752438527 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:56:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-5f8dee83-777d-45ef-853c-74d752438527 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:56:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-5f8dee83-777d-45ef-853c-74d752438527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:38 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 762/1541] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:56:38 2024] POST /identity/v3/auth/tokens => generated 2960 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 12:56:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d1967f-43ed-4686-9b60-8ded8e68e273 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d1967f-43ed-4686-9b60-8ded8e68e273 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44de1951-27f7-47af-b985-af6e10dda37e None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44de1951-27f7-47af-b985-af6e10dda37e None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44de1951-27f7-47af-b985-af6e10dda37e None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44de1951-27f7-47af-b985-af6e10dda37e None admin] PATH_INFO: `/v3/domains` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44de1951-27f7-47af-b985-af6e10dda37e None admin] RBAC: Adding query filter params (name=Default) {{(pid=51267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:56:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44de1951-27f7-47af-b985-af6e10dda37e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44de1951-27f7-47af-b985-af6e10dda37e None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:38 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 780/1542] 10.27.203.238 () {62 vars in 1220 bytes} [Tue May 28 12:56:38 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:56:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8dee83-777d-45ef-853c-74d752438527 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8dee83-777d-45ef-853c-74d752438527 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55685f51-98ba-4d6f-8a4f-11027f5487da None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55685f51-98ba-4d6f-8a4f-11027f5487da None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55685f51-98ba-4d6f-8a4f-11027f5487da None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55685f51-98ba-4d6f-8a4f-11027f5487da None admin] PATH_INFO: `/v3/projects` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55685f51-98ba-4d6f-8a4f-11027f5487da None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55685f51-98ba-4d6f-8a4f-11027f5487da None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:38 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 763/1543] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 12:56:38 2024] POST /identity/v3/projects => generated 385 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:56:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44de1951-27f7-47af-b985-af6e10dda37e None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44de1951-27f7-47af-b985-af6e10dda37e None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3d0cd0-f850-4a50-9549-d398dd39eb1d None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3d0cd0-f850-4a50-9549-d398dd39eb1d None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3d0cd0-f850-4a50-9549-d398dd39eb1d None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3d0cd0-f850-4a50-9549-d398dd39eb1d None admin] PATH_INFO: `/v3/users` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3d0cd0-f850-4a50-9549-d398dd39eb1d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3d0cd0-f850-4a50-9549-d398dd39eb1d None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:38 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-ca3d0cd0-f850-4a50-9549-d398dd39eb1d None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 12:56:38 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 781/1544] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 12:56:38 2024] POST /identity/v3/users => generated 301 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:56:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55685f51-98ba-4d6f-8a4f-11027f5487da None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55685f51-98ba-4d6f-8a4f-11027f5487da None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d00d831-0a03-4bfa-8abb-4a93364ed9df None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d00d831-0a03-4bfa-8abb-4a93364ed9df None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d00d831-0a03-4bfa-8abb-4a93364ed9df None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d00d831-0a03-4bfa-8abb-4a93364ed9df None admin] PATH_INFO: `/v3/roles` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d00d831-0a03-4bfa-8abb-4a93364ed9df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d00d831-0a03-4bfa-8abb-4a93364ed9df None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:38 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 764/1545] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 12:56:38 2024] GET /identity/v3/roles => generated 1680 bytes in 17 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:56:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3d0cd0-f850-4a50-9549-d398dd39eb1d None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3d0cd0-f850-4a50-9549-d398dd39eb1d None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205a149c-fd8d-4dd6-8127-9bfc065d52e1 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205a149c-fd8d-4dd6-8127-9bfc065d52e1 None admin] REQUEST_METHOD: `PUT` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205a149c-fd8d-4dd6-8127-9bfc065d52e1 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205a149c-fd8d-4dd6-8127-9bfc065d52e1 None admin] PATH_INFO: `/v3/projects/1643901550e140118fc2d2e92b82cd0b/users/d9c1ce8296ce4c059b93e7cfa130b326/roles/44620cad10ae407c90c91e2c296adb04` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205a149c-fd8d-4dd6-8127-9bfc065d52e1 None admin] RBAC: Authorizing `identity:create_grant(project_id=1643901550e140118fc2d2e92b82cd0b, user_id=d9c1ce8296ce4c059b93e7cfa130b326, role_id=44620cad10ae407c90c91e2c296adb04)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205a149c-fd8d-4dd6-8127-9bfc065d52e1 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:38 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 782/1546] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 12:56:38 2024] PUT /identity/v3/projects/1643901550e140118fc2d2e92b82cd0b/users/d9c1ce8296ce4c059b93e7cfa130b326/roles/44620cad10ae407c90c91e2c296adb04 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:56:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8a5bc9-330c-4229-97ca-f15b92db550d None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8a5bc9-330c-4229-97ca-f15b92db550d None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8a5bc9-330c-4229-97ca-f15b92db550d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:38 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-eb8a5bc9-330c-4229-97ca-f15b92db550d None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:56:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-eb8a5bc9-330c-4229-97ca-f15b92db550d None None] MFA Rules not processed for user `d9c1ce8296ce4c059b93e7cfa130b326`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:56:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-eb8a5bc9-330c-4229-97ca-f15b92db550d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:38 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 765/1547] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:56:38 2024] POST /identity/v3/auth/tokens => generated 3956 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:56:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205a149c-fd8d-4dd6-8127-9bfc065d52e1 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205a149c-fd8d-4dd6-8127-9bfc065d52e1 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80062c1-96ba-4861-a911-36ef9ab6a5dd None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80062c1-96ba-4861-a911-36ef9ab6a5dd None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80062c1-96ba-4861-a911-36ef9ab6a5dd None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80062c1-96ba-4861-a911-36ef9ab6a5dd None admin] PATH_INFO: `/v3/projects` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80062c1-96ba-4861-a911-36ef9ab6a5dd None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80062c1-96ba-4861-a911-36ef9ab6a5dd None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:38 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 783/1548] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 12:56:38 2024] POST /identity/v3/projects => generated 383 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:56:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8a5bc9-330c-4229-97ca-f15b92db550d None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8a5bc9-330c-4229-97ca-f15b92db550d None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec020b72-d1af-4102-946f-0aaba1689fc5 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec020b72-d1af-4102-946f-0aaba1689fc5 None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec020b72-d1af-4102-946f-0aaba1689fc5 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec020b72-d1af-4102-946f-0aaba1689fc5 None admin] PATH_INFO: `/v3/users` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec020b72-d1af-4102-946f-0aaba1689fc5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec020b72-d1af-4102-946f-0aaba1689fc5 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:38 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-ec020b72-d1af-4102-946f-0aaba1689fc5 None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 12:56:38 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 766/1549] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 12:56:38 2024] POST /identity/v3/users => generated 300 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:56:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80062c1-96ba-4861-a911-36ef9ab6a5dd None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80062c1-96ba-4861-a911-36ef9ab6a5dd None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc1b1e6-cc0a-44f8-b9d2-41023b851a12 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc1b1e6-cc0a-44f8-b9d2-41023b851a12 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc1b1e6-cc0a-44f8-b9d2-41023b851a12 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc1b1e6-cc0a-44f8-b9d2-41023b851a12 None admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc1b1e6-cc0a-44f8-b9d2-41023b851a12 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc1b1e6-cc0a-44f8-b9d2-41023b851a12 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:38 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 784/1550] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 12:56:38 2024] GET /identity/v3/roles => generated 1680 bytes in 17 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:56:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec020b72-d1af-4102-946f-0aaba1689fc5 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec020b72-d1af-4102-946f-0aaba1689fc5 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160727aa-bc95-46b5-a47a-44a5baac6a97 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160727aa-bc95-46b5-a47a-44a5baac6a97 None admin] REQUEST_METHOD: `PUT` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160727aa-bc95-46b5-a47a-44a5baac6a97 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160727aa-bc95-46b5-a47a-44a5baac6a97 None admin] PATH_INFO: `/v3/projects/5370699c903e45df8d014898d783500e/users/57329ed828864df2acbb7817c1a45fbc/roles/44620cad10ae407c90c91e2c296adb04` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160727aa-bc95-46b5-a47a-44a5baac6a97 None admin] RBAC: Authorizing `identity:create_grant(project_id=5370699c903e45df8d014898d783500e, user_id=57329ed828864df2acbb7817c1a45fbc, role_id=44620cad10ae407c90c91e2c296adb04)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160727aa-bc95-46b5-a47a-44a5baac6a97 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:38 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 767/1551] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 12:56:38 2024] PUT /identity/v3/projects/5370699c903e45df8d014898d783500e/users/57329ed828864df2acbb7817c1a45fbc/roles/44620cad10ae407c90c91e2c296adb04 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:56:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8912a2-2feb-4529-ba98-7f63418dc1d4 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8912a2-2feb-4529-ba98-7f63418dc1d4 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8912a2-2feb-4529-ba98-7f63418dc1d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:38 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-1a8912a2-2feb-4529-ba98-7f63418dc1d4 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:56:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-1a8912a2-2feb-4529-ba98-7f63418dc1d4 None None] MFA Rules not processed for user `57329ed828864df2acbb7817c1a45fbc`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:56:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-1a8912a2-2feb-4529-ba98-7f63418dc1d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:38 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 785/1552] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:56:38 2024] POST /identity/v3/auth/tokens => generated 3954 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:56:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160727aa-bc95-46b5-a47a-44a5baac6a97 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160727aa-bc95-46b5-a47a-44a5baac6a97 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b74ab6-3bb9-48e2-b3cd-f0051c8a5cdf None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b74ab6-3bb9-48e2-b3cd-f0051c8a5cdf None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b74ab6-3bb9-48e2-b3cd-f0051c8a5cdf None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b74ab6-3bb9-48e2-b3cd-f0051c8a5cdf None admin] PATH_INFO: `/v3/projects` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b74ab6-3bb9-48e2-b3cd-f0051c8a5cdf None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b74ab6-3bb9-48e2-b3cd-f0051c8a5cdf None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:38 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 768/1553] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 12:56:38 2024] POST /identity/v3/projects => generated 385 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:56:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8912a2-2feb-4529-ba98-7f63418dc1d4 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8912a2-2feb-4529-ba98-7f63418dc1d4 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c078b7a3-3fff-4c72-bed5-f30523b2d870 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c078b7a3-3fff-4c72-bed5-f30523b2d870 None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c078b7a3-3fff-4c72-bed5-f30523b2d870 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c078b7a3-3fff-4c72-bed5-f30523b2d870 None admin] PATH_INFO: `/v3/users` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c078b7a3-3fff-4c72-bed5-f30523b2d870 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c078b7a3-3fff-4c72-bed5-f30523b2d870 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:39 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-c078b7a3-3fff-4c72-bed5-f30523b2d870 None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 12:56:39 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 786/1554] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 12:56:38 2024] POST /identity/v3/users => generated 300 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:56:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b74ab6-3bb9-48e2-b3cd-f0051c8a5cdf None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b74ab6-3bb9-48e2-b3cd-f0051c8a5cdf None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440c3b4a-27e4-4176-9ff9-3e671366b095 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440c3b4a-27e4-4176-9ff9-3e671366b095 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440c3b4a-27e4-4176-9ff9-3e671366b095 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440c3b4a-27e4-4176-9ff9-3e671366b095 None admin] PATH_INFO: `/v3/roles` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440c3b4a-27e4-4176-9ff9-3e671366b095 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440c3b4a-27e4-4176-9ff9-3e671366b095 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:39 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 769/1555] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 12:56:39 2024] GET /identity/v3/roles => generated 1680 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:56:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c078b7a3-3fff-4c72-bed5-f30523b2d870 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c078b7a3-3fff-4c72-bed5-f30523b2d870 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419f079f-8f7b-4aef-acb9-dbf1fc7d8cbd None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419f079f-8f7b-4aef-acb9-dbf1fc7d8cbd None admin] REQUEST_METHOD: `PUT` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419f079f-8f7b-4aef-acb9-dbf1fc7d8cbd None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419f079f-8f7b-4aef-acb9-dbf1fc7d8cbd None admin] PATH_INFO: `/v3/projects/43ff8cffa80748308f619a3e52a285f2/users/521b52cb8ba745709f1904fcb99154d4/roles/e7989893488f483baa107be56668c4f8` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419f079f-8f7b-4aef-acb9-dbf1fc7d8cbd None admin] RBAC: Authorizing `identity:create_grant(project_id=43ff8cffa80748308f619a3e52a285f2, user_id=521b52cb8ba745709f1904fcb99154d4, role_id=e7989893488f483baa107be56668c4f8)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419f079f-8f7b-4aef-acb9-dbf1fc7d8cbd None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:39 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 787/1556] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 12:56:39 2024] PUT /identity/v3/projects/43ff8cffa80748308f619a3e52a285f2/users/521b52cb8ba745709f1904fcb99154d4/roles/e7989893488f483baa107be56668c4f8 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:56:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440c3b4a-27e4-4176-9ff9-3e671366b095 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440c3b4a-27e4-4176-9ff9-3e671366b095 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058d9c26-849c-4868-89a1-e60ebc502b2f None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058d9c26-849c-4868-89a1-e60ebc502b2f None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058d9c26-849c-4868-89a1-e60ebc502b2f None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058d9c26-849c-4868-89a1-e60ebc502b2f None admin] PATH_INFO: `/v3/roles` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058d9c26-849c-4868-89a1-e60ebc502b2f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058d9c26-849c-4868-89a1-e60ebc502b2f None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:39 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 770/1557] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 12:56:39 2024] GET /identity/v3/roles => generated 1680 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:56:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419f079f-8f7b-4aef-acb9-dbf1fc7d8cbd None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419f079f-8f7b-4aef-acb9-dbf1fc7d8cbd None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfa7af9-3f14-4388-9431-c1e9ee4f737a None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfa7af9-3f14-4388-9431-c1e9ee4f737a None admin] REQUEST_METHOD: `PUT` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfa7af9-3f14-4388-9431-c1e9ee4f737a None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfa7af9-3f14-4388-9431-c1e9ee4f737a None admin] PATH_INFO: `/v3/projects/43ff8cffa80748308f619a3e52a285f2/users/521b52cb8ba745709f1904fcb99154d4/roles/e7989893488f483baa107be56668c4f8` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfa7af9-3f14-4388-9431-c1e9ee4f737a None admin] RBAC: Authorizing `identity:create_grant(project_id=43ff8cffa80748308f619a3e52a285f2, user_id=521b52cb8ba745709f1904fcb99154d4, role_id=e7989893488f483baa107be56668c4f8)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfa7af9-3f14-4388-9431-c1e9ee4f737a None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:39 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 788/1558] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 12:56:39 2024] PUT /identity/v3/projects/43ff8cffa80748308f619a3e52a285f2/users/521b52cb8ba745709f1904fcb99154d4/roles/e7989893488f483baa107be56668c4f8 => generated 0 bytes in 18 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:56:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375a6a1c-4f15-4554-aabd-07c9f485c51c None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375a6a1c-4f15-4554-aabd-07c9f485c51c None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375a6a1c-4f15-4554-aabd-07c9f485c51c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:39 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-375a6a1c-4f15-4554-aabd-07c9f485c51c None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:56:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-375a6a1c-4f15-4554-aabd-07c9f485c51c None None] MFA Rules not processed for user `521b52cb8ba745709f1904fcb99154d4`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:56:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-375a6a1c-4f15-4554-aabd-07c9f485c51c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:39 l75lg1-v1 dstat.sh[49771]: 28-05 12:56:39| 9 1 87 2 0|5652M 1856M 277M 7841M| 13k 571B| 0 1326k| 0 210 |7240 13k|1.72 0.98 0.98|2.0 0 0| 0 0 | 0 2048M| 29 346 0 52 0 May 28 12:56:39 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 771/1559] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:56:39 2024] POST /identity/v3/auth/tokens => generated 4079 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:56:39 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-58b24667-ed46-44f5-8f2a-12ae066d1a52 tempest-AdminActionsNegativeTest-763023849 tempest-AdminActionsNegativeTest-763023849-project-admin] GET http://10.27.203.238/share/v2/7c36a466cc2a42b195f921474b0f4de5/snapshots/330a4554-af48-41d4-8b48-7c7fa0931581 May 28 12:56:39 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-58b24667-ed46-44f5-8f2a-12ae066d1a52 tempest-AdminActionsNegativeTest-763023849 tempest-AdminActionsNegativeTest-763023849-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:39 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-58b24667-ed46-44f5-8f2a-12ae066d1a52 tempest-AdminActionsNegativeTest-763023849 tempest-AdminActionsNegativeTest-763023849-project-admin] Calling method 'ShareSnapshotMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfa7af9-3f14-4388-9431-c1e9ee4f737a None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:39 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-58b24667-ed46-44f5-8f2a-12ae066d1a52 tempest-AdminActionsNegativeTest-763023849 tempest-AdminActionsNegativeTest-763023849-project-admin] HTTP exception thrown: The resource could not be found. May 28 12:56:39 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-58b24667-ed46-44f5-8f2a-12ae066d1a52 tempest-AdminActionsNegativeTest-763023849 tempest-AdminActionsNegativeTest-763023849-project-admin] http://10.27.203.238/share/v2/7c36a466cc2a42b195f921474b0f4de5/snapshots/330a4554-af48-41d4-8b48-7c7fa0931581 returned with HTTP 404 May 28 12:56:39 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 121/232] 10.27.203.238 () {64 vars in 1460 bytes} [Tue May 28 12:56:39 2024] GET /share/v2/7c36a466cc2a42b195f921474b0f4de5/snapshots/330a4554-af48-41d4-8b48-7c7fa0931581 => generated 78 bytes in 17 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 12:56:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfa7af9-3f14-4388-9431-c1e9ee4f737a None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5221f8a7-71cb-4284-b848-7bec6f06e3a1 tempest-AccessRulesMetadataTest-1677117720 tempest-AccessRulesMetadataTest-1677117720-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '521b52cb8ba745709f1904fcb99154d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ff8cffa80748308f619a3e52a285f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5221f8a7-71cb-4284-b848-7bec6f06e3a1 tempest-AccessRulesMetadataTest-1677117720 tempest-AccessRulesMetadataTest-1677117720-project-admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5221f8a7-71cb-4284-b848-7bec6f06e3a1 tempest-AccessRulesMetadataTest-1677117720 tempest-AccessRulesMetadataTest-1677117720-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5221f8a7-71cb-4284-b848-7bec6f06e3a1 tempest-AccessRulesMetadataTest-1677117720 tempest-AccessRulesMetadataTest-1677117720-project-admin] PATH_INFO: `/v3/domains` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5221f8a7-71cb-4284-b848-7bec6f06e3a1 tempest-AccessRulesMetadataTest-1677117720 tempest-AccessRulesMetadataTest-1677117720-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=51267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:56:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5221f8a7-71cb-4284-b848-7bec6f06e3a1 tempest-AccessRulesMetadataTest-1677117720 tempest-AccessRulesMetadataTest-1677117720-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:39 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-46dcc34f-4a6c-44ad-8805-81199c011db8 tempest-AdminActionsNegativeTest-1149948660 tempest-AdminActionsNegativeTest-1149948660-project-member] GET http://10.27.203.238/share/v2/f65d9e20f04c46548e43d5b813dea402/share-replicas/detail?share_id=415272bd-25d1-465a-87fc-b0fdbc8c093c May 28 12:56:39 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-46dcc34f-4a6c-44ad-8805-81199c011db8 tempest-AdminActionsNegativeTest-1149948660 tempest-AdminActionsNegativeTest-1149948660-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:39 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-46dcc34f-4a6c-44ad-8805-81199c011db8 tempest-AdminActionsNegativeTest-1149948660 tempest-AdminActionsNegativeTest-1149948660-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5221f8a7-71cb-4284-b848-7bec6f06e3a1 tempest-AccessRulesMetadataTest-1677117720 tempest-AccessRulesMetadataTest-1677117720-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:39 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 789/1560] 10.27.203.238 () {62 vars in 1241 bytes} [Tue May 28 12:56:39 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:56:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375a6a1c-4f15-4554-aabd-07c9f485c51c None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:39 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-46dcc34f-4a6c-44ad-8805-81199c011db8 tempest-AdminActionsNegativeTest-1149948660 tempest-AdminActionsNegativeTest-1149948660-project-member] http://10.27.203.238/share/v2/f65d9e20f04c46548e43d5b813dea402/share-replicas/detail?share_id=415272bd-25d1-465a-87fc-b0fdbc8c093c returned with HTTP 200 May 28 12:56:39 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 112/233] 10.27.203.238 () {64 vars in 1476 bytes} [Tue May 28 12:56:39 2024] GET /share/v2/f65d9e20f04c46548e43d5b813dea402/share-replicas/detail?share_id=415272bd-25d1-465a-87fc-b0fdbc8c093c => generated 22 bytes in 18 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:56:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375a6a1c-4f15-4554-aabd-07c9f485c51c None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:39 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-a5ac53be-0f8f-40da-be27-b1bedd786baf tempest-AdminActionsNegativeTest-763023849 tempest-AdminActionsNegativeTest-763023849-project-admin] DELETE http://10.27.203.238/share/v2/7c36a466cc2a42b195f921474b0f4de5/shares/415272bd-25d1-465a-87fc-b0fdbc8c093c May 28 12:56:39 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-a5ac53be-0f8f-40da-be27-b1bedd786baf tempest-AdminActionsNegativeTest-763023849 tempest-AdminActionsNegativeTest-763023849-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:39 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-a5ac53be-0f8f-40da-be27-b1bedd786baf tempest-AdminActionsNegativeTest-763023849 tempest-AdminActionsNegativeTest-763023849-project-admin] Calling method 'ShareMixin.delete' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96602b3-13e8-4d81-a56b-6c3d0206d6c5 tempest-AccessRulesMetadataTest-1677117720 tempest-AccessRulesMetadataTest-1677117720-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '521b52cb8ba745709f1904fcb99154d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ff8cffa80748308f619a3e52a285f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:39 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.v1.shares [None req-a5ac53be-0f8f-40da-be27-b1bedd786baf tempest-AdminActionsNegativeTest-763023849 tempest-AdminActionsNegativeTest-763023849-project-admin] Delete share with id: 415272bd-25d1-465a-87fc-b0fdbc8c093c May 28 12:56:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96602b3-13e8-4d81-a56b-6c3d0206d6c5 tempest-AccessRulesMetadataTest-1677117720 tempest-AccessRulesMetadataTest-1677117720-project-admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96602b3-13e8-4d81-a56b-6c3d0206d6c5 tempest-AccessRulesMetadataTest-1677117720 tempest-AccessRulesMetadataTest-1677117720-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96602b3-13e8-4d81-a56b-6c3d0206d6c5 tempest-AccessRulesMetadataTest-1677117720 tempest-AccessRulesMetadataTest-1677117720-project-admin] PATH_INFO: `/v3/users` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96602b3-13e8-4d81-a56b-6c3d0206d6c5 tempest-AccessRulesMetadataTest-1677117720 tempest-AccessRulesMetadataTest-1677117720-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96602b3-13e8-4d81-a56b-6c3d0206d6c5 tempest-AccessRulesMetadataTest-1677117720 tempest-AccessRulesMetadataTest-1677117720-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:39 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-b96602b3-13e8-4d81-a56b-6c3d0206d6c5 tempest-AccessRulesMetadataTest-1677117720 tempest-AccessRulesMetadataTest-1677117720-project-admin] Truncating password to algorithm specific maximum length 72 characters. May 28 12:56:39 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-773af689-9436-4db9-b0db-d182f6650c15 tempest-ExportLocationsTest-1017217578 tempest-ExportLocationsTest-1017217578-project-admin] GET http://10.27.203.238/share/v2/87c113478e754c47aea49a8b703cd2f6/shares/a96dff4b-6e98-4085-9f3b-45735d209546 May 28 12:56:39 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-773af689-9436-4db9-b0db-d182f6650c15 tempest-ExportLocationsTest-1017217578 tempest-ExportLocationsTest-1017217578-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:39 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-773af689-9436-4db9-b0db-d182f6650c15 tempest-ExportLocationsTest-1017217578 tempest-ExportLocationsTest-1017217578-project-admin] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:39 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-773af689-9436-4db9-b0db-d182f6650c15 tempest-ExportLocationsTest-1017217578 tempest-ExportLocationsTest-1017217578-project-admin] http://10.27.203.238/share/v2/87c113478e754c47aea49a8b703cd2f6/shares/a96dff4b-6e98-4085-9f3b-45735d209546 returned with HTTP 200 May 28 12:56:39 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 113/234] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:56:39 2024] GET /share/v2/87c113478e754c47aea49a8b703cd2f6/shares/a96dff4b-6e98-4085-9f3b-45735d209546 => generated 1372 bytes in 24 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:56:39 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 772/1561] 10.27.203.238 () {64 vars in 1232 bytes} [Tue May 28 12:56:39 2024] POST /identity/v3/users => generated 433 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:56:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5221f8a7-71cb-4284-b848-7bec6f06e3a1 tempest-AccessRulesMetadataTest-1677117720 tempest-AccessRulesMetadataTest-1677117720-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5221f8a7-71cb-4284-b848-7bec6f06e3a1 tempest-AccessRulesMetadataTest-1677117720 tempest-AccessRulesMetadataTest-1677117720-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea8b4c9-30e0-4fdc-a87d-97086b2e3691 tempest-AccessRulesMetadataTest-1677117720 tempest-AccessRulesMetadataTest-1677117720-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '521b52cb8ba745709f1904fcb99154d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ff8cffa80748308f619a3e52a285f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea8b4c9-30e0-4fdc-a87d-97086b2e3691 tempest-AccessRulesMetadataTest-1677117720 tempest-AccessRulesMetadataTest-1677117720-project-admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea8b4c9-30e0-4fdc-a87d-97086b2e3691 tempest-AccessRulesMetadataTest-1677117720 tempest-AccessRulesMetadataTest-1677117720-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea8b4c9-30e0-4fdc-a87d-97086b2e3691 tempest-AccessRulesMetadataTest-1677117720 tempest-AccessRulesMetadataTest-1677117720-project-admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea8b4c9-30e0-4fdc-a87d-97086b2e3691 tempest-AccessRulesMetadataTest-1677117720 tempest-AccessRulesMetadataTest-1677117720-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea8b4c9-30e0-4fdc-a87d-97086b2e3691 tempest-AccessRulesMetadataTest-1677117720 tempest-AccessRulesMetadataTest-1677117720-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:39 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 790/1562] 10.27.203.238 () {62 vars in 1210 bytes} [Tue May 28 12:56:39 2024] GET /identity/v3/roles => generated 1680 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:56:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96602b3-13e8-4d81-a56b-6c3d0206d6c5 tempest-AccessRulesMetadataTest-1677117720 tempest-AccessRulesMetadataTest-1677117720-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96602b3-13e8-4d81-a56b-6c3d0206d6c5 tempest-AccessRulesMetadataTest-1677117720 tempest-AccessRulesMetadataTest-1677117720-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d33a4c-9bfa-4bdc-80df-1251def2e2ec tempest-AccessRulesMetadataTest-1677117720 tempest-AccessRulesMetadataTest-1677117720-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '521b52cb8ba745709f1904fcb99154d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ff8cffa80748308f619a3e52a285f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d33a4c-9bfa-4bdc-80df-1251def2e2ec tempest-AccessRulesMetadataTest-1677117720 tempest-AccessRulesMetadataTest-1677117720-project-admin] REQUEST_METHOD: `PUT` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d33a4c-9bfa-4bdc-80df-1251def2e2ec tempest-AccessRulesMetadataTest-1677117720 tempest-AccessRulesMetadataTest-1677117720-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d33a4c-9bfa-4bdc-80df-1251def2e2ec tempest-AccessRulesMetadataTest-1677117720 tempest-AccessRulesMetadataTest-1677117720-project-admin] PATH_INFO: `/v3/projects/43ff8cffa80748308f619a3e52a285f2/users/6285dcecc86746a7b4eee34cf3c3f672/roles/44620cad10ae407c90c91e2c296adb04` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d33a4c-9bfa-4bdc-80df-1251def2e2ec tempest-AccessRulesMetadataTest-1677117720 tempest-AccessRulesMetadataTest-1677117720-project-admin] RBAC: Authorizing `identity:create_grant(project_id=43ff8cffa80748308f619a3e52a285f2, user_id=6285dcecc86746a7b4eee34cf3c3f672, role_id=44620cad10ae407c90c91e2c296adb04)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d33a4c-9bfa-4bdc-80df-1251def2e2ec tempest-AccessRulesMetadataTest-1677117720 tempest-AccessRulesMetadataTest-1677117720-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:39 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 773/1563] 10.27.203.238 () {64 vars in 1571 bytes} [Tue May 28 12:56:39 2024] PUT /identity/v3/projects/43ff8cffa80748308f619a3e52a285f2/users/6285dcecc86746a7b4eee34cf3c3f672/roles/44620cad10ae407c90c91e2c296adb04 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:56:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea8b4c9-30e0-4fdc-a87d-97086b2e3691 tempest-AccessRulesMetadataTest-1677117720 tempest-AccessRulesMetadataTest-1677117720-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-9ea8b4c9-30e0-4fdc-a87d-97086b2e3691 tempest-AccessRulesMetadataTest-1677117720 tempest-AccessRulesMetadataTest-1677117720-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:39 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-a5ac53be-0f8f-40da-be27-b1bedd786baf tempest-AdminActionsNegativeTest-763023849 tempest-AdminActionsNegativeTest-763023849-project-admin] http://10.27.203.238/share/v2/7c36a466cc2a42b195f921474b0f4de5/shares/415272bd-25d1-465a-87fc-b0fdbc8c093c returned with HTTP 202 May 28 12:56:39 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 122/235] 10.27.203.238 () {64 vars in 1454 bytes} [Tue May 28 12:56:39 2024] DELETE /share/v2/7c36a466cc2a42b195f921474b0f4de5/shares/415272bd-25d1-465a-87fc-b0fdbc8c093c => generated 0 bytes in 173 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:56:39 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-ee5849e8-4807-4156-abb9-6ea0ee9c1df0 tempest-AdminActionsNegativeTest-763023849 tempest-AdminActionsNegativeTest-763023849-project-admin] GET http://10.27.203.238/share/v2/7c36a466cc2a42b195f921474b0f4de5/shares/415272bd-25d1-465a-87fc-b0fdbc8c093c May 28 12:56:39 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-ee5849e8-4807-4156-abb9-6ea0ee9c1df0 tempest-AdminActionsNegativeTest-763023849 tempest-AdminActionsNegativeTest-763023849-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:39 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-ee5849e8-4807-4156-abb9-6ea0ee9c1df0 tempest-AdminActionsNegativeTest-763023849 tempest-AdminActionsNegativeTest-763023849-project-admin] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea8b4c9-30e0-4fdc-a87d-97086b2e3691 tempest-AccessRulesMetadataTest-1677117720 tempest-AccessRulesMetadataTest-1677117720-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:39 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-ee5849e8-4807-4156-abb9-6ea0ee9c1df0 tempest-AdminActionsNegativeTest-763023849 tempest-AdminActionsNegativeTest-763023849-project-admin] http://10.27.203.238/share/v2/7c36a466cc2a42b195f921474b0f4de5/shares/415272bd-25d1-465a-87fc-b0fdbc8c093c returned with HTTP 200 May 28 12:56:39 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 123/236] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:56:39 2024] GET /share/v2/7c36a466cc2a42b195f921474b0f4de5/shares/415272bd-25d1-465a-87fc-b0fdbc8c093c => generated 1372 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 232 bytes (2 switches on core 0) May 28 12:56:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bef4a7-a39b-4eed-9502-81a9ce2c5fa3 service manila] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f110cf6300f049c897d0aab63218d1e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bef4a7-a39b-4eed-9502-81a9ce2c5fa3 service manila] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bef4a7-a39b-4eed-9502-81a9ce2c5fa3 service manila] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bef4a7-a39b-4eed-9502-81a9ce2c5fa3 service manila] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:39 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-a5ac53be-0f8f-40da-be27-b1bedd786baf tempest-AdminActionsNegativeTest-763023849 None] Acquiring lock "locked_access_rules_operation_by_share_instance_5ae9ae15-dc00-44c8-891a-9758f2b29855" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:56:39 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-a5ac53be-0f8f-40da-be27-b1bedd786baf tempest-AdminActionsNegativeTest-763023849 None] Lock "locked_access_rules_operation_by_share_instance_5ae9ae15-dc00-44c8-891a-9758f2b29855" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:56:39 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-a5ac53be-0f8f-40da-be27-b1bedd786baf tempest-AdminActionsNegativeTest-763023849 None] Lock "locked_access_rules_operation_by_share_instance_5ae9ae15-dc00-44c8-891a-9758f2b29855" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.005s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:56:39 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-a5ac53be-0f8f-40da-be27-b1bedd786baf tempest-AdminActionsNegativeTest-763023849 None] Acquiring lock "locked_access_rules_operation_by_share_instance_5ae9ae15-dc00-44c8-891a-9758f2b29855" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:56:39 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-a5ac53be-0f8f-40da-be27-b1bedd786baf tempest-AdminActionsNegativeTest-763023849 None] Lock "locked_access_rules_operation_by_share_instance_5ae9ae15-dc00-44c8-891a-9758f2b29855" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:56:39 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-a5ac53be-0f8f-40da-be27-b1bedd786baf tempest-AdminActionsNegativeTest-763023849 None] Lock "locked_access_rules_operation_by_share_instance_5ae9ae15-dc00-44c8-891a-9758f2b29855" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:56:39 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-a5ac53be-0f8f-40da-be27-b1bedd786baf tempest-AdminActionsNegativeTest-763023849 None] Acquiring lock "locked_access_rules_operation_by_share_instance_5ae9ae15-dc00-44c8-891a-9758f2b29855" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:56:39 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-a5ac53be-0f8f-40da-be27-b1bedd786baf tempest-AdminActionsNegativeTest-763023849 None] Lock "locked_access_rules_operation_by_share_instance_5ae9ae15-dc00-44c8-891a-9758f2b29855" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:56:39 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-a5ac53be-0f8f-40da-be27-b1bedd786baf tempest-AdminActionsNegativeTest-763023849 None] Lock "locked_access_rules_operation_by_share_instance_5ae9ae15-dc00-44c8-891a-9758f2b29855" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:56:39 l75lg1-v1 manila-share[98474]: DEBUG manila.share.access [None req-a5ac53be-0f8f-40da-be27-b1bedd786baf tempest-AdminActionsNegativeTest-763023849 None] All access rules have been synced for share instance 5ae9ae15-dc00-44c8-891a-9758f2b29855 belonging to share 415272bd-25d1-465a-87fc-b0fdbc8c093c. {{(pid=98474) update_access_rules /opt/stack/manila/manila/share/access.py:304}} May 28 12:56:39 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-a5ac53be-0f8f-40da-be27-b1bedd786baf tempest-AdminActionsNegativeTest-763023849 None] deleting '/manila/manila-5ae9ae15-dc00-44c8-891a-9758f2b29855' May 28 12:56:39 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a5ac53be-0f8f-40da-be27-b1bedd786baf tempest-AdminActionsNegativeTest-763023849 None] >>> [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/ May 28 12:56:39 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a5ac53be-0f8f-40da-be27-b1bedd786baf tempest-AdminActionsNegativeTest-763023849 None] {'data': '{"path": "/manila/manila-5ae9ae15-dc00-44c8-891a-9758f2b29855"}', May 28 12:56:39 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a5ac53be-0f8f-40da-be27-b1bedd786baf tempest-AdminActionsNegativeTest-763023849 None] 'params': None} May 28 12:56:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bef4a7-a39b-4eed-9502-81a9ce2c5fa3 service manila] RBAC: Authorizing `identity:validate_token()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bef4a7-a39b-4eed-9502-81a9ce2c5fa3 service manila] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:39 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 791/1564] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 12:56:39 2024] GET /identity/v3/auth/tokens => generated 4079 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 12:56:39 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-36d5085f-e7d9-4242-b789-aea8955f739b tempest-AccessRulesMetadataTest-1677117720 tempest-AccessRulesMetadataTest-1677117720-project-admin] POST http://10.27.203.238/share/v2/43ff8cffa80748308f619a3e52a285f2/types May 28 12:56:39 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-36d5085f-e7d9-4242-b789-aea8955f739b tempest-AccessRulesMetadataTest-1677117720 tempest-AccessRulesMetadataTest-1677117720-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share_type": {"name": "tempest-typeshare-type-1653009866", "extra_specs": {"driver_handles_share_servers": "False"}, "share_type_access:is_public": true}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:56:39 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-36d5085f-e7d9-4242-b789-aea8955f739b tempest-AccessRulesMetadataTest-1677117720 tempest-AccessRulesMetadataTest-1677117720-project-admin] http://10.27.203.238/share/v2/43ff8cffa80748308f619a3e52a285f2/types returned with HTTP 200 May 28 12:56:39 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 114/237] 10.27.203.238 () {66 vars in 1359 bytes} [Tue May 28 12:56:39 2024] POST /share/v2/43ff8cffa80748308f619a3e52a285f2/types => generated 623 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 231 bytes (2 switches on core 0) May 28 12:56:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d33a4c-9bfa-4bdc-80df-1251def2e2ec tempest-AccessRulesMetadataTest-1677117720 tempest-AccessRulesMetadataTest-1677117720-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-36d33a4c-9bfa-4bdc-80df-1251def2e2ec tempest-AccessRulesMetadataTest-1677117720 tempest-AccessRulesMetadataTest-1677117720-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d33a4c-9bfa-4bdc-80df-1251def2e2ec tempest-AccessRulesMetadataTest-1677117720 tempest-AccessRulesMetadataTest-1677117720-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cde8468-80e1-4dd5-9457-86ea13f6b6aa service manila] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f110cf6300f049c897d0aab63218d1e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cde8468-80e1-4dd5-9457-86ea13f6b6aa service manila] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cde8468-80e1-4dd5-9457-86ea13f6b6aa service manila] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cde8468-80e1-4dd5-9457-86ea13f6b6aa service manila] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:39 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-b4e5a3f9-b8d8-4ac3-adde-d50ef7eec562 tempest-ShareInstancesTest-1546991288 tempest-ShareInstancesTest-1546991288-project-admin] GET http://10.27.203.238/share/v2/fb2c57cefad04e97a990bd936225014d/shares/2dfffda2-1f3a-4d2e-9044-2255a211a9f0 May 28 12:56:39 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-b4e5a3f9-b8d8-4ac3-adde-d50ef7eec562 tempest-ShareInstancesTest-1546991288 tempest-ShareInstancesTest-1546991288-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:39 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-b4e5a3f9-b8d8-4ac3-adde-d50ef7eec562 tempest-ShareInstancesTest-1546991288 tempest-ShareInstancesTest-1546991288-project-admin] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cde8468-80e1-4dd5-9457-86ea13f6b6aa service manila] RBAC: Authorizing `identity:validate_token()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cde8468-80e1-4dd5-9457-86ea13f6b6aa service manila] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:39 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 774/1565] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 12:56:39 2024] GET /identity/v3/auth/tokens => generated 3956 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 12:56:39 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-51696e80-5e11-47b5-ac91-9ed14f8d6d0a tempest-AccessRulesMetadataTest-1973590610 tempest-AccessRulesMetadataTest-1973590610-project-member] POST http://10.27.203.238/share/v2/1643901550e140118fc2d2e92b82cd0b/shares May 28 12:56:39 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-51696e80-5e11-47b5-ac91-9ed14f8d6d0a tempest-AccessRulesMetadataTest-1973590610 tempest-AccessRulesMetadataTest-1973590610-project-member] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share": {"share_proto": "nfs", "description": "Tempest's share", "snapshot_id": null, "name": "tempest-tempest-created-share-1153344755", "size": 1, "metadata": {}, "is_public": false, "share_type": "1071aa1e-8bcd-482c-909b-1df990558c3a"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:56:39 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.v1.shares [None req-51696e80-5e11-47b5-ac91-9ed14f8d6d0a tempest-AccessRulesMetadataTest-1973590610 tempest-AccessRulesMetadataTest-1973590610-project-member] Create NFS share of 1 GB May 28 12:56:39 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-b4e5a3f9-b8d8-4ac3-adde-d50ef7eec562 tempest-ShareInstancesTest-1546991288 tempest-ShareInstancesTest-1546991288-project-admin] http://10.27.203.238/share/v2/fb2c57cefad04e97a990bd936225014d/shares/2dfffda2-1f3a-4d2e-9044-2255a211a9f0 returned with HTTP 200 May 28 12:56:39 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 115/238] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:56:39 2024] GET /share/v2/fb2c57cefad04e97a990bd936225014d/shares/2dfffda2-1f3a-4d2e-9044-2255a211a9f0 => generated 1371 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:56:39 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.quota [None req-51696e80-5e11-47b5-ac91-9ed14f8d6d0a tempest-AccessRulesMetadataTest-1973590610 tempest-AccessRulesMetadataTest-1973590610-project-member] Created reservations ['c539a595-620c-41ba-ac3c-6e17c9845fd9', '6ba7402e-d0c6-45dd-958f-2337635c3a98', 'ef163af1-e12a-4018-b6a0-3dc838943225', '45383f58-f42e-4bd9-aa6c-95f8d476f1bf'] {{(pid=98329) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 12:56:39 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.quota [None req-51696e80-5e11-47b5-ac91-9ed14f8d6d0a tempest-AccessRulesMetadataTest-1973590610 tempest-AccessRulesMetadataTest-1973590610-project-member] Committed reservations ['c539a595-620c-41ba-ac3c-6e17c9845fd9', '6ba7402e-d0c6-45dd-958f-2337635c3a98', 'ef163af1-e12a-4018-b6a0-3dc838943225', '45383f58-f42e-4bd9-aa6c-95f8d476f1bf'] {{(pid=98329) commit /opt/stack/manila/manila/quota.py:1063}} May 28 12:56:39 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9116cb2a-8eea-4ded-b17a-cd46aed26add tempest-AdminActionsTest-1749172189 None] <<< [PATCH] https://127.0.0.1:40443/api/quotas/5/ May 28 12:56:39 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9116cb2a-8eea-4ded-b17a-cd46aed26add tempest-AdminActionsTest-1749172189 None] Bunch(cluster='loop75-kfs', cluster_id=1, default_email=None, default_group_quota=None, default_user_quota=None, enable_alarms=True, enable_email_providers=True, grace_period=None, group_quotas=[], guid='a5c17ca9-e184-4bb4-abf0-b6f53ca0e25d', hard_limit=2147483648, hard_limit_inodes=None, id=5, internal=False, is_user_quota=False, last_user_quotas_update=None, name='766fa507-2a4c-47eb-bfef-fa764b38b24c', num_blocked_users=0, num_exceeded_users=0, path='/manila/manila-766fa507-2a4c-47eb-bfef-fa764b38b24c', percent_capacity=0, percent_inodes=None, pretty_grace_period=None, pretty_grace_period_expiration=None, pretty_state='OK (CREATED)', soft_limit=None, soft_limit_inodes=None, state='OK', sync_state='CREATED', system_id=5, tenant_id=1, tenant_name='default', time_to_block=None, title='766fa507-2a4c-47eb-bfef-fa764b38b24c', url='https://127.0.0.1:40443/api/quotas/5/', used_capacity=0, used_capacity_tb=0.0, used_effective_capacity=0, used_effective_capacity_tb=0.0, used_inodes=0, used_limited_capacity=0, user_quotas=[]) May 28 12:56:39 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9116cb2a-8eea-4ded-b17a-cd46aed26add tempest-AdminActionsTest-1749172189 None] --- [PATCH] https://127.0.0.1:40443/api/quotas/5/: Done May 28 12:56:39 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-9116cb2a-8eea-4ded-b17a-cd46aed26add tempest-AdminActionsTest-1749172189 None] Committed reservations ['6de33a8f-87ba-4ab5-a937-7be576a0d694', '6f076f71-02dd-41ea-8dcc-db05dc609e2b'] {{(pid=98474) commit /opt/stack/manila/manila/quota.py:1063}} May 28 12:56:39 l75lg1-v1 nova-conductor[83648]: DEBUG dbcounter [-] [83648] Writing DB stats nova_cell1:SELECT=1 {{(pid=83648) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:56:39 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-51696e80-5e11-47b5-ac91-9ed14f8d6d0a tempest-AccessRulesMetadataTest-1973590610 None] Starting with 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:80}} May 28 12:56:39 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-51696e80-5e11-47b5-ac91-9ed14f8d6d0a tempest-AccessRulesMetadataTest-1973590610 None] Filter OnlyHostFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:56:39 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-51696e80-5e11-47b5-ac91-9ed14f8d6d0a tempest-AccessRulesMetadataTest-1973590610 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:56:39 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.capacity [None req-51696e80-5e11-47b5-ac91-9ed14f8d6d0a tempest-AccessRulesMetadataTest-1973590610 None] Space information for share creation on host l75lg1-v1@vast#vast (requested / avail): 1/2077 {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/capacity.py:83}} May 28 12:56:39 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-51696e80-5e11-47b5-ac91-9ed14f8d6d0a tempest-AccessRulesMetadataTest-1973590610 None] Filter CapacityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:56:39 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-51696e80-5e11-47b5-ac91-9ed14f8d6d0a tempest-AccessRulesMetadataTest-1973590610 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:56:39 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-51696e80-5e11-47b5-ac91-9ed14f8d6d0a tempest-AccessRulesMetadataTest-1973590610 None] Driver Filter: Checking host 'l75lg1-v1@vast#vast' {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:37}} May 28 12:56:39 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-51696e80-5e11-47b5-ac91-9ed14f8d6d0a tempest-AccessRulesMetadataTest-1973590610 None] Filter function not set :: passing host. {{(pid=98327) _check_filter_function /opt/stack/manila/manila/scheduler/filters/driver.py:53}} May 28 12:56:39 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-51696e80-5e11-47b5-ac91-9ed14f8d6d0a tempest-AccessRulesMetadataTest-1973590610 None] Result: True {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:40}} May 28 12:56:39 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-51696e80-5e11-47b5-ac91-9ed14f8d6d0a tempest-AccessRulesMetadataTest-1973590610 None] Done checking host 'l75lg1-v1@vast#vast' {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:41}} May 28 12:56:39 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-51696e80-5e11-47b5-ac91-9ed14f8d6d0a tempest-AccessRulesMetadataTest-1973590610 None] Filter DriverFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:56:39 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-51696e80-5e11-47b5-ac91-9ed14f8d6d0a tempest-AccessRulesMetadataTest-1973590610 None] Filter ShareReplicationFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:56:39 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-51696e80-5e11-47b5-ac91-9ed14f8d6d0a tempest-AccessRulesMetadataTest-1973590610 None] Filter CreateFromSnapshotFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:56:39 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-51696e80-5e11-47b5-ac91-9ed14f8d6d0a tempest-AccessRulesMetadataTest-1973590610 None] Filter AffinityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:56:39 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-51696e80-5e11-47b5-ac91-9ed14f8d6d0a tempest-AccessRulesMetadataTest-1973590610 None] Filter AntiAffinityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:56:39 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.drivers.filter [None req-51696e80-5e11-47b5-ac91-9ed14f8d6d0a tempest-AccessRulesMetadataTest-1973590610 None] Filtered share [host: 'l75lg1-v1@vast#vast', free_capacity_gb: 2077.6229242384434, pools: None] {{(pid=98327) _schedule_share /opt/stack/manila/manila/scheduler/drivers/filter.py:268}} May 28 12:56:39 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-51696e80-5e11-47b5-ac91-9ed14f8d6d0a tempest-AccessRulesMetadataTest-1973590610 None] Checking host 'l75lg1-v1@vast#vast' {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:46}} May 28 12:56:39 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.weighers.goodness [None req-51696e80-5e11-47b5-ac91-9ed14f8d6d0a tempest-AccessRulesMetadataTest-1973590610 None] Goodness function not set :: defaulting to minimal goodness rating of 0. May 28 12:56:39 l75lg1-v1 manila-scheduler[98327]: INFO manila.scheduler.weighers.goodness [None req-51696e80-5e11-47b5-ac91-9ed14f8d6d0a tempest-AccessRulesMetadataTest-1973590610 None] Goodness function result for host l75lg1-v1@vast#vast: 0. May 28 12:56:39 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-51696e80-5e11-47b5-ac91-9ed14f8d6d0a tempest-AccessRulesMetadataTest-1973590610 None] Goodness: 0 {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:48}} May 28 12:56:39 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-51696e80-5e11-47b5-ac91-9ed14f8d6d0a tempest-AccessRulesMetadataTest-1973590610 None] Done checking host 'l75lg1-v1@vast#vast' {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:49}} May 28 12:56:39 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-51696e80-5e11-47b5-ac91-9ed14f8d6d0a tempest-AccessRulesMetadataTest-1973590610 tempest-AccessRulesMetadataTest-1973590610-project-member] http://10.27.203.238/share/v2/1643901550e140118fc2d2e92b82cd0b/shares returned with HTTP 200 May 28 12:56:39 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.drivers.filter [None req-51696e80-5e11-47b5-ac91-9ed14f8d6d0a tempest-AccessRulesMetadataTest-1973590610 None] Choosing for share: WeighedHost [host: l75lg1-v1@vast#vast, weight: 0.0] {{(pid=98327) _schedule_share /opt/stack/manila/manila/scheduler/drivers/filter.py:274}} May 28 12:56:39 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 124/239] 10.27.203.238 () {66 vars in 1362 bytes} [Tue May 28 12:56:39 2024] POST /share/v2/1643901550e140118fc2d2e92b82cd0b/shares => generated 1314 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:56:39 l75lg1-v1 manila-share[98474]: INFO manila.share.manager [None req-9116cb2a-8eea-4ded-b17a-cd46aed26add tempest-AdminActionsTest-1749172189 None] Extend share completed successfully. May 28 12:56:39 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-3b112435-2585-477c-8be8-04aea6b298b9 tempest-AccessRulesMetadataTest-1973590610 tempest-AccessRulesMetadataTest-1973590610-project-member] GET http://10.27.203.238/share/v2/1643901550e140118fc2d2e92b82cd0b/shares/b92fc06b-76d7-40f9-adef-74a07ace1027 May 28 12:56:39 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-3b112435-2585-477c-8be8-04aea6b298b9 tempest-AccessRulesMetadataTest-1973590610 tempest-AccessRulesMetadataTest-1973590610-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:39 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-3b112435-2585-477c-8be8-04aea6b298b9 tempest-AccessRulesMetadataTest-1973590610 tempest-AccessRulesMetadataTest-1973590610-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f77454c8-a7d3-43f9-807d-8f8535202188 tempest-ShareInstancesTest-1546991288 None] <<< [DELETE] https://127.0.0.1:40443/api/views/6/ May 28 12:56:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f77454c8-a7d3-43f9-807d-8f8535202188 tempest-ShareInstancesTest-1546991288 None] --- [DELETE] https://127.0.0.1:40443/api/views/6/: Done May 28 12:56:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f77454c8-a7d3-43f9-807d-8f8535202188 tempest-ShareInstancesTest-1546991288 None] >>> [GET] https://127.0.0.1:40443/api/quotas/ May 28 12:56:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f77454c8-a7d3-43f9-807d-8f8535202188 tempest-ShareInstancesTest-1546991288 None] {'allow_redirects': True, May 28 12:56:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f77454c8-a7d3-43f9-807d-8f8535202188 tempest-ShareInstancesTest-1546991288 None] 'params': {'name': '7f6a42fa-4d45-471e-a438-36876fc6eac8'}} May 28 12:56:40 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-3b112435-2585-477c-8be8-04aea6b298b9 tempest-AccessRulesMetadataTest-1973590610 tempest-AccessRulesMetadataTest-1973590610-project-member] http://10.27.203.238/share/v2/1643901550e140118fc2d2e92b82cd0b/shares/b92fc06b-76d7-40f9-adef-74a07ace1027 returned with HTTP 200 May 28 12:56:40 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 116/240] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:56:39 2024] GET /share/v2/1643901550e140118fc2d2e92b82cd0b/shares/b92fc06b-76d7-40f9-adef-74a07ace1027 => generated 1314 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:56:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a5ac53be-0f8f-40da-be27-b1bedd786baf tempest-AdminActionsNegativeTest-763023849 None] <<< [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/ May 28 12:56:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a5ac53be-0f8f-40da-be27-b1bedd786baf tempest-AdminActionsNegativeTest-763023849 None] 'OK' May 28 12:56:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a5ac53be-0f8f-40da-be27-b1bedd786baf tempest-AdminActionsNegativeTest-763023849 None] --- [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/: Done May 28 12:56:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a5ac53be-0f8f-40da-be27-b1bedd786baf tempest-AdminActionsNegativeTest-763023849 None] >>> [GET] https://127.0.0.1:40443/api/views/ May 28 12:56:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a5ac53be-0f8f-40da-be27-b1bedd786baf tempest-AdminActionsNegativeTest-763023849 None] {'allow_redirects': True, May 28 12:56:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a5ac53be-0f8f-40da-be27-b1bedd786baf tempest-AdminActionsNegativeTest-763023849 None] 'params': {'name': '5ae9ae15-dc00-44c8-891a-9758f2b29855'}} May 28 12:56:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-51696e80-5e11-47b5-ac91-9ed14f8d6d0a tempest-AccessRulesMetadataTest-1973590610 None] >>> [GET] https://127.0.0.1:40443/api/vippools/ May 28 12:56:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-51696e80-5e11-47b5-ac91-9ed14f8d6d0a tempest-AccessRulesMetadataTest-1973590610 None] {'allow_redirects': True, 'params': {'name': 'vippool-1'}} May 28 12:56:40 l75lg1-v1 dstat.sh[49771]: 28-05 12:56:40| 14 1 82 3 0|5654M 1854M 277M 7841M| 28k 2974B| 0 2023k| 0 289 |7262 12k|1.72 0.98 0.98|1.0 1.0 0| 0 0 | 0 2048M| 29 345 0 53 0 May 28 12:56:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f77454c8-a7d3-43f9-807d-8f8535202188 tempest-ShareInstancesTest-1546991288 None] <<< [GET] https://127.0.0.1:40443/api/quotas/ May 28 12:56:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f77454c8-a7d3-43f9-807d-8f8535202188 tempest-ShareInstancesTest-1546991288 None] [Bunch(cluster='loop75-kfs', cluster_id=1, default_email=None, default_group_quota=None, default_user_quota=None, enable_alarms=True, enable_email_providers=True, grace_period=None, guid='1273b39d-5d19-4c05-8891-017862c1ae23', hard_limit=1073741824, hard_limit_inodes=None, id=4, internal=False, is_user_quota=False, last_user_quotas_update=None, name='7f6a42fa-4d45-471e-a438-36876fc6eac8', num_blocked_users=0, num_exceeded_users=0, path='/manila/manila-7f6a42fa-4d45-471e-a438-36876fc6eac8', percent_capacity=0, percent_inodes=None, pretty_grace_period=None, pretty_grace_period_expiration=None, pretty_state='OK (CREATED)', soft_limit=None, soft_limit_inodes=None, state='OK', sync_state='CREATED', system_id=4, tenant_id=1, tenant_name='default', time_to_block=None, title='7f6a42fa-4d45-471e-a438-36876fc6eac8', url='https://127.0.0.1:40443/api/quotas/4/', used_capacity=0, used_capacity_tb=0.0, used_effective_capacity=0, used_effective_capacity_tb=0.0, used_inodes=0, used_limited_capacity=0)] May 28 12:56:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f77454c8-a7d3-43f9-807d-8f8535202188 tempest-ShareInstancesTest-1546991288 None] --- [GET] https://127.0.0.1:40443/api/quotas/: Done May 28 12:56:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f77454c8-a7d3-43f9-807d-8f8535202188 tempest-ShareInstancesTest-1546991288 None] >>> [DELETE] https://127.0.0.1:40443/api/quotas/4/ May 28 12:56:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a5ac53be-0f8f-40da-be27-b1bedd786baf tempest-AdminActionsNegativeTest-763023849 None] <<< [GET] https://127.0.0.1:40443/api/views/ May 28 12:56:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a5ac53be-0f8f-40da-be27-b1bedd786baf tempest-AdminActionsNegativeTest-763023849 None] [Bunch(abac_tags=[], abe_max_depth=None, abe_protocols=[], alias='', allow_anonymous_access=False, allow_s3_anonymous_access=False, auto_commit='0d', bucket='', bucket_creators=[], bucket_creators_groups=[], bucket_owner=None, bulk_permission_update_progress=None, bulk_permission_update_state=None, cluster='loop75-kfs', cluster_id=1, created='2024-05-28T12:56:29.916189Z', enabled=True, files_retention_mode='NONE', guid='dbf223a9-d53e-4626-9dec-c695925bacad', id=5, ignore_oos=False, internal=False, is_remote=False, is_seamless=False, logical_capacity=0, max_retention_period=None, min_retention_period=None, name='5ae9ae15-dc00-44c8-891a-9758f2b29855', nfs_interop_flags='BOTH_NFS3_AND_NFS4_INTEROP_DISABLED', path='/manila/manila-5ae9ae15-dc00-44c8-891a-9758f2b29855', physical_capacity=0, policy='5ae9ae15-dc00-44c8-891a-9758f2b29855', policy_id=6, protocols=['NFS'], qos_policy=None, qos_policy_id=None, s3_locks=False, s3_locks_retention_mode='NONE', s3_locks_retention_period='', s3_unverified_lookup=False, s3_versioning=False, select_for_live_monitoring=False, share='', share_acl=Bunch(acl=[], enabled=False), sync='SYNCED', sync_time='2024-05-28T12:56:30.167373Z', tenant_id=1, tenant_name='default', title='/manila/manila-5ae9ae15-dc00-44c8-891a-9758f2b29855', url='https://127.0.0.1:40443/api/views/5/')] May 28 12:56:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a5ac53be-0f8f-40da-be27-b1bedd786baf tempest-AdminActionsNegativeTest-763023849 None] --- [GET] https://127.0.0.1:40443/api/views/: Done May 28 12:56:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a5ac53be-0f8f-40da-be27-b1bedd786baf tempest-AdminActionsNegativeTest-763023849 None] >>> [DELETE] https://127.0.0.1:40443/api/views/5/ May 28 12:56:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-51696e80-5e11-47b5-ac91-9ed14f8d6d0a tempest-AccessRulesMetadataTest-1973590610 None] <<< [GET] https://127.0.0.1:40443/api/vippools/ May 28 12:56:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-51696e80-5e11-47b5-ac91-9ed14f8d6d0a tempest-AccessRulesMetadataTest-1973590610 None] [Bunch(active_cnode_ids=[], active_interfaces=4, cluster='loop75-kfs', cluster_id=1, cnode_ids=[], cnodes=[], domain_name='vippool-1', enable_l3=False, enable_weighted_balancing=False, enabled=True, end_ip='172.21.75.4', guid='f2abaede-b397-413a-8faa-3aeead6d3b28', gw_ip='', gw_ipv6='', id=2, ip_ranges=[['172.21.75.1', '172.21.75.4']], name='vippool-1', peer_asn=0, port_membership='ALL', ranges_summary='172.21.75.[1-4]', role='PROTOCOLS', start_ip='172.21.75.1', subnet_cidr=16, subnet_cidr_ipv6=None, sync='SYNCED', sync_time='2024-05-28T12:50:09.644123Z', tenant_id=1, tenant_name='default', title='172.21.75.1 - 172.21.75.4', url='https://127.0.0.1:40443/api/vippools/2/', vast_asn=0, vlan=0, vms_preferred=False)] May 28 12:56:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-51696e80-5e11-47b5-ac91-9ed14f8d6d0a tempest-AccessRulesMetadataTest-1973590610 None] --- [GET] https://127.0.0.1:40443/api/vippools/: Done May 28 12:56:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-51696e80-5e11-47b5-ac91-9ed14f8d6d0a tempest-AccessRulesMetadataTest-1973590610 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:56:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-51696e80-5e11-47b5-ac91-9ed14f8d6d0a tempest-AccessRulesMetadataTest-1973590610 None] {'allow_redirects': True, May 28 12:56:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-51696e80-5e11-47b5-ac91-9ed14f8d6d0a tempest-AccessRulesMetadataTest-1973590610 None] 'params': {'name': '95118a75-173c-4257-acef-78a246ee1c67'}} May 28 12:56:40 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-da3d8c3f-85c9-46fd-b7b2-1092be6ea856 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] GET http://10.27.203.238/share/v1/a3499cb78849424db45e54caac01de92/shares/a6fffe7e-d89b-4b6c-ada2-53d5855ef606 May 28 12:56:40 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-da3d8c3f-85c9-46fd-b7b2-1092be6ea856 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:40 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-da3d8c3f-85c9-46fd-b7b2-1092be6ea856 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-51696e80-5e11-47b5-ac91-9ed14f8d6d0a tempest-AccessRulesMetadataTest-1973590610 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:56:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-51696e80-5e11-47b5-ac91-9ed14f8d6d0a tempest-AccessRulesMetadataTest-1973590610 None] [] May 28 12:56:40 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-da3d8c3f-85c9-46fd-b7b2-1092be6ea856 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v1/a3499cb78849424db45e54caac01de92/shares/a6fffe7e-d89b-4b6c-ada2-53d5855ef606 returned with HTTP 200 May 28 12:56:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-51696e80-5e11-47b5-ac91-9ed14f8d6d0a tempest-AccessRulesMetadataTest-1973590610 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 12:56:40 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 125/241] 10.27.203.238 () {62 vars in 1408 bytes} [Tue May 28 12:56:40 2024] GET /share/v1/a3499cb78849424db45e54caac01de92/shares/a6fffe7e-d89b-4b6c-ada2-53d5855ef606 => generated 1018 bytes in 27 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:56:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-51696e80-5e11-47b5-ac91-9ed14f8d6d0a tempest-AccessRulesMetadataTest-1973590610 None] >>> [POST] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:56:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-51696e80-5e11-47b5-ac91-9ed14f8d6d0a tempest-AccessRulesMetadataTest-1973590610 None] {'data': '{"name": "95118a75-173c-4257-acef-78a246ee1c67"}', May 28 12:56:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-51696e80-5e11-47b5-ac91-9ed14f8d6d0a tempest-AccessRulesMetadataTest-1973590610 None] 'json': None, May 28 12:56:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-51696e80-5e11-47b5-ac91-9ed14f8d6d0a tempest-AccessRulesMetadataTest-1973590610 None] 'params': None} May 28 12:56:40 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-c01d9c54-f492-404d-add4-dbd8a3039b9a tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] GET http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/shares/a6fffe7e-d89b-4b6c-ada2-53d5855ef606 May 28 12:56:40 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-c01d9c54-f492-404d-add4-dbd8a3039b9a tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:40 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-c01d9c54-f492-404d-add4-dbd8a3039b9a tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:40 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-c01d9c54-f492-404d-add4-dbd8a3039b9a tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/shares/a6fffe7e-d89b-4b6c-ada2-53d5855ef606 returned with HTTP 200 May 28 12:56:40 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 117/242] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:56:40 2024] GET /share/v2/a3499cb78849424db45e54caac01de92/shares/a6fffe7e-d89b-4b6c-ada2-53d5855ef606 => generated 1371 bytes in 27 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:56:40 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-13650c51-0b49-489c-8198-5dda04325abd tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] GET http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/share-replicas/detail?share_id=a6fffe7e-d89b-4b6c-ada2-53d5855ef606 May 28 12:56:40 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-13650c51-0b49-489c-8198-5dda04325abd tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:40 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-13650c51-0b49-489c-8198-5dda04325abd tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:40 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-13650c51-0b49-489c-8198-5dda04325abd tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/share-replicas/detail?share_id=a6fffe7e-d89b-4b6c-ada2-53d5855ef606 returned with HTTP 200 May 28 12:56:40 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 126/243] 10.27.203.238 () {64 vars in 1476 bytes} [Tue May 28 12:56:40 2024] GET /share/v2/a3499cb78849424db45e54caac01de92/share-replicas/detail?share_id=a6fffe7e-d89b-4b6c-ada2-53d5855ef606 => generated 22 bytes in 26 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:56:40 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-c000e723-8995-49ec-9273-4b86621726c5 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] DELETE http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/shares/a6fffe7e-d89b-4b6c-ada2-53d5855ef606 May 28 12:56:40 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-c000e723-8995-49ec-9273-4b86621726c5 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:40 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-c000e723-8995-49ec-9273-4b86621726c5 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Calling method 'ShareMixin.delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:40 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.v1.shares [None req-c000e723-8995-49ec-9273-4b86621726c5 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Delete share with id: a6fffe7e-d89b-4b6c-ada2-53d5855ef606 May 28 12:56:41 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-c000e723-8995-49ec-9273-4b86621726c5 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/shares/a6fffe7e-d89b-4b6c-ada2-53d5855ef606 returned with HTTP 202 May 28 12:56:41 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 118/244] 10.27.203.238 () {64 vars in 1454 bytes} [Tue May 28 12:56:40 2024] DELETE /share/v2/a3499cb78849424db45e54caac01de92/shares/a6fffe7e-d89b-4b6c-ada2-53d5855ef606 => generated 0 bytes in 133 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:56:41 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-790afa02-cd28-4764-ad76-95139a75b7b6 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] GET http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/shares/a6fffe7e-d89b-4b6c-ada2-53d5855ef606 May 28 12:56:41 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-790afa02-cd28-4764-ad76-95139a75b7b6 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:41 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-790afa02-cd28-4764-ad76-95139a75b7b6 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:41 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-790afa02-cd28-4764-ad76-95139a75b7b6 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/shares/a6fffe7e-d89b-4b6c-ada2-53d5855ef606 returned with HTTP 200 May 28 12:56:41 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 127/245] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:56:41 2024] GET /share/v2/a3499cb78849424db45e54caac01de92/shares/a6fffe7e-d89b-4b6c-ada2-53d5855ef606 => generated 1370 bytes in 28 msecs (HTTP/1.1 200) 6 headers in 232 bytes (2 switches on core 0) May 28 12:56:41 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c000e723-8995-49ec-9273-4b86621726c5 tempest-AdminActionsTest-1749172189 None] Acquiring lock "locked_access_rules_operation_by_share_instance_766fa507-2a4c-47eb-bfef-fa764b38b24c" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:56:41 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c000e723-8995-49ec-9273-4b86621726c5 tempest-AdminActionsTest-1749172189 None] Lock "locked_access_rules_operation_by_share_instance_766fa507-2a4c-47eb-bfef-fa764b38b24c" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:56:41 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c000e723-8995-49ec-9273-4b86621726c5 tempest-AdminActionsTest-1749172189 None] Lock "locked_access_rules_operation_by_share_instance_766fa507-2a4c-47eb-bfef-fa764b38b24c" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:56:41 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c000e723-8995-49ec-9273-4b86621726c5 tempest-AdminActionsTest-1749172189 None] Acquiring lock "locked_access_rules_operation_by_share_instance_766fa507-2a4c-47eb-bfef-fa764b38b24c" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:56:41 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c000e723-8995-49ec-9273-4b86621726c5 tempest-AdminActionsTest-1749172189 None] Lock "locked_access_rules_operation_by_share_instance_766fa507-2a4c-47eb-bfef-fa764b38b24c" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:56:41 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c000e723-8995-49ec-9273-4b86621726c5 tempest-AdminActionsTest-1749172189 None] Lock "locked_access_rules_operation_by_share_instance_766fa507-2a4c-47eb-bfef-fa764b38b24c" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:56:41 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c000e723-8995-49ec-9273-4b86621726c5 tempest-AdminActionsTest-1749172189 None] Acquiring lock "locked_access_rules_operation_by_share_instance_766fa507-2a4c-47eb-bfef-fa764b38b24c" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:56:41 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c000e723-8995-49ec-9273-4b86621726c5 tempest-AdminActionsTest-1749172189 None] Lock "locked_access_rules_operation_by_share_instance_766fa507-2a4c-47eb-bfef-fa764b38b24c" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:56:41 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c000e723-8995-49ec-9273-4b86621726c5 tempest-AdminActionsTest-1749172189 None] Lock "locked_access_rules_operation_by_share_instance_766fa507-2a4c-47eb-bfef-fa764b38b24c" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.004s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:56:41 l75lg1-v1 manila-share[98474]: DEBUG manila.share.access [None req-c000e723-8995-49ec-9273-4b86621726c5 tempest-AdminActionsTest-1749172189 None] All access rules have been synced for share instance 766fa507-2a4c-47eb-bfef-fa764b38b24c belonging to share a6fffe7e-d89b-4b6c-ada2-53d5855ef606. {{(pid=98474) update_access_rules /opt/stack/manila/manila/share/access.py:304}} May 28 12:56:41 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-c000e723-8995-49ec-9273-4b86621726c5 tempest-AdminActionsTest-1749172189 None] deleting '/manila/manila-766fa507-2a4c-47eb-bfef-fa764b38b24c' May 28 12:56:41 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c000e723-8995-49ec-9273-4b86621726c5 tempest-AdminActionsTest-1749172189 None] >>> [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/ May 28 12:56:41 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c000e723-8995-49ec-9273-4b86621726c5 tempest-AdminActionsTest-1749172189 None] {'data': '{"path": "/manila/manila-766fa507-2a4c-47eb-bfef-fa764b38b24c"}', May 28 12:56:41 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c000e723-8995-49ec-9273-4b86621726c5 tempest-AdminActionsTest-1749172189 None] 'params': None} May 28 12:56:41 l75lg1-v1 dstat.sh[49771]: 28-05 12:56:41| 4 1 94 1 0|5655M 1853M 277M 7841M| 23k 5257B| 0 808k| 0 65.0 |2830 4554 |1.72 0.98 0.98|1.0 1.0 0| 0 0 | 0 2048M| 29 347 0 53 0 May 28 12:56:41 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c000e723-8995-49ec-9273-4b86621726c5 tempest-AdminActionsTest-1749172189 None] <<< [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/ May 28 12:56:41 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c000e723-8995-49ec-9273-4b86621726c5 tempest-AdminActionsTest-1749172189 None] 'OK' May 28 12:56:41 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c000e723-8995-49ec-9273-4b86621726c5 tempest-AdminActionsTest-1749172189 None] --- [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/: Done May 28 12:56:41 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c000e723-8995-49ec-9273-4b86621726c5 tempest-AdminActionsTest-1749172189 None] >>> [GET] https://127.0.0.1:40443/api/views/ May 28 12:56:41 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c000e723-8995-49ec-9273-4b86621726c5 tempest-AdminActionsTest-1749172189 None] {'allow_redirects': True, May 28 12:56:41 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c000e723-8995-49ec-9273-4b86621726c5 tempest-AdminActionsTest-1749172189 None] 'params': {'name': '766fa507-2a4c-47eb-bfef-fa764b38b24c'}} May 28 12:56:41 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-51696e80-5e11-47b5-ac91-9ed14f8d6d0a tempest-AccessRulesMetadataTest-1973590610 None] <<< [POST] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:56:41 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-51696e80-5e11-47b5-ac91-9ed14f8d6d0a tempest-AccessRulesMetadataTest-1973590610 None] Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=0, created='2024-05-28T12:56:41.381687Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='8ed5f8f5-e848-431c-be27-16f1fa370a60', id=9, internal=False, is_s3_default_policy=False, name='95118a75-173c-4257-acef-78a246ee1c67', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=[], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['*'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['*'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T12:56:41.744950Z', tenant_id=1, tenant_name='default', title='95118a75-173c-4257-acef-78a246ee1c67', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/9/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[]) May 28 12:56:41 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-51696e80-5e11-47b5-ac91-9ed14f8d6d0a tempest-AccessRulesMetadataTest-1973590610 None] --- [POST] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 12:56:41 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-51696e80-5e11-47b5-ac91-9ed14f8d6d0a tempest-AccessRulesMetadataTest-1973590610 None] >>> [GET] https://127.0.0.1:40443/api/quotas/ May 28 12:56:41 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-51696e80-5e11-47b5-ac91-9ed14f8d6d0a tempest-AccessRulesMetadataTest-1973590610 None] {'allow_redirects': True, May 28 12:56:41 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-51696e80-5e11-47b5-ac91-9ed14f8d6d0a tempest-AccessRulesMetadataTest-1973590610 None] 'params': {'name': '95118a75-173c-4257-acef-78a246ee1c67'}} May 28 12:56:41 l75lg1-v1 nova-scheduler[81196]: DEBUG dbcounter [-] [81196] Writing DB stats nova_cell0:SELECT=1,nova_cell0:UPDATE=1 {{(pid=81196) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:56:41 l75lg1-v1 nova-scheduler[81194]: DEBUG dbcounter [-] [81194] Writing DB stats nova_cell0:SELECT=1 {{(pid=81194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:56:41 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c000e723-8995-49ec-9273-4b86621726c5 tempest-AdminActionsTest-1749172189 None] <<< [GET] https://127.0.0.1:40443/api/views/ May 28 12:56:41 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c000e723-8995-49ec-9273-4b86621726c5 tempest-AdminActionsTest-1749172189 None] [Bunch(abac_tags=[], abe_max_depth=None, abe_protocols=[], alias='', allow_anonymous_access=False, allow_s3_anonymous_access=False, auto_commit='0d', bucket='', bucket_creators=[], bucket_creators_groups=[], bucket_owner=None, bulk_permission_update_progress=None, bulk_permission_update_state=None, cluster='loop75-kfs', cluster_id=1, created='2024-05-28T12:56:35.674217Z', enabled=True, files_retention_mode='NONE', guid='f1412880-5ed7-4a00-917b-8d42d0aaf91b', id=7, ignore_oos=False, internal=False, is_remote=False, is_seamless=False, logical_capacity=0, max_retention_period=None, min_retention_period=None, name='766fa507-2a4c-47eb-bfef-fa764b38b24c', nfs_interop_flags='BOTH_NFS3_AND_NFS4_INTEROP_DISABLED', path='/manila/manila-766fa507-2a4c-47eb-bfef-fa764b38b24c', physical_capacity=0, policy='766fa507-2a4c-47eb-bfef-fa764b38b24c', policy_id=8, protocols=['NFS'], qos_policy=None, qos_policy_id=None, s3_locks=False, s3_locks_retention_mode='NONE', s3_locks_retention_period='', s3_unverified_lookup=False, s3_versioning=False, select_for_live_monitoring=False, share='', share_acl=Bunch(acl=[], enabled=False), sync='SYNCED', sync_time='2024-05-28T12:56:36.217355Z', tenant_id=1, tenant_name='default', title='/manila/manila-766fa507-2a4c-47eb-bfef-fa764b38b24c', url='https://127.0.0.1:40443/api/views/7/')] May 28 12:56:42 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c000e723-8995-49ec-9273-4b86621726c5 tempest-AdminActionsTest-1749172189 None] --- [GET] https://127.0.0.1:40443/api/views/: Done May 28 12:56:42 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c000e723-8995-49ec-9273-4b86621726c5 tempest-AdminActionsTest-1749172189 None] >>> [DELETE] https://127.0.0.1:40443/api/views/7/ May 28 12:56:42 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-51696e80-5e11-47b5-ac91-9ed14f8d6d0a tempest-AccessRulesMetadataTest-1973590610 None] <<< [GET] https://127.0.0.1:40443/api/quotas/ May 28 12:56:42 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-51696e80-5e11-47b5-ac91-9ed14f8d6d0a tempest-AccessRulesMetadataTest-1973590610 None] [] May 28 12:56:42 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-51696e80-5e11-47b5-ac91-9ed14f8d6d0a tempest-AccessRulesMetadataTest-1973590610 None] --- [GET] https://127.0.0.1:40443/api/quotas/: Done May 28 12:56:42 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-51696e80-5e11-47b5-ac91-9ed14f8d6d0a tempest-AccessRulesMetadataTest-1973590610 None] >>> [POST] https://127.0.0.1:40443/api/quotas/ May 28 12:56:42 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-51696e80-5e11-47b5-ac91-9ed14f8d6d0a tempest-AccessRulesMetadataTest-1973590610 None] {'data': '{"name": "95118a75-173c-4257-acef-78a246ee1c67", "path": ' May 28 12:56:42 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-51696e80-5e11-47b5-ac91-9ed14f8d6d0a tempest-AccessRulesMetadataTest-1973590610 None] '"/manila/manila-95118a75-173c-4257-acef-78a246ee1c67", "create_dir": ' May 28 12:56:42 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-51696e80-5e11-47b5-ac91-9ed14f8d6d0a tempest-AccessRulesMetadataTest-1973590610 None] 'true, "hard_limit": 1073741824}', May 28 12:56:42 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-51696e80-5e11-47b5-ac91-9ed14f8d6d0a tempest-AccessRulesMetadataTest-1973590610 None] 'json': None, May 28 12:56:42 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-51696e80-5e11-47b5-ac91-9ed14f8d6d0a tempest-AccessRulesMetadataTest-1973590610 None] 'params': None} May 28 12:56:42 l75lg1-v1 dstat.sh[49771]: 28-05 12:56:42| 1 0 97 1 0|5655M 1853M 277M 7841M| 23k 2984B| 0 588k| 0 73.0 |2605 4256 |1.74 1.00 0.99|1.0 0 0| 0 0 | 0 2048M| 29 347 0 53 0 May 28 12:56:42 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-6e18468c-fde3-4d24-ab66-d6ae02db597a tempest-ExportLocationsTest-1017217578 tempest-ExportLocationsTest-1017217578-project-admin] GET http://10.27.203.238/share/v2/87c113478e754c47aea49a8b703cd2f6/shares/a96dff4b-6e98-4085-9f3b-45735d209546 May 28 12:56:42 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-6e18468c-fde3-4d24-ab66-d6ae02db597a tempest-ExportLocationsTest-1017217578 tempest-ExportLocationsTest-1017217578-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:42 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-6e18468c-fde3-4d24-ab66-d6ae02db597a tempest-ExportLocationsTest-1017217578 tempest-ExportLocationsTest-1017217578-project-admin] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:42 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-6e18468c-fde3-4d24-ab66-d6ae02db597a tempest-ExportLocationsTest-1017217578 tempest-ExportLocationsTest-1017217578-project-admin] http://10.27.203.238/share/v2/87c113478e754c47aea49a8b703cd2f6/shares/a96dff4b-6e98-4085-9f3b-45735d209546 returned with HTTP 200 May 28 12:56:42 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 119/246] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:56:42 2024] GET /share/v2/87c113478e754c47aea49a8b703cd2f6/shares/a96dff4b-6e98-4085-9f3b-45735d209546 => generated 1372 bytes in 27 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:56:42 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-5ae2f13a-87d1-4600-bbfd-1cc2a9764683 tempest-AdminActionsNegativeTest-763023849 tempest-AdminActionsNegativeTest-763023849-project-admin] GET http://10.27.203.238/share/v2/7c36a466cc2a42b195f921474b0f4de5/shares/415272bd-25d1-465a-87fc-b0fdbc8c093c May 28 12:56:42 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-5ae2f13a-87d1-4600-bbfd-1cc2a9764683 tempest-AdminActionsNegativeTest-763023849 tempest-AdminActionsNegativeTest-763023849-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:42 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-5ae2f13a-87d1-4600-bbfd-1cc2a9764683 tempest-AdminActionsNegativeTest-763023849 tempest-AdminActionsNegativeTest-763023849-project-admin] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:42 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-5ae2f13a-87d1-4600-bbfd-1cc2a9764683 tempest-AdminActionsNegativeTest-763023849 tempest-AdminActionsNegativeTest-763023849-project-admin] http://10.27.203.238/share/v2/7c36a466cc2a42b195f921474b0f4de5/shares/415272bd-25d1-465a-87fc-b0fdbc8c093c returned with HTTP 200 May 28 12:56:42 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 128/247] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:56:42 2024] GET /share/v2/7c36a466cc2a42b195f921474b0f4de5/shares/415272bd-25d1-465a-87fc-b0fdbc8c093c => generated 1372 bytes in 25 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:56:42 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a5ac53be-0f8f-40da-be27-b1bedd786baf tempest-AdminActionsNegativeTest-763023849 None] <<< [DELETE] https://127.0.0.1:40443/api/views/5/ May 28 12:56:42 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a5ac53be-0f8f-40da-be27-b1bedd786baf tempest-AdminActionsNegativeTest-763023849 None] --- [DELETE] https://127.0.0.1:40443/api/views/5/: Done May 28 12:56:42 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a5ac53be-0f8f-40da-be27-b1bedd786baf tempest-AdminActionsNegativeTest-763023849 None] >>> [GET] https://127.0.0.1:40443/api/quotas/ May 28 12:56:42 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a5ac53be-0f8f-40da-be27-b1bedd786baf tempest-AdminActionsNegativeTest-763023849 None] {'allow_redirects': True, May 28 12:56:42 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a5ac53be-0f8f-40da-be27-b1bedd786baf tempest-AdminActionsNegativeTest-763023849 None] 'params': {'name': '5ae9ae15-dc00-44c8-891a-9758f2b29855'}} May 28 12:56:42 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-f4826e72-048f-4fc9-b603-42030b12ee0c tempest-ShareInstancesTest-1546991288 tempest-ShareInstancesTest-1546991288-project-admin] GET http://10.27.203.238/share/v2/fb2c57cefad04e97a990bd936225014d/shares/2dfffda2-1f3a-4d2e-9044-2255a211a9f0 May 28 12:56:42 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-f4826e72-048f-4fc9-b603-42030b12ee0c tempest-ShareInstancesTest-1546991288 tempest-ShareInstancesTest-1546991288-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:42 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-f4826e72-048f-4fc9-b603-42030b12ee0c tempest-ShareInstancesTest-1546991288 tempest-ShareInstancesTest-1546991288-project-admin] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:42 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-f4826e72-048f-4fc9-b603-42030b12ee0c tempest-ShareInstancesTest-1546991288 tempest-ShareInstancesTest-1546991288-project-admin] http://10.27.203.238/share/v2/fb2c57cefad04e97a990bd936225014d/shares/2dfffda2-1f3a-4d2e-9044-2255a211a9f0 returned with HTTP 200 May 28 12:56:42 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 120/248] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:56:42 2024] GET /share/v2/fb2c57cefad04e97a990bd936225014d/shares/2dfffda2-1f3a-4d2e-9044-2255a211a9f0 => generated 1371 bytes in 27 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:56:42 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a5ac53be-0f8f-40da-be27-b1bedd786baf tempest-AdminActionsNegativeTest-763023849 None] <<< [GET] https://127.0.0.1:40443/api/quotas/ May 28 12:56:42 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a5ac53be-0f8f-40da-be27-b1bedd786baf tempest-AdminActionsNegativeTest-763023849 None] [Bunch(cluster='loop75-kfs', cluster_id=1, default_email=None, default_group_quota=None, default_user_quota=None, enable_alarms=True, enable_email_providers=True, grace_period=None, guid='ff6f6fdd-2236-48ab-83ca-902f3e1f5933', hard_limit=1073741824, hard_limit_inodes=None, id=3, internal=False, is_user_quota=False, last_user_quotas_update=None, name='5ae9ae15-dc00-44c8-891a-9758f2b29855', num_blocked_users=0, num_exceeded_users=0, path='/manila/manila-5ae9ae15-dc00-44c8-891a-9758f2b29855', percent_capacity=0, percent_inodes=None, pretty_grace_period=None, pretty_grace_period_expiration=None, pretty_state='OK (Calculating)', soft_limit=None, soft_limit_inodes=None, state='OK', sync_state='Calculating', system_id=3, tenant_id=1, tenant_name='default', time_to_block=None, title='5ae9ae15-dc00-44c8-891a-9758f2b29855', url='https://127.0.0.1:40443/api/quotas/3/', used_capacity=0, used_capacity_tb=0.0, used_effective_capacity=0, used_effective_capacity_tb=0.0, used_inodes=0, used_limited_capacity=0)] May 28 12:56:42 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a5ac53be-0f8f-40da-be27-b1bedd786baf tempest-AdminActionsNegativeTest-763023849 None] --- [GET] https://127.0.0.1:40443/api/quotas/: Done May 28 12:56:42 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a5ac53be-0f8f-40da-be27-b1bedd786baf tempest-AdminActionsNegativeTest-763023849 None] >>> [DELETE] https://127.0.0.1:40443/api/quotas/3/ May 28 12:56:43 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-4e09bb59-6a8b-43e1-b6dd-40707a5c5875 tempest-AccessRulesMetadataTest-1973590610 tempest-AccessRulesMetadataTest-1973590610-project-member] GET http://10.27.203.238/share/v2/1643901550e140118fc2d2e92b82cd0b/shares/b92fc06b-76d7-40f9-adef-74a07ace1027 May 28 12:56:43 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-4e09bb59-6a8b-43e1-b6dd-40707a5c5875 tempest-AccessRulesMetadataTest-1973590610 tempest-AccessRulesMetadataTest-1973590610-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:43 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-4e09bb59-6a8b-43e1-b6dd-40707a5c5875 tempest-AccessRulesMetadataTest-1973590610 tempest-AccessRulesMetadataTest-1973590610-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:43 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-4e09bb59-6a8b-43e1-b6dd-40707a5c5875 tempest-AccessRulesMetadataTest-1973590610 tempest-AccessRulesMetadataTest-1973590610-project-member] http://10.27.203.238/share/v2/1643901550e140118fc2d2e92b82cd0b/shares/b92fc06b-76d7-40f9-adef-74a07ace1027 returned with HTTP 200 May 28 12:56:43 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 129/249] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:56:43 2024] GET /share/v2/1643901550e140118fc2d2e92b82cd0b/shares/b92fc06b-76d7-40f9-adef-74a07ace1027 => generated 1316 bytes in 26 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:56:43 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-51696e80-5e11-47b5-ac91-9ed14f8d6d0a tempest-AccessRulesMetadataTest-1973590610 None] <<< [POST] https://127.0.0.1:40443/api/quotas/ May 28 12:56:43 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-51696e80-5e11-47b5-ac91-9ed14f8d6d0a tempest-AccessRulesMetadataTest-1973590610 None] Bunch(cluster='loop75-kfs', cluster_id=1, default_email=None, default_group_quota=None, default_user_quota=None, enable_alarms=True, enable_email_providers=True, grace_period=None, group_quotas=[], guid='38d04e3d-1aad-4e01-bf01-dff30a7380fb', hard_limit=1073741824, hard_limit_inodes=None, id=6, internal=False, is_user_quota=False, last_user_quotas_update=None, name='95118a75-173c-4257-acef-78a246ee1c67', num_blocked_users=0, num_exceeded_users=0, path='/manila/manila-95118a75-173c-4257-acef-78a246ee1c67', percent_capacity=0, percent_inodes=None, pretty_grace_period=None, pretty_grace_period_expiration=None, pretty_state='OK (CREATED)', soft_limit=None, soft_limit_inodes=None, state='OK', sync_state='CREATED', system_id=6, tenant_id=1, tenant_name='default', time_to_block=None, title='95118a75-173c-4257-acef-78a246ee1c67', url='https://127.0.0.1:40443/api/quotas/6/', used_capacity=0, used_capacity_tb=0.0, used_effective_capacity=0, used_effective_capacity_tb=0.0, used_inodes=0, used_limited_capacity=0, user_quotas=[]) May 28 12:56:43 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-51696e80-5e11-47b5-ac91-9ed14f8d6d0a tempest-AccessRulesMetadataTest-1973590610 None] --- [POST] https://127.0.0.1:40443/api/quotas/: Done May 28 12:56:43 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-51696e80-5e11-47b5-ac91-9ed14f8d6d0a tempest-AccessRulesMetadataTest-1973590610 None] >>> [GET] https://127.0.0.1:40443/api/views/ May 28 12:56:43 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-51696e80-5e11-47b5-ac91-9ed14f8d6d0a tempest-AccessRulesMetadataTest-1973590610 None] {'allow_redirects': True, May 28 12:56:43 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-51696e80-5e11-47b5-ac91-9ed14f8d6d0a tempest-AccessRulesMetadataTest-1973590610 None] 'params': {'name': '95118a75-173c-4257-acef-78a246ee1c67'}} May 28 12:56:43 l75lg1-v1 dstat.sh[49771]: 28-05 12:56:43| 2 0 96 1 0|5655M 1853M 277M 7841M| 20k 1382B| 0 7482k| 0 575 |2406 3595 |1.74 1.00 0.99|1.0 0 0| 0 0 | 0 2048M| 29 347 0 54 0 May 28 12:56:43 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-51696e80-5e11-47b5-ac91-9ed14f8d6d0a tempest-AccessRulesMetadataTest-1973590610 None] <<< [GET] https://127.0.0.1:40443/api/views/ May 28 12:56:43 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-51696e80-5e11-47b5-ac91-9ed14f8d6d0a tempest-AccessRulesMetadataTest-1973590610 None] [] May 28 12:56:43 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-51696e80-5e11-47b5-ac91-9ed14f8d6d0a tempest-AccessRulesMetadataTest-1973590610 None] --- [GET] https://127.0.0.1:40443/api/views/: Done May 28 12:56:43 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-51696e80-5e11-47b5-ac91-9ed14f8d6d0a tempest-AccessRulesMetadataTest-1973590610 None] >>> [POST] https://127.0.0.1:40443/api/views/ May 28 12:56:43 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-51696e80-5e11-47b5-ac91-9ed14f8d6d0a tempest-AccessRulesMetadataTest-1973590610 None] {'data': '{"name": "95118a75-173c-4257-acef-78a246ee1c67", "path": ' May 28 12:56:43 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-51696e80-5e11-47b5-ac91-9ed14f8d6d0a tempest-AccessRulesMetadataTest-1973590610 None] '"/manila/manila-95118a75-173c-4257-acef-78a246ee1c67", "policy_id": ' May 28 12:56:43 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-51696e80-5e11-47b5-ac91-9ed14f8d6d0a tempest-AccessRulesMetadataTest-1973590610 None] '9, "create_dir": true, "protocols": ["NFS"]}', May 28 12:56:43 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-51696e80-5e11-47b5-ac91-9ed14f8d6d0a tempest-AccessRulesMetadataTest-1973590610 None] 'json': None, May 28 12:56:43 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-51696e80-5e11-47b5-ac91-9ed14f8d6d0a tempest-AccessRulesMetadataTest-1973590610 None] 'params': None} May 28 12:56:44 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c000e723-8995-49ec-9273-4b86621726c5 tempest-AdminActionsTest-1749172189 None] <<< [DELETE] https://127.0.0.1:40443/api/views/7/ May 28 12:56:44 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c000e723-8995-49ec-9273-4b86621726c5 tempest-AdminActionsTest-1749172189 None] --- [DELETE] https://127.0.0.1:40443/api/views/7/: Done May 28 12:56:44 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c000e723-8995-49ec-9273-4b86621726c5 tempest-AdminActionsTest-1749172189 None] >>> [GET] https://127.0.0.1:40443/api/quotas/ May 28 12:56:44 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c000e723-8995-49ec-9273-4b86621726c5 tempest-AdminActionsTest-1749172189 None] {'allow_redirects': True, May 28 12:56:44 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c000e723-8995-49ec-9273-4b86621726c5 tempest-AdminActionsTest-1749172189 None] 'params': {'name': '766fa507-2a4c-47eb-bfef-fa764b38b24c'}} May 28 12:56:44 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-0b2a6987-59d0-436d-ae31-510c5fc1a747 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] GET http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/shares/a6fffe7e-d89b-4b6c-ada2-53d5855ef606 May 28 12:56:44 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-0b2a6987-59d0-436d-ae31-510c5fc1a747 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:44 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-0b2a6987-59d0-436d-ae31-510c5fc1a747 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:44 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-0b2a6987-59d0-436d-ae31-510c5fc1a747 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/shares/a6fffe7e-d89b-4b6c-ada2-53d5855ef606 returned with HTTP 200 May 28 12:56:44 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 121/250] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:56:44 2024] GET /share/v2/a3499cb78849424db45e54caac01de92/shares/a6fffe7e-d89b-4b6c-ada2-53d5855ef606 => generated 1370 bytes in 27 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:56:44 l75lg1-v1 dstat.sh[49771]: 28-05 12:56:44| 1 1 98 0 0|5655M 1852M 277M 7841M| 16k 4948B| 0 308k| 0 21.0 |1815 2745 |1.74 1.00 0.99|1.0 0 0| 0 0 | 0 2048M| 29 347 0 50 0 May 28 12:56:44 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c000e723-8995-49ec-9273-4b86621726c5 tempest-AdminActionsTest-1749172189 None] <<< [GET] https://127.0.0.1:40443/api/quotas/ May 28 12:56:44 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c000e723-8995-49ec-9273-4b86621726c5 tempest-AdminActionsTest-1749172189 None] [Bunch(cluster='loop75-kfs', cluster_id=1, default_email=None, default_group_quota=None, default_user_quota=None, enable_alarms=True, enable_email_providers=True, grace_period=None, guid='a5c17ca9-e184-4bb4-abf0-b6f53ca0e25d', hard_limit=2147483648, hard_limit_inodes=None, id=5, internal=False, is_user_quota=False, last_user_quotas_update=None, name='766fa507-2a4c-47eb-bfef-fa764b38b24c', num_blocked_users=0, num_exceeded_users=0, path='/manila/manila-766fa507-2a4c-47eb-bfef-fa764b38b24c', percent_capacity=0, percent_inodes=None, pretty_grace_period=None, pretty_grace_period_expiration=None, pretty_state='OK (Calculating)', soft_limit=None, soft_limit_inodes=None, state='OK', sync_state='Calculating', system_id=5, tenant_id=1, tenant_name='default', time_to_block=None, title='766fa507-2a4c-47eb-bfef-fa764b38b24c', url='https://127.0.0.1:40443/api/quotas/5/', used_capacity=0, used_capacity_tb=0.0, used_effective_capacity=0, used_effective_capacity_tb=0.0, used_inodes=0, used_limited_capacity=0)] May 28 12:56:44 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c000e723-8995-49ec-9273-4b86621726c5 tempest-AdminActionsTest-1749172189 None] --- [GET] https://127.0.0.1:40443/api/quotas/: Done May 28 12:56:44 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c000e723-8995-49ec-9273-4b86621726c5 tempest-AdminActionsTest-1749172189 None] >>> [DELETE] https://127.0.0.1:40443/api/quotas/5/ May 28 12:56:44 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-51696e80-5e11-47b5-ac91-9ed14f8d6d0a tempest-AccessRulesMetadataTest-1973590610 None] <<< [POST] https://127.0.0.1:40443/api/views/ May 28 12:56:44 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-51696e80-5e11-47b5-ac91-9ed14f8d6d0a tempest-AccessRulesMetadataTest-1973590610 None] Bunch(abac_tags=[], abe_max_depth=None, abe_protocols=[], alias='', allow_anonymous_access=False, allow_s3_anonymous_access=False, auto_commit='0d', bucket='', bucket_creators=[], bucket_creators_groups=[], bucket_owner=None, bulk_permission_update_progress=None, bulk_permission_update_state=None, cluster='loop75-kfs', cluster_id=1, created='2024-05-28T12:56:44.385283Z', enabled=True, files_retention_mode='NONE', guid='94362987-116f-4740-996f-65db61f40c56', id=8, ignore_oos=False, internal=False, is_remote=False, is_seamless=False, logical_capacity=0, max_retention_period=None, min_retention_period=None, name='95118a75-173c-4257-acef-78a246ee1c67', nfs_interop_flags='BOTH_NFS3_AND_NFS4_INTEROP_DISABLED', path='/manila/manila-95118a75-173c-4257-acef-78a246ee1c67', physical_capacity=0, policy='95118a75-173c-4257-acef-78a246ee1c67', policy_id=9, protocols=['NFS'], qos_policy=None, qos_policy_id=None, s3_locks=False, s3_locks_retention_mode='NONE', s3_locks_retention_period='', s3_object_ownership_rule='ObjectWriter', s3_unverified_lookup=False, s3_versioning=False, select_for_live_monitoring=False, share='', share_acl=Bunch(acl=[], enabled=False), sync='SYNCED', sync_time='2024-05-28T12:56:44.680235Z', tenant_id=1, tenant_name='default', title='/manila/manila-95118a75-173c-4257-acef-78a246ee1c67', url='https://127.0.0.1:40443/api/views/8/') May 28 12:56:44 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-51696e80-5e11-47b5-ac91-9ed14f8d6d0a tempest-AccessRulesMetadataTest-1973590610 None] --- [POST] https://127.0.0.1:40443/api/views/: Done May 28 12:56:44 l75lg1-v1 manila-share[98474]: INFO manila.share.manager [None req-51696e80-5e11-47b5-ac91-9ed14f8d6d0a tempest-AccessRulesMetadataTest-1973590610 None] Share instance 95118a75-173c-4257-acef-78a246ee1c67 created successfully. May 28 12:56:44 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-72f3d118-a786-4564-9cb7-cb9c1235c2d6 tempest-ExportLocationsTest-1017217578 None] <<< [DELETE] https://127.0.0.1:40443/api/quotas/2/ May 28 12:56:44 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-72f3d118-a786-4564-9cb7-cb9c1235c2d6 tempest-ExportLocationsTest-1017217578 None] --- [DELETE] https://127.0.0.1:40443/api/quotas/2/: Done May 28 12:56:44 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-72f3d118-a786-4564-9cb7-cb9c1235c2d6 tempest-ExportLocationsTest-1017217578 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:56:44 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-72f3d118-a786-4564-9cb7-cb9c1235c2d6 tempest-ExportLocationsTest-1017217578 None] {'allow_redirects': True, May 28 12:56:44 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-72f3d118-a786-4564-9cb7-cb9c1235c2d6 tempest-ExportLocationsTest-1017217578 None] 'params': {'name': '83d10127-dfed-433a-90d1-4f0a7f981edc'}} May 28 12:56:45 l75lg1-v1 dstat.sh[49771]: 28-05 12:56:45| 2 0 98 0 0|5655M 1852M 277M 7841M| 15k 2654B| 0 548k| 0 53.0 |2043 3249 |1.74 1.00 0.99|2.0 0 0| 0 0 | 0 2048M| 29 347 0 50 0 May 28 12:56:45 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-72f3d118-a786-4564-9cb7-cb9c1235c2d6 tempest-ExportLocationsTest-1017217578 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:56:45 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-72f3d118-a786-4564-9cb7-cb9c1235c2d6 tempest-ExportLocationsTest-1017217578 None] [Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=0, created='2024-05-28T12:56:26.373168Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='22ae3b95-a3e6-48fb-b74b-1172b78a702b', id=5, internal=False, is_s3_default_policy=False, name='83d10127-dfed-433a-90d1-4f0a7f981edc', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=[], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['*'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['*'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T12:56:26.706386Z', tenant_id=1, tenant_name='default', title='83d10127-dfed-433a-90d1-4f0a7f981edc', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/5/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[])] May 28 12:56:45 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-72f3d118-a786-4564-9cb7-cb9c1235c2d6 tempest-ExportLocationsTest-1017217578 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 12:56:45 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-72f3d118-a786-4564-9cb7-cb9c1235c2d6 tempest-ExportLocationsTest-1017217578 None] >>> [DELETE] https://127.0.0.1:40443/api/viewpolicies/5/ May 28 12:56:45 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-114783c1-da38-424f-b4fa-edad5178bb19 tempest-ExportLocationsTest-1017217578 tempest-ExportLocationsTest-1017217578-project-admin] GET http://10.27.203.238/share/v2/87c113478e754c47aea49a8b703cd2f6/shares/a96dff4b-6e98-4085-9f3b-45735d209546 May 28 12:56:45 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-114783c1-da38-424f-b4fa-edad5178bb19 tempest-ExportLocationsTest-1017217578 tempest-ExportLocationsTest-1017217578-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:45 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-114783c1-da38-424f-b4fa-edad5178bb19 tempest-ExportLocationsTest-1017217578 tempest-ExportLocationsTest-1017217578-project-admin] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:45 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-114783c1-da38-424f-b4fa-edad5178bb19 tempest-ExportLocationsTest-1017217578 tempest-ExportLocationsTest-1017217578-project-admin] http://10.27.203.238/share/v2/87c113478e754c47aea49a8b703cd2f6/shares/a96dff4b-6e98-4085-9f3b-45735d209546 returned with HTTP 200 May 28 12:56:45 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 130/251] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:56:45 2024] GET /share/v2/87c113478e754c47aea49a8b703cd2f6/shares/a96dff4b-6e98-4085-9f3b-45735d209546 => generated 1372 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:56:45 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-40586354-1353-4644-9582-01fe3f74b3c2 tempest-AdminActionsNegativeTest-763023849 tempest-AdminActionsNegativeTest-763023849-project-admin] GET http://10.27.203.238/share/v2/7c36a466cc2a42b195f921474b0f4de5/shares/415272bd-25d1-465a-87fc-b0fdbc8c093c May 28 12:56:45 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-40586354-1353-4644-9582-01fe3f74b3c2 tempest-AdminActionsNegativeTest-763023849 tempest-AdminActionsNegativeTest-763023849-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:45 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-40586354-1353-4644-9582-01fe3f74b3c2 tempest-AdminActionsNegativeTest-763023849 tempest-AdminActionsNegativeTest-763023849-project-admin] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:45 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-40586354-1353-4644-9582-01fe3f74b3c2 tempest-AdminActionsNegativeTest-763023849 tempest-AdminActionsNegativeTest-763023849-project-admin] http://10.27.203.238/share/v2/7c36a466cc2a42b195f921474b0f4de5/shares/415272bd-25d1-465a-87fc-b0fdbc8c093c returned with HTTP 200 May 28 12:56:45 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 122/252] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:56:45 2024] GET /share/v2/7c36a466cc2a42b195f921474b0f4de5/shares/415272bd-25d1-465a-87fc-b0fdbc8c093c => generated 1372 bytes in 27 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:56:45 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-c4d58eae-b2b2-4407-873c-51474025d4d7 tempest-ShareInstancesTest-1546991288 tempest-ShareInstancesTest-1546991288-project-admin] GET http://10.27.203.238/share/v2/fb2c57cefad04e97a990bd936225014d/shares/2dfffda2-1f3a-4d2e-9044-2255a211a9f0 May 28 12:56:45 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-c4d58eae-b2b2-4407-873c-51474025d4d7 tempest-ShareInstancesTest-1546991288 tempest-ShareInstancesTest-1546991288-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:45 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-c4d58eae-b2b2-4407-873c-51474025d4d7 tempest-ShareInstancesTest-1546991288 tempest-ShareInstancesTest-1546991288-project-admin] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:45 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-c4d58eae-b2b2-4407-873c-51474025d4d7 tempest-ShareInstancesTest-1546991288 tempest-ShareInstancesTest-1546991288-project-admin] http://10.27.203.238/share/v2/fb2c57cefad04e97a990bd936225014d/shares/2dfffda2-1f3a-4d2e-9044-2255a211a9f0 returned with HTTP 200 May 28 12:56:45 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 131/253] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:56:45 2024] GET /share/v2/fb2c57cefad04e97a990bd936225014d/shares/2dfffda2-1f3a-4d2e-9044-2255a211a9f0 => generated 1371 bytes in 24 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:56:46 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-4223f1f4-01b7-484a-941e-d6956e10be71 tempest-AccessRulesMetadataTest-1973590610 tempest-AccessRulesMetadataTest-1973590610-project-member] GET http://10.27.203.238/share/v2/1643901550e140118fc2d2e92b82cd0b/shares/b92fc06b-76d7-40f9-adef-74a07ace1027 May 28 12:56:46 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-4223f1f4-01b7-484a-941e-d6956e10be71 tempest-AccessRulesMetadataTest-1973590610 tempest-AccessRulesMetadataTest-1973590610-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:46 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-4223f1f4-01b7-484a-941e-d6956e10be71 tempest-AccessRulesMetadataTest-1973590610 tempest-AccessRulesMetadataTest-1973590610-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:46 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-4223f1f4-01b7-484a-941e-d6956e10be71 tempest-AccessRulesMetadataTest-1973590610 tempest-AccessRulesMetadataTest-1973590610-project-member] http://10.27.203.238/share/v2/1643901550e140118fc2d2e92b82cd0b/shares/b92fc06b-76d7-40f9-adef-74a07ace1027 returned with HTTP 200 May 28 12:56:46 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 123/254] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:56:46 2024] GET /share/v2/1643901550e140118fc2d2e92b82cd0b/shares/b92fc06b-76d7-40f9-adef-74a07ace1027 => generated 1319 bytes in 25 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:56:46 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-232509cb-520c-4983-af94-5b20ef7736c2 tempest-AccessRulesMetadataTest-1973590610 tempest-AccessRulesMetadataTest-1973590610-project-member] POST http://10.27.203.238/share/v2/1643901550e140118fc2d2e92b82cd0b/shares/b92fc06b-76d7-40f9-adef-74a07ace1027/action May 28 12:56:46 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-232509cb-520c-4983-af94-5b20ef7736c2 tempest-AccessRulesMetadataTest-1973590610 tempest-AccessRulesMetadataTest-1973590610-project-member] Action body: b'{"allow_access": {"access_type": "ip", "access_to": "2001:0DB8:c3cf:7dc0:97e4:5926:467:f5cd", "access_level": "rw", "metadata": {"key1": "value1", "key2": "value2"}}}' {{(pid=98329) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:56:46 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-232509cb-520c-4983-af94-5b20ef7736c2 tempest-AccessRulesMetadataTest-1973590610 tempest-AccessRulesMetadataTest-1973590610-project-member] Action: 'action', calling method: Controller.__getattribute__..version_select, body: {"allow_access": {"access_type": "ip", "access_to": "2001:0DB8:c3cf:7dc0:97e4:5926:467:f5cd", "access_level": "rw", "metadata": {"key1": "value1", "key2": "value2"}}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:56:46 l75lg1-v1 devstack@m-api.service[98329]: DEBUG oslo_concurrency.lockutils [None req-232509cb-520c-4983-af94-5b20ef7736c2 tempest-AccessRulesMetadataTest-1973590610 tempest-AccessRulesMetadataTest-1973590610-project-member] Acquiring lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98329) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:56:46 l75lg1-v1 devstack@m-api.service[98329]: DEBUG oslo_concurrency.lockutils [None req-232509cb-520c-4983-af94-5b20ef7736c2 tempest-AccessRulesMetadataTest-1973590610 tempest-AccessRulesMetadataTest-1973590610-project-member] Lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98329) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:56:46 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a5ac53be-0f8f-40da-be27-b1bedd786baf tempest-AdminActionsNegativeTest-763023849 None] <<< [DELETE] https://127.0.0.1:40443/api/quotas/3/ May 28 12:56:46 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a5ac53be-0f8f-40da-be27-b1bedd786baf tempest-AdminActionsNegativeTest-763023849 None] --- [DELETE] https://127.0.0.1:40443/api/quotas/3/: Done May 28 12:56:46 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a5ac53be-0f8f-40da-be27-b1bedd786baf tempest-AdminActionsNegativeTest-763023849 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:56:46 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a5ac53be-0f8f-40da-be27-b1bedd786baf tempest-AdminActionsNegativeTest-763023849 None] {'allow_redirects': True, May 28 12:56:46 l75lg1-v1 dstat.sh[49771]: 28-05 12:56:46| 3 0 96 0 0|5656M 1852M 277M 7841M| 12k 1822B| 0 460k| 0 47.0 |2281 3660 |1.74 1.00 0.99|2.0 1.0 0| 0 0 | 0 2048M| 29 348 0 49 0 May 28 12:56:46 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a5ac53be-0f8f-40da-be27-b1bedd786baf tempest-AdminActionsNegativeTest-763023849 None] 'params': {'name': '5ae9ae15-dc00-44c8-891a-9758f2b29855'}} May 28 12:56:46 l75lg1-v1 devstack@m-api.service[98329]: DEBUG oslo_concurrency.lockutils [None req-232509cb-520c-4983-af94-5b20ef7736c2 tempest-AccessRulesMetadataTest-1973590610 tempest-AccessRulesMetadataTest-1973590610-project-member] Lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.043s {{(pid=98329) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:56:46 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-232509cb-520c-4983-af94-5b20ef7736c2 tempest-AccessRulesMetadataTest-1973590610 tempest-AccessRulesMetadataTest-1973590610-project-member] http://10.27.203.238/share/v2/1643901550e140118fc2d2e92b82cd0b/shares/b92fc06b-76d7-40f9-adef-74a07ace1027/action returned with HTTP 200 May 28 12:56:46 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 132/255] 10.27.203.238 () {66 vars in 1494 bytes} [Tue May 28 12:56:46 2024] POST /share/v2/1643901550e140118fc2d2e92b82cd0b/shares/b92fc06b-76d7-40f9-adef-74a07ace1027/action => generated 370 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:56:46 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-cef8bb6b-2574-4c09-9ec2-e99c093e48ab tempest-AccessRulesMetadataTest-1973590610 tempest-AccessRulesMetadataTest-1973590610-project-member] GET http://10.27.203.238/share/v2/1643901550e140118fc2d2e92b82cd0b/share-access-rules?share_id=b92fc06b-76d7-40f9-adef-74a07ace1027 May 28 12:56:46 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-cef8bb6b-2574-4c09-9ec2-e99c093e48ab tempest-AccessRulesMetadataTest-1973590610 tempest-AccessRulesMetadataTest-1973590610-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:46 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-cef8bb6b-2574-4c09-9ec2-e99c093e48ab tempest-AccessRulesMetadataTest-1973590610 tempest-AccessRulesMetadataTest-1973590610-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:46 l75lg1-v1 manila-share[98474]: DEBUG manila.share.manager [None req-232509cb-520c-4983-af94-5b20ef7736c2 tempest-AccessRulesMetadataTest-1973590610 None] Received request to update access for share instance 95118a75-173c-4257-acef-78a246ee1c67. {{(pid=98474) update_access_for_instances /opt/stack/manila/manila/share/manager.py:4353}} May 28 12:56:46 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-232509cb-520c-4983-af94-5b20ef7736c2 tempest-AccessRulesMetadataTest-1973590610 None] Acquiring lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:56:46 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-232509cb-520c-4983-af94-5b20ef7736c2 tempest-AccessRulesMetadataTest-1973590610 None] Lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:56:46 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-232509cb-520c-4983-af94-5b20ef7736c2 tempest-AccessRulesMetadataTest-1973590610 None] Lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.004s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:56:46 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-232509cb-520c-4983-af94-5b20ef7736c2 tempest-AccessRulesMetadataTest-1973590610 None] Acquiring lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:56:46 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-232509cb-520c-4983-af94-5b20ef7736c2 tempest-AccessRulesMetadataTest-1973590610 None] Lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:56:46 l75lg1-v1 neutron-server[77618]: DEBUG dbcounter [-] [77618] Writing DB stats neutron:SELECT=7 {{(pid=77618) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:56:46 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.lock.api [None req-cef8bb6b-2574-4c09-9ec2-e99c093e48ab tempest-AccessRulesMetadataTest-1973590610 tempest-AccessRulesMetadataTest-1973590610-project-member] Searching for locks by: {'resource_id': '065fb8ea-fc05-4af3-b191-603cca79c74e', 'resource_action': 'show', 'resource_type': 'access_rule'} {{(pid=98330) get_all /opt/stack/manila/manila/lock/api.py:112}} May 28 12:56:46 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-cef8bb6b-2574-4c09-9ec2-e99c093e48ab tempest-AccessRulesMetadataTest-1973590610 tempest-AccessRulesMetadataTest-1973590610-project-member] http://10.27.203.238/share/v2/1643901550e140118fc2d2e92b82cd0b/share-access-rules?share_id=b92fc06b-76d7-40f9-adef-74a07ace1027 returned with HTTP 200 May 28 12:56:46 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 124/256] 10.27.203.238 () {64 vars in 1467 bytes} [Tue May 28 12:56:46 2024] GET /share/v2/1643901550e140118fc2d2e92b82cd0b/share-access-rules?share_id=b92fc06b-76d7-40f9-adef-74a07ace1027 => generated 325 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:56:46 l75lg1-v1 neutron-server[77618]: DEBUG dbcounter [-] [77618] Writing DB stats neutron:SELECT=7,neutron:UPDATE=1 {{(pid=77618) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:56:46 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-232509cb-520c-4983-af94-5b20ef7736c2 tempest-AccessRulesMetadataTest-1973590610 None] Lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.108s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:56:46 l75lg1-v1 manila-share[98474]: DEBUG manila.share.access [None req-232509cb-520c-4983-af94-5b20ef7736c2 tempest-AccessRulesMetadataTest-1973590610 None] Updating access rules for share instance 95118a75-173c-4257-acef-78a246ee1c67 belonging to share b92fc06b-76d7-40f9-adef-74a07ace1027. {{(pid=98474) update_access_rules /opt/stack/manila/manila/share/access.py:298}} May 28 12:56:46 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-232509cb-520c-4983-af94-5b20ef7736c2 tempest-AccessRulesMetadataTest-1973590610 None] Acquiring lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:56:46 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-232509cb-520c-4983-af94-5b20ef7736c2 tempest-AccessRulesMetadataTest-1973590610 None] Lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:56:46 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-232509cb-520c-4983-af94-5b20ef7736c2 tempest-AccessRulesMetadataTest-1973590610 None] Lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.007s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:56:46 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-232509cb-520c-4983-af94-5b20ef7736c2 tempest-AccessRulesMetadataTest-1973590610 None] Acquiring lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:56:46 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-232509cb-520c-4983-af94-5b20ef7736c2 tempest-AccessRulesMetadataTest-1973590610 None] Lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:56:46 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-232509cb-520c-4983-af94-5b20ef7736c2 tempest-AccessRulesMetadataTest-1973590610 None] Lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.018s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:56:46 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-232509cb-520c-4983-af94-5b20ef7736c2 tempest-AccessRulesMetadataTest-1973590610 None] changing access on None May 28 12:56:46 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-232509cb-520c-4983-af94-5b20ef7736c2 tempest-AccessRulesMetadataTest-1973590610 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:56:46 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-232509cb-520c-4983-af94-5b20ef7736c2 tempest-AccessRulesMetadataTest-1973590610 None] {'allow_redirects': True, May 28 12:56:46 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-232509cb-520c-4983-af94-5b20ef7736c2 tempest-AccessRulesMetadataTest-1973590610 None] 'params': {'name': '95118a75-173c-4257-acef-78a246ee1c67'}} May 28 12:56:46 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-232509cb-520c-4983-af94-5b20ef7736c2 tempest-AccessRulesMetadataTest-1973590610 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:56:46 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-232509cb-520c-4983-af94-5b20ef7736c2 tempest-AccessRulesMetadataTest-1973590610 None] [Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=1, created='2024-05-28T12:56:41.381687Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='8ed5f8f5-e848-431c-be27-16f1fa370a60', id=9, internal=False, is_s3_default_policy=False, name='95118a75-173c-4257-acef-78a246ee1c67', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=[], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['*'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['*'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T12:56:41.744950Z', tenant_id=1, tenant_name='default', title='95118a75-173c-4257-acef-78a246ee1c67', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/9/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[])] May 28 12:56:46 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-232509cb-520c-4983-af94-5b20ef7736c2 tempest-AccessRulesMetadataTest-1973590610 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 12:56:46 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-232509cb-520c-4983-af94-5b20ef7736c2 tempest-AccessRulesMetadataTest-1973590610 None] Acquiring lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:56:46 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-232509cb-520c-4983-af94-5b20ef7736c2 tempest-AccessRulesMetadataTest-1973590610 None] Lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:56:46 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a5ac53be-0f8f-40da-be27-b1bedd786baf tempest-AdminActionsNegativeTest-763023849 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:56:46 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a5ac53be-0f8f-40da-be27-b1bedd786baf tempest-AdminActionsNegativeTest-763023849 None] [Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=0, created='2024-05-28T12:56:27.043058Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='df7184f7-8dea-4f79-a7b5-b5704f7a5e52', id=6, internal=False, is_s3_default_policy=False, name='5ae9ae15-dc00-44c8-891a-9758f2b29855', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=[], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['*'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['*'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T12:56:27.624226Z', tenant_id=1, tenant_name='default', title='5ae9ae15-dc00-44c8-891a-9758f2b29855', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/6/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[])] May 28 12:56:46 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a5ac53be-0f8f-40da-be27-b1bedd786baf tempest-AdminActionsNegativeTest-763023849 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 12:56:46 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a5ac53be-0f8f-40da-be27-b1bedd786baf tempest-AdminActionsNegativeTest-763023849 None] >>> [DELETE] https://127.0.0.1:40443/api/viewpolicies/6/ May 28 12:56:46 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-232509cb-520c-4983-af94-5b20ef7736c2 tempest-AccessRulesMetadataTest-1973590610 None] Lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.075s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:56:46 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-232509cb-520c-4983-af94-5b20ef7736c2 tempest-AccessRulesMetadataTest-1973590610 None] Acquiring lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:56:46 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-232509cb-520c-4983-af94-5b20ef7736c2 tempest-AccessRulesMetadataTest-1973590610 None] Lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:56:46 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-232509cb-520c-4983-af94-5b20ef7736c2 tempest-AccessRulesMetadataTest-1973590610 None] Lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:56:46 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-232509cb-520c-4983-af94-5b20ef7736c2 tempest-AccessRulesMetadataTest-1973590610 None] Acquiring lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:56:46 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-232509cb-520c-4983-af94-5b20ef7736c2 tempest-AccessRulesMetadataTest-1973590610 None] Lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:56:46 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-232509cb-520c-4983-af94-5b20ef7736c2 tempest-AccessRulesMetadataTest-1973590610 None] Lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:56:46 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-232509cb-520c-4983-af94-5b20ef7736c2 tempest-AccessRulesMetadataTest-1973590610 None] Acquiring lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:56:46 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-232509cb-520c-4983-af94-5b20ef7736c2 tempest-AccessRulesMetadataTest-1973590610 None] Lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:56:46 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f77454c8-a7d3-43f9-807d-8f8535202188 tempest-ShareInstancesTest-1546991288 None] <<< [DELETE] https://127.0.0.1:40443/api/quotas/4/ May 28 12:56:46 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f77454c8-a7d3-43f9-807d-8f8535202188 tempest-ShareInstancesTest-1546991288 None] --- [DELETE] https://127.0.0.1:40443/api/quotas/4/: Done May 28 12:56:46 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f77454c8-a7d3-43f9-807d-8f8535202188 tempest-ShareInstancesTest-1546991288 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:56:46 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f77454c8-a7d3-43f9-807d-8f8535202188 tempest-ShareInstancesTest-1546991288 None] {'allow_redirects': True, May 28 12:56:46 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f77454c8-a7d3-43f9-807d-8f8535202188 tempest-ShareInstancesTest-1546991288 None] 'params': {'name': '7f6a42fa-4d45-471e-a438-36876fc6eac8'}} May 28 12:56:46 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-232509cb-520c-4983-af94-5b20ef7736c2 tempest-AccessRulesMetadataTest-1973590610 None] Lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.007s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:56:46 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-232509cb-520c-4983-af94-5b20ef7736c2 tempest-AccessRulesMetadataTest-1973590610 None] Acquiring lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:56:46 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-232509cb-520c-4983-af94-5b20ef7736c2 tempest-AccessRulesMetadataTest-1973590610 None] Lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:56:46 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-72f3d118-a786-4564-9cb7-cb9c1235c2d6 tempest-ExportLocationsTest-1017217578 None] <<< [DELETE] https://127.0.0.1:40443/api/viewpolicies/5/ May 28 12:56:46 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-72f3d118-a786-4564-9cb7-cb9c1235c2d6 tempest-ExportLocationsTest-1017217578 None] --- [DELETE] https://127.0.0.1:40443/api/viewpolicies/5/: Done May 28 12:56:46 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-232509cb-520c-4983-af94-5b20ef7736c2 tempest-AccessRulesMetadataTest-1973590610 None] Lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.065s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:56:46 l75lg1-v1 manila-share[98474]: INFO manila.share.access [None req-232509cb-520c-4983-af94-5b20ef7736c2 tempest-AccessRulesMetadataTest-1973590610 None] Access rules were successfully modified for share instance 95118a75-173c-4257-acef-78a246ee1c67 belonging to share b92fc06b-76d7-40f9-adef-74a07ace1027. May 28 12:56:47 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-72f3d118-a786-4564-9cb7-cb9c1235c2d6 tempest-ExportLocationsTest-1017217578 None] Created reservations ['373e3223-c77b-44a1-8a3a-9560c0c681a9', '28882221-f284-4673-ab8d-96e6e22ec95f', '6b19880e-68fb-4324-9ee4-81449b2962ca', '2895a798-1180-4d73-bbfa-c5dffd1cb68a'] {{(pid=98474) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 12:56:47 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-72f3d118-a786-4564-9cb7-cb9c1235c2d6 tempest-ExportLocationsTest-1017217578 None] Committed reservations ['373e3223-c77b-44a1-8a3a-9560c0c681a9', '28882221-f284-4673-ab8d-96e6e22ec95f', '6b19880e-68fb-4324-9ee4-81449b2962ca', '2895a798-1180-4d73-bbfa-c5dffd1cb68a'] {{(pid=98474) commit /opt/stack/manila/manila/quota.py:1063}} May 28 12:56:47 l75lg1-v1 manila-share[98474]: INFO manila.share.manager [None req-72f3d118-a786-4564-9cb7-cb9c1235c2d6 tempest-ExportLocationsTest-1017217578 None] Share instance 83d10127-dfed-433a-90d1-4f0a7f981edc: deleted successfully. May 28 12:56:47 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-13b434e4-329a-49b9-a7e0-4a1d7ebecec4 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] GET http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/shares/a6fffe7e-d89b-4b6c-ada2-53d5855ef606 May 28 12:56:47 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-13b434e4-329a-49b9-a7e0-4a1d7ebecec4 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:47 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-13b434e4-329a-49b9-a7e0-4a1d7ebecec4 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:47 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-13b434e4-329a-49b9-a7e0-4a1d7ebecec4 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/shares/a6fffe7e-d89b-4b6c-ada2-53d5855ef606 returned with HTTP 200 May 28 12:56:47 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 133/257] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:56:47 2024] GET /share/v2/a3499cb78849424db45e54caac01de92/shares/a6fffe7e-d89b-4b6c-ada2-53d5855ef606 => generated 1370 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:56:47 l75lg1-v1 dstat.sh[49771]: 28-05 12:56:47| 7 0 90 2 0|5657M 1851M 277M 7841M| 22k 3959B| 0 1259k| 0 180 |4052 6816 |1.68 1.00 0.99|1.0 1.0 0| 0 0 | 0 2048M| 29 347 0 49 0 May 28 12:56:47 l75lg1-v1 neutron-server[77619]: DEBUG dbcounter [-] [77619] Writing DB stats neutron:SELECT=3 {{(pid=77619) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:56:47 l75lg1-v1 manila-share[98474]: DEBUG oslo_service.periodic_task [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] Running periodic task ShareManager.do_deferred_share_deletion {{(pid=98474) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:56:47 l75lg1-v1 manila-share[98474]: DEBUG manila.share.manager [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] Checking for shares in 'deferred_deleting' status to process their deletion. {{(pid=98474) do_deferred_share_deletion /opt/stack/manila/manila/share/manager.py:3663}} May 28 12:56:47 l75lg1-v1 manila-share[98474]: DEBUG oslo_service.periodic_task [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] Running periodic task ShareManager.do_deferred_snapshot_deletion {{(pid=98474) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:56:47 l75lg1-v1 manila-share[98474]: DEBUG manila.share.manager [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] Checking for snapshots in 'deferred_deleting' status to process their deletion. {{(pid=98474) do_deferred_snapshot_deletion /opt/stack/manila/manila/share/manager.py:3980}} May 28 12:56:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f77454c8-a7d3-43f9-807d-8f8535202188 tempest-ShareInstancesTest-1546991288 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:56:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f77454c8-a7d3-43f9-807d-8f8535202188 tempest-ShareInstancesTest-1546991288 None] [Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=0, created='2024-05-28T12:56:31.146488Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='9c6e129d-4015-4f5a-81b2-c773c3140a6c', id=7, internal=False, is_s3_default_policy=False, name='7f6a42fa-4d45-471e-a438-36876fc6eac8', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=[], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['*'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['*'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T12:56:31.440893Z', tenant_id=1, tenant_name='default', title='7f6a42fa-4d45-471e-a438-36876fc6eac8', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/7/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[])] May 28 12:56:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f77454c8-a7d3-43f9-807d-8f8535202188 tempest-ShareInstancesTest-1546991288 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 12:56:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f77454c8-a7d3-43f9-807d-8f8535202188 tempest-ShareInstancesTest-1546991288 None] >>> [DELETE] https://127.0.0.1:40443/api/viewpolicies/7/ May 28 12:56:47 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:56:47 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:56:47 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:56:47 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:56:47 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:56:47 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.manager [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=83654) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10545}} May 28 12:56:47 l75lg1-v1 nova-conductor[83229]: DEBUG dbcounter [-] [83229] Writing DB stats nova_cell0:SELECT=1,nova_cell0:UPDATE=1 {{(pid=83229) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:56:48 l75lg1-v1 nova-conductor[83233]: DEBUG dbcounter [-] [83233] Writing DB stats nova_cell0:SELECT=1 {{(pid=83233) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:56:48 l75lg1-v1 neutron-server[77619]: DEBUG dbcounter [-] [77619] Writing DB stats neutron:SELECT=3 {{(pid=77619) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:56:48 l75lg1-v1 dstat.sh[49771]: 28-05 12:56:48| 1 0 98 0 0|5658M 1850M 277M 7841M| 15k 720B| 0 476k| 0 48.0 |2031 3075 |1.68 1.00 0.99| 0 0 2.0| 0 0 | 0 2048M| 29 347 0 49 0 May 28 12:56:48 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a5ac53be-0f8f-40da-be27-b1bedd786baf tempest-AdminActionsNegativeTest-763023849 None] <<< [DELETE] https://127.0.0.1:40443/api/viewpolicies/6/ May 28 12:56:48 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a5ac53be-0f8f-40da-be27-b1bedd786baf tempest-AdminActionsNegativeTest-763023849 None] --- [DELETE] https://127.0.0.1:40443/api/viewpolicies/6/: Done May 28 12:56:48 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-f44abb1c-4c5c-4b58-847f-cb5f0b9eb474 tempest-ExportLocationsTest-1017217578 tempest-ExportLocationsTest-1017217578-project-admin] GET http://10.27.203.238/share/v2/87c113478e754c47aea49a8b703cd2f6/shares/a96dff4b-6e98-4085-9f3b-45735d209546 May 28 12:56:48 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-f44abb1c-4c5c-4b58-847f-cb5f0b9eb474 tempest-ExportLocationsTest-1017217578 tempest-ExportLocationsTest-1017217578-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:48 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-f44abb1c-4c5c-4b58-847f-cb5f0b9eb474 tempest-ExportLocationsTest-1017217578 tempest-ExportLocationsTest-1017217578-project-admin] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:48 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-f44abb1c-4c5c-4b58-847f-cb5f0b9eb474 tempest-ExportLocationsTest-1017217578 tempest-ExportLocationsTest-1017217578-project-admin] HTTP exception thrown: The resource could not be found. May 28 12:56:48 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-f44abb1c-4c5c-4b58-847f-cb5f0b9eb474 tempest-ExportLocationsTest-1017217578 tempest-ExportLocationsTest-1017217578-project-admin] http://10.27.203.238/share/v2/87c113478e754c47aea49a8b703cd2f6/shares/a96dff4b-6e98-4085-9f3b-45735d209546 returned with HTTP 404 May 28 12:56:48 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 125/258] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:56:48 2024] GET /share/v2/87c113478e754c47aea49a8b703cd2f6/shares/a96dff4b-6e98-4085-9f3b-45735d209546 => generated 78 bytes in 11 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 12:56:48 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-ee07d157-e866-4f5b-a951-0c7085cfebc9 tempest-ExportLocationsTest-1017217578 tempest-ExportLocationsTest-1017217578-project-admin] DELETE http://10.27.203.238/share/v2/87c113478e754c47aea49a8b703cd2f6/types/873cf5f5-29fa-4edc-838b-4dbf288089b4 May 28 12:56:48 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-ee07d157-e866-4f5b-a951-0c7085cfebc9 tempest-ExportLocationsTest-1017217578 tempest-ExportLocationsTest-1017217578-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:48 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-ee07d157-e866-4f5b-a951-0c7085cfebc9 tempest-ExportLocationsTest-1017217578 tempest-ExportLocationsTest-1017217578-project-admin] Calling method 'ShareTypesController._delete' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:48 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-ee07d157-e866-4f5b-a951-0c7085cfebc9 tempest-ExportLocationsTest-1017217578 tempest-ExportLocationsTest-1017217578-project-admin] http://10.27.203.238/share/v2/87c113478e754c47aea49a8b703cd2f6/types/873cf5f5-29fa-4edc-838b-4dbf288089b4 returned with HTTP 202 May 28 12:56:48 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 134/259] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:56:48 2024] DELETE /share/v2/87c113478e754c47aea49a8b703cd2f6/types/873cf5f5-29fa-4edc-838b-4dbf288089b4 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:56:48 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-d38c1a5d-9566-48cd-b4fb-d3703628a47e tempest-ExportLocationsTest-1017217578 tempest-ExportLocationsTest-1017217578-project-admin] GET http://10.27.203.238/share/v2/87c113478e754c47aea49a8b703cd2f6/types/873cf5f5-29fa-4edc-838b-4dbf288089b4 May 28 12:56:48 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-d38c1a5d-9566-48cd-b4fb-d3703628a47e tempest-ExportLocationsTest-1017217578 tempest-ExportLocationsTest-1017217578-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:48 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-d38c1a5d-9566-48cd-b4fb-d3703628a47e tempest-ExportLocationsTest-1017217578 tempest-ExportLocationsTest-1017217578-project-admin] Calling method 'ShareTypesController.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:48 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-d38c1a5d-9566-48cd-b4fb-d3703628a47e tempest-ExportLocationsTest-1017217578 tempest-ExportLocationsTest-1017217578-project-admin] HTTP exception thrown: Share type not found. May 28 12:56:48 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-d38c1a5d-9566-48cd-b4fb-d3703628a47e tempest-ExportLocationsTest-1017217578 tempest-ExportLocationsTest-1017217578-project-admin] http://10.27.203.238/share/v2/87c113478e754c47aea49a8b703cd2f6/types/873cf5f5-29fa-4edc-838b-4dbf288089b4 returned with HTTP 404 May 28 12:56:48 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 126/260] 10.27.203.238 () {64 vars in 1448 bytes} [Tue May 28 12:56:48 2024] GET /share/v2/87c113478e754c47aea49a8b703cd2f6/types/873cf5f5-29fa-4edc-838b-4dbf288089b4 => generated 67 bytes in 10 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 12:56:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bef4a7-a39b-4eed-9502-81a9ce2c5fa3 service manila] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-72bef4a7-a39b-4eed-9502-81a9ce2c5fa3 service manila] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:48 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-a5ac53be-0f8f-40da-be27-b1bedd786baf tempest-AdminActionsNegativeTest-763023849 None] Created reservations ['2552b3ba-c3fc-45cd-ad9f-60f0c1ca677a', 'e1d40cda-7ff8-4409-a881-c19005428c35', '8ed6fa2c-d9e7-44e8-8f5e-85b36252089a', '0f88e77a-0f66-45d5-bc48-b9f84e7d58ec'] {{(pid=98474) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 12:56:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bef4a7-a39b-4eed-9502-81a9ce2c5fa3 service manila] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41898370-5368-43cb-9232-5c5513d4a207 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41898370-5368-43cb-9232-5c5513d4a207 None admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41898370-5368-43cb-9232-5c5513d4a207 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41898370-5368-43cb-9232-5c5513d4a207 None admin] PATH_INFO: `/v3/users/e69e25494813402195766fc7ed35b358` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41898370-5368-43cb-9232-5c5513d4a207 None admin] RBAC: Authorizing `identity:delete_user(user_id=e69e25494813402195766fc7ed35b358)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41898370-5368-43cb-9232-5c5513d4a207 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:48 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-a5ac53be-0f8f-40da-be27-b1bedd786baf tempest-AdminActionsNegativeTest-763023849 None] Committed reservations ['2552b3ba-c3fc-45cd-ad9f-60f0c1ca677a', 'e1d40cda-7ff8-4409-a881-c19005428c35', '8ed6fa2c-d9e7-44e8-8f5e-85b36252089a', '0f88e77a-0f66-45d5-bc48-b9f84e7d58ec'] {{(pid=98474) commit /opt/stack/manila/manila/quota.py:1063}} May 28 12:56:48 l75lg1-v1 manila-share[98474]: INFO manila.share.manager [None req-a5ac53be-0f8f-40da-be27-b1bedd786baf tempest-AdminActionsNegativeTest-763023849 None] Share instance 5ae9ae15-dc00-44c8-891a-9758f2b29855: deleted successfully. May 28 12:56:48 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:56:48 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.manager [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Starting heal instance info cache {{(pid=83654) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}} May 28 12:56:48 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.manager [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Rebuilding the list of instances to heal {{(pid=83654) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9930}} May 28 12:56:48 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Expecting reply to msg ab055a34ef134157a8d7c8565f6dabc8 in queue reply_37f4cbd1dd094961a22b8a65f222c327 May 28 12:56:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-41898370-5368-43cb-9232-5c5513d4a207 None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e69e25494813402195766fc7ed35b358', 'request_id': 'req-41898370-5368-43cb-9232-5c5513d4a207'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:48 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-36747207-2a21-4b1e-ae71-71b2fe8121f9 tempest-AdminActionsNegativeTest-763023849 tempest-AdminActionsNegativeTest-763023849-project-admin] GET http://10.27.203.238/share/v2/7c36a466cc2a42b195f921474b0f4de5/shares/415272bd-25d1-465a-87fc-b0fdbc8c093c May 28 12:56:48 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-36747207-2a21-4b1e-ae71-71b2fe8121f9 tempest-AdminActionsNegativeTest-763023849 tempest-AdminActionsNegativeTest-763023849-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:48 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-36747207-2a21-4b1e-ae71-71b2fe8121f9 tempest-AdminActionsNegativeTest-763023849 tempest-AdminActionsNegativeTest-763023849-project-admin] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:48 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [-] Received RPC response for msg ab055a34ef134157a8d7c8565f6dabc8 May 28 12:56:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-41898370-5368-43cb-9232-5c5513d4a207 None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e69e25494813402195766fc7ed35b358', 'request_id': 'req-41898370-5368-43cb-9232-5c5513d4a207'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-41898370-5368-43cb-9232-5c5513d4a207 None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e69e25494813402195766fc7ed35b358', 'request_id': 'req-41898370-5368-43cb-9232-5c5513d4a207'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:48 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-36747207-2a21-4b1e-ae71-71b2fe8121f9 tempest-AdminActionsNegativeTest-763023849 tempest-AdminActionsNegativeTest-763023849-project-admin] HTTP exception thrown: The resource could not be found. May 28 12:56:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-41898370-5368-43cb-9232-5c5513d4a207 None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e69e25494813402195766fc7ed35b358', 'request_id': 'req-41898370-5368-43cb-9232-5c5513d4a207'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:48 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-36747207-2a21-4b1e-ae71-71b2fe8121f9 tempest-AdminActionsNegativeTest-763023849 tempest-AdminActionsNegativeTest-763023849-project-admin] http://10.27.203.238/share/v2/7c36a466cc2a42b195f921474b0f4de5/shares/415272bd-25d1-465a-87fc-b0fdbc8c093c returned with HTTP 404 May 28 12:56:48 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 135/261] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:56:48 2024] GET /share/v2/7c36a466cc2a42b195f921474b0f4de5/shares/415272bd-25d1-465a-87fc-b0fdbc8c093c => generated 78 bytes in 12 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 12:56:48 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-a982e5c4-177b-47df-9e7b-a04d2aa556a4 tempest-AdminActionsNegativeTest-763023849 tempest-AdminActionsNegativeTest-763023849-project-admin] DELETE http://10.27.203.238/share/v2/7c36a466cc2a42b195f921474b0f4de5/types/27f6d0df-1d2a-4709-a297-418caab2a49e May 28 12:56:48 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-a982e5c4-177b-47df-9e7b-a04d2aa556a4 tempest-AdminActionsNegativeTest-763023849 tempest-AdminActionsNegativeTest-763023849-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:48 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-a982e5c4-177b-47df-9e7b-a04d2aa556a4 tempest-AdminActionsNegativeTest-763023849 tempest-AdminActionsNegativeTest-763023849-project-admin] Calling method 'ShareTypesController._delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-41898370-5368-43cb-9232-5c5513d4a207 None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e69e25494813402195766fc7ed35b358', 'request_id': 'req-41898370-5368-43cb-9232-5c5513d4a207'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:48 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 792/1566] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 12:56:48 2024] DELETE /identity/v3/users/e69e25494813402195766fc7ed35b358 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:56:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cde8468-80e1-4dd5-9457-86ea13f6b6aa service manila] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cde8468-80e1-4dd5-9457-86ea13f6b6aa service manila] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:48 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-a982e5c4-177b-47df-9e7b-a04d2aa556a4 tempest-AdminActionsNegativeTest-763023849 tempest-AdminActionsNegativeTest-763023849-project-admin] http://10.27.203.238/share/v2/7c36a466cc2a42b195f921474b0f4de5/types/27f6d0df-1d2a-4709-a297-418caab2a49e returned with HTTP 202 May 28 12:56:48 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 127/262] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:56:48 2024] DELETE /share/v2/7c36a466cc2a42b195f921474b0f4de5/types/27f6d0df-1d2a-4709-a297-418caab2a49e => generated 0 bytes in 51 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:56:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afa8181-bb6c-432f-bf5d-a87ecff61df5 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afa8181-bb6c-432f-bf5d-a87ecff61df5 None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afa8181-bb6c-432f-bf5d-a87ecff61df5 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afa8181-bb6c-432f-bf5d-a87ecff61df5 None admin] PATH_INFO: `/v3/users/0dc74ee9978c4df8b2e1e0046193d9ca` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afa8181-bb6c-432f-bf5d-a87ecff61df5 None admin] RBAC: Authorizing `identity:delete_user(user_id=0dc74ee9978c4df8b2e1e0046193d9ca)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afa8181-bb6c-432f-bf5d-a87ecff61df5 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:48 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-cf108e67-30cc-4aab-bf5a-5887eac94cec tempest-AdminActionsNegativeTest-763023849 tempest-AdminActionsNegativeTest-763023849-project-admin] GET http://10.27.203.238/share/v2/7c36a466cc2a42b195f921474b0f4de5/types/27f6d0df-1d2a-4709-a297-418caab2a49e May 28 12:56:48 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-cf108e67-30cc-4aab-bf5a-5887eac94cec tempest-AdminActionsNegativeTest-763023849 tempest-AdminActionsNegativeTest-763023849-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:48 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-cf108e67-30cc-4aab-bf5a-5887eac94cec tempest-AdminActionsNegativeTest-763023849 tempest-AdminActionsNegativeTest-763023849-project-admin] Calling method 'ShareTypesController.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:48 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-cf108e67-30cc-4aab-bf5a-5887eac94cec tempest-AdminActionsNegativeTest-763023849 tempest-AdminActionsNegativeTest-763023849-project-admin] HTTP exception thrown: Share type not found. May 28 12:56:48 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-cf108e67-30cc-4aab-bf5a-5887eac94cec tempest-AdminActionsNegativeTest-763023849 tempest-AdminActionsNegativeTest-763023849-project-admin] http://10.27.203.238/share/v2/7c36a466cc2a42b195f921474b0f4de5/types/27f6d0df-1d2a-4709-a297-418caab2a49e returned with HTTP 404 May 28 12:56:48 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 136/263] 10.27.203.238 () {64 vars in 1448 bytes} [Tue May 28 12:56:48 2024] GET /share/v2/7c36a466cc2a42b195f921474b0f4de5/types/27f6d0df-1d2a-4709-a297-418caab2a49e => generated 67 bytes in 11 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 12:56:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41898370-5368-43cb-9232-5c5513d4a207 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-41898370-5368-43cb-9232-5c5513d4a207 None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41898370-5368-43cb-9232-5c5513d4a207 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffe5955-38d3-4506-a616-dbbe6e0bd9f0 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffe5955-38d3-4506-a616-dbbe6e0bd9f0 None admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffe5955-38d3-4506-a616-dbbe6e0bd9f0 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffe5955-38d3-4506-a616-dbbe6e0bd9f0 None admin] PATH_INFO: `/v3/users/d39535fed98e4d65bc3b89975b5f70f9` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffe5955-38d3-4506-a616-dbbe6e0bd9f0 None admin] RBAC: Authorizing `identity:delete_user(user_id=d39535fed98e4d65bc3b89975b5f70f9)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffe5955-38d3-4506-a616-dbbe6e0bd9f0 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-5afa8181-bb6c-432f-bf5d-a87ecff61df5 None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0dc74ee9978c4df8b2e1e0046193d9ca', 'request_id': 'req-5afa8181-bb6c-432f-bf5d-a87ecff61df5'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-5afa8181-bb6c-432f-bf5d-a87ecff61df5 None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0dc74ee9978c4df8b2e1e0046193d9ca', 'request_id': 'req-5afa8181-bb6c-432f-bf5d-a87ecff61df5'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-5afa8181-bb6c-432f-bf5d-a87ecff61df5 None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0dc74ee9978c4df8b2e1e0046193d9ca', 'request_id': 'req-5afa8181-bb6c-432f-bf5d-a87ecff61df5'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-5afa8181-bb6c-432f-bf5d-a87ecff61df5 None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0dc74ee9978c4df8b2e1e0046193d9ca', 'request_id': 'req-5afa8181-bb6c-432f-bf5d-a87ecff61df5'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-5afa8181-bb6c-432f-bf5d-a87ecff61df5 None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0dc74ee9978c4df8b2e1e0046193d9ca', 'request_id': 'req-5afa8181-bb6c-432f-bf5d-a87ecff61df5'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-dffe5955-38d3-4506-a616-dbbe6e0bd9f0 None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd39535fed98e4d65bc3b89975b5f70f9', 'request_id': 'req-dffe5955-38d3-4506-a616-dbbe6e0bd9f0'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:48 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 775/1567] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 12:56:48 2024] DELETE /identity/v3/users/0dc74ee9978c4df8b2e1e0046193d9ca => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:56:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-dffe5955-38d3-4506-a616-dbbe6e0bd9f0 None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd39535fed98e4d65bc3b89975b5f70f9', 'request_id': 'req-dffe5955-38d3-4506-a616-dbbe6e0bd9f0'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afa8181-bb6c-432f-bf5d-a87ecff61df5 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-dffe5955-38d3-4506-a616-dbbe6e0bd9f0 None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd39535fed98e4d65bc3b89975b5f70f9', 'request_id': 'req-dffe5955-38d3-4506-a616-dbbe6e0bd9f0'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-dffe5955-38d3-4506-a616-dbbe6e0bd9f0 None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd39535fed98e4d65bc3b89975b5f70f9', 'request_id': 'req-dffe5955-38d3-4506-a616-dbbe6e0bd9f0'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-5afa8181-bb6c-432f-bf5d-a87ecff61df5 None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-dffe5955-38d3-4506-a616-dbbe6e0bd9f0 None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd39535fed98e4d65bc3b89975b5f70f9', 'request_id': 'req-dffe5955-38d3-4506-a616-dbbe6e0bd9f0'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:48 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c000e723-8995-49ec-9273-4b86621726c5 tempest-AdminActionsTest-1749172189 None] <<< [DELETE] https://127.0.0.1:40443/api/quotas/5/ May 28 12:56:48 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c000e723-8995-49ec-9273-4b86621726c5 tempest-AdminActionsTest-1749172189 None] --- [DELETE] https://127.0.0.1:40443/api/quotas/5/: Done May 28 12:56:48 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c000e723-8995-49ec-9273-4b86621726c5 tempest-AdminActionsTest-1749172189 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:56:48 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c000e723-8995-49ec-9273-4b86621726c5 tempest-AdminActionsTest-1749172189 None] {'allow_redirects': True, May 28 12:56:48 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c000e723-8995-49ec-9273-4b86621726c5 tempest-AdminActionsTest-1749172189 None] 'params': {'name': '766fa507-2a4c-47eb-bfef-fa764b38b24c'}} May 28 12:56:48 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 793/1568] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 12:56:48 2024] DELETE /identity/v3/users/d39535fed98e4d65bc3b89975b5f70f9 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:56:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffe5955-38d3-4506-a616-dbbe6e0bd9f0 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-dffe5955-38d3-4506-a616-dbbe6e0bd9f0 None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afa8181-bb6c-432f-bf5d-a87ecff61df5 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffe5955-38d3-4506-a616-dbbe6e0bd9f0 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b004e060-f75b-4542-86b5-31e7f72bb42a None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b004e060-f75b-4542-86b5-31e7f72bb42a None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56174251-0dd9-4efb-893f-ec92d250baea None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b004e060-f75b-4542-86b5-31e7f72bb42a None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56174251-0dd9-4efb-893f-ec92d250baea None admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56174251-0dd9-4efb-893f-ec92d250baea None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56174251-0dd9-4efb-893f-ec92d250baea None admin] PATH_INFO: `/v3/users/ae1ab8d3c7fc4adfac5cafc1d232caef` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b004e060-f75b-4542-86b5-31e7f72bb42a None admin] PATH_INFO: `/v3/users/76cf7583288d4a4eac3cf2f7fac50a81` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56174251-0dd9-4efb-893f-ec92d250baea None admin] RBAC: Authorizing `identity:delete_user(user_id=ae1ab8d3c7fc4adfac5cafc1d232caef)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b004e060-f75b-4542-86b5-31e7f72bb42a None admin] RBAC: Authorizing `identity:delete_user(user_id=76cf7583288d4a4eac3cf2f7fac50a81)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56174251-0dd9-4efb-893f-ec92d250baea None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b004e060-f75b-4542-86b5-31e7f72bb42a None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:48 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-06929e40-d7f8-4859-b3c7-4aa7ea1e870e tempest-ShareInstancesTest-1546991288 tempest-ShareInstancesTest-1546991288-project-admin] GET http://10.27.203.238/share/v2/fb2c57cefad04e97a990bd936225014d/shares/2dfffda2-1f3a-4d2e-9044-2255a211a9f0 May 28 12:56:48 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-06929e40-d7f8-4859-b3c7-4aa7ea1e870e tempest-ShareInstancesTest-1546991288 tempest-ShareInstancesTest-1546991288-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:48 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-06929e40-d7f8-4859-b3c7-4aa7ea1e870e tempest-ShareInstancesTest-1546991288 tempest-ShareInstancesTest-1546991288-project-admin] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:48 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-06929e40-d7f8-4859-b3c7-4aa7ea1e870e tempest-ShareInstancesTest-1546991288 tempest-ShareInstancesTest-1546991288-project-admin] http://10.27.203.238/share/v2/fb2c57cefad04e97a990bd936225014d/shares/2dfffda2-1f3a-4d2e-9044-2255a211a9f0 returned with HTTP 200 May 28 12:56:48 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 128/264] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:56:48 2024] GET /share/v2/fb2c57cefad04e97a990bd936225014d/shares/2dfffda2-1f3a-4d2e-9044-2255a211a9f0 => generated 1371 bytes in 25 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:56:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-56174251-0dd9-4efb-893f-ec92d250baea None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae1ab8d3c7fc4adfac5cafc1d232caef', 'request_id': 'req-56174251-0dd9-4efb-893f-ec92d250baea'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-b004e060-f75b-4542-86b5-31e7f72bb42a None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76cf7583288d4a4eac3cf2f7fac50a81', 'request_id': 'req-b004e060-f75b-4542-86b5-31e7f72bb42a'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-b004e060-f75b-4542-86b5-31e7f72bb42a None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76cf7583288d4a4eac3cf2f7fac50a81', 'request_id': 'req-b004e060-f75b-4542-86b5-31e7f72bb42a'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-56174251-0dd9-4efb-893f-ec92d250baea None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae1ab8d3c7fc4adfac5cafc1d232caef', 'request_id': 'req-56174251-0dd9-4efb-893f-ec92d250baea'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-56174251-0dd9-4efb-893f-ec92d250baea None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae1ab8d3c7fc4adfac5cafc1d232caef', 'request_id': 'req-56174251-0dd9-4efb-893f-ec92d250baea'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-56174251-0dd9-4efb-893f-ec92d250baea None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae1ab8d3c7fc4adfac5cafc1d232caef', 'request_id': 'req-56174251-0dd9-4efb-893f-ec92d250baea'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-b004e060-f75b-4542-86b5-31e7f72bb42a None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76cf7583288d4a4eac3cf2f7fac50a81', 'request_id': 'req-b004e060-f75b-4542-86b5-31e7f72bb42a'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-b004e060-f75b-4542-86b5-31e7f72bb42a None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76cf7583288d4a4eac3cf2f7fac50a81', 'request_id': 'req-b004e060-f75b-4542-86b5-31e7f72bb42a'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-b004e060-f75b-4542-86b5-31e7f72bb42a None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76cf7583288d4a4eac3cf2f7fac50a81', 'request_id': 'req-b004e060-f75b-4542-86b5-31e7f72bb42a'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-56174251-0dd9-4efb-893f-ec92d250baea None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae1ab8d3c7fc4adfac5cafc1d232caef', 'request_id': 'req-56174251-0dd9-4efb-893f-ec92d250baea'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:48 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 794/1569] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 12:56:48 2024] DELETE /identity/v3/users/ae1ab8d3c7fc4adfac5cafc1d232caef => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 28 12:56:48 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 776/1570] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 12:56:48 2024] DELETE /identity/v3/users/76cf7583288d4a4eac3cf2f7fac50a81 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 28 12:56:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56174251-0dd9-4efb-893f-ec92d250baea None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-56174251-0dd9-4efb-893f-ec92d250baea None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f2a802-2be8-4932-944e-ebf4214b81fa None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f2a802-2be8-4932-944e-ebf4214b81fa None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f2a802-2be8-4932-944e-ebf4214b81fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:48 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-13f2a802-2be8-4932-944e-ebf4214b81fa None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:56:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-13f2a802-2be8-4932-944e-ebf4214b81fa None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:56:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-13f2a802-2be8-4932-944e-ebf4214b81fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56174251-0dd9-4efb-893f-ec92d250baea None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:48 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 777/1571] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:56:48 2024] POST /identity/v3/auth/tokens => generated 2960 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 28 12:56:48 l75lg1-v1 neutron-server[77618]: DEBUG neutron.wsgi [-] (77618) accepted ('10.27.203.238', 41020) {{(pid=77618) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 12:56:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f2a802-2be8-4932-944e-ebf4214b81fa None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-13f2a802-2be8-4932-944e-ebf4214b81fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ce2fef-c3e2-41c3-9a4d-e586f422d867 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ce2fef-c3e2-41c3-9a4d-e586f422d867 None admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ce2fef-c3e2-41c3-9a4d-e586f422d867 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ce2fef-c3e2-41c3-9a4d-e586f422d867 None admin] PATH_INFO: `/v3/users/7aee50b56a654f16a4b22ad15fdd1521` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ce2fef-c3e2-41c3-9a4d-e586f422d867 None admin] RBAC: Authorizing `identity:delete_user(user_id=7aee50b56a654f16a4b22ad15fdd1521)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ce2fef-c3e2-41c3-9a4d-e586f422d867 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:48 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f77454c8-a7d3-43f9-807d-8f8535202188 tempest-ShareInstancesTest-1546991288 None] <<< [DELETE] https://127.0.0.1:40443/api/viewpolicies/7/ May 28 12:56:48 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f77454c8-a7d3-43f9-807d-8f8535202188 tempest-ShareInstancesTest-1546991288 None] --- [DELETE] https://127.0.0.1:40443/api/viewpolicies/7/: Done May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f2a802-2be8-4932-944e-ebf4214b81fa None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-09ce2fef-c3e2-41c3-9a4d-e586f422d867 None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7aee50b56a654f16a4b22ad15fdd1521', 'request_id': 'req-09ce2fef-c3e2-41c3-9a4d-e586f422d867'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-09ce2fef-c3e2-41c3-9a4d-e586f422d867 None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7aee50b56a654f16a4b22ad15fdd1521', 'request_id': 'req-09ce2fef-c3e2-41c3-9a4d-e586f422d867'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-09ce2fef-c3e2-41c3-9a4d-e586f422d867 None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7aee50b56a654f16a4b22ad15fdd1521', 'request_id': 'req-09ce2fef-c3e2-41c3-9a4d-e586f422d867'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-09ce2fef-c3e2-41c3-9a4d-e586f422d867 None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7aee50b56a654f16a4b22ad15fdd1521', 'request_id': 'req-09ce2fef-c3e2-41c3-9a4d-e586f422d867'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-09ce2fef-c3e2-41c3-9a4d-e586f422d867 None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7aee50b56a654f16a4b22ad15fdd1521', 'request_id': 'req-09ce2fef-c3e2-41c3-9a4d-e586f422d867'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 795/1572] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 12:56:48 2024] DELETE /identity/v3/users/7aee50b56a654f16a4b22ad15fdd1521 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a547d987-cc94-4fc4-90ee-835b55dc96b6 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a547d987-cc94-4fc4-90ee-835b55dc96b6 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a547d987-cc94-4fc4-90ee-835b55dc96b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f05cd01-50fb-4618-a827-aa627c21d177 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef17047035e4b518fd5360a01f2da1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f05cd01-50fb-4618-a827-aa627c21d177 service neutron] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f05cd01-50fb-4618-a827-aa627c21d177 service neutron] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f05cd01-50fb-4618-a827-aa627c21d177 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-0f05cd01-50fb-4618-a827-aa627c21d177 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-a547d987-cc94-4fc4-90ee-835b55dc96b6 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-a547d987-cc94-4fc4-90ee-835b55dc96b6 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-a547d987-cc94-4fc4-90ee-835b55dc96b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:49 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.manager [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Didn't find any instances for network info cache update. {{(pid=83654) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10012}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f05cd01-50fb-4618-a827-aa627c21d177 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f05cd01-50fb-4618-a827-aa627c21d177 service neutron] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 778/1573] 10.27.203.238 () {64 vars in 1432 bytes} [Tue May 28 12:56:48 2024] GET /identity/v3/auth/tokens => generated 2960 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 28 12:56:49 l75lg1-v1 neutron-server[77618]: INFO neutron.wsgi [None req-136e0bea-9768-4a55-bea1-f10751ce85ae None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=c7f3335cb99f4306a8a60853bfd867c3&name=default HTTP/1.1" status: 200 len: 216 time: 0.1369548 May 28 12:56:49 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c000e723-8995-49ec-9273-4b86621726c5 tempest-AdminActionsTest-1749172189 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 796/1574] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:56:49 2024] POST /identity/v3/auth/tokens => generated 2960 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 12:56:49 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c000e723-8995-49ec-9273-4b86621726c5 tempest-AdminActionsTest-1749172189 None] [Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=0, created='2024-05-28T12:56:33.089480Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='06991041-961d-463f-93e4-93972c4c58c5', id=8, internal=False, is_s3_default_policy=False, name='766fa507-2a4c-47eb-bfef-fa764b38b24c', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=[], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['*'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['*'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T12:56:33.452941Z', tenant_id=1, tenant_name='default', title='766fa507-2a4c-47eb-bfef-fa764b38b24c', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/8/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[])] May 28 12:56:49 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c000e723-8995-49ec-9273-4b86621726c5 tempest-AdminActionsTest-1749172189 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 12:56:49 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c000e723-8995-49ec-9273-4b86621726c5 tempest-AdminActionsTest-1749172189 None] >>> [DELETE] https://127.0.0.1:40443/api/viewpolicies/8/ May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f05cd01-50fb-4618-a827-aa627c21d177 service neutron] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:49 l75lg1-v1 neutron-server[77618]: DEBUG neutron.wsgi [-] (77618) accepted ('10.27.203.238', 41022) {{(pid=77618) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-0f05cd01-50fb-4618-a827-aa627c21d177 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:49 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-f77454c8-a7d3-43f9-807d-8f8535202188 tempest-ShareInstancesTest-1546991288 None] Created reservations ['c8c60c27-d7db-433f-9c0b-ee302ab6e2c2', '9eb18e1d-8fab-489a-b35f-875b78cbebd6', '1a6b8284-c7f5-4040-9f34-5241440b8544', '7f47e1ad-b513-4deb-a9cb-3a3aa9eb8ef4'] {{(pid=98474) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a547d987-cc94-4fc4-90ee-835b55dc96b6 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-a547d987-cc94-4fc4-90ee-835b55dc96b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f05cd01-50fb-4618-a827-aa627c21d177 service neutron] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82da2d95-cfec-4a36-8621-fa86698f03cb None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82da2d95-cfec-4a36-8621-fa86698f03cb None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82da2d95-cfec-4a36-8621-fa86698f03cb None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82da2d95-cfec-4a36-8621-fa86698f03cb None admin] PATH_INFO: `/v3/projects/c7f3335cb99f4306a8a60853bfd867c3` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82da2d95-cfec-4a36-8621-fa86698f03cb None admin] RBAC: Authorizing `identity:delete_project(project_id=c7f3335cb99f4306a8a60853bfd867c3)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82da2d95-cfec-4a36-8621-fa86698f03cb None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:49 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-f77454c8-a7d3-43f9-807d-8f8535202188 tempest-ShareInstancesTest-1546991288 None] Committed reservations ['c8c60c27-d7db-433f-9c0b-ee302ab6e2c2', '9eb18e1d-8fab-489a-b35f-875b78cbebd6', '1a6b8284-c7f5-4040-9f34-5241440b8544', '7f47e1ad-b513-4deb-a9cb-3a3aa9eb8ef4'] {{(pid=98474) commit /opt/stack/manila/manila/quota.py:1063}} May 28 12:56:49 l75lg1-v1 manila-share[98474]: INFO manila.share.manager [None req-f77454c8-a7d3-43f9-807d-8f8535202188 tempest-ShareInstancesTest-1546991288 None] Share instance 7f6a42fa-4d45-471e-a438-36876fc6eac8: deleted successfully. May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a547d987-cc94-4fc4-90ee-835b55dc96b6 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e5f515-2627-49e0-85d4-c062db8008f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef17047035e4b518fd5360a01f2da1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e5f515-2627-49e0-85d4-c062db8008f5 service neutron] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e5f515-2627-49e0-85d4-c062db8008f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e5f515-2627-49e0-85d4-c062db8008f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-82da2d95-cfec-4a36-8621-fa86698f03cb None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7f3335cb99f4306a8a60853bfd867c3', 'request_id': 'req-82da2d95-cfec-4a36-8621-fa86698f03cb'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e5f515-2627-49e0-85d4-c062db8008f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e5f515-2627-49e0-85d4-c062db8008f5 service neutron] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-82da2d95-cfec-4a36-8621-fa86698f03cb None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7f3335cb99f4306a8a60853bfd867c3', 'request_id': 'req-82da2d95-cfec-4a36-8621-fa86698f03cb'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 797/1575] 10.27.203.238 () {64 vars in 1432 bytes} [Tue May 28 12:56:49 2024] GET /identity/v3/auth/tokens => generated 2960 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-82da2d95-cfec-4a36-8621-fa86698f03cb None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7f3335cb99f4306a8a60853bfd867c3', 'request_id': 'req-82da2d95-cfec-4a36-8621-fa86698f03cb'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:49 l75lg1-v1 neutron-server[77618]: INFO neutron.wsgi [None req-d28c2ba0-e566-41dc-b80d-18fec3f37588 None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=a1081c7165a546ba892481e67689dc5b&name=default HTTP/1.1" status: 200 len: 216 time: 0.0770686 May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e5f515-2627-49e0-85d4-c062db8008f5 service neutron] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-b5e5f515-2627-49e0-85d4-c062db8008f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-82da2d95-cfec-4a36-8621-fa86698f03cb None admin] The token cache is being invalidate because project c7f3335cb99f4306a8a60853bfd867c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-82da2d95-cfec-4a36-8621-fa86698f03cb None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-82da2d95-cfec-4a36-8621-fa86698f03cb None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 779/1576] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 12:56:49 2024] DELETE /identity/v3/projects/c7f3335cb99f4306a8a60853bfd867c3 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:56:49 l75lg1-v1 neutron-server[77618]: DEBUG neutron.wsgi [-] (77618) accepted ('10.27.203.238', 41036) {{(pid=77618) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e5f515-2627-49e0-85d4-c062db8008f5 service neutron] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:49 l75lg1-v1 neutron-server[77618]: INFO neutron.wsgi [None req-e1b8ef73-a534-416d-8c67-617d427b6f8f None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=8424fd15a45946d88b09f929bb149784&name=default HTTP/1.1" status: 200 len: 216 time: 0.0080471 May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82da2d95-cfec-4a36-8621-fa86698f03cb None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-82da2d95-cfec-4a36-8621-fa86698f03cb None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683356a1-20dc-41e0-b435-f56a5b6ab879 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683356a1-20dc-41e0-b435-f56a5b6ab879 None admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683356a1-20dc-41e0-b435-f56a5b6ab879 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683356a1-20dc-41e0-b435-f56a5b6ab879 None admin] PATH_INFO: `/v3/projects/a1081c7165a546ba892481e67689dc5b` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683356a1-20dc-41e0-b435-f56a5b6ab879 None admin] RBAC: Authorizing `identity:delete_project(project_id=a1081c7165a546ba892481e67689dc5b)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683356a1-20dc-41e0-b435-f56a5b6ab879 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:49 l75lg1-v1 dstat.sh[49771]: 28-05 12:56:49| 15 2 78 4 0|5659M 1848M 277M 7842M| 17k 1716B| 0 3296k| 0 466 |9893 17k|1.68 1.00 0.99|4.0 1.0 0| 0 0 | 0 2048M| 29 349 0 53 0 May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82da2d95-cfec-4a36-8621-fa86698f03cb None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e29e8b-64f1-4f02-b02a-2728890ff374 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e29e8b-64f1-4f02-b02a-2728890ff374 None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e29e8b-64f1-4f02-b02a-2728890ff374 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e29e8b-64f1-4f02-b02a-2728890ff374 None admin] PATH_INFO: `/v3/projects/8424fd15a45946d88b09f929bb149784` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e29e8b-64f1-4f02-b02a-2728890ff374 None admin] RBAC: Authorizing `identity:delete_project(project_id=8424fd15a45946d88b09f929bb149784)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e29e8b-64f1-4f02-b02a-2728890ff374 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-683356a1-20dc-41e0-b435-f56a5b6ab879 None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1081c7165a546ba892481e67689dc5b', 'request_id': 'req-683356a1-20dc-41e0-b435-f56a5b6ab879'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-683356a1-20dc-41e0-b435-f56a5b6ab879 None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1081c7165a546ba892481e67689dc5b', 'request_id': 'req-683356a1-20dc-41e0-b435-f56a5b6ab879'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-683356a1-20dc-41e0-b435-f56a5b6ab879 None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1081c7165a546ba892481e67689dc5b', 'request_id': 'req-683356a1-20dc-41e0-b435-f56a5b6ab879'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-34e29e8b-64f1-4f02-b02a-2728890ff374 None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8424fd15a45946d88b09f929bb149784', 'request_id': 'req-34e29e8b-64f1-4f02-b02a-2728890ff374'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-34e29e8b-64f1-4f02-b02a-2728890ff374 None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8424fd15a45946d88b09f929bb149784', 'request_id': 'req-34e29e8b-64f1-4f02-b02a-2728890ff374'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-683356a1-20dc-41e0-b435-f56a5b6ab879 None admin] The token cache is being invalidate because project a1081c7165a546ba892481e67689dc5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-683356a1-20dc-41e0-b435-f56a5b6ab879 None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-683356a1-20dc-41e0-b435-f56a5b6ab879 None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 798/1577] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 12:56:49 2024] DELETE /identity/v3/projects/a1081c7165a546ba892481e67689dc5b => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:56:49 l75lg1-v1 neutron-server[77619]: DEBUG neutron.wsgi [-] (77619) accepted ('10.27.203.238', 41040) {{(pid=77619) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-34e29e8b-64f1-4f02-b02a-2728890ff374 None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8424fd15a45946d88b09f929bb149784', 'request_id': 'req-34e29e8b-64f1-4f02-b02a-2728890ff374'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:49 l75lg1-v1 neutron-server[77619]: INFO neutron.wsgi [None req-ec9ea89a-e69a-40f2-bc69-bfbecceb8954 None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=7c36a466cc2a42b195f921474b0f4de5&name=default HTTP/1.1" status: 200 len: 216 time: 0.0086951 May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-34e29e8b-64f1-4f02-b02a-2728890ff374 None admin] The token cache is being invalidate because project 8424fd15a45946d88b09f929bb149784 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-34e29e8b-64f1-4f02-b02a-2728890ff374 None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683356a1-20dc-41e0-b435-f56a5b6ab879 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-34e29e8b-64f1-4f02-b02a-2728890ff374 None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-683356a1-20dc-41e0-b435-f56a5b6ab879 None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 780/1578] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 12:56:49 2024] DELETE /identity/v3/projects/8424fd15a45946d88b09f929bb149784 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:56:49 l75lg1-v1 neutron-server[77618]: DEBUG neutron.wsgi [-] (77618) accepted ('10.27.203.238', 41052) {{(pid=77618) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 12:56:49 l75lg1-v1 neutron-server[77618]: INFO neutron.wsgi [None req-a747101f-0f58-4ace-af49-a095a939f648 None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=87c113478e754c47aea49a8b703cd2f6&name=default HTTP/1.1" status: 200 len: 216 time: 0.0098166 May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e29e8b-64f1-4f02-b02a-2728890ff374 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-34e29e8b-64f1-4f02-b02a-2728890ff374 None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:49 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-4048fa18-a9fe-4c44-ae56-ee790f4588d4 tempest-AccessRulesMetadataTest-1973590610 tempest-AccessRulesMetadataTest-1973590610-project-member] GET http://10.27.203.238/share/v2/1643901550e140118fc2d2e92b82cd0b/share-access-rules?share_id=b92fc06b-76d7-40f9-adef-74a07ace1027 May 28 12:56:49 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-4048fa18-a9fe-4c44-ae56-ee790f4588d4 tempest-AccessRulesMetadataTest-1973590610 tempest-AccessRulesMetadataTest-1973590610-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:49 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-4048fa18-a9fe-4c44-ae56-ee790f4588d4 tempest-AccessRulesMetadataTest-1973590610 tempest-AccessRulesMetadataTest-1973590610-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683356a1-20dc-41e0-b435-f56a5b6ab879 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ddfc64-a083-4d36-a2b3-83a1283193bd None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ddfc64-a083-4d36-a2b3-83a1283193bd None admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ddfc64-a083-4d36-a2b3-83a1283193bd None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ddfc64-a083-4d36-a2b3-83a1283193bd None admin] PATH_INFO: `/v3/projects/7c36a466cc2a42b195f921474b0f4de5` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ddfc64-a083-4d36-a2b3-83a1283193bd None admin] RBAC: Authorizing `identity:delete_project(project_id=7c36a466cc2a42b195f921474b0f4de5)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ddfc64-a083-4d36-a2b3-83a1283193bd None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e29e8b-64f1-4f02-b02a-2728890ff374 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e06cd76-1237-4d1f-a704-58570abd7548 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e06cd76-1237-4d1f-a704-58570abd7548 None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e06cd76-1237-4d1f-a704-58570abd7548 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e06cd76-1237-4d1f-a704-58570abd7548 None admin] PATH_INFO: `/v3/projects/87c113478e754c47aea49a8b703cd2f6` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e06cd76-1237-4d1f-a704-58570abd7548 None admin] RBAC: Authorizing `identity:delete_project(project_id=87c113478e754c47aea49a8b703cd2f6)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e06cd76-1237-4d1f-a704-58570abd7548 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:49 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.lock.api [None req-4048fa18-a9fe-4c44-ae56-ee790f4588d4 tempest-AccessRulesMetadataTest-1973590610 tempest-AccessRulesMetadataTest-1973590610-project-member] Searching for locks by: {'resource_id': '065fb8ea-fc05-4af3-b191-603cca79c74e', 'resource_action': 'show', 'resource_type': 'access_rule'} {{(pid=98329) get_all /opt/stack/manila/manila/lock/api.py:112}} May 28 12:56:49 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-4048fa18-a9fe-4c44-ae56-ee790f4588d4 tempest-AccessRulesMetadataTest-1973590610 tempest-AccessRulesMetadataTest-1973590610-project-member] http://10.27.203.238/share/v2/1643901550e140118fc2d2e92b82cd0b/share-access-rules?share_id=b92fc06b-76d7-40f9-adef-74a07ace1027 returned with HTTP 200 May 28 12:56:49 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 137/265] 10.27.203.238 () {64 vars in 1467 bytes} [Tue May 28 12:56:49 2024] GET /share/v2/1643901550e140118fc2d2e92b82cd0b/share-access-rules?share_id=b92fc06b-76d7-40f9-adef-74a07ace1027 => generated 340 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:56:49 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-d0738bb8-9ab0-4fb2-ab24-00f7e4f5c66f tempest-AccessRulesMetadataTest-1973590610 tempest-AccessRulesMetadataTest-1973590610-project-member] POST http://10.27.203.238/share/v2/1643901550e140118fc2d2e92b82cd0b/shares/b92fc06b-76d7-40f9-adef-74a07ace1027/action May 28 12:56:49 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-d0738bb8-9ab0-4fb2-ab24-00f7e4f5c66f tempest-AccessRulesMetadataTest-1973590610 tempest-AccessRulesMetadataTest-1973590610-project-member] Action body: b'{"allow_access": {"access_type": "ip", "access_to": "2001:0DB8:1ae:b687:f731:7e93:f952:f67b", "access_level": "rw", "metadata": {"key3": "v3", "key4": "value4"}}}' {{(pid=98330) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:56:49 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-d0738bb8-9ab0-4fb2-ab24-00f7e4f5c66f tempest-AccessRulesMetadataTest-1973590610 tempest-AccessRulesMetadataTest-1973590610-project-member] Action: 'action', calling method: Controller.__getattribute__..version_select, body: {"allow_access": {"access_type": "ip", "access_to": "2001:0DB8:1ae:b687:f731:7e93:f952:f67b", "access_level": "rw", "metadata": {"key3": "v3", "key4": "value4"}}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-7e06cd76-1237-4d1f-a704-58570abd7548 None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87c113478e754c47aea49a8b703cd2f6', 'request_id': 'req-7e06cd76-1237-4d1f-a704-58570abd7548'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-53ddfc64-a083-4d36-a2b3-83a1283193bd None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c36a466cc2a42b195f921474b0f4de5', 'request_id': 'req-53ddfc64-a083-4d36-a2b3-83a1283193bd'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-7e06cd76-1237-4d1f-a704-58570abd7548 None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87c113478e754c47aea49a8b703cd2f6', 'request_id': 'req-7e06cd76-1237-4d1f-a704-58570abd7548'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-53ddfc64-a083-4d36-a2b3-83a1283193bd None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c36a466cc2a42b195f921474b0f4de5', 'request_id': 'req-53ddfc64-a083-4d36-a2b3-83a1283193bd'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-53ddfc64-a083-4d36-a2b3-83a1283193bd None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c36a466cc2a42b195f921474b0f4de5', 'request_id': 'req-53ddfc64-a083-4d36-a2b3-83a1283193bd'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-7e06cd76-1237-4d1f-a704-58570abd7548 None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87c113478e754c47aea49a8b703cd2f6', 'request_id': 'req-7e06cd76-1237-4d1f-a704-58570abd7548'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-7e06cd76-1237-4d1f-a704-58570abd7548 None admin] The token cache is being invalidate because project 87c113478e754c47aea49a8b703cd2f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-7e06cd76-1237-4d1f-a704-58570abd7548 None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-7e06cd76-1237-4d1f-a704-58570abd7548 None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 781/1579] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 12:56:49 2024] DELETE /identity/v3/projects/87c113478e754c47aea49a8b703cd2f6 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-53ddfc64-a083-4d36-a2b3-83a1283193bd None admin] The token cache is being invalidate because project 7c36a466cc2a42b195f921474b0f4de5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-53ddfc64-a083-4d36-a2b3-83a1283193bd None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-53ddfc64-a083-4d36-a2b3-83a1283193bd None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 799/1580] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 12:56:49 2024] DELETE /identity/v3/projects/7c36a466cc2a42b195f921474b0f4de5 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 28 12:56:49 l75lg1-v1 neutron-server[77619]: DEBUG neutron.wsgi [-] (77619) accepted ('10.27.203.238', 41068) {{(pid=77619) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb72c608-a52b-48d6-8612-78d4cac3b2ae None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb72c608-a52b-48d6-8612-78d4cac3b2ae None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb72c608-a52b-48d6-8612-78d4cac3b2ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:49 l75lg1-v1 neutron-server[77619]: INFO neutron.wsgi [None req-2b5e7f7a-a37c-4c43-ac42-d4b99f2165bc None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=f65d9e20f04c46548e43d5b813dea402&name=default HTTP/1.1" status: 200 len: 216 time: 0.0084229 May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ddfc64-a083-4d36-a2b3-83a1283193bd None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-53ddfc64-a083-4d36-a2b3-83a1283193bd None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-cb72c608-a52b-48d6-8612-78d4cac3b2ae None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-cb72c608-a52b-48d6-8612-78d4cac3b2ae None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-cb72c608-a52b-48d6-8612-78d4cac3b2ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 782/1581] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:56:49 2024] POST /identity/v3/auth/tokens => generated 312 bytes in 25 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea429ae-b8c4-4cdf-b271-0d2486b5439a None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea429ae-b8c4-4cdf-b271-0d2486b5439a None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea429ae-b8c4-4cdf-b271-0d2486b5439a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-6ea429ae-b8c4-4cdf-b271-0d2486b5439a None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ddfc64-a083-4d36-a2b3-83a1283193bd None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-6ea429ae-b8c4-4cdf-b271-0d2486b5439a None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-6ea429ae-b8c4-4cdf-b271-0d2486b5439a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:49 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-d0738bb8-9ab0-4fb2-ab24-00f7e4f5c66f tempest-AccessRulesMetadataTest-1973590610 tempest-AccessRulesMetadataTest-1973590610-project-member] Acquiring lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:56:49 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-d0738bb8-9ab0-4fb2-ab24-00f7e4f5c66f tempest-AccessRulesMetadataTest-1973590610 tempest-AccessRulesMetadataTest-1973590610-project-member] Lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964d74f5-82af-4649-a618-86c213ddd49a None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964d74f5-82af-4649-a618-86c213ddd49a None admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964d74f5-82af-4649-a618-86c213ddd49a None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964d74f5-82af-4649-a618-86c213ddd49a None admin] PATH_INFO: `/v3/projects/f65d9e20f04c46548e43d5b813dea402` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964d74f5-82af-4649-a618-86c213ddd49a None admin] RBAC: Authorizing `identity:delete_project(project_id=f65d9e20f04c46548e43d5b813dea402)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964d74f5-82af-4649-a618-86c213ddd49a None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 783/1582] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:56:49 2024] POST /identity/v3/auth/tokens => generated 2960 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea429ae-b8c4-4cdf-b271-0d2486b5439a None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea429ae-b8c4-4cdf-b271-0d2486b5439a None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab2fc77-c295-42d7-af3d-0259eea0d3f0 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab2fc77-c295-42d7-af3d-0259eea0d3f0 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab2fc77-c295-42d7-af3d-0259eea0d3f0 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab2fc77-c295-42d7-af3d-0259eea0d3f0 None admin] PATH_INFO: `/v3/domains` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab2fc77-c295-42d7-af3d-0259eea0d3f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab2fc77-c295-42d7-af3d-0259eea0d3f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab2fc77-c295-42d7-af3d-0259eea0d3f0 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 784/1583] 10.27.203.238 () {62 vars in 1220 bytes} [Tue May 28 12:56:49 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab2fc77-c295-42d7-af3d-0259eea0d3f0 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab2fc77-c295-42d7-af3d-0259eea0d3f0 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1b3da2-ad84-4201-a92f-377dec8098e9 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1b3da2-ad84-4201-a92f-377dec8098e9 None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:49 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-d0738bb8-9ab0-4fb2-ab24-00f7e4f5c66f tempest-AccessRulesMetadataTest-1973590610 tempest-AccessRulesMetadataTest-1973590610-project-member] Lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.057s {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1b3da2-ad84-4201-a92f-377dec8098e9 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1b3da2-ad84-4201-a92f-377dec8098e9 None admin] PATH_INFO: `/v3/projects` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1b3da2-ad84-4201-a92f-377dec8098e9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1b3da2-ad84-4201-a92f-377dec8098e9 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:49 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-d0738bb8-9ab0-4fb2-ab24-00f7e4f5c66f tempest-AccessRulesMetadataTest-1973590610 tempest-AccessRulesMetadataTest-1973590610-project-member] http://10.27.203.238/share/v2/1643901550e140118fc2d2e92b82cd0b/shares/b92fc06b-76d7-40f9-adef-74a07ace1027/action returned with HTTP 200 May 28 12:56:49 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 129/266] 10.27.203.238 () {66 vars in 1494 bytes} [Tue May 28 12:56:49 2024] POST /share/v2/1643901550e140118fc2d2e92b82cd0b/shares/b92fc06b-76d7-40f9-adef-74a07ace1027/action => generated 366 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:56:49 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-397b4b45-92ad-419c-a2c6-f585c362c845 tempest-AccessRulesMetadataTest-1973590610 tempest-AccessRulesMetadataTest-1973590610-project-member] GET http://10.27.203.238/share/v2/1643901550e140118fc2d2e92b82cd0b/share-access-rules?share_id=b92fc06b-76d7-40f9-adef-74a07ace1027 May 28 12:56:49 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-397b4b45-92ad-419c-a2c6-f585c362c845 tempest-AccessRulesMetadataTest-1973590610 tempest-AccessRulesMetadataTest-1973590610-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:49 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-397b4b45-92ad-419c-a2c6-f585c362c845 tempest-AccessRulesMetadataTest-1973590610 tempest-AccessRulesMetadataTest-1973590610-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-964d74f5-82af-4649-a618-86c213ddd49a None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f65d9e20f04c46548e43d5b813dea402', 'request_id': 'req-964d74f5-82af-4649-a618-86c213ddd49a'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-964d74f5-82af-4649-a618-86c213ddd49a None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f65d9e20f04c46548e43d5b813dea402', 'request_id': 'req-964d74f5-82af-4649-a618-86c213ddd49a'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-964d74f5-82af-4649-a618-86c213ddd49a None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f65d9e20f04c46548e43d5b813dea402', 'request_id': 'req-964d74f5-82af-4649-a618-86c213ddd49a'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:49 l75lg1-v1 manila-share[98474]: DEBUG manila.share.manager [None req-d0738bb8-9ab0-4fb2-ab24-00f7e4f5c66f tempest-AccessRulesMetadataTest-1973590610 None] Received request to update access for share instance 95118a75-173c-4257-acef-78a246ee1c67. {{(pid=98474) update_access_for_instances /opt/stack/manila/manila/share/manager.py:4353}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 785/1584] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 12:56:49 2024] POST /identity/v3/projects => generated 391 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1b3da2-ad84-4201-a92f-377dec8098e9 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-964d74f5-82af-4649-a618-86c213ddd49a None admin] The token cache is being invalidate because project f65d9e20f04c46548e43d5b813dea402 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-964d74f5-82af-4649-a618-86c213ddd49a None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-964d74f5-82af-4649-a618-86c213ddd49a None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 800/1585] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 12:56:49 2024] DELETE /identity/v3/projects/f65d9e20f04c46548e43d5b813dea402 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 28 12:56:49 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-d0738bb8-9ab0-4fb2-ab24-00f7e4f5c66f tempest-AccessRulesMetadataTest-1973590610 None] Acquiring lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28ef24a-cf8b-4d9e-bc9f-c71aded311c7 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28ef24a-cf8b-4d9e-bc9f-c71aded311c7 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:49 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-d0738bb8-9ab0-4fb2-ab24-00f7e4f5c66f tempest-AccessRulesMetadataTest-1973590610 None] Lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28ef24a-cf8b-4d9e-bc9f-c71aded311c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:49 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-d0738bb8-9ab0-4fb2-ab24-00f7e4f5c66f tempest-AccessRulesMetadataTest-1973590610 None] Lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:56:49 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-d0738bb8-9ab0-4fb2-ab24-00f7e4f5c66f tempest-AccessRulesMetadataTest-1973590610 None] Acquiring lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:56:49 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-d0738bb8-9ab0-4fb2-ab24-00f7e4f5c66f tempest-AccessRulesMetadataTest-1973590610 None] Lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1b3da2-ad84-4201-a92f-377dec8098e9 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:49 l75lg1-v1 nova-conductor[83647]: DEBUG dbcounter [-] [83647] Writing DB stats nova_cell1:SELECT=2,nova_cell1:UPDATE=3 {{(pid=83647) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:56:49 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.lock.api [None req-397b4b45-92ad-419c-a2c6-f585c362c845 tempest-AccessRulesMetadataTest-1973590610 tempest-AccessRulesMetadataTest-1973590610-project-member] Searching for locks by: {'resource_id': '065fb8ea-fc05-4af3-b191-603cca79c74e', 'resource_action': 'show', 'resource_type': 'access_rule'} {{(pid=98329) get_all /opt/stack/manila/manila/lock/api.py:112}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1573e6-3415-4b65-9384-1e05ac214c3a None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1573e6-3415-4b65-9384-1e05ac214c3a None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1573e6-3415-4b65-9384-1e05ac214c3a None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1573e6-3415-4b65-9384-1e05ac214c3a None admin] PATH_INFO: `/v3/users` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-c28ef24a-cf8b-4d9e-bc9f-c71aded311c7 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1573e6-3415-4b65-9384-1e05ac214c3a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1573e6-3415-4b65-9384-1e05ac214c3a None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:49 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.lock.api [None req-397b4b45-92ad-419c-a2c6-f585c362c845 tempest-AccessRulesMetadataTest-1973590610 tempest-AccessRulesMetadataTest-1973590610-project-member] Searching for locks by: {'resource_id': '72727b23-42f9-424a-b54c-87e5069120d3', 'resource_action': 'show', 'resource_type': 'access_rule'} {{(pid=98329) get_all /opt/stack/manila/manila/lock/api.py:112}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-c28ef24a-cf8b-4d9e-bc9f-c71aded311c7 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-6e1573e6-3415-4b65-9384-1e05ac214c3a None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-c28ef24a-cf8b-4d9e-bc9f-c71aded311c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:49 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-397b4b45-92ad-419c-a2c6-f585c362c845 tempest-AccessRulesMetadataTest-1973590610 tempest-AccessRulesMetadataTest-1973590610-project-member] http://10.27.203.238/share/v2/1643901550e140118fc2d2e92b82cd0b/share-access-rules?share_id=b92fc06b-76d7-40f9-adef-74a07ace1027 returned with HTTP 200 May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 801/1586] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:56:49 2024] POST /identity/v3/auth/tokens => generated 312 bytes in 22 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 28 12:56:49 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 138/267] 10.27.203.238 () {64 vars in 1467 bytes} [Tue May 28 12:56:49 2024] GET /share/v2/1643901550e140118fc2d2e92b82cd0b/share-access-rules?share_id=b92fc06b-76d7-40f9-adef-74a07ace1027 => generated 644 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c98cde5-9217-4341-80d0-238b923e7570 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c98cde5-9217-4341-80d0-238b923e7570 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c98cde5-9217-4341-80d0-238b923e7570 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-0c98cde5-9217-4341-80d0-238b923e7570 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 786/1587] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 12:56:49 2024] POST /identity/v3/users => generated 304 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-0c98cde5-9217-4341-80d0-238b923e7570 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-0c98cde5-9217-4341-80d0-238b923e7570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1573e6-3415-4b65-9384-1e05ac214c3a None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-6e1573e6-3415-4b65-9384-1e05ac214c3a None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 802/1588] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:56:49 2024] POST /identity/v3/auth/tokens => generated 2960 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1573e6-3415-4b65-9384-1e05ac214c3a None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c98cde5-9217-4341-80d0-238b923e7570 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd45a5d-2886-4b29-ba6e-7d27d6025e8c None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd45a5d-2886-4b29-ba6e-7d27d6025e8c None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd45a5d-2886-4b29-ba6e-7d27d6025e8c None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd45a5d-2886-4b29-ba6e-7d27d6025e8c None admin] PATH_INFO: `/v3/roles` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd45a5d-2886-4b29-ba6e-7d27d6025e8c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd45a5d-2886-4b29-ba6e-7d27d6025e8c None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c98cde5-9217-4341-80d0-238b923e7570 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ba8a56-371a-490b-9e09-2c1d9dddac4c None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ba8a56-371a-490b-9e09-2c1d9dddac4c None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ba8a56-371a-490b-9e09-2c1d9dddac4c None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ba8a56-371a-490b-9e09-2c1d9dddac4c None admin] PATH_INFO: `/v3/domains` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ba8a56-371a-490b-9e09-2c1d9dddac4c None admin] RBAC: Adding query filter params (name=Default) {{(pid=51267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ba8a56-371a-490b-9e09-2c1d9dddac4c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 787/1589] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 12:56:49 2024] GET /identity/v3/roles => generated 1680 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ba8a56-371a-490b-9e09-2c1d9dddac4c None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd45a5d-2886-4b29-ba6e-7d27d6025e8c None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd45a5d-2886-4b29-ba6e-7d27d6025e8c None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:49 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-d0738bb8-9ab0-4fb2-ab24-00f7e4f5c66f tempest-AccessRulesMetadataTest-1973590610 None] Lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.075s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:56:49 l75lg1-v1 manila-share[98474]: DEBUG manila.share.access [None req-d0738bb8-9ab0-4fb2-ab24-00f7e4f5c66f tempest-AccessRulesMetadataTest-1973590610 None] Updating access rules for share instance 95118a75-173c-4257-acef-78a246ee1c67 belonging to share b92fc06b-76d7-40f9-adef-74a07ace1027. {{(pid=98474) update_access_rules /opt/stack/manila/manila/share/access.py:298}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 803/1590] 10.27.203.238 () {62 vars in 1220 bytes} [Tue May 28 12:56:49 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfaa812-7c0c-40b8-8905-238863619e46 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfaa812-7c0c-40b8-8905-238863619e46 None admin] REQUEST_METHOD: `PUT` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfaa812-7c0c-40b8-8905-238863619e46 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfaa812-7c0c-40b8-8905-238863619e46 None admin] PATH_INFO: `/v3/projects/8122411d892242d0963cf4b8e8fa5bb2/users/48db8b9e3da84d74857c401303968b55/roles/44620cad10ae407c90c91e2c296adb04` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ba8a56-371a-490b-9e09-2c1d9dddac4c None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ba8a56-371a-490b-9e09-2c1d9dddac4c None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55adbad7-4a0a-4c2b-ba45-96f32ef5b122 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55adbad7-4a0a-4c2b-ba45-96f32ef5b122 None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55adbad7-4a0a-4c2b-ba45-96f32ef5b122 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55adbad7-4a0a-4c2b-ba45-96f32ef5b122 None admin] PATH_INFO: `/v3/projects` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfaa812-7c0c-40b8-8905-238863619e46 None admin] RBAC: Authorizing `identity:create_grant(project_id=8122411d892242d0963cf4b8e8fa5bb2, user_id=48db8b9e3da84d74857c401303968b55, role_id=44620cad10ae407c90c91e2c296adb04)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55adbad7-4a0a-4c2b-ba45-96f32ef5b122 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfaa812-7c0c-40b8-8905-238863619e46 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55adbad7-4a0a-4c2b-ba45-96f32ef5b122 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:49 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-d0738bb8-9ab0-4fb2-ab24-00f7e4f5c66f tempest-AccessRulesMetadataTest-1973590610 None] Acquiring lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:56:49 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-d0738bb8-9ab0-4fb2-ab24-00f7e4f5c66f tempest-AccessRulesMetadataTest-1973590610 None] Lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 788/1591] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 12:56:49 2024] PUT /identity/v3/projects/8122411d892242d0963cf4b8e8fa5bb2/users/48db8b9e3da84d74857c401303968b55/roles/44620cad10ae407c90c91e2c296adb04 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 28 12:56:49 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-d0738bb8-9ab0-4fb2-ab24-00f7e4f5c66f tempest-AccessRulesMetadataTest-1973590610 None] Lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.008s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:56:49 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-d0738bb8-9ab0-4fb2-ab24-00f7e4f5c66f tempest-AccessRulesMetadataTest-1973590610 None] Acquiring lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:56:49 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-d0738bb8-9ab0-4fb2-ab24-00f7e4f5c66f tempest-AccessRulesMetadataTest-1973590610 None] Lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35c4f24-15ea-48dd-93c9-0016deef9f29 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35c4f24-15ea-48dd-93c9-0016deef9f29 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35c4f24-15ea-48dd-93c9-0016deef9f29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-c35c4f24-15ea-48dd-93c9-0016deef9f29 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 804/1592] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 12:56:49 2024] POST /identity/v3/projects => generated 409 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55adbad7-4a0a-4c2b-ba45-96f32ef5b122 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-c35c4f24-15ea-48dd-93c9-0016deef9f29 None None] MFA Rules not processed for user `48db8b9e3da84d74857c401303968b55`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-c35c4f24-15ea-48dd-93c9-0016deef9f29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:49 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-d0738bb8-9ab0-4fb2-ab24-00f7e4f5c66f tempest-AccessRulesMetadataTest-1973590610 None] Lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.029s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:56:49 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-d0738bb8-9ab0-4fb2-ab24-00f7e4f5c66f tempest-AccessRulesMetadataTest-1973590610 None] changing access on None May 28 12:56:49 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d0738bb8-9ab0-4fb2-ab24-00f7e4f5c66f tempest-AccessRulesMetadataTest-1973590610 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:56:49 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d0738bb8-9ab0-4fb2-ab24-00f7e4f5c66f tempest-AccessRulesMetadataTest-1973590610 None] {'allow_redirects': True, May 28 12:56:49 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d0738bb8-9ab0-4fb2-ab24-00f7e4f5c66f tempest-AccessRulesMetadataTest-1973590610 None] 'params': {'name': '95118a75-173c-4257-acef-78a246ee1c67'}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55adbad7-4a0a-4c2b-ba45-96f32ef5b122 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25696acb-71c6-4867-8f87-dff09d469a99 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25696acb-71c6-4867-8f87-dff09d469a99 None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25696acb-71c6-4867-8f87-dff09d469a99 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25696acb-71c6-4867-8f87-dff09d469a99 None admin] PATH_INFO: `/v3/users` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25696acb-71c6-4867-8f87-dff09d469a99 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25696acb-71c6-4867-8f87-dff09d469a99 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-25696acb-71c6-4867-8f87-dff09d469a99 None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 789/1593] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:56:49 2024] POST /identity/v3/auth/tokens => generated 3962 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35c4f24-15ea-48dd-93c9-0016deef9f29 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35c4f24-15ea-48dd-93c9-0016deef9f29 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 805/1594] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 12:56:49 2024] POST /identity/v3/users => generated 312 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17c1ba3-f4dc-46d0-8e46-8101fe4ef8c5 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17c1ba3-f4dc-46d0-8e46-8101fe4ef8c5 None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17c1ba3-f4dc-46d0-8e46-8101fe4ef8c5 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17c1ba3-f4dc-46d0-8e46-8101fe4ef8c5 None admin] PATH_INFO: `/v3/projects` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17c1ba3-f4dc-46d0-8e46-8101fe4ef8c5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25696acb-71c6-4867-8f87-dff09d469a99 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17c1ba3-f4dc-46d0-8e46-8101fe4ef8c5 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25696acb-71c6-4867-8f87-dff09d469a99 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65048471-50b2-485e-888c-598c3badd93d None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65048471-50b2-485e-888c-598c3badd93d None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65048471-50b2-485e-888c-598c3badd93d None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65048471-50b2-485e-888c-598c3badd93d None admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65048471-50b2-485e-888c-598c3badd93d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65048471-50b2-485e-888c-598c3badd93d None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 806/1595] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 12:56:49 2024] GET /identity/v3/roles => generated 1680 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65048471-50b2-485e-888c-598c3badd93d None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 790/1596] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 12:56:49 2024] POST /identity/v3/projects => generated 393 bytes in 35 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65048471-50b2-485e-888c-598c3badd93d None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17c1ba3-f4dc-46d0-8e46-8101fe4ef8c5 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:49 l75lg1-v1 nova-conductor[83648]: DEBUG dbcounter [-] [83648] Writing DB stats nova_cell1:SELECT=1 {{(pid=83648) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17c1ba3-f4dc-46d0-8e46-8101fe4ef8c5 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d632e2e3-455e-4a96-aea4-6c8d95138c31 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d632e2e3-455e-4a96-aea4-6c8d95138c31 None admin] REQUEST_METHOD: `PUT` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d632e2e3-455e-4a96-aea4-6c8d95138c31 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d632e2e3-455e-4a96-aea4-6c8d95138c31 None admin] PATH_INFO: `/v3/projects/ad32b3ef77f44ce4940fbcaba8d6549b/users/87694e804d6c455d9e01be494f2abfee/roles/e7989893488f483baa107be56668c4f8` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760a67fd-92cc-48a3-9321-203aafaf88aa None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760a67fd-92cc-48a3-9321-203aafaf88aa None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760a67fd-92cc-48a3-9321-203aafaf88aa None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760a67fd-92cc-48a3-9321-203aafaf88aa None admin] PATH_INFO: `/v3/users` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760a67fd-92cc-48a3-9321-203aafaf88aa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760a67fd-92cc-48a3-9321-203aafaf88aa None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-760a67fd-92cc-48a3-9321-203aafaf88aa None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d632e2e3-455e-4a96-aea4-6c8d95138c31 None admin] RBAC: Authorizing `identity:create_grant(project_id=ad32b3ef77f44ce4940fbcaba8d6549b, user_id=87694e804d6c455d9e01be494f2abfee, role_id=e7989893488f483baa107be56668c4f8)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d632e2e3-455e-4a96-aea4-6c8d95138c31 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 791/1597] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 12:56:49 2024] POST /identity/v3/users => generated 305 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 807/1598] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 12:56:49 2024] PUT /identity/v3/projects/ad32b3ef77f44ce4940fbcaba8d6549b/users/87694e804d6c455d9e01be494f2abfee/roles/e7989893488f483baa107be56668c4f8 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760a67fd-92cc-48a3-9321-203aafaf88aa None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d632e2e3-455e-4a96-aea4-6c8d95138c31 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760a67fd-92cc-48a3-9321-203aafaf88aa None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d632e2e3-455e-4a96-aea4-6c8d95138c31 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504e8f55-274e-4572-9b63-3089908bdece None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504e8f55-274e-4572-9b63-3089908bdece None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504e8f55-274e-4572-9b63-3089908bdece None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504e8f55-274e-4572-9b63-3089908bdece None admin] PATH_INFO: `/v3/roles` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504e8f55-274e-4572-9b63-3089908bdece None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994165e6-d0d3-49b7-850a-a9fab4cb111b None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994165e6-d0d3-49b7-850a-a9fab4cb111b None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504e8f55-274e-4572-9b63-3089908bdece None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994165e6-d0d3-49b7-850a-a9fab4cb111b None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994165e6-d0d3-49b7-850a-a9fab4cb111b None admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994165e6-d0d3-49b7-850a-a9fab4cb111b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994165e6-d0d3-49b7-850a-a9fab4cb111b None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 792/1599] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 12:56:50 2024] GET /identity/v3/roles => generated 1680 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 808/1600] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 12:56:50 2024] GET /identity/v3/roles => generated 1680 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504e8f55-274e-4572-9b63-3089908bdece None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994165e6-d0d3-49b7-850a-a9fab4cb111b None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504e8f55-274e-4572-9b63-3089908bdece None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d68220-a94c-4f7f-994b-6017b23bb3f4 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d68220-a94c-4f7f-994b-6017b23bb3f4 None admin] REQUEST_METHOD: `PUT` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994165e6-d0d3-49b7-850a-a9fab4cb111b None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d68220-a94c-4f7f-994b-6017b23bb3f4 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d68220-a94c-4f7f-994b-6017b23bb3f4 None admin] PATH_INFO: `/v3/projects/7abca1415fa0479a90ff899b30fb3735/users/4718d0ee9a4a4d93bbd3f60f5cc1b4af/roles/44620cad10ae407c90c91e2c296adb04` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947b14e0-7473-4c93-928f-222936373827 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947b14e0-7473-4c93-928f-222936373827 None admin] REQUEST_METHOD: `PUT` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947b14e0-7473-4c93-928f-222936373827 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947b14e0-7473-4c93-928f-222936373827 None admin] PATH_INFO: `/v3/projects/ad32b3ef77f44ce4940fbcaba8d6549b/users/87694e804d6c455d9e01be494f2abfee/roles/e7989893488f483baa107be56668c4f8` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947b14e0-7473-4c93-928f-222936373827 None admin] RBAC: Authorizing `identity:create_grant(project_id=ad32b3ef77f44ce4940fbcaba8d6549b, user_id=87694e804d6c455d9e01be494f2abfee, role_id=e7989893488f483baa107be56668c4f8)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947b14e0-7473-4c93-928f-222936373827 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d68220-a94c-4f7f-994b-6017b23bb3f4 None admin] RBAC: Authorizing `identity:create_grant(project_id=7abca1415fa0479a90ff899b30fb3735, user_id=4718d0ee9a4a4d93bbd3f60f5cc1b4af, role_id=44620cad10ae407c90c91e2c296adb04)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d68220-a94c-4f7f-994b-6017b23bb3f4 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 809/1601] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 12:56:50 2024] PUT /identity/v3/projects/ad32b3ef77f44ce4940fbcaba8d6549b/users/87694e804d6c455d9e01be494f2abfee/roles/e7989893488f483baa107be56668c4f8 => generated 0 bytes in 19 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871213c8-84ff-4cd8-8b62-6fbd50b08542 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871213c8-84ff-4cd8-8b62-6fbd50b08542 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871213c8-84ff-4cd8-8b62-6fbd50b08542 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:50 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 793/1602] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 12:56:50 2024] PUT /identity/v3/projects/7abca1415fa0479a90ff899b30fb3735/users/4718d0ee9a4a4d93bbd3f60f5cc1b4af/roles/44620cad10ae407c90c91e2c296adb04 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2941ed-7755-475c-8838-9365dc732ff7 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2941ed-7755-475c-8838-9365dc732ff7 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2941ed-7755-475c-8838-9365dc732ff7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-871213c8-84ff-4cd8-8b62-6fbd50b08542 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-7d2941ed-7755-475c-8838-9365dc732ff7 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-871213c8-84ff-4cd8-8b62-6fbd50b08542 None None] MFA Rules not processed for user `87694e804d6c455d9e01be494f2abfee`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-871213c8-84ff-4cd8-8b62-6fbd50b08542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-7d2941ed-7755-475c-8838-9365dc732ff7 None None] MFA Rules not processed for user `4718d0ee9a4a4d93bbd3f60f5cc1b4af`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-7d2941ed-7755-475c-8838-9365dc732ff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 810/1603] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:56:50 2024] POST /identity/v3/auth/tokens => generated 4103 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 794/1604] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:56:50 2024] POST /identity/v3/auth/tokens => generated 3964 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871213c8-84ff-4cd8-8b62-6fbd50b08542 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2941ed-7755-475c-8838-9365dc732ff7 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:50 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-5e2e70ce-727c-483a-b4ed-90d041c84d98 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] GET http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/shares/a6fffe7e-d89b-4b6c-ada2-53d5855ef606 May 28 12:56:50 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-5e2e70ce-727c-483a-b4ed-90d041c84d98 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:50 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-5e2e70ce-727c-483a-b4ed-90d041c84d98 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871213c8-84ff-4cd8-8b62-6fbd50b08542 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2941ed-7755-475c-8838-9365dc732ff7 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d8f14d-987b-44fd-9eee-0f1e380efa7c None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1054ddf8-64bf-4094-80ed-1132f3aeb99e None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d8f14d-987b-44fd-9eee-0f1e380efa7c None admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1054ddf8-64bf-4094-80ed-1132f3aeb99e None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d8f14d-987b-44fd-9eee-0f1e380efa7c None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1054ddf8-64bf-4094-80ed-1132f3aeb99e None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d8f14d-987b-44fd-9eee-0f1e380efa7c None admin] PATH_INFO: `/v3/users/87694e804d6c455d9e01be494f2abfee` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1054ddf8-64bf-4094-80ed-1132f3aeb99e None admin] PATH_INFO: `/v3/projects` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1054ddf8-64bf-4094-80ed-1132f3aeb99e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d8f14d-987b-44fd-9eee-0f1e380efa7c None admin] RBAC: Authorizing `identity:delete_user(user_id=87694e804d6c455d9e01be494f2abfee)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1054ddf8-64bf-4094-80ed-1132f3aeb99e None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d8f14d-987b-44fd-9eee-0f1e380efa7c None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:50 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-5e2e70ce-727c-483a-b4ed-90d041c84d98 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/shares/a6fffe7e-d89b-4b6c-ada2-53d5855ef606 returned with HTTP 200 May 28 12:56:50 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 130/268] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:56:50 2024] GET /share/v2/a3499cb78849424db45e54caac01de92/shares/a6fffe7e-d89b-4b6c-ada2-53d5855ef606 => generated 1370 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 795/1605] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 12:56:50 2024] POST /identity/v3/projects => generated 391 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1054ddf8-64bf-4094-80ed-1132f3aeb99e None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:50 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d0738bb8-9ab0-4fb2-ab24-00f7e4f5c66f tempest-AccessRulesMetadataTest-1973590610 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:56:50 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d0738bb8-9ab0-4fb2-ab24-00f7e4f5c66f tempest-AccessRulesMetadataTest-1973590610 None] [Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=1, created='2024-05-28T12:56:41.381687Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='8ed5f8f5-e848-431c-be27-16f1fa370a60', id=9, internal=False, is_s3_default_policy=False, name='95118a75-173c-4257-acef-78a246ee1c67', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=[], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['*'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['*'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T12:56:41.744950Z', tenant_id=1, tenant_name='default', title='95118a75-173c-4257-acef-78a246ee1c67', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/9/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[])] May 28 12:56:50 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d0738bb8-9ab0-4fb2-ab24-00f7e4f5c66f tempest-AccessRulesMetadataTest-1973590610 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 12:56:50 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-d0738bb8-9ab0-4fb2-ab24-00f7e4f5c66f tempest-AccessRulesMetadataTest-1973590610 None] Acquiring lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:56:50 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-d0738bb8-9ab0-4fb2-ab24-00f7e4f5c66f tempest-AccessRulesMetadataTest-1973590610 None] Lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1054ddf8-64bf-4094-80ed-1132f3aeb99e None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-75d8f14d-987b-44fd-9eee-0f1e380efa7c None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87694e804d6c455d9e01be494f2abfee', 'request_id': 'req-75d8f14d-987b-44fd-9eee-0f1e380efa7c'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:50 l75lg1-v1 dstat.sh[49771]: 28-05 12:56:50| 21 2 70 6 0|5660M 1846M 277M 7842M| 19k 1054B| 0 9017k| 0 811 | 12k 22k|1.68 1.00 0.99|4.0 1.0 0| 0 0 | 0 2048M| 29 349 0 56 0 May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-75d8f14d-987b-44fd-9eee-0f1e380efa7c None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87694e804d6c455d9e01be494f2abfee', 'request_id': 'req-75d8f14d-987b-44fd-9eee-0f1e380efa7c'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-75d8f14d-987b-44fd-9eee-0f1e380efa7c None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87694e804d6c455d9e01be494f2abfee', 'request_id': 'req-75d8f14d-987b-44fd-9eee-0f1e380efa7c'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-75d8f14d-987b-44fd-9eee-0f1e380efa7c None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87694e804d6c455d9e01be494f2abfee', 'request_id': 'req-75d8f14d-987b-44fd-9eee-0f1e380efa7c'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8485d3c6-da85-4a37-ac0a-3a2eab72e7f8 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8485d3c6-da85-4a37-ac0a-3a2eab72e7f8 None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8485d3c6-da85-4a37-ac0a-3a2eab72e7f8 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8485d3c6-da85-4a37-ac0a-3a2eab72e7f8 None admin] PATH_INFO: `/v3/users` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-75d8f14d-987b-44fd-9eee-0f1e380efa7c None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87694e804d6c455d9e01be494f2abfee', 'request_id': 'req-75d8f14d-987b-44fd-9eee-0f1e380efa7c'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8485d3c6-da85-4a37-ac0a-3a2eab72e7f8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8485d3c6-da85-4a37-ac0a-3a2eab72e7f8 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-8485d3c6-da85-4a37-ac0a-3a2eab72e7f8 None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 811/1606] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 12:56:50 2024] DELETE /identity/v3/users/87694e804d6c455d9e01be494f2abfee => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370e24b8-d92c-47b3-b1ad-eae5d2c95dbb None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370e24b8-d92c-47b3-b1ad-eae5d2c95dbb None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370e24b8-d92c-47b3-b1ad-eae5d2c95dbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-370e24b8-d92c-47b3-b1ad-eae5d2c95dbb None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-370e24b8-d92c-47b3-b1ad-eae5d2c95dbb None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-370e24b8-d92c-47b3-b1ad-eae5d2c95dbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 796/1607] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 12:56:50 2024] POST /identity/v3/users => generated 303 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8485d3c6-da85-4a37-ac0a-3a2eab72e7f8 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-8485d3c6-da85-4a37-ac0a-3a2eab72e7f8 None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8485d3c6-da85-4a37-ac0a-3a2eab72e7f8 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 812/1608] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:56:50 2024] POST /identity/v3/auth/tokens => generated 2960 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 12:56:50 l75lg1-v1 neutron-server[77618]: DEBUG neutron.wsgi [-] (77618) accepted ('10.27.203.238', 40242) {{(pid=77618) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 12:56:50 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-d0738bb8-9ab0-4fb2-ab24-00f7e4f5c66f tempest-AccessRulesMetadataTest-1973590610 None] Lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.105s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370e24b8-d92c-47b3-b1ad-eae5d2c95dbb None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:50 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-d0738bb8-9ab0-4fb2-ab24-00f7e4f5c66f tempest-AccessRulesMetadataTest-1973590610 None] Acquiring lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:56:50 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-d0738bb8-9ab0-4fb2-ab24-00f7e4f5c66f tempest-AccessRulesMetadataTest-1973590610 None] Lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:56:50 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-d0738bb8-9ab0-4fb2-ab24-00f7e4f5c66f tempest-AccessRulesMetadataTest-1973590610 None] Lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:56:50 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-d0738bb8-9ab0-4fb2-ab24-00f7e4f5c66f tempest-AccessRulesMetadataTest-1973590610 None] Acquiring lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-370e24b8-d92c-47b3-b1ad-eae5d2c95dbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:50 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-d0738bb8-9ab0-4fb2-ab24-00f7e4f5c66f tempest-AccessRulesMetadataTest-1973590610 None] Lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:56:50 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-d0738bb8-9ab0-4fb2-ab24-00f7e4f5c66f tempest-AccessRulesMetadataTest-1973590610 None] Lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:56:50 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-d0738bb8-9ab0-4fb2-ab24-00f7e4f5c66f tempest-AccessRulesMetadataTest-1973590610 None] Acquiring lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:56:50 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-d0738bb8-9ab0-4fb2-ab24-00f7e4f5c66f tempest-AccessRulesMetadataTest-1973590610 None] Lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:56:50 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-d0738bb8-9ab0-4fb2-ab24-00f7e4f5c66f tempest-AccessRulesMetadataTest-1973590610 None] Lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:56:50 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-d0738bb8-9ab0-4fb2-ab24-00f7e4f5c66f tempest-AccessRulesMetadataTest-1973590610 None] Acquiring lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:56:50 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-d0738bb8-9ab0-4fb2-ab24-00f7e4f5c66f tempest-AccessRulesMetadataTest-1973590610 None] Lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebddb8f1-dac8-4b05-8ed3-524aa132d88a None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebddb8f1-dac8-4b05-8ed3-524aa132d88a None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebddb8f1-dac8-4b05-8ed3-524aa132d88a None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebddb8f1-dac8-4b05-8ed3-524aa132d88a None admin] PATH_INFO: `/v3/roles` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebddb8f1-dac8-4b05-8ed3-524aa132d88a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebddb8f1-dac8-4b05-8ed3-524aa132d88a None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 797/1609] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 12:56:50 2024] GET /identity/v3/roles => generated 1680 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebddb8f1-dac8-4b05-8ed3-524aa132d88a None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebddb8f1-dac8-4b05-8ed3-524aa132d88a None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee3e853-f9b0-4ed7-8d91-0df502aeace6 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee3e853-f9b0-4ed7-8d91-0df502aeace6 None admin] REQUEST_METHOD: `PUT` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee3e853-f9b0-4ed7-8d91-0df502aeace6 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee3e853-f9b0-4ed7-8d91-0df502aeace6 None admin] PATH_INFO: `/v3/projects/df93a973373644ccaf8ecf54774a4ced/users/f047e790f5704d6c9c05ddd053c2c71c/roles/e7989893488f483baa107be56668c4f8` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee3e853-f9b0-4ed7-8d91-0df502aeace6 None admin] RBAC: Authorizing `identity:create_grant(project_id=df93a973373644ccaf8ecf54774a4ced, user_id=f047e790f5704d6c9c05ddd053c2c71c, role_id=e7989893488f483baa107be56668c4f8)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee3e853-f9b0-4ed7-8d91-0df502aeace6 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370e24b8-d92c-47b3-b1ad-eae5d2c95dbb None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:50 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-d0738bb8-9ab0-4fb2-ab24-00f7e4f5c66f tempest-AccessRulesMetadataTest-1973590610 None] Lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.040s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:56:50 l75lg1-v1 manila-share[98474]: INFO manila.share.access [None req-d0738bb8-9ab0-4fb2-ab24-00f7e4f5c66f tempest-AccessRulesMetadataTest-1973590610 None] Access rules were successfully modified for share instance 95118a75-173c-4257-acef-78a246ee1c67 belonging to share b92fc06b-76d7-40f9-adef-74a07ace1027. May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf97897-b31c-4deb-8613-e27b60a98c28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef17047035e4b518fd5360a01f2da1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf97897-b31c-4deb-8613-e27b60a98c28 service neutron] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf97897-b31c-4deb-8613-e27b60a98c28 service neutron] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf97897-b31c-4deb-8613-e27b60a98c28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf97897-b31c-4deb-8613-e27b60a98c28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf97897-b31c-4deb-8613-e27b60a98c28 service neutron] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 798/1610] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 12:56:50 2024] PUT /identity/v3/projects/df93a973373644ccaf8ecf54774a4ced/users/f047e790f5704d6c9c05ddd053c2c71c/roles/e7989893488f483baa107be56668c4f8 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 813/1611] 10.27.203.238 () {64 vars in 1432 bytes} [Tue May 28 12:56:50 2024] GET /identity/v3/auth/tokens => generated 2960 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee3e853-f9b0-4ed7-8d91-0df502aeace6 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:50 l75lg1-v1 neutron-server[77618]: INFO neutron.wsgi [None req-77cb80da-c996-4778-b429-87e082eacc59 None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=ad32b3ef77f44ce4940fbcaba8d6549b&name=default HTTP/1.1" status: 200 len: 216 time: 0.0766935 May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf97897-b31c-4deb-8613-e27b60a98c28 service neutron] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-6bf97897-b31c-4deb-8613-e27b60a98c28 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf97897-b31c-4deb-8613-e27b60a98c28 service neutron] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee3e853-f9b0-4ed7-8d91-0df502aeace6 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a0cc38-9e56-4ba8-b830-dcb765322ad6 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a0cc38-9e56-4ba8-b830-dcb765322ad6 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a0cc38-9e56-4ba8-b830-dcb765322ad6 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a0cc38-9e56-4ba8-b830-dcb765322ad6 None admin] PATH_INFO: `/v3/roles` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a0cc38-9e56-4ba8-b830-dcb765322ad6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a0cc38-9e56-4ba8-b830-dcb765322ad6 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 799/1612] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 12:56:50 2024] GET /identity/v3/roles => generated 1680 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6912a4e-d5c1-4cb2-a13b-a70fd43b1a4b None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6912a4e-d5c1-4cb2-a13b-a70fd43b1a4b None admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6912a4e-d5c1-4cb2-a13b-a70fd43b1a4b None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6912a4e-d5c1-4cb2-a13b-a70fd43b1a4b None admin] PATH_INFO: `/v3/projects/ad32b3ef77f44ce4940fbcaba8d6549b` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6912a4e-d5c1-4cb2-a13b-a70fd43b1a4b None admin] RBAC: Authorizing `identity:delete_project(project_id=ad32b3ef77f44ce4940fbcaba8d6549b)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a0cc38-9e56-4ba8-b830-dcb765322ad6 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6912a4e-d5c1-4cb2-a13b-a70fd43b1a4b None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a0cc38-9e56-4ba8-b830-dcb765322ad6 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a93fea-b8ff-46f9-b459-bee4a56f0d9f None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a93fea-b8ff-46f9-b459-bee4a56f0d9f None admin] REQUEST_METHOD: `PUT` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a93fea-b8ff-46f9-b459-bee4a56f0d9f None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a93fea-b8ff-46f9-b459-bee4a56f0d9f None admin] PATH_INFO: `/v3/projects/df93a973373644ccaf8ecf54774a4ced/users/f047e790f5704d6c9c05ddd053c2c71c/roles/e7989893488f483baa107be56668c4f8` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a93fea-b8ff-46f9-b459-bee4a56f0d9f None admin] RBAC: Authorizing `identity:create_grant(project_id=df93a973373644ccaf8ecf54774a4ced, user_id=f047e790f5704d6c9c05ddd053c2c71c, role_id=e7989893488f483baa107be56668c4f8)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a93fea-b8ff-46f9-b459-bee4a56f0d9f None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 800/1613] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 12:56:50 2024] PUT /identity/v3/projects/df93a973373644ccaf8ecf54774a4ced/users/f047e790f5704d6c9c05ddd053c2c71c/roles/e7989893488f483baa107be56668c4f8 => generated 0 bytes in 19 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ce1b87-dafe-48b8-80e9-6457e6403789 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ce1b87-dafe-48b8-80e9-6457e6403789 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ce1b87-dafe-48b8-80e9-6457e6403789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-05ce1b87-dafe-48b8-80e9-6457e6403789 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-d6912a4e-d5c1-4cb2-a13b-a70fd43b1a4b None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad32b3ef77f44ce4940fbcaba8d6549b', 'request_id': 'req-d6912a4e-d5c1-4cb2-a13b-a70fd43b1a4b'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-d6912a4e-d5c1-4cb2-a13b-a70fd43b1a4b None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad32b3ef77f44ce4940fbcaba8d6549b', 'request_id': 'req-d6912a4e-d5c1-4cb2-a13b-a70fd43b1a4b'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-d6912a4e-d5c1-4cb2-a13b-a70fd43b1a4b None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad32b3ef77f44ce4940fbcaba8d6549b', 'request_id': 'req-d6912a4e-d5c1-4cb2-a13b-a70fd43b1a4b'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-05ce1b87-dafe-48b8-80e9-6457e6403789 None None] MFA Rules not processed for user `f047e790f5704d6c9c05ddd053c2c71c`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-05ce1b87-dafe-48b8-80e9-6457e6403789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-d6912a4e-d5c1-4cb2-a13b-a70fd43b1a4b None admin] The token cache is being invalidate because project ad32b3ef77f44ce4940fbcaba8d6549b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-d6912a4e-d5c1-4cb2-a13b-a70fd43b1a4b None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-d6912a4e-d5c1-4cb2-a13b-a70fd43b1a4b None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 814/1614] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 12:56:50 2024] DELETE /identity/v3/projects/ad32b3ef77f44ce4940fbcaba8d6549b => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44f8e96-e2ce-4e01-8baa-dc0d624b85fe None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44f8e96-e2ce-4e01-8baa-dc0d624b85fe None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44f8e96-e2ce-4e01-8baa-dc0d624b85fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-c44f8e96-e2ce-4e01-8baa-dc0d624b85fe None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-c44f8e96-e2ce-4e01-8baa-dc0d624b85fe None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-c44f8e96-e2ce-4e01-8baa-dc0d624b85fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 815/1615] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:56:50 2024] POST /identity/v3/auth/tokens => generated 312 bytes in 18 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580ac1ed-2c38-4918-baa1-0b553855bbf4 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580ac1ed-2c38-4918-baa1-0b553855bbf4 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580ac1ed-2c38-4918-baa1-0b553855bbf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-580ac1ed-2c38-4918-baa1-0b553855bbf4 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 801/1616] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:56:50 2024] POST /identity/v3/auth/tokens => generated 4085 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-580ac1ed-2c38-4918-baa1-0b553855bbf4 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-580ac1ed-2c38-4918-baa1-0b553855bbf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ce1b87-dafe-48b8-80e9-6457e6403789 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ce1b87-dafe-48b8-80e9-6457e6403789 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50ef6fa-70a2-45c8-9264-7396c9ff9b9c tempest-ExportLocationsNegativeTest-386865252 tempest-ExportLocationsNegativeTest-386865252-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f047e790f5704d6c9c05ddd053c2c71c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df93a973373644ccaf8ecf54774a4ced', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50ef6fa-70a2-45c8-9264-7396c9ff9b9c tempest-ExportLocationsNegativeTest-386865252 tempest-ExportLocationsNegativeTest-386865252-project-admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50ef6fa-70a2-45c8-9264-7396c9ff9b9c tempest-ExportLocationsNegativeTest-386865252 tempest-ExportLocationsNegativeTest-386865252-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50ef6fa-70a2-45c8-9264-7396c9ff9b9c tempest-ExportLocationsNegativeTest-386865252 tempest-ExportLocationsNegativeTest-386865252-project-admin] PATH_INFO: `/v3/domains` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50ef6fa-70a2-45c8-9264-7396c9ff9b9c tempest-ExportLocationsNegativeTest-386865252 tempest-ExportLocationsNegativeTest-386865252-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50ef6fa-70a2-45c8-9264-7396c9ff9b9c tempest-ExportLocationsNegativeTest-386865252 tempest-ExportLocationsNegativeTest-386865252-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50ef6fa-70a2-45c8-9264-7396c9ff9b9c tempest-ExportLocationsNegativeTest-386865252 tempest-ExportLocationsNegativeTest-386865252-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 802/1617] 10.27.203.238 () {62 vars in 1241 bytes} [Tue May 28 12:56:50 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 816/1618] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:56:50 2024] POST /identity/v3/auth/tokens => generated 2960 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50ef6fa-70a2-45c8-9264-7396c9ff9b9c tempest-ExportLocationsNegativeTest-386865252 tempest-ExportLocationsNegativeTest-386865252-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580ac1ed-2c38-4918-baa1-0b553855bbf4 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50ef6fa-70a2-45c8-9264-7396c9ff9b9c tempest-ExportLocationsNegativeTest-386865252 tempest-ExportLocationsNegativeTest-386865252-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580bb2f4-7645-45d7-a099-9a63b2bed700 tempest-ExportLocationsNegativeTest-386865252 tempest-ExportLocationsNegativeTest-386865252-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f047e790f5704d6c9c05ddd053c2c71c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df93a973373644ccaf8ecf54774a4ced', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580bb2f4-7645-45d7-a099-9a63b2bed700 tempest-ExportLocationsNegativeTest-386865252 tempest-ExportLocationsNegativeTest-386865252-project-admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580bb2f4-7645-45d7-a099-9a63b2bed700 tempest-ExportLocationsNegativeTest-386865252 tempest-ExportLocationsNegativeTest-386865252-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580bb2f4-7645-45d7-a099-9a63b2bed700 tempest-ExportLocationsNegativeTest-386865252 tempest-ExportLocationsNegativeTest-386865252-project-admin] PATH_INFO: `/v3/users` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580bb2f4-7645-45d7-a099-9a63b2bed700 tempest-ExportLocationsNegativeTest-386865252 tempest-ExportLocationsNegativeTest-386865252-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580ac1ed-2c38-4918-baa1-0b553855bbf4 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580bb2f4-7645-45d7-a099-9a63b2bed700 tempest-ExportLocationsNegativeTest-386865252 tempest-ExportLocationsNegativeTest-386865252-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e716fe-ae49-457b-b1d8-cac2e92b3b0e None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-580bb2f4-7645-45d7-a099-9a63b2bed700 tempest-ExportLocationsNegativeTest-386865252 tempest-ExportLocationsNegativeTest-386865252-project-admin] Truncating password to algorithm specific maximum length 72 characters. May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e716fe-ae49-457b-b1d8-cac2e92b3b0e None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e716fe-ae49-457b-b1d8-cac2e92b3b0e None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e716fe-ae49-457b-b1d8-cac2e92b3b0e None admin] PATH_INFO: `/v3/domains` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:50 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager.update_available_resource {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e716fe-ae49-457b-b1d8-cac2e92b3b0e None admin] RBAC: Adding query filter params (name=Default) {{(pid=51267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e716fe-ae49-457b-b1d8-cac2e92b3b0e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e716fe-ae49-457b-b1d8-cac2e92b3b0e None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:50 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Expecting reply to msg 549b11124bbe4da0ae38af6f28d3cb34 in queue reply_37f4cbd1dd094961a22b8a65f222c327 May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 817/1619] 10.27.203.238 () {62 vars in 1220 bytes} [Tue May 28 12:56:50 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e716fe-ae49-457b-b1d8-cac2e92b3b0e None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:50 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [-] Received RPC response for msg 549b11124bbe4da0ae38af6f28d3cb34 May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e716fe-ae49-457b-b1d8-cac2e92b3b0e None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc057bac-10a9-47e3-9b9d-40c9a2e75fc8 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc057bac-10a9-47e3-9b9d-40c9a2e75fc8 None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc057bac-10a9-47e3-9b9d-40c9a2e75fc8 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc057bac-10a9-47e3-9b9d-40c9a2e75fc8 None admin] PATH_INFO: `/v3/projects` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc057bac-10a9-47e3-9b9d-40c9a2e75fc8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc057bac-10a9-47e3-9b9d-40c9a2e75fc8 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 803/1620] 10.27.203.238 () {64 vars in 1232 bytes} [Tue May 28 12:56:50 2024] POST /identity/v3/users => generated 435 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580bb2f4-7645-45d7-a099-9a63b2bed700 tempest-ExportLocationsNegativeTest-386865252 tempest-ExportLocationsNegativeTest-386865252-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580bb2f4-7645-45d7-a099-9a63b2bed700 tempest-ExportLocationsNegativeTest-386865252 tempest-ExportLocationsNegativeTest-386865252-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f10682-edf6-45d1-ac6e-bfd39b5c18c1 tempest-ExportLocationsNegativeTest-386865252 tempest-ExportLocationsNegativeTest-386865252-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f047e790f5704d6c9c05ddd053c2c71c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df93a973373644ccaf8ecf54774a4ced', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f10682-edf6-45d1-ac6e-bfd39b5c18c1 tempest-ExportLocationsNegativeTest-386865252 tempest-ExportLocationsNegativeTest-386865252-project-admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f10682-edf6-45d1-ac6e-bfd39b5c18c1 tempest-ExportLocationsNegativeTest-386865252 tempest-ExportLocationsNegativeTest-386865252-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f10682-edf6-45d1-ac6e-bfd39b5c18c1 tempest-ExportLocationsNegativeTest-386865252 tempest-ExportLocationsNegativeTest-386865252-project-admin] PATH_INFO: `/v3/roles` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f10682-edf6-45d1-ac6e-bfd39b5c18c1 tempest-ExportLocationsNegativeTest-386865252 tempest-ExportLocationsNegativeTest-386865252-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f10682-edf6-45d1-ac6e-bfd39b5c18c1 tempest-ExportLocationsNegativeTest-386865252 tempest-ExportLocationsNegativeTest-386865252-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 804/1621] 10.27.203.238 () {62 vars in 1210 bytes} [Tue May 28 12:56:50 2024] GET /identity/v3/roles => generated 1680 bytes in 17 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f10682-edf6-45d1-ac6e-bfd39b5c18c1 tempest-ExportLocationsNegativeTest-386865252 tempest-ExportLocationsNegativeTest-386865252-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 818/1622] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 12:56:50 2024] POST /identity/v3/projects => generated 409 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f10682-edf6-45d1-ac6e-bfd39b5c18c1 tempest-ExportLocationsNegativeTest-386865252 tempest-ExportLocationsNegativeTest-386865252-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc057bac-10a9-47e3-9b9d-40c9a2e75fc8 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc057bac-10a9-47e3-9b9d-40c9a2e75fc8 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f3ff9f-08fd-4c4e-909b-1276559ef489 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f3ff9f-08fd-4c4e-909b-1276559ef489 None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f3ff9f-08fd-4c4e-909b-1276559ef489 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f3ff9f-08fd-4c4e-909b-1276559ef489 None admin] PATH_INFO: `/v3/users` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f3ff9f-08fd-4c4e-909b-1276559ef489 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f3ff9f-08fd-4c4e-909b-1276559ef489 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-32f3ff9f-08fd-4c4e-909b-1276559ef489 None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1918d79d-d54c-4ac3-806a-0cb72ad4fed8 tempest-ExportLocationsNegativeTest-386865252 tempest-ExportLocationsNegativeTest-386865252-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f047e790f5704d6c9c05ddd053c2c71c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df93a973373644ccaf8ecf54774a4ced', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1918d79d-d54c-4ac3-806a-0cb72ad4fed8 tempest-ExportLocationsNegativeTest-386865252 tempest-ExportLocationsNegativeTest-386865252-project-admin] REQUEST_METHOD: `PUT` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1918d79d-d54c-4ac3-806a-0cb72ad4fed8 tempest-ExportLocationsNegativeTest-386865252 tempest-ExportLocationsNegativeTest-386865252-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1918d79d-d54c-4ac3-806a-0cb72ad4fed8 tempest-ExportLocationsNegativeTest-386865252 tempest-ExportLocationsNegativeTest-386865252-project-admin] PATH_INFO: `/v3/projects/df93a973373644ccaf8ecf54774a4ced/users/108a25e436e9452a9a865957dcea1fc5/roles/44620cad10ae407c90c91e2c296adb04` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 819/1623] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 12:56:50 2024] POST /identity/v3/users => generated 312 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f3ff9f-08fd-4c4e-909b-1276559ef489 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f3ff9f-08fd-4c4e-909b-1276559ef489 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1918d79d-d54c-4ac3-806a-0cb72ad4fed8 tempest-ExportLocationsNegativeTest-386865252 tempest-ExportLocationsNegativeTest-386865252-project-admin] RBAC: Authorizing `identity:create_grant(project_id=df93a973373644ccaf8ecf54774a4ced, user_id=108a25e436e9452a9a865957dcea1fc5, role_id=44620cad10ae407c90c91e2c296adb04)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27255b7e-04d8-4b97-8f9d-40dc1cf156a7 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27255b7e-04d8-4b97-8f9d-40dc1cf156a7 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27255b7e-04d8-4b97-8f9d-40dc1cf156a7 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1918d79d-d54c-4ac3-806a-0cb72ad4fed8 tempest-ExportLocationsNegativeTest-386865252 tempest-ExportLocationsNegativeTest-386865252-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27255b7e-04d8-4b97-8f9d-40dc1cf156a7 None admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27255b7e-04d8-4b97-8f9d-40dc1cf156a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27255b7e-04d8-4b97-8f9d-40dc1cf156a7 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 820/1624] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 12:56:50 2024] GET /identity/v3/roles => generated 1680 bytes in 16 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27255b7e-04d8-4b97-8f9d-40dc1cf156a7 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27255b7e-04d8-4b97-8f9d-40dc1cf156a7 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5004c262-e87e-49ec-a9fb-78fc62e0e733 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5004c262-e87e-49ec-a9fb-78fc62e0e733 None admin] REQUEST_METHOD: `PUT` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5004c262-e87e-49ec-a9fb-78fc62e0e733 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5004c262-e87e-49ec-a9fb-78fc62e0e733 None admin] PATH_INFO: `/v3/projects/8e7ce02170aa410eab05376bcf2808e0/users/f71c80a1588c4c8baa7eebdac29cda10/roles/e7989893488f483baa107be56668c4f8` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 805/1625] 10.27.203.238 () {64 vars in 1571 bytes} [Tue May 28 12:56:50 2024] PUT /identity/v3/projects/df93a973373644ccaf8ecf54774a4ced/users/108a25e436e9452a9a865957dcea1fc5/roles/44620cad10ae407c90c91e2c296adb04 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5004c262-e87e-49ec-a9fb-78fc62e0e733 None admin] RBAC: Authorizing `identity:create_grant(project_id=8e7ce02170aa410eab05376bcf2808e0, user_id=f71c80a1588c4c8baa7eebdac29cda10, role_id=e7989893488f483baa107be56668c4f8)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5004c262-e87e-49ec-a9fb-78fc62e0e733 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1918d79d-d54c-4ac3-806a-0cb72ad4fed8 tempest-ExportLocationsNegativeTest-386865252 tempest-ExportLocationsNegativeTest-386865252-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-1918d79d-d54c-4ac3-806a-0cb72ad4fed8 tempest-ExportLocationsNegativeTest-386865252 tempest-ExportLocationsNegativeTest-386865252-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 821/1626] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 12:56:50 2024] PUT /identity/v3/projects/8e7ce02170aa410eab05376bcf2808e0/users/f71c80a1588c4c8baa7eebdac29cda10/roles/e7989893488f483baa107be56668c4f8 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5004c262-e87e-49ec-a9fb-78fc62e0e733 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5004c262-e87e-49ec-a9fb-78fc62e0e733 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf3b9c5-9c88-4518-9a87-db61c7520c31 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf3b9c5-9c88-4518-9a87-db61c7520c31 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf3b9c5-9c88-4518-9a87-db61c7520c31 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf3b9c5-9c88-4518-9a87-db61c7520c31 None admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf3b9c5-9c88-4518-9a87-db61c7520c31 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf3b9c5-9c88-4518-9a87-db61c7520c31 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1918d79d-d54c-4ac3-806a-0cb72ad4fed8 tempest-ExportLocationsNegativeTest-386865252 tempest-ExportLocationsNegativeTest-386865252-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 822/1627] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 12:56:50 2024] GET /identity/v3/roles => generated 1680 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf3b9c5-9c88-4518-9a87-db61c7520c31 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf3b9c5-9c88-4518-9a87-db61c7520c31 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69dc69a-ed67-4b13-b4d4-50d2ae827c03 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69dc69a-ed67-4b13-b4d4-50d2ae827c03 None admin] REQUEST_METHOD: `PUT` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69dc69a-ed67-4b13-b4d4-50d2ae827c03 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69dc69a-ed67-4b13-b4d4-50d2ae827c03 None admin] PATH_INFO: `/v3/projects/8e7ce02170aa410eab05376bcf2808e0/users/f71c80a1588c4c8baa7eebdac29cda10/roles/e7989893488f483baa107be56668c4f8` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69dc69a-ed67-4b13-b4d4-50d2ae827c03 None admin] RBAC: Authorizing `identity:create_grant(project_id=8e7ce02170aa410eab05376bcf2808e0, user_id=f71c80a1588c4c8baa7eebdac29cda10, role_id=e7989893488f483baa107be56668c4f8)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69dc69a-ed67-4b13-b4d4-50d2ae827c03 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 823/1628] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 12:56:50 2024] PUT /identity/v3/projects/8e7ce02170aa410eab05376bcf2808e0/users/f71c80a1588c4c8baa7eebdac29cda10/roles/e7989893488f483baa107be56668c4f8 => generated 0 bytes in 17 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c01bed-7089-4fbb-8745-786765ae7c32 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c01bed-7089-4fbb-8745-786765ae7c32 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c01bed-7089-4fbb-8745-786765ae7c32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dc9c03-8d36-4da2-9d0b-57e82731dbe6 service manila] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f110cf6300f049c897d0aab63218d1e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dc9c03-8d36-4da2-9d0b-57e82731dbe6 service manila] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dc9c03-8d36-4da2-9d0b-57e82731dbe6 service manila] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dc9c03-8d36-4da2-9d0b-57e82731dbe6 service manila] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-e8c01bed-7089-4fbb-8745-786765ae7c32 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-e8c01bed-7089-4fbb-8745-786765ae7c32 None None] MFA Rules not processed for user `f71c80a1588c4c8baa7eebdac29cda10`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-e8c01bed-7089-4fbb-8745-786765ae7c32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dc9c03-8d36-4da2-9d0b-57e82731dbe6 service manila] RBAC: Authorizing `identity:validate_token()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dc9c03-8d36-4da2-9d0b-57e82731dbe6 service manila] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 806/1629] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 12:56:50 2024] GET /identity/v3/auth/tokens => generated 4085 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 12:56:50 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-e5545ecf-b1d1-49ad-abae-07be3e54ca2f tempest-ExportLocationsNegativeTest-386865252 tempest-ExportLocationsNegativeTest-386865252-project-admin] POST http://10.27.203.238/share/v2/df93a973373644ccaf8ecf54774a4ced/types May 28 12:56:50 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-e5545ecf-b1d1-49ad-abae-07be3e54ca2f tempest-ExportLocationsNegativeTest-386865252 tempest-ExportLocationsNegativeTest-386865252-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share_type": {"name": "tempest-typeshare-type-1054903334", "extra_specs": {"driver_handles_share_servers": "False"}, "share_type_access:is_public": true}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 824/1630] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:56:50 2024] POST /identity/v3/auth/tokens => generated 4103 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dc9c03-8d36-4da2-9d0b-57e82731dbe6 service manila] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:50 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-e5545ecf-b1d1-49ad-abae-07be3e54ca2f tempest-ExportLocationsNegativeTest-386865252 tempest-ExportLocationsNegativeTest-386865252-project-admin] http://10.27.203.238/share/v2/df93a973373644ccaf8ecf54774a4ced/types returned with HTTP 200 May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dc9c03-8d36-4da2-9d0b-57e82731dbe6 service manila] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:50 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 139/269] 10.27.203.238 () {66 vars in 1359 bytes} [Tue May 28 12:56:50 2024] POST /share/v2/df93a973373644ccaf8ecf54774a4ced/types => generated 623 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:56:50 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-837a6446-9037-44ea-98a7-140165b7746b tempest-ExportLocationsNegativeTest-386865252 tempest-ExportLocationsNegativeTest-386865252-project-admin] POST http://10.27.203.238/share/v2/df93a973373644ccaf8ecf54774a4ced/shares May 28 12:56:50 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-837a6446-9037-44ea-98a7-140165b7746b tempest-ExportLocationsNegativeTest-386865252 tempest-ExportLocationsNegativeTest-386865252-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share": {"share_proto": "nfs", "description": "Tempest's share", "snapshot_id": null, "name": "tempest-tempest-created-share-1832939602", "size": 1, "metadata": {}, "is_public": false, "share_type": "bbf19685-42b8-43ec-aa54-786683e9d11d"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:56:50 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.v1.shares [None req-837a6446-9037-44ea-98a7-140165b7746b tempest-ExportLocationsNegativeTest-386865252 tempest-ExportLocationsNegativeTest-386865252-project-admin] Create NFS share of 1 GB May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e53a170-7dd4-47b1-8e73-670fe139e615 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e53a170-7dd4-47b1-8e73-670fe139e615 None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e53a170-7dd4-47b1-8e73-670fe139e615 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e53a170-7dd4-47b1-8e73-670fe139e615 None admin] PATH_INFO: `/v3/users/f71c80a1588c4c8baa7eebdac29cda10` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e53a170-7dd4-47b1-8e73-670fe139e615 None admin] RBAC: Authorizing `identity:delete_user(user_id=f71c80a1588c4c8baa7eebdac29cda10)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e53a170-7dd4-47b1-8e73-670fe139e615 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:50 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c000e723-8995-49ec-9273-4b86621726c5 tempest-AdminActionsTest-1749172189 None] <<< [DELETE] https://127.0.0.1:40443/api/viewpolicies/8/ May 28 12:56:50 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c000e723-8995-49ec-9273-4b86621726c5 tempest-AdminActionsTest-1749172189 None] --- [DELETE] https://127.0.0.1:40443/api/viewpolicies/8/: Done May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-8e53a170-7dd4-47b1-8e73-670fe139e615 None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f71c80a1588c4c8baa7eebdac29cda10', 'request_id': 'req-8e53a170-7dd4-47b1-8e73-670fe139e615'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-8e53a170-7dd4-47b1-8e73-670fe139e615 None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f71c80a1588c4c8baa7eebdac29cda10', 'request_id': 'req-8e53a170-7dd4-47b1-8e73-670fe139e615'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-8e53a170-7dd4-47b1-8e73-670fe139e615 None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f71c80a1588c4c8baa7eebdac29cda10', 'request_id': 'req-8e53a170-7dd4-47b1-8e73-670fe139e615'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-8e53a170-7dd4-47b1-8e73-670fe139e615 None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f71c80a1588c4c8baa7eebdac29cda10', 'request_id': 'req-8e53a170-7dd4-47b1-8e73-670fe139e615'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-8e53a170-7dd4-47b1-8e73-670fe139e615 None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f71c80a1588c4c8baa7eebdac29cda10', 'request_id': 'req-8e53a170-7dd4-47b1-8e73-670fe139e615'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:50 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.quota [None req-837a6446-9037-44ea-98a7-140165b7746b tempest-ExportLocationsNegativeTest-386865252 tempest-ExportLocationsNegativeTest-386865252-project-admin] Created reservations ['48bcabf3-0e85-4782-9c52-30cf349efabd', '6be5da09-8822-4988-b5f5-0e25d5be8ff7', '12e57af4-13d8-4d15-a7a0-34e23ec147db', '83a4e676-d09c-4bfc-94f5-6b95acd23fc0'] {{(pid=98330) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 807/1631] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 12:56:50 2024] DELETE /identity/v3/users/f71c80a1588c4c8baa7eebdac29cda10 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db90a4e-2359-4c4c-9e7f-44a1994a7bb8 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db90a4e-2359-4c4c-9e7f-44a1994a7bb8 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db90a4e-2359-4c4c-9e7f-44a1994a7bb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-6db90a4e-2359-4c4c-9e7f-44a1994a7bb8 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-6db90a4e-2359-4c4c-9e7f-44a1994a7bb8 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-6db90a4e-2359-4c4c-9e7f-44a1994a7bb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:51 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.quota [None req-837a6446-9037-44ea-98a7-140165b7746b tempest-ExportLocationsNegativeTest-386865252 tempest-ExportLocationsNegativeTest-386865252-project-admin] Committed reservations ['48bcabf3-0e85-4782-9c52-30cf349efabd', '6be5da09-8822-4988-b5f5-0e25d5be8ff7', '12e57af4-13d8-4d15-a7a0-34e23ec147db', '83a4e676-d09c-4bfc-94f5-6b95acd23fc0'] {{(pid=98330) commit /opt/stack/manila/manila/quota.py:1063}} May 28 12:56:51 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-c000e723-8995-49ec-9273-4b86621726c5 tempest-AdminActionsTest-1749172189 None] Created reservations ['6826bab6-774d-4d90-83c8-dc41df7ef5ef', '9817571d-dd4a-45ed-9f67-f68314fe3039', '8741d740-f584-4fc0-b7a4-1d3806bbb1a6', '42ad9dda-909a-49a7-8ed4-03d35005e44c'] {{(pid=98474) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 825/1632] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:56:50 2024] POST /identity/v3/auth/tokens => generated 2960 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 12:56:51 l75lg1-v1 neutron-server[77618]: DEBUG neutron.wsgi [-] (77618) accepted ('10.27.203.238', 40252) {{(pid=77618) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e53a170-7dd4-47b1-8e73-670fe139e615 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-8e53a170-7dd4-47b1-8e73-670fe139e615 None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:51 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-c000e723-8995-49ec-9273-4b86621726c5 tempest-AdminActionsTest-1749172189 None] Committed reservations ['6826bab6-774d-4d90-83c8-dc41df7ef5ef', '9817571d-dd4a-45ed-9f67-f68314fe3039', '8741d740-f584-4fc0-b7a4-1d3806bbb1a6', '42ad9dda-909a-49a7-8ed4-03d35005e44c'] {{(pid=98474) commit /opt/stack/manila/manila/quota.py:1063}} May 28 12:56:51 l75lg1-v1 manila-share[98474]: INFO manila.share.manager [None req-c000e723-8995-49ec-9273-4b86621726c5 tempest-AdminActionsTest-1749172189 None] Share instance 766fa507-2a4c-47eb-bfef-fa764b38b24c: deleted successfully. May 28 12:56:51 l75lg1-v1 nova-compute[83654]: DEBUG oslo_concurrency.lockutils [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=83654) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:56:51 l75lg1-v1 nova-compute[83654]: DEBUG oslo_concurrency.lockutils [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=83654) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:56:51 l75lg1-v1 nova-compute[83654]: DEBUG oslo_concurrency.lockutils [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=83654) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:56:51 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.resource_tracker [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Auditing locally available compute resources for l75lg1-v1 (node: l75lg1-v1) {{(pid=83654) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}} May 28 12:56:51 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-837a6446-9037-44ea-98a7-140165b7746b tempest-ExportLocationsNegativeTest-386865252 None] Starting with 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:80}} May 28 12:56:51 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-837a6446-9037-44ea-98a7-140165b7746b tempest-ExportLocationsNegativeTest-386865252 None] Filter OnlyHostFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:56:51 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-837a6446-9037-44ea-98a7-140165b7746b tempest-ExportLocationsNegativeTest-386865252 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:56:51 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.capacity [None req-837a6446-9037-44ea-98a7-140165b7746b tempest-ExportLocationsNegativeTest-386865252 None] Space information for share creation on host l75lg1-v1@vast#vast (requested / avail): 1/2076 {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/capacity.py:83}} May 28 12:56:51 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-837a6446-9037-44ea-98a7-140165b7746b tempest-ExportLocationsNegativeTest-386865252 None] Filter CapacityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:56:51 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-837a6446-9037-44ea-98a7-140165b7746b tempest-ExportLocationsNegativeTest-386865252 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:56:51 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-837a6446-9037-44ea-98a7-140165b7746b tempest-ExportLocationsNegativeTest-386865252 None] Driver Filter: Checking host 'l75lg1-v1@vast#vast' {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:37}} May 28 12:56:51 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-837a6446-9037-44ea-98a7-140165b7746b tempest-ExportLocationsNegativeTest-386865252 None] Filter function not set :: passing host. {{(pid=98327) _check_filter_function /opt/stack/manila/manila/scheduler/filters/driver.py:53}} May 28 12:56:51 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-837a6446-9037-44ea-98a7-140165b7746b tempest-ExportLocationsNegativeTest-386865252 None] Result: True {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:40}} May 28 12:56:51 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-837a6446-9037-44ea-98a7-140165b7746b tempest-ExportLocationsNegativeTest-386865252 None] Done checking host 'l75lg1-v1@vast#vast' {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:41}} May 28 12:56:51 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-837a6446-9037-44ea-98a7-140165b7746b tempest-ExportLocationsNegativeTest-386865252 None] Filter DriverFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:56:51 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-837a6446-9037-44ea-98a7-140165b7746b tempest-ExportLocationsNegativeTest-386865252 None] Filter ShareReplicationFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:56:51 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-837a6446-9037-44ea-98a7-140165b7746b tempest-ExportLocationsNegativeTest-386865252 None] Filter CreateFromSnapshotFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:56:51 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-837a6446-9037-44ea-98a7-140165b7746b tempest-ExportLocationsNegativeTest-386865252 None] Filter AffinityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:56:51 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-837a6446-9037-44ea-98a7-140165b7746b tempest-ExportLocationsNegativeTest-386865252 None] Filter AntiAffinityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:56:51 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.drivers.filter [None req-837a6446-9037-44ea-98a7-140165b7746b tempest-ExportLocationsNegativeTest-386865252 None] Filtered share [host: 'l75lg1-v1@vast#vast', free_capacity_gb: 2076.6229242384434, pools: None] {{(pid=98327) _schedule_share /opt/stack/manila/manila/scheduler/drivers/filter.py:268}} May 28 12:56:51 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-837a6446-9037-44ea-98a7-140165b7746b tempest-ExportLocationsNegativeTest-386865252 None] Checking host 'l75lg1-v1@vast#vast' {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:46}} May 28 12:56:51 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.weighers.goodness [None req-837a6446-9037-44ea-98a7-140165b7746b tempest-ExportLocationsNegativeTest-386865252 None] Goodness function not set :: defaulting to minimal goodness rating of 0. May 28 12:56:51 l75lg1-v1 manila-scheduler[98327]: INFO manila.scheduler.weighers.goodness [None req-837a6446-9037-44ea-98a7-140165b7746b tempest-ExportLocationsNegativeTest-386865252 None] Goodness function result for host l75lg1-v1@vast#vast: 0. May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e53a170-7dd4-47b1-8e73-670fe139e615 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:51 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-837a6446-9037-44ea-98a7-140165b7746b tempest-ExportLocationsNegativeTest-386865252 None] Goodness: 0 {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:48}} May 28 12:56:51 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-837a6446-9037-44ea-98a7-140165b7746b tempest-ExportLocationsNegativeTest-386865252 None] Done checking host 'l75lg1-v1@vast#vast' {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:49}} May 28 12:56:51 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.drivers.filter [None req-837a6446-9037-44ea-98a7-140165b7746b tempest-ExportLocationsNegativeTest-386865252 None] Choosing for share: WeighedHost [host: l75lg1-v1@vast#vast, weight: 0.0] {{(pid=98327) _schedule_share /opt/stack/manila/manila/scheduler/drivers/filter.py:274}} May 28 12:56:51 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-837a6446-9037-44ea-98a7-140165b7746b tempest-ExportLocationsNegativeTest-386865252 tempest-ExportLocationsNegativeTest-386865252-project-admin] http://10.27.203.238/share/v2/df93a973373644ccaf8ecf54774a4ced/shares returned with HTTP 200 May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01bdb26-e326-43a0-9926-40282394cd37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef17047035e4b518fd5360a01f2da1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01bdb26-e326-43a0-9926-40282394cd37 service neutron] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01bdb26-e326-43a0-9926-40282394cd37 service neutron] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01bdb26-e326-43a0-9926-40282394cd37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:51 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 131/270] 10.27.203.238 () {66 vars in 1362 bytes} [Tue May 28 12:56:50 2024] POST /share/v2/df93a973373644ccaf8ecf54774a4ced/shares => generated 1351 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:56:51 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-4300010d-4289-4160-8f61-2d3d1db31ada tempest-ExportLocationsNegativeTest-386865252 tempest-ExportLocationsNegativeTest-386865252-project-admin] GET http://10.27.203.238/share/v2/df93a973373644ccaf8ecf54774a4ced/shares/543531db-0529-42ad-9ae8-5e3dff98a2a5 May 28 12:56:51 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-4300010d-4289-4160-8f61-2d3d1db31ada tempest-ExportLocationsNegativeTest-386865252 tempest-ExportLocationsNegativeTest-386865252-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:51 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-4300010d-4289-4160-8f61-2d3d1db31ada tempest-ExportLocationsNegativeTest-386865252 tempest-ExportLocationsNegativeTest-386865252-project-admin] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01bdb26-e326-43a0-9926-40282394cd37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01bdb26-e326-43a0-9926-40282394cd37 service neutron] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 808/1633] 10.27.203.238 () {64 vars in 1432 bytes} [Tue May 28 12:56:51 2024] GET /identity/v3/auth/tokens => generated 2960 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 28 12:56:51 l75lg1-v1 neutron-server[77618]: INFO neutron.wsgi [None req-ec2ce394-ebf9-4d7b-8377-80721c32486d None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=8e7ce02170aa410eab05376bcf2808e0&name=default HTTP/1.1" status: 200 len: 216 time: 0.0806184 May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db90a4e-2359-4c4c-9e7f-44a1994a7bb8 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-6db90a4e-2359-4c4c-9e7f-44a1994a7bb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:51 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-4300010d-4289-4160-8f61-2d3d1db31ada tempest-ExportLocationsNegativeTest-386865252 tempest-ExportLocationsNegativeTest-386865252-project-admin] http://10.27.203.238/share/v2/df93a973373644ccaf8ecf54774a4ced/shares/543531db-0529-42ad-9ae8-5e3dff98a2a5 returned with HTTP 200 May 28 12:56:51 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 140/271] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:56:51 2024] GET /share/v2/df93a973373644ccaf8ecf54774a4ced/shares/543531db-0529-42ad-9ae8-5e3dff98a2a5 => generated 1351 bytes in 25 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db90a4e-2359-4c4c-9e7f-44a1994a7bb8 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f8c61d-a83d-4df6-8cd3-c21e2a9b3fa2 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f8c61d-a83d-4df6-8cd3-c21e2a9b3fa2 None admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f8c61d-a83d-4df6-8cd3-c21e2a9b3fa2 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f8c61d-a83d-4df6-8cd3-c21e2a9b3fa2 None admin] PATH_INFO: `/v3/projects/8e7ce02170aa410eab05376bcf2808e0` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f8c61d-a83d-4df6-8cd3-c21e2a9b3fa2 None admin] RBAC: Authorizing `identity:delete_project(project_id=8e7ce02170aa410eab05376bcf2808e0)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f8c61d-a83d-4df6-8cd3-c21e2a9b3fa2 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:51 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.resource_tracker [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Hypervisor/Node resource view: name=l75lg1-v1 free_ram=9964MB free_disk=15.6312255859375GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_01_1", "address": "0000:00:01.1", "product_id": "7010", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7010", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7000", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7000", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "0100", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_0100", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_09_0", "address": "0000:00:09.0", "product_id": "1001", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1001", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "293a", "vendor_id": "8086", "numa_node": null, "label": "label_8086_293a", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_2", "address": "0000:00:07.2", "product_id": "2936", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2936", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "1237", "vendor_id": "8086", "numa_node": null, "label": "label_8086_1237", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "2935", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2935", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "2934", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2934", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_05_0", "address": "0000:00:05.0", "product_id": "1000", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1000", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "1000", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1000", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_06_0", "address": "0000:00:06.0", "product_id": "2668", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2668", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "1000", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1000", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0a_0", "address": "0000:00:0a.0", "product_id": "1002", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1002", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_3", "address": "0000:00:01.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_08_0", "address": "0000:00:08.0", "product_id": "1003", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1003", "dev_type": "type-PCI"}] {{(pid=83654) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}} May 28 12:56:51 l75lg1-v1 nova-compute[83654]: DEBUG oslo_concurrency.lockutils [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=83654) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:56:51 l75lg1-v1 nova-compute[83654]: DEBUG oslo_concurrency.lockutils [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=83654) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:56:51 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Expecting reply to msg 6dc1968b9c8344ac87988307249a94e1 in queue reply_37f4cbd1dd094961a22b8a65f222c327 May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-f1f8c61d-a83d-4df6-8cd3-c21e2a9b3fa2 None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e7ce02170aa410eab05376bcf2808e0', 'request_id': 'req-f1f8c61d-a83d-4df6-8cd3-c21e2a9b3fa2'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-f1f8c61d-a83d-4df6-8cd3-c21e2a9b3fa2 None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e7ce02170aa410eab05376bcf2808e0', 'request_id': 'req-f1f8c61d-a83d-4df6-8cd3-c21e2a9b3fa2'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:51 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [-] Received RPC response for msg 6dc1968b9c8344ac87988307249a94e1 May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-f1f8c61d-a83d-4df6-8cd3-c21e2a9b3fa2 None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e7ce02170aa410eab05376bcf2808e0', 'request_id': 'req-f1f8c61d-a83d-4df6-8cd3-c21e2a9b3fa2'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-f1f8c61d-a83d-4df6-8cd3-c21e2a9b3fa2 None admin] The token cache is being invalidate because project 8e7ce02170aa410eab05376bcf2808e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-f1f8c61d-a83d-4df6-8cd3-c21e2a9b3fa2 None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-f1f8c61d-a83d-4df6-8cd3-c21e2a9b3fa2 None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 826/1634] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 12:56:51 2024] DELETE /identity/v3/projects/8e7ce02170aa410eab05376bcf2808e0 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e9ebab-c51a-4413-8066-c47a82c7aaec None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e9ebab-c51a-4413-8066-c47a82c7aaec None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e9ebab-c51a-4413-8066-c47a82c7aaec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:51 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-837a6446-9037-44ea-98a7-140165b7746b tempest-ExportLocationsNegativeTest-386865252 None] >>> [GET] https://127.0.0.1:40443/api/vippools/ May 28 12:56:51 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-837a6446-9037-44ea-98a7-140165b7746b tempest-ExportLocationsNegativeTest-386865252 None] {'allow_redirects': True, 'params': {'name': 'vippool-1'}} May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-50e9ebab-c51a-4413-8066-c47a82c7aaec None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-50e9ebab-c51a-4413-8066-c47a82c7aaec None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-50e9ebab-c51a-4413-8066-c47a82c7aaec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 809/1635] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:56:51 2024] POST /identity/v3/auth/tokens => generated 312 bytes in 20 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 28 12:56:51 l75lg1-v1 dstat.sh[49771]: 28-05 12:56:51| 21 3 72 3 0|5662M 1844M 277M 7843M| 12k 1789B| 0 3143k| 0 443 | 13k 24k|1.68 1.00 0.99|3.0 1.0 0| 0 0 | 0 2048M| 29 348 0 58 0 May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb2e5ed-9082-4093-872d-d044dac989d3 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb2e5ed-9082-4093-872d-d044dac989d3 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb2e5ed-9082-4093-872d-d044dac989d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-cfb2e5ed-9082-4093-872d-d044dac989d3 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-cfb2e5ed-9082-4093-872d-d044dac989d3 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-cfb2e5ed-9082-4093-872d-d044dac989d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 827/1636] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:56:51 2024] POST /identity/v3/auth/tokens => generated 2960 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e9ebab-c51a-4413-8066-c47a82c7aaec None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e9ebab-c51a-4413-8066-c47a82c7aaec None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b012da-6f55-4653-a719-2da9b66a3c04 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b012da-6f55-4653-a719-2da9b66a3c04 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b012da-6f55-4653-a719-2da9b66a3c04 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b012da-6f55-4653-a719-2da9b66a3c04 None admin] PATH_INFO: `/v3/domains` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b012da-6f55-4653-a719-2da9b66a3c04 None admin] RBAC: Adding query filter params (name=Default) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b012da-6f55-4653-a719-2da9b66a3c04 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b012da-6f55-4653-a719-2da9b66a3c04 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 810/1637] 10.27.203.238 () {62 vars in 1220 bytes} [Tue May 28 12:56:51 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb2e5ed-9082-4093-872d-d044dac989d3 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb2e5ed-9082-4093-872d-d044dac989d3 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72259abf-d208-4afd-8c62-ea1bfdd01ba5 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72259abf-d208-4afd-8c62-ea1bfdd01ba5 None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72259abf-d208-4afd-8c62-ea1bfdd01ba5 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72259abf-d208-4afd-8c62-ea1bfdd01ba5 None admin] PATH_INFO: `/v3/projects` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72259abf-d208-4afd-8c62-ea1bfdd01ba5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72259abf-d208-4afd-8c62-ea1bfdd01ba5 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 828/1638] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 12:56:51 2024] POST /identity/v3/projects => generated 427 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b012da-6f55-4653-a719-2da9b66a3c04 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b012da-6f55-4653-a719-2da9b66a3c04 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0934ab6-9f3e-45bb-9fc1-caa7582a91e5 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0934ab6-9f3e-45bb-9fc1-caa7582a91e5 None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0934ab6-9f3e-45bb-9fc1-caa7582a91e5 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0934ab6-9f3e-45bb-9fc1-caa7582a91e5 None admin] PATH_INFO: `/v3/users` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0934ab6-9f3e-45bb-9fc1-caa7582a91e5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0934ab6-9f3e-45bb-9fc1-caa7582a91e5 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-a0934ab6-9f3e-45bb-9fc1-caa7582a91e5 None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 811/1639] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 12:56:51 2024] POST /identity/v3/users => generated 321 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72259abf-d208-4afd-8c62-ea1bfdd01ba5 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72259abf-d208-4afd-8c62-ea1bfdd01ba5 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce16e74-fea8-4b77-88d4-e1dd5d853ae5 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce16e74-fea8-4b77-88d4-e1dd5d853ae5 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce16e74-fea8-4b77-88d4-e1dd5d853ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce16e74-fea8-4b77-88d4-e1dd5d853ae5 None admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce16e74-fea8-4b77-88d4-e1dd5d853ae5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce16e74-fea8-4b77-88d4-e1dd5d853ae5 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 829/1640] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 12:56:51 2024] GET /identity/v3/roles => generated 1680 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0934ab6-9f3e-45bb-9fc1-caa7582a91e5 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0934ab6-9f3e-45bb-9fc1-caa7582a91e5 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69812945-3a3f-4465-9f58-5d927d254fd5 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69812945-3a3f-4465-9f58-5d927d254fd5 None admin] REQUEST_METHOD: `PUT` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69812945-3a3f-4465-9f58-5d927d254fd5 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69812945-3a3f-4465-9f58-5d927d254fd5 None admin] PATH_INFO: `/v3/projects/48fb7896dc8e4452ad5fe751c3d0e8fc/users/3241bc88ad064d2c90c8f789ed7143aa/roles/e7989893488f483baa107be56668c4f8` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69812945-3a3f-4465-9f58-5d927d254fd5 None admin] RBAC: Authorizing `identity:create_grant(project_id=48fb7896dc8e4452ad5fe751c3d0e8fc, user_id=3241bc88ad064d2c90c8f789ed7143aa, role_id=e7989893488f483baa107be56668c4f8)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69812945-3a3f-4465-9f58-5d927d254fd5 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 812/1641] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 12:56:51 2024] PUT /identity/v3/projects/48fb7896dc8e4452ad5fe751c3d0e8fc/users/3241bc88ad064d2c90c8f789ed7143aa/roles/e7989893488f483baa107be56668c4f8 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce16e74-fea8-4b77-88d4-e1dd5d853ae5 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce16e74-fea8-4b77-88d4-e1dd5d853ae5 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcb3338-5d4d-4825-954f-29179cb669e7 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcb3338-5d4d-4825-954f-29179cb669e7 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcb3338-5d4d-4825-954f-29179cb669e7 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcb3338-5d4d-4825-954f-29179cb669e7 None admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcb3338-5d4d-4825-954f-29179cb669e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcb3338-5d4d-4825-954f-29179cb669e7 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 830/1642] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 12:56:51 2024] GET /identity/v3/roles => generated 1680 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69812945-3a3f-4465-9f58-5d927d254fd5 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69812945-3a3f-4465-9f58-5d927d254fd5 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4a9c8a-c2c3-483e-b601-ba29704c497c None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4a9c8a-c2c3-483e-b601-ba29704c497c None admin] REQUEST_METHOD: `PUT` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4a9c8a-c2c3-483e-b601-ba29704c497c None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4a9c8a-c2c3-483e-b601-ba29704c497c None admin] PATH_INFO: `/v3/projects/48fb7896dc8e4452ad5fe751c3d0e8fc/users/3241bc88ad064d2c90c8f789ed7143aa/roles/e7989893488f483baa107be56668c4f8` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4a9c8a-c2c3-483e-b601-ba29704c497c None admin] RBAC: Authorizing `identity:create_grant(project_id=48fb7896dc8e4452ad5fe751c3d0e8fc, user_id=3241bc88ad064d2c90c8f789ed7143aa, role_id=e7989893488f483baa107be56668c4f8)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4a9c8a-c2c3-483e-b601-ba29704c497c None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 813/1643] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 12:56:51 2024] PUT /identity/v3/projects/48fb7896dc8e4452ad5fe751c3d0e8fc/users/3241bc88ad064d2c90c8f789ed7143aa/roles/e7989893488f483baa107be56668c4f8 => generated 0 bytes in 19 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654e9314-e052-4eeb-ada4-f2c8b8d0450f None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654e9314-e052-4eeb-ada4-f2c8b8d0450f None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654e9314-e052-4eeb-ada4-f2c8b8d0450f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-654e9314-e052-4eeb-ada4-f2c8b8d0450f None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-654e9314-e052-4eeb-ada4-f2c8b8d0450f None None] MFA Rules not processed for user `3241bc88ad064d2c90c8f789ed7143aa`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-654e9314-e052-4eeb-ada4-f2c8b8d0450f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 831/1644] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:56:51 2024] POST /identity/v3/auth/tokens => generated 4121 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4a9c8a-c2c3-483e-b601-ba29704c497c None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4a9c8a-c2c3-483e-b601-ba29704c497c None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e345c4e-6f49-4bee-b11d-09e3b04b42a3 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e345c4e-6f49-4bee-b11d-09e3b04b42a3 None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e345c4e-6f49-4bee-b11d-09e3b04b42a3 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e345c4e-6f49-4bee-b11d-09e3b04b42a3 None admin] PATH_INFO: `/v3/users/3241bc88ad064d2c90c8f789ed7143aa` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e345c4e-6f49-4bee-b11d-09e3b04b42a3 None admin] RBAC: Authorizing `identity:delete_user(user_id=3241bc88ad064d2c90c8f789ed7143aa)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e345c4e-6f49-4bee-b11d-09e3b04b42a3 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:51 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Expecting reply to msg 9c3b40029fac45adbab5ea94e81dc5d6 in queue reply_37f4cbd1dd094961a22b8a65f222c327 May 28 12:56:51 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [-] Received RPC response for msg 9c3b40029fac45adbab5ea94e81dc5d6 May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-8e345c4e-6f49-4bee-b11d-09e3b04b42a3 None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3241bc88ad064d2c90c8f789ed7143aa', 'request_id': 'req-8e345c4e-6f49-4bee-b11d-09e3b04b42a3'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-8e345c4e-6f49-4bee-b11d-09e3b04b42a3 None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3241bc88ad064d2c90c8f789ed7143aa', 'request_id': 'req-8e345c4e-6f49-4bee-b11d-09e3b04b42a3'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-8e345c4e-6f49-4bee-b11d-09e3b04b42a3 None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3241bc88ad064d2c90c8f789ed7143aa', 'request_id': 'req-8e345c4e-6f49-4bee-b11d-09e3b04b42a3'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-8e345c4e-6f49-4bee-b11d-09e3b04b42a3 None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3241bc88ad064d2c90c8f789ed7143aa', 'request_id': 'req-8e345c4e-6f49-4bee-b11d-09e3b04b42a3'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-8e345c4e-6f49-4bee-b11d-09e3b04b42a3 None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3241bc88ad064d2c90c8f789ed7143aa', 'request_id': 'req-8e345c4e-6f49-4bee-b11d-09e3b04b42a3'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:51 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-837a6446-9037-44ea-98a7-140165b7746b tempest-ExportLocationsNegativeTest-386865252 None] <<< [GET] https://127.0.0.1:40443/api/vippools/ May 28 12:56:51 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-837a6446-9037-44ea-98a7-140165b7746b tempest-ExportLocationsNegativeTest-386865252 None] [Bunch(active_cnode_ids=[], active_interfaces=4, cluster='loop75-kfs', cluster_id=1, cnode_ids=[], cnodes=[], domain_name='vippool-1', enable_l3=False, enable_weighted_balancing=False, enabled=True, end_ip='172.21.75.4', guid='f2abaede-b397-413a-8faa-3aeead6d3b28', gw_ip='', gw_ipv6='', id=2, ip_ranges=[['172.21.75.1', '172.21.75.4']], name='vippool-1', peer_asn=0, port_membership='ALL', ranges_summary='172.21.75.[1-4]', role='PROTOCOLS', start_ip='172.21.75.1', subnet_cidr=16, subnet_cidr_ipv6=None, sync='SYNCED', sync_time='2024-05-28T12:50:09.644123Z', tenant_id=1, tenant_name='default', title='172.21.75.1 - 172.21.75.4', url='https://127.0.0.1:40443/api/vippools/2/', vast_asn=0, vlan=0, vms_preferred=False)] May 28 12:56:51 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-837a6446-9037-44ea-98a7-140165b7746b tempest-ExportLocationsNegativeTest-386865252 None] --- [GET] https://127.0.0.1:40443/api/vippools/: Done May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 814/1645] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 12:56:51 2024] DELETE /identity/v3/users/3241bc88ad064d2c90c8f789ed7143aa => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:56:51 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-837a6446-9037-44ea-98a7-140165b7746b tempest-ExportLocationsNegativeTest-386865252 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:56:51 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-837a6446-9037-44ea-98a7-140165b7746b tempest-ExportLocationsNegativeTest-386865252 None] {'allow_redirects': True, May 28 12:56:51 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-837a6446-9037-44ea-98a7-140165b7746b tempest-ExportLocationsNegativeTest-386865252 None] 'params': {'name': 'd44fc8f1-83fc-47c3-994f-497e85a3194a'}} May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ecd348-3e38-4d47-94d4-d3a35a9a142e None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ecd348-3e38-4d47-94d4-d3a35a9a142e None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ecd348-3e38-4d47-94d4-d3a35a9a142e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-a0ecd348-3e38-4d47-94d4-d3a35a9a142e None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-a0ecd348-3e38-4d47-94d4-d3a35a9a142e None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-a0ecd348-3e38-4d47-94d4-d3a35a9a142e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 832/1646] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:56:51 2024] POST /identity/v3/auth/tokens => generated 2960 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 12:56:51 l75lg1-v1 neutron-server[77618]: DEBUG neutron.wsgi [-] (77618) accepted ('10.27.203.238', 40256) {{(pid=77618) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e345c4e-6f49-4bee-b11d-09e3b04b42a3 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-8e345c4e-6f49-4bee-b11d-09e3b04b42a3 None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e345c4e-6f49-4bee-b11d-09e3b04b42a3 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66779fd4-82df-4e99-813b-9e322e12cee2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef17047035e4b518fd5360a01f2da1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66779fd4-82df-4e99-813b-9e322e12cee2 service neutron] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66779fd4-82df-4e99-813b-9e322e12cee2 service neutron] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66779fd4-82df-4e99-813b-9e322e12cee2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66779fd4-82df-4e99-813b-9e322e12cee2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66779fd4-82df-4e99-813b-9e322e12cee2 service neutron] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:51 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-6654c89f-f7df-4a48-be1e-8ae131ddf1e7 tempest-ShareInstancesTest-1546991288 tempest-ShareInstancesTest-1546991288-project-admin] GET http://10.27.203.238/share/v2/fb2c57cefad04e97a990bd936225014d/shares/2dfffda2-1f3a-4d2e-9044-2255a211a9f0 May 28 12:56:51 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-6654c89f-f7df-4a48-be1e-8ae131ddf1e7 tempest-ShareInstancesTest-1546991288 tempest-ShareInstancesTest-1546991288-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:51 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-6654c89f-f7df-4a48-be1e-8ae131ddf1e7 tempest-ShareInstancesTest-1546991288 tempest-ShareInstancesTest-1546991288-project-admin] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 815/1647] 10.27.203.238 () {64 vars in 1432 bytes} [Tue May 28 12:56:51 2024] GET /identity/v3/auth/tokens => generated 2960 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 28 12:56:51 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-6654c89f-f7df-4a48-be1e-8ae131ddf1e7 tempest-ShareInstancesTest-1546991288 tempest-ShareInstancesTest-1546991288-project-admin] HTTP exception thrown: The resource could not be found. May 28 12:56:51 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-6654c89f-f7df-4a48-be1e-8ae131ddf1e7 tempest-ShareInstancesTest-1546991288 tempest-ShareInstancesTest-1546991288-project-admin] http://10.27.203.238/share/v2/fb2c57cefad04e97a990bd936225014d/shares/2dfffda2-1f3a-4d2e-9044-2255a211a9f0 returned with HTTP 404 May 28 12:56:51 l75lg1-v1 neutron-server[77618]: INFO neutron.wsgi [None req-cd1fb28d-ddb3-43a3-b357-3e34e9fa2f84 None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=48fb7896dc8e4452ad5fe751c3d0e8fc&name=default HTTP/1.1" status: 200 len: 216 time: 0.0697830 May 28 12:56:51 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 132/272] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:56:51 2024] GET /share/v2/fb2c57cefad04e97a990bd936225014d/shares/2dfffda2-1f3a-4d2e-9044-2255a211a9f0 => generated 78 bytes in 16 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ecd348-3e38-4d47-94d4-d3a35a9a142e None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-a0ecd348-3e38-4d47-94d4-d3a35a9a142e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:51 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-7d0a8f75-e58c-45d2-bd2e-81bc503c46b0 tempest-ShareInstancesTest-1546991288 tempest-ShareInstancesTest-1546991288-project-admin] DELETE http://10.27.203.238/share/v2/fb2c57cefad04e97a990bd936225014d/types/95f6e9a5-0efd-43ed-82de-580b838468cd May 28 12:56:51 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-7d0a8f75-e58c-45d2-bd2e-81bc503c46b0 tempest-ShareInstancesTest-1546991288 tempest-ShareInstancesTest-1546991288-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:51 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-7d0a8f75-e58c-45d2-bd2e-81bc503c46b0 tempest-ShareInstancesTest-1546991288 tempest-ShareInstancesTest-1546991288-project-admin] Calling method 'ShareTypesController._delete' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ecd348-3e38-4d47-94d4-d3a35a9a142e None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9a3b08-6602-4e69-9a24-30b54ae1d92b None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9a3b08-6602-4e69-9a24-30b54ae1d92b None admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9a3b08-6602-4e69-9a24-30b54ae1d92b None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9a3b08-6602-4e69-9a24-30b54ae1d92b None admin] PATH_INFO: `/v3/projects/48fb7896dc8e4452ad5fe751c3d0e8fc` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9a3b08-6602-4e69-9a24-30b54ae1d92b None admin] RBAC: Authorizing `identity:delete_project(project_id=48fb7896dc8e4452ad5fe751c3d0e8fc)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9a3b08-6602-4e69-9a24-30b54ae1d92b None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:51 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-7d0a8f75-e58c-45d2-bd2e-81bc503c46b0 tempest-ShareInstancesTest-1546991288 tempest-ShareInstancesTest-1546991288-project-admin] http://10.27.203.238/share/v2/fb2c57cefad04e97a990bd936225014d/types/95f6e9a5-0efd-43ed-82de-580b838468cd returned with HTTP 202 May 28 12:56:51 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 141/273] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:56:51 2024] DELETE /share/v2/fb2c57cefad04e97a990bd936225014d/types/95f6e9a5-0efd-43ed-82de-580b838468cd => generated 0 bytes in 50 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-9a9a3b08-6602-4e69-9a24-30b54ae1d92b None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48fb7896dc8e4452ad5fe751c3d0e8fc', 'request_id': 'req-9a9a3b08-6602-4e69-9a24-30b54ae1d92b'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-9a9a3b08-6602-4e69-9a24-30b54ae1d92b None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48fb7896dc8e4452ad5fe751c3d0e8fc', 'request_id': 'req-9a9a3b08-6602-4e69-9a24-30b54ae1d92b'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:51 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-273564e2-ad07-420e-9ea4-2406b475c843 tempest-ShareInstancesTest-1546991288 tempest-ShareInstancesTest-1546991288-project-admin] GET http://10.27.203.238/share/v2/fb2c57cefad04e97a990bd936225014d/types/95f6e9a5-0efd-43ed-82de-580b838468cd May 28 12:56:51 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-273564e2-ad07-420e-9ea4-2406b475c843 tempest-ShareInstancesTest-1546991288 tempest-ShareInstancesTest-1546991288-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:51 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-273564e2-ad07-420e-9ea4-2406b475c843 tempest-ShareInstancesTest-1546991288 tempest-ShareInstancesTest-1546991288-project-admin] Calling method 'ShareTypesController.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-9a9a3b08-6602-4e69-9a24-30b54ae1d92b None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48fb7896dc8e4452ad5fe751c3d0e8fc', 'request_id': 'req-9a9a3b08-6602-4e69-9a24-30b54ae1d92b'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:51 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-273564e2-ad07-420e-9ea4-2406b475c843 tempest-ShareInstancesTest-1546991288 tempest-ShareInstancesTest-1546991288-project-admin] HTTP exception thrown: Share type not found. May 28 12:56:51 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-273564e2-ad07-420e-9ea4-2406b475c843 tempest-ShareInstancesTest-1546991288 tempest-ShareInstancesTest-1546991288-project-admin] http://10.27.203.238/share/v2/fb2c57cefad04e97a990bd936225014d/types/95f6e9a5-0efd-43ed-82de-580b838468cd returned with HTTP 404 May 28 12:56:51 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 133/274] 10.27.203.238 () {64 vars in 1448 bytes} [Tue May 28 12:56:51 2024] GET /share/v2/fb2c57cefad04e97a990bd936225014d/types/95f6e9a5-0efd-43ed-82de-580b838468cd => generated 67 bytes in 12 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66779fd4-82df-4e99-813b-9e322e12cee2 service neutron] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-66779fd4-82df-4e99-813b-9e322e12cee2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-9a9a3b08-6602-4e69-9a24-30b54ae1d92b None admin] The token cache is being invalidate because project 48fb7896dc8e4452ad5fe751c3d0e8fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66779fd4-82df-4e99-813b-9e322e12cee2 service neutron] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-9a9a3b08-6602-4e69-9a24-30b54ae1d92b None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-9a9a3b08-6602-4e69-9a24-30b54ae1d92b None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 833/1648] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 12:56:51 2024] DELETE /identity/v3/projects/48fb7896dc8e4452ad5fe751c3d0e8fc => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f9d745-09a9-4e89-a307-6bef4436f939 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f9d745-09a9-4e89-a307-6bef4436f939 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f9d745-09a9-4e89-a307-6bef4436f939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-46f9d745-09a9-4e89-a307-6bef4436f939 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-46f9d745-09a9-4e89-a307-6bef4436f939 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-46f9d745-09a9-4e89-a307-6bef4436f939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a829bb-c58a-47dd-bdd6-05c07ac2621c None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a829bb-c58a-47dd-bdd6-05c07ac2621c None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a829bb-c58a-47dd-bdd6-05c07ac2621c None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a829bb-c58a-47dd-bdd6-05c07ac2621c None admin] PATH_INFO: `/v3/users/cade0f2d0a774d6b8f7d1abf63c40a18` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 834/1649] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:56:51 2024] POST /identity/v3/auth/tokens => generated 312 bytes in 19 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a829bb-c58a-47dd-bdd6-05c07ac2621c None admin] RBAC: Authorizing `identity:delete_user(user_id=cade0f2d0a774d6b8f7d1abf63c40a18)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a829bb-c58a-47dd-bdd6-05c07ac2621c None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f40238-19dc-408c-831e-5f89af9a9699 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f40238-19dc-408c-831e-5f89af9a9699 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f40238-19dc-408c-831e-5f89af9a9699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-a0f40238-19dc-408c-831e-5f89af9a9699 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-a0f40238-19dc-408c-831e-5f89af9a9699 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:56:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-a0f40238-19dc-408c-831e-5f89af9a9699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 835/1650] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:56:51 2024] POST /identity/v3/auth/tokens => generated 2960 bytes in 24 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f40238-19dc-408c-831e-5f89af9a9699 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f40238-19dc-408c-831e-5f89af9a9699 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-45a829bb-c58a-47dd-bdd6-05c07ac2621c None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cade0f2d0a774d6b8f7d1abf63c40a18', 'request_id': 'req-45a829bb-c58a-47dd-bdd6-05c07ac2621c'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-45a829bb-c58a-47dd-bdd6-05c07ac2621c None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cade0f2d0a774d6b8f7d1abf63c40a18', 'request_id': 'req-45a829bb-c58a-47dd-bdd6-05c07ac2621c'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-45a829bb-c58a-47dd-bdd6-05c07ac2621c None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cade0f2d0a774d6b8f7d1abf63c40a18', 'request_id': 'req-45a829bb-c58a-47dd-bdd6-05c07ac2621c'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-45a829bb-c58a-47dd-bdd6-05c07ac2621c None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cade0f2d0a774d6b8f7d1abf63c40a18', 'request_id': 'req-45a829bb-c58a-47dd-bdd6-05c07ac2621c'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-45a829bb-c58a-47dd-bdd6-05c07ac2621c None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cade0f2d0a774d6b8f7d1abf63c40a18', 'request_id': 'req-45a829bb-c58a-47dd-bdd6-05c07ac2621c'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75007d98-554a-49c2-be45-caefb6d3bf08 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75007d98-554a-49c2-be45-caefb6d3bf08 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75007d98-554a-49c2-be45-caefb6d3bf08 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75007d98-554a-49c2-be45-caefb6d3bf08 None admin] PATH_INFO: `/v3/domains` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75007d98-554a-49c2-be45-caefb6d3bf08 None admin] RBAC: Adding query filter params (name=Default) {{(pid=51267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75007d98-554a-49c2-be45-caefb6d3bf08 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75007d98-554a-49c2-be45-caefb6d3bf08 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:52 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-837a6446-9037-44ea-98a7-140165b7746b tempest-ExportLocationsNegativeTest-386865252 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:56:52 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-837a6446-9037-44ea-98a7-140165b7746b tempest-ExportLocationsNegativeTest-386865252 None] [] May 28 12:56:52 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-837a6446-9037-44ea-98a7-140165b7746b tempest-ExportLocationsNegativeTest-386865252 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 12:56:52 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-837a6446-9037-44ea-98a7-140165b7746b tempest-ExportLocationsNegativeTest-386865252 None] >>> [POST] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:56:52 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-837a6446-9037-44ea-98a7-140165b7746b tempest-ExportLocationsNegativeTest-386865252 None] {'data': '{"name": "d44fc8f1-83fc-47c3-994f-497e85a3194a"}', May 28 12:56:52 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-837a6446-9037-44ea-98a7-140165b7746b tempest-ExportLocationsNegativeTest-386865252 None] 'json': None, May 28 12:56:52 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-837a6446-9037-44ea-98a7-140165b7746b tempest-ExportLocationsNegativeTest-386865252 None] 'params': None} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 836/1651] 10.27.203.238 () {62 vars in 1220 bytes} [Tue May 28 12:56:52 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75007d98-554a-49c2-be45-caefb6d3bf08 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-75007d98-554a-49c2-be45-caefb6d3bf08 None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 816/1652] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 12:56:51 2024] DELETE /identity/v3/users/cade0f2d0a774d6b8f7d1abf63c40a18 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75007d98-554a-49c2-be45-caefb6d3bf08 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be62c80-ef69-4849-bb07-d0258229168e None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be62c80-ef69-4849-bb07-d0258229168e None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be62c80-ef69-4849-bb07-d0258229168e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-3be62c80-ef69-4849-bb07-d0258229168e None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-3be62c80-ef69-4849-bb07-d0258229168e None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-3be62c80-ef69-4849-bb07-d0258229168e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc2d168-b990-4f3d-ad4d-52abb6c652f1 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc2d168-b990-4f3d-ad4d-52abb6c652f1 None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc2d168-b990-4f3d-ad4d-52abb6c652f1 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc2d168-b990-4f3d-ad4d-52abb6c652f1 None admin] PATH_INFO: `/v3/projects` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc2d168-b990-4f3d-ad4d-52abb6c652f1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc2d168-b990-4f3d-ad4d-52abb6c652f1 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 817/1653] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:56:52 2024] POST /identity/v3/auth/tokens => generated 2960 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 28 12:56:52 l75lg1-v1 neutron-server[77618]: DEBUG neutron.wsgi [-] (77618) accepted ('10.27.203.238', 40270) {{(pid=77618) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 837/1654] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 12:56:52 2024] POST /identity/v3/projects => generated 389 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be62c80-ef69-4849-bb07-d0258229168e None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-3be62c80-ef69-4849-bb07-d0258229168e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc2d168-b990-4f3d-ad4d-52abb6c652f1 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc2d168-b990-4f3d-ad4d-52abb6c652f1 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a22975d-f9d8-4ff4-8ac5-9c1423d8dacd None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a22975d-f9d8-4ff4-8ac5-9c1423d8dacd None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a22975d-f9d8-4ff4-8ac5-9c1423d8dacd None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a22975d-f9d8-4ff4-8ac5-9c1423d8dacd None admin] PATH_INFO: `/v3/users` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a22975d-f9d8-4ff4-8ac5-9c1423d8dacd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a22975d-f9d8-4ff4-8ac5-9c1423d8dacd None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-5a22975d-f9d8-4ff4-8ac5-9c1423d8dacd None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be62c80-ef69-4849-bb07-d0258229168e None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 838/1655] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 12:56:52 2024] POST /identity/v3/users => generated 302 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a22975d-f9d8-4ff4-8ac5-9c1423d8dacd None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a22975d-f9d8-4ff4-8ac5-9c1423d8dacd None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf61dba-5b32-45c8-8d4b-cc61795c808e None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf61dba-5b32-45c8-8d4b-cc61795c808e None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf61dba-5b32-45c8-8d4b-cc61795c808e None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf61dba-5b32-45c8-8d4b-cc61795c808e None admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf61dba-5b32-45c8-8d4b-cc61795c808e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf61dba-5b32-45c8-8d4b-cc61795c808e None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:52 l75lg1-v1 devstack@placement-api.service[78202]: DEBUG placement.requestlog [req-30d4ad3a-a54d-4e3d-ae1c-2311f008d698 req-3ef97a31-d320-40ad-a5ea-cc7c23456814 None None] Starting request: 10.27.203.238 "GET /placement/resource_providers/ef90d7d1-0808-4a15-ad77-f9a7391af2f4/allocations" {{(pid=78202) __call__ /opt/stack/placement/placement/requestlog.py:55}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 839/1656] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 12:56:52 2024] GET /identity/v3/roles => generated 1680 bytes in 18 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf61dba-5b32-45c8-8d4b-cc61795c808e None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc978824-2a2f-4dcc-a4f0-8fc1a8daa9c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef17047035e4b518fd5360a01f2da1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc978824-2a2f-4dcc-a4f0-8fc1a8daa9c9 service neutron] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc978824-2a2f-4dcc-a4f0-8fc1a8daa9c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc978824-2a2f-4dcc-a4f0-8fc1a8daa9c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:52 l75lg1-v1 devstack@placement-api.service[78202]: INFO placement.requestlog [req-30d4ad3a-a54d-4e3d-ae1c-2311f008d698 req-3ef97a31-d320-40ad-a5ea-cc7c23456814 service placement] 10.27.203.238 "GET /placement/resource_providers/ef90d7d1-0808-4a15-ad77-f9a7391af2f4/allocations" status: 200 len: 54 microversion: 1.0 May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf61dba-5b32-45c8-8d4b-cc61795c808e None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:52 l75lg1-v1 devstack@placement-api.service[78202]: [pid: 78202|app: 0|req: 22/43] 10.27.203.238 () {62 vars in 1480 bytes} [Tue May 28 12:56:52 2024] GET /placement/resource_providers/ef90d7d1-0808-4a15-ad77-f9a7391af2f4/allocations => generated 54 bytes in 11 msecs (HTTP/1.1 200) 6 headers in 223 bytes (1 switches on core 0) May 28 12:56:52 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.resource_tracker [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Total usable vcpus: 10, total allocated vcpus: 0 {{(pid=83654) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}} May 28 12:56:52 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.resource_tracker [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Final resource view: name=l75lg1-v1 phys_ram=16000MB used_ram=512MB phys_disk=28GB used_disk=0GB total_vcpus=10 used_vcpus=0 pci_stats=[] {{(pid=83654) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a3ea58-7af5-44ec-8c63-f63ba68d483a None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc978824-2a2f-4dcc-a4f0-8fc1a8daa9c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a3ea58-7af5-44ec-8c63-f63ba68d483a None admin] REQUEST_METHOD: `PUT` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a3ea58-7af5-44ec-8c63-f63ba68d483a None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a3ea58-7af5-44ec-8c63-f63ba68d483a None admin] PATH_INFO: `/v3/projects/bb8f0d37fc204d24b8146108f63a1922/users/2e437fa55aef49da85172b192169da34/roles/e7989893488f483baa107be56668c4f8` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc978824-2a2f-4dcc-a4f0-8fc1a8daa9c9 service neutron] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:52 l75lg1-v1 devstack@placement-api.service[78201]: DEBUG placement.requestlog [req-30d4ad3a-a54d-4e3d-ae1c-2311f008d698 req-097e3e46-1410-495c-8d45-601bf5e46689 None None] Starting request: 10.27.203.238 "GET /placement/resource_providers/ef90d7d1-0808-4a15-ad77-f9a7391af2f4/allocations" {{(pid=78201) __call__ /opt/stack/placement/placement/requestlog.py:55}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 818/1657] 10.27.203.238 () {64 vars in 1432 bytes} [Tue May 28 12:56:52 2024] GET /identity/v3/auth/tokens => generated 2960 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a3ea58-7af5-44ec-8c63-f63ba68d483a None admin] RBAC: Authorizing `identity:create_grant(project_id=bb8f0d37fc204d24b8146108f63a1922, user_id=2e437fa55aef49da85172b192169da34, role_id=e7989893488f483baa107be56668c4f8)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a3ea58-7af5-44ec-8c63-f63ba68d483a None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:52 l75lg1-v1 devstack@placement-api.service[78201]: INFO placement.requestlog [req-30d4ad3a-a54d-4e3d-ae1c-2311f008d698 req-097e3e46-1410-495c-8d45-601bf5e46689 service placement] 10.27.203.238 "GET /placement/resource_providers/ef90d7d1-0808-4a15-ad77-f9a7391af2f4/allocations" status: 200 len: 54 microversion: 1.0 May 28 12:56:52 l75lg1-v1 devstack@placement-api.service[78201]: [pid: 78201|app: 0|req: 22/44] 10.27.203.238 () {62 vars in 1480 bytes} [Tue May 28 12:56:52 2024] GET /placement/resource_providers/ef90d7d1-0808-4a15-ad77-f9a7391af2f4/allocations => generated 54 bytes in 12 msecs (HTTP/1.1 200) 6 headers in 223 bytes (1 switches on core 0) May 28 12:56:52 l75lg1-v1 neutron-server[77618]: INFO neutron.wsgi [None req-da616ac5-e728-4014-8ea3-1ea3e63eb506 None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=fb2c57cefad04e97a990bd936225014d&name=default HTTP/1.1" status: 200 len: 216 time: 0.1029041 May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc978824-2a2f-4dcc-a4f0-8fc1a8daa9c9 service neutron] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:52 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.provider_tree [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Inventory has not changed in ProviderTree for provider: ef90d7d1-0808-4a15-ad77-f9a7391af2f4 {{(pid=83654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-dc978824-2a2f-4dcc-a4f0-8fc1a8daa9c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:52 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Expecting reply to msg acc7df6036f34c1fb80833da6b59defe in queue reply_37f4cbd1dd094961a22b8a65f222c327 May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc978824-2a2f-4dcc-a4f0-8fc1a8daa9c9 service neutron] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:52 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [-] Received RPC response for msg acc7df6036f34c1fb80833da6b59defe May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 840/1658] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 12:56:52 2024] PUT /identity/v3/projects/bb8f0d37fc204d24b8146108f63a1922/users/2e437fa55aef49da85172b192169da34/roles/e7989893488f483baa107be56668c4f8 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a3ea58-7af5-44ec-8c63-f63ba68d483a None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:52 l75lg1-v1 dstat.sh[49771]: 28-05 12:56:52| 14 2 81 3 0|5662M 1843M 277M 7843M| 12k 3173B| 0 2188k| 0 294 |9461 17k|1.55 0.98 0.98|3.0 2.0 0| 0 0 | 0 2048M| 29 349 0 59 0 May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7898959-1764-42f2-85ae-03e24cef8624 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7898959-1764-42f2-85ae-03e24cef8624 None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7898959-1764-42f2-85ae-03e24cef8624 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7898959-1764-42f2-85ae-03e24cef8624 None admin] PATH_INFO: `/v3/projects/fb2c57cefad04e97a990bd936225014d` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7898959-1764-42f2-85ae-03e24cef8624 None admin] RBAC: Authorizing `identity:delete_project(project_id=fb2c57cefad04e97a990bd936225014d)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7898959-1764-42f2-85ae-03e24cef8624 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a3ea58-7af5-44ec-8c63-f63ba68d483a None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8609272c-56e7-46d8-9810-6c95afd6772f None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8609272c-56e7-46d8-9810-6c95afd6772f None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8609272c-56e7-46d8-9810-6c95afd6772f None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8609272c-56e7-46d8-9810-6c95afd6772f None admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8609272c-56e7-46d8-9810-6c95afd6772f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8609272c-56e7-46d8-9810-6c95afd6772f None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 841/1659] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 12:56:52 2024] GET /identity/v3/roles => generated 1680 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8609272c-56e7-46d8-9810-6c95afd6772f None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8609272c-56e7-46d8-9810-6c95afd6772f None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f2e50c-c451-43b8-9c35-5cea7c9af4b2 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f2e50c-c451-43b8-9c35-5cea7c9af4b2 None admin] REQUEST_METHOD: `PUT` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f2e50c-c451-43b8-9c35-5cea7c9af4b2 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f2e50c-c451-43b8-9c35-5cea7c9af4b2 None admin] PATH_INFO: `/v3/projects/bb8f0d37fc204d24b8146108f63a1922/users/2e437fa55aef49da85172b192169da34/roles/e7989893488f483baa107be56668c4f8` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f2e50c-c451-43b8-9c35-5cea7c9af4b2 None admin] RBAC: Authorizing `identity:create_grant(project_id=bb8f0d37fc204d24b8146108f63a1922, user_id=2e437fa55aef49da85172b192169da34, role_id=e7989893488f483baa107be56668c4f8)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f2e50c-c451-43b8-9c35-5cea7c9af4b2 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-b7898959-1764-42f2-85ae-03e24cef8624 None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb2c57cefad04e97a990bd936225014d', 'request_id': 'req-b7898959-1764-42f2-85ae-03e24cef8624'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-b7898959-1764-42f2-85ae-03e24cef8624 None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb2c57cefad04e97a990bd936225014d', 'request_id': 'req-b7898959-1764-42f2-85ae-03e24cef8624'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 842/1660] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 12:56:52 2024] PUT /identity/v3/projects/bb8f0d37fc204d24b8146108f63a1922/users/2e437fa55aef49da85172b192169da34/roles/e7989893488f483baa107be56668c4f8 => generated 0 bytes in 19 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6119ceb-4469-4522-af1b-f4bdda8dd76a None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6119ceb-4469-4522-af1b-f4bdda8dd76a None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6119ceb-4469-4522-af1b-f4bdda8dd76a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-b7898959-1764-42f2-85ae-03e24cef8624 None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb2c57cefad04e97a990bd936225014d', 'request_id': 'req-b7898959-1764-42f2-85ae-03e24cef8624'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-b6119ceb-4469-4522-af1b-f4bdda8dd76a None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-b7898959-1764-42f2-85ae-03e24cef8624 None admin] The token cache is being invalidate because project fb2c57cefad04e97a990bd936225014d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-b7898959-1764-42f2-85ae-03e24cef8624 None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-b7898959-1764-42f2-85ae-03e24cef8624 None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 819/1661] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 12:56:52 2024] DELETE /identity/v3/projects/fb2c57cefad04e97a990bd936225014d => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-b6119ceb-4469-4522-af1b-f4bdda8dd76a None None] MFA Rules not processed for user `2e437fa55aef49da85172b192169da34`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-b6119ceb-4469-4522-af1b-f4bdda8dd76a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d56042b-5b73-49c2-addb-8fa1f32d5aa9 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d56042b-5b73-49c2-addb-8fa1f32d5aa9 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d56042b-5b73-49c2-addb-8fa1f32d5aa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-5d56042b-5b73-49c2-addb-8fa1f32d5aa9 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-5d56042b-5b73-49c2-addb-8fa1f32d5aa9 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-5d56042b-5b73-49c2-addb-8fa1f32d5aa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 820/1662] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:56:52 2024] POST /identity/v3/auth/tokens => generated 312 bytes in 19 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 843/1663] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:56:52 2024] POST /identity/v3/auth/tokens => generated 4083 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d56042b-5b73-49c2-addb-8fa1f32d5aa9 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-5d56042b-5b73-49c2-addb-8fa1f32d5aa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432ae9c4-3c3d-4e45-a820-44767619b0f4 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432ae9c4-3c3d-4e45-a820-44767619b0f4 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432ae9c4-3c3d-4e45-a820-44767619b0f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-432ae9c4-3c3d-4e45-a820-44767619b0f4 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-432ae9c4-3c3d-4e45-a820-44767619b0f4 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-432ae9c4-3c3d-4e45-a820-44767619b0f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d56042b-5b73-49c2-addb-8fa1f32d5aa9 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04abaf0f-6dd7-44a4-960a-47252292fe84 service manila] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f110cf6300f049c897d0aab63218d1e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04abaf0f-6dd7-44a4-960a-47252292fe84 service manila] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04abaf0f-6dd7-44a4-960a-47252292fe84 service manila] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04abaf0f-6dd7-44a4-960a-47252292fe84 service manila] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04abaf0f-6dd7-44a4-960a-47252292fe84 service manila] RBAC: Authorizing `identity:validate_token()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04abaf0f-6dd7-44a4-960a-47252292fe84 service manila] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 821/1664] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 12:56:52 2024] GET /identity/v3/auth/tokens => generated 4083 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 844/1665] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:56:52 2024] POST /identity/v3/auth/tokens => generated 2960 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 12:56:52 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-ab7ebcc1-cbda-454f-b0f7-02f002b6f41f tempest-ShareInstancesNegativeTest-210953919 tempest-ShareInstancesNegativeTest-210953919-project-admin] POST http://10.27.203.238/share/v2/bb8f0d37fc204d24b8146108f63a1922/types May 28 12:56:52 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-ab7ebcc1-cbda-454f-b0f7-02f002b6f41f tempest-ShareInstancesNegativeTest-210953919 tempest-ShareInstancesNegativeTest-210953919-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share_type": {"name": "tempest-typeshare-type-78781371", "extra_specs": {"driver_handles_share_servers": "False"}, "share_type_access:is_public": true}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04abaf0f-6dd7-44a4-960a-47252292fe84 service manila] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04abaf0f-6dd7-44a4-960a-47252292fe84 service manila] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9049ffde-aa56-4340-b4c2-38fec20a847e None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9049ffde-aa56-4340-b4c2-38fec20a847e None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9049ffde-aa56-4340-b4c2-38fec20a847e None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9049ffde-aa56-4340-b4c2-38fec20a847e None admin] PATH_INFO: `/v3/domains` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9049ffde-aa56-4340-b4c2-38fec20a847e None admin] RBAC: Adding query filter params (name=Default) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9049ffde-aa56-4340-b4c2-38fec20a847e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9049ffde-aa56-4340-b4c2-38fec20a847e None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:52 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-ab7ebcc1-cbda-454f-b0f7-02f002b6f41f tempest-ShareInstancesNegativeTest-210953919 tempest-ShareInstancesNegativeTest-210953919-project-admin] http://10.27.203.238/share/v2/bb8f0d37fc204d24b8146108f63a1922/types returned with HTTP 200 May 28 12:56:52 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 142/275] 10.27.203.238 () {66 vars in 1359 bytes} [Tue May 28 12:56:52 2024] POST /share/v2/bb8f0d37fc204d24b8146108f63a1922/types => generated 619 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:56:52 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-68cfc213-3bbd-40e0-bab5-7c73e970f44c tempest-ShareInstancesNegativeTest-210953919 tempest-ShareInstancesNegativeTest-210953919-project-admin] POST http://10.27.203.238/share/v2/bb8f0d37fc204d24b8146108f63a1922/shares May 28 12:56:52 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-68cfc213-3bbd-40e0-bab5-7c73e970f44c tempest-ShareInstancesNegativeTest-210953919 tempest-ShareInstancesNegativeTest-210953919-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share": {"share_proto": "nfs", "description": "Tempest's share", "snapshot_id": null, "name": "tempest-tempest-created-share-1036538773", "size": 1, "metadata": {}, "is_public": false, "share_type": "cebb6aed-3720-45a4-84fe-d21cb838f20a"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 822/1666] 10.27.203.238 () {62 vars in 1220 bytes} [Tue May 28 12:56:52 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:56:52 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.v1.shares [None req-68cfc213-3bbd-40e0-bab5-7c73e970f44c tempest-ShareInstancesNegativeTest-210953919 tempest-ShareInstancesNegativeTest-210953919-project-admin] Create NFS share of 1 GB May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432ae9c4-3c3d-4e45-a820-44767619b0f4 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432ae9c4-3c3d-4e45-a820-44767619b0f4 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f47e2b2-a0b3-486f-933d-1f50b76bf7fb None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f47e2b2-a0b3-486f-933d-1f50b76bf7fb None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f47e2b2-a0b3-486f-933d-1f50b76bf7fb None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f47e2b2-a0b3-486f-933d-1f50b76bf7fb None admin] PATH_INFO: `/v3/projects` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f47e2b2-a0b3-486f-933d-1f50b76bf7fb None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f47e2b2-a0b3-486f-933d-1f50b76bf7fb None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 845/1667] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 12:56:52 2024] POST /identity/v3/projects => generated 375 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9049ffde-aa56-4340-b4c2-38fec20a847e None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9049ffde-aa56-4340-b4c2-38fec20a847e None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8027ae5d-2046-48bf-9793-352f9a548035 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:52 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.quota [None req-68cfc213-3bbd-40e0-bab5-7c73e970f44c tempest-ShareInstancesNegativeTest-210953919 tempest-ShareInstancesNegativeTest-210953919-project-admin] Created reservations ['ad7ab08f-250c-4e20-a011-c2e22122c446', '012786e7-d4eb-4e8f-ae56-48f36d4b3bf0', '9df2acef-e9a5-4522-9abd-28854cd4d2fe', 'b9a6c077-55f0-416d-8b81-30b63c13c5d5'] {{(pid=98330) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8027ae5d-2046-48bf-9793-352f9a548035 None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8027ae5d-2046-48bf-9793-352f9a548035 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8027ae5d-2046-48bf-9793-352f9a548035 None admin] PATH_INFO: `/v3/users` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8027ae5d-2046-48bf-9793-352f9a548035 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8027ae5d-2046-48bf-9793-352f9a548035 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-8027ae5d-2046-48bf-9793-352f9a548035 None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 823/1668] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 12:56:52 2024] POST /identity/v3/users => generated 295 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f47e2b2-a0b3-486f-933d-1f50b76bf7fb None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f47e2b2-a0b3-486f-933d-1f50b76bf7fb None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65190f8-bff3-4ed4-a244-9d9beff17778 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65190f8-bff3-4ed4-a244-9d9beff17778 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65190f8-bff3-4ed4-a244-9d9beff17778 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65190f8-bff3-4ed4-a244-9d9beff17778 None admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65190f8-bff3-4ed4-a244-9d9beff17778 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65190f8-bff3-4ed4-a244-9d9beff17778 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 846/1669] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 12:56:52 2024] GET /identity/v3/roles => generated 1680 bytes in 17 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8027ae5d-2046-48bf-9793-352f9a548035 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:52 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.quota [None req-68cfc213-3bbd-40e0-bab5-7c73e970f44c tempest-ShareInstancesNegativeTest-210953919 tempest-ShareInstancesNegativeTest-210953919-project-admin] Committed reservations ['ad7ab08f-250c-4e20-a011-c2e22122c446', '012786e7-d4eb-4e8f-ae56-48f36d4b3bf0', '9df2acef-e9a5-4522-9abd-28854cd4d2fe', 'b9a6c077-55f0-416d-8b81-30b63c13c5d5'] {{(pid=98330) commit /opt/stack/manila/manila/quota.py:1063}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8027ae5d-2046-48bf-9793-352f9a548035 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9767e2-2d36-437c-845a-a0b9a0ba5b09 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9767e2-2d36-437c-845a-a0b9a0ba5b09 None admin] REQUEST_METHOD: `PUT` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9767e2-2d36-437c-845a-a0b9a0ba5b09 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9767e2-2d36-437c-845a-a0b9a0ba5b09 None admin] PATH_INFO: `/v3/projects/35d84ed7cf164123a87b8b906a836985/users/2c2540fe25994249acab1b6e8656e2a1/roles/e7989893488f483baa107be56668c4f8` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9767e2-2d36-437c-845a-a0b9a0ba5b09 None admin] RBAC: Authorizing `identity:create_grant(project_id=35d84ed7cf164123a87b8b906a836985, user_id=2c2540fe25994249acab1b6e8656e2a1, role_id=e7989893488f483baa107be56668c4f8)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9767e2-2d36-437c-845a-a0b9a0ba5b09 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 824/1670] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 12:56:52 2024] PUT /identity/v3/projects/35d84ed7cf164123a87b8b906a836985/users/2c2540fe25994249acab1b6e8656e2a1/roles/e7989893488f483baa107be56668c4f8 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65190f8-bff3-4ed4-a244-9d9beff17778 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65190f8-bff3-4ed4-a244-9d9beff17778 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:52 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-68cfc213-3bbd-40e0-bab5-7c73e970f44c tempest-ShareInstancesNegativeTest-210953919 None] Starting with 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:80}} May 28 12:56:52 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-68cfc213-3bbd-40e0-bab5-7c73e970f44c tempest-ShareInstancesNegativeTest-210953919 None] Filter OnlyHostFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:56:52 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-68cfc213-3bbd-40e0-bab5-7c73e970f44c tempest-ShareInstancesNegativeTest-210953919 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:56:52 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.capacity [None req-68cfc213-3bbd-40e0-bab5-7c73e970f44c tempest-ShareInstancesNegativeTest-210953919 None] Space information for share creation on host l75lg1-v1@vast#vast (requested / avail): 1/2075 {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/capacity.py:83}} May 28 12:56:52 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-68cfc213-3bbd-40e0-bab5-7c73e970f44c tempest-ShareInstancesNegativeTest-210953919 None] Filter CapacityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:56:52 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-68cfc213-3bbd-40e0-bab5-7c73e970f44c tempest-ShareInstancesNegativeTest-210953919 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:56:52 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-68cfc213-3bbd-40e0-bab5-7c73e970f44c tempest-ShareInstancesNegativeTest-210953919 None] Driver Filter: Checking host 'l75lg1-v1@vast#vast' {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:37}} May 28 12:56:52 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-68cfc213-3bbd-40e0-bab5-7c73e970f44c tempest-ShareInstancesNegativeTest-210953919 None] Filter function not set :: passing host. {{(pid=98327) _check_filter_function /opt/stack/manila/manila/scheduler/filters/driver.py:53}} May 28 12:56:52 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-68cfc213-3bbd-40e0-bab5-7c73e970f44c tempest-ShareInstancesNegativeTest-210953919 None] Result: True {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:40}} May 28 12:56:52 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-68cfc213-3bbd-40e0-bab5-7c73e970f44c tempest-ShareInstancesNegativeTest-210953919 None] Done checking host 'l75lg1-v1@vast#vast' {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:41}} May 28 12:56:52 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-68cfc213-3bbd-40e0-bab5-7c73e970f44c tempest-ShareInstancesNegativeTest-210953919 None] Filter DriverFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:56:52 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-68cfc213-3bbd-40e0-bab5-7c73e970f44c tempest-ShareInstancesNegativeTest-210953919 None] Filter ShareReplicationFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:56:52 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-68cfc213-3bbd-40e0-bab5-7c73e970f44c tempest-ShareInstancesNegativeTest-210953919 None] Filter CreateFromSnapshotFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:56:52 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-68cfc213-3bbd-40e0-bab5-7c73e970f44c tempest-ShareInstancesNegativeTest-210953919 None] Filter AffinityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:56:52 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-68cfc213-3bbd-40e0-bab5-7c73e970f44c tempest-ShareInstancesNegativeTest-210953919 None] Filter AntiAffinityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:56:52 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.drivers.filter [None req-68cfc213-3bbd-40e0-bab5-7c73e970f44c tempest-ShareInstancesNegativeTest-210953919 None] Filtered share [host: 'l75lg1-v1@vast#vast', free_capacity_gb: 2075.6229242384434, pools: None] {{(pid=98327) _schedule_share /opt/stack/manila/manila/scheduler/drivers/filter.py:268}} May 28 12:56:52 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-68cfc213-3bbd-40e0-bab5-7c73e970f44c tempest-ShareInstancesNegativeTest-210953919 None] Checking host 'l75lg1-v1@vast#vast' {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:46}} May 28 12:56:52 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.weighers.goodness [None req-68cfc213-3bbd-40e0-bab5-7c73e970f44c tempest-ShareInstancesNegativeTest-210953919 None] Goodness function not set :: defaulting to minimal goodness rating of 0. May 28 12:56:52 l75lg1-v1 manila-scheduler[98327]: INFO manila.scheduler.weighers.goodness [None req-68cfc213-3bbd-40e0-bab5-7c73e970f44c tempest-ShareInstancesNegativeTest-210953919 None] Goodness function result for host l75lg1-v1@vast#vast: 0. May 28 12:56:52 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-68cfc213-3bbd-40e0-bab5-7c73e970f44c tempest-ShareInstancesNegativeTest-210953919 None] Goodness: 0 {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:48}} May 28 12:56:52 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-68cfc213-3bbd-40e0-bab5-7c73e970f44c tempest-ShareInstancesNegativeTest-210953919 None] Done checking host 'l75lg1-v1@vast#vast' {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:49}} May 28 12:56:52 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.drivers.filter [None req-68cfc213-3bbd-40e0-bab5-7c73e970f44c tempest-ShareInstancesNegativeTest-210953919 None] Choosing for share: WeighedHost [host: l75lg1-v1@vast#vast, weight: 0.0] {{(pid=98327) _schedule_share /opt/stack/manila/manila/scheduler/drivers/filter.py:274}} May 28 12:56:52 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-68cfc213-3bbd-40e0-bab5-7c73e970f44c tempest-ShareInstancesNegativeTest-210953919 tempest-ShareInstancesNegativeTest-210953919-project-admin] http://10.27.203.238/share/v2/bb8f0d37fc204d24b8146108f63a1922/shares returned with HTTP 200 May 28 12:56:52 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 134/276] 10.27.203.238 () {66 vars in 1362 bytes} [Tue May 28 12:56:52 2024] POST /share/v2/bb8f0d37fc204d24b8146108f63a1922/shares => generated 1347 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8830ac41-f5ce-419a-a112-d409ca452ffd None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8830ac41-f5ce-419a-a112-d409ca452ffd None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8830ac41-f5ce-419a-a112-d409ca452ffd None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8830ac41-f5ce-419a-a112-d409ca452ffd None admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8830ac41-f5ce-419a-a112-d409ca452ffd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8830ac41-f5ce-419a-a112-d409ca452ffd None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:52 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-8a0d3a27-8c48-4d53-b985-f2c753286d55 tempest-ShareInstancesNegativeTest-210953919 tempest-ShareInstancesNegativeTest-210953919-project-admin] GET http://10.27.203.238/share/v2/bb8f0d37fc204d24b8146108f63a1922/shares/6b055a82-f6ad-4af2-8b38-137b3cc99cc1 May 28 12:56:52 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-8a0d3a27-8c48-4d53-b985-f2c753286d55 tempest-ShareInstancesNegativeTest-210953919 tempest-ShareInstancesNegativeTest-210953919-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:52 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-8a0d3a27-8c48-4d53-b985-f2c753286d55 tempest-ShareInstancesNegativeTest-210953919 tempest-ShareInstancesNegativeTest-210953919-project-admin] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 847/1671] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 12:56:52 2024] GET /identity/v3/roles => generated 1680 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9767e2-2d36-437c-845a-a0b9a0ba5b09 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9767e2-2d36-437c-845a-a0b9a0ba5b09 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83191f02-f560-41e8-ab4d-7b75ddba1869 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83191f02-f560-41e8-ab4d-7b75ddba1869 None admin] REQUEST_METHOD: `PUT` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83191f02-f560-41e8-ab4d-7b75ddba1869 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83191f02-f560-41e8-ab4d-7b75ddba1869 None admin] PATH_INFO: `/v3/projects/35d84ed7cf164123a87b8b906a836985/users/2c2540fe25994249acab1b6e8656e2a1/roles/e7989893488f483baa107be56668c4f8` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83191f02-f560-41e8-ab4d-7b75ddba1869 None admin] RBAC: Authorizing `identity:create_grant(project_id=35d84ed7cf164123a87b8b906a836985, user_id=2c2540fe25994249acab1b6e8656e2a1, role_id=e7989893488f483baa107be56668c4f8)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83191f02-f560-41e8-ab4d-7b75ddba1869 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:52 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-8a0d3a27-8c48-4d53-b985-f2c753286d55 tempest-ShareInstancesNegativeTest-210953919 tempest-ShareInstancesNegativeTest-210953919-project-admin] http://10.27.203.238/share/v2/bb8f0d37fc204d24b8146108f63a1922/shares/6b055a82-f6ad-4af2-8b38-137b3cc99cc1 returned with HTTP 200 May 28 12:56:52 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 143/277] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:56:52 2024] GET /share/v2/bb8f0d37fc204d24b8146108f63a1922/shares/6b055a82-f6ad-4af2-8b38-137b3cc99cc1 => generated 1347 bytes in 27 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 825/1672] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 12:56:52 2024] PUT /identity/v3/projects/35d84ed7cf164123a87b8b906a836985/users/2c2540fe25994249acab1b6e8656e2a1/roles/e7989893488f483baa107be56668c4f8 => generated 0 bytes in 18 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201fd1f8-0a1d-41ce-948b-311b9964d811 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201fd1f8-0a1d-41ce-948b-311b9964d811 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201fd1f8-0a1d-41ce-948b-311b9964d811 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-201fd1f8-0a1d-41ce-948b-311b9964d811 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:56:52 l75lg1-v1 nova-compute[83654]: DEBUG nova.scheduler.client.report [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Inventory has not changed for provider ef90d7d1-0808-4a15-ad77-f9a7391af2f4 based on inventory data: {'VCPU': {'total': 10, 'reserved': 0, 'min_unit': 1, 'max_unit': 10, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16000, 'reserved': 512, 'min_unit': 1, 'max_unit': 16000, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 28, 'reserved': 0, 'min_unit': 1, 'max_unit': 28, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=83654) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}} May 28 12:56:52 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.resource_tracker [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Compute_service record updated for l75lg1-v1:l75lg1-v1 {{(pid=83654) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}} May 28 12:56:52 l75lg1-v1 nova-compute[83654]: DEBUG oslo_concurrency.lockutils [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.553s {{(pid=83654) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-201fd1f8-0a1d-41ce-948b-311b9964d811 None None] MFA Rules not processed for user `2c2540fe25994249acab1b6e8656e2a1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-201fd1f8-0a1d-41ce-948b-311b9964d811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:52 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-bba3f628-cca8-4a32-b2fe-f3ec09ec9be4 tempest-AccessRulesMetadataTest-1973590610 tempest-AccessRulesMetadataTest-1973590610-project-member] GET http://10.27.203.238/share/v2/1643901550e140118fc2d2e92b82cd0b/share-access-rules?share_id=b92fc06b-76d7-40f9-adef-74a07ace1027 May 28 12:56:52 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-bba3f628-cca8-4a32-b2fe-f3ec09ec9be4 tempest-AccessRulesMetadataTest-1973590610 tempest-AccessRulesMetadataTest-1973590610-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:52 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-bba3f628-cca8-4a32-b2fe-f3ec09ec9be4 tempest-AccessRulesMetadataTest-1973590610 tempest-AccessRulesMetadataTest-1973590610-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:52 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-68cfc213-3bbd-40e0-bab5-7c73e970f44c tempest-ShareInstancesNegativeTest-210953919 None] >>> [GET] https://127.0.0.1:40443/api/vippools/ May 28 12:56:52 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-68cfc213-3bbd-40e0-bab5-7c73e970f44c tempest-ShareInstancesNegativeTest-210953919 None] {'allow_redirects': True, 'params': {'name': 'vippool-1'}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 848/1673] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:56:52 2024] POST /identity/v3/auth/tokens => generated 4069 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:56:52 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-837a6446-9037-44ea-98a7-140165b7746b tempest-ExportLocationsNegativeTest-386865252 None] <<< [POST] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:56:52 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-837a6446-9037-44ea-98a7-140165b7746b tempest-ExportLocationsNegativeTest-386865252 None] Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=0, created='2024-05-28T12:56:52.385700Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='bb50b748-102f-4135-bd29-6fe71148e4e0', id=10, internal=False, is_s3_default_policy=False, name='d44fc8f1-83fc-47c3-994f-497e85a3194a', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=[], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['*'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['*'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T12:56:52.730972Z', tenant_id=1, tenant_name='default', title='d44fc8f1-83fc-47c3-994f-497e85a3194a', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/10/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[]) May 28 12:56:52 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-837a6446-9037-44ea-98a7-140165b7746b tempest-ExportLocationsNegativeTest-386865252 None] --- [POST] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 12:56:52 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-837a6446-9037-44ea-98a7-140165b7746b tempest-ExportLocationsNegativeTest-386865252 None] >>> [GET] https://127.0.0.1:40443/api/quotas/ May 28 12:56:52 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-837a6446-9037-44ea-98a7-140165b7746b tempest-ExportLocationsNegativeTest-386865252 None] {'allow_redirects': True, May 28 12:56:52 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-837a6446-9037-44ea-98a7-140165b7746b tempest-ExportLocationsNegativeTest-386865252 None] 'params': {'name': 'd44fc8f1-83fc-47c3-994f-497e85a3194a'}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83191f02-f560-41e8-ab4d-7b75ddba1869 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:52 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.lock.api [None req-bba3f628-cca8-4a32-b2fe-f3ec09ec9be4 tempest-AccessRulesMetadataTest-1973590610 tempest-AccessRulesMetadataTest-1973590610-project-member] Searching for locks by: {'resource_id': '065fb8ea-fc05-4af3-b191-603cca79c74e', 'resource_action': 'show', 'resource_type': 'access_rule'} {{(pid=98330) get_all /opt/stack/manila/manila/lock/api.py:112}} May 28 12:56:52 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.lock.api [None req-bba3f628-cca8-4a32-b2fe-f3ec09ec9be4 tempest-AccessRulesMetadataTest-1973590610 tempest-AccessRulesMetadataTest-1973590610-project-member] Searching for locks by: {'resource_id': '72727b23-42f9-424a-b54c-87e5069120d3', 'resource_action': 'show', 'resource_type': 'access_rule'} {{(pid=98330) get_all /opt/stack/manila/manila/lock/api.py:112}} May 28 12:56:52 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-bba3f628-cca8-4a32-b2fe-f3ec09ec9be4 tempest-AccessRulesMetadataTest-1973590610 tempest-AccessRulesMetadataTest-1973590610-project-member] http://10.27.203.238/share/v2/1643901550e140118fc2d2e92b82cd0b/share-access-rules?share_id=b92fc06b-76d7-40f9-adef-74a07ace1027 returned with HTTP 200 May 28 12:56:52 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 135/278] 10.27.203.238 () {64 vars in 1467 bytes} [Tue May 28 12:56:52 2024] GET /share/v2/1643901550e140118fc2d2e92b82cd0b/share-access-rules?share_id=b92fc06b-76d7-40f9-adef-74a07ace1027 => generated 659 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:56:52 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-6c4ca9cf-afdc-48cb-979f-683f4768e33f tempest-AccessRulesMetadataTest-1973590610 tempest-AccessRulesMetadataTest-1973590610-project-member] GET http://10.27.203.238/share/v2/1643901550e140118fc2d2e92b82cd0b/share-access-rules?share_id=b92fc06b-76d7-40f9-adef-74a07ace1027&metadata=%7B%27key3%27%3A+%27v3%27%2C+%27key4%27%3A+%27value4%27%7D May 28 12:56:52 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-6c4ca9cf-afdc-48cb-979f-683f4768e33f tempest-AccessRulesMetadataTest-1973590610 tempest-AccessRulesMetadataTest-1973590610-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:52 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-6c4ca9cf-afdc-48cb-979f-683f4768e33f tempest-AccessRulesMetadataTest-1973590610 tempest-AccessRulesMetadataTest-1973590610-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83191f02-f560-41e8-ab4d-7b75ddba1869 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77102f6e-393c-411f-ae49-719e9745b30e service manila] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f110cf6300f049c897d0aab63218d1e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77102f6e-393c-411f-ae49-719e9745b30e service manila] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77102f6e-393c-411f-ae49-719e9745b30e service manila] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77102f6e-393c-411f-ae49-719e9745b30e service manila] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77102f6e-393c-411f-ae49-719e9745b30e service manila] RBAC: Authorizing `identity:validate_token()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77102f6e-393c-411f-ae49-719e9745b30e service manila] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:52 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.lock.api [None req-6c4ca9cf-afdc-48cb-979f-683f4768e33f tempest-AccessRulesMetadataTest-1973590610 tempest-AccessRulesMetadataTest-1973590610-project-member] Searching for locks by: {'resource_id': '72727b23-42f9-424a-b54c-87e5069120d3', 'resource_action': 'show', 'resource_type': 'access_rule'} {{(pid=98330) get_all /opt/stack/manila/manila/lock/api.py:112}} May 28 12:56:52 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 826/1674] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 12:56:52 2024] GET /identity/v3/auth/tokens => generated 4069 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 12:56:52 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-6c4ca9cf-afdc-48cb-979f-683f4768e33f tempest-AccessRulesMetadataTest-1973590610 tempest-AccessRulesMetadataTest-1973590610-project-member] http://10.27.203.238/share/v2/1643901550e140118fc2d2e92b82cd0b/share-access-rules?share_id=b92fc06b-76d7-40f9-adef-74a07ace1027&metadata=%7B%27key3%27%3A+%27v3%27%2C+%27key4%27%3A+%27value4%27%7D returned with HTTP 200 May 28 12:56:52 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 136/279] 10.27.203.238 () {64 vars in 1603 bytes} [Tue May 28 12:56:52 2024] GET /share/v2/1643901550e140118fc2d2e92b82cd0b/share-access-rules?share_id=b92fc06b-76d7-40f9-adef-74a07ace1027&metadata=%7B%27key3%27%3A+%27v3%27%2C+%27key4%27%3A+%27value4%27%7D => generated 336 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:56:52 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-70c381e4-e727-4d25-a0ab-760a9f245b7b tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] POST http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types May 28 12:56:52 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-70c381e4-e727-4d25-a0ab-760a9f245b7b tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share_type": {"name": "tempest-share-type-350617760", "extra_specs": {"driver_handles_share_servers": "False", "storage_protocol": "NFS"}, "share_type_access:is_public": true}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:56:52 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-9f1a515c-dc72-4405-86c6-290b8e41a797 tempest-AccessRulesMetadataTest-1973590610 tempest-AccessRulesMetadataTest-1973590610-project-member] POST http://10.27.203.238/share/v2/1643901550e140118fc2d2e92b82cd0b/shares/b92fc06b-76d7-40f9-adef-74a07ace1027/action May 28 12:56:52 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-9f1a515c-dc72-4405-86c6-290b8e41a797 tempest-AccessRulesMetadataTest-1973590610 tempest-AccessRulesMetadataTest-1973590610-project-member] Action body: b'{"deny_access": {"access_id": "72727b23-42f9-424a-b54c-87e5069120d3"}}' {{(pid=98330) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:56:52 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-9f1a515c-dc72-4405-86c6-290b8e41a797 tempest-AccessRulesMetadataTest-1973590610 tempest-AccessRulesMetadataTest-1973590610-project-member] Action: 'action', calling method: Controller.__getattribute__..version_select, body: {"deny_access": {"access_id": "72727b23-42f9-424a-b54c-87e5069120d3"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:56:52 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.lock.api [None req-9f1a515c-dc72-4405-86c6-290b8e41a797 tempest-AccessRulesMetadataTest-1973590610 tempest-AccessRulesMetadataTest-1973590610-project-member] Searching for locks by: {'resource_id': '72727b23-42f9-424a-b54c-87e5069120d3', 'resource_action': 'delete'} {{(pid=98330) get_all /opt/stack/manila/manila/lock/api.py:112}} May 28 12:56:52 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-70c381e4-e727-4d25-a0ab-760a9f245b7b tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types returned with HTTP 200 May 28 12:56:52 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 144/280] 10.27.203.238 () {66 vars in 1359 bytes} [Tue May 28 12:56:52 2024] POST /share/v2/35d84ed7cf164123a87b8b906a836985/types => generated 667 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:56:52 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-ea9bfd84-defc-4007-b796-ab8de4f6c750 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] POST http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/shares May 28 12:56:52 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-ea9bfd84-defc-4007-b796-ab8de4f6c750 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share": {"share_proto": "nfs", "description": "Tempest's share", "snapshot_id": null, "name": "tempest-share-904591389", "size": 1, "metadata": {}, "is_public": false, "share_type": "044c5a62-3559-453b-9207-1b3393b6012f"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:56:52 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.v1.shares [None req-ea9bfd84-defc-4007-b796-ab8de4f6c750 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Create NFS share of 1 GB May 28 12:56:52 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-9f1a515c-dc72-4405-86c6-290b8e41a797 tempest-AccessRulesMetadataTest-1973590610 tempest-AccessRulesMetadataTest-1973590610-project-member] Acquiring lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:56:52 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-9f1a515c-dc72-4405-86c6-290b8e41a797 tempest-AccessRulesMetadataTest-1973590610 tempest-AccessRulesMetadataTest-1973590610-project-member] Lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:56:52 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.quota [None req-ea9bfd84-defc-4007-b796-ab8de4f6c750 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Created reservations ['e2e17517-48a6-42f5-8399-b93e26acc94d', 'd59ad91b-8656-4c76-972e-a024ddf1bf59', '5a8266d8-c81c-4b8e-a783-136ba720bf82', '8ed7ff23-36e3-45e5-92a0-ba16fa0ab68f'] {{(pid=98329) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 12:56:52 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-9f1a515c-dc72-4405-86c6-290b8e41a797 tempest-AccessRulesMetadataTest-1973590610 tempest-AccessRulesMetadataTest-1973590610-project-member] Lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.040s {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:56:52 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-9f1a515c-dc72-4405-86c6-290b8e41a797 tempest-AccessRulesMetadataTest-1973590610 tempest-AccessRulesMetadataTest-1973590610-project-member] Acquiring lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:56:52 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-9f1a515c-dc72-4405-86c6-290b8e41a797 tempest-AccessRulesMetadataTest-1973590610 tempest-AccessRulesMetadataTest-1973590610-project-member] Lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:56:53 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.quota [None req-ea9bfd84-defc-4007-b796-ab8de4f6c750 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Committed reservations ['e2e17517-48a6-42f5-8399-b93e26acc94d', 'd59ad91b-8656-4c76-972e-a024ddf1bf59', '5a8266d8-c81c-4b8e-a783-136ba720bf82', '8ed7ff23-36e3-45e5-92a0-ba16fa0ab68f'] {{(pid=98329) commit /opt/stack/manila/manila/quota.py:1063}} May 28 12:56:53 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-68cfc213-3bbd-40e0-bab5-7c73e970f44c tempest-ShareInstancesNegativeTest-210953919 None] <<< [GET] https://127.0.0.1:40443/api/vippools/ May 28 12:56:53 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-68cfc213-3bbd-40e0-bab5-7c73e970f44c tempest-ShareInstancesNegativeTest-210953919 None] [Bunch(active_cnode_ids=[], active_interfaces=4, cluster='loop75-kfs', cluster_id=1, cnode_ids=[], cnodes=[], domain_name='vippool-1', enable_l3=False, enable_weighted_balancing=False, enabled=True, end_ip='172.21.75.4', guid='f2abaede-b397-413a-8faa-3aeead6d3b28', gw_ip='', gw_ipv6='', id=2, ip_ranges=[['172.21.75.1', '172.21.75.4']], name='vippool-1', peer_asn=0, port_membership='ALL', ranges_summary='172.21.75.[1-4]', role='PROTOCOLS', start_ip='172.21.75.1', subnet_cidr=16, subnet_cidr_ipv6=None, sync='SYNCED', sync_time='2024-05-28T12:50:09.644123Z', tenant_id=1, tenant_name='default', title='172.21.75.1 - 172.21.75.4', url='https://127.0.0.1:40443/api/vippools/2/', vast_asn=0, vlan=0, vms_preferred=False)] May 28 12:56:53 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-68cfc213-3bbd-40e0-bab5-7c73e970f44c tempest-ShareInstancesNegativeTest-210953919 None] --- [GET] https://127.0.0.1:40443/api/vippools/: Done May 28 12:56:53 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-68cfc213-3bbd-40e0-bab5-7c73e970f44c tempest-ShareInstancesNegativeTest-210953919 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:56:53 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-68cfc213-3bbd-40e0-bab5-7c73e970f44c tempest-ShareInstancesNegativeTest-210953919 None] {'allow_redirects': True, May 28 12:56:53 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-68cfc213-3bbd-40e0-bab5-7c73e970f44c tempest-ShareInstancesNegativeTest-210953919 None] 'params': {'name': '9b44eaf4-da6e-42e7-8723-ce0cc8878f85'}} May 28 12:56:53 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-ea9bfd84-defc-4007-b796-ab8de4f6c750 tempest-ShareTypesAdminTest-216868925 None] Starting with 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:80}} May 28 12:56:53 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-ea9bfd84-defc-4007-b796-ab8de4f6c750 tempest-ShareTypesAdminTest-216868925 None] Filter OnlyHostFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:56:53 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-ea9bfd84-defc-4007-b796-ab8de4f6c750 tempest-ShareTypesAdminTest-216868925 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:56:53 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.capacity [None req-ea9bfd84-defc-4007-b796-ab8de4f6c750 tempest-ShareTypesAdminTest-216868925 None] Space information for share creation on host l75lg1-v1@vast#vast (requested / avail): 1/2074 {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/capacity.py:83}} May 28 12:56:53 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-ea9bfd84-defc-4007-b796-ab8de4f6c750 tempest-ShareTypesAdminTest-216868925 None] Filter CapacityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:56:53 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-ea9bfd84-defc-4007-b796-ab8de4f6c750 tempest-ShareTypesAdminTest-216868925 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:56:53 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-ea9bfd84-defc-4007-b796-ab8de4f6c750 tempest-ShareTypesAdminTest-216868925 None] Driver Filter: Checking host 'l75lg1-v1@vast#vast' {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:37}} May 28 12:56:53 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-ea9bfd84-defc-4007-b796-ab8de4f6c750 tempest-ShareTypesAdminTest-216868925 None] Filter function not set :: passing host. {{(pid=98327) _check_filter_function /opt/stack/manila/manila/scheduler/filters/driver.py:53}} May 28 12:56:53 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-ea9bfd84-defc-4007-b796-ab8de4f6c750 tempest-ShareTypesAdminTest-216868925 None] Result: True {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:40}} May 28 12:56:53 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-ea9bfd84-defc-4007-b796-ab8de4f6c750 tempest-ShareTypesAdminTest-216868925 None] Done checking host 'l75lg1-v1@vast#vast' {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:41}} May 28 12:56:53 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-ea9bfd84-defc-4007-b796-ab8de4f6c750 tempest-ShareTypesAdminTest-216868925 None] Filter DriverFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:56:53 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-ea9bfd84-defc-4007-b796-ab8de4f6c750 tempest-ShareTypesAdminTest-216868925 None] Filter ShareReplicationFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:56:53 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-ea9bfd84-defc-4007-b796-ab8de4f6c750 tempest-ShareTypesAdminTest-216868925 None] Filter CreateFromSnapshotFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:56:53 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-ea9bfd84-defc-4007-b796-ab8de4f6c750 tempest-ShareTypesAdminTest-216868925 None] Filter AffinityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:56:53 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-ea9bfd84-defc-4007-b796-ab8de4f6c750 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/shares returned with HTTP 200 May 28 12:56:53 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-ea9bfd84-defc-4007-b796-ab8de4f6c750 tempest-ShareTypesAdminTest-216868925 None] Filter AntiAffinityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:56:53 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 145/281] 10.27.203.238 () {66 vars in 1362 bytes} [Tue May 28 12:56:52 2024] POST /share/v2/35d84ed7cf164123a87b8b906a836985/shares => generated 1324 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 232 bytes (2 switches on core 0) May 28 12:56:53 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.drivers.filter [None req-ea9bfd84-defc-4007-b796-ab8de4f6c750 tempest-ShareTypesAdminTest-216868925 None] Filtered share [host: 'l75lg1-v1@vast#vast', free_capacity_gb: 2074.6229242384434, pools: None] {{(pid=98327) _schedule_share /opt/stack/manila/manila/scheduler/drivers/filter.py:268}} May 28 12:56:53 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-ea9bfd84-defc-4007-b796-ab8de4f6c750 tempest-ShareTypesAdminTest-216868925 None] Checking host 'l75lg1-v1@vast#vast' {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:46}} May 28 12:56:53 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-9f1a515c-dc72-4405-86c6-290b8e41a797 tempest-AccessRulesMetadataTest-1973590610 tempest-AccessRulesMetadataTest-1973590610-project-member] Lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.084s {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:56:53 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.weighers.goodness [None req-ea9bfd84-defc-4007-b796-ab8de4f6c750 tempest-ShareTypesAdminTest-216868925 None] Goodness function not set :: defaulting to minimal goodness rating of 0. May 28 12:56:53 l75lg1-v1 manila-scheduler[98327]: INFO manila.scheduler.weighers.goodness [None req-ea9bfd84-defc-4007-b796-ab8de4f6c750 tempest-ShareTypesAdminTest-216868925 None] Goodness function result for host l75lg1-v1@vast#vast: 0. May 28 12:56:53 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-ea9bfd84-defc-4007-b796-ab8de4f6c750 tempest-ShareTypesAdminTest-216868925 None] Goodness: 0 {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:48}} May 28 12:56:53 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-ea9bfd84-defc-4007-b796-ab8de4f6c750 tempest-ShareTypesAdminTest-216868925 None] Done checking host 'l75lg1-v1@vast#vast' {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:49}} May 28 12:56:53 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-9f1a515c-dc72-4405-86c6-290b8e41a797 tempest-AccessRulesMetadataTest-1973590610 tempest-AccessRulesMetadataTest-1973590610-project-member] http://10.27.203.238/share/v2/1643901550e140118fc2d2e92b82cd0b/shares/b92fc06b-76d7-40f9-adef-74a07ace1027/action returned with HTTP 202 May 28 12:56:53 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.drivers.filter [None req-ea9bfd84-defc-4007-b796-ab8de4f6c750 tempest-ShareTypesAdminTest-216868925 None] Choosing for share: WeighedHost [host: l75lg1-v1@vast#vast, weight: 0.0] {{(pid=98327) _schedule_share /opt/stack/manila/manila/scheduler/drivers/filter.py:274}} May 28 12:56:53 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 137/282] 10.27.203.238 () {66 vars in 1493 bytes} [Tue May 28 12:56:52 2024] POST /share/v2/1643901550e140118fc2d2e92b82cd0b/shares/b92fc06b-76d7-40f9-adef-74a07ace1027/action => generated 0 bytes in 210 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:56:53 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-c791c342-13d4-4d2a-ab52-e55eb8fce022 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] GET http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/shares/8e00d6e4-a018-4e71-b71c-831e546cb6e6 May 28 12:56:53 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-c791c342-13d4-4d2a-ab52-e55eb8fce022 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:53 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-c791c342-13d4-4d2a-ab52-e55eb8fce022 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:53 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-b83a7447-1a8f-483e-82d9-9ed5ed94bc37 tempest-AccessRulesMetadataTest-1973590610 tempest-AccessRulesMetadataTest-1973590610-project-member] GET http://10.27.203.238/share/v2/1643901550e140118fc2d2e92b82cd0b/share-access-rules?share_id=b92fc06b-76d7-40f9-adef-74a07ace1027 May 28 12:56:53 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-b83a7447-1a8f-483e-82d9-9ed5ed94bc37 tempest-AccessRulesMetadataTest-1973590610 tempest-AccessRulesMetadataTest-1973590610-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:53 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-b83a7447-1a8f-483e-82d9-9ed5ed94bc37 tempest-AccessRulesMetadataTest-1973590610 tempest-AccessRulesMetadataTest-1973590610-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:53 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-c791c342-13d4-4d2a-ab52-e55eb8fce022 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/shares/8e00d6e4-a018-4e71-b71c-831e546cb6e6 returned with HTTP 200 May 28 12:56:53 l75lg1-v1 manila-share[98474]: DEBUG manila.share.manager [None req-9f1a515c-dc72-4405-86c6-290b8e41a797 tempest-AccessRulesMetadataTest-1973590610 None] Received request to update access for share instance 95118a75-173c-4257-acef-78a246ee1c67. {{(pid=98474) update_access_for_instances /opt/stack/manila/manila/share/manager.py:4353}} May 28 12:56:53 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 146/283] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:56:53 2024] GET /share/v2/35d84ed7cf164123a87b8b906a836985/shares/8e00d6e4-a018-4e71-b71c-831e546cb6e6 => generated 1324 bytes in 24 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:56:53 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-9f1a515c-dc72-4405-86c6-290b8e41a797 tempest-AccessRulesMetadataTest-1973590610 None] Acquiring lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:56:53 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-9f1a515c-dc72-4405-86c6-290b8e41a797 tempest-AccessRulesMetadataTest-1973590610 None] Lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:56:53 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.lock.api [None req-b83a7447-1a8f-483e-82d9-9ed5ed94bc37 tempest-AccessRulesMetadataTest-1973590610 tempest-AccessRulesMetadataTest-1973590610-project-member] Searching for locks by: {'resource_id': '065fb8ea-fc05-4af3-b191-603cca79c74e', 'resource_action': 'show', 'resource_type': 'access_rule'} {{(pid=98330) get_all /opt/stack/manila/manila/lock/api.py:112}} May 28 12:56:53 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.lock.api [None req-b83a7447-1a8f-483e-82d9-9ed5ed94bc37 tempest-AccessRulesMetadataTest-1973590610 tempest-AccessRulesMetadataTest-1973590610-project-member] Searching for locks by: {'resource_id': '72727b23-42f9-424a-b54c-87e5069120d3', 'resource_action': 'show', 'resource_type': 'access_rule'} {{(pid=98330) get_all /opt/stack/manila/manila/lock/api.py:112}} May 28 12:56:53 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-9f1a515c-dc72-4405-86c6-290b8e41a797 tempest-AccessRulesMetadataTest-1973590610 None] Lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.014s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:56:53 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-9f1a515c-dc72-4405-86c6-290b8e41a797 tempest-AccessRulesMetadataTest-1973590610 None] Acquiring lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:56:53 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-b83a7447-1a8f-483e-82d9-9ed5ed94bc37 tempest-AccessRulesMetadataTest-1973590610 tempest-AccessRulesMetadataTest-1973590610-project-member] http://10.27.203.238/share/v2/1643901550e140118fc2d2e92b82cd0b/share-access-rules?share_id=b92fc06b-76d7-40f9-adef-74a07ace1027 returned with HTTP 200 May 28 12:56:53 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-9f1a515c-dc72-4405-86c6-290b8e41a797 tempest-AccessRulesMetadataTest-1973590610 None] Lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:56:53 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 138/284] 10.27.203.238 () {64 vars in 1467 bytes} [Tue May 28 12:56:53 2024] GET /share/v2/1643901550e140118fc2d2e92b82cd0b/share-access-rules?share_id=b92fc06b-76d7-40f9-adef-74a07ace1027 => generated 667 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:56:53 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-fe1a75fe-b490-454a-9b5d-1467805923df tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] GET http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/shares/a6fffe7e-d89b-4b6c-ada2-53d5855ef606 May 28 12:56:53 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-fe1a75fe-b490-454a-9b5d-1467805923df tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:53 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-fe1a75fe-b490-454a-9b5d-1467805923df tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:53 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-fe1a75fe-b490-454a-9b5d-1467805923df tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] HTTP exception thrown: The resource could not be found. May 28 12:56:53 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-fe1a75fe-b490-454a-9b5d-1467805923df tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/shares/a6fffe7e-d89b-4b6c-ada2-53d5855ef606 returned with HTTP 404 May 28 12:56:53 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 147/285] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:56:53 2024] GET /share/v2/a3499cb78849424db45e54caac01de92/shares/a6fffe7e-d89b-4b6c-ada2-53d5855ef606 => generated 78 bytes in 13 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 12:56:53 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-828f7ff7-ae15-4608-b548-bfee0a309e65 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] POST http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/shares May 28 12:56:53 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-828f7ff7-ae15-4608-b548-bfee0a309e65 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share": {"share_proto": "nfs", "description": "Tempest's share", "snapshot_id": null, "name": "tempest-tempest-created-share-1919982830", "size": 1, "metadata": {}, "is_public": false, "share_type": "ed6e3c4a-7505-47e7-9c77-78267ba93d85"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:56:53 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ea9bfd84-defc-4007-b796-ab8de4f6c750 tempest-ShareTypesAdminTest-216868925 None] >>> [GET] https://127.0.0.1:40443/api/vippools/ May 28 12:56:53 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ea9bfd84-defc-4007-b796-ab8de4f6c750 tempest-ShareTypesAdminTest-216868925 None] {'allow_redirects': True, 'params': {'name': 'vippool-1'}} May 28 12:56:53 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.v1.shares [None req-828f7ff7-ae15-4608-b548-bfee0a309e65 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Create NFS share of 1 GB May 28 12:56:53 l75lg1-v1 dstat.sh[49771]: 28-05 12:56:53| 20 2 74 4 0|5666M 1839M 277M 7844M| 19k 10k| 0 3052k| 0 421 |9944 18k|1.55 0.98 0.98|1.0 2.0 0| 0 0 | 0 2048M| 29 348 0 59 0 May 28 12:56:53 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-9f1a515c-dc72-4405-86c6-290b8e41a797 tempest-AccessRulesMetadataTest-1973590610 None] Lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.124s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:56:53 l75lg1-v1 manila-share[98474]: DEBUG manila.share.access [None req-9f1a515c-dc72-4405-86c6-290b8e41a797 tempest-AccessRulesMetadataTest-1973590610 None] Updating access rules for share instance 95118a75-173c-4257-acef-78a246ee1c67 belonging to share b92fc06b-76d7-40f9-adef-74a07ace1027. {{(pid=98474) update_access_rules /opt/stack/manila/manila/share/access.py:298}} May 28 12:56:53 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.quota [None req-828f7ff7-ae15-4608-b548-bfee0a309e65 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Created reservations ['be959050-bab3-4967-afac-4b46a8a14b04', '7e5874b9-fa82-41fa-8504-55d1d05b1142', 'c764ebf7-2c0c-46fd-8ea5-c1993cb73d4f', '9154e142-2319-48fd-894d-4f19724e10e1'] {{(pid=98330) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 12:56:53 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-837a6446-9037-44ea-98a7-140165b7746b tempest-ExportLocationsNegativeTest-386865252 None] <<< [GET] https://127.0.0.1:40443/api/quotas/ May 28 12:56:53 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-837a6446-9037-44ea-98a7-140165b7746b tempest-ExportLocationsNegativeTest-386865252 None] [] May 28 12:56:53 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-837a6446-9037-44ea-98a7-140165b7746b tempest-ExportLocationsNegativeTest-386865252 None] --- [GET] https://127.0.0.1:40443/api/quotas/: Done May 28 12:56:53 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-837a6446-9037-44ea-98a7-140165b7746b tempest-ExportLocationsNegativeTest-386865252 None] >>> [POST] https://127.0.0.1:40443/api/quotas/ May 28 12:56:53 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-837a6446-9037-44ea-98a7-140165b7746b tempest-ExportLocationsNegativeTest-386865252 None] {'data': '{"name": "d44fc8f1-83fc-47c3-994f-497e85a3194a", "path": ' May 28 12:56:53 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-837a6446-9037-44ea-98a7-140165b7746b tempest-ExportLocationsNegativeTest-386865252 None] '"/manila/manila-d44fc8f1-83fc-47c3-994f-497e85a3194a", "create_dir": ' May 28 12:56:53 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-837a6446-9037-44ea-98a7-140165b7746b tempest-ExportLocationsNegativeTest-386865252 None] 'true, "hard_limit": 1073741824}', May 28 12:56:53 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-837a6446-9037-44ea-98a7-140165b7746b tempest-ExportLocationsNegativeTest-386865252 None] 'json': None, May 28 12:56:53 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-837a6446-9037-44ea-98a7-140165b7746b tempest-ExportLocationsNegativeTest-386865252 None] 'params': None} May 28 12:56:53 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-9f1a515c-dc72-4405-86c6-290b8e41a797 tempest-AccessRulesMetadataTest-1973590610 None] Acquiring lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:56:53 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-9f1a515c-dc72-4405-86c6-290b8e41a797 tempest-AccessRulesMetadataTest-1973590610 None] Lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:56:53 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-9f1a515c-dc72-4405-86c6-290b8e41a797 tempest-AccessRulesMetadataTest-1973590610 None] Lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.026s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:56:53 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-9f1a515c-dc72-4405-86c6-290b8e41a797 tempest-AccessRulesMetadataTest-1973590610 None] Acquiring lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:56:53 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-9f1a515c-dc72-4405-86c6-290b8e41a797 tempest-AccessRulesMetadataTest-1973590610 None] Lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:56:53 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.quota [None req-828f7ff7-ae15-4608-b548-bfee0a309e65 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Committed reservations ['be959050-bab3-4967-afac-4b46a8a14b04', '7e5874b9-fa82-41fa-8504-55d1d05b1142', 'c764ebf7-2c0c-46fd-8ea5-c1993cb73d4f', '9154e142-2319-48fd-894d-4f19724e10e1'] {{(pid=98330) commit /opt/stack/manila/manila/quota.py:1063}} May 28 12:56:53 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-9f1a515c-dc72-4405-86c6-290b8e41a797 tempest-AccessRulesMetadataTest-1973590610 None] Lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.036s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:56:53 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-9f1a515c-dc72-4405-86c6-290b8e41a797 tempest-AccessRulesMetadataTest-1973590610 None] changing access on None May 28 12:56:53 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9f1a515c-dc72-4405-86c6-290b8e41a797 tempest-AccessRulesMetadataTest-1973590610 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:56:53 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9f1a515c-dc72-4405-86c6-290b8e41a797 tempest-AccessRulesMetadataTest-1973590610 None] {'allow_redirects': True, May 28 12:56:53 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9f1a515c-dc72-4405-86c6-290b8e41a797 tempest-AccessRulesMetadataTest-1973590610 None] 'params': {'name': '95118a75-173c-4257-acef-78a246ee1c67'}} May 28 12:56:53 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-828f7ff7-ae15-4608-b548-bfee0a309e65 tempest-AdminActionsTest-1749172189 None] Starting with 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:80}} May 28 12:56:53 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-828f7ff7-ae15-4608-b548-bfee0a309e65 tempest-AdminActionsTest-1749172189 None] Filter OnlyHostFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:56:53 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-828f7ff7-ae15-4608-b548-bfee0a309e65 tempest-AdminActionsTest-1749172189 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:56:53 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.capacity [None req-828f7ff7-ae15-4608-b548-bfee0a309e65 tempest-AdminActionsTest-1749172189 None] Space information for share creation on host l75lg1-v1@vast#vast (requested / avail): 1/2073 {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/capacity.py:83}} May 28 12:56:53 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-828f7ff7-ae15-4608-b548-bfee0a309e65 tempest-AdminActionsTest-1749172189 None] Filter CapacityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:56:53 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-828f7ff7-ae15-4608-b548-bfee0a309e65 tempest-AdminActionsTest-1749172189 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:56:53 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-828f7ff7-ae15-4608-b548-bfee0a309e65 tempest-AdminActionsTest-1749172189 None] Driver Filter: Checking host 'l75lg1-v1@vast#vast' {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:37}} May 28 12:56:53 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-828f7ff7-ae15-4608-b548-bfee0a309e65 tempest-AdminActionsTest-1749172189 None] Filter function not set :: passing host. {{(pid=98327) _check_filter_function /opt/stack/manila/manila/scheduler/filters/driver.py:53}} May 28 12:56:53 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-828f7ff7-ae15-4608-b548-bfee0a309e65 tempest-AdminActionsTest-1749172189 None] Result: True {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:40}} May 28 12:56:53 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-828f7ff7-ae15-4608-b548-bfee0a309e65 tempest-AdminActionsTest-1749172189 None] Done checking host 'l75lg1-v1@vast#vast' {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:41}} May 28 12:56:53 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-828f7ff7-ae15-4608-b548-bfee0a309e65 tempest-AdminActionsTest-1749172189 None] Filter DriverFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:56:53 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-828f7ff7-ae15-4608-b548-bfee0a309e65 tempest-AdminActionsTest-1749172189 None] Filter ShareReplicationFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:56:53 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-828f7ff7-ae15-4608-b548-bfee0a309e65 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/shares returned with HTTP 200 May 28 12:56:53 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-828f7ff7-ae15-4608-b548-bfee0a309e65 tempest-AdminActionsTest-1749172189 None] Filter CreateFromSnapshotFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:56:53 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 139/286] 10.27.203.238 () {66 vars in 1362 bytes} [Tue May 28 12:56:53 2024] POST /share/v2/a3499cb78849424db45e54caac01de92/shares => generated 1348 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:56:53 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-828f7ff7-ae15-4608-b548-bfee0a309e65 tempest-AdminActionsTest-1749172189 None] Filter AffinityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:56:53 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-828f7ff7-ae15-4608-b548-bfee0a309e65 tempest-AdminActionsTest-1749172189 None] Filter AntiAffinityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:56:53 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.drivers.filter [None req-828f7ff7-ae15-4608-b548-bfee0a309e65 tempest-AdminActionsTest-1749172189 None] Filtered share [host: 'l75lg1-v1@vast#vast', free_capacity_gb: 2073.6229242384434, pools: None] {{(pid=98327) _schedule_share /opt/stack/manila/manila/scheduler/drivers/filter.py:268}} May 28 12:56:53 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-828f7ff7-ae15-4608-b548-bfee0a309e65 tempest-AdminActionsTest-1749172189 None] Checking host 'l75lg1-v1@vast#vast' {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:46}} May 28 12:56:53 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.weighers.goodness [None req-828f7ff7-ae15-4608-b548-bfee0a309e65 tempest-AdminActionsTest-1749172189 None] Goodness function not set :: defaulting to minimal goodness rating of 0. May 28 12:56:53 l75lg1-v1 manila-scheduler[98327]: INFO manila.scheduler.weighers.goodness [None req-828f7ff7-ae15-4608-b548-bfee0a309e65 tempest-AdminActionsTest-1749172189 None] Goodness function result for host l75lg1-v1@vast#vast: 0. May 28 12:56:53 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-828f7ff7-ae15-4608-b548-bfee0a309e65 tempest-AdminActionsTest-1749172189 None] Goodness: 0 {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:48}} May 28 12:56:53 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-828f7ff7-ae15-4608-b548-bfee0a309e65 tempest-AdminActionsTest-1749172189 None] Done checking host 'l75lg1-v1@vast#vast' {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:49}} May 28 12:56:53 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.drivers.filter [None req-828f7ff7-ae15-4608-b548-bfee0a309e65 tempest-AdminActionsTest-1749172189 None] Choosing for share: WeighedHost [host: l75lg1-v1@vast#vast, weight: 0.0] {{(pid=98327) _schedule_share /opt/stack/manila/manila/scheduler/drivers/filter.py:274}} May 28 12:56:53 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-42bede54-98cb-4149-a5b3-327f63d6eb97 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] GET http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/shares/9be3b244-34ab-4002-b1e1-427af2ab8545 May 28 12:56:53 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-42bede54-98cb-4149-a5b3-327f63d6eb97 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:53 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-42bede54-98cb-4149-a5b3-327f63d6eb97 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:53 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ea9bfd84-defc-4007-b796-ab8de4f6c750 tempest-ShareTypesAdminTest-216868925 None] <<< [GET] https://127.0.0.1:40443/api/vippools/ May 28 12:56:53 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ea9bfd84-defc-4007-b796-ab8de4f6c750 tempest-ShareTypesAdminTest-216868925 None] [Bunch(active_cnode_ids=[], active_interfaces=4, cluster='loop75-kfs', cluster_id=1, cnode_ids=[], cnodes=[], domain_name='vippool-1', enable_l3=False, enable_weighted_balancing=False, enabled=True, end_ip='172.21.75.4', guid='f2abaede-b397-413a-8faa-3aeead6d3b28', gw_ip='', gw_ipv6='', id=2, ip_ranges=[['172.21.75.1', '172.21.75.4']], name='vippool-1', peer_asn=0, port_membership='ALL', ranges_summary='172.21.75.[1-4]', role='PROTOCOLS', start_ip='172.21.75.1', subnet_cidr=16, subnet_cidr_ipv6=None, sync='SYNCED', sync_time='2024-05-28T12:50:09.644123Z', tenant_id=1, tenant_name='default', title='172.21.75.1 - 172.21.75.4', url='https://127.0.0.1:40443/api/vippools/2/', vast_asn=0, vlan=0, vms_preferred=False)] May 28 12:56:53 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ea9bfd84-defc-4007-b796-ab8de4f6c750 tempest-ShareTypesAdminTest-216868925 None] --- [GET] https://127.0.0.1:40443/api/vippools/: Done May 28 12:56:53 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ea9bfd84-defc-4007-b796-ab8de4f6c750 tempest-ShareTypesAdminTest-216868925 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:56:53 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ea9bfd84-defc-4007-b796-ab8de4f6c750 tempest-ShareTypesAdminTest-216868925 None] {'allow_redirects': True, May 28 12:56:53 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ea9bfd84-defc-4007-b796-ab8de4f6c750 tempest-ShareTypesAdminTest-216868925 None] 'params': {'name': '4e77e600-5df2-4310-91eb-8d6633f53ce4'}} May 28 12:56:53 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-42bede54-98cb-4149-a5b3-327f63d6eb97 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/shares/9be3b244-34ab-4002-b1e1-427af2ab8545 returned with HTTP 200 May 28 12:56:53 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 148/287] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:56:53 2024] GET /share/v2/a3499cb78849424db45e54caac01de92/shares/9be3b244-34ab-4002-b1e1-427af2ab8545 => generated 1348 bytes in 29 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:56:53 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-68cfc213-3bbd-40e0-bab5-7c73e970f44c tempest-ShareInstancesNegativeTest-210953919 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:56:53 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-68cfc213-3bbd-40e0-bab5-7c73e970f44c tempest-ShareInstancesNegativeTest-210953919 None] [] May 28 12:56:53 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-68cfc213-3bbd-40e0-bab5-7c73e970f44c tempest-ShareInstancesNegativeTest-210953919 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 12:56:53 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-68cfc213-3bbd-40e0-bab5-7c73e970f44c tempest-ShareInstancesNegativeTest-210953919 None] >>> [POST] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:56:53 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-68cfc213-3bbd-40e0-bab5-7c73e970f44c tempest-ShareInstancesNegativeTest-210953919 None] {'data': '{"name": "9b44eaf4-da6e-42e7-8723-ce0cc8878f85"}', May 28 12:56:53 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-68cfc213-3bbd-40e0-bab5-7c73e970f44c tempest-ShareInstancesNegativeTest-210953919 None] 'json': None, May 28 12:56:53 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-68cfc213-3bbd-40e0-bab5-7c73e970f44c tempest-ShareInstancesNegativeTest-210953919 None] 'params': None} May 28 12:56:53 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-828f7ff7-ae15-4608-b548-bfee0a309e65 tempest-AdminActionsTest-1749172189 None] >>> [GET] https://127.0.0.1:40443/api/vippools/ May 28 12:56:53 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-828f7ff7-ae15-4608-b548-bfee0a309e65 tempest-AdminActionsTest-1749172189 None] {'allow_redirects': True, 'params': {'name': 'vippool-1'}} May 28 12:56:53 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:56:53 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:56:53 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-828f7ff7-ae15-4608-b548-bfee0a309e65 tempest-AdminActionsTest-1749172189 None] <<< [GET] https://127.0.0.1:40443/api/vippools/ May 28 12:56:53 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-828f7ff7-ae15-4608-b548-bfee0a309e65 tempest-AdminActionsTest-1749172189 None] [Bunch(active_cnode_ids=[], active_interfaces=4, cluster='loop75-kfs', cluster_id=1, cnode_ids=[], cnodes=[], domain_name='vippool-1', enable_l3=False, enable_weighted_balancing=False, enabled=True, end_ip='172.21.75.4', guid='f2abaede-b397-413a-8faa-3aeead6d3b28', gw_ip='', gw_ipv6='', id=2, ip_ranges=[['172.21.75.1', '172.21.75.4']], name='vippool-1', peer_asn=0, port_membership='ALL', ranges_summary='172.21.75.[1-4]', role='PROTOCOLS', start_ip='172.21.75.1', subnet_cidr=16, subnet_cidr_ipv6=None, sync='SYNCED', sync_time='2024-05-28T12:50:09.644123Z', tenant_id=1, tenant_name='default', title='172.21.75.1 - 172.21.75.4', url='https://127.0.0.1:40443/api/vippools/2/', vast_asn=0, vlan=0, vms_preferred=False)] May 28 12:56:53 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-828f7ff7-ae15-4608-b548-bfee0a309e65 tempest-AdminActionsTest-1749172189 None] --- [GET] https://127.0.0.1:40443/api/vippools/: Done May 28 12:56:53 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-828f7ff7-ae15-4608-b548-bfee0a309e65 tempest-AdminActionsTest-1749172189 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:56:53 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-828f7ff7-ae15-4608-b548-bfee0a309e65 tempest-AdminActionsTest-1749172189 None] {'allow_redirects': True, May 28 12:56:53 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-828f7ff7-ae15-4608-b548-bfee0a309e65 tempest-AdminActionsTest-1749172189 None] 'params': {'name': '4016fe10-12f4-48fc-92de-42cdd2fff998'}} May 28 12:56:54 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9f1a515c-dc72-4405-86c6-290b8e41a797 tempest-AccessRulesMetadataTest-1973590610 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:56:54 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9f1a515c-dc72-4405-86c6-290b8e41a797 tempest-AccessRulesMetadataTest-1973590610 None] [Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=1, created='2024-05-28T12:56:41.381687Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='8ed5f8f5-e848-431c-be27-16f1fa370a60', id=9, internal=False, is_s3_default_policy=False, name='95118a75-173c-4257-acef-78a246ee1c67', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=[], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['*'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['*'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T12:56:41.744950Z', tenant_id=1, tenant_name='default', title='95118a75-173c-4257-acef-78a246ee1c67', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/9/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[])] May 28 12:56:54 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9f1a515c-dc72-4405-86c6-290b8e41a797 tempest-AccessRulesMetadataTest-1973590610 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 12:56:54 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-9f1a515c-dc72-4405-86c6-290b8e41a797 tempest-AccessRulesMetadataTest-1973590610 None] Acquiring lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:56:54 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-9f1a515c-dc72-4405-86c6-290b8e41a797 tempest-AccessRulesMetadataTest-1973590610 None] Lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:56:54 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-9f1a515c-dc72-4405-86c6-290b8e41a797 tempest-AccessRulesMetadataTest-1973590610 None] Lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.064s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:56:54 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-9f1a515c-dc72-4405-86c6-290b8e41a797 tempest-AccessRulesMetadataTest-1973590610 None] Acquiring lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:56:54 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-9f1a515c-dc72-4405-86c6-290b8e41a797 tempest-AccessRulesMetadataTest-1973590610 None] Lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:56:54 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-9f1a515c-dc72-4405-86c6-290b8e41a797 tempest-AccessRulesMetadataTest-1973590610 None] Lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.041s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:56:54 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-9f1a515c-dc72-4405-86c6-290b8e41a797 tempest-AccessRulesMetadataTest-1973590610 None] Acquiring lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:56:54 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-9f1a515c-dc72-4405-86c6-290b8e41a797 tempest-AccessRulesMetadataTest-1973590610 None] Lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:56:54 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-9f1a515c-dc72-4405-86c6-290b8e41a797 tempest-AccessRulesMetadataTest-1973590610 None] Lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.005s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:56:54 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-9f1a515c-dc72-4405-86c6-290b8e41a797 tempest-AccessRulesMetadataTest-1973590610 None] Acquiring lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:56:54 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-9f1a515c-dc72-4405-86c6-290b8e41a797 tempest-AccessRulesMetadataTest-1973590610 None] Lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:56:54 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-9f1a515c-dc72-4405-86c6-290b8e41a797 tempest-AccessRulesMetadataTest-1973590610 None] Lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.004s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:56:54 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-9f1a515c-dc72-4405-86c6-290b8e41a797 tempest-AccessRulesMetadataTest-1973590610 None] Acquiring lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:56:54 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-891ab0b3-4522-4417-8de7-a4f9899f7c39 tempest-ExportLocationsNegativeTest-386865252 tempest-ExportLocationsNegativeTest-386865252-project-admin] GET http://10.27.203.238/share/v2/df93a973373644ccaf8ecf54774a4ced/shares/543531db-0529-42ad-9ae8-5e3dff98a2a5 May 28 12:56:54 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-891ab0b3-4522-4417-8de7-a4f9899f7c39 tempest-ExportLocationsNegativeTest-386865252 tempest-ExportLocationsNegativeTest-386865252-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:54 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-9f1a515c-dc72-4405-86c6-290b8e41a797 tempest-AccessRulesMetadataTest-1973590610 None] Lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:56:54 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-891ab0b3-4522-4417-8de7-a4f9899f7c39 tempest-ExportLocationsNegativeTest-386865252 tempest-ExportLocationsNegativeTest-386865252-project-admin] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:54 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-837a6446-9037-44ea-98a7-140165b7746b tempest-ExportLocationsNegativeTest-386865252 None] <<< [POST] https://127.0.0.1:40443/api/quotas/ May 28 12:56:54 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-837a6446-9037-44ea-98a7-140165b7746b tempest-ExportLocationsNegativeTest-386865252 None] Bunch(cluster='loop75-kfs', cluster_id=1, default_email=None, default_group_quota=None, default_user_quota=None, enable_alarms=True, enable_email_providers=True, grace_period=None, group_quotas=[], guid='7539e5d6-b4f9-4a34-8d50-fb7bae8450a9', hard_limit=1073741824, hard_limit_inodes=None, id=7, internal=False, is_user_quota=False, last_user_quotas_update=None, name='d44fc8f1-83fc-47c3-994f-497e85a3194a', num_blocked_users=0, num_exceeded_users=0, path='/manila/manila-d44fc8f1-83fc-47c3-994f-497e85a3194a', percent_capacity=0, percent_inodes=None, pretty_grace_period=None, pretty_grace_period_expiration=None, pretty_state='OK (CREATED)', soft_limit=None, soft_limit_inodes=None, state='OK', sync_state='CREATED', system_id=7, tenant_id=1, tenant_name='default', time_to_block=None, title='d44fc8f1-83fc-47c3-994f-497e85a3194a', url='https://127.0.0.1:40443/api/quotas/7/', used_capacity=0, used_capacity_tb=0.0, used_effective_capacity=0, used_effective_capacity_tb=0.0, used_inodes=0, used_limited_capacity=0, user_quotas=[]) May 28 12:56:54 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-837a6446-9037-44ea-98a7-140165b7746b tempest-ExportLocationsNegativeTest-386865252 None] --- [POST] https://127.0.0.1:40443/api/quotas/: Done May 28 12:56:54 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-837a6446-9037-44ea-98a7-140165b7746b tempest-ExportLocationsNegativeTest-386865252 None] >>> [GET] https://127.0.0.1:40443/api/views/ May 28 12:56:54 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-837a6446-9037-44ea-98a7-140165b7746b tempest-ExportLocationsNegativeTest-386865252 None] {'allow_redirects': True, May 28 12:56:54 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-837a6446-9037-44ea-98a7-140165b7746b tempest-ExportLocationsNegativeTest-386865252 None] 'params': {'name': 'd44fc8f1-83fc-47c3-994f-497e85a3194a'}} May 28 12:56:54 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-891ab0b3-4522-4417-8de7-a4f9899f7c39 tempest-ExportLocationsNegativeTest-386865252 tempest-ExportLocationsNegativeTest-386865252-project-admin] http://10.27.203.238/share/v2/df93a973373644ccaf8ecf54774a4ced/shares/543531db-0529-42ad-9ae8-5e3dff98a2a5 returned with HTTP 200 May 28 12:56:54 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 140/288] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:56:54 2024] GET /share/v2/df93a973373644ccaf8ecf54774a4ced/shares/543531db-0529-42ad-9ae8-5e3dff98a2a5 => generated 1372 bytes in 25 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:56:54 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ea9bfd84-defc-4007-b796-ab8de4f6c750 tempest-ShareTypesAdminTest-216868925 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:56:54 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ea9bfd84-defc-4007-b796-ab8de4f6c750 tempest-ShareTypesAdminTest-216868925 None] [] May 28 12:56:54 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ea9bfd84-defc-4007-b796-ab8de4f6c750 tempest-ShareTypesAdminTest-216868925 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 12:56:54 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ea9bfd84-defc-4007-b796-ab8de4f6c750 tempest-ShareTypesAdminTest-216868925 None] >>> [POST] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:56:54 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ea9bfd84-defc-4007-b796-ab8de4f6c750 tempest-ShareTypesAdminTest-216868925 None] {'data': '{"name": "4e77e600-5df2-4310-91eb-8d6633f53ce4"}', May 28 12:56:54 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ea9bfd84-defc-4007-b796-ab8de4f6c750 tempest-ShareTypesAdminTest-216868925 None] 'json': None, May 28 12:56:54 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ea9bfd84-defc-4007-b796-ab8de4f6c750 tempest-ShareTypesAdminTest-216868925 None] 'params': None} May 28 12:56:54 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-9f1a515c-dc72-4405-86c6-290b8e41a797 tempest-AccessRulesMetadataTest-1973590610 None] Lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.052s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:56:54 l75lg1-v1 manila-share[98474]: INFO manila.share.access [None req-9f1a515c-dc72-4405-86c6-290b8e41a797 tempest-AccessRulesMetadataTest-1973590610 None] Access rules were successfully modified for share instance 95118a75-173c-4257-acef-78a246ee1c67 belonging to share b92fc06b-76d7-40f9-adef-74a07ace1027. May 28 12:56:54 l75lg1-v1 dstat.sh[49771]: 28-05 12:56:54| 7 1 85 6 0|5666M 1838M 277M 7844M| 19k 6177B| 0 8375k| 0 738 |6017 10k|1.55 0.98 0.98| 0 1.0 0| 0 0 | 0 2048M| 29 347 0 56 0 May 28 12:56:54 l75lg1-v1 neutron-server[77623]: DEBUG dbcounter [-] [77623] Writing DB stats neutron:SELECT=1 {{(pid=77623) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:56:54 l75lg1-v1 neutron-server[77623]: DEBUG dbcounter [-] [77623] Writing DB stats neutron:SELECT=2 {{(pid=77623) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:56:54 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-828f7ff7-ae15-4608-b548-bfee0a309e65 tempest-AdminActionsTest-1749172189 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:56:54 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-828f7ff7-ae15-4608-b548-bfee0a309e65 tempest-AdminActionsTest-1749172189 None] [] May 28 12:56:54 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-828f7ff7-ae15-4608-b548-bfee0a309e65 tempest-AdminActionsTest-1749172189 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 12:56:54 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-828f7ff7-ae15-4608-b548-bfee0a309e65 tempest-AdminActionsTest-1749172189 None] >>> [POST] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:56:54 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-828f7ff7-ae15-4608-b548-bfee0a309e65 tempest-AdminActionsTest-1749172189 None] {'data': '{"name": "4016fe10-12f4-48fc-92de-42cdd2fff998"}', May 28 12:56:54 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-828f7ff7-ae15-4608-b548-bfee0a309e65 tempest-AdminActionsTest-1749172189 None] 'json': None, May 28 12:56:54 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-828f7ff7-ae15-4608-b548-bfee0a309e65 tempest-AdminActionsTest-1749172189 None] 'params': None} May 28 12:56:54 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-68cfc213-3bbd-40e0-bab5-7c73e970f44c tempest-ShareInstancesNegativeTest-210953919 None] <<< [POST] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:56:54 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-68cfc213-3bbd-40e0-bab5-7c73e970f44c tempest-ShareInstancesNegativeTest-210953919 None] Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=0, created='2024-05-28T12:56:54.339412Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='4109ecc5-85a4-4ee7-a55f-54cf7176aa66', id=11, internal=False, is_s3_default_policy=False, name='9b44eaf4-da6e-42e7-8723-ce0cc8878f85', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=[], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['*'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['*'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T12:56:54.719556Z', tenant_id=1, tenant_name='default', title='9b44eaf4-da6e-42e7-8723-ce0cc8878f85', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/11/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[]) May 28 12:56:54 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-68cfc213-3bbd-40e0-bab5-7c73e970f44c tempest-ShareInstancesNegativeTest-210953919 None] --- [POST] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 12:56:54 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-68cfc213-3bbd-40e0-bab5-7c73e970f44c tempest-ShareInstancesNegativeTest-210953919 None] >>> [GET] https://127.0.0.1:40443/api/quotas/ May 28 12:56:54 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-68cfc213-3bbd-40e0-bab5-7c73e970f44c tempest-ShareInstancesNegativeTest-210953919 None] {'allow_redirects': True, May 28 12:56:54 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-68cfc213-3bbd-40e0-bab5-7c73e970f44c tempest-ShareInstancesNegativeTest-210953919 None] 'params': {'name': '9b44eaf4-da6e-42e7-8723-ce0cc8878f85'}} May 28 12:56:54 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-837a6446-9037-44ea-98a7-140165b7746b tempest-ExportLocationsNegativeTest-386865252 None] <<< [GET] https://127.0.0.1:40443/api/views/ May 28 12:56:54 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-837a6446-9037-44ea-98a7-140165b7746b tempest-ExportLocationsNegativeTest-386865252 None] [] May 28 12:56:54 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-837a6446-9037-44ea-98a7-140165b7746b tempest-ExportLocationsNegativeTest-386865252 None] --- [GET] https://127.0.0.1:40443/api/views/: Done May 28 12:56:54 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-837a6446-9037-44ea-98a7-140165b7746b tempest-ExportLocationsNegativeTest-386865252 None] >>> [POST] https://127.0.0.1:40443/api/views/ May 28 12:56:54 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-837a6446-9037-44ea-98a7-140165b7746b tempest-ExportLocationsNegativeTest-386865252 None] {'data': '{"name": "d44fc8f1-83fc-47c3-994f-497e85a3194a", "path": ' May 28 12:56:54 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-837a6446-9037-44ea-98a7-140165b7746b tempest-ExportLocationsNegativeTest-386865252 None] '"/manila/manila-d44fc8f1-83fc-47c3-994f-497e85a3194a", "policy_id": ' May 28 12:56:54 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-837a6446-9037-44ea-98a7-140165b7746b tempest-ExportLocationsNegativeTest-386865252 None] '10, "create_dir": true, "protocols": ["NFS"]}', May 28 12:56:54 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-837a6446-9037-44ea-98a7-140165b7746b tempest-ExportLocationsNegativeTest-386865252 None] 'json': None, May 28 12:56:54 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-837a6446-9037-44ea-98a7-140165b7746b tempest-ExportLocationsNegativeTest-386865252 None] 'params': None} May 28 12:56:55 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ea9bfd84-defc-4007-b796-ab8de4f6c750 tempest-ShareTypesAdminTest-216868925 None] <<< [POST] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:56:55 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ea9bfd84-defc-4007-b796-ab8de4f6c750 tempest-ShareTypesAdminTest-216868925 None] Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=0, created='2024-05-28T12:56:54.595811Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='bf1a1526-4fae-41a2-8eb8-97af4f34870d', id=12, internal=False, is_s3_default_policy=False, name='4e77e600-5df2-4310-91eb-8d6633f53ce4', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=[], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['*'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['*'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T12:56:54.985063Z', tenant_id=1, tenant_name='default', title='4e77e600-5df2-4310-91eb-8d6633f53ce4', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/12/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[]) May 28 12:56:55 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ea9bfd84-defc-4007-b796-ab8de4f6c750 tempest-ShareTypesAdminTest-216868925 None] --- [POST] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 12:56:55 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ea9bfd84-defc-4007-b796-ab8de4f6c750 tempest-ShareTypesAdminTest-216868925 None] >>> [GET] https://127.0.0.1:40443/api/quotas/ May 28 12:56:55 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ea9bfd84-defc-4007-b796-ab8de4f6c750 tempest-ShareTypesAdminTest-216868925 None] {'allow_redirects': True, May 28 12:56:55 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ea9bfd84-defc-4007-b796-ab8de4f6c750 tempest-ShareTypesAdminTest-216868925 None] 'params': {'name': '4e77e600-5df2-4310-91eb-8d6633f53ce4'}} May 28 12:56:55 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-68cfc213-3bbd-40e0-bab5-7c73e970f44c tempest-ShareInstancesNegativeTest-210953919 None] <<< [GET] https://127.0.0.1:40443/api/quotas/ May 28 12:56:55 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-68cfc213-3bbd-40e0-bab5-7c73e970f44c tempest-ShareInstancesNegativeTest-210953919 None] [] May 28 12:56:55 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-68cfc213-3bbd-40e0-bab5-7c73e970f44c tempest-ShareInstancesNegativeTest-210953919 None] --- [GET] https://127.0.0.1:40443/api/quotas/: Done May 28 12:56:55 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-68cfc213-3bbd-40e0-bab5-7c73e970f44c tempest-ShareInstancesNegativeTest-210953919 None] >>> [POST] https://127.0.0.1:40443/api/quotas/ May 28 12:56:55 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-68cfc213-3bbd-40e0-bab5-7c73e970f44c tempest-ShareInstancesNegativeTest-210953919 None] {'data': '{"name": "9b44eaf4-da6e-42e7-8723-ce0cc8878f85", "path": ' May 28 12:56:55 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-68cfc213-3bbd-40e0-bab5-7c73e970f44c tempest-ShareInstancesNegativeTest-210953919 None] '"/manila/manila-9b44eaf4-da6e-42e7-8723-ce0cc8878f85", "create_dir": ' May 28 12:56:55 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-68cfc213-3bbd-40e0-bab5-7c73e970f44c tempest-ShareInstancesNegativeTest-210953919 None] 'true, "hard_limit": 1073741824}', May 28 12:56:55 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-68cfc213-3bbd-40e0-bab5-7c73e970f44c tempest-ShareInstancesNegativeTest-210953919 None] 'json': None, May 28 12:56:55 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-68cfc213-3bbd-40e0-bab5-7c73e970f44c tempest-ShareInstancesNegativeTest-210953919 None] 'params': None} May 28 12:56:55 l75lg1-v1 dstat.sh[49771]: 28-05 12:56:55| 1 0 98 1 0|5667M 1838M 277M 7844M| 18k 3240B| 0 996k| 0 112 |2059 3215 |1.55 0.98 0.98|2.0 0 0| 0 0 | 0 2048M| 29 347 0 56 0 May 28 12:56:55 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ea9bfd84-defc-4007-b796-ab8de4f6c750 tempest-ShareTypesAdminTest-216868925 None] <<< [GET] https://127.0.0.1:40443/api/quotas/ May 28 12:56:55 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ea9bfd84-defc-4007-b796-ab8de4f6c750 tempest-ShareTypesAdminTest-216868925 None] [] May 28 12:56:55 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ea9bfd84-defc-4007-b796-ab8de4f6c750 tempest-ShareTypesAdminTest-216868925 None] --- [GET] https://127.0.0.1:40443/api/quotas/: Done May 28 12:56:55 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ea9bfd84-defc-4007-b796-ab8de4f6c750 tempest-ShareTypesAdminTest-216868925 None] >>> [POST] https://127.0.0.1:40443/api/quotas/ May 28 12:56:55 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ea9bfd84-defc-4007-b796-ab8de4f6c750 tempest-ShareTypesAdminTest-216868925 None] {'data': '{"name": "4e77e600-5df2-4310-91eb-8d6633f53ce4", "path": ' May 28 12:56:55 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ea9bfd84-defc-4007-b796-ab8de4f6c750 tempest-ShareTypesAdminTest-216868925 None] '"/manila/manila-4e77e600-5df2-4310-91eb-8d6633f53ce4", "create_dir": ' May 28 12:56:55 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ea9bfd84-defc-4007-b796-ab8de4f6c750 tempest-ShareTypesAdminTest-216868925 None] 'true, "hard_limit": 1073741824}', May 28 12:56:55 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ea9bfd84-defc-4007-b796-ab8de4f6c750 tempest-ShareTypesAdminTest-216868925 None] 'json': None, May 28 12:56:55 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ea9bfd84-defc-4007-b796-ab8de4f6c750 tempest-ShareTypesAdminTest-216868925 None] 'params': None} May 28 12:56:55 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-828f7ff7-ae15-4608-b548-bfee0a309e65 tempest-AdminActionsTest-1749172189 None] <<< [POST] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:56:55 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-828f7ff7-ae15-4608-b548-bfee0a309e65 tempest-AdminActionsTest-1749172189 None] Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=0, created='2024-05-28T12:56:55.010324Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='78ebe432-5e30-44de-a9b6-ff1e3ef31f8c', id=13, internal=False, is_s3_default_policy=False, name='4016fe10-12f4-48fc-92de-42cdd2fff998', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=[], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['*'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['*'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T12:56:55.390912Z', tenant_id=1, tenant_name='default', title='4016fe10-12f4-48fc-92de-42cdd2fff998', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/13/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[]) May 28 12:56:55 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-828f7ff7-ae15-4608-b548-bfee0a309e65 tempest-AdminActionsTest-1749172189 None] --- [POST] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 12:56:55 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-828f7ff7-ae15-4608-b548-bfee0a309e65 tempest-AdminActionsTest-1749172189 None] >>> [GET] https://127.0.0.1:40443/api/quotas/ May 28 12:56:55 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-828f7ff7-ae15-4608-b548-bfee0a309e65 tempest-AdminActionsTest-1749172189 None] {'allow_redirects': True, May 28 12:56:55 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-828f7ff7-ae15-4608-b548-bfee0a309e65 tempest-AdminActionsTest-1749172189 None] 'params': {'name': '4016fe10-12f4-48fc-92de-42cdd2fff998'}} May 28 12:56:55 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-e1e39516-1969-49b5-83e1-6484c20404f8 tempest-ShareInstancesNegativeTest-210953919 tempest-ShareInstancesNegativeTest-210953919-project-admin] GET http://10.27.203.238/share/v2/bb8f0d37fc204d24b8146108f63a1922/shares/6b055a82-f6ad-4af2-8b38-137b3cc99cc1 May 28 12:56:55 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-e1e39516-1969-49b5-83e1-6484c20404f8 tempest-ShareInstancesNegativeTest-210953919 tempest-ShareInstancesNegativeTest-210953919-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:55 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-e1e39516-1969-49b5-83e1-6484c20404f8 tempest-ShareInstancesNegativeTest-210953919 tempest-ShareInstancesNegativeTest-210953919-project-admin] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:55 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-837a6446-9037-44ea-98a7-140165b7746b tempest-ExportLocationsNegativeTest-386865252 None] <<< [POST] https://127.0.0.1:40443/api/views/ May 28 12:56:55 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-837a6446-9037-44ea-98a7-140165b7746b tempest-ExportLocationsNegativeTest-386865252 None] Bunch(abac_tags=[], abe_max_depth=None, abe_protocols=[], alias='', allow_anonymous_access=False, allow_s3_anonymous_access=False, auto_commit='0d', bucket='', bucket_creators=[], bucket_creators_groups=[], bucket_owner=None, bulk_permission_update_progress=None, bulk_permission_update_state=None, cluster='loop75-kfs', cluster_id=1, created='2024-05-28T12:56:55.357006Z', enabled=True, files_retention_mode='NONE', guid='f0ad949b-c006-4bb9-9c2d-f5b7349265c1', id=9, ignore_oos=False, internal=False, is_remote=False, is_seamless=False, logical_capacity=0, max_retention_period=None, min_retention_period=None, name='d44fc8f1-83fc-47c3-994f-497e85a3194a', nfs_interop_flags='BOTH_NFS3_AND_NFS4_INTEROP_DISABLED', path='/manila/manila-d44fc8f1-83fc-47c3-994f-497e85a3194a', physical_capacity=0, policy='d44fc8f1-83fc-47c3-994f-497e85a3194a', policy_id=10, protocols=['NFS'], qos_policy=None, qos_policy_id=None, s3_locks=False, s3_locks_retention_mode='NONE', s3_locks_retention_period='', s3_object_ownership_rule='ObjectWriter', s3_unverified_lookup=False, s3_versioning=False, select_for_live_monitoring=False, share='', share_acl=Bunch(acl=[], enabled=False), sync='SYNCED', sync_time='2024-05-28T12:56:55.654658Z', tenant_id=1, tenant_name='default', title='/manila/manila-d44fc8f1-83fc-47c3-994f-497e85a3194a', url='https://127.0.0.1:40443/api/views/9/') May 28 12:56:55 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-837a6446-9037-44ea-98a7-140165b7746b tempest-ExportLocationsNegativeTest-386865252 None] --- [POST] https://127.0.0.1:40443/api/views/: Done May 28 12:56:55 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-e1e39516-1969-49b5-83e1-6484c20404f8 tempest-ShareInstancesNegativeTest-210953919 tempest-ShareInstancesNegativeTest-210953919-project-admin] http://10.27.203.238/share/v2/bb8f0d37fc204d24b8146108f63a1922/shares/6b055a82-f6ad-4af2-8b38-137b3cc99cc1 returned with HTTP 200 May 28 12:56:55 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 149/289] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:56:55 2024] GET /share/v2/bb8f0d37fc204d24b8146108f63a1922/shares/6b055a82-f6ad-4af2-8b38-137b3cc99cc1 => generated 1368 bytes in 25 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:56:55 l75lg1-v1 manila-share[98474]: INFO manila.share.manager [None req-837a6446-9037-44ea-98a7-140165b7746b tempest-ExportLocationsNegativeTest-386865252 None] Share instance d44fc8f1-83fc-47c3-994f-497e85a3194a created successfully. May 28 12:56:55 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-828f7ff7-ae15-4608-b548-bfee0a309e65 tempest-AdminActionsTest-1749172189 None] <<< [GET] https://127.0.0.1:40443/api/quotas/ May 28 12:56:55 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-828f7ff7-ae15-4608-b548-bfee0a309e65 tempest-AdminActionsTest-1749172189 None] [] May 28 12:56:55 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-828f7ff7-ae15-4608-b548-bfee0a309e65 tempest-AdminActionsTest-1749172189 None] --- [GET] https://127.0.0.1:40443/api/quotas/: Done May 28 12:56:55 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-828f7ff7-ae15-4608-b548-bfee0a309e65 tempest-AdminActionsTest-1749172189 None] >>> [POST] https://127.0.0.1:40443/api/quotas/ May 28 12:56:55 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-828f7ff7-ae15-4608-b548-bfee0a309e65 tempest-AdminActionsTest-1749172189 None] {'data': '{"name": "4016fe10-12f4-48fc-92de-42cdd2fff998", "path": ' May 28 12:56:55 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-828f7ff7-ae15-4608-b548-bfee0a309e65 tempest-AdminActionsTest-1749172189 None] '"/manila/manila-4016fe10-12f4-48fc-92de-42cdd2fff998", "create_dir": ' May 28 12:56:55 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-828f7ff7-ae15-4608-b548-bfee0a309e65 tempest-AdminActionsTest-1749172189 None] 'true, "hard_limit": 1073741824}', May 28 12:56:55 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-828f7ff7-ae15-4608-b548-bfee0a309e65 tempest-AdminActionsTest-1749172189 None] 'json': None, May 28 12:56:55 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-828f7ff7-ae15-4608-b548-bfee0a309e65 tempest-AdminActionsTest-1749172189 None] 'params': None} May 28 12:56:56 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-cd2e9e11-f7e2-43fb-a7c0-6470a2d67401 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] GET http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/shares/8e00d6e4-a018-4e71-b71c-831e546cb6e6 May 28 12:56:56 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-cd2e9e11-f7e2-43fb-a7c0-6470a2d67401 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:56 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-cd2e9e11-f7e2-43fb-a7c0-6470a2d67401 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:56 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-cd2e9e11-f7e2-43fb-a7c0-6470a2d67401 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/shares/8e00d6e4-a018-4e71-b71c-831e546cb6e6 returned with HTTP 200 May 28 12:56:56 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 141/290] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:56:56 2024] GET /share/v2/35d84ed7cf164123a87b8b906a836985/shares/8e00d6e4-a018-4e71-b71c-831e546cb6e6 => generated 1345 bytes in 30 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:56:56 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-8d850c15-950b-4cbf-8042-84e57904bad2 tempest-AccessRulesMetadataTest-1973590610 tempest-AccessRulesMetadataTest-1973590610-project-member] GET http://10.27.203.238/share/v2/1643901550e140118fc2d2e92b82cd0b/share-access-rules?share_id=b92fc06b-76d7-40f9-adef-74a07ace1027 May 28 12:56:56 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-8d850c15-950b-4cbf-8042-84e57904bad2 tempest-AccessRulesMetadataTest-1973590610 tempest-AccessRulesMetadataTest-1973590610-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:56 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-8d850c15-950b-4cbf-8042-84e57904bad2 tempest-AccessRulesMetadataTest-1973590610 tempest-AccessRulesMetadataTest-1973590610-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:56 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.lock.api [None req-8d850c15-950b-4cbf-8042-84e57904bad2 tempest-AccessRulesMetadataTest-1973590610 tempest-AccessRulesMetadataTest-1973590610-project-member] Searching for locks by: {'resource_id': '065fb8ea-fc05-4af3-b191-603cca79c74e', 'resource_action': 'show', 'resource_type': 'access_rule'} {{(pid=98329) get_all /opt/stack/manila/manila/lock/api.py:112}} May 28 12:56:56 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-8d850c15-950b-4cbf-8042-84e57904bad2 tempest-AccessRulesMetadataTest-1973590610 tempest-AccessRulesMetadataTest-1973590610-project-member] http://10.27.203.238/share/v2/1643901550e140118fc2d2e92b82cd0b/share-access-rules?share_id=b92fc06b-76d7-40f9-adef-74a07ace1027 returned with HTTP 200 May 28 12:56:56 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 150/291] 10.27.203.238 () {64 vars in 1467 bytes} [Tue May 28 12:56:56 2024] GET /share/v2/1643901550e140118fc2d2e92b82cd0b/share-access-rules?share_id=b92fc06b-76d7-40f9-adef-74a07ace1027 => generated 340 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:56:56 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-2dbf5575-1440-4c4f-9084-d4af8ef4489b tempest-AccessRulesMetadataTest-1973590610 tempest-AccessRulesMetadataTest-1973590610-project-member] POST http://10.27.203.238/share/v2/1643901550e140118fc2d2e92b82cd0b/shares/b92fc06b-76d7-40f9-adef-74a07ace1027/action May 28 12:56:56 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-2dbf5575-1440-4c4f-9084-d4af8ef4489b tempest-AccessRulesMetadataTest-1973590610 tempest-AccessRulesMetadataTest-1973590610-project-member] Action body: b'{"allow_access": {"access_type": "ip", "access_to": "2001:0DB8:39ea:8bcd:c460:d167:364b:4410", "access_level": "rw", "metadata": {"key1": "vvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvv", "kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "value2"}}}' {{(pid=98330) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:56:56 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-2dbf5575-1440-4c4f-9084-d4af8ef4489b tempest-AccessRulesMetadataTest-1973590610 tempest-AccessRulesMetadataTest-1973590610-project-member] Action: 'action', calling method: ShareController.allow_access, body: {"allow_access": {"access_type": "ip", "access_to": "2001:0DB8:39ea:8bcd:c460:d167:364b:4410", "access_level": "rw", "metadata": {"key1": "vvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvv", "kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "value2"}}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:56:56 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-68cfc213-3bbd-40e0-bab5-7c73e970f44c tempest-ShareInstancesNegativeTest-210953919 None] <<< [POST] https://127.0.0.1:40443/api/quotas/ May 28 12:56:56 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-68cfc213-3bbd-40e0-bab5-7c73e970f44c tempest-ShareInstancesNegativeTest-210953919 None] Bunch(cluster='loop75-kfs', cluster_id=1, default_email=None, default_group_quota=None, default_user_quota=None, enable_alarms=True, enable_email_providers=True, grace_period=None, group_quotas=[], guid='07db6d5a-b377-40cb-a98c-08b240f266f1', hard_limit=1073741824, hard_limit_inodes=None, id=8, internal=False, is_user_quota=False, last_user_quotas_update=None, name='9b44eaf4-da6e-42e7-8723-ce0cc8878f85', num_blocked_users=0, num_exceeded_users=0, path='/manila/manila-9b44eaf4-da6e-42e7-8723-ce0cc8878f85', percent_capacity=0, percent_inodes=None, pretty_grace_period=None, pretty_grace_period_expiration=None, pretty_state='OK (CREATED)', soft_limit=None, soft_limit_inodes=None, state='OK', sync_state='CREATED', system_id=8, tenant_id=1, tenant_name='default', time_to_block=None, title='9b44eaf4-da6e-42e7-8723-ce0cc8878f85', url='https://127.0.0.1:40443/api/quotas/8/', used_capacity=0, used_capacity_tb=0.0, used_effective_capacity=0, used_effective_capacity_tb=0.0, used_inodes=0, used_limited_capacity=0, user_quotas=[]) May 28 12:56:56 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-68cfc213-3bbd-40e0-bab5-7c73e970f44c tempest-ShareInstancesNegativeTest-210953919 None] --- [POST] https://127.0.0.1:40443/api/quotas/: Done May 28 12:56:56 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-68cfc213-3bbd-40e0-bab5-7c73e970f44c tempest-ShareInstancesNegativeTest-210953919 None] >>> [GET] https://127.0.0.1:40443/api/views/ May 28 12:56:56 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-68cfc213-3bbd-40e0-bab5-7c73e970f44c tempest-ShareInstancesNegativeTest-210953919 None] {'allow_redirects': True, May 28 12:56:56 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-68cfc213-3bbd-40e0-bab5-7c73e970f44c tempest-ShareInstancesNegativeTest-210953919 None] 'params': {'name': '9b44eaf4-da6e-42e7-8723-ce0cc8878f85'}} May 28 12:56:56 l75lg1-v1 dstat.sh[49771]: 28-05 12:56:56| 3 0 96 1 0|5666M 1838M 277M 7844M| 20k 7110B| 0 572k| 0 53.0 |2451 3943 |1.55 0.98 0.98|1.0 1.0 0| 0 0 | 0 2048M| 29 348 0 55 0 May 28 12:56:56 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-2dbf5575-1440-4c4f-9084-d4af8ef4489b tempest-AccessRulesMetadataTest-1973590610 tempest-AccessRulesMetadataTest-1973590610-project-member] Acquiring lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:56:56 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-2dbf5575-1440-4c4f-9084-d4af8ef4489b tempest-AccessRulesMetadataTest-1973590610 tempest-AccessRulesMetadataTest-1973590610-project-member] Lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:56:56 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-2dbf5575-1440-4c4f-9084-d4af8ef4489b tempest-AccessRulesMetadataTest-1973590610 tempest-AccessRulesMetadataTest-1973590610-project-member] Lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.046s {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:56:56 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-2dbf5575-1440-4c4f-9084-d4af8ef4489b tempest-AccessRulesMetadataTest-1973590610 tempest-AccessRulesMetadataTest-1973590610-project-member] http://10.27.203.238/share/v2/1643901550e140118fc2d2e92b82cd0b/shares/b92fc06b-76d7-40f9-adef-74a07ace1027/action returned with HTTP 200 May 28 12:56:56 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 142/292] 10.27.203.238 () {66 vars in 1494 bytes} [Tue May 28 12:56:56 2024] POST /share/v2/1643901550e140118fc2d2e92b82cd0b/shares/b92fc06b-76d7-40f9-adef-74a07ace1027/action => generated 871 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:56:56 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-85a97a1f-1875-490a-831b-cab3767b5a4f tempest-AccessRulesMetadataTest-1973590610 tempest-AccessRulesMetadataTest-1973590610-project-member] GET http://10.27.203.238/share/v2/1643901550e140118fc2d2e92b82cd0b/share-access-rules?share_id=b92fc06b-76d7-40f9-adef-74a07ace1027 May 28 12:56:56 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-85a97a1f-1875-490a-831b-cab3767b5a4f tempest-AccessRulesMetadataTest-1973590610 tempest-AccessRulesMetadataTest-1973590610-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:56 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-85a97a1f-1875-490a-831b-cab3767b5a4f tempest-AccessRulesMetadataTest-1973590610 tempest-AccessRulesMetadataTest-1973590610-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:56 l75lg1-v1 manila-share[98474]: DEBUG manila.share.manager [None req-2dbf5575-1440-4c4f-9084-d4af8ef4489b tempest-AccessRulesMetadataTest-1973590610 None] Received request to update access for share instance 95118a75-173c-4257-acef-78a246ee1c67. {{(pid=98474) update_access_for_instances /opt/stack/manila/manila/share/manager.py:4353}} May 28 12:56:56 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-2dbf5575-1440-4c4f-9084-d4af8ef4489b tempest-AccessRulesMetadataTest-1973590610 None] Acquiring lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:56:56 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-2dbf5575-1440-4c4f-9084-d4af8ef4489b tempest-AccessRulesMetadataTest-1973590610 None] Lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:56:56 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-2dbf5575-1440-4c4f-9084-d4af8ef4489b tempest-AccessRulesMetadataTest-1973590610 None] Lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:56:56 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-2dbf5575-1440-4c4f-9084-d4af8ef4489b tempest-AccessRulesMetadataTest-1973590610 None] Acquiring lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:56:56 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-2dbf5575-1440-4c4f-9084-d4af8ef4489b tempest-AccessRulesMetadataTest-1973590610 None] Lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:56:56 l75lg1-v1 neutron-server[77623]: DEBUG neutron.db.agents_db [None req-fe40ce8c-640e-4db7-a17a-6e8888cce266 None None] Agent healthcheck: found 0 active agents {{(pid=77623) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:319}} May 28 12:56:56 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.lock.api [None req-85a97a1f-1875-490a-831b-cab3767b5a4f tempest-AccessRulesMetadataTest-1973590610 tempest-AccessRulesMetadataTest-1973590610-project-member] Searching for locks by: {'resource_id': '065fb8ea-fc05-4af3-b191-603cca79c74e', 'resource_action': 'show', 'resource_type': 'access_rule'} {{(pid=98329) get_all /opt/stack/manila/manila/lock/api.py:112}} May 28 12:56:56 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.lock.api [None req-85a97a1f-1875-490a-831b-cab3767b5a4f tempest-AccessRulesMetadataTest-1973590610 tempest-AccessRulesMetadataTest-1973590610-project-member] Searching for locks by: {'resource_id': 'f4507547-5ed1-4027-b15a-ba64f3ba185c', 'resource_action': 'show', 'resource_type': 'access_rule'} {{(pid=98329) get_all /opt/stack/manila/manila/lock/api.py:112}} May 28 12:56:56 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-85a97a1f-1875-490a-831b-cab3767b5a4f tempest-AccessRulesMetadataTest-1973590610 tempest-AccessRulesMetadataTest-1973590610-project-member] http://10.27.203.238/share/v2/1643901550e140118fc2d2e92b82cd0b/share-access-rules?share_id=b92fc06b-76d7-40f9-adef-74a07ace1027 returned with HTTP 200 May 28 12:56:56 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 151/293] 10.27.203.238 () {64 vars in 1467 bytes} [Tue May 28 12:56:56 2024] GET /share/v2/1643901550e140118fc2d2e92b82cd0b/share-access-rules?share_id=b92fc06b-76d7-40f9-adef-74a07ace1027 => generated 1149 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:56:56 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ea9bfd84-defc-4007-b796-ab8de4f6c750 tempest-ShareTypesAdminTest-216868925 None] <<< [POST] https://127.0.0.1:40443/api/quotas/ May 28 12:56:56 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ea9bfd84-defc-4007-b796-ab8de4f6c750 tempest-ShareTypesAdminTest-216868925 None] Bunch(cluster='loop75-kfs', cluster_id=1, default_email=None, default_group_quota=None, default_user_quota=None, enable_alarms=True, enable_email_providers=True, grace_period=None, group_quotas=[], guid='fdaf6eb3-4ce8-4ae5-ba94-f99eaf956a7a', hard_limit=1073741824, hard_limit_inodes=None, id=9, internal=False, is_user_quota=False, last_user_quotas_update=None, name='4e77e600-5df2-4310-91eb-8d6633f53ce4', num_blocked_users=0, num_exceeded_users=0, path='/manila/manila-4e77e600-5df2-4310-91eb-8d6633f53ce4', percent_capacity=0, percent_inodes=None, pretty_grace_period=None, pretty_grace_period_expiration=None, pretty_state='OK (CREATED)', soft_limit=None, soft_limit_inodes=None, state='OK', sync_state='CREATED', system_id=9, tenant_id=1, tenant_name='default', time_to_block=None, title='4e77e600-5df2-4310-91eb-8d6633f53ce4', url='https://127.0.0.1:40443/api/quotas/9/', used_capacity=0, used_capacity_tb=0.0, used_effective_capacity=0, used_effective_capacity_tb=0.0, used_inodes=0, used_limited_capacity=0, user_quotas=[]) May 28 12:56:56 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ea9bfd84-defc-4007-b796-ab8de4f6c750 tempest-ShareTypesAdminTest-216868925 None] --- [POST] https://127.0.0.1:40443/api/quotas/: Done May 28 12:56:56 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ea9bfd84-defc-4007-b796-ab8de4f6c750 tempest-ShareTypesAdminTest-216868925 None] >>> [GET] https://127.0.0.1:40443/api/views/ May 28 12:56:56 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ea9bfd84-defc-4007-b796-ab8de4f6c750 tempest-ShareTypesAdminTest-216868925 None] {'allow_redirects': True, May 28 12:56:56 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ea9bfd84-defc-4007-b796-ab8de4f6c750 tempest-ShareTypesAdminTest-216868925 None] 'params': {'name': '4e77e600-5df2-4310-91eb-8d6633f53ce4'}} May 28 12:56:56 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-2dbf5575-1440-4c4f-9084-d4af8ef4489b tempest-AccessRulesMetadataTest-1973590610 None] Lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.064s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:56:56 l75lg1-v1 manila-share[98474]: DEBUG manila.share.access [None req-2dbf5575-1440-4c4f-9084-d4af8ef4489b tempest-AccessRulesMetadataTest-1973590610 None] Updating access rules for share instance 95118a75-173c-4257-acef-78a246ee1c67 belonging to share b92fc06b-76d7-40f9-adef-74a07ace1027. {{(pid=98474) update_access_rules /opt/stack/manila/manila/share/access.py:298}} May 28 12:56:56 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-2dbf5575-1440-4c4f-9084-d4af8ef4489b tempest-AccessRulesMetadataTest-1973590610 None] Acquiring lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:56:56 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-2dbf5575-1440-4c4f-9084-d4af8ef4489b tempest-AccessRulesMetadataTest-1973590610 None] Lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:56:56 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-2dbf5575-1440-4c4f-9084-d4af8ef4489b tempest-AccessRulesMetadataTest-1973590610 None] Lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.007s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:56:56 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-2dbf5575-1440-4c4f-9084-d4af8ef4489b tempest-AccessRulesMetadataTest-1973590610 None] Acquiring lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:56:56 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-2dbf5575-1440-4c4f-9084-d4af8ef4489b tempest-AccessRulesMetadataTest-1973590610 None] Lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:56:56 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-2dbf5575-1440-4c4f-9084-d4af8ef4489b tempest-AccessRulesMetadataTest-1973590610 None] Lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.027s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:56:56 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-2dbf5575-1440-4c4f-9084-d4af8ef4489b tempest-AccessRulesMetadataTest-1973590610 None] changing access on None May 28 12:56:56 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2dbf5575-1440-4c4f-9084-d4af8ef4489b tempest-AccessRulesMetadataTest-1973590610 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:56:56 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2dbf5575-1440-4c4f-9084-d4af8ef4489b tempest-AccessRulesMetadataTest-1973590610 None] {'allow_redirects': True, May 28 12:56:56 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2dbf5575-1440-4c4f-9084-d4af8ef4489b tempest-AccessRulesMetadataTest-1973590610 None] 'params': {'name': '95118a75-173c-4257-acef-78a246ee1c67'}} May 28 12:56:56 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-4ccf6fc0-0169-4532-beec-53bed06950f7 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] GET http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/shares/9be3b244-34ab-4002-b1e1-427af2ab8545 May 28 12:56:56 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-4ccf6fc0-0169-4532-beec-53bed06950f7 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:56 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-4ccf6fc0-0169-4532-beec-53bed06950f7 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:56 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-4ccf6fc0-0169-4532-beec-53bed06950f7 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/shares/9be3b244-34ab-4002-b1e1-427af2ab8545 returned with HTTP 200 May 28 12:56:56 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 143/294] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:56:56 2024] GET /share/v2/a3499cb78849424db45e54caac01de92/shares/9be3b244-34ab-4002-b1e1-427af2ab8545 => generated 1369 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:56:56 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-68cfc213-3bbd-40e0-bab5-7c73e970f44c tempest-ShareInstancesNegativeTest-210953919 None] <<< [GET] https://127.0.0.1:40443/api/views/ May 28 12:56:56 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-68cfc213-3bbd-40e0-bab5-7c73e970f44c tempest-ShareInstancesNegativeTest-210953919 None] [] May 28 12:56:56 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-68cfc213-3bbd-40e0-bab5-7c73e970f44c tempest-ShareInstancesNegativeTest-210953919 None] --- [GET] https://127.0.0.1:40443/api/views/: Done May 28 12:56:56 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-68cfc213-3bbd-40e0-bab5-7c73e970f44c tempest-ShareInstancesNegativeTest-210953919 None] >>> [POST] https://127.0.0.1:40443/api/views/ May 28 12:56:56 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-68cfc213-3bbd-40e0-bab5-7c73e970f44c tempest-ShareInstancesNegativeTest-210953919 None] {'data': '{"name": "9b44eaf4-da6e-42e7-8723-ce0cc8878f85", "path": ' May 28 12:56:56 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-68cfc213-3bbd-40e0-bab5-7c73e970f44c tempest-ShareInstancesNegativeTest-210953919 None] '"/manila/manila-9b44eaf4-da6e-42e7-8723-ce0cc8878f85", "policy_id": ' May 28 12:56:56 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-68cfc213-3bbd-40e0-bab5-7c73e970f44c tempest-ShareInstancesNegativeTest-210953919 None] '11, "create_dir": true, "protocols": ["NFS"]}', May 28 12:56:56 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-68cfc213-3bbd-40e0-bab5-7c73e970f44c tempest-ShareInstancesNegativeTest-210953919 None] 'json': None, May 28 12:56:56 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-68cfc213-3bbd-40e0-bab5-7c73e970f44c tempest-ShareInstancesNegativeTest-210953919 None] 'params': None} May 28 12:56:56 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-828f7ff7-ae15-4608-b548-bfee0a309e65 tempest-AdminActionsTest-1749172189 None] <<< [POST] https://127.0.0.1:40443/api/quotas/ May 28 12:56:56 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-828f7ff7-ae15-4608-b548-bfee0a309e65 tempest-AdminActionsTest-1749172189 None] Bunch(cluster='loop75-kfs', cluster_id=1, default_email=None, default_group_quota=None, default_user_quota=None, enable_alarms=True, enable_email_providers=True, grace_period=None, group_quotas=[], guid='0a264a9b-c035-496c-8ef1-e9dd1076d22c', hard_limit=1073741824, hard_limit_inodes=None, id=10, internal=False, is_user_quota=False, last_user_quotas_update=None, name='4016fe10-12f4-48fc-92de-42cdd2fff998', num_blocked_users=0, num_exceeded_users=0, path='/manila/manila-4016fe10-12f4-48fc-92de-42cdd2fff998', percent_capacity=0, percent_inodes=None, pretty_grace_period=None, pretty_grace_period_expiration=None, pretty_state='OK (CREATED)', soft_limit=None, soft_limit_inodes=None, state='OK', sync_state='CREATED', system_id=10, tenant_id=1, tenant_name='default', time_to_block=None, title='4016fe10-12f4-48fc-92de-42cdd2fff998', url='https://127.0.0.1:40443/api/quotas/10/', used_capacity=0, used_capacity_tb=0.0, used_effective_capacity=0, used_effective_capacity_tb=0.0, used_inodes=0, used_limited_capacity=0, user_quotas=[]) May 28 12:56:56 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-828f7ff7-ae15-4608-b548-bfee0a309e65 tempest-AdminActionsTest-1749172189 None] --- [POST] https://127.0.0.1:40443/api/quotas/: Done May 28 12:56:56 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-828f7ff7-ae15-4608-b548-bfee0a309e65 tempest-AdminActionsTest-1749172189 None] >>> [GET] https://127.0.0.1:40443/api/views/ May 28 12:56:56 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-828f7ff7-ae15-4608-b548-bfee0a309e65 tempest-AdminActionsTest-1749172189 None] {'allow_redirects': True, May 28 12:56:56 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-828f7ff7-ae15-4608-b548-bfee0a309e65 tempest-AdminActionsTest-1749172189 None] 'params': {'name': '4016fe10-12f4-48fc-92de-42cdd2fff998'}} May 28 12:56:56 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ea9bfd84-defc-4007-b796-ab8de4f6c750 tempest-ShareTypesAdminTest-216868925 None] <<< [GET] https://127.0.0.1:40443/api/views/ May 28 12:56:56 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ea9bfd84-defc-4007-b796-ab8de4f6c750 tempest-ShareTypesAdminTest-216868925 None] [] May 28 12:56:56 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ea9bfd84-defc-4007-b796-ab8de4f6c750 tempest-ShareTypesAdminTest-216868925 None] --- [GET] https://127.0.0.1:40443/api/views/: Done May 28 12:56:56 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ea9bfd84-defc-4007-b796-ab8de4f6c750 tempest-ShareTypesAdminTest-216868925 None] >>> [POST] https://127.0.0.1:40443/api/views/ May 28 12:56:56 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ea9bfd84-defc-4007-b796-ab8de4f6c750 tempest-ShareTypesAdminTest-216868925 None] {'data': '{"name": "4e77e600-5df2-4310-91eb-8d6633f53ce4", "path": ' May 28 12:56:56 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ea9bfd84-defc-4007-b796-ab8de4f6c750 tempest-ShareTypesAdminTest-216868925 None] '"/manila/manila-4e77e600-5df2-4310-91eb-8d6633f53ce4", "policy_id": ' May 28 12:56:56 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ea9bfd84-defc-4007-b796-ab8de4f6c750 tempest-ShareTypesAdminTest-216868925 None] '12, "create_dir": true, "protocols": ["NFS"]}', May 28 12:56:56 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ea9bfd84-defc-4007-b796-ab8de4f6c750 tempest-ShareTypesAdminTest-216868925 None] 'json': None, May 28 12:56:56 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ea9bfd84-defc-4007-b796-ab8de4f6c750 tempest-ShareTypesAdminTest-216868925 None] 'params': None} May 28 12:56:57 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2dbf5575-1440-4c4f-9084-d4af8ef4489b tempest-AccessRulesMetadataTest-1973590610 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:56:57 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2dbf5575-1440-4c4f-9084-d4af8ef4489b tempest-AccessRulesMetadataTest-1973590610 None] [Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=1, created='2024-05-28T12:56:41.381687Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='8ed5f8f5-e848-431c-be27-16f1fa370a60', id=9, internal=False, is_s3_default_policy=False, name='95118a75-173c-4257-acef-78a246ee1c67', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=[], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['*'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['*'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T12:56:41.744950Z', tenant_id=1, tenant_name='default', title='95118a75-173c-4257-acef-78a246ee1c67', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/9/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[])] May 28 12:56:57 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2dbf5575-1440-4c4f-9084-d4af8ef4489b tempest-AccessRulesMetadataTest-1973590610 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 12:56:57 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-2dbf5575-1440-4c4f-9084-d4af8ef4489b tempest-AccessRulesMetadataTest-1973590610 None] Acquiring lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:56:57 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-2dbf5575-1440-4c4f-9084-d4af8ef4489b tempest-AccessRulesMetadataTest-1973590610 None] Lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:56:57 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-fae98faa-23a7-4a6a-839b-0376ab49f632 tempest-ExportLocationsNegativeTest-386865252 tempest-ExportLocationsNegativeTest-386865252-project-admin] GET http://10.27.203.238/share/v2/df93a973373644ccaf8ecf54774a4ced/shares/543531db-0529-42ad-9ae8-5e3dff98a2a5 May 28 12:56:57 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-fae98faa-23a7-4a6a-839b-0376ab49f632 tempest-ExportLocationsNegativeTest-386865252 tempest-ExportLocationsNegativeTest-386865252-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:57 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-fae98faa-23a7-4a6a-839b-0376ab49f632 tempest-ExportLocationsNegativeTest-386865252 tempest-ExportLocationsNegativeTest-386865252-project-admin] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:57 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-fae98faa-23a7-4a6a-839b-0376ab49f632 tempest-ExportLocationsNegativeTest-386865252 tempest-ExportLocationsNegativeTest-386865252-project-admin] http://10.27.203.238/share/v2/df93a973373644ccaf8ecf54774a4ced/shares/543531db-0529-42ad-9ae8-5e3dff98a2a5 returned with HTTP 200 May 28 12:56:57 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 152/295] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:56:57 2024] GET /share/v2/df93a973373644ccaf8ecf54774a4ced/shares/543531db-0529-42ad-9ae8-5e3dff98a2a5 => generated 1375 bytes in 24 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:56:57 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-95e64fbe-7215-47d4-b436-21027664bde3 tempest-ExportLocationsNegativeTest-386865252 tempest-ExportLocationsNegativeTest-386865252-project-admin] GET http://10.27.203.238/share/v2/df93a973373644ccaf8ecf54774a4ced/shares/543531db-0529-42ad-9ae8-5e3dff98a2a5 May 28 12:56:57 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-95e64fbe-7215-47d4-b436-21027664bde3 tempest-ExportLocationsNegativeTest-386865252 tempest-ExportLocationsNegativeTest-386865252-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:57 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-95e64fbe-7215-47d4-b436-21027664bde3 tempest-ExportLocationsNegativeTest-386865252 tempest-ExportLocationsNegativeTest-386865252-project-admin] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:57 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-2dbf5575-1440-4c4f-9084-d4af8ef4489b tempest-AccessRulesMetadataTest-1973590610 None] Lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.083s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:56:57 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-2dbf5575-1440-4c4f-9084-d4af8ef4489b tempest-AccessRulesMetadataTest-1973590610 None] Acquiring lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:56:57 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-2dbf5575-1440-4c4f-9084-d4af8ef4489b tempest-AccessRulesMetadataTest-1973590610 None] Lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:56:57 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-2dbf5575-1440-4c4f-9084-d4af8ef4489b tempest-AccessRulesMetadataTest-1973590610 None] Lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:56:57 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-2dbf5575-1440-4c4f-9084-d4af8ef4489b tempest-AccessRulesMetadataTest-1973590610 None] Acquiring lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:56:57 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-2dbf5575-1440-4c4f-9084-d4af8ef4489b tempest-AccessRulesMetadataTest-1973590610 None] Lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:56:57 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-2dbf5575-1440-4c4f-9084-d4af8ef4489b tempest-AccessRulesMetadataTest-1973590610 None] Lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:56:57 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-2dbf5575-1440-4c4f-9084-d4af8ef4489b tempest-AccessRulesMetadataTest-1973590610 None] Acquiring lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:56:57 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-95e64fbe-7215-47d4-b436-21027664bde3 tempest-ExportLocationsNegativeTest-386865252 tempest-ExportLocationsNegativeTest-386865252-project-admin] http://10.27.203.238/share/v2/df93a973373644ccaf8ecf54774a4ced/shares/543531db-0529-42ad-9ae8-5e3dff98a2a5 returned with HTTP 200 May 28 12:56:57 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-2dbf5575-1440-4c4f-9084-d4af8ef4489b tempest-AccessRulesMetadataTest-1973590610 None] Lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:56:57 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 144/296] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:56:57 2024] GET /share/v2/df93a973373644ccaf8ecf54774a4ced/shares/543531db-0529-42ad-9ae8-5e3dff98a2a5 => generated 1375 bytes in 24 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:56:57 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-2dbf5575-1440-4c4f-9084-d4af8ef4489b tempest-AccessRulesMetadataTest-1973590610 None] Lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:56:57 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-2dbf5575-1440-4c4f-9084-d4af8ef4489b tempest-AccessRulesMetadataTest-1973590610 None] Acquiring lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:56:57 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-2dbf5575-1440-4c4f-9084-d4af8ef4489b tempest-AccessRulesMetadataTest-1973590610 None] Lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:56:57 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-51501a31-d865-4b3d-8cb3-468a467cbcf4 tempest-ExportLocationsNegativeTest-386865252 tempest-ExportLocationsNegativeTest-386865252-project-admin] GET http://10.27.203.238/share/v2/df93a973373644ccaf8ecf54774a4ced/shares/543531db-0529-42ad-9ae8-5e3dff98a2a5/instances May 28 12:56:57 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-51501a31-d865-4b3d-8cb3-468a467cbcf4 tempest-ExportLocationsNegativeTest-386865252 tempest-ExportLocationsNegativeTest-386865252-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:57 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-51501a31-d865-4b3d-8cb3-468a467cbcf4 tempest-ExportLocationsNegativeTest-386865252 tempest-ExportLocationsNegativeTest-386865252-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:57 l75lg1-v1 dstat.sh[49771]: 28-05 12:56:57| 6 1 91 2 0|5667M 1837M 277M 7844M| 29k 3888B| 0 2366k| 0 197 |3890 6495 |1.42 0.96 0.98|3.0 0 0| 0 0 | 0 2048M| 29 348 0 55 0 May 28 12:56:57 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-828f7ff7-ae15-4608-b548-bfee0a309e65 tempest-AdminActionsTest-1749172189 None] <<< [GET] https://127.0.0.1:40443/api/views/ May 28 12:56:57 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-828f7ff7-ae15-4608-b548-bfee0a309e65 tempest-AdminActionsTest-1749172189 None] [] May 28 12:56:57 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-828f7ff7-ae15-4608-b548-bfee0a309e65 tempest-AdminActionsTest-1749172189 None] --- [GET] https://127.0.0.1:40443/api/views/: Done May 28 12:56:57 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-51501a31-d865-4b3d-8cb3-468a467cbcf4 tempest-ExportLocationsNegativeTest-386865252 tempest-ExportLocationsNegativeTest-386865252-project-admin] http://10.27.203.238/share/v2/df93a973373644ccaf8ecf54774a4ced/shares/543531db-0529-42ad-9ae8-5e3dff98a2a5/instances returned with HTTP 200 May 28 12:56:57 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-828f7ff7-ae15-4608-b548-bfee0a309e65 tempest-AdminActionsTest-1749172189 None] >>> [POST] https://127.0.0.1:40443/api/views/ May 28 12:56:57 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-828f7ff7-ae15-4608-b548-bfee0a309e65 tempest-AdminActionsTest-1749172189 None] {'data': '{"name": "4016fe10-12f4-48fc-92de-42cdd2fff998", "path": ' May 28 12:56:57 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 153/297] 10.27.203.238 () {64 vars in 1481 bytes} [Tue May 28 12:56:57 2024] GET /share/v2/df93a973373644ccaf8ecf54774a4ced/shares/543531db-0529-42ad-9ae8-5e3dff98a2a5/instances => generated 509 bytes in 29 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:56:57 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-828f7ff7-ae15-4608-b548-bfee0a309e65 tempest-AdminActionsTest-1749172189 None] '"/manila/manila-4016fe10-12f4-48fc-92de-42cdd2fff998", "policy_id": ' May 28 12:56:57 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-828f7ff7-ae15-4608-b548-bfee0a309e65 tempest-AdminActionsTest-1749172189 None] '13, "create_dir": true, "protocols": ["NFS"]}', May 28 12:56:57 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-828f7ff7-ae15-4608-b548-bfee0a309e65 tempest-AdminActionsTest-1749172189 None] 'json': None, May 28 12:56:57 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-828f7ff7-ae15-4608-b548-bfee0a309e65 tempest-AdminActionsTest-1749172189 None] 'params': None} May 28 12:56:57 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-d2cdf006-65dc-4aaa-b3c1-533e57ee7b1b tempest-ExportLocationsNegativeTest-386865252 tempest-ExportLocationsNegativeTest-386865252-project-admin] GET http://10.27.203.238/share/v2/df93a973373644ccaf8ecf54774a4ced/shares/543531db-0529-42ad-9ae8-5e3dff98a2a5/export_locations/fake-inexistent-share-instance-id May 28 12:56:57 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-d2cdf006-65dc-4aaa-b3c1-533e57ee7b1b tempest-ExportLocationsNegativeTest-386865252 tempest-ExportLocationsNegativeTest-386865252-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:57 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-d2cdf006-65dc-4aaa-b3c1-533e57ee7b1b tempest-ExportLocationsNegativeTest-386865252 tempest-ExportLocationsNegativeTest-386865252-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:57 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-2dbf5575-1440-4c4f-9084-d4af8ef4489b tempest-AccessRulesMetadataTest-1973590610 None] Lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.046s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:56:57 l75lg1-v1 manila-share[98474]: INFO manila.share.access [None req-2dbf5575-1440-4c4f-9084-d4af8ef4489b tempest-AccessRulesMetadataTest-1973590610 None] Access rules were successfully modified for share instance 95118a75-173c-4257-acef-78a246ee1c67 belonging to share b92fc06b-76d7-40f9-adef-74a07ace1027. May 28 12:56:57 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-d2cdf006-65dc-4aaa-b3c1-533e57ee7b1b tempest-ExportLocationsNegativeTest-386865252 tempest-ExportLocationsNegativeTest-386865252-project-admin] HTTP exception thrown: Export location 'fake-inexistent-share-instance-id' not found. May 28 12:56:57 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-d2cdf006-65dc-4aaa-b3c1-533e57ee7b1b tempest-ExportLocationsNegativeTest-386865252 tempest-ExportLocationsNegativeTest-386865252-project-admin] http://10.27.203.238/share/v2/df93a973373644ccaf8ecf54774a4ced/shares/543531db-0529-42ad-9ae8-5e3dff98a2a5/export_locations/fake-inexistent-share-instance-id returned with HTTP 404 May 28 12:56:57 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 145/298] 10.27.203.238 () {64 vars in 1604 bytes} [Tue May 28 12:56:57 2024] GET /share/v2/df93a973373644ccaf8ecf54774a4ced/shares/543531db-0529-42ad-9ae8-5e3dff98a2a5/export_locations/fake-inexistent-share-instance-id => generated 108 bytes in 38 msecs (HTTP/1.1 404) 6 headers in 238 bytes (1 switches on core 0) May 28 12:56:57 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-1788a42c-33a9-4d51-8b63-ad4517576482 tempest-ExportLocationsNegativeTest-386865252 tempest-ExportLocationsNegativeTest-386865252-project-admin] GET http://10.27.203.238/share/v2/df93a973373644ccaf8ecf54774a4ced/share_instances/d44fc8f1-83fc-47c3-994f-497e85a3194a/export_locations/fake-inexistent-share-instance-id May 28 12:56:57 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-1788a42c-33a9-4d51-8b63-ad4517576482 tempest-ExportLocationsNegativeTest-386865252 tempest-ExportLocationsNegativeTest-386865252-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:57 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-1788a42c-33a9-4d51-8b63-ad4517576482 tempest-ExportLocationsNegativeTest-386865252 tempest-ExportLocationsNegativeTest-386865252-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:57 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-1788a42c-33a9-4d51-8b63-ad4517576482 tempest-ExportLocationsNegativeTest-386865252 tempest-ExportLocationsNegativeTest-386865252-project-admin] HTTP exception thrown: Export location fake-inexistent-share-instance-id could not be found. May 28 12:56:57 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-1788a42c-33a9-4d51-8b63-ad4517576482 tempest-ExportLocationsNegativeTest-386865252 tempest-ExportLocationsNegativeTest-386865252-project-admin] http://10.27.203.238/share/v2/df93a973373644ccaf8ecf54774a4ced/share_instances/d44fc8f1-83fc-47c3-994f-497e85a3194a/export_locations/fake-inexistent-share-instance-id returned with HTTP 404 May 28 12:56:57 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 154/299] 10.27.203.238 () {64 vars in 1631 bytes} [Tue May 28 12:56:57 2024] GET /share/v2/df93a973373644ccaf8ecf54774a4ced/share_instances/d44fc8f1-83fc-47c3-994f-497e85a3194a/export_locations/fake-inexistent-share-instance-id => generated 115 bytes in 47 msecs (HTTP/1.1 404) 6 headers in 238 bytes (1 switches on core 0) May 28 12:56:57 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-51970fe1-c165-4818-ab80-da196b5108bd tempest-ExportLocationsNegativeTest-386865252 tempest-ExportLocationsNegativeTest-386865252-project-admin] GET http://10.27.203.238/share/v2/df93a973373644ccaf8ecf54774a4ced/shares/543531db-0529-42ad-9ae8-5e3dff98a2a5/export_locations May 28 12:56:57 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-51970fe1-c165-4818-ab80-da196b5108bd tempest-ExportLocationsNegativeTest-386865252 tempest-ExportLocationsNegativeTest-386865252-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:57 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-51970fe1-c165-4818-ab80-da196b5108bd tempest-ExportLocationsNegativeTest-386865252 tempest-ExportLocationsNegativeTest-386865252-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:57 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-51970fe1-c165-4818-ab80-da196b5108bd tempest-ExportLocationsNegativeTest-386865252 tempest-ExportLocationsNegativeTest-386865252-project-admin] http://10.27.203.238/share/v2/df93a973373644ccaf8ecf54774a4ced/shares/543531db-0529-42ad-9ae8-5e3dff98a2a5/export_locations returned with HTTP 200 May 28 12:56:57 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 146/300] 10.27.203.238 () {64 vars in 1502 bytes} [Tue May 28 12:56:57 2024] GET /share/v2/df93a973373644ccaf8ecf54774a4ced/shares/543531db-0529-42ad-9ae8-5e3dff98a2a5/export_locations => generated 250 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:56:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201fd1f8-0a1d-41ce-948b-311b9964d811 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201fd1f8-0a1d-41ce-948b-311b9964d811 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6630df-2450-44c4-adaf-f29b3ddc0016 service manila] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f110cf6300f049c897d0aab63218d1e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6630df-2450-44c4-adaf-f29b3ddc0016 service manila] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6630df-2450-44c4-adaf-f29b3ddc0016 service manila] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6630df-2450-44c4-adaf-f29b3ddc0016 service manila] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-2a6630df-2450-44c4-adaf-f29b3ddc0016 service manila] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6630df-2450-44c4-adaf-f29b3ddc0016 service manila] RBAC: Authorizing `identity:validate_token()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6630df-2450-44c4-adaf-f29b3ddc0016 service manila] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:57 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 849/1675] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 12:56:57 2024] GET /identity/v3/auth/tokens => generated 3962 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 12:56:57 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-6f497428-faeb-4419-a2f7-9d159da5f156 tempest-ExportLocationsNegativeTest-163410417 tempest-ExportLocationsNegativeTest-163410417-project-member] GET http://10.27.203.238/share/v2/8122411d892242d0963cf4b8e8fa5bb2/shares/543531db-0529-42ad-9ae8-5e3dff98a2a5/export_locations/2e2e6456-bd53-4234-ade5-aef3f2aaab5b May 28 12:56:57 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-6f497428-faeb-4419-a2f7-9d159da5f156 tempest-ExportLocationsNegativeTest-163410417 tempest-ExportLocationsNegativeTest-163410417-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:57 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-6f497428-faeb-4419-a2f7-9d159da5f156 tempest-ExportLocationsNegativeTest-163410417 tempest-ExportLocationsNegativeTest-163410417-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:57 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.policy [None req-6f497428-faeb-4419-a2f7-9d159da5f156 tempest-ExportLocationsNegativeTest-163410417 tempest-ExportLocationsNegativeTest-163410417-project-member] Policy check for share:get failed with credentials {'is_admin': False, 'user_id': '48db8b9e3da84d74857c401303968b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8122411d892242d0963cf4b8e8fa5bb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98329) authorize /opt/stack/manila/manila/policy.py:208}} May 28 12:56:57 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-6f497428-faeb-4419-a2f7-9d159da5f156 tempest-ExportLocationsNegativeTest-163410417 tempest-ExportLocationsNegativeTest-163410417-project-member] http://10.27.203.238/share/v2/8122411d892242d0963cf4b8e8fa5bb2/shares/543531db-0529-42ad-9ae8-5e3dff98a2a5/export_locations/2e2e6456-bd53-4234-ade5-aef3f2aaab5b returned with HTTP 403 May 28 12:56:57 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 155/301] 10.27.203.238 () {64 vars in 1613 bytes} [Tue May 28 12:56:57 2024] GET /share/v2/8122411d892242d0963cf4b8e8fa5bb2/shares/543531db-0529-42ad-9ae8-5e3dff98a2a5/export_locations/2e2e6456-bd53-4234-ade5-aef3f2aaab5b => generated 90 bytes in 81 msecs (HTTP/1.1 403) 6 headers in 237 bytes (1 switches on core 0) May 28 12:56:57 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-da7b7197-7b40-4795-ba54-6e20e895363f tempest-ExportLocationsNegativeTest-386865252 tempest-ExportLocationsNegativeTest-386865252-project-admin] GET http://10.27.203.238/share/v2/df93a973373644ccaf8ecf54774a4ced/share_instances/d44fc8f1-83fc-47c3-994f-497e85a3194a/export_locations May 28 12:56:57 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-da7b7197-7b40-4795-ba54-6e20e895363f tempest-ExportLocationsNegativeTest-386865252 tempest-ExportLocationsNegativeTest-386865252-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:57 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-da7b7197-7b40-4795-ba54-6e20e895363f tempest-ExportLocationsNegativeTest-386865252 tempest-ExportLocationsNegativeTest-386865252-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:57 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-da7b7197-7b40-4795-ba54-6e20e895363f tempest-ExportLocationsNegativeTest-386865252 tempest-ExportLocationsNegativeTest-386865252-project-admin] http://10.27.203.238/share/v2/df93a973373644ccaf8ecf54774a4ced/share_instances/d44fc8f1-83fc-47c3-994f-497e85a3194a/export_locations returned with HTTP 200 May 28 12:56:57 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 147/302] 10.27.203.238 () {64 vars in 1529 bytes} [Tue May 28 12:56:57 2024] GET /share/v2/df93a973373644ccaf8ecf54774a4ced/share_instances/d44fc8f1-83fc-47c3-994f-497e85a3194a/export_locations => generated 250 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:56:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184e00ff-4e38-4617-824d-fd1228230802 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184e00ff-4e38-4617-824d-fd1228230802 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184e00ff-4e38-4617-824d-fd1228230802 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:57 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-184e00ff-4e38-4617-824d-fd1228230802 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:56:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-184e00ff-4e38-4617-824d-fd1228230802 None None] MFA Rules not processed for user `108a25e436e9452a9a865957dcea1fc5`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:56:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-184e00ff-4e38-4617-824d-fd1228230802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:57 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 827/1676] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:56:57 2024] POST /identity/v3/auth/tokens => generated 3960 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:56:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6630df-2450-44c4-adaf-f29b3ddc0016 service manila] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6630df-2450-44c4-adaf-f29b3ddc0016 service manila] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfb7bfb-f027-43c3-912e-36c327d7f7fc service manila] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f110cf6300f049c897d0aab63218d1e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfb7bfb-f027-43c3-912e-36c327d7f7fc service manila] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfb7bfb-f027-43c3-912e-36c327d7f7fc service manila] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfb7bfb-f027-43c3-912e-36c327d7f7fc service manila] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfb7bfb-f027-43c3-912e-36c327d7f7fc service manila] RBAC: Authorizing `identity:validate_token()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfb7bfb-f027-43c3-912e-36c327d7f7fc service manila] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:57 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 850/1677] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 12:56:57 2024] GET /identity/v3/auth/tokens => generated 3960 bytes in 17 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 12:56:57 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-f9cdc086-c8b7-458e-a1db-058714f16911 tempest-ExportLocationsNegativeTest-386865252 tempest-manila_df93a973373644ccaf8ecf54774a4ced-1685420653] GET http://10.27.203.238/share/v2/df93a973373644ccaf8ecf54774a4ced/share_instances/d44fc8f1-83fc-47c3-994f-497e85a3194a/export_locations/2e2e6456-bd53-4234-ade5-aef3f2aaab5b May 28 12:56:57 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-f9cdc086-c8b7-458e-a1db-058714f16911 tempest-ExportLocationsNegativeTest-386865252 tempest-manila_df93a973373644ccaf8ecf54774a4ced-1685420653] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:57 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-f9cdc086-c8b7-458e-a1db-058714f16911 tempest-ExportLocationsNegativeTest-386865252 tempest-manila_df93a973373644ccaf8ecf54774a4ced-1685420653] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:57 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.policy [None req-f9cdc086-c8b7-458e-a1db-058714f16911 tempest-ExportLocationsNegativeTest-386865252 tempest-manila_df93a973373644ccaf8ecf54774a4ced-1685420653] Policy check for share_instance_export_location:show failed with credentials {'is_admin': False, 'user_id': '108a25e436e9452a9a865957dcea1fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df93a973373644ccaf8ecf54774a4ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98329) authorize /opt/stack/manila/manila/policy.py:208}} May 28 12:56:57 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-f9cdc086-c8b7-458e-a1db-058714f16911 tempest-ExportLocationsNegativeTest-386865252 tempest-manila_df93a973373644ccaf8ecf54774a4ced-1685420653] HTTP exception thrown: Access was denied to this resource. May 28 12:56:57 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-f9cdc086-c8b7-458e-a1db-058714f16911 tempest-ExportLocationsNegativeTest-386865252 tempest-manila_df93a973373644ccaf8ecf54774a4ced-1685420653] http://10.27.203.238/share/v2/df93a973373644ccaf8ecf54774a4ced/share_instances/d44fc8f1-83fc-47c3-994f-497e85a3194a/export_locations/2e2e6456-bd53-4234-ade5-aef3f2aaab5b returned with HTTP 403 May 28 12:56:57 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 156/303] 10.27.203.238 () {64 vars in 1640 bytes} [Tue May 28 12:56:57 2024] GET /share/v2/df93a973373644ccaf8ecf54774a4ced/share_instances/d44fc8f1-83fc-47c3-994f-497e85a3194a/export_locations/2e2e6456-bd53-4234-ade5-aef3f2aaab5b => generated 78 bytes in 27 msecs (HTTP/1.1 403) 6 headers in 237 bytes (1 switches on core 0) May 28 12:56:57 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-649a6640-514e-4c4e-90ab-a975c3597129 tempest-ExportLocationsNegativeTest-163410417 tempest-ExportLocationsNegativeTest-163410417-project-member] GET http://10.27.203.238/share/v2/8122411d892242d0963cf4b8e8fa5bb2/shares/543531db-0529-42ad-9ae8-5e3dff98a2a5/export_locations May 28 12:56:57 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-649a6640-514e-4c4e-90ab-a975c3597129 tempest-ExportLocationsNegativeTest-163410417 tempest-ExportLocationsNegativeTest-163410417-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:57 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-649a6640-514e-4c4e-90ab-a975c3597129 tempest-ExportLocationsNegativeTest-163410417 tempest-ExportLocationsNegativeTest-163410417-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:57 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.policy [None req-649a6640-514e-4c4e-90ab-a975c3597129 tempest-ExportLocationsNegativeTest-163410417 tempest-ExportLocationsNegativeTest-163410417-project-member] Policy check for share:get failed with credentials {'is_admin': False, 'user_id': '48db8b9e3da84d74857c401303968b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8122411d892242d0963cf4b8e8fa5bb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98330) authorize /opt/stack/manila/manila/policy.py:208}} May 28 12:56:57 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-649a6640-514e-4c4e-90ab-a975c3597129 tempest-ExportLocationsNegativeTest-163410417 tempest-ExportLocationsNegativeTest-163410417-project-member] http://10.27.203.238/share/v2/8122411d892242d0963cf4b8e8fa5bb2/shares/543531db-0529-42ad-9ae8-5e3dff98a2a5/export_locations returned with HTTP 403 May 28 12:56:57 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 148/304] 10.27.203.238 () {64 vars in 1502 bytes} [Tue May 28 12:56:57 2024] GET /share/v2/8122411d892242d0963cf4b8e8fa5bb2/shares/543531db-0529-42ad-9ae8-5e3dff98a2a5/export_locations => generated 90 bytes in 35 msecs (HTTP/1.1 403) 6 headers in 237 bytes (1 switches on core 0) May 28 12:56:57 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-9ce065fb-8ead-4214-8cbf-9ee7866259cb tempest-ExportLocationsNegativeTest-386865252 tempest-manila_df93a973373644ccaf8ecf54774a4ced-1685420653] GET http://10.27.203.238/share/v2/df93a973373644ccaf8ecf54774a4ced/share_instances/d44fc8f1-83fc-47c3-994f-497e85a3194a/export_locations May 28 12:56:57 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-9ce065fb-8ead-4214-8cbf-9ee7866259cb tempest-ExportLocationsNegativeTest-386865252 tempest-manila_df93a973373644ccaf8ecf54774a4ced-1685420653] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:57 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-9ce065fb-8ead-4214-8cbf-9ee7866259cb tempest-ExportLocationsNegativeTest-386865252 tempest-manila_df93a973373644ccaf8ecf54774a4ced-1685420653] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:57 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.policy [None req-9ce065fb-8ead-4214-8cbf-9ee7866259cb tempest-ExportLocationsNegativeTest-386865252 tempest-manila_df93a973373644ccaf8ecf54774a4ced-1685420653] Policy check for share_instance_export_location:index failed with credentials {'is_admin': False, 'user_id': '108a25e436e9452a9a865957dcea1fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df93a973373644ccaf8ecf54774a4ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98329) authorize /opt/stack/manila/manila/policy.py:208}} May 28 12:56:57 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-9ce065fb-8ead-4214-8cbf-9ee7866259cb tempest-ExportLocationsNegativeTest-386865252 tempest-manila_df93a973373644ccaf8ecf54774a4ced-1685420653] HTTP exception thrown: Access was denied to this resource. May 28 12:56:57 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-9ce065fb-8ead-4214-8cbf-9ee7866259cb tempest-ExportLocationsNegativeTest-386865252 tempest-manila_df93a973373644ccaf8ecf54774a4ced-1685420653] http://10.27.203.238/share/v2/df93a973373644ccaf8ecf54774a4ced/share_instances/d44fc8f1-83fc-47c3-994f-497e85a3194a/export_locations returned with HTTP 403 May 28 12:56:57 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 157/305] 10.27.203.238 () {64 vars in 1529 bytes} [Tue May 28 12:56:57 2024] GET /share/v2/df93a973373644ccaf8ecf54774a4ced/share_instances/d44fc8f1-83fc-47c3-994f-497e85a3194a/export_locations => generated 78 bytes in 6 msecs (HTTP/1.1 403) 6 headers in 237 bytes (1 switches on core 0) May 28 12:56:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184e00ff-4e38-4617-824d-fd1228230802 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-184e00ff-4e38-4617-824d-fd1228230802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:56:57 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-68cfc213-3bbd-40e0-bab5-7c73e970f44c tempest-ShareInstancesNegativeTest-210953919 None] <<< [POST] https://127.0.0.1:40443/api/views/ May 28 12:56:57 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-68cfc213-3bbd-40e0-bab5-7c73e970f44c tempest-ShareInstancesNegativeTest-210953919 None] Bunch(abac_tags=[], abe_max_depth=None, abe_protocols=[], alias='', allow_anonymous_access=False, allow_s3_anonymous_access=False, auto_commit='0d', bucket='', bucket_creators=[], bucket_creators_groups=[], bucket_owner=None, bulk_permission_update_progress=None, bulk_permission_update_state=None, cluster='loop75-kfs', cluster_id=1, created='2024-05-28T12:56:57.398461Z', enabled=True, files_retention_mode='NONE', guid='a78ec6a5-bdf3-48b2-8727-fff6076b4ca7', id=10, ignore_oos=False, internal=False, is_remote=False, is_seamless=False, logical_capacity=0, max_retention_period=None, min_retention_period=None, name='9b44eaf4-da6e-42e7-8723-ce0cc8878f85', nfs_interop_flags='BOTH_NFS3_AND_NFS4_INTEROP_DISABLED', path='/manila/manila-9b44eaf4-da6e-42e7-8723-ce0cc8878f85', physical_capacity=0, policy='9b44eaf4-da6e-42e7-8723-ce0cc8878f85', policy_id=11, protocols=['NFS'], qos_policy=None, qos_policy_id=None, s3_locks=False, s3_locks_retention_mode='NONE', s3_locks_retention_period='', s3_object_ownership_rule='ObjectWriter', s3_unverified_lookup=False, s3_versioning=False, select_for_live_monitoring=False, share='', share_acl=Bunch(acl=[], enabled=False), sync='SYNCED', sync_time='2024-05-28T12:56:57.649716Z', tenant_id=1, tenant_name='default', title='/manila/manila-9b44eaf4-da6e-42e7-8723-ce0cc8878f85', url='https://127.0.0.1:40443/api/views/10/') May 28 12:56:57 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-68cfc213-3bbd-40e0-bab5-7c73e970f44c tempest-ShareInstancesNegativeTest-210953919 None] --- [POST] https://127.0.0.1:40443/api/views/: Done May 28 12:56:57 l75lg1-v1 manila-share[98474]: INFO manila.share.manager [None req-68cfc213-3bbd-40e0-bab5-7c73e970f44c tempest-ShareInstancesNegativeTest-210953919 None] Share instance 9b44eaf4-da6e-42e7-8723-ce0cc8878f85 created successfully. May 28 12:56:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184e00ff-4e38-4617-824d-fd1228230802 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5686a749-7234-4eeb-aef0-4f2b1af9a630 tempest-ExportLocationsNegativeTest-386865252 tempest-ExportLocationsNegativeTest-386865252-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f047e790f5704d6c9c05ddd053c2c71c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df93a973373644ccaf8ecf54774a4ced', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5686a749-7234-4eeb-aef0-4f2b1af9a630 tempest-ExportLocationsNegativeTest-386865252 tempest-ExportLocationsNegativeTest-386865252-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5686a749-7234-4eeb-aef0-4f2b1af9a630 tempest-ExportLocationsNegativeTest-386865252 tempest-ExportLocationsNegativeTest-386865252-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5686a749-7234-4eeb-aef0-4f2b1af9a630 tempest-ExportLocationsNegativeTest-386865252 tempest-ExportLocationsNegativeTest-386865252-project-admin] PATH_INFO: `/v3/users/8688f80695814f34bfb56342c4e54028` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5686a749-7234-4eeb-aef0-4f2b1af9a630 tempest-ExportLocationsNegativeTest-386865252 tempest-ExportLocationsNegativeTest-386865252-project-admin] RBAC: Authorizing `identity:delete_user(user_id=8688f80695814f34bfb56342c4e54028)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5686a749-7234-4eeb-aef0-4f2b1af9a630 tempest-ExportLocationsNegativeTest-386865252 tempest-ExportLocationsNegativeTest-386865252-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:57 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-5686a749-7234-4eeb-aef0-4f2b1af9a630 tempest-ExportLocationsNegativeTest-386865252 tempest-ExportLocationsNegativeTest-386865252-project-admin] Could not find user: 8688f80695814f34bfb56342c4e54028.: keystone.exception.UserNotFound: Could not find user: 8688f80695814f34bfb56342c4e54028. May 28 12:56:57 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:56:57 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:56:57 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:56:57 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:56:57 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:56:57 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:56:57 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:56:57 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:56:57 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:56:57 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:56:57 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:56:57 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 12:56:57 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 12:56:57 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:56:57 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:56:57 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 12:56:57 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:56:57 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 12:56:57 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:56:57 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 12:56:57 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 12:56:57 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:56:57 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:56:57 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 12:56:57 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:56:57 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 12:56:57 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:56:57 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:56:57 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:56:57 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:56:57 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:56:57 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:56:57 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 12:56:57 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:56:57 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 12:56:57 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:56:57 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:56:57 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:56:57 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 12:56:57 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:56:57 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 12:56:57 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 12:56:57 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 12:56:57 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 12:56:57 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 12:56:57 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 12:56:57 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 12:56:57 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 8688f80695814f34bfb56342c4e54028. May 28 12:56:57 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 12:56:57 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 828/1678] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 12:56:57 2024] DELETE /identity/v3/users/8688f80695814f34bfb56342c4e54028 => generated 110 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 12:56:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfb7bfb-f027-43c3-912e-36c327d7f7fc service manila] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:56:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfb7bfb-f027-43c3-912e-36c327d7f7fc service manila] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:56:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32048650-09af-4870-8e22-c880d9056b99 tempest-ExportLocationsNegativeTest-386865252 tempest-ExportLocationsNegativeTest-386865252-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f047e790f5704d6c9c05ddd053c2c71c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df93a973373644ccaf8ecf54774a4ced', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:56:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32048650-09af-4870-8e22-c880d9056b99 tempest-ExportLocationsNegativeTest-386865252 tempest-ExportLocationsNegativeTest-386865252-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:56:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32048650-09af-4870-8e22-c880d9056b99 tempest-ExportLocationsNegativeTest-386865252 tempest-ExportLocationsNegativeTest-386865252-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:56:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32048650-09af-4870-8e22-c880d9056b99 tempest-ExportLocationsNegativeTest-386865252 tempest-ExportLocationsNegativeTest-386865252-project-admin] PATH_INFO: `/v3/users/108a25e436e9452a9a865957dcea1fc5` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:56:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32048650-09af-4870-8e22-c880d9056b99 tempest-ExportLocationsNegativeTest-386865252 tempest-ExportLocationsNegativeTest-386865252-project-admin] RBAC: Authorizing `identity:delete_user(user_id=108a25e436e9452a9a865957dcea1fc5)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:56:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32048650-09af-4870-8e22-c880d9056b99 tempest-ExportLocationsNegativeTest-386865252 tempest-ExportLocationsNegativeTest-386865252-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:56:57 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ea9bfd84-defc-4007-b796-ab8de4f6c750 tempest-ShareTypesAdminTest-216868925 None] <<< [POST] https://127.0.0.1:40443/api/views/ May 28 12:56:57 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ea9bfd84-defc-4007-b796-ab8de4f6c750 tempest-ShareTypesAdminTest-216868925 None] Bunch(abac_tags=[], abe_max_depth=None, abe_protocols=[], alias='', allow_anonymous_access=False, allow_s3_anonymous_access=False, auto_commit='0d', bucket='', bucket_creators=[], bucket_creators_groups=[], bucket_owner=None, bulk_permission_update_progress=None, bulk_permission_update_state=None, cluster='loop75-kfs', cluster_id=1, created='2024-05-28T12:56:57.497558Z', enabled=True, files_retention_mode='NONE', guid='1743eb56-f144-4850-b3b2-ddb0cb513da4', id=11, ignore_oos=False, internal=False, is_remote=False, is_seamless=False, logical_capacity=0, max_retention_period=None, min_retention_period=None, name='4e77e600-5df2-4310-91eb-8d6633f53ce4', nfs_interop_flags='BOTH_NFS3_AND_NFS4_INTEROP_DISABLED', path='/manila/manila-4e77e600-5df2-4310-91eb-8d6633f53ce4', physical_capacity=0, policy='4e77e600-5df2-4310-91eb-8d6633f53ce4', policy_id=12, protocols=['NFS'], qos_policy=None, qos_policy_id=None, s3_locks=False, s3_locks_retention_mode='NONE', s3_locks_retention_period='', s3_object_ownership_rule='ObjectWriter', s3_unverified_lookup=False, s3_versioning=False, select_for_live_monitoring=False, share='', share_acl=Bunch(acl=[], enabled=False), sync='SYNCED', sync_time='2024-05-28T12:56:57.754059Z', tenant_id=1, tenant_name='default', title='/manila/manila-4e77e600-5df2-4310-91eb-8d6633f53ce4', url='https://127.0.0.1:40443/api/views/11/') May 28 12:56:57 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ea9bfd84-defc-4007-b796-ab8de4f6c750 tempest-ShareTypesAdminTest-216868925 None] --- [POST] https://127.0.0.1:40443/api/views/: Done May 28 12:56:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-32048650-09af-4870-8e22-c880d9056b99 tempest-ExportLocationsNegativeTest-386865252 tempest-ExportLocationsNegativeTest-386865252-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '108a25e436e9452a9a865957dcea1fc5', 'request_id': 'req-32048650-09af-4870-8e22-c880d9056b99'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-32048650-09af-4870-8e22-c880d9056b99 tempest-ExportLocationsNegativeTest-386865252 tempest-ExportLocationsNegativeTest-386865252-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '108a25e436e9452a9a865957dcea1fc5', 'request_id': 'req-32048650-09af-4870-8e22-c880d9056b99'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-32048650-09af-4870-8e22-c880d9056b99 tempest-ExportLocationsNegativeTest-386865252 tempest-ExportLocationsNegativeTest-386865252-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '108a25e436e9452a9a865957dcea1fc5', 'request_id': 'req-32048650-09af-4870-8e22-c880d9056b99'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-32048650-09af-4870-8e22-c880d9056b99 tempest-ExportLocationsNegativeTest-386865252 tempest-ExportLocationsNegativeTest-386865252-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '108a25e436e9452a9a865957dcea1fc5', 'request_id': 'req-32048650-09af-4870-8e22-c880d9056b99'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:57 l75lg1-v1 manila-share[98474]: INFO manila.share.manager [None req-ea9bfd84-defc-4007-b796-ab8de4f6c750 tempest-ShareTypesAdminTest-216868925 None] Share instance 4e77e600-5df2-4310-91eb-8d6633f53ce4 created successfully. May 28 12:56:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-32048650-09af-4870-8e22-c880d9056b99 tempest-ExportLocationsNegativeTest-386865252 tempest-ExportLocationsNegativeTest-386865252-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '108a25e436e9452a9a865957dcea1fc5', 'request_id': 'req-32048650-09af-4870-8e22-c880d9056b99'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:56:57 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 851/1679] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 12:56:57 2024] DELETE /identity/v3/users/108a25e436e9452a9a865957dcea1fc5 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:56:57 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-c056eb4f-ed85-4284-9834-f5c6b93539f3 tempest-ExportLocationsNegativeTest-163410417 tempest-ExportLocationsNegativeTest-163410417-project-member] GET http://10.27.203.238/share/v2/8122411d892242d0963cf4b8e8fa5bb2/share-replicas/detail?share_id=543531db-0529-42ad-9ae8-5e3dff98a2a5 May 28 12:56:57 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-c056eb4f-ed85-4284-9834-f5c6b93539f3 tempest-ExportLocationsNegativeTest-163410417 tempest-ExportLocationsNegativeTest-163410417-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:57 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-c056eb4f-ed85-4284-9834-f5c6b93539f3 tempest-ExportLocationsNegativeTest-163410417 tempest-ExportLocationsNegativeTest-163410417-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:57 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-c056eb4f-ed85-4284-9834-f5c6b93539f3 tempest-ExportLocationsNegativeTest-163410417 tempest-ExportLocationsNegativeTest-163410417-project-member] http://10.27.203.238/share/v2/8122411d892242d0963cf4b8e8fa5bb2/share-replicas/detail?share_id=543531db-0529-42ad-9ae8-5e3dff98a2a5 returned with HTTP 200 May 28 12:56:57 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 149/306] 10.27.203.238 () {64 vars in 1476 bytes} [Tue May 28 12:56:57 2024] GET /share/v2/8122411d892242d0963cf4b8e8fa5bb2/share-replicas/detail?share_id=543531db-0529-42ad-9ae8-5e3dff98a2a5 => generated 22 bytes in 13 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:56:57 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-9c9aa596-d63a-4c98-8174-b7af98a44ede tempest-ExportLocationsNegativeTest-386865252 tempest-ExportLocationsNegativeTest-386865252-project-admin] DELETE http://10.27.203.238/share/v2/df93a973373644ccaf8ecf54774a4ced/shares/543531db-0529-42ad-9ae8-5e3dff98a2a5 May 28 12:56:57 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-9c9aa596-d63a-4c98-8174-b7af98a44ede tempest-ExportLocationsNegativeTest-386865252 tempest-ExportLocationsNegativeTest-386865252-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:57 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-9c9aa596-d63a-4c98-8174-b7af98a44ede tempest-ExportLocationsNegativeTest-386865252 tempest-ExportLocationsNegativeTest-386865252-project-admin] Calling method 'ShareMixin.delete' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:57 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.v1.shares [None req-9c9aa596-d63a-4c98-8174-b7af98a44ede tempest-ExportLocationsNegativeTest-386865252 tempest-ExportLocationsNegativeTest-386865252-project-admin] Delete share with id: 543531db-0529-42ad-9ae8-5e3dff98a2a5 May 28 12:56:58 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-828f7ff7-ae15-4608-b548-bfee0a309e65 tempest-AdminActionsTest-1749172189 None] <<< [POST] https://127.0.0.1:40443/api/views/ May 28 12:56:58 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-828f7ff7-ae15-4608-b548-bfee0a309e65 tempest-AdminActionsTest-1749172189 None] Bunch(abac_tags=[], abe_max_depth=None, abe_protocols=[], alias='', allow_anonymous_access=False, allow_s3_anonymous_access=False, auto_commit='0d', bucket='', bucket_creators=[], bucket_creators_groups=[], bucket_owner=None, bulk_permission_update_progress=None, bulk_permission_update_state=None, cluster='loop75-kfs', cluster_id=1, created='2024-05-28T12:56:57.682565Z', enabled=True, files_retention_mode='NONE', guid='9ed67c42-65ba-472b-b661-fdd961602360', id=12, ignore_oos=False, internal=False, is_remote=False, is_seamless=False, logical_capacity=0, max_retention_period=None, min_retention_period=None, name='4016fe10-12f4-48fc-92de-42cdd2fff998', nfs_interop_flags='BOTH_NFS3_AND_NFS4_INTEROP_DISABLED', path='/manila/manila-4016fe10-12f4-48fc-92de-42cdd2fff998', physical_capacity=0, policy='4016fe10-12f4-48fc-92de-42cdd2fff998', policy_id=13, protocols=['NFS'], qos_policy=None, qos_policy_id=None, s3_locks=False, s3_locks_retention_mode='NONE', s3_locks_retention_period='', s3_object_ownership_rule='ObjectWriter', s3_unverified_lookup=False, s3_versioning=False, select_for_live_monitoring=False, share='', share_acl=Bunch(acl=[], enabled=False), sync='SYNCED', sync_time='2024-05-28T12:56:57.938891Z', tenant_id=1, tenant_name='default', title='/manila/manila-4016fe10-12f4-48fc-92de-42cdd2fff998', url='https://127.0.0.1:40443/api/views/12/') May 28 12:56:58 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-828f7ff7-ae15-4608-b548-bfee0a309e65 tempest-AdminActionsTest-1749172189 None] --- [POST] https://127.0.0.1:40443/api/views/: Done May 28 12:56:58 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [-] Expecting reply to msg 7352434287cd4f6c95d6740cb248d5e7 in queue reply_37f4cbd1dd094961a22b8a65f222c327 May 28 12:56:58 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-9c9aa596-d63a-4c98-8174-b7af98a44ede tempest-ExportLocationsNegativeTest-386865252 tempest-ExportLocationsNegativeTest-386865252-project-admin] http://10.27.203.238/share/v2/df93a973373644ccaf8ecf54774a4ced/shares/543531db-0529-42ad-9ae8-5e3dff98a2a5 returned with HTTP 202 May 28 12:56:58 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 158/307] 10.27.203.238 () {64 vars in 1454 bytes} [Tue May 28 12:56:57 2024] DELETE /share/v2/df93a973373644ccaf8ecf54774a4ced/shares/543531db-0529-42ad-9ae8-5e3dff98a2a5 => generated 0 bytes in 119 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:56:58 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-29c01df5-85c1-48c4-99ce-944c36097112 tempest-ExportLocationsNegativeTest-386865252 tempest-ExportLocationsNegativeTest-386865252-project-admin] GET http://10.27.203.238/share/v2/df93a973373644ccaf8ecf54774a4ced/shares/543531db-0529-42ad-9ae8-5e3dff98a2a5 May 28 12:56:58 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-29c01df5-85c1-48c4-99ce-944c36097112 tempest-ExportLocationsNegativeTest-386865252 tempest-ExportLocationsNegativeTest-386865252-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:58 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-29c01df5-85c1-48c4-99ce-944c36097112 tempest-ExportLocationsNegativeTest-386865252 tempest-ExportLocationsNegativeTest-386865252-project-admin] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:58 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [-] Received RPC response for msg 7352434287cd4f6c95d6740cb248d5e7 May 28 12:56:58 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-29c01df5-85c1-48c4-99ce-944c36097112 tempest-ExportLocationsNegativeTest-386865252 tempest-ExportLocationsNegativeTest-386865252-project-admin] http://10.27.203.238/share/v2/df93a973373644ccaf8ecf54774a4ced/shares/543531db-0529-42ad-9ae8-5e3dff98a2a5 returned with HTTP 200 May 28 12:56:58 l75lg1-v1 manila-share[98474]: INFO manila.share.manager [None req-828f7ff7-ae15-4608-b548-bfee0a309e65 tempest-AdminActionsTest-1749172189 None] Share instance 4016fe10-12f4-48fc-92de-42cdd2fff998 created successfully. May 28 12:56:58 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 150/308] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:56:58 2024] GET /share/v2/df93a973373644ccaf8ecf54774a4ced/shares/543531db-0529-42ad-9ae8-5e3dff98a2a5 => generated 1374 bytes in 24 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:56:58 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-9c9aa596-d63a-4c98-8174-b7af98a44ede tempest-ExportLocationsNegativeTest-386865252 None] Acquiring lock "locked_access_rules_operation_by_share_instance_d44fc8f1-83fc-47c3-994f-497e85a3194a" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:56:58 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-9c9aa596-d63a-4c98-8174-b7af98a44ede tempest-ExportLocationsNegativeTest-386865252 None] Lock "locked_access_rules_operation_by_share_instance_d44fc8f1-83fc-47c3-994f-497e85a3194a" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:56:58 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-9c9aa596-d63a-4c98-8174-b7af98a44ede tempest-ExportLocationsNegativeTest-386865252 None] Lock "locked_access_rules_operation_by_share_instance_d44fc8f1-83fc-47c3-994f-497e85a3194a" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:56:58 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-9c9aa596-d63a-4c98-8174-b7af98a44ede tempest-ExportLocationsNegativeTest-386865252 None] Acquiring lock "locked_access_rules_operation_by_share_instance_d44fc8f1-83fc-47c3-994f-497e85a3194a" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:56:58 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-9c9aa596-d63a-4c98-8174-b7af98a44ede tempest-ExportLocationsNegativeTest-386865252 None] Lock "locked_access_rules_operation_by_share_instance_d44fc8f1-83fc-47c3-994f-497e85a3194a" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:56:58 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-9c9aa596-d63a-4c98-8174-b7af98a44ede tempest-ExportLocationsNegativeTest-386865252 None] Lock "locked_access_rules_operation_by_share_instance_d44fc8f1-83fc-47c3-994f-497e85a3194a" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:56:58 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-9c9aa596-d63a-4c98-8174-b7af98a44ede tempest-ExportLocationsNegativeTest-386865252 None] Acquiring lock "locked_access_rules_operation_by_share_instance_d44fc8f1-83fc-47c3-994f-497e85a3194a" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:56:58 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-9c9aa596-d63a-4c98-8174-b7af98a44ede tempest-ExportLocationsNegativeTest-386865252 None] Lock "locked_access_rules_operation_by_share_instance_d44fc8f1-83fc-47c3-994f-497e85a3194a" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:56:58 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-9c9aa596-d63a-4c98-8174-b7af98a44ede tempest-ExportLocationsNegativeTest-386865252 None] Lock "locked_access_rules_operation_by_share_instance_d44fc8f1-83fc-47c3-994f-497e85a3194a" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:56:58 l75lg1-v1 manila-share[98474]: DEBUG manila.share.access [None req-9c9aa596-d63a-4c98-8174-b7af98a44ede tempest-ExportLocationsNegativeTest-386865252 None] All access rules have been synced for share instance d44fc8f1-83fc-47c3-994f-497e85a3194a belonging to share 543531db-0529-42ad-9ae8-5e3dff98a2a5. {{(pid=98474) update_access_rules /opt/stack/manila/manila/share/access.py:304}} May 28 12:56:58 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-9c9aa596-d63a-4c98-8174-b7af98a44ede tempest-ExportLocationsNegativeTest-386865252 None] deleting '/manila/manila-d44fc8f1-83fc-47c3-994f-497e85a3194a' May 28 12:56:58 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9c9aa596-d63a-4c98-8174-b7af98a44ede tempest-ExportLocationsNegativeTest-386865252 None] >>> [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/ May 28 12:56:58 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9c9aa596-d63a-4c98-8174-b7af98a44ede tempest-ExportLocationsNegativeTest-386865252 None] {'data': '{"path": "/manila/manila-d44fc8f1-83fc-47c3-994f-497e85a3194a"}', May 28 12:56:58 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9c9aa596-d63a-4c98-8174-b7af98a44ede tempest-ExportLocationsNegativeTest-386865252 None] 'params': None} May 28 12:56:58 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9c9aa596-d63a-4c98-8174-b7af98a44ede tempest-ExportLocationsNegativeTest-386865252 None] <<< [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/ May 28 12:56:58 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9c9aa596-d63a-4c98-8174-b7af98a44ede tempest-ExportLocationsNegativeTest-386865252 None] 'OK' May 28 12:56:58 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9c9aa596-d63a-4c98-8174-b7af98a44ede tempest-ExportLocationsNegativeTest-386865252 None] --- [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/: Done May 28 12:56:58 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9c9aa596-d63a-4c98-8174-b7af98a44ede tempest-ExportLocationsNegativeTest-386865252 None] >>> [GET] https://127.0.0.1:40443/api/views/ May 28 12:56:58 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9c9aa596-d63a-4c98-8174-b7af98a44ede tempest-ExportLocationsNegativeTest-386865252 None] {'allow_redirects': True, May 28 12:56:58 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9c9aa596-d63a-4c98-8174-b7af98a44ede tempest-ExportLocationsNegativeTest-386865252 None] 'params': {'name': 'd44fc8f1-83fc-47c3-994f-497e85a3194a'}} May 28 12:56:58 l75lg1-v1 dstat.sh[49771]: 28-05 12:56:58| 11 1 86 2 0|5669M 1836M 277M 7844M| 28k 12k| 0 2598k| 0 202 |6284 10k|1.42 0.96 0.98|1.0 0 2.0| 0 0 | 0 2048M| 29 347 0 54 0 May 28 12:56:58 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9c9aa596-d63a-4c98-8174-b7af98a44ede tempest-ExportLocationsNegativeTest-386865252 None] <<< [GET] https://127.0.0.1:40443/api/views/ May 28 12:56:58 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9c9aa596-d63a-4c98-8174-b7af98a44ede tempest-ExportLocationsNegativeTest-386865252 None] [Bunch(abac_tags=[], abe_max_depth=None, abe_protocols=[], alias='', allow_anonymous_access=False, allow_s3_anonymous_access=False, auto_commit='0d', bucket='', bucket_creators=[], bucket_creators_groups=[], bucket_owner=None, bulk_permission_update_progress=None, bulk_permission_update_state=None, cluster='loop75-kfs', cluster_id=1, created='2024-05-28T12:56:55.357006Z', enabled=True, files_retention_mode='NONE', guid='f0ad949b-c006-4bb9-9c2d-f5b7349265c1', id=9, ignore_oos=False, internal=False, is_remote=False, is_seamless=False, logical_capacity=0, max_retention_period=None, min_retention_period=None, name='d44fc8f1-83fc-47c3-994f-497e85a3194a', nfs_interop_flags='BOTH_NFS3_AND_NFS4_INTEROP_DISABLED', path='/manila/manila-d44fc8f1-83fc-47c3-994f-497e85a3194a', physical_capacity=0, policy='d44fc8f1-83fc-47c3-994f-497e85a3194a', policy_id=10, protocols=['NFS'], qos_policy=None, qos_policy_id=None, s3_locks=False, s3_locks_retention_mode='NONE', s3_locks_retention_period='', s3_unverified_lookup=False, s3_versioning=False, select_for_live_monitoring=False, share='', share_acl=Bunch(acl=[], enabled=False), sync='SYNCED', sync_time='2024-05-28T12:56:55.654658Z', tenant_id=1, tenant_name='default', title='/manila/manila-d44fc8f1-83fc-47c3-994f-497e85a3194a', url='https://127.0.0.1:40443/api/views/9/')] May 28 12:56:58 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9c9aa596-d63a-4c98-8174-b7af98a44ede tempest-ExportLocationsNegativeTest-386865252 None] --- [GET] https://127.0.0.1:40443/api/views/: Done May 28 12:56:58 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9c9aa596-d63a-4c98-8174-b7af98a44ede tempest-ExportLocationsNegativeTest-386865252 None] >>> [DELETE] https://127.0.0.1:40443/api/views/9/ May 28 12:56:58 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-496ac233-2d18-450d-a976-ee873a94f27a tempest-ShareInstancesNegativeTest-210953919 tempest-ShareInstancesNegativeTest-210953919-project-admin] GET http://10.27.203.238/share/v2/bb8f0d37fc204d24b8146108f63a1922/shares/6b055a82-f6ad-4af2-8b38-137b3cc99cc1 May 28 12:56:58 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-496ac233-2d18-450d-a976-ee873a94f27a tempest-ShareInstancesNegativeTest-210953919 tempest-ShareInstancesNegativeTest-210953919-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:58 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-496ac233-2d18-450d-a976-ee873a94f27a tempest-ShareInstancesNegativeTest-210953919 tempest-ShareInstancesNegativeTest-210953919-project-admin] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:58 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-496ac233-2d18-450d-a976-ee873a94f27a tempest-ShareInstancesNegativeTest-210953919 tempest-ShareInstancesNegativeTest-210953919-project-admin] http://10.27.203.238/share/v2/bb8f0d37fc204d24b8146108f63a1922/shares/6b055a82-f6ad-4af2-8b38-137b3cc99cc1 returned with HTTP 200 May 28 12:56:58 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 159/309] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:56:58 2024] GET /share/v2/bb8f0d37fc204d24b8146108f63a1922/shares/6b055a82-f6ad-4af2-8b38-137b3cc99cc1 => generated 1371 bytes in 25 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:56:58 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-3f565fd0-172c-41d1-b8bc-a73aa6799298 tempest-ShareInstancesNegativeTest-210953919 tempest-ShareInstancesNegativeTest-210953919-project-admin] GET http://10.27.203.238/share/v2/bb8f0d37fc204d24b8146108f63a1922/share_instances?export_location_path=fake May 28 12:56:58 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-3f565fd0-172c-41d1-b8bc-a73aa6799298 tempest-ShareInstancesNegativeTest-210953919 tempest-ShareInstancesNegativeTest-210953919-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:58 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-3f565fd0-172c-41d1-b8bc-a73aa6799298 tempest-ShareInstancesNegativeTest-210953919 tempest-ShareInstancesNegativeTest-210953919-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:58 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-3f565fd0-172c-41d1-b8bc-a73aa6799298 tempest-ShareInstancesNegativeTest-210953919 tempest-ShareInstancesNegativeTest-210953919-project-admin] http://10.27.203.238/share/v2/bb8f0d37fc204d24b8146108f63a1922/share_instances returned with HTTP 200 May 28 12:56:58 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 151/310] 10.27.203.238 () {64 vars in 1418 bytes} [Tue May 28 12:56:58 2024] GET /share/v2/bb8f0d37fc204d24b8146108f63a1922/share_instances?export_location_path=fake => generated 2564 bytes in 17 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:56:58 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-6344a1a4-a0bf-402b-8fe4-52ae03736427 tempest-ShareInstancesNegativeTest-210953919 tempest-ShareInstancesNegativeTest-210953919-project-admin] GET http://10.27.203.238/share/v2/bb8f0d37fc204d24b8146108f63a1922/share_instances?export_location_id=fake May 28 12:56:58 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-6344a1a4-a0bf-402b-8fe4-52ae03736427 tempest-ShareInstancesNegativeTest-210953919 tempest-ShareInstancesNegativeTest-210953919-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:58 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-6344a1a4-a0bf-402b-8fe4-52ae03736427 tempest-ShareInstancesNegativeTest-210953919 tempest-ShareInstancesNegativeTest-210953919-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:58 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-6344a1a4-a0bf-402b-8fe4-52ae03736427 tempest-ShareInstancesNegativeTest-210953919 tempest-ShareInstancesNegativeTest-210953919-project-admin] http://10.27.203.238/share/v2/bb8f0d37fc204d24b8146108f63a1922/share_instances returned with HTTP 200 May 28 12:56:58 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 160/311] 10.27.203.238 () {64 vars in 1414 bytes} [Tue May 28 12:56:58 2024] GET /share/v2/bb8f0d37fc204d24b8146108f63a1922/share_instances?export_location_id=fake => generated 2564 bytes in 26 msecs (HTTP/1.1 200) 6 headers in 232 bytes (2 switches on core 0) May 28 12:56:58 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-1c28e5b2-313a-4b75-8a9d-c062d5b3cdb5 tempest-ShareInstancesNegativeTest-210953919 tempest-ShareInstancesNegativeTest-210953919-project-admin] GET http://10.27.203.238/share/v2/bb8f0d37fc204d24b8146108f63a1922/share_instances?export_location_path=fake_not_exist May 28 12:56:58 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-1c28e5b2-313a-4b75-8a9d-c062d5b3cdb5 tempest-ShareInstancesNegativeTest-210953919 tempest-ShareInstancesNegativeTest-210953919-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:58 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-1c28e5b2-313a-4b75-8a9d-c062d5b3cdb5 tempest-ShareInstancesNegativeTest-210953919 tempest-ShareInstancesNegativeTest-210953919-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:58 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-1c28e5b2-313a-4b75-8a9d-c062d5b3cdb5 tempest-ShareInstancesNegativeTest-210953919 tempest-ShareInstancesNegativeTest-210953919-project-admin] http://10.27.203.238/share/v2/bb8f0d37fc204d24b8146108f63a1922/share_instances?export_location_path=fake_not_exist returned with HTTP 200 May 28 12:56:58 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 152/312] 10.27.203.238 () {64 vars in 1438 bytes} [Tue May 28 12:56:58 2024] GET /share/v2/bb8f0d37fc204d24b8146108f63a1922/share_instances?export_location_path=fake_not_exist => generated 23 bytes in 16 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:56:58 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-d6aa4d42-3d11-4f0a-8532-efaf9a3682d3 tempest-ShareInstancesNegativeTest-210953919 tempest-ShareInstancesNegativeTest-210953919-project-admin] GET http://10.27.203.238/share/v2/bb8f0d37fc204d24b8146108f63a1922/share_instances?export_location_id=fake_not_exist May 28 12:56:58 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-d6aa4d42-3d11-4f0a-8532-efaf9a3682d3 tempest-ShareInstancesNegativeTest-210953919 tempest-ShareInstancesNegativeTest-210953919-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:58 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-d6aa4d42-3d11-4f0a-8532-efaf9a3682d3 tempest-ShareInstancesNegativeTest-210953919 tempest-ShareInstancesNegativeTest-210953919-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:58 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-d6aa4d42-3d11-4f0a-8532-efaf9a3682d3 tempest-ShareInstancesNegativeTest-210953919 tempest-ShareInstancesNegativeTest-210953919-project-admin] http://10.27.203.238/share/v2/bb8f0d37fc204d24b8146108f63a1922/share_instances?export_location_id=fake_not_exist returned with HTTP 200 May 28 12:56:58 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 161/313] 10.27.203.238 () {64 vars in 1434 bytes} [Tue May 28 12:56:58 2024] GET /share/v2/bb8f0d37fc204d24b8146108f63a1922/share_instances?export_location_id=fake_not_exist => generated 23 bytes in 18 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:56:58 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-a3f4d4c0-18e6-4ff8-9018-bbb6cf539a79 tempest-ShareInstancesNegativeTest-210953919 tempest-ShareInstancesNegativeTest-210953919-project-admin] GET http://10.27.203.238/share/v2/bb8f0d37fc204d24b8146108f63a1922/share-replicas/detail?share_id=6b055a82-f6ad-4af2-8b38-137b3cc99cc1 May 28 12:56:58 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-a3f4d4c0-18e6-4ff8-9018-bbb6cf539a79 tempest-ShareInstancesNegativeTest-210953919 tempest-ShareInstancesNegativeTest-210953919-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:58 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-a3f4d4c0-18e6-4ff8-9018-bbb6cf539a79 tempest-ShareInstancesNegativeTest-210953919 tempest-ShareInstancesNegativeTest-210953919-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:58 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-a3f4d4c0-18e6-4ff8-9018-bbb6cf539a79 tempest-ShareInstancesNegativeTest-210953919 tempest-ShareInstancesNegativeTest-210953919-project-admin] http://10.27.203.238/share/v2/bb8f0d37fc204d24b8146108f63a1922/share-replicas/detail?share_id=6b055a82-f6ad-4af2-8b38-137b3cc99cc1 returned with HTTP 200 May 28 12:56:58 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 153/314] 10.27.203.238 () {64 vars in 1476 bytes} [Tue May 28 12:56:58 2024] GET /share/v2/bb8f0d37fc204d24b8146108f63a1922/share-replicas/detail?share_id=6b055a82-f6ad-4af2-8b38-137b3cc99cc1 => generated 22 bytes in 16 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:56:58 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-c07df379-c3ad-4b79-82d1-01d37d41940f tempest-ShareInstancesNegativeTest-210953919 tempest-ShareInstancesNegativeTest-210953919-project-admin] DELETE http://10.27.203.238/share/v2/bb8f0d37fc204d24b8146108f63a1922/shares/6b055a82-f6ad-4af2-8b38-137b3cc99cc1 May 28 12:56:58 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-c07df379-c3ad-4b79-82d1-01d37d41940f tempest-ShareInstancesNegativeTest-210953919 tempest-ShareInstancesNegativeTest-210953919-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:58 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-c07df379-c3ad-4b79-82d1-01d37d41940f tempest-ShareInstancesNegativeTest-210953919 tempest-ShareInstancesNegativeTest-210953919-project-admin] Calling method 'ShareMixin.delete' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:58 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.v1.shares [None req-c07df379-c3ad-4b79-82d1-01d37d41940f tempest-ShareInstancesNegativeTest-210953919 tempest-ShareInstancesNegativeTest-210953919-project-admin] Delete share with id: 6b055a82-f6ad-4af2-8b38-137b3cc99cc1 May 28 12:56:58 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-c07df379-c3ad-4b79-82d1-01d37d41940f tempest-ShareInstancesNegativeTest-210953919 tempest-ShareInstancesNegativeTest-210953919-project-admin] http://10.27.203.238/share/v2/bb8f0d37fc204d24b8146108f63a1922/shares/6b055a82-f6ad-4af2-8b38-137b3cc99cc1 returned with HTTP 202 May 28 12:56:58 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 162/315] 10.27.203.238 () {64 vars in 1454 bytes} [Tue May 28 12:56:58 2024] DELETE /share/v2/bb8f0d37fc204d24b8146108f63a1922/shares/6b055a82-f6ad-4af2-8b38-137b3cc99cc1 => generated 0 bytes in 119 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-442ee4ee-6cb2-4648-a4e8-64745e746de4 tempest-ShareInstancesNegativeTest-210953919 tempest-ShareInstancesNegativeTest-210953919-project-admin] GET http://10.27.203.238/share/v2/bb8f0d37fc204d24b8146108f63a1922/shares/6b055a82-f6ad-4af2-8b38-137b3cc99cc1 May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-442ee4ee-6cb2-4648-a4e8-64745e746de4 tempest-ShareInstancesNegativeTest-210953919 tempest-ShareInstancesNegativeTest-210953919-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-442ee4ee-6cb2-4648-a4e8-64745e746de4 tempest-ShareInstancesNegativeTest-210953919 tempest-ShareInstancesNegativeTest-210953919-project-admin] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-442ee4ee-6cb2-4648-a4e8-64745e746de4 tempest-ShareInstancesNegativeTest-210953919 tempest-ShareInstancesNegativeTest-210953919-project-admin] http://10.27.203.238/share/v2/bb8f0d37fc204d24b8146108f63a1922/shares/6b055a82-f6ad-4af2-8b38-137b3cc99cc1 returned with HTTP 200 May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 154/316] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:56:58 2024] GET /share/v2/bb8f0d37fc204d24b8146108f63a1922/shares/6b055a82-f6ad-4af2-8b38-137b3cc99cc1 => generated 1370 bytes in 27 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:56:59 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c07df379-c3ad-4b79-82d1-01d37d41940f tempest-ShareInstancesNegativeTest-210953919 None] Acquiring lock "locked_access_rules_operation_by_share_instance_9b44eaf4-da6e-42e7-8723-ce0cc8878f85" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:56:59 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c07df379-c3ad-4b79-82d1-01d37d41940f tempest-ShareInstancesNegativeTest-210953919 None] Lock "locked_access_rules_operation_by_share_instance_9b44eaf4-da6e-42e7-8723-ce0cc8878f85" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:56:59 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c07df379-c3ad-4b79-82d1-01d37d41940f tempest-ShareInstancesNegativeTest-210953919 None] Lock "locked_access_rules_operation_by_share_instance_9b44eaf4-da6e-42e7-8723-ce0cc8878f85" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:56:59 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c07df379-c3ad-4b79-82d1-01d37d41940f tempest-ShareInstancesNegativeTest-210953919 None] Acquiring lock "locked_access_rules_operation_by_share_instance_9b44eaf4-da6e-42e7-8723-ce0cc8878f85" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:56:59 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c07df379-c3ad-4b79-82d1-01d37d41940f tempest-ShareInstancesNegativeTest-210953919 None] Lock "locked_access_rules_operation_by_share_instance_9b44eaf4-da6e-42e7-8723-ce0cc8878f85" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:56:59 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c07df379-c3ad-4b79-82d1-01d37d41940f tempest-ShareInstancesNegativeTest-210953919 None] Lock "locked_access_rules_operation_by_share_instance_9b44eaf4-da6e-42e7-8723-ce0cc8878f85" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:56:59 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c07df379-c3ad-4b79-82d1-01d37d41940f tempest-ShareInstancesNegativeTest-210953919 None] Acquiring lock "locked_access_rules_operation_by_share_instance_9b44eaf4-da6e-42e7-8723-ce0cc8878f85" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:56:59 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c07df379-c3ad-4b79-82d1-01d37d41940f tempest-ShareInstancesNegativeTest-210953919 None] Lock "locked_access_rules_operation_by_share_instance_9b44eaf4-da6e-42e7-8723-ce0cc8878f85" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:56:59 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c07df379-c3ad-4b79-82d1-01d37d41940f tempest-ShareInstancesNegativeTest-210953919 None] Lock "locked_access_rules_operation_by_share_instance_9b44eaf4-da6e-42e7-8723-ce0cc8878f85" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:56:59 l75lg1-v1 manila-share[98474]: DEBUG manila.share.access [None req-c07df379-c3ad-4b79-82d1-01d37d41940f tempest-ShareInstancesNegativeTest-210953919 None] All access rules have been synced for share instance 9b44eaf4-da6e-42e7-8723-ce0cc8878f85 belonging to share 6b055a82-f6ad-4af2-8b38-137b3cc99cc1. {{(pid=98474) update_access_rules /opt/stack/manila/manila/share/access.py:304}} May 28 12:56:59 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-c07df379-c3ad-4b79-82d1-01d37d41940f tempest-ShareInstancesNegativeTest-210953919 None] deleting '/manila/manila-9b44eaf4-da6e-42e7-8723-ce0cc8878f85' May 28 12:56:59 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c07df379-c3ad-4b79-82d1-01d37d41940f tempest-ShareInstancesNegativeTest-210953919 None] >>> [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/ May 28 12:56:59 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c07df379-c3ad-4b79-82d1-01d37d41940f tempest-ShareInstancesNegativeTest-210953919 None] {'data': '{"path": "/manila/manila-9b44eaf4-da6e-42e7-8723-ce0cc8878f85"}', May 28 12:56:59 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c07df379-c3ad-4b79-82d1-01d37d41940f tempest-ShareInstancesNegativeTest-210953919 None] 'params': None} May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-2b050f3e-e146-41bd-8a44-637bbd0d9c45 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] GET http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/shares/8e00d6e4-a018-4e71-b71c-831e546cb6e6 May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-2b050f3e-e146-41bd-8a44-637bbd0d9c45 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-2b050f3e-e146-41bd-8a44-637bbd0d9c45 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:59 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c07df379-c3ad-4b79-82d1-01d37d41940f tempest-ShareInstancesNegativeTest-210953919 None] <<< [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/ May 28 12:56:59 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c07df379-c3ad-4b79-82d1-01d37d41940f tempest-ShareInstancesNegativeTest-210953919 None] 'OK' May 28 12:56:59 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c07df379-c3ad-4b79-82d1-01d37d41940f tempest-ShareInstancesNegativeTest-210953919 None] --- [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/: Done May 28 12:56:59 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c07df379-c3ad-4b79-82d1-01d37d41940f tempest-ShareInstancesNegativeTest-210953919 None] >>> [GET] https://127.0.0.1:40443/api/views/ May 28 12:56:59 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c07df379-c3ad-4b79-82d1-01d37d41940f tempest-ShareInstancesNegativeTest-210953919 None] {'allow_redirects': True, May 28 12:56:59 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c07df379-c3ad-4b79-82d1-01d37d41940f tempest-ShareInstancesNegativeTest-210953919 None] 'params': {'name': '9b44eaf4-da6e-42e7-8723-ce0cc8878f85'}} May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-2b050f3e-e146-41bd-8a44-637bbd0d9c45 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/shares/8e00d6e4-a018-4e71-b71c-831e546cb6e6 returned with HTTP 200 May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 163/317] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:56:59 2024] GET /share/v2/35d84ed7cf164123a87b8b906a836985/shares/8e00d6e4-a018-4e71-b71c-831e546cb6e6 => generated 1348 bytes in 27 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-dde55d73-881b-459c-93f2-f2bd8eef4f80 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] GET http://10.27.203.238/share/v1/35d84ed7cf164123a87b8b906a836985/shares/8e00d6e4-a018-4e71-b71c-831e546cb6e6 May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-dde55d73-881b-459c-93f2-f2bd8eef4f80 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-dde55d73-881b-459c-93f2-f2bd8eef4f80 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-dde55d73-881b-459c-93f2-f2bd8eef4f80 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] http://10.27.203.238/share/v1/35d84ed7cf164123a87b8b906a836985/shares/8e00d6e4-a018-4e71-b71c-831e546cb6e6 returned with HTTP 200 May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 155/318] 10.27.203.238 () {62 vars in 1408 bytes} [Tue May 28 12:56:59 2024] GET /share/v1/35d84ed7cf164123a87b8b906a836985/shares/8e00d6e4-a018-4e71-b71c-831e546cb6e6 => generated 994 bytes in 30 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-989b76ae-b626-45e5-8025-ed19f98194ad tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] GET http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/shares/8e00d6e4-a018-4e71-b71c-831e546cb6e6 May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-989b76ae-b626-45e5-8025-ed19f98194ad tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-989b76ae-b626-45e5-8025-ed19f98194ad tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-989b76ae-b626-45e5-8025-ed19f98194ad tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/shares/8e00d6e4-a018-4e71-b71c-831e546cb6e6 returned with HTTP 200 May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 164/319] 10.27.203.238 () {64 vars in 1450 bytes} [Tue May 28 12:56:59 2024] GET /share/v2/35d84ed7cf164123a87b8b906a836985/shares/8e00d6e4-a018-4e71-b71c-831e546cb6e6 => generated 1041 bytes in 24 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-aae3ceed-bce3-4ff2-903b-1b8b59806f8b tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] GET http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/shares/8e00d6e4-a018-4e71-b71c-831e546cb6e6 May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-aae3ceed-bce3-4ff2-903b-1b8b59806f8b tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-aae3ceed-bce3-4ff2-903b-1b8b59806f8b tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:59 l75lg1-v1 dstat.sh[49771]: 28-05 12:56:59| 5 0 94 0 0|5669M 1835M 277M 7845M| 19k 7879B| 0 460k| 0 37.0 |3127 4828 |1.42 0.96 0.98|2.0 0 0| 0 0 | 0 2048M| 29 348 0 54 0 May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-aae3ceed-bce3-4ff2-903b-1b8b59806f8b tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/shares/8e00d6e4-a018-4e71-b71c-831e546cb6e6 returned with HTTP 200 May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 156/320] 10.27.203.238 () {64 vars in 1450 bytes} [Tue May 28 12:56:59 2024] GET /share/v2/35d84ed7cf164123a87b8b906a836985/shares/8e00d6e4-a018-4e71-b71c-831e546cb6e6 => generated 1100 bytes in 26 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-b05969c0-2b53-4292-9199-9e6edd21c4e2 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] POST http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-b05969c0-2b53-4292-9199-9e6edd21c4e2 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share_type": {"name": "tempest-tempest-manila-1183457341", "extra_specs": {"driver_handles_share_servers": "False", "key": "value"}, "share_type_access:is_public": false}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-b05969c0-2b53-4292-9199-9e6edd21c4e2 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types returned with HTTP 200 May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 165/321] 10.27.203.238 () {66 vars in 1359 bytes} [Tue May 28 12:56:59 2024] POST /share/v2/35d84ed7cf164123a87b8b906a836985/types => generated 657 bytes in 20 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-5189918c-fffc-4484-a632-a82dccac860b tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] GET http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-5189918c-fffc-4484-a632-a82dccac860b tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-5189918c-fffc-4484-a632-a82dccac860b tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Calling method 'ShareTypesController.index' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-5189918c-fffc-4484-a632-a82dccac860b tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types returned with HTTP 200 May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 157/322] 10.27.203.238 () {64 vars in 1337 bytes} [Tue May 28 12:56:59 2024] GET /share/v2/35d84ed7cf164123a87b8b906a836985/types => generated 4725 bytes in 18 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-32d26034-3e23-43d5-94dd-bc0648af4b36 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] GET http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types/70af56f8-a0ee-4f17-b82c-3f78e274e8d6/share_type_access May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-32d26034-3e23-43d5-94dd-bc0648af4b36 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-32d26034-3e23-43d5-94dd-bc0648af4b36 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Calling method 'ShareTypesController.share_type_access' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-32d26034-3e23-43d5-94dd-bc0648af4b36 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types/70af56f8-a0ee-4f17-b82c-3f78e274e8d6/share_type_access returned with HTTP 200 May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 166/323] 10.27.203.238 () {64 vars in 1502 bytes} [Tue May 28 12:56:59 2024] GET /share/v2/35d84ed7cf164123a87b8b906a836985/types/70af56f8-a0ee-4f17-b82c-3f78e274e8d6/share_type_access => generated 25 bytes in 18 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-7ff1a2de-fe90-413d-9adc-cc170725cf68 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] POST http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types/70af56f8-a0ee-4f17-b82c-3f78e274e8d6/action May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-7ff1a2de-fe90-413d-9adc-cc170725cf68 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Action body: b'{"addProjectAccess": {"project": "35d84ed7cf164123a87b8b906a836985"}}' {{(pid=98330) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-7ff1a2de-fe90-413d-9adc-cc170725cf68 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Action: 'action', calling method: ShareTypesController._add_project_access, body: {"addProjectAccess": {"project": "35d84ed7cf164123a87b8b906a836985"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-7ff1a2de-fe90-413d-9adc-cc170725cf68 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types/70af56f8-a0ee-4f17-b82c-3f78e274e8d6/action returned with HTTP 202 May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 158/324] 10.27.203.238 () {66 vars in 1490 bytes} [Tue May 28 12:56:59 2024] POST /share/v2/35d84ed7cf164123a87b8b906a836985/types/70af56f8-a0ee-4f17-b82c-3f78e274e8d6/action => generated 0 bytes in 22 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-209d462c-e26b-47c4-8c76-ffa8a6d73e14 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] GET http://10.27.203.238/share/v1/35d84ed7cf164123a87b8b906a836985/types May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-209d462c-e26b-47c4-8c76-ffa8a6d73e14 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-209d462c-e26b-47c4-8c76-ffa8a6d73e14 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Calling method 'ShareTypesController.index' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-209d462c-e26b-47c4-8c76-ffa8a6d73e14 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] http://10.27.203.238/share/v1/35d84ed7cf164123a87b8b906a836985/types returned with HTTP 200 May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 167/325] 10.27.203.238 () {62 vars in 1294 bytes} [Tue May 28 12:56:59 2024] GET /share/v1/35d84ed7cf164123a87b8b906a836985/types => generated 4653 bytes in 13 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-24befda3-4b27-42c7-95ea-64bfbc967624 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] GET http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types/70af56f8-a0ee-4f17-b82c-3f78e274e8d6/share_type_access May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-24befda3-4b27-42c7-95ea-64bfbc967624 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-24befda3-4b27-42c7-95ea-64bfbc967624 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Calling method 'ShareTypesController.share_type_access' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-24befda3-4b27-42c7-95ea-64bfbc967624 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types/70af56f8-a0ee-4f17-b82c-3f78e274e8d6/share_type_access returned with HTTP 200 May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 159/326] 10.27.203.238 () {64 vars in 1502 bytes} [Tue May 28 12:56:59 2024] GET /share/v2/35d84ed7cf164123a87b8b906a836985/types/70af56f8-a0ee-4f17-b82c-3f78e274e8d6/share_type_access => generated 132 bytes in 11 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-aa0b7e0a-f66b-4df6-8e66-acfb70082158 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] POST http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types/70af56f8-a0ee-4f17-b82c-3f78e274e8d6/action May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-aa0b7e0a-f66b-4df6-8e66-acfb70082158 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Action body: b'{"removeProjectAccess": {"project": "35d84ed7cf164123a87b8b906a836985"}}' {{(pid=98329) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-aa0b7e0a-f66b-4df6-8e66-acfb70082158 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Action: 'action', calling method: ShareTypesController._remove_project_access, body: {"removeProjectAccess": {"project": "35d84ed7cf164123a87b8b906a836985"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-aa0b7e0a-f66b-4df6-8e66-acfb70082158 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types/70af56f8-a0ee-4f17-b82c-3f78e274e8d6/action returned with HTTP 202 May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 168/327] 10.27.203.238 () {66 vars in 1490 bytes} [Tue May 28 12:56:59 2024] POST /share/v2/35d84ed7cf164123a87b8b906a836985/types/70af56f8-a0ee-4f17-b82c-3f78e274e8d6/action => generated 0 bytes in 25 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-c8bd1198-66dd-4a96-99de-75939bbe350b tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] GET http://10.27.203.238/share/v1/35d84ed7cf164123a87b8b906a836985/types May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-c8bd1198-66dd-4a96-99de-75939bbe350b tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-c8bd1198-66dd-4a96-99de-75939bbe350b tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Calling method 'ShareTypesController.index' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-e73bbe3a-1ad3-4dcd-b28e-3f26381597b1 tempest-AccessRulesMetadataTest-1973590610 tempest-AccessRulesMetadataTest-1973590610-project-member] GET http://10.27.203.238/share/v2/1643901550e140118fc2d2e92b82cd0b/share-access-rules?share_id=b92fc06b-76d7-40f9-adef-74a07ace1027 May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-e73bbe3a-1ad3-4dcd-b28e-3f26381597b1 tempest-AccessRulesMetadataTest-1973590610 tempest-AccessRulesMetadataTest-1973590610-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-c8bd1198-66dd-4a96-99de-75939bbe350b tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] http://10.27.203.238/share/v1/35d84ed7cf164123a87b8b906a836985/types returned with HTTP 200 May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-e73bbe3a-1ad3-4dcd-b28e-3f26381597b1 tempest-AccessRulesMetadataTest-1973590610 tempest-AccessRulesMetadataTest-1973590610-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 160/328] 10.27.203.238 () {62 vars in 1294 bytes} [Tue May 28 12:56:59 2024] GET /share/v1/35d84ed7cf164123a87b8b906a836985/types => generated 4103 bytes in 14 msecs (HTTP/1.1 200) 6 headers in 231 bytes (2 switches on core 0) May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-1b8e3e54-2666-48f9-b7d2-7ec34205e4d8 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] GET http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types/70af56f8-a0ee-4f17-b82c-3f78e274e8d6/share_type_access May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-1b8e3e54-2666-48f9-b7d2-7ec34205e4d8 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-1b8e3e54-2666-48f9-b7d2-7ec34205e4d8 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Calling method 'ShareTypesController.share_type_access' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-1b8e3e54-2666-48f9-b7d2-7ec34205e4d8 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types/70af56f8-a0ee-4f17-b82c-3f78e274e8d6/share_type_access returned with HTTP 200 May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 161/329] 10.27.203.238 () {64 vars in 1502 bytes} [Tue May 28 12:56:59 2024] GET /share/v2/35d84ed7cf164123a87b8b906a836985/types/70af56f8-a0ee-4f17-b82c-3f78e274e8d6/share_type_access => generated 25 bytes in 9 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-c89e921c-0076-4730-9359-de1229ed3700 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] POST http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-c89e921c-0076-4730-9359-de1229ed3700 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share_type": {"name": "tempest-tempest-manila-1761561417", "extra_specs": {"driver_handles_share_servers": "False"}, "share_type_access:is_public": true}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-c89e921c-0076-4730-9359-de1229ed3700 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types returned with HTTP 200 May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 162/330] 10.27.203.238 () {66 vars in 1359 bytes} [Tue May 28 12:56:59 2024] POST /share/v2/35d84ed7cf164123a87b8b906a836985/types => generated 623 bytes in 20 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-d0ea4b18-a448-4a44-b51c-568a512d37d0 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] DELETE http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types/2e3db65d-a376-4369-bc50-bf89c94eb6ee May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-d0ea4b18-a448-4a44-b51c-568a512d37d0 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-d0ea4b18-a448-4a44-b51c-568a512d37d0 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Calling method 'ShareTypesController._delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.lock.api [None req-e73bbe3a-1ad3-4dcd-b28e-3f26381597b1 tempest-AccessRulesMetadataTest-1973590610 tempest-AccessRulesMetadataTest-1973590610-project-member] Searching for locks by: {'resource_id': '065fb8ea-fc05-4af3-b191-603cca79c74e', 'resource_action': 'show', 'resource_type': 'access_rule'} {{(pid=98329) get_all /opt/stack/manila/manila/lock/api.py:112}} May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.lock.api [None req-e73bbe3a-1ad3-4dcd-b28e-3f26381597b1 tempest-AccessRulesMetadataTest-1973590610 tempest-AccessRulesMetadataTest-1973590610-project-member] Searching for locks by: {'resource_id': 'f4507547-5ed1-4027-b15a-ba64f3ba185c', 'resource_action': 'show', 'resource_type': 'access_rule'} {{(pid=98329) get_all /opt/stack/manila/manila/lock/api.py:112}} May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-e73bbe3a-1ad3-4dcd-b28e-3f26381597b1 tempest-AccessRulesMetadataTest-1973590610 tempest-AccessRulesMetadataTest-1973590610-project-member] http://10.27.203.238/share/v2/1643901550e140118fc2d2e92b82cd0b/share-access-rules?share_id=b92fc06b-76d7-40f9-adef-74a07ace1027 returned with HTTP 200 May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 169/331] 10.27.203.238 () {64 vars in 1467 bytes} [Tue May 28 12:56:59 2024] GET /share/v2/1643901550e140118fc2d2e92b82cd0b/share-access-rules?share_id=b92fc06b-76d7-40f9-adef-74a07ace1027 => generated 1164 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-27719732-b484-4faa-9f47-77ab8dd7b2b0 tempest-AccessRulesMetadataTest-1973590610 tempest-AccessRulesMetadataTest-1973590610-project-member] GET http://10.27.203.238/share/v2/1643901550e140118fc2d2e92b82cd0b/share-access-rules/f4507547-5ed1-4027-b15a-ba64f3ba185c May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-27719732-b484-4faa-9f47-77ab8dd7b2b0 tempest-AccessRulesMetadataTest-1973590610 tempest-AccessRulesMetadataTest-1973590610-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-27719732-b484-4faa-9f47-77ab8dd7b2b0 tempest-AccessRulesMetadataTest-1973590610 tempest-AccessRulesMetadataTest-1973590610-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-d0ea4b18-a448-4a44-b51c-568a512d37d0 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types/2e3db65d-a376-4369-bc50-bf89c94eb6ee returned with HTTP 202 May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 163/332] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:56:59 2024] DELETE /share/v2/35d84ed7cf164123a87b8b906a836985/types/2e3db65d-a376-4369-bc50-bf89c94eb6ee => generated 0 bytes in 33 msecs (HTTP/1.1 202) 6 headers in 243 bytes (2 switches on core 0) May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-302417de-908b-4128-9ffe-5c634be5f390 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] GET http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types/2e3db65d-a376-4369-bc50-bf89c94eb6ee May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-302417de-908b-4128-9ffe-5c634be5f390 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-302417de-908b-4128-9ffe-5c634be5f390 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Calling method 'ShareTypesController.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-302417de-908b-4128-9ffe-5c634be5f390 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] HTTP exception thrown: Share type not found. May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-302417de-908b-4128-9ffe-5c634be5f390 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types/2e3db65d-a376-4369-bc50-bf89c94eb6ee returned with HTTP 404 May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 164/333] 10.27.203.238 () {64 vars in 1448 bytes} [Tue May 28 12:56:59 2024] GET /share/v2/35d84ed7cf164123a87b8b906a836985/types/2e3db65d-a376-4369-bc50-bf89c94eb6ee => generated 67 bytes in 11 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-54eb94ca-b63a-4d08-8ee0-ec72bf8f5547 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] GET http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types/2e3db65d-a376-4369-bc50-bf89c94eb6ee May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-54eb94ca-b63a-4d08-8ee0-ec72bf8f5547 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-54eb94ca-b63a-4d08-8ee0-ec72bf8f5547 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Calling method 'ShareTypesController.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-54eb94ca-b63a-4d08-8ee0-ec72bf8f5547 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] HTTP exception thrown: Share type not found. May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-54eb94ca-b63a-4d08-8ee0-ec72bf8f5547 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types/2e3db65d-a376-4369-bc50-bf89c94eb6ee returned with HTTP 404 May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 165/334] 10.27.203.238 () {64 vars in 1448 bytes} [Tue May 28 12:56:59 2024] GET /share/v2/35d84ed7cf164123a87b8b906a836985/types/2e3db65d-a376-4369-bc50-bf89c94eb6ee => generated 67 bytes in 10 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.lock.api [None req-27719732-b484-4faa-9f47-77ab8dd7b2b0 tempest-AccessRulesMetadataTest-1973590610 tempest-AccessRulesMetadataTest-1973590610-project-member] Searching for locks by: {'resource_id': 'f4507547-5ed1-4027-b15a-ba64f3ba185c', 'resource_action': 'show', 'resource_type': 'access_rule'} {{(pid=98329) get_all /opt/stack/manila/manila/lock/api.py:112}} May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-9ae4cfcf-72e2-4733-a149-a7cc57837004 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] POST http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-9ae4cfcf-72e2-4733-a149-a7cc57837004 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share_type": {"name": "tempest-tempest-manila-1138705478", "extra_specs": {"driver_handles_share_servers": "False", "key": "value"}, "os-share-type-access:is_public": true}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-27719732-b484-4faa-9f47-77ab8dd7b2b0 tempest-AccessRulesMetadataTest-1973590610 tempest-AccessRulesMetadataTest-1973590610-project-member] http://10.27.203.238/share/v2/1643901550e140118fc2d2e92b82cd0b/share-access-rules/f4507547-5ed1-4027-b15a-ba64f3ba185c returned with HTTP 200 May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 170/335] 10.27.203.238 () {64 vars in 1487 bytes} [Tue May 28 12:56:59 2024] GET /share/v2/1643901550e140118fc2d2e92b82cd0b/share-access-rules/f4507547-5ed1-4027-b15a-ba64f3ba185c => generated 886 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 231 bytes (2 switches on core 0) May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-a038bcd5-16b1-4f7b-83f9-84b93fee4256 tempest-AccessRulesMetadataTest-1973590610 tempest-AccessRulesMetadataTest-1973590610-project-member] DELETE http://10.27.203.238/share/v2/1643901550e140118fc2d2e92b82cd0b/share-access-rules/f4507547-5ed1-4027-b15a-ba64f3ba185c/metadata/key1 May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-a038bcd5-16b1-4f7b-83f9-84b93fee4256 tempest-AccessRulesMetadataTest-1973590610 tempest-AccessRulesMetadataTest-1973590610-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-a038bcd5-16b1-4f7b-83f9-84b93fee4256 tempest-AccessRulesMetadataTest-1973590610 tempest-AccessRulesMetadataTest-1973590610-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:59 l75lg1-v1 neutron-server[77619]: DEBUG dbcounter [-] [77619] Writing DB stats neutron:SELECT=2 {{(pid=77619) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-9ae4cfcf-72e2-4733-a149-a7cc57837004 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types returned with HTTP 200 May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 166/336] 10.27.203.238 () {66 vars in 1358 bytes} [Tue May 28 12:56:59 2024] POST /share/v2/35d84ed7cf164123a87b8b906a836985/types => generated 633 bytes in 26 msecs (HTTP/1.1 200) 6 headers in 230 bytes (2 switches on core 0) May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-fccee658-131f-4766-9718-64731b811549 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] GET http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types/5debb07d-1f82-4b75-86c8-2d76a921ab8f May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-fccee658-131f-4766-9718-64731b811549 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-fccee658-131f-4766-9718-64731b811549 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Calling method 'ShareTypesController.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-fccee658-131f-4766-9718-64731b811549 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types/5debb07d-1f82-4b75-86c8-2d76a921ab8f returned with HTTP 200 May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 167/337] 10.27.203.238 () {64 vars in 1447 bytes} [Tue May 28 12:56:59 2024] GET /share/v2/35d84ed7cf164123a87b8b906a836985/types/5debb07d-1f82-4b75-86c8-2d76a921ab8f => generated 633 bytes in 10 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-1d891baf-6ae9-47f8-b306-3a39c49a31be tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] GET http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/shares/9be3b244-34ab-4002-b1e1-427af2ab8545 May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-1d891baf-6ae9-47f8-b306-3a39c49a31be tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-1d891baf-6ae9-47f8-b306-3a39c49a31be tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-1d891baf-6ae9-47f8-b306-3a39c49a31be tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/shares/9be3b244-34ab-4002-b1e1-427af2ab8545 returned with HTTP 200 May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 168/338] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:56:59 2024] GET /share/v2/a3499cb78849424db45e54caac01de92/shares/9be3b244-34ab-4002-b1e1-427af2ab8545 => generated 1372 bytes in 24 msecs (HTTP/1.1 200) 6 headers in 232 bytes (2 switches on core 0) May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-fc92c72e-8225-43f4-b6df-bc5f97cc8a40 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] POST http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-fc92c72e-8225-43f4-b6df-bc5f97cc8a40 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share_type": {"name": "tempest-tempest-manila-1277613871", "extra_specs": {"driver_handles_share_servers": "False", "key": "value"}, "os-share-type-access:is_public": true}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-fc92c72e-8225-43f4-b6df-bc5f97cc8a40 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types returned with HTTP 200 May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-a038bcd5-16b1-4f7b-83f9-84b93fee4256 tempest-AccessRulesMetadataTest-1973590610 tempest-AccessRulesMetadataTest-1973590610-project-member] http://10.27.203.238/share/v2/1643901550e140118fc2d2e92b82cd0b/share-access-rules/f4507547-5ed1-4027-b15a-ba64f3ba185c/metadata/key1 returned with HTTP 200 May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 169/339] 10.27.203.238 () {66 vars in 1358 bytes} [Tue May 28 12:56:59 2024] POST /share/v2/35d84ed7cf164123a87b8b906a836985/types => generated 633 bytes in 23 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 171/340] 10.27.203.238 () {64 vars in 1532 bytes} [Tue May 28 12:56:59 2024] DELETE /share/v2/1643901550e140118fc2d2e92b82cd0b/share-access-rules/f4507547-5ed1-4027-b15a-ba64f3ba185c/metadata/key1 => generated 0 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 229 bytes (1 switches on core 0) May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-6e54a78c-4794-448a-be5d-5a31c17c1dd6 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] POST http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/shares/9be3b244-34ab-4002-b1e1-427af2ab8545/action May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-6e54a78c-4794-448a-be5d-5a31c17c1dd6 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Action body: b'{"extend": {"new_size": 2, "force": false}}' {{(pid=98330) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-6e54a78c-4794-448a-be5d-5a31c17c1dd6 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Action: 'action', calling method: Controller.__getattribute__..version_select, body: {"extend": {"new_size": 2, "force": false}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-045dc2ce-5e71-4e7e-b6fa-fa1ff6ced68b tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] GET http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types/238d4e44-28b7-4ce6-bb66-9e8a6a669e93 May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-045dc2ce-5e71-4e7e-b6fa-fa1ff6ced68b tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-045dc2ce-5e71-4e7e-b6fa-fa1ff6ced68b tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Calling method 'ShareTypesController.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-045dc2ce-5e71-4e7e-b6fa-fa1ff6ced68b tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types/238d4e44-28b7-4ce6-bb66-9e8a6a669e93 returned with HTTP 200 May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 172/341] 10.27.203.238 () {64 vars in 1447 bytes} [Tue May 28 12:56:59 2024] GET /share/v2/35d84ed7cf164123a87b8b906a836985/types/238d4e44-28b7-4ce6-bb66-9e8a6a669e93 => generated 633 bytes in 11 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-c7386e21-6789-44dd-8728-06cdecbf0784 tempest-AccessRulesMetadataTest-1973590610 tempest-AccessRulesMetadataTest-1973590610-project-member] DELETE http://10.27.203.238/share/v2/1643901550e140118fc2d2e92b82cd0b/share-access-rules/f4507547-5ed1-4027-b15a-ba64f3ba185c/metadata/kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-c7386e21-6789-44dd-8728-06cdecbf0784 tempest-AccessRulesMetadataTest-1973590610 tempest-AccessRulesMetadataTest-1973590610-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-c7386e21-6789-44dd-8728-06cdecbf0784 tempest-AccessRulesMetadataTest-1973590610 tempest-AccessRulesMetadataTest-1973590610-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-c7386e21-6789-44dd-8728-06cdecbf0784 tempest-AccessRulesMetadataTest-1973590610 tempest-AccessRulesMetadataTest-1973590610-project-member] http://10.27.203.238/share/v2/1643901550e140118fc2d2e92b82cd0b/share-access-rules/f4507547-5ed1-4027-b15a-ba64f3ba185c/metadata/kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk returned with HTTP 200 May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 173/342] 10.27.203.238 () {64 vars in 2285 bytes} [Tue May 28 12:56:59 2024] DELETE /share/v2/1643901550e140118fc2d2e92b82cd0b/share-access-rules/f4507547-5ed1-4027-b15a-ba64f3ba185c/metadata/kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk => generated 0 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 229 bytes (1 switches on core 0) May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-6421535e-54de-48f1-b6d9-426d847fbec4 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] POST http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-6421535e-54de-48f1-b6d9-426d847fbec4 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share_type": {"name": "tempest-tempest-manila-626907912", "extra_specs": {"driver_handles_share_servers": "False", "key": "value"}, "share_type_access:is_public": true}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.quota [None req-6e54a78c-4794-448a-be5d-5a31c17c1dd6 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Created reservations ['799c71ba-a635-42b5-b54d-1d1c9b7b6391', 'c576ca57-e051-4523-b2f8-66cdb687a27f'] {{(pid=98330) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-6421535e-54de-48f1-b6d9-426d847fbec4 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types returned with HTTP 200 May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 174/343] 10.27.203.238 () {66 vars in 1358 bytes} [Tue May 28 12:56:59 2024] POST /share/v2/35d84ed7cf164123a87b8b906a836985/types => generated 625 bytes in 22 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-44bd6204-be63-4f3b-bdbb-740d955fccc6 tempest-AccessRulesMetadataTest-1973590610 tempest-AccessRulesMetadataTest-1973590610-project-member] GET http://10.27.203.238/share/v2/1643901550e140118fc2d2e92b82cd0b/share-access-rules/f4507547-5ed1-4027-b15a-ba64f3ba185c May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-44bd6204-be63-4f3b-bdbb-740d955fccc6 tempest-AccessRulesMetadataTest-1973590610 tempest-AccessRulesMetadataTest-1973590610-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-44bd6204-be63-4f3b-bdbb-740d955fccc6 tempest-AccessRulesMetadataTest-1973590610 tempest-AccessRulesMetadataTest-1973590610-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.lock.api [None req-44bd6204-be63-4f3b-bdbb-740d955fccc6 tempest-AccessRulesMetadataTest-1973590610 tempest-AccessRulesMetadataTest-1973590610-project-member] Searching for locks by: {'resource_id': 'f4507547-5ed1-4027-b15a-ba64f3ba185c', 'resource_action': 'show', 'resource_type': 'access_rule'} {{(pid=98329) get_all /opt/stack/manila/manila/lock/api.py:112}} May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.share.api [None req-6e54a78c-4794-448a-be5d-5a31c17c1dd6 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Extend share request issued successfully. May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-6e54a78c-4794-448a-be5d-5a31c17c1dd6 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/shares/9be3b244-34ab-4002-b1e1-427af2ab8545/action returned with HTTP 202 May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 170/344] 10.27.203.238 () {66 vars in 1493 bytes} [Tue May 28 12:56:59 2024] POST /share/v2/a3499cb78849424db45e54caac01de92/shares/9be3b244-34ab-4002-b1e1-427af2ab8545/action => generated 0 bytes in 153 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-44bd6204-be63-4f3b-bdbb-740d955fccc6 tempest-AccessRulesMetadataTest-1973590610 tempest-AccessRulesMetadataTest-1973590610-project-member] http://10.27.203.238/share/v2/1643901550e140118fc2d2e92b82cd0b/share-access-rules/f4507547-5ed1-4027-b15a-ba64f3ba185c returned with HTTP 200 May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 175/345] 10.27.203.238 () {64 vars in 1487 bytes} [Tue May 28 12:56:59 2024] GET /share/v2/1643901550e140118fc2d2e92b82cd0b/share-access-rules/f4507547-5ed1-4027-b15a-ba64f3ba185c => generated 352 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-8c8abeda-18ad-4064-823d-d873335e985d tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] GET http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types/33a31329-99f0-4278-b969-6f60426700d1 May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-8c8abeda-18ad-4064-823d-d873335e985d tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-cdc208d5-24e3-4b15-a58d-e7964fb6be92 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] GET http://10.27.203.238/share/v1/a3499cb78849424db45e54caac01de92/shares/9be3b244-34ab-4002-b1e1-427af2ab8545 May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-cdc208d5-24e3-4b15-a58d-e7964fb6be92 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-8c8abeda-18ad-4064-823d-d873335e985d tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Calling method 'ShareTypesController.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-cdc208d5-24e3-4b15-a58d-e7964fb6be92 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-8c8abeda-18ad-4064-823d-d873335e985d tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types/33a31329-99f0-4278-b969-6f60426700d1 returned with HTTP 200 May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 171/346] 10.27.203.238 () {64 vars in 1447 bytes} [Tue May 28 12:56:59 2024] GET /share/v2/35d84ed7cf164123a87b8b906a836985/types/33a31329-99f0-4278-b969-6f60426700d1 => generated 625 bytes in 11 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-4efdd4ce-e86a-4ef2-8f3e-457013deabfe tempest-AccessRulesMetadataTest-1973590610 tempest-AccessRulesMetadataTest-1973590610-project-member] POST http://10.27.203.238/share/v2/1643901550e140118fc2d2e92b82cd0b/shares/b92fc06b-76d7-40f9-adef-74a07ace1027/action May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-4efdd4ce-e86a-4ef2-8f3e-457013deabfe tempest-AccessRulesMetadataTest-1973590610 tempest-AccessRulesMetadataTest-1973590610-project-member] Action body: b'{"deny_access": {"access_id": "f4507547-5ed1-4027-b15a-ba64f3ba185c"}}' {{(pid=98330) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-4efdd4ce-e86a-4ef2-8f3e-457013deabfe tempest-AccessRulesMetadataTest-1973590610 tempest-AccessRulesMetadataTest-1973590610-project-member] Action: 'action', calling method: ShareController.deny_access, body: {"deny_access": {"access_id": "f4507547-5ed1-4027-b15a-ba64f3ba185c"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.lock.api [None req-4efdd4ce-e86a-4ef2-8f3e-457013deabfe tempest-AccessRulesMetadataTest-1973590610 tempest-AccessRulesMetadataTest-1973590610-project-member] Searching for locks by: {'resource_id': 'f4507547-5ed1-4027-b15a-ba64f3ba185c', 'resource_action': 'delete'} {{(pid=98330) get_all /opt/stack/manila/manila/lock/api.py:112}} May 28 12:56:59 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c07df379-c3ad-4b79-82d1-01d37d41940f tempest-ShareInstancesNegativeTest-210953919 None] <<< [GET] https://127.0.0.1:40443/api/views/ May 28 12:56:59 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c07df379-c3ad-4b79-82d1-01d37d41940f tempest-ShareInstancesNegativeTest-210953919 None] [Bunch(abac_tags=[], abe_max_depth=None, abe_protocols=[], alias='', allow_anonymous_access=False, allow_s3_anonymous_access=False, auto_commit='0d', bucket='', bucket_creators=[], bucket_creators_groups=[], bucket_owner=None, bulk_permission_update_progress=None, bulk_permission_update_state=None, cluster='loop75-kfs', cluster_id=1, created='2024-05-28T12:56:57.398461Z', enabled=True, files_retention_mode='NONE', guid='a78ec6a5-bdf3-48b2-8727-fff6076b4ca7', id=10, ignore_oos=False, internal=False, is_remote=False, is_seamless=False, logical_capacity=0, max_retention_period=None, min_retention_period=None, name='9b44eaf4-da6e-42e7-8723-ce0cc8878f85', nfs_interop_flags='BOTH_NFS3_AND_NFS4_INTEROP_DISABLED', path='/manila/manila-9b44eaf4-da6e-42e7-8723-ce0cc8878f85', physical_capacity=0, policy='9b44eaf4-da6e-42e7-8723-ce0cc8878f85', policy_id=11, protocols=['NFS'], qos_policy=None, qos_policy_id=None, s3_locks=False, s3_locks_retention_mode='NONE', s3_locks_retention_period='', s3_unverified_lookup=False, s3_versioning=False, select_for_live_monitoring=False, share='', share_acl=Bunch(acl=[], enabled=False), sync='SYNCED', sync_time='2024-05-28T12:56:57.649716Z', tenant_id=1, tenant_name='default', title='/manila/manila-9b44eaf4-da6e-42e7-8723-ce0cc8878f85', url='https://127.0.0.1:40443/api/views/10/')] May 28 12:56:59 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c07df379-c3ad-4b79-82d1-01d37d41940f tempest-ShareInstancesNegativeTest-210953919 None] --- [GET] https://127.0.0.1:40443/api/views/: Done May 28 12:56:59 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c07df379-c3ad-4b79-82d1-01d37d41940f tempest-ShareInstancesNegativeTest-210953919 None] >>> [DELETE] https://127.0.0.1:40443/api/views/10/ May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-cdc208d5-24e3-4b15-a58d-e7964fb6be92 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v1/a3499cb78849424db45e54caac01de92/shares/9be3b244-34ab-4002-b1e1-427af2ab8545 returned with HTTP 200 May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 176/347] 10.27.203.238 () {62 vars in 1408 bytes} [Tue May 28 12:56:59 2024] GET /share/v1/a3499cb78849424db45e54caac01de92/shares/9be3b244-34ab-4002-b1e1-427af2ab8545 => generated 954 bytes in 24 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-cda7f36a-3e0b-4258-89c2-12b09e60c7fb tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] POST http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-cda7f36a-3e0b-4258-89c2-12b09e60c7fb tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share_type": {"name": "tempest-tempest-manila-1468040561", "extra_specs": {"driver_handles_share_servers": "False", "key": "value"}, "share_type_access:is_public": true}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:56:59 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-6e54a78c-4794-448a-be5d-5a31c17c1dd6 tempest-AdminActionsTest-1749172189 None] Starting with 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:80}} May 28 12:56:59 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.capacity [None req-6e54a78c-4794-448a-be5d-5a31c17c1dd6 tempest-AdminActionsTest-1749172189 None] Space information for share creation on host l75lg1-v1@vast#vast (requested / avail): 1/2072 {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/capacity.py:83}} May 28 12:56:59 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-6e54a78c-4794-448a-be5d-5a31c17c1dd6 tempest-AdminActionsTest-1749172189 None] Filter CapacityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:56:59 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-6e54a78c-4794-448a-be5d-5a31c17c1dd6 tempest-AdminActionsTest-1749172189 None] Driver Filter: Checking host 'l75lg1-v1@vast#vast' {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:37}} May 28 12:56:59 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-6e54a78c-4794-448a-be5d-5a31c17c1dd6 tempest-AdminActionsTest-1749172189 None] Filter function not set :: passing host. {{(pid=98327) _check_filter_function /opt/stack/manila/manila/scheduler/filters/driver.py:53}} May 28 12:56:59 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-6e54a78c-4794-448a-be5d-5a31c17c1dd6 tempest-AdminActionsTest-1749172189 None] Result: True {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:40}} May 28 12:56:59 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-6e54a78c-4794-448a-be5d-5a31c17c1dd6 tempest-AdminActionsTest-1749172189 None] Done checking host 'l75lg1-v1@vast#vast' {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:41}} May 28 12:56:59 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-6e54a78c-4794-448a-be5d-5a31c17c1dd6 tempest-AdminActionsTest-1749172189 None] Filter DriverFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:56:59 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-6e54a78c-4794-448a-be5d-5a31c17c1dd6 tempest-AdminActionsTest-1749172189 None] Checking host 'l75lg1-v1@vast#vast' {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:46}} May 28 12:56:59 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.weighers.goodness [None req-6e54a78c-4794-448a-be5d-5a31c17c1dd6 tempest-AdminActionsTest-1749172189 None] Goodness function not set :: defaulting to minimal goodness rating of 0. May 28 12:56:59 l75lg1-v1 manila-scheduler[98327]: INFO manila.scheduler.weighers.goodness [None req-6e54a78c-4794-448a-be5d-5a31c17c1dd6 tempest-AdminActionsTest-1749172189 None] Goodness function result for host l75lg1-v1@vast#vast: 0. May 28 12:56:59 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-6e54a78c-4794-448a-be5d-5a31c17c1dd6 tempest-AdminActionsTest-1749172189 None] Goodness: 0 {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:48}} May 28 12:56:59 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-6e54a78c-4794-448a-be5d-5a31c17c1dd6 tempest-AdminActionsTest-1749172189 None] Done checking host 'l75lg1-v1@vast#vast' {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:49}} May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-cda7f36a-3e0b-4258-89c2-12b09e60c7fb tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types returned with HTTP 200 May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 177/348] 10.27.203.238 () {66 vars in 1359 bytes} [Tue May 28 12:56:59 2024] POST /share/v2/35d84ed7cf164123a87b8b906a836985/types => generated 571 bytes in 21 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-c323d158-6b7c-4a52-85ee-7bd280803c7f tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] GET http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types/8f410a55-c636-4b9c-895f-cda92ea6f0ce May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-c323d158-6b7c-4a52-85ee-7bd280803c7f tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-c323d158-6b7c-4a52-85ee-7bd280803c7f tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Calling method 'ShareTypesController.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-c323d158-6b7c-4a52-85ee-7bd280803c7f tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types/8f410a55-c636-4b9c-895f-cda92ea6f0ce returned with HTTP 200 May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 178/349] 10.27.203.238 () {64 vars in 1448 bytes} [Tue May 28 12:56:59 2024] GET /share/v2/35d84ed7cf164123a87b8b906a836985/types/8f410a55-c636-4b9c-895f-cda92ea6f0ce => generated 571 bytes in 10 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-87072531-ce36-441f-bafa-f1b75c04626a tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] POST http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-87072531-ce36-441f-bafa-f1b75c04626a tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share_type": {"name": "tempest-tempest-manila-692625117", "extra_specs": {"driver_handles_share_servers": "False", "key": "value"}, "share_type_access:is_public": true, "description": "Description for share type"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:56:59 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-6e54a78c-4794-448a-be5d-5a31c17c1dd6 tempest-AdminActionsTest-1749172189 None] >>> [GET] https://127.0.0.1:40443/api/quotas/ May 28 12:56:59 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-6e54a78c-4794-448a-be5d-5a31c17c1dd6 tempest-AdminActionsTest-1749172189 None] {'allow_redirects': True, May 28 12:56:59 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-6e54a78c-4794-448a-be5d-5a31c17c1dd6 tempest-AdminActionsTest-1749172189 None] 'params': {'name': '4016fe10-12f4-48fc-92de-42cdd2fff998'}} May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-87072531-ce36-441f-bafa-f1b75c04626a tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types returned with HTTP 200 May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 179/350] 10.27.203.238 () {66 vars in 1359 bytes} [Tue May 28 12:56:59 2024] POST /share/v2/35d84ed7cf164123a87b8b906a836985/types => generated 659 bytes in 23 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-d9cb507a-e772-4bcc-9474-f2de982a673c tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] GET http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types/2a604dfb-5878-44de-90b0-fb91db1c433d May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-d9cb507a-e772-4bcc-9474-f2de982a673c tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-d9cb507a-e772-4bcc-9474-f2de982a673c tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Calling method 'ShareTypesController.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-d9cb507a-e772-4bcc-9474-f2de982a673c tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types/2a604dfb-5878-44de-90b0-fb91db1c433d returned with HTTP 200 May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 180/351] 10.27.203.238 () {64 vars in 1448 bytes} [Tue May 28 12:56:59 2024] GET /share/v2/35d84ed7cf164123a87b8b906a836985/types/2a604dfb-5878-44de-90b0-fb91db1c433d => generated 659 bytes in 10 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-4efdd4ce-e86a-4ef2-8f3e-457013deabfe tempest-AccessRulesMetadataTest-1973590610 tempest-AccessRulesMetadataTest-1973590610-project-member] Acquiring lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-4efdd4ce-e86a-4ef2-8f3e-457013deabfe tempest-AccessRulesMetadataTest-1973590610 tempest-AccessRulesMetadataTest-1973590610-project-member] Lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-2e20a68f-79d0-42ff-8aa3-253275f61cff tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] POST http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-2e20a68f-79d0-42ff-8aa3-253275f61cff tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share_type": {"name": "tempest-tempest-manila-1744979018", "extra_specs": {"driver_handles_share_servers": "False"}, "os-share-type-access:is_public": true}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-2e20a68f-79d0-42ff-8aa3-253275f61cff tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types returned with HTTP 200 May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 181/352] 10.27.203.238 () {66 vars in 1358 bytes} [Tue May 28 12:56:59 2024] POST /share/v2/35d84ed7cf164123a87b8b906a836985/types => generated 601 bytes in 24 msecs (HTTP/1.1 200) 6 headers in 230 bytes (2 switches on core 0) May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-05dfaef7-4db4-4544-a0a2-e416e3070c92 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] GET http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-05dfaef7-4db4-4544-a0a2-e416e3070c92 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-05dfaef7-4db4-4544-a0a2-e416e3070c92 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Calling method 'ShareTypesController.index' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-05dfaef7-4db4-4544-a0a2-e416e3070c92 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types returned with HTTP 200 May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 182/353] 10.27.203.238 () {64 vars in 1336 bytes} [Tue May 28 12:56:59 2024] GET /share/v2/35d84ed7cf164123a87b8b906a836985/types => generated 7579 bytes in 15 msecs (HTTP/1.1 200) 6 headers in 231 bytes (2 switches on core 0) May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-82cc1e2e-29bf-458a-9452-eb6e903446fb tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] POST http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-4efdd4ce-e86a-4ef2-8f3e-457013deabfe tempest-AccessRulesMetadataTest-1973590610 tempest-AccessRulesMetadataTest-1973590610-project-member] Lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.053s {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-82cc1e2e-29bf-458a-9452-eb6e903446fb tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share_type": {"name": "tempest-tempest-manila-126168210", "extra_specs": {"driver_handles_share_servers": "False"}, "os-share-type-access:is_public": true}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-4efdd4ce-e86a-4ef2-8f3e-457013deabfe tempest-AccessRulesMetadataTest-1973590610 tempest-AccessRulesMetadataTest-1973590610-project-member] Acquiring lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-4efdd4ce-e86a-4ef2-8f3e-457013deabfe tempest-AccessRulesMetadataTest-1973590610 tempest-AccessRulesMetadataTest-1973590610-project-member] Lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-82cc1e2e-29bf-458a-9452-eb6e903446fb tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types returned with HTTP 200 May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 183/354] 10.27.203.238 () {66 vars in 1358 bytes} [Tue May 28 12:56:59 2024] POST /share/v2/35d84ed7cf164123a87b8b906a836985/types => generated 599 bytes in 22 msecs (HTTP/1.1 200) 6 headers in 230 bytes (2 switches on core 0) May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-2ddc8b0f-c585-4511-bbbf-e791160ef157 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] GET http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-2ddc8b0f-c585-4511-bbbf-e791160ef157 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-2ddc8b0f-c585-4511-bbbf-e791160ef157 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Calling method 'ShareTypesController.index' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-2ddc8b0f-c585-4511-bbbf-e791160ef157 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types returned with HTTP 200 May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 184/355] 10.27.203.238 () {64 vars in 1336 bytes} [Tue May 28 12:56:59 2024] GET /share/v2/35d84ed7cf164123a87b8b906a836985/types => generated 8149 bytes in 15 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-e74c9c9b-ce11-49a1-aadb-884db5bd9fe8 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] POST http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types May 28 12:56:59 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-e74c9c9b-ce11-49a1-aadb-884db5bd9fe8 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share_type": {"name": "tempest-tempest-manila-1078857351", "extra_specs": {"driver_handles_share_servers": "False"}, "share_type_access:is_public": true}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:57:00 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-e74c9c9b-ce11-49a1-aadb-884db5bd9fe8 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types returned with HTTP 200 May 28 12:57:00 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 185/356] 10.27.203.238 () {66 vars in 1358 bytes} [Tue May 28 12:56:59 2024] POST /share/v2/35d84ed7cf164123a87b8b906a836985/types => generated 595 bytes in 24 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:57:00 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-da07eb0b-a426-4865-96f8-761a93ba1456 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] GET http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types May 28 12:57:00 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-da07eb0b-a426-4865-96f8-761a93ba1456 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:00 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-da07eb0b-a426-4865-96f8-761a93ba1456 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Calling method 'ShareTypesController.index' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:00 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-4efdd4ce-e86a-4ef2-8f3e-457013deabfe tempest-AccessRulesMetadataTest-1973590610 tempest-AccessRulesMetadataTest-1973590610-project-member] Lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.076s {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:57:00 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-4efdd4ce-e86a-4ef2-8f3e-457013deabfe tempest-AccessRulesMetadataTest-1973590610 tempest-AccessRulesMetadataTest-1973590610-project-member] http://10.27.203.238/share/v2/1643901550e140118fc2d2e92b82cd0b/shares/b92fc06b-76d7-40f9-adef-74a07ace1027/action returned with HTTP 202 May 28 12:57:00 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 172/357] 10.27.203.238 () {66 vars in 1493 bytes} [Tue May 28 12:56:59 2024] POST /share/v2/1643901550e140118fc2d2e92b82cd0b/shares/b92fc06b-76d7-40f9-adef-74a07ace1027/action => generated 0 bytes in 227 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:57:00 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-da07eb0b-a426-4865-96f8-761a93ba1456 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types returned with HTTP 200 May 28 12:57:00 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 186/358] 10.27.203.238 () {64 vars in 1336 bytes} [Tue May 28 12:57:00 2024] GET /share/v2/35d84ed7cf164123a87b8b906a836985/types => generated 8625 bytes in 15 msecs (HTTP/1.1 200) 6 headers in 231 bytes (2 switches on core 0) May 28 12:57:00 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-4356e045-1030-4778-9f01-fc9f97890b84 tempest-AccessRulesMetadataTest-1973590610 tempest-AccessRulesMetadataTest-1973590610-project-member] GET http://10.27.203.238/share/v2/1643901550e140118fc2d2e92b82cd0b/share-access-rules?share_id=b92fc06b-76d7-40f9-adef-74a07ace1027 May 28 12:57:00 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-4356e045-1030-4778-9f01-fc9f97890b84 tempest-AccessRulesMetadataTest-1973590610 tempest-AccessRulesMetadataTest-1973590610-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:00 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-4356e045-1030-4778-9f01-fc9f97890b84 tempest-AccessRulesMetadataTest-1973590610 tempest-AccessRulesMetadataTest-1973590610-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:00 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-83e3a4aa-4774-4bc8-bcb1-387d8898cc22 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] POST http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types May 28 12:57:00 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-83e3a4aa-4774-4bc8-bcb1-387d8898cc22 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share_type": {"name": "tempest-tempest-manila-1469395506", "extra_specs": {"driver_handles_share_servers": "False"}, "share_type_access:is_public": true}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:57:00 l75lg1-v1 manila-share[98474]: DEBUG manila.share.manager [None req-4efdd4ce-e86a-4ef2-8f3e-457013deabfe tempest-AccessRulesMetadataTest-1973590610 None] Received request to update access for share instance 95118a75-173c-4257-acef-78a246ee1c67. {{(pid=98474) update_access_for_instances /opt/stack/manila/manila/share/manager.py:4353}} May 28 12:57:00 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-83e3a4aa-4774-4bc8-bcb1-387d8898cc22 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types returned with HTTP 200 May 28 12:57:00 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 187/359] 10.27.203.238 () {66 vars in 1359 bytes} [Tue May 28 12:57:00 2024] POST /share/v2/35d84ed7cf164123a87b8b906a836985/types => generated 539 bytes in 21 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:57:00 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-42508ccf-8090-4f61-b73b-9dd2bb4e4a7f tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] GET http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types May 28 12:57:00 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-42508ccf-8090-4f61-b73b-9dd2bb4e4a7f tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:00 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-42508ccf-8090-4f61-b73b-9dd2bb4e4a7f tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Calling method 'ShareTypesController.index' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:00 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-42508ccf-8090-4f61-b73b-9dd2bb4e4a7f tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types returned with HTTP 200 May 28 12:57:00 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 188/360] 10.27.203.238 () {64 vars in 1337 bytes} [Tue May 28 12:57:00 2024] GET /share/v2/35d84ed7cf164123a87b8b906a836985/types => generated 9135 bytes in 16 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:57:00 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-4efdd4ce-e86a-4ef2-8f3e-457013deabfe tempest-AccessRulesMetadataTest-1973590610 None] Acquiring lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:57:00 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-4efdd4ce-e86a-4ef2-8f3e-457013deabfe tempest-AccessRulesMetadataTest-1973590610 None] Lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:57:00 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-4efdd4ce-e86a-4ef2-8f3e-457013deabfe tempest-AccessRulesMetadataTest-1973590610 None] Lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.006s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:57:00 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-a89a0062-dbfb-425b-842b-a3d555ebfbd8 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] POST http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types May 28 12:57:00 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-4efdd4ce-e86a-4ef2-8f3e-457013deabfe tempest-AccessRulesMetadataTest-1973590610 None] Acquiring lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:57:00 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.lock.api [None req-4356e045-1030-4778-9f01-fc9f97890b84 tempest-AccessRulesMetadataTest-1973590610 tempest-AccessRulesMetadataTest-1973590610-project-member] Searching for locks by: {'resource_id': '065fb8ea-fc05-4af3-b191-603cca79c74e', 'resource_action': 'show', 'resource_type': 'access_rule'} {{(pid=98330) get_all /opt/stack/manila/manila/lock/api.py:112}} May 28 12:57:00 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-4efdd4ce-e86a-4ef2-8f3e-457013deabfe tempest-AccessRulesMetadataTest-1973590610 None] Lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:57:00 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-a89a0062-dbfb-425b-842b-a3d555ebfbd8 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share_type": {"name": "tempest-tempest-manila-1024054891", "extra_specs": {"driver_handles_share_servers": "False"}, "share_type_access:is_public": true, "description": "Description for share type"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:57:00 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.lock.api [None req-4356e045-1030-4778-9f01-fc9f97890b84 tempest-AccessRulesMetadataTest-1973590610 tempest-AccessRulesMetadataTest-1973590610-project-member] Searching for locks by: {'resource_id': 'f4507547-5ed1-4027-b15a-ba64f3ba185c', 'resource_action': 'show', 'resource_type': 'access_rule'} {{(pid=98330) get_all /opt/stack/manila/manila/lock/api.py:112}} May 28 12:57:00 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-4356e045-1030-4778-9f01-fc9f97890b84 tempest-AccessRulesMetadataTest-1973590610 tempest-AccessRulesMetadataTest-1973590610-project-member] http://10.27.203.238/share/v2/1643901550e140118fc2d2e92b82cd0b/share-access-rules?share_id=b92fc06b-76d7-40f9-adef-74a07ace1027 returned with HTTP 200 May 28 12:57:00 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 173/361] 10.27.203.238 () {64 vars in 1467 bytes} [Tue May 28 12:57:00 2024] GET /share/v2/1643901550e140118fc2d2e92b82cd0b/share-access-rules?share_id=b92fc06b-76d7-40f9-adef-74a07ace1027 => generated 638 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:57:00 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-a89a0062-dbfb-425b-842b-a3d555ebfbd8 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types returned with HTTP 200 May 28 12:57:00 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 189/362] 10.27.203.238 () {66 vars in 1359 bytes} [Tue May 28 12:57:00 2024] POST /share/v2/35d84ed7cf164123a87b8b906a836985/types => generated 629 bytes in 20 msecs (HTTP/1.1 200) 6 headers in 231 bytes (2 switches on core 0) May 28 12:57:00 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-3c781c2f-6dd2-4d59-ab22-f1558a6269a5 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] GET http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types May 28 12:57:00 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-3c781c2f-6dd2-4d59-ab22-f1558a6269a5 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:00 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-3c781c2f-6dd2-4d59-ab22-f1558a6269a5 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Calling method 'ShareTypesController.index' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:00 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-3c781c2f-6dd2-4d59-ab22-f1558a6269a5 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types returned with HTTP 200 May 28 12:57:00 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 174/363] 10.27.203.238 () {64 vars in 1337 bytes} [Tue May 28 12:57:00 2024] GET /share/v2/35d84ed7cf164123a87b8b906a836985/types => generated 10497 bytes in 17 msecs (HTTP/1.1 200) 6 headers in 233 bytes (1 switches on core 0) May 28 12:57:00 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-736b3556-54b9-4dc2-97f4-beb35e446881 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] POST http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types May 28 12:57:00 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-736b3556-54b9-4dc2-97f4-beb35e446881 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share_type": {"name": "tempest-tempest-manila-817738855", "extra_specs": {"driver_handles_share_servers": "False"}, "share_type_access:is_public": true}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:57:00 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-4efdd4ce-e86a-4ef2-8f3e-457013deabfe tempest-AccessRulesMetadataTest-1973590610 None] Lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.054s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:57:00 l75lg1-v1 manila-share[98474]: DEBUG manila.share.access [None req-4efdd4ce-e86a-4ef2-8f3e-457013deabfe tempest-AccessRulesMetadataTest-1973590610 None] Updating access rules for share instance 95118a75-173c-4257-acef-78a246ee1c67 belonging to share b92fc06b-76d7-40f9-adef-74a07ace1027. {{(pid=98474) update_access_rules /opt/stack/manila/manila/share/access.py:298}} May 28 12:57:00 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-736b3556-54b9-4dc2-97f4-beb35e446881 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types returned with HTTP 200 May 28 12:57:00 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 190/364] 10.27.203.238 () {66 vars in 1359 bytes} [Tue May 28 12:57:00 2024] POST /share/v2/35d84ed7cf164123a87b8b906a836985/types => generated 579 bytes in 27 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:57:00 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-35656c18-8032-4494-b80b-4716c179e12e tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] GET http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types May 28 12:57:00 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-35656c18-8032-4494-b80b-4716c179e12e tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:00 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-35656c18-8032-4494-b80b-4716c179e12e tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Calling method 'ShareTypesController.index' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:00 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-4efdd4ce-e86a-4ef2-8f3e-457013deabfe tempest-AccessRulesMetadataTest-1973590610 None] Acquiring lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:57:00 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-4efdd4ce-e86a-4ef2-8f3e-457013deabfe tempest-AccessRulesMetadataTest-1973590610 None] Lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:57:00 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-35656c18-8032-4494-b80b-4716c179e12e tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types returned with HTTP 200 May 28 12:57:00 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-4efdd4ce-e86a-4ef2-8f3e-457013deabfe tempest-AccessRulesMetadataTest-1973590610 None] Lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.007s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:57:00 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 175/365] 10.27.203.238 () {64 vars in 1337 bytes} [Tue May 28 12:57:00 2024] GET /share/v2/35d84ed7cf164123a87b8b906a836985/types => generated 11047 bytes in 16 msecs (HTTP/1.1 200) 6 headers in 233 bytes (1 switches on core 0) May 28 12:57:00 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-4efdd4ce-e86a-4ef2-8f3e-457013deabfe tempest-AccessRulesMetadataTest-1973590610 None] Acquiring lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:57:00 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-4efdd4ce-e86a-4ef2-8f3e-457013deabfe tempest-AccessRulesMetadataTest-1973590610 None] Lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:57:00 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-930086cc-d37b-4e48-b2e7-150e81d0cd26 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] GET http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types/838e1647-150d-4bf2-903c-bdbdd81e2460 May 28 12:57:00 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-930086cc-d37b-4e48-b2e7-150e81d0cd26 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:00 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-930086cc-d37b-4e48-b2e7-150e81d0cd26 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Calling method 'ShareTypesController.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:00 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-930086cc-d37b-4e48-b2e7-150e81d0cd26 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types/838e1647-150d-4bf2-903c-bdbdd81e2460 returned with HTTP 200 May 28 12:57:00 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 191/366] 10.27.203.238 () {64 vars in 1448 bytes} [Tue May 28 12:57:00 2024] GET /share/v2/35d84ed7cf164123a87b8b906a836985/types/838e1647-150d-4bf2-903c-bdbdd81e2460 => generated 579 bytes in 15 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:57:00 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-4bdea200-2a3a-498a-8ec8-797d890b0b9a tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] POST http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types May 28 12:57:00 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-4efdd4ce-e86a-4ef2-8f3e-457013deabfe tempest-AccessRulesMetadataTest-1973590610 None] Lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.025s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:57:00 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-4efdd4ce-e86a-4ef2-8f3e-457013deabfe tempest-AccessRulesMetadataTest-1973590610 None] changing access on None May 28 12:57:00 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-4bdea200-2a3a-498a-8ec8-797d890b0b9a tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share_type": {"name": "tempest-tempest-manila-1287808216", "extra_specs": {"driver_handles_share_servers": "False"}, "share_type_access:is_public": true}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:57:00 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-4efdd4ce-e86a-4ef2-8f3e-457013deabfe tempest-AccessRulesMetadataTest-1973590610 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:57:00 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-4efdd4ce-e86a-4ef2-8f3e-457013deabfe tempest-AccessRulesMetadataTest-1973590610 None] {'allow_redirects': True, May 28 12:57:00 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-4efdd4ce-e86a-4ef2-8f3e-457013deabfe tempest-AccessRulesMetadataTest-1973590610 None] 'params': {'name': '95118a75-173c-4257-acef-78a246ee1c67'}} May 28 12:57:00 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-4bdea200-2a3a-498a-8ec8-797d890b0b9a tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types returned with HTTP 200 May 28 12:57:00 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 176/367] 10.27.203.238 () {66 vars in 1359 bytes} [Tue May 28 12:57:00 2024] POST /share/v2/35d84ed7cf164123a87b8b906a836985/types => generated 623 bytes in 20 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:57:00 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-a2b1e520-6290-4f46-95c4-4e92cd0a7b35 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] GET http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types May 28 12:57:00 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-a2b1e520-6290-4f46-95c4-4e92cd0a7b35 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:00 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-a2b1e520-6290-4f46-95c4-4e92cd0a7b35 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Calling method 'ShareTypesController.index' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:00 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-6e54a78c-4794-448a-be5d-5a31c17c1dd6 tempest-AdminActionsTest-1749172189 None] <<< [GET] https://127.0.0.1:40443/api/quotas/ May 28 12:57:00 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-6e54a78c-4794-448a-be5d-5a31c17c1dd6 tempest-AdminActionsTest-1749172189 None] [Bunch(cluster='loop75-kfs', cluster_id=1, default_email=None, default_group_quota=None, default_user_quota=None, enable_alarms=True, enable_email_providers=True, grace_period=None, guid='0a264a9b-c035-496c-8ef1-e9dd1076d22c', hard_limit=1073741824, hard_limit_inodes=None, id=10, internal=False, is_user_quota=False, last_user_quotas_update=None, name='4016fe10-12f4-48fc-92de-42cdd2fff998', num_blocked_users=0, num_exceeded_users=0, path='/manila/manila-4016fe10-12f4-48fc-92de-42cdd2fff998', percent_capacity=0, percent_inodes=None, pretty_grace_period=None, pretty_grace_period_expiration=None, pretty_state='OK (CREATED)', soft_limit=None, soft_limit_inodes=None, state='OK', sync_state='CREATED', system_id=10, tenant_id=1, tenant_name='default', time_to_block=None, title='4016fe10-12f4-48fc-92de-42cdd2fff998', url='https://127.0.0.1:40443/api/quotas/10/', used_capacity=0, used_capacity_tb=0.0, used_effective_capacity=0, used_effective_capacity_tb=0.0, used_inodes=0, used_limited_capacity=0)] May 28 12:57:00 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-6e54a78c-4794-448a-be5d-5a31c17c1dd6 tempest-AdminActionsTest-1749172189 None] --- [GET] https://127.0.0.1:40443/api/quotas/: Done May 28 12:57:00 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-6e54a78c-4794-448a-be5d-5a31c17c1dd6 tempest-AdminActionsTest-1749172189 None] >>> [PATCH] https://127.0.0.1:40443/api/quotas/10/ May 28 12:57:00 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-6e54a78c-4794-448a-be5d-5a31c17c1dd6 tempest-AdminActionsTest-1749172189 None] {'data': '{"hard_limit": 2147483648}', 'params': None} May 28 12:57:00 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-a2b1e520-6290-4f46-95c4-4e92cd0a7b35 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types returned with HTTP 200 May 28 12:57:00 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 192/368] 10.27.203.238 () {64 vars in 1337 bytes} [Tue May 28 12:57:00 2024] GET /share/v2/35d84ed7cf164123a87b8b906a836985/types => generated 12437 bytes in 21 msecs (HTTP/1.1 200) 6 headers in 233 bytes (1 switches on core 0) May 28 12:57:00 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-8f193b89-b9a9-4bdf-a15f-f42ba6b68a99 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] GET http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types/190ec616-4bf8-4458-9cfa-ec460cae775b May 28 12:57:00 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-8f193b89-b9a9-4bdf-a15f-f42ba6b68a99 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:00 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-8f193b89-b9a9-4bdf-a15f-f42ba6b68a99 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Calling method 'ShareTypesController.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:00 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-8f193b89-b9a9-4bdf-a15f-f42ba6b68a99 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types/190ec616-4bf8-4458-9cfa-ec460cae775b returned with HTTP 200 May 28 12:57:00 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 177/369] 10.27.203.238 () {64 vars in 1448 bytes} [Tue May 28 12:57:00 2024] GET /share/v2/35d84ed7cf164123a87b8b906a836985/types/190ec616-4bf8-4458-9cfa-ec460cae775b => generated 623 bytes in 10 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:57:00 l75lg1-v1 dstat.sh[49771]: 28-05 12:57:00| 18 2 77 2 0|5671M 1833M 277M 7845M| 27k 26k| 0 2752k| 0 415 |9240 15k|1.42 0.96 0.98|2.0 1.0 0| 0 0 | 0 2048M| 29 348 0 58 0 May 28 12:57:00 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-de4f58d7-6d32-43e8-8173-1596bd9cb775 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] POST http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types May 28 12:57:00 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-de4f58d7-6d32-43e8-8173-1596bd9cb775 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share_type": {"name": "tempest-tempest-manila-802183737", "extra_specs": {"driver_handles_share_servers": "False"}, "share_type_access:is_public": true}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:57:00 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-de4f58d7-6d32-43e8-8173-1596bd9cb775 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types returned with HTTP 200 May 28 12:57:00 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 193/370] 10.27.203.238 () {66 vars in 1359 bytes} [Tue May 28 12:57:00 2024] POST /share/v2/35d84ed7cf164123a87b8b906a836985/types => generated 621 bytes in 21 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:57:00 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-85039193-3bf7-4ff7-81f9-1a70821f7197 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] GET http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types May 28 12:57:00 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-85039193-3bf7-4ff7-81f9-1a70821f7197 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:00 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-85039193-3bf7-4ff7-81f9-1a70821f7197 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Calling method 'ShareTypesController.index' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:00 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-85039193-3bf7-4ff7-81f9-1a70821f7197 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types returned with HTTP 200 May 28 12:57:00 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 178/371] 10.27.203.238 () {64 vars in 1337 bytes} [Tue May 28 12:57:00 2024] GET /share/v2/35d84ed7cf164123a87b8b906a836985/types => generated 13029 bytes in 19 msecs (HTTP/1.1 200) 6 headers in 233 bytes (1 switches on core 0) May 28 12:57:00 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-45ffb6ed-20eb-4370-995e-70a7e42efb06 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] GET http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types/91187db2-4240-42f0-b6f2-b3d0b41593c3 May 28 12:57:00 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-45ffb6ed-20eb-4370-995e-70a7e42efb06 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:00 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-45ffb6ed-20eb-4370-995e-70a7e42efb06 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Calling method 'ShareTypesController.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:00 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-45ffb6ed-20eb-4370-995e-70a7e42efb06 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types/91187db2-4240-42f0-b6f2-b3d0b41593c3 returned with HTTP 200 May 28 12:57:00 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 194/372] 10.27.203.238 () {64 vars in 1448 bytes} [Tue May 28 12:57:00 2024] GET /share/v2/35d84ed7cf164123a87b8b906a836985/types/91187db2-4240-42f0-b6f2-b3d0b41593c3 => generated 621 bytes in 11 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:57:00 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-ee8770bd-9f07-433f-b53e-bb09a9fb9636 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] POST http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types May 28 12:57:00 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-ee8770bd-9f07-433f-b53e-bb09a9fb9636 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share_type": {"name": "tempest-tempest-manila-1989732722", "extra_specs": {"driver_handles_share_servers": "False", "key": "value"}, "share_type_access:is_public": true, "description": "Description for share type"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:57:00 l75lg1-v1 neutron-server[77618]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.HashRingHealthCheckPeriodics.touch_hash_ring_nodes' {{(pid=77618) _process_scheduled /opt/stack/data/venv/lib/python3.10/site-packages/futurist/periodics.py:638}} May 28 12:57:00 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-ee8770bd-9f07-433f-b53e-bb09a9fb9636 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types returned with HTTP 200 May 28 12:57:00 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 179/373] 10.27.203.238 () {66 vars in 1359 bytes} [Tue May 28 12:57:00 2024] POST /share/v2/35d84ed7cf164123a87b8b906a836985/types => generated 703 bytes in 23 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:57:00 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-dd7c3851-e7cf-4bd6-a8f7-94392376295a tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] PUT http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types/b3fb3663-32da-4415-9c04-781a8a8aa8d7 May 28 12:57:00 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-dd7c3851-e7cf-4bd6-a8f7-94392376295a tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Action: 'update', calling method: Controller.__getattribute__..version_select, body: {"share_type": {"share_type_access:is_public": true, "name": "tempest-type_updated-47932075", "description": "description_updated"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:57:00 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-dd7c3851-e7cf-4bd6-a8f7-94392376295a tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types/b3fb3663-32da-4415-9c04-781a8a8aa8d7 returned with HTTP 200 May 28 12:57:00 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 195/374] 10.27.203.238 () {66 vars in 1469 bytes} [Tue May 28 12:57:00 2024] PUT /share/v2/35d84ed7cf164123a87b8b906a836985/types/b3fb3663-32da-4415-9c04-781a8a8aa8d7 => generated 681 bytes in 25 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:57:00 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-c3e623e6-8d3b-40de-9fdd-73424995763a tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] POST http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types May 28 12:57:00 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-c3e623e6-8d3b-40de-9fdd-73424995763a tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share_type": {"name": "tempest-tempest-manila-1038147681", "extra_specs": {"driver_handles_share_servers": "False", "key": "value"}, "share_type_access:is_public": true, "description": "Description for share type"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:57:00 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-c3e623e6-8d3b-40de-9fdd-73424995763a tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types returned with HTTP 200 May 28 12:57:00 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 180/375] 10.27.203.238 () {66 vars in 1359 bytes} [Tue May 28 12:57:00 2024] POST /share/v2/35d84ed7cf164123a87b8b906a836985/types => generated 703 bytes in 21 msecs (HTTP/1.1 200) 6 headers in 231 bytes (2 switches on core 0) May 28 12:57:00 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-8adf5df5-6e09-49a1-8306-32e8855a39c7 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] PUT http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types/966f3e22-6603-4ea7-a9fa-769fa80b5db2 May 28 12:57:00 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-8adf5df5-6e09-49a1-8306-32e8855a39c7 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Action: 'update', calling method: Controller.__getattribute__..version_select, body: {"share_type": {"name": "tempest-type_updated-1172658387"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:57:00 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-8adf5df5-6e09-49a1-8306-32e8855a39c7 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types/966f3e22-6603-4ea7-a9fa-769fa80b5db2 returned with HTTP 200 May 28 12:57:00 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 196/376] 10.27.203.238 () {66 vars in 1468 bytes} [Tue May 28 12:57:00 2024] PUT /share/v2/35d84ed7cf164123a87b8b906a836985/types/966f3e22-6603-4ea7-a9fa-769fa80b5db2 => generated 699 bytes in 21 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:57:00 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-284852fe-89f1-40b3-81a1-5435405cc461 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] POST http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types May 28 12:57:00 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-284852fe-89f1-40b3-81a1-5435405cc461 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share_type": {"name": "tempest-tempest-manila-606699954", "extra_specs": {"driver_handles_share_servers": "False", "key": "value"}, "share_type_access:is_public": true, "description": "Description for share type"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:57:00 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-284852fe-89f1-40b3-81a1-5435405cc461 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types returned with HTTP 200 May 28 12:57:00 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 181/377] 10.27.203.238 () {66 vars in 1359 bytes} [Tue May 28 12:57:00 2024] POST /share/v2/35d84ed7cf164123a87b8b906a836985/types => generated 701 bytes in 23 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:57:00 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-16d0f569-6bd3-4c3e-91a4-461aeca4afc9 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] PUT http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types/c6e15d05-3583-41ac-936a-80c0ef20b8fe May 28 12:57:00 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-16d0f569-6bd3-4c3e-91a4-461aeca4afc9 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Action: 'update', calling method: Controller.__getattribute__..version_select, body: {"share_type": {"description": "description_updated"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:57:00 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-16d0f569-6bd3-4c3e-91a4-461aeca4afc9 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types/c6e15d05-3583-41ac-936a-80c0ef20b8fe returned with HTTP 200 May 28 12:57:00 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 197/378] 10.27.203.238 () {66 vars in 1468 bytes} [Tue May 28 12:57:00 2024] PUT /share/v2/35d84ed7cf164123a87b8b906a836985/types/c6e15d05-3583-41ac-936a-80c0ef20b8fe => generated 687 bytes in 21 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:57:00 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-156cfc0f-c19e-4ce0-b7c7-a0908d5fa1eb tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] POST http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types May 28 12:57:00 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-156cfc0f-c19e-4ce0-b7c7-a0908d5fa1eb tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share_type": {"name": "tempest-tempest-manila-249087735", "extra_specs": {"driver_handles_share_servers": "False", "key": "value"}, "share_type_access:is_public": true, "description": "Description for share type"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:57:00 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-156cfc0f-c19e-4ce0-b7c7-a0908d5fa1eb tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types returned with HTTP 200 May 28 12:57:00 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 182/379] 10.27.203.238 () {66 vars in 1359 bytes} [Tue May 28 12:57:00 2024] POST /share/v2/35d84ed7cf164123a87b8b906a836985/types => generated 701 bytes in 27 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:57:00 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-eda6b9ae-7146-465d-bcb6-218fc1416f58 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] PUT http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types/507d3854-75d8-445a-9f31-da36d20913ee May 28 12:57:00 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-eda6b9ae-7146-465d-bcb6-218fc1416f58 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Action: 'update', calling method: Controller.__getattribute__..version_select, body: {"share_type": {"share_type_access:is_public": true}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:57:00 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-eda6b9ae-7146-465d-bcb6-218fc1416f58 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types/507d3854-75d8-445a-9f31-da36d20913ee returned with HTTP 200 May 28 12:57:00 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 198/380] 10.27.203.238 () {66 vars in 1468 bytes} [Tue May 28 12:57:00 2024] PUT /share/v2/35d84ed7cf164123a87b8b906a836985/types/507d3854-75d8-445a-9f31-da36d20913ee => generated 701 bytes in 20 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:57:00 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-f7d12e1a-d4f2-409a-879a-fa4819493af1 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] POST http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types May 28 12:57:00 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-4efdd4ce-e86a-4ef2-8f3e-457013deabfe tempest-AccessRulesMetadataTest-1973590610 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:57:00 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-f7d12e1a-d4f2-409a-879a-fa4819493af1 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share_type": {"name": "tempest-tempest-manila-1044260961", "extra_specs": {"driver_handles_share_servers": "False", "key": "value"}, "share_type_access:is_public": true, "description": "Description for share type"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:57:00 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-4efdd4ce-e86a-4ef2-8f3e-457013deabfe tempest-AccessRulesMetadataTest-1973590610 None] [Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=1, created='2024-05-28T12:56:41.381687Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='8ed5f8f5-e848-431c-be27-16f1fa370a60', id=9, internal=False, is_s3_default_policy=False, name='95118a75-173c-4257-acef-78a246ee1c67', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=[], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['*'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['*'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T12:56:41.744950Z', tenant_id=1, tenant_name='default', title='95118a75-173c-4257-acef-78a246ee1c67', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/9/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[])] May 28 12:57:00 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-4efdd4ce-e86a-4ef2-8f3e-457013deabfe tempest-AccessRulesMetadataTest-1973590610 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 12:57:00 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-4efdd4ce-e86a-4ef2-8f3e-457013deabfe tempest-AccessRulesMetadataTest-1973590610 None] Acquiring lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:57:00 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-4efdd4ce-e86a-4ef2-8f3e-457013deabfe tempest-AccessRulesMetadataTest-1973590610 None] Lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:57:00 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-f7d12e1a-d4f2-409a-879a-fa4819493af1 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types returned with HTTP 200 May 28 12:57:00 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 183/381] 10.27.203.238 () {66 vars in 1359 bytes} [Tue May 28 12:57:00 2024] POST /share/v2/35d84ed7cf164123a87b8b906a836985/types => generated 703 bytes in 31 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:57:00 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-beb58861-7b93-4ef7-87d5-d6891ad64f2f tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] PUT http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types/f3edc1b4-9522-475f-be7d-5019990062a2 May 28 12:57:00 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-beb58861-7b93-4ef7-87d5-d6891ad64f2f tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Action: 'update', calling method: Controller.__getattribute__..version_select, body: {"share_type": {"share_type_access:is_public": false}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:57:00 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-beb58861-7b93-4ef7-87d5-d6891ad64f2f tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types/f3edc1b4-9522-475f-be7d-5019990062a2 returned with HTTP 200 May 28 12:57:00 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 199/382] 10.27.203.238 () {66 vars in 1468 bytes} [Tue May 28 12:57:00 2024] PUT /share/v2/35d84ed7cf164123a87b8b906a836985/types/f3edc1b4-9522-475f-be7d-5019990062a2 => generated 705 bytes in 25 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:57:00 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-4efdd4ce-e86a-4ef2-8f3e-457013deabfe tempest-AccessRulesMetadataTest-1973590610 None] Lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.053s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:57:00 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-4efdd4ce-e86a-4ef2-8f3e-457013deabfe tempest-AccessRulesMetadataTest-1973590610 None] Acquiring lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:57:00 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-4efdd4ce-e86a-4ef2-8f3e-457013deabfe tempest-AccessRulesMetadataTest-1973590610 None] Lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:57:00 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-f99504d2-66d9-48af-a569-2bec994151e4 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] POST http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types May 28 12:57:00 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-f99504d2-66d9-48af-a569-2bec994151e4 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share_type": {"name": "tempest-tempest-manila-784612462", "extra_specs": {"driver_handles_share_servers": "False", "key": "value"}, "share_type_access:is_public": true, "description": "Description for share type"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:57:00 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-f99504d2-66d9-48af-a569-2bec994151e4 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types returned with HTTP 200 May 28 12:57:00 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 184/383] 10.27.203.238 () {66 vars in 1359 bytes} [Tue May 28 12:57:00 2024] POST /share/v2/35d84ed7cf164123a87b8b906a836985/types => generated 701 bytes in 24 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:57:00 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-4efdd4ce-e86a-4ef2-8f3e-457013deabfe tempest-AccessRulesMetadataTest-1973590610 None] Lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.028s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:57:00 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-4efdd4ce-e86a-4ef2-8f3e-457013deabfe tempest-AccessRulesMetadataTest-1973590610 None] Acquiring lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:57:00 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-4efdd4ce-e86a-4ef2-8f3e-457013deabfe tempest-AccessRulesMetadataTest-1973590610 None] Lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:57:00 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-02b78ad0-75ef-47e9-9044-8a534b263e6c tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] PUT http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types/59965bca-f09c-4efc-9744-036c507d4a66 May 28 12:57:00 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-02b78ad0-75ef-47e9-9044-8a534b263e6c tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Action: 'update', calling method: Controller.__getattribute__..version_select, body: {"share_type": {"share_type_access:is_public": true, "name": "tempest-type_updated-773580191", "description": "description_updated"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:57:00 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-4efdd4ce-e86a-4ef2-8f3e-457013deabfe tempest-AccessRulesMetadataTest-1973590610 None] Lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.004s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:57:00 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-4efdd4ce-e86a-4ef2-8f3e-457013deabfe tempest-AccessRulesMetadataTest-1973590610 None] Acquiring lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:57:00 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-4efdd4ce-e86a-4ef2-8f3e-457013deabfe tempest-AccessRulesMetadataTest-1973590610 None] Lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:57:00 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-4efdd4ce-e86a-4ef2-8f3e-457013deabfe tempest-AccessRulesMetadataTest-1973590610 None] Lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:57:00 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-4efdd4ce-e86a-4ef2-8f3e-457013deabfe tempest-AccessRulesMetadataTest-1973590610 None] Acquiring lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:57:00 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-4efdd4ce-e86a-4ef2-8f3e-457013deabfe tempest-AccessRulesMetadataTest-1973590610 None] Lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:57:00 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-02b78ad0-75ef-47e9-9044-8a534b263e6c tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types/59965bca-f09c-4efc-9744-036c507d4a66 returned with HTTP 200 May 28 12:57:00 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 200/384] 10.27.203.238 () {66 vars in 1469 bytes} [Tue May 28 12:57:00 2024] PUT /share/v2/35d84ed7cf164123a87b8b906a836985/types/59965bca-f09c-4efc-9744-036c507d4a66 => generated 683 bytes in 19 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:57:00 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-9aeb0f6c-0851-4abf-bb2c-2cfaf8888a98 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] POST http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types May 28 12:57:00 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-9aeb0f6c-0851-4abf-bb2c-2cfaf8888a98 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share_type": {"name": "tempest-tempest-manila-1519426256", "extra_specs": {"driver_handles_share_servers": "False", "key": "value"}, "share_type_access:is_public": true, "description": "Description for share type"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:57:00 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-9aeb0f6c-0851-4abf-bb2c-2cfaf8888a98 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types returned with HTTP 200 May 28 12:57:00 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 185/385] 10.27.203.238 () {66 vars in 1359 bytes} [Tue May 28 12:57:00 2024] POST /share/v2/35d84ed7cf164123a87b8b906a836985/types => generated 703 bytes in 22 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:57:00 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-4efdd4ce-e86a-4ef2-8f3e-457013deabfe tempest-AccessRulesMetadataTest-1973590610 None] Lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.041s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:57:00 l75lg1-v1 manila-share[98474]: INFO manila.share.access [None req-4efdd4ce-e86a-4ef2-8f3e-457013deabfe tempest-AccessRulesMetadataTest-1973590610 None] Access rules were successfully modified for share instance 95118a75-173c-4257-acef-78a246ee1c67 belonging to share b92fc06b-76d7-40f9-adef-74a07ace1027. May 28 12:57:00 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-c76b8c13-7646-460e-8677-4b3c19774282 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] PUT http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types/021b7991-34f7-4223-9da6-d2574c044742 May 28 12:57:00 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-c76b8c13-7646-460e-8677-4b3c19774282 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Action: 'update', calling method: Controller.__getattribute__..version_select, body: {"share_type": {"name": "tempest-type_updated-962784890"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:57:00 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-c76b8c13-7646-460e-8677-4b3c19774282 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types/021b7991-34f7-4223-9da6-d2574c044742 returned with HTTP 200 May 28 12:57:00 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 201/386] 10.27.203.238 () {66 vars in 1468 bytes} [Tue May 28 12:57:00 2024] PUT /share/v2/35d84ed7cf164123a87b8b906a836985/types/021b7991-34f7-4223-9da6-d2574c044742 => generated 697 bytes in 26 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:57:00 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-c5b04e60-fea4-42b1-b1bf-fd70c6da7ebc tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] POST http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types May 28 12:57:00 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-c5b04e60-fea4-42b1-b1bf-fd70c6da7ebc tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share_type": {"name": "tempest-tempest-manila-1649591433", "extra_specs": {"driver_handles_share_servers": "False", "key": "value"}, "share_type_access:is_public": true, "description": "Description for share type"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:57:00 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-c5b04e60-fea4-42b1-b1bf-fd70c6da7ebc tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types returned with HTTP 200 May 28 12:57:00 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 186/387] 10.27.203.238 () {66 vars in 1359 bytes} [Tue May 28 12:57:00 2024] POST /share/v2/35d84ed7cf164123a87b8b906a836985/types => generated 703 bytes in 23 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:57:00 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-90835f77-a7c5-43b2-9e28-24ab520488d7 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] PUT http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types/5240050d-cc21-4bc1-9493-0c7396097b87 May 28 12:57:00 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-90835f77-a7c5-43b2-9e28-24ab520488d7 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Action: 'update', calling method: Controller.__getattribute__..version_select, body: {"share_type": {"description": "description_updated"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:57:00 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-90835f77-a7c5-43b2-9e28-24ab520488d7 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types/5240050d-cc21-4bc1-9493-0c7396097b87 returned with HTTP 200 May 28 12:57:00 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 202/388] 10.27.203.238 () {66 vars in 1468 bytes} [Tue May 28 12:57:00 2024] PUT /share/v2/35d84ed7cf164123a87b8b906a836985/types/5240050d-cc21-4bc1-9493-0c7396097b87 => generated 689 bytes in 30 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:57:00 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-ddfee120-4009-495e-a39f-06232cb4783d tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] POST http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types May 28 12:57:00 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-ddfee120-4009-495e-a39f-06232cb4783d tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share_type": {"name": "tempest-tempest-manila-452594589", "extra_specs": {"driver_handles_share_servers": "False", "key": "value"}, "share_type_access:is_public": true, "description": "Description for share type"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:57:00 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-ddfee120-4009-495e-a39f-06232cb4783d tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types returned with HTTP 200 May 28 12:57:00 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 187/389] 10.27.203.238 () {66 vars in 1359 bytes} [Tue May 28 12:57:00 2024] POST /share/v2/35d84ed7cf164123a87b8b906a836985/types => generated 701 bytes in 22 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:57:00 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-32d5ab7b-2f70-4f03-bd95-490db5d2ae7d tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] PUT http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types/f85ed7f8-ec5d-4ba0-a28b-246bfa11016c May 28 12:57:00 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-32d5ab7b-2f70-4f03-bd95-490db5d2ae7d tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Action: 'update', calling method: Controller.__getattribute__..version_select, body: {"share_type": {"share_type_access:is_public": true}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:57:00 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9c9aa596-d63a-4c98-8174-b7af98a44ede tempest-ExportLocationsNegativeTest-386865252 None] <<< [DELETE] https://127.0.0.1:40443/api/views/9/ May 28 12:57:00 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9c9aa596-d63a-4c98-8174-b7af98a44ede tempest-ExportLocationsNegativeTest-386865252 None] --- [DELETE] https://127.0.0.1:40443/api/views/9/: Done May 28 12:57:00 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9c9aa596-d63a-4c98-8174-b7af98a44ede tempest-ExportLocationsNegativeTest-386865252 None] >>> [GET] https://127.0.0.1:40443/api/quotas/ May 28 12:57:00 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9c9aa596-d63a-4c98-8174-b7af98a44ede tempest-ExportLocationsNegativeTest-386865252 None] {'allow_redirects': True, May 28 12:57:00 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9c9aa596-d63a-4c98-8174-b7af98a44ede tempest-ExportLocationsNegativeTest-386865252 None] 'params': {'name': 'd44fc8f1-83fc-47c3-994f-497e85a3194a'}} May 28 12:57:00 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-32d5ab7b-2f70-4f03-bd95-490db5d2ae7d tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types/f85ed7f8-ec5d-4ba0-a28b-246bfa11016c returned with HTTP 200 May 28 12:57:00 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 203/390] 10.27.203.238 () {66 vars in 1468 bytes} [Tue May 28 12:57:00 2024] PUT /share/v2/35d84ed7cf164123a87b8b906a836985/types/f85ed7f8-ec5d-4ba0-a28b-246bfa11016c => generated 701 bytes in 21 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:57:00 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-844b7bf0-45ce-4310-af1c-5e9e1d502cc3 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] POST http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types May 28 12:57:00 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-844b7bf0-45ce-4310-af1c-5e9e1d502cc3 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share_type": {"name": "tempest-tempest-manila-1360759250", "extra_specs": {"driver_handles_share_servers": "False", "key": "value"}, "share_type_access:is_public": true, "description": "Description for share type"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:57:00 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-844b7bf0-45ce-4310-af1c-5e9e1d502cc3 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types returned with HTTP 200 May 28 12:57:00 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 188/391] 10.27.203.238 () {66 vars in 1359 bytes} [Tue May 28 12:57:00 2024] POST /share/v2/35d84ed7cf164123a87b8b906a836985/types => generated 703 bytes in 25 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:57:00 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-e4a263b6-8fc1-4ec6-aefe-8236bcbbd45b tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] PUT http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types/b90bd0c0-94f1-4e9c-b68a-ff0eace102d8 May 28 12:57:00 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-e4a263b6-8fc1-4ec6-aefe-8236bcbbd45b tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Action: 'update', calling method: Controller.__getattribute__..version_select, body: {"share_type": {"share_type_access:is_public": false}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:57:00 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-e4a263b6-8fc1-4ec6-aefe-8236bcbbd45b tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types/b90bd0c0-94f1-4e9c-b68a-ff0eace102d8 returned with HTTP 200 May 28 12:57:00 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 204/392] 10.27.203.238 () {66 vars in 1468 bytes} [Tue May 28 12:57:00 2024] PUT /share/v2/35d84ed7cf164123a87b8b906a836985/types/b90bd0c0-94f1-4e9c-b68a-ff0eace102d8 => generated 705 bytes in 20 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:57:00 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-d63a14c5-7c58-4428-a6a0-143812a99000 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] POST http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types May 28 12:57:00 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-d63a14c5-7c58-4428-a6a0-143812a99000 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share_type": {"name": "tempest-tempest-manila-171821123", "extra_specs": {"driver_handles_share_servers": "False", "key": "value"}, "share_type_access:is_public": true, "description": "Description for share type"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:57:00 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-d63a14c5-7c58-4428-a6a0-143812a99000 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types returned with HTTP 200 May 28 12:57:00 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 189/393] 10.27.203.238 () {66 vars in 1359 bytes} [Tue May 28 12:57:00 2024] POST /share/v2/35d84ed7cf164123a87b8b906a836985/types => generated 701 bytes in 24 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:57:00 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-c0a848cc-585e-4367-98d4-5c588653dcb0 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] PUT http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types/05ad9f50-110e-4ea7-a626-ff61c1a1ea4d May 28 12:57:00 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-c0a848cc-585e-4367-98d4-5c588653dcb0 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Action: 'update', calling method: Controller.__getattribute__..version_select, body: {"share_type": {"description": ""}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:57:00 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-c0a848cc-585e-4367-98d4-5c588653dcb0 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types/05ad9f50-110e-4ea7-a626-ff61c1a1ea4d returned with HTTP 200 May 28 12:57:00 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 205/394] 10.27.203.238 () {66 vars in 1468 bytes} [Tue May 28 12:57:00 2024] PUT /share/v2/35d84ed7cf164123a87b8b906a836985/types/05ad9f50-110e-4ea7-a626-ff61c1a1ea4d => generated 653 bytes in 21 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:57:00 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-fd449164-3b19-43fc-a6f7-ed839913968e tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] POST http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types May 28 12:57:00 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-fd449164-3b19-43fc-a6f7-ed839913968e tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share_type": {"name": "tempest-tempest-manila-1534156368", "extra_specs": {"driver_handles_share_servers": "False", "key": "value"}, "share_type_access:is_public": true, "description": "Description for share type"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:57:00 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-fd449164-3b19-43fc-a6f7-ed839913968e tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types returned with HTTP 200 May 28 12:57:00 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 190/395] 10.27.203.238 () {66 vars in 1359 bytes} [Tue May 28 12:57:00 2024] POST /share/v2/35d84ed7cf164123a87b8b906a836985/types => generated 703 bytes in 25 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:57:00 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-3b07e553-f237-4654-bac3-c19873458834 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] PUT http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types/e13e19c0-30cb-4c16-8600-feca465b77ad May 28 12:57:00 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-3b07e553-f237-4654-bac3-c19873458834 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Action: 'update', calling method: Controller.__getattribute__..version_select, body: {"share_type": {"description": ""}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:57:00 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-3b07e553-f237-4654-bac3-c19873458834 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types/e13e19c0-30cb-4c16-8600-feca465b77ad returned with HTTP 200 May 28 12:57:00 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 206/396] 10.27.203.238 () {66 vars in 1468 bytes} [Tue May 28 12:57:00 2024] PUT /share/v2/35d84ed7cf164123a87b8b906a836985/types/e13e19c0-30cb-4c16-8600-feca465b77ad => generated 655 bytes in 20 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:57:00 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-29bd019f-679f-4fbc-9ee9-8d43affd5147 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] DELETE http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types/e13e19c0-30cb-4c16-8600-feca465b77ad May 28 12:57:00 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-29bd019f-679f-4fbc-9ee9-8d43affd5147 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:00 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-29bd019f-679f-4fbc-9ee9-8d43affd5147 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Calling method 'ShareTypesController._delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:00 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-29bd019f-679f-4fbc-9ee9-8d43affd5147 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types/e13e19c0-30cb-4c16-8600-feca465b77ad returned with HTTP 202 May 28 12:57:00 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 191/397] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:57:00 2024] DELETE /share/v2/35d84ed7cf164123a87b8b906a836985/types/e13e19c0-30cb-4c16-8600-feca465b77ad => generated 0 bytes in 38 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-90a78a09-d20c-4760-9090-6eb50dab1d60 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] GET http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types/e13e19c0-30cb-4c16-8600-feca465b77ad May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-90a78a09-d20c-4760-9090-6eb50dab1d60 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-90a78a09-d20c-4760-9090-6eb50dab1d60 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Calling method 'ShareTypesController.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-90a78a09-d20c-4760-9090-6eb50dab1d60 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] HTTP exception thrown: Share type not found. May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-90a78a09-d20c-4760-9090-6eb50dab1d60 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types/e13e19c0-30cb-4c16-8600-feca465b77ad returned with HTTP 404 May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 207/398] 10.27.203.238 () {64 vars in 1448 bytes} [Tue May 28 12:57:00 2024] GET /share/v2/35d84ed7cf164123a87b8b906a836985/types/e13e19c0-30cb-4c16-8600-feca465b77ad => generated 67 bytes in 12 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-c7917d75-07e5-451a-b256-8d1ab1fae23a tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] DELETE http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types/05ad9f50-110e-4ea7-a626-ff61c1a1ea4d May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-c7917d75-07e5-451a-b256-8d1ab1fae23a tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-c7917d75-07e5-451a-b256-8d1ab1fae23a tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Calling method 'ShareTypesController._delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-0fd45eb6-e032-46d0-b659-8019cf6940da tempest-ExportLocationsNegativeTest-386865252 tempest-ExportLocationsNegativeTest-386865252-project-admin] GET http://10.27.203.238/share/v2/df93a973373644ccaf8ecf54774a4ced/shares/543531db-0529-42ad-9ae8-5e3dff98a2a5 May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-0fd45eb6-e032-46d0-b659-8019cf6940da tempest-ExportLocationsNegativeTest-386865252 tempest-ExportLocationsNegativeTest-386865252-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-0fd45eb6-e032-46d0-b659-8019cf6940da tempest-ExportLocationsNegativeTest-386865252 tempest-ExportLocationsNegativeTest-386865252-project-admin] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-c7917d75-07e5-451a-b256-8d1ab1fae23a tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types/05ad9f50-110e-4ea7-a626-ff61c1a1ea4d returned with HTTP 202 May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 192/399] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:57:01 2024] DELETE /share/v2/35d84ed7cf164123a87b8b906a836985/types/05ad9f50-110e-4ea7-a626-ff61c1a1ea4d => generated 0 bytes in 35 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-5cd8908c-9f53-48be-8ee3-0401e24e9acc tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] GET http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types/05ad9f50-110e-4ea7-a626-ff61c1a1ea4d May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-5cd8908c-9f53-48be-8ee3-0401e24e9acc tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-5cd8908c-9f53-48be-8ee3-0401e24e9acc tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Calling method 'ShareTypesController.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-5cd8908c-9f53-48be-8ee3-0401e24e9acc tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] HTTP exception thrown: Share type not found. May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-5cd8908c-9f53-48be-8ee3-0401e24e9acc tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types/05ad9f50-110e-4ea7-a626-ff61c1a1ea4d returned with HTTP 404 May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 193/400] 10.27.203.238 () {64 vars in 1448 bytes} [Tue May 28 12:57:01 2024] GET /share/v2/35d84ed7cf164123a87b8b906a836985/types/05ad9f50-110e-4ea7-a626-ff61c1a1ea4d => generated 67 bytes in 10 msecs (HTTP/1.1 404) 6 headers in 237 bytes (2 switches on core 0) May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-849539c2-da9b-4a16-b08e-d03c599026fd tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] DELETE http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types/b90bd0c0-94f1-4e9c-b68a-ff0eace102d8 May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-849539c2-da9b-4a16-b08e-d03c599026fd tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-849539c2-da9b-4a16-b08e-d03c599026fd tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Calling method 'ShareTypesController._delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-0fd45eb6-e032-46d0-b659-8019cf6940da tempest-ExportLocationsNegativeTest-386865252 tempest-ExportLocationsNegativeTest-386865252-project-admin] http://10.27.203.238/share/v2/df93a973373644ccaf8ecf54774a4ced/shares/543531db-0529-42ad-9ae8-5e3dff98a2a5 returned with HTTP 200 May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 208/401] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:57:01 2024] GET /share/v2/df93a973373644ccaf8ecf54774a4ced/shares/543531db-0529-42ad-9ae8-5e3dff98a2a5 => generated 1374 bytes in 30 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-849539c2-da9b-4a16-b08e-d03c599026fd tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types/b90bd0c0-94f1-4e9c-b68a-ff0eace102d8 returned with HTTP 202 May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 194/402] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:57:01 2024] DELETE /share/v2/35d84ed7cf164123a87b8b906a836985/types/b90bd0c0-94f1-4e9c-b68a-ff0eace102d8 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:57:01 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9c9aa596-d63a-4c98-8174-b7af98a44ede tempest-ExportLocationsNegativeTest-386865252 None] <<< [GET] https://127.0.0.1:40443/api/quotas/ May 28 12:57:01 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9c9aa596-d63a-4c98-8174-b7af98a44ede tempest-ExportLocationsNegativeTest-386865252 None] [Bunch(cluster='loop75-kfs', cluster_id=1, default_email=None, default_group_quota=None, default_user_quota=None, enable_alarms=True, enable_email_providers=True, grace_period=None, guid='7539e5d6-b4f9-4a34-8d50-fb7bae8450a9', hard_limit=1073741824, hard_limit_inodes=None, id=7, internal=False, is_user_quota=False, last_user_quotas_update=None, name='d44fc8f1-83fc-47c3-994f-497e85a3194a', num_blocked_users=0, num_exceeded_users=0, path='/manila/manila-d44fc8f1-83fc-47c3-994f-497e85a3194a', percent_capacity=0, percent_inodes=None, pretty_grace_period=None, pretty_grace_period_expiration=None, pretty_state='OK (CREATED)', soft_limit=None, soft_limit_inodes=None, state='OK', sync_state='CREATED', system_id=7, tenant_id=1, tenant_name='default', time_to_block=None, title='d44fc8f1-83fc-47c3-994f-497e85a3194a', url='https://127.0.0.1:40443/api/quotas/7/', used_capacity=0, used_capacity_tb=0.0, used_effective_capacity=0, used_effective_capacity_tb=0.0, used_inodes=0, used_limited_capacity=0)] May 28 12:57:01 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9c9aa596-d63a-4c98-8174-b7af98a44ede tempest-ExportLocationsNegativeTest-386865252 None] --- [GET] https://127.0.0.1:40443/api/quotas/: Done May 28 12:57:01 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9c9aa596-d63a-4c98-8174-b7af98a44ede tempest-ExportLocationsNegativeTest-386865252 None] >>> [DELETE] https://127.0.0.1:40443/api/quotas/7/ May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-7a0447dd-54d3-45ed-a825-2987528b526e tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] GET http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types/b90bd0c0-94f1-4e9c-b68a-ff0eace102d8 May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-7a0447dd-54d3-45ed-a825-2987528b526e tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-7a0447dd-54d3-45ed-a825-2987528b526e tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Calling method 'ShareTypesController.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-7a0447dd-54d3-45ed-a825-2987528b526e tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] HTTP exception thrown: Share type not found. May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-7a0447dd-54d3-45ed-a825-2987528b526e tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types/b90bd0c0-94f1-4e9c-b68a-ff0eace102d8 returned with HTTP 404 May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 209/403] 10.27.203.238 () {64 vars in 1448 bytes} [Tue May 28 12:57:01 2024] GET /share/v2/35d84ed7cf164123a87b8b906a836985/types/b90bd0c0-94f1-4e9c-b68a-ff0eace102d8 => generated 67 bytes in 12 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-aefb5b8c-558f-4fe9-976c-a879f3803e29 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] DELETE http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types/f85ed7f8-ec5d-4ba0-a28b-246bfa11016c May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-aefb5b8c-558f-4fe9-976c-a879f3803e29 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-aefb5b8c-558f-4fe9-976c-a879f3803e29 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Calling method 'ShareTypesController._delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-aefb5b8c-558f-4fe9-976c-a879f3803e29 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types/f85ed7f8-ec5d-4ba0-a28b-246bfa11016c returned with HTTP 202 May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 195/404] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:57:01 2024] DELETE /share/v2/35d84ed7cf164123a87b8b906a836985/types/f85ed7f8-ec5d-4ba0-a28b-246bfa11016c => generated 0 bytes in 35 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-82095ef6-e7c5-4f9f-8c83-842c684ce58f tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] GET http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types/f85ed7f8-ec5d-4ba0-a28b-246bfa11016c May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-82095ef6-e7c5-4f9f-8c83-842c684ce58f tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-82095ef6-e7c5-4f9f-8c83-842c684ce58f tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Calling method 'ShareTypesController.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-82095ef6-e7c5-4f9f-8c83-842c684ce58f tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] HTTP exception thrown: Share type not found. May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-82095ef6-e7c5-4f9f-8c83-842c684ce58f tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types/f85ed7f8-ec5d-4ba0-a28b-246bfa11016c returned with HTTP 404 May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 210/405] 10.27.203.238 () {64 vars in 1448 bytes} [Tue May 28 12:57:01 2024] GET /share/v2/35d84ed7cf164123a87b8b906a836985/types/f85ed7f8-ec5d-4ba0-a28b-246bfa11016c => generated 67 bytes in 11 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-cf97d519-ae29-47b7-9a50-3239d1e6e9bb tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] DELETE http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types/5240050d-cc21-4bc1-9493-0c7396097b87 May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-cf97d519-ae29-47b7-9a50-3239d1e6e9bb tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-cf97d519-ae29-47b7-9a50-3239d1e6e9bb tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Calling method 'ShareTypesController._delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:01 l75lg1-v1 nova-conductor[83647]: DEBUG dbcounter [-] [83647] Writing DB stats nova_cell1:SELECT=1 {{(pid=83647) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-cf97d519-ae29-47b7-9a50-3239d1e6e9bb tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types/5240050d-cc21-4bc1-9493-0c7396097b87 returned with HTTP 202 May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 196/406] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:57:01 2024] DELETE /share/v2/35d84ed7cf164123a87b8b906a836985/types/5240050d-cc21-4bc1-9493-0c7396097b87 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-4ab4f2ac-8b71-41d9-a63d-568a367819e5 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] GET http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types/5240050d-cc21-4bc1-9493-0c7396097b87 May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-4ab4f2ac-8b71-41d9-a63d-568a367819e5 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-4ab4f2ac-8b71-41d9-a63d-568a367819e5 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Calling method 'ShareTypesController.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-4ab4f2ac-8b71-41d9-a63d-568a367819e5 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] HTTP exception thrown: Share type not found. May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-4ab4f2ac-8b71-41d9-a63d-568a367819e5 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types/5240050d-cc21-4bc1-9493-0c7396097b87 returned with HTTP 404 May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 211/407] 10.27.203.238 () {64 vars in 1448 bytes} [Tue May 28 12:57:01 2024] GET /share/v2/35d84ed7cf164123a87b8b906a836985/types/5240050d-cc21-4bc1-9493-0c7396097b87 => generated 67 bytes in 12 msecs (HTTP/1.1 404) 6 headers in 237 bytes (2 switches on core 0) May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-279b9ae9-7224-4ae5-81ad-9d6d80dcf305 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] DELETE http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types/021b7991-34f7-4223-9da6-d2574c044742 May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-279b9ae9-7224-4ae5-81ad-9d6d80dcf305 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-279b9ae9-7224-4ae5-81ad-9d6d80dcf305 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Calling method 'ShareTypesController._delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:01 l75lg1-v1 dstat.sh[49771]: 28-05 12:57:01| 11 2 83 4 0|5671M 1832M 277M 7845M| 23k 22k| 0 3348k| 0 540 |8763 14k|1.42 0.96 0.98|2.0 1.0 0| 0 0 | 0 2048M| 29 348 0 58 0 May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-279b9ae9-7224-4ae5-81ad-9d6d80dcf305 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types/021b7991-34f7-4223-9da6-d2574c044742 returned with HTTP 202 May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 197/408] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:57:01 2024] DELETE /share/v2/35d84ed7cf164123a87b8b906a836985/types/021b7991-34f7-4223-9da6-d2574c044742 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-f79b1dbb-28d3-4976-8b75-c7d1e73ea292 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] GET http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types/021b7991-34f7-4223-9da6-d2574c044742 May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-f79b1dbb-28d3-4976-8b75-c7d1e73ea292 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-f79b1dbb-28d3-4976-8b75-c7d1e73ea292 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Calling method 'ShareTypesController.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-f79b1dbb-28d3-4976-8b75-c7d1e73ea292 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] HTTP exception thrown: Share type not found. May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-f79b1dbb-28d3-4976-8b75-c7d1e73ea292 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types/021b7991-34f7-4223-9da6-d2574c044742 returned with HTTP 404 May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 212/409] 10.27.203.238 () {64 vars in 1448 bytes} [Tue May 28 12:57:01 2024] GET /share/v2/35d84ed7cf164123a87b8b906a836985/types/021b7991-34f7-4223-9da6-d2574c044742 => generated 67 bytes in 11 msecs (HTTP/1.1 404) 6 headers in 237 bytes (2 switches on core 0) May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-d9bfd0b0-3b66-4d06-9b47-7dbdffda9763 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] DELETE http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types/59965bca-f09c-4efc-9744-036c507d4a66 May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-d9bfd0b0-3b66-4d06-9b47-7dbdffda9763 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-d9bfd0b0-3b66-4d06-9b47-7dbdffda9763 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Calling method 'ShareTypesController._delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-d9bfd0b0-3b66-4d06-9b47-7dbdffda9763 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types/59965bca-f09c-4efc-9744-036c507d4a66 returned with HTTP 202 May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 198/410] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:57:01 2024] DELETE /share/v2/35d84ed7cf164123a87b8b906a836985/types/59965bca-f09c-4efc-9744-036c507d4a66 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-e7bd30a3-0647-474f-abf1-b78f928219a8 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] GET http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types/59965bca-f09c-4efc-9744-036c507d4a66 May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-e7bd30a3-0647-474f-abf1-b78f928219a8 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-e7bd30a3-0647-474f-abf1-b78f928219a8 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Calling method 'ShareTypesController.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-e7bd30a3-0647-474f-abf1-b78f928219a8 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] HTTP exception thrown: Share type not found. May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-e7bd30a3-0647-474f-abf1-b78f928219a8 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types/59965bca-f09c-4efc-9744-036c507d4a66 returned with HTTP 404 May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 213/411] 10.27.203.238 () {64 vars in 1448 bytes} [Tue May 28 12:57:01 2024] GET /share/v2/35d84ed7cf164123a87b8b906a836985/types/59965bca-f09c-4efc-9744-036c507d4a66 => generated 67 bytes in 11 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-bfd505b4-a2fe-435a-a31d-bab582fcd16e tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] DELETE http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types/f3edc1b4-9522-475f-be7d-5019990062a2 May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-bfd505b4-a2fe-435a-a31d-bab582fcd16e tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-bfd505b4-a2fe-435a-a31d-bab582fcd16e tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Calling method 'ShareTypesController._delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-bfd505b4-a2fe-435a-a31d-bab582fcd16e tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types/f3edc1b4-9522-475f-be7d-5019990062a2 returned with HTTP 202 May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 199/412] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:57:01 2024] DELETE /share/v2/35d84ed7cf164123a87b8b906a836985/types/f3edc1b4-9522-475f-be7d-5019990062a2 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-af499a3c-d1ed-42f6-9b08-24eec0154e0e tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] GET http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types/f3edc1b4-9522-475f-be7d-5019990062a2 May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-af499a3c-d1ed-42f6-9b08-24eec0154e0e tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-af499a3c-d1ed-42f6-9b08-24eec0154e0e tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Calling method 'ShareTypesController.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-af499a3c-d1ed-42f6-9b08-24eec0154e0e tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] HTTP exception thrown: Share type not found. May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-af499a3c-d1ed-42f6-9b08-24eec0154e0e tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types/f3edc1b4-9522-475f-be7d-5019990062a2 returned with HTTP 404 May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 214/413] 10.27.203.238 () {64 vars in 1448 bytes} [Tue May 28 12:57:01 2024] GET /share/v2/35d84ed7cf164123a87b8b906a836985/types/f3edc1b4-9522-475f-be7d-5019990062a2 => generated 67 bytes in 12 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-48b00454-03a5-4fd7-89ec-9902ecf5254c tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] DELETE http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types/507d3854-75d8-445a-9f31-da36d20913ee May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-48b00454-03a5-4fd7-89ec-9902ecf5254c tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-48b00454-03a5-4fd7-89ec-9902ecf5254c tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Calling method 'ShareTypesController._delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-48b00454-03a5-4fd7-89ec-9902ecf5254c tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types/507d3854-75d8-445a-9f31-da36d20913ee returned with HTTP 202 May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 200/414] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:57:01 2024] DELETE /share/v2/35d84ed7cf164123a87b8b906a836985/types/507d3854-75d8-445a-9f31-da36d20913ee => generated 0 bytes in 33 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-f01a9899-fd16-4149-99f2-7ffffc5088d3 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] GET http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types/507d3854-75d8-445a-9f31-da36d20913ee May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-f01a9899-fd16-4149-99f2-7ffffc5088d3 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-f01a9899-fd16-4149-99f2-7ffffc5088d3 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Calling method 'ShareTypesController.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-f01a9899-fd16-4149-99f2-7ffffc5088d3 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] HTTP exception thrown: Share type not found. May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-f01a9899-fd16-4149-99f2-7ffffc5088d3 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types/507d3854-75d8-445a-9f31-da36d20913ee returned with HTTP 404 May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 215/415] 10.27.203.238 () {64 vars in 1448 bytes} [Tue May 28 12:57:01 2024] GET /share/v2/35d84ed7cf164123a87b8b906a836985/types/507d3854-75d8-445a-9f31-da36d20913ee => generated 67 bytes in 10 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-fefb8af3-a792-4f1f-aa44-283ad7e877ce tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] DELETE http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types/c6e15d05-3583-41ac-936a-80c0ef20b8fe May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-fefb8af3-a792-4f1f-aa44-283ad7e877ce tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-fefb8af3-a792-4f1f-aa44-283ad7e877ce tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Calling method 'ShareTypesController._delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-fefb8af3-a792-4f1f-aa44-283ad7e877ce tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types/c6e15d05-3583-41ac-936a-80c0ef20b8fe returned with HTTP 202 May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 201/416] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:57:01 2024] DELETE /share/v2/35d84ed7cf164123a87b8b906a836985/types/c6e15d05-3583-41ac-936a-80c0ef20b8fe => generated 0 bytes in 44 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-24d56138-007f-4854-be0a-e605f5de41c3 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] GET http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types/c6e15d05-3583-41ac-936a-80c0ef20b8fe May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-24d56138-007f-4854-be0a-e605f5de41c3 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-24d56138-007f-4854-be0a-e605f5de41c3 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Calling method 'ShareTypesController.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-24d56138-007f-4854-be0a-e605f5de41c3 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] HTTP exception thrown: Share type not found. May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-24d56138-007f-4854-be0a-e605f5de41c3 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types/c6e15d05-3583-41ac-936a-80c0ef20b8fe returned with HTTP 404 May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 216/417] 10.27.203.238 () {64 vars in 1448 bytes} [Tue May 28 12:57:01 2024] GET /share/v2/35d84ed7cf164123a87b8b906a836985/types/c6e15d05-3583-41ac-936a-80c0ef20b8fe => generated 67 bytes in 12 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-8512f99c-0f3c-4d3e-bbb2-e017d17523de tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] DELETE http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types/966f3e22-6603-4ea7-a9fa-769fa80b5db2 May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-8512f99c-0f3c-4d3e-bbb2-e017d17523de tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-8512f99c-0f3c-4d3e-bbb2-e017d17523de tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Calling method 'ShareTypesController._delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-8512f99c-0f3c-4d3e-bbb2-e017d17523de tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types/966f3e22-6603-4ea7-a9fa-769fa80b5db2 returned with HTTP 202 May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 202/418] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:57:01 2024] DELETE /share/v2/35d84ed7cf164123a87b8b906a836985/types/966f3e22-6603-4ea7-a9fa-769fa80b5db2 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-d77b3dee-2b5e-487c-b564-a4d6a23211da tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] GET http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types/966f3e22-6603-4ea7-a9fa-769fa80b5db2 May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-d77b3dee-2b5e-487c-b564-a4d6a23211da tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-d77b3dee-2b5e-487c-b564-a4d6a23211da tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Calling method 'ShareTypesController.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-d77b3dee-2b5e-487c-b564-a4d6a23211da tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] HTTP exception thrown: Share type not found. May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-d77b3dee-2b5e-487c-b564-a4d6a23211da tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types/966f3e22-6603-4ea7-a9fa-769fa80b5db2 returned with HTTP 404 May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 217/419] 10.27.203.238 () {64 vars in 1448 bytes} [Tue May 28 12:57:01 2024] GET /share/v2/35d84ed7cf164123a87b8b906a836985/types/966f3e22-6603-4ea7-a9fa-769fa80b5db2 => generated 67 bytes in 10 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-c25895e9-4378-47dc-a2d4-31d078446a1a tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] DELETE http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types/b3fb3663-32da-4415-9c04-781a8a8aa8d7 May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-c25895e9-4378-47dc-a2d4-31d078446a1a tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-c25895e9-4378-47dc-a2d4-31d078446a1a tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Calling method 'ShareTypesController._delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-c25895e9-4378-47dc-a2d4-31d078446a1a tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types/b3fb3663-32da-4415-9c04-781a8a8aa8d7 returned with HTTP 202 May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 203/420] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:57:01 2024] DELETE /share/v2/35d84ed7cf164123a87b8b906a836985/types/b3fb3663-32da-4415-9c04-781a8a8aa8d7 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-06203e5f-f2ac-4300-8522-96b47fd32e4f tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] GET http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types/b3fb3663-32da-4415-9c04-781a8a8aa8d7 May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-06203e5f-f2ac-4300-8522-96b47fd32e4f tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-06203e5f-f2ac-4300-8522-96b47fd32e4f tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Calling method 'ShareTypesController.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-06203e5f-f2ac-4300-8522-96b47fd32e4f tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] HTTP exception thrown: Share type not found. May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-06203e5f-f2ac-4300-8522-96b47fd32e4f tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types/b3fb3663-32da-4415-9c04-781a8a8aa8d7 returned with HTTP 404 May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 218/421] 10.27.203.238 () {64 vars in 1448 bytes} [Tue May 28 12:57:01 2024] GET /share/v2/35d84ed7cf164123a87b8b906a836985/types/b3fb3663-32da-4415-9c04-781a8a8aa8d7 => generated 67 bytes in 11 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-9ac253e2-3546-4c37-9b10-b679da74b568 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] DELETE http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types/91187db2-4240-42f0-b6f2-b3d0b41593c3 May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-9ac253e2-3546-4c37-9b10-b679da74b568 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-9ac253e2-3546-4c37-9b10-b679da74b568 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Calling method 'ShareTypesController._delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-9ac253e2-3546-4c37-9b10-b679da74b568 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types/91187db2-4240-42f0-b6f2-b3d0b41593c3 returned with HTTP 202 May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 204/422] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:57:01 2024] DELETE /share/v2/35d84ed7cf164123a87b8b906a836985/types/91187db2-4240-42f0-b6f2-b3d0b41593c3 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-ef20f356-8f19-42ac-8fdc-2c90e238b997 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] GET http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types/91187db2-4240-42f0-b6f2-b3d0b41593c3 May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-ef20f356-8f19-42ac-8fdc-2c90e238b997 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-ef20f356-8f19-42ac-8fdc-2c90e238b997 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Calling method 'ShareTypesController.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-ef20f356-8f19-42ac-8fdc-2c90e238b997 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] HTTP exception thrown: Share type not found. May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-ef20f356-8f19-42ac-8fdc-2c90e238b997 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types/91187db2-4240-42f0-b6f2-b3d0b41593c3 returned with HTTP 404 May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 219/423] 10.27.203.238 () {64 vars in 1448 bytes} [Tue May 28 12:57:01 2024] GET /share/v2/35d84ed7cf164123a87b8b906a836985/types/91187db2-4240-42f0-b6f2-b3d0b41593c3 => generated 67 bytes in 10 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-f2a58afc-4b19-4a0d-9769-b5183fcee76e tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] DELETE http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types/190ec616-4bf8-4458-9cfa-ec460cae775b May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-f2a58afc-4b19-4a0d-9769-b5183fcee76e tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-f2a58afc-4b19-4a0d-9769-b5183fcee76e tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Calling method 'ShareTypesController._delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-f2a58afc-4b19-4a0d-9769-b5183fcee76e tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types/190ec616-4bf8-4458-9cfa-ec460cae775b returned with HTTP 202 May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 205/424] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:57:01 2024] DELETE /share/v2/35d84ed7cf164123a87b8b906a836985/types/190ec616-4bf8-4458-9cfa-ec460cae775b => generated 0 bytes in 45 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-227e5d3b-f11b-47a4-8682-ba185c550604 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] GET http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types/190ec616-4bf8-4458-9cfa-ec460cae775b May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-227e5d3b-f11b-47a4-8682-ba185c550604 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-227e5d3b-f11b-47a4-8682-ba185c550604 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Calling method 'ShareTypesController.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-227e5d3b-f11b-47a4-8682-ba185c550604 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] HTTP exception thrown: Share type not found. May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-227e5d3b-f11b-47a4-8682-ba185c550604 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types/190ec616-4bf8-4458-9cfa-ec460cae775b returned with HTTP 404 May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 220/425] 10.27.203.238 () {64 vars in 1448 bytes} [Tue May 28 12:57:01 2024] GET /share/v2/35d84ed7cf164123a87b8b906a836985/types/190ec616-4bf8-4458-9cfa-ec460cae775b => generated 67 bytes in 10 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-dde3911b-5447-427e-b52f-7dbd7c201879 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] DELETE http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types/838e1647-150d-4bf2-903c-bdbdd81e2460 May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-dde3911b-5447-427e-b52f-7dbd7c201879 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-dde3911b-5447-427e-b52f-7dbd7c201879 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Calling method 'ShareTypesController._delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-dde3911b-5447-427e-b52f-7dbd7c201879 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types/838e1647-150d-4bf2-903c-bdbdd81e2460 returned with HTTP 202 May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 206/426] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:57:01 2024] DELETE /share/v2/35d84ed7cf164123a87b8b906a836985/types/838e1647-150d-4bf2-903c-bdbdd81e2460 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-9541c50a-f4cd-4ef3-87b1-31630c6f1f2f tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] GET http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types/838e1647-150d-4bf2-903c-bdbdd81e2460 May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-9541c50a-f4cd-4ef3-87b1-31630c6f1f2f tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-9541c50a-f4cd-4ef3-87b1-31630c6f1f2f tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Calling method 'ShareTypesController.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-9541c50a-f4cd-4ef3-87b1-31630c6f1f2f tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] HTTP exception thrown: Share type not found. May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-9541c50a-f4cd-4ef3-87b1-31630c6f1f2f tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types/838e1647-150d-4bf2-903c-bdbdd81e2460 returned with HTTP 404 May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 221/427] 10.27.203.238 () {64 vars in 1448 bytes} [Tue May 28 12:57:01 2024] GET /share/v2/35d84ed7cf164123a87b8b906a836985/types/838e1647-150d-4bf2-903c-bdbdd81e2460 => generated 67 bytes in 9 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-58152bde-b7b0-4192-b143-08267080886d tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] DELETE http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types/53f02f55-344c-4f0c-9703-ae4b6def7f22 May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-58152bde-b7b0-4192-b143-08267080886d tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-58152bde-b7b0-4192-b143-08267080886d tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Calling method 'ShareTypesController._delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-58152bde-b7b0-4192-b143-08267080886d tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types/53f02f55-344c-4f0c-9703-ae4b6def7f22 returned with HTTP 202 May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 207/428] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:57:01 2024] DELETE /share/v2/35d84ed7cf164123a87b8b906a836985/types/53f02f55-344c-4f0c-9703-ae4b6def7f22 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-06fa393b-80f0-4808-8603-ca800087975d tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] GET http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types/53f02f55-344c-4f0c-9703-ae4b6def7f22 May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-06fa393b-80f0-4808-8603-ca800087975d tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-06fa393b-80f0-4808-8603-ca800087975d tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Calling method 'ShareTypesController.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-06fa393b-80f0-4808-8603-ca800087975d tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] HTTP exception thrown: Share type not found. May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-06fa393b-80f0-4808-8603-ca800087975d tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types/53f02f55-344c-4f0c-9703-ae4b6def7f22 returned with HTTP 404 May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 222/429] 10.27.203.238 () {64 vars in 1448 bytes} [Tue May 28 12:57:01 2024] GET /share/v2/35d84ed7cf164123a87b8b906a836985/types/53f02f55-344c-4f0c-9703-ae4b6def7f22 => generated 67 bytes in 9 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-d9b4347b-56cc-44d3-a9c8-d75c49601c47 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] DELETE http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types/f5d48070-5d9b-49a8-b0b5-28d94b22aec2 May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-d9b4347b-56cc-44d3-a9c8-d75c49601c47 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-d9b4347b-56cc-44d3-a9c8-d75c49601c47 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Calling method 'ShareTypesController._delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-d9b4347b-56cc-44d3-a9c8-d75c49601c47 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types/f5d48070-5d9b-49a8-b0b5-28d94b22aec2 returned with HTTP 202 May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 208/430] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:57:01 2024] DELETE /share/v2/35d84ed7cf164123a87b8b906a836985/types/f5d48070-5d9b-49a8-b0b5-28d94b22aec2 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-b59e59b2-3094-4ece-be5e-5f6a28ca5b4e tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] GET http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types/f5d48070-5d9b-49a8-b0b5-28d94b22aec2 May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-b59e59b2-3094-4ece-be5e-5f6a28ca5b4e tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-b59e59b2-3094-4ece-be5e-5f6a28ca5b4e tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Calling method 'ShareTypesController.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-b59e59b2-3094-4ece-be5e-5f6a28ca5b4e tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] HTTP exception thrown: Share type not found. May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-b59e59b2-3094-4ece-be5e-5f6a28ca5b4e tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types/f5d48070-5d9b-49a8-b0b5-28d94b22aec2 returned with HTTP 404 May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 223/431] 10.27.203.238 () {64 vars in 1448 bytes} [Tue May 28 12:57:01 2024] GET /share/v2/35d84ed7cf164123a87b8b906a836985/types/f5d48070-5d9b-49a8-b0b5-28d94b22aec2 => generated 67 bytes in 11 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-f71a58c7-687d-43d8-98a7-c3aa091aceb4 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] DELETE http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types/d8194bec-d49e-4fba-9f80-e1c088e73b8c May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-f71a58c7-687d-43d8-98a7-c3aa091aceb4 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-f71a58c7-687d-43d8-98a7-c3aa091aceb4 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Calling method 'ShareTypesController._delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-f71a58c7-687d-43d8-98a7-c3aa091aceb4 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types/d8194bec-d49e-4fba-9f80-e1c088e73b8c returned with HTTP 202 May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 209/432] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:57:01 2024] DELETE /share/v2/35d84ed7cf164123a87b8b906a836985/types/d8194bec-d49e-4fba-9f80-e1c088e73b8c => generated 0 bytes in 39 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-4c8d8a46-1005-46af-9a02-fd0c8531a891 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] GET http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types/d8194bec-d49e-4fba-9f80-e1c088e73b8c May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-4c8d8a46-1005-46af-9a02-fd0c8531a891 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-4c8d8a46-1005-46af-9a02-fd0c8531a891 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Calling method 'ShareTypesController.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-4c8d8a46-1005-46af-9a02-fd0c8531a891 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] HTTP exception thrown: Share type not found. May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-4c8d8a46-1005-46af-9a02-fd0c8531a891 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types/d8194bec-d49e-4fba-9f80-e1c088e73b8c returned with HTTP 404 May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 224/433] 10.27.203.238 () {64 vars in 1448 bytes} [Tue May 28 12:57:01 2024] GET /share/v2/35d84ed7cf164123a87b8b906a836985/types/d8194bec-d49e-4fba-9f80-e1c088e73b8c => generated 67 bytes in 9 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-f35a9bcf-4f64-4e79-94c7-3fcd9ee03c30 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] DELETE http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types/09e30216-341d-4e60-adde-4ada6d4ef3aa May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-f35a9bcf-4f64-4e79-94c7-3fcd9ee03c30 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-f35a9bcf-4f64-4e79-94c7-3fcd9ee03c30 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Calling method 'ShareTypesController._delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-f35a9bcf-4f64-4e79-94c7-3fcd9ee03c30 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types/09e30216-341d-4e60-adde-4ada6d4ef3aa returned with HTTP 202 May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 210/434] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:57:01 2024] DELETE /share/v2/35d84ed7cf164123a87b8b906a836985/types/09e30216-341d-4e60-adde-4ada6d4ef3aa => generated 0 bytes in 33 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-1063f0a9-6914-4a47-aa8c-6248d0d6a545 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] GET http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types/09e30216-341d-4e60-adde-4ada6d4ef3aa May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-1063f0a9-6914-4a47-aa8c-6248d0d6a545 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-1063f0a9-6914-4a47-aa8c-6248d0d6a545 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Calling method 'ShareTypesController.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-1063f0a9-6914-4a47-aa8c-6248d0d6a545 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] HTTP exception thrown: Share type not found. May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-1063f0a9-6914-4a47-aa8c-6248d0d6a545 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types/09e30216-341d-4e60-adde-4ada6d4ef3aa returned with HTTP 404 May 28 12:57:01 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-6e54a78c-4794-448a-be5d-5a31c17c1dd6 tempest-AdminActionsTest-1749172189 None] <<< [PATCH] https://127.0.0.1:40443/api/quotas/10/ May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 225/435] 10.27.203.238 () {64 vars in 1448 bytes} [Tue May 28 12:57:01 2024] GET /share/v2/35d84ed7cf164123a87b8b906a836985/types/09e30216-341d-4e60-adde-4ada6d4ef3aa => generated 67 bytes in 10 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 12:57:01 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-6e54a78c-4794-448a-be5d-5a31c17c1dd6 tempest-AdminActionsTest-1749172189 None] Bunch(cluster='loop75-kfs', cluster_id=1, default_email=None, default_group_quota=None, default_user_quota=None, enable_alarms=True, enable_email_providers=True, grace_period=None, group_quotas=[], guid='0a264a9b-c035-496c-8ef1-e9dd1076d22c', hard_limit=2147483648, hard_limit_inodes=None, id=10, internal=False, is_user_quota=False, last_user_quotas_update=None, name='4016fe10-12f4-48fc-92de-42cdd2fff998', num_blocked_users=0, num_exceeded_users=0, path='/manila/manila-4016fe10-12f4-48fc-92de-42cdd2fff998', percent_capacity=0, percent_inodes=None, pretty_grace_period=None, pretty_grace_period_expiration=None, pretty_state='OK (CREATED)', soft_limit=None, soft_limit_inodes=None, state='OK', sync_state='CREATED', system_id=10, tenant_id=1, tenant_name='default', time_to_block=None, title='4016fe10-12f4-48fc-92de-42cdd2fff998', url='https://127.0.0.1:40443/api/quotas/10/', used_capacity=0, used_capacity_tb=0.0, used_effective_capacity=0, used_effective_capacity_tb=0.0, used_inodes=0, used_limited_capacity=0, user_quotas=[]) May 28 12:57:01 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-6e54a78c-4794-448a-be5d-5a31c17c1dd6 tempest-AdminActionsTest-1749172189 None] --- [PATCH] https://127.0.0.1:40443/api/quotas/10/: Done May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-662fd064-1063-4a24-b718-e39855d1fe0e tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] DELETE http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types/bbf6ff9e-8287-43b7-b921-1eb8e1606eb9 May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-662fd064-1063-4a24-b718-e39855d1fe0e tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:01 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-662fd064-1063-4a24-b718-e39855d1fe0e tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Calling method 'ShareTypesController._delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:01 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-6e54a78c-4794-448a-be5d-5a31c17c1dd6 tempest-AdminActionsTest-1749172189 None] Committed reservations ['799c71ba-a635-42b5-b54d-1d1c9b7b6391', 'c576ca57-e051-4523-b2f8-66cdb687a27f'] {{(pid=98474) commit /opt/stack/manila/manila/quota.py:1063}} May 28 12:57:02 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-662fd064-1063-4a24-b718-e39855d1fe0e tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types/bbf6ff9e-8287-43b7-b921-1eb8e1606eb9 returned with HTTP 202 May 28 12:57:02 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 211/436] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:57:01 2024] DELETE /share/v2/35d84ed7cf164123a87b8b906a836985/types/bbf6ff9e-8287-43b7-b921-1eb8e1606eb9 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:57:02 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-5b77e65b-0817-4cfe-9d8c-fda28899f746 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] GET http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types/bbf6ff9e-8287-43b7-b921-1eb8e1606eb9 May 28 12:57:02 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-5b77e65b-0817-4cfe-9d8c-fda28899f746 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:02 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-5b77e65b-0817-4cfe-9d8c-fda28899f746 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Calling method 'ShareTypesController.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:02 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-5b77e65b-0817-4cfe-9d8c-fda28899f746 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] HTTP exception thrown: Share type not found. May 28 12:57:02 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-5b77e65b-0817-4cfe-9d8c-fda28899f746 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types/bbf6ff9e-8287-43b7-b921-1eb8e1606eb9 returned with HTTP 404 May 28 12:57:02 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 226/437] 10.27.203.238 () {64 vars in 1448 bytes} [Tue May 28 12:57:02 2024] GET /share/v2/35d84ed7cf164123a87b8b906a836985/types/bbf6ff9e-8287-43b7-b921-1eb8e1606eb9 => generated 67 bytes in 10 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 12:57:02 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-7273a07e-b556-48ac-9958-f8fbf87f2afc tempest-ShareInstancesNegativeTest-210953919 tempest-ShareInstancesNegativeTest-210953919-project-admin] GET http://10.27.203.238/share/v2/bb8f0d37fc204d24b8146108f63a1922/shares/6b055a82-f6ad-4af2-8b38-137b3cc99cc1 May 28 12:57:02 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-7273a07e-b556-48ac-9958-f8fbf87f2afc tempest-ShareInstancesNegativeTest-210953919 tempest-ShareInstancesNegativeTest-210953919-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:02 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-7273a07e-b556-48ac-9958-f8fbf87f2afc tempest-ShareInstancesNegativeTest-210953919 tempest-ShareInstancesNegativeTest-210953919-project-admin] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:02 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-13d9d8fa-2eda-4737-a1ff-2cb5246c59b3 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] DELETE http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types/2a604dfb-5878-44de-90b0-fb91db1c433d May 28 12:57:02 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-13d9d8fa-2eda-4737-a1ff-2cb5246c59b3 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:02 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-13d9d8fa-2eda-4737-a1ff-2cb5246c59b3 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Calling method 'ShareTypesController._delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:02 l75lg1-v1 manila-share[98474]: INFO manila.share.manager [None req-6e54a78c-4794-448a-be5d-5a31c17c1dd6 tempest-AdminActionsTest-1749172189 None] Extend share completed successfully. May 28 12:57:02 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-7273a07e-b556-48ac-9958-f8fbf87f2afc tempest-ShareInstancesNegativeTest-210953919 tempest-ShareInstancesNegativeTest-210953919-project-admin] http://10.27.203.238/share/v2/bb8f0d37fc204d24b8146108f63a1922/shares/6b055a82-f6ad-4af2-8b38-137b3cc99cc1 returned with HTTP 200 May 28 12:57:02 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 227/438] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:57:02 2024] GET /share/v2/bb8f0d37fc204d24b8146108f63a1922/shares/6b055a82-f6ad-4af2-8b38-137b3cc99cc1 => generated 1370 bytes in 22 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:57:02 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-13d9d8fa-2eda-4737-a1ff-2cb5246c59b3 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types/2a604dfb-5878-44de-90b0-fb91db1c433d returned with HTTP 202 May 28 12:57:02 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 212/439] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:57:02 2024] DELETE /share/v2/35d84ed7cf164123a87b8b906a836985/types/2a604dfb-5878-44de-90b0-fb91db1c433d => generated 0 bytes in 36 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:57:02 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-a65465ae-09a6-4c3b-8ebf-6e31473c242a tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] GET http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types/2a604dfb-5878-44de-90b0-fb91db1c433d May 28 12:57:02 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-a65465ae-09a6-4c3b-8ebf-6e31473c242a tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:02 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-a65465ae-09a6-4c3b-8ebf-6e31473c242a tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Calling method 'ShareTypesController.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:02 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-a65465ae-09a6-4c3b-8ebf-6e31473c242a tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] HTTP exception thrown: Share type not found. May 28 12:57:02 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-a65465ae-09a6-4c3b-8ebf-6e31473c242a tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types/2a604dfb-5878-44de-90b0-fb91db1c433d returned with HTTP 404 May 28 12:57:02 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 228/440] 10.27.203.238 () {64 vars in 1448 bytes} [Tue May 28 12:57:02 2024] GET /share/v2/35d84ed7cf164123a87b8b906a836985/types/2a604dfb-5878-44de-90b0-fb91db1c433d => generated 67 bytes in 9 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 12:57:02 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-396bda31-4fdd-48f0-83c6-c5f8680dad87 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] DELETE http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types/8f410a55-c636-4b9c-895f-cda92ea6f0ce May 28 12:57:02 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-396bda31-4fdd-48f0-83c6-c5f8680dad87 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:02 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-396bda31-4fdd-48f0-83c6-c5f8680dad87 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Calling method 'ShareTypesController._delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:02 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-396bda31-4fdd-48f0-83c6-c5f8680dad87 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types/8f410a55-c636-4b9c-895f-cda92ea6f0ce returned with HTTP 202 May 28 12:57:02 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 213/441] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:57:02 2024] DELETE /share/v2/35d84ed7cf164123a87b8b906a836985/types/8f410a55-c636-4b9c-895f-cda92ea6f0ce => generated 0 bytes in 33 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:57:02 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-9d4e2069-8cd5-4ecc-8c81-37463e8d6da5 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] GET http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types/8f410a55-c636-4b9c-895f-cda92ea6f0ce May 28 12:57:02 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-9d4e2069-8cd5-4ecc-8c81-37463e8d6da5 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:02 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-9d4e2069-8cd5-4ecc-8c81-37463e8d6da5 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Calling method 'ShareTypesController.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:02 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-9d4e2069-8cd5-4ecc-8c81-37463e8d6da5 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] HTTP exception thrown: Share type not found. May 28 12:57:02 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-9d4e2069-8cd5-4ecc-8c81-37463e8d6da5 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types/8f410a55-c636-4b9c-895f-cda92ea6f0ce returned with HTTP 404 May 28 12:57:02 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 229/442] 10.27.203.238 () {64 vars in 1448 bytes} [Tue May 28 12:57:02 2024] GET /share/v2/35d84ed7cf164123a87b8b906a836985/types/8f410a55-c636-4b9c-895f-cda92ea6f0ce => generated 67 bytes in 9 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 12:57:02 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-b03b1c43-8a39-45a5-8be8-6836a5d1e080 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] DELETE http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types/33a31329-99f0-4278-b969-6f60426700d1 May 28 12:57:02 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-b03b1c43-8a39-45a5-8be8-6836a5d1e080 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:02 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-b03b1c43-8a39-45a5-8be8-6836a5d1e080 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Calling method 'ShareTypesController._delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:02 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-b03b1c43-8a39-45a5-8be8-6836a5d1e080 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types/33a31329-99f0-4278-b969-6f60426700d1 returned with HTTP 202 May 28 12:57:02 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 214/443] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:57:02 2024] DELETE /share/v2/35d84ed7cf164123a87b8b906a836985/types/33a31329-99f0-4278-b969-6f60426700d1 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:57:02 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-c704b199-8187-48a9-a1cd-48843edd023d tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] GET http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types/33a31329-99f0-4278-b969-6f60426700d1 May 28 12:57:02 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-c704b199-8187-48a9-a1cd-48843edd023d tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:02 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-c704b199-8187-48a9-a1cd-48843edd023d tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Calling method 'ShareTypesController.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:02 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c07df379-c3ad-4b79-82d1-01d37d41940f tempest-ShareInstancesNegativeTest-210953919 None] <<< [DELETE] https://127.0.0.1:40443/api/views/10/ May 28 12:57:02 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c07df379-c3ad-4b79-82d1-01d37d41940f tempest-ShareInstancesNegativeTest-210953919 None] --- [DELETE] https://127.0.0.1:40443/api/views/10/: Done May 28 12:57:02 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c07df379-c3ad-4b79-82d1-01d37d41940f tempest-ShareInstancesNegativeTest-210953919 None] >>> [GET] https://127.0.0.1:40443/api/quotas/ May 28 12:57:02 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c07df379-c3ad-4b79-82d1-01d37d41940f tempest-ShareInstancesNegativeTest-210953919 None] {'allow_redirects': True, May 28 12:57:02 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c07df379-c3ad-4b79-82d1-01d37d41940f tempest-ShareInstancesNegativeTest-210953919 None] 'params': {'name': '9b44eaf4-da6e-42e7-8723-ce0cc8878f85'}} May 28 12:57:02 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-c704b199-8187-48a9-a1cd-48843edd023d tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] HTTP exception thrown: Share type not found. May 28 12:57:02 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-c704b199-8187-48a9-a1cd-48843edd023d tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types/33a31329-99f0-4278-b969-6f60426700d1 returned with HTTP 404 May 28 12:57:02 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 230/444] 10.27.203.238 () {64 vars in 1448 bytes} [Tue May 28 12:57:02 2024] GET /share/v2/35d84ed7cf164123a87b8b906a836985/types/33a31329-99f0-4278-b969-6f60426700d1 => generated 67 bytes in 11 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 12:57:02 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-0d7e5f9d-34fb-4c20-8071-df5b5f4f16f1 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] DELETE http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types/238d4e44-28b7-4ce6-bb66-9e8a6a669e93 May 28 12:57:02 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-0d7e5f9d-34fb-4c20-8071-df5b5f4f16f1 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:02 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-0d7e5f9d-34fb-4c20-8071-df5b5f4f16f1 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Calling method 'ShareTypesController._delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:02 l75lg1-v1 devstack@placement-api.service[78202]: DEBUG dbcounter [-] [78202] Writing DB stats placement:SELECT=2 {{(pid=78202) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:57:02 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-0d7e5f9d-34fb-4c20-8071-df5b5f4f16f1 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types/238d4e44-28b7-4ce6-bb66-9e8a6a669e93 returned with HTTP 202 May 28 12:57:02 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 215/445] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:57:02 2024] DELETE /share/v2/35d84ed7cf164123a87b8b906a836985/types/238d4e44-28b7-4ce6-bb66-9e8a6a669e93 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:57:02 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-8efc0601-f045-4d58-bc44-949b4e9f19a2 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] GET http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types/238d4e44-28b7-4ce6-bb66-9e8a6a669e93 May 28 12:57:02 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-8efc0601-f045-4d58-bc44-949b4e9f19a2 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:02 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-8efc0601-f045-4d58-bc44-949b4e9f19a2 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Calling method 'ShareTypesController.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:02 l75lg1-v1 devstack@placement-api.service[78201]: DEBUG dbcounter [-] [78201] Writing DB stats placement:SELECT=2 {{(pid=78201) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:57:02 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-8efc0601-f045-4d58-bc44-949b4e9f19a2 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] HTTP exception thrown: Share type not found. May 28 12:57:02 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-8efc0601-f045-4d58-bc44-949b4e9f19a2 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types/238d4e44-28b7-4ce6-bb66-9e8a6a669e93 returned with HTTP 404 May 28 12:57:02 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 231/446] 10.27.203.238 () {64 vars in 1448 bytes} [Tue May 28 12:57:02 2024] GET /share/v2/35d84ed7cf164123a87b8b906a836985/types/238d4e44-28b7-4ce6-bb66-9e8a6a669e93 => generated 67 bytes in 10 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 12:57:02 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-1884d688-25bc-4913-a8b8-7cac46d5c393 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] DELETE http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types/5debb07d-1f82-4b75-86c8-2d76a921ab8f May 28 12:57:02 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-1884d688-25bc-4913-a8b8-7cac46d5c393 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:02 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-1884d688-25bc-4913-a8b8-7cac46d5c393 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Calling method 'ShareTypesController._delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:02 l75lg1-v1 dstat.sh[49771]: 28-05 12:57:02| 10 2 85 3 0|5671M 1832M 277M 7846M| 19k 802B| 0 2936k| 0 447 |8013 13k|1.47 0.98 0.98|2.0 0 0| 0 0 | 0 2048M| 29 348 0 59 0 May 28 12:57:02 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-1884d688-25bc-4913-a8b8-7cac46d5c393 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types/5debb07d-1f82-4b75-86c8-2d76a921ab8f returned with HTTP 202 May 28 12:57:02 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 216/447] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:57:02 2024] DELETE /share/v2/35d84ed7cf164123a87b8b906a836985/types/5debb07d-1f82-4b75-86c8-2d76a921ab8f => generated 0 bytes in 47 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:57:02 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-2ca163f1-7349-443e-a9c3-fdca0e5ce4c9 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] GET http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types/5debb07d-1f82-4b75-86c8-2d76a921ab8f May 28 12:57:02 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-2ca163f1-7349-443e-a9c3-fdca0e5ce4c9 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:02 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-2ca163f1-7349-443e-a9c3-fdca0e5ce4c9 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Calling method 'ShareTypesController.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:02 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-2ca163f1-7349-443e-a9c3-fdca0e5ce4c9 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] HTTP exception thrown: Share type not found. May 28 12:57:02 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-2ca163f1-7349-443e-a9c3-fdca0e5ce4c9 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types/5debb07d-1f82-4b75-86c8-2d76a921ab8f returned with HTTP 404 May 28 12:57:02 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 232/448] 10.27.203.238 () {64 vars in 1448 bytes} [Tue May 28 12:57:02 2024] GET /share/v2/35d84ed7cf164123a87b8b906a836985/types/5debb07d-1f82-4b75-86c8-2d76a921ab8f => generated 67 bytes in 10 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 12:57:02 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-ec62a6a7-b4f9-4eae-83e0-fd30e42e0021 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] DELETE http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types/70af56f8-a0ee-4f17-b82c-3f78e274e8d6 May 28 12:57:02 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-ec62a6a7-b4f9-4eae-83e0-fd30e42e0021 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:02 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-ec62a6a7-b4f9-4eae-83e0-fd30e42e0021 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Calling method 'ShareTypesController._delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:02 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-ec62a6a7-b4f9-4eae-83e0-fd30e42e0021 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types/70af56f8-a0ee-4f17-b82c-3f78e274e8d6 returned with HTTP 202 May 28 12:57:02 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 217/449] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:57:02 2024] DELETE /share/v2/35d84ed7cf164123a87b8b906a836985/types/70af56f8-a0ee-4f17-b82c-3f78e274e8d6 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:57:02 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-3dacc17b-fc1b-4903-a104-db0c06bd406f tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] GET http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types/70af56f8-a0ee-4f17-b82c-3f78e274e8d6 May 28 12:57:02 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-3dacc17b-fc1b-4903-a104-db0c06bd406f tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:02 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-3dacc17b-fc1b-4903-a104-db0c06bd406f tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Calling method 'ShareTypesController.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:02 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-3dacc17b-fc1b-4903-a104-db0c06bd406f tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] HTTP exception thrown: Share type not found. May 28 12:57:02 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-3dacc17b-fc1b-4903-a104-db0c06bd406f tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types/70af56f8-a0ee-4f17-b82c-3f78e274e8d6 returned with HTTP 404 May 28 12:57:02 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 233/450] 10.27.203.238 () {64 vars in 1448 bytes} [Tue May 28 12:57:02 2024] GET /share/v2/35d84ed7cf164123a87b8b906a836985/types/70af56f8-a0ee-4f17-b82c-3f78e274e8d6 => generated 67 bytes in 10 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 12:57:02 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-8bf3a3f1-8c0c-4b70-95f1-bd9b384a4b66 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] GET http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/share-replicas/detail?share_id=8e00d6e4-a018-4e71-b71c-831e546cb6e6 May 28 12:57:02 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-8bf3a3f1-8c0c-4b70-95f1-bd9b384a4b66 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:02 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-8bf3a3f1-8c0c-4b70-95f1-bd9b384a4b66 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:02 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-8bf3a3f1-8c0c-4b70-95f1-bd9b384a4b66 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/share-replicas/detail?share_id=8e00d6e4-a018-4e71-b71c-831e546cb6e6 returned with HTTP 200 May 28 12:57:02 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 218/451] 10.27.203.238 () {64 vars in 1476 bytes} [Tue May 28 12:57:02 2024] GET /share/v2/35d84ed7cf164123a87b8b906a836985/share-replicas/detail?share_id=8e00d6e4-a018-4e71-b71c-831e546cb6e6 => generated 22 bytes in 17 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:57:02 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-7e081b81-135c-47a7-9bfa-2207e386d60b tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] DELETE http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/shares/8e00d6e4-a018-4e71-b71c-831e546cb6e6 May 28 12:57:02 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-7e081b81-135c-47a7-9bfa-2207e386d60b tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:02 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-7e081b81-135c-47a7-9bfa-2207e386d60b tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Calling method 'ShareMixin.delete' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:02 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.v1.shares [None req-7e081b81-135c-47a7-9bfa-2207e386d60b tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Delete share with id: 8e00d6e4-a018-4e71-b71c-831e546cb6e6 May 28 12:57:02 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-7e081b81-135c-47a7-9bfa-2207e386d60b tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/shares/8e00d6e4-a018-4e71-b71c-831e546cb6e6 returned with HTTP 202 May 28 12:57:02 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 234/452] 10.27.203.238 () {64 vars in 1454 bytes} [Tue May 28 12:57:02 2024] DELETE /share/v2/35d84ed7cf164123a87b8b906a836985/shares/8e00d6e4-a018-4e71-b71c-831e546cb6e6 => generated 0 bytes in 134 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:57:02 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-fdc6b5b4-38e1-4e0f-a2d9-6bc221093fe5 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] GET http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/shares/8e00d6e4-a018-4e71-b71c-831e546cb6e6 May 28 12:57:02 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-fdc6b5b4-38e1-4e0f-a2d9-6bc221093fe5 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:02 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-fdc6b5b4-38e1-4e0f-a2d9-6bc221093fe5 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:02 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-fdc6b5b4-38e1-4e0f-a2d9-6bc221093fe5 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/shares/8e00d6e4-a018-4e71-b71c-831e546cb6e6 returned with HTTP 200 May 28 12:57:02 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 219/453] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:57:02 2024] GET /share/v2/35d84ed7cf164123a87b8b906a836985/shares/8e00d6e4-a018-4e71-b71c-831e546cb6e6 => generated 1347 bytes in 27 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:57:02 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c07df379-c3ad-4b79-82d1-01d37d41940f tempest-ShareInstancesNegativeTest-210953919 None] <<< [GET] https://127.0.0.1:40443/api/quotas/ May 28 12:57:02 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c07df379-c3ad-4b79-82d1-01d37d41940f tempest-ShareInstancesNegativeTest-210953919 None] [Bunch(cluster='loop75-kfs', cluster_id=1, default_email=None, default_group_quota=None, default_user_quota=None, enable_alarms=True, enable_email_providers=True, grace_period=None, guid='07db6d5a-b377-40cb-a98c-08b240f266f1', hard_limit=1073741824, hard_limit_inodes=None, id=8, internal=False, is_user_quota=False, last_user_quotas_update=None, name='9b44eaf4-da6e-42e7-8723-ce0cc8878f85', num_blocked_users=0, num_exceeded_users=0, path='/manila/manila-9b44eaf4-da6e-42e7-8723-ce0cc8878f85', percent_capacity=0, percent_inodes=None, pretty_grace_period=None, pretty_grace_period_expiration=None, pretty_state='OK (CREATED)', soft_limit=None, soft_limit_inodes=None, state='OK', sync_state='CREATED', system_id=8, tenant_id=1, tenant_name='default', time_to_block=None, title='9b44eaf4-da6e-42e7-8723-ce0cc8878f85', url='https://127.0.0.1:40443/api/quotas/8/', used_capacity=0, used_capacity_tb=0.0, used_effective_capacity=0, used_effective_capacity_tb=0.0, used_inodes=0, used_limited_capacity=0)] May 28 12:57:02 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c07df379-c3ad-4b79-82d1-01d37d41940f tempest-ShareInstancesNegativeTest-210953919 None] --- [GET] https://127.0.0.1:40443/api/quotas/: Done May 28 12:57:02 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c07df379-c3ad-4b79-82d1-01d37d41940f tempest-ShareInstancesNegativeTest-210953919 None] >>> [DELETE] https://127.0.0.1:40443/api/quotas/8/ May 28 12:57:02 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-7e081b81-135c-47a7-9bfa-2207e386d60b tempest-ShareTypesAdminTest-216868925 None] Acquiring lock "locked_access_rules_operation_by_share_instance_4e77e600-5df2-4310-91eb-8d6633f53ce4" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:57:02 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-7e081b81-135c-47a7-9bfa-2207e386d60b tempest-ShareTypesAdminTest-216868925 None] Lock "locked_access_rules_operation_by_share_instance_4e77e600-5df2-4310-91eb-8d6633f53ce4" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:57:02 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-7e081b81-135c-47a7-9bfa-2207e386d60b tempest-ShareTypesAdminTest-216868925 None] Lock "locked_access_rules_operation_by_share_instance_4e77e600-5df2-4310-91eb-8d6633f53ce4" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:57:02 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-7e081b81-135c-47a7-9bfa-2207e386d60b tempest-ShareTypesAdminTest-216868925 None] Acquiring lock "locked_access_rules_operation_by_share_instance_4e77e600-5df2-4310-91eb-8d6633f53ce4" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:57:02 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-7e081b81-135c-47a7-9bfa-2207e386d60b tempest-ShareTypesAdminTest-216868925 None] Lock "locked_access_rules_operation_by_share_instance_4e77e600-5df2-4310-91eb-8d6633f53ce4" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:57:02 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-7e081b81-135c-47a7-9bfa-2207e386d60b tempest-ShareTypesAdminTest-216868925 None] Lock "locked_access_rules_operation_by_share_instance_4e77e600-5df2-4310-91eb-8d6633f53ce4" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:57:02 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-7e081b81-135c-47a7-9bfa-2207e386d60b tempest-ShareTypesAdminTest-216868925 None] Acquiring lock "locked_access_rules_operation_by_share_instance_4e77e600-5df2-4310-91eb-8d6633f53ce4" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:57:02 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-7e081b81-135c-47a7-9bfa-2207e386d60b tempest-ShareTypesAdminTest-216868925 None] Lock "locked_access_rules_operation_by_share_instance_4e77e600-5df2-4310-91eb-8d6633f53ce4" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:57:02 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-7e081b81-135c-47a7-9bfa-2207e386d60b tempest-ShareTypesAdminTest-216868925 None] Lock "locked_access_rules_operation_by_share_instance_4e77e600-5df2-4310-91eb-8d6633f53ce4" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:57:02 l75lg1-v1 manila-share[98474]: DEBUG manila.share.access [None req-7e081b81-135c-47a7-9bfa-2207e386d60b tempest-ShareTypesAdminTest-216868925 None] All access rules have been synced for share instance 4e77e600-5df2-4310-91eb-8d6633f53ce4 belonging to share 8e00d6e4-a018-4e71-b71c-831e546cb6e6. {{(pid=98474) update_access_rules /opt/stack/manila/manila/share/access.py:304}} May 28 12:57:02 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-7e081b81-135c-47a7-9bfa-2207e386d60b tempest-ShareTypesAdminTest-216868925 None] deleting '/manila/manila-4e77e600-5df2-4310-91eb-8d6633f53ce4' May 28 12:57:02 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-7e081b81-135c-47a7-9bfa-2207e386d60b tempest-ShareTypesAdminTest-216868925 None] >>> [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/ May 28 12:57:02 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-7e081b81-135c-47a7-9bfa-2207e386d60b tempest-ShareTypesAdminTest-216868925 None] {'data': '{"path": "/manila/manila-4e77e600-5df2-4310-91eb-8d6633f53ce4"}', May 28 12:57:02 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-7e081b81-135c-47a7-9bfa-2207e386d60b tempest-ShareTypesAdminTest-216868925 None] 'params': None} May 28 12:57:02 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-7e081b81-135c-47a7-9bfa-2207e386d60b tempest-ShareTypesAdminTest-216868925 None] <<< [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/ May 28 12:57:02 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-7e081b81-135c-47a7-9bfa-2207e386d60b tempest-ShareTypesAdminTest-216868925 None] 'OK' May 28 12:57:02 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-7e081b81-135c-47a7-9bfa-2207e386d60b tempest-ShareTypesAdminTest-216868925 None] --- [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/: Done May 28 12:57:02 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-7e081b81-135c-47a7-9bfa-2207e386d60b tempest-ShareTypesAdminTest-216868925 None] >>> [GET] https://127.0.0.1:40443/api/views/ May 28 12:57:02 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-7e081b81-135c-47a7-9bfa-2207e386d60b tempest-ShareTypesAdminTest-216868925 None] {'allow_redirects': True, May 28 12:57:02 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-7e081b81-135c-47a7-9bfa-2207e386d60b tempest-ShareTypesAdminTest-216868925 None] 'params': {'name': '4e77e600-5df2-4310-91eb-8d6633f53ce4'}} May 28 12:57:02 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-6437edb3-2b4a-4102-af75-fe5dd9510706 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] GET http://10.27.203.238/share/v1/a3499cb78849424db45e54caac01de92/shares/9be3b244-34ab-4002-b1e1-427af2ab8545 May 28 12:57:02 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-6437edb3-2b4a-4102-af75-fe5dd9510706 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:02 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-6437edb3-2b4a-4102-af75-fe5dd9510706 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:02 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-6437edb3-2b4a-4102-af75-fe5dd9510706 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v1/a3499cb78849424db45e54caac01de92/shares/9be3b244-34ab-4002-b1e1-427af2ab8545 returned with HTTP 200 May 28 12:57:02 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 235/454] 10.27.203.238 () {62 vars in 1408 bytes} [Tue May 28 12:57:02 2024] GET /share/v1/a3499cb78849424db45e54caac01de92/shares/9be3b244-34ab-4002-b1e1-427af2ab8545 => generated 1019 bytes in 24 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:57:02 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-e502bf00-4fef-42e3-8f4c-188fc3b0a3f4 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] GET http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/shares/9be3b244-34ab-4002-b1e1-427af2ab8545 May 28 12:57:02 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-e502bf00-4fef-42e3-8f4c-188fc3b0a3f4 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:02 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-e502bf00-4fef-42e3-8f4c-188fc3b0a3f4 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:02 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-e502bf00-4fef-42e3-8f4c-188fc3b0a3f4 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/shares/9be3b244-34ab-4002-b1e1-427af2ab8545 returned with HTTP 200 May 28 12:57:02 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 220/455] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:57:02 2024] GET /share/v2/a3499cb78849424db45e54caac01de92/shares/9be3b244-34ab-4002-b1e1-427af2ab8545 => generated 1372 bytes in 24 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:57:02 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-b8ecb69d-b062-4769-a368-630c5a2580e4 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] GET http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/share-replicas/detail?share_id=9be3b244-34ab-4002-b1e1-427af2ab8545 May 28 12:57:02 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-b8ecb69d-b062-4769-a368-630c5a2580e4 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:02 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-b8ecb69d-b062-4769-a368-630c5a2580e4 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:02 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-b8ecb69d-b062-4769-a368-630c5a2580e4 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/share-replicas/detail?share_id=9be3b244-34ab-4002-b1e1-427af2ab8545 returned with HTTP 200 May 28 12:57:02 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 236/456] 10.27.203.238 () {64 vars in 1476 bytes} [Tue May 28 12:57:02 2024] GET /share/v2/a3499cb78849424db45e54caac01de92/share-replicas/detail?share_id=9be3b244-34ab-4002-b1e1-427af2ab8545 => generated 22 bytes in 12 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:57:02 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-eeade190-48a4-4e98-ba6e-dc30e46ebb57 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] DELETE http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/shares/9be3b244-34ab-4002-b1e1-427af2ab8545 May 28 12:57:02 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-eeade190-48a4-4e98-ba6e-dc30e46ebb57 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:02 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-eeade190-48a4-4e98-ba6e-dc30e46ebb57 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Calling method 'ShareMixin.delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:02 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.v1.shares [None req-eeade190-48a4-4e98-ba6e-dc30e46ebb57 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Delete share with id: 9be3b244-34ab-4002-b1e1-427af2ab8545 May 28 12:57:02 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-eeade190-48a4-4e98-ba6e-dc30e46ebb57 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/shares/9be3b244-34ab-4002-b1e1-427af2ab8545 returned with HTTP 202 May 28 12:57:02 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 221/457] 10.27.203.238 () {64 vars in 1454 bytes} [Tue May 28 12:57:02 2024] DELETE /share/v2/a3499cb78849424db45e54caac01de92/shares/9be3b244-34ab-4002-b1e1-427af2ab8545 => generated 0 bytes in 112 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:57:03 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-7039526b-17b4-487b-9ba9-cbcdeac4dc51 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] GET http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/shares/9be3b244-34ab-4002-b1e1-427af2ab8545 May 28 12:57:03 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-7039526b-17b4-487b-9ba9-cbcdeac4dc51 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:03 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-7039526b-17b4-487b-9ba9-cbcdeac4dc51 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:03 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-7039526b-17b4-487b-9ba9-cbcdeac4dc51 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/shares/9be3b244-34ab-4002-b1e1-427af2ab8545 returned with HTTP 200 May 28 12:57:03 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 237/458] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:57:02 2024] GET /share/v2/a3499cb78849424db45e54caac01de92/shares/9be3b244-34ab-4002-b1e1-427af2ab8545 => generated 1371 bytes in 23 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:57:03 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-7e081b81-135c-47a7-9bfa-2207e386d60b tempest-ShareTypesAdminTest-216868925 None] <<< [GET] https://127.0.0.1:40443/api/views/ May 28 12:57:03 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-7e081b81-135c-47a7-9bfa-2207e386d60b tempest-ShareTypesAdminTest-216868925 None] [Bunch(abac_tags=[], abe_max_depth=None, abe_protocols=[], alias='', allow_anonymous_access=False, allow_s3_anonymous_access=False, auto_commit='0d', bucket='', bucket_creators=[], bucket_creators_groups=[], bucket_owner=None, bulk_permission_update_progress=None, bulk_permission_update_state=None, cluster='loop75-kfs', cluster_id=1, created='2024-05-28T12:56:57.497558Z', enabled=True, files_retention_mode='NONE', guid='1743eb56-f144-4850-b3b2-ddb0cb513da4', id=11, ignore_oos=False, internal=False, is_remote=False, is_seamless=False, logical_capacity=0, max_retention_period=None, min_retention_period=None, name='4e77e600-5df2-4310-91eb-8d6633f53ce4', nfs_interop_flags='BOTH_NFS3_AND_NFS4_INTEROP_DISABLED', path='/manila/manila-4e77e600-5df2-4310-91eb-8d6633f53ce4', physical_capacity=0, policy='4e77e600-5df2-4310-91eb-8d6633f53ce4', policy_id=12, protocols=['NFS'], qos_policy=None, qos_policy_id=None, s3_locks=False, s3_locks_retention_mode='NONE', s3_locks_retention_period='', s3_unverified_lookup=False, s3_versioning=False, select_for_live_monitoring=False, share='', share_acl=Bunch(acl=[], enabled=False), sync='SYNCED', sync_time='2024-05-28T12:56:57.754059Z', tenant_id=1, tenant_name='default', title='/manila/manila-4e77e600-5df2-4310-91eb-8d6633f53ce4', url='https://127.0.0.1:40443/api/views/11/')] May 28 12:57:03 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-7e081b81-135c-47a7-9bfa-2207e386d60b tempest-ShareTypesAdminTest-216868925 None] --- [GET] https://127.0.0.1:40443/api/views/: Done May 28 12:57:03 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-7e081b81-135c-47a7-9bfa-2207e386d60b tempest-ShareTypesAdminTest-216868925 None] >>> [DELETE] https://127.0.0.1:40443/api/views/11/ May 28 12:57:03 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-eeade190-48a4-4e98-ba6e-dc30e46ebb57 tempest-AdminActionsTest-1749172189 None] Acquiring lock "locked_access_rules_operation_by_share_instance_4016fe10-12f4-48fc-92de-42cdd2fff998" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:57:03 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-eeade190-48a4-4e98-ba6e-dc30e46ebb57 tempest-AdminActionsTest-1749172189 None] Lock "locked_access_rules_operation_by_share_instance_4016fe10-12f4-48fc-92de-42cdd2fff998" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:57:03 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-eeade190-48a4-4e98-ba6e-dc30e46ebb57 tempest-AdminActionsTest-1749172189 None] Lock "locked_access_rules_operation_by_share_instance_4016fe10-12f4-48fc-92de-42cdd2fff998" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:57:03 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-eeade190-48a4-4e98-ba6e-dc30e46ebb57 tempest-AdminActionsTest-1749172189 None] Acquiring lock "locked_access_rules_operation_by_share_instance_4016fe10-12f4-48fc-92de-42cdd2fff998" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:57:03 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-eeade190-48a4-4e98-ba6e-dc30e46ebb57 tempest-AdminActionsTest-1749172189 None] Lock "locked_access_rules_operation_by_share_instance_4016fe10-12f4-48fc-92de-42cdd2fff998" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:57:03 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-eeade190-48a4-4e98-ba6e-dc30e46ebb57 tempest-AdminActionsTest-1749172189 None] Lock "locked_access_rules_operation_by_share_instance_4016fe10-12f4-48fc-92de-42cdd2fff998" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:57:03 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-eeade190-48a4-4e98-ba6e-dc30e46ebb57 tempest-AdminActionsTest-1749172189 None] Acquiring lock "locked_access_rules_operation_by_share_instance_4016fe10-12f4-48fc-92de-42cdd2fff998" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:57:03 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-eeade190-48a4-4e98-ba6e-dc30e46ebb57 tempest-AdminActionsTest-1749172189 None] Lock "locked_access_rules_operation_by_share_instance_4016fe10-12f4-48fc-92de-42cdd2fff998" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:57:03 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-eeade190-48a4-4e98-ba6e-dc30e46ebb57 tempest-AdminActionsTest-1749172189 None] Lock "locked_access_rules_operation_by_share_instance_4016fe10-12f4-48fc-92de-42cdd2fff998" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:57:03 l75lg1-v1 manila-share[98474]: DEBUG manila.share.access [None req-eeade190-48a4-4e98-ba6e-dc30e46ebb57 tempest-AdminActionsTest-1749172189 None] All access rules have been synced for share instance 4016fe10-12f4-48fc-92de-42cdd2fff998 belonging to share 9be3b244-34ab-4002-b1e1-427af2ab8545. {{(pid=98474) update_access_rules /opt/stack/manila/manila/share/access.py:304}} May 28 12:57:03 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-eeade190-48a4-4e98-ba6e-dc30e46ebb57 tempest-AdminActionsTest-1749172189 None] deleting '/manila/manila-4016fe10-12f4-48fc-92de-42cdd2fff998' May 28 12:57:03 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-eeade190-48a4-4e98-ba6e-dc30e46ebb57 tempest-AdminActionsTest-1749172189 None] >>> [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/ May 28 12:57:03 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-eeade190-48a4-4e98-ba6e-dc30e46ebb57 tempest-AdminActionsTest-1749172189 None] {'data': '{"path": "/manila/manila-4016fe10-12f4-48fc-92de-42cdd2fff998"}', May 28 12:57:03 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-eeade190-48a4-4e98-ba6e-dc30e46ebb57 tempest-AdminActionsTest-1749172189 None] 'params': None} May 28 12:57:03 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-b3c2b941-0967-4bc3-88ac-88958d479c05 tempest-AccessRulesMetadataTest-1973590610 tempest-AccessRulesMetadataTest-1973590610-project-member] GET http://10.27.203.238/share/v2/1643901550e140118fc2d2e92b82cd0b/share-access-rules?share_id=b92fc06b-76d7-40f9-adef-74a07ace1027 May 28 12:57:03 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-b3c2b941-0967-4bc3-88ac-88958d479c05 tempest-AccessRulesMetadataTest-1973590610 tempest-AccessRulesMetadataTest-1973590610-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:03 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-b3c2b941-0967-4bc3-88ac-88958d479c05 tempest-AccessRulesMetadataTest-1973590610 tempest-AccessRulesMetadataTest-1973590610-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:03 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.lock.api [None req-b3c2b941-0967-4bc3-88ac-88958d479c05 tempest-AccessRulesMetadataTest-1973590610 tempest-AccessRulesMetadataTest-1973590610-project-member] Searching for locks by: {'resource_id': '065fb8ea-fc05-4af3-b191-603cca79c74e', 'resource_action': 'show', 'resource_type': 'access_rule'} {{(pid=98330) get_all /opt/stack/manila/manila/lock/api.py:112}} May 28 12:57:03 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-b3c2b941-0967-4bc3-88ac-88958d479c05 tempest-AccessRulesMetadataTest-1973590610 tempest-AccessRulesMetadataTest-1973590610-project-member] http://10.27.203.238/share/v2/1643901550e140118fc2d2e92b82cd0b/share-access-rules?share_id=b92fc06b-76d7-40f9-adef-74a07ace1027 returned with HTTP 200 May 28 12:57:03 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 222/459] 10.27.203.238 () {64 vars in 1467 bytes} [Tue May 28 12:57:03 2024] GET /share/v2/1643901550e140118fc2d2e92b82cd0b/share-access-rules?share_id=b92fc06b-76d7-40f9-adef-74a07ace1027 => generated 340 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:57:03 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-cc40d96c-b03c-4c6f-8903-d71cb091afd7 tempest-AccessRulesMetadataTest-1973590610 tempest-AccessRulesMetadataTest-1973590610-project-member] PUT http://10.27.203.238/share/v2/1643901550e140118fc2d2e92b82cd0b/share-access-rules/065fb8ea-fc05-4af3-b191-603cca79c74e/metadata May 28 12:57:03 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-cc40d96c-b03c-4c6f-8903-d71cb091afd7 tempest-AccessRulesMetadataTest-1973590610 tempest-AccessRulesMetadataTest-1973590610-project-member] Action: 'update', calling method: Controller.__getattribute__..version_select, body: {"metadata": {"key7": "value7", "key2": "value6_new"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:57:03 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-eeade190-48a4-4e98-ba6e-dc30e46ebb57 tempest-AdminActionsTest-1749172189 None] <<< [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/ May 28 12:57:03 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-eeade190-48a4-4e98-ba6e-dc30e46ebb57 tempest-AdminActionsTest-1749172189 None] 'OK' May 28 12:57:03 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-eeade190-48a4-4e98-ba6e-dc30e46ebb57 tempest-AdminActionsTest-1749172189 None] --- [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/: Done May 28 12:57:03 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-eeade190-48a4-4e98-ba6e-dc30e46ebb57 tempest-AdminActionsTest-1749172189 None] >>> [GET] https://127.0.0.1:40443/api/views/ May 28 12:57:03 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-eeade190-48a4-4e98-ba6e-dc30e46ebb57 tempest-AdminActionsTest-1749172189 None] {'allow_redirects': True, May 28 12:57:03 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-eeade190-48a4-4e98-ba6e-dc30e46ebb57 tempest-AdminActionsTest-1749172189 None] 'params': {'name': '4016fe10-12f4-48fc-92de-42cdd2fff998'}} May 28 12:57:03 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-cc40d96c-b03c-4c6f-8903-d71cb091afd7 tempest-AccessRulesMetadataTest-1973590610 tempest-AccessRulesMetadataTest-1973590610-project-member] http://10.27.203.238/share/v2/1643901550e140118fc2d2e92b82cd0b/share-access-rules/065fb8ea-fc05-4af3-b191-603cca79c74e/metadata returned with HTTP 200 May 28 12:57:03 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 238/460] 10.27.203.238 () {66 vars in 1534 bytes} [Tue May 28 12:57:03 2024] PUT /share/v2/1643901550e140118fc2d2e92b82cd0b/share-access-rules/065fb8ea-fc05-4af3-b191-603cca79c74e/metadata => generated 54 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:57:03 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-cb5ddded-2148-4187-8b30-bfd36611d686 tempest-AccessRulesMetadataTest-1973590610 tempest-AccessRulesMetadataTest-1973590610-project-member] GET http://10.27.203.238/share/v2/1643901550e140118fc2d2e92b82cd0b/share-access-rules/065fb8ea-fc05-4af3-b191-603cca79c74e May 28 12:57:03 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-cb5ddded-2148-4187-8b30-bfd36611d686 tempest-AccessRulesMetadataTest-1973590610 tempest-AccessRulesMetadataTest-1973590610-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:03 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-cb5ddded-2148-4187-8b30-bfd36611d686 tempest-AccessRulesMetadataTest-1973590610 tempest-AccessRulesMetadataTest-1973590610-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:03 l75lg1-v1 dstat.sh[49771]: 28-05 12:57:03| 9 1 86 4 0|5673M 1830M 277M 7846M| 24k 8345B| 0 11M| 0 726 |5591 9655 |1.47 0.98 0.98|1.0 0 0| 0 0 | 0 2048M| 29 348 0 59 0 May 28 12:57:03 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.lock.api [None req-cb5ddded-2148-4187-8b30-bfd36611d686 tempest-AccessRulesMetadataTest-1973590610 tempest-AccessRulesMetadataTest-1973590610-project-member] Searching for locks by: {'resource_id': '065fb8ea-fc05-4af3-b191-603cca79c74e', 'resource_action': 'show', 'resource_type': 'access_rule'} {{(pid=98330) get_all /opt/stack/manila/manila/lock/api.py:112}} May 28 12:57:03 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-cb5ddded-2148-4187-8b30-bfd36611d686 tempest-AccessRulesMetadataTest-1973590610 tempest-AccessRulesMetadataTest-1973590610-project-member] http://10.27.203.238/share/v2/1643901550e140118fc2d2e92b82cd0b/share-access-rules/065fb8ea-fc05-4af3-b191-603cca79c74e returned with HTTP 200 May 28 12:57:03 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 223/461] 10.27.203.238 () {64 vars in 1487 bytes} [Tue May 28 12:57:03 2024] GET /share/v2/1643901550e140118fc2d2e92b82cd0b/share-access-rules/065fb8ea-fc05-4af3-b191-603cca79c74e => generated 407 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:57:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5686a749-7234-4eeb-aef0-4f2b1af9a630 tempest-ExportLocationsNegativeTest-386865252 tempest-ExportLocationsNegativeTest-386865252-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-5686a749-7234-4eeb-aef0-4f2b1af9a630 tempest-ExportLocationsNegativeTest-386865252 tempest-ExportLocationsNegativeTest-386865252-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5686a749-7234-4eeb-aef0-4f2b1af9a630 tempest-ExportLocationsNegativeTest-386865252 tempest-ExportLocationsNegativeTest-386865252-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894e1823-8668-4d2b-ab36-81c2d1262b9f tempest-AccessRulesMetadataTest-1677117720 tempest-AccessRulesMetadataTest-1677117720-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '521b52cb8ba745709f1904fcb99154d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ff8cffa80748308f619a3e52a285f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894e1823-8668-4d2b-ab36-81c2d1262b9f tempest-AccessRulesMetadataTest-1677117720 tempest-AccessRulesMetadataTest-1677117720-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894e1823-8668-4d2b-ab36-81c2d1262b9f tempest-AccessRulesMetadataTest-1677117720 tempest-AccessRulesMetadataTest-1677117720-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894e1823-8668-4d2b-ab36-81c2d1262b9f tempest-AccessRulesMetadataTest-1677117720 tempest-AccessRulesMetadataTest-1677117720-project-admin] PATH_INFO: `/v3/users/981b3e419ab1466ba64538f100d39f99` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894e1823-8668-4d2b-ab36-81c2d1262b9f tempest-AccessRulesMetadataTest-1677117720 tempest-AccessRulesMetadataTest-1677117720-project-admin] RBAC: Authorizing `identity:delete_user(user_id=981b3e419ab1466ba64538f100d39f99)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894e1823-8668-4d2b-ab36-81c2d1262b9f tempest-AccessRulesMetadataTest-1677117720 tempest-AccessRulesMetadataTest-1677117720-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-894e1823-8668-4d2b-ab36-81c2d1262b9f tempest-AccessRulesMetadataTest-1677117720 tempest-AccessRulesMetadataTest-1677117720-project-admin] Could not find user: 981b3e419ab1466ba64538f100d39f99.: keystone.exception.UserNotFound: Could not find user: 981b3e419ab1466ba64538f100d39f99. May 28 12:57:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:57:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:57:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:57:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:57:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:57:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:57:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:57:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:57:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:57:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:57:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:57:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 12:57:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 12:57:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:57:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:57:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 12:57:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:57:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 12:57:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:57:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 12:57:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 12:57:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:57:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:57:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 12:57:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:57:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 12:57:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:57:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:57:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:57:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:57:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:57:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:57:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 12:57:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:57:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 12:57:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:57:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:57:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:57:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 12:57:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:57:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 12:57:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 12:57:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 12:57:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 12:57:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 12:57:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 12:57:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 12:57:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 981b3e419ab1466ba64538f100d39f99. May 28 12:57:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 12:57:03 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 829/1680] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 12:57:03 2024] DELETE /identity/v3/users/981b3e419ab1466ba64538f100d39f99 => generated 110 bytes in 109 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 12:57:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32048650-09af-4870-8e22-c880d9056b99 tempest-ExportLocationsNegativeTest-386865252 tempest-ExportLocationsNegativeTest-386865252-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32048650-09af-4870-8e22-c880d9056b99 tempest-ExportLocationsNegativeTest-386865252 tempest-ExportLocationsNegativeTest-386865252-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1440754-9384-4aaf-9173-da088a6c84df tempest-AccessRulesMetadataTest-1677117720 tempest-AccessRulesMetadataTest-1677117720-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '521b52cb8ba745709f1904fcb99154d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ff8cffa80748308f619a3e52a285f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1440754-9384-4aaf-9173-da088a6c84df tempest-AccessRulesMetadataTest-1677117720 tempest-AccessRulesMetadataTest-1677117720-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1440754-9384-4aaf-9173-da088a6c84df tempest-AccessRulesMetadataTest-1677117720 tempest-AccessRulesMetadataTest-1677117720-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1440754-9384-4aaf-9173-da088a6c84df tempest-AccessRulesMetadataTest-1677117720 tempest-AccessRulesMetadataTest-1677117720-project-admin] PATH_INFO: `/v3/users/b06cddbef69143b790020ff2c97c502e` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1440754-9384-4aaf-9173-da088a6c84df tempest-AccessRulesMetadataTest-1677117720 tempest-AccessRulesMetadataTest-1677117720-project-admin] RBAC: Authorizing `identity:delete_user(user_id=b06cddbef69143b790020ff2c97c502e)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1440754-9384-4aaf-9173-da088a6c84df tempest-AccessRulesMetadataTest-1677117720 tempest-AccessRulesMetadataTest-1677117720-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-a1440754-9384-4aaf-9173-da088a6c84df tempest-AccessRulesMetadataTest-1677117720 tempest-AccessRulesMetadataTest-1677117720-project-admin] Could not find user: b06cddbef69143b790020ff2c97c502e.: keystone.exception.UserNotFound: Could not find user: b06cddbef69143b790020ff2c97c502e. May 28 12:57:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:57:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:57:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:57:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:57:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:57:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:57:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:57:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:57:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:57:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:57:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:57:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 12:57:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 12:57:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:57:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:57:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 12:57:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:57:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 12:57:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:57:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 12:57:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 12:57:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:57:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:57:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 12:57:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:57:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 12:57:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:57:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:57:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:57:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:57:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:57:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:57:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 12:57:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:57:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 12:57:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:57:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:57:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:57:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 12:57:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:57:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 12:57:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 12:57:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 12:57:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 12:57:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 12:57:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 12:57:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 12:57:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: b06cddbef69143b790020ff2c97c502e. May 28 12:57:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 12:57:03 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 852/1681] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 12:57:03 2024] DELETE /identity/v3/users/b06cddbef69143b790020ff2c97c502e => generated 110 bytes in 26 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 12:57:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894e1823-8668-4d2b-ab36-81c2d1262b9f tempest-AccessRulesMetadataTest-1677117720 tempest-AccessRulesMetadataTest-1677117720-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894e1823-8668-4d2b-ab36-81c2d1262b9f tempest-AccessRulesMetadataTest-1677117720 tempest-AccessRulesMetadataTest-1677117720-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367b0dfc-f11d-4096-aab3-ecc7626dac6a tempest-AccessRulesMetadataTest-1677117720 tempest-AccessRulesMetadataTest-1677117720-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '521b52cb8ba745709f1904fcb99154d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ff8cffa80748308f619a3e52a285f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367b0dfc-f11d-4096-aab3-ecc7626dac6a tempest-AccessRulesMetadataTest-1677117720 tempest-AccessRulesMetadataTest-1677117720-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367b0dfc-f11d-4096-aab3-ecc7626dac6a tempest-AccessRulesMetadataTest-1677117720 tempest-AccessRulesMetadataTest-1677117720-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367b0dfc-f11d-4096-aab3-ecc7626dac6a tempest-AccessRulesMetadataTest-1677117720 tempest-AccessRulesMetadataTest-1677117720-project-admin] PATH_INFO: `/v3/users/6285dcecc86746a7b4eee34cf3c3f672` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367b0dfc-f11d-4096-aab3-ecc7626dac6a tempest-AccessRulesMetadataTest-1677117720 tempest-AccessRulesMetadataTest-1677117720-project-admin] RBAC: Authorizing `identity:delete_user(user_id=6285dcecc86746a7b4eee34cf3c3f672)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367b0dfc-f11d-4096-aab3-ecc7626dac6a tempest-AccessRulesMetadataTest-1677117720 tempest-AccessRulesMetadataTest-1677117720-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-367b0dfc-f11d-4096-aab3-ecc7626dac6a tempest-AccessRulesMetadataTest-1677117720 tempest-AccessRulesMetadataTest-1677117720-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6285dcecc86746a7b4eee34cf3c3f672', 'request_id': 'req-367b0dfc-f11d-4096-aab3-ecc7626dac6a'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-367b0dfc-f11d-4096-aab3-ecc7626dac6a tempest-AccessRulesMetadataTest-1677117720 tempest-AccessRulesMetadataTest-1677117720-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6285dcecc86746a7b4eee34cf3c3f672', 'request_id': 'req-367b0dfc-f11d-4096-aab3-ecc7626dac6a'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-367b0dfc-f11d-4096-aab3-ecc7626dac6a tempest-AccessRulesMetadataTest-1677117720 tempest-AccessRulesMetadataTest-1677117720-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6285dcecc86746a7b4eee34cf3c3f672', 'request_id': 'req-367b0dfc-f11d-4096-aab3-ecc7626dac6a'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-367b0dfc-f11d-4096-aab3-ecc7626dac6a tempest-AccessRulesMetadataTest-1677117720 tempest-AccessRulesMetadataTest-1677117720-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6285dcecc86746a7b4eee34cf3c3f672', 'request_id': 'req-367b0dfc-f11d-4096-aab3-ecc7626dac6a'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-367b0dfc-f11d-4096-aab3-ecc7626dac6a tempest-AccessRulesMetadataTest-1677117720 tempest-AccessRulesMetadataTest-1677117720-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6285dcecc86746a7b4eee34cf3c3f672', 'request_id': 'req-367b0dfc-f11d-4096-aab3-ecc7626dac6a'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:03 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 830/1682] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 12:57:03 2024] DELETE /identity/v3/users/6285dcecc86746a7b4eee34cf3c3f672 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:57:03 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-323edf33-13c2-427a-afa2-9c6f6cd8d92f tempest-AccessRulesMetadataTest-1973590610 tempest-AccessRulesMetadataTest-1973590610-project-member] GET http://10.27.203.238/share/v2/1643901550e140118fc2d2e92b82cd0b/share-replicas/detail?share_id=b92fc06b-76d7-40f9-adef-74a07ace1027 May 28 12:57:03 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-323edf33-13c2-427a-afa2-9c6f6cd8d92f tempest-AccessRulesMetadataTest-1973590610 tempest-AccessRulesMetadataTest-1973590610-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:03 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-323edf33-13c2-427a-afa2-9c6f6cd8d92f tempest-AccessRulesMetadataTest-1973590610 tempest-AccessRulesMetadataTest-1973590610-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:03 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-323edf33-13c2-427a-afa2-9c6f6cd8d92f tempest-AccessRulesMetadataTest-1973590610 tempest-AccessRulesMetadataTest-1973590610-project-member] http://10.27.203.238/share/v2/1643901550e140118fc2d2e92b82cd0b/share-replicas/detail?share_id=b92fc06b-76d7-40f9-adef-74a07ace1027 returned with HTTP 200 May 28 12:57:03 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 239/462] 10.27.203.238 () {64 vars in 1476 bytes} [Tue May 28 12:57:03 2024] GET /share/v2/1643901550e140118fc2d2e92b82cd0b/share-replicas/detail?share_id=b92fc06b-76d7-40f9-adef-74a07ace1027 => generated 22 bytes in 13 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:57:03 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-bbf758da-a5e5-4efa-9481-28cdc0a18883 tempest-AccessRulesMetadataTest-1973590610 tempest-AccessRulesMetadataTest-1973590610-project-member] DELETE http://10.27.203.238/share/v2/1643901550e140118fc2d2e92b82cd0b/shares/b92fc06b-76d7-40f9-adef-74a07ace1027 May 28 12:57:03 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-bbf758da-a5e5-4efa-9481-28cdc0a18883 tempest-AccessRulesMetadataTest-1973590610 tempest-AccessRulesMetadataTest-1973590610-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:03 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-bbf758da-a5e5-4efa-9481-28cdc0a18883 tempest-AccessRulesMetadataTest-1973590610 tempest-AccessRulesMetadataTest-1973590610-project-member] Calling method 'ShareMixin.delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:03 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.v1.shares [None req-bbf758da-a5e5-4efa-9481-28cdc0a18883 tempest-AccessRulesMetadataTest-1973590610 tempest-AccessRulesMetadataTest-1973590610-project-member] Delete share with id: b92fc06b-76d7-40f9-adef-74a07ace1027 May 28 12:57:03 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-bbf758da-a5e5-4efa-9481-28cdc0a18883 tempest-AccessRulesMetadataTest-1973590610 tempest-AccessRulesMetadataTest-1973590610-project-member] http://10.27.203.238/share/v2/1643901550e140118fc2d2e92b82cd0b/shares/b92fc06b-76d7-40f9-adef-74a07ace1027 returned with HTTP 202 May 28 12:57:03 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 224/463] 10.27.203.238 () {64 vars in 1454 bytes} [Tue May 28 12:57:03 2024] DELETE /share/v2/1643901550e140118fc2d2e92b82cd0b/shares/b92fc06b-76d7-40f9-adef-74a07ace1027 => generated 0 bytes in 121 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:57:03 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-9537b19e-ef57-4e9b-8a82-c9f85a1f45d1 tempest-AccessRulesMetadataTest-1973590610 tempest-AccessRulesMetadataTest-1973590610-project-member] GET http://10.27.203.238/share/v2/1643901550e140118fc2d2e92b82cd0b/shares/b92fc06b-76d7-40f9-adef-74a07ace1027 May 28 12:57:03 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-9537b19e-ef57-4e9b-8a82-c9f85a1f45d1 tempest-AccessRulesMetadataTest-1973590610 tempest-AccessRulesMetadataTest-1973590610-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:03 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-9537b19e-ef57-4e9b-8a82-c9f85a1f45d1 tempest-AccessRulesMetadataTest-1973590610 tempest-AccessRulesMetadataTest-1973590610-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:03 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-9537b19e-ef57-4e9b-8a82-c9f85a1f45d1 tempest-AccessRulesMetadataTest-1973590610 tempest-AccessRulesMetadataTest-1973590610-project-member] http://10.27.203.238/share/v2/1643901550e140118fc2d2e92b82cd0b/shares/b92fc06b-76d7-40f9-adef-74a07ace1027 returned with HTTP 200 May 28 12:57:03 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 240/464] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:57:03 2024] GET /share/v2/1643901550e140118fc2d2e92b82cd0b/shares/b92fc06b-76d7-40f9-adef-74a07ace1027 => generated 1318 bytes in 26 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:57:03 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-bbf758da-a5e5-4efa-9481-28cdc0a18883 tempest-AccessRulesMetadataTest-1973590610 None] Acquiring lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:57:03 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-bbf758da-a5e5-4efa-9481-28cdc0a18883 tempest-AccessRulesMetadataTest-1973590610 None] Lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:57:03 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-bbf758da-a5e5-4efa-9481-28cdc0a18883 tempest-AccessRulesMetadataTest-1973590610 None] Lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.064s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:57:03 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-bbf758da-a5e5-4efa-9481-28cdc0a18883 tempest-AccessRulesMetadataTest-1973590610 None] Acquiring lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:57:03 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-bbf758da-a5e5-4efa-9481-28cdc0a18883 tempest-AccessRulesMetadataTest-1973590610 None] Lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:57:03 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-bbf758da-a5e5-4efa-9481-28cdc0a18883 tempest-AccessRulesMetadataTest-1973590610 None] Lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:57:03 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-bbf758da-a5e5-4efa-9481-28cdc0a18883 tempest-AccessRulesMetadataTest-1973590610 None] Acquiring lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:57:03 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-bbf758da-a5e5-4efa-9481-28cdc0a18883 tempest-AccessRulesMetadataTest-1973590610 None] Lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:57:03 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-bbf758da-a5e5-4efa-9481-28cdc0a18883 tempest-AccessRulesMetadataTest-1973590610 None] Lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.070s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:57:03 l75lg1-v1 manila-share[98474]: DEBUG manila.share.access [None req-bbf758da-a5e5-4efa-9481-28cdc0a18883 tempest-AccessRulesMetadataTest-1973590610 None] Updating access rules for share instance 95118a75-173c-4257-acef-78a246ee1c67 belonging to share b92fc06b-76d7-40f9-adef-74a07ace1027. {{(pid=98474) update_access_rules /opt/stack/manila/manila/share/access.py:298}} May 28 12:57:03 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-bbf758da-a5e5-4efa-9481-28cdc0a18883 tempest-AccessRulesMetadataTest-1973590610 None] Acquiring lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:57:03 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-bbf758da-a5e5-4efa-9481-28cdc0a18883 tempest-AccessRulesMetadataTest-1973590610 None] Lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:57:03 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-eeade190-48a4-4e98-ba6e-dc30e46ebb57 tempest-AdminActionsTest-1749172189 None] <<< [GET] https://127.0.0.1:40443/api/views/ May 28 12:57:03 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-eeade190-48a4-4e98-ba6e-dc30e46ebb57 tempest-AdminActionsTest-1749172189 None] [Bunch(abac_tags=[], abe_max_depth=None, abe_protocols=[], alias='', allow_anonymous_access=False, allow_s3_anonymous_access=False, auto_commit='0d', bucket='', bucket_creators=[], bucket_creators_groups=[], bucket_owner=None, bulk_permission_update_progress=None, bulk_permission_update_state=None, cluster='loop75-kfs', cluster_id=1, created='2024-05-28T12:56:57.682565Z', enabled=True, files_retention_mode='NONE', guid='9ed67c42-65ba-472b-b661-fdd961602360', id=12, ignore_oos=False, internal=False, is_remote=False, is_seamless=False, logical_capacity=0, max_retention_period=None, min_retention_period=None, name='4016fe10-12f4-48fc-92de-42cdd2fff998', nfs_interop_flags='BOTH_NFS3_AND_NFS4_INTEROP_DISABLED', path='/manila/manila-4016fe10-12f4-48fc-92de-42cdd2fff998', physical_capacity=0, policy='4016fe10-12f4-48fc-92de-42cdd2fff998', policy_id=13, protocols=['NFS'], qos_policy=None, qos_policy_id=None, s3_locks=False, s3_locks_retention_mode='NONE', s3_locks_retention_period='', s3_unverified_lookup=False, s3_versioning=False, select_for_live_monitoring=False, share='', share_acl=Bunch(acl=[], enabled=False), sync='SYNCED', sync_time='2024-05-28T12:56:57.938891Z', tenant_id=1, tenant_name='default', title='/manila/manila-4016fe10-12f4-48fc-92de-42cdd2fff998', url='https://127.0.0.1:40443/api/views/12/')] May 28 12:57:03 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-eeade190-48a4-4e98-ba6e-dc30e46ebb57 tempest-AdminActionsTest-1749172189 None] --- [GET] https://127.0.0.1:40443/api/views/: Done May 28 12:57:03 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-eeade190-48a4-4e98-ba6e-dc30e46ebb57 tempest-AdminActionsTest-1749172189 None] >>> [DELETE] https://127.0.0.1:40443/api/views/12/ May 28 12:57:03 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-bbf758da-a5e5-4efa-9481-28cdc0a18883 tempest-AccessRulesMetadataTest-1973590610 None] Lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.047s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:57:03 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-bbf758da-a5e5-4efa-9481-28cdc0a18883 tempest-AccessRulesMetadataTest-1973590610 None] Acquiring lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:57:03 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-bbf758da-a5e5-4efa-9481-28cdc0a18883 tempest-AccessRulesMetadataTest-1973590610 None] Lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:57:03 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-bbf758da-a5e5-4efa-9481-28cdc0a18883 tempest-AccessRulesMetadataTest-1973590610 None] Lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.020s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:57:03 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-bbf758da-a5e5-4efa-9481-28cdc0a18883 tempest-AccessRulesMetadataTest-1973590610 None] changing access on None May 28 12:57:03 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bbf758da-a5e5-4efa-9481-28cdc0a18883 tempest-AccessRulesMetadataTest-1973590610 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:57:03 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bbf758da-a5e5-4efa-9481-28cdc0a18883 tempest-AccessRulesMetadataTest-1973590610 None] {'allow_redirects': True, May 28 12:57:03 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bbf758da-a5e5-4efa-9481-28cdc0a18883 tempest-AccessRulesMetadataTest-1973590610 None] 'params': {'name': '95118a75-173c-4257-acef-78a246ee1c67'}} May 28 12:57:04 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-8e025358-57f4-4a17-af9a-4d67c207dd9b tempest-ExportLocationsNegativeTest-386865252 tempest-ExportLocationsNegativeTest-386865252-project-admin] GET http://10.27.203.238/share/v2/df93a973373644ccaf8ecf54774a4ced/shares/543531db-0529-42ad-9ae8-5e3dff98a2a5 May 28 12:57:04 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-8e025358-57f4-4a17-af9a-4d67c207dd9b tempest-ExportLocationsNegativeTest-386865252 tempest-ExportLocationsNegativeTest-386865252-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:04 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-8e025358-57f4-4a17-af9a-4d67c207dd9b tempest-ExportLocationsNegativeTest-386865252 tempest-ExportLocationsNegativeTest-386865252-project-admin] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:04 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-8e025358-57f4-4a17-af9a-4d67c207dd9b tempest-ExportLocationsNegativeTest-386865252 tempest-ExportLocationsNegativeTest-386865252-project-admin] http://10.27.203.238/share/v2/df93a973373644ccaf8ecf54774a4ced/shares/543531db-0529-42ad-9ae8-5e3dff98a2a5 returned with HTTP 200 May 28 12:57:04 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 225/465] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:57:04 2024] GET /share/v2/df93a973373644ccaf8ecf54774a4ced/shares/543531db-0529-42ad-9ae8-5e3dff98a2a5 => generated 1374 bytes in 26 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:57:04 l75lg1-v1 dstat.sh[49771]: 28-05 12:57:04| 8 1 90 1 0|5674M 1829M 277M 7846M| 13k 2528B| 0 1436k| 0 165 |4937 8725 |1.47 0.98 0.98|1.0 1.0 0| 0 0 | 0 2048M| 29 347 0 59 0 May 28 12:57:04 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bbf758da-a5e5-4efa-9481-28cdc0a18883 tempest-AccessRulesMetadataTest-1973590610 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:57:04 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bbf758da-a5e5-4efa-9481-28cdc0a18883 tempest-AccessRulesMetadataTest-1973590610 None] [Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=1, created='2024-05-28T12:56:41.381687Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='8ed5f8f5-e848-431c-be27-16f1fa370a60', id=9, internal=False, is_s3_default_policy=False, name='95118a75-173c-4257-acef-78a246ee1c67', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=[], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['*'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['*'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T12:56:41.744950Z', tenant_id=1, tenant_name='default', title='95118a75-173c-4257-acef-78a246ee1c67', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/9/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[])] May 28 12:57:04 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bbf758da-a5e5-4efa-9481-28cdc0a18883 tempest-AccessRulesMetadataTest-1973590610 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 12:57:04 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-bbf758da-a5e5-4efa-9481-28cdc0a18883 tempest-AccessRulesMetadataTest-1973590610 None] Acquiring lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:57:04 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-bbf758da-a5e5-4efa-9481-28cdc0a18883 tempest-AccessRulesMetadataTest-1973590610 None] Lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:57:04 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-bbf758da-a5e5-4efa-9481-28cdc0a18883 tempest-AccessRulesMetadataTest-1973590610 None] Lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.037s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:57:04 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-bbf758da-a5e5-4efa-9481-28cdc0a18883 tempest-AccessRulesMetadataTest-1973590610 None] Acquiring lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:57:04 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-bbf758da-a5e5-4efa-9481-28cdc0a18883 tempest-AccessRulesMetadataTest-1973590610 None] Lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:57:04 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-bbf758da-a5e5-4efa-9481-28cdc0a18883 tempest-AccessRulesMetadataTest-1973590610 None] Lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.035s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:57:04 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-bbf758da-a5e5-4efa-9481-28cdc0a18883 tempest-AccessRulesMetadataTest-1973590610 None] Acquiring lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:57:04 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-bbf758da-a5e5-4efa-9481-28cdc0a18883 tempest-AccessRulesMetadataTest-1973590610 None] Lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:57:04 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-bbf758da-a5e5-4efa-9481-28cdc0a18883 tempest-AccessRulesMetadataTest-1973590610 None] Lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:57:04 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-bbf758da-a5e5-4efa-9481-28cdc0a18883 tempest-AccessRulesMetadataTest-1973590610 None] Acquiring lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:57:04 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-bbf758da-a5e5-4efa-9481-28cdc0a18883 tempest-AccessRulesMetadataTest-1973590610 None] Lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:57:04 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-bbf758da-a5e5-4efa-9481-28cdc0a18883 tempest-AccessRulesMetadataTest-1973590610 None] Lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:57:04 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-bbf758da-a5e5-4efa-9481-28cdc0a18883 tempest-AccessRulesMetadataTest-1973590610 None] Acquiring lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:57:04 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-bbf758da-a5e5-4efa-9481-28cdc0a18883 tempest-AccessRulesMetadataTest-1973590610 None] Lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:57:04 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-bbf758da-a5e5-4efa-9481-28cdc0a18883 tempest-AccessRulesMetadataTest-1973590610 None] Lock "locked_access_rules_operation_by_share_instance_95118a75-173c-4257-acef-78a246ee1c67" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.037s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:57:04 l75lg1-v1 manila-share[98474]: INFO manila.share.access [None req-bbf758da-a5e5-4efa-9481-28cdc0a18883 tempest-AccessRulesMetadataTest-1973590610 None] Access rules were successfully modified for share instance 95118a75-173c-4257-acef-78a246ee1c67 belonging to share b92fc06b-76d7-40f9-adef-74a07ace1027. May 28 12:57:04 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-bbf758da-a5e5-4efa-9481-28cdc0a18883 tempest-AccessRulesMetadataTest-1973590610 None] deleting '/manila/manila-95118a75-173c-4257-acef-78a246ee1c67' May 28 12:57:04 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bbf758da-a5e5-4efa-9481-28cdc0a18883 tempest-AccessRulesMetadataTest-1973590610 None] >>> [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/ May 28 12:57:04 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bbf758da-a5e5-4efa-9481-28cdc0a18883 tempest-AccessRulesMetadataTest-1973590610 None] {'data': '{"path": "/manila/manila-95118a75-173c-4257-acef-78a246ee1c67"}', May 28 12:57:04 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bbf758da-a5e5-4efa-9481-28cdc0a18883 tempest-AccessRulesMetadataTest-1973590610 None] 'params': None} May 28 12:57:04 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9c9aa596-d63a-4c98-8174-b7af98a44ede tempest-ExportLocationsNegativeTest-386865252 None] <<< [DELETE] https://127.0.0.1:40443/api/quotas/7/ May 28 12:57:04 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9c9aa596-d63a-4c98-8174-b7af98a44ede tempest-ExportLocationsNegativeTest-386865252 None] --- [DELETE] https://127.0.0.1:40443/api/quotas/7/: Done May 28 12:57:04 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9c9aa596-d63a-4c98-8174-b7af98a44ede tempest-ExportLocationsNegativeTest-386865252 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:57:04 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9c9aa596-d63a-4c98-8174-b7af98a44ede tempest-ExportLocationsNegativeTest-386865252 None] {'allow_redirects': True, May 28 12:57:04 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9c9aa596-d63a-4c98-8174-b7af98a44ede tempest-ExportLocationsNegativeTest-386865252 None] 'params': {'name': 'd44fc8f1-83fc-47c3-994f-497e85a3194a'}} May 28 12:57:04 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bbf758da-a5e5-4efa-9481-28cdc0a18883 tempest-AccessRulesMetadataTest-1973590610 None] <<< [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/ May 28 12:57:04 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bbf758da-a5e5-4efa-9481-28cdc0a18883 tempest-AccessRulesMetadataTest-1973590610 None] 'OK' May 28 12:57:04 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bbf758da-a5e5-4efa-9481-28cdc0a18883 tempest-AccessRulesMetadataTest-1973590610 None] --- [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/: Done May 28 12:57:04 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bbf758da-a5e5-4efa-9481-28cdc0a18883 tempest-AccessRulesMetadataTest-1973590610 None] >>> [GET] https://127.0.0.1:40443/api/views/ May 28 12:57:04 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bbf758da-a5e5-4efa-9481-28cdc0a18883 tempest-AccessRulesMetadataTest-1973590610 None] {'allow_redirects': True, May 28 12:57:04 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bbf758da-a5e5-4efa-9481-28cdc0a18883 tempest-AccessRulesMetadataTest-1973590610 None] 'params': {'name': '95118a75-173c-4257-acef-78a246ee1c67'}} May 28 12:57:05 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-db9e5db6-cb1e-4d26-bd49-b5f4cb090cda tempest-ShareInstancesNegativeTest-210953919 tempest-ShareInstancesNegativeTest-210953919-project-admin] GET http://10.27.203.238/share/v2/bb8f0d37fc204d24b8146108f63a1922/shares/6b055a82-f6ad-4af2-8b38-137b3cc99cc1 May 28 12:57:05 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-db9e5db6-cb1e-4d26-bd49-b5f4cb090cda tempest-ShareInstancesNegativeTest-210953919 tempest-ShareInstancesNegativeTest-210953919-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:05 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-db9e5db6-cb1e-4d26-bd49-b5f4cb090cda tempest-ShareInstancesNegativeTest-210953919 tempest-ShareInstancesNegativeTest-210953919-project-admin] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:05 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-db9e5db6-cb1e-4d26-bd49-b5f4cb090cda tempest-ShareInstancesNegativeTest-210953919 tempest-ShareInstancesNegativeTest-210953919-project-admin] http://10.27.203.238/share/v2/bb8f0d37fc204d24b8146108f63a1922/shares/6b055a82-f6ad-4af2-8b38-137b3cc99cc1 returned with HTTP 200 May 28 12:57:05 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 241/466] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:57:05 2024] GET /share/v2/bb8f0d37fc204d24b8146108f63a1922/shares/6b055a82-f6ad-4af2-8b38-137b3cc99cc1 => generated 1370 bytes in 27 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:57:05 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bbf758da-a5e5-4efa-9481-28cdc0a18883 tempest-AccessRulesMetadataTest-1973590610 None] <<< [GET] https://127.0.0.1:40443/api/views/ May 28 12:57:05 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bbf758da-a5e5-4efa-9481-28cdc0a18883 tempest-AccessRulesMetadataTest-1973590610 None] [Bunch(abac_tags=[], abe_max_depth=None, abe_protocols=[], alias='', allow_anonymous_access=False, allow_s3_anonymous_access=False, auto_commit='0d', bucket='', bucket_creators=[], bucket_creators_groups=[], bucket_owner=None, bulk_permission_update_progress=None, bulk_permission_update_state=None, cluster='loop75-kfs', cluster_id=1, created='2024-05-28T12:56:44.385283Z', enabled=True, files_retention_mode='NONE', guid='94362987-116f-4740-996f-65db61f40c56', id=8, ignore_oos=False, internal=False, is_remote=False, is_seamless=False, logical_capacity=0, max_retention_period=None, min_retention_period=None, name='95118a75-173c-4257-acef-78a246ee1c67', nfs_interop_flags='BOTH_NFS3_AND_NFS4_INTEROP_DISABLED', path='/manila/manila-95118a75-173c-4257-acef-78a246ee1c67', physical_capacity=0, policy='95118a75-173c-4257-acef-78a246ee1c67', policy_id=9, protocols=['NFS'], qos_policy=None, qos_policy_id=None, s3_locks=False, s3_locks_retention_mode='NONE', s3_locks_retention_period='', s3_unverified_lookup=False, s3_versioning=False, select_for_live_monitoring=False, share='', share_acl=Bunch(acl=[], enabled=False), sync='SYNCED', sync_time='2024-05-28T12:56:44.680235Z', tenant_id=1, tenant_name='default', title='/manila/manila-95118a75-173c-4257-acef-78a246ee1c67', url='https://127.0.0.1:40443/api/views/8/')] May 28 12:57:05 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bbf758da-a5e5-4efa-9481-28cdc0a18883 tempest-AccessRulesMetadataTest-1973590610 None] --- [GET] https://127.0.0.1:40443/api/views/: Done May 28 12:57:05 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bbf758da-a5e5-4efa-9481-28cdc0a18883 tempest-AccessRulesMetadataTest-1973590610 None] >>> [DELETE] https://127.0.0.1:40443/api/views/8/ May 28 12:57:05 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9c9aa596-d63a-4c98-8174-b7af98a44ede tempest-ExportLocationsNegativeTest-386865252 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:57:05 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9c9aa596-d63a-4c98-8174-b7af98a44ede tempest-ExportLocationsNegativeTest-386865252 None] [Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=0, created='2024-05-28T12:56:52.385700Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='bb50b748-102f-4135-bd29-6fe71148e4e0', id=10, internal=False, is_s3_default_policy=False, name='d44fc8f1-83fc-47c3-994f-497e85a3194a', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=[], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['*'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['*'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T12:56:52.730972Z', tenant_id=1, tenant_name='default', title='d44fc8f1-83fc-47c3-994f-497e85a3194a', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/10/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[])] May 28 12:57:05 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9c9aa596-d63a-4c98-8174-b7af98a44ede tempest-ExportLocationsNegativeTest-386865252 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 12:57:05 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9c9aa596-d63a-4c98-8174-b7af98a44ede tempest-ExportLocationsNegativeTest-386865252 None] >>> [DELETE] https://127.0.0.1:40443/api/viewpolicies/10/ May 28 12:57:05 l75lg1-v1 dstat.sh[49771]: 28-05 12:57:05| 2 0 96 1 0|5674M 1829M 277M 7846M| 20k 4217B| 0 876k| 0 79.0 |2352 3858 |1.47 0.98 0.98|1.0 0 0| 0 0 | 0 2048M| 29 347 0 59 0 May 28 12:57:05 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-7e081b81-135c-47a7-9bfa-2207e386d60b tempest-ShareTypesAdminTest-216868925 None] <<< [DELETE] https://127.0.0.1:40443/api/views/11/ May 28 12:57:05 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-7e081b81-135c-47a7-9bfa-2207e386d60b tempest-ShareTypesAdminTest-216868925 None] --- [DELETE] https://127.0.0.1:40443/api/views/11/: Done May 28 12:57:05 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-7e081b81-135c-47a7-9bfa-2207e386d60b tempest-ShareTypesAdminTest-216868925 None] >>> [GET] https://127.0.0.1:40443/api/quotas/ May 28 12:57:05 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-7e081b81-135c-47a7-9bfa-2207e386d60b tempest-ShareTypesAdminTest-216868925 None] {'allow_redirects': True, May 28 12:57:05 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-7e081b81-135c-47a7-9bfa-2207e386d60b tempest-ShareTypesAdminTest-216868925 None] 'params': {'name': '4e77e600-5df2-4310-91eb-8d6633f53ce4'}} May 28 12:57:05 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-46c10a7c-3665-4b1b-8119-571a47f023d2 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] GET http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/shares/8e00d6e4-a018-4e71-b71c-831e546cb6e6 May 28 12:57:05 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-46c10a7c-3665-4b1b-8119-571a47f023d2 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:05 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-46c10a7c-3665-4b1b-8119-571a47f023d2 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:05 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-7e081b81-135c-47a7-9bfa-2207e386d60b tempest-ShareTypesAdminTest-216868925 None] <<< [GET] https://127.0.0.1:40443/api/quotas/ May 28 12:57:05 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-7e081b81-135c-47a7-9bfa-2207e386d60b tempest-ShareTypesAdminTest-216868925 None] [Bunch(cluster='loop75-kfs', cluster_id=1, default_email=None, default_group_quota=None, default_user_quota=None, enable_alarms=True, enable_email_providers=True, grace_period=None, guid='fdaf6eb3-4ce8-4ae5-ba94-f99eaf956a7a', hard_limit=1073741824, hard_limit_inodes=None, id=9, internal=False, is_user_quota=False, last_user_quotas_update=None, name='4e77e600-5df2-4310-91eb-8d6633f53ce4', num_blocked_users=0, num_exceeded_users=0, path='/manila/manila-4e77e600-5df2-4310-91eb-8d6633f53ce4', percent_capacity=0, percent_inodes=None, pretty_grace_period=None, pretty_grace_period_expiration=None, pretty_state='OK (CREATED)', soft_limit=None, soft_limit_inodes=None, state='OK', sync_state='CREATED', system_id=9, tenant_id=1, tenant_name='default', time_to_block=None, title='4e77e600-5df2-4310-91eb-8d6633f53ce4', url='https://127.0.0.1:40443/api/quotas/9/', used_capacity=0, used_capacity_tb=0.0, used_effective_capacity=0, used_effective_capacity_tb=0.0, used_inodes=0, used_limited_capacity=0)] May 28 12:57:05 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-7e081b81-135c-47a7-9bfa-2207e386d60b tempest-ShareTypesAdminTest-216868925 None] --- [GET] https://127.0.0.1:40443/api/quotas/: Done May 28 12:57:05 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-7e081b81-135c-47a7-9bfa-2207e386d60b tempest-ShareTypesAdminTest-216868925 None] >>> [DELETE] https://127.0.0.1:40443/api/quotas/9/ May 28 12:57:05 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-46c10a7c-3665-4b1b-8119-571a47f023d2 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/shares/8e00d6e4-a018-4e71-b71c-831e546cb6e6 returned with HTTP 200 May 28 12:57:05 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 226/467] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:57:05 2024] GET /share/v2/35d84ed7cf164123a87b8b906a836985/shares/8e00d6e4-a018-4e71-b71c-831e546cb6e6 => generated 1347 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:57:05 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c07df379-c3ad-4b79-82d1-01d37d41940f tempest-ShareInstancesNegativeTest-210953919 None] <<< [DELETE] https://127.0.0.1:40443/api/quotas/8/ May 28 12:57:05 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c07df379-c3ad-4b79-82d1-01d37d41940f tempest-ShareInstancesNegativeTest-210953919 None] --- [DELETE] https://127.0.0.1:40443/api/quotas/8/: Done May 28 12:57:05 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c07df379-c3ad-4b79-82d1-01d37d41940f tempest-ShareInstancesNegativeTest-210953919 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:57:05 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c07df379-c3ad-4b79-82d1-01d37d41940f tempest-ShareInstancesNegativeTest-210953919 None] {'allow_redirects': True, May 28 12:57:05 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c07df379-c3ad-4b79-82d1-01d37d41940f tempest-ShareInstancesNegativeTest-210953919 None] 'params': {'name': '9b44eaf4-da6e-42e7-8723-ce0cc8878f85'}} May 28 12:57:06 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-428e0540-4113-4931-ac7e-b58b93b155db tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] GET http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/shares/9be3b244-34ab-4002-b1e1-427af2ab8545 May 28 12:57:06 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-428e0540-4113-4931-ac7e-b58b93b155db tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:06 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-428e0540-4113-4931-ac7e-b58b93b155db tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:06 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-428e0540-4113-4931-ac7e-b58b93b155db tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/shares/9be3b244-34ab-4002-b1e1-427af2ab8545 returned with HTTP 200 May 28 12:57:06 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 242/468] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:57:06 2024] GET /share/v2/a3499cb78849424db45e54caac01de92/shares/9be3b244-34ab-4002-b1e1-427af2ab8545 => generated 1371 bytes in 24 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:57:06 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-eeade190-48a4-4e98-ba6e-dc30e46ebb57 tempest-AdminActionsTest-1749172189 None] <<< [DELETE] https://127.0.0.1:40443/api/views/12/ May 28 12:57:06 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-eeade190-48a4-4e98-ba6e-dc30e46ebb57 tempest-AdminActionsTest-1749172189 None] --- [DELETE] https://127.0.0.1:40443/api/views/12/: Done May 28 12:57:06 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-eeade190-48a4-4e98-ba6e-dc30e46ebb57 tempest-AdminActionsTest-1749172189 None] >>> [GET] https://127.0.0.1:40443/api/quotas/ May 28 12:57:06 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-eeade190-48a4-4e98-ba6e-dc30e46ebb57 tempest-AdminActionsTest-1749172189 None] {'allow_redirects': True, May 28 12:57:06 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-eeade190-48a4-4e98-ba6e-dc30e46ebb57 tempest-AdminActionsTest-1749172189 None] 'params': {'name': '4016fe10-12f4-48fc-92de-42cdd2fff998'}} May 28 12:57:06 l75lg1-v1 dstat.sh[49771]: 28-05 12:57:06| 1 0 98 0 0|5674M 1828M 277M 7846M| 18k 2656B| 0 224k| 0 16.0 |1960 2973 |1.47 0.98 0.98|1.0 0 0| 0 0 | 0 2048M| 29 347 0 59 0 May 28 12:57:06 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c07df379-c3ad-4b79-82d1-01d37d41940f tempest-ShareInstancesNegativeTest-210953919 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:57:06 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c07df379-c3ad-4b79-82d1-01d37d41940f tempest-ShareInstancesNegativeTest-210953919 None] [Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=0, created='2024-05-28T12:56:54.339412Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='4109ecc5-85a4-4ee7-a55f-54cf7176aa66', id=11, internal=False, is_s3_default_policy=False, name='9b44eaf4-da6e-42e7-8723-ce0cc8878f85', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=[], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['*'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['*'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T12:56:54.719556Z', tenant_id=1, tenant_name='default', title='9b44eaf4-da6e-42e7-8723-ce0cc8878f85', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/11/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[])] May 28 12:57:06 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c07df379-c3ad-4b79-82d1-01d37d41940f tempest-ShareInstancesNegativeTest-210953919 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 12:57:06 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c07df379-c3ad-4b79-82d1-01d37d41940f tempest-ShareInstancesNegativeTest-210953919 None] >>> [DELETE] https://127.0.0.1:40443/api/viewpolicies/11/ May 28 12:57:06 l75lg1-v1 neutron-server[77623]: DEBUG dbcounter [-] [77623] Writing DB stats neutron:SELECT=1 {{(pid=77623) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:57:06 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-eeade190-48a4-4e98-ba6e-dc30e46ebb57 tempest-AdminActionsTest-1749172189 None] <<< [GET] https://127.0.0.1:40443/api/quotas/ May 28 12:57:06 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-eeade190-48a4-4e98-ba6e-dc30e46ebb57 tempest-AdminActionsTest-1749172189 None] [Bunch(cluster='loop75-kfs', cluster_id=1, default_email=None, default_group_quota=None, default_user_quota=None, enable_alarms=True, enable_email_providers=True, grace_period=None, guid='0a264a9b-c035-496c-8ef1-e9dd1076d22c', hard_limit=2147483648, hard_limit_inodes=None, id=10, internal=False, is_user_quota=False, last_user_quotas_update=None, name='4016fe10-12f4-48fc-92de-42cdd2fff998', num_blocked_users=0, num_exceeded_users=0, path='/manila/manila-4016fe10-12f4-48fc-92de-42cdd2fff998', percent_capacity=0, percent_inodes=None, pretty_grace_period=None, pretty_grace_period_expiration=None, pretty_state='OK (CREATED)', soft_limit=None, soft_limit_inodes=None, state='OK', sync_state='CREATED', system_id=10, tenant_id=1, tenant_name='default', time_to_block=None, title='4016fe10-12f4-48fc-92de-42cdd2fff998', url='https://127.0.0.1:40443/api/quotas/10/', used_capacity=0, used_capacity_tb=0.0, used_effective_capacity=0, used_effective_capacity_tb=0.0, used_inodes=0, used_limited_capacity=0)] May 28 12:57:06 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-eeade190-48a4-4e98-ba6e-dc30e46ebb57 tempest-AdminActionsTest-1749172189 None] --- [GET] https://127.0.0.1:40443/api/quotas/: Done May 28 12:57:06 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-eeade190-48a4-4e98-ba6e-dc30e46ebb57 tempest-AdminActionsTest-1749172189 None] >>> [DELETE] https://127.0.0.1:40443/api/quotas/10/ May 28 12:57:06 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-c573f44e-5525-4c78-9545-de9bcc59ddf7 tempest-AccessRulesMetadataTest-1973590610 tempest-AccessRulesMetadataTest-1973590610-project-member] GET http://10.27.203.238/share/v2/1643901550e140118fc2d2e92b82cd0b/shares/b92fc06b-76d7-40f9-adef-74a07ace1027 May 28 12:57:06 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-c573f44e-5525-4c78-9545-de9bcc59ddf7 tempest-AccessRulesMetadataTest-1973590610 tempest-AccessRulesMetadataTest-1973590610-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:06 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-c573f44e-5525-4c78-9545-de9bcc59ddf7 tempest-AccessRulesMetadataTest-1973590610 tempest-AccessRulesMetadataTest-1973590610-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:06 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-c573f44e-5525-4c78-9545-de9bcc59ddf7 tempest-AccessRulesMetadataTest-1973590610 tempest-AccessRulesMetadataTest-1973590610-project-member] http://10.27.203.238/share/v2/1643901550e140118fc2d2e92b82cd0b/shares/b92fc06b-76d7-40f9-adef-74a07ace1027 returned with HTTP 200 May 28 12:57:06 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 227/469] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:57:06 2024] GET /share/v2/1643901550e140118fc2d2e92b82cd0b/shares/b92fc06b-76d7-40f9-adef-74a07ace1027 => generated 1318 bytes in 25 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:57:06 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9c9aa596-d63a-4c98-8174-b7af98a44ede tempest-ExportLocationsNegativeTest-386865252 None] <<< [DELETE] https://127.0.0.1:40443/api/viewpolicies/10/ May 28 12:57:06 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9c9aa596-d63a-4c98-8174-b7af98a44ede tempest-ExportLocationsNegativeTest-386865252 None] --- [DELETE] https://127.0.0.1:40443/api/viewpolicies/10/: Done May 28 12:57:06 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-9c9aa596-d63a-4c98-8174-b7af98a44ede tempest-ExportLocationsNegativeTest-386865252 None] Created reservations ['74ceb961-320c-460c-86bd-7a74c320c4a0', '3f54f6e5-7e32-4687-a3fd-3ba14fe80f55', 'e668141d-bfae-47f4-ad14-7e6fb660fc33', '1b07a5cf-5839-4ae1-ad1c-7cabcc63bbc3'] {{(pid=98474) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 12:57:06 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-9c9aa596-d63a-4c98-8174-b7af98a44ede tempest-ExportLocationsNegativeTest-386865252 None] Committed reservations ['74ceb961-320c-460c-86bd-7a74c320c4a0', '3f54f6e5-7e32-4687-a3fd-3ba14fe80f55', 'e668141d-bfae-47f4-ad14-7e6fb660fc33', '1b07a5cf-5839-4ae1-ad1c-7cabcc63bbc3'] {{(pid=98474) commit /opt/stack/manila/manila/quota.py:1063}} May 28 12:57:06 l75lg1-v1 manila-share[98474]: INFO manila.share.manager [None req-9c9aa596-d63a-4c98-8174-b7af98a44ede tempest-ExportLocationsNegativeTest-386865252 None] Share instance d44fc8f1-83fc-47c3-994f-497e85a3194a: deleted successfully. May 28 12:57:07 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-b7f54a61-6322-40c4-bdb9-712f10bef757 tempest-ExportLocationsNegativeTest-386865252 tempest-ExportLocationsNegativeTest-386865252-project-admin] GET http://10.27.203.238/share/v2/df93a973373644ccaf8ecf54774a4ced/shares/543531db-0529-42ad-9ae8-5e3dff98a2a5 May 28 12:57:07 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-b7f54a61-6322-40c4-bdb9-712f10bef757 tempest-ExportLocationsNegativeTest-386865252 tempest-ExportLocationsNegativeTest-386865252-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:07 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-b7f54a61-6322-40c4-bdb9-712f10bef757 tempest-ExportLocationsNegativeTest-386865252 tempest-ExportLocationsNegativeTest-386865252-project-admin] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:07 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-b7f54a61-6322-40c4-bdb9-712f10bef757 tempest-ExportLocationsNegativeTest-386865252 tempest-ExportLocationsNegativeTest-386865252-project-admin] HTTP exception thrown: The resource could not be found. May 28 12:57:07 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-b7f54a61-6322-40c4-bdb9-712f10bef757 tempest-ExportLocationsNegativeTest-386865252 tempest-ExportLocationsNegativeTest-386865252-project-admin] http://10.27.203.238/share/v2/df93a973373644ccaf8ecf54774a4ced/shares/543531db-0529-42ad-9ae8-5e3dff98a2a5 returned with HTTP 404 May 28 12:57:07 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 243/470] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:57:07 2024] GET /share/v2/df93a973373644ccaf8ecf54774a4ced/shares/543531db-0529-42ad-9ae8-5e3dff98a2a5 => generated 78 bytes in 12 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 12:57:07 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-d51c0177-ff55-46d3-99d5-d48f78dc1e73 tempest-ExportLocationsNegativeTest-386865252 tempest-ExportLocationsNegativeTest-386865252-project-admin] DELETE http://10.27.203.238/share/v2/df93a973373644ccaf8ecf54774a4ced/types/bbf19685-42b8-43ec-aa54-786683e9d11d May 28 12:57:07 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-d51c0177-ff55-46d3-99d5-d48f78dc1e73 tempest-ExportLocationsNegativeTest-386865252 tempest-ExportLocationsNegativeTest-386865252-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:07 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-d51c0177-ff55-46d3-99d5-d48f78dc1e73 tempest-ExportLocationsNegativeTest-386865252 tempest-ExportLocationsNegativeTest-386865252-project-admin] Calling method 'ShareTypesController._delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:07 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-d51c0177-ff55-46d3-99d5-d48f78dc1e73 tempest-ExportLocationsNegativeTest-386865252 tempest-ExportLocationsNegativeTest-386865252-project-admin] http://10.27.203.238/share/v2/df93a973373644ccaf8ecf54774a4ced/types/bbf19685-42b8-43ec-aa54-786683e9d11d returned with HTTP 202 May 28 12:57:07 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 228/471] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:57:07 2024] DELETE /share/v2/df93a973373644ccaf8ecf54774a4ced/types/bbf19685-42b8-43ec-aa54-786683e9d11d => generated 0 bytes in 50 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:57:07 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-c57e37bf-c6e3-4210-8b7c-e41861e4a39a tempest-ExportLocationsNegativeTest-386865252 tempest-ExportLocationsNegativeTest-386865252-project-admin] GET http://10.27.203.238/share/v2/df93a973373644ccaf8ecf54774a4ced/types/bbf19685-42b8-43ec-aa54-786683e9d11d May 28 12:57:07 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-c57e37bf-c6e3-4210-8b7c-e41861e4a39a tempest-ExportLocationsNegativeTest-386865252 tempest-ExportLocationsNegativeTest-386865252-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:07 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-c57e37bf-c6e3-4210-8b7c-e41861e4a39a tempest-ExportLocationsNegativeTest-386865252 tempest-ExportLocationsNegativeTest-386865252-project-admin] Calling method 'ShareTypesController.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:07 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-c57e37bf-c6e3-4210-8b7c-e41861e4a39a tempest-ExportLocationsNegativeTest-386865252 tempest-ExportLocationsNegativeTest-386865252-project-admin] HTTP exception thrown: Share type not found. May 28 12:57:07 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-c57e37bf-c6e3-4210-8b7c-e41861e4a39a tempest-ExportLocationsNegativeTest-386865252 tempest-ExportLocationsNegativeTest-386865252-project-admin] http://10.27.203.238/share/v2/df93a973373644ccaf8ecf54774a4ced/types/bbf19685-42b8-43ec-aa54-786683e9d11d returned with HTTP 404 May 28 12:57:07 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 244/472] 10.27.203.238 () {64 vars in 1448 bytes} [Tue May 28 12:57:07 2024] GET /share/v2/df93a973373644ccaf8ecf54774a4ced/types/bbf19685-42b8-43ec-aa54-786683e9d11d => generated 67 bytes in 10 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 12:57:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1440754-9384-4aaf-9173-da088a6c84df tempest-AccessRulesMetadataTest-1677117720 tempest-AccessRulesMetadataTest-1677117720-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-a1440754-9384-4aaf-9173-da088a6c84df tempest-AccessRulesMetadataTest-1677117720 tempest-AccessRulesMetadataTest-1677117720-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1440754-9384-4aaf-9173-da088a6c84df tempest-AccessRulesMetadataTest-1677117720 tempest-AccessRulesMetadataTest-1677117720-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:07 l75lg1-v1 dstat.sh[49771]: 28-05 12:57:07| 3 1 95 1 0|5674M 1828M 277M 7846M| 28k 1440B| 0 860k| 0 117 |3135 5253 |1.59 1.01 1.00|2.0 2.0 0| 0 0 | 0 2048M| 29 348 0 57 0 May 28 12:57:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc794236-593e-4c9d-8564-52a8bd91994c None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc794236-593e-4c9d-8564-52a8bd91994c None admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc794236-593e-4c9d-8564-52a8bd91994c None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc794236-593e-4c9d-8564-52a8bd91994c None admin] PATH_INFO: `/v3/users/48db8b9e3da84d74857c401303968b55` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc794236-593e-4c9d-8564-52a8bd91994c None admin] RBAC: Authorizing `identity:delete_user(user_id=48db8b9e3da84d74857c401303968b55)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc794236-593e-4c9d-8564-52a8bd91994c None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-cc794236-593e-4c9d-8564-52a8bd91994c None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48db8b9e3da84d74857c401303968b55', 'request_id': 'req-cc794236-593e-4c9d-8564-52a8bd91994c'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-cc794236-593e-4c9d-8564-52a8bd91994c None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48db8b9e3da84d74857c401303968b55', 'request_id': 'req-cc794236-593e-4c9d-8564-52a8bd91994c'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-cc794236-593e-4c9d-8564-52a8bd91994c None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48db8b9e3da84d74857c401303968b55', 'request_id': 'req-cc794236-593e-4c9d-8564-52a8bd91994c'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-cc794236-593e-4c9d-8564-52a8bd91994c None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48db8b9e3da84d74857c401303968b55', 'request_id': 'req-cc794236-593e-4c9d-8564-52a8bd91994c'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-cc794236-593e-4c9d-8564-52a8bd91994c None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48db8b9e3da84d74857c401303968b55', 'request_id': 'req-cc794236-593e-4c9d-8564-52a8bd91994c'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:07 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 853/1683] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 12:57:07 2024] DELETE /identity/v3/users/48db8b9e3da84d74857c401303968b55 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:57:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367b0dfc-f11d-4096-aab3-ecc7626dac6a tempest-AccessRulesMetadataTest-1677117720 tempest-AccessRulesMetadataTest-1677117720-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367b0dfc-f11d-4096-aab3-ecc7626dac6a tempest-AccessRulesMetadataTest-1677117720 tempest-AccessRulesMetadataTest-1677117720-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e20423-215c-4d40-be6a-f91f2c36360f None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e20423-215c-4d40-be6a-f91f2c36360f None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e20423-215c-4d40-be6a-f91f2c36360f None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e20423-215c-4d40-be6a-f91f2c36360f None admin] PATH_INFO: `/v3/users/4718d0ee9a4a4d93bbd3f60f5cc1b4af` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e20423-215c-4d40-be6a-f91f2c36360f None admin] RBAC: Authorizing `identity:delete_user(user_id=4718d0ee9a4a4d93bbd3f60f5cc1b4af)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e20423-215c-4d40-be6a-f91f2c36360f None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-b5e20423-215c-4d40-be6a-f91f2c36360f None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4718d0ee9a4a4d93bbd3f60f5cc1b4af', 'request_id': 'req-b5e20423-215c-4d40-be6a-f91f2c36360f'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-b5e20423-215c-4d40-be6a-f91f2c36360f None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4718d0ee9a4a4d93bbd3f60f5cc1b4af', 'request_id': 'req-b5e20423-215c-4d40-be6a-f91f2c36360f'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-b5e20423-215c-4d40-be6a-f91f2c36360f None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4718d0ee9a4a4d93bbd3f60f5cc1b4af', 'request_id': 'req-b5e20423-215c-4d40-be6a-f91f2c36360f'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-b5e20423-215c-4d40-be6a-f91f2c36360f None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4718d0ee9a4a4d93bbd3f60f5cc1b4af', 'request_id': 'req-b5e20423-215c-4d40-be6a-f91f2c36360f'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-b5e20423-215c-4d40-be6a-f91f2c36360f None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4718d0ee9a4a4d93bbd3f60f5cc1b4af', 'request_id': 'req-b5e20423-215c-4d40-be6a-f91f2c36360f'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:07 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 831/1684] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 12:57:07 2024] DELETE /identity/v3/users/4718d0ee9a4a4d93bbd3f60f5cc1b4af => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:57:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc794236-593e-4c9d-8564-52a8bd91994c None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-cc794236-593e-4c9d-8564-52a8bd91994c None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc794236-593e-4c9d-8564-52a8bd91994c None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:07 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bbf758da-a5e5-4efa-9481-28cdc0a18883 tempest-AccessRulesMetadataTest-1973590610 None] <<< [DELETE] https://127.0.0.1:40443/api/views/8/ May 28 12:57:07 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bbf758da-a5e5-4efa-9481-28cdc0a18883 tempest-AccessRulesMetadataTest-1973590610 None] --- [DELETE] https://127.0.0.1:40443/api/views/8/: Done May 28 12:57:07 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bbf758da-a5e5-4efa-9481-28cdc0a18883 tempest-AccessRulesMetadataTest-1973590610 None] >>> [GET] https://127.0.0.1:40443/api/quotas/ May 28 12:57:07 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bbf758da-a5e5-4efa-9481-28cdc0a18883 tempest-AccessRulesMetadataTest-1973590610 None] {'allow_redirects': True, May 28 12:57:07 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bbf758da-a5e5-4efa-9481-28cdc0a18883 tempest-AccessRulesMetadataTest-1973590610 None] 'params': {'name': '95118a75-173c-4257-acef-78a246ee1c67'}} May 28 12:57:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9362b985-41e8-46f0-8036-1509e411be51 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9362b985-41e8-46f0-8036-1509e411be51 None admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9362b985-41e8-46f0-8036-1509e411be51 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9362b985-41e8-46f0-8036-1509e411be51 None admin] PATH_INFO: `/v3/users/f047e790f5704d6c9c05ddd053c2c71c` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9362b985-41e8-46f0-8036-1509e411be51 None admin] RBAC: Authorizing `identity:delete_user(user_id=f047e790f5704d6c9c05ddd053c2c71c)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9362b985-41e8-46f0-8036-1509e411be51 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-9362b985-41e8-46f0-8036-1509e411be51 None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f047e790f5704d6c9c05ddd053c2c71c', 'request_id': 'req-9362b985-41e8-46f0-8036-1509e411be51'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-9362b985-41e8-46f0-8036-1509e411be51 None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f047e790f5704d6c9c05ddd053c2c71c', 'request_id': 'req-9362b985-41e8-46f0-8036-1509e411be51'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-9362b985-41e8-46f0-8036-1509e411be51 None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f047e790f5704d6c9c05ddd053c2c71c', 'request_id': 'req-9362b985-41e8-46f0-8036-1509e411be51'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-9362b985-41e8-46f0-8036-1509e411be51 None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f047e790f5704d6c9c05ddd053c2c71c', 'request_id': 'req-9362b985-41e8-46f0-8036-1509e411be51'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-9362b985-41e8-46f0-8036-1509e411be51 None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f047e790f5704d6c9c05ddd053c2c71c', 'request_id': 'req-9362b985-41e8-46f0-8036-1509e411be51'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:07 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 854/1685] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 12:57:07 2024] DELETE /identity/v3/users/f047e790f5704d6c9c05ddd053c2c71c => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:57:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fda5b71-1c74-4d40-8968-e24d4a03a404 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fda5b71-1c74-4d40-8968-e24d4a03a404 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fda5b71-1c74-4d40-8968-e24d4a03a404 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:07 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-6fda5b71-1c74-4d40-8968-e24d4a03a404 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:57:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-6fda5b71-1c74-4d40-8968-e24d4a03a404 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:57:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-6fda5b71-1c74-4d40-8968-e24d4a03a404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:07 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 832/1686] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:57:07 2024] POST /identity/v3/auth/tokens => generated 2960 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 12:57:07 l75lg1-v1 neutron-server[77618]: DEBUG neutron.wsgi [-] (77618) accepted ('10.27.203.238', 59574) {{(pid=77618) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 12:57:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9362b985-41e8-46f0-8036-1509e411be51 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-9362b985-41e8-46f0-8036-1509e411be51 None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9362b985-41e8-46f0-8036-1509e411be51 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a3d518-9e57-4554-9f89-d1e36deb4efd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef17047035e4b518fd5360a01f2da1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a3d518-9e57-4554-9f89-d1e36deb4efd service neutron] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a3d518-9e57-4554-9f89-d1e36deb4efd service neutron] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a3d518-9e57-4554-9f89-d1e36deb4efd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a3d518-9e57-4554-9f89-d1e36deb4efd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a3d518-9e57-4554-9f89-d1e36deb4efd service neutron] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:07 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 855/1687] 10.27.203.238 () {64 vars in 1432 bytes} [Tue May 28 12:57:07 2024] GET /identity/v3/auth/tokens => generated 2960 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 28 12:57:07 l75lg1-v1 neutron-server[77618]: INFO neutron.wsgi [None req-f5766a9f-b88d-4f3f-a016-e33c1fc98bd9 None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=8122411d892242d0963cf4b8e8fa5bb2&name=default HTTP/1.1" status: 200 len: 216 time: 0.0699108 May 28 12:57:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fda5b71-1c74-4d40-8968-e24d4a03a404 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-6fda5b71-1c74-4d40-8968-e24d4a03a404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fda5b71-1c74-4d40-8968-e24d4a03a404 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b14cc5c-3562-4318-98ab-cd9733e73a2a None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b14cc5c-3562-4318-98ab-cd9733e73a2a None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b14cc5c-3562-4318-98ab-cd9733e73a2a None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b14cc5c-3562-4318-98ab-cd9733e73a2a None admin] PATH_INFO: `/v3/projects/8122411d892242d0963cf4b8e8fa5bb2` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b14cc5c-3562-4318-98ab-cd9733e73a2a None admin] RBAC: Authorizing `identity:delete_project(project_id=8122411d892242d0963cf4b8e8fa5bb2)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b14cc5c-3562-4318-98ab-cd9733e73a2a None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-6b14cc5c-3562-4318-98ab-cd9733e73a2a None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8122411d892242d0963cf4b8e8fa5bb2', 'request_id': 'req-6b14cc5c-3562-4318-98ab-cd9733e73a2a'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-6b14cc5c-3562-4318-98ab-cd9733e73a2a None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8122411d892242d0963cf4b8e8fa5bb2', 'request_id': 'req-6b14cc5c-3562-4318-98ab-cd9733e73a2a'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-6b14cc5c-3562-4318-98ab-cd9733e73a2a None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8122411d892242d0963cf4b8e8fa5bb2', 'request_id': 'req-6b14cc5c-3562-4318-98ab-cd9733e73a2a'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-6b14cc5c-3562-4318-98ab-cd9733e73a2a None admin] The token cache is being invalidate because project 8122411d892242d0963cf4b8e8fa5bb2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 12:57:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-6b14cc5c-3562-4318-98ab-cd9733e73a2a None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-6b14cc5c-3562-4318-98ab-cd9733e73a2a None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:07 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 833/1688] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 12:57:07 2024] DELETE /identity/v3/projects/8122411d892242d0963cf4b8e8fa5bb2 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:57:07 l75lg1-v1 neutron-server[77618]: DEBUG neutron.wsgi [-] (77618) accepted ('10.27.203.238', 59576) {{(pid=77618) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 12:57:07 l75lg1-v1 neutron-server[77618]: INFO neutron.wsgi [None req-7c2bc875-b1ec-45d7-8fb8-2ddd63b9879c None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=7abca1415fa0479a90ff899b30fb3735&name=default HTTP/1.1" status: 200 len: 216 time: 0.0083580 May 28 12:57:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a3d518-9e57-4554-9f89-d1e36deb4efd service neutron] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a3d518-9e57-4554-9f89-d1e36deb4efd service neutron] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84279d7c-2c61-4cec-9d61-7720a0eded66 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84279d7c-2c61-4cec-9d61-7720a0eded66 None admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84279d7c-2c61-4cec-9d61-7720a0eded66 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84279d7c-2c61-4cec-9d61-7720a0eded66 None admin] PATH_INFO: `/v3/projects/7abca1415fa0479a90ff899b30fb3735` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84279d7c-2c61-4cec-9d61-7720a0eded66 None admin] RBAC: Authorizing `identity:delete_project(project_id=7abca1415fa0479a90ff899b30fb3735)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84279d7c-2c61-4cec-9d61-7720a0eded66 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-84279d7c-2c61-4cec-9d61-7720a0eded66 None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7abca1415fa0479a90ff899b30fb3735', 'request_id': 'req-84279d7c-2c61-4cec-9d61-7720a0eded66'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-84279d7c-2c61-4cec-9d61-7720a0eded66 None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7abca1415fa0479a90ff899b30fb3735', 'request_id': 'req-84279d7c-2c61-4cec-9d61-7720a0eded66'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-84279d7c-2c61-4cec-9d61-7720a0eded66 None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7abca1415fa0479a90ff899b30fb3735', 'request_id': 'req-84279d7c-2c61-4cec-9d61-7720a0eded66'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-84279d7c-2c61-4cec-9d61-7720a0eded66 None admin] The token cache is being invalidate because project 7abca1415fa0479a90ff899b30fb3735 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 12:57:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-84279d7c-2c61-4cec-9d61-7720a0eded66 None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-84279d7c-2c61-4cec-9d61-7720a0eded66 None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:07 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 856/1689] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 12:57:07 2024] DELETE /identity/v3/projects/7abca1415fa0479a90ff899b30fb3735 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:57:07 l75lg1-v1 neutron-server[77618]: DEBUG neutron.wsgi [-] (77618) accepted ('10.27.203.238', 59584) {{(pid=77618) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 12:57:07 l75lg1-v1 neutron-server[77618]: INFO neutron.wsgi [None req-8d9e22be-c12d-4cee-a272-1c6724ebca92 None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=df93a973373644ccaf8ecf54774a4ced&name=default HTTP/1.1" status: 200 len: 216 time: 0.0082409 May 28 12:57:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b14cc5c-3562-4318-98ab-cd9733e73a2a None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-6b14cc5c-3562-4318-98ab-cd9733e73a2a None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b14cc5c-3562-4318-98ab-cd9733e73a2a None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233cfe85-6215-4ed0-a7bc-ccc5ebe8bed7 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233cfe85-6215-4ed0-a7bc-ccc5ebe8bed7 None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233cfe85-6215-4ed0-a7bc-ccc5ebe8bed7 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233cfe85-6215-4ed0-a7bc-ccc5ebe8bed7 None admin] PATH_INFO: `/v3/projects/df93a973373644ccaf8ecf54774a4ced` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233cfe85-6215-4ed0-a7bc-ccc5ebe8bed7 None admin] RBAC: Authorizing `identity:delete_project(project_id=df93a973373644ccaf8ecf54774a4ced)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233cfe85-6215-4ed0-a7bc-ccc5ebe8bed7 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-233cfe85-6215-4ed0-a7bc-ccc5ebe8bed7 None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df93a973373644ccaf8ecf54774a4ced', 'request_id': 'req-233cfe85-6215-4ed0-a7bc-ccc5ebe8bed7'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-233cfe85-6215-4ed0-a7bc-ccc5ebe8bed7 None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df93a973373644ccaf8ecf54774a4ced', 'request_id': 'req-233cfe85-6215-4ed0-a7bc-ccc5ebe8bed7'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-233cfe85-6215-4ed0-a7bc-ccc5ebe8bed7 None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df93a973373644ccaf8ecf54774a4ced', 'request_id': 'req-233cfe85-6215-4ed0-a7bc-ccc5ebe8bed7'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:08 l75lg1-v1 nova-conductor[83648]: DEBUG dbcounter [-] [83648] Writing DB stats nova_cell1:SELECT=2,nova_cell1:UPDATE=1 {{(pid=83648) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:57:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-233cfe85-6215-4ed0-a7bc-ccc5ebe8bed7 None admin] The token cache is being invalidate because project df93a973373644ccaf8ecf54774a4ced was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 12:57:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-233cfe85-6215-4ed0-a7bc-ccc5ebe8bed7 None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-233cfe85-6215-4ed0-a7bc-ccc5ebe8bed7 None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:08 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 834/1690] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 12:57:07 2024] DELETE /identity/v3/projects/df93a973373644ccaf8ecf54774a4ced => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:57:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9b68d6-cda1-4e0e-b715-c0d6f018ef8c None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9b68d6-cda1-4e0e-b715-c0d6f018ef8c None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9b68d6-cda1-4e0e-b715-c0d6f018ef8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:08 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-4e9b68d6-cda1-4e0e-b715-c0d6f018ef8c None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:57:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-4e9b68d6-cda1-4e0e-b715-c0d6f018ef8c None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:57:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-4e9b68d6-cda1-4e0e-b715-c0d6f018ef8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:08 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 857/1691] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:57:08 2024] POST /identity/v3/auth/tokens => generated 312 bytes in 20 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 28 12:57:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64c3cd8-8711-4a45-95fc-c472a13d837d None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64c3cd8-8711-4a45-95fc-c472a13d837d None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64c3cd8-8711-4a45-95fc-c472a13d837d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:08 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-b64c3cd8-8711-4a45-95fc-c472a13d837d None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:57:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-b64c3cd8-8711-4a45-95fc-c472a13d837d None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:57:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-b64c3cd8-8711-4a45-95fc-c472a13d837d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:08 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-8b208877-efa2-44f0-be30-00225a53e8d5 tempest-ShareInstancesNegativeTest-210953919 tempest-ShareInstancesNegativeTest-210953919-project-admin] GET http://10.27.203.238/share/v2/bb8f0d37fc204d24b8146108f63a1922/shares/6b055a82-f6ad-4af2-8b38-137b3cc99cc1 May 28 12:57:08 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-8b208877-efa2-44f0-be30-00225a53e8d5 tempest-ShareInstancesNegativeTest-210953919 tempest-ShareInstancesNegativeTest-210953919-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:08 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-8b208877-efa2-44f0-be30-00225a53e8d5 tempest-ShareInstancesNegativeTest-210953919 tempest-ShareInstancesNegativeTest-210953919-project-admin] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:08 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 835/1692] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:57:08 2024] POST /identity/v3/auth/tokens => generated 2960 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 12:57:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9b68d6-cda1-4e0e-b715-c0d6f018ef8c None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9b68d6-cda1-4e0e-b715-c0d6f018ef8c None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:08 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-8b208877-efa2-44f0-be30-00225a53e8d5 tempest-ShareInstancesNegativeTest-210953919 tempest-ShareInstancesNegativeTest-210953919-project-admin] http://10.27.203.238/share/v2/bb8f0d37fc204d24b8146108f63a1922/shares/6b055a82-f6ad-4af2-8b38-137b3cc99cc1 returned with HTTP 200 May 28 12:57:08 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 229/473] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:57:08 2024] GET /share/v2/bb8f0d37fc204d24b8146108f63a1922/shares/6b055a82-f6ad-4af2-8b38-137b3cc99cc1 => generated 1370 bytes in 24 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:57:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02e4a49-273a-4fea-9814-01e7880d083d None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02e4a49-273a-4fea-9814-01e7880d083d None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02e4a49-273a-4fea-9814-01e7880d083d None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02e4a49-273a-4fea-9814-01e7880d083d None admin] PATH_INFO: `/v3/domains` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02e4a49-273a-4fea-9814-01e7880d083d None admin] RBAC: Adding query filter params (name=Default) {{(pid=51267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:57:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02e4a49-273a-4fea-9814-01e7880d083d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02e4a49-273a-4fea-9814-01e7880d083d None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:08 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 858/1693] 10.27.203.238 () {62 vars in 1220 bytes} [Tue May 28 12:57:08 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:57:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64c3cd8-8711-4a45-95fc-c472a13d837d None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:08 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bbf758da-a5e5-4efa-9481-28cdc0a18883 tempest-AccessRulesMetadataTest-1973590610 None] <<< [GET] https://127.0.0.1:40443/api/quotas/ May 28 12:57:08 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bbf758da-a5e5-4efa-9481-28cdc0a18883 tempest-AccessRulesMetadataTest-1973590610 None] [Bunch(cluster='loop75-kfs', cluster_id=1, default_email=None, default_group_quota=None, default_user_quota=None, enable_alarms=True, enable_email_providers=True, grace_period=None, guid='38d04e3d-1aad-4e01-bf01-dff30a7380fb', hard_limit=1073741824, hard_limit_inodes=None, id=6, internal=False, is_user_quota=False, last_user_quotas_update=None, name='95118a75-173c-4257-acef-78a246ee1c67', num_blocked_users=0, num_exceeded_users=0, path='/manila/manila-95118a75-173c-4257-acef-78a246ee1c67', percent_capacity=0, percent_inodes=None, pretty_grace_period=None, pretty_grace_period_expiration=None, pretty_state='OK (CREATED)', soft_limit=None, soft_limit_inodes=None, state='OK', sync_state='CREATED', system_id=6, tenant_id=1, tenant_name='default', time_to_block=None, title='95118a75-173c-4257-acef-78a246ee1c67', url='https://127.0.0.1:40443/api/quotas/6/', used_capacity=0, used_capacity_tb=0.0, used_effective_capacity=0, used_effective_capacity_tb=0.0, used_inodes=0, used_limited_capacity=0)] May 28 12:57:08 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bbf758da-a5e5-4efa-9481-28cdc0a18883 tempest-AccessRulesMetadataTest-1973590610 None] --- [GET] https://127.0.0.1:40443/api/quotas/: Done May 28 12:57:08 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bbf758da-a5e5-4efa-9481-28cdc0a18883 tempest-AccessRulesMetadataTest-1973590610 None] >>> [DELETE] https://127.0.0.1:40443/api/quotas/6/ May 28 12:57:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64c3cd8-8711-4a45-95fc-c472a13d837d None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484b845f-f374-4e94-949c-4d3bf53cac47 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484b845f-f374-4e94-949c-4d3bf53cac47 None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484b845f-f374-4e94-949c-4d3bf53cac47 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484b845f-f374-4e94-949c-4d3bf53cac47 None admin] PATH_INFO: `/v3/projects` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484b845f-f374-4e94-949c-4d3bf53cac47 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484b845f-f374-4e94-949c-4d3bf53cac47 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:08 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 836/1694] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 12:57:08 2024] POST /identity/v3/projects => generated 381 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:57:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02e4a49-273a-4fea-9814-01e7880d083d None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02e4a49-273a-4fea-9814-01e7880d083d None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:08 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c07df379-c3ad-4b79-82d1-01d37d41940f tempest-ShareInstancesNegativeTest-210953919 None] <<< [DELETE] https://127.0.0.1:40443/api/viewpolicies/11/ May 28 12:57:08 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c07df379-c3ad-4b79-82d1-01d37d41940f tempest-ShareInstancesNegativeTest-210953919 None] --- [DELETE] https://127.0.0.1:40443/api/viewpolicies/11/: Done May 28 12:57:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7592030e-349a-46c2-94eb-eca0adcd3bd2 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7592030e-349a-46c2-94eb-eca0adcd3bd2 None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7592030e-349a-46c2-94eb-eca0adcd3bd2 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7592030e-349a-46c2-94eb-eca0adcd3bd2 None admin] PATH_INFO: `/v3/users` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7592030e-349a-46c2-94eb-eca0adcd3bd2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7592030e-349a-46c2-94eb-eca0adcd3bd2 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:08 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-7592030e-349a-46c2-94eb-eca0adcd3bd2 None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 12:57:08 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 859/1695] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 12:57:08 2024] POST /identity/v3/users => generated 298 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:57:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484b845f-f374-4e94-949c-4d3bf53cac47 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484b845f-f374-4e94-949c-4d3bf53cac47 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97746fbd-ae60-41ce-bd5d-331e27a51295 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97746fbd-ae60-41ce-bd5d-331e27a51295 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97746fbd-ae60-41ce-bd5d-331e27a51295 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97746fbd-ae60-41ce-bd5d-331e27a51295 None admin] PATH_INFO: `/v3/roles` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97746fbd-ae60-41ce-bd5d-331e27a51295 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97746fbd-ae60-41ce-bd5d-331e27a51295 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:08 l75lg1-v1 dstat.sh[49771]: 28-05 12:57:08| 10 2 85 3 0|5675M 1827M 277M 7847M| 17k 1620B| 0 8775k| 0 1073 |7852 14k|1.59 1.01 1.00|3.0 1.0 2.0| 0 0 | 0 2048M| 29 348 0 60 0 May 28 12:57:08 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 837/1696] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 12:57:08 2024] GET /identity/v3/roles => generated 1680 bytes in 17 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:57:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7592030e-349a-46c2-94eb-eca0adcd3bd2 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7592030e-349a-46c2-94eb-eca0adcd3bd2 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eccff1d-00a5-4bef-8d5c-ec3765a65228 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eccff1d-00a5-4bef-8d5c-ec3765a65228 None admin] REQUEST_METHOD: `PUT` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eccff1d-00a5-4bef-8d5c-ec3765a65228 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eccff1d-00a5-4bef-8d5c-ec3765a65228 None admin] PATH_INFO: `/v3/projects/c4e1c40722d448388acafcd2f58af36b/users/ecb7bc4086304a2ebf3c392fd1c208fa/roles/e7989893488f483baa107be56668c4f8` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eccff1d-00a5-4bef-8d5c-ec3765a65228 None admin] RBAC: Authorizing `identity:create_grant(project_id=c4e1c40722d448388acafcd2f58af36b, user_id=ecb7bc4086304a2ebf3c392fd1c208fa, role_id=e7989893488f483baa107be56668c4f8)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eccff1d-00a5-4bef-8d5c-ec3765a65228 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:08 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 860/1697] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 12:57:08 2024] PUT /identity/v3/projects/c4e1c40722d448388acafcd2f58af36b/users/ecb7bc4086304a2ebf3c392fd1c208fa/roles/e7989893488f483baa107be56668c4f8 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:57:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97746fbd-ae60-41ce-bd5d-331e27a51295 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:08 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-c07df379-c3ad-4b79-82d1-01d37d41940f tempest-ShareInstancesNegativeTest-210953919 None] Created reservations ['f96a41cb-6d33-4c38-bdd0-5ed1718ebc6a', '1306ae35-5bee-4262-a2bd-857875785d6d', 'b6c159bc-3eb9-4c9e-a353-f96b43308c40', '391c13d4-f4c0-4905-8fba-bd8a4a86e4f8'] {{(pid=98474) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 12:57:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97746fbd-ae60-41ce-bd5d-331e27a51295 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:08 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-c07df379-c3ad-4b79-82d1-01d37d41940f tempest-ShareInstancesNegativeTest-210953919 None] Committed reservations ['f96a41cb-6d33-4c38-bdd0-5ed1718ebc6a', '1306ae35-5bee-4262-a2bd-857875785d6d', 'b6c159bc-3eb9-4c9e-a353-f96b43308c40', '391c13d4-f4c0-4905-8fba-bd8a4a86e4f8'] {{(pid=98474) commit /opt/stack/manila/manila/quota.py:1063}} May 28 12:57:08 l75lg1-v1 manila-share[98474]: INFO manila.share.manager [None req-c07df379-c3ad-4b79-82d1-01d37d41940f tempest-ShareInstancesNegativeTest-210953919 None] Share instance 9b44eaf4-da6e-42e7-8723-ce0cc8878f85: deleted successfully. May 28 12:57:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ae218b-5011-4f69-9adf-65d1d0fd18e1 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ae218b-5011-4f69-9adf-65d1d0fd18e1 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ae218b-5011-4f69-9adf-65d1d0fd18e1 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ae218b-5011-4f69-9adf-65d1d0fd18e1 None admin] PATH_INFO: `/v3/roles` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ae218b-5011-4f69-9adf-65d1d0fd18e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ae218b-5011-4f69-9adf-65d1d0fd18e1 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:08 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 838/1698] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 12:57:08 2024] GET /identity/v3/roles => generated 1680 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:57:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eccff1d-00a5-4bef-8d5c-ec3765a65228 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eccff1d-00a5-4bef-8d5c-ec3765a65228 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6e5f7c-562c-4ab6-b5bc-12587dc20a55 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6e5f7c-562c-4ab6-b5bc-12587dc20a55 None admin] REQUEST_METHOD: `PUT` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6e5f7c-562c-4ab6-b5bc-12587dc20a55 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6e5f7c-562c-4ab6-b5bc-12587dc20a55 None admin] PATH_INFO: `/v3/projects/c4e1c40722d448388acafcd2f58af36b/users/ecb7bc4086304a2ebf3c392fd1c208fa/roles/e7989893488f483baa107be56668c4f8` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6e5f7c-562c-4ab6-b5bc-12587dc20a55 None admin] RBAC: Authorizing `identity:create_grant(project_id=c4e1c40722d448388acafcd2f58af36b, user_id=ecb7bc4086304a2ebf3c392fd1c208fa, role_id=e7989893488f483baa107be56668c4f8)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6e5f7c-562c-4ab6-b5bc-12587dc20a55 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:08 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 861/1699] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 12:57:08 2024] PUT /identity/v3/projects/c4e1c40722d448388acafcd2f58af36b/users/ecb7bc4086304a2ebf3c392fd1c208fa/roles/e7989893488f483baa107be56668c4f8 => generated 0 bytes in 19 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:57:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b75874-5610-4846-8d2c-ea8427a02c2b None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b75874-5610-4846-8d2c-ea8427a02c2b None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b75874-5610-4846-8d2c-ea8427a02c2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:08 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-27b75874-5610-4846-8d2c-ea8427a02c2b None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:57:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-27b75874-5610-4846-8d2c-ea8427a02c2b None None] MFA Rules not processed for user `ecb7bc4086304a2ebf3c392fd1c208fa`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:57:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-27b75874-5610-4846-8d2c-ea8427a02c2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:08 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 839/1700] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:57:08 2024] POST /identity/v3/auth/tokens => generated 4075 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:57:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6e5f7c-562c-4ab6-b5bc-12587dc20a55 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6e5f7c-562c-4ab6-b5bc-12587dc20a55 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f01663-44c6-476d-9d05-c128bd74bd34 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f01663-44c6-476d-9d05-c128bd74bd34 None admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f01663-44c6-476d-9d05-c128bd74bd34 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f01663-44c6-476d-9d05-c128bd74bd34 None admin] PATH_INFO: `/v3/users/ecb7bc4086304a2ebf3c392fd1c208fa` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f01663-44c6-476d-9d05-c128bd74bd34 None admin] RBAC: Authorizing `identity:delete_user(user_id=ecb7bc4086304a2ebf3c392fd1c208fa)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f01663-44c6-476d-9d05-c128bd74bd34 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-d7f01663-44c6-476d-9d05-c128bd74bd34 None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ecb7bc4086304a2ebf3c392fd1c208fa', 'request_id': 'req-d7f01663-44c6-476d-9d05-c128bd74bd34'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-d7f01663-44c6-476d-9d05-c128bd74bd34 None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ecb7bc4086304a2ebf3c392fd1c208fa', 'request_id': 'req-d7f01663-44c6-476d-9d05-c128bd74bd34'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-d7f01663-44c6-476d-9d05-c128bd74bd34 None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ecb7bc4086304a2ebf3c392fd1c208fa', 'request_id': 'req-d7f01663-44c6-476d-9d05-c128bd74bd34'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-d7f01663-44c6-476d-9d05-c128bd74bd34 None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ecb7bc4086304a2ebf3c392fd1c208fa', 'request_id': 'req-d7f01663-44c6-476d-9d05-c128bd74bd34'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-d7f01663-44c6-476d-9d05-c128bd74bd34 None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ecb7bc4086304a2ebf3c392fd1c208fa', 'request_id': 'req-d7f01663-44c6-476d-9d05-c128bd74bd34'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:08 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 862/1701] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 12:57:08 2024] DELETE /identity/v3/users/ecb7bc4086304a2ebf3c392fd1c208fa => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:57:08 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-5b2d6ff3-2631-46b8-ac9c-63c4d24e018c tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] GET http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/shares/8e00d6e4-a018-4e71-b71c-831e546cb6e6 May 28 12:57:08 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-5b2d6ff3-2631-46b8-ac9c-63c4d24e018c tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:08 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-5b2d6ff3-2631-46b8-ac9c-63c4d24e018c tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669c2973-6cf8-411e-b5cb-92c8a8bdbdd1 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669c2973-6cf8-411e-b5cb-92c8a8bdbdd1 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669c2973-6cf8-411e-b5cb-92c8a8bdbdd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:08 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-669c2973-6cf8-411e-b5cb-92c8a8bdbdd1 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:57:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-669c2973-6cf8-411e-b5cb-92c8a8bdbdd1 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:57:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-669c2973-6cf8-411e-b5cb-92c8a8bdbdd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:08 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-5b2d6ff3-2631-46b8-ac9c-63c4d24e018c tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/shares/8e00d6e4-a018-4e71-b71c-831e546cb6e6 returned with HTTP 200 May 28 12:57:08 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 245/474] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:57:08 2024] GET /share/v2/35d84ed7cf164123a87b8b906a836985/shares/8e00d6e4-a018-4e71-b71c-831e546cb6e6 => generated 1347 bytes in 24 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:57:08 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 840/1702] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:57:08 2024] POST /identity/v3/auth/tokens => generated 2960 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 12:57:08 l75lg1-v1 neutron-server[77618]: DEBUG neutron.wsgi [-] (77618) accepted ('10.27.203.238', 59588) {{(pid=77618) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 12:57:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f01663-44c6-476d-9d05-c128bd74bd34 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-d7f01663-44c6-476d-9d05-c128bd74bd34 None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f01663-44c6-476d-9d05-c128bd74bd34 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b96e4c-4eb8-451e-aef6-0e3048d0bbb7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef17047035e4b518fd5360a01f2da1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b96e4c-4eb8-451e-aef6-0e3048d0bbb7 service neutron] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b96e4c-4eb8-451e-aef6-0e3048d0bbb7 service neutron] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b96e4c-4eb8-451e-aef6-0e3048d0bbb7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b96e4c-4eb8-451e-aef6-0e3048d0bbb7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b96e4c-4eb8-451e-aef6-0e3048d0bbb7 service neutron] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:08 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 863/1703] 10.27.203.238 () {64 vars in 1432 bytes} [Tue May 28 12:57:08 2024] GET /identity/v3/auth/tokens => generated 2960 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 28 12:57:08 l75lg1-v1 neutron-server[77618]: INFO neutron.wsgi [None req-58ff64e2-2066-477f-9197-9e29dc817913 None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=c4e1c40722d448388acafcd2f58af36b&name=default HTTP/1.1" status: 200 len: 216 time: 0.0708113 May 28 12:57:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669c2973-6cf8-411e-b5cb-92c8a8bdbdd1 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-669c2973-6cf8-411e-b5cb-92c8a8bdbdd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669c2973-6cf8-411e-b5cb-92c8a8bdbdd1 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce207a31-3a7a-42e7-b90e-d65441effc74 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce207a31-3a7a-42e7-b90e-d65441effc74 None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce207a31-3a7a-42e7-b90e-d65441effc74 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce207a31-3a7a-42e7-b90e-d65441effc74 None admin] PATH_INFO: `/v3/projects/c4e1c40722d448388acafcd2f58af36b` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce207a31-3a7a-42e7-b90e-d65441effc74 None admin] RBAC: Authorizing `identity:delete_project(project_id=c4e1c40722d448388acafcd2f58af36b)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce207a31-3a7a-42e7-b90e-d65441effc74 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-ce207a31-3a7a-42e7-b90e-d65441effc74 None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4e1c40722d448388acafcd2f58af36b', 'request_id': 'req-ce207a31-3a7a-42e7-b90e-d65441effc74'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-ce207a31-3a7a-42e7-b90e-d65441effc74 None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4e1c40722d448388acafcd2f58af36b', 'request_id': 'req-ce207a31-3a7a-42e7-b90e-d65441effc74'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-ce207a31-3a7a-42e7-b90e-d65441effc74 None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4e1c40722d448388acafcd2f58af36b', 'request_id': 'req-ce207a31-3a7a-42e7-b90e-d65441effc74'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-ce207a31-3a7a-42e7-b90e-d65441effc74 None admin] The token cache is being invalidate because project c4e1c40722d448388acafcd2f58af36b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 12:57:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-ce207a31-3a7a-42e7-b90e-d65441effc74 None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-ce207a31-3a7a-42e7-b90e-d65441effc74 None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:08 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 841/1704] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 12:57:08 2024] DELETE /identity/v3/projects/c4e1c40722d448388acafcd2f58af36b => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:57:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af1dc68-0d33-4cdc-8ff5-d4da00842786 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af1dc68-0d33-4cdc-8ff5-d4da00842786 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af1dc68-0d33-4cdc-8ff5-d4da00842786 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:08 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-0af1dc68-0d33-4cdc-8ff5-d4da00842786 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:57:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-0af1dc68-0d33-4cdc-8ff5-d4da00842786 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:57:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-0af1dc68-0d33-4cdc-8ff5-d4da00842786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:08 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 864/1705] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:57:08 2024] POST /identity/v3/auth/tokens => generated 312 bytes in 26 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 28 12:57:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f938c0c0-0aff-4b63-837f-fca381a8c00b None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f938c0c0-0aff-4b63-837f-fca381a8c00b None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f938c0c0-0aff-4b63-837f-fca381a8c00b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:08 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-f938c0c0-0aff-4b63-837f-fca381a8c00b None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:57:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-f938c0c0-0aff-4b63-837f-fca381a8c00b None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:57:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-f938c0c0-0aff-4b63-837f-fca381a8c00b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:08 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 842/1706] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:57:08 2024] POST /identity/v3/auth/tokens => generated 2960 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 12:57:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af1dc68-0d33-4cdc-8ff5-d4da00842786 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af1dc68-0d33-4cdc-8ff5-d4da00842786 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f657686-3be8-4e64-97e2-798f5c3b804a None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f657686-3be8-4e64-97e2-798f5c3b804a None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f657686-3be8-4e64-97e2-798f5c3b804a None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f657686-3be8-4e64-97e2-798f5c3b804a None admin] PATH_INFO: `/v3/domains` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f657686-3be8-4e64-97e2-798f5c3b804a None admin] RBAC: Adding query filter params (name=Default) {{(pid=51267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:57:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f657686-3be8-4e64-97e2-798f5c3b804a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f657686-3be8-4e64-97e2-798f5c3b804a None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:08 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 865/1707] 10.27.203.238 () {62 vars in 1220 bytes} [Tue May 28 12:57:08 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:57:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f938c0c0-0aff-4b63-837f-fca381a8c00b None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f938c0c0-0aff-4b63-837f-fca381a8c00b None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9757f2-660e-4031-b3ac-823a15e394c9 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9757f2-660e-4031-b3ac-823a15e394c9 None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9757f2-660e-4031-b3ac-823a15e394c9 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9757f2-660e-4031-b3ac-823a15e394c9 None admin] PATH_INFO: `/v3/projects` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9757f2-660e-4031-b3ac-823a15e394c9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9757f2-660e-4031-b3ac-823a15e394c9 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:08 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 843/1708] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 12:57:08 2024] POST /identity/v3/projects => generated 389 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:57:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f657686-3be8-4e64-97e2-798f5c3b804a None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f657686-3be8-4e64-97e2-798f5c3b804a None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb1d66c-abfe-43bb-9402-2e20356fd688 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb1d66c-abfe-43bb-9402-2e20356fd688 None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb1d66c-abfe-43bb-9402-2e20356fd688 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb1d66c-abfe-43bb-9402-2e20356fd688 None admin] PATH_INFO: `/v3/users` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb1d66c-abfe-43bb-9402-2e20356fd688 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb1d66c-abfe-43bb-9402-2e20356fd688 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:09 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-ccb1d66c-abfe-43bb-9402-2e20356fd688 None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 12:57:09 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-7e081b81-135c-47a7-9bfa-2207e386d60b tempest-ShareTypesAdminTest-216868925 None] <<< [DELETE] https://127.0.0.1:40443/api/quotas/9/ May 28 12:57:09 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-7e081b81-135c-47a7-9bfa-2207e386d60b tempest-ShareTypesAdminTest-216868925 None] --- [DELETE] https://127.0.0.1:40443/api/quotas/9/: Done May 28 12:57:09 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 866/1709] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 12:57:08 2024] POST /identity/v3/users => generated 303 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:57:09 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-7e081b81-135c-47a7-9bfa-2207e386d60b tempest-ShareTypesAdminTest-216868925 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:57:09 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-7e081b81-135c-47a7-9bfa-2207e386d60b tempest-ShareTypesAdminTest-216868925 None] {'allow_redirects': True, May 28 12:57:09 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-7e081b81-135c-47a7-9bfa-2207e386d60b tempest-ShareTypesAdminTest-216868925 None] 'params': {'name': '4e77e600-5df2-4310-91eb-8d6633f53ce4'}} May 28 12:57:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9757f2-660e-4031-b3ac-823a15e394c9 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9757f2-660e-4031-b3ac-823a15e394c9 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e22adfc-e19b-48e9-a387-7b434ca7a1f1 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e22adfc-e19b-48e9-a387-7b434ca7a1f1 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e22adfc-e19b-48e9-a387-7b434ca7a1f1 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e22adfc-e19b-48e9-a387-7b434ca7a1f1 None admin] PATH_INFO: `/v3/roles` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e22adfc-e19b-48e9-a387-7b434ca7a1f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e22adfc-e19b-48e9-a387-7b434ca7a1f1 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:09 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 844/1710] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 12:57:09 2024] GET /identity/v3/roles => generated 1680 bytes in 17 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:57:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb1d66c-abfe-43bb-9402-2e20356fd688 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb1d66c-abfe-43bb-9402-2e20356fd688 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c786df5-3098-4b1f-a285-8ca853bc1b43 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c786df5-3098-4b1f-a285-8ca853bc1b43 None admin] REQUEST_METHOD: `PUT` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c786df5-3098-4b1f-a285-8ca853bc1b43 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c786df5-3098-4b1f-a285-8ca853bc1b43 None admin] PATH_INFO: `/v3/projects/733abeb6b7f14d85930dd7d4da7587f5/users/1088ed2b050844799c3ae6a6d5cc28c8/roles/44620cad10ae407c90c91e2c296adb04` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:09 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-3403f35e-a42d-4c6e-a853-bf8de8f5c80f tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] GET http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/shares/9be3b244-34ab-4002-b1e1-427af2ab8545 May 28 12:57:09 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-3403f35e-a42d-4c6e-a853-bf8de8f5c80f tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:09 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-3403f35e-a42d-4c6e-a853-bf8de8f5c80f tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c786df5-3098-4b1f-a285-8ca853bc1b43 None admin] RBAC: Authorizing `identity:create_grant(project_id=733abeb6b7f14d85930dd7d4da7587f5, user_id=1088ed2b050844799c3ae6a6d5cc28c8, role_id=44620cad10ae407c90c91e2c296adb04)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c786df5-3098-4b1f-a285-8ca853bc1b43 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:09 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-3403f35e-a42d-4c6e-a853-bf8de8f5c80f tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/shares/9be3b244-34ab-4002-b1e1-427af2ab8545 returned with HTTP 200 May 28 12:57:09 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 230/475] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:57:09 2024] GET /share/v2/a3499cb78849424db45e54caac01de92/shares/9be3b244-34ab-4002-b1e1-427af2ab8545 => generated 1371 bytes in 25 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:57:09 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 867/1711] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 12:57:09 2024] PUT /identity/v3/projects/733abeb6b7f14d85930dd7d4da7587f5/users/1088ed2b050844799c3ae6a6d5cc28c8/roles/44620cad10ae407c90c91e2c296adb04 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 28 12:57:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abb9110-2898-4f4b-a3d2-b19a899047f4 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abb9110-2898-4f4b-a3d2-b19a899047f4 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abb9110-2898-4f4b-a3d2-b19a899047f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:09 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-7abb9110-2898-4f4b-a3d2-b19a899047f4 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:57:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-7abb9110-2898-4f4b-a3d2-b19a899047f4 None None] MFA Rules not processed for user `1088ed2b050844799c3ae6a6d5cc28c8`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:57:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-7abb9110-2898-4f4b-a3d2-b19a899047f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:09 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 845/1712] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:57:09 2024] POST /identity/v3/auth/tokens => generated 3960 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:57:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c786df5-3098-4b1f-a285-8ca853bc1b43 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c786df5-3098-4b1f-a285-8ca853bc1b43 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bf99a1-10fb-469e-b345-f70ea3b25188 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bf99a1-10fb-469e-b345-f70ea3b25188 None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bf99a1-10fb-469e-b345-f70ea3b25188 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bf99a1-10fb-469e-b345-f70ea3b25188 None admin] PATH_INFO: `/v3/projects` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bf99a1-10fb-469e-b345-f70ea3b25188 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bf99a1-10fb-469e-b345-f70ea3b25188 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:09 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 868/1713] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 12:57:09 2024] POST /identity/v3/projects => generated 387 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:57:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abb9110-2898-4f4b-a3d2-b19a899047f4 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abb9110-2898-4f4b-a3d2-b19a899047f4 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:09 l75lg1-v1 dstat.sh[49771]: 28-05 12:57:09| 10 2 85 3 0|5675M 1827M 277M 7847M| 15k 1318B| 0 2708k| 0 275 |7437 13k|1.59 1.01 1.00|2.0 1.0 0| 0 0 | 0 2048M| 29 348 0 62 0 May 28 12:57:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6672fa4f-0aa6-4849-b1b5-1146335ff3fe None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6672fa4f-0aa6-4849-b1b5-1146335ff3fe None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6672fa4f-0aa6-4849-b1b5-1146335ff3fe None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6672fa4f-0aa6-4849-b1b5-1146335ff3fe None admin] PATH_INFO: `/v3/users` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6672fa4f-0aa6-4849-b1b5-1146335ff3fe None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6672fa4f-0aa6-4849-b1b5-1146335ff3fe None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:09 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-6672fa4f-0aa6-4849-b1b5-1146335ff3fe None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 12:57:09 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 846/1714] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 12:57:09 2024] POST /identity/v3/users => generated 302 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:57:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bf99a1-10fb-469e-b345-f70ea3b25188 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bf99a1-10fb-469e-b345-f70ea3b25188 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18c5188-740e-43cd-a47c-ce646805175d None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18c5188-740e-43cd-a47c-ce646805175d None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18c5188-740e-43cd-a47c-ce646805175d None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18c5188-740e-43cd-a47c-ce646805175d None admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18c5188-740e-43cd-a47c-ce646805175d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18c5188-740e-43cd-a47c-ce646805175d None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:09 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 869/1715] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 12:57:09 2024] GET /identity/v3/roles => generated 1680 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:57:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6672fa4f-0aa6-4849-b1b5-1146335ff3fe None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6672fa4f-0aa6-4849-b1b5-1146335ff3fe None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f978e7de-d667-4594-ada1-7ee38e1cd679 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f978e7de-d667-4594-ada1-7ee38e1cd679 None admin] REQUEST_METHOD: `PUT` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f978e7de-d667-4594-ada1-7ee38e1cd679 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f978e7de-d667-4594-ada1-7ee38e1cd679 None admin] PATH_INFO: `/v3/projects/989392199c1c4c7ca95fcdecce7ed757/users/d1c265944d944e65bb8d3eb50a476c3d/roles/44620cad10ae407c90c91e2c296adb04` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f978e7de-d667-4594-ada1-7ee38e1cd679 None admin] RBAC: Authorizing `identity:create_grant(project_id=989392199c1c4c7ca95fcdecce7ed757, user_id=d1c265944d944e65bb8d3eb50a476c3d, role_id=44620cad10ae407c90c91e2c296adb04)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f978e7de-d667-4594-ada1-7ee38e1cd679 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:09 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-7e081b81-135c-47a7-9bfa-2207e386d60b tempest-ShareTypesAdminTest-216868925 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:57:09 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-7e081b81-135c-47a7-9bfa-2207e386d60b tempest-ShareTypesAdminTest-216868925 None] [Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=0, created='2024-05-28T12:56:54.595811Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='bf1a1526-4fae-41a2-8eb8-97af4f34870d', id=12, internal=False, is_s3_default_policy=False, name='4e77e600-5df2-4310-91eb-8d6633f53ce4', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=[], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['*'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['*'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T12:56:54.985063Z', tenant_id=1, tenant_name='default', title='4e77e600-5df2-4310-91eb-8d6633f53ce4', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/12/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[])] May 28 12:57:09 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-7e081b81-135c-47a7-9bfa-2207e386d60b tempest-ShareTypesAdminTest-216868925 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 12:57:09 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-7e081b81-135c-47a7-9bfa-2207e386d60b tempest-ShareTypesAdminTest-216868925 None] >>> [DELETE] https://127.0.0.1:40443/api/viewpolicies/12/ May 28 12:57:09 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 847/1716] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 12:57:09 2024] PUT /identity/v3/projects/989392199c1c4c7ca95fcdecce7ed757/users/d1c265944d944e65bb8d3eb50a476c3d/roles/44620cad10ae407c90c91e2c296adb04 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:57:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd07670-69ce-45dd-8129-9e868b9dc763 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd07670-69ce-45dd-8129-9e868b9dc763 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd07670-69ce-45dd-8129-9e868b9dc763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:09 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-efd07670-69ce-45dd-8129-9e868b9dc763 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:57:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-efd07670-69ce-45dd-8129-9e868b9dc763 None None] MFA Rules not processed for user `d1c265944d944e65bb8d3eb50a476c3d`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:57:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-efd07670-69ce-45dd-8129-9e868b9dc763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:09 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 870/1717] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:57:09 2024] POST /identity/v3/auth/tokens => generated 3958 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:57:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f978e7de-d667-4594-ada1-7ee38e1cd679 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f978e7de-d667-4594-ada1-7ee38e1cd679 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659b2d1b-75a7-442b-b0af-28d650122e07 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659b2d1b-75a7-442b-b0af-28d650122e07 None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659b2d1b-75a7-442b-b0af-28d650122e07 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659b2d1b-75a7-442b-b0af-28d650122e07 None admin] PATH_INFO: `/v3/projects` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659b2d1b-75a7-442b-b0af-28d650122e07 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659b2d1b-75a7-442b-b0af-28d650122e07 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:09 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 848/1718] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 12:57:09 2024] POST /identity/v3/projects => generated 385 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:57:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd07670-69ce-45dd-8129-9e868b9dc763 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd07670-69ce-45dd-8129-9e868b9dc763 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3838714a-dea9-4977-b8bc-e52028a23588 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3838714a-dea9-4977-b8bc-e52028a23588 None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3838714a-dea9-4977-b8bc-e52028a23588 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3838714a-dea9-4977-b8bc-e52028a23588 None admin] PATH_INFO: `/v3/users` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3838714a-dea9-4977-b8bc-e52028a23588 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3838714a-dea9-4977-b8bc-e52028a23588 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:09 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-3838714a-dea9-4977-b8bc-e52028a23588 None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 12:57:09 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 871/1719] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 12:57:09 2024] POST /identity/v3/users => generated 300 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:57:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659b2d1b-75a7-442b-b0af-28d650122e07 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659b2d1b-75a7-442b-b0af-28d650122e07 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3489bc6-7bfd-4de4-b8fb-9d2bf1d88002 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3489bc6-7bfd-4de4-b8fb-9d2bf1d88002 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3489bc6-7bfd-4de4-b8fb-9d2bf1d88002 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3489bc6-7bfd-4de4-b8fb-9d2bf1d88002 None admin] PATH_INFO: `/v3/roles` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3489bc6-7bfd-4de4-b8fb-9d2bf1d88002 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3489bc6-7bfd-4de4-b8fb-9d2bf1d88002 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:09 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 849/1720] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 12:57:09 2024] GET /identity/v3/roles => generated 1680 bytes in 18 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:57:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3838714a-dea9-4977-b8bc-e52028a23588 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3838714a-dea9-4977-b8bc-e52028a23588 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdb131d-b674-49f4-972a-2302bcd2ad4a None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdb131d-b674-49f4-972a-2302bcd2ad4a None admin] REQUEST_METHOD: `PUT` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdb131d-b674-49f4-972a-2302bcd2ad4a None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdb131d-b674-49f4-972a-2302bcd2ad4a None admin] PATH_INFO: `/v3/projects/5f95b12aeb9c4909b2f41b65f6661d09/users/12120209f6fe4bd29179faf1b6c6719a/roles/e7989893488f483baa107be56668c4f8` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:09 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-eeade190-48a4-4e98-ba6e-dc30e46ebb57 tempest-AdminActionsTest-1749172189 None] <<< [DELETE] https://127.0.0.1:40443/api/quotas/10/ May 28 12:57:09 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-eeade190-48a4-4e98-ba6e-dc30e46ebb57 tempest-AdminActionsTest-1749172189 None] --- [DELETE] https://127.0.0.1:40443/api/quotas/10/: Done May 28 12:57:09 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-eeade190-48a4-4e98-ba6e-dc30e46ebb57 tempest-AdminActionsTest-1749172189 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:57:09 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-eeade190-48a4-4e98-ba6e-dc30e46ebb57 tempest-AdminActionsTest-1749172189 None] {'allow_redirects': True, May 28 12:57:09 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-eeade190-48a4-4e98-ba6e-dc30e46ebb57 tempest-AdminActionsTest-1749172189 None] 'params': {'name': '4016fe10-12f4-48fc-92de-42cdd2fff998'}} May 28 12:57:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdb131d-b674-49f4-972a-2302bcd2ad4a None admin] RBAC: Authorizing `identity:create_grant(project_id=5f95b12aeb9c4909b2f41b65f6661d09, user_id=12120209f6fe4bd29179faf1b6c6719a, role_id=e7989893488f483baa107be56668c4f8)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdb131d-b674-49f4-972a-2302bcd2ad4a None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:09 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-af904e76-a421-4ea9-be70-0fa2f2399c7a tempest-AccessRulesMetadataTest-1973590610 tempest-AccessRulesMetadataTest-1973590610-project-member] GET http://10.27.203.238/share/v2/1643901550e140118fc2d2e92b82cd0b/shares/b92fc06b-76d7-40f9-adef-74a07ace1027 May 28 12:57:09 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-af904e76-a421-4ea9-be70-0fa2f2399c7a tempest-AccessRulesMetadataTest-1973590610 tempest-AccessRulesMetadataTest-1973590610-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:09 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-af904e76-a421-4ea9-be70-0fa2f2399c7a tempest-AccessRulesMetadataTest-1973590610 tempest-AccessRulesMetadataTest-1973590610-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:09 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 872/1721] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 12:57:09 2024] PUT /identity/v3/projects/5f95b12aeb9c4909b2f41b65f6661d09/users/12120209f6fe4bd29179faf1b6c6719a/roles/e7989893488f483baa107be56668c4f8 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:57:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3489bc6-7bfd-4de4-b8fb-9d2bf1d88002 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3489bc6-7bfd-4de4-b8fb-9d2bf1d88002 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:09 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-af904e76-a421-4ea9-be70-0fa2f2399c7a tempest-AccessRulesMetadataTest-1973590610 tempest-AccessRulesMetadataTest-1973590610-project-member] http://10.27.203.238/share/v2/1643901550e140118fc2d2e92b82cd0b/shares/b92fc06b-76d7-40f9-adef-74a07ace1027 returned with HTTP 200 May 28 12:57:09 l75lg1-v1 nova-conductor[83647]: DEBUG dbcounter [-] [83647] Writing DB stats nova_cell1:SELECT=5,nova_cell1:UPDATE=2 {{(pid=83647) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:57:09 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 246/476] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:57:09 2024] GET /share/v2/1643901550e140118fc2d2e92b82cd0b/shares/b92fc06b-76d7-40f9-adef-74a07ace1027 => generated 1318 bytes in 28 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:57:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16320bb-d09d-4e23-85e8-fede2c8e1b48 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16320bb-d09d-4e23-85e8-fede2c8e1b48 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16320bb-d09d-4e23-85e8-fede2c8e1b48 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16320bb-d09d-4e23-85e8-fede2c8e1b48 None admin] PATH_INFO: `/v3/roles` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16320bb-d09d-4e23-85e8-fede2c8e1b48 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16320bb-d09d-4e23-85e8-fede2c8e1b48 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:09 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 850/1722] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 12:57:09 2024] GET /identity/v3/roles => generated 1680 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:57:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdb131d-b674-49f4-972a-2302bcd2ad4a None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdb131d-b674-49f4-972a-2302bcd2ad4a None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd35b76-2c82-4b86-b8d6-f200af9fffc3 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd35b76-2c82-4b86-b8d6-f200af9fffc3 None admin] REQUEST_METHOD: `PUT` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd35b76-2c82-4b86-b8d6-f200af9fffc3 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd35b76-2c82-4b86-b8d6-f200af9fffc3 None admin] PATH_INFO: `/v3/projects/5f95b12aeb9c4909b2f41b65f6661d09/users/12120209f6fe4bd29179faf1b6c6719a/roles/e7989893488f483baa107be56668c4f8` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd35b76-2c82-4b86-b8d6-f200af9fffc3 None admin] RBAC: Authorizing `identity:create_grant(project_id=5f95b12aeb9c4909b2f41b65f6661d09, user_id=12120209f6fe4bd29179faf1b6c6719a, role_id=e7989893488f483baa107be56668c4f8)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd35b76-2c82-4b86-b8d6-f200af9fffc3 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:09 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 873/1723] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 12:57:09 2024] PUT /identity/v3/projects/5f95b12aeb9c4909b2f41b65f6661d09/users/12120209f6fe4bd29179faf1b6c6719a/roles/e7989893488f483baa107be56668c4f8 => generated 0 bytes in 19 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 28 12:57:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7ae164-301e-4a76-b49d-47aa0506dfa2 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7ae164-301e-4a76-b49d-47aa0506dfa2 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7ae164-301e-4a76-b49d-47aa0506dfa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:09 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-bc7ae164-301e-4a76-b49d-47aa0506dfa2 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:57:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-bc7ae164-301e-4a76-b49d-47aa0506dfa2 None None] MFA Rules not processed for user `12120209f6fe4bd29179faf1b6c6719a`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:57:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-bc7ae164-301e-4a76-b49d-47aa0506dfa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:09 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 851/1724] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:57:09 2024] POST /identity/v3/auth/tokens => generated 4079 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:57:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd35b76-2c82-4b86-b8d6-f200af9fffc3 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd35b76-2c82-4b86-b8d6-f200af9fffc3 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d1018f-9092-4624-93ec-ee4a9c0c15ed tempest-ServicesAdminNegativeTest-26282853 tempest-ServicesAdminNegativeTest-26282853-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12120209f6fe4bd29179faf1b6c6719a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f95b12aeb9c4909b2f41b65f6661d09', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d1018f-9092-4624-93ec-ee4a9c0c15ed tempest-ServicesAdminNegativeTest-26282853 tempest-ServicesAdminNegativeTest-26282853-project-admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d1018f-9092-4624-93ec-ee4a9c0c15ed tempest-ServicesAdminNegativeTest-26282853 tempest-ServicesAdminNegativeTest-26282853-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d1018f-9092-4624-93ec-ee4a9c0c15ed tempest-ServicesAdminNegativeTest-26282853 tempest-ServicesAdminNegativeTest-26282853-project-admin] PATH_INFO: `/v3/domains` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d1018f-9092-4624-93ec-ee4a9c0c15ed tempest-ServicesAdminNegativeTest-26282853 tempest-ServicesAdminNegativeTest-26282853-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=51267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:57:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d1018f-9092-4624-93ec-ee4a9c0c15ed tempest-ServicesAdminNegativeTest-26282853 tempest-ServicesAdminNegativeTest-26282853-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d1018f-9092-4624-93ec-ee4a9c0c15ed tempest-ServicesAdminNegativeTest-26282853 tempest-ServicesAdminNegativeTest-26282853-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:09 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 874/1725] 10.27.203.238 () {62 vars in 1241 bytes} [Tue May 28 12:57:09 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:57:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7ae164-301e-4a76-b49d-47aa0506dfa2 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7ae164-301e-4a76-b49d-47aa0506dfa2 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c631720c-43bb-464b-a8e3-c54759af41eb tempest-ServicesAdminNegativeTest-26282853 tempest-ServicesAdminNegativeTest-26282853-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12120209f6fe4bd29179faf1b6c6719a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f95b12aeb9c4909b2f41b65f6661d09', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c631720c-43bb-464b-a8e3-c54759af41eb tempest-ServicesAdminNegativeTest-26282853 tempest-ServicesAdminNegativeTest-26282853-project-admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c631720c-43bb-464b-a8e3-c54759af41eb tempest-ServicesAdminNegativeTest-26282853 tempest-ServicesAdminNegativeTest-26282853-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c631720c-43bb-464b-a8e3-c54759af41eb tempest-ServicesAdminNegativeTest-26282853 tempest-ServicesAdminNegativeTest-26282853-project-admin] PATH_INFO: `/v3/users` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c631720c-43bb-464b-a8e3-c54759af41eb tempest-ServicesAdminNegativeTest-26282853 tempest-ServicesAdminNegativeTest-26282853-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c631720c-43bb-464b-a8e3-c54759af41eb tempest-ServicesAdminNegativeTest-26282853 tempest-ServicesAdminNegativeTest-26282853-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:09 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-c631720c-43bb-464b-a8e3-c54759af41eb tempest-ServicesAdminNegativeTest-26282853 tempest-ServicesAdminNegativeTest-26282853-project-admin] Truncating password to algorithm specific maximum length 72 characters. May 28 12:57:09 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 852/1726] 10.27.203.238 () {64 vars in 1232 bytes} [Tue May 28 12:57:09 2024] POST /identity/v3/users => generated 433 bytes in 36 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:57:09 l75lg1-v1 nova-conductor[83648]: DEBUG dbcounter [-] [83648] Writing DB stats nova_cell1:SELECT=3 {{(pid=83648) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:57:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d1018f-9092-4624-93ec-ee4a9c0c15ed tempest-ServicesAdminNegativeTest-26282853 tempest-ServicesAdminNegativeTest-26282853-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d1018f-9092-4624-93ec-ee4a9c0c15ed tempest-ServicesAdminNegativeTest-26282853 tempest-ServicesAdminNegativeTest-26282853-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc850360-065a-4ede-9820-b154d4e3f400 tempest-ServicesAdminNegativeTest-26282853 tempest-ServicesAdminNegativeTest-26282853-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12120209f6fe4bd29179faf1b6c6719a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f95b12aeb9c4909b2f41b65f6661d09', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc850360-065a-4ede-9820-b154d4e3f400 tempest-ServicesAdminNegativeTest-26282853 tempest-ServicesAdminNegativeTest-26282853-project-admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc850360-065a-4ede-9820-b154d4e3f400 tempest-ServicesAdminNegativeTest-26282853 tempest-ServicesAdminNegativeTest-26282853-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc850360-065a-4ede-9820-b154d4e3f400 tempest-ServicesAdminNegativeTest-26282853 tempest-ServicesAdminNegativeTest-26282853-project-admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc850360-065a-4ede-9820-b154d4e3f400 tempest-ServicesAdminNegativeTest-26282853 tempest-ServicesAdminNegativeTest-26282853-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc850360-065a-4ede-9820-b154d4e3f400 tempest-ServicesAdminNegativeTest-26282853 tempest-ServicesAdminNegativeTest-26282853-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:09 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 875/1727] 10.27.203.238 () {62 vars in 1210 bytes} [Tue May 28 12:57:09 2024] GET /identity/v3/roles => generated 1680 bytes in 18 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:57:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c631720c-43bb-464b-a8e3-c54759af41eb tempest-ServicesAdminNegativeTest-26282853 tempest-ServicesAdminNegativeTest-26282853-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c631720c-43bb-464b-a8e3-c54759af41eb tempest-ServicesAdminNegativeTest-26282853 tempest-ServicesAdminNegativeTest-26282853-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59744f98-abe9-4096-a52e-98c251e111c5 tempest-ServicesAdminNegativeTest-26282853 tempest-ServicesAdminNegativeTest-26282853-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12120209f6fe4bd29179faf1b6c6719a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f95b12aeb9c4909b2f41b65f6661d09', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59744f98-abe9-4096-a52e-98c251e111c5 tempest-ServicesAdminNegativeTest-26282853 tempest-ServicesAdminNegativeTest-26282853-project-admin] REQUEST_METHOD: `PUT` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59744f98-abe9-4096-a52e-98c251e111c5 tempest-ServicesAdminNegativeTest-26282853 tempest-ServicesAdminNegativeTest-26282853-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59744f98-abe9-4096-a52e-98c251e111c5 tempest-ServicesAdminNegativeTest-26282853 tempest-ServicesAdminNegativeTest-26282853-project-admin] PATH_INFO: `/v3/projects/5f95b12aeb9c4909b2f41b65f6661d09/users/5ae5cb1db3504baaba1df93dc154a004/roles/44620cad10ae407c90c91e2c296adb04` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59744f98-abe9-4096-a52e-98c251e111c5 tempest-ServicesAdminNegativeTest-26282853 tempest-ServicesAdminNegativeTest-26282853-project-admin] RBAC: Authorizing `identity:create_grant(project_id=5f95b12aeb9c4909b2f41b65f6661d09, user_id=5ae5cb1db3504baaba1df93dc154a004, role_id=44620cad10ae407c90c91e2c296adb04)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59744f98-abe9-4096-a52e-98c251e111c5 tempest-ServicesAdminNegativeTest-26282853 tempest-ServicesAdminNegativeTest-26282853-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 853/1728] 10.27.203.238 () {64 vars in 1571 bytes} [Tue May 28 12:57:09 2024] PUT /identity/v3/projects/5f95b12aeb9c4909b2f41b65f6661d09/users/5ae5cb1db3504baaba1df93dc154a004/roles/44620cad10ae407c90c91e2c296adb04 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc850360-065a-4ede-9820-b154d4e3f400 tempest-ServicesAdminNegativeTest-26282853 tempest-ServicesAdminNegativeTest-26282853-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-dc850360-065a-4ede-9820-b154d4e3f400 tempest-ServicesAdminNegativeTest-26282853 tempest-ServicesAdminNegativeTest-26282853-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc850360-065a-4ede-9820-b154d4e3f400 tempest-ServicesAdminNegativeTest-26282853 tempest-ServicesAdminNegativeTest-26282853-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae7f964-9d30-48d4-85f1-640839a00344 service manila] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f110cf6300f049c897d0aab63218d1e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae7f964-9d30-48d4-85f1-640839a00344 service manila] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae7f964-9d30-48d4-85f1-640839a00344 service manila] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae7f964-9d30-48d4-85f1-640839a00344 service manila] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae7f964-9d30-48d4-85f1-640839a00344 service manila] RBAC: Authorizing `identity:validate_token()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae7f964-9d30-48d4-85f1-640839a00344 service manila] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 876/1729] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 12:57:10 2024] GET /identity/v3/auth/tokens => generated 4079 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 12:57:10 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-077a3542-373f-458b-b881-776a2ec99c36 tempest-ServicesAdminNegativeTest-26282853 tempest-ServicesAdminNegativeTest-26282853-project-admin] GET http://10.27.203.238/share/v2/5f95b12aeb9c4909b2f41b65f6661d09/services?binary=fake_binary May 28 12:57:10 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-077a3542-373f-458b-b881-776a2ec99c36 tempest-ServicesAdminNegativeTest-26282853 tempest-ServicesAdminNegativeTest-26282853-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:10 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-077a3542-373f-458b-b881-776a2ec99c36 tempest-ServicesAdminNegativeTest-26282853 tempest-ServicesAdminNegativeTest-26282853-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:10 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-077a3542-373f-458b-b881-776a2ec99c36 tempest-ServicesAdminNegativeTest-26282853 tempest-ServicesAdminNegativeTest-26282853-project-admin] http://10.27.203.238/share/v2/5f95b12aeb9c4909b2f41b65f6661d09/services?binary=fake_binary returned with HTTP 200 May 28 12:57:10 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 231/477] 10.27.203.238 () {64 vars in 1383 bytes} [Tue May 28 12:57:10 2024] GET /share/v2/5f95b12aeb9c4909b2f41b65f6661d09/services?binary=fake_binary => generated 16 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:57:10 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-06a9678a-92a1-4be5-a5e4-a30e6ecc0e25 tempest-ServicesAdminNegativeTest-26282853 tempest-ServicesAdminNegativeTest-26282853-project-admin] GET http://10.27.203.238/share/v2/5f95b12aeb9c4909b2f41b65f6661d09/services?host=fake_host May 28 12:57:10 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-06a9678a-92a1-4be5-a5e4-a30e6ecc0e25 tempest-ServicesAdminNegativeTest-26282853 tempest-ServicesAdminNegativeTest-26282853-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:10 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-06a9678a-92a1-4be5-a5e4-a30e6ecc0e25 tempest-ServicesAdminNegativeTest-26282853 tempest-ServicesAdminNegativeTest-26282853-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:10 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-06a9678a-92a1-4be5-a5e4-a30e6ecc0e25 tempest-ServicesAdminNegativeTest-26282853 tempest-ServicesAdminNegativeTest-26282853-project-admin] http://10.27.203.238/share/v2/5f95b12aeb9c4909b2f41b65f6661d09/services?host=fake_host returned with HTTP 200 May 28 12:57:10 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 247/478] 10.27.203.238 () {64 vars in 1375 bytes} [Tue May 28 12:57:10 2024] GET /share/v2/5f95b12aeb9c4909b2f41b65f6661d09/services?host=fake_host => generated 16 bytes in 20 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:57:10 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-43c3ae38-1bd9-4154-b372-141141c5d986 tempest-ServicesAdminNegativeTest-26282853 tempest-ServicesAdminNegativeTest-26282853-project-admin] GET http://10.27.203.238/share/v2/5f95b12aeb9c4909b2f41b65f6661d09/services May 28 12:57:10 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-43c3ae38-1bd9-4154-b372-141141c5d986 tempest-ServicesAdminNegativeTest-26282853 tempest-ServicesAdminNegativeTest-26282853-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:10 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-43c3ae38-1bd9-4154-b372-141141c5d986 tempest-ServicesAdminNegativeTest-26282853 tempest-ServicesAdminNegativeTest-26282853-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:10 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-43c3ae38-1bd9-4154-b372-141141c5d986 tempest-ServicesAdminNegativeTest-26282853 tempest-ServicesAdminNegativeTest-26282853-project-admin] http://10.27.203.238/share/v2/5f95b12aeb9c4909b2f41b65f6661d09/services returned with HTTP 200 May 28 12:57:10 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 232/479] 10.27.203.238 () {64 vars in 1346 bytes} [Tue May 28 12:57:10 2024] GET /share/v2/5f95b12aeb9c4909b2f41b65f6661d09/services => generated 945 bytes in 16 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:57:10 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-f42e7cd2-a307-4f93-9370-97a2ac673faa tempest-ServicesAdminNegativeTest-26282853 tempest-ServicesAdminNegativeTest-26282853-project-admin] GET http://10.27.203.238/share/v2/5f95b12aeb9c4909b2f41b65f6661d09/services?fake_param=fake_param_value May 28 12:57:10 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-f42e7cd2-a307-4f93-9370-97a2ac673faa tempest-ServicesAdminNegativeTest-26282853 tempest-ServicesAdminNegativeTest-26282853-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:10 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-f42e7cd2-a307-4f93-9370-97a2ac673faa tempest-ServicesAdminNegativeTest-26282853 tempest-ServicesAdminNegativeTest-26282853-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:10 l75lg1-v1 dstat.sh[49771]: 28-05 12:57:10| 10 2 83 4 0|5675M 1826M 277M 7847M| 20k 4140B| 0 6562k| 0 536 |7632 13k|1.59 1.01 1.00|3.0 0 0| 0 0 | 0 2048M| 29 348 0 62 0 May 28 12:57:10 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-f42e7cd2-a307-4f93-9370-97a2ac673faa tempest-ServicesAdminNegativeTest-26282853 tempest-ServicesAdminNegativeTest-26282853-project-admin] http://10.27.203.238/share/v2/5f95b12aeb9c4909b2f41b65f6661d09/services?fake_param=fake_param_value returned with HTTP 200 May 28 12:57:10 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 248/480] 10.27.203.238 () {64 vars in 1401 bytes} [Tue May 28 12:57:10 2024] GET /share/v2/5f95b12aeb9c4909b2f41b65f6661d09/services?fake_param=fake_param_value => generated 945 bytes in 16 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:57:10 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-9cc8ca5a-d94d-4d6f-88b2-9ae6b57d7850 tempest-ServicesAdminNegativeTest-26282853 tempest-ServicesAdminNegativeTest-26282853-project-admin] GET http://10.27.203.238/share/v2/5f95b12aeb9c4909b2f41b65f6661d09/services?state=fake_state May 28 12:57:10 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-9cc8ca5a-d94d-4d6f-88b2-9ae6b57d7850 tempest-ServicesAdminNegativeTest-26282853 tempest-ServicesAdminNegativeTest-26282853-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:10 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-9cc8ca5a-d94d-4d6f-88b2-9ae6b57d7850 tempest-ServicesAdminNegativeTest-26282853 tempest-ServicesAdminNegativeTest-26282853-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:10 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-9cc8ca5a-d94d-4d6f-88b2-9ae6b57d7850 tempest-ServicesAdminNegativeTest-26282853 tempest-ServicesAdminNegativeTest-26282853-project-admin] http://10.27.203.238/share/v2/5f95b12aeb9c4909b2f41b65f6661d09/services?state=fake_state returned with HTTP 200 May 28 12:57:10 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 233/481] 10.27.203.238 () {64 vars in 1379 bytes} [Tue May 28 12:57:10 2024] GET /share/v2/5f95b12aeb9c4909b2f41b65f6661d09/services?state=fake_state => generated 16 bytes in 16 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:57:10 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-c885d704-d786-45ac-8118-08674621750a tempest-ServicesAdminNegativeTest-26282853 tempest-ServicesAdminNegativeTest-26282853-project-admin] GET http://10.27.203.238/share/v2/5f95b12aeb9c4909b2f41b65f6661d09/services?status=fake_status May 28 12:57:10 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-c885d704-d786-45ac-8118-08674621750a tempest-ServicesAdminNegativeTest-26282853 tempest-ServicesAdminNegativeTest-26282853-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:10 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-c885d704-d786-45ac-8118-08674621750a tempest-ServicesAdminNegativeTest-26282853 tempest-ServicesAdminNegativeTest-26282853-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:10 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-c885d704-d786-45ac-8118-08674621750a tempest-ServicesAdminNegativeTest-26282853 tempest-ServicesAdminNegativeTest-26282853-project-admin] http://10.27.203.238/share/v2/5f95b12aeb9c4909b2f41b65f6661d09/services?status=fake_status returned with HTTP 200 May 28 12:57:10 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 249/482] 10.27.203.238 () {64 vars in 1383 bytes} [Tue May 28 12:57:10 2024] GET /share/v2/5f95b12aeb9c4909b2f41b65f6661d09/services?status=fake_status => generated 16 bytes in 15 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:57:10 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-22982021-e98e-47d6-81ae-ec1a85c82b0b tempest-ServicesAdminNegativeTest-26282853 tempest-ServicesAdminNegativeTest-26282853-project-admin] GET http://10.27.203.238/share/v2/5f95b12aeb9c4909b2f41b65f6661d09/services?zone=fake_zone May 28 12:57:10 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-22982021-e98e-47d6-81ae-ec1a85c82b0b tempest-ServicesAdminNegativeTest-26282853 tempest-ServicesAdminNegativeTest-26282853-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:10 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-22982021-e98e-47d6-81ae-ec1a85c82b0b tempest-ServicesAdminNegativeTest-26282853 tempest-ServicesAdminNegativeTest-26282853-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:10 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-22982021-e98e-47d6-81ae-ec1a85c82b0b tempest-ServicesAdminNegativeTest-26282853 tempest-ServicesAdminNegativeTest-26282853-project-admin] http://10.27.203.238/share/v2/5f95b12aeb9c4909b2f41b65f6661d09/services?zone=fake_zone returned with HTTP 200 May 28 12:57:10 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 234/483] 10.27.203.238 () {64 vars in 1375 bytes} [Tue May 28 12:57:10 2024] GET /share/v2/5f95b12aeb9c4909b2f41b65f6661d09/services?zone=fake_zone => generated 16 bytes in 15 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59744f98-abe9-4096-a52e-98c251e111c5 tempest-ServicesAdminNegativeTest-26282853 tempest-ServicesAdminNegativeTest-26282853-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-59744f98-abe9-4096-a52e-98c251e111c5 tempest-ServicesAdminNegativeTest-26282853 tempest-ServicesAdminNegativeTest-26282853-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59744f98-abe9-4096-a52e-98c251e111c5 tempest-ServicesAdminNegativeTest-26282853 tempest-ServicesAdminNegativeTest-26282853-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468318c6-c86b-4aed-b269-4db191015cce service manila] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f110cf6300f049c897d0aab63218d1e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468318c6-c86b-4aed-b269-4db191015cce service manila] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468318c6-c86b-4aed-b269-4db191015cce service manila] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468318c6-c86b-4aed-b269-4db191015cce service manila] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468318c6-c86b-4aed-b269-4db191015cce service manila] RBAC: Authorizing `identity:validate_token()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468318c6-c86b-4aed-b269-4db191015cce service manila] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 854/1730] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 12:57:10 2024] GET /identity/v3/auth/tokens => generated 3960 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 12:57:10 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-90ee3fbd-b93c-4968-b75e-c700822a0f54 tempest-ServicesAdminNegativeTest-1564772150 tempest-ServicesAdminNegativeTest-1564772150-project-member] GET http://10.27.203.238/share/v2/733abeb6b7f14d85930dd7d4da7587f5/services May 28 12:57:10 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-90ee3fbd-b93c-4968-b75e-c700822a0f54 tempest-ServicesAdminNegativeTest-1564772150 tempest-ServicesAdminNegativeTest-1564772150-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:10 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-90ee3fbd-b93c-4968-b75e-c700822a0f54 tempest-ServicesAdminNegativeTest-1564772150 tempest-ServicesAdminNegativeTest-1564772150-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:10 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.policy [None req-90ee3fbd-b93c-4968-b75e-c700822a0f54 tempest-ServicesAdminNegativeTest-1564772150 tempest-ServicesAdminNegativeTest-1564772150-project-member] Policy check for service:index failed with credentials {'is_admin': False, 'user_id': '1088ed2b050844799c3ae6a6d5cc28c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733abeb6b7f14d85930dd7d4da7587f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98329) authorize /opt/stack/manila/manila/policy.py:208}} May 28 12:57:10 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-90ee3fbd-b93c-4968-b75e-c700822a0f54 tempest-ServicesAdminNegativeTest-1564772150 tempest-ServicesAdminNegativeTest-1564772150-project-member] HTTP exception thrown: Access was denied to this resource. May 28 12:57:10 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-90ee3fbd-b93c-4968-b75e-c700822a0f54 tempest-ServicesAdminNegativeTest-1564772150 tempest-ServicesAdminNegativeTest-1564772150-project-member] http://10.27.203.238/share/v2/733abeb6b7f14d85930dd7d4da7587f5/services returned with HTTP 403 May 28 12:57:10 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 250/484] 10.27.203.238 () {64 vars in 1346 bytes} [Tue May 28 12:57:10 2024] GET /share/v2/733abeb6b7f14d85930dd7d4da7587f5/services => generated 78 bytes in 68 msecs (HTTP/1.1 403) 6 headers in 237 bytes (1 switches on core 0) May 28 12:57:10 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-1f5cf3e5-b72f-4a1e-a453-c9f581c5bd2f tempest-ServicesAdminNegativeTest-26282853 tempest-ServicesAdminNegativeTest-26282853-project-admin] GET http://10.27.203.238/share/v2/5f95b12aeb9c4909b2f41b65f6661d09/os-services May 28 12:57:10 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-1f5cf3e5-b72f-4a1e-a453-c9f581c5bd2f tempest-ServicesAdminNegativeTest-26282853 tempest-ServicesAdminNegativeTest-26282853-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:10 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-1f5cf3e5-b72f-4a1e-a453-c9f581c5bd2f tempest-ServicesAdminNegativeTest-26282853 tempest-ServicesAdminNegativeTest-26282853-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:10 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-1f5cf3e5-b72f-4a1e-a453-c9f581c5bd2f tempest-ServicesAdminNegativeTest-26282853 tempest-ServicesAdminNegativeTest-26282853-project-admin] http://10.27.203.238/share/v2/5f95b12aeb9c4909b2f41b65f6661d09/os-services returned with HTTP 404 May 28 12:57:10 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 235/485] 10.27.203.238 () {64 vars in 1354 bytes} [Tue May 28 12:57:10 2024] GET /share/v2/5f95b12aeb9c4909b2f41b65f6661d09/os-services => generated 78 bytes in 5 msecs (HTTP/1.1 404) 6 headers in 236 bytes (1 switches on core 0) May 28 12:57:10 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-70be753a-89b0-4c42-a5fc-b27c2567742a tempest-ServicesAdminNegativeTest-26282853 tempest-ServicesAdminNegativeTest-26282853-project-admin] GET http://10.27.203.238/share/v2/5f95b12aeb9c4909b2f41b65f6661d09/services May 28 12:57:10 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-70be753a-89b0-4c42-a5fc-b27c2567742a tempest-ServicesAdminNegativeTest-26282853 tempest-ServicesAdminNegativeTest-26282853-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:10 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-70be753a-89b0-4c42-a5fc-b27c2567742a tempest-ServicesAdminNegativeTest-26282853 tempest-ServicesAdminNegativeTest-26282853-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:10 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-70be753a-89b0-4c42-a5fc-b27c2567742a tempest-ServicesAdminNegativeTest-26282853 tempest-ServicesAdminNegativeTest-26282853-project-admin] http://10.27.203.238/share/v2/5f95b12aeb9c4909b2f41b65f6661d09/services returned with HTTP 404 May 28 12:57:10 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 251/486] 10.27.203.238 () {64 vars in 1345 bytes} [Tue May 28 12:57:10 2024] GET /share/v2/5f95b12aeb9c4909b2f41b65f6661d09/services => generated 78 bytes in 4 msecs (HTTP/1.1 404) 6 headers in 236 bytes (1 switches on core 0) May 28 12:57:10 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-03c7f1d9-3077-4e31-8b7f-9f6718eec533 tempest-ServicesAdminNegativeTest-26282853 tempest-ServicesAdminNegativeTest-26282853-project-admin] GET http://10.27.203.238/share/v2/5f95b12aeb9c4909b2f41b65f6661d09/services May 28 12:57:10 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-03c7f1d9-3077-4e31-8b7f-9f6718eec533 tempest-ServicesAdminNegativeTest-26282853 tempest-ServicesAdminNegativeTest-26282853-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:10 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-03c7f1d9-3077-4e31-8b7f-9f6718eec533 tempest-ServicesAdminNegativeTest-26282853 tempest-ServicesAdminNegativeTest-26282853-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:10 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-03c7f1d9-3077-4e31-8b7f-9f6718eec533 tempest-ServicesAdminNegativeTest-26282853 tempest-ServicesAdminNegativeTest-26282853-project-admin] http://10.27.203.238/share/v2/5f95b12aeb9c4909b2f41b65f6661d09/services returned with HTTP 404 May 28 12:57:10 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 236/487] 10.27.203.238 () {64 vars in 1345 bytes} [Tue May 28 12:57:10 2024] GET /share/v2/5f95b12aeb9c4909b2f41b65f6661d09/services => generated 78 bytes in 5 msecs (HTTP/1.1 404) 6 headers in 236 bytes (1 switches on core 0) May 28 12:57:10 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-eeade190-48a4-4e98-ba6e-dc30e46ebb57 tempest-AdminActionsTest-1749172189 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae7f964-9d30-48d4-85f1-640839a00344 service manila] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:10 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-eeade190-48a4-4e98-ba6e-dc30e46ebb57 tempest-AdminActionsTest-1749172189 None] [Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=0, created='2024-05-28T12:56:55.010324Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='78ebe432-5e30-44de-a9b6-ff1e3ef31f8c', id=13, internal=False, is_s3_default_policy=False, name='4016fe10-12f4-48fc-92de-42cdd2fff998', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=[], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['*'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['*'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T12:56:55.390912Z', tenant_id=1, tenant_name='default', title='4016fe10-12f4-48fc-92de-42cdd2fff998', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/13/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[])] May 28 12:57:10 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-eeade190-48a4-4e98-ba6e-dc30e46ebb57 tempest-AdminActionsTest-1749172189 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 12:57:10 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-eeade190-48a4-4e98-ba6e-dc30e46ebb57 tempest-AdminActionsTest-1749172189 None] >>> [DELETE] https://127.0.0.1:40443/api/viewpolicies/13/ May 28 12:57:10 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bbf758da-a5e5-4efa-9481-28cdc0a18883 tempest-AccessRulesMetadataTest-1973590610 None] <<< [DELETE] https://127.0.0.1:40443/api/quotas/6/ May 28 12:57:10 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bbf758da-a5e5-4efa-9481-28cdc0a18883 tempest-AccessRulesMetadataTest-1973590610 None] --- [DELETE] https://127.0.0.1:40443/api/quotas/6/: Done May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae7f964-9d30-48d4-85f1-640839a00344 service manila] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:10 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bbf758da-a5e5-4efa-9481-28cdc0a18883 tempest-AccessRulesMetadataTest-1973590610 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:57:10 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bbf758da-a5e5-4efa-9481-28cdc0a18883 tempest-AccessRulesMetadataTest-1973590610 None] {'allow_redirects': True, May 28 12:57:10 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bbf758da-a5e5-4efa-9481-28cdc0a18883 tempest-AccessRulesMetadataTest-1973590610 None] 'params': {'name': '95118a75-173c-4257-acef-78a246ee1c67'}} May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d25526-3017-4616-b0d5-0d251654347e tempest-ServicesAdminNegativeTest-26282853 tempest-ServicesAdminNegativeTest-26282853-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12120209f6fe4bd29179faf1b6c6719a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f95b12aeb9c4909b2f41b65f6661d09', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d25526-3017-4616-b0d5-0d251654347e tempest-ServicesAdminNegativeTest-26282853 tempest-ServicesAdminNegativeTest-26282853-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d25526-3017-4616-b0d5-0d251654347e tempest-ServicesAdminNegativeTest-26282853 tempest-ServicesAdminNegativeTest-26282853-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d25526-3017-4616-b0d5-0d251654347e tempest-ServicesAdminNegativeTest-26282853 tempest-ServicesAdminNegativeTest-26282853-project-admin] PATH_INFO: `/v3/users/8688f80695814f34bfb56342c4e54028` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d25526-3017-4616-b0d5-0d251654347e tempest-ServicesAdminNegativeTest-26282853 tempest-ServicesAdminNegativeTest-26282853-project-admin] RBAC: Authorizing `identity:delete_user(user_id=8688f80695814f34bfb56342c4e54028)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d25526-3017-4616-b0d5-0d251654347e tempest-ServicesAdminNegativeTest-26282853 tempest-ServicesAdminNegativeTest-26282853-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-16d25526-3017-4616-b0d5-0d251654347e tempest-ServicesAdminNegativeTest-26282853 tempest-ServicesAdminNegativeTest-26282853-project-admin] Could not find user: 8688f80695814f34bfb56342c4e54028.: keystone.exception.UserNotFound: Could not find user: 8688f80695814f34bfb56342c4e54028. May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 8688f80695814f34bfb56342c4e54028. May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 877/1731] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 12:57:10 2024] DELETE /identity/v3/users/8688f80695814f34bfb56342c4e54028 => generated 110 bytes in 26 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468318c6-c86b-4aed-b269-4db191015cce service manila] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468318c6-c86b-4aed-b269-4db191015cce service manila] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be3771d-70a7-42a1-8131-0fd522aede05 tempest-ServicesAdminNegativeTest-26282853 tempest-ServicesAdminNegativeTest-26282853-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12120209f6fe4bd29179faf1b6c6719a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f95b12aeb9c4909b2f41b65f6661d09', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be3771d-70a7-42a1-8131-0fd522aede05 tempest-ServicesAdminNegativeTest-26282853 tempest-ServicesAdminNegativeTest-26282853-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be3771d-70a7-42a1-8131-0fd522aede05 tempest-ServicesAdminNegativeTest-26282853 tempest-ServicesAdminNegativeTest-26282853-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be3771d-70a7-42a1-8131-0fd522aede05 tempest-ServicesAdminNegativeTest-26282853 tempest-ServicesAdminNegativeTest-26282853-project-admin] PATH_INFO: `/v3/users/108a25e436e9452a9a865957dcea1fc5` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be3771d-70a7-42a1-8131-0fd522aede05 tempest-ServicesAdminNegativeTest-26282853 tempest-ServicesAdminNegativeTest-26282853-project-admin] RBAC: Authorizing `identity:delete_user(user_id=108a25e436e9452a9a865957dcea1fc5)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be3771d-70a7-42a1-8131-0fd522aede05 tempest-ServicesAdminNegativeTest-26282853 tempest-ServicesAdminNegativeTest-26282853-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-2be3771d-70a7-42a1-8131-0fd522aede05 tempest-ServicesAdminNegativeTest-26282853 tempest-ServicesAdminNegativeTest-26282853-project-admin] Could not find user: 108a25e436e9452a9a865957dcea1fc5.: keystone.exception.UserNotFound: Could not find user: 108a25e436e9452a9a865957dcea1fc5. May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 108a25e436e9452a9a865957dcea1fc5. May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 855/1732] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 12:57:10 2024] DELETE /identity/v3/users/108a25e436e9452a9a865957dcea1fc5 => generated 110 bytes in 25 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d25526-3017-4616-b0d5-0d251654347e tempest-ServicesAdminNegativeTest-26282853 tempest-ServicesAdminNegativeTest-26282853-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d25526-3017-4616-b0d5-0d251654347e tempest-ServicesAdminNegativeTest-26282853 tempest-ServicesAdminNegativeTest-26282853-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848d06cf-a5ba-4fc0-bbc3-f7f186e2399a tempest-ServicesAdminNegativeTest-26282853 tempest-ServicesAdminNegativeTest-26282853-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12120209f6fe4bd29179faf1b6c6719a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f95b12aeb9c4909b2f41b65f6661d09', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848d06cf-a5ba-4fc0-bbc3-f7f186e2399a tempest-ServicesAdminNegativeTest-26282853 tempest-ServicesAdminNegativeTest-26282853-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848d06cf-a5ba-4fc0-bbc3-f7f186e2399a tempest-ServicesAdminNegativeTest-26282853 tempest-ServicesAdminNegativeTest-26282853-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848d06cf-a5ba-4fc0-bbc3-f7f186e2399a tempest-ServicesAdminNegativeTest-26282853 tempest-ServicesAdminNegativeTest-26282853-project-admin] PATH_INFO: `/v3/users/5ae5cb1db3504baaba1df93dc154a004` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848d06cf-a5ba-4fc0-bbc3-f7f186e2399a tempest-ServicesAdminNegativeTest-26282853 tempest-ServicesAdminNegativeTest-26282853-project-admin] RBAC: Authorizing `identity:delete_user(user_id=5ae5cb1db3504baaba1df93dc154a004)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848d06cf-a5ba-4fc0-bbc3-f7f186e2399a tempest-ServicesAdminNegativeTest-26282853 tempest-ServicesAdminNegativeTest-26282853-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-848d06cf-a5ba-4fc0-bbc3-f7f186e2399a tempest-ServicesAdminNegativeTest-26282853 tempest-ServicesAdminNegativeTest-26282853-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ae5cb1db3504baaba1df93dc154a004', 'request_id': 'req-848d06cf-a5ba-4fc0-bbc3-f7f186e2399a'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-848d06cf-a5ba-4fc0-bbc3-f7f186e2399a tempest-ServicesAdminNegativeTest-26282853 tempest-ServicesAdminNegativeTest-26282853-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ae5cb1db3504baaba1df93dc154a004', 'request_id': 'req-848d06cf-a5ba-4fc0-bbc3-f7f186e2399a'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-848d06cf-a5ba-4fc0-bbc3-f7f186e2399a tempest-ServicesAdminNegativeTest-26282853 tempest-ServicesAdminNegativeTest-26282853-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ae5cb1db3504baaba1df93dc154a004', 'request_id': 'req-848d06cf-a5ba-4fc0-bbc3-f7f186e2399a'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-848d06cf-a5ba-4fc0-bbc3-f7f186e2399a tempest-ServicesAdminNegativeTest-26282853 tempest-ServicesAdminNegativeTest-26282853-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ae5cb1db3504baaba1df93dc154a004', 'request_id': 'req-848d06cf-a5ba-4fc0-bbc3-f7f186e2399a'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-848d06cf-a5ba-4fc0-bbc3-f7f186e2399a tempest-ServicesAdminNegativeTest-26282853 tempest-ServicesAdminNegativeTest-26282853-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ae5cb1db3504baaba1df93dc154a004', 'request_id': 'req-848d06cf-a5ba-4fc0-bbc3-f7f186e2399a'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 878/1733] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 12:57:10 2024] DELETE /identity/v3/users/5ae5cb1db3504baaba1df93dc154a004 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be3771d-70a7-42a1-8131-0fd522aede05 tempest-ServicesAdminNegativeTest-26282853 tempest-ServicesAdminNegativeTest-26282853-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-2be3771d-70a7-42a1-8131-0fd522aede05 tempest-ServicesAdminNegativeTest-26282853 tempest-ServicesAdminNegativeTest-26282853-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be3771d-70a7-42a1-8131-0fd522aede05 tempest-ServicesAdminNegativeTest-26282853 tempest-ServicesAdminNegativeTest-26282853-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a4df9c-38a9-4b6e-999a-e65c71533dd8 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a4df9c-38a9-4b6e-999a-e65c71533dd8 None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a4df9c-38a9-4b6e-999a-e65c71533dd8 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a4df9c-38a9-4b6e-999a-e65c71533dd8 None admin] PATH_INFO: `/v3/users/1088ed2b050844799c3ae6a6d5cc28c8` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a4df9c-38a9-4b6e-999a-e65c71533dd8 None admin] RBAC: Authorizing `identity:delete_user(user_id=1088ed2b050844799c3ae6a6d5cc28c8)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a4df9c-38a9-4b6e-999a-e65c71533dd8 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-c0a4df9c-38a9-4b6e-999a-e65c71533dd8 None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1088ed2b050844799c3ae6a6d5cc28c8', 'request_id': 'req-c0a4df9c-38a9-4b6e-999a-e65c71533dd8'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-c0a4df9c-38a9-4b6e-999a-e65c71533dd8 None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1088ed2b050844799c3ae6a6d5cc28c8', 'request_id': 'req-c0a4df9c-38a9-4b6e-999a-e65c71533dd8'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-c0a4df9c-38a9-4b6e-999a-e65c71533dd8 None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1088ed2b050844799c3ae6a6d5cc28c8', 'request_id': 'req-c0a4df9c-38a9-4b6e-999a-e65c71533dd8'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-c0a4df9c-38a9-4b6e-999a-e65c71533dd8 None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1088ed2b050844799c3ae6a6d5cc28c8', 'request_id': 'req-c0a4df9c-38a9-4b6e-999a-e65c71533dd8'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-c0a4df9c-38a9-4b6e-999a-e65c71533dd8 None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1088ed2b050844799c3ae6a6d5cc28c8', 'request_id': 'req-c0a4df9c-38a9-4b6e-999a-e65c71533dd8'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 856/1734] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 12:57:10 2024] DELETE /identity/v3/users/1088ed2b050844799c3ae6a6d5cc28c8 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848d06cf-a5ba-4fc0-bbc3-f7f186e2399a tempest-ServicesAdminNegativeTest-26282853 tempest-ServicesAdminNegativeTest-26282853-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848d06cf-a5ba-4fc0-bbc3-f7f186e2399a tempest-ServicesAdminNegativeTest-26282853 tempest-ServicesAdminNegativeTest-26282853-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e237d5-2989-4d45-adfa-d453a0aa1a9b None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e237d5-2989-4d45-adfa-d453a0aa1a9b None admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e237d5-2989-4d45-adfa-d453a0aa1a9b None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e237d5-2989-4d45-adfa-d453a0aa1a9b None admin] PATH_INFO: `/v3/users/d1c265944d944e65bb8d3eb50a476c3d` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e237d5-2989-4d45-adfa-d453a0aa1a9b None admin] RBAC: Authorizing `identity:delete_user(user_id=d1c265944d944e65bb8d3eb50a476c3d)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e237d5-2989-4d45-adfa-d453a0aa1a9b None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-69e237d5-2989-4d45-adfa-d453a0aa1a9b None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1c265944d944e65bb8d3eb50a476c3d', 'request_id': 'req-69e237d5-2989-4d45-adfa-d453a0aa1a9b'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:10 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bbf758da-a5e5-4efa-9481-28cdc0a18883 tempest-AccessRulesMetadataTest-1973590610 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:57:10 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bbf758da-a5e5-4efa-9481-28cdc0a18883 tempest-AccessRulesMetadataTest-1973590610 None] [Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=0, created='2024-05-28T12:56:41.381687Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='8ed5f8f5-e848-431c-be27-16f1fa370a60', id=9, internal=False, is_s3_default_policy=False, name='95118a75-173c-4257-acef-78a246ee1c67', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=[], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['*'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['*'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T12:56:41.744950Z', tenant_id=1, tenant_name='default', title='95118a75-173c-4257-acef-78a246ee1c67', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/9/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[])] May 28 12:57:10 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bbf758da-a5e5-4efa-9481-28cdc0a18883 tempest-AccessRulesMetadataTest-1973590610 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 12:57:10 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bbf758da-a5e5-4efa-9481-28cdc0a18883 tempest-AccessRulesMetadataTest-1973590610 None] >>> [DELETE] https://127.0.0.1:40443/api/viewpolicies/9/ May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-69e237d5-2989-4d45-adfa-d453a0aa1a9b None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1c265944d944e65bb8d3eb50a476c3d', 'request_id': 'req-69e237d5-2989-4d45-adfa-d453a0aa1a9b'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-69e237d5-2989-4d45-adfa-d453a0aa1a9b None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1c265944d944e65bb8d3eb50a476c3d', 'request_id': 'req-69e237d5-2989-4d45-adfa-d453a0aa1a9b'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-69e237d5-2989-4d45-adfa-d453a0aa1a9b None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1c265944d944e65bb8d3eb50a476c3d', 'request_id': 'req-69e237d5-2989-4d45-adfa-d453a0aa1a9b'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-69e237d5-2989-4d45-adfa-d453a0aa1a9b None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1c265944d944e65bb8d3eb50a476c3d', 'request_id': 'req-69e237d5-2989-4d45-adfa-d453a0aa1a9b'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 879/1735] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 12:57:10 2024] DELETE /identity/v3/users/d1c265944d944e65bb8d3eb50a476c3d => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a4df9c-38a9-4b6e-999a-e65c71533dd8 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-c0a4df9c-38a9-4b6e-999a-e65c71533dd8 None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a4df9c-38a9-4b6e-999a-e65c71533dd8 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2393f5-473b-475c-b8c8-acd4709fb08a None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2393f5-473b-475c-b8c8-acd4709fb08a None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2393f5-473b-475c-b8c8-acd4709fb08a None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2393f5-473b-475c-b8c8-acd4709fb08a None admin] PATH_INFO: `/v3/users/12120209f6fe4bd29179faf1b6c6719a` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2393f5-473b-475c-b8c8-acd4709fb08a None admin] RBAC: Authorizing `identity:delete_user(user_id=12120209f6fe4bd29179faf1b6c6719a)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2393f5-473b-475c-b8c8-acd4709fb08a None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-ff2393f5-473b-475c-b8c8-acd4709fb08a None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12120209f6fe4bd29179faf1b6c6719a', 'request_id': 'req-ff2393f5-473b-475c-b8c8-acd4709fb08a'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-ff2393f5-473b-475c-b8c8-acd4709fb08a None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12120209f6fe4bd29179faf1b6c6719a', 'request_id': 'req-ff2393f5-473b-475c-b8c8-acd4709fb08a'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-ff2393f5-473b-475c-b8c8-acd4709fb08a None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12120209f6fe4bd29179faf1b6c6719a', 'request_id': 'req-ff2393f5-473b-475c-b8c8-acd4709fb08a'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-ff2393f5-473b-475c-b8c8-acd4709fb08a None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12120209f6fe4bd29179faf1b6c6719a', 'request_id': 'req-ff2393f5-473b-475c-b8c8-acd4709fb08a'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-ff2393f5-473b-475c-b8c8-acd4709fb08a None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12120209f6fe4bd29179faf1b6c6719a', 'request_id': 'req-ff2393f5-473b-475c-b8c8-acd4709fb08a'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 857/1736] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 12:57:10 2024] DELETE /identity/v3/users/12120209f6fe4bd29179faf1b6c6719a => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd70b0dc-98f8-4a66-997d-acef05aaaf8a None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd70b0dc-98f8-4a66-997d-acef05aaaf8a None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd70b0dc-98f8-4a66-997d-acef05aaaf8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-dd70b0dc-98f8-4a66-997d-acef05aaaf8a None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-dd70b0dc-98f8-4a66-997d-acef05aaaf8a None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-dd70b0dc-98f8-4a66-997d-acef05aaaf8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 880/1737] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:57:10 2024] POST /identity/v3/auth/tokens => generated 2960 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 12:57:10 l75lg1-v1 neutron-server[77618]: DEBUG neutron.wsgi [-] (77618) accepted ('10.27.203.238', 58584) {{(pid=77618) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 12:57:10 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2393f5-473b-475c-b8c8-acd4709fb08a None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-ff2393f5-473b-475c-b8c8-acd4709fb08a None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2393f5-473b-475c-b8c8-acd4709fb08a None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18138e69-bf4c-4ae9-a3e4-b67d1adeed2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef17047035e4b518fd5360a01f2da1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18138e69-bf4c-4ae9-a3e4-b67d1adeed2e service neutron] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18138e69-bf4c-4ae9-a3e4-b67d1adeed2e service neutron] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18138e69-bf4c-4ae9-a3e4-b67d1adeed2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18138e69-bf4c-4ae9-a3e4-b67d1adeed2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18138e69-bf4c-4ae9-a3e4-b67d1adeed2e service neutron] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 858/1738] 10.27.203.238 () {64 vars in 1432 bytes} [Tue May 28 12:57:10 2024] GET /identity/v3/auth/tokens => generated 2960 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 28 12:57:11 l75lg1-v1 cinder-scheduler[85128]: DEBUG dbcounter [-] [85128] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=85128) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:57:11 l75lg1-v1 neutron-server[77618]: INFO neutron.wsgi [None req-ecc1c13b-8ed1-4f0d-b35b-d76aa8d32f1c None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=733abeb6b7f14d85930dd7d4da7587f5&name=default HTTP/1.1" status: 200 len: 216 time: 0.0738931 May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd70b0dc-98f8-4a66-997d-acef05aaaf8a None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-dd70b0dc-98f8-4a66-997d-acef05aaaf8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd70b0dc-98f8-4a66-997d-acef05aaaf8a None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283dea2a-d507-4288-8681-508a9d8668ae None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283dea2a-d507-4288-8681-508a9d8668ae None admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283dea2a-d507-4288-8681-508a9d8668ae None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283dea2a-d507-4288-8681-508a9d8668ae None admin] PATH_INFO: `/v3/projects/733abeb6b7f14d85930dd7d4da7587f5` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283dea2a-d507-4288-8681-508a9d8668ae None admin] RBAC: Authorizing `identity:delete_project(project_id=733abeb6b7f14d85930dd7d4da7587f5)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283dea2a-d507-4288-8681-508a9d8668ae None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:11 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-c357155d-baf2-4dcd-9653-06e61ced25e2 tempest-ShareInstancesNegativeTest-210953919 tempest-ShareInstancesNegativeTest-210953919-project-admin] GET http://10.27.203.238/share/v2/bb8f0d37fc204d24b8146108f63a1922/shares/6b055a82-f6ad-4af2-8b38-137b3cc99cc1 May 28 12:57:11 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-c357155d-baf2-4dcd-9653-06e61ced25e2 tempest-ShareInstancesNegativeTest-210953919 tempest-ShareInstancesNegativeTest-210953919-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:11 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-c357155d-baf2-4dcd-9653-06e61ced25e2 tempest-ShareInstancesNegativeTest-210953919 tempest-ShareInstancesNegativeTest-210953919-project-admin] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:11 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-c357155d-baf2-4dcd-9653-06e61ced25e2 tempest-ShareInstancesNegativeTest-210953919 tempest-ShareInstancesNegativeTest-210953919-project-admin] HTTP exception thrown: The resource could not be found. May 28 12:57:11 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-c357155d-baf2-4dcd-9653-06e61ced25e2 tempest-ShareInstancesNegativeTest-210953919 tempest-ShareInstancesNegativeTest-210953919-project-admin] http://10.27.203.238/share/v2/bb8f0d37fc204d24b8146108f63a1922/shares/6b055a82-f6ad-4af2-8b38-137b3cc99cc1 returned with HTTP 404 May 28 12:57:11 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 252/488] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:57:11 2024] GET /share/v2/bb8f0d37fc204d24b8146108f63a1922/shares/6b055a82-f6ad-4af2-8b38-137b3cc99cc1 => generated 78 bytes in 12 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 12:57:11 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-05180418-14be-47d3-93db-a1a5da2ac928 tempest-ShareInstancesNegativeTest-210953919 tempest-ShareInstancesNegativeTest-210953919-project-admin] DELETE http://10.27.203.238/share/v2/bb8f0d37fc204d24b8146108f63a1922/types/cebb6aed-3720-45a4-84fe-d21cb838f20a May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-283dea2a-d507-4288-8681-508a9d8668ae None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '733abeb6b7f14d85930dd7d4da7587f5', 'request_id': 'req-283dea2a-d507-4288-8681-508a9d8668ae'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:11 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-05180418-14be-47d3-93db-a1a5da2ac928 tempest-ShareInstancesNegativeTest-210953919 tempest-ShareInstancesNegativeTest-210953919-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:11 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-05180418-14be-47d3-93db-a1a5da2ac928 tempest-ShareInstancesNegativeTest-210953919 tempest-ShareInstancesNegativeTest-210953919-project-admin] Calling method 'ShareTypesController._delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-283dea2a-d507-4288-8681-508a9d8668ae None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '733abeb6b7f14d85930dd7d4da7587f5', 'request_id': 'req-283dea2a-d507-4288-8681-508a9d8668ae'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-283dea2a-d507-4288-8681-508a9d8668ae None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '733abeb6b7f14d85930dd7d4da7587f5', 'request_id': 'req-283dea2a-d507-4288-8681-508a9d8668ae'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-283dea2a-d507-4288-8681-508a9d8668ae None admin] The token cache is being invalidate because project 733abeb6b7f14d85930dd7d4da7587f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-283dea2a-d507-4288-8681-508a9d8668ae None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-283dea2a-d507-4288-8681-508a9d8668ae None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 881/1739] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 12:57:11 2024] DELETE /identity/v3/projects/733abeb6b7f14d85930dd7d4da7587f5 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:57:11 l75lg1-v1 neutron-server[77619]: DEBUG neutron.wsgi [-] (77619) accepted ('10.27.203.238', 58588) {{(pid=77619) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 12:57:11 l75lg1-v1 neutron-server[77619]: INFO neutron.wsgi [None req-4a6bb6d3-6833-4ba2-a778-f528adae3cb9 None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=989392199c1c4c7ca95fcdecce7ed757&name=default HTTP/1.1" status: 200 len: 216 time: 0.0086162 May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18138e69-bf4c-4ae9-a3e4-b67d1adeed2e service neutron] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:11 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-05180418-14be-47d3-93db-a1a5da2ac928 tempest-ShareInstancesNegativeTest-210953919 tempest-ShareInstancesNegativeTest-210953919-project-admin] http://10.27.203.238/share/v2/bb8f0d37fc204d24b8146108f63a1922/types/cebb6aed-3720-45a4-84fe-d21cb838f20a returned with HTTP 202 May 28 12:57:11 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 237/489] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:57:11 2024] DELETE /share/v2/bb8f0d37fc204d24b8146108f63a1922/types/cebb6aed-3720-45a4-84fe-d21cb838f20a => generated 0 bytes in 48 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18138e69-bf4c-4ae9-a3e4-b67d1adeed2e service neutron] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:11 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-97533012-84f4-41dd-a578-19dbfdcd6fa3 tempest-ShareInstancesNegativeTest-210953919 tempest-ShareInstancesNegativeTest-210953919-project-admin] GET http://10.27.203.238/share/v2/bb8f0d37fc204d24b8146108f63a1922/types/cebb6aed-3720-45a4-84fe-d21cb838f20a May 28 12:57:11 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-97533012-84f4-41dd-a578-19dbfdcd6fa3 tempest-ShareInstancesNegativeTest-210953919 tempest-ShareInstancesNegativeTest-210953919-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:11 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-97533012-84f4-41dd-a578-19dbfdcd6fa3 tempest-ShareInstancesNegativeTest-210953919 tempest-ShareInstancesNegativeTest-210953919-project-admin] Calling method 'ShareTypesController.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:11 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-97533012-84f4-41dd-a578-19dbfdcd6fa3 tempest-ShareInstancesNegativeTest-210953919 tempest-ShareInstancesNegativeTest-210953919-project-admin] HTTP exception thrown: Share type not found. May 28 12:57:11 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-97533012-84f4-41dd-a578-19dbfdcd6fa3 tempest-ShareInstancesNegativeTest-210953919 tempest-ShareInstancesNegativeTest-210953919-project-admin] http://10.27.203.238/share/v2/bb8f0d37fc204d24b8146108f63a1922/types/cebb6aed-3720-45a4-84fe-d21cb838f20a returned with HTTP 404 May 28 12:57:11 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 253/490] 10.27.203.238 () {64 vars in 1448 bytes} [Tue May 28 12:57:11 2024] GET /share/v2/bb8f0d37fc204d24b8146108f63a1922/types/cebb6aed-3720-45a4-84fe-d21cb838f20a => generated 67 bytes in 10 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283dea2a-d507-4288-8681-508a9d8668ae None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-283dea2a-d507-4288-8681-508a9d8668ae None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a773a657-3dc3-434b-8984-d53396364ac1 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a773a657-3dc3-434b-8984-d53396364ac1 None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a773a657-3dc3-434b-8984-d53396364ac1 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a773a657-3dc3-434b-8984-d53396364ac1 None admin] PATH_INFO: `/v3/projects/989392199c1c4c7ca95fcdecce7ed757` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a773a657-3dc3-434b-8984-d53396364ac1 None admin] RBAC: Authorizing `identity:delete_project(project_id=989392199c1c4c7ca95fcdecce7ed757)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:11 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-7e081b81-135c-47a7-9bfa-2207e386d60b tempest-ShareTypesAdminTest-216868925 None] <<< [DELETE] https://127.0.0.1:40443/api/viewpolicies/12/ May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a773a657-3dc3-434b-8984-d53396364ac1 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:11 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-7e081b81-135c-47a7-9bfa-2207e386d60b tempest-ShareTypesAdminTest-216868925 None] --- [DELETE] https://127.0.0.1:40443/api/viewpolicies/12/: Done May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283dea2a-d507-4288-8681-508a9d8668ae None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760908f6-2af0-4402-a9c7-b9ba44e90820 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760908f6-2af0-4402-a9c7-b9ba44e90820 None admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760908f6-2af0-4402-a9c7-b9ba44e90820 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760908f6-2af0-4402-a9c7-b9ba44e90820 None admin] PATH_INFO: `/v3/users/2e437fa55aef49da85172b192169da34` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760908f6-2af0-4402-a9c7-b9ba44e90820 None admin] RBAC: Authorizing `identity:delete_user(user_id=2e437fa55aef49da85172b192169da34)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760908f6-2af0-4402-a9c7-b9ba44e90820 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:11 l75lg1-v1 dstat.sh[49771]: 28-05 12:57:11| 10 1 84 3 0|5675M 1826M 277M 7848M| 17k 12k| 0 1969k| 0 275 |8145 14k|1.59 1.01 1.00|1.0 1.0 0| 0 0 | 0 2048M| 29 349 0 60 0 May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-a773a657-3dc3-434b-8984-d53396364ac1 None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '989392199c1c4c7ca95fcdecce7ed757', 'request_id': 'req-a773a657-3dc3-434b-8984-d53396364ac1'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-a773a657-3dc3-434b-8984-d53396364ac1 None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '989392199c1c4c7ca95fcdecce7ed757', 'request_id': 'req-a773a657-3dc3-434b-8984-d53396364ac1'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-a773a657-3dc3-434b-8984-d53396364ac1 None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '989392199c1c4c7ca95fcdecce7ed757', 'request_id': 'req-a773a657-3dc3-434b-8984-d53396364ac1'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-a773a657-3dc3-434b-8984-d53396364ac1 None admin] The token cache is being invalidate because project 989392199c1c4c7ca95fcdecce7ed757 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-a773a657-3dc3-434b-8984-d53396364ac1 None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-a773a657-3dc3-434b-8984-d53396364ac1 None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 859/1740] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 12:57:11 2024] DELETE /identity/v3/projects/989392199c1c4c7ca95fcdecce7ed757 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:57:11 l75lg1-v1 neutron-server[77618]: DEBUG neutron.wsgi [-] (77618) accepted ('10.27.203.238', 58604) {{(pid=77618) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 12:57:11 l75lg1-v1 neutron-server[77618]: INFO neutron.wsgi [None req-622e2cb5-94c9-40c3-a87f-4a09b6ee1483 None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=5f95b12aeb9c4909b2f41b65f6661d09&name=default HTTP/1.1" status: 200 len: 216 time: 0.0084896 May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a773a657-3dc3-434b-8984-d53396364ac1 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-a773a657-3dc3-434b-8984-d53396364ac1 None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-760908f6-2af0-4402-a9c7-b9ba44e90820 None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e437fa55aef49da85172b192169da34', 'request_id': 'req-760908f6-2af0-4402-a9c7-b9ba44e90820'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-760908f6-2af0-4402-a9c7-b9ba44e90820 None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e437fa55aef49da85172b192169da34', 'request_id': 'req-760908f6-2af0-4402-a9c7-b9ba44e90820'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-760908f6-2af0-4402-a9c7-b9ba44e90820 None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e437fa55aef49da85172b192169da34', 'request_id': 'req-760908f6-2af0-4402-a9c7-b9ba44e90820'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-760908f6-2af0-4402-a9c7-b9ba44e90820 None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e437fa55aef49da85172b192169da34', 'request_id': 'req-760908f6-2af0-4402-a9c7-b9ba44e90820'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:11 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-7e081b81-135c-47a7-9bfa-2207e386d60b tempest-ShareTypesAdminTest-216868925 None] Created reservations ['4041a7f7-459b-4069-83aa-befe6a1ade57', 'e492c77e-339b-468d-a69b-7b9456a8838e', 'cc6184a3-6882-46e4-8dc7-b5b6ffb2908b', 'f991c9d6-dace-4007-9cee-e4b4421ffce9'] {{(pid=98474) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a773a657-3dc3-434b-8984-d53396364ac1 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-760908f6-2af0-4402-a9c7-b9ba44e90820 None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e437fa55aef49da85172b192169da34', 'request_id': 'req-760908f6-2af0-4402-a9c7-b9ba44e90820'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:11 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-7e081b81-135c-47a7-9bfa-2207e386d60b tempest-ShareTypesAdminTest-216868925 None] Committed reservations ['4041a7f7-459b-4069-83aa-befe6a1ade57', 'e492c77e-339b-468d-a69b-7b9456a8838e', 'cc6184a3-6882-46e4-8dc7-b5b6ffb2908b', 'f991c9d6-dace-4007-9cee-e4b4421ffce9'] {{(pid=98474) commit /opt/stack/manila/manila/quota.py:1063}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baed745-887c-48cd-9aa0-bf99705916ed None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baed745-887c-48cd-9aa0-bf99705916ed None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baed745-887c-48cd-9aa0-bf99705916ed None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baed745-887c-48cd-9aa0-bf99705916ed None admin] PATH_INFO: `/v3/projects/5f95b12aeb9c4909b2f41b65f6661d09` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baed745-887c-48cd-9aa0-bf99705916ed None admin] RBAC: Authorizing `identity:delete_project(project_id=5f95b12aeb9c4909b2f41b65f6661d09)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baed745-887c-48cd-9aa0-bf99705916ed None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 882/1741] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 12:57:11 2024] DELETE /identity/v3/users/2e437fa55aef49da85172b192169da34 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 28 12:57:11 l75lg1-v1 manila-share[98474]: INFO manila.share.manager [None req-7e081b81-135c-47a7-9bfa-2207e386d60b tempest-ShareTypesAdminTest-216868925 None] Share instance 4e77e600-5df2-4310-91eb-8d6633f53ce4: deleted successfully. May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e783a2b-e26a-4327-9ee7-4f3e981916b6 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e783a2b-e26a-4327-9ee7-4f3e981916b6 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e783a2b-e26a-4327-9ee7-4f3e981916b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-3e783a2b-e26a-4327-9ee7-4f3e981916b6 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-3e783a2b-e26a-4327-9ee7-4f3e981916b6 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-3e783a2b-e26a-4327-9ee7-4f3e981916b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-0baed745-887c-48cd-9aa0-bf99705916ed None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f95b12aeb9c4909b2f41b65f6661d09', 'request_id': 'req-0baed745-887c-48cd-9aa0-bf99705916ed'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-0baed745-887c-48cd-9aa0-bf99705916ed None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f95b12aeb9c4909b2f41b65f6661d09', 'request_id': 'req-0baed745-887c-48cd-9aa0-bf99705916ed'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 883/1742] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:57:11 2024] POST /identity/v3/auth/tokens => generated 2960 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 12:57:11 l75lg1-v1 neutron-server[77619]: DEBUG neutron.wsgi [-] (77619) accepted ('10.27.203.238', 58612) {{(pid=77619) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e783a2b-e26a-4327-9ee7-4f3e981916b6 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-3e783a2b-e26a-4327-9ee7-4f3e981916b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-0baed745-887c-48cd-9aa0-bf99705916ed None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f95b12aeb9c4909b2f41b65f6661d09', 'request_id': 'req-0baed745-887c-48cd-9aa0-bf99705916ed'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-0baed745-887c-48cd-9aa0-bf99705916ed None admin] The token cache is being invalidate because project 5f95b12aeb9c4909b2f41b65f6661d09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-0baed745-887c-48cd-9aa0-bf99705916ed None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-0baed745-887c-48cd-9aa0-bf99705916ed None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 860/1743] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 12:57:11 2024] DELETE /identity/v3/projects/5f95b12aeb9c4909b2f41b65f6661d09 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163e2f99-14ae-46c8-8710-5e6f102b88b8 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163e2f99-14ae-46c8-8710-5e6f102b88b8 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163e2f99-14ae-46c8-8710-5e6f102b88b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-163e2f99-14ae-46c8-8710-5e6f102b88b8 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-163e2f99-14ae-46c8-8710-5e6f102b88b8 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-163e2f99-14ae-46c8-8710-5e6f102b88b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e783a2b-e26a-4327-9ee7-4f3e981916b6 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 861/1744] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:57:11 2024] POST /identity/v3/auth/tokens => generated 312 bytes in 25 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ce7c03-6fbf-40ba-a330-9bbb77cef903 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ce7c03-6fbf-40ba-a330-9bbb77cef903 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ce7c03-6fbf-40ba-a330-9bbb77cef903 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-b9ce7c03-6fbf-40ba-a330-9bbb77cef903 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-b9ce7c03-6fbf-40ba-a330-9bbb77cef903 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-b9ce7c03-6fbf-40ba-a330-9bbb77cef903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3111e027-0f76-49b1-aed8-5ad5bf1a3878 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef17047035e4b518fd5360a01f2da1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3111e027-0f76-49b1-aed8-5ad5bf1a3878 service neutron] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3111e027-0f76-49b1-aed8-5ad5bf1a3878 service neutron] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3111e027-0f76-49b1-aed8-5ad5bf1a3878 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-3111e027-0f76-49b1-aed8-5ad5bf1a3878 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 862/1745] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:57:11 2024] POST /identity/v3/auth/tokens => generated 2960 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ce7c03-6fbf-40ba-a330-9bbb77cef903 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ce7c03-6fbf-40ba-a330-9bbb77cef903 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e789c99-d237-4ba1-830f-cf98a768365c None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e789c99-d237-4ba1-830f-cf98a768365c None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e789c99-d237-4ba1-830f-cf98a768365c None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e789c99-d237-4ba1-830f-cf98a768365c None admin] PATH_INFO: `/v3/domains` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e789c99-d237-4ba1-830f-cf98a768365c None admin] RBAC: Adding query filter params (name=Default) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e789c99-d237-4ba1-830f-cf98a768365c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e789c99-d237-4ba1-830f-cf98a768365c None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3111e027-0f76-49b1-aed8-5ad5bf1a3878 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3111e027-0f76-49b1-aed8-5ad5bf1a3878 service neutron] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 884/1746] 10.27.203.238 () {64 vars in 1432 bytes} [Tue May 28 12:57:11 2024] GET /identity/v3/auth/tokens => generated 2960 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 863/1747] 10.27.203.238 () {62 vars in 1220 bytes} [Tue May 28 12:57:11 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3111e027-0f76-49b1-aed8-5ad5bf1a3878 service neutron] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3111e027-0f76-49b1-aed8-5ad5bf1a3878 service neutron] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:11 l75lg1-v1 neutron-server[77619]: INFO neutron.wsgi [None req-f194bc7e-5093-4418-97d3-3e72b2ea7d75 None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=bb8f0d37fc204d24b8146108f63a1922&name=default HTTP/1.1" status: 200 len: 216 time: 0.1596580 May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4815b006-41bd-4fa0-b72f-910fde7e5954 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4815b006-41bd-4fa0-b72f-910fde7e5954 None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4815b006-41bd-4fa0-b72f-910fde7e5954 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e789c99-d237-4ba1-830f-cf98a768365c None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4815b006-41bd-4fa0-b72f-910fde7e5954 None admin] PATH_INFO: `/v3/projects` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4815b006-41bd-4fa0-b72f-910fde7e5954 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-1e789c99-d237-4ba1-830f-cf98a768365c None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4815b006-41bd-4fa0-b72f-910fde7e5954 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e789c99-d237-4ba1-830f-cf98a768365c None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:11 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-6721862e-8933-4a9c-9f6f-69565ec9cb4c tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] GET http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/shares/8e00d6e4-a018-4e71-b71c-831e546cb6e6 May 28 12:57:11 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-6721862e-8933-4a9c-9f6f-69565ec9cb4c tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:11 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-6721862e-8933-4a9c-9f6f-69565ec9cb4c tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbc263c-6549-4936-b468-ae66c6e61c6c None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbc263c-6549-4936-b468-ae66c6e61c6c None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbc263c-6549-4936-b468-ae66c6e61c6c None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbc263c-6549-4936-b468-ae66c6e61c6c None admin] PATH_INFO: `/v3/projects/bb8f0d37fc204d24b8146108f63a1922` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbc263c-6549-4936-b468-ae66c6e61c6c None admin] RBAC: Authorizing `identity:delete_project(project_id=bb8f0d37fc204d24b8146108f63a1922)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbc263c-6549-4936-b468-ae66c6e61c6c None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:11 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-6721862e-8933-4a9c-9f6f-69565ec9cb4c tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] HTTP exception thrown: The resource could not be found. May 28 12:57:11 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-6721862e-8933-4a9c-9f6f-69565ec9cb4c tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/shares/8e00d6e4-a018-4e71-b71c-831e546cb6e6 returned with HTTP 404 May 28 12:57:11 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 238/491] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:57:11 2024] GET /share/v2/35d84ed7cf164123a87b8b906a836985/shares/8e00d6e4-a018-4e71-b71c-831e546cb6e6 => generated 78 bytes in 11 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 12:57:11 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-7964f0d4-5379-4fb9-a731-161ca842afb9 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] DELETE http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types/044c5a62-3559-453b-9207-1b3393b6012f May 28 12:57:11 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-7964f0d4-5379-4fb9-a731-161ca842afb9 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:11 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-7964f0d4-5379-4fb9-a731-161ca842afb9 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Calling method 'ShareTypesController._delete' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 885/1748] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 12:57:11 2024] POST /identity/v3/projects => generated 389 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4815b006-41bd-4fa0-b72f-910fde7e5954 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4815b006-41bd-4fa0-b72f-910fde7e5954 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-2dbc263c-6549-4936-b468-ae66c6e61c6c None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb8f0d37fc204d24b8146108f63a1922', 'request_id': 'req-2dbc263c-6549-4936-b468-ae66c6e61c6c'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-2dbc263c-6549-4936-b468-ae66c6e61c6c None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb8f0d37fc204d24b8146108f63a1922', 'request_id': 'req-2dbc263c-6549-4936-b468-ae66c6e61c6c'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:11 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-7964f0d4-5379-4fb9-a731-161ca842afb9 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types/044c5a62-3559-453b-9207-1b3393b6012f returned with HTTP 202 May 28 12:57:11 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 254/492] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:57:11 2024] DELETE /share/v2/35d84ed7cf164123a87b8b906a836985/types/044c5a62-3559-453b-9207-1b3393b6012f => generated 0 bytes in 70 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-2dbc263c-6549-4936-b468-ae66c6e61c6c None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb8f0d37fc204d24b8146108f63a1922', 'request_id': 'req-2dbc263c-6549-4936-b468-ae66c6e61c6c'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:11 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-6b00e937-a733-4c40-a202-c1d05e9f29b1 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] GET http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types/044c5a62-3559-453b-9207-1b3393b6012f May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331a69fa-102a-4e5e-9766-fedc4a594def None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:11 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-6b00e937-a733-4c40-a202-c1d05e9f29b1 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331a69fa-102a-4e5e-9766-fedc4a594def None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331a69fa-102a-4e5e-9766-fedc4a594def None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:11 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-6b00e937-a733-4c40-a202-c1d05e9f29b1 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] Calling method 'ShareTypesController.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331a69fa-102a-4e5e-9766-fedc4a594def None admin] PATH_INFO: `/v3/users` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331a69fa-102a-4e5e-9766-fedc4a594def None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331a69fa-102a-4e5e-9766-fedc4a594def None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:11 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-6b00e937-a733-4c40-a202-c1d05e9f29b1 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] HTTP exception thrown: Share type not found. May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-331a69fa-102a-4e5e-9766-fedc4a594def None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 12:57:11 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-6b00e937-a733-4c40-a202-c1d05e9f29b1 tempest-ShareTypesAdminTest-216868925 tempest-ShareTypesAdminTest-216868925-project-admin] http://10.27.203.238/share/v2/35d84ed7cf164123a87b8b906a836985/types/044c5a62-3559-453b-9207-1b3393b6012f returned with HTTP 404 May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-2dbc263c-6549-4936-b468-ae66c6e61c6c None admin] The token cache is being invalidate because project bb8f0d37fc204d24b8146108f63a1922 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-2dbc263c-6549-4936-b468-ae66c6e61c6c None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:11 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 239/493] 10.27.203.238 () {64 vars in 1448 bytes} [Tue May 28 12:57:11 2024] GET /share/v2/35d84ed7cf164123a87b8b906a836985/types/044c5a62-3559-453b-9207-1b3393b6012f => generated 67 bytes in 10 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-2dbc263c-6549-4936-b468-ae66c6e61c6c None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 864/1749] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 12:57:11 2024] DELETE /identity/v3/projects/bb8f0d37fc204d24b8146108f63a1922 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbc263c-6549-4936-b468-ae66c6e61c6c None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-2dbc263c-6549-4936-b468-ae66c6e61c6c None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbc263c-6549-4936-b468-ae66c6e61c6c None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fb38c1-4526-4e70-92bc-40c470136000 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fb38c1-4526-4e70-92bc-40c470136000 None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fb38c1-4526-4e70-92bc-40c470136000 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 886/1750] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 12:57:11 2024] POST /identity/v3/users => generated 302 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fb38c1-4526-4e70-92bc-40c470136000 None admin] PATH_INFO: `/v3/users/2c2540fe25994249acab1b6e8656e2a1` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5877c6-85d7-4598-9a5c-89a5df1f44e2 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5877c6-85d7-4598-9a5c-89a5df1f44e2 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5877c6-85d7-4598-9a5c-89a5df1f44e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fb38c1-4526-4e70-92bc-40c470136000 None admin] RBAC: Authorizing `identity:delete_user(user_id=2c2540fe25994249acab1b6e8656e2a1)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:11 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.periodic_task [None req-e3486ff9-a95e-41bc-8901-df75aedbeaad None None] Running periodic task DataManager.create_backup_continue {{(pid=98318) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fb38c1-4526-4e70-92bc-40c470136000 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:11 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.periodic_task [None req-e3486ff9-a95e-41bc-8901-df75aedbeaad None None] Running periodic task DataManager.restore_backup_continue {{(pid=98318) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-0c5877c6-85d7-4598-9a5c-89a5df1f44e2 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-0c5877c6-85d7-4598-9a5c-89a5df1f44e2 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-0c5877c6-85d7-4598-9a5c-89a5df1f44e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 887/1751] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:57:11 2024] POST /identity/v3/auth/tokens => generated 312 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5877c6-85d7-4598-9a5c-89a5df1f44e2 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-0c5877c6-85d7-4598-9a5c-89a5df1f44e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5877c6-85d7-4598-9a5c-89a5df1f44e2 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78eae2c-c259-4f25-9c06-bb036e9fe7de None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78eae2c-c259-4f25-9c06-bb036e9fe7de None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78eae2c-c259-4f25-9c06-bb036e9fe7de None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78eae2c-c259-4f25-9c06-bb036e9fe7de None admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78eae2c-c259-4f25-9c06-bb036e9fe7de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78eae2c-c259-4f25-9c06-bb036e9fe7de None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 888/1752] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 12:57:11 2024] GET /identity/v3/roles => generated 1680 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78eae2c-c259-4f25-9c06-bb036e9fe7de None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78eae2c-c259-4f25-9c06-bb036e9fe7de None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-09fb38c1-4526-4e70-92bc-40c470136000 None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c2540fe25994249acab1b6e8656e2a1', 'request_id': 'req-09fb38c1-4526-4e70-92bc-40c470136000'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-09fb38c1-4526-4e70-92bc-40c470136000 None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c2540fe25994249acab1b6e8656e2a1', 'request_id': 'req-09fb38c1-4526-4e70-92bc-40c470136000'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-09fb38c1-4526-4e70-92bc-40c470136000 None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c2540fe25994249acab1b6e8656e2a1', 'request_id': 'req-09fb38c1-4526-4e70-92bc-40c470136000'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-09fb38c1-4526-4e70-92bc-40c470136000 None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c2540fe25994249acab1b6e8656e2a1', 'request_id': 'req-09fb38c1-4526-4e70-92bc-40c470136000'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-09fb38c1-4526-4e70-92bc-40c470136000 None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c2540fe25994249acab1b6e8656e2a1', 'request_id': 'req-09fb38c1-4526-4e70-92bc-40c470136000'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23750b9e-00ae-4497-934a-6980169cfd75 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23750b9e-00ae-4497-934a-6980169cfd75 None admin] REQUEST_METHOD: `PUT` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23750b9e-00ae-4497-934a-6980169cfd75 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23750b9e-00ae-4497-934a-6980169cfd75 None admin] PATH_INFO: `/v3/projects/f4f7702aa04c467288cc6b142f61ec37/users/38f9868304a34b56bebf6e47a61b2d46/roles/e7989893488f483baa107be56668c4f8` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 865/1753] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 12:57:11 2024] DELETE /identity/v3/users/2c2540fe25994249acab1b6e8656e2a1 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f82817-ee1e-467c-8e8e-446f9b7449c0 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f82817-ee1e-467c-8e8e-446f9b7449c0 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f82817-ee1e-467c-8e8e-446f9b7449c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23750b9e-00ae-4497-934a-6980169cfd75 None admin] RBAC: Authorizing `identity:create_grant(project_id=f4f7702aa04c467288cc6b142f61ec37, user_id=38f9868304a34b56bebf6e47a61b2d46, role_id=e7989893488f483baa107be56668c4f8)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23750b9e-00ae-4497-934a-6980169cfd75 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-d3f82817-ee1e-467c-8e8e-446f9b7449c0 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-d3f82817-ee1e-467c-8e8e-446f9b7449c0 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-d3f82817-ee1e-467c-8e8e-446f9b7449c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 889/1754] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 12:57:11 2024] PUT /identity/v3/projects/f4f7702aa04c467288cc6b142f61ec37/users/38f9868304a34b56bebf6e47a61b2d46/roles/e7989893488f483baa107be56668c4f8 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083c40c0-721f-444b-b2aa-95213181029e None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083c40c0-721f-444b-b2aa-95213181029e None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083c40c0-721f-444b-b2aa-95213181029e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-083c40c0-721f-444b-b2aa-95213181029e None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-083c40c0-721f-444b-b2aa-95213181029e None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-083c40c0-721f-444b-b2aa-95213181029e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 866/1755] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:57:11 2024] POST /identity/v3/auth/tokens => generated 2960 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f82817-ee1e-467c-8e8e-446f9b7449c0 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 890/1756] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:57:11 2024] POST /identity/v3/auth/tokens => generated 2960 bytes in 26 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-d3f82817-ee1e-467c-8e8e-446f9b7449c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:11 l75lg1-v1 neutron-server[77618]: DEBUG neutron.wsgi [-] (77618) accepted ('10.27.203.238', 58628) {{(pid=77618) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083c40c0-721f-444b-b2aa-95213181029e None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083c40c0-721f-444b-b2aa-95213181029e None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f82817-ee1e-467c-8e8e-446f9b7449c0 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b294bd8-71d3-48a0-bba0-c4f27be3b3e5 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b294bd8-71d3-48a0-bba0-c4f27be3b3e5 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b294bd8-71d3-48a0-bba0-c4f27be3b3e5 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c8c99e-a78f-4e0a-a04b-c5a4c37716de None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b294bd8-71d3-48a0-bba0-c4f27be3b3e5 None admin] PATH_INFO: `/v3/domains` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b294bd8-71d3-48a0-bba0-c4f27be3b3e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=51267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c8c99e-a78f-4e0a-a04b-c5a4c37716de None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c8c99e-a78f-4e0a-a04b-c5a4c37716de None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b294bd8-71d3-48a0-bba0-c4f27be3b3e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c8c99e-a78f-4e0a-a04b-c5a4c37716de None admin] PATH_INFO: `/v3/roles` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c8c99e-a78f-4e0a-a04b-c5a4c37716de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b294bd8-71d3-48a0-bba0-c4f27be3b3e5 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c8c99e-a78f-4e0a-a04b-c5a4c37716de None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 867/1757] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 12:57:11 2024] GET /identity/v3/roles => generated 1680 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c8c99e-a78f-4e0a-a04b-c5a4c37716de None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 891/1758] 10.27.203.238 () {62 vars in 1220 bytes} [Tue May 28 12:57:11 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-e2c8c99e-a78f-4e0a-a04b-c5a4c37716de None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b294bd8-71d3-48a0-bba0-c4f27be3b3e5 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b294bd8-71d3-48a0-bba0-c4f27be3b3e5 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf733db2-b730-4871-841a-5f324316455b None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf733db2-b730-4871-841a-5f324316455b None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf733db2-b730-4871-841a-5f324316455b None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf733db2-b730-4871-841a-5f324316455b None admin] PATH_INFO: `/v3/projects` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf733db2-b730-4871-841a-5f324316455b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf733db2-b730-4871-841a-5f324316455b None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 892/1759] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 12:57:11 2024] POST /identity/v3/projects => generated 391 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf733db2-b730-4871-841a-5f324316455b None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c8c99e-a78f-4e0a-a04b-c5a4c37716de None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf733db2-b730-4871-841a-5f324316455b None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0b0395-7af7-4d24-a37b-fa287fb3db09 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0b0395-7af7-4d24-a37b-fa287fb3db09 None admin] REQUEST_METHOD: `PUT` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0b0395-7af7-4d24-a37b-fa287fb3db09 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0b0395-7af7-4d24-a37b-fa287fb3db09 None admin] PATH_INFO: `/v3/projects/f4f7702aa04c467288cc6b142f61ec37/users/38f9868304a34b56bebf6e47a61b2d46/roles/e7989893488f483baa107be56668c4f8` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0b0395-7af7-4d24-a37b-fa287fb3db09 None admin] RBAC: Authorizing `identity:create_grant(project_id=f4f7702aa04c467288cc6b142f61ec37, user_id=38f9868304a34b56bebf6e47a61b2d46, role_id=e7989893488f483baa107be56668c4f8)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0b0395-7af7-4d24-a37b-fa287fb3db09 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89e535e-e852-4388-b831-89a075d76fc9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef17047035e4b518fd5360a01f2da1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89e535e-e852-4388-b831-89a075d76fc9 service neutron] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89e535e-e852-4388-b831-89a075d76fc9 service neutron] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89e535e-e852-4388-b831-89a075d76fc9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 893/1760] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 12:57:11 2024] PUT /identity/v3/projects/f4f7702aa04c467288cc6b142f61ec37/users/38f9868304a34b56bebf6e47a61b2d46/roles/e7989893488f483baa107be56668c4f8 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0b0395-7af7-4d24-a37b-fa287fb3db09 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89e535e-e852-4388-b831-89a075d76fc9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89e535e-e852-4388-b831-89a075d76fc9 service neutron] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 868/1761] 10.27.203.238 () {64 vars in 1432 bytes} [Tue May 28 12:57:11 2024] GET /identity/v3/auth/tokens => generated 2960 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3947f6d-1490-4450-a59b-a641bb875573 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3947f6d-1490-4450-a59b-a641bb875573 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3947f6d-1490-4450-a59b-a641bb875573 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:12 l75lg1-v1 neutron-server[77618]: INFO neutron.wsgi [None req-0c27b66c-3491-490e-b992-1534dd27ab42 None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=35d84ed7cf164123a87b8b906a836985&name=default HTTP/1.1" status: 200 len: 216 time: 0.1240892 May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-c3947f6d-1490-4450-a59b-a641bb875573 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0b0395-7af7-4d24-a37b-fa287fb3db09 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a5f3cc-a06a-4847-886a-fbe113b3ac7b None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a5f3cc-a06a-4847-886a-fbe113b3ac7b None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-c3947f6d-1490-4450-a59b-a641bb875573 None None] MFA Rules not processed for user `38f9868304a34b56bebf6e47a61b2d46`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a5f3cc-a06a-4847-886a-fbe113b3ac7b None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a5f3cc-a06a-4847-886a-fbe113b3ac7b None admin] PATH_INFO: `/v3/users` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a5f3cc-a06a-4847-886a-fbe113b3ac7b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-c3947f6d-1490-4450-a59b-a641bb875573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a5f3cc-a06a-4847-886a-fbe113b3ac7b None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-e3a5f3cc-a06a-4847-886a-fbe113b3ac7b None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 894/1762] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 12:57:11 2024] POST /identity/v3/users => generated 304 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a5f3cc-a06a-4847-886a-fbe113b3ac7b None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-e3a5f3cc-a06a-4847-886a-fbe113b3ac7b None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a5f3cc-a06a-4847-886a-fbe113b3ac7b None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bc9c9e-3bf3-4c8d-bfb5-8cc680ca6c67 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bc9c9e-3bf3-4c8d-bfb5-8cc680ca6c67 None admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bc9c9e-3bf3-4c8d-bfb5-8cc680ca6c67 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bc9c9e-3bf3-4c8d-bfb5-8cc680ca6c67 None admin] PATH_INFO: `/v3/projects/35d84ed7cf164123a87b8b906a836985` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bc9c9e-3bf3-4c8d-bfb5-8cc680ca6c67 None admin] RBAC: Authorizing `identity:delete_project(project_id=35d84ed7cf164123a87b8b906a836985)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bc9c9e-3bf3-4c8d-bfb5-8cc680ca6c67 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 869/1763] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:57:11 2024] POST /identity/v3/auth/tokens => generated 4083 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3947f6d-1490-4450-a59b-a641bb875573 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3947f6d-1490-4450-a59b-a641bb875573 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfc816f-a99f-41ff-934b-821ffff11635 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfc816f-a99f-41ff-934b-821ffff11635 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfc816f-a99f-41ff-934b-821ffff11635 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfc816f-a99f-41ff-934b-821ffff11635 None admin] PATH_INFO: `/v3/roles` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfc816f-a99f-41ff-934b-821ffff11635 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfc816f-a99f-41ff-934b-821ffff11635 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 870/1764] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 12:57:12 2024] GET /identity/v3/roles => generated 1680 bytes in 16 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfc816f-a99f-41ff-934b-821ffff11635 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-9bfc816f-a99f-41ff-934b-821ffff11635 None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:12 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-230a1377-8864-4dc4-aa45-0cd2f1c769f1 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] GET http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/shares/9be3b244-34ab-4002-b1e1-427af2ab8545 May 28 12:57:12 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-230a1377-8864-4dc4-aa45-0cd2f1c769f1 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:12 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-230a1377-8864-4dc4-aa45-0cd2f1c769f1 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:12 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-eeade190-48a4-4e98-ba6e-dc30e46ebb57 tempest-AdminActionsTest-1749172189 None] <<< [DELETE] https://127.0.0.1:40443/api/viewpolicies/13/ May 28 12:57:12 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-eeade190-48a4-4e98-ba6e-dc30e46ebb57 tempest-AdminActionsTest-1749172189 None] --- [DELETE] https://127.0.0.1:40443/api/viewpolicies/13/: Done May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-76bc9c9e-3bf3-4c8d-bfb5-8cc680ca6c67 None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35d84ed7cf164123a87b8b906a836985', 'request_id': 'req-76bc9c9e-3bf3-4c8d-bfb5-8cc680ca6c67'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:12 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-230a1377-8864-4dc4-aa45-0cd2f1c769f1 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/shares/9be3b244-34ab-4002-b1e1-427af2ab8545 returned with HTTP 200 May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-76bc9c9e-3bf3-4c8d-bfb5-8cc680ca6c67 None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35d84ed7cf164123a87b8b906a836985', 'request_id': 'req-76bc9c9e-3bf3-4c8d-bfb5-8cc680ca6c67'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:12 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 240/494] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:57:12 2024] GET /share/v2/a3499cb78849424db45e54caac01de92/shares/9be3b244-34ab-4002-b1e1-427af2ab8545 => generated 1371 bytes in 31 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-76bc9c9e-3bf3-4c8d-bfb5-8cc680ca6c67 None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35d84ed7cf164123a87b8b906a836985', 'request_id': 'req-76bc9c9e-3bf3-4c8d-bfb5-8cc680ca6c67'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfc816f-a99f-41ff-934b-821ffff11635 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-76bc9c9e-3bf3-4c8d-bfb5-8cc680ca6c67 None admin] The token cache is being invalidate because project 35d84ed7cf164123a87b8b906a836985 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-76bc9c9e-3bf3-4c8d-bfb5-8cc680ca6c67 None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-76bc9c9e-3bf3-4c8d-bfb5-8cc680ca6c67 None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 895/1765] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 12:57:12 2024] DELETE /identity/v3/projects/35d84ed7cf164123a87b8b906a836985 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bc9c9e-3bf3-4c8d-bfb5-8cc680ca6c67 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-76bc9c9e-3bf3-4c8d-bfb5-8cc680ca6c67 None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb98958f-a9f7-4620-8cb6-ee88c77e7e07 service manila] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f110cf6300f049c897d0aab63218d1e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb98958f-a9f7-4620-8cb6-ee88c77e7e07 service manila] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb98958f-a9f7-4620-8cb6-ee88c77e7e07 service manila] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb98958f-a9f7-4620-8cb6-ee88c77e7e07 service manila] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-eb98958f-a9f7-4620-8cb6-ee88c77e7e07 service manila] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bc9c9e-3bf3-4c8d-bfb5-8cc680ca6c67 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3569b1e7-eb32-4b44-bbb6-c849634e6b44 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3569b1e7-eb32-4b44-bbb6-c849634e6b44 None admin] REQUEST_METHOD: `PUT` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3569b1e7-eb32-4b44-bbb6-c849634e6b44 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3569b1e7-eb32-4b44-bbb6-c849634e6b44 None admin] PATH_INFO: `/v3/projects/b459b0ac20ef4f348e8ff53468c5c935/users/7365146fcc404c988e9841963a43be27/roles/44620cad10ae407c90c91e2c296adb04` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3569b1e7-eb32-4b44-bbb6-c849634e6b44 None admin] RBAC: Authorizing `identity:create_grant(project_id=b459b0ac20ef4f348e8ff53468c5c935, user_id=7365146fcc404c988e9841963a43be27, role_id=44620cad10ae407c90c91e2c296adb04)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3569b1e7-eb32-4b44-bbb6-c849634e6b44 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb98958f-a9f7-4620-8cb6-ee88c77e7e07 service manila] RBAC: Authorizing `identity:validate_token()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb98958f-a9f7-4620-8cb6-ee88c77e7e07 service manila] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 871/1766] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 12:57:12 2024] GET /identity/v3/auth/tokens => generated 4083 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bb131d-fce0-4ef8-981d-da24e7ca8b21 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bb131d-fce0-4ef8-981d-da24e7ca8b21 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bb131d-fce0-4ef8-981d-da24e7ca8b21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:12 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-131a0407-3bc1-4e3e-823f-deb6c616c1f1 tempest-ShareSnapshotInstancesTest-843694899 tempest-ShareSnapshotInstancesTest-843694899-project-admin] POST http://10.27.203.238/share/v2/f4f7702aa04c467288cc6b142f61ec37/types May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 896/1767] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 12:57:12 2024] PUT /identity/v3/projects/b459b0ac20ef4f348e8ff53468c5c935/users/7365146fcc404c988e9841963a43be27/roles/44620cad10ae407c90c91e2c296adb04 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:57:12 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-131a0407-3bc1-4e3e-823f-deb6c616c1f1 tempest-ShareSnapshotInstancesTest-843694899 tempest-ShareSnapshotInstancesTest-843694899-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share_type": {"name": "tempest-typeshare-type-1849572432", "extra_specs": {"driver_handles_share_servers": "False", "snapshot_support": true}, "share_type_access:is_public": true}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ab1403-f06d-46a7-b3a5-ae35db7d15aa None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ab1403-f06d-46a7-b3a5-ae35db7d15aa None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-59bb131d-fce0-4ef8-981d-da24e7ca8b21 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ab1403-f06d-46a7-b3a5-ae35db7d15aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-59bb131d-fce0-4ef8-981d-da24e7ca8b21 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-59bb131d-fce0-4ef8-981d-da24e7ca8b21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 872/1768] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:57:12 2024] POST /identity/v3/auth/tokens => generated 312 bytes in 18 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a985cbe-fc26-418d-874f-3dbc3f7c3c97 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a985cbe-fc26-418d-874f-3dbc3f7c3c97 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a985cbe-fc26-418d-874f-3dbc3f7c3c97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-a0ab1403-f06d-46a7-b3a5-ae35db7d15aa None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:57:12 l75lg1-v1 dstat.sh[49771]: 28-05 12:57:12| 22 3 71 4 0|5676M 1824M 277M 7848M| 11k 5201B| 0 3133k| 0 426 | 12k 21k|1.63 1.03 1.00|3.0 1.0 1.0| 0 0 | 0 2048M| 29 352 0 67 0 May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-5a985cbe-fc26-418d-874f-3dbc3f7c3c97 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-5a985cbe-fc26-418d-874f-3dbc3f7c3c97 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:57:12 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-131a0407-3bc1-4e3e-823f-deb6c616c1f1 tempest-ShareSnapshotInstancesTest-843694899 tempest-ShareSnapshotInstancesTest-843694899-project-admin] http://10.27.203.238/share/v2/f4f7702aa04c467288cc6b142f61ec37/types returned with HTTP 200 May 28 12:57:12 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-eeade190-48a4-4e98-ba6e-dc30e46ebb57 tempest-AdminActionsTest-1749172189 None] Created reservations ['11999014-0d3d-422d-b62e-a606079efd49', '3573320e-22fd-4551-aa17-a7d2a08420e0', '2962a1d9-d7d5-4ee5-a2aa-667cf301bbc6', '9d53cd9c-412e-4cc4-991b-f97e411fa209'] {{(pid=98474) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-5a985cbe-fc26-418d-874f-3dbc3f7c3c97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:12 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 255/495] 10.27.203.238 () {66 vars in 1359 bytes} [Tue May 28 12:57:12 2024] POST /share/v2/f4f7702aa04c467288cc6b142f61ec37/types => generated 679 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-a0ab1403-f06d-46a7-b3a5-ae35db7d15aa None None] MFA Rules not processed for user `7365146fcc404c988e9841963a43be27`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-a0ab1403-f06d-46a7-b3a5-ae35db7d15aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:12 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-01a2ae14-f15d-4183-924e-4ad9803a3801 tempest-ShareSnapshotInstancesTest-843694899 tempest-ShareSnapshotInstancesTest-843694899-project-admin] POST http://10.27.203.238/share/v2/f4f7702aa04c467288cc6b142f61ec37/shares May 28 12:57:12 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-01a2ae14-f15d-4183-924e-4ad9803a3801 tempest-ShareSnapshotInstancesTest-843694899 tempest-ShareSnapshotInstancesTest-843694899-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share": {"share_proto": "nfs", "description": "Tempest's share", "snapshot_id": null, "name": "tempest-tempest-created-share-513156540", "size": 1, "metadata": {}, "is_public": false, "share_type": "b13f7d87-31c1-4483-bf1e-45136ab4c6a6"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:57:12 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.v1.shares [None req-01a2ae14-f15d-4183-924e-4ad9803a3801 tempest-ShareSnapshotInstancesTest-843694899 tempest-ShareSnapshotInstancesTest-843694899-project-admin] Create NFS share of 1 GB May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 873/1769] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:57:12 2024] POST /identity/v3/auth/tokens => generated 2960 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a985cbe-fc26-418d-874f-3dbc3f7c3c97 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:12 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-eeade190-48a4-4e98-ba6e-dc30e46ebb57 tempest-AdminActionsTest-1749172189 None] Committed reservations ['11999014-0d3d-422d-b62e-a606079efd49', '3573320e-22fd-4551-aa17-a7d2a08420e0', '2962a1d9-d7d5-4ee5-a2aa-667cf301bbc6', '9d53cd9c-412e-4cc4-991b-f97e411fa209'] {{(pid=98474) commit /opt/stack/manila/manila/quota.py:1063}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a985cbe-fc26-418d-874f-3dbc3f7c3c97 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0871c6-80ca-45db-b9e8-2dd836562cb3 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0871c6-80ca-45db-b9e8-2dd836562cb3 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0871c6-80ca-45db-b9e8-2dd836562cb3 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:12 l75lg1-v1 manila-share[98474]: INFO manila.share.manager [None req-eeade190-48a4-4e98-ba6e-dc30e46ebb57 tempest-AdminActionsTest-1749172189 None] Share instance 4016fe10-12f4-48fc-92de-42cdd2fff998: deleted successfully. May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0871c6-80ca-45db-b9e8-2dd836562cb3 None admin] PATH_INFO: `/v3/domains` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0871c6-80ca-45db-b9e8-2dd836562cb3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0871c6-80ca-45db-b9e8-2dd836562cb3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0871c6-80ca-45db-b9e8-2dd836562cb3 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 874/1770] 10.27.203.238 () {62 vars in 1220 bytes} [Tue May 28 12:57:12 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0871c6-80ca-45db-b9e8-2dd836562cb3 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 897/1771] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:57:12 2024] POST /identity/v3/auth/tokens => generated 3962 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0871c6-80ca-45db-b9e8-2dd836562cb3 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ab1403-f06d-46a7-b3a5-ae35db7d15aa None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e2f948-115b-496b-9a07-d82e1a92e31d None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e2f948-115b-496b-9a07-d82e1a92e31d None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e2f948-115b-496b-9a07-d82e1a92e31d None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e2f948-115b-496b-9a07-d82e1a92e31d None admin] PATH_INFO: `/v3/projects` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e2f948-115b-496b-9a07-d82e1a92e31d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e2f948-115b-496b-9a07-d82e1a92e31d None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ab1403-f06d-46a7-b3a5-ae35db7d15aa None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a065cc-68db-4666-a412-08bffa357f93 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a065cc-68db-4666-a412-08bffa357f93 None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a065cc-68db-4666-a412-08bffa357f93 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a065cc-68db-4666-a412-08bffa357f93 None admin] PATH_INFO: `/v3/projects` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a065cc-68db-4666-a412-08bffa357f93 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a065cc-68db-4666-a412-08bffa357f93 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:12 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.quota [None req-01a2ae14-f15d-4183-924e-4ad9803a3801 tempest-ShareSnapshotInstancesTest-843694899 tempest-ShareSnapshotInstancesTest-843694899-project-admin] Created reservations ['5f74be3c-8bc5-4765-9175-850bf8ca78e5', '51bd3d8c-89b5-4663-9349-d567869a2b50', 'd962174d-508c-4eae-be72-24c9a0a701df', '2c76690a-c999-484a-b5f2-8aad6fa61a5b'] {{(pid=98330) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 875/1772] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 12:57:12 2024] POST /identity/v3/projects => generated 383 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e2f948-115b-496b-9a07-d82e1a92e31d None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 898/1773] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 12:57:12 2024] POST /identity/v3/projects => generated 393 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a065cc-68db-4666-a412-08bffa357f93 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e2f948-115b-496b-9a07-d82e1a92e31d None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a065cc-68db-4666-a412-08bffa357f93 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c414401-4b13-4353-940f-743deb2631b7 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:12 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.quota [None req-01a2ae14-f15d-4183-924e-4ad9803a3801 tempest-ShareSnapshotInstancesTest-843694899 tempest-ShareSnapshotInstancesTest-843694899-project-admin] Committed reservations ['5f74be3c-8bc5-4765-9175-850bf8ca78e5', '51bd3d8c-89b5-4663-9349-d567869a2b50', 'd962174d-508c-4eae-be72-24c9a0a701df', '2c76690a-c999-484a-b5f2-8aad6fa61a5b'] {{(pid=98330) commit /opt/stack/manila/manila/quota.py:1063}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c414401-4b13-4353-940f-743deb2631b7 None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c414401-4b13-4353-940f-743deb2631b7 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c414401-4b13-4353-940f-743deb2631b7 None admin] PATH_INFO: `/v3/users` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c414401-4b13-4353-940f-743deb2631b7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:12 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bbf758da-a5e5-4efa-9481-28cdc0a18883 tempest-AccessRulesMetadataTest-1973590610 None] <<< [DELETE] https://127.0.0.1:40443/api/viewpolicies/9/ May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c414401-4b13-4353-940f-743deb2631b7 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:12 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bbf758da-a5e5-4efa-9481-28cdc0a18883 tempest-AccessRulesMetadataTest-1973590610 None] --- [DELETE] https://127.0.0.1:40443/api/viewpolicies/9/: Done May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-4c414401-4b13-4353-940f-743deb2631b7 None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519594f1-38b6-4da4-ba8f-0537907e8b8d None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519594f1-38b6-4da4-ba8f-0537907e8b8d None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519594f1-38b6-4da4-ba8f-0537907e8b8d None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519594f1-38b6-4da4-ba8f-0537907e8b8d None admin] PATH_INFO: `/v3/users` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519594f1-38b6-4da4-ba8f-0537907e8b8d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519594f1-38b6-4da4-ba8f-0537907e8b8d None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-519594f1-38b6-4da4-ba8f-0537907e8b8d None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 899/1774] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 12:57:12 2024] POST /identity/v3/users => generated 305 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 876/1775] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 12:57:12 2024] POST /identity/v3/users => generated 299 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c414401-4b13-4353-940f-743deb2631b7 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519594f1-38b6-4da4-ba8f-0537907e8b8d None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c414401-4b13-4353-940f-743deb2631b7 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519594f1-38b6-4da4-ba8f-0537907e8b8d None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3fc905-b7cb-414f-a120-86375727ada8 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3fc905-b7cb-414f-a120-86375727ada8 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3fc905-b7cb-414f-a120-86375727ada8 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3fc905-b7cb-414f-a120-86375727ada8 None admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3fc905-b7cb-414f-a120-86375727ada8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3fc905-b7cb-414f-a120-86375727ada8 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74355e66-6d11-4df2-b8dc-96da27f28110 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74355e66-6d11-4df2-b8dc-96da27f28110 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74355e66-6d11-4df2-b8dc-96da27f28110 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74355e66-6d11-4df2-b8dc-96da27f28110 None admin] PATH_INFO: `/v3/roles` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74355e66-6d11-4df2-b8dc-96da27f28110 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74355e66-6d11-4df2-b8dc-96da27f28110 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 900/1776] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 12:57:12 2024] GET /identity/v3/roles => generated 1680 bytes in 17 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 877/1777] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 12:57:12 2024] GET /identity/v3/roles => generated 1680 bytes in 17 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3fc905-b7cb-414f-a120-86375727ada8 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74355e66-6d11-4df2-b8dc-96da27f28110 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3fc905-b7cb-414f-a120-86375727ada8 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:12 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.host_manager [None req-01a2ae14-f15d-4183-924e-4ad9803a3801 tempest-ShareSnapshotInstancesTest-843694899 None] Share service is down. (host: l75lg1-v1@generic2). May 28 12:57:12 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.host_manager [None req-01a2ae14-f15d-4183-924e-4ad9803a3801 tempest-ShareSnapshotInstancesTest-843694899 None] Share service is down. (host: l75lg1-v1@generic1). May 28 12:57:12 l75lg1-v1 manila-scheduler[98327]: INFO manila.scheduler.host_manager [None req-01a2ae14-f15d-4183-924e-4ad9803a3801 tempest-ShareSnapshotInstancesTest-843694899 None] Removing non-active host: l75lg1-v1@generic2 from scheduler cache. May 28 12:57:12 l75lg1-v1 manila-scheduler[98327]: INFO manila.scheduler.host_manager [None req-01a2ae14-f15d-4183-924e-4ad9803a3801 tempest-ShareSnapshotInstancesTest-843694899 None] Removing non-active host: l75lg1-v1@generic1 from scheduler cache. May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74355e66-6d11-4df2-b8dc-96da27f28110 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:12 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-01a2ae14-f15d-4183-924e-4ad9803a3801 tempest-ShareSnapshotInstancesTest-843694899 None] Starting with 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:80}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa4450c-9ae8-40d0-b62b-82188480cb3e None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:12 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-01a2ae14-f15d-4183-924e-4ad9803a3801 tempest-ShareSnapshotInstancesTest-843694899 None] Filter OnlyHostFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa4450c-9ae8-40d0-b62b-82188480cb3e None admin] REQUEST_METHOD: `PUT` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa4450c-9ae8-40d0-b62b-82188480cb3e None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:12 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-01a2ae14-f15d-4183-924e-4ad9803a3801 tempest-ShareSnapshotInstancesTest-843694899 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa4450c-9ae8-40d0-b62b-82188480cb3e None admin] PATH_INFO: `/v3/projects/1f12d119bc9a46e9b391ca37a6d3847a/users/165270b3c7594f98ad74df5e973f36b6/roles/44620cad10ae407c90c91e2c296adb04` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:12 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.capacity [None req-01a2ae14-f15d-4183-924e-4ad9803a3801 tempest-ShareSnapshotInstancesTest-843694899 None] Space information for share creation on host l75lg1-v1@vast#vast (requested / avail): 1/2071 {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/capacity.py:83}} May 28 12:57:12 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-01a2ae14-f15d-4183-924e-4ad9803a3801 tempest-ShareSnapshotInstancesTest-843694899 None] Filter CapacityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:57:12 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-01a2ae14-f15d-4183-924e-4ad9803a3801 tempest-ShareSnapshotInstancesTest-843694899 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:57:12 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-01a2ae14-f15d-4183-924e-4ad9803a3801 tempest-ShareSnapshotInstancesTest-843694899 None] Driver Filter: Checking host 'l75lg1-v1@vast#vast' {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:37}} May 28 12:57:12 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-01a2ae14-f15d-4183-924e-4ad9803a3801 tempest-ShareSnapshotInstancesTest-843694899 None] Filter function not set :: passing host. {{(pid=98327) _check_filter_function /opt/stack/manila/manila/scheduler/filters/driver.py:53}} May 28 12:57:12 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-01a2ae14-f15d-4183-924e-4ad9803a3801 tempest-ShareSnapshotInstancesTest-843694899 None] Result: True {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:40}} May 28 12:57:12 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-01a2ae14-f15d-4183-924e-4ad9803a3801 tempest-ShareSnapshotInstancesTest-843694899 None] Done checking host 'l75lg1-v1@vast#vast' {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:41}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0d54c1-c537-4b0f-804b-22ed0f356b28 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:12 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-01a2ae14-f15d-4183-924e-4ad9803a3801 tempest-ShareSnapshotInstancesTest-843694899 None] Filter DriverFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:57:12 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-01a2ae14-f15d-4183-924e-4ad9803a3801 tempest-ShareSnapshotInstancesTest-843694899 None] Filter ShareReplicationFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:57:12 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-01a2ae14-f15d-4183-924e-4ad9803a3801 tempest-ShareSnapshotInstancesTest-843694899 tempest-ShareSnapshotInstancesTest-843694899-project-admin] http://10.27.203.238/share/v2/f4f7702aa04c467288cc6b142f61ec37/shares returned with HTTP 200 May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0d54c1-c537-4b0f-804b-22ed0f356b28 None admin] REQUEST_METHOD: `PUT` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0d54c1-c537-4b0f-804b-22ed0f356b28 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0d54c1-c537-4b0f-804b-22ed0f356b28 None admin] PATH_INFO: `/v3/projects/366171b6e44f4129bbd7dae20def74e5/users/330379bfc1e8469981f6265eca405f7b/roles/e7989893488f483baa107be56668c4f8` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:12 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 241/496] 10.27.203.238 () {66 vars in 1362 bytes} [Tue May 28 12:57:12 2024] POST /share/v2/f4f7702aa04c467288cc6b142f61ec37/shares => generated 1349 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:57:12 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-01a2ae14-f15d-4183-924e-4ad9803a3801 tempest-ShareSnapshotInstancesTest-843694899 None] Filter CreateFromSnapshotFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:57:12 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-01a2ae14-f15d-4183-924e-4ad9803a3801 tempest-ShareSnapshotInstancesTest-843694899 None] Filter AffinityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:57:12 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-01a2ae14-f15d-4183-924e-4ad9803a3801 tempest-ShareSnapshotInstancesTest-843694899 None] Filter AntiAffinityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:57:12 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.drivers.filter [None req-01a2ae14-f15d-4183-924e-4ad9803a3801 tempest-ShareSnapshotInstancesTest-843694899 None] Filtered share [host: 'l75lg1-v1@vast#vast', free_capacity_gb: 2071.6229242384434, pools: None] {{(pid=98327) _schedule_share /opt/stack/manila/manila/scheduler/drivers/filter.py:268}} May 28 12:57:12 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-01a2ae14-f15d-4183-924e-4ad9803a3801 tempest-ShareSnapshotInstancesTest-843694899 None] Checking host 'l75lg1-v1@vast#vast' {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:46}} May 28 12:57:12 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.weighers.goodness [None req-01a2ae14-f15d-4183-924e-4ad9803a3801 tempest-ShareSnapshotInstancesTest-843694899 None] Goodness function not set :: defaulting to minimal goodness rating of 0. May 28 12:57:12 l75lg1-v1 manila-scheduler[98327]: INFO manila.scheduler.weighers.goodness [None req-01a2ae14-f15d-4183-924e-4ad9803a3801 tempest-ShareSnapshotInstancesTest-843694899 None] Goodness function result for host l75lg1-v1@vast#vast: 0. May 28 12:57:12 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-01a2ae14-f15d-4183-924e-4ad9803a3801 tempest-ShareSnapshotInstancesTest-843694899 None] Goodness: 0 {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:48}} May 28 12:57:12 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-01a2ae14-f15d-4183-924e-4ad9803a3801 tempest-ShareSnapshotInstancesTest-843694899 None] Done checking host 'l75lg1-v1@vast#vast' {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:49}} May 28 12:57:12 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.drivers.filter [None req-01a2ae14-f15d-4183-924e-4ad9803a3801 tempest-ShareSnapshotInstancesTest-843694899 None] Choosing for share: WeighedHost [host: l75lg1-v1@vast#vast, weight: 0.0] {{(pid=98327) _schedule_share /opt/stack/manila/manila/scheduler/drivers/filter.py:274}} May 28 12:57:12 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-813222f8-00e1-4c23-943a-58883fe587f6 tempest-ShareSnapshotInstancesTest-843694899 tempest-ShareSnapshotInstancesTest-843694899-project-admin] GET http://10.27.203.238/share/v2/f4f7702aa04c467288cc6b142f61ec37/shares/b235c40f-7437-4e0c-b44e-321d8e8b1457 May 28 12:57:12 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-813222f8-00e1-4c23-943a-58883fe587f6 tempest-ShareSnapshotInstancesTest-843694899 tempest-ShareSnapshotInstancesTest-843694899-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:12 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-813222f8-00e1-4c23-943a-58883fe587f6 tempest-ShareSnapshotInstancesTest-843694899 tempest-ShareSnapshotInstancesTest-843694899-project-admin] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa4450c-9ae8-40d0-b62b-82188480cb3e None admin] RBAC: Authorizing `identity:create_grant(project_id=1f12d119bc9a46e9b391ca37a6d3847a, user_id=165270b3c7594f98ad74df5e973f36b6, role_id=44620cad10ae407c90c91e2c296adb04)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa4450c-9ae8-40d0-b62b-82188480cb3e None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0d54c1-c537-4b0f-804b-22ed0f356b28 None admin] RBAC: Authorizing `identity:create_grant(project_id=366171b6e44f4129bbd7dae20def74e5, user_id=330379bfc1e8469981f6265eca405f7b, role_id=e7989893488f483baa107be56668c4f8)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0d54c1-c537-4b0f-804b-22ed0f356b28 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 901/1778] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 12:57:12 2024] PUT /identity/v3/projects/1f12d119bc9a46e9b391ca37a6d3847a/users/165270b3c7594f98ad74df5e973f36b6/roles/44620cad10ae407c90c91e2c296adb04 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518b2182-69e8-474f-9582-f355d117610b None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518b2182-69e8-474f-9582-f355d117610b None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518b2182-69e8-474f-9582-f355d117610b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:12 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-813222f8-00e1-4c23-943a-58883fe587f6 tempest-ShareSnapshotInstancesTest-843694899 tempest-ShareSnapshotInstancesTest-843694899-project-admin] http://10.27.203.238/share/v2/f4f7702aa04c467288cc6b142f61ec37/shares/b235c40f-7437-4e0c-b44e-321d8e8b1457 returned with HTTP 200 May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 878/1779] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 12:57:12 2024] PUT /identity/v3/projects/366171b6e44f4129bbd7dae20def74e5/users/330379bfc1e8469981f6265eca405f7b/roles/e7989893488f483baa107be56668c4f8 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 28 12:57:12 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 256/497] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:57:12 2024] GET /share/v2/f4f7702aa04c467288cc6b142f61ec37/shares/b235c40f-7437-4e0c-b44e-321d8e8b1457 => generated 1349 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0d54c1-c537-4b0f-804b-22ed0f356b28 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-518b2182-69e8-474f-9582-f355d117610b None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-518b2182-69e8-474f-9582-f355d117610b None None] MFA Rules not processed for user `165270b3c7594f98ad74df5e973f36b6`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-518b2182-69e8-474f-9582-f355d117610b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0d54c1-c537-4b0f-804b-22ed0f356b28 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fddfc6a-779e-474d-9f26-14a69405677c None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fddfc6a-779e-474d-9f26-14a69405677c None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fddfc6a-779e-474d-9f26-14a69405677c None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fddfc6a-779e-474d-9f26-14a69405677c None admin] PATH_INFO: `/v3/roles` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fddfc6a-779e-474d-9f26-14a69405677c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fddfc6a-779e-474d-9f26-14a69405677c None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 879/1780] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 12:57:12 2024] GET /identity/v3/roles => generated 1680 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fddfc6a-779e-474d-9f26-14a69405677c None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fddfc6a-779e-474d-9f26-14a69405677c None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171f77f7-fa65-418b-936f-b6c5ceac93d9 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171f77f7-fa65-418b-936f-b6c5ceac93d9 None admin] REQUEST_METHOD: `PUT` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171f77f7-fa65-418b-936f-b6c5ceac93d9 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171f77f7-fa65-418b-936f-b6c5ceac93d9 None admin] PATH_INFO: `/v3/projects/366171b6e44f4129bbd7dae20def74e5/users/330379bfc1e8469981f6265eca405f7b/roles/e7989893488f483baa107be56668c4f8` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171f77f7-fa65-418b-936f-b6c5ceac93d9 None admin] RBAC: Authorizing `identity:create_grant(project_id=366171b6e44f4129bbd7dae20def74e5, user_id=330379bfc1e8469981f6265eca405f7b, role_id=e7989893488f483baa107be56668c4f8)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171f77f7-fa65-418b-936f-b6c5ceac93d9 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 880/1781] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 12:57:12 2024] PUT /identity/v3/projects/366171b6e44f4129bbd7dae20def74e5/users/330379bfc1e8469981f6265eca405f7b/roles/e7989893488f483baa107be56668c4f8 => generated 0 bytes in 18 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b216905b-3320-474d-9240-bd9c1129de13 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b216905b-3320-474d-9240-bd9c1129de13 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b216905b-3320-474d-9240-bd9c1129de13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 902/1782] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:57:12 2024] POST /identity/v3/auth/tokens => generated 3964 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518b2182-69e8-474f-9582-f355d117610b None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518b2182-69e8-474f-9582-f355d117610b None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-b216905b-3320-474d-9240-bd9c1129de13 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:57:12 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-bbf758da-a5e5-4efa-9481-28cdc0a18883 tempest-AccessRulesMetadataTest-1973590610 None] Created reservations ['10d488be-b750-4260-8704-53a4331f1243', '81c02b6f-718f-4234-8147-7d28a735b766', 'bbf6fe19-d845-4fc7-a619-f9ba9cb7f30b', '54bbd703-7da4-4dc2-86bd-d93e04c5412b'] {{(pid=98474) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-b216905b-3320-474d-9240-bd9c1129de13 None None] MFA Rules not processed for user `330379bfc1e8469981f6265eca405f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-b216905b-3320-474d-9240-bd9c1129de13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a7c03c-6a13-4b89-9029-cb3a6d6a8e23 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a7c03c-6a13-4b89-9029-cb3a6d6a8e23 None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a7c03c-6a13-4b89-9029-cb3a6d6a8e23 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a7c03c-6a13-4b89-9029-cb3a6d6a8e23 None admin] PATH_INFO: `/v3/projects` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a7c03c-6a13-4b89-9029-cb3a6d6a8e23 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a7c03c-6a13-4b89-9029-cb3a6d6a8e23 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:12 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-01a2ae14-f15d-4183-924e-4ad9803a3801 tempest-ShareSnapshotInstancesTest-843694899 None] >>> [GET] https://127.0.0.1:40443/api/vippools/ May 28 12:57:12 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-01a2ae14-f15d-4183-924e-4ad9803a3801 tempest-ShareSnapshotInstancesTest-843694899 None] {'allow_redirects': True, 'params': {'name': 'vippool-1'}} May 28 12:57:12 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-bbf758da-a5e5-4efa-9481-28cdc0a18883 tempest-AccessRulesMetadataTest-1973590610 None] Committed reservations ['10d488be-b750-4260-8704-53a4331f1243', '81c02b6f-718f-4234-8147-7d28a735b766', 'bbf6fe19-d845-4fc7-a619-f9ba9cb7f30b', '54bbd703-7da4-4dc2-86bd-d93e04c5412b'] {{(pid=98474) commit /opt/stack/manila/manila/quota.py:1063}} May 28 12:57:12 l75lg1-v1 manila-share[98474]: INFO manila.share.manager [None req-bbf758da-a5e5-4efa-9481-28cdc0a18883 tempest-AccessRulesMetadataTest-1973590610 None] Share instance 95118a75-173c-4257-acef-78a246ee1c67: deleted successfully. May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 903/1783] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 12:57:12 2024] POST /identity/v3/projects => generated 393 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a7c03c-6a13-4b89-9029-cb3a6d6a8e23 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 881/1784] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:57:12 2024] POST /identity/v3/auth/tokens => generated 4077 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b216905b-3320-474d-9240-bd9c1129de13 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-b216905b-3320-474d-9240-bd9c1129de13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a7c03c-6a13-4b89-9029-cb3a6d6a8e23 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4797be-0c26-472e-8fe3-4f052ddf6bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4797be-0c26-472e-8fe3-4f052ddf6bc8 None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4797be-0c26-472e-8fe3-4f052ddf6bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4797be-0c26-472e-8fe3-4f052ddf6bc8 None admin] PATH_INFO: `/v3/users` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4797be-0c26-472e-8fe3-4f052ddf6bc8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4797be-0c26-472e-8fe3-4f052ddf6bc8 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-bb4797be-0c26-472e-8fe3-4f052ddf6bc8 None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 12:57:12 l75lg1-v1 cinder-volume[85846]: DEBUG dbcounter [-] [85846] Writing DB stats cinder:SELECT=1 {{(pid=85846) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:57:12 l75lg1-v1 cinder-volume[85846]: DEBUG dbcounter [-] [85846] Writing DB stats cinder:UPDATE=1 {{(pid=85846) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 904/1785] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 12:57:12 2024] POST /identity/v3/users => generated 304 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4797be-0c26-472e-8fe3-4f052ddf6bc8 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4797be-0c26-472e-8fe3-4f052ddf6bc8 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b216905b-3320-474d-9240-bd9c1129de13 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6099331-bef7-47b1-a511-5ffef91aa62d None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6099331-bef7-47b1-a511-5ffef91aa62d None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6099331-bef7-47b1-a511-5ffef91aa62d None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6099331-bef7-47b1-a511-5ffef91aa62d None admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6099331-bef7-47b1-a511-5ffef91aa62d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6099331-bef7-47b1-a511-5ffef91aa62d None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 905/1786] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 12:57:12 2024] GET /identity/v3/roles => generated 1680 bytes in 15 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6099331-bef7-47b1-a511-5ffef91aa62d None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6099331-bef7-47b1-a511-5ffef91aa62d None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a4b03c-b28a-4278-a9ff-ff666a5ca64e None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a4b03c-b28a-4278-a9ff-ff666a5ca64e None admin] REQUEST_METHOD: `PUT` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a4b03c-b28a-4278-a9ff-ff666a5ca64e None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a4b03c-b28a-4278-a9ff-ff666a5ca64e None admin] PATH_INFO: `/v3/projects/1ae8e27013bc48228edf3022159a9c1f/users/be38ad37856445168a42a6912c87bc8b/roles/e7989893488f483baa107be56668c4f8` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a4b03c-b28a-4278-a9ff-ff666a5ca64e None admin] RBAC: Authorizing `identity:create_grant(project_id=1ae8e27013bc48228edf3022159a9c1f, user_id=be38ad37856445168a42a6912c87bc8b, role_id=e7989893488f483baa107be56668c4f8)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a4b03c-b28a-4278-a9ff-ff666a5ca64e None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05cee36-3101-4f0a-aba8-c0270f366a3f service manila] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f110cf6300f049c897d0aab63218d1e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05cee36-3101-4f0a-aba8-c0270f366a3f service manila] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05cee36-3101-4f0a-aba8-c0270f366a3f service manila] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05cee36-3101-4f0a-aba8-c0270f366a3f service manila] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 906/1787] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 12:57:12 2024] PUT /identity/v3/projects/1ae8e27013bc48228edf3022159a9c1f/users/be38ad37856445168a42a6912c87bc8b/roles/e7989893488f483baa107be56668c4f8 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a4b03c-b28a-4278-a9ff-ff666a5ca64e None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:12 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-bf304d63-f520-42c4-9575-3268ca5e3ec5 tempest-AccessRulesMetadataTest-1973590610 tempest-AccessRulesMetadataTest-1973590610-project-member] GET http://10.27.203.238/share/v2/1643901550e140118fc2d2e92b82cd0b/shares/b92fc06b-76d7-40f9-adef-74a07ace1027 May 28 12:57:12 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-bf304d63-f520-42c4-9575-3268ca5e3ec5 tempest-AccessRulesMetadataTest-1973590610 tempest-AccessRulesMetadataTest-1973590610-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:12 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-bf304d63-f520-42c4-9575-3268ca5e3ec5 tempest-AccessRulesMetadataTest-1973590610 tempest-AccessRulesMetadataTest-1973590610-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:12 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-bf304d63-f520-42c4-9575-3268ca5e3ec5 tempest-AccessRulesMetadataTest-1973590610 tempest-AccessRulesMetadataTest-1973590610-project-member] HTTP exception thrown: The resource could not be found. May 28 12:57:12 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-bf304d63-f520-42c4-9575-3268ca5e3ec5 tempest-AccessRulesMetadataTest-1973590610 tempest-AccessRulesMetadataTest-1973590610-project-member] http://10.27.203.238/share/v2/1643901550e140118fc2d2e92b82cd0b/shares/b92fc06b-76d7-40f9-adef-74a07ace1027 returned with HTTP 404 May 28 12:57:12 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 257/498] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:57:12 2024] GET /share/v2/1643901550e140118fc2d2e92b82cd0b/shares/b92fc06b-76d7-40f9-adef-74a07ace1027 => generated 78 bytes in 12 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 12:57:12 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-6681e8da-3f71-4cba-8292-fb6a4f62b625 tempest-AccessRulesMetadataTest-1677117720 tempest-AccessRulesMetadataTest-1677117720-project-admin] DELETE http://10.27.203.238/share/v2/43ff8cffa80748308f619a3e52a285f2/types/1071aa1e-8bcd-482c-909b-1df990558c3a May 28 12:57:12 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-6681e8da-3f71-4cba-8292-fb6a4f62b625 tempest-AccessRulesMetadataTest-1677117720 tempest-AccessRulesMetadataTest-1677117720-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:12 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-6681e8da-3f71-4cba-8292-fb6a4f62b625 tempest-AccessRulesMetadataTest-1677117720 tempest-AccessRulesMetadataTest-1677117720-project-admin] Calling method 'ShareTypesController._delete' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a4b03c-b28a-4278-a9ff-ff666a5ca64e None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8bc9a3-b70f-4542-aaa7-6fdff1d29ddc None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8bc9a3-b70f-4542-aaa7-6fdff1d29ddc None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8bc9a3-b70f-4542-aaa7-6fdff1d29ddc None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8bc9a3-b70f-4542-aaa7-6fdff1d29ddc None admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8bc9a3-b70f-4542-aaa7-6fdff1d29ddc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8bc9a3-b70f-4542-aaa7-6fdff1d29ddc None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05cee36-3101-4f0a-aba8-c0270f366a3f service manila] RBAC: Authorizing `identity:validate_token()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05cee36-3101-4f0a-aba8-c0270f366a3f service manila] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 882/1788] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 12:57:12 2024] GET /identity/v3/auth/tokens => generated 4077 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 907/1789] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 12:57:12 2024] GET /identity/v3/roles => generated 1680 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05cee36-3101-4f0a-aba8-c0270f366a3f service manila] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:12 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-71bc0248-ad34-4c00-9b81-56d3b6ed4afd tempest-ExtraSpecsReadAdminTest-352063724 tempest-ExtraSpecsReadAdminTest-352063724-project-admin] POST http://10.27.203.238/share/v2/366171b6e44f4129bbd7dae20def74e5/types May 28 12:57:12 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-71bc0248-ad34-4c00-9b81-56d3b6ed4afd tempest-ExtraSpecsReadAdminTest-352063724 tempest-ExtraSpecsReadAdminTest-352063724-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share_type": {"name": "tempest-share-type-1862669297", "extra_specs": {"driver_handles_share_servers": "False"}, "share_type_access:is_public": true}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05cee36-3101-4f0a-aba8-c0270f366a3f service manila] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503f52b0-1c72-45ed-a859-febb89b27fc8 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503f52b0-1c72-45ed-a859-febb89b27fc8 None admin] REQUEST_METHOD: `PUT` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503f52b0-1c72-45ed-a859-febb89b27fc8 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503f52b0-1c72-45ed-a859-febb89b27fc8 None admin] PATH_INFO: `/v3/projects/1ae8e27013bc48228edf3022159a9c1f/users/be38ad37856445168a42a6912c87bc8b/roles/e7989893488f483baa107be56668c4f8` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503f52b0-1c72-45ed-a859-febb89b27fc8 None admin] RBAC: Authorizing `identity:create_grant(project_id=1ae8e27013bc48228edf3022159a9c1f, user_id=be38ad37856445168a42a6912c87bc8b, role_id=e7989893488f483baa107be56668c4f8)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503f52b0-1c72-45ed-a859-febb89b27fc8 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 883/1790] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 12:57:12 2024] PUT /identity/v3/projects/1ae8e27013bc48228edf3022159a9c1f/users/be38ad37856445168a42a6912c87bc8b/roles/e7989893488f483baa107be56668c4f8 => generated 0 bytes in 18 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:57:12 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-71bc0248-ad34-4c00-9b81-56d3b6ed4afd tempest-ExtraSpecsReadAdminTest-352063724 tempest-ExtraSpecsReadAdminTest-352063724-project-admin] http://10.27.203.238/share/v2/366171b6e44f4129bbd7dae20def74e5/types returned with HTTP 200 May 28 12:57:12 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 242/499] 10.27.203.238 () {66 vars in 1359 bytes} [Tue May 28 12:57:12 2024] POST /share/v2/366171b6e44f4129bbd7dae20def74e5/types => generated 615 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481b773e-86f7-4cde-b4c4-10a7c7f8f9ff None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481b773e-86f7-4cde-b4c4-10a7c7f8f9ff None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481b773e-86f7-4cde-b4c4-10a7c7f8f9ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:12 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-21b48d89-20ab-48ef-9537-e9f14e14ffab tempest-ExtraSpecsReadAdminTest-352063724 tempest-ExtraSpecsReadAdminTest-352063724-project-admin] POST http://10.27.203.238/share/v1/366171b6e44f4129bbd7dae20def74e5/types/fa0865a5-bbf6-4939-ba42-07804ff949da/extra_specs May 28 12:57:12 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-21b48d89-20ab-48ef-9537-e9f14e14ffab tempest-ExtraSpecsReadAdminTest-352063724 tempest-ExtraSpecsReadAdminTest-352063724-project-admin] Action: 'create', calling method: ShareTypeExtraSpecsController.create, body: {"extra_specs": {"key1": "value1", "key2": "value2"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-481b773e-86f7-4cde-b4c4-10a7c7f8f9ff None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-481b773e-86f7-4cde-b4c4-10a7c7f8f9ff None None] MFA Rules not processed for user `be38ad37856445168a42a6912c87bc8b`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-481b773e-86f7-4cde-b4c4-10a7c7f8f9ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:12 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-21b48d89-20ab-48ef-9537-e9f14e14ffab tempest-ExtraSpecsReadAdminTest-352063724 tempest-ExtraSpecsReadAdminTest-352063724-project-admin] http://10.27.203.238/share/v1/366171b6e44f4129bbd7dae20def74e5/types/fa0865a5-bbf6-4939-ba42-07804ff949da/extra_specs returned with HTTP 200 May 28 12:57:12 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 243/500] 10.27.203.238 () {64 vars in 1462 bytes} [Tue May 28 12:57:12 2024] POST /share/v1/366171b6e44f4129bbd7dae20def74e5/types/fa0865a5-bbf6-4939-ba42-07804ff949da/extra_specs => generated 53 bytes in 28 msecs (HTTP/1.1 200) 6 headers in 229 bytes (2 switches on core 0) May 28 12:57:12 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-2afdb45e-8e99-4f49-b9e7-8a03dfa3f9f8 tempest-ExtraSpecsReadAdminTest-352063724 tempest-ExtraSpecsReadAdminTest-352063724-project-admin] GET http://10.27.203.238/share/v1/366171b6e44f4129bbd7dae20def74e5/types/fa0865a5-bbf6-4939-ba42-07804ff949da/extra_specs May 28 12:57:12 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-2afdb45e-8e99-4f49-b9e7-8a03dfa3f9f8 tempest-ExtraSpecsReadAdminTest-352063724 tempest-ExtraSpecsReadAdminTest-352063724-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:12 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-2afdb45e-8e99-4f49-b9e7-8a03dfa3f9f8 tempest-ExtraSpecsReadAdminTest-352063724 tempest-ExtraSpecsReadAdminTest-352063724-project-admin] Calling method 'ShareTypeExtraSpecsController.index' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:12 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-2afdb45e-8e99-4f49-b9e7-8a03dfa3f9f8 tempest-ExtraSpecsReadAdminTest-352063724 tempest-ExtraSpecsReadAdminTest-352063724-project-admin] http://10.27.203.238/share/v1/366171b6e44f4129bbd7dae20def74e5/types/fa0865a5-bbf6-4939-ba42-07804ff949da/extra_specs returned with HTTP 200 May 28 12:57:12 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 244/501] 10.27.203.238 () {62 vars in 1441 bytes} [Tue May 28 12:57:12 2024] GET /share/v1/366171b6e44f4129bbd7dae20def74e5/types/fa0865a5-bbf6-4939-ba42-07804ff949da/extra_specs => generated 94 bytes in 12 msecs (HTTP/1.1 200) 6 headers in 229 bytes (2 switches on core 0) May 28 12:57:12 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-7ff46e7a-c4ae-4e95-9fa7-7bc37bd52df1 tempest-ExtraSpecsReadAdminTest-352063724 tempest-ExtraSpecsReadAdminTest-352063724-project-admin] GET http://10.27.203.238/share/v1/366171b6e44f4129bbd7dae20def74e5/types/fa0865a5-bbf6-4939-ba42-07804ff949da/extra_specs/key1 May 28 12:57:12 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-7ff46e7a-c4ae-4e95-9fa7-7bc37bd52df1 tempest-ExtraSpecsReadAdminTest-352063724 tempest-ExtraSpecsReadAdminTest-352063724-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:12 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-7ff46e7a-c4ae-4e95-9fa7-7bc37bd52df1 tempest-ExtraSpecsReadAdminTest-352063724 tempest-ExtraSpecsReadAdminTest-352063724-project-admin] Calling method 'ShareTypeExtraSpecsController.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:12 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-7ff46e7a-c4ae-4e95-9fa7-7bc37bd52df1 tempest-ExtraSpecsReadAdminTest-352063724 tempest-ExtraSpecsReadAdminTest-352063724-project-admin] http://10.27.203.238/share/v1/366171b6e44f4129bbd7dae20def74e5/types/fa0865a5-bbf6-4939-ba42-07804ff949da/extra_specs/key1 returned with HTTP 200 May 28 12:57:12 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 245/502] 10.27.203.238 () {62 vars in 1456 bytes} [Tue May 28 12:57:12 2024] GET /share/v1/366171b6e44f4129bbd7dae20def74e5/types/fa0865a5-bbf6-4939-ba42-07804ff949da/extra_specs/key1 => generated 18 bytes in 12 msecs (HTTP/1.1 200) 6 headers in 229 bytes (2 switches on core 0) May 28 12:57:12 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-8cb7444c-e69d-4c17-9413-424877fa816e tempest-ExtraSpecsReadAdminTest-352063724 tempest-ExtraSpecsReadAdminTest-352063724-project-admin] DELETE http://10.27.203.238/share/v2/366171b6e44f4129bbd7dae20def74e5/types/fa0865a5-bbf6-4939-ba42-07804ff949da May 28 12:57:12 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-8cb7444c-e69d-4c17-9413-424877fa816e tempest-ExtraSpecsReadAdminTest-352063724 tempest-ExtraSpecsReadAdminTest-352063724-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:12 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-8cb7444c-e69d-4c17-9413-424877fa816e tempest-ExtraSpecsReadAdminTest-352063724 tempest-ExtraSpecsReadAdminTest-352063724-project-admin] Calling method 'ShareTypesController._delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 908/1791] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:57:12 2024] POST /identity/v3/auth/tokens => generated 4087 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503f52b0-1c72-45ed-a859-febb89b27fc8 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503f52b0-1c72-45ed-a859-febb89b27fc8 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:12 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-01a2ae14-f15d-4183-924e-4ad9803a3801 tempest-ShareSnapshotInstancesTest-843694899 None] <<< [GET] https://127.0.0.1:40443/api/vippools/ May 28 12:57:12 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-01a2ae14-f15d-4183-924e-4ad9803a3801 tempest-ShareSnapshotInstancesTest-843694899 None] [Bunch(active_cnode_ids=[], active_interfaces=4, cluster='loop75-kfs', cluster_id=1, cnode_ids=[], cnodes=[], domain_name='vippool-1', enable_l3=False, enable_weighted_balancing=False, enabled=True, end_ip='172.21.75.4', guid='f2abaede-b397-413a-8faa-3aeead6d3b28', gw_ip='', gw_ipv6='', id=2, ip_ranges=[['172.21.75.1', '172.21.75.4']], name='vippool-1', peer_asn=0, port_membership='ALL', ranges_summary='172.21.75.[1-4]', role='PROTOCOLS', start_ip='172.21.75.1', subnet_cidr=16, subnet_cidr_ipv6=None, sync='SYNCED', sync_time='2024-05-28T12:50:09.644123Z', tenant_id=1, tenant_name='default', title='172.21.75.1 - 172.21.75.4', url='https://127.0.0.1:40443/api/vippools/2/', vast_asn=0, vlan=0, vms_preferred=False)] May 28 12:57:12 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-01a2ae14-f15d-4183-924e-4ad9803a3801 tempest-ShareSnapshotInstancesTest-843694899 None] --- [GET] https://127.0.0.1:40443/api/vippools/: Done May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4694a4-865f-4522-9780-37c5b9cb2207 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be38ad37856445168a42a6912c87bc8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae8e27013bc48228edf3022159a9c1f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4694a4-865f-4522-9780-37c5b9cb2207 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4694a4-865f-4522-9780-37c5b9cb2207 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4694a4-865f-4522-9780-37c5b9cb2207 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] PATH_INFO: `/v3/domains` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:12 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-01a2ae14-f15d-4183-924e-4ad9803a3801 tempest-ShareSnapshotInstancesTest-843694899 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:57:12 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-01a2ae14-f15d-4183-924e-4ad9803a3801 tempest-ShareSnapshotInstancesTest-843694899 None] {'allow_redirects': True, May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4694a4-865f-4522-9780-37c5b9cb2207 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4694a4-865f-4522-9780-37c5b9cb2207 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:12 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-01a2ae14-f15d-4183-924e-4ad9803a3801 tempest-ShareSnapshotInstancesTest-843694899 None] 'params': {'name': 'c2f741cd-bac5-499f-9539-8e93d6a81282'}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4694a4-865f-4522-9780-37c5b9cb2207 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:12 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-8cb7444c-e69d-4c17-9413-424877fa816e tempest-ExtraSpecsReadAdminTest-352063724 tempest-ExtraSpecsReadAdminTest-352063724-project-admin] http://10.27.203.238/share/v2/366171b6e44f4129bbd7dae20def74e5/types/fa0865a5-bbf6-4939-ba42-07804ff949da returned with HTTP 202 May 28 12:57:12 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 246/503] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:57:12 2024] DELETE /share/v2/366171b6e44f4129bbd7dae20def74e5/types/fa0865a5-bbf6-4939-ba42-07804ff949da => generated 0 bytes in 42 msecs (HTTP/1.1 202) 6 headers in 243 bytes (2 switches on core 0) May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 884/1792] 10.27.203.238 () {62 vars in 1241 bytes} [Tue May 28 12:57:12 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481b773e-86f7-4cde-b4c4-10a7c7f8f9ff None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:12 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-63e2c0c8-0238-465b-8959-961815e84a2d tempest-ExtraSpecsReadAdminTest-352063724 tempest-ExtraSpecsReadAdminTest-352063724-project-admin] GET http://10.27.203.238/share/v2/366171b6e44f4129bbd7dae20def74e5/types/fa0865a5-bbf6-4939-ba42-07804ff949da May 28 12:57:12 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-63e2c0c8-0238-465b-8959-961815e84a2d tempest-ExtraSpecsReadAdminTest-352063724 tempest-ExtraSpecsReadAdminTest-352063724-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:12 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-63e2c0c8-0238-465b-8959-961815e84a2d tempest-ExtraSpecsReadAdminTest-352063724 tempest-ExtraSpecsReadAdminTest-352063724-project-admin] Calling method 'ShareTypesController.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481b773e-86f7-4cde-b4c4-10a7c7f8f9ff None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:12 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-63e2c0c8-0238-465b-8959-961815e84a2d tempest-ExtraSpecsReadAdminTest-352063724 tempest-ExtraSpecsReadAdminTest-352063724-project-admin] HTTP exception thrown: Share type not found. May 28 12:57:12 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-63e2c0c8-0238-465b-8959-961815e84a2d tempest-ExtraSpecsReadAdminTest-352063724 tempest-ExtraSpecsReadAdminTest-352063724-project-admin] http://10.27.203.238/share/v2/366171b6e44f4129bbd7dae20def74e5/types/fa0865a5-bbf6-4939-ba42-07804ff949da returned with HTTP 404 May 28 12:57:12 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 247/504] 10.27.203.238 () {64 vars in 1448 bytes} [Tue May 28 12:57:12 2024] GET /share/v2/366171b6e44f4129bbd7dae20def74e5/types/fa0865a5-bbf6-4939-ba42-07804ff949da => generated 67 bytes in 10 msecs (HTTP/1.1 404) 6 headers in 237 bytes (2 switches on core 0) May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4361a87-7cd4-482a-866a-9fdfb4014585 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be38ad37856445168a42a6912c87bc8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae8e27013bc48228edf3022159a9c1f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4361a87-7cd4-482a-866a-9fdfb4014585 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4361a87-7cd4-482a-866a-9fdfb4014585 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4361a87-7cd4-482a-866a-9fdfb4014585 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] PATH_INFO: `/v3/users` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4361a87-7cd4-482a-866a-9fdfb4014585 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4361a87-7cd4-482a-866a-9fdfb4014585 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4694a4-865f-4522-9780-37c5b9cb2207 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-a4361a87-7cd4-482a-866a-9fdfb4014585 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] Truncating password to algorithm specific maximum length 72 characters. May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 909/1793] 10.27.203.238 () {64 vars in 1232 bytes} [Tue May 28 12:57:12 2024] POST /identity/v3/users => generated 431 bytes in 32 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4361a87-7cd4-482a-866a-9fdfb4014585 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4694a4-865f-4522-9780-37c5b9cb2207 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4361a87-7cd4-482a-866a-9fdfb4014585 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eebb530-cb42-4569-bf56-a97b31b0aac7 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eebb530-cb42-4569-bf56-a97b31b0aac7 None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eebb530-cb42-4569-bf56-a97b31b0aac7 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eebb530-cb42-4569-bf56-a97b31b0aac7 None admin] PATH_INFO: `/v3/users/330379bfc1e8469981f6265eca405f7b` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ec21be-9819-4ea8-9e54-b37a38288c07 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be38ad37856445168a42a6912c87bc8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae8e27013bc48228edf3022159a9c1f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ec21be-9819-4ea8-9e54-b37a38288c07 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ec21be-9819-4ea8-9e54-b37a38288c07 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eebb530-cb42-4569-bf56-a97b31b0aac7 None admin] RBAC: Authorizing `identity:delete_user(user_id=330379bfc1e8469981f6265eca405f7b)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ec21be-9819-4ea8-9e54-b37a38288c07 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ec21be-9819-4ea8-9e54-b37a38288c07 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eebb530-cb42-4569-bf56-a97b31b0aac7 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ec21be-9819-4ea8-9e54-b37a38288c07 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 910/1794] 10.27.203.238 () {62 vars in 1210 bytes} [Tue May 28 12:57:12 2024] GET /identity/v3/roles => generated 1680 bytes in 19 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ec21be-9819-4ea8-9e54-b37a38288c07 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ec21be-9819-4ea8-9e54-b37a38288c07 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:12 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-6681e8da-3f71-4cba-8292-fb6a4f62b625 tempest-AccessRulesMetadataTest-1677117720 tempest-AccessRulesMetadataTest-1677117720-project-admin] http://10.27.203.238/share/v2/43ff8cffa80748308f619a3e52a285f2/types/1071aa1e-8bcd-482c-909b-1df990558c3a returned with HTTP 202 May 28 12:57:12 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 258/505] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:57:12 2024] DELETE /share/v2/43ff8cffa80748308f619a3e52a285f2/types/1071aa1e-8bcd-482c-909b-1df990558c3a => generated 0 bytes in 216 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047f653c-fd26-4040-850c-cf275d8f1f98 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be38ad37856445168a42a6912c87bc8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae8e27013bc48228edf3022159a9c1f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047f653c-fd26-4040-850c-cf275d8f1f98 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] REQUEST_METHOD: `PUT` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047f653c-fd26-4040-850c-cf275d8f1f98 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047f653c-fd26-4040-850c-cf275d8f1f98 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] PATH_INFO: `/v3/projects/1ae8e27013bc48228edf3022159a9c1f/users/567edee5a37f498e8a3f54a933728377/roles/44620cad10ae407c90c91e2c296adb04` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:12 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-2fe987c2-ab86-4e1f-a2af-04e73252881d tempest-AccessRulesMetadataTest-1677117720 tempest-AccessRulesMetadataTest-1677117720-project-admin] GET http://10.27.203.238/share/v2/43ff8cffa80748308f619a3e52a285f2/types/1071aa1e-8bcd-482c-909b-1df990558c3a May 28 12:57:12 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-2fe987c2-ab86-4e1f-a2af-04e73252881d tempest-AccessRulesMetadataTest-1677117720 tempest-AccessRulesMetadataTest-1677117720-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:12 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-2fe987c2-ab86-4e1f-a2af-04e73252881d tempest-AccessRulesMetadataTest-1677117720 tempest-AccessRulesMetadataTest-1677117720-project-admin] Calling method 'ShareTypesController.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:12 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-2fe987c2-ab86-4e1f-a2af-04e73252881d tempest-AccessRulesMetadataTest-1677117720 tempest-AccessRulesMetadataTest-1677117720-project-admin] HTTP exception thrown: Share type not found. May 28 12:57:12 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-2fe987c2-ab86-4e1f-a2af-04e73252881d tempest-AccessRulesMetadataTest-1677117720 tempest-AccessRulesMetadataTest-1677117720-project-admin] http://10.27.203.238/share/v2/43ff8cffa80748308f619a3e52a285f2/types/1071aa1e-8bcd-482c-909b-1df990558c3a returned with HTTP 404 May 28 12:57:12 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 248/506] 10.27.203.238 () {64 vars in 1448 bytes} [Tue May 28 12:57:12 2024] GET /share/v2/43ff8cffa80748308f619a3e52a285f2/types/1071aa1e-8bcd-482c-909b-1df990558c3a => generated 67 bytes in 12 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047f653c-fd26-4040-850c-cf275d8f1f98 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] RBAC: Authorizing `identity:create_grant(project_id=1ae8e27013bc48228edf3022159a9c1f, user_id=567edee5a37f498e8a3f54a933728377, role_id=44620cad10ae407c90c91e2c296adb04)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047f653c-fd26-4040-850c-cf275d8f1f98 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-5eebb530-cb42-4569-bf56-a97b31b0aac7 None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '330379bfc1e8469981f6265eca405f7b', 'request_id': 'req-5eebb530-cb42-4569-bf56-a97b31b0aac7'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-5eebb530-cb42-4569-bf56-a97b31b0aac7 None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '330379bfc1e8469981f6265eca405f7b', 'request_id': 'req-5eebb530-cb42-4569-bf56-a97b31b0aac7'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 911/1795] 10.27.203.238 () {64 vars in 1571 bytes} [Tue May 28 12:57:12 2024] PUT /identity/v3/projects/1ae8e27013bc48228edf3022159a9c1f/users/567edee5a37f498e8a3f54a933728377/roles/44620cad10ae407c90c91e2c296adb04 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047f653c-fd26-4040-850c-cf275d8f1f98 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-047f653c-fd26-4040-850c-cf275d8f1f98 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-5eebb530-cb42-4569-bf56-a97b31b0aac7 None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '330379bfc1e8469981f6265eca405f7b', 'request_id': 'req-5eebb530-cb42-4569-bf56-a97b31b0aac7'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-5eebb530-cb42-4569-bf56-a97b31b0aac7 None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '330379bfc1e8469981f6265eca405f7b', 'request_id': 'req-5eebb530-cb42-4569-bf56-a97b31b0aac7'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-5eebb530-cb42-4569-bf56-a97b31b0aac7 None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '330379bfc1e8469981f6265eca405f7b', 'request_id': 'req-5eebb530-cb42-4569-bf56-a97b31b0aac7'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 885/1796] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 12:57:12 2024] DELETE /identity/v3/users/330379bfc1e8469981f6265eca405f7b => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eebb530-cb42-4569-bf56-a97b31b0aac7 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-5eebb530-cb42-4569-bf56-a97b31b0aac7 None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047f653c-fd26-4040-850c-cf275d8f1f98 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2725cfc0-d104-4ec6-ada2-cac49fefbf98 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2725cfc0-d104-4ec6-ada2-cac49fefbf98 None admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2725cfc0-d104-4ec6-ada2-cac49fefbf98 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2725cfc0-d104-4ec6-ada2-cac49fefbf98 None admin] PATH_INFO: `/v3/users/d9c1ce8296ce4c059b93e7cfa130b326` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2725cfc0-d104-4ec6-ada2-cac49fefbf98 None admin] RBAC: Authorizing `identity:delete_user(user_id=d9c1ce8296ce4c059b93e7cfa130b326)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2725cfc0-d104-4ec6-ada2-cac49fefbf98 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eebb530-cb42-4569-bf56-a97b31b0aac7 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f79dbb-dfa5-41d7-96a7-cde1eebfe58a service manila] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f110cf6300f049c897d0aab63218d1e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f79dbb-dfa5-41d7-96a7-cde1eebfe58a service manila] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f79dbb-dfa5-41d7-96a7-cde1eebfe58a service manila] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f79dbb-dfa5-41d7-96a7-cde1eebfe58a service manila] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-04f79dbb-dfa5-41d7-96a7-cde1eebfe58a service manila] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f79dbb-dfa5-41d7-96a7-cde1eebfe58a service manila] RBAC: Authorizing `identity:validate_token()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f79dbb-dfa5-41d7-96a7-cde1eebfe58a service manila] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 886/1797] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 12:57:13 2024] GET /identity/v3/auth/tokens => generated 4087 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b906501a-3366-4320-970a-2d6f539a171f None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b906501a-3366-4320-970a-2d6f539a171f None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b906501a-3366-4320-970a-2d6f539a171f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:13 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 259/507] 10.27.203.238 () {66 vars in 1394 bytes} [Tue May 28 12:57:13 2024] POST /share/v2/1ae8e27013bc48228edf3022159a9c1f/types/extra_specs => generated 112 bytes in 120 msecs (HTTP/1.1 404) 3 headers in 98 bytes (1 switches on core 0) May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-b906501a-3366-4320-970a-2d6f539a171f None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:57:13 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-d2b3131a-4d35-428a-83a7-9ee39dc97344 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] POST http://10.27.203.238/share/v2/1ae8e27013bc48228edf3022159a9c1f/types May 28 12:57:13 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-d2b3131a-4d35-428a-83a7-9ee39dc97344 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share_type": {"name": "tempest-typeshare-type-74176224", "extra_specs": {"driver_handles_share_servers": "False", "key": "value"}, "share_type_access:is_public": true}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-b906501a-3366-4320-970a-2d6f539a171f None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-b906501a-3366-4320-970a-2d6f539a171f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-2725cfc0-d104-4ec6-ada2-cac49fefbf98 None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9c1ce8296ce4c059b93e7cfa130b326', 'request_id': 'req-2725cfc0-d104-4ec6-ada2-cac49fefbf98'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-2725cfc0-d104-4ec6-ada2-cac49fefbf98 None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9c1ce8296ce4c059b93e7cfa130b326', 'request_id': 'req-2725cfc0-d104-4ec6-ada2-cac49fefbf98'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-2725cfc0-d104-4ec6-ada2-cac49fefbf98 None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9c1ce8296ce4c059b93e7cfa130b326', 'request_id': 'req-2725cfc0-d104-4ec6-ada2-cac49fefbf98'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-2725cfc0-d104-4ec6-ada2-cac49fefbf98 None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9c1ce8296ce4c059b93e7cfa130b326', 'request_id': 'req-2725cfc0-d104-4ec6-ada2-cac49fefbf98'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:13 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-d2b3131a-4d35-428a-83a7-9ee39dc97344 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] http://10.27.203.238/share/v2/1ae8e27013bc48228edf3022159a9c1f/types returned with HTTP 200 May 28 12:57:13 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 249/508] 10.27.203.238 () {66 vars in 1359 bytes} [Tue May 28 12:57:13 2024] POST /share/v2/1ae8e27013bc48228edf3022159a9c1f/types => generated 651 bytes in 22 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:57:13 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-02a512a7-83cd-4e06-9740-3ba558ccc4ad tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] POST http://10.27.203.238/share/v2/1ae8e27013bc48228edf3022159a9c1f/types/91a21269-ee12-4daa-82dd-9acbd2740926/extra_specs May 28 12:57:13 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-02a512a7-83cd-4e06-9740-3ba558ccc4ad tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] Action: 'create', calling method: ShareTypeExtraSpecsController.create, body: {"extra_specs": ""} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 887/1798] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:57:13 2024] POST /identity/v3/auth/tokens => generated 2960 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 12:57:13 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-02a512a7-83cd-4e06-9740-3ba558ccc4ad tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] HTTP exception thrown: The server could not comply with the request since it is either malformed or otherwise incorrect. May 28 12:57:13 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-02a512a7-83cd-4e06-9740-3ba558ccc4ad tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] http://10.27.203.238/share/v2/1ae8e27013bc48228edf3022159a9c1f/types/91a21269-ee12-4daa-82dd-9acbd2740926/extra_specs returned with HTTP 400 May 28 12:57:13 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 260/509] 10.27.203.238 () {66 vars in 1505 bytes} [Tue May 28 12:57:13 2024] POST /share/v2/1ae8e27013bc48228edf3022159a9c1f/types/91a21269-ee12-4daa-82dd-9acbd2740926/extra_specs => generated 141 bytes in 6 msecs (HTTP/1.1 400) 6 headers in 240 bytes (1 switches on core 0) May 28 12:57:13 l75lg1-v1 neutron-server[77619]: DEBUG neutron.wsgi [-] (77619) accepted ('10.27.203.238', 58642) {{(pid=77619) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b906501a-3366-4320-970a-2d6f539a171f None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:13 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-177e8284-9ac9-4723-9d0f-043b03f96cf3 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] POST http://10.27.203.238/share/v2/1ae8e27013bc48228edf3022159a9c1f/types/tempest-fake-606689747/extra_specs May 28 12:57:13 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-177e8284-9ac9-4723-9d0f-043b03f96cf3 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] Action: 'create', calling method: ShareTypeExtraSpecsController.create, body: {"extra_specs": {"key1": "value1"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-b906501a-3366-4320-970a-2d6f539a171f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-2725cfc0-d104-4ec6-ada2-cac49fefbf98 None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9c1ce8296ce4c059b93e7cfa130b326', 'request_id': 'req-2725cfc0-d104-4ec6-ada2-cac49fefbf98'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:13 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-177e8284-9ac9-4723-9d0f-043b03f96cf3 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] HTTP exception thrown: Share type tempest-fake-606689747 could not be found. May 28 12:57:13 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-177e8284-9ac9-4723-9d0f-043b03f96cf3 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] http://10.27.203.238/share/v2/1ae8e27013bc48228edf3022159a9c1f/types/tempest-fake-606689747/extra_specs returned with HTTP 404 May 28 12:57:13 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 250/510] 10.27.203.238 () {66 vars in 1463 bytes} [Tue May 28 12:57:13 2024] POST /share/v2/1ae8e27013bc48228edf3022159a9c1f/types/tempest-fake-606689747/extra_specs => generated 99 bytes in 9 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 12:57:13 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-2e6c98d3-e5af-417c-8c21-ef0b2b3cae6c tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] POST http://10.27.203.238/share/v2/1ae8e27013bc48228edf3022159a9c1f/types May 28 12:57:13 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-2e6c98d3-e5af-417c-8c21-ef0b2b3cae6c tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share_type": {"name": "tempest-typeshare-type-1531386496", "extra_specs": {"driver_handles_share_servers": "False", "key": "value"}, "share_type_access:is_public": true}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 912/1799] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 12:57:13 2024] DELETE /identity/v3/users/d9c1ce8296ce4c059b93e7cfa130b326 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2725cfc0-d104-4ec6-ada2-cac49fefbf98 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-2725cfc0-d104-4ec6-ada2-cac49fefbf98 None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:13 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-2e6c98d3-e5af-417c-8c21-ef0b2b3cae6c tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] http://10.27.203.238/share/v2/1ae8e27013bc48228edf3022159a9c1f/types returned with HTTP 200 May 28 12:57:13 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 261/511] 10.27.203.238 () {66 vars in 1359 bytes} [Tue May 28 12:57:13 2024] POST /share/v2/1ae8e27013bc48228edf3022159a9c1f/types => generated 655 bytes in 29 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:57:13 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-6f5ad776-8eae-4371-8786-d18559085c8e tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] POST http://10.27.203.238/share/v2/1ae8e27013bc48228edf3022159a9c1f/types/a7d3ef8e-a59b-4a67-a67e-d09569da9eef/extra_specs May 28 12:57:13 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-6f5ad776-8eae-4371-8786-d18559085c8e tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] Action: 'create', calling method: ShareTypeExtraSpecsController.create, body: {"extra_specs": {"": "value_with_empty_key"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:57:13 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-6f5ad776-8eae-4371-8786-d18559085c8e tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] HTTP exception thrown: Invalid extra_spec: : value_with_empty_key May 28 12:57:13 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-6f5ad776-8eae-4371-8786-d18559085c8e tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] http://10.27.203.238/share/v2/1ae8e27013bc48228edf3022159a9c1f/types/a7d3ef8e-a59b-4a67-a67e-d09569da9eef/extra_specs returned with HTTP 400 May 28 12:57:13 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 251/512] 10.27.203.238 () {66 vars in 1505 bytes} [Tue May 28 12:57:13 2024] POST /share/v2/1ae8e27013bc48228edf3022159a9c1f/types/a7d3ef8e-a59b-4a67-a67e-d09569da9eef/extra_specs => generated 86 bytes in 11 msecs (HTTP/1.1 400) 6 headers in 239 bytes (1 switches on core 0) May 28 12:57:13 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-591ba593-75df-48a2-8493-678e70c61353 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] POST http://10.27.203.238/share/v2/1ae8e27013bc48228edf3022159a9c1f/types May 28 12:57:13 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-591ba593-75df-48a2-8493-678e70c61353 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share_type": {"name": "tempest-typeshare-type-295728591", "extra_specs": {"driver_handles_share_servers": "False", "key": "value"}, "share_type_access:is_public": true}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2725cfc0-d104-4ec6-ada2-cac49fefbf98 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:13 l75lg1-v1 dstat.sh[49771]: 28-05 12:57:13| 25 3 66 5 0|5677M 1823M 277M 7849M| 17k 9991B| 0 3959k| 0 576 | 14k 26k|1.63 1.03 1.00|2.0 2.0 1.0| 0 0 | 0 2048M| 29 356 0 71 0 May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b906501a-3366-4320-970a-2d6f539a171f None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c99c7f5-1015-4f06-bded-265bffda5c68 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c99c7f5-1015-4f06-bded-265bffda5c68 None admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c99c7f5-1015-4f06-bded-265bffda5c68 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c99c7f5-1015-4f06-bded-265bffda5c68 None admin] PATH_INFO: `/v3/users/57329ed828864df2acbb7817c1a45fbc` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c99c7f5-1015-4f06-bded-265bffda5c68 None admin] RBAC: Authorizing `identity:delete_user(user_id=57329ed828864df2acbb7817c1a45fbc)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c99c7f5-1015-4f06-bded-265bffda5c68 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:13 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-591ba593-75df-48a2-8493-678e70c61353 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] http://10.27.203.238/share/v2/1ae8e27013bc48228edf3022159a9c1f/types returned with HTTP 200 May 28 12:57:13 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 262/513] 10.27.203.238 () {66 vars in 1359 bytes} [Tue May 28 12:57:13 2024] POST /share/v2/1ae8e27013bc48228edf3022159a9c1f/types => generated 653 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63dc978-11bd-4e16-a749-f99008ae54ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef17047035e4b518fd5360a01f2da1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63dc978-11bd-4e16-a749-f99008ae54ff service neutron] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63dc978-11bd-4e16-a749-f99008ae54ff service neutron] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63dc978-11bd-4e16-a749-f99008ae54ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63dc978-11bd-4e16-a749-f99008ae54ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63dc978-11bd-4e16-a749-f99008ae54ff service neutron] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 888/1800] 10.27.203.238 () {64 vars in 1432 bytes} [Tue May 28 12:57:13 2024] GET /identity/v3/auth/tokens => generated 2960 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63dc978-11bd-4e16-a749-f99008ae54ff service neutron] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-d63dc978-11bd-4e16-a749-f99008ae54ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:13 l75lg1-v1 neutron-server[77619]: INFO neutron.wsgi [None req-edc4b2ef-1cc2-469d-bd93-3daafb346e03 None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=366171b6e44f4129bbd7dae20def74e5&name=default HTTP/1.1" status: 200 len: 216 time: 0.1328437 May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-1c99c7f5-1015-4f06-bded-265bffda5c68 None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57329ed828864df2acbb7817c1a45fbc', 'request_id': 'req-1c99c7f5-1015-4f06-bded-265bffda5c68'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-1c99c7f5-1015-4f06-bded-265bffda5c68 None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57329ed828864df2acbb7817c1a45fbc', 'request_id': 'req-1c99c7f5-1015-4f06-bded-265bffda5c68'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-1c99c7f5-1015-4f06-bded-265bffda5c68 None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57329ed828864df2acbb7817c1a45fbc', 'request_id': 'req-1c99c7f5-1015-4f06-bded-265bffda5c68'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-1c99c7f5-1015-4f06-bded-265bffda5c68 None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57329ed828864df2acbb7817c1a45fbc', 'request_id': 'req-1c99c7f5-1015-4f06-bded-265bffda5c68'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63dc978-11bd-4e16-a749-f99008ae54ff service neutron] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-1c99c7f5-1015-4f06-bded-265bffda5c68 None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57329ed828864df2acbb7817c1a45fbc', 'request_id': 'req-1c99c7f5-1015-4f06-bded-265bffda5c68'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 913/1801] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 12:57:13 2024] DELETE /identity/v3/users/57329ed828864df2acbb7817c1a45fbc => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c99c7f5-1015-4f06-bded-265bffda5c68 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-1c99c7f5-1015-4f06-bded-265bffda5c68 None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75437e81-5b61-4474-a124-a2fd046c2aff service manila] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f110cf6300f049c897d0aab63218d1e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75437e81-5b61-4474-a124-a2fd046c2aff service manila] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75437e81-5b61-4474-a124-a2fd046c2aff service manila] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75437e81-5b61-4474-a124-a2fd046c2aff service manila] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-75437e81-5b61-4474-a124-a2fd046c2aff service manila] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c99c7f5-1015-4f06-bded-265bffda5c68 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf36714c-df27-40eb-856f-69c16dc139a4 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf36714c-df27-40eb-856f-69c16dc139a4 None admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf36714c-df27-40eb-856f-69c16dc139a4 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf36714c-df27-40eb-856f-69c16dc139a4 None admin] PATH_INFO: `/v3/projects/366171b6e44f4129bbd7dae20def74e5` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf36714c-df27-40eb-856f-69c16dc139a4 None admin] RBAC: Authorizing `identity:delete_project(project_id=366171b6e44f4129bbd7dae20def74e5)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf36714c-df27-40eb-856f-69c16dc139a4 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75437e81-5b61-4474-a124-a2fd046c2aff service manila] RBAC: Authorizing `identity:validate_token()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75437e81-5b61-4474-a124-a2fd046c2aff service manila] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 889/1802] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 12:57:13 2024] GET /identity/v3/auth/tokens => generated 3962 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75437e81-5b61-4474-a124-a2fd046c2aff service manila] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-75437e81-5b61-4474-a124-a2fd046c2aff service manila] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:13 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-4c31724e-8dc4-44a1-902a-6a00d72032fd tempest-ExtraSpecsAdminNegativeTest-773939988 tempest-ExtraSpecsAdminNegativeTest-773939988-project-member] POST http://10.27.203.238/share/v2/b459b0ac20ef4f348e8ff53468c5c935/types/763fbbc2-6098-48ca-99b0-54d1e100d3da/extra_specs May 28 12:57:13 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-4c31724e-8dc4-44a1-902a-6a00d72032fd tempest-ExtraSpecsAdminNegativeTest-773939988 tempest-ExtraSpecsAdminNegativeTest-773939988-project-member] Action: 'create', calling method: ShareTypeExtraSpecsController.create, body: {"extra_specs": {"driver_handles_share_servers": "False", "key": "new_value"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:57:13 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.policy [None req-4c31724e-8dc4-44a1-902a-6a00d72032fd tempest-ExtraSpecsAdminNegativeTest-773939988 tempest-ExtraSpecsAdminNegativeTest-773939988-project-member] Policy check for share_types_extra_spec:create failed with credentials {'is_admin': False, 'user_id': '7365146fcc404c988e9841963a43be27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b459b0ac20ef4f348e8ff53468c5c935', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98330) authorize /opt/stack/manila/manila/policy.py:208}} May 28 12:57:13 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-4c31724e-8dc4-44a1-902a-6a00d72032fd tempest-ExtraSpecsAdminNegativeTest-773939988 tempest-ExtraSpecsAdminNegativeTest-773939988-project-member] HTTP exception thrown: Access was denied to this resource. May 28 12:57:13 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-4c31724e-8dc4-44a1-902a-6a00d72032fd tempest-ExtraSpecsAdminNegativeTest-773939988 tempest-ExtraSpecsAdminNegativeTest-773939988-project-member] http://10.27.203.238/share/v2/b459b0ac20ef4f348e8ff53468c5c935/types/763fbbc2-6098-48ca-99b0-54d1e100d3da/extra_specs returned with HTTP 403 May 28 12:57:13 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 252/514] 10.27.203.238 () {66 vars in 1505 bytes} [Tue May 28 12:57:13 2024] POST /share/v2/b459b0ac20ef4f348e8ff53468c5c935/types/763fbbc2-6098-48ca-99b0-54d1e100d3da/extra_specs => generated 78 bytes in 155 msecs (HTTP/1.1 403) 6 headers in 237 bytes (1 switches on core 0) May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-cf36714c-df27-40eb-856f-69c16dc139a4 None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '366171b6e44f4129bbd7dae20def74e5', 'request_id': 'req-cf36714c-df27-40eb-856f-69c16dc139a4'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:13 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 263/515] 10.27.203.238 () {64 vars in 1388 bytes} [Tue May 28 12:57:13 2024] DELETE /share/v2/1ae8e27013bc48228edf3022159a9c1f/types/extra_specs/key => generated 112 bytes in 3 msecs (HTTP/1.1 404) 3 headers in 98 bytes (1 switches on core 0) May 28 12:57:13 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-01a2ae14-f15d-4183-924e-4ad9803a3801 tempest-ShareSnapshotInstancesTest-843694899 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:57:13 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-01a2ae14-f15d-4183-924e-4ad9803a3801 tempest-ShareSnapshotInstancesTest-843694899 None] [] May 28 12:57:13 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-01a2ae14-f15d-4183-924e-4ad9803a3801 tempest-ShareSnapshotInstancesTest-843694899 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 12:57:13 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-01a2ae14-f15d-4183-924e-4ad9803a3801 tempest-ShareSnapshotInstancesTest-843694899 None] >>> [POST] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:57:13 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-01a2ae14-f15d-4183-924e-4ad9803a3801 tempest-ShareSnapshotInstancesTest-843694899 None] {'data': '{"name": "c2f741cd-bac5-499f-9539-8e93d6a81282"}', May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-cf36714c-df27-40eb-856f-69c16dc139a4 None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '366171b6e44f4129bbd7dae20def74e5', 'request_id': 'req-cf36714c-df27-40eb-856f-69c16dc139a4'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:13 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-01a2ae14-f15d-4183-924e-4ad9803a3801 tempest-ShareSnapshotInstancesTest-843694899 None] 'json': None, May 28 12:57:13 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-01a2ae14-f15d-4183-924e-4ad9803a3801 tempest-ShareSnapshotInstancesTest-843694899 None] 'params': None} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-cf36714c-df27-40eb-856f-69c16dc139a4 None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '366171b6e44f4129bbd7dae20def74e5', 'request_id': 'req-cf36714c-df27-40eb-856f-69c16dc139a4'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:13 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-8622a0e4-86f7-419c-a5b5-c93df6597a15 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] DELETE http://10.27.203.238/share/v2/1ae8e27013bc48228edf3022159a9c1f/types/tempest-fake-308974077/extra_specs/key May 28 12:57:13 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-8622a0e4-86f7-419c-a5b5-c93df6597a15 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:13 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-8622a0e4-86f7-419c-a5b5-c93df6597a15 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:13 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-8622a0e4-86f7-419c-a5b5-c93df6597a15 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] HTTP exception thrown: Share type tempest-fake-308974077 could not be found. May 28 12:57:13 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-8622a0e4-86f7-419c-a5b5-c93df6597a15 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] http://10.27.203.238/share/v2/1ae8e27013bc48228edf3022159a9c1f/types/tempest-fake-308974077/extra_specs/key returned with HTTP 404 May 28 12:57:13 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 253/516] 10.27.203.238 () {64 vars in 1457 bytes} [Tue May 28 12:57:13 2024] DELETE /share/v2/1ae8e27013bc48228edf3022159a9c1f/types/tempest-fake-308974077/extra_specs/key => generated 99 bytes in 13 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75437e81-5b61-4474-a124-a2fd046c2aff service manila] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:13 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-8faa6160-99cd-4c9e-a779-1855b905fc82 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] POST http://10.27.203.238/share/v2/1ae8e27013bc48228edf3022159a9c1f/types May 28 12:57:13 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-8faa6160-99cd-4c9e-a779-1855b905fc82 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share_type": {"name": "tempest-typeshare-type-1930083457", "extra_specs": {"driver_handles_share_servers": "False", "key": "value"}, "share_type_access:is_public": true}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-cf36714c-df27-40eb-856f-69c16dc139a4 None admin] The token cache is being invalidate because project 366171b6e44f4129bbd7dae20def74e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-cf36714c-df27-40eb-856f-69c16dc139a4 None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-cf36714c-df27-40eb-856f-69c16dc139a4 None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 914/1803] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 12:57:13 2024] DELETE /identity/v3/projects/366171b6e44f4129bbd7dae20def74e5 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52095504-8a54-416e-999a-091c08c9be2c None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52095504-8a54-416e-999a-091c08c9be2c None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52095504-8a54-416e-999a-091c08c9be2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cbfae7-cabf-47a9-98aa-8d5e348a27ac None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cbfae7-cabf-47a9-98aa-8d5e348a27ac None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cbfae7-cabf-47a9-98aa-8d5e348a27ac None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cbfae7-cabf-47a9-98aa-8d5e348a27ac None admin] PATH_INFO: `/v3/users/521b52cb8ba745709f1904fcb99154d4` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cbfae7-cabf-47a9-98aa-8d5e348a27ac None admin] RBAC: Authorizing `identity:delete_user(user_id=521b52cb8ba745709f1904fcb99154d4)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cbfae7-cabf-47a9-98aa-8d5e348a27ac None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-52095504-8a54-416e-999a-091c08c9be2c None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:57:13 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-8faa6160-99cd-4c9e-a779-1855b905fc82 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] http://10.27.203.238/share/v2/1ae8e27013bc48228edf3022159a9c1f/types returned with HTTP 200 May 28 12:57:13 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 264/517] 10.27.203.238 () {66 vars in 1359 bytes} [Tue May 28 12:57:13 2024] POST /share/v2/1ae8e27013bc48228edf3022159a9c1f/types => generated 655 bytes in 29 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-52095504-8a54-416e-999a-091c08c9be2c None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-52095504-8a54-416e-999a-091c08c9be2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 915/1804] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:57:13 2024] POST /identity/v3/auth/tokens => generated 312 bytes in 22 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 28 12:57:13 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-1c41144d-78dd-47a1-a3c7-f594ef26016e tempest-ExtraSpecsAdminNegativeTest-773939988 tempest-ExtraSpecsAdminNegativeTest-773939988-project-member] DELETE http://10.27.203.238/share/v2/b459b0ac20ef4f348e8ff53468c5c935/types/b16f901c-4082-4810-ba14-aa2086f1fcd7/extra_specs/key May 28 12:57:13 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-1c41144d-78dd-47a1-a3c7-f594ef26016e tempest-ExtraSpecsAdminNegativeTest-773939988 tempest-ExtraSpecsAdminNegativeTest-773939988-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:13 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-1c41144d-78dd-47a1-a3c7-f594ef26016e tempest-ExtraSpecsAdminNegativeTest-773939988 tempest-ExtraSpecsAdminNegativeTest-773939988-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:13 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.policy [None req-1c41144d-78dd-47a1-a3c7-f594ef26016e tempest-ExtraSpecsAdminNegativeTest-773939988 tempest-ExtraSpecsAdminNegativeTest-773939988-project-member] Policy check for share_types_extra_spec:delete failed with credentials {'is_admin': False, 'user_id': '7365146fcc404c988e9841963a43be27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b459b0ac20ef4f348e8ff53468c5c935', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98330) authorize /opt/stack/manila/manila/policy.py:208}} May 28 12:57:13 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-1c41144d-78dd-47a1-a3c7-f594ef26016e tempest-ExtraSpecsAdminNegativeTest-773939988 tempest-ExtraSpecsAdminNegativeTest-773939988-project-member] HTTP exception thrown: Access was denied to this resource. May 28 12:57:13 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-1c41144d-78dd-47a1-a3c7-f594ef26016e tempest-ExtraSpecsAdminNegativeTest-773939988 tempest-ExtraSpecsAdminNegativeTest-773939988-project-member] http://10.27.203.238/share/v2/b459b0ac20ef4f348e8ff53468c5c935/types/b16f901c-4082-4810-ba14-aa2086f1fcd7/extra_specs/key returned with HTTP 403 May 28 12:57:13 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 254/518] 10.27.203.238 () {64 vars in 1499 bytes} [Tue May 28 12:57:13 2024] DELETE /share/v2/b459b0ac20ef4f348e8ff53468c5c935/types/b16f901c-4082-4810-ba14-aa2086f1fcd7/extra_specs/key => generated 78 bytes in 6 msecs (HTTP/1.1 403) 6 headers in 237 bytes (1 switches on core 0) May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca25ec23-905b-48f4-88c5-cd7aa3ed84ba None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca25ec23-905b-48f4-88c5-cd7aa3ed84ba None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca25ec23-905b-48f4-88c5-cd7aa3ed84ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:13 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-cfc2994a-2d2e-4cec-80d7-f65c5bb38eeb tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] POST http://10.27.203.238/share/v2/1ae8e27013bc48228edf3022159a9c1f/types May 28 12:57:13 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-cfc2994a-2d2e-4cec-80d7-f65c5bb38eeb tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share_type": {"name": "tempest-typeshare-type-536970090", "extra_specs": {"driver_handles_share_servers": "False", "key": "value"}, "share_type_access:is_public": true}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-ca25ec23-905b-48f4-88c5-cd7aa3ed84ba None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-ca25ec23-905b-48f4-88c5-cd7aa3ed84ba None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-ca25ec23-905b-48f4-88c5-cd7aa3ed84ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 916/1805] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:57:13 2024] POST /identity/v3/auth/tokens => generated 2960 bytes in 24 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca25ec23-905b-48f4-88c5-cd7aa3ed84ba None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:13 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-cfc2994a-2d2e-4cec-80d7-f65c5bb38eeb tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] http://10.27.203.238/share/v2/1ae8e27013bc48228edf3022159a9c1f/types returned with HTTP 200 May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca25ec23-905b-48f4-88c5-cd7aa3ed84ba None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:13 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 265/519] 10.27.203.238 () {66 vars in 1359 bytes} [Tue May 28 12:57:13 2024] POST /share/v2/1ae8e27013bc48228edf3022159a9c1f/types => generated 653 bytes in 29 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-38cbfae7-cabf-47a9-98aa-8d5e348a27ac None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '521b52cb8ba745709f1904fcb99154d4', 'request_id': 'req-38cbfae7-cabf-47a9-98aa-8d5e348a27ac'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-38cbfae7-cabf-47a9-98aa-8d5e348a27ac None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '521b52cb8ba745709f1904fcb99154d4', 'request_id': 'req-38cbfae7-cabf-47a9-98aa-8d5e348a27ac'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:13 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-1642c152-8add-4c9b-ba4d-17ff155ac45b tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] DELETE http://10.27.203.238/share/v2/1ae8e27013bc48228edf3022159a9c1f/types/f676a13a-d273-434b-bc78-bec5e62f86f8/extra_specs/snapshot_support May 28 12:57:13 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-1642c152-8add-4c9b-ba4d-17ff155ac45b tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:13 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-1642c152-8add-4c9b-ba4d-17ff155ac45b tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-38cbfae7-cabf-47a9-98aa-8d5e348a27ac None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '521b52cb8ba745709f1904fcb99154d4', 'request_id': 'req-38cbfae7-cabf-47a9-98aa-8d5e348a27ac'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:13 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-1642c152-8add-4c9b-ba4d-17ff155ac45b tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] HTTP exception thrown: Extra spec 'snapshot_support' can't be deleted. May 28 12:57:13 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-1642c152-8add-4c9b-ba4d-17ff155ac45b tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] http://10.27.203.238/share/v2/1ae8e27013bc48228edf3022159a9c1f/types/f676a13a-d273-434b-bc78-bec5e62f86f8/extra_specs/snapshot_support returned with HTTP 403 May 28 12:57:13 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 255/520] 10.27.203.238 () {64 vars in 1537 bytes} [Tue May 28 12:57:13 2024] DELETE /share/v2/1ae8e27013bc48228edf3022159a9c1f/types/f676a13a-d273-434b-bc78-bec5e62f86f8/extra_specs/snapshot_support => generated 90 bytes in 10 msecs (HTTP/1.1 403) 6 headers in 236 bytes (1 switches on core 0) May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-38cbfae7-cabf-47a9-98aa-8d5e348a27ac None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '521b52cb8ba745709f1904fcb99154d4', 'request_id': 'req-38cbfae7-cabf-47a9-98aa-8d5e348a27ac'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-38cbfae7-cabf-47a9-98aa-8d5e348a27ac None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '521b52cb8ba745709f1904fcb99154d4', 'request_id': 'req-38cbfae7-cabf-47a9-98aa-8d5e348a27ac'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:13 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-6f5f5af0-03b3-4444-8ebd-31763a753fe4 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] POST http://10.27.203.238/share/v2/1ae8e27013bc48228edf3022159a9c1f/types May 28 12:57:13 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-6f5f5af0-03b3-4444-8ebd-31763a753fe4 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share_type": {"name": "tempest-typeshare-type-1282289473", "extra_specs": {"driver_handles_share_servers": "False", "key": "value"}, "share_type_access:is_public": true}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 890/1806] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 12:57:13 2024] DELETE /identity/v3/users/521b52cb8ba745709f1904fcb99154d4 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a605197c-d0f8-4c3c-8de3-0406b5fd0284 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a605197c-d0f8-4c3c-8de3-0406b5fd0284 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a605197c-d0f8-4c3c-8de3-0406b5fd0284 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a605197c-d0f8-4c3c-8de3-0406b5fd0284 None admin] PATH_INFO: `/v3/domains` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a605197c-d0f8-4c3c-8de3-0406b5fd0284 None admin] RBAC: Adding query filter params (name=Default) {{(pid=51267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a605197c-d0f8-4c3c-8de3-0406b5fd0284 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a383a087-9f94-4a4e-aa00-61a8d4a2f8d1 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a383a087-9f94-4a4e-aa00-61a8d4a2f8d1 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a383a087-9f94-4a4e-aa00-61a8d4a2f8d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a605197c-d0f8-4c3c-8de3-0406b5fd0284 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:13 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-6f5f5af0-03b3-4444-8ebd-31763a753fe4 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] http://10.27.203.238/share/v2/1ae8e27013bc48228edf3022159a9c1f/types returned with HTTP 200 May 28 12:57:13 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 266/521] 10.27.203.238 () {66 vars in 1359 bytes} [Tue May 28 12:57:13 2024] POST /share/v2/1ae8e27013bc48228edf3022159a9c1f/types => generated 655 bytes in 22 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-a383a087-9f94-4a4e-aa00-61a8d4a2f8d1 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 917/1807] 10.27.203.238 () {62 vars in 1220 bytes} [Tue May 28 12:57:13 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:57:13 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-881c4e3a-cd72-4298-a18d-a5a7e68699ec tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] DELETE http://10.27.203.238/share/v2/1ae8e27013bc48228edf3022159a9c1f/types/43cd736a-2620-4e48-9f39-83c7df9b380a/extra_specs/snapshot_support May 28 12:57:13 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-881c4e3a-cd72-4298-a18d-a5a7e68699ec tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-a383a087-9f94-4a4e-aa00-61a8d4a2f8d1 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:57:13 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-881c4e3a-cd72-4298-a18d-a5a7e68699ec tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a605197c-d0f8-4c3c-8de3-0406b5fd0284 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-a383a087-9f94-4a4e-aa00-61a8d4a2f8d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-a605197c-d0f8-4c3c-8de3-0406b5fd0284 None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:13 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-881c4e3a-cd72-4298-a18d-a5a7e68699ec tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] HTTP exception thrown: Extra spec 'snapshot_support' can't be deleted. May 28 12:57:13 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-881c4e3a-cd72-4298-a18d-a5a7e68699ec tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] http://10.27.203.238/share/v2/1ae8e27013bc48228edf3022159a9c1f/types/43cd736a-2620-4e48-9f39-83c7df9b380a/extra_specs/snapshot_support returned with HTTP 403 May 28 12:57:13 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 256/522] 10.27.203.238 () {64 vars in 1538 bytes} [Tue May 28 12:57:13 2024] DELETE /share/v2/1ae8e27013bc48228edf3022159a9c1f/types/43cd736a-2620-4e48-9f39-83c7df9b380a/extra_specs/snapshot_support => generated 90 bytes in 11 msecs (HTTP/1.1 403) 6 headers in 237 bytes (1 switches on core 0) May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a605197c-d0f8-4c3c-8de3-0406b5fd0284 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:13 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-362b4f3f-e7e1-46be-955e-b76cf1655f49 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] POST http://10.27.203.238/share/v2/1ae8e27013bc48228edf3022159a9c1f/types May 28 12:57:13 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-362b4f3f-e7e1-46be-955e-b76cf1655f49 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share_type": {"name": "tempest-typeshare-type-1045073016", "extra_specs": {"driver_handles_share_servers": "False", "key": "value"}, "share_type_access:is_public": true}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 891/1808] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:57:13 2024] POST /identity/v3/auth/tokens => generated 2960 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 12:57:13 l75lg1-v1 neutron-server[77619]: DEBUG neutron.wsgi [-] (77619) accepted ('10.27.203.238', 58654) {{(pid=77619) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 12:57:13 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-362b4f3f-e7e1-46be-955e-b76cf1655f49 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] http://10.27.203.238/share/v2/1ae8e27013bc48228edf3022159a9c1f/types returned with HTTP 200 May 28 12:57:13 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 267/523] 10.27.203.238 () {66 vars in 1359 bytes} [Tue May 28 12:57:13 2024] POST /share/v2/1ae8e27013bc48228edf3022159a9c1f/types => generated 655 bytes in 22 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a383a087-9f94-4a4e-aa00-61a8d4a2f8d1 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-a383a087-9f94-4a4e-aa00-61a8d4a2f8d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:13 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-e1c784b2-8666-4641-bab8-2c8c25dfb00f tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] DELETE http://10.27.203.238/share/v2/1ae8e27013bc48228edf3022159a9c1f/types/c4597038-c3af-42d2-afd3-74055597cc77/extra_specs/driver_handles_share_servers May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d348f852-7b29-4b39-9237-3e9d4cb9b8be None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:13 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-e1c784b2-8666-4641-bab8-2c8c25dfb00f tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d348f852-7b29-4b39-9237-3e9d4cb9b8be None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d348f852-7b29-4b39-9237-3e9d4cb9b8be None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:13 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-e1c784b2-8666-4641-bab8-2c8c25dfb00f tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d348f852-7b29-4b39-9237-3e9d4cb9b8be None admin] PATH_INFO: `/v3/projects` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d348f852-7b29-4b39-9237-3e9d4cb9b8be None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d348f852-7b29-4b39-9237-3e9d4cb9b8be None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:13 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-e1c784b2-8666-4641-bab8-2c8c25dfb00f tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] HTTP exception thrown: Extra spec 'driver_handles_share_servers' can't be deleted. May 28 12:57:13 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-e1c784b2-8666-4641-bab8-2c8c25dfb00f tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] http://10.27.203.238/share/v2/1ae8e27013bc48228edf3022159a9c1f/types/c4597038-c3af-42d2-afd3-74055597cc77/extra_specs/driver_handles_share_servers returned with HTTP 403 May 28 12:57:13 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 257/524] 10.27.203.238 () {64 vars in 1574 bytes} [Tue May 28 12:57:13 2024] DELETE /share/v2/1ae8e27013bc48228edf3022159a9c1f/types/c4597038-c3af-42d2-afd3-74055597cc77/extra_specs/driver_handles_share_servers => generated 102 bytes in 13 msecs (HTTP/1.1 403) 6 headers in 238 bytes (1 switches on core 0) May 28 12:57:13 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-e52e8617-0e9e-4c18-a35a-9457b67e3465 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] POST http://10.27.203.238/share/v2/1ae8e27013bc48228edf3022159a9c1f/types May 28 12:57:13 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-e52e8617-0e9e-4c18-a35a-9457b67e3465 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share_type": {"name": "tempest-typeshare-type-541074767", "extra_specs": {"driver_handles_share_servers": "False", "key": "value"}, "share_type_access:is_public": true}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a383a087-9f94-4a4e-aa00-61a8d4a2f8d1 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f4c288-0f78-4b6d-ae9a-3684b8be428e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef17047035e4b518fd5360a01f2da1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 918/1809] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 12:57:13 2024] POST /identity/v3/projects => generated 383 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f4c288-0f78-4b6d-ae9a-3684b8be428e service neutron] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f4c288-0f78-4b6d-ae9a-3684b8be428e service neutron] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f4c288-0f78-4b6d-ae9a-3684b8be428e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d348f852-7b29-4b39-9237-3e9d4cb9b8be None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:13 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-e52e8617-0e9e-4c18-a35a-9457b67e3465 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] http://10.27.203.238/share/v2/1ae8e27013bc48228edf3022159a9c1f/types returned with HTTP 200 May 28 12:57:13 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 268/525] 10.27.203.238 () {66 vars in 1359 bytes} [Tue May 28 12:57:13 2024] POST /share/v2/1ae8e27013bc48228edf3022159a9c1f/types => generated 653 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f4c288-0f78-4b6d-ae9a-3684b8be428e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f4c288-0f78-4b6d-ae9a-3684b8be428e service neutron] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 892/1810] 10.27.203.238 () {64 vars in 1432 bytes} [Tue May 28 12:57:13 2024] GET /identity/v3/auth/tokens => generated 2960 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 28 12:57:13 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-283e9e6b-ba82-4dc3-9ffd-2d37ce348d19 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] DELETE http://10.27.203.238/share/v2/1ae8e27013bc48228edf3022159a9c1f/types/dae41377-0474-4f8a-beda-3839c98cb123/extra_specs/tempest-fake-317870168 May 28 12:57:13 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-283e9e6b-ba82-4dc3-9ffd-2d37ce348d19 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:13 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-283e9e6b-ba82-4dc3-9ffd-2d37ce348d19 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:13 l75lg1-v1 neutron-server[77619]: INFO neutron.wsgi [None req-ef3ab995-5444-421b-919e-68b6f27dce7d None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=1643901550e140118fc2d2e92b82cd0b&name=default HTTP/1.1" status: 200 len: 216 time: 0.0718071 May 28 12:57:13 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-283e9e6b-ba82-4dc3-9ffd-2d37ce348d19 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] HTTP exception thrown: Share Type dae41377-0474-4f8a-beda-3839c98cb123 has no extra specs with key tempest-fake-317870168. May 28 12:57:13 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-283e9e6b-ba82-4dc3-9ffd-2d37ce348d19 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] http://10.27.203.238/share/v2/1ae8e27013bc48228edf3022159a9c1f/types/dae41377-0474-4f8a-beda-3839c98cb123/extra_specs/tempest-fake-317870168 returned with HTTP 404 May 28 12:57:13 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 258/526] 10.27.203.238 () {64 vars in 1556 bytes} [Tue May 28 12:57:13 2024] DELETE /share/v2/1ae8e27013bc48228edf3022159a9c1f/types/dae41377-0474-4f8a-beda-3839c98cb123/extra_specs/tempest-fake-317870168 => generated 145 bytes in 14 msecs (HTTP/1.1 404) 6 headers in 238 bytes (1 switches on core 0) May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f4c288-0f78-4b6d-ae9a-3684b8be428e service neutron] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-63f4c288-0f78-4b6d-ae9a-3684b8be428e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d348f852-7b29-4b39-9237-3e9d4cb9b8be None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:13 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-4a5bfe77-acd8-4305-a89e-efcfa3a58c07 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] POST http://10.27.203.238/share/v2/1ae8e27013bc48228edf3022159a9c1f/types May 28 12:57:13 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-4a5bfe77-acd8-4305-a89e-efcfa3a58c07 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share_type": {"name": "tempest-typeshare-type-1806188277", "extra_specs": {"driver_handles_share_servers": "False", "key": "value"}, "share_type_access:is_public": true}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f4c288-0f78-4b6d-ae9a-3684b8be428e service neutron] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a39ad69-144a-491d-bc8d-16c8d6af2411 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a39ad69-144a-491d-bc8d-16c8d6af2411 None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a39ad69-144a-491d-bc8d-16c8d6af2411 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a39ad69-144a-491d-bc8d-16c8d6af2411 None admin] PATH_INFO: `/v3/users` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a39ad69-144a-491d-bc8d-16c8d6af2411 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85424416-d8b1-439a-9cba-9298114c9416 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a39ad69-144a-491d-bc8d-16c8d6af2411 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85424416-d8b1-439a-9cba-9298114c9416 None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85424416-d8b1-439a-9cba-9298114c9416 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85424416-d8b1-439a-9cba-9298114c9416 None admin] PATH_INFO: `/v3/projects/1643901550e140118fc2d2e92b82cd0b` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85424416-d8b1-439a-9cba-9298114c9416 None admin] RBAC: Authorizing `identity:delete_project(project_id=1643901550e140118fc2d2e92b82cd0b)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85424416-d8b1-439a-9cba-9298114c9416 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-7a39ad69-144a-491d-bc8d-16c8d6af2411 None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 12:57:13 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-4a5bfe77-acd8-4305-a89e-efcfa3a58c07 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] http://10.27.203.238/share/v2/1ae8e27013bc48228edf3022159a9c1f/types returned with HTTP 200 May 28 12:57:13 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 269/527] 10.27.203.238 () {66 vars in 1359 bytes} [Tue May 28 12:57:13 2024] POST /share/v2/1ae8e27013bc48228edf3022159a9c1f/types => generated 655 bytes in 24 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:57:13 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 259/528] 10.27.203.238 () {64 vars in 1487 bytes} [Tue May 28 12:57:13 2024] GET /share/v2/1ae8e27013bc48228edf3022159a9c1f/types/cc30bac1-e8e3-4e53-b660-f80ce32ddfe0/extra_specs/ => generated 112 bytes in 3 msecs (HTTP/1.1 404) 3 headers in 98 bytes (1 switches on core 0) May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 919/1811] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 12:57:13 2024] POST /identity/v3/users => generated 299 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a39ad69-144a-491d-bc8d-16c8d6af2411 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:13 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-c13bac75-f891-4dc1-9d26-6489d4357e01 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] POST http://10.27.203.238/share/v2/1ae8e27013bc48228edf3022159a9c1f/types May 28 12:57:13 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-c13bac75-f891-4dc1-9d26-6489d4357e01 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share_type": {"name": "tempest-typeshare-type-1751213699", "extra_specs": {"driver_handles_share_servers": "False", "key": "value"}, "share_type_access:is_public": true}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a39ad69-144a-491d-bc8d-16c8d6af2411 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b534a858-1377-4c2f-88bf-07926beade34 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b534a858-1377-4c2f-88bf-07926beade34 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b534a858-1377-4c2f-88bf-07926beade34 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b534a858-1377-4c2f-88bf-07926beade34 None admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b534a858-1377-4c2f-88bf-07926beade34 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b534a858-1377-4c2f-88bf-07926beade34 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 920/1812] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 12:57:13 2024] GET /identity/v3/roles => generated 1680 bytes in 18 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-85424416-d8b1-439a-9cba-9298114c9416 None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1643901550e140118fc2d2e92b82cd0b', 'request_id': 'req-85424416-d8b1-439a-9cba-9298114c9416'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b534a858-1377-4c2f-88bf-07926beade34 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b534a858-1377-4c2f-88bf-07926beade34 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-85424416-d8b1-439a-9cba-9298114c9416 None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1643901550e140118fc2d2e92b82cd0b', 'request_id': 'req-85424416-d8b1-439a-9cba-9298114c9416'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-85424416-d8b1-439a-9cba-9298114c9416 None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1643901550e140118fc2d2e92b82cd0b', 'request_id': 'req-85424416-d8b1-439a-9cba-9298114c9416'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:13 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-c13bac75-f891-4dc1-9d26-6489d4357e01 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] http://10.27.203.238/share/v2/1ae8e27013bc48228edf3022159a9c1f/types returned with HTTP 200 May 28 12:57:13 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 270/529] 10.27.203.238 () {66 vars in 1359 bytes} [Tue May 28 12:57:13 2024] POST /share/v2/1ae8e27013bc48228edf3022159a9c1f/types => generated 655 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-85424416-d8b1-439a-9cba-9298114c9416 None admin] The token cache is being invalidate because project 1643901550e140118fc2d2e92b82cd0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-85424416-d8b1-439a-9cba-9298114c9416 None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-85424416-d8b1-439a-9cba-9298114c9416 None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 893/1813] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 12:57:13 2024] DELETE /identity/v3/projects/1643901550e140118fc2d2e92b82cd0b => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:57:13 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-23278454-3a57-4835-85b1-e96a9bf752be tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] GET http://10.27.203.238/share/v2/1ae8e27013bc48228edf3022159a9c1f/types/b8a59a8f-0fff-470a-ae19-f374dbf8ab3b/extra_specs/tempest-fake-894542240 May 28 12:57:13 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-23278454-3a57-4835-85b1-e96a9bf752be tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:13 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-23278454-3a57-4835-85b1-e96a9bf752be tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] Calling method 'ShareTypeExtraSpecsController.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:13 l75lg1-v1 neutron-server[77618]: DEBUG neutron.wsgi [-] (77618) accepted ('10.27.203.238', 58670) {{(pid=77618) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 12:57:13 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-23278454-3a57-4835-85b1-e96a9bf752be tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] HTTP exception thrown: The resource could not be found. May 28 12:57:13 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-23278454-3a57-4835-85b1-e96a9bf752be tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] http://10.27.203.238/share/v2/1ae8e27013bc48228edf3022159a9c1f/types/b8a59a8f-0fff-470a-ae19-f374dbf8ab3b/extra_specs/tempest-fake-894542240 returned with HTTP 404 May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61736489-90de-4a6f-b23a-097094a2c1c5 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:13 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 260/530] 10.27.203.238 () {64 vars in 1553 bytes} [Tue May 28 12:57:13 2024] GET /share/v2/1ae8e27013bc48228edf3022159a9c1f/types/b8a59a8f-0fff-470a-ae19-f374dbf8ab3b/extra_specs/tempest-fake-894542240 => generated 78 bytes in 16 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61736489-90de-4a6f-b23a-097094a2c1c5 None admin] REQUEST_METHOD: `PUT` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61736489-90de-4a6f-b23a-097094a2c1c5 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61736489-90de-4a6f-b23a-097094a2c1c5 None admin] PATH_INFO: `/v3/projects/fe54df7c653849ab8ec7523262c597cf/users/ec5a2b103a70407ba8e53c1f28a98ae9/roles/e7989893488f483baa107be56668c4f8` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:13 l75lg1-v1 neutron-server[77618]: INFO neutron.wsgi [None req-9e44f72c-54c1-49c5-9b15-ef6905ea279c None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=43ff8cffa80748308f619a3e52a285f2&name=default HTTP/1.1" status: 200 len: 216 time: 0.0097806 May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85424416-d8b1-439a-9cba-9298114c9416 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-85424416-d8b1-439a-9cba-9298114c9416 None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:13 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-38bf71ae-d825-47ad-85fb-629e1871937d tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] POST http://10.27.203.238/share/v2/1ae8e27013bc48228edf3022159a9c1f/types May 28 12:57:13 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-38bf71ae-d825-47ad-85fb-629e1871937d tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share_type": {"name": "tempest-typeshare-type-1187145635", "extra_specs": {"driver_handles_share_servers": "False", "key": "value"}, "share_type_access:is_public": true}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61736489-90de-4a6f-b23a-097094a2c1c5 None admin] RBAC: Authorizing `identity:create_grant(project_id=fe54df7c653849ab8ec7523262c597cf, user_id=ec5a2b103a70407ba8e53c1f28a98ae9, role_id=e7989893488f483baa107be56668c4f8)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61736489-90de-4a6f-b23a-097094a2c1c5 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85424416-d8b1-439a-9cba-9298114c9416 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3217971-227d-44f2-ae1b-4d78b358a82c None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3217971-227d-44f2-ae1b-4d78b358a82c None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3217971-227d-44f2-ae1b-4d78b358a82c None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3217971-227d-44f2-ae1b-4d78b358a82c None admin] PATH_INFO: `/v3/projects/43ff8cffa80748308f619a3e52a285f2` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3217971-227d-44f2-ae1b-4d78b358a82c None admin] RBAC: Authorizing `identity:delete_project(project_id=43ff8cffa80748308f619a3e52a285f2)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3217971-227d-44f2-ae1b-4d78b358a82c None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 921/1814] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 12:57:13 2024] PUT /identity/v3/projects/fe54df7c653849ab8ec7523262c597cf/users/ec5a2b103a70407ba8e53c1f28a98ae9/roles/e7989893488f483baa107be56668c4f8 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61736489-90de-4a6f-b23a-097094a2c1c5 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-61736489-90de-4a6f-b23a-097094a2c1c5 None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:13 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-38bf71ae-d825-47ad-85fb-629e1871937d tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] http://10.27.203.238/share/v2/1ae8e27013bc48228edf3022159a9c1f/types returned with HTTP 200 May 28 12:57:13 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 271/531] 10.27.203.238 () {66 vars in 1359 bytes} [Tue May 28 12:57:13 2024] POST /share/v2/1ae8e27013bc48228edf3022159a9c1f/types => generated 655 bytes in 28 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:57:13 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-cce0ac4a-323e-4bff-93e7-b8b53ab7c6fe tempest-ExtraSpecsAdminNegativeTest-773939988 tempest-ExtraSpecsAdminNegativeTest-773939988-project-member] GET http://10.27.203.238/share/v2/b459b0ac20ef4f348e8ff53468c5c935/types/8ac7167e-4ee5-4626-84c9-f4018be08764/extra_specs/key May 28 12:57:13 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-cce0ac4a-323e-4bff-93e7-b8b53ab7c6fe tempest-ExtraSpecsAdminNegativeTest-773939988 tempest-ExtraSpecsAdminNegativeTest-773939988-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:13 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-cce0ac4a-323e-4bff-93e7-b8b53ab7c6fe tempest-ExtraSpecsAdminNegativeTest-773939988 tempest-ExtraSpecsAdminNegativeTest-773939988-project-member] Calling method 'ShareTypeExtraSpecsController.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:13 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.policy [None req-cce0ac4a-323e-4bff-93e7-b8b53ab7c6fe tempest-ExtraSpecsAdminNegativeTest-773939988 tempest-ExtraSpecsAdminNegativeTest-773939988-project-member] Policy check for share_types_extra_spec:show failed with credentials {'is_admin': False, 'user_id': '7365146fcc404c988e9841963a43be27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b459b0ac20ef4f348e8ff53468c5c935', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98330) authorize /opt/stack/manila/manila/policy.py:208}} May 28 12:57:13 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-cce0ac4a-323e-4bff-93e7-b8b53ab7c6fe tempest-ExtraSpecsAdminNegativeTest-773939988 tempest-ExtraSpecsAdminNegativeTest-773939988-project-member] HTTP exception thrown: Access was denied to this resource. May 28 12:57:13 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-cce0ac4a-323e-4bff-93e7-b8b53ab7c6fe tempest-ExtraSpecsAdminNegativeTest-773939988 tempest-ExtraSpecsAdminNegativeTest-773939988-project-member] http://10.27.203.238/share/v2/b459b0ac20ef4f348e8ff53468c5c935/types/8ac7167e-4ee5-4626-84c9-f4018be08764/extra_specs/key returned with HTTP 403 May 28 12:57:13 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 261/532] 10.27.203.238 () {64 vars in 1496 bytes} [Tue May 28 12:57:13 2024] GET /share/v2/b459b0ac20ef4f348e8ff53468c5c935/types/8ac7167e-4ee5-4626-84c9-f4018be08764/extra_specs/key => generated 78 bytes in 8 msecs (HTTP/1.1 403) 6 headers in 237 bytes (1 switches on core 0) May 28 12:57:13 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-bdf48da2-fbd6-4321-842e-86416c4719c8 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] GET http://10.27.203.238/share/v2/1ae8e27013bc48228edf3022159a9c1f/types/extra_specs May 28 12:57:13 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-bdf48da2-fbd6-4321-842e-86416c4719c8 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:13 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-bdf48da2-fbd6-4321-842e-86416c4719c8 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] Calling method 'ShareTypesController.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-d3217971-227d-44f2-ae1b-4d78b358a82c None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43ff8cffa80748308f619a3e52a285f2', 'request_id': 'req-d3217971-227d-44f2-ae1b-4d78b358a82c'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:13 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-bdf48da2-fbd6-4321-842e-86416c4719c8 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] HTTP exception thrown: Share type not found. May 28 12:57:13 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-bdf48da2-fbd6-4321-842e-86416c4719c8 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] http://10.27.203.238/share/v2/1ae8e27013bc48228edf3022159a9c1f/types/extra_specs returned with HTTP 404 May 28 12:57:13 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 272/533] 10.27.203.238 () {64 vars in 1373 bytes} [Tue May 28 12:57:13 2024] GET /share/v2/1ae8e27013bc48228edf3022159a9c1f/types/extra_specs => generated 67 bytes in 14 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61736489-90de-4a6f-b23a-097094a2c1c5 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-d3217971-227d-44f2-ae1b-4d78b358a82c None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43ff8cffa80748308f619a3e52a285f2', 'request_id': 'req-d3217971-227d-44f2-ae1b-4d78b358a82c'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:13 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-9d9c6e00-fdaa-417e-910d-86291b7dd3b5 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] GET http://10.27.203.238/share/v2/1ae8e27013bc48228edf3022159a9c1f/types/tempest-fake-163769860/extra_specs May 28 12:57:13 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-9d9c6e00-fdaa-417e-910d-86291b7dd3b5 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:13 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-9d9c6e00-fdaa-417e-910d-86291b7dd3b5 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] Calling method 'ShareTypeExtraSpecsController.index' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:13 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-9d9c6e00-fdaa-417e-910d-86291b7dd3b5 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] HTTP exception thrown: Share type tempest-fake-163769860 could not be found. May 28 12:57:13 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-9d9c6e00-fdaa-417e-910d-86291b7dd3b5 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] http://10.27.203.238/share/v2/1ae8e27013bc48228edf3022159a9c1f/types/tempest-fake-163769860/extra_specs returned with HTTP 404 May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-d3217971-227d-44f2-ae1b-4d78b358a82c None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43ff8cffa80748308f619a3e52a285f2', 'request_id': 'req-d3217971-227d-44f2-ae1b-4d78b358a82c'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:13 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 262/534] 10.27.203.238 () {64 vars in 1442 bytes} [Tue May 28 12:57:13 2024] GET /share/v2/1ae8e27013bc48228edf3022159a9c1f/types/tempest-fake-163769860/extra_specs => generated 99 bytes in 11 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-d3217971-227d-44f2-ae1b-4d78b358a82c None admin] The token cache is being invalidate because project 43ff8cffa80748308f619a3e52a285f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 12:57:13 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-c41b1ccc-1ef4-43e1-9656-7d847b9895f8 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] POST http://10.27.203.238/share/v2/1ae8e27013bc48228edf3022159a9c1f/types May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-d3217971-227d-44f2-ae1b-4d78b358a82c None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:13 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-c41b1ccc-1ef4-43e1-9656-7d847b9895f8 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share_type": {"name": "tempest-typeshare-type-962539511", "extra_specs": {"driver_handles_share_servers": "False", "key": "value"}, "share_type_access:is_public": true}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-d3217971-227d-44f2-ae1b-4d78b358a82c None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 894/1815] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 12:57:13 2024] DELETE /identity/v3/projects/43ff8cffa80748308f619a3e52a285f2 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d39900-cf87-46b6-a632-24adfe13cbbe None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d39900-cf87-46b6-a632-24adfe13cbbe None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:13 l75lg1-v1 neutron-server[77619]: DEBUG neutron.wsgi [-] (77619) accepted ('10.27.203.238', 58678) {{(pid=77619) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d39900-cf87-46b6-a632-24adfe13cbbe None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d39900-cf87-46b6-a632-24adfe13cbbe None admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d39900-cf87-46b6-a632-24adfe13cbbe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d39900-cf87-46b6-a632-24adfe13cbbe None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 922/1816] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 12:57:13 2024] GET /identity/v3/roles => generated 1680 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 28 12:57:13 l75lg1-v1 neutron-server[77619]: INFO neutron.wsgi [None req-50f19648-65f3-426d-a9ec-f8067c18b506 None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=5370699c903e45df8d014898d783500e&name=default HTTP/1.1" status: 200 len: 216 time: 0.0089998 May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d39900-cf87-46b6-a632-24adfe13cbbe None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3217971-227d-44f2-ae1b-4d78b358a82c None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-d3217971-227d-44f2-ae1b-4d78b358a82c None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-a9d39900-cf87-46b6-a632-24adfe13cbbe None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:13 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-c41b1ccc-1ef4-43e1-9656-7d847b9895f8 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] http://10.27.203.238/share/v2/1ae8e27013bc48228edf3022159a9c1f/types returned with HTTP 200 May 28 12:57:13 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 273/535] 10.27.203.238 () {66 vars in 1359 bytes} [Tue May 28 12:57:13 2024] POST /share/v2/1ae8e27013bc48228edf3022159a9c1f/types => generated 653 bytes in 25 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d39900-cf87-46b6-a632-24adfe13cbbe None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3217971-227d-44f2-ae1b-4d78b358a82c None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:13 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-ce188a40-069e-45f4-8947-4975991c1ea1 tempest-ExtraSpecsAdminNegativeTest-773939988 tempest-ExtraSpecsAdminNegativeTest-773939988-project-member] GET http://10.27.203.238/share/v2/b459b0ac20ef4f348e8ff53468c5c935/types/f4d611bb-aa60-46f8-8a5f-91fc4457d2ec/extra_specs May 28 12:57:13 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-ce188a40-069e-45f4-8947-4975991c1ea1 tempest-ExtraSpecsAdminNegativeTest-773939988 tempest-ExtraSpecsAdminNegativeTest-773939988-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:13 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-ce188a40-069e-45f4-8947-4975991c1ea1 tempest-ExtraSpecsAdminNegativeTest-773939988 tempest-ExtraSpecsAdminNegativeTest-773939988-project-member] Calling method 'ShareTypeExtraSpecsController.index' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:13 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.policy [None req-ce188a40-069e-45f4-8947-4975991c1ea1 tempest-ExtraSpecsAdminNegativeTest-773939988 tempest-ExtraSpecsAdminNegativeTest-773939988-project-member] Policy check for share_types_extra_spec:index failed with credentials {'is_admin': False, 'user_id': '7365146fcc404c988e9841963a43be27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b459b0ac20ef4f348e8ff53468c5c935', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98330) authorize /opt/stack/manila/manila/policy.py:208}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9399a3-ccbb-4405-9513-2a7a6c456256 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:13 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-ce188a40-069e-45f4-8947-4975991c1ea1 tempest-ExtraSpecsAdminNegativeTest-773939988 tempest-ExtraSpecsAdminNegativeTest-773939988-project-member] HTTP exception thrown: Access was denied to this resource. May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5cc488-0279-4ef4-93a7-84e716c3ee6d None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9399a3-ccbb-4405-9513-2a7a6c456256 None admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9399a3-ccbb-4405-9513-2a7a6c456256 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5cc488-0279-4ef4-93a7-84e716c3ee6d None admin] REQUEST_METHOD: `PUT` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9399a3-ccbb-4405-9513-2a7a6c456256 None admin] PATH_INFO: `/v3/projects/5370699c903e45df8d014898d783500e` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5cc488-0279-4ef4-93a7-84e716c3ee6d None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:13 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-ce188a40-069e-45f4-8947-4975991c1ea1 tempest-ExtraSpecsAdminNegativeTest-773939988 tempest-ExtraSpecsAdminNegativeTest-773939988-project-member] http://10.27.203.238/share/v2/b459b0ac20ef4f348e8ff53468c5c935/types/f4d611bb-aa60-46f8-8a5f-91fc4457d2ec/extra_specs returned with HTTP 403 May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5cc488-0279-4ef4-93a7-84e716c3ee6d None admin] PATH_INFO: `/v3/projects/fe54df7c653849ab8ec7523262c597cf/users/ec5a2b103a70407ba8e53c1f28a98ae9/roles/e7989893488f483baa107be56668c4f8` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9399a3-ccbb-4405-9513-2a7a6c456256 None admin] RBAC: Authorizing `identity:delete_project(project_id=5370699c903e45df8d014898d783500e)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:13 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 263/536] 10.27.203.238 () {64 vars in 1484 bytes} [Tue May 28 12:57:13 2024] GET /share/v2/b459b0ac20ef4f348e8ff53468c5c935/types/f4d611bb-aa60-46f8-8a5f-91fc4457d2ec/extra_specs => generated 78 bytes in 10 msecs (HTTP/1.1 403) 6 headers in 237 bytes (1 switches on core 0) May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5cc488-0279-4ef4-93a7-84e716c3ee6d None admin] RBAC: Authorizing `identity:create_grant(project_id=fe54df7c653849ab8ec7523262c597cf, user_id=ec5a2b103a70407ba8e53c1f28a98ae9, role_id=e7989893488f483baa107be56668c4f8)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9399a3-ccbb-4405-9513-2a7a6c456256 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5cc488-0279-4ef4-93a7-84e716c3ee6d None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:13 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-0058c76a-30e6-4b06-9192-20f0b0a0d167 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] GET http://10.27.203.238/share/v2/1ae8e27013bc48228edf3022159a9c1f/types/extra_specs May 28 12:57:13 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-0058c76a-30e6-4b06-9192-20f0b0a0d167 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:13 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-0058c76a-30e6-4b06-9192-20f0b0a0d167 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] Calling method 'ShareTypesController.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 895/1817] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 12:57:13 2024] PUT /identity/v3/projects/fe54df7c653849ab8ec7523262c597cf/users/ec5a2b103a70407ba8e53c1f28a98ae9/roles/e7989893488f483baa107be56668c4f8 => generated 0 bytes in 29 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:57:13 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-0058c76a-30e6-4b06-9192-20f0b0a0d167 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] HTTP exception thrown: Share type not found. May 28 12:57:13 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-0058c76a-30e6-4b06-9192-20f0b0a0d167 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] http://10.27.203.238/share/v2/1ae8e27013bc48228edf3022159a9c1f/types/extra_specs returned with HTTP 404 May 28 12:57:13 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 274/537] 10.27.203.238 () {64 vars in 1373 bytes} [Tue May 28 12:57:13 2024] GET /share/v2/1ae8e27013bc48228edf3022159a9c1f/types/extra_specs => generated 67 bytes in 10 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82a1cd4-7059-4105-9cb3-0ade58072718 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82a1cd4-7059-4105-9cb3-0ade58072718 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82a1cd4-7059-4105-9cb3-0ade58072718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:13 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-22220e88-b594-433a-b814-c75835a44030 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] GET http://10.27.203.238/share/v2/1ae8e27013bc48228edf3022159a9c1f/types/tempest-fake-1431537607/extra_specs May 28 12:57:13 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-22220e88-b594-433a-b814-c75835a44030 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:13 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-22220e88-b594-433a-b814-c75835a44030 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] Calling method 'ShareTypeExtraSpecsController.index' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-c82a1cd4-7059-4105-9cb3-0ade58072718 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:57:13 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-22220e88-b594-433a-b814-c75835a44030 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] HTTP exception thrown: Share type tempest-fake-1431537607 could not be found. May 28 12:57:13 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-22220e88-b594-433a-b814-c75835a44030 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] http://10.27.203.238/share/v2/1ae8e27013bc48228edf3022159a9c1f/types/tempest-fake-1431537607/extra_specs returned with HTTP 404 May 28 12:57:13 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 264/538] 10.27.203.238 () {64 vars in 1445 bytes} [Tue May 28 12:57:13 2024] GET /share/v2/1ae8e27013bc48228edf3022159a9c1f/types/tempest-fake-1431537607/extra_specs => generated 100 bytes in 11 msecs (HTTP/1.1 404) 6 headers in 238 bytes (2 switches on core 0) May 28 12:57:13 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-80de2667-0799-4e78-951e-304d7ef8c309 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] POST http://10.27.203.238/share/v2/1ae8e27013bc48228edf3022159a9c1f/types May 28 12:57:13 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-80de2667-0799-4e78-951e-304d7ef8c309 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share_type": {"name": "tempest-typeshare-type-1573063868", "extra_specs": {"driver_handles_share_servers": "False", "key": "value"}, "share_type_access:is_public": true}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-c82a1cd4-7059-4105-9cb3-0ade58072718 None None] MFA Rules not processed for user `ec5a2b103a70407ba8e53c1f28a98ae9`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-c82a1cd4-7059-4105-9cb3-0ade58072718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-2b9399a3-ccbb-4405-9513-2a7a6c456256 None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5370699c903e45df8d014898d783500e', 'request_id': 'req-2b9399a3-ccbb-4405-9513-2a7a6c456256'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-2b9399a3-ccbb-4405-9513-2a7a6c456256 None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5370699c903e45df8d014898d783500e', 'request_id': 'req-2b9399a3-ccbb-4405-9513-2a7a6c456256'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-2b9399a3-ccbb-4405-9513-2a7a6c456256 None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5370699c903e45df8d014898d783500e', 'request_id': 'req-2b9399a3-ccbb-4405-9513-2a7a6c456256'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:13 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-80de2667-0799-4e78-951e-304d7ef8c309 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] http://10.27.203.238/share/v2/1ae8e27013bc48228edf3022159a9c1f/types returned with HTTP 200 May 28 12:57:13 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 275/539] 10.27.203.238 () {66 vars in 1359 bytes} [Tue May 28 12:57:13 2024] POST /share/v2/1ae8e27013bc48228edf3022159a9c1f/types => generated 655 bytes in 28 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:57:13 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-42161b7e-230f-48f7-ae49-dc85c2e82c21 tempest-ExtraSpecsAdminNegativeTest-773939988 tempest-ExtraSpecsAdminNegativeTest-773939988-project-member] GET http://10.27.203.238/share/v2/b459b0ac20ef4f348e8ff53468c5c935/types/5d77f885-b328-4d22-9007-e21eace5ccc9/extra_specs May 28 12:57:13 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-42161b7e-230f-48f7-ae49-dc85c2e82c21 tempest-ExtraSpecsAdminNegativeTest-773939988 tempest-ExtraSpecsAdminNegativeTest-773939988-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:13 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-42161b7e-230f-48f7-ae49-dc85c2e82c21 tempest-ExtraSpecsAdminNegativeTest-773939988 tempest-ExtraSpecsAdminNegativeTest-773939988-project-member] Calling method 'ShareTypeExtraSpecsController.index' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:13 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.policy [None req-42161b7e-230f-48f7-ae49-dc85c2e82c21 tempest-ExtraSpecsAdminNegativeTest-773939988 tempest-ExtraSpecsAdminNegativeTest-773939988-project-member] Policy check for share_types_extra_spec:index failed with credentials {'is_admin': False, 'user_id': '7365146fcc404c988e9841963a43be27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b459b0ac20ef4f348e8ff53468c5c935', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98330) authorize /opt/stack/manila/manila/policy.py:208}} May 28 12:57:13 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-42161b7e-230f-48f7-ae49-dc85c2e82c21 tempest-ExtraSpecsAdminNegativeTest-773939988 tempest-ExtraSpecsAdminNegativeTest-773939988-project-member] HTTP exception thrown: Access was denied to this resource. May 28 12:57:13 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-42161b7e-230f-48f7-ae49-dc85c2e82c21 tempest-ExtraSpecsAdminNegativeTest-773939988 tempest-ExtraSpecsAdminNegativeTest-773939988-project-member] http://10.27.203.238/share/v2/b459b0ac20ef4f348e8ff53468c5c935/types/5d77f885-b328-4d22-9007-e21eace5ccc9/extra_specs returned with HTTP 403 May 28 12:57:13 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 265/540] 10.27.203.238 () {64 vars in 1484 bytes} [Tue May 28 12:57:13 2024] GET /share/v2/b459b0ac20ef4f348e8ff53468c5c935/types/5d77f885-b328-4d22-9007-e21eace5ccc9/extra_specs => generated 78 bytes in 8 msecs (HTTP/1.1 403) 6 headers in 237 bytes (1 switches on core 0) May 28 12:57:13 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-00bb7ec8-bb9d-4c1c-91ef-5c923dcb2f43 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] POST http://10.27.203.238/share/v2/1ae8e27013bc48228edf3022159a9c1f/types May 28 12:57:13 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-00bb7ec8-bb9d-4c1c-91ef-5c923dcb2f43 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share_type": {"name": "tempest-typeshare-type-1390030917", "extra_specs": {"driver_handles_share_servers": "False", "key": "value"}, "share_type_access:is_public": true}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-2b9399a3-ccbb-4405-9513-2a7a6c456256 None admin] The token cache is being invalidate because project 5370699c903e45df8d014898d783500e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-2b9399a3-ccbb-4405-9513-2a7a6c456256 None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-2b9399a3-ccbb-4405-9513-2a7a6c456256 None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:13 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 923/1818] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 12:57:13 2024] DELETE /identity/v3/projects/5370699c903e45df8d014898d783500e => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 896/1819] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:57:13 2024] POST /identity/v3/auth/tokens => generated 4077 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68c0e76-5a7e-400c-a345-eeabf28a3346 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68c0e76-5a7e-400c-a345-eeabf28a3346 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68c0e76-5a7e-400c-a345-eeabf28a3346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82a1cd4-7059-4105-9cb3-0ade58072718 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-c82a1cd4-7059-4105-9cb3-0ade58072718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:14 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-00bb7ec8-bb9d-4c1c-91ef-5c923dcb2f43 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] http://10.27.203.238/share/v2/1ae8e27013bc48228edf3022159a9c1f/types returned with HTTP 200 May 28 12:57:14 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 276/541] 10.27.203.238 () {66 vars in 1359 bytes} [Tue May 28 12:57:13 2024] POST /share/v2/1ae8e27013bc48228edf3022159a9c1f/types => generated 655 bytes in 30 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-e68c0e76-5a7e-400c-a345-eeabf28a3346 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:57:14 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-146334dc-86e3-4811-ad20-382442d9312f tempest-ExtraSpecsAdminNegativeTest-773939988 tempest-ExtraSpecsAdminNegativeTest-773939988-project-member] GET http://10.27.203.238/share/v2/b459b0ac20ef4f348e8ff53468c5c935/types/87e08e04-de75-4648-8f60-bebf5c8b7fce May 28 12:57:14 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-146334dc-86e3-4811-ad20-382442d9312f tempest-ExtraSpecsAdminNegativeTest-773939988 tempest-ExtraSpecsAdminNegativeTest-773939988-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:14 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-146334dc-86e3-4811-ad20-382442d9312f tempest-ExtraSpecsAdminNegativeTest-773939988 tempest-ExtraSpecsAdminNegativeTest-773939988-project-member] Calling method 'ShareTypesController.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-e68c0e76-5a7e-400c-a345-eeabf28a3346 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-e68c0e76-5a7e-400c-a345-eeabf28a3346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:14 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-146334dc-86e3-4811-ad20-382442d9312f tempest-ExtraSpecsAdminNegativeTest-773939988 tempest-ExtraSpecsAdminNegativeTest-773939988-project-member] http://10.27.203.238/share/v2/b459b0ac20ef4f348e8ff53468c5c935/types/87e08e04-de75-4648-8f60-bebf5c8b7fce returned with HTTP 200 May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 924/1820] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:57:14 2024] POST /identity/v3/auth/tokens => generated 312 bytes in 24 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 28 12:57:14 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 277/542] 10.27.203.238 () {64 vars in 1448 bytes} [Tue May 28 12:57:14 2024] GET /share/v2/b459b0ac20ef4f348e8ff53468c5c935/types/87e08e04-de75-4648-8f60-bebf5c8b7fce => generated 907 bytes in 11 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caddee0-608f-4a20-bf8a-786b019882bb None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:14 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-bc28479a-6a97-4102-81c8-556b8ceeb5ea tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] POST http://10.27.203.238/share/v2/1ae8e27013bc48228edf3022159a9c1f/types May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caddee0-608f-4a20-bf8a-786b019882bb None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:14 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-bc28479a-6a97-4102-81c8-556b8ceeb5ea tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share_type": {"name": "tempest-typeshare-type-1550783982", "extra_specs": {"driver_handles_share_servers": "False", "key": "value"}, "share_type_access:is_public": true}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caddee0-608f-4a20-bf8a-786b019882bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82a1cd4-7059-4105-9cb3-0ade58072718 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-8caddee0-608f-4a20-bf8a-786b019882bb None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230bafce-b9da-449d-8493-d80cc57654a3 service manila] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f110cf6300f049c897d0aab63218d1e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230bafce-b9da-449d-8493-d80cc57654a3 service manila] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230bafce-b9da-449d-8493-d80cc57654a3 service manila] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230bafce-b9da-449d-8493-d80cc57654a3 service manila] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-230bafce-b9da-449d-8493-d80cc57654a3 service manila] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-8caddee0-608f-4a20-bf8a-786b019882bb None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-8caddee0-608f-4a20-bf8a-786b019882bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:14 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-bc28479a-6a97-4102-81c8-556b8ceeb5ea tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] http://10.27.203.238/share/v2/1ae8e27013bc48228edf3022159a9c1f/types returned with HTTP 200 May 28 12:57:14 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 278/543] 10.27.203.238 () {66 vars in 1359 bytes} [Tue May 28 12:57:14 2024] POST /share/v2/1ae8e27013bc48228edf3022159a9c1f/types => generated 655 bytes in 29 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230bafce-b9da-449d-8493-d80cc57654a3 service manila] RBAC: Authorizing `identity:validate_token()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230bafce-b9da-449d-8493-d80cc57654a3 service manila] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 897/1821] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 12:57:14 2024] GET /identity/v3/auth/tokens => generated 4077 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 12:57:14 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-017ad327-2640-4f7d-9b92-163e76e4cf80 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] POST http://10.27.203.238/share/v2/1ae8e27013bc48228edf3022159a9c1f/types/6ada2880-51f5-4019-8d2c-7ffa58a8b629/extra_specs May 28 12:57:14 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-017ad327-2640-4f7d-9b92-163e76e4cf80 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] Action: 'create', calling method: ShareTypeExtraSpecsController.create, body: {"extra_specs": {"driver_handles_share_servers": "False", "kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "value"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:57:14 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-eff299cd-c7ed-4c3d-bfdb-ed5fb25221e0 tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] POST http://10.27.203.238/share/v2/fe54df7c653849ab8ec7523262c597cf/types May 28 12:57:14 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-eff299cd-c7ed-4c3d-bfdb-ed5fb25221e0 tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share_type": {"name": "tempest-typeshare-type-1760862378", "extra_specs": {"driver_handles_share_servers": "False", "storage_protocol": "NFS", "snapshot_support": true}, "share_type_access:is_public": true}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:57:14 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-017ad327-2640-4f7d-9b92-163e76e4cf80 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] HTTP exception thrown: Invalid extra_spec: kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk: value May 28 12:57:14 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-017ad327-2640-4f7d-9b92-163e76e4cf80 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] http://10.27.203.238/share/v2/1ae8e27013bc48228edf3022159a9c1f/types/6ada2880-51f5-4019-8d2c-7ffa58a8b629/extra_specs returned with HTTP 400 May 28 12:57:14 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 279/544] 10.27.203.238 () {66 vars in 1506 bytes} [Tue May 28 12:57:14 2024] POST /share/v2/1ae8e27013bc48228edf3022159a9c1f/types/6ada2880-51f5-4019-8d2c-7ffa58a8b629/extra_specs => generated 327 bytes in 12 msecs (HTTP/1.1 400) 6 headers in 240 bytes (1 switches on core 0) May 28 12:57:14 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-a30f4c9a-7b45-4d51-96ff-11c26226691c tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] POST http://10.27.203.238/share/v2/1ae8e27013bc48228edf3022159a9c1f/types May 28 12:57:14 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-a30f4c9a-7b45-4d51-96ff-11c26226691c tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share_type": {"name": "tempest-typeshare-type-1322669704", "extra_specs": {"driver_handles_share_servers": "False", "key": "value"}, "share_type_access:is_public": true}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 925/1822] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:57:14 2024] POST /identity/v3/auth/tokens => generated 2960 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 12:57:14 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-eff299cd-c7ed-4c3d-bfdb-ed5fb25221e0 tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] http://10.27.203.238/share/v2/fe54df7c653849ab8ec7523262c597cf/types returned with HTTP 200 May 28 12:57:14 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 266/545] 10.27.203.238 () {66 vars in 1359 bytes} [Tue May 28 12:57:14 2024] POST /share/v2/fe54df7c653849ab8ec7523262c597cf/types => generated 733 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230bafce-b9da-449d-8493-d80cc57654a3 service manila] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:14 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-b5d0ddc5-db46-4239-8d97-cf384f7cf2d8 tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] POST http://10.27.203.238/share/v2/fe54df7c653849ab8ec7523262c597cf/shares May 28 12:57:14 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-b5d0ddc5-db46-4239-8d97-cf384f7cf2d8 tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share": {"share_proto": "nfs", "description": "tempest-tempest-share-description-565888573", "snapshot_id": null, "name": "tempest-tempest-share-name-768779863", "size": 1, "metadata": {"foo_key_share_1": "foo_value_share_1", "bar_key_share_1": "foo_value_share_1"}, "is_public": false, "share_type": "ca9bd8a1-ee0c-41ce-8832-c674458b3deb"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:57:14 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-a30f4c9a-7b45-4d51-96ff-11c26226691c tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] http://10.27.203.238/share/v2/1ae8e27013bc48228edf3022159a9c1f/types returned with HTTP 200 May 28 12:57:14 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.v1.shares [None req-b5d0ddc5-db46-4239-8d97-cf384f7cf2d8 tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] Create NFS share of 1 GB May 28 12:57:14 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 280/546] 10.27.203.238 () {66 vars in 1359 bytes} [Tue May 28 12:57:14 2024] POST /share/v2/1ae8e27013bc48228edf3022159a9c1f/types => generated 655 bytes in 21 msecs (HTTP/1.1 200) 6 headers in 231 bytes (2 switches on core 0) May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230bafce-b9da-449d-8493-d80cc57654a3 service manila] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:14 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-2311ceba-7248-4b2d-baa2-56a6d2439c3c tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] POST http://10.27.203.238/share/v2/1ae8e27013bc48228edf3022159a9c1f/types/530d6c70-a60f-45b4-8810-f997583cc60f/extra_specs May 28 12:57:14 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-2311ceba-7248-4b2d-baa2-56a6d2439c3c tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] Action: 'create', calling method: ShareTypeExtraSpecsController.create, body: {"extra_specs": {"driver_handles_share_servers": "False", "key": "vvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvv"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54b9f84-b72a-4142-8b5d-d5e90b6e6298 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54b9f84-b72a-4142-8b5d-d5e90b6e6298 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54b9f84-b72a-4142-8b5d-d5e90b6e6298 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54b9f84-b72a-4142-8b5d-d5e90b6e6298 None admin] PATH_INFO: `/v3/domains` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54b9f84-b72a-4142-8b5d-d5e90b6e6298 None admin] RBAC: Adding query filter params (name=Default) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54b9f84-b72a-4142-8b5d-d5e90b6e6298 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54b9f84-b72a-4142-8b5d-d5e90b6e6298 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:14 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-2311ceba-7248-4b2d-baa2-56a6d2439c3c tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] HTTP exception thrown: Invalid extra_spec: key: vvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvv May 28 12:57:14 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-2311ceba-7248-4b2d-baa2-56a6d2439c3c tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] http://10.27.203.238/share/v2/1ae8e27013bc48228edf3022159a9c1f/types/530d6c70-a60f-45b4-8810-f997583cc60f/extra_specs returned with HTTP 400 May 28 12:57:14 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 281/547] 10.27.203.238 () {66 vars in 1506 bytes} [Tue May 28 12:57:14 2024] POST /share/v2/1ae8e27013bc48228edf3022159a9c1f/types/530d6c70-a60f-45b4-8810-f997583cc60f/extra_specs => generated 325 bytes in 10 msecs (HTTP/1.1 400) 6 headers in 240 bytes (2 switches on core 0) May 28 12:57:14 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-e8083b5f-6d60-4e51-a7c4-b7088740bad0 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] POST http://10.27.203.238/share/v2/1ae8e27013bc48228edf3022159a9c1f/types May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 898/1823] 10.27.203.238 () {62 vars in 1220 bytes} [Tue May 28 12:57:14 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:57:14 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-e8083b5f-6d60-4e51-a7c4-b7088740bad0 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share_type": {"name": "tempest-typeshare-type-492539899", "extra_specs": {"driver_handles_share_servers": "False", "key": "value"}, "share_type_access:is_public": true}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caddee0-608f-4a20-bf8a-786b019882bb None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caddee0-608f-4a20-bf8a-786b019882bb None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c5e690-838d-432e-87a8-7aaf7fc64ac8 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c5e690-838d-432e-87a8-7aaf7fc64ac8 None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c5e690-838d-432e-87a8-7aaf7fc64ac8 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c5e690-838d-432e-87a8-7aaf7fc64ac8 None admin] PATH_INFO: `/v3/projects` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c5e690-838d-432e-87a8-7aaf7fc64ac8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c5e690-838d-432e-87a8-7aaf7fc64ac8 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:14 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-e8083b5f-6d60-4e51-a7c4-b7088740bad0 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] http://10.27.203.238/share/v2/1ae8e27013bc48228edf3022159a9c1f/types returned with HTTP 200 May 28 12:57:14 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 282/548] 10.27.203.238 () {66 vars in 1359 bytes} [Tue May 28 12:57:14 2024] POST /share/v2/1ae8e27013bc48228edf3022159a9c1f/types => generated 653 bytes in 22 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:57:14 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-d5e9ffca-0eee-4dbb-a4d9-742cea169186 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] POST http://10.27.203.238/share/v2/1ae8e27013bc48228edf3022159a9c1f/types/267f85de-c874-4ef9-9dba-05907bb40f17/extra_specs May 28 12:57:14 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-d5e9ffca-0eee-4dbb-a4d9-742cea169186 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] Action: 'create', calling method: ShareTypeExtraSpecsController.create, body: {"extra_specs": {"driver_handles_share_servers": "False", "key": "value"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:57:14 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-d5e9ffca-0eee-4dbb-a4d9-742cea169186 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] http://10.27.203.238/share/v2/1ae8e27013bc48228edf3022159a9c1f/types/267f85de-c874-4ef9-9dba-05907bb40f17/extra_specs returned with HTTP 200 May 28 12:57:14 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 283/549] 10.27.203.238 () {66 vars in 1505 bytes} [Tue May 28 12:57:14 2024] POST /share/v2/1ae8e27013bc48228edf3022159a9c1f/types/267f85de-c874-4ef9-9dba-05907bb40f17/extra_specs => generated 74 bytes in 19 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:57:14 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-7365e857-56d4-4f56-94d4-a65f097cd4bd tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] POST http://10.27.203.238/share/v2/1ae8e27013bc48228edf3022159a9c1f/types/267f85de-c874-4ef9-9dba-05907bb40f17/extra_specs May 28 12:57:14 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-7365e857-56d4-4f56-94d4-a65f097cd4bd tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] Action: 'create', calling method: ShareTypeExtraSpecsController.create, body: {"extra_specs": {"driver_handles_share_servers": "False", "key": "vvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvv"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:57:14 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-7365e857-56d4-4f56-94d4-a65f097cd4bd tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] HTTP exception thrown: Invalid extra_spec: key: vvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvv May 28 12:57:14 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-7365e857-56d4-4f56-94d4-a65f097cd4bd tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] http://10.27.203.238/share/v2/1ae8e27013bc48228edf3022159a9c1f/types/267f85de-c874-4ef9-9dba-05907bb40f17/extra_specs returned with HTTP 400 May 28 12:57:14 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 284/550] 10.27.203.238 () {66 vars in 1506 bytes} [Tue May 28 12:57:14 2024] POST /share/v2/1ae8e27013bc48228edf3022159a9c1f/types/267f85de-c874-4ef9-9dba-05907bb40f17/extra_specs => generated 325 bytes in 11 msecs (HTTP/1.1 400) 6 headers in 240 bytes (2 switches on core 0) May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 926/1824] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 12:57:14 2024] POST /identity/v3/projects => generated 395 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54b9f84-b72a-4142-8b5d-d5e90b6e6298 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:14 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-28d1c1b9-dabe-4750-91c4-2816a61f4ebb tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] POST http://10.27.203.238/share/v2/1ae8e27013bc48228edf3022159a9c1f/types May 28 12:57:14 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-28d1c1b9-dabe-4750-91c4-2816a61f4ebb tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share_type": {"name": "tempest-typeshare-type-1507236769", "extra_specs": {"driver_handles_share_servers": "False", "key": "value"}, "share_type_access:is_public": true}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54b9f84-b72a-4142-8b5d-d5e90b6e6298 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:14 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.quota [None req-b5d0ddc5-db46-4239-8d97-cf384f7cf2d8 tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] Created reservations ['ab7ffdf9-56fa-46ff-bd17-20ed958a630f', '5049f642-7685-4fed-9400-7d772bbdd891', 'da54ec6d-4ce4-4422-a311-984cb9e54b27', '406b650e-b539-4c64-8d9a-ed7d99413dc6'] {{(pid=98330) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5ea478-40a9-4871-be95-a393aca9912c None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5ea478-40a9-4871-be95-a393aca9912c None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5ea478-40a9-4871-be95-a393aca9912c None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5ea478-40a9-4871-be95-a393aca9912c None admin] PATH_INFO: `/v3/users` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5ea478-40a9-4871-be95-a393aca9912c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:14 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-28d1c1b9-dabe-4750-91c4-2816a61f4ebb tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] http://10.27.203.238/share/v2/1ae8e27013bc48228edf3022159a9c1f/types returned with HTTP 200 May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5ea478-40a9-4871-be95-a393aca9912c None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:14 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 285/551] 10.27.203.238 () {66 vars in 1359 bytes} [Tue May 28 12:57:14 2024] POST /share/v2/1ae8e27013bc48228edf3022159a9c1f/types => generated 655 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-ef5ea478-40a9-4871-be95-a393aca9912c None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 12:57:14 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-7923b73e-82ef-4b45-8f27-140b46370496 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] POST http://10.27.203.238/share/v2/1ae8e27013bc48228edf3022159a9c1f/types/ad9a409c-7bfe-4e4b-9e03-83b5c57e112d/extra_specs May 28 12:57:14 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-7923b73e-82ef-4b45-8f27-140b46370496 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] Action: 'create', calling method: ShareTypeExtraSpecsController.create, body: {"extra_specs": {"driver_handles_share_servers": "False", "key": "value"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:57:14 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-01a2ae14-f15d-4183-924e-4ad9803a3801 tempest-ShareSnapshotInstancesTest-843694899 None] <<< [POST] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:57:14 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-01a2ae14-f15d-4183-924e-4ad9803a3801 tempest-ShareSnapshotInstancesTest-843694899 None] Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=0, created='2024-05-28T12:57:13.803333Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='f7d455a0-d2cb-4d17-917a-e41748cee8af', id=14, internal=False, is_s3_default_policy=False, name='c2f741cd-bac5-499f-9539-8e93d6a81282', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=[], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['*'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['*'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T12:57:14.146855Z', tenant_id=1, tenant_name='default', title='c2f741cd-bac5-499f-9539-8e93d6a81282', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/14/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[]) May 28 12:57:14 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-01a2ae14-f15d-4183-924e-4ad9803a3801 tempest-ShareSnapshotInstancesTest-843694899 None] --- [POST] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 12:57:14 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-01a2ae14-f15d-4183-924e-4ad9803a3801 tempest-ShareSnapshotInstancesTest-843694899 None] >>> [GET] https://127.0.0.1:40443/api/quotas/ May 28 12:57:14 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-01a2ae14-f15d-4183-924e-4ad9803a3801 tempest-ShareSnapshotInstancesTest-843694899 None] {'allow_redirects': True, May 28 12:57:14 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-01a2ae14-f15d-4183-924e-4ad9803a3801 tempest-ShareSnapshotInstancesTest-843694899 None] 'params': {'name': 'c2f741cd-bac5-499f-9539-8e93d6a81282'}} May 28 12:57:14 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-7923b73e-82ef-4b45-8f27-140b46370496 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] http://10.27.203.238/share/v2/1ae8e27013bc48228edf3022159a9c1f/types/ad9a409c-7bfe-4e4b-9e03-83b5c57e112d/extra_specs returned with HTTP 200 May 28 12:57:14 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 286/552] 10.27.203.238 () {66 vars in 1505 bytes} [Tue May 28 12:57:14 2024] POST /share/v2/1ae8e27013bc48228edf3022159a9c1f/types/ad9a409c-7bfe-4e4b-9e03-83b5c57e112d/extra_specs => generated 74 bytes in 20 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:57:14 l75lg1-v1 dstat.sh[49771]: 28-05 12:57:14| 24 3 69 3 0|5677M 1822M 277M 7850M| 25k 33k| 0 5030k| 0 568 | 14k 26k|1.63 1.03 1.00|2.0 1.0 0| 0 0 | 0 2048M| 29 354 0 77 0 May 28 12:57:14 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-54fb1219-2fa3-4418-9266-d6f335042815 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] PUT http://10.27.203.238/share/v2/1ae8e27013bc48228edf3022159a9c1f/types/ad9a409c-7bfe-4e4b-9e03-83b5c57e112d/extra_specs/key May 28 12:57:14 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-54fb1219-2fa3-4418-9266-d6f335042815 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] Action: 'update', calling method: ShareTypeExtraSpecsController.update, body: {"key": "vvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvv"} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:57:14 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-54fb1219-2fa3-4418-9266-d6f335042815 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] HTTP exception thrown: Invalid extra_spec: key: vvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvv May 28 12:57:14 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-54fb1219-2fa3-4418-9266-d6f335042815 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] http://10.27.203.238/share/v2/1ae8e27013bc48228edf3022159a9c1f/types/ad9a409c-7bfe-4e4b-9e03-83b5c57e112d/extra_specs/key returned with HTTP 400 May 28 12:57:14 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 287/553] 10.27.203.238 () {66 vars in 1517 bytes} [Tue May 28 12:57:14 2024] PUT /share/v2/1ae8e27013bc48228edf3022159a9c1f/types/ad9a409c-7bfe-4e4b-9e03-83b5c57e112d/extra_specs/key => generated 325 bytes in 11 msecs (HTTP/1.1 400) 6 headers in 240 bytes (2 switches on core 0) May 28 12:57:14 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.quota [None req-b5d0ddc5-db46-4239-8d97-cf384f7cf2d8 tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] Committed reservations ['ab7ffdf9-56fa-46ff-bd17-20ed958a630f', '5049f642-7685-4fed-9400-7d772bbdd891', 'da54ec6d-4ce4-4422-a311-984cb9e54b27', '406b650e-b539-4c64-8d9a-ed7d99413dc6'] {{(pid=98330) commit /opt/stack/manila/manila/quota.py:1063}} May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 899/1825] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 12:57:14 2024] POST /identity/v3/users => generated 306 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:57:14 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-6dd0def1-7571-4f89-b2f5-acd653dae925 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] POST http://10.27.203.238/share/v2/1ae8e27013bc48228edf3022159a9c1f/types May 28 12:57:14 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-6dd0def1-7571-4f89-b2f5-acd653dae925 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share_type": {"name": "tempest-typeshare-type-2139876614", "extra_specs": {"driver_handles_share_servers": "False", "key": "value"}, "share_type_access:is_public": true}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c5e690-838d-432e-87a8-7aaf7fc64ac8 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c5e690-838d-432e-87a8-7aaf7fc64ac8 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e46718e-e968-4536-83a8-eef2b729e2a2 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e46718e-e968-4536-83a8-eef2b729e2a2 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e46718e-e968-4536-83a8-eef2b729e2a2 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e46718e-e968-4536-83a8-eef2b729e2a2 None admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e46718e-e968-4536-83a8-eef2b729e2a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e46718e-e968-4536-83a8-eef2b729e2a2 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:14 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-6dd0def1-7571-4f89-b2f5-acd653dae925 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] http://10.27.203.238/share/v2/1ae8e27013bc48228edf3022159a9c1f/types returned with HTTP 200 May 28 12:57:14 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 288/554] 10.27.203.238 () {66 vars in 1359 bytes} [Tue May 28 12:57:14 2024] POST /share/v2/1ae8e27013bc48228edf3022159a9c1f/types => generated 655 bytes in 26 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 927/1826] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 12:57:14 2024] GET /identity/v3/roles => generated 1680 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5ea478-40a9-4871-be95-a393aca9912c None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:14 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-b22b29f1-377b-4129-b4a0-fecb40f123d2 tempest-ExtraSpecsAdminNegativeTest-773939988 tempest-ExtraSpecsAdminNegativeTest-773939988-project-member] PUT http://10.27.203.238/share/v2/b459b0ac20ef4f348e8ff53468c5c935/types/d7647d83-e1c0-4114-9c84-dc770aeeab34/extra_specs/key May 28 12:57:14 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-b22b29f1-377b-4129-b4a0-fecb40f123d2 tempest-ExtraSpecsAdminNegativeTest-773939988 tempest-ExtraSpecsAdminNegativeTest-773939988-project-member] Action: 'update', calling method: ShareTypeExtraSpecsController.update, body: {"key": "new_value"} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:57:14 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.policy [None req-b22b29f1-377b-4129-b4a0-fecb40f123d2 tempest-ExtraSpecsAdminNegativeTest-773939988 tempest-ExtraSpecsAdminNegativeTest-773939988-project-member] Policy check for share_types_extra_spec:update failed with credentials {'is_admin': False, 'user_id': '7365146fcc404c988e9841963a43be27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b459b0ac20ef4f348e8ff53468c5c935', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98329) authorize /opt/stack/manila/manila/policy.py:208}} May 28 12:57:14 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-b22b29f1-377b-4129-b4a0-fecb40f123d2 tempest-ExtraSpecsAdminNegativeTest-773939988 tempest-ExtraSpecsAdminNegativeTest-773939988-project-member] HTTP exception thrown: Access was denied to this resource. May 28 12:57:14 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-b22b29f1-377b-4129-b4a0-fecb40f123d2 tempest-ExtraSpecsAdminNegativeTest-773939988 tempest-ExtraSpecsAdminNegativeTest-773939988-project-member] http://10.27.203.238/share/v2/b459b0ac20ef4f348e8ff53468c5c935/types/d7647d83-e1c0-4114-9c84-dc770aeeab34/extra_specs/key returned with HTTP 403 May 28 12:57:14 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 289/555] 10.27.203.238 () {66 vars in 1516 bytes} [Tue May 28 12:57:14 2024] PUT /share/v2/b459b0ac20ef4f348e8ff53468c5c935/types/d7647d83-e1c0-4114-9c84-dc770aeeab34/extra_specs/key => generated 78 bytes in 6 msecs (HTTP/1.1 403) 6 headers in 237 bytes (2 switches on core 0) May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5ea478-40a9-4871-be95-a393aca9912c None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf100a16-b000-4eeb-867d-b1771a439939 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf100a16-b000-4eeb-867d-b1771a439939 None admin] REQUEST_METHOD: `PUT` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf100a16-b000-4eeb-867d-b1771a439939 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf100a16-b000-4eeb-867d-b1771a439939 None admin] PATH_INFO: `/v3/projects/ed83204ad63946bdae288892bd07d115/users/aecf70f564bb43b5bc870395023f1341/roles/44620cad10ae407c90c91e2c296adb04` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:14 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-1872ca47-c0a5-4967-a79b-00af76fab8ab tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] POST http://10.27.203.238/share/v2/1ae8e27013bc48228edf3022159a9c1f/types May 28 12:57:14 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-1872ca47-c0a5-4967-a79b-00af76fab8ab tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share_type": {"name": "tempest-typeshare-type-1344995381", "extra_specs": {"driver_handles_share_servers": "False", "key": "value"}, "share_type_access:is_public": true}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf100a16-b000-4eeb-867d-b1771a439939 None admin] RBAC: Authorizing `identity:create_grant(project_id=ed83204ad63946bdae288892bd07d115, user_id=aecf70f564bb43b5bc870395023f1341, role_id=44620cad10ae407c90c91e2c296adb04)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf100a16-b000-4eeb-867d-b1771a439939 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:14 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-1872ca47-c0a5-4967-a79b-00af76fab8ab tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] http://10.27.203.238/share/v2/1ae8e27013bc48228edf3022159a9c1f/types returned with HTTP 200 May 28 12:57:14 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 290/556] 10.27.203.238 () {66 vars in 1359 bytes} [Tue May 28 12:57:14 2024] POST /share/v2/1ae8e27013bc48228edf3022159a9c1f/types => generated 655 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:57:14 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-19055da7-6081-46c4-a189-c7ea3e1280ea tempest-ExtraSpecsAdminNegativeTest-773939988 tempest-ExtraSpecsAdminNegativeTest-773939988-project-member] POST http://10.27.203.238/share/v2/b459b0ac20ef4f348e8ff53468c5c935/types/e113c38a-fcde-46c9-9158-f2d3b50bd899/extra_specs May 28 12:57:14 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-19055da7-6081-46c4-a189-c7ea3e1280ea tempest-ExtraSpecsAdminNegativeTest-773939988 tempest-ExtraSpecsAdminNegativeTest-773939988-project-member] Action: 'create', calling method: ShareTypeExtraSpecsController.create, body: {"extra_specs": {"key": "new_value"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:57:14 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-b5d0ddc5-db46-4239-8d97-cf384f7cf2d8 tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] http://10.27.203.238/share/v2/fe54df7c653849ab8ec7523262c597cf/shares returned with HTTP 200 May 28 12:57:14 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.policy [None req-19055da7-6081-46c4-a189-c7ea3e1280ea tempest-ExtraSpecsAdminNegativeTest-773939988 tempest-ExtraSpecsAdminNegativeTest-773939988-project-member] Policy check for share_types_extra_spec:create failed with credentials {'is_admin': False, 'user_id': '7365146fcc404c988e9841963a43be27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b459b0ac20ef4f348e8ff53468c5c935', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98329) authorize /opt/stack/manila/manila/policy.py:208}} May 28 12:57:14 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-19055da7-6081-46c4-a189-c7ea3e1280ea tempest-ExtraSpecsAdminNegativeTest-773939988 tempest-ExtraSpecsAdminNegativeTest-773939988-project-member] HTTP exception thrown: Access was denied to this resource. May 28 12:57:14 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-19055da7-6081-46c4-a189-c7ea3e1280ea tempest-ExtraSpecsAdminNegativeTest-773939988 tempest-ExtraSpecsAdminNegativeTest-773939988-project-member] http://10.27.203.238/share/v2/b459b0ac20ef4f348e8ff53468c5c935/types/e113c38a-fcde-46c9-9158-f2d3b50bd899/extra_specs returned with HTTP 403 May 28 12:57:14 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 267/557] 10.27.203.238 () {66 vars in 1362 bytes} [Tue May 28 12:57:14 2024] POST /share/v2/fe54df7c653849ab8ec7523262c597cf/shares => generated 1452 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:57:14 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 291/558] 10.27.203.238 () {66 vars in 1505 bytes} [Tue May 28 12:57:14 2024] POST /share/v2/b459b0ac20ef4f348e8ff53468c5c935/types/e113c38a-fcde-46c9-9158-f2d3b50bd899/extra_specs => generated 78 bytes in 6 msecs (HTTP/1.1 403) 6 headers in 237 bytes (1 switches on core 0) May 28 12:57:14 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-b590bd79-fc9b-477e-9827-ffe5122d3e39 tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] GET http://10.27.203.238/share/v2/fe54df7c653849ab8ec7523262c597cf/shares/7da650db-1124-40b5-ba52-fb1170c038c8 May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 900/1827] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 12:57:14 2024] PUT /identity/v3/projects/ed83204ad63946bdae288892bd07d115/users/aecf70f564bb43b5bc870395023f1341/roles/44620cad10ae407c90c91e2c296adb04 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:57:14 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-b590bd79-fc9b-477e-9827-ffe5122d3e39 tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:14 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.host_manager [None req-b5d0ddc5-db46-4239-8d97-cf384f7cf2d8 tempest-SharesActionsAdminTest-1286316336 None] Share service is down. (host: l75lg1-v1@generic2). May 28 12:57:14 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-b590bd79-fc9b-477e-9827-ffe5122d3e39 tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:14 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-836ea1da-65c0-4389-8041-28fc10fd0b6a tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] POST http://10.27.203.238/share/v2/1ae8e27013bc48228edf3022159a9c1f/types May 28 12:57:14 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-836ea1da-65c0-4389-8041-28fc10fd0b6a tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share_type": {"name": "tempest-typeshare-type-48567042", "extra_specs": {"driver_handles_share_servers": "False", "key": "value"}, "share_type_access:is_public": true}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:57:14 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.host_manager [None req-b5d0ddc5-db46-4239-8d97-cf384f7cf2d8 tempest-SharesActionsAdminTest-1286316336 None] Share service is down. (host: l75lg1-v1@generic1). May 28 12:57:14 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-b5d0ddc5-db46-4239-8d97-cf384f7cf2d8 tempest-SharesActionsAdminTest-1286316336 None] Starting with 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:80}} May 28 12:57:14 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-b5d0ddc5-db46-4239-8d97-cf384f7cf2d8 tempest-SharesActionsAdminTest-1286316336 None] Filter OnlyHostFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:57:14 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-b5d0ddc5-db46-4239-8d97-cf384f7cf2d8 tempest-SharesActionsAdminTest-1286316336 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:57:14 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.capacity [None req-b5d0ddc5-db46-4239-8d97-cf384f7cf2d8 tempest-SharesActionsAdminTest-1286316336 None] Space information for share creation on host l75lg1-v1@vast#vast (requested / avail): 1/2070 {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/capacity.py:83}} May 28 12:57:14 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-b5d0ddc5-db46-4239-8d97-cf384f7cf2d8 tempest-SharesActionsAdminTest-1286316336 None] Filter CapacityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6020c0ed-9a6b-4ce4-98f5-d1ab2cfa5cb8 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6020c0ed-9a6b-4ce4-98f5-d1ab2cfa5cb8 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6020c0ed-9a6b-4ce4-98f5-d1ab2cfa5cb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:14 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-b5d0ddc5-db46-4239-8d97-cf384f7cf2d8 tempest-SharesActionsAdminTest-1286316336 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:57:14 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-b5d0ddc5-db46-4239-8d97-cf384f7cf2d8 tempest-SharesActionsAdminTest-1286316336 None] Driver Filter: Checking host 'l75lg1-v1@vast#vast' {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:37}} May 28 12:57:14 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-b5d0ddc5-db46-4239-8d97-cf384f7cf2d8 tempest-SharesActionsAdminTest-1286316336 None] Filter function not set :: passing host. {{(pid=98327) _check_filter_function /opt/stack/manila/manila/scheduler/filters/driver.py:53}} May 28 12:57:14 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-b5d0ddc5-db46-4239-8d97-cf384f7cf2d8 tempest-SharesActionsAdminTest-1286316336 None] Result: True {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:40}} May 28 12:57:14 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-b5d0ddc5-db46-4239-8d97-cf384f7cf2d8 tempest-SharesActionsAdminTest-1286316336 None] Done checking host 'l75lg1-v1@vast#vast' {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:41}} May 28 12:57:14 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-b5d0ddc5-db46-4239-8d97-cf384f7cf2d8 tempest-SharesActionsAdminTest-1286316336 None] Filter DriverFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:57:14 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-b5d0ddc5-db46-4239-8d97-cf384f7cf2d8 tempest-SharesActionsAdminTest-1286316336 None] Filter ShareReplicationFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:57:14 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-b5d0ddc5-db46-4239-8d97-cf384f7cf2d8 tempest-SharesActionsAdminTest-1286316336 None] Filter CreateFromSnapshotFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:57:14 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-b5d0ddc5-db46-4239-8d97-cf384f7cf2d8 tempest-SharesActionsAdminTest-1286316336 None] Filter AffinityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:57:14 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-b5d0ddc5-db46-4239-8d97-cf384f7cf2d8 tempest-SharesActionsAdminTest-1286316336 None] Filter AntiAffinityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:57:14 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.drivers.filter [None req-b5d0ddc5-db46-4239-8d97-cf384f7cf2d8 tempest-SharesActionsAdminTest-1286316336 None] Filtered share [host: 'l75lg1-v1@vast#vast', free_capacity_gb: 2070.6229242384434, pools: None] {{(pid=98327) _schedule_share /opt/stack/manila/manila/scheduler/drivers/filter.py:268}} May 28 12:57:14 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-b5d0ddc5-db46-4239-8d97-cf384f7cf2d8 tempest-SharesActionsAdminTest-1286316336 None] Checking host 'l75lg1-v1@vast#vast' {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:46}} May 28 12:57:14 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.weighers.goodness [None req-b5d0ddc5-db46-4239-8d97-cf384f7cf2d8 tempest-SharesActionsAdminTest-1286316336 None] Goodness function not set :: defaulting to minimal goodness rating of 0. May 28 12:57:14 l75lg1-v1 manila-scheduler[98327]: INFO manila.scheduler.weighers.goodness [None req-b5d0ddc5-db46-4239-8d97-cf384f7cf2d8 tempest-SharesActionsAdminTest-1286316336 None] Goodness function result for host l75lg1-v1@vast#vast: 0. May 28 12:57:14 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-b5d0ddc5-db46-4239-8d97-cf384f7cf2d8 tempest-SharesActionsAdminTest-1286316336 None] Goodness: 0 {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:48}} May 28 12:57:14 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-b5d0ddc5-db46-4239-8d97-cf384f7cf2d8 tempest-SharesActionsAdminTest-1286316336 None] Done checking host 'l75lg1-v1@vast#vast' {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:49}} May 28 12:57:14 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.drivers.filter [None req-b5d0ddc5-db46-4239-8d97-cf384f7cf2d8 tempest-SharesActionsAdminTest-1286316336 None] Choosing for share: WeighedHost [host: l75lg1-v1@vast#vast, weight: 0.0] {{(pid=98327) _schedule_share /opt/stack/manila/manila/scheduler/drivers/filter.py:274}} May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-6020c0ed-9a6b-4ce4-98f5-d1ab2cfa5cb8 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:57:14 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-836ea1da-65c0-4389-8041-28fc10fd0b6a tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] http://10.27.203.238/share/v2/1ae8e27013bc48228edf3022159a9c1f/types returned with HTTP 200 May 28 12:57:14 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 292/559] 10.27.203.238 () {66 vars in 1359 bytes} [Tue May 28 12:57:14 2024] POST /share/v2/1ae8e27013bc48228edf3022159a9c1f/types => generated 651 bytes in 24 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:57:14 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-b590bd79-fc9b-477e-9827-ffe5122d3e39 tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] http://10.27.203.238/share/v2/fe54df7c653849ab8ec7523262c597cf/shares/7da650db-1124-40b5-ba52-fb1170c038c8 returned with HTTP 200 May 28 12:57:14 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 268/560] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:57:14 2024] GET /share/v2/fe54df7c653849ab8ec7523262c597cf/shares/7da650db-1124-40b5-ba52-fb1170c038c8 => generated 1452 bytes in 30 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-6020c0ed-9a6b-4ce4-98f5-d1ab2cfa5cb8 None None] MFA Rules not processed for user `aecf70f564bb43b5bc870395023f1341`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:57:14 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 293/561] 10.27.203.238 () {66 vars in 1507 bytes} [Tue May 28 12:57:14 2024] PUT /share/v2/1ae8e27013bc48228edf3022159a9c1f/types/085a5b1e-9c62-49aa-beae-f0b2ca158c1e/extra_specs/ => generated 112 bytes in 3 msecs (HTTP/1.1 404) 3 headers in 98 bytes (1 switches on core 0) May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-6020c0ed-9a6b-4ce4-98f5-d1ab2cfa5cb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:14 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 269/562] 10.27.203.238 () {66 vars in 1405 bytes} [Tue May 28 12:57:14 2024] PUT /share/v2/1ae8e27013bc48228edf3022159a9c1f/types/extra_specs/key => generated 112 bytes in 4 msecs (HTTP/1.1 404) 3 headers in 98 bytes (1 switches on core 0) May 28 12:57:14 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-024aeb8c-3906-4ec4-a805-d5ba6de8d75e tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] PUT http://10.27.203.238/share/v2/1ae8e27013bc48228edf3022159a9c1f/types/tempest-fake-1619065030/extra_specs/key May 28 12:57:14 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-024aeb8c-3906-4ec4-a805-d5ba6de8d75e tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] Action: 'update', calling method: ShareTypeExtraSpecsController.update, body: {"key": "new_value"} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:57:14 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-024aeb8c-3906-4ec4-a805-d5ba6de8d75e tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] HTTP exception thrown: Share type tempest-fake-1619065030 could not be found. May 28 12:57:14 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-024aeb8c-3906-4ec4-a805-d5ba6de8d75e tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] http://10.27.203.238/share/v2/1ae8e27013bc48228edf3022159a9c1f/types/tempest-fake-1619065030/extra_specs/key returned with HTTP 404 May 28 12:57:14 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 294/563] 10.27.203.238 () {66 vars in 1477 bytes} [Tue May 28 12:57:14 2024] PUT /share/v2/1ae8e27013bc48228edf3022159a9c1f/types/tempest-fake-1619065030/extra_specs/key => generated 100 bytes in 10 msecs (HTTP/1.1 404) 6 headers in 238 bytes (1 switches on core 0) May 28 12:57:14 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-241ede1a-69bd-447a-b400-3df65bd96319 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] POST http://10.27.203.238/share/v2/1ae8e27013bc48228edf3022159a9c1f/types/tempest-fake-643797704/extra_specs May 28 12:57:14 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-241ede1a-69bd-447a-b400-3df65bd96319 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] Action: 'create', calling method: ShareTypeExtraSpecsController.create, body: {"extra_specs": {"key": "new_value"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:57:14 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-241ede1a-69bd-447a-b400-3df65bd96319 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] HTTP exception thrown: Share type tempest-fake-643797704 could not be found. May 28 12:57:14 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-241ede1a-69bd-447a-b400-3df65bd96319 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] http://10.27.203.238/share/v2/1ae8e27013bc48228edf3022159a9c1f/types/tempest-fake-643797704/extra_specs returned with HTTP 404 May 28 12:57:14 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 270/564] 10.27.203.238 () {66 vars in 1463 bytes} [Tue May 28 12:57:14 2024] POST /share/v2/1ae8e27013bc48228edf3022159a9c1f/types/tempest-fake-643797704/extra_specs => generated 99 bytes in 14 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 12:57:14 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-b4245c5b-7810-4463-bb38-938a59355f0e tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] POST http://10.27.203.238/share/v2/1ae8e27013bc48228edf3022159a9c1f/types May 28 12:57:14 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-b4245c5b-7810-4463-bb38-938a59355f0e tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share_type": {"name": "tempest-typeshare-type-616377596", "extra_specs": {"driver_handles_share_servers": "False", "key": "value"}, "share_type_access:is_public": true}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 928/1828] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:57:14 2024] POST /identity/v3/auth/tokens => generated 3966 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf100a16-b000-4eeb-867d-b1771a439939 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf100a16-b000-4eeb-867d-b1771a439939 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f38eda8-c677-4b46-bb08-471165d68c32 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f38eda8-c677-4b46-bb08-471165d68c32 None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f38eda8-c677-4b46-bb08-471165d68c32 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f38eda8-c677-4b46-bb08-471165d68c32 None admin] PATH_INFO: `/v3/projects` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f38eda8-c677-4b46-bb08-471165d68c32 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f38eda8-c677-4b46-bb08-471165d68c32 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:14 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-b4245c5b-7810-4463-bb38-938a59355f0e tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] http://10.27.203.238/share/v2/1ae8e27013bc48228edf3022159a9c1f/types returned with HTTP 200 May 28 12:57:14 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 295/565] 10.27.203.238 () {66 vars in 1359 bytes} [Tue May 28 12:57:14 2024] POST /share/v2/1ae8e27013bc48228edf3022159a9c1f/types => generated 653 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:57:14 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-48daa801-786d-4f4c-84d1-99bba139d64f tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] POST http://10.27.203.238/share/v2/1ae8e27013bc48228edf3022159a9c1f/types/c22ebdb5-43a3-4144-9935-bc06959bfb25/extra_specs May 28 12:57:14 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-48daa801-786d-4f4c-84d1-99bba139d64f tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] Action: 'create', calling method: ShareTypeExtraSpecsController.create, body: {"extra_specs": {"": "new_value"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:57:14 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-48daa801-786d-4f4c-84d1-99bba139d64f tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] HTTP exception thrown: Invalid extra_spec: : new_value May 28 12:57:14 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-48daa801-786d-4f4c-84d1-99bba139d64f tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] http://10.27.203.238/share/v2/1ae8e27013bc48228edf3022159a9c1f/types/c22ebdb5-43a3-4144-9935-bc06959bfb25/extra_specs returned with HTTP 400 May 28 12:57:14 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 271/566] 10.27.203.238 () {66 vars in 1505 bytes} [Tue May 28 12:57:14 2024] POST /share/v2/1ae8e27013bc48228edf3022159a9c1f/types/c22ebdb5-43a3-4144-9935-bc06959bfb25/extra_specs => generated 75 bytes in 10 msecs (HTTP/1.1 400) 6 headers in 239 bytes (1 switches on core 0) May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6020c0ed-9a6b-4ce4-98f5-d1ab2cfa5cb8 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-6020c0ed-9a6b-4ce4-98f5-d1ab2cfa5cb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:14 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b5d0ddc5-db46-4239-8d97-cf384f7cf2d8 tempest-SharesActionsAdminTest-1286316336 None] >>> [GET] https://127.0.0.1:40443/api/vippools/ May 28 12:57:14 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b5d0ddc5-db46-4239-8d97-cf384f7cf2d8 tempest-SharesActionsAdminTest-1286316336 None] {'allow_redirects': True, 'params': {'name': 'vippool-1'}} May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 901/1829] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 12:57:14 2024] POST /identity/v3/projects => generated 395 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f38eda8-c677-4b46-bb08-471165d68c32 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f38eda8-c677-4b46-bb08-471165d68c32 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6020c0ed-9a6b-4ce4-98f5-d1ab2cfa5cb8 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a67506-d529-4fec-ac70-22999c7300da None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a67506-d529-4fec-ac70-22999c7300da None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a67506-d529-4fec-ac70-22999c7300da None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a67506-d529-4fec-ac70-22999c7300da None admin] PATH_INFO: `/v3/users` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a67506-d529-4fec-ac70-22999c7300da None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a67506-d529-4fec-ac70-22999c7300da None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-02a67506-d529-4fec-ac70-22999c7300da None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c85f13d-658a-40c5-a154-847d5795550c tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be38ad37856445168a42a6912c87bc8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae8e27013bc48228edf3022159a9c1f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c85f13d-658a-40c5-a154-847d5795550c tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c85f13d-658a-40c5-a154-847d5795550c tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c85f13d-658a-40c5-a154-847d5795550c tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] PATH_INFO: `/v3/users/b9078b0601ac4efa93bdcc390f3d1208` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 902/1830] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 12:57:14 2024] POST /identity/v3/users => generated 306 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a67506-d529-4fec-ac70-22999c7300da None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c85f13d-658a-40c5-a154-847d5795550c tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] RBAC: Authorizing `identity:delete_user(user_id=b9078b0601ac4efa93bdcc390f3d1208)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c85f13d-658a-40c5-a154-847d5795550c tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a67506-d529-4fec-ac70-22999c7300da None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7682da36-63df-40a7-bec2-65d7ed34234a None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7682da36-63df-40a7-bec2-65d7ed34234a None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7682da36-63df-40a7-bec2-65d7ed34234a None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7682da36-63df-40a7-bec2-65d7ed34234a None admin] PATH_INFO: `/v3/roles` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7682da36-63df-40a7-bec2-65d7ed34234a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7682da36-63df-40a7-bec2-65d7ed34234a None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-0c85f13d-658a-40c5-a154-847d5795550c tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] Could not find user: b9078b0601ac4efa93bdcc390f3d1208.: keystone.exception.UserNotFound: Could not find user: b9078b0601ac4efa93bdcc390f3d1208. May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: b9078b0601ac4efa93bdcc390f3d1208. May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 929/1831] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 12:57:14 2024] DELETE /identity/v3/users/b9078b0601ac4efa93bdcc390f3d1208 => generated 110 bytes in 112 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c85f13d-658a-40c5-a154-847d5795550c tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c85f13d-658a-40c5-a154-847d5795550c tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 903/1832] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 12:57:14 2024] GET /identity/v3/roles => generated 1680 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a157ab4-2b61-4279-86c5-a0a64b2e4383 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be38ad37856445168a42a6912c87bc8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae8e27013bc48228edf3022159a9c1f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7682da36-63df-40a7-bec2-65d7ed34234a None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a157ab4-2b61-4279-86c5-a0a64b2e4383 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a157ab4-2b61-4279-86c5-a0a64b2e4383 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a157ab4-2b61-4279-86c5-a0a64b2e4383 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] PATH_INFO: `/v3/users/567edee5a37f498e8a3f54a933728377` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a157ab4-2b61-4279-86c5-a0a64b2e4383 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] RBAC: Authorizing `identity:delete_user(user_id=567edee5a37f498e8a3f54a933728377)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a157ab4-2b61-4279-86c5-a0a64b2e4383 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7682da36-63df-40a7-bec2-65d7ed34234a None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bb934a-e4c7-411a-8de8-4607757a3415 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bb934a-e4c7-411a-8de8-4607757a3415 None admin] REQUEST_METHOD: `PUT` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bb934a-e4c7-411a-8de8-4607757a3415 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bb934a-e4c7-411a-8de8-4607757a3415 None admin] PATH_INFO: `/v3/projects/3e21df600d6c4f93ae48db92d82bf03e/users/3602f1b4b0604dac9f3dac83a8eb3661/roles/44620cad10ae407c90c91e2c296adb04` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bb934a-e4c7-411a-8de8-4607757a3415 None admin] RBAC: Authorizing `identity:create_grant(project_id=3e21df600d6c4f93ae48db92d82bf03e, user_id=3602f1b4b0604dac9f3dac83a8eb3661, role_id=44620cad10ae407c90c91e2c296adb04)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bb934a-e4c7-411a-8de8-4607757a3415 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51266]: DEBUG dbcounter [-] [51266] Writing DB stats keystone:SELECT=3678,keystone:INSERT=201,keystone:DELETE=404 {{(pid=51266) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 904/1833] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 12:57:14 2024] PUT /identity/v3/projects/3e21df600d6c4f93ae48db92d82bf03e/users/3602f1b4b0604dac9f3dac83a8eb3661/roles/44620cad10ae407c90c91e2c296adb04 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ece01e-3689-4fa6-8a29-faf22992d18d None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ece01e-3689-4fa6-8a29-faf22992d18d None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ece01e-3689-4fa6-8a29-faf22992d18d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-86ece01e-3689-4fa6-8a29-faf22992d18d None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-86ece01e-3689-4fa6-8a29-faf22992d18d None None] MFA Rules not processed for user `3602f1b4b0604dac9f3dac83a8eb3661`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-86ece01e-3689-4fa6-8a29-faf22992d18d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51267]: DEBUG dbcounter [-] [51267] Writing DB stats keystone:SELECT=3633,keystone:INSERT=207,keystone:DELETE=395 {{(pid=51267) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-5a157ab4-2b61-4279-86c5-a0a64b2e4383 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '567edee5a37f498e8a3f54a933728377', 'request_id': 'req-5a157ab4-2b61-4279-86c5-a0a64b2e4383'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-5a157ab4-2b61-4279-86c5-a0a64b2e4383 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '567edee5a37f498e8a3f54a933728377', 'request_id': 'req-5a157ab4-2b61-4279-86c5-a0a64b2e4383'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-5a157ab4-2b61-4279-86c5-a0a64b2e4383 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '567edee5a37f498e8a3f54a933728377', 'request_id': 'req-5a157ab4-2b61-4279-86c5-a0a64b2e4383'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-5a157ab4-2b61-4279-86c5-a0a64b2e4383 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '567edee5a37f498e8a3f54a933728377', 'request_id': 'req-5a157ab4-2b61-4279-86c5-a0a64b2e4383'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 905/1834] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:57:14 2024] POST /identity/v3/auth/tokens => generated 3966 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ece01e-3689-4fa6-8a29-faf22992d18d None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-86ece01e-3689-4fa6-8a29-faf22992d18d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:14 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-01a2ae14-f15d-4183-924e-4ad9803a3801 tempest-ShareSnapshotInstancesTest-843694899 None] <<< [GET] https://127.0.0.1:40443/api/quotas/ May 28 12:57:14 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-01a2ae14-f15d-4183-924e-4ad9803a3801 tempest-ShareSnapshotInstancesTest-843694899 None] [] May 28 12:57:14 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-01a2ae14-f15d-4183-924e-4ad9803a3801 tempest-ShareSnapshotInstancesTest-843694899 None] --- [GET] https://127.0.0.1:40443/api/quotas/: Done May 28 12:57:14 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-01a2ae14-f15d-4183-924e-4ad9803a3801 tempest-ShareSnapshotInstancesTest-843694899 None] >>> [POST] https://127.0.0.1:40443/api/quotas/ May 28 12:57:14 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-01a2ae14-f15d-4183-924e-4ad9803a3801 tempest-ShareSnapshotInstancesTest-843694899 None] {'data': '{"name": "c2f741cd-bac5-499f-9539-8e93d6a81282", "path": ' May 28 12:57:14 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-01a2ae14-f15d-4183-924e-4ad9803a3801 tempest-ShareSnapshotInstancesTest-843694899 None] '"/manila/manila-c2f741cd-bac5-499f-9539-8e93d6a81282", "create_dir": ' May 28 12:57:14 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-01a2ae14-f15d-4183-924e-4ad9803a3801 tempest-ShareSnapshotInstancesTest-843694899 None] 'true, "hard_limit": 1073741824}', May 28 12:57:14 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-01a2ae14-f15d-4183-924e-4ad9803a3801 tempest-ShareSnapshotInstancesTest-843694899 None] 'json': None, May 28 12:57:14 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-01a2ae14-f15d-4183-924e-4ad9803a3801 tempest-ShareSnapshotInstancesTest-843694899 None] 'params': None} May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-5a157ab4-2b61-4279-86c5-a0a64b2e4383 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '567edee5a37f498e8a3f54a933728377', 'request_id': 'req-5a157ab4-2b61-4279-86c5-a0a64b2e4383'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 930/1835] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 12:57:14 2024] DELETE /identity/v3/users/567edee5a37f498e8a3f54a933728377 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 28 12:57:14 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-10d6fd4e-e029-4d6a-b07f-c732ed9efc98 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] DELETE http://10.27.203.238/share/v2/1ae8e27013bc48228edf3022159a9c1f/types/c22ebdb5-43a3-4144-9935-bc06959bfb25 May 28 12:57:14 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-10d6fd4e-e029-4d6a-b07f-c732ed9efc98 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:14 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-10d6fd4e-e029-4d6a-b07f-c732ed9efc98 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] Calling method 'ShareTypesController._delete' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ece01e-3689-4fa6-8a29-faf22992d18d None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f065e7e-5e4e-4f6f-a042-80972dfa34d0 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f065e7e-5e4e-4f6f-a042-80972dfa34d0 None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f065e7e-5e4e-4f6f-a042-80972dfa34d0 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f065e7e-5e4e-4f6f-a042-80972dfa34d0 None admin] PATH_INFO: `/v3/projects` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f065e7e-5e4e-4f6f-a042-80972dfa34d0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f065e7e-5e4e-4f6f-a042-80972dfa34d0 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:14 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-10d6fd4e-e029-4d6a-b07f-c732ed9efc98 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] http://10.27.203.238/share/v2/1ae8e27013bc48228edf3022159a9c1f/types/c22ebdb5-43a3-4144-9935-bc06959bfb25 returned with HTTP 202 May 28 12:57:14 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 296/567] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:57:14 2024] DELETE /share/v2/1ae8e27013bc48228edf3022159a9c1f/types/c22ebdb5-43a3-4144-9935-bc06959bfb25 => generated 0 bytes in 57 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:57:14 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-d560cfbb-8668-4f95-9067-ed4ad799aae2 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] GET http://10.27.203.238/share/v2/1ae8e27013bc48228edf3022159a9c1f/types/c22ebdb5-43a3-4144-9935-bc06959bfb25 May 28 12:57:14 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-d560cfbb-8668-4f95-9067-ed4ad799aae2 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:14 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-d560cfbb-8668-4f95-9067-ed4ad799aae2 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] Calling method 'ShareTypesController.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:14 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-d560cfbb-8668-4f95-9067-ed4ad799aae2 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] HTTP exception thrown: Share type not found. May 28 12:57:14 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-d560cfbb-8668-4f95-9067-ed4ad799aae2 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] http://10.27.203.238/share/v2/1ae8e27013bc48228edf3022159a9c1f/types/c22ebdb5-43a3-4144-9935-bc06959bfb25 returned with HTTP 404 May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 906/1836] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 12:57:14 2024] POST /identity/v3/projects => generated 393 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 28 12:57:14 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 272/568] 10.27.203.238 () {64 vars in 1448 bytes} [Tue May 28 12:57:14 2024] GET /share/v2/1ae8e27013bc48228edf3022159a9c1f/types/c22ebdb5-43a3-4144-9935-bc06959bfb25 => generated 67 bytes in 10 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a157ab4-2b61-4279-86c5-a0a64b2e4383 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:14 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-cfca92c8-0f8a-45a2-8743-f1dd217ec508 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] DELETE http://10.27.203.238/share/v2/1ae8e27013bc48228edf3022159a9c1f/types/085a5b1e-9c62-49aa-beae-f0b2ca158c1e May 28 12:57:14 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-cfca92c8-0f8a-45a2-8743-f1dd217ec508 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a157ab4-2b61-4279-86c5-a0a64b2e4383 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:14 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-cfca92c8-0f8a-45a2-8743-f1dd217ec508 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] Calling method 'ShareTypesController._delete' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4e9aef-ba91-488e-8093-c0928fe38bdf None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4e9aef-ba91-488e-8093-c0928fe38bdf None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4e9aef-ba91-488e-8093-c0928fe38bdf None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4e9aef-ba91-488e-8093-c0928fe38bdf None admin] PATH_INFO: `/v3/users` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4e9aef-ba91-488e-8093-c0928fe38bdf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4e9aef-ba91-488e-8093-c0928fe38bdf None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-0b4e9aef-ba91-488e-8093-c0928fe38bdf None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 12:57:14 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-cfca92c8-0f8a-45a2-8743-f1dd217ec508 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] http://10.27.203.238/share/v2/1ae8e27013bc48228edf3022159a9c1f/types/085a5b1e-9c62-49aa-beae-f0b2ca158c1e returned with HTTP 202 May 28 12:57:14 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 297/569] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:57:14 2024] DELETE /share/v2/1ae8e27013bc48228edf3022159a9c1f/types/085a5b1e-9c62-49aa-beae-f0b2ca158c1e => generated 0 bytes in 45 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:57:14 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-37031cc7-4aaa-406f-afd0-45e923434114 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] GET http://10.27.203.238/share/v2/1ae8e27013bc48228edf3022159a9c1f/types/085a5b1e-9c62-49aa-beae-f0b2ca158c1e May 28 12:57:14 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-37031cc7-4aaa-406f-afd0-45e923434114 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:14 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-37031cc7-4aaa-406f-afd0-45e923434114 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] Calling method 'ShareTypesController.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:14 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-37031cc7-4aaa-406f-afd0-45e923434114 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] HTTP exception thrown: Share type not found. May 28 12:57:14 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-37031cc7-4aaa-406f-afd0-45e923434114 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] http://10.27.203.238/share/v2/1ae8e27013bc48228edf3022159a9c1f/types/085a5b1e-9c62-49aa-beae-f0b2ca158c1e returned with HTTP 404 May 28 12:57:14 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 273/570] 10.27.203.238 () {64 vars in 1448 bytes} [Tue May 28 12:57:14 2024] GET /share/v2/1ae8e27013bc48228edf3022159a9c1f/types/085a5b1e-9c62-49aa-beae-f0b2ca158c1e => generated 67 bytes in 10 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 12:57:14 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-1ec3a1f3-7648-43bb-ae11-b06ea54d0c68 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] DELETE http://10.27.203.238/share/v2/1ae8e27013bc48228edf3022159a9c1f/types/e113c38a-fcde-46c9-9158-f2d3b50bd899 May 28 12:57:14 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-1ec3a1f3-7648-43bb-ae11-b06ea54d0c68 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:14 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-1ec3a1f3-7648-43bb-ae11-b06ea54d0c68 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] Calling method 'ShareTypesController._delete' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 931/1837] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 12:57:14 2024] POST /identity/v3/users => generated 304 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f065e7e-5e4e-4f6f-a042-80972dfa34d0 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f065e7e-5e4e-4f6f-a042-80972dfa34d0 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6da1d80-efb7-48bb-8478-e11afd3bcd7f None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6da1d80-efb7-48bb-8478-e11afd3bcd7f None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6da1d80-efb7-48bb-8478-e11afd3bcd7f None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6da1d80-efb7-48bb-8478-e11afd3bcd7f None admin] PATH_INFO: `/v3/roles` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6da1d80-efb7-48bb-8478-e11afd3bcd7f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:14 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6da1d80-efb7-48bb-8478-e11afd3bcd7f None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:15 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 907/1838] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 12:57:14 2024] GET /identity/v3/roles => generated 1680 bytes in 17 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:57:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4e9aef-ba91-488e-8093-c0928fe38bdf None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4e9aef-ba91-488e-8093-c0928fe38bdf None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67ee280-54d1-4658-ba4e-dd55cbd8f5a2 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67ee280-54d1-4658-ba4e-dd55cbd8f5a2 None admin] REQUEST_METHOD: `PUT` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67ee280-54d1-4658-ba4e-dd55cbd8f5a2 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67ee280-54d1-4658-ba4e-dd55cbd8f5a2 None admin] PATH_INFO: `/v3/projects/86b1b2ed568f43c9892e17d54b3c5f78/users/d2db2faa187d4ba4baf6b1b73c2fb965/roles/e7989893488f483baa107be56668c4f8` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-1ec3a1f3-7648-43bb-ae11-b06ea54d0c68 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] http://10.27.203.238/share/v2/1ae8e27013bc48228edf3022159a9c1f/types/e113c38a-fcde-46c9-9158-f2d3b50bd899 returned with HTTP 202 May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 298/571] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:57:14 2024] DELETE /share/v2/1ae8e27013bc48228edf3022159a9c1f/types/e113c38a-fcde-46c9-9158-f2d3b50bd899 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:57:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67ee280-54d1-4658-ba4e-dd55cbd8f5a2 None admin] RBAC: Authorizing `identity:create_grant(project_id=86b1b2ed568f43c9892e17d54b3c5f78, user_id=d2db2faa187d4ba4baf6b1b73c2fb965, role_id=e7989893488f483baa107be56668c4f8)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67ee280-54d1-4658-ba4e-dd55cbd8f5a2 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-1340caed-51ae-4632-9cfc-7e36a2940959 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] GET http://10.27.203.238/share/v2/1ae8e27013bc48228edf3022159a9c1f/types/e113c38a-fcde-46c9-9158-f2d3b50bd899 May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-1340caed-51ae-4632-9cfc-7e36a2940959 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-1340caed-51ae-4632-9cfc-7e36a2940959 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] Calling method 'ShareTypesController.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-1340caed-51ae-4632-9cfc-7e36a2940959 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] HTTP exception thrown: Share type not found. May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-1340caed-51ae-4632-9cfc-7e36a2940959 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] http://10.27.203.238/share/v2/1ae8e27013bc48228edf3022159a9c1f/types/e113c38a-fcde-46c9-9158-f2d3b50bd899 returned with HTTP 404 May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 274/572] 10.27.203.238 () {64 vars in 1448 bytes} [Tue May 28 12:57:15 2024] GET /share/v2/1ae8e27013bc48228edf3022159a9c1f/types/e113c38a-fcde-46c9-9158-f2d3b50bd899 => generated 67 bytes in 11 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-043386a0-abef-4f0d-ba6d-ffd164d43bcc tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] DELETE http://10.27.203.238/share/v2/1ae8e27013bc48228edf3022159a9c1f/types/d7647d83-e1c0-4114-9c84-dc770aeeab34 May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-043386a0-abef-4f0d-ba6d-ffd164d43bcc tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:15 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 932/1839] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 12:57:15 2024] PUT /identity/v3/projects/86b1b2ed568f43c9892e17d54b3c5f78/users/d2db2faa187d4ba4baf6b1b73c2fb965/roles/e7989893488f483baa107be56668c4f8 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-043386a0-abef-4f0d-ba6d-ffd164d43bcc tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] Calling method 'ShareTypesController._delete' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6da1d80-efb7-48bb-8478-e11afd3bcd7f None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6da1d80-efb7-48bb-8478-e11afd3bcd7f None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-043386a0-abef-4f0d-ba6d-ffd164d43bcc tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] http://10.27.203.238/share/v2/1ae8e27013bc48228edf3022159a9c1f/types/d7647d83-e1c0-4114-9c84-dc770aeeab34 returned with HTTP 202 May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 299/573] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:57:15 2024] DELETE /share/v2/1ae8e27013bc48228edf3022159a9c1f/types/d7647d83-e1c0-4114-9c84-dc770aeeab34 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:57:15 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b5d0ddc5-db46-4239-8d97-cf384f7cf2d8 tempest-SharesActionsAdminTest-1286316336 None] <<< [GET] https://127.0.0.1:40443/api/vippools/ May 28 12:57:15 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b5d0ddc5-db46-4239-8d97-cf384f7cf2d8 tempest-SharesActionsAdminTest-1286316336 None] [Bunch(active_cnode_ids=[], active_interfaces=4, cluster='loop75-kfs', cluster_id=1, cnode_ids=[], cnodes=[], domain_name='vippool-1', enable_l3=False, enable_weighted_balancing=False, enabled=True, end_ip='172.21.75.4', guid='f2abaede-b397-413a-8faa-3aeead6d3b28', gw_ip='', gw_ipv6='', id=2, ip_ranges=[['172.21.75.1', '172.21.75.4']], name='vippool-1', peer_asn=0, port_membership='ALL', ranges_summary='172.21.75.[1-4]', role='PROTOCOLS', start_ip='172.21.75.1', subnet_cidr=16, subnet_cidr_ipv6=None, sync='SYNCED', sync_time='2024-05-28T12:50:09.644123Z', tenant_id=1, tenant_name='default', title='172.21.75.1 - 172.21.75.4', url='https://127.0.0.1:40443/api/vippools/2/', vast_asn=0, vlan=0, vms_preferred=False)] May 28 12:57:15 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b5d0ddc5-db46-4239-8d97-cf384f7cf2d8 tempest-SharesActionsAdminTest-1286316336 None] --- [GET] https://127.0.0.1:40443/api/vippools/: Done May 28 12:57:15 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b5d0ddc5-db46-4239-8d97-cf384f7cf2d8 tempest-SharesActionsAdminTest-1286316336 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:57:15 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b5d0ddc5-db46-4239-8d97-cf384f7cf2d8 tempest-SharesActionsAdminTest-1286316336 None] {'allow_redirects': True, May 28 12:57:15 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b5d0ddc5-db46-4239-8d97-cf384f7cf2d8 tempest-SharesActionsAdminTest-1286316336 None] 'params': {'name': '7c19614c-d968-4489-b2ad-bd88c2ef8054'}} May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-387d9c25-a02c-4bcc-922f-0e9ccea596c5 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] GET http://10.27.203.238/share/v2/1ae8e27013bc48228edf3022159a9c1f/types/d7647d83-e1c0-4114-9c84-dc770aeeab34 May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-387d9c25-a02c-4bcc-922f-0e9ccea596c5 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-387d9c25-a02c-4bcc-922f-0e9ccea596c5 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] Calling method 'ShareTypesController.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda2f476-fa99-4294-8db1-898f7e5bb609 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda2f476-fa99-4294-8db1-898f7e5bb609 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda2f476-fa99-4294-8db1-898f7e5bb609 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda2f476-fa99-4294-8db1-898f7e5bb609 None admin] PATH_INFO: `/v3/roles` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda2f476-fa99-4294-8db1-898f7e5bb609 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda2f476-fa99-4294-8db1-898f7e5bb609 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-387d9c25-a02c-4bcc-922f-0e9ccea596c5 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] HTTP exception thrown: Share type not found. May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-387d9c25-a02c-4bcc-922f-0e9ccea596c5 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] http://10.27.203.238/share/v2/1ae8e27013bc48228edf3022159a9c1f/types/d7647d83-e1c0-4114-9c84-dc770aeeab34 returned with HTTP 404 May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 275/574] 10.27.203.238 () {64 vars in 1448 bytes} [Tue May 28 12:57:15 2024] GET /share/v2/1ae8e27013bc48228edf3022159a9c1f/types/d7647d83-e1c0-4114-9c84-dc770aeeab34 => generated 67 bytes in 10 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 12:57:15 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 908/1840] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 12:57:15 2024] GET /identity/v3/roles => generated 1680 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:57:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67ee280-54d1-4658-ba4e-dd55cbd8f5a2 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-ebb5d525-90a4-48dd-8bcd-994d3c59322c tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] DELETE http://10.27.203.238/share/v2/1ae8e27013bc48228edf3022159a9c1f/types/ad9a409c-7bfe-4e4b-9e03-83b5c57e112d May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-ebb5d525-90a4-48dd-8bcd-994d3c59322c tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-ebb5d525-90a4-48dd-8bcd-994d3c59322c tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] Calling method 'ShareTypesController._delete' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67ee280-54d1-4658-ba4e-dd55cbd8f5a2 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8b16a6-ca2f-4b6b-8f10-3cb4d4bd808f None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8b16a6-ca2f-4b6b-8f10-3cb4d4bd808f None admin] REQUEST_METHOD: `PUT` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8b16a6-ca2f-4b6b-8f10-3cb4d4bd808f None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8b16a6-ca2f-4b6b-8f10-3cb4d4bd808f None admin] PATH_INFO: `/v3/projects/86b1b2ed568f43c9892e17d54b3c5f78/users/d2db2faa187d4ba4baf6b1b73c2fb965/roles/e7989893488f483baa107be56668c4f8` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8b16a6-ca2f-4b6b-8f10-3cb4d4bd808f None admin] RBAC: Authorizing `identity:create_grant(project_id=86b1b2ed568f43c9892e17d54b3c5f78, user_id=d2db2faa187d4ba4baf6b1b73c2fb965, role_id=e7989893488f483baa107be56668c4f8)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8b16a6-ca2f-4b6b-8f10-3cb4d4bd808f None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:15 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 933/1841] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 12:57:15 2024] PUT /identity/v3/projects/86b1b2ed568f43c9892e17d54b3c5f78/users/d2db2faa187d4ba4baf6b1b73c2fb965/roles/e7989893488f483baa107be56668c4f8 => generated 0 bytes in 18 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:57:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9a3cd1-4d76-4e59-be76-e733c84ec7f4 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9a3cd1-4d76-4e59-be76-e733c84ec7f4 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9a3cd1-4d76-4e59-be76-e733c84ec7f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:15 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-dc9a3cd1-4d76-4e59-be76-e733c84ec7f4 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-40236442-43a4-48c8-9b11-90c5345d1991 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] GET http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/shares/9be3b244-34ab-4002-b1e1-427af2ab8545 May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-40236442-43a4-48c8-9b11-90c5345d1991 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-40236442-43a4-48c8-9b11-90c5345d1991 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-ebb5d525-90a4-48dd-8bcd-994d3c59322c tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] http://10.27.203.238/share/v2/1ae8e27013bc48228edf3022159a9c1f/types/ad9a409c-7bfe-4e4b-9e03-83b5c57e112d returned with HTTP 202 May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 300/575] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:57:15 2024] DELETE /share/v2/1ae8e27013bc48228edf3022159a9c1f/types/ad9a409c-7bfe-4e4b-9e03-83b5c57e112d => generated 0 bytes in 42 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:57:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-dc9a3cd1-4d76-4e59-be76-e733c84ec7f4 None None] MFA Rules not processed for user `d2db2faa187d4ba4baf6b1b73c2fb965`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-40236442-43a4-48c8-9b11-90c5345d1991 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] HTTP exception thrown: The resource could not be found. May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-40236442-43a4-48c8-9b11-90c5345d1991 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/shares/9be3b244-34ab-4002-b1e1-427af2ab8545 returned with HTTP 404 May 28 12:57:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-dc9a3cd1-4d76-4e59-be76-e733c84ec7f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-3d930ab6-0987-4d26-b189-f2c7bf0e033a tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] GET http://10.27.203.238/share/v2/1ae8e27013bc48228edf3022159a9c1f/types/ad9a409c-7bfe-4e4b-9e03-83b5c57e112d May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-3d930ab6-0987-4d26-b189-f2c7bf0e033a tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-3d930ab6-0987-4d26-b189-f2c7bf0e033a tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] Calling method 'ShareTypesController.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 276/576] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:57:15 2024] GET /share/v2/a3499cb78849424db45e54caac01de92/shares/9be3b244-34ab-4002-b1e1-427af2ab8545 => generated 78 bytes in 12 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-3d930ab6-0987-4d26-b189-f2c7bf0e033a tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] HTTP exception thrown: Share type not found. May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-3d930ab6-0987-4d26-b189-f2c7bf0e033a tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] http://10.27.203.238/share/v2/1ae8e27013bc48228edf3022159a9c1f/types/ad9a409c-7bfe-4e4b-9e03-83b5c57e112d returned with HTTP 404 May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 301/577] 10.27.203.238 () {64 vars in 1448 bytes} [Tue May 28 12:57:15 2024] GET /share/v2/1ae8e27013bc48228edf3022159a9c1f/types/ad9a409c-7bfe-4e4b-9e03-83b5c57e112d => generated 67 bytes in 10 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-5e3899b9-b6e9-4441-8750-3d8495665a52 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] POST http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/shares May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-5e3899b9-b6e9-4441-8750-3d8495665a52 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share": {"share_proto": "nfs", "description": "Tempest's share", "snapshot_id": null, "name": "tempest-tempest-created-share-2015176486", "size": 1, "metadata": {}, "is_public": false, "share_type": "ed6e3c4a-7505-47e7-9c77-78267ba93d85"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.v1.shares [None req-5e3899b9-b6e9-4441-8750-3d8495665a52 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Create NFS share of 1 GB May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-9dd43f39-0601-45a8-8131-02eb06d8635c tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] DELETE http://10.27.203.238/share/v2/1ae8e27013bc48228edf3022159a9c1f/types/267f85de-c874-4ef9-9dba-05907bb40f17 May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-9dd43f39-0601-45a8-8131-02eb06d8635c tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-9dd43f39-0601-45a8-8131-02eb06d8635c tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] Calling method 'ShareTypesController._delete' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:15 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 909/1842] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:57:15 2024] POST /identity/v3/auth/tokens => generated 4087 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:57:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8b16a6-ca2f-4b6b-8f10-3cb4d4bd808f None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-9dd43f39-0601-45a8-8131-02eb06d8635c tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] http://10.27.203.238/share/v2/1ae8e27013bc48228edf3022159a9c1f/types/267f85de-c874-4ef9-9dba-05907bb40f17 returned with HTTP 202 May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 302/578] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:57:15 2024] DELETE /share/v2/1ae8e27013bc48228edf3022159a9c1f/types/267f85de-c874-4ef9-9dba-05907bb40f17 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 6 headers in 243 bytes (2 switches on core 0) May 28 12:57:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8b16a6-ca2f-4b6b-8f10-3cb4d4bd808f None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971ee9ee-6f59-4331-bbf6-83a46652fe1a tempest-AccessesMetadataNegativeTest-850862987 tempest-AccessesMetadataNegativeTest-850862987-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2db2faa187d4ba4baf6b1b73c2fb965', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86b1b2ed568f43c9892e17d54b3c5f78', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971ee9ee-6f59-4331-bbf6-83a46652fe1a tempest-AccessesMetadataNegativeTest-850862987 tempest-AccessesMetadataNegativeTest-850862987-project-admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-f5eaf44f-2b20-4a64-ace1-49a14654f30c tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] GET http://10.27.203.238/share/v2/1ae8e27013bc48228edf3022159a9c1f/types/267f85de-c874-4ef9-9dba-05907bb40f17 May 28 12:57:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971ee9ee-6f59-4331-bbf6-83a46652fe1a tempest-AccessesMetadataNegativeTest-850862987 tempest-AccessesMetadataNegativeTest-850862987-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971ee9ee-6f59-4331-bbf6-83a46652fe1a tempest-AccessesMetadataNegativeTest-850862987 tempest-AccessesMetadataNegativeTest-850862987-project-admin] PATH_INFO: `/v3/domains` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-f5eaf44f-2b20-4a64-ace1-49a14654f30c tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-f5eaf44f-2b20-4a64-ace1-49a14654f30c tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] Calling method 'ShareTypesController.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971ee9ee-6f59-4331-bbf6-83a46652fe1a tempest-AccessesMetadataNegativeTest-850862987 tempest-AccessesMetadataNegativeTest-850862987-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=51267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:57:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971ee9ee-6f59-4331-bbf6-83a46652fe1a tempest-AccessesMetadataNegativeTest-850862987 tempest-AccessesMetadataNegativeTest-850862987-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971ee9ee-6f59-4331-bbf6-83a46652fe1a tempest-AccessesMetadataNegativeTest-850862987 tempest-AccessesMetadataNegativeTest-850862987-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.quota [None req-5e3899b9-b6e9-4441-8750-3d8495665a52 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Created reservations ['b64314c4-8afe-41a4-88f5-f1adc21963b1', 'd0d007d4-f479-47aa-b8a5-c2b201354207', 'cddd6967-70c8-482c-83f1-adfea0c28313', '724622c1-ba83-45ad-ac0b-c0587b350da1'] {{(pid=98330) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-f5eaf44f-2b20-4a64-ace1-49a14654f30c tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] HTTP exception thrown: Share type not found. May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-f5eaf44f-2b20-4a64-ace1-49a14654f30c tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] http://10.27.203.238/share/v2/1ae8e27013bc48228edf3022159a9c1f/types/267f85de-c874-4ef9-9dba-05907bb40f17 returned with HTTP 404 May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 303/579] 10.27.203.238 () {64 vars in 1448 bytes} [Tue May 28 12:57:15 2024] GET /share/v2/1ae8e27013bc48228edf3022159a9c1f/types/267f85de-c874-4ef9-9dba-05907bb40f17 => generated 67 bytes in 12 msecs (HTTP/1.1 404) 6 headers in 237 bytes (2 switches on core 0) May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-78795dea-05b7-4080-b236-9c22fcbec19e tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] DELETE http://10.27.203.238/share/v2/1ae8e27013bc48228edf3022159a9c1f/types/530d6c70-a60f-45b4-8810-f997583cc60f May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-78795dea-05b7-4080-b236-9c22fcbec19e tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-78795dea-05b7-4080-b236-9c22fcbec19e tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] Calling method 'ShareTypesController._delete' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:15 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 934/1843] 10.27.203.238 () {62 vars in 1241 bytes} [Tue May 28 12:57:15 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:57:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9a3cd1-4d76-4e59-be76-e733c84ec7f4 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9a3cd1-4d76-4e59-be76-e733c84ec7f4 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77239274-f22a-4a59-af1f-9618345af10d tempest-AccessesMetadataNegativeTest-850862987 tempest-AccessesMetadataNegativeTest-850862987-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2db2faa187d4ba4baf6b1b73c2fb965', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86b1b2ed568f43c9892e17d54b3c5f78', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77239274-f22a-4a59-af1f-9618345af10d tempest-AccessesMetadataNegativeTest-850862987 tempest-AccessesMetadataNegativeTest-850862987-project-admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77239274-f22a-4a59-af1f-9618345af10d tempest-AccessesMetadataNegativeTest-850862987 tempest-AccessesMetadataNegativeTest-850862987-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77239274-f22a-4a59-af1f-9618345af10d tempest-AccessesMetadataNegativeTest-850862987 tempest-AccessesMetadataNegativeTest-850862987-project-admin] PATH_INFO: `/v3/users` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77239274-f22a-4a59-af1f-9618345af10d tempest-AccessesMetadataNegativeTest-850862987 tempest-AccessesMetadataNegativeTest-850862987-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77239274-f22a-4a59-af1f-9618345af10d tempest-AccessesMetadataNegativeTest-850862987 tempest-AccessesMetadataNegativeTest-850862987-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:15 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-77239274-f22a-4a59-af1f-9618345af10d tempest-AccessesMetadataNegativeTest-850862987 tempest-AccessesMetadataNegativeTest-850862987-project-admin] Truncating password to algorithm specific maximum length 72 characters. May 28 12:57:15 l75lg1-v1 dstat.sh[49771]: 28-05 12:57:15| 18 3 69 9 0|5679M 1819M 277M 7850M| 15k 18k| 0 11M| 0 992 | 12k 22k|1.63 1.03 1.00|2.0 1.0 0| 0 0 | 0 2048M| 29 354 0 78 0 May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-78795dea-05b7-4080-b236-9c22fcbec19e tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] http://10.27.203.238/share/v2/1ae8e27013bc48228edf3022159a9c1f/types/530d6c70-a60f-45b4-8810-f997583cc60f returned with HTTP 202 May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 304/580] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:57:15 2024] DELETE /share/v2/1ae8e27013bc48228edf3022159a9c1f/types/530d6c70-a60f-45b4-8810-f997583cc60f => generated 0 bytes in 47 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:57:15 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 910/1844] 10.27.203.238 () {64 vars in 1232 bytes} [Tue May 28 12:57:15 2024] POST /identity/v3/users => generated 435 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-ad1930ab-96b5-431e-859c-c994f5b09e36 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] GET http://10.27.203.238/share/v2/1ae8e27013bc48228edf3022159a9c1f/types/530d6c70-a60f-45b4-8810-f997583cc60f May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-ad1930ab-96b5-431e-859c-c994f5b09e36 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-ad1930ab-96b5-431e-859c-c994f5b09e36 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] Calling method 'ShareTypesController.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971ee9ee-6f59-4331-bbf6-83a46652fe1a tempest-AccessesMetadataNegativeTest-850862987 tempest-AccessesMetadataNegativeTest-850862987-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-ad1930ab-96b5-431e-859c-c994f5b09e36 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] HTTP exception thrown: Share type not found. May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-ad1930ab-96b5-431e-859c-c994f5b09e36 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] http://10.27.203.238/share/v2/1ae8e27013bc48228edf3022159a9c1f/types/530d6c70-a60f-45b4-8810-f997583cc60f returned with HTTP 404 May 28 12:57:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971ee9ee-6f59-4331-bbf6-83a46652fe1a tempest-AccessesMetadataNegativeTest-850862987 tempest-AccessesMetadataNegativeTest-850862987-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 305/581] 10.27.203.238 () {64 vars in 1448 bytes} [Tue May 28 12:57:15 2024] GET /share/v2/1ae8e27013bc48228edf3022159a9c1f/types/530d6c70-a60f-45b4-8810-f997583cc60f => generated 67 bytes in 10 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 12:57:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdd6ca8-5900-458e-92f8-168c9e682953 tempest-AccessesMetadataNegativeTest-850862987 tempest-AccessesMetadataNegativeTest-850862987-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2db2faa187d4ba4baf6b1b73c2fb965', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86b1b2ed568f43c9892e17d54b3c5f78', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdd6ca8-5900-458e-92f8-168c9e682953 tempest-AccessesMetadataNegativeTest-850862987 tempest-AccessesMetadataNegativeTest-850862987-project-admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdd6ca8-5900-458e-92f8-168c9e682953 tempest-AccessesMetadataNegativeTest-850862987 tempest-AccessesMetadataNegativeTest-850862987-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdd6ca8-5900-458e-92f8-168c9e682953 tempest-AccessesMetadataNegativeTest-850862987 tempest-AccessesMetadataNegativeTest-850862987-project-admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdd6ca8-5900-458e-92f8-168c9e682953 tempest-AccessesMetadataNegativeTest-850862987 tempest-AccessesMetadataNegativeTest-850862987-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-cd9595e5-bbd5-4a98-af01-5c493a5d1d4e tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] DELETE http://10.27.203.238/share/v2/1ae8e27013bc48228edf3022159a9c1f/types/6ada2880-51f5-4019-8d2c-7ffa58a8b629 May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-cd9595e5-bbd5-4a98-af01-5c493a5d1d4e tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdd6ca8-5900-458e-92f8-168c9e682953 tempest-AccessesMetadataNegativeTest-850862987 tempest-AccessesMetadataNegativeTest-850862987-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-cd9595e5-bbd5-4a98-af01-5c493a5d1d4e tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] Calling method 'ShareTypesController._delete' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:15 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 935/1845] 10.27.203.238 () {62 vars in 1210 bytes} [Tue May 28 12:57:15 2024] GET /identity/v3/roles => generated 1680 bytes in 19 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:57:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77239274-f22a-4a59-af1f-9618345af10d tempest-AccessesMetadataNegativeTest-850862987 tempest-AccessesMetadataNegativeTest-850862987-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77239274-f22a-4a59-af1f-9618345af10d tempest-AccessesMetadataNegativeTest-850862987 tempest-AccessesMetadataNegativeTest-850862987-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.quota [None req-5e3899b9-b6e9-4441-8750-3d8495665a52 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Committed reservations ['b64314c4-8afe-41a4-88f5-f1adc21963b1', 'd0d007d4-f479-47aa-b8a5-c2b201354207', 'cddd6967-70c8-482c-83f1-adfea0c28313', '724622c1-ba83-45ad-ac0b-c0587b350da1'] {{(pid=98330) commit /opt/stack/manila/manila/quota.py:1063}} May 28 12:57:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e5a7c7-d77f-47af-ae8c-bb954527adb0 tempest-AccessesMetadataNegativeTest-850862987 tempest-AccessesMetadataNegativeTest-850862987-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2db2faa187d4ba4baf6b1b73c2fb965', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86b1b2ed568f43c9892e17d54b3c5f78', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e5a7c7-d77f-47af-ae8c-bb954527adb0 tempest-AccessesMetadataNegativeTest-850862987 tempest-AccessesMetadataNegativeTest-850862987-project-admin] REQUEST_METHOD: `PUT` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e5a7c7-d77f-47af-ae8c-bb954527adb0 tempest-AccessesMetadataNegativeTest-850862987 tempest-AccessesMetadataNegativeTest-850862987-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e5a7c7-d77f-47af-ae8c-bb954527adb0 tempest-AccessesMetadataNegativeTest-850862987 tempest-AccessesMetadataNegativeTest-850862987-project-admin] PATH_INFO: `/v3/projects/86b1b2ed568f43c9892e17d54b3c5f78/users/b12d90b85fc7452f83fec53a2941a759/roles/44620cad10ae407c90c91e2c296adb04` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e5a7c7-d77f-47af-ae8c-bb954527adb0 tempest-AccessesMetadataNegativeTest-850862987 tempest-AccessesMetadataNegativeTest-850862987-project-admin] RBAC: Authorizing `identity:create_grant(project_id=86b1b2ed568f43c9892e17d54b3c5f78, user_id=b12d90b85fc7452f83fec53a2941a759, role_id=44620cad10ae407c90c91e2c296adb04)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e5a7c7-d77f-47af-ae8c-bb954527adb0 tempest-AccessesMetadataNegativeTest-850862987 tempest-AccessesMetadataNegativeTest-850862987-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-cd9595e5-bbd5-4a98-af01-5c493a5d1d4e tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] http://10.27.203.238/share/v2/1ae8e27013bc48228edf3022159a9c1f/types/6ada2880-51f5-4019-8d2c-7ffa58a8b629 returned with HTTP 202 May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 306/582] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:57:15 2024] DELETE /share/v2/1ae8e27013bc48228edf3022159a9c1f/types/6ada2880-51f5-4019-8d2c-7ffa58a8b629 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 6 headers in 243 bytes (2 switches on core 0) May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-cd32ff8f-8cab-4ef3-981b-8309f615537f tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] GET http://10.27.203.238/share/v2/1ae8e27013bc48228edf3022159a9c1f/types/6ada2880-51f5-4019-8d2c-7ffa58a8b629 May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-cd32ff8f-8cab-4ef3-981b-8309f615537f tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-cd32ff8f-8cab-4ef3-981b-8309f615537f tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] Calling method 'ShareTypesController.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:15 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 911/1846] 10.27.203.238 () {64 vars in 1571 bytes} [Tue May 28 12:57:15 2024] PUT /identity/v3/projects/86b1b2ed568f43c9892e17d54b3c5f78/users/b12d90b85fc7452f83fec53a2941a759/roles/44620cad10ae407c90c91e2c296adb04 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-cd32ff8f-8cab-4ef3-981b-8309f615537f tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] HTTP exception thrown: Share type not found. May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-cd32ff8f-8cab-4ef3-981b-8309f615537f tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] http://10.27.203.238/share/v2/1ae8e27013bc48228edf3022159a9c1f/types/6ada2880-51f5-4019-8d2c-7ffa58a8b629 returned with HTTP 404 May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 307/583] 10.27.203.238 () {64 vars in 1448 bytes} [Tue May 28 12:57:15 2024] GET /share/v2/1ae8e27013bc48228edf3022159a9c1f/types/6ada2880-51f5-4019-8d2c-7ffa58a8b629 => generated 67 bytes in 10 msecs (HTTP/1.1 404) 6 headers in 237 bytes (2 switches on core 0) May 28 12:57:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdd6ca8-5900-458e-92f8-168c9e682953 tempest-AccessesMetadataNegativeTest-850862987 tempest-AccessesMetadataNegativeTest-850862987-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-4fdd6ca8-5900-458e-92f8-168c9e682953 tempest-AccessesMetadataNegativeTest-850862987 tempest-AccessesMetadataNegativeTest-850862987-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:15 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.host_manager [None req-5e3899b9-b6e9-4441-8750-3d8495665a52 tempest-AdminActionsTest-1749172189 None] Share service is down. (host: l75lg1-v1@generic2). May 28 12:57:15 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.host_manager [None req-5e3899b9-b6e9-4441-8750-3d8495665a52 tempest-AdminActionsTest-1749172189 None] Share service is down. (host: l75lg1-v1@generic1). May 28 12:57:15 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-5e3899b9-b6e9-4441-8750-3d8495665a52 tempest-AdminActionsTest-1749172189 None] Starting with 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:80}} May 28 12:57:15 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-5e3899b9-b6e9-4441-8750-3d8495665a52 tempest-AdminActionsTest-1749172189 None] Filter OnlyHostFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:57:15 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-5e3899b9-b6e9-4441-8750-3d8495665a52 tempest-AdminActionsTest-1749172189 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:57:15 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.capacity [None req-5e3899b9-b6e9-4441-8750-3d8495665a52 tempest-AdminActionsTest-1749172189 None] Space information for share creation on host l75lg1-v1@vast#vast (requested / avail): 1/2069 {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/capacity.py:83}} May 28 12:57:15 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-5e3899b9-b6e9-4441-8750-3d8495665a52 tempest-AdminActionsTest-1749172189 None] Filter CapacityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:57:15 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-5e3899b9-b6e9-4441-8750-3d8495665a52 tempest-AdminActionsTest-1749172189 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:57:15 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-5e3899b9-b6e9-4441-8750-3d8495665a52 tempest-AdminActionsTest-1749172189 None] Driver Filter: Checking host 'l75lg1-v1@vast#vast' {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:37}} May 28 12:57:15 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-5e3899b9-b6e9-4441-8750-3d8495665a52 tempest-AdminActionsTest-1749172189 None] Filter function not set :: passing host. {{(pid=98327) _check_filter_function /opt/stack/manila/manila/scheduler/filters/driver.py:53}} May 28 12:57:15 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-5e3899b9-b6e9-4441-8750-3d8495665a52 tempest-AdminActionsTest-1749172189 None] Result: True {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:40}} May 28 12:57:15 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-5e3899b9-b6e9-4441-8750-3d8495665a52 tempest-AdminActionsTest-1749172189 None] Done checking host 'l75lg1-v1@vast#vast' {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:41}} May 28 12:57:15 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-5e3899b9-b6e9-4441-8750-3d8495665a52 tempest-AdminActionsTest-1749172189 None] Filter DriverFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:57:15 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-5e3899b9-b6e9-4441-8750-3d8495665a52 tempest-AdminActionsTest-1749172189 None] Filter ShareReplicationFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:57:15 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-5e3899b9-b6e9-4441-8750-3d8495665a52 tempest-AdminActionsTest-1749172189 None] Filter CreateFromSnapshotFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-5e3899b9-b6e9-4441-8750-3d8495665a52 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/shares returned with HTTP 200 May 28 12:57:15 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-5e3899b9-b6e9-4441-8750-3d8495665a52 tempest-AdminActionsTest-1749172189 None] Filter AffinityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:57:15 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-5e3899b9-b6e9-4441-8750-3d8495665a52 tempest-AdminActionsTest-1749172189 None] Filter AntiAffinityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 277/584] 10.27.203.238 () {66 vars in 1362 bytes} [Tue May 28 12:57:15 2024] POST /share/v2/a3499cb78849424db45e54caac01de92/shares => generated 1348 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 232 bytes (2 switches on core 0) May 28 12:57:15 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b5d0ddc5-db46-4239-8d97-cf384f7cf2d8 tempest-SharesActionsAdminTest-1286316336 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:57:15 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b5d0ddc5-db46-4239-8d97-cf384f7cf2d8 tempest-SharesActionsAdminTest-1286316336 None] [] May 28 12:57:15 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b5d0ddc5-db46-4239-8d97-cf384f7cf2d8 tempest-SharesActionsAdminTest-1286316336 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 12:57:15 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b5d0ddc5-db46-4239-8d97-cf384f7cf2d8 tempest-SharesActionsAdminTest-1286316336 None] >>> [POST] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:57:15 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.drivers.filter [None req-5e3899b9-b6e9-4441-8750-3d8495665a52 tempest-AdminActionsTest-1749172189 None] Filtered share [host: 'l75lg1-v1@vast#vast', free_capacity_gb: 2069.6229242384434, pools: None] {{(pid=98327) _schedule_share /opt/stack/manila/manila/scheduler/drivers/filter.py:268}} May 28 12:57:15 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-5e3899b9-b6e9-4441-8750-3d8495665a52 tempest-AdminActionsTest-1749172189 None] Checking host 'l75lg1-v1@vast#vast' {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:46}} May 28 12:57:15 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b5d0ddc5-db46-4239-8d97-cf384f7cf2d8 tempest-SharesActionsAdminTest-1286316336 None] {'data': '{"name": "7c19614c-d968-4489-b2ad-bd88c2ef8054"}', May 28 12:57:15 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.weighers.goodness [None req-5e3899b9-b6e9-4441-8750-3d8495665a52 tempest-AdminActionsTest-1749172189 None] Goodness function not set :: defaulting to minimal goodness rating of 0. May 28 12:57:15 l75lg1-v1 manila-scheduler[98327]: INFO manila.scheduler.weighers.goodness [None req-5e3899b9-b6e9-4441-8750-3d8495665a52 tempest-AdminActionsTest-1749172189 None] Goodness function result for host l75lg1-v1@vast#vast: 0. May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-bfcd1e19-3451-451b-b895-6c5d2600ad88 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] DELETE http://10.27.203.238/share/v2/1ae8e27013bc48228edf3022159a9c1f/types/87e08e04-de75-4648-8f60-bebf5c8b7fce May 28 12:57:15 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-5e3899b9-b6e9-4441-8750-3d8495665a52 tempest-AdminActionsTest-1749172189 None] Goodness: 0 {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:48}} May 28 12:57:15 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b5d0ddc5-db46-4239-8d97-cf384f7cf2d8 tempest-SharesActionsAdminTest-1286316336 None] 'json': None, May 28 12:57:15 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-5e3899b9-b6e9-4441-8750-3d8495665a52 tempest-AdminActionsTest-1749172189 None] Done checking host 'l75lg1-v1@vast#vast' {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:49}} May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-bfcd1e19-3451-451b-b895-6c5d2600ad88 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-bfcd1e19-3451-451b-b895-6c5d2600ad88 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] Calling method 'ShareTypesController._delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:15 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.drivers.filter [None req-5e3899b9-b6e9-4441-8750-3d8495665a52 tempest-AdminActionsTest-1749172189 None] Choosing for share: WeighedHost [host: l75lg1-v1@vast#vast, weight: 0.0] {{(pid=98327) _schedule_share /opt/stack/manila/manila/scheduler/drivers/filter.py:274}} May 28 12:57:15 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b5d0ddc5-db46-4239-8d97-cf384f7cf2d8 tempest-SharesActionsAdminTest-1286316336 None] 'params': None} May 28 12:57:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdd6ca8-5900-458e-92f8-168c9e682953 tempest-AccessesMetadataNegativeTest-850862987 tempest-AccessesMetadataNegativeTest-850862987-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-bfcd1e19-3451-451b-b895-6c5d2600ad88 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] http://10.27.203.238/share/v2/1ae8e27013bc48228edf3022159a9c1f/types/87e08e04-de75-4648-8f60-bebf5c8b7fce returned with HTTP 202 May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 278/585] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:57:15 2024] DELETE /share/v2/1ae8e27013bc48228edf3022159a9c1f/types/87e08e04-de75-4648-8f60-bebf5c8b7fce => generated 0 bytes in 35 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-aa428485-8c30-4cf1-b781-24bc20514375 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] GET http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/shares/c5d9b059-bdd0-4fae-9bd0-328d926e5694 May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-aa428485-8c30-4cf1-b781-24bc20514375 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-aa428485-8c30-4cf1-b781-24bc20514375 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b454cec2-5a16-4d13-8969-93a6920886ac service manila] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f110cf6300f049c897d0aab63218d1e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b454cec2-5a16-4d13-8969-93a6920886ac service manila] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b454cec2-5a16-4d13-8969-93a6920886ac service manila] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b454cec2-5a16-4d13-8969-93a6920886ac service manila] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-aa428485-8c30-4cf1-b781-24bc20514375 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/shares/c5d9b059-bdd0-4fae-9bd0-328d926e5694 returned with HTTP 200 May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 279/586] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:57:15 2024] GET /share/v2/a3499cb78849424db45e54caac01de92/shares/c5d9b059-bdd0-4fae-9bd0-328d926e5694 => generated 1367 bytes in 23 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-acb19770-7cd6-4878-99f7-05bc0dfe4671 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] GET http://10.27.203.238/share/v2/1ae8e27013bc48228edf3022159a9c1f/types/87e08e04-de75-4648-8f60-bebf5c8b7fce May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-acb19770-7cd6-4878-99f7-05bc0dfe4671 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-acb19770-7cd6-4878-99f7-05bc0dfe4671 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] Calling method 'ShareTypesController.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-acb19770-7cd6-4878-99f7-05bc0dfe4671 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] HTTP exception thrown: Share type not found. May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-acb19770-7cd6-4878-99f7-05bc0dfe4671 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] http://10.27.203.238/share/v2/1ae8e27013bc48228edf3022159a9c1f/types/87e08e04-de75-4648-8f60-bebf5c8b7fce returned with HTTP 404 May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 280/587] 10.27.203.238 () {64 vars in 1448 bytes} [Tue May 28 12:57:15 2024] GET /share/v2/1ae8e27013bc48228edf3022159a9c1f/types/87e08e04-de75-4648-8f60-bebf5c8b7fce => generated 67 bytes in 9 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-54b2da7a-188c-456e-9152-d5428843ba0c tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] DELETE http://10.27.203.238/share/v2/1ae8e27013bc48228edf3022159a9c1f/types/5d77f885-b328-4d22-9007-e21eace5ccc9 May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-54b2da7a-188c-456e-9152-d5428843ba0c tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-54b2da7a-188c-456e-9152-d5428843ba0c tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] Calling method 'ShareTypesController._delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b454cec2-5a16-4d13-8969-93a6920886ac service manila] RBAC: Authorizing `identity:validate_token()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b454cec2-5a16-4d13-8969-93a6920886ac service manila] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:15 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 936/1847] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 12:57:15 2024] GET /identity/v3/auth/tokens => generated 4087 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-54b2da7a-188c-456e-9152-d5428843ba0c tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] http://10.27.203.238/share/v2/1ae8e27013bc48228edf3022159a9c1f/types/5d77f885-b328-4d22-9007-e21eace5ccc9 returned with HTTP 202 May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-bd209425-74fa-48f6-aa29-7a60cb7acdfd tempest-AccessesMetadataNegativeTest-850862987 tempest-AccessesMetadataNegativeTest-850862987-project-admin] POST http://10.27.203.238/share/v2/86b1b2ed568f43c9892e17d54b3c5f78/types May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 281/588] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:57:15 2024] DELETE /share/v2/1ae8e27013bc48228edf3022159a9c1f/types/5d77f885-b328-4d22-9007-e21eace5ccc9 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-bd209425-74fa-48f6-aa29-7a60cb7acdfd tempest-AccessesMetadataNegativeTest-850862987 tempest-AccessesMetadataNegativeTest-850862987-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share_type": {"name": "tempest-typeshare-type-337022916", "extra_specs": {"driver_handles_share_servers": "False"}, "share_type_access:is_public": true}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-5fbf12d3-b127-4a05-a0a9-6fd7cb2f2138 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] GET http://10.27.203.238/share/v2/1ae8e27013bc48228edf3022159a9c1f/types/5d77f885-b328-4d22-9007-e21eace5ccc9 May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-5fbf12d3-b127-4a05-a0a9-6fd7cb2f2138 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-5fbf12d3-b127-4a05-a0a9-6fd7cb2f2138 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] Calling method 'ShareTypesController.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-5fbf12d3-b127-4a05-a0a9-6fd7cb2f2138 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] HTTP exception thrown: Share type not found. May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-5fbf12d3-b127-4a05-a0a9-6fd7cb2f2138 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] http://10.27.203.238/share/v2/1ae8e27013bc48228edf3022159a9c1f/types/5d77f885-b328-4d22-9007-e21eace5ccc9 returned with HTTP 404 May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 282/589] 10.27.203.238 () {64 vars in 1448 bytes} [Tue May 28 12:57:15 2024] GET /share/v2/1ae8e27013bc48228edf3022159a9c1f/types/5d77f885-b328-4d22-9007-e21eace5ccc9 => generated 67 bytes in 9 msecs (HTTP/1.1 404) 6 headers in 237 bytes (2 switches on core 0) May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-66f82bfc-8b63-44e5-854f-31a6f2f4998b tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] DELETE http://10.27.203.238/share/v2/1ae8e27013bc48228edf3022159a9c1f/types/f4d611bb-aa60-46f8-8a5f-91fc4457d2ec May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-66f82bfc-8b63-44e5-854f-31a6f2f4998b tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-66f82bfc-8b63-44e5-854f-31a6f2f4998b tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] Calling method 'ShareTypesController._delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-bd209425-74fa-48f6-aa29-7a60cb7acdfd tempest-AccessesMetadataNegativeTest-850862987 tempest-AccessesMetadataNegativeTest-850862987-project-admin] http://10.27.203.238/share/v2/86b1b2ed568f43c9892e17d54b3c5f78/types returned with HTTP 200 May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 308/590] 10.27.203.238 () {66 vars in 1359 bytes} [Tue May 28 12:57:15 2024] POST /share/v2/86b1b2ed568f43c9892e17d54b3c5f78/types => generated 621 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:57:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e5a7c7-d77f-47af-ae8c-bb954527adb0 tempest-AccessesMetadataNegativeTest-850862987 tempest-AccessesMetadataNegativeTest-850862987-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e5a7c7-d77f-47af-ae8c-bb954527adb0 tempest-AccessesMetadataNegativeTest-850862987 tempest-AccessesMetadataNegativeTest-850862987-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8103b76-c544-4ba9-906d-09bb5b2807da service manila] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f110cf6300f049c897d0aab63218d1e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8103b76-c544-4ba9-906d-09bb5b2807da service manila] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8103b76-c544-4ba9-906d-09bb5b2807da service manila] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8103b76-c544-4ba9-906d-09bb5b2807da service manila] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-b8103b76-c544-4ba9-906d-09bb5b2807da service manila] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-66f82bfc-8b63-44e5-854f-31a6f2f4998b tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] http://10.27.203.238/share/v2/1ae8e27013bc48228edf3022159a9c1f/types/f4d611bb-aa60-46f8-8a5f-91fc4457d2ec returned with HTTP 202 May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 283/591] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:57:15 2024] DELETE /share/v2/1ae8e27013bc48228edf3022159a9c1f/types/f4d611bb-aa60-46f8-8a5f-91fc4457d2ec => generated 0 bytes in 48 msecs (HTTP/1.1 202) 6 headers in 243 bytes (2 switches on core 0) May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-84d3e4ab-6d36-405f-a712-56cb58c95d75 tempest-ShareSnapshotInstancesTest-843694899 tempest-ShareSnapshotInstancesTest-843694899-project-admin] GET http://10.27.203.238/share/v2/f4f7702aa04c467288cc6b142f61ec37/shares/b235c40f-7437-4e0c-b44e-321d8e8b1457 May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-84d3e4ab-6d36-405f-a712-56cb58c95d75 tempest-ShareSnapshotInstancesTest-843694899 tempest-ShareSnapshotInstancesTest-843694899-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-84d3e4ab-6d36-405f-a712-56cb58c95d75 tempest-ShareSnapshotInstancesTest-843694899 tempest-ShareSnapshotInstancesTest-843694899-project-admin] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:15 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-5e3899b9-b6e9-4441-8750-3d8495665a52 tempest-AdminActionsTest-1749172189 None] >>> [GET] https://127.0.0.1:40443/api/vippools/ May 28 12:57:15 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-5e3899b9-b6e9-4441-8750-3d8495665a52 tempest-AdminActionsTest-1749172189 None] {'allow_redirects': True, 'params': {'name': 'vippool-1'}} May 28 12:57:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8103b76-c544-4ba9-906d-09bb5b2807da service manila] RBAC: Authorizing `identity:validate_token()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8103b76-c544-4ba9-906d-09bb5b2807da service manila] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:15 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 912/1848] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 12:57:15 2024] GET /identity/v3/auth/tokens => generated 3966 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-d4e94067-7ef0-44e3-b09c-a394b3b4dcd1 tempest-AccessesMetadataNegativeTest-1660907003 tempest-AccessesMetadataNegativeTest-1660907003-project-member] POST http://10.27.203.238/share/v2/ed83204ad63946bdae288892bd07d115/shares May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-84d3e4ab-6d36-405f-a712-56cb58c95d75 tempest-ShareSnapshotInstancesTest-843694899 tempest-ShareSnapshotInstancesTest-843694899-project-admin] http://10.27.203.238/share/v2/f4f7702aa04c467288cc6b142f61ec37/shares/b235c40f-7437-4e0c-b44e-321d8e8b1457 returned with HTTP 200 May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-d4e94067-7ef0-44e3-b09c-a394b3b4dcd1 tempest-AccessesMetadataNegativeTest-1660907003 tempest-AccessesMetadataNegativeTest-1660907003-project-member] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share": {"share_proto": "nfs", "description": "Tempest's share", "snapshot_id": null, "name": "tempest-tempest-created-share-1274449909", "size": 1, "metadata": {}, "is_public": false, "share_type": "35d8f83e-fb79-4641-b1b4-7e1e2b54c7bd"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 284/592] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:57:15 2024] GET /share/v2/f4f7702aa04c467288cc6b142f61ec37/shares/b235c40f-7437-4e0c-b44e-321d8e8b1457 => generated 1370 bytes in 23 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.v1.shares [None req-d4e94067-7ef0-44e3-b09c-a394b3b4dcd1 tempest-AccessesMetadataNegativeTest-1660907003 tempest-AccessesMetadataNegativeTest-1660907003-project-member] Create NFS share of 1 GB May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-140fb4d6-7a86-4347-9151-caa9fbaf090f tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] GET http://10.27.203.238/share/v2/1ae8e27013bc48228edf3022159a9c1f/types/f4d611bb-aa60-46f8-8a5f-91fc4457d2ec May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-140fb4d6-7a86-4347-9151-caa9fbaf090f tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-140fb4d6-7a86-4347-9151-caa9fbaf090f tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] Calling method 'ShareTypesController.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-140fb4d6-7a86-4347-9151-caa9fbaf090f tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] HTTP exception thrown: Share type not found. May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-140fb4d6-7a86-4347-9151-caa9fbaf090f tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] http://10.27.203.238/share/v2/1ae8e27013bc48228edf3022159a9c1f/types/f4d611bb-aa60-46f8-8a5f-91fc4457d2ec returned with HTTP 404 May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 285/593] 10.27.203.238 () {64 vars in 1448 bytes} [Tue May 28 12:57:15 2024] GET /share/v2/1ae8e27013bc48228edf3022159a9c1f/types/f4d611bb-aa60-46f8-8a5f-91fc4457d2ec => generated 67 bytes in 10 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-4313b2c4-2a35-4b20-8216-dea5a67828f7 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] DELETE http://10.27.203.238/share/v2/1ae8e27013bc48228edf3022159a9c1f/types/8ac7167e-4ee5-4626-84c9-f4018be08764 May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-4313b2c4-2a35-4b20-8216-dea5a67828f7 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-4313b2c4-2a35-4b20-8216-dea5a67828f7 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] Calling method 'ShareTypesController._delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-4313b2c4-2a35-4b20-8216-dea5a67828f7 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] http://10.27.203.238/share/v2/1ae8e27013bc48228edf3022159a9c1f/types/8ac7167e-4ee5-4626-84c9-f4018be08764 returned with HTTP 202 May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 286/594] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:57:15 2024] DELETE /share/v2/1ae8e27013bc48228edf3022159a9c1f/types/8ac7167e-4ee5-4626-84c9-f4018be08764 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 6 headers in 243 bytes (2 switches on core 0) May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-e96804bc-7420-45a3-b040-0ee07ff8f6fa tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] GET http://10.27.203.238/share/v2/1ae8e27013bc48228edf3022159a9c1f/types/8ac7167e-4ee5-4626-84c9-f4018be08764 May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-e96804bc-7420-45a3-b040-0ee07ff8f6fa tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-e96804bc-7420-45a3-b040-0ee07ff8f6fa tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] Calling method 'ShareTypesController.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-e96804bc-7420-45a3-b040-0ee07ff8f6fa tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] HTTP exception thrown: Share type not found. May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-e96804bc-7420-45a3-b040-0ee07ff8f6fa tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] http://10.27.203.238/share/v2/1ae8e27013bc48228edf3022159a9c1f/types/8ac7167e-4ee5-4626-84c9-f4018be08764 returned with HTTP 404 May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 287/595] 10.27.203.238 () {64 vars in 1448 bytes} [Tue May 28 12:57:15 2024] GET /share/v2/1ae8e27013bc48228edf3022159a9c1f/types/8ac7167e-4ee5-4626-84c9-f4018be08764 => generated 67 bytes in 10 msecs (HTTP/1.1 404) 6 headers in 237 bytes (2 switches on core 0) May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.quota [None req-d4e94067-7ef0-44e3-b09c-a394b3b4dcd1 tempest-AccessesMetadataNegativeTest-1660907003 tempest-AccessesMetadataNegativeTest-1660907003-project-member] Created reservations ['aac0156e-f107-429b-a757-0b03d9522df8', 'db911197-652e-4403-ab3d-ea8c83de1183', 'df83497f-560e-4884-82fc-af46c7d63e97', '1c4bc325-bf97-4331-8878-f3d9a3483f4e'] {{(pid=98329) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-8fa86359-800d-4912-b7e0-70aa97017594 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] DELETE http://10.27.203.238/share/v2/1ae8e27013bc48228edf3022159a9c1f/types/b8a59a8f-0fff-470a-ae19-f374dbf8ab3b May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-8fa86359-800d-4912-b7e0-70aa97017594 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-8fa86359-800d-4912-b7e0-70aa97017594 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] Calling method 'ShareTypesController._delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-8fa86359-800d-4912-b7e0-70aa97017594 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] http://10.27.203.238/share/v2/1ae8e27013bc48228edf3022159a9c1f/types/b8a59a8f-0fff-470a-ae19-f374dbf8ab3b returned with HTTP 202 May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 288/596] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:57:15 2024] DELETE /share/v2/1ae8e27013bc48228edf3022159a9c1f/types/b8a59a8f-0fff-470a-ae19-f374dbf8ab3b => generated 0 bytes in 36 msecs (HTTP/1.1 202) 6 headers in 243 bytes (2 switches on core 0) May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-3976ebed-6464-4b91-b71f-306d11d94418 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] GET http://10.27.203.238/share/v2/1ae8e27013bc48228edf3022159a9c1f/types/b8a59a8f-0fff-470a-ae19-f374dbf8ab3b May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-3976ebed-6464-4b91-b71f-306d11d94418 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-3976ebed-6464-4b91-b71f-306d11d94418 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] Calling method 'ShareTypesController.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-3976ebed-6464-4b91-b71f-306d11d94418 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] HTTP exception thrown: Share type not found. May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-3976ebed-6464-4b91-b71f-306d11d94418 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] http://10.27.203.238/share/v2/1ae8e27013bc48228edf3022159a9c1f/types/b8a59a8f-0fff-470a-ae19-f374dbf8ab3b returned with HTTP 404 May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 289/597] 10.27.203.238 () {64 vars in 1448 bytes} [Tue May 28 12:57:15 2024] GET /share/v2/1ae8e27013bc48228edf3022159a9c1f/types/b8a59a8f-0fff-470a-ae19-f374dbf8ab3b => generated 67 bytes in 9 msecs (HTTP/1.1 404) 6 headers in 237 bytes (2 switches on core 0) May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-36301c43-5678-4f68-9027-5afb1b757cb8 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] DELETE http://10.27.203.238/share/v2/1ae8e27013bc48228edf3022159a9c1f/types/cc30bac1-e8e3-4e53-b660-f80ce32ddfe0 May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-36301c43-5678-4f68-9027-5afb1b757cb8 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-36301c43-5678-4f68-9027-5afb1b757cb8 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] Calling method 'ShareTypesController._delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.quota [None req-d4e94067-7ef0-44e3-b09c-a394b3b4dcd1 tempest-AccessesMetadataNegativeTest-1660907003 tempest-AccessesMetadataNegativeTest-1660907003-project-member] Committed reservations ['aac0156e-f107-429b-a757-0b03d9522df8', 'db911197-652e-4403-ab3d-ea8c83de1183', 'df83497f-560e-4884-82fc-af46c7d63e97', '1c4bc325-bf97-4331-8878-f3d9a3483f4e'] {{(pid=98329) commit /opt/stack/manila/manila/quota.py:1063}} May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-36301c43-5678-4f68-9027-5afb1b757cb8 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] http://10.27.203.238/share/v2/1ae8e27013bc48228edf3022159a9c1f/types/cc30bac1-e8e3-4e53-b660-f80ce32ddfe0 returned with HTTP 202 May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 290/598] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:57:15 2024] DELETE /share/v2/1ae8e27013bc48228edf3022159a9c1f/types/cc30bac1-e8e3-4e53-b660-f80ce32ddfe0 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-c32e0c1a-cd6e-4d18-aaed-e73554d48898 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] GET http://10.27.203.238/share/v2/1ae8e27013bc48228edf3022159a9c1f/types/cc30bac1-e8e3-4e53-b660-f80ce32ddfe0 May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-c32e0c1a-cd6e-4d18-aaed-e73554d48898 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-c32e0c1a-cd6e-4d18-aaed-e73554d48898 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] Calling method 'ShareTypesController.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-c32e0c1a-cd6e-4d18-aaed-e73554d48898 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] HTTP exception thrown: Share type not found. May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-c32e0c1a-cd6e-4d18-aaed-e73554d48898 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] http://10.27.203.238/share/v2/1ae8e27013bc48228edf3022159a9c1f/types/cc30bac1-e8e3-4e53-b660-f80ce32ddfe0 returned with HTTP 404 May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 291/599] 10.27.203.238 () {64 vars in 1448 bytes} [Tue May 28 12:57:15 2024] GET /share/v2/1ae8e27013bc48228edf3022159a9c1f/types/cc30bac1-e8e3-4e53-b660-f80ce32ddfe0 => generated 67 bytes in 9 msecs (HTTP/1.1 404) 6 headers in 237 bytes (2 switches on core 0) May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-36ac9489-2f69-4481-8790-387333ca7e6b tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] DELETE http://10.27.203.238/share/v2/1ae8e27013bc48228edf3022159a9c1f/types/dae41377-0474-4f8a-beda-3839c98cb123 May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-36ac9489-2f69-4481-8790-387333ca7e6b tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-36ac9489-2f69-4481-8790-387333ca7e6b tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] Calling method 'ShareTypesController._delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:15 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-01a2ae14-f15d-4183-924e-4ad9803a3801 tempest-ShareSnapshotInstancesTest-843694899 None] <<< [POST] https://127.0.0.1:40443/api/quotas/ May 28 12:57:15 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-01a2ae14-f15d-4183-924e-4ad9803a3801 tempest-ShareSnapshotInstancesTest-843694899 None] Bunch(cluster='loop75-kfs', cluster_id=1, default_email=None, default_group_quota=None, default_user_quota=None, enable_alarms=True, enable_email_providers=True, grace_period=None, group_quotas=[], guid='dea1acfc-2015-40a9-931d-b1809af3132c', hard_limit=1073741824, hard_limit_inodes=None, id=11, internal=False, is_user_quota=False, last_user_quotas_update=None, name='c2f741cd-bac5-499f-9539-8e93d6a81282', num_blocked_users=0, num_exceeded_users=0, path='/manila/manila-c2f741cd-bac5-499f-9539-8e93d6a81282', percent_capacity=0, percent_inodes=None, pretty_grace_period=None, pretty_grace_period_expiration=None, pretty_state='OK (CREATED)', soft_limit=None, soft_limit_inodes=None, state='OK', sync_state='CREATED', system_id=11, tenant_id=1, tenant_name='default', time_to_block=None, title='c2f741cd-bac5-499f-9539-8e93d6a81282', url='https://127.0.0.1:40443/api/quotas/11/', used_capacity=0, used_capacity_tb=0.0, used_effective_capacity=0, used_effective_capacity_tb=0.0, used_inodes=0, used_limited_capacity=0, user_quotas=[]) May 28 12:57:15 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-01a2ae14-f15d-4183-924e-4ad9803a3801 tempest-ShareSnapshotInstancesTest-843694899 None] --- [POST] https://127.0.0.1:40443/api/quotas/: Done May 28 12:57:15 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-01a2ae14-f15d-4183-924e-4ad9803a3801 tempest-ShareSnapshotInstancesTest-843694899 None] >>> [GET] https://127.0.0.1:40443/api/views/ May 28 12:57:15 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-01a2ae14-f15d-4183-924e-4ad9803a3801 tempest-ShareSnapshotInstancesTest-843694899 None] {'allow_redirects': True, May 28 12:57:15 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-01a2ae14-f15d-4183-924e-4ad9803a3801 tempest-ShareSnapshotInstancesTest-843694899 None] 'params': {'name': 'c2f741cd-bac5-499f-9539-8e93d6a81282'}} May 28 12:57:15 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.host_manager [None req-d4e94067-7ef0-44e3-b09c-a394b3b4dcd1 tempest-AccessesMetadataNegativeTest-1660907003 None] Share service is down. (host: l75lg1-v1@generic2). May 28 12:57:15 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.host_manager [None req-d4e94067-7ef0-44e3-b09c-a394b3b4dcd1 tempest-AccessesMetadataNegativeTest-1660907003 None] Share service is down. (host: l75lg1-v1@generic1). May 28 12:57:15 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-d4e94067-7ef0-44e3-b09c-a394b3b4dcd1 tempest-AccessesMetadataNegativeTest-1660907003 None] Starting with 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:80}} May 28 12:57:15 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-d4e94067-7ef0-44e3-b09c-a394b3b4dcd1 tempest-AccessesMetadataNegativeTest-1660907003 None] Filter OnlyHostFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:57:15 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-d4e94067-7ef0-44e3-b09c-a394b3b4dcd1 tempest-AccessesMetadataNegativeTest-1660907003 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:57:15 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.capacity [None req-d4e94067-7ef0-44e3-b09c-a394b3b4dcd1 tempest-AccessesMetadataNegativeTest-1660907003 None] Space information for share creation on host l75lg1-v1@vast#vast (requested / avail): 1/2068 {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/capacity.py:83}} May 28 12:57:15 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-d4e94067-7ef0-44e3-b09c-a394b3b4dcd1 tempest-AccessesMetadataNegativeTest-1660907003 None] Filter CapacityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:57:15 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-d4e94067-7ef0-44e3-b09c-a394b3b4dcd1 tempest-AccessesMetadataNegativeTest-1660907003 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:57:15 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-d4e94067-7ef0-44e3-b09c-a394b3b4dcd1 tempest-AccessesMetadataNegativeTest-1660907003 None] Driver Filter: Checking host 'l75lg1-v1@vast#vast' {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:37}} May 28 12:57:15 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-d4e94067-7ef0-44e3-b09c-a394b3b4dcd1 tempest-AccessesMetadataNegativeTest-1660907003 None] Filter function not set :: passing host. {{(pid=98327) _check_filter_function /opt/stack/manila/manila/scheduler/filters/driver.py:53}} May 28 12:57:15 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-d4e94067-7ef0-44e3-b09c-a394b3b4dcd1 tempest-AccessesMetadataNegativeTest-1660907003 None] Result: True {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:40}} May 28 12:57:15 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-d4e94067-7ef0-44e3-b09c-a394b3b4dcd1 tempest-AccessesMetadataNegativeTest-1660907003 None] Done checking host 'l75lg1-v1@vast#vast' {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:41}} May 28 12:57:15 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-d4e94067-7ef0-44e3-b09c-a394b3b4dcd1 tempest-AccessesMetadataNegativeTest-1660907003 None] Filter DriverFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:57:15 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-d4e94067-7ef0-44e3-b09c-a394b3b4dcd1 tempest-AccessesMetadataNegativeTest-1660907003 None] Filter ShareReplicationFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:57:15 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-d4e94067-7ef0-44e3-b09c-a394b3b4dcd1 tempest-AccessesMetadataNegativeTest-1660907003 None] Filter CreateFromSnapshotFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:57:15 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-d4e94067-7ef0-44e3-b09c-a394b3b4dcd1 tempest-AccessesMetadataNegativeTest-1660907003 None] Filter AffinityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:57:15 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-d4e94067-7ef0-44e3-b09c-a394b3b4dcd1 tempest-AccessesMetadataNegativeTest-1660907003 None] Filter AntiAffinityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:57:15 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.drivers.filter [None req-d4e94067-7ef0-44e3-b09c-a394b3b4dcd1 tempest-AccessesMetadataNegativeTest-1660907003 None] Filtered share [host: 'l75lg1-v1@vast#vast', free_capacity_gb: 2068.6229242384434, pools: None] {{(pid=98327) _schedule_share /opt/stack/manila/manila/scheduler/drivers/filter.py:268}} May 28 12:57:15 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-d4e94067-7ef0-44e3-b09c-a394b3b4dcd1 tempest-AccessesMetadataNegativeTest-1660907003 None] Checking host 'l75lg1-v1@vast#vast' {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:46}} May 28 12:57:15 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.weighers.goodness [None req-d4e94067-7ef0-44e3-b09c-a394b3b4dcd1 tempest-AccessesMetadataNegativeTest-1660907003 None] Goodness function not set :: defaulting to minimal goodness rating of 0. May 28 12:57:15 l75lg1-v1 manila-scheduler[98327]: INFO manila.scheduler.weighers.goodness [None req-d4e94067-7ef0-44e3-b09c-a394b3b4dcd1 tempest-AccessesMetadataNegativeTest-1660907003 None] Goodness function result for host l75lg1-v1@vast#vast: 0. May 28 12:57:15 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-d4e94067-7ef0-44e3-b09c-a394b3b4dcd1 tempest-AccessesMetadataNegativeTest-1660907003 None] Goodness: 0 {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:48}} May 28 12:57:15 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-d4e94067-7ef0-44e3-b09c-a394b3b4dcd1 tempest-AccessesMetadataNegativeTest-1660907003 None] Done checking host 'l75lg1-v1@vast#vast' {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:49}} May 28 12:57:15 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.drivers.filter [None req-d4e94067-7ef0-44e3-b09c-a394b3b4dcd1 tempest-AccessesMetadataNegativeTest-1660907003 None] Choosing for share: WeighedHost [host: l75lg1-v1@vast#vast, weight: 0.0] {{(pid=98327) _schedule_share /opt/stack/manila/manila/scheduler/drivers/filter.py:274}} May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-d4e94067-7ef0-44e3-b09c-a394b3b4dcd1 tempest-AccessesMetadataNegativeTest-1660907003 tempest-AccessesMetadataNegativeTest-1660907003-project-member] http://10.27.203.238/share/v2/ed83204ad63946bdae288892bd07d115/shares returned with HTTP 200 May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 309/600] 10.27.203.238 () {66 vars in 1362 bytes} [Tue May 28 12:57:15 2024] POST /share/v2/ed83204ad63946bdae288892bd07d115/shares => generated 1312 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-36ac9489-2f69-4481-8790-387333ca7e6b tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] http://10.27.203.238/share/v2/1ae8e27013bc48228edf3022159a9c1f/types/dae41377-0474-4f8a-beda-3839c98cb123 returned with HTTP 202 May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 292/601] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:57:15 2024] DELETE /share/v2/1ae8e27013bc48228edf3022159a9c1f/types/dae41377-0474-4f8a-beda-3839c98cb123 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-f0bf0c7e-da70-4a19-9f5b-514c020a9e5b tempest-AccessesMetadataNegativeTest-1660907003 tempest-AccessesMetadataNegativeTest-1660907003-project-member] GET http://10.27.203.238/share/v2/ed83204ad63946bdae288892bd07d115/shares/1b8e12e8-6d99-48c0-8368-d1a37e2ca2ca May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-f0bf0c7e-da70-4a19-9f5b-514c020a9e5b tempest-AccessesMetadataNegativeTest-1660907003 tempest-AccessesMetadataNegativeTest-1660907003-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-f0bf0c7e-da70-4a19-9f5b-514c020a9e5b tempest-AccessesMetadataNegativeTest-1660907003 tempest-AccessesMetadataNegativeTest-1660907003-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-488791a2-a411-4d15-a8a8-7308cafd46a2 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] GET http://10.27.203.238/share/v2/1ae8e27013bc48228edf3022159a9c1f/types/dae41377-0474-4f8a-beda-3839c98cb123 May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-488791a2-a411-4d15-a8a8-7308cafd46a2 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-488791a2-a411-4d15-a8a8-7308cafd46a2 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] Calling method 'ShareTypesController.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-488791a2-a411-4d15-a8a8-7308cafd46a2 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] HTTP exception thrown: Share type not found. May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-488791a2-a411-4d15-a8a8-7308cafd46a2 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] http://10.27.203.238/share/v2/1ae8e27013bc48228edf3022159a9c1f/types/dae41377-0474-4f8a-beda-3839c98cb123 returned with HTTP 404 May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 293/602] 10.27.203.238 () {64 vars in 1448 bytes} [Tue May 28 12:57:15 2024] GET /share/v2/1ae8e27013bc48228edf3022159a9c1f/types/dae41377-0474-4f8a-beda-3839c98cb123 => generated 67 bytes in 9 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-97b00e80-4dcf-48bd-9dd2-efa5f9957e3b tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] DELETE http://10.27.203.238/share/v2/1ae8e27013bc48228edf3022159a9c1f/types/c4597038-c3af-42d2-afd3-74055597cc77 May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-97b00e80-4dcf-48bd-9dd2-efa5f9957e3b tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-97b00e80-4dcf-48bd-9dd2-efa5f9957e3b tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] Calling method 'ShareTypesController._delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-f0bf0c7e-da70-4a19-9f5b-514c020a9e5b tempest-AccessesMetadataNegativeTest-1660907003 tempest-AccessesMetadataNegativeTest-1660907003-project-member] http://10.27.203.238/share/v2/ed83204ad63946bdae288892bd07d115/shares/1b8e12e8-6d99-48c0-8368-d1a37e2ca2ca returned with HTTP 200 May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 310/603] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:57:15 2024] GET /share/v2/ed83204ad63946bdae288892bd07d115/shares/1b8e12e8-6d99-48c0-8368-d1a37e2ca2ca => generated 1312 bytes in 28 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-97b00e80-4dcf-48bd-9dd2-efa5f9957e3b tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] http://10.27.203.238/share/v2/1ae8e27013bc48228edf3022159a9c1f/types/c4597038-c3af-42d2-afd3-74055597cc77 returned with HTTP 202 May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 294/604] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:57:15 2024] DELETE /share/v2/1ae8e27013bc48228edf3022159a9c1f/types/c4597038-c3af-42d2-afd3-74055597cc77 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-0aef0b58-1a0e-44f3-a0ab-606382d00a1e tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] GET http://10.27.203.238/share/v2/1ae8e27013bc48228edf3022159a9c1f/types/c4597038-c3af-42d2-afd3-74055597cc77 May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-0aef0b58-1a0e-44f3-a0ab-606382d00a1e tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-0aef0b58-1a0e-44f3-a0ab-606382d00a1e tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] Calling method 'ShareTypesController.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-0aef0b58-1a0e-44f3-a0ab-606382d00a1e tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] HTTP exception thrown: Share type not found. May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-0aef0b58-1a0e-44f3-a0ab-606382d00a1e tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] http://10.27.203.238/share/v2/1ae8e27013bc48228edf3022159a9c1f/types/c4597038-c3af-42d2-afd3-74055597cc77 returned with HTTP 404 May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 311/605] 10.27.203.238 () {64 vars in 1448 bytes} [Tue May 28 12:57:15 2024] GET /share/v2/1ae8e27013bc48228edf3022159a9c1f/types/c4597038-c3af-42d2-afd3-74055597cc77 => generated 67 bytes in 10 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-127dd949-2252-40a3-9206-2fe0100db353 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] DELETE http://10.27.203.238/share/v2/1ae8e27013bc48228edf3022159a9c1f/types/43cd736a-2620-4e48-9f39-83c7df9b380a May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-127dd949-2252-40a3-9206-2fe0100db353 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-127dd949-2252-40a3-9206-2fe0100db353 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] Calling method 'ShareTypesController._delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-127dd949-2252-40a3-9206-2fe0100db353 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] http://10.27.203.238/share/v2/1ae8e27013bc48228edf3022159a9c1f/types/43cd736a-2620-4e48-9f39-83c7df9b380a returned with HTTP 202 May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 295/606] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:57:15 2024] DELETE /share/v2/1ae8e27013bc48228edf3022159a9c1f/types/43cd736a-2620-4e48-9f39-83c7df9b380a => generated 0 bytes in 34 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:57:15 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d4e94067-7ef0-44e3-b09c-a394b3b4dcd1 tempest-AccessesMetadataNegativeTest-1660907003 None] >>> [GET] https://127.0.0.1:40443/api/vippools/ May 28 12:57:15 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d4e94067-7ef0-44e3-b09c-a394b3b4dcd1 tempest-AccessesMetadataNegativeTest-1660907003 None] {'allow_redirects': True, 'params': {'name': 'vippool-1'}} May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-c83a0171-1c28-41f0-8b74-4ef7b5929bfe tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] GET http://10.27.203.238/share/v2/1ae8e27013bc48228edf3022159a9c1f/types/43cd736a-2620-4e48-9f39-83c7df9b380a May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-c83a0171-1c28-41f0-8b74-4ef7b5929bfe tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-c83a0171-1c28-41f0-8b74-4ef7b5929bfe tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] Calling method 'ShareTypesController.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-c83a0171-1c28-41f0-8b74-4ef7b5929bfe tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] HTTP exception thrown: Share type not found. May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-c83a0171-1c28-41f0-8b74-4ef7b5929bfe tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] http://10.27.203.238/share/v2/1ae8e27013bc48228edf3022159a9c1f/types/43cd736a-2620-4e48-9f39-83c7df9b380a returned with HTTP 404 May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 312/607] 10.27.203.238 () {64 vars in 1448 bytes} [Tue May 28 12:57:15 2024] GET /share/v2/1ae8e27013bc48228edf3022159a9c1f/types/43cd736a-2620-4e48-9f39-83c7df9b380a => generated 67 bytes in 10 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-509a82d3-d234-4890-b926-41991bd95de1 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] DELETE http://10.27.203.238/share/v2/1ae8e27013bc48228edf3022159a9c1f/types/f676a13a-d273-434b-bc78-bec5e62f86f8 May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-509a82d3-d234-4890-b926-41991bd95de1 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-509a82d3-d234-4890-b926-41991bd95de1 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] Calling method 'ShareTypesController._delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-509a82d3-d234-4890-b926-41991bd95de1 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] http://10.27.203.238/share/v2/1ae8e27013bc48228edf3022159a9c1f/types/f676a13a-d273-434b-bc78-bec5e62f86f8 returned with HTTP 202 May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 296/608] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:57:15 2024] DELETE /share/v2/1ae8e27013bc48228edf3022159a9c1f/types/f676a13a-d273-434b-bc78-bec5e62f86f8 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-507da27d-7ff6-4569-bec7-b4f3456a9c84 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] GET http://10.27.203.238/share/v2/1ae8e27013bc48228edf3022159a9c1f/types/f676a13a-d273-434b-bc78-bec5e62f86f8 May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-507da27d-7ff6-4569-bec7-b4f3456a9c84 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-507da27d-7ff6-4569-bec7-b4f3456a9c84 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] Calling method 'ShareTypesController.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-507da27d-7ff6-4569-bec7-b4f3456a9c84 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] HTTP exception thrown: Share type not found. May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-507da27d-7ff6-4569-bec7-b4f3456a9c84 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] http://10.27.203.238/share/v2/1ae8e27013bc48228edf3022159a9c1f/types/f676a13a-d273-434b-bc78-bec5e62f86f8 returned with HTTP 404 May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 313/609] 10.27.203.238 () {64 vars in 1448 bytes} [Tue May 28 12:57:15 2024] GET /share/v2/1ae8e27013bc48228edf3022159a9c1f/types/f676a13a-d273-434b-bc78-bec5e62f86f8 => generated 67 bytes in 10 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-97728d3f-fa6c-4e42-b917-1b783a98ea7d tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] DELETE http://10.27.203.238/share/v2/1ae8e27013bc48228edf3022159a9c1f/types/b16f901c-4082-4810-ba14-aa2086f1fcd7 May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-97728d3f-fa6c-4e42-b917-1b783a98ea7d tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-97728d3f-fa6c-4e42-b917-1b783a98ea7d tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] Calling method 'ShareTypesController._delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-97728d3f-fa6c-4e42-b917-1b783a98ea7d tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] http://10.27.203.238/share/v2/1ae8e27013bc48228edf3022159a9c1f/types/b16f901c-4082-4810-ba14-aa2086f1fcd7 returned with HTTP 202 May 28 12:57:15 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 297/610] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:57:15 2024] DELETE /share/v2/1ae8e27013bc48228edf3022159a9c1f/types/b16f901c-4082-4810-ba14-aa2086f1fcd7 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:57:16 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-1649ca93-b0bf-457b-b533-3653da470aeb tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] GET http://10.27.203.238/share/v2/1ae8e27013bc48228edf3022159a9c1f/types/b16f901c-4082-4810-ba14-aa2086f1fcd7 May 28 12:57:16 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-1649ca93-b0bf-457b-b533-3653da470aeb tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:16 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-1649ca93-b0bf-457b-b533-3653da470aeb tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] Calling method 'ShareTypesController.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:16 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-1649ca93-b0bf-457b-b533-3653da470aeb tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] HTTP exception thrown: Share type not found. May 28 12:57:16 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-1649ca93-b0bf-457b-b533-3653da470aeb tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] http://10.27.203.238/share/v2/1ae8e27013bc48228edf3022159a9c1f/types/b16f901c-4082-4810-ba14-aa2086f1fcd7 returned with HTTP 404 May 28 12:57:16 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 314/611] 10.27.203.238 () {64 vars in 1448 bytes} [Tue May 28 12:57:15 2024] GET /share/v2/1ae8e27013bc48228edf3022159a9c1f/types/b16f901c-4082-4810-ba14-aa2086f1fcd7 => generated 67 bytes in 9 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 12:57:16 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-0e2b032e-d4b3-4a85-b09e-eb99b7242702 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] DELETE http://10.27.203.238/share/v2/1ae8e27013bc48228edf3022159a9c1f/types/763fbbc2-6098-48ca-99b0-54d1e100d3da May 28 12:57:16 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-0e2b032e-d4b3-4a85-b09e-eb99b7242702 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:16 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-0e2b032e-d4b3-4a85-b09e-eb99b7242702 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] Calling method 'ShareTypesController._delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:16 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-0e2b032e-d4b3-4a85-b09e-eb99b7242702 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] http://10.27.203.238/share/v2/1ae8e27013bc48228edf3022159a9c1f/types/763fbbc2-6098-48ca-99b0-54d1e100d3da returned with HTTP 202 May 28 12:57:16 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 298/612] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:57:16 2024] DELETE /share/v2/1ae8e27013bc48228edf3022159a9c1f/types/763fbbc2-6098-48ca-99b0-54d1e100d3da => generated 0 bytes in 40 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:57:16 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-fd967d5e-15c9-48d3-9baf-7c343614dc03 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] GET http://10.27.203.238/share/v2/1ae8e27013bc48228edf3022159a9c1f/types/763fbbc2-6098-48ca-99b0-54d1e100d3da May 28 12:57:16 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-fd967d5e-15c9-48d3-9baf-7c343614dc03 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:16 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-fd967d5e-15c9-48d3-9baf-7c343614dc03 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] Calling method 'ShareTypesController.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:16 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-fd967d5e-15c9-48d3-9baf-7c343614dc03 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] HTTP exception thrown: Share type not found. May 28 12:57:16 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-fd967d5e-15c9-48d3-9baf-7c343614dc03 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] http://10.27.203.238/share/v2/1ae8e27013bc48228edf3022159a9c1f/types/763fbbc2-6098-48ca-99b0-54d1e100d3da returned with HTTP 404 May 28 12:57:16 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 315/613] 10.27.203.238 () {64 vars in 1448 bytes} [Tue May 28 12:57:16 2024] GET /share/v2/1ae8e27013bc48228edf3022159a9c1f/types/763fbbc2-6098-48ca-99b0-54d1e100d3da => generated 67 bytes in 9 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 12:57:16 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-32bafba5-7abd-4fea-ac11-1e9abab292e9 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] DELETE http://10.27.203.238/share/v2/1ae8e27013bc48228edf3022159a9c1f/types/a7d3ef8e-a59b-4a67-a67e-d09569da9eef May 28 12:57:16 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-32bafba5-7abd-4fea-ac11-1e9abab292e9 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:16 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-32bafba5-7abd-4fea-ac11-1e9abab292e9 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] Calling method 'ShareTypesController._delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:16 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-5e3899b9-b6e9-4441-8750-3d8495665a52 tempest-AdminActionsTest-1749172189 None] <<< [GET] https://127.0.0.1:40443/api/vippools/ May 28 12:57:16 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-5e3899b9-b6e9-4441-8750-3d8495665a52 tempest-AdminActionsTest-1749172189 None] [Bunch(active_cnode_ids=[], active_interfaces=4, cluster='loop75-kfs', cluster_id=1, cnode_ids=[], cnodes=[], domain_name='vippool-1', enable_l3=False, enable_weighted_balancing=False, enabled=True, end_ip='172.21.75.4', guid='f2abaede-b397-413a-8faa-3aeead6d3b28', gw_ip='', gw_ipv6='', id=2, ip_ranges=[['172.21.75.1', '172.21.75.4']], name='vippool-1', peer_asn=0, port_membership='ALL', ranges_summary='172.21.75.[1-4]', role='PROTOCOLS', start_ip='172.21.75.1', subnet_cidr=16, subnet_cidr_ipv6=None, sync='SYNCED', sync_time='2024-05-28T12:50:09.644123Z', tenant_id=1, tenant_name='default', title='172.21.75.1 - 172.21.75.4', url='https://127.0.0.1:40443/api/vippools/2/', vast_asn=0, vlan=0, vms_preferred=False)] May 28 12:57:16 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-5e3899b9-b6e9-4441-8750-3d8495665a52 tempest-AdminActionsTest-1749172189 None] --- [GET] https://127.0.0.1:40443/api/vippools/: Done May 28 12:57:16 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-5e3899b9-b6e9-4441-8750-3d8495665a52 tempest-AdminActionsTest-1749172189 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:57:16 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-5e3899b9-b6e9-4441-8750-3d8495665a52 tempest-AdminActionsTest-1749172189 None] {'allow_redirects': True, May 28 12:57:16 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-5e3899b9-b6e9-4441-8750-3d8495665a52 tempest-AdminActionsTest-1749172189 None] 'params': {'name': '891641f2-366e-4b85-925e-8cffaa759ace'}} May 28 12:57:16 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-32bafba5-7abd-4fea-ac11-1e9abab292e9 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] http://10.27.203.238/share/v2/1ae8e27013bc48228edf3022159a9c1f/types/a7d3ef8e-a59b-4a67-a67e-d09569da9eef returned with HTTP 202 May 28 12:57:16 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 299/614] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:57:16 2024] DELETE /share/v2/1ae8e27013bc48228edf3022159a9c1f/types/a7d3ef8e-a59b-4a67-a67e-d09569da9eef => generated 0 bytes in 41 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:57:16 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-5c72fe56-8933-415c-881e-f180271af379 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] GET http://10.27.203.238/share/v2/1ae8e27013bc48228edf3022159a9c1f/types/a7d3ef8e-a59b-4a67-a67e-d09569da9eef May 28 12:57:16 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-5c72fe56-8933-415c-881e-f180271af379 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:16 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-5c72fe56-8933-415c-881e-f180271af379 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] Calling method 'ShareTypesController.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:16 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-5c72fe56-8933-415c-881e-f180271af379 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] HTTP exception thrown: Share type not found. May 28 12:57:16 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-5c72fe56-8933-415c-881e-f180271af379 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] http://10.27.203.238/share/v2/1ae8e27013bc48228edf3022159a9c1f/types/a7d3ef8e-a59b-4a67-a67e-d09569da9eef returned with HTTP 404 May 28 12:57:16 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 316/615] 10.27.203.238 () {64 vars in 1448 bytes} [Tue May 28 12:57:16 2024] GET /share/v2/1ae8e27013bc48228edf3022159a9c1f/types/a7d3ef8e-a59b-4a67-a67e-d09569da9eef => generated 67 bytes in 11 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 12:57:16 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-89bae589-48dc-44aa-9488-76c23c60ce8e tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] DELETE http://10.27.203.238/share/v2/1ae8e27013bc48228edf3022159a9c1f/types/91a21269-ee12-4daa-82dd-9acbd2740926 May 28 12:57:16 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-89bae589-48dc-44aa-9488-76c23c60ce8e tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:16 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-89bae589-48dc-44aa-9488-76c23c60ce8e tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] Calling method 'ShareTypesController._delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:16 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-89bae589-48dc-44aa-9488-76c23c60ce8e tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] http://10.27.203.238/share/v2/1ae8e27013bc48228edf3022159a9c1f/types/91a21269-ee12-4daa-82dd-9acbd2740926 returned with HTTP 202 May 28 12:57:16 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 300/616] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:57:16 2024] DELETE /share/v2/1ae8e27013bc48228edf3022159a9c1f/types/91a21269-ee12-4daa-82dd-9acbd2740926 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:57:16 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b5d0ddc5-db46-4239-8d97-cf384f7cf2d8 tempest-SharesActionsAdminTest-1286316336 None] <<< [POST] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:57:16 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b5d0ddc5-db46-4239-8d97-cf384f7cf2d8 tempest-SharesActionsAdminTest-1286316336 None] Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=0, created='2024-05-28T12:57:15.736653Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='268e982f-5193-45fa-a88b-ed0fd523938d', id=15, internal=False, is_s3_default_policy=False, name='7c19614c-d968-4489-b2ad-bd88c2ef8054', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=[], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['*'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['*'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T12:57:16.085300Z', tenant_id=1, tenant_name='default', title='7c19614c-d968-4489-b2ad-bd88c2ef8054', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/15/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[]) May 28 12:57:16 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b5d0ddc5-db46-4239-8d97-cf384f7cf2d8 tempest-SharesActionsAdminTest-1286316336 None] --- [POST] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 12:57:16 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b5d0ddc5-db46-4239-8d97-cf384f7cf2d8 tempest-SharesActionsAdminTest-1286316336 None] >>> [GET] https://127.0.0.1:40443/api/quotas/ May 28 12:57:16 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b5d0ddc5-db46-4239-8d97-cf384f7cf2d8 tempest-SharesActionsAdminTest-1286316336 None] {'allow_redirects': True, May 28 12:57:16 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b5d0ddc5-db46-4239-8d97-cf384f7cf2d8 tempest-SharesActionsAdminTest-1286316336 None] 'params': {'name': '7c19614c-d968-4489-b2ad-bd88c2ef8054'}} May 28 12:57:16 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-55cba237-7f76-448f-ac4d-0330cef993b4 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] GET http://10.27.203.238/share/v2/1ae8e27013bc48228edf3022159a9c1f/types/91a21269-ee12-4daa-82dd-9acbd2740926 May 28 12:57:16 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-55cba237-7f76-448f-ac4d-0330cef993b4 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:16 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-55cba237-7f76-448f-ac4d-0330cef993b4 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] Calling method 'ShareTypesController.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:16 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-55cba237-7f76-448f-ac4d-0330cef993b4 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] HTTP exception thrown: Share type not found. May 28 12:57:16 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-55cba237-7f76-448f-ac4d-0330cef993b4 tempest-ExtraSpecsAdminNegativeTest-1493698056 tempest-ExtraSpecsAdminNegativeTest-1493698056-project-admin] http://10.27.203.238/share/v2/1ae8e27013bc48228edf3022159a9c1f/types/91a21269-ee12-4daa-82dd-9acbd2740926 returned with HTTP 404 May 28 12:57:16 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 317/617] 10.27.203.238 () {64 vars in 1448 bytes} [Tue May 28 12:57:16 2024] GET /share/v2/1ae8e27013bc48228edf3022159a9c1f/types/91a21269-ee12-4daa-82dd-9acbd2740926 => generated 67 bytes in 10 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 12:57:16 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b454cec2-5a16-4d13-8969-93a6920886ac service manila] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:16 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-b454cec2-5a16-4d13-8969-93a6920886ac service manila] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:16 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b454cec2-5a16-4d13-8969-93a6920886ac service manila] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:16 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff869ba-9853-4748-ae91-f0cef57747ea None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:16 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff869ba-9853-4748-ae91-f0cef57747ea None admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:16 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff869ba-9853-4748-ae91-f0cef57747ea None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:16 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff869ba-9853-4748-ae91-f0cef57747ea None admin] PATH_INFO: `/v3/users/7365146fcc404c988e9841963a43be27` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:16 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff869ba-9853-4748-ae91-f0cef57747ea None admin] RBAC: Authorizing `identity:delete_user(user_id=7365146fcc404c988e9841963a43be27)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:16 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff869ba-9853-4748-ae91-f0cef57747ea None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:16 l75lg1-v1 dstat.sh[49771]: 28-05 12:57:16| 17 1 76 5 0|5679M 1819M 277M 7851M| 19k 4436B| 0 3062k| 0 460 |9570 16k|1.63 1.03 1.00|2.0 2.0 0| 0 0 | 0 2048M| 29 352 0 79 0 May 28 12:57:16 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-7ff869ba-9853-4748-ae91-f0cef57747ea None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7365146fcc404c988e9841963a43be27', 'request_id': 'req-7ff869ba-9853-4748-ae91-f0cef57747ea'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:16 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-7ff869ba-9853-4748-ae91-f0cef57747ea None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7365146fcc404c988e9841963a43be27', 'request_id': 'req-7ff869ba-9853-4748-ae91-f0cef57747ea'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:16 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-7ff869ba-9853-4748-ae91-f0cef57747ea None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7365146fcc404c988e9841963a43be27', 'request_id': 'req-7ff869ba-9853-4748-ae91-f0cef57747ea'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:16 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-7ff869ba-9853-4748-ae91-f0cef57747ea None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7365146fcc404c988e9841963a43be27', 'request_id': 'req-7ff869ba-9853-4748-ae91-f0cef57747ea'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:16 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-7ff869ba-9853-4748-ae91-f0cef57747ea None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7365146fcc404c988e9841963a43be27', 'request_id': 'req-7ff869ba-9853-4748-ae91-f0cef57747ea'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:16 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 937/1849] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 12:57:16 2024] DELETE /identity/v3/users/7365146fcc404c988e9841963a43be27 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:57:16 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8103b76-c544-4ba9-906d-09bb5b2807da service manila] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:16 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8103b76-c544-4ba9-906d-09bb5b2807da service manila] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:16 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04c2f04-e511-4048-a7fa-95198b9ac03a None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:16 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04c2f04-e511-4048-a7fa-95198b9ac03a None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:16 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04c2f04-e511-4048-a7fa-95198b9ac03a None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:16 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04c2f04-e511-4048-a7fa-95198b9ac03a None admin] PATH_INFO: `/v3/users/165270b3c7594f98ad74df5e973f36b6` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:16 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04c2f04-e511-4048-a7fa-95198b9ac03a None admin] RBAC: Authorizing `identity:delete_user(user_id=165270b3c7594f98ad74df5e973f36b6)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:16 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04c2f04-e511-4048-a7fa-95198b9ac03a None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:16 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-a04c2f04-e511-4048-a7fa-95198b9ac03a None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '165270b3c7594f98ad74df5e973f36b6', 'request_id': 'req-a04c2f04-e511-4048-a7fa-95198b9ac03a'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:16 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-a04c2f04-e511-4048-a7fa-95198b9ac03a None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '165270b3c7594f98ad74df5e973f36b6', 'request_id': 'req-a04c2f04-e511-4048-a7fa-95198b9ac03a'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:16 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-01a2ae14-f15d-4183-924e-4ad9803a3801 tempest-ShareSnapshotInstancesTest-843694899 None] <<< [GET] https://127.0.0.1:40443/api/views/ May 28 12:57:16 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-01a2ae14-f15d-4183-924e-4ad9803a3801 tempest-ShareSnapshotInstancesTest-843694899 None] [] May 28 12:57:16 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-01a2ae14-f15d-4183-924e-4ad9803a3801 tempest-ShareSnapshotInstancesTest-843694899 None] --- [GET] https://127.0.0.1:40443/api/views/: Done May 28 12:57:16 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-01a2ae14-f15d-4183-924e-4ad9803a3801 tempest-ShareSnapshotInstancesTest-843694899 None] >>> [POST] https://127.0.0.1:40443/api/views/ May 28 12:57:16 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-01a2ae14-f15d-4183-924e-4ad9803a3801 tempest-ShareSnapshotInstancesTest-843694899 None] {'data': '{"name": "c2f741cd-bac5-499f-9539-8e93d6a81282", "path": ' May 28 12:57:16 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-01a2ae14-f15d-4183-924e-4ad9803a3801 tempest-ShareSnapshotInstancesTest-843694899 None] '"/manila/manila-c2f741cd-bac5-499f-9539-8e93d6a81282", "policy_id": ' May 28 12:57:16 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-01a2ae14-f15d-4183-924e-4ad9803a3801 tempest-ShareSnapshotInstancesTest-843694899 None] '14, "create_dir": true, "protocols": ["NFS"]}', May 28 12:57:16 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-01a2ae14-f15d-4183-924e-4ad9803a3801 tempest-ShareSnapshotInstancesTest-843694899 None] 'json': None, May 28 12:57:16 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-01a2ae14-f15d-4183-924e-4ad9803a3801 tempest-ShareSnapshotInstancesTest-843694899 None] 'params': None} May 28 12:57:16 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-a04c2f04-e511-4048-a7fa-95198b9ac03a None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '165270b3c7594f98ad74df5e973f36b6', 'request_id': 'req-a04c2f04-e511-4048-a7fa-95198b9ac03a'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:16 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-5e3899b9-b6e9-4441-8750-3d8495665a52 tempest-AdminActionsTest-1749172189 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:57:16 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-5e3899b9-b6e9-4441-8750-3d8495665a52 tempest-AdminActionsTest-1749172189 None] [] May 28 12:57:16 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-5e3899b9-b6e9-4441-8750-3d8495665a52 tempest-AdminActionsTest-1749172189 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 12:57:16 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-5e3899b9-b6e9-4441-8750-3d8495665a52 tempest-AdminActionsTest-1749172189 None] >>> [POST] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:57:16 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-5e3899b9-b6e9-4441-8750-3d8495665a52 tempest-AdminActionsTest-1749172189 None] {'data': '{"name": "891641f2-366e-4b85-925e-8cffaa759ace"}', May 28 12:57:16 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-5e3899b9-b6e9-4441-8750-3d8495665a52 tempest-AdminActionsTest-1749172189 None] 'json': None, May 28 12:57:16 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-5e3899b9-b6e9-4441-8750-3d8495665a52 tempest-AdminActionsTest-1749172189 None] 'params': None} May 28 12:57:16 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-a04c2f04-e511-4048-a7fa-95198b9ac03a None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '165270b3c7594f98ad74df5e973f36b6', 'request_id': 'req-a04c2f04-e511-4048-a7fa-95198b9ac03a'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:16 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-a04c2f04-e511-4048-a7fa-95198b9ac03a None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '165270b3c7594f98ad74df5e973f36b6', 'request_id': 'req-a04c2f04-e511-4048-a7fa-95198b9ac03a'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:16 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d4e94067-7ef0-44e3-b09c-a394b3b4dcd1 tempest-AccessesMetadataNegativeTest-1660907003 None] <<< [GET] https://127.0.0.1:40443/api/vippools/ May 28 12:57:16 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d4e94067-7ef0-44e3-b09c-a394b3b4dcd1 tempest-AccessesMetadataNegativeTest-1660907003 None] [Bunch(active_cnode_ids=[], active_interfaces=4, cluster='loop75-kfs', cluster_id=1, cnode_ids=[], cnodes=[], domain_name='vippool-1', enable_l3=False, enable_weighted_balancing=False, enabled=True, end_ip='172.21.75.4', guid='f2abaede-b397-413a-8faa-3aeead6d3b28', gw_ip='', gw_ipv6='', id=2, ip_ranges=[['172.21.75.1', '172.21.75.4']], name='vippool-1', peer_asn=0, port_membership='ALL', ranges_summary='172.21.75.[1-4]', role='PROTOCOLS', start_ip='172.21.75.1', subnet_cidr=16, subnet_cidr_ipv6=None, sync='SYNCED', sync_time='2024-05-28T12:50:09.644123Z', tenant_id=1, tenant_name='default', title='172.21.75.1 - 172.21.75.4', url='https://127.0.0.1:40443/api/vippools/2/', vast_asn=0, vlan=0, vms_preferred=False)] May 28 12:57:16 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d4e94067-7ef0-44e3-b09c-a394b3b4dcd1 tempest-AccessesMetadataNegativeTest-1660907003 None] --- [GET] https://127.0.0.1:40443/api/vippools/: Done May 28 12:57:16 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d4e94067-7ef0-44e3-b09c-a394b3b4dcd1 tempest-AccessesMetadataNegativeTest-1660907003 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:57:16 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d4e94067-7ef0-44e3-b09c-a394b3b4dcd1 tempest-AccessesMetadataNegativeTest-1660907003 None] {'allow_redirects': True, May 28 12:57:16 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d4e94067-7ef0-44e3-b09c-a394b3b4dcd1 tempest-AccessesMetadataNegativeTest-1660907003 None] 'params': {'name': '113739f1-d41a-4f4e-b63f-071e2ecd0a7b'}} May 28 12:57:16 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 913/1850] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 12:57:16 2024] DELETE /identity/v3/users/165270b3c7594f98ad74df5e973f36b6 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:57:16 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff869ba-9853-4748-ae91-f0cef57747ea None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:16 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-7ff869ba-9853-4748-ae91-f0cef57747ea None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:16 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff869ba-9853-4748-ae91-f0cef57747ea None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:16 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b5d0ddc5-db46-4239-8d97-cf384f7cf2d8 tempest-SharesActionsAdminTest-1286316336 None] <<< [GET] https://127.0.0.1:40443/api/quotas/ May 28 12:57:16 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b5d0ddc5-db46-4239-8d97-cf384f7cf2d8 tempest-SharesActionsAdminTest-1286316336 None] [] May 28 12:57:16 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b5d0ddc5-db46-4239-8d97-cf384f7cf2d8 tempest-SharesActionsAdminTest-1286316336 None] --- [GET] https://127.0.0.1:40443/api/quotas/: Done May 28 12:57:16 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b5d0ddc5-db46-4239-8d97-cf384f7cf2d8 tempest-SharesActionsAdminTest-1286316336 None] >>> [POST] https://127.0.0.1:40443/api/quotas/ May 28 12:57:16 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b5d0ddc5-db46-4239-8d97-cf384f7cf2d8 tempest-SharesActionsAdminTest-1286316336 None] {'data': '{"name": "7c19614c-d968-4489-b2ad-bd88c2ef8054", "path": ' May 28 12:57:16 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b5d0ddc5-db46-4239-8d97-cf384f7cf2d8 tempest-SharesActionsAdminTest-1286316336 None] '"/manila/manila-7c19614c-d968-4489-b2ad-bd88c2ef8054", "create_dir": ' May 28 12:57:16 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b5d0ddc5-db46-4239-8d97-cf384f7cf2d8 tempest-SharesActionsAdminTest-1286316336 None] 'true, "hard_limit": 1073741824}', May 28 12:57:16 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b5d0ddc5-db46-4239-8d97-cf384f7cf2d8 tempest-SharesActionsAdminTest-1286316336 None] 'json': None, May 28 12:57:16 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b5d0ddc5-db46-4239-8d97-cf384f7cf2d8 tempest-SharesActionsAdminTest-1286316336 None] 'params': None} May 28 12:57:16 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee7ece8-a2cb-47d8-bc7b-2ad3a31b77e0 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:16 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee7ece8-a2cb-47d8-bc7b-2ad3a31b77e0 None admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:16 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee7ece8-a2cb-47d8-bc7b-2ad3a31b77e0 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:16 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee7ece8-a2cb-47d8-bc7b-2ad3a31b77e0 None admin] PATH_INFO: `/v3/users/be38ad37856445168a42a6912c87bc8b` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:16 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee7ece8-a2cb-47d8-bc7b-2ad3a31b77e0 None admin] RBAC: Authorizing `identity:delete_user(user_id=be38ad37856445168a42a6912c87bc8b)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:16 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee7ece8-a2cb-47d8-bc7b-2ad3a31b77e0 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:16 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-5ee7ece8-a2cb-47d8-bc7b-2ad3a31b77e0 None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be38ad37856445168a42a6912c87bc8b', 'request_id': 'req-5ee7ece8-a2cb-47d8-bc7b-2ad3a31b77e0'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:16 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-5ee7ece8-a2cb-47d8-bc7b-2ad3a31b77e0 None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be38ad37856445168a42a6912c87bc8b', 'request_id': 'req-5ee7ece8-a2cb-47d8-bc7b-2ad3a31b77e0'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:16 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-5ee7ece8-a2cb-47d8-bc7b-2ad3a31b77e0 None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be38ad37856445168a42a6912c87bc8b', 'request_id': 'req-5ee7ece8-a2cb-47d8-bc7b-2ad3a31b77e0'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:16 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-5ee7ece8-a2cb-47d8-bc7b-2ad3a31b77e0 None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be38ad37856445168a42a6912c87bc8b', 'request_id': 'req-5ee7ece8-a2cb-47d8-bc7b-2ad3a31b77e0'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:16 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-5ee7ece8-a2cb-47d8-bc7b-2ad3a31b77e0 None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be38ad37856445168a42a6912c87bc8b', 'request_id': 'req-5ee7ece8-a2cb-47d8-bc7b-2ad3a31b77e0'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:16 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 938/1851] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 12:57:16 2024] DELETE /identity/v3/users/be38ad37856445168a42a6912c87bc8b => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:57:16 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e3fb6d-baea-4c43-b1d7-9eeb2fd609fe None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:16 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e3fb6d-baea-4c43-b1d7-9eeb2fd609fe None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:16 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e3fb6d-baea-4c43-b1d7-9eeb2fd609fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:16 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-f1e3fb6d-baea-4c43-b1d7-9eeb2fd609fe None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:57:16 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-f1e3fb6d-baea-4c43-b1d7-9eeb2fd609fe None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:57:16 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-f1e3fb6d-baea-4c43-b1d7-9eeb2fd609fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:16 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 914/1852] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:57:16 2024] POST /identity/v3/auth/tokens => generated 2960 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 12:57:16 l75lg1-v1 neutron-server[77619]: DEBUG neutron.wsgi [-] (77619) accepted ('10.27.203.238', 58680) {{(pid=77619) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 12:57:16 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee7ece8-a2cb-47d8-bc7b-2ad3a31b77e0 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:16 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-5ee7ece8-a2cb-47d8-bc7b-2ad3a31b77e0 None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:16 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee7ece8-a2cb-47d8-bc7b-2ad3a31b77e0 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:16 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a939925-ae24-4cec-8e35-1b58d9b5fcda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef17047035e4b518fd5360a01f2da1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:16 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a939925-ae24-4cec-8e35-1b58d9b5fcda service neutron] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:16 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a939925-ae24-4cec-8e35-1b58d9b5fcda service neutron] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:16 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a939925-ae24-4cec-8e35-1b58d9b5fcda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:16 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a939925-ae24-4cec-8e35-1b58d9b5fcda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:16 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a939925-ae24-4cec-8e35-1b58d9b5fcda service neutron] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:16 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 939/1853] 10.27.203.238 () {64 vars in 1432 bytes} [Tue May 28 12:57:16 2024] GET /identity/v3/auth/tokens => generated 2960 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 28 12:57:16 l75lg1-v1 neutron-server[77619]: INFO neutron.wsgi [None req-b85e2eba-c798-492e-9b1c-9f033194930d None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=1f12d119bc9a46e9b391ca37a6d3847a&name=default HTTP/1.1" status: 200 len: 216 time: 0.0704226 May 28 12:57:16 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e3fb6d-baea-4c43-b1d7-9eeb2fd609fe None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:16 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-f1e3fb6d-baea-4c43-b1d7-9eeb2fd609fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:16 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e3fb6d-baea-4c43-b1d7-9eeb2fd609fe None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:16 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e70fe6-810c-4a20-ae7e-55b62a56ffb2 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:16 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e70fe6-810c-4a20-ae7e-55b62a56ffb2 None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:16 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e70fe6-810c-4a20-ae7e-55b62a56ffb2 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:16 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e70fe6-810c-4a20-ae7e-55b62a56ffb2 None admin] PATH_INFO: `/v3/projects/1f12d119bc9a46e9b391ca37a6d3847a` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:16 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e70fe6-810c-4a20-ae7e-55b62a56ffb2 None admin] RBAC: Authorizing `identity:delete_project(project_id=1f12d119bc9a46e9b391ca37a6d3847a)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:16 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e70fe6-810c-4a20-ae7e-55b62a56ffb2 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:16 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d4e94067-7ef0-44e3-b09c-a394b3b4dcd1 tempest-AccessesMetadataNegativeTest-1660907003 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:57:16 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d4e94067-7ef0-44e3-b09c-a394b3b4dcd1 tempest-AccessesMetadataNegativeTest-1660907003 None] [] May 28 12:57:16 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d4e94067-7ef0-44e3-b09c-a394b3b4dcd1 tempest-AccessesMetadataNegativeTest-1660907003 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 12:57:16 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d4e94067-7ef0-44e3-b09c-a394b3b4dcd1 tempest-AccessesMetadataNegativeTest-1660907003 None] >>> [POST] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:57:16 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d4e94067-7ef0-44e3-b09c-a394b3b4dcd1 tempest-AccessesMetadataNegativeTest-1660907003 None] {'data': '{"name": "113739f1-d41a-4f4e-b63f-071e2ecd0a7b"}', May 28 12:57:16 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d4e94067-7ef0-44e3-b09c-a394b3b4dcd1 tempest-AccessesMetadataNegativeTest-1660907003 None] 'json': None, May 28 12:57:16 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d4e94067-7ef0-44e3-b09c-a394b3b4dcd1 tempest-AccessesMetadataNegativeTest-1660907003 None] 'params': None} May 28 12:57:16 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-15e70fe6-810c-4a20-ae7e-55b62a56ffb2 None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f12d119bc9a46e9b391ca37a6d3847a', 'request_id': 'req-15e70fe6-810c-4a20-ae7e-55b62a56ffb2'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:16 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-15e70fe6-810c-4a20-ae7e-55b62a56ffb2 None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f12d119bc9a46e9b391ca37a6d3847a', 'request_id': 'req-15e70fe6-810c-4a20-ae7e-55b62a56ffb2'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:16 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-15e70fe6-810c-4a20-ae7e-55b62a56ffb2 None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f12d119bc9a46e9b391ca37a6d3847a', 'request_id': 'req-15e70fe6-810c-4a20-ae7e-55b62a56ffb2'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:16 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-15e70fe6-810c-4a20-ae7e-55b62a56ffb2 None admin] The token cache is being invalidate because project 1f12d119bc9a46e9b391ca37a6d3847a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 12:57:16 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-15e70fe6-810c-4a20-ae7e-55b62a56ffb2 None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:16 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-15e70fe6-810c-4a20-ae7e-55b62a56ffb2 None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:16 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 915/1854] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 12:57:16 2024] DELETE /identity/v3/projects/1f12d119bc9a46e9b391ca37a6d3847a => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:57:16 l75lg1-v1 neutron-server[77618]: DEBUG neutron.wsgi [-] (77618) accepted ('10.27.203.238', 58696) {{(pid=77618) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 12:57:16 l75lg1-v1 neutron-server[77618]: INFO neutron.wsgi [None req-d617e0d4-9b4a-444f-a896-fcacd1d99659 None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=1ae8e27013bc48228edf3022159a9c1f&name=default HTTP/1.1" status: 200 len: 216 time: 0.0086160 May 28 12:57:16 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a939925-ae24-4cec-8e35-1b58d9b5fcda service neutron] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:16 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a939925-ae24-4cec-8e35-1b58d9b5fcda service neutron] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:16 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381966bd-8fb7-49a9-b8de-b4bc5caaa03f None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:16 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381966bd-8fb7-49a9-b8de-b4bc5caaa03f None admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:16 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381966bd-8fb7-49a9-b8de-b4bc5caaa03f None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:16 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381966bd-8fb7-49a9-b8de-b4bc5caaa03f None admin] PATH_INFO: `/v3/projects/1ae8e27013bc48228edf3022159a9c1f` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:16 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381966bd-8fb7-49a9-b8de-b4bc5caaa03f None admin] RBAC: Authorizing `identity:delete_project(project_id=1ae8e27013bc48228edf3022159a9c1f)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:16 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381966bd-8fb7-49a9-b8de-b4bc5caaa03f None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:16 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-381966bd-8fb7-49a9-b8de-b4bc5caaa03f None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ae8e27013bc48228edf3022159a9c1f', 'request_id': 'req-381966bd-8fb7-49a9-b8de-b4bc5caaa03f'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:16 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-381966bd-8fb7-49a9-b8de-b4bc5caaa03f None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ae8e27013bc48228edf3022159a9c1f', 'request_id': 'req-381966bd-8fb7-49a9-b8de-b4bc5caaa03f'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:16 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-381966bd-8fb7-49a9-b8de-b4bc5caaa03f None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ae8e27013bc48228edf3022159a9c1f', 'request_id': 'req-381966bd-8fb7-49a9-b8de-b4bc5caaa03f'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:16 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-381966bd-8fb7-49a9-b8de-b4bc5caaa03f None admin] The token cache is being invalidate because project 1ae8e27013bc48228edf3022159a9c1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 12:57:16 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-381966bd-8fb7-49a9-b8de-b4bc5caaa03f None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:16 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-381966bd-8fb7-49a9-b8de-b4bc5caaa03f None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:16 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 940/1855] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 12:57:16 2024] DELETE /identity/v3/projects/1ae8e27013bc48228edf3022159a9c1f => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:57:16 l75lg1-v1 neutron-server[77618]: DEBUG neutron.wsgi [-] (77618) accepted ('10.27.203.238', 58712) {{(pid=77618) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 12:57:16 l75lg1-v1 neutron-server[77618]: INFO neutron.wsgi [None req-1ea56029-5f8b-4156-88e6-3f3adea6cb73 None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=b459b0ac20ef4f348e8ff53468c5c935&name=default HTTP/1.1" status: 200 len: 216 time: 0.0084808 May 28 12:57:16 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e70fe6-810c-4a20-ae7e-55b62a56ffb2 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:16 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-15e70fe6-810c-4a20-ae7e-55b62a56ffb2 None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:16 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e70fe6-810c-4a20-ae7e-55b62a56ffb2 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:16 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a19dcba-6095-459f-b407-fc6fc238c1b2 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:16 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a19dcba-6095-459f-b407-fc6fc238c1b2 None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:16 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a19dcba-6095-459f-b407-fc6fc238c1b2 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:16 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a19dcba-6095-459f-b407-fc6fc238c1b2 None admin] PATH_INFO: `/v3/projects/b459b0ac20ef4f348e8ff53468c5c935` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:16 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a19dcba-6095-459f-b407-fc6fc238c1b2 None admin] RBAC: Authorizing `identity:delete_project(project_id=b459b0ac20ef4f348e8ff53468c5c935)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:16 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a19dcba-6095-459f-b407-fc6fc238c1b2 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:16 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-3a19dcba-6095-459f-b407-fc6fc238c1b2 None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b459b0ac20ef4f348e8ff53468c5c935', 'request_id': 'req-3a19dcba-6095-459f-b407-fc6fc238c1b2'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:16 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-3a19dcba-6095-459f-b407-fc6fc238c1b2 None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b459b0ac20ef4f348e8ff53468c5c935', 'request_id': 'req-3a19dcba-6095-459f-b407-fc6fc238c1b2'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-3a19dcba-6095-459f-b407-fc6fc238c1b2 None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b459b0ac20ef4f348e8ff53468c5c935', 'request_id': 'req-3a19dcba-6095-459f-b407-fc6fc238c1b2'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-3a19dcba-6095-459f-b407-fc6fc238c1b2 None admin] The token cache is being invalidate because project b459b0ac20ef4f348e8ff53468c5c935 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-3a19dcba-6095-459f-b407-fc6fc238c1b2 None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-3a19dcba-6095-459f-b407-fc6fc238c1b2 None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 916/1856] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 12:57:16 2024] DELETE /identity/v3/projects/b459b0ac20ef4f348e8ff53468c5c935 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ea111d-26ef-46d8-a289-60fe4be5a5d1 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ea111d-26ef-46d8-a289-60fe4be5a5d1 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ea111d-26ef-46d8-a289-60fe4be5a5d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-77ea111d-26ef-46d8-a289-60fe4be5a5d1 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-77ea111d-26ef-46d8-a289-60fe4be5a5d1 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-77ea111d-26ef-46d8-a289-60fe4be5a5d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 941/1857] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:57:17 2024] POST /identity/v3/auth/tokens => generated 312 bytes in 19 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bb6465-e70d-4fa7-9830-48abe49de4e0 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bb6465-e70d-4fa7-9830-48abe49de4e0 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bb6465-e70d-4fa7-9830-48abe49de4e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-19bb6465-e70d-4fa7-9830-48abe49de4e0 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-19bb6465-e70d-4fa7-9830-48abe49de4e0 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-19bb6465-e70d-4fa7-9830-48abe49de4e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 917/1858] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:57:17 2024] POST /identity/v3/auth/tokens => generated 2960 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ea111d-26ef-46d8-a289-60fe4be5a5d1 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ea111d-26ef-46d8-a289-60fe4be5a5d1 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a095d62b-69a8-440c-b899-1523e428f4e6 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a095d62b-69a8-440c-b899-1523e428f4e6 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a095d62b-69a8-440c-b899-1523e428f4e6 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a095d62b-69a8-440c-b899-1523e428f4e6 None admin] PATH_INFO: `/v3/domains` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a095d62b-69a8-440c-b899-1523e428f4e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=51267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a095d62b-69a8-440c-b899-1523e428f4e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a095d62b-69a8-440c-b899-1523e428f4e6 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 942/1859] 10.27.203.238 () {62 vars in 1220 bytes} [Tue May 28 12:57:17 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bb6465-e70d-4fa7-9830-48abe49de4e0 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bb6465-e70d-4fa7-9830-48abe49de4e0 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d048358f-3c12-4272-8e23-56d0fa1a7ad9 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d048358f-3c12-4272-8e23-56d0fa1a7ad9 None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d048358f-3c12-4272-8e23-56d0fa1a7ad9 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d048358f-3c12-4272-8e23-56d0fa1a7ad9 None admin] PATH_INFO: `/v3/projects` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d048358f-3c12-4272-8e23-56d0fa1a7ad9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d048358f-3c12-4272-8e23-56d0fa1a7ad9 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 918/1860] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 12:57:17 2024] POST /identity/v3/projects => generated 407 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a095d62b-69a8-440c-b899-1523e428f4e6 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a095d62b-69a8-440c-b899-1523e428f4e6 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ca2604-3699-478d-a328-dd1e2b964e5a None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ca2604-3699-478d-a328-dd1e2b964e5a None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ca2604-3699-478d-a328-dd1e2b964e5a None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ca2604-3699-478d-a328-dd1e2b964e5a None admin] PATH_INFO: `/v3/users` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ca2604-3699-478d-a328-dd1e2b964e5a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ca2604-3699-478d-a328-dd1e2b964e5a None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-71ca2604-3699-478d-a328-dd1e2b964e5a None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 943/1861] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 12:57:17 2024] POST /identity/v3/users => generated 311 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d048358f-3c12-4272-8e23-56d0fa1a7ad9 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:17 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-01a2ae14-f15d-4183-924e-4ad9803a3801 tempest-ShareSnapshotInstancesTest-843694899 None] <<< [POST] https://127.0.0.1:40443/api/views/ May 28 12:57:17 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-01a2ae14-f15d-4183-924e-4ad9803a3801 tempest-ShareSnapshotInstancesTest-843694899 None] Bunch(abac_tags=[], abe_max_depth=None, abe_protocols=[], alias='', allow_anonymous_access=False, allow_s3_anonymous_access=False, auto_commit='0d', bucket='', bucket_creators=[], bucket_creators_groups=[], bucket_owner=None, bulk_permission_update_progress=None, bulk_permission_update_state=None, cluster='loop75-kfs', cluster_id=1, created='2024-05-28T12:57:16.816766Z', enabled=True, files_retention_mode='NONE', guid='1d767672-1b27-4da4-9f14-3046ea4263e8', id=13, ignore_oos=False, internal=False, is_remote=False, is_seamless=False, logical_capacity=0, max_retention_period=None, min_retention_period=None, name='c2f741cd-bac5-499f-9539-8e93d6a81282', nfs_interop_flags='BOTH_NFS3_AND_NFS4_INTEROP_DISABLED', path='/manila/manila-c2f741cd-bac5-499f-9539-8e93d6a81282', physical_capacity=0, policy='c2f741cd-bac5-499f-9539-8e93d6a81282', policy_id=14, protocols=['NFS'], qos_policy=None, qos_policy_id=None, s3_locks=False, s3_locks_retention_mode='NONE', s3_locks_retention_period='', s3_object_ownership_rule='ObjectWriter', s3_unverified_lookup=False, s3_versioning=False, select_for_live_monitoring=False, share='', share_acl=Bunch(acl=[], enabled=False), sync='SYNCED', sync_time='2024-05-28T12:57:17.153109Z', tenant_id=1, tenant_name='default', title='/manila/manila-c2f741cd-bac5-499f-9539-8e93d6a81282', url='https://127.0.0.1:40443/api/views/13/') May 28 12:57:17 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-01a2ae14-f15d-4183-924e-4ad9803a3801 tempest-ShareSnapshotInstancesTest-843694899 None] --- [POST] https://127.0.0.1:40443/api/views/: Done May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d048358f-3c12-4272-8e23-56d0fa1a7ad9 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83434b88-b384-4078-ae8a-d64c8943af7b None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83434b88-b384-4078-ae8a-d64c8943af7b None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83434b88-b384-4078-ae8a-d64c8943af7b None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83434b88-b384-4078-ae8a-d64c8943af7b None admin] PATH_INFO: `/v3/roles` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83434b88-b384-4078-ae8a-d64c8943af7b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83434b88-b384-4078-ae8a-d64c8943af7b None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 919/1862] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 12:57:17 2024] GET /identity/v3/roles => generated 1680 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ca2604-3699-478d-a328-dd1e2b964e5a None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:17 l75lg1-v1 dstat.sh[49771]: 28-05 12:57:17| 9 1 86 2 0|5679M 1818M 277M 7851M| 19k 5324B| 0 2102k| 0 286 |8014 14k|1.58 1.03 1.00|3.0 1.0 0| 0 0 | 0 2048M| 29 352 0 82 0 May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ca2604-3699-478d-a328-dd1e2b964e5a None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686ecff5-931b-466a-8015-7dab994d58c8 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686ecff5-931b-466a-8015-7dab994d58c8 None admin] REQUEST_METHOD: `PUT` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686ecff5-931b-466a-8015-7dab994d58c8 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686ecff5-931b-466a-8015-7dab994d58c8 None admin] PATH_INFO: `/v3/projects/64cd9e94eaa447f29cae5e44ae494de4/users/85d7f56c5fec4742a925123004bef348/roles/e7989893488f483baa107be56668c4f8` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:17 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-5e3899b9-b6e9-4441-8750-3d8495665a52 tempest-AdminActionsTest-1749172189 None] <<< [POST] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:57:17 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-5e3899b9-b6e9-4441-8750-3d8495665a52 tempest-AdminActionsTest-1749172189 None] Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=0, created='2024-05-28T12:57:16.761770Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='eef0d88b-92de-42e0-9816-91439c2589ed', id=16, internal=False, is_s3_default_policy=False, name='891641f2-366e-4b85-925e-8cffaa759ace', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=[], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['*'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['*'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T12:57:17.162490Z', tenant_id=1, tenant_name='default', title='891641f2-366e-4b85-925e-8cffaa759ace', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/16/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[]) May 28 12:57:17 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-5e3899b9-b6e9-4441-8750-3d8495665a52 tempest-AdminActionsTest-1749172189 None] --- [POST] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 12:57:17 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-5e3899b9-b6e9-4441-8750-3d8495665a52 tempest-AdminActionsTest-1749172189 None] >>> [GET] https://127.0.0.1:40443/api/quotas/ May 28 12:57:17 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-5e3899b9-b6e9-4441-8750-3d8495665a52 tempest-AdminActionsTest-1749172189 None] {'allow_redirects': True, May 28 12:57:17 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-5e3899b9-b6e9-4441-8750-3d8495665a52 tempest-AdminActionsTest-1749172189 None] 'params': {'name': '891641f2-366e-4b85-925e-8cffaa759ace'}} May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686ecff5-931b-466a-8015-7dab994d58c8 None admin] RBAC: Authorizing `identity:create_grant(project_id=64cd9e94eaa447f29cae5e44ae494de4, user_id=85d7f56c5fec4742a925123004bef348, role_id=e7989893488f483baa107be56668c4f8)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686ecff5-931b-466a-8015-7dab994d58c8 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:17 l75lg1-v1 manila-share[98474]: INFO manila.share.manager [None req-01a2ae14-f15d-4183-924e-4ad9803a3801 tempest-ShareSnapshotInstancesTest-843694899 None] Share instance c2f741cd-bac5-499f-9539-8e93d6a81282 created successfully. May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 944/1863] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 12:57:17 2024] PUT /identity/v3/projects/64cd9e94eaa447f29cae5e44ae494de4/users/85d7f56c5fec4742a925123004bef348/roles/e7989893488f483baa107be56668c4f8 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83434b88-b384-4078-ae8a-d64c8943af7b None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83434b88-b384-4078-ae8a-d64c8943af7b None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:17 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b5d0ddc5-db46-4239-8d97-cf384f7cf2d8 tempest-SharesActionsAdminTest-1286316336 None] <<< [POST] https://127.0.0.1:40443/api/quotas/ May 28 12:57:17 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b5d0ddc5-db46-4239-8d97-cf384f7cf2d8 tempest-SharesActionsAdminTest-1286316336 None] Bunch(cluster='loop75-kfs', cluster_id=1, default_email=None, default_group_quota=None, default_user_quota=None, enable_alarms=True, enable_email_providers=True, grace_period=None, group_quotas=[], guid='1daf21c1-9331-49c1-9cbb-b571e9a6c8d3', hard_limit=1073741824, hard_limit_inodes=None, id=12, internal=False, is_user_quota=False, last_user_quotas_update=None, name='7c19614c-d968-4489-b2ad-bd88c2ef8054', num_blocked_users=0, num_exceeded_users=0, path='/manila/manila-7c19614c-d968-4489-b2ad-bd88c2ef8054', percent_capacity=0, percent_inodes=None, pretty_grace_period=None, pretty_grace_period_expiration=None, pretty_state='OK (CREATED)', soft_limit=None, soft_limit_inodes=None, state='OK', sync_state='CREATED', system_id=12, tenant_id=1, tenant_name='default', time_to_block=None, title='7c19614c-d968-4489-b2ad-bd88c2ef8054', url='https://127.0.0.1:40443/api/quotas/12/', used_capacity=0, used_capacity_tb=0.0, used_effective_capacity=0, used_effective_capacity_tb=0.0, used_inodes=0, used_limited_capacity=0, user_quotas=[]) May 28 12:57:17 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b5d0ddc5-db46-4239-8d97-cf384f7cf2d8 tempest-SharesActionsAdminTest-1286316336 None] --- [POST] https://127.0.0.1:40443/api/quotas/: Done May 28 12:57:17 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b5d0ddc5-db46-4239-8d97-cf384f7cf2d8 tempest-SharesActionsAdminTest-1286316336 None] >>> [GET] https://127.0.0.1:40443/api/views/ May 28 12:57:17 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b5d0ddc5-db46-4239-8d97-cf384f7cf2d8 tempest-SharesActionsAdminTest-1286316336 None] {'allow_redirects': True, May 28 12:57:17 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b5d0ddc5-db46-4239-8d97-cf384f7cf2d8 tempest-SharesActionsAdminTest-1286316336 None] 'params': {'name': '7c19614c-d968-4489-b2ad-bd88c2ef8054'}} May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdad4cf-f4cf-4636-8663-7aae20d53295 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdad4cf-f4cf-4636-8663-7aae20d53295 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdad4cf-f4cf-4636-8663-7aae20d53295 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdad4cf-f4cf-4636-8663-7aae20d53295 None admin] PATH_INFO: `/v3/roles` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdad4cf-f4cf-4636-8663-7aae20d53295 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdad4cf-f4cf-4636-8663-7aae20d53295 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 920/1864] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 12:57:17 2024] GET /identity/v3/roles => generated 1680 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686ecff5-931b-466a-8015-7dab994d58c8 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686ecff5-931b-466a-8015-7dab994d58c8 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1932c5-803f-45de-87b0-b2091e7005fd None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1932c5-803f-45de-87b0-b2091e7005fd None admin] REQUEST_METHOD: `PUT` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1932c5-803f-45de-87b0-b2091e7005fd None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1932c5-803f-45de-87b0-b2091e7005fd None admin] PATH_INFO: `/v3/projects/64cd9e94eaa447f29cae5e44ae494de4/users/85d7f56c5fec4742a925123004bef348/roles/e7989893488f483baa107be56668c4f8` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1932c5-803f-45de-87b0-b2091e7005fd None admin] RBAC: Authorizing `identity:create_grant(project_id=64cd9e94eaa447f29cae5e44ae494de4, user_id=85d7f56c5fec4742a925123004bef348, role_id=e7989893488f483baa107be56668c4f8)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1932c5-803f-45de-87b0-b2091e7005fd None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 945/1865] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 12:57:17 2024] PUT /identity/v3/projects/64cd9e94eaa447f29cae5e44ae494de4/users/85d7f56c5fec4742a925123004bef348/roles/e7989893488f483baa107be56668c4f8 => generated 0 bytes in 19 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b841f3-501b-4637-85e5-354cbb88d5d5 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b841f3-501b-4637-85e5-354cbb88d5d5 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b841f3-501b-4637-85e5-354cbb88d5d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-18b841f3-501b-4637-85e5-354cbb88d5d5 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-18b841f3-501b-4637-85e5-354cbb88d5d5 None None] MFA Rules not processed for user `85d7f56c5fec4742a925123004bef348`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-18b841f3-501b-4637-85e5-354cbb88d5d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:17 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-09c99b06-311f-4391-aef9-2dd4b14e2793 tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] GET http://10.27.203.238/share/v2/fe54df7c653849ab8ec7523262c597cf/shares/7da650db-1124-40b5-ba52-fb1170c038c8 May 28 12:57:17 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-09c99b06-311f-4391-aef9-2dd4b14e2793 tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:17 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-09c99b06-311f-4391-aef9-2dd4b14e2793 tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 921/1866] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:57:17 2024] POST /identity/v3/auth/tokens => generated 4101 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:57:17 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-09c99b06-311f-4391-aef9-2dd4b14e2793 tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] http://10.27.203.238/share/v2/fe54df7c653849ab8ec7523262c597cf/shares/7da650db-1124-40b5-ba52-fb1170c038c8 returned with HTTP 200 May 28 12:57:17 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 301/618] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:57:17 2024] GET /share/v2/fe54df7c653849ab8ec7523262c597cf/shares/7da650db-1124-40b5-ba52-fb1170c038c8 => generated 1473 bytes in 24 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1932c5-803f-45de-87b0-b2091e7005fd None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1932c5-803f-45de-87b0-b2091e7005fd None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b183bb17-5713-4d91-8803-96cd82514863 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b183bb17-5713-4d91-8803-96cd82514863 None admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b183bb17-5713-4d91-8803-96cd82514863 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b183bb17-5713-4d91-8803-96cd82514863 None admin] PATH_INFO: `/v3/users/85d7f56c5fec4742a925123004bef348` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b183bb17-5713-4d91-8803-96cd82514863 None admin] RBAC: Authorizing `identity:delete_user(user_id=85d7f56c5fec4742a925123004bef348)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b183bb17-5713-4d91-8803-96cd82514863 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-b183bb17-5713-4d91-8803-96cd82514863 None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85d7f56c5fec4742a925123004bef348', 'request_id': 'req-b183bb17-5713-4d91-8803-96cd82514863'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-b183bb17-5713-4d91-8803-96cd82514863 None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85d7f56c5fec4742a925123004bef348', 'request_id': 'req-b183bb17-5713-4d91-8803-96cd82514863'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-b183bb17-5713-4d91-8803-96cd82514863 None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85d7f56c5fec4742a925123004bef348', 'request_id': 'req-b183bb17-5713-4d91-8803-96cd82514863'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-b183bb17-5713-4d91-8803-96cd82514863 None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85d7f56c5fec4742a925123004bef348', 'request_id': 'req-b183bb17-5713-4d91-8803-96cd82514863'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-b183bb17-5713-4d91-8803-96cd82514863 None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85d7f56c5fec4742a925123004bef348', 'request_id': 'req-b183bb17-5713-4d91-8803-96cd82514863'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 946/1867] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 12:57:17 2024] DELETE /identity/v3/users/85d7f56c5fec4742a925123004bef348 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a62d93-fb53-41ad-9f1a-bdf5cc26dd00 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a62d93-fb53-41ad-9f1a-bdf5cc26dd00 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a62d93-fb53-41ad-9f1a-bdf5cc26dd00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-12a62d93-fb53-41ad-9f1a-bdf5cc26dd00 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-12a62d93-fb53-41ad-9f1a-bdf5cc26dd00 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-12a62d93-fb53-41ad-9f1a-bdf5cc26dd00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 922/1868] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:57:17 2024] POST /identity/v3/auth/tokens => generated 2960 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 12:57:17 l75lg1-v1 neutron-server[77619]: DEBUG neutron.wsgi [-] (77619) accepted ('10.27.203.238', 58720) {{(pid=77619) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b183bb17-5713-4d91-8803-96cd82514863 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-b183bb17-5713-4d91-8803-96cd82514863 None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:17 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d4e94067-7ef0-44e3-b09c-a394b3b4dcd1 tempest-AccessesMetadataNegativeTest-1660907003 None] <<< [POST] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:57:17 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d4e94067-7ef0-44e3-b09c-a394b3b4dcd1 tempest-AccessesMetadataNegativeTest-1660907003 None] Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=0, created='2024-05-28T12:57:17.272743Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='a438200f-35fa-44b5-a39f-2a7af61c13bd', id=17, internal=False, is_s3_default_policy=False, name='113739f1-d41a-4f4e-b63f-071e2ecd0a7b', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=[], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['*'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['*'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T12:57:17.574439Z', tenant_id=1, tenant_name='default', title='113739f1-d41a-4f4e-b63f-071e2ecd0a7b', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/17/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[]) May 28 12:57:17 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d4e94067-7ef0-44e3-b09c-a394b3b4dcd1 tempest-AccessesMetadataNegativeTest-1660907003 None] --- [POST] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 12:57:17 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d4e94067-7ef0-44e3-b09c-a394b3b4dcd1 tempest-AccessesMetadataNegativeTest-1660907003 None] >>> [GET] https://127.0.0.1:40443/api/quotas/ May 28 12:57:17 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d4e94067-7ef0-44e3-b09c-a394b3b4dcd1 tempest-AccessesMetadataNegativeTest-1660907003 None] {'allow_redirects': True, May 28 12:57:17 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d4e94067-7ef0-44e3-b09c-a394b3b4dcd1 tempest-AccessesMetadataNegativeTest-1660907003 None] 'params': {'name': '113739f1-d41a-4f4e-b63f-071e2ecd0a7b'}} May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b183bb17-5713-4d91-8803-96cd82514863 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e413770b-5893-47cb-896d-c3b282b0aa36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef17047035e4b518fd5360a01f2da1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e413770b-5893-47cb-896d-c3b282b0aa36 service neutron] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e413770b-5893-47cb-896d-c3b282b0aa36 service neutron] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e413770b-5893-47cb-896d-c3b282b0aa36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e413770b-5893-47cb-896d-c3b282b0aa36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e413770b-5893-47cb-896d-c3b282b0aa36 service neutron] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 947/1869] 10.27.203.238 () {64 vars in 1432 bytes} [Tue May 28 12:57:17 2024] GET /identity/v3/auth/tokens => generated 2960 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 28 12:57:17 l75lg1-v1 neutron-server[77619]: INFO neutron.wsgi [None req-696a823d-17b7-4280-b148-4c12cede40bd None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=64cd9e94eaa447f29cae5e44ae494de4&name=default HTTP/1.1" status: 200 len: 216 time: 0.0736086 May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a62d93-fb53-41ad-9f1a-bdf5cc26dd00 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-12a62d93-fb53-41ad-9f1a-bdf5cc26dd00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a62d93-fb53-41ad-9f1a-bdf5cc26dd00 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e2083a-bbc3-4f2e-a518-88c182ad19df None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e2083a-bbc3-4f2e-a518-88c182ad19df None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e2083a-bbc3-4f2e-a518-88c182ad19df None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e2083a-bbc3-4f2e-a518-88c182ad19df None admin] PATH_INFO: `/v3/projects/64cd9e94eaa447f29cae5e44ae494de4` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e2083a-bbc3-4f2e-a518-88c182ad19df None admin] RBAC: Authorizing `identity:delete_project(project_id=64cd9e94eaa447f29cae5e44ae494de4)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e2083a-bbc3-4f2e-a518-88c182ad19df None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-97e2083a-bbc3-4f2e-a518-88c182ad19df None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64cd9e94eaa447f29cae5e44ae494de4', 'request_id': 'req-97e2083a-bbc3-4f2e-a518-88c182ad19df'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-97e2083a-bbc3-4f2e-a518-88c182ad19df None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64cd9e94eaa447f29cae5e44ae494de4', 'request_id': 'req-97e2083a-bbc3-4f2e-a518-88c182ad19df'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-97e2083a-bbc3-4f2e-a518-88c182ad19df None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64cd9e94eaa447f29cae5e44ae494de4', 'request_id': 'req-97e2083a-bbc3-4f2e-a518-88c182ad19df'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-97e2083a-bbc3-4f2e-a518-88c182ad19df None admin] The token cache is being invalidate because project 64cd9e94eaa447f29cae5e44ae494de4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-97e2083a-bbc3-4f2e-a518-88c182ad19df None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-97e2083a-bbc3-4f2e-a518-88c182ad19df None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 923/1870] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 12:57:17 2024] DELETE /identity/v3/projects/64cd9e94eaa447f29cae5e44ae494de4 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e868fb5c-97e6-4464-943f-258087e2c17d None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e868fb5c-97e6-4464-943f-258087e2c17d None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e868fb5c-97e6-4464-943f-258087e2c17d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-e868fb5c-97e6-4464-943f-258087e2c17d None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-e868fb5c-97e6-4464-943f-258087e2c17d None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-e868fb5c-97e6-4464-943f-258087e2c17d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 948/1871] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:57:17 2024] POST /identity/v3/auth/tokens => generated 312 bytes in 18 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5716a0-3bf8-4fa7-b466-c4485ffddf2c None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5716a0-3bf8-4fa7-b466-c4485ffddf2c None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5716a0-3bf8-4fa7-b466-c4485ffddf2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:17 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-5e3899b9-b6e9-4441-8750-3d8495665a52 tempest-AdminActionsTest-1749172189 None] <<< [GET] https://127.0.0.1:40443/api/quotas/ May 28 12:57:17 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-5e3899b9-b6e9-4441-8750-3d8495665a52 tempest-AdminActionsTest-1749172189 None] [] May 28 12:57:17 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-5e3899b9-b6e9-4441-8750-3d8495665a52 tempest-AdminActionsTest-1749172189 None] --- [GET] https://127.0.0.1:40443/api/quotas/: Done May 28 12:57:17 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-5e3899b9-b6e9-4441-8750-3d8495665a52 tempest-AdminActionsTest-1749172189 None] >>> [POST] https://127.0.0.1:40443/api/quotas/ May 28 12:57:17 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-5e3899b9-b6e9-4441-8750-3d8495665a52 tempest-AdminActionsTest-1749172189 None] {'data': '{"name": "891641f2-366e-4b85-925e-8cffaa759ace", "path": ' May 28 12:57:17 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-5e3899b9-b6e9-4441-8750-3d8495665a52 tempest-AdminActionsTest-1749172189 None] '"/manila/manila-891641f2-366e-4b85-925e-8cffaa759ace", "create_dir": ' May 28 12:57:17 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-5e3899b9-b6e9-4441-8750-3d8495665a52 tempest-AdminActionsTest-1749172189 None] 'true, "hard_limit": 1073741824}', May 28 12:57:17 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-5e3899b9-b6e9-4441-8750-3d8495665a52 tempest-AdminActionsTest-1749172189 None] 'json': None, May 28 12:57:17 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-5e3899b9-b6e9-4441-8750-3d8495665a52 tempest-AdminActionsTest-1749172189 None] 'params': None} May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-1f5716a0-3bf8-4fa7-b466-c4485ffddf2c None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-1f5716a0-3bf8-4fa7-b466-c4485ffddf2c None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-1f5716a0-3bf8-4fa7-b466-c4485ffddf2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 924/1872] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:57:17 2024] POST /identity/v3/auth/tokens => generated 2960 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e868fb5c-97e6-4464-943f-258087e2c17d None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e868fb5c-97e6-4464-943f-258087e2c17d None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fab621e-1458-4002-8656-980498124f3f None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fab621e-1458-4002-8656-980498124f3f None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fab621e-1458-4002-8656-980498124f3f None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fab621e-1458-4002-8656-980498124f3f None admin] PATH_INFO: `/v3/domains` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fab621e-1458-4002-8656-980498124f3f None admin] RBAC: Adding query filter params (name=Default) {{(pid=51267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fab621e-1458-4002-8656-980498124f3f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fab621e-1458-4002-8656-980498124f3f None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 949/1873] 10.27.203.238 () {62 vars in 1220 bytes} [Tue May 28 12:57:17 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5716a0-3bf8-4fa7-b466-c4485ffddf2c None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5716a0-3bf8-4fa7-b466-c4485ffddf2c None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7330e29-6f9a-4555-b51b-6e3bd30cd895 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7330e29-6f9a-4555-b51b-6e3bd30cd895 None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7330e29-6f9a-4555-b51b-6e3bd30cd895 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7330e29-6f9a-4555-b51b-6e3bd30cd895 None admin] PATH_INFO: `/v3/projects` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7330e29-6f9a-4555-b51b-6e3bd30cd895 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7330e29-6f9a-4555-b51b-6e3bd30cd895 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 925/1874] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 12:57:17 2024] POST /identity/v3/projects => generated 397 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fab621e-1458-4002-8656-980498124f3f None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fab621e-1458-4002-8656-980498124f3f None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0beab43-cf67-4d33-9d4e-1e872b17e309 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0beab43-cf67-4d33-9d4e-1e872b17e309 None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0beab43-cf67-4d33-9d4e-1e872b17e309 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0beab43-cf67-4d33-9d4e-1e872b17e309 None admin] PATH_INFO: `/v3/users` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0beab43-cf67-4d33-9d4e-1e872b17e309 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0beab43-cf67-4d33-9d4e-1e872b17e309 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-b0beab43-cf67-4d33-9d4e-1e872b17e309 None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 12:57:17 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d4e94067-7ef0-44e3-b09c-a394b3b4dcd1 tempest-AccessesMetadataNegativeTest-1660907003 None] <<< [GET] https://127.0.0.1:40443/api/quotas/ May 28 12:57:17 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d4e94067-7ef0-44e3-b09c-a394b3b4dcd1 tempest-AccessesMetadataNegativeTest-1660907003 None] [] May 28 12:57:17 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d4e94067-7ef0-44e3-b09c-a394b3b4dcd1 tempest-AccessesMetadataNegativeTest-1660907003 None] --- [GET] https://127.0.0.1:40443/api/quotas/: Done May 28 12:57:17 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d4e94067-7ef0-44e3-b09c-a394b3b4dcd1 tempest-AccessesMetadataNegativeTest-1660907003 None] >>> [POST] https://127.0.0.1:40443/api/quotas/ May 28 12:57:17 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d4e94067-7ef0-44e3-b09c-a394b3b4dcd1 tempest-AccessesMetadataNegativeTest-1660907003 None] {'data': '{"name": "113739f1-d41a-4f4e-b63f-071e2ecd0a7b", "path": ' May 28 12:57:17 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d4e94067-7ef0-44e3-b09c-a394b3b4dcd1 tempest-AccessesMetadataNegativeTest-1660907003 None] '"/manila/manila-113739f1-d41a-4f4e-b63f-071e2ecd0a7b", "create_dir": ' May 28 12:57:17 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d4e94067-7ef0-44e3-b09c-a394b3b4dcd1 tempest-AccessesMetadataNegativeTest-1660907003 None] 'true, "hard_limit": 1073741824}', May 28 12:57:17 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d4e94067-7ef0-44e3-b09c-a394b3b4dcd1 tempest-AccessesMetadataNegativeTest-1660907003 None] 'json': None, May 28 12:57:17 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d4e94067-7ef0-44e3-b09c-a394b3b4dcd1 tempest-AccessesMetadataNegativeTest-1660907003 None] 'params': None} May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 950/1875] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 12:57:17 2024] POST /identity/v3/users => generated 307 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7330e29-6f9a-4555-b51b-6e3bd30cd895 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7330e29-6f9a-4555-b51b-6e3bd30cd895 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e83ecd-cd9c-4265-aaae-2f49e367506d None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e83ecd-cd9c-4265-aaae-2f49e367506d None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e83ecd-cd9c-4265-aaae-2f49e367506d None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e83ecd-cd9c-4265-aaae-2f49e367506d None admin] PATH_INFO: `/v3/roles` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e83ecd-cd9c-4265-aaae-2f49e367506d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e83ecd-cd9c-4265-aaae-2f49e367506d None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 926/1876] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 12:57:17 2024] GET /identity/v3/roles => generated 1680 bytes in 16 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0beab43-cf67-4d33-9d4e-1e872b17e309 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0beab43-cf67-4d33-9d4e-1e872b17e309 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7ad4e1-ca9b-4761-a32f-0a5892b54b3e None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7ad4e1-ca9b-4761-a32f-0a5892b54b3e None admin] REQUEST_METHOD: `PUT` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7ad4e1-ca9b-4761-a32f-0a5892b54b3e None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7ad4e1-ca9b-4761-a32f-0a5892b54b3e None admin] PATH_INFO: `/v3/projects/6a56a0744f37473dbbd43f0a3a99c191/users/c30c25ccc04e4f9a8ee300ac75fd1241/roles/44620cad10ae407c90c91e2c296adb04` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7ad4e1-ca9b-4761-a32f-0a5892b54b3e None admin] RBAC: Authorizing `identity:create_grant(project_id=6a56a0744f37473dbbd43f0a3a99c191, user_id=c30c25ccc04e4f9a8ee300ac75fd1241, role_id=44620cad10ae407c90c91e2c296adb04)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7ad4e1-ca9b-4761-a32f-0a5892b54b3e None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:18 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 951/1877] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 12:57:17 2024] PUT /identity/v3/projects/6a56a0744f37473dbbd43f0a3a99c191/users/c30c25ccc04e4f9a8ee300ac75fd1241/roles/44620cad10ae407c90c91e2c296adb04 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:57:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fb627e-1883-4413-bb36-8fc1ea9d8d1d None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fb627e-1883-4413-bb36-8fc1ea9d8d1d None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fb627e-1883-4413-bb36-8fc1ea9d8d1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:18 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-99fb627e-1883-4413-bb36-8fc1ea9d8d1d None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:57:18 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b5d0ddc5-db46-4239-8d97-cf384f7cf2d8 tempest-SharesActionsAdminTest-1286316336 None] <<< [GET] https://127.0.0.1:40443/api/views/ May 28 12:57:18 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b5d0ddc5-db46-4239-8d97-cf384f7cf2d8 tempest-SharesActionsAdminTest-1286316336 None] [] May 28 12:57:18 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b5d0ddc5-db46-4239-8d97-cf384f7cf2d8 tempest-SharesActionsAdminTest-1286316336 None] --- [GET] https://127.0.0.1:40443/api/views/: Done May 28 12:57:18 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b5d0ddc5-db46-4239-8d97-cf384f7cf2d8 tempest-SharesActionsAdminTest-1286316336 None] >>> [POST] https://127.0.0.1:40443/api/views/ May 28 12:57:18 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b5d0ddc5-db46-4239-8d97-cf384f7cf2d8 tempest-SharesActionsAdminTest-1286316336 None] {'data': '{"name": "7c19614c-d968-4489-b2ad-bd88c2ef8054", "path": ' May 28 12:57:18 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b5d0ddc5-db46-4239-8d97-cf384f7cf2d8 tempest-SharesActionsAdminTest-1286316336 None] '"/manila/manila-7c19614c-d968-4489-b2ad-bd88c2ef8054", "policy_id": ' May 28 12:57:18 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b5d0ddc5-db46-4239-8d97-cf384f7cf2d8 tempest-SharesActionsAdminTest-1286316336 None] '15, "create_dir": true, "protocols": ["NFS"]}', May 28 12:57:18 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b5d0ddc5-db46-4239-8d97-cf384f7cf2d8 tempest-SharesActionsAdminTest-1286316336 None] 'json': None, May 28 12:57:18 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b5d0ddc5-db46-4239-8d97-cf384f7cf2d8 tempest-SharesActionsAdminTest-1286316336 None] 'params': None} May 28 12:57:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-99fb627e-1883-4413-bb36-8fc1ea9d8d1d None None] MFA Rules not processed for user `c30c25ccc04e4f9a8ee300ac75fd1241`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:57:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-99fb627e-1883-4413-bb36-8fc1ea9d8d1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:18 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 927/1878] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:57:18 2024] POST /identity/v3/auth/tokens => generated 3968 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:57:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7ad4e1-ca9b-4761-a32f-0a5892b54b3e None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-ca7ad4e1-ca9b-4761-a32f-0a5892b54b3e None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7ad4e1-ca9b-4761-a32f-0a5892b54b3e None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ebf322-97c2-4cb0-99cf-5d6c73e429d1 service manila] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f110cf6300f049c897d0aab63218d1e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ebf322-97c2-4cb0-99cf-5d6c73e429d1 service manila] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ebf322-97c2-4cb0-99cf-5d6c73e429d1 service manila] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ebf322-97c2-4cb0-99cf-5d6c73e429d1 service manila] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ebf322-97c2-4cb0-99cf-5d6c73e429d1 service manila] RBAC: Authorizing `identity:validate_token()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ebf322-97c2-4cb0-99cf-5d6c73e429d1 service manila] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:18 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 952/1879] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 12:57:18 2024] GET /identity/v3/auth/tokens => generated 3968 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 12:57:18 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-53775efa-0249-4adf-a7a3-bda82cf9a669 tempest-AvailabilityZonesNegativeTest-1115727887 tempest-AvailabilityZonesNegativeTest-1115727887-project-member] GET http://10.27.203.238/share/v2/6a56a0744f37473dbbd43f0a3a99c191/availability-zones May 28 12:57:18 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-53775efa-0249-4adf-a7a3-bda82cf9a669 tempest-AvailabilityZonesNegativeTest-1115727887 tempest-AvailabilityZonesNegativeTest-1115727887-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:18 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-53775efa-0249-4adf-a7a3-bda82cf9a669 tempest-AvailabilityZonesNegativeTest-1115727887 tempest-AvailabilityZonesNegativeTest-1115727887-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:18 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-53775efa-0249-4adf-a7a3-bda82cf9a669 tempest-AvailabilityZonesNegativeTest-1115727887 tempest-AvailabilityZonesNegativeTest-1115727887-project-member] http://10.27.203.238/share/v2/6a56a0744f37473dbbd43f0a3a99c191/availability-zones returned with HTTP 404 May 28 12:57:18 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 318/619] 10.27.203.238 () {64 vars in 1375 bytes} [Tue May 28 12:57:18 2024] GET /share/v2/6a56a0744f37473dbbd43f0a3a99c191/availability-zones => generated 78 bytes in 67 msecs (HTTP/1.1 404) 6 headers in 236 bytes (1 switches on core 0) May 28 12:57:18 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-c203caa5-716c-422d-8ba2-93bcc1b9fb5e tempest-AvailabilityZonesNegativeTest-1115727887 tempest-AvailabilityZonesNegativeTest-1115727887-project-member] GET http://10.27.203.238/share/v2/6a56a0744f37473dbbd43f0a3a99c191/os-availability-zone May 28 12:57:18 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-c203caa5-716c-422d-8ba2-93bcc1b9fb5e tempest-AvailabilityZonesNegativeTest-1115727887 tempest-AvailabilityZonesNegativeTest-1115727887-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:18 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-c203caa5-716c-422d-8ba2-93bcc1b9fb5e tempest-AvailabilityZonesNegativeTest-1115727887 tempest-AvailabilityZonesNegativeTest-1115727887-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:18 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-c203caa5-716c-422d-8ba2-93bcc1b9fb5e tempest-AvailabilityZonesNegativeTest-1115727887 tempest-AvailabilityZonesNegativeTest-1115727887-project-member] http://10.27.203.238/share/v2/6a56a0744f37473dbbd43f0a3a99c191/os-availability-zone returned with HTTP 404 May 28 12:57:18 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 302/620] 10.27.203.238 () {64 vars in 1381 bytes} [Tue May 28 12:57:18 2024] GET /share/v2/6a56a0744f37473dbbd43f0a3a99c191/os-availability-zone => generated 78 bytes in 5 msecs (HTTP/1.1 404) 6 headers in 236 bytes (1 switches on core 0) May 28 12:57:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fb627e-1883-4413-bb36-8fc1ea9d8d1d None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fb627e-1883-4413-bb36-8fc1ea9d8d1d None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cd11b3-5b45-434f-aa9a-749730c17c02 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cd11b3-5b45-434f-aa9a-749730c17c02 None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cd11b3-5b45-434f-aa9a-749730c17c02 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cd11b3-5b45-434f-aa9a-749730c17c02 None admin] PATH_INFO: `/v3/users/c30c25ccc04e4f9a8ee300ac75fd1241` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cd11b3-5b45-434f-aa9a-749730c17c02 None admin] RBAC: Authorizing `identity:delete_user(user_id=c30c25ccc04e4f9a8ee300ac75fd1241)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cd11b3-5b45-434f-aa9a-749730c17c02 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:18 l75lg1-v1 dstat.sh[49771]: 28-05 12:57:18| 10 1 85 2 0|5681M 1816M 277M 7852M| 26k 8202B| 0 1921k| 0 227 |8031 13k|1.58 1.03 1.00|1.0 2.0 2.0| 0 0 | 0 2048M| 29 352 0 83 0 May 28 12:57:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-e3cd11b3-5b45-434f-aa9a-749730c17c02 None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c30c25ccc04e4f9a8ee300ac75fd1241', 'request_id': 'req-e3cd11b3-5b45-434f-aa9a-749730c17c02'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-e3cd11b3-5b45-434f-aa9a-749730c17c02 None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c30c25ccc04e4f9a8ee300ac75fd1241', 'request_id': 'req-e3cd11b3-5b45-434f-aa9a-749730c17c02'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-e3cd11b3-5b45-434f-aa9a-749730c17c02 None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c30c25ccc04e4f9a8ee300ac75fd1241', 'request_id': 'req-e3cd11b3-5b45-434f-aa9a-749730c17c02'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-e3cd11b3-5b45-434f-aa9a-749730c17c02 None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c30c25ccc04e4f9a8ee300ac75fd1241', 'request_id': 'req-e3cd11b3-5b45-434f-aa9a-749730c17c02'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-e3cd11b3-5b45-434f-aa9a-749730c17c02 None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c30c25ccc04e4f9a8ee300ac75fd1241', 'request_id': 'req-e3cd11b3-5b45-434f-aa9a-749730c17c02'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:18 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 928/1880] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 12:57:18 2024] DELETE /identity/v3/users/c30c25ccc04e4f9a8ee300ac75fd1241 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:57:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0407926f-982a-44aa-8826-8ab24033889d None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0407926f-982a-44aa-8826-8ab24033889d None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0407926f-982a-44aa-8826-8ab24033889d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:18 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-0407926f-982a-44aa-8826-8ab24033889d None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:57:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-0407926f-982a-44aa-8826-8ab24033889d None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:57:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-0407926f-982a-44aa-8826-8ab24033889d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:18 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 953/1881] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:57:18 2024] POST /identity/v3/auth/tokens => generated 2960 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 12:57:18 l75lg1-v1 neutron-server[77619]: DEBUG neutron.wsgi [-] (77619) accepted ('10.27.203.238', 58722) {{(pid=77619) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 12:57:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cd11b3-5b45-434f-aa9a-749730c17c02 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-e3cd11b3-5b45-434f-aa9a-749730c17c02 None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:18 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-ab73a8bc-79d6-4e4d-8482-82ecf4bc1729 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] GET http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/shares/c5d9b059-bdd0-4fae-9bd0-328d926e5694 May 28 12:57:18 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-ab73a8bc-79d6-4e4d-8482-82ecf4bc1729 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:18 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-ab73a8bc-79d6-4e4d-8482-82ecf4bc1729 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cd11b3-5b45-434f-aa9a-749730c17c02 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13579d8-cb4d-413f-8f25-fff63d4013c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef17047035e4b518fd5360a01f2da1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13579d8-cb4d-413f-8f25-fff63d4013c1 service neutron] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13579d8-cb4d-413f-8f25-fff63d4013c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13579d8-cb4d-413f-8f25-fff63d4013c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13579d8-cb4d-413f-8f25-fff63d4013c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13579d8-cb4d-413f-8f25-fff63d4013c1 service neutron] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:18 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 929/1882] 10.27.203.238 () {64 vars in 1432 bytes} [Tue May 28 12:57:18 2024] GET /identity/v3/auth/tokens => generated 2960 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 28 12:57:18 l75lg1-v1 neutron-server[77619]: INFO neutron.wsgi [None req-7cb70016-884a-4bfc-beb0-f8672a976f98 None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=6a56a0744f37473dbbd43f0a3a99c191&name=default HTTP/1.1" status: 200 len: 216 time: 0.0713332 May 28 12:57:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0407926f-982a-44aa-8826-8ab24033889d None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-0407926f-982a-44aa-8826-8ab24033889d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0407926f-982a-44aa-8826-8ab24033889d None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:18 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-ab73a8bc-79d6-4e4d-8482-82ecf4bc1729 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/shares/c5d9b059-bdd0-4fae-9bd0-328d926e5694 returned with HTTP 200 May 28 12:57:18 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 319/621] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:57:18 2024] GET /share/v2/a3499cb78849424db45e54caac01de92/shares/c5d9b059-bdd0-4fae-9bd0-328d926e5694 => generated 1369 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:57:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b25b6c-477e-4545-bf4d-44ceb2179cd4 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b25b6c-477e-4545-bf4d-44ceb2179cd4 None admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b25b6c-477e-4545-bf4d-44ceb2179cd4 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b25b6c-477e-4545-bf4d-44ceb2179cd4 None admin] PATH_INFO: `/v3/projects/6a56a0744f37473dbbd43f0a3a99c191` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b25b6c-477e-4545-bf4d-44ceb2179cd4 None admin] RBAC: Authorizing `identity:delete_project(project_id=6a56a0744f37473dbbd43f0a3a99c191)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b25b6c-477e-4545-bf4d-44ceb2179cd4 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-d6b25b6c-477e-4545-bf4d-44ceb2179cd4 None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a56a0744f37473dbbd43f0a3a99c191', 'request_id': 'req-d6b25b6c-477e-4545-bf4d-44ceb2179cd4'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-d6b25b6c-477e-4545-bf4d-44ceb2179cd4 None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a56a0744f37473dbbd43f0a3a99c191', 'request_id': 'req-d6b25b6c-477e-4545-bf4d-44ceb2179cd4'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-d6b25b6c-477e-4545-bf4d-44ceb2179cd4 None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a56a0744f37473dbbd43f0a3a99c191', 'request_id': 'req-d6b25b6c-477e-4545-bf4d-44ceb2179cd4'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:18 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-5e3899b9-b6e9-4441-8750-3d8495665a52 tempest-AdminActionsTest-1749172189 None] <<< [POST] https://127.0.0.1:40443/api/quotas/ May 28 12:57:18 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-5e3899b9-b6e9-4441-8750-3d8495665a52 tempest-AdminActionsTest-1749172189 None] Bunch(cluster='loop75-kfs', cluster_id=1, default_email=None, default_group_quota=None, default_user_quota=None, enable_alarms=True, enable_email_providers=True, grace_period=None, group_quotas=[], guid='07d541a7-ad7f-420e-9fef-16e0838b6c7b', hard_limit=1073741824, hard_limit_inodes=None, id=13, internal=False, is_user_quota=False, last_user_quotas_update=None, name='891641f2-366e-4b85-925e-8cffaa759ace', num_blocked_users=0, num_exceeded_users=0, path='/manila/manila-891641f2-366e-4b85-925e-8cffaa759ace', percent_capacity=0, percent_inodes=None, pretty_grace_period=None, pretty_grace_period_expiration=None, pretty_state='OK (CREATED)', soft_limit=None, soft_limit_inodes=None, state='OK', sync_state='CREATED', system_id=13, tenant_id=1, tenant_name='default', time_to_block=None, title='891641f2-366e-4b85-925e-8cffaa759ace', url='https://127.0.0.1:40443/api/quotas/13/', used_capacity=0, used_capacity_tb=0.0, used_effective_capacity=0, used_effective_capacity_tb=0.0, used_inodes=0, used_limited_capacity=0, user_quotas=[]) May 28 12:57:18 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-4d028f81-72c1-4f26-b6c3-97fc40c6a5a2 tempest-ShareSnapshotInstancesTest-843694899 tempest-ShareSnapshotInstancesTest-843694899-project-admin] GET http://10.27.203.238/share/v2/f4f7702aa04c467288cc6b142f61ec37/shares/b235c40f-7437-4e0c-b44e-321d8e8b1457 May 28 12:57:18 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-4d028f81-72c1-4f26-b6c3-97fc40c6a5a2 tempest-ShareSnapshotInstancesTest-843694899 tempest-ShareSnapshotInstancesTest-843694899-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:18 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-4d028f81-72c1-4f26-b6c3-97fc40c6a5a2 tempest-ShareSnapshotInstancesTest-843694899 tempest-ShareSnapshotInstancesTest-843694899-project-admin] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:18 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-5e3899b9-b6e9-4441-8750-3d8495665a52 tempest-AdminActionsTest-1749172189 None] --- [POST] https://127.0.0.1:40443/api/quotas/: Done May 28 12:57:18 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-5e3899b9-b6e9-4441-8750-3d8495665a52 tempest-AdminActionsTest-1749172189 None] >>> [GET] https://127.0.0.1:40443/api/views/ May 28 12:57:18 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-5e3899b9-b6e9-4441-8750-3d8495665a52 tempest-AdminActionsTest-1749172189 None] {'allow_redirects': True, May 28 12:57:18 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-5e3899b9-b6e9-4441-8750-3d8495665a52 tempest-AdminActionsTest-1749172189 None] 'params': {'name': '891641f2-366e-4b85-925e-8cffaa759ace'}} May 28 12:57:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-d6b25b6c-477e-4545-bf4d-44ceb2179cd4 None admin] The token cache is being invalidate because project 6a56a0744f37473dbbd43f0a3a99c191 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 12:57:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-d6b25b6c-477e-4545-bf4d-44ceb2179cd4 None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-d6b25b6c-477e-4545-bf4d-44ceb2179cd4 None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:18 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 954/1883] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 12:57:18 2024] DELETE /identity/v3/projects/6a56a0744f37473dbbd43f0a3a99c191 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:57:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130e8bef-0379-4647-861f-00bd22a63501 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130e8bef-0379-4647-861f-00bd22a63501 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130e8bef-0379-4647-861f-00bd22a63501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:18 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-4d028f81-72c1-4f26-b6c3-97fc40c6a5a2 tempest-ShareSnapshotInstancesTest-843694899 tempest-ShareSnapshotInstancesTest-843694899-project-admin] http://10.27.203.238/share/v2/f4f7702aa04c467288cc6b142f61ec37/shares/b235c40f-7437-4e0c-b44e-321d8e8b1457 returned with HTTP 200 May 28 12:57:18 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 303/622] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:57:18 2024] GET /share/v2/f4f7702aa04c467288cc6b142f61ec37/shares/b235c40f-7437-4e0c-b44e-321d8e8b1457 => generated 1373 bytes in 26 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:57:18 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-130e8bef-0379-4647-861f-00bd22a63501 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:57:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-130e8bef-0379-4647-861f-00bd22a63501 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:57:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-130e8bef-0379-4647-861f-00bd22a63501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:18 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-262aea2e-7992-48e6-864e-791f2d9cbf82 tempest-ShareSnapshotInstancesTest-843694899 tempest-ShareSnapshotInstancesTest-843694899-project-admin] POST http://10.27.203.238/share/v2/f4f7702aa04c467288cc6b142f61ec37/snapshots May 28 12:57:18 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 930/1884] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:57:18 2024] POST /identity/v3/auth/tokens => generated 312 bytes in 20 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 28 12:57:18 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-262aea2e-7992-48e6-864e-791f2d9cbf82 tempest-ShareSnapshotInstancesTest-843694899 tempest-ShareSnapshotInstancesTest-843694899-project-admin] Action: 'create', calling method: ShareSnapshotMixin.create, body: {"snapshot": {"name": "tempest-tempest-created-share-snap-996481061", "force": false, "description": "Tempest's snapshot", "share_id": "b235c40f-7437-4e0c-b44e-321d8e8b1457"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:57:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73245ea7-793d-4050-8b13-118b1c07d237 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73245ea7-793d-4050-8b13-118b1c07d237 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73245ea7-793d-4050-8b13-118b1c07d237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:18 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-73245ea7-793d-4050-8b13-118b1c07d237 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:57:18 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.v1.share_snapshots [None req-262aea2e-7992-48e6-864e-791f2d9cbf82 tempest-ShareSnapshotInstancesTest-843694899 tempest-ShareSnapshotInstancesTest-843694899-project-admin] Create snapshot from share b235c40f-7437-4e0c-b44e-321d8e8b1457 May 28 12:57:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-73245ea7-793d-4050-8b13-118b1c07d237 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:57:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-73245ea7-793d-4050-8b13-118b1c07d237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:18 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 955/1885] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:57:18 2024] POST /identity/v3/auth/tokens => generated 2960 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 12:57:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130e8bef-0379-4647-861f-00bd22a63501 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130e8bef-0379-4647-861f-00bd22a63501 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3958bc21-f502-4509-b81c-e2b8c9d035c2 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3958bc21-f502-4509-b81c-e2b8c9d035c2 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3958bc21-f502-4509-b81c-e2b8c9d035c2 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3958bc21-f502-4509-b81c-e2b8c9d035c2 None admin] PATH_INFO: `/v3/domains` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3958bc21-f502-4509-b81c-e2b8c9d035c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:57:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3958bc21-f502-4509-b81c-e2b8c9d035c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3958bc21-f502-4509-b81c-e2b8c9d035c2 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:18 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 931/1886] 10.27.203.238 () {62 vars in 1220 bytes} [Tue May 28 12:57:18 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:57:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73245ea7-793d-4050-8b13-118b1c07d237 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73245ea7-793d-4050-8b13-118b1c07d237 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44807266-39a5-4222-873b-0cfd0eda76cb None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44807266-39a5-4222-873b-0cfd0eda76cb None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44807266-39a5-4222-873b-0cfd0eda76cb None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44807266-39a5-4222-873b-0cfd0eda76cb None admin] PATH_INFO: `/v3/projects` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44807266-39a5-4222-873b-0cfd0eda76cb None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44807266-39a5-4222-873b-0cfd0eda76cb None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:18 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d4e94067-7ef0-44e3-b09c-a394b3b4dcd1 tempest-AccessesMetadataNegativeTest-1660907003 None] <<< [POST] https://127.0.0.1:40443/api/quotas/ May 28 12:57:18 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d4e94067-7ef0-44e3-b09c-a394b3b4dcd1 tempest-AccessesMetadataNegativeTest-1660907003 None] Bunch(cluster='loop75-kfs', cluster_id=1, default_email=None, default_group_quota=None, default_user_quota=None, enable_alarms=True, enable_email_providers=True, grace_period=None, group_quotas=[], guid='d4c3c5c4-93d2-45ff-a090-01451c34d58d', hard_limit=1073741824, hard_limit_inodes=None, id=14, internal=False, is_user_quota=False, last_user_quotas_update=None, name='113739f1-d41a-4f4e-b63f-071e2ecd0a7b', num_blocked_users=0, num_exceeded_users=0, path='/manila/manila-113739f1-d41a-4f4e-b63f-071e2ecd0a7b', percent_capacity=0, percent_inodes=None, pretty_grace_period=None, pretty_grace_period_expiration=None, pretty_state='OK (CREATED)', soft_limit=None, soft_limit_inodes=None, state='OK', sync_state='CREATED', system_id=14, tenant_id=1, tenant_name='default', time_to_block=None, title='113739f1-d41a-4f4e-b63f-071e2ecd0a7b', url='https://127.0.0.1:40443/api/quotas/14/', used_capacity=0, used_capacity_tb=0.0, used_effective_capacity=0, used_effective_capacity_tb=0.0, used_inodes=0, used_limited_capacity=0, user_quotas=[]) May 28 12:57:18 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d4e94067-7ef0-44e3-b09c-a394b3b4dcd1 tempest-AccessesMetadataNegativeTest-1660907003 None] --- [POST] https://127.0.0.1:40443/api/quotas/: Done May 28 12:57:18 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d4e94067-7ef0-44e3-b09c-a394b3b4dcd1 tempest-AccessesMetadataNegativeTest-1660907003 None] >>> [GET] https://127.0.0.1:40443/api/views/ May 28 12:57:18 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d4e94067-7ef0-44e3-b09c-a394b3b4dcd1 tempest-AccessesMetadataNegativeTest-1660907003 None] {'allow_redirects': True, May 28 12:57:18 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d4e94067-7ef0-44e3-b09c-a394b3b4dcd1 tempest-AccessesMetadataNegativeTest-1660907003 None] 'params': {'name': '113739f1-d41a-4f4e-b63f-071e2ecd0a7b'}} May 28 12:57:18 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.quota [None req-262aea2e-7992-48e6-864e-791f2d9cbf82 tempest-ShareSnapshotInstancesTest-843694899 tempest-ShareSnapshotInstancesTest-843694899-project-admin] Created reservations ['0d5ed891-99ff-4f81-80a8-64b51b7c265a', '246f6fab-4677-4f74-8d0a-5889b7b48998', '48ffdd87-8af3-42d6-9071-4c4da766ebe0', 'c195383f-e566-42a6-a2af-d285724d0eda'] {{(pid=98329) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 12:57:18 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 956/1887] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 12:57:18 2024] POST /identity/v3/projects => generated 375 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:57:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3958bc21-f502-4509-b81c-e2b8c9d035c2 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3958bc21-f502-4509-b81c-e2b8c9d035c2 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:18 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-c78cef31-f937-4966-8ca0-e72ed94a3eb0 tempest-AccessesMetadataNegativeTest-1660907003 tempest-AccessesMetadataNegativeTest-1660907003-project-member] GET http://10.27.203.238/share/v2/ed83204ad63946bdae288892bd07d115/shares/1b8e12e8-6d99-48c0-8368-d1a37e2ca2ca May 28 12:57:18 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-c78cef31-f937-4966-8ca0-e72ed94a3eb0 tempest-AccessesMetadataNegativeTest-1660907003 tempest-AccessesMetadataNegativeTest-1660907003-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:18 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-c78cef31-f937-4966-8ca0-e72ed94a3eb0 tempest-AccessesMetadataNegativeTest-1660907003 tempest-AccessesMetadataNegativeTest-1660907003-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1309ad-a1fe-4c34-9b70-736356fbbca5 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1309ad-a1fe-4c34-9b70-736356fbbca5 None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1309ad-a1fe-4c34-9b70-736356fbbca5 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1309ad-a1fe-4c34-9b70-736356fbbca5 None admin] PATH_INFO: `/v3/users` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1309ad-a1fe-4c34-9b70-736356fbbca5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1309ad-a1fe-4c34-9b70-736356fbbca5 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:18 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-1a1309ad-a1fe-4c34-9b70-736356fbbca5 None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 12:57:18 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-c78cef31-f937-4966-8ca0-e72ed94a3eb0 tempest-AccessesMetadataNegativeTest-1660907003 tempest-AccessesMetadataNegativeTest-1660907003-project-member] http://10.27.203.238/share/v2/ed83204ad63946bdae288892bd07d115/shares/1b8e12e8-6d99-48c0-8368-d1a37e2ca2ca returned with HTTP 200 May 28 12:57:18 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 304/623] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:57:18 2024] GET /share/v2/ed83204ad63946bdae288892bd07d115/shares/1b8e12e8-6d99-48c0-8368-d1a37e2ca2ca => generated 1314 bytes in 24 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:57:18 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 932/1888] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 12:57:18 2024] POST /identity/v3/users => generated 296 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:57:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44807266-39a5-4222-873b-0cfd0eda76cb None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44807266-39a5-4222-873b-0cfd0eda76cb None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b37ac83-a490-4176-b8f8-cd6b803c5ba4 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b37ac83-a490-4176-b8f8-cd6b803c5ba4 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b37ac83-a490-4176-b8f8-cd6b803c5ba4 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b37ac83-a490-4176-b8f8-cd6b803c5ba4 None admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b37ac83-a490-4176-b8f8-cd6b803c5ba4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b37ac83-a490-4176-b8f8-cd6b803c5ba4 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:18 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 957/1889] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 12:57:18 2024] GET /identity/v3/roles => generated 1680 bytes in 16 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:57:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1309ad-a1fe-4c34-9b70-736356fbbca5 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1309ad-a1fe-4c34-9b70-736356fbbca5 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:18 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.quota [None req-262aea2e-7992-48e6-864e-791f2d9cbf82 tempest-ShareSnapshotInstancesTest-843694899 tempest-ShareSnapshotInstancesTest-843694899-project-admin] Committed reservations ['0d5ed891-99ff-4f81-80a8-64b51b7c265a', '246f6fab-4677-4f74-8d0a-5889b7b48998', '48ffdd87-8af3-42d6-9071-4c4da766ebe0', 'c195383f-e566-42a6-a2af-d285724d0eda'] {{(pid=98329) commit /opt/stack/manila/manila/quota.py:1063}} May 28 12:57:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae304996-8b1e-41bf-b12d-5d716b52239b None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:18 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-262aea2e-7992-48e6-864e-791f2d9cbf82 tempest-ShareSnapshotInstancesTest-843694899 tempest-ShareSnapshotInstancesTest-843694899-project-admin] http://10.27.203.238/share/v2/f4f7702aa04c467288cc6b142f61ec37/snapshots returned with HTTP 202 May 28 12:57:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae304996-8b1e-41bf-b12d-5d716b52239b None admin] REQUEST_METHOD: `PUT` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae304996-8b1e-41bf-b12d-5d716b52239b None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae304996-8b1e-41bf-b12d-5d716b52239b None admin] PATH_INFO: `/v3/projects/698d6c02a1cc4bf2b16302eb8a31bc26/users/5cae310f9eae48e088e8afe98917a6fd/roles/44620cad10ae407c90c91e2c296adb04` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:18 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 320/624] 10.27.203.238 () {66 vars in 1371 bytes} [Tue May 28 12:57:18 2024] POST /share/v2/f4f7702aa04c467288cc6b142f61ec37/snapshots => generated 749 bytes in 280 msecs (HTTP/1.1 202) 6 headers in 237 bytes (1 switches on core 0) May 28 12:57:18 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-be573813-1ffe-4ab6-8912-36075dc0a9dd tempest-ShareSnapshotInstancesTest-843694899 tempest-ShareSnapshotInstancesTest-843694899-project-admin] GET http://10.27.203.238/share/v2/f4f7702aa04c467288cc6b142f61ec37/snapshots/06828ea4-ef00-439f-b57a-9d726e3f2e62 May 28 12:57:18 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-be573813-1ffe-4ab6-8912-36075dc0a9dd tempest-ShareSnapshotInstancesTest-843694899 tempest-ShareSnapshotInstancesTest-843694899-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:18 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-be573813-1ffe-4ab6-8912-36075dc0a9dd tempest-ShareSnapshotInstancesTest-843694899 tempest-ShareSnapshotInstancesTest-843694899-project-admin] Calling method 'ShareSnapshotMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae304996-8b1e-41bf-b12d-5d716b52239b None admin] RBAC: Authorizing `identity:create_grant(project_id=698d6c02a1cc4bf2b16302eb8a31bc26, user_id=5cae310f9eae48e088e8afe98917a6fd, role_id=44620cad10ae407c90c91e2c296adb04)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae304996-8b1e-41bf-b12d-5d716b52239b None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:18 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 933/1890] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 12:57:18 2024] PUT /identity/v3/projects/698d6c02a1cc4bf2b16302eb8a31bc26/users/5cae310f9eae48e088e8afe98917a6fd/roles/44620cad10ae407c90c91e2c296adb04 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:57:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89994ab1-a7bc-4dfe-9bb3-a2b351833961 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89994ab1-a7bc-4dfe-9bb3-a2b351833961 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89994ab1-a7bc-4dfe-9bb3-a2b351833961 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:18 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-be573813-1ffe-4ab6-8912-36075dc0a9dd tempest-ShareSnapshotInstancesTest-843694899 tempest-ShareSnapshotInstancesTest-843694899-project-admin] http://10.27.203.238/share/v2/f4f7702aa04c467288cc6b142f61ec37/snapshots/06828ea4-ef00-439f-b57a-9d726e3f2e62 returned with HTTP 200 May 28 12:57:18 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 305/625] 10.27.203.238 () {64 vars in 1460 bytes} [Tue May 28 12:57:18 2024] GET /share/v2/f4f7702aa04c467288cc6b142f61ec37/snapshots/06828ea4-ef00-439f-b57a-9d726e3f2e62 => generated 749 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:57:18 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-89994ab1-a7bc-4dfe-9bb3-a2b351833961 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:57:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-89994ab1-a7bc-4dfe-9bb3-a2b351833961 None None] MFA Rules not processed for user `5cae310f9eae48e088e8afe98917a6fd`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:57:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-89994ab1-a7bc-4dfe-9bb3-a2b351833961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:18 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-262aea2e-7992-48e6-864e-791f2d9cbf82 tempest-ShareSnapshotInstancesTest-843694899 None] >>> [POST] https://127.0.0.1:40443/api/snapshots/ May 28 12:57:18 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-262aea2e-7992-48e6-864e-791f2d9cbf82 tempest-ShareSnapshotInstancesTest-843694899 None] {'data': '{"path": "/manila/manila-c2f741cd-bac5-499f-9539-8e93d6a81282", ' May 28 12:57:18 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-262aea2e-7992-48e6-864e-791f2d9cbf82 tempest-ShareSnapshotInstancesTest-843694899 None] '"name": "share-snapshot-43659856-8e64-4da7-83ec-5bc65fe3dbe5"}', May 28 12:57:18 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-262aea2e-7992-48e6-864e-791f2d9cbf82 tempest-ShareSnapshotInstancesTest-843694899 None] 'json': None, May 28 12:57:18 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-262aea2e-7992-48e6-864e-791f2d9cbf82 tempest-ShareSnapshotInstancesTest-843694899 None] 'params': None} May 28 12:57:18 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-5e3899b9-b6e9-4441-8750-3d8495665a52 tempest-AdminActionsTest-1749172189 None] <<< [GET] https://127.0.0.1:40443/api/views/ May 28 12:57:18 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-5e3899b9-b6e9-4441-8750-3d8495665a52 tempest-AdminActionsTest-1749172189 None] [] May 28 12:57:18 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-5e3899b9-b6e9-4441-8750-3d8495665a52 tempest-AdminActionsTest-1749172189 None] --- [GET] https://127.0.0.1:40443/api/views/: Done May 28 12:57:18 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-5e3899b9-b6e9-4441-8750-3d8495665a52 tempest-AdminActionsTest-1749172189 None] >>> [POST] https://127.0.0.1:40443/api/views/ May 28 12:57:18 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-5e3899b9-b6e9-4441-8750-3d8495665a52 tempest-AdminActionsTest-1749172189 None] {'data': '{"name": "891641f2-366e-4b85-925e-8cffaa759ace", "path": ' May 28 12:57:18 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-5e3899b9-b6e9-4441-8750-3d8495665a52 tempest-AdminActionsTest-1749172189 None] '"/manila/manila-891641f2-366e-4b85-925e-8cffaa759ace", "policy_id": ' May 28 12:57:18 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-5e3899b9-b6e9-4441-8750-3d8495665a52 tempest-AdminActionsTest-1749172189 None] '16, "create_dir": true, "protocols": ["NFS"]}', May 28 12:57:18 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-5e3899b9-b6e9-4441-8750-3d8495665a52 tempest-AdminActionsTest-1749172189 None] 'json': None, May 28 12:57:18 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-5e3899b9-b6e9-4441-8750-3d8495665a52 tempest-AdminActionsTest-1749172189 None] 'params': None} May 28 12:57:18 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 958/1891] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:57:18 2024] POST /identity/v3/auth/tokens => generated 3946 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:57:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae304996-8b1e-41bf-b12d-5d716b52239b None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae304996-8b1e-41bf-b12d-5d716b52239b None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b8a84b-8cbb-4a48-aa15-62b0ec1d2553 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b8a84b-8cbb-4a48-aa15-62b0ec1d2553 None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b8a84b-8cbb-4a48-aa15-62b0ec1d2553 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b8a84b-8cbb-4a48-aa15-62b0ec1d2553 None admin] PATH_INFO: `/v3/projects` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b8a84b-8cbb-4a48-aa15-62b0ec1d2553 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:19 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b5d0ddc5-db46-4239-8d97-cf384f7cf2d8 tempest-SharesActionsAdminTest-1286316336 None] <<< [POST] https://127.0.0.1:40443/api/views/ May 28 12:57:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b8a84b-8cbb-4a48-aa15-62b0ec1d2553 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:19 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b5d0ddc5-db46-4239-8d97-cf384f7cf2d8 tempest-SharesActionsAdminTest-1286316336 None] Bunch(abac_tags=[], abe_max_depth=None, abe_protocols=[], alias='', allow_anonymous_access=False, allow_s3_anonymous_access=False, auto_commit='0d', bucket='', bucket_creators=[], bucket_creators_groups=[], bucket_owner=None, bulk_permission_update_progress=None, bulk_permission_update_state=None, cluster='loop75-kfs', cluster_id=1, created='2024-05-28T12:57:18.687530Z', enabled=True, files_retention_mode='NONE', guid='54a0f75b-0213-4593-8d13-4a164026c80a', id=14, ignore_oos=False, internal=False, is_remote=False, is_seamless=False, logical_capacity=0, max_retention_period=None, min_retention_period=None, name='7c19614c-d968-4489-b2ad-bd88c2ef8054', nfs_interop_flags='BOTH_NFS3_AND_NFS4_INTEROP_DISABLED', path='/manila/manila-7c19614c-d968-4489-b2ad-bd88c2ef8054', physical_capacity=0, policy='7c19614c-d968-4489-b2ad-bd88c2ef8054', policy_id=15, protocols=['NFS'], qos_policy=None, qos_policy_id=None, s3_locks=False, s3_locks_retention_mode='NONE', s3_locks_retention_period='', s3_object_ownership_rule='ObjectWriter', s3_unverified_lookup=False, s3_versioning=False, select_for_live_monitoring=False, share='', share_acl=Bunch(acl=[], enabled=False), sync='SYNCED', sync_time='2024-05-28T12:57:18.955547Z', tenant_id=1, tenant_name='default', title='/manila/manila-7c19614c-d968-4489-b2ad-bd88c2ef8054', url='https://127.0.0.1:40443/api/views/14/') May 28 12:57:19 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b5d0ddc5-db46-4239-8d97-cf384f7cf2d8 tempest-SharesActionsAdminTest-1286316336 None] --- [POST] https://127.0.0.1:40443/api/views/: Done May 28 12:57:19 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 934/1892] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 12:57:18 2024] POST /identity/v3/projects => generated 375 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:57:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89994ab1-a7bc-4dfe-9bb3-a2b351833961 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89994ab1-a7bc-4dfe-9bb3-a2b351833961 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:19 l75lg1-v1 manila-share[98474]: INFO manila.share.manager [None req-b5d0ddc5-db46-4239-8d97-cf384f7cf2d8 tempest-SharesActionsAdminTest-1286316336 None] Share instance 7c19614c-d968-4489-b2ad-bd88c2ef8054 created successfully. May 28 12:57:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b9778e-5653-4324-a5ec-d168da4b6bb3 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b9778e-5653-4324-a5ec-d168da4b6bb3 None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b9778e-5653-4324-a5ec-d168da4b6bb3 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b9778e-5653-4324-a5ec-d168da4b6bb3 None admin] PATH_INFO: `/v3/users` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b9778e-5653-4324-a5ec-d168da4b6bb3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b9778e-5653-4324-a5ec-d168da4b6bb3 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:19 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-73b9778e-5653-4324-a5ec-d168da4b6bb3 None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 12:57:19 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 959/1893] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 12:57:19 2024] POST /identity/v3/users => generated 296 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:57:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b8a84b-8cbb-4a48-aa15-62b0ec1d2553 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b8a84b-8cbb-4a48-aa15-62b0ec1d2553 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862f1d05-ecde-457c-a0eb-f0d46d7fcd18 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862f1d05-ecde-457c-a0eb-f0d46d7fcd18 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862f1d05-ecde-457c-a0eb-f0d46d7fcd18 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862f1d05-ecde-457c-a0eb-f0d46d7fcd18 None admin] PATH_INFO: `/v3/roles` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862f1d05-ecde-457c-a0eb-f0d46d7fcd18 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862f1d05-ecde-457c-a0eb-f0d46d7fcd18 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:19 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 935/1894] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 12:57:19 2024] GET /identity/v3/roles => generated 1680 bytes in 17 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:57:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b9778e-5653-4324-a5ec-d168da4b6bb3 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b9778e-5653-4324-a5ec-d168da4b6bb3 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87d1173-8c8e-4fea-b3e7-f68c0df76292 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87d1173-8c8e-4fea-b3e7-f68c0df76292 None admin] REQUEST_METHOD: `PUT` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87d1173-8c8e-4fea-b3e7-f68c0df76292 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87d1173-8c8e-4fea-b3e7-f68c0df76292 None admin] PATH_INFO: `/v3/projects/50673e34797a4dee8fd8c1fe56b1d6af/users/e9171911f4cf49bf912e780367746517/roles/44620cad10ae407c90c91e2c296adb04` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87d1173-8c8e-4fea-b3e7-f68c0df76292 None admin] RBAC: Authorizing `identity:create_grant(project_id=50673e34797a4dee8fd8c1fe56b1d6af, user_id=e9171911f4cf49bf912e780367746517, role_id=44620cad10ae407c90c91e2c296adb04)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87d1173-8c8e-4fea-b3e7-f68c0df76292 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:19 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 960/1895] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 12:57:19 2024] PUT /identity/v3/projects/50673e34797a4dee8fd8c1fe56b1d6af/users/e9171911f4cf49bf912e780367746517/roles/44620cad10ae407c90c91e2c296adb04 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:57:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5376a5-1c42-4070-87ea-6fc500c7baf4 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5376a5-1c42-4070-87ea-6fc500c7baf4 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5376a5-1c42-4070-87ea-6fc500c7baf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:19 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-4b5376a5-1c42-4070-87ea-6fc500c7baf4 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:57:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-4b5376a5-1c42-4070-87ea-6fc500c7baf4 None None] MFA Rules not processed for user `e9171911f4cf49bf912e780367746517`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:57:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-4b5376a5-1c42-4070-87ea-6fc500c7baf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:19 l75lg1-v1 dstat.sh[49771]: 28-05 12:57:19| 13 2 78 8 0|5681M 1816M 277M 7852M| 19k 3386B| 0 9688k| 0 774 |9440 16k|1.58 1.03 1.00|2.0 0 0| 0 0 | 0 2048M| 29 352 0 85 0 May 28 12:57:19 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 936/1896] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:57:19 2024] POST /identity/v3/auth/tokens => generated 3946 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:57:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87d1173-8c8e-4fea-b3e7-f68c0df76292 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87d1173-8c8e-4fea-b3e7-f68c0df76292 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b467a2d-71a8-4ee2-95d0-d03d197523b0 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b467a2d-71a8-4ee2-95d0-d03d197523b0 None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b467a2d-71a8-4ee2-95d0-d03d197523b0 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b467a2d-71a8-4ee2-95d0-d03d197523b0 None admin] PATH_INFO: `/v3/projects` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b467a2d-71a8-4ee2-95d0-d03d197523b0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b467a2d-71a8-4ee2-95d0-d03d197523b0 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:19 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 961/1897] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 12:57:19 2024] POST /identity/v3/projects => generated 375 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:57:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5376a5-1c42-4070-87ea-6fc500c7baf4 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5376a5-1c42-4070-87ea-6fc500c7baf4 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3d5609-a7bd-40c3-863c-8acb6541575a None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3d5609-a7bd-40c3-863c-8acb6541575a None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3d5609-a7bd-40c3-863c-8acb6541575a None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3d5609-a7bd-40c3-863c-8acb6541575a None admin] PATH_INFO: `/v3/users` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3d5609-a7bd-40c3-863c-8acb6541575a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3d5609-a7bd-40c3-863c-8acb6541575a None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:19 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-4b3d5609-a7bd-40c3-863c-8acb6541575a None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 12:57:19 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 937/1898] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 12:57:19 2024] POST /identity/v3/users => generated 295 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:57:19 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d4e94067-7ef0-44e3-b09c-a394b3b4dcd1 tempest-AccessesMetadataNegativeTest-1660907003 None] <<< [GET] https://127.0.0.1:40443/api/views/ May 28 12:57:19 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d4e94067-7ef0-44e3-b09c-a394b3b4dcd1 tempest-AccessesMetadataNegativeTest-1660907003 None] [] May 28 12:57:19 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d4e94067-7ef0-44e3-b09c-a394b3b4dcd1 tempest-AccessesMetadataNegativeTest-1660907003 None] --- [GET] https://127.0.0.1:40443/api/views/: Done May 28 12:57:19 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d4e94067-7ef0-44e3-b09c-a394b3b4dcd1 tempest-AccessesMetadataNegativeTest-1660907003 None] >>> [POST] https://127.0.0.1:40443/api/views/ May 28 12:57:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b467a2d-71a8-4ee2-95d0-d03d197523b0 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:19 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d4e94067-7ef0-44e3-b09c-a394b3b4dcd1 tempest-AccessesMetadataNegativeTest-1660907003 None] {'data': '{"name": "113739f1-d41a-4f4e-b63f-071e2ecd0a7b", "path": ' May 28 12:57:19 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d4e94067-7ef0-44e3-b09c-a394b3b4dcd1 tempest-AccessesMetadataNegativeTest-1660907003 None] '"/manila/manila-113739f1-d41a-4f4e-b63f-071e2ecd0a7b", "policy_id": ' May 28 12:57:19 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d4e94067-7ef0-44e3-b09c-a394b3b4dcd1 tempest-AccessesMetadataNegativeTest-1660907003 None] '17, "create_dir": true, "protocols": ["NFS"]}', May 28 12:57:19 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d4e94067-7ef0-44e3-b09c-a394b3b4dcd1 tempest-AccessesMetadataNegativeTest-1660907003 None] 'json': None, May 28 12:57:19 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d4e94067-7ef0-44e3-b09c-a394b3b4dcd1 tempest-AccessesMetadataNegativeTest-1660907003 None] 'params': None} May 28 12:57:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b467a2d-71a8-4ee2-95d0-d03d197523b0 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f96faf-a132-4ff6-9419-1c3a87726113 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f96faf-a132-4ff6-9419-1c3a87726113 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f96faf-a132-4ff6-9419-1c3a87726113 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f96faf-a132-4ff6-9419-1c3a87726113 None admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f96faf-a132-4ff6-9419-1c3a87726113 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f96faf-a132-4ff6-9419-1c3a87726113 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:19 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 962/1899] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 12:57:19 2024] GET /identity/v3/roles => generated 1680 bytes in 17 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:57:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3d5609-a7bd-40c3-863c-8acb6541575a None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3d5609-a7bd-40c3-863c-8acb6541575a None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66999ba5-1b1e-4d88-a7a6-4f695500477c None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66999ba5-1b1e-4d88-a7a6-4f695500477c None admin] REQUEST_METHOD: `PUT` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66999ba5-1b1e-4d88-a7a6-4f695500477c None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66999ba5-1b1e-4d88-a7a6-4f695500477c None admin] PATH_INFO: `/v3/projects/2d702e4e22be4d49a78c389a89fb56b5/users/c56458627e0c4970bd67958e52ea88bd/roles/e7989893488f483baa107be56668c4f8` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66999ba5-1b1e-4d88-a7a6-4f695500477c None admin] RBAC: Authorizing `identity:create_grant(project_id=2d702e4e22be4d49a78c389a89fb56b5, user_id=c56458627e0c4970bd67958e52ea88bd, role_id=e7989893488f483baa107be56668c4f8)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66999ba5-1b1e-4d88-a7a6-4f695500477c None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:19 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 938/1900] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 12:57:19 2024] PUT /identity/v3/projects/2d702e4e22be4d49a78c389a89fb56b5/users/c56458627e0c4970bd67958e52ea88bd/roles/e7989893488f483baa107be56668c4f8 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:57:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f96faf-a132-4ff6-9419-1c3a87726113 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f96faf-a132-4ff6-9419-1c3a87726113 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab78c386-f5b3-47a9-bad7-4410db27fe30 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab78c386-f5b3-47a9-bad7-4410db27fe30 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab78c386-f5b3-47a9-bad7-4410db27fe30 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab78c386-f5b3-47a9-bad7-4410db27fe30 None admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab78c386-f5b3-47a9-bad7-4410db27fe30 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab78c386-f5b3-47a9-bad7-4410db27fe30 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:19 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 963/1901] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 12:57:19 2024] GET /identity/v3/roles => generated 1680 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:57:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66999ba5-1b1e-4d88-a7a6-4f695500477c None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66999ba5-1b1e-4d88-a7a6-4f695500477c None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba52a51-a234-4f2e-b19b-5536ed475b87 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba52a51-a234-4f2e-b19b-5536ed475b87 None admin] REQUEST_METHOD: `PUT` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba52a51-a234-4f2e-b19b-5536ed475b87 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba52a51-a234-4f2e-b19b-5536ed475b87 None admin] PATH_INFO: `/v3/projects/2d702e4e22be4d49a78c389a89fb56b5/users/c56458627e0c4970bd67958e52ea88bd/roles/e7989893488f483baa107be56668c4f8` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba52a51-a234-4f2e-b19b-5536ed475b87 None admin] RBAC: Authorizing `identity:create_grant(project_id=2d702e4e22be4d49a78c389a89fb56b5, user_id=c56458627e0c4970bd67958e52ea88bd, role_id=e7989893488f483baa107be56668c4f8)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba52a51-a234-4f2e-b19b-5536ed475b87 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:19 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 939/1902] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 12:57:19 2024] PUT /identity/v3/projects/2d702e4e22be4d49a78c389a89fb56b5/users/c56458627e0c4970bd67958e52ea88bd/roles/e7989893488f483baa107be56668c4f8 => generated 0 bytes in 19 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:57:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b70980-45aa-4671-8b63-181ec2844e8b None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b70980-45aa-4671-8b63-181ec2844e8b None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b70980-45aa-4671-8b63-181ec2844e8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:19 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-24b70980-45aa-4671-8b63-181ec2844e8b None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:57:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-24b70980-45aa-4671-8b63-181ec2844e8b None None] MFA Rules not processed for user `c56458627e0c4970bd67958e52ea88bd`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:57:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-24b70980-45aa-4671-8b63-181ec2844e8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:19 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 964/1903] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:57:19 2024] POST /identity/v3/auth/tokens => generated 4069 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:57:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba52a51-a234-4f2e-b19b-5536ed475b87 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba52a51-a234-4f2e-b19b-5536ed475b87 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8829ff1-842e-4083-a0f7-10f29ef9b35d tempest-SharesMetadataTest-1653637154 tempest-SharesMetadataTest-1653637154-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c56458627e0c4970bd67958e52ea88bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d702e4e22be4d49a78c389a89fb56b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8829ff1-842e-4083-a0f7-10f29ef9b35d tempest-SharesMetadataTest-1653637154 tempest-SharesMetadataTest-1653637154-project-admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8829ff1-842e-4083-a0f7-10f29ef9b35d tempest-SharesMetadataTest-1653637154 tempest-SharesMetadataTest-1653637154-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8829ff1-842e-4083-a0f7-10f29ef9b35d tempest-SharesMetadataTest-1653637154 tempest-SharesMetadataTest-1653637154-project-admin] PATH_INFO: `/v3/domains` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8829ff1-842e-4083-a0f7-10f29ef9b35d tempest-SharesMetadataTest-1653637154 tempest-SharesMetadataTest-1653637154-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:57:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8829ff1-842e-4083-a0f7-10f29ef9b35d tempest-SharesMetadataTest-1653637154 tempest-SharesMetadataTest-1653637154-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8829ff1-842e-4083-a0f7-10f29ef9b35d tempest-SharesMetadataTest-1653637154 tempest-SharesMetadataTest-1653637154-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:19 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 940/1904] 10.27.203.238 () {62 vars in 1241 bytes} [Tue May 28 12:57:19 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:57:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b70980-45aa-4671-8b63-181ec2844e8b None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b70980-45aa-4671-8b63-181ec2844e8b None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d812fa5d-0b59-4c53-b435-d688730b4e0a tempest-SharesMetadataTest-1653637154 tempest-SharesMetadataTest-1653637154-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c56458627e0c4970bd67958e52ea88bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d702e4e22be4d49a78c389a89fb56b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d812fa5d-0b59-4c53-b435-d688730b4e0a tempest-SharesMetadataTest-1653637154 tempest-SharesMetadataTest-1653637154-project-admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d812fa5d-0b59-4c53-b435-d688730b4e0a tempest-SharesMetadataTest-1653637154 tempest-SharesMetadataTest-1653637154-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d812fa5d-0b59-4c53-b435-d688730b4e0a tempest-SharesMetadataTest-1653637154 tempest-SharesMetadataTest-1653637154-project-admin] PATH_INFO: `/v3/users` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d812fa5d-0b59-4c53-b435-d688730b4e0a tempest-SharesMetadataTest-1653637154 tempest-SharesMetadataTest-1653637154-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d812fa5d-0b59-4c53-b435-d688730b4e0a tempest-SharesMetadataTest-1653637154 tempest-SharesMetadataTest-1653637154-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:19 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-d812fa5d-0b59-4c53-b435-d688730b4e0a tempest-SharesMetadataTest-1653637154 tempest-SharesMetadataTest-1653637154-project-admin] Truncating password to algorithm specific maximum length 72 characters. May 28 12:57:19 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 965/1905] 10.27.203.238 () {64 vars in 1232 bytes} [Tue May 28 12:57:19 2024] POST /identity/v3/users => generated 435 bytes in 32 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:57:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8829ff1-842e-4083-a0f7-10f29ef9b35d tempest-SharesMetadataTest-1653637154 tempest-SharesMetadataTest-1653637154-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8829ff1-842e-4083-a0f7-10f29ef9b35d tempest-SharesMetadataTest-1653637154 tempest-SharesMetadataTest-1653637154-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728e8c78-4366-4718-82dc-c16a2fd28ea0 tempest-SharesMetadataTest-1653637154 tempest-SharesMetadataTest-1653637154-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c56458627e0c4970bd67958e52ea88bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d702e4e22be4d49a78c389a89fb56b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728e8c78-4366-4718-82dc-c16a2fd28ea0 tempest-SharesMetadataTest-1653637154 tempest-SharesMetadataTest-1653637154-project-admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728e8c78-4366-4718-82dc-c16a2fd28ea0 tempest-SharesMetadataTest-1653637154 tempest-SharesMetadataTest-1653637154-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728e8c78-4366-4718-82dc-c16a2fd28ea0 tempest-SharesMetadataTest-1653637154 tempest-SharesMetadataTest-1653637154-project-admin] PATH_INFO: `/v3/roles` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728e8c78-4366-4718-82dc-c16a2fd28ea0 tempest-SharesMetadataTest-1653637154 tempest-SharesMetadataTest-1653637154-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728e8c78-4366-4718-82dc-c16a2fd28ea0 tempest-SharesMetadataTest-1653637154 tempest-SharesMetadataTest-1653637154-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:19 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 941/1906] 10.27.203.238 () {62 vars in 1210 bytes} [Tue May 28 12:57:19 2024] GET /identity/v3/roles => generated 1680 bytes in 17 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:57:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d812fa5d-0b59-4c53-b435-d688730b4e0a tempest-SharesMetadataTest-1653637154 tempest-SharesMetadataTest-1653637154-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d812fa5d-0b59-4c53-b435-d688730b4e0a tempest-SharesMetadataTest-1653637154 tempest-SharesMetadataTest-1653637154-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91db997f-3503-4687-9f3e-10c210d7ed51 tempest-SharesMetadataTest-1653637154 tempest-SharesMetadataTest-1653637154-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c56458627e0c4970bd67958e52ea88bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d702e4e22be4d49a78c389a89fb56b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91db997f-3503-4687-9f3e-10c210d7ed51 tempest-SharesMetadataTest-1653637154 tempest-SharesMetadataTest-1653637154-project-admin] REQUEST_METHOD: `PUT` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91db997f-3503-4687-9f3e-10c210d7ed51 tempest-SharesMetadataTest-1653637154 tempest-SharesMetadataTest-1653637154-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91db997f-3503-4687-9f3e-10c210d7ed51 tempest-SharesMetadataTest-1653637154 tempest-SharesMetadataTest-1653637154-project-admin] PATH_INFO: `/v3/projects/2d702e4e22be4d49a78c389a89fb56b5/users/e1f712aac7e94e429048f60f92a8a736/roles/44620cad10ae407c90c91e2c296adb04` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91db997f-3503-4687-9f3e-10c210d7ed51 tempest-SharesMetadataTest-1653637154 tempest-SharesMetadataTest-1653637154-project-admin] RBAC: Authorizing `identity:create_grant(project_id=2d702e4e22be4d49a78c389a89fb56b5, user_id=e1f712aac7e94e429048f60f92a8a736, role_id=44620cad10ae407c90c91e2c296adb04)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91db997f-3503-4687-9f3e-10c210d7ed51 tempest-SharesMetadataTest-1653637154 tempest-SharesMetadataTest-1653637154-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:19 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 966/1907] 10.27.203.238 () {64 vars in 1571 bytes} [Tue May 28 12:57:19 2024] PUT /identity/v3/projects/2d702e4e22be4d49a78c389a89fb56b5/users/e1f712aac7e94e429048f60f92a8a736/roles/44620cad10ae407c90c91e2c296adb04 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:57:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728e8c78-4366-4718-82dc-c16a2fd28ea0 tempest-SharesMetadataTest-1653637154 tempest-SharesMetadataTest-1653637154-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-728e8c78-4366-4718-82dc-c16a2fd28ea0 tempest-SharesMetadataTest-1653637154 tempest-SharesMetadataTest-1653637154-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728e8c78-4366-4718-82dc-c16a2fd28ea0 tempest-SharesMetadataTest-1653637154 tempest-SharesMetadataTest-1653637154-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0e4c1f-6bef-4c26-8521-5d98a211e0a1 service manila] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f110cf6300f049c897d0aab63218d1e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0e4c1f-6bef-4c26-8521-5d98a211e0a1 service manila] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0e4c1f-6bef-4c26-8521-5d98a211e0a1 service manila] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0e4c1f-6bef-4c26-8521-5d98a211e0a1 service manila] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0e4c1f-6bef-4c26-8521-5d98a211e0a1 service manila] RBAC: Authorizing `identity:validate_token()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0e4c1f-6bef-4c26-8521-5d98a211e0a1 service manila] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:19 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 942/1908] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 12:57:19 2024] GET /identity/v3/auth/tokens => generated 4069 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 12:57:19 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-e67c67a4-8e88-4915-98aa-b3eac73f63fc tempest-SharesMetadataTest-1653637154 tempest-SharesMetadataTest-1653637154-project-admin] POST http://10.27.203.238/share/v2/2d702e4e22be4d49a78c389a89fb56b5/types May 28 12:57:19 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-e67c67a4-8e88-4915-98aa-b3eac73f63fc tempest-SharesMetadataTest-1653637154 tempest-SharesMetadataTest-1653637154-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share_type": {"name": "tempest-typeshare-type-257096329", "extra_specs": {"driver_handles_share_servers": "False"}, "share_type_access:is_public": true}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:57:19 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-e67c67a4-8e88-4915-98aa-b3eac73f63fc tempest-SharesMetadataTest-1653637154 tempest-SharesMetadataTest-1653637154-project-admin] http://10.27.203.238/share/v2/2d702e4e22be4d49a78c389a89fb56b5/types returned with HTTP 200 May 28 12:57:19 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 321/626] 10.27.203.238 () {66 vars in 1359 bytes} [Tue May 28 12:57:19 2024] POST /share/v2/2d702e4e22be4d49a78c389a89fb56b5/types => generated 621 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:57:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91db997f-3503-4687-9f3e-10c210d7ed51 tempest-SharesMetadataTest-1653637154 tempest-SharesMetadataTest-1653637154-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-91db997f-3503-4687-9f3e-10c210d7ed51 tempest-SharesMetadataTest-1653637154 tempest-SharesMetadataTest-1653637154-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91db997f-3503-4687-9f3e-10c210d7ed51 tempest-SharesMetadataTest-1653637154 tempest-SharesMetadataTest-1653637154-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccedf69d-6ef5-45e3-910d-e3e54e163b5e service manila] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f110cf6300f049c897d0aab63218d1e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccedf69d-6ef5-45e3-910d-e3e54e163b5e service manila] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccedf69d-6ef5-45e3-910d-e3e54e163b5e service manila] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccedf69d-6ef5-45e3-910d-e3e54e163b5e service manila] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccedf69d-6ef5-45e3-910d-e3e54e163b5e service manila] RBAC: Authorizing `identity:validate_token()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccedf69d-6ef5-45e3-910d-e3e54e163b5e service manila] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:19 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 967/1909] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 12:57:19 2024] GET /identity/v3/auth/tokens => generated 3946 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 12:57:19 l75lg1-v1 nova-conductor[83648]: DEBUG dbcounter [-] [83648] Writing DB stats nova_cell1:SELECT=1 {{(pid=83648) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:57:19 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-bde4066b-d8fb-4c28-8293-2527ac852f8f tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] POST http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares May 28 12:57:19 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-bde4066b-d8fb-4c28-8293-2527ac852f8f tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share": {"share_proto": "nfs", "description": "Tempest's share", "snapshot_id": null, "name": "tempest-tempest-created-share-2132659858", "size": 1, "metadata": {}, "is_public": false, "share_type": "10ddeb10-4cbf-44c0-94cd-48a1deaf7383"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:57:19 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.v1.shares [None req-bde4066b-d8fb-4c28-8293-2527ac852f8f tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Create NFS share of 1 GB May 28 12:57:20 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-5e3899b9-b6e9-4441-8750-3d8495665a52 tempest-AdminActionsTest-1749172189 None] <<< [POST] https://127.0.0.1:40443/api/views/ May 28 12:57:20 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-5e3899b9-b6e9-4441-8750-3d8495665a52 tempest-AdminActionsTest-1749172189 None] Bunch(abac_tags=[], abe_max_depth=None, abe_protocols=[], alias='', allow_anonymous_access=False, allow_s3_anonymous_access=False, auto_commit='0d', bucket='', bucket_creators=[], bucket_creators_groups=[], bucket_owner=None, bulk_permission_update_progress=None, bulk_permission_update_state=None, cluster='loop75-kfs', cluster_id=1, created='2024-05-28T12:57:19.642566Z', enabled=True, files_retention_mode='NONE', guid='562349d7-1894-4ef1-b261-68e441ce36ce', id=15, ignore_oos=False, internal=False, is_remote=False, is_seamless=False, logical_capacity=0, max_retention_period=None, min_retention_period=None, name='891641f2-366e-4b85-925e-8cffaa759ace', nfs_interop_flags='BOTH_NFS3_AND_NFS4_INTEROP_DISABLED', path='/manila/manila-891641f2-366e-4b85-925e-8cffaa759ace', physical_capacity=0, policy='891641f2-366e-4b85-925e-8cffaa759ace', policy_id=16, protocols=['NFS'], qos_policy=None, qos_policy_id=None, s3_locks=False, s3_locks_retention_mode='NONE', s3_locks_retention_period='', s3_object_ownership_rule='ObjectWriter', s3_unverified_lookup=False, s3_versioning=False, select_for_live_monitoring=False, share='', share_acl=Bunch(acl=[], enabled=False), sync='SYNCED', sync_time='2024-05-28T12:57:19.961239Z', tenant_id=1, tenant_name='default', title='/manila/manila-891641f2-366e-4b85-925e-8cffaa759ace', url='https://127.0.0.1:40443/api/views/15/') May 28 12:57:20 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-5e3899b9-b6e9-4441-8750-3d8495665a52 tempest-AdminActionsTest-1749172189 None] --- [POST] https://127.0.0.1:40443/api/views/: Done May 28 12:57:20 l75lg1-v1 manila-share[98474]: INFO manila.share.manager [None req-5e3899b9-b6e9-4441-8750-3d8495665a52 tempest-AdminActionsTest-1749172189 None] Share instance 891641f2-366e-4b85-925e-8cffaa759ace created successfully. May 28 12:57:20 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d4e94067-7ef0-44e3-b09c-a394b3b4dcd1 tempest-AccessesMetadataNegativeTest-1660907003 None] <<< [POST] https://127.0.0.1:40443/api/views/ May 28 12:57:20 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d4e94067-7ef0-44e3-b09c-a394b3b4dcd1 tempest-AccessesMetadataNegativeTest-1660907003 None] Bunch(abac_tags=[], abe_max_depth=None, abe_protocols=[], alias='', allow_anonymous_access=False, allow_s3_anonymous_access=False, auto_commit='0d', bucket='', bucket_creators=[], bucket_creators_groups=[], bucket_owner=None, bulk_permission_update_progress=None, bulk_permission_update_state=None, cluster='loop75-kfs', cluster_id=1, created='2024-05-28T12:57:19.808991Z', enabled=True, files_retention_mode='NONE', guid='6e44791a-a8b6-467c-a4c0-e6c0eca02e8e', id=16, ignore_oos=False, internal=False, is_remote=False, is_seamless=False, logical_capacity=0, max_retention_period=None, min_retention_period=None, name='113739f1-d41a-4f4e-b63f-071e2ecd0a7b', nfs_interop_flags='BOTH_NFS3_AND_NFS4_INTEROP_DISABLED', path='/manila/manila-113739f1-d41a-4f4e-b63f-071e2ecd0a7b', physical_capacity=0, policy='113739f1-d41a-4f4e-b63f-071e2ecd0a7b', policy_id=17, protocols=['NFS'], qos_policy=None, qos_policy_id=None, s3_locks=False, s3_locks_retention_mode='NONE', s3_locks_retention_period='', s3_object_ownership_rule='ObjectWriter', s3_unverified_lookup=False, s3_versioning=False, select_for_live_monitoring=False, share='', share_acl=Bunch(acl=[], enabled=False), sync='SYNCED', sync_time='2024-05-28T12:57:20.101147Z', tenant_id=1, tenant_name='default', title='/manila/manila-113739f1-d41a-4f4e-b63f-071e2ecd0a7b', url='https://127.0.0.1:40443/api/views/16/') May 28 12:57:20 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d4e94067-7ef0-44e3-b09c-a394b3b4dcd1 tempest-AccessesMetadataNegativeTest-1660907003 None] --- [POST] https://127.0.0.1:40443/api/views/: Done May 28 12:57:20 l75lg1-v1 manila-share[98474]: INFO manila.share.manager [None req-d4e94067-7ef0-44e3-b09c-a394b3b4dcd1 tempest-AccessesMetadataNegativeTest-1660907003 None] Share instance 113739f1-d41a-4f4e-b63f-071e2ecd0a7b created successfully. May 28 12:57:20 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.quota [None req-bde4066b-d8fb-4c28-8293-2527ac852f8f tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Created reservations ['00a7cb06-91fa-4c32-8549-35daccb82c56', 'b1a57ac4-9231-4b90-9680-312a9b56abde', 'e62fb49e-6b3c-4eca-b7d7-7377d19b31a0', '6964db93-9873-4525-b724-40cb45d9d206'] {{(pid=98330) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 12:57:20 l75lg1-v1 dstat.sh[49771]: 28-05 12:57:20| 10 1 86 2 0|5681M 1815M 277M 7852M| 18k 1072B| 0 1552k| 0 241 |6717 12k|1.58 1.03 1.00|2.0 0 0| 0 0 | 0 2048M| 29 352 0 85 0 May 28 12:57:20 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.quota [None req-bde4066b-d8fb-4c28-8293-2527ac852f8f tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Committed reservations ['00a7cb06-91fa-4c32-8549-35daccb82c56', 'b1a57ac4-9231-4b90-9680-312a9b56abde', 'e62fb49e-6b3c-4eca-b7d7-7377d19b31a0', '6964db93-9873-4525-b724-40cb45d9d206'] {{(pid=98330) commit /opt/stack/manila/manila/quota.py:1063}} May 28 12:57:20 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.host_manager [None req-bde4066b-d8fb-4c28-8293-2527ac852f8f tempest-SharesMetadataTest-1561320255 None] Share service is down. (host: l75lg1-v1@generic2). May 28 12:57:20 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.host_manager [None req-bde4066b-d8fb-4c28-8293-2527ac852f8f tempest-SharesMetadataTest-1561320255 None] Share service is down. (host: l75lg1-v1@generic1). May 28 12:57:20 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-bde4066b-d8fb-4c28-8293-2527ac852f8f tempest-SharesMetadataTest-1561320255 None] Starting with 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:80}} May 28 12:57:20 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-bde4066b-d8fb-4c28-8293-2527ac852f8f tempest-SharesMetadataTest-1561320255 None] Filter OnlyHostFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:57:20 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-bde4066b-d8fb-4c28-8293-2527ac852f8f tempest-SharesMetadataTest-1561320255 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:57:20 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.capacity [None req-bde4066b-d8fb-4c28-8293-2527ac852f8f tempest-SharesMetadataTest-1561320255 None] Space information for share creation on host l75lg1-v1@vast#vast (requested / avail): 1/2067 {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/capacity.py:83}} May 28 12:57:20 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-bde4066b-d8fb-4c28-8293-2527ac852f8f tempest-SharesMetadataTest-1561320255 None] Filter CapacityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:57:20 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-bde4066b-d8fb-4c28-8293-2527ac852f8f tempest-SharesMetadataTest-1561320255 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:57:20 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-bde4066b-d8fb-4c28-8293-2527ac852f8f tempest-SharesMetadataTest-1561320255 None] Driver Filter: Checking host 'l75lg1-v1@vast#vast' {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:37}} May 28 12:57:20 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-bde4066b-d8fb-4c28-8293-2527ac852f8f tempest-SharesMetadataTest-1561320255 None] Filter function not set :: passing host. {{(pid=98327) _check_filter_function /opt/stack/manila/manila/scheduler/filters/driver.py:53}} May 28 12:57:20 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-bde4066b-d8fb-4c28-8293-2527ac852f8f tempest-SharesMetadataTest-1561320255 None] Result: True {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:40}} May 28 12:57:20 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-bde4066b-d8fb-4c28-8293-2527ac852f8f tempest-SharesMetadataTest-1561320255 None] Done checking host 'l75lg1-v1@vast#vast' {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:41}} May 28 12:57:20 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-bde4066b-d8fb-4c28-8293-2527ac852f8f tempest-SharesMetadataTest-1561320255 None] Filter DriverFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:57:20 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-bde4066b-d8fb-4c28-8293-2527ac852f8f tempest-SharesMetadataTest-1561320255 None] Filter ShareReplicationFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:57:20 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-bde4066b-d8fb-4c28-8293-2527ac852f8f tempest-SharesMetadataTest-1561320255 None] Filter CreateFromSnapshotFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:57:20 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-bde4066b-d8fb-4c28-8293-2527ac852f8f tempest-SharesMetadataTest-1561320255 None] Filter AffinityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:57:20 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-bde4066b-d8fb-4c28-8293-2527ac852f8f tempest-SharesMetadataTest-1561320255 None] Filter AntiAffinityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:57:20 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.drivers.filter [None req-bde4066b-d8fb-4c28-8293-2527ac852f8f tempest-SharesMetadataTest-1561320255 None] Filtered share [host: 'l75lg1-v1@vast#vast', free_capacity_gb: 2067.6229242384434, pools: None] {{(pid=98327) _schedule_share /opt/stack/manila/manila/scheduler/drivers/filter.py:268}} May 28 12:57:20 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-bde4066b-d8fb-4c28-8293-2527ac852f8f tempest-SharesMetadataTest-1561320255 None] Checking host 'l75lg1-v1@vast#vast' {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:46}} May 28 12:57:20 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.weighers.goodness [None req-bde4066b-d8fb-4c28-8293-2527ac852f8f tempest-SharesMetadataTest-1561320255 None] Goodness function not set :: defaulting to minimal goodness rating of 0. May 28 12:57:20 l75lg1-v1 manila-scheduler[98327]: INFO manila.scheduler.weighers.goodness [None req-bde4066b-d8fb-4c28-8293-2527ac852f8f tempest-SharesMetadataTest-1561320255 None] Goodness function result for host l75lg1-v1@vast#vast: 0. May 28 12:57:20 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-bde4066b-d8fb-4c28-8293-2527ac852f8f tempest-SharesMetadataTest-1561320255 None] Goodness: 0 {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:48}} May 28 12:57:20 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-bde4066b-d8fb-4c28-8293-2527ac852f8f tempest-SharesMetadataTest-1561320255 None] Done checking host 'l75lg1-v1@vast#vast' {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:49}} May 28 12:57:20 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.drivers.filter [None req-bde4066b-d8fb-4c28-8293-2527ac852f8f tempest-SharesMetadataTest-1561320255 None] Choosing for share: WeighedHost [host: l75lg1-v1@vast#vast, weight: 0.0] {{(pid=98327) _schedule_share /opt/stack/manila/manila/scheduler/drivers/filter.py:274}} May 28 12:57:20 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-bde4066b-d8fb-4c28-8293-2527ac852f8f tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares returned with HTTP 200 May 28 12:57:20 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 306/627] 10.27.203.238 () {66 vars in 1362 bytes} [Tue May 28 12:57:19 2024] POST /share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares => generated 1312 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:57:20 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-d31c0525-4b5e-4ee0-82b5-0f5689c2072b tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] GET http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/9e24a210-9e96-45d9-b31c-f6f3377eb0e7 May 28 12:57:20 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-d31c0525-4b5e-4ee0-82b5-0f5689c2072b tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:20 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-d31c0525-4b5e-4ee0-82b5-0f5689c2072b tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:20 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-d31c0525-4b5e-4ee0-82b5-0f5689c2072b tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/9e24a210-9e96-45d9-b31c-f6f3377eb0e7 returned with HTTP 200 May 28 12:57:20 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 322/628] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:57:20 2024] GET /share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/9e24a210-9e96-45d9-b31c-f6f3377eb0e7 => generated 1312 bytes in 25 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:57:20 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-992b77eb-dcf0-469e-a779-47990c1448df tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] GET http://10.27.203.238/share/v2/fe54df7c653849ab8ec7523262c597cf/shares/7da650db-1124-40b5-ba52-fb1170c038c8 May 28 12:57:20 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-992b77eb-dcf0-469e-a779-47990c1448df tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:20 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-992b77eb-dcf0-469e-a779-47990c1448df tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:20 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bde4066b-d8fb-4c28-8293-2527ac852f8f tempest-SharesMetadataTest-1561320255 None] >>> [GET] https://127.0.0.1:40443/api/vippools/ May 28 12:57:20 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bde4066b-d8fb-4c28-8293-2527ac852f8f tempest-SharesMetadataTest-1561320255 None] {'allow_redirects': True, 'params': {'name': 'vippool-1'}} May 28 12:57:20 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-992b77eb-dcf0-469e-a779-47990c1448df tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] http://10.27.203.238/share/v2/fe54df7c653849ab8ec7523262c597cf/shares/7da650db-1124-40b5-ba52-fb1170c038c8 returned with HTTP 200 May 28 12:57:20 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 307/629] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:57:20 2024] GET /share/v2/fe54df7c653849ab8ec7523262c597cf/shares/7da650db-1124-40b5-ba52-fb1170c038c8 => generated 1476 bytes in 25 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:57:20 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-72338d36-e1c6-4716-b1d8-6c3ed27d0e04 tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] POST http://10.27.203.238/share/v2/fe54df7c653849ab8ec7523262c597cf/snapshots May 28 12:57:20 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-72338d36-e1c6-4716-b1d8-6c3ed27d0e04 tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] Action: 'create', calling method: ShareSnapshotMixin.create, body: {"snapshot": {"name": "tempest-tempest-snapshot-name-1145132332", "force": false, "description": "tempest-tempest-snapshot-description-1898222467", "share_id": "7da650db-1124-40b5-ba52-fb1170c038c8"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:57:20 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.v1.share_snapshots [None req-72338d36-e1c6-4716-b1d8-6c3ed27d0e04 tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] Create snapshot from share 7da650db-1124-40b5-ba52-fb1170c038c8 May 28 12:57:20 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.quota [None req-72338d36-e1c6-4716-b1d8-6c3ed27d0e04 tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] Created reservations ['9f9d99f0-b263-4f2e-a9a2-036b5646b8be', 'c69807fd-5a81-4b41-b15d-c249475bfaf1', '52ece67b-6ea8-4297-a98a-a7e77d0b90ce', '9514cf5f-5c66-4071-a3d6-90e18f97c549'] {{(pid=98329) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 12:57:20 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.quota [None req-72338d36-e1c6-4716-b1d8-6c3ed27d0e04 tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] Committed reservations ['9f9d99f0-b263-4f2e-a9a2-036b5646b8be', 'c69807fd-5a81-4b41-b15d-c249475bfaf1', '52ece67b-6ea8-4297-a98a-a7e77d0b90ce', '9514cf5f-5c66-4071-a3d6-90e18f97c549'] {{(pid=98329) commit /opt/stack/manila/manila/quota.py:1063}} May 28 12:57:20 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-72338d36-e1c6-4716-b1d8-6c3ed27d0e04 tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] http://10.27.203.238/share/v2/fe54df7c653849ab8ec7523262c597cf/snapshots returned with HTTP 202 May 28 12:57:20 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 323/630] 10.27.203.238 () {66 vars in 1371 bytes} [Tue May 28 12:57:20 2024] POST /share/v2/fe54df7c653849ab8ec7523262c597cf/snapshots => generated 774 bytes in 182 msecs (HTTP/1.1 202) 6 headers in 237 bytes (1 switches on core 0) May 28 12:57:20 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-f50bae50-6cc3-4ed8-910b-ae96aed331c3 tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] GET http://10.27.203.238/share/v2/fe54df7c653849ab8ec7523262c597cf/snapshots/ad33850e-6645-4962-a407-4dc7bb8e5045 May 28 12:57:20 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-f50bae50-6cc3-4ed8-910b-ae96aed331c3 tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:20 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-f50bae50-6cc3-4ed8-910b-ae96aed331c3 tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] Calling method 'ShareSnapshotMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:20 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-f50bae50-6cc3-4ed8-910b-ae96aed331c3 tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] http://10.27.203.238/share/v2/fe54df7c653849ab8ec7523262c597cf/snapshots/ad33850e-6645-4962-a407-4dc7bb8e5045 returned with HTTP 200 May 28 12:57:20 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 308/631] 10.27.203.238 () {64 vars in 1460 bytes} [Tue May 28 12:57:20 2024] GET /share/v2/fe54df7c653849ab8ec7523262c597cf/snapshots/ad33850e-6645-4962-a407-4dc7bb8e5045 => generated 774 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:57:20 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-72338d36-e1c6-4716-b1d8-6c3ed27d0e04 tempest-SharesActionsAdminTest-1286316336 None] >>> [POST] https://127.0.0.1:40443/api/snapshots/ May 28 12:57:20 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-72338d36-e1c6-4716-b1d8-6c3ed27d0e04 tempest-SharesActionsAdminTest-1286316336 None] {'data': '{"path": "/manila/manila-7c19614c-d968-4489-b2ad-bd88c2ef8054", ' May 28 12:57:20 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-72338d36-e1c6-4716-b1d8-6c3ed27d0e04 tempest-SharesActionsAdminTest-1286316336 None] '"name": "share-snapshot-ced65a7e-7f74-4c22-bb6e-0b88e0a53b00"}', May 28 12:57:20 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-72338d36-e1c6-4716-b1d8-6c3ed27d0e04 tempest-SharesActionsAdminTest-1286316336 None] 'json': None, May 28 12:57:20 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-72338d36-e1c6-4716-b1d8-6c3ed27d0e04 tempest-SharesActionsAdminTest-1286316336 None] 'params': None} May 28 12:57:20 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bde4066b-d8fb-4c28-8293-2527ac852f8f tempest-SharesMetadataTest-1561320255 None] <<< [GET] https://127.0.0.1:40443/api/vippools/ May 28 12:57:20 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bde4066b-d8fb-4c28-8293-2527ac852f8f tempest-SharesMetadataTest-1561320255 None] [Bunch(active_cnode_ids=[], active_interfaces=4, cluster='loop75-kfs', cluster_id=1, cnode_ids=[], cnodes=[], domain_name='vippool-1', enable_l3=False, enable_weighted_balancing=False, enabled=True, end_ip='172.21.75.4', guid='f2abaede-b397-413a-8faa-3aeead6d3b28', gw_ip='', gw_ipv6='', id=2, ip_ranges=[['172.21.75.1', '172.21.75.4']], name='vippool-1', peer_asn=0, port_membership='ALL', ranges_summary='172.21.75.[1-4]', role='PROTOCOLS', start_ip='172.21.75.1', subnet_cidr=16, subnet_cidr_ipv6=None, sync='SYNCED', sync_time='2024-05-28T12:50:09.644123Z', tenant_id=1, tenant_name='default', title='172.21.75.1 - 172.21.75.4', url='https://127.0.0.1:40443/api/vippools/2/', vast_asn=0, vlan=0, vms_preferred=False)] May 28 12:57:20 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bde4066b-d8fb-4c28-8293-2527ac852f8f tempest-SharesMetadataTest-1561320255 None] --- [GET] https://127.0.0.1:40443/api/vippools/: Done May 28 12:57:20 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bde4066b-d8fb-4c28-8293-2527ac852f8f tempest-SharesMetadataTest-1561320255 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:57:20 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bde4066b-d8fb-4c28-8293-2527ac852f8f tempest-SharesMetadataTest-1561320255 None] {'allow_redirects': True, May 28 12:57:20 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bde4066b-d8fb-4c28-8293-2527ac852f8f tempest-SharesMetadataTest-1561320255 None] 'params': {'name': '5a6db1ad-927e-4228-b973-3ff998e29ada'}} May 28 12:57:21 l75lg1-v1 dstat.sh[49771]: 28-05 12:57:21| 5 1 91 2 0|5681M 1815M 277M 7852M| 13k 2226B| 0 1586k| 0 199 |4418 7382 |1.58 1.03 1.00|2.0 0 0| 0 0 | 0 2048M| 29 351 0 85 0 May 28 12:57:21 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bde4066b-d8fb-4c28-8293-2527ac852f8f tempest-SharesMetadataTest-1561320255 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:57:21 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bde4066b-d8fb-4c28-8293-2527ac852f8f tempest-SharesMetadataTest-1561320255 None] [] May 28 12:57:21 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bde4066b-d8fb-4c28-8293-2527ac852f8f tempest-SharesMetadataTest-1561320255 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 12:57:21 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bde4066b-d8fb-4c28-8293-2527ac852f8f tempest-SharesMetadataTest-1561320255 None] >>> [POST] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:57:21 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bde4066b-d8fb-4c28-8293-2527ac852f8f tempest-SharesMetadataTest-1561320255 None] {'data': '{"name": "5a6db1ad-927e-4228-b973-3ff998e29ada"}', May 28 12:57:21 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bde4066b-d8fb-4c28-8293-2527ac852f8f tempest-SharesMetadataTest-1561320255 None] 'json': None, May 28 12:57:21 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bde4066b-d8fb-4c28-8293-2527ac852f8f tempest-SharesMetadataTest-1561320255 None] 'params': None} May 28 12:57:21 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-3c0c2fd1-6715-42f7-a2e1-695b3b8b5ece tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] GET http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/shares/c5d9b059-bdd0-4fae-9bd0-328d926e5694 May 28 12:57:21 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-3c0c2fd1-6715-42f7-a2e1-695b3b8b5ece tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:21 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-3c0c2fd1-6715-42f7-a2e1-695b3b8b5ece tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:21 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-3c0c2fd1-6715-42f7-a2e1-695b3b8b5ece tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/shares/c5d9b059-bdd0-4fae-9bd0-328d926e5694 returned with HTTP 200 May 28 12:57:21 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 324/632] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:57:21 2024] GET /share/v2/a3499cb78849424db45e54caac01de92/shares/c5d9b059-bdd0-4fae-9bd0-328d926e5694 => generated 1372 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:57:21 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-43fd2d4e-498e-496d-9063-b98f0eed6641 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] POST http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/shares/c5d9b059-bdd0-4fae-9bd0-328d926e5694/action May 28 12:57:21 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-43fd2d4e-498e-496d-9063-b98f0eed6641 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Action body: b'{"reset_status": {"status": "error_deleting"}}' {{(pid=98330) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:57:21 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-43fd2d4e-498e-496d-9063-b98f0eed6641 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Action: 'action', calling method: ShareController.share_reset_status, body: {"reset_status": {"status": "error_deleting"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:57:21 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-43fd2d4e-498e-496d-9063-b98f0eed6641 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Updating share 'c5d9b059-bdd0-4fae-9bd0-328d926e5694' with '{'status': 'error_deleting'}' {{(pid=98330) _reset_status /opt/stack/manila/manila/api/openstack/wsgi.py:1257}} May 28 12:57:21 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-43fd2d4e-498e-496d-9063-b98f0eed6641 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/shares/c5d9b059-bdd0-4fae-9bd0-328d926e5694/action returned with HTTP 202 May 28 12:57:21 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 309/633] 10.27.203.238 () {66 vars in 1493 bytes} [Tue May 28 12:57:21 2024] POST /share/v2/a3499cb78849424db45e54caac01de92/shares/c5d9b059-bdd0-4fae-9bd0-328d926e5694/action => generated 0 bytes in 55 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:57:21 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-0042f9aa-583e-4804-a34c-2ac2efdd982e tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] GET http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/shares/c5d9b059-bdd0-4fae-9bd0-328d926e5694 May 28 12:57:21 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-0042f9aa-583e-4804-a34c-2ac2efdd982e tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:21 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-0042f9aa-583e-4804-a34c-2ac2efdd982e tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:21 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-0042f9aa-583e-4804-a34c-2ac2efdd982e tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/shares/c5d9b059-bdd0-4fae-9bd0-328d926e5694 returned with HTTP 200 May 28 12:57:21 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 325/634] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:57:21 2024] GET /share/v2/a3499cb78849424db45e54caac01de92/shares/c5d9b059-bdd0-4fae-9bd0-328d926e5694 => generated 1377 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:57:21 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-a26ac8ef-2c95-49c8-896a-27a98ee94388 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] POST http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/shares/c5d9b059-bdd0-4fae-9bd0-328d926e5694/action May 28 12:57:21 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-a26ac8ef-2c95-49c8-896a-27a98ee94388 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Action body: b'{"force_delete": null}' {{(pid=98330) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:57:21 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-a26ac8ef-2c95-49c8-896a-27a98ee94388 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Action: 'action', calling method: ShareController.share_force_delete, body: {"force_delete": null} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:57:21 l75lg1-v1 manila-data[98318]: DEBUG dbcounter [-] [98318] Writing DB stats manila:SELECT=27,manila:UPDATE=6 {{(pid=98318) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:57:21 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-a26ac8ef-2c95-49c8-896a-27a98ee94388 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/shares/c5d9b059-bdd0-4fae-9bd0-328d926e5694/action returned with HTTP 202 May 28 12:57:21 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 310/635] 10.27.203.238 () {66 vars in 1493 bytes} [Tue May 28 12:57:21 2024] POST /share/v2/a3499cb78849424db45e54caac01de92/shares/c5d9b059-bdd0-4fae-9bd0-328d926e5694/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:57:21 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-e2d883a6-e697-438a-b864-ebe658a69dbd tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] GET http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/shares/c5d9b059-bdd0-4fae-9bd0-328d926e5694 May 28 12:57:21 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-e2d883a6-e697-438a-b864-ebe658a69dbd tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:21 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-e2d883a6-e697-438a-b864-ebe658a69dbd tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:21 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-e2d883a6-e697-438a-b864-ebe658a69dbd tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/shares/c5d9b059-bdd0-4fae-9bd0-328d926e5694 returned with HTTP 200 May 28 12:57:21 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 326/636] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:57:21 2024] GET /share/v2/a3499cb78849424db45e54caac01de92/shares/c5d9b059-bdd0-4fae-9bd0-328d926e5694 => generated 1371 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:57:21 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-a26ac8ef-2c95-49c8-896a-27a98ee94388 tempest-AdminActionsTest-1749172189 None] Acquiring lock "locked_access_rules_operation_by_share_instance_891641f2-366e-4b85-925e-8cffaa759ace" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:57:21 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-a26ac8ef-2c95-49c8-896a-27a98ee94388 tempest-AdminActionsTest-1749172189 None] Lock "locked_access_rules_operation_by_share_instance_891641f2-366e-4b85-925e-8cffaa759ace" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:57:21 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-a26ac8ef-2c95-49c8-896a-27a98ee94388 tempest-AdminActionsTest-1749172189 None] Lock "locked_access_rules_operation_by_share_instance_891641f2-366e-4b85-925e-8cffaa759ace" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:57:21 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-a26ac8ef-2c95-49c8-896a-27a98ee94388 tempest-AdminActionsTest-1749172189 None] Acquiring lock "locked_access_rules_operation_by_share_instance_891641f2-366e-4b85-925e-8cffaa759ace" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:57:21 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-a26ac8ef-2c95-49c8-896a-27a98ee94388 tempest-AdminActionsTest-1749172189 None] Lock "locked_access_rules_operation_by_share_instance_891641f2-366e-4b85-925e-8cffaa759ace" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:57:21 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-a26ac8ef-2c95-49c8-896a-27a98ee94388 tempest-AdminActionsTest-1749172189 None] Lock "locked_access_rules_operation_by_share_instance_891641f2-366e-4b85-925e-8cffaa759ace" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:57:21 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-a26ac8ef-2c95-49c8-896a-27a98ee94388 tempest-AdminActionsTest-1749172189 None] Acquiring lock "locked_access_rules_operation_by_share_instance_891641f2-366e-4b85-925e-8cffaa759ace" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:57:21 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-a26ac8ef-2c95-49c8-896a-27a98ee94388 tempest-AdminActionsTest-1749172189 None] Lock "locked_access_rules_operation_by_share_instance_891641f2-366e-4b85-925e-8cffaa759ace" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:57:21 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-a26ac8ef-2c95-49c8-896a-27a98ee94388 tempest-AdminActionsTest-1749172189 None] Lock "locked_access_rules_operation_by_share_instance_891641f2-366e-4b85-925e-8cffaa759ace" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:57:21 l75lg1-v1 manila-share[98474]: DEBUG manila.share.access [None req-a26ac8ef-2c95-49c8-896a-27a98ee94388 tempest-AdminActionsTest-1749172189 None] All access rules have been synced for share instance 891641f2-366e-4b85-925e-8cffaa759ace belonging to share c5d9b059-bdd0-4fae-9bd0-328d926e5694. {{(pid=98474) update_access_rules /opt/stack/manila/manila/share/access.py:304}} May 28 12:57:21 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-a26ac8ef-2c95-49c8-896a-27a98ee94388 tempest-AdminActionsTest-1749172189 None] deleting '/manila/manila-891641f2-366e-4b85-925e-8cffaa759ace' May 28 12:57:21 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a26ac8ef-2c95-49c8-896a-27a98ee94388 tempest-AdminActionsTest-1749172189 None] >>> [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/ May 28 12:57:21 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a26ac8ef-2c95-49c8-896a-27a98ee94388 tempest-AdminActionsTest-1749172189 None] {'data': '{"path": "/manila/manila-891641f2-366e-4b85-925e-8cffaa759ace"}', May 28 12:57:21 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a26ac8ef-2c95-49c8-896a-27a98ee94388 tempest-AdminActionsTest-1749172189 None] 'params': None} May 28 12:57:21 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-be8d4aeb-953f-4858-a651-4cb3d6782ee7 tempest-AccessesMetadataNegativeTest-1660907003 tempest-AccessesMetadataNegativeTest-1660907003-project-member] GET http://10.27.203.238/share/v2/ed83204ad63946bdae288892bd07d115/shares/1b8e12e8-6d99-48c0-8368-d1a37e2ca2ca May 28 12:57:21 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-be8d4aeb-953f-4858-a651-4cb3d6782ee7 tempest-AccessesMetadataNegativeTest-1660907003 tempest-AccessesMetadataNegativeTest-1660907003-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:21 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-be8d4aeb-953f-4858-a651-4cb3d6782ee7 tempest-AccessesMetadataNegativeTest-1660907003 tempest-AccessesMetadataNegativeTest-1660907003-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:21 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-be8d4aeb-953f-4858-a651-4cb3d6782ee7 tempest-AccessesMetadataNegativeTest-1660907003 tempest-AccessesMetadataNegativeTest-1660907003-project-member] http://10.27.203.238/share/v2/ed83204ad63946bdae288892bd07d115/shares/1b8e12e8-6d99-48c0-8368-d1a37e2ca2ca returned with HTTP 200 May 28 12:57:21 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 311/637] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:57:21 2024] GET /share/v2/ed83204ad63946bdae288892bd07d115/shares/1b8e12e8-6d99-48c0-8368-d1a37e2ca2ca => generated 1317 bytes in 24 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:57:21 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-b1ec6779-218a-4ef1-b16b-863f32a2e840 tempest-AccessesMetadataNegativeTest-1660907003 tempest-AccessesMetadataNegativeTest-1660907003-project-member] POST http://10.27.203.238/share/v2/ed83204ad63946bdae288892bd07d115/shares/1b8e12e8-6d99-48c0-8368-d1a37e2ca2ca/action May 28 12:57:21 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-b1ec6779-218a-4ef1-b16b-863f32a2e840 tempest-AccessesMetadataNegativeTest-1660907003 tempest-AccessesMetadataNegativeTest-1660907003-project-member] Action body: b'{"allow_access": {"access_type": "ip", "access_to": "203.0.113.93", "access_level": "rw", "metadata": {"key1": "value1"}}}' {{(pid=98329) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:57:21 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-b1ec6779-218a-4ef1-b16b-863f32a2e840 tempest-AccessesMetadataNegativeTest-1660907003 tempest-AccessesMetadataNegativeTest-1660907003-project-member] Action: 'action', calling method: ShareController.allow_access, body: {"allow_access": {"access_type": "ip", "access_to": "203.0.113.93", "access_level": "rw", "metadata": {"key1": "value1"}}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:57:21 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a26ac8ef-2c95-49c8-896a-27a98ee94388 tempest-AdminActionsTest-1749172189 None] <<< [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/ May 28 12:57:21 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a26ac8ef-2c95-49c8-896a-27a98ee94388 tempest-AdminActionsTest-1749172189 None] 'OK' May 28 12:57:21 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a26ac8ef-2c95-49c8-896a-27a98ee94388 tempest-AdminActionsTest-1749172189 None] --- [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/: Done May 28 12:57:21 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a26ac8ef-2c95-49c8-896a-27a98ee94388 tempest-AdminActionsTest-1749172189 None] >>> [GET] https://127.0.0.1:40443/api/views/ May 28 12:57:21 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a26ac8ef-2c95-49c8-896a-27a98ee94388 tempest-AdminActionsTest-1749172189 None] {'allow_redirects': True, May 28 12:57:21 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a26ac8ef-2c95-49c8-896a-27a98ee94388 tempest-AdminActionsTest-1749172189 None] 'params': {'name': '891641f2-366e-4b85-925e-8cffaa759ace'}} May 28 12:57:21 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-7e487fb0-2b13-4c23-b5f0-0d7b8eb77169 tempest-ShareSnapshotInstancesTest-843694899 tempest-ShareSnapshotInstancesTest-843694899-project-admin] GET http://10.27.203.238/share/v2/f4f7702aa04c467288cc6b142f61ec37/snapshots/06828ea4-ef00-439f-b57a-9d726e3f2e62 May 28 12:57:21 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-7e487fb0-2b13-4c23-b5f0-0d7b8eb77169 tempest-ShareSnapshotInstancesTest-843694899 tempest-ShareSnapshotInstancesTest-843694899-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:21 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-7e487fb0-2b13-4c23-b5f0-0d7b8eb77169 tempest-ShareSnapshotInstancesTest-843694899 tempest-ShareSnapshotInstancesTest-843694899-project-admin] Calling method 'ShareSnapshotMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:21 l75lg1-v1 devstack@m-api.service[98329]: DEBUG oslo_concurrency.lockutils [None req-b1ec6779-218a-4ef1-b16b-863f32a2e840 tempest-AccessesMetadataNegativeTest-1660907003 tempest-AccessesMetadataNegativeTest-1660907003-project-member] Acquiring lock "locked_access_rules_operation_by_share_instance_113739f1-d41a-4f4e-b63f-071e2ecd0a7b" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98329) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:57:21 l75lg1-v1 devstack@m-api.service[98329]: DEBUG oslo_concurrency.lockutils [None req-b1ec6779-218a-4ef1-b16b-863f32a2e840 tempest-AccessesMetadataNegativeTest-1660907003 tempest-AccessesMetadataNegativeTest-1660907003-project-member] Lock "locked_access_rules_operation_by_share_instance_113739f1-d41a-4f4e-b63f-071e2ecd0a7b" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98329) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:57:21 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-7e487fb0-2b13-4c23-b5f0-0d7b8eb77169 tempest-ShareSnapshotInstancesTest-843694899 tempest-ShareSnapshotInstancesTest-843694899-project-admin] http://10.27.203.238/share/v2/f4f7702aa04c467288cc6b142f61ec37/snapshots/06828ea4-ef00-439f-b57a-9d726e3f2e62 returned with HTTP 200 May 28 12:57:21 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 312/638] 10.27.203.238 () {64 vars in 1460 bytes} [Tue May 28 12:57:21 2024] GET /share/v2/f4f7702aa04c467288cc6b142f61ec37/snapshots/06828ea4-ef00-439f-b57a-9d726e3f2e62 => generated 749 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:57:22 l75lg1-v1 devstack@m-api.service[98329]: DEBUG oslo_concurrency.lockutils [None req-b1ec6779-218a-4ef1-b16b-863f32a2e840 tempest-AccessesMetadataNegativeTest-1660907003 tempest-AccessesMetadataNegativeTest-1660907003-project-member] Lock "locked_access_rules_operation_by_share_instance_113739f1-d41a-4f4e-b63f-071e2ecd0a7b" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.046s {{(pid=98329) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:57:22 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-b1ec6779-218a-4ef1-b16b-863f32a2e840 tempest-AccessesMetadataNegativeTest-1660907003 tempest-AccessesMetadataNegativeTest-1660907003-project-member] http://10.27.203.238/share/v2/ed83204ad63946bdae288892bd07d115/shares/1b8e12e8-6d99-48c0-8368-d1a37e2ca2ca/action returned with HTTP 200 May 28 12:57:22 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 327/639] 10.27.203.238 () {66 vars in 1494 bytes} [Tue May 28 12:57:21 2024] POST /share/v2/ed83204ad63946bdae288892bd07d115/shares/1b8e12e8-6d99-48c0-8368-d1a37e2ca2ca/action => generated 326 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:57:22 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-5b6195fa-52e5-41e0-bcd8-47684edbf086 tempest-AccessesMetadataNegativeTest-1660907003 tempest-AccessesMetadataNegativeTest-1660907003-project-member] DELETE http://10.27.203.238/share/v2/ed83204ad63946bdae288892bd07d115/share-access-rules/aa413e06-7a77-4e6e-9e6b-33eaeb1fc1c3/metadata/wrong_key May 28 12:57:22 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-5b6195fa-52e5-41e0-bcd8-47684edbf086 tempest-AccessesMetadataNegativeTest-1660907003 tempest-AccessesMetadataNegativeTest-1660907003-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:22 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-5b6195fa-52e5-41e0-bcd8-47684edbf086 tempest-AccessesMetadataNegativeTest-1660907003 tempest-AccessesMetadataNegativeTest-1660907003-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:22 l75lg1-v1 manila-share[98474]: DEBUG manila.share.manager [None req-b1ec6779-218a-4ef1-b16b-863f32a2e840 tempest-AccessesMetadataNegativeTest-1660907003 None] Received request to update access for share instance 113739f1-d41a-4f4e-b63f-071e2ecd0a7b. {{(pid=98474) update_access_for_instances /opt/stack/manila/manila/share/manager.py:4353}} May 28 12:57:22 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-b1ec6779-218a-4ef1-b16b-863f32a2e840 tempest-AccessesMetadataNegativeTest-1660907003 None] Acquiring lock "locked_access_rules_operation_by_share_instance_113739f1-d41a-4f4e-b63f-071e2ecd0a7b" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:57:22 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-b1ec6779-218a-4ef1-b16b-863f32a2e840 tempest-AccessesMetadataNegativeTest-1660907003 None] Lock "locked_access_rules_operation_by_share_instance_113739f1-d41a-4f4e-b63f-071e2ecd0a7b" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:57:22 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-5b6195fa-52e5-41e0-bcd8-47684edbf086 tempest-AccessesMetadataNegativeTest-1660907003 tempest-AccessesMetadataNegativeTest-1660907003-project-member] HTTP exception thrown: Share access rule metadata does not exist. May 28 12:57:22 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-5b6195fa-52e5-41e0-bcd8-47684edbf086 tempest-AccessesMetadataNegativeTest-1660907003 tempest-AccessesMetadataNegativeTest-1660907003-project-member] http://10.27.203.238/share/v2/ed83204ad63946bdae288892bd07d115/share-access-rules/aa413e06-7a77-4e6e-9e6b-33eaeb1fc1c3/metadata/wrong_key returned with HTTP 404 May 28 12:57:22 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 313/640] 10.27.203.238 () {64 vars in 1547 bytes} [Tue May 28 12:57:22 2024] DELETE /share/v2/ed83204ad63946bdae288892bd07d115/share-access-rules/aa413e06-7a77-4e6e-9e6b-33eaeb1fc1c3/metadata/wrong_key => generated 88 bytes in 49 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 12:57:22 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-b1ec6779-218a-4ef1-b16b-863f32a2e840 tempest-AccessesMetadataNegativeTest-1660907003 None] Lock "locked_access_rules_operation_by_share_instance_113739f1-d41a-4f4e-b63f-071e2ecd0a7b" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:57:22 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-b1ec6779-218a-4ef1-b16b-863f32a2e840 tempest-AccessesMetadataNegativeTest-1660907003 None] Acquiring lock "locked_access_rules_operation_by_share_instance_113739f1-d41a-4f4e-b63f-071e2ecd0a7b" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:57:22 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-b1ec6779-218a-4ef1-b16b-863f32a2e840 tempest-AccessesMetadataNegativeTest-1660907003 None] Lock "locked_access_rules_operation_by_share_instance_113739f1-d41a-4f4e-b63f-071e2ecd0a7b" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:57:22 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-3ddcde64-ff41-4230-8df1-f0acf6b5325e tempest-AccessesMetadataNegativeTest-1660907003 tempest-AccessesMetadataNegativeTest-1660907003-project-member] PUT http://10.27.203.238/share/v2/ed83204ad63946bdae288892bd07d115/share-access-rules/aa413e06-7a77-4e6e-9e6b-33eaeb1fc1c3/metadata May 28 12:57:22 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-3ddcde64-ff41-4230-8df1-f0acf6b5325e tempest-AccessesMetadataNegativeTest-1660907003 tempest-AccessesMetadataNegativeTest-1660907003-project-member] Action: 'update', calling method: Controller.__getattribute__..version_select, body: {"metadata": {"": "value"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:57:22 l75lg1-v1 manila-scheduler[98327]: DEBUG dbcounter [-] [98327] Writing DB stats manila:SELECT=184,manila:UPDATE=22,manila:DELETE=1 {{(pid=98327) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:57:22 l75lg1-v1 devstack@m-api.service[98329]: WARNING manila.api.common [None req-3ddcde64-ff41-4230-8df1-f0acf6b5325e tempest-AccessesMetadataNegativeTest-1660907003 tempest-AccessesMetadataNegativeTest-1660907003-project-member] Metadata property key is blank. May 28 12:57:22 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-3ddcde64-ff41-4230-8df1-f0acf6b5325e tempest-AccessesMetadataNegativeTest-1660907003 tempest-AccessesMetadataNegativeTest-1660907003-project-member] HTTP exception thrown: Invalid metadata. May 28 12:57:22 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-3ddcde64-ff41-4230-8df1-f0acf6b5325e tempest-AccessesMetadataNegativeTest-1660907003 tempest-AccessesMetadataNegativeTest-1660907003-project-member] http://10.27.203.238/share/v2/ed83204ad63946bdae288892bd07d115/share-access-rules/aa413e06-7a77-4e6e-9e6b-33eaeb1fc1c3/metadata returned with HTTP 400 May 28 12:57:22 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 328/641] 10.27.203.238 () {66 vars in 1534 bytes} [Tue May 28 12:57:22 2024] PUT /share/v2/ed83204ad63946bdae288892bd07d115/share-access-rules/aa413e06-7a77-4e6e-9e6b-33eaeb1fc1c3/metadata => generated 61 bytes in 43 msecs (HTTP/1.1 400) 6 headers in 239 bytes (1 switches on core 0) May 28 12:57:22 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-3b979f89-a79a-404f-92b3-bd80658e8a9f tempest-AccessesMetadataNegativeTest-1660907003 tempest-AccessesMetadataNegativeTest-1660907003-project-member] PUT http://10.27.203.238/share/v2/ed83204ad63946bdae288892bd07d115/share-access-rules/aa413e06-7a77-4e6e-9e6b-33eaeb1fc1c3/metadata May 28 12:57:22 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-3b979f89-a79a-404f-92b3-bd80658e8a9f tempest-AccessesMetadataNegativeTest-1660907003 tempest-AccessesMetadataNegativeTest-1660907003-project-member] Action: 'update', calling method: Controller.__getattribute__..version_select, body: {"metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "value"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:57:22 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-b1ec6779-218a-4ef1-b16b-863f32a2e840 tempest-AccessesMetadataNegativeTest-1660907003 None] Lock "locked_access_rules_operation_by_share_instance_113739f1-d41a-4f4e-b63f-071e2ecd0a7b" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.058s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:57:22 l75lg1-v1 manila-share[98474]: DEBUG manila.share.access [None req-b1ec6779-218a-4ef1-b16b-863f32a2e840 tempest-AccessesMetadataNegativeTest-1660907003 None] Updating access rules for share instance 113739f1-d41a-4f4e-b63f-071e2ecd0a7b belonging to share 1b8e12e8-6d99-48c0-8368-d1a37e2ca2ca. {{(pid=98474) update_access_rules /opt/stack/manila/manila/share/access.py:298}} May 28 12:57:22 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-b1ec6779-218a-4ef1-b16b-863f32a2e840 tempest-AccessesMetadataNegativeTest-1660907003 None] Acquiring lock "locked_access_rules_operation_by_share_instance_113739f1-d41a-4f4e-b63f-071e2ecd0a7b" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:57:22 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-b1ec6779-218a-4ef1-b16b-863f32a2e840 tempest-AccessesMetadataNegativeTest-1660907003 None] Lock "locked_access_rules_operation_by_share_instance_113739f1-d41a-4f4e-b63f-071e2ecd0a7b" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:57:22 l75lg1-v1 devstack@m-api.service[98330]: WARNING manila.api.common [None req-3b979f89-a79a-404f-92b3-bd80658e8a9f tempest-AccessesMetadataNegativeTest-1660907003 tempest-AccessesMetadataNegativeTest-1660907003-project-member] Metadata property key is greater than 255 characters. May 28 12:57:22 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-3b979f89-a79a-404f-92b3-bd80658e8a9f tempest-AccessesMetadataNegativeTest-1660907003 tempest-AccessesMetadataNegativeTest-1660907003-project-member] HTTP exception thrown: Invalid metadata size. May 28 12:57:22 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-3b979f89-a79a-404f-92b3-bd80658e8a9f tempest-AccessesMetadataNegativeTest-1660907003 tempest-AccessesMetadataNegativeTest-1660907003-project-member] http://10.27.203.238/share/v2/ed83204ad63946bdae288892bd07d115/share-access-rules/aa413e06-7a77-4e6e-9e6b-33eaeb1fc1c3/metadata returned with HTTP 400 May 28 12:57:22 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 314/642] 10.27.203.238 () {66 vars in 1535 bytes} [Tue May 28 12:57:22 2024] PUT /share/v2/ed83204ad63946bdae288892bd07d115/share-access-rules/aa413e06-7a77-4e6e-9e6b-33eaeb1fc1c3/metadata => generated 66 bytes in 40 msecs (HTTP/1.1 400) 6 headers in 239 bytes (1 switches on core 0) May 28 12:57:22 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-b1ec6779-218a-4ef1-b16b-863f32a2e840 tempest-AccessesMetadataNegativeTest-1660907003 None] Lock "locked_access_rules_operation_by_share_instance_113739f1-d41a-4f4e-b63f-071e2ecd0a7b" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.008s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:57:22 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-b1ec6779-218a-4ef1-b16b-863f32a2e840 tempest-AccessesMetadataNegativeTest-1660907003 None] Acquiring lock "locked_access_rules_operation_by_share_instance_113739f1-d41a-4f4e-b63f-071e2ecd0a7b" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:57:22 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-b1ec6779-218a-4ef1-b16b-863f32a2e840 tempest-AccessesMetadataNegativeTest-1660907003 None] Lock "locked_access_rules_operation_by_share_instance_113739f1-d41a-4f4e-b63f-071e2ecd0a7b" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:57:22 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-ee9bcccb-3256-4a6e-9217-ad07a96bf840 tempest-AccessesMetadataNegativeTest-1660907003 tempest-AccessesMetadataNegativeTest-1660907003-project-member] PUT http://10.27.203.238/share/v2/ed83204ad63946bdae288892bd07d115/share-access-rules/aa413e06-7a77-4e6e-9e6b-33eaeb1fc1c3/metadata May 28 12:57:22 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-ee9bcccb-3256-4a6e-9217-ad07a96bf840 tempest-AccessesMetadataNegativeTest-1660907003 tempest-AccessesMetadataNegativeTest-1660907003-project-member] Action: 'update', calling method: Controller.__getattribute__..version_select, body: {"metadata": {"key": "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:57:22 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-b1ec6779-218a-4ef1-b16b-863f32a2e840 tempest-AccessesMetadataNegativeTest-1660907003 None] Lock "locked_access_rules_operation_by_share_instance_113739f1-d41a-4f4e-b63f-071e2ecd0a7b" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.016s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:57:22 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-b1ec6779-218a-4ef1-b16b-863f32a2e840 tempest-AccessesMetadataNegativeTest-1660907003 None] changing access on None May 28 12:57:22 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b1ec6779-218a-4ef1-b16b-863f32a2e840 tempest-AccessesMetadataNegativeTest-1660907003 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:57:22 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b1ec6779-218a-4ef1-b16b-863f32a2e840 tempest-AccessesMetadataNegativeTest-1660907003 None] {'allow_redirects': True, May 28 12:57:22 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b1ec6779-218a-4ef1-b16b-863f32a2e840 tempest-AccessesMetadataNegativeTest-1660907003 None] 'params': {'name': '113739f1-d41a-4f4e-b63f-071e2ecd0a7b'}} May 28 12:57:22 l75lg1-v1 devstack@m-api.service[98329]: WARNING manila.api.common [None req-ee9bcccb-3256-4a6e-9217-ad07a96bf840 tempest-AccessesMetadataNegativeTest-1660907003 tempest-AccessesMetadataNegativeTest-1660907003-project-member] Metadata property value is greater than 1023 characters. May 28 12:57:22 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-ee9bcccb-3256-4a6e-9217-ad07a96bf840 tempest-AccessesMetadataNegativeTest-1660907003 tempest-AccessesMetadataNegativeTest-1660907003-project-member] HTTP exception thrown: Invalid metadata size. May 28 12:57:22 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-ee9bcccb-3256-4a6e-9217-ad07a96bf840 tempest-AccessesMetadataNegativeTest-1660907003 tempest-AccessesMetadataNegativeTest-1660907003-project-member] http://10.27.203.238/share/v2/ed83204ad63946bdae288892bd07d115/share-access-rules/aa413e06-7a77-4e6e-9e6b-33eaeb1fc1c3/metadata returned with HTTP 400 May 28 12:57:22 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 329/643] 10.27.203.238 () {66 vars in 1536 bytes} [Tue May 28 12:57:22 2024] PUT /share/v2/ed83204ad63946bdae288892bd07d115/share-access-rules/aa413e06-7a77-4e6e-9e6b-33eaeb1fc1c3/metadata => generated 66 bytes in 40 msecs (HTTP/1.1 400) 6 headers in 239 bytes (1 switches on core 0) May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0e4c1f-6bef-4c26-8521-5d98a211e0a1 service manila] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-fc0e4c1f-6bef-4c26-8521-5d98a211e0a1 service manila] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:22 l75lg1-v1 dstat.sh[49771]: 28-05 12:57:22| 11 1 87 1 0|5681M 1815M 277M 7852M| 16k 8405B| 0 1503k| 0 179 |5157 8384 |1.53 1.03 1.00|2.0 1.0 0| 0 0 | 0 2048M| 29 352 0 86 0 May 28 12:57:22 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-262aea2e-7992-48e6-864e-791f2d9cbf82 tempest-ShareSnapshotInstancesTest-843694899 None] <<< [POST] https://127.0.0.1:40443/api/snapshots/ May 28 12:57:22 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-262aea2e-7992-48e6-864e-791f2d9cbf82 tempest-ShareSnapshotInstancesTest-843694899 None] Bunch(access_path='/.vast_all_snapshots/1000000001_share-snapshot-43659856-8e64-4da7-83ec-5bc65fe3dbe5', aggr_phys_estimation=0, cluster='loop75-kfs', created='2024-05-28T12:57:19.575149Z', eta_sec=30819898955.76291, expiration_time='3001-01-19T07:59:58Z', guid='1ff1f2fa-e107-4b20-9c15-b7d80f36022a', id=2, indestructible=False, locked=False, name='share-snapshot-43659856-8e64-4da7-83ec-5bc65fe3dbe5', path='/manila/manila-c2f741cd-bac5-499f-9539-8e93d6a81282/', policy=None, policy_id=None, protection_policy_id=None, state='SUCCEED', tenant_id=1, tenant_name='default', title='share-snapshot-43659856-8e64-4da7-83ec-5bc65fe3dbe5(/manila/manila-c2f741cd-bac5-499f-9539-8e93d6a81282/)', type='local', unique_phys_estimation=0, url='https://127.0.0.1:40443/api/snapshots/2/') May 28 12:57:22 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-262aea2e-7992-48e6-864e-791f2d9cbf82 tempest-ShareSnapshotInstancesTest-843694899 None] --- [POST] https://127.0.0.1:40443/api/snapshots/: Done May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0e4c1f-6bef-4c26-8521-5d98a211e0a1 service manila] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:22 l75lg1-v1 manila-share[98474]: DEBUG dbcounter [-] [98474] Writing DB stats manila:SELECT=1588,manila:UPDATE=150,manila:INSERT=54 {{(pid=98474) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbd332f-be44-494f-8133-68de87357244 tempest-AccessesMetadataNegativeTest-850862987 tempest-AccessesMetadataNegativeTest-850862987-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2db2faa187d4ba4baf6b1b73c2fb965', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86b1b2ed568f43c9892e17d54b3c5f78', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbd332f-be44-494f-8133-68de87357244 tempest-AccessesMetadataNegativeTest-850862987 tempest-AccessesMetadataNegativeTest-850862987-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbd332f-be44-494f-8133-68de87357244 tempest-AccessesMetadataNegativeTest-850862987 tempest-AccessesMetadataNegativeTest-850862987-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbd332f-be44-494f-8133-68de87357244 tempest-AccessesMetadataNegativeTest-850862987 tempest-AccessesMetadataNegativeTest-850862987-project-admin] PATH_INFO: `/v3/users/981b3e419ab1466ba64538f100d39f99` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbd332f-be44-494f-8133-68de87357244 tempest-AccessesMetadataNegativeTest-850862987 tempest-AccessesMetadataNegativeTest-850862987-project-admin] RBAC: Authorizing `identity:delete_user(user_id=981b3e419ab1466ba64538f100d39f99)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbd332f-be44-494f-8133-68de87357244 tempest-AccessesMetadataNegativeTest-850862987 tempest-AccessesMetadataNegativeTest-850862987-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-2dbd332f-be44-494f-8133-68de87357244 tempest-AccessesMetadataNegativeTest-850862987 tempest-AccessesMetadataNegativeTest-850862987-project-admin] Could not find user: 981b3e419ab1466ba64538f100d39f99.: keystone.exception.UserNotFound: Could not find user: 981b3e419ab1466ba64538f100d39f99. May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 981b3e419ab1466ba64538f100d39f99. May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 943/1910] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 12:57:22 2024] DELETE /identity/v3/users/981b3e419ab1466ba64538f100d39f99 => generated 110 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 12:57:22 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a26ac8ef-2c95-49c8-896a-27a98ee94388 tempest-AdminActionsTest-1749172189 None] <<< [GET] https://127.0.0.1:40443/api/views/ May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccedf69d-6ef5-45e3-910d-e3e54e163b5e service manila] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:22 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a26ac8ef-2c95-49c8-896a-27a98ee94388 tempest-AdminActionsTest-1749172189 None] [Bunch(abac_tags=[], abe_max_depth=None, abe_protocols=[], alias='', allow_anonymous_access=False, allow_s3_anonymous_access=False, auto_commit='0d', bucket='', bucket_creators=[], bucket_creators_groups=[], bucket_owner=None, bulk_permission_update_progress=None, bulk_permission_update_state=None, cluster='loop75-kfs', cluster_id=1, created='2024-05-28T12:57:19.642566Z', enabled=True, files_retention_mode='NONE', guid='562349d7-1894-4ef1-b261-68e441ce36ce', id=15, ignore_oos=False, internal=False, is_remote=False, is_seamless=False, logical_capacity=0, max_retention_period=None, min_retention_period=None, name='891641f2-366e-4b85-925e-8cffaa759ace', nfs_interop_flags='BOTH_NFS3_AND_NFS4_INTEROP_DISABLED', path='/manila/manila-891641f2-366e-4b85-925e-8cffaa759ace', physical_capacity=0, policy='891641f2-366e-4b85-925e-8cffaa759ace', policy_id=16, protocols=['NFS'], qos_policy=None, qos_policy_id=None, s3_locks=False, s3_locks_retention_mode='NONE', s3_locks_retention_period='', s3_unverified_lookup=False, s3_versioning=False, select_for_live_monitoring=False, share='', share_acl=Bunch(acl=[], enabled=False), sync='SYNCED', sync_time='2024-05-28T12:57:19.961239Z', tenant_id=1, tenant_name='default', title='/manila/manila-891641f2-366e-4b85-925e-8cffaa759ace', url='https://127.0.0.1:40443/api/views/15/')] May 28 12:57:22 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a26ac8ef-2c95-49c8-896a-27a98ee94388 tempest-AdminActionsTest-1749172189 None] --- [GET] https://127.0.0.1:40443/api/views/: Done May 28 12:57:22 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a26ac8ef-2c95-49c8-896a-27a98ee94388 tempest-AdminActionsTest-1749172189 None] >>> [DELETE] https://127.0.0.1:40443/api/views/15/ May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccedf69d-6ef5-45e3-910d-e3e54e163b5e service manila] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2676ce-8a43-4626-a408-800ec587568d tempest-AccessesMetadataNegativeTest-850862987 tempest-AccessesMetadataNegativeTest-850862987-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2db2faa187d4ba4baf6b1b73c2fb965', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86b1b2ed568f43c9892e17d54b3c5f78', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2676ce-8a43-4626-a408-800ec587568d tempest-AccessesMetadataNegativeTest-850862987 tempest-AccessesMetadataNegativeTest-850862987-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2676ce-8a43-4626-a408-800ec587568d tempest-AccessesMetadataNegativeTest-850862987 tempest-AccessesMetadataNegativeTest-850862987-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2676ce-8a43-4626-a408-800ec587568d tempest-AccessesMetadataNegativeTest-850862987 tempest-AccessesMetadataNegativeTest-850862987-project-admin] PATH_INFO: `/v3/users/b06cddbef69143b790020ff2c97c502e` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2676ce-8a43-4626-a408-800ec587568d tempest-AccessesMetadataNegativeTest-850862987 tempest-AccessesMetadataNegativeTest-850862987-project-admin] RBAC: Authorizing `identity:delete_user(user_id=b06cddbef69143b790020ff2c97c502e)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2676ce-8a43-4626-a408-800ec587568d tempest-AccessesMetadataNegativeTest-850862987 tempest-AccessesMetadataNegativeTest-850862987-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-cd2676ce-8a43-4626-a408-800ec587568d tempest-AccessesMetadataNegativeTest-850862987 tempest-AccessesMetadataNegativeTest-850862987-project-admin] Could not find user: b06cddbef69143b790020ff2c97c502e.: keystone.exception.UserNotFound: Could not find user: b06cddbef69143b790020ff2c97c502e. May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: b06cddbef69143b790020ff2c97c502e. May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 968/1911] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 12:57:22 2024] DELETE /identity/v3/users/b06cddbef69143b790020ff2c97c502e => generated 110 bytes in 24 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbd332f-be44-494f-8133-68de87357244 tempest-AccessesMetadataNegativeTest-850862987 tempest-AccessesMetadataNegativeTest-850862987-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbd332f-be44-494f-8133-68de87357244 tempest-AccessesMetadataNegativeTest-850862987 tempest-AccessesMetadataNegativeTest-850862987-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7369712-7cfe-49b4-b5e7-5c191a55a5d9 tempest-AccessesMetadataNegativeTest-850862987 tempest-AccessesMetadataNegativeTest-850862987-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2db2faa187d4ba4baf6b1b73c2fb965', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86b1b2ed568f43c9892e17d54b3c5f78', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7369712-7cfe-49b4-b5e7-5c191a55a5d9 tempest-AccessesMetadataNegativeTest-850862987 tempest-AccessesMetadataNegativeTest-850862987-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7369712-7cfe-49b4-b5e7-5c191a55a5d9 tempest-AccessesMetadataNegativeTest-850862987 tempest-AccessesMetadataNegativeTest-850862987-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7369712-7cfe-49b4-b5e7-5c191a55a5d9 tempest-AccessesMetadataNegativeTest-850862987 tempest-AccessesMetadataNegativeTest-850862987-project-admin] PATH_INFO: `/v3/users/6285dcecc86746a7b4eee34cf3c3f672` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7369712-7cfe-49b4-b5e7-5c191a55a5d9 tempest-AccessesMetadataNegativeTest-850862987 tempest-AccessesMetadataNegativeTest-850862987-project-admin] RBAC: Authorizing `identity:delete_user(user_id=6285dcecc86746a7b4eee34cf3c3f672)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7369712-7cfe-49b4-b5e7-5c191a55a5d9 tempest-AccessesMetadataNegativeTest-850862987 tempest-AccessesMetadataNegativeTest-850862987-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-d7369712-7cfe-49b4-b5e7-5c191a55a5d9 tempest-AccessesMetadataNegativeTest-850862987 tempest-AccessesMetadataNegativeTest-850862987-project-admin] Could not find user: 6285dcecc86746a7b4eee34cf3c3f672.: keystone.exception.UserNotFound: Could not find user: 6285dcecc86746a7b4eee34cf3c3f672. May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 6285dcecc86746a7b4eee34cf3c3f672. May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 944/1912] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 12:57:22 2024] DELETE /identity/v3/users/6285dcecc86746a7b4eee34cf3c3f672 => generated 110 bytes in 24 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2676ce-8a43-4626-a408-800ec587568d tempest-AccessesMetadataNegativeTest-850862987 tempest-AccessesMetadataNegativeTest-850862987-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2676ce-8a43-4626-a408-800ec587568d tempest-AccessesMetadataNegativeTest-850862987 tempest-AccessesMetadataNegativeTest-850862987-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f9229c-e209-484f-8f93-cd3378359aaa tempest-AccessesMetadataNegativeTest-850862987 tempest-AccessesMetadataNegativeTest-850862987-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2db2faa187d4ba4baf6b1b73c2fb965', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86b1b2ed568f43c9892e17d54b3c5f78', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f9229c-e209-484f-8f93-cd3378359aaa tempest-AccessesMetadataNegativeTest-850862987 tempest-AccessesMetadataNegativeTest-850862987-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f9229c-e209-484f-8f93-cd3378359aaa tempest-AccessesMetadataNegativeTest-850862987 tempest-AccessesMetadataNegativeTest-850862987-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f9229c-e209-484f-8f93-cd3378359aaa tempest-AccessesMetadataNegativeTest-850862987 tempest-AccessesMetadataNegativeTest-850862987-project-admin] PATH_INFO: `/v3/users/b12d90b85fc7452f83fec53a2941a759` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f9229c-e209-484f-8f93-cd3378359aaa tempest-AccessesMetadataNegativeTest-850862987 tempest-AccessesMetadataNegativeTest-850862987-project-admin] RBAC: Authorizing `identity:delete_user(user_id=b12d90b85fc7452f83fec53a2941a759)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f9229c-e209-484f-8f93-cd3378359aaa tempest-AccessesMetadataNegativeTest-850862987 tempest-AccessesMetadataNegativeTest-850862987-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-94f9229c-e209-484f-8f93-cd3378359aaa tempest-AccessesMetadataNegativeTest-850862987 tempest-AccessesMetadataNegativeTest-850862987-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b12d90b85fc7452f83fec53a2941a759', 'request_id': 'req-94f9229c-e209-484f-8f93-cd3378359aaa'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-94f9229c-e209-484f-8f93-cd3378359aaa tempest-AccessesMetadataNegativeTest-850862987 tempest-AccessesMetadataNegativeTest-850862987-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b12d90b85fc7452f83fec53a2941a759', 'request_id': 'req-94f9229c-e209-484f-8f93-cd3378359aaa'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-94f9229c-e209-484f-8f93-cd3378359aaa tempest-AccessesMetadataNegativeTest-850862987 tempest-AccessesMetadataNegativeTest-850862987-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b12d90b85fc7452f83fec53a2941a759', 'request_id': 'req-94f9229c-e209-484f-8f93-cd3378359aaa'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-94f9229c-e209-484f-8f93-cd3378359aaa tempest-AccessesMetadataNegativeTest-850862987 tempest-AccessesMetadataNegativeTest-850862987-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b12d90b85fc7452f83fec53a2941a759', 'request_id': 'req-94f9229c-e209-484f-8f93-cd3378359aaa'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-94f9229c-e209-484f-8f93-cd3378359aaa tempest-AccessesMetadataNegativeTest-850862987 tempest-AccessesMetadataNegativeTest-850862987-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b12d90b85fc7452f83fec53a2941a759', 'request_id': 'req-94f9229c-e209-484f-8f93-cd3378359aaa'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:22 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 969/1913] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 12:57:22 2024] DELETE /identity/v3/users/b12d90b85fc7452f83fec53a2941a759 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:57:22 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-f46bc65a-0b32-4a86-9b5f-34e69201d093 tempest-AccessesMetadataNegativeTest-1660907003 tempest-AccessesMetadataNegativeTest-1660907003-project-member] GET http://10.27.203.238/share/v2/ed83204ad63946bdae288892bd07d115/share-replicas/detail?share_id=1b8e12e8-6d99-48c0-8368-d1a37e2ca2ca May 28 12:57:22 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-f46bc65a-0b32-4a86-9b5f-34e69201d093 tempest-AccessesMetadataNegativeTest-1660907003 tempest-AccessesMetadataNegativeTest-1660907003-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:22 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-f46bc65a-0b32-4a86-9b5f-34e69201d093 tempest-AccessesMetadataNegativeTest-1660907003 tempest-AccessesMetadataNegativeTest-1660907003-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:22 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-f46bc65a-0b32-4a86-9b5f-34e69201d093 tempest-AccessesMetadataNegativeTest-1660907003 tempest-AccessesMetadataNegativeTest-1660907003-project-member] http://10.27.203.238/share/v2/ed83204ad63946bdae288892bd07d115/share-replicas/detail?share_id=1b8e12e8-6d99-48c0-8368-d1a37e2ca2ca returned with HTTP 200 May 28 12:57:22 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 315/644] 10.27.203.238 () {64 vars in 1476 bytes} [Tue May 28 12:57:22 2024] GET /share/v2/ed83204ad63946bdae288892bd07d115/share-replicas/detail?share_id=1b8e12e8-6d99-48c0-8368-d1a37e2ca2ca => generated 22 bytes in 13 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:57:22 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-3e942cba-0587-4cbb-b520-59523fea767f tempest-AccessesMetadataNegativeTest-1660907003 tempest-AccessesMetadataNegativeTest-1660907003-project-member] DELETE http://10.27.203.238/share/v2/ed83204ad63946bdae288892bd07d115/shares/1b8e12e8-6d99-48c0-8368-d1a37e2ca2ca May 28 12:57:22 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-3e942cba-0587-4cbb-b520-59523fea767f tempest-AccessesMetadataNegativeTest-1660907003 tempest-AccessesMetadataNegativeTest-1660907003-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:22 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-3e942cba-0587-4cbb-b520-59523fea767f tempest-AccessesMetadataNegativeTest-1660907003 tempest-AccessesMetadataNegativeTest-1660907003-project-member] Calling method 'ShareMixin.delete' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:22 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.v1.shares [None req-3e942cba-0587-4cbb-b520-59523fea767f tempest-AccessesMetadataNegativeTest-1660907003 tempest-AccessesMetadataNegativeTest-1660907003-project-member] Delete share with id: 1b8e12e8-6d99-48c0-8368-d1a37e2ca2ca May 28 12:57:22 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bde4066b-d8fb-4c28-8293-2527ac852f8f tempest-SharesMetadataTest-1561320255 None] <<< [POST] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:57:22 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bde4066b-d8fb-4c28-8293-2527ac852f8f tempest-SharesMetadataTest-1561320255 None] Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=0, created='2024-05-28T12:57:22.052824Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='87781126-ccab-4be7-a8c1-9e74530a49c8', id=18, internal=False, is_s3_default_policy=False, name='5a6db1ad-927e-4228-b973-3ff998e29ada', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=[], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['*'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['*'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T12:57:22.447464Z', tenant_id=1, tenant_name='default', title='5a6db1ad-927e-4228-b973-3ff998e29ada', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/18/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[]) May 28 12:57:22 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bde4066b-d8fb-4c28-8293-2527ac852f8f tempest-SharesMetadataTest-1561320255 None] --- [POST] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 12:57:22 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bde4066b-d8fb-4c28-8293-2527ac852f8f tempest-SharesMetadataTest-1561320255 None] >>> [GET] https://127.0.0.1:40443/api/quotas/ May 28 12:57:22 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bde4066b-d8fb-4c28-8293-2527ac852f8f tempest-SharesMetadataTest-1561320255 None] {'allow_redirects': True, May 28 12:57:22 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bde4066b-d8fb-4c28-8293-2527ac852f8f tempest-SharesMetadataTest-1561320255 None] 'params': {'name': '5a6db1ad-927e-4228-b973-3ff998e29ada'}} May 28 12:57:22 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-3e942cba-0587-4cbb-b520-59523fea767f tempest-AccessesMetadataNegativeTest-1660907003 tempest-AccessesMetadataNegativeTest-1660907003-project-member] http://10.27.203.238/share/v2/ed83204ad63946bdae288892bd07d115/shares/1b8e12e8-6d99-48c0-8368-d1a37e2ca2ca returned with HTTP 202 May 28 12:57:22 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 330/645] 10.27.203.238 () {64 vars in 1454 bytes} [Tue May 28 12:57:22 2024] DELETE /share/v2/ed83204ad63946bdae288892bd07d115/shares/1b8e12e8-6d99-48c0-8368-d1a37e2ca2ca => generated 0 bytes in 140 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:57:22 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-7e9a7f7c-04c2-4df4-8f5a-65e148391e5d tempest-AccessesMetadataNegativeTest-1660907003 tempest-AccessesMetadataNegativeTest-1660907003-project-member] GET http://10.27.203.238/share/v2/ed83204ad63946bdae288892bd07d115/shares/1b8e12e8-6d99-48c0-8368-d1a37e2ca2ca May 28 12:57:22 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-7e9a7f7c-04c2-4df4-8f5a-65e148391e5d tempest-AccessesMetadataNegativeTest-1660907003 tempest-AccessesMetadataNegativeTest-1660907003-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:22 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-7e9a7f7c-04c2-4df4-8f5a-65e148391e5d tempest-AccessesMetadataNegativeTest-1660907003 tempest-AccessesMetadataNegativeTest-1660907003-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:22 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-7e9a7f7c-04c2-4df4-8f5a-65e148391e5d tempest-AccessesMetadataNegativeTest-1660907003 tempest-AccessesMetadataNegativeTest-1660907003-project-member] http://10.27.203.238/share/v2/ed83204ad63946bdae288892bd07d115/shares/1b8e12e8-6d99-48c0-8368-d1a37e2ca2ca returned with HTTP 200 May 28 12:57:22 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b1ec6779-218a-4ef1-b16b-863f32a2e840 tempest-AccessesMetadataNegativeTest-1660907003 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:57:22 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 316/646] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:57:22 2024] GET /share/v2/ed83204ad63946bdae288892bd07d115/shares/1b8e12e8-6d99-48c0-8368-d1a37e2ca2ca => generated 1316 bytes in 25 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:57:22 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b1ec6779-218a-4ef1-b16b-863f32a2e840 tempest-AccessesMetadataNegativeTest-1660907003 None] [Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=1, created='2024-05-28T12:57:17.272743Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='a438200f-35fa-44b5-a39f-2a7af61c13bd', id=17, internal=False, is_s3_default_policy=False, name='113739f1-d41a-4f4e-b63f-071e2ecd0a7b', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=[], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['*'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['*'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T12:57:17.574439Z', tenant_id=1, tenant_name='default', title='113739f1-d41a-4f4e-b63f-071e2ecd0a7b', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/17/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[])] May 28 12:57:22 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b1ec6779-218a-4ef1-b16b-863f32a2e840 tempest-AccessesMetadataNegativeTest-1660907003 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 12:57:22 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-b1ec6779-218a-4ef1-b16b-863f32a2e840 tempest-AccessesMetadataNegativeTest-1660907003 None] changing access on /manila/manila-113739f1-d41a-4f4e-b63f-071e2ecd0a7b. Rules: {'nfs_read_write': ['203.0.113.93'], 'nfs_read_only': []} May 28 12:57:22 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b1ec6779-218a-4ef1-b16b-863f32a2e840 tempest-AccessesMetadataNegativeTest-1660907003 None] >>> [PATCH] https://127.0.0.1:40443/api/viewpolicies/17/ May 28 12:57:22 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b1ec6779-218a-4ef1-b16b-863f32a2e840 tempest-AccessesMetadataNegativeTest-1660907003 None] {'data': '{"name": "113739f1-d41a-4f4e-b63f-071e2ecd0a7b", "nfs_no_squash": ' May 28 12:57:22 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b1ec6779-218a-4ef1-b16b-863f32a2e840 tempest-AccessesMetadataNegativeTest-1660907003 None] '["*"], "nfs_root_squash": ["*"], "nfs_read_write": ["203.0.113.93"], ' May 28 12:57:22 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b1ec6779-218a-4ef1-b16b-863f32a2e840 tempest-AccessesMetadataNegativeTest-1660907003 None] '"nfs_read_only": []}', May 28 12:57:22 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b1ec6779-218a-4ef1-b16b-863f32a2e840 tempest-AccessesMetadataNegativeTest-1660907003 None] 'params': None} May 28 12:57:22 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-3e942cba-0587-4cbb-b520-59523fea767f tempest-AccessesMetadataNegativeTest-1660907003 None] Acquiring lock "locked_access_rules_operation_by_share_instance_113739f1-d41a-4f4e-b63f-071e2ecd0a7b" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:57:22 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-3e942cba-0587-4cbb-b520-59523fea767f tempest-AccessesMetadataNegativeTest-1660907003 None] Lock "locked_access_rules_operation_by_share_instance_113739f1-d41a-4f4e-b63f-071e2ecd0a7b" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:57:22 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-3e942cba-0587-4cbb-b520-59523fea767f tempest-AccessesMetadataNegativeTest-1660907003 None] Lock "locked_access_rules_operation_by_share_instance_113739f1-d41a-4f4e-b63f-071e2ecd0a7b" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.058s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:57:22 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-3e942cba-0587-4cbb-b520-59523fea767f tempest-AccessesMetadataNegativeTest-1660907003 None] Acquiring lock "locked_access_rules_operation_by_share_instance_113739f1-d41a-4f4e-b63f-071e2ecd0a7b" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:57:22 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-3e942cba-0587-4cbb-b520-59523fea767f tempest-AccessesMetadataNegativeTest-1660907003 None] Lock "locked_access_rules_operation_by_share_instance_113739f1-d41a-4f4e-b63f-071e2ecd0a7b" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:57:22 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-3e942cba-0587-4cbb-b520-59523fea767f tempest-AccessesMetadataNegativeTest-1660907003 None] Lock "locked_access_rules_operation_by_share_instance_113739f1-d41a-4f4e-b63f-071e2ecd0a7b" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:57:22 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-3e942cba-0587-4cbb-b520-59523fea767f tempest-AccessesMetadataNegativeTest-1660907003 None] Acquiring lock "locked_access_rules_operation_by_share_instance_113739f1-d41a-4f4e-b63f-071e2ecd0a7b" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:57:22 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-3e942cba-0587-4cbb-b520-59523fea767f tempest-AccessesMetadataNegativeTest-1660907003 None] Lock "locked_access_rules_operation_by_share_instance_113739f1-d41a-4f4e-b63f-071e2ecd0a7b" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:57:22 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-3e942cba-0587-4cbb-b520-59523fea767f tempest-AccessesMetadataNegativeTest-1660907003 None] Lock "locked_access_rules_operation_by_share_instance_113739f1-d41a-4f4e-b63f-071e2ecd0a7b" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.057s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:57:22 l75lg1-v1 manila-share[98474]: DEBUG manila.share.access [None req-3e942cba-0587-4cbb-b520-59523fea767f tempest-AccessesMetadataNegativeTest-1660907003 None] Updating access rules for share instance 113739f1-d41a-4f4e-b63f-071e2ecd0a7b belonging to share 1b8e12e8-6d99-48c0-8368-d1a37e2ca2ca. {{(pid=98474) update_access_rules /opt/stack/manila/manila/share/access.py:298}} May 28 12:57:22 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-3e942cba-0587-4cbb-b520-59523fea767f tempest-AccessesMetadataNegativeTest-1660907003 None] Acquiring lock "locked_access_rules_operation_by_share_instance_113739f1-d41a-4f4e-b63f-071e2ecd0a7b" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:57:22 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-3e942cba-0587-4cbb-b520-59523fea767f tempest-AccessesMetadataNegativeTest-1660907003 None] Lock "locked_access_rules_operation_by_share_instance_113739f1-d41a-4f4e-b63f-071e2ecd0a7b" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:57:22 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-3e942cba-0587-4cbb-b520-59523fea767f tempest-AccessesMetadataNegativeTest-1660907003 None] Lock "locked_access_rules_operation_by_share_instance_113739f1-d41a-4f4e-b63f-071e2ecd0a7b" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.007s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:57:22 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-3e942cba-0587-4cbb-b520-59523fea767f tempest-AccessesMetadataNegativeTest-1660907003 None] Acquiring lock "locked_access_rules_operation_by_share_instance_113739f1-d41a-4f4e-b63f-071e2ecd0a7b" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:57:22 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-3e942cba-0587-4cbb-b520-59523fea767f tempest-AccessesMetadataNegativeTest-1660907003 None] Lock "locked_access_rules_operation_by_share_instance_113739f1-d41a-4f4e-b63f-071e2ecd0a7b" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:57:22 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-3e942cba-0587-4cbb-b520-59523fea767f tempest-AccessesMetadataNegativeTest-1660907003 None] Lock "locked_access_rules_operation_by_share_instance_113739f1-d41a-4f4e-b63f-071e2ecd0a7b" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.015s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:57:22 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-3e942cba-0587-4cbb-b520-59523fea767f tempest-AccessesMetadataNegativeTest-1660907003 None] changing access on None May 28 12:57:22 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-3e942cba-0587-4cbb-b520-59523fea767f tempest-AccessesMetadataNegativeTest-1660907003 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:57:22 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-3e942cba-0587-4cbb-b520-59523fea767f tempest-AccessesMetadataNegativeTest-1660907003 None] {'allow_redirects': True, May 28 12:57:22 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-3e942cba-0587-4cbb-b520-59523fea767f tempest-AccessesMetadataNegativeTest-1660907003 None] 'params': {'name': '113739f1-d41a-4f4e-b63f-071e2ecd0a7b'}} May 28 12:57:22 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bde4066b-d8fb-4c28-8293-2527ac852f8f tempest-SharesMetadataTest-1561320255 None] <<< [GET] https://127.0.0.1:40443/api/quotas/ May 28 12:57:22 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bde4066b-d8fb-4c28-8293-2527ac852f8f tempest-SharesMetadataTest-1561320255 None] [] May 28 12:57:22 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bde4066b-d8fb-4c28-8293-2527ac852f8f tempest-SharesMetadataTest-1561320255 None] --- [GET] https://127.0.0.1:40443/api/quotas/: Done May 28 12:57:22 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bde4066b-d8fb-4c28-8293-2527ac852f8f tempest-SharesMetadataTest-1561320255 None] >>> [POST] https://127.0.0.1:40443/api/quotas/ May 28 12:57:22 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bde4066b-d8fb-4c28-8293-2527ac852f8f tempest-SharesMetadataTest-1561320255 None] {'data': '{"name": "5a6db1ad-927e-4228-b973-3ff998e29ada", "path": ' May 28 12:57:22 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bde4066b-d8fb-4c28-8293-2527ac852f8f tempest-SharesMetadataTest-1561320255 None] '"/manila/manila-5a6db1ad-927e-4228-b973-3ff998e29ada", "create_dir": ' May 28 12:57:22 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bde4066b-d8fb-4c28-8293-2527ac852f8f tempest-SharesMetadataTest-1561320255 None] 'true, "hard_limit": 1073741824}', May 28 12:57:22 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bde4066b-d8fb-4c28-8293-2527ac852f8f tempest-SharesMetadataTest-1561320255 None] 'json': None, May 28 12:57:22 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bde4066b-d8fb-4c28-8293-2527ac852f8f tempest-SharesMetadataTest-1561320255 None] 'params': None} May 28 12:57:23 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-3e942cba-0587-4cbb-b520-59523fea767f tempest-AccessesMetadataNegativeTest-1660907003 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:57:23 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-3e942cba-0587-4cbb-b520-59523fea767f tempest-AccessesMetadataNegativeTest-1660907003 None] [Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=1, created='2024-05-28T12:57:17.272743Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='a438200f-35fa-44b5-a39f-2a7af61c13bd', id=17, internal=False, is_s3_default_policy=False, name='113739f1-d41a-4f4e-b63f-071e2ecd0a7b', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=[], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['*'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['*'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T12:57:17.574439Z', tenant_id=1, tenant_name='default', title='113739f1-d41a-4f4e-b63f-071e2ecd0a7b', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/17/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[])] May 28 12:57:23 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-3e942cba-0587-4cbb-b520-59523fea767f tempest-AccessesMetadataNegativeTest-1660907003 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 12:57:23 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-3e942cba-0587-4cbb-b520-59523fea767f tempest-AccessesMetadataNegativeTest-1660907003 None] changing access on /manila/manila-113739f1-d41a-4f4e-b63f-071e2ecd0a7b. Rules: {'nfs_read_write': ['*'], 'nfs_read_only': []} May 28 12:57:23 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-3e942cba-0587-4cbb-b520-59523fea767f tempest-AccessesMetadataNegativeTest-1660907003 None] >>> [PATCH] https://127.0.0.1:40443/api/viewpolicies/17/ May 28 12:57:23 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-3e942cba-0587-4cbb-b520-59523fea767f tempest-AccessesMetadataNegativeTest-1660907003 None] {'data': '{"name": "113739f1-d41a-4f4e-b63f-071e2ecd0a7b", "nfs_no_squash": ' May 28 12:57:23 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-3e942cba-0587-4cbb-b520-59523fea767f tempest-AccessesMetadataNegativeTest-1660907003 None] '["*"], "nfs_root_squash": ["*"], "nfs_read_write": ["*"], ' May 28 12:57:23 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-3e942cba-0587-4cbb-b520-59523fea767f tempest-AccessesMetadataNegativeTest-1660907003 None] '"nfs_read_only": []}', May 28 12:57:23 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-3e942cba-0587-4cbb-b520-59523fea767f tempest-AccessesMetadataNegativeTest-1660907003 None] 'params': None} May 28 12:57:23 l75lg1-v1 dstat.sh[49771]: 28-05 12:57:23| 7 1 90 2 0|5681M 1814M 277M 7852M| 24k 5033B| 0 2050k| 0 261 |4733 7971 |1.53 1.03 1.00|2.0 1.0 0| 0 0 | 0 2048M| 29 351 0 87 0 May 28 12:57:23 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-73a9ed37-8b4b-4769-9000-c398c8e86956 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] GET http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/9e24a210-9e96-45d9-b31c-f6f3377eb0e7 May 28 12:57:23 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-73a9ed37-8b4b-4769-9000-c398c8e86956 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:23 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-73a9ed37-8b4b-4769-9000-c398c8e86956 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:23 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-73a9ed37-8b4b-4769-9000-c398c8e86956 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/9e24a210-9e96-45d9-b31c-f6f3377eb0e7 returned with HTTP 200 May 28 12:57:23 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 331/647] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:57:23 2024] GET /share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/9e24a210-9e96-45d9-b31c-f6f3377eb0e7 => generated 1314 bytes in 30 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:57:23 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-df3d24a6-4adf-400d-8705-d69d4d5f178d tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] GET http://10.27.203.238/share/v2/fe54df7c653849ab8ec7523262c597cf/snapshots/ad33850e-6645-4962-a407-4dc7bb8e5045 May 28 12:57:23 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-df3d24a6-4adf-400d-8705-d69d4d5f178d tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:23 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-df3d24a6-4adf-400d-8705-d69d4d5f178d tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] Calling method 'ShareSnapshotMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:23 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-df3d24a6-4adf-400d-8705-d69d4d5f178d tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] http://10.27.203.238/share/v2/fe54df7c653849ab8ec7523262c597cf/snapshots/ad33850e-6645-4962-a407-4dc7bb8e5045 returned with HTTP 200 May 28 12:57:23 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 317/648] 10.27.203.238 () {64 vars in 1460 bytes} [Tue May 28 12:57:23 2024] GET /share/v2/fe54df7c653849ab8ec7523262c597cf/snapshots/ad33850e-6645-4962-a407-4dc7bb8e5045 => generated 774 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:57:23 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bde4066b-d8fb-4c28-8293-2527ac852f8f tempest-SharesMetadataTest-1561320255 None] <<< [POST] https://127.0.0.1:40443/api/quotas/ May 28 12:57:23 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bde4066b-d8fb-4c28-8293-2527ac852f8f tempest-SharesMetadataTest-1561320255 None] Bunch(cluster='loop75-kfs', cluster_id=1, default_email=None, default_group_quota=None, default_user_quota=None, enable_alarms=True, enable_email_providers=True, grace_period=None, group_quotas=[], guid='baf75465-80a7-4139-a11e-6386234e88cb', hard_limit=1073741824, hard_limit_inodes=None, id=15, internal=False, is_user_quota=False, last_user_quotas_update=None, name='5a6db1ad-927e-4228-b973-3ff998e29ada', num_blocked_users=0, num_exceeded_users=0, path='/manila/manila-5a6db1ad-927e-4228-b973-3ff998e29ada', percent_capacity=0, percent_inodes=None, pretty_grace_period=None, pretty_grace_period_expiration=None, pretty_state='OK (CREATED)', soft_limit=None, soft_limit_inodes=None, state='OK', sync_state='CREATED', system_id=15, tenant_id=1, tenant_name='default', time_to_block=None, title='5a6db1ad-927e-4228-b973-3ff998e29ada', url='https://127.0.0.1:40443/api/quotas/15/', used_capacity=0, used_capacity_tb=0.0, used_effective_capacity=0, used_effective_capacity_tb=0.0, used_inodes=0, used_limited_capacity=0, user_quotas=[]) May 28 12:57:23 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bde4066b-d8fb-4c28-8293-2527ac852f8f tempest-SharesMetadataTest-1561320255 None] --- [POST] https://127.0.0.1:40443/api/quotas/: Done May 28 12:57:23 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bde4066b-d8fb-4c28-8293-2527ac852f8f tempest-SharesMetadataTest-1561320255 None] >>> [GET] https://127.0.0.1:40443/api/views/ May 28 12:57:23 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bde4066b-d8fb-4c28-8293-2527ac852f8f tempest-SharesMetadataTest-1561320255 None] {'allow_redirects': True, May 28 12:57:23 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bde4066b-d8fb-4c28-8293-2527ac852f8f tempest-SharesMetadataTest-1561320255 None] 'params': {'name': '5a6db1ad-927e-4228-b973-3ff998e29ada'}} May 28 12:57:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "_check_child_processes" by "neutron.agent.linux.external_process.ProcessMonitor._check_child_processes" {{(pid=76818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:57:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_concurrency.lockutils [-] Lock "_check_child_processes" acquired by "neutron.agent.linux.external_process.ProcessMonitor._check_child_processes" :: waited 0.001s {{(pid=76818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:57:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_concurrency.lockutils [-] Lock "_check_child_processes" "released" by "neutron.agent.linux.external_process.ProcessMonitor._check_child_processes" :: held 0.002s {{(pid=76818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:57:24 l75lg1-v1 dstat.sh[49771]: 28-05 12:57:24| 2 1 97 1 0|5681M 1814M 277M 7853M| 19k 909B| 0 4215k| 0 92.1 |2001 3045 |1.53 1.03 1.00|1.0 1.0 0| 0 0 | 0 2048M| 29 351 0 87 0 May 28 12:57:24 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b1ec6779-218a-4ef1-b16b-863f32a2e840 tempest-AccessesMetadataNegativeTest-1660907003 None] <<< [PATCH] https://127.0.0.1:40443/api/viewpolicies/17/ May 28 12:57:24 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b1ec6779-218a-4ef1-b16b-863f32a2e840 tempest-AccessesMetadataNegativeTest-1660907003 None] Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=1, created='2024-05-28T12:57:17.272743Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='a438200f-35fa-44b5-a39f-2a7af61c13bd', id=17, internal=False, is_s3_default_policy=False, name='113739f1-d41a-4f4e-b63f-071e2ecd0a7b', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=['*'], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['203.0.113.93'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['203.0.113.93'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='MODIFYING', sync_time='2024-05-28T12:57:23.977506Z', tenant_id=1, tenant_name='default', title='113739f1-d41a-4f4e-b63f-071e2ecd0a7b', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/17/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[]) May 28 12:57:24 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b1ec6779-218a-4ef1-b16b-863f32a2e840 tempest-AccessesMetadataNegativeTest-1660907003 None] --- [PATCH] https://127.0.0.1:40443/api/viewpolicies/17/: Done May 28 12:57:24 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-b1ec6779-218a-4ef1-b16b-863f32a2e840 tempest-AccessesMetadataNegativeTest-1660907003 None] Acquiring lock "locked_access_rules_operation_by_share_instance_113739f1-d41a-4f4e-b63f-071e2ecd0a7b" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:57:24 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-b1ec6779-218a-4ef1-b16b-863f32a2e840 tempest-AccessesMetadataNegativeTest-1660907003 None] Lock "locked_access_rules_operation_by_share_instance_113739f1-d41a-4f4e-b63f-071e2ecd0a7b" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:57:24 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-b1ec6779-218a-4ef1-b16b-863f32a2e840 tempest-AccessesMetadataNegativeTest-1660907003 None] Lock "locked_access_rules_operation_by_share_instance_113739f1-d41a-4f4e-b63f-071e2ecd0a7b" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.033s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:57:24 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-b1ec6779-218a-4ef1-b16b-863f32a2e840 tempest-AccessesMetadataNegativeTest-1660907003 None] Acquiring lock "locked_access_rules_operation_by_share_instance_113739f1-d41a-4f4e-b63f-071e2ecd0a7b" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:57:24 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-b1ec6779-218a-4ef1-b16b-863f32a2e840 tempest-AccessesMetadataNegativeTest-1660907003 None] Lock "locked_access_rules_operation_by_share_instance_113739f1-d41a-4f4e-b63f-071e2ecd0a7b" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:57:24 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-b1ec6779-218a-4ef1-b16b-863f32a2e840 tempest-AccessesMetadataNegativeTest-1660907003 None] Lock "locked_access_rules_operation_by_share_instance_113739f1-d41a-4f4e-b63f-071e2ecd0a7b" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:57:24 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-b1ec6779-218a-4ef1-b16b-863f32a2e840 tempest-AccessesMetadataNegativeTest-1660907003 None] Acquiring lock "locked_access_rules_operation_by_share_instance_113739f1-d41a-4f4e-b63f-071e2ecd0a7b" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:57:24 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-b1ec6779-218a-4ef1-b16b-863f32a2e840 tempest-AccessesMetadataNegativeTest-1660907003 None] Lock "locked_access_rules_operation_by_share_instance_113739f1-d41a-4f4e-b63f-071e2ecd0a7b" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:57:24 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-b1ec6779-218a-4ef1-b16b-863f32a2e840 tempest-AccessesMetadataNegativeTest-1660907003 None] Lock "locked_access_rules_operation_by_share_instance_113739f1-d41a-4f4e-b63f-071e2ecd0a7b" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:57:24 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-b1ec6779-218a-4ef1-b16b-863f32a2e840 tempest-AccessesMetadataNegativeTest-1660907003 None] Acquiring lock "locked_access_rules_operation_by_share_instance_113739f1-d41a-4f4e-b63f-071e2ecd0a7b" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:57:24 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-b1ec6779-218a-4ef1-b16b-863f32a2e840 tempest-AccessesMetadataNegativeTest-1660907003 None] Lock "locked_access_rules_operation_by_share_instance_113739f1-d41a-4f4e-b63f-071e2ecd0a7b" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:57:24 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-b1ec6779-218a-4ef1-b16b-863f32a2e840 tempest-AccessesMetadataNegativeTest-1660907003 None] Lock "locked_access_rules_operation_by_share_instance_113739f1-d41a-4f4e-b63f-071e2ecd0a7b" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:57:24 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-b1ec6779-218a-4ef1-b16b-863f32a2e840 tempest-AccessesMetadataNegativeTest-1660907003 None] Acquiring lock "locked_access_rules_operation_by_share_instance_113739f1-d41a-4f4e-b63f-071e2ecd0a7b" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:57:24 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-b1ec6779-218a-4ef1-b16b-863f32a2e840 tempest-AccessesMetadataNegativeTest-1660907003 None] Lock "locked_access_rules_operation_by_share_instance_113739f1-d41a-4f4e-b63f-071e2ecd0a7b" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:57:24 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bde4066b-d8fb-4c28-8293-2527ac852f8f tempest-SharesMetadataTest-1561320255 None] <<< [GET] https://127.0.0.1:40443/api/views/ May 28 12:57:24 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bde4066b-d8fb-4c28-8293-2527ac852f8f tempest-SharesMetadataTest-1561320255 None] [] May 28 12:57:24 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bde4066b-d8fb-4c28-8293-2527ac852f8f tempest-SharesMetadataTest-1561320255 None] --- [GET] https://127.0.0.1:40443/api/views/: Done May 28 12:57:24 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bde4066b-d8fb-4c28-8293-2527ac852f8f tempest-SharesMetadataTest-1561320255 None] >>> [POST] https://127.0.0.1:40443/api/views/ May 28 12:57:24 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bde4066b-d8fb-4c28-8293-2527ac852f8f tempest-SharesMetadataTest-1561320255 None] {'data': '{"name": "5a6db1ad-927e-4228-b973-3ff998e29ada", "path": ' May 28 12:57:24 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bde4066b-d8fb-4c28-8293-2527ac852f8f tempest-SharesMetadataTest-1561320255 None] '"/manila/manila-5a6db1ad-927e-4228-b973-3ff998e29ada", "policy_id": ' May 28 12:57:24 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bde4066b-d8fb-4c28-8293-2527ac852f8f tempest-SharesMetadataTest-1561320255 None] '18, "create_dir": true, "protocols": ["NFS"]}', May 28 12:57:24 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bde4066b-d8fb-4c28-8293-2527ac852f8f tempest-SharesMetadataTest-1561320255 None] 'json': None, May 28 12:57:24 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bde4066b-d8fb-4c28-8293-2527ac852f8f tempest-SharesMetadataTest-1561320255 None] 'params': None} May 28 12:57:24 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a26ac8ef-2c95-49c8-896a-27a98ee94388 tempest-AdminActionsTest-1749172189 None] <<< [DELETE] https://127.0.0.1:40443/api/views/15/ May 28 12:57:24 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a26ac8ef-2c95-49c8-896a-27a98ee94388 tempest-AdminActionsTest-1749172189 None] --- [DELETE] https://127.0.0.1:40443/api/views/15/: Done May 28 12:57:24 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a26ac8ef-2c95-49c8-896a-27a98ee94388 tempest-AdminActionsTest-1749172189 None] >>> [GET] https://127.0.0.1:40443/api/quotas/ May 28 12:57:24 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a26ac8ef-2c95-49c8-896a-27a98ee94388 tempest-AdminActionsTest-1749172189 None] {'allow_redirects': True, May 28 12:57:24 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a26ac8ef-2c95-49c8-896a-27a98ee94388 tempest-AdminActionsTest-1749172189 None] 'params': {'name': '891641f2-366e-4b85-925e-8cffaa759ace'}} May 28 12:57:24 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-b1ec6779-218a-4ef1-b16b-863f32a2e840 tempest-AccessesMetadataNegativeTest-1660907003 None] Lock "locked_access_rules_operation_by_share_instance_113739f1-d41a-4f4e-b63f-071e2ecd0a7b" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.045s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:57:24 l75lg1-v1 manila-share[98474]: INFO manila.share.access [None req-b1ec6779-218a-4ef1-b16b-863f32a2e840 tempest-AccessesMetadataNegativeTest-1660907003 None] Access rules were successfully modified for share instance 113739f1-d41a-4f4e-b63f-071e2ecd0a7b belonging to share 1b8e12e8-6d99-48c0-8368-d1a37e2ca2ca. May 28 12:57:24 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-bb496541-6e32-42ae-8d43-b7e9a18d652e tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] GET http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/shares/c5d9b059-bdd0-4fae-9bd0-328d926e5694 May 28 12:57:24 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-bb496541-6e32-42ae-8d43-b7e9a18d652e tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:24 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-bb496541-6e32-42ae-8d43-b7e9a18d652e tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:24 l75lg1-v1 devstack@m-api.service[98329]: DEBUG dbcounter [-] [98329] Writing DB stats manila:INSERT=231,manila:SELECT=1312,manila:UPDATE=198 {{(pid=98329) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:57:24 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-bb496541-6e32-42ae-8d43-b7e9a18d652e tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/shares/c5d9b059-bdd0-4fae-9bd0-328d926e5694 returned with HTTP 200 May 28 12:57:24 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 332/649] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:57:24 2024] GET /share/v2/a3499cb78849424db45e54caac01de92/shares/c5d9b059-bdd0-4fae-9bd0-328d926e5694 => generated 1371 bytes in 30 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:57:24 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-b56d51d6-89c3-44a8-afcc-1a24b6d170bb tempest-ShareSnapshotInstancesTest-843694899 tempest-ShareSnapshotInstancesTest-843694899-project-admin] GET http://10.27.203.238/share/v2/f4f7702aa04c467288cc6b142f61ec37/snapshots/06828ea4-ef00-439f-b57a-9d726e3f2e62 May 28 12:57:24 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-b56d51d6-89c3-44a8-afcc-1a24b6d170bb tempest-ShareSnapshotInstancesTest-843694899 tempest-ShareSnapshotInstancesTest-843694899-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:24 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-b56d51d6-89c3-44a8-afcc-1a24b6d170bb tempest-ShareSnapshotInstancesTest-843694899 tempest-ShareSnapshotInstancesTest-843694899-project-admin] Calling method 'ShareSnapshotMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:24 l75lg1-v1 devstack@m-api.service[98330]: DEBUG dbcounter [-] [98330] Writing DB stats manila:SELECT=1583,manila:INSERT=189,manila:UPDATE=372 {{(pid=98330) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:57:25 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-b56d51d6-89c3-44a8-afcc-1a24b6d170bb tempest-ShareSnapshotInstancesTest-843694899 tempest-ShareSnapshotInstancesTest-843694899-project-admin] http://10.27.203.238/share/v2/f4f7702aa04c467288cc6b142f61ec37/snapshots/06828ea4-ef00-439f-b57a-9d726e3f2e62 returned with HTTP 200 May 28 12:57:25 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 318/650] 10.27.203.238 () {64 vars in 1460 bytes} [Tue May 28 12:57:24 2024] GET /share/v2/f4f7702aa04c467288cc6b142f61ec37/snapshots/06828ea4-ef00-439f-b57a-9d726e3f2e62 => generated 750 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:57:25 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-503e57f0-025b-40c9-bde8-cbe9389d91ba tempest-ShareSnapshotInstancesTest-843694899 tempest-ShareSnapshotInstancesTest-843694899-project-admin] GET http://10.27.203.238/share/v2/f4f7702aa04c467288cc6b142f61ec37/snapshots/06828ea4-ef00-439f-b57a-9d726e3f2e62 May 28 12:57:25 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-503e57f0-025b-40c9-bde8-cbe9389d91ba tempest-ShareSnapshotInstancesTest-843694899 tempest-ShareSnapshotInstancesTest-843694899-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:25 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-503e57f0-025b-40c9-bde8-cbe9389d91ba tempest-ShareSnapshotInstancesTest-843694899 tempest-ShareSnapshotInstancesTest-843694899-project-admin] Calling method 'ShareSnapshotMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:25 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-503e57f0-025b-40c9-bde8-cbe9389d91ba tempest-ShareSnapshotInstancesTest-843694899 tempest-ShareSnapshotInstancesTest-843694899-project-admin] http://10.27.203.238/share/v2/f4f7702aa04c467288cc6b142f61ec37/snapshots/06828ea4-ef00-439f-b57a-9d726e3f2e62 returned with HTTP 200 May 28 12:57:25 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 333/651] 10.27.203.238 () {64 vars in 1460 bytes} [Tue May 28 12:57:25 2024] GET /share/v2/f4f7702aa04c467288cc6b142f61ec37/snapshots/06828ea4-ef00-439f-b57a-9d726e3f2e62 => generated 750 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:57:25 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-b8f2493d-9cb9-43ec-beaf-dc90e36dd455 tempest-ShareSnapshotInstancesTest-843694899 tempest-ShareSnapshotInstancesTest-843694899-project-admin] GET http://10.27.203.238/share/v2/f4f7702aa04c467288cc6b142f61ec37/snapshot-instances?snapshot_id=06828ea4-ef00-439f-b57a-9d726e3f2e62 May 28 12:57:25 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-b8f2493d-9cb9-43ec-beaf-dc90e36dd455 tempest-ShareSnapshotInstancesTest-843694899 tempest-ShareSnapshotInstancesTest-843694899-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:25 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-b8f2493d-9cb9-43ec-beaf-dc90e36dd455 tempest-ShareSnapshotInstancesTest-843694899 tempest-ShareSnapshotInstancesTest-843694899-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:25 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-b8f2493d-9cb9-43ec-beaf-dc90e36dd455 tempest-ShareSnapshotInstancesTest-843694899 tempest-ShareSnapshotInstancesTest-843694899-project-admin] http://10.27.203.238/share/v2/f4f7702aa04c467288cc6b142f61ec37/snapshot-instances?snapshot_id=06828ea4-ef00-439f-b57a-9d726e3f2e62 returned with HTTP 200 May 28 12:57:25 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 319/652] 10.27.203.238 () {64 vars in 1473 bytes} [Tue May 28 12:57:25 2024] GET /share/v2/f4f7702aa04c467288cc6b142f61ec37/snapshot-instances?snapshot_id=06828ea4-ef00-439f-b57a-9d726e3f2e62 => generated 150 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:57:25 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-6e9c3cad-2913-44f8-ae51-328748fcb7e4 tempest-ShareSnapshotInstancesTest-843694899 tempest-ShareSnapshotInstancesTest-843694899-project-admin] GET http://10.27.203.238/share/v2/f4f7702aa04c467288cc6b142f61ec37/snapshot-instances/43659856-8e64-4da7-83ec-5bc65fe3dbe5 May 28 12:57:25 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-6e9c3cad-2913-44f8-ae51-328748fcb7e4 tempest-ShareSnapshotInstancesTest-843694899 tempest-ShareSnapshotInstancesTest-843694899-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:25 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-6e9c3cad-2913-44f8-ae51-328748fcb7e4 tempest-ShareSnapshotInstancesTest-843694899 tempest-ShareSnapshotInstancesTest-843694899-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:25 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-6e9c3cad-2913-44f8-ae51-328748fcb7e4 tempest-ShareSnapshotInstancesTest-843694899 tempest-ShareSnapshotInstancesTest-843694899-project-admin] http://10.27.203.238/share/v2/f4f7702aa04c467288cc6b142f61ec37/snapshot-instances/43659856-8e64-4da7-83ec-5bc65fe3dbe5 returned with HTTP 200 May 28 12:57:25 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 334/653] 10.27.203.238 () {64 vars in 1487 bytes} [Tue May 28 12:57:25 2024] GET /share/v2/f4f7702aa04c467288cc6b142f61ec37/snapshot-instances/43659856-8e64-4da7-83ec-5bc65fe3dbe5 => generated 395 bytes in 23 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:57:25 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-55d3eb0b-6abb-4524-8bbf-b44b0fc66afb tempest-ShareSnapshotInstancesTest-843694899 tempest-ShareSnapshotInstancesTest-843694899-project-admin] GET http://10.27.203.238/share/v2/f4f7702aa04c467288cc6b142f61ec37/snapshot-instances May 28 12:57:25 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-55d3eb0b-6abb-4524-8bbf-b44b0fc66afb tempest-ShareSnapshotInstancesTest-843694899 tempest-ShareSnapshotInstancesTest-843694899-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:25 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-55d3eb0b-6abb-4524-8bbf-b44b0fc66afb tempest-ShareSnapshotInstancesTest-843694899 tempest-ShareSnapshotInstancesTest-843694899-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:25 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-55d3eb0b-6abb-4524-8bbf-b44b0fc66afb tempest-ShareSnapshotInstancesTest-843694899 tempest-ShareSnapshotInstancesTest-843694899-project-admin] http://10.27.203.238/share/v2/f4f7702aa04c467288cc6b142f61ec37/snapshot-instances returned with HTTP 200 May 28 12:57:25 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 320/654] 10.27.203.238 () {64 vars in 1376 bytes} [Tue May 28 12:57:25 2024] GET /share/v2/f4f7702aa04c467288cc6b142f61ec37/snapshot-instances => generated 275 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:57:25 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-deaafc37-f53b-4ec1-bc7f-da9a495bc297 tempest-ShareSnapshotInstancesTest-843694899 tempest-ShareSnapshotInstancesTest-843694899-project-admin] GET http://10.27.203.238/share/v2/f4f7702aa04c467288cc6b142f61ec37/snapshot-instances/detail?snapshot_id=06828ea4-ef00-439f-b57a-9d726e3f2e62 May 28 12:57:25 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-deaafc37-f53b-4ec1-bc7f-da9a495bc297 tempest-ShareSnapshotInstancesTest-843694899 tempest-ShareSnapshotInstancesTest-843694899-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:25 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-deaafc37-f53b-4ec1-bc7f-da9a495bc297 tempest-ShareSnapshotInstancesTest-843694899 tempest-ShareSnapshotInstancesTest-843694899-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:25 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-deaafc37-f53b-4ec1-bc7f-da9a495bc297 tempest-ShareSnapshotInstancesTest-843694899 tempest-ShareSnapshotInstancesTest-843694899-project-admin] http://10.27.203.238/share/v2/f4f7702aa04c467288cc6b142f61ec37/snapshot-instances/detail?snapshot_id=06828ea4-ef00-439f-b57a-9d726e3f2e62 returned with HTTP 200 May 28 12:57:25 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 335/655] 10.27.203.238 () {64 vars in 1494 bytes} [Tue May 28 12:57:25 2024] GET /share/v2/f4f7702aa04c467288cc6b142f61ec37/snapshot-instances/detail?snapshot_id=06828ea4-ef00-439f-b57a-9d726e3f2e62 => generated 398 bytes in 26 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:57:25 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-a9484eff-6b2a-4093-beb2-80441a3e7d88 tempest-ShareSnapshotInstancesTest-843694899 tempest-ShareSnapshotInstancesTest-843694899-project-admin] GET http://10.27.203.238/share/v2/f4f7702aa04c467288cc6b142f61ec37/snapshot-instances?snapshot_id=06828ea4-ef00-439f-b57a-9d726e3f2e62 May 28 12:57:25 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-a9484eff-6b2a-4093-beb2-80441a3e7d88 tempest-ShareSnapshotInstancesTest-843694899 tempest-ShareSnapshotInstancesTest-843694899-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:25 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-a9484eff-6b2a-4093-beb2-80441a3e7d88 tempest-ShareSnapshotInstancesTest-843694899 tempest-ShareSnapshotInstancesTest-843694899-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:25 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-72338d36-e1c6-4716-b1d8-6c3ed27d0e04 tempest-SharesActionsAdminTest-1286316336 None] <<< [POST] https://127.0.0.1:40443/api/snapshots/ May 28 12:57:25 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-72338d36-e1c6-4716-b1d8-6c3ed27d0e04 tempest-SharesActionsAdminTest-1286316336 None] Bunch(access_path='/.vast_all_snapshots/1000000002_share-snapshot-ced65a7e-7f74-4c22-bb6e-0b88e0a53b00', aggr_phys_estimation=0, cluster='loop75-kfs', created='2024-05-28T12:57:21.319406Z', eta_sec=30819898952.783264, expiration_time='3001-01-19T07:59:58Z', guid='111e0040-fd12-4ed6-b1aa-539831f66727', id=3, indestructible=False, locked=False, name='share-snapshot-ced65a7e-7f74-4c22-bb6e-0b88e0a53b00', path='/manila/manila-7c19614c-d968-4489-b2ad-bd88c2ef8054/', policy=None, policy_id=None, protection_policy_id=None, state='SUCCEED', tenant_id=1, tenant_name='default', title='share-snapshot-ced65a7e-7f74-4c22-bb6e-0b88e0a53b00(/manila/manila-7c19614c-d968-4489-b2ad-bd88c2ef8054/)', type='local', unique_phys_estimation=0, url='https://127.0.0.1:40443/api/snapshots/3/') May 28 12:57:25 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-72338d36-e1c6-4716-b1d8-6c3ed27d0e04 tempest-SharesActionsAdminTest-1286316336 None] --- [POST] https://127.0.0.1:40443/api/snapshots/: Done May 28 12:57:25 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-a9484eff-6b2a-4093-beb2-80441a3e7d88 tempest-ShareSnapshotInstancesTest-843694899 tempest-ShareSnapshotInstancesTest-843694899-project-admin] http://10.27.203.238/share/v2/f4f7702aa04c467288cc6b142f61ec37/snapshot-instances?snapshot_id=06828ea4-ef00-439f-b57a-9d726e3f2e62 returned with HTTP 200 May 28 12:57:25 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 321/656] 10.27.203.238 () {64 vars in 1473 bytes} [Tue May 28 12:57:25 2024] GET /share/v2/f4f7702aa04c467288cc6b142f61ec37/snapshot-instances?snapshot_id=06828ea4-ef00-439f-b57a-9d726e3f2e62 => generated 150 bytes in 22 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:57:25 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-ad0f4df2-cc05-4f5c-9c4b-93754c9df166 tempest-ShareSnapshotInstancesTest-843694899 tempest-ShareSnapshotInstancesTest-843694899-project-admin] POST http://10.27.203.238/share/v2/f4f7702aa04c467288cc6b142f61ec37/snapshots May 28 12:57:25 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-ad0f4df2-cc05-4f5c-9c4b-93754c9df166 tempest-ShareSnapshotInstancesTest-843694899 tempest-ShareSnapshotInstancesTest-843694899-project-admin] Action: 'create', calling method: ShareSnapshotMixin.create, body: {"snapshot": {"name": "tempest-tempest-created-share-snap-115331545", "force": false, "description": "Tempest's snapshot", "share_id": "b235c40f-7437-4e0c-b44e-321d8e8b1457"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:57:25 l75lg1-v1 dstat.sh[49771]: 28-05 12:57:25| 5 1 93 1 0|5682M 1813M 277M 7853M| 19k 7710B| 0 816k| 0 86.0 |3454 5344 |1.53 1.03 1.00|2.0 0 2.0| 0 0 | 0 2048M| 29 356 0 86 0 May 28 12:57:25 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.v1.share_snapshots [None req-ad0f4df2-cc05-4f5c-9c4b-93754c9df166 tempest-ShareSnapshotInstancesTest-843694899 tempest-ShareSnapshotInstancesTest-843694899-project-admin] Create snapshot from share b235c40f-7437-4e0c-b44e-321d8e8b1457 May 28 12:57:25 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a26ac8ef-2c95-49c8-896a-27a98ee94388 tempest-AdminActionsTest-1749172189 None] <<< [GET] https://127.0.0.1:40443/api/quotas/ May 28 12:57:25 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a26ac8ef-2c95-49c8-896a-27a98ee94388 tempest-AdminActionsTest-1749172189 None] [Bunch(cluster='loop75-kfs', cluster_id=1, default_email=None, default_group_quota=None, default_user_quota=None, enable_alarms=True, enable_email_providers=True, grace_period=None, guid='07d541a7-ad7f-420e-9fef-16e0838b6c7b', hard_limit=1073741824, hard_limit_inodes=None, id=13, internal=False, is_user_quota=False, last_user_quotas_update=None, name='891641f2-366e-4b85-925e-8cffaa759ace', num_blocked_users=0, num_exceeded_users=0, path='/manila/manila-891641f2-366e-4b85-925e-8cffaa759ace', percent_capacity=0, percent_inodes=None, pretty_grace_period=None, pretty_grace_period_expiration=None, pretty_state='OK (CREATED)', soft_limit=None, soft_limit_inodes=None, state='OK', sync_state='CREATED', system_id=13, tenant_id=1, tenant_name='default', time_to_block=None, title='891641f2-366e-4b85-925e-8cffaa759ace', url='https://127.0.0.1:40443/api/quotas/13/', used_capacity=0, used_capacity_tb=0.0, used_effective_capacity=0, used_effective_capacity_tb=0.0, used_inodes=0, used_limited_capacity=0)] May 28 12:57:25 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a26ac8ef-2c95-49c8-896a-27a98ee94388 tempest-AdminActionsTest-1749172189 None] --- [GET] https://127.0.0.1:40443/api/quotas/: Done May 28 12:57:25 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a26ac8ef-2c95-49c8-896a-27a98ee94388 tempest-AdminActionsTest-1749172189 None] >>> [DELETE] https://127.0.0.1:40443/api/quotas/13/ May 28 12:57:25 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.quota [None req-ad0f4df2-cc05-4f5c-9c4b-93754c9df166 tempest-ShareSnapshotInstancesTest-843694899 tempest-ShareSnapshotInstancesTest-843694899-project-admin] Created reservations ['9b763a2f-b396-4353-9bea-e27b5c93cd99', '4edee298-3ac9-4c61-963c-656b9907a82f', 'd5461d14-dae6-45de-9241-7cb6588fca87', '916571d8-7a11-4ac4-aac9-3e90ed008003'] {{(pid=98329) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 12:57:25 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.quota [None req-ad0f4df2-cc05-4f5c-9c4b-93754c9df166 tempest-ShareSnapshotInstancesTest-843694899 tempest-ShareSnapshotInstancesTest-843694899-project-admin] Committed reservations ['9b763a2f-b396-4353-9bea-e27b5c93cd99', '4edee298-3ac9-4c61-963c-656b9907a82f', 'd5461d14-dae6-45de-9241-7cb6588fca87', '916571d8-7a11-4ac4-aac9-3e90ed008003'] {{(pid=98329) commit /opt/stack/manila/manila/quota.py:1063}} May 28 12:57:25 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-ad0f4df2-cc05-4f5c-9c4b-93754c9df166 tempest-ShareSnapshotInstancesTest-843694899 tempest-ShareSnapshotInstancesTest-843694899-project-admin] http://10.27.203.238/share/v2/f4f7702aa04c467288cc6b142f61ec37/snapshots returned with HTTP 202 May 28 12:57:25 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 336/657] 10.27.203.238 () {66 vars in 1371 bytes} [Tue May 28 12:57:25 2024] POST /share/v2/f4f7702aa04c467288cc6b142f61ec37/snapshots => generated 749 bytes in 184 msecs (HTTP/1.1 202) 6 headers in 237 bytes (1 switches on core 0) May 28 12:57:25 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-0dd01fd2-4938-4e65-b482-4387f003720c tempest-ShareSnapshotInstancesTest-843694899 tempest-ShareSnapshotInstancesTest-843694899-project-admin] GET http://10.27.203.238/share/v2/f4f7702aa04c467288cc6b142f61ec37/snapshots/8f61b18a-3a70-47fb-b981-4fcb057a0c26 May 28 12:57:25 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-0dd01fd2-4938-4e65-b482-4387f003720c tempest-ShareSnapshotInstancesTest-843694899 tempest-ShareSnapshotInstancesTest-843694899-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:25 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-0dd01fd2-4938-4e65-b482-4387f003720c tempest-ShareSnapshotInstancesTest-843694899 tempest-ShareSnapshotInstancesTest-843694899-project-admin] Calling method 'ShareSnapshotMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:25 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-0dd01fd2-4938-4e65-b482-4387f003720c tempest-ShareSnapshotInstancesTest-843694899 tempest-ShareSnapshotInstancesTest-843694899-project-admin] http://10.27.203.238/share/v2/f4f7702aa04c467288cc6b142f61ec37/snapshots/8f61b18a-3a70-47fb-b981-4fcb057a0c26 returned with HTTP 200 May 28 12:57:25 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 322/658] 10.27.203.238 () {64 vars in 1460 bytes} [Tue May 28 12:57:25 2024] GET /share/v2/f4f7702aa04c467288cc6b142f61ec37/snapshots/8f61b18a-3a70-47fb-b981-4fcb057a0c26 => generated 749 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:57:25 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ad0f4df2-cc05-4f5c-9c4b-93754c9df166 tempest-ShareSnapshotInstancesTest-843694899 None] >>> [POST] https://127.0.0.1:40443/api/snapshots/ May 28 12:57:25 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ad0f4df2-cc05-4f5c-9c4b-93754c9df166 tempest-ShareSnapshotInstancesTest-843694899 None] {'data': '{"path": "/manila/manila-c2f741cd-bac5-499f-9539-8e93d6a81282", ' May 28 12:57:25 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ad0f4df2-cc05-4f5c-9c4b-93754c9df166 tempest-ShareSnapshotInstancesTest-843694899 None] '"name": "share-snapshot-c7ea0dae-078a-429a-ab92-8154afeab33a"}', May 28 12:57:25 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ad0f4df2-cc05-4f5c-9c4b-93754c9df166 tempest-ShareSnapshotInstancesTest-843694899 None] 'json': None, May 28 12:57:25 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ad0f4df2-cc05-4f5c-9c4b-93754c9df166 tempest-ShareSnapshotInstancesTest-843694899 None] 'params': None} May 28 12:57:25 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bde4066b-d8fb-4c28-8293-2527ac852f8f tempest-SharesMetadataTest-1561320255 None] <<< [POST] https://127.0.0.1:40443/api/views/ May 28 12:57:25 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bde4066b-d8fb-4c28-8293-2527ac852f8f tempest-SharesMetadataTest-1561320255 None] Bunch(abac_tags=[], abe_max_depth=None, abe_protocols=[], alias='', allow_anonymous_access=False, allow_s3_anonymous_access=False, auto_commit='0d', bucket='', bucket_creators=[], bucket_creators_groups=[], bucket_owner=None, bulk_permission_update_progress=None, bulk_permission_update_state=None, cluster='loop75-kfs', cluster_id=1, created='2024-05-28T12:57:25.087651Z', enabled=True, files_retention_mode='NONE', guid='3d1d4674-2606-490b-ae43-88cfba8daced', id=17, ignore_oos=False, internal=False, is_remote=False, is_seamless=False, logical_capacity=0, max_retention_period=None, min_retention_period=None, name='5a6db1ad-927e-4228-b973-3ff998e29ada', nfs_interop_flags='BOTH_NFS3_AND_NFS4_INTEROP_DISABLED', path='/manila/manila-5a6db1ad-927e-4228-b973-3ff998e29ada', physical_capacity=0, policy='5a6db1ad-927e-4228-b973-3ff998e29ada', policy_id=18, protocols=['NFS'], qos_policy=None, qos_policy_id=None, s3_locks=False, s3_locks_retention_mode='NONE', s3_locks_retention_period='', s3_object_ownership_rule='ObjectWriter', s3_unverified_lookup=False, s3_versioning=False, select_for_live_monitoring=False, share='', share_acl=Bunch(acl=[], enabled=False), sync='SYNCED', sync_time='2024-05-28T12:57:25.450440Z', tenant_id=1, tenant_name='default', title='/manila/manila-5a6db1ad-927e-4228-b973-3ff998e29ada', url='https://127.0.0.1:40443/api/views/17/') May 28 12:57:25 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bde4066b-d8fb-4c28-8293-2527ac852f8f tempest-SharesMetadataTest-1561320255 None] --- [POST] https://127.0.0.1:40443/api/views/: Done May 28 12:57:25 l75lg1-v1 manila-share[98474]: INFO manila.share.manager [None req-bde4066b-d8fb-4c28-8293-2527ac852f8f tempest-SharesMetadataTest-1561320255 None] Share instance 5a6db1ad-927e-4228-b973-3ff998e29ada created successfully. May 28 12:57:25 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-f177635e-5777-4d00-b423-339cffec5733 tempest-AccessesMetadataNegativeTest-1660907003 tempest-AccessesMetadataNegativeTest-1660907003-project-member] GET http://10.27.203.238/share/v2/ed83204ad63946bdae288892bd07d115/shares/1b8e12e8-6d99-48c0-8368-d1a37e2ca2ca May 28 12:57:25 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-f177635e-5777-4d00-b423-339cffec5733 tempest-AccessesMetadataNegativeTest-1660907003 tempest-AccessesMetadataNegativeTest-1660907003-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:25 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-f177635e-5777-4d00-b423-339cffec5733 tempest-AccessesMetadataNegativeTest-1660907003 tempest-AccessesMetadataNegativeTest-1660907003-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:25 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-f177635e-5777-4d00-b423-339cffec5733 tempest-AccessesMetadataNegativeTest-1660907003 tempest-AccessesMetadataNegativeTest-1660907003-project-member] http://10.27.203.238/share/v2/ed83204ad63946bdae288892bd07d115/shares/1b8e12e8-6d99-48c0-8368-d1a37e2ca2ca returned with HTTP 200 May 28 12:57:25 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 337/659] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:57:25 2024] GET /share/v2/ed83204ad63946bdae288892bd07d115/shares/1b8e12e8-6d99-48c0-8368-d1a37e2ca2ca => generated 1316 bytes in 27 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:57:25 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_service.periodic_task [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85846) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:57:25 l75lg1-v1 cinder-volume[85846]: DEBUG cinder.volume.drivers.lvm [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] Updating volume stats {{(pid=85846) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}} May 28 12:57:25 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:390}} May 28 12:57:25 l75lg1-v1 sudo[98788]: vastdata : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 May 28 12:57:25 l75lg1-v1 sudo[98788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) May 28 12:57:25 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-3e942cba-0587-4cbb-b520-59523fea767f tempest-AccessesMetadataNegativeTest-1660907003 None] <<< [PATCH] https://127.0.0.1:40443/api/viewpolicies/17/ May 28 12:57:25 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-3e942cba-0587-4cbb-b520-59523fea767f tempest-AccessesMetadataNegativeTest-1660907003 None] Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=1, created='2024-05-28T12:57:17.272743Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='a438200f-35fa-44b5-a39f-2a7af61c13bd', id=17, internal=False, is_s3_default_policy=False, name='113739f1-d41a-4f4e-b63f-071e2ecd0a7b', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=['*'], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['*'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['*'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='MODIFYING', sync_time='2024-05-28T12:57:25.108174Z', tenant_id=1, tenant_name='default', title='113739f1-d41a-4f4e-b63f-071e2ecd0a7b', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/17/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[]) May 28 12:57:25 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-3e942cba-0587-4cbb-b520-59523fea767f tempest-AccessesMetadataNegativeTest-1660907003 None] --- [PATCH] https://127.0.0.1:40443/api/viewpolicies/17/: Done May 28 12:57:25 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-3e942cba-0587-4cbb-b520-59523fea767f tempest-AccessesMetadataNegativeTest-1660907003 None] Acquiring lock "locked_access_rules_operation_by_share_instance_113739f1-d41a-4f4e-b63f-071e2ecd0a7b" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:57:25 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-3e942cba-0587-4cbb-b520-59523fea767f tempest-AccessesMetadataNegativeTest-1660907003 None] Lock "locked_access_rules_operation_by_share_instance_113739f1-d41a-4f4e-b63f-071e2ecd0a7b" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:57:25 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-3e942cba-0587-4cbb-b520-59523fea767f tempest-AccessesMetadataNegativeTest-1660907003 None] Lock "locked_access_rules_operation_by_share_instance_113739f1-d41a-4f4e-b63f-071e2ecd0a7b" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.033s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:57:25 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-3e942cba-0587-4cbb-b520-59523fea767f tempest-AccessesMetadataNegativeTest-1660907003 None] Acquiring lock "locked_access_rules_operation_by_share_instance_113739f1-d41a-4f4e-b63f-071e2ecd0a7b" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:57:25 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-3e942cba-0587-4cbb-b520-59523fea767f tempest-AccessesMetadataNegativeTest-1660907003 None] Lock "locked_access_rules_operation_by_share_instance_113739f1-d41a-4f4e-b63f-071e2ecd0a7b" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:57:26 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-3e942cba-0587-4cbb-b520-59523fea767f tempest-AccessesMetadataNegativeTest-1660907003 None] Lock "locked_access_rules_operation_by_share_instance_113739f1-d41a-4f4e-b63f-071e2ecd0a7b" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.030s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:57:26 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-3e942cba-0587-4cbb-b520-59523fea767f tempest-AccessesMetadataNegativeTest-1660907003 None] Acquiring lock "locked_access_rules_operation_by_share_instance_113739f1-d41a-4f4e-b63f-071e2ecd0a7b" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:57:26 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-3e942cba-0587-4cbb-b520-59523fea767f tempest-AccessesMetadataNegativeTest-1660907003 None] Lock "locked_access_rules_operation_by_share_instance_113739f1-d41a-4f4e-b63f-071e2ecd0a7b" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:57:26 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-3e942cba-0587-4cbb-b520-59523fea767f tempest-AccessesMetadataNegativeTest-1660907003 None] Lock "locked_access_rules_operation_by_share_instance_113739f1-d41a-4f4e-b63f-071e2ecd0a7b" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:57:26 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-3e942cba-0587-4cbb-b520-59523fea767f tempest-AccessesMetadataNegativeTest-1660907003 None] Acquiring lock "locked_access_rules_operation_by_share_instance_113739f1-d41a-4f4e-b63f-071e2ecd0a7b" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:57:26 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-3e942cba-0587-4cbb-b520-59523fea767f tempest-AccessesMetadataNegativeTest-1660907003 None] Lock "locked_access_rules_operation_by_share_instance_113739f1-d41a-4f4e-b63f-071e2ecd0a7b" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:57:26 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-3e942cba-0587-4cbb-b520-59523fea767f tempest-AccessesMetadataNegativeTest-1660907003 None] Lock "locked_access_rules_operation_by_share_instance_113739f1-d41a-4f4e-b63f-071e2ecd0a7b" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:57:26 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-3e942cba-0587-4cbb-b520-59523fea767f tempest-AccessesMetadataNegativeTest-1660907003 None] Acquiring lock "locked_access_rules_operation_by_share_instance_113739f1-d41a-4f4e-b63f-071e2ecd0a7b" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:57:26 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-3e942cba-0587-4cbb-b520-59523fea767f tempest-AccessesMetadataNegativeTest-1660907003 None] Lock "locked_access_rules_operation_by_share_instance_113739f1-d41a-4f4e-b63f-071e2ecd0a7b" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:57:26 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-3e942cba-0587-4cbb-b520-59523fea767f tempest-AccessesMetadataNegativeTest-1660907003 None] Lock "locked_access_rules_operation_by_share_instance_113739f1-d41a-4f4e-b63f-071e2ecd0a7b" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.007s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:57:26 l75lg1-v1 manila-share[98474]: INFO manila.share.access [None req-3e942cba-0587-4cbb-b520-59523fea767f tempest-AccessesMetadataNegativeTest-1660907003 None] Access rules were successfully modified for share instance 113739f1-d41a-4f4e-b63f-071e2ecd0a7b belonging to share 1b8e12e8-6d99-48c0-8368-d1a37e2ca2ca. May 28 12:57:26 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-3e942cba-0587-4cbb-b520-59523fea767f tempest-AccessesMetadataNegativeTest-1660907003 None] deleting '/manila/manila-113739f1-d41a-4f4e-b63f-071e2ecd0a7b' May 28 12:57:26 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-3e942cba-0587-4cbb-b520-59523fea767f tempest-AccessesMetadataNegativeTest-1660907003 None] >>> [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/ May 28 12:57:26 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-3e942cba-0587-4cbb-b520-59523fea767f tempest-AccessesMetadataNegativeTest-1660907003 None] {'data': '{"path": "/manila/manila-113739f1-d41a-4f4e-b63f-071e2ecd0a7b"}', May 28 12:57:26 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-3e942cba-0587-4cbb-b520-59523fea767f tempest-AccessesMetadataNegativeTest-1660907003 None] 'params': None} May 28 12:57:26 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-3e942cba-0587-4cbb-b520-59523fea767f tempest-AccessesMetadataNegativeTest-1660907003 None] <<< [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/ May 28 12:57:26 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-3e942cba-0587-4cbb-b520-59523fea767f tempest-AccessesMetadataNegativeTest-1660907003 None] 'OK' May 28 12:57:26 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-3e942cba-0587-4cbb-b520-59523fea767f tempest-AccessesMetadataNegativeTest-1660907003 None] --- [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/: Done May 28 12:57:26 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-3e942cba-0587-4cbb-b520-59523fea767f tempest-AccessesMetadataNegativeTest-1660907003 None] >>> [GET] https://127.0.0.1:40443/api/views/ May 28 12:57:26 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-3e942cba-0587-4cbb-b520-59523fea767f tempest-AccessesMetadataNegativeTest-1660907003 None] {'allow_redirects': True, May 28 12:57:26 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-3e942cba-0587-4cbb-b520-59523fea767f tempest-AccessesMetadataNegativeTest-1660907003 None] 'params': {'name': '113739f1-d41a-4f4e-b63f-071e2ecd0a7b'}} May 28 12:57:26 l75lg1-v1 sudo[98788]: pam_unix(sudo:session): session closed for user root May 28 12:57:26 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.472s {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:428}} May 28 12:57:26 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:390}} May 28 12:57:26 l75lg1-v1 sudo[98837]: vastdata : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 May 28 12:57:26 l75lg1-v1 sudo[98837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) May 28 12:57:26 l75lg1-v1 dstat.sh[49771]: 28-05 12:57:26| 11 2 85 2 0|5684M 1812M 277M 7853M| 16k 3217B| 256k 1636k|2.00 213 |5190 8298 |1.53 1.03 1.00|1.0 1.0 51| 0 0 | 0 2048M| 29 355 0 87 0 May 28 12:57:26 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-119f68c3-b525-4c48-92a6-b22a072d532b tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] GET http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/9e24a210-9e96-45d9-b31c-f6f3377eb0e7 May 28 12:57:26 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-119f68c3-b525-4c48-92a6-b22a072d532b tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:26 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-119f68c3-b525-4c48-92a6-b22a072d532b tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:26 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-119f68c3-b525-4c48-92a6-b22a072d532b tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/9e24a210-9e96-45d9-b31c-f6f3377eb0e7 returned with HTTP 200 May 28 12:57:26 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 323/660] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:57:26 2024] GET /share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/9e24a210-9e96-45d9-b31c-f6f3377eb0e7 => generated 1317 bytes in 27 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:57:26 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-61139e70-4a3f-4962-9a7d-6fde22916298 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] POST http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares May 28 12:57:26 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-61139e70-4a3f-4962-9a7d-6fde22916298 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share": {"share_proto": "nfs", "description": "Tempest's share", "snapshot_id": null, "name": "tempest-tempest-created-share-1548045551", "size": 1, "metadata": {}, "is_public": false, "share_type": "10ddeb10-4cbf-44c0-94cd-48a1deaf7383"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:57:26 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.v1.shares [None req-61139e70-4a3f-4962-9a7d-6fde22916298 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Create NFS share of 1 GB May 28 12:57:26 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.quota [None req-61139e70-4a3f-4962-9a7d-6fde22916298 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Created reservations ['34493889-3e05-4771-83f5-30554e1c5387', '5c2901a2-9b84-40b5-bd8e-7f1655daf3f6', '370e1e64-a97a-486e-a934-39bf8e533b6e', 'c94fbc53-def1-4f5e-93e6-35488afdc82c'] {{(pid=98329) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 12:57:26 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.quota [None req-61139e70-4a3f-4962-9a7d-6fde22916298 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Committed reservations ['34493889-3e05-4771-83f5-30554e1c5387', '5c2901a2-9b84-40b5-bd8e-7f1655daf3f6', '370e1e64-a97a-486e-a934-39bf8e533b6e', 'c94fbc53-def1-4f5e-93e6-35488afdc82c'] {{(pid=98329) commit /opt/stack/manila/manila/quota.py:1063}} May 28 12:57:26 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.host_manager [None req-61139e70-4a3f-4962-9a7d-6fde22916298 tempest-SharesMetadataTest-1561320255 None] Share service is down. (host: l75lg1-v1@generic2). May 28 12:57:26 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.host_manager [None req-61139e70-4a3f-4962-9a7d-6fde22916298 tempest-SharesMetadataTest-1561320255 None] Share service is down. (host: l75lg1-v1@generic1). May 28 12:57:26 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-61139e70-4a3f-4962-9a7d-6fde22916298 tempest-SharesMetadataTest-1561320255 None] Starting with 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:80}} May 28 12:57:26 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-61139e70-4a3f-4962-9a7d-6fde22916298 tempest-SharesMetadataTest-1561320255 None] Filter OnlyHostFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:57:26 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-61139e70-4a3f-4962-9a7d-6fde22916298 tempest-SharesMetadataTest-1561320255 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:57:26 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.capacity [None req-61139e70-4a3f-4962-9a7d-6fde22916298 tempest-SharesMetadataTest-1561320255 None] Space information for share creation on host l75lg1-v1@vast#vast (requested / avail): 1/2066 {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/capacity.py:83}} May 28 12:57:26 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-61139e70-4a3f-4962-9a7d-6fde22916298 tempest-SharesMetadataTest-1561320255 None] Filter CapacityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:57:26 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-61139e70-4a3f-4962-9a7d-6fde22916298 tempest-SharesMetadataTest-1561320255 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:57:26 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-61139e70-4a3f-4962-9a7d-6fde22916298 tempest-SharesMetadataTest-1561320255 None] Driver Filter: Checking host 'l75lg1-v1@vast#vast' {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:37}} May 28 12:57:26 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-61139e70-4a3f-4962-9a7d-6fde22916298 tempest-SharesMetadataTest-1561320255 None] Filter function not set :: passing host. {{(pid=98327) _check_filter_function /opt/stack/manila/manila/scheduler/filters/driver.py:53}} May 28 12:57:26 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-61139e70-4a3f-4962-9a7d-6fde22916298 tempest-SharesMetadataTest-1561320255 None] Result: True {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:40}} May 28 12:57:26 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-61139e70-4a3f-4962-9a7d-6fde22916298 tempest-SharesMetadataTest-1561320255 None] Done checking host 'l75lg1-v1@vast#vast' {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:41}} May 28 12:57:26 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-61139e70-4a3f-4962-9a7d-6fde22916298 tempest-SharesMetadataTest-1561320255 None] Filter DriverFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:57:26 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-61139e70-4a3f-4962-9a7d-6fde22916298 tempest-SharesMetadataTest-1561320255 None] Filter ShareReplicationFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:57:26 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-61139e70-4a3f-4962-9a7d-6fde22916298 tempest-SharesMetadataTest-1561320255 None] Filter CreateFromSnapshotFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:57:26 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-61139e70-4a3f-4962-9a7d-6fde22916298 tempest-SharesMetadataTest-1561320255 None] Filter AffinityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:57:26 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-61139e70-4a3f-4962-9a7d-6fde22916298 tempest-SharesMetadataTest-1561320255 None] Filter AntiAffinityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:57:26 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.drivers.filter [None req-61139e70-4a3f-4962-9a7d-6fde22916298 tempest-SharesMetadataTest-1561320255 None] Filtered share [host: 'l75lg1-v1@vast#vast', free_capacity_gb: 2066.6229242384434, pools: None] {{(pid=98327) _schedule_share /opt/stack/manila/manila/scheduler/drivers/filter.py:268}} May 28 12:57:26 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-61139e70-4a3f-4962-9a7d-6fde22916298 tempest-SharesMetadataTest-1561320255 None] Checking host 'l75lg1-v1@vast#vast' {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:46}} May 28 12:57:26 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.weighers.goodness [None req-61139e70-4a3f-4962-9a7d-6fde22916298 tempest-SharesMetadataTest-1561320255 None] Goodness function not set :: defaulting to minimal goodness rating of 0. May 28 12:57:26 l75lg1-v1 manila-scheduler[98327]: INFO manila.scheduler.weighers.goodness [None req-61139e70-4a3f-4962-9a7d-6fde22916298 tempest-SharesMetadataTest-1561320255 None] Goodness function result for host l75lg1-v1@vast#vast: 0. May 28 12:57:26 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-61139e70-4a3f-4962-9a7d-6fde22916298 tempest-SharesMetadataTest-1561320255 None] Goodness: 0 {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:48}} May 28 12:57:26 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-61139e70-4a3f-4962-9a7d-6fde22916298 tempest-SharesMetadataTest-1561320255 None] Done checking host 'l75lg1-v1@vast#vast' {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:49}} May 28 12:57:26 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.drivers.filter [None req-61139e70-4a3f-4962-9a7d-6fde22916298 tempest-SharesMetadataTest-1561320255 None] Choosing for share: WeighedHost [host: l75lg1-v1@vast#vast, weight: 0.0] {{(pid=98327) _schedule_share /opt/stack/manila/manila/scheduler/drivers/filter.py:274}} May 28 12:57:26 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-61139e70-4a3f-4962-9a7d-6fde22916298 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares returned with HTTP 200 May 28 12:57:26 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 338/661] 10.27.203.238 () {66 vars in 1362 bytes} [Tue May 28 12:57:26 2024] POST /share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares => generated 1312 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:57:26 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-336ba359-7b30-4915-a389-5b130976a84c tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] GET http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/36ebac5b-70c6-4cc4-85fa-1acc9586628e May 28 12:57:26 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-336ba359-7b30-4915-a389-5b130976a84c tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:26 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-336ba359-7b30-4915-a389-5b130976a84c tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:26 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-336ba359-7b30-4915-a389-5b130976a84c tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/36ebac5b-70c6-4cc4-85fa-1acc9586628e returned with HTTP 200 May 28 12:57:26 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 324/662] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:57:26 2024] GET /share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/36ebac5b-70c6-4cc4-85fa-1acc9586628e => generated 1312 bytes in 28 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:57:26 l75lg1-v1 sudo[98837]: pam_unix(sudo:session): session closed for user root May 28 12:57:26 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.514s {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:428}} May 28 12:57:26 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:390}} May 28 12:57:26 l75lg1-v1 sudo[98840]: vastdata : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool May 28 12:57:26 l75lg1-v1 sudo[98840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) May 28 12:57:26 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-61139e70-4a3f-4962-9a7d-6fde22916298 tempest-SharesMetadataTest-1561320255 None] >>> [GET] https://127.0.0.1:40443/api/vippools/ May 28 12:57:26 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-61139e70-4a3f-4962-9a7d-6fde22916298 tempest-SharesMetadataTest-1561320255 None] {'allow_redirects': True, 'params': {'name': 'vippool-1'}} May 28 12:57:26 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-0b93b626-4bb0-4cf1-b379-d872606e35a1 tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] GET http://10.27.203.238/share/v2/fe54df7c653849ab8ec7523262c597cf/snapshots/ad33850e-6645-4962-a407-4dc7bb8e5045 May 28 12:57:26 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-0b93b626-4bb0-4cf1-b379-d872606e35a1 tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:26 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-0b93b626-4bb0-4cf1-b379-d872606e35a1 tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] Calling method 'ShareSnapshotMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:26 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-3e942cba-0587-4cbb-b520-59523fea767f tempest-AccessesMetadataNegativeTest-1660907003 None] <<< [GET] https://127.0.0.1:40443/api/views/ May 28 12:57:26 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-3e942cba-0587-4cbb-b520-59523fea767f tempest-AccessesMetadataNegativeTest-1660907003 None] [Bunch(abac_tags=[], abe_max_depth=None, abe_protocols=[], alias='', allow_anonymous_access=False, allow_s3_anonymous_access=False, auto_commit='0d', bucket='', bucket_creators=[], bucket_creators_groups=[], bucket_owner=None, bulk_permission_update_progress=None, bulk_permission_update_state=None, cluster='loop75-kfs', cluster_id=1, created='2024-05-28T12:57:19.808991Z', enabled=True, files_retention_mode='NONE', guid='6e44791a-a8b6-467c-a4c0-e6c0eca02e8e', id=16, ignore_oos=False, internal=False, is_remote=False, is_seamless=False, logical_capacity=0, max_retention_period=None, min_retention_period=None, name='113739f1-d41a-4f4e-b63f-071e2ecd0a7b', nfs_interop_flags='BOTH_NFS3_AND_NFS4_INTEROP_DISABLED', path='/manila/manila-113739f1-d41a-4f4e-b63f-071e2ecd0a7b', physical_capacity=0, policy='113739f1-d41a-4f4e-b63f-071e2ecd0a7b', policy_id=17, protocols=['NFS'], qos_policy=None, qos_policy_id=None, s3_locks=False, s3_locks_retention_mode='NONE', s3_locks_retention_period='', s3_unverified_lookup=False, s3_versioning=False, select_for_live_monitoring=False, share='', share_acl=Bunch(acl=[], enabled=False), sync='SYNCED', sync_time='2024-05-28T12:57:20.101147Z', tenant_id=1, tenant_name='default', title='/manila/manila-113739f1-d41a-4f4e-b63f-071e2ecd0a7b', url='https://127.0.0.1:40443/api/views/16/')] May 28 12:57:26 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-3e942cba-0587-4cbb-b520-59523fea767f tempest-AccessesMetadataNegativeTest-1660907003 None] --- [GET] https://127.0.0.1:40443/api/views/: Done May 28 12:57:26 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-3e942cba-0587-4cbb-b520-59523fea767f tempest-AccessesMetadataNegativeTest-1660907003 None] >>> [DELETE] https://127.0.0.1:40443/api/views/16/ May 28 12:57:26 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-0b93b626-4bb0-4cf1-b379-d872606e35a1 tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] http://10.27.203.238/share/v2/fe54df7c653849ab8ec7523262c597cf/snapshots/ad33850e-6645-4962-a407-4dc7bb8e5045 returned with HTTP 200 May 28 12:57:26 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 339/663] 10.27.203.238 () {64 vars in 1460 bytes} [Tue May 28 12:57:26 2024] GET /share/v2/fe54df7c653849ab8ec7523262c597cf/snapshots/ad33850e-6645-4962-a407-4dc7bb8e5045 => generated 775 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:57:26 l75lg1-v1 neutron-server[77618]: DEBUG dbcounter [-] [77618] Writing DB stats neutron:SELECT=12 {{(pid=77618) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:57:26 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-42a2fcd1-d155-420b-8c7f-3b5222202f48 tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] GET http://10.27.203.238/share/v1/fe54df7c653849ab8ec7523262c597cf/shares/7da650db-1124-40b5-ba52-fb1170c038c8 May 28 12:57:26 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-42a2fcd1-d155-420b-8c7f-3b5222202f48 tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:26 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-42a2fcd1-d155-420b-8c7f-3b5222202f48 tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:26 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-42a2fcd1-d155-420b-8c7f-3b5222202f48 tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] http://10.27.203.238/share/v1/fe54df7c653849ab8ec7523262c597cf/shares/7da650db-1124-40b5-ba52-fb1170c038c8 returned with HTTP 200 May 28 12:57:26 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 325/664] 10.27.203.238 () {62 vars in 1408 bytes} [Tue May 28 12:57:26 2024] GET /share/v1/fe54df7c653849ab8ec7523262c597cf/shares/7da650db-1124-40b5-ba52-fb1170c038c8 => generated 1123 bytes in 24 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:57:26 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-99e91222-ee6b-406b-a6c0-80dd6b6d566a tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] GET http://10.27.203.238/share/v1/fe54df7c653849ab8ec7523262c597cf/snapshots/ad33850e-6645-4962-a407-4dc7bb8e5045 May 28 12:57:26 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-99e91222-ee6b-406b-a6c0-80dd6b6d566a tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:26 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-99e91222-ee6b-406b-a6c0-80dd6b6d566a tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] Calling method 'ShareSnapshotMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:26 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-99e91222-ee6b-406b-a6c0-80dd6b6d566a tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] http://10.27.203.238/share/v1/fe54df7c653849ab8ec7523262c597cf/snapshots/ad33850e-6645-4962-a407-4dc7bb8e5045 returned with HTTP 200 May 28 12:57:26 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 340/665] 10.27.203.238 () {62 vars in 1417 bytes} [Tue May 28 12:57:26 2024] GET /share/v1/fe54df7c653849ab8ec7523262c597cf/snapshots/ad33850e-6645-4962-a407-4dc7bb8e5045 => generated 635 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:57:26 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-8fca80fb-2bd4-43f5-af50-1f3362459331 tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] GET http://10.27.203.238/share/v1/fe54df7c653849ab8ec7523262c597cf/shares May 28 12:57:26 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-8fca80fb-2bd4-43f5-af50-1f3362459331 tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:26 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-8fca80fb-2bd4-43f5-af50-1f3362459331 tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] Calling method 'ShareMixin.index' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:26 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.share.api [None req-8fca80fb-2bd4-43f5-af50-1f3362459331 tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] Searching for shares by: {} {{(pid=98330) _get_all /opt/stack/manila/manila/share/api.py:2235}} May 28 12:57:26 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-8fca80fb-2bd4-43f5-af50-1f3362459331 tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] http://10.27.203.238/share/v1/fe54df7c653849ab8ec7523262c597cf/shares returned with HTTP 200 May 28 12:57:26 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 326/666] 10.27.203.238 () {62 vars in 1297 bytes} [Tue May 28 12:57:26 2024] GET /share/v1/fe54df7c653849ab8ec7523262c597cf/shares => generated 390 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:57:26 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-43b5af3e-08fc-42fd-8a51-2b17759fbc98 tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] GET http://10.27.203.238/share/v2/fe54df7c653849ab8ec7523262c597cf/shares/7da650db-1124-40b5-ba52-fb1170c038c8/export_locations May 28 12:57:26 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-43b5af3e-08fc-42fd-8a51-2b17759fbc98 tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:26 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-43b5af3e-08fc-42fd-8a51-2b17759fbc98 tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:26 l75lg1-v1 neutron-server[77618]: DEBUG dbcounter [-] [77618] Writing DB stats neutron:SELECT=7,neutron:UPDATE=1 {{(pid=77618) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:57:26 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-43b5af3e-08fc-42fd-8a51-2b17759fbc98 tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] http://10.27.203.238/share/v2/fe54df7c653849ab8ec7523262c597cf/shares/7da650db-1124-40b5-ba52-fb1170c038c8/export_locations returned with HTTP 200 May 28 12:57:26 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 341/667] 10.27.203.238 () {64 vars in 1502 bytes} [Tue May 28 12:57:26 2024] GET /share/v2/fe54df7c653849ab8ec7523262c597cf/shares/7da650db-1124-40b5-ba52-fb1170c038c8/export_locations => generated 250 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:57:26 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-e7579f11-b23d-4b3d-a0a0-92ea32f545ec tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] GET http://10.27.203.238/share/v2/fe54df7c653849ab8ec7523262c597cf/shares/detail?export_location_path=172.21.75.1%3A%2Fmanila%2Fmanila-7c19614c-d968-4489-b2ad-bd88c2ef8054 May 28 12:57:26 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-e7579f11-b23d-4b3d-a0a0-92ea32f545ec tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:26 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-e7579f11-b23d-4b3d-a0a0-92ea32f545ec tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:26 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.share.api [None req-e7579f11-b23d-4b3d-a0a0-92ea32f545ec tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] Searching for shares by: {'export_location_path': '172.21.75.1:/manila/manila-7c19614c-d968-4489-b2ad-bd88c2ef8054'} {{(pid=98330) _get_all /opt/stack/manila/manila/share/api.py:2235}} May 28 12:57:26 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-e7579f11-b23d-4b3d-a0a0-92ea32f545ec tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] http://10.27.203.238/share/v2/fe54df7c653849ab8ec7523262c597cf/shares/detail?export_location_path=172.21.75.1%3A%2Fmanila%2Fmanila-7c19614c-d968-4489-b2ad-bd88c2ef8054 returned with HTTP 200 May 28 12:57:26 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 327/668] 10.27.203.238 () {64 vars in 1542 bytes} [Tue May 28 12:57:26 2024] GET /share/v2/fe54df7c653849ab8ec7523262c597cf/shares/detail?export_location_path=172.21.75.1%3A%2Fmanila%2Fmanila-7c19614c-d968-4489-b2ad-bd88c2ef8054 => generated 1479 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 232 bytes (2 switches on core 0) May 28 12:57:27 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-61139e70-4a3f-4962-9a7d-6fde22916298 tempest-SharesMetadataTest-1561320255 None] <<< [GET] https://127.0.0.1:40443/api/vippools/ May 28 12:57:27 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-61139e70-4a3f-4962-9a7d-6fde22916298 tempest-SharesMetadataTest-1561320255 None] [Bunch(active_cnode_ids=[], active_interfaces=4, cluster='loop75-kfs', cluster_id=1, cnode_ids=[], cnodes=[], domain_name='vippool-1', enable_l3=False, enable_weighted_balancing=False, enabled=True, end_ip='172.21.75.4', guid='f2abaede-b397-413a-8faa-3aeead6d3b28', gw_ip='', gw_ipv6='', id=2, ip_ranges=[['172.21.75.1', '172.21.75.4']], name='vippool-1', peer_asn=0, port_membership='ALL', ranges_summary='172.21.75.[1-4]', role='PROTOCOLS', start_ip='172.21.75.1', subnet_cidr=16, subnet_cidr_ipv6=None, sync='SYNCED', sync_time='2024-05-28T12:50:09.644123Z', tenant_id=1, tenant_name='default', title='172.21.75.1 - 172.21.75.4', url='https://127.0.0.1:40443/api/vippools/2/', vast_asn=0, vlan=0, vms_preferred=False)] May 28 12:57:27 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-61139e70-4a3f-4962-9a7d-6fde22916298 tempest-SharesMetadataTest-1561320255 None] --- [GET] https://127.0.0.1:40443/api/vippools/: Done May 28 12:57:27 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-61139e70-4a3f-4962-9a7d-6fde22916298 tempest-SharesMetadataTest-1561320255 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:57:27 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-c2c01fb4-c74d-46b0-a128-e58f6306041e tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] GET http://10.27.203.238/share/v2/fe54df7c653849ab8ec7523262c597cf/shares/7da650db-1124-40b5-ba52-fb1170c038c8/export_locations May 28 12:57:27 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-61139e70-4a3f-4962-9a7d-6fde22916298 tempest-SharesMetadataTest-1561320255 None] {'allow_redirects': True, May 28 12:57:27 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-61139e70-4a3f-4962-9a7d-6fde22916298 tempest-SharesMetadataTest-1561320255 None] 'params': {'name': '2be2873c-4768-478e-a848-fb1d2654ca64'}} May 28 12:57:27 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-c2c01fb4-c74d-46b0-a128-e58f6306041e tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:27 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-c2c01fb4-c74d-46b0-a128-e58f6306041e tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:27 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-c2c01fb4-c74d-46b0-a128-e58f6306041e tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] http://10.27.203.238/share/v2/fe54df7c653849ab8ec7523262c597cf/shares/7da650db-1124-40b5-ba52-fb1170c038c8/export_locations returned with HTTP 200 May 28 12:57:27 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 342/669] 10.27.203.238 () {64 vars in 1502 bytes} [Tue May 28 12:57:27 2024] GET /share/v2/fe54df7c653849ab8ec7523262c597cf/shares/7da650db-1124-40b5-ba52-fb1170c038c8/export_locations => generated 250 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:57:27 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-7a274c76-ce45-4025-8254-c882adec2f02 tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] GET http://10.27.203.238/share/v2/fe54df7c653849ab8ec7523262c597cf/shares/detail?export_location_id=014ad559-581f-40d6-8ce6-bd29c72c4e1a May 28 12:57:27 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-7a274c76-ce45-4025-8254-c882adec2f02 tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:27 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-7a274c76-ce45-4025-8254-c882adec2f02 tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:27 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.share.api [None req-7a274c76-ce45-4025-8254-c882adec2f02 tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] Searching for shares by: {'export_location_id': '014ad559-581f-40d6-8ce6-bd29c72c4e1a'} {{(pid=98330) _get_all /opt/stack/manila/manila/share/api.py:2235}} May 28 12:57:27 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-7a274c76-ce45-4025-8254-c882adec2f02 tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] http://10.27.203.238/share/v2/fe54df7c653849ab8ec7523262c597cf/shares/detail?export_location_id=014ad559-581f-40d6-8ce6-bd29c72c4e1a returned with HTTP 200 May 28 12:57:27 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 328/670] 10.27.203.238 () {64 vars in 1472 bytes} [Tue May 28 12:57:27 2024] GET /share/v2/fe54df7c653849ab8ec7523262c597cf/shares/detail?export_location_id=014ad559-581f-40d6-8ce6-bd29c72c4e1a => generated 1479 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:57:27 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-336cbd38-63ba-4431-a962-53ab92a1758b tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] GET http://10.27.203.238/share/v2/fe54df7c653849ab8ec7523262c597cf/shares/7da650db-1124-40b5-ba52-fb1170c038c8/export_locations May 28 12:57:27 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-336cbd38-63ba-4431-a962-53ab92a1758b tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:27 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-336cbd38-63ba-4431-a962-53ab92a1758b tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:27 l75lg1-v1 sudo[98840]: pam_unix(sudo:session): session closed for user root May 28 12:57:27 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.484s {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:428}} May 28 12:57:27 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:390}} May 28 12:57:27 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-336cbd38-63ba-4431-a962-53ab92a1758b tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] http://10.27.203.238/share/v2/fe54df7c653849ab8ec7523262c597cf/shares/7da650db-1124-40b5-ba52-fb1170c038c8/export_locations returned with HTTP 200 May 28 12:57:27 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 343/671] 10.27.203.238 () {64 vars in 1502 bytes} [Tue May 28 12:57:27 2024] GET /share/v2/fe54df7c653849ab8ec7523262c597cf/shares/7da650db-1124-40b5-ba52-fb1170c038c8/export_locations => generated 250 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:57:27 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-a0f4cd59-699d-44f9-b919-c6a6ba83b7bf tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] GET http://10.27.203.238/share/v2/fe54df7c653849ab8ec7523262c597cf/shares?export_location_path=172.21.75.1%3A%2Fmanila%2Fmanila-7c19614c-d968-4489-b2ad-bd88c2ef8054 May 28 12:57:27 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-a0f4cd59-699d-44f9-b919-c6a6ba83b7bf tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:27 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-a0f4cd59-699d-44f9-b919-c6a6ba83b7bf tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:27 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.share.api [None req-a0f4cd59-699d-44f9-b919-c6a6ba83b7bf tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] Searching for shares by: {'export_location_path': '172.21.75.1:/manila/manila-7c19614c-d968-4489-b2ad-bd88c2ef8054'} {{(pid=98330) _get_all /opt/stack/manila/manila/share/api.py:2235}} May 28 12:57:27 l75lg1-v1 sudo[98843]: vastdata : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 May 28 12:57:27 l75lg1-v1 sudo[98843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) May 28 12:57:27 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-a0f4cd59-699d-44f9-b919-c6a6ba83b7bf tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] http://10.27.203.238/share/v2/fe54df7c653849ab8ec7523262c597cf/shares?export_location_path=172.21.75.1%3A%2Fmanila%2Fmanila-7c19614c-d968-4489-b2ad-bd88c2ef8054 returned with HTTP 200 May 28 12:57:27 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 329/672] 10.27.203.238 () {64 vars in 1521 bytes} [Tue May 28 12:57:27 2024] GET /share/v2/fe54df7c653849ab8ec7523262c597cf/shares?export_location_path=172.21.75.1%3A%2Fmanila%2Fmanila-7c19614c-d968-4489-b2ad-bd88c2ef8054 => generated 390 bytes in 25 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:57:27 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-02294b02-8b10-4002-a4a4-0daaa1d5d5f9 tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] GET http://10.27.203.238/share/v2/fe54df7c653849ab8ec7523262c597cf/shares/7da650db-1124-40b5-ba52-fb1170c038c8/export_locations May 28 12:57:27 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-02294b02-8b10-4002-a4a4-0daaa1d5d5f9 tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:27 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-02294b02-8b10-4002-a4a4-0daaa1d5d5f9 tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:27 l75lg1-v1 dstat.sh[49771]: 28-05 12:57:27| 16 2 79 1 0|5684M 1811M 277M 7853M| 23k 11k| 639k 1302k|4.99 170 |4948 7818 |1.65 1.06 1.01|3.0 1.0 6.0| 0 0 | 0 2048M| 29 356 0 80 0 May 28 12:57:27 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-02294b02-8b10-4002-a4a4-0daaa1d5d5f9 tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] http://10.27.203.238/share/v2/fe54df7c653849ab8ec7523262c597cf/shares/7da650db-1124-40b5-ba52-fb1170c038c8/export_locations returned with HTTP 200 May 28 12:57:27 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 344/673] 10.27.203.238 () {64 vars in 1502 bytes} [Tue May 28 12:57:27 2024] GET /share/v2/fe54df7c653849ab8ec7523262c597cf/shares/7da650db-1124-40b5-ba52-fb1170c038c8/export_locations => generated 250 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:57:27 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-e84c8274-82e4-429a-84e1-7c6363c82c22 tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] GET http://10.27.203.238/share/v2/fe54df7c653849ab8ec7523262c597cf/shares?export_location_id=014ad559-581f-40d6-8ce6-bd29c72c4e1a May 28 12:57:27 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-e84c8274-82e4-429a-84e1-7c6363c82c22 tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:27 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-e84c8274-82e4-429a-84e1-7c6363c82c22 tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:27 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.share.api [None req-e84c8274-82e4-429a-84e1-7c6363c82c22 tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] Searching for shares by: {'export_location_id': '014ad559-581f-40d6-8ce6-bd29c72c4e1a'} {{(pid=98330) _get_all /opt/stack/manila/manila/share/api.py:2235}} May 28 12:57:27 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-61139e70-4a3f-4962-9a7d-6fde22916298 tempest-SharesMetadataTest-1561320255 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:57:27 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-61139e70-4a3f-4962-9a7d-6fde22916298 tempest-SharesMetadataTest-1561320255 None] [] May 28 12:57:27 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-61139e70-4a3f-4962-9a7d-6fde22916298 tempest-SharesMetadataTest-1561320255 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 12:57:27 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-61139e70-4a3f-4962-9a7d-6fde22916298 tempest-SharesMetadataTest-1561320255 None] >>> [POST] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:57:27 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-61139e70-4a3f-4962-9a7d-6fde22916298 tempest-SharesMetadataTest-1561320255 None] {'data': '{"name": "2be2873c-4768-478e-a848-fb1d2654ca64"}', May 28 12:57:27 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-61139e70-4a3f-4962-9a7d-6fde22916298 tempest-SharesMetadataTest-1561320255 None] 'json': None, May 28 12:57:27 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-61139e70-4a3f-4962-9a7d-6fde22916298 tempest-SharesMetadataTest-1561320255 None] 'params': None} May 28 12:57:27 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-e84c8274-82e4-429a-84e1-7c6363c82c22 tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] http://10.27.203.238/share/v2/fe54df7c653849ab8ec7523262c597cf/shares?export_location_id=014ad559-581f-40d6-8ce6-bd29c72c4e1a returned with HTTP 200 May 28 12:57:27 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 330/674] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:57:27 2024] GET /share/v2/fe54df7c653849ab8ec7523262c597cf/shares?export_location_id=014ad559-581f-40d6-8ce6-bd29c72c4e1a => generated 390 bytes in 26 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:57:27 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-5b73d134-c672-49f6-a455-e8a150022235 tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] GET http://10.27.203.238/share/v1/fe54df7c653849ab8ec7523262c597cf/shares/detail May 28 12:57:27 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-5b73d134-c672-49f6-a455-e8a150022235 tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:27 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-5b73d134-c672-49f6-a455-e8a150022235 tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] Calling method 'ShareMixin.detail' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:27 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.share.api [None req-5b73d134-c672-49f6-a455-e8a150022235 tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] Searching for shares by: {} {{(pid=98329) _get_all /opt/stack/manila/manila/share/api.py:2235}} May 28 12:57:27 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-5b73d134-c672-49f6-a455-e8a150022235 tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] http://10.27.203.238/share/v1/fe54df7c653849ab8ec7523262c597cf/shares/detail returned with HTTP 200 May 28 12:57:27 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 345/675] 10.27.203.238 () {62 vars in 1318 bytes} [Tue May 28 12:57:27 2024] GET /share/v1/fe54df7c653849ab8ec7523262c597cf/shares/detail => generated 1126 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:57:27 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-f587b97e-ec60-4a00-a309-93e7ea9f9803 tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] GET http://10.27.203.238/share/v1/fe54df7c653849ab8ec7523262c597cf/shares/detail?status=available May 28 12:57:27 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-f587b97e-ec60-4a00-a309-93e7ea9f9803 tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:27 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-f587b97e-ec60-4a00-a309-93e7ea9f9803 tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] Calling method 'ShareMixin.detail' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:27 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.share.api [None req-f587b97e-ec60-4a00-a309-93e7ea9f9803 tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] Searching for shares by: {'status': 'available'} {{(pid=98330) _get_all /opt/stack/manila/manila/share/api.py:2235}} May 28 12:57:27 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-f587b97e-ec60-4a00-a309-93e7ea9f9803 tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] http://10.27.203.238/share/v1/fe54df7c653849ab8ec7523262c597cf/shares/detail?status=available returned with HTTP 200 May 28 12:57:27 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 331/676] 10.27.203.238 () {62 vars in 1351 bytes} [Tue May 28 12:57:27 2024] GET /share/v1/fe54df7c653849ab8ec7523262c597cf/shares/detail?status=available => generated 1126 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:57:27 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-91009ce3-dd37-4331-8648-ddf8b64c5678 tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] GET http://10.27.203.238/share/v1/fe54df7c653849ab8ec7523262c597cf/shares/detail?name=tempest-tempest-share-name-768779863 May 28 12:57:27 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-91009ce3-dd37-4331-8648-ddf8b64c5678 tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:27 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-91009ce3-dd37-4331-8648-ddf8b64c5678 tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] Calling method 'ShareMixin.detail' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:27 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.share.api [None req-91009ce3-dd37-4331-8648-ddf8b64c5678 tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] Searching for shares by: {'display_name': 'tempest-tempest-share-name-768779863'} {{(pid=98329) _get_all /opt/stack/manila/manila/share/api.py:2235}} May 28 12:57:27 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-91009ce3-dd37-4331-8648-ddf8b64c5678 tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] http://10.27.203.238/share/v1/fe54df7c653849ab8ec7523262c597cf/shares/detail?name=tempest-tempest-share-name-768779863 returned with HTTP 200 May 28 12:57:27 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 346/677] 10.27.203.238 () {62 vars in 1401 bytes} [Tue May 28 12:57:27 2024] GET /share/v1/fe54df7c653849ab8ec7523262c597cf/shares/detail?name=tempest-tempest-share-name-768779863 => generated 1126 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:57:27 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-d8f8740a-2663-4361-a060-8cb7ba15a41e tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] GET http://10.27.203.238/share/v1/fe54df7c653849ab8ec7523262c597cf/types May 28 12:57:27 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-d8f8740a-2663-4361-a060-8cb7ba15a41e tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:27 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-d8f8740a-2663-4361-a060-8cb7ba15a41e tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] Calling method 'ShareTypesController.index' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:27 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-d8f8740a-2663-4361-a060-8cb7ba15a41e tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] http://10.27.203.238/share/v1/fe54df7c653849ab8ec7523262c597cf/types returned with HTTP 200 May 28 12:57:27 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 332/678] 10.27.203.238 () {62 vars in 1294 bytes} [Tue May 28 12:57:27 2024] GET /share/v1/fe54df7c653849ab8ec7523262c597cf/types => generated 4225 bytes in 12 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:57:27 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-f6d8bc77-7f3b-4888-b268-c1cbafbcf312 tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] GET http://10.27.203.238/share/v1/fe54df7c653849ab8ec7523262c597cf/shares/detail?extra_specs=%7B%27storage_protocol%27%3A+%27NFS%27%7D May 28 12:57:27 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-f6d8bc77-7f3b-4888-b268-c1cbafbcf312 tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:27 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-f6d8bc77-7f3b-4888-b268-c1cbafbcf312 tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] Calling method 'ShareMixin.detail' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:27 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.share.api [None req-f6d8bc77-7f3b-4888-b268-c1cbafbcf312 tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] Searching for shares by: {'extra_specs': {'storage_protocol': 'NFS'}} {{(pid=98329) _get_all /opt/stack/manila/manila/share/api.py:2235}} May 28 12:57:27 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-f6d8bc77-7f3b-4888-b268-c1cbafbcf312 tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] http://10.27.203.238/share/v1/fe54df7c653849ab8ec7523262c597cf/shares/detail?extra_specs=%7B%27storage_protocol%27%3A+%27NFS%27%7D returned with HTTP 200 May 28 12:57:27 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 347/679] 10.27.203.238 () {62 vars in 1425 bytes} [Tue May 28 12:57:27 2024] GET /share/v1/fe54df7c653849ab8ec7523262c597cf/shares/detail?extra_specs=%7B%27storage_protocol%27%3A+%27NFS%27%7D => generated 1126 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:57:27 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-f07f71a0-bdf7-4ab3-bc70-97da39ffb856 tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] GET http://10.27.203.238/share/v1/fe54df7c653849ab8ec7523262c597cf/types/ca9bd8a1-ee0c-41ce-8832-c674458b3deb/extra_specs May 28 12:57:27 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-f07f71a0-bdf7-4ab3-bc70-97da39ffb856 tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:27 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-f07f71a0-bdf7-4ab3-bc70-97da39ffb856 tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] Calling method 'ShareTypeExtraSpecsController.index' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:27 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-f07f71a0-bdf7-4ab3-bc70-97da39ffb856 tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] http://10.27.203.238/share/v1/fe54df7c653849ab8ec7523262c597cf/types/ca9bd8a1-ee0c-41ce-8832-c674458b3deb/extra_specs returned with HTTP 200 May 28 12:57:27 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 333/680] 10.27.203.238 () {62 vars in 1441 bytes} [Tue May 28 12:57:27 2024] GET /share/v1/fe54df7c653849ab8ec7523262c597cf/types/ca9bd8a1-ee0c-41ce-8832-c674458b3deb/extra_specs => generated 113 bytes in 12 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:57:27 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-784fb349-1ecd-44c3-9a21-4ee0a87a72e7 tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] GET http://10.27.203.238/share/v1/fe54df7c653849ab8ec7523262c597cf/shares/detail?name=tempest-fake-nonexistent-name-398253201 May 28 12:57:27 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-784fb349-1ecd-44c3-9a21-4ee0a87a72e7 tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:27 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-784fb349-1ecd-44c3-9a21-4ee0a87a72e7 tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] Calling method 'ShareMixin.detail' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:27 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.share.api [None req-784fb349-1ecd-44c3-9a21-4ee0a87a72e7 tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] Searching for shares by: {'display_name': 'tempest-fake-nonexistent-name-398253201'} {{(pid=98329) _get_all /opt/stack/manila/manila/share/api.py:2235}} May 28 12:57:27 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a26ac8ef-2c95-49c8-896a-27a98ee94388 tempest-AdminActionsTest-1749172189 None] <<< [DELETE] https://127.0.0.1:40443/api/quotas/13/ May 28 12:57:27 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a26ac8ef-2c95-49c8-896a-27a98ee94388 tempest-AdminActionsTest-1749172189 None] --- [DELETE] https://127.0.0.1:40443/api/quotas/13/: Done May 28 12:57:27 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a26ac8ef-2c95-49c8-896a-27a98ee94388 tempest-AdminActionsTest-1749172189 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:57:27 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a26ac8ef-2c95-49c8-896a-27a98ee94388 tempest-AdminActionsTest-1749172189 None] {'allow_redirects': True, May 28 12:57:27 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a26ac8ef-2c95-49c8-896a-27a98ee94388 tempest-AdminActionsTest-1749172189 None] 'params': {'name': '891641f2-366e-4b85-925e-8cffaa759ace'}} May 28 12:57:27 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-784fb349-1ecd-44c3-9a21-4ee0a87a72e7 tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] http://10.27.203.238/share/v1/fe54df7c653849ab8ec7523262c597cf/shares/detail?name=tempest-fake-nonexistent-name-398253201 returned with HTTP 200 May 28 12:57:27 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 348/681] 10.27.203.238 () {62 vars in 1407 bytes} [Tue May 28 12:57:27 2024] GET /share/v1/fe54df7c653849ab8ec7523262c597cf/shares/detail?name=tempest-fake-nonexistent-name-398253201 => generated 14 bytes in 12 msecs (HTTP/1.1 200) 6 headers in 229 bytes (1 switches on core 0) May 28 12:57:27 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-246ff21d-f3aa-4fe8-89ff-b33a01b4f7df tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] GET http://10.27.203.238/share/v1/fe54df7c653849ab8ec7523262c597cf/shares/detail?status=fake May 28 12:57:27 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-246ff21d-f3aa-4fe8-89ff-b33a01b4f7df tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:27 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-246ff21d-f3aa-4fe8-89ff-b33a01b4f7df tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] Calling method 'ShareMixin.detail' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:27 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.share.api [None req-246ff21d-f3aa-4fe8-89ff-b33a01b4f7df tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] Searching for shares by: {'status': 'fake'} {{(pid=98330) _get_all /opt/stack/manila/manila/share/api.py:2235}} May 28 12:57:27 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-246ff21d-f3aa-4fe8-89ff-b33a01b4f7df tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] http://10.27.203.238/share/v1/fe54df7c653849ab8ec7523262c597cf/shares/detail?status=fake returned with HTTP 200 May 28 12:57:27 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 334/682] 10.27.203.238 () {62 vars in 1341 bytes} [Tue May 28 12:57:27 2024] GET /share/v1/fe54df7c653849ab8ec7523262c597cf/shares/detail?status=fake => generated 14 bytes in 12 msecs (HTTP/1.1 200) 6 headers in 229 bytes (1 switches on core 0) May 28 12:57:27 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-efce6cd1-efb0-4f4e-b447-9e3602d35e93 tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] GET http://10.27.203.238/share/v1/fe54df7c653849ab8ec7523262c597cf/shares/7da650db-1124-40b5-ba52-fb1170c038c8 May 28 12:57:27 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-efce6cd1-efb0-4f4e-b447-9e3602d35e93 tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:27 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-efce6cd1-efb0-4f4e-b447-9e3602d35e93 tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:27 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-efce6cd1-efb0-4f4e-b447-9e3602d35e93 tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] http://10.27.203.238/share/v1/fe54df7c653849ab8ec7523262c597cf/shares/7da650db-1124-40b5-ba52-fb1170c038c8 returned with HTTP 200 May 28 12:57:27 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 349/683] 10.27.203.238 () {62 vars in 1408 bytes} [Tue May 28 12:57:27 2024] GET /share/v1/fe54df7c653849ab8ec7523262c597cf/shares/7da650db-1124-40b5-ba52-fb1170c038c8 => generated 1123 bytes in 27 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:57:27 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-c49383e9-f5e9-426f-b403-cdb69fc6adc4 tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] GET http://10.27.203.238/share/v1/fe54df7c653849ab8ec7523262c597cf/shares/detail?host=l75lg1-v1%40vast%23vast May 28 12:57:27 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-c49383e9-f5e9-426f-b403-cdb69fc6adc4 tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:27 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-c49383e9-f5e9-426f-b403-cdb69fc6adc4 tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] Calling method 'ShareMixin.detail' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:27 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.share.api [None req-c49383e9-f5e9-426f-b403-cdb69fc6adc4 tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] Searching for shares by: {'host': 'l75lg1-v1@vast#vast'} {{(pid=98330) _get_all /opt/stack/manila/manila/share/api.py:2235}} May 28 12:57:27 l75lg1-v1 sudo[98843]: pam_unix(sudo:session): session closed for user root May 28 12:57:27 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.470s {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:428}} May 28 12:57:27 l75lg1-v1 cinder-volume[85846]: DEBUG cinder.manager [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] Notifying Schedulers of capabilities ... {{(pid=85846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 28 12:57:27 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-c49383e9-f5e9-426f-b403-cdb69fc6adc4 tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] http://10.27.203.238/share/v1/fe54df7c653849ab8ec7523262c597cf/shares/detail?host=l75lg1-v1%40vast%23vast returned with HTTP 200 May 28 12:57:27 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 335/684] 10.27.203.238 () {62 vars in 1375 bytes} [Tue May 28 12:57:27 2024] GET /share/v1/fe54df7c653849ab8ec7523262c597cf/shares/detail?host=l75lg1-v1%40vast%23vast => generated 1126 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:57:27 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.scheduler.host_manager [None req-a6f372b1-8068-4bc0-861d-d4500f299486 None None] Received volume service update from l75lg1-v1@lvmdriver-1: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:l75lg1-v1:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up', 'allocated_capacity_gb': 0, 'cacheable': True}], 'shared_targets': False, 'sparse_copy_volume': True, 'filter_function': None, 'goodness_function': None} {{(pid=85128) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:628}} May 28 12:57:27 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-6bd99a64-691a-4062-a2ad-ed848f24a2d1 tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] GET http://10.27.203.238/share/v1/fe54df7c653849ab8ec7523262c597cf/shares/detail?metadata=%7B%27foo_key_share_1%27%3A+%27foo_value_share_1%27%2C+%27bar_key_share_1%27%3A+%27foo_value_share_1%27%7D May 28 12:57:27 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-6bd99a64-691a-4062-a2ad-ed848f24a2d1 tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:27 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-6bd99a64-691a-4062-a2ad-ed848f24a2d1 tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] Calling method 'ShareMixin.detail' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:27 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.share.api [None req-6bd99a64-691a-4062-a2ad-ed848f24a2d1 tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] Searching for shares by: {'metadata': {'foo_key_share_1': 'foo_value_share_1', 'bar_key_share_1': 'foo_value_share_1'}} {{(pid=98329) _get_all /opt/stack/manila/manila/share/api.py:2235}} May 28 12:57:27 l75lg1-v1 neutron-server[77619]: DEBUG dbcounter [-] [77619] Writing DB stats neutron:SELECT=5 {{(pid=77619) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:57:27 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-6bd99a64-691a-4062-a2ad-ed848f24a2d1 tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] http://10.27.203.238/share/v1/fe54df7c653849ab8ec7523262c597cf/shares/detail?metadata=%7B%27foo_key_share_1%27%3A+%27foo_value_share_1%27%2C+%27bar_key_share_1%27%3A+%27foo_value_share_1%27%7D returned with HTTP 200 May 28 12:57:27 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 350/685] 10.27.203.238 () {62 vars in 1549 bytes} [Tue May 28 12:57:27 2024] GET /share/v1/fe54df7c653849ab8ec7523262c597cf/shares/detail?metadata=%7B%27foo_key_share_1%27%3A+%27foo_value_share_1%27%2C+%27bar_key_share_1%27%3A+%27foo_value_share_1%27%7D => generated 1126 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:57:27 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-3fa4bfe7-b3fb-4566-8351-b701ba7f5715 tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] GET http://10.27.203.238/share/v1/fe54df7c653849ab8ec7523262c597cf/shares/detail?share_type_id=ca9bd8a1-ee0c-41ce-8832-c674458b3deb May 28 12:57:27 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-3fa4bfe7-b3fb-4566-8351-b701ba7f5715 tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:27 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-3fa4bfe7-b3fb-4566-8351-b701ba7f5715 tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] Calling method 'ShareMixin.detail' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:27 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.share.api [None req-3fa4bfe7-b3fb-4566-8351-b701ba7f5715 tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] Searching for shares by: {'share_type_id': 'ca9bd8a1-ee0c-41ce-8832-c674458b3deb'} {{(pid=98330) _get_all /opt/stack/manila/manila/share/api.py:2235}} May 28 12:57:27 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-3fa4bfe7-b3fb-4566-8351-b701ba7f5715 tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] http://10.27.203.238/share/v1/fe54df7c653849ab8ec7523262c597cf/shares/detail?share_type_id=ca9bd8a1-ee0c-41ce-8832-c674458b3deb returned with HTTP 200 May 28 12:57:27 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 336/686] 10.27.203.238 () {62 vars in 1419 bytes} [Tue May 28 12:57:27 2024] GET /share/v1/fe54df7c653849ab8ec7523262c597cf/shares/detail?share_type_id=ca9bd8a1-ee0c-41ce-8832-c674458b3deb => generated 1126 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:57:27 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-38db7e76-add5-4a1c-b108-80241c3119ab tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] GET http://10.27.203.238/share/v1/fe54df7c653849ab8ec7523262c597cf/types May 28 12:57:27 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-38db7e76-add5-4a1c-b108-80241c3119ab tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:27 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-38db7e76-add5-4a1c-b108-80241c3119ab tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] Calling method 'ShareTypesController.index' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:27 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-38db7e76-add5-4a1c-b108-80241c3119ab tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] http://10.27.203.238/share/v1/fe54df7c653849ab8ec7523262c597cf/types returned with HTTP 200 May 28 12:57:27 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 351/687] 10.27.203.238 () {62 vars in 1294 bytes} [Tue May 28 12:57:27 2024] GET /share/v1/fe54df7c653849ab8ec7523262c597cf/types => generated 4225 bytes in 13 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:57:27 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-d3a96c8b-56a6-44f8-a813-0251b684bddb tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] GET http://10.27.203.238/share/v1/fe54df7c653849ab8ec7523262c597cf/shares/detail?sort_key=created_at&sort_dir=asc May 28 12:57:27 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-d3a96c8b-56a6-44f8-a813-0251b684bddb tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:27 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-d3a96c8b-56a6-44f8-a813-0251b684bddb tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] Calling method 'ShareMixin.detail' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:27 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.share.api [None req-d3a96c8b-56a6-44f8-a813-0251b684bddb tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] Searching for shares by: {} {{(pid=98330) _get_all /opt/stack/manila/manila/share/api.py:2235}} May 28 12:57:27 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-d3a96c8b-56a6-44f8-a813-0251b684bddb tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] http://10.27.203.238/share/v1/fe54df7c653849ab8ec7523262c597cf/shares/detail?sort_key=created_at&sort_dir=asc returned with HTTP 200 May 28 12:57:27 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 337/688] 10.27.203.238 () {62 vars in 1383 bytes} [Tue May 28 12:57:27 2024] GET /share/v1/fe54df7c653849ab8ec7523262c597cf/shares/detail?sort_key=created_at&sort_dir=asc => generated 1126 bytes in 28 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:57:27 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-5a9f8dbe-e1e6-4658-b138-250775624864 tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] GET http://10.27.203.238/share/v1/fe54df7c653849ab8ec7523262c597cf/snapshots May 28 12:57:27 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-5a9f8dbe-e1e6-4658-b138-250775624864 tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:27 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-5a9f8dbe-e1e6-4658-b138-250775624864 tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] Calling method 'ShareSnapshotMixin.index' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:27 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.share.api [None req-5a9f8dbe-e1e6-4658-b138-250775624864 tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] Searching for snapshots by: {} {{(pid=98329) _get_all_snapshots /opt/stack/manila/manila/share/api.py:2349}} May 28 12:57:27 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-d5776109-4809-45f2-809f-19172f5dd786 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] GET http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/shares/c5d9b059-bdd0-4fae-9bd0-328d926e5694 May 28 12:57:27 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-d5776109-4809-45f2-809f-19172f5dd786 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:27 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-d5776109-4809-45f2-809f-19172f5dd786 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:27 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-d5776109-4809-45f2-809f-19172f5dd786 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/shares/c5d9b059-bdd0-4fae-9bd0-328d926e5694 returned with HTTP 200 May 28 12:57:27 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 338/689] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:57:27 2024] GET /share/v2/a3499cb78849424db45e54caac01de92/shares/c5d9b059-bdd0-4fae-9bd0-328d926e5694 => generated 1371 bytes in 31 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:57:27 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-5a9f8dbe-e1e6-4658-b138-250775624864 tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] http://10.27.203.238/share/v1/fe54df7c653849ab8ec7523262c597cf/snapshots returned with HTTP 200 May 28 12:57:27 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 352/690] 10.27.203.238 () {62 vars in 1306 bytes} [Tue May 28 12:57:27 2024] GET /share/v1/fe54df7c653849ab8ec7523262c597cf/snapshots => generated 403 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:57:27 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-4f60fa13-3951-4fc4-8adf-816c3445083f tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] GET http://10.27.203.238/share/v1/fe54df7c653849ab8ec7523262c597cf/snapshots/detail May 28 12:57:27 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-4f60fa13-3951-4fc4-8adf-816c3445083f tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:27 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-4f60fa13-3951-4fc4-8adf-816c3445083f tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] Calling method 'ShareSnapshotMixin.detail' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:27 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.share.api [None req-4f60fa13-3951-4fc4-8adf-816c3445083f tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] Searching for snapshots by: {} {{(pid=98330) _get_all_snapshots /opt/stack/manila/manila/share/api.py:2349}} May 28 12:57:27 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a26ac8ef-2c95-49c8-896a-27a98ee94388 tempest-AdminActionsTest-1749172189 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:57:27 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a26ac8ef-2c95-49c8-896a-27a98ee94388 tempest-AdminActionsTest-1749172189 None] [Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=0, created='2024-05-28T12:57:16.761770Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='eef0d88b-92de-42e0-9816-91439c2589ed', id=16, internal=False, is_s3_default_policy=False, name='891641f2-366e-4b85-925e-8cffaa759ace', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=[], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['*'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['*'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T12:57:17.162490Z', tenant_id=1, tenant_name='default', title='891641f2-366e-4b85-925e-8cffaa759ace', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/16/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[])] May 28 12:57:27 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a26ac8ef-2c95-49c8-896a-27a98ee94388 tempest-AdminActionsTest-1749172189 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 12:57:27 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a26ac8ef-2c95-49c8-896a-27a98ee94388 tempest-AdminActionsTest-1749172189 None] >>> [DELETE] https://127.0.0.1:40443/api/viewpolicies/16/ May 28 12:57:27 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-4f60fa13-3951-4fc4-8adf-816c3445083f tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] http://10.27.203.238/share/v1/fe54df7c653849ab8ec7523262c597cf/snapshots/detail returned with HTTP 200 May 28 12:57:27 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 339/691] 10.27.203.238 () {62 vars in 1327 bytes} [Tue May 28 12:57:27 2024] GET /share/v1/fe54df7c653849ab8ec7523262c597cf/snapshots/detail => generated 638 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:57:27 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-eced5e1f-d39e-41cd-a2bd-6aa69290e071 tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] DELETE http://10.27.203.238/share/v2/fe54df7c653849ab8ec7523262c597cf/snapshots/ad33850e-6645-4962-a407-4dc7bb8e5045 May 28 12:57:27 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-eced5e1f-d39e-41cd-a2bd-6aa69290e071 tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:27 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-eced5e1f-d39e-41cd-a2bd-6aa69290e071 tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] Calling method 'ShareSnapshotMixin.delete' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:27 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.v1.share_snapshots [None req-eced5e1f-d39e-41cd-a2bd-6aa69290e071 tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] Delete snapshot with id: ad33850e-6645-4962-a407-4dc7bb8e5045 May 28 12:57:28 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-eced5e1f-d39e-41cd-a2bd-6aa69290e071 tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] http://10.27.203.238/share/v2/fe54df7c653849ab8ec7523262c597cf/snapshots/ad33850e-6645-4962-a407-4dc7bb8e5045 returned with HTTP 202 May 28 12:57:28 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 353/692] 10.27.203.238 () {64 vars in 1463 bytes} [Tue May 28 12:57:27 2024] DELETE /share/v2/fe54df7c653849ab8ec7523262c597cf/snapshots/ad33850e-6645-4962-a407-4dc7bb8e5045 => generated 0 bytes in 96 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:57:28 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-8050c16a-d914-4208-b1d3-f8f1f5b77b75 tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] GET http://10.27.203.238/share/v2/fe54df7c653849ab8ec7523262c597cf/snapshots/ad33850e-6645-4962-a407-4dc7bb8e5045 May 28 12:57:28 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-8050c16a-d914-4208-b1d3-f8f1f5b77b75 tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:28 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-8050c16a-d914-4208-b1d3-f8f1f5b77b75 tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] Calling method 'ShareSnapshotMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:28 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-8050c16a-d914-4208-b1d3-f8f1f5b77b75 tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] http://10.27.203.238/share/v2/fe54df7c653849ab8ec7523262c597cf/snapshots/ad33850e-6645-4962-a407-4dc7bb8e5045 returned with HTTP 200 May 28 12:57:28 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 340/693] 10.27.203.238 () {64 vars in 1460 bytes} [Tue May 28 12:57:28 2024] GET /share/v2/fe54df7c653849ab8ec7523262c597cf/snapshots/ad33850e-6645-4962-a407-4dc7bb8e5045 => generated 774 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:57:28 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-eced5e1f-d39e-41cd-a2bd-6aa69290e071 tempest-SharesActionsAdminTest-1286316336 None] >>> [GET] https://127.0.0.1:40443/api/snapshots/ May 28 12:57:28 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-eced5e1f-d39e-41cd-a2bd-6aa69290e071 tempest-SharesActionsAdminTest-1286316336 None] {'allow_redirects': True, May 28 12:57:28 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-eced5e1f-d39e-41cd-a2bd-6aa69290e071 tempest-SharesActionsAdminTest-1286316336 None] 'params': {'name': 'share-snapshot-ced65a7e-7f74-4c22-bb6e-0b88e0a53b00'}} May 28 12:57:28 l75lg1-v1 dstat.sh[49771]: 28-05 12:57:28| 14 2 80 4 0|5685M 1810M 277M 7853M| 16k 22k| 256k 6213k|2.00 457 |5187 7805 |1.65 1.06 1.01|1.0 0 9.0| 0 0 | 0 2048M| 29 355 0 81 0 May 28 12:57:28 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ad0f4df2-cc05-4f5c-9c4b-93754c9df166 tempest-ShareSnapshotInstancesTest-843694899 None] <<< [POST] https://127.0.0.1:40443/api/snapshots/ May 28 12:57:28 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ad0f4df2-cc05-4f5c-9c4b-93754c9df166 tempest-ShareSnapshotInstancesTest-843694899 None] Bunch(access_path='/.vast_all_snapshots/1000000003_share-snapshot-c7ea0dae-078a-429a-ab92-8154afeab33a', aggr_phys_estimation=0, cluster='loop75-kfs', created='2024-05-28T12:57:25.925071Z', eta_sec=30819898949.768444, expiration_time='3001-01-19T07:59:58Z', guid='c27c2f05-28f9-4286-ae3c-f15bb1af55bf', id=4, indestructible=False, locked=False, name='share-snapshot-c7ea0dae-078a-429a-ab92-8154afeab33a', path='/manila/manila-c2f741cd-bac5-499f-9539-8e93d6a81282/', policy=None, policy_id=None, protection_policy_id=None, state='SUCCEED', tenant_id=1, tenant_name='default', title='share-snapshot-c7ea0dae-078a-429a-ab92-8154afeab33a(/manila/manila-c2f741cd-bac5-499f-9539-8e93d6a81282/)', type='local', unique_phys_estimation=0, url='https://127.0.0.1:40443/api/snapshots/4/') May 28 12:57:28 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ad0f4df2-cc05-4f5c-9c4b-93754c9df166 tempest-ShareSnapshotInstancesTest-843694899 None] --- [POST] https://127.0.0.1:40443/api/snapshots/: Done May 28 12:57:28 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-61139e70-4a3f-4962-9a7d-6fde22916298 tempest-SharesMetadataTest-1561320255 None] <<< [POST] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:57:28 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-61139e70-4a3f-4962-9a7d-6fde22916298 tempest-SharesMetadataTest-1561320255 None] Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=0, created='2024-05-28T12:57:27.845930Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='db0128af-0723-414b-8207-c9145bdfb0e8', id=19, internal=False, is_s3_default_policy=False, name='2be2873c-4768-478e-a848-fb1d2654ca64', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=[], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['*'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['*'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T12:57:28.189334Z', tenant_id=1, tenant_name='default', title='2be2873c-4768-478e-a848-fb1d2654ca64', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/19/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[]) May 28 12:57:28 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-61139e70-4a3f-4962-9a7d-6fde22916298 tempest-SharesMetadataTest-1561320255 None] --- [POST] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 12:57:28 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-61139e70-4a3f-4962-9a7d-6fde22916298 tempest-SharesMetadataTest-1561320255 None] >>> [GET] https://127.0.0.1:40443/api/quotas/ May 28 12:57:28 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-61139e70-4a3f-4962-9a7d-6fde22916298 tempest-SharesMetadataTest-1561320255 None] {'allow_redirects': True, May 28 12:57:28 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-61139e70-4a3f-4962-9a7d-6fde22916298 tempest-SharesMetadataTest-1561320255 None] 'params': {'name': '2be2873c-4768-478e-a848-fb1d2654ca64'}} May 28 12:57:28 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-eced5e1f-d39e-41cd-a2bd-6aa69290e071 tempest-SharesActionsAdminTest-1286316336 None] <<< [GET] https://127.0.0.1:40443/api/snapshots/ May 28 12:57:28 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-eced5e1f-d39e-41cd-a2bd-6aa69290e071 tempest-SharesActionsAdminTest-1286316336 None] [Bunch(access_path='/.vast_all_snapshots/1000000002_share-snapshot-ced65a7e-7f74-4c22-bb6e-0b88e0a53b00', aggr_phys_estimation=0, cluster='loop75-kfs', created='2024-05-28T12:57:21.319406Z', eta_sec=30819898949.578476, expiration_time='3001-01-19T07:59:58Z', guid='111e0040-fd12-4ed6-b1aa-539831f66727', id=3, indestructible=False, locked=False, name='share-snapshot-ced65a7e-7f74-4c22-bb6e-0b88e0a53b00', path='/manila/manila-7c19614c-d968-4489-b2ad-bd88c2ef8054/', policy=None, policy_id=None, protection_policy_id=None, state='SUCCEED', tenant_id=1, tenant_name='default', title='share-snapshot-ced65a7e-7f74-4c22-bb6e-0b88e0a53b00(/manila/manila-7c19614c-d968-4489-b2ad-bd88c2ef8054/)', type='local', unique_phys_estimation=0, url='https://127.0.0.1:40443/api/snapshots/3/')] May 28 12:57:28 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-eced5e1f-d39e-41cd-a2bd-6aa69290e071 tempest-SharesActionsAdminTest-1286316336 None] --- [GET] https://127.0.0.1:40443/api/snapshots/: Done May 28 12:57:28 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-eced5e1f-d39e-41cd-a2bd-6aa69290e071 tempest-SharesActionsAdminTest-1286316336 None] >>> [DELETE] https://127.0.0.1:40443/api/snapshots/3/ May 28 12:57:28 l75lg1-v1 neutron-server[77619]: DEBUG dbcounter [-] [77619] Writing DB stats neutron:SELECT=3 {{(pid=77619) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:57:28 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-97917ecb-53f3-4d62-ac83-f8b8a43005d6 tempest-ShareSnapshotInstancesTest-843694899 tempest-ShareSnapshotInstancesTest-843694899-project-admin] GET http://10.27.203.238/share/v2/f4f7702aa04c467288cc6b142f61ec37/snapshots/8f61b18a-3a70-47fb-b981-4fcb057a0c26 May 28 12:57:28 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-97917ecb-53f3-4d62-ac83-f8b8a43005d6 tempest-ShareSnapshotInstancesTest-843694899 tempest-ShareSnapshotInstancesTest-843694899-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:28 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-97917ecb-53f3-4d62-ac83-f8b8a43005d6 tempest-ShareSnapshotInstancesTest-843694899 tempest-ShareSnapshotInstancesTest-843694899-project-admin] Calling method 'ShareSnapshotMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:28 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-97917ecb-53f3-4d62-ac83-f8b8a43005d6 tempest-ShareSnapshotInstancesTest-843694899 tempest-ShareSnapshotInstancesTest-843694899-project-admin] http://10.27.203.238/share/v2/f4f7702aa04c467288cc6b142f61ec37/snapshots/8f61b18a-3a70-47fb-b981-4fcb057a0c26 returned with HTTP 200 May 28 12:57:28 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 354/694] 10.27.203.238 () {64 vars in 1460 bytes} [Tue May 28 12:57:28 2024] GET /share/v2/f4f7702aa04c467288cc6b142f61ec37/snapshots/8f61b18a-3a70-47fb-b981-4fcb057a0c26 => generated 750 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:57:28 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-cedbef15-7111-4f10-9665-c32463f21a50 tempest-ShareSnapshotInstancesTest-843694899 tempest-ShareSnapshotInstancesTest-843694899-project-admin] GET http://10.27.203.238/share/v2/f4f7702aa04c467288cc6b142f61ec37/snapshot-instances?snapshot_id=8f61b18a-3a70-47fb-b981-4fcb057a0c26 May 28 12:57:28 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-cedbef15-7111-4f10-9665-c32463f21a50 tempest-ShareSnapshotInstancesTest-843694899 tempest-ShareSnapshotInstancesTest-843694899-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:28 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-cedbef15-7111-4f10-9665-c32463f21a50 tempest-ShareSnapshotInstancesTest-843694899 tempest-ShareSnapshotInstancesTest-843694899-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:28 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-cedbef15-7111-4f10-9665-c32463f21a50 tempest-ShareSnapshotInstancesTest-843694899 tempest-ShareSnapshotInstancesTest-843694899-project-admin] http://10.27.203.238/share/v2/f4f7702aa04c467288cc6b142f61ec37/snapshot-instances?snapshot_id=8f61b18a-3a70-47fb-b981-4fcb057a0c26 returned with HTTP 200 May 28 12:57:28 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 341/695] 10.27.203.238 () {64 vars in 1473 bytes} [Tue May 28 12:57:28 2024] GET /share/v2/f4f7702aa04c467288cc6b142f61ec37/snapshot-instances?snapshot_id=8f61b18a-3a70-47fb-b981-4fcb057a0c26 => generated 150 bytes in 22 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:57:28 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-a748bf1a-34cf-4920-899d-ba2003c636ab tempest-ShareSnapshotInstancesTest-843694899 tempest-ShareSnapshotInstancesTest-843694899-project-admin] POST http://10.27.203.238/share/v2/f4f7702aa04c467288cc6b142f61ec37/snapshot-instances/c7ea0dae-078a-429a-ab92-8154afeab33a/action May 28 12:57:28 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-a748bf1a-34cf-4920-899d-ba2003c636ab tempest-ShareSnapshotInstancesTest-843694899 tempest-ShareSnapshotInstancesTest-843694899-project-admin] Action body: b'{"reset_status": {"status": "error"}}' {{(pid=98329) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:57:28 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-a748bf1a-34cf-4920-899d-ba2003c636ab tempest-ShareSnapshotInstancesTest-843694899 tempest-ShareSnapshotInstancesTest-843694899-project-admin] Action: 'action', calling method: Controller.__getattribute__..version_select, body: {"reset_status": {"status": "error"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:57:28 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-a748bf1a-34cf-4920-899d-ba2003c636ab tempest-ShareSnapshotInstancesTest-843694899 tempest-ShareSnapshotInstancesTest-843694899-project-admin] Updating share_snapshot_instance 'c7ea0dae-078a-429a-ab92-8154afeab33a' with '{'status': 'error'}' {{(pid=98329) _reset_status /opt/stack/manila/manila/api/openstack/wsgi.py:1257}} May 28 12:57:28 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-61139e70-4a3f-4962-9a7d-6fde22916298 tempest-SharesMetadataTest-1561320255 None] <<< [GET] https://127.0.0.1:40443/api/quotas/ May 28 12:57:28 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-61139e70-4a3f-4962-9a7d-6fde22916298 tempest-SharesMetadataTest-1561320255 None] [] May 28 12:57:28 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-61139e70-4a3f-4962-9a7d-6fde22916298 tempest-SharesMetadataTest-1561320255 None] --- [GET] https://127.0.0.1:40443/api/quotas/: Done May 28 12:57:28 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-61139e70-4a3f-4962-9a7d-6fde22916298 tempest-SharesMetadataTest-1561320255 None] >>> [POST] https://127.0.0.1:40443/api/quotas/ May 28 12:57:28 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-61139e70-4a3f-4962-9a7d-6fde22916298 tempest-SharesMetadataTest-1561320255 None] {'data': '{"name": "2be2873c-4768-478e-a848-fb1d2654ca64", "path": ' May 28 12:57:28 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-61139e70-4a3f-4962-9a7d-6fde22916298 tempest-SharesMetadataTest-1561320255 None] '"/manila/manila-2be2873c-4768-478e-a848-fb1d2654ca64", "create_dir": ' May 28 12:57:28 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-61139e70-4a3f-4962-9a7d-6fde22916298 tempest-SharesMetadataTest-1561320255 None] 'true, "hard_limit": 1073741824}', May 28 12:57:28 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-61139e70-4a3f-4962-9a7d-6fde22916298 tempest-SharesMetadataTest-1561320255 None] 'json': None, May 28 12:57:28 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-61139e70-4a3f-4962-9a7d-6fde22916298 tempest-SharesMetadataTest-1561320255 None] 'params': None} May 28 12:57:28 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-a748bf1a-34cf-4920-899d-ba2003c636ab tempest-ShareSnapshotInstancesTest-843694899 tempest-ShareSnapshotInstancesTest-843694899-project-admin] http://10.27.203.238/share/v2/f4f7702aa04c467288cc6b142f61ec37/snapshot-instances/c7ea0dae-078a-429a-ab92-8154afeab33a/action returned with HTTP 202 May 28 12:57:28 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 355/696] 10.27.203.238 () {66 vars in 1529 bytes} [Tue May 28 12:57:28 2024] POST /share/v2/f4f7702aa04c467288cc6b142f61ec37/snapshot-instances/c7ea0dae-078a-429a-ab92-8154afeab33a/action => generated 0 bytes in 45 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:57:28 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-c57d014a-af46-4e77-a3c8-a84d9b2a3c6f tempest-ShareSnapshotInstancesTest-843694899 tempest-ShareSnapshotInstancesTest-843694899-project-admin] GET http://10.27.203.238/share/v2/f4f7702aa04c467288cc6b142f61ec37/snapshot-instances/c7ea0dae-078a-429a-ab92-8154afeab33a May 28 12:57:28 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-c57d014a-af46-4e77-a3c8-a84d9b2a3c6f tempest-ShareSnapshotInstancesTest-843694899 tempest-ShareSnapshotInstancesTest-843694899-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:28 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-c57d014a-af46-4e77-a3c8-a84d9b2a3c6f tempest-ShareSnapshotInstancesTest-843694899 tempest-ShareSnapshotInstancesTest-843694899-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:28 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-3e942cba-0587-4cbb-b520-59523fea767f tempest-AccessesMetadataNegativeTest-1660907003 None] <<< [DELETE] https://127.0.0.1:40443/api/views/16/ May 28 12:57:28 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-3e942cba-0587-4cbb-b520-59523fea767f tempest-AccessesMetadataNegativeTest-1660907003 None] --- [DELETE] https://127.0.0.1:40443/api/views/16/: Done May 28 12:57:28 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-3e942cba-0587-4cbb-b520-59523fea767f tempest-AccessesMetadataNegativeTest-1660907003 None] >>> [GET] https://127.0.0.1:40443/api/quotas/ May 28 12:57:28 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-3e942cba-0587-4cbb-b520-59523fea767f tempest-AccessesMetadataNegativeTest-1660907003 None] {'allow_redirects': True, May 28 12:57:28 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-3e942cba-0587-4cbb-b520-59523fea767f tempest-AccessesMetadataNegativeTest-1660907003 None] 'params': {'name': '113739f1-d41a-4f4e-b63f-071e2ecd0a7b'}} May 28 12:57:28 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-c57d014a-af46-4e77-a3c8-a84d9b2a3c6f tempest-ShareSnapshotInstancesTest-843694899 tempest-ShareSnapshotInstancesTest-843694899-project-admin] http://10.27.203.238/share/v2/f4f7702aa04c467288cc6b142f61ec37/snapshot-instances/c7ea0dae-078a-429a-ab92-8154afeab33a returned with HTTP 200 May 28 12:57:28 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 342/697] 10.27.203.238 () {64 vars in 1487 bytes} [Tue May 28 12:57:28 2024] GET /share/v2/f4f7702aa04c467288cc6b142f61ec37/snapshot-instances/c7ea0dae-078a-429a-ab92-8154afeab33a => generated 391 bytes in 21 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:57:28 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-50f94a4c-379d-41b5-a0ac-a3477695db7a tempest-ShareSnapshotInstancesTest-843694899 tempest-ShareSnapshotInstancesTest-843694899-project-admin] POST http://10.27.203.238/share/v2/f4f7702aa04c467288cc6b142f61ec37/snapshot-instances/c7ea0dae-078a-429a-ab92-8154afeab33a/action May 28 12:57:28 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-50f94a4c-379d-41b5-a0ac-a3477695db7a tempest-ShareSnapshotInstancesTest-843694899 tempest-ShareSnapshotInstancesTest-843694899-project-admin] Action body: b'{"reset_status": {"status": "available"}}' {{(pid=98329) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:57:28 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-50f94a4c-379d-41b5-a0ac-a3477695db7a tempest-ShareSnapshotInstancesTest-843694899 tempest-ShareSnapshotInstancesTest-843694899-project-admin] Action: 'action', calling method: ShareSnapshotInstancesController.reset_status, body: {"reset_status": {"status": "available"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:57:28 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-50f94a4c-379d-41b5-a0ac-a3477695db7a tempest-ShareSnapshotInstancesTest-843694899 tempest-ShareSnapshotInstancesTest-843694899-project-admin] Updating share_snapshot_instance 'c7ea0dae-078a-429a-ab92-8154afeab33a' with '{'status': 'available'}' {{(pid=98329) _reset_status /opt/stack/manila/manila/api/openstack/wsgi.py:1257}} May 28 12:57:28 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-50f94a4c-379d-41b5-a0ac-a3477695db7a tempest-ShareSnapshotInstancesTest-843694899 tempest-ShareSnapshotInstancesTest-843694899-project-admin] http://10.27.203.238/share/v2/f4f7702aa04c467288cc6b142f61ec37/snapshot-instances/c7ea0dae-078a-429a-ab92-8154afeab33a/action returned with HTTP 202 May 28 12:57:28 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 356/698] 10.27.203.238 () {66 vars in 1529 bytes} [Tue May 28 12:57:28 2024] POST /share/v2/f4f7702aa04c467288cc6b142f61ec37/snapshot-instances/c7ea0dae-078a-429a-ab92-8154afeab33a/action => generated 0 bytes in 46 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:57:28 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-30e30f63-6d3e-44ba-b677-60af49fa9832 tempest-AccessesMetadataNegativeTest-1660907003 tempest-AccessesMetadataNegativeTest-1660907003-project-member] GET http://10.27.203.238/share/v2/ed83204ad63946bdae288892bd07d115/shares/1b8e12e8-6d99-48c0-8368-d1a37e2ca2ca May 28 12:57:28 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-30e30f63-6d3e-44ba-b677-60af49fa9832 tempest-AccessesMetadataNegativeTest-1660907003 tempest-AccessesMetadataNegativeTest-1660907003-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:28 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-30e30f63-6d3e-44ba-b677-60af49fa9832 tempest-AccessesMetadataNegativeTest-1660907003 tempest-AccessesMetadataNegativeTest-1660907003-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:28 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-ced623fe-9db1-44ce-9492-a765e6c56207 tempest-ShareSnapshotInstancesTest-843694899 tempest-ShareSnapshotInstancesTest-843694899-project-admin] GET http://10.27.203.238/share/v2/f4f7702aa04c467288cc6b142f61ec37/snapshot-instances/c7ea0dae-078a-429a-ab92-8154afeab33a May 28 12:57:28 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-ced623fe-9db1-44ce-9492-a765e6c56207 tempest-ShareSnapshotInstancesTest-843694899 tempest-ShareSnapshotInstancesTest-843694899-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:28 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-ced623fe-9db1-44ce-9492-a765e6c56207 tempest-ShareSnapshotInstancesTest-843694899 tempest-ShareSnapshotInstancesTest-843694899-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:28 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-30e30f63-6d3e-44ba-b677-60af49fa9832 tempest-AccessesMetadataNegativeTest-1660907003 tempest-AccessesMetadataNegativeTest-1660907003-project-member] http://10.27.203.238/share/v2/ed83204ad63946bdae288892bd07d115/shares/1b8e12e8-6d99-48c0-8368-d1a37e2ca2ca returned with HTTP 200 May 28 12:57:28 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 343/699] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:57:28 2024] GET /share/v2/ed83204ad63946bdae288892bd07d115/shares/1b8e12e8-6d99-48c0-8368-d1a37e2ca2ca => generated 1316 bytes in 26 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:57:28 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-ced623fe-9db1-44ce-9492-a765e6c56207 tempest-ShareSnapshotInstancesTest-843694899 tempest-ShareSnapshotInstancesTest-843694899-project-admin] http://10.27.203.238/share/v2/f4f7702aa04c467288cc6b142f61ec37/snapshot-instances/c7ea0dae-078a-429a-ab92-8154afeab33a returned with HTTP 200 May 28 12:57:28 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 357/700] 10.27.203.238 () {64 vars in 1487 bytes} [Tue May 28 12:57:28 2024] GET /share/v2/f4f7702aa04c467288cc6b142f61ec37/snapshot-instances/c7ea0dae-078a-429a-ab92-8154afeab33a => generated 395 bytes in 23 msecs (HTTP/1.1 200) 6 headers in 231 bytes (2 switches on core 0) May 28 12:57:28 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-e2a32939-6895-4d15-8cb5-e302833164a5 tempest-ShareSnapshotInstancesTest-843694899 tempest-ShareSnapshotInstancesTest-843694899-project-admin] DELETE http://10.27.203.238/share/v2/f4f7702aa04c467288cc6b142f61ec37/snapshots/8f61b18a-3a70-47fb-b981-4fcb057a0c26 May 28 12:57:28 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-e2a32939-6895-4d15-8cb5-e302833164a5 tempest-ShareSnapshotInstancesTest-843694899 tempest-ShareSnapshotInstancesTest-843694899-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:28 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-e2a32939-6895-4d15-8cb5-e302833164a5 tempest-ShareSnapshotInstancesTest-843694899 tempest-ShareSnapshotInstancesTest-843694899-project-admin] Calling method 'ShareSnapshotMixin.delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:28 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.v1.share_snapshots [None req-e2a32939-6895-4d15-8cb5-e302833164a5 tempest-ShareSnapshotInstancesTest-843694899 tempest-ShareSnapshotInstancesTest-843694899-project-admin] Delete snapshot with id: 8f61b18a-3a70-47fb-b981-4fcb057a0c26 May 28 12:57:28 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-e2a32939-6895-4d15-8cb5-e302833164a5 tempest-ShareSnapshotInstancesTest-843694899 tempest-ShareSnapshotInstancesTest-843694899-project-admin] http://10.27.203.238/share/v2/f4f7702aa04c467288cc6b142f61ec37/snapshots/8f61b18a-3a70-47fb-b981-4fcb057a0c26 returned with HTTP 202 May 28 12:57:28 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 344/701] 10.27.203.238 () {64 vars in 1463 bytes} [Tue May 28 12:57:28 2024] DELETE /share/v2/f4f7702aa04c467288cc6b142f61ec37/snapshots/8f61b18a-3a70-47fb-b981-4fcb057a0c26 => generated 0 bytes in 99 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:57:28 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-8882d694-268d-4b3b-83a7-356766dfa964 tempest-ShareSnapshotInstancesTest-843694899 tempest-ShareSnapshotInstancesTest-843694899-project-admin] GET http://10.27.203.238/share/v2/f4f7702aa04c467288cc6b142f61ec37/snapshots/8f61b18a-3a70-47fb-b981-4fcb057a0c26 May 28 12:57:28 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-8882d694-268d-4b3b-83a7-356766dfa964 tempest-ShareSnapshotInstancesTest-843694899 tempest-ShareSnapshotInstancesTest-843694899-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:28 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-8882d694-268d-4b3b-83a7-356766dfa964 tempest-ShareSnapshotInstancesTest-843694899 tempest-ShareSnapshotInstancesTest-843694899-project-admin] Calling method 'ShareSnapshotMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:28 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-8882d694-268d-4b3b-83a7-356766dfa964 tempest-ShareSnapshotInstancesTest-843694899 tempest-ShareSnapshotInstancesTest-843694899-project-admin] http://10.27.203.238/share/v2/f4f7702aa04c467288cc6b142f61ec37/snapshots/8f61b18a-3a70-47fb-b981-4fcb057a0c26 returned with HTTP 200 May 28 12:57:28 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 358/702] 10.27.203.238 () {64 vars in 1460 bytes} [Tue May 28 12:57:28 2024] GET /share/v2/f4f7702aa04c467288cc6b142f61ec37/snapshots/8f61b18a-3a70-47fb-b981-4fcb057a0c26 => generated 749 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:57:28 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e2a32939-6895-4d15-8cb5-e302833164a5 tempest-ShareSnapshotInstancesTest-843694899 None] >>> [GET] https://127.0.0.1:40443/api/snapshots/ May 28 12:57:28 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e2a32939-6895-4d15-8cb5-e302833164a5 tempest-ShareSnapshotInstancesTest-843694899 None] {'allow_redirects': True, May 28 12:57:28 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e2a32939-6895-4d15-8cb5-e302833164a5 tempest-ShareSnapshotInstancesTest-843694899 None] 'params': {'name': 'share-snapshot-c7ea0dae-078a-429a-ab92-8154afeab33a'}} May 28 12:57:29 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e2a32939-6895-4d15-8cb5-e302833164a5 tempest-ShareSnapshotInstancesTest-843694899 None] <<< [GET] https://127.0.0.1:40443/api/snapshots/ May 28 12:57:29 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e2a32939-6895-4d15-8cb5-e302833164a5 tempest-ShareSnapshotInstancesTest-843694899 None] [Bunch(access_path='/.vast_all_snapshots/1000000003_share-snapshot-c7ea0dae-078a-429a-ab92-8154afeab33a', aggr_phys_estimation=0, cluster='loop75-kfs', created='2024-05-28T12:57:25.925071Z', eta_sec=30819898948.83795, expiration_time='3001-01-19T07:59:58Z', guid='c27c2f05-28f9-4286-ae3c-f15bb1af55bf', id=4, indestructible=False, locked=False, name='share-snapshot-c7ea0dae-078a-429a-ab92-8154afeab33a', path='/manila/manila-c2f741cd-bac5-499f-9539-8e93d6a81282/', policy=None, policy_id=None, protection_policy_id=None, state='SUCCEED', tenant_id=1, tenant_name='default', title='share-snapshot-c7ea0dae-078a-429a-ab92-8154afeab33a(/manila/manila-c2f741cd-bac5-499f-9539-8e93d6a81282/)', type='local', unique_phys_estimation=0, url='https://127.0.0.1:40443/api/snapshots/4/')] May 28 12:57:29 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e2a32939-6895-4d15-8cb5-e302833164a5 tempest-ShareSnapshotInstancesTest-843694899 None] --- [GET] https://127.0.0.1:40443/api/snapshots/: Done May 28 12:57:29 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e2a32939-6895-4d15-8cb5-e302833164a5 tempest-ShareSnapshotInstancesTest-843694899 None] >>> [DELETE] https://127.0.0.1:40443/api/snapshots/4/ May 28 12:57:29 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-3e942cba-0587-4cbb-b520-59523fea767f tempest-AccessesMetadataNegativeTest-1660907003 None] <<< [GET] https://127.0.0.1:40443/api/quotas/ May 28 12:57:29 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-3e942cba-0587-4cbb-b520-59523fea767f tempest-AccessesMetadataNegativeTest-1660907003 None] [Bunch(cluster='loop75-kfs', cluster_id=1, default_email=None, default_group_quota=None, default_user_quota=None, enable_alarms=True, enable_email_providers=True, grace_period=None, guid='d4c3c5c4-93d2-45ff-a090-01451c34d58d', hard_limit=1073741824, hard_limit_inodes=None, id=14, internal=False, is_user_quota=False, last_user_quotas_update=None, name='113739f1-d41a-4f4e-b63f-071e2ecd0a7b', num_blocked_users=0, num_exceeded_users=0, path='/manila/manila-113739f1-d41a-4f4e-b63f-071e2ecd0a7b', percent_capacity=0, percent_inodes=None, pretty_grace_period=None, pretty_grace_period_expiration=None, pretty_state='OK (CREATED)', soft_limit=None, soft_limit_inodes=None, state='OK', sync_state='CREATED', system_id=14, tenant_id=1, tenant_name='default', time_to_block=None, title='113739f1-d41a-4f4e-b63f-071e2ecd0a7b', url='https://127.0.0.1:40443/api/quotas/14/', used_capacity=0, used_capacity_tb=0.0, used_effective_capacity=0, used_effective_capacity_tb=0.0, used_inodes=0, used_limited_capacity=0)] May 28 12:57:29 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-3e942cba-0587-4cbb-b520-59523fea767f tempest-AccessesMetadataNegativeTest-1660907003 None] --- [GET] https://127.0.0.1:40443/api/quotas/: Done May 28 12:57:29 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-3e942cba-0587-4cbb-b520-59523fea767f tempest-AccessesMetadataNegativeTest-1660907003 None] >>> [DELETE] https://127.0.0.1:40443/api/quotas/14/ May 28 12:57:29 l75lg1-v1 dstat.sh[49771]: 28-05 12:57:29| 5 1 92 1 0|5687M 1808M 277M 7853M| 27k 5050B| 0 8756k| 0 861 |3793 5974 |1.65 1.06 1.01|1.0 0 0| 0 0 | 0 2048M| 29 355 0 78 0 May 28 12:57:29 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-61139e70-4a3f-4962-9a7d-6fde22916298 tempest-SharesMetadataTest-1561320255 None] <<< [POST] https://127.0.0.1:40443/api/quotas/ May 28 12:57:29 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-61139e70-4a3f-4962-9a7d-6fde22916298 tempest-SharesMetadataTest-1561320255 None] Bunch(cluster='loop75-kfs', cluster_id=1, default_email=None, default_group_quota=None, default_user_quota=None, enable_alarms=True, enable_email_providers=True, grace_period=None, group_quotas=[], guid='8e6fd8ce-aa33-4ab2-9148-729c0b02afdf', hard_limit=1073741824, hard_limit_inodes=None, id=16, internal=False, is_user_quota=False, last_user_quotas_update=None, name='2be2873c-4768-478e-a848-fb1d2654ca64', num_blocked_users=0, num_exceeded_users=0, path='/manila/manila-2be2873c-4768-478e-a848-fb1d2654ca64', percent_capacity=0, percent_inodes=None, pretty_grace_period=None, pretty_grace_period_expiration=None, pretty_state='OK (CREATED)', soft_limit=None, soft_limit_inodes=None, state='OK', sync_state='CREATED', system_id=16, tenant_id=1, tenant_name='default', time_to_block=None, title='2be2873c-4768-478e-a848-fb1d2654ca64', url='https://127.0.0.1:40443/api/quotas/16/', used_capacity=0, used_capacity_tb=0.0, used_effective_capacity=0, used_effective_capacity_tb=0.0, used_inodes=0, used_limited_capacity=0, user_quotas=[]) May 28 12:57:29 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-61139e70-4a3f-4962-9a7d-6fde22916298 tempest-SharesMetadataTest-1561320255 None] --- [POST] https://127.0.0.1:40443/api/quotas/: Done May 28 12:57:29 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-61139e70-4a3f-4962-9a7d-6fde22916298 tempest-SharesMetadataTest-1561320255 None] >>> [GET] https://127.0.0.1:40443/api/views/ May 28 12:57:29 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-61139e70-4a3f-4962-9a7d-6fde22916298 tempest-SharesMetadataTest-1561320255 None] {'allow_redirects': True, May 28 12:57:29 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-61139e70-4a3f-4962-9a7d-6fde22916298 tempest-SharesMetadataTest-1561320255 None] 'params': {'name': '2be2873c-4768-478e-a848-fb1d2654ca64'}} May 28 12:57:29 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-78e0be03-802b-4956-9d60-f780b814d476 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] GET http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/36ebac5b-70c6-4cc4-85fa-1acc9586628e May 28 12:57:29 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-78e0be03-802b-4956-9d60-f780b814d476 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:29 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-78e0be03-802b-4956-9d60-f780b814d476 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:29 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-78e0be03-802b-4956-9d60-f780b814d476 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/36ebac5b-70c6-4cc4-85fa-1acc9586628e returned with HTTP 200 May 28 12:57:29 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 345/703] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:57:29 2024] GET /share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/36ebac5b-70c6-4cc4-85fa-1acc9586628e => generated 1314 bytes in 25 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:57:29 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-61139e70-4a3f-4962-9a7d-6fde22916298 tempest-SharesMetadataTest-1561320255 None] <<< [GET] https://127.0.0.1:40443/api/views/ May 28 12:57:29 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-61139e70-4a3f-4962-9a7d-6fde22916298 tempest-SharesMetadataTest-1561320255 None] [] May 28 12:57:29 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-61139e70-4a3f-4962-9a7d-6fde22916298 tempest-SharesMetadataTest-1561320255 None] --- [GET] https://127.0.0.1:40443/api/views/: Done May 28 12:57:29 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-61139e70-4a3f-4962-9a7d-6fde22916298 tempest-SharesMetadataTest-1561320255 None] >>> [POST] https://127.0.0.1:40443/api/views/ May 28 12:57:29 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-61139e70-4a3f-4962-9a7d-6fde22916298 tempest-SharesMetadataTest-1561320255 None] {'data': '{"name": "2be2873c-4768-478e-a848-fb1d2654ca64", "path": ' May 28 12:57:29 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-61139e70-4a3f-4962-9a7d-6fde22916298 tempest-SharesMetadataTest-1561320255 None] '"/manila/manila-2be2873c-4768-478e-a848-fb1d2654ca64", "policy_id": ' May 28 12:57:29 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-61139e70-4a3f-4962-9a7d-6fde22916298 tempest-SharesMetadataTest-1561320255 None] '19, "create_dir": true, "protocols": ["NFS"]}', May 28 12:57:29 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-61139e70-4a3f-4962-9a7d-6fde22916298 tempest-SharesMetadataTest-1561320255 None] 'json': None, May 28 12:57:29 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-61139e70-4a3f-4962-9a7d-6fde22916298 tempest-SharesMetadataTest-1561320255 None] 'params': None} May 28 12:57:29 l75lg1-v1 nova-conductor[83647]: DEBUG dbcounter [-] [83647] Writing DB stats nova_cell1:SELECT=2,nova_cell1:UPDATE=2 {{(pid=83647) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:57:29 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a26ac8ef-2c95-49c8-896a-27a98ee94388 tempest-AdminActionsTest-1749172189 None] <<< [DELETE] https://127.0.0.1:40443/api/viewpolicies/16/ May 28 12:57:29 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a26ac8ef-2c95-49c8-896a-27a98ee94388 tempest-AdminActionsTest-1749172189 None] --- [DELETE] https://127.0.0.1:40443/api/viewpolicies/16/: Done May 28 12:57:29 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-eced5e1f-d39e-41cd-a2bd-6aa69290e071 tempest-SharesActionsAdminTest-1286316336 None] <<< [DELETE] https://127.0.0.1:40443/api/snapshots/3/ May 28 12:57:29 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-eced5e1f-d39e-41cd-a2bd-6aa69290e071 tempest-SharesActionsAdminTest-1286316336 None] --- [DELETE] https://127.0.0.1:40443/api/snapshots/3/: Done May 28 12:57:29 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-a26ac8ef-2c95-49c8-896a-27a98ee94388 tempest-AdminActionsTest-1749172189 None] Created reservations ['c6e508eb-0127-494b-9306-a44a5bb9e82d', '4d159704-ca3e-48e1-94c2-845c382c088e', 'a483c44a-1df5-4278-88da-e040af1b8a56', '4bb17a34-4a1d-4445-88af-59b70f11be50'] {{(pid=98474) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 12:57:29 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-a26ac8ef-2c95-49c8-896a-27a98ee94388 tempest-AdminActionsTest-1749172189 None] Committed reservations ['c6e508eb-0127-494b-9306-a44a5bb9e82d', '4d159704-ca3e-48e1-94c2-845c382c088e', 'a483c44a-1df5-4278-88da-e040af1b8a56', '4bb17a34-4a1d-4445-88af-59b70f11be50'] {{(pid=98474) commit /opt/stack/manila/manila/quota.py:1063}} May 28 12:57:29 l75lg1-v1 manila-share[98474]: INFO manila.share.manager [None req-a26ac8ef-2c95-49c8-896a-27a98ee94388 tempest-AdminActionsTest-1749172189 None] Share instance 891641f2-366e-4b85-925e-8cffaa759ace: deleted successfully. May 28 12:57:29 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-eced5e1f-d39e-41cd-a2bd-6aa69290e071 tempest-SharesActionsAdminTest-1286316336 None] Created reservations ['e48a2ccd-9fce-4e86-900c-3327de9fa4ad', '160b9de3-a5e9-4020-be6c-dd46b74a9410', '642b4d87-9783-4ffa-bc1c-7a2d8b815163', 'c974c9f9-ac4e-4ce0-b573-43d7d98ef5cf'] {{(pid=98474) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 12:57:29 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-eced5e1f-d39e-41cd-a2bd-6aa69290e071 tempest-SharesActionsAdminTest-1286316336 None] Committed reservations ['e48a2ccd-9fce-4e86-900c-3327de9fa4ad', '160b9de3-a5e9-4020-be6c-dd46b74a9410', '642b4d87-9783-4ffa-bc1c-7a2d8b815163', 'c974c9f9-ac4e-4ce0-b573-43d7d98ef5cf'] {{(pid=98474) commit /opt/stack/manila/manila/quota.py:1063}} May 28 12:57:30 l75lg1-v1 dstat.sh[49771]: 28-05 12:57:30| 3 1 95 2 0|5688M 1807M 277M 7853M| 25k 1742B| 0 1036k| 0 162 |2942 5106 |1.65 1.06 1.01|1.0 0 0| 0 0 | 0 2048M| 29 355 0 78 0 May 28 12:57:30 l75lg1-v1 neutron-server[77618]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.HashRingHealthCheckPeriodics.touch_hash_ring_nodes' {{(pid=77618) _process_scheduled /opt/stack/data/venv/lib/python3.10/site-packages/futurist/periodics.py:638}} May 28 12:57:30 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e2a32939-6895-4d15-8cb5-e302833164a5 tempest-ShareSnapshotInstancesTest-843694899 None] <<< [DELETE] https://127.0.0.1:40443/api/snapshots/4/ May 28 12:57:30 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e2a32939-6895-4d15-8cb5-e302833164a5 tempest-ShareSnapshotInstancesTest-843694899 None] --- [DELETE] https://127.0.0.1:40443/api/snapshots/4/: Done May 28 12:57:30 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-e2a32939-6895-4d15-8cb5-e302833164a5 tempest-ShareSnapshotInstancesTest-843694899 None] Created reservations ['68702d30-5190-4075-9a8c-ad3fe1480e7a', 'ab6cc4da-10b3-417f-a6bd-8c882de53183', '349c3786-0897-473d-830d-3a4e378e2d9e', 'e7c7264c-6f1f-4a1c-bfef-9192026dac45'] {{(pid=98474) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 12:57:30 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-e2a32939-6895-4d15-8cb5-e302833164a5 tempest-ShareSnapshotInstancesTest-843694899 None] Committed reservations ['68702d30-5190-4075-9a8c-ad3fe1480e7a', 'ab6cc4da-10b3-417f-a6bd-8c882de53183', '349c3786-0897-473d-830d-3a4e378e2d9e', 'e7c7264c-6f1f-4a1c-bfef-9192026dac45'] {{(pid=98474) commit /opt/stack/manila/manila/quota.py:1063}} May 28 12:57:30 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-61139e70-4a3f-4962-9a7d-6fde22916298 tempest-SharesMetadataTest-1561320255 None] <<< [POST] https://127.0.0.1:40443/api/views/ May 28 12:57:30 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-61139e70-4a3f-4962-9a7d-6fde22916298 tempest-SharesMetadataTest-1561320255 None] Bunch(abac_tags=[], abe_max_depth=None, abe_protocols=[], alias='', allow_anonymous_access=False, allow_s3_anonymous_access=False, auto_commit='0d', bucket='', bucket_creators=[], bucket_creators_groups=[], bucket_owner=None, bulk_permission_update_progress=None, bulk_permission_update_state=None, cluster='loop75-kfs', cluster_id=1, created='2024-05-28T12:57:30.362962Z', enabled=True, files_retention_mode='NONE', guid='84d95a43-e15c-4060-87ec-730e526534ff', id=18, ignore_oos=False, internal=False, is_remote=False, is_seamless=False, logical_capacity=0, max_retention_period=None, min_retention_period=None, name='2be2873c-4768-478e-a848-fb1d2654ca64', nfs_interop_flags='BOTH_NFS3_AND_NFS4_INTEROP_DISABLED', path='/manila/manila-2be2873c-4768-478e-a848-fb1d2654ca64', physical_capacity=0, policy='2be2873c-4768-478e-a848-fb1d2654ca64', policy_id=19, protocols=['NFS'], qos_policy=None, qos_policy_id=None, s3_locks=False, s3_locks_retention_mode='NONE', s3_locks_retention_period='', s3_object_ownership_rule='ObjectWriter', s3_unverified_lookup=False, s3_versioning=False, select_for_live_monitoring=False, share='', share_acl=Bunch(acl=[], enabled=False), sync='SYNCED', sync_time='2024-05-28T12:57:30.644319Z', tenant_id=1, tenant_name='default', title='/manila/manila-2be2873c-4768-478e-a848-fb1d2654ca64', url='https://127.0.0.1:40443/api/views/18/') May 28 12:57:30 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-61139e70-4a3f-4962-9a7d-6fde22916298 tempest-SharesMetadataTest-1561320255 None] --- [POST] https://127.0.0.1:40443/api/views/: Done May 28 12:57:30 l75lg1-v1 manila-share[98474]: INFO manila.share.manager [None req-61139e70-4a3f-4962-9a7d-6fde22916298 tempest-SharesMetadataTest-1561320255 None] Share instance 2be2873c-4768-478e-a848-fb1d2654ca64 created successfully. May 28 12:57:30 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-5c8fb8c2-f896-4b93-b878-aea772b7c1cc tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] GET http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/shares/c5d9b059-bdd0-4fae-9bd0-328d926e5694 May 28 12:57:30 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-5c8fb8c2-f896-4b93-b878-aea772b7c1cc tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:30 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-5c8fb8c2-f896-4b93-b878-aea772b7c1cc tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:30 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-5c8fb8c2-f896-4b93-b878-aea772b7c1cc tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] HTTP exception thrown: The resource could not be found. May 28 12:57:30 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-5c8fb8c2-f896-4b93-b878-aea772b7c1cc tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/shares/c5d9b059-bdd0-4fae-9bd0-328d926e5694 returned with HTTP 404 May 28 12:57:30 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 359/704] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:57:30 2024] GET /share/v2/a3499cb78849424db45e54caac01de92/shares/c5d9b059-bdd0-4fae-9bd0-328d926e5694 => generated 78 bytes in 11 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 12:57:30 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-0822a4f6-6ff4-4990-9cf0-11eebbf113e7 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] POST http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/shares May 28 12:57:30 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-0822a4f6-6ff4-4990-9cf0-11eebbf113e7 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share": {"share_proto": "nfs", "description": "Tempest's share", "snapshot_id": null, "name": "tempest-tempest-created-share-1883208137", "size": 1, "metadata": {}, "is_public": false, "share_type": "ed6e3c4a-7505-47e7-9c77-78267ba93d85"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:57:30 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.v1.shares [None req-0822a4f6-6ff4-4990-9cf0-11eebbf113e7 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Create NFS share of 1 GB May 28 12:57:30 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.quota [None req-0822a4f6-6ff4-4990-9cf0-11eebbf113e7 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Created reservations ['1c4a086d-a39d-4732-9cd1-9c25d6dd2dfb', '42fd0eab-141f-4411-9a40-7c187286296c', 'c0d292b7-6d02-419e-837b-94d0b94d69f0', 'c20eda22-ead3-4533-8df6-4bfebe91f74c'] {{(pid=98330) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 12:57:30 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.quota [None req-0822a4f6-6ff4-4990-9cf0-11eebbf113e7 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Committed reservations ['1c4a086d-a39d-4732-9cd1-9c25d6dd2dfb', '42fd0eab-141f-4411-9a40-7c187286296c', 'c0d292b7-6d02-419e-837b-94d0b94d69f0', 'c20eda22-ead3-4533-8df6-4bfebe91f74c'] {{(pid=98330) commit /opt/stack/manila/manila/quota.py:1063}} May 28 12:57:31 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.host_manager [None req-0822a4f6-6ff4-4990-9cf0-11eebbf113e7 tempest-AdminActionsTest-1749172189 None] Share service is down. (host: l75lg1-v1@generic2). May 28 12:57:31 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.host_manager [None req-0822a4f6-6ff4-4990-9cf0-11eebbf113e7 tempest-AdminActionsTest-1749172189 None] Share service is down. (host: l75lg1-v1@generic1). May 28 12:57:31 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-0822a4f6-6ff4-4990-9cf0-11eebbf113e7 tempest-AdminActionsTest-1749172189 None] Starting with 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:80}} May 28 12:57:31 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-0822a4f6-6ff4-4990-9cf0-11eebbf113e7 tempest-AdminActionsTest-1749172189 None] Filter OnlyHostFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:57:31 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-0822a4f6-6ff4-4990-9cf0-11eebbf113e7 tempest-AdminActionsTest-1749172189 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:57:31 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.capacity [None req-0822a4f6-6ff4-4990-9cf0-11eebbf113e7 tempest-AdminActionsTest-1749172189 None] Space information for share creation on host l75lg1-v1@vast#vast (requested / avail): 1/2065 {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/capacity.py:83}} May 28 12:57:31 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-0822a4f6-6ff4-4990-9cf0-11eebbf113e7 tempest-AdminActionsTest-1749172189 None] Filter CapacityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:57:31 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-0822a4f6-6ff4-4990-9cf0-11eebbf113e7 tempest-AdminActionsTest-1749172189 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:57:31 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-0822a4f6-6ff4-4990-9cf0-11eebbf113e7 tempest-AdminActionsTest-1749172189 None] Driver Filter: Checking host 'l75lg1-v1@vast#vast' {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:37}} May 28 12:57:31 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-0822a4f6-6ff4-4990-9cf0-11eebbf113e7 tempest-AdminActionsTest-1749172189 None] Filter function not set :: passing host. {{(pid=98327) _check_filter_function /opt/stack/manila/manila/scheduler/filters/driver.py:53}} May 28 12:57:31 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-0822a4f6-6ff4-4990-9cf0-11eebbf113e7 tempest-AdminActionsTest-1749172189 None] Result: True {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:40}} May 28 12:57:31 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-0822a4f6-6ff4-4990-9cf0-11eebbf113e7 tempest-AdminActionsTest-1749172189 None] Done checking host 'l75lg1-v1@vast#vast' {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:41}} May 28 12:57:31 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-0822a4f6-6ff4-4990-9cf0-11eebbf113e7 tempest-AdminActionsTest-1749172189 None] Filter DriverFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:57:31 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-0822a4f6-6ff4-4990-9cf0-11eebbf113e7 tempest-AdminActionsTest-1749172189 None] Filter ShareReplicationFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:57:31 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-0822a4f6-6ff4-4990-9cf0-11eebbf113e7 tempest-AdminActionsTest-1749172189 None] Filter CreateFromSnapshotFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:57:31 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-0822a4f6-6ff4-4990-9cf0-11eebbf113e7 tempest-AdminActionsTest-1749172189 None] Filter AffinityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:57:31 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-0822a4f6-6ff4-4990-9cf0-11eebbf113e7 tempest-AdminActionsTest-1749172189 None] Filter AntiAffinityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:57:31 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.drivers.filter [None req-0822a4f6-6ff4-4990-9cf0-11eebbf113e7 tempest-AdminActionsTest-1749172189 None] Filtered share [host: 'l75lg1-v1@vast#vast', free_capacity_gb: 2065.6229242384434, pools: None] {{(pid=98327) _schedule_share /opt/stack/manila/manila/scheduler/drivers/filter.py:268}} May 28 12:57:31 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-0822a4f6-6ff4-4990-9cf0-11eebbf113e7 tempest-AdminActionsTest-1749172189 None] Checking host 'l75lg1-v1@vast#vast' {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:46}} May 28 12:57:31 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.weighers.goodness [None req-0822a4f6-6ff4-4990-9cf0-11eebbf113e7 tempest-AdminActionsTest-1749172189 None] Goodness function not set :: defaulting to minimal goodness rating of 0. May 28 12:57:31 l75lg1-v1 manila-scheduler[98327]: INFO manila.scheduler.weighers.goodness [None req-0822a4f6-6ff4-4990-9cf0-11eebbf113e7 tempest-AdminActionsTest-1749172189 None] Goodness function result for host l75lg1-v1@vast#vast: 0. May 28 12:57:31 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-0822a4f6-6ff4-4990-9cf0-11eebbf113e7 tempest-AdminActionsTest-1749172189 None] Goodness: 0 {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:48}} May 28 12:57:31 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-0822a4f6-6ff4-4990-9cf0-11eebbf113e7 tempest-AdminActionsTest-1749172189 None] Done checking host 'l75lg1-v1@vast#vast' {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:49}} May 28 12:57:31 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-0822a4f6-6ff4-4990-9cf0-11eebbf113e7 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/shares returned with HTTP 200 May 28 12:57:31 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.drivers.filter [None req-0822a4f6-6ff4-4990-9cf0-11eebbf113e7 tempest-AdminActionsTest-1749172189 None] Choosing for share: WeighedHost [host: l75lg1-v1@vast#vast, weight: 0.0] {{(pid=98327) _schedule_share /opt/stack/manila/manila/scheduler/drivers/filter.py:274}} May 28 12:57:31 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 346/705] 10.27.203.238 () {66 vars in 1362 bytes} [Tue May 28 12:57:30 2024] POST /share/v2/a3499cb78849424db45e54caac01de92/shares => generated 1348 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:57:31 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-cb3dfbab-a651-4ebe-8dcf-11bf50b4c266 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] GET http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/shares/0e109bad-1de4-4ba0-a890-7011220b44eb May 28 12:57:31 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-cb3dfbab-a651-4ebe-8dcf-11bf50b4c266 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:31 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-cb3dfbab-a651-4ebe-8dcf-11bf50b4c266 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:31 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-cb3dfbab-a651-4ebe-8dcf-11bf50b4c266 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/shares/0e109bad-1de4-4ba0-a890-7011220b44eb returned with HTTP 200 May 28 12:57:31 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 360/706] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:57:31 2024] GET /share/v2/a3499cb78849424db45e54caac01de92/shares/0e109bad-1de4-4ba0-a890-7011220b44eb => generated 1348 bytes in 23 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:57:31 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-7dc2c642-8fb9-4b3d-9f7e-9fb90c05a8ca tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] GET http://10.27.203.238/share/v2/fe54df7c653849ab8ec7523262c597cf/snapshots/ad33850e-6645-4962-a407-4dc7bb8e5045 May 28 12:57:31 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-7dc2c642-8fb9-4b3d-9f7e-9fb90c05a8ca tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:31 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-7dc2c642-8fb9-4b3d-9f7e-9fb90c05a8ca tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] Calling method 'ShareSnapshotMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:31 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-7dc2c642-8fb9-4b3d-9f7e-9fb90c05a8ca tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] HTTP exception thrown: The resource could not be found. May 28 12:57:31 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-7dc2c642-8fb9-4b3d-9f7e-9fb90c05a8ca tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] http://10.27.203.238/share/v2/fe54df7c653849ab8ec7523262c597cf/snapshots/ad33850e-6645-4962-a407-4dc7bb8e5045 returned with HTTP 404 May 28 12:57:31 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 347/707] 10.27.203.238 () {64 vars in 1460 bytes} [Tue May 28 12:57:31 2024] GET /share/v2/fe54df7c653849ab8ec7523262c597cf/snapshots/ad33850e-6645-4962-a407-4dc7bb8e5045 => generated 78 bytes in 17 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 12:57:31 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-8bed7034-1a82-4da5-93e8-e36fd9117b10 tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] GET http://10.27.203.238/share/v2/fe54df7c653849ab8ec7523262c597cf/share-replicas/detail?share_id=7da650db-1124-40b5-ba52-fb1170c038c8 May 28 12:57:31 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-8bed7034-1a82-4da5-93e8-e36fd9117b10 tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:31 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-8bed7034-1a82-4da5-93e8-e36fd9117b10 tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:31 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-8bed7034-1a82-4da5-93e8-e36fd9117b10 tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] http://10.27.203.238/share/v2/fe54df7c653849ab8ec7523262c597cf/share-replicas/detail?share_id=7da650db-1124-40b5-ba52-fb1170c038c8 returned with HTTP 200 May 28 12:57:31 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 361/708] 10.27.203.238 () {64 vars in 1476 bytes} [Tue May 28 12:57:31 2024] GET /share/v2/fe54df7c653849ab8ec7523262c597cf/share-replicas/detail?share_id=7da650db-1124-40b5-ba52-fb1170c038c8 => generated 22 bytes in 14 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:57:31 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-1a206104-3ae2-40d4-ad11-73c0d9107322 tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] DELETE http://10.27.203.238/share/v2/fe54df7c653849ab8ec7523262c597cf/shares/7da650db-1124-40b5-ba52-fb1170c038c8 May 28 12:57:31 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-1a206104-3ae2-40d4-ad11-73c0d9107322 tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:31 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-1a206104-3ae2-40d4-ad11-73c0d9107322 tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] Calling method 'ShareMixin.delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:31 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.v1.shares [None req-1a206104-3ae2-40d4-ad11-73c0d9107322 tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] Delete share with id: 7da650db-1124-40b5-ba52-fb1170c038c8 May 28 12:57:31 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0822a4f6-6ff4-4990-9cf0-11eebbf113e7 tempest-AdminActionsTest-1749172189 None] >>> [GET] https://127.0.0.1:40443/api/vippools/ May 28 12:57:31 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0822a4f6-6ff4-4990-9cf0-11eebbf113e7 tempest-AdminActionsTest-1749172189 None] {'allow_redirects': True, 'params': {'name': 'vippool-1'}} May 28 12:57:31 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-1a206104-3ae2-40d4-ad11-73c0d9107322 tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] http://10.27.203.238/share/v2/fe54df7c653849ab8ec7523262c597cf/shares/7da650db-1124-40b5-ba52-fb1170c038c8 returned with HTTP 202 May 28 12:57:31 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 348/709] 10.27.203.238 () {64 vars in 1454 bytes} [Tue May 28 12:57:31 2024] DELETE /share/v2/fe54df7c653849ab8ec7523262c597cf/shares/7da650db-1124-40b5-ba52-fb1170c038c8 => generated 0 bytes in 115 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:57:31 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-275cdeaf-b49a-4c5d-b55d-309199100802 tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] GET http://10.27.203.238/share/v2/fe54df7c653849ab8ec7523262c597cf/shares/7da650db-1124-40b5-ba52-fb1170c038c8 May 28 12:57:31 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-275cdeaf-b49a-4c5d-b55d-309199100802 tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:31 l75lg1-v1 dstat.sh[49771]: 28-05 12:57:31| 7 1 90 2 0|5689M 1806M 277M 7854M| 19k 4413B| 0 1720k| 0 283 |4742 8701 |1.65 1.06 1.01|4.0 0 0| 0 0 | 0 2048M| 29 356 0 76 0 May 28 12:57:31 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-275cdeaf-b49a-4c5d-b55d-309199100802 tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:31 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-275cdeaf-b49a-4c5d-b55d-309199100802 tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] http://10.27.203.238/share/v2/fe54df7c653849ab8ec7523262c597cf/shares/7da650db-1124-40b5-ba52-fb1170c038c8 returned with HTTP 200 May 28 12:57:31 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 362/710] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:57:31 2024] GET /share/v2/fe54df7c653849ab8ec7523262c597cf/shares/7da650db-1124-40b5-ba52-fb1170c038c8 => generated 1475 bytes in 25 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:57:31 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-1a206104-3ae2-40d4-ad11-73c0d9107322 tempest-SharesActionsAdminTest-1286316336 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7c19614c-d968-4489-b2ad-bd88c2ef8054" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:57:31 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-1a206104-3ae2-40d4-ad11-73c0d9107322 tempest-SharesActionsAdminTest-1286316336 None] Lock "locked_access_rules_operation_by_share_instance_7c19614c-d968-4489-b2ad-bd88c2ef8054" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:57:31 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-1a206104-3ae2-40d4-ad11-73c0d9107322 tempest-SharesActionsAdminTest-1286316336 None] Lock "locked_access_rules_operation_by_share_instance_7c19614c-d968-4489-b2ad-bd88c2ef8054" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:57:31 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-1a206104-3ae2-40d4-ad11-73c0d9107322 tempest-SharesActionsAdminTest-1286316336 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7c19614c-d968-4489-b2ad-bd88c2ef8054" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:57:31 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-1a206104-3ae2-40d4-ad11-73c0d9107322 tempest-SharesActionsAdminTest-1286316336 None] Lock "locked_access_rules_operation_by_share_instance_7c19614c-d968-4489-b2ad-bd88c2ef8054" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:57:31 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-1a206104-3ae2-40d4-ad11-73c0d9107322 tempest-SharesActionsAdminTest-1286316336 None] Lock "locked_access_rules_operation_by_share_instance_7c19614c-d968-4489-b2ad-bd88c2ef8054" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:57:31 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-1a206104-3ae2-40d4-ad11-73c0d9107322 tempest-SharesActionsAdminTest-1286316336 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7c19614c-d968-4489-b2ad-bd88c2ef8054" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:57:31 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-1a206104-3ae2-40d4-ad11-73c0d9107322 tempest-SharesActionsAdminTest-1286316336 None] Lock "locked_access_rules_operation_by_share_instance_7c19614c-d968-4489-b2ad-bd88c2ef8054" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:57:31 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-1a206104-3ae2-40d4-ad11-73c0d9107322 tempest-SharesActionsAdminTest-1286316336 None] Lock "locked_access_rules_operation_by_share_instance_7c19614c-d968-4489-b2ad-bd88c2ef8054" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:57:31 l75lg1-v1 manila-share[98474]: DEBUG manila.share.access [None req-1a206104-3ae2-40d4-ad11-73c0d9107322 tempest-SharesActionsAdminTest-1286316336 None] All access rules have been synced for share instance 7c19614c-d968-4489-b2ad-bd88c2ef8054 belonging to share 7da650db-1124-40b5-ba52-fb1170c038c8. {{(pid=98474) update_access_rules /opt/stack/manila/manila/share/access.py:304}} May 28 12:57:31 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-1a206104-3ae2-40d4-ad11-73c0d9107322 tempest-SharesActionsAdminTest-1286316336 None] deleting '/manila/manila-7c19614c-d968-4489-b2ad-bd88c2ef8054' May 28 12:57:31 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1a206104-3ae2-40d4-ad11-73c0d9107322 tempest-SharesActionsAdminTest-1286316336 None] >>> [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/ May 28 12:57:31 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1a206104-3ae2-40d4-ad11-73c0d9107322 tempest-SharesActionsAdminTest-1286316336 None] {'data': '{"path": "/manila/manila-7c19614c-d968-4489-b2ad-bd88c2ef8054"}', May 28 12:57:31 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1a206104-3ae2-40d4-ad11-73c0d9107322 tempest-SharesActionsAdminTest-1286316336 None] 'params': None} May 28 12:57:31 l75lg1-v1 neutron-server[77623]: DEBUG dbcounter [-] [77623] Writing DB stats neutron:SELECT=1 {{(pid=77623) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:57:31 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1a206104-3ae2-40d4-ad11-73c0d9107322 tempest-SharesActionsAdminTest-1286316336 None] <<< [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/ May 28 12:57:31 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1a206104-3ae2-40d4-ad11-73c0d9107322 tempest-SharesActionsAdminTest-1286316336 None] 'OK' May 28 12:57:31 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1a206104-3ae2-40d4-ad11-73c0d9107322 tempest-SharesActionsAdminTest-1286316336 None] --- [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/: Done May 28 12:57:31 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1a206104-3ae2-40d4-ad11-73c0d9107322 tempest-SharesActionsAdminTest-1286316336 None] >>> [GET] https://127.0.0.1:40443/api/views/ May 28 12:57:31 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1a206104-3ae2-40d4-ad11-73c0d9107322 tempest-SharesActionsAdminTest-1286316336 None] {'allow_redirects': True, May 28 12:57:31 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1a206104-3ae2-40d4-ad11-73c0d9107322 tempest-SharesActionsAdminTest-1286316336 None] 'params': {'name': '7c19614c-d968-4489-b2ad-bd88c2ef8054'}} May 28 12:57:31 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-3e942cba-0587-4cbb-b520-59523fea767f tempest-AccessesMetadataNegativeTest-1660907003 None] <<< [DELETE] https://127.0.0.1:40443/api/quotas/14/ May 28 12:57:31 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-3e942cba-0587-4cbb-b520-59523fea767f tempest-AccessesMetadataNegativeTest-1660907003 None] --- [DELETE] https://127.0.0.1:40443/api/quotas/14/: Done May 28 12:57:31 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-3e942cba-0587-4cbb-b520-59523fea767f tempest-AccessesMetadataNegativeTest-1660907003 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:57:31 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-3e942cba-0587-4cbb-b520-59523fea767f tempest-AccessesMetadataNegativeTest-1660907003 None] {'allow_redirects': True, May 28 12:57:31 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-3e942cba-0587-4cbb-b520-59523fea767f tempest-AccessesMetadataNegativeTest-1660907003 None] 'params': {'name': '113739f1-d41a-4f4e-b63f-071e2ecd0a7b'}} May 28 12:57:31 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-8b2a72ea-0b19-4d0a-9d08-d52fce52505b tempest-AccessesMetadataNegativeTest-1660907003 tempest-AccessesMetadataNegativeTest-1660907003-project-member] GET http://10.27.203.238/share/v2/ed83204ad63946bdae288892bd07d115/shares/1b8e12e8-6d99-48c0-8368-d1a37e2ca2ca May 28 12:57:31 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-8b2a72ea-0b19-4d0a-9d08-d52fce52505b tempest-AccessesMetadataNegativeTest-1660907003 tempest-AccessesMetadataNegativeTest-1660907003-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:31 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-8b2a72ea-0b19-4d0a-9d08-d52fce52505b tempest-AccessesMetadataNegativeTest-1660907003 tempest-AccessesMetadataNegativeTest-1660907003-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:31 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-8b2a72ea-0b19-4d0a-9d08-d52fce52505b tempest-AccessesMetadataNegativeTest-1660907003 tempest-AccessesMetadataNegativeTest-1660907003-project-member] http://10.27.203.238/share/v2/ed83204ad63946bdae288892bd07d115/shares/1b8e12e8-6d99-48c0-8368-d1a37e2ca2ca returned with HTTP 200 May 28 12:57:31 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 349/711] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:57:31 2024] GET /share/v2/ed83204ad63946bdae288892bd07d115/shares/1b8e12e8-6d99-48c0-8368-d1a37e2ca2ca => generated 1316 bytes in 27 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:57:31 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0822a4f6-6ff4-4990-9cf0-11eebbf113e7 tempest-AdminActionsTest-1749172189 None] <<< [GET] https://127.0.0.1:40443/api/vippools/ May 28 12:57:31 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0822a4f6-6ff4-4990-9cf0-11eebbf113e7 tempest-AdminActionsTest-1749172189 None] [Bunch(active_cnode_ids=[], active_interfaces=4, cluster='loop75-kfs', cluster_id=1, cnode_ids=[], cnodes=[], domain_name='vippool-1', enable_l3=False, enable_weighted_balancing=False, enabled=True, end_ip='172.21.75.4', guid='f2abaede-b397-413a-8faa-3aeead6d3b28', gw_ip='', gw_ipv6='', id=2, ip_ranges=[['172.21.75.1', '172.21.75.4']], name='vippool-1', peer_asn=0, port_membership='ALL', ranges_summary='172.21.75.[1-4]', role='PROTOCOLS', start_ip='172.21.75.1', subnet_cidr=16, subnet_cidr_ipv6=None, sync='SYNCED', sync_time='2024-05-28T12:50:09.644123Z', tenant_id=1, tenant_name='default', title='172.21.75.1 - 172.21.75.4', url='https://127.0.0.1:40443/api/vippools/2/', vast_asn=0, vlan=0, vms_preferred=False)] May 28 12:57:31 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0822a4f6-6ff4-4990-9cf0-11eebbf113e7 tempest-AdminActionsTest-1749172189 None] --- [GET] https://127.0.0.1:40443/api/vippools/: Done May 28 12:57:31 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0822a4f6-6ff4-4990-9cf0-11eebbf113e7 tempest-AdminActionsTest-1749172189 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:57:31 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0822a4f6-6ff4-4990-9cf0-11eebbf113e7 tempest-AdminActionsTest-1749172189 None] {'allow_redirects': True, May 28 12:57:31 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0822a4f6-6ff4-4990-9cf0-11eebbf113e7 tempest-AdminActionsTest-1749172189 None] 'params': {'name': '724bc53b-1c28-4ab1-b3c8-ab90f868473d'}} May 28 12:57:31 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1a206104-3ae2-40d4-ad11-73c0d9107322 tempest-SharesActionsAdminTest-1286316336 None] <<< [GET] https://127.0.0.1:40443/api/views/ May 28 12:57:31 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1a206104-3ae2-40d4-ad11-73c0d9107322 tempest-SharesActionsAdminTest-1286316336 None] [Bunch(abac_tags=[], abe_max_depth=None, abe_protocols=[], alias='', allow_anonymous_access=False, allow_s3_anonymous_access=False, auto_commit='0d', bucket='', bucket_creators=[], bucket_creators_groups=[], bucket_owner=None, bulk_permission_update_progress=None, bulk_permission_update_state=None, cluster='loop75-kfs', cluster_id=1, created='2024-05-28T12:57:18.687530Z', enabled=True, files_retention_mode='NONE', guid='54a0f75b-0213-4593-8d13-4a164026c80a', id=14, ignore_oos=False, internal=False, is_remote=False, is_seamless=False, logical_capacity=0, max_retention_period=None, min_retention_period=None, name='7c19614c-d968-4489-b2ad-bd88c2ef8054', nfs_interop_flags='BOTH_NFS3_AND_NFS4_INTEROP_DISABLED', path='/manila/manila-7c19614c-d968-4489-b2ad-bd88c2ef8054', physical_capacity=0, policy='7c19614c-d968-4489-b2ad-bd88c2ef8054', policy_id=15, protocols=['NFS'], qos_policy=None, qos_policy_id=None, s3_locks=False, s3_locks_retention_mode='NONE', s3_locks_retention_period='', s3_unverified_lookup=False, s3_versioning=False, select_for_live_monitoring=False, share='', share_acl=Bunch(acl=[], enabled=False), sync='SYNCED', sync_time='2024-05-28T12:57:18.955547Z', tenant_id=1, tenant_name='default', title='/manila/manila-7c19614c-d968-4489-b2ad-bd88c2ef8054', url='https://127.0.0.1:40443/api/views/14/')] May 28 12:57:31 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1a206104-3ae2-40d4-ad11-73c0d9107322 tempest-SharesActionsAdminTest-1286316336 None] --- [GET] https://127.0.0.1:40443/api/views/: Done May 28 12:57:31 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1a206104-3ae2-40d4-ad11-73c0d9107322 tempest-SharesActionsAdminTest-1286316336 None] >>> [DELETE] https://127.0.0.1:40443/api/views/14/ May 28 12:57:31 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-b9f74ffc-bf59-4223-ad1c-424cdb9c17e2 tempest-ShareSnapshotInstancesTest-843694899 tempest-ShareSnapshotInstancesTest-843694899-project-admin] GET http://10.27.203.238/share/v2/f4f7702aa04c467288cc6b142f61ec37/snapshots/8f61b18a-3a70-47fb-b981-4fcb057a0c26 May 28 12:57:31 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-b9f74ffc-bf59-4223-ad1c-424cdb9c17e2 tempest-ShareSnapshotInstancesTest-843694899 tempest-ShareSnapshotInstancesTest-843694899-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:31 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-b9f74ffc-bf59-4223-ad1c-424cdb9c17e2 tempest-ShareSnapshotInstancesTest-843694899 tempest-ShareSnapshotInstancesTest-843694899-project-admin] Calling method 'ShareSnapshotMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:31 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-b9f74ffc-bf59-4223-ad1c-424cdb9c17e2 tempest-ShareSnapshotInstancesTest-843694899 tempest-ShareSnapshotInstancesTest-843694899-project-admin] HTTP exception thrown: The resource could not be found. May 28 12:57:31 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-b9f74ffc-bf59-4223-ad1c-424cdb9c17e2 tempest-ShareSnapshotInstancesTest-843694899 tempest-ShareSnapshotInstancesTest-843694899-project-admin] http://10.27.203.238/share/v2/f4f7702aa04c467288cc6b142f61ec37/snapshots/8f61b18a-3a70-47fb-b981-4fcb057a0c26 returned with HTTP 404 May 28 12:57:31 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 363/712] 10.27.203.238 () {64 vars in 1460 bytes} [Tue May 28 12:57:31 2024] GET /share/v2/f4f7702aa04c467288cc6b142f61ec37/snapshots/8f61b18a-3a70-47fb-b981-4fcb057a0c26 => generated 78 bytes in 14 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 12:57:31 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-5564cc88-0437-4725-876e-5e3cd9fba894 tempest-ShareSnapshotInstancesTest-843694899 tempest-ShareSnapshotInstancesTest-843694899-project-admin] DELETE http://10.27.203.238/share/v2/f4f7702aa04c467288cc6b142f61ec37/snapshots/8f61b18a-3a70-47fb-b981-4fcb057a0c26 May 28 12:57:31 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-5564cc88-0437-4725-876e-5e3cd9fba894 tempest-ShareSnapshotInstancesTest-843694899 tempest-ShareSnapshotInstancesTest-843694899-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:31 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-5564cc88-0437-4725-876e-5e3cd9fba894 tempest-ShareSnapshotInstancesTest-843694899 tempest-ShareSnapshotInstancesTest-843694899-project-admin] Calling method 'ShareSnapshotMixin.delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:31 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.v1.share_snapshots [None req-5564cc88-0437-4725-876e-5e3cd9fba894 tempest-ShareSnapshotInstancesTest-843694899 tempest-ShareSnapshotInstancesTest-843694899-project-admin] Delete snapshot with id: 8f61b18a-3a70-47fb-b981-4fcb057a0c26 May 28 12:57:31 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-5564cc88-0437-4725-876e-5e3cd9fba894 tempest-ShareSnapshotInstancesTest-843694899 tempest-ShareSnapshotInstancesTest-843694899-project-admin] HTTP exception thrown: The resource could not be found. May 28 12:57:31 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-5564cc88-0437-4725-876e-5e3cd9fba894 tempest-ShareSnapshotInstancesTest-843694899 tempest-ShareSnapshotInstancesTest-843694899-project-admin] http://10.27.203.238/share/v2/f4f7702aa04c467288cc6b142f61ec37/snapshots/8f61b18a-3a70-47fb-b981-4fcb057a0c26 returned with HTTP 404 May 28 12:57:31 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 350/713] 10.27.203.238 () {64 vars in 1463 bytes} [Tue May 28 12:57:31 2024] DELETE /share/v2/f4f7702aa04c467288cc6b142f61ec37/snapshots/8f61b18a-3a70-47fb-b981-4fcb057a0c26 => generated 78 bytes in 14 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 12:57:31 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-9a03681f-3656-4edd-9161-2567cc716074 tempest-ShareSnapshotInstancesTest-843694899 tempest-ShareSnapshotInstancesTest-843694899-project-admin] DELETE http://10.27.203.238/share/v2/f4f7702aa04c467288cc6b142f61ec37/snapshots/06828ea4-ef00-439f-b57a-9d726e3f2e62 May 28 12:57:31 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-9a03681f-3656-4edd-9161-2567cc716074 tempest-ShareSnapshotInstancesTest-843694899 tempest-ShareSnapshotInstancesTest-843694899-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:31 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-9a03681f-3656-4edd-9161-2567cc716074 tempest-ShareSnapshotInstancesTest-843694899 tempest-ShareSnapshotInstancesTest-843694899-project-admin] Calling method 'ShareSnapshotMixin.delete' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:31 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.v1.share_snapshots [None req-9a03681f-3656-4edd-9161-2567cc716074 tempest-ShareSnapshotInstancesTest-843694899 tempest-ShareSnapshotInstancesTest-843694899-project-admin] Delete snapshot with id: 06828ea4-ef00-439f-b57a-9d726e3f2e62 May 28 12:57:31 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-9a03681f-3656-4edd-9161-2567cc716074 tempest-ShareSnapshotInstancesTest-843694899 tempest-ShareSnapshotInstancesTest-843694899-project-admin] http://10.27.203.238/share/v2/f4f7702aa04c467288cc6b142f61ec37/snapshots/06828ea4-ef00-439f-b57a-9d726e3f2e62 returned with HTTP 202 May 28 12:57:31 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 364/714] 10.27.203.238 () {64 vars in 1463 bytes} [Tue May 28 12:57:31 2024] DELETE /share/v2/f4f7702aa04c467288cc6b142f61ec37/snapshots/06828ea4-ef00-439f-b57a-9d726e3f2e62 => generated 0 bytes in 91 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:57:31 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-3c8474b0-44e7-4807-b78f-63360a48be6f tempest-ShareSnapshotInstancesTest-843694899 tempest-ShareSnapshotInstancesTest-843694899-project-admin] GET http://10.27.203.238/share/v2/f4f7702aa04c467288cc6b142f61ec37/snapshots/06828ea4-ef00-439f-b57a-9d726e3f2e62 May 28 12:57:31 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-3c8474b0-44e7-4807-b78f-63360a48be6f tempest-ShareSnapshotInstancesTest-843694899 tempest-ShareSnapshotInstancesTest-843694899-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:31 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-3c8474b0-44e7-4807-b78f-63360a48be6f tempest-ShareSnapshotInstancesTest-843694899 tempest-ShareSnapshotInstancesTest-843694899-project-admin] Calling method 'ShareSnapshotMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:31 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-3c8474b0-44e7-4807-b78f-63360a48be6f tempest-ShareSnapshotInstancesTest-843694899 tempest-ShareSnapshotInstancesTest-843694899-project-admin] http://10.27.203.238/share/v2/f4f7702aa04c467288cc6b142f61ec37/snapshots/06828ea4-ef00-439f-b57a-9d726e3f2e62 returned with HTTP 200 May 28 12:57:31 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 351/715] 10.27.203.238 () {64 vars in 1460 bytes} [Tue May 28 12:57:31 2024] GET /share/v2/f4f7702aa04c467288cc6b142f61ec37/snapshots/06828ea4-ef00-439f-b57a-9d726e3f2e62 => generated 749 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:57:32 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-3e942cba-0587-4cbb-b520-59523fea767f tempest-AccessesMetadataNegativeTest-1660907003 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:57:32 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-3e942cba-0587-4cbb-b520-59523fea767f tempest-AccessesMetadataNegativeTest-1660907003 None] [Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=0, created='2024-05-28T12:57:17.272743Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='a438200f-35fa-44b5-a39f-2a7af61c13bd', id=17, internal=False, is_s3_default_policy=False, name='113739f1-d41a-4f4e-b63f-071e2ecd0a7b', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=['*'], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['*'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['*'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T12:57:25.804198Z', tenant_id=1, tenant_name='default', title='113739f1-d41a-4f4e-b63f-071e2ecd0a7b', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/17/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[])] May 28 12:57:32 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-3e942cba-0587-4cbb-b520-59523fea767f tempest-AccessesMetadataNegativeTest-1660907003 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 12:57:32 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-3e942cba-0587-4cbb-b520-59523fea767f tempest-AccessesMetadataNegativeTest-1660907003 None] >>> [DELETE] https://127.0.0.1:40443/api/viewpolicies/17/ May 28 12:57:32 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0822a4f6-6ff4-4990-9cf0-11eebbf113e7 tempest-AdminActionsTest-1749172189 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:57:32 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0822a4f6-6ff4-4990-9cf0-11eebbf113e7 tempest-AdminActionsTest-1749172189 None] [] May 28 12:57:32 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0822a4f6-6ff4-4990-9cf0-11eebbf113e7 tempest-AdminActionsTest-1749172189 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 12:57:32 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0822a4f6-6ff4-4990-9cf0-11eebbf113e7 tempest-AdminActionsTest-1749172189 None] >>> [POST] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:57:32 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0822a4f6-6ff4-4990-9cf0-11eebbf113e7 tempest-AdminActionsTest-1749172189 None] {'data': '{"name": "724bc53b-1c28-4ab1-b3c8-ab90f868473d"}', May 28 12:57:32 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0822a4f6-6ff4-4990-9cf0-11eebbf113e7 tempest-AdminActionsTest-1749172189 None] 'json': None, May 28 12:57:32 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0822a4f6-6ff4-4990-9cf0-11eebbf113e7 tempest-AdminActionsTest-1749172189 None] 'params': None} May 28 12:57:32 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9a03681f-3656-4edd-9161-2567cc716074 tempest-ShareSnapshotInstancesTest-843694899 None] >>> [GET] https://127.0.0.1:40443/api/snapshots/ May 28 12:57:32 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9a03681f-3656-4edd-9161-2567cc716074 tempest-ShareSnapshotInstancesTest-843694899 None] {'allow_redirects': True, May 28 12:57:32 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9a03681f-3656-4edd-9161-2567cc716074 tempest-ShareSnapshotInstancesTest-843694899 None] 'params': {'name': 'share-snapshot-43659856-8e64-4da7-83ec-5bc65fe3dbe5'}} May 28 12:57:32 l75lg1-v1 dstat.sh[49771]: 28-05 12:57:32| 6 1 93 0 0|5690M 1804M 277M 7854M| 20k 9917B| 0 696k| 0 80.0 |3283 5605 |1.59 1.06 1.01|1.0 0 0| 0 0 | 0 2048M| 29 355 0 76 0 May 28 12:57:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG dbcounter [-] [51266] Writing DB stats keystone:SELECT=466,keystone:INSERT=22,keystone:DELETE=41 {{(pid=51266) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:57:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG dbcounter [-] [51267] Writing DB stats keystone:SELECT=407,keystone:DELETE=59,keystone:INSERT=31 {{(pid=51267) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:57:32 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-bff8961e-451f-4e94-8fbe-301b308dae69 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] GET http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/36ebac5b-70c6-4cc4-85fa-1acc9586628e May 28 12:57:32 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-bff8961e-451f-4e94-8fbe-301b308dae69 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:32 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-bff8961e-451f-4e94-8fbe-301b308dae69 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:32 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9a03681f-3656-4edd-9161-2567cc716074 tempest-ShareSnapshotInstancesTest-843694899 None] <<< [GET] https://127.0.0.1:40443/api/snapshots/ May 28 12:57:32 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9a03681f-3656-4edd-9161-2567cc716074 tempest-ShareSnapshotInstancesTest-843694899 None] [Bunch(access_path='/.vast_all_snapshots/1000000001_share-snapshot-43659856-8e64-4da7-83ec-5bc65fe3dbe5', aggr_phys_estimation=0, cluster='loop75-kfs', created='2024-05-28T12:57:19.575149Z', eta_sec=30819898945.32384, expiration_time='3001-01-19T07:59:58Z', guid='1ff1f2fa-e107-4b20-9c15-b7d80f36022a', id=2, indestructible=False, locked=False, name='share-snapshot-43659856-8e64-4da7-83ec-5bc65fe3dbe5', path='/manila/manila-c2f741cd-bac5-499f-9539-8e93d6a81282/', policy=None, policy_id=None, protection_policy_id=None, state='SUCCEED', tenant_id=1, tenant_name='default', title='share-snapshot-43659856-8e64-4da7-83ec-5bc65fe3dbe5(/manila/manila-c2f741cd-bac5-499f-9539-8e93d6a81282/)', type='local', unique_phys_estimation=0, url='https://127.0.0.1:40443/api/snapshots/2/')] May 28 12:57:32 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9a03681f-3656-4edd-9161-2567cc716074 tempest-ShareSnapshotInstancesTest-843694899 None] --- [GET] https://127.0.0.1:40443/api/snapshots/: Done May 28 12:57:32 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9a03681f-3656-4edd-9161-2567cc716074 tempest-ShareSnapshotInstancesTest-843694899 None] >>> [DELETE] https://127.0.0.1:40443/api/snapshots/2/ May 28 12:57:32 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-bff8961e-451f-4e94-8fbe-301b308dae69 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/36ebac5b-70c6-4cc4-85fa-1acc9586628e returned with HTTP 200 May 28 12:57:32 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 365/716] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:57:32 2024] GET /share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/36ebac5b-70c6-4cc4-85fa-1acc9586628e => generated 1317 bytes in 24 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:57:32 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-1e4001d9-82a1-462d-adc9-f7152f47ce6b tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] POST http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/36ebac5b-70c6-4cc4-85fa-1acc9586628e/metadata May 28 12:57:32 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-1e4001d9-82a1-462d-adc9-f7152f47ce6b tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Action: 'create_metadata', calling method: Controller.__getattribute__..version_select, body: {"metadata": {"key5": "value5", "key6": "value6"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:57:32 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-1e4001d9-82a1-462d-adc9-f7152f47ce6b tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/36ebac5b-70c6-4cc4-85fa-1acc9586628e/metadata returned with HTTP 200 May 28 12:57:32 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 352/717] 10.27.203.238 () {66 vars in 1499 bytes} [Tue May 28 12:57:32 2024] POST /share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/36ebac5b-70c6-4cc4-85fa-1acc9586628e/metadata => generated 50 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:57:32 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-9fc91884-288e-431b-a4d7-5876e5fd2ad9 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] PUT http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/36ebac5b-70c6-4cc4-85fa-1acc9586628e/metadata May 28 12:57:32 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-9fc91884-288e-431b-a4d7-5876e5fd2ad9 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Action: 'update_all_metadata', calling method: Controller.__getattribute__..version_select, body: {"metadata": {"key7": "value7", "key8": "value8"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:57:33 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-9fc91884-288e-431b-a4d7-5876e5fd2ad9 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/36ebac5b-70c6-4cc4-85fa-1acc9586628e/metadata returned with HTTP 200 May 28 12:57:33 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 366/718] 10.27.203.238 () {66 vars in 1498 bytes} [Tue May 28 12:57:32 2024] PUT /share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/36ebac5b-70c6-4cc4-85fa-1acc9586628e/metadata => generated 50 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:57:33 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-72377f06-79f2-4376-8283-0bbfccfbdafa tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] GET http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/36ebac5b-70c6-4cc4-85fa-1acc9586628e/metadata/key7 May 28 12:57:33 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-72377f06-79f2-4376-8283-0bbfccfbdafa tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:33 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-72377f06-79f2-4376-8283-0bbfccfbdafa tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:33 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-72377f06-79f2-4376-8283-0bbfccfbdafa tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/36ebac5b-70c6-4cc4-85fa-1acc9586628e/metadata/key7 returned with HTTP 200 May 28 12:57:33 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 353/719] 10.27.203.238 () {64 vars in 1493 bytes} [Tue May 28 12:57:33 2024] GET /share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/36ebac5b-70c6-4cc4-85fa-1acc9586628e/metadata/key7 => generated 28 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:57:33 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-283803ef-386a-452d-a752-e36777b48c28 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] GET http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/36ebac5b-70c6-4cc4-85fa-1acc9586628e/metadata/key8 May 28 12:57:33 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-283803ef-386a-452d-a752-e36777b48c28 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:33 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-283803ef-386a-452d-a752-e36777b48c28 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:33 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0822a4f6-6ff4-4990-9cf0-11eebbf113e7 tempest-AdminActionsTest-1749172189 None] <<< [POST] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:57:33 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0822a4f6-6ff4-4990-9cf0-11eebbf113e7 tempest-AdminActionsTest-1749172189 None] Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=0, created='2024-05-28T12:57:32.701407Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='33f7134a-3093-4a78-b34b-cfd50d818cbc', id=20, internal=False, is_s3_default_policy=False, name='724bc53b-1c28-4ab1-b3c8-ab90f868473d', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=[], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['*'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['*'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T12:57:33.061049Z', tenant_id=1, tenant_name='default', title='724bc53b-1c28-4ab1-b3c8-ab90f868473d', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/20/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[]) May 28 12:57:33 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0822a4f6-6ff4-4990-9cf0-11eebbf113e7 tempest-AdminActionsTest-1749172189 None] --- [POST] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 12:57:33 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0822a4f6-6ff4-4990-9cf0-11eebbf113e7 tempest-AdminActionsTest-1749172189 None] >>> [GET] https://127.0.0.1:40443/api/quotas/ May 28 12:57:33 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0822a4f6-6ff4-4990-9cf0-11eebbf113e7 tempest-AdminActionsTest-1749172189 None] {'allow_redirects': True, May 28 12:57:33 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0822a4f6-6ff4-4990-9cf0-11eebbf113e7 tempest-AdminActionsTest-1749172189 None] 'params': {'name': '724bc53b-1c28-4ab1-b3c8-ab90f868473d'}} May 28 12:57:33 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-283803ef-386a-452d-a752-e36777b48c28 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/36ebac5b-70c6-4cc4-85fa-1acc9586628e/metadata/key8 returned with HTTP 200 May 28 12:57:33 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 367/720] 10.27.203.238 () {64 vars in 1493 bytes} [Tue May 28 12:57:33 2024] GET /share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/36ebac5b-70c6-4cc4-85fa-1acc9586628e/metadata/key8 => generated 28 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:57:33 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-53a890c9-ce2c-41fc-b9a1-bdba1f03e8bc tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] GET http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/share-replicas/detail?share_id=36ebac5b-70c6-4cc4-85fa-1acc9586628e May 28 12:57:33 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-53a890c9-ce2c-41fc-b9a1-bdba1f03e8bc tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:33 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-53a890c9-ce2c-41fc-b9a1-bdba1f03e8bc tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:33 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-53a890c9-ce2c-41fc-b9a1-bdba1f03e8bc tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/share-replicas/detail?share_id=36ebac5b-70c6-4cc4-85fa-1acc9586628e returned with HTTP 200 May 28 12:57:33 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 354/721] 10.27.203.238 () {64 vars in 1476 bytes} [Tue May 28 12:57:33 2024] GET /share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/share-replicas/detail?share_id=36ebac5b-70c6-4cc4-85fa-1acc9586628e => generated 22 bytes in 13 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:57:33 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-a5b23709-72de-4efa-8cc5-29f19d0f7897 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] DELETE http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/36ebac5b-70c6-4cc4-85fa-1acc9586628e May 28 12:57:33 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-a5b23709-72de-4efa-8cc5-29f19d0f7897 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:33 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-a5b23709-72de-4efa-8cc5-29f19d0f7897 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Calling method 'ShareMixin.delete' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:33 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.v1.shares [None req-a5b23709-72de-4efa-8cc5-29f19d0f7897 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Delete share with id: 36ebac5b-70c6-4cc4-85fa-1acc9586628e May 28 12:57:33 l75lg1-v1 dstat.sh[49771]: 28-05 12:57:33| 6 1 92 1 0|5692M 1802M 277M 7854M| 21k 1389B| 0 1004k| 0 131 |3392 6013 |1.59 1.06 1.01|2.0 0 0| 0 0 | 0 2048M| 29 356 0 68 0 May 28 12:57:33 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-a5b23709-72de-4efa-8cc5-29f19d0f7897 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/36ebac5b-70c6-4cc4-85fa-1acc9586628e returned with HTTP 202 May 28 12:57:33 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 368/722] 10.27.203.238 () {64 vars in 1454 bytes} [Tue May 28 12:57:33 2024] DELETE /share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/36ebac5b-70c6-4cc4-85fa-1acc9586628e => generated 0 bytes in 125 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:57:33 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-10232952-4c72-46c2-8583-4ef030bf3c51 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] GET http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/36ebac5b-70c6-4cc4-85fa-1acc9586628e May 28 12:57:33 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-10232952-4c72-46c2-8583-4ef030bf3c51 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:33 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-10232952-4c72-46c2-8583-4ef030bf3c51 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:33 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-10232952-4c72-46c2-8583-4ef030bf3c51 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/36ebac5b-70c6-4cc4-85fa-1acc9586628e returned with HTTP 200 May 28 12:57:33 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 355/723] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:57:33 2024] GET /share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/36ebac5b-70c6-4cc4-85fa-1acc9586628e => generated 1350 bytes in 29 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:57:33 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-a5b23709-72de-4efa-8cc5-29f19d0f7897 tempest-SharesMetadataTest-1561320255 None] Acquiring lock "locked_access_rules_operation_by_share_instance_2be2873c-4768-478e-a848-fb1d2654ca64" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:57:33 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-a5b23709-72de-4efa-8cc5-29f19d0f7897 tempest-SharesMetadataTest-1561320255 None] Lock "locked_access_rules_operation_by_share_instance_2be2873c-4768-478e-a848-fb1d2654ca64" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:57:33 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-a5b23709-72de-4efa-8cc5-29f19d0f7897 tempest-SharesMetadataTest-1561320255 None] Lock "locked_access_rules_operation_by_share_instance_2be2873c-4768-478e-a848-fb1d2654ca64" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:57:33 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-a5b23709-72de-4efa-8cc5-29f19d0f7897 tempest-SharesMetadataTest-1561320255 None] Acquiring lock "locked_access_rules_operation_by_share_instance_2be2873c-4768-478e-a848-fb1d2654ca64" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:57:33 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-a5b23709-72de-4efa-8cc5-29f19d0f7897 tempest-SharesMetadataTest-1561320255 None] Lock "locked_access_rules_operation_by_share_instance_2be2873c-4768-478e-a848-fb1d2654ca64" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:57:33 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-a5b23709-72de-4efa-8cc5-29f19d0f7897 tempest-SharesMetadataTest-1561320255 None] Lock "locked_access_rules_operation_by_share_instance_2be2873c-4768-478e-a848-fb1d2654ca64" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.004s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:57:33 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-a5b23709-72de-4efa-8cc5-29f19d0f7897 tempest-SharesMetadataTest-1561320255 None] Acquiring lock "locked_access_rules_operation_by_share_instance_2be2873c-4768-478e-a848-fb1d2654ca64" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:57:33 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-a5b23709-72de-4efa-8cc5-29f19d0f7897 tempest-SharesMetadataTest-1561320255 None] Lock "locked_access_rules_operation_by_share_instance_2be2873c-4768-478e-a848-fb1d2654ca64" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:57:33 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-a5b23709-72de-4efa-8cc5-29f19d0f7897 tempest-SharesMetadataTest-1561320255 None] Lock "locked_access_rules_operation_by_share_instance_2be2873c-4768-478e-a848-fb1d2654ca64" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:57:33 l75lg1-v1 manila-share[98474]: DEBUG manila.share.access [None req-a5b23709-72de-4efa-8cc5-29f19d0f7897 tempest-SharesMetadataTest-1561320255 None] All access rules have been synced for share instance 2be2873c-4768-478e-a848-fb1d2654ca64 belonging to share 36ebac5b-70c6-4cc4-85fa-1acc9586628e. {{(pid=98474) update_access_rules /opt/stack/manila/manila/share/access.py:304}} May 28 12:57:33 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-a5b23709-72de-4efa-8cc5-29f19d0f7897 tempest-SharesMetadataTest-1561320255 None] deleting '/manila/manila-2be2873c-4768-478e-a848-fb1d2654ca64' May 28 12:57:33 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a5b23709-72de-4efa-8cc5-29f19d0f7897 tempest-SharesMetadataTest-1561320255 None] >>> [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/ May 28 12:57:33 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a5b23709-72de-4efa-8cc5-29f19d0f7897 tempest-SharesMetadataTest-1561320255 None] {'data': '{"path": "/manila/manila-2be2873c-4768-478e-a848-fb1d2654ca64"}', May 28 12:57:33 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a5b23709-72de-4efa-8cc5-29f19d0f7897 tempest-SharesMetadataTest-1561320255 None] 'params': None} May 28 12:57:33 l75lg1-v1 neutron-server[77623]: DEBUG neutron.db.agents_db [None req-fe40ce8c-640e-4db7-a17a-6e8888cce266 None None] Agent healthcheck: found 0 active agents {{(pid=77623) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:319}} May 28 12:57:33 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0822a4f6-6ff4-4990-9cf0-11eebbf113e7 tempest-AdminActionsTest-1749172189 None] <<< [GET] https://127.0.0.1:40443/api/quotas/ May 28 12:57:33 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0822a4f6-6ff4-4990-9cf0-11eebbf113e7 tempest-AdminActionsTest-1749172189 None] [] May 28 12:57:33 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0822a4f6-6ff4-4990-9cf0-11eebbf113e7 tempest-AdminActionsTest-1749172189 None] --- [GET] https://127.0.0.1:40443/api/quotas/: Done May 28 12:57:33 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0822a4f6-6ff4-4990-9cf0-11eebbf113e7 tempest-AdminActionsTest-1749172189 None] >>> [POST] https://127.0.0.1:40443/api/quotas/ May 28 12:57:33 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0822a4f6-6ff4-4990-9cf0-11eebbf113e7 tempest-AdminActionsTest-1749172189 None] {'data': '{"name": "724bc53b-1c28-4ab1-b3c8-ab90f868473d", "path": ' May 28 12:57:33 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0822a4f6-6ff4-4990-9cf0-11eebbf113e7 tempest-AdminActionsTest-1749172189 None] '"/manila/manila-724bc53b-1c28-4ab1-b3c8-ab90f868473d", "create_dir": ' May 28 12:57:33 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0822a4f6-6ff4-4990-9cf0-11eebbf113e7 tempest-AdminActionsTest-1749172189 None] 'true, "hard_limit": 1073741824}', May 28 12:57:33 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0822a4f6-6ff4-4990-9cf0-11eebbf113e7 tempest-AdminActionsTest-1749172189 None] 'json': None, May 28 12:57:33 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0822a4f6-6ff4-4990-9cf0-11eebbf113e7 tempest-AdminActionsTest-1749172189 None] 'params': None} May 28 12:57:33 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a5b23709-72de-4efa-8cc5-29f19d0f7897 tempest-SharesMetadataTest-1561320255 None] <<< [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/ May 28 12:57:33 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a5b23709-72de-4efa-8cc5-29f19d0f7897 tempest-SharesMetadataTest-1561320255 None] 'OK' May 28 12:57:33 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a5b23709-72de-4efa-8cc5-29f19d0f7897 tempest-SharesMetadataTest-1561320255 None] --- [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/: Done May 28 12:57:33 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a5b23709-72de-4efa-8cc5-29f19d0f7897 tempest-SharesMetadataTest-1561320255 None] >>> [GET] https://127.0.0.1:40443/api/views/ May 28 12:57:33 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a5b23709-72de-4efa-8cc5-29f19d0f7897 tempest-SharesMetadataTest-1561320255 None] {'allow_redirects': True, May 28 12:57:33 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a5b23709-72de-4efa-8cc5-29f19d0f7897 tempest-SharesMetadataTest-1561320255 None] 'params': {'name': '2be2873c-4768-478e-a848-fb1d2654ca64'}} May 28 12:57:33 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-3e942cba-0587-4cbb-b520-59523fea767f tempest-AccessesMetadataNegativeTest-1660907003 None] <<< [DELETE] https://127.0.0.1:40443/api/viewpolicies/17/ May 28 12:57:33 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-3e942cba-0587-4cbb-b520-59523fea767f tempest-AccessesMetadataNegativeTest-1660907003 None] --- [DELETE] https://127.0.0.1:40443/api/viewpolicies/17/: Done May 28 12:57:33 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1a206104-3ae2-40d4-ad11-73c0d9107322 tempest-SharesActionsAdminTest-1286316336 None] <<< [DELETE] https://127.0.0.1:40443/api/views/14/ May 28 12:57:33 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1a206104-3ae2-40d4-ad11-73c0d9107322 tempest-SharesActionsAdminTest-1286316336 None] --- [DELETE] https://127.0.0.1:40443/api/views/14/: Done May 28 12:57:33 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1a206104-3ae2-40d4-ad11-73c0d9107322 tempest-SharesActionsAdminTest-1286316336 None] >>> [GET] https://127.0.0.1:40443/api/quotas/ May 28 12:57:33 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1a206104-3ae2-40d4-ad11-73c0d9107322 tempest-SharesActionsAdminTest-1286316336 None] {'allow_redirects': True, May 28 12:57:33 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1a206104-3ae2-40d4-ad11-73c0d9107322 tempest-SharesActionsAdminTest-1286316336 None] 'params': {'name': '7c19614c-d968-4489-b2ad-bd88c2ef8054'}} May 28 12:57:33 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-3e942cba-0587-4cbb-b520-59523fea767f tempest-AccessesMetadataNegativeTest-1660907003 None] Created reservations ['4051c56a-8714-4a24-bc9a-fcf7eec639b2', '68a6c91b-9738-4578-97d3-acc7f4e0219a', 'b34e69e5-b799-48b6-bdda-e172ca2b4b68', 'a06ec8d6-6e91-48b3-acba-792c49bb3e36'] {{(pid=98474) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 12:57:33 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-3e942cba-0587-4cbb-b520-59523fea767f tempest-AccessesMetadataNegativeTest-1660907003 None] Committed reservations ['4051c56a-8714-4a24-bc9a-fcf7eec639b2', '68a6c91b-9738-4578-97d3-acc7f4e0219a', 'b34e69e5-b799-48b6-bdda-e172ca2b4b68', 'a06ec8d6-6e91-48b3-acba-792c49bb3e36'] {{(pid=98474) commit /opt/stack/manila/manila/quota.py:1063}} May 28 12:57:33 l75lg1-v1 manila-share[98474]: INFO manila.share.manager [None req-3e942cba-0587-4cbb-b520-59523fea767f tempest-AccessesMetadataNegativeTest-1660907003 None] Share instance 113739f1-d41a-4f4e-b63f-071e2ecd0a7b: deleted successfully. May 28 12:57:33 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a5b23709-72de-4efa-8cc5-29f19d0f7897 tempest-SharesMetadataTest-1561320255 None] <<< [GET] https://127.0.0.1:40443/api/views/ May 28 12:57:33 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a5b23709-72de-4efa-8cc5-29f19d0f7897 tempest-SharesMetadataTest-1561320255 None] [Bunch(abac_tags=[], abe_max_depth=None, abe_protocols=[], alias='', allow_anonymous_access=False, allow_s3_anonymous_access=False, auto_commit='0d', bucket='', bucket_creators=[], bucket_creators_groups=[], bucket_owner=None, bulk_permission_update_progress=None, bulk_permission_update_state=None, cluster='loop75-kfs', cluster_id=1, created='2024-05-28T12:57:30.362962Z', enabled=True, files_retention_mode='NONE', guid='84d95a43-e15c-4060-87ec-730e526534ff', id=18, ignore_oos=False, internal=False, is_remote=False, is_seamless=False, logical_capacity=0, max_retention_period=None, min_retention_period=None, name='2be2873c-4768-478e-a848-fb1d2654ca64', nfs_interop_flags='BOTH_NFS3_AND_NFS4_INTEROP_DISABLED', path='/manila/manila-2be2873c-4768-478e-a848-fb1d2654ca64', physical_capacity=0, policy='2be2873c-4768-478e-a848-fb1d2654ca64', policy_id=19, protocols=['NFS'], qos_policy=None, qos_policy_id=None, s3_locks=False, s3_locks_retention_mode='NONE', s3_locks_retention_period='', s3_unverified_lookup=False, s3_versioning=False, select_for_live_monitoring=False, share='', share_acl=Bunch(acl=[], enabled=False), sync='SYNCED', sync_time='2024-05-28T12:57:30.644319Z', tenant_id=1, tenant_name='default', title='/manila/manila-2be2873c-4768-478e-a848-fb1d2654ca64', url='https://127.0.0.1:40443/api/views/18/')] May 28 12:57:33 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a5b23709-72de-4efa-8cc5-29f19d0f7897 tempest-SharesMetadataTest-1561320255 None] --- [GET] https://127.0.0.1:40443/api/views/: Done May 28 12:57:33 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a5b23709-72de-4efa-8cc5-29f19d0f7897 tempest-SharesMetadataTest-1561320255 None] >>> [DELETE] https://127.0.0.1:40443/api/views/18/ May 28 12:57:34 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-b6265188-5fb9-411a-a277-2c0b5ea716bc tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] GET http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/shares/0e109bad-1de4-4ba0-a890-7011220b44eb May 28 12:57:34 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-b6265188-5fb9-411a-a277-2c0b5ea716bc tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:34 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-b6265188-5fb9-411a-a277-2c0b5ea716bc tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:34 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-b6265188-5fb9-411a-a277-2c0b5ea716bc tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/shares/0e109bad-1de4-4ba0-a890-7011220b44eb returned with HTTP 200 May 28 12:57:34 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 369/724] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:57:34 2024] GET /share/v2/a3499cb78849424db45e54caac01de92/shares/0e109bad-1de4-4ba0-a890-7011220b44eb => generated 1369 bytes in 25 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:57:34 l75lg1-v1 dstat.sh[49771]: 28-05 12:57:34| 4 1 94 1 0|5693M 1801M 277M 7854M| 28k 3901B| 0 972k| 0 115 |2964 5050 |1.59 1.06 1.01|1.0 2.0 0| 0 0 | 0 2048M| 29 355 0 68 0 May 28 12:57:34 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1a206104-3ae2-40d4-ad11-73c0d9107322 tempest-SharesActionsAdminTest-1286316336 None] <<< [GET] https://127.0.0.1:40443/api/quotas/ May 28 12:57:34 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1a206104-3ae2-40d4-ad11-73c0d9107322 tempest-SharesActionsAdminTest-1286316336 None] [Bunch(cluster='loop75-kfs', cluster_id=1, default_email=None, default_group_quota=None, default_user_quota=None, enable_alarms=True, enable_email_providers=True, grace_period=None, guid='1daf21c1-9331-49c1-9cbb-b571e9a6c8d3', hard_limit=1073741824, hard_limit_inodes=None, id=12, internal=False, is_user_quota=False, last_user_quotas_update=None, name='7c19614c-d968-4489-b2ad-bd88c2ef8054', num_blocked_users=0, num_exceeded_users=0, path='/manila/manila-7c19614c-d968-4489-b2ad-bd88c2ef8054', percent_capacity=0, percent_inodes=None, pretty_grace_period=None, pretty_grace_period_expiration=None, pretty_state='OK (CREATED)', soft_limit=None, soft_limit_inodes=None, state='OK', sync_state='CREATED', system_id=12, tenant_id=1, tenant_name='default', time_to_block=None, title='7c19614c-d968-4489-b2ad-bd88c2ef8054', url='https://127.0.0.1:40443/api/quotas/12/', used_capacity=0, used_capacity_tb=0.0, used_effective_capacity=0, used_effective_capacity_tb=0.0, used_inodes=0, used_limited_capacity=0)] May 28 12:57:34 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1a206104-3ae2-40d4-ad11-73c0d9107322 tempest-SharesActionsAdminTest-1286316336 None] --- [GET] https://127.0.0.1:40443/api/quotas/: Done May 28 12:57:34 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1a206104-3ae2-40d4-ad11-73c0d9107322 tempest-SharesActionsAdminTest-1286316336 None] >>> [DELETE] https://127.0.0.1:40443/api/quotas/12/ May 28 12:57:34 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-f2fc84c7-58a9-4aae-b494-58a8855bdabb tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] GET http://10.27.203.238/share/v2/fe54df7c653849ab8ec7523262c597cf/shares/7da650db-1124-40b5-ba52-fb1170c038c8 May 28 12:57:34 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-f2fc84c7-58a9-4aae-b494-58a8855bdabb tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:34 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-f2fc84c7-58a9-4aae-b494-58a8855bdabb tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:34 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0822a4f6-6ff4-4990-9cf0-11eebbf113e7 tempest-AdminActionsTest-1749172189 None] <<< [POST] https://127.0.0.1:40443/api/quotas/ May 28 12:57:34 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0822a4f6-6ff4-4990-9cf0-11eebbf113e7 tempest-AdminActionsTest-1749172189 None] Bunch(cluster='loop75-kfs', cluster_id=1, default_email=None, default_group_quota=None, default_user_quota=None, enable_alarms=True, enable_email_providers=True, grace_period=None, group_quotas=[], guid='9f20ada5-e731-436b-979f-d93c5a06c3b8', hard_limit=1073741824, hard_limit_inodes=None, id=17, internal=False, is_user_quota=False, last_user_quotas_update=None, name='724bc53b-1c28-4ab1-b3c8-ab90f868473d', num_blocked_users=0, num_exceeded_users=0, path='/manila/manila-724bc53b-1c28-4ab1-b3c8-ab90f868473d', percent_capacity=0, percent_inodes=None, pretty_grace_period=None, pretty_grace_period_expiration=None, pretty_state='OK (CREATED)', soft_limit=None, soft_limit_inodes=None, state='OK', sync_state='CREATED', system_id=17, tenant_id=1, tenant_name='default', time_to_block=None, title='724bc53b-1c28-4ab1-b3c8-ab90f868473d', url='https://127.0.0.1:40443/api/quotas/17/', used_capacity=0, used_capacity_tb=0.0, used_effective_capacity=0, used_effective_capacity_tb=0.0, used_inodes=0, used_limited_capacity=0, user_quotas=[]) May 28 12:57:34 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0822a4f6-6ff4-4990-9cf0-11eebbf113e7 tempest-AdminActionsTest-1749172189 None] --- [POST] https://127.0.0.1:40443/api/quotas/: Done May 28 12:57:34 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0822a4f6-6ff4-4990-9cf0-11eebbf113e7 tempest-AdminActionsTest-1749172189 None] >>> [GET] https://127.0.0.1:40443/api/views/ May 28 12:57:34 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0822a4f6-6ff4-4990-9cf0-11eebbf113e7 tempest-AdminActionsTest-1749172189 None] {'allow_redirects': True, May 28 12:57:34 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0822a4f6-6ff4-4990-9cf0-11eebbf113e7 tempest-AdminActionsTest-1749172189 None] 'params': {'name': '724bc53b-1c28-4ab1-b3c8-ab90f868473d'}} May 28 12:57:34 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-f2fc84c7-58a9-4aae-b494-58a8855bdabb tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] http://10.27.203.238/share/v2/fe54df7c653849ab8ec7523262c597cf/shares/7da650db-1124-40b5-ba52-fb1170c038c8 returned with HTTP 200 May 28 12:57:34 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 356/725] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:57:34 2024] GET /share/v2/fe54df7c653849ab8ec7523262c597cf/shares/7da650db-1124-40b5-ba52-fb1170c038c8 => generated 1475 bytes in 27 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:57:34 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9a03681f-3656-4edd-9161-2567cc716074 tempest-ShareSnapshotInstancesTest-843694899 None] <<< [DELETE] https://127.0.0.1:40443/api/snapshots/2/ May 28 12:57:34 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9a03681f-3656-4edd-9161-2567cc716074 tempest-ShareSnapshotInstancesTest-843694899 None] --- [DELETE] https://127.0.0.1:40443/api/snapshots/2/: Done May 28 12:57:34 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-9a03681f-3656-4edd-9161-2567cc716074 tempest-ShareSnapshotInstancesTest-843694899 None] Created reservations ['ccd8817b-ffdf-47e6-a453-740f1522e0c0', '642ac870-c68a-4aad-ab5b-70395b212de8', '40c299a2-08db-447e-abfe-aa19248c0f43', '815b9337-e999-425d-b1de-ef9f625be78a'] {{(pid=98474) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 12:57:34 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-9a03681f-3656-4edd-9161-2567cc716074 tempest-ShareSnapshotInstancesTest-843694899 None] Committed reservations ['ccd8817b-ffdf-47e6-a453-740f1522e0c0', '642ac870-c68a-4aad-ab5b-70395b212de8', '40c299a2-08db-447e-abfe-aa19248c0f43', '815b9337-e999-425d-b1de-ef9f625be78a'] {{(pid=98474) commit /opt/stack/manila/manila/quota.py:1063}} May 28 12:57:34 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-50671a28-500e-4143-b659-5e6822ab987c tempest-AccessesMetadataNegativeTest-1660907003 tempest-AccessesMetadataNegativeTest-1660907003-project-member] GET http://10.27.203.238/share/v2/ed83204ad63946bdae288892bd07d115/shares/1b8e12e8-6d99-48c0-8368-d1a37e2ca2ca May 28 12:57:34 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-50671a28-500e-4143-b659-5e6822ab987c tempest-AccessesMetadataNegativeTest-1660907003 tempest-AccessesMetadataNegativeTest-1660907003-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:34 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-50671a28-500e-4143-b659-5e6822ab987c tempest-AccessesMetadataNegativeTest-1660907003 tempest-AccessesMetadataNegativeTest-1660907003-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:34 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-50671a28-500e-4143-b659-5e6822ab987c tempest-AccessesMetadataNegativeTest-1660907003 tempest-AccessesMetadataNegativeTest-1660907003-project-member] HTTP exception thrown: The resource could not be found. May 28 12:57:34 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-50671a28-500e-4143-b659-5e6822ab987c tempest-AccessesMetadataNegativeTest-1660907003 tempest-AccessesMetadataNegativeTest-1660907003-project-member] http://10.27.203.238/share/v2/ed83204ad63946bdae288892bd07d115/shares/1b8e12e8-6d99-48c0-8368-d1a37e2ca2ca returned with HTTP 404 May 28 12:57:34 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 370/726] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:57:34 2024] GET /share/v2/ed83204ad63946bdae288892bd07d115/shares/1b8e12e8-6d99-48c0-8368-d1a37e2ca2ca => generated 78 bytes in 12 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 12:57:34 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-66a5f1e6-cf72-4f90-b0d2-0c3c3aaf1a99 tempest-AccessesMetadataNegativeTest-850862987 tempest-AccessesMetadataNegativeTest-850862987-project-admin] DELETE http://10.27.203.238/share/v2/86b1b2ed568f43c9892e17d54b3c5f78/types/35d8f83e-fb79-4641-b1b4-7e1e2b54c7bd May 28 12:57:34 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-66a5f1e6-cf72-4f90-b0d2-0c3c3aaf1a99 tempest-AccessesMetadataNegativeTest-850862987 tempest-AccessesMetadataNegativeTest-850862987-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:34 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-66a5f1e6-cf72-4f90-b0d2-0c3c3aaf1a99 tempest-AccessesMetadataNegativeTest-850862987 tempest-AccessesMetadataNegativeTest-850862987-project-admin] Calling method 'ShareTypesController._delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:34 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-66a5f1e6-cf72-4f90-b0d2-0c3c3aaf1a99 tempest-AccessesMetadataNegativeTest-850862987 tempest-AccessesMetadataNegativeTest-850862987-project-admin] http://10.27.203.238/share/v2/86b1b2ed568f43c9892e17d54b3c5f78/types/35d8f83e-fb79-4641-b1b4-7e1e2b54c7bd returned with HTTP 202 May 28 12:57:34 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 357/727] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:57:34 2024] DELETE /share/v2/86b1b2ed568f43c9892e17d54b3c5f78/types/35d8f83e-fb79-4641-b1b4-7e1e2b54c7bd => generated 0 bytes in 43 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:57:34 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-33275488-6dd7-49e5-9196-97ece76148b3 tempest-AccessesMetadataNegativeTest-850862987 tempest-AccessesMetadataNegativeTest-850862987-project-admin] GET http://10.27.203.238/share/v2/86b1b2ed568f43c9892e17d54b3c5f78/types/35d8f83e-fb79-4641-b1b4-7e1e2b54c7bd May 28 12:57:34 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-33275488-6dd7-49e5-9196-97ece76148b3 tempest-AccessesMetadataNegativeTest-850862987 tempest-AccessesMetadataNegativeTest-850862987-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:34 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-33275488-6dd7-49e5-9196-97ece76148b3 tempest-AccessesMetadataNegativeTest-850862987 tempest-AccessesMetadataNegativeTest-850862987-project-admin] Calling method 'ShareTypesController.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:34 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-33275488-6dd7-49e5-9196-97ece76148b3 tempest-AccessesMetadataNegativeTest-850862987 tempest-AccessesMetadataNegativeTest-850862987-project-admin] HTTP exception thrown: Share type not found. May 28 12:57:34 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-33275488-6dd7-49e5-9196-97ece76148b3 tempest-AccessesMetadataNegativeTest-850862987 tempest-AccessesMetadataNegativeTest-850862987-project-admin] http://10.27.203.238/share/v2/86b1b2ed568f43c9892e17d54b3c5f78/types/35d8f83e-fb79-4641-b1b4-7e1e2b54c7bd returned with HTTP 404 May 28 12:57:34 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 371/728] 10.27.203.238 () {64 vars in 1448 bytes} [Tue May 28 12:57:34 2024] GET /share/v2/86b1b2ed568f43c9892e17d54b3c5f78/types/35d8f83e-fb79-4641-b1b4-7e1e2b54c7bd => generated 67 bytes in 11 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 12:57:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7369712-7cfe-49b4-b5e7-5c191a55a5d9 tempest-AccessesMetadataNegativeTest-850862987 tempest-AccessesMetadataNegativeTest-850862987-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-d7369712-7cfe-49b4-b5e7-5c191a55a5d9 tempest-AccessesMetadataNegativeTest-850862987 tempest-AccessesMetadataNegativeTest-850862987-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7369712-7cfe-49b4-b5e7-5c191a55a5d9 tempest-AccessesMetadataNegativeTest-850862987 tempest-AccessesMetadataNegativeTest-850862987-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21d84fe-926f-43ad-932e-47ce219969e4 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21d84fe-926f-43ad-932e-47ce219969e4 None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21d84fe-926f-43ad-932e-47ce219969e4 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21d84fe-926f-43ad-932e-47ce219969e4 None admin] PATH_INFO: `/v3/users/aecf70f564bb43b5bc870395023f1341` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21d84fe-926f-43ad-932e-47ce219969e4 None admin] RBAC: Authorizing `identity:delete_user(user_id=aecf70f564bb43b5bc870395023f1341)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21d84fe-926f-43ad-932e-47ce219969e4 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-e21d84fe-926f-43ad-932e-47ce219969e4 None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aecf70f564bb43b5bc870395023f1341', 'request_id': 'req-e21d84fe-926f-43ad-932e-47ce219969e4'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-e21d84fe-926f-43ad-932e-47ce219969e4 None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aecf70f564bb43b5bc870395023f1341', 'request_id': 'req-e21d84fe-926f-43ad-932e-47ce219969e4'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-e21d84fe-926f-43ad-932e-47ce219969e4 None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aecf70f564bb43b5bc870395023f1341', 'request_id': 'req-e21d84fe-926f-43ad-932e-47ce219969e4'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-e21d84fe-926f-43ad-932e-47ce219969e4 None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aecf70f564bb43b5bc870395023f1341', 'request_id': 'req-e21d84fe-926f-43ad-932e-47ce219969e4'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-e21d84fe-926f-43ad-932e-47ce219969e4 None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aecf70f564bb43b5bc870395023f1341', 'request_id': 'req-e21d84fe-926f-43ad-932e-47ce219969e4'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:34 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0822a4f6-6ff4-4990-9cf0-11eebbf113e7 tempest-AdminActionsTest-1749172189 None] <<< [GET] https://127.0.0.1:40443/api/views/ May 28 12:57:34 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0822a4f6-6ff4-4990-9cf0-11eebbf113e7 tempest-AdminActionsTest-1749172189 None] [] May 28 12:57:34 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0822a4f6-6ff4-4990-9cf0-11eebbf113e7 tempest-AdminActionsTest-1749172189 None] --- [GET] https://127.0.0.1:40443/api/views/: Done May 28 12:57:34 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0822a4f6-6ff4-4990-9cf0-11eebbf113e7 tempest-AdminActionsTest-1749172189 None] >>> [POST] https://127.0.0.1:40443/api/views/ May 28 12:57:34 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0822a4f6-6ff4-4990-9cf0-11eebbf113e7 tempest-AdminActionsTest-1749172189 None] {'data': '{"name": "724bc53b-1c28-4ab1-b3c8-ab90f868473d", "path": ' May 28 12:57:34 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0822a4f6-6ff4-4990-9cf0-11eebbf113e7 tempest-AdminActionsTest-1749172189 None] '"/manila/manila-724bc53b-1c28-4ab1-b3c8-ab90f868473d", "policy_id": ' May 28 12:57:34 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0822a4f6-6ff4-4990-9cf0-11eebbf113e7 tempest-AdminActionsTest-1749172189 None] '20, "create_dir": true, "protocols": ["NFS"]}', May 28 12:57:34 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0822a4f6-6ff4-4990-9cf0-11eebbf113e7 tempest-AdminActionsTest-1749172189 None] 'json': None, May 28 12:57:34 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0822a4f6-6ff4-4990-9cf0-11eebbf113e7 tempest-AdminActionsTest-1749172189 None] 'params': None} May 28 12:57:34 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 945/1914] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 12:57:34 2024] DELETE /identity/v3/users/aecf70f564bb43b5bc870395023f1341 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:57:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f9229c-e209-484f-8f93-cd3378359aaa tempest-AccessesMetadataNegativeTest-850862987 tempest-AccessesMetadataNegativeTest-850862987-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f9229c-e209-484f-8f93-cd3378359aaa tempest-AccessesMetadataNegativeTest-850862987 tempest-AccessesMetadataNegativeTest-850862987-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509217b0-9ad2-4ba8-a152-869afb4853d0 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509217b0-9ad2-4ba8-a152-869afb4853d0 None admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509217b0-9ad2-4ba8-a152-869afb4853d0 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509217b0-9ad2-4ba8-a152-869afb4853d0 None admin] PATH_INFO: `/v3/users/3602f1b4b0604dac9f3dac83a8eb3661` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509217b0-9ad2-4ba8-a152-869afb4853d0 None admin] RBAC: Authorizing `identity:delete_user(user_id=3602f1b4b0604dac9f3dac83a8eb3661)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509217b0-9ad2-4ba8-a152-869afb4853d0 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:34 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-d07ac1b0-1cbd-4f1b-bca7-459b6fafde65 tempest-ShareSnapshotInstancesTest-843694899 tempest-ShareSnapshotInstancesTest-843694899-project-admin] GET http://10.27.203.238/share/v2/f4f7702aa04c467288cc6b142f61ec37/snapshots/06828ea4-ef00-439f-b57a-9d726e3f2e62 May 28 12:57:34 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-d07ac1b0-1cbd-4f1b-bca7-459b6fafde65 tempest-ShareSnapshotInstancesTest-843694899 tempest-ShareSnapshotInstancesTest-843694899-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:34 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-d07ac1b0-1cbd-4f1b-bca7-459b6fafde65 tempest-ShareSnapshotInstancesTest-843694899 tempest-ShareSnapshotInstancesTest-843694899-project-admin] Calling method 'ShareSnapshotMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:35 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-d07ac1b0-1cbd-4f1b-bca7-459b6fafde65 tempest-ShareSnapshotInstancesTest-843694899 tempest-ShareSnapshotInstancesTest-843694899-project-admin] HTTP exception thrown: The resource could not be found. May 28 12:57:35 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-d07ac1b0-1cbd-4f1b-bca7-459b6fafde65 tempest-ShareSnapshotInstancesTest-843694899 tempest-ShareSnapshotInstancesTest-843694899-project-admin] http://10.27.203.238/share/v2/f4f7702aa04c467288cc6b142f61ec37/snapshots/06828ea4-ef00-439f-b57a-9d726e3f2e62 returned with HTTP 404 May 28 12:57:35 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 358/729] 10.27.203.238 () {64 vars in 1460 bytes} [Tue May 28 12:57:34 2024] GET /share/v2/f4f7702aa04c467288cc6b142f61ec37/snapshots/06828ea4-ef00-439f-b57a-9d726e3f2e62 => generated 78 bytes in 15 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 12:57:35 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-c57c6f9d-c231-4641-a2b0-fcf304e50d4b tempest-ShareSnapshotInstancesTest-843694899 tempest-ShareSnapshotInstancesTest-843694899-project-admin] GET http://10.27.203.238/share/v2/f4f7702aa04c467288cc6b142f61ec37/share-replicas/detail?share_id=b235c40f-7437-4e0c-b44e-321d8e8b1457 May 28 12:57:35 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-c57c6f9d-c231-4641-a2b0-fcf304e50d4b tempest-ShareSnapshotInstancesTest-843694899 tempest-ShareSnapshotInstancesTest-843694899-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:35 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-c57c6f9d-c231-4641-a2b0-fcf304e50d4b tempest-ShareSnapshotInstancesTest-843694899 tempest-ShareSnapshotInstancesTest-843694899-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:35 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-c57c6f9d-c231-4641-a2b0-fcf304e50d4b tempest-ShareSnapshotInstancesTest-843694899 tempest-ShareSnapshotInstancesTest-843694899-project-admin] http://10.27.203.238/share/v2/f4f7702aa04c467288cc6b142f61ec37/share-replicas/detail?share_id=b235c40f-7437-4e0c-b44e-321d8e8b1457 returned with HTTP 200 May 28 12:57:35 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 372/730] 10.27.203.238 () {64 vars in 1476 bytes} [Tue May 28 12:57:35 2024] GET /share/v2/f4f7702aa04c467288cc6b142f61ec37/share-replicas/detail?share_id=b235c40f-7437-4e0c-b44e-321d8e8b1457 => generated 22 bytes in 13 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:57:35 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-814b4b1c-0796-47a2-87e9-38fb765c09fd tempest-ShareSnapshotInstancesTest-843694899 tempest-ShareSnapshotInstancesTest-843694899-project-admin] DELETE http://10.27.203.238/share/v2/f4f7702aa04c467288cc6b142f61ec37/shares/b235c40f-7437-4e0c-b44e-321d8e8b1457 May 28 12:57:35 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-814b4b1c-0796-47a2-87e9-38fb765c09fd tempest-ShareSnapshotInstancesTest-843694899 tempest-ShareSnapshotInstancesTest-843694899-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:35 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-814b4b1c-0796-47a2-87e9-38fb765c09fd tempest-ShareSnapshotInstancesTest-843694899 tempest-ShareSnapshotInstancesTest-843694899-project-admin] Calling method 'ShareMixin.delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-509217b0-9ad2-4ba8-a152-869afb4853d0 None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3602f1b4b0604dac9f3dac83a8eb3661', 'request_id': 'req-509217b0-9ad2-4ba8-a152-869afb4853d0'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:35 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.v1.shares [None req-814b4b1c-0796-47a2-87e9-38fb765c09fd tempest-ShareSnapshotInstancesTest-843694899 tempest-ShareSnapshotInstancesTest-843694899-project-admin] Delete share with id: b235c40f-7437-4e0c-b44e-321d8e8b1457 May 28 12:57:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-509217b0-9ad2-4ba8-a152-869afb4853d0 None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3602f1b4b0604dac9f3dac83a8eb3661', 'request_id': 'req-509217b0-9ad2-4ba8-a152-869afb4853d0'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-509217b0-9ad2-4ba8-a152-869afb4853d0 None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3602f1b4b0604dac9f3dac83a8eb3661', 'request_id': 'req-509217b0-9ad2-4ba8-a152-869afb4853d0'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-509217b0-9ad2-4ba8-a152-869afb4853d0 None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3602f1b4b0604dac9f3dac83a8eb3661', 'request_id': 'req-509217b0-9ad2-4ba8-a152-869afb4853d0'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-509217b0-9ad2-4ba8-a152-869afb4853d0 None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3602f1b4b0604dac9f3dac83a8eb3661', 'request_id': 'req-509217b0-9ad2-4ba8-a152-869afb4853d0'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:35 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 970/1915] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 12:57:34 2024] DELETE /identity/v3/users/3602f1b4b0604dac9f3dac83a8eb3661 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:57:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21d84fe-926f-43ad-932e-47ce219969e4 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-e21d84fe-926f-43ad-932e-47ce219969e4 None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21d84fe-926f-43ad-932e-47ce219969e4 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fe9308-5288-4c4f-be24-a580ecfc862e None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fe9308-5288-4c4f-be24-a580ecfc862e None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fe9308-5288-4c4f-be24-a580ecfc862e None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fe9308-5288-4c4f-be24-a580ecfc862e None admin] PATH_INFO: `/v3/users/d2db2faa187d4ba4baf6b1b73c2fb965` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fe9308-5288-4c4f-be24-a580ecfc862e None admin] RBAC: Authorizing `identity:delete_user(user_id=d2db2faa187d4ba4baf6b1b73c2fb965)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fe9308-5288-4c4f-be24-a580ecfc862e None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:35 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-814b4b1c-0796-47a2-87e9-38fb765c09fd tempest-ShareSnapshotInstancesTest-843694899 tempest-ShareSnapshotInstancesTest-843694899-project-admin] http://10.27.203.238/share/v2/f4f7702aa04c467288cc6b142f61ec37/shares/b235c40f-7437-4e0c-b44e-321d8e8b1457 returned with HTTP 202 May 28 12:57:35 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 359/731] 10.27.203.238 () {64 vars in 1454 bytes} [Tue May 28 12:57:35 2024] DELETE /share/v2/f4f7702aa04c467288cc6b142f61ec37/shares/b235c40f-7437-4e0c-b44e-321d8e8b1457 => generated 0 bytes in 126 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:57:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-b4fe9308-5288-4c4f-be24-a580ecfc862e None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2db2faa187d4ba4baf6b1b73c2fb965', 'request_id': 'req-b4fe9308-5288-4c4f-be24-a580ecfc862e'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-b4fe9308-5288-4c4f-be24-a580ecfc862e None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2db2faa187d4ba4baf6b1b73c2fb965', 'request_id': 'req-b4fe9308-5288-4c4f-be24-a580ecfc862e'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:35 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-221399ba-3c3a-418e-bfef-3b7c05b82343 tempest-ShareSnapshotInstancesTest-843694899 tempest-ShareSnapshotInstancesTest-843694899-project-admin] GET http://10.27.203.238/share/v2/f4f7702aa04c467288cc6b142f61ec37/shares/b235c40f-7437-4e0c-b44e-321d8e8b1457 May 28 12:57:35 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-221399ba-3c3a-418e-bfef-3b7c05b82343 tempest-ShareSnapshotInstancesTest-843694899 tempest-ShareSnapshotInstancesTest-843694899-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:35 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-221399ba-3c3a-418e-bfef-3b7c05b82343 tempest-ShareSnapshotInstancesTest-843694899 tempest-ShareSnapshotInstancesTest-843694899-project-admin] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-b4fe9308-5288-4c4f-be24-a580ecfc862e None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2db2faa187d4ba4baf6b1b73c2fb965', 'request_id': 'req-b4fe9308-5288-4c4f-be24-a580ecfc862e'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-b4fe9308-5288-4c4f-be24-a580ecfc862e None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2db2faa187d4ba4baf6b1b73c2fb965', 'request_id': 'req-b4fe9308-5288-4c4f-be24-a580ecfc862e'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-b4fe9308-5288-4c4f-be24-a580ecfc862e None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2db2faa187d4ba4baf6b1b73c2fb965', 'request_id': 'req-b4fe9308-5288-4c4f-be24-a580ecfc862e'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:35 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-221399ba-3c3a-418e-bfef-3b7c05b82343 tempest-ShareSnapshotInstancesTest-843694899 tempest-ShareSnapshotInstancesTest-843694899-project-admin] http://10.27.203.238/share/v2/f4f7702aa04c467288cc6b142f61ec37/shares/b235c40f-7437-4e0c-b44e-321d8e8b1457 returned with HTTP 200 May 28 12:57:35 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 373/732] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:57:35 2024] GET /share/v2/f4f7702aa04c467288cc6b142f61ec37/shares/b235c40f-7437-4e0c-b44e-321d8e8b1457 => generated 1372 bytes in 25 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:57:35 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 946/1916] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 12:57:35 2024] DELETE /identity/v3/users/d2db2faa187d4ba4baf6b1b73c2fb965 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:57:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe4274f-acbd-494c-bf69-8a606d2ed5ca None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe4274f-acbd-494c-bf69-8a606d2ed5ca None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe4274f-acbd-494c-bf69-8a606d2ed5ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:35 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-efe4274f-acbd-494c-bf69-8a606d2ed5ca None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:57:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-efe4274f-acbd-494c-bf69-8a606d2ed5ca None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:57:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-efe4274f-acbd-494c-bf69-8a606d2ed5ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:35 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-814b4b1c-0796-47a2-87e9-38fb765c09fd tempest-ShareSnapshotInstancesTest-843694899 None] Acquiring lock "locked_access_rules_operation_by_share_instance_c2f741cd-bac5-499f-9539-8e93d6a81282" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:57:35 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-814b4b1c-0796-47a2-87e9-38fb765c09fd tempest-ShareSnapshotInstancesTest-843694899 None] Lock "locked_access_rules_operation_by_share_instance_c2f741cd-bac5-499f-9539-8e93d6a81282" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:57:35 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-814b4b1c-0796-47a2-87e9-38fb765c09fd tempest-ShareSnapshotInstancesTest-843694899 None] Lock "locked_access_rules_operation_by_share_instance_c2f741cd-bac5-499f-9539-8e93d6a81282" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:57:35 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-814b4b1c-0796-47a2-87e9-38fb765c09fd tempest-ShareSnapshotInstancesTest-843694899 None] Acquiring lock "locked_access_rules_operation_by_share_instance_c2f741cd-bac5-499f-9539-8e93d6a81282" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:57:35 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-814b4b1c-0796-47a2-87e9-38fb765c09fd tempest-ShareSnapshotInstancesTest-843694899 None] Lock "locked_access_rules_operation_by_share_instance_c2f741cd-bac5-499f-9539-8e93d6a81282" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:57:35 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-814b4b1c-0796-47a2-87e9-38fb765c09fd tempest-ShareSnapshotInstancesTest-843694899 None] Lock "locked_access_rules_operation_by_share_instance_c2f741cd-bac5-499f-9539-8e93d6a81282" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.004s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:57:35 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-814b4b1c-0796-47a2-87e9-38fb765c09fd tempest-ShareSnapshotInstancesTest-843694899 None] Acquiring lock "locked_access_rules_operation_by_share_instance_c2f741cd-bac5-499f-9539-8e93d6a81282" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:57:35 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-814b4b1c-0796-47a2-87e9-38fb765c09fd tempest-ShareSnapshotInstancesTest-843694899 None] Lock "locked_access_rules_operation_by_share_instance_c2f741cd-bac5-499f-9539-8e93d6a81282" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:57:35 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-814b4b1c-0796-47a2-87e9-38fb765c09fd tempest-ShareSnapshotInstancesTest-843694899 None] Lock "locked_access_rules_operation_by_share_instance_c2f741cd-bac5-499f-9539-8e93d6a81282" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:57:35 l75lg1-v1 manila-share[98474]: DEBUG manila.share.access [None req-814b4b1c-0796-47a2-87e9-38fb765c09fd tempest-ShareSnapshotInstancesTest-843694899 None] All access rules have been synced for share instance c2f741cd-bac5-499f-9539-8e93d6a81282 belonging to share b235c40f-7437-4e0c-b44e-321d8e8b1457. {{(pid=98474) update_access_rules /opt/stack/manila/manila/share/access.py:304}} May 28 12:57:35 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-814b4b1c-0796-47a2-87e9-38fb765c09fd tempest-ShareSnapshotInstancesTest-843694899 None] deleting '/manila/manila-c2f741cd-bac5-499f-9539-8e93d6a81282' May 28 12:57:35 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-814b4b1c-0796-47a2-87e9-38fb765c09fd tempest-ShareSnapshotInstancesTest-843694899 None] >>> [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/ May 28 12:57:35 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-814b4b1c-0796-47a2-87e9-38fb765c09fd tempest-ShareSnapshotInstancesTest-843694899 None] {'data': '{"path": "/manila/manila-c2f741cd-bac5-499f-9539-8e93d6a81282"}', May 28 12:57:35 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-814b4b1c-0796-47a2-87e9-38fb765c09fd tempest-ShareSnapshotInstancesTest-843694899 None] 'params': None} May 28 12:57:35 l75lg1-v1 dstat.sh[49771]: 28-05 12:57:35| 9 1 87 3 0|5694M 1800M 277M 7854M| 22k 3112B| 0 1817k| 0 267 |5967 10k|1.59 1.06 1.01|2.0 2.0 0| 0 0 | 0 2048M| 29 356 0 67 0 May 28 12:57:35 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 971/1917] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:57:35 2024] POST /identity/v3/auth/tokens => generated 2960 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 12:57:35 l75lg1-v1 neutron-server[77619]: DEBUG neutron.wsgi [-] (77619) accepted ('10.27.203.238', 37726) {{(pid=77619) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 12:57:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fe9308-5288-4c4f-be24-a580ecfc862e None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-b4fe9308-5288-4c4f-be24-a580ecfc862e None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fe9308-5288-4c4f-be24-a580ecfc862e None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed672666-c400-4bc1-a7e0-2cf41947bf3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef17047035e4b518fd5360a01f2da1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed672666-c400-4bc1-a7e0-2cf41947bf3d service neutron] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed672666-c400-4bc1-a7e0-2cf41947bf3d service neutron] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed672666-c400-4bc1-a7e0-2cf41947bf3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed672666-c400-4bc1-a7e0-2cf41947bf3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed672666-c400-4bc1-a7e0-2cf41947bf3d service neutron] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:35 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 947/1918] 10.27.203.238 () {64 vars in 1432 bytes} [Tue May 28 12:57:35 2024] GET /identity/v3/auth/tokens => generated 2960 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 28 12:57:35 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-814b4b1c-0796-47a2-87e9-38fb765c09fd tempest-ShareSnapshotInstancesTest-843694899 None] <<< [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/ May 28 12:57:35 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-814b4b1c-0796-47a2-87e9-38fb765c09fd tempest-ShareSnapshotInstancesTest-843694899 None] 'OK' May 28 12:57:35 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-814b4b1c-0796-47a2-87e9-38fb765c09fd tempest-ShareSnapshotInstancesTest-843694899 None] --- [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/: Done May 28 12:57:35 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-814b4b1c-0796-47a2-87e9-38fb765c09fd tempest-ShareSnapshotInstancesTest-843694899 None] >>> [GET] https://127.0.0.1:40443/api/views/ May 28 12:57:35 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-814b4b1c-0796-47a2-87e9-38fb765c09fd tempest-ShareSnapshotInstancesTest-843694899 None] {'allow_redirects': True, May 28 12:57:35 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-814b4b1c-0796-47a2-87e9-38fb765c09fd tempest-ShareSnapshotInstancesTest-843694899 None] 'params': {'name': 'c2f741cd-bac5-499f-9539-8e93d6a81282'}} May 28 12:57:35 l75lg1-v1 neutron-server[77619]: INFO neutron.wsgi [None req-f4bebacb-fb8c-4224-9ddf-ce9ff87af442 None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=ed83204ad63946bdae288892bd07d115&name=default HTTP/1.1" status: 200 len: 216 time: 0.0737269 May 28 12:57:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe4274f-acbd-494c-bf69-8a606d2ed5ca None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-efe4274f-acbd-494c-bf69-8a606d2ed5ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe4274f-acbd-494c-bf69-8a606d2ed5ca None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52812685-1b29-4c77-9a52-243af67a1702 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52812685-1b29-4c77-9a52-243af67a1702 None admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52812685-1b29-4c77-9a52-243af67a1702 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52812685-1b29-4c77-9a52-243af67a1702 None admin] PATH_INFO: `/v3/projects/ed83204ad63946bdae288892bd07d115` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52812685-1b29-4c77-9a52-243af67a1702 None admin] RBAC: Authorizing `identity:delete_project(project_id=ed83204ad63946bdae288892bd07d115)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52812685-1b29-4c77-9a52-243af67a1702 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-52812685-1b29-4c77-9a52-243af67a1702 None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed83204ad63946bdae288892bd07d115', 'request_id': 'req-52812685-1b29-4c77-9a52-243af67a1702'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-52812685-1b29-4c77-9a52-243af67a1702 None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed83204ad63946bdae288892bd07d115', 'request_id': 'req-52812685-1b29-4c77-9a52-243af67a1702'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-52812685-1b29-4c77-9a52-243af67a1702 None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed83204ad63946bdae288892bd07d115', 'request_id': 'req-52812685-1b29-4c77-9a52-243af67a1702'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-52812685-1b29-4c77-9a52-243af67a1702 None admin] The token cache is being invalidate because project ed83204ad63946bdae288892bd07d115 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 12:57:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-52812685-1b29-4c77-9a52-243af67a1702 None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-52812685-1b29-4c77-9a52-243af67a1702 None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:35 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 972/1919] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 12:57:35 2024] DELETE /identity/v3/projects/ed83204ad63946bdae288892bd07d115 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:57:35 l75lg1-v1 neutron-server[77619]: DEBUG neutron.wsgi [-] (77619) accepted ('10.27.203.238', 37742) {{(pid=77619) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 12:57:35 l75lg1-v1 neutron-server[77619]: INFO neutron.wsgi [None req-b452c33d-a9ee-492f-b337-69e7a799c0bb None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=86b1b2ed568f43c9892e17d54b3c5f78&name=default HTTP/1.1" status: 200 len: 216 time: 0.0090837 May 28 12:57:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed672666-c400-4bc1-a7e0-2cf41947bf3d service neutron] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed672666-c400-4bc1-a7e0-2cf41947bf3d service neutron] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f389c2e5-aab4-40d5-8de9-fc99afbc62f7 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f389c2e5-aab4-40d5-8de9-fc99afbc62f7 None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f389c2e5-aab4-40d5-8de9-fc99afbc62f7 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f389c2e5-aab4-40d5-8de9-fc99afbc62f7 None admin] PATH_INFO: `/v3/projects/86b1b2ed568f43c9892e17d54b3c5f78` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f389c2e5-aab4-40d5-8de9-fc99afbc62f7 None admin] RBAC: Authorizing `identity:delete_project(project_id=86b1b2ed568f43c9892e17d54b3c5f78)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f389c2e5-aab4-40d5-8de9-fc99afbc62f7 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-f389c2e5-aab4-40d5-8de9-fc99afbc62f7 None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86b1b2ed568f43c9892e17d54b3c5f78', 'request_id': 'req-f389c2e5-aab4-40d5-8de9-fc99afbc62f7'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-f389c2e5-aab4-40d5-8de9-fc99afbc62f7 None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86b1b2ed568f43c9892e17d54b3c5f78', 'request_id': 'req-f389c2e5-aab4-40d5-8de9-fc99afbc62f7'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-f389c2e5-aab4-40d5-8de9-fc99afbc62f7 None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86b1b2ed568f43c9892e17d54b3c5f78', 'request_id': 'req-f389c2e5-aab4-40d5-8de9-fc99afbc62f7'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-f389c2e5-aab4-40d5-8de9-fc99afbc62f7 None admin] The token cache is being invalidate because project 86b1b2ed568f43c9892e17d54b3c5f78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 12:57:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-f389c2e5-aab4-40d5-8de9-fc99afbc62f7 None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-f389c2e5-aab4-40d5-8de9-fc99afbc62f7 None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:35 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 948/1920] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 12:57:35 2024] DELETE /identity/v3/projects/86b1b2ed568f43c9892e17d54b3c5f78 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:57:35 l75lg1-v1 neutron-server[77619]: DEBUG neutron.wsgi [-] (77619) accepted ('10.27.203.238', 37744) {{(pid=77619) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 12:57:35 l75lg1-v1 neutron-server[77619]: INFO neutron.wsgi [None req-cf065ff3-dda0-438f-ae21-2d75a375d05b None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=3e21df600d6c4f93ae48db92d82bf03e&name=default HTTP/1.1" status: 200 len: 216 time: 0.0088933 May 28 12:57:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52812685-1b29-4c77-9a52-243af67a1702 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-52812685-1b29-4c77-9a52-243af67a1702 None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52812685-1b29-4c77-9a52-243af67a1702 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6d3ef8-7e19-4bb7-9366-b68f11860329 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6d3ef8-7e19-4bb7-9366-b68f11860329 None admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6d3ef8-7e19-4bb7-9366-b68f11860329 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6d3ef8-7e19-4bb7-9366-b68f11860329 None admin] PATH_INFO: `/v3/projects/3e21df600d6c4f93ae48db92d82bf03e` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6d3ef8-7e19-4bb7-9366-b68f11860329 None admin] RBAC: Authorizing `identity:delete_project(project_id=3e21df600d6c4f93ae48db92d82bf03e)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6d3ef8-7e19-4bb7-9366-b68f11860329 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-6f6d3ef8-7e19-4bb7-9366-b68f11860329 None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e21df600d6c4f93ae48db92d82bf03e', 'request_id': 'req-6f6d3ef8-7e19-4bb7-9366-b68f11860329'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-6f6d3ef8-7e19-4bb7-9366-b68f11860329 None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e21df600d6c4f93ae48db92d82bf03e', 'request_id': 'req-6f6d3ef8-7e19-4bb7-9366-b68f11860329'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-6f6d3ef8-7e19-4bb7-9366-b68f11860329 None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e21df600d6c4f93ae48db92d82bf03e', 'request_id': 'req-6f6d3ef8-7e19-4bb7-9366-b68f11860329'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-6f6d3ef8-7e19-4bb7-9366-b68f11860329 None admin] The token cache is being invalidate because project 3e21df600d6c4f93ae48db92d82bf03e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 12:57:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-6f6d3ef8-7e19-4bb7-9366-b68f11860329 None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-6f6d3ef8-7e19-4bb7-9366-b68f11860329 None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:35 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 973/1921] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 12:57:35 2024] DELETE /identity/v3/projects/3e21df600d6c4f93ae48db92d82bf03e => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:57:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9b9f29-00c3-4aeb-a58c-86e6e6f28f48 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9b9f29-00c3-4aeb-a58c-86e6e6f28f48 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9b9f29-00c3-4aeb-a58c-86e6e6f28f48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:35 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-bc9b9f29-00c3-4aeb-a58c-86e6e6f28f48 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:57:35 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0822a4f6-6ff4-4990-9cf0-11eebbf113e7 tempest-AdminActionsTest-1749172189 None] <<< [POST] https://127.0.0.1:40443/api/views/ May 28 12:57:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-bc9b9f29-00c3-4aeb-a58c-86e6e6f28f48 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:57:35 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0822a4f6-6ff4-4990-9cf0-11eebbf113e7 tempest-AdminActionsTest-1749172189 None] Bunch(abac_tags=[], abe_max_depth=None, abe_protocols=[], alias='', allow_anonymous_access=False, allow_s3_anonymous_access=False, auto_commit='0d', bucket='', bucket_creators=[], bucket_creators_groups=[], bucket_owner=None, bulk_permission_update_progress=None, bulk_permission_update_state=None, cluster='loop75-kfs', cluster_id=1, created='2024-05-28T12:57:35.351565Z', enabled=True, files_retention_mode='NONE', guid='cb44dd7a-3d70-4e01-99f0-f132fdaeba68', id=19, ignore_oos=False, internal=False, is_remote=False, is_seamless=False, logical_capacity=0, max_retention_period=None, min_retention_period=None, name='724bc53b-1c28-4ab1-b3c8-ab90f868473d', nfs_interop_flags='BOTH_NFS3_AND_NFS4_INTEROP_DISABLED', path='/manila/manila-724bc53b-1c28-4ab1-b3c8-ab90f868473d', physical_capacity=0, policy='724bc53b-1c28-4ab1-b3c8-ab90f868473d', policy_id=20, protocols=['NFS'], qos_policy=None, qos_policy_id=None, s3_locks=False, s3_locks_retention_mode='NONE', s3_locks_retention_period='', s3_object_ownership_rule='ObjectWriter', s3_unverified_lookup=False, s3_versioning=False, select_for_live_monitoring=False, share='', share_acl=Bunch(acl=[], enabled=False), sync='SYNCED', sync_time='2024-05-28T12:57:35.616568Z', tenant_id=1, tenant_name='default', title='/manila/manila-724bc53b-1c28-4ab1-b3c8-ab90f868473d', url='https://127.0.0.1:40443/api/views/19/') May 28 12:57:35 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0822a4f6-6ff4-4990-9cf0-11eebbf113e7 tempest-AdminActionsTest-1749172189 None] --- [POST] https://127.0.0.1:40443/api/views/: Done May 28 12:57:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-bc9b9f29-00c3-4aeb-a58c-86e6e6f28f48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:35 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 949/1922] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:57:35 2024] POST /identity/v3/auth/tokens => generated 312 bytes in 21 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 28 12:57:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea39396e-2a5b-4db8-b94e-18853cb46080 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea39396e-2a5b-4db8-b94e-18853cb46080 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea39396e-2a5b-4db8-b94e-18853cb46080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:35 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-ea39396e-2a5b-4db8-b94e-18853cb46080 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:57:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-ea39396e-2a5b-4db8-b94e-18853cb46080 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:57:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-ea39396e-2a5b-4db8-b94e-18853cb46080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:35 l75lg1-v1 manila-share[98474]: INFO manila.share.manager [None req-0822a4f6-6ff4-4990-9cf0-11eebbf113e7 tempest-AdminActionsTest-1749172189 None] Share instance 724bc53b-1c28-4ab1-b3c8-ab90f868473d created successfully. May 28 12:57:35 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 974/1923] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:57:35 2024] POST /identity/v3/auth/tokens => generated 2960 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 12:57:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9b9f29-00c3-4aeb-a58c-86e6e6f28f48 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9b9f29-00c3-4aeb-a58c-86e6e6f28f48 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47acd439-ff7e-4025-ba74-a3c42febdc3f None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47acd439-ff7e-4025-ba74-a3c42febdc3f None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47acd439-ff7e-4025-ba74-a3c42febdc3f None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47acd439-ff7e-4025-ba74-a3c42febdc3f None admin] PATH_INFO: `/v3/domains` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47acd439-ff7e-4025-ba74-a3c42febdc3f None admin] RBAC: Adding query filter params (name=Default) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:57:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47acd439-ff7e-4025-ba74-a3c42febdc3f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47acd439-ff7e-4025-ba74-a3c42febdc3f None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:35 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 950/1924] 10.27.203.238 () {62 vars in 1220 bytes} [Tue May 28 12:57:35 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:57:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea39396e-2a5b-4db8-b94e-18853cb46080 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea39396e-2a5b-4db8-b94e-18853cb46080 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ba4d87-1ff2-4f7b-a3fe-7187f2ec4d18 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ba4d87-1ff2-4f7b-a3fe-7187f2ec4d18 None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ba4d87-1ff2-4f7b-a3fe-7187f2ec4d18 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ba4d87-1ff2-4f7b-a3fe-7187f2ec4d18 None admin] PATH_INFO: `/v3/projects` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ba4d87-1ff2-4f7b-a3fe-7187f2ec4d18 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ba4d87-1ff2-4f7b-a3fe-7187f2ec4d18 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:35 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 975/1925] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 12:57:35 2024] POST /identity/v3/projects => generated 379 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:57:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47acd439-ff7e-4025-ba74-a3c42febdc3f None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47acd439-ff7e-4025-ba74-a3c42febdc3f None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9b6f3f-a41b-4769-a2bd-59138cf10fd3 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9b6f3f-a41b-4769-a2bd-59138cf10fd3 None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9b6f3f-a41b-4769-a2bd-59138cf10fd3 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9b6f3f-a41b-4769-a2bd-59138cf10fd3 None admin] PATH_INFO: `/v3/users` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9b6f3f-a41b-4769-a2bd-59138cf10fd3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9b6f3f-a41b-4769-a2bd-59138cf10fd3 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:35 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-5a9b6f3f-a41b-4769-a2bd-59138cf10fd3 None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 12:57:35 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 951/1926] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 12:57:35 2024] POST /identity/v3/users => generated 298 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:57:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ba4d87-1ff2-4f7b-a3fe-7187f2ec4d18 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ba4d87-1ff2-4f7b-a3fe-7187f2ec4d18 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab378b0e-f6ca-4099-905f-ed21e188d5b6 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab378b0e-f6ca-4099-905f-ed21e188d5b6 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab378b0e-f6ca-4099-905f-ed21e188d5b6 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab378b0e-f6ca-4099-905f-ed21e188d5b6 None admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab378b0e-f6ca-4099-905f-ed21e188d5b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab378b0e-f6ca-4099-905f-ed21e188d5b6 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:35 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 976/1927] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 12:57:35 2024] GET /identity/v3/roles => generated 1680 bytes in 17 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:57:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9b6f3f-a41b-4769-a2bd-59138cf10fd3 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9b6f3f-a41b-4769-a2bd-59138cf10fd3 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1729ed-4510-47fc-bf16-178752c02be8 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1729ed-4510-47fc-bf16-178752c02be8 None admin] REQUEST_METHOD: `PUT` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1729ed-4510-47fc-bf16-178752c02be8 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1729ed-4510-47fc-bf16-178752c02be8 None admin] PATH_INFO: `/v3/projects/dff252807b6b49bdad4fd85f22c29e5b/users/f5d41d73590d4952bc69134aed9c80f0/roles/44620cad10ae407c90c91e2c296adb04` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1729ed-4510-47fc-bf16-178752c02be8 None admin] RBAC: Authorizing `identity:create_grant(project_id=dff252807b6b49bdad4fd85f22c29e5b, user_id=f5d41d73590d4952bc69134aed9c80f0, role_id=44620cad10ae407c90c91e2c296adb04)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1729ed-4510-47fc-bf16-178752c02be8 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:35 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-814b4b1c-0796-47a2-87e9-38fb765c09fd tempest-ShareSnapshotInstancesTest-843694899 None] <<< [GET] https://127.0.0.1:40443/api/views/ May 28 12:57:35 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-814b4b1c-0796-47a2-87e9-38fb765c09fd tempest-ShareSnapshotInstancesTest-843694899 None] [Bunch(abac_tags=[], abe_max_depth=None, abe_protocols=[], alias='', allow_anonymous_access=False, allow_s3_anonymous_access=False, auto_commit='0d', bucket='', bucket_creators=[], bucket_creators_groups=[], bucket_owner=None, bulk_permission_update_progress=None, bulk_permission_update_state=None, cluster='loop75-kfs', cluster_id=1, created='2024-05-28T12:57:16.816766Z', enabled=True, files_retention_mode='NONE', guid='1d767672-1b27-4da4-9f14-3046ea4263e8', id=13, ignore_oos=False, internal=False, is_remote=False, is_seamless=False, logical_capacity=0, max_retention_period=None, min_retention_period=None, name='c2f741cd-bac5-499f-9539-8e93d6a81282', nfs_interop_flags='BOTH_NFS3_AND_NFS4_INTEROP_DISABLED', path='/manila/manila-c2f741cd-bac5-499f-9539-8e93d6a81282', physical_capacity=0, policy='c2f741cd-bac5-499f-9539-8e93d6a81282', policy_id=14, protocols=['NFS'], qos_policy=None, qos_policy_id=None, s3_locks=False, s3_locks_retention_mode='NONE', s3_locks_retention_period='', s3_unverified_lookup=False, s3_versioning=False, select_for_live_monitoring=False, share='', share_acl=Bunch(acl=[], enabled=False), sync='SYNCED', sync_time='2024-05-28T12:57:17.153109Z', tenant_id=1, tenant_name='default', title='/manila/manila-c2f741cd-bac5-499f-9539-8e93d6a81282', url='https://127.0.0.1:40443/api/views/13/')] May 28 12:57:35 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-814b4b1c-0796-47a2-87e9-38fb765c09fd tempest-ShareSnapshotInstancesTest-843694899 None] --- [GET] https://127.0.0.1:40443/api/views/: Done May 28 12:57:35 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-814b4b1c-0796-47a2-87e9-38fb765c09fd tempest-ShareSnapshotInstancesTest-843694899 None] >>> [DELETE] https://127.0.0.1:40443/api/views/13/ May 28 12:57:35 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 952/1928] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 12:57:35 2024] PUT /identity/v3/projects/dff252807b6b49bdad4fd85f22c29e5b/users/f5d41d73590d4952bc69134aed9c80f0/roles/44620cad10ae407c90c91e2c296adb04 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:57:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de419b41-1e9e-4cad-a2db-8c8d09fbed1a None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de419b41-1e9e-4cad-a2db-8c8d09fbed1a None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de419b41-1e9e-4cad-a2db-8c8d09fbed1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:35 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-de419b41-1e9e-4cad-a2db-8c8d09fbed1a None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:57:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-de419b41-1e9e-4cad-a2db-8c8d09fbed1a None None] MFA Rules not processed for user `f5d41d73590d4952bc69134aed9c80f0`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:57:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-de419b41-1e9e-4cad-a2db-8c8d09fbed1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:35 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a5b23709-72de-4efa-8cc5-29f19d0f7897 tempest-SharesMetadataTest-1561320255 None] <<< [DELETE] https://127.0.0.1:40443/api/views/18/ May 28 12:57:35 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a5b23709-72de-4efa-8cc5-29f19d0f7897 tempest-SharesMetadataTest-1561320255 None] --- [DELETE] https://127.0.0.1:40443/api/views/18/: Done May 28 12:57:35 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a5b23709-72de-4efa-8cc5-29f19d0f7897 tempest-SharesMetadataTest-1561320255 None] >>> [GET] https://127.0.0.1:40443/api/quotas/ May 28 12:57:35 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a5b23709-72de-4efa-8cc5-29f19d0f7897 tempest-SharesMetadataTest-1561320255 None] {'allow_redirects': True, May 28 12:57:35 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a5b23709-72de-4efa-8cc5-29f19d0f7897 tempest-SharesMetadataTest-1561320255 None] 'params': {'name': '2be2873c-4768-478e-a848-fb1d2654ca64'}} May 28 12:57:35 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 977/1929] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:57:35 2024] POST /identity/v3/auth/tokens => generated 3950 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:57:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1729ed-4510-47fc-bf16-178752c02be8 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-7a1729ed-4510-47fc-bf16-178752c02be8 None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1729ed-4510-47fc-bf16-178752c02be8 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71f5faa-a0fa-42d9-bf79-816b8c7d896f service manila] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f110cf6300f049c897d0aab63218d1e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71f5faa-a0fa-42d9-bf79-816b8c7d896f service manila] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71f5faa-a0fa-42d9-bf79-816b8c7d896f service manila] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71f5faa-a0fa-42d9-bf79-816b8c7d896f service manila] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71f5faa-a0fa-42d9-bf79-816b8c7d896f service manila] RBAC: Authorizing `identity:validate_token()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71f5faa-a0fa-42d9-bf79-816b8c7d896f service manila] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:36 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 953/1930] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 12:57:36 2024] GET /identity/v3/auth/tokens => generated 3950 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 12:57:36 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-10ad1352-c46c-4245-b11d-37827cae81fe tempest-AvailabilityZonesTest-406956437 tempest-AvailabilityZonesTest-406956437-project-member] GET http://10.27.203.238/share/v2/dff252807b6b49bdad4fd85f22c29e5b/availability-zones May 28 12:57:36 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-10ad1352-c46c-4245-b11d-37827cae81fe tempest-AvailabilityZonesTest-406956437 tempest-AvailabilityZonesTest-406956437-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:36 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-10ad1352-c46c-4245-b11d-37827cae81fe tempest-AvailabilityZonesTest-406956437 tempest-AvailabilityZonesTest-406956437-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:36 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-10ad1352-c46c-4245-b11d-37827cae81fe tempest-AvailabilityZonesTest-406956437 tempest-AvailabilityZonesTest-406956437-project-member] http://10.27.203.238/share/v2/dff252807b6b49bdad4fd85f22c29e5b/availability-zones returned with HTTP 200 May 28 12:57:36 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 360/733] 10.27.203.238 () {64 vars in 1375 bytes} [Tue May 28 12:57:36 2024] GET /share/v2/dff252807b6b49bdad4fd85f22c29e5b/availability-zones => generated 152 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:57:36 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-cb6ac4db-6f26-4c0a-86ce-2c4037adfc68 tempest-AvailabilityZonesTest-406956437 tempest-AvailabilityZonesTest-406956437-project-member] GET http://10.27.203.238/share/v1/dff252807b6b49bdad4fd85f22c29e5b/os-availability-zone May 28 12:57:36 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-cb6ac4db-6f26-4c0a-86ce-2c4037adfc68 tempest-AvailabilityZonesTest-406956437 tempest-AvailabilityZonesTest-406956437-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:36 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-cb6ac4db-6f26-4c0a-86ce-2c4037adfc68 tempest-AvailabilityZonesTest-406956437 tempest-AvailabilityZonesTest-406956437-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:36 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-cb6ac4db-6f26-4c0a-86ce-2c4037adfc68 tempest-AvailabilityZonesTest-406956437 tempest-AvailabilityZonesTest-406956437-project-member] http://10.27.203.238/share/v1/dff252807b6b49bdad4fd85f22c29e5b/os-availability-zone returned with HTTP 200 May 28 12:57:36 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 374/734] 10.27.203.238 () {62 vars in 1339 bytes} [Tue May 28 12:57:36 2024] GET /share/v1/dff252807b6b49bdad4fd85f22c29e5b/os-availability-zone => generated 152 bytes in 10 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:57:36 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-669b98e3-4be8-4d92-a030-20576dfa5d6e tempest-AvailabilityZonesTest-406956437 tempest-AvailabilityZonesTest-406956437-project-member] GET http://10.27.203.238/share/v2/dff252807b6b49bdad4fd85f22c29e5b/os-availability-zone May 28 12:57:36 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-669b98e3-4be8-4d92-a030-20576dfa5d6e tempest-AvailabilityZonesTest-406956437 tempest-AvailabilityZonesTest-406956437-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:36 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-669b98e3-4be8-4d92-a030-20576dfa5d6e tempest-AvailabilityZonesTest-406956437 tempest-AvailabilityZonesTest-406956437-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:36 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-669b98e3-4be8-4d92-a030-20576dfa5d6e tempest-AvailabilityZonesTest-406956437 tempest-AvailabilityZonesTest-406956437-project-member] http://10.27.203.238/share/v2/dff252807b6b49bdad4fd85f22c29e5b/os-availability-zone returned with HTTP 200 May 28 12:57:36 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 361/735] 10.27.203.238 () {64 vars in 1381 bytes} [Tue May 28 12:57:36 2024] GET /share/v2/dff252807b6b49bdad4fd85f22c29e5b/os-availability-zone => generated 152 bytes in 9 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:57:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de419b41-1e9e-4cad-a2db-8c8d09fbed1a None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de419b41-1e9e-4cad-a2db-8c8d09fbed1a None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bac2fe-86cc-4011-b610-94b69afc2a97 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bac2fe-86cc-4011-b610-94b69afc2a97 None admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bac2fe-86cc-4011-b610-94b69afc2a97 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bac2fe-86cc-4011-b610-94b69afc2a97 None admin] PATH_INFO: `/v3/users/f5d41d73590d4952bc69134aed9c80f0` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bac2fe-86cc-4011-b610-94b69afc2a97 None admin] RBAC: Authorizing `identity:delete_user(user_id=f5d41d73590d4952bc69134aed9c80f0)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bac2fe-86cc-4011-b610-94b69afc2a97 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-b7bac2fe-86cc-4011-b610-94b69afc2a97 None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5d41d73590d4952bc69134aed9c80f0', 'request_id': 'req-b7bac2fe-86cc-4011-b610-94b69afc2a97'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-b7bac2fe-86cc-4011-b610-94b69afc2a97 None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5d41d73590d4952bc69134aed9c80f0', 'request_id': 'req-b7bac2fe-86cc-4011-b610-94b69afc2a97'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-b7bac2fe-86cc-4011-b610-94b69afc2a97 None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5d41d73590d4952bc69134aed9c80f0', 'request_id': 'req-b7bac2fe-86cc-4011-b610-94b69afc2a97'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-b7bac2fe-86cc-4011-b610-94b69afc2a97 None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5d41d73590d4952bc69134aed9c80f0', 'request_id': 'req-b7bac2fe-86cc-4011-b610-94b69afc2a97'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-b7bac2fe-86cc-4011-b610-94b69afc2a97 None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5d41d73590d4952bc69134aed9c80f0', 'request_id': 'req-b7bac2fe-86cc-4011-b610-94b69afc2a97'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:36 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 978/1931] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 12:57:36 2024] DELETE /identity/v3/users/f5d41d73590d4952bc69134aed9c80f0 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:57:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3971d5c2-32ea-4417-8d3f-6a6d56ac8619 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3971d5c2-32ea-4417-8d3f-6a6d56ac8619 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3971d5c2-32ea-4417-8d3f-6a6d56ac8619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:36 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-3971d5c2-32ea-4417-8d3f-6a6d56ac8619 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:57:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-3971d5c2-32ea-4417-8d3f-6a6d56ac8619 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:57:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-3971d5c2-32ea-4417-8d3f-6a6d56ac8619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:36 l75lg1-v1 dstat.sh[49771]: 28-05 12:57:36| 10 2 86 2 0|5694M 1799M 277M 7855M| 16k 5666B| 0 2308k| 0 295 |7660 13k|1.59 1.06 1.01|2.0 1.0 0| 0 0 | 0 2048M| 29 356 0 70 0 May 28 12:57:36 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 954/1932] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:57:36 2024] POST /identity/v3/auth/tokens => generated 2960 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 12:57:36 l75lg1-v1 neutron-server[77619]: DEBUG neutron.wsgi [-] (77619) accepted ('10.27.203.238', 37750) {{(pid=77619) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 12:57:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bac2fe-86cc-4011-b610-94b69afc2a97 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-b7bac2fe-86cc-4011-b610-94b69afc2a97 None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:36 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a5b23709-72de-4efa-8cc5-29f19d0f7897 tempest-SharesMetadataTest-1561320255 None] <<< [GET] https://127.0.0.1:40443/api/quotas/ May 28 12:57:36 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a5b23709-72de-4efa-8cc5-29f19d0f7897 tempest-SharesMetadataTest-1561320255 None] [Bunch(cluster='loop75-kfs', cluster_id=1, default_email=None, default_group_quota=None, default_user_quota=None, enable_alarms=True, enable_email_providers=True, grace_period=None, guid='8e6fd8ce-aa33-4ab2-9148-729c0b02afdf', hard_limit=1073741824, hard_limit_inodes=None, id=16, internal=False, is_user_quota=False, last_user_quotas_update=None, name='2be2873c-4768-478e-a848-fb1d2654ca64', num_blocked_users=0, num_exceeded_users=0, path='/manila/manila-2be2873c-4768-478e-a848-fb1d2654ca64', percent_capacity=0, percent_inodes=None, pretty_grace_period=None, pretty_grace_period_expiration=None, pretty_state='OK (CREATED)', soft_limit=None, soft_limit_inodes=None, state='OK', sync_state='CREATED', system_id=16, tenant_id=1, tenant_name='default', time_to_block=None, title='2be2873c-4768-478e-a848-fb1d2654ca64', url='https://127.0.0.1:40443/api/quotas/16/', used_capacity=0, used_capacity_tb=0.0, used_effective_capacity=0, used_effective_capacity_tb=0.0, used_inodes=0, used_limited_capacity=0)] May 28 12:57:36 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a5b23709-72de-4efa-8cc5-29f19d0f7897 tempest-SharesMetadataTest-1561320255 None] --- [GET] https://127.0.0.1:40443/api/quotas/: Done May 28 12:57:36 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a5b23709-72de-4efa-8cc5-29f19d0f7897 tempest-SharesMetadataTest-1561320255 None] >>> [DELETE] https://127.0.0.1:40443/api/quotas/16/ May 28 12:57:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bac2fe-86cc-4011-b610-94b69afc2a97 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8775ac0e-47ae-4cd8-9da2-9f8320629e91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef17047035e4b518fd5360a01f2da1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8775ac0e-47ae-4cd8-9da2-9f8320629e91 service neutron] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8775ac0e-47ae-4cd8-9da2-9f8320629e91 service neutron] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8775ac0e-47ae-4cd8-9da2-9f8320629e91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8775ac0e-47ae-4cd8-9da2-9f8320629e91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8775ac0e-47ae-4cd8-9da2-9f8320629e91 service neutron] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:36 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 979/1933] 10.27.203.238 () {64 vars in 1432 bytes} [Tue May 28 12:57:36 2024] GET /identity/v3/auth/tokens => generated 2960 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 28 12:57:36 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-dc3912e6-0f44-43d4-a927-471d0ece9e49 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] GET http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/36ebac5b-70c6-4cc4-85fa-1acc9586628e May 28 12:57:36 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-dc3912e6-0f44-43d4-a927-471d0ece9e49 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:36 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-dc3912e6-0f44-43d4-a927-471d0ece9e49 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:36 l75lg1-v1 neutron-server[77619]: INFO neutron.wsgi [None req-9dd65a52-26de-482e-b847-84514837bf80 None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=dff252807b6b49bdad4fd85f22c29e5b&name=default HTTP/1.1" status: 200 len: 216 time: 0.0767088 May 28 12:57:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3971d5c2-32ea-4417-8d3f-6a6d56ac8619 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-3971d5c2-32ea-4417-8d3f-6a6d56ac8619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3971d5c2-32ea-4417-8d3f-6a6d56ac8619 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b606adb3-909a-4134-8b7b-ba4b0ffec470 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b606adb3-909a-4134-8b7b-ba4b0ffec470 None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b606adb3-909a-4134-8b7b-ba4b0ffec470 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b606adb3-909a-4134-8b7b-ba4b0ffec470 None admin] PATH_INFO: `/v3/projects/dff252807b6b49bdad4fd85f22c29e5b` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b606adb3-909a-4134-8b7b-ba4b0ffec470 None admin] RBAC: Authorizing `identity:delete_project(project_id=dff252807b6b49bdad4fd85f22c29e5b)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b606adb3-909a-4134-8b7b-ba4b0ffec470 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:36 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-dc3912e6-0f44-43d4-a927-471d0ece9e49 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/36ebac5b-70c6-4cc4-85fa-1acc9586628e returned with HTTP 200 May 28 12:57:36 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 375/736] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:57:36 2024] GET /share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/36ebac5b-70c6-4cc4-85fa-1acc9586628e => generated 1350 bytes in 28 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:57:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-b606adb3-909a-4134-8b7b-ba4b0ffec470 None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dff252807b6b49bdad4fd85f22c29e5b', 'request_id': 'req-b606adb3-909a-4134-8b7b-ba4b0ffec470'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-b606adb3-909a-4134-8b7b-ba4b0ffec470 None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dff252807b6b49bdad4fd85f22c29e5b', 'request_id': 'req-b606adb3-909a-4134-8b7b-ba4b0ffec470'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-b606adb3-909a-4134-8b7b-ba4b0ffec470 None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dff252807b6b49bdad4fd85f22c29e5b', 'request_id': 'req-b606adb3-909a-4134-8b7b-ba4b0ffec470'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-b606adb3-909a-4134-8b7b-ba4b0ffec470 None admin] The token cache is being invalidate because project dff252807b6b49bdad4fd85f22c29e5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 12:57:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-b606adb3-909a-4134-8b7b-ba4b0ffec470 None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-b606adb3-909a-4134-8b7b-ba4b0ffec470 None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:36 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 955/1934] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 12:57:36 2024] DELETE /identity/v3/projects/dff252807b6b49bdad4fd85f22c29e5b => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:57:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d6bbea-a3c2-4601-9592-f6f03778d112 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d6bbea-a3c2-4601-9592-f6f03778d112 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d6bbea-a3c2-4601-9592-f6f03778d112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:36 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-25d6bbea-a3c2-4601-9592-f6f03778d112 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:57:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-25d6bbea-a3c2-4601-9592-f6f03778d112 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:57:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-25d6bbea-a3c2-4601-9592-f6f03778d112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:36 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 980/1935] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:57:36 2024] POST /identity/v3/auth/tokens => generated 312 bytes in 22 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 28 12:57:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499286a8-dcc9-41a6-9e90-0261a6b10924 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499286a8-dcc9-41a6-9e90-0261a6b10924 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499286a8-dcc9-41a6-9e90-0261a6b10924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:36 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-499286a8-dcc9-41a6-9e90-0261a6b10924 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:57:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-499286a8-dcc9-41a6-9e90-0261a6b10924 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:57:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-499286a8-dcc9-41a6-9e90-0261a6b10924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:36 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 956/1936] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:57:36 2024] POST /identity/v3/auth/tokens => generated 2960 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 12:57:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d6bbea-a3c2-4601-9592-f6f03778d112 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d6bbea-a3c2-4601-9592-f6f03778d112 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12ed65c-92c3-46c7-9f79-edbf4894cf14 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12ed65c-92c3-46c7-9f79-edbf4894cf14 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12ed65c-92c3-46c7-9f79-edbf4894cf14 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12ed65c-92c3-46c7-9f79-edbf4894cf14 None admin] PATH_INFO: `/v3/domains` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12ed65c-92c3-46c7-9f79-edbf4894cf14 None admin] RBAC: Adding query filter params (name=Default) {{(pid=51267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:57:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12ed65c-92c3-46c7-9f79-edbf4894cf14 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12ed65c-92c3-46c7-9f79-edbf4894cf14 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:36 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 981/1937] 10.27.203.238 () {62 vars in 1220 bytes} [Tue May 28 12:57:36 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:57:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499286a8-dcc9-41a6-9e90-0261a6b10924 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499286a8-dcc9-41a6-9e90-0261a6b10924 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b229a7-333d-4afc-b603-55c031398d81 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b229a7-333d-4afc-b603-55c031398d81 None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b229a7-333d-4afc-b603-55c031398d81 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b229a7-333d-4afc-b603-55c031398d81 None admin] PATH_INFO: `/v3/projects` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b229a7-333d-4afc-b603-55c031398d81 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b229a7-333d-4afc-b603-55c031398d81 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:36 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 957/1938] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 12:57:36 2024] POST /identity/v3/projects => generated 365 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:57:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12ed65c-92c3-46c7-9f79-edbf4894cf14 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12ed65c-92c3-46c7-9f79-edbf4894cf14 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cef394-a4a5-4196-b6c3-d1ef4a467fde None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cef394-a4a5-4196-b6c3-d1ef4a467fde None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cef394-a4a5-4196-b6c3-d1ef4a467fde None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cef394-a4a5-4196-b6c3-d1ef4a467fde None admin] PATH_INFO: `/v3/users` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cef394-a4a5-4196-b6c3-d1ef4a467fde None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cef394-a4a5-4196-b6c3-d1ef4a467fde None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:36 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-c4cef394-a4a5-4196-b6c3-d1ef4a467fde None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 12:57:36 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 982/1939] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 12:57:36 2024] POST /identity/v3/users => generated 291 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:57:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b229a7-333d-4afc-b603-55c031398d81 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b229a7-333d-4afc-b603-55c031398d81 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6cf7e7-1ec2-4f0c-9ccd-db9689c366b9 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6cf7e7-1ec2-4f0c-9ccd-db9689c366b9 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6cf7e7-1ec2-4f0c-9ccd-db9689c366b9 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6cf7e7-1ec2-4f0c-9ccd-db9689c366b9 None admin] PATH_INFO: `/v3/roles` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6cf7e7-1ec2-4f0c-9ccd-db9689c366b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6cf7e7-1ec2-4f0c-9ccd-db9689c366b9 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:36 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 958/1940] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 12:57:36 2024] GET /identity/v3/roles => generated 1680 bytes in 17 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:57:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cef394-a4a5-4196-b6c3-d1ef4a467fde None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cef394-a4a5-4196-b6c3-d1ef4a467fde None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9c9d05-b5ea-416c-9a38-08ef23e85cc8 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9c9d05-b5ea-416c-9a38-08ef23e85cc8 None admin] REQUEST_METHOD: `PUT` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9c9d05-b5ea-416c-9a38-08ef23e85cc8 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9c9d05-b5ea-416c-9a38-08ef23e85cc8 None admin] PATH_INFO: `/v3/projects/480f011d09784daa9db3173a43309a4c/users/e53df3f8c4b743fb922d8349ce6ef944/roles/44620cad10ae407c90c91e2c296adb04` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9c9d05-b5ea-416c-9a38-08ef23e85cc8 None admin] RBAC: Authorizing `identity:create_grant(project_id=480f011d09784daa9db3173a43309a4c, user_id=e53df3f8c4b743fb922d8349ce6ef944, role_id=44620cad10ae407c90c91e2c296adb04)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9c9d05-b5ea-416c-9a38-08ef23e85cc8 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:36 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 983/1941] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 12:57:36 2024] PUT /identity/v3/projects/480f011d09784daa9db3173a43309a4c/users/e53df3f8c4b743fb922d8349ce6ef944/roles/44620cad10ae407c90c91e2c296adb04 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:57:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dcccd0-5ecb-445e-b7fd-60782f2a2910 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dcccd0-5ecb-445e-b7fd-60782f2a2910 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dcccd0-5ecb-445e-b7fd-60782f2a2910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:36 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-a9dcccd0-5ecb-445e-b7fd-60782f2a2910 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:57:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-a9dcccd0-5ecb-445e-b7fd-60782f2a2910 None None] MFA Rules not processed for user `e53df3f8c4b743fb922d8349ce6ef944`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:57:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-a9dcccd0-5ecb-445e-b7fd-60782f2a2910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:36 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 959/1942] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:57:36 2024] POST /identity/v3/auth/tokens => generated 3936 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:57:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9c9d05-b5ea-416c-9a38-08ef23e85cc8 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-3d9c9d05-b5ea-416c-9a38-08ef23e85cc8 None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9c9d05-b5ea-416c-9a38-08ef23e85cc8 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89329ebf-d0b1-49c1-8614-b994d29c0ab5 service manila] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f110cf6300f049c897d0aab63218d1e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89329ebf-d0b1-49c1-8614-b994d29c0ab5 service manila] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89329ebf-d0b1-49c1-8614-b994d29c0ab5 service manila] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89329ebf-d0b1-49c1-8614-b994d29c0ab5 service manila] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89329ebf-d0b1-49c1-8614-b994d29c0ab5 service manila] RBAC: Authorizing `identity:validate_token()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89329ebf-d0b1-49c1-8614-b994d29c0ab5 service manila] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:36 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 984/1943] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 12:57:36 2024] GET /identity/v3/auth/tokens => generated 3936 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 12:57:36 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-0838d489-1b91-4084-9a92-ff16ec882146 tempest-ExtensionsTest-420292269 tempest-ExtensionsTest-420292269-project-member] GET http://10.27.203.238/share/v1/480f011d09784daa9db3173a43309a4c/extensions May 28 12:57:36 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-0838d489-1b91-4084-9a92-ff16ec882146 tempest-ExtensionsTest-420292269 tempest-ExtensionsTest-420292269-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:36 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-0838d489-1b91-4084-9a92-ff16ec882146 tempest-ExtensionsTest-420292269 tempest-ExtensionsTest-420292269-project-member] Calling method 'ExtensionsResource.index' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:36 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-0838d489-1b91-4084-9a92-ff16ec882146 tempest-ExtensionsTest-420292269 tempest-ExtensionsTest-420292269-project-member] http://10.27.203.238/share/v1/480f011d09784daa9db3173a43309a4c/extensions returned with HTTP 200 May 28 12:57:36 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 362/737] 10.27.203.238 () {62 vars in 1309 bytes} [Tue May 28 12:57:36 2024] GET /share/v1/480f011d09784daa9db3173a43309a4c/extensions => generated 18 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 229 bytes (1 switches on core 0) May 28 12:57:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dcccd0-5ecb-445e-b7fd-60782f2a2910 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dcccd0-5ecb-445e-b7fd-60782f2a2910 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f152a82b-abf8-40b0-bb1e-dedd7da50332 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f152a82b-abf8-40b0-bb1e-dedd7da50332 None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f152a82b-abf8-40b0-bb1e-dedd7da50332 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f152a82b-abf8-40b0-bb1e-dedd7da50332 None admin] PATH_INFO: `/v3/users/e53df3f8c4b743fb922d8349ce6ef944` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f152a82b-abf8-40b0-bb1e-dedd7da50332 None admin] RBAC: Authorizing `identity:delete_user(user_id=e53df3f8c4b743fb922d8349ce6ef944)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f152a82b-abf8-40b0-bb1e-dedd7da50332 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-f152a82b-abf8-40b0-bb1e-dedd7da50332 None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e53df3f8c4b743fb922d8349ce6ef944', 'request_id': 'req-f152a82b-abf8-40b0-bb1e-dedd7da50332'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-f152a82b-abf8-40b0-bb1e-dedd7da50332 None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e53df3f8c4b743fb922d8349ce6ef944', 'request_id': 'req-f152a82b-abf8-40b0-bb1e-dedd7da50332'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-f152a82b-abf8-40b0-bb1e-dedd7da50332 None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e53df3f8c4b743fb922d8349ce6ef944', 'request_id': 'req-f152a82b-abf8-40b0-bb1e-dedd7da50332'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-f152a82b-abf8-40b0-bb1e-dedd7da50332 None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e53df3f8c4b743fb922d8349ce6ef944', 'request_id': 'req-f152a82b-abf8-40b0-bb1e-dedd7da50332'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-f152a82b-abf8-40b0-bb1e-dedd7da50332 None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e53df3f8c4b743fb922d8349ce6ef944', 'request_id': 'req-f152a82b-abf8-40b0-bb1e-dedd7da50332'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:37 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 960/1944] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 12:57:36 2024] DELETE /identity/v3/users/e53df3f8c4b743fb922d8349ce6ef944 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:57:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d79ede3-dbb0-45e0-bca2-bd0d844822e7 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d79ede3-dbb0-45e0-bca2-bd0d844822e7 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d79ede3-dbb0-45e0-bca2-bd0d844822e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:37 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-9d79ede3-dbb0-45e0-bca2-bd0d844822e7 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:57:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-9d79ede3-dbb0-45e0-bca2-bd0d844822e7 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:57:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-9d79ede3-dbb0-45e0-bca2-bd0d844822e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:37 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 985/1945] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:57:37 2024] POST /identity/v3/auth/tokens => generated 2960 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 12:57:37 l75lg1-v1 neutron-server[77619]: DEBUG neutron.wsgi [-] (77619) accepted ('10.27.203.238', 37752) {{(pid=77619) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 12:57:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f152a82b-abf8-40b0-bb1e-dedd7da50332 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-f152a82b-abf8-40b0-bb1e-dedd7da50332 None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f152a82b-abf8-40b0-bb1e-dedd7da50332 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a2a871-834b-40fb-b5d2-5162ecf98676 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef17047035e4b518fd5360a01f2da1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a2a871-834b-40fb-b5d2-5162ecf98676 service neutron] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a2a871-834b-40fb-b5d2-5162ecf98676 service neutron] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a2a871-834b-40fb-b5d2-5162ecf98676 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a2a871-834b-40fb-b5d2-5162ecf98676 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a2a871-834b-40fb-b5d2-5162ecf98676 service neutron] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:37 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 961/1946] 10.27.203.238 () {64 vars in 1432 bytes} [Tue May 28 12:57:37 2024] GET /identity/v3/auth/tokens => generated 2960 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 28 12:57:37 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-b5ae1470-a3c3-4aa4-94e2-5c50edca0889 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] GET http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/shares/0e109bad-1de4-4ba0-a890-7011220b44eb May 28 12:57:37 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-b5ae1470-a3c3-4aa4-94e2-5c50edca0889 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:37 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-b5ae1470-a3c3-4aa4-94e2-5c50edca0889 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:37 l75lg1-v1 neutron-server[77619]: INFO neutron.wsgi [None req-d25d1e33-2b9e-4236-a0da-82e9c5c74406 None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=480f011d09784daa9db3173a43309a4c&name=default HTTP/1.1" status: 200 len: 216 time: 0.0714846 May 28 12:57:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d79ede3-dbb0-45e0-bca2-bd0d844822e7 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-9d79ede3-dbb0-45e0-bca2-bd0d844822e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d79ede3-dbb0-45e0-bca2-bd0d844822e7 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:37 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-b5ae1470-a3c3-4aa4-94e2-5c50edca0889 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/shares/0e109bad-1de4-4ba0-a890-7011220b44eb returned with HTTP 200 May 28 12:57:37 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 376/738] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:57:37 2024] GET /share/v2/a3499cb78849424db45e54caac01de92/shares/0e109bad-1de4-4ba0-a890-7011220b44eb => generated 1372 bytes in 25 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:57:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028183b9-9b14-4c2c-8700-3d4748131e4c None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028183b9-9b14-4c2c-8700-3d4748131e4c None admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028183b9-9b14-4c2c-8700-3d4748131e4c None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028183b9-9b14-4c2c-8700-3d4748131e4c None admin] PATH_INFO: `/v3/projects/480f011d09784daa9db3173a43309a4c` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028183b9-9b14-4c2c-8700-3d4748131e4c None admin] RBAC: Authorizing `identity:delete_project(project_id=480f011d09784daa9db3173a43309a4c)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028183b9-9b14-4c2c-8700-3d4748131e4c None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:37 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-27da9a41-c24e-44a7-b79c-f0dc9efe58c6 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] GET http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/shares/0e109bad-1de4-4ba0-a890-7011220b44eb/instances May 28 12:57:37 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-27da9a41-c24e-44a7-b79c-f0dc9efe58c6 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:37 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-27da9a41-c24e-44a7-b79c-f0dc9efe58c6 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:37 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-27da9a41-c24e-44a7-b79c-f0dc9efe58c6 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/shares/0e109bad-1de4-4ba0-a890-7011220b44eb/instances returned with HTTP 200 May 28 12:57:37 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 363/739] 10.27.203.238 () {64 vars in 1481 bytes} [Tue May 28 12:57:37 2024] GET /share/v2/a3499cb78849424db45e54caac01de92/shares/0e109bad-1de4-4ba0-a890-7011220b44eb/instances => generated 509 bytes in 26 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:57:37 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-befde4c9-2406-425d-97b6-9380531f47ab tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] POST http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/share_instances/724bc53b-1c28-4ab1-b3c8-ab90f868473d/action May 28 12:57:37 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-befde4c9-2406-425d-97b6-9380531f47ab tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Action body: b'{"reset_status": {"status": "error_deleting"}}' {{(pid=98329) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:57:37 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-befde4c9-2406-425d-97b6-9380531f47ab tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Action: 'action', calling method: ShareInstancesController.instance_reset_status, body: {"reset_status": {"status": "error_deleting"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:57:37 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-befde4c9-2406-425d-97b6-9380531f47ab tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Updating share_instance '724bc53b-1c28-4ab1-b3c8-ab90f868473d' with '{'status': 'error_deleting'}' {{(pid=98329) _reset_status /opt/stack/manila/manila/api/openstack/wsgi.py:1257}} May 28 12:57:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-028183b9-9b14-4c2c-8700-3d4748131e4c None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '480f011d09784daa9db3173a43309a4c', 'request_id': 'req-028183b9-9b14-4c2c-8700-3d4748131e4c'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-028183b9-9b14-4c2c-8700-3d4748131e4c None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '480f011d09784daa9db3173a43309a4c', 'request_id': 'req-028183b9-9b14-4c2c-8700-3d4748131e4c'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-028183b9-9b14-4c2c-8700-3d4748131e4c None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '480f011d09784daa9db3173a43309a4c', 'request_id': 'req-028183b9-9b14-4c2c-8700-3d4748131e4c'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:37 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-befde4c9-2406-425d-97b6-9380531f47ab tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/share_instances/724bc53b-1c28-4ab1-b3c8-ab90f868473d/action returned with HTTP 202 May 28 12:57:37 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 377/740] 10.27.203.238 () {66 vars in 1520 bytes} [Tue May 28 12:57:37 2024] POST /share/v2/a3499cb78849424db45e54caac01de92/share_instances/724bc53b-1c28-4ab1-b3c8-ab90f868473d/action => generated 0 bytes in 42 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:57:37 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-1deae73c-8617-446f-a065-9cc320d96d06 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] GET http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/share_instances/724bc53b-1c28-4ab1-b3c8-ab90f868473d May 28 12:57:37 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-1deae73c-8617-446f-a065-9cc320d96d06 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-028183b9-9b14-4c2c-8700-3d4748131e4c None admin] The token cache is being invalidate because project 480f011d09784daa9db3173a43309a4c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 12:57:37 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-1deae73c-8617-446f-a065-9cc320d96d06 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-028183b9-9b14-4c2c-8700-3d4748131e4c None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-028183b9-9b14-4c2c-8700-3d4748131e4c None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:37 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 986/1947] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 12:57:37 2024] DELETE /identity/v3/projects/480f011d09784daa9db3173a43309a4c => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:57:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e98a54-196f-44b0-b994-b5ae8b8ddaf9 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e98a54-196f-44b0-b994-b5ae8b8ddaf9 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e98a54-196f-44b0-b994-b5ae8b8ddaf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:37 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-1deae73c-8617-446f-a065-9cc320d96d06 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/share_instances/724bc53b-1c28-4ab1-b3c8-ab90f868473d returned with HTTP 200 May 28 12:57:37 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 364/741] 10.27.203.238 () {64 vars in 1478 bytes} [Tue May 28 12:57:37 2024] GET /share/v2/a3499cb78849424db45e54caac01de92/share_instances/724bc53b-1c28-4ab1-b3c8-ab90f868473d => generated 511 bytes in 16 msecs (HTTP/1.1 200) 6 headers in 231 bytes (2 switches on core 0) May 28 12:57:37 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-f6784d36-6966-4d0d-8f96-f818219fe4a4 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] POST http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/share_instances/724bc53b-1c28-4ab1-b3c8-ab90f868473d/action May 28 12:57:37 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-f6784d36-6966-4d0d-8f96-f818219fe4a4 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Action body: b'{"force_delete": null}' {{(pid=98329) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:57:37 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-f6784d36-6966-4d0d-8f96-f818219fe4a4 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Action: 'action', calling method: ShareInstancesController.instance_force_delete, body: {"force_delete": null} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:57:37 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-d3e98a54-196f-44b0-b994-b5ae8b8ddaf9 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:57:37 l75lg1-v1 dstat.sh[49771]: 28-05 12:57:37| 12 2 82 4 0|5695M 1799M 277M 7855M| 26k 2172B| 0 6928k| 0 560 |8486 14k|1.63 1.08 1.02|3.0 0 0| 0 0 | 0 2048M| 29 357 0 67 0 May 28 12:57:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-d3e98a54-196f-44b0-b994-b5ae8b8ddaf9 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:57:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-d3e98a54-196f-44b0-b994-b5ae8b8ddaf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:37 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 962/1948] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:57:37 2024] POST /identity/v3/auth/tokens => generated 312 bytes in 20 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 28 12:57:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60934f2d-45e6-443f-b8cc-90d331351a50 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60934f2d-45e6-443f-b8cc-90d331351a50 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60934f2d-45e6-443f-b8cc-90d331351a50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:37 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-60934f2d-45e6-443f-b8cc-90d331351a50 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:57:37 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-f6784d36-6966-4d0d-8f96-f818219fe4a4 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/share_instances/724bc53b-1c28-4ab1-b3c8-ab90f868473d/action returned with HTTP 202 May 28 12:57:37 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 378/742] 10.27.203.238 () {66 vars in 1520 bytes} [Tue May 28 12:57:37 2024] POST /share/v2/a3499cb78849424db45e54caac01de92/share_instances/724bc53b-1c28-4ab1-b3c8-ab90f868473d/action => generated 0 bytes in 33 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:57:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-60934f2d-45e6-443f-b8cc-90d331351a50 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:57:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-60934f2d-45e6-443f-b8cc-90d331351a50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:37 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-d215f91d-6e2d-44f2-a338-9691ed82c8d5 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] GET http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/share_instances/724bc53b-1c28-4ab1-b3c8-ab90f868473d May 28 12:57:37 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-d215f91d-6e2d-44f2-a338-9691ed82c8d5 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:37 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-d215f91d-6e2d-44f2-a338-9691ed82c8d5 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:37 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-d215f91d-6e2d-44f2-a338-9691ed82c8d5 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/share_instances/724bc53b-1c28-4ab1-b3c8-ab90f868473d returned with HTTP 200 May 28 12:57:37 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 365/743] 10.27.203.238 () {64 vars in 1478 bytes} [Tue May 28 12:57:37 2024] GET /share/v2/a3499cb78849424db45e54caac01de92/share_instances/724bc53b-1c28-4ab1-b3c8-ab90f868473d => generated 505 bytes in 14 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:57:37 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 987/1949] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:57:37 2024] POST /identity/v3/auth/tokens => generated 2960 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 12:57:37 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-b37fe9fc-f692-47ae-99ad-e4aa8dfb5cdd tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] GET http://10.27.203.238/share/v2/fe54df7c653849ab8ec7523262c597cf/shares/7da650db-1124-40b5-ba52-fb1170c038c8 May 28 12:57:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e98a54-196f-44b0-b994-b5ae8b8ddaf9 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:37 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-b37fe9fc-f692-47ae-99ad-e4aa8dfb5cdd tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:37 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-b37fe9fc-f692-47ae-99ad-e4aa8dfb5cdd tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e98a54-196f-44b0-b994-b5ae8b8ddaf9 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1dd8f6-6833-4f8a-896e-c5682f7b5d57 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1dd8f6-6833-4f8a-896e-c5682f7b5d57 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1dd8f6-6833-4f8a-896e-c5682f7b5d57 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1dd8f6-6833-4f8a-896e-c5682f7b5d57 None admin] PATH_INFO: `/v3/domains` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1dd8f6-6833-4f8a-896e-c5682f7b5d57 None admin] RBAC: Adding query filter params (name=Default) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:57:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1dd8f6-6833-4f8a-896e-c5682f7b5d57 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1dd8f6-6833-4f8a-896e-c5682f7b5d57 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:37 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-b37fe9fc-f692-47ae-99ad-e4aa8dfb5cdd tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] http://10.27.203.238/share/v2/fe54df7c653849ab8ec7523262c597cf/shares/7da650db-1124-40b5-ba52-fb1170c038c8 returned with HTTP 200 May 28 12:57:37 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 379/744] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:57:37 2024] GET /share/v2/fe54df7c653849ab8ec7523262c597cf/shares/7da650db-1124-40b5-ba52-fb1170c038c8 => generated 1475 bytes in 29 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:57:37 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 963/1950] 10.27.203.238 () {62 vars in 1220 bytes} [Tue May 28 12:57:37 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:57:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60934f2d-45e6-443f-b8cc-90d331351a50 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60934f2d-45e6-443f-b8cc-90d331351a50 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:37 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-f6784d36-6966-4d0d-8f96-f818219fe4a4 tempest-AdminActionsTest-1749172189 None] Acquiring lock "locked_access_rules_operation_by_share_instance_724bc53b-1c28-4ab1-b3c8-ab90f868473d" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:57:37 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-f6784d36-6966-4d0d-8f96-f818219fe4a4 tempest-AdminActionsTest-1749172189 None] Lock "locked_access_rules_operation_by_share_instance_724bc53b-1c28-4ab1-b3c8-ab90f868473d" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:57:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3685842b-ae40-4dad-a221-c17a79cb1918 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3685842b-ae40-4dad-a221-c17a79cb1918 None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3685842b-ae40-4dad-a221-c17a79cb1918 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3685842b-ae40-4dad-a221-c17a79cb1918 None admin] PATH_INFO: `/v3/projects` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3685842b-ae40-4dad-a221-c17a79cb1918 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3685842b-ae40-4dad-a221-c17a79cb1918 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:37 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-f6784d36-6966-4d0d-8f96-f818219fe4a4 tempest-AdminActionsTest-1749172189 None] Lock "locked_access_rules_operation_by_share_instance_724bc53b-1c28-4ab1-b3c8-ab90f868473d" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:57:37 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-f6784d36-6966-4d0d-8f96-f818219fe4a4 tempest-AdminActionsTest-1749172189 None] Acquiring lock "locked_access_rules_operation_by_share_instance_724bc53b-1c28-4ab1-b3c8-ab90f868473d" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:57:37 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-f6784d36-6966-4d0d-8f96-f818219fe4a4 tempest-AdminActionsTest-1749172189 None] Lock "locked_access_rules_operation_by_share_instance_724bc53b-1c28-4ab1-b3c8-ab90f868473d" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:57:37 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-f6784d36-6966-4d0d-8f96-f818219fe4a4 tempest-AdminActionsTest-1749172189 None] Lock "locked_access_rules_operation_by_share_instance_724bc53b-1c28-4ab1-b3c8-ab90f868473d" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:57:37 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-f6784d36-6966-4d0d-8f96-f818219fe4a4 tempest-AdminActionsTest-1749172189 None] Acquiring lock "locked_access_rules_operation_by_share_instance_724bc53b-1c28-4ab1-b3c8-ab90f868473d" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:57:37 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-f6784d36-6966-4d0d-8f96-f818219fe4a4 tempest-AdminActionsTest-1749172189 None] Lock "locked_access_rules_operation_by_share_instance_724bc53b-1c28-4ab1-b3c8-ab90f868473d" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:57:37 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-f6784d36-6966-4d0d-8f96-f818219fe4a4 tempest-AdminActionsTest-1749172189 None] Lock "locked_access_rules_operation_by_share_instance_724bc53b-1c28-4ab1-b3c8-ab90f868473d" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:57:37 l75lg1-v1 manila-share[98474]: DEBUG manila.share.access [None req-f6784d36-6966-4d0d-8f96-f818219fe4a4 tempest-AdminActionsTest-1749172189 None] All access rules have been synced for share instance 724bc53b-1c28-4ab1-b3c8-ab90f868473d belonging to share 0e109bad-1de4-4ba0-a890-7011220b44eb. {{(pid=98474) update_access_rules /opt/stack/manila/manila/share/access.py:304}} May 28 12:57:37 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-f6784d36-6966-4d0d-8f96-f818219fe4a4 tempest-AdminActionsTest-1749172189 None] deleting '/manila/manila-724bc53b-1c28-4ab1-b3c8-ab90f868473d' May 28 12:57:37 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f6784d36-6966-4d0d-8f96-f818219fe4a4 tempest-AdminActionsTest-1749172189 None] >>> [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/ May 28 12:57:37 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f6784d36-6966-4d0d-8f96-f818219fe4a4 tempest-AdminActionsTest-1749172189 None] {'data': '{"path": "/manila/manila-724bc53b-1c28-4ab1-b3c8-ab90f868473d"}', May 28 12:57:37 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f6784d36-6966-4d0d-8f96-f818219fe4a4 tempest-AdminActionsTest-1749172189 None] 'params': None} May 28 12:57:37 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 988/1951] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 12:57:37 2024] POST /identity/v3/projects => generated 371 bytes in 33 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:57:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1dd8f6-6833-4f8a-896e-c5682f7b5d57 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1dd8f6-6833-4f8a-896e-c5682f7b5d57 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce758380-2309-4239-8e16-665bd0437dc1 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce758380-2309-4239-8e16-665bd0437dc1 None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce758380-2309-4239-8e16-665bd0437dc1 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce758380-2309-4239-8e16-665bd0437dc1 None admin] PATH_INFO: `/v3/users` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce758380-2309-4239-8e16-665bd0437dc1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce758380-2309-4239-8e16-665bd0437dc1 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:37 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-ce758380-2309-4239-8e16-665bd0437dc1 None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 12:57:37 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 964/1952] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 12:57:37 2024] POST /identity/v3/users => generated 294 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:57:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3685842b-ae40-4dad-a221-c17a79cb1918 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3685842b-ae40-4dad-a221-c17a79cb1918 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:37 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f6784d36-6966-4d0d-8f96-f818219fe4a4 tempest-AdminActionsTest-1749172189 None] <<< [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/ May 28 12:57:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e8ef19-2593-4f8b-8758-0e6e12be65a5 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:37 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f6784d36-6966-4d0d-8f96-f818219fe4a4 tempest-AdminActionsTest-1749172189 None] 'OK' May 28 12:57:37 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f6784d36-6966-4d0d-8f96-f818219fe4a4 tempest-AdminActionsTest-1749172189 None] --- [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/: Done May 28 12:57:37 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f6784d36-6966-4d0d-8f96-f818219fe4a4 tempest-AdminActionsTest-1749172189 None] >>> [GET] https://127.0.0.1:40443/api/views/ May 28 12:57:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e8ef19-2593-4f8b-8758-0e6e12be65a5 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e8ef19-2593-4f8b-8758-0e6e12be65a5 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:37 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f6784d36-6966-4d0d-8f96-f818219fe4a4 tempest-AdminActionsTest-1749172189 None] {'allow_redirects': True, May 28 12:57:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e8ef19-2593-4f8b-8758-0e6e12be65a5 None admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:37 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f6784d36-6966-4d0d-8f96-f818219fe4a4 tempest-AdminActionsTest-1749172189 None] 'params': {'name': '724bc53b-1c28-4ab1-b3c8-ab90f868473d'}} May 28 12:57:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e8ef19-2593-4f8b-8758-0e6e12be65a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e8ef19-2593-4f8b-8758-0e6e12be65a5 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:37 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 989/1953] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 12:57:37 2024] GET /identity/v3/roles => generated 1680 bytes in 18 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:57:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce758380-2309-4239-8e16-665bd0437dc1 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce758380-2309-4239-8e16-665bd0437dc1 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ce9718-00ae-4dc6-9a4f-8cb8cba84ceb None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ce9718-00ae-4dc6-9a4f-8cb8cba84ceb None admin] REQUEST_METHOD: `PUT` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ce9718-00ae-4dc6-9a4f-8cb8cba84ceb None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ce9718-00ae-4dc6-9a4f-8cb8cba84ceb None admin] PATH_INFO: `/v3/projects/954e6ba3ee0543b29788f581bbd961f2/users/fd36a0805fe442beac8a7dc17ebb7cb0/roles/44620cad10ae407c90c91e2c296adb04` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ce9718-00ae-4dc6-9a4f-8cb8cba84ceb None admin] RBAC: Authorizing `identity:create_grant(project_id=954e6ba3ee0543b29788f581bbd961f2, user_id=fd36a0805fe442beac8a7dc17ebb7cb0, role_id=44620cad10ae407c90c91e2c296adb04)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ce9718-00ae-4dc6-9a4f-8cb8cba84ceb None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:37 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 965/1954] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 12:57:37 2024] PUT /identity/v3/projects/954e6ba3ee0543b29788f581bbd961f2/users/fd36a0805fe442beac8a7dc17ebb7cb0/roles/44620cad10ae407c90c91e2c296adb04 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:57:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39db9d18-8b9a-48ec-a732-29c157497d7e None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39db9d18-8b9a-48ec-a732-29c157497d7e None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39db9d18-8b9a-48ec-a732-29c157497d7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:37 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1a206104-3ae2-40d4-ad11-73c0d9107322 tempest-SharesActionsAdminTest-1286316336 None] <<< [DELETE] https://127.0.0.1:40443/api/quotas/12/ May 28 12:57:37 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1a206104-3ae2-40d4-ad11-73c0d9107322 tempest-SharesActionsAdminTest-1286316336 None] --- [DELETE] https://127.0.0.1:40443/api/quotas/12/: Done May 28 12:57:37 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1a206104-3ae2-40d4-ad11-73c0d9107322 tempest-SharesActionsAdminTest-1286316336 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:57:37 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1a206104-3ae2-40d4-ad11-73c0d9107322 tempest-SharesActionsAdminTest-1286316336 None] {'allow_redirects': True, May 28 12:57:37 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1a206104-3ae2-40d4-ad11-73c0d9107322 tempest-SharesActionsAdminTest-1286316336 None] 'params': {'name': '7c19614c-d968-4489-b2ad-bd88c2ef8054'}} May 28 12:57:37 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-39db9d18-8b9a-48ec-a732-29c157497d7e None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:57:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-39db9d18-8b9a-48ec-a732-29c157497d7e None None] MFA Rules not processed for user `fd36a0805fe442beac8a7dc17ebb7cb0`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:57:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-39db9d18-8b9a-48ec-a732-29c157497d7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:37 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 990/1955] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:57:37 2024] POST /identity/v3/auth/tokens => generated 3942 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:57:37 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-d215f91d-6e2d-44f2-a338-9691ed82c8d5 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] GET http://10.27.203.238/share// May 28 12:57:37 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-d215f91d-6e2d-44f2-a338-9691ed82c8d5 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:37 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-d215f91d-6e2d-44f2-a338-9691ed82c8d5 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Calling method 'VersionsController.all' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:37 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-d215f91d-6e2d-44f2-a338-9691ed82c8d5 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share// returned with HTTP 300 May 28 12:57:37 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 366/745] 10.27.203.238 () {62 vars in 1172 bytes} [Tue May 28 12:57:37 2024] GET /share/ => generated 752 bytes in 7 msecs (HTTP/1.1 300) 3 headers in 105 bytes (1 switches on core 0) May 28 12:57:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697770b7-33dd-455e-9f6b-02157fd3428f None None] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697770b7-33dd-455e-9f6b-02157fd3428f None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697770b7-33dd-455e-9f6b-02157fd3428f None None] PATH_INFO: `/` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:37 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 966/1956] 10.27.203.238 () {58 vars in 1052 bytes} [Tue May 28 12:57:37 2024] GET /identity => generated 272 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 236 bytes (1 switches on core 0) May 28 12:57:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cdb75e-7912-4316-8e3b-8f2c3c841198 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cdb75e-7912-4316-8e3b-8f2c3c841198 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cdb75e-7912-4316-8e3b-8f2c3c841198 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:37 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-02cdb75e-7912-4316-8e3b-8f2c3c841198 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:57:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-02cdb75e-7912-4316-8e3b-8f2c3c841198 None None] MFA Rules not processed for user `f110cf6300f049c897d0aab63218d1e5`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:57:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-02cdb75e-7912-4316-8e3b-8f2c3c841198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:37 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 991/1957] 10.27.203.238 () {62 vars in 1149 bytes} [Tue May 28 12:57:37 2024] POST /identity/v3/auth/tokens => generated 3809 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:57:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697770b7-33dd-455e-9f6b-02157fd3428f None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697770b7-33dd-455e-9f6b-02157fd3428f None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73019f8c-3c57-470c-a1c4-49cfec443b48 service manila] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f110cf6300f049c897d0aab63218d1e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73019f8c-3c57-470c-a1c4-49cfec443b48 service manila] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73019f8c-3c57-470c-a1c4-49cfec443b48 service manila] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73019f8c-3c57-470c-a1c4-49cfec443b48 service manila] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73019f8c-3c57-470c-a1c4-49cfec443b48 service manila] RBAC: Authorizing `identity:validate_token()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73019f8c-3c57-470c-a1c4-49cfec443b48 service manila] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:37 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 967/1958] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 12:57:37 2024] GET /identity/v3/auth/tokens => generated 3942 bytes in 23 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 12:57:37 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-25784f5c-da28-4b42-b884-b00529b87b89 tempest-MicroversionsTest-651130726 tempest-MicroversionsTest-651130726-project-member] GET http://10.27.203.238/share/v1/ May 28 12:57:37 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-25784f5c-da28-4b42-b884-b00529b87b89 tempest-MicroversionsTest-651130726 tempest-MicroversionsTest-651130726-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:37 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-25784f5c-da28-4b42-b884-b00529b87b89 tempest-MicroversionsTest-651130726 tempest-MicroversionsTest-651130726-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:37 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-25784f5c-da28-4b42-b884-b00529b87b89 tempest-MicroversionsTest-651130726 tempest-MicroversionsTest-651130726-project-member] http://10.27.203.238/share/v1/ returned with HTTP 200 May 28 12:57:37 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 380/746] 10.27.203.238 () {62 vars in 1180 bytes} [Tue May 28 12:57:37 2024] GET /share/v1/ => generated 381 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:57:37 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-e6ac10a7-8101-44cb-943c-4b3f22245333 tempest-MicroversionsTest-651130726 tempest-MicroversionsTest-651130726-project-member] GET http://10.27.203.238/share/v1/ May 28 12:57:37 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-e6ac10a7-8101-44cb-943c-4b3f22245333 tempest-MicroversionsTest-651130726 tempest-MicroversionsTest-651130726-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:37 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-e6ac10a7-8101-44cb-943c-4b3f22245333 tempest-MicroversionsTest-651130726 tempest-MicroversionsTest-651130726-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:37 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-e6ac10a7-8101-44cb-943c-4b3f22245333 tempest-MicroversionsTest-651130726 tempest-MicroversionsTest-651130726-project-member] http://10.27.203.238/share/v1/ returned with HTTP 200 May 28 12:57:37 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 367/747] 10.27.203.238 () {64 vars in 1222 bytes} [Tue May 28 12:57:37 2024] GET /share/v1/ => generated 381 bytes in 4 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:57:37 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-d97a14d6-e9e6-4741-9a3a-e4929550354a tempest-MicroversionsTest-651130726 tempest-MicroversionsTest-651130726-project-member] GET http://10.27.203.238/share/v2/ May 28 12:57:37 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 381/748] 10.27.203.238 () {64 vars in 1224 bytes} [Tue May 28 12:57:37 2024] GET /share/v2/ => generated 127 bytes in 3 msecs (HTTP/1.1 400) 4 headers in 164 bytes (1 switches on core 0) May 28 12:57:37 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-23ee0092-d6db-4e18-963a-12299f76aca4 tempest-MicroversionsTest-651130726 tempest-MicroversionsTest-651130726-project-member] GET http://10.27.203.238/share/v2/ May 28 12:57:37 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-23ee0092-d6db-4e18-963a-12299f76aca4 tempest-MicroversionsTest-651130726 tempest-MicroversionsTest-651130726-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:37 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-23ee0092-d6db-4e18-963a-12299f76aca4 tempest-MicroversionsTest-651130726 tempest-MicroversionsTest-651130726-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:37 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-23ee0092-d6db-4e18-963a-12299f76aca4 tempest-MicroversionsTest-651130726 tempest-MicroversionsTest-651130726-project-member] http://10.27.203.238/share/v2/ returned with HTTP 200 May 28 12:57:37 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 368/749] 10.27.203.238 () {64 vars in 1223 bytes} [Tue May 28 12:57:37 2024] GET /share/v2/ => generated 385 bytes in 4 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:57:37 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-c007049b-80a5-468b-b52d-9be2082e7f3b tempest-MicroversionsTest-651130726 tempest-MicroversionsTest-651130726-project-member] GET http://10.27.203.238/share/v2/ May 28 12:57:37 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-c007049b-80a5-468b-b52d-9be2082e7f3b tempest-MicroversionsTest-651130726 tempest-MicroversionsTest-651130726-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:37 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-c007049b-80a5-468b-b52d-9be2082e7f3b tempest-MicroversionsTest-651130726 tempest-MicroversionsTest-651130726-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:37 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-c007049b-80a5-468b-b52d-9be2082e7f3b tempest-MicroversionsTest-651130726 tempest-MicroversionsTest-651130726-project-member] http://10.27.203.238/share/v2/ returned with HTTP 200 May 28 12:57:37 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 382/750] 10.27.203.238 () {64 vars in 1222 bytes} [Tue May 28 12:57:37 2024] GET /share/v2/ => generated 385 bytes in 4 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:57:37 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-13093cd6-f07f-4ce7-b61e-58f8052aa819 tempest-MicroversionsTest-651130726 tempest-MicroversionsTest-651130726-project-member] GET http://10.27.203.238/share/v2/ May 28 12:57:37 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-13093cd6-f07f-4ce7-b61e-58f8052aa819 tempest-MicroversionsTest-651130726 tempest-MicroversionsTest-651130726-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:37 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-13093cd6-f07f-4ce7-b61e-58f8052aa819 tempest-MicroversionsTest-651130726 tempest-MicroversionsTest-651130726-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:37 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-13093cd6-f07f-4ce7-b61e-58f8052aa819 tempest-MicroversionsTest-651130726 tempest-MicroversionsTest-651130726-project-member] http://10.27.203.238/share/v2/ returned with HTTP 200 May 28 12:57:37 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 369/751] 10.27.203.238 () {62 vars in 1180 bytes} [Tue May 28 12:57:37 2024] GET /share/v2/ => generated 385 bytes in 4 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:57:37 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-96f2879d-5c69-48b8-b23c-796fac44ab16 tempest-MicroversionsTest-651130726 tempest-MicroversionsTest-651130726-project-member] GET http://10.27.203.238/share/v2/ May 28 12:57:37 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-96f2879d-5c69-48b8-b23c-796fac44ab16 tempest-MicroversionsTest-651130726 tempest-MicroversionsTest-651130726-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:37 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-96f2879d-5c69-48b8-b23c-796fac44ab16 tempest-MicroversionsTest-651130726 tempest-MicroversionsTest-651130726-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:37 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-96f2879d-5c69-48b8-b23c-796fac44ab16 tempest-MicroversionsTest-651130726 tempest-MicroversionsTest-651130726-project-member] http://10.27.203.238/share/v2/ returned with HTTP 200 May 28 12:57:37 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 383/752] 10.27.203.238 () {62 vars in 1180 bytes} [Tue May 28 12:57:37 2024] GET /share/v2/ => generated 385 bytes in 4 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:57:37 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-85a7ba13-180d-4566-a232-759feb997d07 tempest-MicroversionsTest-651130726 tempest-MicroversionsTest-651130726-project-member] GET http://10.27.203.238/share/v2/ May 28 12:57:37 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 370/753] 10.27.203.238 () {64 vars in 1223 bytes} [Tue May 28 12:57:37 2024] GET /share/v2/ => generated 123 bytes in 3 msecs (HTTP/1.1 406) 6 headers in 243 bytes (2 switches on core 0) May 28 12:57:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cdb75e-7912-4316-8e3b-8f2c3c841198 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cdb75e-7912-4316-8e3b-8f2c3c841198 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97e5f6e-1ad1-4929-ad18-b2b350090bbb None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97e5f6e-1ad1-4929-ad18-b2b350090bbb None admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97e5f6e-1ad1-4929-ad18-b2b350090bbb None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97e5f6e-1ad1-4929-ad18-b2b350090bbb None admin] PATH_INFO: `/v3/users/fd36a0805fe442beac8a7dc17ebb7cb0` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97e5f6e-1ad1-4929-ad18-b2b350090bbb None admin] RBAC: Authorizing `identity:delete_user(user_id=fd36a0805fe442beac8a7dc17ebb7cb0)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97e5f6e-1ad1-4929-ad18-b2b350090bbb None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:37 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f6784d36-6966-4d0d-8f96-f818219fe4a4 tempest-AdminActionsTest-1749172189 None] <<< [GET] https://127.0.0.1:40443/api/views/ May 28 12:57:37 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f6784d36-6966-4d0d-8f96-f818219fe4a4 tempest-AdminActionsTest-1749172189 None] [Bunch(abac_tags=[], abe_max_depth=None, abe_protocols=[], alias='', allow_anonymous_access=False, allow_s3_anonymous_access=False, auto_commit='0d', bucket='', bucket_creators=[], bucket_creators_groups=[], bucket_owner=None, bulk_permission_update_progress=None, bulk_permission_update_state=None, cluster='loop75-kfs', cluster_id=1, created='2024-05-28T12:57:35.351565Z', enabled=True, files_retention_mode='NONE', guid='cb44dd7a-3d70-4e01-99f0-f132fdaeba68', id=19, ignore_oos=False, internal=False, is_remote=False, is_seamless=False, logical_capacity=0, max_retention_period=None, min_retention_period=None, name='724bc53b-1c28-4ab1-b3c8-ab90f868473d', nfs_interop_flags='BOTH_NFS3_AND_NFS4_INTEROP_DISABLED', path='/manila/manila-724bc53b-1c28-4ab1-b3c8-ab90f868473d', physical_capacity=0, policy='724bc53b-1c28-4ab1-b3c8-ab90f868473d', policy_id=20, protocols=['NFS'], qos_policy=None, qos_policy_id=None, s3_locks=False, s3_locks_retention_mode='NONE', s3_locks_retention_period='', s3_unverified_lookup=False, s3_versioning=False, select_for_live_monitoring=False, share='', share_acl=Bunch(acl=[], enabled=False), sync='SYNCED', sync_time='2024-05-28T12:57:35.616568Z', tenant_id=1, tenant_name='default', title='/manila/manila-724bc53b-1c28-4ab1-b3c8-ab90f868473d', url='https://127.0.0.1:40443/api/views/19/')] May 28 12:57:37 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f6784d36-6966-4d0d-8f96-f818219fe4a4 tempest-AdminActionsTest-1749172189 None] --- [GET] https://127.0.0.1:40443/api/views/: Done May 28 12:57:37 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f6784d36-6966-4d0d-8f96-f818219fe4a4 tempest-AdminActionsTest-1749172189 None] >>> [DELETE] https://127.0.0.1:40443/api/views/19/ May 28 12:57:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-d97e5f6e-1ad1-4929-ad18-b2b350090bbb None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd36a0805fe442beac8a7dc17ebb7cb0', 'request_id': 'req-d97e5f6e-1ad1-4929-ad18-b2b350090bbb'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:37 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1a206104-3ae2-40d4-ad11-73c0d9107322 tempest-SharesActionsAdminTest-1286316336 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:57:37 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1a206104-3ae2-40d4-ad11-73c0d9107322 tempest-SharesActionsAdminTest-1286316336 None] [Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=0, created='2024-05-28T12:57:15.736653Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='268e982f-5193-45fa-a88b-ed0fd523938d', id=15, internal=False, is_s3_default_policy=False, name='7c19614c-d968-4489-b2ad-bd88c2ef8054', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=[], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['*'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['*'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T12:57:16.085300Z', tenant_id=1, tenant_name='default', title='7c19614c-d968-4489-b2ad-bd88c2ef8054', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/15/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[])] May 28 12:57:37 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1a206104-3ae2-40d4-ad11-73c0d9107322 tempest-SharesActionsAdminTest-1286316336 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 12:57:37 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1a206104-3ae2-40d4-ad11-73c0d9107322 tempest-SharesActionsAdminTest-1286316336 None] >>> [DELETE] https://127.0.0.1:40443/api/viewpolicies/15/ May 28 12:57:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-d97e5f6e-1ad1-4929-ad18-b2b350090bbb None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd36a0805fe442beac8a7dc17ebb7cb0', 'request_id': 'req-d97e5f6e-1ad1-4929-ad18-b2b350090bbb'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-d97e5f6e-1ad1-4929-ad18-b2b350090bbb None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd36a0805fe442beac8a7dc17ebb7cb0', 'request_id': 'req-d97e5f6e-1ad1-4929-ad18-b2b350090bbb'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-d97e5f6e-1ad1-4929-ad18-b2b350090bbb None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd36a0805fe442beac8a7dc17ebb7cb0', 'request_id': 'req-d97e5f6e-1ad1-4929-ad18-b2b350090bbb'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-d97e5f6e-1ad1-4929-ad18-b2b350090bbb None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd36a0805fe442beac8a7dc17ebb7cb0', 'request_id': 'req-d97e5f6e-1ad1-4929-ad18-b2b350090bbb'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:37 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 992/1959] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 12:57:37 2024] DELETE /identity/v3/users/fd36a0805fe442beac8a7dc17ebb7cb0 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:57:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78003f1d-c161-41ac-afb8-8913db8af920 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78003f1d-c161-41ac-afb8-8913db8af920 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78003f1d-c161-41ac-afb8-8913db8af920 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:37 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-78003f1d-c161-41ac-afb8-8913db8af920 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:57:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-78003f1d-c161-41ac-afb8-8913db8af920 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:57:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-78003f1d-c161-41ac-afb8-8913db8af920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:37 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 968/1960] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:57:37 2024] POST /identity/v3/auth/tokens => generated 2960 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 12:57:37 l75lg1-v1 neutron-server[77619]: DEBUG neutron.wsgi [-] (77619) accepted ('10.27.203.238', 37764) {{(pid=77619) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 12:57:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97e5f6e-1ad1-4929-ad18-b2b350090bbb None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-d97e5f6e-1ad1-4929-ad18-b2b350090bbb None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:37 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-814b4b1c-0796-47a2-87e9-38fb765c09fd tempest-ShareSnapshotInstancesTest-843694899 None] <<< [DELETE] https://127.0.0.1:40443/api/views/13/ May 28 12:57:37 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-814b4b1c-0796-47a2-87e9-38fb765c09fd tempest-ShareSnapshotInstancesTest-843694899 None] --- [DELETE] https://127.0.0.1:40443/api/views/13/: Done May 28 12:57:37 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-814b4b1c-0796-47a2-87e9-38fb765c09fd tempest-ShareSnapshotInstancesTest-843694899 None] >>> [GET] https://127.0.0.1:40443/api/quotas/ May 28 12:57:37 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-814b4b1c-0796-47a2-87e9-38fb765c09fd tempest-ShareSnapshotInstancesTest-843694899 None] {'allow_redirects': True, May 28 12:57:37 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-814b4b1c-0796-47a2-87e9-38fb765c09fd tempest-ShareSnapshotInstancesTest-843694899 None] 'params': {'name': 'c2f741cd-bac5-499f-9539-8e93d6a81282'}} May 28 12:57:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97e5f6e-1ad1-4929-ad18-b2b350090bbb None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18a99ab-3422-4bcc-a85a-ed0bc2b15d1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef17047035e4b518fd5360a01f2da1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18a99ab-3422-4bcc-a85a-ed0bc2b15d1e service neutron] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18a99ab-3422-4bcc-a85a-ed0bc2b15d1e service neutron] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18a99ab-3422-4bcc-a85a-ed0bc2b15d1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18a99ab-3422-4bcc-a85a-ed0bc2b15d1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18a99ab-3422-4bcc-a85a-ed0bc2b15d1e service neutron] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:37 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 993/1961] 10.27.203.238 () {64 vars in 1432 bytes} [Tue May 28 12:57:37 2024] GET /identity/v3/auth/tokens => generated 2960 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 28 12:57:37 l75lg1-v1 neutron-server[77619]: INFO neutron.wsgi [None req-61df7ace-5729-43e1-aa6b-eb52279a9a1b None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=954e6ba3ee0543b29788f581bbd961f2&name=default HTTP/1.1" status: 200 len: 216 time: 0.0709581 May 28 12:57:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78003f1d-c161-41ac-afb8-8913db8af920 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-78003f1d-c161-41ac-afb8-8913db8af920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78003f1d-c161-41ac-afb8-8913db8af920 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b61f45-5833-428f-9a5f-238379eed009 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b61f45-5833-428f-9a5f-238379eed009 None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b61f45-5833-428f-9a5f-238379eed009 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b61f45-5833-428f-9a5f-238379eed009 None admin] PATH_INFO: `/v3/projects/954e6ba3ee0543b29788f581bbd961f2` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b61f45-5833-428f-9a5f-238379eed009 None admin] RBAC: Authorizing `identity:delete_project(project_id=954e6ba3ee0543b29788f581bbd961f2)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b61f45-5833-428f-9a5f-238379eed009 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-42b61f45-5833-428f-9a5f-238379eed009 None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '954e6ba3ee0543b29788f581bbd961f2', 'request_id': 'req-42b61f45-5833-428f-9a5f-238379eed009'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-42b61f45-5833-428f-9a5f-238379eed009 None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '954e6ba3ee0543b29788f581bbd961f2', 'request_id': 'req-42b61f45-5833-428f-9a5f-238379eed009'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-42b61f45-5833-428f-9a5f-238379eed009 None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '954e6ba3ee0543b29788f581bbd961f2', 'request_id': 'req-42b61f45-5833-428f-9a5f-238379eed009'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-42b61f45-5833-428f-9a5f-238379eed009 None admin] The token cache is being invalidate because project 954e6ba3ee0543b29788f581bbd961f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-42b61f45-5833-428f-9a5f-238379eed009 None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-42b61f45-5833-428f-9a5f-238379eed009 None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 969/1962] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 12:57:37 2024] DELETE /identity/v3/projects/954e6ba3ee0543b29788f581bbd961f2 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf56640c-76f3-4fe4-ba40-19c883fb8d2e None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf56640c-76f3-4fe4-ba40-19c883fb8d2e None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf56640c-76f3-4fe4-ba40-19c883fb8d2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-cf56640c-76f3-4fe4-ba40-19c883fb8d2e None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-cf56640c-76f3-4fe4-ba40-19c883fb8d2e None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-cf56640c-76f3-4fe4-ba40-19c883fb8d2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 994/1963] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:57:38 2024] POST /identity/v3/auth/tokens => generated 312 bytes in 18 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8a5404-070c-45e1-909a-243cd94c3fe9 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8a5404-070c-45e1-909a-243cd94c3fe9 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8a5404-070c-45e1-909a-243cd94c3fe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-ec8a5404-070c-45e1-909a-243cd94c3fe9 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-ec8a5404-070c-45e1-909a-243cd94c3fe9 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-ec8a5404-070c-45e1-909a-243cd94c3fe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 970/1964] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:57:38 2024] POST /identity/v3/auth/tokens => generated 2960 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf56640c-76f3-4fe4-ba40-19c883fb8d2e None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf56640c-76f3-4fe4-ba40-19c883fb8d2e None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b030a38f-39fa-4be1-9581-b2f71cdaa041 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b030a38f-39fa-4be1-9581-b2f71cdaa041 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b030a38f-39fa-4be1-9581-b2f71cdaa041 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b030a38f-39fa-4be1-9581-b2f71cdaa041 None admin] PATH_INFO: `/v3/domains` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b030a38f-39fa-4be1-9581-b2f71cdaa041 None admin] RBAC: Adding query filter params (name=Default) {{(pid=51267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b030a38f-39fa-4be1-9581-b2f71cdaa041 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b030a38f-39fa-4be1-9581-b2f71cdaa041 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 995/1965] 10.27.203.238 () {62 vars in 1220 bytes} [Tue May 28 12:57:38 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8a5404-070c-45e1-909a-243cd94c3fe9 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8a5404-070c-45e1-909a-243cd94c3fe9 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80a6e7c-1bd4-42a0-bc97-00bf3ded0520 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80a6e7c-1bd4-42a0-bc97-00bf3ded0520 None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80a6e7c-1bd4-42a0-bc97-00bf3ded0520 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80a6e7c-1bd4-42a0-bc97-00bf3ded0520 None admin] PATH_INFO: `/v3/projects` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80a6e7c-1bd4-42a0-bc97-00bf3ded0520 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80a6e7c-1bd4-42a0-bc97-00bf3ded0520 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:38 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-a188b34a-3aa1-4016-b95d-2f91f7817109 tempest-ShareSnapshotInstancesTest-843694899 tempest-ShareSnapshotInstancesTest-843694899-project-admin] GET http://10.27.203.238/share/v2/f4f7702aa04c467288cc6b142f61ec37/shares/b235c40f-7437-4e0c-b44e-321d8e8b1457 May 28 12:57:38 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-a188b34a-3aa1-4016-b95d-2f91f7817109 tempest-ShareSnapshotInstancesTest-843694899 tempest-ShareSnapshotInstancesTest-843694899-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:38 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-a188b34a-3aa1-4016-b95d-2f91f7817109 tempest-ShareSnapshotInstancesTest-843694899 tempest-ShareSnapshotInstancesTest-843694899-project-admin] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 971/1966] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 12:57:38 2024] POST /identity/v3/projects => generated 383 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b030a38f-39fa-4be1-9581-b2f71cdaa041 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b030a38f-39fa-4be1-9581-b2f71cdaa041 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:38 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-a188b34a-3aa1-4016-b95d-2f91f7817109 tempest-ShareSnapshotInstancesTest-843694899 tempest-ShareSnapshotInstancesTest-843694899-project-admin] http://10.27.203.238/share/v2/f4f7702aa04c467288cc6b142f61ec37/shares/b235c40f-7437-4e0c-b44e-321d8e8b1457 returned with HTTP 200 May 28 12:57:38 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 384/754] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:57:38 2024] GET /share/v2/f4f7702aa04c467288cc6b142f61ec37/shares/b235c40f-7437-4e0c-b44e-321d8e8b1457 => generated 1372 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53acf38-9e9a-4f64-8e80-38b2091dad5d None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53acf38-9e9a-4f64-8e80-38b2091dad5d None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53acf38-9e9a-4f64-8e80-38b2091dad5d None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53acf38-9e9a-4f64-8e80-38b2091dad5d None admin] PATH_INFO: `/v3/users` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53acf38-9e9a-4f64-8e80-38b2091dad5d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53acf38-9e9a-4f64-8e80-38b2091dad5d None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-f53acf38-9e9a-4f64-8e80-38b2091dad5d None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 12:57:38 l75lg1-v1 dstat.sh[49771]: 28-05 12:57:38| 12 2 84 2 0|5695M 1798M 277M 7855M| 28k 15k| 0 1336k| 0 181 |7895 13k|1.63 1.08 1.02|1.0 0 2.0| 0 0 | 0 2048M| 29 356 0 68 0 May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 996/1967] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 12:57:38 2024] POST /identity/v3/users => generated 300 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80a6e7c-1bd4-42a0-bc97-00bf3ded0520 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80a6e7c-1bd4-42a0-bc97-00bf3ded0520 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08adf1d1-1952-4773-918e-c968d98b5165 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08adf1d1-1952-4773-918e-c968d98b5165 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08adf1d1-1952-4773-918e-c968d98b5165 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08adf1d1-1952-4773-918e-c968d98b5165 None admin] PATH_INFO: `/v3/roles` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08adf1d1-1952-4773-918e-c968d98b5165 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08adf1d1-1952-4773-918e-c968d98b5165 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 972/1968] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 12:57:38 2024] GET /identity/v3/roles => generated 1680 bytes in 19 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53acf38-9e9a-4f64-8e80-38b2091dad5d None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53acf38-9e9a-4f64-8e80-38b2091dad5d None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8dd128-fef7-424b-b67b-8f7072f90913 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8dd128-fef7-424b-b67b-8f7072f90913 None admin] REQUEST_METHOD: `PUT` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8dd128-fef7-424b-b67b-8f7072f90913 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8dd128-fef7-424b-b67b-8f7072f90913 None admin] PATH_INFO: `/v3/projects/776f75906bc64f8f9316d5aab4b50bf1/users/8937c78e76024a40a3ee7b019a2d366f/roles/44620cad10ae407c90c91e2c296adb04` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8dd128-fef7-424b-b67b-8f7072f90913 None admin] RBAC: Authorizing `identity:create_grant(project_id=776f75906bc64f8f9316d5aab4b50bf1, user_id=8937c78e76024a40a3ee7b019a2d366f, role_id=44620cad10ae407c90c91e2c296adb04)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8dd128-fef7-424b-b67b-8f7072f90913 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 997/1969] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 12:57:38 2024] PUT /identity/v3/projects/776f75906bc64f8f9316d5aab4b50bf1/users/8937c78e76024a40a3ee7b019a2d366f/roles/44620cad10ae407c90c91e2c296adb04 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9825f5a6-bc41-4fb8-bcfe-a3932b358552 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9825f5a6-bc41-4fb8-bcfe-a3932b358552 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9825f5a6-bc41-4fb8-bcfe-a3932b358552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-9825f5a6-bc41-4fb8-bcfe-a3932b358552 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-9825f5a6-bc41-4fb8-bcfe-a3932b358552 None None] MFA Rules not processed for user `8937c78e76024a40a3ee7b019a2d366f`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-9825f5a6-bc41-4fb8-bcfe-a3932b358552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 973/1970] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:57:38 2024] POST /identity/v3/auth/tokens => generated 3954 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8dd128-fef7-424b-b67b-8f7072f90913 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8dd128-fef7-424b-b67b-8f7072f90913 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae926d25-7a0a-4e67-a1d4-2110ae85e917 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae926d25-7a0a-4e67-a1d4-2110ae85e917 None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae926d25-7a0a-4e67-a1d4-2110ae85e917 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae926d25-7a0a-4e67-a1d4-2110ae85e917 None admin] PATH_INFO: `/v3/projects` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae926d25-7a0a-4e67-a1d4-2110ae85e917 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae926d25-7a0a-4e67-a1d4-2110ae85e917 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 998/1971] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 12:57:38 2024] POST /identity/v3/projects => generated 383 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9825f5a6-bc41-4fb8-bcfe-a3932b358552 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:38 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-814b4b1c-0796-47a2-87e9-38fb765c09fd tempest-ShareSnapshotInstancesTest-843694899 None] <<< [GET] https://127.0.0.1:40443/api/quotas/ May 28 12:57:38 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-814b4b1c-0796-47a2-87e9-38fb765c09fd tempest-ShareSnapshotInstancesTest-843694899 None] [Bunch(cluster='loop75-kfs', cluster_id=1, default_email=None, default_group_quota=None, default_user_quota=None, enable_alarms=True, enable_email_providers=True, grace_period=None, guid='dea1acfc-2015-40a9-931d-b1809af3132c', hard_limit=1073741824, hard_limit_inodes=None, id=11, internal=False, is_user_quota=False, last_user_quotas_update=None, name='c2f741cd-bac5-499f-9539-8e93d6a81282', num_blocked_users=0, num_exceeded_users=0, path='/manila/manila-c2f741cd-bac5-499f-9539-8e93d6a81282', percent_capacity=0, percent_inodes=None, pretty_grace_period=None, pretty_grace_period_expiration=None, pretty_state='OK (CREATED)', soft_limit=None, soft_limit_inodes=None, state='OK', sync_state='CREATED', system_id=11, tenant_id=1, tenant_name='default', time_to_block=None, title='c2f741cd-bac5-499f-9539-8e93d6a81282', url='https://127.0.0.1:40443/api/quotas/11/', used_capacity=0, used_capacity_tb=0.0, used_effective_capacity=0, used_effective_capacity_tb=0.0, used_inodes=0, used_limited_capacity=0)] May 28 12:57:38 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-814b4b1c-0796-47a2-87e9-38fb765c09fd tempest-ShareSnapshotInstancesTest-843694899 None] --- [GET] https://127.0.0.1:40443/api/quotas/: Done May 28 12:57:38 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-814b4b1c-0796-47a2-87e9-38fb765c09fd tempest-ShareSnapshotInstancesTest-843694899 None] >>> [DELETE] https://127.0.0.1:40443/api/quotas/11/ May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9825f5a6-bc41-4fb8-bcfe-a3932b358552 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da2108b-4dc0-42bc-a21e-38b3d6a83c18 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da2108b-4dc0-42bc-a21e-38b3d6a83c18 None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da2108b-4dc0-42bc-a21e-38b3d6a83c18 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da2108b-4dc0-42bc-a21e-38b3d6a83c18 None admin] PATH_INFO: `/v3/users` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da2108b-4dc0-42bc-a21e-38b3d6a83c18 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da2108b-4dc0-42bc-a21e-38b3d6a83c18 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-8da2108b-4dc0-42bc-a21e-38b3d6a83c18 None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 974/1972] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 12:57:38 2024] POST /identity/v3/users => generated 300 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae926d25-7a0a-4e67-a1d4-2110ae85e917 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae926d25-7a0a-4e67-a1d4-2110ae85e917 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1122fc5-8c25-4991-9e2b-4372b57fb45a None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1122fc5-8c25-4991-9e2b-4372b57fb45a None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1122fc5-8c25-4991-9e2b-4372b57fb45a None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1122fc5-8c25-4991-9e2b-4372b57fb45a None admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1122fc5-8c25-4991-9e2b-4372b57fb45a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1122fc5-8c25-4991-9e2b-4372b57fb45a None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 999/1973] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 12:57:38 2024] GET /identity/v3/roles => generated 1680 bytes in 18 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da2108b-4dc0-42bc-a21e-38b3d6a83c18 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da2108b-4dc0-42bc-a21e-38b3d6a83c18 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60668ec-8f25-46b0-a6dc-d07d49651ac3 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60668ec-8f25-46b0-a6dc-d07d49651ac3 None admin] REQUEST_METHOD: `PUT` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60668ec-8f25-46b0-a6dc-d07d49651ac3 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60668ec-8f25-46b0-a6dc-d07d49651ac3 None admin] PATH_INFO: `/v3/projects/a8833f25920b4057b32b03094b1ca6f8/users/8a096898300641eabaf2d505168d8804/roles/44620cad10ae407c90c91e2c296adb04` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60668ec-8f25-46b0-a6dc-d07d49651ac3 None admin] RBAC: Authorizing `identity:create_grant(project_id=a8833f25920b4057b32b03094b1ca6f8, user_id=8a096898300641eabaf2d505168d8804, role_id=44620cad10ae407c90c91e2c296adb04)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60668ec-8f25-46b0-a6dc-d07d49651ac3 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 975/1974] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 12:57:38 2024] PUT /identity/v3/projects/a8833f25920b4057b32b03094b1ca6f8/users/8a096898300641eabaf2d505168d8804/roles/44620cad10ae407c90c91e2c296adb04 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9ad3a2-6ae2-4184-a533-d4d6a251e97a None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9ad3a2-6ae2-4184-a533-d4d6a251e97a None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9ad3a2-6ae2-4184-a533-d4d6a251e97a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-9a9ad3a2-6ae2-4184-a533-d4d6a251e97a None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-9a9ad3a2-6ae2-4184-a533-d4d6a251e97a None None] MFA Rules not processed for user `8a096898300641eabaf2d505168d8804`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-9a9ad3a2-6ae2-4184-a533-d4d6a251e97a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1000/1975] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:57:38 2024] POST /identity/v3/auth/tokens => generated 3954 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60668ec-8f25-46b0-a6dc-d07d49651ac3 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60668ec-8f25-46b0-a6dc-d07d49651ac3 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a6fe8e-0437-433c-8130-23f3d9e8c7d1 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a6fe8e-0437-433c-8130-23f3d9e8c7d1 None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a6fe8e-0437-433c-8130-23f3d9e8c7d1 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a6fe8e-0437-433c-8130-23f3d9e8c7d1 None admin] PATH_INFO: `/v3/projects` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a6fe8e-0437-433c-8130-23f3d9e8c7d1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a6fe8e-0437-433c-8130-23f3d9e8c7d1 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 976/1976] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 12:57:38 2024] POST /identity/v3/projects => generated 383 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9ad3a2-6ae2-4184-a533-d4d6a251e97a None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9ad3a2-6ae2-4184-a533-d4d6a251e97a None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5fc630-9d16-4a1d-b867-216c1d543580 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5fc630-9d16-4a1d-b867-216c1d543580 None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5fc630-9d16-4a1d-b867-216c1d543580 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5fc630-9d16-4a1d-b867-216c1d543580 None admin] PATH_INFO: `/v3/users` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5fc630-9d16-4a1d-b867-216c1d543580 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5fc630-9d16-4a1d-b867-216c1d543580 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-6b5fc630-9d16-4a1d-b867-216c1d543580 None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1001/1977] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 12:57:38 2024] POST /identity/v3/users => generated 299 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a6fe8e-0437-433c-8130-23f3d9e8c7d1 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a6fe8e-0437-433c-8130-23f3d9e8c7d1 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef6d62a-a672-4578-a5c6-b7b72da15c29 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef6d62a-a672-4578-a5c6-b7b72da15c29 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef6d62a-a672-4578-a5c6-b7b72da15c29 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef6d62a-a672-4578-a5c6-b7b72da15c29 None admin] PATH_INFO: `/v3/roles` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef6d62a-a672-4578-a5c6-b7b72da15c29 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef6d62a-a672-4578-a5c6-b7b72da15c29 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 977/1978] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 12:57:38 2024] GET /identity/v3/roles => generated 1680 bytes in 18 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5fc630-9d16-4a1d-b867-216c1d543580 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5fc630-9d16-4a1d-b867-216c1d543580 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7baf7c-d341-466a-81b4-01c93e0ac19a None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7baf7c-d341-466a-81b4-01c93e0ac19a None admin] REQUEST_METHOD: `PUT` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7baf7c-d341-466a-81b4-01c93e0ac19a None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7baf7c-d341-466a-81b4-01c93e0ac19a None admin] PATH_INFO: `/v3/projects/be41abb2eae44a6481cf94a21e347d1e/users/4baf3846d3024ef88eeb58770fe946c9/roles/e7989893488f483baa107be56668c4f8` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7baf7c-d341-466a-81b4-01c93e0ac19a None admin] RBAC: Authorizing `identity:create_grant(project_id=be41abb2eae44a6481cf94a21e347d1e, user_id=4baf3846d3024ef88eeb58770fe946c9, role_id=e7989893488f483baa107be56668c4f8)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7baf7c-d341-466a-81b4-01c93e0ac19a None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1002/1979] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 12:57:38 2024] PUT /identity/v3/projects/be41abb2eae44a6481cf94a21e347d1e/users/4baf3846d3024ef88eeb58770fe946c9/roles/e7989893488f483baa107be56668c4f8 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef6d62a-a672-4578-a5c6-b7b72da15c29 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef6d62a-a672-4578-a5c6-b7b72da15c29 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e565dc-8a4d-41a4-8e1e-c63a19d881f0 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e565dc-8a4d-41a4-8e1e-c63a19d881f0 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e565dc-8a4d-41a4-8e1e-c63a19d881f0 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e565dc-8a4d-41a4-8e1e-c63a19d881f0 None admin] PATH_INFO: `/v3/roles` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e565dc-8a4d-41a4-8e1e-c63a19d881f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e565dc-8a4d-41a4-8e1e-c63a19d881f0 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 978/1980] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 12:57:38 2024] GET /identity/v3/roles => generated 1680 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7baf7c-d341-466a-81b4-01c93e0ac19a None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7baf7c-d341-466a-81b4-01c93e0ac19a None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc97693-4194-4543-88a8-c6e4c8d59fde None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc97693-4194-4543-88a8-c6e4c8d59fde None admin] REQUEST_METHOD: `PUT` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc97693-4194-4543-88a8-c6e4c8d59fde None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc97693-4194-4543-88a8-c6e4c8d59fde None admin] PATH_INFO: `/v3/projects/be41abb2eae44a6481cf94a21e347d1e/users/4baf3846d3024ef88eeb58770fe946c9/roles/e7989893488f483baa107be56668c4f8` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc97693-4194-4543-88a8-c6e4c8d59fde None admin] RBAC: Authorizing `identity:create_grant(project_id=be41abb2eae44a6481cf94a21e347d1e, user_id=4baf3846d3024ef88eeb58770fe946c9, role_id=e7989893488f483baa107be56668c4f8)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc97693-4194-4543-88a8-c6e4c8d59fde None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1003/1981] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 12:57:38 2024] PUT /identity/v3/projects/be41abb2eae44a6481cf94a21e347d1e/users/4baf3846d3024ef88eeb58770fe946c9/roles/e7989893488f483baa107be56668c4f8 => generated 0 bytes in 18 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef934b60-6cd6-4869-8718-e19a20093908 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef934b60-6cd6-4869-8718-e19a20093908 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef934b60-6cd6-4869-8718-e19a20093908 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-ef934b60-6cd6-4869-8718-e19a20093908 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-ef934b60-6cd6-4869-8718-e19a20093908 None None] MFA Rules not processed for user `4baf3846d3024ef88eeb58770fe946c9`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-ef934b60-6cd6-4869-8718-e19a20093908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 979/1982] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:57:38 2024] POST /identity/v3/auth/tokens => generated 4077 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc97693-4194-4543-88a8-c6e4c8d59fde None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc97693-4194-4543-88a8-c6e4c8d59fde None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978564dd-9a67-4c9b-baaa-f31df25c6ff0 tempest-ShareIpRulesForNFSTest-2105398077 tempest-ShareIpRulesForNFSTest-2105398077-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baf3846d3024ef88eeb58770fe946c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be41abb2eae44a6481cf94a21e347d1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978564dd-9a67-4c9b-baaa-f31df25c6ff0 tempest-ShareIpRulesForNFSTest-2105398077 tempest-ShareIpRulesForNFSTest-2105398077-project-admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978564dd-9a67-4c9b-baaa-f31df25c6ff0 tempest-ShareIpRulesForNFSTest-2105398077 tempest-ShareIpRulesForNFSTest-2105398077-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978564dd-9a67-4c9b-baaa-f31df25c6ff0 tempest-ShareIpRulesForNFSTest-2105398077 tempest-ShareIpRulesForNFSTest-2105398077-project-admin] PATH_INFO: `/v3/domains` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978564dd-9a67-4c9b-baaa-f31df25c6ff0 tempest-ShareIpRulesForNFSTest-2105398077 tempest-ShareIpRulesForNFSTest-2105398077-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=51267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978564dd-9a67-4c9b-baaa-f31df25c6ff0 tempest-ShareIpRulesForNFSTest-2105398077 tempest-ShareIpRulesForNFSTest-2105398077-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978564dd-9a67-4c9b-baaa-f31df25c6ff0 tempest-ShareIpRulesForNFSTest-2105398077 tempest-ShareIpRulesForNFSTest-2105398077-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:39 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1004/1983] 10.27.203.238 () {62 vars in 1241 bytes} [Tue May 28 12:57:38 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:57:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef934b60-6cd6-4869-8718-e19a20093908 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef934b60-6cd6-4869-8718-e19a20093908 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb90d85a-85fb-4181-a55e-6e80cd56c4e4 tempest-ShareIpRulesForNFSTest-2105398077 tempest-ShareIpRulesForNFSTest-2105398077-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baf3846d3024ef88eeb58770fe946c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be41abb2eae44a6481cf94a21e347d1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb90d85a-85fb-4181-a55e-6e80cd56c4e4 tempest-ShareIpRulesForNFSTest-2105398077 tempest-ShareIpRulesForNFSTest-2105398077-project-admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb90d85a-85fb-4181-a55e-6e80cd56c4e4 tempest-ShareIpRulesForNFSTest-2105398077 tempest-ShareIpRulesForNFSTest-2105398077-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb90d85a-85fb-4181-a55e-6e80cd56c4e4 tempest-ShareIpRulesForNFSTest-2105398077 tempest-ShareIpRulesForNFSTest-2105398077-project-admin] PATH_INFO: `/v3/users` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb90d85a-85fb-4181-a55e-6e80cd56c4e4 tempest-ShareIpRulesForNFSTest-2105398077 tempest-ShareIpRulesForNFSTest-2105398077-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb90d85a-85fb-4181-a55e-6e80cd56c4e4 tempest-ShareIpRulesForNFSTest-2105398077 tempest-ShareIpRulesForNFSTest-2105398077-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:39 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-bb90d85a-85fb-4181-a55e-6e80cd56c4e4 tempest-ShareIpRulesForNFSTest-2105398077 tempest-ShareIpRulesForNFSTest-2105398077-project-admin] Truncating password to algorithm specific maximum length 72 characters. May 28 12:57:39 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 980/1984] 10.27.203.238 () {64 vars in 1232 bytes} [Tue May 28 12:57:39 2024] POST /identity/v3/users => generated 435 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:57:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978564dd-9a67-4c9b-baaa-f31df25c6ff0 tempest-ShareIpRulesForNFSTest-2105398077 tempest-ShareIpRulesForNFSTest-2105398077-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978564dd-9a67-4c9b-baaa-f31df25c6ff0 tempest-ShareIpRulesForNFSTest-2105398077 tempest-ShareIpRulesForNFSTest-2105398077-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b83e94-5c8d-4f88-aef5-d89048703ec7 tempest-ShareIpRulesForNFSTest-2105398077 tempest-ShareIpRulesForNFSTest-2105398077-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baf3846d3024ef88eeb58770fe946c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be41abb2eae44a6481cf94a21e347d1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b83e94-5c8d-4f88-aef5-d89048703ec7 tempest-ShareIpRulesForNFSTest-2105398077 tempest-ShareIpRulesForNFSTest-2105398077-project-admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b83e94-5c8d-4f88-aef5-d89048703ec7 tempest-ShareIpRulesForNFSTest-2105398077 tempest-ShareIpRulesForNFSTest-2105398077-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b83e94-5c8d-4f88-aef5-d89048703ec7 tempest-ShareIpRulesForNFSTest-2105398077 tempest-ShareIpRulesForNFSTest-2105398077-project-admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b83e94-5c8d-4f88-aef5-d89048703ec7 tempest-ShareIpRulesForNFSTest-2105398077 tempest-ShareIpRulesForNFSTest-2105398077-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b83e94-5c8d-4f88-aef5-d89048703ec7 tempest-ShareIpRulesForNFSTest-2105398077 tempest-ShareIpRulesForNFSTest-2105398077-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:39 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1005/1985] 10.27.203.238 () {62 vars in 1210 bytes} [Tue May 28 12:57:39 2024] GET /identity/v3/roles => generated 1680 bytes in 17 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:57:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb90d85a-85fb-4181-a55e-6e80cd56c4e4 tempest-ShareIpRulesForNFSTest-2105398077 tempest-ShareIpRulesForNFSTest-2105398077-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb90d85a-85fb-4181-a55e-6e80cd56c4e4 tempest-ShareIpRulesForNFSTest-2105398077 tempest-ShareIpRulesForNFSTest-2105398077-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9847a3c-ae8e-41d4-bb37-3d6dc3a27a03 tempest-ShareIpRulesForNFSTest-2105398077 tempest-ShareIpRulesForNFSTest-2105398077-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baf3846d3024ef88eeb58770fe946c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be41abb2eae44a6481cf94a21e347d1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9847a3c-ae8e-41d4-bb37-3d6dc3a27a03 tempest-ShareIpRulesForNFSTest-2105398077 tempest-ShareIpRulesForNFSTest-2105398077-project-admin] REQUEST_METHOD: `PUT` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9847a3c-ae8e-41d4-bb37-3d6dc3a27a03 tempest-ShareIpRulesForNFSTest-2105398077 tempest-ShareIpRulesForNFSTest-2105398077-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9847a3c-ae8e-41d4-bb37-3d6dc3a27a03 tempest-ShareIpRulesForNFSTest-2105398077 tempest-ShareIpRulesForNFSTest-2105398077-project-admin] PATH_INFO: `/v3/projects/be41abb2eae44a6481cf94a21e347d1e/users/fa87d7e402e34eeab8ec8ddf1839bb59/roles/44620cad10ae407c90c91e2c296adb04` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9847a3c-ae8e-41d4-bb37-3d6dc3a27a03 tempest-ShareIpRulesForNFSTest-2105398077 tempest-ShareIpRulesForNFSTest-2105398077-project-admin] RBAC: Authorizing `identity:create_grant(project_id=be41abb2eae44a6481cf94a21e347d1e, user_id=fa87d7e402e34eeab8ec8ddf1839bb59, role_id=44620cad10ae407c90c91e2c296adb04)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9847a3c-ae8e-41d4-bb37-3d6dc3a27a03 tempest-ShareIpRulesForNFSTest-2105398077 tempest-ShareIpRulesForNFSTest-2105398077-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:39 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 981/1986] 10.27.203.238 () {64 vars in 1571 bytes} [Tue May 28 12:57:39 2024] PUT /identity/v3/projects/be41abb2eae44a6481cf94a21e347d1e/users/fa87d7e402e34eeab8ec8ddf1839bb59/roles/44620cad10ae407c90c91e2c296adb04 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:57:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b83e94-5c8d-4f88-aef5-d89048703ec7 tempest-ShareIpRulesForNFSTest-2105398077 tempest-ShareIpRulesForNFSTest-2105398077-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-e6b83e94-5c8d-4f88-aef5-d89048703ec7 tempest-ShareIpRulesForNFSTest-2105398077 tempest-ShareIpRulesForNFSTest-2105398077-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b83e94-5c8d-4f88-aef5-d89048703ec7 tempest-ShareIpRulesForNFSTest-2105398077 tempest-ShareIpRulesForNFSTest-2105398077-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b20892-c043-4269-816a-4bab8c160501 service manila] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f110cf6300f049c897d0aab63218d1e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b20892-c043-4269-816a-4bab8c160501 service manila] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b20892-c043-4269-816a-4bab8c160501 service manila] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b20892-c043-4269-816a-4bab8c160501 service manila] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b20892-c043-4269-816a-4bab8c160501 service manila] RBAC: Authorizing `identity:validate_token()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b20892-c043-4269-816a-4bab8c160501 service manila] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:39 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1006/1987] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 12:57:39 2024] GET /identity/v3/auth/tokens => generated 4077 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 12:57:39 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-46882b96-75b4-464a-8472-c0545415a93b tempest-ShareIpRulesForNFSTest-2105398077 tempest-ShareIpRulesForNFSTest-2105398077-project-admin] POST http://10.27.203.238/share/v2/be41abb2eae44a6481cf94a21e347d1e/types May 28 12:57:39 l75lg1-v1 dstat.sh[49771]: 28-05 12:57:39| 10 2 87 2 0|5696M 1797M 277M 7855M| 22k 862B| 0 1284k| 0 183 |7500 13k|1.63 1.08 1.02|2.0 0 0| 0 0 | 0 2048M| 29 356 0 66 0 May 28 12:57:39 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-46882b96-75b4-464a-8472-c0545415a93b tempest-ShareIpRulesForNFSTest-2105398077 tempest-ShareIpRulesForNFSTest-2105398077-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share_type": {"name": "tempest-typeshare-type-156874882", "extra_specs": {"driver_handles_share_servers": "False"}, "share_type_access:is_public": true}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:57:39 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-46882b96-75b4-464a-8472-c0545415a93b tempest-ShareIpRulesForNFSTest-2105398077 tempest-ShareIpRulesForNFSTest-2105398077-project-admin] http://10.27.203.238/share/v2/be41abb2eae44a6481cf94a21e347d1e/types returned with HTTP 200 May 28 12:57:39 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 371/755] 10.27.203.238 () {66 vars in 1359 bytes} [Tue May 28 12:57:39 2024] POST /share/v2/be41abb2eae44a6481cf94a21e347d1e/types => generated 621 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:57:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9847a3c-ae8e-41d4-bb37-3d6dc3a27a03 tempest-ShareIpRulesForNFSTest-2105398077 tempest-ShareIpRulesForNFSTest-2105398077-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-a9847a3c-ae8e-41d4-bb37-3d6dc3a27a03 tempest-ShareIpRulesForNFSTest-2105398077 tempest-ShareIpRulesForNFSTest-2105398077-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9847a3c-ae8e-41d4-bb37-3d6dc3a27a03 tempest-ShareIpRulesForNFSTest-2105398077 tempest-ShareIpRulesForNFSTest-2105398077-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fedeb5-c707-402c-bfaf-ab5e8bd3f209 service manila] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f110cf6300f049c897d0aab63218d1e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fedeb5-c707-402c-bfaf-ab5e8bd3f209 service manila] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fedeb5-c707-402c-bfaf-ab5e8bd3f209 service manila] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fedeb5-c707-402c-bfaf-ab5e8bd3f209 service manila] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fedeb5-c707-402c-bfaf-ab5e8bd3f209 service manila] RBAC: Authorizing `identity:validate_token()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fedeb5-c707-402c-bfaf-ab5e8bd3f209 service manila] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:39 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 982/1988] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 12:57:39 2024] GET /identity/v3/auth/tokens => generated 3954 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 12:57:39 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-73c32d25-146c-4856-8152-deb6aa1abca7 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] POST http://10.27.203.238/share/v2/776f75906bc64f8f9316d5aab4b50bf1/shares May 28 12:57:39 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-73c32d25-146c-4856-8152-deb6aa1abca7 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share": {"share_proto": "nfs", "description": "Tempest's share", "snapshot_id": null, "name": "tempest-tempest-created-share-1071850272", "size": 1, "metadata": {}, "is_public": false, "share_type": "9752aa1f-dff4-4911-9901-18941d761370"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:57:39 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.v1.shares [None req-73c32d25-146c-4856-8152-deb6aa1abca7 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Create NFS share of 1 GB May 28 12:57:39 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-82645b52-f181-488a-bafb-43043346b561 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] GET http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/36ebac5b-70c6-4cc4-85fa-1acc9586628e May 28 12:57:39 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-82645b52-f181-488a-bafb-43043346b561 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:39 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-82645b52-f181-488a-bafb-43043346b561 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:39 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-82645b52-f181-488a-bafb-43043346b561 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/36ebac5b-70c6-4cc4-85fa-1acc9586628e returned with HTTP 200 May 28 12:57:39 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 372/756] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:57:39 2024] GET /share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/36ebac5b-70c6-4cc4-85fa-1acc9586628e => generated 1350 bytes in 24 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:57:39 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.quota [None req-73c32d25-146c-4856-8152-deb6aa1abca7 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Created reservations ['13502e34-6b1b-4a26-bab2-5eacdc697076', '2425492b-c832-41a6-bc30-a7806713a235', '3d658c1e-8efb-4f39-975c-be7bb0e07dce', 'fea38af7-183e-4fe1-be09-bd48bd328dfd'] {{(pid=98329) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 12:57:39 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.quota [None req-73c32d25-146c-4856-8152-deb6aa1abca7 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Committed reservations ['13502e34-6b1b-4a26-bab2-5eacdc697076', '2425492b-c832-41a6-bc30-a7806713a235', '3d658c1e-8efb-4f39-975c-be7bb0e07dce', 'fea38af7-183e-4fe1-be09-bd48bd328dfd'] {{(pid=98329) commit /opt/stack/manila/manila/quota.py:1063}} May 28 12:57:39 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.host_manager [None req-73c32d25-146c-4856-8152-deb6aa1abca7 tempest-ShareIpRulesForNFSTest-1748669711 None] Share service is down. (host: l75lg1-v1@generic2). May 28 12:57:39 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.host_manager [None req-73c32d25-146c-4856-8152-deb6aa1abca7 tempest-ShareIpRulesForNFSTest-1748669711 None] Share service is down. (host: l75lg1-v1@generic1). May 28 12:57:39 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-73c32d25-146c-4856-8152-deb6aa1abca7 tempest-ShareIpRulesForNFSTest-1748669711 None] Starting with 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:80}} May 28 12:57:39 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-73c32d25-146c-4856-8152-deb6aa1abca7 tempest-ShareIpRulesForNFSTest-1748669711 None] Filter OnlyHostFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:57:39 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-73c32d25-146c-4856-8152-deb6aa1abca7 tempest-ShareIpRulesForNFSTest-1748669711 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:57:39 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.capacity [None req-73c32d25-146c-4856-8152-deb6aa1abca7 tempest-ShareIpRulesForNFSTest-1748669711 None] Space information for share creation on host l75lg1-v1@vast#vast (requested / avail): 1/2064 {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/capacity.py:83}} May 28 12:57:39 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-73c32d25-146c-4856-8152-deb6aa1abca7 tempest-ShareIpRulesForNFSTest-1748669711 None] Filter CapacityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:57:39 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-73c32d25-146c-4856-8152-deb6aa1abca7 tempest-ShareIpRulesForNFSTest-1748669711 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:57:39 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-73c32d25-146c-4856-8152-deb6aa1abca7 tempest-ShareIpRulesForNFSTest-1748669711 None] Driver Filter: Checking host 'l75lg1-v1@vast#vast' {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:37}} May 28 12:57:39 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-73c32d25-146c-4856-8152-deb6aa1abca7 tempest-ShareIpRulesForNFSTest-1748669711 None] Filter function not set :: passing host. {{(pid=98327) _check_filter_function /opt/stack/manila/manila/scheduler/filters/driver.py:53}} May 28 12:57:39 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-73c32d25-146c-4856-8152-deb6aa1abca7 tempest-ShareIpRulesForNFSTest-1748669711 None] Result: True {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:40}} May 28 12:57:39 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-73c32d25-146c-4856-8152-deb6aa1abca7 tempest-ShareIpRulesForNFSTest-1748669711 None] Done checking host 'l75lg1-v1@vast#vast' {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:41}} May 28 12:57:39 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-73c32d25-146c-4856-8152-deb6aa1abca7 tempest-ShareIpRulesForNFSTest-1748669711 None] Filter DriverFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:57:39 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-73c32d25-146c-4856-8152-deb6aa1abca7 tempest-ShareIpRulesForNFSTest-1748669711 None] Filter ShareReplicationFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:57:39 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-73c32d25-146c-4856-8152-deb6aa1abca7 tempest-ShareIpRulesForNFSTest-1748669711 None] Filter CreateFromSnapshotFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:57:39 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-73c32d25-146c-4856-8152-deb6aa1abca7 tempest-ShareIpRulesForNFSTest-1748669711 None] Filter AffinityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:57:39 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-73c32d25-146c-4856-8152-deb6aa1abca7 tempest-ShareIpRulesForNFSTest-1748669711 None] Filter AntiAffinityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:57:39 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.drivers.filter [None req-73c32d25-146c-4856-8152-deb6aa1abca7 tempest-ShareIpRulesForNFSTest-1748669711 None] Filtered share [host: 'l75lg1-v1@vast#vast', free_capacity_gb: 2064.6229242384434, pools: None] {{(pid=98327) _schedule_share /opt/stack/manila/manila/scheduler/drivers/filter.py:268}} May 28 12:57:39 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-73c32d25-146c-4856-8152-deb6aa1abca7 tempest-ShareIpRulesForNFSTest-1748669711 None] Checking host 'l75lg1-v1@vast#vast' {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:46}} May 28 12:57:39 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.weighers.goodness [None req-73c32d25-146c-4856-8152-deb6aa1abca7 tempest-ShareIpRulesForNFSTest-1748669711 None] Goodness function not set :: defaulting to minimal goodness rating of 0. May 28 12:57:39 l75lg1-v1 manila-scheduler[98327]: INFO manila.scheduler.weighers.goodness [None req-73c32d25-146c-4856-8152-deb6aa1abca7 tempest-ShareIpRulesForNFSTest-1748669711 None] Goodness function result for host l75lg1-v1@vast#vast: 0. May 28 12:57:39 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-73c32d25-146c-4856-8152-deb6aa1abca7 tempest-ShareIpRulesForNFSTest-1748669711 None] Goodness: 0 {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:48}} May 28 12:57:39 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-73c32d25-146c-4856-8152-deb6aa1abca7 tempest-ShareIpRulesForNFSTest-1748669711 None] Done checking host 'l75lg1-v1@vast#vast' {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:49}} May 28 12:57:39 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.drivers.filter [None req-73c32d25-146c-4856-8152-deb6aa1abca7 tempest-ShareIpRulesForNFSTest-1748669711 None] Choosing for share: WeighedHost [host: l75lg1-v1@vast#vast, weight: 0.0] {{(pid=98327) _schedule_share /opt/stack/manila/manila/scheduler/drivers/filter.py:274}} May 28 12:57:39 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-73c32d25-146c-4856-8152-deb6aa1abca7 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] http://10.27.203.238/share/v2/776f75906bc64f8f9316d5aab4b50bf1/shares returned with HTTP 200 May 28 12:57:39 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 385/757] 10.27.203.238 () {66 vars in 1362 bytes} [Tue May 28 12:57:39 2024] POST /share/v2/776f75906bc64f8f9316d5aab4b50bf1/shares => generated 1312 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:57:39 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a5b23709-72de-4efa-8cc5-29f19d0f7897 tempest-SharesMetadataTest-1561320255 None] <<< [DELETE] https://127.0.0.1:40443/api/quotas/16/ May 28 12:57:39 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a5b23709-72de-4efa-8cc5-29f19d0f7897 tempest-SharesMetadataTest-1561320255 None] --- [DELETE] https://127.0.0.1:40443/api/quotas/16/: Done May 28 12:57:39 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-444371fe-e766-40b8-be08-e23447b8534f tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] GET http://10.27.203.238/share/v2/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1 May 28 12:57:39 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a5b23709-72de-4efa-8cc5-29f19d0f7897 tempest-SharesMetadataTest-1561320255 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:57:39 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-444371fe-e766-40b8-be08-e23447b8534f tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:39 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a5b23709-72de-4efa-8cc5-29f19d0f7897 tempest-SharesMetadataTest-1561320255 None] {'allow_redirects': True, May 28 12:57:39 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-444371fe-e766-40b8-be08-e23447b8534f tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:39 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a5b23709-72de-4efa-8cc5-29f19d0f7897 tempest-SharesMetadataTest-1561320255 None] 'params': {'name': '2be2873c-4768-478e-a848-fb1d2654ca64'}} May 28 12:57:39 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-444371fe-e766-40b8-be08-e23447b8534f tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] http://10.27.203.238/share/v2/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1 returned with HTTP 200 May 28 12:57:39 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 373/758] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:57:39 2024] GET /share/v2/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1 => generated 1312 bytes in 28 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:57:39 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-73c32d25-146c-4856-8152-deb6aa1abca7 tempest-ShareIpRulesForNFSTest-1748669711 None] >>> [GET] https://127.0.0.1:40443/api/vippools/ May 28 12:57:39 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-73c32d25-146c-4856-8152-deb6aa1abca7 tempest-ShareIpRulesForNFSTest-1748669711 None] {'allow_redirects': True, 'params': {'name': 'vippool-1'}} May 28 12:57:39 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1a206104-3ae2-40d4-ad11-73c0d9107322 tempest-SharesActionsAdminTest-1286316336 None] <<< [DELETE] https://127.0.0.1:40443/api/viewpolicies/15/ May 28 12:57:39 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1a206104-3ae2-40d4-ad11-73c0d9107322 tempest-SharesActionsAdminTest-1286316336 None] --- [DELETE] https://127.0.0.1:40443/api/viewpolicies/15/: Done May 28 12:57:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-73c32d25-146c-4856-8152-deb6aa1abca7 tempest-ShareIpRulesForNFSTest-1748669711 None] <<< [GET] https://127.0.0.1:40443/api/vippools/ May 28 12:57:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-73c32d25-146c-4856-8152-deb6aa1abca7 tempest-ShareIpRulesForNFSTest-1748669711 None] [Bunch(active_cnode_ids=[], active_interfaces=4, cluster='loop75-kfs', cluster_id=1, cnode_ids=[], cnodes=[], domain_name='vippool-1', enable_l3=False, enable_weighted_balancing=False, enabled=True, end_ip='172.21.75.4', guid='f2abaede-b397-413a-8faa-3aeead6d3b28', gw_ip='', gw_ipv6='', id=2, ip_ranges=[['172.21.75.1', '172.21.75.4']], name='vippool-1', peer_asn=0, port_membership='ALL', ranges_summary='172.21.75.[1-4]', role='PROTOCOLS', start_ip='172.21.75.1', subnet_cidr=16, subnet_cidr_ipv6=None, sync='SYNCED', sync_time='2024-05-28T12:50:09.644123Z', tenant_id=1, tenant_name='default', title='172.21.75.1 - 172.21.75.4', url='https://127.0.0.1:40443/api/vippools/2/', vast_asn=0, vlan=0, vms_preferred=False)] May 28 12:57:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-73c32d25-146c-4856-8152-deb6aa1abca7 tempest-ShareIpRulesForNFSTest-1748669711 None] --- [GET] https://127.0.0.1:40443/api/vippools/: Done May 28 12:57:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-73c32d25-146c-4856-8152-deb6aa1abca7 tempest-ShareIpRulesForNFSTest-1748669711 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:57:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-73c32d25-146c-4856-8152-deb6aa1abca7 tempest-ShareIpRulesForNFSTest-1748669711 None] {'allow_redirects': True, May 28 12:57:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-73c32d25-146c-4856-8152-deb6aa1abca7 tempest-ShareIpRulesForNFSTest-1748669711 None] 'params': {'name': 'b7a7d61c-2cea-442a-9809-507038e080d5'}} May 28 12:57:40 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-1a206104-3ae2-40d4-ad11-73c0d9107322 tempest-SharesActionsAdminTest-1286316336 None] Created reservations ['49a954c7-94f9-499d-afb8-575f09a23c5f', '189592b4-92cd-4c31-b1bb-e255b7a68ef6', '22283243-034c-483c-bdc0-e4d4820ab186', '126998a6-de2e-447e-9fee-7155972768ad'] {{(pid=98474) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 12:57:40 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-1a206104-3ae2-40d4-ad11-73c0d9107322 tempest-SharesActionsAdminTest-1286316336 None] Committed reservations ['49a954c7-94f9-499d-afb8-575f09a23c5f', '189592b4-92cd-4c31-b1bb-e255b7a68ef6', '22283243-034c-483c-bdc0-e4d4820ab186', '126998a6-de2e-447e-9fee-7155972768ad'] {{(pid=98474) commit /opt/stack/manila/manila/quota.py:1063}} May 28 12:57:40 l75lg1-v1 manila-share[98474]: INFO manila.share.manager [None req-1a206104-3ae2-40d4-ad11-73c0d9107322 tempest-SharesActionsAdminTest-1286316336 None] Share instance 7c19614c-d968-4489-b2ad-bd88c2ef8054: deleted successfully. May 28 12:57:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f6784d36-6966-4d0d-8f96-f818219fe4a4 tempest-AdminActionsTest-1749172189 None] <<< [DELETE] https://127.0.0.1:40443/api/views/19/ May 28 12:57:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f6784d36-6966-4d0d-8f96-f818219fe4a4 tempest-AdminActionsTest-1749172189 None] --- [DELETE] https://127.0.0.1:40443/api/views/19/: Done May 28 12:57:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f6784d36-6966-4d0d-8f96-f818219fe4a4 tempest-AdminActionsTest-1749172189 None] >>> [GET] https://127.0.0.1:40443/api/quotas/ May 28 12:57:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f6784d36-6966-4d0d-8f96-f818219fe4a4 tempest-AdminActionsTest-1749172189 None] {'allow_redirects': True, May 28 12:57:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f6784d36-6966-4d0d-8f96-f818219fe4a4 tempest-AdminActionsTest-1749172189 None] 'params': {'name': '724bc53b-1c28-4ab1-b3c8-ab90f868473d'}} May 28 12:57:40 l75lg1-v1 dstat.sh[49771]: 28-05 12:57:40| 7 1 89 2 0|5696M 1797M 277M 7856M| 25k 3725B| 0 2072k| 0 258 |5706 9261 |1.63 1.08 1.02|2.0 1.0 0| 0 0 | 0 2048M| 29 355 0 66 0 May 28 12:57:40 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-8dce78c9-6981-4cac-a021-c711e0b3d446 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] GET http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/share_instances/724bc53b-1c28-4ab1-b3c8-ab90f868473d May 28 12:57:40 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-8dce78c9-6981-4cac-a021-c711e0b3d446 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:40 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-8dce78c9-6981-4cac-a021-c711e0b3d446 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:40 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-8dce78c9-6981-4cac-a021-c711e0b3d446 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/share_instances/724bc53b-1c28-4ab1-b3c8-ab90f868473d returned with HTTP 200 May 28 12:57:40 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 386/759] 10.27.203.238 () {64 vars in 1478 bytes} [Tue May 28 12:57:40 2024] GET /share/v2/a3499cb78849424db45e54caac01de92/share_instances/724bc53b-1c28-4ab1-b3c8-ab90f868473d => generated 505 bytes in 21 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:57:40 l75lg1-v1 neutron-server[77618]: DEBUG dbcounter [-] [77618] Writing DB stats neutron:UPDATE=1 {{(pid=77618) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:57:40 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-440cea23-73f5-40ad-a1a4-7c3e0fbb0416 tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] GET http://10.27.203.238/share/v2/fe54df7c653849ab8ec7523262c597cf/shares/7da650db-1124-40b5-ba52-fb1170c038c8 May 28 12:57:40 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-440cea23-73f5-40ad-a1a4-7c3e0fbb0416 tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:40 l75lg1-v1 neutron-server[77618]: DEBUG dbcounter [-] [77618] Writing DB stats neutron:SELECT=1 {{(pid=77618) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:57:40 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-440cea23-73f5-40ad-a1a4-7c3e0fbb0416 tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:40 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-440cea23-73f5-40ad-a1a4-7c3e0fbb0416 tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] HTTP exception thrown: The resource could not be found. May 28 12:57:40 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-440cea23-73f5-40ad-a1a4-7c3e0fbb0416 tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] http://10.27.203.238/share/v2/fe54df7c653849ab8ec7523262c597cf/shares/7da650db-1124-40b5-ba52-fb1170c038c8 returned with HTTP 404 May 28 12:57:40 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 374/760] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:57:40 2024] GET /share/v2/fe54df7c653849ab8ec7523262c597cf/shares/7da650db-1124-40b5-ba52-fb1170c038c8 => generated 78 bytes in 13 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 12:57:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a5b23709-72de-4efa-8cc5-29f19d0f7897 tempest-SharesMetadataTest-1561320255 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:57:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a5b23709-72de-4efa-8cc5-29f19d0f7897 tempest-SharesMetadataTest-1561320255 None] [Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=0, created='2024-05-28T12:57:27.845930Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='db0128af-0723-414b-8207-c9145bdfb0e8', id=19, internal=False, is_s3_default_policy=False, name='2be2873c-4768-478e-a848-fb1d2654ca64', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=[], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['*'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['*'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T12:57:28.189334Z', tenant_id=1, tenant_name='default', title='2be2873c-4768-478e-a848-fb1d2654ca64', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/19/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[])] May 28 12:57:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a5b23709-72de-4efa-8cc5-29f19d0f7897 tempest-SharesMetadataTest-1561320255 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 12:57:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a5b23709-72de-4efa-8cc5-29f19d0f7897 tempest-SharesMetadataTest-1561320255 None] >>> [DELETE] https://127.0.0.1:40443/api/viewpolicies/19/ May 28 12:57:40 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-d95d92f3-e5e6-48f4-af31-22fcfdc2bb95 tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] DELETE http://10.27.203.238/share/v2/fe54df7c653849ab8ec7523262c597cf/types/ca9bd8a1-ee0c-41ce-8832-c674458b3deb May 28 12:57:40 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-d95d92f3-e5e6-48f4-af31-22fcfdc2bb95 tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:40 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-d95d92f3-e5e6-48f4-af31-22fcfdc2bb95 tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] Calling method 'ShareTypesController._delete' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-73c32d25-146c-4856-8152-deb6aa1abca7 tempest-ShareIpRulesForNFSTest-1748669711 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:57:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-73c32d25-146c-4856-8152-deb6aa1abca7 tempest-ShareIpRulesForNFSTest-1748669711 None] [] May 28 12:57:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-73c32d25-146c-4856-8152-deb6aa1abca7 tempest-ShareIpRulesForNFSTest-1748669711 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 12:57:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-73c32d25-146c-4856-8152-deb6aa1abca7 tempest-ShareIpRulesForNFSTest-1748669711 None] >>> [POST] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:57:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-73c32d25-146c-4856-8152-deb6aa1abca7 tempest-ShareIpRulesForNFSTest-1748669711 None] {'data': '{"name": "b7a7d61c-2cea-442a-9809-507038e080d5"}', May 28 12:57:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-73c32d25-146c-4856-8152-deb6aa1abca7 tempest-ShareIpRulesForNFSTest-1748669711 None] 'json': None, May 28 12:57:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-73c32d25-146c-4856-8152-deb6aa1abca7 tempest-ShareIpRulesForNFSTest-1748669711 None] 'params': None} May 28 12:57:40 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-d95d92f3-e5e6-48f4-af31-22fcfdc2bb95 tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] http://10.27.203.238/share/v2/fe54df7c653849ab8ec7523262c597cf/types/ca9bd8a1-ee0c-41ce-8832-c674458b3deb returned with HTTP 202 May 28 12:57:40 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 387/761] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:57:40 2024] DELETE /share/v2/fe54df7c653849ab8ec7523262c597cf/types/ca9bd8a1-ee0c-41ce-8832-c674458b3deb => generated 0 bytes in 46 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:57:40 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-89cb870b-e8b1-4c63-84cc-336786219f1b tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] GET http://10.27.203.238/share/v2/fe54df7c653849ab8ec7523262c597cf/types/ca9bd8a1-ee0c-41ce-8832-c674458b3deb May 28 12:57:40 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-89cb870b-e8b1-4c63-84cc-336786219f1b tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:40 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-89cb870b-e8b1-4c63-84cc-336786219f1b tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] Calling method 'ShareTypesController.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:40 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-89cb870b-e8b1-4c63-84cc-336786219f1b tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] HTTP exception thrown: Share type not found. May 28 12:57:40 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-89cb870b-e8b1-4c63-84cc-336786219f1b tempest-SharesActionsAdminTest-1286316336 tempest-SharesActionsAdminTest-1286316336-project-admin] http://10.27.203.238/share/v2/fe54df7c653849ab8ec7523262c597cf/types/ca9bd8a1-ee0c-41ce-8832-c674458b3deb returned with HTTP 404 May 28 12:57:40 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 375/762] 10.27.203.238 () {64 vars in 1448 bytes} [Tue May 28 12:57:40 2024] GET /share/v2/fe54df7c653849ab8ec7523262c597cf/types/ca9bd8a1-ee0c-41ce-8832-c674458b3deb => generated 67 bytes in 14 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 12:57:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b20892-c043-4269-816a-4bab8c160501 service manila] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-14b20892-c043-4269-816a-4bab8c160501 service manila] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b20892-c043-4269-816a-4bab8c160501 service manila] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fdbe05-762b-4490-8281-7b19239dd346 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fdbe05-762b-4490-8281-7b19239dd346 None admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fdbe05-762b-4490-8281-7b19239dd346 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fdbe05-762b-4490-8281-7b19239dd346 None admin] PATH_INFO: `/v3/users/ec5a2b103a70407ba8e53c1f28a98ae9` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fdbe05-762b-4490-8281-7b19239dd346 None admin] RBAC: Authorizing `identity:delete_user(user_id=ec5a2b103a70407ba8e53c1f28a98ae9)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fdbe05-762b-4490-8281-7b19239dd346 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-78fdbe05-762b-4490-8281-7b19239dd346 None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec5a2b103a70407ba8e53c1f28a98ae9', 'request_id': 'req-78fdbe05-762b-4490-8281-7b19239dd346'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-78fdbe05-762b-4490-8281-7b19239dd346 None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec5a2b103a70407ba8e53c1f28a98ae9', 'request_id': 'req-78fdbe05-762b-4490-8281-7b19239dd346'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-78fdbe05-762b-4490-8281-7b19239dd346 None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec5a2b103a70407ba8e53c1f28a98ae9', 'request_id': 'req-78fdbe05-762b-4490-8281-7b19239dd346'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-78fdbe05-762b-4490-8281-7b19239dd346 None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec5a2b103a70407ba8e53c1f28a98ae9', 'request_id': 'req-78fdbe05-762b-4490-8281-7b19239dd346'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f6784d36-6966-4d0d-8f96-f818219fe4a4 tempest-AdminActionsTest-1749172189 None] <<< [GET] https://127.0.0.1:40443/api/quotas/ May 28 12:57:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f6784d36-6966-4d0d-8f96-f818219fe4a4 tempest-AdminActionsTest-1749172189 None] [Bunch(cluster='loop75-kfs', cluster_id=1, default_email=None, default_group_quota=None, default_user_quota=None, enable_alarms=True, enable_email_providers=True, grace_period=None, guid='9f20ada5-e731-436b-979f-d93c5a06c3b8', hard_limit=1073741824, hard_limit_inodes=None, id=17, internal=False, is_user_quota=False, last_user_quotas_update=None, name='724bc53b-1c28-4ab1-b3c8-ab90f868473d', num_blocked_users=0, num_exceeded_users=0, path='/manila/manila-724bc53b-1c28-4ab1-b3c8-ab90f868473d', percent_capacity=0, percent_inodes=None, pretty_grace_period=None, pretty_grace_period_expiration=None, pretty_state='OK (CREATED)', soft_limit=None, soft_limit_inodes=None, state='OK', sync_state='CREATED', system_id=17, tenant_id=1, tenant_name='default', time_to_block=None, title='724bc53b-1c28-4ab1-b3c8-ab90f868473d', url='https://127.0.0.1:40443/api/quotas/17/', used_capacity=0, used_capacity_tb=0.0, used_effective_capacity=0, used_effective_capacity_tb=0.0, used_inodes=0, used_limited_capacity=0)] May 28 12:57:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f6784d36-6966-4d0d-8f96-f818219fe4a4 tempest-AdminActionsTest-1749172189 None] --- [GET] https://127.0.0.1:40443/api/quotas/: Done May 28 12:57:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f6784d36-6966-4d0d-8f96-f818219fe4a4 tempest-AdminActionsTest-1749172189 None] >>> [DELETE] https://127.0.0.1:40443/api/quotas/17/ May 28 12:57:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-78fdbe05-762b-4490-8281-7b19239dd346 None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec5a2b103a70407ba8e53c1f28a98ae9', 'request_id': 'req-78fdbe05-762b-4490-8281-7b19239dd346'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:40 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1007/1989] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 12:57:40 2024] DELETE /identity/v3/users/ec5a2b103a70407ba8e53c1f28a98ae9 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:57:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e015bef-0c7c-43b9-ab51-e0deec4e2727 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e015bef-0c7c-43b9-ab51-e0deec4e2727 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e015bef-0c7c-43b9-ab51-e0deec4e2727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:40 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-8e015bef-0c7c-43b9-ab51-e0deec4e2727 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:57:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-8e015bef-0c7c-43b9-ab51-e0deec4e2727 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:57:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-8e015bef-0c7c-43b9-ab51-e0deec4e2727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:40 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 983/1990] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:57:40 2024] POST /identity/v3/auth/tokens => generated 2960 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 12:57:40 l75lg1-v1 neutron-server[77619]: DEBUG neutron.wsgi [-] (77619) accepted ('10.27.203.238', 41626) {{(pid=77619) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 12:57:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fdbe05-762b-4490-8281-7b19239dd346 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-78fdbe05-762b-4490-8281-7b19239dd346 None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fdbe05-762b-4490-8281-7b19239dd346 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9a7fe4-3718-436e-988b-d68a9cdaba70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef17047035e4b518fd5360a01f2da1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9a7fe4-3718-436e-988b-d68a9cdaba70 service neutron] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9a7fe4-3718-436e-988b-d68a9cdaba70 service neutron] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9a7fe4-3718-436e-988b-d68a9cdaba70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9a7fe4-3718-436e-988b-d68a9cdaba70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9a7fe4-3718-436e-988b-d68a9cdaba70 service neutron] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:40 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1008/1991] 10.27.203.238 () {64 vars in 1432 bytes} [Tue May 28 12:57:40 2024] GET /identity/v3/auth/tokens => generated 2960 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 28 12:57:40 l75lg1-v1 neutron-server[77619]: INFO neutron.wsgi [None req-623ce290-69aa-4751-8dea-26112e70a589 None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=fe54df7c653849ab8ec7523262c597cf&name=default HTTP/1.1" status: 200 len: 216 time: 0.0832751 May 28 12:57:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e015bef-0c7c-43b9-ab51-e0deec4e2727 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-8e015bef-0c7c-43b9-ab51-e0deec4e2727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e015bef-0c7c-43b9-ab51-e0deec4e2727 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62f23c6-76d8-41ff-b2b7-2dc8555f1e33 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62f23c6-76d8-41ff-b2b7-2dc8555f1e33 None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62f23c6-76d8-41ff-b2b7-2dc8555f1e33 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62f23c6-76d8-41ff-b2b7-2dc8555f1e33 None admin] PATH_INFO: `/v3/projects/fe54df7c653849ab8ec7523262c597cf` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62f23c6-76d8-41ff-b2b7-2dc8555f1e33 None admin] RBAC: Authorizing `identity:delete_project(project_id=fe54df7c653849ab8ec7523262c597cf)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62f23c6-76d8-41ff-b2b7-2dc8555f1e33 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-d62f23c6-76d8-41ff-b2b7-2dc8555f1e33 None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe54df7c653849ab8ec7523262c597cf', 'request_id': 'req-d62f23c6-76d8-41ff-b2b7-2dc8555f1e33'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-d62f23c6-76d8-41ff-b2b7-2dc8555f1e33 None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe54df7c653849ab8ec7523262c597cf', 'request_id': 'req-d62f23c6-76d8-41ff-b2b7-2dc8555f1e33'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-d62f23c6-76d8-41ff-b2b7-2dc8555f1e33 None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe54df7c653849ab8ec7523262c597cf', 'request_id': 'req-d62f23c6-76d8-41ff-b2b7-2dc8555f1e33'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-d62f23c6-76d8-41ff-b2b7-2dc8555f1e33 None admin] The token cache is being invalidate because project fe54df7c653849ab8ec7523262c597cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 12:57:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-d62f23c6-76d8-41ff-b2b7-2dc8555f1e33 None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-d62f23c6-76d8-41ff-b2b7-2dc8555f1e33 None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:40 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 984/1992] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 12:57:40 2024] DELETE /identity/v3/projects/fe54df7c653849ab8ec7523262c597cf => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:57:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c251278a-0cb6-4e18-89cb-e7a92d250f07 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c251278a-0cb6-4e18-89cb-e7a92d250f07 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c251278a-0cb6-4e18-89cb-e7a92d250f07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:40 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-c251278a-0cb6-4e18-89cb-e7a92d250f07 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:57:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-c251278a-0cb6-4e18-89cb-e7a92d250f07 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:57:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-c251278a-0cb6-4e18-89cb-e7a92d250f07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:40 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1009/1993] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:57:40 2024] POST /identity/v3/auth/tokens => generated 312 bytes in 23 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 28 12:57:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ea87c0-f1d6-4339-b02f-e9d4bffe0092 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ea87c0-f1d6-4339-b02f-e9d4bffe0092 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ea87c0-f1d6-4339-b02f-e9d4bffe0092 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:40 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-f0ea87c0-f1d6-4339-b02f-e9d4bffe0092 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:57:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-f0ea87c0-f1d6-4339-b02f-e9d4bffe0092 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:57:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-f0ea87c0-f1d6-4339-b02f-e9d4bffe0092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:40 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 985/1994] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:57:40 2024] POST /identity/v3/auth/tokens => generated 2960 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 12:57:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c251278a-0cb6-4e18-89cb-e7a92d250f07 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c251278a-0cb6-4e18-89cb-e7a92d250f07 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949327b9-453b-4cd0-b622-8686a80178d3 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949327b9-453b-4cd0-b622-8686a80178d3 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949327b9-453b-4cd0-b622-8686a80178d3 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949327b9-453b-4cd0-b622-8686a80178d3 None admin] PATH_INFO: `/v3/domains` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949327b9-453b-4cd0-b622-8686a80178d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=51267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:57:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949327b9-453b-4cd0-b622-8686a80178d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949327b9-453b-4cd0-b622-8686a80178d3 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:40 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1010/1995] 10.27.203.238 () {62 vars in 1220 bytes} [Tue May 28 12:57:40 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:57:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ea87c0-f1d6-4339-b02f-e9d4bffe0092 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ea87c0-f1d6-4339-b02f-e9d4bffe0092 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93bd761-818a-43a3-9d9d-d75bd3737344 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93bd761-818a-43a3-9d9d-d75bd3737344 None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93bd761-818a-43a3-9d9d-d75bd3737344 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93bd761-818a-43a3-9d9d-d75bd3737344 None admin] PATH_INFO: `/v3/projects` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93bd761-818a-43a3-9d9d-d75bd3737344 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93bd761-818a-43a3-9d9d-d75bd3737344 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:40 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 986/1996] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 12:57:40 2024] POST /identity/v3/projects => generated 403 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:57:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949327b9-453b-4cd0-b622-8686a80178d3 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949327b9-453b-4cd0-b622-8686a80178d3 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8321f8-9c92-4cad-a7e0-abb97fff8047 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8321f8-9c92-4cad-a7e0-abb97fff8047 None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8321f8-9c92-4cad-a7e0-abb97fff8047 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8321f8-9c92-4cad-a7e0-abb97fff8047 None admin] PATH_INFO: `/v3/users` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8321f8-9c92-4cad-a7e0-abb97fff8047 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8321f8-9c92-4cad-a7e0-abb97fff8047 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:40 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-9b8321f8-9c92-4cad-a7e0-abb97fff8047 None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 12:57:41 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1011/1997] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 12:57:40 2024] POST /identity/v3/users => generated 310 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:57:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93bd761-818a-43a3-9d9d-d75bd3737344 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93bd761-818a-43a3-9d9d-d75bd3737344 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84134f00-6322-48b4-b91e-e22eccb37cde None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84134f00-6322-48b4-b91e-e22eccb37cde None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84134f00-6322-48b4-b91e-e22eccb37cde None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84134f00-6322-48b4-b91e-e22eccb37cde None admin] PATH_INFO: `/v3/roles` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84134f00-6322-48b4-b91e-e22eccb37cde None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84134f00-6322-48b4-b91e-e22eccb37cde None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:41 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 987/1998] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 12:57:41 2024] GET /identity/v3/roles => generated 1680 bytes in 18 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:57:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8321f8-9c92-4cad-a7e0-abb97fff8047 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8321f8-9c92-4cad-a7e0-abb97fff8047 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c05758-c36a-49e0-be23-00d0d9b3ce17 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c05758-c36a-49e0-be23-00d0d9b3ce17 None admin] REQUEST_METHOD: `PUT` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c05758-c36a-49e0-be23-00d0d9b3ce17 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c05758-c36a-49e0-be23-00d0d9b3ce17 None admin] PATH_INFO: `/v3/projects/72d2e8575d3e465b88e866ae4f08f91c/users/d22cff7674b741abb310e84692c76339/roles/44620cad10ae407c90c91e2c296adb04` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c05758-c36a-49e0-be23-00d0d9b3ce17 None admin] RBAC: Authorizing `identity:create_grant(project_id=72d2e8575d3e465b88e866ae4f08f91c, user_id=d22cff7674b741abb310e84692c76339, role_id=44620cad10ae407c90c91e2c296adb04)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c05758-c36a-49e0-be23-00d0d9b3ce17 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:41 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-814b4b1c-0796-47a2-87e9-38fb765c09fd tempest-ShareSnapshotInstancesTest-843694899 None] <<< [DELETE] https://127.0.0.1:40443/api/quotas/11/ May 28 12:57:41 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-814b4b1c-0796-47a2-87e9-38fb765c09fd tempest-ShareSnapshotInstancesTest-843694899 None] --- [DELETE] https://127.0.0.1:40443/api/quotas/11/: Done May 28 12:57:41 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-814b4b1c-0796-47a2-87e9-38fb765c09fd tempest-ShareSnapshotInstancesTest-843694899 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:57:41 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-814b4b1c-0796-47a2-87e9-38fb765c09fd tempest-ShareSnapshotInstancesTest-843694899 None] {'allow_redirects': True, May 28 12:57:41 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-814b4b1c-0796-47a2-87e9-38fb765c09fd tempest-ShareSnapshotInstancesTest-843694899 None] 'params': {'name': 'c2f741cd-bac5-499f-9539-8e93d6a81282'}} May 28 12:57:41 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1012/1999] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 12:57:41 2024] PUT /identity/v3/projects/72d2e8575d3e465b88e866ae4f08f91c/users/d22cff7674b741abb310e84692c76339/roles/44620cad10ae407c90c91e2c296adb04 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:57:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479fc6f5-e63d-415c-97ca-36a58fb8ca90 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479fc6f5-e63d-415c-97ca-36a58fb8ca90 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479fc6f5-e63d-415c-97ca-36a58fb8ca90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:41 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-479fc6f5-e63d-415c-97ca-36a58fb8ca90 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:57:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-479fc6f5-e63d-415c-97ca-36a58fb8ca90 None None] MFA Rules not processed for user `d22cff7674b741abb310e84692c76339`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:57:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-479fc6f5-e63d-415c-97ca-36a58fb8ca90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:41 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 988/2000] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:57:41 2024] POST /identity/v3/auth/tokens => generated 3974 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:57:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c05758-c36a-49e0-be23-00d0d9b3ce17 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-21c05758-c36a-49e0-be23-00d0d9b3ce17 None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c05758-c36a-49e0-be23-00d0d9b3ce17 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-4151a0bc-cf86-49d1-8736-0a46902ef16b tempest-ShareSnapshotInstancesTest-843694899 tempest-ShareSnapshotInstancesTest-843694899-project-admin] GET http://10.27.203.238/share/v2/f4f7702aa04c467288cc6b142f61ec37/shares/b235c40f-7437-4e0c-b44e-321d8e8b1457 May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-4151a0bc-cf86-49d1-8736-0a46902ef16b tempest-ShareSnapshotInstancesTest-843694899 tempest-ShareSnapshotInstancesTest-843694899-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-4151a0bc-cf86-49d1-8736-0a46902ef16b tempest-ShareSnapshotInstancesTest-843694899 tempest-ShareSnapshotInstancesTest-843694899-project-admin] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecee761-070c-4bda-86ee-9c1da1217936 service manila] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f110cf6300f049c897d0aab63218d1e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecee761-070c-4bda-86ee-9c1da1217936 service manila] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecee761-070c-4bda-86ee-9c1da1217936 service manila] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecee761-070c-4bda-86ee-9c1da1217936 service manila] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecee761-070c-4bda-86ee-9c1da1217936 service manila] RBAC: Authorizing `identity:validate_token()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecee761-070c-4bda-86ee-9c1da1217936 service manila] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:41 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1013/2001] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 12:57:41 2024] GET /identity/v3/auth/tokens => generated 3974 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 12:57:41 l75lg1-v1 dstat.sh[49771]: 28-05 12:57:41| 10 1 86 2 0|5696M 1796M 277M 7856M| 27k 3761B| 0 2044k| 0 224 |7155 11k|1.63 1.08 1.02|3.0 1.0 0| 0 0 | 0 2048M| 29 358 0 66 0 May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-db77a94b-765d-4a77-9a32-eacc38a9b5a4 tempest-SharesMetadataAPIOnlyNegativeTest-410031080 tempest-SharesMetadataAPIOnlyNegativeTest-410031080-project-member] POST http://10.27.203.238/share/v2/72d2e8575d3e465b88e866ae4f08f91c/shares/wrong_share_id/metadata May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-db77a94b-765d-4a77-9a32-eacc38a9b5a4 tempest-SharesMetadataAPIOnlyNegativeTest-410031080 tempest-SharesMetadataAPIOnlyNegativeTest-410031080-project-member] Action: 'create_metadata', calling method: Controller.__getattribute__..version_select, body: {"metadata": {"key1": "value1", "key2": "value2"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault [None req-db77a94b-765d-4a77-9a32-eacc38a9b5a4 tempest-SharesMetadataAPIOnlyNegativeTest-410031080 tempest-SharesMetadataAPIOnlyNegativeTest-410031080-project-member] Caught error: Resource could not be found.: manila.exception.NotFound: Resource could not be found. May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault Traceback (most recent call last): May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/api/middleware/fault.py", line 76, in __call__ May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault return req.get_response(self.application) May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/request.py", line 1313, in send May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault status, headers, app_iter = self.call_application( May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/request.py", line 1278, in call_application May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault app_iter = application(self.environ, start_response) May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 129, in __call__ May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault resp = self.call_func(req, *args, **kw) May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 193, in call_func May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault return self.func(req, *args, **kwargs) May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_middleware/base.py", line 124, in __call__ May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault response = req.get_response(self.application) May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/request.py", line 1313, in send May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault status, headers, app_iter = self.call_application( May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/request.py", line 1278, in call_application May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault app_iter = application(self.environ, start_response) May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 143, in __call__ May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault return resp(environ, start_response) May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 129, in __call__ May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault resp = self.call_func(req, *args, **kw) May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 193, in call_func May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault return self.func(req, *args, **kwargs) May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/osprofiler/web.py", line 111, in __call__ May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault return request.get_response(self.application) May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/request.py", line 1313, in send May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault status, headers, app_iter = self.call_application( May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/request.py", line 1278, in call_application May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault app_iter = application(self.environ, start_response) May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 129, in __call__ May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault resp = self.call_func(req, *args, **kw) May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 193, in call_func May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault return self.func(req, *args, **kwargs) May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py", line 340, in __call__ May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault response = req.get_response(self._app) May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/request.py", line 1313, in send May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault status, headers, app_iter = self.call_application( May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/request.py", line 1278, in call_application May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault app_iter = application(self.environ, start_response) May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 143, in __call__ May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault return resp(environ, start_response) May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 143, in __call__ May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault return resp(environ, start_response) May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/routes/middleware.py", line 153, in __call__ May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault response = self.app(environ, start_response) May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 143, in __call__ May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault return resp(environ, start_response) May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 129, in __call__ May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault resp = self.call_func(req, *args, **kw) May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 193, in call_func May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault return self.func(req, *args, **kwargs) May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/api/openstack/wsgi.py", line 764, in __call__ May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault return self._process_stack(request, action, action_args, May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/api/openstack/wsgi.py", line 829, in _process_stack May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault action_result = self.dispatch(meth, request, action_args) May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/api/openstack/wsgi.py", line 924, in dispatch May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault return method(req=request, **action_args) May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/api/openstack/wsgi.py", line 1066, in version_select May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault return func.func(self, *args, **kwargs) May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/api/openstack/wsgi.py", line 1160, in wrapper May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault return f(self, req, *args, **kwargs) May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/api/v2/shares.py", line 670, in create_metadata May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault _metadata = self._validate_metadata_for_update(req, resource_id, May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/api/v2/shares.py", line 642, in _validate_metadata_for_update May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault current_share_metadata = db.share_metadata_get(context, share_id) May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/db/api.py", line 931, in share_metadata_get May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault return IMPL.share_metadata_get(context, share_id) May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/db/sqlalchemy/api.py", line 166, in wrapper May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault return f(*args, **kwargs) May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/db/sqlalchemy/api.py", line 178, in wrapper May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault share_get(context, share_id) May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/db/sqlalchemy/api.py", line 166, in wrapper May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault return f(*args, **kwargs) May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/enginefacade.py", line 998, in wrapper May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault return fn(*args, **kwargs) May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/db/sqlalchemy/api.py", line 2367, in share_get May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault return _share_get(context, share_id, **kwargs) May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/db/sqlalchemy/api.py", line 2378, in _share_get May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault raise exception.NotFound() May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault manila.exception.NotFound: Resource could not be found. May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.middleware.fault [None req-db77a94b-765d-4a77-9a32-eacc38a9b5a4 tempest-SharesMetadataAPIOnlyNegativeTest-410031080 tempest-SharesMetadataAPIOnlyNegativeTest-410031080-project-member] http://10.27.203.238/share/v2/72d2e8575d3e465b88e866ae4f08f91c/shares/wrong_share_id/metadata returned with HTTP 404 May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-4151a0bc-cf86-49d1-8736-0a46902ef16b tempest-ShareSnapshotInstancesTest-843694899 tempest-ShareSnapshotInstancesTest-843694899-project-admin] http://10.27.203.238/share/v2/f4f7702aa04c467288cc6b142f61ec37/shares/b235c40f-7437-4e0c-b44e-321d8e8b1457 returned with HTTP 200 May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 376/763] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:57:41 2024] GET /share/v2/f4f7702aa04c467288cc6b142f61ec37/shares/b235c40f-7437-4e0c-b44e-321d8e8b1457 => generated 1372 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 388/764] 10.27.203.238 () {66 vars in 1433 bytes} [Tue May 28 12:57:41 2024] POST /share/v2/72d2e8575d3e465b88e866ae4f08f91c/shares/wrong_share_id/metadata => generated 84 bytes in 82 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-ec57cdc1-411e-4940-a96b-38527df6d809 tempest-SharesMetadataAPIOnlyNegativeTest-410031080 tempest-SharesMetadataAPIOnlyNegativeTest-410031080-project-member] POST http://10.27.203.238/share/v1/72d2e8575d3e465b88e866ae4f08f91c/shares/wrong_share_id/metadata May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-ec57cdc1-411e-4940-a96b-38527df6d809 tempest-SharesMetadataAPIOnlyNegativeTest-410031080 tempest-SharesMetadataAPIOnlyNegativeTest-410031080-project-member] Action: 'create', calling method: ShareMetadataController.create, body: {"metadata": {"key1": "value1", "key2": "value2"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-ec57cdc1-411e-4940-a96b-38527df6d809 tempest-SharesMetadataAPIOnlyNegativeTest-410031080 tempest-SharesMetadataAPIOnlyNegativeTest-410031080-project-member] HTTP exception thrown: share does not exist May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-ec57cdc1-411e-4940-a96b-38527df6d809 tempest-SharesMetadataAPIOnlyNegativeTest-410031080 tempest-SharesMetadataAPIOnlyNegativeTest-410031080-project-member] http://10.27.203.238/share/v1/72d2e8575d3e465b88e866ae4f08f91c/shares/wrong_share_id/metadata returned with HTTP 404 May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 377/765] 10.27.203.238 () {64 vars in 1390 bytes} [Tue May 28 12:57:41 2024] POST /share/v1/72d2e8575d3e465b88e866ae4f08f91c/shares/wrong_share_id/metadata => generated 66 bytes in 14 msecs (HTTP/1.1 404) 6 headers in 236 bytes (1 switches on core 0) May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-da1b2b2b-ecfd-4001-92f5-a577c6bfefaf tempest-SharesMetadataAPIOnlyNegativeTest-410031080 tempest-SharesMetadataAPIOnlyNegativeTest-410031080-project-member] PUT http://10.27.203.238/share/v2/72d2e8575d3e465b88e866ae4f08f91c/shares/wrong_share_id/metadata May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-da1b2b2b-ecfd-4001-92f5-a577c6bfefaf tempest-SharesMetadataAPIOnlyNegativeTest-410031080 tempest-SharesMetadataAPIOnlyNegativeTest-410031080-project-member] Action: 'update_all_metadata', calling method: Controller.__getattribute__..version_select, body: {"metadata": {"key1": "value1", "key2": "value2"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault [None req-da1b2b2b-ecfd-4001-92f5-a577c6bfefaf tempest-SharesMetadataAPIOnlyNegativeTest-410031080 tempest-SharesMetadataAPIOnlyNegativeTest-410031080-project-member] Caught error: Resource could not be found.: manila.exception.NotFound: Resource could not be found. May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault Traceback (most recent call last): May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/api/middleware/fault.py", line 76, in __call__ May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault return req.get_response(self.application) May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/request.py", line 1313, in send May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault status, headers, app_iter = self.call_application( May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/request.py", line 1278, in call_application May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault app_iter = application(self.environ, start_response) May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 129, in __call__ May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault resp = self.call_func(req, *args, **kw) May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 193, in call_func May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault return self.func(req, *args, **kwargs) May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_middleware/base.py", line 124, in __call__ May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault response = req.get_response(self.application) May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/request.py", line 1313, in send May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault status, headers, app_iter = self.call_application( May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/request.py", line 1278, in call_application May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault app_iter = application(self.environ, start_response) May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 143, in __call__ May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault return resp(environ, start_response) May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 129, in __call__ May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault resp = self.call_func(req, *args, **kw) May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 193, in call_func May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault return self.func(req, *args, **kwargs) May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/osprofiler/web.py", line 111, in __call__ May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault return request.get_response(self.application) May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/request.py", line 1313, in send May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault status, headers, app_iter = self.call_application( May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/request.py", line 1278, in call_application May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault app_iter = application(self.environ, start_response) May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 129, in __call__ May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault resp = self.call_func(req, *args, **kw) May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 193, in call_func May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault return self.func(req, *args, **kwargs) May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py", line 340, in __call__ May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault response = req.get_response(self._app) May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/request.py", line 1313, in send May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault status, headers, app_iter = self.call_application( May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/request.py", line 1278, in call_application May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault app_iter = application(self.environ, start_response) May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 143, in __call__ May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault return resp(environ, start_response) May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 143, in __call__ May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault return resp(environ, start_response) May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/routes/middleware.py", line 153, in __call__ May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault response = self.app(environ, start_response) May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 143, in __call__ May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault return resp(environ, start_response) May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 129, in __call__ May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault resp = self.call_func(req, *args, **kw) May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 193, in call_func May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault return self.func(req, *args, **kwargs) May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/api/openstack/wsgi.py", line 764, in __call__ May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault return self._process_stack(request, action, action_args, May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/api/openstack/wsgi.py", line 829, in _process_stack May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault action_result = self.dispatch(meth, request, action_args) May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/api/openstack/wsgi.py", line 924, in dispatch May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault return method(req=request, **action_args) May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/api/openstack/wsgi.py", line 1066, in version_select May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault return func.func(self, *args, **kwargs) May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/api/openstack/wsgi.py", line 1160, in wrapper May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault return f(self, req, *args, **kwargs) May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/api/v2/shares.py", line 682, in update_all_metadata May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault _metadata = self._validate_metadata_for_update(req, resource_id, May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/api/v2/shares.py", line 642, in _validate_metadata_for_update May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault current_share_metadata = db.share_metadata_get(context, share_id) May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/db/api.py", line 931, in share_metadata_get May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault return IMPL.share_metadata_get(context, share_id) May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/db/sqlalchemy/api.py", line 166, in wrapper May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault return f(*args, **kwargs) May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/db/sqlalchemy/api.py", line 178, in wrapper May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault share_get(context, share_id) May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/db/sqlalchemy/api.py", line 166, in wrapper May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault return f(*args, **kwargs) May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/enginefacade.py", line 998, in wrapper May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault return fn(*args, **kwargs) May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/db/sqlalchemy/api.py", line 2367, in share_get May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault return _share_get(context, share_id, **kwargs) May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/db/sqlalchemy/api.py", line 2378, in _share_get May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault raise exception.NotFound() May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault manila.exception.NotFound: Resource could not be found. May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.middleware.fault [None req-da1b2b2b-ecfd-4001-92f5-a577c6bfefaf tempest-SharesMetadataAPIOnlyNegativeTest-410031080 tempest-SharesMetadataAPIOnlyNegativeTest-410031080-project-member] http://10.27.203.238/share/v2/72d2e8575d3e465b88e866ae4f08f91c/shares/wrong_share_id/metadata returned with HTTP 404 May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 389/766] 10.27.203.238 () {66 vars in 1432 bytes} [Tue May 28 12:57:41 2024] PUT /share/v2/72d2e8575d3e465b88e866ae4f08f91c/shares/wrong_share_id/metadata => generated 84 bytes in 15 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-a25e8288-50e1-44cc-939d-f7d6f769e38e tempest-SharesMetadataAPIOnlyNegativeTest-410031080 tempest-SharesMetadataAPIOnlyNegativeTest-410031080-project-member] PUT http://10.27.203.238/share/v1/72d2e8575d3e465b88e866ae4f08f91c/shares/wrong_share_id/metadata May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-a25e8288-50e1-44cc-939d-f7d6f769e38e tempest-SharesMetadataAPIOnlyNegativeTest-410031080 tempest-SharesMetadataAPIOnlyNegativeTest-410031080-project-member] Action: 'update_all', calling method: ShareMetadataController.update_all, body: {"metadata": {"key1": "value1", "key2": "value2"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-a25e8288-50e1-44cc-939d-f7d6f769e38e tempest-SharesMetadataAPIOnlyNegativeTest-410031080 tempest-SharesMetadataAPIOnlyNegativeTest-410031080-project-member] HTTP exception thrown: share does not exist May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-a25e8288-50e1-44cc-939d-f7d6f769e38e tempest-SharesMetadataAPIOnlyNegativeTest-410031080 tempest-SharesMetadataAPIOnlyNegativeTest-410031080-project-member] http://10.27.203.238/share/v1/72d2e8575d3e465b88e866ae4f08f91c/shares/wrong_share_id/metadata returned with HTTP 404 May 28 12:57:41 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 378/767] 10.27.203.238 () {64 vars in 1389 bytes} [Tue May 28 12:57:41 2024] PUT /share/v1/72d2e8575d3e465b88e866ae4f08f91c/shares/wrong_share_id/metadata => generated 66 bytes in 11 msecs (HTTP/1.1 404) 6 headers in 236 bytes (1 switches on core 0) May 28 12:57:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479fc6f5-e63d-415c-97ca-36a58fb8ca90 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:41 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-73c32d25-146c-4856-8152-deb6aa1abca7 tempest-ShareIpRulesForNFSTest-1748669711 None] <<< [POST] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:57:41 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-73c32d25-146c-4856-8152-deb6aa1abca7 tempest-ShareIpRulesForNFSTest-1748669711 None] Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=0, created='2024-05-28T12:57:40.763635Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='377955ad-d094-4e49-ab32-1021d943a572', id=21, internal=False, is_s3_default_policy=False, name='b7a7d61c-2cea-442a-9809-507038e080d5', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=[], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['*'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['*'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T12:57:41.242917Z', tenant_id=1, tenant_name='default', title='b7a7d61c-2cea-442a-9809-507038e080d5', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/21/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[]) May 28 12:57:41 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-73c32d25-146c-4856-8152-deb6aa1abca7 tempest-ShareIpRulesForNFSTest-1748669711 None] --- [POST] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 12:57:41 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-73c32d25-146c-4856-8152-deb6aa1abca7 tempest-ShareIpRulesForNFSTest-1748669711 None] >>> [GET] https://127.0.0.1:40443/api/quotas/ May 28 12:57:41 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-73c32d25-146c-4856-8152-deb6aa1abca7 tempest-ShareIpRulesForNFSTest-1748669711 None] {'allow_redirects': True, May 28 12:57:41 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-73c32d25-146c-4856-8152-deb6aa1abca7 tempest-ShareIpRulesForNFSTest-1748669711 None] 'params': {'name': 'b7a7d61c-2cea-442a-9809-507038e080d5'}} May 28 12:57:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479fc6f5-e63d-415c-97ca-36a58fb8ca90 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a223b8-4e01-4257-baf5-55155c057e7a None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a223b8-4e01-4257-baf5-55155c057e7a None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a223b8-4e01-4257-baf5-55155c057e7a None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a223b8-4e01-4257-baf5-55155c057e7a None admin] PATH_INFO: `/v3/users/d22cff7674b741abb310e84692c76339` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a223b8-4e01-4257-baf5-55155c057e7a None admin] RBAC: Authorizing `identity:delete_user(user_id=d22cff7674b741abb310e84692c76339)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a223b8-4e01-4257-baf5-55155c057e7a None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-94a223b8-4e01-4257-baf5-55155c057e7a None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd22cff7674b741abb310e84692c76339', 'request_id': 'req-94a223b8-4e01-4257-baf5-55155c057e7a'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-94a223b8-4e01-4257-baf5-55155c057e7a None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd22cff7674b741abb310e84692c76339', 'request_id': 'req-94a223b8-4e01-4257-baf5-55155c057e7a'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-94a223b8-4e01-4257-baf5-55155c057e7a None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd22cff7674b741abb310e84692c76339', 'request_id': 'req-94a223b8-4e01-4257-baf5-55155c057e7a'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-94a223b8-4e01-4257-baf5-55155c057e7a None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd22cff7674b741abb310e84692c76339', 'request_id': 'req-94a223b8-4e01-4257-baf5-55155c057e7a'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-94a223b8-4e01-4257-baf5-55155c057e7a None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd22cff7674b741abb310e84692c76339', 'request_id': 'req-94a223b8-4e01-4257-baf5-55155c057e7a'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:41 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 989/2002] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 12:57:41 2024] DELETE /identity/v3/users/d22cff7674b741abb310e84692c76339 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:57:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795d5319-41bd-468d-94cb-b906862881d3 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795d5319-41bd-468d-94cb-b906862881d3 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795d5319-41bd-468d-94cb-b906862881d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:41 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-795d5319-41bd-468d-94cb-b906862881d3 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:57:41 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-814b4b1c-0796-47a2-87e9-38fb765c09fd tempest-ShareSnapshotInstancesTest-843694899 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:57:41 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-814b4b1c-0796-47a2-87e9-38fb765c09fd tempest-ShareSnapshotInstancesTest-843694899 None] [Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=0, created='2024-05-28T12:57:13.803333Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='f7d455a0-d2cb-4d17-917a-e41748cee8af', id=14, internal=False, is_s3_default_policy=False, name='c2f741cd-bac5-499f-9539-8e93d6a81282', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=[], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['*'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['*'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T12:57:14.146855Z', tenant_id=1, tenant_name='default', title='c2f741cd-bac5-499f-9539-8e93d6a81282', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/14/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[])] May 28 12:57:41 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-814b4b1c-0796-47a2-87e9-38fb765c09fd tempest-ShareSnapshotInstancesTest-843694899 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 12:57:41 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-814b4b1c-0796-47a2-87e9-38fb765c09fd tempest-ShareSnapshotInstancesTest-843694899 None] >>> [DELETE] https://127.0.0.1:40443/api/viewpolicies/14/ May 28 12:57:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-795d5319-41bd-468d-94cb-b906862881d3 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:57:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-795d5319-41bd-468d-94cb-b906862881d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:41 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1014/2003] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:57:41 2024] POST /identity/v3/auth/tokens => generated 2960 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 12:57:41 l75lg1-v1 neutron-server[77619]: DEBUG neutron.wsgi [-] (77619) accepted ('10.27.203.238', 41636) {{(pid=77619) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 12:57:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a223b8-4e01-4257-baf5-55155c057e7a None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-94a223b8-4e01-4257-baf5-55155c057e7a None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a223b8-4e01-4257-baf5-55155c057e7a None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9b8da6-1b69-4bea-bd1b-20d8d1a33522 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef17047035e4b518fd5360a01f2da1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9b8da6-1b69-4bea-bd1b-20d8d1a33522 service neutron] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9b8da6-1b69-4bea-bd1b-20d8d1a33522 service neutron] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9b8da6-1b69-4bea-bd1b-20d8d1a33522 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9b8da6-1b69-4bea-bd1b-20d8d1a33522 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9b8da6-1b69-4bea-bd1b-20d8d1a33522 service neutron] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:41 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 990/2004] 10.27.203.238 () {64 vars in 1432 bytes} [Tue May 28 12:57:41 2024] GET /identity/v3/auth/tokens => generated 2960 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 28 12:57:41 l75lg1-v1 neutron-server[77619]: INFO neutron.wsgi [None req-229468d4-2e03-4294-9360-7fab8da19d70 None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=72d2e8575d3e465b88e866ae4f08f91c&name=default HTTP/1.1" status: 200 len: 216 time: 0.0803678 May 28 12:57:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795d5319-41bd-468d-94cb-b906862881d3 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-795d5319-41bd-468d-94cb-b906862881d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795d5319-41bd-468d-94cb-b906862881d3 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab889c7-db78-45fd-bed0-56e7fdbdb2d5 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab889c7-db78-45fd-bed0-56e7fdbdb2d5 None admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab889c7-db78-45fd-bed0-56e7fdbdb2d5 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab889c7-db78-45fd-bed0-56e7fdbdb2d5 None admin] PATH_INFO: `/v3/projects/72d2e8575d3e465b88e866ae4f08f91c` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab889c7-db78-45fd-bed0-56e7fdbdb2d5 None admin] RBAC: Authorizing `identity:delete_project(project_id=72d2e8575d3e465b88e866ae4f08f91c)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab889c7-db78-45fd-bed0-56e7fdbdb2d5 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-7ab889c7-db78-45fd-bed0-56e7fdbdb2d5 None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72d2e8575d3e465b88e866ae4f08f91c', 'request_id': 'req-7ab889c7-db78-45fd-bed0-56e7fdbdb2d5'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-7ab889c7-db78-45fd-bed0-56e7fdbdb2d5 None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72d2e8575d3e465b88e866ae4f08f91c', 'request_id': 'req-7ab889c7-db78-45fd-bed0-56e7fdbdb2d5'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-7ab889c7-db78-45fd-bed0-56e7fdbdb2d5 None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72d2e8575d3e465b88e866ae4f08f91c', 'request_id': 'req-7ab889c7-db78-45fd-bed0-56e7fdbdb2d5'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-7ab889c7-db78-45fd-bed0-56e7fdbdb2d5 None admin] The token cache is being invalidate because project 72d2e8575d3e465b88e866ae4f08f91c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 12:57:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-7ab889c7-db78-45fd-bed0-56e7fdbdb2d5 None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-7ab889c7-db78-45fd-bed0-56e7fdbdb2d5 None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:41 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1015/2005] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 12:57:41 2024] DELETE /identity/v3/projects/72d2e8575d3e465b88e866ae4f08f91c => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:57:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e06dadd-cad8-4e99-8e98-ff1539403453 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e06dadd-cad8-4e99-8e98-ff1539403453 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e06dadd-cad8-4e99-8e98-ff1539403453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:41 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-9e06dadd-cad8-4e99-8e98-ff1539403453 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:57:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-9e06dadd-cad8-4e99-8e98-ff1539403453 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:57:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-9e06dadd-cad8-4e99-8e98-ff1539403453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:41 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 991/2006] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:57:41 2024] POST /identity/v3/auth/tokens => generated 312 bytes in 21 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 28 12:57:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4500aa7-67a2-422f-b5a2-586d246d6c1d None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4500aa7-67a2-422f-b5a2-586d246d6c1d None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4500aa7-67a2-422f-b5a2-586d246d6c1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:41 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-b4500aa7-67a2-422f-b5a2-586d246d6c1d None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:57:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-b4500aa7-67a2-422f-b5a2-586d246d6c1d None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:57:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-b4500aa7-67a2-422f-b5a2-586d246d6c1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:41 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1016/2007] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:57:41 2024] POST /identity/v3/auth/tokens => generated 2960 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 12:57:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e06dadd-cad8-4e99-8e98-ff1539403453 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e06dadd-cad8-4e99-8e98-ff1539403453 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d799275a-3121-4d9b-aa1e-31fa97ed8f5e None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d799275a-3121-4d9b-aa1e-31fa97ed8f5e None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d799275a-3121-4d9b-aa1e-31fa97ed8f5e None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d799275a-3121-4d9b-aa1e-31fa97ed8f5e None admin] PATH_INFO: `/v3/domains` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d799275a-3121-4d9b-aa1e-31fa97ed8f5e None admin] RBAC: Adding query filter params (name=Default) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:57:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d799275a-3121-4d9b-aa1e-31fa97ed8f5e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d799275a-3121-4d9b-aa1e-31fa97ed8f5e None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:41 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 992/2008] 10.27.203.238 () {62 vars in 1220 bytes} [Tue May 28 12:57:41 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:57:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4500aa7-67a2-422f-b5a2-586d246d6c1d None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4500aa7-67a2-422f-b5a2-586d246d6c1d None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbd9bc8-20d2-46d5-a187-e68e47df0d9b None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbd9bc8-20d2-46d5-a187-e68e47df0d9b None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbd9bc8-20d2-46d5-a187-e68e47df0d9b None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbd9bc8-20d2-46d5-a187-e68e47df0d9b None admin] PATH_INFO: `/v3/projects` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbd9bc8-20d2-46d5-a187-e68e47df0d9b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbd9bc8-20d2-46d5-a187-e68e47df0d9b None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:41 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1017/2009] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 12:57:41 2024] POST /identity/v3/projects => generated 391 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:57:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d799275a-3121-4d9b-aa1e-31fa97ed8f5e None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d799275a-3121-4d9b-aa1e-31fa97ed8f5e None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686196fd-12d9-4d64-a49f-26b4ea814461 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686196fd-12d9-4d64-a49f-26b4ea814461 None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686196fd-12d9-4d64-a49f-26b4ea814461 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686196fd-12d9-4d64-a49f-26b4ea814461 None admin] PATH_INFO: `/v3/users` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686196fd-12d9-4d64-a49f-26b4ea814461 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686196fd-12d9-4d64-a49f-26b4ea814461 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:41 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-686196fd-12d9-4d64-a49f-26b4ea814461 None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 12:57:41 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 993/2010] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 12:57:41 2024] POST /identity/v3/users => generated 304 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:57:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbd9bc8-20d2-46d5-a187-e68e47df0d9b None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbd9bc8-20d2-46d5-a187-e68e47df0d9b None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:41 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-73c32d25-146c-4856-8152-deb6aa1abca7 tempest-ShareIpRulesForNFSTest-1748669711 None] <<< [GET] https://127.0.0.1:40443/api/quotas/ May 28 12:57:41 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-73c32d25-146c-4856-8152-deb6aa1abca7 tempest-ShareIpRulesForNFSTest-1748669711 None] [] May 28 12:57:41 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-73c32d25-146c-4856-8152-deb6aa1abca7 tempest-ShareIpRulesForNFSTest-1748669711 None] --- [GET] https://127.0.0.1:40443/api/quotas/: Done May 28 12:57:41 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-73c32d25-146c-4856-8152-deb6aa1abca7 tempest-ShareIpRulesForNFSTest-1748669711 None] >>> [POST] https://127.0.0.1:40443/api/quotas/ May 28 12:57:41 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-73c32d25-146c-4856-8152-deb6aa1abca7 tempest-ShareIpRulesForNFSTest-1748669711 None] {'data': '{"name": "b7a7d61c-2cea-442a-9809-507038e080d5", "path": ' May 28 12:57:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2c463a-6578-4d7f-bb51-5eb213cea8bc None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:41 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-73c32d25-146c-4856-8152-deb6aa1abca7 tempest-ShareIpRulesForNFSTest-1748669711 None] '"/manila/manila-b7a7d61c-2cea-442a-9809-507038e080d5", "create_dir": ' May 28 12:57:41 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-73c32d25-146c-4856-8152-deb6aa1abca7 tempest-ShareIpRulesForNFSTest-1748669711 None] 'true, "hard_limit": 1073741824}', May 28 12:57:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2c463a-6578-4d7f-bb51-5eb213cea8bc None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:41 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-73c32d25-146c-4856-8152-deb6aa1abca7 tempest-ShareIpRulesForNFSTest-1748669711 None] 'json': None, May 28 12:57:41 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-73c32d25-146c-4856-8152-deb6aa1abca7 tempest-ShareIpRulesForNFSTest-1748669711 None] 'params': None} May 28 12:57:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2c463a-6578-4d7f-bb51-5eb213cea8bc None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2c463a-6578-4d7f-bb51-5eb213cea8bc None admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2c463a-6578-4d7f-bb51-5eb213cea8bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2c463a-6578-4d7f-bb51-5eb213cea8bc None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:41 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1018/2011] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 12:57:41 2024] GET /identity/v3/roles => generated 1680 bytes in 17 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:57:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686196fd-12d9-4d64-a49f-26b4ea814461 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686196fd-12d9-4d64-a49f-26b4ea814461 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a247cb3d-7a4e-4893-ba88-fa27554eb26f None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a247cb3d-7a4e-4893-ba88-fa27554eb26f None admin] REQUEST_METHOD: `PUT` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a247cb3d-7a4e-4893-ba88-fa27554eb26f None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a247cb3d-7a4e-4893-ba88-fa27554eb26f None admin] PATH_INFO: `/v3/projects/5e5bc0c8fb8b46d598b0621999301112/users/b0864c216255411892f92de6eedf4968/roles/44620cad10ae407c90c91e2c296adb04` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a247cb3d-7a4e-4893-ba88-fa27554eb26f None admin] RBAC: Authorizing `identity:create_grant(project_id=5e5bc0c8fb8b46d598b0621999301112, user_id=b0864c216255411892f92de6eedf4968, role_id=44620cad10ae407c90c91e2c296adb04)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a247cb3d-7a4e-4893-ba88-fa27554eb26f None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:41 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 994/2012] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 12:57:41 2024] PUT /identity/v3/projects/5e5bc0c8fb8b46d598b0621999301112/users/b0864c216255411892f92de6eedf4968/roles/44620cad10ae407c90c91e2c296adb04 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 28 12:57:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db27bba-ab8d-414f-bb11-fe5343939e58 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db27bba-ab8d-414f-bb11-fe5343939e58 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db27bba-ab8d-414f-bb11-fe5343939e58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:41 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-0db27bba-ab8d-414f-bb11-fe5343939e58 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:57:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-0db27bba-ab8d-414f-bb11-fe5343939e58 None None] MFA Rules not processed for user `b0864c216255411892f92de6eedf4968`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:57:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-0db27bba-ab8d-414f-bb11-fe5343939e58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:42 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a5b23709-72de-4efa-8cc5-29f19d0f7897 tempest-SharesMetadataTest-1561320255 None] <<< [DELETE] https://127.0.0.1:40443/api/viewpolicies/19/ May 28 12:57:42 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a5b23709-72de-4efa-8cc5-29f19d0f7897 tempest-SharesMetadataTest-1561320255 None] --- [DELETE] https://127.0.0.1:40443/api/viewpolicies/19/: Done May 28 12:57:42 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1019/2013] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:57:41 2024] POST /identity/v3/auth/tokens => generated 3962 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:57:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a247cb3d-7a4e-4893-ba88-fa27554eb26f None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a247cb3d-7a4e-4893-ba88-fa27554eb26f None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9add43d-d8f4-44b6-8fdf-fe155bec6305 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9add43d-d8f4-44b6-8fdf-fe155bec6305 None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9add43d-d8f4-44b6-8fdf-fe155bec6305 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9add43d-d8f4-44b6-8fdf-fe155bec6305 None admin] PATH_INFO: `/v3/projects` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9add43d-d8f4-44b6-8fdf-fe155bec6305 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9add43d-d8f4-44b6-8fdf-fe155bec6305 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:42 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 995/2014] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 12:57:42 2024] POST /identity/v3/projects => generated 389 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:57:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db27bba-ab8d-414f-bb11-fe5343939e58 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db27bba-ab8d-414f-bb11-fe5343939e58 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:42 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-a5b23709-72de-4efa-8cc5-29f19d0f7897 tempest-SharesMetadataTest-1561320255 None] Created reservations ['ded18d69-a3b1-4ad8-add7-d8f6de4df58d', '5e5f434b-49e2-4a9d-b675-8129fa126359', '1fb3919b-73cb-4cce-880d-8be2e1a4a1bd', '6e2f99b8-6691-4339-80b4-ed26e57f6ced'] {{(pid=98474) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 12:57:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fed5d30-9633-49ab-b86f-d90411be33da None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fed5d30-9633-49ab-b86f-d90411be33da None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fed5d30-9633-49ab-b86f-d90411be33da None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fed5d30-9633-49ab-b86f-d90411be33da None admin] PATH_INFO: `/v3/users` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fed5d30-9633-49ab-b86f-d90411be33da None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fed5d30-9633-49ab-b86f-d90411be33da None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:42 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-1fed5d30-9633-49ab-b86f-d90411be33da None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 12:57:42 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-a5b23709-72de-4efa-8cc5-29f19d0f7897 tempest-SharesMetadataTest-1561320255 None] Committed reservations ['ded18d69-a3b1-4ad8-add7-d8f6de4df58d', '5e5f434b-49e2-4a9d-b675-8129fa126359', '1fb3919b-73cb-4cce-880d-8be2e1a4a1bd', '6e2f99b8-6691-4339-80b4-ed26e57f6ced'] {{(pid=98474) commit /opt/stack/manila/manila/quota.py:1063}} May 28 12:57:42 l75lg1-v1 manila-share[98474]: INFO manila.share.manager [None req-a5b23709-72de-4efa-8cc5-29f19d0f7897 tempest-SharesMetadataTest-1561320255 None] Share instance 2be2873c-4768-478e-a848-fb1d2654ca64: deleted successfully. May 28 12:57:42 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1020/2015] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 12:57:42 2024] POST /identity/v3/users => generated 303 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:57:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9add43d-d8f4-44b6-8fdf-fe155bec6305 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9add43d-d8f4-44b6-8fdf-fe155bec6305 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c56e312-b8fe-45c0-a8c4-1514e527f37c None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c56e312-b8fe-45c0-a8c4-1514e527f37c None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c56e312-b8fe-45c0-a8c4-1514e527f37c None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c56e312-b8fe-45c0-a8c4-1514e527f37c None admin] PATH_INFO: `/v3/roles` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c56e312-b8fe-45c0-a8c4-1514e527f37c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c56e312-b8fe-45c0-a8c4-1514e527f37c None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:42 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 996/2016] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 12:57:42 2024] GET /identity/v3/roles => generated 1680 bytes in 17 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:57:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fed5d30-9633-49ab-b86f-d90411be33da None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fed5d30-9633-49ab-b86f-d90411be33da None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873eb071-87ae-4936-8f24-3b1552ff6fed None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873eb071-87ae-4936-8f24-3b1552ff6fed None admin] REQUEST_METHOD: `PUT` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873eb071-87ae-4936-8f24-3b1552ff6fed None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873eb071-87ae-4936-8f24-3b1552ff6fed None admin] PATH_INFO: `/v3/projects/9f0aba9bff5442b580ca1a6d3c9bbaa0/users/311cd5fb5b0043b98ed6eed3875b4fc4/roles/44620cad10ae407c90c91e2c296adb04` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873eb071-87ae-4936-8f24-3b1552ff6fed None admin] RBAC: Authorizing `identity:create_grant(project_id=9f0aba9bff5442b580ca1a6d3c9bbaa0, user_id=311cd5fb5b0043b98ed6eed3875b4fc4, role_id=44620cad10ae407c90c91e2c296adb04)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873eb071-87ae-4936-8f24-3b1552ff6fed None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:42 l75lg1-v1 dstat.sh[49771]: 28-05 12:57:42| 11 2 83 3 0|5696M 1796M 277M 7856M| 30k 7351B| 0 1960k| 0 273 |7883 13k|1.66 1.09 1.02|3.0 2.0 0| 0 0 | 0 2048M| 29 356 0 68 0 May 28 12:57:42 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1021/2017] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 12:57:42 2024] PUT /identity/v3/projects/9f0aba9bff5442b580ca1a6d3c9bbaa0/users/311cd5fb5b0043b98ed6eed3875b4fc4/roles/44620cad10ae407c90c91e2c296adb04 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:57:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cac764d-9925-4163-ac58-aeb3d8e367cc None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cac764d-9925-4163-ac58-aeb3d8e367cc None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cac764d-9925-4163-ac58-aeb3d8e367cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:42 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-9cac764d-9925-4163-ac58-aeb3d8e367cc None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:57:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-9cac764d-9925-4163-ac58-aeb3d8e367cc None None] MFA Rules not processed for user `311cd5fb5b0043b98ed6eed3875b4fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:57:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-9cac764d-9925-4163-ac58-aeb3d8e367cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:42 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 997/2018] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:57:42 2024] POST /identity/v3/auth/tokens => generated 3960 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:57:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873eb071-87ae-4936-8f24-3b1552ff6fed None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873eb071-87ae-4936-8f24-3b1552ff6fed None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd5d300-9587-4697-8c6b-d4088aeac6f3 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd5d300-9587-4697-8c6b-d4088aeac6f3 None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd5d300-9587-4697-8c6b-d4088aeac6f3 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd5d300-9587-4697-8c6b-d4088aeac6f3 None admin] PATH_INFO: `/v3/projects` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd5d300-9587-4697-8c6b-d4088aeac6f3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd5d300-9587-4697-8c6b-d4088aeac6f3 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:42 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1022/2019] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 12:57:42 2024] POST /identity/v3/projects => generated 391 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:57:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cac764d-9925-4163-ac58-aeb3d8e367cc None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cac764d-9925-4163-ac58-aeb3d8e367cc None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:42 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-7e524cd1-1ee3-4331-88d8-95e7b90812a4 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] GET http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/36ebac5b-70c6-4cc4-85fa-1acc9586628e May 28 12:57:42 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-7e524cd1-1ee3-4331-88d8-95e7b90812a4 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:42 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-7e524cd1-1ee3-4331-88d8-95e7b90812a4 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:42 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-7e524cd1-1ee3-4331-88d8-95e7b90812a4 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] HTTP exception thrown: The resource could not be found. May 28 12:57:42 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-7e524cd1-1ee3-4331-88d8-95e7b90812a4 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/36ebac5b-70c6-4cc4-85fa-1acc9586628e returned with HTTP 404 May 28 12:57:42 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 390/768] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:57:42 2024] GET /share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/36ebac5b-70c6-4cc4-85fa-1acc9586628e => generated 78 bytes in 12 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 12:57:42 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-e475b181-000c-48f1-bae2-1c0506418668 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] POST http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares May 28 12:57:42 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-e475b181-000c-48f1-bae2-1c0506418668 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share": {"share_proto": "nfs", "description": "Tempest's share", "snapshot_id": null, "name": "tempest-tempest-created-share-2108113108", "size": 1, "metadata": {}, "is_public": false, "share_type": "10ddeb10-4cbf-44c0-94cd-48a1deaf7383"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:57:42 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.v1.shares [None req-e475b181-000c-48f1-bae2-1c0506418668 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Create NFS share of 1 GB May 28 12:57:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632073c3-b9bd-48e3-a8c6-df3c9438e124 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632073c3-b9bd-48e3-a8c6-df3c9438e124 None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632073c3-b9bd-48e3-a8c6-df3c9438e124 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632073c3-b9bd-48e3-a8c6-df3c9438e124 None admin] PATH_INFO: `/v3/users` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632073c3-b9bd-48e3-a8c6-df3c9438e124 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632073c3-b9bd-48e3-a8c6-df3c9438e124 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:42 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-632073c3-b9bd-48e3-a8c6-df3c9438e124 None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 12:57:42 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 998/2020] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 12:57:42 2024] POST /identity/v3/users => generated 303 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:57:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd5d300-9587-4697-8c6b-d4088aeac6f3 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd5d300-9587-4697-8c6b-d4088aeac6f3 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455e1349-c3af-4aa1-a59d-dad8da0a6826 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455e1349-c3af-4aa1-a59d-dad8da0a6826 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455e1349-c3af-4aa1-a59d-dad8da0a6826 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455e1349-c3af-4aa1-a59d-dad8da0a6826 None admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455e1349-c3af-4aa1-a59d-dad8da0a6826 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455e1349-c3af-4aa1-a59d-dad8da0a6826 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:42 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1023/2021] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 12:57:42 2024] GET /identity/v3/roles => generated 1680 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:57:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632073c3-b9bd-48e3-a8c6-df3c9438e124 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632073c3-b9bd-48e3-a8c6-df3c9438e124 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:42 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.quota [None req-e475b181-000c-48f1-bae2-1c0506418668 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Created reservations ['3f0de6ff-ec1f-4bb0-ae6e-c5ad295807f2', 'c7d92968-7fd1-4114-9bdb-ea03f6c89765', 'c1b47ea9-0044-4c88-b18e-c590cb8a2ece', '6f9cac3f-4907-4a2a-acbb-7b210b052d71'] {{(pid=98330) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 12:57:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8c2fd1-77fd-4952-9588-0f9ada10cb4f None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8c2fd1-77fd-4952-9588-0f9ada10cb4f None admin] REQUEST_METHOD: `PUT` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8c2fd1-77fd-4952-9588-0f9ada10cb4f None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8c2fd1-77fd-4952-9588-0f9ada10cb4f None admin] PATH_INFO: `/v3/projects/efc051b5756f4b69ba8d639efab8d102/users/6f163ab6cac34b77945bc27e1a5c66ce/roles/e7989893488f483baa107be56668c4f8` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8c2fd1-77fd-4952-9588-0f9ada10cb4f None admin] RBAC: Authorizing `identity:create_grant(project_id=efc051b5756f4b69ba8d639efab8d102, user_id=6f163ab6cac34b77945bc27e1a5c66ce, role_id=e7989893488f483baa107be56668c4f8)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8c2fd1-77fd-4952-9588-0f9ada10cb4f None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:42 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 999/2022] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 12:57:42 2024] PUT /identity/v3/projects/efc051b5756f4b69ba8d639efab8d102/users/6f163ab6cac34b77945bc27e1a5c66ce/roles/e7989893488f483baa107be56668c4f8 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:57:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455e1349-c3af-4aa1-a59d-dad8da0a6826 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455e1349-c3af-4aa1-a59d-dad8da0a6826 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:42 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.quota [None req-e475b181-000c-48f1-bae2-1c0506418668 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Committed reservations ['3f0de6ff-ec1f-4bb0-ae6e-c5ad295807f2', 'c7d92968-7fd1-4114-9bdb-ea03f6c89765', 'c1b47ea9-0044-4c88-b18e-c590cb8a2ece', '6f9cac3f-4907-4a2a-acbb-7b210b052d71'] {{(pid=98330) commit /opt/stack/manila/manila/quota.py:1063}} May 28 12:57:42 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-e8140a51-e491-4930-a0df-2153cb78253e tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] GET http://10.27.203.238/share/v2/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1 May 28 12:57:42 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-e8140a51-e491-4930-a0df-2153cb78253e tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:42 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-e8140a51-e491-4930-a0df-2153cb78253e tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c572755b-05f4-46ee-be3d-c20e52ceacc2 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c572755b-05f4-46ee-be3d-c20e52ceacc2 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c572755b-05f4-46ee-be3d-c20e52ceacc2 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c572755b-05f4-46ee-be3d-c20e52ceacc2 None admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c572755b-05f4-46ee-be3d-c20e52ceacc2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c572755b-05f4-46ee-be3d-c20e52ceacc2 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:42 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1024/2023] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 12:57:42 2024] GET /identity/v3/roles => generated 1680 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:57:42 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-e8140a51-e491-4930-a0df-2153cb78253e tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] http://10.27.203.238/share/v2/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1 returned with HTTP 200 May 28 12:57:42 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 391/769] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:57:42 2024] GET /share/v2/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1 => generated 1314 bytes in 30 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:57:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8c2fd1-77fd-4952-9588-0f9ada10cb4f None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8c2fd1-77fd-4952-9588-0f9ada10cb4f None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f837cc4b-6196-42d3-ac67-6a7d2aadf85f None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f837cc4b-6196-42d3-ac67-6a7d2aadf85f None admin] REQUEST_METHOD: `PUT` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f837cc4b-6196-42d3-ac67-6a7d2aadf85f None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f837cc4b-6196-42d3-ac67-6a7d2aadf85f None admin] PATH_INFO: `/v3/projects/efc051b5756f4b69ba8d639efab8d102/users/6f163ab6cac34b77945bc27e1a5c66ce/roles/e7989893488f483baa107be56668c4f8` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f837cc4b-6196-42d3-ac67-6a7d2aadf85f None admin] RBAC: Authorizing `identity:create_grant(project_id=efc051b5756f4b69ba8d639efab8d102, user_id=6f163ab6cac34b77945bc27e1a5c66ce, role_id=e7989893488f483baa107be56668c4f8)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f837cc4b-6196-42d3-ac67-6a7d2aadf85f None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:42 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1000/2024] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 12:57:42 2024] PUT /identity/v3/projects/efc051b5756f4b69ba8d639efab8d102/users/6f163ab6cac34b77945bc27e1a5c66ce/roles/e7989893488f483baa107be56668c4f8 => generated 0 bytes in 24 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:57:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eca84d-dec5-4ba6-b5dc-75e4eb67b0dc None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eca84d-dec5-4ba6-b5dc-75e4eb67b0dc None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eca84d-dec5-4ba6-b5dc-75e4eb67b0dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:42 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.host_manager [None req-e475b181-000c-48f1-bae2-1c0506418668 tempest-SharesMetadataTest-1561320255 None] Share service is down. (host: l75lg1-v1@generic2). May 28 12:57:42 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.host_manager [None req-e475b181-000c-48f1-bae2-1c0506418668 tempest-SharesMetadataTest-1561320255 None] Share service is down. (host: l75lg1-v1@generic1). May 28 12:57:42 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-e475b181-000c-48f1-bae2-1c0506418668 tempest-SharesMetadataTest-1561320255 None] Starting with 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:80}} May 28 12:57:42 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-e475b181-000c-48f1-bae2-1c0506418668 tempest-SharesMetadataTest-1561320255 None] Filter OnlyHostFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:57:42 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-e475b181-000c-48f1-bae2-1c0506418668 tempest-SharesMetadataTest-1561320255 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:57:42 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.capacity [None req-e475b181-000c-48f1-bae2-1c0506418668 tempest-SharesMetadataTest-1561320255 None] Space information for share creation on host l75lg1-v1@vast#vast (requested / avail): 1/2063 {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/capacity.py:83}} May 28 12:57:42 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-e475b181-000c-48f1-bae2-1c0506418668 tempest-SharesMetadataTest-1561320255 None] Filter CapacityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:57:42 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-e475b181-000c-48f1-bae2-1c0506418668 tempest-SharesMetadataTest-1561320255 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:57:42 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-e475b181-000c-48f1-bae2-1c0506418668 tempest-SharesMetadataTest-1561320255 None] Driver Filter: Checking host 'l75lg1-v1@vast#vast' {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:37}} May 28 12:57:42 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-e475b181-000c-48f1-bae2-1c0506418668 tempest-SharesMetadataTest-1561320255 None] Filter function not set :: passing host. {{(pid=98327) _check_filter_function /opt/stack/manila/manila/scheduler/filters/driver.py:53}} May 28 12:57:42 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-e475b181-000c-48f1-bae2-1c0506418668 tempest-SharesMetadataTest-1561320255 None] Result: True {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:40}} May 28 12:57:42 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-e475b181-000c-48f1-bae2-1c0506418668 tempest-SharesMetadataTest-1561320255 None] Done checking host 'l75lg1-v1@vast#vast' {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:41}} May 28 12:57:42 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-e475b181-000c-48f1-bae2-1c0506418668 tempest-SharesMetadataTest-1561320255 None] Filter DriverFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:57:42 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-e475b181-000c-48f1-bae2-1c0506418668 tempest-SharesMetadataTest-1561320255 None] Filter ShareReplicationFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:57:42 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-e475b181-000c-48f1-bae2-1c0506418668 tempest-SharesMetadataTest-1561320255 None] Filter CreateFromSnapshotFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:57:42 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-e475b181-000c-48f1-bae2-1c0506418668 tempest-SharesMetadataTest-1561320255 None] Filter AffinityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:57:42 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-e475b181-000c-48f1-bae2-1c0506418668 tempest-SharesMetadataTest-1561320255 None] Filter AntiAffinityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:57:42 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.drivers.filter [None req-e475b181-000c-48f1-bae2-1c0506418668 tempest-SharesMetadataTest-1561320255 None] Filtered share [host: 'l75lg1-v1@vast#vast', free_capacity_gb: 2063.6229242384434, pools: None] {{(pid=98327) _schedule_share /opt/stack/manila/manila/scheduler/drivers/filter.py:268}} May 28 12:57:42 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-e475b181-000c-48f1-bae2-1c0506418668 tempest-SharesMetadataTest-1561320255 None] Checking host 'l75lg1-v1@vast#vast' {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:46}} May 28 12:57:42 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.weighers.goodness [None req-e475b181-000c-48f1-bae2-1c0506418668 tempest-SharesMetadataTest-1561320255 None] Goodness function not set :: defaulting to minimal goodness rating of 0. May 28 12:57:42 l75lg1-v1 manila-scheduler[98327]: INFO manila.scheduler.weighers.goodness [None req-e475b181-000c-48f1-bae2-1c0506418668 tempest-SharesMetadataTest-1561320255 None] Goodness function result for host l75lg1-v1@vast#vast: 0. May 28 12:57:42 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-e475b181-000c-48f1-bae2-1c0506418668 tempest-SharesMetadataTest-1561320255 None] Goodness: 0 {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:48}} May 28 12:57:42 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-e475b181-000c-48f1-bae2-1c0506418668 tempest-SharesMetadataTest-1561320255 None] Done checking host 'l75lg1-v1@vast#vast' {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:49}} May 28 12:57:42 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.drivers.filter [None req-e475b181-000c-48f1-bae2-1c0506418668 tempest-SharesMetadataTest-1561320255 None] Choosing for share: WeighedHost [host: l75lg1-v1@vast#vast, weight: 0.0] {{(pid=98327) _schedule_share /opt/stack/manila/manila/scheduler/drivers/filter.py:274}} May 28 12:57:42 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-b7eca84d-dec5-4ba6-b5dc-75e4eb67b0dc None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:57:42 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-e475b181-000c-48f1-bae2-1c0506418668 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares returned with HTTP 200 May 28 12:57:42 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 379/770] 10.27.203.238 () {66 vars in 1362 bytes} [Tue May 28 12:57:42 2024] POST /share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares => generated 1312 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 232 bytes (2 switches on core 0) May 28 12:57:42 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-c0b87601-0418-4406-9883-ea9ff9cd325d tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] GET http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/da7ec0a1-db21-42c6-b842-6f87b3c5843d May 28 12:57:42 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-c0b87601-0418-4406-9883-ea9ff9cd325d tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:42 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-c0b87601-0418-4406-9883-ea9ff9cd325d tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-b7eca84d-dec5-4ba6-b5dc-75e4eb67b0dc None None] MFA Rules not processed for user `6f163ab6cac34b77945bc27e1a5c66ce`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:57:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-b7eca84d-dec5-4ba6-b5dc-75e4eb67b0dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:42 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-c0b87601-0418-4406-9883-ea9ff9cd325d tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/da7ec0a1-db21-42c6-b842-6f87b3c5843d returned with HTTP 200 May 28 12:57:42 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 392/771] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:57:42 2024] GET /share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/da7ec0a1-db21-42c6-b842-6f87b3c5843d => generated 1312 bytes in 25 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:57:42 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-73c32d25-146c-4856-8152-deb6aa1abca7 tempest-ShareIpRulesForNFSTest-1748669711 None] <<< [POST] https://127.0.0.1:40443/api/quotas/ May 28 12:57:42 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-73c32d25-146c-4856-8152-deb6aa1abca7 tempest-ShareIpRulesForNFSTest-1748669711 None] Bunch(cluster='loop75-kfs', cluster_id=1, default_email=None, default_group_quota=None, default_user_quota=None, enable_alarms=True, enable_email_providers=True, grace_period=None, group_quotas=[], guid='7cee33d4-fd10-4965-96a8-0fb543190acd', hard_limit=1073741824, hard_limit_inodes=None, id=18, internal=False, is_user_quota=False, last_user_quotas_update=None, name='b7a7d61c-2cea-442a-9809-507038e080d5', num_blocked_users=0, num_exceeded_users=0, path='/manila/manila-b7a7d61c-2cea-442a-9809-507038e080d5', percent_capacity=0, percent_inodes=None, pretty_grace_period=None, pretty_grace_period_expiration=None, pretty_state='OK (CREATED)', soft_limit=None, soft_limit_inodes=None, state='OK', sync_state='CREATED', system_id=18, tenant_id=1, tenant_name='default', time_to_block=None, title='b7a7d61c-2cea-442a-9809-507038e080d5', url='https://127.0.0.1:40443/api/quotas/18/', used_capacity=0, used_capacity_tb=0.0, used_effective_capacity=0, used_effective_capacity_tb=0.0, used_inodes=0, used_limited_capacity=0, user_quotas=[]) May 28 12:57:42 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-73c32d25-146c-4856-8152-deb6aa1abca7 tempest-ShareIpRulesForNFSTest-1748669711 None] --- [POST] https://127.0.0.1:40443/api/quotas/: Done May 28 12:57:42 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-73c32d25-146c-4856-8152-deb6aa1abca7 tempest-ShareIpRulesForNFSTest-1748669711 None] >>> [GET] https://127.0.0.1:40443/api/views/ May 28 12:57:42 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-73c32d25-146c-4856-8152-deb6aa1abca7 tempest-ShareIpRulesForNFSTest-1748669711 None] {'allow_redirects': True, May 28 12:57:42 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-73c32d25-146c-4856-8152-deb6aa1abca7 tempest-ShareIpRulesForNFSTest-1748669711 None] 'params': {'name': 'b7a7d61c-2cea-442a-9809-507038e080d5'}} May 28 12:57:42 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1025/2025] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:57:42 2024] POST /identity/v3/auth/tokens => generated 4085 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:57:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f837cc4b-6196-42d3-ac67-6a7d2aadf85f None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f837cc4b-6196-42d3-ac67-6a7d2aadf85f None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d0ee9a-f6cf-4c9b-ac04-4beeea0f49c9 tempest-SharesMetadataNegativeTest-1095932064 tempest-SharesMetadataNegativeTest-1095932064-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f163ab6cac34b77945bc27e1a5c66ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efc051b5756f4b69ba8d639efab8d102', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d0ee9a-f6cf-4c9b-ac04-4beeea0f49c9 tempest-SharesMetadataNegativeTest-1095932064 tempest-SharesMetadataNegativeTest-1095932064-project-admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d0ee9a-f6cf-4c9b-ac04-4beeea0f49c9 tempest-SharesMetadataNegativeTest-1095932064 tempest-SharesMetadataNegativeTest-1095932064-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d0ee9a-f6cf-4c9b-ac04-4beeea0f49c9 tempest-SharesMetadataNegativeTest-1095932064 tempest-SharesMetadataNegativeTest-1095932064-project-admin] PATH_INFO: `/v3/domains` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d0ee9a-f6cf-4c9b-ac04-4beeea0f49c9 tempest-SharesMetadataNegativeTest-1095932064 tempest-SharesMetadataNegativeTest-1095932064-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:57:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d0ee9a-f6cf-4c9b-ac04-4beeea0f49c9 tempest-SharesMetadataNegativeTest-1095932064 tempest-SharesMetadataNegativeTest-1095932064-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d0ee9a-f6cf-4c9b-ac04-4beeea0f49c9 tempest-SharesMetadataNegativeTest-1095932064 tempest-SharesMetadataNegativeTest-1095932064-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:42 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1001/2026] 10.27.203.238 () {62 vars in 1241 bytes} [Tue May 28 12:57:42 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:57:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eca84d-dec5-4ba6-b5dc-75e4eb67b0dc None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eca84d-dec5-4ba6-b5dc-75e4eb67b0dc None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ee4fd1-e9c2-433f-b836-1dd236eaec2c tempest-SharesMetadataNegativeTest-1095932064 tempest-SharesMetadataNegativeTest-1095932064-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f163ab6cac34b77945bc27e1a5c66ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efc051b5756f4b69ba8d639efab8d102', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ee4fd1-e9c2-433f-b836-1dd236eaec2c tempest-SharesMetadataNegativeTest-1095932064 tempest-SharesMetadataNegativeTest-1095932064-project-admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ee4fd1-e9c2-433f-b836-1dd236eaec2c tempest-SharesMetadataNegativeTest-1095932064 tempest-SharesMetadataNegativeTest-1095932064-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ee4fd1-e9c2-433f-b836-1dd236eaec2c tempest-SharesMetadataNegativeTest-1095932064 tempest-SharesMetadataNegativeTest-1095932064-project-admin] PATH_INFO: `/v3/users` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ee4fd1-e9c2-433f-b836-1dd236eaec2c tempest-SharesMetadataNegativeTest-1095932064 tempest-SharesMetadataNegativeTest-1095932064-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ee4fd1-e9c2-433f-b836-1dd236eaec2c tempest-SharesMetadataNegativeTest-1095932064 tempest-SharesMetadataNegativeTest-1095932064-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:42 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-92ee4fd1-e9c2-433f-b836-1dd236eaec2c tempest-SharesMetadataNegativeTest-1095932064 tempest-SharesMetadataNegativeTest-1095932064-project-admin] Truncating password to algorithm specific maximum length 72 characters. May 28 12:57:42 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e475b181-000c-48f1-bae2-1c0506418668 tempest-SharesMetadataTest-1561320255 None] >>> [GET] https://127.0.0.1:40443/api/vippools/ May 28 12:57:42 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e475b181-000c-48f1-bae2-1c0506418668 tempest-SharesMetadataTest-1561320255 None] {'allow_redirects': True, 'params': {'name': 'vippool-1'}} May 28 12:57:42 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1026/2027] 10.27.203.238 () {64 vars in 1232 bytes} [Tue May 28 12:57:42 2024] POST /identity/v3/users => generated 435 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:57:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d0ee9a-f6cf-4c9b-ac04-4beeea0f49c9 tempest-SharesMetadataNegativeTest-1095932064 tempest-SharesMetadataNegativeTest-1095932064-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d0ee9a-f6cf-4c9b-ac04-4beeea0f49c9 tempest-SharesMetadataNegativeTest-1095932064 tempest-SharesMetadataNegativeTest-1095932064-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949794f6-b7cf-40ca-8dd3-8b451cecf0ef tempest-SharesMetadataNegativeTest-1095932064 tempest-SharesMetadataNegativeTest-1095932064-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f163ab6cac34b77945bc27e1a5c66ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efc051b5756f4b69ba8d639efab8d102', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949794f6-b7cf-40ca-8dd3-8b451cecf0ef tempest-SharesMetadataNegativeTest-1095932064 tempest-SharesMetadataNegativeTest-1095932064-project-admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949794f6-b7cf-40ca-8dd3-8b451cecf0ef tempest-SharesMetadataNegativeTest-1095932064 tempest-SharesMetadataNegativeTest-1095932064-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949794f6-b7cf-40ca-8dd3-8b451cecf0ef tempest-SharesMetadataNegativeTest-1095932064 tempest-SharesMetadataNegativeTest-1095932064-project-admin] PATH_INFO: `/v3/roles` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949794f6-b7cf-40ca-8dd3-8b451cecf0ef tempest-SharesMetadataNegativeTest-1095932064 tempest-SharesMetadataNegativeTest-1095932064-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949794f6-b7cf-40ca-8dd3-8b451cecf0ef tempest-SharesMetadataNegativeTest-1095932064 tempest-SharesMetadataNegativeTest-1095932064-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:42 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1002/2028] 10.27.203.238 () {62 vars in 1210 bytes} [Tue May 28 12:57:42 2024] GET /identity/v3/roles => generated 1680 bytes in 18 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 28 12:57:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ee4fd1-e9c2-433f-b836-1dd236eaec2c tempest-SharesMetadataNegativeTest-1095932064 tempest-SharesMetadataNegativeTest-1095932064-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ee4fd1-e9c2-433f-b836-1dd236eaec2c tempest-SharesMetadataNegativeTest-1095932064 tempest-SharesMetadataNegativeTest-1095932064-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755bd637-40f5-4282-8cd3-8a723f26c5d4 tempest-SharesMetadataNegativeTest-1095932064 tempest-SharesMetadataNegativeTest-1095932064-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f163ab6cac34b77945bc27e1a5c66ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efc051b5756f4b69ba8d639efab8d102', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755bd637-40f5-4282-8cd3-8a723f26c5d4 tempest-SharesMetadataNegativeTest-1095932064 tempest-SharesMetadataNegativeTest-1095932064-project-admin] REQUEST_METHOD: `PUT` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755bd637-40f5-4282-8cd3-8a723f26c5d4 tempest-SharesMetadataNegativeTest-1095932064 tempest-SharesMetadataNegativeTest-1095932064-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755bd637-40f5-4282-8cd3-8a723f26c5d4 tempest-SharesMetadataNegativeTest-1095932064 tempest-SharesMetadataNegativeTest-1095932064-project-admin] PATH_INFO: `/v3/projects/efc051b5756f4b69ba8d639efab8d102/users/9eca355145fd413390b5efe7a0d95465/roles/44620cad10ae407c90c91e2c296adb04` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755bd637-40f5-4282-8cd3-8a723f26c5d4 tempest-SharesMetadataNegativeTest-1095932064 tempest-SharesMetadataNegativeTest-1095932064-project-admin] RBAC: Authorizing `identity:create_grant(project_id=efc051b5756f4b69ba8d639efab8d102, user_id=9eca355145fd413390b5efe7a0d95465, role_id=44620cad10ae407c90c91e2c296adb04)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755bd637-40f5-4282-8cd3-8a723f26c5d4 tempest-SharesMetadataNegativeTest-1095932064 tempest-SharesMetadataNegativeTest-1095932064-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:42 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1027/2029] 10.27.203.238 () {64 vars in 1571 bytes} [Tue May 28 12:57:42 2024] PUT /identity/v3/projects/efc051b5756f4b69ba8d639efab8d102/users/9eca355145fd413390b5efe7a0d95465/roles/44620cad10ae407c90c91e2c296adb04 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:57:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949794f6-b7cf-40ca-8dd3-8b451cecf0ef tempest-SharesMetadataNegativeTest-1095932064 tempest-SharesMetadataNegativeTest-1095932064-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-949794f6-b7cf-40ca-8dd3-8b451cecf0ef tempest-SharesMetadataNegativeTest-1095932064 tempest-SharesMetadataNegativeTest-1095932064-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949794f6-b7cf-40ca-8dd3-8b451cecf0ef tempest-SharesMetadataNegativeTest-1095932064 tempest-SharesMetadataNegativeTest-1095932064-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887d6a79-f7e4-48c6-97b8-19716afdb54f service manila] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f110cf6300f049c897d0aab63218d1e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887d6a79-f7e4-48c6-97b8-19716afdb54f service manila] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887d6a79-f7e4-48c6-97b8-19716afdb54f service manila] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887d6a79-f7e4-48c6-97b8-19716afdb54f service manila] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887d6a79-f7e4-48c6-97b8-19716afdb54f service manila] RBAC: Authorizing `identity:validate_token()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887d6a79-f7e4-48c6-97b8-19716afdb54f service manila] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:43 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1003/2030] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 12:57:42 2024] GET /identity/v3/auth/tokens => generated 4085 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 12:57:43 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-5dac8cb9-8c03-4a34-89d6-8a3a50841885 tempest-SharesMetadataNegativeTest-1095932064 tempest-SharesMetadataNegativeTest-1095932064-project-admin] POST http://10.27.203.238/share/v2/efc051b5756f4b69ba8d639efab8d102/types May 28 12:57:43 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-5dac8cb9-8c03-4a34-89d6-8a3a50841885 tempest-SharesMetadataNegativeTest-1095932064 tempest-SharesMetadataNegativeTest-1095932064-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share_type": {"name": "tempest-typeshare-type-344484932", "extra_specs": {"driver_handles_share_servers": "False"}, "share_type_access:is_public": true}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:57:43 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-5dac8cb9-8c03-4a34-89d6-8a3a50841885 tempest-SharesMetadataNegativeTest-1095932064 tempest-SharesMetadataNegativeTest-1095932064-project-admin] http://10.27.203.238/share/v2/efc051b5756f4b69ba8d639efab8d102/types returned with HTTP 200 May 28 12:57:43 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 380/772] 10.27.203.238 () {66 vars in 1359 bytes} [Tue May 28 12:57:42 2024] POST /share/v2/efc051b5756f4b69ba8d639efab8d102/types => generated 621 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:57:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755bd637-40f5-4282-8cd3-8a723f26c5d4 tempest-SharesMetadataNegativeTest-1095932064 tempest-SharesMetadataNegativeTest-1095932064-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-755bd637-40f5-4282-8cd3-8a723f26c5d4 tempest-SharesMetadataNegativeTest-1095932064 tempest-SharesMetadataNegativeTest-1095932064-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755bd637-40f5-4282-8cd3-8a723f26c5d4 tempest-SharesMetadataNegativeTest-1095932064 tempest-SharesMetadataNegativeTest-1095932064-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967121a9-40d0-43d8-9206-012a4989d84f service manila] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f110cf6300f049c897d0aab63218d1e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967121a9-40d0-43d8-9206-012a4989d84f service manila] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967121a9-40d0-43d8-9206-012a4989d84f service manila] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967121a9-40d0-43d8-9206-012a4989d84f service manila] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:43 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-73c32d25-146c-4856-8152-deb6aa1abca7 tempest-ShareIpRulesForNFSTest-1748669711 None] <<< [GET] https://127.0.0.1:40443/api/views/ May 28 12:57:43 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-73c32d25-146c-4856-8152-deb6aa1abca7 tempest-ShareIpRulesForNFSTest-1748669711 None] [] May 28 12:57:43 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-73c32d25-146c-4856-8152-deb6aa1abca7 tempest-ShareIpRulesForNFSTest-1748669711 None] --- [GET] https://127.0.0.1:40443/api/views/: Done May 28 12:57:43 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-73c32d25-146c-4856-8152-deb6aa1abca7 tempest-ShareIpRulesForNFSTest-1748669711 None] >>> [POST] https://127.0.0.1:40443/api/views/ May 28 12:57:43 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-73c32d25-146c-4856-8152-deb6aa1abca7 tempest-ShareIpRulesForNFSTest-1748669711 None] {'data': '{"name": "b7a7d61c-2cea-442a-9809-507038e080d5", "path": ' May 28 12:57:43 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-73c32d25-146c-4856-8152-deb6aa1abca7 tempest-ShareIpRulesForNFSTest-1748669711 None] '"/manila/manila-b7a7d61c-2cea-442a-9809-507038e080d5", "policy_id": ' May 28 12:57:43 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-73c32d25-146c-4856-8152-deb6aa1abca7 tempest-ShareIpRulesForNFSTest-1748669711 None] '21, "create_dir": true, "protocols": ["NFS"]}', May 28 12:57:43 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-73c32d25-146c-4856-8152-deb6aa1abca7 tempest-ShareIpRulesForNFSTest-1748669711 None] 'json': None, May 28 12:57:43 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-73c32d25-146c-4856-8152-deb6aa1abca7 tempest-ShareIpRulesForNFSTest-1748669711 None] 'params': None} May 28 12:57:43 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-814b4b1c-0796-47a2-87e9-38fb765c09fd tempest-ShareSnapshotInstancesTest-843694899 None] <<< [DELETE] https://127.0.0.1:40443/api/viewpolicies/14/ May 28 12:57:43 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-814b4b1c-0796-47a2-87e9-38fb765c09fd tempest-ShareSnapshotInstancesTest-843694899 None] --- [DELETE] https://127.0.0.1:40443/api/viewpolicies/14/: Done May 28 12:57:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967121a9-40d0-43d8-9206-012a4989d84f service manila] RBAC: Authorizing `identity:validate_token()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967121a9-40d0-43d8-9206-012a4989d84f service manila] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:43 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1028/2031] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 12:57:43 2024] GET /identity/v3/auth/tokens => generated 3962 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 12:57:43 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-1d58e35e-74eb-471d-bbdb-c75219ac6e07 tempest-SharesMetadataNegativeTest-1584039052 tempest-SharesMetadataNegativeTest-1584039052-project-member] POST http://10.27.203.238/share/v2/5e5bc0c8fb8b46d598b0621999301112/shares May 28 12:57:43 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-1d58e35e-74eb-471d-bbdb-c75219ac6e07 tempest-SharesMetadataNegativeTest-1584039052 tempest-SharesMetadataNegativeTest-1584039052-project-member] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share": {"share_proto": "nfs", "description": "Tempest's share", "snapshot_id": null, "name": "tempest-tempest-created-share-1294510436", "size": 1, "metadata": {}, "is_public": false, "share_type": "c28a59fe-4641-4c44-8ef9-4e7174c48b1c"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:57:43 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.v1.shares [None req-1d58e35e-74eb-471d-bbdb-c75219ac6e07 tempest-SharesMetadataNegativeTest-1584039052 tempest-SharesMetadataNegativeTest-1584039052-project-member] Create NFS share of 1 GB May 28 12:57:43 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.quota [None req-1d58e35e-74eb-471d-bbdb-c75219ac6e07 tempest-SharesMetadataNegativeTest-1584039052 tempest-SharesMetadataNegativeTest-1584039052-project-member] Created reservations ['bd4c02dd-56c6-4488-89b7-67f8c420d813', '073b24a3-2569-4243-bf30-1b61c8a78deb', '3bac77f8-b012-41ef-b91a-3d0ecdf8b701', '80cfb7d5-df82-4298-9ad2-5ef445265a46'] {{(pid=98329) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 12:57:43 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-814b4b1c-0796-47a2-87e9-38fb765c09fd tempest-ShareSnapshotInstancesTest-843694899 None] Created reservations ['677378dc-fa92-432c-9014-ac0470317b36', 'e9578081-3139-419c-adc8-45e47bb4494a', '449577b0-9317-4d82-96ef-85b6051552de', '24ea15ac-3cd1-478d-9c01-12208120db6e'] {{(pid=98474) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 12:57:43 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-814b4b1c-0796-47a2-87e9-38fb765c09fd tempest-ShareSnapshotInstancesTest-843694899 None] Committed reservations ['677378dc-fa92-432c-9014-ac0470317b36', 'e9578081-3139-419c-adc8-45e47bb4494a', '449577b0-9317-4d82-96ef-85b6051552de', '24ea15ac-3cd1-478d-9c01-12208120db6e'] {{(pid=98474) commit /opt/stack/manila/manila/quota.py:1063}} May 28 12:57:43 l75lg1-v1 dstat.sh[49771]: 28-05 12:57:43| 14 2 80 3 0|5696M 1795M 277M 7856M| 17k 6878B| 0 2288k| 0 328 |8876 15k|1.66 1.09 1.02|1.0 2.0 0| 0 0 | 0 2048M| 29 356 0 67 0 May 28 12:57:43 l75lg1-v1 manila-share[98474]: INFO manila.share.manager [None req-814b4b1c-0796-47a2-87e9-38fb765c09fd tempest-ShareSnapshotInstancesTest-843694899 None] Share instance c2f741cd-bac5-499f-9539-8e93d6a81282: deleted successfully. May 28 12:57:43 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.quota [None req-1d58e35e-74eb-471d-bbdb-c75219ac6e07 tempest-SharesMetadataNegativeTest-1584039052 tempest-SharesMetadataNegativeTest-1584039052-project-member] Committed reservations ['bd4c02dd-56c6-4488-89b7-67f8c420d813', '073b24a3-2569-4243-bf30-1b61c8a78deb', '3bac77f8-b012-41ef-b91a-3d0ecdf8b701', '80cfb7d5-df82-4298-9ad2-5ef445265a46'] {{(pid=98329) commit /opt/stack/manila/manila/quota.py:1063}} May 28 12:57:43 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-8af3fbe0-c516-4d7d-8f98-382603c49070 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] GET http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/share_instances/724bc53b-1c28-4ab1-b3c8-ab90f868473d May 28 12:57:43 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-8af3fbe0-c516-4d7d-8f98-382603c49070 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:43 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-8af3fbe0-c516-4d7d-8f98-382603c49070 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:43 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-8af3fbe0-c516-4d7d-8f98-382603c49070 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/share_instances/724bc53b-1c28-4ab1-b3c8-ab90f868473d returned with HTTP 200 May 28 12:57:43 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 381/773] 10.27.203.238 () {64 vars in 1478 bytes} [Tue May 28 12:57:43 2024] GET /share/v2/a3499cb78849424db45e54caac01de92/share_instances/724bc53b-1c28-4ab1-b3c8-ab90f868473d => generated 505 bytes in 15 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:57:43 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.host_manager [None req-1d58e35e-74eb-471d-bbdb-c75219ac6e07 tempest-SharesMetadataNegativeTest-1584039052 None] Share service is down. (host: l75lg1-v1@generic2). May 28 12:57:43 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.host_manager [None req-1d58e35e-74eb-471d-bbdb-c75219ac6e07 tempest-SharesMetadataNegativeTest-1584039052 None] Share service is down. (host: l75lg1-v1@generic1). May 28 12:57:43 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-1d58e35e-74eb-471d-bbdb-c75219ac6e07 tempest-SharesMetadataNegativeTest-1584039052 None] Starting with 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:80}} May 28 12:57:43 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-1d58e35e-74eb-471d-bbdb-c75219ac6e07 tempest-SharesMetadataNegativeTest-1584039052 None] Filter OnlyHostFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:57:43 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-1d58e35e-74eb-471d-bbdb-c75219ac6e07 tempest-SharesMetadataNegativeTest-1584039052 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:57:43 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.capacity [None req-1d58e35e-74eb-471d-bbdb-c75219ac6e07 tempest-SharesMetadataNegativeTest-1584039052 None] Space information for share creation on host l75lg1-v1@vast#vast (requested / avail): 1/2062 {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/capacity.py:83}} May 28 12:57:43 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e475b181-000c-48f1-bae2-1c0506418668 tempest-SharesMetadataTest-1561320255 None] <<< [GET] https://127.0.0.1:40443/api/vippools/ May 28 12:57:43 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-1d58e35e-74eb-471d-bbdb-c75219ac6e07 tempest-SharesMetadataNegativeTest-1584039052 None] Filter CapacityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:57:43 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-1d58e35e-74eb-471d-bbdb-c75219ac6e07 tempest-SharesMetadataNegativeTest-1584039052 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:57:43 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e475b181-000c-48f1-bae2-1c0506418668 tempest-SharesMetadataTest-1561320255 None] [Bunch(active_cnode_ids=[], active_interfaces=4, cluster='loop75-kfs', cluster_id=1, cnode_ids=[], cnodes=[], domain_name='vippool-1', enable_l3=False, enable_weighted_balancing=False, enabled=True, end_ip='172.21.75.4', guid='f2abaede-b397-413a-8faa-3aeead6d3b28', gw_ip='', gw_ipv6='', id=2, ip_ranges=[['172.21.75.1', '172.21.75.4']], name='vippool-1', peer_asn=0, port_membership='ALL', ranges_summary='172.21.75.[1-4]', role='PROTOCOLS', start_ip='172.21.75.1', subnet_cidr=16, subnet_cidr_ipv6=None, sync='SYNCED', sync_time='2024-05-28T12:50:09.644123Z', tenant_id=1, tenant_name='default', title='172.21.75.1 - 172.21.75.4', url='https://127.0.0.1:40443/api/vippools/2/', vast_asn=0, vlan=0, vms_preferred=False)] May 28 12:57:43 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-1d58e35e-74eb-471d-bbdb-c75219ac6e07 tempest-SharesMetadataNegativeTest-1584039052 None] Driver Filter: Checking host 'l75lg1-v1@vast#vast' {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:37}} May 28 12:57:43 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e475b181-000c-48f1-bae2-1c0506418668 tempest-SharesMetadataTest-1561320255 None] --- [GET] https://127.0.0.1:40443/api/vippools/: Done May 28 12:57:43 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-1d58e35e-74eb-471d-bbdb-c75219ac6e07 tempest-SharesMetadataNegativeTest-1584039052 None] Filter function not set :: passing host. {{(pid=98327) _check_filter_function /opt/stack/manila/manila/scheduler/filters/driver.py:53}} May 28 12:57:43 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-1d58e35e-74eb-471d-bbdb-c75219ac6e07 tempest-SharesMetadataNegativeTest-1584039052 None] Result: True {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:40}} May 28 12:57:43 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-1d58e35e-74eb-471d-bbdb-c75219ac6e07 tempest-SharesMetadataNegativeTest-1584039052 None] Done checking host 'l75lg1-v1@vast#vast' {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:41}} May 28 12:57:43 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e475b181-000c-48f1-bae2-1c0506418668 tempest-SharesMetadataTest-1561320255 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:57:43 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-1d58e35e-74eb-471d-bbdb-c75219ac6e07 tempest-SharesMetadataNegativeTest-1584039052 None] Filter DriverFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:57:43 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e475b181-000c-48f1-bae2-1c0506418668 tempest-SharesMetadataTest-1561320255 None] {'allow_redirects': True, May 28 12:57:43 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-1d58e35e-74eb-471d-bbdb-c75219ac6e07 tempest-SharesMetadataNegativeTest-1584039052 None] Filter ShareReplicationFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:57:43 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-1d58e35e-74eb-471d-bbdb-c75219ac6e07 tempest-SharesMetadataNegativeTest-1584039052 None] Filter CreateFromSnapshotFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:57:43 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e475b181-000c-48f1-bae2-1c0506418668 tempest-SharesMetadataTest-1561320255 None] 'params': {'name': '5cf89605-2e7d-4ecc-9c44-5e6f5ecb0cad'}} May 28 12:57:43 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-1d58e35e-74eb-471d-bbdb-c75219ac6e07 tempest-SharesMetadataNegativeTest-1584039052 None] Filter AffinityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:57:43 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-1d58e35e-74eb-471d-bbdb-c75219ac6e07 tempest-SharesMetadataNegativeTest-1584039052 None] Filter AntiAffinityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:57:43 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.drivers.filter [None req-1d58e35e-74eb-471d-bbdb-c75219ac6e07 tempest-SharesMetadataNegativeTest-1584039052 None] Filtered share [host: 'l75lg1-v1@vast#vast', free_capacity_gb: 2062.6229242384434, pools: None] {{(pid=98327) _schedule_share /opt/stack/manila/manila/scheduler/drivers/filter.py:268}} May 28 12:57:43 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-1d58e35e-74eb-471d-bbdb-c75219ac6e07 tempest-SharesMetadataNegativeTest-1584039052 None] Checking host 'l75lg1-v1@vast#vast' {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:46}} May 28 12:57:43 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.weighers.goodness [None req-1d58e35e-74eb-471d-bbdb-c75219ac6e07 tempest-SharesMetadataNegativeTest-1584039052 None] Goodness function not set :: defaulting to minimal goodness rating of 0. May 28 12:57:43 l75lg1-v1 manila-scheduler[98327]: INFO manila.scheduler.weighers.goodness [None req-1d58e35e-74eb-471d-bbdb-c75219ac6e07 tempest-SharesMetadataNegativeTest-1584039052 None] Goodness function result for host l75lg1-v1@vast#vast: 0. May 28 12:57:43 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-1d58e35e-74eb-471d-bbdb-c75219ac6e07 tempest-SharesMetadataNegativeTest-1584039052 None] Goodness: 0 {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:48}} May 28 12:57:43 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-1d58e35e-74eb-471d-bbdb-c75219ac6e07 tempest-SharesMetadataNegativeTest-1584039052 None] Done checking host 'l75lg1-v1@vast#vast' {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:49}} May 28 12:57:43 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.drivers.filter [None req-1d58e35e-74eb-471d-bbdb-c75219ac6e07 tempest-SharesMetadataNegativeTest-1584039052 None] Choosing for share: WeighedHost [host: l75lg1-v1@vast#vast, weight: 0.0] {{(pid=98327) _schedule_share /opt/stack/manila/manila/scheduler/drivers/filter.py:274}} May 28 12:57:43 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-1d58e35e-74eb-471d-bbdb-c75219ac6e07 tempest-SharesMetadataNegativeTest-1584039052 tempest-SharesMetadataNegativeTest-1584039052-project-member] http://10.27.203.238/share/v2/5e5bc0c8fb8b46d598b0621999301112/shares returned with HTTP 200 May 28 12:57:43 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 393/774] 10.27.203.238 () {66 vars in 1362 bytes} [Tue May 28 12:57:43 2024] POST /share/v2/5e5bc0c8fb8b46d598b0621999301112/shares => generated 1312 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:57:43 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-92a84bc4-f0f5-479a-9b02-cc37e51c7761 tempest-SharesMetadataNegativeTest-1584039052 tempest-SharesMetadataNegativeTest-1584039052-project-member] GET http://10.27.203.238/share/v2/5e5bc0c8fb8b46d598b0621999301112/shares/12970599-4f96-41ce-abd8-18371bc51a8c May 28 12:57:43 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-92a84bc4-f0f5-479a-9b02-cc37e51c7761 tempest-SharesMetadataNegativeTest-1584039052 tempest-SharesMetadataNegativeTest-1584039052-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:43 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-92a84bc4-f0f5-479a-9b02-cc37e51c7761 tempest-SharesMetadataNegativeTest-1584039052 tempest-SharesMetadataNegativeTest-1584039052-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:43 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-92a84bc4-f0f5-479a-9b02-cc37e51c7761 tempest-SharesMetadataNegativeTest-1584039052 tempest-SharesMetadataNegativeTest-1584039052-project-member] http://10.27.203.238/share/v2/5e5bc0c8fb8b46d598b0621999301112/shares/12970599-4f96-41ce-abd8-18371bc51a8c returned with HTTP 200 May 28 12:57:43 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 382/775] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:57:43 2024] GET /share/v2/5e5bc0c8fb8b46d598b0621999301112/shares/12970599-4f96-41ce-abd8-18371bc51a8c => generated 1312 bytes in 28 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:57:43 l75lg1-v1 neutron-server[77623]: DEBUG dbcounter [-] [77623] Writing DB stats neutron:SELECT=3,neutron:DELETE=1 {{(pid=77623) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:57:43 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1d58e35e-74eb-471d-bbdb-c75219ac6e07 tempest-SharesMetadataNegativeTest-1584039052 None] >>> [GET] https://127.0.0.1:40443/api/vippools/ May 28 12:57:43 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1d58e35e-74eb-471d-bbdb-c75219ac6e07 tempest-SharesMetadataNegativeTest-1584039052 None] {'allow_redirects': True, 'params': {'name': 'vippool-1'}} May 28 12:57:43 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e475b181-000c-48f1-bae2-1c0506418668 tempest-SharesMetadataTest-1561320255 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:57:43 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e475b181-000c-48f1-bae2-1c0506418668 tempest-SharesMetadataTest-1561320255 None] [] May 28 12:57:43 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e475b181-000c-48f1-bae2-1c0506418668 tempest-SharesMetadataTest-1561320255 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 12:57:43 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e475b181-000c-48f1-bae2-1c0506418668 tempest-SharesMetadataTest-1561320255 None] >>> [POST] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:57:43 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e475b181-000c-48f1-bae2-1c0506418668 tempest-SharesMetadataTest-1561320255 None] {'data': '{"name": "5cf89605-2e7d-4ecc-9c44-5e6f5ecb0cad"}', May 28 12:57:43 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e475b181-000c-48f1-bae2-1c0506418668 tempest-SharesMetadataTest-1561320255 None] 'json': None, May 28 12:57:43 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e475b181-000c-48f1-bae2-1c0506418668 tempest-SharesMetadataTest-1561320255 None] 'params': None} May 28 12:57:43 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1d58e35e-74eb-471d-bbdb-c75219ac6e07 tempest-SharesMetadataNegativeTest-1584039052 None] <<< [GET] https://127.0.0.1:40443/api/vippools/ May 28 12:57:43 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1d58e35e-74eb-471d-bbdb-c75219ac6e07 tempest-SharesMetadataNegativeTest-1584039052 None] [Bunch(active_cnode_ids=[], active_interfaces=4, cluster='loop75-kfs', cluster_id=1, cnode_ids=[], cnodes=[], domain_name='vippool-1', enable_l3=False, enable_weighted_balancing=False, enabled=True, end_ip='172.21.75.4', guid='f2abaede-b397-413a-8faa-3aeead6d3b28', gw_ip='', gw_ipv6='', id=2, ip_ranges=[['172.21.75.1', '172.21.75.4']], name='vippool-1', peer_asn=0, port_membership='ALL', ranges_summary='172.21.75.[1-4]', role='PROTOCOLS', start_ip='172.21.75.1', subnet_cidr=16, subnet_cidr_ipv6=None, sync='SYNCED', sync_time='2024-05-28T12:50:09.644123Z', tenant_id=1, tenant_name='default', title='172.21.75.1 - 172.21.75.4', url='https://127.0.0.1:40443/api/vippools/2/', vast_asn=0, vlan=0, vms_preferred=False)] May 28 12:57:43 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1d58e35e-74eb-471d-bbdb-c75219ac6e07 tempest-SharesMetadataNegativeTest-1584039052 None] --- [GET] https://127.0.0.1:40443/api/vippools/: Done May 28 12:57:43 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1d58e35e-74eb-471d-bbdb-c75219ac6e07 tempest-SharesMetadataNegativeTest-1584039052 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:57:43 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1d58e35e-74eb-471d-bbdb-c75219ac6e07 tempest-SharesMetadataNegativeTest-1584039052 None] {'allow_redirects': True, May 28 12:57:43 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1d58e35e-74eb-471d-bbdb-c75219ac6e07 tempest-SharesMetadataNegativeTest-1584039052 None] 'params': {'name': '9e93e444-3013-4370-9caa-9f912c5201e6'}} May 28 12:57:44 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f6784d36-6966-4d0d-8f96-f818219fe4a4 tempest-AdminActionsTest-1749172189 None] <<< [DELETE] https://127.0.0.1:40443/api/quotas/17/ May 28 12:57:44 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f6784d36-6966-4d0d-8f96-f818219fe4a4 tempest-AdminActionsTest-1749172189 None] --- [DELETE] https://127.0.0.1:40443/api/quotas/17/: Done May 28 12:57:44 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f6784d36-6966-4d0d-8f96-f818219fe4a4 tempest-AdminActionsTest-1749172189 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:57:44 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f6784d36-6966-4d0d-8f96-f818219fe4a4 tempest-AdminActionsTest-1749172189 None] {'allow_redirects': True, May 28 12:57:44 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f6784d36-6966-4d0d-8f96-f818219fe4a4 tempest-AdminActionsTest-1749172189 None] 'params': {'name': '724bc53b-1c28-4ab1-b3c8-ab90f868473d'}} May 28 12:57:44 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1d58e35e-74eb-471d-bbdb-c75219ac6e07 tempest-SharesMetadataNegativeTest-1584039052 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:57:44 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1d58e35e-74eb-471d-bbdb-c75219ac6e07 tempest-SharesMetadataNegativeTest-1584039052 None] [] May 28 12:57:44 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1d58e35e-74eb-471d-bbdb-c75219ac6e07 tempest-SharesMetadataNegativeTest-1584039052 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 12:57:44 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1d58e35e-74eb-471d-bbdb-c75219ac6e07 tempest-SharesMetadataNegativeTest-1584039052 None] >>> [POST] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:57:44 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1d58e35e-74eb-471d-bbdb-c75219ac6e07 tempest-SharesMetadataNegativeTest-1584039052 None] {'data': '{"name": "9e93e444-3013-4370-9caa-9f912c5201e6"}', May 28 12:57:44 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1d58e35e-74eb-471d-bbdb-c75219ac6e07 tempest-SharesMetadataNegativeTest-1584039052 None] 'json': None, May 28 12:57:44 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1d58e35e-74eb-471d-bbdb-c75219ac6e07 tempest-SharesMetadataNegativeTest-1584039052 None] 'params': None} May 28 12:57:44 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-73c32d25-146c-4856-8152-deb6aa1abca7 tempest-ShareIpRulesForNFSTest-1748669711 None] <<< [POST] https://127.0.0.1:40443/api/views/ May 28 12:57:44 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-73c32d25-146c-4856-8152-deb6aa1abca7 tempest-ShareIpRulesForNFSTest-1748669711 None] Bunch(abac_tags=[], abe_max_depth=None, abe_protocols=[], alias='', allow_anonymous_access=False, allow_s3_anonymous_access=False, auto_commit='0d', bucket='', bucket_creators=[], bucket_creators_groups=[], bucket_owner=None, bulk_permission_update_progress=None, bulk_permission_update_state=None, cluster='loop75-kfs', cluster_id=1, created='2024-05-28T12:57:43.771237Z', enabled=True, files_retention_mode='NONE', guid='63641add-d7f2-4515-b5d2-49626cd8ed6a', id=20, ignore_oos=False, internal=False, is_remote=False, is_seamless=False, logical_capacity=0, max_retention_period=None, min_retention_period=None, name='b7a7d61c-2cea-442a-9809-507038e080d5', nfs_interop_flags='BOTH_NFS3_AND_NFS4_INTEROP_DISABLED', path='/manila/manila-b7a7d61c-2cea-442a-9809-507038e080d5', physical_capacity=0, policy='b7a7d61c-2cea-442a-9809-507038e080d5', policy_id=21, protocols=['NFS'], qos_policy=None, qos_policy_id=None, s3_locks=False, s3_locks_retention_mode='NONE', s3_locks_retention_period='', s3_object_ownership_rule='ObjectWriter', s3_unverified_lookup=False, s3_versioning=False, select_for_live_monitoring=False, share='', share_acl=Bunch(acl=[], enabled=False), sync='SYNCED', sync_time='2024-05-28T12:57:44.091371Z', tenant_id=1, tenant_name='default', title='/manila/manila-b7a7d61c-2cea-442a-9809-507038e080d5', url='https://127.0.0.1:40443/api/views/20/') May 28 12:57:44 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-73c32d25-146c-4856-8152-deb6aa1abca7 tempest-ShareIpRulesForNFSTest-1748669711 None] --- [POST] https://127.0.0.1:40443/api/views/: Done May 28 12:57:44 l75lg1-v1 manila-share[98474]: INFO manila.share.manager [None req-73c32d25-146c-4856-8152-deb6aa1abca7 tempest-ShareIpRulesForNFSTest-1748669711 None] Share instance b7a7d61c-2cea-442a-9809-507038e080d5 created successfully. May 28 12:57:44 l75lg1-v1 dstat.sh[49771]: 28-05 12:57:44| 4 1 93 1 0|5697M 1795M 277M 7857M| 25k 5315B| 0 1665k| 0 195 |3766 6015 |1.66 1.09 1.02|1.0 1.0 0| 0 0 | 0 2048M| 29 355 0 68 0 May 28 12:57:44 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-a9dc954e-a629-4c54-a952-85b33bc19d83 tempest-ShareSnapshotInstancesTest-843694899 tempest-ShareSnapshotInstancesTest-843694899-project-admin] GET http://10.27.203.238/share/v2/f4f7702aa04c467288cc6b142f61ec37/shares/b235c40f-7437-4e0c-b44e-321d8e8b1457 May 28 12:57:44 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-a9dc954e-a629-4c54-a952-85b33bc19d83 tempest-ShareSnapshotInstancesTest-843694899 tempest-ShareSnapshotInstancesTest-843694899-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:44 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-a9dc954e-a629-4c54-a952-85b33bc19d83 tempest-ShareSnapshotInstancesTest-843694899 tempest-ShareSnapshotInstancesTest-843694899-project-admin] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:44 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-a9dc954e-a629-4c54-a952-85b33bc19d83 tempest-ShareSnapshotInstancesTest-843694899 tempest-ShareSnapshotInstancesTest-843694899-project-admin] HTTP exception thrown: The resource could not be found. May 28 12:57:44 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-a9dc954e-a629-4c54-a952-85b33bc19d83 tempest-ShareSnapshotInstancesTest-843694899 tempest-ShareSnapshotInstancesTest-843694899-project-admin] http://10.27.203.238/share/v2/f4f7702aa04c467288cc6b142f61ec37/shares/b235c40f-7437-4e0c-b44e-321d8e8b1457 returned with HTTP 404 May 28 12:57:44 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 394/776] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:57:44 2024] GET /share/v2/f4f7702aa04c467288cc6b142f61ec37/shares/b235c40f-7437-4e0c-b44e-321d8e8b1457 => generated 78 bytes in 13 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 12:57:44 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-eeaf62c7-6681-4fae-b619-0843305f3d13 tempest-ShareSnapshotInstancesTest-843694899 tempest-ShareSnapshotInstancesTest-843694899-project-admin] DELETE http://10.27.203.238/share/v2/f4f7702aa04c467288cc6b142f61ec37/types/b13f7d87-31c1-4483-bf1e-45136ab4c6a6 May 28 12:57:44 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-eeaf62c7-6681-4fae-b619-0843305f3d13 tempest-ShareSnapshotInstancesTest-843694899 tempest-ShareSnapshotInstancesTest-843694899-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:44 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-eeaf62c7-6681-4fae-b619-0843305f3d13 tempest-ShareSnapshotInstancesTest-843694899 tempest-ShareSnapshotInstancesTest-843694899-project-admin] Calling method 'ShareTypesController._delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:44 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-eeaf62c7-6681-4fae-b619-0843305f3d13 tempest-ShareSnapshotInstancesTest-843694899 tempest-ShareSnapshotInstancesTest-843694899-project-admin] http://10.27.203.238/share/v2/f4f7702aa04c467288cc6b142f61ec37/types/b13f7d87-31c1-4483-bf1e-45136ab4c6a6 returned with HTTP 202 May 28 12:57:44 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 383/777] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:57:44 2024] DELETE /share/v2/f4f7702aa04c467288cc6b142f61ec37/types/b13f7d87-31c1-4483-bf1e-45136ab4c6a6 => generated 0 bytes in 80 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:57:44 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-c7d866b8-fcba-4cb0-a81d-747d75423547 tempest-ShareSnapshotInstancesTest-843694899 tempest-ShareSnapshotInstancesTest-843694899-project-admin] GET http://10.27.203.238/share/v2/f4f7702aa04c467288cc6b142f61ec37/types/b13f7d87-31c1-4483-bf1e-45136ab4c6a6 May 28 12:57:44 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-c7d866b8-fcba-4cb0-a81d-747d75423547 tempest-ShareSnapshotInstancesTest-843694899 tempest-ShareSnapshotInstancesTest-843694899-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:44 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-c7d866b8-fcba-4cb0-a81d-747d75423547 tempest-ShareSnapshotInstancesTest-843694899 tempest-ShareSnapshotInstancesTest-843694899-project-admin] Calling method 'ShareTypesController.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:44 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-c7d866b8-fcba-4cb0-a81d-747d75423547 tempest-ShareSnapshotInstancesTest-843694899 tempest-ShareSnapshotInstancesTest-843694899-project-admin] HTTP exception thrown: Share type not found. May 28 12:57:44 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-c7d866b8-fcba-4cb0-a81d-747d75423547 tempest-ShareSnapshotInstancesTest-843694899 tempest-ShareSnapshotInstancesTest-843694899-project-admin] http://10.27.203.238/share/v2/f4f7702aa04c467288cc6b142f61ec37/types/b13f7d87-31c1-4483-bf1e-45136ab4c6a6 returned with HTTP 404 May 28 12:57:44 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 395/778] 10.27.203.238 () {64 vars in 1448 bytes} [Tue May 28 12:57:44 2024] GET /share/v2/f4f7702aa04c467288cc6b142f61ec37/types/b13f7d87-31c1-4483-bf1e-45136ab4c6a6 => generated 67 bytes in 12 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 12:57:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887d6a79-f7e4-48c6-97b8-19716afdb54f service manila] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-887d6a79-f7e4-48c6-97b8-19716afdb54f service manila] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887d6a79-f7e4-48c6-97b8-19716afdb54f service manila] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a63dffe-af6c-401d-8116-1936349fa637 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a63dffe-af6c-401d-8116-1936349fa637 None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a63dffe-af6c-401d-8116-1936349fa637 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a63dffe-af6c-401d-8116-1936349fa637 None admin] PATH_INFO: `/v3/users/38f9868304a34b56bebf6e47a61b2d46` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a63dffe-af6c-401d-8116-1936349fa637 None admin] RBAC: Authorizing `identity:delete_user(user_id=38f9868304a34b56bebf6e47a61b2d46)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a63dffe-af6c-401d-8116-1936349fa637 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:44 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e475b181-000c-48f1-bae2-1c0506418668 tempest-SharesMetadataTest-1561320255 None] <<< [POST] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:57:44 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e475b181-000c-48f1-bae2-1c0506418668 tempest-SharesMetadataTest-1561320255 None] Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=0, created='2024-05-28T12:57:44.088708Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='24d37600-809f-4b98-9af6-3f21c6f81002', id=22, internal=False, is_s3_default_policy=False, name='5cf89605-2e7d-4ecc-9c44-5e6f5ecb0cad', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=[], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['*'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['*'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T12:57:44.426635Z', tenant_id=1, tenant_name='default', title='5cf89605-2e7d-4ecc-9c44-5e6f5ecb0cad', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/22/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[]) May 28 12:57:44 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e475b181-000c-48f1-bae2-1c0506418668 tempest-SharesMetadataTest-1561320255 None] --- [POST] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 12:57:44 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e475b181-000c-48f1-bae2-1c0506418668 tempest-SharesMetadataTest-1561320255 None] >>> [GET] https://127.0.0.1:40443/api/quotas/ May 28 12:57:44 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e475b181-000c-48f1-bae2-1c0506418668 tempest-SharesMetadataTest-1561320255 None] {'allow_redirects': True, May 28 12:57:44 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e475b181-000c-48f1-bae2-1c0506418668 tempest-SharesMetadataTest-1561320255 None] 'params': {'name': '5cf89605-2e7d-4ecc-9c44-5e6f5ecb0cad'}} May 28 12:57:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-5a63dffe-af6c-401d-8116-1936349fa637 None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38f9868304a34b56bebf6e47a61b2d46', 'request_id': 'req-5a63dffe-af6c-401d-8116-1936349fa637'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-5a63dffe-af6c-401d-8116-1936349fa637 None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38f9868304a34b56bebf6e47a61b2d46', 'request_id': 'req-5a63dffe-af6c-401d-8116-1936349fa637'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-5a63dffe-af6c-401d-8116-1936349fa637 None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38f9868304a34b56bebf6e47a61b2d46', 'request_id': 'req-5a63dffe-af6c-401d-8116-1936349fa637'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-5a63dffe-af6c-401d-8116-1936349fa637 None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38f9868304a34b56bebf6e47a61b2d46', 'request_id': 'req-5a63dffe-af6c-401d-8116-1936349fa637'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-5a63dffe-af6c-401d-8116-1936349fa637 None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38f9868304a34b56bebf6e47a61b2d46', 'request_id': 'req-5a63dffe-af6c-401d-8116-1936349fa637'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:44 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1004/2032] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 12:57:44 2024] DELETE /identity/v3/users/38f9868304a34b56bebf6e47a61b2d46 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:57:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb69e78-af91-4459-b585-ee962dc0508f None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb69e78-af91-4459-b585-ee962dc0508f None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb69e78-af91-4459-b585-ee962dc0508f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:44 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-2bb69e78-af91-4459-b585-ee962dc0508f None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:57:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-2bb69e78-af91-4459-b585-ee962dc0508f None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:57:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-2bb69e78-af91-4459-b585-ee962dc0508f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:44 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f6784d36-6966-4d0d-8f96-f818219fe4a4 tempest-AdminActionsTest-1749172189 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:57:44 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f6784d36-6966-4d0d-8f96-f818219fe4a4 tempest-AdminActionsTest-1749172189 None] [Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=0, created='2024-05-28T12:57:32.701407Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='33f7134a-3093-4a78-b34b-cfd50d818cbc', id=20, internal=False, is_s3_default_policy=False, name='724bc53b-1c28-4ab1-b3c8-ab90f868473d', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=[], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['*'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['*'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T12:57:33.061049Z', tenant_id=1, tenant_name='default', title='724bc53b-1c28-4ab1-b3c8-ab90f868473d', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/20/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[])] May 28 12:57:44 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f6784d36-6966-4d0d-8f96-f818219fe4a4 tempest-AdminActionsTest-1749172189 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 12:57:44 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f6784d36-6966-4d0d-8f96-f818219fe4a4 tempest-AdminActionsTest-1749172189 None] >>> [DELETE] https://127.0.0.1:40443/api/viewpolicies/20/ May 28 12:57:44 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1029/2033] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:57:44 2024] POST /identity/v3/auth/tokens => generated 2960 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 12:57:44 l75lg1-v1 neutron-server[77619]: DEBUG neutron.wsgi [-] (77619) accepted ('10.27.203.238', 41638) {{(pid=77619) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 12:57:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a63dffe-af6c-401d-8116-1936349fa637 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-5a63dffe-af6c-401d-8116-1936349fa637 None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a63dffe-af6c-401d-8116-1936349fa637 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90a89c0-f92c-449d-b5da-cf63cd428aad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef17047035e4b518fd5360a01f2da1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90a89c0-f92c-449d-b5da-cf63cd428aad service neutron] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90a89c0-f92c-449d-b5da-cf63cd428aad service neutron] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90a89c0-f92c-449d-b5da-cf63cd428aad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90a89c0-f92c-449d-b5da-cf63cd428aad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90a89c0-f92c-449d-b5da-cf63cd428aad service neutron] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:44 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1005/2034] 10.27.203.238 () {64 vars in 1432 bytes} [Tue May 28 12:57:44 2024] GET /identity/v3/auth/tokens => generated 2960 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 28 12:57:44 l75lg1-v1 neutron-server[77619]: INFO neutron.wsgi [None req-be714afd-b3a6-41e2-90d2-b7d008ebee46 None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=f4f7702aa04c467288cc6b142f61ec37&name=default HTTP/1.1" status: 200 len: 216 time: 0.0791831 May 28 12:57:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb69e78-af91-4459-b585-ee962dc0508f None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-2bb69e78-af91-4459-b585-ee962dc0508f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb69e78-af91-4459-b585-ee962dc0508f None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c236c0-4613-4eaa-902e-b9187baba188 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c236c0-4613-4eaa-902e-b9187baba188 None admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c236c0-4613-4eaa-902e-b9187baba188 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c236c0-4613-4eaa-902e-b9187baba188 None admin] PATH_INFO: `/v3/projects/f4f7702aa04c467288cc6b142f61ec37` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c236c0-4613-4eaa-902e-b9187baba188 None admin] RBAC: Authorizing `identity:delete_project(project_id=f4f7702aa04c467288cc6b142f61ec37)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c236c0-4613-4eaa-902e-b9187baba188 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-62c236c0-4613-4eaa-902e-b9187baba188 None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4f7702aa04c467288cc6b142f61ec37', 'request_id': 'req-62c236c0-4613-4eaa-902e-b9187baba188'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-62c236c0-4613-4eaa-902e-b9187baba188 None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4f7702aa04c467288cc6b142f61ec37', 'request_id': 'req-62c236c0-4613-4eaa-902e-b9187baba188'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-62c236c0-4613-4eaa-902e-b9187baba188 None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4f7702aa04c467288cc6b142f61ec37', 'request_id': 'req-62c236c0-4613-4eaa-902e-b9187baba188'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-62c236c0-4613-4eaa-902e-b9187baba188 None admin] The token cache is being invalidate because project f4f7702aa04c467288cc6b142f61ec37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 12:57:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-62c236c0-4613-4eaa-902e-b9187baba188 None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-62c236c0-4613-4eaa-902e-b9187baba188 None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:44 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1030/2035] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 12:57:44 2024] DELETE /identity/v3/projects/f4f7702aa04c467288cc6b142f61ec37 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:57:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deea1aab-f983-42f0-ba41-5bc7d43b0d3e None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deea1aab-f983-42f0-ba41-5bc7d43b0d3e None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deea1aab-f983-42f0-ba41-5bc7d43b0d3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:44 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-deea1aab-f983-42f0-ba41-5bc7d43b0d3e None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:57:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-deea1aab-f983-42f0-ba41-5bc7d43b0d3e None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:57:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-deea1aab-f983-42f0-ba41-5bc7d43b0d3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:44 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1006/2036] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:57:44 2024] POST /identity/v3/auth/tokens => generated 312 bytes in 19 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 28 12:57:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e565f3d-4c22-495f-8ceb-c1e90df82e7a None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e565f3d-4c22-495f-8ceb-c1e90df82e7a None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e565f3d-4c22-495f-8ceb-c1e90df82e7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:44 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-4e565f3d-4c22-495f-8ceb-c1e90df82e7a None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:57:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-4e565f3d-4c22-495f-8ceb-c1e90df82e7a None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:57:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-4e565f3d-4c22-495f-8ceb-c1e90df82e7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:44 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1031/2037] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:57:44 2024] POST /identity/v3/auth/tokens => generated 2960 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 12:57:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deea1aab-f983-42f0-ba41-5bc7d43b0d3e None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deea1aab-f983-42f0-ba41-5bc7d43b0d3e None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd314e3c-67f8-41f6-b89d-ddefe6585397 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd314e3c-67f8-41f6-b89d-ddefe6585397 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd314e3c-67f8-41f6-b89d-ddefe6585397 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd314e3c-67f8-41f6-b89d-ddefe6585397 None admin] PATH_INFO: `/v3/domains` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd314e3c-67f8-41f6-b89d-ddefe6585397 None admin] RBAC: Adding query filter params (name=Default) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:57:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd314e3c-67f8-41f6-b89d-ddefe6585397 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd314e3c-67f8-41f6-b89d-ddefe6585397 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:44 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1007/2038] 10.27.203.238 () {62 vars in 1220 bytes} [Tue May 28 12:57:44 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:57:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e565f3d-4c22-495f-8ceb-c1e90df82e7a None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e565f3d-4c22-495f-8ceb-c1e90df82e7a None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924ad440-c56e-433e-9be3-ad51b4d03d5c None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924ad440-c56e-433e-9be3-ad51b4d03d5c None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924ad440-c56e-433e-9be3-ad51b4d03d5c None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924ad440-c56e-433e-9be3-ad51b4d03d5c None admin] PATH_INFO: `/v3/projects` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924ad440-c56e-433e-9be3-ad51b4d03d5c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924ad440-c56e-433e-9be3-ad51b4d03d5c None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:44 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1032/2039] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 12:57:44 2024] POST /identity/v3/projects => generated 417 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:57:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd314e3c-67f8-41f6-b89d-ddefe6585397 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd314e3c-67f8-41f6-b89d-ddefe6585397 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa74a27d-0198-44a1-b621-400063f618c9 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa74a27d-0198-44a1-b621-400063f618c9 None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa74a27d-0198-44a1-b621-400063f618c9 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa74a27d-0198-44a1-b621-400063f618c9 None admin] PATH_INFO: `/v3/users` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa74a27d-0198-44a1-b621-400063f618c9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa74a27d-0198-44a1-b621-400063f618c9 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:44 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-fa74a27d-0198-44a1-b621-400063f618c9 None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 12:57:44 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1008/2040] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 12:57:44 2024] POST /identity/v3/users => generated 317 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:57:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924ad440-c56e-433e-9be3-ad51b4d03d5c None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924ad440-c56e-433e-9be3-ad51b4d03d5c None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed243a9f-5498-49ba-9739-79dfd8b3edca None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed243a9f-5498-49ba-9739-79dfd8b3edca None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed243a9f-5498-49ba-9739-79dfd8b3edca None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed243a9f-5498-49ba-9739-79dfd8b3edca None admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed243a9f-5498-49ba-9739-79dfd8b3edca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed243a9f-5498-49ba-9739-79dfd8b3edca None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:45 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1033/2041] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 12:57:45 2024] GET /identity/v3/roles => generated 1680 bytes in 18 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:57:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa74a27d-0198-44a1-b621-400063f618c9 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa74a27d-0198-44a1-b621-400063f618c9 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf1986a-5c39-459b-b433-99d5d2cfe046 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf1986a-5c39-459b-b433-99d5d2cfe046 None admin] REQUEST_METHOD: `PUT` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf1986a-5c39-459b-b433-99d5d2cfe046 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf1986a-5c39-459b-b433-99d5d2cfe046 None admin] PATH_INFO: `/v3/projects/f84351e3119949b78e742aaf4bf970bf/users/3a064c27328349069060d9e9ebb49aed/roles/44620cad10ae407c90c91e2c296adb04` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf1986a-5c39-459b-b433-99d5d2cfe046 None admin] RBAC: Authorizing `identity:create_grant(project_id=f84351e3119949b78e742aaf4bf970bf, user_id=3a064c27328349069060d9e9ebb49aed, role_id=44620cad10ae407c90c91e2c296adb04)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf1986a-5c39-459b-b433-99d5d2cfe046 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:45 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1009/2042] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 12:57:45 2024] PUT /identity/v3/projects/f84351e3119949b78e742aaf4bf970bf/users/3a064c27328349069060d9e9ebb49aed/roles/44620cad10ae407c90c91e2c296adb04 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:57:45 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e475b181-000c-48f1-bae2-1c0506418668 tempest-SharesMetadataTest-1561320255 None] <<< [GET] https://127.0.0.1:40443/api/quotas/ May 28 12:57:45 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e475b181-000c-48f1-bae2-1c0506418668 tempest-SharesMetadataTest-1561320255 None] [] May 28 12:57:45 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e475b181-000c-48f1-bae2-1c0506418668 tempest-SharesMetadataTest-1561320255 None] --- [GET] https://127.0.0.1:40443/api/quotas/: Done May 28 12:57:45 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e475b181-000c-48f1-bae2-1c0506418668 tempest-SharesMetadataTest-1561320255 None] >>> [POST] https://127.0.0.1:40443/api/quotas/ May 28 12:57:45 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e475b181-000c-48f1-bae2-1c0506418668 tempest-SharesMetadataTest-1561320255 None] {'data': '{"name": "5cf89605-2e7d-4ecc-9c44-5e6f5ecb0cad", "path": ' May 28 12:57:45 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e475b181-000c-48f1-bae2-1c0506418668 tempest-SharesMetadataTest-1561320255 None] '"/manila/manila-5cf89605-2e7d-4ecc-9c44-5e6f5ecb0cad", "create_dir": ' May 28 12:57:45 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e475b181-000c-48f1-bae2-1c0506418668 tempest-SharesMetadataTest-1561320255 None] 'true, "hard_limit": 1073741824}', May 28 12:57:45 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e475b181-000c-48f1-bae2-1c0506418668 tempest-SharesMetadataTest-1561320255 None] 'json': None, May 28 12:57:45 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e475b181-000c-48f1-bae2-1c0506418668 tempest-SharesMetadataTest-1561320255 None] 'params': None} May 28 12:57:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1f3927-b98b-4798-b3ed-b4b2a77724d6 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1f3927-b98b-4798-b3ed-b4b2a77724d6 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1f3927-b98b-4798-b3ed-b4b2a77724d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:45 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-5b1f3927-b98b-4798-b3ed-b4b2a77724d6 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:57:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-5b1f3927-b98b-4798-b3ed-b4b2a77724d6 None None] MFA Rules not processed for user `3a064c27328349069060d9e9ebb49aed`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:57:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-5b1f3927-b98b-4798-b3ed-b4b2a77724d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:45 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1034/2043] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:57:45 2024] POST /identity/v3/auth/tokens => generated 3988 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:57:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf1986a-5c39-459b-b433-99d5d2cfe046 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf1986a-5c39-459b-b433-99d5d2cfe046 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13bda30-8a5f-4fbd-bc46-d9dd2b1e49fc None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13bda30-8a5f-4fbd-bc46-d9dd2b1e49fc None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13bda30-8a5f-4fbd-bc46-d9dd2b1e49fc None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13bda30-8a5f-4fbd-bc46-d9dd2b1e49fc None admin] PATH_INFO: `/v3/projects` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13bda30-8a5f-4fbd-bc46-d9dd2b1e49fc None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13bda30-8a5f-4fbd-bc46-d9dd2b1e49fc None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:45 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1010/2044] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 12:57:45 2024] POST /identity/v3/projects => generated 417 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:57:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1f3927-b98b-4798-b3ed-b4b2a77724d6 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1f3927-b98b-4798-b3ed-b4b2a77724d6 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:45 l75lg1-v1 dstat.sh[49771]: 28-05 12:57:45| 9 1 82 6 0|5698M 1793M 277M 7857M| 21k 2469B| 0 8493k| 0 696 |7816 13k|1.66 1.09 1.02|1.0 0 1.0| 0 0 | 0 2048M| 29 356 0 69 0 May 28 12:57:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a2146a-615d-4556-b008-ec980c81abd3 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a2146a-615d-4556-b008-ec980c81abd3 None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a2146a-615d-4556-b008-ec980c81abd3 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a2146a-615d-4556-b008-ec980c81abd3 None admin] PATH_INFO: `/v3/users` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a2146a-615d-4556-b008-ec980c81abd3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a2146a-615d-4556-b008-ec980c81abd3 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:45 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-34a2146a-615d-4556-b008-ec980c81abd3 None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 12:57:45 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1035/2045] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 12:57:45 2024] POST /identity/v3/users => generated 317 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:57:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13bda30-8a5f-4fbd-bc46-d9dd2b1e49fc None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13bda30-8a5f-4fbd-bc46-d9dd2b1e49fc None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12de47f9-1207-46e2-9251-a2d16b13a7c0 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12de47f9-1207-46e2-9251-a2d16b13a7c0 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12de47f9-1207-46e2-9251-a2d16b13a7c0 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12de47f9-1207-46e2-9251-a2d16b13a7c0 None admin] PATH_INFO: `/v3/roles` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12de47f9-1207-46e2-9251-a2d16b13a7c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12de47f9-1207-46e2-9251-a2d16b13a7c0 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:45 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1011/2046] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 12:57:45 2024] GET /identity/v3/roles => generated 1680 bytes in 18 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:57:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a2146a-615d-4556-b008-ec980c81abd3 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a2146a-615d-4556-b008-ec980c81abd3 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0895a8f9-53d2-4cd2-a338-68fc7e2206cf None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0895a8f9-53d2-4cd2-a338-68fc7e2206cf None admin] REQUEST_METHOD: `PUT` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0895a8f9-53d2-4cd2-a338-68fc7e2206cf None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0895a8f9-53d2-4cd2-a338-68fc7e2206cf None admin] PATH_INFO: `/v3/projects/79c22d93ef6a4115a5b0066f1b85b888/users/05edbb51061048028aa360253ec8d71f/roles/44620cad10ae407c90c91e2c296adb04` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0895a8f9-53d2-4cd2-a338-68fc7e2206cf None admin] RBAC: Authorizing `identity:create_grant(project_id=79c22d93ef6a4115a5b0066f1b85b888, user_id=05edbb51061048028aa360253ec8d71f, role_id=44620cad10ae407c90c91e2c296adb04)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0895a8f9-53d2-4cd2-a338-68fc7e2206cf None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:45 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1036/2047] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 12:57:45 2024] PUT /identity/v3/projects/79c22d93ef6a4115a5b0066f1b85b888/users/05edbb51061048028aa360253ec8d71f/roles/44620cad10ae407c90c91e2c296adb04 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:57:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dbe7ec-44f8-43b9-98d6-f0e540a70d6e None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dbe7ec-44f8-43b9-98d6-f0e540a70d6e None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dbe7ec-44f8-43b9-98d6-f0e540a70d6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:45 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1d58e35e-74eb-471d-bbdb-c75219ac6e07 tempest-SharesMetadataNegativeTest-1584039052 None] <<< [POST] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:57:45 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1d58e35e-74eb-471d-bbdb-c75219ac6e07 tempest-SharesMetadataNegativeTest-1584039052 None] Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=0, created='2024-05-28T12:57:44.861869Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='12459ef8-d17b-4bf0-8edc-1e7e86135440', id=23, internal=False, is_s3_default_policy=False, name='9e93e444-3013-4370-9caa-9f912c5201e6', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=[], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['*'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['*'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T12:57:45.276765Z', tenant_id=1, tenant_name='default', title='9e93e444-3013-4370-9caa-9f912c5201e6', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/23/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[]) May 28 12:57:45 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1d58e35e-74eb-471d-bbdb-c75219ac6e07 tempest-SharesMetadataNegativeTest-1584039052 None] --- [POST] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 12:57:45 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1d58e35e-74eb-471d-bbdb-c75219ac6e07 tempest-SharesMetadataNegativeTest-1584039052 None] >>> [GET] https://127.0.0.1:40443/api/quotas/ May 28 12:57:45 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1d58e35e-74eb-471d-bbdb-c75219ac6e07 tempest-SharesMetadataNegativeTest-1584039052 None] {'allow_redirects': True, May 28 12:57:45 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1d58e35e-74eb-471d-bbdb-c75219ac6e07 tempest-SharesMetadataNegativeTest-1584039052 None] 'params': {'name': '9e93e444-3013-4370-9caa-9f912c5201e6'}} May 28 12:57:45 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-88dbe7ec-44f8-43b9-98d6-f0e540a70d6e None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:57:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-88dbe7ec-44f8-43b9-98d6-f0e540a70d6e None None] MFA Rules not processed for user `05edbb51061048028aa360253ec8d71f`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:57:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-88dbe7ec-44f8-43b9-98d6-f0e540a70d6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:45 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1012/2048] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:57:45 2024] POST /identity/v3/auth/tokens => generated 3988 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:57:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0895a8f9-53d2-4cd2-a338-68fc7e2206cf None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0895a8f9-53d2-4cd2-a338-68fc7e2206cf None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9a4a49-a4d9-4610-ad53-e8c8d342e1bd None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9a4a49-a4d9-4610-ad53-e8c8d342e1bd None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9a4a49-a4d9-4610-ad53-e8c8d342e1bd None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9a4a49-a4d9-4610-ad53-e8c8d342e1bd None admin] PATH_INFO: `/v3/projects` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9a4a49-a4d9-4610-ad53-e8c8d342e1bd None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9a4a49-a4d9-4610-ad53-e8c8d342e1bd None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:45 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1037/2049] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 12:57:45 2024] POST /identity/v3/projects => generated 411 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:57:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dbe7ec-44f8-43b9-98d6-f0e540a70d6e None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dbe7ec-44f8-43b9-98d6-f0e540a70d6e None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af3be91-29dc-4ca8-82b8-3cd8b0597a09 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af3be91-29dc-4ca8-82b8-3cd8b0597a09 None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af3be91-29dc-4ca8-82b8-3cd8b0597a09 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af3be91-29dc-4ca8-82b8-3cd8b0597a09 None admin] PATH_INFO: `/v3/users` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af3be91-29dc-4ca8-82b8-3cd8b0597a09 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af3be91-29dc-4ca8-82b8-3cd8b0597a09 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:45 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-2af3be91-29dc-4ca8-82b8-3cd8b0597a09 None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 12:57:45 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1013/2050] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 12:57:45 2024] POST /identity/v3/users => generated 313 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:57:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9a4a49-a4d9-4610-ad53-e8c8d342e1bd None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9a4a49-a4d9-4610-ad53-e8c8d342e1bd None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e605afc9-aec6-4b48-b6a5-c41644cdb930 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e605afc9-aec6-4b48-b6a5-c41644cdb930 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e605afc9-aec6-4b48-b6a5-c41644cdb930 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e605afc9-aec6-4b48-b6a5-c41644cdb930 None admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e605afc9-aec6-4b48-b6a5-c41644cdb930 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e605afc9-aec6-4b48-b6a5-c41644cdb930 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:45 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1038/2051] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 12:57:45 2024] GET /identity/v3/roles => generated 1680 bytes in 17 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:57:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af3be91-29dc-4ca8-82b8-3cd8b0597a09 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af3be91-29dc-4ca8-82b8-3cd8b0597a09 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cd3e03-59c2-4bb9-aea9-8d66529bd51b None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cd3e03-59c2-4bb9-aea9-8d66529bd51b None admin] REQUEST_METHOD: `PUT` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cd3e03-59c2-4bb9-aea9-8d66529bd51b None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cd3e03-59c2-4bb9-aea9-8d66529bd51b None admin] PATH_INFO: `/v3/projects/6bd48af9e1aa4ddf993b915112d9430d/users/f11da789b819461c9bddb10be1712ee9/roles/e7989893488f483baa107be56668c4f8` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cd3e03-59c2-4bb9-aea9-8d66529bd51b None admin] RBAC: Authorizing `identity:create_grant(project_id=6bd48af9e1aa4ddf993b915112d9430d, user_id=f11da789b819461c9bddb10be1712ee9, role_id=e7989893488f483baa107be56668c4f8)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cd3e03-59c2-4bb9-aea9-8d66529bd51b None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:45 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1014/2052] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 12:57:45 2024] PUT /identity/v3/projects/6bd48af9e1aa4ddf993b915112d9430d/users/f11da789b819461c9bddb10be1712ee9/roles/e7989893488f483baa107be56668c4f8 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:57:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e605afc9-aec6-4b48-b6a5-c41644cdb930 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e605afc9-aec6-4b48-b6a5-c41644cdb930 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:45 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-47fa3561-dd13-4c45-9889-2e333b54e950 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] GET http://10.27.203.238/share/v2/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1 May 28 12:57:45 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-47fa3561-dd13-4c45-9889-2e333b54e950 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:45 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-47fa3561-dd13-4c45-9889-2e333b54e950 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:45 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-47fa3561-dd13-4c45-9889-2e333b54e950 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] http://10.27.203.238/share/v2/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1 returned with HTTP 200 May 28 12:57:45 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 384/779] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:57:45 2024] GET /share/v2/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1 => generated 1317 bytes in 26 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:57:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3490fd-bf4c-4a59-9c21-5df1564d459b None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3490fd-bf4c-4a59-9c21-5df1564d459b None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3490fd-bf4c-4a59-9c21-5df1564d459b None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3490fd-bf4c-4a59-9c21-5df1564d459b None admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3490fd-bf4c-4a59-9c21-5df1564d459b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3490fd-bf4c-4a59-9c21-5df1564d459b None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:45 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-9b2a0955-73fa-4cdd-9d93-42a7023f7cc8 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] POST http://10.27.203.238/share/v1/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action May 28 12:57:45 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-9b2a0955-73fa-4cdd-9d93-42a7023f7cc8 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Action body: b'{"os-allow_access": {"access_type": "ip", "access_to": "203.0.113.108/30", "access_level": "rw"}}' {{(pid=98329) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:57:45 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-9b2a0955-73fa-4cdd-9d93-42a7023f7cc8 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Action: 'action', calling method: ShareController.allow_access, body: {"os-allow_access": {"access_type": "ip", "access_to": "203.0.113.108/30", "access_level": "rw"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:57:45 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1039/2053] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 12:57:45 2024] GET /identity/v3/roles => generated 1680 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:57:45 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1d58e35e-74eb-471d-bbdb-c75219ac6e07 tempest-SharesMetadataNegativeTest-1584039052 None] <<< [GET] https://127.0.0.1:40443/api/quotas/ May 28 12:57:45 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1d58e35e-74eb-471d-bbdb-c75219ac6e07 tempest-SharesMetadataNegativeTest-1584039052 None] [] May 28 12:57:45 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1d58e35e-74eb-471d-bbdb-c75219ac6e07 tempest-SharesMetadataNegativeTest-1584039052 None] --- [GET] https://127.0.0.1:40443/api/quotas/: Done May 28 12:57:45 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1d58e35e-74eb-471d-bbdb-c75219ac6e07 tempest-SharesMetadataNegativeTest-1584039052 None] >>> [POST] https://127.0.0.1:40443/api/quotas/ May 28 12:57:45 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1d58e35e-74eb-471d-bbdb-c75219ac6e07 tempest-SharesMetadataNegativeTest-1584039052 None] {'data': '{"name": "9e93e444-3013-4370-9caa-9f912c5201e6", "path": ' May 28 12:57:45 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1d58e35e-74eb-471d-bbdb-c75219ac6e07 tempest-SharesMetadataNegativeTest-1584039052 None] '"/manila/manila-9e93e444-3013-4370-9caa-9f912c5201e6", "create_dir": ' May 28 12:57:45 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1d58e35e-74eb-471d-bbdb-c75219ac6e07 tempest-SharesMetadataNegativeTest-1584039052 None] 'true, "hard_limit": 1073741824}', May 28 12:57:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cd3e03-59c2-4bb9-aea9-8d66529bd51b None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:45 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1d58e35e-74eb-471d-bbdb-c75219ac6e07 tempest-SharesMetadataNegativeTest-1584039052 None] 'json': None, May 28 12:57:45 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1d58e35e-74eb-471d-bbdb-c75219ac6e07 tempest-SharesMetadataNegativeTest-1584039052 None] 'params': None} May 28 12:57:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cd3e03-59c2-4bb9-aea9-8d66529bd51b None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a1c939-8654-4e56-b29c-26cc82f0da25 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a1c939-8654-4e56-b29c-26cc82f0da25 None admin] REQUEST_METHOD: `PUT` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a1c939-8654-4e56-b29c-26cc82f0da25 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a1c939-8654-4e56-b29c-26cc82f0da25 None admin] PATH_INFO: `/v3/projects/6bd48af9e1aa4ddf993b915112d9430d/users/f11da789b819461c9bddb10be1712ee9/roles/e7989893488f483baa107be56668c4f8` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a1c939-8654-4e56-b29c-26cc82f0da25 None admin] RBAC: Authorizing `identity:create_grant(project_id=6bd48af9e1aa4ddf993b915112d9430d, user_id=f11da789b819461c9bddb10be1712ee9, role_id=e7989893488f483baa107be56668c4f8)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a1c939-8654-4e56-b29c-26cc82f0da25 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:45 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1015/2054] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 12:57:45 2024] PUT /identity/v3/projects/6bd48af9e1aa4ddf993b915112d9430d/users/f11da789b819461c9bddb10be1712ee9/roles/e7989893488f483baa107be56668c4f8 => generated 0 bytes in 20 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:57:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaf3afe-1b72-4a01-aeb5-2778870ab4db None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaf3afe-1b72-4a01-aeb5-2778870ab4db None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaf3afe-1b72-4a01-aeb5-2778870ab4db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:45 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-bcaf3afe-1b72-4a01-aeb5-2778870ab4db None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:57:45 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-03b84c9e-5549-4e30-8170-3789d24411ba tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] GET http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/da7ec0a1-db21-42c6-b842-6f87b3c5843d May 28 12:57:45 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-03b84c9e-5549-4e30-8170-3789d24411ba tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:45 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-03b84c9e-5549-4e30-8170-3789d24411ba tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-bcaf3afe-1b72-4a01-aeb5-2778870ab4db None None] MFA Rules not processed for user `f11da789b819461c9bddb10be1712ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:57:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-bcaf3afe-1b72-4a01-aeb5-2778870ab4db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:45 l75lg1-v1 devstack@m-api.service[98329]: DEBUG oslo_concurrency.lockutils [None req-9b2a0955-73fa-4cdd-9d93-42a7023f7cc8 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98329) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:57:45 l75lg1-v1 devstack@m-api.service[98329]: DEBUG oslo_concurrency.lockutils [None req-9b2a0955-73fa-4cdd-9d93-42a7023f7cc8 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98329) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:57:45 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-03b84c9e-5549-4e30-8170-3789d24411ba tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/da7ec0a1-db21-42c6-b842-6f87b3c5843d returned with HTTP 200 May 28 12:57:45 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 385/780] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:57:45 2024] GET /share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/da7ec0a1-db21-42c6-b842-6f87b3c5843d => generated 1314 bytes in 28 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:57:45 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1040/2055] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:57:45 2024] POST /identity/v3/auth/tokens => generated 4105 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:57:45 l75lg1-v1 devstack@m-api.service[98329]: DEBUG oslo_concurrency.lockutils [None req-9b2a0955-73fa-4cdd-9d93-42a7023f7cc8 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.045s {{(pid=98329) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:57:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a1c939-8654-4e56-b29c-26cc82f0da25 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a1c939-8654-4e56-b29c-26cc82f0da25 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24abd48-4f9f-449b-9dc9-a45f9ed7542b tempest-SnapshotInstancesNegativeNoResourceTest-5019251 tempest-SnapshotInstancesNegativeNoResourceTest-5019251-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f11da789b819461c9bddb10be1712ee9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bd48af9e1aa4ddf993b915112d9430d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24abd48-4f9f-449b-9dc9-a45f9ed7542b tempest-SnapshotInstancesNegativeNoResourceTest-5019251 tempest-SnapshotInstancesNegativeNoResourceTest-5019251-project-admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24abd48-4f9f-449b-9dc9-a45f9ed7542b tempest-SnapshotInstancesNegativeNoResourceTest-5019251 tempest-SnapshotInstancesNegativeNoResourceTest-5019251-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24abd48-4f9f-449b-9dc9-a45f9ed7542b tempest-SnapshotInstancesNegativeNoResourceTest-5019251 tempest-SnapshotInstancesNegativeNoResourceTest-5019251-project-admin] PATH_INFO: `/v3/domains` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24abd48-4f9f-449b-9dc9-a45f9ed7542b tempest-SnapshotInstancesNegativeNoResourceTest-5019251 tempest-SnapshotInstancesNegativeNoResourceTest-5019251-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:57:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24abd48-4f9f-449b-9dc9-a45f9ed7542b tempest-SnapshotInstancesNegativeNoResourceTest-5019251 tempest-SnapshotInstancesNegativeNoResourceTest-5019251-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24abd48-4f9f-449b-9dc9-a45f9ed7542b tempest-SnapshotInstancesNegativeNoResourceTest-5019251 tempest-SnapshotInstancesNegativeNoResourceTest-5019251-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:45 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-9b2a0955-73fa-4cdd-9d93-42a7023f7cc8 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] http://10.27.203.238/share/v1/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action returned with HTTP 200 May 28 12:57:45 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 396/781] 10.27.203.238 () {64 vars in 1450 bytes} [Tue May 28 12:57:45 2024] POST /share/v1/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action => generated 202 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:57:45 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1016/2056] 10.27.203.238 () {62 vars in 1241 bytes} [Tue May 28 12:57:45 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:57:45 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-69cafe2f-f60c-4841-88e2-0a8794a67ac6 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] POST http://10.27.203.238/share/v1/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action May 28 12:57:45 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-69cafe2f-f60c-4841-88e2-0a8794a67ac6 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Action body: b'{"os-access_list": null}' {{(pid=98330) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:57:45 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-69cafe2f-f60c-4841-88e2-0a8794a67ac6 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Action: 'action', calling method: ShareController.access_list, body: {"os-access_list": null} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:57:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaf3afe-1b72-4a01-aeb5-2778870ab4db None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:45 l75lg1-v1 manila-share[98474]: DEBUG manila.share.manager [None req-9b2a0955-73fa-4cdd-9d93-42a7023f7cc8 tempest-ShareIpRulesForNFSTest-1748669711 None] Received request to update access for share instance b7a7d61c-2cea-442a-9809-507038e080d5. {{(pid=98474) update_access_for_instances /opt/stack/manila/manila/share/manager.py:4353}} May 28 12:57:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaf3afe-1b72-4a01-aeb5-2778870ab4db None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f549ef-abe8-48ad-b3cd-8d487f0f94b4 tempest-SnapshotInstancesNegativeNoResourceTest-5019251 tempest-SnapshotInstancesNegativeNoResourceTest-5019251-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f11da789b819461c9bddb10be1712ee9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bd48af9e1aa4ddf993b915112d9430d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f549ef-abe8-48ad-b3cd-8d487f0f94b4 tempest-SnapshotInstancesNegativeNoResourceTest-5019251 tempest-SnapshotInstancesNegativeNoResourceTest-5019251-project-admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f549ef-abe8-48ad-b3cd-8d487f0f94b4 tempest-SnapshotInstancesNegativeNoResourceTest-5019251 tempest-SnapshotInstancesNegativeNoResourceTest-5019251-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f549ef-abe8-48ad-b3cd-8d487f0f94b4 tempest-SnapshotInstancesNegativeNoResourceTest-5019251 tempest-SnapshotInstancesNegativeNoResourceTest-5019251-project-admin] PATH_INFO: `/v3/users` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f549ef-abe8-48ad-b3cd-8d487f0f94b4 tempest-SnapshotInstancesNegativeNoResourceTest-5019251 tempest-SnapshotInstancesNegativeNoResourceTest-5019251-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f549ef-abe8-48ad-b3cd-8d487f0f94b4 tempest-SnapshotInstancesNegativeNoResourceTest-5019251 tempest-SnapshotInstancesNegativeNoResourceTest-5019251-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:45 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-72f549ef-abe8-48ad-b3cd-8d487f0f94b4 tempest-SnapshotInstancesNegativeNoResourceTest-5019251 tempest-SnapshotInstancesNegativeNoResourceTest-5019251-project-admin] Truncating password to algorithm specific maximum length 72 characters. May 28 12:57:45 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-9b2a0955-73fa-4cdd-9d93-42a7023f7cc8 tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:57:45 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-9b2a0955-73fa-4cdd-9d93-42a7023f7cc8 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:57:45 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-9b2a0955-73fa-4cdd-9d93-42a7023f7cc8 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:57:45 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-9b2a0955-73fa-4cdd-9d93-42a7023f7cc8 tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:57:45 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-9b2a0955-73fa-4cdd-9d93-42a7023f7cc8 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:57:45 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1041/2057] 10.27.203.238 () {64 vars in 1232 bytes} [Tue May 28 12:57:45 2024] POST /identity/v3/users => generated 435 bytes in 34 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:57:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24abd48-4f9f-449b-9dc9-a45f9ed7542b tempest-SnapshotInstancesNegativeNoResourceTest-5019251 tempest-SnapshotInstancesNegativeNoResourceTest-5019251-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24abd48-4f9f-449b-9dc9-a45f9ed7542b tempest-SnapshotInstancesNegativeNoResourceTest-5019251 tempest-SnapshotInstancesNegativeNoResourceTest-5019251-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85180972-e2e7-4c1f-a4b3-b16fd1c36b2b tempest-SnapshotInstancesNegativeNoResourceTest-5019251 tempest-SnapshotInstancesNegativeNoResourceTest-5019251-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f11da789b819461c9bddb10be1712ee9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bd48af9e1aa4ddf993b915112d9430d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85180972-e2e7-4c1f-a4b3-b16fd1c36b2b tempest-SnapshotInstancesNegativeNoResourceTest-5019251 tempest-SnapshotInstancesNegativeNoResourceTest-5019251-project-admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85180972-e2e7-4c1f-a4b3-b16fd1c36b2b tempest-SnapshotInstancesNegativeNoResourceTest-5019251 tempest-SnapshotInstancesNegativeNoResourceTest-5019251-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85180972-e2e7-4c1f-a4b3-b16fd1c36b2b tempest-SnapshotInstancesNegativeNoResourceTest-5019251 tempest-SnapshotInstancesNegativeNoResourceTest-5019251-project-admin] PATH_INFO: `/v3/roles` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85180972-e2e7-4c1f-a4b3-b16fd1c36b2b tempest-SnapshotInstancesNegativeNoResourceTest-5019251 tempest-SnapshotInstancesNegativeNoResourceTest-5019251-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85180972-e2e7-4c1f-a4b3-b16fd1c36b2b tempest-SnapshotInstancesNegativeNoResourceTest-5019251 tempest-SnapshotInstancesNegativeNoResourceTest-5019251-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:45 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-69cafe2f-f60c-4841-88e2-0a8794a67ac6 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] http://10.27.203.238/share/v1/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action returned with HTTP 200 May 28 12:57:45 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 386/782] 10.27.203.238 () {64 vars in 1450 bytes} [Tue May 28 12:57:45 2024] POST /share/v1/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action => generated 157 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 230 bytes (2 switches on core 0) May 28 12:57:45 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e475b181-000c-48f1-bae2-1c0506418668 tempest-SharesMetadataTest-1561320255 None] <<< [POST] https://127.0.0.1:40443/api/quotas/ May 28 12:57:45 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1017/2058] 10.27.203.238 () {62 vars in 1210 bytes} [Tue May 28 12:57:45 2024] GET /identity/v3/roles => generated 1680 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:57:45 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e475b181-000c-48f1-bae2-1c0506418668 tempest-SharesMetadataTest-1561320255 None] Bunch(cluster='loop75-kfs', cluster_id=1, default_email=None, default_group_quota=None, default_user_quota=None, enable_alarms=True, enable_email_providers=True, grace_period=None, group_quotas=[], guid='e06dd441-3858-4651-8b77-6371f1d2a0ce', hard_limit=1073741824, hard_limit_inodes=None, id=19, internal=False, is_user_quota=False, last_user_quotas_update=None, name='5cf89605-2e7d-4ecc-9c44-5e6f5ecb0cad', num_blocked_users=0, num_exceeded_users=0, path='/manila/manila-5cf89605-2e7d-4ecc-9c44-5e6f5ecb0cad', percent_capacity=0, percent_inodes=None, pretty_grace_period=None, pretty_grace_period_expiration=None, pretty_state='OK (CREATED)', soft_limit=None, soft_limit_inodes=None, state='OK', sync_state='CREATED', system_id=19, tenant_id=1, tenant_name='default', time_to_block=None, title='5cf89605-2e7d-4ecc-9c44-5e6f5ecb0cad', url='https://127.0.0.1:40443/api/quotas/19/', used_capacity=0, used_capacity_tb=0.0, used_effective_capacity=0, used_effective_capacity_tb=0.0, used_inodes=0, used_limited_capacity=0, user_quotas=[]) May 28 12:57:45 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e475b181-000c-48f1-bae2-1c0506418668 tempest-SharesMetadataTest-1561320255 None] --- [POST] https://127.0.0.1:40443/api/quotas/: Done May 28 12:57:45 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e475b181-000c-48f1-bae2-1c0506418668 tempest-SharesMetadataTest-1561320255 None] >>> [GET] https://127.0.0.1:40443/api/views/ May 28 12:57:45 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e475b181-000c-48f1-bae2-1c0506418668 tempest-SharesMetadataTest-1561320255 None] {'allow_redirects': True, May 28 12:57:45 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e475b181-000c-48f1-bae2-1c0506418668 tempest-SharesMetadataTest-1561320255 None] 'params': {'name': '5cf89605-2e7d-4ecc-9c44-5e6f5ecb0cad'}} May 28 12:57:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f549ef-abe8-48ad-b3cd-8d487f0f94b4 tempest-SnapshotInstancesNegativeNoResourceTest-5019251 tempest-SnapshotInstancesNegativeNoResourceTest-5019251-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f549ef-abe8-48ad-b3cd-8d487f0f94b4 tempest-SnapshotInstancesNegativeNoResourceTest-5019251 tempest-SnapshotInstancesNegativeNoResourceTest-5019251-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105e356f-afc9-41ce-aa91-ab095c12eb31 tempest-SnapshotInstancesNegativeNoResourceTest-5019251 tempest-SnapshotInstancesNegativeNoResourceTest-5019251-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f11da789b819461c9bddb10be1712ee9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bd48af9e1aa4ddf993b915112d9430d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105e356f-afc9-41ce-aa91-ab095c12eb31 tempest-SnapshotInstancesNegativeNoResourceTest-5019251 tempest-SnapshotInstancesNegativeNoResourceTest-5019251-project-admin] REQUEST_METHOD: `PUT` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105e356f-afc9-41ce-aa91-ab095c12eb31 tempest-SnapshotInstancesNegativeNoResourceTest-5019251 tempest-SnapshotInstancesNegativeNoResourceTest-5019251-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105e356f-afc9-41ce-aa91-ab095c12eb31 tempest-SnapshotInstancesNegativeNoResourceTest-5019251 tempest-SnapshotInstancesNegativeNoResourceTest-5019251-project-admin] PATH_INFO: `/v3/projects/6bd48af9e1aa4ddf993b915112d9430d/users/c2ac6ca3ea5a4ae498df6d12bb7caadc/roles/44620cad10ae407c90c91e2c296adb04` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105e356f-afc9-41ce-aa91-ab095c12eb31 tempest-SnapshotInstancesNegativeNoResourceTest-5019251 tempest-SnapshotInstancesNegativeNoResourceTest-5019251-project-admin] RBAC: Authorizing `identity:create_grant(project_id=6bd48af9e1aa4ddf993b915112d9430d, user_id=c2ac6ca3ea5a4ae498df6d12bb7caadc, role_id=44620cad10ae407c90c91e2c296adb04)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105e356f-afc9-41ce-aa91-ab095c12eb31 tempest-SnapshotInstancesNegativeNoResourceTest-5019251 tempest-SnapshotInstancesNegativeNoResourceTest-5019251-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:45 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-9b2a0955-73fa-4cdd-9d93-42a7023f7cc8 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.058s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:57:45 l75lg1-v1 manila-share[98474]: DEBUG manila.share.access [None req-9b2a0955-73fa-4cdd-9d93-42a7023f7cc8 tempest-ShareIpRulesForNFSTest-1748669711 None] Updating access rules for share instance b7a7d61c-2cea-442a-9809-507038e080d5 belonging to share 1ddadc17-cf10-4a42-8bbd-8335fb3520a1. {{(pid=98474) update_access_rules /opt/stack/manila/manila/share/access.py:298}} May 28 12:57:45 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1042/2059] 10.27.203.238 () {64 vars in 1571 bytes} [Tue May 28 12:57:45 2024] PUT /identity/v3/projects/6bd48af9e1aa4ddf993b915112d9430d/users/c2ac6ca3ea5a4ae498df6d12bb7caadc/roles/44620cad10ae407c90c91e2c296adb04 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:57:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85180972-e2e7-4c1f-a4b3-b16fd1c36b2b tempest-SnapshotInstancesNegativeNoResourceTest-5019251 tempest-SnapshotInstancesNegativeNoResourceTest-5019251-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-85180972-e2e7-4c1f-a4b3-b16fd1c36b2b tempest-SnapshotInstancesNegativeNoResourceTest-5019251 tempest-SnapshotInstancesNegativeNoResourceTest-5019251-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:45 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-9b2a0955-73fa-4cdd-9d93-42a7023f7cc8 tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:57:45 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-9b2a0955-73fa-4cdd-9d93-42a7023f7cc8 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:57:45 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-9b2a0955-73fa-4cdd-9d93-42a7023f7cc8 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.009s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:57:45 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-9b2a0955-73fa-4cdd-9d93-42a7023f7cc8 tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:57:45 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-9b2a0955-73fa-4cdd-9d93-42a7023f7cc8 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:57:45 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-9b2a0955-73fa-4cdd-9d93-42a7023f7cc8 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.016s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:57:45 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-9b2a0955-73fa-4cdd-9d93-42a7023f7cc8 tempest-ShareIpRulesForNFSTest-1748669711 None] changing access on None May 28 12:57:45 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9b2a0955-73fa-4cdd-9d93-42a7023f7cc8 tempest-ShareIpRulesForNFSTest-1748669711 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:57:45 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9b2a0955-73fa-4cdd-9d93-42a7023f7cc8 tempest-ShareIpRulesForNFSTest-1748669711 None] {'allow_redirects': True, May 28 12:57:45 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9b2a0955-73fa-4cdd-9d93-42a7023f7cc8 tempest-ShareIpRulesForNFSTest-1748669711 None] 'params': {'name': 'b7a7d61c-2cea-442a-9809-507038e080d5'}} May 28 12:57:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85180972-e2e7-4c1f-a4b3-b16fd1c36b2b tempest-SnapshotInstancesNegativeNoResourceTest-5019251 tempest-SnapshotInstancesNegativeNoResourceTest-5019251-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3b9884-6fa4-4299-9d5a-38b249a200b6 service manila] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f110cf6300f049c897d0aab63218d1e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3b9884-6fa4-4299-9d5a-38b249a200b6 service manila] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3b9884-6fa4-4299-9d5a-38b249a200b6 service manila] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3b9884-6fa4-4299-9d5a-38b249a200b6 service manila] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3b9884-6fa4-4299-9d5a-38b249a200b6 service manila] RBAC: Authorizing `identity:validate_token()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3b9884-6fa4-4299-9d5a-38b249a200b6 service manila] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1018/2060] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 12:57:45 2024] GET /identity/v3/auth/tokens => generated 4105 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 12:57:46 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-69a93940-cb73-41b2-bcd8-04c60353be1b tempest-SnapshotInstancesNegativeNoResourceTest-5019251 tempest-SnapshotInstancesNegativeNoResourceTest-5019251-project-admin] GET http://10.27.203.238/share/v2/6bd48af9e1aa4ddf993b915112d9430d/snapshot-instances/nonexistent_instance May 28 12:57:46 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-69a93940-cb73-41b2-bcd8-04c60353be1b tempest-SnapshotInstancesNegativeNoResourceTest-5019251 tempest-SnapshotInstancesNegativeNoResourceTest-5019251-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:46 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-69a93940-cb73-41b2-bcd8-04c60353be1b tempest-SnapshotInstancesNegativeNoResourceTest-5019251 tempest-SnapshotInstancesNegativeNoResourceTest-5019251-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:46 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-69a93940-cb73-41b2-bcd8-04c60353be1b tempest-SnapshotInstancesNegativeNoResourceTest-5019251 tempest-SnapshotInstancesNegativeNoResourceTest-5019251-project-admin] HTTP exception thrown: Snapshot instance nonexistent_instance not found. May 28 12:57:46 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-69a93940-cb73-41b2-bcd8-04c60353be1b tempest-SnapshotInstancesNegativeNoResourceTest-5019251 tempest-SnapshotInstancesNegativeNoResourceTest-5019251-project-admin] http://10.27.203.238/share/v2/6bd48af9e1aa4ddf993b915112d9430d/snapshot-instances/nonexistent_instance returned with HTTP 404 May 28 12:57:46 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 397/783] 10.27.203.238 () {64 vars in 1439 bytes} [Tue May 28 12:57:45 2024] GET /share/v2/6bd48af9e1aa4ddf993b915112d9430d/snapshot-instances/nonexistent_instance => generated 95 bytes in 149 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105e356f-afc9-41ce-aa91-ab095c12eb31 tempest-SnapshotInstancesNegativeNoResourceTest-5019251 tempest-SnapshotInstancesNegativeNoResourceTest-5019251-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-105e356f-afc9-41ce-aa91-ab095c12eb31 tempest-SnapshotInstancesNegativeNoResourceTest-5019251 tempest-SnapshotInstancesNegativeNoResourceTest-5019251-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105e356f-afc9-41ce-aa91-ab095c12eb31 tempest-SnapshotInstancesNegativeNoResourceTest-5019251 tempest-SnapshotInstancesNegativeNoResourceTest-5019251-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71efa9d3-e4f6-4ff3-9fb8-18274ea77d97 service manila] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f110cf6300f049c897d0aab63218d1e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71efa9d3-e4f6-4ff3-9fb8-18274ea77d97 service manila] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71efa9d3-e4f6-4ff3-9fb8-18274ea77d97 service manila] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71efa9d3-e4f6-4ff3-9fb8-18274ea77d97 service manila] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71efa9d3-e4f6-4ff3-9fb8-18274ea77d97 service manila] RBAC: Authorizing `identity:validate_token()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71efa9d3-e4f6-4ff3-9fb8-18274ea77d97 service manila] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1043/2061] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 12:57:46 2024] GET /identity/v3/auth/tokens => generated 3988 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 12:57:46 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-4ded7e8e-e6ab-42d5-b858-f83883458258 tempest-SnapshotInstancesNegativeNoResourceTest-2009069633 tempest-SnapshotInstancesNegativeNoResourceTest-2009069633-project-member] GET http://10.27.203.238/share/v2/f84351e3119949b78e742aaf4bf970bf/snapshot-instances May 28 12:57:46 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-4ded7e8e-e6ab-42d5-b858-f83883458258 tempest-SnapshotInstancesNegativeNoResourceTest-2009069633 tempest-SnapshotInstancesNegativeNoResourceTest-2009069633-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:46 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-4ded7e8e-e6ab-42d5-b858-f83883458258 tempest-SnapshotInstancesNegativeNoResourceTest-2009069633 tempest-SnapshotInstancesNegativeNoResourceTest-2009069633-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:46 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.policy [None req-4ded7e8e-e6ab-42d5-b858-f83883458258 tempest-SnapshotInstancesNegativeNoResourceTest-2009069633 tempest-SnapshotInstancesNegativeNoResourceTest-2009069633-project-member] Policy check for share_snapshot_instance:index failed with credentials {'is_admin': False, 'user_id': '3a064c27328349069060d9e9ebb49aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84351e3119949b78e742aaf4bf970bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98330) authorize /opt/stack/manila/manila/policy.py:208}} May 28 12:57:46 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-4ded7e8e-e6ab-42d5-b858-f83883458258 tempest-SnapshotInstancesNegativeNoResourceTest-2009069633 tempest-SnapshotInstancesNegativeNoResourceTest-2009069633-project-member] HTTP exception thrown: Access was denied to this resource. May 28 12:57:46 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-4ded7e8e-e6ab-42d5-b858-f83883458258 tempest-SnapshotInstancesNegativeNoResourceTest-2009069633 tempest-SnapshotInstancesNegativeNoResourceTest-2009069633-project-member] http://10.27.203.238/share/v2/f84351e3119949b78e742aaf4bf970bf/snapshot-instances returned with HTTP 403 May 28 12:57:46 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 387/784] 10.27.203.238 () {64 vars in 1376 bytes} [Tue May 28 12:57:46 2024] GET /share/v2/f84351e3119949b78e742aaf4bf970bf/snapshot-instances => generated 78 bytes in 71 msecs (HTTP/1.1 403) 6 headers in 237 bytes (1 switches on core 0) May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3b9884-6fa4-4299-9d5a-38b249a200b6 service manila] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3b9884-6fa4-4299-9d5a-38b249a200b6 service manila] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3902367f-e389-4cc7-bb3a-7086075a559e tempest-SnapshotInstancesNegativeNoResourceTest-5019251 tempest-SnapshotInstancesNegativeNoResourceTest-5019251-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f11da789b819461c9bddb10be1712ee9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bd48af9e1aa4ddf993b915112d9430d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3902367f-e389-4cc7-bb3a-7086075a559e tempest-SnapshotInstancesNegativeNoResourceTest-5019251 tempest-SnapshotInstancesNegativeNoResourceTest-5019251-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3902367f-e389-4cc7-bb3a-7086075a559e tempest-SnapshotInstancesNegativeNoResourceTest-5019251 tempest-SnapshotInstancesNegativeNoResourceTest-5019251-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3902367f-e389-4cc7-bb3a-7086075a559e tempest-SnapshotInstancesNegativeNoResourceTest-5019251 tempest-SnapshotInstancesNegativeNoResourceTest-5019251-project-admin] PATH_INFO: `/v3/users/8688f80695814f34bfb56342c4e54028` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3902367f-e389-4cc7-bb3a-7086075a559e tempest-SnapshotInstancesNegativeNoResourceTest-5019251 tempest-SnapshotInstancesNegativeNoResourceTest-5019251-project-admin] RBAC: Authorizing `identity:delete_user(user_id=8688f80695814f34bfb56342c4e54028)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3902367f-e389-4cc7-bb3a-7086075a559e tempest-SnapshotInstancesNegativeNoResourceTest-5019251 tempest-SnapshotInstancesNegativeNoResourceTest-5019251-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-3902367f-e389-4cc7-bb3a-7086075a559e tempest-SnapshotInstancesNegativeNoResourceTest-5019251 tempest-SnapshotInstancesNegativeNoResourceTest-5019251-project-admin] Could not find user: 8688f80695814f34bfb56342c4e54028.: keystone.exception.UserNotFound: Could not find user: 8688f80695814f34bfb56342c4e54028. May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 8688f80695814f34bfb56342c4e54028. May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1019/2062] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 12:57:46 2024] DELETE /identity/v3/users/8688f80695814f34bfb56342c4e54028 => generated 110 bytes in 27 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71efa9d3-e4f6-4ff3-9fb8-18274ea77d97 service manila] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71efa9d3-e4f6-4ff3-9fb8-18274ea77d97 service manila] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6ec992-3059-48ca-9c8e-4454ece94a87 tempest-SnapshotInstancesNegativeNoResourceTest-5019251 tempest-SnapshotInstancesNegativeNoResourceTest-5019251-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f11da789b819461c9bddb10be1712ee9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bd48af9e1aa4ddf993b915112d9430d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6ec992-3059-48ca-9c8e-4454ece94a87 tempest-SnapshotInstancesNegativeNoResourceTest-5019251 tempest-SnapshotInstancesNegativeNoResourceTest-5019251-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6ec992-3059-48ca-9c8e-4454ece94a87 tempest-SnapshotInstancesNegativeNoResourceTest-5019251 tempest-SnapshotInstancesNegativeNoResourceTest-5019251-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6ec992-3059-48ca-9c8e-4454ece94a87 tempest-SnapshotInstancesNegativeNoResourceTest-5019251 tempest-SnapshotInstancesNegativeNoResourceTest-5019251-project-admin] PATH_INFO: `/v3/users/108a25e436e9452a9a865957dcea1fc5` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6ec992-3059-48ca-9c8e-4454ece94a87 tempest-SnapshotInstancesNegativeNoResourceTest-5019251 tempest-SnapshotInstancesNegativeNoResourceTest-5019251-project-admin] RBAC: Authorizing `identity:delete_user(user_id=108a25e436e9452a9a865957dcea1fc5)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6ec992-3059-48ca-9c8e-4454ece94a87 tempest-SnapshotInstancesNegativeNoResourceTest-5019251 tempest-SnapshotInstancesNegativeNoResourceTest-5019251-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-2f6ec992-3059-48ca-9c8e-4454ece94a87 tempest-SnapshotInstancesNegativeNoResourceTest-5019251 tempest-SnapshotInstancesNegativeNoResourceTest-5019251-project-admin] Could not find user: 108a25e436e9452a9a865957dcea1fc5.: keystone.exception.UserNotFound: Could not find user: 108a25e436e9452a9a865957dcea1fc5. May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 108a25e436e9452a9a865957dcea1fc5. May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1044/2063] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 12:57:46 2024] DELETE /identity/v3/users/108a25e436e9452a9a865957dcea1fc5 => generated 110 bytes in 31 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3902367f-e389-4cc7-bb3a-7086075a559e tempest-SnapshotInstancesNegativeNoResourceTest-5019251 tempest-SnapshotInstancesNegativeNoResourceTest-5019251-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3902367f-e389-4cc7-bb3a-7086075a559e tempest-SnapshotInstancesNegativeNoResourceTest-5019251 tempest-SnapshotInstancesNegativeNoResourceTest-5019251-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c605c77b-7040-4e0e-aaaf-d35074bc15c9 tempest-SnapshotInstancesNegativeNoResourceTest-5019251 tempest-SnapshotInstancesNegativeNoResourceTest-5019251-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f11da789b819461c9bddb10be1712ee9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bd48af9e1aa4ddf993b915112d9430d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c605c77b-7040-4e0e-aaaf-d35074bc15c9 tempest-SnapshotInstancesNegativeNoResourceTest-5019251 tempest-SnapshotInstancesNegativeNoResourceTest-5019251-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c605c77b-7040-4e0e-aaaf-d35074bc15c9 tempest-SnapshotInstancesNegativeNoResourceTest-5019251 tempest-SnapshotInstancesNegativeNoResourceTest-5019251-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c605c77b-7040-4e0e-aaaf-d35074bc15c9 tempest-SnapshotInstancesNegativeNoResourceTest-5019251 tempest-SnapshotInstancesNegativeNoResourceTest-5019251-project-admin] PATH_INFO: `/v3/users/5ae5cb1db3504baaba1df93dc154a004` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c605c77b-7040-4e0e-aaaf-d35074bc15c9 tempest-SnapshotInstancesNegativeNoResourceTest-5019251 tempest-SnapshotInstancesNegativeNoResourceTest-5019251-project-admin] RBAC: Authorizing `identity:delete_user(user_id=5ae5cb1db3504baaba1df93dc154a004)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c605c77b-7040-4e0e-aaaf-d35074bc15c9 tempest-SnapshotInstancesNegativeNoResourceTest-5019251 tempest-SnapshotInstancesNegativeNoResourceTest-5019251-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-c605c77b-7040-4e0e-aaaf-d35074bc15c9 tempest-SnapshotInstancesNegativeNoResourceTest-5019251 tempest-SnapshotInstancesNegativeNoResourceTest-5019251-project-admin] Could not find user: 5ae5cb1db3504baaba1df93dc154a004.: keystone.exception.UserNotFound: Could not find user: 5ae5cb1db3504baaba1df93dc154a004. May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 5ae5cb1db3504baaba1df93dc154a004. May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1020/2064] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 12:57:46 2024] DELETE /identity/v3/users/5ae5cb1db3504baaba1df93dc154a004 => generated 110 bytes in 28 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6ec992-3059-48ca-9c8e-4454ece94a87 tempest-SnapshotInstancesNegativeNoResourceTest-5019251 tempest-SnapshotInstancesNegativeNoResourceTest-5019251-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6ec992-3059-48ca-9c8e-4454ece94a87 tempest-SnapshotInstancesNegativeNoResourceTest-5019251 tempest-SnapshotInstancesNegativeNoResourceTest-5019251-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:46 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f6784d36-6966-4d0d-8f96-f818219fe4a4 tempest-AdminActionsTest-1749172189 None] <<< [DELETE] https://127.0.0.1:40443/api/viewpolicies/20/ May 28 12:57:46 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f6784d36-6966-4d0d-8f96-f818219fe4a4 tempest-AdminActionsTest-1749172189 None] --- [DELETE] https://127.0.0.1:40443/api/viewpolicies/20/: Done May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0336dc95-add9-4d2b-a633-c53ed0dcaae7 tempest-SnapshotInstancesNegativeNoResourceTest-5019251 tempest-SnapshotInstancesNegativeNoResourceTest-5019251-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f11da789b819461c9bddb10be1712ee9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bd48af9e1aa4ddf993b915112d9430d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0336dc95-add9-4d2b-a633-c53ed0dcaae7 tempest-SnapshotInstancesNegativeNoResourceTest-5019251 tempest-SnapshotInstancesNegativeNoResourceTest-5019251-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0336dc95-add9-4d2b-a633-c53ed0dcaae7 tempest-SnapshotInstancesNegativeNoResourceTest-5019251 tempest-SnapshotInstancesNegativeNoResourceTest-5019251-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0336dc95-add9-4d2b-a633-c53ed0dcaae7 tempest-SnapshotInstancesNegativeNoResourceTest-5019251 tempest-SnapshotInstancesNegativeNoResourceTest-5019251-project-admin] PATH_INFO: `/v3/users/c2ac6ca3ea5a4ae498df6d12bb7caadc` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0336dc95-add9-4d2b-a633-c53ed0dcaae7 tempest-SnapshotInstancesNegativeNoResourceTest-5019251 tempest-SnapshotInstancesNegativeNoResourceTest-5019251-project-admin] RBAC: Authorizing `identity:delete_user(user_id=c2ac6ca3ea5a4ae498df6d12bb7caadc)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0336dc95-add9-4d2b-a633-c53ed0dcaae7 tempest-SnapshotInstancesNegativeNoResourceTest-5019251 tempest-SnapshotInstancesNegativeNoResourceTest-5019251-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:46 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e475b181-000c-48f1-bae2-1c0506418668 tempest-SharesMetadataTest-1561320255 None] <<< [GET] https://127.0.0.1:40443/api/views/ May 28 12:57:46 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e475b181-000c-48f1-bae2-1c0506418668 tempest-SharesMetadataTest-1561320255 None] [] May 28 12:57:46 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e475b181-000c-48f1-bae2-1c0506418668 tempest-SharesMetadataTest-1561320255 None] --- [GET] https://127.0.0.1:40443/api/views/: Done May 28 12:57:46 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e475b181-000c-48f1-bae2-1c0506418668 tempest-SharesMetadataTest-1561320255 None] >>> [POST] https://127.0.0.1:40443/api/views/ May 28 12:57:46 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e475b181-000c-48f1-bae2-1c0506418668 tempest-SharesMetadataTest-1561320255 None] {'data': '{"name": "5cf89605-2e7d-4ecc-9c44-5e6f5ecb0cad", "path": ' May 28 12:57:46 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e475b181-000c-48f1-bae2-1c0506418668 tempest-SharesMetadataTest-1561320255 None] '"/manila/manila-5cf89605-2e7d-4ecc-9c44-5e6f5ecb0cad", "policy_id": ' May 28 12:57:46 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e475b181-000c-48f1-bae2-1c0506418668 tempest-SharesMetadataTest-1561320255 None] '22, "create_dir": true, "protocols": ["NFS"]}', May 28 12:57:46 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e475b181-000c-48f1-bae2-1c0506418668 tempest-SharesMetadataTest-1561320255 None] 'json': None, May 28 12:57:46 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e475b181-000c-48f1-bae2-1c0506418668 tempest-SharesMetadataTest-1561320255 None] 'params': None} May 28 12:57:46 l75lg1-v1 dstat.sh[49771]: 28-05 12:57:46| 15 2 82 2 0|5699M 1792M 277M 7857M| 24k 6378B| 0 1565k| 0 195 |8254 14k|1.66 1.09 1.02|2.0 0 0| 0 0 | 0 2048M| 29 356 0 69 0 May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-0336dc95-add9-4d2b-a633-c53ed0dcaae7 tempest-SnapshotInstancesNegativeNoResourceTest-5019251 tempest-SnapshotInstancesNegativeNoResourceTest-5019251-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2ac6ca3ea5a4ae498df6d12bb7caadc', 'request_id': 'req-0336dc95-add9-4d2b-a633-c53ed0dcaae7'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-0336dc95-add9-4d2b-a633-c53ed0dcaae7 tempest-SnapshotInstancesNegativeNoResourceTest-5019251 tempest-SnapshotInstancesNegativeNoResourceTest-5019251-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2ac6ca3ea5a4ae498df6d12bb7caadc', 'request_id': 'req-0336dc95-add9-4d2b-a633-c53ed0dcaae7'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-0336dc95-add9-4d2b-a633-c53ed0dcaae7 tempest-SnapshotInstancesNegativeNoResourceTest-5019251 tempest-SnapshotInstancesNegativeNoResourceTest-5019251-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2ac6ca3ea5a4ae498df6d12bb7caadc', 'request_id': 'req-0336dc95-add9-4d2b-a633-c53ed0dcaae7'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-0336dc95-add9-4d2b-a633-c53ed0dcaae7 tempest-SnapshotInstancesNegativeNoResourceTest-5019251 tempest-SnapshotInstancesNegativeNoResourceTest-5019251-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2ac6ca3ea5a4ae498df6d12bb7caadc', 'request_id': 'req-0336dc95-add9-4d2b-a633-c53ed0dcaae7'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-0336dc95-add9-4d2b-a633-c53ed0dcaae7 tempest-SnapshotInstancesNegativeNoResourceTest-5019251 tempest-SnapshotInstancesNegativeNoResourceTest-5019251-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2ac6ca3ea5a4ae498df6d12bb7caadc', 'request_id': 'req-0336dc95-add9-4d2b-a633-c53ed0dcaae7'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1045/2065] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 12:57:46 2024] DELETE /identity/v3/users/c2ac6ca3ea5a4ae498df6d12bb7caadc => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c605c77b-7040-4e0e-aaaf-d35074bc15c9 tempest-SnapshotInstancesNegativeNoResourceTest-5019251 tempest-SnapshotInstancesNegativeNoResourceTest-5019251-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-c605c77b-7040-4e0e-aaaf-d35074bc15c9 tempest-SnapshotInstancesNegativeNoResourceTest-5019251 tempest-SnapshotInstancesNegativeNoResourceTest-5019251-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:46 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-f6784d36-6966-4d0d-8f96-f818219fe4a4 tempest-AdminActionsTest-1749172189 None] Created reservations ['fd962ec5-86d3-4f2c-bd53-398064772b1c', 'c1e64207-08ef-4d8c-bf86-62078694fe33', 'a4753ce1-b401-412c-8b1b-9e07cd29cced', '33a38e26-8b1a-44a5-a8cb-75a61daf0df8'] {{(pid=98474) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 12:57:46 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-df370c0e-7336-4b1d-aa8e-78d594fb501a tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] GET http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/share_instances/724bc53b-1c28-4ab1-b3c8-ab90f868473d May 28 12:57:46 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-df370c0e-7336-4b1d-aa8e-78d594fb501a tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:46 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-df370c0e-7336-4b1d-aa8e-78d594fb501a tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:46 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-f6784d36-6966-4d0d-8f96-f818219fe4a4 tempest-AdminActionsTest-1749172189 None] Committed reservations ['fd962ec5-86d3-4f2c-bd53-398064772b1c', 'c1e64207-08ef-4d8c-bf86-62078694fe33', 'a4753ce1-b401-412c-8b1b-9e07cd29cced', '33a38e26-8b1a-44a5-a8cb-75a61daf0df8'] {{(pid=98474) commit /opt/stack/manila/manila/quota.py:1063}} May 28 12:57:46 l75lg1-v1 manila-share[98474]: INFO manila.share.manager [None req-f6784d36-6966-4d0d-8f96-f818219fe4a4 tempest-AdminActionsTest-1749172189 None] Share instance 724bc53b-1c28-4ab1-b3c8-ab90f868473d: deleted successfully. May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c605c77b-7040-4e0e-aaaf-d35074bc15c9 tempest-SnapshotInstancesNegativeNoResourceTest-5019251 tempest-SnapshotInstancesNegativeNoResourceTest-5019251-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:46 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-df370c0e-7336-4b1d-aa8e-78d594fb501a tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/share_instances/724bc53b-1c28-4ab1-b3c8-ab90f868473d returned with HTTP 200 May 28 12:57:46 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 398/785] 10.27.203.238 () {64 vars in 1478 bytes} [Tue May 28 12:57:46 2024] GET /share/v2/a3499cb78849424db45e54caac01de92/share_instances/724bc53b-1c28-4ab1-b3c8-ab90f868473d => generated 505 bytes in 30 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873902e9-3a2f-4465-85df-9f7961641346 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873902e9-3a2f-4465-85df-9f7961641346 None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873902e9-3a2f-4465-85df-9f7961641346 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873902e9-3a2f-4465-85df-9f7961641346 None admin] PATH_INFO: `/v3/users/3a064c27328349069060d9e9ebb49aed` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873902e9-3a2f-4465-85df-9f7961641346 None admin] RBAC: Authorizing `identity:delete_user(user_id=3a064c27328349069060d9e9ebb49aed)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873902e9-3a2f-4465-85df-9f7961641346 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:46 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-cb229325-1f1a-4128-bd7b-89c4063b7fd9 tempest-SharesMetadataNegativeTest-1584039052 tempest-SharesMetadataNegativeTest-1584039052-project-member] GET http://10.27.203.238/share/v2/5e5bc0c8fb8b46d598b0621999301112/shares/12970599-4f96-41ce-abd8-18371bc51a8c May 28 12:57:46 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-cb229325-1f1a-4128-bd7b-89c4063b7fd9 tempest-SharesMetadataNegativeTest-1584039052 tempest-SharesMetadataNegativeTest-1584039052-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:46 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-cb229325-1f1a-4128-bd7b-89c4063b7fd9 tempest-SharesMetadataNegativeTest-1584039052 tempest-SharesMetadataNegativeTest-1584039052-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:46 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-cb229325-1f1a-4128-bd7b-89c4063b7fd9 tempest-SharesMetadataNegativeTest-1584039052 tempest-SharesMetadataNegativeTest-1584039052-project-member] http://10.27.203.238/share/v2/5e5bc0c8fb8b46d598b0621999301112/shares/12970599-4f96-41ce-abd8-18371bc51a8c returned with HTTP 200 May 28 12:57:46 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 388/786] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:57:46 2024] GET /share/v2/5e5bc0c8fb8b46d598b0621999301112/shares/12970599-4f96-41ce-abd8-18371bc51a8c => generated 1314 bytes in 29 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-873902e9-3a2f-4465-85df-9f7961641346 None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a064c27328349069060d9e9ebb49aed', 'request_id': 'req-873902e9-3a2f-4465-85df-9f7961641346'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-873902e9-3a2f-4465-85df-9f7961641346 None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a064c27328349069060d9e9ebb49aed', 'request_id': 'req-873902e9-3a2f-4465-85df-9f7961641346'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-873902e9-3a2f-4465-85df-9f7961641346 None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a064c27328349069060d9e9ebb49aed', 'request_id': 'req-873902e9-3a2f-4465-85df-9f7961641346'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-873902e9-3a2f-4465-85df-9f7961641346 None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a064c27328349069060d9e9ebb49aed', 'request_id': 'req-873902e9-3a2f-4465-85df-9f7961641346'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-873902e9-3a2f-4465-85df-9f7961641346 None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a064c27328349069060d9e9ebb49aed', 'request_id': 'req-873902e9-3a2f-4465-85df-9f7961641346'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1021/2066] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 12:57:46 2024] DELETE /identity/v3/users/3a064c27328349069060d9e9ebb49aed => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0336dc95-add9-4d2b-a633-c53ed0dcaae7 tempest-SnapshotInstancesNegativeNoResourceTest-5019251 tempest-SnapshotInstancesNegativeNoResourceTest-5019251-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0336dc95-add9-4d2b-a633-c53ed0dcaae7 tempest-SnapshotInstancesNegativeNoResourceTest-5019251 tempest-SnapshotInstancesNegativeNoResourceTest-5019251-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:46 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9b2a0955-73fa-4cdd-9d93-42a7023f7cc8 tempest-ShareIpRulesForNFSTest-1748669711 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:57:46 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9b2a0955-73fa-4cdd-9d93-42a7023f7cc8 tempest-ShareIpRulesForNFSTest-1748669711 None] [Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=1, created='2024-05-28T12:57:40.763635Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='377955ad-d094-4e49-ab32-1021d943a572', id=21, internal=False, is_s3_default_policy=False, name='b7a7d61c-2cea-442a-9809-507038e080d5', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=[], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['*'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['*'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T12:57:41.242917Z', tenant_id=1, tenant_name='default', title='b7a7d61c-2cea-442a-9809-507038e080d5', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/21/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[])] May 28 12:57:46 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9b2a0955-73fa-4cdd-9d93-42a7023f7cc8 tempest-ShareIpRulesForNFSTest-1748669711 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b31a91-31d1-4f5e-af66-79ae9831a420 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b31a91-31d1-4f5e-af66-79ae9831a420 None admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b31a91-31d1-4f5e-af66-79ae9831a420 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b31a91-31d1-4f5e-af66-79ae9831a420 None admin] PATH_INFO: `/v3/users/05edbb51061048028aa360253ec8d71f` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b31a91-31d1-4f5e-af66-79ae9831a420 None admin] RBAC: Authorizing `identity:delete_user(user_id=05edbb51061048028aa360253ec8d71f)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b31a91-31d1-4f5e-af66-79ae9831a420 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:46 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1d58e35e-74eb-471d-bbdb-c75219ac6e07 tempest-SharesMetadataNegativeTest-1584039052 None] <<< [POST] https://127.0.0.1:40443/api/quotas/ May 28 12:57:46 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1d58e35e-74eb-471d-bbdb-c75219ac6e07 tempest-SharesMetadataNegativeTest-1584039052 None] Bunch(cluster='loop75-kfs', cluster_id=1, default_email=None, default_group_quota=None, default_user_quota=None, enable_alarms=True, enable_email_providers=True, grace_period=None, group_quotas=[], guid='a603f8b2-fa6c-4c31-9c02-5490ba93b8a3', hard_limit=1073741824, hard_limit_inodes=None, id=20, internal=False, is_user_quota=False, last_user_quotas_update=None, name='9e93e444-3013-4370-9caa-9f912c5201e6', num_blocked_users=0, num_exceeded_users=0, path='/manila/manila-9e93e444-3013-4370-9caa-9f912c5201e6', percent_capacity=0, percent_inodes=None, pretty_grace_period=None, pretty_grace_period_expiration=None, pretty_state='OK (CREATED)', soft_limit=None, soft_limit_inodes=None, state='OK', sync_state='CREATED', system_id=20, tenant_id=1, tenant_name='default', time_to_block=None, title='9e93e444-3013-4370-9caa-9f912c5201e6', url='https://127.0.0.1:40443/api/quotas/20/', used_capacity=0, used_capacity_tb=0.0, used_effective_capacity=0, used_effective_capacity_tb=0.0, used_inodes=0, used_limited_capacity=0, user_quotas=[]) May 28 12:57:46 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1d58e35e-74eb-471d-bbdb-c75219ac6e07 tempest-SharesMetadataNegativeTest-1584039052 None] --- [POST] https://127.0.0.1:40443/api/quotas/: Done May 28 12:57:46 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1d58e35e-74eb-471d-bbdb-c75219ac6e07 tempest-SharesMetadataNegativeTest-1584039052 None] >>> [GET] https://127.0.0.1:40443/api/views/ May 28 12:57:46 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1d58e35e-74eb-471d-bbdb-c75219ac6e07 tempest-SharesMetadataNegativeTest-1584039052 None] {'allow_redirects': True, May 28 12:57:46 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1d58e35e-74eb-471d-bbdb-c75219ac6e07 tempest-SharesMetadataNegativeTest-1584039052 None] 'params': {'name': '9e93e444-3013-4370-9caa-9f912c5201e6'}} May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-a0b31a91-31d1-4f5e-af66-79ae9831a420 None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05edbb51061048028aa360253ec8d71f', 'request_id': 'req-a0b31a91-31d1-4f5e-af66-79ae9831a420'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-a0b31a91-31d1-4f5e-af66-79ae9831a420 None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05edbb51061048028aa360253ec8d71f', 'request_id': 'req-a0b31a91-31d1-4f5e-af66-79ae9831a420'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-a0b31a91-31d1-4f5e-af66-79ae9831a420 None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05edbb51061048028aa360253ec8d71f', 'request_id': 'req-a0b31a91-31d1-4f5e-af66-79ae9831a420'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-a0b31a91-31d1-4f5e-af66-79ae9831a420 None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05edbb51061048028aa360253ec8d71f', 'request_id': 'req-a0b31a91-31d1-4f5e-af66-79ae9831a420'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-a0b31a91-31d1-4f5e-af66-79ae9831a420 None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05edbb51061048028aa360253ec8d71f', 'request_id': 'req-a0b31a91-31d1-4f5e-af66-79ae9831a420'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1046/2067] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 12:57:46 2024] DELETE /identity/v3/users/05edbb51061048028aa360253ec8d71f => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:57:46 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873902e9-3a2f-4465-85df-9f7961641346 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-873902e9-3a2f-4465-85df-9f7961641346 None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873902e9-3a2f-4465-85df-9f7961641346 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e14f5ab-f5a6-4341-80bf-87bc2959b463 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e14f5ab-f5a6-4341-80bf-87bc2959b463 None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e14f5ab-f5a6-4341-80bf-87bc2959b463 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e14f5ab-f5a6-4341-80bf-87bc2959b463 None admin] PATH_INFO: `/v3/users/f11da789b819461c9bddb10be1712ee9` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e14f5ab-f5a6-4341-80bf-87bc2959b463 None admin] RBAC: Authorizing `identity:delete_user(user_id=f11da789b819461c9bddb10be1712ee9)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e14f5ab-f5a6-4341-80bf-87bc2959b463 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:46 l75lg1-v1 manila-share[98474]: ERROR manila.share.drivers.vastdata [None req-9b2a0955-73fa-4cdd-9d93-42a7023f7cc8 tempest-ShareIpRulesForNFSTest-1748669711 None] failed to resolve host '203.0.113.108/30': [Errno -2] Name or service not known (ignoring): socket.gaierror: [Errno -2] Name or service not known May 28 12:57:46 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-9b2a0955-73fa-4cdd-9d93-42a7023f7cc8 tempest-ShareIpRulesForNFSTest-1748669711 None] changing access on /manila/manila-b7a7d61c-2cea-442a-9809-507038e080d5. Rules: {'nfs_read_write': ['*'], 'nfs_read_only': []} May 28 12:57:46 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9b2a0955-73fa-4cdd-9d93-42a7023f7cc8 tempest-ShareIpRulesForNFSTest-1748669711 None] >>> [PATCH] https://127.0.0.1:40443/api/viewpolicies/21/ May 28 12:57:46 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9b2a0955-73fa-4cdd-9d93-42a7023f7cc8 tempest-ShareIpRulesForNFSTest-1748669711 None] {'data': '{"name": "b7a7d61c-2cea-442a-9809-507038e080d5", "nfs_no_squash": ' May 28 12:57:46 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9b2a0955-73fa-4cdd-9d93-42a7023f7cc8 tempest-ShareIpRulesForNFSTest-1748669711 None] '["*"], "nfs_root_squash": ["*"], "nfs_read_write": ["*"], ' May 28 12:57:46 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9b2a0955-73fa-4cdd-9d93-42a7023f7cc8 tempest-ShareIpRulesForNFSTest-1748669711 None] '"nfs_read_only": []}', May 28 12:57:46 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9b2a0955-73fa-4cdd-9d93-42a7023f7cc8 tempest-ShareIpRulesForNFSTest-1748669711 None] 'params': None} May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-6e14f5ab-f5a6-4341-80bf-87bc2959b463 None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f11da789b819461c9bddb10be1712ee9', 'request_id': 'req-6e14f5ab-f5a6-4341-80bf-87bc2959b463'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-6e14f5ab-f5a6-4341-80bf-87bc2959b463 None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f11da789b819461c9bddb10be1712ee9', 'request_id': 'req-6e14f5ab-f5a6-4341-80bf-87bc2959b463'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-6e14f5ab-f5a6-4341-80bf-87bc2959b463 None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f11da789b819461c9bddb10be1712ee9', 'request_id': 'req-6e14f5ab-f5a6-4341-80bf-87bc2959b463'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-6e14f5ab-f5a6-4341-80bf-87bc2959b463 None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f11da789b819461c9bddb10be1712ee9', 'request_id': 'req-6e14f5ab-f5a6-4341-80bf-87bc2959b463'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-6e14f5ab-f5a6-4341-80bf-87bc2959b463 None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f11da789b819461c9bddb10be1712ee9', 'request_id': 'req-6e14f5ab-f5a6-4341-80bf-87bc2959b463'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1022/2068] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 12:57:46 2024] DELETE /identity/v3/users/f11da789b819461c9bddb10be1712ee9 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873f0c20-34b7-424c-9bf3-f9463f91b405 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873f0c20-34b7-424c-9bf3-f9463f91b405 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873f0c20-34b7-424c-9bf3-f9463f91b405 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-873f0c20-34b7-424c-9bf3-f9463f91b405 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-873f0c20-34b7-424c-9bf3-f9463f91b405 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-873f0c20-34b7-424c-9bf3-f9463f91b405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1047/2069] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:57:46 2024] POST /identity/v3/auth/tokens => generated 2960 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 12:57:46 l75lg1-v1 neutron-server[77618]: DEBUG neutron.wsgi [-] (77618) accepted ('10.27.203.238', 41652) {{(pid=77618) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e14f5ab-f5a6-4341-80bf-87bc2959b463 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-6e14f5ab-f5a6-4341-80bf-87bc2959b463 None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e14f5ab-f5a6-4341-80bf-87bc2959b463 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781ff6e1-68c1-4119-9c13-e4f323fc5dd1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef17047035e4b518fd5360a01f2da1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781ff6e1-68c1-4119-9c13-e4f323fc5dd1 service neutron] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781ff6e1-68c1-4119-9c13-e4f323fc5dd1 service neutron] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781ff6e1-68c1-4119-9c13-e4f323fc5dd1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781ff6e1-68c1-4119-9c13-e4f323fc5dd1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781ff6e1-68c1-4119-9c13-e4f323fc5dd1 service neutron] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1023/2070] 10.27.203.238 () {64 vars in 1432 bytes} [Tue May 28 12:57:46 2024] GET /identity/v3/auth/tokens => generated 2960 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 28 12:57:46 l75lg1-v1 neutron-server[77618]: INFO neutron.wsgi [None req-8fa728b8-0428-4f0c-a341-f0605e074f98 None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=f84351e3119949b78e742aaf4bf970bf&name=default HTTP/1.1" status: 200 len: 216 time: 0.0764589 May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873f0c20-34b7-424c-9bf3-f9463f91b405 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-873f0c20-34b7-424c-9bf3-f9463f91b405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873f0c20-34b7-424c-9bf3-f9463f91b405 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba57afd7-3c3d-4e54-ab88-d8c62dc2d8be None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba57afd7-3c3d-4e54-ab88-d8c62dc2d8be None admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba57afd7-3c3d-4e54-ab88-d8c62dc2d8be None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba57afd7-3c3d-4e54-ab88-d8c62dc2d8be None admin] PATH_INFO: `/v3/projects/f84351e3119949b78e742aaf4bf970bf` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba57afd7-3c3d-4e54-ab88-d8c62dc2d8be None admin] RBAC: Authorizing `identity:delete_project(project_id=f84351e3119949b78e742aaf4bf970bf)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba57afd7-3c3d-4e54-ab88-d8c62dc2d8be None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-ba57afd7-3c3d-4e54-ab88-d8c62dc2d8be None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f84351e3119949b78e742aaf4bf970bf', 'request_id': 'req-ba57afd7-3c3d-4e54-ab88-d8c62dc2d8be'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-ba57afd7-3c3d-4e54-ab88-d8c62dc2d8be None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f84351e3119949b78e742aaf4bf970bf', 'request_id': 'req-ba57afd7-3c3d-4e54-ab88-d8c62dc2d8be'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-ba57afd7-3c3d-4e54-ab88-d8c62dc2d8be None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f84351e3119949b78e742aaf4bf970bf', 'request_id': 'req-ba57afd7-3c3d-4e54-ab88-d8c62dc2d8be'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-ba57afd7-3c3d-4e54-ab88-d8c62dc2d8be None admin] The token cache is being invalidate because project f84351e3119949b78e742aaf4bf970bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-ba57afd7-3c3d-4e54-ab88-d8c62dc2d8be None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-ba57afd7-3c3d-4e54-ab88-d8c62dc2d8be None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1048/2071] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 12:57:46 2024] DELETE /identity/v3/projects/f84351e3119949b78e742aaf4bf970bf => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:57:46 l75lg1-v1 neutron-server[77618]: DEBUG neutron.wsgi [-] (77618) accepted ('10.27.203.238', 41668) {{(pid=77618) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 12:57:46 l75lg1-v1 neutron-server[77618]: INFO neutron.wsgi [None req-f5a74bd1-a993-40b4-a8a3-ef9708f518f9 None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=6bd48af9e1aa4ddf993b915112d9430d&name=default HTTP/1.1" status: 200 len: 216 time: 0.0139148 May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781ff6e1-68c1-4119-9c13-e4f323fc5dd1 service neutron] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781ff6e1-68c1-4119-9c13-e4f323fc5dd1 service neutron] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91488e4-3e37-438d-aeb8-ae4153898824 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91488e4-3e37-438d-aeb8-ae4153898824 None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91488e4-3e37-438d-aeb8-ae4153898824 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91488e4-3e37-438d-aeb8-ae4153898824 None admin] PATH_INFO: `/v3/projects/6bd48af9e1aa4ddf993b915112d9430d` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91488e4-3e37-438d-aeb8-ae4153898824 None admin] RBAC: Authorizing `identity:delete_project(project_id=6bd48af9e1aa4ddf993b915112d9430d)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91488e4-3e37-438d-aeb8-ae4153898824 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-c91488e4-3e37-438d-aeb8-ae4153898824 None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6bd48af9e1aa4ddf993b915112d9430d', 'request_id': 'req-c91488e4-3e37-438d-aeb8-ae4153898824'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-c91488e4-3e37-438d-aeb8-ae4153898824 None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6bd48af9e1aa4ddf993b915112d9430d', 'request_id': 'req-c91488e4-3e37-438d-aeb8-ae4153898824'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-c91488e4-3e37-438d-aeb8-ae4153898824 None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6bd48af9e1aa4ddf993b915112d9430d', 'request_id': 'req-c91488e4-3e37-438d-aeb8-ae4153898824'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-c91488e4-3e37-438d-aeb8-ae4153898824 None admin] The token cache is being invalidate because project 6bd48af9e1aa4ddf993b915112d9430d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 12:57:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-c91488e4-3e37-438d-aeb8-ae4153898824 None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-c91488e4-3e37-438d-aeb8-ae4153898824 None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:47 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1024/2072] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 12:57:46 2024] DELETE /identity/v3/projects/6bd48af9e1aa4ddf993b915112d9430d => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:57:47 l75lg1-v1 neutron-server[77618]: DEBUG neutron.wsgi [-] (77618) accepted ('10.27.203.238', 41684) {{(pid=77618) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 12:57:47 l75lg1-v1 neutron-server[77618]: INFO neutron.wsgi [None req-6b220ee0-2964-40ff-b405-eb82f603a1c1 None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=79c22d93ef6a4115a5b0066f1b85b888&name=default HTTP/1.1" status: 200 len: 216 time: 0.0103619 May 28 12:57:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba57afd7-3c3d-4e54-ab88-d8c62dc2d8be None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-ba57afd7-3c3d-4e54-ab88-d8c62dc2d8be None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba57afd7-3c3d-4e54-ab88-d8c62dc2d8be None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce5588c-88d3-48a3-baeb-f6c5d09a402f None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce5588c-88d3-48a3-baeb-f6c5d09a402f None admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce5588c-88d3-48a3-baeb-f6c5d09a402f None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce5588c-88d3-48a3-baeb-f6c5d09a402f None admin] PATH_INFO: `/v3/projects/79c22d93ef6a4115a5b0066f1b85b888` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce5588c-88d3-48a3-baeb-f6c5d09a402f None admin] RBAC: Authorizing `identity:delete_project(project_id=79c22d93ef6a4115a5b0066f1b85b888)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce5588c-88d3-48a3-baeb-f6c5d09a402f None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-6ce5588c-88d3-48a3-baeb-f6c5d09a402f None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79c22d93ef6a4115a5b0066f1b85b888', 'request_id': 'req-6ce5588c-88d3-48a3-baeb-f6c5d09a402f'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-6ce5588c-88d3-48a3-baeb-f6c5d09a402f None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79c22d93ef6a4115a5b0066f1b85b888', 'request_id': 'req-6ce5588c-88d3-48a3-baeb-f6c5d09a402f'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-6ce5588c-88d3-48a3-baeb-f6c5d09a402f None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79c22d93ef6a4115a5b0066f1b85b888', 'request_id': 'req-6ce5588c-88d3-48a3-baeb-f6c5d09a402f'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-6ce5588c-88d3-48a3-baeb-f6c5d09a402f None admin] The token cache is being invalidate because project 79c22d93ef6a4115a5b0066f1b85b888 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 12:57:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-6ce5588c-88d3-48a3-baeb-f6c5d09a402f None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-6ce5588c-88d3-48a3-baeb-f6c5d09a402f None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:47 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1049/2073] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 12:57:47 2024] DELETE /identity/v3/projects/79c22d93ef6a4115a5b0066f1b85b888 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:57:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35e1263-a1cb-4a76-9890-dc8639c64d0f None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35e1263-a1cb-4a76-9890-dc8639c64d0f None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35e1263-a1cb-4a76-9890-dc8639c64d0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:47 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-b35e1263-a1cb-4a76-9890-dc8639c64d0f None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:57:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-b35e1263-a1cb-4a76-9890-dc8639c64d0f None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:57:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-b35e1263-a1cb-4a76-9890-dc8639c64d0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:47 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1025/2074] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:57:47 2024] POST /identity/v3/auth/tokens => generated 312 bytes in 19 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 28 12:57:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d59413-c010-4820-a97f-f793dc34c38b None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d59413-c010-4820-a97f-f793dc34c38b None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d59413-c010-4820-a97f-f793dc34c38b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1d58e35e-74eb-471d-bbdb-c75219ac6e07 tempest-SharesMetadataNegativeTest-1584039052 None] <<< [GET] https://127.0.0.1:40443/api/views/ May 28 12:57:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1d58e35e-74eb-471d-bbdb-c75219ac6e07 tempest-SharesMetadataNegativeTest-1584039052 None] [] May 28 12:57:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1d58e35e-74eb-471d-bbdb-c75219ac6e07 tempest-SharesMetadataNegativeTest-1584039052 None] --- [GET] https://127.0.0.1:40443/api/views/: Done May 28 12:57:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1d58e35e-74eb-471d-bbdb-c75219ac6e07 tempest-SharesMetadataNegativeTest-1584039052 None] >>> [POST] https://127.0.0.1:40443/api/views/ May 28 12:57:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1d58e35e-74eb-471d-bbdb-c75219ac6e07 tempest-SharesMetadataNegativeTest-1584039052 None] {'data': '{"name": "9e93e444-3013-4370-9caa-9f912c5201e6", "path": ' May 28 12:57:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1d58e35e-74eb-471d-bbdb-c75219ac6e07 tempest-SharesMetadataNegativeTest-1584039052 None] '"/manila/manila-9e93e444-3013-4370-9caa-9f912c5201e6", "policy_id": ' May 28 12:57:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1d58e35e-74eb-471d-bbdb-c75219ac6e07 tempest-SharesMetadataNegativeTest-1584039052 None] '23, "create_dir": true, "protocols": ["NFS"]}', May 28 12:57:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1d58e35e-74eb-471d-bbdb-c75219ac6e07 tempest-SharesMetadataNegativeTest-1584039052 None] 'json': None, May 28 12:57:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1d58e35e-74eb-471d-bbdb-c75219ac6e07 tempest-SharesMetadataNegativeTest-1584039052 None] 'params': None} May 28 12:57:47 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-05d59413-c010-4820-a97f-f793dc34c38b None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:57:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-05d59413-c010-4820-a97f-f793dc34c38b None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:57:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-05d59413-c010-4820-a97f-f793dc34c38b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:47 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1050/2075] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:57:47 2024] POST /identity/v3/auth/tokens => generated 2960 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 12:57:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35e1263-a1cb-4a76-9890-dc8639c64d0f None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35e1263-a1cb-4a76-9890-dc8639c64d0f None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4054418-3132-4537-bad2-d4789f3cce8b None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4054418-3132-4537-bad2-d4789f3cce8b None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4054418-3132-4537-bad2-d4789f3cce8b None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4054418-3132-4537-bad2-d4789f3cce8b None admin] PATH_INFO: `/v3/domains` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4054418-3132-4537-bad2-d4789f3cce8b None admin] RBAC: Adding query filter params (name=Default) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:57:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4054418-3132-4537-bad2-d4789f3cce8b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4054418-3132-4537-bad2-d4789f3cce8b None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:47 l75lg1-v1 dstat.sh[49771]: 28-05 12:57:47| 11 2 84 3 0|5700M 1791M 277M 7858M| 27k 4637B| 0 2172k| 0 345 |8262 15k|1.52 1.07 1.02|1.0 1.0 0| 0 0 | 0 2048M| 29 356 0 72 0 May 28 12:57:47 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1026/2076] 10.27.203.238 () {62 vars in 1220 bytes} [Tue May 28 12:57:47 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:57:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d59413-c010-4820-a97f-f793dc34c38b None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d59413-c010-4820-a97f-f793dc34c38b None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cd8de5-d89e-4c5d-b4fd-691402d2367f None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cd8de5-d89e-4c5d-b4fd-691402d2367f None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cd8de5-d89e-4c5d-b4fd-691402d2367f None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cd8de5-d89e-4c5d-b4fd-691402d2367f None admin] PATH_INFO: `/v3/projects` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cd8de5-d89e-4c5d-b4fd-691402d2367f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cd8de5-d89e-4c5d-b4fd-691402d2367f None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:47 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1051/2077] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 12:57:47 2024] POST /identity/v3/projects => generated 397 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:57:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4054418-3132-4537-bad2-d4789f3cce8b None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4054418-3132-4537-bad2-d4789f3cce8b None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e475b181-000c-48f1-bae2-1c0506418668 tempest-SharesMetadataTest-1561320255 None] <<< [POST] https://127.0.0.1:40443/api/views/ May 28 12:57:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e475b181-000c-48f1-bae2-1c0506418668 tempest-SharesMetadataTest-1561320255 None] Bunch(abac_tags=[], abe_max_depth=None, abe_protocols=[], alias='', allow_anonymous_access=False, allow_s3_anonymous_access=False, auto_commit='0d', bucket='', bucket_creators=[], bucket_creators_groups=[], bucket_owner=None, bulk_permission_update_progress=None, bulk_permission_update_state=None, cluster='loop75-kfs', cluster_id=1, created='2024-05-28T12:57:46.900385Z', enabled=True, files_retention_mode='NONE', guid='1462884d-64ac-4510-b0bf-c8d7ef5f49fd', id=21, ignore_oos=False, internal=False, is_remote=False, is_seamless=False, logical_capacity=0, max_retention_period=None, min_retention_period=None, name='5cf89605-2e7d-4ecc-9c44-5e6f5ecb0cad', nfs_interop_flags='BOTH_NFS3_AND_NFS4_INTEROP_DISABLED', path='/manila/manila-5cf89605-2e7d-4ecc-9c44-5e6f5ecb0cad', physical_capacity=0, policy='5cf89605-2e7d-4ecc-9c44-5e6f5ecb0cad', policy_id=22, protocols=['NFS'], qos_policy=None, qos_policy_id=None, s3_locks=False, s3_locks_retention_mode='NONE', s3_locks_retention_period='', s3_object_ownership_rule='ObjectWriter', s3_unverified_lookup=False, s3_versioning=False, select_for_live_monitoring=False, share='', share_acl=Bunch(acl=[], enabled=False), sync='SYNCED', sync_time='2024-05-28T12:57:47.226358Z', tenant_id=1, tenant_name='default', title='/manila/manila-5cf89605-2e7d-4ecc-9c44-5e6f5ecb0cad', url='https://127.0.0.1:40443/api/views/21/') May 28 12:57:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e475b181-000c-48f1-bae2-1c0506418668 tempest-SharesMetadataTest-1561320255 None] --- [POST] https://127.0.0.1:40443/api/views/: Done May 28 12:57:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4385fd32-422e-4f9b-8f59-c2565e7f61c2 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4385fd32-422e-4f9b-8f59-c2565e7f61c2 None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4385fd32-422e-4f9b-8f59-c2565e7f61c2 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4385fd32-422e-4f9b-8f59-c2565e7f61c2 None admin] PATH_INFO: `/v3/users` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4385fd32-422e-4f9b-8f59-c2565e7f61c2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4385fd32-422e-4f9b-8f59-c2565e7f61c2 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:47 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-4385fd32-422e-4f9b-8f59-c2565e7f61c2 None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 12:57:47 l75lg1-v1 manila-share[98474]: INFO manila.share.manager [None req-e475b181-000c-48f1-bae2-1c0506418668 tempest-SharesMetadataTest-1561320255 None] Share instance 5cf89605-2e7d-4ecc-9c44-5e6f5ecb0cad created successfully. May 28 12:57:47 l75lg1-v1 manila-share[98474]: DEBUG oslo_service.periodic_task [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] Running periodic task ShareManager._publish_service_capabilities {{(pid=98474) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:57:47 l75lg1-v1 manila-share[98474]: DEBUG manila.manager [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] Notifying Schedulers of capabilities ... {{(pid=98474) _publish_service_capabilities /opt/stack/manila/manila/manager.py:172}} May 28 12:57:47 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1027/2078] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 12:57:47 2024] POST /identity/v3/users => generated 307 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:57:47 l75lg1-v1 manila-share[98474]: DEBUG oslo_service.periodic_task [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] Running periodic task ShareManager.migration_driver_continue {{(pid=98474) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:57:47 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.host_manager [None req-f415db8b-eda9-4e4b-8308-a2a14b49a7b9 None None] Received share service update from l75lg1-v1@vast: {'share_backend_name': 'vast', 'driver_handles_share_servers': False, 'vendor_name': 'VAST STORAGE', 'driver_version': '1.0', 'storage_protocol': 'NFS', 'total_capacity_gb': 2083.02392578125, 'free_capacity_gb': 2082.6229242384434, 'reserved_percentage': 0, 'reserved_snapshot_percentage': 0, 'reserved_share_extend_percentage': 0, 'qos': False, 'pools': None, 'snapshot_support': True, 'create_share_from_snapshot_support': False, 'revert_to_snapshot_support': False, 'mount_snapshot_support': False, 'replication_domain': None, 'filter_function': None, 'goodness_function': None, 'security_service_update_support': False, 'network_allocation_update_support': False, 'share_server_multiple_subnet_support': False, 'mount_point_name_support': False, 'data_reduction': 5.29, 'provisioned_capacity_gb': 0.40100154280662537, 'share_group_stats': {'consistent_snapshot_support': None}, 'ipv4_support': True, 'ipv6_support': False} {{(pid=98327) update_service_capabilities /opt/stack/manila/manila/scheduler/host_manager.py:632}} May 28 12:57:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cd8de5-d89e-4c5d-b4fd-691402d2367f None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cd8de5-d89e-4c5d-b4fd-691402d2367f None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5673df2a-4065-4ef7-9f91-870400e2b0fa None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5673df2a-4065-4ef7-9f91-870400e2b0fa None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5673df2a-4065-4ef7-9f91-870400e2b0fa None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5673df2a-4065-4ef7-9f91-870400e2b0fa None admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5673df2a-4065-4ef7-9f91-870400e2b0fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5673df2a-4065-4ef7-9f91-870400e2b0fa None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:47 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1052/2079] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 12:57:47 2024] GET /identity/v3/roles => generated 1680 bytes in 16 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:57:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4385fd32-422e-4f9b-8f59-c2565e7f61c2 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4385fd32-422e-4f9b-8f59-c2565e7f61c2 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1abe54-a883-4ba3-a328-b4d2d602330d None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1abe54-a883-4ba3-a328-b4d2d602330d None admin] REQUEST_METHOD: `PUT` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1abe54-a883-4ba3-a328-b4d2d602330d None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1abe54-a883-4ba3-a328-b4d2d602330d None admin] PATH_INFO: `/v3/projects/ed0a0bf2490645089c21203bbbe1c291/users/f3cb6c53a51049ff8cbf29dc9067534a/roles/44620cad10ae407c90c91e2c296adb04` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1abe54-a883-4ba3-a328-b4d2d602330d None admin] RBAC: Authorizing `identity:create_grant(project_id=ed0a0bf2490645089c21203bbbe1c291, user_id=f3cb6c53a51049ff8cbf29dc9067534a, role_id=44620cad10ae407c90c91e2c296adb04)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1abe54-a883-4ba3-a328-b4d2d602330d None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:47 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1028/2080] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 12:57:47 2024] PUT /identity/v3/projects/ed0a0bf2490645089c21203bbbe1c291/users/f3cb6c53a51049ff8cbf29dc9067534a/roles/44620cad10ae407c90c91e2c296adb04 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:57:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72903ca-1608-43e7-b15e-c9c9cbb2a923 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72903ca-1608-43e7-b15e-c9c9cbb2a923 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72903ca-1608-43e7-b15e-c9c9cbb2a923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:47 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-e72903ca-1608-43e7-b15e-c9c9cbb2a923 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:57:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-e72903ca-1608-43e7-b15e-c9c9cbb2a923 None None] MFA Rules not processed for user `f3cb6c53a51049ff8cbf29dc9067534a`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:57:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-e72903ca-1608-43e7-b15e-c9c9cbb2a923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:47 l75lg1-v1 manila-share[98474]: DEBUG oslo_service.periodic_task [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] Running periodic task ShareManager.do_deferred_share_deletion {{(pid=98474) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:57:47 l75lg1-v1 manila-share[98474]: DEBUG manila.share.manager [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] Checking for shares in 'deferred_deleting' status to process their deletion. {{(pid=98474) do_deferred_share_deletion /opt/stack/manila/manila/share/manager.py:3663}} May 28 12:57:47 l75lg1-v1 manila-share[98474]: DEBUG oslo_service.periodic_task [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] Running periodic task ShareManager.do_deferred_snapshot_deletion {{(pid=98474) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:57:47 l75lg1-v1 manila-share[98474]: DEBUG manila.share.manager [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] Checking for snapshots in 'deferred_deleting' status to process their deletion. {{(pid=98474) do_deferred_snapshot_deletion /opt/stack/manila/manila/share/manager.py:3980}} May 28 12:57:47 l75lg1-v1 manila-share[98474]: DEBUG oslo_service.periodic_task [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] Running periodic task ShareManager._report_driver_status {{(pid=98474) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:57:47 l75lg1-v1 manila-share[98474]: INFO manila.share.manager [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] Updating share status May 28 12:57:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] >>> [GET] https://127.0.0.1:40443/api/monitors/ad_hoc_query/ May 28 12:57:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] {'allow_redirects': True, May 28 12:57:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] 'params': {'object_type': 'cluster', May 28 12:57:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] 'prop_list': ['Capacity,drr', May 28 12:57:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] 'Capacity,logical_space', May 28 12:57:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] 'Capacity,logical_space_in_use', May 28 12:57:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] 'Capacity,physical_space', May 28 12:57:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] 'Capacity,physical_space_in_use'], May 28 12:57:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] 'time_frame': '1m'}} May 28 12:57:47 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1053/2081] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:57:47 2024] POST /identity/v3/auth/tokens => generated 3968 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:57:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1abe54-a883-4ba3-a328-b4d2d602330d None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1abe54-a883-4ba3-a328-b4d2d602330d None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d607869-c17b-4c34-bb5b-86f504d90865 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d607869-c17b-4c34-bb5b-86f504d90865 None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d607869-c17b-4c34-bb5b-86f504d90865 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d607869-c17b-4c34-bb5b-86f504d90865 None admin] PATH_INFO: `/v3/projects` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d607869-c17b-4c34-bb5b-86f504d90865 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d607869-c17b-4c34-bb5b-86f504d90865 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:47 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1029/2082] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 12:57:47 2024] POST /identity/v3/projects => generated 395 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:57:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72903ca-1608-43e7-b15e-c9c9cbb2a923 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72903ca-1608-43e7-b15e-c9c9cbb2a923 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] <<< [GET] https://127.0.0.1:40443/api/monitors/ad_hoc_query/ May 28 12:57:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] Bunch(data=[['2024-05-28T12:57:40Z', 1, 403678046.0, 2223930.0, 5.29, 711246584217.0, 2236629909504.0], ['2024-05-28T12:57:29Z', 1, 403514206.0, 2223930.0, 5.29, 711246584217.0, 2236629909504.0], ['2024-05-28T12:57:19Z', 1, 402932574.0, 2223930.0, 5.29, 711246584217.0, 2236629909504.0], ['2024-05-28T12:57:09Z', 1, 402793310.0, 2223930.0, 5.29, 711246584217.0, 2236629909504.0], ['2024-05-28T12:56:59Z', 1, 402621278.0, 2223930.0, 5.29, 711246584217.0, 2236629909504.0], ['2024-05-28T12:56:49Z', 1, 402457437.0, 2223930.0, 5.29, 711246584217.0, 2236629909504.0]], granularity=None, object_ids=[1], prop_list=['timestamp', 'object_id', 'Capacity,logical_space_in_use', 'Capacity,physical_space_in_use', 'Capacity,drr', 'Capacity,physical_space', 'Capacity,logical_space']) May 28 12:57:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] --- [GET] https://127.0.0.1:40443/api/monitors/ad_hoc_query/: Done May 28 12:57:47 l75lg1-v1 manila-share[98474]: DEBUG manila.share.driver [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] Updating share stats. {{(pid=98474) _update_share_stats /opt/stack/manila/manila/share/driver.py:1326}} May 28 12:57:47 l75lg1-v1 manila-share[98474]: DEBUG oslo_service.periodic_task [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] Running periodic task ShareManager.create_backup_continue {{(pid=98474) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:57:47 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:57:47 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:57:47 l75lg1-v1 manila-share[98474]: DEBUG oslo_service.periodic_task [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] Running periodic task ShareManager.restore_backup_continue {{(pid=98474) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:57:47 l75lg1-v1 manila-share[98474]: DEBUG oslo_service.periodic_task [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] Running periodic task ShareManager.periodic_share_status_update {{(pid=98474) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:57:47 l75lg1-v1 manila-share[98474]: DEBUG manila.share.manager [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] Updating status of share instances. {{(pid=98474) periodic_share_status_update /opt/stack/manila/manila/share/manager.py:5475}} May 28 12:57:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2bd9e1-c6d9-4e96-9993-129003984294 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2bd9e1-c6d9-4e96-9993-129003984294 None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2bd9e1-c6d9-4e96-9993-129003984294 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2bd9e1-c6d9-4e96-9993-129003984294 None admin] PATH_INFO: `/v3/users` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2bd9e1-c6d9-4e96-9993-129003984294 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2bd9e1-c6d9-4e96-9993-129003984294 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:47 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-5f2bd9e1-c6d9-4e96-9993-129003984294 None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 12:57:47 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1054/2083] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 12:57:47 2024] POST /identity/v3/users => generated 306 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:57:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d607869-c17b-4c34-bb5b-86f504d90865 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d607869-c17b-4c34-bb5b-86f504d90865 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07074279-1e11-4184-969a-231565705abd None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07074279-1e11-4184-969a-231565705abd None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07074279-1e11-4184-969a-231565705abd None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07074279-1e11-4184-969a-231565705abd None admin] PATH_INFO: `/v3/roles` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07074279-1e11-4184-969a-231565705abd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07074279-1e11-4184-969a-231565705abd None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:47 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1030/2084] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 12:57:47 2024] GET /identity/v3/roles => generated 1680 bytes in 18 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:57:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2bd9e1-c6d9-4e96-9993-129003984294 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2bd9e1-c6d9-4e96-9993-129003984294 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6b4be6-c3ce-4662-9eff-ee213d17cf7f None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6b4be6-c3ce-4662-9eff-ee213d17cf7f None admin] REQUEST_METHOD: `PUT` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6b4be6-c3ce-4662-9eff-ee213d17cf7f None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6b4be6-c3ce-4662-9eff-ee213d17cf7f None admin] PATH_INFO: `/v3/projects/744044ad65fb482da4d2ebaa13a84bf8/users/2bcd797659f0461f9b2ee5e5258371fa/roles/44620cad10ae407c90c91e2c296adb04` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6b4be6-c3ce-4662-9eff-ee213d17cf7f None admin] RBAC: Authorizing `identity:create_grant(project_id=744044ad65fb482da4d2ebaa13a84bf8, user_id=2bcd797659f0461f9b2ee5e5258371fa, role_id=44620cad10ae407c90c91e2c296adb04)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6b4be6-c3ce-4662-9eff-ee213d17cf7f None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:47 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1055/2085] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 12:57:47 2024] PUT /identity/v3/projects/744044ad65fb482da4d2ebaa13a84bf8/users/2bcd797659f0461f9b2ee5e5258371fa/roles/44620cad10ae407c90c91e2c296adb04 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:57:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa0f6b3-53e2-4e9b-86bd-dc4007582419 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa0f6b3-53e2-4e9b-86bd-dc4007582419 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa0f6b3-53e2-4e9b-86bd-dc4007582419 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:47 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-1aa0f6b3-53e2-4e9b-86bd-dc4007582419 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:57:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-1aa0f6b3-53e2-4e9b-86bd-dc4007582419 None None] MFA Rules not processed for user `2bcd797659f0461f9b2ee5e5258371fa`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:57:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-1aa0f6b3-53e2-4e9b-86bd-dc4007582419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:47 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1031/2086] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:57:47 2024] POST /identity/v3/auth/tokens => generated 3966 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:57:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6b4be6-c3ce-4662-9eff-ee213d17cf7f None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6b4be6-c3ce-4662-9eff-ee213d17cf7f None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd36811-44d9-4e98-beef-2e771e820c43 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd36811-44d9-4e98-beef-2e771e820c43 None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd36811-44d9-4e98-beef-2e771e820c43 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd36811-44d9-4e98-beef-2e771e820c43 None admin] PATH_INFO: `/v3/projects` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd36811-44d9-4e98-beef-2e771e820c43 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd36811-44d9-4e98-beef-2e771e820c43 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:47 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1056/2087] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 12:57:47 2024] POST /identity/v3/projects => generated 397 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:57:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa0f6b3-53e2-4e9b-86bd-dc4007582419 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa0f6b3-53e2-4e9b-86bd-dc4007582419 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd949d88-8ad7-4576-aaa6-d53cb9cac2fe None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd949d88-8ad7-4576-aaa6-d53cb9cac2fe None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd949d88-8ad7-4576-aaa6-d53cb9cac2fe None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd949d88-8ad7-4576-aaa6-d53cb9cac2fe None admin] PATH_INFO: `/v3/users` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd949d88-8ad7-4576-aaa6-d53cb9cac2fe None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd949d88-8ad7-4576-aaa6-d53cb9cac2fe None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:47 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-dd949d88-8ad7-4576-aaa6-d53cb9cac2fe None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 12:57:47 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1032/2088] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 12:57:47 2024] POST /identity/v3/users => generated 306 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:57:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd36811-44d9-4e98-beef-2e771e820c43 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd36811-44d9-4e98-beef-2e771e820c43 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0ce84a-7ee6-4809-90e2-8115159bad3a None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0ce84a-7ee6-4809-90e2-8115159bad3a None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0ce84a-7ee6-4809-90e2-8115159bad3a None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0ce84a-7ee6-4809-90e2-8115159bad3a None admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0ce84a-7ee6-4809-90e2-8115159bad3a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0ce84a-7ee6-4809-90e2-8115159bad3a None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:47 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1057/2089] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 12:57:47 2024] GET /identity/v3/roles => generated 1680 bytes in 17 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:57:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd949d88-8ad7-4576-aaa6-d53cb9cac2fe None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd949d88-8ad7-4576-aaa6-d53cb9cac2fe None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf569b51-352c-4660-b5c1-f59e6d337beb None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf569b51-352c-4660-b5c1-f59e6d337beb None admin] REQUEST_METHOD: `PUT` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf569b51-352c-4660-b5c1-f59e6d337beb None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf569b51-352c-4660-b5c1-f59e6d337beb None admin] PATH_INFO: `/v3/projects/c9cc76ecb4e343a6a51bf36da01debf8/users/0b4f232c985e4c7eafeef302f4eaa647/roles/e7989893488f483baa107be56668c4f8` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf569b51-352c-4660-b5c1-f59e6d337beb None admin] RBAC: Authorizing `identity:create_grant(project_id=c9cc76ecb4e343a6a51bf36da01debf8, user_id=0b4f232c985e4c7eafeef302f4eaa647, role_id=e7989893488f483baa107be56668c4f8)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf569b51-352c-4660-b5c1-f59e6d337beb None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:47 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1033/2090] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 12:57:47 2024] PUT /identity/v3/projects/c9cc76ecb4e343a6a51bf36da01debf8/users/0b4f232c985e4c7eafeef302f4eaa647/roles/e7989893488f483baa107be56668c4f8 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:57:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1d58e35e-74eb-471d-bbdb-c75219ac6e07 tempest-SharesMetadataNegativeTest-1584039052 None] <<< [POST] https://127.0.0.1:40443/api/views/ May 28 12:57:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1d58e35e-74eb-471d-bbdb-c75219ac6e07 tempest-SharesMetadataNegativeTest-1584039052 None] Bunch(abac_tags=[], abe_max_depth=None, abe_protocols=[], alias='', allow_anonymous_access=False, allow_s3_anonymous_access=False, auto_commit='0d', bucket='', bucket_creators=[], bucket_creators_groups=[], bucket_owner=None, bulk_permission_update_progress=None, bulk_permission_update_state=None, cluster='loop75-kfs', cluster_id=1, created='2024-05-28T12:57:47.604412Z', enabled=True, files_retention_mode='NONE', guid='06f608e8-20b1-4a3f-ac79-761ca03b03f5', id=22, ignore_oos=False, internal=False, is_remote=False, is_seamless=False, logical_capacity=0, max_retention_period=None, min_retention_period=None, name='9e93e444-3013-4370-9caa-9f912c5201e6', nfs_interop_flags='BOTH_NFS3_AND_NFS4_INTEROP_DISABLED', path='/manila/manila-9e93e444-3013-4370-9caa-9f912c5201e6', physical_capacity=0, policy='9e93e444-3013-4370-9caa-9f912c5201e6', policy_id=23, protocols=['NFS'], qos_policy=None, qos_policy_id=None, s3_locks=False, s3_locks_retention_mode='NONE', s3_locks_retention_period='', s3_object_ownership_rule='ObjectWriter', s3_unverified_lookup=False, s3_versioning=False, select_for_live_monitoring=False, share='', share_acl=Bunch(acl=[], enabled=False), sync='SYNCED', sync_time='2024-05-28T12:57:47.874650Z', tenant_id=1, tenant_name='default', title='/manila/manila-9e93e444-3013-4370-9caa-9f912c5201e6', url='https://127.0.0.1:40443/api/views/22/') May 28 12:57:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1d58e35e-74eb-471d-bbdb-c75219ac6e07 tempest-SharesMetadataNegativeTest-1584039052 None] --- [POST] https://127.0.0.1:40443/api/views/: Done May 28 12:57:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0ce84a-7ee6-4809-90e2-8115159bad3a None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0ce84a-7ee6-4809-90e2-8115159bad3a None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:47 l75lg1-v1 manila-share[98474]: INFO manila.share.manager [None req-1d58e35e-74eb-471d-bbdb-c75219ac6e07 tempest-SharesMetadataNegativeTest-1584039052 None] Share instance 9e93e444-3013-4370-9caa-9f912c5201e6 created successfully. May 28 12:57:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d6cb4f-ea28-4e01-bd3c-64aef5e7802b None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d6cb4f-ea28-4e01-bd3c-64aef5e7802b None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d6cb4f-ea28-4e01-bd3c-64aef5e7802b None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d6cb4f-ea28-4e01-bd3c-64aef5e7802b None admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d6cb4f-ea28-4e01-bd3c-64aef5e7802b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d6cb4f-ea28-4e01-bd3c-64aef5e7802b None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:48 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1058/2091] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 12:57:47 2024] GET /identity/v3/roles => generated 1680 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:57:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf569b51-352c-4660-b5c1-f59e6d337beb None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf569b51-352c-4660-b5c1-f59e6d337beb None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89595540-6baa-4d57-9c83-3346b5d177e2 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89595540-6baa-4d57-9c83-3346b5d177e2 None admin] REQUEST_METHOD: `PUT` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89595540-6baa-4d57-9c83-3346b5d177e2 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89595540-6baa-4d57-9c83-3346b5d177e2 None admin] PATH_INFO: `/v3/projects/c9cc76ecb4e343a6a51bf36da01debf8/users/0b4f232c985e4c7eafeef302f4eaa647/roles/e7989893488f483baa107be56668c4f8` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89595540-6baa-4d57-9c83-3346b5d177e2 None admin] RBAC: Authorizing `identity:create_grant(project_id=c9cc76ecb4e343a6a51bf36da01debf8, user_id=0b4f232c985e4c7eafeef302f4eaa647, role_id=e7989893488f483baa107be56668c4f8)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89595540-6baa-4d57-9c83-3346b5d177e2 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:48 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1034/2092] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 12:57:48 2024] PUT /identity/v3/projects/c9cc76ecb4e343a6a51bf36da01debf8/users/0b4f232c985e4c7eafeef302f4eaa647/roles/e7989893488f483baa107be56668c4f8 => generated 0 bytes in 19 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:57:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8022875c-cf53-433f-a7de-ec94b94512db None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8022875c-cf53-433f-a7de-ec94b94512db None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8022875c-cf53-433f-a7de-ec94b94512db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:48 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-8022875c-cf53-433f-a7de-ec94b94512db None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:57:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-8022875c-cf53-433f-a7de-ec94b94512db None None] MFA Rules not processed for user `0b4f232c985e4c7eafeef302f4eaa647`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:57:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-8022875c-cf53-433f-a7de-ec94b94512db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:48 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1059/2093] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:57:48 2024] POST /identity/v3/auth/tokens => generated 4091 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 28 12:57:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89595540-6baa-4d57-9c83-3346b5d177e2 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89595540-6baa-4d57-9c83-3346b5d177e2 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00952de4-95ba-4edf-b1b8-819ccdc0acb1 tempest-SnapshotInstancesNegativeTest-1396485679 tempest-SnapshotInstancesNegativeTest-1396485679-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b4f232c985e4c7eafeef302f4eaa647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9cc76ecb4e343a6a51bf36da01debf8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00952de4-95ba-4edf-b1b8-819ccdc0acb1 tempest-SnapshotInstancesNegativeTest-1396485679 tempest-SnapshotInstancesNegativeTest-1396485679-project-admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00952de4-95ba-4edf-b1b8-819ccdc0acb1 tempest-SnapshotInstancesNegativeTest-1396485679 tempest-SnapshotInstancesNegativeTest-1396485679-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00952de4-95ba-4edf-b1b8-819ccdc0acb1 tempest-SnapshotInstancesNegativeTest-1396485679 tempest-SnapshotInstancesNegativeTest-1396485679-project-admin] PATH_INFO: `/v3/domains` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00952de4-95ba-4edf-b1b8-819ccdc0acb1 tempest-SnapshotInstancesNegativeTest-1396485679 tempest-SnapshotInstancesNegativeTest-1396485679-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:57:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00952de4-95ba-4edf-b1b8-819ccdc0acb1 tempest-SnapshotInstancesNegativeTest-1396485679 tempest-SnapshotInstancesNegativeTest-1396485679-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00952de4-95ba-4edf-b1b8-819ccdc0acb1 tempest-SnapshotInstancesNegativeTest-1396485679 tempest-SnapshotInstancesNegativeTest-1396485679-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:48 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1035/2094] 10.27.203.238 () {62 vars in 1241 bytes} [Tue May 28 12:57:48 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 28 12:57:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8022875c-cf53-433f-a7de-ec94b94512db None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8022875c-cf53-433f-a7de-ec94b94512db None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3519ed55-35cf-453f-af94-c8375d22c005 tempest-SnapshotInstancesNegativeTest-1396485679 tempest-SnapshotInstancesNegativeTest-1396485679-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b4f232c985e4c7eafeef302f4eaa647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9cc76ecb4e343a6a51bf36da01debf8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3519ed55-35cf-453f-af94-c8375d22c005 tempest-SnapshotInstancesNegativeTest-1396485679 tempest-SnapshotInstancesNegativeTest-1396485679-project-admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3519ed55-35cf-453f-af94-c8375d22c005 tempest-SnapshotInstancesNegativeTest-1396485679 tempest-SnapshotInstancesNegativeTest-1396485679-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3519ed55-35cf-453f-af94-c8375d22c005 tempest-SnapshotInstancesNegativeTest-1396485679 tempest-SnapshotInstancesNegativeTest-1396485679-project-admin] PATH_INFO: `/v3/users` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3519ed55-35cf-453f-af94-c8375d22c005 tempest-SnapshotInstancesNegativeTest-1396485679 tempest-SnapshotInstancesNegativeTest-1396485679-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3519ed55-35cf-453f-af94-c8375d22c005 tempest-SnapshotInstancesNegativeTest-1396485679 tempest-SnapshotInstancesNegativeTest-1396485679-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:48 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-3519ed55-35cf-453f-af94-c8375d22c005 tempest-SnapshotInstancesNegativeTest-1396485679 tempest-SnapshotInstancesNegativeTest-1396485679-project-admin] Truncating password to algorithm specific maximum length 72 characters. May 28 12:57:48 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1060/2095] 10.27.203.238 () {64 vars in 1232 bytes} [Tue May 28 12:57:48 2024] POST /identity/v3/users => generated 433 bytes in 32 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:57:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00952de4-95ba-4edf-b1b8-819ccdc0acb1 tempest-SnapshotInstancesNegativeTest-1396485679 tempest-SnapshotInstancesNegativeTest-1396485679-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00952de4-95ba-4edf-b1b8-819ccdc0acb1 tempest-SnapshotInstancesNegativeTest-1396485679 tempest-SnapshotInstancesNegativeTest-1396485679-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b4a89d-b5cc-4400-bf4c-81aa102f2a70 tempest-SnapshotInstancesNegativeTest-1396485679 tempest-SnapshotInstancesNegativeTest-1396485679-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b4f232c985e4c7eafeef302f4eaa647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9cc76ecb4e343a6a51bf36da01debf8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b4a89d-b5cc-4400-bf4c-81aa102f2a70 tempest-SnapshotInstancesNegativeTest-1396485679 tempest-SnapshotInstancesNegativeTest-1396485679-project-admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b4a89d-b5cc-4400-bf4c-81aa102f2a70 tempest-SnapshotInstancesNegativeTest-1396485679 tempest-SnapshotInstancesNegativeTest-1396485679-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b4a89d-b5cc-4400-bf4c-81aa102f2a70 tempest-SnapshotInstancesNegativeTest-1396485679 tempest-SnapshotInstancesNegativeTest-1396485679-project-admin] PATH_INFO: `/v3/roles` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b4a89d-b5cc-4400-bf4c-81aa102f2a70 tempest-SnapshotInstancesNegativeTest-1396485679 tempest-SnapshotInstancesNegativeTest-1396485679-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b4a89d-b5cc-4400-bf4c-81aa102f2a70 tempest-SnapshotInstancesNegativeTest-1396485679 tempest-SnapshotInstancesNegativeTest-1396485679-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:48 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1036/2096] 10.27.203.238 () {62 vars in 1210 bytes} [Tue May 28 12:57:48 2024] GET /identity/v3/roles => generated 1680 bytes in 16 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:57:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3519ed55-35cf-453f-af94-c8375d22c005 tempest-SnapshotInstancesNegativeTest-1396485679 tempest-SnapshotInstancesNegativeTest-1396485679-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3519ed55-35cf-453f-af94-c8375d22c005 tempest-SnapshotInstancesNegativeTest-1396485679 tempest-SnapshotInstancesNegativeTest-1396485679-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b0b6df-b968-496b-a346-8569dc413e07 tempest-SnapshotInstancesNegativeTest-1396485679 tempest-SnapshotInstancesNegativeTest-1396485679-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b4f232c985e4c7eafeef302f4eaa647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9cc76ecb4e343a6a51bf36da01debf8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b0b6df-b968-496b-a346-8569dc413e07 tempest-SnapshotInstancesNegativeTest-1396485679 tempest-SnapshotInstancesNegativeTest-1396485679-project-admin] REQUEST_METHOD: `PUT` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b0b6df-b968-496b-a346-8569dc413e07 tempest-SnapshotInstancesNegativeTest-1396485679 tempest-SnapshotInstancesNegativeTest-1396485679-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b0b6df-b968-496b-a346-8569dc413e07 tempest-SnapshotInstancesNegativeTest-1396485679 tempest-SnapshotInstancesNegativeTest-1396485679-project-admin] PATH_INFO: `/v3/projects/c9cc76ecb4e343a6a51bf36da01debf8/users/f89f851af36d480ab7d10d3506c60899/roles/44620cad10ae407c90c91e2c296adb04` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b0b6df-b968-496b-a346-8569dc413e07 tempest-SnapshotInstancesNegativeTest-1396485679 tempest-SnapshotInstancesNegativeTest-1396485679-project-admin] RBAC: Authorizing `identity:create_grant(project_id=c9cc76ecb4e343a6a51bf36da01debf8, user_id=f89f851af36d480ab7d10d3506c60899, role_id=44620cad10ae407c90c91e2c296adb04)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:48 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b0b6df-b968-496b-a346-8569dc413e07 tempest-SnapshotInstancesNegativeTest-1396485679 tempest-SnapshotInstancesNegativeTest-1396485679-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:48 l75lg1-v1 dstat.sh[49771]: 28-05 12:57:48| 11 1 84 2 0|5700M 1790M 277M 7858M| 19k 1222B| 0 1889k| 0 259 |7792 14k|1.52 1.07 1.02|1.0 2.0 2.0| 0 0 | 0 2048M| 29 356 0 70 0 May 28 12:57:48 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1061/2097] 10.27.203.238 () {64 vars in 1571 bytes} [Tue May 28 12:57:48 2024] PUT /identity/v3/projects/c9cc76ecb4e343a6a51bf36da01debf8/users/f89f851af36d480ab7d10d3506c60899/roles/44620cad10ae407c90c91e2c296adb04 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 28 12:57:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b4a89d-b5cc-4400-bf4c-81aa102f2a70 tempest-SnapshotInstancesNegativeTest-1396485679 tempest-SnapshotInstancesNegativeTest-1396485679-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-e2b4a89d-b5cc-4400-bf4c-81aa102f2a70 tempest-SnapshotInstancesNegativeTest-1396485679 tempest-SnapshotInstancesNegativeTest-1396485679-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b4a89d-b5cc-4400-bf4c-81aa102f2a70 tempest-SnapshotInstancesNegativeTest-1396485679 tempest-SnapshotInstancesNegativeTest-1396485679-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0d5c3d-8c8b-4788-ba2a-7292606d6acf service manila] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f110cf6300f049c897d0aab63218d1e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0d5c3d-8c8b-4788-ba2a-7292606d6acf service manila] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0d5c3d-8c8b-4788-ba2a-7292606d6acf service manila] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0d5c3d-8c8b-4788-ba2a-7292606d6acf service manila] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0d5c3d-8c8b-4788-ba2a-7292606d6acf service manila] RBAC: Authorizing `identity:validate_token()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0d5c3d-8c8b-4788-ba2a-7292606d6acf service manila] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:48 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1037/2098] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 12:57:48 2024] GET /identity/v3/auth/tokens => generated 4091 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 12:57:48 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-c42af9b6-0dc0-4ac7-a2eb-0c7ba36dfb16 tempest-SnapshotInstancesNegativeTest-1396485679 tempest-SnapshotInstancesNegativeTest-1396485679-project-admin] POST http://10.27.203.238/share/v2/c9cc76ecb4e343a6a51bf36da01debf8/types May 28 12:57:48 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-c42af9b6-0dc0-4ac7-a2eb-0c7ba36dfb16 tempest-SnapshotInstancesNegativeTest-1396485679 tempest-SnapshotInstancesNegativeTest-1396485679-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share_type": {"name": "tempest-typeshare-type-94274106", "extra_specs": {"driver_handles_share_servers": "False", "snapshot_support": true}, "share_type_access:is_public": true}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:57:48 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-c42af9b6-0dc0-4ac7-a2eb-0c7ba36dfb16 tempest-SnapshotInstancesNegativeTest-1396485679 tempest-SnapshotInstancesNegativeTest-1396485679-project-admin] http://10.27.203.238/share/v2/c9cc76ecb4e343a6a51bf36da01debf8/types returned with HTTP 200 May 28 12:57:48 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 399/787] 10.27.203.238 () {66 vars in 1359 bytes} [Tue May 28 12:57:48 2024] POST /share/v2/c9cc76ecb4e343a6a51bf36da01debf8/types => generated 675 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:57:48 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-c54b76c6-953a-466d-88d3-498d6f9bf52b tempest-SnapshotInstancesNegativeTest-1396485679 tempest-SnapshotInstancesNegativeTest-1396485679-project-admin] POST http://10.27.203.238/share/v2/c9cc76ecb4e343a6a51bf36da01debf8/shares May 28 12:57:48 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-c54b76c6-953a-466d-88d3-498d6f9bf52b tempest-SnapshotInstancesNegativeTest-1396485679 tempest-SnapshotInstancesNegativeTest-1396485679-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share": {"share_proto": "nfs", "description": "Tempest's share", "snapshot_id": null, "name": "tempest-tempest-created-share-776123330", "size": 1, "metadata": {}, "is_public": false, "share_type": "a7fa0024-941d-4278-af42-a90075e4eab8"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:57:48 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.v1.shares [None req-c54b76c6-953a-466d-88d3-498d6f9bf52b tempest-SnapshotInstancesNegativeTest-1396485679 tempest-SnapshotInstancesNegativeTest-1396485679-project-admin] Create NFS share of 1 GB May 28 12:57:48 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9b2a0955-73fa-4cdd-9d93-42a7023f7cc8 tempest-ShareIpRulesForNFSTest-1748669711 None] <<< [PATCH] https://127.0.0.1:40443/api/viewpolicies/21/ May 28 12:57:48 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9b2a0955-73fa-4cdd-9d93-42a7023f7cc8 tempest-ShareIpRulesForNFSTest-1748669711 None] Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=1, created='2024-05-28T12:57:40.763635Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='377955ad-d094-4e49-ab32-1021d943a572', id=21, internal=False, is_s3_default_policy=False, name='b7a7d61c-2cea-442a-9809-507038e080d5', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=['*'], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['*'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['*'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='MODIFYING', sync_time='2024-05-28T12:57:47.788959Z', tenant_id=1, tenant_name='default', title='b7a7d61c-2cea-442a-9809-507038e080d5', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/21/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[]) May 28 12:57:48 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9b2a0955-73fa-4cdd-9d93-42a7023f7cc8 tempest-ShareIpRulesForNFSTest-1748669711 None] --- [PATCH] https://127.0.0.1:40443/api/viewpolicies/21/: Done May 28 12:57:48 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-9b2a0955-73fa-4cdd-9d93-42a7023f7cc8 tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:57:48 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-9b2a0955-73fa-4cdd-9d93-42a7023f7cc8 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:57:48 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.quota [None req-c54b76c6-953a-466d-88d3-498d6f9bf52b tempest-SnapshotInstancesNegativeTest-1396485679 tempest-SnapshotInstancesNegativeTest-1396485679-project-admin] Created reservations ['bab95125-c122-414f-8a34-8ed5479295a2', '467486cf-b2a1-4d55-87de-2684b8ee1449', '1f9de2a2-4e52-46d4-a35c-da4c4c6bc3e4', 'ffe0380a-1bda-4793-aa53-7f205ba2031e'] {{(pid=98330) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 12:57:48 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.quota [None req-c54b76c6-953a-466d-88d3-498d6f9bf52b tempest-SnapshotInstancesNegativeTest-1396485679 tempest-SnapshotInstancesNegativeTest-1396485679-project-admin] Committed reservations ['bab95125-c122-414f-8a34-8ed5479295a2', '467486cf-b2a1-4d55-87de-2684b8ee1449', '1f9de2a2-4e52-46d4-a35c-da4c4c6bc3e4', 'ffe0380a-1bda-4793-aa53-7f205ba2031e'] {{(pid=98330) commit /opt/stack/manila/manila/quota.py:1063}} May 28 12:57:48 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-9b2a0955-73fa-4cdd-9d93-42a7023f7cc8 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.056s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:57:48 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-9b2a0955-73fa-4cdd-9d93-42a7023f7cc8 tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:57:48 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-9b2a0955-73fa-4cdd-9d93-42a7023f7cc8 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:57:48 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-9b2a0955-73fa-4cdd-9d93-42a7023f7cc8 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:57:48 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-9b2a0955-73fa-4cdd-9d93-42a7023f7cc8 tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:57:48 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-9b2a0955-73fa-4cdd-9d93-42a7023f7cc8 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:57:48 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-9b2a0955-73fa-4cdd-9d93-42a7023f7cc8 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:57:48 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-9b2a0955-73fa-4cdd-9d93-42a7023f7cc8 tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:57:48 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-9b2a0955-73fa-4cdd-9d93-42a7023f7cc8 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:57:48 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-9b2a0955-73fa-4cdd-9d93-42a7023f7cc8 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:57:48 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-9b2a0955-73fa-4cdd-9d93-42a7023f7cc8 tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:57:48 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-9b2a0955-73fa-4cdd-9d93-42a7023f7cc8 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:57:48 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:57:48 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:57:48 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.manager [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=83654) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10545}} May 28 12:57:48 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-9b2a0955-73fa-4cdd-9d93-42a7023f7cc8 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.037s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:57:48 l75lg1-v1 manila-share[98474]: INFO manila.share.access [None req-9b2a0955-73fa-4cdd-9d93-42a7023f7cc8 tempest-ShareIpRulesForNFSTest-1748669711 None] Access rules were successfully modified for share instance b7a7d61c-2cea-442a-9809-507038e080d5 belonging to share 1ddadc17-cf10-4a42-8bbd-8335fb3520a1. May 28 12:57:48 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.host_manager [None req-c54b76c6-953a-466d-88d3-498d6f9bf52b tempest-SnapshotInstancesNegativeTest-1396485679 None] Share service is down. (host: l75lg1-v1@generic2). May 28 12:57:48 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.host_manager [None req-c54b76c6-953a-466d-88d3-498d6f9bf52b tempest-SnapshotInstancesNegativeTest-1396485679 None] Share service is down. (host: l75lg1-v1@generic1). May 28 12:57:48 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-c54b76c6-953a-466d-88d3-498d6f9bf52b tempest-SnapshotInstancesNegativeTest-1396485679 None] Starting with 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:80}} May 28 12:57:48 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-c54b76c6-953a-466d-88d3-498d6f9bf52b tempest-SnapshotInstancesNegativeTest-1396485679 None] Filter OnlyHostFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:57:48 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-c54b76c6-953a-466d-88d3-498d6f9bf52b tempest-SnapshotInstancesNegativeTest-1396485679 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:57:48 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.capacity [None req-c54b76c6-953a-466d-88d3-498d6f9bf52b tempest-SnapshotInstancesNegativeTest-1396485679 None] Space information for share creation on host l75lg1-v1@vast#vast (requested / avail): 1/2082 {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/capacity.py:83}} May 28 12:57:48 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-c54b76c6-953a-466d-88d3-498d6f9bf52b tempest-SnapshotInstancesNegativeTest-1396485679 None] Filter CapacityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:57:48 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-c54b76c6-953a-466d-88d3-498d6f9bf52b tempest-SnapshotInstancesNegativeTest-1396485679 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:57:48 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-c54b76c6-953a-466d-88d3-498d6f9bf52b tempest-SnapshotInstancesNegativeTest-1396485679 None] Driver Filter: Checking host 'l75lg1-v1@vast#vast' {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:37}} May 28 12:57:48 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-c54b76c6-953a-466d-88d3-498d6f9bf52b tempest-SnapshotInstancesNegativeTest-1396485679 None] Filter function not set :: passing host. {{(pid=98327) _check_filter_function /opt/stack/manila/manila/scheduler/filters/driver.py:53}} May 28 12:57:48 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-c54b76c6-953a-466d-88d3-498d6f9bf52b tempest-SnapshotInstancesNegativeTest-1396485679 None] Result: True {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:40}} May 28 12:57:48 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-c54b76c6-953a-466d-88d3-498d6f9bf52b tempest-SnapshotInstancesNegativeTest-1396485679 None] Done checking host 'l75lg1-v1@vast#vast' {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:41}} May 28 12:57:48 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-c54b76c6-953a-466d-88d3-498d6f9bf52b tempest-SnapshotInstancesNegativeTest-1396485679 None] Filter DriverFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:57:48 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-c54b76c6-953a-466d-88d3-498d6f9bf52b tempest-SnapshotInstancesNegativeTest-1396485679 None] Filter ShareReplicationFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:57:48 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-c54b76c6-953a-466d-88d3-498d6f9bf52b tempest-SnapshotInstancesNegativeTest-1396485679 None] Filter CreateFromSnapshotFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:57:48 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-c54b76c6-953a-466d-88d3-498d6f9bf52b tempest-SnapshotInstancesNegativeTest-1396485679 tempest-SnapshotInstancesNegativeTest-1396485679-project-admin] http://10.27.203.238/share/v2/c9cc76ecb4e343a6a51bf36da01debf8/shares returned with HTTP 200 May 28 12:57:48 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 389/788] 10.27.203.238 () {66 vars in 1362 bytes} [Tue May 28 12:57:48 2024] POST /share/v2/c9cc76ecb4e343a6a51bf36da01debf8/shares => generated 1345 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:57:48 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-c54b76c6-953a-466d-88d3-498d6f9bf52b tempest-SnapshotInstancesNegativeTest-1396485679 None] Filter AffinityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:57:48 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-c54b76c6-953a-466d-88d3-498d6f9bf52b tempest-SnapshotInstancesNegativeTest-1396485679 None] Filter AntiAffinityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:57:48 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.drivers.filter [None req-c54b76c6-953a-466d-88d3-498d6f9bf52b tempest-SnapshotInstancesNegativeTest-1396485679 None] Filtered share [host: 'l75lg1-v1@vast#vast', free_capacity_gb: 2082.6229242384434, pools: None] {{(pid=98327) _schedule_share /opt/stack/manila/manila/scheduler/drivers/filter.py:268}} May 28 12:57:48 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-c54b76c6-953a-466d-88d3-498d6f9bf52b tempest-SnapshotInstancesNegativeTest-1396485679 None] Checking host 'l75lg1-v1@vast#vast' {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:46}} May 28 12:57:48 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.weighers.goodness [None req-c54b76c6-953a-466d-88d3-498d6f9bf52b tempest-SnapshotInstancesNegativeTest-1396485679 None] Goodness function not set :: defaulting to minimal goodness rating of 0. May 28 12:57:48 l75lg1-v1 manila-scheduler[98327]: INFO manila.scheduler.weighers.goodness [None req-c54b76c6-953a-466d-88d3-498d6f9bf52b tempest-SnapshotInstancesNegativeTest-1396485679 None] Goodness function result for host l75lg1-v1@vast#vast: 0. May 28 12:57:48 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-c54b76c6-953a-466d-88d3-498d6f9bf52b tempest-SnapshotInstancesNegativeTest-1396485679 None] Goodness: 0 {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:48}} May 28 12:57:48 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-c54b76c6-953a-466d-88d3-498d6f9bf52b tempest-SnapshotInstancesNegativeTest-1396485679 None] Done checking host 'l75lg1-v1@vast#vast' {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:49}} May 28 12:57:48 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.drivers.filter [None req-c54b76c6-953a-466d-88d3-498d6f9bf52b tempest-SnapshotInstancesNegativeTest-1396485679 None] Choosing for share: WeighedHost [host: l75lg1-v1@vast#vast, weight: 0.0] {{(pid=98327) _schedule_share /opt/stack/manila/manila/scheduler/drivers/filter.py:274}} May 28 12:57:48 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-8aa52c09-5985-47a8-bf2e-ec0c7d581482 tempest-SnapshotInstancesNegativeTest-1396485679 tempest-SnapshotInstancesNegativeTest-1396485679-project-admin] GET http://10.27.203.238/share/v2/c9cc76ecb4e343a6a51bf36da01debf8/shares/59371a98-d4b3-4967-9846-4759c0b33bb2 May 28 12:57:48 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-8aa52c09-5985-47a8-bf2e-ec0c7d581482 tempest-SnapshotInstancesNegativeTest-1396485679 tempest-SnapshotInstancesNegativeTest-1396485679-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:48 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-8aa52c09-5985-47a8-bf2e-ec0c7d581482 tempest-SnapshotInstancesNegativeTest-1396485679 tempest-SnapshotInstancesNegativeTest-1396485679-project-admin] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:48 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-8aa52c09-5985-47a8-bf2e-ec0c7d581482 tempest-SnapshotInstancesNegativeTest-1396485679 tempest-SnapshotInstancesNegativeTest-1396485679-project-admin] http://10.27.203.238/share/v2/c9cc76ecb4e343a6a51bf36da01debf8/shares/59371a98-d4b3-4967-9846-4759c0b33bb2 returned with HTTP 200 May 28 12:57:48 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 400/789] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:57:48 2024] GET /share/v2/c9cc76ecb4e343a6a51bf36da01debf8/shares/59371a98-d4b3-4967-9846-4759c0b33bb2 => generated 1345 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:57:48 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-0690c217-ae64-45e8-a696-db2c6c85942d tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] GET http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/da7ec0a1-db21-42c6-b842-6f87b3c5843d May 28 12:57:48 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-0690c217-ae64-45e8-a696-db2c6c85942d tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:48 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-0690c217-ae64-45e8-a696-db2c6c85942d tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:48 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c54b76c6-953a-466d-88d3-498d6f9bf52b tempest-SnapshotInstancesNegativeTest-1396485679 None] >>> [GET] https://127.0.0.1:40443/api/vippools/ May 28 12:57:48 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c54b76c6-953a-466d-88d3-498d6f9bf52b tempest-SnapshotInstancesNegativeTest-1396485679 None] {'allow_redirects': True, 'params': {'name': 'vippool-1'}} May 28 12:57:48 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-0690c217-ae64-45e8-a696-db2c6c85942d tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/da7ec0a1-db21-42c6-b842-6f87b3c5843d returned with HTTP 200 May 28 12:57:48 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 390/790] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:57:48 2024] GET /share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/da7ec0a1-db21-42c6-b842-6f87b3c5843d => generated 1317 bytes in 26 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:57:48 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-37101074-d3de-454e-b3ec-b21871b1042c tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] POST http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/da7ec0a1-db21-42c6-b842-6f87b3c5843d/metadata May 28 12:57:48 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-37101074-d3de-454e-b3ec-b21871b1042c tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Action: 'create_metadata', calling method: Controller.__getattribute__..version_select, body: {"metadata": {"key3": "value3", "key4": "value4", "key.5.1": "value.5"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:57:48 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-d9bbbaa2-21ce-4117-93ad-19a2a61a0b89 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] POST http://10.27.203.238/share/v1/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action May 28 12:57:48 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-d9bbbaa2-21ce-4117-93ad-19a2a61a0b89 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Action body: b'{"os-access_list": null}' {{(pid=98330) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:57:48 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-d9bbbaa2-21ce-4117-93ad-19a2a61a0b89 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Action: 'action', calling method: ShareController.access_list, body: {"os-access_list": null} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:57:48 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-37101074-d3de-454e-b3ec-b21871b1042c tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/da7ec0a1-db21-42c6-b842-6f87b3c5843d/metadata returned with HTTP 200 May 28 12:57:48 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 401/791] 10.27.203.238 () {66 vars in 1499 bytes} [Tue May 28 12:57:48 2024] POST /share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/da7ec0a1-db21-42c6-b842-6f87b3c5843d/metadata => generated 72 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:57:48 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-2c21ef5d-04e6-49b9-9f16-38c7b2daa4d3 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] GET http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/da7ec0a1-db21-42c6-b842-6f87b3c5843d/metadata/key3 May 28 12:57:48 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-2c21ef5d-04e6-49b9-9f16-38c7b2daa4d3 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:48 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-2c21ef5d-04e6-49b9-9f16-38c7b2daa4d3 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:48 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-d9bbbaa2-21ce-4117-93ad-19a2a61a0b89 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] http://10.27.203.238/share/v1/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action returned with HTTP 200 May 28 12:57:48 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 391/792] 10.27.203.238 () {64 vars in 1450 bytes} [Tue May 28 12:57:48 2024] POST /share/v1/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action => generated 160 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:57:48 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-ebc4c1d7-8988-445f-8dc5-eef00e82a23a tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] POST http://10.27.203.238/share/v1/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action May 28 12:57:48 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-ebc4c1d7-8988-445f-8dc5-eef00e82a23a tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Action body: b'{"os-deny_access": {"access_id": "a7ff3924-56d7-4e79-9f8d-b6d9603b0bd6"}}' {{(pid=98330) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:57:48 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-ebc4c1d7-8988-445f-8dc5-eef00e82a23a tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Action: 'action', calling method: ShareController.deny_access, body: {"os-deny_access": {"access_id": "a7ff3924-56d7-4e79-9f8d-b6d9603b0bd6"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:57:48 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.lock.api [None req-ebc4c1d7-8988-445f-8dc5-eef00e82a23a tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Searching for locks by: {'resource_id': 'a7ff3924-56d7-4e79-9f8d-b6d9603b0bd6', 'resource_action': 'delete'} {{(pid=98330) get_all /opt/stack/manila/manila/lock/api.py:112}} May 28 12:57:48 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-2c21ef5d-04e6-49b9-9f16-38c7b2daa4d3 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/da7ec0a1-db21-42c6-b842-6f87b3c5843d/metadata/key3 returned with HTTP 200 May 28 12:57:48 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 402/793] 10.27.203.238 () {64 vars in 1493 bytes} [Tue May 28 12:57:48 2024] GET /share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/da7ec0a1-db21-42c6-b842-6f87b3c5843d/metadata/key3 => generated 28 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:57:48 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-d763caed-0487-4288-afb8-e6336b874082 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] GET http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/da7ec0a1-db21-42c6-b842-6f87b3c5843d/metadata/key4 May 28 12:57:48 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-d763caed-0487-4288-afb8-e6336b874082 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:48 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-d763caed-0487-4288-afb8-e6336b874082 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:48 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-ebc4c1d7-8988-445f-8dc5-eef00e82a23a tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:57:48 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-ebc4c1d7-8988-445f-8dc5-eef00e82a23a tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:57:48 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-d763caed-0487-4288-afb8-e6336b874082 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/da7ec0a1-db21-42c6-b842-6f87b3c5843d/metadata/key4 returned with HTTP 200 May 28 12:57:48 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 403/794] 10.27.203.238 () {64 vars in 1493 bytes} [Tue May 28 12:57:48 2024] GET /share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/da7ec0a1-db21-42c6-b842-6f87b3c5843d/metadata/key4 => generated 28 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:57:48 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-413db9e1-162e-480d-8d8a-54b53327115a tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] GET http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/da7ec0a1-db21-42c6-b842-6f87b3c5843d/metadata/key.5.1 May 28 12:57:48 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-413db9e1-162e-480d-8d8a-54b53327115a tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:48 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-413db9e1-162e-480d-8d8a-54b53327115a tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-ebc4c1d7-8988-445f-8dc5-eef00e82a23a tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.039s {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-ebc4c1d7-8988-445f-8dc5-eef00e82a23a tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-ebc4c1d7-8988-445f-8dc5-eef00e82a23a tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-413db9e1-162e-480d-8d8a-54b53327115a tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/da7ec0a1-db21-42c6-b842-6f87b3c5843d/metadata/key.5.1 returned with HTTP 200 May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 404/795] 10.27.203.238 () {64 vars in 1502 bytes} [Tue May 28 12:57:48 2024] GET /share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/da7ec0a1-db21-42c6-b842-6f87b3c5843d/metadata/key.5.1 => generated 32 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 230 bytes (2 switches on core 0) May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-ca7c448b-32b5-45de-8ff1-b5f2be16d360 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] DELETE http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/da7ec0a1-db21-42c6-b842-6f87b3c5843d/metadata/key3 May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-ca7c448b-32b5-45de-8ff1-b5f2be16d360 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-ca7c448b-32b5-45de-8ff1-b5f2be16d360 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-ebc4c1d7-8988-445f-8dc5-eef00e82a23a tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.057s {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-ebc4c1d7-8988-445f-8dc5-eef00e82a23a tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] http://10.27.203.238/share/v1/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action returned with HTTP 202 May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 392/796] 10.27.203.238 () {64 vars in 1450 bytes} [Tue May 28 12:57:48 2024] POST /share/v1/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action => generated 0 bytes in 173 msecs (HTTP/1.1 202) 6 headers in 242 bytes (1 switches on core 0) May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-76c93adb-c379-409c-9b26-197a7d847a69 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] POST http://10.27.203.238/share/v1/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-76c93adb-c379-409c-9b26-197a7d847a69 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Action body: b'{"os-access_list": null}' {{(pid=98330) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-76c93adb-c379-409c-9b26-197a7d847a69 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Action: 'action', calling method: ShareController.access_list, body: {"os-access_list": null} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:57:49 l75lg1-v1 manila-share[98474]: DEBUG manila.share.manager [None req-ebc4c1d7-8988-445f-8dc5-eef00e82a23a tempest-ShareIpRulesForNFSTest-1748669711 None] Received request to update access for share instance b7a7d61c-2cea-442a-9809-507038e080d5. {{(pid=98474) update_access_for_instances /opt/stack/manila/manila/share/manager.py:4353}} May 28 12:57:49 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c54b76c6-953a-466d-88d3-498d6f9bf52b tempest-SnapshotInstancesNegativeTest-1396485679 None] <<< [GET] https://127.0.0.1:40443/api/vippools/ May 28 12:57:49 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c54b76c6-953a-466d-88d3-498d6f9bf52b tempest-SnapshotInstancesNegativeTest-1396485679 None] [Bunch(active_cnode_ids=[], active_interfaces=4, cluster='loop75-kfs', cluster_id=1, cnode_ids=[], cnodes=[], domain_name='vippool-1', enable_l3=False, enable_weighted_balancing=False, enabled=True, end_ip='172.21.75.4', guid='f2abaede-b397-413a-8faa-3aeead6d3b28', gw_ip='', gw_ipv6='', id=2, ip_ranges=[['172.21.75.1', '172.21.75.4']], name='vippool-1', peer_asn=0, port_membership='ALL', ranges_summary='172.21.75.[1-4]', role='PROTOCOLS', start_ip='172.21.75.1', subnet_cidr=16, subnet_cidr_ipv6=None, sync='SYNCED', sync_time='2024-05-28T12:50:09.644123Z', tenant_id=1, tenant_name='default', title='172.21.75.1 - 172.21.75.4', url='https://127.0.0.1:40443/api/vippools/2/', vast_asn=0, vlan=0, vms_preferred=False)] May 28 12:57:49 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c54b76c6-953a-466d-88d3-498d6f9bf52b tempest-SnapshotInstancesNegativeTest-1396485679 None] --- [GET] https://127.0.0.1:40443/api/vippools/: Done May 28 12:57:49 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c54b76c6-953a-466d-88d3-498d6f9bf52b tempest-SnapshotInstancesNegativeTest-1396485679 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:57:49 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c54b76c6-953a-466d-88d3-498d6f9bf52b tempest-SnapshotInstancesNegativeTest-1396485679 None] {'allow_redirects': True, May 28 12:57:49 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c54b76c6-953a-466d-88d3-498d6f9bf52b tempest-SnapshotInstancesNegativeTest-1396485679 None] 'params': {'name': '8239ccb8-483c-4129-8319-880234387fbd'}} May 28 12:57:49 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-ebc4c1d7-8988-445f-8dc5-eef00e82a23a tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:57:49 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-ebc4c1d7-8988-445f-8dc5-eef00e82a23a tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:57:49 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-ebc4c1d7-8988-445f-8dc5-eef00e82a23a tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:57:49 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-ebc4c1d7-8988-445f-8dc5-eef00e82a23a tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:57:49 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-ebc4c1d7-8988-445f-8dc5-eef00e82a23a tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-76c93adb-c379-409c-9b26-197a7d847a69 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] http://10.27.203.238/share/v1/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action returned with HTTP 200 May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 393/797] 10.27.203.238 () {64 vars in 1450 bytes} [Tue May 28 12:57:49 2024] POST /share/v1/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action => generated 157 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-ca7c448b-32b5-45de-8ff1-b5f2be16d360 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/da7ec0a1-db21-42c6-b842-6f87b3c5843d/metadata/key3 returned with HTTP 200 May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 405/798] 10.27.203.238 () {64 vars in 1496 bytes} [Tue May 28 12:57:49 2024] DELETE /share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/da7ec0a1-db21-42c6-b842-6f87b3c5843d/metadata/key3 => generated 0 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 229 bytes (2 switches on core 0) May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-077e08e1-589b-4714-af31-d4edf600890e tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] DELETE http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/da7ec0a1-db21-42c6-b842-6f87b3c5843d/metadata/key4 May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-077e08e1-589b-4714-af31-d4edf600890e tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-077e08e1-589b-4714-af31-d4edf600890e tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:49 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-ebc4c1d7-8988-445f-8dc5-eef00e82a23a tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.049s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:57:49 l75lg1-v1 manila-share[98474]: DEBUG manila.share.access [None req-ebc4c1d7-8988-445f-8dc5-eef00e82a23a tempest-ShareIpRulesForNFSTest-1748669711 None] Updating access rules for share instance b7a7d61c-2cea-442a-9809-507038e080d5 belonging to share 1ddadc17-cf10-4a42-8bbd-8335fb3520a1. {{(pid=98474) update_access_rules /opt/stack/manila/manila/share/access.py:298}} May 28 12:57:49 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-ebc4c1d7-8988-445f-8dc5-eef00e82a23a tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:57:49 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-ebc4c1d7-8988-445f-8dc5-eef00e82a23a tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:57:49 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-ebc4c1d7-8988-445f-8dc5-eef00e82a23a tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.007s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:57:49 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-ebc4c1d7-8988-445f-8dc5-eef00e82a23a tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:57:49 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-ebc4c1d7-8988-445f-8dc5-eef00e82a23a tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:57:49 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-ebc4c1d7-8988-445f-8dc5-eef00e82a23a tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.016s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:57:49 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-ebc4c1d7-8988-445f-8dc5-eef00e82a23a tempest-ShareIpRulesForNFSTest-1748669711 None] changing access on None May 28 12:57:49 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ebc4c1d7-8988-445f-8dc5-eef00e82a23a tempest-ShareIpRulesForNFSTest-1748669711 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:57:49 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ebc4c1d7-8988-445f-8dc5-eef00e82a23a tempest-ShareIpRulesForNFSTest-1748669711 None] {'allow_redirects': True, May 28 12:57:49 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ebc4c1d7-8988-445f-8dc5-eef00e82a23a tempest-ShareIpRulesForNFSTest-1748669711 None] 'params': {'name': 'b7a7d61c-2cea-442a-9809-507038e080d5'}} May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-077e08e1-589b-4714-af31-d4edf600890e tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/da7ec0a1-db21-42c6-b842-6f87b3c5843d/metadata/key4 returned with HTTP 200 May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 394/799] 10.27.203.238 () {64 vars in 1496 bytes} [Tue May 28 12:57:49 2024] DELETE /share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/da7ec0a1-db21-42c6-b842-6f87b3c5843d/metadata/key4 => generated 0 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 229 bytes (1 switches on core 0) May 28 12:57:49 l75lg1-v1 dstat.sh[49771]: 28-05 12:57:49| 15 1 80 3 0|5702M 1788M 277M 7858M| 19k 2590B| 0 6601k| 0 583 |7591 12k|1.52 1.07 1.02|1.0 2.0 0| 0 0 | 0 2048M| 29 356 0 71 0 May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-4722b684-d31d-4dfd-8737-66ae7525ad3b tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] DELETE http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/da7ec0a1-db21-42c6-b842-6f87b3c5843d/metadata/key.5.1 May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-4722b684-d31d-4dfd-8737-66ae7525ad3b tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-4722b684-d31d-4dfd-8737-66ae7525ad3b tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-4722b684-d31d-4dfd-8737-66ae7525ad3b tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/da7ec0a1-db21-42c6-b842-6f87b3c5843d/metadata/key.5.1 returned with HTTP 200 May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 406/800] 10.27.203.238 () {64 vars in 1505 bytes} [Tue May 28 12:57:49 2024] DELETE /share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/da7ec0a1-db21-42c6-b842-6f87b3c5843d/metadata/key.5.1 => generated 0 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 229 bytes (1 switches on core 0) May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-54413b56-5bbf-4f4a-8076-d6d051965c8a tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] GET http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/da7ec0a1-db21-42c6-b842-6f87b3c5843d/metadata May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-54413b56-5bbf-4f4a-8076-d6d051965c8a tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-54413b56-5bbf-4f4a-8076-d6d051965c8a tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-0321eaba-99dc-4a85-8ac1-a96c120c060e tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] GET http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/share_instances/724bc53b-1c28-4ab1-b3c8-ab90f868473d May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-0321eaba-99dc-4a85-8ac1-a96c120c060e tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-0321eaba-99dc-4a85-8ac1-a96c120c060e tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-54413b56-5bbf-4f4a-8076-d6d051965c8a tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/da7ec0a1-db21-42c6-b842-6f87b3c5843d/metadata returned with HTTP 200 May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 395/801] 10.27.203.238 () {64 vars in 1478 bytes} [Tue May 28 12:57:49 2024] GET /share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/da7ec0a1-db21-42c6-b842-6f87b3c5843d/metadata => generated 16 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-0321eaba-99dc-4a85-8ac1-a96c120c060e tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] HTTP exception thrown: The resource could not be found. May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-0321eaba-99dc-4a85-8ac1-a96c120c060e tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/share_instances/724bc53b-1c28-4ab1-b3c8-ab90f868473d returned with HTTP 404 May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 407/802] 10.27.203.238 () {64 vars in 1478 bytes} [Tue May 28 12:57:49 2024] GET /share/v2/a3499cb78849424db45e54caac01de92/share_instances/724bc53b-1c28-4ab1-b3c8-ab90f868473d => generated 78 bytes in 14 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-0c91febd-d412-4e8f-a8a2-4b3c8f041838 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] GET http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/share-replicas/detail?share_id=da7ec0a1-db21-42c6-b842-6f87b3c5843d May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-0c91febd-d412-4e8f-a8a2-4b3c8f041838 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-0c91febd-d412-4e8f-a8a2-4b3c8f041838 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-d224c120-5f6d-46a0-8c00-f68a72dfb7be tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] GET http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/shares/0e109bad-1de4-4ba0-a890-7011220b44eb May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-d224c120-5f6d-46a0-8c00-f68a72dfb7be tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-d224c120-5f6d-46a0-8c00-f68a72dfb7be tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-0c91febd-d412-4e8f-a8a2-4b3c8f041838 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/share-replicas/detail?share_id=da7ec0a1-db21-42c6-b842-6f87b3c5843d returned with HTTP 200 May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 396/803] 10.27.203.238 () {64 vars in 1476 bytes} [Tue May 28 12:57:49 2024] GET /share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/share-replicas/detail?share_id=da7ec0a1-db21-42c6-b842-6f87b3c5843d => generated 22 bytes in 13 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-d224c120-5f6d-46a0-8c00-f68a72dfb7be tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] HTTP exception thrown: The resource could not be found. May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-d224c120-5f6d-46a0-8c00-f68a72dfb7be tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/shares/0e109bad-1de4-4ba0-a890-7011220b44eb returned with HTTP 404 May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 408/804] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:57:49 2024] GET /share/v2/a3499cb78849424db45e54caac01de92/shares/0e109bad-1de4-4ba0-a890-7011220b44eb => generated 78 bytes in 13 msecs (HTTP/1.1 404) 6 headers in 237 bytes (2 switches on core 0) May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-76972c49-a34a-4521-9461-6779c9626726 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] DELETE http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/da7ec0a1-db21-42c6-b842-6f87b3c5843d May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-76972c49-a34a-4521-9461-6779c9626726 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-76972c49-a34a-4521-9461-6779c9626726 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Calling method 'ShareMixin.delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.v1.shares [None req-76972c49-a34a-4521-9461-6779c9626726 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Delete share with id: da7ec0a1-db21-42c6-b842-6f87b3c5843d May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-145e64b2-f45a-4237-b8d1-c4923a8c868f tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] GET http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/share-replicas/detail?share_id=0e109bad-1de4-4ba0-a890-7011220b44eb May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-145e64b2-f45a-4237-b8d1-c4923a8c868f tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-145e64b2-f45a-4237-b8d1-c4923a8c868f tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-145e64b2-f45a-4237-b8d1-c4923a8c868f tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/share-replicas/detail?share_id=0e109bad-1de4-4ba0-a890-7011220b44eb returned with HTTP 200 May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 409/805] 10.27.203.238 () {64 vars in 1476 bytes} [Tue May 28 12:57:49 2024] GET /share/v2/a3499cb78849424db45e54caac01de92/share-replicas/detail?share_id=0e109bad-1de4-4ba0-a890-7011220b44eb => generated 22 bytes in 13 msecs (HTTP/1.1 200) 6 headers in 230 bytes (2 switches on core 0) May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-7cf7d557-5a03-4c21-8b15-cd74fc6d3b93 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] DELETE http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/shares/0e109bad-1de4-4ba0-a890-7011220b44eb May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-7cf7d557-5a03-4c21-8b15-cd74fc6d3b93 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-7cf7d557-5a03-4c21-8b15-cd74fc6d3b93 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Calling method 'ShareMixin.delete' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.v1.shares [None req-7cf7d557-5a03-4c21-8b15-cd74fc6d3b93 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Delete share with id: 0e109bad-1de4-4ba0-a890-7011220b44eb May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-7cf7d557-5a03-4c21-8b15-cd74fc6d3b93 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] HTTP exception thrown: The resource could not be found. May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-7cf7d557-5a03-4c21-8b15-cd74fc6d3b93 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/shares/0e109bad-1de4-4ba0-a890-7011220b44eb returned with HTTP 404 May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 410/806] 10.27.203.238 () {64 vars in 1454 bytes} [Tue May 28 12:57:49 2024] DELETE /share/v2/a3499cb78849424db45e54caac01de92/shares/0e109bad-1de4-4ba0-a890-7011220b44eb => generated 78 bytes in 16 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-78b4a1ec-a791-45a2-bdd1-f66e63436eea tempest-SharesMetadataNegativeTest-1584039052 tempest-SharesMetadataNegativeTest-1584039052-project-member] GET http://10.27.203.238/share/v2/5e5bc0c8fb8b46d598b0621999301112/shares/12970599-4f96-41ce-abd8-18371bc51a8c May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-78b4a1ec-a791-45a2-bdd1-f66e63436eea tempest-SharesMetadataNegativeTest-1584039052 tempest-SharesMetadataNegativeTest-1584039052-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-78b4a1ec-a791-45a2-bdd1-f66e63436eea tempest-SharesMetadataNegativeTest-1584039052 tempest-SharesMetadataNegativeTest-1584039052-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-78b4a1ec-a791-45a2-bdd1-f66e63436eea tempest-SharesMetadataNegativeTest-1584039052 tempest-SharesMetadataNegativeTest-1584039052-project-member] http://10.27.203.238/share/v2/5e5bc0c8fb8b46d598b0621999301112/shares/12970599-4f96-41ce-abd8-18371bc51a8c returned with HTTP 200 May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 411/807] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:57:49 2024] GET /share/v2/5e5bc0c8fb8b46d598b0621999301112/shares/12970599-4f96-41ce-abd8-18371bc51a8c => generated 1317 bytes in 30 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-330cdbff-2694-43ae-b35e-04258c7a46e6 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] POST http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/snapshots May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-330cdbff-2694-43ae-b35e-04258c7a46e6 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Action: 'create', calling method: ShareSnapshotMixin.create, body: {"snapshot": {"name": "tempest-tempest-created-share-snap-1511721362", "force": false, "description": "Tempest's snapshot", "share_id": "df0ea844-5fc1-4d04-8afb-5048ec5dc33f"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.v1.share_snapshots [None req-330cdbff-2694-43ae-b35e-04258c7a46e6 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Create snapshot from share df0ea844-5fc1-4d04-8afb-5048ec5dc33f May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-76972c49-a34a-4521-9461-6779c9626726 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/da7ec0a1-db21-42c6-b842-6f87b3c5843d returned with HTTP 202 May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 397/808] 10.27.203.238 () {64 vars in 1454 bytes} [Tue May 28 12:57:49 2024] DELETE /share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/da7ec0a1-db21-42c6-b842-6f87b3c5843d => generated 0 bytes in 126 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-f53be7ba-2818-4f64-ac6c-8f02484406cc tempest-SharesMetadataNegativeTest-1584039052 tempest-SharesMetadataNegativeTest-1584039052-project-member] DELETE http://10.27.203.238/share/v2/5e5bc0c8fb8b46d598b0621999301112/shares/12970599-4f96-41ce-abd8-18371bc51a8c/metadata/wrong_key May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-f53be7ba-2818-4f64-ac6c-8f02484406cc tempest-SharesMetadataNegativeTest-1584039052 tempest-SharesMetadataNegativeTest-1584039052-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-f53be7ba-2818-4f64-ac6c-8f02484406cc tempest-SharesMetadataNegativeTest-1584039052 tempest-SharesMetadataNegativeTest-1584039052-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.quota [None req-330cdbff-2694-43ae-b35e-04258c7a46e6 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Created reservations ['92ace576-9dcc-4511-af34-9ff571321e2e', 'be1fd91c-d0f6-4444-a72f-bd536f11f062', '2d263a9c-c691-4150-9c39-a90d4f86a7d8', 'd2d85305-dda1-4351-b46a-a16d236d1595'] {{(pid=98329) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 12:57:49 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:57:49 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.manager [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Starting heal instance info cache {{(pid=83654) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}} May 28 12:57:49 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.manager [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Rebuilding the list of instances to heal {{(pid=83654) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9930}} May 28 12:57:49 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Expecting reply to msg b2e80b04be794ee1a399fc9fa8c76db2 in queue reply_37f4cbd1dd094961a22b8a65f222c327 May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault [None req-f53be7ba-2818-4f64-ac6c-8f02484406cc tempest-SharesMetadataNegativeTest-1584039052 tempest-SharesMetadataNegativeTest-1584039052-project-member] Caught error: Metadata item is not found.: manila.exception.MetadataItemNotFound: Metadata item is not found. May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault Traceback (most recent call last): May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/db/sqlalchemy/api.py", line 4262, in share_metadata_get_item May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault row = _share_metadata_get_item(context, share_id, key) May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/db/sqlalchemy/api.py", line 4337, in _share_metadata_get_item May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault raise exception.MetadataItemNotFound() May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault manila.exception.MetadataItemNotFound: Metadata item is not found. May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault During handling of the above exception, another exception occurred: May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault Traceback (most recent call last): May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/api/middleware/fault.py", line 76, in __call__ May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return req.get_response(self.application) May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/request.py", line 1313, in send May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault status, headers, app_iter = self.call_application( May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/request.py", line 1278, in call_application May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault app_iter = application(self.environ, start_response) May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 129, in __call__ May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault resp = self.call_func(req, *args, **kw) May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 193, in call_func May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return self.func(req, *args, **kwargs) May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_middleware/base.py", line 124, in __call__ May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault response = req.get_response(self.application) May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/request.py", line 1313, in send May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault status, headers, app_iter = self.call_application( May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/request.py", line 1278, in call_application May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault app_iter = application(self.environ, start_response) May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 143, in __call__ May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return resp(environ, start_response) May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 129, in __call__ May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault resp = self.call_func(req, *args, **kw) May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 193, in call_func May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return self.func(req, *args, **kwargs) May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/osprofiler/web.py", line 111, in __call__ May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return request.get_response(self.application) May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/request.py", line 1313, in send May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault status, headers, app_iter = self.call_application( May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/request.py", line 1278, in call_application May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault app_iter = application(self.environ, start_response) May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 129, in __call__ May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault resp = self.call_func(req, *args, **kw) May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 193, in call_func May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return self.func(req, *args, **kwargs) May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py", line 340, in __call__ May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault response = req.get_response(self._app) May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/request.py", line 1313, in send May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault status, headers, app_iter = self.call_application( May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/request.py", line 1278, in call_application May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault app_iter = application(self.environ, start_response) May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 143, in __call__ May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return resp(environ, start_response) May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 143, in __call__ May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return resp(environ, start_response) May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/routes/middleware.py", line 153, in __call__ May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault response = self.app(environ, start_response) May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 143, in __call__ May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return resp(environ, start_response) May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 129, in __call__ May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault resp = self.call_func(req, *args, **kw) May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 193, in call_func May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return self.func(req, *args, **kwargs) May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/api/openstack/wsgi.py", line 764, in __call__ May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return self._process_stack(request, action, action_args, May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/api/openstack/wsgi.py", line 829, in _process_stack May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault action_result = self.dispatch(meth, request, action_args) May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/api/openstack/wsgi.py", line 924, in dispatch May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return method(req=request, **action_args) May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/api/openstack/wsgi.py", line 1066, in version_select May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return func.func(self, *args, **kwargs) May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/api/openstack/wsgi.py", line 1160, in wrapper May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return f(self, req, *args, **kwargs) May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/api/v2/shares.py", line 711, in delete_metadata May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return self._delete_metadata(req, resource_id, key) May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/api/v2/metadata.py", line 241, in _delete_metadata May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault get_metadata_item_method(context, resource_id, key) May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/db/api.py", line 936, in share_metadata_get_item May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return IMPL.share_metadata_get_item(context, share_id, key) May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/db/sqlalchemy/api.py", line 166, in wrapper May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return f(*args, **kwargs) May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/db/sqlalchemy/api.py", line 179, in wrapper May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return f(context, share_id, *args, **kwargs) May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/enginefacade.py", line 998, in wrapper May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return fn(*args, **kwargs) May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/db/sqlalchemy/api.py", line 4264, in share_metadata_get_item May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault raise exception.MetadataItemNotFound() May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault manila.exception.MetadataItemNotFound: Metadata item is not found. May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.middleware.fault [None req-f53be7ba-2818-4f64-ac6c-8f02484406cc tempest-SharesMetadataNegativeTest-1584039052 tempest-SharesMetadataNegativeTest-1584039052-project-member] http://10.27.203.238/share/v2/5e5bc0c8fb8b46d598b0621999301112/shares/12970599-4f96-41ce-abd8-18371bc51a8c/metadata/wrong_key returned with HTTP 404 May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 398/809] 10.27.203.238 () {64 vars in 1511 bytes} [Tue May 28 12:57:49 2024] DELETE /share/v2/5e5bc0c8fb8b46d598b0621999301112/shares/12970599-4f96-41ce-abd8-18371bc51a8c/metadata/wrong_key => generated 95 bytes in 54 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-3147a300-ef89-4daa-b736-a2e06e0bf578 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] GET http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/da7ec0a1-db21-42c6-b842-6f87b3c5843d May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-3147a300-ef89-4daa-b736-a2e06e0bf578 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-3147a300-ef89-4daa-b736-a2e06e0bf578 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:49 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [-] Received RPC response for msg b2e80b04be794ee1a399fc9fa8c76db2 May 28 12:57:49 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-76972c49-a34a-4521-9461-6779c9626726 tempest-SharesMetadataTest-1561320255 None] Acquiring lock "locked_access_rules_operation_by_share_instance_5cf89605-2e7d-4ecc-9c44-5e6f5ecb0cad" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:57:49 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-76972c49-a34a-4521-9461-6779c9626726 tempest-SharesMetadataTest-1561320255 None] Lock "locked_access_rules_operation_by_share_instance_5cf89605-2e7d-4ecc-9c44-5e6f5ecb0cad" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:57:49 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-76972c49-a34a-4521-9461-6779c9626726 tempest-SharesMetadataTest-1561320255 None] Lock "locked_access_rules_operation_by_share_instance_5cf89605-2e7d-4ecc-9c44-5e6f5ecb0cad" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:57:49 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-76972c49-a34a-4521-9461-6779c9626726 tempest-SharesMetadataTest-1561320255 None] Acquiring lock "locked_access_rules_operation_by_share_instance_5cf89605-2e7d-4ecc-9c44-5e6f5ecb0cad" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:57:49 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-76972c49-a34a-4521-9461-6779c9626726 tempest-SharesMetadataTest-1561320255 None] Lock "locked_access_rules_operation_by_share_instance_5cf89605-2e7d-4ecc-9c44-5e6f5ecb0cad" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:57:49 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-76972c49-a34a-4521-9461-6779c9626726 tempest-SharesMetadataTest-1561320255 None] Lock "locked_access_rules_operation_by_share_instance_5cf89605-2e7d-4ecc-9c44-5e6f5ecb0cad" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:57:49 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-76972c49-a34a-4521-9461-6779c9626726 tempest-SharesMetadataTest-1561320255 None] Acquiring lock "locked_access_rules_operation_by_share_instance_5cf89605-2e7d-4ecc-9c44-5e6f5ecb0cad" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:57:49 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-76972c49-a34a-4521-9461-6779c9626726 tempest-SharesMetadataTest-1561320255 None] Lock "locked_access_rules_operation_by_share_instance_5cf89605-2e7d-4ecc-9c44-5e6f5ecb0cad" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:57:49 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-76972c49-a34a-4521-9461-6779c9626726 tempest-SharesMetadataTest-1561320255 None] Lock "locked_access_rules_operation_by_share_instance_5cf89605-2e7d-4ecc-9c44-5e6f5ecb0cad" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:57:49 l75lg1-v1 manila-share[98474]: DEBUG manila.share.access [None req-76972c49-a34a-4521-9461-6779c9626726 tempest-SharesMetadataTest-1561320255 None] All access rules have been synced for share instance 5cf89605-2e7d-4ecc-9c44-5e6f5ecb0cad belonging to share da7ec0a1-db21-42c6-b842-6f87b3c5843d. {{(pid=98474) update_access_rules /opt/stack/manila/manila/share/access.py:304}} May 28 12:57:49 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-76972c49-a34a-4521-9461-6779c9626726 tempest-SharesMetadataTest-1561320255 None] deleting '/manila/manila-5cf89605-2e7d-4ecc-9c44-5e6f5ecb0cad' May 28 12:57:49 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-76972c49-a34a-4521-9461-6779c9626726 tempest-SharesMetadataTest-1561320255 None] >>> [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/ May 28 12:57:49 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-76972c49-a34a-4521-9461-6779c9626726 tempest-SharesMetadataTest-1561320255 None] {'data': '{"path": "/manila/manila-5cf89605-2e7d-4ecc-9c44-5e6f5ecb0cad"}', May 28 12:57:49 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-76972c49-a34a-4521-9461-6779c9626726 tempest-SharesMetadataTest-1561320255 None] 'params': None} May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-3147a300-ef89-4daa-b736-a2e06e0bf578 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/da7ec0a1-db21-42c6-b842-6f87b3c5843d returned with HTTP 200 May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 399/810] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:57:49 2024] GET /share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/da7ec0a1-db21-42c6-b842-6f87b3c5843d => generated 1316 bytes in 30 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-7fe643cd-d53a-439b-8358-852a6af63173 tempest-SharesMetadataNegativeTest-1584039052 tempest-SharesMetadataNegativeTest-1584039052-project-member] POST http://10.27.203.238/share/v2/5e5bc0c8fb8b46d598b0621999301112/shares/12970599-4f96-41ce-abd8-18371bc51a8c/metadata May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-7fe643cd-d53a-439b-8358-852a6af63173 tempest-SharesMetadataNegativeTest-1584039052 tempest-SharesMetadataNegativeTest-1584039052-project-member] Action: 'create_metadata', calling method: Controller.__getattribute__..version_select, body: {"metadata": {"": "value"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98330]: WARNING manila.api.common [None req-7fe643cd-d53a-439b-8358-852a6af63173 tempest-SharesMetadataNegativeTest-1584039052 tempest-SharesMetadataNegativeTest-1584039052-project-member] Metadata property key is blank. May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-7fe643cd-d53a-439b-8358-852a6af63173 tempest-SharesMetadataNegativeTest-1584039052 tempest-SharesMetadataNegativeTest-1584039052-project-member] HTTP exception thrown: Metadata property key is blank. May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-7fe643cd-d53a-439b-8358-852a6af63173 tempest-SharesMetadataNegativeTest-1584039052 tempest-SharesMetadataNegativeTest-1584039052-project-member] http://10.27.203.238/share/v2/5e5bc0c8fb8b46d598b0621999301112/shares/12970599-4f96-41ce-abd8-18371bc51a8c/metadata returned with HTTP 400 May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 400/811] 10.27.203.238 () {66 vars in 1499 bytes} [Tue May 28 12:57:49 2024] POST /share/v2/5e5bc0c8fb8b46d598b0621999301112/shares/12970599-4f96-41ce-abd8-18371bc51a8c/metadata => generated 75 bytes in 29 msecs (HTTP/1.1 400) 6 headers in 239 bytes (1 switches on core 0) May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-ba10fb4b-e737-468c-9eb1-07a990e075e8 tempest-SharesMetadataNegativeTest-1584039052 tempest-SharesMetadataNegativeTest-1584039052-project-member] POST http://10.27.203.238/share/v2/5e5bc0c8fb8b46d598b0621999301112/shares/12970599-4f96-41ce-abd8-18371bc51a8c/metadata May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-ba10fb4b-e737-468c-9eb1-07a990e075e8 tempest-SharesMetadataNegativeTest-1584039052 tempest-SharesMetadataNegativeTest-1584039052-project-member] Action: 'create_metadata', calling method: Controller.__getattribute__..version_select, body: {"metadata": {"xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx": "value"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.quota [None req-330cdbff-2694-43ae-b35e-04258c7a46e6 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Committed reservations ['92ace576-9dcc-4511-af34-9ff571321e2e', 'be1fd91c-d0f6-4444-a72f-bd536f11f062', '2d263a9c-c691-4150-9c39-a90d4f86a7d8', 'd2d85305-dda1-4351-b46a-a16d236d1595'] {{(pid=98329) commit /opt/stack/manila/manila/quota.py:1063}} May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-330cdbff-2694-43ae-b35e-04258c7a46e6 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/snapshots returned with HTTP 202 May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 412/812] 10.27.203.238 () {66 vars in 1371 bytes} [Tue May 28 12:57:49 2024] POST /share/v2/a3499cb78849424db45e54caac01de92/snapshots => generated 750 bytes in 201 msecs (HTTP/1.1 202) 6 headers in 237 bytes (1 switches on core 0) May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-7ab9b51e-6985-48ca-aff1-081b0f63479e tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] GET http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/snapshots/000474a6-de71-40da-a1b3-815af4e9bcdf May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-7ab9b51e-6985-48ca-aff1-081b0f63479e tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-7ab9b51e-6985-48ca-aff1-081b0f63479e tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Calling method 'ShareSnapshotMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98330]: WARNING manila.api.common [None req-ba10fb4b-e737-468c-9eb1-07a990e075e8 tempest-SharesMetadataNegativeTest-1584039052 tempest-SharesMetadataNegativeTest-1584039052-project-member] Metadata property key is greater than 255 characters. May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-ba10fb4b-e737-468c-9eb1-07a990e075e8 tempest-SharesMetadataNegativeTest-1584039052 tempest-SharesMetadataNegativeTest-1584039052-project-member] HTTP exception thrown: Metadata property key is greater than 255 characters. May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-ba10fb4b-e737-468c-9eb1-07a990e075e8 tempest-SharesMetadataNegativeTest-1584039052 tempest-SharesMetadataNegativeTest-1584039052-project-member] http://10.27.203.238/share/v2/5e5bc0c8fb8b46d598b0621999301112/shares/12970599-4f96-41ce-abd8-18371bc51a8c/metadata returned with HTTP 400 May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 401/813] 10.27.203.238 () {66 vars in 1500 bytes} [Tue May 28 12:57:49 2024] POST /share/v2/5e5bc0c8fb8b46d598b0621999301112/shares/12970599-4f96-41ce-abd8-18371bc51a8c/metadata => generated 97 bytes in 34 msecs (HTTP/1.1 400) 6 headers in 239 bytes (2 switches on core 0) May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-485b2d72-4218-4dc0-bcbd-5c35c761f860 tempest-SharesMetadataNegativeTest-1584039052 tempest-SharesMetadataNegativeTest-1584039052-project-member] POST http://10.27.203.238/share/v2/5e5bc0c8fb8b46d598b0621999301112/shares/12970599-4f96-41ce-abd8-18371bc51a8c/metadata May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-485b2d72-4218-4dc0-bcbd-5c35c761f860 tempest-SharesMetadataNegativeTest-1584039052 tempest-SharesMetadataNegativeTest-1584039052-project-member] Action: 'create_metadata', calling method: Controller.__getattribute__..version_select, body: {"metadata": {"key": "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:57:49 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-76972c49-a34a-4521-9461-6779c9626726 tempest-SharesMetadataTest-1561320255 None] <<< [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/ May 28 12:57:49 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-76972c49-a34a-4521-9461-6779c9626726 tempest-SharesMetadataTest-1561320255 None] 'OK' May 28 12:57:49 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-76972c49-a34a-4521-9461-6779c9626726 tempest-SharesMetadataTest-1561320255 None] --- [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/: Done May 28 12:57:49 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-76972c49-a34a-4521-9461-6779c9626726 tempest-SharesMetadataTest-1561320255 None] >>> [GET] https://127.0.0.1:40443/api/views/ May 28 12:57:49 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-76972c49-a34a-4521-9461-6779c9626726 tempest-SharesMetadataTest-1561320255 None] {'allow_redirects': True, May 28 12:57:49 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-76972c49-a34a-4521-9461-6779c9626726 tempest-SharesMetadataTest-1561320255 None] 'params': {'name': '5cf89605-2e7d-4ecc-9c44-5e6f5ecb0cad'}} May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-7ab9b51e-6985-48ca-aff1-081b0f63479e tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/snapshots/000474a6-de71-40da-a1b3-815af4e9bcdf returned with HTTP 200 May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 413/814] 10.27.203.238 () {64 vars in 1460 bytes} [Tue May 28 12:57:49 2024] GET /share/v2/a3499cb78849424db45e54caac01de92/snapshots/000474a6-de71-40da-a1b3-815af4e9bcdf => generated 750 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 231 bytes (2 switches on core 0) May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98330]: WARNING manila.api.common [None req-485b2d72-4218-4dc0-bcbd-5c35c761f860 tempest-SharesMetadataNegativeTest-1584039052 tempest-SharesMetadataNegativeTest-1584039052-project-member] Metadata property value is greater than 1023 characters. May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-485b2d72-4218-4dc0-bcbd-5c35c761f860 tempest-SharesMetadataNegativeTest-1584039052 tempest-SharesMetadataNegativeTest-1584039052-project-member] HTTP exception thrown: Metadata property value is greater than 1023 characters. May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-485b2d72-4218-4dc0-bcbd-5c35c761f860 tempest-SharesMetadataNegativeTest-1584039052 tempest-SharesMetadataNegativeTest-1584039052-project-member] http://10.27.203.238/share/v2/5e5bc0c8fb8b46d598b0621999301112/shares/12970599-4f96-41ce-abd8-18371bc51a8c/metadata returned with HTTP 400 May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 402/815] 10.27.203.238 () {66 vars in 1501 bytes} [Tue May 28 12:57:49 2024] POST /share/v2/5e5bc0c8fb8b46d598b0621999301112/shares/12970599-4f96-41ce-abd8-18371bc51a8c/metadata => generated 100 bytes in 30 msecs (HTTP/1.1 400) 6 headers in 240 bytes (1 switches on core 0) May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-2a8ddd7a-e23b-49ff-9a25-fb1a24634cf1 tempest-SharesMetadataNegativeTest-1584039052 tempest-SharesMetadataNegativeTest-1584039052-project-member] PUT http://10.27.203.238/share/v2/5e5bc0c8fb8b46d598b0621999301112/shares/12970599-4f96-41ce-abd8-18371bc51a8c/metadata May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-2a8ddd7a-e23b-49ff-9a25-fb1a24634cf1 tempest-SharesMetadataNegativeTest-1584039052 tempest-SharesMetadataNegativeTest-1584039052-project-member] Action: 'update_all_metadata', calling method: Controller.__getattribute__..version_select, body: {"metadata": {"": "value"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:57:49 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-330cdbff-2694-43ae-b35e-04258c7a46e6 tempest-AdminActionsTest-1749172189 None] >>> [POST] https://127.0.0.1:40443/api/snapshots/ May 28 12:57:49 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-330cdbff-2694-43ae-b35e-04258c7a46e6 tempest-AdminActionsTest-1749172189 None] {'data': '{"path": "/manila/manila-77a25e6b-f137-4342-8eb9-9ced679515e2", ' May 28 12:57:49 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-330cdbff-2694-43ae-b35e-04258c7a46e6 tempest-AdminActionsTest-1749172189 None] '"name": "share-snapshot-f95edc7c-3c58-461a-bfc2-ac81b390a0ac"}', May 28 12:57:49 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-330cdbff-2694-43ae-b35e-04258c7a46e6 tempest-AdminActionsTest-1749172189 None] 'json': None, May 28 12:57:49 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-330cdbff-2694-43ae-b35e-04258c7a46e6 tempest-AdminActionsTest-1749172189 None] 'params': None} May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98329]: WARNING manila.api.common [None req-2a8ddd7a-e23b-49ff-9a25-fb1a24634cf1 tempest-SharesMetadataNegativeTest-1584039052 tempest-SharesMetadataNegativeTest-1584039052-project-member] Metadata property key is blank. May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-2a8ddd7a-e23b-49ff-9a25-fb1a24634cf1 tempest-SharesMetadataNegativeTest-1584039052 tempest-SharesMetadataNegativeTest-1584039052-project-member] HTTP exception thrown: Metadata property key is blank. May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-2a8ddd7a-e23b-49ff-9a25-fb1a24634cf1 tempest-SharesMetadataNegativeTest-1584039052 tempest-SharesMetadataNegativeTest-1584039052-project-member] http://10.27.203.238/share/v2/5e5bc0c8fb8b46d598b0621999301112/shares/12970599-4f96-41ce-abd8-18371bc51a8c/metadata returned with HTTP 400 May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 414/816] 10.27.203.238 () {66 vars in 1498 bytes} [Tue May 28 12:57:49 2024] PUT /share/v2/5e5bc0c8fb8b46d598b0621999301112/shares/12970599-4f96-41ce-abd8-18371bc51a8c/metadata => generated 75 bytes in 35 msecs (HTTP/1.1 400) 6 headers in 239 bytes (1 switches on core 0) May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-b926558d-5ed8-460b-9ad3-3261d4ef935a tempest-SharesMetadataNegativeTest-1584039052 tempest-SharesMetadataNegativeTest-1584039052-project-member] PUT http://10.27.203.238/share/v2/5e5bc0c8fb8b46d598b0621999301112/shares/12970599-4f96-41ce-abd8-18371bc51a8c/metadata May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-b926558d-5ed8-460b-9ad3-3261d4ef935a tempest-SharesMetadataNegativeTest-1584039052 tempest-SharesMetadataNegativeTest-1584039052-project-member] Action: 'update_all_metadata', calling method: Controller.__getattribute__..version_select, body: {"metadata": {"xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx": "value"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98330]: WARNING manila.api.common [None req-b926558d-5ed8-460b-9ad3-3261d4ef935a tempest-SharesMetadataNegativeTest-1584039052 tempest-SharesMetadataNegativeTest-1584039052-project-member] Metadata property key is greater than 255 characters. May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-b926558d-5ed8-460b-9ad3-3261d4ef935a tempest-SharesMetadataNegativeTest-1584039052 tempest-SharesMetadataNegativeTest-1584039052-project-member] HTTP exception thrown: Metadata property key is greater than 255 characters. May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-b926558d-5ed8-460b-9ad3-3261d4ef935a tempest-SharesMetadataNegativeTest-1584039052 tempest-SharesMetadataNegativeTest-1584039052-project-member] http://10.27.203.238/share/v2/5e5bc0c8fb8b46d598b0621999301112/shares/12970599-4f96-41ce-abd8-18371bc51a8c/metadata returned with HTTP 400 May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 403/817] 10.27.203.238 () {66 vars in 1499 bytes} [Tue May 28 12:57:49 2024] PUT /share/v2/5e5bc0c8fb8b46d598b0621999301112/shares/12970599-4f96-41ce-abd8-18371bc51a8c/metadata => generated 97 bytes in 29 msecs (HTTP/1.1 400) 6 headers in 239 bytes (1 switches on core 0) May 28 12:57:49 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ebc4c1d7-8988-445f-8dc5-eef00e82a23a tempest-ShareIpRulesForNFSTest-1748669711 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:57:49 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ebc4c1d7-8988-445f-8dc5-eef00e82a23a tempest-ShareIpRulesForNFSTest-1748669711 None] [Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=1, created='2024-05-28T12:57:40.763635Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='377955ad-d094-4e49-ab32-1021d943a572', id=21, internal=False, is_s3_default_policy=False, name='b7a7d61c-2cea-442a-9809-507038e080d5', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=['*'], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['*'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['*'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T12:57:48.319591Z', tenant_id=1, tenant_name='default', title='b7a7d61c-2cea-442a-9809-507038e080d5', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/21/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[])] May 28 12:57:49 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ebc4c1d7-8988-445f-8dc5-eef00e82a23a tempest-ShareIpRulesForNFSTest-1748669711 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 12:57:49 l75lg1-v1 manila-share[98474]: ERROR manila.share.drivers.vastdata [None req-ebc4c1d7-8988-445f-8dc5-eef00e82a23a tempest-ShareIpRulesForNFSTest-1748669711 None] failed to resolve host '203.0.113.108/30': [Errno -2] Name or service not known (ignoring): socket.gaierror: [Errno -2] Name or service not known May 28 12:57:49 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-ebc4c1d7-8988-445f-8dc5-eef00e82a23a tempest-ShareIpRulesForNFSTest-1748669711 None] changing access on /manila/manila-b7a7d61c-2cea-442a-9809-507038e080d5. Rules: {'nfs_read_write': ['*'], 'nfs_read_only': []} May 28 12:57:49 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ebc4c1d7-8988-445f-8dc5-eef00e82a23a tempest-ShareIpRulesForNFSTest-1748669711 None] >>> [PATCH] https://127.0.0.1:40443/api/viewpolicies/21/ May 28 12:57:49 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ebc4c1d7-8988-445f-8dc5-eef00e82a23a tempest-ShareIpRulesForNFSTest-1748669711 None] {'data': '{"name": "b7a7d61c-2cea-442a-9809-507038e080d5", "nfs_no_squash": ' May 28 12:57:49 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ebc4c1d7-8988-445f-8dc5-eef00e82a23a tempest-ShareIpRulesForNFSTest-1748669711 None] '["*"], "nfs_root_squash": ["*"], "nfs_read_write": ["*"], ' May 28 12:57:49 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ebc4c1d7-8988-445f-8dc5-eef00e82a23a tempest-ShareIpRulesForNFSTest-1748669711 None] '"nfs_read_only": []}', May 28 12:57:49 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ebc4c1d7-8988-445f-8dc5-eef00e82a23a tempest-ShareIpRulesForNFSTest-1748669711 None] 'params': None} May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-287d14bc-b8b5-4d69-b5fd-e4ea518a7f39 tempest-SharesMetadataNegativeTest-1584039052 tempest-SharesMetadataNegativeTest-1584039052-project-member] PUT http://10.27.203.238/share/v2/5e5bc0c8fb8b46d598b0621999301112/shares/12970599-4f96-41ce-abd8-18371bc51a8c/metadata May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-287d14bc-b8b5-4d69-b5fd-e4ea518a7f39 tempest-SharesMetadataNegativeTest-1584039052 tempest-SharesMetadataNegativeTest-1584039052-project-member] Action: 'update_all_metadata', calling method: Controller.__getattribute__..version_select, body: {"metadata": {"key": "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98329]: WARNING manila.api.common [None req-287d14bc-b8b5-4d69-b5fd-e4ea518a7f39 tempest-SharesMetadataNegativeTest-1584039052 tempest-SharesMetadataNegativeTest-1584039052-project-member] Metadata property value is greater than 1023 characters. May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-287d14bc-b8b5-4d69-b5fd-e4ea518a7f39 tempest-SharesMetadataNegativeTest-1584039052 tempest-SharesMetadataNegativeTest-1584039052-project-member] HTTP exception thrown: Metadata property value is greater than 1023 characters. May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-287d14bc-b8b5-4d69-b5fd-e4ea518a7f39 tempest-SharesMetadataNegativeTest-1584039052 tempest-SharesMetadataNegativeTest-1584039052-project-member] http://10.27.203.238/share/v2/5e5bc0c8fb8b46d598b0621999301112/shares/12970599-4f96-41ce-abd8-18371bc51a8c/metadata returned with HTTP 400 May 28 12:57:49 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 415/818] 10.27.203.238 () {66 vars in 1500 bytes} [Tue May 28 12:57:49 2024] PUT /share/v2/5e5bc0c8fb8b46d598b0621999301112/shares/12970599-4f96-41ce-abd8-18371bc51a8c/metadata => generated 100 bytes in 31 msecs (HTTP/1.1 400) 6 headers in 240 bytes (1 switches on core 0) May 28 12:57:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b0b6df-b968-496b-a346-8569dc413e07 tempest-SnapshotInstancesNegativeTest-1396485679 tempest-SnapshotInstancesNegativeTest-1396485679-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-f5b0b6df-b968-496b-a346-8569dc413e07 tempest-SnapshotInstancesNegativeTest-1396485679 tempest-SnapshotInstancesNegativeTest-1396485679-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b0b6df-b968-496b-a346-8569dc413e07 tempest-SnapshotInstancesNegativeTest-1396485679 tempest-SnapshotInstancesNegativeTest-1396485679-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83a593f-d717-418f-8252-0ce19c680846 tempest-SharesMetadataNegativeTest-1095932064 tempest-SharesMetadataNegativeTest-1095932064-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f163ab6cac34b77945bc27e1a5c66ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efc051b5756f4b69ba8d639efab8d102', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83a593f-d717-418f-8252-0ce19c680846 tempest-SharesMetadataNegativeTest-1095932064 tempest-SharesMetadataNegativeTest-1095932064-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83a593f-d717-418f-8252-0ce19c680846 tempest-SharesMetadataNegativeTest-1095932064 tempest-SharesMetadataNegativeTest-1095932064-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83a593f-d717-418f-8252-0ce19c680846 tempest-SharesMetadataNegativeTest-1095932064 tempest-SharesMetadataNegativeTest-1095932064-project-admin] PATH_INFO: `/v3/users/14783f4fbce14880b4db4a628827607e` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:49 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c54b76c6-953a-466d-88d3-498d6f9bf52b tempest-SnapshotInstancesNegativeTest-1396485679 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:57:49 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c54b76c6-953a-466d-88d3-498d6f9bf52b tempest-SnapshotInstancesNegativeTest-1396485679 None] [] May 28 12:57:49 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c54b76c6-953a-466d-88d3-498d6f9bf52b tempest-SnapshotInstancesNegativeTest-1396485679 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 12:57:49 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c54b76c6-953a-466d-88d3-498d6f9bf52b tempest-SnapshotInstancesNegativeTest-1396485679 None] >>> [POST] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:57:49 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c54b76c6-953a-466d-88d3-498d6f9bf52b tempest-SnapshotInstancesNegativeTest-1396485679 None] {'data': '{"name": "8239ccb8-483c-4129-8319-880234387fbd"}', May 28 12:57:49 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c54b76c6-953a-466d-88d3-498d6f9bf52b tempest-SnapshotInstancesNegativeTest-1396485679 None] 'json': None, May 28 12:57:49 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c54b76c6-953a-466d-88d3-498d6f9bf52b tempest-SnapshotInstancesNegativeTest-1396485679 None] 'params': None} May 28 12:57:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83a593f-d717-418f-8252-0ce19c680846 tempest-SharesMetadataNegativeTest-1095932064 tempest-SharesMetadataNegativeTest-1095932064-project-admin] RBAC: Authorizing `identity:delete_user(user_id=14783f4fbce14880b4db4a628827607e)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83a593f-d717-418f-8252-0ce19c680846 tempest-SharesMetadataNegativeTest-1095932064 tempest-SharesMetadataNegativeTest-1095932064-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:49 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-c83a593f-d717-418f-8252-0ce19c680846 tempest-SharesMetadataNegativeTest-1095932064 tempest-SharesMetadataNegativeTest-1095932064-project-admin] Could not find user: 14783f4fbce14880b4db4a628827607e.: keystone.exception.UserNotFound: Could not find user: 14783f4fbce14880b4db4a628827607e. May 28 12:57:49 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:57:49 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:57:49 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:57:49 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:57:49 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:57:49 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:57:49 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:57:49 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:57:49 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:57:49 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:57:49 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:57:49 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 12:57:49 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 12:57:49 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:57:49 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:57:49 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 12:57:49 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:57:49 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 12:57:49 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:57:49 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 12:57:49 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 12:57:49 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:57:49 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:57:49 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 12:57:49 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:57:49 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 12:57:49 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:57:49 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:57:49 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:57:49 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:57:49 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:57:49 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:57:49 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 12:57:49 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:57:49 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 12:57:49 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:57:49 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:57:49 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:57:49 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 12:57:49 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:57:49 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 12:57:49 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 12:57:49 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 12:57:49 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 12:57:49 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 12:57:49 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 12:57:49 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 12:57:49 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 14783f4fbce14880b4db4a628827607e. May 28 12:57:49 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 12:57:49 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1062/2099] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 12:57:49 2024] DELETE /identity/v3/users/14783f4fbce14880b4db4a628827607e => generated 110 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 12:57:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0d5c3d-8c8b-4788-ba2a-7292606d6acf service manila] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0d5c3d-8c8b-4788-ba2a-7292606d6acf service manila] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a11e3b-770c-4c99-a993-80e9399dd48f tempest-SharesMetadataNegativeTest-1095932064 tempest-SharesMetadataNegativeTest-1095932064-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f163ab6cac34b77945bc27e1a5c66ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efc051b5756f4b69ba8d639efab8d102', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a11e3b-770c-4c99-a993-80e9399dd48f tempest-SharesMetadataNegativeTest-1095932064 tempest-SharesMetadataNegativeTest-1095932064-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a11e3b-770c-4c99-a993-80e9399dd48f tempest-SharesMetadataNegativeTest-1095932064 tempest-SharesMetadataNegativeTest-1095932064-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a11e3b-770c-4c99-a993-80e9399dd48f tempest-SharesMetadataNegativeTest-1095932064 tempest-SharesMetadataNegativeTest-1095932064-project-admin] PATH_INFO: `/v3/users/9eca355145fd413390b5efe7a0d95465` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a11e3b-770c-4c99-a993-80e9399dd48f tempest-SharesMetadataNegativeTest-1095932064 tempest-SharesMetadataNegativeTest-1095932064-project-admin] RBAC: Authorizing `identity:delete_user(user_id=9eca355145fd413390b5efe7a0d95465)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a11e3b-770c-4c99-a993-80e9399dd48f tempest-SharesMetadataNegativeTest-1095932064 tempest-SharesMetadataNegativeTest-1095932064-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:49 l75lg1-v1 nova-conductor[83648]: DEBUG dbcounter [-] [83648] Writing DB stats nova_cell1:SELECT=3 {{(pid=83648) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:57:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-a9a11e3b-770c-4c99-a993-80e9399dd48f tempest-SharesMetadataNegativeTest-1095932064 tempest-SharesMetadataNegativeTest-1095932064-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9eca355145fd413390b5efe7a0d95465', 'request_id': 'req-a9a11e3b-770c-4c99-a993-80e9399dd48f'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-a9a11e3b-770c-4c99-a993-80e9399dd48f tempest-SharesMetadataNegativeTest-1095932064 tempest-SharesMetadataNegativeTest-1095932064-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9eca355145fd413390b5efe7a0d95465', 'request_id': 'req-a9a11e3b-770c-4c99-a993-80e9399dd48f'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-a9a11e3b-770c-4c99-a993-80e9399dd48f tempest-SharesMetadataNegativeTest-1095932064 tempest-SharesMetadataNegativeTest-1095932064-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9eca355145fd413390b5efe7a0d95465', 'request_id': 'req-a9a11e3b-770c-4c99-a993-80e9399dd48f'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-a9a11e3b-770c-4c99-a993-80e9399dd48f tempest-SharesMetadataNegativeTest-1095932064 tempest-SharesMetadataNegativeTest-1095932064-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9eca355145fd413390b5efe7a0d95465', 'request_id': 'req-a9a11e3b-770c-4c99-a993-80e9399dd48f'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-a9a11e3b-770c-4c99-a993-80e9399dd48f tempest-SharesMetadataNegativeTest-1095932064 tempest-SharesMetadataNegativeTest-1095932064-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9eca355145fd413390b5efe7a0d95465', 'request_id': 'req-a9a11e3b-770c-4c99-a993-80e9399dd48f'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:50 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1038/2100] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 12:57:49 2024] DELETE /identity/v3/users/9eca355145fd413390b5efe7a0d95465 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:57:50 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-76fe387f-fd02-4227-b546-0666bcf40d07 tempest-SharesMetadataNegativeTest-1584039052 tempest-SharesMetadataNegativeTest-1584039052-project-member] GET http://10.27.203.238/share/v2/5e5bc0c8fb8b46d598b0621999301112/share-replicas/detail?share_id=12970599-4f96-41ce-abd8-18371bc51a8c May 28 12:57:50 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-76fe387f-fd02-4227-b546-0666bcf40d07 tempest-SharesMetadataNegativeTest-1584039052 tempest-SharesMetadataNegativeTest-1584039052-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:50 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-76fe387f-fd02-4227-b546-0666bcf40d07 tempest-SharesMetadataNegativeTest-1584039052 tempest-SharesMetadataNegativeTest-1584039052-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:50 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-76fe387f-fd02-4227-b546-0666bcf40d07 tempest-SharesMetadataNegativeTest-1584039052 tempest-SharesMetadataNegativeTest-1584039052-project-member] http://10.27.203.238/share/v2/5e5bc0c8fb8b46d598b0621999301112/share-replicas/detail?share_id=12970599-4f96-41ce-abd8-18371bc51a8c returned with HTTP 200 May 28 12:57:50 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 404/819] 10.27.203.238 () {64 vars in 1476 bytes} [Tue May 28 12:57:50 2024] GET /share/v2/5e5bc0c8fb8b46d598b0621999301112/share-replicas/detail?share_id=12970599-4f96-41ce-abd8-18371bc51a8c => generated 22 bytes in 16 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:57:50 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-c5d3c5e1-db68-40f3-b16b-4a24d7dc03e1 tempest-SharesMetadataNegativeTest-1584039052 tempest-SharesMetadataNegativeTest-1584039052-project-member] DELETE http://10.27.203.238/share/v2/5e5bc0c8fb8b46d598b0621999301112/shares/12970599-4f96-41ce-abd8-18371bc51a8c May 28 12:57:50 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-c5d3c5e1-db68-40f3-b16b-4a24d7dc03e1 tempest-SharesMetadataNegativeTest-1584039052 tempest-SharesMetadataNegativeTest-1584039052-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:50 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-c5d3c5e1-db68-40f3-b16b-4a24d7dc03e1 tempest-SharesMetadataNegativeTest-1584039052 tempest-SharesMetadataNegativeTest-1584039052-project-member] Calling method 'ShareMixin.delete' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:50 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.v1.shares [None req-c5d3c5e1-db68-40f3-b16b-4a24d7dc03e1 tempest-SharesMetadataNegativeTest-1584039052 tempest-SharesMetadataNegativeTest-1584039052-project-member] Delete share with id: 12970599-4f96-41ce-abd8-18371bc51a8c May 28 12:57:50 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.manager [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Didn't find any instances for network info cache update. {{(pid=83654) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10012}} May 28 12:57:50 l75lg1-v1 dstat.sh[49771]: 28-05 12:57:50| 16 2 81 2 0|5705M 1785M 277M 7859M| 22k 19k| 0 2460k| 0 243 |6852 11k|1.52 1.07 1.02|2.0 1.0 0| 0 0 | 0 2048M| 29 356 0 68 0 May 28 12:57:50 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-76972c49-a34a-4521-9461-6779c9626726 tempest-SharesMetadataTest-1561320255 None] <<< [GET] https://127.0.0.1:40443/api/views/ May 28 12:57:50 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-76972c49-a34a-4521-9461-6779c9626726 tempest-SharesMetadataTest-1561320255 None] [Bunch(abac_tags=[], abe_max_depth=None, abe_protocols=[], alias='', allow_anonymous_access=False, allow_s3_anonymous_access=False, auto_commit='0d', bucket='', bucket_creators=[], bucket_creators_groups=[], bucket_owner=None, bulk_permission_update_progress=None, bulk_permission_update_state=None, cluster='loop75-kfs', cluster_id=1, created='2024-05-28T12:57:46.900385Z', enabled=True, files_retention_mode='NONE', guid='1462884d-64ac-4510-b0bf-c8d7ef5f49fd', id=21, ignore_oos=False, internal=False, is_remote=False, is_seamless=False, logical_capacity=0, max_retention_period=None, min_retention_period=None, name='5cf89605-2e7d-4ecc-9c44-5e6f5ecb0cad', nfs_interop_flags='BOTH_NFS3_AND_NFS4_INTEROP_DISABLED', path='/manila/manila-5cf89605-2e7d-4ecc-9c44-5e6f5ecb0cad', physical_capacity=0, policy='5cf89605-2e7d-4ecc-9c44-5e6f5ecb0cad', policy_id=22, protocols=['NFS'], qos_policy=None, qos_policy_id=None, s3_locks=False, s3_locks_retention_mode='NONE', s3_locks_retention_period='', s3_unverified_lookup=False, s3_versioning=False, select_for_live_monitoring=False, share='', share_acl=Bunch(acl=[], enabled=False), sync='SYNCED', sync_time='2024-05-28T12:57:47.226358Z', tenant_id=1, tenant_name='default', title='/manila/manila-5cf89605-2e7d-4ecc-9c44-5e6f5ecb0cad', url='https://127.0.0.1:40443/api/views/21/')] May 28 12:57:50 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-76972c49-a34a-4521-9461-6779c9626726 tempest-SharesMetadataTest-1561320255 None] --- [GET] https://127.0.0.1:40443/api/views/: Done May 28 12:57:50 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-76972c49-a34a-4521-9461-6779c9626726 tempest-SharesMetadataTest-1561320255 None] >>> [DELETE] https://127.0.0.1:40443/api/views/21/ May 28 12:57:50 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-c5d3c5e1-db68-40f3-b16b-4a24d7dc03e1 tempest-SharesMetadataNegativeTest-1584039052 tempest-SharesMetadataNegativeTest-1584039052-project-member] http://10.27.203.238/share/v2/5e5bc0c8fb8b46d598b0621999301112/shares/12970599-4f96-41ce-abd8-18371bc51a8c returned with HTTP 202 May 28 12:57:50 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 416/820] 10.27.203.238 () {64 vars in 1454 bytes} [Tue May 28 12:57:50 2024] DELETE /share/v2/5e5bc0c8fb8b46d598b0621999301112/shares/12970599-4f96-41ce-abd8-18371bc51a8c => generated 0 bytes in 342 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:57:50 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-c813d477-d7f9-4d95-98d6-c9d18540fb8d tempest-SharesMetadataNegativeTest-1584039052 tempest-SharesMetadataNegativeTest-1584039052-project-member] GET http://10.27.203.238/share/v2/5e5bc0c8fb8b46d598b0621999301112/shares/12970599-4f96-41ce-abd8-18371bc51a8c May 28 12:57:50 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-c813d477-d7f9-4d95-98d6-c9d18540fb8d tempest-SharesMetadataNegativeTest-1584039052 tempest-SharesMetadataNegativeTest-1584039052-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:50 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-c813d477-d7f9-4d95-98d6-c9d18540fb8d tempest-SharesMetadataNegativeTest-1584039052 tempest-SharesMetadataNegativeTest-1584039052-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:50 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-c813d477-d7f9-4d95-98d6-c9d18540fb8d tempest-SharesMetadataNegativeTest-1584039052 tempest-SharesMetadataNegativeTest-1584039052-project-member] http://10.27.203.238/share/v2/5e5bc0c8fb8b46d598b0621999301112/shares/12970599-4f96-41ce-abd8-18371bc51a8c returned with HTTP 200 May 28 12:57:50 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 405/821] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:57:50 2024] GET /share/v2/5e5bc0c8fb8b46d598b0621999301112/shares/12970599-4f96-41ce-abd8-18371bc51a8c => generated 1316 bytes in 29 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:57:50 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c5d3c5e1-db68-40f3-b16b-4a24d7dc03e1 tempest-SharesMetadataNegativeTest-1584039052 None] Acquiring lock "locked_access_rules_operation_by_share_instance_9e93e444-3013-4370-9caa-9f912c5201e6" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:57:50 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c5d3c5e1-db68-40f3-b16b-4a24d7dc03e1 tempest-SharesMetadataNegativeTest-1584039052 None] Lock "locked_access_rules_operation_by_share_instance_9e93e444-3013-4370-9caa-9f912c5201e6" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:57:50 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c5d3c5e1-db68-40f3-b16b-4a24d7dc03e1 tempest-SharesMetadataNegativeTest-1584039052 None] Lock "locked_access_rules_operation_by_share_instance_9e93e444-3013-4370-9caa-9f912c5201e6" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.021s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:57:50 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c5d3c5e1-db68-40f3-b16b-4a24d7dc03e1 tempest-SharesMetadataNegativeTest-1584039052 None] Acquiring lock "locked_access_rules_operation_by_share_instance_9e93e444-3013-4370-9caa-9f912c5201e6" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:57:50 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c5d3c5e1-db68-40f3-b16b-4a24d7dc03e1 tempest-SharesMetadataNegativeTest-1584039052 None] Lock "locked_access_rules_operation_by_share_instance_9e93e444-3013-4370-9caa-9f912c5201e6" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:57:50 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c5d3c5e1-db68-40f3-b16b-4a24d7dc03e1 tempest-SharesMetadataNegativeTest-1584039052 None] Lock "locked_access_rules_operation_by_share_instance_9e93e444-3013-4370-9caa-9f912c5201e6" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.004s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:57:50 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c5d3c5e1-db68-40f3-b16b-4a24d7dc03e1 tempest-SharesMetadataNegativeTest-1584039052 None] Acquiring lock "locked_access_rules_operation_by_share_instance_9e93e444-3013-4370-9caa-9f912c5201e6" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:57:50 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c5d3c5e1-db68-40f3-b16b-4a24d7dc03e1 tempest-SharesMetadataNegativeTest-1584039052 None] Lock "locked_access_rules_operation_by_share_instance_9e93e444-3013-4370-9caa-9f912c5201e6" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:57:50 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c5d3c5e1-db68-40f3-b16b-4a24d7dc03e1 tempest-SharesMetadataNegativeTest-1584039052 None] Lock "locked_access_rules_operation_by_share_instance_9e93e444-3013-4370-9caa-9f912c5201e6" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.004s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:57:50 l75lg1-v1 manila-share[98474]: DEBUG manila.share.access [None req-c5d3c5e1-db68-40f3-b16b-4a24d7dc03e1 tempest-SharesMetadataNegativeTest-1584039052 None] All access rules have been synced for share instance 9e93e444-3013-4370-9caa-9f912c5201e6 belonging to share 12970599-4f96-41ce-abd8-18371bc51a8c. {{(pid=98474) update_access_rules /opt/stack/manila/manila/share/access.py:304}} May 28 12:57:50 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-c5d3c5e1-db68-40f3-b16b-4a24d7dc03e1 tempest-SharesMetadataNegativeTest-1584039052 None] deleting '/manila/manila-9e93e444-3013-4370-9caa-9f912c5201e6' May 28 12:57:50 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c5d3c5e1-db68-40f3-b16b-4a24d7dc03e1 tempest-SharesMetadataNegativeTest-1584039052 None] >>> [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/ May 28 12:57:50 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c5d3c5e1-db68-40f3-b16b-4a24d7dc03e1 tempest-SharesMetadataNegativeTest-1584039052 None] {'data': '{"path": "/manila/manila-9e93e444-3013-4370-9caa-9f912c5201e6"}', May 28 12:57:50 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c5d3c5e1-db68-40f3-b16b-4a24d7dc03e1 tempest-SharesMetadataNegativeTest-1584039052 None] 'params': None} May 28 12:57:50 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c5d3c5e1-db68-40f3-b16b-4a24d7dc03e1 tempest-SharesMetadataNegativeTest-1584039052 None] <<< [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/ May 28 12:57:50 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c5d3c5e1-db68-40f3-b16b-4a24d7dc03e1 tempest-SharesMetadataNegativeTest-1584039052 None] 'OK' May 28 12:57:50 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c5d3c5e1-db68-40f3-b16b-4a24d7dc03e1 tempest-SharesMetadataNegativeTest-1584039052 None] --- [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/: Done May 28 12:57:50 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c5d3c5e1-db68-40f3-b16b-4a24d7dc03e1 tempest-SharesMetadataNegativeTest-1584039052 None] >>> [GET] https://127.0.0.1:40443/api/views/ May 28 12:57:50 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c5d3c5e1-db68-40f3-b16b-4a24d7dc03e1 tempest-SharesMetadataNegativeTest-1584039052 None] {'allow_redirects': True, May 28 12:57:50 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c5d3c5e1-db68-40f3-b16b-4a24d7dc03e1 tempest-SharesMetadataNegativeTest-1584039052 None] 'params': {'name': '9e93e444-3013-4370-9caa-9f912c5201e6'}} May 28 12:57:50 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c54b76c6-953a-466d-88d3-498d6f9bf52b tempest-SnapshotInstancesNegativeTest-1396485679 None] <<< [POST] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:57:50 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c54b76c6-953a-466d-88d3-498d6f9bf52b tempest-SnapshotInstancesNegativeTest-1396485679 None] Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=0, created='2024-05-28T12:57:50.327424Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='5b1c8739-fab5-4995-9e5d-3dc8d4a3155c', id=24, internal=False, is_s3_default_policy=False, name='8239ccb8-483c-4129-8319-880234387fbd', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=[], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['*'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['*'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T12:57:50.726951Z', tenant_id=1, tenant_name='default', title='8239ccb8-483c-4129-8319-880234387fbd', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/24/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[]) May 28 12:57:50 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c54b76c6-953a-466d-88d3-498d6f9bf52b tempest-SnapshotInstancesNegativeTest-1396485679 None] --- [POST] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 12:57:50 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c54b76c6-953a-466d-88d3-498d6f9bf52b tempest-SnapshotInstancesNegativeTest-1396485679 None] >>> [GET] https://127.0.0.1:40443/api/quotas/ May 28 12:57:50 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c54b76c6-953a-466d-88d3-498d6f9bf52b tempest-SnapshotInstancesNegativeTest-1396485679 None] {'allow_redirects': True, May 28 12:57:50 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c54b76c6-953a-466d-88d3-498d6f9bf52b tempest-SnapshotInstancesNegativeTest-1396485679 None] 'params': {'name': '8239ccb8-483c-4129-8319-880234387fbd'}} May 28 12:57:51 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c5d3c5e1-db68-40f3-b16b-4a24d7dc03e1 tempest-SharesMetadataNegativeTest-1584039052 None] <<< [GET] https://127.0.0.1:40443/api/views/ May 28 12:57:51 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c5d3c5e1-db68-40f3-b16b-4a24d7dc03e1 tempest-SharesMetadataNegativeTest-1584039052 None] [Bunch(abac_tags=[], abe_max_depth=None, abe_protocols=[], alias='', allow_anonymous_access=False, allow_s3_anonymous_access=False, auto_commit='0d', bucket='', bucket_creators=[], bucket_creators_groups=[], bucket_owner=None, bulk_permission_update_progress=None, bulk_permission_update_state=None, cluster='loop75-kfs', cluster_id=1, created='2024-05-28T12:57:47.604412Z', enabled=True, files_retention_mode='NONE', guid='06f608e8-20b1-4a3f-ac79-761ca03b03f5', id=22, ignore_oos=False, internal=False, is_remote=False, is_seamless=False, logical_capacity=0, max_retention_period=None, min_retention_period=None, name='9e93e444-3013-4370-9caa-9f912c5201e6', nfs_interop_flags='BOTH_NFS3_AND_NFS4_INTEROP_DISABLED', path='/manila/manila-9e93e444-3013-4370-9caa-9f912c5201e6', physical_capacity=0, policy='9e93e444-3013-4370-9caa-9f912c5201e6', policy_id=23, protocols=['NFS'], qos_policy=None, qos_policy_id=None, s3_locks=False, s3_locks_retention_mode='NONE', s3_locks_retention_period='', s3_unverified_lookup=False, s3_versioning=False, select_for_live_monitoring=False, share='', share_acl=Bunch(acl=[], enabled=False), sync='SYNCED', sync_time='2024-05-28T12:57:47.874650Z', tenant_id=1, tenant_name='default', title='/manila/manila-9e93e444-3013-4370-9caa-9f912c5201e6', url='https://127.0.0.1:40443/api/views/22/')] May 28 12:57:51 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c5d3c5e1-db68-40f3-b16b-4a24d7dc03e1 tempest-SharesMetadataNegativeTest-1584039052 None] --- [GET] https://127.0.0.1:40443/api/views/: Done May 28 12:57:51 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c5d3c5e1-db68-40f3-b16b-4a24d7dc03e1 tempest-SharesMetadataNegativeTest-1584039052 None] >>> [DELETE] https://127.0.0.1:40443/api/views/22/ May 28 12:57:51 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c54b76c6-953a-466d-88d3-498d6f9bf52b tempest-SnapshotInstancesNegativeTest-1396485679 None] <<< [GET] https://127.0.0.1:40443/api/quotas/ May 28 12:57:51 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c54b76c6-953a-466d-88d3-498d6f9bf52b tempest-SnapshotInstancesNegativeTest-1396485679 None] [] May 28 12:57:51 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c54b76c6-953a-466d-88d3-498d6f9bf52b tempest-SnapshotInstancesNegativeTest-1396485679 None] --- [GET] https://127.0.0.1:40443/api/quotas/: Done May 28 12:57:51 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c54b76c6-953a-466d-88d3-498d6f9bf52b tempest-SnapshotInstancesNegativeTest-1396485679 None] >>> [POST] https://127.0.0.1:40443/api/quotas/ May 28 12:57:51 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c54b76c6-953a-466d-88d3-498d6f9bf52b tempest-SnapshotInstancesNegativeTest-1396485679 None] {'data': '{"name": "8239ccb8-483c-4129-8319-880234387fbd", "path": ' May 28 12:57:51 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c54b76c6-953a-466d-88d3-498d6f9bf52b tempest-SnapshotInstancesNegativeTest-1396485679 None] '"/manila/manila-8239ccb8-483c-4129-8319-880234387fbd", "create_dir": ' May 28 12:57:51 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c54b76c6-953a-466d-88d3-498d6f9bf52b tempest-SnapshotInstancesNegativeTest-1396485679 None] 'true, "hard_limit": 1073741824}', May 28 12:57:51 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c54b76c6-953a-466d-88d3-498d6f9bf52b tempest-SnapshotInstancesNegativeTest-1396485679 None] 'json': None, May 28 12:57:51 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c54b76c6-953a-466d-88d3-498d6f9bf52b tempest-SnapshotInstancesNegativeTest-1396485679 None] 'params': None} May 28 12:57:51 l75lg1-v1 dstat.sh[49771]: 28-05 12:57:51| 3 0 91 4 0|5705M 1784M 277M 7859M| 22k 4950B| 0 7331k| 0 542 |3818 5855 |1.52 1.07 1.02|1.0 0 0| 0 0 | 0 2048M| 29 355 0 68 0 May 28 12:57:51 l75lg1-v1 neutron-server[77619]: DEBUG dbcounter [-] [77619] Writing DB stats neutron:SELECT=5 {{(pid=77619) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:57:51 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ebc4c1d7-8988-445f-8dc5-eef00e82a23a tempest-ShareIpRulesForNFSTest-1748669711 None] <<< [PATCH] https://127.0.0.1:40443/api/viewpolicies/21/ May 28 12:57:51 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ebc4c1d7-8988-445f-8dc5-eef00e82a23a tempest-ShareIpRulesForNFSTest-1748669711 None] Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=1, created='2024-05-28T12:57:40.763635Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='377955ad-d094-4e49-ab32-1021d943a572', id=21, internal=False, is_s3_default_policy=False, name='b7a7d61c-2cea-442a-9809-507038e080d5', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=['*'], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['*'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['*'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='MODIFYING', sync_time='2024-05-28T12:57:51.023280Z', tenant_id=1, tenant_name='default', title='b7a7d61c-2cea-442a-9809-507038e080d5', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/21/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[]) May 28 12:57:51 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ebc4c1d7-8988-445f-8dc5-eef00e82a23a tempest-ShareIpRulesForNFSTest-1748669711 None] --- [PATCH] https://127.0.0.1:40443/api/viewpolicies/21/: Done May 28 12:57:51 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-ebc4c1d7-8988-445f-8dc5-eef00e82a23a tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:57:51 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-ebc4c1d7-8988-445f-8dc5-eef00e82a23a tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:57:51 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager.update_available_resource {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:57:51 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Expecting reply to msg ae3051da4ac54510a01687298a424d1e in queue reply_37f4cbd1dd094961a22b8a65f222c327 May 28 12:57:51 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [-] Received RPC response for msg ae3051da4ac54510a01687298a424d1e May 28 12:57:51 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-ebc4c1d7-8988-445f-8dc5-eef00e82a23a tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.035s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:57:51 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-ebc4c1d7-8988-445f-8dc5-eef00e82a23a tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:57:51 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-ebc4c1d7-8988-445f-8dc5-eef00e82a23a tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:57:51 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-ebc4c1d7-8988-445f-8dc5-eef00e82a23a tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.026s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:57:51 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-ebc4c1d7-8988-445f-8dc5-eef00e82a23a tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:57:51 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-ebc4c1d7-8988-445f-8dc5-eef00e82a23a tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:57:51 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-ebc4c1d7-8988-445f-8dc5-eef00e82a23a tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.004s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:57:51 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-ebc4c1d7-8988-445f-8dc5-eef00e82a23a tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:57:51 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-ebc4c1d7-8988-445f-8dc5-eef00e82a23a tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:57:51 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-ebc4c1d7-8988-445f-8dc5-eef00e82a23a tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:57:51 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-ebc4c1d7-8988-445f-8dc5-eef00e82a23a tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:57:51 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-ebc4c1d7-8988-445f-8dc5-eef00e82a23a tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:57:51 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-e4568fa9-5429-41a1-9f66-600836973d31 tempest-SnapshotInstancesNegativeTest-1396485679 tempest-SnapshotInstancesNegativeTest-1396485679-project-admin] GET http://10.27.203.238/share/v2/c9cc76ecb4e343a6a51bf36da01debf8/shares/59371a98-d4b3-4967-9846-4759c0b33bb2 May 28 12:57:51 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-e4568fa9-5429-41a1-9f66-600836973d31 tempest-SnapshotInstancesNegativeTest-1396485679 tempest-SnapshotInstancesNegativeTest-1396485679-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:51 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-e4568fa9-5429-41a1-9f66-600836973d31 tempest-SnapshotInstancesNegativeTest-1396485679 tempest-SnapshotInstancesNegativeTest-1396485679-project-admin] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:51 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-e4568fa9-5429-41a1-9f66-600836973d31 tempest-SnapshotInstancesNegativeTest-1396485679 tempest-SnapshotInstancesNegativeTest-1396485679-project-admin] http://10.27.203.238/share/v2/c9cc76ecb4e343a6a51bf36da01debf8/shares/59371a98-d4b3-4967-9846-4759c0b33bb2 returned with HTTP 200 May 28 12:57:51 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 417/822] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:57:51 2024] GET /share/v2/c9cc76ecb4e343a6a51bf36da01debf8/shares/59371a98-d4b3-4967-9846-4759c0b33bb2 => generated 1366 bytes in 26 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:57:51 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-ebc4c1d7-8988-445f-8dc5-eef00e82a23a tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.112s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:57:51 l75lg1-v1 manila-share[98474]: INFO manila.share.access [None req-ebc4c1d7-8988-445f-8dc5-eef00e82a23a tempest-ShareIpRulesForNFSTest-1748669711 None] Access rules were successfully modified for share instance b7a7d61c-2cea-442a-9809-507038e080d5 belonging to share 1ddadc17-cf10-4a42-8bbd-8335fb3520a1. May 28 12:57:52 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c54b76c6-953a-466d-88d3-498d6f9bf52b tempest-SnapshotInstancesNegativeTest-1396485679 None] <<< [POST] https://127.0.0.1:40443/api/quotas/ May 28 12:57:52 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c54b76c6-953a-466d-88d3-498d6f9bf52b tempest-SnapshotInstancesNegativeTest-1396485679 None] Bunch(cluster='loop75-kfs', cluster_id=1, default_email=None, default_group_quota=None, default_user_quota=None, enable_alarms=True, enable_email_providers=True, grace_period=None, group_quotas=[], guid='62480c7b-db05-4eca-9eea-6dde72a10b88', hard_limit=1073741824, hard_limit_inodes=None, id=21, internal=False, is_user_quota=False, last_user_quotas_update=None, name='8239ccb8-483c-4129-8319-880234387fbd', num_blocked_users=0, num_exceeded_users=0, path='/manila/manila-8239ccb8-483c-4129-8319-880234387fbd', percent_capacity=0, percent_inodes=None, pretty_grace_period=None, pretty_grace_period_expiration=None, pretty_state='OK (CREATED)', soft_limit=None, soft_limit_inodes=None, state='OK', sync_state='CREATED', system_id=21, tenant_id=1, tenant_name='default', time_to_block=None, title='8239ccb8-483c-4129-8319-880234387fbd', url='https://127.0.0.1:40443/api/quotas/21/', used_capacity=0, used_capacity_tb=0.0, used_effective_capacity=0, used_effective_capacity_tb=0.0, used_inodes=0, used_limited_capacity=0, user_quotas=[]) May 28 12:57:52 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c54b76c6-953a-466d-88d3-498d6f9bf52b tempest-SnapshotInstancesNegativeTest-1396485679 None] --- [POST] https://127.0.0.1:40443/api/quotas/: Done May 28 12:57:52 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c54b76c6-953a-466d-88d3-498d6f9bf52b tempest-SnapshotInstancesNegativeTest-1396485679 None] >>> [GET] https://127.0.0.1:40443/api/views/ May 28 12:57:52 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c54b76c6-953a-466d-88d3-498d6f9bf52b tempest-SnapshotInstancesNegativeTest-1396485679 None] {'allow_redirects': True, May 28 12:57:52 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c54b76c6-953a-466d-88d3-498d6f9bf52b tempest-SnapshotInstancesNegativeTest-1396485679 None] 'params': {'name': '8239ccb8-483c-4129-8319-880234387fbd'}} May 28 12:57:52 l75lg1-v1 nova-compute[83654]: DEBUG oslo_concurrency.lockutils [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=83654) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:57:52 l75lg1-v1 nova-compute[83654]: DEBUG oslo_concurrency.lockutils [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=83654) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:57:52 l75lg1-v1 nova-compute[83654]: DEBUG oslo_concurrency.lockutils [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=83654) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:57:52 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.resource_tracker [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Auditing locally available compute resources for l75lg1-v1 (node: l75lg1-v1) {{(pid=83654) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}} May 28 12:57:52 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-2a404978-92c0-4c82-ba5b-6968a7480f82 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] POST http://10.27.203.238/share/v1/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action May 28 12:57:52 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-2a404978-92c0-4c82-ba5b-6968a7480f82 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Action body: b'{"os-access_list": null}' {{(pid=98330) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:57:52 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-2a404978-92c0-4c82-ba5b-6968a7480f82 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Action: 'action', calling method: ShareController.access_list, body: {"os-access_list": null} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:57:52 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.resource_tracker [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Hypervisor/Node resource view: name=l75lg1-v1 free_ram=9919MB free_disk=15.617530822753906GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_01_1", "address": "0000:00:01.1", "product_id": "7010", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7010", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7000", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7000", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "0100", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_0100", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_09_0", "address": "0000:00:09.0", "product_id": "1001", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1001", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "293a", "vendor_id": "8086", "numa_node": null, "label": "label_8086_293a", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_2", "address": "0000:00:07.2", "product_id": "2936", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2936", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "1237", "vendor_id": "8086", "numa_node": null, "label": "label_8086_1237", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "2935", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2935", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "2934", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2934", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_05_0", "address": "0000:00:05.0", "product_id": "1000", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1000", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "1000", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1000", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_06_0", "address": "0000:00:06.0", "product_id": "2668", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2668", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "1000", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1000", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0a_0", "address": "0000:00:0a.0", "product_id": "1002", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1002", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_3", "address": "0000:00:01.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_08_0", "address": "0000:00:08.0", "product_id": "1003", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1003", "dev_type": "type-PCI"}] {{(pid=83654) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}} May 28 12:57:52 l75lg1-v1 nova-compute[83654]: DEBUG oslo_concurrency.lockutils [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=83654) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:57:52 l75lg1-v1 nova-compute[83654]: DEBUG oslo_concurrency.lockutils [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=83654) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:57:52 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Expecting reply to msg 6f1d85988388445497b44bb653cd27a5 in queue reply_37f4cbd1dd094961a22b8a65f222c327 May 28 12:57:52 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-2a404978-92c0-4c82-ba5b-6968a7480f82 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] http://10.27.203.238/share/v1/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action returned with HTTP 200 May 28 12:57:52 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 406/823] 10.27.203.238 () {64 vars in 1450 bytes} [Tue May 28 12:57:52 2024] POST /share/v1/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action => generated 19 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 229 bytes (1 switches on core 0) May 28 12:57:52 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-d1d78bde-b42d-4875-9bb4-8cbd8b67b21d tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] POST http://10.27.203.238/share/v1/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action May 28 12:57:52 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-d1d78bde-b42d-4875-9bb4-8cbd8b67b21d tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Action body: b'{"os-allow_access": {"access_type": "ip", "access_to": "203.0.113.168/30", "access_level": "rw"}}' {{(pid=98329) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:57:52 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-d1d78bde-b42d-4875-9bb4-8cbd8b67b21d tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Action: 'action', calling method: ShareController.allow_access, body: {"os-allow_access": {"access_type": "ip", "access_to": "203.0.113.168/30", "access_level": "rw"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:57:52 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [-] Received RPC response for msg 6f1d85988388445497b44bb653cd27a5 May 28 12:57:52 l75lg1-v1 dstat.sh[49771]: 28-05 12:57:52| 5 1 93 1 0|5706M 1783M 277M 7859M| 16k 3398B| 0 744k| 0 94.0 |4245 7520 |1.40 1.06 1.01|1.0 2.0 0| 0 0 | 0 2048M| 29 356 0 62 0 May 28 12:57:52 l75lg1-v1 devstack@m-api.service[98329]: DEBUG oslo_concurrency.lockutils [None req-d1d78bde-b42d-4875-9bb4-8cbd8b67b21d tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98329) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:57:52 l75lg1-v1 devstack@m-api.service[98329]: DEBUG oslo_concurrency.lockutils [None req-d1d78bde-b42d-4875-9bb4-8cbd8b67b21d tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98329) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:57:52 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-330cdbff-2694-43ae-b35e-04258c7a46e6 tempest-AdminActionsTest-1749172189 None] <<< [POST] https://127.0.0.1:40443/api/snapshots/ May 28 12:57:52 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-330cdbff-2694-43ae-b35e-04258c7a46e6 tempest-AdminActionsTest-1749172189 None] Bunch(access_path='/.vast_all_snapshots/1000000004_share-snapshot-f95edc7c-3c58-461a-bfc2-ac81b390a0ac', aggr_phys_estimation=0, cluster='loop75-kfs', created='2024-05-28T12:57:50.403931Z', eta_sec=30819898925.71431, expiration_time='3001-01-19T07:59:58Z', guid='9c817232-67ff-45fd-9b73-4e5327aa1a57', id=5, indestructible=False, locked=False, name='share-snapshot-f95edc7c-3c58-461a-bfc2-ac81b390a0ac', path='/manila/manila-77a25e6b-f137-4342-8eb9-9ced679515e2/', policy=None, policy_id=None, protection_policy_id=None, state='SUCCEED', tenant_id=1, tenant_name='default', title='share-snapshot-f95edc7c-3c58-461a-bfc2-ac81b390a0ac(/manila/manila-77a25e6b-f137-4342-8eb9-9ced679515e2/)', type='local', unique_phys_estimation=0, url='https://127.0.0.1:40443/api/snapshots/5/') May 28 12:57:52 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-330cdbff-2694-43ae-b35e-04258c7a46e6 tempest-AdminActionsTest-1749172189 None] --- [POST] https://127.0.0.1:40443/api/snapshots/: Done May 28 12:57:52 l75lg1-v1 devstack@m-api.service[98329]: DEBUG oslo_concurrency.lockutils [None req-d1d78bde-b42d-4875-9bb4-8cbd8b67b21d tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.041s {{(pid=98329) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:57:52 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-d1d78bde-b42d-4875-9bb4-8cbd8b67b21d tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] http://10.27.203.238/share/v1/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action returned with HTTP 200 May 28 12:57:52 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 418/824] 10.27.203.238 () {64 vars in 1450 bytes} [Tue May 28 12:57:52 2024] POST /share/v1/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action => generated 202 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:57:52 l75lg1-v1 manila-share[98474]: DEBUG manila.share.manager [None req-d1d78bde-b42d-4875-9bb4-8cbd8b67b21d tempest-ShareIpRulesForNFSTest-1748669711 None] Received request to update access for share instance b7a7d61c-2cea-442a-9809-507038e080d5. {{(pid=98474) update_access_for_instances /opt/stack/manila/manila/share/manager.py:4353}} May 28 12:57:52 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-2b9bb886-2ab1-468e-be9b-8c908e4d8c4a tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] POST http://10.27.203.238/share/v1/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action May 28 12:57:52 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-2b9bb886-2ab1-468e-be9b-8c908e4d8c4a tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Action body: b'{"os-access_list": null}' {{(pid=98330) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:57:52 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-2b9bb886-2ab1-468e-be9b-8c908e4d8c4a tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Action: 'action', calling method: ShareController.access_list, body: {"os-access_list": null} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:57:52 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-d1d78bde-b42d-4875-9bb4-8cbd8b67b21d tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:57:52 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-d1d78bde-b42d-4875-9bb4-8cbd8b67b21d tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:57:52 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-d1d78bde-b42d-4875-9bb4-8cbd8b67b21d tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.004s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:57:52 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-d1d78bde-b42d-4875-9bb4-8cbd8b67b21d tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:57:52 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-d1d78bde-b42d-4875-9bb4-8cbd8b67b21d tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:57:52 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-2b9bb886-2ab1-468e-be9b-8c908e4d8c4a tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] http://10.27.203.238/share/v1/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action returned with HTTP 200 May 28 12:57:52 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 407/825] 10.27.203.238 () {64 vars in 1450 bytes} [Tue May 28 12:57:52 2024] POST /share/v1/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action => generated 157 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:57:52 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c54b76c6-953a-466d-88d3-498d6f9bf52b tempest-SnapshotInstancesNegativeTest-1396485679 None] <<< [GET] https://127.0.0.1:40443/api/views/ May 28 12:57:52 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c54b76c6-953a-466d-88d3-498d6f9bf52b tempest-SnapshotInstancesNegativeTest-1396485679 None] [] May 28 12:57:52 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c54b76c6-953a-466d-88d3-498d6f9bf52b tempest-SnapshotInstancesNegativeTest-1396485679 None] --- [GET] https://127.0.0.1:40443/api/views/: Done May 28 12:57:52 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c54b76c6-953a-466d-88d3-498d6f9bf52b tempest-SnapshotInstancesNegativeTest-1396485679 None] >>> [POST] https://127.0.0.1:40443/api/views/ May 28 12:57:52 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c54b76c6-953a-466d-88d3-498d6f9bf52b tempest-SnapshotInstancesNegativeTest-1396485679 None] {'data': '{"name": "8239ccb8-483c-4129-8319-880234387fbd", "path": ' May 28 12:57:52 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c54b76c6-953a-466d-88d3-498d6f9bf52b tempest-SnapshotInstancesNegativeTest-1396485679 None] '"/manila/manila-8239ccb8-483c-4129-8319-880234387fbd", "policy_id": ' May 28 12:57:52 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c54b76c6-953a-466d-88d3-498d6f9bf52b tempest-SnapshotInstancesNegativeTest-1396485679 None] '24, "create_dir": true, "protocols": ["NFS"]}', May 28 12:57:52 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c54b76c6-953a-466d-88d3-498d6f9bf52b tempest-SnapshotInstancesNegativeTest-1396485679 None] 'json': None, May 28 12:57:52 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c54b76c6-953a-466d-88d3-498d6f9bf52b tempest-SnapshotInstancesNegativeTest-1396485679 None] 'params': None} May 28 12:57:52 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-d1d78bde-b42d-4875-9bb4-8cbd8b67b21d tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.066s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:57:52 l75lg1-v1 manila-share[98474]: DEBUG manila.share.access [None req-d1d78bde-b42d-4875-9bb4-8cbd8b67b21d tempest-ShareIpRulesForNFSTest-1748669711 None] Updating access rules for share instance b7a7d61c-2cea-442a-9809-507038e080d5 belonging to share 1ddadc17-cf10-4a42-8bbd-8335fb3520a1. {{(pid=98474) update_access_rules /opt/stack/manila/manila/share/access.py:298}} May 28 12:57:52 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-d1d78bde-b42d-4875-9bb4-8cbd8b67b21d tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:57:52 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-d1d78bde-b42d-4875-9bb4-8cbd8b67b21d tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:57:52 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-d1d78bde-b42d-4875-9bb4-8cbd8b67b21d tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.007s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:57:52 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-d1d78bde-b42d-4875-9bb4-8cbd8b67b21d tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:57:52 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-d1d78bde-b42d-4875-9bb4-8cbd8b67b21d tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:57:52 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-d1d78bde-b42d-4875-9bb4-8cbd8b67b21d tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.014s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:57:52 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-d1d78bde-b42d-4875-9bb4-8cbd8b67b21d tempest-ShareIpRulesForNFSTest-1748669711 None] changing access on None May 28 12:57:52 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d1d78bde-b42d-4875-9bb4-8cbd8b67b21d tempest-ShareIpRulesForNFSTest-1748669711 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:57:52 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d1d78bde-b42d-4875-9bb4-8cbd8b67b21d tempest-ShareIpRulesForNFSTest-1748669711 None] {'allow_redirects': True, May 28 12:57:52 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d1d78bde-b42d-4875-9bb4-8cbd8b67b21d tempest-ShareIpRulesForNFSTest-1748669711 None] 'params': {'name': 'b7a7d61c-2cea-442a-9809-507038e080d5'}} May 28 12:57:52 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-76972c49-a34a-4521-9461-6779c9626726 tempest-SharesMetadataTest-1561320255 None] <<< [DELETE] https://127.0.0.1:40443/api/views/21/ May 28 12:57:52 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-76972c49-a34a-4521-9461-6779c9626726 tempest-SharesMetadataTest-1561320255 None] --- [DELETE] https://127.0.0.1:40443/api/views/21/: Done May 28 12:57:52 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-76972c49-a34a-4521-9461-6779c9626726 tempest-SharesMetadataTest-1561320255 None] >>> [GET] https://127.0.0.1:40443/api/quotas/ May 28 12:57:52 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-76972c49-a34a-4521-9461-6779c9626726 tempest-SharesMetadataTest-1561320255 None] {'allow_redirects': True, May 28 12:57:52 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-76972c49-a34a-4521-9461-6779c9626726 tempest-SharesMetadataTest-1561320255 None] 'params': {'name': '5cf89605-2e7d-4ecc-9c44-5e6f5ecb0cad'}} May 28 12:57:52 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-43ac3eb4-485d-4fca-970e-28f118a454ff tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] GET http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/da7ec0a1-db21-42c6-b842-6f87b3c5843d May 28 12:57:52 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-43ac3eb4-485d-4fca-970e-28f118a454ff tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:52 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-43ac3eb4-485d-4fca-970e-28f118a454ff tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:52 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-43ac3eb4-485d-4fca-970e-28f118a454ff tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/da7ec0a1-db21-42c6-b842-6f87b3c5843d returned with HTTP 200 May 28 12:57:52 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 419/826] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:57:52 2024] GET /share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/da7ec0a1-db21-42c6-b842-6f87b3c5843d => generated 1316 bytes in 24 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:57:52 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Expecting reply to msg 5c88ac735fd84ab1899d1142d0c2f884 in queue reply_37f4cbd1dd094961a22b8a65f222c327 May 28 12:57:52 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [-] Received RPC response for msg 5c88ac735fd84ab1899d1142d0c2f884 May 28 12:57:52 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-1ecc230c-3f48-47a9-91a6-d42a684cb0b4 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] GET http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/snapshots/000474a6-de71-40da-a1b3-815af4e9bcdf May 28 12:57:52 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-1ecc230c-3f48-47a9-91a6-d42a684cb0b4 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:52 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-1ecc230c-3f48-47a9-91a6-d42a684cb0b4 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Calling method 'ShareSnapshotMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:52 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-1ecc230c-3f48-47a9-91a6-d42a684cb0b4 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/snapshots/000474a6-de71-40da-a1b3-815af4e9bcdf returned with HTTP 200 May 28 12:57:52 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 408/827] 10.27.203.238 () {64 vars in 1460 bytes} [Tue May 28 12:57:52 2024] GET /share/v2/a3499cb78849424db45e54caac01de92/snapshots/000474a6-de71-40da-a1b3-815af4e9bcdf => generated 751 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:57:52 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-e198b6f9-409e-478c-ad48-975514b59232 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] POST http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/snapshots/000474a6-de71-40da-a1b3-815af4e9bcdf/action May 28 12:57:52 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-e198b6f9-409e-478c-ad48-975514b59232 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Action body: b'{"reset_status": {"status": "error_deleting"}}' {{(pid=98329) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:57:52 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-e198b6f9-409e-478c-ad48-975514b59232 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Action: 'action', calling method: ShareSnapshotsController.snapshot_reset_status, body: {"reset_status": {"status": "error_deleting"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:57:52 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-e198b6f9-409e-478c-ad48-975514b59232 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Updating share_snapshot '000474a6-de71-40da-a1b3-815af4e9bcdf' with '{'status': 'error_deleting'}' {{(pid=98329) _reset_status /opt/stack/manila/manila/api/openstack/wsgi.py:1257}} May 28 12:57:52 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-e198b6f9-409e-478c-ad48-975514b59232 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/snapshots/000474a6-de71-40da-a1b3-815af4e9bcdf/action returned with HTTP 202 May 28 12:57:52 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 420/828] 10.27.203.238 () {66 vars in 1502 bytes} [Tue May 28 12:57:52 2024] POST /share/v2/a3499cb78849424db45e54caac01de92/snapshots/000474a6-de71-40da-a1b3-815af4e9bcdf/action => generated 0 bytes in 70 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:57:52 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-2a739ac0-7178-414d-806c-72e90a92d42c tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] GET http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/snapshots/000474a6-de71-40da-a1b3-815af4e9bcdf May 28 12:57:52 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-2a739ac0-7178-414d-806c-72e90a92d42c tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:52 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-2a739ac0-7178-414d-806c-72e90a92d42c tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Calling method 'ShareSnapshotMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:53 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-2a739ac0-7178-414d-806c-72e90a92d42c tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/snapshots/000474a6-de71-40da-a1b3-815af4e9bcdf returned with HTTP 200 May 28 12:57:53 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 409/829] 10.27.203.238 () {64 vars in 1460 bytes} [Tue May 28 12:57:52 2024] GET /share/v2/a3499cb78849424db45e54caac01de92/snapshots/000474a6-de71-40da-a1b3-815af4e9bcdf => generated 756 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:57:53 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-058a48ab-1d9c-41ec-9074-ebfe49f00362 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] POST http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/snapshots/000474a6-de71-40da-a1b3-815af4e9bcdf/action May 28 12:57:53 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-058a48ab-1d9c-41ec-9074-ebfe49f00362 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Action body: b'{"force_delete": null}' {{(pid=98329) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:57:53 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-058a48ab-1d9c-41ec-9074-ebfe49f00362 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Action: 'action', calling method: ShareSnapshotsController.snapshot_force_delete, body: {"force_delete": null} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:57:53 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d1d78bde-b42d-4875-9bb4-8cbd8b67b21d tempest-ShareIpRulesForNFSTest-1748669711 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:57:53 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d1d78bde-b42d-4875-9bb4-8cbd8b67b21d tempest-ShareIpRulesForNFSTest-1748669711 None] [Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=1, created='2024-05-28T12:57:40.763635Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='377955ad-d094-4e49-ab32-1021d943a572', id=21, internal=False, is_s3_default_policy=False, name='b7a7d61c-2cea-442a-9809-507038e080d5', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=['*'], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['*'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['*'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T12:57:51.463714Z', tenant_id=1, tenant_name='default', title='b7a7d61c-2cea-442a-9809-507038e080d5', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/21/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[])] May 28 12:57:53 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d1d78bde-b42d-4875-9bb4-8cbd8b67b21d tempest-ShareIpRulesForNFSTest-1748669711 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 12:57:53 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-76972c49-a34a-4521-9461-6779c9626726 tempest-SharesMetadataTest-1561320255 None] <<< [GET] https://127.0.0.1:40443/api/quotas/ May 28 12:57:53 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-76972c49-a34a-4521-9461-6779c9626726 tempest-SharesMetadataTest-1561320255 None] [Bunch(cluster='loop75-kfs', cluster_id=1, default_email=None, default_group_quota=None, default_user_quota=None, enable_alarms=True, enable_email_providers=True, grace_period=None, guid='e06dd441-3858-4651-8b77-6371f1d2a0ce', hard_limit=1073741824, hard_limit_inodes=None, id=19, internal=False, is_user_quota=False, last_user_quotas_update=None, name='5cf89605-2e7d-4ecc-9c44-5e6f5ecb0cad', num_blocked_users=0, num_exceeded_users=0, path='/manila/manila-5cf89605-2e7d-4ecc-9c44-5e6f5ecb0cad', percent_capacity=0, percent_inodes=None, pretty_grace_period=None, pretty_grace_period_expiration=None, pretty_state='OK (CREATED)', soft_limit=None, soft_limit_inodes=None, state='OK', sync_state='CREATED', system_id=19, tenant_id=1, tenant_name='default', time_to_block=None, title='5cf89605-2e7d-4ecc-9c44-5e6f5ecb0cad', url='https://127.0.0.1:40443/api/quotas/19/', used_capacity=0, used_capacity_tb=0.0, used_effective_capacity=0, used_effective_capacity_tb=0.0, used_inodes=0, used_limited_capacity=0)] May 28 12:57:53 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-76972c49-a34a-4521-9461-6779c9626726 tempest-SharesMetadataTest-1561320255 None] --- [GET] https://127.0.0.1:40443/api/quotas/: Done May 28 12:57:53 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-76972c49-a34a-4521-9461-6779c9626726 tempest-SharesMetadataTest-1561320255 None] >>> [DELETE] https://127.0.0.1:40443/api/quotas/19/ May 28 12:57:53 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-058a48ab-1d9c-41ec-9074-ebfe49f00362 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/snapshots/000474a6-de71-40da-a1b3-815af4e9bcdf/action returned with HTTP 202 May 28 12:57:53 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 421/830] 10.27.203.238 () {66 vars in 1502 bytes} [Tue May 28 12:57:53 2024] POST /share/v2/a3499cb78849424db45e54caac01de92/snapshots/000474a6-de71-40da-a1b3-815af4e9bcdf/action => generated 0 bytes in 96 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:57:53 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-2375925f-3d26-48b7-9bbc-a88840ea275e tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] GET http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/snapshots/000474a6-de71-40da-a1b3-815af4e9bcdf May 28 12:57:53 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-2375925f-3d26-48b7-9bbc-a88840ea275e tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:53 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-2375925f-3d26-48b7-9bbc-a88840ea275e tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Calling method 'ShareSnapshotMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:53 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c5d3c5e1-db68-40f3-b16b-4a24d7dc03e1 tempest-SharesMetadataNegativeTest-1584039052 None] <<< [DELETE] https://127.0.0.1:40443/api/views/22/ May 28 12:57:53 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c5d3c5e1-db68-40f3-b16b-4a24d7dc03e1 tempest-SharesMetadataNegativeTest-1584039052 None] --- [DELETE] https://127.0.0.1:40443/api/views/22/: Done May 28 12:57:53 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c5d3c5e1-db68-40f3-b16b-4a24d7dc03e1 tempest-SharesMetadataNegativeTest-1584039052 None] >>> [GET] https://127.0.0.1:40443/api/quotas/ May 28 12:57:53 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c5d3c5e1-db68-40f3-b16b-4a24d7dc03e1 tempest-SharesMetadataNegativeTest-1584039052 None] {'allow_redirects': True, May 28 12:57:53 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c5d3c5e1-db68-40f3-b16b-4a24d7dc03e1 tempest-SharesMetadataNegativeTest-1584039052 None] 'params': {'name': '9e93e444-3013-4370-9caa-9f912c5201e6'}} May 28 12:57:53 l75lg1-v1 devstack@placement-api.service[78202]: DEBUG placement.requestlog [req-dbc9611a-a168-460b-ad79-b9b0d4546656 req-5cefc1d4-f17a-45ec-a11e-410f012f46b7 None None] Starting request: 10.27.203.238 "GET /placement/resource_providers/ef90d7d1-0808-4a15-ad77-f9a7391af2f4/allocations" {{(pid=78202) __call__ /opt/stack/placement/placement/requestlog.py:55}} May 28 12:57:53 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-2375925f-3d26-48b7-9bbc-a88840ea275e tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/snapshots/000474a6-de71-40da-a1b3-815af4e9bcdf returned with HTTP 200 May 28 12:57:53 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 410/831] 10.27.203.238 () {64 vars in 1460 bytes} [Tue May 28 12:57:53 2024] GET /share/v2/a3499cb78849424db45e54caac01de92/snapshots/000474a6-de71-40da-a1b3-815af4e9bcdf => generated 750 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:57:53 l75lg1-v1 devstack@placement-api.service[78202]: INFO placement.requestlog [req-dbc9611a-a168-460b-ad79-b9b0d4546656 req-5cefc1d4-f17a-45ec-a11e-410f012f46b7 service placement] 10.27.203.238 "GET /placement/resource_providers/ef90d7d1-0808-4a15-ad77-f9a7391af2f4/allocations" status: 200 len: 54 microversion: 1.0 May 28 12:57:53 l75lg1-v1 devstack@placement-api.service[78202]: [pid: 78202|app: 0|req: 23/45] 10.27.203.238 () {62 vars in 1480 bytes} [Tue May 28 12:57:53 2024] GET /placement/resource_providers/ef90d7d1-0808-4a15-ad77-f9a7391af2f4/allocations => generated 54 bytes in 12 msecs (HTTP/1.1 200) 6 headers in 223 bytes (1 switches on core 0) May 28 12:57:53 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.resource_tracker [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Total usable vcpus: 10, total allocated vcpus: 0 {{(pid=83654) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}} May 28 12:57:53 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.resource_tracker [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Final resource view: name=l75lg1-v1 phys_ram=16000MB used_ram=512MB phys_disk=28GB used_disk=0GB total_vcpus=10 used_vcpus=0 pci_stats=[] {{(pid=83654) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}} May 28 12:57:53 l75lg1-v1 devstack@placement-api.service[78201]: DEBUG placement.requestlog [req-dbc9611a-a168-460b-ad79-b9b0d4546656 req-fc2f611c-4602-4797-8164-02af1f8d8173 None None] Starting request: 10.27.203.238 "GET /placement/resource_providers/ef90d7d1-0808-4a15-ad77-f9a7391af2f4/allocations" {{(pid=78201) __call__ /opt/stack/placement/placement/requestlog.py:55}} May 28 12:57:53 l75lg1-v1 devstack@placement-api.service[78201]: INFO placement.requestlog [req-dbc9611a-a168-460b-ad79-b9b0d4546656 req-fc2f611c-4602-4797-8164-02af1f8d8173 service placement] 10.27.203.238 "GET /placement/resource_providers/ef90d7d1-0808-4a15-ad77-f9a7391af2f4/allocations" status: 200 len: 54 microversion: 1.0 May 28 12:57:53 l75lg1-v1 devstack@placement-api.service[78201]: [pid: 78201|app: 0|req: 23/46] 10.27.203.238 () {62 vars in 1480 bytes} [Tue May 28 12:57:53 2024] GET /placement/resource_providers/ef90d7d1-0808-4a15-ad77-f9a7391af2f4/allocations => generated 54 bytes in 12 msecs (HTTP/1.1 200) 6 headers in 223 bytes (1 switches on core 0) May 28 12:57:53 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.provider_tree [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Inventory has not changed in ProviderTree for provider: ef90d7d1-0808-4a15-ad77-f9a7391af2f4 {{(pid=83654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} May 28 12:57:53 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Expecting reply to msg 8ae786f4eba843d7af88a3266cc04cfd in queue reply_37f4cbd1dd094961a22b8a65f222c327 May 28 12:57:53 l75lg1-v1 manila-share[98474]: ERROR manila.share.drivers.vastdata [None req-d1d78bde-b42d-4875-9bb4-8cbd8b67b21d tempest-ShareIpRulesForNFSTest-1748669711 None] failed to resolve host '203.0.113.168/30': [Errno -2] Name or service not known (ignoring): socket.gaierror: [Errno -2] Name or service not known May 28 12:57:53 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-d1d78bde-b42d-4875-9bb4-8cbd8b67b21d tempest-ShareIpRulesForNFSTest-1748669711 None] changing access on /manila/manila-b7a7d61c-2cea-442a-9809-507038e080d5. Rules: {'nfs_read_write': ['*'], 'nfs_read_only': []} May 28 12:57:53 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d1d78bde-b42d-4875-9bb4-8cbd8b67b21d tempest-ShareIpRulesForNFSTest-1748669711 None] >>> [PATCH] https://127.0.0.1:40443/api/viewpolicies/21/ May 28 12:57:53 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d1d78bde-b42d-4875-9bb4-8cbd8b67b21d tempest-ShareIpRulesForNFSTest-1748669711 None] {'data': '{"name": "b7a7d61c-2cea-442a-9809-507038e080d5", "nfs_no_squash": ' May 28 12:57:53 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d1d78bde-b42d-4875-9bb4-8cbd8b67b21d tempest-ShareIpRulesForNFSTest-1748669711 None] '["*"], "nfs_root_squash": ["*"], "nfs_read_write": ["*"], ' May 28 12:57:53 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d1d78bde-b42d-4875-9bb4-8cbd8b67b21d tempest-ShareIpRulesForNFSTest-1748669711 None] '"nfs_read_only": []}', May 28 12:57:53 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d1d78bde-b42d-4875-9bb4-8cbd8b67b21d tempest-ShareIpRulesForNFSTest-1748669711 None] 'params': None} May 28 12:57:53 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [-] Received RPC response for msg 8ae786f4eba843d7af88a3266cc04cfd May 28 12:57:53 l75lg1-v1 dstat.sh[49771]: 28-05 12:57:53| 10 1 87 1 0|5706M 1783M 277M 7859M| 27k 5924B| 0 924k| 0 124 |4481 7054 |1.40 1.06 1.01|3.0 0 0| 0 0 | 0 2048M| 29 355 0 64 0 May 28 12:57:53 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-058a48ab-1d9c-41ec-9074-ebfe49f00362 tempest-AdminActionsTest-1749172189 None] >>> [GET] https://127.0.0.1:40443/api/snapshots/ May 28 12:57:53 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-058a48ab-1d9c-41ec-9074-ebfe49f00362 tempest-AdminActionsTest-1749172189 None] {'allow_redirects': True, May 28 12:57:53 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-058a48ab-1d9c-41ec-9074-ebfe49f00362 tempest-AdminActionsTest-1749172189 None] 'params': {'name': 'share-snapshot-f95edc7c-3c58-461a-bfc2-ac81b390a0ac'}} May 28 12:57:53 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-59c8db94-e5ef-45ec-b8e1-aea7ac786902 tempest-SharesMetadataNegativeTest-1584039052 tempest-SharesMetadataNegativeTest-1584039052-project-member] GET http://10.27.203.238/share/v2/5e5bc0c8fb8b46d598b0621999301112/shares/12970599-4f96-41ce-abd8-18371bc51a8c May 28 12:57:53 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-59c8db94-e5ef-45ec-b8e1-aea7ac786902 tempest-SharesMetadataNegativeTest-1584039052 tempest-SharesMetadataNegativeTest-1584039052-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:53 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-59c8db94-e5ef-45ec-b8e1-aea7ac786902 tempest-SharesMetadataNegativeTest-1584039052 tempest-SharesMetadataNegativeTest-1584039052-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:53 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-59c8db94-e5ef-45ec-b8e1-aea7ac786902 tempest-SharesMetadataNegativeTest-1584039052 tempest-SharesMetadataNegativeTest-1584039052-project-member] http://10.27.203.238/share/v2/5e5bc0c8fb8b46d598b0621999301112/shares/12970599-4f96-41ce-abd8-18371bc51a8c returned with HTTP 200 May 28 12:57:53 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 422/832] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:57:53 2024] GET /share/v2/5e5bc0c8fb8b46d598b0621999301112/shares/12970599-4f96-41ce-abd8-18371bc51a8c => generated 1316 bytes in 25 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:57:53 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c5d3c5e1-db68-40f3-b16b-4a24d7dc03e1 tempest-SharesMetadataNegativeTest-1584039052 None] <<< [GET] https://127.0.0.1:40443/api/quotas/ May 28 12:57:53 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c5d3c5e1-db68-40f3-b16b-4a24d7dc03e1 tempest-SharesMetadataNegativeTest-1584039052 None] [Bunch(cluster='loop75-kfs', cluster_id=1, default_email=None, default_group_quota=None, default_user_quota=None, enable_alarms=True, enable_email_providers=True, grace_period=None, guid='a603f8b2-fa6c-4c31-9c02-5490ba93b8a3', hard_limit=1073741824, hard_limit_inodes=None, id=20, internal=False, is_user_quota=False, last_user_quotas_update=None, name='9e93e444-3013-4370-9caa-9f912c5201e6', num_blocked_users=0, num_exceeded_users=0, path='/manila/manila-9e93e444-3013-4370-9caa-9f912c5201e6', percent_capacity=0, percent_inodes=None, pretty_grace_period=None, pretty_grace_period_expiration=None, pretty_state='OK (CREATED)', soft_limit=None, soft_limit_inodes=None, state='OK', sync_state='CREATED', system_id=20, tenant_id=1, tenant_name='default', time_to_block=None, title='9e93e444-3013-4370-9caa-9f912c5201e6', url='https://127.0.0.1:40443/api/quotas/20/', used_capacity=0, used_capacity_tb=0.0, used_effective_capacity=0, used_effective_capacity_tb=0.0, used_inodes=0, used_limited_capacity=0)] May 28 12:57:53 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c5d3c5e1-db68-40f3-b16b-4a24d7dc03e1 tempest-SharesMetadataNegativeTest-1584039052 None] --- [GET] https://127.0.0.1:40443/api/quotas/: Done May 28 12:57:53 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c5d3c5e1-db68-40f3-b16b-4a24d7dc03e1 tempest-SharesMetadataNegativeTest-1584039052 None] >>> [DELETE] https://127.0.0.1:40443/api/quotas/20/ May 28 12:57:53 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-058a48ab-1d9c-41ec-9074-ebfe49f00362 tempest-AdminActionsTest-1749172189 None] <<< [GET] https://127.0.0.1:40443/api/snapshots/ May 28 12:57:53 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-058a48ab-1d9c-41ec-9074-ebfe49f00362 tempest-AdminActionsTest-1749172189 None] [Bunch(access_path='/.vast_all_snapshots/1000000004_share-snapshot-f95edc7c-3c58-461a-bfc2-ac81b390a0ac', aggr_phys_estimation=0, cluster='loop75-kfs', created='2024-05-28T12:57:50.403931Z', eta_sec=30819898924.444813, expiration_time='3001-01-19T07:59:58Z', guid='9c817232-67ff-45fd-9b73-4e5327aa1a57', id=5, indestructible=False, locked=False, name='share-snapshot-f95edc7c-3c58-461a-bfc2-ac81b390a0ac', path='/manila/manila-77a25e6b-f137-4342-8eb9-9ced679515e2/', policy=None, policy_id=None, protection_policy_id=None, state='SUCCEED', tenant_id=1, tenant_name='default', title='share-snapshot-f95edc7c-3c58-461a-bfc2-ac81b390a0ac(/manila/manila-77a25e6b-f137-4342-8eb9-9ced679515e2/)', type='local', unique_phys_estimation=0, url='https://127.0.0.1:40443/api/snapshots/5/')] May 28 12:57:53 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-058a48ab-1d9c-41ec-9074-ebfe49f00362 tempest-AdminActionsTest-1749172189 None] --- [GET] https://127.0.0.1:40443/api/snapshots/: Done May 28 12:57:53 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-058a48ab-1d9c-41ec-9074-ebfe49f00362 tempest-AdminActionsTest-1749172189 None] >>> [DELETE] https://127.0.0.1:40443/api/snapshots/5/ May 28 12:57:53 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c54b76c6-953a-466d-88d3-498d6f9bf52b tempest-SnapshotInstancesNegativeTest-1396485679 None] <<< [POST] https://127.0.0.1:40443/api/views/ May 28 12:57:53 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c54b76c6-953a-466d-88d3-498d6f9bf52b tempest-SnapshotInstancesNegativeTest-1396485679 None] Bunch(abac_tags=[], abe_max_depth=None, abe_protocols=[], alias='', allow_anonymous_access=False, allow_s3_anonymous_access=False, auto_commit='0d', bucket='', bucket_creators=[], bucket_creators_groups=[], bucket_owner=None, bulk_permission_update_progress=None, bulk_permission_update_state=None, cluster='loop75-kfs', cluster_id=1, created='2024-05-28T12:57:53.170630Z', enabled=True, files_retention_mode='NONE', guid='d1499399-c5ed-41ff-99b8-21c1b2147bef', id=23, ignore_oos=False, internal=False, is_remote=False, is_seamless=False, logical_capacity=0, max_retention_period=None, min_retention_period=None, name='8239ccb8-483c-4129-8319-880234387fbd', nfs_interop_flags='BOTH_NFS3_AND_NFS4_INTEROP_DISABLED', path='/manila/manila-8239ccb8-483c-4129-8319-880234387fbd', physical_capacity=0, policy='8239ccb8-483c-4129-8319-880234387fbd', policy_id=24, protocols=['NFS'], qos_policy=None, qos_policy_id=None, s3_locks=False, s3_locks_retention_mode='NONE', s3_locks_retention_period='', s3_object_ownership_rule='ObjectWriter', s3_unverified_lookup=False, s3_versioning=False, select_for_live_monitoring=False, share='', share_acl=Bunch(acl=[], enabled=False), sync='SYNCED', sync_time='2024-05-28T12:57:53.506646Z', tenant_id=1, tenant_name='default', title='/manila/manila-8239ccb8-483c-4129-8319-880234387fbd', url='https://127.0.0.1:40443/api/views/23/') May 28 12:57:53 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c54b76c6-953a-466d-88d3-498d6f9bf52b tempest-SnapshotInstancesNegativeTest-1396485679 None] --- [POST] https://127.0.0.1:40443/api/views/: Done May 28 12:57:53 l75lg1-v1 manila-share[98474]: INFO manila.share.manager [None req-c54b76c6-953a-466d-88d3-498d6f9bf52b tempest-SnapshotInstancesNegativeTest-1396485679 None] Share instance 8239ccb8-483c-4129-8319-880234387fbd created successfully. May 28 12:57:53 l75lg1-v1 nova-compute[83654]: DEBUG nova.scheduler.client.report [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Inventory has not changed for provider ef90d7d1-0808-4a15-ad77-f9a7391af2f4 based on inventory data: {'VCPU': {'total': 10, 'reserved': 0, 'min_unit': 1, 'max_unit': 10, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16000, 'reserved': 512, 'min_unit': 1, 'max_unit': 16000, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 28, 'reserved': 0, 'min_unit': 1, 'max_unit': 28, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=83654) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}} May 28 12:57:53 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.resource_tracker [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Compute_service record updated for l75lg1-v1:l75lg1-v1 {{(pid=83654) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}} May 28 12:57:53 l75lg1-v1 nova-compute[83654]: DEBUG oslo_concurrency.lockutils [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.559s {{(pid=83654) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:57:54 l75lg1-v1 dstat.sh[49771]: 28-05 12:57:54| 2 1 96 1 0|5706M 1783M 277M 7859M| 26k 2060B| 0 8192k| 0 805 |2593 3680 |1.40 1.06 1.01|1.0 1.0 0| 0 0 | 0 2048M| 29 355 0 62 0 May 28 12:57:54 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-0e0958af-e44b-4c86-9c12-91130fdb2c85 tempest-SnapshotInstancesNegativeTest-1396485679 tempest-SnapshotInstancesNegativeTest-1396485679-project-admin] GET http://10.27.203.238/share/v2/c9cc76ecb4e343a6a51bf36da01debf8/shares/59371a98-d4b3-4967-9846-4759c0b33bb2 May 28 12:57:54 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-0e0958af-e44b-4c86-9c12-91130fdb2c85 tempest-SnapshotInstancesNegativeTest-1396485679 tempest-SnapshotInstancesNegativeTest-1396485679-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:54 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-0e0958af-e44b-4c86-9c12-91130fdb2c85 tempest-SnapshotInstancesNegativeTest-1396485679 tempest-SnapshotInstancesNegativeTest-1396485679-project-admin] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:54 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-0e0958af-e44b-4c86-9c12-91130fdb2c85 tempest-SnapshotInstancesNegativeTest-1396485679 tempest-SnapshotInstancesNegativeTest-1396485679-project-admin] http://10.27.203.238/share/v2/c9cc76ecb4e343a6a51bf36da01debf8/shares/59371a98-d4b3-4967-9846-4759c0b33bb2 returned with HTTP 200 May 28 12:57:54 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 411/833] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:57:54 2024] GET /share/v2/c9cc76ecb4e343a6a51bf36da01debf8/shares/59371a98-d4b3-4967-9846-4759c0b33bb2 => generated 1369 bytes in 26 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:57:54 l75lg1-v1 neutron-server[77619]: DEBUG dbcounter [-] [77619] Writing DB stats neutron:SELECT=4 {{(pid=77619) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:57:54 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-e16065d5-4f1b-4284-bc4f-4d3288d36cd0 tempest-SnapshotInstancesNegativeTest-1396485679 tempest-SnapshotInstancesNegativeTest-1396485679-project-admin] POST http://10.27.203.238/share/v2/c9cc76ecb4e343a6a51bf36da01debf8/snapshots May 28 12:57:54 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-e16065d5-4f1b-4284-bc4f-4d3288d36cd0 tempest-SnapshotInstancesNegativeTest-1396485679 tempest-SnapshotInstancesNegativeTest-1396485679-project-admin] Action: 'create', calling method: ShareSnapshotMixin.create, body: {"snapshot": {"name": "tempest-tempest-created-share-snap-172819084", "force": false, "description": "Tempest's snapshot", "share_id": "59371a98-d4b3-4967-9846-4759c0b33bb2"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:57:54 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:57:54 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:57:54 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.v1.share_snapshots [None req-e16065d5-4f1b-4284-bc4f-4d3288d36cd0 tempest-SnapshotInstancesNegativeTest-1396485679 tempest-SnapshotInstancesNegativeTest-1396485679-project-admin] Create snapshot from share 59371a98-d4b3-4967-9846-4759c0b33bb2 May 28 12:57:54 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.quota [None req-e16065d5-4f1b-4284-bc4f-4d3288d36cd0 tempest-SnapshotInstancesNegativeTest-1396485679 tempest-SnapshotInstancesNegativeTest-1396485679-project-admin] Created reservations ['a4ad6e4c-5942-4488-b720-cb40008b630e', '64c87064-33f0-4d2a-b9c7-caa2a7e2c837', 'bd40a3f9-2da2-4d35-828e-4d8645aaecce', '245287f5-2f06-44b2-a607-3678f518f471'] {{(pid=98329) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 12:57:54 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.quota [None req-e16065d5-4f1b-4284-bc4f-4d3288d36cd0 tempest-SnapshotInstancesNegativeTest-1396485679 tempest-SnapshotInstancesNegativeTest-1396485679-project-admin] Committed reservations ['a4ad6e4c-5942-4488-b720-cb40008b630e', '64c87064-33f0-4d2a-b9c7-caa2a7e2c837', 'bd40a3f9-2da2-4d35-828e-4d8645aaecce', '245287f5-2f06-44b2-a607-3678f518f471'] {{(pid=98329) commit /opt/stack/manila/manila/quota.py:1063}} May 28 12:57:54 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-e16065d5-4f1b-4284-bc4f-4d3288d36cd0 tempest-SnapshotInstancesNegativeTest-1396485679 tempest-SnapshotInstancesNegativeTest-1396485679-project-admin] http://10.27.203.238/share/v2/c9cc76ecb4e343a6a51bf36da01debf8/snapshots returned with HTTP 202 May 28 12:57:54 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 423/834] 10.27.203.238 () {66 vars in 1371 bytes} [Tue May 28 12:57:54 2024] POST /share/v2/c9cc76ecb4e343a6a51bf36da01debf8/snapshots => generated 749 bytes in 193 msecs (HTTP/1.1 202) 6 headers in 237 bytes (1 switches on core 0) May 28 12:57:54 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-d48a7807-322f-45b6-b798-b27c822b5548 tempest-SnapshotInstancesNegativeTest-1396485679 tempest-SnapshotInstancesNegativeTest-1396485679-project-admin] GET http://10.27.203.238/share/v2/c9cc76ecb4e343a6a51bf36da01debf8/snapshots/0d2e6969-2d63-4c8c-bd0a-ae6e8ca0314c May 28 12:57:54 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-d48a7807-322f-45b6-b798-b27c822b5548 tempest-SnapshotInstancesNegativeTest-1396485679 tempest-SnapshotInstancesNegativeTest-1396485679-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:54 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-d48a7807-322f-45b6-b798-b27c822b5548 tempest-SnapshotInstancesNegativeTest-1396485679 tempest-SnapshotInstancesNegativeTest-1396485679-project-admin] Calling method 'ShareSnapshotMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:54 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-d48a7807-322f-45b6-b798-b27c822b5548 tempest-SnapshotInstancesNegativeTest-1396485679 tempest-SnapshotInstancesNegativeTest-1396485679-project-admin] http://10.27.203.238/share/v2/c9cc76ecb4e343a6a51bf36da01debf8/snapshots/0d2e6969-2d63-4c8c-bd0a-ae6e8ca0314c returned with HTTP 200 May 28 12:57:54 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 412/835] 10.27.203.238 () {64 vars in 1460 bytes} [Tue May 28 12:57:54 2024] GET /share/v2/c9cc76ecb4e343a6a51bf36da01debf8/snapshots/0d2e6969-2d63-4c8c-bd0a-ae6e8ca0314c => generated 749 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:57:54 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-058a48ab-1d9c-41ec-9074-ebfe49f00362 tempest-AdminActionsTest-1749172189 None] <<< [DELETE] https://127.0.0.1:40443/api/snapshots/5/ May 28 12:57:54 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-058a48ab-1d9c-41ec-9074-ebfe49f00362 tempest-AdminActionsTest-1749172189 None] --- [DELETE] https://127.0.0.1:40443/api/snapshots/5/: Done May 28 12:57:54 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e16065d5-4f1b-4284-bc4f-4d3288d36cd0 tempest-SnapshotInstancesNegativeTest-1396485679 None] >>> [POST] https://127.0.0.1:40443/api/snapshots/ May 28 12:57:54 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e16065d5-4f1b-4284-bc4f-4d3288d36cd0 tempest-SnapshotInstancesNegativeTest-1396485679 None] {'data': '{"path": "/manila/manila-8239ccb8-483c-4129-8319-880234387fbd", ' May 28 12:57:54 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e16065d5-4f1b-4284-bc4f-4d3288d36cd0 tempest-SnapshotInstancesNegativeTest-1396485679 None] '"name": "share-snapshot-d9f25a4b-5def-4427-b890-289ce9aabe70"}', May 28 12:57:54 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e16065d5-4f1b-4284-bc4f-4d3288d36cd0 tempest-SnapshotInstancesNegativeTest-1396485679 None] 'json': None, May 28 12:57:54 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e16065d5-4f1b-4284-bc4f-4d3288d36cd0 tempest-SnapshotInstancesNegativeTest-1396485679 None] 'params': None} May 28 12:57:55 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-058a48ab-1d9c-41ec-9074-ebfe49f00362 tempest-AdminActionsTest-1749172189 None] Created reservations ['088cc7ce-bb9d-4ab9-951a-da362603bf92', '79946454-ade0-4668-bb92-79de357f5eef', 'a9d26698-97da-4003-a94d-97a9e403c4af', '9a2e217d-6d72-4bd3-bae1-5f3f9765653f'] {{(pid=98474) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 12:57:55 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-058a48ab-1d9c-41ec-9074-ebfe49f00362 tempest-AdminActionsTest-1749172189 None] Committed reservations ['088cc7ce-bb9d-4ab9-951a-da362603bf92', '79946454-ade0-4668-bb92-79de357f5eef', 'a9d26698-97da-4003-a94d-97a9e403c4af', '9a2e217d-6d72-4bd3-bae1-5f3f9765653f'] {{(pid=98474) commit /opt/stack/manila/manila/quota.py:1063}} May 28 12:57:55 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d1d78bde-b42d-4875-9bb4-8cbd8b67b21d tempest-ShareIpRulesForNFSTest-1748669711 None] <<< [PATCH] https://127.0.0.1:40443/api/viewpolicies/21/ May 28 12:57:55 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d1d78bde-b42d-4875-9bb4-8cbd8b67b21d tempest-ShareIpRulesForNFSTest-1748669711 None] Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=1, created='2024-05-28T12:57:40.763635Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='377955ad-d094-4e49-ab32-1021d943a572', id=21, internal=False, is_s3_default_policy=False, name='b7a7d61c-2cea-442a-9809-507038e080d5', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=['*'], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['*'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['*'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='MODIFYING', sync_time='2024-05-28T12:57:54.545914Z', tenant_id=1, tenant_name='default', title='b7a7d61c-2cea-442a-9809-507038e080d5', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/21/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[]) May 28 12:57:55 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d1d78bde-b42d-4875-9bb4-8cbd8b67b21d tempest-ShareIpRulesForNFSTest-1748669711 None] --- [PATCH] https://127.0.0.1:40443/api/viewpolicies/21/: Done May 28 12:57:55 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-d1d78bde-b42d-4875-9bb4-8cbd8b67b21d tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:57:55 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-d1d78bde-b42d-4875-9bb4-8cbd8b67b21d tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:57:55 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-d1d78bde-b42d-4875-9bb4-8cbd8b67b21d tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.055s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:57:55 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-d1d78bde-b42d-4875-9bb4-8cbd8b67b21d tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:57:55 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-d1d78bde-b42d-4875-9bb4-8cbd8b67b21d tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:57:55 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-d1d78bde-b42d-4875-9bb4-8cbd8b67b21d tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:57:55 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-d1d78bde-b42d-4875-9bb4-8cbd8b67b21d tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:57:55 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-d1d78bde-b42d-4875-9bb4-8cbd8b67b21d tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:57:55 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-d1d78bde-b42d-4875-9bb4-8cbd8b67b21d tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:57:55 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-d1d78bde-b42d-4875-9bb4-8cbd8b67b21d tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:57:55 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-d1d78bde-b42d-4875-9bb4-8cbd8b67b21d tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:57:55 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-d1d78bde-b42d-4875-9bb4-8cbd8b67b21d tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:57:55 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-d1d78bde-b42d-4875-9bb4-8cbd8b67b21d tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:57:55 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-d1d78bde-b42d-4875-9bb4-8cbd8b67b21d tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:57:55 l75lg1-v1 dstat.sh[49771]: 28-05 12:57:55| 6 1 91 2 0|5706M 1782M 277M 7859M| 20k 1442B| 0 1773k| 0 221 |4186 6843 |1.40 1.06 1.01|2.0 1.0 0| 0 0 | 0 2048M| 29 355 0 62 0 May 28 12:57:55 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-d1d78bde-b42d-4875-9bb4-8cbd8b67b21d tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.035s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:57:55 l75lg1-v1 manila-share[98474]: INFO manila.share.access [None req-d1d78bde-b42d-4875-9bb4-8cbd8b67b21d tempest-ShareIpRulesForNFSTest-1748669711 None] Access rules were successfully modified for share instance b7a7d61c-2cea-442a-9809-507038e080d5 belonging to share 1ddadc17-cf10-4a42-8bbd-8335fb3520a1. May 28 12:57:55 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-0ae92182-19f2-4cfd-9acb-bcf61aaedeac tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] POST http://10.27.203.238/share/v1/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action May 28 12:57:55 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-0ae92182-19f2-4cfd-9acb-bcf61aaedeac tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Action body: b'{"os-access_list": null}' {{(pid=98329) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:57:55 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-0ae92182-19f2-4cfd-9acb-bcf61aaedeac tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Action: 'action', calling method: ShareController.access_list, body: {"os-access_list": null} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:57:55 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-0ae92182-19f2-4cfd-9acb-bcf61aaedeac tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] http://10.27.203.238/share/v1/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action returned with HTTP 200 May 28 12:57:55 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 424/836] 10.27.203.238 () {64 vars in 1450 bytes} [Tue May 28 12:57:55 2024] POST /share/v1/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action => generated 160 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:57:55 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-4a49da47-5b6d-4bc6-8c6c-fd400918f1cd tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] POST http://10.27.203.238/share/v1/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action May 28 12:57:55 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-4a49da47-5b6d-4bc6-8c6c-fd400918f1cd tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Action body: b'{"os-deny_access": {"access_id": "6577228e-5417-4fce-a939-508783940a41"}}' {{(pid=98330) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:57:55 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-4a49da47-5b6d-4bc6-8c6c-fd400918f1cd tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Action: 'action', calling method: ShareController.deny_access, body: {"os-deny_access": {"access_id": "6577228e-5417-4fce-a939-508783940a41"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:57:55 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.lock.api [None req-4a49da47-5b6d-4bc6-8c6c-fd400918f1cd tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Searching for locks by: {'resource_id': '6577228e-5417-4fce-a939-508783940a41', 'resource_action': 'delete'} {{(pid=98330) get_all /opt/stack/manila/manila/lock/api.py:112}} May 28 12:57:55 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-4a49da47-5b6d-4bc6-8c6c-fd400918f1cd tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:57:55 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-4a49da47-5b6d-4bc6-8c6c-fd400918f1cd tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:57:55 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-4a49da47-5b6d-4bc6-8c6c-fd400918f1cd tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.038s {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:57:55 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-4a49da47-5b6d-4bc6-8c6c-fd400918f1cd tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:57:55 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-4a49da47-5b6d-4bc6-8c6c-fd400918f1cd tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:57:55 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-4a49da47-5b6d-4bc6-8c6c-fd400918f1cd tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.064s {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:57:55 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-4a49da47-5b6d-4bc6-8c6c-fd400918f1cd tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] http://10.27.203.238/share/v1/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action returned with HTTP 202 May 28 12:57:55 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 413/837] 10.27.203.238 () {64 vars in 1450 bytes} [Tue May 28 12:57:55 2024] POST /share/v1/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action => generated 0 bytes in 179 msecs (HTTP/1.1 202) 6 headers in 242 bytes (1 switches on core 0) May 28 12:57:55 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-dc6bd039-623d-4480-967d-6e17e95e9471 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] POST http://10.27.203.238/share/v1/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action May 28 12:57:55 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-dc6bd039-623d-4480-967d-6e17e95e9471 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Action body: b'{"os-access_list": null}' {{(pid=98329) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:57:55 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-dc6bd039-623d-4480-967d-6e17e95e9471 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Action: 'action', calling method: ShareController.access_list, body: {"os-access_list": null} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:57:55 l75lg1-v1 manila-share[98474]: DEBUG manila.share.manager [None req-4a49da47-5b6d-4bc6-8c6c-fd400918f1cd tempest-ShareIpRulesForNFSTest-1748669711 None] Received request to update access for share instance b7a7d61c-2cea-442a-9809-507038e080d5. {{(pid=98474) update_access_for_instances /opt/stack/manila/manila/share/manager.py:4353}} May 28 12:57:55 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-c84d8631-92fd-4ee0-af4b-99e6b7b8deb2 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] GET http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/da7ec0a1-db21-42c6-b842-6f87b3c5843d May 28 12:57:55 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-c84d8631-92fd-4ee0-af4b-99e6b7b8deb2 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:55 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-c84d8631-92fd-4ee0-af4b-99e6b7b8deb2 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:55 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-4a49da47-5b6d-4bc6-8c6c-fd400918f1cd tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:57:55 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-4a49da47-5b6d-4bc6-8c6c-fd400918f1cd tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:57:55 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-c84d8631-92fd-4ee0-af4b-99e6b7b8deb2 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/da7ec0a1-db21-42c6-b842-6f87b3c5843d returned with HTTP 200 May 28 12:57:55 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 414/838] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:57:55 2024] GET /share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/da7ec0a1-db21-42c6-b842-6f87b3c5843d => generated 1316 bytes in 25 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:57:55 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-4a49da47-5b6d-4bc6-8c6c-fd400918f1cd tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:57:55 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-4a49da47-5b6d-4bc6-8c6c-fd400918f1cd tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:57:55 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-4a49da47-5b6d-4bc6-8c6c-fd400918f1cd tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:57:55 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-dc6bd039-623d-4480-967d-6e17e95e9471 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] http://10.27.203.238/share/v1/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action returned with HTTP 200 May 28 12:57:55 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 425/839] 10.27.203.238 () {64 vars in 1450 bytes} [Tue May 28 12:57:55 2024] POST /share/v1/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action => generated 157 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:57:55 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-4a49da47-5b6d-4bc6-8c6c-fd400918f1cd tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.062s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:57:55 l75lg1-v1 manila-share[98474]: DEBUG manila.share.access [None req-4a49da47-5b6d-4bc6-8c6c-fd400918f1cd tempest-ShareIpRulesForNFSTest-1748669711 None] Updating access rules for share instance b7a7d61c-2cea-442a-9809-507038e080d5 belonging to share 1ddadc17-cf10-4a42-8bbd-8335fb3520a1. {{(pid=98474) update_access_rules /opt/stack/manila/manila/share/access.py:298}} May 28 12:57:55 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-4a49da47-5b6d-4bc6-8c6c-fd400918f1cd tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:57:55 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-4a49da47-5b6d-4bc6-8c6c-fd400918f1cd tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:57:55 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-4a49da47-5b6d-4bc6-8c6c-fd400918f1cd tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.007s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:57:55 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-4a49da47-5b6d-4bc6-8c6c-fd400918f1cd tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:57:55 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-4a49da47-5b6d-4bc6-8c6c-fd400918f1cd tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:57:55 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-4a49da47-5b6d-4bc6-8c6c-fd400918f1cd tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.014s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:57:55 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-4a49da47-5b6d-4bc6-8c6c-fd400918f1cd tempest-ShareIpRulesForNFSTest-1748669711 None] changing access on None May 28 12:57:55 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-4a49da47-5b6d-4bc6-8c6c-fd400918f1cd tempest-ShareIpRulesForNFSTest-1748669711 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:57:55 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-4a49da47-5b6d-4bc6-8c6c-fd400918f1cd tempest-ShareIpRulesForNFSTest-1748669711 None] {'allow_redirects': True, May 28 12:57:55 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-4a49da47-5b6d-4bc6-8c6c-fd400918f1cd tempest-ShareIpRulesForNFSTest-1748669711 None] 'params': {'name': 'b7a7d61c-2cea-442a-9809-507038e080d5'}} May 28 12:57:56 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-4dc308db-ccb2-4020-a265-97c9b4a0df4b tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] GET http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/snapshots/000474a6-de71-40da-a1b3-815af4e9bcdf May 28 12:57:56 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-4dc308db-ccb2-4020-a265-97c9b4a0df4b tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:56 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-4dc308db-ccb2-4020-a265-97c9b4a0df4b tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Calling method 'ShareSnapshotMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:56 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-4dc308db-ccb2-4020-a265-97c9b4a0df4b tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] HTTP exception thrown: The resource could not be found. May 28 12:57:56 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-4dc308db-ccb2-4020-a265-97c9b4a0df4b tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/snapshots/000474a6-de71-40da-a1b3-815af4e9bcdf returned with HTTP 404 May 28 12:57:56 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 415/840] 10.27.203.238 () {64 vars in 1460 bytes} [Tue May 28 12:57:56 2024] GET /share/v2/a3499cb78849424db45e54caac01de92/snapshots/000474a6-de71-40da-a1b3-815af4e9bcdf => generated 78 bytes in 16 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 12:57:56 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-2eecff35-4e3c-41f9-8d5b-d39e83d83e9c tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] GET http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/shares/df0ea844-5fc1-4d04-8afb-5048ec5dc33f/instances May 28 12:57:56 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-2eecff35-4e3c-41f9-8d5b-d39e83d83e9c tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:56 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-2eecff35-4e3c-41f9-8d5b-d39e83d83e9c tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:56 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-2eecff35-4e3c-41f9-8d5b-d39e83d83e9c tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/shares/df0ea844-5fc1-4d04-8afb-5048ec5dc33f/instances returned with HTTP 200 May 28 12:57:56 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 426/841] 10.27.203.238 () {64 vars in 1481 bytes} [Tue May 28 12:57:56 2024] GET /share/v2/a3499cb78849424db45e54caac01de92/shares/df0ea844-5fc1-4d04-8afb-5048ec5dc33f/instances => generated 509 bytes in 23 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:57:56 l75lg1-v1 dstat.sh[49771]: 28-05 12:57:56| 5 1 92 1 0|5707M 1782M 277M 7859M| 18k 3793B| 0 763k| 0 86.9 |3453 5763 |1.40 1.06 1.01|2.0 0 0| 0 0 | 0 2048M| 29 356 0 62 0 May 28 12:57:56 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-caffff4e-c253-4a06-9b51-75844832345a tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] POST http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/share_instances/77a25e6b-f137-4342-8eb9-9ced679515e2/action May 28 12:57:56 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-caffff4e-c253-4a06-9b51-75844832345a tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Action body: b'{"reset_status": {"status": "error"}}' {{(pid=98330) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:57:56 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-caffff4e-c253-4a06-9b51-75844832345a tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Action: 'action', calling method: ShareInstancesController.instance_reset_status, body: {"reset_status": {"status": "error"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:57:56 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-caffff4e-c253-4a06-9b51-75844832345a tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Updating share_instance '77a25e6b-f137-4342-8eb9-9ced679515e2' with '{'status': 'error'}' {{(pid=98330) _reset_status /opt/stack/manila/manila/api/openstack/wsgi.py:1257}} May 28 12:57:56 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-caffff4e-c253-4a06-9b51-75844832345a tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/share_instances/77a25e6b-f137-4342-8eb9-9ced679515e2/action returned with HTTP 202 May 28 12:57:56 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 416/842] 10.27.203.238 () {66 vars in 1520 bytes} [Tue May 28 12:57:56 2024] POST /share/v2/a3499cb78849424db45e54caac01de92/share_instances/77a25e6b-f137-4342-8eb9-9ced679515e2/action => generated 0 bytes in 35 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:57:56 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-34efb530-852d-440c-a9c9-31d52a39fcb0 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] GET http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/share_instances/77a25e6b-f137-4342-8eb9-9ced679515e2 May 28 12:57:56 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-34efb530-852d-440c-a9c9-31d52a39fcb0 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:56 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-34efb530-852d-440c-a9c9-31d52a39fcb0 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:56 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-34efb530-852d-440c-a9c9-31d52a39fcb0 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/share_instances/77a25e6b-f137-4342-8eb9-9ced679515e2 returned with HTTP 200 May 28 12:57:56 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 427/843] 10.27.203.238 () {64 vars in 1478 bytes} [Tue May 28 12:57:56 2024] GET /share/v2/a3499cb78849424db45e54caac01de92/share_instances/77a25e6b-f137-4342-8eb9-9ced679515e2 => generated 502 bytes in 14 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:57:56 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-2afb6498-3f1d-488f-9346-b6d699859d6d tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] POST http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/share_instances/77a25e6b-f137-4342-8eb9-9ced679515e2/action May 28 12:57:56 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-2afb6498-3f1d-488f-9346-b6d699859d6d tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Action body: b'{"reset_status": {"status": "available"}}' {{(pid=98330) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:57:56 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-2afb6498-3f1d-488f-9346-b6d699859d6d tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Action: 'action', calling method: ShareInstancesController.instance_reset_status, body: {"reset_status": {"status": "available"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:57:56 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-2afb6498-3f1d-488f-9346-b6d699859d6d tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Updating share_instance '77a25e6b-f137-4342-8eb9-9ced679515e2' with '{'status': 'available'}' {{(pid=98330) _reset_status /opt/stack/manila/manila/api/openstack/wsgi.py:1257}} May 28 12:57:56 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-2afb6498-3f1d-488f-9346-b6d699859d6d tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/share_instances/77a25e6b-f137-4342-8eb9-9ced679515e2/action returned with HTTP 202 May 28 12:57:56 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 417/844] 10.27.203.238 () {66 vars in 1520 bytes} [Tue May 28 12:57:56 2024] POST /share/v2/a3499cb78849424db45e54caac01de92/share_instances/77a25e6b-f137-4342-8eb9-9ced679515e2/action => generated 0 bytes in 30 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:57:56 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-4a49da47-5b6d-4bc6-8c6c-fd400918f1cd tempest-ShareIpRulesForNFSTest-1748669711 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:57:56 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-4a49da47-5b6d-4bc6-8c6c-fd400918f1cd tempest-ShareIpRulesForNFSTest-1748669711 None] [Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=1, created='2024-05-28T12:57:40.763635Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='377955ad-d094-4e49-ab32-1021d943a572', id=21, internal=False, is_s3_default_policy=False, name='b7a7d61c-2cea-442a-9809-507038e080d5', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=['*'], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['*'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['*'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T12:57:55.029073Z', tenant_id=1, tenant_name='default', title='b7a7d61c-2cea-442a-9809-507038e080d5', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/21/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[])] May 28 12:57:56 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-4a49da47-5b6d-4bc6-8c6c-fd400918f1cd tempest-ShareIpRulesForNFSTest-1748669711 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 12:57:56 l75lg1-v1 manila-share[98474]: ERROR manila.share.drivers.vastdata [None req-4a49da47-5b6d-4bc6-8c6c-fd400918f1cd tempest-ShareIpRulesForNFSTest-1748669711 None] failed to resolve host '203.0.113.168/30': [Errno -2] Name or service not known (ignoring): socket.gaierror: [Errno -2] Name or service not known May 28 12:57:56 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-4a49da47-5b6d-4bc6-8c6c-fd400918f1cd tempest-ShareIpRulesForNFSTest-1748669711 None] changing access on /manila/manila-b7a7d61c-2cea-442a-9809-507038e080d5. Rules: {'nfs_read_write': ['*'], 'nfs_read_only': []} May 28 12:57:56 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-4a49da47-5b6d-4bc6-8c6c-fd400918f1cd tempest-ShareIpRulesForNFSTest-1748669711 None] >>> [PATCH] https://127.0.0.1:40443/api/viewpolicies/21/ May 28 12:57:56 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-4a49da47-5b6d-4bc6-8c6c-fd400918f1cd tempest-ShareIpRulesForNFSTest-1748669711 None] {'data': '{"name": "b7a7d61c-2cea-442a-9809-507038e080d5", "nfs_no_squash": ' May 28 12:57:56 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-4a49da47-5b6d-4bc6-8c6c-fd400918f1cd tempest-ShareIpRulesForNFSTest-1748669711 None] '["*"], "nfs_root_squash": ["*"], "nfs_read_write": ["*"], ' May 28 12:57:56 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-4a49da47-5b6d-4bc6-8c6c-fd400918f1cd tempest-ShareIpRulesForNFSTest-1748669711 None] '"nfs_read_only": []}', May 28 12:57:56 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-4a49da47-5b6d-4bc6-8c6c-fd400918f1cd tempest-ShareIpRulesForNFSTest-1748669711 None] 'params': None} May 28 12:57:56 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-df7cdd80-9603-4776-b368-9726769496cf tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] GET http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/share_instances/77a25e6b-f137-4342-8eb9-9ced679515e2 May 28 12:57:56 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-df7cdd80-9603-4776-b368-9726769496cf tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:56 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-df7cdd80-9603-4776-b368-9726769496cf tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:56 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-76972c49-a34a-4521-9461-6779c9626726 tempest-SharesMetadataTest-1561320255 None] <<< [DELETE] https://127.0.0.1:40443/api/quotas/19/ May 28 12:57:56 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-76972c49-a34a-4521-9461-6779c9626726 tempest-SharesMetadataTest-1561320255 None] --- [DELETE] https://127.0.0.1:40443/api/quotas/19/: Done May 28 12:57:56 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-76972c49-a34a-4521-9461-6779c9626726 tempest-SharesMetadataTest-1561320255 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:57:56 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-76972c49-a34a-4521-9461-6779c9626726 tempest-SharesMetadataTest-1561320255 None] {'allow_redirects': True, May 28 12:57:56 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-76972c49-a34a-4521-9461-6779c9626726 tempest-SharesMetadataTest-1561320255 None] 'params': {'name': '5cf89605-2e7d-4ecc-9c44-5e6f5ecb0cad'}} May 28 12:57:56 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-df7cdd80-9603-4776-b368-9726769496cf tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/share_instances/77a25e6b-f137-4342-8eb9-9ced679515e2 returned with HTTP 200 May 28 12:57:56 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 428/845] 10.27.203.238 () {64 vars in 1478 bytes} [Tue May 28 12:57:56 2024] GET /share/v2/a3499cb78849424db45e54caac01de92/share_instances/77a25e6b-f137-4342-8eb9-9ced679515e2 => generated 506 bytes in 15 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:57:56 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-c0a09eeb-da78-4dee-8f12-88703784f161 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] GET http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/shares/df0ea844-5fc1-4d04-8afb-5048ec5dc33f/instances May 28 12:57:56 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-c0a09eeb-da78-4dee-8f12-88703784f161 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:56 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-c0a09eeb-da78-4dee-8f12-88703784f161 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:56 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-c0a09eeb-da78-4dee-8f12-88703784f161 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/shares/df0ea844-5fc1-4d04-8afb-5048ec5dc33f/instances returned with HTTP 200 May 28 12:57:56 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 418/846] 10.27.203.238 () {64 vars in 1481 bytes} [Tue May 28 12:57:56 2024] GET /share/v2/a3499cb78849424db45e54caac01de92/shares/df0ea844-5fc1-4d04-8afb-5048ec5dc33f/instances => generated 509 bytes in 23 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:57:56 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-4d25cee1-06cc-48e2-a832-76f2a6c88e39 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] POST http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/share_instances/77a25e6b-f137-4342-8eb9-9ced679515e2/action May 28 12:57:56 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-4d25cee1-06cc-48e2-a832-76f2a6c88e39 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Action body: b'{"reset_status": {"status": "available"}}' {{(pid=98329) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:57:56 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-4d25cee1-06cc-48e2-a832-76f2a6c88e39 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Action: 'action', calling method: ShareInstancesController.instance_reset_status, body: {"reset_status": {"status": "available"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:57:56 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-4d25cee1-06cc-48e2-a832-76f2a6c88e39 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Updating share_instance '77a25e6b-f137-4342-8eb9-9ced679515e2' with '{'status': 'available'}' {{(pid=98329) _reset_status /opt/stack/manila/manila/api/openstack/wsgi.py:1257}} May 28 12:57:56 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-4d25cee1-06cc-48e2-a832-76f2a6c88e39 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/share_instances/77a25e6b-f137-4342-8eb9-9ced679515e2/action returned with HTTP 202 May 28 12:57:56 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 429/847] 10.27.203.238 () {66 vars in 1520 bytes} [Tue May 28 12:57:56 2024] POST /share/v2/a3499cb78849424db45e54caac01de92/share_instances/77a25e6b-f137-4342-8eb9-9ced679515e2/action => generated 0 bytes in 23 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:57:56 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-896c1a8a-b875-4cbe-8bb4-fd5ea7fcda49 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] GET http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/share_instances/77a25e6b-f137-4342-8eb9-9ced679515e2 May 28 12:57:56 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-896c1a8a-b875-4cbe-8bb4-fd5ea7fcda49 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:56 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-896c1a8a-b875-4cbe-8bb4-fd5ea7fcda49 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:56 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-896c1a8a-b875-4cbe-8bb4-fd5ea7fcda49 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/share_instances/77a25e6b-f137-4342-8eb9-9ced679515e2 returned with HTTP 200 May 28 12:57:56 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 419/848] 10.27.203.238 () {64 vars in 1478 bytes} [Tue May 28 12:57:56 2024] GET /share/v2/a3499cb78849424db45e54caac01de92/share_instances/77a25e6b-f137-4342-8eb9-9ced679515e2 => generated 506 bytes in 16 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:57:56 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-2fa0ac9e-6bcb-4abe-8e72-9728a979b575 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] POST http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/share_instances/77a25e6b-f137-4342-8eb9-9ced679515e2/action May 28 12:57:56 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-2fa0ac9e-6bcb-4abe-8e72-9728a979b575 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Action body: b'{"reset_status": {"status": "available"}}' {{(pid=98329) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:57:56 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-2fa0ac9e-6bcb-4abe-8e72-9728a979b575 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Action: 'action', calling method: ShareInstancesController.instance_reset_status, body: {"reset_status": {"status": "available"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:57:56 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-2fa0ac9e-6bcb-4abe-8e72-9728a979b575 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Updating share_instance '77a25e6b-f137-4342-8eb9-9ced679515e2' with '{'status': 'available'}' {{(pid=98329) _reset_status /opt/stack/manila/manila/api/openstack/wsgi.py:1257}} May 28 12:57:56 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-9d5c5ea6-93e4-4174-bf0a-fd51da6b7b23 tempest-SharesMetadataNegativeTest-1584039052 tempest-SharesMetadataNegativeTest-1584039052-project-member] GET http://10.27.203.238/share/v2/5e5bc0c8fb8b46d598b0621999301112/shares/12970599-4f96-41ce-abd8-18371bc51a8c May 28 12:57:56 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-9d5c5ea6-93e4-4174-bf0a-fd51da6b7b23 tempest-SharesMetadataNegativeTest-1584039052 tempest-SharesMetadataNegativeTest-1584039052-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:56 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-9d5c5ea6-93e4-4174-bf0a-fd51da6b7b23 tempest-SharesMetadataNegativeTest-1584039052 tempest-SharesMetadataNegativeTest-1584039052-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:56 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-2fa0ac9e-6bcb-4abe-8e72-9728a979b575 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/share_instances/77a25e6b-f137-4342-8eb9-9ced679515e2/action returned with HTTP 202 May 28 12:57:56 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 430/849] 10.27.203.238 () {66 vars in 1520 bytes} [Tue May 28 12:57:56 2024] POST /share/v2/a3499cb78849424db45e54caac01de92/share_instances/77a25e6b-f137-4342-8eb9-9ced679515e2/action => generated 0 bytes in 22 msecs (HTTP/1.1 202) 6 headers in 243 bytes (2 switches on core 0) May 28 12:57:56 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-82707a94-f5bd-44a7-8fbc-1bd907019298 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] GET http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/share_instances/77a25e6b-f137-4342-8eb9-9ced679515e2 May 28 12:57:56 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-82707a94-f5bd-44a7-8fbc-1bd907019298 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:56 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-82707a94-f5bd-44a7-8fbc-1bd907019298 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:56 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-82707a94-f5bd-44a7-8fbc-1bd907019298 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/share_instances/77a25e6b-f137-4342-8eb9-9ced679515e2 returned with HTTP 200 May 28 12:57:56 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 431/850] 10.27.203.238 () {64 vars in 1478 bytes} [Tue May 28 12:57:56 2024] GET /share/v2/a3499cb78849424db45e54caac01de92/share_instances/77a25e6b-f137-4342-8eb9-9ced679515e2 => generated 506 bytes in 12 msecs (HTTP/1.1 200) 6 headers in 231 bytes (2 switches on core 0) May 28 12:57:56 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-9d5c5ea6-93e4-4174-bf0a-fd51da6b7b23 tempest-SharesMetadataNegativeTest-1584039052 tempest-SharesMetadataNegativeTest-1584039052-project-member] http://10.27.203.238/share/v2/5e5bc0c8fb8b46d598b0621999301112/shares/12970599-4f96-41ce-abd8-18371bc51a8c returned with HTTP 200 May 28 12:57:56 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 420/851] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:57:56 2024] GET /share/v2/5e5bc0c8fb8b46d598b0621999301112/shares/12970599-4f96-41ce-abd8-18371bc51a8c => generated 1316 bytes in 25 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:57:56 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-b97434f5-7c6c-4f59-b45a-39c9427cb32a tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] GET http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/shares/df0ea844-5fc1-4d04-8afb-5048ec5dc33f/instances May 28 12:57:56 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-b97434f5-7c6c-4f59-b45a-39c9427cb32a tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:56 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-b97434f5-7c6c-4f59-b45a-39c9427cb32a tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:56 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-b97434f5-7c6c-4f59-b45a-39c9427cb32a tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/shares/df0ea844-5fc1-4d04-8afb-5048ec5dc33f/instances returned with HTTP 200 May 28 12:57:56 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 432/852] 10.27.203.238 () {64 vars in 1481 bytes} [Tue May 28 12:57:56 2024] GET /share/v2/a3499cb78849424db45e54caac01de92/shares/df0ea844-5fc1-4d04-8afb-5048ec5dc33f/instances => generated 509 bytes in 21 msecs (HTTP/1.1 200) 6 headers in 231 bytes (2 switches on core 0) May 28 12:57:56 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-29443e60-8855-4a3f-bd82-dd7a418f09d5 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] POST http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/share_instances/77a25e6b-f137-4342-8eb9-9ced679515e2/action May 28 12:57:56 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-29443e60-8855-4a3f-bd82-dd7a418f09d5 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Action body: b'{"reset_status": {"status": "error_deleting"}}' {{(pid=98330) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:57:56 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-29443e60-8855-4a3f-bd82-dd7a418f09d5 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Action: 'action', calling method: ShareInstancesController.instance_reset_status, body: {"reset_status": {"status": "error_deleting"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:57:56 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-29443e60-8855-4a3f-bd82-dd7a418f09d5 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Updating share_instance '77a25e6b-f137-4342-8eb9-9ced679515e2' with '{'status': 'error_deleting'}' {{(pid=98330) _reset_status /opt/stack/manila/manila/api/openstack/wsgi.py:1257}} May 28 12:57:56 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-29443e60-8855-4a3f-bd82-dd7a418f09d5 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/share_instances/77a25e6b-f137-4342-8eb9-9ced679515e2/action returned with HTTP 202 May 28 12:57:56 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 421/853] 10.27.203.238 () {66 vars in 1520 bytes} [Tue May 28 12:57:56 2024] POST /share/v2/a3499cb78849424db45e54caac01de92/share_instances/77a25e6b-f137-4342-8eb9-9ced679515e2/action => generated 0 bytes in 36 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:57:56 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-4bd4721a-0378-406d-a751-39554b26b940 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] GET http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/share_instances/77a25e6b-f137-4342-8eb9-9ced679515e2 May 28 12:57:56 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-4bd4721a-0378-406d-a751-39554b26b940 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:56 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-4bd4721a-0378-406d-a751-39554b26b940 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:56 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-4bd4721a-0378-406d-a751-39554b26b940 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/share_instances/77a25e6b-f137-4342-8eb9-9ced679515e2 returned with HTTP 200 May 28 12:57:56 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 433/854] 10.27.203.238 () {64 vars in 1478 bytes} [Tue May 28 12:57:56 2024] GET /share/v2/a3499cb78849424db45e54caac01de92/share_instances/77a25e6b-f137-4342-8eb9-9ced679515e2 => generated 511 bytes in 14 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:57:56 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-da5f745a-0726-4406-82a7-3efd46af6ee2 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] POST http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/share_instances/77a25e6b-f137-4342-8eb9-9ced679515e2/action May 28 12:57:56 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-da5f745a-0726-4406-82a7-3efd46af6ee2 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Action body: b'{"reset_status": {"status": "available"}}' {{(pid=98330) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:57:56 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-da5f745a-0726-4406-82a7-3efd46af6ee2 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Action: 'action', calling method: ShareInstancesController.instance_reset_status, body: {"reset_status": {"status": "available"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:57:56 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-da5f745a-0726-4406-82a7-3efd46af6ee2 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Updating share_instance '77a25e6b-f137-4342-8eb9-9ced679515e2' with '{'status': 'available'}' {{(pid=98330) _reset_status /opt/stack/manila/manila/api/openstack/wsgi.py:1257}} May 28 12:57:56 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-da5f745a-0726-4406-82a7-3efd46af6ee2 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/share_instances/77a25e6b-f137-4342-8eb9-9ced679515e2/action returned with HTTP 202 May 28 12:57:56 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 422/855] 10.27.203.238 () {66 vars in 1520 bytes} [Tue May 28 12:57:56 2024] POST /share/v2/a3499cb78849424db45e54caac01de92/share_instances/77a25e6b-f137-4342-8eb9-9ced679515e2/action => generated 0 bytes in 45 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:57:56 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-356fb56c-b623-4561-ac80-c779383b4ec9 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] GET http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/share_instances/77a25e6b-f137-4342-8eb9-9ced679515e2 May 28 12:57:56 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-356fb56c-b623-4561-ac80-c779383b4ec9 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:56 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-356fb56c-b623-4561-ac80-c779383b4ec9 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:56 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-356fb56c-b623-4561-ac80-c779383b4ec9 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/share_instances/77a25e6b-f137-4342-8eb9-9ced679515e2 returned with HTTP 200 May 28 12:57:56 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 434/856] 10.27.203.238 () {64 vars in 1478 bytes} [Tue May 28 12:57:56 2024] GET /share/v2/a3499cb78849424db45e54caac01de92/share_instances/77a25e6b-f137-4342-8eb9-9ced679515e2 => generated 506 bytes in 15 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:57:56 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-84bf8129-9baf-4a8a-b8f7-8c0faf5dcd06 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] GET http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/shares/df0ea844-5fc1-4d04-8afb-5048ec5dc33f/instances May 28 12:57:56 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-84bf8129-9baf-4a8a-b8f7-8c0faf5dcd06 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:56 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-84bf8129-9baf-4a8a-b8f7-8c0faf5dcd06 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:56 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-84bf8129-9baf-4a8a-b8f7-8c0faf5dcd06 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/shares/df0ea844-5fc1-4d04-8afb-5048ec5dc33f/instances returned with HTTP 200 May 28 12:57:56 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 423/857] 10.27.203.238 () {64 vars in 1481 bytes} [Tue May 28 12:57:56 2024] GET /share/v2/a3499cb78849424db45e54caac01de92/shares/df0ea844-5fc1-4d04-8afb-5048ec5dc33f/instances => generated 509 bytes in 26 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:57:56 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-5bd4d7c1-c1e6-466e-9e16-603ddb67c4de tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] POST http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/share_instances/77a25e6b-f137-4342-8eb9-9ced679515e2/action May 28 12:57:56 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-5bd4d7c1-c1e6-466e-9e16-603ddb67c4de tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Action body: b'{"reset_status": {"status": "deleting"}}' {{(pid=98329) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:57:56 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-5bd4d7c1-c1e6-466e-9e16-603ddb67c4de tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Action: 'action', calling method: ShareInstancesController.instance_reset_status, body: {"reset_status": {"status": "deleting"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:57:56 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-5bd4d7c1-c1e6-466e-9e16-603ddb67c4de tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Updating share_instance '77a25e6b-f137-4342-8eb9-9ced679515e2' with '{'status': 'deleting'}' {{(pid=98329) _reset_status /opt/stack/manila/manila/api/openstack/wsgi.py:1257}} May 28 12:57:56 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-76972c49-a34a-4521-9461-6779c9626726 tempest-SharesMetadataTest-1561320255 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:57:56 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-76972c49-a34a-4521-9461-6779c9626726 tempest-SharesMetadataTest-1561320255 None] [Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=0, created='2024-05-28T12:57:44.088708Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='24d37600-809f-4b98-9af6-3f21c6f81002', id=22, internal=False, is_s3_default_policy=False, name='5cf89605-2e7d-4ecc-9c44-5e6f5ecb0cad', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=[], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['*'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['*'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T12:57:44.426635Z', tenant_id=1, tenant_name='default', title='5cf89605-2e7d-4ecc-9c44-5e6f5ecb0cad', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/22/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[])] May 28 12:57:56 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-76972c49-a34a-4521-9461-6779c9626726 tempest-SharesMetadataTest-1561320255 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 12:57:56 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-76972c49-a34a-4521-9461-6779c9626726 tempest-SharesMetadataTest-1561320255 None] >>> [DELETE] https://127.0.0.1:40443/api/viewpolicies/22/ May 28 12:57:56 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-5bd4d7c1-c1e6-466e-9e16-603ddb67c4de tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/share_instances/77a25e6b-f137-4342-8eb9-9ced679515e2/action returned with HTTP 202 May 28 12:57:56 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 435/858] 10.27.203.238 () {66 vars in 1520 bytes} [Tue May 28 12:57:56 2024] POST /share/v2/a3499cb78849424db45e54caac01de92/share_instances/77a25e6b-f137-4342-8eb9-9ced679515e2/action => generated 0 bytes in 49 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:57:56 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-6a3c3acd-4cfc-4548-a740-0a2dda46508a tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] GET http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/share_instances/77a25e6b-f137-4342-8eb9-9ced679515e2 May 28 12:57:56 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-6a3c3acd-4cfc-4548-a740-0a2dda46508a tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:56 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-6a3c3acd-4cfc-4548-a740-0a2dda46508a tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:56 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-6a3c3acd-4cfc-4548-a740-0a2dda46508a tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/share_instances/77a25e6b-f137-4342-8eb9-9ced679515e2 returned with HTTP 200 May 28 12:57:56 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 424/859] 10.27.203.238 () {64 vars in 1478 bytes} [Tue May 28 12:57:56 2024] GET /share/v2/a3499cb78849424db45e54caac01de92/share_instances/77a25e6b-f137-4342-8eb9-9ced679515e2 => generated 505 bytes in 15 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:57:56 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-3ad94e71-334c-46b9-a1a6-185a0b9d95f2 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] POST http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/share_instances/77a25e6b-f137-4342-8eb9-9ced679515e2/action May 28 12:57:56 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-3ad94e71-334c-46b9-a1a6-185a0b9d95f2 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Action body: b'{"reset_status": {"status": "available"}}' {{(pid=98329) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:57:56 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-3ad94e71-334c-46b9-a1a6-185a0b9d95f2 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Action: 'action', calling method: ShareInstancesController.instance_reset_status, body: {"reset_status": {"status": "available"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:57:56 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-3ad94e71-334c-46b9-a1a6-185a0b9d95f2 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Updating share_instance '77a25e6b-f137-4342-8eb9-9ced679515e2' with '{'status': 'available'}' {{(pid=98329) _reset_status /opt/stack/manila/manila/api/openstack/wsgi.py:1257}} May 28 12:57:56 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c5d3c5e1-db68-40f3-b16b-4a24d7dc03e1 tempest-SharesMetadataNegativeTest-1584039052 None] <<< [DELETE] https://127.0.0.1:40443/api/quotas/20/ May 28 12:57:56 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c5d3c5e1-db68-40f3-b16b-4a24d7dc03e1 tempest-SharesMetadataNegativeTest-1584039052 None] --- [DELETE] https://127.0.0.1:40443/api/quotas/20/: Done May 28 12:57:56 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c5d3c5e1-db68-40f3-b16b-4a24d7dc03e1 tempest-SharesMetadataNegativeTest-1584039052 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:57:56 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c5d3c5e1-db68-40f3-b16b-4a24d7dc03e1 tempest-SharesMetadataNegativeTest-1584039052 None] {'allow_redirects': True, May 28 12:57:56 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c5d3c5e1-db68-40f3-b16b-4a24d7dc03e1 tempest-SharesMetadataNegativeTest-1584039052 None] 'params': {'name': '9e93e444-3013-4370-9caa-9f912c5201e6'}} May 28 12:57:56 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-3ad94e71-334c-46b9-a1a6-185a0b9d95f2 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/share_instances/77a25e6b-f137-4342-8eb9-9ced679515e2/action returned with HTTP 202 May 28 12:57:56 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 436/860] 10.27.203.238 () {66 vars in 1520 bytes} [Tue May 28 12:57:56 2024] POST /share/v2/a3499cb78849424db45e54caac01de92/share_instances/77a25e6b-f137-4342-8eb9-9ced679515e2/action => generated 0 bytes in 31 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:57:56 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-771058f1-8d1d-4b6b-831c-0233bfe6f753 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] GET http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/share_instances/77a25e6b-f137-4342-8eb9-9ced679515e2 May 28 12:57:56 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-771058f1-8d1d-4b6b-831c-0233bfe6f753 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:56 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-771058f1-8d1d-4b6b-831c-0233bfe6f753 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:56 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-771058f1-8d1d-4b6b-831c-0233bfe6f753 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/share_instances/77a25e6b-f137-4342-8eb9-9ced679515e2 returned with HTTP 200 May 28 12:57:56 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 425/861] 10.27.203.238 () {64 vars in 1478 bytes} [Tue May 28 12:57:56 2024] GET /share/v2/a3499cb78849424db45e54caac01de92/share_instances/77a25e6b-f137-4342-8eb9-9ced679515e2 => generated 506 bytes in 14 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:57:56 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-8517321a-5c2a-41f7-a507-72ff19b0828a tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] GET http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/shares/df0ea844-5fc1-4d04-8afb-5048ec5dc33f/instances May 28 12:57:56 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-8517321a-5c2a-41f7-a507-72ff19b0828a tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:56 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-8517321a-5c2a-41f7-a507-72ff19b0828a tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:56 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-8517321a-5c2a-41f7-a507-72ff19b0828a tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/shares/df0ea844-5fc1-4d04-8afb-5048ec5dc33f/instances returned with HTTP 200 May 28 12:57:56 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 437/862] 10.27.203.238 () {64 vars in 1481 bytes} [Tue May 28 12:57:56 2024] GET /share/v2/a3499cb78849424db45e54caac01de92/shares/df0ea844-5fc1-4d04-8afb-5048ec5dc33f/instances => generated 509 bytes in 23 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:57:56 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-15829a66-3d4f-4377-8445-07239e5629c6 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] POST http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/share_instances/77a25e6b-f137-4342-8eb9-9ced679515e2/action May 28 12:57:56 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-15829a66-3d4f-4377-8445-07239e5629c6 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Action body: b'{"reset_status": {"status": "creating"}}' {{(pid=98330) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:57:56 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-15829a66-3d4f-4377-8445-07239e5629c6 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Action: 'action', calling method: ShareInstancesController.instance_reset_status, body: {"reset_status": {"status": "creating"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:57:56 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-15829a66-3d4f-4377-8445-07239e5629c6 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Updating share_instance '77a25e6b-f137-4342-8eb9-9ced679515e2' with '{'status': 'creating'}' {{(pid=98330) _reset_status /opt/stack/manila/manila/api/openstack/wsgi.py:1257}} May 28 12:57:56 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-15829a66-3d4f-4377-8445-07239e5629c6 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/share_instances/77a25e6b-f137-4342-8eb9-9ced679515e2/action returned with HTTP 202 May 28 12:57:56 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 426/863] 10.27.203.238 () {66 vars in 1520 bytes} [Tue May 28 12:57:56 2024] POST /share/v2/a3499cb78849424db45e54caac01de92/share_instances/77a25e6b-f137-4342-8eb9-9ced679515e2/action => generated 0 bytes in 30 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:57:56 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-5672d668-dfa6-461e-baef-8683c7855092 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] GET http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/share_instances/77a25e6b-f137-4342-8eb9-9ced679515e2 May 28 12:57:56 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-5672d668-dfa6-461e-baef-8683c7855092 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:56 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-5672d668-dfa6-461e-baef-8683c7855092 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:56 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-5672d668-dfa6-461e-baef-8683c7855092 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/share_instances/77a25e6b-f137-4342-8eb9-9ced679515e2 returned with HTTP 200 May 28 12:57:56 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 438/864] 10.27.203.238 () {64 vars in 1478 bytes} [Tue May 28 12:57:56 2024] GET /share/v2/a3499cb78849424db45e54caac01de92/share_instances/77a25e6b-f137-4342-8eb9-9ced679515e2 => generated 505 bytes in 14 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:57:56 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-e8f6f192-92a2-44e6-90d2-28431b2afe85 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] POST http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/share_instances/77a25e6b-f137-4342-8eb9-9ced679515e2/action May 28 12:57:56 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-e8f6f192-92a2-44e6-90d2-28431b2afe85 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Action body: b'{"reset_status": {"status": "available"}}' {{(pid=98330) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:57:56 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-e8f6f192-92a2-44e6-90d2-28431b2afe85 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Action: 'action', calling method: ShareInstancesController.instance_reset_status, body: {"reset_status": {"status": "available"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:57:56 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-e8f6f192-92a2-44e6-90d2-28431b2afe85 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Updating share_instance '77a25e6b-f137-4342-8eb9-9ced679515e2' with '{'status': 'available'}' {{(pid=98330) _reset_status /opt/stack/manila/manila/api/openstack/wsgi.py:1257}} May 28 12:57:56 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-e8f6f192-92a2-44e6-90d2-28431b2afe85 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/share_instances/77a25e6b-f137-4342-8eb9-9ced679515e2/action returned with HTTP 202 May 28 12:57:56 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 427/865] 10.27.203.238 () {66 vars in 1520 bytes} [Tue May 28 12:57:56 2024] POST /share/v2/a3499cb78849424db45e54caac01de92/share_instances/77a25e6b-f137-4342-8eb9-9ced679515e2/action => generated 0 bytes in 31 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:57:56 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-72286f33-e4ce-499a-9680-6268aaf2e949 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] GET http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/share_instances/77a25e6b-f137-4342-8eb9-9ced679515e2 May 28 12:57:56 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-72286f33-e4ce-499a-9680-6268aaf2e949 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:56 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-72286f33-e4ce-499a-9680-6268aaf2e949 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:56 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-72286f33-e4ce-499a-9680-6268aaf2e949 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/share_instances/77a25e6b-f137-4342-8eb9-9ced679515e2 returned with HTTP 200 May 28 12:57:56 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 439/866] 10.27.203.238 () {64 vars in 1478 bytes} [Tue May 28 12:57:56 2024] GET /share/v2/a3499cb78849424db45e54caac01de92/share_instances/77a25e6b-f137-4342-8eb9-9ced679515e2 => generated 506 bytes in 14 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:57:56 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-9499bcbb-fb7b-4c3b-b327-a1ff3e55f149 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] POST http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/shares/df0ea844-5fc1-4d04-8afb-5048ec5dc33f/action May 28 12:57:56 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-9499bcbb-fb7b-4c3b-b327-a1ff3e55f149 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Action body: b'{"reset_status": {"status": "error"}}' {{(pid=98330) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:57:56 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-9499bcbb-fb7b-4c3b-b327-a1ff3e55f149 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Action: 'action', calling method: ShareController.share_reset_status, body: {"reset_status": {"status": "error"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:57:56 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-9499bcbb-fb7b-4c3b-b327-a1ff3e55f149 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Updating share 'df0ea844-5fc1-4d04-8afb-5048ec5dc33f' with '{'status': 'error'}' {{(pid=98330) _reset_status /opt/stack/manila/manila/api/openstack/wsgi.py:1257}} May 28 12:57:56 l75lg1-v1 neutron-server[77618]: DEBUG dbcounter [-] [77618] Writing DB stats neutron:SELECT=1 {{(pid=77618) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:57:56 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-9499bcbb-fb7b-4c3b-b327-a1ff3e55f149 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/shares/df0ea844-5fc1-4d04-8afb-5048ec5dc33f/action returned with HTTP 202 May 28 12:57:56 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 428/867] 10.27.203.238 () {66 vars in 1493 bytes} [Tue May 28 12:57:56 2024] POST /share/v2/a3499cb78849424db45e54caac01de92/shares/df0ea844-5fc1-4d04-8afb-5048ec5dc33f/action => generated 0 bytes in 54 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:57:56 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-d3574ddb-96b9-41a9-a449-c8f734949d98 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] GET http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/shares/df0ea844-5fc1-4d04-8afb-5048ec5dc33f May 28 12:57:56 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-d3574ddb-96b9-41a9-a449-c8f734949d98 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:56 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-d3574ddb-96b9-41a9-a449-c8f734949d98 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:56 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-d3574ddb-96b9-41a9-a449-c8f734949d98 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/shares/df0ea844-5fc1-4d04-8afb-5048ec5dc33f returned with HTTP 200 May 28 12:57:56 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 440/868] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:57:56 2024] GET /share/v2/a3499cb78849424db45e54caac01de92/shares/df0ea844-5fc1-4d04-8afb-5048ec5dc33f => generated 1367 bytes in 26 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:57:56 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-91e16738-9089-4af8-a5af-f332ce55778b tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] POST http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/shares/df0ea844-5fc1-4d04-8afb-5048ec5dc33f/action May 28 12:57:56 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-91e16738-9089-4af8-a5af-f332ce55778b tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Action body: b'{"reset_status": {"status": "available"}}' {{(pid=98330) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:57:56 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-91e16738-9089-4af8-a5af-f332ce55778b tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Action: 'action', calling method: ShareController.share_reset_status, body: {"reset_status": {"status": "available"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:57:56 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-91e16738-9089-4af8-a5af-f332ce55778b tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Updating share 'df0ea844-5fc1-4d04-8afb-5048ec5dc33f' with '{'status': 'available'}' {{(pid=98330) _reset_status /opt/stack/manila/manila/api/openstack/wsgi.py:1257}} May 28 12:57:57 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-91e16738-9089-4af8-a5af-f332ce55778b tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/shares/df0ea844-5fc1-4d04-8afb-5048ec5dc33f/action returned with HTTP 202 May 28 12:57:57 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 429/869] 10.27.203.238 () {66 vars in 1493 bytes} [Tue May 28 12:57:56 2024] POST /share/v2/a3499cb78849424db45e54caac01de92/shares/df0ea844-5fc1-4d04-8afb-5048ec5dc33f/action => generated 0 bytes in 55 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:57:57 l75lg1-v1 neutron-server[77618]: DEBUG dbcounter [-] [77618] Writing DB stats neutron:SELECT=2 {{(pid=77618) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:57:57 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-60b6775f-c4d9-47ee-9ef5-c7eb38b53ea0 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] GET http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/shares/df0ea844-5fc1-4d04-8afb-5048ec5dc33f May 28 12:57:57 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-60b6775f-c4d9-47ee-9ef5-c7eb38b53ea0 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:57 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-60b6775f-c4d9-47ee-9ef5-c7eb38b53ea0 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:57 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-60b6775f-c4d9-47ee-9ef5-c7eb38b53ea0 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/shares/df0ea844-5fc1-4d04-8afb-5048ec5dc33f returned with HTTP 200 May 28 12:57:57 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 441/870] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:57:57 2024] GET /share/v2/a3499cb78849424db45e54caac01de92/shares/df0ea844-5fc1-4d04-8afb-5048ec5dc33f => generated 1371 bytes in 24 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:57:57 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-ee5ce7eb-c461-4a93-816a-9b1bf23bdde1 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] POST http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/shares/df0ea844-5fc1-4d04-8afb-5048ec5dc33f/action May 28 12:57:57 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-ee5ce7eb-c461-4a93-816a-9b1bf23bdde1 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Action body: b'{"reset_status": {"status": "available"}}' {{(pid=98330) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:57:57 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-ee5ce7eb-c461-4a93-816a-9b1bf23bdde1 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Action: 'action', calling method: ShareController.share_reset_status, body: {"reset_status": {"status": "available"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:57:57 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-ee5ce7eb-c461-4a93-816a-9b1bf23bdde1 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Updating share 'df0ea844-5fc1-4d04-8afb-5048ec5dc33f' with '{'status': 'available'}' {{(pid=98330) _reset_status /opt/stack/manila/manila/api/openstack/wsgi.py:1257}} May 28 12:57:57 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-ee5ce7eb-c461-4a93-816a-9b1bf23bdde1 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/shares/df0ea844-5fc1-4d04-8afb-5048ec5dc33f/action returned with HTTP 202 May 28 12:57:57 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 430/871] 10.27.203.238 () {66 vars in 1493 bytes} [Tue May 28 12:57:57 2024] POST /share/v2/a3499cb78849424db45e54caac01de92/shares/df0ea844-5fc1-4d04-8afb-5048ec5dc33f/action => generated 0 bytes in 47 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:57:57 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-525afc4e-5de4-4b54-864d-949bcd3b4619 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] GET http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/shares/df0ea844-5fc1-4d04-8afb-5048ec5dc33f May 28 12:57:57 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-525afc4e-5de4-4b54-864d-949bcd3b4619 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:57 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-525afc4e-5de4-4b54-864d-949bcd3b4619 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:57 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-525afc4e-5de4-4b54-864d-949bcd3b4619 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/shares/df0ea844-5fc1-4d04-8afb-5048ec5dc33f returned with HTTP 200 May 28 12:57:57 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 442/872] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:57:57 2024] GET /share/v2/a3499cb78849424db45e54caac01de92/shares/df0ea844-5fc1-4d04-8afb-5048ec5dc33f => generated 1371 bytes in 24 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:57:57 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-9c2d3233-8642-47c3-84f5-c3f1fe652cd5 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] POST http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/shares/df0ea844-5fc1-4d04-8afb-5048ec5dc33f/action May 28 12:57:57 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-9c2d3233-8642-47c3-84f5-c3f1fe652cd5 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Action body: b'{"reset_status": {"status": "available"}}' {{(pid=98330) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:57:57 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-9c2d3233-8642-47c3-84f5-c3f1fe652cd5 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Action: 'action', calling method: ShareController.share_reset_status, body: {"reset_status": {"status": "available"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:57:57 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-9c2d3233-8642-47c3-84f5-c3f1fe652cd5 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Updating share 'df0ea844-5fc1-4d04-8afb-5048ec5dc33f' with '{'status': 'available'}' {{(pid=98330) _reset_status /opt/stack/manila/manila/api/openstack/wsgi.py:1257}} May 28 12:57:57 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-9c2d3233-8642-47c3-84f5-c3f1fe652cd5 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/shares/df0ea844-5fc1-4d04-8afb-5048ec5dc33f/action returned with HTTP 202 May 28 12:57:57 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 431/873] 10.27.203.238 () {66 vars in 1493 bytes} [Tue May 28 12:57:57 2024] POST /share/v2/a3499cb78849424db45e54caac01de92/shares/df0ea844-5fc1-4d04-8afb-5048ec5dc33f/action => generated 0 bytes in 46 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:57:57 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-3ea78526-595e-446d-b259-25577976f4f0 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] GET http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/shares/df0ea844-5fc1-4d04-8afb-5048ec5dc33f May 28 12:57:57 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-3ea78526-595e-446d-b259-25577976f4f0 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:57 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-3ea78526-595e-446d-b259-25577976f4f0 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:57 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-3ea78526-595e-446d-b259-25577976f4f0 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/shares/df0ea844-5fc1-4d04-8afb-5048ec5dc33f returned with HTTP 200 May 28 12:57:57 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 443/874] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:57:57 2024] GET /share/v2/a3499cb78849424db45e54caac01de92/shares/df0ea844-5fc1-4d04-8afb-5048ec5dc33f => generated 1371 bytes in 25 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:57:57 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-a5da08c4-6da1-433e-87e3-0427d21ba129 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] POST http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/shares/df0ea844-5fc1-4d04-8afb-5048ec5dc33f/action May 28 12:57:57 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-a5da08c4-6da1-433e-87e3-0427d21ba129 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Action body: b'{"reset_status": {"status": "error_deleting"}}' {{(pid=98330) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:57:57 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-a5da08c4-6da1-433e-87e3-0427d21ba129 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Action: 'action', calling method: ShareController.share_reset_status, body: {"reset_status": {"status": "error_deleting"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:57:57 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-a5da08c4-6da1-433e-87e3-0427d21ba129 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Updating share 'df0ea844-5fc1-4d04-8afb-5048ec5dc33f' with '{'status': 'error_deleting'}' {{(pid=98330) _reset_status /opt/stack/manila/manila/api/openstack/wsgi.py:1257}} May 28 12:57:57 l75lg1-v1 dstat.sh[49771]: 28-05 12:57:57| 11 1 86 2 0|5706M 1782M 277M 7859M| 23k 19k| 0 1664k| 0 225 |6247 9735 |1.45 1.07 1.01|3.0 0 0| 0 0 | 0 2048M| 29 356 0 62 0 May 28 12:57:57 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-a5da08c4-6da1-433e-87e3-0427d21ba129 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/shares/df0ea844-5fc1-4d04-8afb-5048ec5dc33f/action returned with HTTP 202 May 28 12:57:57 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 432/875] 10.27.203.238 () {66 vars in 1493 bytes} [Tue May 28 12:57:57 2024] POST /share/v2/a3499cb78849424db45e54caac01de92/shares/df0ea844-5fc1-4d04-8afb-5048ec5dc33f/action => generated 0 bytes in 60 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:57:57 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c5d3c5e1-db68-40f3-b16b-4a24d7dc03e1 tempest-SharesMetadataNegativeTest-1584039052 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:57:57 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c5d3c5e1-db68-40f3-b16b-4a24d7dc03e1 tempest-SharesMetadataNegativeTest-1584039052 None] [Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=0, created='2024-05-28T12:57:44.861869Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='12459ef8-d17b-4bf0-8edc-1e7e86135440', id=23, internal=False, is_s3_default_policy=False, name='9e93e444-3013-4370-9caa-9f912c5201e6', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=[], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['*'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['*'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T12:57:45.276765Z', tenant_id=1, tenant_name='default', title='9e93e444-3013-4370-9caa-9f912c5201e6', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/23/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[])] May 28 12:57:57 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c5d3c5e1-db68-40f3-b16b-4a24d7dc03e1 tempest-SharesMetadataNegativeTest-1584039052 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 12:57:57 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c5d3c5e1-db68-40f3-b16b-4a24d7dc03e1 tempest-SharesMetadataNegativeTest-1584039052 None] >>> [DELETE] https://127.0.0.1:40443/api/viewpolicies/23/ May 28 12:57:57 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-3c815d5f-8095-4a97-8ef0-184cf6a0736b tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] GET http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/shares/df0ea844-5fc1-4d04-8afb-5048ec5dc33f May 28 12:57:57 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-3c815d5f-8095-4a97-8ef0-184cf6a0736b tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:57 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-3c815d5f-8095-4a97-8ef0-184cf6a0736b tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:57 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-3c815d5f-8095-4a97-8ef0-184cf6a0736b tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/shares/df0ea844-5fc1-4d04-8afb-5048ec5dc33f returned with HTTP 200 May 28 12:57:57 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 444/876] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:57:57 2024] GET /share/v2/a3499cb78849424db45e54caac01de92/shares/df0ea844-5fc1-4d04-8afb-5048ec5dc33f => generated 1376 bytes in 24 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:57:57 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-db2a778b-1dc0-4006-ade0-62af6bbf7850 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] POST http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/shares/df0ea844-5fc1-4d04-8afb-5048ec5dc33f/action May 28 12:57:57 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-db2a778b-1dc0-4006-ade0-62af6bbf7850 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Action body: b'{"reset_status": {"status": "available"}}' {{(pid=98330) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:57:57 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-db2a778b-1dc0-4006-ade0-62af6bbf7850 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Action: 'action', calling method: ShareController.share_reset_status, body: {"reset_status": {"status": "available"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:57:57 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-db2a778b-1dc0-4006-ade0-62af6bbf7850 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Updating share 'df0ea844-5fc1-4d04-8afb-5048ec5dc33f' with '{'status': 'available'}' {{(pid=98330) _reset_status /opt/stack/manila/manila/api/openstack/wsgi.py:1257}} May 28 12:57:57 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-db2a778b-1dc0-4006-ade0-62af6bbf7850 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/shares/df0ea844-5fc1-4d04-8afb-5048ec5dc33f/action returned with HTTP 202 May 28 12:57:57 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 433/877] 10.27.203.238 () {66 vars in 1493 bytes} [Tue May 28 12:57:57 2024] POST /share/v2/a3499cb78849424db45e54caac01de92/shares/df0ea844-5fc1-4d04-8afb-5048ec5dc33f/action => generated 0 bytes in 56 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:57:57 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-f04c7dc2-652e-4c08-9826-4557b7a84297 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] GET http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/shares/df0ea844-5fc1-4d04-8afb-5048ec5dc33f May 28 12:57:57 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-f04c7dc2-652e-4c08-9826-4557b7a84297 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:57 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-f04c7dc2-652e-4c08-9826-4557b7a84297 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:57 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-f04c7dc2-652e-4c08-9826-4557b7a84297 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/shares/df0ea844-5fc1-4d04-8afb-5048ec5dc33f returned with HTTP 200 May 28 12:57:57 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 445/878] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:57:57 2024] GET /share/v2/a3499cb78849424db45e54caac01de92/shares/df0ea844-5fc1-4d04-8afb-5048ec5dc33f => generated 1371 bytes in 24 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:57:57 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-84836dbc-8a33-4632-9baf-f111e58ee7ef tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] POST http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/shares/df0ea844-5fc1-4d04-8afb-5048ec5dc33f/action May 28 12:57:57 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-84836dbc-8a33-4632-9baf-f111e58ee7ef tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Action body: b'{"reset_status": {"status": "deleting"}}' {{(pid=98330) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:57:57 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-84836dbc-8a33-4632-9baf-f111e58ee7ef tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Action: 'action', calling method: ShareController.share_reset_status, body: {"reset_status": {"status": "deleting"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:57:57 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-84836dbc-8a33-4632-9baf-f111e58ee7ef tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Updating share 'df0ea844-5fc1-4d04-8afb-5048ec5dc33f' with '{'status': 'deleting'}' {{(pid=98330) _reset_status /opt/stack/manila/manila/api/openstack/wsgi.py:1257}} May 28 12:57:57 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-84836dbc-8a33-4632-9baf-f111e58ee7ef tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/shares/df0ea844-5fc1-4d04-8afb-5048ec5dc33f/action returned with HTTP 202 May 28 12:57:57 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 434/879] 10.27.203.238 () {66 vars in 1493 bytes} [Tue May 28 12:57:57 2024] POST /share/v2/a3499cb78849424db45e54caac01de92/shares/df0ea844-5fc1-4d04-8afb-5048ec5dc33f/action => generated 0 bytes in 58 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:57:57 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-7659b1f3-2227-4136-aaf8-c203120c16d0 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] GET http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/shares/df0ea844-5fc1-4d04-8afb-5048ec5dc33f May 28 12:57:57 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-7659b1f3-2227-4136-aaf8-c203120c16d0 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:57 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-7659b1f3-2227-4136-aaf8-c203120c16d0 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:57 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-7659b1f3-2227-4136-aaf8-c203120c16d0 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/shares/df0ea844-5fc1-4d04-8afb-5048ec5dc33f returned with HTTP 200 May 28 12:57:57 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 446/880] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:57:57 2024] GET /share/v2/a3499cb78849424db45e54caac01de92/shares/df0ea844-5fc1-4d04-8afb-5048ec5dc33f => generated 1370 bytes in 23 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:57:57 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-dbcc2f02-c89d-4edd-9ffb-048cdb50d485 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] POST http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/shares/df0ea844-5fc1-4d04-8afb-5048ec5dc33f/action May 28 12:57:57 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-dbcc2f02-c89d-4edd-9ffb-048cdb50d485 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Action body: b'{"reset_status": {"status": "available"}}' {{(pid=98330) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:57:57 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-dbcc2f02-c89d-4edd-9ffb-048cdb50d485 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Action: 'action', calling method: ShareController.share_reset_status, body: {"reset_status": {"status": "available"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:57:57 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-dbcc2f02-c89d-4edd-9ffb-048cdb50d485 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Updating share 'df0ea844-5fc1-4d04-8afb-5048ec5dc33f' with '{'status': 'available'}' {{(pid=98330) _reset_status /opt/stack/manila/manila/api/openstack/wsgi.py:1257}} May 28 12:57:57 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-dbcc2f02-c89d-4edd-9ffb-048cdb50d485 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/shares/df0ea844-5fc1-4d04-8afb-5048ec5dc33f/action returned with HTTP 202 May 28 12:57:57 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 435/881] 10.27.203.238 () {66 vars in 1493 bytes} [Tue May 28 12:57:57 2024] POST /share/v2/a3499cb78849424db45e54caac01de92/shares/df0ea844-5fc1-4d04-8afb-5048ec5dc33f/action => generated 0 bytes in 59 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:57:57 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-a95938cc-7045-4f3b-b2c2-02ad1f301794 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] GET http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/shares/df0ea844-5fc1-4d04-8afb-5048ec5dc33f May 28 12:57:57 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-a95938cc-7045-4f3b-b2c2-02ad1f301794 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:57 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-a95938cc-7045-4f3b-b2c2-02ad1f301794 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:57 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-a95938cc-7045-4f3b-b2c2-02ad1f301794 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/shares/df0ea844-5fc1-4d04-8afb-5048ec5dc33f returned with HTTP 200 May 28 12:57:57 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 447/882] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:57:57 2024] GET /share/v2/a3499cb78849424db45e54caac01de92/shares/df0ea844-5fc1-4d04-8afb-5048ec5dc33f => generated 1371 bytes in 24 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:57:57 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-3b5bc9a0-8810-49f4-9d41-bf7e2c2381f5 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] POST http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/shares/df0ea844-5fc1-4d04-8afb-5048ec5dc33f/action May 28 12:57:57 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-3b5bc9a0-8810-49f4-9d41-bf7e2c2381f5 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Action body: b'{"reset_status": {"status": "creating"}}' {{(pid=98330) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:57:57 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-3b5bc9a0-8810-49f4-9d41-bf7e2c2381f5 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Action: 'action', calling method: ShareController.share_reset_status, body: {"reset_status": {"status": "creating"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:57:57 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-3b5bc9a0-8810-49f4-9d41-bf7e2c2381f5 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Updating share 'df0ea844-5fc1-4d04-8afb-5048ec5dc33f' with '{'status': 'creating'}' {{(pid=98330) _reset_status /opt/stack/manila/manila/api/openstack/wsgi.py:1257}} May 28 12:57:57 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-3b5bc9a0-8810-49f4-9d41-bf7e2c2381f5 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/shares/df0ea844-5fc1-4d04-8afb-5048ec5dc33f/action returned with HTTP 202 May 28 12:57:57 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 436/883] 10.27.203.238 () {66 vars in 1493 bytes} [Tue May 28 12:57:57 2024] POST /share/v2/a3499cb78849424db45e54caac01de92/shares/df0ea844-5fc1-4d04-8afb-5048ec5dc33f/action => generated 0 bytes in 54 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:57:57 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-d4f6292a-cf05-4fba-89df-fd9fd7e2c190 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] GET http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/shares/df0ea844-5fc1-4d04-8afb-5048ec5dc33f May 28 12:57:57 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-d4f6292a-cf05-4fba-89df-fd9fd7e2c190 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:57 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-d4f6292a-cf05-4fba-89df-fd9fd7e2c190 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:57 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-d4f6292a-cf05-4fba-89df-fd9fd7e2c190 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/shares/df0ea844-5fc1-4d04-8afb-5048ec5dc33f returned with HTTP 200 May 28 12:57:57 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 448/884] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:57:57 2024] GET /share/v2/a3499cb78849424db45e54caac01de92/shares/df0ea844-5fc1-4d04-8afb-5048ec5dc33f => generated 1370 bytes in 24 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:57:57 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-f5b995b9-f2ee-42c3-8205-9e920b415173 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] POST http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/shares/df0ea844-5fc1-4d04-8afb-5048ec5dc33f/action May 28 12:57:57 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-f5b995b9-f2ee-42c3-8205-9e920b415173 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Action body: b'{"reset_status": {"status": "available"}}' {{(pid=98330) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:57:57 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-f5b995b9-f2ee-42c3-8205-9e920b415173 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Action: 'action', calling method: ShareController.share_reset_status, body: {"reset_status": {"status": "available"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:57:57 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-f5b995b9-f2ee-42c3-8205-9e920b415173 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Updating share 'df0ea844-5fc1-4d04-8afb-5048ec5dc33f' with '{'status': 'available'}' {{(pid=98330) _reset_status /opt/stack/manila/manila/api/openstack/wsgi.py:1257}} May 28 12:57:57 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-f5b995b9-f2ee-42c3-8205-9e920b415173 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/shares/df0ea844-5fc1-4d04-8afb-5048ec5dc33f/action returned with HTTP 202 May 28 12:57:57 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 437/885] 10.27.203.238 () {66 vars in 1493 bytes} [Tue May 28 12:57:57 2024] POST /share/v2/a3499cb78849424db45e54caac01de92/shares/df0ea844-5fc1-4d04-8afb-5048ec5dc33f/action => generated 0 bytes in 57 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:57:57 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-d46524bd-9a43-472e-af4e-b6f0369e1b5a tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] GET http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/shares/df0ea844-5fc1-4d04-8afb-5048ec5dc33f May 28 12:57:57 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-d46524bd-9a43-472e-af4e-b6f0369e1b5a tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:57 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-d46524bd-9a43-472e-af4e-b6f0369e1b5a tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:57 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-d46524bd-9a43-472e-af4e-b6f0369e1b5a tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/shares/df0ea844-5fc1-4d04-8afb-5048ec5dc33f returned with HTTP 200 May 28 12:57:57 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 449/886] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:57:57 2024] GET /share/v2/a3499cb78849424db45e54caac01de92/shares/df0ea844-5fc1-4d04-8afb-5048ec5dc33f => generated 1371 bytes in 27 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:57:57 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-07cd320f-408f-47c1-a5ef-d5a8c4aabb18 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] POST http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/shares/df0ea844-5fc1-4d04-8afb-5048ec5dc33f/action May 28 12:57:57 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-07cd320f-408f-47c1-a5ef-d5a8c4aabb18 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Action body: b'{"reset_task_state": {"task_state": "migration_starting"}}' {{(pid=98330) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:57:57 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-07cd320f-408f-47c1-a5ef-d5a8c4aabb18 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Action: 'action', calling method: Controller.__getattribute__..version_select, body: {"reset_task_state": {"task_state": "migration_starting"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:57:57 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-07cd320f-408f-47c1-a5ef-d5a8c4aabb18 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Updating share 'df0ea844-5fc1-4d04-8afb-5048ec5dc33f' with '{'task_state': 'migration_starting'}' {{(pid=98330) _reset_status /opt/stack/manila/manila/api/openstack/wsgi.py:1257}} May 28 12:57:57 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-07cd320f-408f-47c1-a5ef-d5a8c4aabb18 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/shares/df0ea844-5fc1-4d04-8afb-5048ec5dc33f/action returned with HTTP 202 May 28 12:57:57 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 438/887] 10.27.203.238 () {68 vars in 1541 bytes} [Tue May 28 12:57:57 2024] POST /share/v2/a3499cb78849424db45e54caac01de92/shares/df0ea844-5fc1-4d04-8afb-5048ec5dc33f/action => generated 0 bytes in 71 msecs (HTTP/1.1 202) 7 headers in 286 bytes (1 switches on core 0) May 28 12:57:57 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-a47519a7-c255-415c-9c4b-13c4feefa26c tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] GET http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/shares/df0ea844-5fc1-4d04-8afb-5048ec5dc33f May 28 12:57:57 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-a47519a7-c255-415c-9c4b-13c4feefa26c tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:57 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-a47519a7-c255-415c-9c4b-13c4feefa26c tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:57 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-a47519a7-c255-415c-9c4b-13c4feefa26c tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/shares/df0ea844-5fc1-4d04-8afb-5048ec5dc33f returned with HTTP 200 May 28 12:57:57 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 450/888] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:57:57 2024] GET /share/v2/a3499cb78849424db45e54caac01de92/shares/df0ea844-5fc1-4d04-8afb-5048ec5dc33f => generated 1387 bytes in 23 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:57:57 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-09bed8b5-c01e-4a9d-8772-4bc05ed55061 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] POST http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/shares/df0ea844-5fc1-4d04-8afb-5048ec5dc33f/action May 28 12:57:57 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-09bed8b5-c01e-4a9d-8772-4bc05ed55061 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Action body: b'{"reset_task_state": {"task_state": "data_copying_in_progress"}}' {{(pid=98330) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:57:57 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-09bed8b5-c01e-4a9d-8772-4bc05ed55061 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Action: 'action', calling method: ShareController.reset_task_state, body: {"reset_task_state": {"task_state": "data_copying_in_progress"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:57:57 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-09bed8b5-c01e-4a9d-8772-4bc05ed55061 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Updating share 'df0ea844-5fc1-4d04-8afb-5048ec5dc33f' with '{'task_state': 'data_copying_in_progress'}' {{(pid=98330) _reset_status /opt/stack/manila/manila/api/openstack/wsgi.py:1257}} May 28 12:57:57 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-09bed8b5-c01e-4a9d-8772-4bc05ed55061 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/shares/df0ea844-5fc1-4d04-8afb-5048ec5dc33f/action returned with HTTP 202 May 28 12:57:57 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 439/889] 10.27.203.238 () {68 vars in 1541 bytes} [Tue May 28 12:57:57 2024] POST /share/v2/a3499cb78849424db45e54caac01de92/shares/df0ea844-5fc1-4d04-8afb-5048ec5dc33f/action => generated 0 bytes in 56 msecs (HTTP/1.1 202) 7 headers in 286 bytes (1 switches on core 0) May 28 12:57:57 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-01719e96-000f-42b7-bee5-a2fe6c60efea tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] GET http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/shares/df0ea844-5fc1-4d04-8afb-5048ec5dc33f May 28 12:57:57 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-01719e96-000f-42b7-bee5-a2fe6c60efea tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:57 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-01719e96-000f-42b7-bee5-a2fe6c60efea tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:57 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-01719e96-000f-42b7-bee5-a2fe6c60efea tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/shares/df0ea844-5fc1-4d04-8afb-5048ec5dc33f returned with HTTP 200 May 28 12:57:57 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 451/890] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:57:57 2024] GET /share/v2/a3499cb78849424db45e54caac01de92/shares/df0ea844-5fc1-4d04-8afb-5048ec5dc33f => generated 1393 bytes in 29 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:57:57 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-6eefeb13-bee3-45d4-9677-23e7cecaeffd tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] POST http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/shares/df0ea844-5fc1-4d04-8afb-5048ec5dc33f/action May 28 12:57:57 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-6eefeb13-bee3-45d4-9677-23e7cecaeffd tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Action body: b'{"reset_task_state": {"task_state": "migration_success"}}' {{(pid=98330) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:57:57 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-6eefeb13-bee3-45d4-9677-23e7cecaeffd tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Action: 'action', calling method: ShareController.reset_task_state, body: {"reset_task_state": {"task_state": "migration_success"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:57:57 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-6eefeb13-bee3-45d4-9677-23e7cecaeffd tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Updating share 'df0ea844-5fc1-4d04-8afb-5048ec5dc33f' with '{'task_state': 'migration_success'}' {{(pid=98330) _reset_status /opt/stack/manila/manila/api/openstack/wsgi.py:1257}} May 28 12:57:57 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-5ee5e5de-5dd1-4484-88db-e475abba4f2f tempest-SnapshotInstancesNegativeTest-1396485679 tempest-SnapshotInstancesNegativeTest-1396485679-project-admin] GET http://10.27.203.238/share/v2/c9cc76ecb4e343a6a51bf36da01debf8/snapshots/0d2e6969-2d63-4c8c-bd0a-ae6e8ca0314c May 28 12:57:57 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-5ee5e5de-5dd1-4484-88db-e475abba4f2f tempest-SnapshotInstancesNegativeTest-1396485679 tempest-SnapshotInstancesNegativeTest-1396485679-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:57 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-5ee5e5de-5dd1-4484-88db-e475abba4f2f tempest-SnapshotInstancesNegativeTest-1396485679 tempest-SnapshotInstancesNegativeTest-1396485679-project-admin] Calling method 'ShareSnapshotMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:57 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-6eefeb13-bee3-45d4-9677-23e7cecaeffd tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/shares/df0ea844-5fc1-4d04-8afb-5048ec5dc33f/action returned with HTTP 202 May 28 12:57:57 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 440/891] 10.27.203.238 () {68 vars in 1541 bytes} [Tue May 28 12:57:57 2024] POST /share/v2/a3499cb78849424db45e54caac01de92/shares/df0ea844-5fc1-4d04-8afb-5048ec5dc33f/action => generated 0 bytes in 57 msecs (HTTP/1.1 202) 7 headers in 286 bytes (1 switches on core 0) May 28 12:57:57 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-5ee5e5de-5dd1-4484-88db-e475abba4f2f tempest-SnapshotInstancesNegativeTest-1396485679 tempest-SnapshotInstancesNegativeTest-1396485679-project-admin] http://10.27.203.238/share/v2/c9cc76ecb4e343a6a51bf36da01debf8/snapshots/0d2e6969-2d63-4c8c-bd0a-ae6e8ca0314c returned with HTTP 200 May 28 12:57:57 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 452/892] 10.27.203.238 () {64 vars in 1460 bytes} [Tue May 28 12:57:57 2024] GET /share/v2/c9cc76ecb4e343a6a51bf36da01debf8/snapshots/0d2e6969-2d63-4c8c-bd0a-ae6e8ca0314c => generated 749 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:57:57 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-3a780c44-5645-4a22-af0c-ae0ee446c040 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] GET http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/shares/df0ea844-5fc1-4d04-8afb-5048ec5dc33f May 28 12:57:57 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-3a780c44-5645-4a22-af0c-ae0ee446c040 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:57 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-3a780c44-5645-4a22-af0c-ae0ee446c040 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:58 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-4a49da47-5b6d-4bc6-8c6c-fd400918f1cd tempest-ShareIpRulesForNFSTest-1748669711 None] <<< [PATCH] https://127.0.0.1:40443/api/viewpolicies/21/ May 28 12:57:58 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-4a49da47-5b6d-4bc6-8c6c-fd400918f1cd tempest-ShareIpRulesForNFSTest-1748669711 None] Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=1, created='2024-05-28T12:57:40.763635Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='377955ad-d094-4e49-ab32-1021d943a572', id=21, internal=False, is_s3_default_policy=False, name='b7a7d61c-2cea-442a-9809-507038e080d5', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=['*'], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['*'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['*'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='MODIFYING', sync_time='2024-05-28T12:57:57.494787Z', tenant_id=1, tenant_name='default', title='b7a7d61c-2cea-442a-9809-507038e080d5', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/21/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[]) May 28 12:57:58 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-4a49da47-5b6d-4bc6-8c6c-fd400918f1cd tempest-ShareIpRulesForNFSTest-1748669711 None] --- [PATCH] https://127.0.0.1:40443/api/viewpolicies/21/: Done May 28 12:57:58 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-4a49da47-5b6d-4bc6-8c6c-fd400918f1cd tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:57:58 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-4a49da47-5b6d-4bc6-8c6c-fd400918f1cd tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:57:58 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-3a780c44-5645-4a22-af0c-ae0ee446c040 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/shares/df0ea844-5fc1-4d04-8afb-5048ec5dc33f returned with HTTP 200 May 28 12:57:58 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 441/893] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:57:57 2024] GET /share/v2/a3499cb78849424db45e54caac01de92/shares/df0ea844-5fc1-4d04-8afb-5048ec5dc33f => generated 1386 bytes in 27 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:57:58 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-204743ee-fef0-43c3-ad87-451c502d6db5 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] POST http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/shares/df0ea844-5fc1-4d04-8afb-5048ec5dc33f/action May 28 12:57:58 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-204743ee-fef0-43c3-ad87-451c502d6db5 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Action body: b'{"reset_task_state": {"task_state": null}}' {{(pid=98329) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:57:58 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-204743ee-fef0-43c3-ad87-451c502d6db5 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Action: 'action', calling method: ShareController.reset_task_state, body: {"reset_task_state": {"task_state": null}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:57:58 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-204743ee-fef0-43c3-ad87-451c502d6db5 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Updating share 'df0ea844-5fc1-4d04-8afb-5048ec5dc33f' with '{'task_state': None}' {{(pid=98329) _reset_status /opt/stack/manila/manila/api/openstack/wsgi.py:1257}} May 28 12:57:58 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-4a49da47-5b6d-4bc6-8c6c-fd400918f1cd tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.028s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:57:58 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-4a49da47-5b6d-4bc6-8c6c-fd400918f1cd tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:57:58 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-4a49da47-5b6d-4bc6-8c6c-fd400918f1cd tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:57:58 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-4a49da47-5b6d-4bc6-8c6c-fd400918f1cd tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.030s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:57:58 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-4a49da47-5b6d-4bc6-8c6c-fd400918f1cd tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:57:58 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-4a49da47-5b6d-4bc6-8c6c-fd400918f1cd tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:57:58 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-4a49da47-5b6d-4bc6-8c6c-fd400918f1cd tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:57:58 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-4a49da47-5b6d-4bc6-8c6c-fd400918f1cd tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:57:58 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-4a49da47-5b6d-4bc6-8c6c-fd400918f1cd tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:57:58 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-4a49da47-5b6d-4bc6-8c6c-fd400918f1cd tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:57:58 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-4a49da47-5b6d-4bc6-8c6c-fd400918f1cd tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:57:58 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-4a49da47-5b6d-4bc6-8c6c-fd400918f1cd tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:57:58 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-204743ee-fef0-43c3-ad87-451c502d6db5 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/shares/df0ea844-5fc1-4d04-8afb-5048ec5dc33f/action returned with HTTP 202 May 28 12:57:58 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 453/894] 10.27.203.238 () {68 vars in 1541 bytes} [Tue May 28 12:57:58 2024] POST /share/v2/a3499cb78849424db45e54caac01de92/shares/df0ea844-5fc1-4d04-8afb-5048ec5dc33f/action => generated 0 bytes in 63 msecs (HTTP/1.1 202) 7 headers in 286 bytes (1 switches on core 0) May 28 12:57:58 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-60288635-c80a-45fc-939c-22e9b8352a24 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] GET http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/shares/df0ea844-5fc1-4d04-8afb-5048ec5dc33f May 28 12:57:58 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-60288635-c80a-45fc-939c-22e9b8352a24 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:58 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-60288635-c80a-45fc-939c-22e9b8352a24 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:58 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-60288635-c80a-45fc-939c-22e9b8352a24 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/shares/df0ea844-5fc1-4d04-8afb-5048ec5dc33f returned with HTTP 200 May 28 12:57:58 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 442/895] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:57:58 2024] GET /share/v2/a3499cb78849424db45e54caac01de92/shares/df0ea844-5fc1-4d04-8afb-5048ec5dc33f => generated 1371 bytes in 24 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:57:58 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-cde3eeea-113a-4231-aac9-4e347b0f402b tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] POST http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/snapshots May 28 12:57:58 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-cde3eeea-113a-4231-aac9-4e347b0f402b tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Action: 'create', calling method: ShareSnapshotMixin.create, body: {"snapshot": {"name": "tempest-tempest-created-share-snap-552789931", "force": false, "description": "Tempest's snapshot", "share_id": "df0ea844-5fc1-4d04-8afb-5048ec5dc33f"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:57:58 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-4a49da47-5b6d-4bc6-8c6c-fd400918f1cd tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.041s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:57:58 l75lg1-v1 manila-share[98474]: INFO manila.share.access [None req-4a49da47-5b6d-4bc6-8c6c-fd400918f1cd tempest-ShareIpRulesForNFSTest-1748669711 None] Access rules were successfully modified for share instance b7a7d61c-2cea-442a-9809-507038e080d5 belonging to share 1ddadc17-cf10-4a42-8bbd-8335fb3520a1. May 28 12:57:58 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.v1.share_snapshots [None req-cde3eeea-113a-4231-aac9-4e347b0f402b tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Create snapshot from share df0ea844-5fc1-4d04-8afb-5048ec5dc33f May 28 12:57:58 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.quota [None req-cde3eeea-113a-4231-aac9-4e347b0f402b tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Created reservations ['8917c179-de34-4e47-9155-a91b7ca7f516', 'fa5e5737-842b-49eb-8427-8f2ebaffa2f1', 'd4b5fb4b-dd94-4342-ac2d-5b775f830217', 'c2313783-4581-4dd6-bc8f-bcaed60023a3'] {{(pid=98329) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 12:57:58 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-76972c49-a34a-4521-9461-6779c9626726 tempest-SharesMetadataTest-1561320255 None] <<< [DELETE] https://127.0.0.1:40443/api/viewpolicies/22/ May 28 12:57:58 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-76972c49-a34a-4521-9461-6779c9626726 tempest-SharesMetadataTest-1561320255 None] --- [DELETE] https://127.0.0.1:40443/api/viewpolicies/22/: Done May 28 12:57:58 l75lg1-v1 dstat.sh[49771]: 28-05 12:57:58| 11 2 85 2 0|5706M 1782M 277M 7860M| 18k 9863B| 0 2010k| 0 269 |6769 11k|1.45 1.07 1.01|3.0 1.0 2.0| 0 0 | 0 2048M| 29 356 0 62 0 May 28 12:57:58 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.quota [None req-cde3eeea-113a-4231-aac9-4e347b0f402b tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Committed reservations ['8917c179-de34-4e47-9155-a91b7ca7f516', 'fa5e5737-842b-49eb-8427-8f2ebaffa2f1', 'd4b5fb4b-dd94-4342-ac2d-5b775f830217', 'c2313783-4581-4dd6-bc8f-bcaed60023a3'] {{(pid=98329) commit /opt/stack/manila/manila/quota.py:1063}} May 28 12:57:58 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-cde3eeea-113a-4231-aac9-4e347b0f402b tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/snapshots returned with HTTP 202 May 28 12:57:58 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 454/896] 10.27.203.238 () {66 vars in 1371 bytes} [Tue May 28 12:57:58 2024] POST /share/v2/a3499cb78849424db45e54caac01de92/snapshots => generated 749 bytes in 193 msecs (HTTP/1.1 202) 6 headers in 237 bytes (1 switches on core 0) May 28 12:57:58 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-f0ef4461-8314-4cfb-afe1-0da6669d3e5f tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] GET http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/snapshots/461797f5-03b2-4e09-af96-9f13a9a2464e May 28 12:57:58 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-f0ef4461-8314-4cfb-afe1-0da6669d3e5f tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:58 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-f0ef4461-8314-4cfb-afe1-0da6669d3e5f tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Calling method 'ShareSnapshotMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:58 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-f0ef4461-8314-4cfb-afe1-0da6669d3e5f tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/snapshots/461797f5-03b2-4e09-af96-9f13a9a2464e returned with HTTP 200 May 28 12:57:58 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 443/897] 10.27.203.238 () {64 vars in 1460 bytes} [Tue May 28 12:57:58 2024] GET /share/v2/a3499cb78849424db45e54caac01de92/snapshots/461797f5-03b2-4e09-af96-9f13a9a2464e => generated 749 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:57:58 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e16065d5-4f1b-4284-bc4f-4d3288d36cd0 tempest-SnapshotInstancesNegativeTest-1396485679 None] <<< [POST] https://127.0.0.1:40443/api/snapshots/ May 28 12:57:58 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e16065d5-4f1b-4284-bc4f-4d3288d36cd0 tempest-SnapshotInstancesNegativeTest-1396485679 None] Bunch(access_path='/.vast_all_snapshots/1000000005_share-snapshot-d9f25a4b-5def-4427-b890-289ce9aabe70', aggr_phys_estimation=0, cluster='loop75-kfs', created='2024-05-28T12:57:55.326951Z', eta_sec=30819898919.659935, expiration_time='3001-01-19T07:59:58Z', guid='45421c99-9096-4569-b40c-6a6e58867415', id=6, indestructible=False, locked=False, name='share-snapshot-d9f25a4b-5def-4427-b890-289ce9aabe70', path='/manila/manila-8239ccb8-483c-4129-8319-880234387fbd/', policy=None, policy_id=None, protection_policy_id=None, state='SUCCEED', tenant_id=1, tenant_name='default', title='share-snapshot-d9f25a4b-5def-4427-b890-289ce9aabe70(/manila/manila-8239ccb8-483c-4129-8319-880234387fbd/)', type='local', unique_phys_estimation=0, url='https://127.0.0.1:40443/api/snapshots/6/') May 28 12:57:58 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e16065d5-4f1b-4284-bc4f-4d3288d36cd0 tempest-SnapshotInstancesNegativeTest-1396485679 None] --- [POST] https://127.0.0.1:40443/api/snapshots/: Done May 28 12:57:58 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-cde3eeea-113a-4231-aac9-4e347b0f402b tempest-AdminActionsTest-1749172189 None] >>> [POST] https://127.0.0.1:40443/api/snapshots/ May 28 12:57:58 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-cde3eeea-113a-4231-aac9-4e347b0f402b tempest-AdminActionsTest-1749172189 None] {'data': '{"path": "/manila/manila-77a25e6b-f137-4342-8eb9-9ced679515e2", ' May 28 12:57:58 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-cde3eeea-113a-4231-aac9-4e347b0f402b tempest-AdminActionsTest-1749172189 None] '"name": "share-snapshot-5630474e-5783-4d8b-a724-cb878db3d827"}', May 28 12:57:58 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-cde3eeea-113a-4231-aac9-4e347b0f402b tempest-AdminActionsTest-1749172189 None] 'json': None, May 28 12:57:58 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-cde3eeea-113a-4231-aac9-4e347b0f402b tempest-AdminActionsTest-1749172189 None] 'params': None} May 28 12:57:58 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-76972c49-a34a-4521-9461-6779c9626726 tempest-SharesMetadataTest-1561320255 None] Created reservations ['2a53fd09-f06a-4150-9d76-663649999e6a', '6ff604a5-5bda-409c-966a-02da782dfb9c', 'ad5dfc30-45a2-4c4c-8ff3-9d861b0a2023', '1f3b1f58-a363-46c2-97ea-d258155722c6'] {{(pid=98474) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 12:57:58 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-76972c49-a34a-4521-9461-6779c9626726 tempest-SharesMetadataTest-1561320255 None] Committed reservations ['2a53fd09-f06a-4150-9d76-663649999e6a', '6ff604a5-5bda-409c-966a-02da782dfb9c', 'ad5dfc30-45a2-4c4c-8ff3-9d861b0a2023', '1f3b1f58-a363-46c2-97ea-d258155722c6'] {{(pid=98474) commit /opt/stack/manila/manila/quota.py:1063}} May 28 12:57:58 l75lg1-v1 manila-share[98474]: INFO manila.share.manager [None req-76972c49-a34a-4521-9461-6779c9626726 tempest-SharesMetadataTest-1561320255 None] Share instance 5cf89605-2e7d-4ecc-9c44-5e6f5ecb0cad: deleted successfully. May 28 12:57:58 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-31cd918e-eae2-4419-978e-7130cd073d48 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] GET http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/da7ec0a1-db21-42c6-b842-6f87b3c5843d May 28 12:57:58 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-31cd918e-eae2-4419-978e-7130cd073d48 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:58 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-31cd918e-eae2-4419-978e-7130cd073d48 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:58 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-31cd918e-eae2-4419-978e-7130cd073d48 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] HTTP exception thrown: The resource could not be found. May 28 12:57:58 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-31cd918e-eae2-4419-978e-7130cd073d48 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/da7ec0a1-db21-42c6-b842-6f87b3c5843d returned with HTTP 404 May 28 12:57:58 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 455/898] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:57:58 2024] GET /share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/da7ec0a1-db21-42c6-b842-6f87b3c5843d => generated 78 bytes in 11 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 12:57:58 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-9353d2ac-6952-43e0-a1dc-846288bab251 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] POST http://10.27.203.238/share/v1/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action May 28 12:57:58 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-9353d2ac-6952-43e0-a1dc-846288bab251 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Action body: b'{"os-access_list": null}' {{(pid=98330) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:57:58 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-9353d2ac-6952-43e0-a1dc-846288bab251 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Action: 'action', calling method: ShareController.access_list, body: {"os-access_list": null} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:57:58 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-2a531a29-2cd9-4e97-9af6-1ed124146a5b tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] POST http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares May 28 12:57:58 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-2a531a29-2cd9-4e97-9af6-1ed124146a5b tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share": {"share_proto": "nfs", "description": "Tempest's share", "snapshot_id": null, "name": "tempest-tempest-created-share-419821613", "size": 1, "metadata": {"key1": "value1", "key2": "value2"}, "is_public": false, "share_type": "10ddeb10-4cbf-44c0-94cd-48a1deaf7383"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:57:58 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.v1.shares [None req-2a531a29-2cd9-4e97-9af6-1ed124146a5b tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Create NFS share of 1 GB May 28 12:57:58 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-9353d2ac-6952-43e0-a1dc-846288bab251 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] http://10.27.203.238/share/v1/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action returned with HTTP 200 May 28 12:57:58 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 444/899] 10.27.203.238 () {64 vars in 1450 bytes} [Tue May 28 12:57:58 2024] POST /share/v1/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action => generated 19 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 229 bytes (1 switches on core 0) May 28 12:57:58 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-c0075687-3b5e-4109-97fb-16dc52ac5085 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] POST http://10.27.203.238/share/v2/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action May 28 12:57:58 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-c0075687-3b5e-4109-97fb-16dc52ac5085 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Action body: b'{"allow_access": {"access_type": "ip", "access_to": "203.0.113.96/30", "access_level": "rw"}}' {{(pid=98330) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:57:58 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-c0075687-3b5e-4109-97fb-16dc52ac5085 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Action: 'action', calling method: ShareController.allow_access, body: {"allow_access": {"access_type": "ip", "access_to": "203.0.113.96/30", "access_level": "rw"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:57:58 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.quota [None req-2a531a29-2cd9-4e97-9af6-1ed124146a5b tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Created reservations ['5701d574-628c-4e6e-bf56-f02b297ca9aa', '98cb5698-0516-40fe-b807-e08e03d58905', 'd0a554c1-e213-4aee-80a9-2f189c2eca87', '6ab9cc15-58e7-4c73-b25b-be540bcbae1d'] {{(pid=98329) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 12:57:58 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-c0075687-3b5e-4109-97fb-16dc52ac5085 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:57:58 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-c0075687-3b5e-4109-97fb-16dc52ac5085 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:57:58 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c5d3c5e1-db68-40f3-b16b-4a24d7dc03e1 tempest-SharesMetadataNegativeTest-1584039052 None] <<< [DELETE] https://127.0.0.1:40443/api/viewpolicies/23/ May 28 12:57:58 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c5d3c5e1-db68-40f3-b16b-4a24d7dc03e1 tempest-SharesMetadataNegativeTest-1584039052 None] --- [DELETE] https://127.0.0.1:40443/api/viewpolicies/23/: Done May 28 12:57:58 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.quota [None req-2a531a29-2cd9-4e97-9af6-1ed124146a5b tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Committed reservations ['5701d574-628c-4e6e-bf56-f02b297ca9aa', '98cb5698-0516-40fe-b807-e08e03d58905', 'd0a554c1-e213-4aee-80a9-2f189c2eca87', '6ab9cc15-58e7-4c73-b25b-be540bcbae1d'] {{(pid=98329) commit /opt/stack/manila/manila/quota.py:1063}} May 28 12:57:58 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-c0075687-3b5e-4109-97fb-16dc52ac5085 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.043s {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:57:58 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-c0075687-3b5e-4109-97fb-16dc52ac5085 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] http://10.27.203.238/share/v2/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action returned with HTTP 200 May 28 12:57:58 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 445/900] 10.27.203.238 () {66 vars in 1493 bytes} [Tue May 28 12:57:58 2024] POST /share/v2/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action => generated 297 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 231 bytes (2 switches on core 0) May 28 12:57:58 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-37fea0f4-55e0-4e05-8b36-44c1ddf032a4 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] POST http://10.27.203.238/share/v2/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action May 28 12:57:58 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-37fea0f4-55e0-4e05-8b36-44c1ddf032a4 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Action body: b'{"access_list": null}' {{(pid=98330) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:57:58 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-37fea0f4-55e0-4e05-8b36-44c1ddf032a4 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Action: 'action', calling method: Controller.__getattribute__..version_select, body: {"access_list": null} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:57:58 l75lg1-v1 manila-share[98474]: DEBUG manila.share.manager [None req-c0075687-3b5e-4109-97fb-16dc52ac5085 tempest-ShareIpRulesForNFSTest-1748669711 None] Received request to update access for share instance b7a7d61c-2cea-442a-9809-507038e080d5. {{(pid=98474) update_access_for_instances /opt/stack/manila/manila/share/manager.py:4353}} May 28 12:57:58 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-37fea0f4-55e0-4e05-8b36-44c1ddf032a4 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] http://10.27.203.238/share/v2/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action returned with HTTP 200 May 28 12:57:58 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 446/901] 10.27.203.238 () {66 vars in 1493 bytes} [Tue May 28 12:57:58 2024] POST /share/v2/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action => generated 252 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:57:58 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.host_manager [None req-2a531a29-2cd9-4e97-9af6-1ed124146a5b tempest-SharesMetadataTest-1561320255 None] Share service is down. (host: l75lg1-v1@generic2). May 28 12:57:58 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.host_manager [None req-2a531a29-2cd9-4e97-9af6-1ed124146a5b tempest-SharesMetadataTest-1561320255 None] Share service is down. (host: l75lg1-v1@generic1). May 28 12:57:58 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-2a531a29-2cd9-4e97-9af6-1ed124146a5b tempest-SharesMetadataTest-1561320255 None] Starting with 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:80}} May 28 12:57:58 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c0075687-3b5e-4109-97fb-16dc52ac5085 tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:57:58 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c0075687-3b5e-4109-97fb-16dc52ac5085 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:57:58 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-2a531a29-2cd9-4e97-9af6-1ed124146a5b tempest-SharesMetadataTest-1561320255 None] Filter OnlyHostFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:57:58 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-2a531a29-2cd9-4e97-9af6-1ed124146a5b tempest-SharesMetadataTest-1561320255 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:57:58 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.capacity [None req-2a531a29-2cd9-4e97-9af6-1ed124146a5b tempest-SharesMetadataTest-1561320255 None] Space information for share creation on host l75lg1-v1@vast#vast (requested / avail): 1/2081 {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/capacity.py:83}} May 28 12:57:58 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-2a531a29-2cd9-4e97-9af6-1ed124146a5b tempest-SharesMetadataTest-1561320255 None] Filter CapacityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:57:58 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-2a531a29-2cd9-4e97-9af6-1ed124146a5b tempest-SharesMetadataTest-1561320255 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:57:58 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-2a531a29-2cd9-4e97-9af6-1ed124146a5b tempest-SharesMetadataTest-1561320255 None] Driver Filter: Checking host 'l75lg1-v1@vast#vast' {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:37}} May 28 12:57:58 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-2a531a29-2cd9-4e97-9af6-1ed124146a5b tempest-SharesMetadataTest-1561320255 None] Filter function not set :: passing host. {{(pid=98327) _check_filter_function /opt/stack/manila/manila/scheduler/filters/driver.py:53}} May 28 12:57:58 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-2a531a29-2cd9-4e97-9af6-1ed124146a5b tempest-SharesMetadataTest-1561320255 None] Result: True {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:40}} May 28 12:57:58 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-2a531a29-2cd9-4e97-9af6-1ed124146a5b tempest-SharesMetadataTest-1561320255 None] Done checking host 'l75lg1-v1@vast#vast' {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:41}} May 28 12:57:58 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-2a531a29-2cd9-4e97-9af6-1ed124146a5b tempest-SharesMetadataTest-1561320255 None] Filter DriverFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:57:58 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-2a531a29-2cd9-4e97-9af6-1ed124146a5b tempest-SharesMetadataTest-1561320255 None] Filter ShareReplicationFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:57:58 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-2a531a29-2cd9-4e97-9af6-1ed124146a5b tempest-SharesMetadataTest-1561320255 None] Filter CreateFromSnapshotFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:57:58 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-2a531a29-2cd9-4e97-9af6-1ed124146a5b tempest-SharesMetadataTest-1561320255 None] Filter AffinityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:57:58 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-2a531a29-2cd9-4e97-9af6-1ed124146a5b tempest-SharesMetadataTest-1561320255 None] Filter AntiAffinityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:57:58 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.drivers.filter [None req-2a531a29-2cd9-4e97-9af6-1ed124146a5b tempest-SharesMetadataTest-1561320255 None] Filtered share [host: 'l75lg1-v1@vast#vast', free_capacity_gb: 2081.6229242384434, pools: None] {{(pid=98327) _schedule_share /opt/stack/manila/manila/scheduler/drivers/filter.py:268}} May 28 12:57:58 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-2a531a29-2cd9-4e97-9af6-1ed124146a5b tempest-SharesMetadataTest-1561320255 None] Checking host 'l75lg1-v1@vast#vast' {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:46}} May 28 12:57:58 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.weighers.goodness [None req-2a531a29-2cd9-4e97-9af6-1ed124146a5b tempest-SharesMetadataTest-1561320255 None] Goodness function not set :: defaulting to minimal goodness rating of 0. May 28 12:57:58 l75lg1-v1 manila-scheduler[98327]: INFO manila.scheduler.weighers.goodness [None req-2a531a29-2cd9-4e97-9af6-1ed124146a5b tempest-SharesMetadataTest-1561320255 None] Goodness function result for host l75lg1-v1@vast#vast: 0. May 28 12:57:58 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-2a531a29-2cd9-4e97-9af6-1ed124146a5b tempest-SharesMetadataTest-1561320255 None] Goodness: 0 {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:48}} May 28 12:57:58 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-2a531a29-2cd9-4e97-9af6-1ed124146a5b tempest-SharesMetadataTest-1561320255 None] Done checking host 'l75lg1-v1@vast#vast' {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:49}} May 28 12:57:58 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.drivers.filter [None req-2a531a29-2cd9-4e97-9af6-1ed124146a5b tempest-SharesMetadataTest-1561320255 None] Choosing for share: WeighedHost [host: l75lg1-v1@vast#vast, weight: 0.0] {{(pid=98327) _schedule_share /opt/stack/manila/manila/scheduler/drivers/filter.py:274}} May 28 12:57:58 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c0075687-3b5e-4109-97fb-16dc52ac5085 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.006s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:57:58 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c0075687-3b5e-4109-97fb-16dc52ac5085 tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:57:58 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c0075687-3b5e-4109-97fb-16dc52ac5085 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:57:58 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-2a531a29-2cd9-4e97-9af6-1ed124146a5b tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares returned with HTTP 200 May 28 12:57:58 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 456/902] 10.27.203.238 () {66 vars in 1362 bytes} [Tue May 28 12:57:58 2024] POST /share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares => generated 1345 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:57:58 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-39f2358a-ae14-447b-9222-5541c0ec3559 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] GET http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/c485966a-3cd7-4de5-903f-4b379a6cb450 May 28 12:57:58 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-39f2358a-ae14-447b-9222-5541c0ec3559 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:58 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-39f2358a-ae14-447b-9222-5541c0ec3559 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:58 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-39f2358a-ae14-447b-9222-5541c0ec3559 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/c485966a-3cd7-4de5-903f-4b379a6cb450 returned with HTTP 200 May 28 12:57:58 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 447/903] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:57:58 2024] GET /share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/c485966a-3cd7-4de5-903f-4b379a6cb450 => generated 1345 bytes in 28 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:57:58 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-c5d3c5e1-db68-40f3-b16b-4a24d7dc03e1 tempest-SharesMetadataNegativeTest-1584039052 None] Created reservations ['4858e47e-8a01-49cc-aed7-2576c65ff39b', 'a6303005-9e19-42a5-8b03-99c7797d68a4', '84c23186-2e24-4eca-ac9d-01c4137e8c06', '77e2b79a-b98b-4a5c-9fa1-ebe1b0bdb0c8'] {{(pid=98474) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 12:57:58 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c0075687-3b5e-4109-97fb-16dc52ac5085 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.090s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:57:58 l75lg1-v1 manila-share[98474]: DEBUG manila.share.access [None req-c0075687-3b5e-4109-97fb-16dc52ac5085 tempest-ShareIpRulesForNFSTest-1748669711 None] Updating access rules for share instance b7a7d61c-2cea-442a-9809-507038e080d5 belonging to share 1ddadc17-cf10-4a42-8bbd-8335fb3520a1. {{(pid=98474) update_access_rules /opt/stack/manila/manila/share/access.py:298}} May 28 12:57:59 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-c5d3c5e1-db68-40f3-b16b-4a24d7dc03e1 tempest-SharesMetadataNegativeTest-1584039052 None] Committed reservations ['4858e47e-8a01-49cc-aed7-2576c65ff39b', 'a6303005-9e19-42a5-8b03-99c7797d68a4', '84c23186-2e24-4eca-ac9d-01c4137e8c06', '77e2b79a-b98b-4a5c-9fa1-ebe1b0bdb0c8'] {{(pid=98474) commit /opt/stack/manila/manila/quota.py:1063}} May 28 12:57:59 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c0075687-3b5e-4109-97fb-16dc52ac5085 tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:57:59 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c0075687-3b5e-4109-97fb-16dc52ac5085 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:57:59 l75lg1-v1 manila-share[98474]: INFO manila.share.manager [None req-c5d3c5e1-db68-40f3-b16b-4a24d7dc03e1 tempest-SharesMetadataNegativeTest-1584039052 None] Share instance 9e93e444-3013-4370-9caa-9f912c5201e6: deleted successfully. May 28 12:57:59 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c0075687-3b5e-4109-97fb-16dc52ac5085 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.018s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:57:59 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c0075687-3b5e-4109-97fb-16dc52ac5085 tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:57:59 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c0075687-3b5e-4109-97fb-16dc52ac5085 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:57:59 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2a531a29-2cd9-4e97-9af6-1ed124146a5b tempest-SharesMetadataTest-1561320255 None] >>> [GET] https://127.0.0.1:40443/api/vippools/ May 28 12:57:59 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2a531a29-2cd9-4e97-9af6-1ed124146a5b tempest-SharesMetadataTest-1561320255 None] {'allow_redirects': True, 'params': {'name': 'vippool-1'}} May 28 12:57:59 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c0075687-3b5e-4109-97fb-16dc52ac5085 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.015s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:57:59 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-c0075687-3b5e-4109-97fb-16dc52ac5085 tempest-ShareIpRulesForNFSTest-1748669711 None] changing access on None May 28 12:57:59 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c0075687-3b5e-4109-97fb-16dc52ac5085 tempest-ShareIpRulesForNFSTest-1748669711 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:57:59 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c0075687-3b5e-4109-97fb-16dc52ac5085 tempest-ShareIpRulesForNFSTest-1748669711 None] {'allow_redirects': True, May 28 12:57:59 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c0075687-3b5e-4109-97fb-16dc52ac5085 tempest-ShareIpRulesForNFSTest-1748669711 None] 'params': {'name': 'b7a7d61c-2cea-442a-9809-507038e080d5'}} May 28 12:57:59 l75lg1-v1 dstat.sh[49771]: 28-05 12:57:59| 10 1 83 5 0|5707M 1781M 277M 7860M| 20k 11k| 0 6683k| 0 689 |7076 12k|1.45 1.07 1.01|1.0 1.0 1.0| 0 0 | 0 2048M| 29 357 0 62 0 May 28 12:57:59 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2a531a29-2cd9-4e97-9af6-1ed124146a5b tempest-SharesMetadataTest-1561320255 None] <<< [GET] https://127.0.0.1:40443/api/vippools/ May 28 12:57:59 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2a531a29-2cd9-4e97-9af6-1ed124146a5b tempest-SharesMetadataTest-1561320255 None] [Bunch(active_cnode_ids=[], active_interfaces=4, cluster='loop75-kfs', cluster_id=1, cnode_ids=[], cnodes=[], domain_name='vippool-1', enable_l3=False, enable_weighted_balancing=False, enabled=True, end_ip='172.21.75.4', guid='f2abaede-b397-413a-8faa-3aeead6d3b28', gw_ip='', gw_ipv6='', id=2, ip_ranges=[['172.21.75.1', '172.21.75.4']], name='vippool-1', peer_asn=0, port_membership='ALL', ranges_summary='172.21.75.[1-4]', role='PROTOCOLS', start_ip='172.21.75.1', subnet_cidr=16, subnet_cidr_ipv6=None, sync='SYNCED', sync_time='2024-05-28T12:50:09.644123Z', tenant_id=1, tenant_name='default', title='172.21.75.1 - 172.21.75.4', url='https://127.0.0.1:40443/api/vippools/2/', vast_asn=0, vlan=0, vms_preferred=False)] May 28 12:57:59 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2a531a29-2cd9-4e97-9af6-1ed124146a5b tempest-SharesMetadataTest-1561320255 None] --- [GET] https://127.0.0.1:40443/api/vippools/: Done May 28 12:57:59 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2a531a29-2cd9-4e97-9af6-1ed124146a5b tempest-SharesMetadataTest-1561320255 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:57:59 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2a531a29-2cd9-4e97-9af6-1ed124146a5b tempest-SharesMetadataTest-1561320255 None] {'allow_redirects': True, May 28 12:57:59 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2a531a29-2cd9-4e97-9af6-1ed124146a5b tempest-SharesMetadataTest-1561320255 None] 'params': {'name': '205d35a8-15b8-4a2f-8214-8c2d1a5de6b0'}} May 28 12:57:59 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c0075687-3b5e-4109-97fb-16dc52ac5085 tempest-ShareIpRulesForNFSTest-1748669711 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:57:59 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c0075687-3b5e-4109-97fb-16dc52ac5085 tempest-ShareIpRulesForNFSTest-1748669711 None] [Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=1, created='2024-05-28T12:57:40.763635Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='377955ad-d094-4e49-ab32-1021d943a572', id=21, internal=False, is_s3_default_policy=False, name='b7a7d61c-2cea-442a-9809-507038e080d5', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=['*'], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['*'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['*'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T12:57:57.921941Z', tenant_id=1, tenant_name='default', title='b7a7d61c-2cea-442a-9809-507038e080d5', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/21/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[])] May 28 12:57:59 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c0075687-3b5e-4109-97fb-16dc52ac5085 tempest-ShareIpRulesForNFSTest-1748669711 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 12:57:59 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-048a382b-99d7-40de-a12b-f1416a8a0832 tempest-SharesMetadataNegativeTest-1584039052 tempest-SharesMetadataNegativeTest-1584039052-project-member] GET http://10.27.203.238/share/v2/5e5bc0c8fb8b46d598b0621999301112/shares/12970599-4f96-41ce-abd8-18371bc51a8c May 28 12:57:59 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-048a382b-99d7-40de-a12b-f1416a8a0832 tempest-SharesMetadataNegativeTest-1584039052 tempest-SharesMetadataNegativeTest-1584039052-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:59 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-048a382b-99d7-40de-a12b-f1416a8a0832 tempest-SharesMetadataNegativeTest-1584039052 tempest-SharesMetadataNegativeTest-1584039052-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:59 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-048a382b-99d7-40de-a12b-f1416a8a0832 tempest-SharesMetadataNegativeTest-1584039052 tempest-SharesMetadataNegativeTest-1584039052-project-member] HTTP exception thrown: The resource could not be found. May 28 12:57:59 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-048a382b-99d7-40de-a12b-f1416a8a0832 tempest-SharesMetadataNegativeTest-1584039052 tempest-SharesMetadataNegativeTest-1584039052-project-member] http://10.27.203.238/share/v2/5e5bc0c8fb8b46d598b0621999301112/shares/12970599-4f96-41ce-abd8-18371bc51a8c returned with HTTP 404 May 28 12:57:59 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 457/904] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:57:59 2024] GET /share/v2/5e5bc0c8fb8b46d598b0621999301112/shares/12970599-4f96-41ce-abd8-18371bc51a8c => generated 78 bytes in 11 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 12:57:59 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-be550114-c421-488e-963d-2571bb060d6d tempest-SharesMetadataNegativeTest-1095932064 tempest-SharesMetadataNegativeTest-1095932064-project-admin] DELETE http://10.27.203.238/share/v2/efc051b5756f4b69ba8d639efab8d102/types/c28a59fe-4641-4c44-8ef9-4e7174c48b1c May 28 12:57:59 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-be550114-c421-488e-963d-2571bb060d6d tempest-SharesMetadataNegativeTest-1095932064 tempest-SharesMetadataNegativeTest-1095932064-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:59 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-be550114-c421-488e-963d-2571bb060d6d tempest-SharesMetadataNegativeTest-1095932064 tempest-SharesMetadataNegativeTest-1095932064-project-admin] Calling method 'ShareTypesController._delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:59 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-be550114-c421-488e-963d-2571bb060d6d tempest-SharesMetadataNegativeTest-1095932064 tempest-SharesMetadataNegativeTest-1095932064-project-admin] http://10.27.203.238/share/v2/efc051b5756f4b69ba8d639efab8d102/types/c28a59fe-4641-4c44-8ef9-4e7174c48b1c returned with HTTP 202 May 28 12:57:59 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 448/905] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:57:59 2024] DELETE /share/v2/efc051b5756f4b69ba8d639efab8d102/types/c28a59fe-4641-4c44-8ef9-4e7174c48b1c => generated 0 bytes in 50 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:57:59 l75lg1-v1 manila-share[98474]: ERROR manila.share.drivers.vastdata [None req-c0075687-3b5e-4109-97fb-16dc52ac5085 tempest-ShareIpRulesForNFSTest-1748669711 None] failed to resolve host '203.0.113.96/30': [Errno -2] Name or service not known (ignoring): socket.gaierror: [Errno -2] Name or service not known May 28 12:57:59 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-c0075687-3b5e-4109-97fb-16dc52ac5085 tempest-ShareIpRulesForNFSTest-1748669711 None] changing access on /manila/manila-b7a7d61c-2cea-442a-9809-507038e080d5. Rules: {'nfs_read_write': ['*'], 'nfs_read_only': []} May 28 12:57:59 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c0075687-3b5e-4109-97fb-16dc52ac5085 tempest-ShareIpRulesForNFSTest-1748669711 None] >>> [PATCH] https://127.0.0.1:40443/api/viewpolicies/21/ May 28 12:57:59 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c0075687-3b5e-4109-97fb-16dc52ac5085 tempest-ShareIpRulesForNFSTest-1748669711 None] {'data': '{"name": "b7a7d61c-2cea-442a-9809-507038e080d5", "nfs_no_squash": ' May 28 12:57:59 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c0075687-3b5e-4109-97fb-16dc52ac5085 tempest-ShareIpRulesForNFSTest-1748669711 None] '["*"], "nfs_root_squash": ["*"], "nfs_read_write": ["*"], ' May 28 12:57:59 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c0075687-3b5e-4109-97fb-16dc52ac5085 tempest-ShareIpRulesForNFSTest-1748669711 None] '"nfs_read_only": []}', May 28 12:57:59 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c0075687-3b5e-4109-97fb-16dc52ac5085 tempest-ShareIpRulesForNFSTest-1748669711 None] 'params': None} May 28 12:57:59 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-a02686aa-6791-4288-88df-4c199afc60d7 tempest-SharesMetadataNegativeTest-1095932064 tempest-SharesMetadataNegativeTest-1095932064-project-admin] GET http://10.27.203.238/share/v2/efc051b5756f4b69ba8d639efab8d102/types/c28a59fe-4641-4c44-8ef9-4e7174c48b1c May 28 12:57:59 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-a02686aa-6791-4288-88df-4c199afc60d7 tempest-SharesMetadataNegativeTest-1095932064 tempest-SharesMetadataNegativeTest-1095932064-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:57:59 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-a02686aa-6791-4288-88df-4c199afc60d7 tempest-SharesMetadataNegativeTest-1095932064 tempest-SharesMetadataNegativeTest-1095932064-project-admin] Calling method 'ShareTypesController.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:57:59 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-a02686aa-6791-4288-88df-4c199afc60d7 tempest-SharesMetadataNegativeTest-1095932064 tempest-SharesMetadataNegativeTest-1095932064-project-admin] HTTP exception thrown: Share type not found. May 28 12:57:59 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-a02686aa-6791-4288-88df-4c199afc60d7 tempest-SharesMetadataNegativeTest-1095932064 tempest-SharesMetadataNegativeTest-1095932064-project-admin] http://10.27.203.238/share/v2/efc051b5756f4b69ba8d639efab8d102/types/c28a59fe-4641-4c44-8ef9-4e7174c48b1c returned with HTTP 404 May 28 12:57:59 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 458/906] 10.27.203.238 () {64 vars in 1448 bytes} [Tue May 28 12:57:59 2024] GET /share/v2/efc051b5756f4b69ba8d639efab8d102/types/c28a59fe-4641-4c44-8ef9-4e7174c48b1c => generated 67 bytes in 10 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 12:57:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83a593f-d717-418f-8252-0ce19c680846 tempest-SharesMetadataNegativeTest-1095932064 tempest-SharesMetadataNegativeTest-1095932064-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-c83a593f-d717-418f-8252-0ce19c680846 tempest-SharesMetadataNegativeTest-1095932064 tempest-SharesMetadataNegativeTest-1095932064-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83a593f-d717-418f-8252-0ce19c680846 tempest-SharesMetadataNegativeTest-1095932064 tempest-SharesMetadataNegativeTest-1095932064-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d2c857-eedc-4c50-bea3-6201c919f34b None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d2c857-eedc-4c50-bea3-6201c919f34b None admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d2c857-eedc-4c50-bea3-6201c919f34b None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d2c857-eedc-4c50-bea3-6201c919f34b None admin] PATH_INFO: `/v3/users/b0864c216255411892f92de6eedf4968` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d2c857-eedc-4c50-bea3-6201c919f34b None admin] RBAC: Authorizing `identity:delete_user(user_id=b0864c216255411892f92de6eedf4968)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d2c857-eedc-4c50-bea3-6201c919f34b None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:59 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2a531a29-2cd9-4e97-9af6-1ed124146a5b tempest-SharesMetadataTest-1561320255 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:57:59 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2a531a29-2cd9-4e97-9af6-1ed124146a5b tempest-SharesMetadataTest-1561320255 None] [] May 28 12:57:59 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2a531a29-2cd9-4e97-9af6-1ed124146a5b tempest-SharesMetadataTest-1561320255 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 12:57:59 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2a531a29-2cd9-4e97-9af6-1ed124146a5b tempest-SharesMetadataTest-1561320255 None] >>> [POST] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:57:59 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2a531a29-2cd9-4e97-9af6-1ed124146a5b tempest-SharesMetadataTest-1561320255 None] {'data': '{"name": "205d35a8-15b8-4a2f-8214-8c2d1a5de6b0"}', May 28 12:57:59 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2a531a29-2cd9-4e97-9af6-1ed124146a5b tempest-SharesMetadataTest-1561320255 None] 'json': None, May 28 12:57:59 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2a531a29-2cd9-4e97-9af6-1ed124146a5b tempest-SharesMetadataTest-1561320255 None] 'params': None} May 28 12:57:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-14d2c857-eedc-4c50-bea3-6201c919f34b None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0864c216255411892f92de6eedf4968', 'request_id': 'req-14d2c857-eedc-4c50-bea3-6201c919f34b'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-14d2c857-eedc-4c50-bea3-6201c919f34b None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0864c216255411892f92de6eedf4968', 'request_id': 'req-14d2c857-eedc-4c50-bea3-6201c919f34b'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-14d2c857-eedc-4c50-bea3-6201c919f34b None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0864c216255411892f92de6eedf4968', 'request_id': 'req-14d2c857-eedc-4c50-bea3-6201c919f34b'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-14d2c857-eedc-4c50-bea3-6201c919f34b None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0864c216255411892f92de6eedf4968', 'request_id': 'req-14d2c857-eedc-4c50-bea3-6201c919f34b'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-14d2c857-eedc-4c50-bea3-6201c919f34b None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0864c216255411892f92de6eedf4968', 'request_id': 'req-14d2c857-eedc-4c50-bea3-6201c919f34b'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:59 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1063/2101] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 12:57:59 2024] DELETE /identity/v3/users/b0864c216255411892f92de6eedf4968 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:57:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a11e3b-770c-4c99-a993-80e9399dd48f tempest-SharesMetadataNegativeTest-1095932064 tempest-SharesMetadataNegativeTest-1095932064-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a11e3b-770c-4c99-a993-80e9399dd48f tempest-SharesMetadataNegativeTest-1095932064 tempest-SharesMetadataNegativeTest-1095932064-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7256c519-a598-47e4-9ef1-7e2970db7f0a None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7256c519-a598-47e4-9ef1-7e2970db7f0a None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7256c519-a598-47e4-9ef1-7e2970db7f0a None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7256c519-a598-47e4-9ef1-7e2970db7f0a None admin] PATH_INFO: `/v3/users/311cd5fb5b0043b98ed6eed3875b4fc4` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7256c519-a598-47e4-9ef1-7e2970db7f0a None admin] RBAC: Authorizing `identity:delete_user(user_id=311cd5fb5b0043b98ed6eed3875b4fc4)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7256c519-a598-47e4-9ef1-7e2970db7f0a None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-7256c519-a598-47e4-9ef1-7e2970db7f0a None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '311cd5fb5b0043b98ed6eed3875b4fc4', 'request_id': 'req-7256c519-a598-47e4-9ef1-7e2970db7f0a'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-7256c519-a598-47e4-9ef1-7e2970db7f0a None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '311cd5fb5b0043b98ed6eed3875b4fc4', 'request_id': 'req-7256c519-a598-47e4-9ef1-7e2970db7f0a'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-7256c519-a598-47e4-9ef1-7e2970db7f0a None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '311cd5fb5b0043b98ed6eed3875b4fc4', 'request_id': 'req-7256c519-a598-47e4-9ef1-7e2970db7f0a'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-7256c519-a598-47e4-9ef1-7e2970db7f0a None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '311cd5fb5b0043b98ed6eed3875b4fc4', 'request_id': 'req-7256c519-a598-47e4-9ef1-7e2970db7f0a'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-7256c519-a598-47e4-9ef1-7e2970db7f0a None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '311cd5fb5b0043b98ed6eed3875b4fc4', 'request_id': 'req-7256c519-a598-47e4-9ef1-7e2970db7f0a'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:59 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1039/2102] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 12:57:59 2024] DELETE /identity/v3/users/311cd5fb5b0043b98ed6eed3875b4fc4 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:57:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d2c857-eedc-4c50-bea3-6201c919f34b None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:57:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-14d2c857-eedc-4c50-bea3-6201c919f34b None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:57:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d2c857-eedc-4c50-bea3-6201c919f34b None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:57:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dee3bb8-4ffa-4c84-8c32-2d19e61436b1 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:57:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dee3bb8-4ffa-4c84-8c32-2d19e61436b1 None admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dee3bb8-4ffa-4c84-8c32-2d19e61436b1 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dee3bb8-4ffa-4c84-8c32-2d19e61436b1 None admin] PATH_INFO: `/v3/users/6f163ab6cac34b77945bc27e1a5c66ce` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dee3bb8-4ffa-4c84-8c32-2d19e61436b1 None admin] RBAC: Authorizing `identity:delete_user(user_id=6f163ab6cac34b77945bc27e1a5c66ce)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:57:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dee3bb8-4ffa-4c84-8c32-2d19e61436b1 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:57:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-4dee3bb8-4ffa-4c84-8c32-2d19e61436b1 None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f163ab6cac34b77945bc27e1a5c66ce', 'request_id': 'req-4dee3bb8-4ffa-4c84-8c32-2d19e61436b1'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-4dee3bb8-4ffa-4c84-8c32-2d19e61436b1 None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f163ab6cac34b77945bc27e1a5c66ce', 'request_id': 'req-4dee3bb8-4ffa-4c84-8c32-2d19e61436b1'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-4dee3bb8-4ffa-4c84-8c32-2d19e61436b1 None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f163ab6cac34b77945bc27e1a5c66ce', 'request_id': 'req-4dee3bb8-4ffa-4c84-8c32-2d19e61436b1'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-4dee3bb8-4ffa-4c84-8c32-2d19e61436b1 None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f163ab6cac34b77945bc27e1a5c66ce', 'request_id': 'req-4dee3bb8-4ffa-4c84-8c32-2d19e61436b1'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-4dee3bb8-4ffa-4c84-8c32-2d19e61436b1 None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f163ab6cac34b77945bc27e1a5c66ce', 'request_id': 'req-4dee3bb8-4ffa-4c84-8c32-2d19e61436b1'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:57:59 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1064/2103] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 12:57:59 2024] DELETE /identity/v3/users/6f163ab6cac34b77945bc27e1a5c66ce => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:57:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc06a00-e891-4f78-a929-9c38d9d38a04 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:57:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc06a00-e891-4f78-a929-9c38d9d38a04 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:57:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc06a00-e891-4f78-a929-9c38d9d38a04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:57:59 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-0dc06a00-e891-4f78-a929-9c38d9d38a04 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:57:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-0dc06a00-e891-4f78-a929-9c38d9d38a04 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:57:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-0dc06a00-e891-4f78-a929-9c38d9d38a04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:58:00 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1040/2104] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:57:59 2024] POST /identity/v3/auth/tokens => generated 2960 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 12:58:00 l75lg1-v1 neutron-server[77619]: DEBUG neutron.wsgi [-] (77619) accepted ('10.27.203.238', 46162) {{(pid=77619) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 12:58:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dee3bb8-4ffa-4c84-8c32-2d19e61436b1 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-4dee3bb8-4ffa-4c84-8c32-2d19e61436b1 None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:58:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dee3bb8-4ffa-4c84-8c32-2d19e61436b1 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68173298-4d96-42a2-8542-230b0f4a611c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef17047035e4b518fd5360a01f2da1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68173298-4d96-42a2-8542-230b0f4a611c service neutron] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68173298-4d96-42a2-8542-230b0f4a611c service neutron] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68173298-4d96-42a2-8542-230b0f4a611c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68173298-4d96-42a2-8542-230b0f4a611c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68173298-4d96-42a2-8542-230b0f4a611c service neutron] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:00 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1065/2105] 10.27.203.238 () {64 vars in 1432 bytes} [Tue May 28 12:58:00 2024] GET /identity/v3/auth/tokens => generated 2960 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 28 12:58:00 l75lg1-v1 neutron-server[77619]: INFO neutron.wsgi [None req-4ee5781b-da13-431c-8c2e-d8d12efcb189 None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=efc051b5756f4b69ba8d639efab8d102&name=default HTTP/1.1" status: 200 len: 216 time: 0.0725441 May 28 12:58:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc06a00-e891-4f78-a929-9c38d9d38a04 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-0dc06a00-e891-4f78-a929-9c38d9d38a04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:58:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc06a00-e891-4f78-a929-9c38d9d38a04 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adef5745-7273-4f39-a762-614a51457dc1 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adef5745-7273-4f39-a762-614a51457dc1 None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adef5745-7273-4f39-a762-614a51457dc1 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adef5745-7273-4f39-a762-614a51457dc1 None admin] PATH_INFO: `/v3/projects/efc051b5756f4b69ba8d639efab8d102` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adef5745-7273-4f39-a762-614a51457dc1 None admin] RBAC: Authorizing `identity:delete_project(project_id=efc051b5756f4b69ba8d639efab8d102)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adef5745-7273-4f39-a762-614a51457dc1 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-adef5745-7273-4f39-a762-614a51457dc1 None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'efc051b5756f4b69ba8d639efab8d102', 'request_id': 'req-adef5745-7273-4f39-a762-614a51457dc1'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:58:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-adef5745-7273-4f39-a762-614a51457dc1 None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'efc051b5756f4b69ba8d639efab8d102', 'request_id': 'req-adef5745-7273-4f39-a762-614a51457dc1'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:58:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-adef5745-7273-4f39-a762-614a51457dc1 None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'efc051b5756f4b69ba8d639efab8d102', 'request_id': 'req-adef5745-7273-4f39-a762-614a51457dc1'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:58:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-adef5745-7273-4f39-a762-614a51457dc1 None admin] The token cache is being invalidate because project efc051b5756f4b69ba8d639efab8d102 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 12:58:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-adef5745-7273-4f39-a762-614a51457dc1 None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:58:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-adef5745-7273-4f39-a762-614a51457dc1 None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:58:00 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1041/2106] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 12:58:00 2024] DELETE /identity/v3/projects/efc051b5756f4b69ba8d639efab8d102 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:58:00 l75lg1-v1 neutron-server[77619]: DEBUG neutron.wsgi [-] (77619) accepted ('10.27.203.238', 46164) {{(pid=77619) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 12:58:00 l75lg1-v1 neutron-server[77619]: INFO neutron.wsgi [None req-94b6d159-e0c4-40d1-a461-f1a025d2e706 None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=5e5bc0c8fb8b46d598b0621999301112&name=default HTTP/1.1" status: 200 len: 216 time: 0.0083392 May 28 12:58:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68173298-4d96-42a2-8542-230b0f4a611c service neutron] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68173298-4d96-42a2-8542-230b0f4a611c service neutron] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cd8ae5-a1b3-4db5-ad7e-235e654fabcd None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cd8ae5-a1b3-4db5-ad7e-235e654fabcd None admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cd8ae5-a1b3-4db5-ad7e-235e654fabcd None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cd8ae5-a1b3-4db5-ad7e-235e654fabcd None admin] PATH_INFO: `/v3/projects/5e5bc0c8fb8b46d598b0621999301112` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cd8ae5-a1b3-4db5-ad7e-235e654fabcd None admin] RBAC: Authorizing `identity:delete_project(project_id=5e5bc0c8fb8b46d598b0621999301112)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cd8ae5-a1b3-4db5-ad7e-235e654fabcd None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:00 l75lg1-v1 dstat.sh[49771]: 28-05 12:58:00| 7 1 89 2 0|5707M 1781M 277M 7860M| 18k 3562B| 0 1872k| 0 252 |6122 11k|1.45 1.07 1.01|2.0 0 0| 0 0 | 0 2048M| 29 358 0 62 0 May 28 12:58:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-e9cd8ae5-a1b3-4db5-ad7e-235e654fabcd None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e5bc0c8fb8b46d598b0621999301112', 'request_id': 'req-e9cd8ae5-a1b3-4db5-ad7e-235e654fabcd'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:58:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-e9cd8ae5-a1b3-4db5-ad7e-235e654fabcd None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e5bc0c8fb8b46d598b0621999301112', 'request_id': 'req-e9cd8ae5-a1b3-4db5-ad7e-235e654fabcd'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:58:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-e9cd8ae5-a1b3-4db5-ad7e-235e654fabcd None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e5bc0c8fb8b46d598b0621999301112', 'request_id': 'req-e9cd8ae5-a1b3-4db5-ad7e-235e654fabcd'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:58:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-e9cd8ae5-a1b3-4db5-ad7e-235e654fabcd None admin] The token cache is being invalidate because project 5e5bc0c8fb8b46d598b0621999301112 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 12:58:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-e9cd8ae5-a1b3-4db5-ad7e-235e654fabcd None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:58:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-e9cd8ae5-a1b3-4db5-ad7e-235e654fabcd None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:58:00 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1066/2107] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 12:58:00 2024] DELETE /identity/v3/projects/5e5bc0c8fb8b46d598b0621999301112 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:58:00 l75lg1-v1 neutron-server[77619]: DEBUG neutron.wsgi [-] (77619) accepted ('10.27.203.238', 39614) {{(pid=77619) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 12:58:00 l75lg1-v1 neutron-server[77619]: INFO neutron.wsgi [None req-5c05a449-2380-480b-a03d-d5ade1bcd621 None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=9f0aba9bff5442b580ca1a6d3c9bbaa0&name=default HTTP/1.1" status: 200 len: 216 time: 0.0083051 May 28 12:58:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adef5745-7273-4f39-a762-614a51457dc1 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-adef5745-7273-4f39-a762-614a51457dc1 None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:58:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adef5745-7273-4f39-a762-614a51457dc1 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:00 l75lg1-v1 neutron-server[77618]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.HashRingHealthCheckPeriodics.touch_hash_ring_nodes' {{(pid=77618) _process_scheduled /opt/stack/data/venv/lib/python3.10/site-packages/futurist/periodics.py:638}} May 28 12:58:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27a922b-c3a6-407e-95bd-e720e8eaa688 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27a922b-c3a6-407e-95bd-e720e8eaa688 None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27a922b-c3a6-407e-95bd-e720e8eaa688 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27a922b-c3a6-407e-95bd-e720e8eaa688 None admin] PATH_INFO: `/v3/projects/9f0aba9bff5442b580ca1a6d3c9bbaa0` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27a922b-c3a6-407e-95bd-e720e8eaa688 None admin] RBAC: Authorizing `identity:delete_project(project_id=9f0aba9bff5442b580ca1a6d3c9bbaa0)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27a922b-c3a6-407e-95bd-e720e8eaa688 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-d27a922b-c3a6-407e-95bd-e720e8eaa688 None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f0aba9bff5442b580ca1a6d3c9bbaa0', 'request_id': 'req-d27a922b-c3a6-407e-95bd-e720e8eaa688'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:58:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-d27a922b-c3a6-407e-95bd-e720e8eaa688 None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f0aba9bff5442b580ca1a6d3c9bbaa0', 'request_id': 'req-d27a922b-c3a6-407e-95bd-e720e8eaa688'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:58:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-d27a922b-c3a6-407e-95bd-e720e8eaa688 None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f0aba9bff5442b580ca1a6d3c9bbaa0', 'request_id': 'req-d27a922b-c3a6-407e-95bd-e720e8eaa688'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:58:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-d27a922b-c3a6-407e-95bd-e720e8eaa688 None admin] The token cache is being invalidate because project 9f0aba9bff5442b580ca1a6d3c9bbaa0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 12:58:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-d27a922b-c3a6-407e-95bd-e720e8eaa688 None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:58:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-d27a922b-c3a6-407e-95bd-e720e8eaa688 None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:58:00 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1042/2108] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 12:58:00 2024] DELETE /identity/v3/projects/9f0aba9bff5442b580ca1a6d3c9bbaa0 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:58:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1b9124-fa77-416c-99cf-b27c61406e00 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1b9124-fa77-416c-99cf-b27c61406e00 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1b9124-fa77-416c-99cf-b27c61406e00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:00 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-ad1b9124-fa77-416c-99cf-b27c61406e00 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:58:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-ad1b9124-fa77-416c-99cf-b27c61406e00 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:58:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-ad1b9124-fa77-416c-99cf-b27c61406e00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:58:00 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1067/2109] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:58:00 2024] POST /identity/v3/auth/tokens => generated 312 bytes in 19 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 28 12:58:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4be2bf2-a694-4189-8a3e-a54287c28078 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4be2bf2-a694-4189-8a3e-a54287c28078 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4be2bf2-a694-4189-8a3e-a54287c28078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:00 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2a531a29-2cd9-4e97-9af6-1ed124146a5b tempest-SharesMetadataTest-1561320255 None] <<< [POST] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:58:00 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2a531a29-2cd9-4e97-9af6-1ed124146a5b tempest-SharesMetadataTest-1561320255 None] Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=0, created='2024-05-28T12:58:00.007552Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='472818a4-2598-42ca-9c38-1bc6b2b5e609', id=25, internal=False, is_s3_default_policy=False, name='205d35a8-15b8-4a2f-8214-8c2d1a5de6b0', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=[], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['*'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['*'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T12:58:00.372249Z', tenant_id=1, tenant_name='default', title='205d35a8-15b8-4a2f-8214-8c2d1a5de6b0', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/25/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[]) May 28 12:58:00 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2a531a29-2cd9-4e97-9af6-1ed124146a5b tempest-SharesMetadataTest-1561320255 None] --- [POST] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 12:58:00 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2a531a29-2cd9-4e97-9af6-1ed124146a5b tempest-SharesMetadataTest-1561320255 None] >>> [GET] https://127.0.0.1:40443/api/quotas/ May 28 12:58:00 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2a531a29-2cd9-4e97-9af6-1ed124146a5b tempest-SharesMetadataTest-1561320255 None] {'allow_redirects': True, May 28 12:58:00 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2a531a29-2cd9-4e97-9af6-1ed124146a5b tempest-SharesMetadataTest-1561320255 None] 'params': {'name': '205d35a8-15b8-4a2f-8214-8c2d1a5de6b0'}} May 28 12:58:00 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-d4be2bf2-a694-4189-8a3e-a54287c28078 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:58:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-d4be2bf2-a694-4189-8a3e-a54287c28078 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:58:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-d4be2bf2-a694-4189-8a3e-a54287c28078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:58:00 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1043/2110] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:58:00 2024] POST /identity/v3/auth/tokens => generated 2960 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 12:58:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1b9124-fa77-416c-99cf-b27c61406e00 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1b9124-fa77-416c-99cf-b27c61406e00 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357bcca2-b5f9-4891-9be0-366d7459de17 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357bcca2-b5f9-4891-9be0-366d7459de17 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357bcca2-b5f9-4891-9be0-366d7459de17 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357bcca2-b5f9-4891-9be0-366d7459de17 None admin] PATH_INFO: `/v3/domains` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357bcca2-b5f9-4891-9be0-366d7459de17 None admin] RBAC: Adding query filter params (name=Default) {{(pid=51267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:58:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357bcca2-b5f9-4891-9be0-366d7459de17 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357bcca2-b5f9-4891-9be0-366d7459de17 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:00 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1068/2111] 10.27.203.238 () {62 vars in 1220 bytes} [Tue May 28 12:58:00 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:58:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4be2bf2-a694-4189-8a3e-a54287c28078 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4be2bf2-a694-4189-8a3e-a54287c28078 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4750d1a-8b71-4c2e-a03b-f900732154a1 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4750d1a-8b71-4c2e-a03b-f900732154a1 None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4750d1a-8b71-4c2e-a03b-f900732154a1 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4750d1a-8b71-4c2e-a03b-f900732154a1 None admin] PATH_INFO: `/v3/projects` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4750d1a-8b71-4c2e-a03b-f900732154a1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4750d1a-8b71-4c2e-a03b-f900732154a1 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:00 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1044/2112] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 12:58:00 2024] POST /identity/v3/projects => generated 377 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:58:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357bcca2-b5f9-4891-9be0-366d7459de17 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357bcca2-b5f9-4891-9be0-366d7459de17 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49cbb60-4d9a-4c65-88ea-e92b0d1db8b4 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49cbb60-4d9a-4c65-88ea-e92b0d1db8b4 None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49cbb60-4d9a-4c65-88ea-e92b0d1db8b4 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49cbb60-4d9a-4c65-88ea-e92b0d1db8b4 None admin] PATH_INFO: `/v3/users` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49cbb60-4d9a-4c65-88ea-e92b0d1db8b4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49cbb60-4d9a-4c65-88ea-e92b0d1db8b4 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:00 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-c49cbb60-4d9a-4c65-88ea-e92b0d1db8b4 None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 12:58:00 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1069/2113] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 12:58:00 2024] POST /identity/v3/users => generated 297 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:58:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4750d1a-8b71-4c2e-a03b-f900732154a1 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4750d1a-8b71-4c2e-a03b-f900732154a1 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ea4678-d568-4a7e-9e34-35e079a48b20 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ea4678-d568-4a7e-9e34-35e079a48b20 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ea4678-d568-4a7e-9e34-35e079a48b20 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ea4678-d568-4a7e-9e34-35e079a48b20 None admin] PATH_INFO: `/v3/roles` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ea4678-d568-4a7e-9e34-35e079a48b20 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ea4678-d568-4a7e-9e34-35e079a48b20 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:00 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1045/2114] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 12:58:00 2024] GET /identity/v3/roles => generated 1680 bytes in 16 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:58:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49cbb60-4d9a-4c65-88ea-e92b0d1db8b4 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49cbb60-4d9a-4c65-88ea-e92b0d1db8b4 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51c1545-a46c-41ba-8ae1-8f5e9fd26682 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51c1545-a46c-41ba-8ae1-8f5e9fd26682 None admin] REQUEST_METHOD: `PUT` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51c1545-a46c-41ba-8ae1-8f5e9fd26682 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51c1545-a46c-41ba-8ae1-8f5e9fd26682 None admin] PATH_INFO: `/v3/projects/82840ccb77144a4aa2d0bdce807ce686/users/a5f62af60417483dbbe38e24cb57d83b/roles/44620cad10ae407c90c91e2c296adb04` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51c1545-a46c-41ba-8ae1-8f5e9fd26682 None admin] RBAC: Authorizing `identity:create_grant(project_id=82840ccb77144a4aa2d0bdce807ce686, user_id=a5f62af60417483dbbe38e24cb57d83b, role_id=44620cad10ae407c90c91e2c296adb04)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51c1545-a46c-41ba-8ae1-8f5e9fd26682 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:00 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1070/2115] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 12:58:00 2024] PUT /identity/v3/projects/82840ccb77144a4aa2d0bdce807ce686/users/a5f62af60417483dbbe38e24cb57d83b/roles/44620cad10ae407c90c91e2c296adb04 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:58:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc716c1-6797-4ea8-b19e-768880bfb798 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc716c1-6797-4ea8-b19e-768880bfb798 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc716c1-6797-4ea8-b19e-768880bfb798 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:00 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-2bc716c1-6797-4ea8-b19e-768880bfb798 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:58:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-2bc716c1-6797-4ea8-b19e-768880bfb798 None None] MFA Rules not processed for user `a5f62af60417483dbbe38e24cb57d83b`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:58:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-2bc716c1-6797-4ea8-b19e-768880bfb798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:58:00 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1046/2116] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:58:00 2024] POST /identity/v3/auth/tokens => generated 3948 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:58:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51c1545-a46c-41ba-8ae1-8f5e9fd26682 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51c1545-a46c-41ba-8ae1-8f5e9fd26682 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccf39d0-3e26-4f83-9eb5-385077af6132 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccf39d0-3e26-4f83-9eb5-385077af6132 None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccf39d0-3e26-4f83-9eb5-385077af6132 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccf39d0-3e26-4f83-9eb5-385077af6132 None admin] PATH_INFO: `/v3/projects` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccf39d0-3e26-4f83-9eb5-385077af6132 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccf39d0-3e26-4f83-9eb5-385077af6132 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:00 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1071/2117] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 12:58:00 2024] POST /identity/v3/projects => generated 375 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:58:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc716c1-6797-4ea8-b19e-768880bfb798 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc716c1-6797-4ea8-b19e-768880bfb798 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb992c6-aa4c-4841-ba62-af66bb1b7d46 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb992c6-aa4c-4841-ba62-af66bb1b7d46 None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb992c6-aa4c-4841-ba62-af66bb1b7d46 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb992c6-aa4c-4841-ba62-af66bb1b7d46 None admin] PATH_INFO: `/v3/users` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb992c6-aa4c-4841-ba62-af66bb1b7d46 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb992c6-aa4c-4841-ba62-af66bb1b7d46 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:00 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-fcb992c6-aa4c-4841-ba62-af66bb1b7d46 None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 12:58:00 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1047/2118] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 12:58:00 2024] POST /identity/v3/users => generated 296 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:58:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccf39d0-3e26-4f83-9eb5-385077af6132 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccf39d0-3e26-4f83-9eb5-385077af6132 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbb7915-c818-4e79-8872-bdf328033e55 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbb7915-c818-4e79-8872-bdf328033e55 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbb7915-c818-4e79-8872-bdf328033e55 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbb7915-c818-4e79-8872-bdf328033e55 None admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbb7915-c818-4e79-8872-bdf328033e55 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbb7915-c818-4e79-8872-bdf328033e55 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:00 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1072/2119] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 12:58:00 2024] GET /identity/v3/roles => generated 1680 bytes in 16 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:58:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb992c6-aa4c-4841-ba62-af66bb1b7d46 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb992c6-aa4c-4841-ba62-af66bb1b7d46 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd000a53-8b72-49b1-a96b-0a9821c1e096 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd000a53-8b72-49b1-a96b-0a9821c1e096 None admin] REQUEST_METHOD: `PUT` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd000a53-8b72-49b1-a96b-0a9821c1e096 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd000a53-8b72-49b1-a96b-0a9821c1e096 None admin] PATH_INFO: `/v3/projects/be51d6e321244991ac955863ae123a81/users/7a0db4d21f4c4b35b1f3c9b27af6cdb0/roles/44620cad10ae407c90c91e2c296adb04` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd000a53-8b72-49b1-a96b-0a9821c1e096 None admin] RBAC: Authorizing `identity:create_grant(project_id=be51d6e321244991ac955863ae123a81, user_id=7a0db4d21f4c4b35b1f3c9b27af6cdb0, role_id=44620cad10ae407c90c91e2c296adb04)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd000a53-8b72-49b1-a96b-0a9821c1e096 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:00 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1048/2120] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 12:58:00 2024] PUT /identity/v3/projects/be51d6e321244991ac955863ae123a81/users/7a0db4d21f4c4b35b1f3c9b27af6cdb0/roles/44620cad10ae407c90c91e2c296adb04 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:58:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a4e00e-11c1-42a1-a413-114f667006b1 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a4e00e-11c1-42a1-a413-114f667006b1 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a4e00e-11c1-42a1-a413-114f667006b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:00 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-83a4e00e-11c1-42a1-a413-114f667006b1 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:58:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-83a4e00e-11c1-42a1-a413-114f667006b1 None None] MFA Rules not processed for user `7a0db4d21f4c4b35b1f3c9b27af6cdb0`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:58:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-83a4e00e-11c1-42a1-a413-114f667006b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:58:00 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1073/2121] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:58:00 2024] POST /identity/v3/auth/tokens => generated 3946 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:58:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd000a53-8b72-49b1-a96b-0a9821c1e096 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:00 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-b2917c65-ed60-419f-9274-592cd4ca85b8 tempest-SnapshotInstancesNegativeTest-1396485679 tempest-SnapshotInstancesNegativeTest-1396485679-project-admin] GET http://10.27.203.238/share/v2/c9cc76ecb4e343a6a51bf36da01debf8/snapshots/0d2e6969-2d63-4c8c-bd0a-ae6e8ca0314c May 28 12:58:00 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-b2917c65-ed60-419f-9274-592cd4ca85b8 tempest-SnapshotInstancesNegativeTest-1396485679 tempest-SnapshotInstancesNegativeTest-1396485679-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:00 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-b2917c65-ed60-419f-9274-592cd4ca85b8 tempest-SnapshotInstancesNegativeTest-1396485679 tempest-SnapshotInstancesNegativeTest-1396485679-project-admin] Calling method 'ShareSnapshotMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd000a53-8b72-49b1-a96b-0a9821c1e096 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac8f10c-93d4-4ebf-8994-104c8c201d10 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac8f10c-93d4-4ebf-8994-104c8c201d10 None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac8f10c-93d4-4ebf-8994-104c8c201d10 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac8f10c-93d4-4ebf-8994-104c8c201d10 None admin] PATH_INFO: `/v3/projects` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac8f10c-93d4-4ebf-8994-104c8c201d10 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac8f10c-93d4-4ebf-8994-104c8c201d10 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:01 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-b2917c65-ed60-419f-9274-592cd4ca85b8 tempest-SnapshotInstancesNegativeTest-1396485679 tempest-SnapshotInstancesNegativeTest-1396485679-project-admin] http://10.27.203.238/share/v2/c9cc76ecb4e343a6a51bf36da01debf8/snapshots/0d2e6969-2d63-4c8c-bd0a-ae6e8ca0314c returned with HTTP 200 May 28 12:58:01 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 449/907] 10.27.203.238 () {64 vars in 1460 bytes} [Tue May 28 12:58:00 2024] GET /share/v2/c9cc76ecb4e343a6a51bf36da01debf8/snapshots/0d2e6969-2d63-4c8c-bd0a-ae6e8ca0314c => generated 750 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:58:01 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-dc5467a9-3190-4f79-8dac-dd33eaae6fb3 tempest-SnapshotInstancesNegativeTest-1396485679 tempest-SnapshotInstancesNegativeTest-1396485679-project-admin] GET http://10.27.203.238/share/v2/c9cc76ecb4e343a6a51bf36da01debf8/snapshot-instances?snapshot_id=0d2e6969-2d63-4c8c-bd0a-ae6e8ca0314c May 28 12:58:01 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-dc5467a9-3190-4f79-8dac-dd33eaae6fb3 tempest-SnapshotInstancesNegativeTest-1396485679 tempest-SnapshotInstancesNegativeTest-1396485679-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:01 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-dc5467a9-3190-4f79-8dac-dd33eaae6fb3 tempest-SnapshotInstancesNegativeTest-1396485679 tempest-SnapshotInstancesNegativeTest-1396485679-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:01 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2a531a29-2cd9-4e97-9af6-1ed124146a5b tempest-SharesMetadataTest-1561320255 None] <<< [GET] https://127.0.0.1:40443/api/quotas/ May 28 12:58:01 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2a531a29-2cd9-4e97-9af6-1ed124146a5b tempest-SharesMetadataTest-1561320255 None] [] May 28 12:58:01 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2a531a29-2cd9-4e97-9af6-1ed124146a5b tempest-SharesMetadataTest-1561320255 None] --- [GET] https://127.0.0.1:40443/api/quotas/: Done May 28 12:58:01 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2a531a29-2cd9-4e97-9af6-1ed124146a5b tempest-SharesMetadataTest-1561320255 None] >>> [POST] https://127.0.0.1:40443/api/quotas/ May 28 12:58:01 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2a531a29-2cd9-4e97-9af6-1ed124146a5b tempest-SharesMetadataTest-1561320255 None] {'data': '{"name": "205d35a8-15b8-4a2f-8214-8c2d1a5de6b0", "path": ' May 28 12:58:01 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2a531a29-2cd9-4e97-9af6-1ed124146a5b tempest-SharesMetadataTest-1561320255 None] '"/manila/manila-205d35a8-15b8-4a2f-8214-8c2d1a5de6b0", "create_dir": ' May 28 12:58:01 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2a531a29-2cd9-4e97-9af6-1ed124146a5b tempest-SharesMetadataTest-1561320255 None] 'true, "hard_limit": 1073741824}', May 28 12:58:01 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2a531a29-2cd9-4e97-9af6-1ed124146a5b tempest-SharesMetadataTest-1561320255 None] 'json': None, May 28 12:58:01 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2a531a29-2cd9-4e97-9af6-1ed124146a5b tempest-SharesMetadataTest-1561320255 None] 'params': None} May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1049/2122] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 12:58:00 2024] POST /identity/v3/projects => generated 377 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a4e00e-11c1-42a1-a413-114f667006b1 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:01 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-dc5467a9-3190-4f79-8dac-dd33eaae6fb3 tempest-SnapshotInstancesNegativeTest-1396485679 tempest-SnapshotInstancesNegativeTest-1396485679-project-admin] http://10.27.203.238/share/v2/c9cc76ecb4e343a6a51bf36da01debf8/snapshot-instances?snapshot_id=0d2e6969-2d63-4c8c-bd0a-ae6e8ca0314c returned with HTTP 200 May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a4e00e-11c1-42a1-a413-114f667006b1 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:01 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 459/908] 10.27.203.238 () {64 vars in 1473 bytes} [Tue May 28 12:58:01 2024] GET /share/v2/c9cc76ecb4e343a6a51bf36da01debf8/snapshot-instances?snapshot_id=0d2e6969-2d63-4c8c-bd0a-ae6e8ca0314c => generated 150 bytes in 23 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac8f10c-93d4-4ebf-8994-104c8c201d10 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-5ac8f10c-93d4-4ebf-8994-104c8c201d10 None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba1ab76-310d-435c-8240-adb0905bec49 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba1ab76-310d-435c-8240-adb0905bec49 None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba1ab76-310d-435c-8240-adb0905bec49 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba1ab76-310d-435c-8240-adb0905bec49 None admin] PATH_INFO: `/v3/users` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba1ab76-310d-435c-8240-adb0905bec49 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba1ab76-310d-435c-8240-adb0905bec49 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-aba1ab76-310d-435c-8240-adb0905bec49 None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac8f10c-93d4-4ebf-8994-104c8c201d10 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4735567-7100-49c8-8aef-777ce439be2a service manila] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f110cf6300f049c897d0aab63218d1e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4735567-7100-49c8-8aef-777ce439be2a service manila] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4735567-7100-49c8-8aef-777ce439be2a service manila] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4735567-7100-49c8-8aef-777ce439be2a service manila] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-b4735567-7100-49c8-8aef-777ce439be2a service manila] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1074/2123] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 12:58:01 2024] POST /identity/v3/users => generated 296 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba1ab76-310d-435c-8240-adb0905bec49 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba1ab76-310d-435c-8240-adb0905bec49 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9722525e-2da6-42da-8af8-6bca8851a051 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9722525e-2da6-42da-8af8-6bca8851a051 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9722525e-2da6-42da-8af8-6bca8851a051 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9722525e-2da6-42da-8af8-6bca8851a051 None admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9722525e-2da6-42da-8af8-6bca8851a051 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9722525e-2da6-42da-8af8-6bca8851a051 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1075/2124] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 12:58:01 2024] GET /identity/v3/roles => generated 1680 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9722525e-2da6-42da-8af8-6bca8851a051 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4735567-7100-49c8-8aef-777ce439be2a service manila] RBAC: Authorizing `identity:validate_token()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9722525e-2da6-42da-8af8-6bca8851a051 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4735567-7100-49c8-8aef-777ce439be2a service manila] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1050/2125] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 12:58:01 2024] GET /identity/v3/auth/tokens => generated 3968 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab32be1a-30f1-4721-ba1b-f114db9bb275 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab32be1a-30f1-4721-ba1b-f114db9bb275 None admin] REQUEST_METHOD: `PUT` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab32be1a-30f1-4721-ba1b-f114db9bb275 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab32be1a-30f1-4721-ba1b-f114db9bb275 None admin] PATH_INFO: `/v3/projects/6bcb84add5bc4d8cb675498201734b6d/users/cacdef9ca5d04afb85fa43f2d0e57632/roles/e7989893488f483baa107be56668c4f8` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:01 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-73cc7840-57cd-473f-985e-12a9194a7b4a tempest-SnapshotInstancesNegativeTest-1897954514 tempest-SnapshotInstancesNegativeTest-1897954514-project-member] GET http://10.27.203.238/share/v2/ed0a0bf2490645089c21203bbbe1c291/snapshot-instances/d9f25a4b-5def-4427-b890-289ce9aabe70 May 28 12:58:01 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-73cc7840-57cd-473f-985e-12a9194a7b4a tempest-SnapshotInstancesNegativeTest-1897954514 tempest-SnapshotInstancesNegativeTest-1897954514-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:01 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-73cc7840-57cd-473f-985e-12a9194a7b4a tempest-SnapshotInstancesNegativeTest-1897954514 tempest-SnapshotInstancesNegativeTest-1897954514-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:01 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.policy [None req-73cc7840-57cd-473f-985e-12a9194a7b4a tempest-SnapshotInstancesNegativeTest-1897954514 tempest-SnapshotInstancesNegativeTest-1897954514-project-member] Policy check for share_snapshot_instance:show failed with credentials {'is_admin': False, 'user_id': 'f3cb6c53a51049ff8cbf29dc9067534a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0a0bf2490645089c21203bbbe1c291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98330) authorize /opt/stack/manila/manila/policy.py:208}} May 28 12:58:01 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-73cc7840-57cd-473f-985e-12a9194a7b4a tempest-SnapshotInstancesNegativeTest-1897954514 tempest-SnapshotInstancesNegativeTest-1897954514-project-member] HTTP exception thrown: Access was denied to this resource. May 28 12:58:01 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-73cc7840-57cd-473f-985e-12a9194a7b4a tempest-SnapshotInstancesNegativeTest-1897954514 tempest-SnapshotInstancesNegativeTest-1897954514-project-member] http://10.27.203.238/share/v2/ed0a0bf2490645089c21203bbbe1c291/snapshot-instances/d9f25a4b-5def-4427-b890-289ce9aabe70 returned with HTTP 403 May 28 12:58:01 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 450/909] 10.27.203.238 () {64 vars in 1487 bytes} [Tue May 28 12:58:01 2024] GET /share/v2/ed0a0bf2490645089c21203bbbe1c291/snapshot-instances/d9f25a4b-5def-4427-b890-289ce9aabe70 => generated 78 bytes in 108 msecs (HTTP/1.1 403) 6 headers in 237 bytes (1 switches on core 0) May 28 12:58:01 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-f29bd26e-e447-4d26-90e8-3b8ff4d286bc tempest-SnapshotInstancesNegativeTest-1897954514 tempest-SnapshotInstancesNegativeTest-1897954514-project-member] GET http://10.27.203.238/share/v2/ed0a0bf2490645089c21203bbbe1c291/snapshot-instances?snapshot_id=0d2e6969-2d63-4c8c-bd0a-ae6e8ca0314c May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab32be1a-30f1-4721-ba1b-f114db9bb275 None admin] RBAC: Authorizing `identity:create_grant(project_id=6bcb84add5bc4d8cb675498201734b6d, user_id=cacdef9ca5d04afb85fa43f2d0e57632, role_id=e7989893488f483baa107be56668c4f8)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:01 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-f29bd26e-e447-4d26-90e8-3b8ff4d286bc tempest-SnapshotInstancesNegativeTest-1897954514 tempest-SnapshotInstancesNegativeTest-1897954514-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:01 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-f29bd26e-e447-4d26-90e8-3b8ff4d286bc tempest-SnapshotInstancesNegativeTest-1897954514 tempest-SnapshotInstancesNegativeTest-1897954514-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab32be1a-30f1-4721-ba1b-f114db9bb275 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:01 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.policy [None req-f29bd26e-e447-4d26-90e8-3b8ff4d286bc tempest-SnapshotInstancesNegativeTest-1897954514 tempest-SnapshotInstancesNegativeTest-1897954514-project-member] Policy check for share_snapshot_instance:index failed with credentials {'is_admin': False, 'user_id': 'f3cb6c53a51049ff8cbf29dc9067534a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0a0bf2490645089c21203bbbe1c291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98329) authorize /opt/stack/manila/manila/policy.py:208}} May 28 12:58:01 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-f29bd26e-e447-4d26-90e8-3b8ff4d286bc tempest-SnapshotInstancesNegativeTest-1897954514 tempest-SnapshotInstancesNegativeTest-1897954514-project-member] HTTP exception thrown: Access was denied to this resource. May 28 12:58:01 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-f29bd26e-e447-4d26-90e8-3b8ff4d286bc tempest-SnapshotInstancesNegativeTest-1897954514 tempest-SnapshotInstancesNegativeTest-1897954514-project-member] http://10.27.203.238/share/v2/ed0a0bf2490645089c21203bbbe1c291/snapshot-instances?snapshot_id=0d2e6969-2d63-4c8c-bd0a-ae6e8ca0314c returned with HTTP 403 May 28 12:58:01 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 460/910] 10.27.203.238 () {64 vars in 1473 bytes} [Tue May 28 12:58:01 2024] GET /share/v2/ed0a0bf2490645089c21203bbbe1c291/snapshot-instances?snapshot_id=0d2e6969-2d63-4c8c-bd0a-ae6e8ca0314c => generated 78 bytes in 7 msecs (HTTP/1.1 403) 6 headers in 237 bytes (1 switches on core 0) May 28 12:58:01 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-47f4ef0f-b0fe-4b1c-9777-ee1ce792145d tempest-SnapshotInstancesNegativeTest-1396485679 tempest-SnapshotInstancesNegativeTest-1396485679-project-admin] GET http://10.27.203.238/share/v2/c9cc76ecb4e343a6a51bf36da01debf8/snapshot-instances?snapshot_id=0d2e6969-2d63-4c8c-bd0a-ae6e8ca0314c May 28 12:58:01 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-47f4ef0f-b0fe-4b1c-9777-ee1ce792145d tempest-SnapshotInstancesNegativeTest-1396485679 tempest-SnapshotInstancesNegativeTest-1396485679-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:01 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-47f4ef0f-b0fe-4b1c-9777-ee1ce792145d tempest-SnapshotInstancesNegativeTest-1396485679 tempest-SnapshotInstancesNegativeTest-1396485679-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1076/2126] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 12:58:01 2024] PUT /identity/v3/projects/6bcb84add5bc4d8cb675498201734b6d/users/cacdef9ca5d04afb85fa43f2d0e57632/roles/e7989893488f483baa107be56668c4f8 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4735567-7100-49c8-8aef-777ce439be2a service manila] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4735567-7100-49c8-8aef-777ce439be2a service manila] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:01 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-47f4ef0f-b0fe-4b1c-9777-ee1ce792145d tempest-SnapshotInstancesNegativeTest-1396485679 tempest-SnapshotInstancesNegativeTest-1396485679-project-admin] http://10.27.203.238/share/v2/c9cc76ecb4e343a6a51bf36da01debf8/snapshot-instances?snapshot_id=0d2e6969-2d63-4c8c-bd0a-ae6e8ca0314c returned with HTTP 200 May 28 12:58:01 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 451/911] 10.27.203.238 () {64 vars in 1473 bytes} [Tue May 28 12:58:01 2024] GET /share/v2/c9cc76ecb4e343a6a51bf36da01debf8/snapshot-instances?snapshot_id=0d2e6969-2d63-4c8c-bd0a-ae6e8ca0314c => generated 150 bytes in 25 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:58:01 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-ae6c97e3-2e3a-4e26-bfee-191842ab6dc8 tempest-SnapshotInstancesNegativeTest-1897954514 tempest-SnapshotInstancesNegativeTest-1897954514-project-member] POST http://10.27.203.238/share/v2/ed0a0bf2490645089c21203bbbe1c291/snapshot-instances/d9f25a4b-5def-4427-b890-289ce9aabe70/action May 28 12:58:01 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-ae6c97e3-2e3a-4e26-bfee-191842ab6dc8 tempest-SnapshotInstancesNegativeTest-1897954514 tempest-SnapshotInstancesNegativeTest-1897954514-project-member] Action body: b'{"reset_status": {"status": "error"}}' {{(pid=98329) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:58:01 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-ae6c97e3-2e3a-4e26-bfee-191842ab6dc8 tempest-SnapshotInstancesNegativeTest-1897954514 tempest-SnapshotInstancesNegativeTest-1897954514-project-member] Action: 'action', calling method: ShareSnapshotInstancesController.reset_status, body: {"reset_status": {"status": "error"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:58:01 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.policy [None req-ae6c97e3-2e3a-4e26-bfee-191842ab6dc8 tempest-SnapshotInstancesNegativeTest-1897954514 tempest-SnapshotInstancesNegativeTest-1897954514-project-member] Policy check for share_snapshot_instance:reset_status failed with credentials {'is_admin': False, 'user_id': 'f3cb6c53a51049ff8cbf29dc9067534a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0a0bf2490645089c21203bbbe1c291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98329) authorize /opt/stack/manila/manila/policy.py:208}} May 28 12:58:01 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-ae6c97e3-2e3a-4e26-bfee-191842ab6dc8 tempest-SnapshotInstancesNegativeTest-1897954514 tempest-SnapshotInstancesNegativeTest-1897954514-project-member] HTTP exception thrown: Access was denied to this resource. May 28 12:58:01 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-ae6c97e3-2e3a-4e26-bfee-191842ab6dc8 tempest-SnapshotInstancesNegativeTest-1897954514 tempest-SnapshotInstancesNegativeTest-1897954514-project-member] http://10.27.203.238/share/v2/ed0a0bf2490645089c21203bbbe1c291/snapshot-instances/d9f25a4b-5def-4427-b890-289ce9aabe70/action returned with HTTP 403 May 28 12:58:01 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 461/912] 10.27.203.238 () {66 vars in 1529 bytes} [Tue May 28 12:58:01 2024] POST /share/v2/ed0a0bf2490645089c21203bbbe1c291/snapshot-instances/d9f25a4b-5def-4427-b890-289ce9aabe70/action => generated 78 bytes in 8 msecs (HTTP/1.1 403) 6 headers in 237 bytes (1 switches on core 0) May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87d21cb-7d07-4d3c-88b7-0d2b1095e9a8 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87d21cb-7d07-4d3c-88b7-0d2b1095e9a8 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87d21cb-7d07-4d3c-88b7-0d2b1095e9a8 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87d21cb-7d07-4d3c-88b7-0d2b1095e9a8 None admin] PATH_INFO: `/v3/roles` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87d21cb-7d07-4d3c-88b7-0d2b1095e9a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab32be1a-30f1-4721-ba1b-f114db9bb275 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87d21cb-7d07-4d3c-88b7-0d2b1095e9a8 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-ab32be1a-30f1-4721-ba1b-f114db9bb275 None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1051/2127] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 12:58:01 2024] GET /identity/v3/roles => generated 1680 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87d21cb-7d07-4d3c-88b7-0d2b1095e9a8 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87d21cb-7d07-4d3c-88b7-0d2b1095e9a8 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824b012f-8af4-47a6-b88c-4813fa730a41 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824b012f-8af4-47a6-b88c-4813fa730a41 None admin] REQUEST_METHOD: `PUT` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824b012f-8af4-47a6-b88c-4813fa730a41 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824b012f-8af4-47a6-b88c-4813fa730a41 None admin] PATH_INFO: `/v3/projects/6bcb84add5bc4d8cb675498201734b6d/users/cacdef9ca5d04afb85fa43f2d0e57632/roles/e7989893488f483baa107be56668c4f8` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824b012f-8af4-47a6-b88c-4813fa730a41 None admin] RBAC: Authorizing `identity:create_grant(project_id=6bcb84add5bc4d8cb675498201734b6d, user_id=cacdef9ca5d04afb85fa43f2d0e57632, role_id=e7989893488f483baa107be56668c4f8)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824b012f-8af4-47a6-b88c-4813fa730a41 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:01 l75lg1-v1 dstat.sh[49771]: 28-05 12:58:01| 12 1 84 2 0|5707M 1780M 277M 7860M| 20k 8015B| 0 2425k| 0 285 |7719 14k|1.45 1.07 1.01|3.0 1.0 0| 0 0 | 0 2048M| 29 359 0 65 0 May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1052/2128] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 12:58:01 2024] PUT /identity/v3/projects/6bcb84add5bc4d8cb675498201734b6d/users/cacdef9ca5d04afb85fa43f2d0e57632/roles/e7989893488f483baa107be56668c4f8 => generated 0 bytes in 18 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94be5844-ab16-4c46-a294-1918fb17f740 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94be5844-ab16-4c46-a294-1918fb17f740 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94be5844-ab16-4c46-a294-1918fb17f740 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-94be5844-ab16-4c46-a294-1918fb17f740 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab32be1a-30f1-4721-ba1b-f114db9bb275 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-94be5844-ab16-4c46-a294-1918fb17f740 None None] MFA Rules not processed for user `cacdef9ca5d04afb85fa43f2d0e57632`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-94be5844-ab16-4c46-a294-1918fb17f740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21bac2b-7b1f-4b2a-9f99-0d805f7684f6 tempest-SnapshotInstancesNegativeTest-1396485679 tempest-SnapshotInstancesNegativeTest-1396485679-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b4f232c985e4c7eafeef302f4eaa647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9cc76ecb4e343a6a51bf36da01debf8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21bac2b-7b1f-4b2a-9f99-0d805f7684f6 tempest-SnapshotInstancesNegativeTest-1396485679 tempest-SnapshotInstancesNegativeTest-1396485679-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21bac2b-7b1f-4b2a-9f99-0d805f7684f6 tempest-SnapshotInstancesNegativeTest-1396485679 tempest-SnapshotInstancesNegativeTest-1396485679-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21bac2b-7b1f-4b2a-9f99-0d805f7684f6 tempest-SnapshotInstancesNegativeTest-1396485679 tempest-SnapshotInstancesNegativeTest-1396485679-project-admin] PATH_INFO: `/v3/users/8688f80695814f34bfb56342c4e54028` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21bac2b-7b1f-4b2a-9f99-0d805f7684f6 tempest-SnapshotInstancesNegativeTest-1396485679 tempest-SnapshotInstancesNegativeTest-1396485679-project-admin] RBAC: Authorizing `identity:delete_user(user_id=8688f80695814f34bfb56342c4e54028)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21bac2b-7b1f-4b2a-9f99-0d805f7684f6 tempest-SnapshotInstancesNegativeTest-1396485679 tempest-SnapshotInstancesNegativeTest-1396485679-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-b21bac2b-7b1f-4b2a-9f99-0d805f7684f6 tempest-SnapshotInstancesNegativeTest-1396485679 tempest-SnapshotInstancesNegativeTest-1396485679-project-admin] Could not find user: 8688f80695814f34bfb56342c4e54028.: keystone.exception.UserNotFound: Could not find user: 8688f80695814f34bfb56342c4e54028. May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 8688f80695814f34bfb56342c4e54028. May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1077/2129] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 12:58:01 2024] DELETE /identity/v3/users/8688f80695814f34bfb56342c4e54028 => generated 110 bytes in 106 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1053/2130] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:58:01 2024] POST /identity/v3/auth/tokens => generated 4071 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21bac2b-7b1f-4b2a-9f99-0d805f7684f6 tempest-SnapshotInstancesNegativeTest-1396485679 tempest-SnapshotInstancesNegativeTest-1396485679-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94be5844-ab16-4c46-a294-1918fb17f740 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21bac2b-7b1f-4b2a-9f99-0d805f7684f6 tempest-SnapshotInstancesNegativeTest-1396485679 tempest-SnapshotInstancesNegativeTest-1396485679-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2254ab-03cd-4ad7-b7d0-dfdc35058533 tempest-SnapshotInstancesNegativeTest-1396485679 tempest-SnapshotInstancesNegativeTest-1396485679-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b4f232c985e4c7eafeef302f4eaa647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9cc76ecb4e343a6a51bf36da01debf8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2254ab-03cd-4ad7-b7d0-dfdc35058533 tempest-SnapshotInstancesNegativeTest-1396485679 tempest-SnapshotInstancesNegativeTest-1396485679-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2254ab-03cd-4ad7-b7d0-dfdc35058533 tempest-SnapshotInstancesNegativeTest-1396485679 tempest-SnapshotInstancesNegativeTest-1396485679-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2254ab-03cd-4ad7-b7d0-dfdc35058533 tempest-SnapshotInstancesNegativeTest-1396485679 tempest-SnapshotInstancesNegativeTest-1396485679-project-admin] PATH_INFO: `/v3/users/108a25e436e9452a9a865957dcea1fc5` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94be5844-ab16-4c46-a294-1918fb17f740 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b4bd36-fe45-4304-82a6-c386ac71b8b8 tempest-ResourceLockCRUTest-1063854601 tempest-ResourceLockCRUTest-1063854601-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cacdef9ca5d04afb85fa43f2d0e57632', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bcb84add5bc4d8cb675498201734b6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b4bd36-fe45-4304-82a6-c386ac71b8b8 tempest-ResourceLockCRUTest-1063854601 tempest-ResourceLockCRUTest-1063854601-project-admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b4bd36-fe45-4304-82a6-c386ac71b8b8 tempest-ResourceLockCRUTest-1063854601 tempest-ResourceLockCRUTest-1063854601-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2254ab-03cd-4ad7-b7d0-dfdc35058533 tempest-SnapshotInstancesNegativeTest-1396485679 tempest-SnapshotInstancesNegativeTest-1396485679-project-admin] RBAC: Authorizing `identity:delete_user(user_id=108a25e436e9452a9a865957dcea1fc5)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b4bd36-fe45-4304-82a6-c386ac71b8b8 tempest-ResourceLockCRUTest-1063854601 tempest-ResourceLockCRUTest-1063854601-project-admin] PATH_INFO: `/v3/domains` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b4bd36-fe45-4304-82a6-c386ac71b8b8 tempest-ResourceLockCRUTest-1063854601 tempest-ResourceLockCRUTest-1063854601-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b4bd36-fe45-4304-82a6-c386ac71b8b8 tempest-ResourceLockCRUTest-1063854601 tempest-ResourceLockCRUTest-1063854601-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2254ab-03cd-4ad7-b7d0-dfdc35058533 tempest-SnapshotInstancesNegativeTest-1396485679 tempest-SnapshotInstancesNegativeTest-1396485679-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b4bd36-fe45-4304-82a6-c386ac71b8b8 tempest-ResourceLockCRUTest-1063854601 tempest-ResourceLockCRUTest-1063854601-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-fc2254ab-03cd-4ad7-b7d0-dfdc35058533 tempest-SnapshotInstancesNegativeTest-1396485679 tempest-SnapshotInstancesNegativeTest-1396485679-project-admin] Could not find user: 108a25e436e9452a9a865957dcea1fc5.: keystone.exception.UserNotFound: Could not find user: 108a25e436e9452a9a865957dcea1fc5. May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 108a25e436e9452a9a865957dcea1fc5. May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1078/2131] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 12:58:01 2024] DELETE /identity/v3/users/108a25e436e9452a9a865957dcea1fc5 => generated 110 bytes in 22 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 12:58:01 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-0e985612-5606-4442-b24f-abba92961bb6 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] GET http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/snapshots/461797f5-03b2-4e09-af96-9f13a9a2464e May 28 12:58:01 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-0e985612-5606-4442-b24f-abba92961bb6 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:01 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-0e985612-5606-4442-b24f-abba92961bb6 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Calling method 'ShareSnapshotMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1054/2132] 10.27.203.238 () {62 vars in 1241 bytes} [Tue May 28 12:58:01 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2254ab-03cd-4ad7-b7d0-dfdc35058533 tempest-SnapshotInstancesNegativeTest-1396485679 tempest-SnapshotInstancesNegativeTest-1396485679-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b4bd36-fe45-4304-82a6-c386ac71b8b8 tempest-ResourceLockCRUTest-1063854601 tempest-ResourceLockCRUTest-1063854601-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2254ab-03cd-4ad7-b7d0-dfdc35058533 tempest-SnapshotInstancesNegativeTest-1396485679 tempest-SnapshotInstancesNegativeTest-1396485679-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b4bd36-fe45-4304-82a6-c386ac71b8b8 tempest-ResourceLockCRUTest-1063854601 tempest-ResourceLockCRUTest-1063854601-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ddbf30-d87f-4abd-9926-6b67daa96e1a tempest-SnapshotInstancesNegativeTest-1396485679 tempest-SnapshotInstancesNegativeTest-1396485679-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b4f232c985e4c7eafeef302f4eaa647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9cc76ecb4e343a6a51bf36da01debf8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ddbf30-d87f-4abd-9926-6b67daa96e1a tempest-SnapshotInstancesNegativeTest-1396485679 tempest-SnapshotInstancesNegativeTest-1396485679-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ddbf30-d87f-4abd-9926-6b67daa96e1a tempest-SnapshotInstancesNegativeTest-1396485679 tempest-SnapshotInstancesNegativeTest-1396485679-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ddbf30-d87f-4abd-9926-6b67daa96e1a tempest-SnapshotInstancesNegativeTest-1396485679 tempest-SnapshotInstancesNegativeTest-1396485679-project-admin] PATH_INFO: `/v3/users/5ae5cb1db3504baaba1df93dc154a004` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061b06e9-5ce1-4781-abf4-88f94f38f70c tempest-ResourceLockCRUTest-1063854601 tempest-ResourceLockCRUTest-1063854601-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cacdef9ca5d04afb85fa43f2d0e57632', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bcb84add5bc4d8cb675498201734b6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061b06e9-5ce1-4781-abf4-88f94f38f70c tempest-ResourceLockCRUTest-1063854601 tempest-ResourceLockCRUTest-1063854601-project-admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061b06e9-5ce1-4781-abf4-88f94f38f70c tempest-ResourceLockCRUTest-1063854601 tempest-ResourceLockCRUTest-1063854601-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061b06e9-5ce1-4781-abf4-88f94f38f70c tempest-ResourceLockCRUTest-1063854601 tempest-ResourceLockCRUTest-1063854601-project-admin] PATH_INFO: `/v3/users` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061b06e9-5ce1-4781-abf4-88f94f38f70c tempest-ResourceLockCRUTest-1063854601 tempest-ResourceLockCRUTest-1063854601-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061b06e9-5ce1-4781-abf4-88f94f38f70c tempest-ResourceLockCRUTest-1063854601 tempest-ResourceLockCRUTest-1063854601-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ddbf30-d87f-4abd-9926-6b67daa96e1a tempest-SnapshotInstancesNegativeTest-1396485679 tempest-SnapshotInstancesNegativeTest-1396485679-project-admin] RBAC: Authorizing `identity:delete_user(user_id=5ae5cb1db3504baaba1df93dc154a004)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-061b06e9-5ce1-4781-abf4-88f94f38f70c tempest-ResourceLockCRUTest-1063854601 tempest-ResourceLockCRUTest-1063854601-project-admin] Truncating password to algorithm specific maximum length 72 characters. May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ddbf30-d87f-4abd-9926-6b67daa96e1a tempest-SnapshotInstancesNegativeTest-1396485679 tempest-SnapshotInstancesNegativeTest-1396485679-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-54ddbf30-d87f-4abd-9926-6b67daa96e1a tempest-SnapshotInstancesNegativeTest-1396485679 tempest-SnapshotInstancesNegativeTest-1396485679-project-admin] Could not find user: 5ae5cb1db3504baaba1df93dc154a004.: keystone.exception.UserNotFound: Could not find user: 5ae5cb1db3504baaba1df93dc154a004. May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 5ae5cb1db3504baaba1df93dc154a004. May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1079/2133] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 12:58:01 2024] DELETE /identity/v3/users/5ae5cb1db3504baaba1df93dc154a004 => generated 110 bytes in 24 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ddbf30-d87f-4abd-9926-6b67daa96e1a tempest-SnapshotInstancesNegativeTest-1396485679 tempest-SnapshotInstancesNegativeTest-1396485679-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ddbf30-d87f-4abd-9926-6b67daa96e1a tempest-SnapshotInstancesNegativeTest-1396485679 tempest-SnapshotInstancesNegativeTest-1396485679-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:01 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-0e985612-5606-4442-b24f-abba92961bb6 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/snapshots/461797f5-03b2-4e09-af96-9f13a9a2464e returned with HTTP 200 May 28 12:58:01 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 452/913] 10.27.203.238 () {64 vars in 1460 bytes} [Tue May 28 12:58:01 2024] GET /share/v2/a3499cb78849424db45e54caac01de92/snapshots/461797f5-03b2-4e09-af96-9f13a9a2464e => generated 749 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee505946-2571-4c5c-8e96-183061937039 tempest-SnapshotInstancesNegativeTest-1396485679 tempest-SnapshotInstancesNegativeTest-1396485679-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b4f232c985e4c7eafeef302f4eaa647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9cc76ecb4e343a6a51bf36da01debf8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee505946-2571-4c5c-8e96-183061937039 tempest-SnapshotInstancesNegativeTest-1396485679 tempest-SnapshotInstancesNegativeTest-1396485679-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee505946-2571-4c5c-8e96-183061937039 tempest-SnapshotInstancesNegativeTest-1396485679 tempest-SnapshotInstancesNegativeTest-1396485679-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee505946-2571-4c5c-8e96-183061937039 tempest-SnapshotInstancesNegativeTest-1396485679 tempest-SnapshotInstancesNegativeTest-1396485679-project-admin] PATH_INFO: `/v3/users/c2ac6ca3ea5a4ae498df6d12bb7caadc` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1055/2134] 10.27.203.238 () {64 vars in 1232 bytes} [Tue May 28 12:58:01 2024] POST /identity/v3/users => generated 435 bytes in 35 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061b06e9-5ce1-4781-abf4-88f94f38f70c tempest-ResourceLockCRUTest-1063854601 tempest-ResourceLockCRUTest-1063854601-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee505946-2571-4c5c-8e96-183061937039 tempest-SnapshotInstancesNegativeTest-1396485679 tempest-SnapshotInstancesNegativeTest-1396485679-project-admin] RBAC: Authorizing `identity:delete_user(user_id=c2ac6ca3ea5a4ae498df6d12bb7caadc)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee505946-2571-4c5c-8e96-183061937039 tempest-SnapshotInstancesNegativeTest-1396485679 tempest-SnapshotInstancesNegativeTest-1396485679-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061b06e9-5ce1-4781-abf4-88f94f38f70c tempest-ResourceLockCRUTest-1063854601 tempest-ResourceLockCRUTest-1063854601-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6a7ad7-ad26-43ae-851e-f641097065a8 tempest-ResourceLockCRUTest-1063854601 tempest-ResourceLockCRUTest-1063854601-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cacdef9ca5d04afb85fa43f2d0e57632', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bcb84add5bc4d8cb675498201734b6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6a7ad7-ad26-43ae-851e-f641097065a8 tempest-ResourceLockCRUTest-1063854601 tempest-ResourceLockCRUTest-1063854601-project-admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6a7ad7-ad26-43ae-851e-f641097065a8 tempest-ResourceLockCRUTest-1063854601 tempest-ResourceLockCRUTest-1063854601-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6a7ad7-ad26-43ae-851e-f641097065a8 tempest-ResourceLockCRUTest-1063854601 tempest-ResourceLockCRUTest-1063854601-project-admin] PATH_INFO: `/v3/roles` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6a7ad7-ad26-43ae-851e-f641097065a8 tempest-ResourceLockCRUTest-1063854601 tempest-ResourceLockCRUTest-1063854601-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6a7ad7-ad26-43ae-851e-f641097065a8 tempest-ResourceLockCRUTest-1063854601 tempest-ResourceLockCRUTest-1063854601-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-ee505946-2571-4c5c-8e96-183061937039 tempest-SnapshotInstancesNegativeTest-1396485679 tempest-SnapshotInstancesNegativeTest-1396485679-project-admin] Could not find user: c2ac6ca3ea5a4ae498df6d12bb7caadc.: keystone.exception.UserNotFound: Could not find user: c2ac6ca3ea5a4ae498df6d12bb7caadc. May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: c2ac6ca3ea5a4ae498df6d12bb7caadc. May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1080/2135] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 12:58:01 2024] DELETE /identity/v3/users/c2ac6ca3ea5a4ae498df6d12bb7caadc => generated 110 bytes in 24 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee505946-2571-4c5c-8e96-183061937039 tempest-SnapshotInstancesNegativeTest-1396485679 tempest-SnapshotInstancesNegativeTest-1396485679-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1056/2136] 10.27.203.238 () {62 vars in 1210 bytes} [Tue May 28 12:58:01 2024] GET /identity/v3/roles => generated 1680 bytes in 16 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee505946-2571-4c5c-8e96-183061937039 tempest-SnapshotInstancesNegativeTest-1396485679 tempest-SnapshotInstancesNegativeTest-1396485679-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6a7ad7-ad26-43ae-851e-f641097065a8 tempest-ResourceLockCRUTest-1063854601 tempest-ResourceLockCRUTest-1063854601-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ae220e-9c32-4b74-87d1-7d149c2473ae tempest-SnapshotInstancesNegativeTest-1396485679 tempest-SnapshotInstancesNegativeTest-1396485679-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b4f232c985e4c7eafeef302f4eaa647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9cc76ecb4e343a6a51bf36da01debf8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ae220e-9c32-4b74-87d1-7d149c2473ae tempest-SnapshotInstancesNegativeTest-1396485679 tempest-SnapshotInstancesNegativeTest-1396485679-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ae220e-9c32-4b74-87d1-7d149c2473ae tempest-SnapshotInstancesNegativeTest-1396485679 tempest-SnapshotInstancesNegativeTest-1396485679-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ae220e-9c32-4b74-87d1-7d149c2473ae tempest-SnapshotInstancesNegativeTest-1396485679 tempest-SnapshotInstancesNegativeTest-1396485679-project-admin] PATH_INFO: `/v3/users/f89f851af36d480ab7d10d3506c60899` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6a7ad7-ad26-43ae-851e-f641097065a8 tempest-ResourceLockCRUTest-1063854601 tempest-ResourceLockCRUTest-1063854601-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ae220e-9c32-4b74-87d1-7d149c2473ae tempest-SnapshotInstancesNegativeTest-1396485679 tempest-SnapshotInstancesNegativeTest-1396485679-project-admin] RBAC: Authorizing `identity:delete_user(user_id=f89f851af36d480ab7d10d3506c60899)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ae220e-9c32-4b74-87d1-7d149c2473ae tempest-SnapshotInstancesNegativeTest-1396485679 tempest-SnapshotInstancesNegativeTest-1396485679-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb9e545-de95-4158-ba5f-9438850c29ea tempest-ResourceLockCRUTest-1063854601 tempest-ResourceLockCRUTest-1063854601-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cacdef9ca5d04afb85fa43f2d0e57632', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bcb84add5bc4d8cb675498201734b6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb9e545-de95-4158-ba5f-9438850c29ea tempest-ResourceLockCRUTest-1063854601 tempest-ResourceLockCRUTest-1063854601-project-admin] REQUEST_METHOD: `PUT` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb9e545-de95-4158-ba5f-9438850c29ea tempest-ResourceLockCRUTest-1063854601 tempest-ResourceLockCRUTest-1063854601-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb9e545-de95-4158-ba5f-9438850c29ea tempest-ResourceLockCRUTest-1063854601 tempest-ResourceLockCRUTest-1063854601-project-admin] PATH_INFO: `/v3/projects/6bcb84add5bc4d8cb675498201734b6d/users/91ab54ee09854b549923fb7671247f5c/roles/44620cad10ae407c90c91e2c296adb04` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:01 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c0075687-3b5e-4109-97fb-16dc52ac5085 tempest-ShareIpRulesForNFSTest-1748669711 None] <<< [PATCH] https://127.0.0.1:40443/api/viewpolicies/21/ May 28 12:58:01 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c0075687-3b5e-4109-97fb-16dc52ac5085 tempest-ShareIpRulesForNFSTest-1748669711 None] Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=1, created='2024-05-28T12:57:40.763635Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='377955ad-d094-4e49-ab32-1021d943a572', id=21, internal=False, is_s3_default_policy=False, name='b7a7d61c-2cea-442a-9809-507038e080d5', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=['*'], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['*'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['*'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='MODIFYING', sync_time='2024-05-28T12:58:00.914887Z', tenant_id=1, tenant_name='default', title='b7a7d61c-2cea-442a-9809-507038e080d5', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/21/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[]) May 28 12:58:01 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c0075687-3b5e-4109-97fb-16dc52ac5085 tempest-ShareIpRulesForNFSTest-1748669711 None] --- [PATCH] https://127.0.0.1:40443/api/viewpolicies/21/: Done May 28 12:58:01 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c0075687-3b5e-4109-97fb-16dc52ac5085 tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:01 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c0075687-3b5e-4109-97fb-16dc52ac5085 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:01 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-cde3eeea-113a-4231-aac9-4e347b0f402b tempest-AdminActionsTest-1749172189 None] <<< [POST] https://127.0.0.1:40443/api/snapshots/ May 28 12:58:01 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-cde3eeea-113a-4231-aac9-4e347b0f402b tempest-AdminActionsTest-1749172189 None] Bunch(access_path='/.vast_all_snapshots/1000000006_share-snapshot-5630474e-5783-4d8b-a724-cb878db3d827', aggr_phys_estimation=0, cluster='loop75-kfs', created='2024-05-28T12:57:59.013521Z', eta_sec=30819898916.579494, expiration_time='3001-01-19T07:59:58Z', guid='f989f84e-cec1-42ee-a812-f61a7952c729', id=7, indestructible=False, locked=False, name='share-snapshot-5630474e-5783-4d8b-a724-cb878db3d827', path='/manila/manila-77a25e6b-f137-4342-8eb9-9ced679515e2/', policy=None, policy_id=None, protection_policy_id=None, state='SUCCEED', tenant_id=1, tenant_name='default', title='share-snapshot-5630474e-5783-4d8b-a724-cb878db3d827(/manila/manila-77a25e6b-f137-4342-8eb9-9ced679515e2/)', type='local', unique_phys_estimation=0, url='https://127.0.0.1:40443/api/snapshots/7/') May 28 12:58:01 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-cde3eeea-113a-4231-aac9-4e347b0f402b tempest-AdminActionsTest-1749172189 None] --- [POST] https://127.0.0.1:40443/api/snapshots/: Done May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb9e545-de95-4158-ba5f-9438850c29ea tempest-ResourceLockCRUTest-1063854601 tempest-ResourceLockCRUTest-1063854601-project-admin] RBAC: Authorizing `identity:create_grant(project_id=6bcb84add5bc4d8cb675498201734b6d, user_id=91ab54ee09854b549923fb7671247f5c, role_id=44620cad10ae407c90c91e2c296adb04)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb9e545-de95-4158-ba5f-9438850c29ea tempest-ResourceLockCRUTest-1063854601 tempest-ResourceLockCRUTest-1063854601-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1057/2137] 10.27.203.238 () {64 vars in 1571 bytes} [Tue May 28 12:58:01 2024] PUT /identity/v3/projects/6bcb84add5bc4d8cb675498201734b6d/users/91ab54ee09854b549923fb7671247f5c/roles/44620cad10ae407c90c91e2c296adb04 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb9e545-de95-4158-ba5f-9438850c29ea tempest-ResourceLockCRUTest-1063854601 tempest-ResourceLockCRUTest-1063854601-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-bfb9e545-de95-4158-ba5f-9438850c29ea tempest-ResourceLockCRUTest-1063854601 tempest-ResourceLockCRUTest-1063854601-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-b7ae220e-9c32-4b74-87d1-7d149c2473ae tempest-SnapshotInstancesNegativeTest-1396485679 tempest-SnapshotInstancesNegativeTest-1396485679-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f89f851af36d480ab7d10d3506c60899', 'request_id': 'req-b7ae220e-9c32-4b74-87d1-7d149c2473ae'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-b7ae220e-9c32-4b74-87d1-7d149c2473ae tempest-SnapshotInstancesNegativeTest-1396485679 tempest-SnapshotInstancesNegativeTest-1396485679-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f89f851af36d480ab7d10d3506c60899', 'request_id': 'req-b7ae220e-9c32-4b74-87d1-7d149c2473ae'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-b7ae220e-9c32-4b74-87d1-7d149c2473ae tempest-SnapshotInstancesNegativeTest-1396485679 tempest-SnapshotInstancesNegativeTest-1396485679-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f89f851af36d480ab7d10d3506c60899', 'request_id': 'req-b7ae220e-9c32-4b74-87d1-7d149c2473ae'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-b7ae220e-9c32-4b74-87d1-7d149c2473ae tempest-SnapshotInstancesNegativeTest-1396485679 tempest-SnapshotInstancesNegativeTest-1396485679-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f89f851af36d480ab7d10d3506c60899', 'request_id': 'req-b7ae220e-9c32-4b74-87d1-7d149c2473ae'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-b7ae220e-9c32-4b74-87d1-7d149c2473ae tempest-SnapshotInstancesNegativeTest-1396485679 tempest-SnapshotInstancesNegativeTest-1396485679-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f89f851af36d480ab7d10d3506c60899', 'request_id': 'req-b7ae220e-9c32-4b74-87d1-7d149c2473ae'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1081/2138] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 12:58:01 2024] DELETE /identity/v3/users/f89f851af36d480ab7d10d3506c60899 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb9e545-de95-4158-ba5f-9438850c29ea tempest-ResourceLockCRUTest-1063854601 tempest-ResourceLockCRUTest-1063854601-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:01 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-fbe18e3f-a7ea-40d8-a8e4-86384913070d tempest-SnapshotInstancesNegativeTest-1396485679 tempest-SnapshotInstancesNegativeTest-1396485679-project-admin] DELETE http://10.27.203.238/share/v2/c9cc76ecb4e343a6a51bf36da01debf8/snapshots/0d2e6969-2d63-4c8c-bd0a-ae6e8ca0314c May 28 12:58:01 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-fbe18e3f-a7ea-40d8-a8e4-86384913070d tempest-SnapshotInstancesNegativeTest-1396485679 tempest-SnapshotInstancesNegativeTest-1396485679-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:01 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-fbe18e3f-a7ea-40d8-a8e4-86384913070d tempest-SnapshotInstancesNegativeTest-1396485679 tempest-SnapshotInstancesNegativeTest-1396485679-project-admin] Calling method 'ShareSnapshotMixin.delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:01 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.v1.share_snapshots [None req-fbe18e3f-a7ea-40d8-a8e4-86384913070d tempest-SnapshotInstancesNegativeTest-1396485679 tempest-SnapshotInstancesNegativeTest-1396485679-project-admin] Delete snapshot with id: 0d2e6969-2d63-4c8c-bd0a-ae6e8ca0314c May 28 12:58:01 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c0075687-3b5e-4109-97fb-16dc52ac5085 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.074s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:01 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c0075687-3b5e-4109-97fb-16dc52ac5085 tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:01 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c0075687-3b5e-4109-97fb-16dc52ac5085 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:01 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c0075687-3b5e-4109-97fb-16dc52ac5085 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:01 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c0075687-3b5e-4109-97fb-16dc52ac5085 tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:01 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c0075687-3b5e-4109-97fb-16dc52ac5085 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:01 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c0075687-3b5e-4109-97fb-16dc52ac5085 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:01 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c0075687-3b5e-4109-97fb-16dc52ac5085 tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:01 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c0075687-3b5e-4109-97fb-16dc52ac5085 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:01 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c0075687-3b5e-4109-97fb-16dc52ac5085 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:01 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c0075687-3b5e-4109-97fb-16dc52ac5085 tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:01 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c0075687-3b5e-4109-97fb-16dc52ac5085 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa1294d-e32b-4e8f-a39e-a4f7fd4eb1e3 service manila] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f110cf6300f049c897d0aab63218d1e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa1294d-e32b-4e8f-a39e-a4f7fd4eb1e3 service manila] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa1294d-e32b-4e8f-a39e-a4f7fd4eb1e3 service manila] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa1294d-e32b-4e8f-a39e-a4f7fd4eb1e3 service manila] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-eaa1294d-e32b-4e8f-a39e-a4f7fd4eb1e3 service manila] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:58:01 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c0075687-3b5e-4109-97fb-16dc52ac5085 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.035s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:01 l75lg1-v1 manila-share[98474]: INFO manila.share.access [None req-c0075687-3b5e-4109-97fb-16dc52ac5085 tempest-ShareIpRulesForNFSTest-1748669711 None] Access rules were successfully modified for share instance b7a7d61c-2cea-442a-9809-507038e080d5 belonging to share 1ddadc17-cf10-4a42-8bbd-8335fb3520a1. May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa1294d-e32b-4e8f-a39e-a4f7fd4eb1e3 service manila] RBAC: Authorizing `identity:validate_token()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa1294d-e32b-4e8f-a39e-a4f7fd4eb1e3 service manila] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1058/2139] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 12:58:01 2024] GET /identity/v3/auth/tokens => generated 4071 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 12:58:01 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-fbe18e3f-a7ea-40d8-a8e4-86384913070d tempest-SnapshotInstancesNegativeTest-1396485679 tempest-SnapshotInstancesNegativeTest-1396485679-project-admin] http://10.27.203.238/share/v2/c9cc76ecb4e343a6a51bf36da01debf8/snapshots/0d2e6969-2d63-4c8c-bd0a-ae6e8ca0314c returned with HTTP 202 May 28 12:58:01 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 453/914] 10.27.203.238 () {64 vars in 1463 bytes} [Tue May 28 12:58:01 2024] DELETE /share/v2/c9cc76ecb4e343a6a51bf36da01debf8/snapshots/0d2e6969-2d63-4c8c-bd0a-ae6e8ca0314c => generated 0 bytes in 93 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:58:01 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-25bf7f0f-b54b-4b75-a042-35a7eba7b841 tempest-ResourceLockCRUTest-1063854601 tempest-ResourceLockCRUTest-1063854601-project-admin] POST http://10.27.203.238/share/v2/6bcb84add5bc4d8cb675498201734b6d/types May 28 12:58:01 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-25bf7f0f-b54b-4b75-a042-35a7eba7b841 tempest-ResourceLockCRUTest-1063854601 tempest-ResourceLockCRUTest-1063854601-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share_type": {"name": "tempest-typeshare-type-1749463297", "extra_specs": {"driver_handles_share_servers": "False"}, "share_type_access:is_public": true}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:58:01 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-f5108609-f6e3-4bb9-871c-07a891df0923 tempest-SnapshotInstancesNegativeTest-1396485679 tempest-SnapshotInstancesNegativeTest-1396485679-project-admin] GET http://10.27.203.238/share/v2/c9cc76ecb4e343a6a51bf36da01debf8/snapshots/0d2e6969-2d63-4c8c-bd0a-ae6e8ca0314c May 28 12:58:01 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-f5108609-f6e3-4bb9-871c-07a891df0923 tempest-SnapshotInstancesNegativeTest-1396485679 tempest-SnapshotInstancesNegativeTest-1396485679-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:01 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-f5108609-f6e3-4bb9-871c-07a891df0923 tempest-SnapshotInstancesNegativeTest-1396485679 tempest-SnapshotInstancesNegativeTest-1396485679-project-admin] Calling method 'ShareSnapshotMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:01 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-25bf7f0f-b54b-4b75-a042-35a7eba7b841 tempest-ResourceLockCRUTest-1063854601 tempest-ResourceLockCRUTest-1063854601-project-admin] http://10.27.203.238/share/v2/6bcb84add5bc4d8cb675498201734b6d/types returned with HTTP 200 May 28 12:58:01 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 462/915] 10.27.203.238 () {66 vars in 1359 bytes} [Tue May 28 12:58:01 2024] POST /share/v2/6bcb84add5bc4d8cb675498201734b6d/types => generated 623 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ae220e-9c32-4b74-87d1-7d149c2473ae tempest-SnapshotInstancesNegativeTest-1396485679 tempest-SnapshotInstancesNegativeTest-1396485679-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-b7ae220e-9c32-4b74-87d1-7d149c2473ae tempest-SnapshotInstancesNegativeTest-1396485679 tempest-SnapshotInstancesNegativeTest-1396485679-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ae220e-9c32-4b74-87d1-7d149c2473ae tempest-SnapshotInstancesNegativeTest-1396485679 tempest-SnapshotInstancesNegativeTest-1396485679-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10a5eae-4f77-4354-98b2-274ec7cd91fc service manila] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f110cf6300f049c897d0aab63218d1e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10a5eae-4f77-4354-98b2-274ec7cd91fc service manila] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10a5eae-4f77-4354-98b2-274ec7cd91fc service manila] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10a5eae-4f77-4354-98b2-274ec7cd91fc service manila] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-d10a5eae-4f77-4354-98b2-274ec7cd91fc service manila] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:58:01 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-f5108609-f6e3-4bb9-871c-07a891df0923 tempest-SnapshotInstancesNegativeTest-1396485679 tempest-SnapshotInstancesNegativeTest-1396485679-project-admin] http://10.27.203.238/share/v2/c9cc76ecb4e343a6a51bf36da01debf8/snapshots/0d2e6969-2d63-4c8c-bd0a-ae6e8ca0314c returned with HTTP 200 May 28 12:58:01 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 454/916] 10.27.203.238 () {64 vars in 1460 bytes} [Tue May 28 12:58:01 2024] GET /share/v2/c9cc76ecb4e343a6a51bf36da01debf8/snapshots/0d2e6969-2d63-4c8c-bd0a-ae6e8ca0314c => generated 749 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:58:01 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-fbe18e3f-a7ea-40d8-a8e4-86384913070d tempest-SnapshotInstancesNegativeTest-1396485679 None] >>> [GET] https://127.0.0.1:40443/api/snapshots/ May 28 12:58:01 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-fbe18e3f-a7ea-40d8-a8e4-86384913070d tempest-SnapshotInstancesNegativeTest-1396485679 None] {'allow_redirects': True, May 28 12:58:01 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-fbe18e3f-a7ea-40d8-a8e4-86384913070d tempest-SnapshotInstancesNegativeTest-1396485679 None] 'params': {'name': 'share-snapshot-d9f25a4b-5def-4427-b890-289ce9aabe70'}} May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10a5eae-4f77-4354-98b2-274ec7cd91fc service manila] RBAC: Authorizing `identity:validate_token()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10a5eae-4f77-4354-98b2-274ec7cd91fc service manila] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:01 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1082/2140] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 12:58:01 2024] GET /identity/v3/auth/tokens => generated 3948 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 12:58:01 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-1329f217-bf7f-4692-b354-ac9b72606999 tempest-ResourceLockCRUTest-1971036144 tempest-ResourceLockCRUTest-1971036144-project-member] POST http://10.27.203.238/share/v2/82840ccb77144a4aa2d0bdce807ce686/shares May 28 12:58:01 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-1329f217-bf7f-4692-b354-ac9b72606999 tempest-ResourceLockCRUTest-1971036144 tempest-ResourceLockCRUTest-1971036144-project-member] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share": {"share_proto": "nfs", "description": "Tempest's share", "snapshot_id": null, "name": "tempest-tempest-created-share-2082239177", "size": 1, "metadata": {}, "is_public": false, "share_type": "2995b9a5-154c-4e23-8364-c4a157a7537f"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:58:01 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.v1.shares [None req-1329f217-bf7f-4692-b354-ac9b72606999 tempest-ResourceLockCRUTest-1971036144 tempest-ResourceLockCRUTest-1971036144-project-member] Create NFS share of 1 GB May 28 12:58:01 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.quota [None req-1329f217-bf7f-4692-b354-ac9b72606999 tempest-ResourceLockCRUTest-1971036144 tempest-ResourceLockCRUTest-1971036144-project-member] Created reservations ['10291342-7189-4116-8765-b43fb2b3a5c4', '9610f765-79af-4ca9-9707-194532f5b232', '810f2b3e-0099-4c5e-bbdf-51de0f6ff216', 'f1276afe-3b04-485a-a8d1-848414ef8eca'] {{(pid=98329) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 12:58:01 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2a531a29-2cd9-4e97-9af6-1ed124146a5b tempest-SharesMetadataTest-1561320255 None] <<< [POST] https://127.0.0.1:40443/api/quotas/ May 28 12:58:01 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2a531a29-2cd9-4e97-9af6-1ed124146a5b tempest-SharesMetadataTest-1561320255 None] Bunch(cluster='loop75-kfs', cluster_id=1, default_email=None, default_group_quota=None, default_user_quota=None, enable_alarms=True, enable_email_providers=True, grace_period=None, group_quotas=[], guid='91e33e64-2bcd-4f77-9728-391c484342e0', hard_limit=1073741824, hard_limit_inodes=None, id=22, internal=False, is_user_quota=False, last_user_quotas_update=None, name='205d35a8-15b8-4a2f-8214-8c2d1a5de6b0', num_blocked_users=0, num_exceeded_users=0, path='/manila/manila-205d35a8-15b8-4a2f-8214-8c2d1a5de6b0', percent_capacity=0, percent_inodes=None, pretty_grace_period=None, pretty_grace_period_expiration=None, pretty_state='OK (CREATED)', soft_limit=None, soft_limit_inodes=None, state='OK', sync_state='CREATED', system_id=22, tenant_id=1, tenant_name='default', time_to_block=None, title='205d35a8-15b8-4a2f-8214-8c2d1a5de6b0', url='https://127.0.0.1:40443/api/quotas/22/', used_capacity=0, used_capacity_tb=0.0, used_effective_capacity=0, used_effective_capacity_tb=0.0, used_inodes=0, used_limited_capacity=0, user_quotas=[]) May 28 12:58:01 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2a531a29-2cd9-4e97-9af6-1ed124146a5b tempest-SharesMetadataTest-1561320255 None] --- [POST] https://127.0.0.1:40443/api/quotas/: Done May 28 12:58:01 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2a531a29-2cd9-4e97-9af6-1ed124146a5b tempest-SharesMetadataTest-1561320255 None] >>> [GET] https://127.0.0.1:40443/api/views/ May 28 12:58:01 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2a531a29-2cd9-4e97-9af6-1ed124146a5b tempest-SharesMetadataTest-1561320255 None] {'allow_redirects': True, May 28 12:58:01 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2a531a29-2cd9-4e97-9af6-1ed124146a5b tempest-SharesMetadataTest-1561320255 None] 'params': {'name': '205d35a8-15b8-4a2f-8214-8c2d1a5de6b0'}} May 28 12:58:01 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.quota [None req-1329f217-bf7f-4692-b354-ac9b72606999 tempest-ResourceLockCRUTest-1971036144 tempest-ResourceLockCRUTest-1971036144-project-member] Committed reservations ['10291342-7189-4116-8765-b43fb2b3a5c4', '9610f765-79af-4ca9-9707-194532f5b232', '810f2b3e-0099-4c5e-bbdf-51de0f6ff216', 'f1276afe-3b04-485a-a8d1-848414ef8eca'] {{(pid=98329) commit /opt/stack/manila/manila/quota.py:1063}} May 28 12:58:01 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.host_manager [None req-1329f217-bf7f-4692-b354-ac9b72606999 tempest-ResourceLockCRUTest-1971036144 None] Share service is down. (host: l75lg1-v1@generic2). May 28 12:58:01 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.host_manager [None req-1329f217-bf7f-4692-b354-ac9b72606999 tempest-ResourceLockCRUTest-1971036144 None] Share service is down. (host: l75lg1-v1@generic1). May 28 12:58:01 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-1329f217-bf7f-4692-b354-ac9b72606999 tempest-ResourceLockCRUTest-1971036144 None] Starting with 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:80}} May 28 12:58:01 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-1329f217-bf7f-4692-b354-ac9b72606999 tempest-ResourceLockCRUTest-1971036144 None] Filter OnlyHostFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:58:01 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-1329f217-bf7f-4692-b354-ac9b72606999 tempest-ResourceLockCRUTest-1971036144 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:58:01 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.capacity [None req-1329f217-bf7f-4692-b354-ac9b72606999 tempest-ResourceLockCRUTest-1971036144 None] Space information for share creation on host l75lg1-v1@vast#vast (requested / avail): 1/2080 {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/capacity.py:83}} May 28 12:58:01 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-1329f217-bf7f-4692-b354-ac9b72606999 tempest-ResourceLockCRUTest-1971036144 None] Filter CapacityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:58:01 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-1329f217-bf7f-4692-b354-ac9b72606999 tempest-ResourceLockCRUTest-1971036144 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:58:01 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-1329f217-bf7f-4692-b354-ac9b72606999 tempest-ResourceLockCRUTest-1971036144 None] Driver Filter: Checking host 'l75lg1-v1@vast#vast' {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:37}} May 28 12:58:01 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-1329f217-bf7f-4692-b354-ac9b72606999 tempest-ResourceLockCRUTest-1971036144 None] Filter function not set :: passing host. {{(pid=98327) _check_filter_function /opt/stack/manila/manila/scheduler/filters/driver.py:53}} May 28 12:58:01 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-1329f217-bf7f-4692-b354-ac9b72606999 tempest-ResourceLockCRUTest-1971036144 None] Result: True {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:40}} May 28 12:58:01 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-1329f217-bf7f-4692-b354-ac9b72606999 tempest-ResourceLockCRUTest-1971036144 None] Done checking host 'l75lg1-v1@vast#vast' {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:41}} May 28 12:58:01 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-1329f217-bf7f-4692-b354-ac9b72606999 tempest-ResourceLockCRUTest-1971036144 None] Filter DriverFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:58:01 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-1329f217-bf7f-4692-b354-ac9b72606999 tempest-ResourceLockCRUTest-1971036144 None] Filter ShareReplicationFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:58:01 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-1329f217-bf7f-4692-b354-ac9b72606999 tempest-ResourceLockCRUTest-1971036144 None] Filter CreateFromSnapshotFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:58:01 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-1329f217-bf7f-4692-b354-ac9b72606999 tempest-ResourceLockCRUTest-1971036144 None] Filter AffinityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:58:01 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-1329f217-bf7f-4692-b354-ac9b72606999 tempest-ResourceLockCRUTest-1971036144 None] Filter AntiAffinityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:58:01 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.drivers.filter [None req-1329f217-bf7f-4692-b354-ac9b72606999 tempest-ResourceLockCRUTest-1971036144 None] Filtered share [host: 'l75lg1-v1@vast#vast', free_capacity_gb: 2080.6229242384434, pools: None] {{(pid=98327) _schedule_share /opt/stack/manila/manila/scheduler/drivers/filter.py:268}} May 28 12:58:01 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-1329f217-bf7f-4692-b354-ac9b72606999 tempest-ResourceLockCRUTest-1971036144 None] Checking host 'l75lg1-v1@vast#vast' {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:46}} May 28 12:58:01 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.weighers.goodness [None req-1329f217-bf7f-4692-b354-ac9b72606999 tempest-ResourceLockCRUTest-1971036144 None] Goodness function not set :: defaulting to minimal goodness rating of 0. May 28 12:58:01 l75lg1-v1 manila-scheduler[98327]: INFO manila.scheduler.weighers.goodness [None req-1329f217-bf7f-4692-b354-ac9b72606999 tempest-ResourceLockCRUTest-1971036144 None] Goodness function result for host l75lg1-v1@vast#vast: 0. May 28 12:58:01 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-1329f217-bf7f-4692-b354-ac9b72606999 tempest-ResourceLockCRUTest-1971036144 None] Goodness: 0 {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:48}} May 28 12:58:01 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-1329f217-bf7f-4692-b354-ac9b72606999 tempest-ResourceLockCRUTest-1971036144 None] Done checking host 'l75lg1-v1@vast#vast' {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:49}} May 28 12:58:01 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.drivers.filter [None req-1329f217-bf7f-4692-b354-ac9b72606999 tempest-ResourceLockCRUTest-1971036144 None] Choosing for share: WeighedHost [host: l75lg1-v1@vast#vast, weight: 0.0] {{(pid=98327) _schedule_share /opt/stack/manila/manila/scheduler/drivers/filter.py:274}} May 28 12:58:01 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-1329f217-bf7f-4692-b354-ac9b72606999 tempest-ResourceLockCRUTest-1971036144 tempest-ResourceLockCRUTest-1971036144-project-member] http://10.27.203.238/share/v2/82840ccb77144a4aa2d0bdce807ce686/shares returned with HTTP 200 May 28 12:58:01 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 463/917] 10.27.203.238 () {66 vars in 1362 bytes} [Tue May 28 12:58:01 2024] POST /share/v2/82840ccb77144a4aa2d0bdce807ce686/shares => generated 1314 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:58:01 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-21863d9b-d3bc-4f3b-a1a5-ef4e1cdd831f tempest-ResourceLockCRUTest-1971036144 tempest-ResourceLockCRUTest-1971036144-project-member] GET http://10.27.203.238/share/v2/82840ccb77144a4aa2d0bdce807ce686/shares/071c2e61-b4b6-48bf-a1f2-c20b233560ed May 28 12:58:01 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-21863d9b-d3bc-4f3b-a1a5-ef4e1cdd831f tempest-ResourceLockCRUTest-1971036144 tempest-ResourceLockCRUTest-1971036144-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:01 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-21863d9b-d3bc-4f3b-a1a5-ef4e1cdd831f tempest-ResourceLockCRUTest-1971036144 tempest-ResourceLockCRUTest-1971036144-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:01 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-3d44f393-a4c1-4b85-bbf5-18a35088968e tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] POST http://10.27.203.238/share/v2/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action May 28 12:58:01 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-3d44f393-a4c1-4b85-bbf5-18a35088968e tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Action body: b'{"access_list": null}' {{(pid=98329) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:58:01 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-3d44f393-a4c1-4b85-bbf5-18a35088968e tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Action: 'action', calling method: Controller.__getattribute__..version_select, body: {"access_list": null} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:58:01 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-21863d9b-d3bc-4f3b-a1a5-ef4e1cdd831f tempest-ResourceLockCRUTest-1971036144 tempest-ResourceLockCRUTest-1971036144-project-member] http://10.27.203.238/share/v2/82840ccb77144a4aa2d0bdce807ce686/shares/071c2e61-b4b6-48bf-a1f2-c20b233560ed returned with HTTP 200 May 28 12:58:01 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 455/918] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:58:01 2024] GET /share/v2/82840ccb77144a4aa2d0bdce807ce686/shares/071c2e61-b4b6-48bf-a1f2-c20b233560ed => generated 1314 bytes in 25 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:58:01 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-3d44f393-a4c1-4b85-bbf5-18a35088968e tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] http://10.27.203.238/share/v2/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action returned with HTTP 200 May 28 12:58:01 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 464/919] 10.27.203.238 () {66 vars in 1493 bytes} [Tue May 28 12:58:01 2024] POST /share/v2/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action => generated 267 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:58:01 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-eb13e1d9-dd47-4b34-96f7-7b70918603bc tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] POST http://10.27.203.238/share/v2/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action May 28 12:58:01 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-eb13e1d9-dd47-4b34-96f7-7b70918603bc tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Action body: b'{"deny_access": {"access_id": "b2185210-2dd1-4b1c-af23-e580dbc41fa8"}}' {{(pid=98330) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:58:01 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-eb13e1d9-dd47-4b34-96f7-7b70918603bc tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Action: 'action', calling method: ShareController.deny_access, body: {"deny_access": {"access_id": "b2185210-2dd1-4b1c-af23-e580dbc41fa8"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:58:01 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.lock.api [None req-eb13e1d9-dd47-4b34-96f7-7b70918603bc tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Searching for locks by: {'resource_id': 'b2185210-2dd1-4b1c-af23-e580dbc41fa8', 'resource_action': 'delete'} {{(pid=98330) get_all /opt/stack/manila/manila/lock/api.py:112}} May 28 12:58:01 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-ac173b87-50da-4e9d-9651-13aa3e360ab8 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] GET http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/c485966a-3cd7-4de5-903f-4b379a6cb450 May 28 12:58:01 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-ac173b87-50da-4e9d-9651-13aa3e360ab8 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:01 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-ac173b87-50da-4e9d-9651-13aa3e360ab8 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:01 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-ac173b87-50da-4e9d-9651-13aa3e360ab8 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/c485966a-3cd7-4de5-903f-4b379a6cb450 returned with HTTP 200 May 28 12:58:01 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 465/920] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:58:01 2024] GET /share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/c485966a-3cd7-4de5-903f-4b379a6cb450 => generated 1347 bytes in 25 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:58:01 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1329f217-bf7f-4692-b354-ac9b72606999 tempest-ResourceLockCRUTest-1971036144 None] >>> [GET] https://127.0.0.1:40443/api/vippools/ May 28 12:58:01 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1329f217-bf7f-4692-b354-ac9b72606999 tempest-ResourceLockCRUTest-1971036144 None] {'allow_redirects': True, 'params': {'name': 'vippool-1'}} May 28 12:58:01 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-fbe18e3f-a7ea-40d8-a8e4-86384913070d tempest-SnapshotInstancesNegativeTest-1396485679 None] <<< [GET] https://127.0.0.1:40443/api/snapshots/ May 28 12:58:01 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-fbe18e3f-a7ea-40d8-a8e4-86384913070d tempest-SnapshotInstancesNegativeTest-1396485679 None] [Bunch(access_path='/.vast_all_snapshots/1000000005_share-snapshot-d9f25a4b-5def-4427-b890-289ce9aabe70', aggr_phys_estimation=0, cluster='loop75-kfs', created='2024-05-28T12:57:55.326951Z', eta_sec=30819898916.031788, expiration_time='3001-01-19T07:59:58Z', guid='45421c99-9096-4569-b40c-6a6e58867415', id=6, indestructible=False, locked=False, name='share-snapshot-d9f25a4b-5def-4427-b890-289ce9aabe70', path='/manila/manila-8239ccb8-483c-4129-8319-880234387fbd/', policy=None, policy_id=None, protection_policy_id=None, state='SUCCEED', tenant_id=1, tenant_name='default', title='share-snapshot-d9f25a4b-5def-4427-b890-289ce9aabe70(/manila/manila-8239ccb8-483c-4129-8319-880234387fbd/)', type='local', unique_phys_estimation=0, url='https://127.0.0.1:40443/api/snapshots/6/')] May 28 12:58:01 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-fbe18e3f-a7ea-40d8-a8e4-86384913070d tempest-SnapshotInstancesNegativeTest-1396485679 None] --- [GET] https://127.0.0.1:40443/api/snapshots/: Done May 28 12:58:01 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-fbe18e3f-a7ea-40d8-a8e4-86384913070d tempest-SnapshotInstancesNegativeTest-1396485679 None] >>> [DELETE] https://127.0.0.1:40443/api/snapshots/6/ May 28 12:58:02 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-eb13e1d9-dd47-4b34-96f7-7b70918603bc tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:02 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-eb13e1d9-dd47-4b34-96f7-7b70918603bc tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:02 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-eb13e1d9-dd47-4b34-96f7-7b70918603bc tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.043s {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:02 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-eb13e1d9-dd47-4b34-96f7-7b70918603bc tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:02 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-eb13e1d9-dd47-4b34-96f7-7b70918603bc tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:02 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-eb13e1d9-dd47-4b34-96f7-7b70918603bc tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.056s {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:02 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-eb13e1d9-dd47-4b34-96f7-7b70918603bc tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] http://10.27.203.238/share/v2/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action returned with HTTP 202 May 28 12:58:02 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 456/921] 10.27.203.238 () {66 vars in 1493 bytes} [Tue May 28 12:58:01 2024] POST /share/v2/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action => generated 0 bytes in 175 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:58:02 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-8a552e89-3010-41a4-afa9-fded736179b5 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] GET http://10.27.203.238/share/v2/776f75906bc64f8f9316d5aab4b50bf1/share-access-rules?share_id=1ddadc17-cf10-4a42-8bbd-8335fb3520a1 May 28 12:58:02 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-8a552e89-3010-41a4-afa9-fded736179b5 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:02 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-8a552e89-3010-41a4-afa9-fded736179b5 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:02 l75lg1-v1 manila-share[98474]: DEBUG manila.share.manager [None req-eb13e1d9-dd47-4b34-96f7-7b70918603bc tempest-ShareIpRulesForNFSTest-1748669711 None] Received request to update access for share instance b7a7d61c-2cea-442a-9809-507038e080d5. {{(pid=98474) update_access_for_instances /opt/stack/manila/manila/share/manager.py:4353}} May 28 12:58:02 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.lock.api [None req-8a552e89-3010-41a4-afa9-fded736179b5 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Searching for locks by: {'resource_id': 'b2185210-2dd1-4b1c-af23-e580dbc41fa8', 'resource_action': 'show', 'resource_type': 'access_rule'} {{(pid=98329) get_all /opt/stack/manila/manila/lock/api.py:112}} May 28 12:58:02 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2a531a29-2cd9-4e97-9af6-1ed124146a5b tempest-SharesMetadataTest-1561320255 None] <<< [GET] https://127.0.0.1:40443/api/views/ May 28 12:58:02 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-8a552e89-3010-41a4-afa9-fded736179b5 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] http://10.27.203.238/share/v2/776f75906bc64f8f9316d5aab4b50bf1/share-access-rules?share_id=1ddadc17-cf10-4a42-8bbd-8335fb3520a1 returned with HTTP 200 May 28 12:58:02 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2a531a29-2cd9-4e97-9af6-1ed124146a5b tempest-SharesMetadataTest-1561320255 None] [] May 28 12:58:02 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2a531a29-2cd9-4e97-9af6-1ed124146a5b tempest-SharesMetadataTest-1561320255 None] --- [GET] https://127.0.0.1:40443/api/views/: Done May 28 12:58:02 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2a531a29-2cd9-4e97-9af6-1ed124146a5b tempest-SharesMetadataTest-1561320255 None] >>> [POST] https://127.0.0.1:40443/api/views/ May 28 12:58:02 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 466/922] 10.27.203.238 () {64 vars in 1467 bytes} [Tue May 28 12:58:02 2024] GET /share/v2/776f75906bc64f8f9316d5aab4b50bf1/share-access-rules?share_id=1ddadc17-cf10-4a42-8bbd-8335fb3520a1 => generated 291 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:58:02 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2a531a29-2cd9-4e97-9af6-1ed124146a5b tempest-SharesMetadataTest-1561320255 None] {'data': '{"name": "205d35a8-15b8-4a2f-8214-8c2d1a5de6b0", "path": ' May 28 12:58:02 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2a531a29-2cd9-4e97-9af6-1ed124146a5b tempest-SharesMetadataTest-1561320255 None] '"/manila/manila-205d35a8-15b8-4a2f-8214-8c2d1a5de6b0", "policy_id": ' May 28 12:58:02 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2a531a29-2cd9-4e97-9af6-1ed124146a5b tempest-SharesMetadataTest-1561320255 None] '25, "create_dir": true, "protocols": ["NFS"]}', May 28 12:58:02 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2a531a29-2cd9-4e97-9af6-1ed124146a5b tempest-SharesMetadataTest-1561320255 None] 'json': None, May 28 12:58:02 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2a531a29-2cd9-4e97-9af6-1ed124146a5b tempest-SharesMetadataTest-1561320255 None] 'params': None} May 28 12:58:02 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-eb13e1d9-dd47-4b34-96f7-7b70918603bc tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:02 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-eb13e1d9-dd47-4b34-96f7-7b70918603bc tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:02 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-eb13e1d9-dd47-4b34-96f7-7b70918603bc tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:02 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-eb13e1d9-dd47-4b34-96f7-7b70918603bc tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:02 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-eb13e1d9-dd47-4b34-96f7-7b70918603bc tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:02 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-eb13e1d9-dd47-4b34-96f7-7b70918603bc tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.055s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:02 l75lg1-v1 manila-share[98474]: DEBUG manila.share.access [None req-eb13e1d9-dd47-4b34-96f7-7b70918603bc tempest-ShareIpRulesForNFSTest-1748669711 None] Updating access rules for share instance b7a7d61c-2cea-442a-9809-507038e080d5 belonging to share 1ddadc17-cf10-4a42-8bbd-8335fb3520a1. {{(pid=98474) update_access_rules /opt/stack/manila/manila/share/access.py:298}} May 28 12:58:02 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-eb13e1d9-dd47-4b34-96f7-7b70918603bc tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:02 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-eb13e1d9-dd47-4b34-96f7-7b70918603bc tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:02 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-eb13e1d9-dd47-4b34-96f7-7b70918603bc tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.007s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:02 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-eb13e1d9-dd47-4b34-96f7-7b70918603bc tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:02 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-eb13e1d9-dd47-4b34-96f7-7b70918603bc tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:02 l75lg1-v1 dstat.sh[49771]: 28-05 12:58:02| 18 2 77 3 0|5708M 1779M 277M 7861M| 28k 3907B| 0 2609k| 0 379 |9222 17k|1.50 1.09 1.02|1.0 1.0 0| 0 0 | 0 2048M| 29 357 0 62 0 May 28 12:58:02 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-eb13e1d9-dd47-4b34-96f7-7b70918603bc tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.014s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:02 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-eb13e1d9-dd47-4b34-96f7-7b70918603bc tempest-ShareIpRulesForNFSTest-1748669711 None] changing access on None May 28 12:58:02 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-eb13e1d9-dd47-4b34-96f7-7b70918603bc tempest-ShareIpRulesForNFSTest-1748669711 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:58:02 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-eb13e1d9-dd47-4b34-96f7-7b70918603bc tempest-ShareIpRulesForNFSTest-1748669711 None] {'allow_redirects': True, May 28 12:58:02 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-eb13e1d9-dd47-4b34-96f7-7b70918603bc tempest-ShareIpRulesForNFSTest-1748669711 None] 'params': {'name': 'b7a7d61c-2cea-442a-9809-507038e080d5'}} May 28 12:58:02 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1329f217-bf7f-4692-b354-ac9b72606999 tempest-ResourceLockCRUTest-1971036144 None] <<< [GET] https://127.0.0.1:40443/api/vippools/ May 28 12:58:02 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1329f217-bf7f-4692-b354-ac9b72606999 tempest-ResourceLockCRUTest-1971036144 None] [Bunch(active_cnode_ids=[], active_interfaces=4, cluster='loop75-kfs', cluster_id=1, cnode_ids=[], cnodes=[], domain_name='vippool-1', enable_l3=False, enable_weighted_balancing=False, enabled=True, end_ip='172.21.75.4', guid='f2abaede-b397-413a-8faa-3aeead6d3b28', gw_ip='', gw_ipv6='', id=2, ip_ranges=[['172.21.75.1', '172.21.75.4']], name='vippool-1', peer_asn=0, port_membership='ALL', ranges_summary='172.21.75.[1-4]', role='PROTOCOLS', start_ip='172.21.75.1', subnet_cidr=16, subnet_cidr_ipv6=None, sync='SYNCED', sync_time='2024-05-28T12:50:09.644123Z', tenant_id=1, tenant_name='default', title='172.21.75.1 - 172.21.75.4', url='https://127.0.0.1:40443/api/vippools/2/', vast_asn=0, vlan=0, vms_preferred=False)] May 28 12:58:02 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1329f217-bf7f-4692-b354-ac9b72606999 tempest-ResourceLockCRUTest-1971036144 None] --- [GET] https://127.0.0.1:40443/api/vippools/: Done May 28 12:58:02 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1329f217-bf7f-4692-b354-ac9b72606999 tempest-ResourceLockCRUTest-1971036144 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:58:02 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1329f217-bf7f-4692-b354-ac9b72606999 tempest-ResourceLockCRUTest-1971036144 None] {'allow_redirects': True, May 28 12:58:02 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1329f217-bf7f-4692-b354-ac9b72606999 tempest-ResourceLockCRUTest-1971036144 None] 'params': {'name': '5de0f734-b2f4-4d05-8249-81f9d2973a8a'}} May 28 12:58:02 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-eb13e1d9-dd47-4b34-96f7-7b70918603bc tempest-ShareIpRulesForNFSTest-1748669711 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:58:02 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-eb13e1d9-dd47-4b34-96f7-7b70918603bc tempest-ShareIpRulesForNFSTest-1748669711 None] [Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=1, created='2024-05-28T12:57:40.763635Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='377955ad-d094-4e49-ab32-1021d943a572', id=21, internal=False, is_s3_default_policy=False, name='b7a7d61c-2cea-442a-9809-507038e080d5', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=['*'], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['*'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['*'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T12:58:01.329720Z', tenant_id=1, tenant_name='default', title='b7a7d61c-2cea-442a-9809-507038e080d5', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/21/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[])] May 28 12:58:02 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-eb13e1d9-dd47-4b34-96f7-7b70918603bc tempest-ShareIpRulesForNFSTest-1748669711 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 12:58:02 l75lg1-v1 manila-share[98474]: ERROR manila.share.drivers.vastdata [None req-eb13e1d9-dd47-4b34-96f7-7b70918603bc tempest-ShareIpRulesForNFSTest-1748669711 None] failed to resolve host '203.0.113.96/30': [Errno -2] Name or service not known (ignoring): socket.gaierror: [Errno -2] Name or service not known May 28 12:58:02 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-eb13e1d9-dd47-4b34-96f7-7b70918603bc tempest-ShareIpRulesForNFSTest-1748669711 None] changing access on /manila/manila-b7a7d61c-2cea-442a-9809-507038e080d5. Rules: {'nfs_read_write': ['*'], 'nfs_read_only': []} May 28 12:58:02 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-eb13e1d9-dd47-4b34-96f7-7b70918603bc tempest-ShareIpRulesForNFSTest-1748669711 None] >>> [PATCH] https://127.0.0.1:40443/api/viewpolicies/21/ May 28 12:58:02 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-eb13e1d9-dd47-4b34-96f7-7b70918603bc tempest-ShareIpRulesForNFSTest-1748669711 None] {'data': '{"name": "b7a7d61c-2cea-442a-9809-507038e080d5", "nfs_no_squash": ' May 28 12:58:02 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-eb13e1d9-dd47-4b34-96f7-7b70918603bc tempest-ShareIpRulesForNFSTest-1748669711 None] '["*"], "nfs_root_squash": ["*"], "nfs_read_write": ["*"], ' May 28 12:58:02 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-eb13e1d9-dd47-4b34-96f7-7b70918603bc tempest-ShareIpRulesForNFSTest-1748669711 None] '"nfs_read_only": []}', May 28 12:58:02 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-eb13e1d9-dd47-4b34-96f7-7b70918603bc tempest-ShareIpRulesForNFSTest-1748669711 None] 'params': None} May 28 12:58:02 l75lg1-v1 nova-conductor[83648]: DEBUG dbcounter [-] [83648] Writing DB stats nova_cell1:SELECT=1 {{(pid=83648) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:58:02 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1329f217-bf7f-4692-b354-ac9b72606999 tempest-ResourceLockCRUTest-1971036144 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:58:02 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1329f217-bf7f-4692-b354-ac9b72606999 tempest-ResourceLockCRUTest-1971036144 None] [] May 28 12:58:02 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1329f217-bf7f-4692-b354-ac9b72606999 tempest-ResourceLockCRUTest-1971036144 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 12:58:02 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1329f217-bf7f-4692-b354-ac9b72606999 tempest-ResourceLockCRUTest-1971036144 None] >>> [POST] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:58:02 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1329f217-bf7f-4692-b354-ac9b72606999 tempest-ResourceLockCRUTest-1971036144 None] {'data': '{"name": "5de0f734-b2f4-4d05-8249-81f9d2973a8a"}', May 28 12:58:02 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1329f217-bf7f-4692-b354-ac9b72606999 tempest-ResourceLockCRUTest-1971036144 None] 'json': None, May 28 12:58:02 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1329f217-bf7f-4692-b354-ac9b72606999 tempest-ResourceLockCRUTest-1971036144 None] 'params': None} May 28 12:58:03 l75lg1-v1 devstack@placement-api.service[78202]: DEBUG dbcounter [-] [78202] Writing DB stats placement:SELECT=2 {{(pid=78202) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:58:03 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2a531a29-2cd9-4e97-9af6-1ed124146a5b tempest-SharesMetadataTest-1561320255 None] <<< [POST] https://127.0.0.1:40443/api/views/ May 28 12:58:03 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2a531a29-2cd9-4e97-9af6-1ed124146a5b tempest-SharesMetadataTest-1561320255 None] Bunch(abac_tags=[], abe_max_depth=None, abe_protocols=[], alias='', allow_anonymous_access=False, allow_s3_anonymous_access=False, auto_commit='0d', bucket='', bucket_creators=[], bucket_creators_groups=[], bucket_owner=None, bulk_permission_update_progress=None, bulk_permission_update_state=None, cluster='loop75-kfs', cluster_id=1, created='2024-05-28T12:58:02.816039Z', enabled=True, files_retention_mode='NONE', guid='d51413c4-aa3c-408a-9313-d2ddd4a49be5', id=24, ignore_oos=False, internal=False, is_remote=False, is_seamless=False, logical_capacity=0, max_retention_period=None, min_retention_period=None, name='205d35a8-15b8-4a2f-8214-8c2d1a5de6b0', nfs_interop_flags='BOTH_NFS3_AND_NFS4_INTEROP_DISABLED', path='/manila/manila-205d35a8-15b8-4a2f-8214-8c2d1a5de6b0', physical_capacity=0, policy='205d35a8-15b8-4a2f-8214-8c2d1a5de6b0', policy_id=25, protocols=['NFS'], qos_policy=None, qos_policy_id=None, s3_locks=False, s3_locks_retention_mode='NONE', s3_locks_retention_period='', s3_object_ownership_rule='ObjectWriter', s3_unverified_lookup=False, s3_versioning=False, select_for_live_monitoring=False, share='', share_acl=Bunch(acl=[], enabled=False), sync='SYNCED', sync_time='2024-05-28T12:58:03.124811Z', tenant_id=1, tenant_name='default', title='/manila/manila-205d35a8-15b8-4a2f-8214-8c2d1a5de6b0', url='https://127.0.0.1:40443/api/views/24/') May 28 12:58:03 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2a531a29-2cd9-4e97-9af6-1ed124146a5b tempest-SharesMetadataTest-1561320255 None] --- [POST] https://127.0.0.1:40443/api/views/: Done May 28 12:58:03 l75lg1-v1 devstack@placement-api.service[78201]: DEBUG dbcounter [-] [78201] Writing DB stats placement:SELECT=2 {{(pid=78201) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:58:03 l75lg1-v1 manila-share[98474]: INFO manila.share.manager [None req-2a531a29-2cd9-4e97-9af6-1ed124146a5b tempest-SharesMetadataTest-1561320255 None] Share instance 205d35a8-15b8-4a2f-8214-8c2d1a5de6b0 created successfully. May 28 12:58:03 l75lg1-v1 dstat.sh[49771]: 28-05 12:58:03| 2 0 97 1 0|5708M 1779M 277M 7861M| 32k 3448B| 0 1125k| 0 103 |2632 3931 |1.50 1.09 1.02|2.0 3.0 0| 0 0 | 0 2048M| 29 357 0 62 0 May 28 12:58:03 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-fbe18e3f-a7ea-40d8-a8e4-86384913070d tempest-SnapshotInstancesNegativeTest-1396485679 None] <<< [DELETE] https://127.0.0.1:40443/api/snapshots/6/ May 28 12:58:03 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-fbe18e3f-a7ea-40d8-a8e4-86384913070d tempest-SnapshotInstancesNegativeTest-1396485679 None] --- [DELETE] https://127.0.0.1:40443/api/snapshots/6/: Done May 28 12:58:03 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-fbe18e3f-a7ea-40d8-a8e4-86384913070d tempest-SnapshotInstancesNegativeTest-1396485679 None] Created reservations ['b3f731da-c552-4981-9b52-dd14c7d3003d', 'd381b701-c584-4f67-af6a-8b66c00b33da', 'bd72d0d9-a1f4-4386-adbe-85a64fb5e377', 'c7e01a22-f0be-4dbd-b516-bceedaee66ef'] {{(pid=98474) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 12:58:03 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-fbe18e3f-a7ea-40d8-a8e4-86384913070d tempest-SnapshotInstancesNegativeTest-1396485679 None] Committed reservations ['b3f731da-c552-4981-9b52-dd14c7d3003d', 'd381b701-c584-4f67-af6a-8b66c00b33da', 'bd72d0d9-a1f4-4386-adbe-85a64fb5e377', 'c7e01a22-f0be-4dbd-b516-bceedaee66ef'] {{(pid=98474) commit /opt/stack/manila/manila/quota.py:1063}} May 28 12:58:03 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1329f217-bf7f-4692-b354-ac9b72606999 tempest-ResourceLockCRUTest-1971036144 None] <<< [POST] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:58:03 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1329f217-bf7f-4692-b354-ac9b72606999 tempest-ResourceLockCRUTest-1971036144 None] Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=0, created='2024-05-28T12:58:03.164357Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='6e54f2b7-632e-4b36-8f16-c0a4fa4affd3', id=26, internal=False, is_s3_default_policy=False, name='5de0f734-b2f4-4d05-8249-81f9d2973a8a', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=[], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['*'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['*'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T12:58:03.509472Z', tenant_id=1, tenant_name='default', title='5de0f734-b2f4-4d05-8249-81f9d2973a8a', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/26/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[]) May 28 12:58:03 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1329f217-bf7f-4692-b354-ac9b72606999 tempest-ResourceLockCRUTest-1971036144 None] --- [POST] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 12:58:03 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1329f217-bf7f-4692-b354-ac9b72606999 tempest-ResourceLockCRUTest-1971036144 None] >>> [GET] https://127.0.0.1:40443/api/quotas/ May 28 12:58:03 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1329f217-bf7f-4692-b354-ac9b72606999 tempest-ResourceLockCRUTest-1971036144 None] {'allow_redirects': True, May 28 12:58:03 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1329f217-bf7f-4692-b354-ac9b72606999 tempest-ResourceLockCRUTest-1971036144 None] 'params': {'name': '5de0f734-b2f4-4d05-8249-81f9d2973a8a'}} May 28 12:58:03 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1329f217-bf7f-4692-b354-ac9b72606999 tempest-ResourceLockCRUTest-1971036144 None] <<< [GET] https://127.0.0.1:40443/api/quotas/ May 28 12:58:03 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1329f217-bf7f-4692-b354-ac9b72606999 tempest-ResourceLockCRUTest-1971036144 None] [] May 28 12:58:03 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1329f217-bf7f-4692-b354-ac9b72606999 tempest-ResourceLockCRUTest-1971036144 None] --- [GET] https://127.0.0.1:40443/api/quotas/: Done May 28 12:58:03 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1329f217-bf7f-4692-b354-ac9b72606999 tempest-ResourceLockCRUTest-1971036144 None] >>> [POST] https://127.0.0.1:40443/api/quotas/ May 28 12:58:03 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1329f217-bf7f-4692-b354-ac9b72606999 tempest-ResourceLockCRUTest-1971036144 None] {'data': '{"name": "5de0f734-b2f4-4d05-8249-81f9d2973a8a", "path": ' May 28 12:58:03 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1329f217-bf7f-4692-b354-ac9b72606999 tempest-ResourceLockCRUTest-1971036144 None] '"/manila/manila-5de0f734-b2f4-4d05-8249-81f9d2973a8a", "create_dir": ' May 28 12:58:03 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1329f217-bf7f-4692-b354-ac9b72606999 tempest-ResourceLockCRUTest-1971036144 None] 'true, "hard_limit": 1073741824}', May 28 12:58:03 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1329f217-bf7f-4692-b354-ac9b72606999 tempest-ResourceLockCRUTest-1971036144 None] 'json': None, May 28 12:58:03 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1329f217-bf7f-4692-b354-ac9b72606999 tempest-ResourceLockCRUTest-1971036144 None] 'params': None} May 28 12:58:04 l75lg1-v1 dstat.sh[49771]: 28-05 12:58:04| 2 1 96 2 0|5708M 1779M 277M 7861M| 35k 2125B| 0 1699k| 0 181 |2988 4700 |1.50 1.09 1.02|1.0 1.0 0| 0 0 | 0 2048M| 29 357 0 62 0 May 28 12:58:04 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-47e1772d-e22c-41ea-ab80-87a630252487 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] GET http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/snapshots/461797f5-03b2-4e09-af96-9f13a9a2464e May 28 12:58:04 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-47e1772d-e22c-41ea-ab80-87a630252487 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:04 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-47e1772d-e22c-41ea-ab80-87a630252487 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Calling method 'ShareSnapshotMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:04 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-47e1772d-e22c-41ea-ab80-87a630252487 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/snapshots/461797f5-03b2-4e09-af96-9f13a9a2464e returned with HTTP 200 May 28 12:58:04 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 457/923] 10.27.203.238 () {64 vars in 1460 bytes} [Tue May 28 12:58:04 2024] GET /share/v2/a3499cb78849424db45e54caac01de92/snapshots/461797f5-03b2-4e09-af96-9f13a9a2464e => generated 750 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:58:04 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-228541fc-6913-4f12-9ee6-17e5e4ce12f0 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] POST http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/snapshots/461797f5-03b2-4e09-af96-9f13a9a2464e/action May 28 12:58:04 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-228541fc-6913-4f12-9ee6-17e5e4ce12f0 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Action body: b'{"reset_status": {"status": "error"}}' {{(pid=98329) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:58:04 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-228541fc-6913-4f12-9ee6-17e5e4ce12f0 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Action: 'action', calling method: ShareSnapshotsController.snapshot_reset_status, body: {"reset_status": {"status": "error"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:58:04 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-228541fc-6913-4f12-9ee6-17e5e4ce12f0 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Updating share_snapshot '461797f5-03b2-4e09-af96-9f13a9a2464e' with '{'status': 'error'}' {{(pid=98329) _reset_status /opt/stack/manila/manila/api/openstack/wsgi.py:1257}} May 28 12:58:04 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-228541fc-6913-4f12-9ee6-17e5e4ce12f0 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/snapshots/461797f5-03b2-4e09-af96-9f13a9a2464e/action returned with HTTP 202 May 28 12:58:04 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 467/924] 10.27.203.238 () {66 vars in 1502 bytes} [Tue May 28 12:58:04 2024] POST /share/v2/a3499cb78849424db45e54caac01de92/snapshots/461797f5-03b2-4e09-af96-9f13a9a2464e/action => generated 0 bytes in 91 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:58:04 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-aad43aa8-9b0f-44a4-81c2-de793dc561a5 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] GET http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/snapshots/461797f5-03b2-4e09-af96-9f13a9a2464e May 28 12:58:04 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-aad43aa8-9b0f-44a4-81c2-de793dc561a5 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:04 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-aad43aa8-9b0f-44a4-81c2-de793dc561a5 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Calling method 'ShareSnapshotMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:04 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-eb13e1d9-dd47-4b34-96f7-7b70918603bc tempest-ShareIpRulesForNFSTest-1748669711 None] <<< [PATCH] https://127.0.0.1:40443/api/viewpolicies/21/ May 28 12:58:04 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-eb13e1d9-dd47-4b34-96f7-7b70918603bc tempest-ShareIpRulesForNFSTest-1748669711 None] Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=1, created='2024-05-28T12:57:40.763635Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='377955ad-d094-4e49-ab32-1021d943a572', id=21, internal=False, is_s3_default_policy=False, name='b7a7d61c-2cea-442a-9809-507038e080d5', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=['*'], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['*'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['*'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='MODIFYING', sync_time='2024-05-28T12:58:03.805845Z', tenant_id=1, tenant_name='default', title='b7a7d61c-2cea-442a-9809-507038e080d5', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/21/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[]) May 28 12:58:04 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-eb13e1d9-dd47-4b34-96f7-7b70918603bc tempest-ShareIpRulesForNFSTest-1748669711 None] --- [PATCH] https://127.0.0.1:40443/api/viewpolicies/21/: Done May 28 12:58:04 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-eb13e1d9-dd47-4b34-96f7-7b70918603bc tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:04 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-eb13e1d9-dd47-4b34-96f7-7b70918603bc tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:04 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-aad43aa8-9b0f-44a4-81c2-de793dc561a5 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/snapshots/461797f5-03b2-4e09-af96-9f13a9a2464e returned with HTTP 200 May 28 12:58:04 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 458/925] 10.27.203.238 () {64 vars in 1460 bytes} [Tue May 28 12:58:04 2024] GET /share/v2/a3499cb78849424db45e54caac01de92/snapshots/461797f5-03b2-4e09-af96-9f13a9a2464e => generated 746 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:58:04 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-c2dd030b-5958-4320-a625-b6077f4c6006 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] POST http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/snapshots/461797f5-03b2-4e09-af96-9f13a9a2464e/action May 28 12:58:04 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-c2dd030b-5958-4320-a625-b6077f4c6006 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Action body: b'{"reset_status": {"status": "available"}}' {{(pid=98329) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:58:04 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-c2dd030b-5958-4320-a625-b6077f4c6006 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Action: 'action', calling method: ShareSnapshotsController.snapshot_reset_status, body: {"reset_status": {"status": "available"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:58:04 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-c2dd030b-5958-4320-a625-b6077f4c6006 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Updating share_snapshot '461797f5-03b2-4e09-af96-9f13a9a2464e' with '{'status': 'available'}' {{(pid=98329) _reset_status /opt/stack/manila/manila/api/openstack/wsgi.py:1257}} May 28 12:58:04 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-eb13e1d9-dd47-4b34-96f7-7b70918603bc tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.029s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:04 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-eb13e1d9-dd47-4b34-96f7-7b70918603bc tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:04 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-eb13e1d9-dd47-4b34-96f7-7b70918603bc tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:04 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-eb13e1d9-dd47-4b34-96f7-7b70918603bc tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.031s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:04 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-eb13e1d9-dd47-4b34-96f7-7b70918603bc tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:04 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-eb13e1d9-dd47-4b34-96f7-7b70918603bc tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:04 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-eb13e1d9-dd47-4b34-96f7-7b70918603bc tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.004s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:04 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-eb13e1d9-dd47-4b34-96f7-7b70918603bc tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:04 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-eb13e1d9-dd47-4b34-96f7-7b70918603bc tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:04 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-eb13e1d9-dd47-4b34-96f7-7b70918603bc tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:04 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-eb13e1d9-dd47-4b34-96f7-7b70918603bc tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:04 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-eb13e1d9-dd47-4b34-96f7-7b70918603bc tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:04 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-096e26ea-ff5f-4862-bbdb-6433e6bb8631 tempest-SnapshotInstancesNegativeTest-1396485679 tempest-SnapshotInstancesNegativeTest-1396485679-project-admin] GET http://10.27.203.238/share/v2/c9cc76ecb4e343a6a51bf36da01debf8/snapshots/0d2e6969-2d63-4c8c-bd0a-ae6e8ca0314c May 28 12:58:04 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-096e26ea-ff5f-4862-bbdb-6433e6bb8631 tempest-SnapshotInstancesNegativeTest-1396485679 tempest-SnapshotInstancesNegativeTest-1396485679-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:04 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-096e26ea-ff5f-4862-bbdb-6433e6bb8631 tempest-SnapshotInstancesNegativeTest-1396485679 tempest-SnapshotInstancesNegativeTest-1396485679-project-admin] Calling method 'ShareSnapshotMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:04 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-c2dd030b-5958-4320-a625-b6077f4c6006 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/snapshots/461797f5-03b2-4e09-af96-9f13a9a2464e/action returned with HTTP 202 May 28 12:58:04 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 468/926] 10.27.203.238 () {66 vars in 1502 bytes} [Tue May 28 12:58:04 2024] POST /share/v2/a3499cb78849424db45e54caac01de92/snapshots/461797f5-03b2-4e09-af96-9f13a9a2464e/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:58:04 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-096e26ea-ff5f-4862-bbdb-6433e6bb8631 tempest-SnapshotInstancesNegativeTest-1396485679 tempest-SnapshotInstancesNegativeTest-1396485679-project-admin] HTTP exception thrown: The resource could not be found. May 28 12:58:04 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-096e26ea-ff5f-4862-bbdb-6433e6bb8631 tempest-SnapshotInstancesNegativeTest-1396485679 tempest-SnapshotInstancesNegativeTest-1396485679-project-admin] http://10.27.203.238/share/v2/c9cc76ecb4e343a6a51bf36da01debf8/snapshots/0d2e6969-2d63-4c8c-bd0a-ae6e8ca0314c returned with HTTP 404 May 28 12:58:04 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 459/927] 10.27.203.238 () {64 vars in 1460 bytes} [Tue May 28 12:58:04 2024] GET /share/v2/c9cc76ecb4e343a6a51bf36da01debf8/snapshots/0d2e6969-2d63-4c8c-bd0a-ae6e8ca0314c => generated 78 bytes in 15 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 12:58:04 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-6529de3a-021a-4df1-b0d8-831d5e7dcb94 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] GET http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/snapshots/461797f5-03b2-4e09-af96-9f13a9a2464e May 28 12:58:04 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-6529de3a-021a-4df1-b0d8-831d5e7dcb94 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:04 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-6529de3a-021a-4df1-b0d8-831d5e7dcb94 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Calling method 'ShareSnapshotMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:04 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-30b0851a-8f2f-4e5b-9f8e-9a5fa082f2fc tempest-SnapshotInstancesNegativeTest-1897954514 tempest-SnapshotInstancesNegativeTest-1897954514-project-member] GET http://10.27.203.238/share/v2/ed0a0bf2490645089c21203bbbe1c291/share-replicas/detail?share_id=59371a98-d4b3-4967-9846-4759c0b33bb2 May 28 12:58:04 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-30b0851a-8f2f-4e5b-9f8e-9a5fa082f2fc tempest-SnapshotInstancesNegativeTest-1897954514 tempest-SnapshotInstancesNegativeTest-1897954514-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:04 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-30b0851a-8f2f-4e5b-9f8e-9a5fa082f2fc tempest-SnapshotInstancesNegativeTest-1897954514 tempest-SnapshotInstancesNegativeTest-1897954514-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:04 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-eb13e1d9-dd47-4b34-96f7-7b70918603bc tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.044s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:04 l75lg1-v1 manila-share[98474]: INFO manila.share.access [None req-eb13e1d9-dd47-4b34-96f7-7b70918603bc tempest-ShareIpRulesForNFSTest-1748669711 None] Access rules were successfully modified for share instance b7a7d61c-2cea-442a-9809-507038e080d5 belonging to share 1ddadc17-cf10-4a42-8bbd-8335fb3520a1. May 28 12:58:04 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-30b0851a-8f2f-4e5b-9f8e-9a5fa082f2fc tempest-SnapshotInstancesNegativeTest-1897954514 tempest-SnapshotInstancesNegativeTest-1897954514-project-member] http://10.27.203.238/share/v2/ed0a0bf2490645089c21203bbbe1c291/share-replicas/detail?share_id=59371a98-d4b3-4967-9846-4759c0b33bb2 returned with HTTP 200 May 28 12:58:04 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 460/928] 10.27.203.238 () {64 vars in 1476 bytes} [Tue May 28 12:58:04 2024] GET /share/v2/ed0a0bf2490645089c21203bbbe1c291/share-replicas/detail?share_id=59371a98-d4b3-4967-9846-4759c0b33bb2 => generated 22 bytes in 15 msecs (HTTP/1.1 200) 6 headers in 230 bytes (2 switches on core 0) May 28 12:58:04 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-c6945b0a-5f43-478b-ab3a-c1fe10c98bc6 tempest-SnapshotInstancesNegativeTest-1396485679 tempest-SnapshotInstancesNegativeTest-1396485679-project-admin] DELETE http://10.27.203.238/share/v2/c9cc76ecb4e343a6a51bf36da01debf8/shares/59371a98-d4b3-4967-9846-4759c0b33bb2 May 28 12:58:04 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-c6945b0a-5f43-478b-ab3a-c1fe10c98bc6 tempest-SnapshotInstancesNegativeTest-1396485679 tempest-SnapshotInstancesNegativeTest-1396485679-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:04 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-c6945b0a-5f43-478b-ab3a-c1fe10c98bc6 tempest-SnapshotInstancesNegativeTest-1396485679 tempest-SnapshotInstancesNegativeTest-1396485679-project-admin] Calling method 'ShareMixin.delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:04 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.v1.shares [None req-c6945b0a-5f43-478b-ab3a-c1fe10c98bc6 tempest-SnapshotInstancesNegativeTest-1396485679 tempest-SnapshotInstancesNegativeTest-1396485679-project-admin] Delete share with id: 59371a98-d4b3-4967-9846-4759c0b33bb2 May 28 12:58:04 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-6529de3a-021a-4df1-b0d8-831d5e7dcb94 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/snapshots/461797f5-03b2-4e09-af96-9f13a9a2464e returned with HTTP 200 May 28 12:58:04 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 469/929] 10.27.203.238 () {64 vars in 1460 bytes} [Tue May 28 12:58:04 2024] GET /share/v2/a3499cb78849424db45e54caac01de92/snapshots/461797f5-03b2-4e09-af96-9f13a9a2464e => generated 750 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:58:04 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-e83d93d7-61fc-499c-aada-ef8cfc584125 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] POST http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/snapshots May 28 12:58:04 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-e83d93d7-61fc-499c-aada-ef8cfc584125 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Action: 'create', calling method: ShareSnapshotMixin.create, body: {"snapshot": {"name": "tempest-tempest-created-share-snap-455624358", "force": false, "description": "Tempest's snapshot", "share_id": "df0ea844-5fc1-4d04-8afb-5048ec5dc33f"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:58:04 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.v1.share_snapshots [None req-e83d93d7-61fc-499c-aada-ef8cfc584125 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Create snapshot from share df0ea844-5fc1-4d04-8afb-5048ec5dc33f May 28 12:58:04 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.quota [None req-e83d93d7-61fc-499c-aada-ef8cfc584125 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Created reservations ['4fe8e6c3-02f7-4759-a077-e865a66652ae', '255a2c52-b285-4369-bc7d-d89a2caf6e29', '658ffb84-ef2a-4231-9535-26bfd216c96f', '60c72462-eaf8-4cd9-a6d2-96c69c455398'] {{(pid=98329) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 12:58:04 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-c6945b0a-5f43-478b-ab3a-c1fe10c98bc6 tempest-SnapshotInstancesNegativeTest-1396485679 tempest-SnapshotInstancesNegativeTest-1396485679-project-admin] http://10.27.203.238/share/v2/c9cc76ecb4e343a6a51bf36da01debf8/shares/59371a98-d4b3-4967-9846-4759c0b33bb2 returned with HTTP 202 May 28 12:58:04 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 461/930] 10.27.203.238 () {64 vars in 1454 bytes} [Tue May 28 12:58:04 2024] DELETE /share/v2/c9cc76ecb4e343a6a51bf36da01debf8/shares/59371a98-d4b3-4967-9846-4759c0b33bb2 => generated 0 bytes in 134 msecs (HTTP/1.1 202) 6 headers in 243 bytes (2 switches on core 0) May 28 12:58:04 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-c546dd13-2dfa-4237-ab96-e987805c763d tempest-SnapshotInstancesNegativeTest-1396485679 tempest-SnapshotInstancesNegativeTest-1396485679-project-admin] GET http://10.27.203.238/share/v2/c9cc76ecb4e343a6a51bf36da01debf8/shares/59371a98-d4b3-4967-9846-4759c0b33bb2 May 28 12:58:04 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-c546dd13-2dfa-4237-ab96-e987805c763d tempest-SnapshotInstancesNegativeTest-1396485679 tempest-SnapshotInstancesNegativeTest-1396485679-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:04 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-c546dd13-2dfa-4237-ab96-e987805c763d tempest-SnapshotInstancesNegativeTest-1396485679 tempest-SnapshotInstancesNegativeTest-1396485679-project-admin] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:04 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-c546dd13-2dfa-4237-ab96-e987805c763d tempest-SnapshotInstancesNegativeTest-1396485679 tempest-SnapshotInstancesNegativeTest-1396485679-project-admin] http://10.27.203.238/share/v2/c9cc76ecb4e343a6a51bf36da01debf8/shares/59371a98-d4b3-4967-9846-4759c0b33bb2 returned with HTTP 200 May 28 12:58:04 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 462/931] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:58:04 2024] GET /share/v2/c9cc76ecb4e343a6a51bf36da01debf8/shares/59371a98-d4b3-4967-9846-4759c0b33bb2 => generated 1368 bytes in 26 msecs (HTTP/1.1 200) 6 headers in 232 bytes (2 switches on core 0) May 28 12:58:04 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.quota [None req-e83d93d7-61fc-499c-aada-ef8cfc584125 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Committed reservations ['4fe8e6c3-02f7-4759-a077-e865a66652ae', '255a2c52-b285-4369-bc7d-d89a2caf6e29', '658ffb84-ef2a-4231-9535-26bfd216c96f', '60c72462-eaf8-4cd9-a6d2-96c69c455398'] {{(pid=98329) commit /opt/stack/manila/manila/quota.py:1063}} May 28 12:58:04 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-e83d93d7-61fc-499c-aada-ef8cfc584125 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/snapshots returned with HTTP 202 May 28 12:58:04 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 470/932] 10.27.203.238 () {66 vars in 1371 bytes} [Tue May 28 12:58:04 2024] POST /share/v2/a3499cb78849424db45e54caac01de92/snapshots => generated 749 bytes in 167 msecs (HTTP/1.1 202) 6 headers in 237 bytes (1 switches on core 0) May 28 12:58:04 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-dd2d3218-68eb-41d1-aacf-e16200e34c06 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] GET http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/snapshots/b3972da7-eb1f-4370-abf4-b7f9402afb30 May 28 12:58:04 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-dd2d3218-68eb-41d1-aacf-e16200e34c06 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:04 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-dd2d3218-68eb-41d1-aacf-e16200e34c06 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Calling method 'ShareSnapshotMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:04 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c6945b0a-5f43-478b-ab3a-c1fe10c98bc6 tempest-SnapshotInstancesNegativeTest-1396485679 None] Acquiring lock "locked_access_rules_operation_by_share_instance_8239ccb8-483c-4129-8319-880234387fbd" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:04 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c6945b0a-5f43-478b-ab3a-c1fe10c98bc6 tempest-SnapshotInstancesNegativeTest-1396485679 None] Lock "locked_access_rules_operation_by_share_instance_8239ccb8-483c-4129-8319-880234387fbd" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:04 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c6945b0a-5f43-478b-ab3a-c1fe10c98bc6 tempest-SnapshotInstancesNegativeTest-1396485679 None] Lock "locked_access_rules_operation_by_share_instance_8239ccb8-483c-4129-8319-880234387fbd" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.010s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:04 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c6945b0a-5f43-478b-ab3a-c1fe10c98bc6 tempest-SnapshotInstancesNegativeTest-1396485679 None] Acquiring lock "locked_access_rules_operation_by_share_instance_8239ccb8-483c-4129-8319-880234387fbd" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:04 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c6945b0a-5f43-478b-ab3a-c1fe10c98bc6 tempest-SnapshotInstancesNegativeTest-1396485679 None] Lock "locked_access_rules_operation_by_share_instance_8239ccb8-483c-4129-8319-880234387fbd" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:04 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c6945b0a-5f43-478b-ab3a-c1fe10c98bc6 tempest-SnapshotInstancesNegativeTest-1396485679 None] Lock "locked_access_rules_operation_by_share_instance_8239ccb8-483c-4129-8319-880234387fbd" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.006s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:04 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c6945b0a-5f43-478b-ab3a-c1fe10c98bc6 tempest-SnapshotInstancesNegativeTest-1396485679 None] Acquiring lock "locked_access_rules_operation_by_share_instance_8239ccb8-483c-4129-8319-880234387fbd" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:04 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c6945b0a-5f43-478b-ab3a-c1fe10c98bc6 tempest-SnapshotInstancesNegativeTest-1396485679 None] Lock "locked_access_rules_operation_by_share_instance_8239ccb8-483c-4129-8319-880234387fbd" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:04 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-dd2d3218-68eb-41d1-aacf-e16200e34c06 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/snapshots/b3972da7-eb1f-4370-abf4-b7f9402afb30 returned with HTTP 200 May 28 12:58:04 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 463/933] 10.27.203.238 () {64 vars in 1460 bytes} [Tue May 28 12:58:04 2024] GET /share/v2/a3499cb78849424db45e54caac01de92/snapshots/b3972da7-eb1f-4370-abf4-b7f9402afb30 => generated 749 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:58:04 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-9a604324-501b-40ed-a411-301fd55603e2 tempest-ResourceLockCRUTest-1971036144 tempest-ResourceLockCRUTest-1971036144-project-member] GET http://10.27.203.238/share/v2/82840ccb77144a4aa2d0bdce807ce686/shares/071c2e61-b4b6-48bf-a1f2-c20b233560ed May 28 12:58:04 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-9a604324-501b-40ed-a411-301fd55603e2 tempest-ResourceLockCRUTest-1971036144 tempest-ResourceLockCRUTest-1971036144-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:04 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-9a604324-501b-40ed-a411-301fd55603e2 tempest-ResourceLockCRUTest-1971036144 tempest-ResourceLockCRUTest-1971036144-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:04 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c6945b0a-5f43-478b-ab3a-c1fe10c98bc6 tempest-SnapshotInstancesNegativeTest-1396485679 None] Lock "locked_access_rules_operation_by_share_instance_8239ccb8-483c-4129-8319-880234387fbd" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.011s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:04 l75lg1-v1 manila-share[98474]: DEBUG manila.share.access [None req-c6945b0a-5f43-478b-ab3a-c1fe10c98bc6 tempest-SnapshotInstancesNegativeTest-1396485679 None] All access rules have been synced for share instance 8239ccb8-483c-4129-8319-880234387fbd belonging to share 59371a98-d4b3-4967-9846-4759c0b33bb2. {{(pid=98474) update_access_rules /opt/stack/manila/manila/share/access.py:304}} May 28 12:58:04 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-c6945b0a-5f43-478b-ab3a-c1fe10c98bc6 tempest-SnapshotInstancesNegativeTest-1396485679 None] deleting '/manila/manila-8239ccb8-483c-4129-8319-880234387fbd' May 28 12:58:04 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c6945b0a-5f43-478b-ab3a-c1fe10c98bc6 tempest-SnapshotInstancesNegativeTest-1396485679 None] >>> [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/ May 28 12:58:04 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c6945b0a-5f43-478b-ab3a-c1fe10c98bc6 tempest-SnapshotInstancesNegativeTest-1396485679 None] {'data': '{"path": "/manila/manila-8239ccb8-483c-4129-8319-880234387fbd"}', May 28 12:58:04 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c6945b0a-5f43-478b-ab3a-c1fe10c98bc6 tempest-SnapshotInstancesNegativeTest-1396485679 None] 'params': None} May 28 12:58:04 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-9a604324-501b-40ed-a411-301fd55603e2 tempest-ResourceLockCRUTest-1971036144 tempest-ResourceLockCRUTest-1971036144-project-member] http://10.27.203.238/share/v2/82840ccb77144a4aa2d0bdce807ce686/shares/071c2e61-b4b6-48bf-a1f2-c20b233560ed returned with HTTP 200 May 28 12:58:04 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 471/934] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:58:04 2024] GET /share/v2/82840ccb77144a4aa2d0bdce807ce686/shares/071c2e61-b4b6-48bf-a1f2-c20b233560ed => generated 1316 bytes in 24 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:58:04 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e83d93d7-61fc-499c-aada-ef8cfc584125 tempest-AdminActionsTest-1749172189 None] >>> [POST] https://127.0.0.1:40443/api/snapshots/ May 28 12:58:04 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e83d93d7-61fc-499c-aada-ef8cfc584125 tempest-AdminActionsTest-1749172189 None] {'data': '{"path": "/manila/manila-77a25e6b-f137-4342-8eb9-9ced679515e2", ' May 28 12:58:04 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e83d93d7-61fc-499c-aada-ef8cfc584125 tempest-AdminActionsTest-1749172189 None] '"name": "share-snapshot-be7ae42b-274e-4c6c-9e06-cbf16268cf26"}', May 28 12:58:04 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e83d93d7-61fc-499c-aada-ef8cfc584125 tempest-AdminActionsTest-1749172189 None] 'json': None, May 28 12:58:04 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e83d93d7-61fc-499c-aada-ef8cfc584125 tempest-AdminActionsTest-1749172189 None] 'params': None} May 28 12:58:04 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-ffa833a7-873a-4e8a-b238-359a648e5e67 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] GET http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/c485966a-3cd7-4de5-903f-4b379a6cb450 May 28 12:58:04 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-ffa833a7-873a-4e8a-b238-359a648e5e67 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:04 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-ffa833a7-873a-4e8a-b238-359a648e5e67 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:05 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-ffa833a7-873a-4e8a-b238-359a648e5e67 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/c485966a-3cd7-4de5-903f-4b379a6cb450 returned with HTTP 200 May 28 12:58:05 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 464/935] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:58:04 2024] GET /share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/c485966a-3cd7-4de5-903f-4b379a6cb450 => generated 1350 bytes in 26 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:58:05 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c6945b0a-5f43-478b-ab3a-c1fe10c98bc6 tempest-SnapshotInstancesNegativeTest-1396485679 None] <<< [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/ May 28 12:58:05 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c6945b0a-5f43-478b-ab3a-c1fe10c98bc6 tempest-SnapshotInstancesNegativeTest-1396485679 None] 'OK' May 28 12:58:05 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c6945b0a-5f43-478b-ab3a-c1fe10c98bc6 tempest-SnapshotInstancesNegativeTest-1396485679 None] --- [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/: Done May 28 12:58:05 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c6945b0a-5f43-478b-ab3a-c1fe10c98bc6 tempest-SnapshotInstancesNegativeTest-1396485679 None] >>> [GET] https://127.0.0.1:40443/api/views/ May 28 12:58:05 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c6945b0a-5f43-478b-ab3a-c1fe10c98bc6 tempest-SnapshotInstancesNegativeTest-1396485679 None] {'allow_redirects': True, May 28 12:58:05 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c6945b0a-5f43-478b-ab3a-c1fe10c98bc6 tempest-SnapshotInstancesNegativeTest-1396485679 None] 'params': {'name': '8239ccb8-483c-4129-8319-880234387fbd'}} May 28 12:58:05 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-c6d65c24-eafc-4b17-a5bb-260a619d6c02 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] GET http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/c485966a-3cd7-4de5-903f-4b379a6cb450/metadata/key1 May 28 12:58:05 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-c6d65c24-eafc-4b17-a5bb-260a619d6c02 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:05 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-c6d65c24-eafc-4b17-a5bb-260a619d6c02 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:05 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1329f217-bf7f-4692-b354-ac9b72606999 tempest-ResourceLockCRUTest-1971036144 None] <<< [POST] https://127.0.0.1:40443/api/quotas/ May 28 12:58:05 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1329f217-bf7f-4692-b354-ac9b72606999 tempest-ResourceLockCRUTest-1971036144 None] Bunch(cluster='loop75-kfs', cluster_id=1, default_email=None, default_group_quota=None, default_user_quota=None, enable_alarms=True, enable_email_providers=True, grace_period=None, group_quotas=[], guid='81084535-f7fd-4368-8fe6-02a5aca74187', hard_limit=1073741824, hard_limit_inodes=None, id=23, internal=False, is_user_quota=False, last_user_quotas_update=None, name='5de0f734-b2f4-4d05-8249-81f9d2973a8a', num_blocked_users=0, num_exceeded_users=0, path='/manila/manila-5de0f734-b2f4-4d05-8249-81f9d2973a8a', percent_capacity=0, percent_inodes=None, pretty_grace_period=None, pretty_grace_period_expiration=None, pretty_state='OK (CREATED)', soft_limit=None, soft_limit_inodes=None, state='OK', sync_state='CREATED', system_id=23, tenant_id=1, tenant_name='default', time_to_block=None, title='5de0f734-b2f4-4d05-8249-81f9d2973a8a', url='https://127.0.0.1:40443/api/quotas/23/', used_capacity=0, used_capacity_tb=0.0, used_effective_capacity=0, used_effective_capacity_tb=0.0, used_inodes=0, used_limited_capacity=0, user_quotas=[]) May 28 12:58:05 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1329f217-bf7f-4692-b354-ac9b72606999 tempest-ResourceLockCRUTest-1971036144 None] --- [POST] https://127.0.0.1:40443/api/quotas/: Done May 28 12:58:05 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1329f217-bf7f-4692-b354-ac9b72606999 tempest-ResourceLockCRUTest-1971036144 None] >>> [GET] https://127.0.0.1:40443/api/views/ May 28 12:58:05 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1329f217-bf7f-4692-b354-ac9b72606999 tempest-ResourceLockCRUTest-1971036144 None] {'allow_redirects': True, May 28 12:58:05 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1329f217-bf7f-4692-b354-ac9b72606999 tempest-ResourceLockCRUTest-1971036144 None] 'params': {'name': '5de0f734-b2f4-4d05-8249-81f9d2973a8a'}} May 28 12:58:05 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-c6d65c24-eafc-4b17-a5bb-260a619d6c02 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/c485966a-3cd7-4de5-903f-4b379a6cb450/metadata/key1 returned with HTTP 200 May 28 12:58:05 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 472/936] 10.27.203.238 () {64 vars in 1493 bytes} [Tue May 28 12:58:05 2024] GET /share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/c485966a-3cd7-4de5-903f-4b379a6cb450/metadata/key1 => generated 28 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:58:05 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-ed660aaa-f56d-4f03-8afa-8fd2046db56c tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] GET http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/c485966a-3cd7-4de5-903f-4b379a6cb450/metadata/key2 May 28 12:58:05 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-ed660aaa-f56d-4f03-8afa-8fd2046db56c tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:05 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-ed660aaa-f56d-4f03-8afa-8fd2046db56c tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:05 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-ed660aaa-f56d-4f03-8afa-8fd2046db56c tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/c485966a-3cd7-4de5-903f-4b379a6cb450/metadata/key2 returned with HTTP 200 May 28 12:58:05 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 465/937] 10.27.203.238 () {64 vars in 1493 bytes} [Tue May 28 12:58:05 2024] GET /share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/c485966a-3cd7-4de5-903f-4b379a6cb450/metadata/key2 => generated 28 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:58:05 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-30dcc345-0964-4e1d-a861-80cd68390913 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] GET http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/share-replicas/detail?share_id=c485966a-3cd7-4de5-903f-4b379a6cb450 May 28 12:58:05 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-30dcc345-0964-4e1d-a861-80cd68390913 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:05 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-30dcc345-0964-4e1d-a861-80cd68390913 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:05 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-30dcc345-0964-4e1d-a861-80cd68390913 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/share-replicas/detail?share_id=c485966a-3cd7-4de5-903f-4b379a6cb450 returned with HTTP 200 May 28 12:58:05 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 473/938] 10.27.203.238 () {64 vars in 1476 bytes} [Tue May 28 12:58:05 2024] GET /share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/share-replicas/detail?share_id=c485966a-3cd7-4de5-903f-4b379a6cb450 => generated 22 bytes in 13 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:58:05 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-56e811af-e796-4a9d-8605-933cf433f535 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] DELETE http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/c485966a-3cd7-4de5-903f-4b379a6cb450 May 28 12:58:05 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-56e811af-e796-4a9d-8605-933cf433f535 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:05 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-56e811af-e796-4a9d-8605-933cf433f535 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Calling method 'ShareMixin.delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:05 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.v1.shares [None req-56e811af-e796-4a9d-8605-933cf433f535 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Delete share with id: c485966a-3cd7-4de5-903f-4b379a6cb450 May 28 12:58:05 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-20eeaba2-beb1-4309-bc04-c965f58f3d9d tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] GET http://10.27.203.238/share/v2/776f75906bc64f8f9316d5aab4b50bf1/share-access-rules?share_id=1ddadc17-cf10-4a42-8bbd-8335fb3520a1 May 28 12:58:05 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-20eeaba2-beb1-4309-bc04-c965f58f3d9d tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:05 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-20eeaba2-beb1-4309-bc04-c965f58f3d9d tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:05 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-20eeaba2-beb1-4309-bc04-c965f58f3d9d tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] http://10.27.203.238/share/v2/776f75906bc64f8f9316d5aab4b50bf1/share-access-rules?share_id=1ddadc17-cf10-4a42-8bbd-8335fb3520a1 returned with HTTP 200 May 28 12:58:05 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 474/939] 10.27.203.238 () {64 vars in 1467 bytes} [Tue May 28 12:58:05 2024] GET /share/v2/776f75906bc64f8f9316d5aab4b50bf1/share-access-rules?share_id=1ddadc17-cf10-4a42-8bbd-8335fb3520a1 => generated 19 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:58:05 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-abaf1bed-55d9-4414-800b-59840cf6c994 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] POST http://10.27.203.238/share/v2/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action May 28 12:58:05 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-abaf1bed-55d9-4414-800b-59840cf6c994 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Action body: b'{"allow_access": {"access_type": "ip", "access_to": "203.0.113.0/24", "access_level": "rw"}}' {{(pid=98329) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:58:05 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-abaf1bed-55d9-4414-800b-59840cf6c994 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Action: 'action', calling method: ShareController.allow_access, body: {"allow_access": {"access_type": "ip", "access_to": "203.0.113.0/24", "access_level": "rw"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:58:05 l75lg1-v1 dstat.sh[49771]: 28-05 12:58:05| 13 1 81 4 0|5708M 1779M 277M 7861M| 27k 8755B| 0 7079k| 0 554 |6309 10k|1.50 1.09 1.02|2.0 0 0| 0 0 | 0 2048M| 29 359 0 62 0 May 28 12:58:05 l75lg1-v1 devstack@m-api.service[98329]: DEBUG oslo_concurrency.lockutils [None req-abaf1bed-55d9-4414-800b-59840cf6c994 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98329) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:05 l75lg1-v1 devstack@m-api.service[98329]: DEBUG oslo_concurrency.lockutils [None req-abaf1bed-55d9-4414-800b-59840cf6c994 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.002s {{(pid=98329) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:05 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-56e811af-e796-4a9d-8605-933cf433f535 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/c485966a-3cd7-4de5-903f-4b379a6cb450 returned with HTTP 202 May 28 12:58:05 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 466/940] 10.27.203.238 () {64 vars in 1454 bytes} [Tue May 28 12:58:05 2024] DELETE /share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/c485966a-3cd7-4de5-903f-4b379a6cb450 => generated 0 bytes in 141 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:58:05 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-ca58fd06-e626-4de3-97aa-195d59c9bb53 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] GET http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/c485966a-3cd7-4de5-903f-4b379a6cb450 May 28 12:58:05 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-ca58fd06-e626-4de3-97aa-195d59c9bb53 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:05 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-ca58fd06-e626-4de3-97aa-195d59c9bb53 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:05 l75lg1-v1 devstack@m-api.service[98329]: DEBUG oslo_concurrency.lockutils [None req-abaf1bed-55d9-4414-800b-59840cf6c994 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.050s {{(pid=98329) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:05 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-abaf1bed-55d9-4414-800b-59840cf6c994 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] http://10.27.203.238/share/v2/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action returned with HTTP 200 May 28 12:58:05 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 475/941] 10.27.203.238 () {66 vars in 1493 bytes} [Tue May 28 12:58:05 2024] POST /share/v2/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action => generated 312 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:58:05 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-0a66f774-e4e3-4766-a90d-b1671916d0cb tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] GET http://10.27.203.238/share/v2/776f75906bc64f8f9316d5aab4b50bf1/share-access-rules?share_id=1ddadc17-cf10-4a42-8bbd-8335fb3520a1 May 28 12:58:05 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-0a66f774-e4e3-4766-a90d-b1671916d0cb tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:05 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-0a66f774-e4e3-4766-a90d-b1671916d0cb tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:05 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-ca58fd06-e626-4de3-97aa-195d59c9bb53 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/c485966a-3cd7-4de5-903f-4b379a6cb450 returned with HTTP 200 May 28 12:58:05 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 467/942] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:58:05 2024] GET /share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/c485966a-3cd7-4de5-903f-4b379a6cb450 => generated 1349 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:58:05 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.lock.api [None req-0a66f774-e4e3-4766-a90d-b1671916d0cb tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Searching for locks by: {'resource_id': '3aa6ee8f-37bb-46ff-af45-fc126918db98', 'resource_action': 'show', 'resource_type': 'access_rule'} {{(pid=98329) get_all /opt/stack/manila/manila/lock/api.py:112}} May 28 12:58:05 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-0a66f774-e4e3-4766-a90d-b1671916d0cb tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] http://10.27.203.238/share/v2/776f75906bc64f8f9316d5aab4b50bf1/share-access-rules?share_id=1ddadc17-cf10-4a42-8bbd-8335fb3520a1 returned with HTTP 200 May 28 12:58:05 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 476/943] 10.27.203.238 () {64 vars in 1467 bytes} [Tue May 28 12:58:05 2024] GET /share/v2/776f75906bc64f8f9316d5aab4b50bf1/share-access-rules?share_id=1ddadc17-cf10-4a42-8bbd-8335fb3520a1 => generated 267 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:58:05 l75lg1-v1 manila-share[98474]: DEBUG manila.share.manager [None req-abaf1bed-55d9-4414-800b-59840cf6c994 tempest-ShareIpRulesForNFSTest-1748669711 None] Received request to update access for share instance b7a7d61c-2cea-442a-9809-507038e080d5. {{(pid=98474) update_access_for_instances /opt/stack/manila/manila/share/manager.py:4353}} May 28 12:58:05 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1329f217-bf7f-4692-b354-ac9b72606999 tempest-ResourceLockCRUTest-1971036144 None] <<< [GET] https://127.0.0.1:40443/api/views/ May 28 12:58:05 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1329f217-bf7f-4692-b354-ac9b72606999 tempest-ResourceLockCRUTest-1971036144 None] [] May 28 12:58:05 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1329f217-bf7f-4692-b354-ac9b72606999 tempest-ResourceLockCRUTest-1971036144 None] --- [GET] https://127.0.0.1:40443/api/views/: Done May 28 12:58:05 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1329f217-bf7f-4692-b354-ac9b72606999 tempest-ResourceLockCRUTest-1971036144 None] >>> [POST] https://127.0.0.1:40443/api/views/ May 28 12:58:05 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1329f217-bf7f-4692-b354-ac9b72606999 tempest-ResourceLockCRUTest-1971036144 None] {'data': '{"name": "5de0f734-b2f4-4d05-8249-81f9d2973a8a", "path": ' May 28 12:58:05 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1329f217-bf7f-4692-b354-ac9b72606999 tempest-ResourceLockCRUTest-1971036144 None] '"/manila/manila-5de0f734-b2f4-4d05-8249-81f9d2973a8a", "policy_id": ' May 28 12:58:05 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1329f217-bf7f-4692-b354-ac9b72606999 tempest-ResourceLockCRUTest-1971036144 None] '26, "create_dir": true, "protocols": ["NFS"]}', May 28 12:58:05 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1329f217-bf7f-4692-b354-ac9b72606999 tempest-ResourceLockCRUTest-1971036144 None] 'json': None, May 28 12:58:05 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1329f217-bf7f-4692-b354-ac9b72606999 tempest-ResourceLockCRUTest-1971036144 None] 'params': None} May 28 12:58:05 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c6945b0a-5f43-478b-ab3a-c1fe10c98bc6 tempest-SnapshotInstancesNegativeTest-1396485679 None] <<< [GET] https://127.0.0.1:40443/api/views/ May 28 12:58:05 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c6945b0a-5f43-478b-ab3a-c1fe10c98bc6 tempest-SnapshotInstancesNegativeTest-1396485679 None] [Bunch(abac_tags=[], abe_max_depth=None, abe_protocols=[], alias='', allow_anonymous_access=False, allow_s3_anonymous_access=False, auto_commit='0d', bucket='', bucket_creators=[], bucket_creators_groups=[], bucket_owner=None, bulk_permission_update_progress=None, bulk_permission_update_state=None, cluster='loop75-kfs', cluster_id=1, created='2024-05-28T12:57:53.170630Z', enabled=True, files_retention_mode='NONE', guid='d1499399-c5ed-41ff-99b8-21c1b2147bef', id=23, ignore_oos=False, internal=False, is_remote=False, is_seamless=False, logical_capacity=0, max_retention_period=None, min_retention_period=None, name='8239ccb8-483c-4129-8319-880234387fbd', nfs_interop_flags='BOTH_NFS3_AND_NFS4_INTEROP_DISABLED', path='/manila/manila-8239ccb8-483c-4129-8319-880234387fbd', physical_capacity=0, policy='8239ccb8-483c-4129-8319-880234387fbd', policy_id=24, protocols=['NFS'], qos_policy=None, qos_policy_id=None, s3_locks=False, s3_locks_retention_mode='NONE', s3_locks_retention_period='', s3_unverified_lookup=False, s3_versioning=False, select_for_live_monitoring=False, share='', share_acl=Bunch(acl=[], enabled=False), sync='SYNCED', sync_time='2024-05-28T12:57:53.506646Z', tenant_id=1, tenant_name='default', title='/manila/manila-8239ccb8-483c-4129-8319-880234387fbd', url='https://127.0.0.1:40443/api/views/23/')] May 28 12:58:05 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c6945b0a-5f43-478b-ab3a-c1fe10c98bc6 tempest-SnapshotInstancesNegativeTest-1396485679 None] --- [GET] https://127.0.0.1:40443/api/views/: Done May 28 12:58:05 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c6945b0a-5f43-478b-ab3a-c1fe10c98bc6 tempest-SnapshotInstancesNegativeTest-1396485679 None] >>> [DELETE] https://127.0.0.1:40443/api/views/23/ May 28 12:58:05 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-abaf1bed-55d9-4414-800b-59840cf6c994 tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:05 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-abaf1bed-55d9-4414-800b-59840cf6c994 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:05 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-56e811af-e796-4a9d-8605-933cf433f535 tempest-SharesMetadataTest-1561320255 None] Acquiring lock "locked_access_rules_operation_by_share_instance_205d35a8-15b8-4a2f-8214-8c2d1a5de6b0" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:05 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-56e811af-e796-4a9d-8605-933cf433f535 tempest-SharesMetadataTest-1561320255 None] Lock "locked_access_rules_operation_by_share_instance_205d35a8-15b8-4a2f-8214-8c2d1a5de6b0" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:05 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-abaf1bed-55d9-4414-800b-59840cf6c994 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.006s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:05 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-abaf1bed-55d9-4414-800b-59840cf6c994 tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:05 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-abaf1bed-55d9-4414-800b-59840cf6c994 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:05 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-56e811af-e796-4a9d-8605-933cf433f535 tempest-SharesMetadataTest-1561320255 None] Lock "locked_access_rules_operation_by_share_instance_205d35a8-15b8-4a2f-8214-8c2d1a5de6b0" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.019s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:05 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-56e811af-e796-4a9d-8605-933cf433f535 tempest-SharesMetadataTest-1561320255 None] Acquiring lock "locked_access_rules_operation_by_share_instance_205d35a8-15b8-4a2f-8214-8c2d1a5de6b0" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:05 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-56e811af-e796-4a9d-8605-933cf433f535 tempest-SharesMetadataTest-1561320255 None] Lock "locked_access_rules_operation_by_share_instance_205d35a8-15b8-4a2f-8214-8c2d1a5de6b0" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:05 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-56e811af-e796-4a9d-8605-933cf433f535 tempest-SharesMetadataTest-1561320255 None] Lock "locked_access_rules_operation_by_share_instance_205d35a8-15b8-4a2f-8214-8c2d1a5de6b0" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.010s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:05 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-56e811af-e796-4a9d-8605-933cf433f535 tempest-SharesMetadataTest-1561320255 None] Acquiring lock "locked_access_rules_operation_by_share_instance_205d35a8-15b8-4a2f-8214-8c2d1a5de6b0" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:05 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-56e811af-e796-4a9d-8605-933cf433f535 tempest-SharesMetadataTest-1561320255 None] Lock "locked_access_rules_operation_by_share_instance_205d35a8-15b8-4a2f-8214-8c2d1a5de6b0" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:05 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-56e811af-e796-4a9d-8605-933cf433f535 tempest-SharesMetadataTest-1561320255 None] Lock "locked_access_rules_operation_by_share_instance_205d35a8-15b8-4a2f-8214-8c2d1a5de6b0" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.004s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:05 l75lg1-v1 manila-share[98474]: DEBUG manila.share.access [None req-56e811af-e796-4a9d-8605-933cf433f535 tempest-SharesMetadataTest-1561320255 None] All access rules have been synced for share instance 205d35a8-15b8-4a2f-8214-8c2d1a5de6b0 belonging to share c485966a-3cd7-4de5-903f-4b379a6cb450. {{(pid=98474) update_access_rules /opt/stack/manila/manila/share/access.py:304}} May 28 12:58:05 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-56e811af-e796-4a9d-8605-933cf433f535 tempest-SharesMetadataTest-1561320255 None] deleting '/manila/manila-205d35a8-15b8-4a2f-8214-8c2d1a5de6b0' May 28 12:58:05 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-56e811af-e796-4a9d-8605-933cf433f535 tempest-SharesMetadataTest-1561320255 None] >>> [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/ May 28 12:58:05 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-56e811af-e796-4a9d-8605-933cf433f535 tempest-SharesMetadataTest-1561320255 None] {'data': '{"path": "/manila/manila-205d35a8-15b8-4a2f-8214-8c2d1a5de6b0"}', May 28 12:58:05 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-56e811af-e796-4a9d-8605-933cf433f535 tempest-SharesMetadataTest-1561320255 None] 'params': None} May 28 12:58:05 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-abaf1bed-55d9-4414-800b-59840cf6c994 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.060s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:05 l75lg1-v1 manila-share[98474]: DEBUG manila.share.access [None req-abaf1bed-55d9-4414-800b-59840cf6c994 tempest-ShareIpRulesForNFSTest-1748669711 None] Updating access rules for share instance b7a7d61c-2cea-442a-9809-507038e080d5 belonging to share 1ddadc17-cf10-4a42-8bbd-8335fb3520a1. {{(pid=98474) update_access_rules /opt/stack/manila/manila/share/access.py:298}} May 28 12:58:05 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-abaf1bed-55d9-4414-800b-59840cf6c994 tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:05 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-abaf1bed-55d9-4414-800b-59840cf6c994 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:05 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-abaf1bed-55d9-4414-800b-59840cf6c994 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.007s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:05 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-abaf1bed-55d9-4414-800b-59840cf6c994 tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:05 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-abaf1bed-55d9-4414-800b-59840cf6c994 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:05 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-abaf1bed-55d9-4414-800b-59840cf6c994 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.014s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:05 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-abaf1bed-55d9-4414-800b-59840cf6c994 tempest-ShareIpRulesForNFSTest-1748669711 None] changing access on None May 28 12:58:05 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-abaf1bed-55d9-4414-800b-59840cf6c994 tempest-ShareIpRulesForNFSTest-1748669711 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:58:05 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-abaf1bed-55d9-4414-800b-59840cf6c994 tempest-ShareIpRulesForNFSTest-1748669711 None] {'allow_redirects': True, May 28 12:58:05 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-abaf1bed-55d9-4414-800b-59840cf6c994 tempest-ShareIpRulesForNFSTest-1748669711 None] 'params': {'name': 'b7a7d61c-2cea-442a-9809-507038e080d5'}} May 28 12:58:05 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-56e811af-e796-4a9d-8605-933cf433f535 tempest-SharesMetadataTest-1561320255 None] <<< [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/ May 28 12:58:05 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-56e811af-e796-4a9d-8605-933cf433f535 tempest-SharesMetadataTest-1561320255 None] 'OK' May 28 12:58:05 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-56e811af-e796-4a9d-8605-933cf433f535 tempest-SharesMetadataTest-1561320255 None] --- [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/: Done May 28 12:58:05 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-56e811af-e796-4a9d-8605-933cf433f535 tempest-SharesMetadataTest-1561320255 None] >>> [GET] https://127.0.0.1:40443/api/views/ May 28 12:58:05 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-56e811af-e796-4a9d-8605-933cf433f535 tempest-SharesMetadataTest-1561320255 None] {'allow_redirects': True, May 28 12:58:05 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-56e811af-e796-4a9d-8605-933cf433f535 tempest-SharesMetadataTest-1561320255 None] 'params': {'name': '205d35a8-15b8-4a2f-8214-8c2d1a5de6b0'}} May 28 12:58:06 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-abaf1bed-55d9-4414-800b-59840cf6c994 tempest-ShareIpRulesForNFSTest-1748669711 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:58:06 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-abaf1bed-55d9-4414-800b-59840cf6c994 tempest-ShareIpRulesForNFSTest-1748669711 None] [Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=1, created='2024-05-28T12:57:40.763635Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='377955ad-d094-4e49-ab32-1021d943a572', id=21, internal=False, is_s3_default_policy=False, name='b7a7d61c-2cea-442a-9809-507038e080d5', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=['*'], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['*'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['*'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T12:58:04.456317Z', tenant_id=1, tenant_name='default', title='b7a7d61c-2cea-442a-9809-507038e080d5', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/21/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[])] May 28 12:58:06 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-abaf1bed-55d9-4414-800b-59840cf6c994 tempest-ShareIpRulesForNFSTest-1748669711 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 12:58:06 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-56e811af-e796-4a9d-8605-933cf433f535 tempest-SharesMetadataTest-1561320255 None] <<< [GET] https://127.0.0.1:40443/api/views/ May 28 12:58:06 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-56e811af-e796-4a9d-8605-933cf433f535 tempest-SharesMetadataTest-1561320255 None] [Bunch(abac_tags=[], abe_max_depth=None, abe_protocols=[], alias='', allow_anonymous_access=False, allow_s3_anonymous_access=False, auto_commit='0d', bucket='', bucket_creators=[], bucket_creators_groups=[], bucket_owner=None, bulk_permission_update_progress=None, bulk_permission_update_state=None, cluster='loop75-kfs', cluster_id=1, created='2024-05-28T12:58:02.816039Z', enabled=True, files_retention_mode='NONE', guid='d51413c4-aa3c-408a-9313-d2ddd4a49be5', id=24, ignore_oos=False, internal=False, is_remote=False, is_seamless=False, logical_capacity=0, max_retention_period=None, min_retention_period=None, name='205d35a8-15b8-4a2f-8214-8c2d1a5de6b0', nfs_interop_flags='BOTH_NFS3_AND_NFS4_INTEROP_DISABLED', path='/manila/manila-205d35a8-15b8-4a2f-8214-8c2d1a5de6b0', physical_capacity=0, policy='205d35a8-15b8-4a2f-8214-8c2d1a5de6b0', policy_id=25, protocols=['NFS'], qos_policy=None, qos_policy_id=None, s3_locks=False, s3_locks_retention_mode='NONE', s3_locks_retention_period='', s3_unverified_lookup=False, s3_versioning=False, select_for_live_monitoring=False, share='', share_acl=Bunch(acl=[], enabled=False), sync='SYNCED', sync_time='2024-05-28T12:58:03.124811Z', tenant_id=1, tenant_name='default', title='/manila/manila-205d35a8-15b8-4a2f-8214-8c2d1a5de6b0', url='https://127.0.0.1:40443/api/views/24/')] May 28 12:58:06 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-56e811af-e796-4a9d-8605-933cf433f535 tempest-SharesMetadataTest-1561320255 None] --- [GET] https://127.0.0.1:40443/api/views/: Done May 28 12:58:06 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-56e811af-e796-4a9d-8605-933cf433f535 tempest-SharesMetadataTest-1561320255 None] >>> [DELETE] https://127.0.0.1:40443/api/views/24/ May 28 12:58:06 l75lg1-v1 dstat.sh[49771]: 28-05 12:58:06| 6 1 93 1 0|5709M 1777M 277M 7862M| 25k 6281B| 0 788k| 0 87.0 |3156 5104 |1.50 1.09 1.02|1.0 0 0| 0 0 | 0 2048M| 29 357 0 62 0 May 28 12:58:06 l75lg1-v1 manila-share[98474]: ERROR manila.share.drivers.vastdata [None req-abaf1bed-55d9-4414-800b-59840cf6c994 tempest-ShareIpRulesForNFSTest-1748669711 None] failed to resolve host '203.0.113.0/24': [Errno -2] Name or service not known (ignoring): socket.gaierror: [Errno -2] Name or service not known May 28 12:58:06 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-abaf1bed-55d9-4414-800b-59840cf6c994 tempest-ShareIpRulesForNFSTest-1748669711 None] changing access on /manila/manila-b7a7d61c-2cea-442a-9809-507038e080d5. Rules: {'nfs_read_write': ['*'], 'nfs_read_only': []} May 28 12:58:06 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-abaf1bed-55d9-4414-800b-59840cf6c994 tempest-ShareIpRulesForNFSTest-1748669711 None] >>> [PATCH] https://127.0.0.1:40443/api/viewpolicies/21/ May 28 12:58:06 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-abaf1bed-55d9-4414-800b-59840cf6c994 tempest-ShareIpRulesForNFSTest-1748669711 None] {'data': '{"name": "b7a7d61c-2cea-442a-9809-507038e080d5", "nfs_no_squash": ' May 28 12:58:06 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-abaf1bed-55d9-4414-800b-59840cf6c994 tempest-ShareIpRulesForNFSTest-1748669711 None] '["*"], "nfs_root_squash": ["*"], "nfs_read_write": ["*"], ' May 28 12:58:06 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-abaf1bed-55d9-4414-800b-59840cf6c994 tempest-ShareIpRulesForNFSTest-1748669711 None] '"nfs_read_only": []}', May 28 12:58:06 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-abaf1bed-55d9-4414-800b-59840cf6c994 tempest-ShareIpRulesForNFSTest-1748669711 None] 'params': None} May 28 12:58:06 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1329f217-bf7f-4692-b354-ac9b72606999 tempest-ResourceLockCRUTest-1971036144 None] <<< [POST] https://127.0.0.1:40443/api/views/ May 28 12:58:06 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1329f217-bf7f-4692-b354-ac9b72606999 tempest-ResourceLockCRUTest-1971036144 None] Bunch(abac_tags=[], abe_max_depth=None, abe_protocols=[], alias='', allow_anonymous_access=False, allow_s3_anonymous_access=False, auto_commit='0d', bucket='', bucket_creators=[], bucket_creators_groups=[], bucket_owner=None, bulk_permission_update_progress=None, bulk_permission_update_state=None, cluster='loop75-kfs', cluster_id=1, created='2024-05-28T12:58:06.215642Z', enabled=True, files_retention_mode='NONE', guid='8de59abe-ebe8-4bcc-806a-4252660541eb', id=25, ignore_oos=False, internal=False, is_remote=False, is_seamless=False, logical_capacity=0, max_retention_period=None, min_retention_period=None, name='5de0f734-b2f4-4d05-8249-81f9d2973a8a', nfs_interop_flags='BOTH_NFS3_AND_NFS4_INTEROP_DISABLED', path='/manila/manila-5de0f734-b2f4-4d05-8249-81f9d2973a8a', physical_capacity=0, policy='5de0f734-b2f4-4d05-8249-81f9d2973a8a', policy_id=26, protocols=['NFS'], qos_policy=None, qos_policy_id=None, s3_locks=False, s3_locks_retention_mode='NONE', s3_locks_retention_period='', s3_object_ownership_rule='ObjectWriter', s3_unverified_lookup=False, s3_versioning=False, select_for_live_monitoring=False, share='', share_acl=Bunch(acl=[], enabled=False), sync='SYNCED', sync_time='2024-05-28T12:58:06.465769Z', tenant_id=1, tenant_name='default', title='/manila/manila-5de0f734-b2f4-4d05-8249-81f9d2973a8a', url='https://127.0.0.1:40443/api/views/25/') May 28 12:58:06 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1329f217-bf7f-4692-b354-ac9b72606999 tempest-ResourceLockCRUTest-1971036144 None] --- [POST] https://127.0.0.1:40443/api/views/: Done May 28 12:58:06 l75lg1-v1 manila-share[98474]: INFO manila.share.manager [None req-1329f217-bf7f-4692-b354-ac9b72606999 tempest-ResourceLockCRUTest-1971036144 None] Share instance 5de0f734-b2f4-4d05-8249-81f9d2973a8a created successfully. May 28 12:58:07 l75lg1-v1 dstat.sh[49771]: 28-05 12:58:07| 1 0 98 0 0|5709M 1777M 277M 7862M| 24k 1609B| 0 660k| 0 66.0 |2080 3232 |1.37 1.07 1.01|1.0 0 0| 0 0 | 0 2048M| 29 357 0 62 0 May 28 12:58:07 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e83d93d7-61fc-499c-aada-ef8cfc584125 tempest-AdminActionsTest-1749172189 None] <<< [POST] https://127.0.0.1:40443/api/snapshots/ May 28 12:58:07 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e83d93d7-61fc-499c-aada-ef8cfc584125 tempest-AdminActionsTest-1749172189 None] Bunch(access_path='/.vast_all_snapshots/1000000007_share-snapshot-be7ae42b-274e-4c6c-9e06-cbf16268cf26', aggr_phys_estimation=0, cluster='loop75-kfs', created='2024-05-28T12:58:05.291486Z', eta_sec=30819898910.603302, expiration_time='3001-01-19T07:59:58Z', guid='97a609d2-af81-4195-8bf9-945d87717590', id=8, indestructible=False, locked=False, name='share-snapshot-be7ae42b-274e-4c6c-9e06-cbf16268cf26', path='/manila/manila-77a25e6b-f137-4342-8eb9-9ced679515e2/', policy=None, policy_id=None, protection_policy_id=None, state='SUCCEED', tenant_id=1, tenant_name='default', title='share-snapshot-be7ae42b-274e-4c6c-9e06-cbf16268cf26(/manila/manila-77a25e6b-f137-4342-8eb9-9ced679515e2/)', type='local', unique_phys_estimation=0, url='https://127.0.0.1:40443/api/snapshots/8/') May 28 12:58:07 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e83d93d7-61fc-499c-aada-ef8cfc584125 tempest-AdminActionsTest-1749172189 None] --- [POST] https://127.0.0.1:40443/api/snapshots/: Done May 28 12:58:07 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c6945b0a-5f43-478b-ab3a-c1fe10c98bc6 tempest-SnapshotInstancesNegativeTest-1396485679 None] <<< [DELETE] https://127.0.0.1:40443/api/views/23/ May 28 12:58:07 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c6945b0a-5f43-478b-ab3a-c1fe10c98bc6 tempest-SnapshotInstancesNegativeTest-1396485679 None] --- [DELETE] https://127.0.0.1:40443/api/views/23/: Done May 28 12:58:07 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c6945b0a-5f43-478b-ab3a-c1fe10c98bc6 tempest-SnapshotInstancesNegativeTest-1396485679 None] >>> [GET] https://127.0.0.1:40443/api/quotas/ May 28 12:58:07 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c6945b0a-5f43-478b-ab3a-c1fe10c98bc6 tempest-SnapshotInstancesNegativeTest-1396485679 None] {'allow_redirects': True, May 28 12:58:07 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c6945b0a-5f43-478b-ab3a-c1fe10c98bc6 tempest-SnapshotInstancesNegativeTest-1396485679 None] 'params': {'name': '8239ccb8-483c-4129-8319-880234387fbd'}} May 28 12:58:07 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-3dc0a065-7d9f-40f1-82a3-f2937e78c85e tempest-SnapshotInstancesNegativeTest-1396485679 tempest-SnapshotInstancesNegativeTest-1396485679-project-admin] GET http://10.27.203.238/share/v2/c9cc76ecb4e343a6a51bf36da01debf8/shares/59371a98-d4b3-4967-9846-4759c0b33bb2 May 28 12:58:07 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-3dc0a065-7d9f-40f1-82a3-f2937e78c85e tempest-SnapshotInstancesNegativeTest-1396485679 tempest-SnapshotInstancesNegativeTest-1396485679-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:07 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-3dc0a065-7d9f-40f1-82a3-f2937e78c85e tempest-SnapshotInstancesNegativeTest-1396485679 tempest-SnapshotInstancesNegativeTest-1396485679-project-admin] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:07 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-3dc0a065-7d9f-40f1-82a3-f2937e78c85e tempest-SnapshotInstancesNegativeTest-1396485679 tempest-SnapshotInstancesNegativeTest-1396485679-project-admin] http://10.27.203.238/share/v2/c9cc76ecb4e343a6a51bf36da01debf8/shares/59371a98-d4b3-4967-9846-4759c0b33bb2 returned with HTTP 200 May 28 12:58:07 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 468/944] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:58:07 2024] GET /share/v2/c9cc76ecb4e343a6a51bf36da01debf8/shares/59371a98-d4b3-4967-9846-4759c0b33bb2 => generated 1368 bytes in 31 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:58:07 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-7371952d-dda7-4013-b522-0e1531fc99a4 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] GET http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/snapshots/b3972da7-eb1f-4370-abf4-b7f9402afb30 May 28 12:58:07 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-7371952d-dda7-4013-b522-0e1531fc99a4 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:07 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-7371952d-dda7-4013-b522-0e1531fc99a4 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Calling method 'ShareSnapshotMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:07 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-2d9ec46f-0c2b-4939-b5f3-f1f98aa40096 tempest-ResourceLockCRUTest-1971036144 tempest-ResourceLockCRUTest-1971036144-project-member] GET http://10.27.203.238/share/v2/82840ccb77144a4aa2d0bdce807ce686/shares/071c2e61-b4b6-48bf-a1f2-c20b233560ed May 28 12:58:07 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-2d9ec46f-0c2b-4939-b5f3-f1f98aa40096 tempest-ResourceLockCRUTest-1971036144 tempest-ResourceLockCRUTest-1971036144-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:07 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-2d9ec46f-0c2b-4939-b5f3-f1f98aa40096 tempest-ResourceLockCRUTest-1971036144 tempest-ResourceLockCRUTest-1971036144-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:07 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-7371952d-dda7-4013-b522-0e1531fc99a4 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/snapshots/b3972da7-eb1f-4370-abf4-b7f9402afb30 returned with HTTP 200 May 28 12:58:07 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 477/945] 10.27.203.238 () {64 vars in 1460 bytes} [Tue May 28 12:58:07 2024] GET /share/v2/a3499cb78849424db45e54caac01de92/snapshots/b3972da7-eb1f-4370-abf4-b7f9402afb30 => generated 750 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:58:07 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-f074c106-819a-4ea4-8996-c97d6ea1418b tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] POST http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/snapshots/b3972da7-eb1f-4370-abf4-b7f9402afb30/action May 28 12:58:07 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-f074c106-819a-4ea4-8996-c97d6ea1418b tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Action body: b'{"reset_status": {"status": "available"}}' {{(pid=98329) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:58:07 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-f074c106-819a-4ea4-8996-c97d6ea1418b tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Action: 'action', calling method: ShareSnapshotsController.snapshot_reset_status, body: {"reset_status": {"status": "available"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:58:07 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-f074c106-819a-4ea4-8996-c97d6ea1418b tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Updating share_snapshot 'b3972da7-eb1f-4370-abf4-b7f9402afb30' with '{'status': 'available'}' {{(pid=98329) _reset_status /opt/stack/manila/manila/api/openstack/wsgi.py:1257}} May 28 12:58:07 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-2d9ec46f-0c2b-4939-b5f3-f1f98aa40096 tempest-ResourceLockCRUTest-1971036144 tempest-ResourceLockCRUTest-1971036144-project-member] http://10.27.203.238/share/v2/82840ccb77144a4aa2d0bdce807ce686/shares/071c2e61-b4b6-48bf-a1f2-c20b233560ed returned with HTTP 200 May 28 12:58:07 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 469/946] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:58:07 2024] GET /share/v2/82840ccb77144a4aa2d0bdce807ce686/shares/071c2e61-b4b6-48bf-a1f2-c20b233560ed => generated 1319 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:58:07 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-bcaedc6e-0357-429f-91b9-c392c9e61b6f tempest-ResourceLockCRUTest-1971036144 tempest-ResourceLockCRUTest-1971036144-project-member] POST http://10.27.203.238/share/v2/82840ccb77144a4aa2d0bdce807ce686/resource-locks May 28 12:58:07 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-bcaedc6e-0357-429f-91b9-c392c9e61b6f tempest-ResourceLockCRUTest-1971036144 tempest-ResourceLockCRUTest-1971036144-project-member] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"resource_lock": {"resource_id": "071c2e61-b4b6-48bf-a1f2-c20b233560ed", "resource_type": "share", "resource_action": "delete", "lock_reason": "locked by tempest tests"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:58:08 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-bcaedc6e-0357-429f-91b9-c392c9e61b6f tempest-ResourceLockCRUTest-1971036144 tempest-ResourceLockCRUTest-1971036144-project-member] http://10.27.203.238/share/v2/82840ccb77144a4aa2d0bdce807ce686/resource-locks returned with HTTP 200 May 28 12:58:08 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 470/947] 10.27.203.238 () {66 vars in 1386 bytes} [Tue May 28 12:58:07 2024] POST /share/v2/82840ccb77144a4aa2d0bdce807ce686/resource-locks => generated 700 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 231 bytes (2 switches on core 0) May 28 12:58:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa1294d-e32b-4e8f-a39e-a4f7fd4eb1e3 service manila] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa1294d-e32b-4e8f-a39e-a4f7fd4eb1e3 service manila] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ed080c-0302-402b-bc91-9ff2746a3660 tempest-ResourceLockCRUTest-1063854601 tempest-ResourceLockCRUTest-1063854601-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cacdef9ca5d04afb85fa43f2d0e57632', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bcb84add5bc4d8cb675498201734b6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ed080c-0302-402b-bc91-9ff2746a3660 tempest-ResourceLockCRUTest-1063854601 tempest-ResourceLockCRUTest-1063854601-project-admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ed080c-0302-402b-bc91-9ff2746a3660 tempest-ResourceLockCRUTest-1063854601 tempest-ResourceLockCRUTest-1063854601-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ed080c-0302-402b-bc91-9ff2746a3660 tempest-ResourceLockCRUTest-1063854601 tempest-ResourceLockCRUTest-1063854601-project-admin] PATH_INFO: `/v3/projects/82840ccb77144a4aa2d0bdce807ce686` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:08 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-f074c106-819a-4ea4-8996-c97d6ea1418b tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/snapshots/b3972da7-eb1f-4370-abf4-b7f9402afb30/action returned with HTTP 202 May 28 12:58:08 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 478/948] 10.27.203.238 () {66 vars in 1502 bytes} [Tue May 28 12:58:07 2024] POST /share/v2/a3499cb78849424db45e54caac01de92/snapshots/b3972da7-eb1f-4370-abf4-b7f9402afb30/action => generated 0 bytes in 72 msecs (HTTP/1.1 202) 6 headers in 243 bytes (2 switches on core 0) May 28 12:58:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ed080c-0302-402b-bc91-9ff2746a3660 tempest-ResourceLockCRUTest-1063854601 tempest-ResourceLockCRUTest-1063854601-project-admin] RBAC: Authorizing `identity:get_project(project_id=82840ccb77144a4aa2d0bdce807ce686)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ed080c-0302-402b-bc91-9ff2746a3660 tempest-ResourceLockCRUTest-1063854601 tempest-ResourceLockCRUTest-1063854601-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:08 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1059/2141] 10.27.203.238 () {62 vars in 1318 bytes} [Tue May 28 12:58:08 2024] GET /identity/v3/projects/82840ccb77144a4aa2d0bdce807ce686 => generated 377 bytes in 17 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:58:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10a5eae-4f77-4354-98b2-274ec7cd91fc service manila] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:08 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-710d7001-1e89-494a-869b-a81004ec54b5 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] GET http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/snapshots/b3972da7-eb1f-4370-abf4-b7f9402afb30 May 28 12:58:08 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-710d7001-1e89-494a-869b-a81004ec54b5 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:08 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-710d7001-1e89-494a-869b-a81004ec54b5 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Calling method 'ShareSnapshotMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10a5eae-4f77-4354-98b2-274ec7cd91fc service manila] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8e7ab3-e6ee-4e2a-b3a4-694bcc28accb tempest-ResourceLockCRUTest-1063854601 tempest-ResourceLockCRUTest-1063854601-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cacdef9ca5d04afb85fa43f2d0e57632', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bcb84add5bc4d8cb675498201734b6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8e7ab3-e6ee-4e2a-b3a4-694bcc28accb tempest-ResourceLockCRUTest-1063854601 tempest-ResourceLockCRUTest-1063854601-project-admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8e7ab3-e6ee-4e2a-b3a4-694bcc28accb tempest-ResourceLockCRUTest-1063854601 tempest-ResourceLockCRUTest-1063854601-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8e7ab3-e6ee-4e2a-b3a4-694bcc28accb tempest-ResourceLockCRUTest-1063854601 tempest-ResourceLockCRUTest-1063854601-project-admin] PATH_INFO: `/v3/domains` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8e7ab3-e6ee-4e2a-b3a4-694bcc28accb tempest-ResourceLockCRUTest-1063854601 tempest-ResourceLockCRUTest-1063854601-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=51267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:58:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8e7ab3-e6ee-4e2a-b3a4-694bcc28accb tempest-ResourceLockCRUTest-1063854601 tempest-ResourceLockCRUTest-1063854601-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8e7ab3-e6ee-4e2a-b3a4-694bcc28accb tempest-ResourceLockCRUTest-1063854601 tempest-ResourceLockCRUTest-1063854601-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:08 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1083/2142] 10.27.203.238 () {62 vars in 1241 bytes} [Tue May 28 12:58:08 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:58:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ed080c-0302-402b-bc91-9ff2746a3660 tempest-ResourceLockCRUTest-1063854601 tempest-ResourceLockCRUTest-1063854601-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ed080c-0302-402b-bc91-9ff2746a3660 tempest-ResourceLockCRUTest-1063854601 tempest-ResourceLockCRUTest-1063854601-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaa9279-8547-4bec-8932-fe6dc11bb622 tempest-ResourceLockCRUTest-1063854601 tempest-ResourceLockCRUTest-1063854601-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cacdef9ca5d04afb85fa43f2d0e57632', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bcb84add5bc4d8cb675498201734b6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaa9279-8547-4bec-8932-fe6dc11bb622 tempest-ResourceLockCRUTest-1063854601 tempest-ResourceLockCRUTest-1063854601-project-admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaa9279-8547-4bec-8932-fe6dc11bb622 tempest-ResourceLockCRUTest-1063854601 tempest-ResourceLockCRUTest-1063854601-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaa9279-8547-4bec-8932-fe6dc11bb622 tempest-ResourceLockCRUTest-1063854601 tempest-ResourceLockCRUTest-1063854601-project-admin] PATH_INFO: `/v3/users` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:08 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-710d7001-1e89-494a-869b-a81004ec54b5 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/snapshots/b3972da7-eb1f-4370-abf4-b7f9402afb30 returned with HTTP 200 May 28 12:58:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbaa9279-8547-4bec-8932-fe6dc11bb622 tempest-ResourceLockCRUTest-1063854601 tempest-ResourceLockCRUTest-1063854601-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:08 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 471/949] 10.27.203.238 () {64 vars in 1460 bytes} [Tue May 28 12:58:08 2024] GET /share/v2/a3499cb78849424db45e54caac01de92/snapshots/b3972da7-eb1f-4370-abf4-b7f9402afb30 => generated 750 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:58:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbaa9279-8547-4bec-8932-fe6dc11bb622 tempest-ResourceLockCRUTest-1063854601 tempest-ResourceLockCRUTest-1063854601-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:08 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-bbaa9279-8547-4bec-8932-fe6dc11bb622 tempest-ResourceLockCRUTest-1063854601 tempest-ResourceLockCRUTest-1063854601-project-admin] Truncating password to algorithm specific maximum length 72 characters. May 28 12:58:08 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-af866734-93a2-4e76-8b23-c6304303dacf tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] POST http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/snapshots/b3972da7-eb1f-4370-abf4-b7f9402afb30/action May 28 12:58:08 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-af866734-93a2-4e76-8b23-c6304303dacf tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Action body: b'{"reset_status": {"status": "available"}}' {{(pid=98329) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:58:08 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-af866734-93a2-4e76-8b23-c6304303dacf tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Action: 'action', calling method: ShareSnapshotsController.snapshot_reset_status, body: {"reset_status": {"status": "available"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:58:08 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-af866734-93a2-4e76-8b23-c6304303dacf tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Updating share_snapshot 'b3972da7-eb1f-4370-abf4-b7f9402afb30' with '{'status': 'available'}' {{(pid=98329) _reset_status /opt/stack/manila/manila/api/openstack/wsgi.py:1257}} May 28 12:58:08 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1060/2143] 10.27.203.238 () {64 vars in 1232 bytes} [Tue May 28 12:58:08 2024] POST /identity/v3/users => generated 435 bytes in 35 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:58:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8e7ab3-e6ee-4e2a-b3a4-694bcc28accb tempest-ResourceLockCRUTest-1063854601 tempest-ResourceLockCRUTest-1063854601-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8e7ab3-e6ee-4e2a-b3a4-694bcc28accb tempest-ResourceLockCRUTest-1063854601 tempest-ResourceLockCRUTest-1063854601-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccafb6a-9ab7-4612-8959-4302a8318b68 tempest-ResourceLockCRUTest-1063854601 tempest-ResourceLockCRUTest-1063854601-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cacdef9ca5d04afb85fa43f2d0e57632', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bcb84add5bc4d8cb675498201734b6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccafb6a-9ab7-4612-8959-4302a8318b68 tempest-ResourceLockCRUTest-1063854601 tempest-ResourceLockCRUTest-1063854601-project-admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccafb6a-9ab7-4612-8959-4302a8318b68 tempest-ResourceLockCRUTest-1063854601 tempest-ResourceLockCRUTest-1063854601-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccafb6a-9ab7-4612-8959-4302a8318b68 tempest-ResourceLockCRUTest-1063854601 tempest-ResourceLockCRUTest-1063854601-project-admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccafb6a-9ab7-4612-8959-4302a8318b68 tempest-ResourceLockCRUTest-1063854601 tempest-ResourceLockCRUTest-1063854601-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccafb6a-9ab7-4612-8959-4302a8318b68 tempest-ResourceLockCRUTest-1063854601 tempest-ResourceLockCRUTest-1063854601-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:08 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1084/2144] 10.27.203.238 () {62 vars in 1210 bytes} [Tue May 28 12:58:08 2024] GET /identity/v3/roles => generated 1680 bytes in 18 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:58:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaa9279-8547-4bec-8932-fe6dc11bb622 tempest-ResourceLockCRUTest-1063854601 tempest-ResourceLockCRUTest-1063854601-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:08 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-abaf1bed-55d9-4414-800b-59840cf6c994 tempest-ShareIpRulesForNFSTest-1748669711 None] <<< [PATCH] https://127.0.0.1:40443/api/viewpolicies/21/ May 28 12:58:08 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-abaf1bed-55d9-4414-800b-59840cf6c994 tempest-ShareIpRulesForNFSTest-1748669711 None] Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=1, created='2024-05-28T12:57:40.763635Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='377955ad-d094-4e49-ab32-1021d943a572', id=21, internal=False, is_s3_default_policy=False, name='b7a7d61c-2cea-442a-9809-507038e080d5', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=['*'], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['*'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['*'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='MODIFYING', sync_time='2024-05-28T12:58:07.554029Z', tenant_id=1, tenant_name='default', title='b7a7d61c-2cea-442a-9809-507038e080d5', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/21/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[]) May 28 12:58:08 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-abaf1bed-55d9-4414-800b-59840cf6c994 tempest-ShareIpRulesForNFSTest-1748669711 None] --- [PATCH] https://127.0.0.1:40443/api/viewpolicies/21/: Done May 28 12:58:08 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-abaf1bed-55d9-4414-800b-59840cf6c994 tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:08 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-abaf1bed-55d9-4414-800b-59840cf6c994 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaa9279-8547-4bec-8932-fe6dc11bb622 tempest-ResourceLockCRUTest-1063854601 tempest-ResourceLockCRUTest-1063854601-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713b97dc-e747-4539-a60a-1da0656203e3 tempest-ResourceLockCRUTest-1063854601 tempest-ResourceLockCRUTest-1063854601-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cacdef9ca5d04afb85fa43f2d0e57632', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bcb84add5bc4d8cb675498201734b6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713b97dc-e747-4539-a60a-1da0656203e3 tempest-ResourceLockCRUTest-1063854601 tempest-ResourceLockCRUTest-1063854601-project-admin] REQUEST_METHOD: `PUT` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713b97dc-e747-4539-a60a-1da0656203e3 tempest-ResourceLockCRUTest-1063854601 tempest-ResourceLockCRUTest-1063854601-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713b97dc-e747-4539-a60a-1da0656203e3 tempest-ResourceLockCRUTest-1063854601 tempest-ResourceLockCRUTest-1063854601-project-admin] PATH_INFO: `/v3/projects/82840ccb77144a4aa2d0bdce807ce686/users/2889a927897c49bd92a0d1cfdf27e7f5/roles/44620cad10ae407c90c91e2c296adb04` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:08 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-af866734-93a2-4e76-8b23-c6304303dacf tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/snapshots/b3972da7-eb1f-4370-abf4-b7f9402afb30/action returned with HTTP 202 May 28 12:58:08 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 479/950] 10.27.203.238 () {66 vars in 1502 bytes} [Tue May 28 12:58:08 2024] POST /share/v2/a3499cb78849424db45e54caac01de92/snapshots/b3972da7-eb1f-4370-abf4-b7f9402afb30/action => generated 0 bytes in 69 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:58:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713b97dc-e747-4539-a60a-1da0656203e3 tempest-ResourceLockCRUTest-1063854601 tempest-ResourceLockCRUTest-1063854601-project-admin] RBAC: Authorizing `identity:create_grant(project_id=82840ccb77144a4aa2d0bdce807ce686, user_id=2889a927897c49bd92a0d1cfdf27e7f5, role_id=44620cad10ae407c90c91e2c296adb04)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713b97dc-e747-4539-a60a-1da0656203e3 tempest-ResourceLockCRUTest-1063854601 tempest-ResourceLockCRUTest-1063854601-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:08 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-ef59f99b-8799-4744-b37a-24e20408ceda tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] GET http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/snapshots/b3972da7-eb1f-4370-abf4-b7f9402afb30 May 28 12:58:08 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-ef59f99b-8799-4744-b37a-24e20408ceda tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:08 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-ef59f99b-8799-4744-b37a-24e20408ceda tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Calling method 'ShareSnapshotMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:08 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1061/2145] 10.27.203.238 () {64 vars in 1571 bytes} [Tue May 28 12:58:08 2024] PUT /identity/v3/projects/82840ccb77144a4aa2d0bdce807ce686/users/2889a927897c49bd92a0d1cfdf27e7f5/roles/44620cad10ae407c90c91e2c296adb04 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:58:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efa86ca-4497-4343-bfd3-8571f2c56e62 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efa86ca-4497-4343-bfd3-8571f2c56e62 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efa86ca-4497-4343-bfd3-8571f2c56e62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:08 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-8efa86ca-4497-4343-bfd3-8571f2c56e62 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:58:08 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-ef59f99b-8799-4744-b37a-24e20408ceda tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/snapshots/b3972da7-eb1f-4370-abf4-b7f9402afb30 returned with HTTP 200 May 28 12:58:08 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 472/951] 10.27.203.238 () {64 vars in 1460 bytes} [Tue May 28 12:58:08 2024] GET /share/v2/a3499cb78849424db45e54caac01de92/snapshots/b3972da7-eb1f-4370-abf4-b7f9402afb30 => generated 750 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:58:08 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-75fa9c04-51ee-441f-b48c-45fd253a49a3 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] POST http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/snapshots May 28 12:58:08 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-75fa9c04-51ee-441f-b48c-45fd253a49a3 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Action: 'create', calling method: ShareSnapshotMixin.create, body: {"snapshot": {"name": "tempest-tempest-created-share-snap-2058056916", "force": false, "description": "Tempest's snapshot", "share_id": "df0ea844-5fc1-4d04-8afb-5048ec5dc33f"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:58:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-8efa86ca-4497-4343-bfd3-8571f2c56e62 None None] MFA Rules not processed for user `2889a927897c49bd92a0d1cfdf27e7f5`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:58:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-8efa86ca-4497-4343-bfd3-8571f2c56e62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:58:08 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-abaf1bed-55d9-4414-800b-59840cf6c994 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.070s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:08 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-abaf1bed-55d9-4414-800b-59840cf6c994 tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:08 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-abaf1bed-55d9-4414-800b-59840cf6c994 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:08 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-abaf1bed-55d9-4414-800b-59840cf6c994 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:08 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-abaf1bed-55d9-4414-800b-59840cf6c994 tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:08 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-abaf1bed-55d9-4414-800b-59840cf6c994 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:08 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-abaf1bed-55d9-4414-800b-59840cf6c994 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.004s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:08 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-abaf1bed-55d9-4414-800b-59840cf6c994 tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:08 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-abaf1bed-55d9-4414-800b-59840cf6c994 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:08 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-abaf1bed-55d9-4414-800b-59840cf6c994 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:08 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-abaf1bed-55d9-4414-800b-59840cf6c994 tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:08 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-abaf1bed-55d9-4414-800b-59840cf6c994 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:08 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.v1.share_snapshots [None req-75fa9c04-51ee-441f-b48c-45fd253a49a3 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Create snapshot from share df0ea844-5fc1-4d04-8afb-5048ec5dc33f May 28 12:58:08 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c6945b0a-5f43-478b-ab3a-c1fe10c98bc6 tempest-SnapshotInstancesNegativeTest-1396485679 None] <<< [GET] https://127.0.0.1:40443/api/quotas/ May 28 12:58:08 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c6945b0a-5f43-478b-ab3a-c1fe10c98bc6 tempest-SnapshotInstancesNegativeTest-1396485679 None] [Bunch(cluster='loop75-kfs', cluster_id=1, default_email=None, default_group_quota=None, default_user_quota=None, enable_alarms=True, enable_email_providers=True, grace_period=None, guid='62480c7b-db05-4eca-9eea-6dde72a10b88', hard_limit=1073741824, hard_limit_inodes=None, id=21, internal=False, is_user_quota=False, last_user_quotas_update=None, name='8239ccb8-483c-4129-8319-880234387fbd', num_blocked_users=0, num_exceeded_users=0, path='/manila/manila-8239ccb8-483c-4129-8319-880234387fbd', percent_capacity=0, percent_inodes=None, pretty_grace_period=None, pretty_grace_period_expiration=None, pretty_state='OK (CREATED)', soft_limit=None, soft_limit_inodes=None, state='OK', sync_state='CREATED', system_id=21, tenant_id=1, tenant_name='default', time_to_block=None, title='8239ccb8-483c-4129-8319-880234387fbd', url='https://127.0.0.1:40443/api/quotas/21/', used_capacity=0, used_capacity_tb=0.0, used_effective_capacity=0, used_effective_capacity_tb=0.0, used_inodes=0, used_limited_capacity=0)] May 28 12:58:08 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c6945b0a-5f43-478b-ab3a-c1fe10c98bc6 tempest-SnapshotInstancesNegativeTest-1396485679 None] --- [GET] https://127.0.0.1:40443/api/quotas/: Done May 28 12:58:08 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c6945b0a-5f43-478b-ab3a-c1fe10c98bc6 tempest-SnapshotInstancesNegativeTest-1396485679 None] >>> [DELETE] https://127.0.0.1:40443/api/quotas/21/ May 28 12:58:08 l75lg1-v1 dstat.sh[49771]: 28-05 12:58:08| 8 1 89 1 0|5710M 1776M 277M 7862M| 34k 4447B| 0 876k| 0 104 |4363 6943 |1.37 1.07 1.01|2.0 1.0 2.0| 0 0 | 0 2048M| 29 359 0 61 0 May 28 12:58:08 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1085/2146] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:58:08 2024] POST /identity/v3/auth/tokens => generated 3953 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:58:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713b97dc-e747-4539-a60a-1da0656203e3 tempest-ResourceLockCRUTest-1063854601 tempest-ResourceLockCRUTest-1063854601-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-713b97dc-e747-4539-a60a-1da0656203e3 tempest-ResourceLockCRUTest-1063854601 tempest-ResourceLockCRUTest-1063854601-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:58:08 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-abaf1bed-55d9-4414-800b-59840cf6c994 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.055s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:08 l75lg1-v1 manila-share[98474]: INFO manila.share.access [None req-abaf1bed-55d9-4414-800b-59840cf6c994 tempest-ShareIpRulesForNFSTest-1748669711 None] Access rules were successfully modified for share instance b7a7d61c-2cea-442a-9809-507038e080d5 belonging to share 1ddadc17-cf10-4a42-8bbd-8335fb3520a1. May 28 12:58:08 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.quota [None req-75fa9c04-51ee-441f-b48c-45fd253a49a3 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Created reservations ['48f1479e-bb12-4806-8f82-ebda541d9208', '3b4af678-2cf7-4c4f-a035-3a89f2b6b640', 'ea5bc0bf-87b1-44bf-8b3f-82c0e7ff1a87', '9cdac74d-9afb-4136-9518-b2d0dad65bc5'] {{(pid=98329) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 12:58:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713b97dc-e747-4539-a60a-1da0656203e3 tempest-ResourceLockCRUTest-1063854601 tempest-ResourceLockCRUTest-1063854601-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a107e8-3ee7-44d2-8476-cd65947eb904 service manila] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f110cf6300f049c897d0aab63218d1e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a107e8-3ee7-44d2-8476-cd65947eb904 service manila] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a107e8-3ee7-44d2-8476-cd65947eb904 service manila] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a107e8-3ee7-44d2-8476-cd65947eb904 service manila] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a107e8-3ee7-44d2-8476-cd65947eb904 service manila] RBAC: Authorizing `identity:validate_token()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a107e8-3ee7-44d2-8476-cd65947eb904 service manila] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:08 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1062/2147] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 12:58:08 2024] GET /identity/v3/auth/tokens => generated 3953 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 12:58:08 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-ce24d7ae-55e9-4a27-9c2e-eb5c349f0141 tempest-ResourceLockCRUTest-1971036144 tempest-manila_82840ccb77144a4aa2d0bdce807ce686-1758116432] POST http://10.27.203.238/share/v2/82840ccb77144a4aa2d0bdce807ce686/resource-locks May 28 12:58:08 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-ce24d7ae-55e9-4a27-9c2e-eb5c349f0141 tempest-ResourceLockCRUTest-1971036144 tempest-manila_82840ccb77144a4aa2d0bdce807ce686-1758116432] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"resource_lock": {"resource_id": "071c2e61-b4b6-48bf-a1f2-c20b233560ed", "resource_type": "share", "resource_action": "delete", "lock_reason": "locked by tempest tests"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:58:08 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-56e811af-e796-4a9d-8605-933cf433f535 tempest-SharesMetadataTest-1561320255 None] <<< [DELETE] https://127.0.0.1:40443/api/views/24/ May 28 12:58:08 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-56e811af-e796-4a9d-8605-933cf433f535 tempest-SharesMetadataTest-1561320255 None] --- [DELETE] https://127.0.0.1:40443/api/views/24/: Done May 28 12:58:08 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-56e811af-e796-4a9d-8605-933cf433f535 tempest-SharesMetadataTest-1561320255 None] >>> [GET] https://127.0.0.1:40443/api/quotas/ May 28 12:58:08 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-56e811af-e796-4a9d-8605-933cf433f535 tempest-SharesMetadataTest-1561320255 None] {'allow_redirects': True, May 28 12:58:08 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-56e811af-e796-4a9d-8605-933cf433f535 tempest-SharesMetadataTest-1561320255 None] 'params': {'name': '205d35a8-15b8-4a2f-8214-8c2d1a5de6b0'}} May 28 12:58:08 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-ce24d7ae-55e9-4a27-9c2e-eb5c349f0141 tempest-ResourceLockCRUTest-1971036144 tempest-manila_82840ccb77144a4aa2d0bdce807ce686-1758116432] http://10.27.203.238/share/v2/82840ccb77144a4aa2d0bdce807ce686/resource-locks returned with HTTP 200 May 28 12:58:08 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 473/952] 10.27.203.238 () {66 vars in 1386 bytes} [Tue May 28 12:58:08 2024] POST /share/v2/82840ccb77144a4aa2d0bdce807ce686/resource-locks => generated 700 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 231 bytes (2 switches on core 0) May 28 12:58:08 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-6291e3f1-7b23-485f-a63c-e16ce5c691da tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] GET http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/c485966a-3cd7-4de5-903f-4b379a6cb450 May 28 12:58:08 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-6291e3f1-7b23-485f-a63c-e16ce5c691da tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:08 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-6291e3f1-7b23-485f-a63c-e16ce5c691da tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:08 l75lg1-v1 neutron-server[77623]: DEBUG dbcounter [-] [77623] Writing DB stats neutron:SELECT=1 {{(pid=77623) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:58:08 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-6291e3f1-7b23-485f-a63c-e16ce5c691da tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/c485966a-3cd7-4de5-903f-4b379a6cb450 returned with HTTP 200 May 28 12:58:08 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 474/953] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:58:08 2024] GET /share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/c485966a-3cd7-4de5-903f-4b379a6cb450 => generated 1349 bytes in 26 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:58:08 l75lg1-v1 neutron-server[77623]: DEBUG dbcounter [-] [77623] Writing DB stats neutron:SELECT=2 {{(pid=77623) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:58:08 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-371a10d5-6c75-463e-9619-32980cc221d0 tempest-ResourceLockCRUTest-1063854601 tempest-ResourceLockCRUTest-1063854601-project-admin] POST http://10.27.203.238/share/v2/6bcb84add5bc4d8cb675498201734b6d/resource-locks May 28 12:58:08 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-371a10d5-6c75-463e-9619-32980cc221d0 tempest-ResourceLockCRUTest-1063854601 tempest-ResourceLockCRUTest-1063854601-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"resource_lock": {"resource_id": "071c2e61-b4b6-48bf-a1f2-c20b233560ed", "resource_type": "share", "resource_action": "delete", "lock_reason": "locked by tempest tests"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:58:08 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.quota [None req-75fa9c04-51ee-441f-b48c-45fd253a49a3 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Committed reservations ['48f1479e-bb12-4806-8f82-ebda541d9208', '3b4af678-2cf7-4c4f-a035-3a89f2b6b640', 'ea5bc0bf-87b1-44bf-8b3f-82c0e7ff1a87', '9cdac74d-9afb-4136-9518-b2d0dad65bc5'] {{(pid=98329) commit /opt/stack/manila/manila/quota.py:1063}} May 28 12:58:08 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-75fa9c04-51ee-441f-b48c-45fd253a49a3 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/snapshots returned with HTTP 202 May 28 12:58:08 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 480/954] 10.27.203.238 () {66 vars in 1371 bytes} [Tue May 28 12:58:08 2024] POST /share/v2/a3499cb78849424db45e54caac01de92/snapshots => generated 750 bytes in 218 msecs (HTTP/1.1 202) 6 headers in 237 bytes (1 switches on core 0) May 28 12:58:08 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-bd705bbc-9edc-478f-9ca8-50b6b54d601e tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] GET http://10.27.203.238/share/v2/776f75906bc64f8f9316d5aab4b50bf1/share-access-rules?share_id=1ddadc17-cf10-4a42-8bbd-8335fb3520a1 May 28 12:58:08 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-bd705bbc-9edc-478f-9ca8-50b6b54d601e tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:08 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-bd705bbc-9edc-478f-9ca8-50b6b54d601e tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:08 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-371a10d5-6c75-463e-9619-32980cc221d0 tempest-ResourceLockCRUTest-1063854601 tempest-ResourceLockCRUTest-1063854601-project-admin] http://10.27.203.238/share/v2/6bcb84add5bc4d8cb675498201734b6d/resource-locks returned with HTTP 200 May 28 12:58:08 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 475/955] 10.27.203.238 () {66 vars in 1386 bytes} [Tue May 28 12:58:08 2024] POST /share/v2/6bcb84add5bc4d8cb675498201734b6d/resource-locks => generated 701 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:58:08 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.lock.api [None req-bd705bbc-9edc-478f-9ca8-50b6b54d601e tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Searching for locks by: {'resource_id': '3aa6ee8f-37bb-46ff-af45-fc126918db98', 'resource_action': 'show', 'resource_type': 'access_rule'} {{(pid=98329) get_all /opt/stack/manila/manila/lock/api.py:112}} May 28 12:58:08 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-19080b16-781e-46e8-88cb-cf22fbe557c3 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] GET http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/snapshots/61a994a9-64ae-4c8f-9475-6c6a0b8e910b May 28 12:58:08 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-19080b16-781e-46e8-88cb-cf22fbe557c3 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:08 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-19080b16-781e-46e8-88cb-cf22fbe557c3 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Calling method 'ShareSnapshotMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:08 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-bd705bbc-9edc-478f-9ca8-50b6b54d601e tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] http://10.27.203.238/share/v2/776f75906bc64f8f9316d5aab4b50bf1/share-access-rules?share_id=1ddadc17-cf10-4a42-8bbd-8335fb3520a1 returned with HTTP 200 May 28 12:58:08 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 481/956] 10.27.203.238 () {64 vars in 1467 bytes} [Tue May 28 12:58:08 2024] GET /share/v2/776f75906bc64f8f9316d5aab4b50bf1/share-access-rules?share_id=1ddadc17-cf10-4a42-8bbd-8335fb3520a1 => generated 282 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:58:08 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-c3c3d506-69ca-4038-8e85-aaa60b5d5199 tempest-ResourceLockCRUTest-1063854601 tempest-ResourceLockCRUTest-1063854601-project-admin] DELETE http://10.27.203.238/share/v2/6bcb84add5bc4d8cb675498201734b6d/resource-locks/774de095-4624-404a-ba65-e86b52ba219a May 28 12:58:08 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-c3c3d506-69ca-4038-8e85-aaa60b5d5199 tempest-ResourceLockCRUTest-1063854601 tempest-ResourceLockCRUTest-1063854601-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:08 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-c3c3d506-69ca-4038-8e85-aaa60b5d5199 tempest-ResourceLockCRUTest-1063854601 tempest-ResourceLockCRUTest-1063854601-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:08 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-75fa9c04-51ee-441f-b48c-45fd253a49a3 tempest-AdminActionsTest-1749172189 None] >>> [POST] https://127.0.0.1:40443/api/snapshots/ May 28 12:58:08 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-75fa9c04-51ee-441f-b48c-45fd253a49a3 tempest-AdminActionsTest-1749172189 None] {'data': '{"path": "/manila/manila-77a25e6b-f137-4342-8eb9-9ced679515e2", ' May 28 12:58:08 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-75fa9c04-51ee-441f-b48c-45fd253a49a3 tempest-AdminActionsTest-1749172189 None] '"name": "share-snapshot-a36d2987-19ac-4366-b5bb-199a72efcb95"}', May 28 12:58:08 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-75fa9c04-51ee-441f-b48c-45fd253a49a3 tempest-AdminActionsTest-1749172189 None] 'json': None, May 28 12:58:08 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-75fa9c04-51ee-441f-b48c-45fd253a49a3 tempest-AdminActionsTest-1749172189 None] 'params': None} May 28 12:58:08 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-c3c3d506-69ca-4038-8e85-aaa60b5d5199 tempest-ResourceLockCRUTest-1063854601 tempest-ResourceLockCRUTest-1063854601-project-admin] http://10.27.203.238/share/v2/6bcb84add5bc4d8cb675498201734b6d/resource-locks/774de095-4624-404a-ba65-e86b52ba219a returned with HTTP 204 May 28 12:58:08 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 482/957] 10.27.203.238 () {64 vars in 1478 bytes} [Tue May 28 12:58:08 2024] DELETE /share/v2/6bcb84add5bc4d8cb675498201734b6d/resource-locks/774de095-4624-404a-ba65-e86b52ba219a => generated 0 bytes in 26 msecs (HTTP/1.1 204) 6 headers in 245 bytes (1 switches on core 0) May 28 12:58:08 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-19080b16-781e-46e8-88cb-cf22fbe557c3 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/snapshots/61a994a9-64ae-4c8f-9475-6c6a0b8e910b returned with HTTP 200 May 28 12:58:08 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 476/958] 10.27.203.238 () {64 vars in 1460 bytes} [Tue May 28 12:58:08 2024] GET /share/v2/a3499cb78849424db45e54caac01de92/snapshots/61a994a9-64ae-4c8f-9475-6c6a0b8e910b => generated 750 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:58:08 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-09e64b6a-6daa-4f52-9ebe-fca4517715d9 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] POST http://10.27.203.238/share/v2/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action May 28 12:58:08 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-09e64b6a-6daa-4f52-9ebe-fca4517715d9 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Action body: b'{"deny_access": {"access_id": "3aa6ee8f-37bb-46ff-af45-fc126918db98"}}' {{(pid=98329) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:58:08 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-09e64b6a-6daa-4f52-9ebe-fca4517715d9 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Action: 'action', calling method: Controller.__getattribute__..version_select, body: {"deny_access": {"access_id": "3aa6ee8f-37bb-46ff-af45-fc126918db98"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:58:08 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.lock.api [None req-09e64b6a-6daa-4f52-9ebe-fca4517715d9 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Searching for locks by: {'resource_id': '3aa6ee8f-37bb-46ff-af45-fc126918db98', 'resource_action': 'delete'} {{(pid=98329) get_all /opt/stack/manila/manila/lock/api.py:112}} May 28 12:58:08 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-f5cdc4c2-f6ed-43db-93d8-6c17f4dfaacd tempest-ResourceLockCRUTest-1971036144 tempest-manila_82840ccb77144a4aa2d0bdce807ce686-1758116432] DELETE http://10.27.203.238/share/v2/82840ccb77144a4aa2d0bdce807ce686/resource-locks/e303af80-4c99-46cb-ad14-ee77a1dd96ef May 28 12:58:08 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-f5cdc4c2-f6ed-43db-93d8-6c17f4dfaacd tempest-ResourceLockCRUTest-1971036144 tempest-manila_82840ccb77144a4aa2d0bdce807ce686-1758116432] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:08 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-f5cdc4c2-f6ed-43db-93d8-6c17f4dfaacd tempest-ResourceLockCRUTest-1971036144 tempest-manila_82840ccb77144a4aa2d0bdce807ce686-1758116432] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:08 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-f5cdc4c2-f6ed-43db-93d8-6c17f4dfaacd tempest-ResourceLockCRUTest-1971036144 tempest-manila_82840ccb77144a4aa2d0bdce807ce686-1758116432] http://10.27.203.238/share/v2/82840ccb77144a4aa2d0bdce807ce686/resource-locks/e303af80-4c99-46cb-ad14-ee77a1dd96ef returned with HTTP 204 May 28 12:58:08 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 477/959] 10.27.203.238 () {64 vars in 1478 bytes} [Tue May 28 12:58:08 2024] DELETE /share/v2/82840ccb77144a4aa2d0bdce807ce686/resource-locks/e303af80-4c99-46cb-ad14-ee77a1dd96ef => generated 0 bytes in 20 msecs (HTTP/1.1 204) 6 headers in 245 bytes (1 switches on core 0) May 28 12:58:08 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-af1bc79d-fc20-4a89-bba3-fd867771d713 tempest-ResourceLockCRUTest-1971036144 tempest-ResourceLockCRUTest-1971036144-project-member] GET http://10.27.203.238/share/v2/82840ccb77144a4aa2d0bdce807ce686/resource-locks/87ef736f-2afb-4d32-9520-592130b1715a May 28 12:58:08 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-af1bc79d-fc20-4a89-bba3-fd867771d713 tempest-ResourceLockCRUTest-1971036144 tempest-ResourceLockCRUTest-1971036144-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:08 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-af1bc79d-fc20-4a89-bba3-fd867771d713 tempest-ResourceLockCRUTest-1971036144 tempest-ResourceLockCRUTest-1971036144-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:08 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-af1bc79d-fc20-4a89-bba3-fd867771d713 tempest-ResourceLockCRUTest-1971036144 tempest-ResourceLockCRUTest-1971036144-project-member] http://10.27.203.238/share/v2/82840ccb77144a4aa2d0bdce807ce686/resource-locks/87ef736f-2afb-4d32-9520-592130b1715a returned with HTTP 200 May 28 12:58:08 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 478/960] 10.27.203.238 () {64 vars in 1475 bytes} [Tue May 28 12:58:08 2024] GET /share/v2/82840ccb77144a4aa2d0bdce807ce686/resource-locks/87ef736f-2afb-4d32-9520-592130b1715a => generated 700 bytes in 10 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:58:08 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-4113b921-90a3-4098-a232-c0c5baa57122 tempest-ResourceLockCRUTest-1971036144 tempest-ResourceLockCRUTest-1971036144-project-member] GET http://10.27.203.238/share/v2/82840ccb77144a4aa2d0bdce807ce686/resource-locks May 28 12:58:08 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-4113b921-90a3-4098-a232-c0c5baa57122 tempest-ResourceLockCRUTest-1971036144 tempest-ResourceLockCRUTest-1971036144-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:08 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-4113b921-90a3-4098-a232-c0c5baa57122 tempest-ResourceLockCRUTest-1971036144 tempest-ResourceLockCRUTest-1971036144-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:08 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.lock.api [None req-4113b921-90a3-4098-a232-c0c5baa57122 tempest-ResourceLockCRUTest-1971036144 tempest-ResourceLockCRUTest-1971036144-project-member] Searching for locks by: MultiDict([]) {{(pid=98330) get_all /opt/stack/manila/manila/lock/api.py:112}} May 28 12:58:08 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-4113b921-90a3-4098-a232-c0c5baa57122 tempest-ResourceLockCRUTest-1971036144 tempest-ResourceLockCRUTest-1971036144-project-member] http://10.27.203.238/share/v2/82840ccb77144a4aa2d0bdce807ce686/resource-locks returned with HTTP 200 May 28 12:58:08 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 479/961] 10.27.203.238 () {64 vars in 1364 bytes} [Tue May 28 12:58:08 2024] GET /share/v2/82840ccb77144a4aa2d0bdce807ce686/resource-locks => generated 703 bytes in 11 msecs (HTTP/1.1 200) 6 headers in 231 bytes (2 switches on core 0) May 28 12:58:08 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-64aafb71-9d54-476b-bca7-bc167293b7b0 tempest-ResourceLockCRUTest-1971036144 tempest-ResourceLockCRUTest-1971036144-project-member] POST http://10.27.203.238/share/v2/82840ccb77144a4aa2d0bdce807ce686/shares May 28 12:58:08 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-64aafb71-9d54-476b-bca7-bc167293b7b0 tempest-ResourceLockCRUTest-1971036144 tempest-ResourceLockCRUTest-1971036144-project-member] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share": {"share_proto": "nfs", "description": "Tempest's share", "snapshot_id": null, "name": "tempest-tempest-created-share-1991713941", "size": 1, "metadata": {}, "is_public": false, "share_type": "2995b9a5-154c-4e23-8364-c4a157a7537f"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:58:08 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.v1.shares [None req-64aafb71-9d54-476b-bca7-bc167293b7b0 tempest-ResourceLockCRUTest-1971036144 tempest-ResourceLockCRUTest-1971036144-project-member] Create NFS share of 1 GB May 28 12:58:08 l75lg1-v1 devstack@m-api.service[98329]: DEBUG oslo_concurrency.lockutils [None req-09e64b6a-6daa-4f52-9ebe-fca4517715d9 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98329) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:08 l75lg1-v1 devstack@m-api.service[98329]: DEBUG oslo_concurrency.lockutils [None req-09e64b6a-6daa-4f52-9ebe-fca4517715d9 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98329) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:08 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.quota [None req-64aafb71-9d54-476b-bca7-bc167293b7b0 tempest-ResourceLockCRUTest-1971036144 tempest-ResourceLockCRUTest-1971036144-project-member] Created reservations ['e96b2766-d061-4019-a560-0dabf41656e3', 'c68cacf7-196f-4c8c-995f-93d356236a2d', '0b879e29-566e-4e54-82a9-c7c80dfa89af', 'a1c66f6b-0eae-41d8-ab60-25b3a7c0456e'] {{(pid=98330) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 12:58:08 l75lg1-v1 devstack@m-api.service[98329]: DEBUG oslo_concurrency.lockutils [None req-09e64b6a-6daa-4f52-9ebe-fca4517715d9 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.042s {{(pid=98329) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:08 l75lg1-v1 devstack@m-api.service[98329]: DEBUG oslo_concurrency.lockutils [None req-09e64b6a-6daa-4f52-9ebe-fca4517715d9 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98329) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:08 l75lg1-v1 devstack@m-api.service[98329]: DEBUG oslo_concurrency.lockutils [None req-09e64b6a-6daa-4f52-9ebe-fca4517715d9 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98329) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:08 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.quota [None req-64aafb71-9d54-476b-bca7-bc167293b7b0 tempest-ResourceLockCRUTest-1971036144 tempest-ResourceLockCRUTest-1971036144-project-member] Committed reservations ['e96b2766-d061-4019-a560-0dabf41656e3', 'c68cacf7-196f-4c8c-995f-93d356236a2d', '0b879e29-566e-4e54-82a9-c7c80dfa89af', 'a1c66f6b-0eae-41d8-ab60-25b3a7c0456e'] {{(pid=98330) commit /opt/stack/manila/manila/quota.py:1063}} May 28 12:58:08 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-56e811af-e796-4a9d-8605-933cf433f535 tempest-SharesMetadataTest-1561320255 None] <<< [GET] https://127.0.0.1:40443/api/quotas/ May 28 12:58:08 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-56e811af-e796-4a9d-8605-933cf433f535 tempest-SharesMetadataTest-1561320255 None] [Bunch(cluster='loop75-kfs', cluster_id=1, default_email=None, default_group_quota=None, default_user_quota=None, enable_alarms=True, enable_email_providers=True, grace_period=None, guid='91e33e64-2bcd-4f77-9728-391c484342e0', hard_limit=1073741824, hard_limit_inodes=None, id=22, internal=False, is_user_quota=False, last_user_quotas_update=None, name='205d35a8-15b8-4a2f-8214-8c2d1a5de6b0', num_blocked_users=0, num_exceeded_users=0, path='/manila/manila-205d35a8-15b8-4a2f-8214-8c2d1a5de6b0', percent_capacity=0, percent_inodes=None, pretty_grace_period=None, pretty_grace_period_expiration=None, pretty_state='OK (CREATED)', soft_limit=None, soft_limit_inodes=None, state='OK', sync_state='CREATED', system_id=22, tenant_id=1, tenant_name='default', time_to_block=None, title='205d35a8-15b8-4a2f-8214-8c2d1a5de6b0', url='https://127.0.0.1:40443/api/quotas/22/', used_capacity=0, used_capacity_tb=0.0, used_effective_capacity=0, used_effective_capacity_tb=0.0, used_inodes=0, used_limited_capacity=0)] May 28 12:58:08 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-56e811af-e796-4a9d-8605-933cf433f535 tempest-SharesMetadataTest-1561320255 None] --- [GET] https://127.0.0.1:40443/api/quotas/: Done May 28 12:58:08 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-56e811af-e796-4a9d-8605-933cf433f535 tempest-SharesMetadataTest-1561320255 None] >>> [DELETE] https://127.0.0.1:40443/api/quotas/22/ May 28 12:58:08 l75lg1-v1 devstack@m-api.service[98329]: DEBUG oslo_concurrency.lockutils [None req-09e64b6a-6daa-4f52-9ebe-fca4517715d9 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.081s {{(pid=98329) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:08 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-09e64b6a-6daa-4f52-9ebe-fca4517715d9 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] http://10.27.203.238/share/v2/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action returned with HTTP 202 May 28 12:58:08 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 483/962] 10.27.203.238 () {66 vars in 1493 bytes} [Tue May 28 12:58:08 2024] POST /share/v2/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action => generated 0 bytes in 222 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:58:08 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-5603d2e4-4d73-47e6-8ecf-393414e9ecc3 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] GET http://10.27.203.238/share/v2/776f75906bc64f8f9316d5aab4b50bf1/share-access-rules?share_id=1ddadc17-cf10-4a42-8bbd-8335fb3520a1 May 28 12:58:08 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-5603d2e4-4d73-47e6-8ecf-393414e9ecc3 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:08 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-5603d2e4-4d73-47e6-8ecf-393414e9ecc3 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:08 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.host_manager [None req-64aafb71-9d54-476b-bca7-bc167293b7b0 tempest-ResourceLockCRUTest-1971036144 None] Share service is down. (host: l75lg1-v1@generic2). May 28 12:58:08 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.host_manager [None req-64aafb71-9d54-476b-bca7-bc167293b7b0 tempest-ResourceLockCRUTest-1971036144 None] Share service is down. (host: l75lg1-v1@generic1). May 28 12:58:08 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-64aafb71-9d54-476b-bca7-bc167293b7b0 tempest-ResourceLockCRUTest-1971036144 None] Starting with 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:80}} May 28 12:58:08 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-64aafb71-9d54-476b-bca7-bc167293b7b0 tempest-ResourceLockCRUTest-1971036144 None] Filter OnlyHostFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:58:08 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-64aafb71-9d54-476b-bca7-bc167293b7b0 tempest-ResourceLockCRUTest-1971036144 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:58:08 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.capacity [None req-64aafb71-9d54-476b-bca7-bc167293b7b0 tempest-ResourceLockCRUTest-1971036144 None] Space information for share creation on host l75lg1-v1@vast#vast (requested / avail): 1/2079 {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/capacity.py:83}} May 28 12:58:08 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-64aafb71-9d54-476b-bca7-bc167293b7b0 tempest-ResourceLockCRUTest-1971036144 None] Filter CapacityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:58:08 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-64aafb71-9d54-476b-bca7-bc167293b7b0 tempest-ResourceLockCRUTest-1971036144 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:58:08 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-64aafb71-9d54-476b-bca7-bc167293b7b0 tempest-ResourceLockCRUTest-1971036144 None] Driver Filter: Checking host 'l75lg1-v1@vast#vast' {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:37}} May 28 12:58:08 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-64aafb71-9d54-476b-bca7-bc167293b7b0 tempest-ResourceLockCRUTest-1971036144 None] Filter function not set :: passing host. {{(pid=98327) _check_filter_function /opt/stack/manila/manila/scheduler/filters/driver.py:53}} May 28 12:58:08 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-64aafb71-9d54-476b-bca7-bc167293b7b0 tempest-ResourceLockCRUTest-1971036144 None] Result: True {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:40}} May 28 12:58:08 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-64aafb71-9d54-476b-bca7-bc167293b7b0 tempest-ResourceLockCRUTest-1971036144 None] Done checking host 'l75lg1-v1@vast#vast' {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:41}} May 28 12:58:08 l75lg1-v1 manila-share[98474]: DEBUG manila.share.manager [None req-09e64b6a-6daa-4f52-9ebe-fca4517715d9 tempest-ShareIpRulesForNFSTest-1748669711 None] Received request to update access for share instance b7a7d61c-2cea-442a-9809-507038e080d5. {{(pid=98474) update_access_for_instances /opt/stack/manila/manila/share/manager.py:4353}} May 28 12:58:08 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-64aafb71-9d54-476b-bca7-bc167293b7b0 tempest-ResourceLockCRUTest-1971036144 None] Filter DriverFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:58:08 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-64aafb71-9d54-476b-bca7-bc167293b7b0 tempest-ResourceLockCRUTest-1971036144 None] Filter ShareReplicationFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:58:08 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-64aafb71-9d54-476b-bca7-bc167293b7b0 tempest-ResourceLockCRUTest-1971036144 None] Filter CreateFromSnapshotFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:58:08 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-64aafb71-9d54-476b-bca7-bc167293b7b0 tempest-ResourceLockCRUTest-1971036144 None] Filter AffinityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:58:08 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-64aafb71-9d54-476b-bca7-bc167293b7b0 tempest-ResourceLockCRUTest-1971036144 None] Filter AntiAffinityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:58:08 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.drivers.filter [None req-64aafb71-9d54-476b-bca7-bc167293b7b0 tempest-ResourceLockCRUTest-1971036144 None] Filtered share [host: 'l75lg1-v1@vast#vast', free_capacity_gb: 2079.6229242384434, pools: None] {{(pid=98327) _schedule_share /opt/stack/manila/manila/scheduler/drivers/filter.py:268}} May 28 12:58:08 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-64aafb71-9d54-476b-bca7-bc167293b7b0 tempest-ResourceLockCRUTest-1971036144 None] Checking host 'l75lg1-v1@vast#vast' {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:46}} May 28 12:58:08 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.weighers.goodness [None req-64aafb71-9d54-476b-bca7-bc167293b7b0 tempest-ResourceLockCRUTest-1971036144 None] Goodness function not set :: defaulting to minimal goodness rating of 0. May 28 12:58:08 l75lg1-v1 manila-scheduler[98327]: INFO manila.scheduler.weighers.goodness [None req-64aafb71-9d54-476b-bca7-bc167293b7b0 tempest-ResourceLockCRUTest-1971036144 None] Goodness function result for host l75lg1-v1@vast#vast: 0. May 28 12:58:08 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-64aafb71-9d54-476b-bca7-bc167293b7b0 tempest-ResourceLockCRUTest-1971036144 None] Goodness: 0 {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:48}} May 28 12:58:08 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-64aafb71-9d54-476b-bca7-bc167293b7b0 tempest-ResourceLockCRUTest-1971036144 None] Done checking host 'l75lg1-v1@vast#vast' {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:49}} May 28 12:58:08 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.drivers.filter [None req-64aafb71-9d54-476b-bca7-bc167293b7b0 tempest-ResourceLockCRUTest-1971036144 None] Choosing for share: WeighedHost [host: l75lg1-v1@vast#vast, weight: 0.0] {{(pid=98327) _schedule_share /opt/stack/manila/manila/scheduler/drivers/filter.py:274}} May 28 12:58:08 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-64aafb71-9d54-476b-bca7-bc167293b7b0 tempest-ResourceLockCRUTest-1971036144 tempest-ResourceLockCRUTest-1971036144-project-member] http://10.27.203.238/share/v2/82840ccb77144a4aa2d0bdce807ce686/shares returned with HTTP 200 May 28 12:58:08 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 480/963] 10.27.203.238 () {66 vars in 1362 bytes} [Tue May 28 12:58:08 2024] POST /share/v2/82840ccb77144a4aa2d0bdce807ce686/shares => generated 1314 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:58:08 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-c9ee6852-b9db-4da1-b806-f307298df209 tempest-ResourceLockCRUTest-1971036144 tempest-ResourceLockCRUTest-1971036144-project-member] GET http://10.27.203.238/share/v2/82840ccb77144a4aa2d0bdce807ce686/shares/3f6b8420-fc46-47fc-b707-d08dfd01280f May 28 12:58:08 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-c9ee6852-b9db-4da1-b806-f307298df209 tempest-ResourceLockCRUTest-1971036144 tempest-ResourceLockCRUTest-1971036144-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:08 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-c9ee6852-b9db-4da1-b806-f307298df209 tempest-ResourceLockCRUTest-1971036144 tempest-ResourceLockCRUTest-1971036144-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:08 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.lock.api [None req-5603d2e4-4d73-47e6-8ecf-393414e9ecc3 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Searching for locks by: {'resource_id': '3aa6ee8f-37bb-46ff-af45-fc126918db98', 'resource_action': 'show', 'resource_type': 'access_rule'} {{(pid=98329) get_all /opt/stack/manila/manila/lock/api.py:112}} May 28 12:58:08 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-09e64b6a-6daa-4f52-9ebe-fca4517715d9 tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:08 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-09e64b6a-6daa-4f52-9ebe-fca4517715d9 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:08 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-09e64b6a-6daa-4f52-9ebe-fca4517715d9 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:08 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-09e64b6a-6daa-4f52-9ebe-fca4517715d9 tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:08 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-5603d2e4-4d73-47e6-8ecf-393414e9ecc3 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] http://10.27.203.238/share/v2/776f75906bc64f8f9316d5aab4b50bf1/share-access-rules?share_id=1ddadc17-cf10-4a42-8bbd-8335fb3520a1 returned with HTTP 200 May 28 12:58:08 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-09e64b6a-6daa-4f52-9ebe-fca4517715d9 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:08 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 484/964] 10.27.203.238 () {64 vars in 1467 bytes} [Tue May 28 12:58:08 2024] GET /share/v2/776f75906bc64f8f9316d5aab4b50bf1/share-access-rules?share_id=1ddadc17-cf10-4a42-8bbd-8335fb3520a1 => generated 290 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 231 bytes (2 switches on core 0) May 28 12:58:08 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-c9ee6852-b9db-4da1-b806-f307298df209 tempest-ResourceLockCRUTest-1971036144 tempest-ResourceLockCRUTest-1971036144-project-member] http://10.27.203.238/share/v2/82840ccb77144a4aa2d0bdce807ce686/shares/3f6b8420-fc46-47fc-b707-d08dfd01280f returned with HTTP 200 May 28 12:58:08 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 481/965] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:58:08 2024] GET /share/v2/82840ccb77144a4aa2d0bdce807ce686/shares/3f6b8420-fc46-47fc-b707-d08dfd01280f => generated 1314 bytes in 30 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:58:08 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-09e64b6a-6daa-4f52-9ebe-fca4517715d9 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.090s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:08 l75lg1-v1 manila-share[98474]: DEBUG manila.share.access [None req-09e64b6a-6daa-4f52-9ebe-fca4517715d9 tempest-ShareIpRulesForNFSTest-1748669711 None] Updating access rules for share instance b7a7d61c-2cea-442a-9809-507038e080d5 belonging to share 1ddadc17-cf10-4a42-8bbd-8335fb3520a1. {{(pid=98474) update_access_rules /opt/stack/manila/manila/share/access.py:298}} May 28 12:58:08 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-09e64b6a-6daa-4f52-9ebe-fca4517715d9 tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:08 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-09e64b6a-6daa-4f52-9ebe-fca4517715d9 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:08 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-64aafb71-9d54-476b-bca7-bc167293b7b0 tempest-ResourceLockCRUTest-1971036144 None] >>> [GET] https://127.0.0.1:40443/api/vippools/ May 28 12:58:08 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-64aafb71-9d54-476b-bca7-bc167293b7b0 tempest-ResourceLockCRUTest-1971036144 None] {'allow_redirects': True, 'params': {'name': 'vippool-1'}} May 28 12:58:08 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-09e64b6a-6daa-4f52-9ebe-fca4517715d9 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.012s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:08 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-09e64b6a-6daa-4f52-9ebe-fca4517715d9 tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:08 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-09e64b6a-6daa-4f52-9ebe-fca4517715d9 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:08 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-09e64b6a-6daa-4f52-9ebe-fca4517715d9 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.020s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:08 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-09e64b6a-6daa-4f52-9ebe-fca4517715d9 tempest-ShareIpRulesForNFSTest-1748669711 None] changing access on None May 28 12:58:08 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-09e64b6a-6daa-4f52-9ebe-fca4517715d9 tempest-ShareIpRulesForNFSTest-1748669711 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:58:08 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-09e64b6a-6daa-4f52-9ebe-fca4517715d9 tempest-ShareIpRulesForNFSTest-1748669711 None] {'allow_redirects': True, May 28 12:58:08 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-09e64b6a-6daa-4f52-9ebe-fca4517715d9 tempest-ShareIpRulesForNFSTest-1748669711 None] 'params': {'name': 'b7a7d61c-2cea-442a-9809-507038e080d5'}} May 28 12:58:09 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-64aafb71-9d54-476b-bca7-bc167293b7b0 tempest-ResourceLockCRUTest-1971036144 None] <<< [GET] https://127.0.0.1:40443/api/vippools/ May 28 12:58:09 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-64aafb71-9d54-476b-bca7-bc167293b7b0 tempest-ResourceLockCRUTest-1971036144 None] [Bunch(active_cnode_ids=[], active_interfaces=4, cluster='loop75-kfs', cluster_id=1, cnode_ids=[], cnodes=[], domain_name='vippool-1', enable_l3=False, enable_weighted_balancing=False, enabled=True, end_ip='172.21.75.4', guid='f2abaede-b397-413a-8faa-3aeead6d3b28', gw_ip='', gw_ipv6='', id=2, ip_ranges=[['172.21.75.1', '172.21.75.4']], name='vippool-1', peer_asn=0, port_membership='ALL', ranges_summary='172.21.75.[1-4]', role='PROTOCOLS', start_ip='172.21.75.1', subnet_cidr=16, subnet_cidr_ipv6=None, sync='SYNCED', sync_time='2024-05-28T12:50:09.644123Z', tenant_id=1, tenant_name='default', title='172.21.75.1 - 172.21.75.4', url='https://127.0.0.1:40443/api/vippools/2/', vast_asn=0, vlan=0, vms_preferred=False)] May 28 12:58:09 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-64aafb71-9d54-476b-bca7-bc167293b7b0 tempest-ResourceLockCRUTest-1971036144 None] --- [GET] https://127.0.0.1:40443/api/vippools/: Done May 28 12:58:09 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-64aafb71-9d54-476b-bca7-bc167293b7b0 tempest-ResourceLockCRUTest-1971036144 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:58:09 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-64aafb71-9d54-476b-bca7-bc167293b7b0 tempest-ResourceLockCRUTest-1971036144 None] {'allow_redirects': True, May 28 12:58:09 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-64aafb71-9d54-476b-bca7-bc167293b7b0 tempest-ResourceLockCRUTest-1971036144 None] 'params': {'name': '13a0450c-5c43-4fd2-9710-6cb3885f407a'}} May 28 12:58:09 l75lg1-v1 dstat.sh[49771]: 28-05 12:58:09| 14 2 82 2 0|5710M 1775M 277M 7863M| 35k 9715B| 0 2469k| 0 365 |6798 11k|1.37 1.07 1.01|2.0 1.0 0| 0 0 | 0 2048M| 29 357 0 61 0 May 28 12:58:09 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-09e64b6a-6daa-4f52-9ebe-fca4517715d9 tempest-ShareIpRulesForNFSTest-1748669711 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:58:09 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-09e64b6a-6daa-4f52-9ebe-fca4517715d9 tempest-ShareIpRulesForNFSTest-1748669711 None] [Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=1, created='2024-05-28T12:57:40.763635Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='377955ad-d094-4e49-ab32-1021d943a572', id=21, internal=False, is_s3_default_policy=False, name='b7a7d61c-2cea-442a-9809-507038e080d5', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=['*'], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['*'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['*'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T12:58:08.013025Z', tenant_id=1, tenant_name='default', title='b7a7d61c-2cea-442a-9809-507038e080d5', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/21/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[])] May 28 12:58:09 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-09e64b6a-6daa-4f52-9ebe-fca4517715d9 tempest-ShareIpRulesForNFSTest-1748669711 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 12:58:09 l75lg1-v1 manila-share[98474]: ERROR manila.share.drivers.vastdata [None req-09e64b6a-6daa-4f52-9ebe-fca4517715d9 tempest-ShareIpRulesForNFSTest-1748669711 None] failed to resolve host '203.0.113.0/24': [Errno -2] Name or service not known (ignoring): socket.gaierror: [Errno -2] Name or service not known May 28 12:58:09 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-09e64b6a-6daa-4f52-9ebe-fca4517715d9 tempest-ShareIpRulesForNFSTest-1748669711 None] changing access on /manila/manila-b7a7d61c-2cea-442a-9809-507038e080d5. Rules: {'nfs_read_write': ['*'], 'nfs_read_only': []} May 28 12:58:09 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-09e64b6a-6daa-4f52-9ebe-fca4517715d9 tempest-ShareIpRulesForNFSTest-1748669711 None] >>> [PATCH] https://127.0.0.1:40443/api/viewpolicies/21/ May 28 12:58:09 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-09e64b6a-6daa-4f52-9ebe-fca4517715d9 tempest-ShareIpRulesForNFSTest-1748669711 None] {'data': '{"name": "b7a7d61c-2cea-442a-9809-507038e080d5", "nfs_no_squash": ' May 28 12:58:09 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-09e64b6a-6daa-4f52-9ebe-fca4517715d9 tempest-ShareIpRulesForNFSTest-1748669711 None] '["*"], "nfs_root_squash": ["*"], "nfs_read_write": ["*"], ' May 28 12:58:09 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-09e64b6a-6daa-4f52-9ebe-fca4517715d9 tempest-ShareIpRulesForNFSTest-1748669711 None] '"nfs_read_only": []}', May 28 12:58:09 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-09e64b6a-6daa-4f52-9ebe-fca4517715d9 tempest-ShareIpRulesForNFSTest-1748669711 None] 'params': None} May 28 12:58:09 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-64aafb71-9d54-476b-bca7-bc167293b7b0 tempest-ResourceLockCRUTest-1971036144 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:58:09 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-64aafb71-9d54-476b-bca7-bc167293b7b0 tempest-ResourceLockCRUTest-1971036144 None] [] May 28 12:58:09 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-64aafb71-9d54-476b-bca7-bc167293b7b0 tempest-ResourceLockCRUTest-1971036144 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 12:58:09 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-64aafb71-9d54-476b-bca7-bc167293b7b0 tempest-ResourceLockCRUTest-1971036144 None] >>> [POST] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:58:09 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-64aafb71-9d54-476b-bca7-bc167293b7b0 tempest-ResourceLockCRUTest-1971036144 None] {'data': '{"name": "13a0450c-5c43-4fd2-9710-6cb3885f407a"}', May 28 12:58:09 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-64aafb71-9d54-476b-bca7-bc167293b7b0 tempest-ResourceLockCRUTest-1971036144 None] 'json': None, May 28 12:58:09 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-64aafb71-9d54-476b-bca7-bc167293b7b0 tempest-ResourceLockCRUTest-1971036144 None] 'params': None} May 28 12:58:09 l75lg1-v1 nova-conductor[83647]: DEBUG dbcounter [-] [83647] Writing DB stats nova_cell1:SELECT=5,nova_cell1:UPDATE=3 {{(pid=83647) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:58:09 l75lg1-v1 nova-conductor[83647]: DEBUG dbcounter [-] [83647] Writing DB stats nova_cell1:SELECT=2,nova_cell1:UPDATE=1 {{(pid=83647) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:58:09 l75lg1-v1 nova-conductor[83648]: DEBUG dbcounter [-] [83648] Writing DB stats nova_cell1:SELECT=3 {{(pid=83648) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:58:10 l75lg1-v1 neutron-server[77619]: DEBUG dbcounter [-] [77619] Writing DB stats neutron:SELECT=1 {{(pid=77619) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:58:10 l75lg1-v1 dstat.sh[49771]: 28-05 12:58:10| 2 1 95 2 0|5711M 1774M 277M 7863M| 42k 1614B| 0 8058k| 0 692 |2570 3484 |1.37 1.07 1.01|2.0 2.0 0| 0 0 | 0 2048M| 29 357 0 57 0 May 28 12:58:10 l75lg1-v1 neutron-server[77619]: DEBUG dbcounter [-] [77619] Writing DB stats neutron:SELECT=2 {{(pid=77619) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:58:10 l75lg1-v1 neutron-server[77618]: DEBUG dbcounter [-] [77618] Writing DB stats neutron:UPDATE=1,neutron:SELECT=1 {{(pid=77618) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:58:10 l75lg1-v1 neutron-server[77623]: DEBUG neutron.db.agents_db [None req-fe40ce8c-640e-4db7-a17a-6e8888cce266 None None] Agent healthcheck: found 0 active agents {{(pid=77623) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:319}} May 28 12:58:10 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-64aafb71-9d54-476b-bca7-bc167293b7b0 tempest-ResourceLockCRUTest-1971036144 None] <<< [POST] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:58:10 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-64aafb71-9d54-476b-bca7-bc167293b7b0 tempest-ResourceLockCRUTest-1971036144 None] Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=0, created='2024-05-28T12:58:10.251028Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='ab3d3fa9-b55a-411a-8970-e8d81644fbbc', id=27, internal=False, is_s3_default_policy=False, name='13a0450c-5c43-4fd2-9710-6cb3885f407a', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=[], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['*'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['*'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T12:58:10.723113Z', tenant_id=1, tenant_name='default', title='13a0450c-5c43-4fd2-9710-6cb3885f407a', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/27/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[]) May 28 12:58:10 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-64aafb71-9d54-476b-bca7-bc167293b7b0 tempest-ResourceLockCRUTest-1971036144 None] --- [POST] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 12:58:10 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-64aafb71-9d54-476b-bca7-bc167293b7b0 tempest-ResourceLockCRUTest-1971036144 None] >>> [GET] https://127.0.0.1:40443/api/quotas/ May 28 12:58:10 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-64aafb71-9d54-476b-bca7-bc167293b7b0 tempest-ResourceLockCRUTest-1971036144 None] {'allow_redirects': True, May 28 12:58:10 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-64aafb71-9d54-476b-bca7-bc167293b7b0 tempest-ResourceLockCRUTest-1971036144 None] 'params': {'name': '13a0450c-5c43-4fd2-9710-6cb3885f407a'}} May 28 12:58:10 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-08759b57-9b21-47f4-87ce-1725a1d0e07d tempest-SnapshotInstancesNegativeTest-1396485679 tempest-SnapshotInstancesNegativeTest-1396485679-project-admin] GET http://10.27.203.238/share/v2/c9cc76ecb4e343a6a51bf36da01debf8/shares/59371a98-d4b3-4967-9846-4759c0b33bb2 May 28 12:58:10 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-08759b57-9b21-47f4-87ce-1725a1d0e07d tempest-SnapshotInstancesNegativeTest-1396485679 tempest-SnapshotInstancesNegativeTest-1396485679-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:10 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-08759b57-9b21-47f4-87ce-1725a1d0e07d tempest-SnapshotInstancesNegativeTest-1396485679 tempest-SnapshotInstancesNegativeTest-1396485679-project-admin] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:10 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-08759b57-9b21-47f4-87ce-1725a1d0e07d tempest-SnapshotInstancesNegativeTest-1396485679 tempest-SnapshotInstancesNegativeTest-1396485679-project-admin] http://10.27.203.238/share/v2/c9cc76ecb4e343a6a51bf36da01debf8/shares/59371a98-d4b3-4967-9846-4759c0b33bb2 returned with HTTP 200 May 28 12:58:10 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 485/966] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:58:10 2024] GET /share/v2/c9cc76ecb4e343a6a51bf36da01debf8/shares/59371a98-d4b3-4967-9846-4759c0b33bb2 => generated 1368 bytes in 28 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:58:11 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-64aafb71-9d54-476b-bca7-bc167293b7b0 tempest-ResourceLockCRUTest-1971036144 None] <<< [GET] https://127.0.0.1:40443/api/quotas/ May 28 12:58:11 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-64aafb71-9d54-476b-bca7-bc167293b7b0 tempest-ResourceLockCRUTest-1971036144 None] [] May 28 12:58:11 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-64aafb71-9d54-476b-bca7-bc167293b7b0 tempest-ResourceLockCRUTest-1971036144 None] --- [GET] https://127.0.0.1:40443/api/quotas/: Done May 28 12:58:11 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-64aafb71-9d54-476b-bca7-bc167293b7b0 tempest-ResourceLockCRUTest-1971036144 None] >>> [POST] https://127.0.0.1:40443/api/quotas/ May 28 12:58:11 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-64aafb71-9d54-476b-bca7-bc167293b7b0 tempest-ResourceLockCRUTest-1971036144 None] {'data': '{"name": "13a0450c-5c43-4fd2-9710-6cb3885f407a", "path": ' May 28 12:58:11 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-64aafb71-9d54-476b-bca7-bc167293b7b0 tempest-ResourceLockCRUTest-1971036144 None] '"/manila/manila-13a0450c-5c43-4fd2-9710-6cb3885f407a", "create_dir": ' May 28 12:58:11 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-64aafb71-9d54-476b-bca7-bc167293b7b0 tempest-ResourceLockCRUTest-1971036144 None] 'true, "hard_limit": 1073741824}', May 28 12:58:11 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-64aafb71-9d54-476b-bca7-bc167293b7b0 tempest-ResourceLockCRUTest-1971036144 None] 'json': None, May 28 12:58:11 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-64aafb71-9d54-476b-bca7-bc167293b7b0 tempest-ResourceLockCRUTest-1971036144 None] 'params': None} May 28 12:58:11 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-09e64b6a-6daa-4f52-9ebe-fca4517715d9 tempest-ShareIpRulesForNFSTest-1748669711 None] <<< [PATCH] https://127.0.0.1:40443/api/viewpolicies/21/ May 28 12:58:11 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-09e64b6a-6daa-4f52-9ebe-fca4517715d9 tempest-ShareIpRulesForNFSTest-1748669711 None] Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=1, created='2024-05-28T12:57:40.763635Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='377955ad-d094-4e49-ab32-1021d943a572', id=21, internal=False, is_s3_default_policy=False, name='b7a7d61c-2cea-442a-9809-507038e080d5', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=['*'], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['*'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['*'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='MODIFYING', sync_time='2024-05-28T12:58:10.561508Z', tenant_id=1, tenant_name='default', title='b7a7d61c-2cea-442a-9809-507038e080d5', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/21/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[]) May 28 12:58:11 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-09e64b6a-6daa-4f52-9ebe-fca4517715d9 tempest-ShareIpRulesForNFSTest-1748669711 None] --- [PATCH] https://127.0.0.1:40443/api/viewpolicies/21/: Done May 28 12:58:11 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-09e64b6a-6daa-4f52-9ebe-fca4517715d9 tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:11 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-09e64b6a-6daa-4f52-9ebe-fca4517715d9 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:11 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-09e64b6a-6daa-4f52-9ebe-fca4517715d9 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.031s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:11 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-09e64b6a-6daa-4f52-9ebe-fca4517715d9 tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:11 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-09e64b6a-6daa-4f52-9ebe-fca4517715d9 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:11 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-09e64b6a-6daa-4f52-9ebe-fca4517715d9 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.025s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:11 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-09e64b6a-6daa-4f52-9ebe-fca4517715d9 tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:11 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-09e64b6a-6daa-4f52-9ebe-fca4517715d9 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:11 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-09e64b6a-6daa-4f52-9ebe-fca4517715d9 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.004s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:11 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-09e64b6a-6daa-4f52-9ebe-fca4517715d9 tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:11 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-09e64b6a-6daa-4f52-9ebe-fca4517715d9 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:11 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-09e64b6a-6daa-4f52-9ebe-fca4517715d9 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:11 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-09e64b6a-6daa-4f52-9ebe-fca4517715d9 tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:11 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-09e64b6a-6daa-4f52-9ebe-fca4517715d9 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:11 l75lg1-v1 dstat.sh[49771]: 28-05 12:58:11| 3 1 96 1 0|5711M 1774M 277M 7863M| 48k 1734B| 0 776k| 0 70.0 |2517 3441 |1.37 1.07 1.01|1.0 2.0 0| 0 0 | 0 2048M| 29 357 0 57 0 May 28 12:58:11 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-09e64b6a-6daa-4f52-9ebe-fca4517715d9 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.045s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:11 l75lg1-v1 manila-share[98474]: INFO manila.share.access [None req-09e64b6a-6daa-4f52-9ebe-fca4517715d9 tempest-ShareIpRulesForNFSTest-1748669711 None] Access rules were successfully modified for share instance b7a7d61c-2cea-442a-9809-507038e080d5 belonging to share 1ddadc17-cf10-4a42-8bbd-8335fb3520a1. May 28 12:58:11 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-c052d77f-a9e1-4d42-88ed-642b0e885f54 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] GET http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/c485966a-3cd7-4de5-903f-4b379a6cb450 May 28 12:58:11 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-c052d77f-a9e1-4d42-88ed-642b0e885f54 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:11 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-c052d77f-a9e1-4d42-88ed-642b0e885f54 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:11 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-c052d77f-a9e1-4d42-88ed-642b0e885f54 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/c485966a-3cd7-4de5-903f-4b379a6cb450 returned with HTTP 200 May 28 12:58:11 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 482/967] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:58:11 2024] GET /share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/c485966a-3cd7-4de5-903f-4b379a6cb450 => generated 1349 bytes in 26 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:58:11 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-883c8000-f356-43f9-a502-ef534f3317b1 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] GET http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/snapshots/61a994a9-64ae-4c8f-9475-6c6a0b8e910b May 28 12:58:11 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-883c8000-f356-43f9-a502-ef534f3317b1 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:11 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-883c8000-f356-43f9-a502-ef534f3317b1 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Calling method 'ShareSnapshotMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:11 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-883c8000-f356-43f9-a502-ef534f3317b1 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/snapshots/61a994a9-64ae-4c8f-9475-6c6a0b8e910b returned with HTTP 200 May 28 12:58:11 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 486/968] 10.27.203.238 () {64 vars in 1460 bytes} [Tue May 28 12:58:11 2024] GET /share/v2/a3499cb78849424db45e54caac01de92/snapshots/61a994a9-64ae-4c8f-9475-6c6a0b8e910b => generated 750 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:58:11 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c6945b0a-5f43-478b-ab3a-c1fe10c98bc6 tempest-SnapshotInstancesNegativeTest-1396485679 None] <<< [DELETE] https://127.0.0.1:40443/api/quotas/21/ May 28 12:58:11 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c6945b0a-5f43-478b-ab3a-c1fe10c98bc6 tempest-SnapshotInstancesNegativeTest-1396485679 None] --- [DELETE] https://127.0.0.1:40443/api/quotas/21/: Done May 28 12:58:11 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c6945b0a-5f43-478b-ab3a-c1fe10c98bc6 tempest-SnapshotInstancesNegativeTest-1396485679 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:58:11 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c6945b0a-5f43-478b-ab3a-c1fe10c98bc6 tempest-SnapshotInstancesNegativeTest-1396485679 None] {'allow_redirects': True, May 28 12:58:11 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c6945b0a-5f43-478b-ab3a-c1fe10c98bc6 tempest-SnapshotInstancesNegativeTest-1396485679 None] 'params': {'name': '8239ccb8-483c-4129-8319-880234387fbd'}} May 28 12:58:11 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.periodic_task [None req-e3486ff9-a95e-41bc-8901-df75aedbeaad None None] Running periodic task DataManager.create_backup_continue {{(pid=98318) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:58:11 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.periodic_task [None req-e3486ff9-a95e-41bc-8901-df75aedbeaad None None] Running periodic task DataManager.restore_backup_continue {{(pid=98318) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:58:11 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-2028d9aa-dc39-4874-a530-a1a43ee4f2e1 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] GET http://10.27.203.238/share/v2/776f75906bc64f8f9316d5aab4b50bf1/share-access-rules?share_id=1ddadc17-cf10-4a42-8bbd-8335fb3520a1 May 28 12:58:11 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-2028d9aa-dc39-4874-a530-a1a43ee4f2e1 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:11 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-2028d9aa-dc39-4874-a530-a1a43ee4f2e1 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:11 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-8233f854-9095-4a64-8f38-7c19dabd4932 tempest-ResourceLockCRUTest-1971036144 tempest-ResourceLockCRUTest-1971036144-project-member] GET http://10.27.203.238/share/v2/82840ccb77144a4aa2d0bdce807ce686/shares/3f6b8420-fc46-47fc-b707-d08dfd01280f May 28 12:58:11 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-8233f854-9095-4a64-8f38-7c19dabd4932 tempest-ResourceLockCRUTest-1971036144 tempest-ResourceLockCRUTest-1971036144-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:11 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-8233f854-9095-4a64-8f38-7c19dabd4932 tempest-ResourceLockCRUTest-1971036144 tempest-ResourceLockCRUTest-1971036144-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:11 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-2028d9aa-dc39-4874-a530-a1a43ee4f2e1 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] http://10.27.203.238/share/v2/776f75906bc64f8f9316d5aab4b50bf1/share-access-rules?share_id=1ddadc17-cf10-4a42-8bbd-8335fb3520a1 returned with HTTP 200 May 28 12:58:11 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 483/969] 10.27.203.238 () {64 vars in 1467 bytes} [Tue May 28 12:58:11 2024] GET /share/v2/776f75906bc64f8f9316d5aab4b50bf1/share-access-rules?share_id=1ddadc17-cf10-4a42-8bbd-8335fb3520a1 => generated 19 bytes in 31 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:58:11 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-8233f854-9095-4a64-8f38-7c19dabd4932 tempest-ResourceLockCRUTest-1971036144 tempest-ResourceLockCRUTest-1971036144-project-member] http://10.27.203.238/share/v2/82840ccb77144a4aa2d0bdce807ce686/shares/3f6b8420-fc46-47fc-b707-d08dfd01280f returned with HTTP 200 May 28 12:58:11 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 487/970] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:58:11 2024] GET /share/v2/82840ccb77144a4aa2d0bdce807ce686/shares/3f6b8420-fc46-47fc-b707-d08dfd01280f => generated 1316 bytes in 25 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:58:11 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-ebd8be77-6f2d-47fa-8553-c13b27a9dabe tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] POST http://10.27.203.238/share/v2/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action May 28 12:58:11 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-ebd8be77-6f2d-47fa-8553-c13b27a9dabe tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Action body: b'{"allow_access": {"access_type": "ip", "access_to": "2001:db8:5d1a:d535:c330::/77", "access_level": "rw"}}' {{(pid=98330) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:58:11 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-ebd8be77-6f2d-47fa-8553-c13b27a9dabe tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Action: 'action', calling method: ShareController.allow_access, body: {"allow_access": {"access_type": "ip", "access_to": "2001:db8:5d1a:d535:c330::/77", "access_level": "rw"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:58:11 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-ebd8be77-6f2d-47fa-8553-c13b27a9dabe tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:11 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-ebd8be77-6f2d-47fa-8553-c13b27a9dabe tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:11 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-ebd8be77-6f2d-47fa-8553-c13b27a9dabe tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.042s {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:11 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-ebd8be77-6f2d-47fa-8553-c13b27a9dabe tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] http://10.27.203.238/share/v2/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action returned with HTTP 200 May 28 12:58:11 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 484/971] 10.27.203.238 () {66 vars in 1494 bytes} [Tue May 28 12:58:11 2024] POST /share/v2/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action => generated 310 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:58:11 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-9881368a-34f8-45ba-96a3-c22600d2f9a2 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] POST http://10.27.203.238/share/v2/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action May 28 12:58:11 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-9881368a-34f8-45ba-96a3-c22600d2f9a2 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Action body: b'{"access_list": null}' {{(pid=98329) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:58:11 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-9881368a-34f8-45ba-96a3-c22600d2f9a2 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Action: 'action', calling method: ShareController.access_list, body: {"access_list": null} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:58:11 l75lg1-v1 manila-share[98474]: DEBUG manila.share.manager [None req-ebd8be77-6f2d-47fa-8553-c13b27a9dabe tempest-ShareIpRulesForNFSTest-1748669711 None] Received request to update access for share instance b7a7d61c-2cea-442a-9809-507038e080d5. {{(pid=98474) update_access_for_instances /opt/stack/manila/manila/share/manager.py:4353}} May 28 12:58:11 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-9881368a-34f8-45ba-96a3-c22600d2f9a2 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] http://10.27.203.238/share/v2/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action returned with HTTP 200 May 28 12:58:11 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 488/972] 10.27.203.238 () {66 vars in 1493 bytes} [Tue May 28 12:58:11 2024] POST /share/v2/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action => generated 265 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:58:11 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-ebd8be77-6f2d-47fa-8553-c13b27a9dabe tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:11 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-ebd8be77-6f2d-47fa-8553-c13b27a9dabe tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:11 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-ebd8be77-6f2d-47fa-8553-c13b27a9dabe tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.004s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:11 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-ebd8be77-6f2d-47fa-8553-c13b27a9dabe tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:11 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-ebd8be77-6f2d-47fa-8553-c13b27a9dabe tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:11 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-75fa9c04-51ee-441f-b48c-45fd253a49a3 tempest-AdminActionsTest-1749172189 None] <<< [POST] https://127.0.0.1:40443/api/snapshots/ May 28 12:58:11 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-75fa9c04-51ee-441f-b48c-45fd253a49a3 tempest-AdminActionsTest-1749172189 None] Bunch(access_path='/.vast_all_snapshots/1000000008_share-snapshot-a36d2987-19ac-4366-b5bb-199a72efcb95', aggr_phys_estimation=0, cluster='loop75-kfs', created='2024-05-28T12:58:08.917970Z', eta_sec=30819898906.054653, expiration_time='3001-01-19T07:59:58Z', guid='faa3f846-60a6-46a0-89e1-a77729118953', id=9, indestructible=False, locked=False, name='share-snapshot-a36d2987-19ac-4366-b5bb-199a72efcb95', path='/manila/manila-77a25e6b-f137-4342-8eb9-9ced679515e2/', policy=None, policy_id=None, protection_policy_id=None, state='SUCCEED', tenant_id=1, tenant_name='default', title='share-snapshot-a36d2987-19ac-4366-b5bb-199a72efcb95(/manila/manila-77a25e6b-f137-4342-8eb9-9ced679515e2/)', type='local', unique_phys_estimation=0, url='https://127.0.0.1:40443/api/snapshots/9/') May 28 12:58:11 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-75fa9c04-51ee-441f-b48c-45fd253a49a3 tempest-AdminActionsTest-1749172189 None] --- [POST] https://127.0.0.1:40443/api/snapshots/: Done May 28 12:58:12 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-ebd8be77-6f2d-47fa-8553-c13b27a9dabe tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.082s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:12 l75lg1-v1 manila-share[98474]: DEBUG manila.share.access [None req-ebd8be77-6f2d-47fa-8553-c13b27a9dabe tempest-ShareIpRulesForNFSTest-1748669711 None] Updating access rules for share instance b7a7d61c-2cea-442a-9809-507038e080d5 belonging to share 1ddadc17-cf10-4a42-8bbd-8335fb3520a1. {{(pid=98474) update_access_rules /opt/stack/manila/manila/share/access.py:298}} May 28 12:58:12 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c6945b0a-5f43-478b-ab3a-c1fe10c98bc6 tempest-SnapshotInstancesNegativeTest-1396485679 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:58:12 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c6945b0a-5f43-478b-ab3a-c1fe10c98bc6 tempest-SnapshotInstancesNegativeTest-1396485679 None] [Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=0, created='2024-05-28T12:57:50.327424Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='5b1c8739-fab5-4995-9e5d-3dc8d4a3155c', id=24, internal=False, is_s3_default_policy=False, name='8239ccb8-483c-4129-8319-880234387fbd', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=[], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['*'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['*'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T12:57:50.726951Z', tenant_id=1, tenant_name='default', title='8239ccb8-483c-4129-8319-880234387fbd', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/24/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[])] May 28 12:58:12 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c6945b0a-5f43-478b-ab3a-c1fe10c98bc6 tempest-SnapshotInstancesNegativeTest-1396485679 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 12:58:12 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c6945b0a-5f43-478b-ab3a-c1fe10c98bc6 tempest-SnapshotInstancesNegativeTest-1396485679 None] >>> [DELETE] https://127.0.0.1:40443/api/viewpolicies/24/ May 28 12:58:12 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-ebd8be77-6f2d-47fa-8553-c13b27a9dabe tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:12 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-ebd8be77-6f2d-47fa-8553-c13b27a9dabe tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:12 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-ebd8be77-6f2d-47fa-8553-c13b27a9dabe tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.008s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:12 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-ebd8be77-6f2d-47fa-8553-c13b27a9dabe tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:12 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-ebd8be77-6f2d-47fa-8553-c13b27a9dabe tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:12 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-ebd8be77-6f2d-47fa-8553-c13b27a9dabe tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.017s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:12 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-ebd8be77-6f2d-47fa-8553-c13b27a9dabe tempest-ShareIpRulesForNFSTest-1748669711 None] changing access on None May 28 12:58:12 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ebd8be77-6f2d-47fa-8553-c13b27a9dabe tempest-ShareIpRulesForNFSTest-1748669711 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:58:12 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ebd8be77-6f2d-47fa-8553-c13b27a9dabe tempest-ShareIpRulesForNFSTest-1748669711 None] {'allow_redirects': True, May 28 12:58:12 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ebd8be77-6f2d-47fa-8553-c13b27a9dabe tempest-ShareIpRulesForNFSTest-1748669711 None] 'params': {'name': 'b7a7d61c-2cea-442a-9809-507038e080d5'}} May 28 12:58:12 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-64aafb71-9d54-476b-bca7-bc167293b7b0 tempest-ResourceLockCRUTest-1971036144 None] <<< [POST] https://127.0.0.1:40443/api/quotas/ May 28 12:58:12 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-64aafb71-9d54-476b-bca7-bc167293b7b0 tempest-ResourceLockCRUTest-1971036144 None] Bunch(cluster='loop75-kfs', cluster_id=1, default_email=None, default_group_quota=None, default_user_quota=None, enable_alarms=True, enable_email_providers=True, grace_period=None, group_quotas=[], guid='e3418568-de5b-418a-9cb6-1d7ebf645618', hard_limit=1073741824, hard_limit_inodes=None, id=24, internal=False, is_user_quota=False, last_user_quotas_update=None, name='13a0450c-5c43-4fd2-9710-6cb3885f407a', num_blocked_users=0, num_exceeded_users=0, path='/manila/manila-13a0450c-5c43-4fd2-9710-6cb3885f407a', percent_capacity=0, percent_inodes=None, pretty_grace_period=None, pretty_grace_period_expiration=None, pretty_state='OK (CREATED)', soft_limit=None, soft_limit_inodes=None, state='OK', sync_state='CREATED', system_id=24, tenant_id=1, tenant_name='default', time_to_block=None, title='13a0450c-5c43-4fd2-9710-6cb3885f407a', url='https://127.0.0.1:40443/api/quotas/24/', used_capacity=0, used_capacity_tb=0.0, used_effective_capacity=0, used_effective_capacity_tb=0.0, used_inodes=0, used_limited_capacity=0, user_quotas=[]) May 28 12:58:12 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-64aafb71-9d54-476b-bca7-bc167293b7b0 tempest-ResourceLockCRUTest-1971036144 None] --- [POST] https://127.0.0.1:40443/api/quotas/: Done May 28 12:58:12 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-64aafb71-9d54-476b-bca7-bc167293b7b0 tempest-ResourceLockCRUTest-1971036144 None] >>> [GET] https://127.0.0.1:40443/api/views/ May 28 12:58:12 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-64aafb71-9d54-476b-bca7-bc167293b7b0 tempest-ResourceLockCRUTest-1971036144 None] {'allow_redirects': True, May 28 12:58:12 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-64aafb71-9d54-476b-bca7-bc167293b7b0 tempest-ResourceLockCRUTest-1971036144 None] 'params': {'name': '13a0450c-5c43-4fd2-9710-6cb3885f407a'}} May 28 12:58:12 l75lg1-v1 dstat.sh[49771]: 28-05 12:58:12| 6 1 91 2 0|5711M 1774M 277M 7863M| 42k 5645B| 0 1196k| 0 156 |4272 6511 |1.34 1.07 1.01|1.0 1.0 0| 0 0 | 0 2048M| 29 357 0 52 0 May 28 12:58:12 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-56e811af-e796-4a9d-8605-933cf433f535 tempest-SharesMetadataTest-1561320255 None] <<< [DELETE] https://127.0.0.1:40443/api/quotas/22/ May 28 12:58:12 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-56e811af-e796-4a9d-8605-933cf433f535 tempest-SharesMetadataTest-1561320255 None] --- [DELETE] https://127.0.0.1:40443/api/quotas/22/: Done May 28 12:58:12 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-56e811af-e796-4a9d-8605-933cf433f535 tempest-SharesMetadataTest-1561320255 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:58:12 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-56e811af-e796-4a9d-8605-933cf433f535 tempest-SharesMetadataTest-1561320255 None] {'allow_redirects': True, May 28 12:58:12 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-56e811af-e796-4a9d-8605-933cf433f535 tempest-SharesMetadataTest-1561320255 None] 'params': {'name': '205d35a8-15b8-4a2f-8214-8c2d1a5de6b0'}} May 28 12:58:12 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ebd8be77-6f2d-47fa-8553-c13b27a9dabe tempest-ShareIpRulesForNFSTest-1748669711 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:58:12 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ebd8be77-6f2d-47fa-8553-c13b27a9dabe tempest-ShareIpRulesForNFSTest-1748669711 None] [Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=1, created='2024-05-28T12:57:40.763635Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='377955ad-d094-4e49-ab32-1021d943a572', id=21, internal=False, is_s3_default_policy=False, name='b7a7d61c-2cea-442a-9809-507038e080d5', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=['*'], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['*'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['*'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T12:58:11.063538Z', tenant_id=1, tenant_name='default', title='b7a7d61c-2cea-442a-9809-507038e080d5', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/21/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[])] May 28 12:58:12 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ebd8be77-6f2d-47fa-8553-c13b27a9dabe tempest-ShareIpRulesForNFSTest-1748669711 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 12:58:12 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-ebd8be77-6f2d-47fa-8553-c13b27a9dabe tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:12 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-ebd8be77-6f2d-47fa-8553-c13b27a9dabe tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:12 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-ebd8be77-6f2d-47fa-8553-c13b27a9dabe tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.053s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:12 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-ebd8be77-6f2d-47fa-8553-c13b27a9dabe tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:12 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-ebd8be77-6f2d-47fa-8553-c13b27a9dabe tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:12 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-ebd8be77-6f2d-47fa-8553-c13b27a9dabe tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:12 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-ebd8be77-6f2d-47fa-8553-c13b27a9dabe tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:12 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-ebd8be77-6f2d-47fa-8553-c13b27a9dabe tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:12 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-ebd8be77-6f2d-47fa-8553-c13b27a9dabe tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:12 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-ebd8be77-6f2d-47fa-8553-c13b27a9dabe tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:12 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-ebd8be77-6f2d-47fa-8553-c13b27a9dabe tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:12 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-ebd8be77-6f2d-47fa-8553-c13b27a9dabe tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:12 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-ebd8be77-6f2d-47fa-8553-c13b27a9dabe tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:12 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-ebd8be77-6f2d-47fa-8553-c13b27a9dabe tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:12 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-ebd8be77-6f2d-47fa-8553-c13b27a9dabe tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.036s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:12 l75lg1-v1 manila-share[98474]: INFO manila.share.access [None req-ebd8be77-6f2d-47fa-8553-c13b27a9dabe tempest-ShareIpRulesForNFSTest-1748669711 None] Access rules were successfully modified for share instance b7a7d61c-2cea-442a-9809-507038e080d5 belonging to share 1ddadc17-cf10-4a42-8bbd-8335fb3520a1. May 28 12:58:12 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-64aafb71-9d54-476b-bca7-bc167293b7b0 tempest-ResourceLockCRUTest-1971036144 None] <<< [GET] https://127.0.0.1:40443/api/views/ May 28 12:58:12 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-64aafb71-9d54-476b-bca7-bc167293b7b0 tempest-ResourceLockCRUTest-1971036144 None] [] May 28 12:58:12 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-64aafb71-9d54-476b-bca7-bc167293b7b0 tempest-ResourceLockCRUTest-1971036144 None] --- [GET] https://127.0.0.1:40443/api/views/: Done May 28 12:58:12 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-64aafb71-9d54-476b-bca7-bc167293b7b0 tempest-ResourceLockCRUTest-1971036144 None] >>> [POST] https://127.0.0.1:40443/api/views/ May 28 12:58:12 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-64aafb71-9d54-476b-bca7-bc167293b7b0 tempest-ResourceLockCRUTest-1971036144 None] {'data': '{"name": "13a0450c-5c43-4fd2-9710-6cb3885f407a", "path": ' May 28 12:58:12 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-64aafb71-9d54-476b-bca7-bc167293b7b0 tempest-ResourceLockCRUTest-1971036144 None] '"/manila/manila-13a0450c-5c43-4fd2-9710-6cb3885f407a", "policy_id": ' May 28 12:58:12 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-64aafb71-9d54-476b-bca7-bc167293b7b0 tempest-ResourceLockCRUTest-1971036144 None] '27, "create_dir": true, "protocols": ["NFS"]}', May 28 12:58:12 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-64aafb71-9d54-476b-bca7-bc167293b7b0 tempest-ResourceLockCRUTest-1971036144 None] 'json': None, May 28 12:58:12 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-64aafb71-9d54-476b-bca7-bc167293b7b0 tempest-ResourceLockCRUTest-1971036144 None] 'params': None} May 28 12:58:13 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-56e811af-e796-4a9d-8605-933cf433f535 tempest-SharesMetadataTest-1561320255 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:58:13 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-56e811af-e796-4a9d-8605-933cf433f535 tempest-SharesMetadataTest-1561320255 None] [Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=0, created='2024-05-28T12:58:00.007552Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='472818a4-2598-42ca-9c38-1bc6b2b5e609', id=25, internal=False, is_s3_default_policy=False, name='205d35a8-15b8-4a2f-8214-8c2d1a5de6b0', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=[], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['*'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['*'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T12:58:00.372249Z', tenant_id=1, tenant_name='default', title='205d35a8-15b8-4a2f-8214-8c2d1a5de6b0', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/25/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[])] May 28 12:58:13 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-56e811af-e796-4a9d-8605-933cf433f535 tempest-SharesMetadataTest-1561320255 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 12:58:13 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-56e811af-e796-4a9d-8605-933cf433f535 tempest-SharesMetadataTest-1561320255 None] >>> [DELETE] https://127.0.0.1:40443/api/viewpolicies/25/ May 28 12:58:13 l75lg1-v1 dstat.sh[49771]: 28-05 12:58:13| 2 1 96 1 0|5711M 1774M 277M 7863M| 42k 2396B| 0 828k| 0 91.0 |2740 4114 |1.34 1.07 1.01|1.0 2.0 0| 0 0 | 0 2048M| 29 357 0 52 0 May 28 12:58:13 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-64aafb71-9d54-476b-bca7-bc167293b7b0 tempest-ResourceLockCRUTest-1971036144 None] <<< [POST] https://127.0.0.1:40443/api/views/ May 28 12:58:13 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-64aafb71-9d54-476b-bca7-bc167293b7b0 tempest-ResourceLockCRUTest-1971036144 None] Bunch(abac_tags=[], abe_max_depth=None, abe_protocols=[], alias='', allow_anonymous_access=False, allow_s3_anonymous_access=False, auto_commit='0d', bucket='', bucket_creators=[], bucket_creators_groups=[], bucket_owner=None, bulk_permission_update_progress=None, bulk_permission_update_state=None, cluster='loop75-kfs', cluster_id=1, created='2024-05-28T12:58:13.458183Z', enabled=True, files_retention_mode='NONE', guid='31210cc8-1989-48ee-9976-c943b0d36f0c', id=26, ignore_oos=False, internal=False, is_remote=False, is_seamless=False, logical_capacity=0, max_retention_period=None, min_retention_period=None, name='13a0450c-5c43-4fd2-9710-6cb3885f407a', nfs_interop_flags='BOTH_NFS3_AND_NFS4_INTEROP_DISABLED', path='/manila/manila-13a0450c-5c43-4fd2-9710-6cb3885f407a', physical_capacity=0, policy='13a0450c-5c43-4fd2-9710-6cb3885f407a', policy_id=27, protocols=['NFS'], qos_policy=None, qos_policy_id=None, s3_locks=False, s3_locks_retention_mode='NONE', s3_locks_retention_period='', s3_object_ownership_rule='ObjectWriter', s3_unverified_lookup=False, s3_versioning=False, select_for_live_monitoring=False, share='', share_acl=Bunch(acl=[], enabled=False), sync='SYNCED', sync_time='2024-05-28T12:58:13.699141Z', tenant_id=1, tenant_name='default', title='/manila/manila-13a0450c-5c43-4fd2-9710-6cb3885f407a', url='https://127.0.0.1:40443/api/views/26/') May 28 12:58:13 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-64aafb71-9d54-476b-bca7-bc167293b7b0 tempest-ResourceLockCRUTest-1971036144 None] --- [POST] https://127.0.0.1:40443/api/views/: Done May 28 12:58:13 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c6945b0a-5f43-478b-ab3a-c1fe10c98bc6 tempest-SnapshotInstancesNegativeTest-1396485679 None] <<< [DELETE] https://127.0.0.1:40443/api/viewpolicies/24/ May 28 12:58:13 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c6945b0a-5f43-478b-ab3a-c1fe10c98bc6 tempest-SnapshotInstancesNegativeTest-1396485679 None] --- [DELETE] https://127.0.0.1:40443/api/viewpolicies/24/: Done May 28 12:58:13 l75lg1-v1 manila-share[98474]: INFO manila.share.manager [None req-64aafb71-9d54-476b-bca7-bc167293b7b0 tempest-ResourceLockCRUTest-1971036144 None] Share instance 13a0450c-5c43-4fd2-9710-6cb3885f407a created successfully. May 28 12:58:13 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-c6945b0a-5f43-478b-ab3a-c1fe10c98bc6 tempest-SnapshotInstancesNegativeTest-1396485679 None] Created reservations ['385da1c8-9f38-4dc8-aae0-01e6dfa9694f', 'a76006e6-0409-4cb4-b18a-369c7a58325d', '51755e07-7ff5-45bd-9901-b71e85581540', 'a556c040-2321-4545-8f82-3c7723cf5d50'] {{(pid=98474) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 12:58:13 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-c6945b0a-5f43-478b-ab3a-c1fe10c98bc6 tempest-SnapshotInstancesNegativeTest-1396485679 None] Committed reservations ['385da1c8-9f38-4dc8-aae0-01e6dfa9694f', 'a76006e6-0409-4cb4-b18a-369c7a58325d', '51755e07-7ff5-45bd-9901-b71e85581540', 'a556c040-2321-4545-8f82-3c7723cf5d50'] {{(pid=98474) commit /opt/stack/manila/manila/quota.py:1063}} May 28 12:58:13 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-1b9f2f8c-411c-480d-abf3-533ee4c46309 tempest-SnapshotInstancesNegativeTest-1396485679 tempest-SnapshotInstancesNegativeTest-1396485679-project-admin] GET http://10.27.203.238/share/v2/c9cc76ecb4e343a6a51bf36da01debf8/shares/59371a98-d4b3-4967-9846-4759c0b33bb2 May 28 12:58:13 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-1b9f2f8c-411c-480d-abf3-533ee4c46309 tempest-SnapshotInstancesNegativeTest-1396485679 tempest-SnapshotInstancesNegativeTest-1396485679-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:13 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-1b9f2f8c-411c-480d-abf3-533ee4c46309 tempest-SnapshotInstancesNegativeTest-1396485679 tempest-SnapshotInstancesNegativeTest-1396485679-project-admin] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:13 l75lg1-v1 manila-share[98474]: INFO manila.share.manager [None req-c6945b0a-5f43-478b-ab3a-c1fe10c98bc6 tempest-SnapshotInstancesNegativeTest-1396485679 None] Share instance 8239ccb8-483c-4129-8319-880234387fbd: deleted successfully. May 28 12:58:13 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-1b9f2f8c-411c-480d-abf3-533ee4c46309 tempest-SnapshotInstancesNegativeTest-1396485679 tempest-SnapshotInstancesNegativeTest-1396485679-project-admin] http://10.27.203.238/share/v2/c9cc76ecb4e343a6a51bf36da01debf8/shares/59371a98-d4b3-4967-9846-4759c0b33bb2 returned with HTTP 200 May 28 12:58:13 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 485/973] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:58:13 2024] GET /share/v2/c9cc76ecb4e343a6a51bf36da01debf8/shares/59371a98-d4b3-4967-9846-4759c0b33bb2 => generated 1368 bytes in 27 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:58:14 l75lg1-v1 dstat.sh[49771]: 28-05 12:58:14| 3 1 95 1 0|5712M 1773M 277M 7863M| 35k 132B| 0 1146k| 0 146 |2860 4512 |1.34 1.07 1.01|1.0 1.0 0| 0 0 | 0 2048M| 29 357 0 38 0 May 28 12:58:14 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-51f8266b-9418-47b2-b768-124c0dca758e tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] GET http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/c485966a-3cd7-4de5-903f-4b379a6cb450 May 28 12:58:14 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-51f8266b-9418-47b2-b768-124c0dca758e tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:14 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-51f8266b-9418-47b2-b768-124c0dca758e tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:14 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-51f8266b-9418-47b2-b768-124c0dca758e tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/c485966a-3cd7-4de5-903f-4b379a6cb450 returned with HTTP 200 May 28 12:58:14 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 489/974] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:58:14 2024] GET /share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/c485966a-3cd7-4de5-903f-4b379a6cb450 => generated 1349 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:58:14 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-24b271d6-9786-4346-8f2b-ad5cd05c7f53 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] GET http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/snapshots/61a994a9-64ae-4c8f-9475-6c6a0b8e910b May 28 12:58:14 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-24b271d6-9786-4346-8f2b-ad5cd05c7f53 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:14 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-24b271d6-9786-4346-8f2b-ad5cd05c7f53 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Calling method 'ShareSnapshotMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:14 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-24b271d6-9786-4346-8f2b-ad5cd05c7f53 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/snapshots/61a994a9-64ae-4c8f-9475-6c6a0b8e910b returned with HTTP 200 May 28 12:58:14 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 486/975] 10.27.203.238 () {64 vars in 1460 bytes} [Tue May 28 12:58:14 2024] GET /share/v2/a3499cb78849424db45e54caac01de92/snapshots/61a994a9-64ae-4c8f-9475-6c6a0b8e910b => generated 751 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:58:14 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-f14443d2-1a07-4723-a9ee-e3026e94da00 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] POST http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/snapshots/61a994a9-64ae-4c8f-9475-6c6a0b8e910b/action May 28 12:58:14 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-f14443d2-1a07-4723-a9ee-e3026e94da00 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Action body: b'{"reset_status": {"status": "error_deleting"}}' {{(pid=98329) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:58:14 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-f14443d2-1a07-4723-a9ee-e3026e94da00 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Action: 'action', calling method: ShareSnapshotsController.snapshot_reset_status, body: {"reset_status": {"status": "error_deleting"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:58:14 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-f14443d2-1a07-4723-a9ee-e3026e94da00 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Updating share_snapshot '61a994a9-64ae-4c8f-9475-6c6a0b8e910b' with '{'status': 'error_deleting'}' {{(pid=98329) _reset_status /opt/stack/manila/manila/api/openstack/wsgi.py:1257}} May 28 12:58:14 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-f14443d2-1a07-4723-a9ee-e3026e94da00 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/snapshots/61a994a9-64ae-4c8f-9475-6c6a0b8e910b/action returned with HTTP 202 May 28 12:58:14 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 490/976] 10.27.203.238 () {66 vars in 1502 bytes} [Tue May 28 12:58:14 2024] POST /share/v2/a3499cb78849424db45e54caac01de92/snapshots/61a994a9-64ae-4c8f-9475-6c6a0b8e910b/action => generated 0 bytes in 100 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:58:14 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-13e8971a-b004-452c-890c-9fb60c8ea518 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] GET http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/snapshots/61a994a9-64ae-4c8f-9475-6c6a0b8e910b May 28 12:58:14 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-13e8971a-b004-452c-890c-9fb60c8ea518 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:14 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-13e8971a-b004-452c-890c-9fb60c8ea518 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Calling method 'ShareSnapshotMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:14 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-13e8971a-b004-452c-890c-9fb60c8ea518 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/snapshots/61a994a9-64ae-4c8f-9475-6c6a0b8e910b returned with HTTP 200 May 28 12:58:14 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 487/977] 10.27.203.238 () {64 vars in 1460 bytes} [Tue May 28 12:58:14 2024] GET /share/v2/a3499cb78849424db45e54caac01de92/snapshots/61a994a9-64ae-4c8f-9475-6c6a0b8e910b => generated 756 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 231 bytes (2 switches on core 0) May 28 12:58:14 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-56e811af-e796-4a9d-8605-933cf433f535 tempest-SharesMetadataTest-1561320255 None] <<< [DELETE] https://127.0.0.1:40443/api/viewpolicies/25/ May 28 12:58:14 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-56e811af-e796-4a9d-8605-933cf433f535 tempest-SharesMetadataTest-1561320255 None] --- [DELETE] https://127.0.0.1:40443/api/viewpolicies/25/: Done May 28 12:58:14 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-1d83defc-8f3a-41ac-af01-f638662c1444 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] POST http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/snapshots/61a994a9-64ae-4c8f-9475-6c6a0b8e910b/action May 28 12:58:14 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-1d83defc-8f3a-41ac-af01-f638662c1444 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Action body: b'{"reset_status": {"status": "available"}}' {{(pid=98329) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:58:14 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-1d83defc-8f3a-41ac-af01-f638662c1444 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Action: 'action', calling method: ShareSnapshotsController.snapshot_reset_status, body: {"reset_status": {"status": "available"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:58:14 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-1d83defc-8f3a-41ac-af01-f638662c1444 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Updating share_snapshot '61a994a9-64ae-4c8f-9475-6c6a0b8e910b' with '{'status': 'available'}' {{(pid=98329) _reset_status /opt/stack/manila/manila/api/openstack/wsgi.py:1257}} May 28 12:58:14 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-27a30ccf-61ca-49ac-997b-3c3cfe7f0285 tempest-ResourceLockCRUTest-1971036144 tempest-ResourceLockCRUTest-1971036144-project-member] GET http://10.27.203.238/share/v2/82840ccb77144a4aa2d0bdce807ce686/shares/3f6b8420-fc46-47fc-b707-d08dfd01280f May 28 12:58:14 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-27a30ccf-61ca-49ac-997b-3c3cfe7f0285 tempest-ResourceLockCRUTest-1971036144 tempest-ResourceLockCRUTest-1971036144-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:14 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-27a30ccf-61ca-49ac-997b-3c3cfe7f0285 tempest-ResourceLockCRUTest-1971036144 tempest-ResourceLockCRUTest-1971036144-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:14 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-1d83defc-8f3a-41ac-af01-f638662c1444 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/snapshots/61a994a9-64ae-4c8f-9475-6c6a0b8e910b/action returned with HTTP 202 May 28 12:58:14 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 491/978] 10.27.203.238 () {66 vars in 1502 bytes} [Tue May 28 12:58:14 2024] POST /share/v2/a3499cb78849424db45e54caac01de92/snapshots/61a994a9-64ae-4c8f-9475-6c6a0b8e910b/action => generated 0 bytes in 106 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:58:14 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-27a30ccf-61ca-49ac-997b-3c3cfe7f0285 tempest-ResourceLockCRUTest-1971036144 tempest-ResourceLockCRUTest-1971036144-project-member] http://10.27.203.238/share/v2/82840ccb77144a4aa2d0bdce807ce686/shares/3f6b8420-fc46-47fc-b707-d08dfd01280f returned with HTTP 200 May 28 12:58:14 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-56e811af-e796-4a9d-8605-933cf433f535 tempest-SharesMetadataTest-1561320255 None] Created reservations ['bb3bf695-fba4-4e17-a50d-539f4c258ff8', '80d3b3a7-7dd5-4313-9ea2-8d2c29e6764c', 'c5ee52a0-eecd-4cef-89e7-467c8da50741', 'b3d7808b-06e0-4717-b9ea-d4aca66433b0'] {{(pid=98474) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 12:58:14 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 488/979] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:58:14 2024] GET /share/v2/82840ccb77144a4aa2d0bdce807ce686/shares/3f6b8420-fc46-47fc-b707-d08dfd01280f => generated 1319 bytes in 28 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:58:14 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-35ac5d5c-ab40-455d-a00b-d13154c597bc tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] GET http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/snapshots/61a994a9-64ae-4c8f-9475-6c6a0b8e910b May 28 12:58:14 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-35ac5d5c-ab40-455d-a00b-d13154c597bc tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:14 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-35ac5d5c-ab40-455d-a00b-d13154c597bc tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Calling method 'ShareSnapshotMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:14 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-7ef25264-edb1-437e-95f6-9de580d263f4 tempest-ResourceLockCRUTest-1971036144 tempest-ResourceLockCRUTest-1971036144-project-member] POST http://10.27.203.238/share/v2/82840ccb77144a4aa2d0bdce807ce686/resource-locks May 28 12:58:14 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-7ef25264-edb1-437e-95f6-9de580d263f4 tempest-ResourceLockCRUTest-1971036144 tempest-ResourceLockCRUTest-1971036144-project-member] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"resource_lock": {"resource_id": "071c2e61-b4b6-48bf-a1f2-c20b233560ed", "resource_type": "share", "resource_action": "delete", "lock_reason": "clemson tigers rule"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:58:14 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-56e811af-e796-4a9d-8605-933cf433f535 tempest-SharesMetadataTest-1561320255 None] Committed reservations ['bb3bf695-fba4-4e17-a50d-539f4c258ff8', '80d3b3a7-7dd5-4313-9ea2-8d2c29e6764c', 'c5ee52a0-eecd-4cef-89e7-467c8da50741', 'b3d7808b-06e0-4717-b9ea-d4aca66433b0'] {{(pid=98474) commit /opt/stack/manila/manila/quota.py:1063}} May 28 12:58:14 l75lg1-v1 manila-share[98474]: INFO manila.share.manager [None req-56e811af-e796-4a9d-8605-933cf433f535 tempest-SharesMetadataTest-1561320255 None] Share instance 205d35a8-15b8-4a2f-8214-8c2d1a5de6b0: deleted successfully. May 28 12:58:14 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-7ef25264-edb1-437e-95f6-9de580d263f4 tempest-ResourceLockCRUTest-1971036144 tempest-ResourceLockCRUTest-1971036144-project-member] http://10.27.203.238/share/v2/82840ccb77144a4aa2d0bdce807ce686/resource-locks returned with HTTP 200 May 28 12:58:14 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 489/980] 10.27.203.238 () {66 vars in 1386 bytes} [Tue May 28 12:58:14 2024] POST /share/v2/82840ccb77144a4aa2d0bdce807ce686/resource-locks => generated 696 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:58:14 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-35ac5d5c-ab40-455d-a00b-d13154c597bc tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/snapshots/61a994a9-64ae-4c8f-9475-6c6a0b8e910b returned with HTTP 200 May 28 12:58:14 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-4040e88f-4bd4-442b-9f51-700d4581d2ad tempest-ResourceLockCRUTest-1971036144 tempest-ResourceLockCRUTest-1971036144-project-member] POST http://10.27.203.238/share/v2/82840ccb77144a4aa2d0bdce807ce686/resource-locks May 28 12:58:14 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-4040e88f-4bd4-442b-9f51-700d4581d2ad tempest-ResourceLockCRUTest-1971036144 tempest-ResourceLockCRUTest-1971036144-project-member] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"resource_lock": {"resource_id": "3f6b8420-fc46-47fc-b707-d08dfd01280f", "resource_type": "share", "resource_action": "delete", "lock_reason": "locked by tempest tests"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:58:14 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 492/981] 10.27.203.238 () {64 vars in 1460 bytes} [Tue May 28 12:58:14 2024] GET /share/v2/a3499cb78849424db45e54caac01de92/snapshots/61a994a9-64ae-4c8f-9475-6c6a0b8e910b => generated 751 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 231 bytes (2 switches on core 0) May 28 12:58:14 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-957b621e-5200-4efb-82a9-ec05e4454fd7 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] POST http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/snapshots May 28 12:58:14 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-957b621e-5200-4efb-82a9-ec05e4454fd7 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Action: 'create', calling method: ShareSnapshotMixin.create, body: {"snapshot": {"name": "tempest-tempest-created-share-snap-2087857081", "force": false, "description": "Tempest's snapshot", "share_id": "df0ea844-5fc1-4d04-8afb-5048ec5dc33f"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:58:14 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-4040e88f-4bd4-442b-9f51-700d4581d2ad tempest-ResourceLockCRUTest-1971036144 tempest-ResourceLockCRUTest-1971036144-project-member] http://10.27.203.238/share/v2/82840ccb77144a4aa2d0bdce807ce686/resource-locks returned with HTTP 200 May 28 12:58:14 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 490/982] 10.27.203.238 () {66 vars in 1386 bytes} [Tue May 28 12:58:14 2024] POST /share/v2/82840ccb77144a4aa2d0bdce807ce686/resource-locks => generated 700 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 231 bytes (2 switches on core 0) May 28 12:58:14 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.v1.share_snapshots [None req-957b621e-5200-4efb-82a9-ec05e4454fd7 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Create snapshot from share df0ea844-5fc1-4d04-8afb-5048ec5dc33f May 28 12:58:14 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-3a6ccd0a-67d8-4bba-8480-7c1830aadf48 tempest-ResourceLockCRUTest-1971036144 tempest-ResourceLockCRUTest-1971036144-project-member] GET http://10.27.203.238/share/v2/82840ccb77144a4aa2d0bdce807ce686/resource-locks?resource_type=share May 28 12:58:14 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-3a6ccd0a-67d8-4bba-8480-7c1830aadf48 tempest-ResourceLockCRUTest-1971036144 tempest-ResourceLockCRUTest-1971036144-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:14 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-3a6ccd0a-67d8-4bba-8480-7c1830aadf48 tempest-ResourceLockCRUTest-1971036144 tempest-ResourceLockCRUTest-1971036144-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:14 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.lock.api [None req-3a6ccd0a-67d8-4bba-8480-7c1830aadf48 tempest-ResourceLockCRUTest-1971036144 tempest-ResourceLockCRUTest-1971036144-project-member] Searching for locks by: MultiDict([('resource_type', 'share')]) {{(pid=98330) get_all /opt/stack/manila/manila/lock/api.py:112}} May 28 12:58:14 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-3a6ccd0a-67d8-4bba-8480-7c1830aadf48 tempest-ResourceLockCRUTest-1971036144 tempest-ResourceLockCRUTest-1971036144-project-member] http://10.27.203.238/share/v2/82840ccb77144a4aa2d0bdce807ce686/resource-locks?resource_type=share returned with HTTP 200 May 28 12:58:14 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 491/983] 10.27.203.238 () {64 vars in 1403 bytes} [Tue May 28 12:58:14 2024] GET /share/v2/82840ccb77144a4aa2d0bdce807ce686/resource-locks?resource_type=share => generated 2065 bytes in 13 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:58:14 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-8735eca3-8d04-46b1-8af8-3deac8461303 tempest-ResourceLockCRUTest-1971036144 tempest-ResourceLockCRUTest-1971036144-project-member] GET http://10.27.203.238/share/v2/82840ccb77144a4aa2d0bdce807ce686/resource-locks?resource_id=071c2e61-b4b6-48bf-a1f2-c20b233560ed May 28 12:58:14 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-8735eca3-8d04-46b1-8af8-3deac8461303 tempest-ResourceLockCRUTest-1971036144 tempest-ResourceLockCRUTest-1971036144-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:14 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-8735eca3-8d04-46b1-8af8-3deac8461303 tempest-ResourceLockCRUTest-1971036144 tempest-ResourceLockCRUTest-1971036144-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:14 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.lock.api [None req-8735eca3-8d04-46b1-8af8-3deac8461303 tempest-ResourceLockCRUTest-1971036144 tempest-ResourceLockCRUTest-1971036144-project-member] Searching for locks by: MultiDict([('resource_id', '071c2e61-b4b6-48bf-a1f2-c20b233560ed')]) {{(pid=98330) get_all /opt/stack/manila/manila/lock/api.py:112}} May 28 12:58:14 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-8735eca3-8d04-46b1-8af8-3deac8461303 tempest-ResourceLockCRUTest-1971036144 tempest-ResourceLockCRUTest-1971036144-project-member] http://10.27.203.238/share/v2/82840ccb77144a4aa2d0bdce807ce686/resource-locks?resource_id=071c2e61-b4b6-48bf-a1f2-c20b233560ed returned with HTTP 200 May 28 12:58:14 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 492/984] 10.27.203.238 () {64 vars in 1461 bytes} [Tue May 28 12:58:14 2024] GET /share/v2/82840ccb77144a4aa2d0bdce807ce686/resource-locks?resource_id=071c2e61-b4b6-48bf-a1f2-c20b233560ed => generated 1382 bytes in 11 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:58:14 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-7014935d-b1d2-4940-85f8-d6ae74d63aed tempest-ResourceLockCRUTest-1971036144 tempest-ResourceLockCRUTest-1971036144-project-member] GET http://10.27.203.238/share/v2/82840ccb77144a4aa2d0bdce807ce686/resource-locks?lock_reason~=clemson May 28 12:58:14 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-7014935d-b1d2-4940-85f8-d6ae74d63aed tempest-ResourceLockCRUTest-1971036144 tempest-ResourceLockCRUTest-1971036144-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:14 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-7014935d-b1d2-4940-85f8-d6ae74d63aed tempest-ResourceLockCRUTest-1971036144 tempest-ResourceLockCRUTest-1971036144-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:14 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.lock.api [None req-7014935d-b1d2-4940-85f8-d6ae74d63aed tempest-ResourceLockCRUTest-1971036144 tempest-ResourceLockCRUTest-1971036144-project-member] Searching for locks by: MultiDict([('lock_reason~', 'clemson')]) {{(pid=98330) get_all /opt/stack/manila/manila/lock/api.py:112}} May 28 12:58:14 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-7014935d-b1d2-4940-85f8-d6ae74d63aed tempest-ResourceLockCRUTest-1971036144 tempest-ResourceLockCRUTest-1971036144-project-member] http://10.27.203.238/share/v2/82840ccb77144a4aa2d0bdce807ce686/resource-locks?lock_reason~=clemson returned with HTTP 200 May 28 12:58:14 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 493/985] 10.27.203.238 () {64 vars in 1405 bytes} [Tue May 28 12:58:14 2024] GET /share/v2/82840ccb77144a4aa2d0bdce807ce686/resource-locks?lock_reason~=clemson => generated 699 bytes in 13 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:58:14 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-aec9508f-fcdf-429a-86f7-26d7e1df0b88 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] POST http://10.27.203.238/share/v2/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action May 28 12:58:14 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-aec9508f-fcdf-429a-86f7-26d7e1df0b88 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Action body: b'{"access_list": null}' {{(pid=98330) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:58:14 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-aec9508f-fcdf-429a-86f7-26d7e1df0b88 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Action: 'action', calling method: ShareController.access_list, body: {"access_list": null} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:58:14 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.quota [None req-957b621e-5200-4efb-82a9-ec05e4454fd7 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Created reservations ['7788b200-e22a-42bd-9836-2d3d6a6f13e0', '039c0af1-3389-45ca-b06c-3b8ed6fa5e95', 'd799b91b-e5fe-4dac-af4e-c965f285bd93', '99ccdfb1-a4ad-4ec8-8b6c-a2f481f6682d'] {{(pid=98329) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 12:58:14 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-aec9508f-fcdf-429a-86f7-26d7e1df0b88 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] http://10.27.203.238/share/v2/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action returned with HTTP 200 May 28 12:58:14 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 494/986] 10.27.203.238 () {66 vars in 1493 bytes} [Tue May 28 12:58:14 2024] POST /share/v2/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action => generated 280 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:58:14 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-746a09ef-4a2f-49c6-8777-6a1612af224b tempest-ResourceLockCRUTest-1971036144 tempest-ResourceLockCRUTest-1971036144-project-member] GET http://10.27.203.238/share/v2/82840ccb77144a4aa2d0bdce807ce686/resource-locks?created_since=2024-05-28+12%3A58%3A06.998500 May 28 12:58:14 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-746a09ef-4a2f-49c6-8777-6a1612af224b tempest-ResourceLockCRUTest-1971036144 tempest-ResourceLockCRUTest-1971036144-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:14 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-746a09ef-4a2f-49c6-8777-6a1612af224b tempest-ResourceLockCRUTest-1971036144 tempest-ResourceLockCRUTest-1971036144-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:14 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.lock.api [None req-746a09ef-4a2f-49c6-8777-6a1612af224b tempest-ResourceLockCRUTest-1971036144 tempest-ResourceLockCRUTest-1971036144-project-member] Searching for locks by: MultiDict([('created_since', datetime.datetime(2024, 5, 28, 12, 58, 6, 998500, tzinfo=datetime.timezone.utc))]) {{(pid=98330) get_all /opt/stack/manila/manila/lock/api.py:112}} May 28 12:58:14 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-746a09ef-4a2f-49c6-8777-6a1612af224b tempest-ResourceLockCRUTest-1971036144 tempest-ResourceLockCRUTest-1971036144-project-member] http://10.27.203.238/share/v2/82840ccb77144a4aa2d0bdce807ce686/resource-locks?created_since=2024-05-28+12%3A58%3A06.998500 returned with HTTP 200 May 28 12:58:14 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 495/987] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 12:58:14 2024] GET /share/v2/82840ccb77144a4aa2d0bdce807ce686/resource-locks?created_since=2024-05-28+12%3A58%3A06.998500 => generated 2065 bytes in 12 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:58:15 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-fc7786ae-8cb0-4e33-a1fe-ca532efa61e3 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] POST http://10.27.203.238/share/v2/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action May 28 12:58:15 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-fc7786ae-8cb0-4e33-a1fe-ca532efa61e3 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Action body: b'{"deny_access": {"access_id": "b86d8ed2-c35d-4fc2-9339-5fbce5bc5ae0"}}' {{(pid=98330) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:58:15 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-fc7786ae-8cb0-4e33-a1fe-ca532efa61e3 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Action: 'action', calling method: ShareController.deny_access, body: {"deny_access": {"access_id": "b86d8ed2-c35d-4fc2-9339-5fbce5bc5ae0"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:58:15 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.lock.api [None req-fc7786ae-8cb0-4e33-a1fe-ca532efa61e3 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Searching for locks by: {'resource_id': 'b86d8ed2-c35d-4fc2-9339-5fbce5bc5ae0', 'resource_action': 'delete'} {{(pid=98330) get_all /opt/stack/manila/manila/lock/api.py:112}} May 28 12:58:15 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.quota [None req-957b621e-5200-4efb-82a9-ec05e4454fd7 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Committed reservations ['7788b200-e22a-42bd-9836-2d3d6a6f13e0', '039c0af1-3389-45ca-b06c-3b8ed6fa5e95', 'd799b91b-e5fe-4dac-af4e-c965f285bd93', '99ccdfb1-a4ad-4ec8-8b6c-a2f481f6682d'] {{(pid=98329) commit /opt/stack/manila/manila/quota.py:1063}} May 28 12:58:15 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-957b621e-5200-4efb-82a9-ec05e4454fd7 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/snapshots returned with HTTP 202 May 28 12:58:15 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 493/988] 10.27.203.238 () {66 vars in 1371 bytes} [Tue May 28 12:58:14 2024] POST /share/v2/a3499cb78849424db45e54caac01de92/snapshots => generated 750 bytes in 183 msecs (HTTP/1.1 202) 6 headers in 237 bytes (2 switches on core 0) May 28 12:58:15 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-d09944ce-ad14-458d-869d-1f629c258a23 tempest-ResourceLockCRUTest-1971036144 tempest-ResourceLockCRUTest-1971036144-project-member] GET http://10.27.203.238/share/v2/82840ccb77144a4aa2d0bdce807ce686/resource-locks?created_since=2024-05-28+12%3A58%3A06.998500&created_before=2024-05-28+12%3A58%3A14.892018 May 28 12:58:15 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-d09944ce-ad14-458d-869d-1f629c258a23 tempest-ResourceLockCRUTest-1971036144 tempest-ResourceLockCRUTest-1971036144-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:15 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-d09944ce-ad14-458d-869d-1f629c258a23 tempest-ResourceLockCRUTest-1971036144 tempest-ResourceLockCRUTest-1971036144-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:15 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.lock.api [None req-d09944ce-ad14-458d-869d-1f629c258a23 tempest-ResourceLockCRUTest-1971036144 tempest-ResourceLockCRUTest-1971036144-project-member] Searching for locks by: MultiDict([('created_since', datetime.datetime(2024, 5, 28, 12, 58, 6, 998500, tzinfo=datetime.timezone.utc)), ('created_before', datetime.datetime(2024, 5, 28, 12, 58, 14, 892018, tzinfo=datetime.timezone.utc))]) {{(pid=98329) get_all /opt/stack/manila/manila/lock/api.py:112}} May 28 12:58:15 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-d09944ce-ad14-458d-869d-1f629c258a23 tempest-ResourceLockCRUTest-1971036144 tempest-ResourceLockCRUTest-1971036144-project-member] http://10.27.203.238/share/v2/82840ccb77144a4aa2d0bdce807ce686/resource-locks?created_since=2024-05-28+12%3A58%3A06.998500&created_before=2024-05-28+12%3A58%3A14.892018 returned with HTTP 200 May 28 12:58:15 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 494/989] 10.27.203.238 () {64 vars in 1545 bytes} [Tue May 28 12:58:15 2024] GET /share/v2/82840ccb77144a4aa2d0bdce807ce686/resource-locks?created_since=2024-05-28+12%3A58%3A06.998500&created_before=2024-05-28+12%3A58%3A14.892018 => generated 1382 bytes in 11 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:58:15 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-878725c6-daa1-4a96-8b52-c83d03a8d1d1 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] GET http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/snapshots/6ddf5f7a-7bad-4eea-9e2e-64307270ec88 May 28 12:58:15 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-878725c6-daa1-4a96-8b52-c83d03a8d1d1 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:15 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-878725c6-daa1-4a96-8b52-c83d03a8d1d1 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Calling method 'ShareSnapshotMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:15 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-fc7786ae-8cb0-4e33-a1fe-ca532efa61e3 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:15 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-fc7786ae-8cb0-4e33-a1fe-ca532efa61e3 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:15 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-878725c6-daa1-4a96-8b52-c83d03a8d1d1 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/snapshots/6ddf5f7a-7bad-4eea-9e2e-64307270ec88 returned with HTTP 200 May 28 12:58:15 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 495/990] 10.27.203.238 () {64 vars in 1460 bytes} [Tue May 28 12:58:15 2024] GET /share/v2/a3499cb78849424db45e54caac01de92/snapshots/6ddf5f7a-7bad-4eea-9e2e-64307270ec88 => generated 750 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:58:15 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-925d0393-1dd5-4525-8a1a-30c8d2091941 tempest-ResourceLockCRUTest-1971036144 tempest-ResourceLockCRUTest-1971036144-project-member] DELETE http://10.27.203.238/share/v2/82840ccb77144a4aa2d0bdce807ce686/resource-locks/c7fe711e-83e8-4175-bee3-96c48ff07008 May 28 12:58:15 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-925d0393-1dd5-4525-8a1a-30c8d2091941 tempest-ResourceLockCRUTest-1971036144 tempest-ResourceLockCRUTest-1971036144-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:15 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-925d0393-1dd5-4525-8a1a-30c8d2091941 tempest-ResourceLockCRUTest-1971036144 tempest-ResourceLockCRUTest-1971036144-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:15 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-fc7786ae-8cb0-4e33-a1fe-ca532efa61e3 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.040s {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:15 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-fc7786ae-8cb0-4e33-a1fe-ca532efa61e3 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:15 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-fc7786ae-8cb0-4e33-a1fe-ca532efa61e3 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:15 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-957b621e-5200-4efb-82a9-ec05e4454fd7 tempest-AdminActionsTest-1749172189 None] >>> [POST] https://127.0.0.1:40443/api/snapshots/ May 28 12:58:15 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-957b621e-5200-4efb-82a9-ec05e4454fd7 tempest-AdminActionsTest-1749172189 None] {'data': '{"path": "/manila/manila-77a25e6b-f137-4342-8eb9-9ced679515e2", ' May 28 12:58:15 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-957b621e-5200-4efb-82a9-ec05e4454fd7 tempest-AdminActionsTest-1749172189 None] '"name": "share-snapshot-64c48761-d84e-4d5e-adb5-0cae2ce900e5"}', May 28 12:58:15 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-957b621e-5200-4efb-82a9-ec05e4454fd7 tempest-AdminActionsTest-1749172189 None] 'json': None, May 28 12:58:15 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-957b621e-5200-4efb-82a9-ec05e4454fd7 tempest-AdminActionsTest-1749172189 None] 'params': None} May 28 12:58:15 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-925d0393-1dd5-4525-8a1a-30c8d2091941 tempest-ResourceLockCRUTest-1971036144 tempest-ResourceLockCRUTest-1971036144-project-member] http://10.27.203.238/share/v2/82840ccb77144a4aa2d0bdce807ce686/resource-locks/c7fe711e-83e8-4175-bee3-96c48ff07008 returned with HTTP 204 May 28 12:58:15 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 496/991] 10.27.203.238 () {64 vars in 1478 bytes} [Tue May 28 12:58:15 2024] DELETE /share/v2/82840ccb77144a4aa2d0bdce807ce686/resource-locks/c7fe711e-83e8-4175-bee3-96c48ff07008 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 6 headers in 245 bytes (1 switches on core 0) May 28 12:58:15 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-d2dc9697-8989-4851-9280-97b6ff8304b6 tempest-ResourceLockCRUTest-1971036144 tempest-ResourceLockCRUTest-1971036144-project-member] DELETE http://10.27.203.238/share/v2/82840ccb77144a4aa2d0bdce807ce686/resource-locks/3f4aabb4-a7d9-4c2b-985c-bcbdbe8034d6 May 28 12:58:15 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-d2dc9697-8989-4851-9280-97b6ff8304b6 tempest-ResourceLockCRUTest-1971036144 tempest-ResourceLockCRUTest-1971036144-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:15 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-d2dc9697-8989-4851-9280-97b6ff8304b6 tempest-ResourceLockCRUTest-1971036144 tempest-ResourceLockCRUTest-1971036144-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:15 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-d2dc9697-8989-4851-9280-97b6ff8304b6 tempest-ResourceLockCRUTest-1971036144 tempest-ResourceLockCRUTest-1971036144-project-member] http://10.27.203.238/share/v2/82840ccb77144a4aa2d0bdce807ce686/resource-locks/3f4aabb4-a7d9-4c2b-985c-bcbdbe8034d6 returned with HTTP 204 May 28 12:58:15 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 497/992] 10.27.203.238 () {64 vars in 1478 bytes} [Tue May 28 12:58:15 2024] DELETE /share/v2/82840ccb77144a4aa2d0bdce807ce686/resource-locks/3f4aabb4-a7d9-4c2b-985c-bcbdbe8034d6 => generated 0 bytes in 22 msecs (HTTP/1.1 204) 6 headers in 245 bytes (2 switches on core 0) May 28 12:58:15 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-fc7786ae-8cb0-4e33-a1fe-ca532efa61e3 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.065s {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:15 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-fc7786ae-8cb0-4e33-a1fe-ca532efa61e3 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] http://10.27.203.238/share/v2/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action returned with HTTP 202 May 28 12:58:15 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 496/993] 10.27.203.238 () {66 vars in 1493 bytes} [Tue May 28 12:58:14 2024] POST /share/v2/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action => generated 0 bytes in 186 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:58:15 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-e1af55c5-efc4-4128-9cfb-e51372600e74 tempest-ResourceLockCRUTest-1971036144 tempest-ResourceLockCRUTest-1971036144-project-member] POST http://10.27.203.238/share/v2/82840ccb77144a4aa2d0bdce807ce686/resource-locks May 28 12:58:15 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-e1af55c5-efc4-4128-9cfb-e51372600e74 tempest-ResourceLockCRUTest-1971036144 tempest-ResourceLockCRUTest-1971036144-project-member] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"resource_lock": {"resource_id": "071c2e61-b4b6-48bf-a1f2-c20b233560ed", "resource_type": "share", "resource_action": "delete", "lock_reason": "locked by tempest tests"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:58:15 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-582e52e2-dd27-4936-b41a-c57c69600c9b tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] GET http://10.27.203.238/share/v2/776f75906bc64f8f9316d5aab4b50bf1/share-access-rules?share_id=1ddadc17-cf10-4a42-8bbd-8335fb3520a1 May 28 12:58:15 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-582e52e2-dd27-4936-b41a-c57c69600c9b tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:15 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-582e52e2-dd27-4936-b41a-c57c69600c9b tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:15 l75lg1-v1 manila-share[98474]: DEBUG manila.share.manager [None req-fc7786ae-8cb0-4e33-a1fe-ca532efa61e3 tempest-ShareIpRulesForNFSTest-1748669711 None] Received request to update access for share instance b7a7d61c-2cea-442a-9809-507038e080d5. {{(pid=98474) update_access_for_instances /opt/stack/manila/manila/share/manager.py:4353}} May 28 12:58:15 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-e1af55c5-efc4-4128-9cfb-e51372600e74 tempest-ResourceLockCRUTest-1971036144 tempest-ResourceLockCRUTest-1971036144-project-member] http://10.27.203.238/share/v2/82840ccb77144a4aa2d0bdce807ce686/resource-locks returned with HTTP 200 May 28 12:58:15 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 498/994] 10.27.203.238 () {66 vars in 1386 bytes} [Tue May 28 12:58:15 2024] POST /share/v2/82840ccb77144a4aa2d0bdce807ce686/resource-locks => generated 700 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 231 bytes (2 switches on core 0) May 28 12:58:15 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-fc7786ae-8cb0-4e33-a1fe-ca532efa61e3 tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:15 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-fc7786ae-8cb0-4e33-a1fe-ca532efa61e3 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:15 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-fc7786ae-8cb0-4e33-a1fe-ca532efa61e3 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:15 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-fc7786ae-8cb0-4e33-a1fe-ca532efa61e3 tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:15 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-fc7786ae-8cb0-4e33-a1fe-ca532efa61e3 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:15 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.lock.api [None req-582e52e2-dd27-4936-b41a-c57c69600c9b tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Searching for locks by: {'resource_id': 'b86d8ed2-c35d-4fc2-9339-5fbce5bc5ae0', 'resource_action': 'show', 'resource_type': 'access_rule'} {{(pid=98330) get_all /opt/stack/manila/manila/lock/api.py:112}} May 28 12:58:15 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-9bc85dcf-bea4-4c68-8454-fa2e61fe017f tempest-ResourceLockCRUTest-1971036144 tempest-ResourceLockCRUTest-1971036144-project-member] POST http://10.27.203.238/share/v2/82840ccb77144a4aa2d0bdce807ce686/resource-locks May 28 12:58:15 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-9bc85dcf-bea4-4c68-8454-fa2e61fe017f tempest-ResourceLockCRUTest-1971036144 tempest-ResourceLockCRUTest-1971036144-project-member] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"resource_lock": {"resource_id": "071c2e61-b4b6-48bf-a1f2-c20b233560ed", "resource_type": "share", "resource_action": "delete", "lock_reason": "locked by tempest tests"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:58:15 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-582e52e2-dd27-4936-b41a-c57c69600c9b tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] http://10.27.203.238/share/v2/776f75906bc64f8f9316d5aab4b50bf1/share-access-rules?share_id=1ddadc17-cf10-4a42-8bbd-8335fb3520a1 returned with HTTP 200 May 28 12:58:15 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 497/995] 10.27.203.238 () {64 vars in 1467 bytes} [Tue May 28 12:58:15 2024] GET /share/v2/776f75906bc64f8f9316d5aab4b50bf1/share-access-rules?share_id=1ddadc17-cf10-4a42-8bbd-8335fb3520a1 => generated 304 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:58:15 l75lg1-v1 dstat.sh[49771]: 28-05 12:58:15| 14 2 82 2 0|5712M 1772M 277M 7863M| 34k 8245B| 0 2119k| 0 283 |5947 10k|1.34 1.07 1.01|5.0 1.0 0| 0 0 | 0 2048M| 29 359 0 39 0 May 28 12:58:15 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-9bc85dcf-bea4-4c68-8454-fa2e61fe017f tempest-ResourceLockCRUTest-1971036144 tempest-ResourceLockCRUTest-1971036144-project-member] http://10.27.203.238/share/v2/82840ccb77144a4aa2d0bdce807ce686/resource-locks returned with HTTP 200 May 28 12:58:15 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 499/996] 10.27.203.238 () {66 vars in 1386 bytes} [Tue May 28 12:58:15 2024] POST /share/v2/82840ccb77144a4aa2d0bdce807ce686/resource-locks => generated 700 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 231 bytes (2 switches on core 0) May 28 12:58:15 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-fc1b6229-9d9a-48f1-881c-cbb6a0ed7d7b tempest-ResourceLockCRUTest-1971036144 tempest-ResourceLockCRUTest-1971036144-project-member] GET http://10.27.203.238/share/v2/82840ccb77144a4aa2d0bdce807ce686/resource-locks?sort_key=created_at&sort_dir=asc&limit=2 May 28 12:58:15 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-fc1b6229-9d9a-48f1-881c-cbb6a0ed7d7b tempest-ResourceLockCRUTest-1971036144 tempest-ResourceLockCRUTest-1971036144-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:15 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-fc1b6229-9d9a-48f1-881c-cbb6a0ed7d7b tempest-ResourceLockCRUTest-1971036144 tempest-ResourceLockCRUTest-1971036144-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:15 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.lock.api [None req-fc1b6229-9d9a-48f1-881c-cbb6a0ed7d7b tempest-ResourceLockCRUTest-1971036144 tempest-ResourceLockCRUTest-1971036144-project-member] Searching for locks by: MultiDict([]) {{(pid=98330) get_all /opt/stack/manila/manila/lock/api.py:112}} May 28 12:58:15 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-fc1b6229-9d9a-48f1-881c-cbb6a0ed7d7b tempest-ResourceLockCRUTest-1971036144 tempest-ResourceLockCRUTest-1971036144-project-member] http://10.27.203.238/share/v2/82840ccb77144a4aa2d0bdce807ce686/resource-locks?sort_key=created_at&sort_dir=asc&limit=2 returned with HTTP 200 May 28 12:58:15 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 498/997] 10.27.203.238 () {64 vars in 1445 bytes} [Tue May 28 12:58:15 2024] GET /share/v2/82840ccb77144a4aa2d0bdce807ce686/resource-locks?sort_key=created_at&sort_dir=asc&limit=2 => generated 1603 bytes in 13 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:58:15 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-fc7786ae-8cb0-4e33-a1fe-ca532efa61e3 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.058s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:15 l75lg1-v1 manila-share[98474]: DEBUG manila.share.access [None req-fc7786ae-8cb0-4e33-a1fe-ca532efa61e3 tempest-ShareIpRulesForNFSTest-1748669711 None] Updating access rules for share instance b7a7d61c-2cea-442a-9809-507038e080d5 belonging to share 1ddadc17-cf10-4a42-8bbd-8335fb3520a1. {{(pid=98474) update_access_rules /opt/stack/manila/manila/share/access.py:298}} May 28 12:58:15 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-4def5fef-8390-4806-b69e-7dac07bc3cbe tempest-ResourceLockCRUTest-1971036144 tempest-ResourceLockCRUTest-1971036144-project-member] DELETE http://10.27.203.238/share/v2/82840ccb77144a4aa2d0bdce807ce686/resource-locks/17e9c957-3448-4102-be6b-b75b459cf6c3 May 28 12:58:15 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-4def5fef-8390-4806-b69e-7dac07bc3cbe tempest-ResourceLockCRUTest-1971036144 tempest-ResourceLockCRUTest-1971036144-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:15 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-4def5fef-8390-4806-b69e-7dac07bc3cbe tempest-ResourceLockCRUTest-1971036144 tempest-ResourceLockCRUTest-1971036144-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:15 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-4def5fef-8390-4806-b69e-7dac07bc3cbe tempest-ResourceLockCRUTest-1971036144 tempest-ResourceLockCRUTest-1971036144-project-member] http://10.27.203.238/share/v2/82840ccb77144a4aa2d0bdce807ce686/resource-locks/17e9c957-3448-4102-be6b-b75b459cf6c3 returned with HTTP 204 May 28 12:58:15 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 500/998] 10.27.203.238 () {64 vars in 1478 bytes} [Tue May 28 12:58:15 2024] DELETE /share/v2/82840ccb77144a4aa2d0bdce807ce686/resource-locks/17e9c957-3448-4102-be6b-b75b459cf6c3 => generated 0 bytes in 22 msecs (HTTP/1.1 204) 6 headers in 245 bytes (1 switches on core 0) May 28 12:58:15 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-fc7786ae-8cb0-4e33-a1fe-ca532efa61e3 tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:15 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-fc7786ae-8cb0-4e33-a1fe-ca532efa61e3 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:15 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-fbcdff72-c555-419b-a099-896e01c0653b tempest-ResourceLockCRUTest-1971036144 tempest-ResourceLockCRUTest-1971036144-project-member] DELETE http://10.27.203.238/share/v2/82840ccb77144a4aa2d0bdce807ce686/resource-locks/5854762c-6c57-47f0-954e-edec81ae1f44 May 28 12:58:15 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-fbcdff72-c555-419b-a099-896e01c0653b tempest-ResourceLockCRUTest-1971036144 tempest-ResourceLockCRUTest-1971036144-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:15 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-fbcdff72-c555-419b-a099-896e01c0653b tempest-ResourceLockCRUTest-1971036144 tempest-ResourceLockCRUTest-1971036144-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:15 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-fc7786ae-8cb0-4e33-a1fe-ca532efa61e3 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.009s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:15 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-fc7786ae-8cb0-4e33-a1fe-ca532efa61e3 tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:15 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-fc7786ae-8cb0-4e33-a1fe-ca532efa61e3 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:15 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-fbcdff72-c555-419b-a099-896e01c0653b tempest-ResourceLockCRUTest-1971036144 tempest-ResourceLockCRUTest-1971036144-project-member] http://10.27.203.238/share/v2/82840ccb77144a4aa2d0bdce807ce686/resource-locks/5854762c-6c57-47f0-954e-edec81ae1f44 returned with HTTP 204 May 28 12:58:15 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 499/999] 10.27.203.238 () {64 vars in 1478 bytes} [Tue May 28 12:58:15 2024] DELETE /share/v2/82840ccb77144a4aa2d0bdce807ce686/resource-locks/5854762c-6c57-47f0-954e-edec81ae1f44 => generated 0 bytes in 23 msecs (HTTP/1.1 204) 6 headers in 245 bytes (1 switches on core 0) May 28 12:58:15 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-fc7786ae-8cb0-4e33-a1fe-ca532efa61e3 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.018s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:15 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-fc7786ae-8cb0-4e33-a1fe-ca532efa61e3 tempest-ShareIpRulesForNFSTest-1748669711 None] changing access on None May 28 12:58:15 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-fc7786ae-8cb0-4e33-a1fe-ca532efa61e3 tempest-ShareIpRulesForNFSTest-1748669711 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:58:15 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-fc7786ae-8cb0-4e33-a1fe-ca532efa61e3 tempest-ShareIpRulesForNFSTest-1748669711 None] {'allow_redirects': True, May 28 12:58:15 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-fc7786ae-8cb0-4e33-a1fe-ca532efa61e3 tempest-ShareIpRulesForNFSTest-1748669711 None] 'params': {'name': 'b7a7d61c-2cea-442a-9809-507038e080d5'}} May 28 12:58:15 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-3b62a7cb-9b92-4cd4-aecb-e07e96baafe6 tempest-ResourceLockCRUTest-1971036144 tempest-ResourceLockCRUTest-1971036144-project-member] PUT http://10.27.203.238/share/v2/82840ccb77144a4aa2d0bdce807ce686/resource-locks/87ef736f-2afb-4d32-9520-592130b1715a May 28 12:58:15 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-3b62a7cb-9b92-4cd4-aecb-e07e96baafe6 tempest-ResourceLockCRUTest-1971036144 tempest-ResourceLockCRUTest-1971036144-project-member] Action: 'update', calling method: Controller.__getattribute__..version_select, body: {"resource_lock": {"lock_reason": "new lock reason"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:58:15 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-3b62a7cb-9b92-4cd4-aecb-e07e96baafe6 tempest-ResourceLockCRUTest-1971036144 tempest-ResourceLockCRUTest-1971036144-project-member] http://10.27.203.238/share/v2/82840ccb77144a4aa2d0bdce807ce686/resource-locks/87ef736f-2afb-4d32-9520-592130b1715a returned with HTTP 200 May 28 12:58:15 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 501/1000] 10.27.203.238 () {66 vars in 1495 bytes} [Tue May 28 12:58:15 2024] PUT /share/v2/82840ccb77144a4aa2d0bdce807ce686/resource-locks/87ef736f-2afb-4d32-9520-592130b1715a => generated 716 bytes in 27 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:58:15 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-852d5e78-9f75-41d9-a4b0-43476ab90028 tempest-ResourceLockCRUTest-1971036144 tempest-ResourceLockCRUTest-1971036144-project-member] GET http://10.27.203.238/share/v2/82840ccb77144a4aa2d0bdce807ce686/resource-locks/87ef736f-2afb-4d32-9520-592130b1715a May 28 12:58:15 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-852d5e78-9f75-41d9-a4b0-43476ab90028 tempest-ResourceLockCRUTest-1971036144 tempest-ResourceLockCRUTest-1971036144-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:15 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-852d5e78-9f75-41d9-a4b0-43476ab90028 tempest-ResourceLockCRUTest-1971036144 tempest-ResourceLockCRUTest-1971036144-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:15 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-852d5e78-9f75-41d9-a4b0-43476ab90028 tempest-ResourceLockCRUTest-1971036144 tempest-ResourceLockCRUTest-1971036144-project-member] http://10.27.203.238/share/v2/82840ccb77144a4aa2d0bdce807ce686/resource-locks/87ef736f-2afb-4d32-9520-592130b1715a returned with HTTP 200 May 28 12:58:15 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 500/1001] 10.27.203.238 () {64 vars in 1475 bytes} [Tue May 28 12:58:15 2024] GET /share/v2/82840ccb77144a4aa2d0bdce807ce686/resource-locks/87ef736f-2afb-4d32-9520-592130b1715a => generated 716 bytes in 11 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:58:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efa86ca-4497-4343-bfd3-8571f2c56e62 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efa86ca-4497-4343-bfd3-8571f2c56e62 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69096ef-3f8a-48d8-b7e8-fd40824e4206 tempest-ResourceLockCRUTest-1063854601 tempest-ResourceLockCRUTest-1063854601-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cacdef9ca5d04afb85fa43f2d0e57632', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bcb84add5bc4d8cb675498201734b6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69096ef-3f8a-48d8-b7e8-fd40824e4206 tempest-ResourceLockCRUTest-1063854601 tempest-ResourceLockCRUTest-1063854601-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69096ef-3f8a-48d8-b7e8-fd40824e4206 tempest-ResourceLockCRUTest-1063854601 tempest-ResourceLockCRUTest-1063854601-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69096ef-3f8a-48d8-b7e8-fd40824e4206 tempest-ResourceLockCRUTest-1063854601 tempest-ResourceLockCRUTest-1063854601-project-admin] PATH_INFO: `/v3/users/14783f4fbce14880b4db4a628827607e` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69096ef-3f8a-48d8-b7e8-fd40824e4206 tempest-ResourceLockCRUTest-1063854601 tempest-ResourceLockCRUTest-1063854601-project-admin] RBAC: Authorizing `identity:delete_user(user_id=14783f4fbce14880b4db4a628827607e)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69096ef-3f8a-48d8-b7e8-fd40824e4206 tempest-ResourceLockCRUTest-1063854601 tempest-ResourceLockCRUTest-1063854601-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-e69096ef-3f8a-48d8-b7e8-fd40824e4206 tempest-ResourceLockCRUTest-1063854601 tempest-ResourceLockCRUTest-1063854601-project-admin] Could not find user: 14783f4fbce14880b4db4a628827607e.: keystone.exception.UserNotFound: Could not find user: 14783f4fbce14880b4db4a628827607e. May 28 12:58:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:58:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:58:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:58:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:58:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:58:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:58:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:58:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:58:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:58:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:58:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:58:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 12:58:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 12:58:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:58:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:58:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 12:58:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:58:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 12:58:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:58:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 12:58:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 12:58:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:58:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:58:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 12:58:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:58:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 12:58:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:58:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:58:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:58:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:58:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:58:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:58:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 12:58:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:58:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 12:58:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:58:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:58:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:58:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 12:58:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:58:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 12:58:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 12:58:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 12:58:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 12:58:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 12:58:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 12:58:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 12:58:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 14783f4fbce14880b4db4a628827607e. May 28 12:58:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 12:58:15 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1086/2148] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 12:58:15 2024] DELETE /identity/v3/users/14783f4fbce14880b4db4a628827607e => generated 110 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 12:58:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a107e8-3ee7-44d2-8476-cd65947eb904 service manila] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a107e8-3ee7-44d2-8476-cd65947eb904 service manila] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f09383-0213-4847-ab96-cf141b110a6b tempest-ResourceLockCRUTest-1063854601 tempest-ResourceLockCRUTest-1063854601-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cacdef9ca5d04afb85fa43f2d0e57632', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bcb84add5bc4d8cb675498201734b6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f09383-0213-4847-ab96-cf141b110a6b tempest-ResourceLockCRUTest-1063854601 tempest-ResourceLockCRUTest-1063854601-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f09383-0213-4847-ab96-cf141b110a6b tempest-ResourceLockCRUTest-1063854601 tempest-ResourceLockCRUTest-1063854601-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f09383-0213-4847-ab96-cf141b110a6b tempest-ResourceLockCRUTest-1063854601 tempest-ResourceLockCRUTest-1063854601-project-admin] PATH_INFO: `/v3/users/9eca355145fd413390b5efe7a0d95465` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f09383-0213-4847-ab96-cf141b110a6b tempest-ResourceLockCRUTest-1063854601 tempest-ResourceLockCRUTest-1063854601-project-admin] RBAC: Authorizing `identity:delete_user(user_id=9eca355145fd413390b5efe7a0d95465)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f09383-0213-4847-ab96-cf141b110a6b tempest-ResourceLockCRUTest-1063854601 tempest-ResourceLockCRUTest-1063854601-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-42f09383-0213-4847-ab96-cf141b110a6b tempest-ResourceLockCRUTest-1063854601 tempest-ResourceLockCRUTest-1063854601-project-admin] Could not find user: 9eca355145fd413390b5efe7a0d95465.: keystone.exception.UserNotFound: Could not find user: 9eca355145fd413390b5efe7a0d95465. May 28 12:58:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:58:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:58:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:58:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:58:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:58:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:58:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:58:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:58:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:58:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:58:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:58:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 12:58:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 12:58:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:58:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:58:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 12:58:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:58:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 12:58:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:58:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 12:58:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 12:58:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:58:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:58:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 12:58:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:58:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 12:58:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:58:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:58:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:58:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:58:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:58:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:58:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 12:58:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:58:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 12:58:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:58:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:58:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:58:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 12:58:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:58:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 12:58:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 12:58:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 12:58:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 12:58:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 12:58:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 12:58:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 12:58:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 9eca355145fd413390b5efe7a0d95465. May 28 12:58:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 12:58:15 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1063/2149] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 12:58:15 2024] DELETE /identity/v3/users/9eca355145fd413390b5efe7a0d95465 => generated 110 bytes in 26 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 12:58:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69096ef-3f8a-48d8-b7e8-fd40824e4206 tempest-ResourceLockCRUTest-1063854601 tempest-ResourceLockCRUTest-1063854601-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69096ef-3f8a-48d8-b7e8-fd40824e4206 tempest-ResourceLockCRUTest-1063854601 tempest-ResourceLockCRUTest-1063854601-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2678019-a6de-48e0-95ac-6ba28fd60811 tempest-ResourceLockCRUTest-1063854601 tempest-ResourceLockCRUTest-1063854601-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cacdef9ca5d04afb85fa43f2d0e57632', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bcb84add5bc4d8cb675498201734b6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2678019-a6de-48e0-95ac-6ba28fd60811 tempest-ResourceLockCRUTest-1063854601 tempest-ResourceLockCRUTest-1063854601-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2678019-a6de-48e0-95ac-6ba28fd60811 tempest-ResourceLockCRUTest-1063854601 tempest-ResourceLockCRUTest-1063854601-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2678019-a6de-48e0-95ac-6ba28fd60811 tempest-ResourceLockCRUTest-1063854601 tempest-ResourceLockCRUTest-1063854601-project-admin] PATH_INFO: `/v3/users/91ab54ee09854b549923fb7671247f5c` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2678019-a6de-48e0-95ac-6ba28fd60811 tempest-ResourceLockCRUTest-1063854601 tempest-ResourceLockCRUTest-1063854601-project-admin] RBAC: Authorizing `identity:delete_user(user_id=91ab54ee09854b549923fb7671247f5c)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2678019-a6de-48e0-95ac-6ba28fd60811 tempest-ResourceLockCRUTest-1063854601 tempest-ResourceLockCRUTest-1063854601-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-d2678019-a6de-48e0-95ac-6ba28fd60811 tempest-ResourceLockCRUTest-1063854601 tempest-ResourceLockCRUTest-1063854601-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91ab54ee09854b549923fb7671247f5c', 'request_id': 'req-d2678019-a6de-48e0-95ac-6ba28fd60811'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:58:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-d2678019-a6de-48e0-95ac-6ba28fd60811 tempest-ResourceLockCRUTest-1063854601 tempest-ResourceLockCRUTest-1063854601-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91ab54ee09854b549923fb7671247f5c', 'request_id': 'req-d2678019-a6de-48e0-95ac-6ba28fd60811'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:58:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-d2678019-a6de-48e0-95ac-6ba28fd60811 tempest-ResourceLockCRUTest-1063854601 tempest-ResourceLockCRUTest-1063854601-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91ab54ee09854b549923fb7671247f5c', 'request_id': 'req-d2678019-a6de-48e0-95ac-6ba28fd60811'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:58:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-d2678019-a6de-48e0-95ac-6ba28fd60811 tempest-ResourceLockCRUTest-1063854601 tempest-ResourceLockCRUTest-1063854601-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91ab54ee09854b549923fb7671247f5c', 'request_id': 'req-d2678019-a6de-48e0-95ac-6ba28fd60811'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:58:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-d2678019-a6de-48e0-95ac-6ba28fd60811 tempest-ResourceLockCRUTest-1063854601 tempest-ResourceLockCRUTest-1063854601-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91ab54ee09854b549923fb7671247f5c', 'request_id': 'req-d2678019-a6de-48e0-95ac-6ba28fd60811'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:58:15 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1087/2150] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 12:58:15 2024] DELETE /identity/v3/users/91ab54ee09854b549923fb7671247f5c => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:58:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f09383-0213-4847-ab96-cf141b110a6b tempest-ResourceLockCRUTest-1063854601 tempest-ResourceLockCRUTest-1063854601-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-42f09383-0213-4847-ab96-cf141b110a6b tempest-ResourceLockCRUTest-1063854601 tempest-ResourceLockCRUTest-1063854601-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:58:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f09383-0213-4847-ab96-cf141b110a6b tempest-ResourceLockCRUTest-1063854601 tempest-ResourceLockCRUTest-1063854601-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fab27c-dd61-4ad8-9cce-c2e6ce19eb16 tempest-ResourceLockCRUTest-1063854601 tempest-ResourceLockCRUTest-1063854601-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cacdef9ca5d04afb85fa43f2d0e57632', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bcb84add5bc4d8cb675498201734b6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fab27c-dd61-4ad8-9cce-c2e6ce19eb16 tempest-ResourceLockCRUTest-1063854601 tempest-ResourceLockCRUTest-1063854601-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fab27c-dd61-4ad8-9cce-c2e6ce19eb16 tempest-ResourceLockCRUTest-1063854601 tempest-ResourceLockCRUTest-1063854601-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fab27c-dd61-4ad8-9cce-c2e6ce19eb16 tempest-ResourceLockCRUTest-1063854601 tempest-ResourceLockCRUTest-1063854601-project-admin] PATH_INFO: `/v3/users/2889a927897c49bd92a0d1cfdf27e7f5` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fab27c-dd61-4ad8-9cce-c2e6ce19eb16 tempest-ResourceLockCRUTest-1063854601 tempest-ResourceLockCRUTest-1063854601-project-admin] RBAC: Authorizing `identity:delete_user(user_id=2889a927897c49bd92a0d1cfdf27e7f5)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fab27c-dd61-4ad8-9cce-c2e6ce19eb16 tempest-ResourceLockCRUTest-1063854601 tempest-ResourceLockCRUTest-1063854601-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:15 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-fc7786ae-8cb0-4e33-a1fe-ca532efa61e3 tempest-ShareIpRulesForNFSTest-1748669711 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:58:15 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-fc7786ae-8cb0-4e33-a1fe-ca532efa61e3 tempest-ShareIpRulesForNFSTest-1748669711 None] [Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=1, created='2024-05-28T12:57:40.763635Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='377955ad-d094-4e49-ab32-1021d943a572', id=21, internal=False, is_s3_default_policy=False, name='b7a7d61c-2cea-442a-9809-507038e080d5', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=['*'], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['*'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['*'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T12:58:11.063538Z', tenant_id=1, tenant_name='default', title='b7a7d61c-2cea-442a-9809-507038e080d5', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/21/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[])] May 28 12:58:15 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-fc7786ae-8cb0-4e33-a1fe-ca532efa61e3 tempest-ShareIpRulesForNFSTest-1748669711 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 12:58:15 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-fc7786ae-8cb0-4e33-a1fe-ca532efa61e3 tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:15 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-fc7786ae-8cb0-4e33-a1fe-ca532efa61e3 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-60fab27c-dd61-4ad8-9cce-c2e6ce19eb16 tempest-ResourceLockCRUTest-1063854601 tempest-ResourceLockCRUTest-1063854601-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2889a927897c49bd92a0d1cfdf27e7f5', 'request_id': 'req-60fab27c-dd61-4ad8-9cce-c2e6ce19eb16'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:58:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-60fab27c-dd61-4ad8-9cce-c2e6ce19eb16 tempest-ResourceLockCRUTest-1063854601 tempest-ResourceLockCRUTest-1063854601-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2889a927897c49bd92a0d1cfdf27e7f5', 'request_id': 'req-60fab27c-dd61-4ad8-9cce-c2e6ce19eb16'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:58:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-60fab27c-dd61-4ad8-9cce-c2e6ce19eb16 tempest-ResourceLockCRUTest-1063854601 tempest-ResourceLockCRUTest-1063854601-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2889a927897c49bd92a0d1cfdf27e7f5', 'request_id': 'req-60fab27c-dd61-4ad8-9cce-c2e6ce19eb16'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:58:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-60fab27c-dd61-4ad8-9cce-c2e6ce19eb16 tempest-ResourceLockCRUTest-1063854601 tempest-ResourceLockCRUTest-1063854601-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2889a927897c49bd92a0d1cfdf27e7f5', 'request_id': 'req-60fab27c-dd61-4ad8-9cce-c2e6ce19eb16'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:58:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-60fab27c-dd61-4ad8-9cce-c2e6ce19eb16 tempest-ResourceLockCRUTest-1063854601 tempest-ResourceLockCRUTest-1063854601-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2889a927897c49bd92a0d1cfdf27e7f5', 'request_id': 'req-60fab27c-dd61-4ad8-9cce-c2e6ce19eb16'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:58:15 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-fc7786ae-8cb0-4e33-a1fe-ca532efa61e3 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.031s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:15 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-fc7786ae-8cb0-4e33-a1fe-ca532efa61e3 tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:15 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-fc7786ae-8cb0-4e33-a1fe-ca532efa61e3 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:15 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1064/2151] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 12:58:15 2024] DELETE /identity/v3/users/2889a927897c49bd92a0d1cfdf27e7f5 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:58:15 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-e3c020b4-eead-4de1-a3f4-a86ce727b603 tempest-ResourceLockCRUTest-1971036144 tempest-ResourceLockCRUTest-1971036144-project-member] GET http://10.27.203.238/share/v2/82840ccb77144a4aa2d0bdce807ce686/share-replicas/detail?share_id=3f6b8420-fc46-47fc-b707-d08dfd01280f May 28 12:58:15 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-e3c020b4-eead-4de1-a3f4-a86ce727b603 tempest-ResourceLockCRUTest-1971036144 tempest-ResourceLockCRUTest-1971036144-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:15 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-e3c020b4-eead-4de1-a3f4-a86ce727b603 tempest-ResourceLockCRUTest-1971036144 tempest-ResourceLockCRUTest-1971036144-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:15 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-e3c020b4-eead-4de1-a3f4-a86ce727b603 tempest-ResourceLockCRUTest-1971036144 tempest-ResourceLockCRUTest-1971036144-project-member] http://10.27.203.238/share/v2/82840ccb77144a4aa2d0bdce807ce686/share-replicas/detail?share_id=3f6b8420-fc46-47fc-b707-d08dfd01280f returned with HTTP 200 May 28 12:58:15 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 502/1002] 10.27.203.238 () {64 vars in 1476 bytes} [Tue May 28 12:58:15 2024] GET /share/v2/82840ccb77144a4aa2d0bdce807ce686/share-replicas/detail?share_id=3f6b8420-fc46-47fc-b707-d08dfd01280f => generated 22 bytes in 15 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:58:15 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-fc7786ae-8cb0-4e33-a1fe-ca532efa61e3 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.027s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:15 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-fc7786ae-8cb0-4e33-a1fe-ca532efa61e3 tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:15 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-fc7786ae-8cb0-4e33-a1fe-ca532efa61e3 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:15 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-e4d1993b-6bf2-4567-84a9-36aee9246ffa tempest-ResourceLockCRUTest-1971036144 tempest-ResourceLockCRUTest-1971036144-project-member] DELETE http://10.27.203.238/share/v2/82840ccb77144a4aa2d0bdce807ce686/shares/3f6b8420-fc46-47fc-b707-d08dfd01280f May 28 12:58:15 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-e4d1993b-6bf2-4567-84a9-36aee9246ffa tempest-ResourceLockCRUTest-1971036144 tempest-ResourceLockCRUTest-1971036144-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:15 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-e4d1993b-6bf2-4567-84a9-36aee9246ffa tempest-ResourceLockCRUTest-1971036144 tempest-ResourceLockCRUTest-1971036144-project-member] Calling method 'ShareMixin.delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:15 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.v1.shares [None req-e4d1993b-6bf2-4567-84a9-36aee9246ffa tempest-ResourceLockCRUTest-1971036144 tempest-ResourceLockCRUTest-1971036144-project-member] Delete share with id: 3f6b8420-fc46-47fc-b707-d08dfd01280f May 28 12:58:15 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-fc7786ae-8cb0-4e33-a1fe-ca532efa61e3 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:15 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-fc7786ae-8cb0-4e33-a1fe-ca532efa61e3 tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:15 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-fc7786ae-8cb0-4e33-a1fe-ca532efa61e3 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:15 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-fc7786ae-8cb0-4e33-a1fe-ca532efa61e3 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:15 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-fc7786ae-8cb0-4e33-a1fe-ca532efa61e3 tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:15 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-fc7786ae-8cb0-4e33-a1fe-ca532efa61e3 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:15 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-fc7786ae-8cb0-4e33-a1fe-ca532efa61e3 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.038s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:15 l75lg1-v1 manila-share[98474]: INFO manila.share.access [None req-fc7786ae-8cb0-4e33-a1fe-ca532efa61e3 tempest-ShareIpRulesForNFSTest-1748669711 None] Access rules were successfully modified for share instance b7a7d61c-2cea-442a-9809-507038e080d5 belonging to share 1ddadc17-cf10-4a42-8bbd-8335fb3520a1. May 28 12:58:15 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-e4d1993b-6bf2-4567-84a9-36aee9246ffa tempest-ResourceLockCRUTest-1971036144 tempest-ResourceLockCRUTest-1971036144-project-member] http://10.27.203.238/share/v2/82840ccb77144a4aa2d0bdce807ce686/shares/3f6b8420-fc46-47fc-b707-d08dfd01280f returned with HTTP 202 May 28 12:58:15 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 501/1003] 10.27.203.238 () {64 vars in 1454 bytes} [Tue May 28 12:58:15 2024] DELETE /share/v2/82840ccb77144a4aa2d0bdce807ce686/shares/3f6b8420-fc46-47fc-b707-d08dfd01280f => generated 0 bytes in 131 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:58:15 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-279f5299-c346-4c2e-9b8d-1f831756b5ae tempest-ResourceLockCRUTest-1971036144 tempest-ResourceLockCRUTest-1971036144-project-member] GET http://10.27.203.238/share/v2/82840ccb77144a4aa2d0bdce807ce686/shares/3f6b8420-fc46-47fc-b707-d08dfd01280f May 28 12:58:15 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-279f5299-c346-4c2e-9b8d-1f831756b5ae tempest-ResourceLockCRUTest-1971036144 tempest-ResourceLockCRUTest-1971036144-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:15 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-279f5299-c346-4c2e-9b8d-1f831756b5ae tempest-ResourceLockCRUTest-1971036144 tempest-ResourceLockCRUTest-1971036144-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:15 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-279f5299-c346-4c2e-9b8d-1f831756b5ae tempest-ResourceLockCRUTest-1971036144 tempest-ResourceLockCRUTest-1971036144-project-member] http://10.27.203.238/share/v2/82840ccb77144a4aa2d0bdce807ce686/shares/3f6b8420-fc46-47fc-b707-d08dfd01280f returned with HTTP 200 May 28 12:58:15 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 503/1004] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:58:15 2024] GET /share/v2/82840ccb77144a4aa2d0bdce807ce686/shares/3f6b8420-fc46-47fc-b707-d08dfd01280f => generated 1318 bytes in 25 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:58:15 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-e4d1993b-6bf2-4567-84a9-36aee9246ffa tempest-ResourceLockCRUTest-1971036144 None] Acquiring lock "locked_access_rules_operation_by_share_instance_13a0450c-5c43-4fd2-9710-6cb3885f407a" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:15 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-e4d1993b-6bf2-4567-84a9-36aee9246ffa tempest-ResourceLockCRUTest-1971036144 None] Lock "locked_access_rules_operation_by_share_instance_13a0450c-5c43-4fd2-9710-6cb3885f407a" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:15 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-e4d1993b-6bf2-4567-84a9-36aee9246ffa tempest-ResourceLockCRUTest-1971036144 None] Lock "locked_access_rules_operation_by_share_instance_13a0450c-5c43-4fd2-9710-6cb3885f407a" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:15 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-e4d1993b-6bf2-4567-84a9-36aee9246ffa tempest-ResourceLockCRUTest-1971036144 None] Acquiring lock "locked_access_rules_operation_by_share_instance_13a0450c-5c43-4fd2-9710-6cb3885f407a" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:15 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-e4d1993b-6bf2-4567-84a9-36aee9246ffa tempest-ResourceLockCRUTest-1971036144 None] Lock "locked_access_rules_operation_by_share_instance_13a0450c-5c43-4fd2-9710-6cb3885f407a" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:15 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-e4d1993b-6bf2-4567-84a9-36aee9246ffa tempest-ResourceLockCRUTest-1971036144 None] Lock "locked_access_rules_operation_by_share_instance_13a0450c-5c43-4fd2-9710-6cb3885f407a" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:15 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-e4d1993b-6bf2-4567-84a9-36aee9246ffa tempest-ResourceLockCRUTest-1971036144 None] Acquiring lock "locked_access_rules_operation_by_share_instance_13a0450c-5c43-4fd2-9710-6cb3885f407a" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:15 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-e4d1993b-6bf2-4567-84a9-36aee9246ffa tempest-ResourceLockCRUTest-1971036144 None] Lock "locked_access_rules_operation_by_share_instance_13a0450c-5c43-4fd2-9710-6cb3885f407a" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:15 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-e4d1993b-6bf2-4567-84a9-36aee9246ffa tempest-ResourceLockCRUTest-1971036144 None] Lock "locked_access_rules_operation_by_share_instance_13a0450c-5c43-4fd2-9710-6cb3885f407a" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:15 l75lg1-v1 manila-share[98474]: DEBUG manila.share.access [None req-e4d1993b-6bf2-4567-84a9-36aee9246ffa tempest-ResourceLockCRUTest-1971036144 None] All access rules have been synced for share instance 13a0450c-5c43-4fd2-9710-6cb3885f407a belonging to share 3f6b8420-fc46-47fc-b707-d08dfd01280f. {{(pid=98474) update_access_rules /opt/stack/manila/manila/share/access.py:304}} May 28 12:58:15 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-e4d1993b-6bf2-4567-84a9-36aee9246ffa tempest-ResourceLockCRUTest-1971036144 None] deleting '/manila/manila-13a0450c-5c43-4fd2-9710-6cb3885f407a' May 28 12:58:15 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e4d1993b-6bf2-4567-84a9-36aee9246ffa tempest-ResourceLockCRUTest-1971036144 None] >>> [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/ May 28 12:58:15 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e4d1993b-6bf2-4567-84a9-36aee9246ffa tempest-ResourceLockCRUTest-1971036144 None] {'data': '{"path": "/manila/manila-13a0450c-5c43-4fd2-9710-6cb3885f407a"}', May 28 12:58:15 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e4d1993b-6bf2-4567-84a9-36aee9246ffa tempest-ResourceLockCRUTest-1971036144 None] 'params': None} May 28 12:58:16 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e4d1993b-6bf2-4567-84a9-36aee9246ffa tempest-ResourceLockCRUTest-1971036144 None] <<< [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/ May 28 12:58:16 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e4d1993b-6bf2-4567-84a9-36aee9246ffa tempest-ResourceLockCRUTest-1971036144 None] 'OK' May 28 12:58:16 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e4d1993b-6bf2-4567-84a9-36aee9246ffa tempest-ResourceLockCRUTest-1971036144 None] --- [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/: Done May 28 12:58:16 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e4d1993b-6bf2-4567-84a9-36aee9246ffa tempest-ResourceLockCRUTest-1971036144 None] >>> [GET] https://127.0.0.1:40443/api/views/ May 28 12:58:16 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e4d1993b-6bf2-4567-84a9-36aee9246ffa tempest-ResourceLockCRUTest-1971036144 None] {'allow_redirects': True, May 28 12:58:16 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e4d1993b-6bf2-4567-84a9-36aee9246ffa tempest-ResourceLockCRUTest-1971036144 None] 'params': {'name': '13a0450c-5c43-4fd2-9710-6cb3885f407a'}} May 28 12:58:16 l75lg1-v1 dstat.sh[49771]: 28-05 12:58:16| 10 1 86 2 0|5712M 1772M 277M 7864M| 42k 5792B| 0 2122k| 0 273 |6555 10k|1.34 1.07 1.01|1.0 1.0 0| 0 0 | 0 2048M| 29 357 0 37 0 May 28 12:58:16 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e4d1993b-6bf2-4567-84a9-36aee9246ffa tempest-ResourceLockCRUTest-1971036144 None] <<< [GET] https://127.0.0.1:40443/api/views/ May 28 12:58:16 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e4d1993b-6bf2-4567-84a9-36aee9246ffa tempest-ResourceLockCRUTest-1971036144 None] [Bunch(abac_tags=[], abe_max_depth=None, abe_protocols=[], alias='', allow_anonymous_access=False, allow_s3_anonymous_access=False, auto_commit='0d', bucket='', bucket_creators=[], bucket_creators_groups=[], bucket_owner=None, bulk_permission_update_progress=None, bulk_permission_update_state=None, cluster='loop75-kfs', cluster_id=1, created='2024-05-28T12:58:13.458183Z', enabled=True, files_retention_mode='NONE', guid='31210cc8-1989-48ee-9976-c943b0d36f0c', id=26, ignore_oos=False, internal=False, is_remote=False, is_seamless=False, logical_capacity=0, max_retention_period=None, min_retention_period=None, name='13a0450c-5c43-4fd2-9710-6cb3885f407a', nfs_interop_flags='BOTH_NFS3_AND_NFS4_INTEROP_DISABLED', path='/manila/manila-13a0450c-5c43-4fd2-9710-6cb3885f407a', physical_capacity=0, policy='13a0450c-5c43-4fd2-9710-6cb3885f407a', policy_id=27, protocols=['NFS'], qos_policy=None, qos_policy_id=None, s3_locks=False, s3_locks_retention_mode='NONE', s3_locks_retention_period='', s3_unverified_lookup=False, s3_versioning=False, select_for_live_monitoring=False, share='', share_acl=Bunch(acl=[], enabled=False), sync='SYNCED', sync_time='2024-05-28T12:58:13.699141Z', tenant_id=1, tenant_name='default', title='/manila/manila-13a0450c-5c43-4fd2-9710-6cb3885f407a', url='https://127.0.0.1:40443/api/views/26/')] May 28 12:58:16 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e4d1993b-6bf2-4567-84a9-36aee9246ffa tempest-ResourceLockCRUTest-1971036144 None] --- [GET] https://127.0.0.1:40443/api/views/: Done May 28 12:58:16 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e4d1993b-6bf2-4567-84a9-36aee9246ffa tempest-ResourceLockCRUTest-1971036144 None] >>> [DELETE] https://127.0.0.1:40443/api/views/26/ May 28 12:58:16 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-e840db5b-a372-4322-a9f5-08c4c7cb058a tempest-SnapshotInstancesNegativeTest-1396485679 tempest-SnapshotInstancesNegativeTest-1396485679-project-admin] GET http://10.27.203.238/share/v2/c9cc76ecb4e343a6a51bf36da01debf8/shares/59371a98-d4b3-4967-9846-4759c0b33bb2 May 28 12:58:16 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-e840db5b-a372-4322-a9f5-08c4c7cb058a tempest-SnapshotInstancesNegativeTest-1396485679 tempest-SnapshotInstancesNegativeTest-1396485679-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:16 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-e840db5b-a372-4322-a9f5-08c4c7cb058a tempest-SnapshotInstancesNegativeTest-1396485679 tempest-SnapshotInstancesNegativeTest-1396485679-project-admin] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:16 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-e840db5b-a372-4322-a9f5-08c4c7cb058a tempest-SnapshotInstancesNegativeTest-1396485679 tempest-SnapshotInstancesNegativeTest-1396485679-project-admin] HTTP exception thrown: The resource could not be found. May 28 12:58:16 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-e840db5b-a372-4322-a9f5-08c4c7cb058a tempest-SnapshotInstancesNegativeTest-1396485679 tempest-SnapshotInstancesNegativeTest-1396485679-project-admin] http://10.27.203.238/share/v2/c9cc76ecb4e343a6a51bf36da01debf8/shares/59371a98-d4b3-4967-9846-4759c0b33bb2 returned with HTTP 404 May 28 12:58:16 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 502/1005] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:58:16 2024] GET /share/v2/c9cc76ecb4e343a6a51bf36da01debf8/shares/59371a98-d4b3-4967-9846-4759c0b33bb2 => generated 78 bytes in 11 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 12:58:16 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-6554fa03-3009-4dce-a080-2ab2825102a7 tempest-SnapshotInstancesNegativeTest-1396485679 tempest-SnapshotInstancesNegativeTest-1396485679-project-admin] DELETE http://10.27.203.238/share/v2/c9cc76ecb4e343a6a51bf36da01debf8/types/a7fa0024-941d-4278-af42-a90075e4eab8 May 28 12:58:16 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-6554fa03-3009-4dce-a080-2ab2825102a7 tempest-SnapshotInstancesNegativeTest-1396485679 tempest-SnapshotInstancesNegativeTest-1396485679-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:16 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-6554fa03-3009-4dce-a080-2ab2825102a7 tempest-SnapshotInstancesNegativeTest-1396485679 tempest-SnapshotInstancesNegativeTest-1396485679-project-admin] Calling method 'ShareTypesController._delete' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:17 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-6554fa03-3009-4dce-a080-2ab2825102a7 tempest-SnapshotInstancesNegativeTest-1396485679 tempest-SnapshotInstancesNegativeTest-1396485679-project-admin] http://10.27.203.238/share/v2/c9cc76ecb4e343a6a51bf36da01debf8/types/a7fa0024-941d-4278-af42-a90075e4eab8 returned with HTTP 202 May 28 12:58:17 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 504/1006] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:58:16 2024] DELETE /share/v2/c9cc76ecb4e343a6a51bf36da01debf8/types/a7fa0024-941d-4278-af42-a90075e4eab8 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:58:17 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-93d1236e-66e3-4964-98b2-dc9656ab56cb tempest-SnapshotInstancesNegativeTest-1396485679 tempest-SnapshotInstancesNegativeTest-1396485679-project-admin] GET http://10.27.203.238/share/v2/c9cc76ecb4e343a6a51bf36da01debf8/types/a7fa0024-941d-4278-af42-a90075e4eab8 May 28 12:58:17 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-93d1236e-66e3-4964-98b2-dc9656ab56cb tempest-SnapshotInstancesNegativeTest-1396485679 tempest-SnapshotInstancesNegativeTest-1396485679-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:17 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-93d1236e-66e3-4964-98b2-dc9656ab56cb tempest-SnapshotInstancesNegativeTest-1396485679 tempest-SnapshotInstancesNegativeTest-1396485679-project-admin] Calling method 'ShareTypesController.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:17 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-93d1236e-66e3-4964-98b2-dc9656ab56cb tempest-SnapshotInstancesNegativeTest-1396485679 tempest-SnapshotInstancesNegativeTest-1396485679-project-admin] HTTP exception thrown: Share type not found. May 28 12:58:17 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-93d1236e-66e3-4964-98b2-dc9656ab56cb tempest-SnapshotInstancesNegativeTest-1396485679 tempest-SnapshotInstancesNegativeTest-1396485679-project-admin] http://10.27.203.238/share/v2/c9cc76ecb4e343a6a51bf36da01debf8/types/a7fa0024-941d-4278-af42-a90075e4eab8 returned with HTTP 404 May 28 12:58:17 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 503/1007] 10.27.203.238 () {64 vars in 1448 bytes} [Tue May 28 12:58:17 2024] GET /share/v2/c9cc76ecb4e343a6a51bf36da01debf8/types/a7fa0024-941d-4278-af42-a90075e4eab8 => generated 67 bytes in 11 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 12:58:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2678019-a6de-48e0-95ac-6ba28fd60811 tempest-ResourceLockCRUTest-1063854601 tempest-ResourceLockCRUTest-1063854601-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-d2678019-a6de-48e0-95ac-6ba28fd60811 tempest-ResourceLockCRUTest-1063854601 tempest-ResourceLockCRUTest-1063854601-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:58:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2678019-a6de-48e0-95ac-6ba28fd60811 tempest-ResourceLockCRUTest-1063854601 tempest-ResourceLockCRUTest-1063854601-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d816067-c26f-4aaa-a513-0b89681658b2 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d816067-c26f-4aaa-a513-0b89681658b2 None admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d816067-c26f-4aaa-a513-0b89681658b2 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d816067-c26f-4aaa-a513-0b89681658b2 None admin] PATH_INFO: `/v3/users/f3cb6c53a51049ff8cbf29dc9067534a` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d816067-c26f-4aaa-a513-0b89681658b2 None admin] RBAC: Authorizing `identity:delete_user(user_id=f3cb6c53a51049ff8cbf29dc9067534a)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d816067-c26f-4aaa-a513-0b89681658b2 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-9d816067-c26f-4aaa-a513-0b89681658b2 None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3cb6c53a51049ff8cbf29dc9067534a', 'request_id': 'req-9d816067-c26f-4aaa-a513-0b89681658b2'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:58:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-9d816067-c26f-4aaa-a513-0b89681658b2 None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3cb6c53a51049ff8cbf29dc9067534a', 'request_id': 'req-9d816067-c26f-4aaa-a513-0b89681658b2'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:58:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-9d816067-c26f-4aaa-a513-0b89681658b2 None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3cb6c53a51049ff8cbf29dc9067534a', 'request_id': 'req-9d816067-c26f-4aaa-a513-0b89681658b2'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:58:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-9d816067-c26f-4aaa-a513-0b89681658b2 None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3cb6c53a51049ff8cbf29dc9067534a', 'request_id': 'req-9d816067-c26f-4aaa-a513-0b89681658b2'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:58:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-9d816067-c26f-4aaa-a513-0b89681658b2 None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3cb6c53a51049ff8cbf29dc9067534a', 'request_id': 'req-9d816067-c26f-4aaa-a513-0b89681658b2'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:58:17 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1088/2152] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 12:58:17 2024] DELETE /identity/v3/users/f3cb6c53a51049ff8cbf29dc9067534a => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:58:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fab27c-dd61-4ad8-9cce-c2e6ce19eb16 tempest-ResourceLockCRUTest-1063854601 tempest-ResourceLockCRUTest-1063854601-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-60fab27c-dd61-4ad8-9cce-c2e6ce19eb16 tempest-ResourceLockCRUTest-1063854601 tempest-ResourceLockCRUTest-1063854601-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:58:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fab27c-dd61-4ad8-9cce-c2e6ce19eb16 tempest-ResourceLockCRUTest-1063854601 tempest-ResourceLockCRUTest-1063854601-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ac3b26-4827-4440-a3df-8a0a0782d546 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ac3b26-4827-4440-a3df-8a0a0782d546 None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ac3b26-4827-4440-a3df-8a0a0782d546 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ac3b26-4827-4440-a3df-8a0a0782d546 None admin] PATH_INFO: `/v3/users/2bcd797659f0461f9b2ee5e5258371fa` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ac3b26-4827-4440-a3df-8a0a0782d546 None admin] RBAC: Authorizing `identity:delete_user(user_id=2bcd797659f0461f9b2ee5e5258371fa)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ac3b26-4827-4440-a3df-8a0a0782d546 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:17 l75lg1-v1 dstat.sh[49771]: 28-05 12:58:17| 3 1 91 4 0|5713M 1771M 277M 7864M| 39k 646B| 0 6768k| 0 555 |4768 7405 |1.32 1.07 1.01|1.0 0 0| 0 0 | 0 2048M| 29 358 0 37 0 May 28 12:58:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-38ac3b26-4827-4440-a3df-8a0a0782d546 None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2bcd797659f0461f9b2ee5e5258371fa', 'request_id': 'req-38ac3b26-4827-4440-a3df-8a0a0782d546'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:58:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-38ac3b26-4827-4440-a3df-8a0a0782d546 None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2bcd797659f0461f9b2ee5e5258371fa', 'request_id': 'req-38ac3b26-4827-4440-a3df-8a0a0782d546'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:58:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-38ac3b26-4827-4440-a3df-8a0a0782d546 None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2bcd797659f0461f9b2ee5e5258371fa', 'request_id': 'req-38ac3b26-4827-4440-a3df-8a0a0782d546'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:58:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-38ac3b26-4827-4440-a3df-8a0a0782d546 None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2bcd797659f0461f9b2ee5e5258371fa', 'request_id': 'req-38ac3b26-4827-4440-a3df-8a0a0782d546'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:58:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-38ac3b26-4827-4440-a3df-8a0a0782d546 None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2bcd797659f0461f9b2ee5e5258371fa', 'request_id': 'req-38ac3b26-4827-4440-a3df-8a0a0782d546'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:58:17 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1065/2153] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 12:58:17 2024] DELETE /identity/v3/users/2bcd797659f0461f9b2ee5e5258371fa => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:58:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d816067-c26f-4aaa-a513-0b89681658b2 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-9d816067-c26f-4aaa-a513-0b89681658b2 None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:58:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d816067-c26f-4aaa-a513-0b89681658b2 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad637c6-0227-43df-9fa8-7a7b0680e3dc None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad637c6-0227-43df-9fa8-7a7b0680e3dc None admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad637c6-0227-43df-9fa8-7a7b0680e3dc None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad637c6-0227-43df-9fa8-7a7b0680e3dc None admin] PATH_INFO: `/v3/users/0b4f232c985e4c7eafeef302f4eaa647` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad637c6-0227-43df-9fa8-7a7b0680e3dc None admin] RBAC: Authorizing `identity:delete_user(user_id=0b4f232c985e4c7eafeef302f4eaa647)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad637c6-0227-43df-9fa8-7a7b0680e3dc None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-3ad637c6-0227-43df-9fa8-7a7b0680e3dc None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b4f232c985e4c7eafeef302f4eaa647', 'request_id': 'req-3ad637c6-0227-43df-9fa8-7a7b0680e3dc'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:58:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-3ad637c6-0227-43df-9fa8-7a7b0680e3dc None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b4f232c985e4c7eafeef302f4eaa647', 'request_id': 'req-3ad637c6-0227-43df-9fa8-7a7b0680e3dc'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:58:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-3ad637c6-0227-43df-9fa8-7a7b0680e3dc None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b4f232c985e4c7eafeef302f4eaa647', 'request_id': 'req-3ad637c6-0227-43df-9fa8-7a7b0680e3dc'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:58:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-3ad637c6-0227-43df-9fa8-7a7b0680e3dc None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b4f232c985e4c7eafeef302f4eaa647', 'request_id': 'req-3ad637c6-0227-43df-9fa8-7a7b0680e3dc'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:58:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-3ad637c6-0227-43df-9fa8-7a7b0680e3dc None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b4f232c985e4c7eafeef302f4eaa647', 'request_id': 'req-3ad637c6-0227-43df-9fa8-7a7b0680e3dc'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:58:17 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1089/2154] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 12:58:17 2024] DELETE /identity/v3/users/0b4f232c985e4c7eafeef302f4eaa647 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:58:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1918d16a-bd2a-467d-8034-ac8d321d3023 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1918d16a-bd2a-467d-8034-ac8d321d3023 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1918d16a-bd2a-467d-8034-ac8d321d3023 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:17 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-1918d16a-bd2a-467d-8034-ac8d321d3023 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:58:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-1918d16a-bd2a-467d-8034-ac8d321d3023 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:58:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-1918d16a-bd2a-467d-8034-ac8d321d3023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:58:17 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1066/2155] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:58:17 2024] POST /identity/v3/auth/tokens => generated 2960 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 12:58:17 l75lg1-v1 neutron-server[77619]: DEBUG neutron.wsgi [-] (77619) accepted ('10.27.203.238', 54754) {{(pid=77619) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 12:58:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad637c6-0227-43df-9fa8-7a7b0680e3dc None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-3ad637c6-0227-43df-9fa8-7a7b0680e3dc None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:58:17 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-d68586f6-f1a9-4dd1-b43b-c846f6b6d6d6 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] GET http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/c485966a-3cd7-4de5-903f-4b379a6cb450 May 28 12:58:17 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-d68586f6-f1a9-4dd1-b43b-c846f6b6d6d6 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:17 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-d68586f6-f1a9-4dd1-b43b-c846f6b6d6d6 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad637c6-0227-43df-9fa8-7a7b0680e3dc None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:17 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-d68586f6-f1a9-4dd1-b43b-c846f6b6d6d6 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] HTTP exception thrown: The resource could not be found. May 28 12:58:17 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-d68586f6-f1a9-4dd1-b43b-c846f6b6d6d6 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/c485966a-3cd7-4de5-903f-4b379a6cb450 returned with HTTP 404 May 28 12:58:17 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 505/1008] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:58:17 2024] GET /share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/c485966a-3cd7-4de5-903f-4b379a6cb450 => generated 78 bytes in 12 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 12:58:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c788561b-c37c-4a70-9fce-d3cd89dd6bc0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef17047035e4b518fd5360a01f2da1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c788561b-c37c-4a70-9fce-d3cd89dd6bc0 service neutron] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c788561b-c37c-4a70-9fce-d3cd89dd6bc0 service neutron] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c788561b-c37c-4a70-9fce-d3cd89dd6bc0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:17 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-d26fdd02-decd-405f-8c00-5f1d70a43412 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] POST http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares May 28 12:58:17 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-d26fdd02-decd-405f-8c00-5f1d70a43412 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share": {"share_proto": "nfs", "description": "Tempest's share", "snapshot_id": null, "name": "tempest-tempest-created-share-89865060", "size": 1, "metadata": {}, "is_public": false, "share_type": "10ddeb10-4cbf-44c0-94cd-48a1deaf7383"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:58:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c788561b-c37c-4a70-9fce-d3cd89dd6bc0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c788561b-c37c-4a70-9fce-d3cd89dd6bc0 service neutron] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:17 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.v1.shares [None req-d26fdd02-decd-405f-8c00-5f1d70a43412 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Create NFS share of 1 GB May 28 12:58:17 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1090/2156] 10.27.203.238 () {64 vars in 1432 bytes} [Tue May 28 12:58:17 2024] GET /identity/v3/auth/tokens => generated 2960 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 28 12:58:17 l75lg1-v1 neutron-server[77619]: INFO neutron.wsgi [None req-c63af433-09da-4dbb-a037-70f7ca2c033d None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=c9cc76ecb4e343a6a51bf36da01debf8&name=default HTTP/1.1" status: 200 len: 216 time: 0.0689995 May 28 12:58:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1918d16a-bd2a-467d-8034-ac8d321d3023 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-1918d16a-bd2a-467d-8034-ac8d321d3023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:58:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1918d16a-bd2a-467d-8034-ac8d321d3023 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d4963a-7f96-419e-bd4b-ade524120faa None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d4963a-7f96-419e-bd4b-ade524120faa None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d4963a-7f96-419e-bd4b-ade524120faa None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d4963a-7f96-419e-bd4b-ade524120faa None admin] PATH_INFO: `/v3/projects/c9cc76ecb4e343a6a51bf36da01debf8` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d4963a-7f96-419e-bd4b-ade524120faa None admin] RBAC: Authorizing `identity:delete_project(project_id=c9cc76ecb4e343a6a51bf36da01debf8)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d4963a-7f96-419e-bd4b-ade524120faa None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:17 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.quota [None req-d26fdd02-decd-405f-8c00-5f1d70a43412 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Created reservations ['7caa6973-71d2-4468-ab98-b470ed4eb6b3', '6c4ca978-7cd9-4ece-ae40-3400643f10a0', 'e69fb860-eb00-45e0-a6b0-139ddb010c60', 'b4c28d1c-6250-4d74-8386-3767ada054b1'] {{(pid=98330) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 12:58:17 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.quota [None req-d26fdd02-decd-405f-8c00-5f1d70a43412 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Committed reservations ['7caa6973-71d2-4468-ab98-b470ed4eb6b3', '6c4ca978-7cd9-4ece-ae40-3400643f10a0', 'e69fb860-eb00-45e0-a6b0-139ddb010c60', 'b4c28d1c-6250-4d74-8386-3767ada054b1'] {{(pid=98330) commit /opt/stack/manila/manila/quota.py:1063}} May 28 12:58:17 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.host_manager [None req-d26fdd02-decd-405f-8c00-5f1d70a43412 tempest-SharesMetadataTest-1561320255 None] Share service is down. (host: l75lg1-v1@generic2). May 28 12:58:17 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.host_manager [None req-d26fdd02-decd-405f-8c00-5f1d70a43412 tempest-SharesMetadataTest-1561320255 None] Share service is down. (host: l75lg1-v1@generic1). May 28 12:58:17 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-d26fdd02-decd-405f-8c00-5f1d70a43412 tempest-SharesMetadataTest-1561320255 None] Starting with 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:80}} May 28 12:58:17 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-d26fdd02-decd-405f-8c00-5f1d70a43412 tempest-SharesMetadataTest-1561320255 None] Filter OnlyHostFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:58:17 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-d26fdd02-decd-405f-8c00-5f1d70a43412 tempest-SharesMetadataTest-1561320255 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:58:17 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.capacity [None req-d26fdd02-decd-405f-8c00-5f1d70a43412 tempest-SharesMetadataTest-1561320255 None] Space information for share creation on host l75lg1-v1@vast#vast (requested / avail): 1/2078 {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/capacity.py:83}} May 28 12:58:17 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-d26fdd02-decd-405f-8c00-5f1d70a43412 tempest-SharesMetadataTest-1561320255 None] Filter CapacityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:58:17 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-d26fdd02-decd-405f-8c00-5f1d70a43412 tempest-SharesMetadataTest-1561320255 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:58:17 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-d26fdd02-decd-405f-8c00-5f1d70a43412 tempest-SharesMetadataTest-1561320255 None] Driver Filter: Checking host 'l75lg1-v1@vast#vast' {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:37}} May 28 12:58:17 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-d26fdd02-decd-405f-8c00-5f1d70a43412 tempest-SharesMetadataTest-1561320255 None] Filter function not set :: passing host. {{(pid=98327) _check_filter_function /opt/stack/manila/manila/scheduler/filters/driver.py:53}} May 28 12:58:17 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-d26fdd02-decd-405f-8c00-5f1d70a43412 tempest-SharesMetadataTest-1561320255 None] Result: True {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:40}} May 28 12:58:17 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-d26fdd02-decd-405f-8c00-5f1d70a43412 tempest-SharesMetadataTest-1561320255 None] Done checking host 'l75lg1-v1@vast#vast' {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:41}} May 28 12:58:17 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-d26fdd02-decd-405f-8c00-5f1d70a43412 tempest-SharesMetadataTest-1561320255 None] Filter DriverFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:58:17 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-d26fdd02-decd-405f-8c00-5f1d70a43412 tempest-SharesMetadataTest-1561320255 None] Filter ShareReplicationFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:58:17 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-d26fdd02-decd-405f-8c00-5f1d70a43412 tempest-SharesMetadataTest-1561320255 None] Filter CreateFromSnapshotFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:58:17 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-d26fdd02-decd-405f-8c00-5f1d70a43412 tempest-SharesMetadataTest-1561320255 None] Filter AffinityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:58:17 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-d26fdd02-decd-405f-8c00-5f1d70a43412 tempest-SharesMetadataTest-1561320255 None] Filter AntiAffinityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:58:17 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.drivers.filter [None req-d26fdd02-decd-405f-8c00-5f1d70a43412 tempest-SharesMetadataTest-1561320255 None] Filtered share [host: 'l75lg1-v1@vast#vast', free_capacity_gb: 2078.6229242384434, pools: None] {{(pid=98327) _schedule_share /opt/stack/manila/manila/scheduler/drivers/filter.py:268}} May 28 12:58:17 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-d26fdd02-decd-405f-8c00-5f1d70a43412 tempest-SharesMetadataTest-1561320255 None] Checking host 'l75lg1-v1@vast#vast' {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:46}} May 28 12:58:17 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.weighers.goodness [None req-d26fdd02-decd-405f-8c00-5f1d70a43412 tempest-SharesMetadataTest-1561320255 None] Goodness function not set :: defaulting to minimal goodness rating of 0. May 28 12:58:17 l75lg1-v1 manila-scheduler[98327]: INFO manila.scheduler.weighers.goodness [None req-d26fdd02-decd-405f-8c00-5f1d70a43412 tempest-SharesMetadataTest-1561320255 None] Goodness function result for host l75lg1-v1@vast#vast: 0. May 28 12:58:17 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-d26fdd02-decd-405f-8c00-5f1d70a43412 tempest-SharesMetadataTest-1561320255 None] Goodness: 0 {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:48}} May 28 12:58:17 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-d26fdd02-decd-405f-8c00-5f1d70a43412 tempest-SharesMetadataTest-1561320255 None] Done checking host 'l75lg1-v1@vast#vast' {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:49}} May 28 12:58:17 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.drivers.filter [None req-d26fdd02-decd-405f-8c00-5f1d70a43412 tempest-SharesMetadataTest-1561320255 None] Choosing for share: WeighedHost [host: l75lg1-v1@vast#vast, weight: 0.0] {{(pid=98327) _schedule_share /opt/stack/manila/manila/scheduler/drivers/filter.py:274}} May 28 12:58:17 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-d26fdd02-decd-405f-8c00-5f1d70a43412 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares returned with HTTP 200 May 28 12:58:17 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 504/1009] 10.27.203.238 () {66 vars in 1362 bytes} [Tue May 28 12:58:17 2024] POST /share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares => generated 1310 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:58:17 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-15dda4fb-d6ff-4669-800c-6cd8d3c51859 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] GET http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/dacdb3b4-4336-45fd-b002-1a5aa6ad9957 May 28 12:58:17 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-15dda4fb-d6ff-4669-800c-6cd8d3c51859 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:17 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-15dda4fb-d6ff-4669-800c-6cd8d3c51859 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-80d4963a-7f96-419e-bd4b-ade524120faa None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9cc76ecb4e343a6a51bf36da01debf8', 'request_id': 'req-80d4963a-7f96-419e-bd4b-ade524120faa'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:58:17 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-15dda4fb-d6ff-4669-800c-6cd8d3c51859 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/dacdb3b4-4336-45fd-b002-1a5aa6ad9957 returned with HTTP 200 May 28 12:58:17 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 506/1010] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:58:17 2024] GET /share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/dacdb3b4-4336-45fd-b002-1a5aa6ad9957 => generated 1310 bytes in 23 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:58:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-80d4963a-7f96-419e-bd4b-ade524120faa None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9cc76ecb4e343a6a51bf36da01debf8', 'request_id': 'req-80d4963a-7f96-419e-bd4b-ade524120faa'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:58:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-80d4963a-7f96-419e-bd4b-ade524120faa None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9cc76ecb4e343a6a51bf36da01debf8', 'request_id': 'req-80d4963a-7f96-419e-bd4b-ade524120faa'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:58:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-80d4963a-7f96-419e-bd4b-ade524120faa None admin] The token cache is being invalidate because project c9cc76ecb4e343a6a51bf36da01debf8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 12:58:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-80d4963a-7f96-419e-bd4b-ade524120faa None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:58:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-80d4963a-7f96-419e-bd4b-ade524120faa None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:58:17 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1067/2157] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 12:58:17 2024] DELETE /identity/v3/projects/c9cc76ecb4e343a6a51bf36da01debf8 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:58:17 l75lg1-v1 neutron-server[77619]: DEBUG neutron.wsgi [-] (77619) accepted ('10.27.203.238', 54766) {{(pid=77619) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 12:58:17 l75lg1-v1 neutron-server[77619]: INFO neutron.wsgi [None req-27179868-893d-45d5-a98b-aaacc64bc695 None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=744044ad65fb482da4d2ebaa13a84bf8&name=default HTTP/1.1" status: 200 len: 216 time: 0.0082989 May 28 12:58:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c788561b-c37c-4a70-9fce-d3cd89dd6bc0 service neutron] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c788561b-c37c-4a70-9fce-d3cd89dd6bc0 service neutron] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:17 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d26fdd02-decd-405f-8c00-5f1d70a43412 tempest-SharesMetadataTest-1561320255 None] >>> [GET] https://127.0.0.1:40443/api/vippools/ May 28 12:58:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13da0e8-d083-4097-aee5-2e378fcf5cf9 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13da0e8-d083-4097-aee5-2e378fcf5cf9 None admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13da0e8-d083-4097-aee5-2e378fcf5cf9 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13da0e8-d083-4097-aee5-2e378fcf5cf9 None admin] PATH_INFO: `/v3/projects/744044ad65fb482da4d2ebaa13a84bf8` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:17 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d26fdd02-decd-405f-8c00-5f1d70a43412 tempest-SharesMetadataTest-1561320255 None] {'allow_redirects': True, 'params': {'name': 'vippool-1'}} May 28 12:58:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13da0e8-d083-4097-aee5-2e378fcf5cf9 None admin] RBAC: Authorizing `identity:delete_project(project_id=744044ad65fb482da4d2ebaa13a84bf8)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13da0e8-d083-4097-aee5-2e378fcf5cf9 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-c13da0e8-d083-4097-aee5-2e378fcf5cf9 None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '744044ad65fb482da4d2ebaa13a84bf8', 'request_id': 'req-c13da0e8-d083-4097-aee5-2e378fcf5cf9'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:58:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-c13da0e8-d083-4097-aee5-2e378fcf5cf9 None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '744044ad65fb482da4d2ebaa13a84bf8', 'request_id': 'req-c13da0e8-d083-4097-aee5-2e378fcf5cf9'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:58:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-c13da0e8-d083-4097-aee5-2e378fcf5cf9 None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '744044ad65fb482da4d2ebaa13a84bf8', 'request_id': 'req-c13da0e8-d083-4097-aee5-2e378fcf5cf9'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:58:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-c13da0e8-d083-4097-aee5-2e378fcf5cf9 None admin] The token cache is being invalidate because project 744044ad65fb482da4d2ebaa13a84bf8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 12:58:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-c13da0e8-d083-4097-aee5-2e378fcf5cf9 None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:58:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-c13da0e8-d083-4097-aee5-2e378fcf5cf9 None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:58:17 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1091/2158] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 12:58:17 2024] DELETE /identity/v3/projects/744044ad65fb482da4d2ebaa13a84bf8 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:58:17 l75lg1-v1 neutron-server[77619]: DEBUG neutron.wsgi [-] (77619) accepted ('10.27.203.238', 54770) {{(pid=77619) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 12:58:17 l75lg1-v1 neutron-server[77619]: INFO neutron.wsgi [None req-1d484d14-8e61-454b-a904-701c600cc3f6 None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=ed0a0bf2490645089c21203bbbe1c291&name=default HTTP/1.1" status: 200 len: 216 time: 0.0087519 May 28 12:58:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d4963a-7f96-419e-bd4b-ade524120faa None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-80d4963a-7f96-419e-bd4b-ade524120faa None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:58:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d4963a-7f96-419e-bd4b-ade524120faa None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:17 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-957b621e-5200-4efb-82a9-ec05e4454fd7 tempest-AdminActionsTest-1749172189 None] <<< [POST] https://127.0.0.1:40443/api/snapshots/ May 28 12:58:17 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-957b621e-5200-4efb-82a9-ec05e4454fd7 tempest-AdminActionsTest-1749172189 None] Bunch(access_path='/.vast_all_snapshots/1000000009_share-snapshot-64c48761-d84e-4d5e-adb5-0cae2ce900e5', aggr_phys_estimation=0, cluster='loop75-kfs', created='2024-05-28T12:58:15.802688Z', eta_sec=30819898900.131096, expiration_time='3001-01-19T07:59:58Z', guid='0e254f26-53f8-4e32-b566-aed8291f2b5c', id=10, indestructible=False, locked=False, name='share-snapshot-64c48761-d84e-4d5e-adb5-0cae2ce900e5', path='/manila/manila-77a25e6b-f137-4342-8eb9-9ced679515e2/', policy=None, policy_id=None, protection_policy_id=None, state='SUCCEED', tenant_id=1, tenant_name='default', title='share-snapshot-64c48761-d84e-4d5e-adb5-0cae2ce900e5(/manila/manila-77a25e6b-f137-4342-8eb9-9ced679515e2/)', type='local', unique_phys_estimation=0, url='https://127.0.0.1:40443/api/snapshots/10/') May 28 12:58:17 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-957b621e-5200-4efb-82a9-ec05e4454fd7 tempest-AdminActionsTest-1749172189 None] --- [POST] https://127.0.0.1:40443/api/snapshots/: Done May 28 12:58:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50048bb7-80e4-4f50-9572-9ec9bd76ed78 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50048bb7-80e4-4f50-9572-9ec9bd76ed78 None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50048bb7-80e4-4f50-9572-9ec9bd76ed78 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50048bb7-80e4-4f50-9572-9ec9bd76ed78 None admin] PATH_INFO: `/v3/projects/ed0a0bf2490645089c21203bbbe1c291` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50048bb7-80e4-4f50-9572-9ec9bd76ed78 None admin] RBAC: Authorizing `identity:delete_project(project_id=ed0a0bf2490645089c21203bbbe1c291)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50048bb7-80e4-4f50-9572-9ec9bd76ed78 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-50048bb7-80e4-4f50-9572-9ec9bd76ed78 None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed0a0bf2490645089c21203bbbe1c291', 'request_id': 'req-50048bb7-80e4-4f50-9572-9ec9bd76ed78'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:58:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-50048bb7-80e4-4f50-9572-9ec9bd76ed78 None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed0a0bf2490645089c21203bbbe1c291', 'request_id': 'req-50048bb7-80e4-4f50-9572-9ec9bd76ed78'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:58:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-50048bb7-80e4-4f50-9572-9ec9bd76ed78 None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed0a0bf2490645089c21203bbbe1c291', 'request_id': 'req-50048bb7-80e4-4f50-9572-9ec9bd76ed78'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:58:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-50048bb7-80e4-4f50-9572-9ec9bd76ed78 None admin] The token cache is being invalidate because project ed0a0bf2490645089c21203bbbe1c291 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 12:58:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-50048bb7-80e4-4f50-9572-9ec9bd76ed78 None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:58:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-50048bb7-80e4-4f50-9572-9ec9bd76ed78 None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:58:17 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1068/2159] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 12:58:17 2024] DELETE /identity/v3/projects/ed0a0bf2490645089c21203bbbe1c291 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:58:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2c9074-b576-43f4-ac6f-199212218a2a None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2c9074-b576-43f4-ac6f-199212218a2a None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2c9074-b576-43f4-ac6f-199212218a2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:17 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-ec2c9074-b576-43f4-ac6f-199212218a2a None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:58:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-ec2c9074-b576-43f4-ac6f-199212218a2a None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:58:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-ec2c9074-b576-43f4-ac6f-199212218a2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:58:17 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1092/2160] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:58:17 2024] POST /identity/v3/auth/tokens => generated 312 bytes in 20 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 28 12:58:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b77960-f0b0-4d0e-8373-8c8cb70524fb None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b77960-f0b0-4d0e-8373-8c8cb70524fb None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b77960-f0b0-4d0e-8373-8c8cb70524fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:18 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-50b77960-f0b0-4d0e-8373-8c8cb70524fb None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:58:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-50b77960-f0b0-4d0e-8373-8c8cb70524fb None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:58:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-50b77960-f0b0-4d0e-8373-8c8cb70524fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:58:18 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1069/2161] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:58:17 2024] POST /identity/v3/auth/tokens => generated 2960 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 12:58:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2c9074-b576-43f4-ac6f-199212218a2a None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2c9074-b576-43f4-ac6f-199212218a2a None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:18 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d26fdd02-decd-405f-8c00-5f1d70a43412 tempest-SharesMetadataTest-1561320255 None] <<< [GET] https://127.0.0.1:40443/api/vippools/ May 28 12:58:18 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d26fdd02-decd-405f-8c00-5f1d70a43412 tempest-SharesMetadataTest-1561320255 None] [Bunch(active_cnode_ids=[], active_interfaces=4, cluster='loop75-kfs', cluster_id=1, cnode_ids=[], cnodes=[], domain_name='vippool-1', enable_l3=False, enable_weighted_balancing=False, enabled=True, end_ip='172.21.75.4', guid='f2abaede-b397-413a-8faa-3aeead6d3b28', gw_ip='', gw_ipv6='', id=2, ip_ranges=[['172.21.75.1', '172.21.75.4']], name='vippool-1', peer_asn=0, port_membership='ALL', ranges_summary='172.21.75.[1-4]', role='PROTOCOLS', start_ip='172.21.75.1', subnet_cidr=16, subnet_cidr_ipv6=None, sync='SYNCED', sync_time='2024-05-28T12:50:09.644123Z', tenant_id=1, tenant_name='default', title='172.21.75.1 - 172.21.75.4', url='https://127.0.0.1:40443/api/vippools/2/', vast_asn=0, vlan=0, vms_preferred=False)] May 28 12:58:18 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d26fdd02-decd-405f-8c00-5f1d70a43412 tempest-SharesMetadataTest-1561320255 None] --- [GET] https://127.0.0.1:40443/api/vippools/: Done May 28 12:58:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53f808c-519b-4d25-a491-5cfe243c22cb None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:18 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d26fdd02-decd-405f-8c00-5f1d70a43412 tempest-SharesMetadataTest-1561320255 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:58:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53f808c-519b-4d25-a491-5cfe243c22cb None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:18 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d26fdd02-decd-405f-8c00-5f1d70a43412 tempest-SharesMetadataTest-1561320255 None] {'allow_redirects': True, May 28 12:58:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53f808c-519b-4d25-a491-5cfe243c22cb None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:18 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d26fdd02-decd-405f-8c00-5f1d70a43412 tempest-SharesMetadataTest-1561320255 None] 'params': {'name': '8d0c9317-df90-47d1-b406-482ee14c60e8'}} May 28 12:58:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53f808c-519b-4d25-a491-5cfe243c22cb None admin] PATH_INFO: `/v3/domains` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53f808c-519b-4d25-a491-5cfe243c22cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=51267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:58:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53f808c-519b-4d25-a491-5cfe243c22cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53f808c-519b-4d25-a491-5cfe243c22cb None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:18 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1093/2162] 10.27.203.238 () {62 vars in 1220 bytes} [Tue May 28 12:58:18 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:58:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b77960-f0b0-4d0e-8373-8c8cb70524fb None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b77960-f0b0-4d0e-8373-8c8cb70524fb None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599b37f8-6cd4-4627-9271-5db63945fcac None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599b37f8-6cd4-4627-9271-5db63945fcac None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599b37f8-6cd4-4627-9271-5db63945fcac None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599b37f8-6cd4-4627-9271-5db63945fcac None admin] PATH_INFO: `/v3/projects` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599b37f8-6cd4-4627-9271-5db63945fcac None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599b37f8-6cd4-4627-9271-5db63945fcac None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:18 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1070/2163] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 12:58:18 2024] POST /identity/v3/projects => generated 397 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:58:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53f808c-519b-4d25-a491-5cfe243c22cb None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:18 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-e58b8d2c-8147-48ea-b285-2a241aea3840 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] GET http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/snapshots/6ddf5f7a-7bad-4eea-9e2e-64307270ec88 May 28 12:58:18 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-e58b8d2c-8147-48ea-b285-2a241aea3840 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:18 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-e58b8d2c-8147-48ea-b285-2a241aea3840 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Calling method 'ShareSnapshotMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53f808c-519b-4d25-a491-5cfe243c22cb None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:18 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-e58b8d2c-8147-48ea-b285-2a241aea3840 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/snapshots/6ddf5f7a-7bad-4eea-9e2e-64307270ec88 returned with HTTP 200 May 28 12:58:18 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 505/1011] 10.27.203.238 () {64 vars in 1460 bytes} [Tue May 28 12:58:18 2024] GET /share/v2/a3499cb78849424db45e54caac01de92/snapshots/6ddf5f7a-7bad-4eea-9e2e-64307270ec88 => generated 751 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:58:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a3d5ae-38e2-40f1-9fcd-c29623b2d6e8 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a3d5ae-38e2-40f1-9fcd-c29623b2d6e8 None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a3d5ae-38e2-40f1-9fcd-c29623b2d6e8 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a3d5ae-38e2-40f1-9fcd-c29623b2d6e8 None admin] PATH_INFO: `/v3/users` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a3d5ae-38e2-40f1-9fcd-c29623b2d6e8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a3d5ae-38e2-40f1-9fcd-c29623b2d6e8 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:18 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-b7d72aa4-b758-40d2-81c2-2ae0eec1ea9a tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] POST http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/snapshots/6ddf5f7a-7bad-4eea-9e2e-64307270ec88/action May 28 12:58:18 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-c8a3d5ae-38e2-40f1-9fcd-c29623b2d6e8 None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 12:58:18 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-b7d72aa4-b758-40d2-81c2-2ae0eec1ea9a tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Action body: b'{"reset_status": {"status": "deleting"}}' {{(pid=98329) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:58:18 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-b7d72aa4-b758-40d2-81c2-2ae0eec1ea9a tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Action: 'action', calling method: ShareSnapshotsController.snapshot_reset_status, body: {"reset_status": {"status": "deleting"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:58:18 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-b7d72aa4-b758-40d2-81c2-2ae0eec1ea9a tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Updating share_snapshot '6ddf5f7a-7bad-4eea-9e2e-64307270ec88' with '{'status': 'deleting'}' {{(pid=98329) _reset_status /opt/stack/manila/manila/api/openstack/wsgi.py:1257}} May 28 12:58:18 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1094/2164] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 12:58:18 2024] POST /identity/v3/users => generated 306 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:58:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599b37f8-6cd4-4627-9271-5db63945fcac None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599b37f8-6cd4-4627-9271-5db63945fcac None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7febd60c-1c8f-4a77-ab9a-485b9439c205 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7febd60c-1c8f-4a77-ab9a-485b9439c205 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7febd60c-1c8f-4a77-ab9a-485b9439c205 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7febd60c-1c8f-4a77-ab9a-485b9439c205 None admin] PATH_INFO: `/v3/roles` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7febd60c-1c8f-4a77-ab9a-485b9439c205 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7febd60c-1c8f-4a77-ab9a-485b9439c205 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:18 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1071/2165] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 12:58:18 2024] GET /identity/v3/roles => generated 1680 bytes in 19 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:58:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a3d5ae-38e2-40f1-9fcd-c29623b2d6e8 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a3d5ae-38e2-40f1-9fcd-c29623b2d6e8 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d2e662-c714-4a79-a501-6ac2c6b0ec6e None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d2e662-c714-4a79-a501-6ac2c6b0ec6e None admin] REQUEST_METHOD: `PUT` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d2e662-c714-4a79-a501-6ac2c6b0ec6e None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d2e662-c714-4a79-a501-6ac2c6b0ec6e None admin] PATH_INFO: `/v3/projects/0a0f51e7150545b9a25bf6f47942ebc7/users/9e23f6715857452e892241c9927d5510/roles/e7989893488f483baa107be56668c4f8` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d2e662-c714-4a79-a501-6ac2c6b0ec6e None admin] RBAC: Authorizing `identity:create_grant(project_id=0a0f51e7150545b9a25bf6f47942ebc7, user_id=9e23f6715857452e892241c9927d5510, role_id=e7989893488f483baa107be56668c4f8)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d2e662-c714-4a79-a501-6ac2c6b0ec6e None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:18 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-b7d72aa4-b758-40d2-81c2-2ae0eec1ea9a tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/snapshots/6ddf5f7a-7bad-4eea-9e2e-64307270ec88/action returned with HTTP 202 May 28 12:58:18 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 507/1012] 10.27.203.238 () {66 vars in 1502 bytes} [Tue May 28 12:58:18 2024] POST /share/v2/a3499cb78849424db45e54caac01de92/snapshots/6ddf5f7a-7bad-4eea-9e2e-64307270ec88/action => generated 0 bytes in 74 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:58:18 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-5b7f6ad6-8da9-4c6c-9f29-e2b3ccb51bd8 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] GET http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/snapshots/6ddf5f7a-7bad-4eea-9e2e-64307270ec88 May 28 12:58:18 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-5b7f6ad6-8da9-4c6c-9f29-e2b3ccb51bd8 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:18 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-5b7f6ad6-8da9-4c6c-9f29-e2b3ccb51bd8 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Calling method 'ShareSnapshotMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:18 l75lg1-v1 dstat.sh[49771]: 28-05 12:58:18| 13 2 82 2 0|5713M 1771M 277M 7864M| 31k 6115B| 0 2184k| 0 325 |8195 14k|1.32 1.07 1.01|3.0 1.0 2.0| 0 0 | 0 2048M| 29 359 0 37 0 May 28 12:58:18 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-26a3750b-2308-482c-bf4c-aa3ab03c9e58 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] GET http://10.27.203.238/share/v2/776f75906bc64f8f9316d5aab4b50bf1/share-access-rules?share_id=1ddadc17-cf10-4a42-8bbd-8335fb3520a1 May 28 12:58:18 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-26a3750b-2308-482c-bf4c-aa3ab03c9e58 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:18 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-26a3750b-2308-482c-bf4c-aa3ab03c9e58 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:18 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1095/2166] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 12:58:18 2024] PUT /identity/v3/projects/0a0f51e7150545b9a25bf6f47942ebc7/users/9e23f6715857452e892241c9927d5510/roles/e7989893488f483baa107be56668c4f8 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:58:18 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-5b7f6ad6-8da9-4c6c-9f29-e2b3ccb51bd8 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/snapshots/6ddf5f7a-7bad-4eea-9e2e-64307270ec88 returned with HTTP 200 May 28 12:58:18 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 506/1013] 10.27.203.238 () {64 vars in 1460 bytes} [Tue May 28 12:58:18 2024] GET /share/v2/a3499cb78849424db45e54caac01de92/snapshots/6ddf5f7a-7bad-4eea-9e2e-64307270ec88 => generated 750 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:58:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7febd60c-1c8f-4a77-ab9a-485b9439c205 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7febd60c-1c8f-4a77-ab9a-485b9439c205 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:18 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-659d4eab-4126-4a1b-bcb4-951900e5a27e tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] POST http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/snapshots/6ddf5f7a-7bad-4eea-9e2e-64307270ec88/action May 28 12:58:18 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-659d4eab-4126-4a1b-bcb4-951900e5a27e tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Action body: b'{"reset_status": {"status": "available"}}' {{(pid=98330) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:58:18 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-659d4eab-4126-4a1b-bcb4-951900e5a27e tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Action: 'action', calling method: ShareSnapshotsController.snapshot_reset_status, body: {"reset_status": {"status": "available"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:58:18 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-659d4eab-4126-4a1b-bcb4-951900e5a27e tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Updating share_snapshot '6ddf5f7a-7bad-4eea-9e2e-64307270ec88' with '{'status': 'available'}' {{(pid=98330) _reset_status /opt/stack/manila/manila/api/openstack/wsgi.py:1257}} May 28 12:58:18 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-26a3750b-2308-482c-bf4c-aa3ab03c9e58 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] http://10.27.203.238/share/v2/776f75906bc64f8f9316d5aab4b50bf1/share-access-rules?share_id=1ddadc17-cf10-4a42-8bbd-8335fb3520a1 returned with HTTP 200 May 28 12:58:18 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 508/1014] 10.27.203.238 () {64 vars in 1467 bytes} [Tue May 28 12:58:18 2024] GET /share/v2/776f75906bc64f8f9316d5aab4b50bf1/share-access-rules?share_id=1ddadc17-cf10-4a42-8bbd-8335fb3520a1 => generated 19 bytes in 28 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:58:18 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-b0acc4f8-c2b5-4700-8fb1-ecf04149d275 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] POST http://10.27.203.238/share/v2/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action May 28 12:58:18 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-b0acc4f8-c2b5-4700-8fb1-ecf04149d275 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Action body: b'{"allow_access": {"access_type": "ip", "access_to": "2001:db8:5000::/37", "access_level": "rw"}}' {{(pid=98329) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:58:18 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-b0acc4f8-c2b5-4700-8fb1-ecf04149d275 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Action: 'action', calling method: ShareController.allow_access, body: {"allow_access": {"access_type": "ip", "access_to": "2001:db8:5000::/37", "access_level": "rw"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:58:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5a6960-7a9c-4270-a125-6c5827cbb35b None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5a6960-7a9c-4270-a125-6c5827cbb35b None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5a6960-7a9c-4270-a125-6c5827cbb35b None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5a6960-7a9c-4270-a125-6c5827cbb35b None admin] PATH_INFO: `/v3/roles` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5a6960-7a9c-4270-a125-6c5827cbb35b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5a6960-7a9c-4270-a125-6c5827cbb35b None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:18 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1072/2167] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 12:58:18 2024] GET /identity/v3/roles => generated 1680 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:58:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d2e662-c714-4a79-a501-6ac2c6b0ec6e None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d2e662-c714-4a79-a501-6ac2c6b0ec6e None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc9c7ec-078d-41af-b4d9-238d2876571b None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc9c7ec-078d-41af-b4d9-238d2876571b None admin] REQUEST_METHOD: `PUT` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc9c7ec-078d-41af-b4d9-238d2876571b None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc9c7ec-078d-41af-b4d9-238d2876571b None admin] PATH_INFO: `/v3/projects/0a0f51e7150545b9a25bf6f47942ebc7/users/9e23f6715857452e892241c9927d5510/roles/e7989893488f483baa107be56668c4f8` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc9c7ec-078d-41af-b4d9-238d2876571b None admin] RBAC: Authorizing `identity:create_grant(project_id=0a0f51e7150545b9a25bf6f47942ebc7, user_id=9e23f6715857452e892241c9927d5510, role_id=e7989893488f483baa107be56668c4f8)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc9c7ec-078d-41af-b4d9-238d2876571b None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:18 l75lg1-v1 devstack@m-api.service[98329]: DEBUG oslo_concurrency.lockutils [None req-b0acc4f8-c2b5-4700-8fb1-ecf04149d275 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98329) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:18 l75lg1-v1 devstack@m-api.service[98329]: DEBUG oslo_concurrency.lockutils [None req-b0acc4f8-c2b5-4700-8fb1-ecf04149d275 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98329) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:18 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-659d4eab-4126-4a1b-bcb4-951900e5a27e tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/snapshots/6ddf5f7a-7bad-4eea-9e2e-64307270ec88/action returned with HTTP 202 May 28 12:58:18 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1096/2168] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 12:58:18 2024] PUT /identity/v3/projects/0a0f51e7150545b9a25bf6f47942ebc7/users/9e23f6715857452e892241c9927d5510/roles/e7989893488f483baa107be56668c4f8 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:58:18 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 507/1015] 10.27.203.238 () {66 vars in 1502 bytes} [Tue May 28 12:58:18 2024] POST /share/v2/a3499cb78849424db45e54caac01de92/snapshots/6ddf5f7a-7bad-4eea-9e2e-64307270ec88/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:58:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5f05d1-6918-46e9-9233-a80a8fdc282c None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5f05d1-6918-46e9-9233-a80a8fdc282c None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5f05d1-6918-46e9-9233-a80a8fdc282c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:18 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-26824cfa-82dd-467b-a13b-9d324c9af104 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] GET http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/snapshots/6ddf5f7a-7bad-4eea-9e2e-64307270ec88 May 28 12:58:18 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-26824cfa-82dd-467b-a13b-9d324c9af104 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:18 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-26824cfa-82dd-467b-a13b-9d324c9af104 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Calling method 'ShareSnapshotMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:18 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d26fdd02-decd-405f-8c00-5f1d70a43412 tempest-SharesMetadataTest-1561320255 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:58:18 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d26fdd02-decd-405f-8c00-5f1d70a43412 tempest-SharesMetadataTest-1561320255 None] [] May 28 12:58:18 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d26fdd02-decd-405f-8c00-5f1d70a43412 tempest-SharesMetadataTest-1561320255 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 12:58:18 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d26fdd02-decd-405f-8c00-5f1d70a43412 tempest-SharesMetadataTest-1561320255 None] >>> [POST] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:58:18 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d26fdd02-decd-405f-8c00-5f1d70a43412 tempest-SharesMetadataTest-1561320255 None] {'data': '{"name": "8d0c9317-df90-47d1-b406-482ee14c60e8"}', May 28 12:58:18 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d26fdd02-decd-405f-8c00-5f1d70a43412 tempest-SharesMetadataTest-1561320255 None] 'json': None, May 28 12:58:18 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d26fdd02-decd-405f-8c00-5f1d70a43412 tempest-SharesMetadataTest-1561320255 None] 'params': None} May 28 12:58:18 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-ec5f05d1-6918-46e9-9233-a80a8fdc282c None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:58:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-ec5f05d1-6918-46e9-9233-a80a8fdc282c None None] MFA Rules not processed for user `9e23f6715857452e892241c9927d5510`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:58:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-ec5f05d1-6918-46e9-9233-a80a8fdc282c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:58:18 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-26824cfa-82dd-467b-a13b-9d324c9af104 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/snapshots/6ddf5f7a-7bad-4eea-9e2e-64307270ec88 returned with HTTP 200 May 28 12:58:18 l75lg1-v1 devstack@m-api.service[98329]: DEBUG oslo_concurrency.lockutils [None req-b0acc4f8-c2b5-4700-8fb1-ecf04149d275 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.045s {{(pid=98329) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:18 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 508/1016] 10.27.203.238 () {64 vars in 1460 bytes} [Tue May 28 12:58:18 2024] GET /share/v2/a3499cb78849424db45e54caac01de92/snapshots/6ddf5f7a-7bad-4eea-9e2e-64307270ec88 => generated 751 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:58:18 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-b0acc4f8-c2b5-4700-8fb1-ecf04149d275 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] http://10.27.203.238/share/v2/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action returned with HTTP 200 May 28 12:58:18 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 509/1017] 10.27.203.238 () {66 vars in 1493 bytes} [Tue May 28 12:58:18 2024] POST /share/v2/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action => generated 316 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 231 bytes (2 switches on core 0) May 28 12:58:18 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-bf30714a-ad04-4dc9-bf7b-6788b02e4540 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] POST http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/snapshots May 28 12:58:18 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-c55d25a7-e7f3-4164-8897-49edfc5aa812 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] GET http://10.27.203.238/share/v2/776f75906bc64f8f9316d5aab4b50bf1/share-access-rules?share_id=1ddadc17-cf10-4a42-8bbd-8335fb3520a1 May 28 12:58:18 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-c55d25a7-e7f3-4164-8897-49edfc5aa812 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:18 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-bf30714a-ad04-4dc9-bf7b-6788b02e4540 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Action: 'create', calling method: ShareSnapshotMixin.create, body: {"snapshot": {"name": "tempest-tempest-created-share-snap-838501466", "force": false, "description": "Tempest's snapshot", "share_id": "df0ea844-5fc1-4d04-8afb-5048ec5dc33f"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:58:18 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-c55d25a7-e7f3-4164-8897-49edfc5aa812 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:18 l75lg1-v1 manila-share[98474]: DEBUG manila.share.manager [None req-b0acc4f8-c2b5-4700-8fb1-ecf04149d275 tempest-ShareIpRulesForNFSTest-1748669711 None] Received request to update access for share instance b7a7d61c-2cea-442a-9809-507038e080d5. {{(pid=98474) update_access_for_instances /opt/stack/manila/manila/share/manager.py:4353}} May 28 12:58:18 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.v1.share_snapshots [None req-bf30714a-ad04-4dc9-bf7b-6788b02e4540 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Create snapshot from share df0ea844-5fc1-4d04-8afb-5048ec5dc33f May 28 12:58:18 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1073/2169] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:58:18 2024] POST /identity/v3/auth/tokens => generated 4091 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:58:18 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.lock.api [None req-c55d25a7-e7f3-4164-8897-49edfc5aa812 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Searching for locks by: {'resource_id': 'b2e61511-34dc-4e43-b8f2-c23097e69425', 'resource_action': 'show', 'resource_type': 'access_rule'} {{(pid=98329) get_all /opt/stack/manila/manila/lock/api.py:112}} May 28 12:58:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc9c7ec-078d-41af-b4d9-238d2876571b None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:18 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-c55d25a7-e7f3-4164-8897-49edfc5aa812 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] http://10.27.203.238/share/v2/776f75906bc64f8f9316d5aab4b50bf1/share-access-rules?share_id=1ddadc17-cf10-4a42-8bbd-8335fb3520a1 returned with HTTP 200 May 28 12:58:18 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 510/1018] 10.27.203.238 () {64 vars in 1467 bytes} [Tue May 28 12:58:18 2024] GET /share/v2/776f75906bc64f8f9316d5aab4b50bf1/share-access-rules?share_id=1ddadc17-cf10-4a42-8bbd-8335fb3520a1 => generated 271 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 231 bytes (2 switches on core 0) May 28 12:58:18 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-b0acc4f8-c2b5-4700-8fb1-ecf04149d275 tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:18 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-b0acc4f8-c2b5-4700-8fb1-ecf04149d275 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:18 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-b0acc4f8-c2b5-4700-8fb1-ecf04149d275 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:18 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-b0acc4f8-c2b5-4700-8fb1-ecf04149d275 tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:18 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-b0acc4f8-c2b5-4700-8fb1-ecf04149d275 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:18 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.quota [None req-bf30714a-ad04-4dc9-bf7b-6788b02e4540 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Created reservations ['edb0e342-557d-412b-8986-e7b3743c1494', '1975c81f-70dc-4e41-b6e6-2686244d6ab7', '93b926fe-b1c0-46eb-9bfe-67ff4f3ccbdd', 'fd797d33-830f-48ea-a39d-acb79a8fb3a7'] {{(pid=98330) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 12:58:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc9c7ec-078d-41af-b4d9-238d2876571b None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c69a22-7665-4587-ab3d-1473f00c296c None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c69a22-7665-4587-ab3d-1473f00c296c None admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c69a22-7665-4587-ab3d-1473f00c296c None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c69a22-7665-4587-ab3d-1473f00c296c None admin] PATH_INFO: `/v3/users/9e23f6715857452e892241c9927d5510` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c69a22-7665-4587-ab3d-1473f00c296c None admin] RBAC: Authorizing `identity:delete_user(user_id=9e23f6715857452e892241c9927d5510)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c69a22-7665-4587-ab3d-1473f00c296c None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:18 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-b0acc4f8-c2b5-4700-8fb1-ecf04149d275 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.056s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:18 l75lg1-v1 manila-share[98474]: DEBUG manila.share.access [None req-b0acc4f8-c2b5-4700-8fb1-ecf04149d275 tempest-ShareIpRulesForNFSTest-1748669711 None] Updating access rules for share instance b7a7d61c-2cea-442a-9809-507038e080d5 belonging to share 1ddadc17-cf10-4a42-8bbd-8335fb3520a1. {{(pid=98474) update_access_rules /opt/stack/manila/manila/share/access.py:298}} May 28 12:58:18 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e4d1993b-6bf2-4567-84a9-36aee9246ffa tempest-ResourceLockCRUTest-1971036144 None] <<< [DELETE] https://127.0.0.1:40443/api/views/26/ May 28 12:58:18 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e4d1993b-6bf2-4567-84a9-36aee9246ffa tempest-ResourceLockCRUTest-1971036144 None] --- [DELETE] https://127.0.0.1:40443/api/views/26/: Done May 28 12:58:18 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e4d1993b-6bf2-4567-84a9-36aee9246ffa tempest-ResourceLockCRUTest-1971036144 None] >>> [GET] https://127.0.0.1:40443/api/quotas/ May 28 12:58:18 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e4d1993b-6bf2-4567-84a9-36aee9246ffa tempest-ResourceLockCRUTest-1971036144 None] {'allow_redirects': True, May 28 12:58:18 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e4d1993b-6bf2-4567-84a9-36aee9246ffa tempest-ResourceLockCRUTest-1971036144 None] 'params': {'name': '13a0450c-5c43-4fd2-9710-6cb3885f407a'}} May 28 12:58:18 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-b0acc4f8-c2b5-4700-8fb1-ecf04149d275 tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:18 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-b0acc4f8-c2b5-4700-8fb1-ecf04149d275 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:18 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-b0acc4f8-c2b5-4700-8fb1-ecf04149d275 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.008s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:18 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-b0acc4f8-c2b5-4700-8fb1-ecf04149d275 tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:18 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-b0acc4f8-c2b5-4700-8fb1-ecf04149d275 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:18 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-b0acc4f8-c2b5-4700-8fb1-ecf04149d275 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.016s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-19c69a22-7665-4587-ab3d-1473f00c296c None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e23f6715857452e892241c9927d5510', 'request_id': 'req-19c69a22-7665-4587-ab3d-1473f00c296c'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:58:18 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-b0acc4f8-c2b5-4700-8fb1-ecf04149d275 tempest-ShareIpRulesForNFSTest-1748669711 None] changing access on None May 28 12:58:18 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b0acc4f8-c2b5-4700-8fb1-ecf04149d275 tempest-ShareIpRulesForNFSTest-1748669711 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:58:18 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b0acc4f8-c2b5-4700-8fb1-ecf04149d275 tempest-ShareIpRulesForNFSTest-1748669711 None] {'allow_redirects': True, May 28 12:58:18 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b0acc4f8-c2b5-4700-8fb1-ecf04149d275 tempest-ShareIpRulesForNFSTest-1748669711 None] 'params': {'name': 'b7a7d61c-2cea-442a-9809-507038e080d5'}} May 28 12:58:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-19c69a22-7665-4587-ab3d-1473f00c296c None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e23f6715857452e892241c9927d5510', 'request_id': 'req-19c69a22-7665-4587-ab3d-1473f00c296c'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:58:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-19c69a22-7665-4587-ab3d-1473f00c296c None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e23f6715857452e892241c9927d5510', 'request_id': 'req-19c69a22-7665-4587-ab3d-1473f00c296c'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:58:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-19c69a22-7665-4587-ab3d-1473f00c296c None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e23f6715857452e892241c9927d5510', 'request_id': 'req-19c69a22-7665-4587-ab3d-1473f00c296c'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:58:18 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.quota [None req-bf30714a-ad04-4dc9-bf7b-6788b02e4540 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Committed reservations ['edb0e342-557d-412b-8986-e7b3743c1494', '1975c81f-70dc-4e41-b6e6-2686244d6ab7', '93b926fe-b1c0-46eb-9bfe-67ff4f3ccbdd', 'fd797d33-830f-48ea-a39d-acb79a8fb3a7'] {{(pid=98330) commit /opt/stack/manila/manila/quota.py:1063}} May 28 12:58:18 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-bf30714a-ad04-4dc9-bf7b-6788b02e4540 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/snapshots returned with HTTP 202 May 28 12:58:18 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 509/1019] 10.27.203.238 () {66 vars in 1371 bytes} [Tue May 28 12:58:18 2024] POST /share/v2/a3499cb78849424db45e54caac01de92/snapshots => generated 749 bytes in 179 msecs (HTTP/1.1 202) 6 headers in 237 bytes (1 switches on core 0) May 28 12:58:18 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-f9db7b69-0d63-491e-9afc-0e0f55b820cd tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] GET http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/snapshots/7f8e9058-4b96-4983-9bc5-b81989653aee May 28 12:58:18 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-f9db7b69-0d63-491e-9afc-0e0f55b820cd tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:18 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-f9db7b69-0d63-491e-9afc-0e0f55b820cd tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Calling method 'ShareSnapshotMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-19c69a22-7665-4587-ab3d-1473f00c296c None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e23f6715857452e892241c9927d5510', 'request_id': 'req-19c69a22-7665-4587-ab3d-1473f00c296c'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:58:18 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1097/2170] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 12:58:18 2024] DELETE /identity/v3/users/9e23f6715857452e892241c9927d5510 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:58:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8228762e-d5f8-42c8-91e8-48f49ca2829c None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8228762e-d5f8-42c8-91e8-48f49ca2829c None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8228762e-d5f8-42c8-91e8-48f49ca2829c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:18 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-8228762e-d5f8-42c8-91e8-48f49ca2829c None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:58:18 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-f9db7b69-0d63-491e-9afc-0e0f55b820cd tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/snapshots/7f8e9058-4b96-4983-9bc5-b81989653aee returned with HTTP 200 May 28 12:58:18 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 511/1020] 10.27.203.238 () {64 vars in 1460 bytes} [Tue May 28 12:58:18 2024] GET /share/v2/a3499cb78849424db45e54caac01de92/snapshots/7f8e9058-4b96-4983-9bc5-b81989653aee => generated 749 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:58:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-8228762e-d5f8-42c8-91e8-48f49ca2829c None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:58:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-8228762e-d5f8-42c8-91e8-48f49ca2829c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:58:18 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bf30714a-ad04-4dc9-bf7b-6788b02e4540 tempest-AdminActionsTest-1749172189 None] >>> [POST] https://127.0.0.1:40443/api/snapshots/ May 28 12:58:18 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bf30714a-ad04-4dc9-bf7b-6788b02e4540 tempest-AdminActionsTest-1749172189 None] {'data': '{"path": "/manila/manila-77a25e6b-f137-4342-8eb9-9ced679515e2", ' May 28 12:58:18 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bf30714a-ad04-4dc9-bf7b-6788b02e4540 tempest-AdminActionsTest-1749172189 None] '"name": "share-snapshot-1b959a63-6155-4bab-8823-312d4dcc85cb"}', May 28 12:58:18 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bf30714a-ad04-4dc9-bf7b-6788b02e4540 tempest-AdminActionsTest-1749172189 None] 'json': None, May 28 12:58:18 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bf30714a-ad04-4dc9-bf7b-6788b02e4540 tempest-AdminActionsTest-1749172189 None] 'params': None} May 28 12:58:18 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1074/2171] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:58:18 2024] POST /identity/v3/auth/tokens => generated 2960 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 12:58:18 l75lg1-v1 neutron-server[77619]: DEBUG neutron.wsgi [-] (77619) accepted ('10.27.203.238', 54776) {{(pid=77619) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 12:58:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c69a22-7665-4587-ab3d-1473f00c296c None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-19c69a22-7665-4587-ab3d-1473f00c296c None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:58:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c69a22-7665-4587-ab3d-1473f00c296c None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d904bf32-a62e-4a78-9a41-7abffdf1c5e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef17047035e4b518fd5360a01f2da1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d904bf32-a62e-4a78-9a41-7abffdf1c5e4 service neutron] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d904bf32-a62e-4a78-9a41-7abffdf1c5e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d904bf32-a62e-4a78-9a41-7abffdf1c5e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d904bf32-a62e-4a78-9a41-7abffdf1c5e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d904bf32-a62e-4a78-9a41-7abffdf1c5e4 service neutron] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:18 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1098/2172] 10.27.203.238 () {64 vars in 1432 bytes} [Tue May 28 12:58:18 2024] GET /identity/v3/auth/tokens => generated 2960 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 28 12:58:18 l75lg1-v1 neutron-server[77619]: INFO neutron.wsgi [None req-868660a7-15a0-4674-9809-012b3f025b04 None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=0a0f51e7150545b9a25bf6f47942ebc7&name=default HTTP/1.1" status: 200 len: 216 time: 0.0728199 May 28 12:58:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8228762e-d5f8-42c8-91e8-48f49ca2829c None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-8228762e-d5f8-42c8-91e8-48f49ca2829c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:58:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8228762e-d5f8-42c8-91e8-48f49ca2829c None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59a30bd-3ec5-47c6-8744-2751f6d3276e None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59a30bd-3ec5-47c6-8744-2751f6d3276e None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59a30bd-3ec5-47c6-8744-2751f6d3276e None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59a30bd-3ec5-47c6-8744-2751f6d3276e None admin] PATH_INFO: `/v3/projects/0a0f51e7150545b9a25bf6f47942ebc7` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59a30bd-3ec5-47c6-8744-2751f6d3276e None admin] RBAC: Authorizing `identity:delete_project(project_id=0a0f51e7150545b9a25bf6f47942ebc7)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59a30bd-3ec5-47c6-8744-2751f6d3276e None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-a59a30bd-3ec5-47c6-8744-2751f6d3276e None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a0f51e7150545b9a25bf6f47942ebc7', 'request_id': 'req-a59a30bd-3ec5-47c6-8744-2751f6d3276e'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:58:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-a59a30bd-3ec5-47c6-8744-2751f6d3276e None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a0f51e7150545b9a25bf6f47942ebc7', 'request_id': 'req-a59a30bd-3ec5-47c6-8744-2751f6d3276e'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:58:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-a59a30bd-3ec5-47c6-8744-2751f6d3276e None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a0f51e7150545b9a25bf6f47942ebc7', 'request_id': 'req-a59a30bd-3ec5-47c6-8744-2751f6d3276e'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:58:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-a59a30bd-3ec5-47c6-8744-2751f6d3276e None admin] The token cache is being invalidate because project 0a0f51e7150545b9a25bf6f47942ebc7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 12:58:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-a59a30bd-3ec5-47c6-8744-2751f6d3276e None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:58:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-a59a30bd-3ec5-47c6-8744-2751f6d3276e None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:58:18 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1075/2173] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 12:58:18 2024] DELETE /identity/v3/projects/0a0f51e7150545b9a25bf6f47942ebc7 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:58:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048b159b-cbb1-4dae-b4c0-c3e9bb12ed12 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048b159b-cbb1-4dae-b4c0-c3e9bb12ed12 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048b159b-cbb1-4dae-b4c0-c3e9bb12ed12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:18 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-048b159b-cbb1-4dae-b4c0-c3e9bb12ed12 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:58:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-048b159b-cbb1-4dae-b4c0-c3e9bb12ed12 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:58:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-048b159b-cbb1-4dae-b4c0-c3e9bb12ed12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:58:18 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1099/2174] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:58:18 2024] POST /identity/v3/auth/tokens => generated 312 bytes in 20 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 28 12:58:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0513d46d-a9e6-45fa-b269-9fbf9ff61d89 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0513d46d-a9e6-45fa-b269-9fbf9ff61d89 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0513d46d-a9e6-45fa-b269-9fbf9ff61d89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:18 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-0513d46d-a9e6-45fa-b269-9fbf9ff61d89 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:58:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-0513d46d-a9e6-45fa-b269-9fbf9ff61d89 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:58:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-0513d46d-a9e6-45fa-b269-9fbf9ff61d89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:58:18 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e4d1993b-6bf2-4567-84a9-36aee9246ffa tempest-ResourceLockCRUTest-1971036144 None] <<< [GET] https://127.0.0.1:40443/api/quotas/ May 28 12:58:18 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e4d1993b-6bf2-4567-84a9-36aee9246ffa tempest-ResourceLockCRUTest-1971036144 None] [Bunch(cluster='loop75-kfs', cluster_id=1, default_email=None, default_group_quota=None, default_user_quota=None, enable_alarms=True, enable_email_providers=True, grace_period=None, guid='e3418568-de5b-418a-9cb6-1d7ebf645618', hard_limit=1073741824, hard_limit_inodes=None, id=24, internal=False, is_user_quota=False, last_user_quotas_update=None, name='13a0450c-5c43-4fd2-9710-6cb3885f407a', num_blocked_users=0, num_exceeded_users=0, path='/manila/manila-13a0450c-5c43-4fd2-9710-6cb3885f407a', percent_capacity=0, percent_inodes=None, pretty_grace_period=None, pretty_grace_period_expiration=None, pretty_state='OK (CREATED)', soft_limit=None, soft_limit_inodes=None, state='OK', sync_state='CREATED', system_id=24, tenant_id=1, tenant_name='default', time_to_block=None, title='13a0450c-5c43-4fd2-9710-6cb3885f407a', url='https://127.0.0.1:40443/api/quotas/24/', used_capacity=0, used_capacity_tb=0.0, used_effective_capacity=0, used_effective_capacity_tb=0.0, used_inodes=0, used_limited_capacity=0)] May 28 12:58:18 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e4d1993b-6bf2-4567-84a9-36aee9246ffa tempest-ResourceLockCRUTest-1971036144 None] --- [GET] https://127.0.0.1:40443/api/quotas/: Done May 28 12:58:18 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e4d1993b-6bf2-4567-84a9-36aee9246ffa tempest-ResourceLockCRUTest-1971036144 None] >>> [DELETE] https://127.0.0.1:40443/api/quotas/24/ May 28 12:58:18 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1076/2175] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:58:18 2024] POST /identity/v3/auth/tokens => generated 2960 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 12:58:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048b159b-cbb1-4dae-b4c0-c3e9bb12ed12 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048b159b-cbb1-4dae-b4c0-c3e9bb12ed12 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67e620d-7352-4383-98dd-9c4fd06640f8 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67e620d-7352-4383-98dd-9c4fd06640f8 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67e620d-7352-4383-98dd-9c4fd06640f8 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67e620d-7352-4383-98dd-9c4fd06640f8 None admin] PATH_INFO: `/v3/domains` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67e620d-7352-4383-98dd-9c4fd06640f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=51267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:58:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67e620d-7352-4383-98dd-9c4fd06640f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67e620d-7352-4383-98dd-9c4fd06640f8 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:18 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1100/2176] 10.27.203.238 () {62 vars in 1220 bytes} [Tue May 28 12:58:18 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:58:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0513d46d-a9e6-45fa-b269-9fbf9ff61d89 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0513d46d-a9e6-45fa-b269-9fbf9ff61d89 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d9da0d-6f66-48e6-b302-0afa4c5e4c8f None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d9da0d-6f66-48e6-b302-0afa4c5e4c8f None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d9da0d-6f66-48e6-b302-0afa4c5e4c8f None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d9da0d-6f66-48e6-b302-0afa4c5e4c8f None admin] PATH_INFO: `/v3/projects` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d9da0d-6f66-48e6-b302-0afa4c5e4c8f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d9da0d-6f66-48e6-b302-0afa4c5e4c8f None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:18 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-187e5171-1f29-4db9-98cb-3460f512c9b4 tempest-ResourceLockCRUTest-1971036144 tempest-ResourceLockCRUTest-1971036144-project-member] GET http://10.27.203.238/share/v2/82840ccb77144a4aa2d0bdce807ce686/shares/3f6b8420-fc46-47fc-b707-d08dfd01280f May 28 12:58:18 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-187e5171-1f29-4db9-98cb-3460f512c9b4 tempest-ResourceLockCRUTest-1971036144 tempest-ResourceLockCRUTest-1971036144-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:18 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-187e5171-1f29-4db9-98cb-3460f512c9b4 tempest-ResourceLockCRUTest-1971036144 tempest-ResourceLockCRUTest-1971036144-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:18 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1077/2177] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 12:58:18 2024] POST /identity/v3/projects => generated 367 bytes in 34 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:58:18 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-187e5171-1f29-4db9-98cb-3460f512c9b4 tempest-ResourceLockCRUTest-1971036144 tempest-ResourceLockCRUTest-1971036144-project-member] http://10.27.203.238/share/v2/82840ccb77144a4aa2d0bdce807ce686/shares/3f6b8420-fc46-47fc-b707-d08dfd01280f returned with HTTP 200 May 28 12:58:18 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 510/1021] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:58:18 2024] GET /share/v2/82840ccb77144a4aa2d0bdce807ce686/shares/3f6b8420-fc46-47fc-b707-d08dfd01280f => generated 1318 bytes in 27 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:58:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67e620d-7352-4383-98dd-9c4fd06640f8 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67e620d-7352-4383-98dd-9c4fd06640f8 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e59fdb9-54af-4e12-ab5f-e18bf5ed5c79 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e59fdb9-54af-4e12-ab5f-e18bf5ed5c79 None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e59fdb9-54af-4e12-ab5f-e18bf5ed5c79 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e59fdb9-54af-4e12-ab5f-e18bf5ed5c79 None admin] PATH_INFO: `/v3/users` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e59fdb9-54af-4e12-ab5f-e18bf5ed5c79 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e59fdb9-54af-4e12-ab5f-e18bf5ed5c79 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:18 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-3e59fdb9-54af-4e12-ab5f-e18bf5ed5c79 None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 12:58:18 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1101/2178] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 12:58:18 2024] POST /identity/v3/users => generated 292 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:58:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d9da0d-6f66-48e6-b302-0afa4c5e4c8f None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d9da0d-6f66-48e6-b302-0afa4c5e4c8f None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c6f42c-723b-493e-9658-42eb8e93b41d None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c6f42c-723b-493e-9658-42eb8e93b41d None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c6f42c-723b-493e-9658-42eb8e93b41d None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c6f42c-723b-493e-9658-42eb8e93b41d None admin] PATH_INFO: `/v3/roles` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c6f42c-723b-493e-9658-42eb8e93b41d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c6f42c-723b-493e-9658-42eb8e93b41d None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:19 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1078/2179] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 12:58:18 2024] GET /identity/v3/roles => generated 1680 bytes in 18 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:58:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e59fdb9-54af-4e12-ab5f-e18bf5ed5c79 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e59fdb9-54af-4e12-ab5f-e18bf5ed5c79 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d676be0-7553-496e-83bc-5d9555002970 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d676be0-7553-496e-83bc-5d9555002970 None admin] REQUEST_METHOD: `PUT` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d676be0-7553-496e-83bc-5d9555002970 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d676be0-7553-496e-83bc-5d9555002970 None admin] PATH_INFO: `/v3/projects/7fddfcac22784ad6ba56f0209c4fd7a2/users/595f83b25b8744429daa0125a8d2fab7/roles/44620cad10ae407c90c91e2c296adb04` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d676be0-7553-496e-83bc-5d9555002970 None admin] RBAC: Authorizing `identity:create_grant(project_id=7fddfcac22784ad6ba56f0209c4fd7a2, user_id=595f83b25b8744429daa0125a8d2fab7, role_id=44620cad10ae407c90c91e2c296adb04)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d676be0-7553-496e-83bc-5d9555002970 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:19 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1102/2180] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 12:58:19 2024] PUT /identity/v3/projects/7fddfcac22784ad6ba56f0209c4fd7a2/users/595f83b25b8744429daa0125a8d2fab7/roles/44620cad10ae407c90c91e2c296adb04 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:58:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0e7d9d-aacb-421f-b92c-55a8562b1cc4 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0e7d9d-aacb-421f-b92c-55a8562b1cc4 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0e7d9d-aacb-421f-b92c-55a8562b1cc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:19 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-fc0e7d9d-aacb-421f-b92c-55a8562b1cc4 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:58:19 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b0acc4f8-c2b5-4700-8fb1-ecf04149d275 tempest-ShareIpRulesForNFSTest-1748669711 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:58:19 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b0acc4f8-c2b5-4700-8fb1-ecf04149d275 tempest-ShareIpRulesForNFSTest-1748669711 None] [Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=1, created='2024-05-28T12:57:40.763635Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='377955ad-d094-4e49-ab32-1021d943a572', id=21, internal=False, is_s3_default_policy=False, name='b7a7d61c-2cea-442a-9809-507038e080d5', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=['*'], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['*'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['*'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T12:58:11.063538Z', tenant_id=1, tenant_name='default', title='b7a7d61c-2cea-442a-9809-507038e080d5', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/21/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[])] May 28 12:58:19 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b0acc4f8-c2b5-4700-8fb1-ecf04149d275 tempest-ShareIpRulesForNFSTest-1748669711 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 12:58:19 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-b0acc4f8-c2b5-4700-8fb1-ecf04149d275 tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:19 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-b0acc4f8-c2b5-4700-8fb1-ecf04149d275 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-fc0e7d9d-aacb-421f-b92c-55a8562b1cc4 None None] MFA Rules not processed for user `595f83b25b8744429daa0125a8d2fab7`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:58:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-fc0e7d9d-aacb-421f-b92c-55a8562b1cc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:58:19 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1079/2181] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:58:19 2024] POST /identity/v3/auth/tokens => generated 3938 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:58:19 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-b0acc4f8-c2b5-4700-8fb1-ecf04149d275 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.053s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:19 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-b0acc4f8-c2b5-4700-8fb1-ecf04149d275 tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:19 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-b0acc4f8-c2b5-4700-8fb1-ecf04149d275 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:19 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-b0acc4f8-c2b5-4700-8fb1-ecf04149d275 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:19 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-b0acc4f8-c2b5-4700-8fb1-ecf04149d275 tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:19 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-b0acc4f8-c2b5-4700-8fb1-ecf04149d275 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:19 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-b0acc4f8-c2b5-4700-8fb1-ecf04149d275 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:19 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-b0acc4f8-c2b5-4700-8fb1-ecf04149d275 tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:19 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-b0acc4f8-c2b5-4700-8fb1-ecf04149d275 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d676be0-7553-496e-83bc-5d9555002970 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-7d676be0-7553-496e-83bc-5d9555002970 None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:58:19 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-b0acc4f8-c2b5-4700-8fb1-ecf04149d275 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.004s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:19 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-b0acc4f8-c2b5-4700-8fb1-ecf04149d275 tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:19 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-b0acc4f8-c2b5-4700-8fb1-ecf04149d275 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d676be0-7553-496e-83bc-5d9555002970 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:19 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-b0acc4f8-c2b5-4700-8fb1-ecf04149d275 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.042s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:19 l75lg1-v1 manila-share[98474]: INFO manila.share.access [None req-b0acc4f8-c2b5-4700-8fb1-ecf04149d275 tempest-ShareIpRulesForNFSTest-1748669711 None] Access rules were successfully modified for share instance b7a7d61c-2cea-442a-9809-507038e080d5 belonging to share 1ddadc17-cf10-4a42-8bbd-8335fb3520a1. May 28 12:58:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a1c123-7e09-4ee7-ab72-5b29ab3a3cc9 service manila] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f110cf6300f049c897d0aab63218d1e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a1c123-7e09-4ee7-ab72-5b29ab3a3cc9 service manila] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a1c123-7e09-4ee7-ab72-5b29ab3a3cc9 service manila] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a1c123-7e09-4ee7-ab72-5b29ab3a3cc9 service manila] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a1c123-7e09-4ee7-ab72-5b29ab3a3cc9 service manila] RBAC: Authorizing `identity:validate_token()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a1c123-7e09-4ee7-ab72-5b29ab3a3cc9 service manila] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:19 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1103/2182] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 12:58:19 2024] GET /identity/v3/auth/tokens => generated 3938 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 12:58:19 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-bc213b53-e20b-4111-a94a-4327255c3275 tempest-ShareLimitsTest-308397042 tempest-ShareLimitsTest-308397042-project-member] GET http://10.27.203.238/share/v1/7fddfcac22784ad6ba56f0209c4fd7a2/limits May 28 12:58:19 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-bc213b53-e20b-4111-a94a-4327255c3275 tempest-ShareLimitsTest-308397042 tempest-ShareLimitsTest-308397042-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:19 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-bc213b53-e20b-4111-a94a-4327255c3275 tempest-ShareLimitsTest-308397042 tempest-ShareLimitsTest-308397042-project-member] Calling method 'LimitsController.index' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:19 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-bc213b53-e20b-4111-a94a-4327255c3275 tempest-ShareLimitsTest-308397042 tempest-ShareLimitsTest-308397042-project-member] http://10.27.203.238/share/v1/7fddfcac22784ad6ba56f0209c4fd7a2/limits returned with HTTP 200 May 28 12:58:19 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 512/1022] 10.27.203.238 () {62 vars in 1297 bytes} [Tue May 28 12:58:19 2024] GET /share/v1/7fddfcac22784ad6ba56f0209c4fd7a2/limits => generated 330 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:58:19 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-11bc7c0c-9095-40b5-ac23-e944433130c4 tempest-ShareLimitsTest-308397042 tempest-ShareLimitsTest-308397042-project-member] GET http://10.27.203.238/share/v1/7fddfcac22784ad6ba56f0209c4fd7a2/limits May 28 12:58:19 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-11bc7c0c-9095-40b5-ac23-e944433130c4 tempest-ShareLimitsTest-308397042 tempest-ShareLimitsTest-308397042-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:19 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-11bc7c0c-9095-40b5-ac23-e944433130c4 tempest-ShareLimitsTest-308397042 tempest-ShareLimitsTest-308397042-project-member] Calling method 'LimitsController.index' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:19 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-11bc7c0c-9095-40b5-ac23-e944433130c4 tempest-ShareLimitsTest-308397042 tempest-ShareLimitsTest-308397042-project-member] http://10.27.203.238/share/v1/7fddfcac22784ad6ba56f0209c4fd7a2/limits returned with HTTP 200 May 28 12:58:19 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 511/1023] 10.27.203.238 () {62 vars in 1297 bytes} [Tue May 28 12:58:19 2024] GET /share/v1/7fddfcac22784ad6ba56f0209c4fd7a2/limits => generated 330 bytes in 14 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:58:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0e7d9d-aacb-421f-b92c-55a8562b1cc4 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:19 l75lg1-v1 dstat.sh[49771]: 28-05 12:58:19| 18 2 77 2 0|5715M 1769M 277M 7864M| 28k 11k| 0 2420k| 0 351 |9384 16k|1.32 1.07 1.01|2.0 1.0 0| 0 0 | 0 2048M| 29 358 0 38 0 May 28 12:58:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0e7d9d-aacb-421f-b92c-55a8562b1cc4 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7d91c1-29e7-4893-943c-183a94bdc219 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7d91c1-29e7-4893-943c-183a94bdc219 None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7d91c1-29e7-4893-943c-183a94bdc219 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7d91c1-29e7-4893-943c-183a94bdc219 None admin] PATH_INFO: `/v3/users/595f83b25b8744429daa0125a8d2fab7` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7d91c1-29e7-4893-943c-183a94bdc219 None admin] RBAC: Authorizing `identity:delete_user(user_id=595f83b25b8744429daa0125a8d2fab7)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7d91c1-29e7-4893-943c-183a94bdc219 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-bf7d91c1-29e7-4893-943c-183a94bdc219 None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '595f83b25b8744429daa0125a8d2fab7', 'request_id': 'req-bf7d91c1-29e7-4893-943c-183a94bdc219'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:58:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-bf7d91c1-29e7-4893-943c-183a94bdc219 None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '595f83b25b8744429daa0125a8d2fab7', 'request_id': 'req-bf7d91c1-29e7-4893-943c-183a94bdc219'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:58:19 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d26fdd02-decd-405f-8c00-5f1d70a43412 tempest-SharesMetadataTest-1561320255 None] <<< [POST] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:58:19 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d26fdd02-decd-405f-8c00-5f1d70a43412 tempest-SharesMetadataTest-1561320255 None] Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=0, created='2024-05-28T12:58:18.947693Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='f783b0c7-2ca2-4d9a-8771-78213ba8eaac', id=28, internal=False, is_s3_default_policy=False, name='8d0c9317-df90-47d1-b406-482ee14c60e8', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=[], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['*'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['*'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T12:58:19.254737Z', tenant_id=1, tenant_name='default', title='8d0c9317-df90-47d1-b406-482ee14c60e8', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/28/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[]) May 28 12:58:19 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d26fdd02-decd-405f-8c00-5f1d70a43412 tempest-SharesMetadataTest-1561320255 None] --- [POST] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 12:58:19 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d26fdd02-decd-405f-8c00-5f1d70a43412 tempest-SharesMetadataTest-1561320255 None] >>> [GET] https://127.0.0.1:40443/api/quotas/ May 28 12:58:19 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d26fdd02-decd-405f-8c00-5f1d70a43412 tempest-SharesMetadataTest-1561320255 None] {'allow_redirects': True, May 28 12:58:19 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d26fdd02-decd-405f-8c00-5f1d70a43412 tempest-SharesMetadataTest-1561320255 None] 'params': {'name': '8d0c9317-df90-47d1-b406-482ee14c60e8'}} May 28 12:58:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-bf7d91c1-29e7-4893-943c-183a94bdc219 None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '595f83b25b8744429daa0125a8d2fab7', 'request_id': 'req-bf7d91c1-29e7-4893-943c-183a94bdc219'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:58:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-bf7d91c1-29e7-4893-943c-183a94bdc219 None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '595f83b25b8744429daa0125a8d2fab7', 'request_id': 'req-bf7d91c1-29e7-4893-943c-183a94bdc219'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:58:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-bf7d91c1-29e7-4893-943c-183a94bdc219 None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '595f83b25b8744429daa0125a8d2fab7', 'request_id': 'req-bf7d91c1-29e7-4893-943c-183a94bdc219'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:58:19 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1080/2183] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 12:58:19 2024] DELETE /identity/v3/users/595f83b25b8744429daa0125a8d2fab7 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:58:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d59d879-d741-46a9-921a-3beac80534dd None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d59d879-d741-46a9-921a-3beac80534dd None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d59d879-d741-46a9-921a-3beac80534dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:19 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-7d59d879-d741-46a9-921a-3beac80534dd None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:58:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-7d59d879-d741-46a9-921a-3beac80534dd None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:58:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-7d59d879-d741-46a9-921a-3beac80534dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:58:19 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1104/2184] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:58:19 2024] POST /identity/v3/auth/tokens => generated 2960 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 12:58:19 l75lg1-v1 neutron-server[77619]: DEBUG neutron.wsgi [-] (77619) accepted ('10.27.203.238', 54784) {{(pid=77619) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 12:58:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7d91c1-29e7-4893-943c-183a94bdc219 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-bf7d91c1-29e7-4893-943c-183a94bdc219 None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:58:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7d91c1-29e7-4893-943c-183a94bdc219 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8b019c-61ab-4504-9222-7e4517355fd5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef17047035e4b518fd5360a01f2da1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8b019c-61ab-4504-9222-7e4517355fd5 service neutron] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8b019c-61ab-4504-9222-7e4517355fd5 service neutron] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8b019c-61ab-4504-9222-7e4517355fd5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8b019c-61ab-4504-9222-7e4517355fd5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8b019c-61ab-4504-9222-7e4517355fd5 service neutron] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:19 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1081/2185] 10.27.203.238 () {64 vars in 1432 bytes} [Tue May 28 12:58:19 2024] GET /identity/v3/auth/tokens => generated 2960 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 28 12:58:19 l75lg1-v1 neutron-server[77619]: INFO neutron.wsgi [None req-70d84988-4350-48d9-aae6-885e096df39b None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=7fddfcac22784ad6ba56f0209c4fd7a2&name=default HTTP/1.1" status: 200 len: 216 time: 0.0700490 May 28 12:58:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d59d879-d741-46a9-921a-3beac80534dd None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-7d59d879-d741-46a9-921a-3beac80534dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:58:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d59d879-d741-46a9-921a-3beac80534dd None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19338982-603a-4224-bc6a-9a700de8e768 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19338982-603a-4224-bc6a-9a700de8e768 None admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19338982-603a-4224-bc6a-9a700de8e768 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19338982-603a-4224-bc6a-9a700de8e768 None admin] PATH_INFO: `/v3/projects/7fddfcac22784ad6ba56f0209c4fd7a2` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19338982-603a-4224-bc6a-9a700de8e768 None admin] RBAC: Authorizing `identity:delete_project(project_id=7fddfcac22784ad6ba56f0209c4fd7a2)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19338982-603a-4224-bc6a-9a700de8e768 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-19338982-603a-4224-bc6a-9a700de8e768 None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7fddfcac22784ad6ba56f0209c4fd7a2', 'request_id': 'req-19338982-603a-4224-bc6a-9a700de8e768'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:58:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-19338982-603a-4224-bc6a-9a700de8e768 None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7fddfcac22784ad6ba56f0209c4fd7a2', 'request_id': 'req-19338982-603a-4224-bc6a-9a700de8e768'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:58:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-19338982-603a-4224-bc6a-9a700de8e768 None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7fddfcac22784ad6ba56f0209c4fd7a2', 'request_id': 'req-19338982-603a-4224-bc6a-9a700de8e768'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:58:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-19338982-603a-4224-bc6a-9a700de8e768 None admin] The token cache is being invalidate because project 7fddfcac22784ad6ba56f0209c4fd7a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 12:58:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-19338982-603a-4224-bc6a-9a700de8e768 None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:58:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-19338982-603a-4224-bc6a-9a700de8e768 None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:58:19 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1105/2186] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 12:58:19 2024] DELETE /identity/v3/projects/7fddfcac22784ad6ba56f0209c4fd7a2 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:58:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f2f656-cf0a-44a9-a4be-0841a1dd6375 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f2f656-cf0a-44a9-a4be-0841a1dd6375 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f2f656-cf0a-44a9-a4be-0841a1dd6375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:19 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-11f2f656-cf0a-44a9-a4be-0841a1dd6375 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:58:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-11f2f656-cf0a-44a9-a4be-0841a1dd6375 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:58:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-11f2f656-cf0a-44a9-a4be-0841a1dd6375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:58:19 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1082/2187] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:58:19 2024] POST /identity/v3/auth/tokens => generated 312 bytes in 19 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 28 12:58:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c47a86-49b0-4847-8dab-158936ee0236 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c47a86-49b0-4847-8dab-158936ee0236 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c47a86-49b0-4847-8dab-158936ee0236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:19 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-05c47a86-49b0-4847-8dab-158936ee0236 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:58:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-05c47a86-49b0-4847-8dab-158936ee0236 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:58:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-05c47a86-49b0-4847-8dab-158936ee0236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:58:19 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d26fdd02-decd-405f-8c00-5f1d70a43412 tempest-SharesMetadataTest-1561320255 None] <<< [GET] https://127.0.0.1:40443/api/quotas/ May 28 12:58:19 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d26fdd02-decd-405f-8c00-5f1d70a43412 tempest-SharesMetadataTest-1561320255 None] [] May 28 12:58:19 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d26fdd02-decd-405f-8c00-5f1d70a43412 tempest-SharesMetadataTest-1561320255 None] --- [GET] https://127.0.0.1:40443/api/quotas/: Done May 28 12:58:19 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d26fdd02-decd-405f-8c00-5f1d70a43412 tempest-SharesMetadataTest-1561320255 None] >>> [POST] https://127.0.0.1:40443/api/quotas/ May 28 12:58:19 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d26fdd02-decd-405f-8c00-5f1d70a43412 tempest-SharesMetadataTest-1561320255 None] {'data': '{"name": "8d0c9317-df90-47d1-b406-482ee14c60e8", "path": ' May 28 12:58:19 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d26fdd02-decd-405f-8c00-5f1d70a43412 tempest-SharesMetadataTest-1561320255 None] '"/manila/manila-8d0c9317-df90-47d1-b406-482ee14c60e8", "create_dir": ' May 28 12:58:19 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d26fdd02-decd-405f-8c00-5f1d70a43412 tempest-SharesMetadataTest-1561320255 None] 'true, "hard_limit": 1073741824}', May 28 12:58:19 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d26fdd02-decd-405f-8c00-5f1d70a43412 tempest-SharesMetadataTest-1561320255 None] 'json': None, May 28 12:58:19 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d26fdd02-decd-405f-8c00-5f1d70a43412 tempest-SharesMetadataTest-1561320255 None] 'params': None} May 28 12:58:19 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1106/2188] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:58:19 2024] POST /identity/v3/auth/tokens => generated 2960 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 12:58:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f2f656-cf0a-44a9-a4be-0841a1dd6375 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f2f656-cf0a-44a9-a4be-0841a1dd6375 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328afc53-61b8-44ac-96e1-b6298b71f340 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328afc53-61b8-44ac-96e1-b6298b71f340 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328afc53-61b8-44ac-96e1-b6298b71f340 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328afc53-61b8-44ac-96e1-b6298b71f340 None admin] PATH_INFO: `/v3/domains` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328afc53-61b8-44ac-96e1-b6298b71f340 None admin] RBAC: Adding query filter params (name=Default) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:58:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328afc53-61b8-44ac-96e1-b6298b71f340 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328afc53-61b8-44ac-96e1-b6298b71f340 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:19 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1083/2189] 10.27.203.238 () {62 vars in 1220 bytes} [Tue May 28 12:58:19 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:58:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c47a86-49b0-4847-8dab-158936ee0236 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c47a86-49b0-4847-8dab-158936ee0236 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43d3cac-c8eb-45e2-8839-6fac9fc5124b None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43d3cac-c8eb-45e2-8839-6fac9fc5124b None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43d3cac-c8eb-45e2-8839-6fac9fc5124b None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43d3cac-c8eb-45e2-8839-6fac9fc5124b None admin] PATH_INFO: `/v3/projects` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43d3cac-c8eb-45e2-8839-6fac9fc5124b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43d3cac-c8eb-45e2-8839-6fac9fc5124b None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:19 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1107/2190] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 12:58:19 2024] POST /identity/v3/projects => generated 371 bytes in 35 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:58:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328afc53-61b8-44ac-96e1-b6298b71f340 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328afc53-61b8-44ac-96e1-b6298b71f340 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b597d6-de77-4cb6-8930-de556e8b9b28 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b597d6-de77-4cb6-8930-de556e8b9b28 None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b597d6-de77-4cb6-8930-de556e8b9b28 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b597d6-de77-4cb6-8930-de556e8b9b28 None admin] PATH_INFO: `/v3/users` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b597d6-de77-4cb6-8930-de556e8b9b28 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b597d6-de77-4cb6-8930-de556e8b9b28 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:19 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-37b597d6-de77-4cb6-8930-de556e8b9b28 None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 12:58:19 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1084/2191] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 12:58:19 2024] POST /identity/v3/users => generated 294 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:58:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43d3cac-c8eb-45e2-8839-6fac9fc5124b None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43d3cac-c8eb-45e2-8839-6fac9fc5124b None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a06f6f-cff7-4ba3-9409-36c05f73a384 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a06f6f-cff7-4ba3-9409-36c05f73a384 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a06f6f-cff7-4ba3-9409-36c05f73a384 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a06f6f-cff7-4ba3-9409-36c05f73a384 None admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a06f6f-cff7-4ba3-9409-36c05f73a384 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a06f6f-cff7-4ba3-9409-36c05f73a384 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:19 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1108/2192] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 12:58:19 2024] GET /identity/v3/roles => generated 1680 bytes in 18 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:58:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b597d6-de77-4cb6-8930-de556e8b9b28 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b597d6-de77-4cb6-8930-de556e8b9b28 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf2f6c0-477b-405e-b1b8-8e929e9ad505 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf2f6c0-477b-405e-b1b8-8e929e9ad505 None admin] REQUEST_METHOD: `PUT` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf2f6c0-477b-405e-b1b8-8e929e9ad505 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf2f6c0-477b-405e-b1b8-8e929e9ad505 None admin] PATH_INFO: `/v3/projects/6d36e1eb1dbc449db6aca75b12a2ba18/users/672c4552229b4f82a12c9d2e0e77332f/roles/44620cad10ae407c90c91e2c296adb04` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf2f6c0-477b-405e-b1b8-8e929e9ad505 None admin] RBAC: Authorizing `identity:create_grant(project_id=6d36e1eb1dbc449db6aca75b12a2ba18, user_id=672c4552229b4f82a12c9d2e0e77332f, role_id=44620cad10ae407c90c91e2c296adb04)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf2f6c0-477b-405e-b1b8-8e929e9ad505 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:19 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1085/2193] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 12:58:19 2024] PUT /identity/v3/projects/6d36e1eb1dbc449db6aca75b12a2ba18/users/672c4552229b4f82a12c9d2e0e77332f/roles/44620cad10ae407c90c91e2c296adb04 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:58:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ab5852-de46-487e-97c3-5d051ad3e7dd None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ab5852-de46-487e-97c3-5d051ad3e7dd None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ab5852-de46-487e-97c3-5d051ad3e7dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:19 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-19ab5852-de46-487e-97c3-5d051ad3e7dd None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:58:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-19ab5852-de46-487e-97c3-5d051ad3e7dd None None] MFA Rules not processed for user `672c4552229b4f82a12c9d2e0e77332f`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:58:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-19ab5852-de46-487e-97c3-5d051ad3e7dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:58:19 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1109/2194] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:58:19 2024] POST /identity/v3/auth/tokens => generated 3942 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:58:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf2f6c0-477b-405e-b1b8-8e929e9ad505 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf2f6c0-477b-405e-b1b8-8e929e9ad505 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9155e44b-9140-427a-8b9d-3ca726c2d462 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9155e44b-9140-427a-8b9d-3ca726c2d462 None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9155e44b-9140-427a-8b9d-3ca726c2d462 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9155e44b-9140-427a-8b9d-3ca726c2d462 None admin] PATH_INFO: `/v3/projects` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9155e44b-9140-427a-8b9d-3ca726c2d462 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9155e44b-9140-427a-8b9d-3ca726c2d462 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:19 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1086/2195] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 12:58:19 2024] POST /identity/v3/projects => generated 369 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:58:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ab5852-de46-487e-97c3-5d051ad3e7dd None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ab5852-de46-487e-97c3-5d051ad3e7dd None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b2c2e7-89a1-429e-aa44-51d767a1c388 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b2c2e7-89a1-429e-aa44-51d767a1c388 None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b2c2e7-89a1-429e-aa44-51d767a1c388 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b2c2e7-89a1-429e-aa44-51d767a1c388 None admin] PATH_INFO: `/v3/users` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:19 l75lg1-v1 nova-conductor[83648]: DEBUG dbcounter [-] [83648] Writing DB stats nova_cell1:SELECT=1 {{(pid=83648) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:58:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b2c2e7-89a1-429e-aa44-51d767a1c388 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b2c2e7-89a1-429e-aa44-51d767a1c388 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:19 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-38b2c2e7-89a1-429e-aa44-51d767a1c388 None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 12:58:19 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1110/2196] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 12:58:19 2024] POST /identity/v3/users => generated 293 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:58:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9155e44b-9140-427a-8b9d-3ca726c2d462 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9155e44b-9140-427a-8b9d-3ca726c2d462 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb581bf-e6ef-4574-9d5e-b234c3818f80 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb581bf-e6ef-4574-9d5e-b234c3818f80 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb581bf-e6ef-4574-9d5e-b234c3818f80 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb581bf-e6ef-4574-9d5e-b234c3818f80 None admin] PATH_INFO: `/v3/roles` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb581bf-e6ef-4574-9d5e-b234c3818f80 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb581bf-e6ef-4574-9d5e-b234c3818f80 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:20 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1087/2197] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 12:58:19 2024] GET /identity/v3/roles => generated 1680 bytes in 16 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:58:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b2c2e7-89a1-429e-aa44-51d767a1c388 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b2c2e7-89a1-429e-aa44-51d767a1c388 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f0153a-e5ff-4c48-aba7-e20f733c1444 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f0153a-e5ff-4c48-aba7-e20f733c1444 None admin] REQUEST_METHOD: `PUT` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f0153a-e5ff-4c48-aba7-e20f733c1444 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f0153a-e5ff-4c48-aba7-e20f733c1444 None admin] PATH_INFO: `/v3/projects/f72e4ec607ca4e899b33f8b656888e37/users/31e9148b59af4472aa527a955469124d/roles/44620cad10ae407c90c91e2c296adb04` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f0153a-e5ff-4c48-aba7-e20f733c1444 None admin] RBAC: Authorizing `identity:create_grant(project_id=f72e4ec607ca4e899b33f8b656888e37, user_id=31e9148b59af4472aa527a955469124d, role_id=44620cad10ae407c90c91e2c296adb04)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f0153a-e5ff-4c48-aba7-e20f733c1444 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:20 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1111/2198] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 12:58:20 2024] PUT /identity/v3/projects/f72e4ec607ca4e899b33f8b656888e37/users/31e9148b59af4472aa527a955469124d/roles/44620cad10ae407c90c91e2c296adb04 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:58:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980dc6ea-429c-4364-bd55-cd25b414c75c None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980dc6ea-429c-4364-bd55-cd25b414c75c None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980dc6ea-429c-4364-bd55-cd25b414c75c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:20 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-980dc6ea-429c-4364-bd55-cd25b414c75c None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:58:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-980dc6ea-429c-4364-bd55-cd25b414c75c None None] MFA Rules not processed for user `31e9148b59af4472aa527a955469124d`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:58:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-980dc6ea-429c-4364-bd55-cd25b414c75c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:58:20 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1088/2199] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:58:20 2024] POST /identity/v3/auth/tokens => generated 3940 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:58:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f0153a-e5ff-4c48-aba7-e20f733c1444 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f0153a-e5ff-4c48-aba7-e20f733c1444 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a796db5-aad8-4d38-bba3-3c7ffd9afe1b None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a796db5-aad8-4d38-bba3-3c7ffd9afe1b None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a796db5-aad8-4d38-bba3-3c7ffd9afe1b None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a796db5-aad8-4d38-bba3-3c7ffd9afe1b None admin] PATH_INFO: `/v3/projects` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a796db5-aad8-4d38-bba3-3c7ffd9afe1b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a796db5-aad8-4d38-bba3-3c7ffd9afe1b None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:20 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1112/2200] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 12:58:20 2024] POST /identity/v3/projects => generated 369 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:58:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980dc6ea-429c-4364-bd55-cd25b414c75c None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980dc6ea-429c-4364-bd55-cd25b414c75c None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ffaf9c-886b-4885-b1bd-c1fb76f2df73 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ffaf9c-886b-4885-b1bd-c1fb76f2df73 None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ffaf9c-886b-4885-b1bd-c1fb76f2df73 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ffaf9c-886b-4885-b1bd-c1fb76f2df73 None admin] PATH_INFO: `/v3/users` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ffaf9c-886b-4885-b1bd-c1fb76f2df73 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ffaf9c-886b-4885-b1bd-c1fb76f2df73 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:20 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-f8ffaf9c-886b-4885-b1bd-c1fb76f2df73 None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 12:58:20 l75lg1-v1 dstat.sh[49771]: 28-05 12:58:20| 10 1 86 2 0|5715M 1768M 277M 7865M| 31k 1754B| 0 2040k| 0 263 |7770 13k|1.32 1.07 1.01| 0 1.0 0| 0 0 | 0 2048M| 29 358 0 38 0 May 28 12:58:20 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1089/2201] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 12:58:20 2024] POST /identity/v3/users => generated 292 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:58:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a796db5-aad8-4d38-bba3-3c7ffd9afe1b None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a796db5-aad8-4d38-bba3-3c7ffd9afe1b None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854fb54a-2607-46f4-839e-6688fae73b5e None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854fb54a-2607-46f4-839e-6688fae73b5e None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854fb54a-2607-46f4-839e-6688fae73b5e None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854fb54a-2607-46f4-839e-6688fae73b5e None admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854fb54a-2607-46f4-839e-6688fae73b5e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854fb54a-2607-46f4-839e-6688fae73b5e None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:20 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1113/2202] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 12:58:20 2024] GET /identity/v3/roles => generated 1680 bytes in 18 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:58:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ffaf9c-886b-4885-b1bd-c1fb76f2df73 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ffaf9c-886b-4885-b1bd-c1fb76f2df73 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9c1a2e-8e6f-4f87-9436-390536f343ad None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9c1a2e-8e6f-4f87-9436-390536f343ad None admin] REQUEST_METHOD: `PUT` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9c1a2e-8e6f-4f87-9436-390536f343ad None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9c1a2e-8e6f-4f87-9436-390536f343ad None admin] PATH_INFO: `/v3/projects/8ee1466a8fe242afa8e0d0378840bfc1/users/3bc1f1b24efd484493c1e18638340a25/roles/e7989893488f483baa107be56668c4f8` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9c1a2e-8e6f-4f87-9436-390536f343ad None admin] RBAC: Authorizing `identity:create_grant(project_id=8ee1466a8fe242afa8e0d0378840bfc1, user_id=3bc1f1b24efd484493c1e18638340a25, role_id=e7989893488f483baa107be56668c4f8)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9c1a2e-8e6f-4f87-9436-390536f343ad None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:20 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1090/2203] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 12:58:20 2024] PUT /identity/v3/projects/8ee1466a8fe242afa8e0d0378840bfc1/users/3bc1f1b24efd484493c1e18638340a25/roles/e7989893488f483baa107be56668c4f8 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:58:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854fb54a-2607-46f4-839e-6688fae73b5e None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854fb54a-2607-46f4-839e-6688fae73b5e None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108221f6-31f0-449c-b53f-7662899b4fdc None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108221f6-31f0-449c-b53f-7662899b4fdc None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108221f6-31f0-449c-b53f-7662899b4fdc None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108221f6-31f0-449c-b53f-7662899b4fdc None admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108221f6-31f0-449c-b53f-7662899b4fdc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108221f6-31f0-449c-b53f-7662899b4fdc None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:20 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1114/2204] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 12:58:20 2024] GET /identity/v3/roles => generated 1680 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:58:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9c1a2e-8e6f-4f87-9436-390536f343ad None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9c1a2e-8e6f-4f87-9436-390536f343ad None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ac9bd5-e7c3-4ade-aa36-aa90512947aa None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ac9bd5-e7c3-4ade-aa36-aa90512947aa None admin] REQUEST_METHOD: `PUT` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ac9bd5-e7c3-4ade-aa36-aa90512947aa None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ac9bd5-e7c3-4ade-aa36-aa90512947aa None admin] PATH_INFO: `/v3/projects/8ee1466a8fe242afa8e0d0378840bfc1/users/3bc1f1b24efd484493c1e18638340a25/roles/e7989893488f483baa107be56668c4f8` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ac9bd5-e7c3-4ade-aa36-aa90512947aa None admin] RBAC: Authorizing `identity:create_grant(project_id=8ee1466a8fe242afa8e0d0378840bfc1, user_id=3bc1f1b24efd484493c1e18638340a25, role_id=e7989893488f483baa107be56668c4f8)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ac9bd5-e7c3-4ade-aa36-aa90512947aa None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:20 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1091/2205] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 12:58:20 2024] PUT /identity/v3/projects/8ee1466a8fe242afa8e0d0378840bfc1/users/3bc1f1b24efd484493c1e18638340a25/roles/e7989893488f483baa107be56668c4f8 => generated 0 bytes in 18 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:58:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61835747-890d-4717-8d7a-347cee7628e4 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61835747-890d-4717-8d7a-347cee7628e4 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61835747-890d-4717-8d7a-347cee7628e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:20 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-61835747-890d-4717-8d7a-347cee7628e4 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:58:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-61835747-890d-4717-8d7a-347cee7628e4 None None] MFA Rules not processed for user `3bc1f1b24efd484493c1e18638340a25`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:58:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-61835747-890d-4717-8d7a-347cee7628e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:58:20 l75lg1-v1 neutron-server[77623]: DEBUG dbcounter [-] [77623] Writing DB stats neutron:SELECT=1 {{(pid=77623) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:58:20 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1115/2206] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:58:20 2024] POST /identity/v3/auth/tokens => generated 4063 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:58:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ac9bd5-e7c3-4ade-aa36-aa90512947aa None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:20 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d26fdd02-decd-405f-8c00-5f1d70a43412 tempest-SharesMetadataTest-1561320255 None] <<< [POST] https://127.0.0.1:40443/api/quotas/ May 28 12:58:20 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d26fdd02-decd-405f-8c00-5f1d70a43412 tempest-SharesMetadataTest-1561320255 None] Bunch(cluster='loop75-kfs', cluster_id=1, default_email=None, default_group_quota=None, default_user_quota=None, enable_alarms=True, enable_email_providers=True, grace_period=None, group_quotas=[], guid='3579bff1-f9e9-45c5-8cac-26aac3d8a5da', hard_limit=1073741824, hard_limit_inodes=None, id=25, internal=False, is_user_quota=False, last_user_quotas_update=None, name='8d0c9317-df90-47d1-b406-482ee14c60e8', num_blocked_users=0, num_exceeded_users=0, path='/manila/manila-8d0c9317-df90-47d1-b406-482ee14c60e8', percent_capacity=0, percent_inodes=None, pretty_grace_period=None, pretty_grace_period_expiration=None, pretty_state='OK (CREATED)', soft_limit=None, soft_limit_inodes=None, state='OK', sync_state='CREATED', system_id=25, tenant_id=1, tenant_name='default', time_to_block=None, title='8d0c9317-df90-47d1-b406-482ee14c60e8', url='https://127.0.0.1:40443/api/quotas/25/', used_capacity=0, used_capacity_tb=0.0, used_effective_capacity=0, used_effective_capacity_tb=0.0, used_inodes=0, used_limited_capacity=0, user_quotas=[]) May 28 12:58:20 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d26fdd02-decd-405f-8c00-5f1d70a43412 tempest-SharesMetadataTest-1561320255 None] --- [POST] https://127.0.0.1:40443/api/quotas/: Done May 28 12:58:20 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d26fdd02-decd-405f-8c00-5f1d70a43412 tempest-SharesMetadataTest-1561320255 None] >>> [GET] https://127.0.0.1:40443/api/views/ May 28 12:58:20 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d26fdd02-decd-405f-8c00-5f1d70a43412 tempest-SharesMetadataTest-1561320255 None] {'allow_redirects': True, May 28 12:58:20 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d26fdd02-decd-405f-8c00-5f1d70a43412 tempest-SharesMetadataTest-1561320255 None] 'params': {'name': '8d0c9317-df90-47d1-b406-482ee14c60e8'}} May 28 12:58:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ac9bd5-e7c3-4ade-aa36-aa90512947aa None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcfb523-7075-460c-b750-570d541cea04 tempest-PublicSharesTest-118543418 tempest-PublicSharesTest-118543418-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bc1f1b24efd484493c1e18638340a25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee1466a8fe242afa8e0d0378840bfc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcfb523-7075-460c-b750-570d541cea04 tempest-PublicSharesTest-118543418 tempest-PublicSharesTest-118543418-project-admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcfb523-7075-460c-b750-570d541cea04 tempest-PublicSharesTest-118543418 tempest-PublicSharesTest-118543418-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcfb523-7075-460c-b750-570d541cea04 tempest-PublicSharesTest-118543418 tempest-PublicSharesTest-118543418-project-admin] PATH_INFO: `/v3/domains` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcfb523-7075-460c-b750-570d541cea04 tempest-PublicSharesTest-118543418 tempest-PublicSharesTest-118543418-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:58:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcfb523-7075-460c-b750-570d541cea04 tempest-PublicSharesTest-118543418 tempest-PublicSharesTest-118543418-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcfb523-7075-460c-b750-570d541cea04 tempest-PublicSharesTest-118543418 tempest-PublicSharesTest-118543418-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:20 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1092/2207] 10.27.203.238 () {62 vars in 1241 bytes} [Tue May 28 12:58:20 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:58:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61835747-890d-4717-8d7a-347cee7628e4 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61835747-890d-4717-8d7a-347cee7628e4 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f1c5bd-f7ee-43f6-a76a-a0787e4eddf1 tempest-PublicSharesTest-118543418 tempest-PublicSharesTest-118543418-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bc1f1b24efd484493c1e18638340a25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee1466a8fe242afa8e0d0378840bfc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f1c5bd-f7ee-43f6-a76a-a0787e4eddf1 tempest-PublicSharesTest-118543418 tempest-PublicSharesTest-118543418-project-admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f1c5bd-f7ee-43f6-a76a-a0787e4eddf1 tempest-PublicSharesTest-118543418 tempest-PublicSharesTest-118543418-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f1c5bd-f7ee-43f6-a76a-a0787e4eddf1 tempest-PublicSharesTest-118543418 tempest-PublicSharesTest-118543418-project-admin] PATH_INFO: `/v3/users` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f1c5bd-f7ee-43f6-a76a-a0787e4eddf1 tempest-PublicSharesTest-118543418 tempest-PublicSharesTest-118543418-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f1c5bd-f7ee-43f6-a76a-a0787e4eddf1 tempest-PublicSharesTest-118543418 tempest-PublicSharesTest-118543418-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:20 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-18f1c5bd-f7ee-43f6-a76a-a0787e4eddf1 tempest-PublicSharesTest-118543418 tempest-PublicSharesTest-118543418-project-admin] Truncating password to algorithm specific maximum length 72 characters. May 28 12:58:20 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1116/2208] 10.27.203.238 () {64 vars in 1232 bytes} [Tue May 28 12:58:20 2024] POST /identity/v3/users => generated 435 bytes in 32 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:58:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcfb523-7075-460c-b750-570d541cea04 tempest-PublicSharesTest-118543418 tempest-PublicSharesTest-118543418-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcfb523-7075-460c-b750-570d541cea04 tempest-PublicSharesTest-118543418 tempest-PublicSharesTest-118543418-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71224d72-6a69-480f-9acd-7842f9411e23 tempest-PublicSharesTest-118543418 tempest-PublicSharesTest-118543418-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bc1f1b24efd484493c1e18638340a25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee1466a8fe242afa8e0d0378840bfc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71224d72-6a69-480f-9acd-7842f9411e23 tempest-PublicSharesTest-118543418 tempest-PublicSharesTest-118543418-project-admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71224d72-6a69-480f-9acd-7842f9411e23 tempest-PublicSharesTest-118543418 tempest-PublicSharesTest-118543418-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71224d72-6a69-480f-9acd-7842f9411e23 tempest-PublicSharesTest-118543418 tempest-PublicSharesTest-118543418-project-admin] PATH_INFO: `/v3/roles` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71224d72-6a69-480f-9acd-7842f9411e23 tempest-PublicSharesTest-118543418 tempest-PublicSharesTest-118543418-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71224d72-6a69-480f-9acd-7842f9411e23 tempest-PublicSharesTest-118543418 tempest-PublicSharesTest-118543418-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:20 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1093/2209] 10.27.203.238 () {62 vars in 1210 bytes} [Tue May 28 12:58:20 2024] GET /identity/v3/roles => generated 1680 bytes in 17 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:58:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f1c5bd-f7ee-43f6-a76a-a0787e4eddf1 tempest-PublicSharesTest-118543418 tempest-PublicSharesTest-118543418-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f1c5bd-f7ee-43f6-a76a-a0787e4eddf1 tempest-PublicSharesTest-118543418 tempest-PublicSharesTest-118543418-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fcdc8d-a2d0-46e0-ae31-31acd381d806 tempest-PublicSharesTest-118543418 tempest-PublicSharesTest-118543418-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bc1f1b24efd484493c1e18638340a25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee1466a8fe242afa8e0d0378840bfc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fcdc8d-a2d0-46e0-ae31-31acd381d806 tempest-PublicSharesTest-118543418 tempest-PublicSharesTest-118543418-project-admin] REQUEST_METHOD: `PUT` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fcdc8d-a2d0-46e0-ae31-31acd381d806 tempest-PublicSharesTest-118543418 tempest-PublicSharesTest-118543418-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fcdc8d-a2d0-46e0-ae31-31acd381d806 tempest-PublicSharesTest-118543418 tempest-PublicSharesTest-118543418-project-admin] PATH_INFO: `/v3/projects/8ee1466a8fe242afa8e0d0378840bfc1/users/6886717a9cfb42a0a4142a0b982570ee/roles/44620cad10ae407c90c91e2c296adb04` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fcdc8d-a2d0-46e0-ae31-31acd381d806 tempest-PublicSharesTest-118543418 tempest-PublicSharesTest-118543418-project-admin] RBAC: Authorizing `identity:create_grant(project_id=8ee1466a8fe242afa8e0d0378840bfc1, user_id=6886717a9cfb42a0a4142a0b982570ee, role_id=44620cad10ae407c90c91e2c296adb04)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fcdc8d-a2d0-46e0-ae31-31acd381d806 tempest-PublicSharesTest-118543418 tempest-PublicSharesTest-118543418-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:20 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1117/2210] 10.27.203.238 () {64 vars in 1571 bytes} [Tue May 28 12:58:20 2024] PUT /identity/v3/projects/8ee1466a8fe242afa8e0d0378840bfc1/users/6886717a9cfb42a0a4142a0b982570ee/roles/44620cad10ae407c90c91e2c296adb04 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:58:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71224d72-6a69-480f-9acd-7842f9411e23 tempest-PublicSharesTest-118543418 tempest-PublicSharesTest-118543418-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-71224d72-6a69-480f-9acd-7842f9411e23 tempest-PublicSharesTest-118543418 tempest-PublicSharesTest-118543418-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:58:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71224d72-6a69-480f-9acd-7842f9411e23 tempest-PublicSharesTest-118543418 tempest-PublicSharesTest-118543418-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6034c1e-1bd4-4501-b33f-af2c4c6be0e0 service manila] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f110cf6300f049c897d0aab63218d1e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6034c1e-1bd4-4501-b33f-af2c4c6be0e0 service manila] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6034c1e-1bd4-4501-b33f-af2c4c6be0e0 service manila] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6034c1e-1bd4-4501-b33f-af2c4c6be0e0 service manila] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:20 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-daa68adb-7f51-4915-9904-3df359bd73f0 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] GET http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/dacdb3b4-4336-45fd-b002-1a5aa6ad9957 May 28 12:58:20 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-daa68adb-7f51-4915-9904-3df359bd73f0 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:20 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-daa68adb-7f51-4915-9904-3df359bd73f0 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6034c1e-1bd4-4501-b33f-af2c4c6be0e0 service manila] RBAC: Authorizing `identity:validate_token()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6034c1e-1bd4-4501-b33f-af2c4c6be0e0 service manila] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:20 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1094/2211] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 12:58:20 2024] GET /identity/v3/auth/tokens => generated 4063 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 12:58:20 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-564ca0a4-a769-432b-8d72-3cdf36cd6010 tempest-PublicSharesTest-118543418 tempest-PublicSharesTest-118543418-project-admin] POST http://10.27.203.238/share/v2/8ee1466a8fe242afa8e0d0378840bfc1/types May 28 12:58:20 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-564ca0a4-a769-432b-8d72-3cdf36cd6010 tempest-PublicSharesTest-118543418 tempest-PublicSharesTest-118543418-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share_type": {"name": "tempest-typeshare-type-931046286", "extra_specs": {"driver_handles_share_servers": "False"}, "share_type_access:is_public": true}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:58:20 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-daa68adb-7f51-4915-9904-3df359bd73f0 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/dacdb3b4-4336-45fd-b002-1a5aa6ad9957 returned with HTTP 200 May 28 12:58:20 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 512/1024] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:58:20 2024] GET /share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/dacdb3b4-4336-45fd-b002-1a5aa6ad9957 => generated 1312 bytes in 31 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:58:20 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-564ca0a4-a769-432b-8d72-3cdf36cd6010 tempest-PublicSharesTest-118543418 tempest-PublicSharesTest-118543418-project-admin] http://10.27.203.238/share/v2/8ee1466a8fe242afa8e0d0378840bfc1/types returned with HTTP 200 May 28 12:58:20 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 513/1025] 10.27.203.238 () {66 vars in 1359 bytes} [Tue May 28 12:58:20 2024] POST /share/v2/8ee1466a8fe242afa8e0d0378840bfc1/types => generated 621 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:58:20 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-0e1fea71-d8a0-4d61-a7a0-79654970cec5 tempest-PublicSharesTest-118543418 tempest-PublicSharesTest-118543418-project-admin] POST http://10.27.203.238/share/v2/8ee1466a8fe242afa8e0d0378840bfc1/shares May 28 12:58:20 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-0e1fea71-d8a0-4d61-a7a0-79654970cec5 tempest-PublicSharesTest-118543418 tempest-PublicSharesTest-118543418-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share": {"share_proto": "nfs", "description": "public_share_desc", "snapshot_id": null, "name": "public_share - must be visible to all projects in the cloud", "size": 1, "metadata": {}, "is_public": true, "share_type": "31514837-1b9c-4410-8444-5ea15e0aca59"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:58:20 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.v1.shares [None req-0e1fea71-d8a0-4d61-a7a0-79654970cec5 tempest-PublicSharesTest-118543418 tempest-PublicSharesTest-118543418-project-admin] Create NFS share of 1 GB May 28 12:58:20 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.quota [None req-0e1fea71-d8a0-4d61-a7a0-79654970cec5 tempest-PublicSharesTest-118543418 tempest-PublicSharesTest-118543418-project-admin] Created reservations ['ccd02812-a99a-4d29-8c59-6a9167cd4e98', '1c5285a3-71ab-4073-9e9d-7ef3201a93fe', '4e60f869-01c1-405d-aa0f-05f925eb66c6', 'a56f501f-90ec-49c6-a4da-b342240dfa32'] {{(pid=98330) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 12:58:20 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.quota [None req-0e1fea71-d8a0-4d61-a7a0-79654970cec5 tempest-PublicSharesTest-118543418 tempest-PublicSharesTest-118543418-project-admin] Committed reservations ['ccd02812-a99a-4d29-8c59-6a9167cd4e98', '1c5285a3-71ab-4073-9e9d-7ef3201a93fe', '4e60f869-01c1-405d-aa0f-05f925eb66c6', 'a56f501f-90ec-49c6-a4da-b342240dfa32'] {{(pid=98330) commit /opt/stack/manila/manila/quota.py:1063}} May 28 12:58:20 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bf30714a-ad04-4dc9-bf7b-6788b02e4540 tempest-AdminActionsTest-1749172189 None] <<< [POST] https://127.0.0.1:40443/api/snapshots/ May 28 12:58:20 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bf30714a-ad04-4dc9-bf7b-6788b02e4540 tempest-AdminActionsTest-1749172189 None] Bunch(access_path='/.vast_all_snapshots/1000000010_share-snapshot-1b959a63-6155-4bab-8823-312d4dcc85cb', aggr_phys_estimation=0, cluster='loop75-kfs', created='2024-05-28T12:58:19.001914Z', eta_sec=30819898897.096382, expiration_time='3001-01-19T07:59:58Z', guid='956513d5-1d52-4445-a184-03c65f00e6e0', id=11, indestructible=False, locked=False, name='share-snapshot-1b959a63-6155-4bab-8823-312d4dcc85cb', path='/manila/manila-77a25e6b-f137-4342-8eb9-9ced679515e2/', policy=None, policy_id=None, protection_policy_id=None, state='SUCCEED', tenant_id=1, tenant_name='default', title='share-snapshot-1b959a63-6155-4bab-8823-312d4dcc85cb(/manila/manila-77a25e6b-f137-4342-8eb9-9ced679515e2/)', type='local', unique_phys_estimation=0, url='https://127.0.0.1:40443/api/snapshots/11/') May 28 12:58:20 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bf30714a-ad04-4dc9-bf7b-6788b02e4540 tempest-AdminActionsTest-1749172189 None] --- [POST] https://127.0.0.1:40443/api/snapshots/: Done May 28 12:58:20 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.host_manager [None req-0e1fea71-d8a0-4d61-a7a0-79654970cec5 tempest-PublicSharesTest-118543418 None] Share service is down. (host: l75lg1-v1@generic2). May 28 12:58:20 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.host_manager [None req-0e1fea71-d8a0-4d61-a7a0-79654970cec5 tempest-PublicSharesTest-118543418 None] Share service is down. (host: l75lg1-v1@generic1). May 28 12:58:20 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-0e1fea71-d8a0-4d61-a7a0-79654970cec5 tempest-PublicSharesTest-118543418 None] Starting with 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:80}} May 28 12:58:20 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-0e1fea71-d8a0-4d61-a7a0-79654970cec5 tempest-PublicSharesTest-118543418 None] Filter OnlyHostFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:58:20 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-0e1fea71-d8a0-4d61-a7a0-79654970cec5 tempest-PublicSharesTest-118543418 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:58:20 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.capacity [None req-0e1fea71-d8a0-4d61-a7a0-79654970cec5 tempest-PublicSharesTest-118543418 None] Space information for share creation on host l75lg1-v1@vast#vast (requested / avail): 1/2077 {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/capacity.py:83}} May 28 12:58:20 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-0e1fea71-d8a0-4d61-a7a0-79654970cec5 tempest-PublicSharesTest-118543418 None] Filter CapacityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:58:20 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-0e1fea71-d8a0-4d61-a7a0-79654970cec5 tempest-PublicSharesTest-118543418 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:58:20 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-0e1fea71-d8a0-4d61-a7a0-79654970cec5 tempest-PublicSharesTest-118543418 None] Driver Filter: Checking host 'l75lg1-v1@vast#vast' {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:37}} May 28 12:58:20 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-0e1fea71-d8a0-4d61-a7a0-79654970cec5 tempest-PublicSharesTest-118543418 None] Filter function not set :: passing host. {{(pid=98327) _check_filter_function /opt/stack/manila/manila/scheduler/filters/driver.py:53}} May 28 12:58:20 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-0e1fea71-d8a0-4d61-a7a0-79654970cec5 tempest-PublicSharesTest-118543418 None] Result: True {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:40}} May 28 12:58:20 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-0e1fea71-d8a0-4d61-a7a0-79654970cec5 tempest-PublicSharesTest-118543418 None] Done checking host 'l75lg1-v1@vast#vast' {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:41}} May 28 12:58:20 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-0e1fea71-d8a0-4d61-a7a0-79654970cec5 tempest-PublicSharesTest-118543418 None] Filter DriverFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:58:20 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-0e1fea71-d8a0-4d61-a7a0-79654970cec5 tempest-PublicSharesTest-118543418 None] Filter ShareReplicationFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:58:20 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-0e1fea71-d8a0-4d61-a7a0-79654970cec5 tempest-PublicSharesTest-118543418 None] Filter CreateFromSnapshotFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:58:20 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-0e1fea71-d8a0-4d61-a7a0-79654970cec5 tempest-PublicSharesTest-118543418 None] Filter AffinityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:58:20 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-0e1fea71-d8a0-4d61-a7a0-79654970cec5 tempest-PublicSharesTest-118543418 None] Filter AntiAffinityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:58:20 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.drivers.filter [None req-0e1fea71-d8a0-4d61-a7a0-79654970cec5 tempest-PublicSharesTest-118543418 None] Filtered share [host: 'l75lg1-v1@vast#vast', free_capacity_gb: 2077.6229242384434, pools: None] {{(pid=98327) _schedule_share /opt/stack/manila/manila/scheduler/drivers/filter.py:268}} May 28 12:58:20 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-0e1fea71-d8a0-4d61-a7a0-79654970cec5 tempest-PublicSharesTest-118543418 None] Checking host 'l75lg1-v1@vast#vast' {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:46}} May 28 12:58:20 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.weighers.goodness [None req-0e1fea71-d8a0-4d61-a7a0-79654970cec5 tempest-PublicSharesTest-118543418 None] Goodness function not set :: defaulting to minimal goodness rating of 0. May 28 12:58:20 l75lg1-v1 manila-scheduler[98327]: INFO manila.scheduler.weighers.goodness [None req-0e1fea71-d8a0-4d61-a7a0-79654970cec5 tempest-PublicSharesTest-118543418 None] Goodness function result for host l75lg1-v1@vast#vast: 0. May 28 12:58:20 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-0e1fea71-d8a0-4d61-a7a0-79654970cec5 tempest-PublicSharesTest-118543418 None] Goodness: 0 {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:48}} May 28 12:58:20 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-0e1fea71-d8a0-4d61-a7a0-79654970cec5 tempest-PublicSharesTest-118543418 tempest-PublicSharesTest-118543418-project-admin] http://10.27.203.238/share/v2/8ee1466a8fe242afa8e0d0378840bfc1/shares returned with HTTP 200 May 28 12:58:20 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-0e1fea71-d8a0-4d61-a7a0-79654970cec5 tempest-PublicSharesTest-118543418 None] Done checking host 'l75lg1-v1@vast#vast' {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:49}} May 28 12:58:20 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.drivers.filter [None req-0e1fea71-d8a0-4d61-a7a0-79654970cec5 tempest-PublicSharesTest-118543418 None] Choosing for share: WeighedHost [host: l75lg1-v1@vast#vast, weight: 0.0] {{(pid=98327) _schedule_share /opt/stack/manila/manila/scheduler/drivers/filter.py:274}} May 28 12:58:20 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 513/1026] 10.27.203.238 () {66 vars in 1362 bytes} [Tue May 28 12:58:20 2024] POST /share/v2/8ee1466a8fe242afa8e0d0378840bfc1/shares => generated 1369 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:58:20 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-0a693ae4-d907-4403-8bcd-c62e0276a787 tempest-PublicSharesTest-118543418 tempest-PublicSharesTest-118543418-project-admin] GET http://10.27.203.238/share/v2/8ee1466a8fe242afa8e0d0378840bfc1/shares/5a92a994-03f1-4598-b3f6-70280cf0a971 May 28 12:58:20 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-0a693ae4-d907-4403-8bcd-c62e0276a787 tempest-PublicSharesTest-118543418 tempest-PublicSharesTest-118543418-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:20 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-0a693ae4-d907-4403-8bcd-c62e0276a787 tempest-PublicSharesTest-118543418 tempest-PublicSharesTest-118543418-project-admin] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:20 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-0a693ae4-d907-4403-8bcd-c62e0276a787 tempest-PublicSharesTest-118543418 tempest-PublicSharesTest-118543418-project-admin] http://10.27.203.238/share/v2/8ee1466a8fe242afa8e0d0378840bfc1/shares/5a92a994-03f1-4598-b3f6-70280cf0a971 returned with HTTP 200 May 28 12:58:20 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 514/1027] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:58:20 2024] GET /share/v2/8ee1466a8fe242afa8e0d0378840bfc1/shares/5a92a994-03f1-4598-b3f6-70280cf0a971 => generated 1369 bytes in 22 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:58:21 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0e1fea71-d8a0-4d61-a7a0-79654970cec5 tempest-PublicSharesTest-118543418 None] >>> [GET] https://127.0.0.1:40443/api/vippools/ May 28 12:58:21 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0e1fea71-d8a0-4d61-a7a0-79654970cec5 tempest-PublicSharesTest-118543418 None] {'allow_redirects': True, 'params': {'name': 'vippool-1'}} May 28 12:58:21 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d26fdd02-decd-405f-8c00-5f1d70a43412 tempest-SharesMetadataTest-1561320255 None] <<< [GET] https://127.0.0.1:40443/api/views/ May 28 12:58:21 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d26fdd02-decd-405f-8c00-5f1d70a43412 tempest-SharesMetadataTest-1561320255 None] [] May 28 12:58:21 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d26fdd02-decd-405f-8c00-5f1d70a43412 tempest-SharesMetadataTest-1561320255 None] --- [GET] https://127.0.0.1:40443/api/views/: Done May 28 12:58:21 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d26fdd02-decd-405f-8c00-5f1d70a43412 tempest-SharesMetadataTest-1561320255 None] >>> [POST] https://127.0.0.1:40443/api/views/ May 28 12:58:21 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d26fdd02-decd-405f-8c00-5f1d70a43412 tempest-SharesMetadataTest-1561320255 None] {'data': '{"name": "8d0c9317-df90-47d1-b406-482ee14c60e8", "path": ' May 28 12:58:21 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d26fdd02-decd-405f-8c00-5f1d70a43412 tempest-SharesMetadataTest-1561320255 None] '"/manila/manila-8d0c9317-df90-47d1-b406-482ee14c60e8", "policy_id": ' May 28 12:58:21 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d26fdd02-decd-405f-8c00-5f1d70a43412 tempest-SharesMetadataTest-1561320255 None] '28, "create_dir": true, "protocols": ["NFS"]}', May 28 12:58:21 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d26fdd02-decd-405f-8c00-5f1d70a43412 tempest-SharesMetadataTest-1561320255 None] 'json': None, May 28 12:58:21 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d26fdd02-decd-405f-8c00-5f1d70a43412 tempest-SharesMetadataTest-1561320255 None] 'params': None} May 28 12:58:21 l75lg1-v1 dstat.sh[49771]: 28-05 12:58:21| 9 1 87 3 0|5716M 1767M 277M 7865M| 31k 2792B| 0 2832k| 0 294 |6876 11k|1.32 1.07 1.01|1.0 1.0 0| 0 0 | 0 2048M| 29 357 0 38 0 May 28 12:58:21 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-deded916-14db-4b93-a68b-37bbf4c222a5 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] GET http://10.27.203.238/share/v2/776f75906bc64f8f9316d5aab4b50bf1/share-access-rules?share_id=1ddadc17-cf10-4a42-8bbd-8335fb3520a1 May 28 12:58:21 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-deded916-14db-4b93-a68b-37bbf4c222a5 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:21 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-deded916-14db-4b93-a68b-37bbf4c222a5 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:21 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.lock.api [None req-deded916-14db-4b93-a68b-37bbf4c222a5 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Searching for locks by: {'resource_id': 'b2e61511-34dc-4e43-b8f2-c23097e69425', 'resource_action': 'show', 'resource_type': 'access_rule'} {{(pid=98330) get_all /opt/stack/manila/manila/lock/api.py:112}} May 28 12:58:21 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-deded916-14db-4b93-a68b-37bbf4c222a5 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] http://10.27.203.238/share/v2/776f75906bc64f8f9316d5aab4b50bf1/share-access-rules?share_id=1ddadc17-cf10-4a42-8bbd-8335fb3520a1 returned with HTTP 200 May 28 12:58:21 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 514/1028] 10.27.203.238 () {64 vars in 1467 bytes} [Tue May 28 12:58:21 2024] GET /share/v2/776f75906bc64f8f9316d5aab4b50bf1/share-access-rules?share_id=1ddadc17-cf10-4a42-8bbd-8335fb3520a1 => generated 286 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:58:21 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-c8e727f7-de8d-4567-801e-7bb4c4ce75b9 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] POST http://10.27.203.238/share/v2/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action May 28 12:58:21 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-c8e727f7-de8d-4567-801e-7bb4c4ce75b9 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Action body: b'{"deny_access": {"access_id": "b2e61511-34dc-4e43-b8f2-c23097e69425"}}' {{(pid=98329) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:58:21 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-c8e727f7-de8d-4567-801e-7bb4c4ce75b9 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Action: 'action', calling method: ShareController.deny_access, body: {"deny_access": {"access_id": "b2e61511-34dc-4e43-b8f2-c23097e69425"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:58:21 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.lock.api [None req-c8e727f7-de8d-4567-801e-7bb4c4ce75b9 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Searching for locks by: {'resource_id': 'b2e61511-34dc-4e43-b8f2-c23097e69425', 'resource_action': 'delete'} {{(pid=98329) get_all /opt/stack/manila/manila/lock/api.py:112}} May 28 12:58:21 l75lg1-v1 devstack@m-api.service[98329]: DEBUG oslo_concurrency.lockutils [None req-c8e727f7-de8d-4567-801e-7bb4c4ce75b9 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98329) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:21 l75lg1-v1 devstack@m-api.service[98329]: DEBUG oslo_concurrency.lockutils [None req-c8e727f7-de8d-4567-801e-7bb4c4ce75b9 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98329) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:21 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0e1fea71-d8a0-4d61-a7a0-79654970cec5 tempest-PublicSharesTest-118543418 None] <<< [GET] https://127.0.0.1:40443/api/vippools/ May 28 12:58:21 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0e1fea71-d8a0-4d61-a7a0-79654970cec5 tempest-PublicSharesTest-118543418 None] [Bunch(active_cnode_ids=[], active_interfaces=4, cluster='loop75-kfs', cluster_id=1, cnode_ids=[], cnodes=[], domain_name='vippool-1', enable_l3=False, enable_weighted_balancing=False, enabled=True, end_ip='172.21.75.4', guid='f2abaede-b397-413a-8faa-3aeead6d3b28', gw_ip='', gw_ipv6='', id=2, ip_ranges=[['172.21.75.1', '172.21.75.4']], name='vippool-1', peer_asn=0, port_membership='ALL', ranges_summary='172.21.75.[1-4]', role='PROTOCOLS', start_ip='172.21.75.1', subnet_cidr=16, subnet_cidr_ipv6=None, sync='SYNCED', sync_time='2024-05-28T12:50:09.644123Z', tenant_id=1, tenant_name='default', title='172.21.75.1 - 172.21.75.4', url='https://127.0.0.1:40443/api/vippools/2/', vast_asn=0, vlan=0, vms_preferred=False)] May 28 12:58:21 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0e1fea71-d8a0-4d61-a7a0-79654970cec5 tempest-PublicSharesTest-118543418 None] --- [GET] https://127.0.0.1:40443/api/vippools/: Done May 28 12:58:21 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0e1fea71-d8a0-4d61-a7a0-79654970cec5 tempest-PublicSharesTest-118543418 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:58:21 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0e1fea71-d8a0-4d61-a7a0-79654970cec5 tempest-PublicSharesTest-118543418 None] {'allow_redirects': True, May 28 12:58:21 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0e1fea71-d8a0-4d61-a7a0-79654970cec5 tempest-PublicSharesTest-118543418 None] 'params': {'name': 'c4c98d1e-9abc-48c7-a23f-ed7f1a740252'}} May 28 12:58:21 l75lg1-v1 devstack@m-api.service[98329]: DEBUG oslo_concurrency.lockutils [None req-c8e727f7-de8d-4567-801e-7bb4c4ce75b9 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.040s {{(pid=98329) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:21 l75lg1-v1 devstack@m-api.service[98329]: DEBUG oslo_concurrency.lockutils [None req-c8e727f7-de8d-4567-801e-7bb4c4ce75b9 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98329) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:21 l75lg1-v1 devstack@m-api.service[98329]: DEBUG oslo_concurrency.lockutils [None req-c8e727f7-de8d-4567-801e-7bb4c4ce75b9 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98329) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:21 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-1cd8cbc0-31e0-4fe6-b605-6d3963cb2926 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] GET http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/snapshots/7f8e9058-4b96-4983-9bc5-b81989653aee May 28 12:58:21 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-1cd8cbc0-31e0-4fe6-b605-6d3963cb2926 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:21 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-1cd8cbc0-31e0-4fe6-b605-6d3963cb2926 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Calling method 'ShareSnapshotMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:21 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-1cd8cbc0-31e0-4fe6-b605-6d3963cb2926 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/snapshots/7f8e9058-4b96-4983-9bc5-b81989653aee returned with HTTP 200 May 28 12:58:21 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 515/1029] 10.27.203.238 () {64 vars in 1460 bytes} [Tue May 28 12:58:21 2024] GET /share/v2/a3499cb78849424db45e54caac01de92/snapshots/7f8e9058-4b96-4983-9bc5-b81989653aee => generated 750 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:58:21 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-5ada43af-3a32-4ea4-b9e9-38f95d37e143 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] POST http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/snapshots/7f8e9058-4b96-4983-9bc5-b81989653aee/action May 28 12:58:21 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-5ada43af-3a32-4ea4-b9e9-38f95d37e143 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Action body: b'{"reset_status": {"status": "creating"}}' {{(pid=98330) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:58:21 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-5ada43af-3a32-4ea4-b9e9-38f95d37e143 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Action: 'action', calling method: ShareSnapshotsController.snapshot_reset_status, body: {"reset_status": {"status": "creating"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:58:21 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-5ada43af-3a32-4ea4-b9e9-38f95d37e143 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Updating share_snapshot '7f8e9058-4b96-4983-9bc5-b81989653aee' with '{'status': 'creating'}' {{(pid=98330) _reset_status /opt/stack/manila/manila/api/openstack/wsgi.py:1257}} May 28 12:58:21 l75lg1-v1 devstack@m-api.service[98329]: DEBUG oslo_concurrency.lockutils [None req-c8e727f7-de8d-4567-801e-7bb4c4ce75b9 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.054s {{(pid=98329) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:21 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-c8e727f7-de8d-4567-801e-7bb4c4ce75b9 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] http://10.27.203.238/share/v2/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action returned with HTTP 202 May 28 12:58:21 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 515/1030] 10.27.203.238 () {66 vars in 1493 bytes} [Tue May 28 12:58:21 2024] POST /share/v2/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action => generated 0 bytes in 173 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:58:21 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-395758c0-6cf9-4715-be18-eaed69e31ed2 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] GET http://10.27.203.238/share/v2/776f75906bc64f8f9316d5aab4b50bf1/share-access-rules?share_id=1ddadc17-cf10-4a42-8bbd-8335fb3520a1 May 28 12:58:21 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-395758c0-6cf9-4715-be18-eaed69e31ed2 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:21 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-395758c0-6cf9-4715-be18-eaed69e31ed2 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:21 l75lg1-v1 manila-share[98474]: DEBUG manila.share.manager [None req-c8e727f7-de8d-4567-801e-7bb4c4ce75b9 tempest-ShareIpRulesForNFSTest-1748669711 None] Received request to update access for share instance b7a7d61c-2cea-442a-9809-507038e080d5. {{(pid=98474) update_access_for_instances /opt/stack/manila/manila/share/manager.py:4353}} May 28 12:58:21 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.lock.api [None req-395758c0-6cf9-4715-be18-eaed69e31ed2 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Searching for locks by: {'resource_id': 'b2e61511-34dc-4e43-b8f2-c23097e69425', 'resource_action': 'show', 'resource_type': 'access_rule'} {{(pid=98329) get_all /opt/stack/manila/manila/lock/api.py:112}} May 28 12:58:21 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c8e727f7-de8d-4567-801e-7bb4c4ce75b9 tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:21 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c8e727f7-de8d-4567-801e-7bb4c4ce75b9 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:21 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-395758c0-6cf9-4715-be18-eaed69e31ed2 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] http://10.27.203.238/share/v2/776f75906bc64f8f9316d5aab4b50bf1/share-access-rules?share_id=1ddadc17-cf10-4a42-8bbd-8335fb3520a1 returned with HTTP 200 May 28 12:58:21 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 516/1031] 10.27.203.238 () {64 vars in 1467 bytes} [Tue May 28 12:58:21 2024] GET /share/v2/776f75906bc64f8f9316d5aab4b50bf1/share-access-rules?share_id=1ddadc17-cf10-4a42-8bbd-8335fb3520a1 => generated 294 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:58:21 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c8e727f7-de8d-4567-801e-7bb4c4ce75b9 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.004s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:21 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c8e727f7-de8d-4567-801e-7bb4c4ce75b9 tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:21 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c8e727f7-de8d-4567-801e-7bb4c4ce75b9 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:21 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-5ada43af-3a32-4ea4-b9e9-38f95d37e143 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/snapshots/7f8e9058-4b96-4983-9bc5-b81989653aee/action returned with HTTP 202 May 28 12:58:21 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 516/1032] 10.27.203.238 () {66 vars in 1502 bytes} [Tue May 28 12:58:21 2024] POST /share/v2/a3499cb78849424db45e54caac01de92/snapshots/7f8e9058-4b96-4983-9bc5-b81989653aee/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:58:21 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-10172f09-2f88-4fd4-bb68-0733d0a2d1c8 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] GET http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/snapshots/7f8e9058-4b96-4983-9bc5-b81989653aee May 28 12:58:21 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-10172f09-2f88-4fd4-bb68-0733d0a2d1c8 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:21 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-10172f09-2f88-4fd4-bb68-0733d0a2d1c8 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Calling method 'ShareSnapshotMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:21 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-10172f09-2f88-4fd4-bb68-0733d0a2d1c8 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/snapshots/7f8e9058-4b96-4983-9bc5-b81989653aee returned with HTTP 200 May 28 12:58:21 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 517/1033] 10.27.203.238 () {64 vars in 1460 bytes} [Tue May 28 12:58:21 2024] GET /share/v2/a3499cb78849424db45e54caac01de92/snapshots/7f8e9058-4b96-4983-9bc5-b81989653aee => generated 749 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:58:21 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c8e727f7-de8d-4567-801e-7bb4c4ce75b9 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.063s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:21 l75lg1-v1 manila-share[98474]: DEBUG manila.share.access [None req-c8e727f7-de8d-4567-801e-7bb4c4ce75b9 tempest-ShareIpRulesForNFSTest-1748669711 None] Updating access rules for share instance b7a7d61c-2cea-442a-9809-507038e080d5 belonging to share 1ddadc17-cf10-4a42-8bbd-8335fb3520a1. {{(pid=98474) update_access_rules /opt/stack/manila/manila/share/access.py:298}} May 28 12:58:21 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-055f0dbf-367a-4c6a-8db9-49be03ae7235 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] POST http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/snapshots/7f8e9058-4b96-4983-9bc5-b81989653aee/action May 28 12:58:21 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-055f0dbf-367a-4c6a-8db9-49be03ae7235 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Action body: b'{"reset_status": {"status": "available"}}' {{(pid=98330) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:58:21 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-055f0dbf-367a-4c6a-8db9-49be03ae7235 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Action: 'action', calling method: ShareSnapshotsController.snapshot_reset_status, body: {"reset_status": {"status": "available"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:58:21 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-055f0dbf-367a-4c6a-8db9-49be03ae7235 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Updating share_snapshot '7f8e9058-4b96-4983-9bc5-b81989653aee' with '{'status': 'available'}' {{(pid=98330) _reset_status /opt/stack/manila/manila/api/openstack/wsgi.py:1257}} May 28 12:58:21 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c8e727f7-de8d-4567-801e-7bb4c4ce75b9 tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:21 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c8e727f7-de8d-4567-801e-7bb4c4ce75b9 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:21 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c8e727f7-de8d-4567-801e-7bb4c4ce75b9 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.008s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:21 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c8e727f7-de8d-4567-801e-7bb4c4ce75b9 tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:21 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c8e727f7-de8d-4567-801e-7bb4c4ce75b9 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:21 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c8e727f7-de8d-4567-801e-7bb4c4ce75b9 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.013s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:21 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-c8e727f7-de8d-4567-801e-7bb4c4ce75b9 tempest-ShareIpRulesForNFSTest-1748669711 None] changing access on None May 28 12:58:21 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c8e727f7-de8d-4567-801e-7bb4c4ce75b9 tempest-ShareIpRulesForNFSTest-1748669711 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:58:21 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c8e727f7-de8d-4567-801e-7bb4c4ce75b9 tempest-ShareIpRulesForNFSTest-1748669711 None] {'allow_redirects': True, May 28 12:58:21 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c8e727f7-de8d-4567-801e-7bb4c4ce75b9 tempest-ShareIpRulesForNFSTest-1748669711 None] 'params': {'name': 'b7a7d61c-2cea-442a-9809-507038e080d5'}} May 28 12:58:21 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-055f0dbf-367a-4c6a-8db9-49be03ae7235 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/snapshots/7f8e9058-4b96-4983-9bc5-b81989653aee/action returned with HTTP 202 May 28 12:58:21 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 517/1034] 10.27.203.238 () {66 vars in 1502 bytes} [Tue May 28 12:58:21 2024] POST /share/v2/a3499cb78849424db45e54caac01de92/snapshots/7f8e9058-4b96-4983-9bc5-b81989653aee/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:58:21 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-4bc6d808-631d-4ebf-840c-a280d83ad4eb tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] GET http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/snapshots/7f8e9058-4b96-4983-9bc5-b81989653aee May 28 12:58:21 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-4bc6d808-631d-4ebf-840c-a280d83ad4eb tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:21 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-4bc6d808-631d-4ebf-840c-a280d83ad4eb tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Calling method 'ShareSnapshotMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:21 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d26fdd02-decd-405f-8c00-5f1d70a43412 tempest-SharesMetadataTest-1561320255 None] <<< [POST] https://127.0.0.1:40443/api/views/ May 28 12:58:21 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d26fdd02-decd-405f-8c00-5f1d70a43412 tempest-SharesMetadataTest-1561320255 None] Bunch(abac_tags=[], abe_max_depth=None, abe_protocols=[], alias='', allow_anonymous_access=False, allow_s3_anonymous_access=False, auto_commit='0d', bucket='', bucket_creators=[], bucket_creators_groups=[], bucket_owner=None, bulk_permission_update_progress=None, bulk_permission_update_state=None, cluster='loop75-kfs', cluster_id=1, created='2024-05-28T12:58:21.546392Z', enabled=True, files_retention_mode='NONE', guid='75f7a9cb-dadc-42b2-8d91-f290a453d80c', id=27, ignore_oos=False, internal=False, is_remote=False, is_seamless=False, logical_capacity=0, max_retention_period=None, min_retention_period=None, name='8d0c9317-df90-47d1-b406-482ee14c60e8', nfs_interop_flags='BOTH_NFS3_AND_NFS4_INTEROP_DISABLED', path='/manila/manila-8d0c9317-df90-47d1-b406-482ee14c60e8', physical_capacity=0, policy='8d0c9317-df90-47d1-b406-482ee14c60e8', policy_id=28, protocols=['NFS'], qos_policy=None, qos_policy_id=None, s3_locks=False, s3_locks_retention_mode='NONE', s3_locks_retention_period='', s3_object_ownership_rule='ObjectWriter', s3_unverified_lookup=False, s3_versioning=False, select_for_live_monitoring=False, share='', share_acl=Bunch(acl=[], enabled=False), sync='SYNCED', sync_time='2024-05-28T12:58:21.817045Z', tenant_id=1, tenant_name='default', title='/manila/manila-8d0c9317-df90-47d1-b406-482ee14c60e8', url='https://127.0.0.1:40443/api/views/27/') May 28 12:58:21 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d26fdd02-decd-405f-8c00-5f1d70a43412 tempest-SharesMetadataTest-1561320255 None] --- [POST] https://127.0.0.1:40443/api/views/: Done May 28 12:58:21 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-4bc6d808-631d-4ebf-840c-a280d83ad4eb tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/snapshots/7f8e9058-4b96-4983-9bc5-b81989653aee returned with HTTP 200 May 28 12:58:21 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 518/1035] 10.27.203.238 () {64 vars in 1460 bytes} [Tue May 28 12:58:21 2024] GET /share/v2/a3499cb78849424db45e54caac01de92/snapshots/7f8e9058-4b96-4983-9bc5-b81989653aee => generated 750 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:58:21 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-39da8787-9ead-4049-9976-d17b46af6834 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] DELETE http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/snapshots/7f8e9058-4b96-4983-9bc5-b81989653aee May 28 12:58:21 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-39da8787-9ead-4049-9976-d17b46af6834 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:21 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-39da8787-9ead-4049-9976-d17b46af6834 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Calling method 'ShareSnapshotMixin.delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:21 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.v1.share_snapshots [None req-39da8787-9ead-4049-9976-d17b46af6834 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Delete snapshot with id: 7f8e9058-4b96-4983-9bc5-b81989653aee May 28 12:58:21 l75lg1-v1 manila-share[98474]: INFO manila.share.manager [None req-d26fdd02-decd-405f-8c00-5f1d70a43412 tempest-SharesMetadataTest-1561320255 None] Share instance 8d0c9317-df90-47d1-b406-482ee14c60e8 created successfully. May 28 12:58:21 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-008263e8-4283-4a96-b588-d1ff3e5b1c4e tempest-ResourceLockCRUTest-1971036144 tempest-ResourceLockCRUTest-1971036144-project-member] GET http://10.27.203.238/share/v2/82840ccb77144a4aa2d0bdce807ce686/shares/3f6b8420-fc46-47fc-b707-d08dfd01280f May 28 12:58:21 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-008263e8-4283-4a96-b588-d1ff3e5b1c4e tempest-ResourceLockCRUTest-1971036144 tempest-ResourceLockCRUTest-1971036144-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:21 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-008263e8-4283-4a96-b588-d1ff3e5b1c4e tempest-ResourceLockCRUTest-1971036144 tempest-ResourceLockCRUTest-1971036144-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:21 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-008263e8-4283-4a96-b588-d1ff3e5b1c4e tempest-ResourceLockCRUTest-1971036144 tempest-ResourceLockCRUTest-1971036144-project-member] http://10.27.203.238/share/v2/82840ccb77144a4aa2d0bdce807ce686/shares/3f6b8420-fc46-47fc-b707-d08dfd01280f returned with HTTP 200 May 28 12:58:21 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 519/1036] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:58:21 2024] GET /share/v2/82840ccb77144a4aa2d0bdce807ce686/shares/3f6b8420-fc46-47fc-b707-d08dfd01280f => generated 1318 bytes in 28 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:58:22 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-39da8787-9ead-4049-9976-d17b46af6834 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/snapshots/7f8e9058-4b96-4983-9bc5-b81989653aee returned with HTTP 202 May 28 12:58:22 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 518/1037] 10.27.203.238 () {64 vars in 1463 bytes} [Tue May 28 12:58:21 2024] DELETE /share/v2/a3499cb78849424db45e54caac01de92/snapshots/7f8e9058-4b96-4983-9bc5-b81989653aee => generated 0 bytes in 104 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:58:22 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-73871e5c-aeed-415e-82ac-5280b8d838fc tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] GET http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/snapshots/7f8e9058-4b96-4983-9bc5-b81989653aee May 28 12:58:22 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-73871e5c-aeed-415e-82ac-5280b8d838fc tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:22 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-73871e5c-aeed-415e-82ac-5280b8d838fc tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Calling method 'ShareSnapshotMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:22 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-73871e5c-aeed-415e-82ac-5280b8d838fc tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/snapshots/7f8e9058-4b96-4983-9bc5-b81989653aee returned with HTTP 200 May 28 12:58:22 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 520/1038] 10.27.203.238 () {64 vars in 1460 bytes} [Tue May 28 12:58:22 2024] GET /share/v2/a3499cb78849424db45e54caac01de92/snapshots/7f8e9058-4b96-4983-9bc5-b81989653aee => generated 749 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:58:22 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-39da8787-9ead-4049-9976-d17b46af6834 tempest-AdminActionsTest-1749172189 None] >>> [GET] https://127.0.0.1:40443/api/snapshots/ May 28 12:58:22 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-39da8787-9ead-4049-9976-d17b46af6834 tempest-AdminActionsTest-1749172189 None] {'allow_redirects': True, May 28 12:58:22 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-39da8787-9ead-4049-9976-d17b46af6834 tempest-AdminActionsTest-1749172189 None] 'params': {'name': 'share-snapshot-1b959a63-6155-4bab-8823-312d4dcc85cb'}} May 28 12:58:22 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c8e727f7-de8d-4567-801e-7bb4c4ce75b9 tempest-ShareIpRulesForNFSTest-1748669711 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:58:22 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c8e727f7-de8d-4567-801e-7bb4c4ce75b9 tempest-ShareIpRulesForNFSTest-1748669711 None] [Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=1, created='2024-05-28T12:57:40.763635Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='377955ad-d094-4e49-ab32-1021d943a572', id=21, internal=False, is_s3_default_policy=False, name='b7a7d61c-2cea-442a-9809-507038e080d5', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=['*'], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['*'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['*'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T12:58:11.063538Z', tenant_id=1, tenant_name='default', title='b7a7d61c-2cea-442a-9809-507038e080d5', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/21/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[])] May 28 12:58:22 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c8e727f7-de8d-4567-801e-7bb4c4ce75b9 tempest-ShareIpRulesForNFSTest-1748669711 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 12:58:22 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c8e727f7-de8d-4567-801e-7bb4c4ce75b9 tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:22 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c8e727f7-de8d-4567-801e-7bb4c4ce75b9 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:22 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e4d1993b-6bf2-4567-84a9-36aee9246ffa tempest-ResourceLockCRUTest-1971036144 None] <<< [DELETE] https://127.0.0.1:40443/api/quotas/24/ May 28 12:58:22 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e4d1993b-6bf2-4567-84a9-36aee9246ffa tempest-ResourceLockCRUTest-1971036144 None] --- [DELETE] https://127.0.0.1:40443/api/quotas/24/: Done May 28 12:58:22 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e4d1993b-6bf2-4567-84a9-36aee9246ffa tempest-ResourceLockCRUTest-1971036144 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:58:22 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e4d1993b-6bf2-4567-84a9-36aee9246ffa tempest-ResourceLockCRUTest-1971036144 None] {'allow_redirects': True, May 28 12:58:22 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e4d1993b-6bf2-4567-84a9-36aee9246ffa tempest-ResourceLockCRUTest-1971036144 None] 'params': {'name': '13a0450c-5c43-4fd2-9710-6cb3885f407a'}} May 28 12:58:22 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0e1fea71-d8a0-4d61-a7a0-79654970cec5 tempest-PublicSharesTest-118543418 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:58:22 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0e1fea71-d8a0-4d61-a7a0-79654970cec5 tempest-PublicSharesTest-118543418 None] [] May 28 12:58:22 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0e1fea71-d8a0-4d61-a7a0-79654970cec5 tempest-PublicSharesTest-118543418 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 12:58:22 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0e1fea71-d8a0-4d61-a7a0-79654970cec5 tempest-PublicSharesTest-118543418 None] >>> [POST] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:58:22 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0e1fea71-d8a0-4d61-a7a0-79654970cec5 tempest-PublicSharesTest-118543418 None] {'data': '{"name": "c4c98d1e-9abc-48c7-a23f-ed7f1a740252"}', May 28 12:58:22 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0e1fea71-d8a0-4d61-a7a0-79654970cec5 tempest-PublicSharesTest-118543418 None] 'json': None, May 28 12:58:22 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0e1fea71-d8a0-4d61-a7a0-79654970cec5 tempest-PublicSharesTest-118543418 None] 'params': None} May 28 12:58:22 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c8e727f7-de8d-4567-801e-7bb4c4ce75b9 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.034s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:22 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c8e727f7-de8d-4567-801e-7bb4c4ce75b9 tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:22 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c8e727f7-de8d-4567-801e-7bb4c4ce75b9 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:22 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c8e727f7-de8d-4567-801e-7bb4c4ce75b9 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.023s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:22 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c8e727f7-de8d-4567-801e-7bb4c4ce75b9 tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:22 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c8e727f7-de8d-4567-801e-7bb4c4ce75b9 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:22 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c8e727f7-de8d-4567-801e-7bb4c4ce75b9 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.004s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:22 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c8e727f7-de8d-4567-801e-7bb4c4ce75b9 tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:22 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c8e727f7-de8d-4567-801e-7bb4c4ce75b9 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:22 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c8e727f7-de8d-4567-801e-7bb4c4ce75b9 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:22 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c8e727f7-de8d-4567-801e-7bb4c4ce75b9 tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:22 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c8e727f7-de8d-4567-801e-7bb4c4ce75b9 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:22 l75lg1-v1 dstat.sh[49771]: 28-05 12:58:22| 12 1 85 2 0|5717M 1765M 277M 7865M| 25k 6034B| 0 2027k| 0 236 |5319 8710 |1.45 1.10 1.02|2.0 1.0 0| 0 0 | 0 2048M| 29 357 0 37 0 May 28 12:58:22 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c8e727f7-de8d-4567-801e-7bb4c4ce75b9 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.060s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:22 l75lg1-v1 manila-share[98474]: INFO manila.share.access [None req-c8e727f7-de8d-4567-801e-7bb4c4ce75b9 tempest-ShareIpRulesForNFSTest-1748669711 None] Access rules were successfully modified for share instance b7a7d61c-2cea-442a-9809-507038e080d5 belonging to share 1ddadc17-cf10-4a42-8bbd-8335fb3520a1. May 28 12:58:22 l75lg1-v1 manila-share[98474]: DEBUG dbcounter [-] [98474] Writing DB stats manila:SELECT=2226,manila:UPDATE=207,manila:INSERT=71 {{(pid=98474) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:58:22 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e4d1993b-6bf2-4567-84a9-36aee9246ffa tempest-ResourceLockCRUTest-1971036144 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:58:22 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e4d1993b-6bf2-4567-84a9-36aee9246ffa tempest-ResourceLockCRUTest-1971036144 None] [Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=0, created='2024-05-28T12:58:10.251028Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='ab3d3fa9-b55a-411a-8970-e8d81644fbbc', id=27, internal=False, is_s3_default_policy=False, name='13a0450c-5c43-4fd2-9710-6cb3885f407a', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=[], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['*'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['*'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T12:58:10.723113Z', tenant_id=1, tenant_name='default', title='13a0450c-5c43-4fd2-9710-6cb3885f407a', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/27/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[])] May 28 12:58:22 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e4d1993b-6bf2-4567-84a9-36aee9246ffa tempest-ResourceLockCRUTest-1971036144 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 12:58:22 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e4d1993b-6bf2-4567-84a9-36aee9246ffa tempest-ResourceLockCRUTest-1971036144 None] >>> [DELETE] https://127.0.0.1:40443/api/viewpolicies/27/ May 28 12:58:22 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-39da8787-9ead-4049-9976-d17b46af6834 tempest-AdminActionsTest-1749172189 None] <<< [GET] https://127.0.0.1:40443/api/snapshots/ May 28 12:58:22 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-39da8787-9ead-4049-9976-d17b46af6834 tempest-AdminActionsTest-1749172189 None] [Bunch(access_path='/.vast_all_snapshots/1000000010_share-snapshot-1b959a63-6155-4bab-8823-312d4dcc85cb', aggr_phys_estimation=0, cluster='loop75-kfs', created='2024-05-28T12:58:19.001914Z', eta_sec=30819898895.347153, expiration_time='3001-01-19T07:59:58Z', guid='956513d5-1d52-4445-a184-03c65f00e6e0', id=11, indestructible=False, locked=False, name='share-snapshot-1b959a63-6155-4bab-8823-312d4dcc85cb', path='/manila/manila-77a25e6b-f137-4342-8eb9-9ced679515e2/', policy=None, policy_id=None, protection_policy_id=None, state='SUCCEED', tenant_id=1, tenant_name='default', title='share-snapshot-1b959a63-6155-4bab-8823-312d4dcc85cb(/manila/manila-77a25e6b-f137-4342-8eb9-9ced679515e2/)', type='local', unique_phys_estimation=0, url='https://127.0.0.1:40443/api/snapshots/11/')] May 28 12:58:22 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-39da8787-9ead-4049-9976-d17b46af6834 tempest-AdminActionsTest-1749172189 None] --- [GET] https://127.0.0.1:40443/api/snapshots/: Done May 28 12:58:22 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-39da8787-9ead-4049-9976-d17b46af6834 tempest-AdminActionsTest-1749172189 None] >>> [DELETE] https://127.0.0.1:40443/api/snapshots/11/ May 28 12:58:22 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0e1fea71-d8a0-4d61-a7a0-79654970cec5 tempest-PublicSharesTest-118543418 None] <<< [POST] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:58:22 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0e1fea71-d8a0-4d61-a7a0-79654970cec5 tempest-PublicSharesTest-118543418 None] Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=0, created='2024-05-28T12:58:22.525434Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='26aa4609-6029-4c58-8efe-5da6be4ab833', id=29, internal=False, is_s3_default_policy=False, name='c4c98d1e-9abc-48c7-a23f-ed7f1a740252', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=[], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['*'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['*'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T12:58:22.867667Z', tenant_id=1, tenant_name='default', title='c4c98d1e-9abc-48c7-a23f-ed7f1a740252', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/29/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[]) May 28 12:58:22 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0e1fea71-d8a0-4d61-a7a0-79654970cec5 tempest-PublicSharesTest-118543418 None] --- [POST] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 12:58:22 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0e1fea71-d8a0-4d61-a7a0-79654970cec5 tempest-PublicSharesTest-118543418 None] >>> [GET] https://127.0.0.1:40443/api/quotas/ May 28 12:58:22 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0e1fea71-d8a0-4d61-a7a0-79654970cec5 tempest-PublicSharesTest-118543418 None] {'allow_redirects': True, May 28 12:58:22 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0e1fea71-d8a0-4d61-a7a0-79654970cec5 tempest-PublicSharesTest-118543418 None] 'params': {'name': 'c4c98d1e-9abc-48c7-a23f-ed7f1a740252'}} May 28 12:58:23 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0e1fea71-d8a0-4d61-a7a0-79654970cec5 tempest-PublicSharesTest-118543418 None] <<< [GET] https://127.0.0.1:40443/api/quotas/ May 28 12:58:23 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0e1fea71-d8a0-4d61-a7a0-79654970cec5 tempest-PublicSharesTest-118543418 None] [] May 28 12:58:23 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0e1fea71-d8a0-4d61-a7a0-79654970cec5 tempest-PublicSharesTest-118543418 None] --- [GET] https://127.0.0.1:40443/api/quotas/: Done May 28 12:58:23 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0e1fea71-d8a0-4d61-a7a0-79654970cec5 tempest-PublicSharesTest-118543418 None] >>> [POST] https://127.0.0.1:40443/api/quotas/ May 28 12:58:23 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0e1fea71-d8a0-4d61-a7a0-79654970cec5 tempest-PublicSharesTest-118543418 None] {'data': '{"name": "c4c98d1e-9abc-48c7-a23f-ed7f1a740252", "path": ' May 28 12:58:23 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0e1fea71-d8a0-4d61-a7a0-79654970cec5 tempest-PublicSharesTest-118543418 None] '"/manila/manila-c4c98d1e-9abc-48c7-a23f-ed7f1a740252", "create_dir": ' May 28 12:58:23 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0e1fea71-d8a0-4d61-a7a0-79654970cec5 tempest-PublicSharesTest-118543418 None] 'true, "hard_limit": 1073741824}', May 28 12:58:23 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0e1fea71-d8a0-4d61-a7a0-79654970cec5 tempest-PublicSharesTest-118543418 None] 'json': None, May 28 12:58:23 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0e1fea71-d8a0-4d61-a7a0-79654970cec5 tempest-PublicSharesTest-118543418 None] 'params': None} May 28 12:58:23 l75lg1-v1 dstat.sh[49771]: 28-05 12:58:23| 1 1 93 4 0|5717M 1765M 277M 7865M| 25k 2110B| 0 7148k| 0 528 |3481 5649 |1.45 1.10 1.02|4.0 0 0| 0 0 | 0 2048M| 29 357 0 37 0 May 28 12:58:23 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-8862e40d-1b25-4f9d-b11d-fa176c596971 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] GET http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/dacdb3b4-4336-45fd-b002-1a5aa6ad9957 May 28 12:58:23 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-8862e40d-1b25-4f9d-b11d-fa176c596971 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:23 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-8862e40d-1b25-4f9d-b11d-fa176c596971 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:23 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-8862e40d-1b25-4f9d-b11d-fa176c596971 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/dacdb3b4-4336-45fd-b002-1a5aa6ad9957 returned with HTTP 200 May 28 12:58:23 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 519/1039] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:58:23 2024] GET /share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/dacdb3b4-4336-45fd-b002-1a5aa6ad9957 => generated 1315 bytes in 27 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:58:23 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-c349bc3c-0458-48fa-bd67-d384b69d8c45 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] POST http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/dacdb3b4-4336-45fd-b002-1a5aa6ad9957/metadata May 28 12:58:23 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-c349bc3c-0458-48fa-bd67-d384b69d8c45 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Action: 'create_metadata', calling method: Controller.__getattribute__..version_select, body: {"metadata": {"key9": "value9", "key10": "value10"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:58:23 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-c349bc3c-0458-48fa-bd67-d384b69d8c45 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/dacdb3b4-4336-45fd-b002-1a5aa6ad9957/metadata returned with HTTP 200 May 28 12:58:23 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 521/1040] 10.27.203.238 () {66 vars in 1499 bytes} [Tue May 28 12:58:23 2024] POST /share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/dacdb3b4-4336-45fd-b002-1a5aa6ad9957/metadata => generated 52 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:58:23 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-903fd0f1-8109-4219-9efd-15e8c03bb511 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] GET http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/dacdb3b4-4336-45fd-b002-1a5aa6ad9957/metadata/key9 May 28 12:58:23 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-903fd0f1-8109-4219-9efd-15e8c03bb511 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:23 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-903fd0f1-8109-4219-9efd-15e8c03bb511 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:23 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-903fd0f1-8109-4219-9efd-15e8c03bb511 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/dacdb3b4-4336-45fd-b002-1a5aa6ad9957/metadata/key9 returned with HTTP 200 May 28 12:58:23 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 520/1041] 10.27.203.238 () {64 vars in 1493 bytes} [Tue May 28 12:58:23 2024] GET /share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/dacdb3b4-4336-45fd-b002-1a5aa6ad9957/metadata/key9 => generated 28 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:58:23 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-c0920939-8f1b-40ab-bf5b-20c732a8f267 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] GET http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/dacdb3b4-4336-45fd-b002-1a5aa6ad9957/metadata/key10 May 28 12:58:23 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-c0920939-8f1b-40ab-bf5b-20c732a8f267 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:23 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-c0920939-8f1b-40ab-bf5b-20c732a8f267 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:23 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-39da8787-9ead-4049-9976-d17b46af6834 tempest-AdminActionsTest-1749172189 None] <<< [DELETE] https://127.0.0.1:40443/api/snapshots/11/ May 28 12:58:23 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-39da8787-9ead-4049-9976-d17b46af6834 tempest-AdminActionsTest-1749172189 None] --- [DELETE] https://127.0.0.1:40443/api/snapshots/11/: Done May 28 12:58:23 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-621ec63b-474e-4115-9492-827cfbce1319 tempest-PublicSharesTest-118543418 tempest-PublicSharesTest-118543418-project-admin] GET http://10.27.203.238/share/v2/8ee1466a8fe242afa8e0d0378840bfc1/shares/5a92a994-03f1-4598-b3f6-70280cf0a971 May 28 12:58:23 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-621ec63b-474e-4115-9492-827cfbce1319 tempest-PublicSharesTest-118543418 tempest-PublicSharesTest-118543418-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:23 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-621ec63b-474e-4115-9492-827cfbce1319 tempest-PublicSharesTest-118543418 tempest-PublicSharesTest-118543418-project-admin] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:23 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-621ec63b-474e-4115-9492-827cfbce1319 tempest-PublicSharesTest-118543418 tempest-PublicSharesTest-118543418-project-admin] http://10.27.203.238/share/v2/8ee1466a8fe242afa8e0d0378840bfc1/shares/5a92a994-03f1-4598-b3f6-70280cf0a971 returned with HTTP 200 May 28 12:58:23 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 521/1042] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:58:23 2024] GET /share/v2/8ee1466a8fe242afa8e0d0378840bfc1/shares/5a92a994-03f1-4598-b3f6-70280cf0a971 => generated 1390 bytes in 26 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:58:24 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-c0920939-8f1b-40ab-bf5b-20c732a8f267 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/dacdb3b4-4336-45fd-b002-1a5aa6ad9957/metadata/key10 returned with HTTP 200 May 28 12:58:24 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 522/1043] 10.27.203.238 () {64 vars in 1496 bytes} [Tue May 28 12:58:23 2024] GET /share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/dacdb3b4-4336-45fd-b002-1a5aa6ad9957/metadata/key10 => generated 30 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:58:24 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-707b5383-2f73-4843-8587-57da1722fd88 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] POST http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/dacdb3b4-4336-45fd-b002-1a5aa6ad9957/metadata May 28 12:58:24 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-707b5383-2f73-4843-8587-57da1722fd88 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Action: 'create_metadata', calling method: Controller.__getattribute__..version_select, body: {"metadata": {"key9": "value13", "key11": "value11"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:58:24 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-39da8787-9ead-4049-9976-d17b46af6834 tempest-AdminActionsTest-1749172189 None] Created reservations ['1b619440-f81f-4090-b7e3-aa406b83905f', '81228191-4c69-4021-b1fa-42932535b976', '1739ff0e-7cf2-43ba-8b27-8c4b27c280f8', '38381f15-36cb-4486-8247-c579c48d9a25'] {{(pid=98474) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 12:58:24 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-39da8787-9ead-4049-9976-d17b46af6834 tempest-AdminActionsTest-1749172189 None] Committed reservations ['1b619440-f81f-4090-b7e3-aa406b83905f', '81228191-4c69-4021-b1fa-42932535b976', '1739ff0e-7cf2-43ba-8b27-8c4b27c280f8', '38381f15-36cb-4486-8247-c579c48d9a25'] {{(pid=98474) commit /opt/stack/manila/manila/quota.py:1063}} May 28 12:58:24 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-707b5383-2f73-4843-8587-57da1722fd88 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/dacdb3b4-4336-45fd-b002-1a5aa6ad9957/metadata returned with HTTP 200 May 28 12:58:24 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 522/1044] 10.27.203.238 () {66 vars in 1499 bytes} [Tue May 28 12:58:24 2024] POST /share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/dacdb3b4-4336-45fd-b002-1a5aa6ad9957/metadata => generated 73 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:58:24 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-6a4326b9-7017-4f41-8e19-d616ccf4c001 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] GET http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/dacdb3b4-4336-45fd-b002-1a5aa6ad9957/metadata/key9 May 28 12:58:24 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-6a4326b9-7017-4f41-8e19-d616ccf4c001 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:24 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-6a4326b9-7017-4f41-8e19-d616ccf4c001 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "_check_child_processes" by "neutron.agent.linux.external_process.ProcessMonitor._check_child_processes" {{(pid=76818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_concurrency.lockutils [-] Lock "_check_child_processes" acquired by "neutron.agent.linux.external_process.ProcessMonitor._check_child_processes" :: waited 0.000s {{(pid=76818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_concurrency.lockutils [-] Lock "_check_child_processes" "released" by "neutron.agent.linux.external_process.ProcessMonitor._check_child_processes" :: held 0.001s {{(pid=76818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:24 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-6a4326b9-7017-4f41-8e19-d616ccf4c001 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/dacdb3b4-4336-45fd-b002-1a5aa6ad9957/metadata/key9 returned with HTTP 200 May 28 12:58:24 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 523/1045] 10.27.203.238 () {64 vars in 1493 bytes} [Tue May 28 12:58:24 2024] GET /share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/dacdb3b4-4336-45fd-b002-1a5aa6ad9957/metadata/key9 => generated 29 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:58:24 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-fd32f191-888e-43ee-81ee-5bb27bcfcc14 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] GET http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/dacdb3b4-4336-45fd-b002-1a5aa6ad9957/metadata/key10 May 28 12:58:24 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-fd32f191-888e-43ee-81ee-5bb27bcfcc14 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:24 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-fd32f191-888e-43ee-81ee-5bb27bcfcc14 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:24 l75lg1-v1 dstat.sh[49771]: 28-05 12:58:24| 7 1 91 1 0|5718M 1765M 277M 7865M| 25k 998B| 0 1124k| 0 135 |3796 6156 |1.45 1.10 1.02|2.0 1.0 0| 0 0 | 0 2048M| 29 358 0 36 0 May 28 12:58:24 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-fd32f191-888e-43ee-81ee-5bb27bcfcc14 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/dacdb3b4-4336-45fd-b002-1a5aa6ad9957/metadata/key10 returned with HTTP 200 May 28 12:58:24 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 523/1046] 10.27.203.238 () {64 vars in 1496 bytes} [Tue May 28 12:58:24 2024] GET /share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/dacdb3b4-4336-45fd-b002-1a5aa6ad9957/metadata/key10 => generated 30 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:58:24 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-bcb7cde5-a34d-401b-9da1-627e58b89b58 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] GET http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/dacdb3b4-4336-45fd-b002-1a5aa6ad9957/metadata/key11 May 28 12:58:24 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-bcb7cde5-a34d-401b-9da1-627e58b89b58 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:24 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-bcb7cde5-a34d-401b-9da1-627e58b89b58 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:24 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e4d1993b-6bf2-4567-84a9-36aee9246ffa tempest-ResourceLockCRUTest-1971036144 None] <<< [DELETE] https://127.0.0.1:40443/api/viewpolicies/27/ May 28 12:58:24 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e4d1993b-6bf2-4567-84a9-36aee9246ffa tempest-ResourceLockCRUTest-1971036144 None] --- [DELETE] https://127.0.0.1:40443/api/viewpolicies/27/: Done May 28 12:58:24 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-bcb7cde5-a34d-401b-9da1-627e58b89b58 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/dacdb3b4-4336-45fd-b002-1a5aa6ad9957/metadata/key11 returned with HTTP 200 May 28 12:58:24 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 524/1047] 10.27.203.238 () {64 vars in 1496 bytes} [Tue May 28 12:58:24 2024] GET /share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/dacdb3b4-4336-45fd-b002-1a5aa6ad9957/metadata/key11 => generated 30 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:58:24 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-6440fdd5-61e5-45fe-b7d1-2ce782900c6c tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] DELETE http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/dacdb3b4-4336-45fd-b002-1a5aa6ad9957/metadata/key9 May 28 12:58:24 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-6440fdd5-61e5-45fe-b7d1-2ce782900c6c tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:24 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-6440fdd5-61e5-45fe-b7d1-2ce782900c6c tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:24 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0e1fea71-d8a0-4d61-a7a0-79654970cec5 tempest-PublicSharesTest-118543418 None] <<< [POST] https://127.0.0.1:40443/api/quotas/ May 28 12:58:24 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0e1fea71-d8a0-4d61-a7a0-79654970cec5 tempest-PublicSharesTest-118543418 None] Bunch(cluster='loop75-kfs', cluster_id=1, default_email=None, default_group_quota=None, default_user_quota=None, enable_alarms=True, enable_email_providers=True, grace_period=None, group_quotas=[], guid='122392ee-7157-4035-874e-bb2b6612b1d1', hard_limit=1073741824, hard_limit_inodes=None, id=26, internal=False, is_user_quota=False, last_user_quotas_update=None, name='c4c98d1e-9abc-48c7-a23f-ed7f1a740252', num_blocked_users=0, num_exceeded_users=0, path='/manila/manila-c4c98d1e-9abc-48c7-a23f-ed7f1a740252', percent_capacity=0, percent_inodes=None, pretty_grace_period=None, pretty_grace_period_expiration=None, pretty_state='OK (CREATED)', soft_limit=None, soft_limit_inodes=None, state='OK', sync_state='CREATED', system_id=26, tenant_id=1, tenant_name='default', time_to_block=None, title='c4c98d1e-9abc-48c7-a23f-ed7f1a740252', url='https://127.0.0.1:40443/api/quotas/26/', used_capacity=0, used_capacity_tb=0.0, used_effective_capacity=0, used_effective_capacity_tb=0.0, used_inodes=0, used_limited_capacity=0, user_quotas=[]) May 28 12:58:24 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0e1fea71-d8a0-4d61-a7a0-79654970cec5 tempest-PublicSharesTest-118543418 None] --- [POST] https://127.0.0.1:40443/api/quotas/: Done May 28 12:58:24 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0e1fea71-d8a0-4d61-a7a0-79654970cec5 tempest-PublicSharesTest-118543418 None] >>> [GET] https://127.0.0.1:40443/api/views/ May 28 12:58:24 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0e1fea71-d8a0-4d61-a7a0-79654970cec5 tempest-PublicSharesTest-118543418 None] {'allow_redirects': True, May 28 12:58:24 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0e1fea71-d8a0-4d61-a7a0-79654970cec5 tempest-PublicSharesTest-118543418 None] 'params': {'name': 'c4c98d1e-9abc-48c7-a23f-ed7f1a740252'}} May 28 12:58:24 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-6440fdd5-61e5-45fe-b7d1-2ce782900c6c tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/dacdb3b4-4336-45fd-b002-1a5aa6ad9957/metadata/key9 returned with HTTP 200 May 28 12:58:24 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 524/1048] 10.27.203.238 () {64 vars in 1496 bytes} [Tue May 28 12:58:24 2024] DELETE /share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/dacdb3b4-4336-45fd-b002-1a5aa6ad9957/metadata/key9 => generated 0 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 229 bytes (1 switches on core 0) May 28 12:58:24 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-d4b8d51c-19c0-470b-956f-2ab75ad8786a tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] DELETE http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/dacdb3b4-4336-45fd-b002-1a5aa6ad9957/metadata/key10 May 28 12:58:24 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-d4b8d51c-19c0-470b-956f-2ab75ad8786a tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:24 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-d4b8d51c-19c0-470b-956f-2ab75ad8786a tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:24 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-e4d1993b-6bf2-4567-84a9-36aee9246ffa tempest-ResourceLockCRUTest-1971036144 None] Created reservations ['d5c26a24-6cc1-4da4-a5cc-d34766cf5c37', '26e19c81-800e-43fd-9e21-04789e24b322', 'acd55892-09b6-4884-927e-431bfb6114e7', 'b7762cd9-664b-44b0-989e-be4bfcbb0669'] {{(pid=98474) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 12:58:24 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-e4d1993b-6bf2-4567-84a9-36aee9246ffa tempest-ResourceLockCRUTest-1971036144 None] Committed reservations ['d5c26a24-6cc1-4da4-a5cc-d34766cf5c37', '26e19c81-800e-43fd-9e21-04789e24b322', 'acd55892-09b6-4884-927e-431bfb6114e7', 'b7762cd9-664b-44b0-989e-be4bfcbb0669'] {{(pid=98474) commit /opt/stack/manila/manila/quota.py:1063}} May 28 12:58:24 l75lg1-v1 manila-share[98474]: INFO manila.share.manager [None req-e4d1993b-6bf2-4567-84a9-36aee9246ffa tempest-ResourceLockCRUTest-1971036144 None] Share instance 13a0450c-5c43-4fd2-9710-6cb3885f407a: deleted successfully. May 28 12:58:24 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-d4b8d51c-19c0-470b-956f-2ab75ad8786a tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/dacdb3b4-4336-45fd-b002-1a5aa6ad9957/metadata/key10 returned with HTTP 200 May 28 12:58:24 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 525/1049] 10.27.203.238 () {64 vars in 1499 bytes} [Tue May 28 12:58:24 2024] DELETE /share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/dacdb3b4-4336-45fd-b002-1a5aa6ad9957/metadata/key10 => generated 0 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 229 bytes (1 switches on core 0) May 28 12:58:24 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-f8392234-6b6b-4ff0-a758-58d0df0b2658 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] DELETE http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/dacdb3b4-4336-45fd-b002-1a5aa6ad9957/metadata/key11 May 28 12:58:24 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-f8392234-6b6b-4ff0-a758-58d0df0b2658 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:24 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-f8392234-6b6b-4ff0-a758-58d0df0b2658 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:24 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-f8392234-6b6b-4ff0-a758-58d0df0b2658 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/dacdb3b4-4336-45fd-b002-1a5aa6ad9957/metadata/key11 returned with HTTP 200 May 28 12:58:24 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 525/1050] 10.27.203.238 () {64 vars in 1499 bytes} [Tue May 28 12:58:24 2024] DELETE /share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/dacdb3b4-4336-45fd-b002-1a5aa6ad9957/metadata/key11 => generated 0 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 229 bytes (1 switches on core 0) May 28 12:58:24 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-867d9162-0437-4afe-b47e-c5a36251f11a tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] GET http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/dacdb3b4-4336-45fd-b002-1a5aa6ad9957/metadata May 28 12:58:24 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-867d9162-0437-4afe-b47e-c5a36251f11a tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:24 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-867d9162-0437-4afe-b47e-c5a36251f11a tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:24 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-867d9162-0437-4afe-b47e-c5a36251f11a tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/dacdb3b4-4336-45fd-b002-1a5aa6ad9957/metadata returned with HTTP 200 May 28 12:58:24 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 526/1051] 10.27.203.238 () {64 vars in 1478 bytes} [Tue May 28 12:58:24 2024] GET /share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/dacdb3b4-4336-45fd-b002-1a5aa6ad9957/metadata => generated 16 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:58:24 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-69b48bfe-8cef-437c-a739-c870b5819000 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] GET http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/share-replicas/detail?share_id=dacdb3b4-4336-45fd-b002-1a5aa6ad9957 May 28 12:58:24 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-69b48bfe-8cef-437c-a739-c870b5819000 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:24 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-69b48bfe-8cef-437c-a739-c870b5819000 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:24 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-bbf5c97d-47f3-4597-a71f-ae85c2729412 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] GET http://10.27.203.238/share/v2/776f75906bc64f8f9316d5aab4b50bf1/share-access-rules?share_id=1ddadc17-cf10-4a42-8bbd-8335fb3520a1 May 28 12:58:24 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-bbf5c97d-47f3-4597-a71f-ae85c2729412 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:24 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-bbf5c97d-47f3-4597-a71f-ae85c2729412 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:24 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-69b48bfe-8cef-437c-a739-c870b5819000 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/share-replicas/detail?share_id=dacdb3b4-4336-45fd-b002-1a5aa6ad9957 returned with HTTP 200 May 28 12:58:24 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 526/1052] 10.27.203.238 () {64 vars in 1476 bytes} [Tue May 28 12:58:24 2024] GET /share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/share-replicas/detail?share_id=dacdb3b4-4336-45fd-b002-1a5aa6ad9957 => generated 22 bytes in 14 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:58:24 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-b955836e-3bcf-4f6f-a7c4-571eaa76539d tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] DELETE http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/dacdb3b4-4336-45fd-b002-1a5aa6ad9957 May 28 12:58:24 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-b955836e-3bcf-4f6f-a7c4-571eaa76539d tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:24 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-b955836e-3bcf-4f6f-a7c4-571eaa76539d tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Calling method 'ShareMixin.delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:24 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.v1.shares [None req-b955836e-3bcf-4f6f-a7c4-571eaa76539d tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Delete share with id: dacdb3b4-4336-45fd-b002-1a5aa6ad9957 May 28 12:58:24 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-bbf5c97d-47f3-4597-a71f-ae85c2729412 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] http://10.27.203.238/share/v2/776f75906bc64f8f9316d5aab4b50bf1/share-access-rules?share_id=1ddadc17-cf10-4a42-8bbd-8335fb3520a1 returned with HTTP 200 May 28 12:58:24 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 527/1053] 10.27.203.238 () {64 vars in 1467 bytes} [Tue May 28 12:58:24 2024] GET /share/v2/776f75906bc64f8f9316d5aab4b50bf1/share-access-rules?share_id=1ddadc17-cf10-4a42-8bbd-8335fb3520a1 => generated 19 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:58:24 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-df1115ed-7421-4cf3-ab15-b143bf1cb0e0 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] POST http://10.27.203.238/share/v1/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action May 28 12:58:24 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-df1115ed-7421-4cf3-ab15-b143bf1cb0e0 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Action body: b'{"os-allow_access": {"access_type": "ip", "access_to": "203.0.113.130", "access_level": "rw"}}' {{(pid=98329) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:58:24 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-df1115ed-7421-4cf3-ab15-b143bf1cb0e0 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Action: 'action', calling method: ShareController.allow_access, body: {"os-allow_access": {"access_type": "ip", "access_to": "203.0.113.130", "access_level": "rw"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:58:24 l75lg1-v1 devstack@m-api.service[98329]: DEBUG oslo_concurrency.lockutils [None req-df1115ed-7421-4cf3-ab15-b143bf1cb0e0 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98329) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:24 l75lg1-v1 devstack@m-api.service[98329]: DEBUG oslo_concurrency.lockutils [None req-df1115ed-7421-4cf3-ab15-b143bf1cb0e0 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98329) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:24 l75lg1-v1 devstack@m-api.service[98329]: DEBUG dbcounter [-] [98329] Writing DB stats manila:SELECT=1719,manila:INSERT=120,manila:UPDATE=122 {{(pid=98329) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:58:24 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0e1fea71-d8a0-4d61-a7a0-79654970cec5 tempest-PublicSharesTest-118543418 None] <<< [GET] https://127.0.0.1:40443/api/views/ May 28 12:58:24 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0e1fea71-d8a0-4d61-a7a0-79654970cec5 tempest-PublicSharesTest-118543418 None] [] May 28 12:58:24 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0e1fea71-d8a0-4d61-a7a0-79654970cec5 tempest-PublicSharesTest-118543418 None] --- [GET] https://127.0.0.1:40443/api/views/: Done May 28 12:58:24 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0e1fea71-d8a0-4d61-a7a0-79654970cec5 tempest-PublicSharesTest-118543418 None] >>> [POST] https://127.0.0.1:40443/api/views/ May 28 12:58:24 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0e1fea71-d8a0-4d61-a7a0-79654970cec5 tempest-PublicSharesTest-118543418 None] {'data': '{"name": "c4c98d1e-9abc-48c7-a23f-ed7f1a740252", "path": ' May 28 12:58:24 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0e1fea71-d8a0-4d61-a7a0-79654970cec5 tempest-PublicSharesTest-118543418 None] '"/manila/manila-c4c98d1e-9abc-48c7-a23f-ed7f1a740252", "policy_id": ' May 28 12:58:24 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0e1fea71-d8a0-4d61-a7a0-79654970cec5 tempest-PublicSharesTest-118543418 None] '29, "create_dir": true, "protocols": ["NFS"]}', May 28 12:58:24 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0e1fea71-d8a0-4d61-a7a0-79654970cec5 tempest-PublicSharesTest-118543418 None] 'json': None, May 28 12:58:24 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0e1fea71-d8a0-4d61-a7a0-79654970cec5 tempest-PublicSharesTest-118543418 None] 'params': None} May 28 12:58:24 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-b955836e-3bcf-4f6f-a7c4-571eaa76539d tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/dacdb3b4-4336-45fd-b002-1a5aa6ad9957 returned with HTTP 202 May 28 12:58:24 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 527/1054] 10.27.203.238 () {64 vars in 1454 bytes} [Tue May 28 12:58:24 2024] DELETE /share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/dacdb3b4-4336-45fd-b002-1a5aa6ad9957 => generated 0 bytes in 155 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:58:24 l75lg1-v1 devstack@m-api.service[98329]: DEBUG oslo_concurrency.lockutils [None req-df1115ed-7421-4cf3-ab15-b143bf1cb0e0 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.060s {{(pid=98329) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:24 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-00c515aa-8f65-4b0b-bafc-d5d55cadb1fa tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] GET http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/dacdb3b4-4336-45fd-b002-1a5aa6ad9957 May 28 12:58:24 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-00c515aa-8f65-4b0b-bafc-d5d55cadb1fa tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:24 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-00c515aa-8f65-4b0b-bafc-d5d55cadb1fa tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:24 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-df1115ed-7421-4cf3-ab15-b143bf1cb0e0 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] http://10.27.203.238/share/v1/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action returned with HTTP 200 May 28 12:58:24 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 528/1055] 10.27.203.238 () {64 vars in 1450 bytes} [Tue May 28 12:58:24 2024] POST /share/v1/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action => generated 199 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 230 bytes (2 switches on core 0) May 28 12:58:24 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-00c515aa-8f65-4b0b-bafc-d5d55cadb1fa tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/dacdb3b4-4336-45fd-b002-1a5aa6ad9957 returned with HTTP 200 May 28 12:58:24 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-afd23407-104b-475f-8998-2c6c24a87ae1 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] POST http://10.27.203.238/share/v1/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action May 28 12:58:24 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 528/1056] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:58:24 2024] GET /share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/dacdb3b4-4336-45fd-b002-1a5aa6ad9957 => generated 1314 bytes in 28 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:58:24 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-afd23407-104b-475f-8998-2c6c24a87ae1 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Action body: b'{"os-access_list": null}' {{(pid=98329) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:58:24 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-afd23407-104b-475f-8998-2c6c24a87ae1 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Action: 'action', calling method: ShareController.access_list, body: {"os-access_list": null} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:58:24 l75lg1-v1 manila-share[98474]: DEBUG manila.share.manager [None req-df1115ed-7421-4cf3-ab15-b143bf1cb0e0 tempest-ShareIpRulesForNFSTest-1748669711 None] Received request to update access for share instance b7a7d61c-2cea-442a-9809-507038e080d5. {{(pid=98474) update_access_for_instances /opt/stack/manila/manila/share/manager.py:4353}} May 28 12:58:24 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-afd23407-104b-475f-8998-2c6c24a87ae1 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] http://10.27.203.238/share/v1/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action returned with HTTP 200 May 28 12:58:24 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 529/1057] 10.27.203.238 () {64 vars in 1450 bytes} [Tue May 28 12:58:24 2024] POST /share/v1/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action => generated 154 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 230 bytes (2 switches on core 0) May 28 12:58:24 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-e1a1e9ee-ad27-48b5-844d-af2974e96e56 tempest-ResourceLockCRUTest-1971036144 tempest-ResourceLockCRUTest-1971036144-project-member] GET http://10.27.203.238/share/v2/82840ccb77144a4aa2d0bdce807ce686/shares/3f6b8420-fc46-47fc-b707-d08dfd01280f May 28 12:58:24 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-e1a1e9ee-ad27-48b5-844d-af2974e96e56 tempest-ResourceLockCRUTest-1971036144 tempest-ResourceLockCRUTest-1971036144-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:24 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-e1a1e9ee-ad27-48b5-844d-af2974e96e56 tempest-ResourceLockCRUTest-1971036144 tempest-ResourceLockCRUTest-1971036144-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:24 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-df1115ed-7421-4cf3-ab15-b143bf1cb0e0 tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:24 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-df1115ed-7421-4cf3-ab15-b143bf1cb0e0 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:24 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-e1a1e9ee-ad27-48b5-844d-af2974e96e56 tempest-ResourceLockCRUTest-1971036144 tempest-ResourceLockCRUTest-1971036144-project-member] HTTP exception thrown: The resource could not be found. May 28 12:58:24 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-e1a1e9ee-ad27-48b5-844d-af2974e96e56 tempest-ResourceLockCRUTest-1971036144 tempest-ResourceLockCRUTest-1971036144-project-member] http://10.27.203.238/share/v2/82840ccb77144a4aa2d0bdce807ce686/shares/3f6b8420-fc46-47fc-b707-d08dfd01280f returned with HTTP 404 May 28 12:58:24 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 529/1058] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:58:24 2024] GET /share/v2/82840ccb77144a4aa2d0bdce807ce686/shares/3f6b8420-fc46-47fc-b707-d08dfd01280f => generated 78 bytes in 11 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 12:58:24 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-f326039a-7460-4b36-9e03-e97198e579bf tempest-ResourceLockCRUTest-1971036144 tempest-ResourceLockCRUTest-1971036144-project-member] DELETE http://10.27.203.238/share/v2/82840ccb77144a4aa2d0bdce807ce686/resource-locks/87ef736f-2afb-4d32-9520-592130b1715a May 28 12:58:24 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-f326039a-7460-4b36-9e03-e97198e579bf tempest-ResourceLockCRUTest-1971036144 tempest-ResourceLockCRUTest-1971036144-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:24 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-f326039a-7460-4b36-9e03-e97198e579bf tempest-ResourceLockCRUTest-1971036144 tempest-ResourceLockCRUTest-1971036144-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:24 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-df1115ed-7421-4cf3-ab15-b143bf1cb0e0 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.012s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:24 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-df1115ed-7421-4cf3-ab15-b143bf1cb0e0 tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:24 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-df1115ed-7421-4cf3-ab15-b143bf1cb0e0 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:25 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-f326039a-7460-4b36-9e03-e97198e579bf tempest-ResourceLockCRUTest-1971036144 tempest-ResourceLockCRUTest-1971036144-project-member] http://10.27.203.238/share/v2/82840ccb77144a4aa2d0bdce807ce686/resource-locks/87ef736f-2afb-4d32-9520-592130b1715a returned with HTTP 204 May 28 12:58:25 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 530/1059] 10.27.203.238 () {64 vars in 1478 bytes} [Tue May 28 12:58:24 2024] DELETE /share/v2/82840ccb77144a4aa2d0bdce807ce686/resource-locks/87ef736f-2afb-4d32-9520-592130b1715a => generated 0 bytes in 23 msecs (HTTP/1.1 204) 6 headers in 245 bytes (1 switches on core 0) May 28 12:58:25 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-b955836e-3bcf-4f6f-a7c4-571eaa76539d tempest-SharesMetadataTest-1561320255 None] Acquiring lock "locked_access_rules_operation_by_share_instance_8d0c9317-df90-47d1-b406-482ee14c60e8" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:25 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-2ae4e49b-7afd-4703-83a1-cc90b24a9a05 tempest-ResourceLockCRUTest-1971036144 tempest-ResourceLockCRUTest-1971036144-project-member] GET http://10.27.203.238/share/v2/82840ccb77144a4aa2d0bdce807ce686/share-replicas/detail?share_id=071c2e61-b4b6-48bf-a1f2-c20b233560ed May 28 12:58:25 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-2ae4e49b-7afd-4703-83a1-cc90b24a9a05 tempest-ResourceLockCRUTest-1971036144 tempest-ResourceLockCRUTest-1971036144-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:25 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-b955836e-3bcf-4f6f-a7c4-571eaa76539d tempest-SharesMetadataTest-1561320255 None] Lock "locked_access_rules_operation_by_share_instance_8d0c9317-df90-47d1-b406-482ee14c60e8" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:25 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-2ae4e49b-7afd-4703-83a1-cc90b24a9a05 tempest-ResourceLockCRUTest-1971036144 tempest-ResourceLockCRUTest-1971036144-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:25 l75lg1-v1 devstack@m-api.service[98330]: DEBUG dbcounter [-] [98330] Writing DB stats manila:SELECT=1683,manila:UPDATE=110,manila:INSERT=66 {{(pid=98330) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:58:25 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-b955836e-3bcf-4f6f-a7c4-571eaa76539d tempest-SharesMetadataTest-1561320255 None] Lock "locked_access_rules_operation_by_share_instance_8d0c9317-df90-47d1-b406-482ee14c60e8" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.008s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:25 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-b955836e-3bcf-4f6f-a7c4-571eaa76539d tempest-SharesMetadataTest-1561320255 None] Acquiring lock "locked_access_rules_operation_by_share_instance_8d0c9317-df90-47d1-b406-482ee14c60e8" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:25 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-b955836e-3bcf-4f6f-a7c4-571eaa76539d tempest-SharesMetadataTest-1561320255 None] Lock "locked_access_rules_operation_by_share_instance_8d0c9317-df90-47d1-b406-482ee14c60e8" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:25 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-2ae4e49b-7afd-4703-83a1-cc90b24a9a05 tempest-ResourceLockCRUTest-1971036144 tempest-ResourceLockCRUTest-1971036144-project-member] http://10.27.203.238/share/v2/82840ccb77144a4aa2d0bdce807ce686/share-replicas/detail?share_id=071c2e61-b4b6-48bf-a1f2-c20b233560ed returned with HTTP 200 May 28 12:58:25 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 530/1060] 10.27.203.238 () {64 vars in 1476 bytes} [Tue May 28 12:58:25 2024] GET /share/v2/82840ccb77144a4aa2d0bdce807ce686/share-replicas/detail?share_id=071c2e61-b4b6-48bf-a1f2-c20b233560ed => generated 22 bytes in 16 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:58:25 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-e663225b-6477-401f-b391-71804dbaf246 tempest-ResourceLockCRUTest-1971036144 tempest-ResourceLockCRUTest-1971036144-project-member] DELETE http://10.27.203.238/share/v2/82840ccb77144a4aa2d0bdce807ce686/shares/071c2e61-b4b6-48bf-a1f2-c20b233560ed May 28 12:58:25 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-e663225b-6477-401f-b391-71804dbaf246 tempest-ResourceLockCRUTest-1971036144 tempest-ResourceLockCRUTest-1971036144-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:25 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-e663225b-6477-401f-b391-71804dbaf246 tempest-ResourceLockCRUTest-1971036144 tempest-ResourceLockCRUTest-1971036144-project-member] Calling method 'ShareMixin.delete' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:25 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.v1.shares [None req-e663225b-6477-401f-b391-71804dbaf246 tempest-ResourceLockCRUTest-1971036144 tempest-ResourceLockCRUTest-1971036144-project-member] Delete share with id: 071c2e61-b4b6-48bf-a1f2-c20b233560ed May 28 12:58:25 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-b955836e-3bcf-4f6f-a7c4-571eaa76539d tempest-SharesMetadataTest-1561320255 None] Lock "locked_access_rules_operation_by_share_instance_8d0c9317-df90-47d1-b406-482ee14c60e8" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.014s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:25 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-b955836e-3bcf-4f6f-a7c4-571eaa76539d tempest-SharesMetadataTest-1561320255 None] Acquiring lock "locked_access_rules_operation_by_share_instance_8d0c9317-df90-47d1-b406-482ee14c60e8" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:25 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-b955836e-3bcf-4f6f-a7c4-571eaa76539d tempest-SharesMetadataTest-1561320255 None] Lock "locked_access_rules_operation_by_share_instance_8d0c9317-df90-47d1-b406-482ee14c60e8" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:25 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-b955836e-3bcf-4f6f-a7c4-571eaa76539d tempest-SharesMetadataTest-1561320255 None] Lock "locked_access_rules_operation_by_share_instance_8d0c9317-df90-47d1-b406-482ee14c60e8" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.009s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:25 l75lg1-v1 manila-share[98474]: DEBUG manila.share.access [None req-b955836e-3bcf-4f6f-a7c4-571eaa76539d tempest-SharesMetadataTest-1561320255 None] All access rules have been synced for share instance 8d0c9317-df90-47d1-b406-482ee14c60e8 belonging to share dacdb3b4-4336-45fd-b002-1a5aa6ad9957. {{(pid=98474) update_access_rules /opt/stack/manila/manila/share/access.py:304}} May 28 12:58:25 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-b955836e-3bcf-4f6f-a7c4-571eaa76539d tempest-SharesMetadataTest-1561320255 None] deleting '/manila/manila-8d0c9317-df90-47d1-b406-482ee14c60e8' May 28 12:58:25 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b955836e-3bcf-4f6f-a7c4-571eaa76539d tempest-SharesMetadataTest-1561320255 None] >>> [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/ May 28 12:58:25 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b955836e-3bcf-4f6f-a7c4-571eaa76539d tempest-SharesMetadataTest-1561320255 None] {'data': '{"path": "/manila/manila-8d0c9317-df90-47d1-b406-482ee14c60e8"}', May 28 12:58:25 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b955836e-3bcf-4f6f-a7c4-571eaa76539d tempest-SharesMetadataTest-1561320255 None] 'params': None} May 28 12:58:25 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-59fbce34-e232-45dc-a3e7-38b1bdcadc60 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] GET http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/snapshots/7f8e9058-4b96-4983-9bc5-b81989653aee May 28 12:58:25 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-59fbce34-e232-45dc-a3e7-38b1bdcadc60 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:25 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-59fbce34-e232-45dc-a3e7-38b1bdcadc60 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Calling method 'ShareSnapshotMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:25 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-59fbce34-e232-45dc-a3e7-38b1bdcadc60 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] HTTP exception thrown: The resource could not be found. May 28 12:58:25 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-59fbce34-e232-45dc-a3e7-38b1bdcadc60 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/snapshots/7f8e9058-4b96-4983-9bc5-b81989653aee returned with HTTP 404 May 28 12:58:25 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 531/1061] 10.27.203.238 () {64 vars in 1460 bytes} [Tue May 28 12:58:25 2024] GET /share/v2/a3499cb78849424db45e54caac01de92/snapshots/7f8e9058-4b96-4983-9bc5-b81989653aee => generated 78 bytes in 15 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 12:58:25 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-7c3c936b-fb6a-4a9e-a8be-cc8742ddbf7d tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] DELETE http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/snapshots/6ddf5f7a-7bad-4eea-9e2e-64307270ec88 May 28 12:58:25 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-7c3c936b-fb6a-4a9e-a8be-cc8742ddbf7d tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:25 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-7c3c936b-fb6a-4a9e-a8be-cc8742ddbf7d tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Calling method 'ShareSnapshotMixin.delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:25 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.v1.share_snapshots [None req-7c3c936b-fb6a-4a9e-a8be-cc8742ddbf7d tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Delete snapshot with id: 6ddf5f7a-7bad-4eea-9e2e-64307270ec88 May 28 12:58:25 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-df1115ed-7421-4cf3-ab15-b143bf1cb0e0 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.081s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:25 l75lg1-v1 manila-share[98474]: DEBUG manila.share.access [None req-df1115ed-7421-4cf3-ab15-b143bf1cb0e0 tempest-ShareIpRulesForNFSTest-1748669711 None] Updating access rules for share instance b7a7d61c-2cea-442a-9809-507038e080d5 belonging to share 1ddadc17-cf10-4a42-8bbd-8335fb3520a1. {{(pid=98474) update_access_rules /opt/stack/manila/manila/share/access.py:298}} May 28 12:58:25 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-df1115ed-7421-4cf3-ab15-b143bf1cb0e0 tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:25 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-df1115ed-7421-4cf3-ab15-b143bf1cb0e0 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:25 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-df1115ed-7421-4cf3-ab15-b143bf1cb0e0 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.008s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:25 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-df1115ed-7421-4cf3-ab15-b143bf1cb0e0 tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:25 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-df1115ed-7421-4cf3-ab15-b143bf1cb0e0 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:25 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-df1115ed-7421-4cf3-ab15-b143bf1cb0e0 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.016s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:25 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-df1115ed-7421-4cf3-ab15-b143bf1cb0e0 tempest-ShareIpRulesForNFSTest-1748669711 None] changing access on None May 28 12:58:25 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-df1115ed-7421-4cf3-ab15-b143bf1cb0e0 tempest-ShareIpRulesForNFSTest-1748669711 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:58:25 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-df1115ed-7421-4cf3-ab15-b143bf1cb0e0 tempest-ShareIpRulesForNFSTest-1748669711 None] {'allow_redirects': True, May 28 12:58:25 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-df1115ed-7421-4cf3-ab15-b143bf1cb0e0 tempest-ShareIpRulesForNFSTest-1748669711 None] 'params': {'name': 'b7a7d61c-2cea-442a-9809-507038e080d5'}} May 28 12:58:25 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b955836e-3bcf-4f6f-a7c4-571eaa76539d tempest-SharesMetadataTest-1561320255 None] <<< [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/ May 28 12:58:25 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b955836e-3bcf-4f6f-a7c4-571eaa76539d tempest-SharesMetadataTest-1561320255 None] 'OK' May 28 12:58:25 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b955836e-3bcf-4f6f-a7c4-571eaa76539d tempest-SharesMetadataTest-1561320255 None] --- [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/: Done May 28 12:58:25 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b955836e-3bcf-4f6f-a7c4-571eaa76539d tempest-SharesMetadataTest-1561320255 None] >>> [GET] https://127.0.0.1:40443/api/views/ May 28 12:58:25 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b955836e-3bcf-4f6f-a7c4-571eaa76539d tempest-SharesMetadataTest-1561320255 None] {'allow_redirects': True, May 28 12:58:25 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b955836e-3bcf-4f6f-a7c4-571eaa76539d tempest-SharesMetadataTest-1561320255 None] 'params': {'name': '8d0c9317-df90-47d1-b406-482ee14c60e8'}} May 28 12:58:25 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-e663225b-6477-401f-b391-71804dbaf246 tempest-ResourceLockCRUTest-1971036144 tempest-ResourceLockCRUTest-1971036144-project-member] http://10.27.203.238/share/v2/82840ccb77144a4aa2d0bdce807ce686/shares/071c2e61-b4b6-48bf-a1f2-c20b233560ed returned with HTTP 202 May 28 12:58:25 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 531/1062] 10.27.203.238 () {64 vars in 1454 bytes} [Tue May 28 12:58:25 2024] DELETE /share/v2/82840ccb77144a4aa2d0bdce807ce686/shares/071c2e61-b4b6-48bf-a1f2-c20b233560ed => generated 0 bytes in 134 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:58:25 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-18f8049c-b93d-4d8f-b8bf-c74a31922257 tempest-ResourceLockCRUTest-1971036144 tempest-ResourceLockCRUTest-1971036144-project-member] GET http://10.27.203.238/share/v2/82840ccb77144a4aa2d0bdce807ce686/shares/071c2e61-b4b6-48bf-a1f2-c20b233560ed May 28 12:58:25 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-18f8049c-b93d-4d8f-b8bf-c74a31922257 tempest-ResourceLockCRUTest-1971036144 tempest-ResourceLockCRUTest-1971036144-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:25 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-18f8049c-b93d-4d8f-b8bf-c74a31922257 tempest-ResourceLockCRUTest-1971036144 tempest-ResourceLockCRUTest-1971036144-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:25 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-7c3c936b-fb6a-4a9e-a8be-cc8742ddbf7d tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/snapshots/6ddf5f7a-7bad-4eea-9e2e-64307270ec88 returned with HTTP 202 May 28 12:58:25 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 532/1063] 10.27.203.238 () {64 vars in 1463 bytes} [Tue May 28 12:58:25 2024] DELETE /share/v2/a3499cb78849424db45e54caac01de92/snapshots/6ddf5f7a-7bad-4eea-9e2e-64307270ec88 => generated 0 bytes in 105 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:58:25 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-3ee05d2f-af3c-4de3-a1fa-443b26bbf17e tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] GET http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/snapshots/6ddf5f7a-7bad-4eea-9e2e-64307270ec88 May 28 12:58:25 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-3ee05d2f-af3c-4de3-a1fa-443b26bbf17e tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:25 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-3ee05d2f-af3c-4de3-a1fa-443b26bbf17e tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Calling method 'ShareSnapshotMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:25 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-18f8049c-b93d-4d8f-b8bf-c74a31922257 tempest-ResourceLockCRUTest-1971036144 tempest-ResourceLockCRUTest-1971036144-project-member] http://10.27.203.238/share/v2/82840ccb77144a4aa2d0bdce807ce686/shares/071c2e61-b4b6-48bf-a1f2-c20b233560ed returned with HTTP 200 May 28 12:58:25 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 532/1064] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:58:25 2024] GET /share/v2/82840ccb77144a4aa2d0bdce807ce686/shares/071c2e61-b4b6-48bf-a1f2-c20b233560ed => generated 1318 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:58:25 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-3ee05d2f-af3c-4de3-a1fa-443b26bbf17e tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/snapshots/6ddf5f7a-7bad-4eea-9e2e-64307270ec88 returned with HTTP 200 May 28 12:58:25 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 533/1065] 10.27.203.238 () {64 vars in 1460 bytes} [Tue May 28 12:58:25 2024] GET /share/v2/a3499cb78849424db45e54caac01de92/snapshots/6ddf5f7a-7bad-4eea-9e2e-64307270ec88 => generated 750 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:58:25 l75lg1-v1 dstat.sh[49771]: 28-05 12:58:25| 17 2 78 2 0|5719M 1763M 277M 7866M| 31k 6446B| 0 8309k| 0 859 |6991 12k|1.45 1.10 1.02|2.0 1.0 0| 0 0 | 0 2048M| 29 357 0 36 0 May 28 12:58:25 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-e663225b-6477-401f-b391-71804dbaf246 tempest-ResourceLockCRUTest-1971036144 None] Acquiring lock "locked_access_rules_operation_by_share_instance_5de0f734-b2f4-4d05-8249-81f9d2973a8a" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:25 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-e663225b-6477-401f-b391-71804dbaf246 tempest-ResourceLockCRUTest-1971036144 None] Lock "locked_access_rules_operation_by_share_instance_5de0f734-b2f4-4d05-8249-81f9d2973a8a" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:25 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-e663225b-6477-401f-b391-71804dbaf246 tempest-ResourceLockCRUTest-1971036144 None] Lock "locked_access_rules_operation_by_share_instance_5de0f734-b2f4-4d05-8249-81f9d2973a8a" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.013s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:25 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-e663225b-6477-401f-b391-71804dbaf246 tempest-ResourceLockCRUTest-1971036144 None] Acquiring lock "locked_access_rules_operation_by_share_instance_5de0f734-b2f4-4d05-8249-81f9d2973a8a" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:25 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-e663225b-6477-401f-b391-71804dbaf246 tempest-ResourceLockCRUTest-1971036144 None] Lock "locked_access_rules_operation_by_share_instance_5de0f734-b2f4-4d05-8249-81f9d2973a8a" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:25 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-e663225b-6477-401f-b391-71804dbaf246 tempest-ResourceLockCRUTest-1971036144 None] Lock "locked_access_rules_operation_by_share_instance_5de0f734-b2f4-4d05-8249-81f9d2973a8a" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.006s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:25 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-e663225b-6477-401f-b391-71804dbaf246 tempest-ResourceLockCRUTest-1971036144 None] Acquiring lock "locked_access_rules_operation_by_share_instance_5de0f734-b2f4-4d05-8249-81f9d2973a8a" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:25 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-e663225b-6477-401f-b391-71804dbaf246 tempest-ResourceLockCRUTest-1971036144 None] Lock "locked_access_rules_operation_by_share_instance_5de0f734-b2f4-4d05-8249-81f9d2973a8a" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:25 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-e663225b-6477-401f-b391-71804dbaf246 tempest-ResourceLockCRUTest-1971036144 None] Lock "locked_access_rules_operation_by_share_instance_5de0f734-b2f4-4d05-8249-81f9d2973a8a" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.012s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:25 l75lg1-v1 manila-share[98474]: DEBUG manila.share.access [None req-e663225b-6477-401f-b391-71804dbaf246 tempest-ResourceLockCRUTest-1971036144 None] All access rules have been synced for share instance 5de0f734-b2f4-4d05-8249-81f9d2973a8a belonging to share 071c2e61-b4b6-48bf-a1f2-c20b233560ed. {{(pid=98474) update_access_rules /opt/stack/manila/manila/share/access.py:304}} May 28 12:58:25 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-e663225b-6477-401f-b391-71804dbaf246 tempest-ResourceLockCRUTest-1971036144 None] deleting '/manila/manila-5de0f734-b2f4-4d05-8249-81f9d2973a8a' May 28 12:58:25 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e663225b-6477-401f-b391-71804dbaf246 tempest-ResourceLockCRUTest-1971036144 None] >>> [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/ May 28 12:58:25 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e663225b-6477-401f-b391-71804dbaf246 tempest-ResourceLockCRUTest-1971036144 None] {'data': '{"path": "/manila/manila-5de0f734-b2f4-4d05-8249-81f9d2973a8a"}', May 28 12:58:25 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e663225b-6477-401f-b391-71804dbaf246 tempest-ResourceLockCRUTest-1971036144 None] 'params': None} May 28 12:58:25 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-7c3c936b-fb6a-4a9e-a8be-cc8742ddbf7d tempest-AdminActionsTest-1749172189 None] >>> [GET] https://127.0.0.1:40443/api/snapshots/ May 28 12:58:25 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-7c3c936b-fb6a-4a9e-a8be-cc8742ddbf7d tempest-AdminActionsTest-1749172189 None] {'allow_redirects': True, May 28 12:58:25 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-7c3c936b-fb6a-4a9e-a8be-cc8742ddbf7d tempest-AdminActionsTest-1749172189 None] 'params': {'name': 'share-snapshot-64c48761-d84e-4d5e-adb5-0cae2ce900e5'}} May 28 12:58:25 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e663225b-6477-401f-b391-71804dbaf246 tempest-ResourceLockCRUTest-1971036144 None] <<< [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/ May 28 12:58:25 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e663225b-6477-401f-b391-71804dbaf246 tempest-ResourceLockCRUTest-1971036144 None] 'OK' May 28 12:58:25 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e663225b-6477-401f-b391-71804dbaf246 tempest-ResourceLockCRUTest-1971036144 None] --- [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/: Done May 28 12:58:25 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e663225b-6477-401f-b391-71804dbaf246 tempest-ResourceLockCRUTest-1971036144 None] >>> [GET] https://127.0.0.1:40443/api/views/ May 28 12:58:25 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e663225b-6477-401f-b391-71804dbaf246 tempest-ResourceLockCRUTest-1971036144 None] {'allow_redirects': True, May 28 12:58:25 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e663225b-6477-401f-b391-71804dbaf246 tempest-ResourceLockCRUTest-1971036144 None] 'params': {'name': '5de0f734-b2f4-4d05-8249-81f9d2973a8a'}} May 28 12:58:25 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b955836e-3bcf-4f6f-a7c4-571eaa76539d tempest-SharesMetadataTest-1561320255 None] <<< [GET] https://127.0.0.1:40443/api/views/ May 28 12:58:25 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b955836e-3bcf-4f6f-a7c4-571eaa76539d tempest-SharesMetadataTest-1561320255 None] [Bunch(abac_tags=[], abe_max_depth=None, abe_protocols=[], alias='', allow_anonymous_access=False, allow_s3_anonymous_access=False, auto_commit='0d', bucket='', bucket_creators=[], bucket_creators_groups=[], bucket_owner=None, bulk_permission_update_progress=None, bulk_permission_update_state=None, cluster='loop75-kfs', cluster_id=1, created='2024-05-28T12:58:21.546392Z', enabled=True, files_retention_mode='NONE', guid='75f7a9cb-dadc-42b2-8d91-f290a453d80c', id=27, ignore_oos=False, internal=False, is_remote=False, is_seamless=False, logical_capacity=0, max_retention_period=None, min_retention_period=None, name='8d0c9317-df90-47d1-b406-482ee14c60e8', nfs_interop_flags='BOTH_NFS3_AND_NFS4_INTEROP_DISABLED', path='/manila/manila-8d0c9317-df90-47d1-b406-482ee14c60e8', physical_capacity=0, policy='8d0c9317-df90-47d1-b406-482ee14c60e8', policy_id=28, protocols=['NFS'], qos_policy=None, qos_policy_id=None, s3_locks=False, s3_locks_retention_mode='NONE', s3_locks_retention_period='', s3_unverified_lookup=False, s3_versioning=False, select_for_live_monitoring=False, share='', share_acl=Bunch(acl=[], enabled=False), sync='SYNCED', sync_time='2024-05-28T12:58:21.817045Z', tenant_id=1, tenant_name='default', title='/manila/manila-8d0c9317-df90-47d1-b406-482ee14c60e8', url='https://127.0.0.1:40443/api/views/27/')] May 28 12:58:25 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b955836e-3bcf-4f6f-a7c4-571eaa76539d tempest-SharesMetadataTest-1561320255 None] --- [GET] https://127.0.0.1:40443/api/views/: Done May 28 12:58:25 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b955836e-3bcf-4f6f-a7c4-571eaa76539d tempest-SharesMetadataTest-1561320255 None] >>> [DELETE] https://127.0.0.1:40443/api/views/27/ May 28 12:58:25 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-7c3c936b-fb6a-4a9e-a8be-cc8742ddbf7d tempest-AdminActionsTest-1749172189 None] <<< [GET] https://127.0.0.1:40443/api/snapshots/ May 28 12:58:25 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-7c3c936b-fb6a-4a9e-a8be-cc8742ddbf7d tempest-AdminActionsTest-1749172189 None] [Bunch(access_path='/.vast_all_snapshots/1000000009_share-snapshot-64c48761-d84e-4d5e-adb5-0cae2ce900e5', aggr_phys_estimation=0, cluster='loop75-kfs', created='2024-05-28T12:58:15.802688Z', eta_sec=30819898892.330204, expiration_time='3001-01-19T07:59:58Z', guid='0e254f26-53f8-4e32-b566-aed8291f2b5c', id=10, indestructible=False, locked=False, name='share-snapshot-64c48761-d84e-4d5e-adb5-0cae2ce900e5', path='/manila/manila-77a25e6b-f137-4342-8eb9-9ced679515e2/', policy=None, policy_id=None, protection_policy_id=None, state='SUCCEED', tenant_id=1, tenant_name='default', title='share-snapshot-64c48761-d84e-4d5e-adb5-0cae2ce900e5(/manila/manila-77a25e6b-f137-4342-8eb9-9ced679515e2/)', type='local', unique_phys_estimation=0, url='https://127.0.0.1:40443/api/snapshots/10/')] May 28 12:58:25 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-7c3c936b-fb6a-4a9e-a8be-cc8742ddbf7d tempest-AdminActionsTest-1749172189 None] --- [GET] https://127.0.0.1:40443/api/snapshots/: Done May 28 12:58:25 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-7c3c936b-fb6a-4a9e-a8be-cc8742ddbf7d tempest-AdminActionsTest-1749172189 None] >>> [DELETE] https://127.0.0.1:40443/api/snapshots/10/ May 28 12:58:25 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_service.periodic_task [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85846) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:58:25 l75lg1-v1 cinder-volume[85846]: DEBUG cinder.volume.drivers.lvm [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] Updating volume stats {{(pid=85846) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}} May 28 12:58:25 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:390}} May 28 12:58:25 l75lg1-v1 sudo[98866]: vastdata : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 May 28 12:58:25 l75lg1-v1 sudo[98866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) May 28 12:58:25 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-df1115ed-7421-4cf3-ab15-b143bf1cb0e0 tempest-ShareIpRulesForNFSTest-1748669711 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:58:25 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-df1115ed-7421-4cf3-ab15-b143bf1cb0e0 tempest-ShareIpRulesForNFSTest-1748669711 None] [Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=1, created='2024-05-28T12:57:40.763635Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='377955ad-d094-4e49-ab32-1021d943a572', id=21, internal=False, is_s3_default_policy=False, name='b7a7d61c-2cea-442a-9809-507038e080d5', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=['*'], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['*'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['*'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T12:58:11.063538Z', tenant_id=1, tenant_name='default', title='b7a7d61c-2cea-442a-9809-507038e080d5', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/21/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[])] May 28 12:58:25 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-df1115ed-7421-4cf3-ab15-b143bf1cb0e0 tempest-ShareIpRulesForNFSTest-1748669711 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 12:58:25 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-df1115ed-7421-4cf3-ab15-b143bf1cb0e0 tempest-ShareIpRulesForNFSTest-1748669711 None] changing access on /manila/manila-b7a7d61c-2cea-442a-9809-507038e080d5. Rules: {'nfs_read_write': ['203.0.113.130'], 'nfs_read_only': []} May 28 12:58:25 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-df1115ed-7421-4cf3-ab15-b143bf1cb0e0 tempest-ShareIpRulesForNFSTest-1748669711 None] >>> [PATCH] https://127.0.0.1:40443/api/viewpolicies/21/ May 28 12:58:25 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-df1115ed-7421-4cf3-ab15-b143bf1cb0e0 tempest-ShareIpRulesForNFSTest-1748669711 None] {'data': '{"name": "b7a7d61c-2cea-442a-9809-507038e080d5", "nfs_no_squash": ' May 28 12:58:25 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-df1115ed-7421-4cf3-ab15-b143bf1cb0e0 tempest-ShareIpRulesForNFSTest-1748669711 None] '["*"], "nfs_root_squash": ["*"], "nfs_read_write": ' May 28 12:58:25 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-df1115ed-7421-4cf3-ab15-b143bf1cb0e0 tempest-ShareIpRulesForNFSTest-1748669711 None] '["203.0.113.130"], "nfs_read_only": []}', May 28 12:58:25 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-df1115ed-7421-4cf3-ab15-b143bf1cb0e0 tempest-ShareIpRulesForNFSTest-1748669711 None] 'params': None} May 28 12:58:25 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0e1fea71-d8a0-4d61-a7a0-79654970cec5 tempest-PublicSharesTest-118543418 None] <<< [POST] https://127.0.0.1:40443/api/views/ May 28 12:58:25 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0e1fea71-d8a0-4d61-a7a0-79654970cec5 tempest-PublicSharesTest-118543418 None] Bunch(abac_tags=[], abe_max_depth=None, abe_protocols=[], alias='', allow_anonymous_access=False, allow_s3_anonymous_access=False, auto_commit='0d', bucket='', bucket_creators=[], bucket_creators_groups=[], bucket_owner=None, bulk_permission_update_progress=None, bulk_permission_update_state=None, cluster='loop75-kfs', cluster_id=1, created='2024-05-28T12:58:25.495336Z', enabled=True, files_retention_mode='NONE', guid='f77087b1-5cf5-46b8-bb21-10e95b50a818', id=28, ignore_oos=False, internal=False, is_remote=False, is_seamless=False, logical_capacity=0, max_retention_period=None, min_retention_period=None, name='c4c98d1e-9abc-48c7-a23f-ed7f1a740252', nfs_interop_flags='BOTH_NFS3_AND_NFS4_INTEROP_DISABLED', path='/manila/manila-c4c98d1e-9abc-48c7-a23f-ed7f1a740252', physical_capacity=0, policy='c4c98d1e-9abc-48c7-a23f-ed7f1a740252', policy_id=29, protocols=['NFS'], qos_policy=None, qos_policy_id=None, s3_locks=False, s3_locks_retention_mode='NONE', s3_locks_retention_period='', s3_object_ownership_rule='ObjectWriter', s3_unverified_lookup=False, s3_versioning=False, select_for_live_monitoring=False, share='', share_acl=Bunch(acl=[], enabled=False), sync='SYNCED', sync_time='2024-05-28T12:58:25.762305Z', tenant_id=1, tenant_name='default', title='/manila/manila-c4c98d1e-9abc-48c7-a23f-ed7f1a740252', url='https://127.0.0.1:40443/api/views/28/') May 28 12:58:25 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0e1fea71-d8a0-4d61-a7a0-79654970cec5 tempest-PublicSharesTest-118543418 None] --- [POST] https://127.0.0.1:40443/api/views/: Done May 28 12:58:25 l75lg1-v1 manila-share[98474]: INFO manila.share.manager [None req-0e1fea71-d8a0-4d61-a7a0-79654970cec5 tempest-PublicSharesTest-118543418 None] Share instance c4c98d1e-9abc-48c7-a23f-ed7f1a740252 created successfully. May 28 12:58:26 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e663225b-6477-401f-b391-71804dbaf246 tempest-ResourceLockCRUTest-1971036144 None] <<< [GET] https://127.0.0.1:40443/api/views/ May 28 12:58:26 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e663225b-6477-401f-b391-71804dbaf246 tempest-ResourceLockCRUTest-1971036144 None] [Bunch(abac_tags=[], abe_max_depth=None, abe_protocols=[], alias='', allow_anonymous_access=False, allow_s3_anonymous_access=False, auto_commit='0d', bucket='', bucket_creators=[], bucket_creators_groups=[], bucket_owner=None, bulk_permission_update_progress=None, bulk_permission_update_state=None, cluster='loop75-kfs', cluster_id=1, created='2024-05-28T12:58:06.215642Z', enabled=True, files_retention_mode='NONE', guid='8de59abe-ebe8-4bcc-806a-4252660541eb', id=25, ignore_oos=False, internal=False, is_remote=False, is_seamless=False, logical_capacity=0, max_retention_period=None, min_retention_period=None, name='5de0f734-b2f4-4d05-8249-81f9d2973a8a', nfs_interop_flags='BOTH_NFS3_AND_NFS4_INTEROP_DISABLED', path='/manila/manila-5de0f734-b2f4-4d05-8249-81f9d2973a8a', physical_capacity=0, policy='5de0f734-b2f4-4d05-8249-81f9d2973a8a', policy_id=26, protocols=['NFS'], qos_policy=None, qos_policy_id=None, s3_locks=False, s3_locks_retention_mode='NONE', s3_locks_retention_period='', s3_unverified_lookup=False, s3_versioning=False, select_for_live_monitoring=False, share='', share_acl=Bunch(acl=[], enabled=False), sync='SYNCED', sync_time='2024-05-28T12:58:06.465769Z', tenant_id=1, tenant_name='default', title='/manila/manila-5de0f734-b2f4-4d05-8249-81f9d2973a8a', url='https://127.0.0.1:40443/api/views/25/')] May 28 12:58:26 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e663225b-6477-401f-b391-71804dbaf246 tempest-ResourceLockCRUTest-1971036144 None] --- [GET] https://127.0.0.1:40443/api/views/: Done May 28 12:58:26 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e663225b-6477-401f-b391-71804dbaf246 tempest-ResourceLockCRUTest-1971036144 None] >>> [DELETE] https://127.0.0.1:40443/api/views/25/ May 28 12:58:26 l75lg1-v1 sudo[98866]: pam_unix(sudo:session): session closed for user root May 28 12:58:26 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.513s {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:428}} May 28 12:58:26 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:390}} May 28 12:58:26 l75lg1-v1 dstat.sh[49771]: 28-05 12:58:26| 8 2 88 1 0|5721M 1761M 277M 7866M| 31k 5115B| 256k 1294k|2.00 94.8 |3847 5787 |1.45 1.10 1.02|2.0 1.0 50| 0 0 | 0 2048M| 29 357 0 36 0 May 28 12:58:26 l75lg1-v1 sudo[98915]: vastdata : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 May 28 12:58:26 l75lg1-v1 sudo[98915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) May 28 12:58:26 l75lg1-v1 sudo[98915]: pam_unix(sudo:session): session closed for user root May 28 12:58:26 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.472s {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:428}} May 28 12:58:26 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:390}} May 28 12:58:26 l75lg1-v1 sudo[98918]: vastdata : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool May 28 12:58:26 l75lg1-v1 sudo[98918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) May 28 12:58:26 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-0d5ff04b-5e02-4451-8ba8-1fec58fe2a51 tempest-PublicSharesTest-118543418 tempest-PublicSharesTest-118543418-project-admin] GET http://10.27.203.238/share/v2/8ee1466a8fe242afa8e0d0378840bfc1/shares/5a92a994-03f1-4598-b3f6-70280cf0a971 May 28 12:58:26 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-0d5ff04b-5e02-4451-8ba8-1fec58fe2a51 tempest-PublicSharesTest-118543418 tempest-PublicSharesTest-118543418-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:26 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-0d5ff04b-5e02-4451-8ba8-1fec58fe2a51 tempest-PublicSharesTest-118543418 tempest-PublicSharesTest-118543418-project-admin] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:27 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-0d5ff04b-5e02-4451-8ba8-1fec58fe2a51 tempest-PublicSharesTest-118543418 tempest-PublicSharesTest-118543418-project-admin] http://10.27.203.238/share/v2/8ee1466a8fe242afa8e0d0378840bfc1/shares/5a92a994-03f1-4598-b3f6-70280cf0a971 returned with HTTP 200 May 28 12:58:27 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 533/1066] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:58:26 2024] GET /share/v2/8ee1466a8fe242afa8e0d0378840bfc1/shares/5a92a994-03f1-4598-b3f6-70280cf0a971 => generated 1393 bytes in 24 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:58:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fcdc8d-a2d0-46e0-ae31-31acd381d806 tempest-PublicSharesTest-118543418 tempest-PublicSharesTest-118543418-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-a4fcdc8d-a2d0-46e0-ae31-31acd381d806 tempest-PublicSharesTest-118543418 tempest-PublicSharesTest-118543418-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:58:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fcdc8d-a2d0-46e0-ae31-31acd381d806 tempest-PublicSharesTest-118543418 tempest-PublicSharesTest-118543418-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40785d6-de61-4e64-b8dd-9c30340252e9 service manila] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f110cf6300f049c897d0aab63218d1e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40785d6-de61-4e64-b8dd-9c30340252e9 service manila] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40785d6-de61-4e64-b8dd-9c30340252e9 service manila] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40785d6-de61-4e64-b8dd-9c30340252e9 service manila] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40785d6-de61-4e64-b8dd-9c30340252e9 service manila] RBAC: Authorizing `identity:validate_token()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40785d6-de61-4e64-b8dd-9c30340252e9 service manila] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:27 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1118/2212] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 12:58:27 2024] GET /identity/v3/auth/tokens => generated 3942 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 12:58:27 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-baa0060d-0a33-4293-9dac-8ca198bdb06c tempest-PublicSharesTest-1667420263 tempest-PublicSharesTest-1667420263-project-member] POST http://10.27.203.238/share/v2/6d36e1eb1dbc449db6aca75b12a2ba18/shares May 28 12:58:27 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-baa0060d-0a33-4293-9dac-8ca198bdb06c tempest-PublicSharesTest-1667420263 tempest-PublicSharesTest-1667420263-project-member] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share": {"share_proto": "nfs", "description": "private share in the primary user project", "snapshot_id": null, "name": "private_share", "size": 1, "metadata": {}, "is_public": false, "share_type": "31514837-1b9c-4410-8444-5ea15e0aca59"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:58:27 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.v1.shares [None req-baa0060d-0a33-4293-9dac-8ca198bdb06c tempest-PublicSharesTest-1667420263 tempest-PublicSharesTest-1667420263-project-member] Create NFS share of 1 GB May 28 12:58:27 l75lg1-v1 sudo[98918]: pam_unix(sudo:session): session closed for user root May 28 12:58:27 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.453s {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:428}} May 28 12:58:27 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:390}} May 28 12:58:27 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.quota [None req-baa0060d-0a33-4293-9dac-8ca198bdb06c tempest-PublicSharesTest-1667420263 tempest-PublicSharesTest-1667420263-project-member] Created reservations ['420c1d8a-a9c0-425d-99c8-a2dd3b112b0a', '2396e574-0dc2-4092-926c-41f3ce0fd321', '0c452748-f6fe-4dc0-9313-3eab0b65bbeb', '4f05c18d-f36f-4653-8e66-f14cce1c4a3d'] {{(pid=98330) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 12:58:27 l75lg1-v1 sudo[98921]: vastdata : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 May 28 12:58:27 l75lg1-v1 sudo[98921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) May 28 12:58:27 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.quota [None req-baa0060d-0a33-4293-9dac-8ca198bdb06c tempest-PublicSharesTest-1667420263 tempest-PublicSharesTest-1667420263-project-member] Committed reservations ['420c1d8a-a9c0-425d-99c8-a2dd3b112b0a', '2396e574-0dc2-4092-926c-41f3ce0fd321', '0c452748-f6fe-4dc0-9313-3eab0b65bbeb', '4f05c18d-f36f-4653-8e66-f14cce1c4a3d'] {{(pid=98330) commit /opt/stack/manila/manila/quota.py:1063}} May 28 12:58:27 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-7c3c936b-fb6a-4a9e-a8be-cc8742ddbf7d tempest-AdminActionsTest-1749172189 None] <<< [DELETE] https://127.0.0.1:40443/api/snapshots/10/ May 28 12:58:27 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-7c3c936b-fb6a-4a9e-a8be-cc8742ddbf7d tempest-AdminActionsTest-1749172189 None] --- [DELETE] https://127.0.0.1:40443/api/snapshots/10/: Done May 28 12:58:27 l75lg1-v1 dstat.sh[49771]: 28-05 12:58:27| 10 2 86 1 0|5721M 1761M 277M 7866M| 17k 172B| 641k 913k|5.01 130 |3197 5132 |1.42 1.10 1.02|3.0 1.0 7.0| 0 0 | 0 2048M| 29 358 0 36 0 May 28 12:58:27 l75lg1-v1 manila-scheduler[98327]: DEBUG dbcounter [-] [98327] Writing DB stats manila:SELECT=138,manila:UPDATE=18 {{(pid=98327) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:58:27 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.host_manager [None req-baa0060d-0a33-4293-9dac-8ca198bdb06c tempest-PublicSharesTest-1667420263 None] Share service is down. (host: l75lg1-v1@generic2). May 28 12:58:27 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.host_manager [None req-baa0060d-0a33-4293-9dac-8ca198bdb06c tempest-PublicSharesTest-1667420263 None] Share service is down. (host: l75lg1-v1@generic1). May 28 12:58:27 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-baa0060d-0a33-4293-9dac-8ca198bdb06c tempest-PublicSharesTest-1667420263 None] Starting with 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:80}} May 28 12:58:27 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-baa0060d-0a33-4293-9dac-8ca198bdb06c tempest-PublicSharesTest-1667420263 None] Filter OnlyHostFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:58:27 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-baa0060d-0a33-4293-9dac-8ca198bdb06c tempest-PublicSharesTest-1667420263 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:58:27 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.capacity [None req-baa0060d-0a33-4293-9dac-8ca198bdb06c tempest-PublicSharesTest-1667420263 None] Space information for share creation on host l75lg1-v1@vast#vast (requested / avail): 1/2076 {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/capacity.py:83}} May 28 12:58:27 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-baa0060d-0a33-4293-9dac-8ca198bdb06c tempest-PublicSharesTest-1667420263 None] Filter CapacityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:58:27 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-baa0060d-0a33-4293-9dac-8ca198bdb06c tempest-PublicSharesTest-1667420263 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:58:27 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-baa0060d-0a33-4293-9dac-8ca198bdb06c tempest-PublicSharesTest-1667420263 None] Driver Filter: Checking host 'l75lg1-v1@vast#vast' {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:37}} May 28 12:58:27 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-baa0060d-0a33-4293-9dac-8ca198bdb06c tempest-PublicSharesTest-1667420263 None] Filter function not set :: passing host. {{(pid=98327) _check_filter_function /opt/stack/manila/manila/scheduler/filters/driver.py:53}} May 28 12:58:27 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-baa0060d-0a33-4293-9dac-8ca198bdb06c tempest-PublicSharesTest-1667420263 None] Result: True {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:40}} May 28 12:58:27 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-baa0060d-0a33-4293-9dac-8ca198bdb06c tempest-PublicSharesTest-1667420263 None] Done checking host 'l75lg1-v1@vast#vast' {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:41}} May 28 12:58:27 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-baa0060d-0a33-4293-9dac-8ca198bdb06c tempest-PublicSharesTest-1667420263 None] Filter DriverFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:58:27 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-baa0060d-0a33-4293-9dac-8ca198bdb06c tempest-PublicSharesTest-1667420263 None] Filter ShareReplicationFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:58:27 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-baa0060d-0a33-4293-9dac-8ca198bdb06c tempest-PublicSharesTest-1667420263 None] Filter CreateFromSnapshotFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:58:27 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-baa0060d-0a33-4293-9dac-8ca198bdb06c tempest-PublicSharesTest-1667420263 None] Filter AffinityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:58:27 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-baa0060d-0a33-4293-9dac-8ca198bdb06c tempest-PublicSharesTest-1667420263 None] Filter AntiAffinityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:58:27 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.drivers.filter [None req-baa0060d-0a33-4293-9dac-8ca198bdb06c tempest-PublicSharesTest-1667420263 None] Filtered share [host: 'l75lg1-v1@vast#vast', free_capacity_gb: 2076.6229242384434, pools: None] {{(pid=98327) _schedule_share /opt/stack/manila/manila/scheduler/drivers/filter.py:268}} May 28 12:58:27 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-baa0060d-0a33-4293-9dac-8ca198bdb06c tempest-PublicSharesTest-1667420263 None] Checking host 'l75lg1-v1@vast#vast' {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:46}} May 28 12:58:27 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.weighers.goodness [None req-baa0060d-0a33-4293-9dac-8ca198bdb06c tempest-PublicSharesTest-1667420263 None] Goodness function not set :: defaulting to minimal goodness rating of 0. May 28 12:58:27 l75lg1-v1 manila-scheduler[98327]: INFO manila.scheduler.weighers.goodness [None req-baa0060d-0a33-4293-9dac-8ca198bdb06c tempest-PublicSharesTest-1667420263 None] Goodness function result for host l75lg1-v1@vast#vast: 0. May 28 12:58:27 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-baa0060d-0a33-4293-9dac-8ca198bdb06c tempest-PublicSharesTest-1667420263 None] Goodness: 0 {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:48}} May 28 12:58:27 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-baa0060d-0a33-4293-9dac-8ca198bdb06c tempest-PublicSharesTest-1667420263 None] Done checking host 'l75lg1-v1@vast#vast' {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:49}} May 28 12:58:27 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.drivers.filter [None req-baa0060d-0a33-4293-9dac-8ca198bdb06c tempest-PublicSharesTest-1667420263 None] Choosing for share: WeighedHost [host: l75lg1-v1@vast#vast, weight: 0.0] {{(pid=98327) _schedule_share /opt/stack/manila/manila/scheduler/drivers/filter.py:274}} May 28 12:58:27 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-baa0060d-0a33-4293-9dac-8ca198bdb06c tempest-PublicSharesTest-1667420263 tempest-PublicSharesTest-1667420263-project-member] http://10.27.203.238/share/v2/6d36e1eb1dbc449db6aca75b12a2ba18/shares returned with HTTP 200 May 28 12:58:27 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 534/1067] 10.27.203.238 () {66 vars in 1362 bytes} [Tue May 28 12:58:27 2024] POST /share/v2/6d36e1eb1dbc449db6aca75b12a2ba18/shares => generated 1311 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:58:27 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-c7f3ad17-c31b-41a1-a0c9-965c888220dc tempest-PublicSharesTest-1667420263 tempest-PublicSharesTest-1667420263-project-member] GET http://10.27.203.238/share/v2/6d36e1eb1dbc449db6aca75b12a2ba18/shares/50dc60c2-08d1-4244-b4aa-f09b7789e32d May 28 12:58:27 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-c7f3ad17-c31b-41a1-a0c9-965c888220dc tempest-PublicSharesTest-1667420263 tempest-PublicSharesTest-1667420263-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:27 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-c7f3ad17-c31b-41a1-a0c9-965c888220dc tempest-PublicSharesTest-1667420263 tempest-PublicSharesTest-1667420263-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:27 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-7c3c936b-fb6a-4a9e-a8be-cc8742ddbf7d tempest-AdminActionsTest-1749172189 None] Created reservations ['afcaaff4-81ca-4eba-90e0-28d5c5c78628', '9d72b5a6-71e8-4e0a-8f36-fed93742e065', '50cb610e-d007-40df-9e66-73e99782d2be', 'c9a95363-02b4-42f0-8307-bec645aeec9d'] {{(pid=98474) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 12:58:27 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-c7f3ad17-c31b-41a1-a0c9-965c888220dc tempest-PublicSharesTest-1667420263 tempest-PublicSharesTest-1667420263-project-member] http://10.27.203.238/share/v2/6d36e1eb1dbc449db6aca75b12a2ba18/shares/50dc60c2-08d1-4244-b4aa-f09b7789e32d returned with HTTP 200 May 28 12:58:27 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 534/1068] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:58:27 2024] GET /share/v2/6d36e1eb1dbc449db6aca75b12a2ba18/shares/50dc60c2-08d1-4244-b4aa-f09b7789e32d => generated 1311 bytes in 25 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:58:27 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-7c3c936b-fb6a-4a9e-a8be-cc8742ddbf7d tempest-AdminActionsTest-1749172189 None] Committed reservations ['afcaaff4-81ca-4eba-90e0-28d5c5c78628', '9d72b5a6-71e8-4e0a-8f36-fed93742e065', '50cb610e-d007-40df-9e66-73e99782d2be', 'c9a95363-02b4-42f0-8307-bec645aeec9d'] {{(pid=98474) commit /opt/stack/manila/manila/quota.py:1063}} May 28 12:58:27 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-baa0060d-0a33-4293-9dac-8ca198bdb06c tempest-PublicSharesTest-1667420263 None] >>> [GET] https://127.0.0.1:40443/api/vippools/ May 28 12:58:27 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-baa0060d-0a33-4293-9dac-8ca198bdb06c tempest-PublicSharesTest-1667420263 None] {'allow_redirects': True, 'params': {'name': 'vippool-1'}} May 28 12:58:27 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-df1115ed-7421-4cf3-ab15-b143bf1cb0e0 tempest-ShareIpRulesForNFSTest-1748669711 None] <<< [PATCH] https://127.0.0.1:40443/api/viewpolicies/21/ May 28 12:58:27 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-df1115ed-7421-4cf3-ab15-b143bf1cb0e0 tempest-ShareIpRulesForNFSTest-1748669711 None] Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=1, created='2024-05-28T12:57:40.763635Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='377955ad-d094-4e49-ab32-1021d943a572', id=21, internal=False, is_s3_default_policy=False, name='b7a7d61c-2cea-442a-9809-507038e080d5', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=['*'], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['203.0.113.130'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['203.0.113.130'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='MODIFYING', sync_time='2024-05-28T12:58:26.939410Z', tenant_id=1, tenant_name='default', title='b7a7d61c-2cea-442a-9809-507038e080d5', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/21/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[]) May 28 12:58:27 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-df1115ed-7421-4cf3-ab15-b143bf1cb0e0 tempest-ShareIpRulesForNFSTest-1748669711 None] --- [PATCH] https://127.0.0.1:40443/api/viewpolicies/21/: Done May 28 12:58:27 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-df1115ed-7421-4cf3-ab15-b143bf1cb0e0 tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:27 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-df1115ed-7421-4cf3-ab15-b143bf1cb0e0 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:27 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-df1115ed-7421-4cf3-ab15-b143bf1cb0e0 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.052s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:27 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-df1115ed-7421-4cf3-ab15-b143bf1cb0e0 tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:27 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-df1115ed-7421-4cf3-ab15-b143bf1cb0e0 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:27 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-df1115ed-7421-4cf3-ab15-b143bf1cb0e0 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:27 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-df1115ed-7421-4cf3-ab15-b143bf1cb0e0 tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:27 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-df1115ed-7421-4cf3-ab15-b143bf1cb0e0 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:27 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-df1115ed-7421-4cf3-ab15-b143bf1cb0e0 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:27 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-df1115ed-7421-4cf3-ab15-b143bf1cb0e0 tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:27 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-df1115ed-7421-4cf3-ab15-b143bf1cb0e0 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:27 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-df1115ed-7421-4cf3-ab15-b143bf1cb0e0 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:27 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-df1115ed-7421-4cf3-ab15-b143bf1cb0e0 tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:27 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-df1115ed-7421-4cf3-ab15-b143bf1cb0e0 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:27 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-df1115ed-7421-4cf3-ab15-b143bf1cb0e0 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.042s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:27 l75lg1-v1 manila-share[98474]: INFO manila.share.access [None req-df1115ed-7421-4cf3-ab15-b143bf1cb0e0 tempest-ShareIpRulesForNFSTest-1748669711 None] Access rules were successfully modified for share instance b7a7d61c-2cea-442a-9809-507038e080d5 belonging to share 1ddadc17-cf10-4a42-8bbd-8335fb3520a1. May 28 12:58:27 l75lg1-v1 sudo[98921]: pam_unix(sudo:session): session closed for user root May 28 12:58:27 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.480s {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:428}} May 28 12:58:27 l75lg1-v1 cinder-volume[85846]: DEBUG cinder.manager [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] Notifying Schedulers of capabilities ... {{(pid=85846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 28 12:58:27 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.scheduler.host_manager [None req-1c739a58-dfb7-492a-b789-471e6c102bbc None None] Received volume service update from l75lg1-v1@lvmdriver-1: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:l75lg1-v1:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up', 'allocated_capacity_gb': 0, 'cacheable': True}], 'shared_targets': False, 'sparse_copy_volume': True, 'filter_function': None, 'goodness_function': None} {{(pid=85128) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:628}} May 28 12:58:27 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-baa0060d-0a33-4293-9dac-8ca198bdb06c tempest-PublicSharesTest-1667420263 None] <<< [GET] https://127.0.0.1:40443/api/vippools/ May 28 12:58:27 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-baa0060d-0a33-4293-9dac-8ca198bdb06c tempest-PublicSharesTest-1667420263 None] [Bunch(active_cnode_ids=[], active_interfaces=4, cluster='loop75-kfs', cluster_id=1, cnode_ids=[], cnodes=[], domain_name='vippool-1', enable_l3=False, enable_weighted_balancing=False, enabled=True, end_ip='172.21.75.4', guid='f2abaede-b397-413a-8faa-3aeead6d3b28', gw_ip='', gw_ipv6='', id=2, ip_ranges=[['172.21.75.1', '172.21.75.4']], name='vippool-1', peer_asn=0, port_membership='ALL', ranges_summary='172.21.75.[1-4]', role='PROTOCOLS', start_ip='172.21.75.1', subnet_cidr=16, subnet_cidr_ipv6=None, sync='SYNCED', sync_time='2024-05-28T12:50:09.644123Z', tenant_id=1, tenant_name='default', title='172.21.75.1 - 172.21.75.4', url='https://127.0.0.1:40443/api/vippools/2/', vast_asn=0, vlan=0, vms_preferred=False)] May 28 12:58:27 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-baa0060d-0a33-4293-9dac-8ca198bdb06c tempest-PublicSharesTest-1667420263 None] --- [GET] https://127.0.0.1:40443/api/vippools/: Done May 28 12:58:27 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-baa0060d-0a33-4293-9dac-8ca198bdb06c tempest-PublicSharesTest-1667420263 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:58:27 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-baa0060d-0a33-4293-9dac-8ca198bdb06c tempest-PublicSharesTest-1667420263 None] {'allow_redirects': True, May 28 12:58:27 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-baa0060d-0a33-4293-9dac-8ca198bdb06c tempest-PublicSharesTest-1667420263 None] 'params': {'name': '58febd66-6690-481d-866e-2c57d2f22405'}} May 28 12:58:27 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b955836e-3bcf-4f6f-a7c4-571eaa76539d tempest-SharesMetadataTest-1561320255 None] <<< [DELETE] https://127.0.0.1:40443/api/views/27/ May 28 12:58:27 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b955836e-3bcf-4f6f-a7c4-571eaa76539d tempest-SharesMetadataTest-1561320255 None] --- [DELETE] https://127.0.0.1:40443/api/views/27/: Done May 28 12:58:27 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b955836e-3bcf-4f6f-a7c4-571eaa76539d tempest-SharesMetadataTest-1561320255 None] >>> [GET] https://127.0.0.1:40443/api/quotas/ May 28 12:58:27 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b955836e-3bcf-4f6f-a7c4-571eaa76539d tempest-SharesMetadataTest-1561320255 None] {'allow_redirects': True, May 28 12:58:27 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b955836e-3bcf-4f6f-a7c4-571eaa76539d tempest-SharesMetadataTest-1561320255 None] 'params': {'name': '8d0c9317-df90-47d1-b406-482ee14c60e8'}} May 28 12:58:27 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-36931cba-6bd6-4cd5-bfcb-29876de18923 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] GET http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/dacdb3b4-4336-45fd-b002-1a5aa6ad9957 May 28 12:58:27 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-36931cba-6bd6-4cd5-bfcb-29876de18923 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:27 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-36931cba-6bd6-4cd5-bfcb-29876de18923 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:27 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-36931cba-6bd6-4cd5-bfcb-29876de18923 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/dacdb3b4-4336-45fd-b002-1a5aa6ad9957 returned with HTTP 200 May 28 12:58:27 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 535/1069] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:58:27 2024] GET /share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/dacdb3b4-4336-45fd-b002-1a5aa6ad9957 => generated 1314 bytes in 25 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:58:27 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-49a92f48-c965-4503-bc48-9ce7ffcb2ca8 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] POST http://10.27.203.238/share/v1/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action May 28 12:58:27 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-49a92f48-c965-4503-bc48-9ce7ffcb2ca8 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Action body: b'{"os-access_list": null}' {{(pid=98329) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:58:27 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-49a92f48-c965-4503-bc48-9ce7ffcb2ca8 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Action: 'action', calling method: ShareController.access_list, body: {"os-access_list": null} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:58:28 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-baa0060d-0a33-4293-9dac-8ca198bdb06c tempest-PublicSharesTest-1667420263 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:58:28 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-baa0060d-0a33-4293-9dac-8ca198bdb06c tempest-PublicSharesTest-1667420263 None] [] May 28 12:58:28 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-baa0060d-0a33-4293-9dac-8ca198bdb06c tempest-PublicSharesTest-1667420263 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 12:58:28 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-baa0060d-0a33-4293-9dac-8ca198bdb06c tempest-PublicSharesTest-1667420263 None] >>> [POST] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:58:28 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-baa0060d-0a33-4293-9dac-8ca198bdb06c tempest-PublicSharesTest-1667420263 None] {'data': '{"name": "58febd66-6690-481d-866e-2c57d2f22405"}', May 28 12:58:28 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-baa0060d-0a33-4293-9dac-8ca198bdb06c tempest-PublicSharesTest-1667420263 None] 'json': None, May 28 12:58:28 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-baa0060d-0a33-4293-9dac-8ca198bdb06c tempest-PublicSharesTest-1667420263 None] 'params': None} May 28 12:58:28 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-49a92f48-c965-4503-bc48-9ce7ffcb2ca8 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] http://10.27.203.238/share/v1/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action returned with HTTP 200 May 28 12:58:28 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 535/1070] 10.27.203.238 () {64 vars in 1450 bytes} [Tue May 28 12:58:27 2024] POST /share/v1/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action => generated 157 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:58:28 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b955836e-3bcf-4f6f-a7c4-571eaa76539d tempest-SharesMetadataTest-1561320255 None] <<< [GET] https://127.0.0.1:40443/api/quotas/ May 28 12:58:28 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b955836e-3bcf-4f6f-a7c4-571eaa76539d tempest-SharesMetadataTest-1561320255 None] [Bunch(cluster='loop75-kfs', cluster_id=1, default_email=None, default_group_quota=None, default_user_quota=None, enable_alarms=True, enable_email_providers=True, grace_period=None, guid='3579bff1-f9e9-45c5-8cac-26aac3d8a5da', hard_limit=1073741824, hard_limit_inodes=None, id=25, internal=False, is_user_quota=False, last_user_quotas_update=None, name='8d0c9317-df90-47d1-b406-482ee14c60e8', num_blocked_users=0, num_exceeded_users=0, path='/manila/manila-8d0c9317-df90-47d1-b406-482ee14c60e8', percent_capacity=0, percent_inodes=None, pretty_grace_period=None, pretty_grace_period_expiration=None, pretty_state='OK (CREATED)', soft_limit=None, soft_limit_inodes=None, state='OK', sync_state='CREATED', system_id=25, tenant_id=1, tenant_name='default', time_to_block=None, title='8d0c9317-df90-47d1-b406-482ee14c60e8', url='https://127.0.0.1:40443/api/quotas/25/', used_capacity=0, used_capacity_tb=0.0, used_effective_capacity=0, used_effective_capacity_tb=0.0, used_inodes=0, used_limited_capacity=0)] May 28 12:58:28 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b955836e-3bcf-4f6f-a7c4-571eaa76539d tempest-SharesMetadataTest-1561320255 None] --- [GET] https://127.0.0.1:40443/api/quotas/: Done May 28 12:58:28 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b955836e-3bcf-4f6f-a7c4-571eaa76539d tempest-SharesMetadataTest-1561320255 None] >>> [DELETE] https://127.0.0.1:40443/api/quotas/25/ May 28 12:58:28 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-629833ea-7ec8-42b2-854f-8591cbabacba tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] POST http://10.27.203.238/share/v1/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action May 28 12:58:28 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-629833ea-7ec8-42b2-854f-8591cbabacba tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Action body: b'{"os-deny_access": {"access_id": "4e43ecde-572c-45f3-a565-a60695ec55ee"}}' {{(pid=98330) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:58:28 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-629833ea-7ec8-42b2-854f-8591cbabacba tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Action: 'action', calling method: ShareController.deny_access, body: {"os-deny_access": {"access_id": "4e43ecde-572c-45f3-a565-a60695ec55ee"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:58:28 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.lock.api [None req-629833ea-7ec8-42b2-854f-8591cbabacba tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Searching for locks by: {'resource_id': '4e43ecde-572c-45f3-a565-a60695ec55ee', 'resource_action': 'delete'} {{(pid=98330) get_all /opt/stack/manila/manila/lock/api.py:112}} May 28 12:58:28 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-629833ea-7ec8-42b2-854f-8591cbabacba tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:28 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-629833ea-7ec8-42b2-854f-8591cbabacba tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:28 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e663225b-6477-401f-b391-71804dbaf246 tempest-ResourceLockCRUTest-1971036144 None] <<< [DELETE] https://127.0.0.1:40443/api/views/25/ May 28 12:58:28 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e663225b-6477-401f-b391-71804dbaf246 tempest-ResourceLockCRUTest-1971036144 None] --- [DELETE] https://127.0.0.1:40443/api/views/25/: Done May 28 12:58:28 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e663225b-6477-401f-b391-71804dbaf246 tempest-ResourceLockCRUTest-1971036144 None] >>> [GET] https://127.0.0.1:40443/api/quotas/ May 28 12:58:28 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e663225b-6477-401f-b391-71804dbaf246 tempest-ResourceLockCRUTest-1971036144 None] {'allow_redirects': True, May 28 12:58:28 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e663225b-6477-401f-b391-71804dbaf246 tempest-ResourceLockCRUTest-1971036144 None] 'params': {'name': '5de0f734-b2f4-4d05-8249-81f9d2973a8a'}} May 28 12:58:28 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-629833ea-7ec8-42b2-854f-8591cbabacba tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.054s {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:28 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-629833ea-7ec8-42b2-854f-8591cbabacba tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:28 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-629833ea-7ec8-42b2-854f-8591cbabacba tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:28 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-5f3de4a0-1a2e-454b-9dcc-3cb21895d972 tempest-ResourceLockCRUTest-1971036144 tempest-ResourceLockCRUTest-1971036144-project-member] GET http://10.27.203.238/share/v2/82840ccb77144a4aa2d0bdce807ce686/shares/071c2e61-b4b6-48bf-a1f2-c20b233560ed May 28 12:58:28 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-5f3de4a0-1a2e-454b-9dcc-3cb21895d972 tempest-ResourceLockCRUTest-1971036144 tempest-ResourceLockCRUTest-1971036144-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:28 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-5f3de4a0-1a2e-454b-9dcc-3cb21895d972 tempest-ResourceLockCRUTest-1971036144 tempest-ResourceLockCRUTest-1971036144-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:28 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-629833ea-7ec8-42b2-854f-8591cbabacba tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.059s {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:28 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-629833ea-7ec8-42b2-854f-8591cbabacba tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] http://10.27.203.238/share/v1/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action returned with HTTP 202 May 28 12:58:28 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 536/1071] 10.27.203.238 () {64 vars in 1450 bytes} [Tue May 28 12:58:28 2024] POST /share/v1/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action => generated 0 bytes in 193 msecs (HTTP/1.1 202) 6 headers in 242 bytes (1 switches on core 0) May 28 12:58:28 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-6074c5b9-3dfb-42df-a57e-cbaa8b609985 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] GET http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/snapshots/6ddf5f7a-7bad-4eea-9e2e-64307270ec88 May 28 12:58:28 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-6074c5b9-3dfb-42df-a57e-cbaa8b609985 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:28 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-6074c5b9-3dfb-42df-a57e-cbaa8b609985 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Calling method 'ShareSnapshotMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:28 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-5f3de4a0-1a2e-454b-9dcc-3cb21895d972 tempest-ResourceLockCRUTest-1971036144 tempest-ResourceLockCRUTest-1971036144-project-member] http://10.27.203.238/share/v2/82840ccb77144a4aa2d0bdce807ce686/shares/071c2e61-b4b6-48bf-a1f2-c20b233560ed returned with HTTP 200 May 28 12:58:28 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 536/1072] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:58:28 2024] GET /share/v2/82840ccb77144a4aa2d0bdce807ce686/shares/071c2e61-b4b6-48bf-a1f2-c20b233560ed => generated 1318 bytes in 26 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:58:28 l75lg1-v1 dstat.sh[49771]: 28-05 12:58:28| 11 1 85 2 0|5720M 1762M 277M 7866M| 27k 4335B| 256k 1560k|2.00 214 |4880 7624 |1.42 1.10 1.02|4.0 2.0 9.0| 0 0 | 0 2048M| 29 360 0 36 0 May 28 12:58:28 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-4e3d607a-a68e-4aa6-9caf-36bc71392a84 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] POST http://10.27.203.238/share/v1/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action May 28 12:58:28 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-4e3d607a-a68e-4aa6-9caf-36bc71392a84 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Action body: b'{"os-access_list": null}' {{(pid=98329) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:58:28 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-4e3d607a-a68e-4aa6-9caf-36bc71392a84 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Action: 'action', calling method: ShareController.access_list, body: {"os-access_list": null} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:58:28 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-6074c5b9-3dfb-42df-a57e-cbaa8b609985 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] HTTP exception thrown: The resource could not be found. May 28 12:58:28 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-6074c5b9-3dfb-42df-a57e-cbaa8b609985 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/snapshots/6ddf5f7a-7bad-4eea-9e2e-64307270ec88 returned with HTTP 404 May 28 12:58:28 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 537/1073] 10.27.203.238 () {64 vars in 1460 bytes} [Tue May 28 12:58:28 2024] GET /share/v2/a3499cb78849424db45e54caac01de92/snapshots/6ddf5f7a-7bad-4eea-9e2e-64307270ec88 => generated 78 bytes in 19 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 12:58:28 l75lg1-v1 manila-share[98474]: DEBUG manila.share.manager [None req-629833ea-7ec8-42b2-854f-8591cbabacba tempest-ShareIpRulesForNFSTest-1748669711 None] Received request to update access for share instance b7a7d61c-2cea-442a-9809-507038e080d5. {{(pid=98474) update_access_for_instances /opt/stack/manila/manila/share/manager.py:4353}} May 28 12:58:28 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-ec0d6050-76b0-4308-a707-fd80874b2fc4 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] DELETE http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/snapshots/61a994a9-64ae-4c8f-9475-6c6a0b8e910b May 28 12:58:28 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-ec0d6050-76b0-4308-a707-fd80874b2fc4 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:28 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-ec0d6050-76b0-4308-a707-fd80874b2fc4 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Calling method 'ShareSnapshotMixin.delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:28 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.v1.share_snapshots [None req-ec0d6050-76b0-4308-a707-fd80874b2fc4 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Delete snapshot with id: 61a994a9-64ae-4c8f-9475-6c6a0b8e910b May 28 12:58:28 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-629833ea-7ec8-42b2-854f-8591cbabacba tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:28 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-629833ea-7ec8-42b2-854f-8591cbabacba tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:28 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-629833ea-7ec8-42b2-854f-8591cbabacba tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.004s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:28 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-629833ea-7ec8-42b2-854f-8591cbabacba tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:28 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-629833ea-7ec8-42b2-854f-8591cbabacba tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:28 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-4e3d607a-a68e-4aa6-9caf-36bc71392a84 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] http://10.27.203.238/share/v1/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action returned with HTTP 200 May 28 12:58:28 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 537/1074] 10.27.203.238 () {64 vars in 1450 bytes} [Tue May 28 12:58:28 2024] POST /share/v1/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action => generated 154 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:58:28 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-629833ea-7ec8-42b2-854f-8591cbabacba tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.056s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:28 l75lg1-v1 manila-share[98474]: DEBUG manila.share.access [None req-629833ea-7ec8-42b2-854f-8591cbabacba tempest-ShareIpRulesForNFSTest-1748669711 None] Updating access rules for share instance b7a7d61c-2cea-442a-9809-507038e080d5 belonging to share 1ddadc17-cf10-4a42-8bbd-8335fb3520a1. {{(pid=98474) update_access_rules /opt/stack/manila/manila/share/access.py:298}} May 28 12:58:28 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-629833ea-7ec8-42b2-854f-8591cbabacba tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:28 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-629833ea-7ec8-42b2-854f-8591cbabacba tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:28 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-ec0d6050-76b0-4308-a707-fd80874b2fc4 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/snapshots/61a994a9-64ae-4c8f-9475-6c6a0b8e910b returned with HTTP 202 May 28 12:58:28 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 538/1075] 10.27.203.238 () {64 vars in 1463 bytes} [Tue May 28 12:58:28 2024] DELETE /share/v2/a3499cb78849424db45e54caac01de92/snapshots/61a994a9-64ae-4c8f-9475-6c6a0b8e910b => generated 0 bytes in 111 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:58:28 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-c6618d10-b525-41e3-84f2-458e63cb6131 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] GET http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/snapshots/61a994a9-64ae-4c8f-9475-6c6a0b8e910b May 28 12:58:28 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-c6618d10-b525-41e3-84f2-458e63cb6131 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:28 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-c6618d10-b525-41e3-84f2-458e63cb6131 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Calling method 'ShareSnapshotMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:28 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-629833ea-7ec8-42b2-854f-8591cbabacba tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.016s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:28 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-629833ea-7ec8-42b2-854f-8591cbabacba tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:28 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-629833ea-7ec8-42b2-854f-8591cbabacba tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:28 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-c6618d10-b525-41e3-84f2-458e63cb6131 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/snapshots/61a994a9-64ae-4c8f-9475-6c6a0b8e910b returned with HTTP 200 May 28 12:58:28 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 538/1076] 10.27.203.238 () {64 vars in 1460 bytes} [Tue May 28 12:58:28 2024] GET /share/v2/a3499cb78849424db45e54caac01de92/snapshots/61a994a9-64ae-4c8f-9475-6c6a0b8e910b => generated 750 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:58:28 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-629833ea-7ec8-42b2-854f-8591cbabacba tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.030s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:28 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-629833ea-7ec8-42b2-854f-8591cbabacba tempest-ShareIpRulesForNFSTest-1748669711 None] changing access on None May 28 12:58:28 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-629833ea-7ec8-42b2-854f-8591cbabacba tempest-ShareIpRulesForNFSTest-1748669711 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:58:28 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-629833ea-7ec8-42b2-854f-8591cbabacba tempest-ShareIpRulesForNFSTest-1748669711 None] {'allow_redirects': True, May 28 12:58:28 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-629833ea-7ec8-42b2-854f-8591cbabacba tempest-ShareIpRulesForNFSTest-1748669711 None] 'params': {'name': 'b7a7d61c-2cea-442a-9809-507038e080d5'}} May 28 12:58:28 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ec0d6050-76b0-4308-a707-fd80874b2fc4 tempest-AdminActionsTest-1749172189 None] >>> [GET] https://127.0.0.1:40443/api/snapshots/ May 28 12:58:28 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ec0d6050-76b0-4308-a707-fd80874b2fc4 tempest-AdminActionsTest-1749172189 None] {'allow_redirects': True, May 28 12:58:28 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ec0d6050-76b0-4308-a707-fd80874b2fc4 tempest-AdminActionsTest-1749172189 None] 'params': {'name': 'share-snapshot-a36d2987-19ac-4366-b5bb-199a72efcb95'}} May 28 12:58:28 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e663225b-6477-401f-b391-71804dbaf246 tempest-ResourceLockCRUTest-1971036144 None] <<< [GET] https://127.0.0.1:40443/api/quotas/ May 28 12:58:28 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e663225b-6477-401f-b391-71804dbaf246 tempest-ResourceLockCRUTest-1971036144 None] [Bunch(cluster='loop75-kfs', cluster_id=1, default_email=None, default_group_quota=None, default_user_quota=None, enable_alarms=True, enable_email_providers=True, grace_period=None, guid='81084535-f7fd-4368-8fe6-02a5aca74187', hard_limit=1073741824, hard_limit_inodes=None, id=23, internal=False, is_user_quota=False, last_user_quotas_update=None, name='5de0f734-b2f4-4d05-8249-81f9d2973a8a', num_blocked_users=0, num_exceeded_users=0, path='/manila/manila-5de0f734-b2f4-4d05-8249-81f9d2973a8a', percent_capacity=0, percent_inodes=None, pretty_grace_period=None, pretty_grace_period_expiration=None, pretty_state='OK (Calculating)', soft_limit=None, soft_limit_inodes=None, state='OK', sync_state='Calculating', system_id=23, tenant_id=1, tenant_name='default', time_to_block=None, title='5de0f734-b2f4-4d05-8249-81f9d2973a8a', url='https://127.0.0.1:40443/api/quotas/23/', used_capacity=0, used_capacity_tb=0.0, used_effective_capacity=0, used_effective_capacity_tb=0.0, used_inodes=0, used_limited_capacity=0)] May 28 12:58:28 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e663225b-6477-401f-b391-71804dbaf246 tempest-ResourceLockCRUTest-1971036144 None] --- [GET] https://127.0.0.1:40443/api/quotas/: Done May 28 12:58:28 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e663225b-6477-401f-b391-71804dbaf246 tempest-ResourceLockCRUTest-1971036144 None] >>> [DELETE] https://127.0.0.1:40443/api/quotas/23/ May 28 12:58:28 l75lg1-v1 neutron-server[77619]: DEBUG dbcounter [-] [77619] Writing DB stats neutron:SELECT=3 {{(pid=77619) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:58:28 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-629833ea-7ec8-42b2-854f-8591cbabacba tempest-ShareIpRulesForNFSTest-1748669711 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:58:28 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-629833ea-7ec8-42b2-854f-8591cbabacba tempest-ShareIpRulesForNFSTest-1748669711 None] [Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=1, created='2024-05-28T12:57:40.763635Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='377955ad-d094-4e49-ab32-1021d943a572', id=21, internal=False, is_s3_default_policy=False, name='b7a7d61c-2cea-442a-9809-507038e080d5', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=['*'], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['203.0.113.130'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['203.0.113.130'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T12:58:27.351644Z', tenant_id=1, tenant_name='default', title='b7a7d61c-2cea-442a-9809-507038e080d5', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/21/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[])] May 28 12:58:28 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-629833ea-7ec8-42b2-854f-8591cbabacba tempest-ShareIpRulesForNFSTest-1748669711 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 12:58:28 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-629833ea-7ec8-42b2-854f-8591cbabacba tempest-ShareIpRulesForNFSTest-1748669711 None] changing access on /manila/manila-b7a7d61c-2cea-442a-9809-507038e080d5. Rules: {'nfs_read_write': [], 'nfs_read_only': []} May 28 12:58:28 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-629833ea-7ec8-42b2-854f-8591cbabacba tempest-ShareIpRulesForNFSTest-1748669711 None] >>> [PATCH] https://127.0.0.1:40443/api/viewpolicies/21/ May 28 12:58:28 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-629833ea-7ec8-42b2-854f-8591cbabacba tempest-ShareIpRulesForNFSTest-1748669711 None] {'data': '{"name": "b7a7d61c-2cea-442a-9809-507038e080d5", "nfs_no_squash": ' May 28 12:58:28 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-629833ea-7ec8-42b2-854f-8591cbabacba tempest-ShareIpRulesForNFSTest-1748669711 None] '["*"], "nfs_root_squash": ["*"], "nfs_read_write": [], ' May 28 12:58:28 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-629833ea-7ec8-42b2-854f-8591cbabacba tempest-ShareIpRulesForNFSTest-1748669711 None] '"nfs_read_only": []}', May 28 12:58:28 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-629833ea-7ec8-42b2-854f-8591cbabacba tempest-ShareIpRulesForNFSTest-1748669711 None] 'params': None} May 28 12:58:28 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ec0d6050-76b0-4308-a707-fd80874b2fc4 tempest-AdminActionsTest-1749172189 None] <<< [GET] https://127.0.0.1:40443/api/snapshots/ May 28 12:58:28 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ec0d6050-76b0-4308-a707-fd80874b2fc4 tempest-AdminActionsTest-1749172189 None] [Bunch(access_path='/.vast_all_snapshots/1000000008_share-snapshot-a36d2987-19ac-4366-b5bb-199a72efcb95', aggr_phys_estimation=0, cluster='loop75-kfs', created='2024-05-28T12:58:08.917970Z', eta_sec=30819898889.234253, expiration_time='3001-01-19T07:59:58Z', guid='faa3f846-60a6-46a0-89e1-a77729118953', id=9, indestructible=False, locked=False, name='share-snapshot-a36d2987-19ac-4366-b5bb-199a72efcb95', path='/manila/manila-77a25e6b-f137-4342-8eb9-9ced679515e2/', policy=None, policy_id=None, protection_policy_id=None, state='SUCCEED', tenant_id=1, tenant_name='default', title='share-snapshot-a36d2987-19ac-4366-b5bb-199a72efcb95(/manila/manila-77a25e6b-f137-4342-8eb9-9ced679515e2/)', type='local', unique_phys_estimation=0, url='https://127.0.0.1:40443/api/snapshots/9/')] May 28 12:58:28 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ec0d6050-76b0-4308-a707-fd80874b2fc4 tempest-AdminActionsTest-1749172189 None] --- [GET] https://127.0.0.1:40443/api/snapshots/: Done May 28 12:58:28 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ec0d6050-76b0-4308-a707-fd80874b2fc4 tempest-AdminActionsTest-1749172189 None] >>> [DELETE] https://127.0.0.1:40443/api/snapshots/9/ May 28 12:58:29 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-baa0060d-0a33-4293-9dac-8ca198bdb06c tempest-PublicSharesTest-1667420263 None] <<< [POST] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:58:29 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-baa0060d-0a33-4293-9dac-8ca198bdb06c tempest-PublicSharesTest-1667420263 None] Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=0, created='2024-05-28T12:58:28.648763Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='9b4c7f7d-304f-4222-91cc-49a9b726b89e', id=30, internal=False, is_s3_default_policy=False, name='58febd66-6690-481d-866e-2c57d2f22405', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=[], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['*'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['*'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T12:58:28.967341Z', tenant_id=1, tenant_name='default', title='58febd66-6690-481d-866e-2c57d2f22405', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/30/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[]) May 28 12:58:29 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-baa0060d-0a33-4293-9dac-8ca198bdb06c tempest-PublicSharesTest-1667420263 None] --- [POST] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 12:58:29 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-baa0060d-0a33-4293-9dac-8ca198bdb06c tempest-PublicSharesTest-1667420263 None] >>> [GET] https://127.0.0.1:40443/api/quotas/ May 28 12:58:29 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-baa0060d-0a33-4293-9dac-8ca198bdb06c tempest-PublicSharesTest-1667420263 None] {'allow_redirects': True, May 28 12:58:29 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-baa0060d-0a33-4293-9dac-8ca198bdb06c tempest-PublicSharesTest-1667420263 None] 'params': {'name': '58febd66-6690-481d-866e-2c57d2f22405'}} May 28 12:58:29 l75lg1-v1 dstat.sh[49771]: 28-05 12:58:29| 5 1 93 1 0|5720M 1761M 277M 7866M| 28k 4391B| 0 932k| 0 87.0 |3140 4827 |1.42 1.10 1.02|2.0 2.0 0| 0 0 | 0 2048M| 29 357 0 35 0 May 28 12:58:29 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-baa0060d-0a33-4293-9dac-8ca198bdb06c tempest-PublicSharesTest-1667420263 None] <<< [GET] https://127.0.0.1:40443/api/quotas/ May 28 12:58:29 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-baa0060d-0a33-4293-9dac-8ca198bdb06c tempest-PublicSharesTest-1667420263 None] [] May 28 12:58:29 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-baa0060d-0a33-4293-9dac-8ca198bdb06c tempest-PublicSharesTest-1667420263 None] --- [GET] https://127.0.0.1:40443/api/quotas/: Done May 28 12:58:29 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-baa0060d-0a33-4293-9dac-8ca198bdb06c tempest-PublicSharesTest-1667420263 None] >>> [POST] https://127.0.0.1:40443/api/quotas/ May 28 12:58:29 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-baa0060d-0a33-4293-9dac-8ca198bdb06c tempest-PublicSharesTest-1667420263 None] {'data': '{"name": "58febd66-6690-481d-866e-2c57d2f22405", "path": ' May 28 12:58:29 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-baa0060d-0a33-4293-9dac-8ca198bdb06c tempest-PublicSharesTest-1667420263 None] '"/manila/manila-58febd66-6690-481d-866e-2c57d2f22405", "create_dir": ' May 28 12:58:29 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-baa0060d-0a33-4293-9dac-8ca198bdb06c tempest-PublicSharesTest-1667420263 None] 'true, "hard_limit": 1073741824}', May 28 12:58:29 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-baa0060d-0a33-4293-9dac-8ca198bdb06c tempest-PublicSharesTest-1667420263 None] 'json': None, May 28 12:58:29 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-baa0060d-0a33-4293-9dac-8ca198bdb06c tempest-PublicSharesTest-1667420263 None] 'params': None} May 28 12:58:29 l75lg1-v1 neutron-server[77619]: DEBUG dbcounter [-] [77619] Writing DB stats neutron:SELECT=2 {{(pid=77619) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:58:29 l75lg1-v1 nova-conductor[83647]: DEBUG dbcounter [-] [83647] Writing DB stats nova_cell1:SELECT=1 {{(pid=83647) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:58:29 l75lg1-v1 nova-conductor[83647]: DEBUG dbcounter [-] [83647] Writing DB stats nova_cell1:SELECT=1,nova_cell1:UPDATE=2 {{(pid=83647) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:58:29 l75lg1-v1 nova-conductor[83648]: DEBUG dbcounter [-] [83648] Writing DB stats nova_cell1:SELECT=1 {{(pid=83648) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:58:30 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-baa0060d-0a33-4293-9dac-8ca198bdb06c tempest-PublicSharesTest-1667420263 None] <<< [POST] https://127.0.0.1:40443/api/quotas/ May 28 12:58:30 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-baa0060d-0a33-4293-9dac-8ca198bdb06c tempest-PublicSharesTest-1667420263 None] Bunch(cluster='loop75-kfs', cluster_id=1, default_email=None, default_group_quota=None, default_user_quota=None, enable_alarms=True, enable_email_providers=True, grace_period=None, group_quotas=[], guid='dd45a8e2-8a2e-4e2d-9e07-008f631d9e48', hard_limit=1073741824, hard_limit_inodes=None, id=27, internal=False, is_user_quota=False, last_user_quotas_update=None, name='58febd66-6690-481d-866e-2c57d2f22405', num_blocked_users=0, num_exceeded_users=0, path='/manila/manila-58febd66-6690-481d-866e-2c57d2f22405', percent_capacity=0, percent_inodes=None, pretty_grace_period=None, pretty_grace_period_expiration=None, pretty_state='OK (CREATED)', soft_limit=None, soft_limit_inodes=None, state='OK', sync_state='CREATED', system_id=27, tenant_id=1, tenant_name='default', time_to_block=None, title='58febd66-6690-481d-866e-2c57d2f22405', url='https://127.0.0.1:40443/api/quotas/27/', used_capacity=0, used_capacity_tb=0.0, used_effective_capacity=0, used_effective_capacity_tb=0.0, used_inodes=0, used_limited_capacity=0, user_quotas=[]) May 28 12:58:30 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-baa0060d-0a33-4293-9dac-8ca198bdb06c tempest-PublicSharesTest-1667420263 None] --- [POST] https://127.0.0.1:40443/api/quotas/: Done May 28 12:58:30 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-baa0060d-0a33-4293-9dac-8ca198bdb06c tempest-PublicSharesTest-1667420263 None] >>> [GET] https://127.0.0.1:40443/api/views/ May 28 12:58:30 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-baa0060d-0a33-4293-9dac-8ca198bdb06c tempest-PublicSharesTest-1667420263 None] {'allow_redirects': True, May 28 12:58:30 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-baa0060d-0a33-4293-9dac-8ca198bdb06c tempest-PublicSharesTest-1667420263 None] 'params': {'name': '58febd66-6690-481d-866e-2c57d2f22405'}} May 28 12:58:30 l75lg1-v1 dstat.sh[49771]: 28-05 12:58:30| 1 0 98 1 0|5720M 1761M 277M 7866M| 21k 1668B| 0 624k| 0 63.0 |2034 3189 |1.42 1.10 1.02|1.0 2.0 0| 0 0 | 0 2048M| 29 357 0 35 0 May 28 12:58:30 l75lg1-v1 neutron-server[77618]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.HashRingHealthCheckPeriodics.touch_hash_ring_nodes' {{(pid=77618) _process_scheduled /opt/stack/data/venv/lib/python3.10/site-packages/futurist/periodics.py:638}} May 28 12:58:30 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-70a29fc0-a1d3-4165-b687-b76dd2968c00 tempest-PublicSharesTest-1667420263 tempest-PublicSharesTest-1667420263-project-member] GET http://10.27.203.238/share/v2/6d36e1eb1dbc449db6aca75b12a2ba18/shares/50dc60c2-08d1-4244-b4aa-f09b7789e32d May 28 12:58:30 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-70a29fc0-a1d3-4165-b687-b76dd2968c00 tempest-PublicSharesTest-1667420263 tempest-PublicSharesTest-1667420263-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:30 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-70a29fc0-a1d3-4165-b687-b76dd2968c00 tempest-PublicSharesTest-1667420263 tempest-PublicSharesTest-1667420263-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:30 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ec0d6050-76b0-4308-a707-fd80874b2fc4 tempest-AdminActionsTest-1749172189 None] <<< [DELETE] https://127.0.0.1:40443/api/snapshots/9/ May 28 12:58:30 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ec0d6050-76b0-4308-a707-fd80874b2fc4 tempest-AdminActionsTest-1749172189 None] --- [DELETE] https://127.0.0.1:40443/api/snapshots/9/: Done May 28 12:58:30 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-70a29fc0-a1d3-4165-b687-b76dd2968c00 tempest-PublicSharesTest-1667420263 tempest-PublicSharesTest-1667420263-project-member] http://10.27.203.238/share/v2/6d36e1eb1dbc449db6aca75b12a2ba18/shares/50dc60c2-08d1-4244-b4aa-f09b7789e32d returned with HTTP 200 May 28 12:58:30 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 539/1077] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:58:30 2024] GET /share/v2/6d36e1eb1dbc449db6aca75b12a2ba18/shares/50dc60c2-08d1-4244-b4aa-f09b7789e32d => generated 1313 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:58:30 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-ec0d6050-76b0-4308-a707-fd80874b2fc4 tempest-AdminActionsTest-1749172189 None] Created reservations ['0f3fb00c-8714-4a24-99e9-caceabde39bf', 'c4093a2f-5808-4619-af0f-cbee1c39ca08', 'de78c6c2-8965-453e-86ab-cc3aea7c1521', 'd0f866c5-3de0-49e1-ad8e-9ebbed459ce9'] {{(pid=98474) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 12:58:30 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-ec0d6050-76b0-4308-a707-fd80874b2fc4 tempest-AdminActionsTest-1749172189 None] Committed reservations ['0f3fb00c-8714-4a24-99e9-caceabde39bf', 'c4093a2f-5808-4619-af0f-cbee1c39ca08', 'de78c6c2-8965-453e-86ab-cc3aea7c1521', 'd0f866c5-3de0-49e1-ad8e-9ebbed459ce9'] {{(pid=98474) commit /opt/stack/manila/manila/quota.py:1063}} May 28 12:58:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG dbcounter [-] [51266] Writing DB stats keystone:SELECT=1656,keystone:DELETE=190,keystone:INSERT=99 {{(pid=51266) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:58:30 l75lg1-v1 neutron-server[77622]: DEBUG futurist.periodics [None req-fbd03350-93f0-48b6-99af-923b4570b093 None None] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_for_inconsistencies' {{(pid=77622) _process_scheduled /opt/stack/data/venv/lib/python3.10/site-packages/futurist/periodics.py:638}} May 28 12:58:30 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-629833ea-7ec8-42b2-854f-8591cbabacba tempest-ShareIpRulesForNFSTest-1748669711 None] <<< [PATCH] https://127.0.0.1:40443/api/viewpolicies/21/ May 28 12:58:30 l75lg1-v1 neutron-server[77622]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-fbd03350-93f0-48b6-99af-923b4570b093 None None] Maintenance task: Synchronizing Neutron and OVN databases started {{(pid=77622) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:340}} May 28 12:58:30 l75lg1-v1 neutron-server[77622]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-fbd03350-93f0-48b6-99af-923b4570b093 None None] Maintenance task: Number of inconsistencies found at create/update: networks=2 {{(pid=77622) _log /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:321}} May 28 12:58:30 l75lg1-v1 neutron-server[77622]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-fbd03350-93f0-48b6-99af-923b4570b093 None None] Maintenance task: Fixing resource a709f3ff-68d5-435a-bc2b-36acb8ce95d4 (type: networks) at create/update {{(pid=77622) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:350}} May 28 12:58:30 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-629833ea-7ec8-42b2-854f-8591cbabacba tempest-ShareIpRulesForNFSTest-1748669711 None] Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=1, created='2024-05-28T12:57:40.763635Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='377955ad-d094-4e49-ab32-1021d943a572', id=21, internal=False, is_s3_default_policy=False, name='b7a7d61c-2cea-442a-9809-507038e080d5', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=['*'], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=[], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=[], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='MODIFYING', sync_time='2024-05-28T12:58:30.012662Z', tenant_id=1, tenant_name='default', title='b7a7d61c-2cea-442a-9809-507038e080d5', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/21/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[]) May 28 12:58:30 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-629833ea-7ec8-42b2-854f-8591cbabacba tempest-ShareIpRulesForNFSTest-1748669711 None] --- [PATCH] https://127.0.0.1:40443/api/viewpolicies/21/: Done May 28 12:58:30 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-629833ea-7ec8-42b2-854f-8591cbabacba tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:30 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-629833ea-7ec8-42b2-854f-8591cbabacba tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:30 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-629833ea-7ec8-42b2-854f-8591cbabacba tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.030s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:30 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-629833ea-7ec8-42b2-854f-8591cbabacba tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:30 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-629833ea-7ec8-42b2-854f-8591cbabacba tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:30 l75lg1-v1 neutron-server[77622]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-a709f3ff-68d5-435a-bc2b-36acb8ce95d4, resource={'id': 'a709f3ff-68d5-435a-bc2b-36acb8ce95d4', 'name': 'shared', 'tenant_id': 'ea8d517cde1d40bb82c97e080ce071f7', 'admin_state_up': True, 'mtu': 1442, 'status': 'ACTIVE', 'subnets': ['e4fad118-aaed-4b8f-af24-7f60741ecf53'], 'standard_attr_id': 42, 'shared': True, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'vlan_transparent': None, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2024-05-28T12:53:48Z', 'updated_at': '2024-05-28T12:53:50Z', 'revision_number': 2, 'project_id': 'ea8d517cde1d40bb82c97e080ce071f7', 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 39669}, resource_type=networks, if_exists=True) {{(pid=77622) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:58:30 l75lg1-v1 neutron-server[77622]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Logical_Switch, record=neutron-a709f3ff-68d5-435a-bc2b-36acb8ce95d4, col_values=(('external_ids', {'neutron:network_name': 'shared', 'neutron:mtu': '1442', 'neutron:revision_number': '2', 'neutron:availability_zone_hints': '', 'neutron:provnet-network-type': 'geneve'}), ('other_config', {'mcast_snoop': 'false', 'mcast_flood_unregistered': 'false', 'vlan-passthru': 'false'})), if_exists=True) {{(pid=77622) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:58:30 l75lg1-v1 neutron-server[77622]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLSwitchPortCommand(_result=None, lport=provnet-6d6f6abd-d338-4b73-9dee-7ce52718541b, external_ids_update=None, columns={'tag': 39669}, if_exists=True) {{(pid=77622) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:58:30 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-629833ea-7ec8-42b2-854f-8591cbabacba tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.027s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:30 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-629833ea-7ec8-42b2-854f-8591cbabacba tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:30 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-629833ea-7ec8-42b2-854f-8591cbabacba tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:30 l75lg1-v1 neutron-server[77619]: DEBUG neutron.common.ovn.hash_ring_manager [None req-53cecb61-7023-41e4-a5ea-23b1eb02606a None None] Hash Ring loaded. 2 active nodes. 0 offline nodes {{(pid=77619) _load_hash_ring /opt/stack/neutron/neutron/common/ovn/hash_ring_manager.py:99}} May 28 12:58:30 l75lg1-v1 neutron-server[77618]: DEBUG neutron.common.ovn.hash_ring_manager [None req-c63b1acc-b5c6-4be8-9db9-04824fec27f2 None None] Hash Ring loaded. 2 active nodes. 0 offline nodes {{(pid=77618) _load_hash_ring /opt/stack/neutron/neutron/common/ovn/hash_ring_manager.py:99}} May 28 12:58:30 l75lg1-v1 neutron-server[77621]: DEBUG neutron.common.ovn.hash_ring_manager [-] Hash Ring loaded. 2 active nodes. 0 offline nodes {{(pid=77621) _load_hash_ring /opt/stack/neutron/neutron/common/ovn/hash_ring_manager.py:99}} May 28 12:58:30 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-baa0060d-0a33-4293-9dac-8ca198bdb06c tempest-PublicSharesTest-1667420263 None] <<< [GET] https://127.0.0.1:40443/api/views/ May 28 12:58:30 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-baa0060d-0a33-4293-9dac-8ca198bdb06c tempest-PublicSharesTest-1667420263 None] [] May 28 12:58:30 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-baa0060d-0a33-4293-9dac-8ca198bdb06c tempest-PublicSharesTest-1667420263 None] --- [GET] https://127.0.0.1:40443/api/views/: Done May 28 12:58:30 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-baa0060d-0a33-4293-9dac-8ca198bdb06c tempest-PublicSharesTest-1667420263 None] >>> [POST] https://127.0.0.1:40443/api/views/ May 28 12:58:30 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-baa0060d-0a33-4293-9dac-8ca198bdb06c tempest-PublicSharesTest-1667420263 None] {'data': '{"name": "58febd66-6690-481d-866e-2c57d2f22405", "path": ' May 28 12:58:30 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-baa0060d-0a33-4293-9dac-8ca198bdb06c tempest-PublicSharesTest-1667420263 None] '"/manila/manila-58febd66-6690-481d-866e-2c57d2f22405", "policy_id": ' May 28 12:58:30 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-baa0060d-0a33-4293-9dac-8ca198bdb06c tempest-PublicSharesTest-1667420263 None] '30, "create_dir": true, "protocols": ["NFS"]}', May 28 12:58:30 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-baa0060d-0a33-4293-9dac-8ca198bdb06c tempest-PublicSharesTest-1667420263 None] 'json': None, May 28 12:58:30 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-baa0060d-0a33-4293-9dac-8ca198bdb06c tempest-PublicSharesTest-1667420263 None] 'params': None} May 28 12:58:30 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-629833ea-7ec8-42b2-854f-8591cbabacba tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.011s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:30 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-629833ea-7ec8-42b2-854f-8591cbabacba tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:30 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-629833ea-7ec8-42b2-854f-8591cbabacba tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:30 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-629833ea-7ec8-42b2-854f-8591cbabacba tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.004s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:30 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-53cecb61-7023-41e4-a5ea-23b1eb02606a None None] Hash Ring: Node c89b3497-133e-4a5a-b67a-3310d2cb2485 (host: l75lg1-v1) handling event "update" for row 4bac71c1-337b-4851-b33f-9c363a194860 (table: Logical_Switch) {{(pid=77619) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:58:30 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-629833ea-7ec8-42b2-854f-8591cbabacba tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:30 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-629833ea-7ec8-42b2-854f-8591cbabacba tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:30 l75lg1-v1 neutron-server[77622]: INFO neutron.db.ovn_revision_numbers_db [None req-fbd03350-93f0-48b6-99af-923b4570b093 None None] Successfully bumped revision number for resource a709f3ff-68d5-435a-bc2b-36acb8ce95d4 (type: networks) to 2 May 28 12:58:30 l75lg1-v1 neutron-server[77622]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-fbd03350-93f0-48b6-99af-923b4570b093 None None] Maintenance task: Fixing resource 9aaf4bd9-9f34-40ad-a4e7-932bff23895a (type: networks) at create/update {{(pid=77622) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:350}} May 28 12:58:30 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-629833ea-7ec8-42b2-854f-8591cbabacba tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.043s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:30 l75lg1-v1 manila-share[98474]: INFO manila.share.access [None req-629833ea-7ec8-42b2-854f-8591cbabacba tempest-ShareIpRulesForNFSTest-1748669711 None] Access rules were successfully modified for share instance b7a7d61c-2cea-442a-9809-507038e080d5 belonging to share 1ddadc17-cf10-4a42-8bbd-8335fb3520a1. May 28 12:58:30 l75lg1-v1 neutron-server[77622]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-9aaf4bd9-9f34-40ad-a4e7-932bff23895a, resource={'id': '9aaf4bd9-9f34-40ad-a4e7-932bff23895a', 'name': 'admin_net', 'tenant_id': '98a6a2dcbf0248d5b353760f7757f713', 'admin_state_up': True, 'mtu': 1442, 'status': 'ACTIVE', 'subnets': ['d5781979-4de3-490b-a4f1-017afe11a304'], 'standard_attr_id': 56, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'vlan_transparent': None, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2024-05-28T12:55:50Z', 'updated_at': '2024-05-28T12:55:56Z', 'revision_number': 2, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 32656}, resource_type=networks, if_exists=True) {{(pid=77622) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:58:30 l75lg1-v1 neutron-server[77622]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Logical_Switch, record=neutron-9aaf4bd9-9f34-40ad-a4e7-932bff23895a, col_values=(('external_ids', {'neutron:network_name': 'admin_net', 'neutron:mtu': '1442', 'neutron:revision_number': '2', 'neutron:availability_zone_hints': '', 'neutron:provnet-network-type': 'geneve'}), ('other_config', {'mcast_snoop': 'false', 'mcast_flood_unregistered': 'false', 'vlan-passthru': 'false'})), if_exists=True) {{(pid=77622) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:58:30 l75lg1-v1 neutron-server[77622]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLSwitchPortCommand(_result=None, lport=provnet-ce8322a7-55e6-4ca6-9e93-5a845a3474f8, external_ids_update=None, columns={'tag': 32656}, if_exists=True) {{(pid=77622) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 28 12:58:30 l75lg1-v1 neutron-server[77619]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-53cecb61-7023-41e4-a5ea-23b1eb02606a None None] Hash Ring: Node c89b3497-133e-4a5a-b67a-3310d2cb2485 (host: l75lg1-v1) handling event "update" for row e86fe565-3ce6-403d-9fe7-8fd8a269888e (table: Logical_Switch) {{(pid=77619) notify /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:839}} May 28 12:58:30 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-b4f5c3a4-0e16-49c7-99da-4b822d064684 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] GET http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/dacdb3b4-4336-45fd-b002-1a5aa6ad9957 May 28 12:58:30 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-b4f5c3a4-0e16-49c7-99da-4b822d064684 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:30 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-b4f5c3a4-0e16-49c7-99da-4b822d064684 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:30 l75lg1-v1 neutron-server[77622]: INFO neutron.db.ovn_revision_numbers_db [None req-fbd03350-93f0-48b6-99af-923b4570b093 None None] Successfully bumped revision number for resource 9aaf4bd9-9f34-40ad-a4e7-932bff23895a (type: networks) to 2 May 28 12:58:30 l75lg1-v1 neutron-server[77622]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-fbd03350-93f0-48b6-99af-923b4570b093 None None] Maintenance task: Synchronization completed (took 0.21 seconds) May 28 12:58:30 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-b4f5c3a4-0e16-49c7-99da-4b822d064684 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/dacdb3b4-4336-45fd-b002-1a5aa6ad9957 returned with HTTP 200 May 28 12:58:30 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 539/1078] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:58:30 2024] GET /share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/dacdb3b4-4336-45fd-b002-1a5aa6ad9957 => generated 1314 bytes in 25 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:58:31 l75lg1-v1 neutron-server[77622]: DEBUG futurist.periodics [None req-fbd03350-93f0-48b6-99af-923b4570b093 None None] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.remove_duplicated_chassis_registers' {{(pid=77622) _process_scheduled /opt/stack/data/venv/lib/python3.10/site-packages/futurist/periodics.py:638}} May 28 12:58:31 l75lg1-v1 dstat.sh[49771]: 28-05 12:58:31| 7 1 91 2 0|5722M 1760M 277M 7866M| 27k 1036B| 0 1696k| 0 217 |4171 6611 |1.42 1.10 1.02|1.0 1.0 0| 0 0 | 0 2048M| 29 357 0 34 0 May 28 12:58:31 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-02d0f3d9-dfc1-4300-9dea-a19ccf4ab9de tempest-ResourceLockCRUTest-1971036144 tempest-ResourceLockCRUTest-1971036144-project-member] GET http://10.27.203.238/share/v2/82840ccb77144a4aa2d0bdce807ce686/shares/071c2e61-b4b6-48bf-a1f2-c20b233560ed May 28 12:58:31 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-02d0f3d9-dfc1-4300-9dea-a19ccf4ab9de tempest-ResourceLockCRUTest-1971036144 tempest-ResourceLockCRUTest-1971036144-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:31 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-02d0f3d9-dfc1-4300-9dea-a19ccf4ab9de tempest-ResourceLockCRUTest-1971036144 tempest-ResourceLockCRUTest-1971036144-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:31 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-02d0f3d9-dfc1-4300-9dea-a19ccf4ab9de tempest-ResourceLockCRUTest-1971036144 tempest-ResourceLockCRUTest-1971036144-project-member] http://10.27.203.238/share/v2/82840ccb77144a4aa2d0bdce807ce686/shares/071c2e61-b4b6-48bf-a1f2-c20b233560ed returned with HTTP 200 May 28 12:58:31 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 540/1079] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:58:31 2024] GET /share/v2/82840ccb77144a4aa2d0bdce807ce686/shares/071c2e61-b4b6-48bf-a1f2-c20b233560ed => generated 1318 bytes in 29 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:58:31 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-091403ca-5530-4970-b627-3247848f1f9b tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] POST http://10.27.203.238/share/v1/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action May 28 12:58:31 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-091403ca-5530-4970-b627-3247848f1f9b tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Action body: b'{"os-access_list": null}' {{(pid=98329) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:58:31 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-091403ca-5530-4970-b627-3247848f1f9b tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Action: 'action', calling method: ShareController.access_list, body: {"os-access_list": null} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:58:31 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-091403ca-5530-4970-b627-3247848f1f9b tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] http://10.27.203.238/share/v1/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action returned with HTTP 200 May 28 12:58:31 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 540/1080] 10.27.203.238 () {64 vars in 1450 bytes} [Tue May 28 12:58:31 2024] POST /share/v1/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action => generated 19 bytes in 27 msecs (HTTP/1.1 200) 6 headers in 229 bytes (1 switches on core 0) May 28 12:58:31 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-662582bd-4d82-4fee-8c1c-8f21c24f2b46 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] POST http://10.27.203.238/share/v1/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action May 28 12:58:31 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-662582bd-4d82-4fee-8c1c-8f21c24f2b46 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Action body: b'{"os-allow_access": {"access_type": "ip", "access_to": "203.0.113.15", "access_level": "rw"}}' {{(pid=98330) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:58:31 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-662582bd-4d82-4fee-8c1c-8f21c24f2b46 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Action: 'action', calling method: ShareController.allow_access, body: {"os-allow_access": {"access_type": "ip", "access_to": "203.0.113.15", "access_level": "rw"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:58:31 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-662582bd-4d82-4fee-8c1c-8f21c24f2b46 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:31 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-662582bd-4d82-4fee-8c1c-8f21c24f2b46 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:31 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-b6a8d064-3f8b-48ed-b705-bcd2f1c9bb80 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] GET http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/snapshots/61a994a9-64ae-4c8f-9475-6c6a0b8e910b May 28 12:58:31 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-b6a8d064-3f8b-48ed-b705-bcd2f1c9bb80 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:31 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-b6a8d064-3f8b-48ed-b705-bcd2f1c9bb80 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Calling method 'ShareSnapshotMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:31 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-b6a8d064-3f8b-48ed-b705-bcd2f1c9bb80 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] HTTP exception thrown: The resource could not be found. May 28 12:58:31 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-b6a8d064-3f8b-48ed-b705-bcd2f1c9bb80 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/snapshots/61a994a9-64ae-4c8f-9475-6c6a0b8e910b returned with HTTP 404 May 28 12:58:31 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 541/1081] 10.27.203.238 () {64 vars in 1460 bytes} [Tue May 28 12:58:31 2024] GET /share/v2/a3499cb78849424db45e54caac01de92/snapshots/61a994a9-64ae-4c8f-9475-6c6a0b8e910b => generated 78 bytes in 14 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 12:58:31 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-aaab4c98-5e24-4cf6-9d7c-22926dcc7409 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] DELETE http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/snapshots/b3972da7-eb1f-4370-abf4-b7f9402afb30 May 28 12:58:31 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-aaab4c98-5e24-4cf6-9d7c-22926dcc7409 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:31 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-aaab4c98-5e24-4cf6-9d7c-22926dcc7409 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Calling method 'ShareSnapshotMixin.delete' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:31 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.v1.share_snapshots [None req-aaab4c98-5e24-4cf6-9d7c-22926dcc7409 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Delete snapshot with id: b3972da7-eb1f-4370-abf4-b7f9402afb30 May 28 12:58:31 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-662582bd-4d82-4fee-8c1c-8f21c24f2b46 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.046s {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:31 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-662582bd-4d82-4fee-8c1c-8f21c24f2b46 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] http://10.27.203.238/share/v1/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action returned with HTTP 200 May 28 12:58:31 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 541/1082] 10.27.203.238 () {64 vars in 1450 bytes} [Tue May 28 12:58:31 2024] POST /share/v1/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action => generated 198 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:58:31 l75lg1-v1 manila-share[98474]: DEBUG manila.share.manager [None req-662582bd-4d82-4fee-8c1c-8f21c24f2b46 tempest-ShareIpRulesForNFSTest-1748669711 None] Received request to update access for share instance b7a7d61c-2cea-442a-9809-507038e080d5. {{(pid=98474) update_access_for_instances /opt/stack/manila/manila/share/manager.py:4353}} May 28 12:58:31 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-cc19b058-4d9f-40d8-8d39-d54b308fdee5 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] POST http://10.27.203.238/share/v1/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action May 28 12:58:31 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-cc19b058-4d9f-40d8-8d39-d54b308fdee5 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Action body: b'{"os-access_list": null}' {{(pid=98330) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:58:31 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-cc19b058-4d9f-40d8-8d39-d54b308fdee5 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Action: 'action', calling method: ShareController.access_list, body: {"os-access_list": null} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:58:31 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-662582bd-4d82-4fee-8c1c-8f21c24f2b46 tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:31 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-662582bd-4d82-4fee-8c1c-8f21c24f2b46 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:31 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-662582bd-4d82-4fee-8c1c-8f21c24f2b46 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.004s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:31 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-662582bd-4d82-4fee-8c1c-8f21c24f2b46 tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:31 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-662582bd-4d82-4fee-8c1c-8f21c24f2b46 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:31 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-cc19b058-4d9f-40d8-8d39-d54b308fdee5 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] http://10.27.203.238/share/v1/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action returned with HTTP 200 May 28 12:58:31 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 542/1083] 10.27.203.238 () {64 vars in 1450 bytes} [Tue May 28 12:58:31 2024] POST /share/v1/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action => generated 153 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:58:31 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-aaab4c98-5e24-4cf6-9d7c-22926dcc7409 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/snapshots/b3972da7-eb1f-4370-abf4-b7f9402afb30 returned with HTTP 202 May 28 12:58:31 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 542/1084] 10.27.203.238 () {64 vars in 1463 bytes} [Tue May 28 12:58:31 2024] DELETE /share/v2/a3499cb78849424db45e54caac01de92/snapshots/b3972da7-eb1f-4370-abf4-b7f9402afb30 => generated 0 bytes in 95 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:58:31 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-42bb70f5-b6c3-40b0-b50b-053528acec55 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] GET http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/snapshots/b3972da7-eb1f-4370-abf4-b7f9402afb30 May 28 12:58:31 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-42bb70f5-b6c3-40b0-b50b-053528acec55 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:31 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-42bb70f5-b6c3-40b0-b50b-053528acec55 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Calling method 'ShareSnapshotMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:31 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-42bb70f5-b6c3-40b0-b50b-053528acec55 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/snapshots/b3972da7-eb1f-4370-abf4-b7f9402afb30 returned with HTTP 200 May 28 12:58:31 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 543/1085] 10.27.203.238 () {64 vars in 1460 bytes} [Tue May 28 12:58:31 2024] GET /share/v2/a3499cb78849424db45e54caac01de92/snapshots/b3972da7-eb1f-4370-abf4-b7f9402afb30 => generated 749 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:58:31 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-baa0060d-0a33-4293-9dac-8ca198bdb06c tempest-PublicSharesTest-1667420263 None] <<< [POST] https://127.0.0.1:40443/api/views/ May 28 12:58:31 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-baa0060d-0a33-4293-9dac-8ca198bdb06c tempest-PublicSharesTest-1667420263 None] Bunch(abac_tags=[], abe_max_depth=None, abe_protocols=[], alias='', allow_anonymous_access=False, allow_s3_anonymous_access=False, auto_commit='0d', bucket='', bucket_creators=[], bucket_creators_groups=[], bucket_owner=None, bulk_permission_update_progress=None, bulk_permission_update_state=None, cluster='loop75-kfs', cluster_id=1, created='2024-05-28T12:58:31.253220Z', enabled=True, files_retention_mode='NONE', guid='ccfdddb8-a574-4640-9527-e09d398a7907', id=29, ignore_oos=False, internal=False, is_remote=False, is_seamless=False, logical_capacity=0, max_retention_period=None, min_retention_period=None, name='58febd66-6690-481d-866e-2c57d2f22405', nfs_interop_flags='BOTH_NFS3_AND_NFS4_INTEROP_DISABLED', path='/manila/manila-58febd66-6690-481d-866e-2c57d2f22405', physical_capacity=0, policy='58febd66-6690-481d-866e-2c57d2f22405', policy_id=30, protocols=['NFS'], qos_policy=None, qos_policy_id=None, s3_locks=False, s3_locks_retention_mode='NONE', s3_locks_retention_period='', s3_object_ownership_rule='ObjectWriter', s3_unverified_lookup=False, s3_versioning=False, select_for_live_monitoring=False, share='', share_acl=Bunch(acl=[], enabled=False), sync='SYNCED', sync_time='2024-05-28T12:58:31.540148Z', tenant_id=1, tenant_name='default', title='/manila/manila-58febd66-6690-481d-866e-2c57d2f22405', url='https://127.0.0.1:40443/api/views/29/') May 28 12:58:31 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-baa0060d-0a33-4293-9dac-8ca198bdb06c tempest-PublicSharesTest-1667420263 None] --- [POST] https://127.0.0.1:40443/api/views/: Done May 28 12:58:31 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-662582bd-4d82-4fee-8c1c-8f21c24f2b46 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.142s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:31 l75lg1-v1 manila-share[98474]: DEBUG manila.share.access [None req-662582bd-4d82-4fee-8c1c-8f21c24f2b46 tempest-ShareIpRulesForNFSTest-1748669711 None] Updating access rules for share instance b7a7d61c-2cea-442a-9809-507038e080d5 belonging to share 1ddadc17-cf10-4a42-8bbd-8335fb3520a1. {{(pid=98474) update_access_rules /opt/stack/manila/manila/share/access.py:298}} May 28 12:58:31 l75lg1-v1 manila-share[98474]: INFO manila.share.manager [None req-baa0060d-0a33-4293-9dac-8ca198bdb06c tempest-PublicSharesTest-1667420263 None] Share instance 58febd66-6690-481d-866e-2c57d2f22405 created successfully. May 28 12:58:31 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-aaab4c98-5e24-4cf6-9d7c-22926dcc7409 tempest-AdminActionsTest-1749172189 None] >>> [GET] https://127.0.0.1:40443/api/snapshots/ May 28 12:58:31 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-aaab4c98-5e24-4cf6-9d7c-22926dcc7409 tempest-AdminActionsTest-1749172189 None] {'allow_redirects': True, May 28 12:58:31 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-aaab4c98-5e24-4cf6-9d7c-22926dcc7409 tempest-AdminActionsTest-1749172189 None] 'params': {'name': 'share-snapshot-be7ae42b-274e-4c6c-9e06-cbf16268cf26'}} May 28 12:58:31 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-662582bd-4d82-4fee-8c1c-8f21c24f2b46 tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:31 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-662582bd-4d82-4fee-8c1c-8f21c24f2b46 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:31 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-662582bd-4d82-4fee-8c1c-8f21c24f2b46 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.007s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:31 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-662582bd-4d82-4fee-8c1c-8f21c24f2b46 tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:31 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-662582bd-4d82-4fee-8c1c-8f21c24f2b46 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:31 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-662582bd-4d82-4fee-8c1c-8f21c24f2b46 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.014s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:31 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-662582bd-4d82-4fee-8c1c-8f21c24f2b46 tempest-ShareIpRulesForNFSTest-1748669711 None] changing access on None May 28 12:58:31 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-662582bd-4d82-4fee-8c1c-8f21c24f2b46 tempest-ShareIpRulesForNFSTest-1748669711 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:58:31 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-662582bd-4d82-4fee-8c1c-8f21c24f2b46 tempest-ShareIpRulesForNFSTest-1748669711 None] {'allow_redirects': True, May 28 12:58:31 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-662582bd-4d82-4fee-8c1c-8f21c24f2b46 tempest-ShareIpRulesForNFSTest-1748669711 None] 'params': {'name': 'b7a7d61c-2cea-442a-9809-507038e080d5'}} May 28 12:58:31 l75lg1-v1 manila-data[98318]: DEBUG dbcounter [-] [98318] Writing DB stats manila:SELECT=30,manila:UPDATE=7 {{(pid=98318) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:58:32 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-aaab4c98-5e24-4cf6-9d7c-22926dcc7409 tempest-AdminActionsTest-1749172189 None] <<< [GET] https://127.0.0.1:40443/api/snapshots/ May 28 12:58:32 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-aaab4c98-5e24-4cf6-9d7c-22926dcc7409 tempest-AdminActionsTest-1749172189 None] [Bunch(access_path='/.vast_all_snapshots/1000000007_share-snapshot-be7ae42b-274e-4c6c-9e06-cbf16268cf26', aggr_phys_estimation=0, cluster='loop75-kfs', created='2024-05-28T12:58:05.291486Z', eta_sec=30819898886.002056, expiration_time='3001-01-19T07:59:58Z', guid='97a609d2-af81-4195-8bf9-945d87717590', id=8, indestructible=False, locked=False, name='share-snapshot-be7ae42b-274e-4c6c-9e06-cbf16268cf26', path='/manila/manila-77a25e6b-f137-4342-8eb9-9ced679515e2/', policy=None, policy_id=None, protection_policy_id=None, state='SUCCEED', tenant_id=1, tenant_name='default', title='share-snapshot-be7ae42b-274e-4c6c-9e06-cbf16268cf26(/manila/manila-77a25e6b-f137-4342-8eb9-9ced679515e2/)', type='local', unique_phys_estimation=0, url='https://127.0.0.1:40443/api/snapshots/8/')] May 28 12:58:32 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-aaab4c98-5e24-4cf6-9d7c-22926dcc7409 tempest-AdminActionsTest-1749172189 None] --- [GET] https://127.0.0.1:40443/api/snapshots/: Done May 28 12:58:32 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-aaab4c98-5e24-4cf6-9d7c-22926dcc7409 tempest-AdminActionsTest-1749172189 None] >>> [DELETE] https://127.0.0.1:40443/api/snapshots/8/ May 28 12:58:32 l75lg1-v1 dstat.sh[49771]: 28-05 12:58:32| 8 1 89 1 0|5722M 1759M 277M 7866M| 25k 4645B| 0 1608k| 0 205 |4655 7473 |1.30 1.08 1.02|1.0 1.0 0| 0 0 | 0 2048M| 29 357 0 34 0 May 28 12:58:32 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b955836e-3bcf-4f6f-a7c4-571eaa76539d tempest-SharesMetadataTest-1561320255 None] <<< [DELETE] https://127.0.0.1:40443/api/quotas/25/ May 28 12:58:32 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b955836e-3bcf-4f6f-a7c4-571eaa76539d tempest-SharesMetadataTest-1561320255 None] --- [DELETE] https://127.0.0.1:40443/api/quotas/25/: Done May 28 12:58:32 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b955836e-3bcf-4f6f-a7c4-571eaa76539d tempest-SharesMetadataTest-1561320255 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:58:32 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b955836e-3bcf-4f6f-a7c4-571eaa76539d tempest-SharesMetadataTest-1561320255 None] {'allow_redirects': True, May 28 12:58:32 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b955836e-3bcf-4f6f-a7c4-571eaa76539d tempest-SharesMetadataTest-1561320255 None] 'params': {'name': '8d0c9317-df90-47d1-b406-482ee14c60e8'}} May 28 12:58:32 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-662582bd-4d82-4fee-8c1c-8f21c24f2b46 tempest-ShareIpRulesForNFSTest-1748669711 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:58:32 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-662582bd-4d82-4fee-8c1c-8f21c24f2b46 tempest-ShareIpRulesForNFSTest-1748669711 None] [Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=1, created='2024-05-28T12:57:40.763635Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='377955ad-d094-4e49-ab32-1021d943a572', id=21, internal=False, is_s3_default_policy=False, name='b7a7d61c-2cea-442a-9809-507038e080d5', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=['*'], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=[], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=[], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T12:58:30.644895Z', tenant_id=1, tenant_name='default', title='b7a7d61c-2cea-442a-9809-507038e080d5', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/21/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[])] May 28 12:58:32 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-662582bd-4d82-4fee-8c1c-8f21c24f2b46 tempest-ShareIpRulesForNFSTest-1748669711 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 12:58:32 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-662582bd-4d82-4fee-8c1c-8f21c24f2b46 tempest-ShareIpRulesForNFSTest-1748669711 None] changing access on /manila/manila-b7a7d61c-2cea-442a-9809-507038e080d5. Rules: {'nfs_read_write': ['203.0.113.15'], 'nfs_read_only': []} May 28 12:58:32 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-662582bd-4d82-4fee-8c1c-8f21c24f2b46 tempest-ShareIpRulesForNFSTest-1748669711 None] >>> [PATCH] https://127.0.0.1:40443/api/viewpolicies/21/ May 28 12:58:32 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-662582bd-4d82-4fee-8c1c-8f21c24f2b46 tempest-ShareIpRulesForNFSTest-1748669711 None] {'data': '{"name": "b7a7d61c-2cea-442a-9809-507038e080d5", "nfs_no_squash": ' May 28 12:58:32 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-662582bd-4d82-4fee-8c1c-8f21c24f2b46 tempest-ShareIpRulesForNFSTest-1748669711 None] '["*"], "nfs_root_squash": ["*"], "nfs_read_write": ["203.0.113.15"], ' May 28 12:58:32 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-662582bd-4d82-4fee-8c1c-8f21c24f2b46 tempest-ShareIpRulesForNFSTest-1748669711 None] '"nfs_read_only": []}', May 28 12:58:32 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-662582bd-4d82-4fee-8c1c-8f21c24f2b46 tempest-ShareIpRulesForNFSTest-1748669711 None] 'params': None} May 28 12:58:32 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e663225b-6477-401f-b391-71804dbaf246 tempest-ResourceLockCRUTest-1971036144 None] <<< [DELETE] https://127.0.0.1:40443/api/quotas/23/ May 28 12:58:32 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e663225b-6477-401f-b391-71804dbaf246 tempest-ResourceLockCRUTest-1971036144 None] --- [DELETE] https://127.0.0.1:40443/api/quotas/23/: Done May 28 12:58:32 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e663225b-6477-401f-b391-71804dbaf246 tempest-ResourceLockCRUTest-1971036144 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:58:32 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e663225b-6477-401f-b391-71804dbaf246 tempest-ResourceLockCRUTest-1971036144 None] {'allow_redirects': True, May 28 12:58:32 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e663225b-6477-401f-b391-71804dbaf246 tempest-ResourceLockCRUTest-1971036144 None] 'params': {'name': '5de0f734-b2f4-4d05-8249-81f9d2973a8a'}} May 28 12:58:32 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e663225b-6477-401f-b391-71804dbaf246 tempest-ResourceLockCRUTest-1971036144 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:58:32 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e663225b-6477-401f-b391-71804dbaf246 tempest-ResourceLockCRUTest-1971036144 None] [Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=0, created='2024-05-28T12:58:03.164357Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='6e54f2b7-632e-4b36-8f16-c0a4fa4affd3', id=26, internal=False, is_s3_default_policy=False, name='5de0f734-b2f4-4d05-8249-81f9d2973a8a', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=[], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['*'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['*'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T12:58:03.509472Z', tenant_id=1, tenant_name='default', title='5de0f734-b2f4-4d05-8249-81f9d2973a8a', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/26/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[])] May 28 12:58:32 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e663225b-6477-401f-b391-71804dbaf246 tempest-ResourceLockCRUTest-1971036144 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 12:58:32 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e663225b-6477-401f-b391-71804dbaf246 tempest-ResourceLockCRUTest-1971036144 None] >>> [DELETE] https://127.0.0.1:40443/api/viewpolicies/26/ May 28 12:58:32 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b955836e-3bcf-4f6f-a7c4-571eaa76539d tempest-SharesMetadataTest-1561320255 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:58:32 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b955836e-3bcf-4f6f-a7c4-571eaa76539d tempest-SharesMetadataTest-1561320255 None] [Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=0, created='2024-05-28T12:58:18.947693Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='f783b0c7-2ca2-4d9a-8771-78213ba8eaac', id=28, internal=False, is_s3_default_policy=False, name='8d0c9317-df90-47d1-b406-482ee14c60e8', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=[], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['*'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['*'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T12:58:19.254737Z', tenant_id=1, tenant_name='default', title='8d0c9317-df90-47d1-b406-482ee14c60e8', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/28/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[])] May 28 12:58:32 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b955836e-3bcf-4f6f-a7c4-571eaa76539d tempest-SharesMetadataTest-1561320255 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 12:58:32 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b955836e-3bcf-4f6f-a7c4-571eaa76539d tempest-SharesMetadataTest-1561320255 None] >>> [DELETE] https://127.0.0.1:40443/api/viewpolicies/28/ May 28 12:58:33 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-aaab4c98-5e24-4cf6-9d7c-22926dcc7409 tempest-AdminActionsTest-1749172189 None] <<< [DELETE] https://127.0.0.1:40443/api/snapshots/8/ May 28 12:58:33 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-aaab4c98-5e24-4cf6-9d7c-22926dcc7409 tempest-AdminActionsTest-1749172189 None] --- [DELETE] https://127.0.0.1:40443/api/snapshots/8/: Done May 28 12:58:33 l75lg1-v1 dstat.sh[49771]: 28-05 12:58:33| 2 0 95 3 0|5722M 1759M 277M 7866M| 23k 3778B| 0 4880k| 0 373 |3004 4621 |1.30 1.08 1.02| 0 0 0| 0 0 | 0 2048M| 29 357 0 33 0 May 28 12:58:33 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-aaab4c98-5e24-4cf6-9d7c-22926dcc7409 tempest-AdminActionsTest-1749172189 None] Created reservations ['5fd78d25-2185-44f7-974f-58ebe01efaa9', '5ebd699d-fcae-47cc-bce6-a131a0bb9fc6', '56d2f67c-a773-4717-a6ad-5b6bcd699fc9', '9c486067-7a70-4f9c-91ae-a3c04629c669'] {{(pid=98474) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 12:58:33 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-aaab4c98-5e24-4cf6-9d7c-22926dcc7409 tempest-AdminActionsTest-1749172189 None] Committed reservations ['5fd78d25-2185-44f7-974f-58ebe01efaa9', '5ebd699d-fcae-47cc-bce6-a131a0bb9fc6', '56d2f67c-a773-4717-a6ad-5b6bcd699fc9', '9c486067-7a70-4f9c-91ae-a3c04629c669'] {{(pid=98474) commit /opt/stack/manila/manila/quota.py:1063}} May 28 12:58:33 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-a66e1f8f-e695-4dac-88b9-dc17cab91e6d tempest-PublicSharesTest-1667420263 tempest-PublicSharesTest-1667420263-project-member] GET http://10.27.203.238/share/v2/6d36e1eb1dbc449db6aca75b12a2ba18/shares/50dc60c2-08d1-4244-b4aa-f09b7789e32d May 28 12:58:33 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-a66e1f8f-e695-4dac-88b9-dc17cab91e6d tempest-PublicSharesTest-1667420263 tempest-PublicSharesTest-1667420263-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:33 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-a66e1f8f-e695-4dac-88b9-dc17cab91e6d tempest-PublicSharesTest-1667420263 tempest-PublicSharesTest-1667420263-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:33 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-a66e1f8f-e695-4dac-88b9-dc17cab91e6d tempest-PublicSharesTest-1667420263 tempest-PublicSharesTest-1667420263-project-member] http://10.27.203.238/share/v2/6d36e1eb1dbc449db6aca75b12a2ba18/shares/50dc60c2-08d1-4244-b4aa-f09b7789e32d returned with HTTP 200 May 28 12:58:33 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 543/1086] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:58:33 2024] GET /share/v2/6d36e1eb1dbc449db6aca75b12a2ba18/shares/50dc60c2-08d1-4244-b4aa-f09b7789e32d => generated 1316 bytes in 26 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:58:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6034c1e-1bd4-4501-b33f-af2c4c6be0e0 service manila] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6034c1e-1bd4-4501-b33f-af2c4c6be0e0 service manila] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe589ae-e78e-49af-bb7f-3469fdbb19fb service manila] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f110cf6300f049c897d0aab63218d1e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe589ae-e78e-49af-bb7f-3469fdbb19fb service manila] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe589ae-e78e-49af-bb7f-3469fdbb19fb service manila] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe589ae-e78e-49af-bb7f-3469fdbb19fb service manila] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe589ae-e78e-49af-bb7f-3469fdbb19fb service manila] RBAC: Authorizing `identity:validate_token()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe589ae-e78e-49af-bb7f-3469fdbb19fb service manila] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:33 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1095/2213] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 12:58:33 2024] GET /identity/v3/auth/tokens => generated 3940 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 12:58:33 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-20eb3e2b-df74-4116-a03c-a52cbc04156b tempest-PublicSharesTest-926778698 tempest-PublicSharesTest-926778698-project-member] GET http://10.27.203.238/share/v2/f72e4ec607ca4e899b33f8b656888e37/shares/detail?is_public=True May 28 12:58:33 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-20eb3e2b-df74-4116-a03c-a52cbc04156b tempest-PublicSharesTest-926778698 tempest-PublicSharesTest-926778698-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:33 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-20eb3e2b-df74-4116-a03c-a52cbc04156b tempest-PublicSharesTest-926778698 tempest-PublicSharesTest-926778698-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:33 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.common [None req-20eb3e2b-df74-4116-a03c-a52cbc04156b tempest-PublicSharesTest-926778698 tempest-PublicSharesTest-926778698-project-member] Removing options '' from query {{(pid=98330) remove_invalid_options /opt/stack/manila/manila/api/common.py:441}} May 28 12:58:33 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.share.api [None req-20eb3e2b-df74-4116-a03c-a52cbc04156b tempest-PublicSharesTest-926778698 tempest-PublicSharesTest-926778698-project-member] Searching for shares by: {'is_public': 'True'} {{(pid=98330) _get_all /opt/stack/manila/manila/share/api.py:2235}} May 28 12:58:33 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-20eb3e2b-df74-4116-a03c-a52cbc04156b tempest-PublicSharesTest-926778698 tempest-PublicSharesTest-926778698-project-member] http://10.27.203.238/share/v2/f72e4ec607ca4e899b33f8b656888e37/shares/detail?is_public=True returned with HTTP 200 May 28 12:58:33 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 544/1087] 10.27.203.238 () {64 vars in 1390 bytes} [Tue May 28 12:58:33 2024] GET /share/v2/f72e4ec607ca4e899b33f8b656888e37/shares/detail?is_public=True => generated 1340 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:58:33 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-924e153b-9962-4ec6-98ca-d36869358e56 tempest-PublicSharesTest-1667420263 tempest-PublicSharesTest-1667420263-project-member] GET http://10.27.203.238/share/v2/6d36e1eb1dbc449db6aca75b12a2ba18/share-replicas/detail?share_id=50dc60c2-08d1-4244-b4aa-f09b7789e32d May 28 12:58:33 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-924e153b-9962-4ec6-98ca-d36869358e56 tempest-PublicSharesTest-1667420263 tempest-PublicSharesTest-1667420263-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:33 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-924e153b-9962-4ec6-98ca-d36869358e56 tempest-PublicSharesTest-1667420263 tempest-PublicSharesTest-1667420263-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:33 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-924e153b-9962-4ec6-98ca-d36869358e56 tempest-PublicSharesTest-1667420263 tempest-PublicSharesTest-1667420263-project-member] http://10.27.203.238/share/v2/6d36e1eb1dbc449db6aca75b12a2ba18/share-replicas/detail?share_id=50dc60c2-08d1-4244-b4aa-f09b7789e32d returned with HTTP 200 May 28 12:58:33 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 544/1088] 10.27.203.238 () {64 vars in 1476 bytes} [Tue May 28 12:58:33 2024] GET /share/v2/6d36e1eb1dbc449db6aca75b12a2ba18/share-replicas/detail?share_id=50dc60c2-08d1-4244-b4aa-f09b7789e32d => generated 22 bytes in 13 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:58:33 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-25d6cabe-430a-4a8c-97f9-866a8ed13460 tempest-PublicSharesTest-1667420263 tempest-PublicSharesTest-1667420263-project-member] DELETE http://10.27.203.238/share/v2/6d36e1eb1dbc449db6aca75b12a2ba18/shares/50dc60c2-08d1-4244-b4aa-f09b7789e32d May 28 12:58:33 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-25d6cabe-430a-4a8c-97f9-866a8ed13460 tempest-PublicSharesTest-1667420263 tempest-PublicSharesTest-1667420263-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:33 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-25d6cabe-430a-4a8c-97f9-866a8ed13460 tempest-PublicSharesTest-1667420263 tempest-PublicSharesTest-1667420263-project-member] Calling method 'ShareMixin.delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:33 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.v1.shares [None req-25d6cabe-430a-4a8c-97f9-866a8ed13460 tempest-PublicSharesTest-1667420263 tempest-PublicSharesTest-1667420263-project-member] Delete share with id: 50dc60c2-08d1-4244-b4aa-f09b7789e32d May 28 12:58:33 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-25d6cabe-430a-4a8c-97f9-866a8ed13460 tempest-PublicSharesTest-1667420263 tempest-PublicSharesTest-1667420263-project-member] http://10.27.203.238/share/v2/6d36e1eb1dbc449db6aca75b12a2ba18/shares/50dc60c2-08d1-4244-b4aa-f09b7789e32d returned with HTTP 202 May 28 12:58:33 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 545/1089] 10.27.203.238 () {64 vars in 1454 bytes} [Tue May 28 12:58:33 2024] DELETE /share/v2/6d36e1eb1dbc449db6aca75b12a2ba18/shares/50dc60c2-08d1-4244-b4aa-f09b7789e32d => generated 0 bytes in 119 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:58:33 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-575d5ba5-8369-4213-8322-3d4acfefac1f tempest-PublicSharesTest-1667420263 tempest-PublicSharesTest-1667420263-project-member] GET http://10.27.203.238/share/v2/6d36e1eb1dbc449db6aca75b12a2ba18/shares/50dc60c2-08d1-4244-b4aa-f09b7789e32d May 28 12:58:33 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-575d5ba5-8369-4213-8322-3d4acfefac1f tempest-PublicSharesTest-1667420263 tempest-PublicSharesTest-1667420263-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:33 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-575d5ba5-8369-4213-8322-3d4acfefac1f tempest-PublicSharesTest-1667420263 tempest-PublicSharesTest-1667420263-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:33 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-575d5ba5-8369-4213-8322-3d4acfefac1f tempest-PublicSharesTest-1667420263 tempest-PublicSharesTest-1667420263-project-member] http://10.27.203.238/share/v2/6d36e1eb1dbc449db6aca75b12a2ba18/shares/50dc60c2-08d1-4244-b4aa-f09b7789e32d returned with HTTP 200 May 28 12:58:33 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 545/1090] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:58:33 2024] GET /share/v2/6d36e1eb1dbc449db6aca75b12a2ba18/shares/50dc60c2-08d1-4244-b4aa-f09b7789e32d => generated 1315 bytes in 27 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:58:33 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-25d6cabe-430a-4a8c-97f9-866a8ed13460 tempest-PublicSharesTest-1667420263 None] Acquiring lock "locked_access_rules_operation_by_share_instance_58febd66-6690-481d-866e-2c57d2f22405" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:33 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-25d6cabe-430a-4a8c-97f9-866a8ed13460 tempest-PublicSharesTest-1667420263 None] Lock "locked_access_rules_operation_by_share_instance_58febd66-6690-481d-866e-2c57d2f22405" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:33 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-25d6cabe-430a-4a8c-97f9-866a8ed13460 tempest-PublicSharesTest-1667420263 None] Lock "locked_access_rules_operation_by_share_instance_58febd66-6690-481d-866e-2c57d2f22405" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:33 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-25d6cabe-430a-4a8c-97f9-866a8ed13460 tempest-PublicSharesTest-1667420263 None] Acquiring lock "locked_access_rules_operation_by_share_instance_58febd66-6690-481d-866e-2c57d2f22405" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:33 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-25d6cabe-430a-4a8c-97f9-866a8ed13460 tempest-PublicSharesTest-1667420263 None] Lock "locked_access_rules_operation_by_share_instance_58febd66-6690-481d-866e-2c57d2f22405" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:33 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-25d6cabe-430a-4a8c-97f9-866a8ed13460 tempest-PublicSharesTest-1667420263 None] Lock "locked_access_rules_operation_by_share_instance_58febd66-6690-481d-866e-2c57d2f22405" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:33 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-25d6cabe-430a-4a8c-97f9-866a8ed13460 tempest-PublicSharesTest-1667420263 None] Acquiring lock "locked_access_rules_operation_by_share_instance_58febd66-6690-481d-866e-2c57d2f22405" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:33 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-25d6cabe-430a-4a8c-97f9-866a8ed13460 tempest-PublicSharesTest-1667420263 None] Lock "locked_access_rules_operation_by_share_instance_58febd66-6690-481d-866e-2c57d2f22405" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:33 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-25d6cabe-430a-4a8c-97f9-866a8ed13460 tempest-PublicSharesTest-1667420263 None] Lock "locked_access_rules_operation_by_share_instance_58febd66-6690-481d-866e-2c57d2f22405" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:33 l75lg1-v1 manila-share[98474]: DEBUG manila.share.access [None req-25d6cabe-430a-4a8c-97f9-866a8ed13460 tempest-PublicSharesTest-1667420263 None] All access rules have been synced for share instance 58febd66-6690-481d-866e-2c57d2f22405 belonging to share 50dc60c2-08d1-4244-b4aa-f09b7789e32d. {{(pid=98474) update_access_rules /opt/stack/manila/manila/share/access.py:304}} May 28 12:58:33 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-25d6cabe-430a-4a8c-97f9-866a8ed13460 tempest-PublicSharesTest-1667420263 None] deleting '/manila/manila-58febd66-6690-481d-866e-2c57d2f22405' May 28 12:58:33 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-25d6cabe-430a-4a8c-97f9-866a8ed13460 tempest-PublicSharesTest-1667420263 None] >>> [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/ May 28 12:58:33 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-25d6cabe-430a-4a8c-97f9-866a8ed13460 tempest-PublicSharesTest-1667420263 None] {'data': '{"path": "/manila/manila-58febd66-6690-481d-866e-2c57d2f22405"}', May 28 12:58:33 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-25d6cabe-430a-4a8c-97f9-866a8ed13460 tempest-PublicSharesTest-1667420263 None] 'params': None} May 28 12:58:33 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-25d6cabe-430a-4a8c-97f9-866a8ed13460 tempest-PublicSharesTest-1667420263 None] <<< [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/ May 28 12:58:33 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-25d6cabe-430a-4a8c-97f9-866a8ed13460 tempest-PublicSharesTest-1667420263 None] 'OK' May 28 12:58:33 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-25d6cabe-430a-4a8c-97f9-866a8ed13460 tempest-PublicSharesTest-1667420263 None] --- [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/: Done May 28 12:58:33 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-25d6cabe-430a-4a8c-97f9-866a8ed13460 tempest-PublicSharesTest-1667420263 None] >>> [GET] https://127.0.0.1:40443/api/views/ May 28 12:58:33 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-25d6cabe-430a-4a8c-97f9-866a8ed13460 tempest-PublicSharesTest-1667420263 None] {'allow_redirects': True, May 28 12:58:33 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-25d6cabe-430a-4a8c-97f9-866a8ed13460 tempest-PublicSharesTest-1667420263 None] 'params': {'name': '58febd66-6690-481d-866e-2c57d2f22405'}} May 28 12:58:33 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-6507af6d-8a57-40bb-b759-7831d28924e4 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] GET http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/dacdb3b4-4336-45fd-b002-1a5aa6ad9957 May 28 12:58:33 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-6507af6d-8a57-40bb-b759-7831d28924e4 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:33 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-6507af6d-8a57-40bb-b759-7831d28924e4 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:34 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-6507af6d-8a57-40bb-b759-7831d28924e4 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/dacdb3b4-4336-45fd-b002-1a5aa6ad9957 returned with HTTP 200 May 28 12:58:34 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 546/1091] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:58:33 2024] GET /share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/dacdb3b4-4336-45fd-b002-1a5aa6ad9957 => generated 1314 bytes in 29 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:58:34 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-25d6cabe-430a-4a8c-97f9-866a8ed13460 tempest-PublicSharesTest-1667420263 None] <<< [GET] https://127.0.0.1:40443/api/views/ May 28 12:58:34 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-25d6cabe-430a-4a8c-97f9-866a8ed13460 tempest-PublicSharesTest-1667420263 None] [Bunch(abac_tags=[], abe_max_depth=None, abe_protocols=[], alias='', allow_anonymous_access=False, allow_s3_anonymous_access=False, auto_commit='0d', bucket='', bucket_creators=[], bucket_creators_groups=[], bucket_owner=None, bulk_permission_update_progress=None, bulk_permission_update_state=None, cluster='loop75-kfs', cluster_id=1, created='2024-05-28T12:58:31.253220Z', enabled=True, files_retention_mode='NONE', guid='ccfdddb8-a574-4640-9527-e09d398a7907', id=29, ignore_oos=False, internal=False, is_remote=False, is_seamless=False, logical_capacity=0, max_retention_period=None, min_retention_period=None, name='58febd66-6690-481d-866e-2c57d2f22405', nfs_interop_flags='BOTH_NFS3_AND_NFS4_INTEROP_DISABLED', path='/manila/manila-58febd66-6690-481d-866e-2c57d2f22405', physical_capacity=0, policy='58febd66-6690-481d-866e-2c57d2f22405', policy_id=30, protocols=['NFS'], qos_policy=None, qos_policy_id=None, s3_locks=False, s3_locks_retention_mode='NONE', s3_locks_retention_period='', s3_unverified_lookup=False, s3_versioning=False, select_for_live_monitoring=False, share='', share_acl=Bunch(acl=[], enabled=False), sync='SYNCED', sync_time='2024-05-28T12:58:31.540148Z', tenant_id=1, tenant_name='default', title='/manila/manila-58febd66-6690-481d-866e-2c57d2f22405', url='https://127.0.0.1:40443/api/views/29/')] May 28 12:58:34 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-25d6cabe-430a-4a8c-97f9-866a8ed13460 tempest-PublicSharesTest-1667420263 None] --- [GET] https://127.0.0.1:40443/api/views/: Done May 28 12:58:34 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-25d6cabe-430a-4a8c-97f9-866a8ed13460 tempest-PublicSharesTest-1667420263 None] >>> [DELETE] https://127.0.0.1:40443/api/views/29/ May 28 12:58:34 l75lg1-v1 dstat.sh[49771]: 28-05 12:58:34| 6 1 92 1 0|5722M 1759M 277M 7866M| 22k 2299B| 0 852k| 0 95.9 |3708 5899 |1.30 1.08 1.02|1.0 1.0 0| 0 0 | 0 2048M| 29 357 0 33 0 May 28 12:58:34 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-8477c237-a92a-40ea-9ce6-a0b81bb2a827 tempest-ResourceLockCRUTest-1971036144 tempest-ResourceLockCRUTest-1971036144-project-member] GET http://10.27.203.238/share/v2/82840ccb77144a4aa2d0bdce807ce686/shares/071c2e61-b4b6-48bf-a1f2-c20b233560ed May 28 12:58:34 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-8477c237-a92a-40ea-9ce6-a0b81bb2a827 tempest-ResourceLockCRUTest-1971036144 tempest-ResourceLockCRUTest-1971036144-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:34 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-8477c237-a92a-40ea-9ce6-a0b81bb2a827 tempest-ResourceLockCRUTest-1971036144 tempest-ResourceLockCRUTest-1971036144-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:34 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-8477c237-a92a-40ea-9ce6-a0b81bb2a827 tempest-ResourceLockCRUTest-1971036144 tempest-ResourceLockCRUTest-1971036144-project-member] http://10.27.203.238/share/v2/82840ccb77144a4aa2d0bdce807ce686/shares/071c2e61-b4b6-48bf-a1f2-c20b233560ed returned with HTTP 200 May 28 12:58:34 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 546/1092] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:58:34 2024] GET /share/v2/82840ccb77144a4aa2d0bdce807ce686/shares/071c2e61-b4b6-48bf-a1f2-c20b233560ed => generated 1318 bytes in 28 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:58:34 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-662582bd-4d82-4fee-8c1c-8f21c24f2b46 tempest-ShareIpRulesForNFSTest-1748669711 None] <<< [PATCH] https://127.0.0.1:40443/api/viewpolicies/21/ May 28 12:58:34 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-662582bd-4d82-4fee-8c1c-8f21c24f2b46 tempest-ShareIpRulesForNFSTest-1748669711 None] Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=1, created='2024-05-28T12:57:40.763635Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='377955ad-d094-4e49-ab32-1021d943a572', id=21, internal=False, is_s3_default_policy=False, name='b7a7d61c-2cea-442a-9809-507038e080d5', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=['*'], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['203.0.113.15'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['203.0.113.15'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='MODIFYING', sync_time='2024-05-28T12:58:33.682951Z', tenant_id=1, tenant_name='default', title='b7a7d61c-2cea-442a-9809-507038e080d5', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/21/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[]) May 28 12:58:34 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-662582bd-4d82-4fee-8c1c-8f21c24f2b46 tempest-ShareIpRulesForNFSTest-1748669711 None] --- [PATCH] https://127.0.0.1:40443/api/viewpolicies/21/: Done May 28 12:58:34 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-662582bd-4d82-4fee-8c1c-8f21c24f2b46 tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:34 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-662582bd-4d82-4fee-8c1c-8f21c24f2b46 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:34 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-662582bd-4d82-4fee-8c1c-8f21c24f2b46 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.060s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:34 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-662582bd-4d82-4fee-8c1c-8f21c24f2b46 tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:34 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-662582bd-4d82-4fee-8c1c-8f21c24f2b46 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:34 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-662582bd-4d82-4fee-8c1c-8f21c24f2b46 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:34 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-662582bd-4d82-4fee-8c1c-8f21c24f2b46 tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:34 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-662582bd-4d82-4fee-8c1c-8f21c24f2b46 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:34 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-662582bd-4d82-4fee-8c1c-8f21c24f2b46 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:34 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-662582bd-4d82-4fee-8c1c-8f21c24f2b46 tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:34 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-662582bd-4d82-4fee-8c1c-8f21c24f2b46 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:34 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-662582bd-4d82-4fee-8c1c-8f21c24f2b46 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:34 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-662582bd-4d82-4fee-8c1c-8f21c24f2b46 tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:34 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-662582bd-4d82-4fee-8c1c-8f21c24f2b46 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:34 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-662582bd-4d82-4fee-8c1c-8f21c24f2b46 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.041s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:34 l75lg1-v1 manila-share[98474]: INFO manila.share.access [None req-662582bd-4d82-4fee-8c1c-8f21c24f2b46 tempest-ShareIpRulesForNFSTest-1748669711 None] Access rules were successfully modified for share instance b7a7d61c-2cea-442a-9809-507038e080d5 belonging to share 1ddadc17-cf10-4a42-8bbd-8335fb3520a1. May 28 12:58:34 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b955836e-3bcf-4f6f-a7c4-571eaa76539d tempest-SharesMetadataTest-1561320255 None] <<< [DELETE] https://127.0.0.1:40443/api/viewpolicies/28/ May 28 12:58:34 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b955836e-3bcf-4f6f-a7c4-571eaa76539d tempest-SharesMetadataTest-1561320255 None] --- [DELETE] https://127.0.0.1:40443/api/viewpolicies/28/: Done May 28 12:58:34 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-89868a2c-51f7-440e-86d3-0a58816f8fba tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] POST http://10.27.203.238/share/v1/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action May 28 12:58:34 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-89868a2c-51f7-440e-86d3-0a58816f8fba tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Action body: b'{"os-access_list": null}' {{(pid=98330) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:58:34 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-89868a2c-51f7-440e-86d3-0a58816f8fba tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Action: 'action', calling method: ShareController.access_list, body: {"os-access_list": null} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:58:34 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-8e5c9d63-2d61-4362-9d07-d339b7704376 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] GET http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/snapshots/b3972da7-eb1f-4370-abf4-b7f9402afb30 May 28 12:58:34 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-8e5c9d63-2d61-4362-9d07-d339b7704376 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:34 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-8e5c9d63-2d61-4362-9d07-d339b7704376 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Calling method 'ShareSnapshotMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:34 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-8e5c9d63-2d61-4362-9d07-d339b7704376 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] HTTP exception thrown: The resource could not be found. May 28 12:58:34 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-8e5c9d63-2d61-4362-9d07-d339b7704376 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/snapshots/b3972da7-eb1f-4370-abf4-b7f9402afb30 returned with HTTP 404 May 28 12:58:34 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 547/1093] 10.27.203.238 () {64 vars in 1460 bytes} [Tue May 28 12:58:34 2024] GET /share/v2/a3499cb78849424db45e54caac01de92/snapshots/b3972da7-eb1f-4370-abf4-b7f9402afb30 => generated 78 bytes in 14 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 12:58:34 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-89868a2c-51f7-440e-86d3-0a58816f8fba tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] http://10.27.203.238/share/v1/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action returned with HTTP 200 May 28 12:58:34 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 547/1094] 10.27.203.238 () {64 vars in 1450 bytes} [Tue May 28 12:58:34 2024] POST /share/v1/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action => generated 156 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:58:34 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-0cbf980c-5237-4af5-9666-5adf20ae8c91 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] DELETE http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/snapshots/461797f5-03b2-4e09-af96-9f13a9a2464e May 28 12:58:34 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-0cbf980c-5237-4af5-9666-5adf20ae8c91 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:34 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-0cbf980c-5237-4af5-9666-5adf20ae8c91 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Calling method 'ShareSnapshotMixin.delete' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:34 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.v1.share_snapshots [None req-0cbf980c-5237-4af5-9666-5adf20ae8c91 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Delete snapshot with id: 461797f5-03b2-4e09-af96-9f13a9a2464e May 28 12:58:34 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-35dd7ed9-05c1-4d2b-a810-d8595cfb283d tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] POST http://10.27.203.238/share/v1/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action May 28 12:58:34 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-35dd7ed9-05c1-4d2b-a810-d8595cfb283d tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Action body: b'{"os-deny_access": {"access_id": "ac2d079f-fc3f-4c06-9500-8c9239d5effc"}}' {{(pid=98330) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:58:34 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-35dd7ed9-05c1-4d2b-a810-d8595cfb283d tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Action: 'action', calling method: ShareController.deny_access, body: {"os-deny_access": {"access_id": "ac2d079f-fc3f-4c06-9500-8c9239d5effc"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:58:34 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.lock.api [None req-35dd7ed9-05c1-4d2b-a810-d8595cfb283d tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Searching for locks by: {'resource_id': 'ac2d079f-fc3f-4c06-9500-8c9239d5effc', 'resource_action': 'delete'} {{(pid=98330) get_all /opt/stack/manila/manila/lock/api.py:112}} May 28 12:58:34 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-b955836e-3bcf-4f6f-a7c4-571eaa76539d tempest-SharesMetadataTest-1561320255 None] Created reservations ['df69e6d8-51ef-41b1-8252-c529429b715f', 'a9636070-4cfd-4926-86c2-e88041f09818', '1b2a2960-58f9-4820-9838-a386512c3a22', 'c3c7e40c-4bcc-4c81-987e-183e9fee7fee'] {{(pid=98474) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 12:58:34 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-b955836e-3bcf-4f6f-a7c4-571eaa76539d tempest-SharesMetadataTest-1561320255 None] Committed reservations ['df69e6d8-51ef-41b1-8252-c529429b715f', 'a9636070-4cfd-4926-86c2-e88041f09818', '1b2a2960-58f9-4820-9838-a386512c3a22', 'c3c7e40c-4bcc-4c81-987e-183e9fee7fee'] {{(pid=98474) commit /opt/stack/manila/manila/quota.py:1063}} May 28 12:58:34 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-35dd7ed9-05c1-4d2b-a810-d8595cfb283d tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:34 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-35dd7ed9-05c1-4d2b-a810-d8595cfb283d tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:34 l75lg1-v1 manila-share[98474]: INFO manila.share.manager [None req-b955836e-3bcf-4f6f-a7c4-571eaa76539d tempest-SharesMetadataTest-1561320255 None] Share instance 8d0c9317-df90-47d1-b406-482ee14c60e8: deleted successfully. May 28 12:58:34 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-0cbf980c-5237-4af5-9666-5adf20ae8c91 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/snapshots/461797f5-03b2-4e09-af96-9f13a9a2464e returned with HTTP 202 May 28 12:58:34 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 548/1095] 10.27.203.238 () {64 vars in 1463 bytes} [Tue May 28 12:58:34 2024] DELETE /share/v2/a3499cb78849424db45e54caac01de92/snapshots/461797f5-03b2-4e09-af96-9f13a9a2464e => generated 0 bytes in 102 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:58:34 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-33d0b2c6-455b-444a-92cf-ce8d082028ac tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] GET http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/snapshots/461797f5-03b2-4e09-af96-9f13a9a2464e May 28 12:58:34 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-33d0b2c6-455b-444a-92cf-ce8d082028ac tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:34 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-33d0b2c6-455b-444a-92cf-ce8d082028ac tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Calling method 'ShareSnapshotMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:34 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-35dd7ed9-05c1-4d2b-a810-d8595cfb283d tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.046s {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:34 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-35dd7ed9-05c1-4d2b-a810-d8595cfb283d tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:34 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-35dd7ed9-05c1-4d2b-a810-d8595cfb283d tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:34 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-33d0b2c6-455b-444a-92cf-ce8d082028ac tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/snapshots/461797f5-03b2-4e09-af96-9f13a9a2464e returned with HTTP 200 May 28 12:58:34 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 549/1096] 10.27.203.238 () {64 vars in 1460 bytes} [Tue May 28 12:58:34 2024] GET /share/v2/a3499cb78849424db45e54caac01de92/snapshots/461797f5-03b2-4e09-af96-9f13a9a2464e => generated 749 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:58:34 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0cbf980c-5237-4af5-9666-5adf20ae8c91 tempest-AdminActionsTest-1749172189 None] >>> [GET] https://127.0.0.1:40443/api/snapshots/ May 28 12:58:34 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0cbf980c-5237-4af5-9666-5adf20ae8c91 tempest-AdminActionsTest-1749172189 None] {'allow_redirects': True, May 28 12:58:34 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0cbf980c-5237-4af5-9666-5adf20ae8c91 tempest-AdminActionsTest-1749172189 None] 'params': {'name': 'share-snapshot-5630474e-5783-4d8b-a724-cb878db3d827'}} May 28 12:58:34 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-35dd7ed9-05c1-4d2b-a810-d8595cfb283d tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.058s {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:34 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-35dd7ed9-05c1-4d2b-a810-d8595cfb283d tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] http://10.27.203.238/share/v1/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action returned with HTTP 202 May 28 12:58:34 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 548/1097] 10.27.203.238 () {64 vars in 1450 bytes} [Tue May 28 12:58:34 2024] POST /share/v1/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action => generated 0 bytes in 194 msecs (HTTP/1.1 202) 6 headers in 242 bytes (1 switches on core 0) May 28 12:58:34 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-ca18c4f2-8759-4798-831a-29b36c69c390 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] POST http://10.27.203.238/share/v1/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action May 28 12:58:34 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-ca18c4f2-8759-4798-831a-29b36c69c390 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Action body: b'{"os-access_list": null}' {{(pid=98329) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:58:34 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-ca18c4f2-8759-4798-831a-29b36c69c390 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Action: 'action', calling method: ShareController.access_list, body: {"os-access_list": null} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:58:34 l75lg1-v1 manila-share[98474]: DEBUG manila.share.manager [None req-35dd7ed9-05c1-4d2b-a810-d8595cfb283d tempest-ShareIpRulesForNFSTest-1748669711 None] Received request to update access for share instance b7a7d61c-2cea-442a-9809-507038e080d5. {{(pid=98474) update_access_for_instances /opt/stack/manila/manila/share/manager.py:4353}} May 28 12:58:34 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e663225b-6477-401f-b391-71804dbaf246 tempest-ResourceLockCRUTest-1971036144 None] <<< [DELETE] https://127.0.0.1:40443/api/viewpolicies/26/ May 28 12:58:34 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e663225b-6477-401f-b391-71804dbaf246 tempest-ResourceLockCRUTest-1971036144 None] --- [DELETE] https://127.0.0.1:40443/api/viewpolicies/26/: Done May 28 12:58:34 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-ca18c4f2-8759-4798-831a-29b36c69c390 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] http://10.27.203.238/share/v1/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action returned with HTTP 200 May 28 12:58:34 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 550/1098] 10.27.203.238 () {64 vars in 1450 bytes} [Tue May 28 12:58:34 2024] POST /share/v1/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action => generated 153 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:58:34 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-35dd7ed9-05c1-4d2b-a810-d8595cfb283d tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:34 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-35dd7ed9-05c1-4d2b-a810-d8595cfb283d tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:34 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-35dd7ed9-05c1-4d2b-a810-d8595cfb283d tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.017s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:34 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-35dd7ed9-05c1-4d2b-a810-d8595cfb283d tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:34 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-35dd7ed9-05c1-4d2b-a810-d8595cfb283d tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:34 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-35dd7ed9-05c1-4d2b-a810-d8595cfb283d tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.093s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:34 l75lg1-v1 manila-share[98474]: DEBUG manila.share.access [None req-35dd7ed9-05c1-4d2b-a810-d8595cfb283d tempest-ShareIpRulesForNFSTest-1748669711 None] Updating access rules for share instance b7a7d61c-2cea-442a-9809-507038e080d5 belonging to share 1ddadc17-cf10-4a42-8bbd-8335fb3520a1. {{(pid=98474) update_access_rules /opt/stack/manila/manila/share/access.py:298}} May 28 12:58:34 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-35dd7ed9-05c1-4d2b-a810-d8595cfb283d tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:34 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-35dd7ed9-05c1-4d2b-a810-d8595cfb283d tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:34 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-35dd7ed9-05c1-4d2b-a810-d8595cfb283d tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.009s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:34 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-35dd7ed9-05c1-4d2b-a810-d8595cfb283d tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:34 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-35dd7ed9-05c1-4d2b-a810-d8595cfb283d tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:35 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-e663225b-6477-401f-b391-71804dbaf246 tempest-ResourceLockCRUTest-1971036144 None] Created reservations ['09f183bb-c69d-4581-bfb5-8304e9edfc1f', 'e1664c33-0b17-45c9-a3c2-b65cdc64a375', '4bfbf80b-a262-440a-aed6-b5e1b8fea700', 'b7c2515c-d873-4f5c-b3ce-289febb41687'] {{(pid=98474) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 12:58:35 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-35dd7ed9-05c1-4d2b-a810-d8595cfb283d tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.023s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:35 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-35dd7ed9-05c1-4d2b-a810-d8595cfb283d tempest-ShareIpRulesForNFSTest-1748669711 None] changing access on None May 28 12:58:35 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-35dd7ed9-05c1-4d2b-a810-d8595cfb283d tempest-ShareIpRulesForNFSTest-1748669711 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:58:35 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-35dd7ed9-05c1-4d2b-a810-d8595cfb283d tempest-ShareIpRulesForNFSTest-1748669711 None] {'allow_redirects': True, May 28 12:58:35 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-35dd7ed9-05c1-4d2b-a810-d8595cfb283d tempest-ShareIpRulesForNFSTest-1748669711 None] 'params': {'name': 'b7a7d61c-2cea-442a-9809-507038e080d5'}} May 28 12:58:35 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-e663225b-6477-401f-b391-71804dbaf246 tempest-ResourceLockCRUTest-1971036144 None] Committed reservations ['09f183bb-c69d-4581-bfb5-8304e9edfc1f', 'e1664c33-0b17-45c9-a3c2-b65cdc64a375', '4bfbf80b-a262-440a-aed6-b5e1b8fea700', 'b7c2515c-d873-4f5c-b3ce-289febb41687'] {{(pid=98474) commit /opt/stack/manila/manila/quota.py:1063}} May 28 12:58:35 l75lg1-v1 manila-share[98474]: INFO manila.share.manager [None req-e663225b-6477-401f-b391-71804dbaf246 tempest-ResourceLockCRUTest-1971036144 None] Share instance 5de0f734-b2f4-4d05-8249-81f9d2973a8a: deleted successfully. May 28 12:58:35 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0cbf980c-5237-4af5-9666-5adf20ae8c91 tempest-AdminActionsTest-1749172189 None] <<< [GET] https://127.0.0.1:40443/api/snapshots/ May 28 12:58:35 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0cbf980c-5237-4af5-9666-5adf20ae8c91 tempest-AdminActionsTest-1749172189 None] [Bunch(access_path='/.vast_all_snapshots/1000000006_share-snapshot-5630474e-5783-4d8b-a724-cb878db3d827', aggr_phys_estimation=0, cluster='loop75-kfs', created='2024-05-28T12:57:59.013521Z', eta_sec=30819898882.922493, expiration_time='3001-01-19T07:59:58Z', guid='f989f84e-cec1-42ee-a812-f61a7952c729', id=7, indestructible=False, locked=False, name='share-snapshot-5630474e-5783-4d8b-a724-cb878db3d827', path='/manila/manila-77a25e6b-f137-4342-8eb9-9ced679515e2/', policy=None, policy_id=None, protection_policy_id=None, state='SUCCEED', tenant_id=1, tenant_name='default', title='share-snapshot-5630474e-5783-4d8b-a724-cb878db3d827(/manila/manila-77a25e6b-f137-4342-8eb9-9ced679515e2/)', type='local', unique_phys_estimation=0, url='https://127.0.0.1:40443/api/snapshots/7/')] May 28 12:58:35 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0cbf980c-5237-4af5-9666-5adf20ae8c91 tempest-AdminActionsTest-1749172189 None] --- [GET] https://127.0.0.1:40443/api/snapshots/: Done May 28 12:58:35 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0cbf980c-5237-4af5-9666-5adf20ae8c91 tempest-AdminActionsTest-1749172189 None] >>> [DELETE] https://127.0.0.1:40443/api/snapshots/7/ May 28 12:58:35 l75lg1-v1 dstat.sh[49771]: 28-05 12:58:35| 11 1 85 2 0|5722M 1759M 277M 7867M| 18k 2447B| 0 1601k| 0 256 |5573 9186 |1.30 1.08 1.02|1.0 1.0 0| 0 0 | 0 2048M| 29 357 0 33 0 May 28 12:58:35 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-35dd7ed9-05c1-4d2b-a810-d8595cfb283d tempest-ShareIpRulesForNFSTest-1748669711 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:58:35 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-35dd7ed9-05c1-4d2b-a810-d8595cfb283d tempest-ShareIpRulesForNFSTest-1748669711 None] [Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=1, created='2024-05-28T12:57:40.763635Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='377955ad-d094-4e49-ab32-1021d943a572', id=21, internal=False, is_s3_default_policy=False, name='b7a7d61c-2cea-442a-9809-507038e080d5', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=['*'], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['203.0.113.15'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['203.0.113.15'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T12:58:34.171061Z', tenant_id=1, tenant_name='default', title='b7a7d61c-2cea-442a-9809-507038e080d5', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/21/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[])] May 28 12:58:35 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-35dd7ed9-05c1-4d2b-a810-d8595cfb283d tempest-ShareIpRulesForNFSTest-1748669711 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 12:58:35 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-35dd7ed9-05c1-4d2b-a810-d8595cfb283d tempest-ShareIpRulesForNFSTest-1748669711 None] changing access on /manila/manila-b7a7d61c-2cea-442a-9809-507038e080d5. Rules: {'nfs_read_write': [], 'nfs_read_only': []} May 28 12:58:35 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-35dd7ed9-05c1-4d2b-a810-d8595cfb283d tempest-ShareIpRulesForNFSTest-1748669711 None] >>> [PATCH] https://127.0.0.1:40443/api/viewpolicies/21/ May 28 12:58:35 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-35dd7ed9-05c1-4d2b-a810-d8595cfb283d tempest-ShareIpRulesForNFSTest-1748669711 None] {'data': '{"name": "b7a7d61c-2cea-442a-9809-507038e080d5", "nfs_no_squash": ' May 28 12:58:35 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-35dd7ed9-05c1-4d2b-a810-d8595cfb283d tempest-ShareIpRulesForNFSTest-1748669711 None] '["*"], "nfs_root_squash": ["*"], "nfs_read_write": [], ' May 28 12:58:35 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-35dd7ed9-05c1-4d2b-a810-d8595cfb283d tempest-ShareIpRulesForNFSTest-1748669711 None] '"nfs_read_only": []}', May 28 12:58:35 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-35dd7ed9-05c1-4d2b-a810-d8595cfb283d tempest-ShareIpRulesForNFSTest-1748669711 None] 'params': None} May 28 12:58:36 l75lg1-v1 dstat.sh[49771]: 28-05 12:58:36| 1 0 98 0 0|5722M 1759M 277M 7867M| 17k 990B| 0 732k| 0 41.0 |1811 2761 |1.30 1.08 1.02|3.0 1.0 0| 0 0 | 0 2048M| 29 357 0 33 0 May 28 12:58:36 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-25d6cabe-430a-4a8c-97f9-866a8ed13460 tempest-PublicSharesTest-1667420263 None] <<< [DELETE] https://127.0.0.1:40443/api/views/29/ May 28 12:58:36 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-25d6cabe-430a-4a8c-97f9-866a8ed13460 tempest-PublicSharesTest-1667420263 None] --- [DELETE] https://127.0.0.1:40443/api/views/29/: Done May 28 12:58:36 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-25d6cabe-430a-4a8c-97f9-866a8ed13460 tempest-PublicSharesTest-1667420263 None] >>> [GET] https://127.0.0.1:40443/api/quotas/ May 28 12:58:36 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-25d6cabe-430a-4a8c-97f9-866a8ed13460 tempest-PublicSharesTest-1667420263 None] {'allow_redirects': True, May 28 12:58:36 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-25d6cabe-430a-4a8c-97f9-866a8ed13460 tempest-PublicSharesTest-1667420263 None] 'params': {'name': '58febd66-6690-481d-866e-2c57d2f22405'}} May 28 12:58:36 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0cbf980c-5237-4af5-9666-5adf20ae8c91 tempest-AdminActionsTest-1749172189 None] <<< [DELETE] https://127.0.0.1:40443/api/snapshots/7/ May 28 12:58:36 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0cbf980c-5237-4af5-9666-5adf20ae8c91 tempest-AdminActionsTest-1749172189 None] --- [DELETE] https://127.0.0.1:40443/api/snapshots/7/: Done May 28 12:58:36 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-0cbf980c-5237-4af5-9666-5adf20ae8c91 tempest-AdminActionsTest-1749172189 None] Created reservations ['5c2cbe04-9917-43eb-bc37-5c9477439ad8', '4e426a23-d080-4dd0-bd08-007d51df71e8', 'ffa43cb7-075a-40a2-bb1a-b8445085c865', 'b08a8058-5635-4964-8945-bdd6be86771f'] {{(pid=98474) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 12:58:36 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-25d6cabe-430a-4a8c-97f9-866a8ed13460 tempest-PublicSharesTest-1667420263 None] <<< [GET] https://127.0.0.1:40443/api/quotas/ May 28 12:58:36 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-25d6cabe-430a-4a8c-97f9-866a8ed13460 tempest-PublicSharesTest-1667420263 None] [Bunch(cluster='loop75-kfs', cluster_id=1, default_email=None, default_group_quota=None, default_user_quota=None, enable_alarms=True, enable_email_providers=True, grace_period=None, guid='dd45a8e2-8a2e-4e2d-9e07-008f631d9e48', hard_limit=1073741824, hard_limit_inodes=None, id=27, internal=False, is_user_quota=False, last_user_quotas_update=None, name='58febd66-6690-481d-866e-2c57d2f22405', num_blocked_users=0, num_exceeded_users=0, path='/manila/manila-58febd66-6690-481d-866e-2c57d2f22405', percent_capacity=0, percent_inodes=None, pretty_grace_period=None, pretty_grace_period_expiration=None, pretty_state='OK (CREATED)', soft_limit=None, soft_limit_inodes=None, state='OK', sync_state='CREATED', system_id=27, tenant_id=1, tenant_name='default', time_to_block=None, title='58febd66-6690-481d-866e-2c57d2f22405', url='https://127.0.0.1:40443/api/quotas/27/', used_capacity=0, used_capacity_tb=0.0, used_effective_capacity=0, used_effective_capacity_tb=0.0, used_inodes=0, used_limited_capacity=0)] May 28 12:58:36 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-25d6cabe-430a-4a8c-97f9-866a8ed13460 tempest-PublicSharesTest-1667420263 None] --- [GET] https://127.0.0.1:40443/api/quotas/: Done May 28 12:58:36 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-25d6cabe-430a-4a8c-97f9-866a8ed13460 tempest-PublicSharesTest-1667420263 None] >>> [DELETE] https://127.0.0.1:40443/api/quotas/27/ May 28 12:58:36 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-0cbf980c-5237-4af5-9666-5adf20ae8c91 tempest-AdminActionsTest-1749172189 None] Committed reservations ['5c2cbe04-9917-43eb-bc37-5c9477439ad8', '4e426a23-d080-4dd0-bd08-007d51df71e8', 'ffa43cb7-075a-40a2-bb1a-b8445085c865', 'b08a8058-5635-4964-8945-bdd6be86771f'] {{(pid=98474) commit /opt/stack/manila/manila/quota.py:1063}} May 28 12:58:36 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-9a7bd4ad-8947-4198-a659-6862cf569bcf tempest-PublicSharesTest-1667420263 tempest-PublicSharesTest-1667420263-project-member] GET http://10.27.203.238/share/v2/6d36e1eb1dbc449db6aca75b12a2ba18/shares/50dc60c2-08d1-4244-b4aa-f09b7789e32d May 28 12:58:36 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-9a7bd4ad-8947-4198-a659-6862cf569bcf tempest-PublicSharesTest-1667420263 tempest-PublicSharesTest-1667420263-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:36 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-9a7bd4ad-8947-4198-a659-6862cf569bcf tempest-PublicSharesTest-1667420263 tempest-PublicSharesTest-1667420263-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:36 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-9a7bd4ad-8947-4198-a659-6862cf569bcf tempest-PublicSharesTest-1667420263 tempest-PublicSharesTest-1667420263-project-member] http://10.27.203.238/share/v2/6d36e1eb1dbc449db6aca75b12a2ba18/shares/50dc60c2-08d1-4244-b4aa-f09b7789e32d returned with HTTP 200 May 28 12:58:36 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 549/1099] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:58:36 2024] GET /share/v2/6d36e1eb1dbc449db6aca75b12a2ba18/shares/50dc60c2-08d1-4244-b4aa-f09b7789e32d => generated 1315 bytes in 24 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:58:37 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-28f8664f-6d5c-444b-b68b-d05fbae7209a tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] GET http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/dacdb3b4-4336-45fd-b002-1a5aa6ad9957 May 28 12:58:37 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-28f8664f-6d5c-444b-b68b-d05fbae7209a tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:37 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-28f8664f-6d5c-444b-b68b-d05fbae7209a tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:37 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-28f8664f-6d5c-444b-b68b-d05fbae7209a tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] HTTP exception thrown: The resource could not be found. May 28 12:58:37 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-28f8664f-6d5c-444b-b68b-d05fbae7209a tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/dacdb3b4-4336-45fd-b002-1a5aa6ad9957 returned with HTTP 404 May 28 12:58:37 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 551/1100] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:58:37 2024] GET /share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/dacdb3b4-4336-45fd-b002-1a5aa6ad9957 => generated 78 bytes in 12 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 12:58:37 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-63d100ab-045d-4eb7-b631-e408f1448444 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] POST http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/9e24a210-9e96-45d9-b31c-f6f3377eb0e7/metadata May 28 12:58:37 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-63d100ab-045d-4eb7-b631-e408f1448444 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Action: 'create_metadata', calling method: Controller.__getattribute__..version_select, body: {"metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "value"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:58:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG dbcounter [-] [51267] Writing DB stats keystone:SELECT=1613,keystone:DELETE=200,keystone:INSERT=101 {{(pid=51267) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:58:37 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-63d100ab-045d-4eb7-b631-e408f1448444 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/9e24a210-9e96-45d9-b31c-f6f3377eb0e7/metadata returned with HTTP 200 May 28 12:58:37 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 550/1101] 10.27.203.238 () {66 vars in 1500 bytes} [Tue May 28 12:58:37 2024] POST /share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/9e24a210-9e96-45d9-b31c-f6f3377eb0e7/metadata => generated 282 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:58:37 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-ef487f01-59c8-4437-8832-f29c7713222b tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] GET http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/9e24a210-9e96-45d9-b31c-f6f3377eb0e7/metadata May 28 12:58:37 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-ef487f01-59c8-4437-8832-f29c7713222b tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:37 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-ef487f01-59c8-4437-8832-f29c7713222b tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:37 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-ef487f01-59c8-4437-8832-f29c7713222b tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/9e24a210-9e96-45d9-b31c-f6f3377eb0e7/metadata returned with HTTP 200 May 28 12:58:37 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 552/1102] 10.27.203.238 () {64 vars in 1478 bytes} [Tue May 28 12:58:37 2024] GET /share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/9e24a210-9e96-45d9-b31c-f6f3377eb0e7/metadata => generated 282 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:58:37 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-f48e1bed-1ad0-4a84-9c5d-ebb084f7e284 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] POST http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/9e24a210-9e96-45d9-b31c-f6f3377eb0e7/metadata May 28 12:58:37 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-f48e1bed-1ad0-4a84-9c5d-ebb084f7e284 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Action: 'create_metadata', calling method: Controller.__getattribute__..version_select, body: {"metadata": {"key": "vvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvv"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:58:37 l75lg1-v1 dstat.sh[49771]: 28-05 12:58:37| 4 1 94 1 0|5723M 1758M 277M 7867M| 27k 10k| 0 905k| 0 119 |3220 4974 |1.20 1.06 1.01|2.0 2.0 0| 0 0 | 0 2048M| 29 358 0 29 0 May 28 12:58:37 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-f48e1bed-1ad0-4a84-9c5d-ebb084f7e284 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/9e24a210-9e96-45d9-b31c-f6f3377eb0e7/metadata returned with HTTP 200 May 28 12:58:37 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 551/1103] 10.27.203.238 () {66 vars in 1501 bytes} [Tue May 28 12:58:37 2024] POST /share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/9e24a210-9e96-45d9-b31c-f6f3377eb0e7/metadata => generated 1316 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:58:37 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-50506dc9-9c49-46fc-95df-3caf1c115589 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] GET http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/9e24a210-9e96-45d9-b31c-f6f3377eb0e7/metadata May 28 12:58:37 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-50506dc9-9c49-46fc-95df-3caf1c115589 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:37 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-50506dc9-9c49-46fc-95df-3caf1c115589 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:37 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-1bc248af-926d-4598-87cf-2f8b7236f10f tempest-ResourceLockCRUTest-1971036144 tempest-ResourceLockCRUTest-1971036144-project-member] GET http://10.27.203.238/share/v2/82840ccb77144a4aa2d0bdce807ce686/shares/071c2e61-b4b6-48bf-a1f2-c20b233560ed May 28 12:58:37 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-1bc248af-926d-4598-87cf-2f8b7236f10f tempest-ResourceLockCRUTest-1971036144 tempest-ResourceLockCRUTest-1971036144-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:37 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-1bc248af-926d-4598-87cf-2f8b7236f10f tempest-ResourceLockCRUTest-1971036144 tempest-ResourceLockCRUTest-1971036144-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:37 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-1bc248af-926d-4598-87cf-2f8b7236f10f tempest-ResourceLockCRUTest-1971036144 tempest-ResourceLockCRUTest-1971036144-project-member] HTTP exception thrown: The resource could not be found. May 28 12:58:37 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-1bc248af-926d-4598-87cf-2f8b7236f10f tempest-ResourceLockCRUTest-1971036144 tempest-ResourceLockCRUTest-1971036144-project-member] http://10.27.203.238/share/v2/82840ccb77144a4aa2d0bdce807ce686/shares/071c2e61-b4b6-48bf-a1f2-c20b233560ed returned with HTTP 404 May 28 12:58:37 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 552/1104] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:58:37 2024] GET /share/v2/82840ccb77144a4aa2d0bdce807ce686/shares/071c2e61-b4b6-48bf-a1f2-c20b233560ed => generated 78 bytes in 13 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 12:58:37 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-11681121-dfd6-4aa5-9701-5954760c3854 tempest-ResourceLockCRUTest-1063854601 tempest-ResourceLockCRUTest-1063854601-project-admin] DELETE http://10.27.203.238/share/v2/6bcb84add5bc4d8cb675498201734b6d/types/2995b9a5-154c-4e23-8364-c4a157a7537f May 28 12:58:37 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-11681121-dfd6-4aa5-9701-5954760c3854 tempest-ResourceLockCRUTest-1063854601 tempest-ResourceLockCRUTest-1063854601-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:37 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-11681121-dfd6-4aa5-9701-5954760c3854 tempest-ResourceLockCRUTest-1063854601 tempest-ResourceLockCRUTest-1063854601-project-admin] Calling method 'ShareTypesController._delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:37 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-50506dc9-9c49-46fc-95df-3caf1c115589 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/9e24a210-9e96-45d9-b31c-f6f3377eb0e7/metadata returned with HTTP 200 May 28 12:58:37 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 553/1105] 10.27.203.238 () {64 vars in 1478 bytes} [Tue May 28 12:58:37 2024] GET /share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/9e24a210-9e96-45d9-b31c-f6f3377eb0e7/metadata => generated 1316 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:58:37 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-276d0e37-9e96-43ab-ae64-006119438509 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] POST http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/9e24a210-9e96-45d9-b31c-f6f3377eb0e7/metadata May 28 12:58:37 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-276d0e37-9e96-43ab-ae64-006119438509 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Action: 'create_metadata', calling method: Controller.__getattribute__..version_select, body: {"metadata": {"k": "value"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:58:37 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-11681121-dfd6-4aa5-9701-5954760c3854 tempest-ResourceLockCRUTest-1063854601 tempest-ResourceLockCRUTest-1063854601-project-admin] http://10.27.203.238/share/v2/6bcb84add5bc4d8cb675498201734b6d/types/2995b9a5-154c-4e23-8364-c4a157a7537f returned with HTTP 202 May 28 12:58:37 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 553/1106] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:58:37 2024] DELETE /share/v2/6bcb84add5bc4d8cb675498201734b6d/types/2995b9a5-154c-4e23-8364-c4a157a7537f => generated 0 bytes in 52 msecs (HTTP/1.1 202) 6 headers in 243 bytes (2 switches on core 0) May 28 12:58:37 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-bb2cf8e6-717b-443c-93f1-9945102a64d0 tempest-ResourceLockCRUTest-1063854601 tempest-ResourceLockCRUTest-1063854601-project-admin] GET http://10.27.203.238/share/v2/6bcb84add5bc4d8cb675498201734b6d/types/2995b9a5-154c-4e23-8364-c4a157a7537f May 28 12:58:37 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-bb2cf8e6-717b-443c-93f1-9945102a64d0 tempest-ResourceLockCRUTest-1063854601 tempest-ResourceLockCRUTest-1063854601-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:37 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-bb2cf8e6-717b-443c-93f1-9945102a64d0 tempest-ResourceLockCRUTest-1063854601 tempest-ResourceLockCRUTest-1063854601-project-admin] Calling method 'ShareTypesController.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:37 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-bb2cf8e6-717b-443c-93f1-9945102a64d0 tempest-ResourceLockCRUTest-1063854601 tempest-ResourceLockCRUTest-1063854601-project-admin] HTTP exception thrown: Share type not found. May 28 12:58:37 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-bb2cf8e6-717b-443c-93f1-9945102a64d0 tempest-ResourceLockCRUTest-1063854601 tempest-ResourceLockCRUTest-1063854601-project-admin] http://10.27.203.238/share/v2/6bcb84add5bc4d8cb675498201734b6d/types/2995b9a5-154c-4e23-8364-c4a157a7537f returned with HTTP 404 May 28 12:58:37 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 554/1107] 10.27.203.238 () {64 vars in 1448 bytes} [Tue May 28 12:58:37 2024] GET /share/v2/6bcb84add5bc4d8cb675498201734b6d/types/2995b9a5-154c-4e23-8364-c4a157a7537f => generated 67 bytes in 13 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 12:58:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40785d6-de61-4e64-b8dd-9c30340252e9 service manila] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-f40785d6-de61-4e64-b8dd-9c30340252e9 service manila] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:58:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40785d6-de61-4e64-b8dd-9c30340252e9 service manila] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccaa37c-4355-4034-9016-a67899879ac7 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccaa37c-4355-4034-9016-a67899879ac7 None admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccaa37c-4355-4034-9016-a67899879ac7 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccaa37c-4355-4034-9016-a67899879ac7 None admin] PATH_INFO: `/v3/users/a5f62af60417483dbbe38e24cb57d83b` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccaa37c-4355-4034-9016-a67899879ac7 None admin] RBAC: Authorizing `identity:delete_user(user_id=a5f62af60417483dbbe38e24cb57d83b)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccaa37c-4355-4034-9016-a67899879ac7 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:37 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-35dd7ed9-05c1-4d2b-a810-d8595cfb283d tempest-ShareIpRulesForNFSTest-1748669711 None] <<< [PATCH] https://127.0.0.1:40443/api/viewpolicies/21/ May 28 12:58:37 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-35dd7ed9-05c1-4d2b-a810-d8595cfb283d tempest-ShareIpRulesForNFSTest-1748669711 None] Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=1, created='2024-05-28T12:57:40.763635Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='377955ad-d094-4e49-ab32-1021d943a572', id=21, internal=False, is_s3_default_policy=False, name='b7a7d61c-2cea-442a-9809-507038e080d5', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=['*'], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=[], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=[], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='MODIFYING', sync_time='2024-05-28T12:58:36.600011Z', tenant_id=1, tenant_name='default', title='b7a7d61c-2cea-442a-9809-507038e080d5', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/21/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[]) May 28 12:58:37 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-35dd7ed9-05c1-4d2b-a810-d8595cfb283d tempest-ShareIpRulesForNFSTest-1748669711 None] --- [PATCH] https://127.0.0.1:40443/api/viewpolicies/21/: Done May 28 12:58:37 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-35dd7ed9-05c1-4d2b-a810-d8595cfb283d tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:37 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-35dd7ed9-05c1-4d2b-a810-d8595cfb283d tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-7ccaa37c-4355-4034-9016-a67899879ac7 None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5f62af60417483dbbe38e24cb57d83b', 'request_id': 'req-7ccaa37c-4355-4034-9016-a67899879ac7'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:58:37 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-35dd7ed9-05c1-4d2b-a810-d8595cfb283d tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.031s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:37 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-35dd7ed9-05c1-4d2b-a810-d8595cfb283d tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:37 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-35dd7ed9-05c1-4d2b-a810-d8595cfb283d tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-7ccaa37c-4355-4034-9016-a67899879ac7 None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5f62af60417483dbbe38e24cb57d83b', 'request_id': 'req-7ccaa37c-4355-4034-9016-a67899879ac7'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:58:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-7ccaa37c-4355-4034-9016-a67899879ac7 None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5f62af60417483dbbe38e24cb57d83b', 'request_id': 'req-7ccaa37c-4355-4034-9016-a67899879ac7'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:58:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-7ccaa37c-4355-4034-9016-a67899879ac7 None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5f62af60417483dbbe38e24cb57d83b', 'request_id': 'req-7ccaa37c-4355-4034-9016-a67899879ac7'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:58:37 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-276d0e37-9e96-43ab-ae64-006119438509 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/9e24a210-9e96-45d9-b31c-f6f3377eb0e7/metadata returned with HTTP 200 May 28 12:58:37 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 554/1108] 10.27.203.238 () {66 vars in 1499 bytes} [Tue May 28 12:58:37 2024] POST /share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/9e24a210-9e96-45d9-b31c-f6f3377eb0e7/metadata => generated 1330 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 232 bytes (2 switches on core 0) May 28 12:58:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-7ccaa37c-4355-4034-9016-a67899879ac7 None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5f62af60417483dbbe38e24cb57d83b', 'request_id': 'req-7ccaa37c-4355-4034-9016-a67899879ac7'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:58:37 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-8ca685d5-d723-4c3a-bc1d-4f078556dac9 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] GET http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/9e24a210-9e96-45d9-b31c-f6f3377eb0e7/metadata May 28 12:58:37 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-8ca685d5-d723-4c3a-bc1d-4f078556dac9 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:37 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-8ca685d5-d723-4c3a-bc1d-4f078556dac9 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:37 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-35dd7ed9-05c1-4d2b-a810-d8595cfb283d tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.032s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:37 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-35dd7ed9-05c1-4d2b-a810-d8595cfb283d tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:37 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1119/2214] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 12:58:37 2024] DELETE /identity/v3/users/a5f62af60417483dbbe38e24cb57d83b => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:58:37 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-35dd7ed9-05c1-4d2b-a810-d8595cfb283d tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe589ae-e78e-49af-bb7f-3469fdbb19fb service manila] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:37 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-35dd7ed9-05c1-4d2b-a810-d8595cfb283d tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:37 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-35dd7ed9-05c1-4d2b-a810-d8595cfb283d tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:37 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-35dd7ed9-05c1-4d2b-a810-d8595cfb283d tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:37 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-35dd7ed9-05c1-4d2b-a810-d8595cfb283d tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:37 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-35dd7ed9-05c1-4d2b-a810-d8595cfb283d tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:37 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-35dd7ed9-05c1-4d2b-a810-d8595cfb283d tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe589ae-e78e-49af-bb7f-3469fdbb19fb service manila] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2daf266-fb12-48c8-b5bb-6b4489c990bf None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2daf266-fb12-48c8-b5bb-6b4489c990bf None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2daf266-fb12-48c8-b5bb-6b4489c990bf None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2daf266-fb12-48c8-b5bb-6b4489c990bf None admin] PATH_INFO: `/v3/users/7a0db4d21f4c4b35b1f3c9b27af6cdb0` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2daf266-fb12-48c8-b5bb-6b4489c990bf None admin] RBAC: Authorizing `identity:delete_user(user_id=7a0db4d21f4c4b35b1f3c9b27af6cdb0)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2daf266-fb12-48c8-b5bb-6b4489c990bf None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:37 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-35dd7ed9-05c1-4d2b-a810-d8595cfb283d tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.037s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:37 l75lg1-v1 manila-share[98474]: INFO manila.share.access [None req-35dd7ed9-05c1-4d2b-a810-d8595cfb283d tempest-ShareIpRulesForNFSTest-1748669711 None] Access rules were successfully modified for share instance b7a7d61c-2cea-442a-9809-507038e080d5 belonging to share 1ddadc17-cf10-4a42-8bbd-8335fb3520a1. May 28 12:58:37 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-8ca685d5-d723-4c3a-bc1d-4f078556dac9 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/9e24a210-9e96-45d9-b31c-f6f3377eb0e7/metadata returned with HTTP 200 May 28 12:58:37 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 555/1109] 10.27.203.238 () {64 vars in 1478 bytes} [Tue May 28 12:58:37 2024] GET /share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/9e24a210-9e96-45d9-b31c-f6f3377eb0e7/metadata => generated 1330 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:58:37 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-c4188acf-7c03-4449-8817-e994c25e943d tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] POST http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/9e24a210-9e96-45d9-b31c-f6f3377eb0e7/metadata May 28 12:58:37 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-c4188acf-7c03-4449-8817-e994c25e943d tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Action: 'create_metadata', calling method: Controller.__getattribute__..version_select, body: {"metadata": {"key": "v"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:58:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-c2daf266-fb12-48c8-b5bb-6b4489c990bf None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a0db4d21f4c4b35b1f3c9b27af6cdb0', 'request_id': 'req-c2daf266-fb12-48c8-b5bb-6b4489c990bf'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:58:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-c2daf266-fb12-48c8-b5bb-6b4489c990bf None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a0db4d21f4c4b35b1f3c9b27af6cdb0', 'request_id': 'req-c2daf266-fb12-48c8-b5bb-6b4489c990bf'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:58:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-c2daf266-fb12-48c8-b5bb-6b4489c990bf None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a0db4d21f4c4b35b1f3c9b27af6cdb0', 'request_id': 'req-c2daf266-fb12-48c8-b5bb-6b4489c990bf'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:58:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-c2daf266-fb12-48c8-b5bb-6b4489c990bf None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a0db4d21f4c4b35b1f3c9b27af6cdb0', 'request_id': 'req-c2daf266-fb12-48c8-b5bb-6b4489c990bf'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:58:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-c2daf266-fb12-48c8-b5bb-6b4489c990bf None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a0db4d21f4c4b35b1f3c9b27af6cdb0', 'request_id': 'req-c2daf266-fb12-48c8-b5bb-6b4489c990bf'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:58:37 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1096/2215] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 12:58:37 2024] DELETE /identity/v3/users/7a0db4d21f4c4b35b1f3c9b27af6cdb0 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:58:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccaa37c-4355-4034-9016-a67899879ac7 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-7ccaa37c-4355-4034-9016-a67899879ac7 None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:58:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccaa37c-4355-4034-9016-a67899879ac7 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bece3b4-9e25-4273-ba26-d79214bcd2ee None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bece3b4-9e25-4273-ba26-d79214bcd2ee None admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bece3b4-9e25-4273-ba26-d79214bcd2ee None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bece3b4-9e25-4273-ba26-d79214bcd2ee None admin] PATH_INFO: `/v3/users/cacdef9ca5d04afb85fa43f2d0e57632` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bece3b4-9e25-4273-ba26-d79214bcd2ee None admin] RBAC: Authorizing `identity:delete_user(user_id=cacdef9ca5d04afb85fa43f2d0e57632)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bece3b4-9e25-4273-ba26-d79214bcd2ee None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:37 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-b682bcf0-6fa6-4bad-a3d3-e1d00b4c0487 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] GET http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/snapshots/461797f5-03b2-4e09-af96-9f13a9a2464e May 28 12:58:37 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-b682bcf0-6fa6-4bad-a3d3-e1d00b4c0487 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:37 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-b682bcf0-6fa6-4bad-a3d3-e1d00b4c0487 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Calling method 'ShareSnapshotMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:37 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-b682bcf0-6fa6-4bad-a3d3-e1d00b4c0487 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] HTTP exception thrown: The resource could not be found. May 28 12:58:37 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-b682bcf0-6fa6-4bad-a3d3-e1d00b4c0487 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/snapshots/461797f5-03b2-4e09-af96-9f13a9a2464e returned with HTTP 404 May 28 12:58:37 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 556/1110] 10.27.203.238 () {64 vars in 1460 bytes} [Tue May 28 12:58:37 2024] GET /share/v2/a3499cb78849424db45e54caac01de92/snapshots/461797f5-03b2-4e09-af96-9f13a9a2464e => generated 78 bytes in 14 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 12:58:37 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-c4188acf-7c03-4449-8817-e994c25e943d tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/9e24a210-9e96-45d9-b31c-f6f3377eb0e7/metadata returned with HTTP 200 May 28 12:58:37 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 555/1111] 10.27.203.238 () {66 vars in 1499 bytes} [Tue May 28 12:58:37 2024] POST /share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/9e24a210-9e96-45d9-b31c-f6f3377eb0e7/metadata => generated 308 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:58:37 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-9bfc7c7b-73c3-45af-b933-72a53c6cdba1 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] DELETE http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/snapshots/000474a6-de71-40da-a1b3-815af4e9bcdf May 28 12:58:37 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-9bfc7c7b-73c3-45af-b933-72a53c6cdba1 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:37 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-9bfc7c7b-73c3-45af-b933-72a53c6cdba1 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Calling method 'ShareSnapshotMixin.delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:37 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.v1.share_snapshots [None req-9bfc7c7b-73c3-45af-b933-72a53c6cdba1 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Delete snapshot with id: 000474a6-de71-40da-a1b3-815af4e9bcdf May 28 12:58:37 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-244728aa-529d-4dab-a9e3-8c8bfc2b1ab6 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] GET http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/9e24a210-9e96-45d9-b31c-f6f3377eb0e7/metadata May 28 12:58:37 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-244728aa-529d-4dab-a9e3-8c8bfc2b1ab6 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:37 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-244728aa-529d-4dab-a9e3-8c8bfc2b1ab6 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-7bece3b4-9e25-4273-ba26-d79214bcd2ee None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cacdef9ca5d04afb85fa43f2d0e57632', 'request_id': 'req-7bece3b4-9e25-4273-ba26-d79214bcd2ee'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:58:37 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-9bfc7c7b-73c3-45af-b933-72a53c6cdba1 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] HTTP exception thrown: The resource could not be found. May 28 12:58:37 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-9bfc7c7b-73c3-45af-b933-72a53c6cdba1 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/snapshots/000474a6-de71-40da-a1b3-815af4e9bcdf returned with HTTP 404 May 28 12:58:37 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 557/1112] 10.27.203.238 () {64 vars in 1463 bytes} [Tue May 28 12:58:37 2024] DELETE /share/v2/a3499cb78849424db45e54caac01de92/snapshots/000474a6-de71-40da-a1b3-815af4e9bcdf => generated 78 bytes in 16 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 12:58:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-7bece3b4-9e25-4273-ba26-d79214bcd2ee None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cacdef9ca5d04afb85fa43f2d0e57632', 'request_id': 'req-7bece3b4-9e25-4273-ba26-d79214bcd2ee'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:58:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-7bece3b4-9e25-4273-ba26-d79214bcd2ee None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cacdef9ca5d04afb85fa43f2d0e57632', 'request_id': 'req-7bece3b4-9e25-4273-ba26-d79214bcd2ee'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:58:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-7bece3b4-9e25-4273-ba26-d79214bcd2ee None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cacdef9ca5d04afb85fa43f2d0e57632', 'request_id': 'req-7bece3b4-9e25-4273-ba26-d79214bcd2ee'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:58:37 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-b1c9c2b7-200f-438a-a6c9-a4a0d6777464 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] GET http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/share-replicas/detail?share_id=c5d9b059-bdd0-4fae-9bd0-328d926e5694 May 28 12:58:37 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-b1c9c2b7-200f-438a-a6c9-a4a0d6777464 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:37 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-b1c9c2b7-200f-438a-a6c9-a4a0d6777464 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:37 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-b1c9c2b7-200f-438a-a6c9-a4a0d6777464 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/share-replicas/detail?share_id=c5d9b059-bdd0-4fae-9bd0-328d926e5694 returned with HTTP 200 May 28 12:58:37 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 558/1113] 10.27.203.238 () {64 vars in 1476 bytes} [Tue May 28 12:58:37 2024] GET /share/v2/a3499cb78849424db45e54caac01de92/share-replicas/detail?share_id=c5d9b059-bdd0-4fae-9bd0-328d926e5694 => generated 22 bytes in 12 msecs (HTTP/1.1 200) 6 headers in 230 bytes (2 switches on core 0) May 28 12:58:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-7bece3b4-9e25-4273-ba26-d79214bcd2ee None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cacdef9ca5d04afb85fa43f2d0e57632', 'request_id': 'req-7bece3b4-9e25-4273-ba26-d79214bcd2ee'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:58:37 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-82a54304-6c0f-4f6c-9a7a-fc3f687067ed tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] DELETE http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/shares/c5d9b059-bdd0-4fae-9bd0-328d926e5694 May 28 12:58:37 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-82a54304-6c0f-4f6c-9a7a-fc3f687067ed tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:37 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-82a54304-6c0f-4f6c-9a7a-fc3f687067ed tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Calling method 'ShareMixin.delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:37 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.v1.shares [None req-82a54304-6c0f-4f6c-9a7a-fc3f687067ed tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Delete share with id: c5d9b059-bdd0-4fae-9bd0-328d926e5694 May 28 12:58:37 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1120/2216] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 12:58:37 2024] DELETE /identity/v3/users/cacdef9ca5d04afb85fa43f2d0e57632 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:58:37 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-82a54304-6c0f-4f6c-9a7a-fc3f687067ed tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] HTTP exception thrown: The resource could not be found. May 28 12:58:37 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-82a54304-6c0f-4f6c-9a7a-fc3f687067ed tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/shares/c5d9b059-bdd0-4fae-9bd0-328d926e5694 returned with HTTP 404 May 28 12:58:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e951b606-9c9f-4ec4-96f0-8f1e54cb93a2 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e951b606-9c9f-4ec4-96f0-8f1e54cb93a2 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e951b606-9c9f-4ec4-96f0-8f1e54cb93a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:37 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 559/1114] 10.27.203.238 () {64 vars in 1454 bytes} [Tue May 28 12:58:37 2024] DELETE /share/v2/a3499cb78849424db45e54caac01de92/shares/c5d9b059-bdd0-4fae-9bd0-328d926e5694 => generated 78 bytes in 12 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 12:58:37 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-d9c71898-ae8b-4d81-b64e-b8839c4b1da8 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] GET http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/share-replicas/detail?share_id=df0ea844-5fc1-4d04-8afb-5048ec5dc33f May 28 12:58:37 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-d9c71898-ae8b-4d81-b64e-b8839c4b1da8 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:37 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-d9c71898-ae8b-4d81-b64e-b8839c4b1da8 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:37 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-e951b606-9c9f-4ec4-96f0-8f1e54cb93a2 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:58:37 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-244728aa-529d-4dab-a9e3-8c8bfc2b1ab6 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/9e24a210-9e96-45d9-b31c-f6f3377eb0e7/metadata returned with HTTP 200 May 28 12:58:37 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 556/1115] 10.27.203.238 () {64 vars in 1478 bytes} [Tue May 28 12:58:37 2024] GET /share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/9e24a210-9e96-45d9-b31c-f6f3377eb0e7/metadata => generated 308 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:58:37 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-d9c71898-ae8b-4d81-b64e-b8839c4b1da8 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/share-replicas/detail?share_id=df0ea844-5fc1-4d04-8afb-5048ec5dc33f returned with HTTP 200 May 28 12:58:37 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 560/1116] 10.27.203.238 () {64 vars in 1476 bytes} [Tue May 28 12:58:37 2024] GET /share/v2/a3499cb78849424db45e54caac01de92/share-replicas/detail?share_id=df0ea844-5fc1-4d04-8afb-5048ec5dc33f => generated 22 bytes in 16 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:58:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-e951b606-9c9f-4ec4-96f0-8f1e54cb93a2 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:58:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-e951b606-9c9f-4ec4-96f0-8f1e54cb93a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:58:37 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-f703c79a-94d0-4ade-b68a-65da0c803a9e tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] POST http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares May 28 12:58:37 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-a8945c45-d985-4f91-9885-702590ff88f8 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] DELETE http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/shares/df0ea844-5fc1-4d04-8afb-5048ec5dc33f May 28 12:58:37 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-f703c79a-94d0-4ade-b68a-65da0c803a9e tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share": {"share_proto": "nfs", "description": "Tempest's share", "snapshot_id": null, "name": "tempest-tempest-created-share-643271693", "size": 1, "metadata": {}, "is_public": false, "share_type": "10ddeb10-4cbf-44c0-94cd-48a1deaf7383"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:58:37 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-a8945c45-d985-4f91-9885-702590ff88f8 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:37 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-a8945c45-d985-4f91-9885-702590ff88f8 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Calling method 'ShareMixin.delete' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:37 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.v1.shares [None req-a8945c45-d985-4f91-9885-702590ff88f8 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Delete share with id: df0ea844-5fc1-4d04-8afb-5048ec5dc33f May 28 12:58:37 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.v1.shares [None req-f703c79a-94d0-4ade-b68a-65da0c803a9e tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Create NFS share of 1 GB May 28 12:58:37 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1097/2217] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:58:37 2024] POST /identity/v3/auth/tokens => generated 2960 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 12:58:37 l75lg1-v1 neutron-server[77618]: DEBUG neutron.wsgi [-] (77618) accepted ('10.27.203.238', 46862) {{(pid=77618) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 12:58:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bece3b4-9e25-4273-ba26-d79214bcd2ee None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-7bece3b4-9e25-4273-ba26-d79214bcd2ee None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:58:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bece3b4-9e25-4273-ba26-d79214bcd2ee None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:37 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.quota [None req-f703c79a-94d0-4ade-b68a-65da0c803a9e tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Created reservations ['cb776458-6745-483f-ad3b-b0873828866e', '68bed645-dbba-4980-af8c-058928aec870', '76c6c831-19cb-4be1-aa08-bc3460c3b1d4', 'cf0b7dab-70c9-4a50-9d38-129beea6dd01'] {{(pid=98330) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 12:58:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc9deff-56db-4a8b-90d6-d381a1e463cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef17047035e4b518fd5360a01f2da1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc9deff-56db-4a8b-90d6-d381a1e463cf service neutron] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc9deff-56db-4a8b-90d6-d381a1e463cf service neutron] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc9deff-56db-4a8b-90d6-d381a1e463cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc9deff-56db-4a8b-90d6-d381a1e463cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc9deff-56db-4a8b-90d6-d381a1e463cf service neutron] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:37 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1121/2218] 10.27.203.238 () {64 vars in 1432 bytes} [Tue May 28 12:58:37 2024] GET /identity/v3/auth/tokens => generated 2960 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 28 12:58:37 l75lg1-v1 neutron-server[77618]: INFO neutron.wsgi [None req-aebc911c-8887-49f6-884a-94bacff6e144 None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=6bcb84add5bc4d8cb675498201734b6d&name=default HTTP/1.1" status: 200 len: 216 time: 0.0745847 May 28 12:58:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e951b606-9c9f-4ec4-96f0-8f1e54cb93a2 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-e951b606-9c9f-4ec4-96f0-8f1e54cb93a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:58:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e951b606-9c9f-4ec4-96f0-8f1e54cb93a2 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0979c135-ba10-453e-ae0e-073914b48bca None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0979c135-ba10-453e-ae0e-073914b48bca None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0979c135-ba10-453e-ae0e-073914b48bca None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0979c135-ba10-453e-ae0e-073914b48bca None admin] PATH_INFO: `/v3/projects/6bcb84add5bc4d8cb675498201734b6d` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0979c135-ba10-453e-ae0e-073914b48bca None admin] RBAC: Authorizing `identity:delete_project(project_id=6bcb84add5bc4d8cb675498201734b6d)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0979c135-ba10-453e-ae0e-073914b48bca None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:37 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-a8945c45-d985-4f91-9885-702590ff88f8 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/shares/df0ea844-5fc1-4d04-8afb-5048ec5dc33f returned with HTTP 202 May 28 12:58:37 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 557/1117] 10.27.203.238 () {64 vars in 1454 bytes} [Tue May 28 12:58:37 2024] DELETE /share/v2/a3499cb78849424db45e54caac01de92/shares/df0ea844-5fc1-4d04-8afb-5048ec5dc33f => generated 0 bytes in 129 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:58:37 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.quota [None req-f703c79a-94d0-4ade-b68a-65da0c803a9e tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Committed reservations ['cb776458-6745-483f-ad3b-b0873828866e', '68bed645-dbba-4980-af8c-058928aec870', '76c6c831-19cb-4be1-aa08-bc3460c3b1d4', 'cf0b7dab-70c9-4a50-9d38-129beea6dd01'] {{(pid=98330) commit /opt/stack/manila/manila/quota.py:1063}} May 28 12:58:37 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-9fdb8304-409a-4fc7-a194-82da3da1e257 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] POST http://10.27.203.238/share/v1/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action May 28 12:58:37 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-9fdb8304-409a-4fc7-a194-82da3da1e257 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Action body: b'{"os-access_list": null}' {{(pid=98329) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:58:37 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-9fdb8304-409a-4fc7-a194-82da3da1e257 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Action: 'action', calling method: ShareController.access_list, body: {"os-access_list": null} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:58:37 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-9fdb8304-409a-4fc7-a194-82da3da1e257 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] http://10.27.203.238/share/v1/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action returned with HTTP 200 May 28 12:58:37 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 558/1118] 10.27.203.238 () {64 vars in 1450 bytes} [Tue May 28 12:58:37 2024] POST /share/v1/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action => generated 19 bytes in 30 msecs (HTTP/1.1 200) 6 headers in 229 bytes (1 switches on core 0) May 28 12:58:37 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-cd477031-436f-494f-947f-ae0eddb4916b tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] GET http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/shares/df0ea844-5fc1-4d04-8afb-5048ec5dc33f May 28 12:58:37 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-cd477031-436f-494f-947f-ae0eddb4916b tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:37 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-cd477031-436f-494f-947f-ae0eddb4916b tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-0979c135-ba10-453e-ae0e-073914b48bca None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6bcb84add5bc4d8cb675498201734b6d', 'request_id': 'req-0979c135-ba10-453e-ae0e-073914b48bca'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:58:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-0979c135-ba10-453e-ae0e-073914b48bca None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6bcb84add5bc4d8cb675498201734b6d', 'request_id': 'req-0979c135-ba10-453e-ae0e-073914b48bca'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:58:38 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-cd477031-436f-494f-947f-ae0eddb4916b tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/shares/df0ea844-5fc1-4d04-8afb-5048ec5dc33f returned with HTTP 200 May 28 12:58:38 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 559/1119] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:58:37 2024] GET /share/v2/a3499cb78849424db45e54caac01de92/shares/df0ea844-5fc1-4d04-8afb-5048ec5dc33f => generated 1370 bytes in 29 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:58:38 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-c201f561-82f3-4ada-8743-f2d6a7e1cc6e tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] POST http://10.27.203.238/share/v2/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action May 28 12:58:38 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-c201f561-82f3-4ada-8743-f2d6a7e1cc6e tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Action body: b'{"allow_access": {"access_type": "ip", "access_to": "203.0.113.141", "access_level": "rw"}}' {{(pid=98329) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:58:38 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-c201f561-82f3-4ada-8743-f2d6a7e1cc6e tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Action: 'action', calling method: ShareController.allow_access, body: {"allow_access": {"access_type": "ip", "access_to": "203.0.113.141", "access_level": "rw"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:58:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-0979c135-ba10-453e-ae0e-073914b48bca None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6bcb84add5bc4d8cb675498201734b6d', 'request_id': 'req-0979c135-ba10-453e-ae0e-073914b48bca'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:58:38 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.host_manager [None req-f703c79a-94d0-4ade-b68a-65da0c803a9e tempest-SharesMetadataTest-1561320255 None] Share service is down. (host: l75lg1-v1@generic2). May 28 12:58:38 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.host_manager [None req-f703c79a-94d0-4ade-b68a-65da0c803a9e tempest-SharesMetadataTest-1561320255 None] Share service is down. (host: l75lg1-v1@generic1). May 28 12:58:38 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-f703c79a-94d0-4ade-b68a-65da0c803a9e tempest-SharesMetadataTest-1561320255 None] Starting with 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:80}} May 28 12:58:38 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-f703c79a-94d0-4ade-b68a-65da0c803a9e tempest-SharesMetadataTest-1561320255 None] Filter OnlyHostFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:58:38 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-f703c79a-94d0-4ade-b68a-65da0c803a9e tempest-SharesMetadataTest-1561320255 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:58:38 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.capacity [None req-f703c79a-94d0-4ade-b68a-65da0c803a9e tempest-SharesMetadataTest-1561320255 None] Space information for share creation on host l75lg1-v1@vast#vast (requested / avail): 1/2075 {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/capacity.py:83}} May 28 12:58:38 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-a8945c45-d985-4f91-9885-702590ff88f8 tempest-AdminActionsTest-1749172189 None] Acquiring lock "locked_access_rules_operation_by_share_instance_77a25e6b-f137-4342-8eb9-9ced679515e2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:38 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-f703c79a-94d0-4ade-b68a-65da0c803a9e tempest-SharesMetadataTest-1561320255 None] Filter CapacityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:58:38 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-f703c79a-94d0-4ade-b68a-65da0c803a9e tempest-SharesMetadataTest-1561320255 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:58:38 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-a8945c45-d985-4f91-9885-702590ff88f8 tempest-AdminActionsTest-1749172189 None] Lock "locked_access_rules_operation_by_share_instance_77a25e6b-f137-4342-8eb9-9ced679515e2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:38 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-f703c79a-94d0-4ade-b68a-65da0c803a9e tempest-SharesMetadataTest-1561320255 None] Driver Filter: Checking host 'l75lg1-v1@vast#vast' {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:37}} May 28 12:58:38 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-f703c79a-94d0-4ade-b68a-65da0c803a9e tempest-SharesMetadataTest-1561320255 None] Filter function not set :: passing host. {{(pid=98327) _check_filter_function /opt/stack/manila/manila/scheduler/filters/driver.py:53}} May 28 12:58:38 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-f703c79a-94d0-4ade-b68a-65da0c803a9e tempest-SharesMetadataTest-1561320255 None] Result: True {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:40}} May 28 12:58:38 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-f703c79a-94d0-4ade-b68a-65da0c803a9e tempest-SharesMetadataTest-1561320255 None] Done checking host 'l75lg1-v1@vast#vast' {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:41}} May 28 12:58:38 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-f703c79a-94d0-4ade-b68a-65da0c803a9e tempest-SharesMetadataTest-1561320255 None] Filter DriverFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:58:38 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-f703c79a-94d0-4ade-b68a-65da0c803a9e tempest-SharesMetadataTest-1561320255 None] Filter ShareReplicationFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:58:38 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-f703c79a-94d0-4ade-b68a-65da0c803a9e tempest-SharesMetadataTest-1561320255 None] Filter CreateFromSnapshotFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:58:38 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-f703c79a-94d0-4ade-b68a-65da0c803a9e tempest-SharesMetadataTest-1561320255 None] Filter AffinityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:58:38 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-a8945c45-d985-4f91-9885-702590ff88f8 tempest-AdminActionsTest-1749172189 None] Lock "locked_access_rules_operation_by_share_instance_77a25e6b-f137-4342-8eb9-9ced679515e2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:38 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-a8945c45-d985-4f91-9885-702590ff88f8 tempest-AdminActionsTest-1749172189 None] Acquiring lock "locked_access_rules_operation_by_share_instance_77a25e6b-f137-4342-8eb9-9ced679515e2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:38 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-f703c79a-94d0-4ade-b68a-65da0c803a9e tempest-SharesMetadataTest-1561320255 None] Filter AntiAffinityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:58:38 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.drivers.filter [None req-f703c79a-94d0-4ade-b68a-65da0c803a9e tempest-SharesMetadataTest-1561320255 None] Filtered share [host: 'l75lg1-v1@vast#vast', free_capacity_gb: 2075.6229242384434, pools: None] {{(pid=98327) _schedule_share /opt/stack/manila/manila/scheduler/drivers/filter.py:268}} May 28 12:58:38 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-a8945c45-d985-4f91-9885-702590ff88f8 tempest-AdminActionsTest-1749172189 None] Lock "locked_access_rules_operation_by_share_instance_77a25e6b-f137-4342-8eb9-9ced679515e2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:38 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-f703c79a-94d0-4ade-b68a-65da0c803a9e tempest-SharesMetadataTest-1561320255 None] Checking host 'l75lg1-v1@vast#vast' {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:46}} May 28 12:58:38 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.weighers.goodness [None req-f703c79a-94d0-4ade-b68a-65da0c803a9e tempest-SharesMetadataTest-1561320255 None] Goodness function not set :: defaulting to minimal goodness rating of 0. May 28 12:58:38 l75lg1-v1 manila-scheduler[98327]: INFO manila.scheduler.weighers.goodness [None req-f703c79a-94d0-4ade-b68a-65da0c803a9e tempest-SharesMetadataTest-1561320255 None] Goodness function result for host l75lg1-v1@vast#vast: 0. May 28 12:58:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-0979c135-ba10-453e-ae0e-073914b48bca None admin] The token cache is being invalidate because project 6bcb84add5bc4d8cb675498201734b6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 12:58:38 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-f703c79a-94d0-4ade-b68a-65da0c803a9e tempest-SharesMetadataTest-1561320255 None] Goodness: 0 {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:48}} May 28 12:58:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-0979c135-ba10-453e-ae0e-073914b48bca None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:58:38 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-f703c79a-94d0-4ade-b68a-65da0c803a9e tempest-SharesMetadataTest-1561320255 None] Done checking host 'l75lg1-v1@vast#vast' {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:49}} May 28 12:58:38 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-f703c79a-94d0-4ade-b68a-65da0c803a9e tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares returned with HTTP 200 May 28 12:58:38 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.drivers.filter [None req-f703c79a-94d0-4ade-b68a-65da0c803a9e tempest-SharesMetadataTest-1561320255 None] Choosing for share: WeighedHost [host: l75lg1-v1@vast#vast, weight: 0.0] {{(pid=98327) _schedule_share /opt/stack/manila/manila/scheduler/drivers/filter.py:274}} May 28 12:58:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-0979c135-ba10-453e-ae0e-073914b48bca None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:58:38 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 561/1120] 10.27.203.238 () {66 vars in 1362 bytes} [Tue May 28 12:58:37 2024] POST /share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares => generated 1311 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:58:38 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1098/2219] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 12:58:37 2024] DELETE /identity/v3/projects/6bcb84add5bc4d8cb675498201734b6d => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:58:38 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-a8945c45-d985-4f91-9885-702590ff88f8 tempest-AdminActionsTest-1749172189 None] Lock "locked_access_rules_operation_by_share_instance_77a25e6b-f137-4342-8eb9-9ced679515e2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:38 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-a8945c45-d985-4f91-9885-702590ff88f8 tempest-AdminActionsTest-1749172189 None] Acquiring lock "locked_access_rules_operation_by_share_instance_77a25e6b-f137-4342-8eb9-9ced679515e2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:38 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-a8945c45-d985-4f91-9885-702590ff88f8 tempest-AdminActionsTest-1749172189 None] Lock "locked_access_rules_operation_by_share_instance_77a25e6b-f137-4342-8eb9-9ced679515e2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:38 l75lg1-v1 neutron-server[77618]: DEBUG neutron.wsgi [-] (77618) accepted ('10.27.203.238', 46866) {{(pid=77618) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 12:58:38 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-e7d58bee-ae07-405f-b584-511478c30906 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] GET http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/0e9e1ee3-c7cc-4239-bc5b-cace9d44e641 May 28 12:58:38 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-e7d58bee-ae07-405f-b584-511478c30906 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:38 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-e7d58bee-ae07-405f-b584-511478c30906 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:38 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-a8945c45-d985-4f91-9885-702590ff88f8 tempest-AdminActionsTest-1749172189 None] Lock "locked_access_rules_operation_by_share_instance_77a25e6b-f137-4342-8eb9-9ced679515e2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.007s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:38 l75lg1-v1 manila-share[98474]: DEBUG manila.share.access [None req-a8945c45-d985-4f91-9885-702590ff88f8 tempest-AdminActionsTest-1749172189 None] All access rules have been synced for share instance 77a25e6b-f137-4342-8eb9-9ced679515e2 belonging to share df0ea844-5fc1-4d04-8afb-5048ec5dc33f. {{(pid=98474) update_access_rules /opt/stack/manila/manila/share/access.py:304}} May 28 12:58:38 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-a8945c45-d985-4f91-9885-702590ff88f8 tempest-AdminActionsTest-1749172189 None] deleting '/manila/manila-77a25e6b-f137-4342-8eb9-9ced679515e2' May 28 12:58:38 l75lg1-v1 neutron-server[77618]: INFO neutron.wsgi [None req-a2e811fb-9122-4aa0-815d-1b75dcb59561 None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=be51d6e321244991ac955863ae123a81&name=default HTTP/1.1" status: 200 len: 216 time: 0.0086040 May 28 12:58:38 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a8945c45-d985-4f91-9885-702590ff88f8 tempest-AdminActionsTest-1749172189 None] >>> [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/ May 28 12:58:38 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a8945c45-d985-4f91-9885-702590ff88f8 tempest-AdminActionsTest-1749172189 None] {'data': '{"path": "/manila/manila-77a25e6b-f137-4342-8eb9-9ced679515e2"}', May 28 12:58:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc9deff-56db-4a8b-90d6-d381a1e463cf service neutron] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:38 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a8945c45-d985-4f91-9885-702590ff88f8 tempest-AdminActionsTest-1749172189 None] 'params': None} May 28 12:58:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc9deff-56db-4a8b-90d6-d381a1e463cf service neutron] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:38 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-e7d58bee-ae07-405f-b584-511478c30906 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/0e9e1ee3-c7cc-4239-bc5b-cace9d44e641 returned with HTTP 200 May 28 12:58:38 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 562/1121] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:58:38 2024] GET /share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/0e9e1ee3-c7cc-4239-bc5b-cace9d44e641 => generated 1311 bytes in 27 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:58:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601a634e-085c-4fe8-8de3-c7df6a1bf82d None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601a634e-085c-4fe8-8de3-c7df6a1bf82d None admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601a634e-085c-4fe8-8de3-c7df6a1bf82d None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601a634e-085c-4fe8-8de3-c7df6a1bf82d None admin] PATH_INFO: `/v3/projects/be51d6e321244991ac955863ae123a81` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:38 l75lg1-v1 devstack@m-api.service[98329]: DEBUG oslo_concurrency.lockutils [None req-c201f561-82f3-4ada-8743-f2d6a7e1cc6e tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98329) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601a634e-085c-4fe8-8de3-c7df6a1bf82d None admin] RBAC: Authorizing `identity:delete_project(project_id=be51d6e321244991ac955863ae123a81)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:38 l75lg1-v1 devstack@m-api.service[98329]: DEBUG oslo_concurrency.lockutils [None req-c201f561-82f3-4ada-8743-f2d6a7e1cc6e tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98329) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601a634e-085c-4fe8-8de3-c7df6a1bf82d None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-601a634e-085c-4fe8-8de3-c7df6a1bf82d None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be51d6e321244991ac955863ae123a81', 'request_id': 'req-601a634e-085c-4fe8-8de3-c7df6a1bf82d'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:58:38 l75lg1-v1 devstack@m-api.service[98329]: DEBUG oslo_concurrency.lockutils [None req-c201f561-82f3-4ada-8743-f2d6a7e1cc6e tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.045s {{(pid=98329) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:38 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a8945c45-d985-4f91-9885-702590ff88f8 tempest-AdminActionsTest-1749172189 None] <<< [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/ May 28 12:58:38 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a8945c45-d985-4f91-9885-702590ff88f8 tempest-AdminActionsTest-1749172189 None] 'OK' May 28 12:58:38 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a8945c45-d985-4f91-9885-702590ff88f8 tempest-AdminActionsTest-1749172189 None] --- [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/: Done May 28 12:58:38 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a8945c45-d985-4f91-9885-702590ff88f8 tempest-AdminActionsTest-1749172189 None] >>> [GET] https://127.0.0.1:40443/api/views/ May 28 12:58:38 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a8945c45-d985-4f91-9885-702590ff88f8 tempest-AdminActionsTest-1749172189 None] {'allow_redirects': True, May 28 12:58:38 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a8945c45-d985-4f91-9885-702590ff88f8 tempest-AdminActionsTest-1749172189 None] 'params': {'name': '77a25e6b-f137-4342-8eb9-9ced679515e2'}} May 28 12:58:38 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-c201f561-82f3-4ada-8743-f2d6a7e1cc6e tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] http://10.27.203.238/share/v2/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action returned with HTTP 200 May 28 12:58:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-601a634e-085c-4fe8-8de3-c7df6a1bf82d None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be51d6e321244991ac955863ae123a81', 'request_id': 'req-601a634e-085c-4fe8-8de3-c7df6a1bf82d'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:58:38 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 560/1122] 10.27.203.238 () {66 vars in 1493 bytes} [Tue May 28 12:58:38 2024] POST /share/v2/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action => generated 295 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:58:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-601a634e-085c-4fe8-8de3-c7df6a1bf82d None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be51d6e321244991ac955863ae123a81', 'request_id': 'req-601a634e-085c-4fe8-8de3-c7df6a1bf82d'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:58:38 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-c6b6d35b-83cb-4e5b-a3d1-bc9636a5fb15 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] POST http://10.27.203.238/share/v2/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action May 28 12:58:38 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-c6b6d35b-83cb-4e5b-a3d1-bc9636a5fb15 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Action body: b'{"access_list": null}' {{(pid=98330) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:58:38 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-c6b6d35b-83cb-4e5b-a3d1-bc9636a5fb15 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Action: 'action', calling method: ShareController.access_list, body: {"access_list": null} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:58:38 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f703c79a-94d0-4ade-b68a-65da0c803a9e tempest-SharesMetadataTest-1561320255 None] >>> [GET] https://127.0.0.1:40443/api/vippools/ May 28 12:58:38 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f703c79a-94d0-4ade-b68a-65da0c803a9e tempest-SharesMetadataTest-1561320255 None] {'allow_redirects': True, 'params': {'name': 'vippool-1'}} May 28 12:58:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-601a634e-085c-4fe8-8de3-c7df6a1bf82d None admin] The token cache is being invalidate because project be51d6e321244991ac955863ae123a81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 12:58:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-601a634e-085c-4fe8-8de3-c7df6a1bf82d None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:58:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-601a634e-085c-4fe8-8de3-c7df6a1bf82d None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:58:38 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1122/2220] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 12:58:38 2024] DELETE /identity/v3/projects/be51d6e321244991ac955863ae123a81 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:58:38 l75lg1-v1 neutron-server[77618]: DEBUG neutron.wsgi [-] (77618) accepted ('10.27.203.238', 46870) {{(pid=77618) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 12:58:38 l75lg1-v1 manila-share[98474]: DEBUG manila.share.manager [None req-c201f561-82f3-4ada-8743-f2d6a7e1cc6e tempest-ShareIpRulesForNFSTest-1748669711 None] Received request to update access for share instance b7a7d61c-2cea-442a-9809-507038e080d5. {{(pid=98474) update_access_for_instances /opt/stack/manila/manila/share/manager.py:4353}} May 28 12:58:38 l75lg1-v1 neutron-server[77618]: INFO neutron.wsgi [None req-b8663301-be56-4391-956d-ff553dffa2aa None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=82840ccb77144a4aa2d0bdce807ce686&name=default HTTP/1.1" status: 200 len: 216 time: 0.0098922 May 28 12:58:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0979c135-ba10-453e-ae0e-073914b48bca None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-0979c135-ba10-453e-ae0e-073914b48bca None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:58:38 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-c6b6d35b-83cb-4e5b-a3d1-bc9636a5fb15 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] http://10.27.203.238/share/v2/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action returned with HTTP 200 May 28 12:58:38 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 563/1123] 10.27.203.238 () {66 vars in 1493 bytes} [Tue May 28 12:58:38 2024] POST /share/v2/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action => generated 250 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:58:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0979c135-ba10-453e-ae0e-073914b48bca None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:38 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c201f561-82f3-4ada-8743-f2d6a7e1cc6e tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:38 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c201f561-82f3-4ada-8743-f2d6a7e1cc6e tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:38 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c201f561-82f3-4ada-8743-f2d6a7e1cc6e tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:38 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c201f561-82f3-4ada-8743-f2d6a7e1cc6e tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:38 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c201f561-82f3-4ada-8743-f2d6a7e1cc6e tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724f4e02-70c4-4017-b2a4-355e047bdaf5 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724f4e02-70c4-4017-b2a4-355e047bdaf5 None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724f4e02-70c4-4017-b2a4-355e047bdaf5 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724f4e02-70c4-4017-b2a4-355e047bdaf5 None admin] PATH_INFO: `/v3/projects/82840ccb77144a4aa2d0bdce807ce686` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724f4e02-70c4-4017-b2a4-355e047bdaf5 None admin] RBAC: Authorizing `identity:delete_project(project_id=82840ccb77144a4aa2d0bdce807ce686)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724f4e02-70c4-4017-b2a4-355e047bdaf5 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:38 l75lg1-v1 dstat.sh[49771]: 28-05 12:58:38| 22 2 71 3 0|5725M 1756M 277M 7867M| 22k 9209B| 0 2646k| 0 455 | 10k 18k|1.20 1.06 1.01| 0 1.0 2.0| 0 0 | 0 2048M| 29 358 0 33 0 May 28 12:58:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-724f4e02-70c4-4017-b2a4-355e047bdaf5 None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82840ccb77144a4aa2d0bdce807ce686', 'request_id': 'req-724f4e02-70c4-4017-b2a4-355e047bdaf5'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:58:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-724f4e02-70c4-4017-b2a4-355e047bdaf5 None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82840ccb77144a4aa2d0bdce807ce686', 'request_id': 'req-724f4e02-70c4-4017-b2a4-355e047bdaf5'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:58:38 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c201f561-82f3-4ada-8743-f2d6a7e1cc6e tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.086s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:38 l75lg1-v1 manila-share[98474]: DEBUG manila.share.access [None req-c201f561-82f3-4ada-8743-f2d6a7e1cc6e tempest-ShareIpRulesForNFSTest-1748669711 None] Updating access rules for share instance b7a7d61c-2cea-442a-9809-507038e080d5 belonging to share 1ddadc17-cf10-4a42-8bbd-8335fb3520a1. {{(pid=98474) update_access_rules /opt/stack/manila/manila/share/access.py:298}} May 28 12:58:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-724f4e02-70c4-4017-b2a4-355e047bdaf5 None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82840ccb77144a4aa2d0bdce807ce686', 'request_id': 'req-724f4e02-70c4-4017-b2a4-355e047bdaf5'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:58:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-724f4e02-70c4-4017-b2a4-355e047bdaf5 None admin] The token cache is being invalidate because project 82840ccb77144a4aa2d0bdce807ce686 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 12:58:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-724f4e02-70c4-4017-b2a4-355e047bdaf5 None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:58:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-724f4e02-70c4-4017-b2a4-355e047bdaf5 None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:58:38 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1099/2221] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 12:58:38 2024] DELETE /identity/v3/projects/82840ccb77144a4aa2d0bdce807ce686 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:58:38 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c201f561-82f3-4ada-8743-f2d6a7e1cc6e tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:38 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c201f561-82f3-4ada-8743-f2d6a7e1cc6e tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c91855-9144-4c65-850f-b52082c71ef5 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c91855-9144-4c65-850f-b52082c71ef5 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c91855-9144-4c65-850f-b52082c71ef5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:38 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c201f561-82f3-4ada-8743-f2d6a7e1cc6e tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.008s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:38 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c201f561-82f3-4ada-8743-f2d6a7e1cc6e tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:38 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c201f561-82f3-4ada-8743-f2d6a7e1cc6e tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:38 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-c6c91855-9144-4c65-850f-b52082c71ef5 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:58:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-c6c91855-9144-4c65-850f-b52082c71ef5 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:58:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-c6c91855-9144-4c65-850f-b52082c71ef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:58:38 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1123/2222] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:58:38 2024] POST /identity/v3/auth/tokens => generated 312 bytes in 21 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 28 12:58:38 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c201f561-82f3-4ada-8743-f2d6a7e1cc6e tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.015s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:38 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-c201f561-82f3-4ada-8743-f2d6a7e1cc6e tempest-ShareIpRulesForNFSTest-1748669711 None] changing access on None May 28 12:58:38 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c201f561-82f3-4ada-8743-f2d6a7e1cc6e tempest-ShareIpRulesForNFSTest-1748669711 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:58:38 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c201f561-82f3-4ada-8743-f2d6a7e1cc6e tempest-ShareIpRulesForNFSTest-1748669711 None] {'allow_redirects': True, May 28 12:58:38 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c201f561-82f3-4ada-8743-f2d6a7e1cc6e tempest-ShareIpRulesForNFSTest-1748669711 None] 'params': {'name': 'b7a7d61c-2cea-442a-9809-507038e080d5'}} May 28 12:58:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca15bce3-ad10-49f7-a7da-1eee7657a849 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca15bce3-ad10-49f7-a7da-1eee7657a849 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca15bce3-ad10-49f7-a7da-1eee7657a849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:38 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-ca15bce3-ad10-49f7-a7da-1eee7657a849 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:58:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-ca15bce3-ad10-49f7-a7da-1eee7657a849 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:58:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-ca15bce3-ad10-49f7-a7da-1eee7657a849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:58:38 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1100/2223] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:58:38 2024] POST /identity/v3/auth/tokens => generated 2960 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 12:58:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c91855-9144-4c65-850f-b52082c71ef5 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c91855-9144-4c65-850f-b52082c71ef5 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c11cbb8-c607-4ebb-a101-9a92d2b805bd None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c11cbb8-c607-4ebb-a101-9a92d2b805bd None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c11cbb8-c607-4ebb-a101-9a92d2b805bd None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c11cbb8-c607-4ebb-a101-9a92d2b805bd None admin] PATH_INFO: `/v3/domains` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c11cbb8-c607-4ebb-a101-9a92d2b805bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=51267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:58:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c11cbb8-c607-4ebb-a101-9a92d2b805bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c11cbb8-c607-4ebb-a101-9a92d2b805bd None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:38 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1124/2224] 10.27.203.238 () {62 vars in 1220 bytes} [Tue May 28 12:58:38 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:58:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca15bce3-ad10-49f7-a7da-1eee7657a849 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca15bce3-ad10-49f7-a7da-1eee7657a849 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b54e0ad-8e7d-487e-bcc8-10cb104303c1 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b54e0ad-8e7d-487e-bcc8-10cb104303c1 None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b54e0ad-8e7d-487e-bcc8-10cb104303c1 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b54e0ad-8e7d-487e-bcc8-10cb104303c1 None admin] PATH_INFO: `/v3/projects` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b54e0ad-8e7d-487e-bcc8-10cb104303c1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b54e0ad-8e7d-487e-bcc8-10cb104303c1 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:38 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1101/2225] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 12:58:38 2024] POST /identity/v3/projects => generated 409 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:58:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c11cbb8-c607-4ebb-a101-9a92d2b805bd None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c11cbb8-c607-4ebb-a101-9a92d2b805bd None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516b0820-8ce8-467e-9d77-700c8e18b71e None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516b0820-8ce8-467e-9d77-700c8e18b71e None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516b0820-8ce8-467e-9d77-700c8e18b71e None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516b0820-8ce8-467e-9d77-700c8e18b71e None admin] PATH_INFO: `/v3/users` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516b0820-8ce8-467e-9d77-700c8e18b71e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516b0820-8ce8-467e-9d77-700c8e18b71e None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:38 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-516b0820-8ce8-467e-9d77-700c8e18b71e None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 12:58:38 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1125/2226] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 12:58:38 2024] POST /identity/v3/users => generated 313 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:58:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b54e0ad-8e7d-487e-bcc8-10cb104303c1 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:38 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a8945c45-d985-4f91-9885-702590ff88f8 tempest-AdminActionsTest-1749172189 None] <<< [GET] https://127.0.0.1:40443/api/views/ May 28 12:58:38 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a8945c45-d985-4f91-9885-702590ff88f8 tempest-AdminActionsTest-1749172189 None] [Bunch(abac_tags=[], abe_max_depth=None, abe_protocols=[], alias='', allow_anonymous_access=False, allow_s3_anonymous_access=False, auto_commit='0d', bucket='', bucket_creators=[], bucket_creators_groups=[], bucket_owner=None, bulk_permission_update_progress=None, bulk_permission_update_state=None, cluster='loop75-kfs', cluster_id=1, created='2024-05-28T12:56:28.966384Z', enabled=True, files_retention_mode='NONE', guid='2129ed17-4cc5-4119-86d1-459930d8696c', id=3, ignore_oos=False, internal=False, is_remote=False, is_seamless=False, logical_capacity=0, max_retention_period='0d', min_retention_period='0d', name='77a25e6b-f137-4342-8eb9-9ced679515e2', nfs_interop_flags='BOTH_NFS3_AND_NFS4_INTEROP_DISABLED', path='/manila/manila-77a25e6b-f137-4342-8eb9-9ced679515e2', physical_capacity=0, policy='77a25e6b-f137-4342-8eb9-9ced679515e2', policy_id=4, protocols=['NFS'], qos_policy=None, qos_policy_id=None, s3_locks=False, s3_locks_retention_mode='NONE', s3_locks_retention_period='', s3_unverified_lookup=False, s3_versioning=False, select_for_live_monitoring=False, share='', share_acl=Bunch(acl=[], enabled=False), sync='SYNCED', sync_time='2024-05-28T12:57:08.454816Z', tenant_id=1, tenant_name='default', title='/manila/manila-77a25e6b-f137-4342-8eb9-9ced679515e2', url='https://127.0.0.1:40443/api/views/3/')] May 28 12:58:38 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a8945c45-d985-4f91-9885-702590ff88f8 tempest-AdminActionsTest-1749172189 None] --- [GET] https://127.0.0.1:40443/api/views/: Done May 28 12:58:38 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a8945c45-d985-4f91-9885-702590ff88f8 tempest-AdminActionsTest-1749172189 None] >>> [DELETE] https://127.0.0.1:40443/api/views/3/ May 28 12:58:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b54e0ad-8e7d-487e-bcc8-10cb104303c1 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e5ffd6-64e8-444a-975b-0f3a61eb120a None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e5ffd6-64e8-444a-975b-0f3a61eb120a None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e5ffd6-64e8-444a-975b-0f3a61eb120a None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e5ffd6-64e8-444a-975b-0f3a61eb120a None admin] PATH_INFO: `/v3/roles` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e5ffd6-64e8-444a-975b-0f3a61eb120a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e5ffd6-64e8-444a-975b-0f3a61eb120a None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:38 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1102/2227] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 12:58:38 2024] GET /identity/v3/roles => generated 1680 bytes in 18 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:58:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516b0820-8ce8-467e-9d77-700c8e18b71e None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516b0820-8ce8-467e-9d77-700c8e18b71e None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7594c2d0-822e-46fa-9d45-4348c22c822e None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7594c2d0-822e-46fa-9d45-4348c22c822e None admin] REQUEST_METHOD: `PUT` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7594c2d0-822e-46fa-9d45-4348c22c822e None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7594c2d0-822e-46fa-9d45-4348c22c822e None admin] PATH_INFO: `/v3/projects/a7bb97bbf59e4210bf09d9f3fb3183bb/users/d357b32489a64877881655e37d5890c6/roles/44620cad10ae407c90c91e2c296adb04` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7594c2d0-822e-46fa-9d45-4348c22c822e None admin] RBAC: Authorizing `identity:create_grant(project_id=a7bb97bbf59e4210bf09d9f3fb3183bb, user_id=d357b32489a64877881655e37d5890c6, role_id=44620cad10ae407c90c91e2c296adb04)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7594c2d0-822e-46fa-9d45-4348c22c822e None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:38 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1126/2228] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 12:58:38 2024] PUT /identity/v3/projects/a7bb97bbf59e4210bf09d9f3fb3183bb/users/d357b32489a64877881655e37d5890c6/roles/44620cad10ae407c90c91e2c296adb04 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:58:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90be72bc-d366-4bb7-91dd-a8e8d7aa55ee None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90be72bc-d366-4bb7-91dd-a8e8d7aa55ee None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90be72bc-d366-4bb7-91dd-a8e8d7aa55ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:38 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-90be72bc-d366-4bb7-91dd-a8e8d7aa55ee None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:58:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-90be72bc-d366-4bb7-91dd-a8e8d7aa55ee None None] MFA Rules not processed for user `d357b32489a64877881655e37d5890c6`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:58:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-90be72bc-d366-4bb7-91dd-a8e8d7aa55ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:58:38 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1103/2229] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:58:38 2024] POST /identity/v3/auth/tokens => generated 3980 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:58:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7594c2d0-822e-46fa-9d45-4348c22c822e None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7594c2d0-822e-46fa-9d45-4348c22c822e None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5d32d9-9d23-4db4-a2cc-440e15c93e48 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5d32d9-9d23-4db4-a2cc-440e15c93e48 None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5d32d9-9d23-4db4-a2cc-440e15c93e48 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5d32d9-9d23-4db4-a2cc-440e15c93e48 None admin] PATH_INFO: `/v3/projects` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5d32d9-9d23-4db4-a2cc-440e15c93e48 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5d32d9-9d23-4db4-a2cc-440e15c93e48 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:38 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1127/2230] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 12:58:38 2024] POST /identity/v3/projects => generated 409 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:58:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90be72bc-d366-4bb7-91dd-a8e8d7aa55ee None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90be72bc-d366-4bb7-91dd-a8e8d7aa55ee None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fc1ce3-fcf7-4c79-b250-d4d5b656dcc1 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fc1ce3-fcf7-4c79-b250-d4d5b656dcc1 None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fc1ce3-fcf7-4c79-b250-d4d5b656dcc1 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fc1ce3-fcf7-4c79-b250-d4d5b656dcc1 None admin] PATH_INFO: `/v3/users` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fc1ce3-fcf7-4c79-b250-d4d5b656dcc1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fc1ce3-fcf7-4c79-b250-d4d5b656dcc1 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:38 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-b3fc1ce3-fcf7-4c79-b250-d4d5b656dcc1 None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 12:58:38 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f703c79a-94d0-4ade-b68a-65da0c803a9e tempest-SharesMetadataTest-1561320255 None] <<< [GET] https://127.0.0.1:40443/api/vippools/ May 28 12:58:38 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f703c79a-94d0-4ade-b68a-65da0c803a9e tempest-SharesMetadataTest-1561320255 None] [Bunch(active_cnode_ids=[], active_interfaces=4, cluster='loop75-kfs', cluster_id=1, cnode_ids=[], cnodes=[], domain_name='vippool-1', enable_l3=False, enable_weighted_balancing=False, enabled=True, end_ip='172.21.75.4', guid='f2abaede-b397-413a-8faa-3aeead6d3b28', gw_ip='', gw_ipv6='', id=2, ip_ranges=[['172.21.75.1', '172.21.75.4']], name='vippool-1', peer_asn=0, port_membership='ALL', ranges_summary='172.21.75.[1-4]', role='PROTOCOLS', start_ip='172.21.75.1', subnet_cidr=16, subnet_cidr_ipv6=None, sync='SYNCED', sync_time='2024-05-28T12:50:09.644123Z', tenant_id=1, tenant_name='default', title='172.21.75.1 - 172.21.75.4', url='https://127.0.0.1:40443/api/vippools/2/', vast_asn=0, vlan=0, vms_preferred=False)] May 28 12:58:38 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f703c79a-94d0-4ade-b68a-65da0c803a9e tempest-SharesMetadataTest-1561320255 None] --- [GET] https://127.0.0.1:40443/api/vippools/: Done May 28 12:58:38 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f703c79a-94d0-4ade-b68a-65da0c803a9e tempest-SharesMetadataTest-1561320255 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:58:38 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f703c79a-94d0-4ade-b68a-65da0c803a9e tempest-SharesMetadataTest-1561320255 None] {'allow_redirects': True, May 28 12:58:38 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f703c79a-94d0-4ade-b68a-65da0c803a9e tempest-SharesMetadataTest-1561320255 None] 'params': {'name': '922a313f-547d-4129-ae7c-39ae549d3f49'}} May 28 12:58:38 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1104/2231] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 12:58:38 2024] POST /identity/v3/users => generated 313 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:58:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5d32d9-9d23-4db4-a2cc-440e15c93e48 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5d32d9-9d23-4db4-a2cc-440e15c93e48 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ca1c69-1b3d-4d14-b7d4-2b66ddcb0dc7 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ca1c69-1b3d-4d14-b7d4-2b66ddcb0dc7 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ca1c69-1b3d-4d14-b7d4-2b66ddcb0dc7 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ca1c69-1b3d-4d14-b7d4-2b66ddcb0dc7 None admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ca1c69-1b3d-4d14-b7d4-2b66ddcb0dc7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ca1c69-1b3d-4d14-b7d4-2b66ddcb0dc7 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:38 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1128/2232] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 12:58:38 2024] GET /identity/v3/roles => generated 1680 bytes in 19 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:58:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fc1ce3-fcf7-4c79-b250-d4d5b656dcc1 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fc1ce3-fcf7-4c79-b250-d4d5b656dcc1 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa493b9e-d065-4a7f-ab1d-f30485569d75 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa493b9e-d065-4a7f-ab1d-f30485569d75 None admin] REQUEST_METHOD: `PUT` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa493b9e-d065-4a7f-ab1d-f30485569d75 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa493b9e-d065-4a7f-ab1d-f30485569d75 None admin] PATH_INFO: `/v3/projects/c68833028e534be787b6190315807f3c/users/258f6dfafbbd41dfbe6203b1e09b1c49/roles/44620cad10ae407c90c91e2c296adb04` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa493b9e-d065-4a7f-ab1d-f30485569d75 None admin] RBAC: Authorizing `identity:create_grant(project_id=c68833028e534be787b6190315807f3c, user_id=258f6dfafbbd41dfbe6203b1e09b1c49, role_id=44620cad10ae407c90c91e2c296adb04)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa493b9e-d065-4a7f-ab1d-f30485569d75 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:38 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1105/2233] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 12:58:38 2024] PUT /identity/v3/projects/c68833028e534be787b6190315807f3c/users/258f6dfafbbd41dfbe6203b1e09b1c49/roles/44620cad10ae407c90c91e2c296adb04 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:58:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd1e8a6-93f3-44ed-af64-40d50381b003 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd1e8a6-93f3-44ed-af64-40d50381b003 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd1e8a6-93f3-44ed-af64-40d50381b003 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:38 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-dfd1e8a6-93f3-44ed-af64-40d50381b003 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:58:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-dfd1e8a6-93f3-44ed-af64-40d50381b003 None None] MFA Rules not processed for user `258f6dfafbbd41dfbe6203b1e09b1c49`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:58:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-dfd1e8a6-93f3-44ed-af64-40d50381b003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:58:38 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c201f561-82f3-4ada-8743-f2d6a7e1cc6e tempest-ShareIpRulesForNFSTest-1748669711 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:58:38 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1129/2234] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:58:38 2024] POST /identity/v3/auth/tokens => generated 3980 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:58:38 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c201f561-82f3-4ada-8743-f2d6a7e1cc6e tempest-ShareIpRulesForNFSTest-1748669711 None] [Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=1, created='2024-05-28T12:57:40.763635Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='377955ad-d094-4e49-ab32-1021d943a572', id=21, internal=False, is_s3_default_policy=False, name='b7a7d61c-2cea-442a-9809-507038e080d5', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=['*'], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=[], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=[], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T12:58:37.320868Z', tenant_id=1, tenant_name='default', title='b7a7d61c-2cea-442a-9809-507038e080d5', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/21/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[])] May 28 12:58:38 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c201f561-82f3-4ada-8743-f2d6a7e1cc6e tempest-ShareIpRulesForNFSTest-1748669711 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 12:58:38 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-c201f561-82f3-4ada-8743-f2d6a7e1cc6e tempest-ShareIpRulesForNFSTest-1748669711 None] changing access on /manila/manila-b7a7d61c-2cea-442a-9809-507038e080d5. Rules: {'nfs_read_write': ['203.0.113.141'], 'nfs_read_only': []} May 28 12:58:38 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c201f561-82f3-4ada-8743-f2d6a7e1cc6e tempest-ShareIpRulesForNFSTest-1748669711 None] >>> [PATCH] https://127.0.0.1:40443/api/viewpolicies/21/ May 28 12:58:38 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c201f561-82f3-4ada-8743-f2d6a7e1cc6e tempest-ShareIpRulesForNFSTest-1748669711 None] {'data': '{"name": "b7a7d61c-2cea-442a-9809-507038e080d5", "nfs_no_squash": ' May 28 12:58:38 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c201f561-82f3-4ada-8743-f2d6a7e1cc6e tempest-ShareIpRulesForNFSTest-1748669711 None] '["*"], "nfs_root_squash": ["*"], "nfs_read_write": ' May 28 12:58:38 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c201f561-82f3-4ada-8743-f2d6a7e1cc6e tempest-ShareIpRulesForNFSTest-1748669711 None] '["203.0.113.141"], "nfs_read_only": []}', May 28 12:58:38 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c201f561-82f3-4ada-8743-f2d6a7e1cc6e tempest-ShareIpRulesForNFSTest-1748669711 None] 'params': None} May 28 12:58:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa493b9e-d065-4a7f-ab1d-f30485569d75 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa493b9e-d065-4a7f-ab1d-f30485569d75 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb8fe02-e00c-441a-8430-7b1de859eb30 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb8fe02-e00c-441a-8430-7b1de859eb30 None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb8fe02-e00c-441a-8430-7b1de859eb30 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb8fe02-e00c-441a-8430-7b1de859eb30 None admin] PATH_INFO: `/v3/projects` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb8fe02-e00c-441a-8430-7b1de859eb30 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb8fe02-e00c-441a-8430-7b1de859eb30 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:38 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1106/2235] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 12:58:38 2024] POST /identity/v3/projects => generated 411 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:58:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd1e8a6-93f3-44ed-af64-40d50381b003 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd1e8a6-93f3-44ed-af64-40d50381b003 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9a6931-f96a-4819-9aed-c1e308244467 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9a6931-f96a-4819-9aed-c1e308244467 None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9a6931-f96a-4819-9aed-c1e308244467 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9a6931-f96a-4819-9aed-c1e308244467 None admin] PATH_INFO: `/v3/users` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9a6931-f96a-4819-9aed-c1e308244467 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9a6931-f96a-4819-9aed-c1e308244467 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-0b9a6931-f96a-4819-9aed-c1e308244467 None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1130/2236] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 12:58:38 2024] POST /identity/v3/users => generated 313 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb8fe02-e00c-441a-8430-7b1de859eb30 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb8fe02-e00c-441a-8430-7b1de859eb30 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35818b73-40b9-4f56-b05b-d42b670907cb None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35818b73-40b9-4f56-b05b-d42b670907cb None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35818b73-40b9-4f56-b05b-d42b670907cb None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35818b73-40b9-4f56-b05b-d42b670907cb None admin] PATH_INFO: `/v3/roles` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35818b73-40b9-4f56-b05b-d42b670907cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35818b73-40b9-4f56-b05b-d42b670907cb None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1107/2237] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 12:58:39 2024] GET /identity/v3/roles => generated 1680 bytes in 17 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9a6931-f96a-4819-9aed-c1e308244467 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9a6931-f96a-4819-9aed-c1e308244467 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:39 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f703c79a-94d0-4ade-b68a-65da0c803a9e tempest-SharesMetadataTest-1561320255 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:58:39 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f703c79a-94d0-4ade-b68a-65da0c803a9e tempest-SharesMetadataTest-1561320255 None] [] May 28 12:58:39 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f703c79a-94d0-4ade-b68a-65da0c803a9e tempest-SharesMetadataTest-1561320255 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 12:58:39 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f703c79a-94d0-4ade-b68a-65da0c803a9e tempest-SharesMetadataTest-1561320255 None] >>> [POST] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:58:39 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f703c79a-94d0-4ade-b68a-65da0c803a9e tempest-SharesMetadataTest-1561320255 None] {'data': '{"name": "922a313f-547d-4129-ae7c-39ae549d3f49"}', May 28 12:58:39 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f703c79a-94d0-4ade-b68a-65da0c803a9e tempest-SharesMetadataTest-1561320255 None] 'json': None, May 28 12:58:39 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f703c79a-94d0-4ade-b68a-65da0c803a9e tempest-SharesMetadataTest-1561320255 None] 'params': None} May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040d072e-2210-47dd-b4f8-9eaaa4cfa032 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040d072e-2210-47dd-b4f8-9eaaa4cfa032 None admin] REQUEST_METHOD: `PUT` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040d072e-2210-47dd-b4f8-9eaaa4cfa032 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040d072e-2210-47dd-b4f8-9eaaa4cfa032 None admin] PATH_INFO: `/v3/projects/aa65c35c7f4b4ef09eb79ff5afb5b3b6/users/500dc1e5dbef40b89cddabee2b44f283/roles/e7989893488f483baa107be56668c4f8` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040d072e-2210-47dd-b4f8-9eaaa4cfa032 None admin] RBAC: Authorizing `identity:create_grant(project_id=aa65c35c7f4b4ef09eb79ff5afb5b3b6, user_id=500dc1e5dbef40b89cddabee2b44f283, role_id=e7989893488f483baa107be56668c4f8)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040d072e-2210-47dd-b4f8-9eaaa4cfa032 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1131/2238] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 12:58:39 2024] PUT /identity/v3/projects/aa65c35c7f4b4ef09eb79ff5afb5b3b6/users/500dc1e5dbef40b89cddabee2b44f283/roles/e7989893488f483baa107be56668c4f8 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35818b73-40b9-4f56-b05b-d42b670907cb None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35818b73-40b9-4f56-b05b-d42b670907cb None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505dec22-76c1-4ec5-ad88-d6ddcc2116c2 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505dec22-76c1-4ec5-ad88-d6ddcc2116c2 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505dec22-76c1-4ec5-ad88-d6ddcc2116c2 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505dec22-76c1-4ec5-ad88-d6ddcc2116c2 None admin] PATH_INFO: `/v3/roles` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505dec22-76c1-4ec5-ad88-d6ddcc2116c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505dec22-76c1-4ec5-ad88-d6ddcc2116c2 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1108/2239] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 12:58:39 2024] GET /identity/v3/roles => generated 1680 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040d072e-2210-47dd-b4f8-9eaaa4cfa032 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040d072e-2210-47dd-b4f8-9eaaa4cfa032 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72752fc6-4f1a-47d0-ace6-9b051b26fb56 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72752fc6-4f1a-47d0-ace6-9b051b26fb56 None admin] REQUEST_METHOD: `PUT` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72752fc6-4f1a-47d0-ace6-9b051b26fb56 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72752fc6-4f1a-47d0-ace6-9b051b26fb56 None admin] PATH_INFO: `/v3/projects/aa65c35c7f4b4ef09eb79ff5afb5b3b6/users/500dc1e5dbef40b89cddabee2b44f283/roles/e7989893488f483baa107be56668c4f8` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72752fc6-4f1a-47d0-ace6-9b051b26fb56 None admin] RBAC: Authorizing `identity:create_grant(project_id=aa65c35c7f4b4ef09eb79ff5afb5b3b6, user_id=500dc1e5dbef40b89cddabee2b44f283, role_id=e7989893488f483baa107be56668c4f8)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72752fc6-4f1a-47d0-ace6-9b051b26fb56 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1132/2240] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 12:58:39 2024] PUT /identity/v3/projects/aa65c35c7f4b4ef09eb79ff5afb5b3b6/users/500dc1e5dbef40b89cddabee2b44f283/roles/e7989893488f483baa107be56668c4f8 => generated 0 bytes in 20 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc73a9f-beb0-43db-bb22-56d5c993b497 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc73a9f-beb0-43db-bb22-56d5c993b497 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc73a9f-beb0-43db-bb22-56d5c993b497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-2bc73a9f-beb0-43db-bb22-56d5c993b497 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-2bc73a9f-beb0-43db-bb22-56d5c993b497 None None] MFA Rules not processed for user `500dc1e5dbef40b89cddabee2b44f283`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-2bc73a9f-beb0-43db-bb22-56d5c993b497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:58:39 l75lg1-v1 dstat.sh[49771]: 28-05 12:58:39| 11 2 85 2 0|5725M 1756M 277M 7867M| 25k 3812B| 0 2288k| 0 262 |7172 13k|1.20 1.06 1.01|2.0 1.0 0| 0 0 | 0 2048M| 29 358 0 31 0 May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1109/2241] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:58:39 2024] POST /identity/v3/auth/tokens => generated 4105 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72752fc6-4f1a-47d0-ace6-9b051b26fb56 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72752fc6-4f1a-47d0-ace6-9b051b26fb56 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6edb22b-649d-4fa9-9786-0d7b0a71feac tempest-ShareCephxRulesForCephFSNegativeTest-1093541641 tempest-ShareCephxRulesForCephFSNegativeTest-1093541641-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '500dc1e5dbef40b89cddabee2b44f283', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa65c35c7f4b4ef09eb79ff5afb5b3b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6edb22b-649d-4fa9-9786-0d7b0a71feac tempest-ShareCephxRulesForCephFSNegativeTest-1093541641 tempest-ShareCephxRulesForCephFSNegativeTest-1093541641-project-admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6edb22b-649d-4fa9-9786-0d7b0a71feac tempest-ShareCephxRulesForCephFSNegativeTest-1093541641 tempest-ShareCephxRulesForCephFSNegativeTest-1093541641-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6edb22b-649d-4fa9-9786-0d7b0a71feac tempest-ShareCephxRulesForCephFSNegativeTest-1093541641 tempest-ShareCephxRulesForCephFSNegativeTest-1093541641-project-admin] PATH_INFO: `/v3/domains` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6edb22b-649d-4fa9-9786-0d7b0a71feac tempest-ShareCephxRulesForCephFSNegativeTest-1093541641 tempest-ShareCephxRulesForCephFSNegativeTest-1093541641-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=51267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6edb22b-649d-4fa9-9786-0d7b0a71feac tempest-ShareCephxRulesForCephFSNegativeTest-1093541641 tempest-ShareCephxRulesForCephFSNegativeTest-1093541641-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6edb22b-649d-4fa9-9786-0d7b0a71feac tempest-ShareCephxRulesForCephFSNegativeTest-1093541641 tempest-ShareCephxRulesForCephFSNegativeTest-1093541641-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1133/2242] 10.27.203.238 () {62 vars in 1241 bytes} [Tue May 28 12:58:39 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc73a9f-beb0-43db-bb22-56d5c993b497 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc73a9f-beb0-43db-bb22-56d5c993b497 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f774f0-4203-4a7d-a64b-9802753955ec tempest-ShareCephxRulesForCephFSNegativeTest-1093541641 tempest-ShareCephxRulesForCephFSNegativeTest-1093541641-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '500dc1e5dbef40b89cddabee2b44f283', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa65c35c7f4b4ef09eb79ff5afb5b3b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f774f0-4203-4a7d-a64b-9802753955ec tempest-ShareCephxRulesForCephFSNegativeTest-1093541641 tempest-ShareCephxRulesForCephFSNegativeTest-1093541641-project-admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f774f0-4203-4a7d-a64b-9802753955ec tempest-ShareCephxRulesForCephFSNegativeTest-1093541641 tempest-ShareCephxRulesForCephFSNegativeTest-1093541641-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f774f0-4203-4a7d-a64b-9802753955ec tempest-ShareCephxRulesForCephFSNegativeTest-1093541641 tempest-ShareCephxRulesForCephFSNegativeTest-1093541641-project-admin] PATH_INFO: `/v3/users` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f774f0-4203-4a7d-a64b-9802753955ec tempest-ShareCephxRulesForCephFSNegativeTest-1093541641 tempest-ShareCephxRulesForCephFSNegativeTest-1093541641-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f774f0-4203-4a7d-a64b-9802753955ec tempest-ShareCephxRulesForCephFSNegativeTest-1093541641 tempest-ShareCephxRulesForCephFSNegativeTest-1093541641-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-a0f774f0-4203-4a7d-a64b-9802753955ec tempest-ShareCephxRulesForCephFSNegativeTest-1093541641 tempest-ShareCephxRulesForCephFSNegativeTest-1093541641-project-admin] Truncating password to algorithm specific maximum length 72 characters. May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1110/2243] 10.27.203.238 () {64 vars in 1232 bytes} [Tue May 28 12:58:39 2024] POST /identity/v3/users => generated 435 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6edb22b-649d-4fa9-9786-0d7b0a71feac tempest-ShareCephxRulesForCephFSNegativeTest-1093541641 tempest-ShareCephxRulesForCephFSNegativeTest-1093541641-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6edb22b-649d-4fa9-9786-0d7b0a71feac tempest-ShareCephxRulesForCephFSNegativeTest-1093541641 tempest-ShareCephxRulesForCephFSNegativeTest-1093541641-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e84556-d871-46af-afe1-181784009a81 tempest-ShareCephxRulesForCephFSNegativeTest-1093541641 tempest-ShareCephxRulesForCephFSNegativeTest-1093541641-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '500dc1e5dbef40b89cddabee2b44f283', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa65c35c7f4b4ef09eb79ff5afb5b3b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e84556-d871-46af-afe1-181784009a81 tempest-ShareCephxRulesForCephFSNegativeTest-1093541641 tempest-ShareCephxRulesForCephFSNegativeTest-1093541641-project-admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e84556-d871-46af-afe1-181784009a81 tempest-ShareCephxRulesForCephFSNegativeTest-1093541641 tempest-ShareCephxRulesForCephFSNegativeTest-1093541641-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e84556-d871-46af-afe1-181784009a81 tempest-ShareCephxRulesForCephFSNegativeTest-1093541641 tempest-ShareCephxRulesForCephFSNegativeTest-1093541641-project-admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e84556-d871-46af-afe1-181784009a81 tempest-ShareCephxRulesForCephFSNegativeTest-1093541641 tempest-ShareCephxRulesForCephFSNegativeTest-1093541641-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e84556-d871-46af-afe1-181784009a81 tempest-ShareCephxRulesForCephFSNegativeTest-1093541641 tempest-ShareCephxRulesForCephFSNegativeTest-1093541641-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1134/2244] 10.27.203.238 () {62 vars in 1210 bytes} [Tue May 28 12:58:39 2024] GET /identity/v3/roles => generated 1680 bytes in 18 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f774f0-4203-4a7d-a64b-9802753955ec tempest-ShareCephxRulesForCephFSNegativeTest-1093541641 tempest-ShareCephxRulesForCephFSNegativeTest-1093541641-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f774f0-4203-4a7d-a64b-9802753955ec tempest-ShareCephxRulesForCephFSNegativeTest-1093541641 tempest-ShareCephxRulesForCephFSNegativeTest-1093541641-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e651478c-7047-47a7-a2f3-fe2915bc5f8d tempest-ShareCephxRulesForCephFSNegativeTest-1093541641 tempest-ShareCephxRulesForCephFSNegativeTest-1093541641-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '500dc1e5dbef40b89cddabee2b44f283', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa65c35c7f4b4ef09eb79ff5afb5b3b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e651478c-7047-47a7-a2f3-fe2915bc5f8d tempest-ShareCephxRulesForCephFSNegativeTest-1093541641 tempest-ShareCephxRulesForCephFSNegativeTest-1093541641-project-admin] REQUEST_METHOD: `PUT` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e651478c-7047-47a7-a2f3-fe2915bc5f8d tempest-ShareCephxRulesForCephFSNegativeTest-1093541641 tempest-ShareCephxRulesForCephFSNegativeTest-1093541641-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e651478c-7047-47a7-a2f3-fe2915bc5f8d tempest-ShareCephxRulesForCephFSNegativeTest-1093541641 tempest-ShareCephxRulesForCephFSNegativeTest-1093541641-project-admin] PATH_INFO: `/v3/projects/aa65c35c7f4b4ef09eb79ff5afb5b3b6/users/bd43e5d1c359462d807b6e8a8581fa73/roles/44620cad10ae407c90c91e2c296adb04` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e651478c-7047-47a7-a2f3-fe2915bc5f8d tempest-ShareCephxRulesForCephFSNegativeTest-1093541641 tempest-ShareCephxRulesForCephFSNegativeTest-1093541641-project-admin] RBAC: Authorizing `identity:create_grant(project_id=aa65c35c7f4b4ef09eb79ff5afb5b3b6, user_id=bd43e5d1c359462d807b6e8a8581fa73, role_id=44620cad10ae407c90c91e2c296adb04)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e651478c-7047-47a7-a2f3-fe2915bc5f8d tempest-ShareCephxRulesForCephFSNegativeTest-1093541641 tempest-ShareCephxRulesForCephFSNegativeTest-1093541641-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1111/2245] 10.27.203.238 () {64 vars in 1571 bytes} [Tue May 28 12:58:39 2024] PUT /identity/v3/projects/aa65c35c7f4b4ef09eb79ff5afb5b3b6/users/bd43e5d1c359462d807b6e8a8581fa73/roles/44620cad10ae407c90c91e2c296adb04 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e84556-d871-46af-afe1-181784009a81 tempest-ShareCephxRulesForCephFSNegativeTest-1093541641 tempest-ShareCephxRulesForCephFSNegativeTest-1093541641-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e84556-d871-46af-afe1-181784009a81 tempest-ShareCephxRulesForCephFSNegativeTest-1093541641 tempest-ShareCephxRulesForCephFSNegativeTest-1093541641-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e866fd-3e1f-4131-90c2-e9f8f58903ff tempest-ShareCephxRulesForCephFSNegativeTest-1093541641 tempest-ShareCephxRulesForCephFSNegativeTest-1093541641-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '500dc1e5dbef40b89cddabee2b44f283', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa65c35c7f4b4ef09eb79ff5afb5b3b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e866fd-3e1f-4131-90c2-e9f8f58903ff tempest-ShareCephxRulesForCephFSNegativeTest-1093541641 tempest-ShareCephxRulesForCephFSNegativeTest-1093541641-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e866fd-3e1f-4131-90c2-e9f8f58903ff tempest-ShareCephxRulesForCephFSNegativeTest-1093541641 tempest-ShareCephxRulesForCephFSNegativeTest-1093541641-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e866fd-3e1f-4131-90c2-e9f8f58903ff tempest-ShareCephxRulesForCephFSNegativeTest-1093541641 tempest-ShareCephxRulesForCephFSNegativeTest-1093541641-project-admin] PATH_INFO: `/v3/users/14783f4fbce14880b4db4a628827607e` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e866fd-3e1f-4131-90c2-e9f8f58903ff tempest-ShareCephxRulesForCephFSNegativeTest-1093541641 tempest-ShareCephxRulesForCephFSNegativeTest-1093541641-project-admin] RBAC: Authorizing `identity:delete_user(user_id=14783f4fbce14880b4db4a628827607e)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e866fd-3e1f-4131-90c2-e9f8f58903ff tempest-ShareCephxRulesForCephFSNegativeTest-1093541641 tempest-ShareCephxRulesForCephFSNegativeTest-1093541641-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-24e866fd-3e1f-4131-90c2-e9f8f58903ff tempest-ShareCephxRulesForCephFSNegativeTest-1093541641 tempest-ShareCephxRulesForCephFSNegativeTest-1093541641-project-admin] Could not find user: 14783f4fbce14880b4db4a628827607e.: keystone.exception.UserNotFound: Could not find user: 14783f4fbce14880b4db4a628827607e. May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 14783f4fbce14880b4db4a628827607e. May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1135/2246] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 12:58:39 2024] DELETE /identity/v3/users/14783f4fbce14880b4db4a628827607e => generated 110 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e651478c-7047-47a7-a2f3-fe2915bc5f8d tempest-ShareCephxRulesForCephFSNegativeTest-1093541641 tempest-ShareCephxRulesForCephFSNegativeTest-1093541641-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e651478c-7047-47a7-a2f3-fe2915bc5f8d tempest-ShareCephxRulesForCephFSNegativeTest-1093541641 tempest-ShareCephxRulesForCephFSNegativeTest-1093541641-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702619cb-8e0d-45cd-be57-6114e5e57f44 tempest-ShareCephxRulesForCephFSNegativeTest-1093541641 tempest-ShareCephxRulesForCephFSNegativeTest-1093541641-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '500dc1e5dbef40b89cddabee2b44f283', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa65c35c7f4b4ef09eb79ff5afb5b3b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702619cb-8e0d-45cd-be57-6114e5e57f44 tempest-ShareCephxRulesForCephFSNegativeTest-1093541641 tempest-ShareCephxRulesForCephFSNegativeTest-1093541641-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702619cb-8e0d-45cd-be57-6114e5e57f44 tempest-ShareCephxRulesForCephFSNegativeTest-1093541641 tempest-ShareCephxRulesForCephFSNegativeTest-1093541641-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702619cb-8e0d-45cd-be57-6114e5e57f44 tempest-ShareCephxRulesForCephFSNegativeTest-1093541641 tempest-ShareCephxRulesForCephFSNegativeTest-1093541641-project-admin] PATH_INFO: `/v3/users/9eca355145fd413390b5efe7a0d95465` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702619cb-8e0d-45cd-be57-6114e5e57f44 tempest-ShareCephxRulesForCephFSNegativeTest-1093541641 tempest-ShareCephxRulesForCephFSNegativeTest-1093541641-project-admin] RBAC: Authorizing `identity:delete_user(user_id=9eca355145fd413390b5efe7a0d95465)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702619cb-8e0d-45cd-be57-6114e5e57f44 tempest-ShareCephxRulesForCephFSNegativeTest-1093541641 tempest-ShareCephxRulesForCephFSNegativeTest-1093541641-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-702619cb-8e0d-45cd-be57-6114e5e57f44 tempest-ShareCephxRulesForCephFSNegativeTest-1093541641 tempest-ShareCephxRulesForCephFSNegativeTest-1093541641-project-admin] Could not find user: 9eca355145fd413390b5efe7a0d95465.: keystone.exception.UserNotFound: Could not find user: 9eca355145fd413390b5efe7a0d95465. May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 9eca355145fd413390b5efe7a0d95465. May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1112/2247] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 12:58:39 2024] DELETE /identity/v3/users/9eca355145fd413390b5efe7a0d95465 => generated 110 bytes in 26 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e866fd-3e1f-4131-90c2-e9f8f58903ff tempest-ShareCephxRulesForCephFSNegativeTest-1093541641 tempest-ShareCephxRulesForCephFSNegativeTest-1093541641-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e866fd-3e1f-4131-90c2-e9f8f58903ff tempest-ShareCephxRulesForCephFSNegativeTest-1093541641 tempest-ShareCephxRulesForCephFSNegativeTest-1093541641-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfe5ef2-31c7-4633-b515-696cef73260f tempest-ShareCephxRulesForCephFSNegativeTest-1093541641 tempest-ShareCephxRulesForCephFSNegativeTest-1093541641-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '500dc1e5dbef40b89cddabee2b44f283', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa65c35c7f4b4ef09eb79ff5afb5b3b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfe5ef2-31c7-4633-b515-696cef73260f tempest-ShareCephxRulesForCephFSNegativeTest-1093541641 tempest-ShareCephxRulesForCephFSNegativeTest-1093541641-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfe5ef2-31c7-4633-b515-696cef73260f tempest-ShareCephxRulesForCephFSNegativeTest-1093541641 tempest-ShareCephxRulesForCephFSNegativeTest-1093541641-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfe5ef2-31c7-4633-b515-696cef73260f tempest-ShareCephxRulesForCephFSNegativeTest-1093541641 tempest-ShareCephxRulesForCephFSNegativeTest-1093541641-project-admin] PATH_INFO: `/v3/users/91ab54ee09854b549923fb7671247f5c` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfe5ef2-31c7-4633-b515-696cef73260f tempest-ShareCephxRulesForCephFSNegativeTest-1093541641 tempest-ShareCephxRulesForCephFSNegativeTest-1093541641-project-admin] RBAC: Authorizing `identity:delete_user(user_id=91ab54ee09854b549923fb7671247f5c)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfe5ef2-31c7-4633-b515-696cef73260f tempest-ShareCephxRulesForCephFSNegativeTest-1093541641 tempest-ShareCephxRulesForCephFSNegativeTest-1093541641-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-ecfe5ef2-31c7-4633-b515-696cef73260f tempest-ShareCephxRulesForCephFSNegativeTest-1093541641 tempest-ShareCephxRulesForCephFSNegativeTest-1093541641-project-admin] Could not find user: 91ab54ee09854b549923fb7671247f5c.: keystone.exception.UserNotFound: Could not find user: 91ab54ee09854b549923fb7671247f5c. May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 91ab54ee09854b549923fb7671247f5c. May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1136/2248] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 12:58:39 2024] DELETE /identity/v3/users/91ab54ee09854b549923fb7671247f5c => generated 110 bytes in 26 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702619cb-8e0d-45cd-be57-6114e5e57f44 tempest-ShareCephxRulesForCephFSNegativeTest-1093541641 tempest-ShareCephxRulesForCephFSNegativeTest-1093541641-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702619cb-8e0d-45cd-be57-6114e5e57f44 tempest-ShareCephxRulesForCephFSNegativeTest-1093541641 tempest-ShareCephxRulesForCephFSNegativeTest-1093541641-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426819d5-4513-4603-bce2-623cd5a0e650 tempest-ShareCephxRulesForCephFSNegativeTest-1093541641 tempest-ShareCephxRulesForCephFSNegativeTest-1093541641-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '500dc1e5dbef40b89cddabee2b44f283', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa65c35c7f4b4ef09eb79ff5afb5b3b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426819d5-4513-4603-bce2-623cd5a0e650 tempest-ShareCephxRulesForCephFSNegativeTest-1093541641 tempest-ShareCephxRulesForCephFSNegativeTest-1093541641-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426819d5-4513-4603-bce2-623cd5a0e650 tempest-ShareCephxRulesForCephFSNegativeTest-1093541641 tempest-ShareCephxRulesForCephFSNegativeTest-1093541641-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426819d5-4513-4603-bce2-623cd5a0e650 tempest-ShareCephxRulesForCephFSNegativeTest-1093541641 tempest-ShareCephxRulesForCephFSNegativeTest-1093541641-project-admin] PATH_INFO: `/v3/users/2889a927897c49bd92a0d1cfdf27e7f5` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426819d5-4513-4603-bce2-623cd5a0e650 tempest-ShareCephxRulesForCephFSNegativeTest-1093541641 tempest-ShareCephxRulesForCephFSNegativeTest-1093541641-project-admin] RBAC: Authorizing `identity:delete_user(user_id=2889a927897c49bd92a0d1cfdf27e7f5)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426819d5-4513-4603-bce2-623cd5a0e650 tempest-ShareCephxRulesForCephFSNegativeTest-1093541641 tempest-ShareCephxRulesForCephFSNegativeTest-1093541641-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-426819d5-4513-4603-bce2-623cd5a0e650 tempest-ShareCephxRulesForCephFSNegativeTest-1093541641 tempest-ShareCephxRulesForCephFSNegativeTest-1093541641-project-admin] Could not find user: 2889a927897c49bd92a0d1cfdf27e7f5.: keystone.exception.UserNotFound: Could not find user: 2889a927897c49bd92a0d1cfdf27e7f5. May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 2889a927897c49bd92a0d1cfdf27e7f5. May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1113/2249] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 12:58:39 2024] DELETE /identity/v3/users/2889a927897c49bd92a0d1cfdf27e7f5 => generated 110 bytes in 24 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfe5ef2-31c7-4633-b515-696cef73260f tempest-ShareCephxRulesForCephFSNegativeTest-1093541641 tempest-ShareCephxRulesForCephFSNegativeTest-1093541641-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfe5ef2-31c7-4633-b515-696cef73260f tempest-ShareCephxRulesForCephFSNegativeTest-1093541641 tempest-ShareCephxRulesForCephFSNegativeTest-1093541641-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c60778e-4b7d-4c5e-90fc-904a5fe2c45e tempest-ShareCephxRulesForCephFSNegativeTest-1093541641 tempest-ShareCephxRulesForCephFSNegativeTest-1093541641-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '500dc1e5dbef40b89cddabee2b44f283', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa65c35c7f4b4ef09eb79ff5afb5b3b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c60778e-4b7d-4c5e-90fc-904a5fe2c45e tempest-ShareCephxRulesForCephFSNegativeTest-1093541641 tempest-ShareCephxRulesForCephFSNegativeTest-1093541641-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c60778e-4b7d-4c5e-90fc-904a5fe2c45e tempest-ShareCephxRulesForCephFSNegativeTest-1093541641 tempest-ShareCephxRulesForCephFSNegativeTest-1093541641-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c60778e-4b7d-4c5e-90fc-904a5fe2c45e tempest-ShareCephxRulesForCephFSNegativeTest-1093541641 tempest-ShareCephxRulesForCephFSNegativeTest-1093541641-project-admin] PATH_INFO: `/v3/users/bd43e5d1c359462d807b6e8a8581fa73` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c60778e-4b7d-4c5e-90fc-904a5fe2c45e tempest-ShareCephxRulesForCephFSNegativeTest-1093541641 tempest-ShareCephxRulesForCephFSNegativeTest-1093541641-project-admin] RBAC: Authorizing `identity:delete_user(user_id=bd43e5d1c359462d807b6e8a8581fa73)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c60778e-4b7d-4c5e-90fc-904a5fe2c45e tempest-ShareCephxRulesForCephFSNegativeTest-1093541641 tempest-ShareCephxRulesForCephFSNegativeTest-1093541641-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-1c60778e-4b7d-4c5e-90fc-904a5fe2c45e tempest-ShareCephxRulesForCephFSNegativeTest-1093541641 tempest-ShareCephxRulesForCephFSNegativeTest-1093541641-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd43e5d1c359462d807b6e8a8581fa73', 'request_id': 'req-1c60778e-4b7d-4c5e-90fc-904a5fe2c45e'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-1c60778e-4b7d-4c5e-90fc-904a5fe2c45e tempest-ShareCephxRulesForCephFSNegativeTest-1093541641 tempest-ShareCephxRulesForCephFSNegativeTest-1093541641-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd43e5d1c359462d807b6e8a8581fa73', 'request_id': 'req-1c60778e-4b7d-4c5e-90fc-904a5fe2c45e'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-1c60778e-4b7d-4c5e-90fc-904a5fe2c45e tempest-ShareCephxRulesForCephFSNegativeTest-1093541641 tempest-ShareCephxRulesForCephFSNegativeTest-1093541641-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd43e5d1c359462d807b6e8a8581fa73', 'request_id': 'req-1c60778e-4b7d-4c5e-90fc-904a5fe2c45e'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-1c60778e-4b7d-4c5e-90fc-904a5fe2c45e tempest-ShareCephxRulesForCephFSNegativeTest-1093541641 tempest-ShareCephxRulesForCephFSNegativeTest-1093541641-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd43e5d1c359462d807b6e8a8581fa73', 'request_id': 'req-1c60778e-4b7d-4c5e-90fc-904a5fe2c45e'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-1c60778e-4b7d-4c5e-90fc-904a5fe2c45e tempest-ShareCephxRulesForCephFSNegativeTest-1093541641 tempest-ShareCephxRulesForCephFSNegativeTest-1093541641-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd43e5d1c359462d807b6e8a8581fa73', 'request_id': 'req-1c60778e-4b7d-4c5e-90fc-904a5fe2c45e'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1137/2250] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 12:58:39 2024] DELETE /identity/v3/users/bd43e5d1c359462d807b6e8a8581fa73 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426819d5-4513-4603-bce2-623cd5a0e650 tempest-ShareCephxRulesForCephFSNegativeTest-1093541641 tempest-ShareCephxRulesForCephFSNegativeTest-1093541641-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-426819d5-4513-4603-bce2-623cd5a0e650 tempest-ShareCephxRulesForCephFSNegativeTest-1093541641 tempest-ShareCephxRulesForCephFSNegativeTest-1093541641-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426819d5-4513-4603-bce2-623cd5a0e650 tempest-ShareCephxRulesForCephFSNegativeTest-1093541641 tempest-ShareCephxRulesForCephFSNegativeTest-1093541641-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:39 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-1b2703d7-dd00-431e-8d2b-dd15d28ae2ca tempest-PublicSharesTest-1667420263 tempest-PublicSharesTest-1667420263-project-member] GET http://10.27.203.238/share/v2/6d36e1eb1dbc449db6aca75b12a2ba18/shares/50dc60c2-08d1-4244-b4aa-f09b7789e32d May 28 12:58:39 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-1b2703d7-dd00-431e-8d2b-dd15d28ae2ca tempest-PublicSharesTest-1667420263 tempest-PublicSharesTest-1667420263-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:39 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-1b2703d7-dd00-431e-8d2b-dd15d28ae2ca tempest-PublicSharesTest-1667420263 tempest-PublicSharesTest-1667420263-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cc06da-050d-423f-b72b-c7229805f2f1 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cc06da-050d-423f-b72b-c7229805f2f1 None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cc06da-050d-423f-b72b-c7229805f2f1 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cc06da-050d-423f-b72b-c7229805f2f1 None admin] PATH_INFO: `/v3/users/d357b32489a64877881655e37d5890c6` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cc06da-050d-423f-b72b-c7229805f2f1 None admin] RBAC: Authorizing `identity:delete_user(user_id=d357b32489a64877881655e37d5890c6)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cc06da-050d-423f-b72b-c7229805f2f1 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:39 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-1b2703d7-dd00-431e-8d2b-dd15d28ae2ca tempest-PublicSharesTest-1667420263 tempest-PublicSharesTest-1667420263-project-member] http://10.27.203.238/share/v2/6d36e1eb1dbc449db6aca75b12a2ba18/shares/50dc60c2-08d1-4244-b4aa-f09b7789e32d returned with HTTP 200 May 28 12:58:39 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 561/1124] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:58:39 2024] GET /share/v2/6d36e1eb1dbc449db6aca75b12a2ba18/shares/50dc60c2-08d1-4244-b4aa-f09b7789e32d => generated 1315 bytes in 28 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:58:39 l75lg1-v1 nova-conductor[83647]: DEBUG dbcounter [-] [83647] Writing DB stats nova_cell1:SELECT=1,nova_cell1:UPDATE=1 {{(pid=83647) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-50cc06da-050d-423f-b72b-c7229805f2f1 None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd357b32489a64877881655e37d5890c6', 'request_id': 'req-50cc06da-050d-423f-b72b-c7229805f2f1'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-50cc06da-050d-423f-b72b-c7229805f2f1 None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd357b32489a64877881655e37d5890c6', 'request_id': 'req-50cc06da-050d-423f-b72b-c7229805f2f1'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-50cc06da-050d-423f-b72b-c7229805f2f1 None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd357b32489a64877881655e37d5890c6', 'request_id': 'req-50cc06da-050d-423f-b72b-c7229805f2f1'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-50cc06da-050d-423f-b72b-c7229805f2f1 None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd357b32489a64877881655e37d5890c6', 'request_id': 'req-50cc06da-050d-423f-b72b-c7229805f2f1'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-50cc06da-050d-423f-b72b-c7229805f2f1 None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd357b32489a64877881655e37d5890c6', 'request_id': 'req-50cc06da-050d-423f-b72b-c7229805f2f1'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1114/2251] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 12:58:39 2024] DELETE /identity/v3/users/d357b32489a64877881655e37d5890c6 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c60778e-4b7d-4c5e-90fc-904a5fe2c45e tempest-ShareCephxRulesForCephFSNegativeTest-1093541641 tempest-ShareCephxRulesForCephFSNegativeTest-1093541641-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c60778e-4b7d-4c5e-90fc-904a5fe2c45e tempest-ShareCephxRulesForCephFSNegativeTest-1093541641 tempest-ShareCephxRulesForCephFSNegativeTest-1093541641-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaac265-30e7-4c76-b141-dc05b4eb6cde None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaac265-30e7-4c76-b141-dc05b4eb6cde None admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaac265-30e7-4c76-b141-dc05b4eb6cde None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaac265-30e7-4c76-b141-dc05b4eb6cde None admin] PATH_INFO: `/v3/users/258f6dfafbbd41dfbe6203b1e09b1c49` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afaac265-30e7-4c76-b141-dc05b4eb6cde None admin] RBAC: Authorizing `identity:delete_user(user_id=258f6dfafbbd41dfbe6203b1e09b1c49)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afaac265-30e7-4c76-b141-dc05b4eb6cde None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-afaac265-30e7-4c76-b141-dc05b4eb6cde None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '258f6dfafbbd41dfbe6203b1e09b1c49', 'request_id': 'req-afaac265-30e7-4c76-b141-dc05b4eb6cde'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-afaac265-30e7-4c76-b141-dc05b4eb6cde None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '258f6dfafbbd41dfbe6203b1e09b1c49', 'request_id': 'req-afaac265-30e7-4c76-b141-dc05b4eb6cde'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-afaac265-30e7-4c76-b141-dc05b4eb6cde None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '258f6dfafbbd41dfbe6203b1e09b1c49', 'request_id': 'req-afaac265-30e7-4c76-b141-dc05b4eb6cde'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-afaac265-30e7-4c76-b141-dc05b4eb6cde None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '258f6dfafbbd41dfbe6203b1e09b1c49', 'request_id': 'req-afaac265-30e7-4c76-b141-dc05b4eb6cde'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-afaac265-30e7-4c76-b141-dc05b4eb6cde None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '258f6dfafbbd41dfbe6203b1e09b1c49', 'request_id': 'req-afaac265-30e7-4c76-b141-dc05b4eb6cde'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1138/2252] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 12:58:39 2024] DELETE /identity/v3/users/258f6dfafbbd41dfbe6203b1e09b1c49 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cc06da-050d-423f-b72b-c7229805f2f1 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-50cc06da-050d-423f-b72b-c7229805f2f1 None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cc06da-050d-423f-b72b-c7229805f2f1 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:39 l75lg1-v1 nova-conductor[83648]: DEBUG dbcounter [-] [83648] Writing DB stats nova_cell1:SELECT=1 {{(pid=83648) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e6702e-c64e-439e-bbb0-92e872d92770 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e6702e-c64e-439e-bbb0-92e872d92770 None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e6702e-c64e-439e-bbb0-92e872d92770 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e6702e-c64e-439e-bbb0-92e872d92770 None admin] PATH_INFO: `/v3/users/500dc1e5dbef40b89cddabee2b44f283` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e6702e-c64e-439e-bbb0-92e872d92770 None admin] RBAC: Authorizing `identity:delete_user(user_id=500dc1e5dbef40b89cddabee2b44f283)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e6702e-c64e-439e-bbb0-92e872d92770 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-11e6702e-c64e-439e-bbb0-92e872d92770 None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '500dc1e5dbef40b89cddabee2b44f283', 'request_id': 'req-11e6702e-c64e-439e-bbb0-92e872d92770'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:58:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-11e6702e-c64e-439e-bbb0-92e872d92770 None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '500dc1e5dbef40b89cddabee2b44f283', 'request_id': 'req-11e6702e-c64e-439e-bbb0-92e872d92770'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:58:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f703c79a-94d0-4ade-b68a-65da0c803a9e tempest-SharesMetadataTest-1561320255 None] <<< [POST] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:58:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f703c79a-94d0-4ade-b68a-65da0c803a9e tempest-SharesMetadataTest-1561320255 None] Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=0, created='2024-05-28T12:58:39.462843Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='8008607d-98e4-4b37-82a5-195594448cd5', id=31, internal=False, is_s3_default_policy=False, name='922a313f-547d-4129-ae7c-39ae549d3f49', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=[], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['*'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['*'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T12:58:39.929997Z', tenant_id=1, tenant_name='default', title='922a313f-547d-4129-ae7c-39ae549d3f49', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/31/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[]) May 28 12:58:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f703c79a-94d0-4ade-b68a-65da0c803a9e tempest-SharesMetadataTest-1561320255 None] --- [POST] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 12:58:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f703c79a-94d0-4ade-b68a-65da0c803a9e tempest-SharesMetadataTest-1561320255 None] >>> [GET] https://127.0.0.1:40443/api/quotas/ May 28 12:58:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f703c79a-94d0-4ade-b68a-65da0c803a9e tempest-SharesMetadataTest-1561320255 None] {'allow_redirects': True, May 28 12:58:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f703c79a-94d0-4ade-b68a-65da0c803a9e tempest-SharesMetadataTest-1561320255 None] 'params': {'name': '922a313f-547d-4129-ae7c-39ae549d3f49'}} May 28 12:58:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-11e6702e-c64e-439e-bbb0-92e872d92770 None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '500dc1e5dbef40b89cddabee2b44f283', 'request_id': 'req-11e6702e-c64e-439e-bbb0-92e872d92770'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:58:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-11e6702e-c64e-439e-bbb0-92e872d92770 None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '500dc1e5dbef40b89cddabee2b44f283', 'request_id': 'req-11e6702e-c64e-439e-bbb0-92e872d92770'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:58:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-11e6702e-c64e-439e-bbb0-92e872d92770 None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '500dc1e5dbef40b89cddabee2b44f283', 'request_id': 'req-11e6702e-c64e-439e-bbb0-92e872d92770'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:58:40 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1115/2253] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 12:58:39 2024] DELETE /identity/v3/users/500dc1e5dbef40b89cddabee2b44f283 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:58:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68697f9-1321-48bd-a019-676cd6f970a5 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68697f9-1321-48bd-a019-676cd6f970a5 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68697f9-1321-48bd-a019-676cd6f970a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:40 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-b68697f9-1321-48bd-a019-676cd6f970a5 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:58:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-b68697f9-1321-48bd-a019-676cd6f970a5 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:58:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-b68697f9-1321-48bd-a019-676cd6f970a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:58:40 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1139/2254] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:58:40 2024] POST /identity/v3/auth/tokens => generated 2960 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 12:58:40 l75lg1-v1 neutron-server[77618]: DEBUG neutron.wsgi [-] (77618) accepted ('10.27.203.238', 46882) {{(pid=77618) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 12:58:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e6702e-c64e-439e-bbb0-92e872d92770 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-11e6702e-c64e-439e-bbb0-92e872d92770 None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:58:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e6702e-c64e-439e-bbb0-92e872d92770 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e736bd5-adea-4a41-bbc3-64c924d71f9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef17047035e4b518fd5360a01f2da1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e736bd5-adea-4a41-bbc3-64c924d71f9d service neutron] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e736bd5-adea-4a41-bbc3-64c924d71f9d service neutron] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e736bd5-adea-4a41-bbc3-64c924d71f9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e736bd5-adea-4a41-bbc3-64c924d71f9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e736bd5-adea-4a41-bbc3-64c924d71f9d service neutron] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:40 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1116/2255] 10.27.203.238 () {64 vars in 1432 bytes} [Tue May 28 12:58:40 2024] GET /identity/v3/auth/tokens => generated 2960 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 28 12:58:40 l75lg1-v1 neutron-server[77618]: INFO neutron.wsgi [None req-60afa101-3a32-429e-a321-a2e9178f7a76 None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=a7bb97bbf59e4210bf09d9f3fb3183bb&name=default HTTP/1.1" status: 200 len: 216 time: 0.0819199 May 28 12:58:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68697f9-1321-48bd-a019-676cd6f970a5 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-b68697f9-1321-48bd-a019-676cd6f970a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:58:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68697f9-1321-48bd-a019-676cd6f970a5 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da508e76-8731-4880-b7f0-1089e195f58a None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da508e76-8731-4880-b7f0-1089e195f58a None admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da508e76-8731-4880-b7f0-1089e195f58a None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da508e76-8731-4880-b7f0-1089e195f58a None admin] PATH_INFO: `/v3/projects/a7bb97bbf59e4210bf09d9f3fb3183bb` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da508e76-8731-4880-b7f0-1089e195f58a None admin] RBAC: Authorizing `identity:delete_project(project_id=a7bb97bbf59e4210bf09d9f3fb3183bb)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da508e76-8731-4880-b7f0-1089e195f58a None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-25d6cabe-430a-4a8c-97f9-866a8ed13460 tempest-PublicSharesTest-1667420263 None] <<< [DELETE] https://127.0.0.1:40443/api/quotas/27/ May 28 12:58:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-25d6cabe-430a-4a8c-97f9-866a8ed13460 tempest-PublicSharesTest-1667420263 None] --- [DELETE] https://127.0.0.1:40443/api/quotas/27/: Done May 28 12:58:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-25d6cabe-430a-4a8c-97f9-866a8ed13460 tempest-PublicSharesTest-1667420263 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:58:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-25d6cabe-430a-4a8c-97f9-866a8ed13460 tempest-PublicSharesTest-1667420263 None] {'allow_redirects': True, May 28 12:58:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-25d6cabe-430a-4a8c-97f9-866a8ed13460 tempest-PublicSharesTest-1667420263 None] 'params': {'name': '58febd66-6690-481d-866e-2c57d2f22405'}} May 28 12:58:40 l75lg1-v1 dstat.sh[49771]: 28-05 12:58:40| 10 1 85 2 0|5725M 1755M 277M 7868M| 22k 1406B| 0 2248k| 0 275 |7786 13k|1.20 1.06 1.01|1.0 1.0 0| 0 0 | 0 2048M| 29 358 0 32 0 May 28 12:58:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-da508e76-8731-4880-b7f0-1089e195f58a None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7bb97bbf59e4210bf09d9f3fb3183bb', 'request_id': 'req-da508e76-8731-4880-b7f0-1089e195f58a'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:58:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-da508e76-8731-4880-b7f0-1089e195f58a None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7bb97bbf59e4210bf09d9f3fb3183bb', 'request_id': 'req-da508e76-8731-4880-b7f0-1089e195f58a'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:58:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-da508e76-8731-4880-b7f0-1089e195f58a None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7bb97bbf59e4210bf09d9f3fb3183bb', 'request_id': 'req-da508e76-8731-4880-b7f0-1089e195f58a'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:58:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-da508e76-8731-4880-b7f0-1089e195f58a None admin] The token cache is being invalidate because project a7bb97bbf59e4210bf09d9f3fb3183bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 12:58:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-da508e76-8731-4880-b7f0-1089e195f58a None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:58:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-da508e76-8731-4880-b7f0-1089e195f58a None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:58:40 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1140/2256] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 12:58:40 2024] DELETE /identity/v3/projects/a7bb97bbf59e4210bf09d9f3fb3183bb => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:58:40 l75lg1-v1 neutron-server[77619]: DEBUG neutron.wsgi [-] (77619) accepted ('10.27.203.238', 48714) {{(pid=77619) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 12:58:40 l75lg1-v1 neutron-server[77619]: INFO neutron.wsgi [None req-f8496b25-718c-413b-ace1-d8f9c80c6ea9 None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=aa65c35c7f4b4ef09eb79ff5afb5b3b6&name=default HTTP/1.1" status: 200 len: 216 time: 0.0103140 May 28 12:58:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e736bd5-adea-4a41-bbc3-64c924d71f9d service neutron] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e736bd5-adea-4a41-bbc3-64c924d71f9d service neutron] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad28d072-cd95-409d-96c6-ede28fac507f None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad28d072-cd95-409d-96c6-ede28fac507f None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad28d072-cd95-409d-96c6-ede28fac507f None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad28d072-cd95-409d-96c6-ede28fac507f None admin] PATH_INFO: `/v3/projects/aa65c35c7f4b4ef09eb79ff5afb5b3b6` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad28d072-cd95-409d-96c6-ede28fac507f None admin] RBAC: Authorizing `identity:delete_project(project_id=aa65c35c7f4b4ef09eb79ff5afb5b3b6)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad28d072-cd95-409d-96c6-ede28fac507f None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-ad28d072-cd95-409d-96c6-ede28fac507f None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa65c35c7f4b4ef09eb79ff5afb5b3b6', 'request_id': 'req-ad28d072-cd95-409d-96c6-ede28fac507f'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:58:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-ad28d072-cd95-409d-96c6-ede28fac507f None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa65c35c7f4b4ef09eb79ff5afb5b3b6', 'request_id': 'req-ad28d072-cd95-409d-96c6-ede28fac507f'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:58:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-ad28d072-cd95-409d-96c6-ede28fac507f None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa65c35c7f4b4ef09eb79ff5afb5b3b6', 'request_id': 'req-ad28d072-cd95-409d-96c6-ede28fac507f'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:58:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-ad28d072-cd95-409d-96c6-ede28fac507f None admin] The token cache is being invalidate because project aa65c35c7f4b4ef09eb79ff5afb5b3b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 12:58:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-ad28d072-cd95-409d-96c6-ede28fac507f None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:58:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-ad28d072-cd95-409d-96c6-ede28fac507f None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:58:40 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1117/2257] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 12:58:40 2024] DELETE /identity/v3/projects/aa65c35c7f4b4ef09eb79ff5afb5b3b6 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 28 12:58:40 l75lg1-v1 neutron-server[77619]: DEBUG neutron.wsgi [-] (77619) accepted ('10.27.203.238', 48718) {{(pid=77619) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 12:58:40 l75lg1-v1 neutron-server[77619]: INFO neutron.wsgi [None req-22bdadff-cf2e-4865-9535-36a63fb5eaac None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=c68833028e534be787b6190315807f3c&name=default HTTP/1.1" status: 200 len: 216 time: 0.0095766 May 28 12:58:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da508e76-8731-4880-b7f0-1089e195f58a None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-da508e76-8731-4880-b7f0-1089e195f58a None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:58:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da508e76-8731-4880-b7f0-1089e195f58a None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f6b785-5447-49f4-b3a2-336d8409aabb None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f6b785-5447-49f4-b3a2-336d8409aabb None admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f6b785-5447-49f4-b3a2-336d8409aabb None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f6b785-5447-49f4-b3a2-336d8409aabb None admin] PATH_INFO: `/v3/projects/c68833028e534be787b6190315807f3c` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f6b785-5447-49f4-b3a2-336d8409aabb None admin] RBAC: Authorizing `identity:delete_project(project_id=c68833028e534be787b6190315807f3c)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f6b785-5447-49f4-b3a2-336d8409aabb None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-25d6cabe-430a-4a8c-97f9-866a8ed13460 tempest-PublicSharesTest-1667420263 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:58:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-25d6cabe-430a-4a8c-97f9-866a8ed13460 tempest-PublicSharesTest-1667420263 None] [Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=0, created='2024-05-28T12:58:28.648763Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='9b4c7f7d-304f-4222-91cc-49a9b726b89e', id=30, internal=False, is_s3_default_policy=False, name='58febd66-6690-481d-866e-2c57d2f22405', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=[], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['*'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['*'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T12:58:28.967341Z', tenant_id=1, tenant_name='default', title='58febd66-6690-481d-866e-2c57d2f22405', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/30/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[])] May 28 12:58:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-25d6cabe-430a-4a8c-97f9-866a8ed13460 tempest-PublicSharesTest-1667420263 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 12:58:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-25d6cabe-430a-4a8c-97f9-866a8ed13460 tempest-PublicSharesTest-1667420263 None] >>> [DELETE] https://127.0.0.1:40443/api/viewpolicies/30/ May 28 12:58:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-b2f6b785-5447-49f4-b3a2-336d8409aabb None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c68833028e534be787b6190315807f3c', 'request_id': 'req-b2f6b785-5447-49f4-b3a2-336d8409aabb'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:58:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-b2f6b785-5447-49f4-b3a2-336d8409aabb None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c68833028e534be787b6190315807f3c', 'request_id': 'req-b2f6b785-5447-49f4-b3a2-336d8409aabb'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:58:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-b2f6b785-5447-49f4-b3a2-336d8409aabb None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c68833028e534be787b6190315807f3c', 'request_id': 'req-b2f6b785-5447-49f4-b3a2-336d8409aabb'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:58:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-b2f6b785-5447-49f4-b3a2-336d8409aabb None admin] The token cache is being invalidate because project c68833028e534be787b6190315807f3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 12:58:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-b2f6b785-5447-49f4-b3a2-336d8409aabb None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:58:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-b2f6b785-5447-49f4-b3a2-336d8409aabb None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:58:40 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1141/2258] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 12:58:40 2024] DELETE /identity/v3/projects/c68833028e534be787b6190315807f3c => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:58:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e98a73-dbe4-4bb8-ac38-adf14b45f439 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e98a73-dbe4-4bb8-ac38-adf14b45f439 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e98a73-dbe4-4bb8-ac38-adf14b45f439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:40 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-99e98a73-dbe4-4bb8-ac38-adf14b45f439 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:58:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-99e98a73-dbe4-4bb8-ac38-adf14b45f439 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:58:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-99e98a73-dbe4-4bb8-ac38-adf14b45f439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:58:40 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1118/2259] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:58:40 2024] POST /identity/v3/auth/tokens => generated 312 bytes in 21 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 28 12:58:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c2465e-6705-4d52-8584-9946e7098d29 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c2465e-6705-4d52-8584-9946e7098d29 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c2465e-6705-4d52-8584-9946e7098d29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f703c79a-94d0-4ade-b68a-65da0c803a9e tempest-SharesMetadataTest-1561320255 None] <<< [GET] https://127.0.0.1:40443/api/quotas/ May 28 12:58:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f703c79a-94d0-4ade-b68a-65da0c803a9e tempest-SharesMetadataTest-1561320255 None] [] May 28 12:58:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f703c79a-94d0-4ade-b68a-65da0c803a9e tempest-SharesMetadataTest-1561320255 None] --- [GET] https://127.0.0.1:40443/api/quotas/: Done May 28 12:58:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f703c79a-94d0-4ade-b68a-65da0c803a9e tempest-SharesMetadataTest-1561320255 None] >>> [POST] https://127.0.0.1:40443/api/quotas/ May 28 12:58:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f703c79a-94d0-4ade-b68a-65da0c803a9e tempest-SharesMetadataTest-1561320255 None] {'data': '{"name": "922a313f-547d-4129-ae7c-39ae549d3f49", "path": ' May 28 12:58:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f703c79a-94d0-4ade-b68a-65da0c803a9e tempest-SharesMetadataTest-1561320255 None] '"/manila/manila-922a313f-547d-4129-ae7c-39ae549d3f49", "create_dir": ' May 28 12:58:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f703c79a-94d0-4ade-b68a-65da0c803a9e tempest-SharesMetadataTest-1561320255 None] 'true, "hard_limit": 1073741824}', May 28 12:58:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f703c79a-94d0-4ade-b68a-65da0c803a9e tempest-SharesMetadataTest-1561320255 None] 'json': None, May 28 12:58:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f703c79a-94d0-4ade-b68a-65da0c803a9e tempest-SharesMetadataTest-1561320255 None] 'params': None} May 28 12:58:40 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-70c2465e-6705-4d52-8584-9946e7098d29 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:58:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-70c2465e-6705-4d52-8584-9946e7098d29 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:58:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-70c2465e-6705-4d52-8584-9946e7098d29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:58:40 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1142/2260] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:58:40 2024] POST /identity/v3/auth/tokens => generated 2960 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 12:58:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e98a73-dbe4-4bb8-ac38-adf14b45f439 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e98a73-dbe4-4bb8-ac38-adf14b45f439 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9971c054-1f9a-4c6d-a799-db979726fe00 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9971c054-1f9a-4c6d-a799-db979726fe00 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9971c054-1f9a-4c6d-a799-db979726fe00 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9971c054-1f9a-4c6d-a799-db979726fe00 None admin] PATH_INFO: `/v3/domains` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9971c054-1f9a-4c6d-a799-db979726fe00 None admin] RBAC: Adding query filter params (name=Default) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:58:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9971c054-1f9a-4c6d-a799-db979726fe00 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9971c054-1f9a-4c6d-a799-db979726fe00 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:40 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1119/2261] 10.27.203.238 () {62 vars in 1220 bytes} [Tue May 28 12:58:40 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:58:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c2465e-6705-4d52-8584-9946e7098d29 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c2465e-6705-4d52-8584-9946e7098d29 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f984cb7f-8c99-463c-a48f-36fe8222b9a1 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f984cb7f-8c99-463c-a48f-36fe8222b9a1 None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f984cb7f-8c99-463c-a48f-36fe8222b9a1 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f984cb7f-8c99-463c-a48f-36fe8222b9a1 None admin] PATH_INFO: `/v3/projects` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f984cb7f-8c99-463c-a48f-36fe8222b9a1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f984cb7f-8c99-463c-a48f-36fe8222b9a1 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:40 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1143/2262] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 12:58:40 2024] POST /identity/v3/projects => generated 399 bytes in 36 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:58:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9971c054-1f9a-4c6d-a799-db979726fe00 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9971c054-1f9a-4c6d-a799-db979726fe00 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca71ed3-0b1c-49f4-b919-0b854367249a None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca71ed3-0b1c-49f4-b919-0b854367249a None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca71ed3-0b1c-49f4-b919-0b854367249a None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:40 l75lg1-v1 neutron-server[77621]: DEBUG dbcounter [-] [77621] Writing DB stats neutron:SELECT=2 {{(pid=77621) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:58:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca71ed3-0b1c-49f4-b919-0b854367249a None admin] PATH_INFO: `/v3/users` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca71ed3-0b1c-49f4-b919-0b854367249a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:40 l75lg1-v1 neutron-server[77619]: DEBUG dbcounter [-] [77619] Writing DB stats neutron:SELECT=1,neutron:UPDATE=1 {{(pid=77619) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:58:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca71ed3-0b1c-49f4-b919-0b854367249a None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:40 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-1ca71ed3-0b1c-49f4-b919-0b854367249a None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 12:58:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a8945c45-d985-4f91-9885-702590ff88f8 tempest-AdminActionsTest-1749172189 None] <<< [DELETE] https://127.0.0.1:40443/api/views/3/ May 28 12:58:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a8945c45-d985-4f91-9885-702590ff88f8 tempest-AdminActionsTest-1749172189 None] --- [DELETE] https://127.0.0.1:40443/api/views/3/: Done May 28 12:58:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a8945c45-d985-4f91-9885-702590ff88f8 tempest-AdminActionsTest-1749172189 None] >>> [GET] https://127.0.0.1:40443/api/quotas/ May 28 12:58:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a8945c45-d985-4f91-9885-702590ff88f8 tempest-AdminActionsTest-1749172189 None] {'allow_redirects': True, May 28 12:58:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a8945c45-d985-4f91-9885-702590ff88f8 tempest-AdminActionsTest-1749172189 None] 'params': {'name': '77a25e6b-f137-4342-8eb9-9ced679515e2'}} May 28 12:58:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c201f561-82f3-4ada-8743-f2d6a7e1cc6e tempest-ShareIpRulesForNFSTest-1748669711 None] <<< [PATCH] https://127.0.0.1:40443/api/viewpolicies/21/ May 28 12:58:40 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1120/2263] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 12:58:40 2024] POST /identity/v3/users => generated 308 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:58:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c201f561-82f3-4ada-8743-f2d6a7e1cc6e tempest-ShareIpRulesForNFSTest-1748669711 None] Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=1, created='2024-05-28T12:57:40.763635Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='377955ad-d094-4e49-ab32-1021d943a572', id=21, internal=False, is_s3_default_policy=False, name='b7a7d61c-2cea-442a-9809-507038e080d5', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=['*'], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['203.0.113.141'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['203.0.113.141'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='MODIFYING', sync_time='2024-05-28T12:58:40.101907Z', tenant_id=1, tenant_name='default', title='b7a7d61c-2cea-442a-9809-507038e080d5', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/21/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[]) May 28 12:58:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c201f561-82f3-4ada-8743-f2d6a7e1cc6e tempest-ShareIpRulesForNFSTest-1748669711 None] --- [PATCH] https://127.0.0.1:40443/api/viewpolicies/21/: Done May 28 12:58:40 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c201f561-82f3-4ada-8743-f2d6a7e1cc6e tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:40 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c201f561-82f3-4ada-8743-f2d6a7e1cc6e tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f984cb7f-8c99-463c-a48f-36fe8222b9a1 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f984cb7f-8c99-463c-a48f-36fe8222b9a1 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41568b26-eec1-4cdc-977e-0919d95973c5 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41568b26-eec1-4cdc-977e-0919d95973c5 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41568b26-eec1-4cdc-977e-0919d95973c5 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41568b26-eec1-4cdc-977e-0919d95973c5 None admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41568b26-eec1-4cdc-977e-0919d95973c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41568b26-eec1-4cdc-977e-0919d95973c5 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:40 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1144/2264] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 12:58:40 2024] GET /identity/v3/roles => generated 1680 bytes in 16 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:58:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca71ed3-0b1c-49f4-b919-0b854367249a None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca71ed3-0b1c-49f4-b919-0b854367249a None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1853db-c4d6-4d20-9c59-2c844a1f5531 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1853db-c4d6-4d20-9c59-2c844a1f5531 None admin] REQUEST_METHOD: `PUT` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1853db-c4d6-4d20-9c59-2c844a1f5531 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1853db-c4d6-4d20-9c59-2c844a1f5531 None admin] PATH_INFO: `/v3/projects/7890e9d8a78c49a0bb9af26ec5dd4646/users/e65e0f7c2ec4409e8ee189360165f84e/roles/44620cad10ae407c90c91e2c296adb04` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1853db-c4d6-4d20-9c59-2c844a1f5531 None admin] RBAC: Authorizing `identity:create_grant(project_id=7890e9d8a78c49a0bb9af26ec5dd4646, user_id=e65e0f7c2ec4409e8ee189360165f84e, role_id=44620cad10ae407c90c91e2c296adb04)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1853db-c4d6-4d20-9c59-2c844a1f5531 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:40 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c201f561-82f3-4ada-8743-f2d6a7e1cc6e tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.058s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:40 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c201f561-82f3-4ada-8743-f2d6a7e1cc6e tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:40 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c201f561-82f3-4ada-8743-f2d6a7e1cc6e tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:40 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c201f561-82f3-4ada-8743-f2d6a7e1cc6e tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:40 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c201f561-82f3-4ada-8743-f2d6a7e1cc6e tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:40 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c201f561-82f3-4ada-8743-f2d6a7e1cc6e tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:40 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1121/2265] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 12:58:40 2024] PUT /identity/v3/projects/7890e9d8a78c49a0bb9af26ec5dd4646/users/e65e0f7c2ec4409e8ee189360165f84e/roles/44620cad10ae407c90c91e2c296adb04 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:58:40 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c201f561-82f3-4ada-8743-f2d6a7e1cc6e tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.004s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:40 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c201f561-82f3-4ada-8743-f2d6a7e1cc6e tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:40 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c201f561-82f3-4ada-8743-f2d6a7e1cc6e tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cba21f-e7ed-4185-a95c-1bda4468e322 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cba21f-e7ed-4185-a95c-1bda4468e322 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cba21f-e7ed-4185-a95c-1bda4468e322 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:40 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c201f561-82f3-4ada-8743-f2d6a7e1cc6e tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:40 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c201f561-82f3-4ada-8743-f2d6a7e1cc6e tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:40 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c201f561-82f3-4ada-8743-f2d6a7e1cc6e tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:40 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-40cba21f-e7ed-4185-a95c-1bda4468e322 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:58:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-40cba21f-e7ed-4185-a95c-1bda4468e322 None None] MFA Rules not processed for user `e65e0f7c2ec4409e8ee189360165f84e`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:58:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-40cba21f-e7ed-4185-a95c-1bda4468e322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:58:40 l75lg1-v1 neutron-server[77622]: DEBUG dbcounter [-] [77622] Writing DB stats neutron:SELECT=26,neutron:UPDATE=1 {{(pid=77622) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:58:40 l75lg1-v1 neutron-server[77622]: DEBUG dbcounter [-] [77622] Writing DB stats neutron:SELECT=28,neutron:UPDATE=1 {{(pid=77622) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:58:40 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c201f561-82f3-4ada-8743-f2d6a7e1cc6e tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.042s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:40 l75lg1-v1 manila-share[98474]: INFO manila.share.access [None req-c201f561-82f3-4ada-8743-f2d6a7e1cc6e tempest-ShareIpRulesForNFSTest-1748669711 None] Access rules were successfully modified for share instance b7a7d61c-2cea-442a-9809-507038e080d5 belonging to share 1ddadc17-cf10-4a42-8bbd-8335fb3520a1. May 28 12:58:40 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1145/2266] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:58:40 2024] POST /identity/v3/auth/tokens => generated 3970 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:58:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1853db-c4d6-4d20-9c59-2c844a1f5531 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:41 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-992150f2-49cc-4233-bb08-58bd0af393f7 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] GET http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/shares/df0ea844-5fc1-4d04-8afb-5048ec5dc33f May 28 12:58:41 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-992150f2-49cc-4233-bb08-58bd0af393f7 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:41 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-992150f2-49cc-4233-bb08-58bd0af393f7 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1853db-c4d6-4d20-9c59-2c844a1f5531 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cdfede-93cb-473c-97c0-a78143b0442d None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cdfede-93cb-473c-97c0-a78143b0442d None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cdfede-93cb-473c-97c0-a78143b0442d None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cdfede-93cb-473c-97c0-a78143b0442d None admin] PATH_INFO: `/v3/projects` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:41 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-992150f2-49cc-4233-bb08-58bd0af393f7 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/shares/df0ea844-5fc1-4d04-8afb-5048ec5dc33f returned with HTTP 200 May 28 12:58:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cdfede-93cb-473c-97c0-a78143b0442d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:41 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 564/1125] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:58:41 2024] GET /share/v2/a3499cb78849424db45e54caac01de92/shares/df0ea844-5fc1-4d04-8afb-5048ec5dc33f => generated 1370 bytes in 25 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:58:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cdfede-93cb-473c-97c0-a78143b0442d None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:41 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1122/2267] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 12:58:41 2024] POST /identity/v3/projects => generated 397 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:58:41 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-9f98241d-caff-42ca-8089-9cbd7766ddf0 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] GET http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/0e9e1ee3-c7cc-4239-bc5b-cace9d44e641 May 28 12:58:41 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-9f98241d-caff-42ca-8089-9cbd7766ddf0 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:41 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-9f98241d-caff-42ca-8089-9cbd7766ddf0 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cba21f-e7ed-4185-a95c-1bda4468e322 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cba21f-e7ed-4185-a95c-1bda4468e322 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:41 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-9f98241d-caff-42ca-8089-9cbd7766ddf0 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/0e9e1ee3-c7cc-4239-bc5b-cace9d44e641 returned with HTTP 200 May 28 12:58:41 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 562/1126] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:58:41 2024] GET /share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/0e9e1ee3-c7cc-4239-bc5b-cace9d44e641 => generated 1313 bytes in 30 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:58:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4310ff-8d96-41ce-ba31-7433cfa71362 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4310ff-8d96-41ce-ba31-7433cfa71362 None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4310ff-8d96-41ce-ba31-7433cfa71362 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4310ff-8d96-41ce-ba31-7433cfa71362 None admin] PATH_INFO: `/v3/users` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4310ff-8d96-41ce-ba31-7433cfa71362 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4310ff-8d96-41ce-ba31-7433cfa71362 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:41 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-df4310ff-8d96-41ce-ba31-7433cfa71362 None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 12:58:41 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1146/2268] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 12:58:41 2024] POST /identity/v3/users => generated 307 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:58:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cdfede-93cb-473c-97c0-a78143b0442d None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cdfede-93cb-473c-97c0-a78143b0442d None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69732ca2-ccc1-4301-85f1-30964f3dc575 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69732ca2-ccc1-4301-85f1-30964f3dc575 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69732ca2-ccc1-4301-85f1-30964f3dc575 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69732ca2-ccc1-4301-85f1-30964f3dc575 None admin] PATH_INFO: `/v3/roles` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69732ca2-ccc1-4301-85f1-30964f3dc575 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69732ca2-ccc1-4301-85f1-30964f3dc575 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:41 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1123/2269] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 12:58:41 2024] GET /identity/v3/roles => generated 1680 bytes in 17 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:58:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4310ff-8d96-41ce-ba31-7433cfa71362 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4310ff-8d96-41ce-ba31-7433cfa71362 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd94f689-62d6-4df9-bdb5-064e62afcdb2 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd94f689-62d6-4df9-bdb5-064e62afcdb2 None admin] REQUEST_METHOD: `PUT` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd94f689-62d6-4df9-bdb5-064e62afcdb2 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd94f689-62d6-4df9-bdb5-064e62afcdb2 None admin] PATH_INFO: `/v3/projects/211270827a6144e49c856696ee8f6eba/users/3e48f2d8cc2748adbed1aedb6a5f8093/roles/44620cad10ae407c90c91e2c296adb04` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd94f689-62d6-4df9-bdb5-064e62afcdb2 None admin] RBAC: Authorizing `identity:create_grant(project_id=211270827a6144e49c856696ee8f6eba, user_id=3e48f2d8cc2748adbed1aedb6a5f8093, role_id=44620cad10ae407c90c91e2c296adb04)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd94f689-62d6-4df9-bdb5-064e62afcdb2 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:41 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-870e17e8-0509-4cee-a036-df9d1ff507b8 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] POST http://10.27.203.238/share/v2/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action May 28 12:58:41 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-870e17e8-0509-4cee-a036-df9d1ff507b8 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Action body: b'{"access_list": null}' {{(pid=98330) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:58:41 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-870e17e8-0509-4cee-a036-df9d1ff507b8 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Action: 'action', calling method: ShareController.access_list, body: {"access_list": null} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:58:41 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1147/2270] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 12:58:41 2024] PUT /identity/v3/projects/211270827a6144e49c856696ee8f6eba/users/3e48f2d8cc2748adbed1aedb6a5f8093/roles/44620cad10ae407c90c91e2c296adb04 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:58:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2241da2c-f723-48fd-8fa3-1470f92ca8a4 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2241da2c-f723-48fd-8fa3-1470f92ca8a4 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2241da2c-f723-48fd-8fa3-1470f92ca8a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:41 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-2241da2c-f723-48fd-8fa3-1470f92ca8a4 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:58:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-2241da2c-f723-48fd-8fa3-1470f92ca8a4 None None] MFA Rules not processed for user `3e48f2d8cc2748adbed1aedb6a5f8093`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:58:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-2241da2c-f723-48fd-8fa3-1470f92ca8a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:58:41 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-870e17e8-0509-4cee-a036-df9d1ff507b8 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] http://10.27.203.238/share/v2/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action returned with HTTP 200 May 28 12:58:41 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 565/1127] 10.27.203.238 () {66 vars in 1493 bytes} [Tue May 28 12:58:41 2024] POST /share/v2/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action => generated 265 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:58:41 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-81107929-f5d0-46a8-a59a-037b8cd77d13 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] POST http://10.27.203.238/share/v2/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action May 28 12:58:41 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-81107929-f5d0-46a8-a59a-037b8cd77d13 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Action body: b'{"deny_access": {"access_id": "41f02b99-5f0a-4e2f-abe2-3b73368d7402"}}' {{(pid=98329) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:58:41 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-81107929-f5d0-46a8-a59a-037b8cd77d13 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Action: 'action', calling method: ShareController.deny_access, body: {"deny_access": {"access_id": "41f02b99-5f0a-4e2f-abe2-3b73368d7402"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:58:41 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.lock.api [None req-81107929-f5d0-46a8-a59a-037b8cd77d13 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Searching for locks by: {'resource_id': '41f02b99-5f0a-4e2f-abe2-3b73368d7402', 'resource_action': 'delete'} {{(pid=98329) get_all /opt/stack/manila/manila/lock/api.py:112}} May 28 12:58:41 l75lg1-v1 dstat.sh[49771]: 28-05 12:58:41| 12 1 82 3 0|5726M 1754M 277M 7868M| 23k 2944B| 0 8756k| 0 965 |8240 14k|1.20 1.06 1.01|4.0 1.0 0| 0 0 | 0 2048M| 29 359 0 35 0 May 28 12:58:41 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1124/2271] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:58:41 2024] POST /identity/v3/auth/tokens => generated 3968 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:58:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd94f689-62d6-4df9-bdb5-064e62afcdb2 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd94f689-62d6-4df9-bdb5-064e62afcdb2 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4f5b10-2833-4590-811c-83a140ec7984 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4f5b10-2833-4590-811c-83a140ec7984 None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4f5b10-2833-4590-811c-83a140ec7984 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4f5b10-2833-4590-811c-83a140ec7984 None admin] PATH_INFO: `/v3/projects` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4f5b10-2833-4590-811c-83a140ec7984 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4f5b10-2833-4590-811c-83a140ec7984 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:41 l75lg1-v1 devstack@m-api.service[98329]: DEBUG oslo_concurrency.lockutils [None req-81107929-f5d0-46a8-a59a-037b8cd77d13 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98329) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:41 l75lg1-v1 devstack@m-api.service[98329]: DEBUG oslo_concurrency.lockutils [None req-81107929-f5d0-46a8-a59a-037b8cd77d13 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98329) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:41 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a8945c45-d985-4f91-9885-702590ff88f8 tempest-AdminActionsTest-1749172189 None] <<< [GET] https://127.0.0.1:40443/api/quotas/ May 28 12:58:41 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a8945c45-d985-4f91-9885-702590ff88f8 tempest-AdminActionsTest-1749172189 None] [Bunch(cluster='loop75-kfs', cluster_id=1, default_email=None, default_group_quota=None, default_user_quota=None, enable_alarms=True, enable_email_providers=True, grace_period=None, guid='209d2cc0-7c6b-437e-821d-b7267f7260be', hard_limit=1073741824, hard_limit_inodes=None, id=1, internal=False, is_user_quota=False, last_user_quotas_update=None, name='77a25e6b-f137-4342-8eb9-9ced679515e2', num_blocked_users=0, num_exceeded_users=0, path='/manila/manila-77a25e6b-f137-4342-8eb9-9ced679515e2', percent_capacity=0, percent_inodes=None, pretty_grace_period=None, pretty_grace_period_expiration=None, pretty_state='OK', soft_limit=None, soft_limit_inodes=None, state='OK', sync_state='SYNCHRONIZED', system_id=1, tenant_id=1, tenant_name='default', time_to_block=None, title='77a25e6b-f137-4342-8eb9-9ced679515e2', url='https://127.0.0.1:40443/api/quotas/1/', used_capacity=0, used_capacity_tb=0.0, used_effective_capacity=0, used_effective_capacity_tb=0.0, used_inodes=1, used_limited_capacity=0)] May 28 12:58:41 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a8945c45-d985-4f91-9885-702590ff88f8 tempest-AdminActionsTest-1749172189 None] --- [GET] https://127.0.0.1:40443/api/quotas/: Done May 28 12:58:41 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a8945c45-d985-4f91-9885-702590ff88f8 tempest-AdminActionsTest-1749172189 None] >>> [DELETE] https://127.0.0.1:40443/api/quotas/1/ May 28 12:58:41 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1148/2272] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 12:58:41 2024] POST /identity/v3/projects => generated 397 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:58:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2241da2c-f723-48fd-8fa3-1470f92ca8a4 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2241da2c-f723-48fd-8fa3-1470f92ca8a4 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:41 l75lg1-v1 devstack@m-api.service[98329]: DEBUG oslo_concurrency.lockutils [None req-81107929-f5d0-46a8-a59a-037b8cd77d13 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.076s {{(pid=98329) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:41 l75lg1-v1 devstack@m-api.service[98329]: DEBUG oslo_concurrency.lockutils [None req-81107929-f5d0-46a8-a59a-037b8cd77d13 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98329) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:41 l75lg1-v1 devstack@m-api.service[98329]: DEBUG oslo_concurrency.lockutils [None req-81107929-f5d0-46a8-a59a-037b8cd77d13 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98329) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c8f942-9dbd-4592-a737-38e42ce8b3cd None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c8f942-9dbd-4592-a737-38e42ce8b3cd None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c8f942-9dbd-4592-a737-38e42ce8b3cd None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c8f942-9dbd-4592-a737-38e42ce8b3cd None admin] PATH_INFO: `/v3/users` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c8f942-9dbd-4592-a737-38e42ce8b3cd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c8f942-9dbd-4592-a737-38e42ce8b3cd None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:41 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-f0c8f942-9dbd-4592-a737-38e42ce8b3cd None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 12:58:41 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1125/2273] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 12:58:41 2024] POST /identity/v3/users => generated 306 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:58:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4f5b10-2833-4590-811c-83a140ec7984 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4f5b10-2833-4590-811c-83a140ec7984 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d444d9-666b-4893-a5ff-a9563c050f4d None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d444d9-666b-4893-a5ff-a9563c050f4d None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d444d9-666b-4893-a5ff-a9563c050f4d None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d444d9-666b-4893-a5ff-a9563c050f4d None admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d444d9-666b-4893-a5ff-a9563c050f4d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d444d9-666b-4893-a5ff-a9563c050f4d None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:41 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1149/2274] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 12:58:41 2024] GET /identity/v3/roles => generated 1680 bytes in 18 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:58:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c8f942-9dbd-4592-a737-38e42ce8b3cd None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c8f942-9dbd-4592-a737-38e42ce8b3cd None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997f35e0-3c82-4b98-94fe-ad71ebe40549 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997f35e0-3c82-4b98-94fe-ad71ebe40549 None admin] REQUEST_METHOD: `PUT` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997f35e0-3c82-4b98-94fe-ad71ebe40549 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997f35e0-3c82-4b98-94fe-ad71ebe40549 None admin] PATH_INFO: `/v3/projects/8f81d1d8d7c946e8aa46d6e3e510424c/users/7640802a4c39457089742b080e6c98b9/roles/e7989893488f483baa107be56668c4f8` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997f35e0-3c82-4b98-94fe-ad71ebe40549 None admin] RBAC: Authorizing `identity:create_grant(project_id=8f81d1d8d7c946e8aa46d6e3e510424c, user_id=7640802a4c39457089742b080e6c98b9, role_id=e7989893488f483baa107be56668c4f8)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997f35e0-3c82-4b98-94fe-ad71ebe40549 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:41 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1126/2275] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 12:58:41 2024] PUT /identity/v3/projects/8f81d1d8d7c946e8aa46d6e3e510424c/users/7640802a4c39457089742b080e6c98b9/roles/e7989893488f483baa107be56668c4f8 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:58:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d444d9-666b-4893-a5ff-a9563c050f4d None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d444d9-666b-4893-a5ff-a9563c050f4d None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:41 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f703c79a-94d0-4ade-b68a-65da0c803a9e tempest-SharesMetadataTest-1561320255 None] <<< [POST] https://127.0.0.1:40443/api/quotas/ May 28 12:58:41 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f703c79a-94d0-4ade-b68a-65da0c803a9e tempest-SharesMetadataTest-1561320255 None] Bunch(cluster='loop75-kfs', cluster_id=1, default_email=None, default_group_quota=None, default_user_quota=None, enable_alarms=True, enable_email_providers=True, grace_period=None, group_quotas=[], guid='475f3772-d5c2-43ff-bd5c-d2ec38825b6e', hard_limit=1073741824, hard_limit_inodes=None, id=28, internal=False, is_user_quota=False, last_user_quotas_update=None, name='922a313f-547d-4129-ae7c-39ae549d3f49', num_blocked_users=0, num_exceeded_users=0, path='/manila/manila-922a313f-547d-4129-ae7c-39ae549d3f49', percent_capacity=0, percent_inodes=None, pretty_grace_period=None, pretty_grace_period_expiration=None, pretty_state='OK (CREATED)', soft_limit=None, soft_limit_inodes=None, state='OK', sync_state='CREATED', system_id=28, tenant_id=1, tenant_name='default', time_to_block=None, title='922a313f-547d-4129-ae7c-39ae549d3f49', url='https://127.0.0.1:40443/api/quotas/28/', used_capacity=0, used_capacity_tb=0.0, used_effective_capacity=0, used_effective_capacity_tb=0.0, used_inodes=0, used_limited_capacity=0, user_quotas=[]) May 28 12:58:41 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f703c79a-94d0-4ade-b68a-65da0c803a9e tempest-SharesMetadataTest-1561320255 None] --- [POST] https://127.0.0.1:40443/api/quotas/: Done May 28 12:58:41 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f703c79a-94d0-4ade-b68a-65da0c803a9e tempest-SharesMetadataTest-1561320255 None] >>> [GET] https://127.0.0.1:40443/api/views/ May 28 12:58:41 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f703c79a-94d0-4ade-b68a-65da0c803a9e tempest-SharesMetadataTest-1561320255 None] {'allow_redirects': True, May 28 12:58:41 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f703c79a-94d0-4ade-b68a-65da0c803a9e tempest-SharesMetadataTest-1561320255 None] 'params': {'name': '922a313f-547d-4129-ae7c-39ae549d3f49'}} May 28 12:58:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dab2cd-b4d5-4513-b2b9-9ba20eb6035b None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dab2cd-b4d5-4513-b2b9-9ba20eb6035b None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dab2cd-b4d5-4513-b2b9-9ba20eb6035b None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dab2cd-b4d5-4513-b2b9-9ba20eb6035b None admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dab2cd-b4d5-4513-b2b9-9ba20eb6035b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dab2cd-b4d5-4513-b2b9-9ba20eb6035b None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:41 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1150/2276] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 12:58:41 2024] GET /identity/v3/roles => generated 1680 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:58:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997f35e0-3c82-4b98-94fe-ad71ebe40549 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997f35e0-3c82-4b98-94fe-ad71ebe40549 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351e93bb-7a9b-4c77-8f6d-254565886f91 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351e93bb-7a9b-4c77-8f6d-254565886f91 None admin] REQUEST_METHOD: `PUT` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351e93bb-7a9b-4c77-8f6d-254565886f91 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351e93bb-7a9b-4c77-8f6d-254565886f91 None admin] PATH_INFO: `/v3/projects/8f81d1d8d7c946e8aa46d6e3e510424c/users/7640802a4c39457089742b080e6c98b9/roles/e7989893488f483baa107be56668c4f8` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351e93bb-7a9b-4c77-8f6d-254565886f91 None admin] RBAC: Authorizing `identity:create_grant(project_id=8f81d1d8d7c946e8aa46d6e3e510424c, user_id=7640802a4c39457089742b080e6c98b9, role_id=e7989893488f483baa107be56668c4f8)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351e93bb-7a9b-4c77-8f6d-254565886f91 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:41 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1127/2277] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 12:58:41 2024] PUT /identity/v3/projects/8f81d1d8d7c946e8aa46d6e3e510424c/users/7640802a4c39457089742b080e6c98b9/roles/e7989893488f483baa107be56668c4f8 => generated 0 bytes in 21 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:58:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8913c07c-9c09-4ac1-a448-7d9e30fcfb70 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8913c07c-9c09-4ac1-a448-7d9e30fcfb70 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8913c07c-9c09-4ac1-a448-7d9e30fcfb70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:41 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-8913c07c-9c09-4ac1-a448-7d9e30fcfb70 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:58:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-8913c07c-9c09-4ac1-a448-7d9e30fcfb70 None None] MFA Rules not processed for user `7640802a4c39457089742b080e6c98b9`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:58:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-8913c07c-9c09-4ac1-a448-7d9e30fcfb70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:58:41 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1151/2278] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:58:41 2024] POST /identity/v3/auth/tokens => generated 4091 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:58:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351e93bb-7a9b-4c77-8f6d-254565886f91 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351e93bb-7a9b-4c77-8f6d-254565886f91 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:41 l75lg1-v1 devstack@m-api.service[98329]: DEBUG oslo_concurrency.lockutils [None req-81107929-f5d0-46a8-a59a-037b8cd77d13 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.316s {{(pid=98329) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee46a7c-a723-4c69-aab8-23f5c1e784e1 tempest-ShareIpRulesForNFSNegativeTest-700172924 tempest-ShareIpRulesForNFSNegativeTest-700172924-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7640802a4c39457089742b080e6c98b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f81d1d8d7c946e8aa46d6e3e510424c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee46a7c-a723-4c69-aab8-23f5c1e784e1 tempest-ShareIpRulesForNFSNegativeTest-700172924 tempest-ShareIpRulesForNFSNegativeTest-700172924-project-admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee46a7c-a723-4c69-aab8-23f5c1e784e1 tempest-ShareIpRulesForNFSNegativeTest-700172924 tempest-ShareIpRulesForNFSNegativeTest-700172924-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee46a7c-a723-4c69-aab8-23f5c1e784e1 tempest-ShareIpRulesForNFSNegativeTest-700172924 tempest-ShareIpRulesForNFSNegativeTest-700172924-project-admin] PATH_INFO: `/v3/domains` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee46a7c-a723-4c69-aab8-23f5c1e784e1 tempest-ShareIpRulesForNFSNegativeTest-700172924 tempest-ShareIpRulesForNFSNegativeTest-700172924-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:58:41 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-81107929-f5d0-46a8-a59a-037b8cd77d13 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] http://10.27.203.238/share/v2/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action returned with HTTP 202 May 28 12:58:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee46a7c-a723-4c69-aab8-23f5c1e784e1 tempest-ShareIpRulesForNFSNegativeTest-700172924 tempest-ShareIpRulesForNFSNegativeTest-700172924-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:41 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 563/1128] 10.27.203.238 () {66 vars in 1493 bytes} [Tue May 28 12:58:41 2024] POST /share/v2/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action => generated 0 bytes in 489 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:58:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee46a7c-a723-4c69-aab8-23f5c1e784e1 tempest-ShareIpRulesForNFSNegativeTest-700172924 tempest-ShareIpRulesForNFSNegativeTest-700172924-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:41 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-82eda478-64b0-4045-aeb6-9137a71c69be tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] GET http://10.27.203.238/share/v2/776f75906bc64f8f9316d5aab4b50bf1/share-access-rules?share_id=1ddadc17-cf10-4a42-8bbd-8335fb3520a1 May 28 12:58:41 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-82eda478-64b0-4045-aeb6-9137a71c69be tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:41 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-82eda478-64b0-4045-aeb6-9137a71c69be tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:41 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1128/2279] 10.27.203.238 () {62 vars in 1241 bytes} [Tue May 28 12:58:41 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:58:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8913c07c-9c09-4ac1-a448-7d9e30fcfb70 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8913c07c-9c09-4ac1-a448-7d9e30fcfb70 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:41 l75lg1-v1 manila-share[98474]: DEBUG manila.share.manager [None req-81107929-f5d0-46a8-a59a-037b8cd77d13 tempest-ShareIpRulesForNFSTest-1748669711 None] Received request to update access for share instance b7a7d61c-2cea-442a-9809-507038e080d5. {{(pid=98474) update_access_for_instances /opt/stack/manila/manila/share/manager.py:4353}} May 28 12:58:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029da9d7-03eb-4c61-91c0-d2ff99b6d3b3 tempest-ShareIpRulesForNFSNegativeTest-700172924 tempest-ShareIpRulesForNFSNegativeTest-700172924-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7640802a4c39457089742b080e6c98b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f81d1d8d7c946e8aa46d6e3e510424c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029da9d7-03eb-4c61-91c0-d2ff99b6d3b3 tempest-ShareIpRulesForNFSNegativeTest-700172924 tempest-ShareIpRulesForNFSNegativeTest-700172924-project-admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029da9d7-03eb-4c61-91c0-d2ff99b6d3b3 tempest-ShareIpRulesForNFSNegativeTest-700172924 tempest-ShareIpRulesForNFSNegativeTest-700172924-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029da9d7-03eb-4c61-91c0-d2ff99b6d3b3 tempest-ShareIpRulesForNFSNegativeTest-700172924 tempest-ShareIpRulesForNFSNegativeTest-700172924-project-admin] PATH_INFO: `/v3/users` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029da9d7-03eb-4c61-91c0-d2ff99b6d3b3 tempest-ShareIpRulesForNFSNegativeTest-700172924 tempest-ShareIpRulesForNFSNegativeTest-700172924-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029da9d7-03eb-4c61-91c0-d2ff99b6d3b3 tempest-ShareIpRulesForNFSNegativeTest-700172924 tempest-ShareIpRulesForNFSNegativeTest-700172924-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:41 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-029da9d7-03eb-4c61-91c0-d2ff99b6d3b3 tempest-ShareIpRulesForNFSNegativeTest-700172924 tempest-ShareIpRulesForNFSNegativeTest-700172924-project-admin] Truncating password to algorithm specific maximum length 72 characters. May 28 12:58:41 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-81107929-f5d0-46a8-a59a-037b8cd77d13 tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:41 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-81107929-f5d0-46a8-a59a-037b8cd77d13 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:41 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-81107929-f5d0-46a8-a59a-037b8cd77d13 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.004s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:41 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-81107929-f5d0-46a8-a59a-037b8cd77d13 tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:41 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-81107929-f5d0-46a8-a59a-037b8cd77d13 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:41 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.lock.api [None req-82eda478-64b0-4045-aeb6-9137a71c69be tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Searching for locks by: {'resource_id': '41f02b99-5f0a-4e2f-abe2-3b73368d7402', 'resource_action': 'show', 'resource_type': 'access_rule'} {{(pid=98330) get_all /opt/stack/manila/manila/lock/api.py:112}} May 28 12:58:41 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1152/2280] 10.27.203.238 () {64 vars in 1232 bytes} [Tue May 28 12:58:41 2024] POST /identity/v3/users => generated 435 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:58:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee46a7c-a723-4c69-aab8-23f5c1e784e1 tempest-ShareIpRulesForNFSNegativeTest-700172924 tempest-ShareIpRulesForNFSNegativeTest-700172924-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:41 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-82eda478-64b0-4045-aeb6-9137a71c69be tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] http://10.27.203.238/share/v2/776f75906bc64f8f9316d5aab4b50bf1/share-access-rules?share_id=1ddadc17-cf10-4a42-8bbd-8335fb3520a1 returned with HTTP 200 May 28 12:58:41 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 566/1129] 10.27.203.238 () {64 vars in 1467 bytes} [Tue May 28 12:58:41 2024] GET /share/v2/776f75906bc64f8f9316d5aab4b50bf1/share-access-rules?share_id=1ddadc17-cf10-4a42-8bbd-8335fb3520a1 => generated 289 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:58:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee46a7c-a723-4c69-aab8-23f5c1e784e1 tempest-ShareIpRulesForNFSNegativeTest-700172924 tempest-ShareIpRulesForNFSNegativeTest-700172924-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5669c3-47c8-44b0-b6d6-82578d471016 tempest-ShareIpRulesForNFSNegativeTest-700172924 tempest-ShareIpRulesForNFSNegativeTest-700172924-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7640802a4c39457089742b080e6c98b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f81d1d8d7c946e8aa46d6e3e510424c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5669c3-47c8-44b0-b6d6-82578d471016 tempest-ShareIpRulesForNFSNegativeTest-700172924 tempest-ShareIpRulesForNFSNegativeTest-700172924-project-admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5669c3-47c8-44b0-b6d6-82578d471016 tempest-ShareIpRulesForNFSNegativeTest-700172924 tempest-ShareIpRulesForNFSNegativeTest-700172924-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5669c3-47c8-44b0-b6d6-82578d471016 tempest-ShareIpRulesForNFSNegativeTest-700172924 tempest-ShareIpRulesForNFSNegativeTest-700172924-project-admin] PATH_INFO: `/v3/roles` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5669c3-47c8-44b0-b6d6-82578d471016 tempest-ShareIpRulesForNFSNegativeTest-700172924 tempest-ShareIpRulesForNFSNegativeTest-700172924-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5669c3-47c8-44b0-b6d6-82578d471016 tempest-ShareIpRulesForNFSNegativeTest-700172924 tempest-ShareIpRulesForNFSNegativeTest-700172924-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:41 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1129/2281] 10.27.203.238 () {62 vars in 1210 bytes} [Tue May 28 12:58:41 2024] GET /identity/v3/roles => generated 1680 bytes in 18 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:58:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029da9d7-03eb-4c61-91c0-d2ff99b6d3b3 tempest-ShareIpRulesForNFSNegativeTest-700172924 tempest-ShareIpRulesForNFSNegativeTest-700172924-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029da9d7-03eb-4c61-91c0-d2ff99b6d3b3 tempest-ShareIpRulesForNFSNegativeTest-700172924 tempest-ShareIpRulesForNFSNegativeTest-700172924-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8aee82-226c-48fe-80e4-6cd7954d1ac3 tempest-ShareIpRulesForNFSNegativeTest-700172924 tempest-ShareIpRulesForNFSNegativeTest-700172924-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7640802a4c39457089742b080e6c98b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f81d1d8d7c946e8aa46d6e3e510424c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8aee82-226c-48fe-80e4-6cd7954d1ac3 tempest-ShareIpRulesForNFSNegativeTest-700172924 tempest-ShareIpRulesForNFSNegativeTest-700172924-project-admin] REQUEST_METHOD: `PUT` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8aee82-226c-48fe-80e4-6cd7954d1ac3 tempest-ShareIpRulesForNFSNegativeTest-700172924 tempest-ShareIpRulesForNFSNegativeTest-700172924-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8aee82-226c-48fe-80e4-6cd7954d1ac3 tempest-ShareIpRulesForNFSNegativeTest-700172924 tempest-ShareIpRulesForNFSNegativeTest-700172924-project-admin] PATH_INFO: `/v3/projects/8f81d1d8d7c946e8aa46d6e3e510424c/users/18c7667276334e98bdd11d2b9d1875cc/roles/44620cad10ae407c90c91e2c296adb04` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8aee82-226c-48fe-80e4-6cd7954d1ac3 tempest-ShareIpRulesForNFSNegativeTest-700172924 tempest-ShareIpRulesForNFSNegativeTest-700172924-project-admin] RBAC: Authorizing `identity:create_grant(project_id=8f81d1d8d7c946e8aa46d6e3e510424c, user_id=18c7667276334e98bdd11d2b9d1875cc, role_id=44620cad10ae407c90c91e2c296adb04)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8aee82-226c-48fe-80e4-6cd7954d1ac3 tempest-ShareIpRulesForNFSNegativeTest-700172924 tempest-ShareIpRulesForNFSNegativeTest-700172924-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:41 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-81107929-f5d0-46a8-a59a-037b8cd77d13 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.055s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:41 l75lg1-v1 manila-share[98474]: DEBUG manila.share.access [None req-81107929-f5d0-46a8-a59a-037b8cd77d13 tempest-ShareIpRulesForNFSTest-1748669711 None] Updating access rules for share instance b7a7d61c-2cea-442a-9809-507038e080d5 belonging to share 1ddadc17-cf10-4a42-8bbd-8335fb3520a1. {{(pid=98474) update_access_rules /opt/stack/manila/manila/share/access.py:298}} May 28 12:58:41 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1153/2282] 10.27.203.238 () {64 vars in 1571 bytes} [Tue May 28 12:58:41 2024] PUT /identity/v3/projects/8f81d1d8d7c946e8aa46d6e3e510424c/users/18c7667276334e98bdd11d2b9d1875cc/roles/44620cad10ae407c90c91e2c296adb04 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:58:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5669c3-47c8-44b0-b6d6-82578d471016 tempest-ShareIpRulesForNFSNegativeTest-700172924 tempest-ShareIpRulesForNFSNegativeTest-700172924-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:41 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-81107929-f5d0-46a8-a59a-037b8cd77d13 tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:41 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-81107929-f5d0-46a8-a59a-037b8cd77d13 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-1c5669c3-47c8-44b0-b6d6-82578d471016 tempest-ShareIpRulesForNFSNegativeTest-700172924 tempest-ShareIpRulesForNFSNegativeTest-700172924-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:58:41 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-81107929-f5d0-46a8-a59a-037b8cd77d13 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.008s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:41 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-81107929-f5d0-46a8-a59a-037b8cd77d13 tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:41 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-81107929-f5d0-46a8-a59a-037b8cd77d13 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:41 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-81107929-f5d0-46a8-a59a-037b8cd77d13 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.019s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:41 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-81107929-f5d0-46a8-a59a-037b8cd77d13 tempest-ShareIpRulesForNFSTest-1748669711 None] changing access on None May 28 12:58:41 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-81107929-f5d0-46a8-a59a-037b8cd77d13 tempest-ShareIpRulesForNFSTest-1748669711 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:58:41 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-81107929-f5d0-46a8-a59a-037b8cd77d13 tempest-ShareIpRulesForNFSTest-1748669711 None] {'allow_redirects': True, May 28 12:58:41 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-81107929-f5d0-46a8-a59a-037b8cd77d13 tempest-ShareIpRulesForNFSTest-1748669711 None] 'params': {'name': 'b7a7d61c-2cea-442a-9809-507038e080d5'}} May 28 12:58:41 l75lg1-v1 nova-scheduler[81196]: DEBUG dbcounter [-] [81196] Writing DB stats nova_cell0:SELECT=1,nova_cell0:UPDATE=1 {{(pid=81196) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:58:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5669c3-47c8-44b0-b6d6-82578d471016 tempest-ShareIpRulesForNFSNegativeTest-700172924 tempest-ShareIpRulesForNFSNegativeTest-700172924-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:41 l75lg1-v1 nova-scheduler[81194]: DEBUG dbcounter [-] [81194] Writing DB stats nova_cell0:SELECT=1 {{(pid=81194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:58:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bae9a9-0967-45b9-a8d9-234b6e0f330e service manila] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f110cf6300f049c897d0aab63218d1e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bae9a9-0967-45b9-a8d9-234b6e0f330e service manila] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bae9a9-0967-45b9-a8d9-234b6e0f330e service manila] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bae9a9-0967-45b9-a8d9-234b6e0f330e service manila] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bae9a9-0967-45b9-a8d9-234b6e0f330e service manila] RBAC: Authorizing `identity:validate_token()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bae9a9-0967-45b9-a8d9-234b6e0f330e service manila] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:41 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1130/2283] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 12:58:41 2024] GET /identity/v3/auth/tokens => generated 4091 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 12:58:41 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-264133f9-4193-4cb2-a551-8b0609af2f80 tempest-ShareIpRulesForNFSNegativeTest-700172924 tempest-ShareIpRulesForNFSNegativeTest-700172924-project-admin] POST http://10.27.203.238/share/v2/8f81d1d8d7c946e8aa46d6e3e510424c/types May 28 12:58:41 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-264133f9-4193-4cb2-a551-8b0609af2f80 tempest-ShareIpRulesForNFSNegativeTest-700172924 tempest-ShareIpRulesForNFSNegativeTest-700172924-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share_type": {"name": "tempest-typeshare-type-1757384623", "extra_specs": {"driver_handles_share_servers": "False", "snapshot_support": true}, "share_type_access:is_public": true}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:58:42 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-264133f9-4193-4cb2-a551-8b0609af2f80 tempest-ShareIpRulesForNFSNegativeTest-700172924 tempest-ShareIpRulesForNFSNegativeTest-700172924-project-admin] http://10.27.203.238/share/v2/8f81d1d8d7c946e8aa46d6e3e510424c/types returned with HTTP 200 May 28 12:58:42 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 564/1130] 10.27.203.238 () {66 vars in 1359 bytes} [Tue May 28 12:58:41 2024] POST /share/v2/8f81d1d8d7c946e8aa46d6e3e510424c/types => generated 679 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:58:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8aee82-226c-48fe-80e4-6cd7954d1ac3 tempest-ShareIpRulesForNFSNegativeTest-700172924 tempest-ShareIpRulesForNFSNegativeTest-700172924-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-4c8aee82-226c-48fe-80e4-6cd7954d1ac3 tempest-ShareIpRulesForNFSNegativeTest-700172924 tempest-ShareIpRulesForNFSNegativeTest-700172924-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:58:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8aee82-226c-48fe-80e4-6cd7954d1ac3 tempest-ShareIpRulesForNFSNegativeTest-700172924 tempest-ShareIpRulesForNFSNegativeTest-700172924-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b08680-6e63-406b-8ea4-fd6b06fb150a service manila] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f110cf6300f049c897d0aab63218d1e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b08680-6e63-406b-8ea4-fd6b06fb150a service manila] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b08680-6e63-406b-8ea4-fd6b06fb150a service manila] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b08680-6e63-406b-8ea4-fd6b06fb150a service manila] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b08680-6e63-406b-8ea4-fd6b06fb150a service manila] RBAC: Authorizing `identity:validate_token()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b08680-6e63-406b-8ea4-fd6b06fb150a service manila] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:42 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1154/2284] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 12:58:42 2024] GET /identity/v3/auth/tokens => generated 3970 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 12:58:42 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-7eab10f5-e18a-4db8-9715-0f60c7d684a3 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] POST http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares May 28 12:58:42 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-7eab10f5-e18a-4db8-9715-0f60c7d684a3 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share": {"share_proto": "nfs", "description": "Tempest's share", "snapshot_id": null, "name": "tempest-tempest-created-share-38344056", "size": 1, "metadata": {}, "is_public": false, "share_type": "5037523b-c9cb-479e-b3dc-93d142b602f8"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:58:42 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.v1.shares [None req-7eab10f5-e18a-4db8-9715-0f60c7d684a3 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Create NFS share of 1 GB May 28 12:58:42 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.quota [None req-7eab10f5-e18a-4db8-9715-0f60c7d684a3 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Created reservations ['76013254-0528-4771-a636-47e53cdf7929', 'fe7d401c-d9e5-4666-965d-e311971b4e4f', 'abc3219f-6f79-4442-a8b8-f5c741eb8d40', '77b262ed-9cd4-4c23-9ff0-08827c8bc61a'] {{(pid=98330) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 12:58:42 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-81107929-f5d0-46a8-a59a-037b8cd77d13 tempest-ShareIpRulesForNFSTest-1748669711 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:58:42 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-81107929-f5d0-46a8-a59a-037b8cd77d13 tempest-ShareIpRulesForNFSTest-1748669711 None] [Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=1, created='2024-05-28T12:57:40.763635Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='377955ad-d094-4e49-ab32-1021d943a572', id=21, internal=False, is_s3_default_policy=False, name='b7a7d61c-2cea-442a-9809-507038e080d5', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=['*'], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['203.0.113.141'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['203.0.113.141'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T12:58:40.712715Z', tenant_id=1, tenant_name='default', title='b7a7d61c-2cea-442a-9809-507038e080d5', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/21/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[])] May 28 12:58:42 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-81107929-f5d0-46a8-a59a-037b8cd77d13 tempest-ShareIpRulesForNFSTest-1748669711 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 12:58:42 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-81107929-f5d0-46a8-a59a-037b8cd77d13 tempest-ShareIpRulesForNFSTest-1748669711 None] changing access on /manila/manila-b7a7d61c-2cea-442a-9809-507038e080d5. Rules: {'nfs_read_write': [], 'nfs_read_only': []} May 28 12:58:42 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-81107929-f5d0-46a8-a59a-037b8cd77d13 tempest-ShareIpRulesForNFSTest-1748669711 None] >>> [PATCH] https://127.0.0.1:40443/api/viewpolicies/21/ May 28 12:58:42 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-81107929-f5d0-46a8-a59a-037b8cd77d13 tempest-ShareIpRulesForNFSTest-1748669711 None] {'data': '{"name": "b7a7d61c-2cea-442a-9809-507038e080d5", "nfs_no_squash": ' May 28 12:58:42 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-81107929-f5d0-46a8-a59a-037b8cd77d13 tempest-ShareIpRulesForNFSTest-1748669711 None] '["*"], "nfs_root_squash": ["*"], "nfs_read_write": [], ' May 28 12:58:42 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-81107929-f5d0-46a8-a59a-037b8cd77d13 tempest-ShareIpRulesForNFSTest-1748669711 None] '"nfs_read_only": []}', May 28 12:58:42 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-81107929-f5d0-46a8-a59a-037b8cd77d13 tempest-ShareIpRulesForNFSTest-1748669711 None] 'params': None} May 28 12:58:42 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f703c79a-94d0-4ade-b68a-65da0c803a9e tempest-SharesMetadataTest-1561320255 None] <<< [GET] https://127.0.0.1:40443/api/views/ May 28 12:58:42 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f703c79a-94d0-4ade-b68a-65da0c803a9e tempest-SharesMetadataTest-1561320255 None] [] May 28 12:58:42 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f703c79a-94d0-4ade-b68a-65da0c803a9e tempest-SharesMetadataTest-1561320255 None] --- [GET] https://127.0.0.1:40443/api/views/: Done May 28 12:58:42 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f703c79a-94d0-4ade-b68a-65da0c803a9e tempest-SharesMetadataTest-1561320255 None] >>> [POST] https://127.0.0.1:40443/api/views/ May 28 12:58:42 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f703c79a-94d0-4ade-b68a-65da0c803a9e tempest-SharesMetadataTest-1561320255 None] {'data': '{"name": "922a313f-547d-4129-ae7c-39ae549d3f49", "path": ' May 28 12:58:42 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f703c79a-94d0-4ade-b68a-65da0c803a9e tempest-SharesMetadataTest-1561320255 None] '"/manila/manila-922a313f-547d-4129-ae7c-39ae549d3f49", "policy_id": ' May 28 12:58:42 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f703c79a-94d0-4ade-b68a-65da0c803a9e tempest-SharesMetadataTest-1561320255 None] '31, "create_dir": true, "protocols": ["NFS"]}', May 28 12:58:42 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f703c79a-94d0-4ade-b68a-65da0c803a9e tempest-SharesMetadataTest-1561320255 None] 'json': None, May 28 12:58:42 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f703c79a-94d0-4ade-b68a-65da0c803a9e tempest-SharesMetadataTest-1561320255 None] 'params': None} May 28 12:58:42 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.quota [None req-7eab10f5-e18a-4db8-9715-0f60c7d684a3 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Committed reservations ['76013254-0528-4771-a636-47e53cdf7929', 'fe7d401c-d9e5-4666-965d-e311971b4e4f', 'abc3219f-6f79-4442-a8b8-f5c741eb8d40', '77b262ed-9cd4-4c23-9ff0-08827c8bc61a'] {{(pid=98330) commit /opt/stack/manila/manila/quota.py:1063}} May 28 12:58:42 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-25d6cabe-430a-4a8c-97f9-866a8ed13460 tempest-PublicSharesTest-1667420263 None] <<< [DELETE] https://127.0.0.1:40443/api/viewpolicies/30/ May 28 12:58:42 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-25d6cabe-430a-4a8c-97f9-866a8ed13460 tempest-PublicSharesTest-1667420263 None] --- [DELETE] https://127.0.0.1:40443/api/viewpolicies/30/: Done May 28 12:58:42 l75lg1-v1 dstat.sh[49771]: 28-05 12:58:42| 15 2 75 7 0|5726M 1754M 277M 7868M| 16k 3981B| 0 7710k| 0 639 |8974 15k|1.18 1.06 1.01|1.0 1.0 0| 0 0 | 0 2048M| 29 358 0 35 0 May 28 12:58:42 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-25d6cabe-430a-4a8c-97f9-866a8ed13460 tempest-PublicSharesTest-1667420263 None] Created reservations ['0787c59a-d9d5-4f43-a1ab-0029ceac9fea', '80979700-7732-4bf3-b53f-0fba12e50dc5', 'bf5278dc-82be-442c-ad55-d708cab66f6c', 'de67890f-36c6-4562-a8a3-90d2f82e6de3'] {{(pid=98474) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 12:58:42 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-25d6cabe-430a-4a8c-97f9-866a8ed13460 tempest-PublicSharesTest-1667420263 None] Committed reservations ['0787c59a-d9d5-4f43-a1ab-0029ceac9fea', '80979700-7732-4bf3-b53f-0fba12e50dc5', 'bf5278dc-82be-442c-ad55-d708cab66f6c', 'de67890f-36c6-4562-a8a3-90d2f82e6de3'] {{(pid=98474) commit /opt/stack/manila/manila/quota.py:1063}} May 28 12:58:42 l75lg1-v1 manila-share[98474]: INFO manila.share.manager [None req-25d6cabe-430a-4a8c-97f9-866a8ed13460 tempest-PublicSharesTest-1667420263 None] Share instance 58febd66-6690-481d-866e-2c57d2f22405: deleted successfully. May 28 12:58:42 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.host_manager [None req-7eab10f5-e18a-4db8-9715-0f60c7d684a3 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Share service is down. (host: l75lg1-v1@generic2). May 28 12:58:42 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.host_manager [None req-7eab10f5-e18a-4db8-9715-0f60c7d684a3 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Share service is down. (host: l75lg1-v1@generic1). May 28 12:58:42 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-7eab10f5-e18a-4db8-9715-0f60c7d684a3 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Starting with 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:80}} May 28 12:58:42 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-7eab10f5-e18a-4db8-9715-0f60c7d684a3 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Filter OnlyHostFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:58:42 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-7eab10f5-e18a-4db8-9715-0f60c7d684a3 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:58:42 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.capacity [None req-7eab10f5-e18a-4db8-9715-0f60c7d684a3 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Space information for share creation on host l75lg1-v1@vast#vast (requested / avail): 1/2074 {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/capacity.py:83}} May 28 12:58:42 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-7eab10f5-e18a-4db8-9715-0f60c7d684a3 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Filter CapacityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:58:42 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-7eab10f5-e18a-4db8-9715-0f60c7d684a3 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:58:42 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-7eab10f5-e18a-4db8-9715-0f60c7d684a3 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Driver Filter: Checking host 'l75lg1-v1@vast#vast' {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:37}} May 28 12:58:42 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-7eab10f5-e18a-4db8-9715-0f60c7d684a3 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Filter function not set :: passing host. {{(pid=98327) _check_filter_function /opt/stack/manila/manila/scheduler/filters/driver.py:53}} May 28 12:58:42 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-7eab10f5-e18a-4db8-9715-0f60c7d684a3 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Result: True {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:40}} May 28 12:58:42 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-7eab10f5-e18a-4db8-9715-0f60c7d684a3 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Done checking host 'l75lg1-v1@vast#vast' {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:41}} May 28 12:58:42 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-7eab10f5-e18a-4db8-9715-0f60c7d684a3 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Filter DriverFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:58:42 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-7eab10f5-e18a-4db8-9715-0f60c7d684a3 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Filter ShareReplicationFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:58:42 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-7eab10f5-e18a-4db8-9715-0f60c7d684a3 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Filter CreateFromSnapshotFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:58:42 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-7eab10f5-e18a-4db8-9715-0f60c7d684a3 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Filter AffinityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:58:42 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-7eab10f5-e18a-4db8-9715-0f60c7d684a3 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Filter AntiAffinityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:58:42 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.drivers.filter [None req-7eab10f5-e18a-4db8-9715-0f60c7d684a3 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Filtered share [host: 'l75lg1-v1@vast#vast', free_capacity_gb: 2074.6229242384434, pools: None] {{(pid=98327) _schedule_share /opt/stack/manila/manila/scheduler/drivers/filter.py:268}} May 28 12:58:42 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-7eab10f5-e18a-4db8-9715-0f60c7d684a3 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Checking host 'l75lg1-v1@vast#vast' {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:46}} May 28 12:58:42 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.weighers.goodness [None req-7eab10f5-e18a-4db8-9715-0f60c7d684a3 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Goodness function not set :: defaulting to minimal goodness rating of 0. May 28 12:58:42 l75lg1-v1 manila-scheduler[98327]: INFO manila.scheduler.weighers.goodness [None req-7eab10f5-e18a-4db8-9715-0f60c7d684a3 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Goodness function result for host l75lg1-v1@vast#vast: 0. May 28 12:58:42 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-7eab10f5-e18a-4db8-9715-0f60c7d684a3 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Goodness: 0 {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:48}} May 28 12:58:42 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-7eab10f5-e18a-4db8-9715-0f60c7d684a3 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Done checking host 'l75lg1-v1@vast#vast' {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:49}} May 28 12:58:42 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.drivers.filter [None req-7eab10f5-e18a-4db8-9715-0f60c7d684a3 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Choosing for share: WeighedHost [host: l75lg1-v1@vast#vast, weight: 0.0] {{(pid=98327) _schedule_share /opt/stack/manila/manila/scheduler/drivers/filter.py:274}} May 28 12:58:42 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-7eab10f5-e18a-4db8-9715-0f60c7d684a3 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares returned with HTTP 200 May 28 12:58:42 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 567/1131] 10.27.203.238 () {66 vars in 1362 bytes} [Tue May 28 12:58:42 2024] POST /share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares => generated 1311 bytes in 502 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:58:42 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-9be136c0-de0d-41d1-b9cb-507cebda1b88 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] GET http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4 May 28 12:58:42 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-9be136c0-de0d-41d1-b9cb-507cebda1b88 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:42 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-9be136c0-de0d-41d1-b9cb-507cebda1b88 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:42 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-9be136c0-de0d-41d1-b9cb-507cebda1b88 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4 returned with HTTP 200 May 28 12:58:42 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 565/1132] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:58:42 2024] GET /share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4 => generated 1311 bytes in 25 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:58:42 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-7eab10f5-e18a-4db8-9715-0f60c7d684a3 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] >>> [GET] https://127.0.0.1:40443/api/vippools/ May 28 12:58:42 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-7eab10f5-e18a-4db8-9715-0f60c7d684a3 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] {'allow_redirects': True, 'params': {'name': 'vippool-1'}} May 28 12:58:42 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-17e12e83-a89f-4479-9c99-7e61112097dc tempest-PublicSharesTest-1667420263 tempest-PublicSharesTest-1667420263-project-member] GET http://10.27.203.238/share/v2/6d36e1eb1dbc449db6aca75b12a2ba18/shares/50dc60c2-08d1-4244-b4aa-f09b7789e32d May 28 12:58:42 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-17e12e83-a89f-4479-9c99-7e61112097dc tempest-PublicSharesTest-1667420263 tempest-PublicSharesTest-1667420263-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:42 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-17e12e83-a89f-4479-9c99-7e61112097dc tempest-PublicSharesTest-1667420263 tempest-PublicSharesTest-1667420263-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:42 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-17e12e83-a89f-4479-9c99-7e61112097dc tempest-PublicSharesTest-1667420263 tempest-PublicSharesTest-1667420263-project-member] HTTP exception thrown: The resource could not be found. May 28 12:58:42 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-17e12e83-a89f-4479-9c99-7e61112097dc tempest-PublicSharesTest-1667420263 tempest-PublicSharesTest-1667420263-project-member] http://10.27.203.238/share/v2/6d36e1eb1dbc449db6aca75b12a2ba18/shares/50dc60c2-08d1-4244-b4aa-f09b7789e32d returned with HTTP 404 May 28 12:58:42 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 568/1133] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:58:42 2024] GET /share/v2/6d36e1eb1dbc449db6aca75b12a2ba18/shares/50dc60c2-08d1-4244-b4aa-f09b7789e32d => generated 78 bytes in 12 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 12:58:42 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-1fc9b9d5-2dee-49eb-a5cf-c8e1f39d7a16 tempest-PublicSharesTest-1667420263 tempest-PublicSharesTest-1667420263-project-member] GET http://10.27.203.238/share/v2/6d36e1eb1dbc449db6aca75b12a2ba18/share-replicas/detail?share_id=5a92a994-03f1-4598-b3f6-70280cf0a971 May 28 12:58:42 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-1fc9b9d5-2dee-49eb-a5cf-c8e1f39d7a16 tempest-PublicSharesTest-1667420263 tempest-PublicSharesTest-1667420263-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:42 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-1fc9b9d5-2dee-49eb-a5cf-c8e1f39d7a16 tempest-PublicSharesTest-1667420263 tempest-PublicSharesTest-1667420263-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:42 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-1fc9b9d5-2dee-49eb-a5cf-c8e1f39d7a16 tempest-PublicSharesTest-1667420263 tempest-PublicSharesTest-1667420263-project-member] http://10.27.203.238/share/v2/6d36e1eb1dbc449db6aca75b12a2ba18/share-replicas/detail?share_id=5a92a994-03f1-4598-b3f6-70280cf0a971 returned with HTTP 200 May 28 12:58:42 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 566/1134] 10.27.203.238 () {64 vars in 1476 bytes} [Tue May 28 12:58:42 2024] GET /share/v2/6d36e1eb1dbc449db6aca75b12a2ba18/share-replicas/detail?share_id=5a92a994-03f1-4598-b3f6-70280cf0a971 => generated 22 bytes in 13 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:58:42 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-85276a66-ca07-4f3f-9343-a3bbc69f06a5 tempest-PublicSharesTest-118543418 tempest-PublicSharesTest-118543418-project-admin] DELETE http://10.27.203.238/share/v2/8ee1466a8fe242afa8e0d0378840bfc1/shares/5a92a994-03f1-4598-b3f6-70280cf0a971 May 28 12:58:42 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-85276a66-ca07-4f3f-9343-a3bbc69f06a5 tempest-PublicSharesTest-118543418 tempest-PublicSharesTest-118543418-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:42 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-85276a66-ca07-4f3f-9343-a3bbc69f06a5 tempest-PublicSharesTest-118543418 tempest-PublicSharesTest-118543418-project-admin] Calling method 'ShareMixin.delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:42 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.v1.shares [None req-85276a66-ca07-4f3f-9343-a3bbc69f06a5 tempest-PublicSharesTest-118543418 tempest-PublicSharesTest-118543418-project-admin] Delete share with id: 5a92a994-03f1-4598-b3f6-70280cf0a971 May 28 12:58:42 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-7eab10f5-e18a-4db8-9715-0f60c7d684a3 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] <<< [GET] https://127.0.0.1:40443/api/vippools/ May 28 12:58:42 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-7eab10f5-e18a-4db8-9715-0f60c7d684a3 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] [Bunch(active_cnode_ids=[], active_interfaces=4, cluster='loop75-kfs', cluster_id=1, cnode_ids=[], cnodes=[], domain_name='vippool-1', enable_l3=False, enable_weighted_balancing=False, enabled=True, end_ip='172.21.75.4', guid='f2abaede-b397-413a-8faa-3aeead6d3b28', gw_ip='', gw_ipv6='', id=2, ip_ranges=[['172.21.75.1', '172.21.75.4']], name='vippool-1', peer_asn=0, port_membership='ALL', ranges_summary='172.21.75.[1-4]', role='PROTOCOLS', start_ip='172.21.75.1', subnet_cidr=16, subnet_cidr_ipv6=None, sync='SYNCED', sync_time='2024-05-28T12:50:09.644123Z', tenant_id=1, tenant_name='default', title='172.21.75.1 - 172.21.75.4', url='https://127.0.0.1:40443/api/vippools/2/', vast_asn=0, vlan=0, vms_preferred=False)] May 28 12:58:42 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-7eab10f5-e18a-4db8-9715-0f60c7d684a3 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] --- [GET] https://127.0.0.1:40443/api/vippools/: Done May 28 12:58:42 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-7eab10f5-e18a-4db8-9715-0f60c7d684a3 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:58:42 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-7eab10f5-e18a-4db8-9715-0f60c7d684a3 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] {'allow_redirects': True, May 28 12:58:42 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-7eab10f5-e18a-4db8-9715-0f60c7d684a3 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] 'params': {'name': '7fdd602c-79d0-479c-95a2-336b202c6639'}} May 28 12:58:42 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-85276a66-ca07-4f3f-9343-a3bbc69f06a5 tempest-PublicSharesTest-118543418 tempest-PublicSharesTest-118543418-project-admin] http://10.27.203.238/share/v2/8ee1466a8fe242afa8e0d0378840bfc1/shares/5a92a994-03f1-4598-b3f6-70280cf0a971 returned with HTTP 202 May 28 12:58:42 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 569/1135] 10.27.203.238 () {64 vars in 1454 bytes} [Tue May 28 12:58:42 2024] DELETE /share/v2/8ee1466a8fe242afa8e0d0378840bfc1/shares/5a92a994-03f1-4598-b3f6-70280cf0a971 => generated 0 bytes in 132 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:58:42 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-d0e57173-e20e-46e1-9fe0-5abafd1f659f tempest-PublicSharesTest-118543418 tempest-PublicSharesTest-118543418-project-admin] GET http://10.27.203.238/share/v2/8ee1466a8fe242afa8e0d0378840bfc1/shares/5a92a994-03f1-4598-b3f6-70280cf0a971 May 28 12:58:42 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-d0e57173-e20e-46e1-9fe0-5abafd1f659f tempest-PublicSharesTest-118543418 tempest-PublicSharesTest-118543418-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:42 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-d0e57173-e20e-46e1-9fe0-5abafd1f659f tempest-PublicSharesTest-118543418 tempest-PublicSharesTest-118543418-project-admin] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:42 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-d0e57173-e20e-46e1-9fe0-5abafd1f659f tempest-PublicSharesTest-118543418 tempest-PublicSharesTest-118543418-project-admin] http://10.27.203.238/share/v2/8ee1466a8fe242afa8e0d0378840bfc1/shares/5a92a994-03f1-4598-b3f6-70280cf0a971 returned with HTTP 200 May 28 12:58:42 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 567/1136] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:58:42 2024] GET /share/v2/8ee1466a8fe242afa8e0d0378840bfc1/shares/5a92a994-03f1-4598-b3f6-70280cf0a971 => generated 1392 bytes in 26 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:58:42 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-85276a66-ca07-4f3f-9343-a3bbc69f06a5 tempest-PublicSharesTest-118543418 None] Acquiring lock "locked_access_rules_operation_by_share_instance_c4c98d1e-9abc-48c7-a23f-ed7f1a740252" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:42 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-85276a66-ca07-4f3f-9343-a3bbc69f06a5 tempest-PublicSharesTest-118543418 None] Lock "locked_access_rules_operation_by_share_instance_c4c98d1e-9abc-48c7-a23f-ed7f1a740252" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:42 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-85276a66-ca07-4f3f-9343-a3bbc69f06a5 tempest-PublicSharesTest-118543418 None] Lock "locked_access_rules_operation_by_share_instance_c4c98d1e-9abc-48c7-a23f-ed7f1a740252" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:42 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-85276a66-ca07-4f3f-9343-a3bbc69f06a5 tempest-PublicSharesTest-118543418 None] Acquiring lock "locked_access_rules_operation_by_share_instance_c4c98d1e-9abc-48c7-a23f-ed7f1a740252" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:42 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-85276a66-ca07-4f3f-9343-a3bbc69f06a5 tempest-PublicSharesTest-118543418 None] Lock "locked_access_rules_operation_by_share_instance_c4c98d1e-9abc-48c7-a23f-ed7f1a740252" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:42 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-85276a66-ca07-4f3f-9343-a3bbc69f06a5 tempest-PublicSharesTest-118543418 None] Lock "locked_access_rules_operation_by_share_instance_c4c98d1e-9abc-48c7-a23f-ed7f1a740252" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:42 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-85276a66-ca07-4f3f-9343-a3bbc69f06a5 tempest-PublicSharesTest-118543418 None] Acquiring lock "locked_access_rules_operation_by_share_instance_c4c98d1e-9abc-48c7-a23f-ed7f1a740252" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:42 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-85276a66-ca07-4f3f-9343-a3bbc69f06a5 tempest-PublicSharesTest-118543418 None] Lock "locked_access_rules_operation_by_share_instance_c4c98d1e-9abc-48c7-a23f-ed7f1a740252" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:42 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-85276a66-ca07-4f3f-9343-a3bbc69f06a5 tempest-PublicSharesTest-118543418 None] Lock "locked_access_rules_operation_by_share_instance_c4c98d1e-9abc-48c7-a23f-ed7f1a740252" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:42 l75lg1-v1 manila-share[98474]: DEBUG manila.share.access [None req-85276a66-ca07-4f3f-9343-a3bbc69f06a5 tempest-PublicSharesTest-118543418 None] All access rules have been synced for share instance c4c98d1e-9abc-48c7-a23f-ed7f1a740252 belonging to share 5a92a994-03f1-4598-b3f6-70280cf0a971. {{(pid=98474) update_access_rules /opt/stack/manila/manila/share/access.py:304}} May 28 12:58:42 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-85276a66-ca07-4f3f-9343-a3bbc69f06a5 tempest-PublicSharesTest-118543418 None] deleting '/manila/manila-c4c98d1e-9abc-48c7-a23f-ed7f1a740252' May 28 12:58:42 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-85276a66-ca07-4f3f-9343-a3bbc69f06a5 tempest-PublicSharesTest-118543418 None] >>> [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/ May 28 12:58:42 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-85276a66-ca07-4f3f-9343-a3bbc69f06a5 tempest-PublicSharesTest-118543418 None] {'data': '{"path": "/manila/manila-c4c98d1e-9abc-48c7-a23f-ed7f1a740252"}', May 28 12:58:42 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-85276a66-ca07-4f3f-9343-a3bbc69f06a5 tempest-PublicSharesTest-118543418 None] 'params': None} May 28 12:58:43 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-85276a66-ca07-4f3f-9343-a3bbc69f06a5 tempest-PublicSharesTest-118543418 None] <<< [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/ May 28 12:58:43 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-85276a66-ca07-4f3f-9343-a3bbc69f06a5 tempest-PublicSharesTest-118543418 None] 'OK' May 28 12:58:43 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-85276a66-ca07-4f3f-9343-a3bbc69f06a5 tempest-PublicSharesTest-118543418 None] --- [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/: Done May 28 12:58:43 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-85276a66-ca07-4f3f-9343-a3bbc69f06a5 tempest-PublicSharesTest-118543418 None] >>> [GET] https://127.0.0.1:40443/api/views/ May 28 12:58:43 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-85276a66-ca07-4f3f-9343-a3bbc69f06a5 tempest-PublicSharesTest-118543418 None] {'allow_redirects': True, May 28 12:58:43 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-85276a66-ca07-4f3f-9343-a3bbc69f06a5 tempest-PublicSharesTest-118543418 None] 'params': {'name': 'c4c98d1e-9abc-48c7-a23f-ed7f1a740252'}} May 28 12:58:43 l75lg1-v1 dstat.sh[49771]: 28-05 12:58:43| 9 1 88 2 0|5726M 1753M 277M 7868M| 17k 3139B| 0 1750k| 0 192 |4458 7190 |1.18 1.06 1.01|2.0 1.0 0| 0 0 | 0 2048M| 29 357 0 32 0 May 28 12:58:43 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f703c79a-94d0-4ade-b68a-65da0c803a9e tempest-SharesMetadataTest-1561320255 None] <<< [POST] https://127.0.0.1:40443/api/views/ May 28 12:58:43 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f703c79a-94d0-4ade-b68a-65da0c803a9e tempest-SharesMetadataTest-1561320255 None] Bunch(abac_tags=[], abe_max_depth=None, abe_protocols=[], alias='', allow_anonymous_access=False, allow_s3_anonymous_access=False, auto_commit='0d', bucket='', bucket_creators=[], bucket_creators_groups=[], bucket_owner=None, bulk_permission_update_progress=None, bulk_permission_update_state=None, cluster='loop75-kfs', cluster_id=1, created='2024-05-28T12:58:42.664711Z', enabled=True, files_retention_mode='NONE', guid='2980358e-2ccb-4ab0-b51c-869a5c867374', id=30, ignore_oos=False, internal=False, is_remote=False, is_seamless=False, logical_capacity=0, max_retention_period=None, min_retention_period=None, name='922a313f-547d-4129-ae7c-39ae549d3f49', nfs_interop_flags='BOTH_NFS3_AND_NFS4_INTEROP_DISABLED', path='/manila/manila-922a313f-547d-4129-ae7c-39ae549d3f49', physical_capacity=0, policy='922a313f-547d-4129-ae7c-39ae549d3f49', policy_id=31, protocols=['NFS'], qos_policy=None, qos_policy_id=None, s3_locks=False, s3_locks_retention_mode='NONE', s3_locks_retention_period='', s3_object_ownership_rule='ObjectWriter', s3_unverified_lookup=False, s3_versioning=False, select_for_live_monitoring=False, share='', share_acl=Bunch(acl=[], enabled=False), sync='SYNCED', sync_time='2024-05-28T12:58:43.216590Z', tenant_id=1, tenant_name='default', title='/manila/manila-922a313f-547d-4129-ae7c-39ae549d3f49', url='https://127.0.0.1:40443/api/views/30/') May 28 12:58:43 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f703c79a-94d0-4ade-b68a-65da0c803a9e tempest-SharesMetadataTest-1561320255 None] --- [POST] https://127.0.0.1:40443/api/views/: Done May 28 12:58:43 l75lg1-v1 manila-share[98474]: INFO manila.share.manager [None req-f703c79a-94d0-4ade-b68a-65da0c803a9e tempest-SharesMetadataTest-1561320255 None] Share instance 922a313f-547d-4129-ae7c-39ae549d3f49 created successfully. May 28 12:58:43 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-7eab10f5-e18a-4db8-9715-0f60c7d684a3 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:58:43 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-7eab10f5-e18a-4db8-9715-0f60c7d684a3 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] [] May 28 12:58:43 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-7eab10f5-e18a-4db8-9715-0f60c7d684a3 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 12:58:43 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-7eab10f5-e18a-4db8-9715-0f60c7d684a3 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] >>> [POST] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:58:43 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-7eab10f5-e18a-4db8-9715-0f60c7d684a3 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] {'data': '{"name": "7fdd602c-79d0-479c-95a2-336b202c6639"}', May 28 12:58:43 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-7eab10f5-e18a-4db8-9715-0f60c7d684a3 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] 'json': None, May 28 12:58:43 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-7eab10f5-e18a-4db8-9715-0f60c7d684a3 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] 'params': None} May 28 12:58:43 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-85276a66-ca07-4f3f-9343-a3bbc69f06a5 tempest-PublicSharesTest-118543418 None] <<< [GET] https://127.0.0.1:40443/api/views/ May 28 12:58:43 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-85276a66-ca07-4f3f-9343-a3bbc69f06a5 tempest-PublicSharesTest-118543418 None] [Bunch(abac_tags=[], abe_max_depth=None, abe_protocols=[], alias='', allow_anonymous_access=False, allow_s3_anonymous_access=False, auto_commit='0d', bucket='', bucket_creators=[], bucket_creators_groups=[], bucket_owner=None, bulk_permission_update_progress=None, bulk_permission_update_state=None, cluster='loop75-kfs', cluster_id=1, created='2024-05-28T12:58:25.495336Z', enabled=True, files_retention_mode='NONE', guid='f77087b1-5cf5-46b8-bb21-10e95b50a818', id=28, ignore_oos=False, internal=False, is_remote=False, is_seamless=False, logical_capacity=0, max_retention_period=None, min_retention_period=None, name='c4c98d1e-9abc-48c7-a23f-ed7f1a740252', nfs_interop_flags='BOTH_NFS3_AND_NFS4_INTEROP_DISABLED', path='/manila/manila-c4c98d1e-9abc-48c7-a23f-ed7f1a740252', physical_capacity=0, policy='c4c98d1e-9abc-48c7-a23f-ed7f1a740252', policy_id=29, protocols=['NFS'], qos_policy=None, qos_policy_id=None, s3_locks=False, s3_locks_retention_mode='NONE', s3_locks_retention_period='', s3_unverified_lookup=False, s3_versioning=False, select_for_live_monitoring=False, share='', share_acl=Bunch(acl=[], enabled=False), sync='SYNCED', sync_time='2024-05-28T12:58:25.762305Z', tenant_id=1, tenant_name='default', title='/manila/manila-c4c98d1e-9abc-48c7-a23f-ed7f1a740252', url='https://127.0.0.1:40443/api/views/28/')] May 28 12:58:43 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-85276a66-ca07-4f3f-9343-a3bbc69f06a5 tempest-PublicSharesTest-118543418 None] --- [GET] https://127.0.0.1:40443/api/views/: Done May 28 12:58:43 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-85276a66-ca07-4f3f-9343-a3bbc69f06a5 tempest-PublicSharesTest-118543418 None] >>> [DELETE] https://127.0.0.1:40443/api/views/28/ May 28 12:58:43 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a8945c45-d985-4f91-9885-702590ff88f8 tempest-AdminActionsTest-1749172189 None] <<< [DELETE] https://127.0.0.1:40443/api/quotas/1/ May 28 12:58:43 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a8945c45-d985-4f91-9885-702590ff88f8 tempest-AdminActionsTest-1749172189 None] --- [DELETE] https://127.0.0.1:40443/api/quotas/1/: Done May 28 12:58:43 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a8945c45-d985-4f91-9885-702590ff88f8 tempest-AdminActionsTest-1749172189 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:58:43 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a8945c45-d985-4f91-9885-702590ff88f8 tempest-AdminActionsTest-1749172189 None] {'allow_redirects': True, May 28 12:58:43 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a8945c45-d985-4f91-9885-702590ff88f8 tempest-AdminActionsTest-1749172189 None] 'params': {'name': '77a25e6b-f137-4342-8eb9-9ced679515e2'}} May 28 12:58:44 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-995e9600-f2b7-4093-a207-ef53a72730b1 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] GET http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/shares/df0ea844-5fc1-4d04-8afb-5048ec5dc33f May 28 12:58:44 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-995e9600-f2b7-4093-a207-ef53a72730b1 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:44 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-995e9600-f2b7-4093-a207-ef53a72730b1 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:44 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-995e9600-f2b7-4093-a207-ef53a72730b1 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/shares/df0ea844-5fc1-4d04-8afb-5048ec5dc33f returned with HTTP 200 May 28 12:58:44 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 570/1137] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:58:44 2024] GET /share/v2/a3499cb78849424db45e54caac01de92/shares/df0ea844-5fc1-4d04-8afb-5048ec5dc33f => generated 1370 bytes in 25 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:58:44 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-67c924d1-2ad3-43cb-840f-df5eef1482db tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] GET http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/0e9e1ee3-c7cc-4239-bc5b-cace9d44e641 May 28 12:58:44 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-67c924d1-2ad3-43cb-840f-df5eef1482db tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:44 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-67c924d1-2ad3-43cb-840f-df5eef1482db tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:44 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-67c924d1-2ad3-43cb-840f-df5eef1482db tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/0e9e1ee3-c7cc-4239-bc5b-cace9d44e641 returned with HTTP 200 May 28 12:58:44 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 568/1138] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:58:44 2024] GET /share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/0e9e1ee3-c7cc-4239-bc5b-cace9d44e641 => generated 1316 bytes in 25 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:58:44 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-5d8944a5-452b-41ac-acd2-583e8d9b587a tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] POST http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/0e9e1ee3-c7cc-4239-bc5b-cace9d44e641/metadata May 28 12:58:44 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-5d8944a5-452b-41ac-acd2-583e8d9b587a tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Action: 'create_metadata', calling method: Controller.__getattribute__..version_select, body: {"metadata": {"key9": "value9", "key10": "value10"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:58:44 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-5d8944a5-452b-41ac-acd2-583e8d9b587a tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/0e9e1ee3-c7cc-4239-bc5b-cace9d44e641/metadata returned with HTTP 200 May 28 12:58:44 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 571/1139] 10.27.203.238 () {66 vars in 1499 bytes} [Tue May 28 12:58:44 2024] POST /share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/0e9e1ee3-c7cc-4239-bc5b-cace9d44e641/metadata => generated 52 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:58:44 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-a7d7f845-39e0-4658-9d36-e5d056914cfa tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] GET http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/0e9e1ee3-c7cc-4239-bc5b-cace9d44e641/metadata/key9 May 28 12:58:44 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-a7d7f845-39e0-4658-9d36-e5d056914cfa tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:44 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-a7d7f845-39e0-4658-9d36-e5d056914cfa tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:44 l75lg1-v1 dstat.sh[49771]: 28-05 12:58:44| 3 1 95 1 0|5726M 1753M 277M 7869M| 27k 2213B| 0 981k| 0 88.1 |2746 4388 |1.18 1.06 1.01|2.0 2.0 0| 0 0 | 0 2048M| 29 358 0 32 0 May 28 12:58:44 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-7eab10f5-e18a-4db8-9715-0f60c7d684a3 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] <<< [POST] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:58:44 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-7eab10f5-e18a-4db8-9715-0f60c7d684a3 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=0, created='2024-05-28T12:58:43.845440Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='31b6534b-d142-4561-992f-4f0759db302d', id=32, internal=False, is_s3_default_policy=False, name='7fdd602c-79d0-479c-95a2-336b202c6639', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=[], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['*'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['*'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T12:58:44.191603Z', tenant_id=1, tenant_name='default', title='7fdd602c-79d0-479c-95a2-336b202c6639', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/32/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[]) May 28 12:58:44 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-7eab10f5-e18a-4db8-9715-0f60c7d684a3 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] --- [POST] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 12:58:44 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-7eab10f5-e18a-4db8-9715-0f60c7d684a3 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] >>> [GET] https://127.0.0.1:40443/api/quotas/ May 28 12:58:44 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-7eab10f5-e18a-4db8-9715-0f60c7d684a3 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] {'allow_redirects': True, May 28 12:58:44 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-7eab10f5-e18a-4db8-9715-0f60c7d684a3 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] 'params': {'name': '7fdd602c-79d0-479c-95a2-336b202c6639'}} May 28 12:58:44 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-a7d7f845-39e0-4658-9d36-e5d056914cfa tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/0e9e1ee3-c7cc-4239-bc5b-cace9d44e641/metadata/key9 returned with HTTP 200 May 28 12:58:44 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 569/1140] 10.27.203.238 () {64 vars in 1493 bytes} [Tue May 28 12:58:44 2024] GET /share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/0e9e1ee3-c7cc-4239-bc5b-cace9d44e641/metadata/key9 => generated 28 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:58:44 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-7f5fbd53-dd21-4229-8c6f-b5188341dd4b tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] GET http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/0e9e1ee3-c7cc-4239-bc5b-cace9d44e641/metadata/key10 May 28 12:58:44 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-7f5fbd53-dd21-4229-8c6f-b5188341dd4b tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:44 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-7f5fbd53-dd21-4229-8c6f-b5188341dd4b tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:44 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-81107929-f5d0-46a8-a59a-037b8cd77d13 tempest-ShareIpRulesForNFSTest-1748669711 None] <<< [PATCH] https://127.0.0.1:40443/api/viewpolicies/21/ May 28 12:58:44 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-81107929-f5d0-46a8-a59a-037b8cd77d13 tempest-ShareIpRulesForNFSTest-1748669711 None] Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=1, created='2024-05-28T12:57:40.763635Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='377955ad-d094-4e49-ab32-1021d943a572', id=21, internal=False, is_s3_default_policy=False, name='b7a7d61c-2cea-442a-9809-507038e080d5', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=['*'], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=[], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=[], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='MODIFYING', sync_time='2024-05-28T12:58:43.460969Z', tenant_id=1, tenant_name='default', title='b7a7d61c-2cea-442a-9809-507038e080d5', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/21/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[]) May 28 12:58:44 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-81107929-f5d0-46a8-a59a-037b8cd77d13 tempest-ShareIpRulesForNFSTest-1748669711 None] --- [PATCH] https://127.0.0.1:40443/api/viewpolicies/21/: Done May 28 12:58:44 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-81107929-f5d0-46a8-a59a-037b8cd77d13 tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:44 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-81107929-f5d0-46a8-a59a-037b8cd77d13 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:44 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-81107929-f5d0-46a8-a59a-037b8cd77d13 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.033s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:44 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-81107929-f5d0-46a8-a59a-037b8cd77d13 tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:44 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-81107929-f5d0-46a8-a59a-037b8cd77d13 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:44 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-7f5fbd53-dd21-4229-8c6f-b5188341dd4b tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/0e9e1ee3-c7cc-4239-bc5b-cace9d44e641/metadata/key10 returned with HTTP 200 May 28 12:58:44 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 572/1141] 10.27.203.238 () {64 vars in 1496 bytes} [Tue May 28 12:58:44 2024] GET /share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/0e9e1ee3-c7cc-4239-bc5b-cace9d44e641/metadata/key10 => generated 30 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:58:44 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-0ecbe01a-42ed-4026-9630-925468fcc3e7 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] POST http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/0e9e1ee3-c7cc-4239-bc5b-cace9d44e641/metadata May 28 12:58:44 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-0ecbe01a-42ed-4026-9630-925468fcc3e7 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Action: 'create_metadata', calling method: Controller.__getattribute__..version_select, body: {"metadata": {"key11": "value11", "key12": "value12"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:58:44 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-81107929-f5d0-46a8-a59a-037b8cd77d13 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.035s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:44 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-81107929-f5d0-46a8-a59a-037b8cd77d13 tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:44 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-81107929-f5d0-46a8-a59a-037b8cd77d13 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:44 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-81107929-f5d0-46a8-a59a-037b8cd77d13 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.004s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:44 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-81107929-f5d0-46a8-a59a-037b8cd77d13 tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:44 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-81107929-f5d0-46a8-a59a-037b8cd77d13 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:44 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-81107929-f5d0-46a8-a59a-037b8cd77d13 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.004s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:44 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-81107929-f5d0-46a8-a59a-037b8cd77d13 tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:44 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-81107929-f5d0-46a8-a59a-037b8cd77d13 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:44 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-81107929-f5d0-46a8-a59a-037b8cd77d13 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.039s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:44 l75lg1-v1 manila-share[98474]: INFO manila.share.access [None req-81107929-f5d0-46a8-a59a-037b8cd77d13 tempest-ShareIpRulesForNFSTest-1748669711 None] Access rules were successfully modified for share instance b7a7d61c-2cea-442a-9809-507038e080d5 belonging to share 1ddadc17-cf10-4a42-8bbd-8335fb3520a1. May 28 12:58:44 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a8945c45-d985-4f91-9885-702590ff88f8 tempest-AdminActionsTest-1749172189 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:58:44 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a8945c45-d985-4f91-9885-702590ff88f8 tempest-AdminActionsTest-1749172189 None] [Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=0, created='2024-05-28T12:56:26.078547Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='39b426f6-8567-435f-897e-d24be3444de1', id=4, internal=False, is_s3_default_policy=False, name='77a25e6b-f137-4342-8eb9-9ced679515e2', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=[], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['*'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['*'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T12:56:26.460809Z', tenant_id=1, tenant_name='default', title='77a25e6b-f137-4342-8eb9-9ced679515e2', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/4/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[])] May 28 12:58:44 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a8945c45-d985-4f91-9885-702590ff88f8 tempest-AdminActionsTest-1749172189 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 12:58:44 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a8945c45-d985-4f91-9885-702590ff88f8 tempest-AdminActionsTest-1749172189 None] >>> [DELETE] https://127.0.0.1:40443/api/viewpolicies/4/ May 28 12:58:44 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-0ecbe01a-42ed-4026-9630-925468fcc3e7 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/0e9e1ee3-c7cc-4239-bc5b-cace9d44e641/metadata returned with HTTP 200 May 28 12:58:44 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 570/1142] 10.27.203.238 () {66 vars in 1499 bytes} [Tue May 28 12:58:44 2024] POST /share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/0e9e1ee3-c7cc-4239-bc5b-cace9d44e641/metadata => generated 92 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:58:44 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-ee26caa9-6c6a-4f68-908b-d4f4642a4cff tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] GET http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/0e9e1ee3-c7cc-4239-bc5b-cace9d44e641/metadata/key9 May 28 12:58:44 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-ee26caa9-6c6a-4f68-908b-d4f4642a4cff tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:44 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-ee26caa9-6c6a-4f68-908b-d4f4642a4cff tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:44 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-ee26caa9-6c6a-4f68-908b-d4f4642a4cff tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/0e9e1ee3-c7cc-4239-bc5b-cace9d44e641/metadata/key9 returned with HTTP 200 May 28 12:58:44 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 573/1143] 10.27.203.238 () {64 vars in 1493 bytes} [Tue May 28 12:58:44 2024] GET /share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/0e9e1ee3-c7cc-4239-bc5b-cace9d44e641/metadata/key9 => generated 28 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:58:44 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-b76b89a8-aab5-4dd2-b18d-b51041b79e7f tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] GET http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/0e9e1ee3-c7cc-4239-bc5b-cace9d44e641/metadata/key10 May 28 12:58:44 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-b76b89a8-aab5-4dd2-b18d-b51041b79e7f tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:44 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-b76b89a8-aab5-4dd2-b18d-b51041b79e7f tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:44 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-7eab10f5-e18a-4db8-9715-0f60c7d684a3 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] <<< [GET] https://127.0.0.1:40443/api/quotas/ May 28 12:58:44 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-7eab10f5-e18a-4db8-9715-0f60c7d684a3 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] [] May 28 12:58:44 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-7eab10f5-e18a-4db8-9715-0f60c7d684a3 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] --- [GET] https://127.0.0.1:40443/api/quotas/: Done May 28 12:58:44 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-7eab10f5-e18a-4db8-9715-0f60c7d684a3 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] >>> [POST] https://127.0.0.1:40443/api/quotas/ May 28 12:58:44 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-7eab10f5-e18a-4db8-9715-0f60c7d684a3 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] {'data': '{"name": "7fdd602c-79d0-479c-95a2-336b202c6639", "path": ' May 28 12:58:44 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-7eab10f5-e18a-4db8-9715-0f60c7d684a3 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] '"/manila/manila-7fdd602c-79d0-479c-95a2-336b202c6639", "create_dir": ' May 28 12:58:44 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-7eab10f5-e18a-4db8-9715-0f60c7d684a3 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] 'true, "hard_limit": 1073741824}', May 28 12:58:44 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-7eab10f5-e18a-4db8-9715-0f60c7d684a3 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] 'json': None, May 28 12:58:44 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-7eab10f5-e18a-4db8-9715-0f60c7d684a3 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] 'params': None} May 28 12:58:44 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-b76b89a8-aab5-4dd2-b18d-b51041b79e7f tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/0e9e1ee3-c7cc-4239-bc5b-cace9d44e641/metadata/key10 returned with HTTP 200 May 28 12:58:44 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 571/1144] 10.27.203.238 () {64 vars in 1496 bytes} [Tue May 28 12:58:44 2024] GET /share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/0e9e1ee3-c7cc-4239-bc5b-cace9d44e641/metadata/key10 => generated 30 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:58:44 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-a5297c8f-9053-4089-b4c5-75a9d692f113 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] GET http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/0e9e1ee3-c7cc-4239-bc5b-cace9d44e641/metadata/key11 May 28 12:58:44 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-a5297c8f-9053-4089-b4c5-75a9d692f113 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:44 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-a5297c8f-9053-4089-b4c5-75a9d692f113 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:44 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-a5297c8f-9053-4089-b4c5-75a9d692f113 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/0e9e1ee3-c7cc-4239-bc5b-cace9d44e641/metadata/key11 returned with HTTP 200 May 28 12:58:44 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 574/1145] 10.27.203.238 () {64 vars in 1496 bytes} [Tue May 28 12:58:44 2024] GET /share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/0e9e1ee3-c7cc-4239-bc5b-cace9d44e641/metadata/key11 => generated 30 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:58:44 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-24797cfa-948f-4b9c-a5b7-a6a294dea5af tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] GET http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/0e9e1ee3-c7cc-4239-bc5b-cace9d44e641/metadata/key12 May 28 12:58:44 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-24797cfa-948f-4b9c-a5b7-a6a294dea5af tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:44 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-24797cfa-948f-4b9c-a5b7-a6a294dea5af tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:44 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-0b62cbc9-b491-4737-b021-c5b937004faa tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] GET http://10.27.203.238/share/v2/776f75906bc64f8f9316d5aab4b50bf1/share-access-rules?share_id=1ddadc17-cf10-4a42-8bbd-8335fb3520a1 May 28 12:58:44 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-0b62cbc9-b491-4737-b021-c5b937004faa tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:44 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-0b62cbc9-b491-4737-b021-c5b937004faa tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:44 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-0b62cbc9-b491-4737-b021-c5b937004faa tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] http://10.27.203.238/share/v2/776f75906bc64f8f9316d5aab4b50bf1/share-access-rules?share_id=1ddadc17-cf10-4a42-8bbd-8335fb3520a1 returned with HTTP 200 May 28 12:58:44 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 575/1146] 10.27.203.238 () {64 vars in 1467 bytes} [Tue May 28 12:58:44 2024] GET /share/v2/776f75906bc64f8f9316d5aab4b50bf1/share-access-rules?share_id=1ddadc17-cf10-4a42-8bbd-8335fb3520a1 => generated 19 bytes in 30 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:58:44 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-150312d6-9c3e-4d89-8a71-2c30b6e42111 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] POST http://10.27.203.238/share/v2/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action May 28 12:58:44 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-150312d6-9c3e-4d89-8a71-2c30b6e42111 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Action body: b'{"allow_access": {"access_type": "ip", "access_to": "203.0.113.171", "access_level": "rw"}}' {{(pid=98330) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:58:44 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-150312d6-9c3e-4d89-8a71-2c30b6e42111 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Action: 'action', calling method: ShareController.allow_access, body: {"allow_access": {"access_type": "ip", "access_to": "203.0.113.171", "access_level": "rw"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:58:44 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-24797cfa-948f-4b9c-a5b7-a6a294dea5af tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/0e9e1ee3-c7cc-4239-bc5b-cace9d44e641/metadata/key12 returned with HTTP 200 May 28 12:58:44 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 572/1147] 10.27.203.238 () {64 vars in 1496 bytes} [Tue May 28 12:58:44 2024] GET /share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/0e9e1ee3-c7cc-4239-bc5b-cace9d44e641/metadata/key12 => generated 30 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:58:44 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-10c6488e-6e52-4bb2-92ff-8ba35abaed0a tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] DELETE http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/0e9e1ee3-c7cc-4239-bc5b-cace9d44e641/metadata/key9 May 28 12:58:44 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-10c6488e-6e52-4bb2-92ff-8ba35abaed0a tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:44 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-10c6488e-6e52-4bb2-92ff-8ba35abaed0a tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:44 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-150312d6-9c3e-4d89-8a71-2c30b6e42111 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:44 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-150312d6-9c3e-4d89-8a71-2c30b6e42111 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:44 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-150312d6-9c3e-4d89-8a71-2c30b6e42111 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.041s {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:44 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-150312d6-9c3e-4d89-8a71-2c30b6e42111 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] http://10.27.203.238/share/v2/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action returned with HTTP 200 May 28 12:58:44 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 576/1148] 10.27.203.238 () {66 vars in 1493 bytes} [Tue May 28 12:58:44 2024] POST /share/v2/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action => generated 311 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:58:44 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-10c6488e-6e52-4bb2-92ff-8ba35abaed0a tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/0e9e1ee3-c7cc-4239-bc5b-cace9d44e641/metadata/key9 returned with HTTP 200 May 28 12:58:44 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 573/1149] 10.27.203.238 () {64 vars in 1496 bytes} [Tue May 28 12:58:44 2024] DELETE /share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/0e9e1ee3-c7cc-4239-bc5b-cace9d44e641/metadata/key9 => generated 0 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 229 bytes (1 switches on core 0) May 28 12:58:44 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-75f0204d-986f-4d59-ba1c-e3ca5e49ed92 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] GET http://10.27.203.238/share/v2/776f75906bc64f8f9316d5aab4b50bf1/share-access-rules?share_id=1ddadc17-cf10-4a42-8bbd-8335fb3520a1 May 28 12:58:44 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-75f0204d-986f-4d59-ba1c-e3ca5e49ed92 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:44 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-75f0204d-986f-4d59-ba1c-e3ca5e49ed92 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:44 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-d0f13f91-70d8-4a1a-82db-261c571bb798 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] DELETE http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/0e9e1ee3-c7cc-4239-bc5b-cace9d44e641/metadata/key10 May 28 12:58:44 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-d0f13f91-70d8-4a1a-82db-261c571bb798 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:44 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-d0f13f91-70d8-4a1a-82db-261c571bb798 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:44 l75lg1-v1 manila-share[98474]: DEBUG manila.share.manager [None req-150312d6-9c3e-4d89-8a71-2c30b6e42111 tempest-ShareIpRulesForNFSTest-1748669711 None] Received request to update access for share instance b7a7d61c-2cea-442a-9809-507038e080d5. {{(pid=98474) update_access_for_instances /opt/stack/manila/manila/share/manager.py:4353}} May 28 12:58:44 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.lock.api [None req-75f0204d-986f-4d59-ba1c-e3ca5e49ed92 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Searching for locks by: {'resource_id': '62766e3c-2f54-4fb6-85a6-dfce2a050ae5', 'resource_action': 'show', 'resource_type': 'access_rule'} {{(pid=98330) get_all /opt/stack/manila/manila/lock/api.py:112}} May 28 12:58:44 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-150312d6-9c3e-4d89-8a71-2c30b6e42111 tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:44 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-150312d6-9c3e-4d89-8a71-2c30b6e42111 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:44 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-75f0204d-986f-4d59-ba1c-e3ca5e49ed92 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] http://10.27.203.238/share/v2/776f75906bc64f8f9316d5aab4b50bf1/share-access-rules?share_id=1ddadc17-cf10-4a42-8bbd-8335fb3520a1 returned with HTTP 200 May 28 12:58:44 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 577/1150] 10.27.203.238 () {64 vars in 1467 bytes} [Tue May 28 12:58:44 2024] GET /share/v2/776f75906bc64f8f9316d5aab4b50bf1/share-access-rules?share_id=1ddadc17-cf10-4a42-8bbd-8335fb3520a1 => generated 266 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 231 bytes (2 switches on core 0) May 28 12:58:44 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-150312d6-9c3e-4d89-8a71-2c30b6e42111 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.004s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:44 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-150312d6-9c3e-4d89-8a71-2c30b6e42111 tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:44 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-150312d6-9c3e-4d89-8a71-2c30b6e42111 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:45 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-d0f13f91-70d8-4a1a-82db-261c571bb798 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/0e9e1ee3-c7cc-4239-bc5b-cace9d44e641/metadata/key10 returned with HTTP 200 May 28 12:58:45 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 574/1151] 10.27.203.238 () {64 vars in 1499 bytes} [Tue May 28 12:58:44 2024] DELETE /share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/0e9e1ee3-c7cc-4239-bc5b-cace9d44e641/metadata/key10 => generated 0 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 229 bytes (2 switches on core 0) May 28 12:58:45 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-7e5b9640-ba86-4fed-9888-fcec027101a9 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] DELETE http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/0e9e1ee3-c7cc-4239-bc5b-cace9d44e641/metadata/key11 May 28 12:58:45 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-7e5b9640-ba86-4fed-9888-fcec027101a9 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:45 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-7e5b9640-ba86-4fed-9888-fcec027101a9 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:45 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-150312d6-9c3e-4d89-8a71-2c30b6e42111 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.068s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:45 l75lg1-v1 manila-share[98474]: DEBUG manila.share.access [None req-150312d6-9c3e-4d89-8a71-2c30b6e42111 tempest-ShareIpRulesForNFSTest-1748669711 None] Updating access rules for share instance b7a7d61c-2cea-442a-9809-507038e080d5 belonging to share 1ddadc17-cf10-4a42-8bbd-8335fb3520a1. {{(pid=98474) update_access_rules /opt/stack/manila/manila/share/access.py:298}} May 28 12:58:45 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-150312d6-9c3e-4d89-8a71-2c30b6e42111 tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:45 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-150312d6-9c3e-4d89-8a71-2c30b6e42111 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:45 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-150312d6-9c3e-4d89-8a71-2c30b6e42111 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.008s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:45 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-150312d6-9c3e-4d89-8a71-2c30b6e42111 tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:45 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-150312d6-9c3e-4d89-8a71-2c30b6e42111 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:45 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-150312d6-9c3e-4d89-8a71-2c30b6e42111 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.017s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:45 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-150312d6-9c3e-4d89-8a71-2c30b6e42111 tempest-ShareIpRulesForNFSTest-1748669711 None] changing access on None May 28 12:58:45 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-150312d6-9c3e-4d89-8a71-2c30b6e42111 tempest-ShareIpRulesForNFSTest-1748669711 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:58:45 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-150312d6-9c3e-4d89-8a71-2c30b6e42111 tempest-ShareIpRulesForNFSTest-1748669711 None] {'allow_redirects': True, May 28 12:58:45 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-150312d6-9c3e-4d89-8a71-2c30b6e42111 tempest-ShareIpRulesForNFSTest-1748669711 None] 'params': {'name': 'b7a7d61c-2cea-442a-9809-507038e080d5'}} May 28 12:58:45 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-7e5b9640-ba86-4fed-9888-fcec027101a9 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/0e9e1ee3-c7cc-4239-bc5b-cace9d44e641/metadata/key11 returned with HTTP 200 May 28 12:58:45 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 578/1152] 10.27.203.238 () {64 vars in 1499 bytes} [Tue May 28 12:58:45 2024] DELETE /share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/0e9e1ee3-c7cc-4239-bc5b-cace9d44e641/metadata/key11 => generated 0 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 229 bytes (1 switches on core 0) May 28 12:58:45 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-82d3ea05-8b49-41c2-b22c-5e42f5d0d3c3 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] DELETE http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/0e9e1ee3-c7cc-4239-bc5b-cace9d44e641/metadata/key12 May 28 12:58:45 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-82d3ea05-8b49-41c2-b22c-5e42f5d0d3c3 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:45 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-82d3ea05-8b49-41c2-b22c-5e42f5d0d3c3 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:45 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-82d3ea05-8b49-41c2-b22c-5e42f5d0d3c3 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/0e9e1ee3-c7cc-4239-bc5b-cace9d44e641/metadata/key12 returned with HTTP 200 May 28 12:58:45 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 575/1153] 10.27.203.238 () {64 vars in 1499 bytes} [Tue May 28 12:58:45 2024] DELETE /share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/0e9e1ee3-c7cc-4239-bc5b-cace9d44e641/metadata/key12 => generated 0 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 229 bytes (1 switches on core 0) May 28 12:58:45 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-5b0f1ea0-b690-45dd-bbdd-b570fbccca5a tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] GET http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/0e9e1ee3-c7cc-4239-bc5b-cace9d44e641/metadata May 28 12:58:45 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-5b0f1ea0-b690-45dd-bbdd-b570fbccca5a tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:45 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-5b0f1ea0-b690-45dd-bbdd-b570fbccca5a tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:45 l75lg1-v1 dstat.sh[49771]: 28-05 12:58:45| 15 1 81 2 0|5726M 1753M 277M 7869M| 29k 5734B| 0 1320k| 0 189 |5965 9835 |1.18 1.06 1.01|2.0 1.0 0| 0 0 | 0 2048M| 29 358 0 31 0 May 28 12:58:45 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-5b0f1ea0-b690-45dd-bbdd-b570fbccca5a tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/0e9e1ee3-c7cc-4239-bc5b-cace9d44e641/metadata returned with HTTP 200 May 28 12:58:45 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 579/1154] 10.27.203.238 () {64 vars in 1478 bytes} [Tue May 28 12:58:45 2024] GET /share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/0e9e1ee3-c7cc-4239-bc5b-cace9d44e641/metadata => generated 16 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:58:45 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-76386251-cb6e-493a-9cab-c63988a6b874 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] GET http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/share-replicas/detail?share_id=0e9e1ee3-c7cc-4239-bc5b-cace9d44e641 May 28 12:58:45 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-76386251-cb6e-493a-9cab-c63988a6b874 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:45 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-76386251-cb6e-493a-9cab-c63988a6b874 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:45 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-76386251-cb6e-493a-9cab-c63988a6b874 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/share-replicas/detail?share_id=0e9e1ee3-c7cc-4239-bc5b-cace9d44e641 returned with HTTP 200 May 28 12:58:45 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 576/1155] 10.27.203.238 () {64 vars in 1476 bytes} [Tue May 28 12:58:45 2024] GET /share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/share-replicas/detail?share_id=0e9e1ee3-c7cc-4239-bc5b-cace9d44e641 => generated 22 bytes in 14 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:58:45 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-26a97202-0bdc-48c2-b1a1-828e0350b6b1 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] DELETE http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/0e9e1ee3-c7cc-4239-bc5b-cace9d44e641 May 28 12:58:45 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-26a97202-0bdc-48c2-b1a1-828e0350b6b1 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:45 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-26a97202-0bdc-48c2-b1a1-828e0350b6b1 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Calling method 'ShareMixin.delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:45 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.v1.shares [None req-26a97202-0bdc-48c2-b1a1-828e0350b6b1 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Delete share with id: 0e9e1ee3-c7cc-4239-bc5b-cace9d44e641 May 28 12:58:45 l75lg1-v1 neutron-server[77623]: DEBUG dbcounter [-] [77623] Writing DB stats neutron:SELECT=1 {{(pid=77623) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:58:45 l75lg1-v1 neutron-server[77623]: DEBUG dbcounter [-] [77623] Writing DB stats neutron:SELECT=2 {{(pid=77623) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:58:45 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-26a97202-0bdc-48c2-b1a1-828e0350b6b1 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/0e9e1ee3-c7cc-4239-bc5b-cace9d44e641 returned with HTTP 202 May 28 12:58:45 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 580/1156] 10.27.203.238 () {64 vars in 1454 bytes} [Tue May 28 12:58:45 2024] DELETE /share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/0e9e1ee3-c7cc-4239-bc5b-cace9d44e641 => generated 0 bytes in 131 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:58:45 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-f8e125c1-584d-4f66-9e2b-b6e26464e128 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] GET http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/0e9e1ee3-c7cc-4239-bc5b-cace9d44e641 May 28 12:58:45 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-f8e125c1-584d-4f66-9e2b-b6e26464e128 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:45 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-f8e125c1-584d-4f66-9e2b-b6e26464e128 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:45 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-150312d6-9c3e-4d89-8a71-2c30b6e42111 tempest-ShareIpRulesForNFSTest-1748669711 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:58:45 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-150312d6-9c3e-4d89-8a71-2c30b6e42111 tempest-ShareIpRulesForNFSTest-1748669711 None] [Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=1, created='2024-05-28T12:57:40.763635Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='377955ad-d094-4e49-ab32-1021d943a572', id=21, internal=False, is_s3_default_policy=False, name='b7a7d61c-2cea-442a-9809-507038e080d5', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=['*'], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=[], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=[], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T12:58:44.196296Z', tenant_id=1, tenant_name='default', title='b7a7d61c-2cea-442a-9809-507038e080d5', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/21/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[])] May 28 12:58:45 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-150312d6-9c3e-4d89-8a71-2c30b6e42111 tempest-ShareIpRulesForNFSTest-1748669711 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 12:58:45 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-150312d6-9c3e-4d89-8a71-2c30b6e42111 tempest-ShareIpRulesForNFSTest-1748669711 None] changing access on /manila/manila-b7a7d61c-2cea-442a-9809-507038e080d5. Rules: {'nfs_read_write': ['203.0.113.171'], 'nfs_read_only': []} May 28 12:58:45 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-150312d6-9c3e-4d89-8a71-2c30b6e42111 tempest-ShareIpRulesForNFSTest-1748669711 None] >>> [PATCH] https://127.0.0.1:40443/api/viewpolicies/21/ May 28 12:58:45 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-150312d6-9c3e-4d89-8a71-2c30b6e42111 tempest-ShareIpRulesForNFSTest-1748669711 None] {'data': '{"name": "b7a7d61c-2cea-442a-9809-507038e080d5", "nfs_no_squash": ' May 28 12:58:45 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-150312d6-9c3e-4d89-8a71-2c30b6e42111 tempest-ShareIpRulesForNFSTest-1748669711 None] '["*"], "nfs_root_squash": ["*"], "nfs_read_write": ' May 28 12:58:45 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-150312d6-9c3e-4d89-8a71-2c30b6e42111 tempest-ShareIpRulesForNFSTest-1748669711 None] '["203.0.113.171"], "nfs_read_only": []}', May 28 12:58:45 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-150312d6-9c3e-4d89-8a71-2c30b6e42111 tempest-ShareIpRulesForNFSTest-1748669711 None] 'params': None} May 28 12:58:45 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-f8e125c1-584d-4f66-9e2b-b6e26464e128 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/0e9e1ee3-c7cc-4239-bc5b-cace9d44e641 returned with HTTP 200 May 28 12:58:45 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 577/1157] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:58:45 2024] GET /share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/0e9e1ee3-c7cc-4239-bc5b-cace9d44e641 => generated 1315 bytes in 26 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:58:45 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-26a97202-0bdc-48c2-b1a1-828e0350b6b1 tempest-SharesMetadataTest-1561320255 None] Acquiring lock "locked_access_rules_operation_by_share_instance_922a313f-547d-4129-ae7c-39ae549d3f49" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:45 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-26a97202-0bdc-48c2-b1a1-828e0350b6b1 tempest-SharesMetadataTest-1561320255 None] Lock "locked_access_rules_operation_by_share_instance_922a313f-547d-4129-ae7c-39ae549d3f49" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:45 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-26a97202-0bdc-48c2-b1a1-828e0350b6b1 tempest-SharesMetadataTest-1561320255 None] Lock "locked_access_rules_operation_by_share_instance_922a313f-547d-4129-ae7c-39ae549d3f49" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:45 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-26a97202-0bdc-48c2-b1a1-828e0350b6b1 tempest-SharesMetadataTest-1561320255 None] Acquiring lock "locked_access_rules_operation_by_share_instance_922a313f-547d-4129-ae7c-39ae549d3f49" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:45 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-26a97202-0bdc-48c2-b1a1-828e0350b6b1 tempest-SharesMetadataTest-1561320255 None] Lock "locked_access_rules_operation_by_share_instance_922a313f-547d-4129-ae7c-39ae549d3f49" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:45 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-26a97202-0bdc-48c2-b1a1-828e0350b6b1 tempest-SharesMetadataTest-1561320255 None] Lock "locked_access_rules_operation_by_share_instance_922a313f-547d-4129-ae7c-39ae549d3f49" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:45 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-26a97202-0bdc-48c2-b1a1-828e0350b6b1 tempest-SharesMetadataTest-1561320255 None] Acquiring lock "locked_access_rules_operation_by_share_instance_922a313f-547d-4129-ae7c-39ae549d3f49" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:45 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-26a97202-0bdc-48c2-b1a1-828e0350b6b1 tempest-SharesMetadataTest-1561320255 None] Lock "locked_access_rules_operation_by_share_instance_922a313f-547d-4129-ae7c-39ae549d3f49" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:45 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-26a97202-0bdc-48c2-b1a1-828e0350b6b1 tempest-SharesMetadataTest-1561320255 None] Lock "locked_access_rules_operation_by_share_instance_922a313f-547d-4129-ae7c-39ae549d3f49" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:45 l75lg1-v1 manila-share[98474]: DEBUG manila.share.access [None req-26a97202-0bdc-48c2-b1a1-828e0350b6b1 tempest-SharesMetadataTest-1561320255 None] All access rules have been synced for share instance 922a313f-547d-4129-ae7c-39ae549d3f49 belonging to share 0e9e1ee3-c7cc-4239-bc5b-cace9d44e641. {{(pid=98474) update_access_rules /opt/stack/manila/manila/share/access.py:304}} May 28 12:58:45 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-26a97202-0bdc-48c2-b1a1-828e0350b6b1 tempest-SharesMetadataTest-1561320255 None] deleting '/manila/manila-922a313f-547d-4129-ae7c-39ae549d3f49' May 28 12:58:45 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-26a97202-0bdc-48c2-b1a1-828e0350b6b1 tempest-SharesMetadataTest-1561320255 None] >>> [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/ May 28 12:58:45 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-26a97202-0bdc-48c2-b1a1-828e0350b6b1 tempest-SharesMetadataTest-1561320255 None] {'data': '{"path": "/manila/manila-922a313f-547d-4129-ae7c-39ae549d3f49"}', May 28 12:58:45 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-26a97202-0bdc-48c2-b1a1-828e0350b6b1 tempest-SharesMetadataTest-1561320255 None] 'params': None} May 28 12:58:45 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-fd5eb400-68f4-49f2-bbd6-410615cf9b9e tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] GET http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4 May 28 12:58:45 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-fd5eb400-68f4-49f2-bbd6-410615cf9b9e tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:45 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-fd5eb400-68f4-49f2-bbd6-410615cf9b9e tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:45 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-fd5eb400-68f4-49f2-bbd6-410615cf9b9e tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4 returned with HTTP 200 May 28 12:58:45 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 581/1158] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:58:45 2024] GET /share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4 => generated 1313 bytes in 28 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:58:45 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-85276a66-ca07-4f3f-9343-a3bbc69f06a5 tempest-PublicSharesTest-118543418 None] <<< [DELETE] https://127.0.0.1:40443/api/views/28/ May 28 12:58:45 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-85276a66-ca07-4f3f-9343-a3bbc69f06a5 tempest-PublicSharesTest-118543418 None] --- [DELETE] https://127.0.0.1:40443/api/views/28/: Done May 28 12:58:45 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-85276a66-ca07-4f3f-9343-a3bbc69f06a5 tempest-PublicSharesTest-118543418 None] >>> [GET] https://127.0.0.1:40443/api/quotas/ May 28 12:58:45 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-85276a66-ca07-4f3f-9343-a3bbc69f06a5 tempest-PublicSharesTest-118543418 None] {'allow_redirects': True, May 28 12:58:45 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-85276a66-ca07-4f3f-9343-a3bbc69f06a5 tempest-PublicSharesTest-118543418 None] 'params': {'name': 'c4c98d1e-9abc-48c7-a23f-ed7f1a740252'}} May 28 12:58:45 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-26a97202-0bdc-48c2-b1a1-828e0350b6b1 tempest-SharesMetadataTest-1561320255 None] <<< [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/ May 28 12:58:45 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-26a97202-0bdc-48c2-b1a1-828e0350b6b1 tempest-SharesMetadataTest-1561320255 None] 'OK' May 28 12:58:45 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-26a97202-0bdc-48c2-b1a1-828e0350b6b1 tempest-SharesMetadataTest-1561320255 None] --- [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/: Done May 28 12:58:45 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-26a97202-0bdc-48c2-b1a1-828e0350b6b1 tempest-SharesMetadataTest-1561320255 None] >>> [GET] https://127.0.0.1:40443/api/views/ May 28 12:58:45 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-26a97202-0bdc-48c2-b1a1-828e0350b6b1 tempest-SharesMetadataTest-1561320255 None] {'allow_redirects': True, May 28 12:58:45 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-26a97202-0bdc-48c2-b1a1-828e0350b6b1 tempest-SharesMetadataTest-1561320255 None] 'params': {'name': '922a313f-547d-4129-ae7c-39ae549d3f49'}} May 28 12:58:45 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-7eab10f5-e18a-4db8-9715-0f60c7d684a3 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] <<< [POST] https://127.0.0.1:40443/api/quotas/ May 28 12:58:45 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-7eab10f5-e18a-4db8-9715-0f60c7d684a3 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Bunch(cluster='loop75-kfs', cluster_id=1, default_email=None, default_group_quota=None, default_user_quota=None, enable_alarms=True, enable_email_providers=True, grace_period=None, group_quotas=[], guid='0e87f0bf-2eb1-4a2d-b001-3e888e655eb8', hard_limit=1073741824, hard_limit_inodes=None, id=29, internal=False, is_user_quota=False, last_user_quotas_update=None, name='7fdd602c-79d0-479c-95a2-336b202c6639', num_blocked_users=0, num_exceeded_users=0, path='/manila/manila-7fdd602c-79d0-479c-95a2-336b202c6639', percent_capacity=0, percent_inodes=None, pretty_grace_period=None, pretty_grace_period_expiration=None, pretty_state='OK (CREATED)', soft_limit=None, soft_limit_inodes=None, state='OK', sync_state='CREATED', system_id=29, tenant_id=1, tenant_name='default', time_to_block=None, title='7fdd602c-79d0-479c-95a2-336b202c6639', url='https://127.0.0.1:40443/api/quotas/29/', used_capacity=0, used_capacity_tb=0.0, used_effective_capacity=0, used_effective_capacity_tb=0.0, used_inodes=0, used_limited_capacity=0, user_quotas=[]) May 28 12:58:45 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-7eab10f5-e18a-4db8-9715-0f60c7d684a3 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] --- [POST] https://127.0.0.1:40443/api/quotas/: Done May 28 12:58:45 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-7eab10f5-e18a-4db8-9715-0f60c7d684a3 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] >>> [GET] https://127.0.0.1:40443/api/views/ May 28 12:58:45 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-7eab10f5-e18a-4db8-9715-0f60c7d684a3 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] {'allow_redirects': True, May 28 12:58:45 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-7eab10f5-e18a-4db8-9715-0f60c7d684a3 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] 'params': {'name': '7fdd602c-79d0-479c-95a2-336b202c6639'}} May 28 12:58:45 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-e10243cd-7627-4c6a-85c0-6001f2619759 tempest-PublicSharesTest-118543418 tempest-PublicSharesTest-118543418-project-admin] GET http://10.27.203.238/share/v2/8ee1466a8fe242afa8e0d0378840bfc1/shares/5a92a994-03f1-4598-b3f6-70280cf0a971 May 28 12:58:45 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-e10243cd-7627-4c6a-85c0-6001f2619759 tempest-PublicSharesTest-118543418 tempest-PublicSharesTest-118543418-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:45 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-e10243cd-7627-4c6a-85c0-6001f2619759 tempest-PublicSharesTest-118543418 tempest-PublicSharesTest-118543418-project-admin] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:45 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-e10243cd-7627-4c6a-85c0-6001f2619759 tempest-PublicSharesTest-118543418 tempest-PublicSharesTest-118543418-project-admin] http://10.27.203.238/share/v2/8ee1466a8fe242afa8e0d0378840bfc1/shares/5a92a994-03f1-4598-b3f6-70280cf0a971 returned with HTTP 200 May 28 12:58:45 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 578/1159] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:58:45 2024] GET /share/v2/8ee1466a8fe242afa8e0d0378840bfc1/shares/5a92a994-03f1-4598-b3f6-70280cf0a971 => generated 1392 bytes in 25 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:58:46 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a8945c45-d985-4f91-9885-702590ff88f8 tempest-AdminActionsTest-1749172189 None] <<< [DELETE] https://127.0.0.1:40443/api/viewpolicies/4/ May 28 12:58:46 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a8945c45-d985-4f91-9885-702590ff88f8 tempest-AdminActionsTest-1749172189 None] --- [DELETE] https://127.0.0.1:40443/api/viewpolicies/4/: Done May 28 12:58:46 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-a8945c45-d985-4f91-9885-702590ff88f8 tempest-AdminActionsTest-1749172189 None] Created reservations ['52500a23-ed8c-4fb6-8e01-f728a3d51d73', 'b9666dc3-2fc7-44c9-865d-9dbc99924ffe', '03d89c8e-2fa1-420f-be32-da5552f2cbb4', 'b26e82bc-44a7-4522-a7a1-1276176f40cb'] {{(pid=98474) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 12:58:46 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-85276a66-ca07-4f3f-9343-a3bbc69f06a5 tempest-PublicSharesTest-118543418 None] <<< [GET] https://127.0.0.1:40443/api/quotas/ May 28 12:58:46 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-85276a66-ca07-4f3f-9343-a3bbc69f06a5 tempest-PublicSharesTest-118543418 None] [Bunch(cluster='loop75-kfs', cluster_id=1, default_email=None, default_group_quota=None, default_user_quota=None, enable_alarms=True, enable_email_providers=True, grace_period=None, guid='122392ee-7157-4035-874e-bb2b6612b1d1', hard_limit=1073741824, hard_limit_inodes=None, id=26, internal=False, is_user_quota=False, last_user_quotas_update=None, name='c4c98d1e-9abc-48c7-a23f-ed7f1a740252', num_blocked_users=0, num_exceeded_users=0, path='/manila/manila-c4c98d1e-9abc-48c7-a23f-ed7f1a740252', percent_capacity=0, percent_inodes=None, pretty_grace_period=None, pretty_grace_period_expiration=None, pretty_state='OK', soft_limit=None, soft_limit_inodes=None, state='OK', sync_state='SYNCHRONIZED', system_id=26, tenant_id=1, tenant_name='default', time_to_block=None, title='c4c98d1e-9abc-48c7-a23f-ed7f1a740252', url='https://127.0.0.1:40443/api/quotas/26/', used_capacity=0, used_capacity_tb=0.0, used_effective_capacity=0, used_effective_capacity_tb=0.0, used_inodes=1, used_limited_capacity=0)] May 28 12:58:46 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-85276a66-ca07-4f3f-9343-a3bbc69f06a5 tempest-PublicSharesTest-118543418 None] --- [GET] https://127.0.0.1:40443/api/quotas/: Done May 28 12:58:46 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-85276a66-ca07-4f3f-9343-a3bbc69f06a5 tempest-PublicSharesTest-118543418 None] >>> [DELETE] https://127.0.0.1:40443/api/quotas/26/ May 28 12:58:46 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-a8945c45-d985-4f91-9885-702590ff88f8 tempest-AdminActionsTest-1749172189 None] Committed reservations ['52500a23-ed8c-4fb6-8e01-f728a3d51d73', 'b9666dc3-2fc7-44c9-865d-9dbc99924ffe', '03d89c8e-2fa1-420f-be32-da5552f2cbb4', 'b26e82bc-44a7-4522-a7a1-1276176f40cb'] {{(pid=98474) commit /opt/stack/manila/manila/quota.py:1063}} May 28 12:58:46 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-7eab10f5-e18a-4db8-9715-0f60c7d684a3 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] <<< [GET] https://127.0.0.1:40443/api/views/ May 28 12:58:46 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-7eab10f5-e18a-4db8-9715-0f60c7d684a3 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] [] May 28 12:58:46 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-7eab10f5-e18a-4db8-9715-0f60c7d684a3 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] --- [GET] https://127.0.0.1:40443/api/views/: Done May 28 12:58:46 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-7eab10f5-e18a-4db8-9715-0f60c7d684a3 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] >>> [POST] https://127.0.0.1:40443/api/views/ May 28 12:58:46 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-7eab10f5-e18a-4db8-9715-0f60c7d684a3 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] {'data': '{"name": "7fdd602c-79d0-479c-95a2-336b202c6639", "path": ' May 28 12:58:46 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-7eab10f5-e18a-4db8-9715-0f60c7d684a3 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] '"/manila/manila-7fdd602c-79d0-479c-95a2-336b202c6639", "policy_id": ' May 28 12:58:46 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-7eab10f5-e18a-4db8-9715-0f60c7d684a3 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] '32, "create_dir": true, "protocols": ["NFS"]}', May 28 12:58:46 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-7eab10f5-e18a-4db8-9715-0f60c7d684a3 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] 'json': None, May 28 12:58:46 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-7eab10f5-e18a-4db8-9715-0f60c7d684a3 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] 'params': None} May 28 12:58:46 l75lg1-v1 manila-share[98474]: INFO manila.share.manager [None req-a8945c45-d985-4f91-9885-702590ff88f8 tempest-AdminActionsTest-1749172189 None] Share instance 77a25e6b-f137-4342-8eb9-9ced679515e2: deleted successfully. May 28 12:58:46 l75lg1-v1 dstat.sh[49771]: 28-05 12:58:46| 6 1 92 1 0|5726M 1753M 277M 7869M| 29k 5547B| 0 943k| 0 119 |3695 5746 |1.18 1.06 1.01| 0 1.0 0| 0 0 | 0 2048M| 29 357 0 31 0 May 28 12:58:46 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-26a97202-0bdc-48c2-b1a1-828e0350b6b1 tempest-SharesMetadataTest-1561320255 None] <<< [GET] https://127.0.0.1:40443/api/views/ May 28 12:58:46 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-26a97202-0bdc-48c2-b1a1-828e0350b6b1 tempest-SharesMetadataTest-1561320255 None] [Bunch(abac_tags=[], abe_max_depth=None, abe_protocols=[], alias='', allow_anonymous_access=False, allow_s3_anonymous_access=False, auto_commit='0d', bucket='', bucket_creators=[], bucket_creators_groups=[], bucket_owner=None, bulk_permission_update_progress=None, bulk_permission_update_state=None, cluster='loop75-kfs', cluster_id=1, created='2024-05-28T12:58:42.664711Z', enabled=True, files_retention_mode='NONE', guid='2980358e-2ccb-4ab0-b51c-869a5c867374', id=30, ignore_oos=False, internal=False, is_remote=False, is_seamless=False, logical_capacity=0, max_retention_period=None, min_retention_period=None, name='922a313f-547d-4129-ae7c-39ae549d3f49', nfs_interop_flags='BOTH_NFS3_AND_NFS4_INTEROP_DISABLED', path='/manila/manila-922a313f-547d-4129-ae7c-39ae549d3f49', physical_capacity=0, policy='922a313f-547d-4129-ae7c-39ae549d3f49', policy_id=31, protocols=['NFS'], qos_policy=None, qos_policy_id=None, s3_locks=False, s3_locks_retention_mode='NONE', s3_locks_retention_period='', s3_unverified_lookup=False, s3_versioning=False, select_for_live_monitoring=False, share='', share_acl=Bunch(acl=[], enabled=False), sync='SYNCED', sync_time='2024-05-28T12:58:43.216590Z', tenant_id=1, tenant_name='default', title='/manila/manila-922a313f-547d-4129-ae7c-39ae549d3f49', url='https://127.0.0.1:40443/api/views/30/')] May 28 12:58:46 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-26a97202-0bdc-48c2-b1a1-828e0350b6b1 tempest-SharesMetadataTest-1561320255 None] --- [GET] https://127.0.0.1:40443/api/views/: Done May 28 12:58:46 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-26a97202-0bdc-48c2-b1a1-828e0350b6b1 tempest-SharesMetadataTest-1561320255 None] >>> [DELETE] https://127.0.0.1:40443/api/views/30/ May 28 12:58:47 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-04a9be33-c1c0-4097-bc75-3a46b91653d6 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] GET http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/shares/df0ea844-5fc1-4d04-8afb-5048ec5dc33f May 28 12:58:47 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-04a9be33-c1c0-4097-bc75-3a46b91653d6 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:47 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-04a9be33-c1c0-4097-bc75-3a46b91653d6 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:47 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-04a9be33-c1c0-4097-bc75-3a46b91653d6 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] HTTP exception thrown: The resource could not be found. May 28 12:58:47 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-04a9be33-c1c0-4097-bc75-3a46b91653d6 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/shares/df0ea844-5fc1-4d04-8afb-5048ec5dc33f returned with HTTP 404 May 28 12:58:47 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 582/1160] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:58:47 2024] GET /share/v2/a3499cb78849424db45e54caac01de92/shares/df0ea844-5fc1-4d04-8afb-5048ec5dc33f => generated 78 bytes in 16 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 12:58:47 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-9545958b-d016-4207-ba7c-5f8919279bd7 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] DELETE http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/types/ed6e3c4a-7505-47e7-9c77-78267ba93d85 May 28 12:58:47 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-9545958b-d016-4207-ba7c-5f8919279bd7 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:47 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-9545958b-d016-4207-ba7c-5f8919279bd7 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Calling method 'ShareTypesController._delete' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:47 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-9545958b-d016-4207-ba7c-5f8919279bd7 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/types/ed6e3c4a-7505-47e7-9c77-78267ba93d85 returned with HTTP 202 May 28 12:58:47 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 579/1161] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:58:47 2024] DELETE /share/v2/a3499cb78849424db45e54caac01de92/types/ed6e3c4a-7505-47e7-9c77-78267ba93d85 => generated 0 bytes in 69 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:58:47 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-a1a5a6b2-0626-421c-92ac-7614bc8497e4 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] GET http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/types/ed6e3c4a-7505-47e7-9c77-78267ba93d85 May 28 12:58:47 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-a1a5a6b2-0626-421c-92ac-7614bc8497e4 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:47 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-a1a5a6b2-0626-421c-92ac-7614bc8497e4 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] Calling method 'ShareTypesController.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:47 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-a1a5a6b2-0626-421c-92ac-7614bc8497e4 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] HTTP exception thrown: Share type not found. May 28 12:58:47 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-a1a5a6b2-0626-421c-92ac-7614bc8497e4 tempest-AdminActionsTest-1749172189 tempest-AdminActionsTest-1749172189-project-admin] http://10.27.203.238/share/v2/a3499cb78849424db45e54caac01de92/types/ed6e3c4a-7505-47e7-9c77-78267ba93d85 returned with HTTP 404 May 28 12:58:47 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 583/1162] 10.27.203.238 () {64 vars in 1448 bytes} [Tue May 28 12:58:47 2024] GET /share/v2/a3499cb78849424db45e54caac01de92/types/ed6e3c4a-7505-47e7-9c77-78267ba93d85 => generated 67 bytes in 15 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 12:58:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bae9a9-0967-45b9-a8d9-234b6e0f330e service manila] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-b4bae9a9-0967-45b9-a8d9-234b6e0f330e service manila] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:58:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bae9a9-0967-45b9-a8d9-234b6e0f330e service manila] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddc9194-c275-4da2-a117-07667f44723f None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddc9194-c275-4da2-a117-07667f44723f None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddc9194-c275-4da2-a117-07667f44723f None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddc9194-c275-4da2-a117-07667f44723f None admin] PATH_INFO: `/v3/users/45c250a71fab4a03be12a8532abf88a1` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddc9194-c275-4da2-a117-07667f44723f None admin] RBAC: Authorizing `identity:delete_user(user_id=45c250a71fab4a03be12a8532abf88a1)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddc9194-c275-4da2-a117-07667f44723f None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:47 l75lg1-v1 dstat.sh[49771]: 28-05 12:58:47| 3 1 96 1 0|5726M 1753M 277M 7869M| 23k 646B| 0 1061k| 0 81.1 |2799 4366 |1.09 1.04 1.01|2.0 1.0 0| 0 0 | 0 2048M| 29 358 0 30 0 May 28 12:58:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-150312d6-9c3e-4d89-8a71-2c30b6e42111 tempest-ShareIpRulesForNFSTest-1748669711 None] <<< [PATCH] https://127.0.0.1:40443/api/viewpolicies/21/ May 28 12:58:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-150312d6-9c3e-4d89-8a71-2c30b6e42111 tempest-ShareIpRulesForNFSTest-1748669711 None] Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=1, created='2024-05-28T12:57:40.763635Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='377955ad-d094-4e49-ab32-1021d943a572', id=21, internal=False, is_s3_default_policy=False, name='b7a7d61c-2cea-442a-9809-507038e080d5', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=['*'], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['203.0.113.171'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['203.0.113.171'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='MODIFYING', sync_time='2024-05-28T12:58:46.696280Z', tenant_id=1, tenant_name='default', title='b7a7d61c-2cea-442a-9809-507038e080d5', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/21/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[]) May 28 12:58:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-150312d6-9c3e-4d89-8a71-2c30b6e42111 tempest-ShareIpRulesForNFSTest-1748669711 None] --- [PATCH] https://127.0.0.1:40443/api/viewpolicies/21/: Done May 28 12:58:47 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-150312d6-9c3e-4d89-8a71-2c30b6e42111 tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:47 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-150312d6-9c3e-4d89-8a71-2c30b6e42111 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-7eab10f5-e18a-4db8-9715-0f60c7d684a3 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] <<< [POST] https://127.0.0.1:40443/api/views/ May 28 12:58:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-7eab10f5-e18a-4db8-9715-0f60c7d684a3 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Bunch(abac_tags=[], abe_max_depth=None, abe_protocols=[], alias='', allow_anonymous_access=False, allow_s3_anonymous_access=False, auto_commit='0d', bucket='', bucket_creators=[], bucket_creators_groups=[], bucket_owner=None, bulk_permission_update_progress=None, bulk_permission_update_state=None, cluster='loop75-kfs', cluster_id=1, created='2024-05-28T12:58:46.921819Z', enabled=True, files_retention_mode='NONE', guid='faf90737-2dcb-403b-a84d-fbc18d7ca2ef', id=31, ignore_oos=False, internal=False, is_remote=False, is_seamless=False, logical_capacity=0, max_retention_period=None, min_retention_period=None, name='7fdd602c-79d0-479c-95a2-336b202c6639', nfs_interop_flags='BOTH_NFS3_AND_NFS4_INTEROP_DISABLED', path='/manila/manila-7fdd602c-79d0-479c-95a2-336b202c6639', physical_capacity=0, policy='7fdd602c-79d0-479c-95a2-336b202c6639', policy_id=32, protocols=['NFS'], qos_policy=None, qos_policy_id=None, s3_locks=False, s3_locks_retention_mode='NONE', s3_locks_retention_period='', s3_object_ownership_rule='ObjectWriter', s3_unverified_lookup=False, s3_versioning=False, select_for_live_monitoring=False, share='', share_acl=Bunch(acl=[], enabled=False), sync='SYNCED', sync_time='2024-05-28T12:58:47.186967Z', tenant_id=1, tenant_name='default', title='/manila/manila-7fdd602c-79d0-479c-95a2-336b202c6639', url='https://127.0.0.1:40443/api/views/31/') May 28 12:58:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-7eab10f5-e18a-4db8-9715-0f60c7d684a3 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] --- [POST] https://127.0.0.1:40443/api/views/: Done May 28 12:58:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-8ddc9194-c275-4da2-a117-07667f44723f None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45c250a71fab4a03be12a8532abf88a1', 'request_id': 'req-8ddc9194-c275-4da2-a117-07667f44723f'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:58:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-8ddc9194-c275-4da2-a117-07667f44723f None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45c250a71fab4a03be12a8532abf88a1', 'request_id': 'req-8ddc9194-c275-4da2-a117-07667f44723f'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:58:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-8ddc9194-c275-4da2-a117-07667f44723f None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45c250a71fab4a03be12a8532abf88a1', 'request_id': 'req-8ddc9194-c275-4da2-a117-07667f44723f'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:58:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-8ddc9194-c275-4da2-a117-07667f44723f None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45c250a71fab4a03be12a8532abf88a1', 'request_id': 'req-8ddc9194-c275-4da2-a117-07667f44723f'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:58:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-8ddc9194-c275-4da2-a117-07667f44723f None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45c250a71fab4a03be12a8532abf88a1', 'request_id': 'req-8ddc9194-c275-4da2-a117-07667f44723f'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:58:47 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1131/2285] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 12:58:47 2024] DELETE /identity/v3/users/45c250a71fab4a03be12a8532abf88a1 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:58:47 l75lg1-v1 manila-share[98474]: INFO manila.share.manager [None req-7eab10f5-e18a-4db8-9715-0f60c7d684a3 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Share instance 7fdd602c-79d0-479c-95a2-336b202c6639 created successfully. May 28 12:58:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b729a5-282e-4e2b-8ac7-8fb4eb899d8c None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b729a5-282e-4e2b-8ac7-8fb4eb899d8c None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b729a5-282e-4e2b-8ac7-8fb4eb899d8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:47 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-27b729a5-282e-4e2b-8ac7-8fb4eb899d8c None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:58:47 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-150312d6-9c3e-4d89-8a71-2c30b6e42111 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.087s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:47 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-150312d6-9c3e-4d89-8a71-2c30b6e42111 tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:47 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-150312d6-9c3e-4d89-8a71-2c30b6e42111 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-27b729a5-282e-4e2b-8ac7-8fb4eb899d8c None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:58:47 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-150312d6-9c3e-4d89-8a71-2c30b6e42111 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:47 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-150312d6-9c3e-4d89-8a71-2c30b6e42111 tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-27b729a5-282e-4e2b-8ac7-8fb4eb899d8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:58:47 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-150312d6-9c3e-4d89-8a71-2c30b6e42111 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:47 l75lg1-v1 manila-share[98474]: DEBUG oslo_service.periodic_task [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] Running periodic task ShareManager._publish_service_capabilities {{(pid=98474) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:58:47 l75lg1-v1 manila-share[98474]: DEBUG manila.manager [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] Notifying Schedulers of capabilities ... {{(pid=98474) _publish_service_capabilities /opt/stack/manila/manila/manager.py:172}} May 28 12:58:47 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.host_manager [None req-9d80f00a-5762-44cb-a46b-68f28bab1a71 None None] Received share service update from l75lg1-v1@vast: {'share_backend_name': 'vast', 'driver_handles_share_servers': False, 'vendor_name': 'VAST STORAGE', 'driver_version': '1.0', 'storage_protocol': 'NFS', 'total_capacity_gb': 2083.02392578125, 'free_capacity_gb': 2082.64910808485, 'reserved_percentage': 0, 'reserved_snapshot_percentage': 0, 'reserved_share_extend_percentage': 0, 'qos': False, 'pools': None, 'snapshot_support': True, 'create_share_from_snapshot_support': False, 'revert_to_snapshot_support': False, 'mount_snapshot_support': False, 'replication_domain': None, 'filter_function': None, 'goodness_function': None, 'security_service_update_support': False, 'network_allocation_update_support': False, 'share_server_multiple_subnet_support': False, 'mount_point_name_support': False, 'data_reduction': 5.29, 'provisioned_capacity_gb': 0.37481769639998674, 'share_group_stats': {'consistent_snapshot_support': None}, 'ipv4_support': True, 'ipv6_support': False} {{(pid=98327) update_service_capabilities /opt/stack/manila/manila/scheduler/host_manager.py:632}} May 28 12:58:47 l75lg1-v1 manila-share[98474]: DEBUG oslo_service.periodic_task [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] Running periodic task ShareManager.migration_driver_continue {{(pid=98474) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:58:47 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-150312d6-9c3e-4d89-8a71-2c30b6e42111 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.013s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:47 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-150312d6-9c3e-4d89-8a71-2c30b6e42111 tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:47 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-150312d6-9c3e-4d89-8a71-2c30b6e42111 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:47 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-150312d6-9c3e-4d89-8a71-2c30b6e42111 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.010s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:47 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-150312d6-9c3e-4d89-8a71-2c30b6e42111 tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:47 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-150312d6-9c3e-4d89-8a71-2c30b6e42111 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:47 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1155/2286] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:58:47 2024] POST /identity/v3/auth/tokens => generated 2960 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 12:58:47 l75lg1-v1 neutron-server[77619]: DEBUG neutron.wsgi [-] (77619) accepted ('10.27.203.238', 48732) {{(pid=77619) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 12:58:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddc9194-c275-4da2-a117-07667f44723f None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-8ddc9194-c275-4da2-a117-07667f44723f None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:58:47 l75lg1-v1 neutron-server[77623]: DEBUG neutron.db.agents_db [None req-fe40ce8c-640e-4db7-a17a-6e8888cce266 None None] Agent healthcheck: found 0 active agents {{(pid=77623) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:319}} May 28 12:58:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddc9194-c275-4da2-a117-07667f44723f None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a68c81-c8c3-4d2b-81ff-1cc610bf7c56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef17047035e4b518fd5360a01f2da1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a68c81-c8c3-4d2b-81ff-1cc610bf7c56 service neutron] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a68c81-c8c3-4d2b-81ff-1cc610bf7c56 service neutron] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a68c81-c8c3-4d2b-81ff-1cc610bf7c56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a68c81-c8c3-4d2b-81ff-1cc610bf7c56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a68c81-c8c3-4d2b-81ff-1cc610bf7c56 service neutron] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:47 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1132/2287] 10.27.203.238 () {64 vars in 1432 bytes} [Tue May 28 12:58:47 2024] GET /identity/v3/auth/tokens => generated 2960 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 28 12:58:47 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-150312d6-9c3e-4d89-8a71-2c30b6e42111 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.080s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:47 l75lg1-v1 manila-share[98474]: INFO manila.share.access [None req-150312d6-9c3e-4d89-8a71-2c30b6e42111 tempest-ShareIpRulesForNFSTest-1748669711 None] Access rules were successfully modified for share instance b7a7d61c-2cea-442a-9809-507038e080d5 belonging to share 1ddadc17-cf10-4a42-8bbd-8335fb3520a1. May 28 12:58:47 l75lg1-v1 neutron-server[77619]: INFO neutron.wsgi [None req-c24ce560-0836-4336-9e06-5aaf17df8cc0 None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=a3499cb78849424db45e54caac01de92&name=default HTTP/1.1" status: 200 len: 216 time: 0.0820112 May 28 12:58:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b729a5-282e-4e2b-8ac7-8fb4eb899d8c None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-27b729a5-282e-4e2b-8ac7-8fb4eb899d8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:58:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b729a5-282e-4e2b-8ac7-8fb4eb899d8c None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:47 l75lg1-v1 manila-share[98474]: DEBUG oslo_service.periodic_task [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] Running periodic task ShareManager.do_deferred_share_deletion {{(pid=98474) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:58:47 l75lg1-v1 manila-share[98474]: DEBUG manila.share.manager [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] Checking for shares in 'deferred_deleting' status to process their deletion. {{(pid=98474) do_deferred_share_deletion /opt/stack/manila/manila/share/manager.py:3663}} May 28 12:58:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e27042c-c4ad-4dae-a8d8-b5561f67d8e3 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e27042c-c4ad-4dae-a8d8-b5561f67d8e3 None admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e27042c-c4ad-4dae-a8d8-b5561f67d8e3 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e27042c-c4ad-4dae-a8d8-b5561f67d8e3 None admin] PATH_INFO: `/v3/projects/a3499cb78849424db45e54caac01de92` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e27042c-c4ad-4dae-a8d8-b5561f67d8e3 None admin] RBAC: Authorizing `identity:delete_project(project_id=a3499cb78849424db45e54caac01de92)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e27042c-c4ad-4dae-a8d8-b5561f67d8e3 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:47 l75lg1-v1 manila-share[98474]: DEBUG oslo_service.periodic_task [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] Running periodic task ShareManager.do_deferred_snapshot_deletion {{(pid=98474) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:58:47 l75lg1-v1 manila-share[98474]: DEBUG manila.share.manager [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] Checking for snapshots in 'deferred_deleting' status to process their deletion. {{(pid=98474) do_deferred_snapshot_deletion /opt/stack/manila/manila/share/manager.py:3980}} May 28 12:58:47 l75lg1-v1 manila-share[98474]: DEBUG oslo_service.periodic_task [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] Running periodic task ShareManager._report_driver_status {{(pid=98474) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:58:47 l75lg1-v1 manila-share[98474]: INFO manila.share.manager [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] Updating share status May 28 12:58:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] >>> [GET] https://127.0.0.1:40443/api/monitors/ad_hoc_query/ May 28 12:58:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] {'allow_redirects': True, May 28 12:58:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] 'params': {'object_type': 'cluster', May 28 12:58:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] 'prop_list': ['Capacity,drr', May 28 12:58:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] 'Capacity,logical_space', May 28 12:58:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] 'Capacity,logical_space_in_use', May 28 12:58:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] 'Capacity,physical_space', May 28 12:58:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] 'Capacity,physical_space_in_use'], May 28 12:58:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] 'time_frame': '1m'}} May 28 12:58:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-1e27042c-c4ad-4dae-a8d8-b5561f67d8e3 None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3499cb78849424db45e54caac01de92', 'request_id': 'req-1e27042c-c4ad-4dae-a8d8-b5561f67d8e3'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:58:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-1e27042c-c4ad-4dae-a8d8-b5561f67d8e3 None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3499cb78849424db45e54caac01de92', 'request_id': 'req-1e27042c-c4ad-4dae-a8d8-b5561f67d8e3'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:58:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-1e27042c-c4ad-4dae-a8d8-b5561f67d8e3 None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3499cb78849424db45e54caac01de92', 'request_id': 'req-1e27042c-c4ad-4dae-a8d8-b5561f67d8e3'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:58:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-1e27042c-c4ad-4dae-a8d8-b5561f67d8e3 None admin] The token cache is being invalidate because project a3499cb78849424db45e54caac01de92 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 12:58:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-1e27042c-c4ad-4dae-a8d8-b5561f67d8e3 None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:58:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-1e27042c-c4ad-4dae-a8d8-b5561f67d8e3 None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:58:47 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1156/2288] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 12:58:47 2024] DELETE /identity/v3/projects/a3499cb78849424db45e54caac01de92 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:58:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c17e5b-489a-4ba7-98da-d91b068fb0bd None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c17e5b-489a-4ba7-98da-d91b068fb0bd None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c17e5b-489a-4ba7-98da-d91b068fb0bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:47 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-02c17e5b-489a-4ba7-98da-d91b068fb0bd None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:58:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-02c17e5b-489a-4ba7-98da-d91b068fb0bd None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:58:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-02c17e5b-489a-4ba7-98da-d91b068fb0bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:58:47 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1133/2289] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:58:47 2024] POST /identity/v3/auth/tokens => generated 312 bytes in 19 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 28 12:58:47 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:58:47 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:58:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a6ea46-4606-4106-a6f3-6444841bca76 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a6ea46-4606-4106-a6f3-6444841bca76 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a6ea46-4606-4106-a6f3-6444841bca76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:47 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-99a6ea46-4606-4106-a6f3-6444841bca76 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:58:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-99a6ea46-4606-4106-a6f3-6444841bca76 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:58:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-99a6ea46-4606-4106-a6f3-6444841bca76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:58:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] <<< [GET] https://127.0.0.1:40443/api/monitors/ad_hoc_query/ May 28 12:58:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] Bunch(data=[['2024-05-28T12:58:40Z', 1, 408519534.0, 2223930.0, 5.29, 711246584217.0, 2236629909504.0], ['2024-05-28T12:58:29Z', 1, 408421214.0, 2223930.0, 5.29, 711246584217.0, 2236629909504.0], ['2024-05-28T12:58:19Z', 1, 404177758.0, 2223930.0, 5.29, 711246584217.0, 2236629909504.0], ['2024-05-28T12:58:09Z', 1, 404087646.0, 2223930.0, 5.29, 711246584217.0, 2236629909504.0], ['2024-05-28T12:57:59Z', 1, 403972958.0, 2223930.0, 5.29, 711246584217.0, 2236629909504.0], ['2024-05-28T12:57:49Z', 1, 403833694.0, 2223930.0, 5.29, 711246584217.0, 2236629909504.0]], granularity=None, object_ids=[1], prop_list=['timestamp', 'object_id', 'Capacity,logical_space_in_use', 'Capacity,physical_space_in_use', 'Capacity,drr', 'Capacity,physical_space', 'Capacity,logical_space']) May 28 12:58:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] --- [GET] https://127.0.0.1:40443/api/monitors/ad_hoc_query/: Done May 28 12:58:47 l75lg1-v1 manila-share[98474]: DEBUG manila.share.driver [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] Updating share stats. {{(pid=98474) _update_share_stats /opt/stack/manila/manila/share/driver.py:1326}} May 28 12:58:47 l75lg1-v1 manila-share[98474]: DEBUG oslo_service.periodic_task [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] Running periodic task ShareManager.create_backup_continue {{(pid=98474) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:58:47 l75lg1-v1 manila-share[98474]: DEBUG oslo_service.periodic_task [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] Running periodic task ShareManager.restore_backup_continue {{(pid=98474) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:58:47 l75lg1-v1 manila-share[98474]: DEBUG oslo_service.periodic_task [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] Running periodic task ShareManager.periodic_share_status_update {{(pid=98474) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:58:47 l75lg1-v1 manila-share[98474]: DEBUG manila.share.manager [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] Updating status of share instances. {{(pid=98474) periodic_share_status_update /opt/stack/manila/manila/share/manager.py:5475}} May 28 12:58:47 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1157/2290] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:58:47 2024] POST /identity/v3/auth/tokens => generated 2960 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 12:58:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c17e5b-489a-4ba7-98da-d91b068fb0bd None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c17e5b-489a-4ba7-98da-d91b068fb0bd None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464f9a56-d671-4763-8ae0-d564a69cec61 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464f9a56-d671-4763-8ae0-d564a69cec61 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464f9a56-d671-4763-8ae0-d564a69cec61 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464f9a56-d671-4763-8ae0-d564a69cec61 None admin] PATH_INFO: `/v3/domains` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464f9a56-d671-4763-8ae0-d564a69cec61 None admin] RBAC: Adding query filter params (name=Default) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:58:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464f9a56-d671-4763-8ae0-d564a69cec61 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464f9a56-d671-4763-8ae0-d564a69cec61 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:47 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1134/2291] 10.27.203.238 () {62 vars in 1220 bytes} [Tue May 28 12:58:47 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:58:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a6ea46-4606-4106-a6f3-6444841bca76 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a6ea46-4606-4106-a6f3-6444841bca76 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df953d4-6051-46fd-9b1e-80e084ce36ec None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df953d4-6051-46fd-9b1e-80e084ce36ec None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df953d4-6051-46fd-9b1e-80e084ce36ec None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df953d4-6051-46fd-9b1e-80e084ce36ec None admin] PATH_INFO: `/v3/projects` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df953d4-6051-46fd-9b1e-80e084ce36ec None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df953d4-6051-46fd-9b1e-80e084ce36ec None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:47 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1158/2292] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 12:58:47 2024] POST /identity/v3/projects => generated 385 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:58:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464f9a56-d671-4763-8ae0-d564a69cec61 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464f9a56-d671-4763-8ae0-d564a69cec61 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a9c691-a616-4f6d-8d1a-57c9b67c1a59 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a9c691-a616-4f6d-8d1a-57c9b67c1a59 None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a9c691-a616-4f6d-8d1a-57c9b67c1a59 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a9c691-a616-4f6d-8d1a-57c9b67c1a59 None admin] PATH_INFO: `/v3/users` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a9c691-a616-4f6d-8d1a-57c9b67c1a59 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a9c691-a616-4f6d-8d1a-57c9b67c1a59 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:47 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-03a9c691-a616-4f6d-8d1a-57c9b67c1a59 None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 12:58:47 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1135/2293] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 12:58:47 2024] POST /identity/v3/users => generated 300 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:58:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df953d4-6051-46fd-9b1e-80e084ce36ec None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df953d4-6051-46fd-9b1e-80e084ce36ec None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e254f87-38c4-4884-aa61-2ecc638a354e None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e254f87-38c4-4884-aa61-2ecc638a354e None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e254f87-38c4-4884-aa61-2ecc638a354e None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e254f87-38c4-4884-aa61-2ecc638a354e None admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e254f87-38c4-4884-aa61-2ecc638a354e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e254f87-38c4-4884-aa61-2ecc638a354e None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:47 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1159/2294] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 12:58:47 2024] GET /identity/v3/roles => generated 1680 bytes in 17 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:58:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a9c691-a616-4f6d-8d1a-57c9b67c1a59 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a9c691-a616-4f6d-8d1a-57c9b67c1a59 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57eba63e-e0f3-4865-bb58-50817c5341cf None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eba63e-e0f3-4865-bb58-50817c5341cf None admin] REQUEST_METHOD: `PUT` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eba63e-e0f3-4865-bb58-50817c5341cf None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eba63e-e0f3-4865-bb58-50817c5341cf None admin] PATH_INFO: `/v3/projects/e3754ccde0c34ce9a33fe231011c1930/users/141d7fcf70c04ad6aea2346d8c2cb259/roles/e7989893488f483baa107be56668c4f8` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57eba63e-e0f3-4865-bb58-50817c5341cf None admin] RBAC: Authorizing `identity:create_grant(project_id=e3754ccde0c34ce9a33fe231011c1930, user_id=141d7fcf70c04ad6aea2346d8c2cb259, role_id=e7989893488f483baa107be56668c4f8)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57eba63e-e0f3-4865-bb58-50817c5341cf None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:47 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1136/2295] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 12:58:47 2024] PUT /identity/v3/projects/e3754ccde0c34ce9a33fe231011c1930/users/141d7fcf70c04ad6aea2346d8c2cb259/roles/e7989893488f483baa107be56668c4f8 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:58:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e254f87-38c4-4884-aa61-2ecc638a354e None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e254f87-38c4-4884-aa61-2ecc638a354e None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768e4766-04dc-4fbb-a21e-c84fa516d70c None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768e4766-04dc-4fbb-a21e-c84fa516d70c None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768e4766-04dc-4fbb-a21e-c84fa516d70c None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768e4766-04dc-4fbb-a21e-c84fa516d70c None admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768e4766-04dc-4fbb-a21e-c84fa516d70c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768e4766-04dc-4fbb-a21e-c84fa516d70c None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:47 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1160/2296] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 12:58:47 2024] GET /identity/v3/roles => generated 1680 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:58:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57eba63e-e0f3-4865-bb58-50817c5341cf None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57eba63e-e0f3-4865-bb58-50817c5341cf None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6342ddea-aecf-450e-a2d8-e56700d5e8f5 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6342ddea-aecf-450e-a2d8-e56700d5e8f5 None admin] REQUEST_METHOD: `PUT` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6342ddea-aecf-450e-a2d8-e56700d5e8f5 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6342ddea-aecf-450e-a2d8-e56700d5e8f5 None admin] PATH_INFO: `/v3/projects/e3754ccde0c34ce9a33fe231011c1930/users/141d7fcf70c04ad6aea2346d8c2cb259/roles/e7989893488f483baa107be56668c4f8` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6342ddea-aecf-450e-a2d8-e56700d5e8f5 None admin] RBAC: Authorizing `identity:create_grant(project_id=e3754ccde0c34ce9a33fe231011c1930, user_id=141d7fcf70c04ad6aea2346d8c2cb259, role_id=e7989893488f483baa107be56668c4f8)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6342ddea-aecf-450e-a2d8-e56700d5e8f5 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:47 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1137/2297] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 12:58:47 2024] PUT /identity/v3/projects/e3754ccde0c34ce9a33fe231011c1930/users/141d7fcf70c04ad6aea2346d8c2cb259/roles/e7989893488f483baa107be56668c4f8 => generated 0 bytes in 18 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:58:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f134762c-c7a3-48be-9157-6dc14b5be07b None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f134762c-c7a3-48be-9157-6dc14b5be07b None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f134762c-c7a3-48be-9157-6dc14b5be07b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:47 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-f134762c-c7a3-48be-9157-6dc14b5be07b None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:58:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-f134762c-c7a3-48be-9157-6dc14b5be07b None None] MFA Rules not processed for user `141d7fcf70c04ad6aea2346d8c2cb259`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:58:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-f134762c-c7a3-48be-9157-6dc14b5be07b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:58:47 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1161/2298] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:58:47 2024] POST /identity/v3/auth/tokens => generated 4079 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:58:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6342ddea-aecf-450e-a2d8-e56700d5e8f5 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-6342ddea-aecf-450e-a2d8-e56700d5e8f5 None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:58:47 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-2eb6235e-15ab-4294-8713-d89ffc3c26e0 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] GET http://10.27.203.238/share/v2/776f75906bc64f8f9316d5aab4b50bf1/share-access-rules?share_id=1ddadc17-cf10-4a42-8bbd-8335fb3520a1 May 28 12:58:47 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-2eb6235e-15ab-4294-8713-d89ffc3c26e0 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:47 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-2eb6235e-15ab-4294-8713-d89ffc3c26e0 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6342ddea-aecf-450e-a2d8-e56700d5e8f5 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:48 l75lg1-v1 nova-conductor[83229]: DEBUG dbcounter [-] [83229] Writing DB stats nova_cell0:SELECT=1,nova_cell0:UPDATE=1 {{(pid=83229) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:58:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272c8704-0218-4465-81c8-3db6aa886454 service manila] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f110cf6300f049c897d0aab63218d1e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272c8704-0218-4465-81c8-3db6aa886454 service manila] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272c8704-0218-4465-81c8-3db6aa886454 service manila] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272c8704-0218-4465-81c8-3db6aa886454 service manila] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272c8704-0218-4465-81c8-3db6aa886454 service manila] RBAC: Authorizing `identity:validate_token()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272c8704-0218-4465-81c8-3db6aa886454 service manila] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:48 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1138/2299] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 12:58:47 2024] GET /identity/v3/auth/tokens => generated 4079 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 12:58:48 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-6c9c8a8e-47c0-4b5d-b18b-6d8e78c29a54 tempest-SchedulerStatsAdminTest-1331908757 tempest-SchedulerStatsAdminTest-1331908757-project-admin] GET http://10.27.203.238/share/v1/e3754ccde0c34ce9a33fe231011c1930/scheduler-stats/pools May 28 12:58:48 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-6c9c8a8e-47c0-4b5d-b18b-6d8e78c29a54 tempest-SchedulerStatsAdminTest-1331908757 tempest-SchedulerStatsAdminTest-1331908757-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:48 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-6c9c8a8e-47c0-4b5d-b18b-6d8e78c29a54 tempest-SchedulerStatsAdminTest-1331908757 tempest-SchedulerStatsAdminTest-1331908757-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:48 l75lg1-v1 devstack@m-api.service[98329]: INFO oslo_messaging._drivers.amqpdriver [None req-6c9c8a8e-47c0-4b5d-b18b-6d8e78c29a54 tempest-SchedulerStatsAdminTest-1331908757 tempest-SchedulerStatsAdminTest-1331908757-project-admin] Creating reply queue: reply_351c50596b2348218ab8657bb9280c03 May 28 12:58:48 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.lock.api [None req-2eb6235e-15ab-4294-8713-d89ffc3c26e0 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Searching for locks by: {'resource_id': '62766e3c-2f54-4fb6-85a6-dfce2a050ae5', 'resource_action': 'show', 'resource_type': 'access_rule'} {{(pid=98330) get_all /opt/stack/manila/manila/lock/api.py:112}} May 28 12:58:48 l75lg1-v1 devstack@m-api.service[98329]: INFO oslo_messaging._drivers.amqpdriver [None req-6c9c8a8e-47c0-4b5d-b18b-6d8e78c29a54 tempest-SchedulerStatsAdminTest-1331908757 tempest-SchedulerStatsAdminTest-1331908757-project-admin] Expecting reply to msg af40433555fd4e6082610227ffc64817 in queue reply_351c50596b2348218ab8657bb9280c03 May 28 12:58:48 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-2eb6235e-15ab-4294-8713-d89ffc3c26e0 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] http://10.27.203.238/share/v2/776f75906bc64f8f9316d5aab4b50bf1/share-access-rules?share_id=1ddadc17-cf10-4a42-8bbd-8335fb3520a1 returned with HTTP 200 May 28 12:58:48 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 584/1163] 10.27.203.238 () {64 vars in 1467 bytes} [Tue May 28 12:58:47 2024] GET /share/v2/776f75906bc64f8f9316d5aab4b50bf1/share-access-rules?share_id=1ddadc17-cf10-4a42-8bbd-8335fb3520a1 => generated 281 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:58:48 l75lg1-v1 devstack@m-api.service[98329]: INFO oslo_messaging._drivers.amqpdriver [-] Received RPC response for msg af40433555fd4e6082610227ffc64817 May 28 12:58:48 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-bdfbd7a0-cc0a-42e6-8517-56a904b55c4e tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] POST http://10.27.203.238/share/v2/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action May 28 12:58:48 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-bdfbd7a0-cc0a-42e6-8517-56a904b55c4e tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Action body: b'{"deny_access": {"access_id": "62766e3c-2f54-4fb6-85a6-dfce2a050ae5"}}' {{(pid=98330) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:58:48 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-bdfbd7a0-cc0a-42e6-8517-56a904b55c4e tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Action: 'action', calling method: ShareController.deny_access, body: {"deny_access": {"access_id": "62766e3c-2f54-4fb6-85a6-dfce2a050ae5"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:58:48 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.lock.api [None req-bdfbd7a0-cc0a-42e6-8517-56a904b55c4e tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Searching for locks by: {'resource_id': '62766e3c-2f54-4fb6-85a6-dfce2a050ae5', 'resource_action': 'delete'} {{(pid=98330) get_all /opt/stack/manila/manila/lock/api.py:112}} May 28 12:58:48 l75lg1-v1 nova-conductor[83233]: DEBUG dbcounter [-] [83233] Writing DB stats nova_cell0:SELECT=1 {{(pid=83233) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:58:48 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-bdfbd7a0-cc0a-42e6-8517-56a904b55c4e tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:48 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-bdfbd7a0-cc0a-42e6-8517-56a904b55c4e tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:48 l75lg1-v1 neutron-server[77618]: DEBUG dbcounter [-] [77618] Writing DB stats neutron:SELECT=3 {{(pid=77618) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:58:48 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-bdfbd7a0-cc0a-42e6-8517-56a904b55c4e tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.041s {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:48 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-bdfbd7a0-cc0a-42e6-8517-56a904b55c4e tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:48 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-bdfbd7a0-cc0a-42e6-8517-56a904b55c4e tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:48 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-bdfbd7a0-cc0a-42e6-8517-56a904b55c4e tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.055s {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:48 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-bdfbd7a0-cc0a-42e6-8517-56a904b55c4e tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] http://10.27.203.238/share/v2/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action returned with HTTP 202 May 28 12:58:48 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 585/1164] 10.27.203.238 () {66 vars in 1493 bytes} [Tue May 28 12:58:48 2024] POST /share/v2/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action => generated 0 bytes in 186 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:58:48 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-01bfd96d-c6bb-48b8-8e52-364eb25e7e63 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] GET http://10.27.203.238/share/v2/776f75906bc64f8f9316d5aab4b50bf1/share-access-rules?share_id=1ddadc17-cf10-4a42-8bbd-8335fb3520a1 May 28 12:58:48 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-01bfd96d-c6bb-48b8-8e52-364eb25e7e63 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:48 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-01bfd96d-c6bb-48b8-8e52-364eb25e7e63 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:48 l75lg1-v1 dstat.sh[49771]: 28-05 12:58:48| 13 1 82 2 0|5727M 1752M 277M 7869M| 31k 2018B| 0 2004k| 0 269 |8060 13k|1.09 1.04 1.01|2.0 1.0 3.0| 0 0 | 0 2048M| 29 360 0 31 0 May 28 12:58:48 l75lg1-v1 manila-share[98474]: DEBUG manila.share.manager [None req-bdfbd7a0-cc0a-42e6-8517-56a904b55c4e tempest-ShareIpRulesForNFSTest-1748669711 None] Received request to update access for share instance b7a7d61c-2cea-442a-9809-507038e080d5. {{(pid=98474) update_access_for_instances /opt/stack/manila/manila/share/manager.py:4353}} May 28 12:58:48 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.lock.api [None req-01bfd96d-c6bb-48b8-8e52-364eb25e7e63 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Searching for locks by: {'resource_id': '62766e3c-2f54-4fb6-85a6-dfce2a050ae5', 'resource_action': 'show', 'resource_type': 'access_rule'} {{(pid=98330) get_all /opt/stack/manila/manila/lock/api.py:112}} May 28 12:58:48 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-bdfbd7a0-cc0a-42e6-8517-56a904b55c4e tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:48 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-bdfbd7a0-cc0a-42e6-8517-56a904b55c4e tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:48 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-01bfd96d-c6bb-48b8-8e52-364eb25e7e63 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] http://10.27.203.238/share/v2/776f75906bc64f8f9316d5aab4b50bf1/share-access-rules?share_id=1ddadc17-cf10-4a42-8bbd-8335fb3520a1 returned with HTTP 200 May 28 12:58:48 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-bdfbd7a0-cc0a-42e6-8517-56a904b55c4e tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:48 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 586/1165] 10.27.203.238 () {64 vars in 1467 bytes} [Tue May 28 12:58:48 2024] GET /share/v2/776f75906bc64f8f9316d5aab4b50bf1/share-access-rules?share_id=1ddadc17-cf10-4a42-8bbd-8335fb3520a1 => generated 289 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 231 bytes (2 switches on core 0) May 28 12:58:48 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-bdfbd7a0-cc0a-42e6-8517-56a904b55c4e tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:48 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-bdfbd7a0-cc0a-42e6-8517-56a904b55c4e tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:48 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-bdfbd7a0-cc0a-42e6-8517-56a904b55c4e tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.062s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:48 l75lg1-v1 manila-share[98474]: DEBUG manila.share.access [None req-bdfbd7a0-cc0a-42e6-8517-56a904b55c4e tempest-ShareIpRulesForNFSTest-1748669711 None] Updating access rules for share instance b7a7d61c-2cea-442a-9809-507038e080d5 belonging to share 1ddadc17-cf10-4a42-8bbd-8335fb3520a1. {{(pid=98474) update_access_rules /opt/stack/manila/manila/share/access.py:298}} May 28 12:58:48 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-bdfbd7a0-cc0a-42e6-8517-56a904b55c4e tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:48 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-bdfbd7a0-cc0a-42e6-8517-56a904b55c4e tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:48 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-bdfbd7a0-cc0a-42e6-8517-56a904b55c4e tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.011s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:48 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-bdfbd7a0-cc0a-42e6-8517-56a904b55c4e tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:48 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-bdfbd7a0-cc0a-42e6-8517-56a904b55c4e tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:48 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-26a97202-0bdc-48c2-b1a1-828e0350b6b1 tempest-SharesMetadataTest-1561320255 None] <<< [DELETE] https://127.0.0.1:40443/api/views/30/ May 28 12:58:48 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-26a97202-0bdc-48c2-b1a1-828e0350b6b1 tempest-SharesMetadataTest-1561320255 None] --- [DELETE] https://127.0.0.1:40443/api/views/30/: Done May 28 12:58:48 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-26a97202-0bdc-48c2-b1a1-828e0350b6b1 tempest-SharesMetadataTest-1561320255 None] >>> [GET] https://127.0.0.1:40443/api/quotas/ May 28 12:58:48 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-26a97202-0bdc-48c2-b1a1-828e0350b6b1 tempest-SharesMetadataTest-1561320255 None] {'allow_redirects': True, May 28 12:58:48 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-26a97202-0bdc-48c2-b1a1-828e0350b6b1 tempest-SharesMetadataTest-1561320255 None] 'params': {'name': '922a313f-547d-4129-ae7c-39ae549d3f49'}} May 28 12:58:48 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-85276a66-ca07-4f3f-9343-a3bbc69f06a5 tempest-PublicSharesTest-118543418 None] <<< [DELETE] https://127.0.0.1:40443/api/quotas/26/ May 28 12:58:48 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-85276a66-ca07-4f3f-9343-a3bbc69f06a5 tempest-PublicSharesTest-118543418 None] --- [DELETE] https://127.0.0.1:40443/api/quotas/26/: Done May 28 12:58:48 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-85276a66-ca07-4f3f-9343-a3bbc69f06a5 tempest-PublicSharesTest-118543418 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:58:48 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-85276a66-ca07-4f3f-9343-a3bbc69f06a5 tempest-PublicSharesTest-118543418 None] {'allow_redirects': True, May 28 12:58:48 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-85276a66-ca07-4f3f-9343-a3bbc69f06a5 tempest-PublicSharesTest-118543418 None] 'params': {'name': 'c4c98d1e-9abc-48c7-a23f-ed7f1a740252'}} May 28 12:58:48 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-bdfbd7a0-cc0a-42e6-8517-56a904b55c4e tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.078s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:48 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-bdfbd7a0-cc0a-42e6-8517-56a904b55c4e tempest-ShareIpRulesForNFSTest-1748669711 None] changing access on None May 28 12:58:48 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bdfbd7a0-cc0a-42e6-8517-56a904b55c4e tempest-ShareIpRulesForNFSTest-1748669711 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:58:48 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bdfbd7a0-cc0a-42e6-8517-56a904b55c4e tempest-ShareIpRulesForNFSTest-1748669711 None] {'allow_redirects': True, May 28 12:58:48 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bdfbd7a0-cc0a-42e6-8517-56a904b55c4e tempest-ShareIpRulesForNFSTest-1748669711 None] 'params': {'name': 'b7a7d61c-2cea-442a-9809-507038e080d5'}} May 28 12:58:48 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-c4a5d57f-6a4b-49c2-a28d-170a2aec8db7 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] GET http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/0e9e1ee3-c7cc-4239-bc5b-cace9d44e641 May 28 12:58:48 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-c4a5d57f-6a4b-49c2-a28d-170a2aec8db7 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:48 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-c4a5d57f-6a4b-49c2-a28d-170a2aec8db7 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:48 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-c4a5d57f-6a4b-49c2-a28d-170a2aec8db7 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/0e9e1ee3-c7cc-4239-bc5b-cace9d44e641 returned with HTTP 200 May 28 12:58:48 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 587/1166] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:58:48 2024] GET /share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/0e9e1ee3-c7cc-4239-bc5b-cace9d44e641 => generated 1315 bytes in 25 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:58:48 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-6c9c8a8e-47c0-4b5d-b18b-6d8e78c29a54 tempest-SchedulerStatsAdminTest-1331908757 tempest-SchedulerStatsAdminTest-1331908757-project-admin] http://10.27.203.238/share/v1/e3754ccde0c34ce9a33fe231011c1930/scheduler-stats/pools returned with HTTP 200 May 28 12:58:48 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 580/1167] 10.27.203.238 () {62 vars in 1342 bytes} [Tue May 28 12:58:47 2024] GET /share/v1/e3754ccde0c34ce9a33fe231011c1930/scheduler-stats/pools => generated 100 bytes in 580 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:58:48 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-95e46426-6fb2-473d-9927-a91ceb156f93 tempest-SchedulerStatsAdminTest-1331908757 tempest-SchedulerStatsAdminTest-1331908757-project-admin] GET http://10.27.203.238/share/v1/e3754ccde0c34ce9a33fe231011c1930/scheduler-stats/pools/detail May 28 12:58:48 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-95e46426-6fb2-473d-9927-a91ceb156f93 tempest-SchedulerStatsAdminTest-1331908757 tempest-SchedulerStatsAdminTest-1331908757-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:48 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-95e46426-6fb2-473d-9927-a91ceb156f93 tempest-SchedulerStatsAdminTest-1331908757 tempest-SchedulerStatsAdminTest-1331908757-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:48 l75lg1-v1 devstack@m-api.service[98330]: INFO oslo_messaging._drivers.amqpdriver [None req-95e46426-6fb2-473d-9927-a91ceb156f93 tempest-SchedulerStatsAdminTest-1331908757 tempest-SchedulerStatsAdminTest-1331908757-project-admin] Creating reply queue: reply_cde4727073384bdbbe2d3acaf79ae8a7 May 28 12:58:48 l75lg1-v1 devstack@m-api.service[98330]: INFO oslo_messaging._drivers.amqpdriver [None req-95e46426-6fb2-473d-9927-a91ceb156f93 tempest-SchedulerStatsAdminTest-1331908757 tempest-SchedulerStatsAdminTest-1331908757-project-admin] Expecting reply to msg a51005ed5de049d7933c9af50b1fe025 in queue reply_cde4727073384bdbbe2d3acaf79ae8a7 May 28 12:58:48 l75lg1-v1 devstack@m-api.service[98330]: INFO oslo_messaging._drivers.amqpdriver [-] Received RPC response for msg a51005ed5de049d7933c9af50b1fe025 May 28 12:58:48 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-33f08325-89c2-4a29-913b-ac02a5e7be04 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] GET http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4 May 28 12:58:48 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-33f08325-89c2-4a29-913b-ac02a5e7be04 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:48 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-33f08325-89c2-4a29-913b-ac02a5e7be04 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:48 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:58:48 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-33f08325-89c2-4a29-913b-ac02a5e7be04 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4 returned with HTTP 200 May 28 12:58:48 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 581/1168] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:58:48 2024] GET /share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4 => generated 1316 bytes in 29 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:58:48 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-dd615440-7b6d-484e-a2c9-09e26b6c340b tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] POST http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/snapshots May 28 12:58:48 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-dd615440-7b6d-484e-a2c9-09e26b6c340b tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Action: 'create', calling method: ShareSnapshotMixin.create, body: {"snapshot": {"name": "tempest-tempest-created-share-snap-751796481", "force": false, "description": "Tempest's snapshot", "share_id": "72db8769-ece7-42ff-af27-2e778292a9b4"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:58:48 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.v1.share_snapshots [None req-dd615440-7b6d-484e-a2c9-09e26b6c340b tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Create snapshot from share 72db8769-ece7-42ff-af27-2e778292a9b4 May 28 12:58:48 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.quota [None req-dd615440-7b6d-484e-a2c9-09e26b6c340b tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Created reservations ['18efa6bf-ea76-4dd9-9c7a-3d0aeb2dccaf', 'b4e3ff81-67d4-49f9-bf57-d28c050278da', '60bb27a9-4966-45df-8740-a334400cbd09', '062c2bdb-e4af-4883-9840-9e2475393969'] {{(pid=98329) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 12:58:48 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-26a97202-0bdc-48c2-b1a1-828e0350b6b1 tempest-SharesMetadataTest-1561320255 None] <<< [GET] https://127.0.0.1:40443/api/quotas/ May 28 12:58:48 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-26a97202-0bdc-48c2-b1a1-828e0350b6b1 tempest-SharesMetadataTest-1561320255 None] [Bunch(cluster='loop75-kfs', cluster_id=1, default_email=None, default_group_quota=None, default_user_quota=None, enable_alarms=True, enable_email_providers=True, grace_period=None, guid='475f3772-d5c2-43ff-bd5c-d2ec38825b6e', hard_limit=1073741824, hard_limit_inodes=None, id=28, internal=False, is_user_quota=False, last_user_quotas_update=None, name='922a313f-547d-4129-ae7c-39ae549d3f49', num_blocked_users=0, num_exceeded_users=0, path='/manila/manila-922a313f-547d-4129-ae7c-39ae549d3f49', percent_capacity=0, percent_inodes=None, pretty_grace_period=None, pretty_grace_period_expiration=None, pretty_state='OK (CREATED)', soft_limit=None, soft_limit_inodes=None, state='OK', sync_state='CREATED', system_id=28, tenant_id=1, tenant_name='default', time_to_block=None, title='922a313f-547d-4129-ae7c-39ae549d3f49', url='https://127.0.0.1:40443/api/quotas/28/', used_capacity=0, used_capacity_tb=0.0, used_effective_capacity=0, used_effective_capacity_tb=0.0, used_inodes=0, used_limited_capacity=0)] May 28 12:58:48 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-26a97202-0bdc-48c2-b1a1-828e0350b6b1 tempest-SharesMetadataTest-1561320255 None] --- [GET] https://127.0.0.1:40443/api/quotas/: Done May 28 12:58:48 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-26a97202-0bdc-48c2-b1a1-828e0350b6b1 tempest-SharesMetadataTest-1561320255 None] >>> [DELETE] https://127.0.0.1:40443/api/quotas/28/ May 28 12:58:48 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-85276a66-ca07-4f3f-9343-a3bbc69f06a5 tempest-PublicSharesTest-118543418 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:58:48 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-85276a66-ca07-4f3f-9343-a3bbc69f06a5 tempest-PublicSharesTest-118543418 None] [Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=0, created='2024-05-28T12:58:22.525434Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='26aa4609-6029-4c58-8efe-5da6be4ab833', id=29, internal=False, is_s3_default_policy=False, name='c4c98d1e-9abc-48c7-a23f-ed7f1a740252', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=[], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['*'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['*'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T12:58:22.867667Z', tenant_id=1, tenant_name='default', title='c4c98d1e-9abc-48c7-a23f-ed7f1a740252', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/29/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[])] May 28 12:58:48 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-85276a66-ca07-4f3f-9343-a3bbc69f06a5 tempest-PublicSharesTest-118543418 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 12:58:48 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-85276a66-ca07-4f3f-9343-a3bbc69f06a5 tempest-PublicSharesTest-118543418 None] >>> [DELETE] https://127.0.0.1:40443/api/viewpolicies/29/ May 28 12:58:48 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.quota [None req-dd615440-7b6d-484e-a2c9-09e26b6c340b tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Committed reservations ['18efa6bf-ea76-4dd9-9c7a-3d0aeb2dccaf', 'b4e3ff81-67d4-49f9-bf57-d28c050278da', '60bb27a9-4966-45df-8740-a334400cbd09', '062c2bdb-e4af-4883-9840-9e2475393969'] {{(pid=98329) commit /opt/stack/manila/manila/quota.py:1063}} May 28 12:58:48 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-dd615440-7b6d-484e-a2c9-09e26b6c340b tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/snapshots returned with HTTP 202 May 28 12:58:48 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 582/1169] 10.27.203.238 () {66 vars in 1371 bytes} [Tue May 28 12:58:48 2024] POST /share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/snapshots => generated 722 bytes in 221 msecs (HTTP/1.1 202) 6 headers in 237 bytes (2 switches on core 0) May 28 12:58:48 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-cbb94b65-5253-4661-b6ad-b0b5726a1b98 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] GET http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/snapshots/0fba4486-6341-49ab-a9dc-333609ce1d2e May 28 12:58:48 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-cbb94b65-5253-4661-b6ad-b0b5726a1b98 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:48 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-cbb94b65-5253-4661-b6ad-b0b5726a1b98 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Calling method 'ShareSnapshotMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:48 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-cbb94b65-5253-4661-b6ad-b0b5726a1b98 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/snapshots/0fba4486-6341-49ab-a9dc-333609ce1d2e returned with HTTP 200 May 28 12:58:48 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 583/1170] 10.27.203.238 () {64 vars in 1460 bytes} [Tue May 28 12:58:48 2024] GET /share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/snapshots/0fba4486-6341-49ab-a9dc-333609ce1d2e => generated 722 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 231 bytes (2 switches on core 0) May 28 12:58:48 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-dd615440-7b6d-484e-a2c9-09e26b6c340b tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] >>> [POST] https://127.0.0.1:40443/api/snapshots/ May 28 12:58:48 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-dd615440-7b6d-484e-a2c9-09e26b6c340b tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] {'data': '{"path": "/manila/manila-7fdd602c-79d0-479c-95a2-336b202c6639", ' May 28 12:58:48 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-dd615440-7b6d-484e-a2c9-09e26b6c340b tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] '"name": "share-snapshot-5fdc999d-abe8-4e79-a497-bb575e26d5e8"}', May 28 12:58:48 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-dd615440-7b6d-484e-a2c9-09e26b6c340b tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] 'json': None, May 28 12:58:48 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-dd615440-7b6d-484e-a2c9-09e26b6c340b tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] 'params': None} May 28 12:58:48 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-086abe7d-ce36-4b97-874f-895baf199a65 tempest-PublicSharesTest-118543418 tempest-PublicSharesTest-118543418-project-admin] GET http://10.27.203.238/share/v2/8ee1466a8fe242afa8e0d0378840bfc1/shares/5a92a994-03f1-4598-b3f6-70280cf0a971 May 28 12:58:48 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-086abe7d-ce36-4b97-874f-895baf199a65 tempest-PublicSharesTest-118543418 tempest-PublicSharesTest-118543418-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:48 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-086abe7d-ce36-4b97-874f-895baf199a65 tempest-PublicSharesTest-118543418 tempest-PublicSharesTest-118543418-project-admin] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:49 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-086abe7d-ce36-4b97-874f-895baf199a65 tempest-PublicSharesTest-118543418 tempest-PublicSharesTest-118543418-project-admin] http://10.27.203.238/share/v2/8ee1466a8fe242afa8e0d0378840bfc1/shares/5a92a994-03f1-4598-b3f6-70280cf0a971 returned with HTTP 200 May 28 12:58:49 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 584/1171] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:58:48 2024] GET /share/v2/8ee1466a8fe242afa8e0d0378840bfc1/shares/5a92a994-03f1-4598-b3f6-70280cf0a971 => generated 1392 bytes in 24 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:58:49 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-95e46426-6fb2-473d-9927-a91ceb156f93 tempest-SchedulerStatsAdminTest-1331908757 tempest-SchedulerStatsAdminTest-1331908757-project-admin] http://10.27.203.238/share/v1/e3754ccde0c34ce9a33fe231011c1930/scheduler-stats/pools/detail returned with HTTP 200 May 28 12:58:49 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 588/1172] 10.27.203.238 () {62 vars in 1363 bytes} [Tue May 28 12:58:48 2024] GET /share/v1/e3754ccde0c34ce9a33fe231011c1930/scheduler-stats/pools/detail => generated 1087 bytes in 519 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:58:49 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-19e9e938-8e5b-487c-bef0-00ecaf6e89d2 tempest-SchedulerStatsAdminTest-1331908757 tempest-SchedulerStatsAdminTest-1331908757-project-admin] GET http://10.27.203.238/share/v1/e3754ccde0c34ce9a33fe231011c1930/scheduler-stats/pools/detail May 28 12:58:49 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-19e9e938-8e5b-487c-bef0-00ecaf6e89d2 tempest-SchedulerStatsAdminTest-1331908757 tempest-SchedulerStatsAdminTest-1331908757-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:49 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-19e9e938-8e5b-487c-bef0-00ecaf6e89d2 tempest-SchedulerStatsAdminTest-1331908757 tempest-SchedulerStatsAdminTest-1331908757-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:49 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bdfbd7a0-cc0a-42e6-8517-56a904b55c4e tempest-ShareIpRulesForNFSTest-1748669711 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:58:49 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bdfbd7a0-cc0a-42e6-8517-56a904b55c4e tempest-ShareIpRulesForNFSTest-1748669711 None] [Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=1, created='2024-05-28T12:57:40.763635Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='377955ad-d094-4e49-ab32-1021d943a572', id=21, internal=False, is_s3_default_policy=False, name='b7a7d61c-2cea-442a-9809-507038e080d5', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=['*'], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['203.0.113.171'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['203.0.113.171'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T12:58:47.136600Z', tenant_id=1, tenant_name='default', title='b7a7d61c-2cea-442a-9809-507038e080d5', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/21/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[])] May 28 12:58:49 l75lg1-v1 devstack@m-api.service[98329]: INFO oslo_messaging._drivers.amqpdriver [None req-19e9e938-8e5b-487c-bef0-00ecaf6e89d2 tempest-SchedulerStatsAdminTest-1331908757 tempest-SchedulerStatsAdminTest-1331908757-project-admin] Expecting reply to msg 650d1cbf4ae9405e9de165d7d0711fbe in queue reply_351c50596b2348218ab8657bb9280c03 May 28 12:58:49 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bdfbd7a0-cc0a-42e6-8517-56a904b55c4e tempest-ShareIpRulesForNFSTest-1748669711 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 12:58:49 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-bdfbd7a0-cc0a-42e6-8517-56a904b55c4e tempest-ShareIpRulesForNFSTest-1748669711 None] changing access on /manila/manila-b7a7d61c-2cea-442a-9809-507038e080d5. Rules: {'nfs_read_write': [], 'nfs_read_only': []} May 28 12:58:49 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bdfbd7a0-cc0a-42e6-8517-56a904b55c4e tempest-ShareIpRulesForNFSTest-1748669711 None] >>> [PATCH] https://127.0.0.1:40443/api/viewpolicies/21/ May 28 12:58:49 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bdfbd7a0-cc0a-42e6-8517-56a904b55c4e tempest-ShareIpRulesForNFSTest-1748669711 None] {'data': '{"name": "b7a7d61c-2cea-442a-9809-507038e080d5", "nfs_no_squash": ' May 28 12:58:49 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bdfbd7a0-cc0a-42e6-8517-56a904b55c4e tempest-ShareIpRulesForNFSTest-1748669711 None] '["*"], "nfs_root_squash": ["*"], "nfs_read_write": [], ' May 28 12:58:49 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bdfbd7a0-cc0a-42e6-8517-56a904b55c4e tempest-ShareIpRulesForNFSTest-1748669711 None] '"nfs_read_only": []}', May 28 12:58:49 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bdfbd7a0-cc0a-42e6-8517-56a904b55c4e tempest-ShareIpRulesForNFSTest-1748669711 None] 'params': None} May 28 12:58:49 l75lg1-v1 devstack@m-api.service[98329]: INFO oslo_messaging._drivers.amqpdriver [-] Received RPC response for msg 650d1cbf4ae9405e9de165d7d0711fbe May 28 12:58:49 l75lg1-v1 dstat.sh[49771]: 28-05 12:58:49| 8 1 89 2 0|5727M 1751M 277M 7869M| 32k 7503B| 0 1516k| 0 171 |4644 7171 |1.09 1.04 1.01|2.0 1.0 1.0| 0 0 | 0 2048M| 29 360 0 28 0 May 28 12:58:49 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-19e9e938-8e5b-487c-bef0-00ecaf6e89d2 tempest-SchedulerStatsAdminTest-1331908757 tempest-SchedulerStatsAdminTest-1331908757-project-admin] http://10.27.203.238/share/v1/e3754ccde0c34ce9a33fe231011c1930/scheduler-stats/pools/detail returned with HTTP 200 May 28 12:58:49 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 585/1173] 10.27.203.238 () {62 vars in 1363 bytes} [Tue May 28 12:58:49 2024] GET /share/v1/e3754ccde0c34ce9a33fe231011c1930/scheduler-stats/pools/detail => generated 1087 bytes in 510 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:58:49 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-304ef334-b2c2-45b7-9f9d-f8147729a4be tempest-SchedulerStatsAdminTest-1331908757 tempest-SchedulerStatsAdminTest-1331908757-project-admin] GET http://10.27.203.238/share/v1/e3754ccde0c34ce9a33fe231011c1930/scheduler-stats/pools/detail?host=%5El75lg1-v1%24&backend=%5Evast%24&pool=%5Evast%24 May 28 12:58:49 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-304ef334-b2c2-45b7-9f9d-f8147729a4be tempest-SchedulerStatsAdminTest-1331908757 tempest-SchedulerStatsAdminTest-1331908757-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:49 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-304ef334-b2c2-45b7-9f9d-f8147729a4be tempest-SchedulerStatsAdminTest-1331908757 tempest-SchedulerStatsAdminTest-1331908757-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:49 l75lg1-v1 devstack@m-api.service[98330]: INFO oslo_messaging._drivers.amqpdriver [None req-304ef334-b2c2-45b7-9f9d-f8147729a4be tempest-SchedulerStatsAdminTest-1331908757 tempest-SchedulerStatsAdminTest-1331908757-project-admin] Expecting reply to msg e57120e7b7cb40dcb52769e6081e4f6c in queue reply_cde4727073384bdbbe2d3acaf79ae8a7 May 28 12:58:49 l75lg1-v1 devstack@m-api.service[98330]: INFO oslo_messaging._drivers.amqpdriver [-] Received RPC response for msg e57120e7b7cb40dcb52769e6081e4f6c May 28 12:58:49 l75lg1-v1 nova-conductor[83648]: DEBUG dbcounter [-] [83648] Writing DB stats nova_cell1:SELECT=1 {{(pid=83648) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:58:50 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-304ef334-b2c2-45b7-9f9d-f8147729a4be tempest-SchedulerStatsAdminTest-1331908757 tempest-SchedulerStatsAdminTest-1331908757-project-admin] http://10.27.203.238/share/v1/e3754ccde0c34ce9a33fe231011c1930/scheduler-stats/pools/detail?host=%5El75lg1-v1%24&backend=%5Evast%24&pool=%5Evast%24 returned with HTTP 200 May 28 12:58:50 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 589/1174] 10.27.203.238 () {62 vars in 1474 bytes} [Tue May 28 12:58:49 2024] GET /share/v1/e3754ccde0c34ce9a33fe231011c1930/scheduler-stats/pools/detail?host=%5El75lg1-v1%24&backend=%5Evast%24&pool=%5Evast%24 => generated 1087 bytes in 508 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:58:50 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-dfff43bf-ef80-4d00-8aa0-369c0cb269aa tempest-SchedulerStatsAdminTest-1331908757 tempest-SchedulerStatsAdminTest-1331908757-project-admin] GET http://10.27.203.238/share/v1/e3754ccde0c34ce9a33fe231011c1930/scheduler-stats/pools/detail?host=foo&backend=bar&pool=shark May 28 12:58:50 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-dfff43bf-ef80-4d00-8aa0-369c0cb269aa tempest-SchedulerStatsAdminTest-1331908757 tempest-SchedulerStatsAdminTest-1331908757-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:50 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-dfff43bf-ef80-4d00-8aa0-369c0cb269aa tempest-SchedulerStatsAdminTest-1331908757 tempest-SchedulerStatsAdminTest-1331908757-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:50 l75lg1-v1 devstack@m-api.service[98329]: INFO oslo_messaging._drivers.amqpdriver [None req-dfff43bf-ef80-4d00-8aa0-369c0cb269aa tempest-SchedulerStatsAdminTest-1331908757 tempest-SchedulerStatsAdminTest-1331908757-project-admin] Expecting reply to msg a0afd0626f6d445c8f17c6213e8346f5 in queue reply_351c50596b2348218ab8657bb9280c03 May 28 12:58:50 l75lg1-v1 devstack@m-api.service[98329]: INFO oslo_messaging._drivers.amqpdriver [-] Received RPC response for msg a0afd0626f6d445c8f17c6213e8346f5 May 28 12:58:50 l75lg1-v1 neutron-server[77618]: DEBUG dbcounter [-] [77618] Writing DB stats neutron:UPDATE=1,neutron:SELECT=4 {{(pid=77618) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:58:50 l75lg1-v1 dstat.sh[49771]: 28-05 12:58:50| 1 1 96 1 0|5727M 1751M 277M 7869M| 32k 1513B| 0 1275k| 0 108 |2578 3646 |1.09 1.04 1.01| 0 2.0 0| 0 0 | 0 2048M| 29 360 0 28 0 May 28 12:58:50 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-85276a66-ca07-4f3f-9343-a3bbc69f06a5 tempest-PublicSharesTest-118543418 None] <<< [DELETE] https://127.0.0.1:40443/api/viewpolicies/29/ May 28 12:58:50 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-85276a66-ca07-4f3f-9343-a3bbc69f06a5 tempest-PublicSharesTest-118543418 None] --- [DELETE] https://127.0.0.1:40443/api/viewpolicies/29/: Done May 28 12:58:50 l75lg1-v1 neutron-server[77619]: DEBUG dbcounter [-] [77619] Writing DB stats neutron:SELECT=3 {{(pid=77619) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:58:50 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-85276a66-ca07-4f3f-9343-a3bbc69f06a5 tempest-PublicSharesTest-118543418 None] Created reservations ['735ce3dd-8a1f-47dd-a5a1-d2820f26f381', 'a8781164-1a41-48f3-b2c5-e0429eafc0e8', '834f0a41-701b-4182-8da8-a4c3586440a4', 'fb4a18bb-e011-45e2-9458-85345971f27a'] {{(pid=98474) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 12:58:50 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-85276a66-ca07-4f3f-9343-a3bbc69f06a5 tempest-PublicSharesTest-118543418 None] Committed reservations ['735ce3dd-8a1f-47dd-a5a1-d2820f26f381', 'a8781164-1a41-48f3-b2c5-e0429eafc0e8', '834f0a41-701b-4182-8da8-a4c3586440a4', 'fb4a18bb-e011-45e2-9458-85345971f27a'] {{(pid=98474) commit /opt/stack/manila/manila/quota.py:1063}} May 28 12:58:50 l75lg1-v1 manila-share[98474]: INFO manila.share.manager [None req-85276a66-ca07-4f3f-9343-a3bbc69f06a5 tempest-PublicSharesTest-118543418 None] Share instance c4c98d1e-9abc-48c7-a23f-ed7f1a740252: deleted successfully. May 28 12:58:50 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:58:50 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:58:50 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.manager [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=83654) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10545}} May 28 12:58:50 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-dfff43bf-ef80-4d00-8aa0-369c0cb269aa tempest-SchedulerStatsAdminTest-1331908757 tempest-SchedulerStatsAdminTest-1331908757-project-admin] http://10.27.203.238/share/v1/e3754ccde0c34ce9a33fe231011c1930/scheduler-stats/pools/detail?host=foo&backend=bar&pool=shark returned with HTTP 200 May 28 12:58:50 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 586/1175] 10.27.203.238 () {62 vars in 1426 bytes} [Tue May 28 12:58:50 2024] GET /share/v1/e3754ccde0c34ce9a33fe231011c1930/scheduler-stats/pools/detail?host=foo&backend=bar&pool=shark => generated 13 bytes in 508 msecs (HTTP/1.1 200) 6 headers in 229 bytes (1 switches on core 0) May 28 12:58:50 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-836785e4-0d91-4fa3-84b7-f860c1a844d3 tempest-SchedulerStatsAdminTest-1331908757 tempest-SchedulerStatsAdminTest-1331908757-project-admin] GET http://10.27.203.238/share/v1/e3754ccde0c34ce9a33fe231011c1930/scheduler-stats/pools May 28 12:58:50 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-836785e4-0d91-4fa3-84b7-f860c1a844d3 tempest-SchedulerStatsAdminTest-1331908757 tempest-SchedulerStatsAdminTest-1331908757-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:50 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-836785e4-0d91-4fa3-84b7-f860c1a844d3 tempest-SchedulerStatsAdminTest-1331908757 tempest-SchedulerStatsAdminTest-1331908757-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:50 l75lg1-v1 devstack@m-api.service[98330]: INFO oslo_messaging._drivers.amqpdriver [None req-836785e4-0d91-4fa3-84b7-f860c1a844d3 tempest-SchedulerStatsAdminTest-1331908757 tempest-SchedulerStatsAdminTest-1331908757-project-admin] Expecting reply to msg a55f855dc7364dd2bf490cff8ccbafb4 in queue reply_cde4727073384bdbbe2d3acaf79ae8a7 May 28 12:58:50 l75lg1-v1 devstack@m-api.service[98330]: INFO oslo_messaging._drivers.amqpdriver [-] Received RPC response for msg a55f855dc7364dd2bf490cff8ccbafb4 May 28 12:58:50 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bdfbd7a0-cc0a-42e6-8517-56a904b55c4e tempest-ShareIpRulesForNFSTest-1748669711 None] <<< [PATCH] https://127.0.0.1:40443/api/viewpolicies/21/ May 28 12:58:50 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bdfbd7a0-cc0a-42e6-8517-56a904b55c4e tempest-ShareIpRulesForNFSTest-1748669711 None] Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=1, created='2024-05-28T12:57:40.763635Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='377955ad-d094-4e49-ab32-1021d943a572', id=21, internal=False, is_s3_default_policy=False, name='b7a7d61c-2cea-442a-9809-507038e080d5', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=['*'], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=[], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=[], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='MODIFYING', sync_time='2024-05-28T12:58:50.343061Z', tenant_id=1, tenant_name='default', title='b7a7d61c-2cea-442a-9809-507038e080d5', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/21/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[]) May 28 12:58:50 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bdfbd7a0-cc0a-42e6-8517-56a904b55c4e tempest-ShareIpRulesForNFSTest-1748669711 None] --- [PATCH] https://127.0.0.1:40443/api/viewpolicies/21/: Done May 28 12:58:50 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-bdfbd7a0-cc0a-42e6-8517-56a904b55c4e tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:50 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-bdfbd7a0-cc0a-42e6-8517-56a904b55c4e tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:50 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-bdfbd7a0-cc0a-42e6-8517-56a904b55c4e tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.032s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:50 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-bdfbd7a0-cc0a-42e6-8517-56a904b55c4e tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:50 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-bdfbd7a0-cc0a-42e6-8517-56a904b55c4e tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:50 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-bdfbd7a0-cc0a-42e6-8517-56a904b55c4e tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.034s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:50 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-bdfbd7a0-cc0a-42e6-8517-56a904b55c4e tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:50 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-bdfbd7a0-cc0a-42e6-8517-56a904b55c4e tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:50 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-bdfbd7a0-cc0a-42e6-8517-56a904b55c4e tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.004s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:50 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-bdfbd7a0-cc0a-42e6-8517-56a904b55c4e tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:50 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-bdfbd7a0-cc0a-42e6-8517-56a904b55c4e tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:50 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-bdfbd7a0-cc0a-42e6-8517-56a904b55c4e tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:50 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-bdfbd7a0-cc0a-42e6-8517-56a904b55c4e tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:50 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-bdfbd7a0-cc0a-42e6-8517-56a904b55c4e tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:50 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-bdfbd7a0-cc0a-42e6-8517-56a904b55c4e tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.042s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:50 l75lg1-v1 manila-share[98474]: INFO manila.share.access [None req-bdfbd7a0-cc0a-42e6-8517-56a904b55c4e tempest-ShareIpRulesForNFSTest-1748669711 None] Access rules were successfully modified for share instance b7a7d61c-2cea-442a-9809-507038e080d5 belonging to share 1ddadc17-cf10-4a42-8bbd-8335fb3520a1. May 28 12:58:51 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-836785e4-0d91-4fa3-84b7-f860c1a844d3 tempest-SchedulerStatsAdminTest-1331908757 tempest-SchedulerStatsAdminTest-1331908757-project-admin] http://10.27.203.238/share/v1/e3754ccde0c34ce9a33fe231011c1930/scheduler-stats/pools returned with HTTP 200 May 28 12:58:51 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 590/1176] 10.27.203.238 () {62 vars in 1342 bytes} [Tue May 28 12:58:50 2024] GET /share/v1/e3754ccde0c34ce9a33fe231011c1930/scheduler-stats/pools => generated 100 bytes in 508 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:58:51 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-9f41d1e4-a145-4b93-9f3b-cd2981588e64 tempest-SchedulerStatsAdminTest-1331908757 tempest-SchedulerStatsAdminTest-1331908757-project-admin] GET http://10.27.203.238/share/v1/e3754ccde0c34ce9a33fe231011c1930/scheduler-stats/pools?host=%5El75lg1-v1%24&backend=%5Evast%24&pool=%5Evast%24 May 28 12:58:51 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-9f41d1e4-a145-4b93-9f3b-cd2981588e64 tempest-SchedulerStatsAdminTest-1331908757 tempest-SchedulerStatsAdminTest-1331908757-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:51 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-9f41d1e4-a145-4b93-9f3b-cd2981588e64 tempest-SchedulerStatsAdminTest-1331908757 tempest-SchedulerStatsAdminTest-1331908757-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:51 l75lg1-v1 devstack@m-api.service[98329]: INFO oslo_messaging._drivers.amqpdriver [None req-9f41d1e4-a145-4b93-9f3b-cd2981588e64 tempest-SchedulerStatsAdminTest-1331908757 tempest-SchedulerStatsAdminTest-1331908757-project-admin] Expecting reply to msg 0125577c44784e0dad2b65fcb9d6926b in queue reply_351c50596b2348218ab8657bb9280c03 May 28 12:58:51 l75lg1-v1 devstack@m-api.service[98329]: INFO oslo_messaging._drivers.amqpdriver [-] Received RPC response for msg 0125577c44784e0dad2b65fcb9d6926b May 28 12:58:51 l75lg1-v1 dstat.sh[49771]: 28-05 12:58:51| 3 1 94 2 0|5727M 1751M 277M 7869M| 34k 1555B| 0 1201k| 0 153 |3572 5499 |1.09 1.04 1.01| 0 1.0 0| 0 0 | 0 2048M| 29 360 0 26 0 May 28 12:58:51 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-751f2c9f-c903-44b6-b373-f8bd8f34419a tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] GET http://10.27.203.238/share/v2/776f75906bc64f8f9316d5aab4b50bf1/share-access-rules?share_id=1ddadc17-cf10-4a42-8bbd-8335fb3520a1 May 28 12:58:51 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-751f2c9f-c903-44b6-b373-f8bd8f34419a tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:51 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-751f2c9f-c903-44b6-b373-f8bd8f34419a tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:51 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-751f2c9f-c903-44b6-b373-f8bd8f34419a tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] http://10.27.203.238/share/v2/776f75906bc64f8f9316d5aab4b50bf1/share-access-rules?share_id=1ddadc17-cf10-4a42-8bbd-8335fb3520a1 returned with HTTP 200 May 28 12:58:51 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 591/1177] 10.27.203.238 () {64 vars in 1467 bytes} [Tue May 28 12:58:51 2024] GET /share/v2/776f75906bc64f8f9316d5aab4b50bf1/share-access-rules?share_id=1ddadc17-cf10-4a42-8bbd-8335fb3520a1 => generated 19 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 230 bytes (2 switches on core 0) May 28 12:58:51 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-3b022bc2-6e1d-4e3f-8682-3f251b036909 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] POST http://10.27.203.238/share/v2/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action May 28 12:58:51 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-3b022bc2-6e1d-4e3f-8682-3f251b036909 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Action body: b'{"allow_access": {"access_type": "ip", "access_to": "2001:0DB8:e36d:a19a:4a8a:ea99:8f12:864f", "access_level": "rw"}}' {{(pid=98330) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:58:51 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-3b022bc2-6e1d-4e3f-8682-3f251b036909 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Action: 'action', calling method: ShareController.allow_access, body: {"allow_access": {"access_type": "ip", "access_to": "2001:0DB8:e36d:a19a:4a8a:ea99:8f12:864f", "access_level": "rw"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:58:51 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-3b022bc2-6e1d-4e3f-8682-3f251b036909 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:51 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-3b022bc2-6e1d-4e3f-8682-3f251b036909 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:51 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-3b022bc2-6e1d-4e3f-8682-3f251b036909 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.044s {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:51 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-3b022bc2-6e1d-4e3f-8682-3f251b036909 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] http://10.27.203.238/share/v2/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action returned with HTTP 200 May 28 12:58:51 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 592/1178] 10.27.203.238 () {66 vars in 1494 bytes} [Tue May 28 12:58:51 2024] POST /share/v2/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action => generated 321 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:58:51 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-87823e69-ff0f-4603-a327-152bf5008392 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] POST http://10.27.203.238/share/v2/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action May 28 12:58:51 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-87823e69-ff0f-4603-a327-152bf5008392 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Action body: b'{"access_list": null}' {{(pid=98330) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:58:51 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-87823e69-ff0f-4603-a327-152bf5008392 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Action: 'action', calling method: ShareController.access_list, body: {"access_list": null} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:58:51 l75lg1-v1 manila-share[98474]: DEBUG manila.share.manager [None req-3b022bc2-6e1d-4e3f-8682-3f251b036909 tempest-ShareIpRulesForNFSTest-1748669711 None] Received request to update access for share instance b7a7d61c-2cea-442a-9809-507038e080d5. {{(pid=98474) update_access_for_instances /opt/stack/manila/manila/share/manager.py:4353}} May 28 12:58:51 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-87823e69-ff0f-4603-a327-152bf5008392 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] http://10.27.203.238/share/v2/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action returned with HTTP 200 May 28 12:58:51 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 593/1179] 10.27.203.238 () {66 vars in 1493 bytes} [Tue May 28 12:58:51 2024] POST /share/v2/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action => generated 276 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 231 bytes (2 switches on core 0) May 28 12:58:51 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-b15859d5-7b69-407d-90bb-81c0c192b532 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] GET http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/0e9e1ee3-c7cc-4239-bc5b-cace9d44e641 May 28 12:58:51 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-b15859d5-7b69-407d-90bb-81c0c192b532 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:51 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-b15859d5-7b69-407d-90bb-81c0c192b532 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:51 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-3b022bc2-6e1d-4e3f-8682-3f251b036909 tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:51 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-3b022bc2-6e1d-4e3f-8682-3f251b036909 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:51 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-3b022bc2-6e1d-4e3f-8682-3f251b036909 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.006s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:51 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-3b022bc2-6e1d-4e3f-8682-3f251b036909 tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:51 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-3b022bc2-6e1d-4e3f-8682-3f251b036909 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:51 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-b15859d5-7b69-407d-90bb-81c0c192b532 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/0e9e1ee3-c7cc-4239-bc5b-cace9d44e641 returned with HTTP 200 May 28 12:58:51 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 594/1180] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:58:51 2024] GET /share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/0e9e1ee3-c7cc-4239-bc5b-cace9d44e641 => generated 1315 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:58:51 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:58:51 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.manager [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Starting heal instance info cache {{(pid=83654) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}} May 28 12:58:51 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.manager [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Rebuilding the list of instances to heal {{(pid=83654) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9930}} May 28 12:58:51 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Expecting reply to msg 35328214baff4bde88c3797f066e4e49 in queue reply_37f4cbd1dd094961a22b8a65f222c327 May 28 12:58:51 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-3b022bc2-6e1d-4e3f-8682-3f251b036909 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.070s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:51 l75lg1-v1 manila-share[98474]: DEBUG manila.share.access [None req-3b022bc2-6e1d-4e3f-8682-3f251b036909 tempest-ShareIpRulesForNFSTest-1748669711 None] Updating access rules for share instance b7a7d61c-2cea-442a-9809-507038e080d5 belonging to share 1ddadc17-cf10-4a42-8bbd-8335fb3520a1. {{(pid=98474) update_access_rules /opt/stack/manila/manila/share/access.py:298}} May 28 12:58:51 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [-] Received RPC response for msg 35328214baff4bde88c3797f066e4e49 May 28 12:58:51 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-3b022bc2-6e1d-4e3f-8682-3f251b036909 tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:51 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-3b022bc2-6e1d-4e3f-8682-3f251b036909 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:51 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-9f41d1e4-a145-4b93-9f3b-cd2981588e64 tempest-SchedulerStatsAdminTest-1331908757 tempest-SchedulerStatsAdminTest-1331908757-project-admin] http://10.27.203.238/share/v1/e3754ccde0c34ce9a33fe231011c1930/scheduler-stats/pools?host=%5El75lg1-v1%24&backend=%5Evast%24&pool=%5Evast%24 returned with HTTP 200 May 28 12:58:51 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 587/1181] 10.27.203.238 () {62 vars in 1453 bytes} [Tue May 28 12:58:51 2024] GET /share/v1/e3754ccde0c34ce9a33fe231011c1930/scheduler-stats/pools?host=%5El75lg1-v1%24&backend=%5Evast%24&pool=%5Evast%24 => generated 100 bytes in 509 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:58:51 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-3b022bc2-6e1d-4e3f-8682-3f251b036909 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.008s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:51 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-3b022bc2-6e1d-4e3f-8682-3f251b036909 tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:51 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-3b022bc2-6e1d-4e3f-8682-3f251b036909 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:51 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-78c3e715-96e3-4b51-92a9-f15b5917b43b tempest-SchedulerStatsAdminTest-1331908757 tempest-SchedulerStatsAdminTest-1331908757-project-admin] GET http://10.27.203.238/share/v1/e3754ccde0c34ce9a33fe231011c1930/scheduler-stats/pools?host=foo&backend=bar&pool=shark May 28 12:58:51 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-78c3e715-96e3-4b51-92a9-f15b5917b43b tempest-SchedulerStatsAdminTest-1331908757 tempest-SchedulerStatsAdminTest-1331908757-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:51 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-78c3e715-96e3-4b51-92a9-f15b5917b43b tempest-SchedulerStatsAdminTest-1331908757 tempest-SchedulerStatsAdminTest-1331908757-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:51 l75lg1-v1 devstack@m-api.service[98330]: INFO oslo_messaging._drivers.amqpdriver [None req-78c3e715-96e3-4b51-92a9-f15b5917b43b tempest-SchedulerStatsAdminTest-1331908757 tempest-SchedulerStatsAdminTest-1331908757-project-admin] Expecting reply to msg 1e9036ec2ae54cce9683e7c99791f0dd in queue reply_cde4727073384bdbbe2d3acaf79ae8a7 May 28 12:58:51 l75lg1-v1 devstack@m-api.service[98330]: INFO oslo_messaging._drivers.amqpdriver [-] Received RPC response for msg 1e9036ec2ae54cce9683e7c99791f0dd May 28 12:58:51 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-3b022bc2-6e1d-4e3f-8682-3f251b036909 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.016s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:51 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-3b022bc2-6e1d-4e3f-8682-3f251b036909 tempest-ShareIpRulesForNFSTest-1748669711 None] changing access on None May 28 12:58:51 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-3b022bc2-6e1d-4e3f-8682-3f251b036909 tempest-ShareIpRulesForNFSTest-1748669711 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:58:51 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-3b022bc2-6e1d-4e3f-8682-3f251b036909 tempest-ShareIpRulesForNFSTest-1748669711 None] {'allow_redirects': True, May 28 12:58:51 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-3b022bc2-6e1d-4e3f-8682-3f251b036909 tempest-ShareIpRulesForNFSTest-1748669711 None] 'params': {'name': 'b7a7d61c-2cea-442a-9809-507038e080d5'}} May 28 12:58:51 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-1eb5044d-96fb-4674-98ba-c54caef5bb9a tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] GET http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/snapshots/0fba4486-6341-49ab-a9dc-333609ce1d2e May 28 12:58:51 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-1eb5044d-96fb-4674-98ba-c54caef5bb9a tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:51 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-1eb5044d-96fb-4674-98ba-c54caef5bb9a tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Calling method 'ShareSnapshotMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:51 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-1eb5044d-96fb-4674-98ba-c54caef5bb9a tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/snapshots/0fba4486-6341-49ab-a9dc-333609ce1d2e returned with HTTP 200 May 28 12:58:51 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 588/1182] 10.27.203.238 () {64 vars in 1460 bytes} [Tue May 28 12:58:51 2024] GET /share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/snapshots/0fba4486-6341-49ab-a9dc-333609ce1d2e => generated 722 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:58:52 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-0e5cb5d6-6351-4a26-bd52-e8ca83414ce5 tempest-PublicSharesTest-118543418 tempest-PublicSharesTest-118543418-project-admin] GET http://10.27.203.238/share/v2/8ee1466a8fe242afa8e0d0378840bfc1/shares/5a92a994-03f1-4598-b3f6-70280cf0a971 May 28 12:58:52 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-0e5cb5d6-6351-4a26-bd52-e8ca83414ce5 tempest-PublicSharesTest-118543418 tempest-PublicSharesTest-118543418-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:52 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-0e5cb5d6-6351-4a26-bd52-e8ca83414ce5 tempest-PublicSharesTest-118543418 tempest-PublicSharesTest-118543418-project-admin] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:52 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-0e5cb5d6-6351-4a26-bd52-e8ca83414ce5 tempest-PublicSharesTest-118543418 tempest-PublicSharesTest-118543418-project-admin] HTTP exception thrown: The resource could not be found. May 28 12:58:52 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-0e5cb5d6-6351-4a26-bd52-e8ca83414ce5 tempest-PublicSharesTest-118543418 tempest-PublicSharesTest-118543418-project-admin] http://10.27.203.238/share/v2/8ee1466a8fe242afa8e0d0378840bfc1/shares/5a92a994-03f1-4598-b3f6-70280cf0a971 returned with HTTP 404 May 28 12:58:52 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 589/1183] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:58:52 2024] GET /share/v2/8ee1466a8fe242afa8e0d0378840bfc1/shares/5a92a994-03f1-4598-b3f6-70280cf0a971 => generated 78 bytes in 11 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 12:58:52 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-4b180551-58c5-42d4-9de8-bc86bc61d554 tempest-PublicSharesTest-1667420263 tempest-PublicSharesTest-1667420263-project-member] POST http://10.27.203.238/share/v2/6d36e1eb1dbc449db6aca75b12a2ba18/shares May 28 12:58:52 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-4b180551-58c5-42d4-9de8-bc86bc61d554 tempest-PublicSharesTest-1667420263 tempest-PublicSharesTest-1667420263-project-member] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share": {"share_proto": "nfs", "description": "a share we will update", "snapshot_id": null, "name": "tempest-tempest-share-name-462897653", "size": 1, "metadata": {}, "is_public": false, "share_type": "31514837-1b9c-4410-8444-5ea15e0aca59"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:58:52 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.v1.shares [None req-4b180551-58c5-42d4-9de8-bc86bc61d554 tempest-PublicSharesTest-1667420263 tempest-PublicSharesTest-1667420263-project-member] Create NFS share of 1 GB May 28 12:58:52 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.manager [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Didn't find any instances for network info cache update. {{(pid=83654) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10012}} May 28 12:58:52 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.quota [None req-4b180551-58c5-42d4-9de8-bc86bc61d554 tempest-PublicSharesTest-1667420263 tempest-PublicSharesTest-1667420263-project-member] Created reservations ['89adbebe-a24a-4465-9bde-ee3bc79189bf', '674d002b-4bb0-4747-8e98-d2c2f1ccad05', '0a06a534-8fd7-49bf-9ccd-b4131b2adcad', '9dc0a3be-8abd-40a6-9ccc-79bf81ed285e'] {{(pid=98329) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 12:58:52 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.quota [None req-4b180551-58c5-42d4-9de8-bc86bc61d554 tempest-PublicSharesTest-1667420263 tempest-PublicSharesTest-1667420263-project-member] Committed reservations ['89adbebe-a24a-4465-9bde-ee3bc79189bf', '674d002b-4bb0-4747-8e98-d2c2f1ccad05', '0a06a534-8fd7-49bf-9ccd-b4131b2adcad', '9dc0a3be-8abd-40a6-9ccc-79bf81ed285e'] {{(pid=98329) commit /opt/stack/manila/manila/quota.py:1063}} May 28 12:58:52 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-78c3e715-96e3-4b51-92a9-f15b5917b43b tempest-SchedulerStatsAdminTest-1331908757 tempest-SchedulerStatsAdminTest-1331908757-project-admin] http://10.27.203.238/share/v1/e3754ccde0c34ce9a33fe231011c1930/scheduler-stats/pools?host=foo&backend=bar&pool=shark returned with HTTP 200 May 28 12:58:52 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 595/1184] 10.27.203.238 () {62 vars in 1405 bytes} [Tue May 28 12:58:51 2024] GET /share/v1/e3754ccde0c34ce9a33fe231011c1930/scheduler-stats/pools?host=foo&backend=bar&pool=shark => generated 13 bytes in 510 msecs (HTTP/1.1 200) 6 headers in 229 bytes (1 switches on core 0) May 28 12:58:52 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-9c21a920-1b29-49fe-9d85-261c6c4c3212 tempest-SchedulerStatsAdminTest-1331908757 tempest-SchedulerStatsAdminTest-1331908757-project-admin] POST http://10.27.203.238/share/v2/e3754ccde0c34ce9a33fe231011c1930/types May 28 12:58:52 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-9c21a920-1b29-49fe-9d85-261c6c4c3212 tempest-SchedulerStatsAdminTest-1331908757 tempest-SchedulerStatsAdminTest-1331908757-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share_type": {"name": "tempest-typeshare-type-640868561", "extra_specs": {"driver_handles_share_servers": "False"}, "share_type_access:is_public": true}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:58:52 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-9c21a920-1b29-49fe-9d85-261c6c4c3212 tempest-SchedulerStatsAdminTest-1331908757 tempest-SchedulerStatsAdminTest-1331908757-project-admin] http://10.27.203.238/share/v2/e3754ccde0c34ce9a33fe231011c1930/types returned with HTTP 200 May 28 12:58:52 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 596/1185] 10.27.203.238 () {66 vars in 1359 bytes} [Tue May 28 12:58:52 2024] POST /share/v2/e3754ccde0c34ce9a33fe231011c1930/types => generated 621 bytes in 19 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:58:52 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-718c40ab-69d1-4c60-8c92-83fd2cafddc9 tempest-SchedulerStatsAdminTest-1331908757 tempest-SchedulerStatsAdminTest-1331908757-project-admin] GET http://10.27.203.238/share/v2/e3754ccde0c34ce9a33fe231011c1930/scheduler-stats/pools/detail?share_type=tempest-typeshare-type-640868561 May 28 12:58:52 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-718c40ab-69d1-4c60-8c92-83fd2cafddc9 tempest-SchedulerStatsAdminTest-1331908757 tempest-SchedulerStatsAdminTest-1331908757-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:52 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-718c40ab-69d1-4c60-8c92-83fd2cafddc9 tempest-SchedulerStatsAdminTest-1331908757 tempest-SchedulerStatsAdminTest-1331908757-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:52 l75lg1-v1 devstack@m-api.service[98330]: INFO oslo_messaging._drivers.amqpdriver [None req-718c40ab-69d1-4c60-8c92-83fd2cafddc9 tempest-SchedulerStatsAdminTest-1331908757 tempest-SchedulerStatsAdminTest-1331908757-project-admin] Expecting reply to msg e782e797598948b798bdf168a8dfd9bf in queue reply_cde4727073384bdbbe2d3acaf79ae8a7 May 28 12:58:52 l75lg1-v1 devstack@m-api.service[98330]: INFO oslo_messaging._drivers.amqpdriver [-] Received RPC response for msg e782e797598948b798bdf168a8dfd9bf May 28 12:58:52 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-3b022bc2-6e1d-4e3f-8682-3f251b036909 tempest-ShareIpRulesForNFSTest-1748669711 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:58:52 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-3b022bc2-6e1d-4e3f-8682-3f251b036909 tempest-ShareIpRulesForNFSTest-1748669711 None] [Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=1, created='2024-05-28T12:57:40.763635Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='377955ad-d094-4e49-ab32-1021d943a572', id=21, internal=False, is_s3_default_policy=False, name='b7a7d61c-2cea-442a-9809-507038e080d5', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=['*'], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=[], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=[], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T12:58:50.758361Z', tenant_id=1, tenant_name='default', title='b7a7d61c-2cea-442a-9809-507038e080d5', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/21/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[])] May 28 12:58:52 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-3b022bc2-6e1d-4e3f-8682-3f251b036909 tempest-ShareIpRulesForNFSTest-1748669711 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 12:58:52 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-3b022bc2-6e1d-4e3f-8682-3f251b036909 tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:52 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-3b022bc2-6e1d-4e3f-8682-3f251b036909 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:52 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.host_manager [None req-4b180551-58c5-42d4-9de8-bc86bc61d554 tempest-PublicSharesTest-1667420263 None] Share service is down. (host: l75lg1-v1@generic2). May 28 12:58:52 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.host_manager [None req-4b180551-58c5-42d4-9de8-bc86bc61d554 tempest-PublicSharesTest-1667420263 None] Share service is down. (host: l75lg1-v1@generic1). May 28 12:58:52 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-4b180551-58c5-42d4-9de8-bc86bc61d554 tempest-PublicSharesTest-1667420263 None] Starting with 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:80}} May 28 12:58:52 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-4b180551-58c5-42d4-9de8-bc86bc61d554 tempest-PublicSharesTest-1667420263 None] Filter OnlyHostFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:58:52 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-4b180551-58c5-42d4-9de8-bc86bc61d554 tempest-PublicSharesTest-1667420263 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:58:52 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.capacity [None req-4b180551-58c5-42d4-9de8-bc86bc61d554 tempest-PublicSharesTest-1667420263 None] Space information for share creation on host l75lg1-v1@vast#vast (requested / avail): 1/2082 {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/capacity.py:83}} May 28 12:58:52 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-4b180551-58c5-42d4-9de8-bc86bc61d554 tempest-PublicSharesTest-1667420263 None] Filter CapacityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:58:52 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-4b180551-58c5-42d4-9de8-bc86bc61d554 tempest-PublicSharesTest-1667420263 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:58:52 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-4b180551-58c5-42d4-9de8-bc86bc61d554 tempest-PublicSharesTest-1667420263 None] Driver Filter: Checking host 'l75lg1-v1@vast#vast' {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:37}} May 28 12:58:52 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-4b180551-58c5-42d4-9de8-bc86bc61d554 tempest-PublicSharesTest-1667420263 None] Filter function not set :: passing host. {{(pid=98327) _check_filter_function /opt/stack/manila/manila/scheduler/filters/driver.py:53}} May 28 12:58:52 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-4b180551-58c5-42d4-9de8-bc86bc61d554 tempest-PublicSharesTest-1667420263 None] Result: True {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:40}} May 28 12:58:52 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-4b180551-58c5-42d4-9de8-bc86bc61d554 tempest-PublicSharesTest-1667420263 None] Done checking host 'l75lg1-v1@vast#vast' {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:41}} May 28 12:58:52 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-4b180551-58c5-42d4-9de8-bc86bc61d554 tempest-PublicSharesTest-1667420263 None] Filter DriverFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:58:52 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-4b180551-58c5-42d4-9de8-bc86bc61d554 tempest-PublicSharesTest-1667420263 None] Filter ShareReplicationFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:58:52 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-4b180551-58c5-42d4-9de8-bc86bc61d554 tempest-PublicSharesTest-1667420263 None] Filter CreateFromSnapshotFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:58:52 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-4b180551-58c5-42d4-9de8-bc86bc61d554 tempest-PublicSharesTest-1667420263 None] Filter AffinityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:58:52 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-4b180551-58c5-42d4-9de8-bc86bc61d554 tempest-PublicSharesTest-1667420263 None] Filter AntiAffinityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:58:52 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.drivers.filter [None req-4b180551-58c5-42d4-9de8-bc86bc61d554 tempest-PublicSharesTest-1667420263 None] Filtered share [host: 'l75lg1-v1@vast#vast', free_capacity_gb: 2082.64910808485, pools: None] {{(pid=98327) _schedule_share /opt/stack/manila/manila/scheduler/drivers/filter.py:268}} May 28 12:58:52 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-4b180551-58c5-42d4-9de8-bc86bc61d554 tempest-PublicSharesTest-1667420263 None] Checking host 'l75lg1-v1@vast#vast' {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:46}} May 28 12:58:52 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.weighers.goodness [None req-4b180551-58c5-42d4-9de8-bc86bc61d554 tempest-PublicSharesTest-1667420263 None] Goodness function not set :: defaulting to minimal goodness rating of 0. May 28 12:58:52 l75lg1-v1 manila-scheduler[98327]: INFO manila.scheduler.weighers.goodness [None req-4b180551-58c5-42d4-9de8-bc86bc61d554 tempest-PublicSharesTest-1667420263 None] Goodness function result for host l75lg1-v1@vast#vast: 0. May 28 12:58:52 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-4b180551-58c5-42d4-9de8-bc86bc61d554 tempest-PublicSharesTest-1667420263 None] Goodness: 0 {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:48}} May 28 12:58:52 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-4b180551-58c5-42d4-9de8-bc86bc61d554 tempest-PublicSharesTest-1667420263 None] Done checking host 'l75lg1-v1@vast#vast' {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:49}} May 28 12:58:52 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.drivers.filter [None req-4b180551-58c5-42d4-9de8-bc86bc61d554 tempest-PublicSharesTest-1667420263 None] Choosing for share: WeighedHost [host: l75lg1-v1@vast#vast, weight: 0.0] {{(pid=98327) _schedule_share /opt/stack/manila/manila/scheduler/drivers/filter.py:274}} May 28 12:58:52 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-4b180551-58c5-42d4-9de8-bc86bc61d554 tempest-PublicSharesTest-1667420263 tempest-PublicSharesTest-1667420263-project-member] http://10.27.203.238/share/v2/6d36e1eb1dbc449db6aca75b12a2ba18/shares returned with HTTP 200 May 28 12:58:52 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 590/1186] 10.27.203.238 () {66 vars in 1362 bytes} [Tue May 28 12:58:52 2024] POST /share/v2/6d36e1eb1dbc449db6aca75b12a2ba18/shares => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:58:52 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-14a2a557-b42b-4ee3-905d-7a54145fc2ef tempest-PublicSharesTest-1667420263 tempest-PublicSharesTest-1667420263-project-member] GET http://10.27.203.238/share/v2/6d36e1eb1dbc449db6aca75b12a2ba18/shares/84e821d0-2b62-48db-80c7-259f61a14bac May 28 12:58:52 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-14a2a557-b42b-4ee3-905d-7a54145fc2ef tempest-PublicSharesTest-1667420263 tempest-PublicSharesTest-1667420263-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:52 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-14a2a557-b42b-4ee3-905d-7a54145fc2ef tempest-PublicSharesTest-1667420263 tempest-PublicSharesTest-1667420263-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:52 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-26a97202-0bdc-48c2-b1a1-828e0350b6b1 tempest-SharesMetadataTest-1561320255 None] <<< [DELETE] https://127.0.0.1:40443/api/quotas/28/ May 28 12:58:52 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-26a97202-0bdc-48c2-b1a1-828e0350b6b1 tempest-SharesMetadataTest-1561320255 None] --- [DELETE] https://127.0.0.1:40443/api/quotas/28/: Done May 28 12:58:52 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-26a97202-0bdc-48c2-b1a1-828e0350b6b1 tempest-SharesMetadataTest-1561320255 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:58:52 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-26a97202-0bdc-48c2-b1a1-828e0350b6b1 tempest-SharesMetadataTest-1561320255 None] {'allow_redirects': True, May 28 12:58:52 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-26a97202-0bdc-48c2-b1a1-828e0350b6b1 tempest-SharesMetadataTest-1561320255 None] 'params': {'name': '922a313f-547d-4129-ae7c-39ae549d3f49'}} May 28 12:58:52 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-14a2a557-b42b-4ee3-905d-7a54145fc2ef tempest-PublicSharesTest-1667420263 tempest-PublicSharesTest-1667420263-project-member] http://10.27.203.238/share/v2/6d36e1eb1dbc449db6aca75b12a2ba18/shares/84e821d0-2b62-48db-80c7-259f61a14bac returned with HTTP 200 May 28 12:58:52 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 591/1187] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:58:52 2024] GET /share/v2/6d36e1eb1dbc449db6aca75b12a2ba18/shares/84e821d0-2b62-48db-80c7-259f61a14bac => generated 1315 bytes in 23 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:58:52 l75lg1-v1 dstat.sh[49771]: 28-05 12:58:52| 8 1 84 5 0|5727M 1751M 277M 7870M| 30k 13k| 0 6898k| 0 606 |6262 10k|1.00 1.02 1.00|2.0 2.0 0| 0 0 | 0 2048M| 29 360 0 26 0 May 28 12:58:52 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-3b022bc2-6e1d-4e3f-8682-3f251b036909 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.079s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:52 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-3b022bc2-6e1d-4e3f-8682-3f251b036909 tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:52 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-3b022bc2-6e1d-4e3f-8682-3f251b036909 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:52 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-3b022bc2-6e1d-4e3f-8682-3f251b036909 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:52 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-3b022bc2-6e1d-4e3f-8682-3f251b036909 tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:52 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-3b022bc2-6e1d-4e3f-8682-3f251b036909 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:52 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-3b022bc2-6e1d-4e3f-8682-3f251b036909 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.006s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:52 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-3b022bc2-6e1d-4e3f-8682-3f251b036909 tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:52 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-3b022bc2-6e1d-4e3f-8682-3f251b036909 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:52 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-3b022bc2-6e1d-4e3f-8682-3f251b036909 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.005s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:52 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-3b022bc2-6e1d-4e3f-8682-3f251b036909 tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:52 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-3b022bc2-6e1d-4e3f-8682-3f251b036909 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:52 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-3b022bc2-6e1d-4e3f-8682-3f251b036909 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.064s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:52 l75lg1-v1 manila-share[98474]: INFO manila.share.access [None req-3b022bc2-6e1d-4e3f-8682-3f251b036909 tempest-ShareIpRulesForNFSTest-1748669711 None] Access rules were successfully modified for share instance b7a7d61c-2cea-442a-9809-507038e080d5 belonging to share 1ddadc17-cf10-4a42-8bbd-8335fb3520a1. May 28 12:58:52 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-4b180551-58c5-42d4-9de8-bc86bc61d554 tempest-PublicSharesTest-1667420263 None] >>> [GET] https://127.0.0.1:40443/api/vippools/ May 28 12:58:52 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-4b180551-58c5-42d4-9de8-bc86bc61d554 tempest-PublicSharesTest-1667420263 None] {'allow_redirects': True, 'params': {'name': 'vippool-1'}} May 28 12:58:52 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:58:52 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-dd615440-7b6d-484e-a2c9-09e26b6c340b tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] <<< [POST] https://127.0.0.1:40443/api/snapshots/ May 28 12:58:52 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-dd615440-7b6d-484e-a2c9-09e26b6c340b tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Bunch(access_path='/.vast_all_snapshots/1000000011_share-snapshot-5fdc999d-abe8-4e79-a497-bb575e26d5e8', aggr_phys_estimation=0, cluster='loop75-kfs', created='2024-05-28T12:58:49.395321Z', eta_sec=30819898865.40724, expiration_time='3001-01-19T07:59:58Z', guid='fc7eef1d-8506-4ae0-a79e-3ff3cd2aeee9', id=12, indestructible=False, locked=False, name='share-snapshot-5fdc999d-abe8-4e79-a497-bb575e26d5e8', path='/manila/manila-7fdd602c-79d0-479c-95a2-336b202c6639/', policy=None, policy_id=None, protection_policy_id=None, state='SUCCEED', tenant_id=1, tenant_name='default', title='share-snapshot-5fdc999d-abe8-4e79-a497-bb575e26d5e8(/manila/manila-7fdd602c-79d0-479c-95a2-336b202c6639/)', type='local', unique_phys_estimation=0, url='https://127.0.0.1:40443/api/snapshots/12/') May 28 12:58:52 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-dd615440-7b6d-484e-a2c9-09e26b6c340b tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] --- [POST] https://127.0.0.1:40443/api/snapshots/: Done May 28 12:58:52 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-4b180551-58c5-42d4-9de8-bc86bc61d554 tempest-PublicSharesTest-1667420263 None] <<< [GET] https://127.0.0.1:40443/api/vippools/ May 28 12:58:52 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-4b180551-58c5-42d4-9de8-bc86bc61d554 tempest-PublicSharesTest-1667420263 None] [Bunch(active_cnode_ids=[], active_interfaces=4, cluster='loop75-kfs', cluster_id=1, cnode_ids=[], cnodes=[], domain_name='vippool-1', enable_l3=False, enable_weighted_balancing=False, enabled=True, end_ip='172.21.75.4', guid='f2abaede-b397-413a-8faa-3aeead6d3b28', gw_ip='', gw_ipv6='', id=2, ip_ranges=[['172.21.75.1', '172.21.75.4']], name='vippool-1', peer_asn=0, port_membership='ALL', ranges_summary='172.21.75.[1-4]', role='PROTOCOLS', start_ip='172.21.75.1', subnet_cidr=16, subnet_cidr_ipv6=None, sync='SYNCED', sync_time='2024-05-28T12:50:09.644123Z', tenant_id=1, tenant_name='default', title='172.21.75.1 - 172.21.75.4', url='https://127.0.0.1:40443/api/vippools/2/', vast_asn=0, vlan=0, vms_preferred=False)] May 28 12:58:52 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-4b180551-58c5-42d4-9de8-bc86bc61d554 tempest-PublicSharesTest-1667420263 None] --- [GET] https://127.0.0.1:40443/api/vippools/: Done May 28 12:58:52 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-4b180551-58c5-42d4-9de8-bc86bc61d554 tempest-PublicSharesTest-1667420263 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:58:52 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-4b180551-58c5-42d4-9de8-bc86bc61d554 tempest-PublicSharesTest-1667420263 None] {'allow_redirects': True, May 28 12:58:52 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-4b180551-58c5-42d4-9de8-bc86bc61d554 tempest-PublicSharesTest-1667420263 None] 'params': {'name': '834576a8-b0ac-4cc8-a1a0-0067a9513141'}} May 28 12:58:52 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-718c40ab-69d1-4c60-8c92-83fd2cafddc9 tempest-SchedulerStatsAdminTest-1331908757 tempest-SchedulerStatsAdminTest-1331908757-project-admin] http://10.27.203.238/share/v2/e3754ccde0c34ce9a33fe231011c1930/scheduler-stats/pools/detail?share_type=tempest-typeshare-type-640868561 returned with HTTP 200 May 28 12:58:52 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 597/1188] 10.27.203.238 () {64 vars in 1493 bytes} [Tue May 28 12:58:52 2024] GET /share/v2/e3754ccde0c34ce9a33fe231011c1930/scheduler-stats/pools/detail?share_type=tempest-typeshare-type-640868561 => generated 1087 bytes in 513 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:58:52 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-41390593-e89d-496f-af4e-f3a8f964dbef tempest-SchedulerStatsAdminTest-1331908757 tempest-SchedulerStatsAdminTest-1331908757-project-admin] POST http://10.27.203.238/share/v2/e3754ccde0c34ce9a33fe231011c1930/types May 28 12:58:52 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-41390593-e89d-496f-af4e-f3a8f964dbef tempest-SchedulerStatsAdminTest-1331908757 tempest-SchedulerStatsAdminTest-1331908757-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share_type": {"name": "tempest-typeshare-type-1374869134", "extra_specs": {"driver_handles_share_servers": "False"}, "share_type_access:is_public": true}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:58:52 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-41390593-e89d-496f-af4e-f3a8f964dbef tempest-SchedulerStatsAdminTest-1331908757 tempest-SchedulerStatsAdminTest-1331908757-project-admin] http://10.27.203.238/share/v2/e3754ccde0c34ce9a33fe231011c1930/types returned with HTTP 200 May 28 12:58:52 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 592/1189] 10.27.203.238 () {66 vars in 1359 bytes} [Tue May 28 12:58:52 2024] POST /share/v2/e3754ccde0c34ce9a33fe231011c1930/types => generated 623 bytes in 24 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:58:52 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-ca3274d2-f82e-483d-920c-545e082c7291 tempest-SchedulerStatsAdminTest-1331908757 tempest-SchedulerStatsAdminTest-1331908757-project-admin] GET http://10.27.203.238/share/v2/e3754ccde0c34ce9a33fe231011c1930/scheduler-stats/pools/detail?share_type=83b5fc12-8b3d-42b7-8cbf-ca9c4e8471f4 May 28 12:58:52 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-ca3274d2-f82e-483d-920c-545e082c7291 tempest-SchedulerStatsAdminTest-1331908757 tempest-SchedulerStatsAdminTest-1331908757-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:52 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-ca3274d2-f82e-483d-920c-545e082c7291 tempest-SchedulerStatsAdminTest-1331908757 tempest-SchedulerStatsAdminTest-1331908757-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:52 l75lg1-v1 devstack@m-api.service[98330]: INFO oslo_messaging._drivers.amqpdriver [None req-ca3274d2-f82e-483d-920c-545e082c7291 tempest-SchedulerStatsAdminTest-1331908757 tempest-SchedulerStatsAdminTest-1331908757-project-admin] Expecting reply to msg 344f2740b6254d9e91a66cff550d6cdb in queue reply_cde4727073384bdbbe2d3acaf79ae8a7 May 28 12:58:52 l75lg1-v1 devstack@m-api.service[98330]: INFO oslo_messaging._drivers.amqpdriver [-] Received RPC response for msg 344f2740b6254d9e91a66cff550d6cdb May 28 12:58:52 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-26a97202-0bdc-48c2-b1a1-828e0350b6b1 tempest-SharesMetadataTest-1561320255 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:58:52 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-26a97202-0bdc-48c2-b1a1-828e0350b6b1 tempest-SharesMetadataTest-1561320255 None] [Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=0, created='2024-05-28T12:58:39.462843Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='8008607d-98e4-4b37-82a5-195594448cd5', id=31, internal=False, is_s3_default_policy=False, name='922a313f-547d-4129-ae7c-39ae549d3f49', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=[], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['*'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['*'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T12:58:39.929997Z', tenant_id=1, tenant_name='default', title='922a313f-547d-4129-ae7c-39ae549d3f49', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/31/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[])] May 28 12:58:52 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-26a97202-0bdc-48c2-b1a1-828e0350b6b1 tempest-SharesMetadataTest-1561320255 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 12:58:52 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-26a97202-0bdc-48c2-b1a1-828e0350b6b1 tempest-SharesMetadataTest-1561320255 None] >>> [DELETE] https://127.0.0.1:40443/api/viewpolicies/31/ May 28 12:58:52 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-4b180551-58c5-42d4-9de8-bc86bc61d554 tempest-PublicSharesTest-1667420263 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:58:52 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-4b180551-58c5-42d4-9de8-bc86bc61d554 tempest-PublicSharesTest-1667420263 None] [] May 28 12:58:52 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-4b180551-58c5-42d4-9de8-bc86bc61d554 tempest-PublicSharesTest-1667420263 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 12:58:52 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-4b180551-58c5-42d4-9de8-bc86bc61d554 tempest-PublicSharesTest-1667420263 None] >>> [POST] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:58:52 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-4b180551-58c5-42d4-9de8-bc86bc61d554 tempest-PublicSharesTest-1667420263 None] {'data': '{"name": "834576a8-b0ac-4cc8-a1a0-0067a9513141"}', May 28 12:58:52 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-4b180551-58c5-42d4-9de8-bc86bc61d554 tempest-PublicSharesTest-1667420263 None] 'json': None, May 28 12:58:52 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-4b180551-58c5-42d4-9de8-bc86bc61d554 tempest-PublicSharesTest-1667420263 None] 'params': None} May 28 12:58:53 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-ca3274d2-f82e-483d-920c-545e082c7291 tempest-SchedulerStatsAdminTest-1331908757 tempest-SchedulerStatsAdminTest-1331908757-project-admin] http://10.27.203.238/share/v2/e3754ccde0c34ce9a33fe231011c1930/scheduler-stats/pools/detail?share_type=83b5fc12-8b3d-42b7-8cbf-ca9c4e8471f4 returned with HTTP 200 May 28 12:58:53 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 598/1190] 10.27.203.238 () {64 vars in 1501 bytes} [Tue May 28 12:58:52 2024] GET /share/v2/e3754ccde0c34ce9a33fe231011c1930/scheduler-stats/pools/detail?share_type=83b5fc12-8b3d-42b7-8cbf-ca9c4e8471f4 => generated 1085 bytes in 515 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:58:53 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-7eadc726-c073-4966-93d9-fd67f64307ff tempest-SchedulerStatsAdminTest-1331908757 tempest-SchedulerStatsAdminTest-1331908757-project-admin] POST http://10.27.203.238/share/v2/e3754ccde0c34ce9a33fe231011c1930/types May 28 12:58:53 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-7eadc726-c073-4966-93d9-fd67f64307ff tempest-SchedulerStatsAdminTest-1331908757 tempest-SchedulerStatsAdminTest-1331908757-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share_type": {"name": "tempest-typeshare-type-1069759470", "extra_specs": {"driver_handles_share_servers": "False"}, "share_type_access:is_public": true}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:58:53 l75lg1-v1 dstat.sh[49771]: 28-05 12:58:53| 3 1 95 1 0|5727M 1751M 277M 7870M| 28k 6228B| 0 1437k| 0 130 |3486 5347 |1.00 1.02 1.00|2.0 2.0 0| 0 0 | 0 2048M| 29 360 0 26 0 May 28 12:58:53 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-7eadc726-c073-4966-93d9-fd67f64307ff tempest-SchedulerStatsAdminTest-1331908757 tempest-SchedulerStatsAdminTest-1331908757-project-admin] http://10.27.203.238/share/v2/e3754ccde0c34ce9a33fe231011c1930/types returned with HTTP 200 May 28 12:58:53 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 593/1191] 10.27.203.238 () {66 vars in 1359 bytes} [Tue May 28 12:58:53 2024] POST /share/v2/e3754ccde0c34ce9a33fe231011c1930/types => generated 623 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:58:53 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-3993d1ac-3d5b-4ef2-9ac7-2051ad1a53b5 tempest-SchedulerStatsAdminTest-1331908757 tempest-SchedulerStatsAdminTest-1331908757-project-admin] GET http://10.27.203.238/share/v2/e3754ccde0c34ce9a33fe231011c1930/scheduler-stats/pools?share_type=tempest-typeshare-type-1069759470 May 28 12:58:53 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-3993d1ac-3d5b-4ef2-9ac7-2051ad1a53b5 tempest-SchedulerStatsAdminTest-1331908757 tempest-SchedulerStatsAdminTest-1331908757-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:53 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-3993d1ac-3d5b-4ef2-9ac7-2051ad1a53b5 tempest-SchedulerStatsAdminTest-1331908757 tempest-SchedulerStatsAdminTest-1331908757-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:53 l75lg1-v1 devstack@m-api.service[98330]: INFO oslo_messaging._drivers.amqpdriver [None req-3993d1ac-3d5b-4ef2-9ac7-2051ad1a53b5 tempest-SchedulerStatsAdminTest-1331908757 tempest-SchedulerStatsAdminTest-1331908757-project-admin] Expecting reply to msg 4950400617864c8d90d76f45be77caf6 in queue reply_cde4727073384bdbbe2d3acaf79ae8a7 May 28 12:58:53 l75lg1-v1 devstack@m-api.service[98330]: INFO oslo_messaging._drivers.amqpdriver [-] Received RPC response for msg 4950400617864c8d90d76f45be77caf6 May 28 12:58:53 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:58:53 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager.update_available_resource {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:58:53 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Expecting reply to msg 5ce8f7aba48e404f94fa67579c66880d in queue reply_37f4cbd1dd094961a22b8a65f222c327 May 28 12:58:53 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [-] Received RPC response for msg 5ce8f7aba48e404f94fa67579c66880d May 28 12:58:53 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-3993d1ac-3d5b-4ef2-9ac7-2051ad1a53b5 tempest-SchedulerStatsAdminTest-1331908757 tempest-SchedulerStatsAdminTest-1331908757-project-admin] http://10.27.203.238/share/v2/e3754ccde0c34ce9a33fe231011c1930/scheduler-stats/pools?share_type=tempest-typeshare-type-1069759470 returned with HTTP 200 May 28 12:58:53 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 599/1192] 10.27.203.238 () {64 vars in 1474 bytes} [Tue May 28 12:58:53 2024] GET /share/v2/e3754ccde0c34ce9a33fe231011c1930/scheduler-stats/pools?share_type=tempest-typeshare-type-1069759470 => generated 100 bytes in 513 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:58:53 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-57c1d20a-b5d1-45da-9b10-366b82c9a05d tempest-SchedulerStatsAdminTest-1331908757 tempest-SchedulerStatsAdminTest-1331908757-project-admin] POST http://10.27.203.238/share/v2/e3754ccde0c34ce9a33fe231011c1930/types May 28 12:58:53 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-57c1d20a-b5d1-45da-9b10-366b82c9a05d tempest-SchedulerStatsAdminTest-1331908757 tempest-SchedulerStatsAdminTest-1331908757-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share_type": {"name": "tempest-typeshare-type-1039833839", "extra_specs": {"driver_handles_share_servers": "False"}, "share_type_access:is_public": true}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:58:53 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-57c1d20a-b5d1-45da-9b10-366b82c9a05d tempest-SchedulerStatsAdminTest-1331908757 tempest-SchedulerStatsAdminTest-1331908757-project-admin] http://10.27.203.238/share/v2/e3754ccde0c34ce9a33fe231011c1930/types returned with HTTP 200 May 28 12:58:53 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 594/1193] 10.27.203.238 () {66 vars in 1359 bytes} [Tue May 28 12:58:53 2024] POST /share/v2/e3754ccde0c34ce9a33fe231011c1930/types => generated 623 bytes in 27 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:58:53 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-33402e85-a375-45c5-80fe-865752c3118c tempest-SchedulerStatsAdminTest-1331908757 tempest-SchedulerStatsAdminTest-1331908757-project-admin] GET http://10.27.203.238/share/v2/e3754ccde0c34ce9a33fe231011c1930/scheduler-stats/pools?share_type=b9189440-fb1a-4773-b2bf-b984ae0533b2 May 28 12:58:53 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-33402e85-a375-45c5-80fe-865752c3118c tempest-SchedulerStatsAdminTest-1331908757 tempest-SchedulerStatsAdminTest-1331908757-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:53 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-33402e85-a375-45c5-80fe-865752c3118c tempest-SchedulerStatsAdminTest-1331908757 tempest-SchedulerStatsAdminTest-1331908757-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:53 l75lg1-v1 devstack@m-api.service[98330]: INFO oslo_messaging._drivers.amqpdriver [None req-33402e85-a375-45c5-80fe-865752c3118c tempest-SchedulerStatsAdminTest-1331908757 tempest-SchedulerStatsAdminTest-1331908757-project-admin] Expecting reply to msg e130c21637e64ae6ba663125ff8428c9 in queue reply_cde4727073384bdbbe2d3acaf79ae8a7 May 28 12:58:53 l75lg1-v1 devstack@m-api.service[98330]: INFO oslo_messaging._drivers.amqpdriver [-] Received RPC response for msg e130c21637e64ae6ba663125ff8428c9 May 28 12:58:53 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-4b180551-58c5-42d4-9de8-bc86bc61d554 tempest-PublicSharesTest-1667420263 None] <<< [POST] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:58:53 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-4b180551-58c5-42d4-9de8-bc86bc61d554 tempest-PublicSharesTest-1667420263 None] Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=0, created='2024-05-28T12:58:53.513887Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='e77919ef-e33f-42bf-a261-d7992af1d276', id=33, internal=False, is_s3_default_policy=False, name='834576a8-b0ac-4cc8-a1a0-0067a9513141', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=[], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['*'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['*'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T12:58:53.814067Z', tenant_id=1, tenant_name='default', title='834576a8-b0ac-4cc8-a1a0-0067a9513141', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/33/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[]) May 28 12:58:53 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-4b180551-58c5-42d4-9de8-bc86bc61d554 tempest-PublicSharesTest-1667420263 None] --- [POST] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 12:58:53 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-4b180551-58c5-42d4-9de8-bc86bc61d554 tempest-PublicSharesTest-1667420263 None] >>> [GET] https://127.0.0.1:40443/api/quotas/ May 28 12:58:53 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-4b180551-58c5-42d4-9de8-bc86bc61d554 tempest-PublicSharesTest-1667420263 None] {'allow_redirects': True, May 28 12:58:53 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-4b180551-58c5-42d4-9de8-bc86bc61d554 tempest-PublicSharesTest-1667420263 None] 'params': {'name': '834576a8-b0ac-4cc8-a1a0-0067a9513141'}} May 28 12:58:54 l75lg1-v1 nova-compute[83654]: DEBUG oslo_concurrency.lockutils [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=83654) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:54 l75lg1-v1 nova-compute[83654]: DEBUG oslo_concurrency.lockutils [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=83654) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:54 l75lg1-v1 nova-compute[83654]: DEBUG oslo_concurrency.lockutils [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=83654) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:54 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.resource_tracker [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Auditing locally available compute resources for l75lg1-v1 (node: l75lg1-v1) {{(pid=83654) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}} May 28 12:58:54 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.resource_tracker [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Hypervisor/Node resource view: name=l75lg1-v1 free_ram=9897MB free_disk=15.605751037597656GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_01_1", "address": "0000:00:01.1", "product_id": "7010", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7010", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7000", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7000", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "0100", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_0100", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_09_0", "address": "0000:00:09.0", "product_id": "1001", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1001", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "293a", "vendor_id": "8086", "numa_node": null, "label": "label_8086_293a", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_2", "address": "0000:00:07.2", "product_id": "2936", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2936", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "1237", "vendor_id": "8086", "numa_node": null, "label": "label_8086_1237", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "2935", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2935", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "2934", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2934", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_05_0", "address": "0000:00:05.0", "product_id": "1000", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1000", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "1000", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1000", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_06_0", "address": "0000:00:06.0", "product_id": "2668", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2668", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "1000", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1000", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0a_0", "address": "0000:00:0a.0", "product_id": "1002", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1002", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_3", "address": "0000:00:01.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_08_0", "address": "0000:00:08.0", "product_id": "1003", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1003", "dev_type": "type-PCI"}] {{(pid=83654) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}} May 28 12:58:54 l75lg1-v1 nova-compute[83654]: DEBUG oslo_concurrency.lockutils [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=83654) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:54 l75lg1-v1 nova-compute[83654]: DEBUG oslo_concurrency.lockutils [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=83654) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:54 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-4b180551-58c5-42d4-9de8-bc86bc61d554 tempest-PublicSharesTest-1667420263 None] <<< [GET] https://127.0.0.1:40443/api/quotas/ May 28 12:58:54 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-4b180551-58c5-42d4-9de8-bc86bc61d554 tempest-PublicSharesTest-1667420263 None] [] May 28 12:58:54 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-4b180551-58c5-42d4-9de8-bc86bc61d554 tempest-PublicSharesTest-1667420263 None] --- [GET] https://127.0.0.1:40443/api/quotas/: Done May 28 12:58:54 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Expecting reply to msg 4a5a4dc0c2884d9bbde597f32df95521 in queue reply_37f4cbd1dd094961a22b8a65f222c327 May 28 12:58:54 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-4b180551-58c5-42d4-9de8-bc86bc61d554 tempest-PublicSharesTest-1667420263 None] >>> [POST] https://127.0.0.1:40443/api/quotas/ May 28 12:58:54 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-4b180551-58c5-42d4-9de8-bc86bc61d554 tempest-PublicSharesTest-1667420263 None] {'data': '{"name": "834576a8-b0ac-4cc8-a1a0-0067a9513141", "path": ' May 28 12:58:54 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-4b180551-58c5-42d4-9de8-bc86bc61d554 tempest-PublicSharesTest-1667420263 None] '"/manila/manila-834576a8-b0ac-4cc8-a1a0-0067a9513141", "create_dir": ' May 28 12:58:54 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-4b180551-58c5-42d4-9de8-bc86bc61d554 tempest-PublicSharesTest-1667420263 None] 'true, "hard_limit": 1073741824}', May 28 12:58:54 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-4b180551-58c5-42d4-9de8-bc86bc61d554 tempest-PublicSharesTest-1667420263 None] 'json': None, May 28 12:58:54 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-4b180551-58c5-42d4-9de8-bc86bc61d554 tempest-PublicSharesTest-1667420263 None] 'params': None} May 28 12:58:54 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [-] Received RPC response for msg 4a5a4dc0c2884d9bbde597f32df95521 May 28 12:58:54 l75lg1-v1 dstat.sh[49771]: 28-05 12:58:54| 3 1 96 1 0|5727M 1750M 277M 7870M| 21k 3307B| 0 651k| 0 63.9 |3658 6302 |1.00 1.02 1.00| 0 1.0 0| 0 0 | 0 2048M| 29 360 0 26 0 May 28 12:58:54 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-33402e85-a375-45c5-80fe-865752c3118c tempest-SchedulerStatsAdminTest-1331908757 tempest-SchedulerStatsAdminTest-1331908757-project-admin] http://10.27.203.238/share/v2/e3754ccde0c34ce9a33fe231011c1930/scheduler-stats/pools?share_type=b9189440-fb1a-4773-b2bf-b984ae0533b2 returned with HTTP 200 May 28 12:58:54 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 600/1194] 10.27.203.238 () {64 vars in 1480 bytes} [Tue May 28 12:58:53 2024] GET /share/v2/e3754ccde0c34ce9a33fe231011c1930/scheduler-stats/pools?share_type=b9189440-fb1a-4773-b2bf-b984ae0533b2 => generated 100 bytes in 514 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:58:54 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-7f6e70b0-ea93-43f2-a1cc-8928ec174a96 tempest-SchedulerStatsAdminTest-1331908757 tempest-SchedulerStatsAdminTest-1331908757-project-admin] POST http://10.27.203.238/share/v2/e3754ccde0c34ce9a33fe231011c1930/types May 28 12:58:54 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-7f6e70b0-ea93-43f2-a1cc-8928ec174a96 tempest-SchedulerStatsAdminTest-1331908757 tempest-SchedulerStatsAdminTest-1331908757-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share_type": {"name": "tempest-unique_st_name-1455428482", "extra_specs": {"driver_handles_share_servers": "False", "share_backend_name": "tempest-fake_name-1106266534"}, "share_type_access:is_public": true}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:58:54 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-7f6e70b0-ea93-43f2-a1cc-8928ec174a96 tempest-SchedulerStatsAdminTest-1331908757 tempest-SchedulerStatsAdminTest-1331908757-project-admin] http://10.27.203.238/share/v2/e3754ccde0c34ce9a33fe231011c1930/types returned with HTTP 200 May 28 12:58:54 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 595/1195] 10.27.203.238 () {66 vars in 1359 bytes} [Tue May 28 12:58:54 2024] POST /share/v2/e3754ccde0c34ce9a33fe231011c1930/types => generated 731 bytes in 23 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:58:54 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-dcfb543f-f57f-417d-b12b-aea4de41a3e5 tempest-SchedulerStatsAdminTest-1331908757 tempest-SchedulerStatsAdminTest-1331908757-project-admin] GET http://10.27.203.238/share/v2/e3754ccde0c34ce9a33fe231011c1930/scheduler-stats/pools/detail?share_type=tempest-unique_st_name-1455428482 May 28 12:58:54 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-dcfb543f-f57f-417d-b12b-aea4de41a3e5 tempest-SchedulerStatsAdminTest-1331908757 tempest-SchedulerStatsAdminTest-1331908757-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:54 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-dcfb543f-f57f-417d-b12b-aea4de41a3e5 tempest-SchedulerStatsAdminTest-1331908757 tempest-SchedulerStatsAdminTest-1331908757-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:54 l75lg1-v1 devstack@m-api.service[98330]: INFO oslo_messaging._drivers.amqpdriver [None req-dcfb543f-f57f-417d-b12b-aea4de41a3e5 tempest-SchedulerStatsAdminTest-1331908757 tempest-SchedulerStatsAdminTest-1331908757-project-admin] Expecting reply to msg 2178f5f794c745d79a62681604d5d76a in queue reply_cde4727073384bdbbe2d3acaf79ae8a7 May 28 12:58:54 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.utils [None req-dcfb543f-f57f-417d-b12b-aea4de41a3e5 tempest-SchedulerStatsAdminTest-1331908757 None] Share type extra spec requirement "share_backend_name=tempest-fake_name-1106266534" does not match reported capability "vast" {{(pid=98327) capabilities_satisfied /opt/stack/manila/manila/scheduler/utils.py:185}} May 28 12:58:54 l75lg1-v1 devstack@m-api.service[98330]: INFO oslo_messaging._drivers.amqpdriver [-] Received RPC response for msg 2178f5f794c745d79a62681604d5d76a May 28 12:58:54 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-bc4ae2d0-0afd-4485-bf98-8adbdfc7d5cb tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] POST http://10.27.203.238/share/v2/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action May 28 12:58:54 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-bc4ae2d0-0afd-4485-bf98-8adbdfc7d5cb tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Action body: b'{"access_list": null}' {{(pid=98329) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:58:54 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-bc4ae2d0-0afd-4485-bf98-8adbdfc7d5cb tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Action: 'action', calling method: ShareController.access_list, body: {"access_list": null} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:58:54 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-bc4ae2d0-0afd-4485-bf98-8adbdfc7d5cb tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] http://10.27.203.238/share/v2/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action returned with HTTP 200 May 28 12:58:54 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 596/1196] 10.27.203.238 () {66 vars in 1493 bytes} [Tue May 28 12:58:54 2024] POST /share/v2/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action => generated 291 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:58:54 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-26a97202-0bdc-48c2-b1a1-828e0350b6b1 tempest-SharesMetadataTest-1561320255 None] <<< [DELETE] https://127.0.0.1:40443/api/viewpolicies/31/ May 28 12:58:54 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-26a97202-0bdc-48c2-b1a1-828e0350b6b1 tempest-SharesMetadataTest-1561320255 None] --- [DELETE] https://127.0.0.1:40443/api/viewpolicies/31/: Done May 28 12:58:54 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-4ea1ae34-4e30-4b50-863a-cb43593bfedc tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] GET http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/0e9e1ee3-c7cc-4239-bc5b-cace9d44e641 May 28 12:58:54 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-4ea1ae34-4e30-4b50-863a-cb43593bfedc tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:54 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-4ea1ae34-4e30-4b50-863a-cb43593bfedc tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:54 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-4ea1ae34-4e30-4b50-863a-cb43593bfedc tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/0e9e1ee3-c7cc-4239-bc5b-cace9d44e641 returned with HTTP 200 May 28 12:58:54 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 597/1197] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:58:54 2024] GET /share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/0e9e1ee3-c7cc-4239-bc5b-cace9d44e641 => generated 1315 bytes in 27 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:58:54 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-2a6f53f3-f91d-4c67-887f-32835add7dd1 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] POST http://10.27.203.238/share/v2/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action May 28 12:58:54 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-2a6f53f3-f91d-4c67-887f-32835add7dd1 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Action body: b'{"deny_access": {"access_id": "16621ac4-cf71-4da9-8043-0f8e495fe3e2"}}' {{(pid=98329) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:58:54 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-2a6f53f3-f91d-4c67-887f-32835add7dd1 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Action: 'action', calling method: ShareController.deny_access, body: {"deny_access": {"access_id": "16621ac4-cf71-4da9-8043-0f8e495fe3e2"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:58:54 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.lock.api [None req-2a6f53f3-f91d-4c67-887f-32835add7dd1 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Searching for locks by: {'resource_id': '16621ac4-cf71-4da9-8043-0f8e495fe3e2', 'resource_action': 'delete'} {{(pid=98329) get_all /opt/stack/manila/manila/lock/api.py:112}} May 28 12:58:54 l75lg1-v1 devstack@m-api.service[98329]: DEBUG oslo_concurrency.lockutils [None req-2a6f53f3-f91d-4c67-887f-32835add7dd1 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98329) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:54 l75lg1-v1 devstack@m-api.service[98329]: DEBUG oslo_concurrency.lockutils [None req-2a6f53f3-f91d-4c67-887f-32835add7dd1 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98329) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:54 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Expecting reply to msg 11f5b1828c8c4430ab6fb2614be79881 in queue reply_37f4cbd1dd094961a22b8a65f222c327 May 28 12:58:54 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [-] Received RPC response for msg 11f5b1828c8c4430ab6fb2614be79881 May 28 12:58:54 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-26a97202-0bdc-48c2-b1a1-828e0350b6b1 tempest-SharesMetadataTest-1561320255 None] Created reservations ['83644bbc-91f3-45c0-a7a3-e48e86178050', '6898fc5d-b412-4571-8878-586792711b58', '28a911be-3eec-48b8-a77d-d68f0eb1247a', '6e9d2493-fd94-41dd-9b9d-db79046251d8'] {{(pid=98474) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 12:58:54 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-26a97202-0bdc-48c2-b1a1-828e0350b6b1 tempest-SharesMetadataTest-1561320255 None] Committed reservations ['83644bbc-91f3-45c0-a7a3-e48e86178050', '6898fc5d-b412-4571-8878-586792711b58', '28a911be-3eec-48b8-a77d-d68f0eb1247a', '6e9d2493-fd94-41dd-9b9d-db79046251d8'] {{(pid=98474) commit /opt/stack/manila/manila/quota.py:1063}} May 28 12:58:54 l75lg1-v1 devstack@m-api.service[98329]: DEBUG oslo_concurrency.lockutils [None req-2a6f53f3-f91d-4c67-887f-32835add7dd1 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.051s {{(pid=98329) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:54 l75lg1-v1 devstack@m-api.service[98329]: DEBUG oslo_concurrency.lockutils [None req-2a6f53f3-f91d-4c67-887f-32835add7dd1 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98329) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:54 l75lg1-v1 devstack@m-api.service[98329]: DEBUG oslo_concurrency.lockutils [None req-2a6f53f3-f91d-4c67-887f-32835add7dd1 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98329) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:54 l75lg1-v1 manila-share[98474]: INFO manila.share.manager [None req-26a97202-0bdc-48c2-b1a1-828e0350b6b1 tempest-SharesMetadataTest-1561320255 None] Share instance 922a313f-547d-4129-ae7c-39ae549d3f49: deleted successfully. May 28 12:58:54 l75lg1-v1 devstack@m-api.service[98329]: DEBUG oslo_concurrency.lockutils [None req-2a6f53f3-f91d-4c67-887f-32835add7dd1 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.062s {{(pid=98329) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:54 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-2a6f53f3-f91d-4c67-887f-32835add7dd1 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] http://10.27.203.238/share/v2/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action returned with HTTP 202 May 28 12:58:54 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 598/1198] 10.27.203.238 () {66 vars in 1493 bytes} [Tue May 28 12:58:54 2024] POST /share/v2/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action => generated 0 bytes in 201 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:58:54 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-3a87ce26-dace-4830-bfe5-a1b37a6e2b3b tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] GET http://10.27.203.238/share/v2/776f75906bc64f8f9316d5aab4b50bf1/share-access-rules?share_id=1ddadc17-cf10-4a42-8bbd-8335fb3520a1 May 28 12:58:54 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-3a87ce26-dace-4830-bfe5-a1b37a6e2b3b tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:54 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-3a87ce26-dace-4830-bfe5-a1b37a6e2b3b tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:54 l75lg1-v1 manila-share[98474]: DEBUG manila.share.manager [None req-2a6f53f3-f91d-4c67-887f-32835add7dd1 tempest-ShareIpRulesForNFSTest-1748669711 None] Received request to update access for share instance b7a7d61c-2cea-442a-9809-507038e080d5. {{(pid=98474) update_access_for_instances /opt/stack/manila/manila/share/manager.py:4353}} May 28 12:58:54 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.lock.api [None req-3a87ce26-dace-4830-bfe5-a1b37a6e2b3b tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Searching for locks by: {'resource_id': '16621ac4-cf71-4da9-8043-0f8e495fe3e2', 'resource_action': 'show', 'resource_type': 'access_rule'} {{(pid=98329) get_all /opt/stack/manila/manila/lock/api.py:112}} May 28 12:58:54 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-3a87ce26-dace-4830-bfe5-a1b37a6e2b3b tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] http://10.27.203.238/share/v2/776f75906bc64f8f9316d5aab4b50bf1/share-access-rules?share_id=1ddadc17-cf10-4a42-8bbd-8335fb3520a1 returned with HTTP 200 May 28 12:58:54 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 599/1199] 10.27.203.238 () {64 vars in 1467 bytes} [Tue May 28 12:58:54 2024] GET /share/v2/776f75906bc64f8f9316d5aab4b50bf1/share-access-rules?share_id=1ddadc17-cf10-4a42-8bbd-8335fb3520a1 => generated 315 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 231 bytes (2 switches on core 0) May 28 12:58:54 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-2a6f53f3-f91d-4c67-887f-32835add7dd1 tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:54 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-2a6f53f3-f91d-4c67-887f-32835add7dd1 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:54 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-2a6f53f3-f91d-4c67-887f-32835add7dd1 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:54 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-2a6f53f3-f91d-4c67-887f-32835add7dd1 tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:54 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-2a6f53f3-f91d-4c67-887f-32835add7dd1 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:54 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-dcfb543f-f57f-417d-b12b-aea4de41a3e5 tempest-SchedulerStatsAdminTest-1331908757 tempest-SchedulerStatsAdminTest-1331908757-project-admin] http://10.27.203.238/share/v2/e3754ccde0c34ce9a33fe231011c1930/scheduler-stats/pools/detail?share_type=tempest-unique_st_name-1455428482 returned with HTTP 200 May 28 12:58:54 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 601/1200] 10.27.203.238 () {64 vars in 1495 bytes} [Tue May 28 12:58:54 2024] GET /share/v2/e3754ccde0c34ce9a33fe231011c1930/scheduler-stats/pools/detail?share_type=tempest-unique_st_name-1455428482 => generated 13 bytes in 513 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:58:54 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-edce85e8-6c69-4a0f-95e4-bb466011be2c tempest-SchedulerStatsAdminTest-1331908757 tempest-SchedulerStatsAdminTest-1331908757-project-admin] POST http://10.27.203.238/share/v2/e3754ccde0c34ce9a33fe231011c1930/types May 28 12:58:54 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-edce85e8-6c69-4a0f-95e4-bb466011be2c tempest-SchedulerStatsAdminTest-1331908757 tempest-SchedulerStatsAdminTest-1331908757-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share_type": {"name": "tempest-unique_st_name-2077444972", "extra_specs": {"driver_handles_share_servers": "False", "share_backend_name": "tempest-fake_name-1434482569"}, "share_type_access:is_public": true}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:58:54 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-edce85e8-6c69-4a0f-95e4-bb466011be2c tempest-SchedulerStatsAdminTest-1331908757 tempest-SchedulerStatsAdminTest-1331908757-project-admin] http://10.27.203.238/share/v2/e3754ccde0c34ce9a33fe231011c1930/types returned with HTTP 200 May 28 12:58:54 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 600/1201] 10.27.203.238 () {66 vars in 1359 bytes} [Tue May 28 12:58:54 2024] POST /share/v2/e3754ccde0c34ce9a33fe231011c1930/types => generated 731 bytes in 27 msecs (HTTP/1.1 200) 6 headers in 231 bytes (2 switches on core 0) May 28 12:58:54 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-2a6f53f3-f91d-4c67-887f-32835add7dd1 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.070s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:54 l75lg1-v1 manila-share[98474]: DEBUG manila.share.access [None req-2a6f53f3-f91d-4c67-887f-32835add7dd1 tempest-ShareIpRulesForNFSTest-1748669711 None] Updating access rules for share instance b7a7d61c-2cea-442a-9809-507038e080d5 belonging to share 1ddadc17-cf10-4a42-8bbd-8335fb3520a1. {{(pid=98474) update_access_rules /opt/stack/manila/manila/share/access.py:298}} May 28 12:58:54 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-66442e13-0b3c-473d-9466-474aa6d7d6e7 tempest-SchedulerStatsAdminTest-1331908757 tempest-SchedulerStatsAdminTest-1331908757-project-admin] GET http://10.27.203.238/share/v2/e3754ccde0c34ce9a33fe231011c1930/scheduler-stats/pools/detail?share_type=8d1107fc-a987-4450-befa-063bbc1e072b May 28 12:58:54 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-66442e13-0b3c-473d-9466-474aa6d7d6e7 tempest-SchedulerStatsAdminTest-1331908757 tempest-SchedulerStatsAdminTest-1331908757-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:54 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-66442e13-0b3c-473d-9466-474aa6d7d6e7 tempest-SchedulerStatsAdminTest-1331908757 tempest-SchedulerStatsAdminTest-1331908757-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:54 l75lg1-v1 devstack@m-api.service[98330]: INFO oslo_messaging._drivers.amqpdriver [None req-66442e13-0b3c-473d-9466-474aa6d7d6e7 tempest-SchedulerStatsAdminTest-1331908757 tempest-SchedulerStatsAdminTest-1331908757-project-admin] Expecting reply to msg b2803aef1b444eefa1d1e5f76d091640 in queue reply_cde4727073384bdbbe2d3acaf79ae8a7 May 28 12:58:54 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.utils [None req-66442e13-0b3c-473d-9466-474aa6d7d6e7 tempest-SchedulerStatsAdminTest-1331908757 None] Share type extra spec requirement "share_backend_name=tempest-fake_name-1434482569" does not match reported capability "vast" {{(pid=98327) capabilities_satisfied /opt/stack/manila/manila/scheduler/utils.py:185}} May 28 12:58:54 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-f654799a-be55-4e07-a20d-2685e977f142 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] GET http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/snapshots/0fba4486-6341-49ab-a9dc-333609ce1d2e May 28 12:58:54 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-f654799a-be55-4e07-a20d-2685e977f142 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:54 l75lg1-v1 devstack@m-api.service[98330]: INFO oslo_messaging._drivers.amqpdriver [-] Received RPC response for msg b2803aef1b444eefa1d1e5f76d091640 May 28 12:58:54 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-f654799a-be55-4e07-a20d-2685e977f142 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Calling method 'ShareSnapshotMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:54 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-2a6f53f3-f91d-4c67-887f-32835add7dd1 tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:54 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-2a6f53f3-f91d-4c67-887f-32835add7dd1 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:54 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-2a6f53f3-f91d-4c67-887f-32835add7dd1 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.008s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:54 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-2a6f53f3-f91d-4c67-887f-32835add7dd1 tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:54 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-2a6f53f3-f91d-4c67-887f-32835add7dd1 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:54 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-f654799a-be55-4e07-a20d-2685e977f142 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/snapshots/0fba4486-6341-49ab-a9dc-333609ce1d2e returned with HTTP 200 May 28 12:58:54 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 601/1202] 10.27.203.238 () {64 vars in 1460 bytes} [Tue May 28 12:58:54 2024] GET /share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/snapshots/0fba4486-6341-49ab-a9dc-333609ce1d2e => generated 723 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:58:54 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-2a6f53f3-f91d-4c67-887f-32835add7dd1 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.015s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:54 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-2a6f53f3-f91d-4c67-887f-32835add7dd1 tempest-ShareIpRulesForNFSTest-1748669711 None] changing access on None May 28 12:58:54 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2a6f53f3-f91d-4c67-887f-32835add7dd1 tempest-ShareIpRulesForNFSTest-1748669711 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:58:54 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2a6f53f3-f91d-4c67-887f-32835add7dd1 tempest-ShareIpRulesForNFSTest-1748669711 None] {'allow_redirects': True, May 28 12:58:54 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2a6f53f3-f91d-4c67-887f-32835add7dd1 tempest-ShareIpRulesForNFSTest-1748669711 None] 'params': {'name': 'b7a7d61c-2cea-442a-9809-507038e080d5'}} May 28 12:58:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f134762c-c7a3-48be-9157-6dc14b5be07b None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-f134762c-c7a3-48be-9157-6dc14b5be07b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:58:55 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f134762c-c7a3-48be-9157-6dc14b5be07b None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:55 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a8a941-d1d3-46c8-8156-7b50d8eba1a4 tempest-ShareIpRulesForNFSNegativeTest-700172924 tempest-ShareIpRulesForNFSNegativeTest-700172924-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7640802a4c39457089742b080e6c98b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f81d1d8d7c946e8aa46d6e3e510424c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:55 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a8a941-d1d3-46c8-8156-7b50d8eba1a4 tempest-ShareIpRulesForNFSNegativeTest-700172924 tempest-ShareIpRulesForNFSNegativeTest-700172924-project-admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:55 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a8a941-d1d3-46c8-8156-7b50d8eba1a4 tempest-ShareIpRulesForNFSNegativeTest-700172924 tempest-ShareIpRulesForNFSNegativeTest-700172924-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:55 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a8a941-d1d3-46c8-8156-7b50d8eba1a4 tempest-ShareIpRulesForNFSNegativeTest-700172924 tempest-ShareIpRulesForNFSNegativeTest-700172924-project-admin] PATH_INFO: `/v3/projects/7890e9d8a78c49a0bb9af26ec5dd4646` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:55 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a8a941-d1d3-46c8-8156-7b50d8eba1a4 tempest-ShareIpRulesForNFSNegativeTest-700172924 tempest-ShareIpRulesForNFSNegativeTest-700172924-project-admin] RBAC: Authorizing `identity:get_project(project_id=7890e9d8a78c49a0bb9af26ec5dd4646)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:55 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a8a941-d1d3-46c8-8156-7b50d8eba1a4 tempest-ShareIpRulesForNFSNegativeTest-700172924 tempest-ShareIpRulesForNFSNegativeTest-700172924-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:55 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1162/2300] 10.27.203.238 () {62 vars in 1318 bytes} [Tue May 28 12:58:54 2024] GET /identity/v3/projects/7890e9d8a78c49a0bb9af26ec5dd4646 => generated 399 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:58:55 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272c8704-0218-4465-81c8-3db6aa886454 service manila] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:55 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272c8704-0218-4465-81c8-3db6aa886454 service manila] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:55 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd99a4b-6f68-4776-811c-13b89005382f tempest-ShareIpRulesForNFSNegativeTest-700172924 tempest-ShareIpRulesForNFSNegativeTest-700172924-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7640802a4c39457089742b080e6c98b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f81d1d8d7c946e8aa46d6e3e510424c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:55 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd99a4b-6f68-4776-811c-13b89005382f tempest-ShareIpRulesForNFSNegativeTest-700172924 tempest-ShareIpRulesForNFSNegativeTest-700172924-project-admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:55 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd99a4b-6f68-4776-811c-13b89005382f tempest-ShareIpRulesForNFSNegativeTest-700172924 tempest-ShareIpRulesForNFSNegativeTest-700172924-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:55 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd99a4b-6f68-4776-811c-13b89005382f tempest-ShareIpRulesForNFSNegativeTest-700172924 tempest-ShareIpRulesForNFSNegativeTest-700172924-project-admin] PATH_INFO: `/v3/domains` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:55 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd99a4b-6f68-4776-811c-13b89005382f tempest-ShareIpRulesForNFSNegativeTest-700172924 tempest-ShareIpRulesForNFSNegativeTest-700172924-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:58:55 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd99a4b-6f68-4776-811c-13b89005382f tempest-ShareIpRulesForNFSNegativeTest-700172924 tempest-ShareIpRulesForNFSNegativeTest-700172924-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:55 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd99a4b-6f68-4776-811c-13b89005382f tempest-ShareIpRulesForNFSNegativeTest-700172924 tempest-ShareIpRulesForNFSNegativeTest-700172924-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:55 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1139/2301] 10.27.203.238 () {62 vars in 1241 bytes} [Tue May 28 12:58:55 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 19 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:58:55 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-4b180551-58c5-42d4-9de8-bc86bc61d554 tempest-PublicSharesTest-1667420263 None] <<< [POST] https://127.0.0.1:40443/api/quotas/ May 28 12:58:55 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-4b180551-58c5-42d4-9de8-bc86bc61d554 tempest-PublicSharesTest-1667420263 None] Bunch(cluster='loop75-kfs', cluster_id=1, default_email=None, default_group_quota=None, default_user_quota=None, enable_alarms=True, enable_email_providers=True, grace_period=None, group_quotas=[], guid='cf7c19c2-ff7e-406b-a41a-cde4538ee6ba', hard_limit=1073741824, hard_limit_inodes=None, id=30, internal=False, is_user_quota=False, last_user_quotas_update=None, name='834576a8-b0ac-4cc8-a1a0-0067a9513141', num_blocked_users=0, num_exceeded_users=0, path='/manila/manila-834576a8-b0ac-4cc8-a1a0-0067a9513141', percent_capacity=0, percent_inodes=None, pretty_grace_period=None, pretty_grace_period_expiration=None, pretty_state='OK (CREATED)', soft_limit=None, soft_limit_inodes=None, state='OK', sync_state='CREATED', system_id=30, tenant_id=1, tenant_name='default', time_to_block=None, title='834576a8-b0ac-4cc8-a1a0-0067a9513141', url='https://127.0.0.1:40443/api/quotas/30/', used_capacity=0, used_capacity_tb=0.0, used_effective_capacity=0, used_effective_capacity_tb=0.0, used_inodes=0, used_limited_capacity=0, user_quotas=[]) May 28 12:58:55 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-4b180551-58c5-42d4-9de8-bc86bc61d554 tempest-PublicSharesTest-1667420263 None] --- [POST] https://127.0.0.1:40443/api/quotas/: Done May 28 12:58:55 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-4b180551-58c5-42d4-9de8-bc86bc61d554 tempest-PublicSharesTest-1667420263 None] >>> [GET] https://127.0.0.1:40443/api/views/ May 28 12:58:55 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-4b180551-58c5-42d4-9de8-bc86bc61d554 tempest-PublicSharesTest-1667420263 None] {'allow_redirects': True, May 28 12:58:55 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-4b180551-58c5-42d4-9de8-bc86bc61d554 tempest-PublicSharesTest-1667420263 None] 'params': {'name': '834576a8-b0ac-4cc8-a1a0-0067a9513141'}} May 28 12:58:55 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a8a941-d1d3-46c8-8156-7b50d8eba1a4 tempest-ShareIpRulesForNFSNegativeTest-700172924 tempest-ShareIpRulesForNFSNegativeTest-700172924-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:55 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a8a941-d1d3-46c8-8156-7b50d8eba1a4 tempest-ShareIpRulesForNFSNegativeTest-700172924 tempest-ShareIpRulesForNFSNegativeTest-700172924-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:55 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfef2b6-637b-44d6-921c-a7bd5941f067 tempest-ShareIpRulesForNFSNegativeTest-700172924 tempest-ShareIpRulesForNFSNegativeTest-700172924-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7640802a4c39457089742b080e6c98b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f81d1d8d7c946e8aa46d6e3e510424c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:55 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfef2b6-637b-44d6-921c-a7bd5941f067 tempest-ShareIpRulesForNFSNegativeTest-700172924 tempest-ShareIpRulesForNFSNegativeTest-700172924-project-admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:55 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfef2b6-637b-44d6-921c-a7bd5941f067 tempest-ShareIpRulesForNFSNegativeTest-700172924 tempest-ShareIpRulesForNFSNegativeTest-700172924-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:55 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfef2b6-637b-44d6-921c-a7bd5941f067 tempest-ShareIpRulesForNFSNegativeTest-700172924 tempest-ShareIpRulesForNFSNegativeTest-700172924-project-admin] PATH_INFO: `/v3/users` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:55 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfef2b6-637b-44d6-921c-a7bd5941f067 tempest-ShareIpRulesForNFSNegativeTest-700172924 tempest-ShareIpRulesForNFSNegativeTest-700172924-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:55 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfef2b6-637b-44d6-921c-a7bd5941f067 tempest-ShareIpRulesForNFSNegativeTest-700172924 tempest-ShareIpRulesForNFSNegativeTest-700172924-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:55 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-dcfef2b6-637b-44d6-921c-a7bd5941f067 tempest-ShareIpRulesForNFSNegativeTest-700172924 tempest-ShareIpRulesForNFSNegativeTest-700172924-project-admin] Truncating password to algorithm specific maximum length 72 characters. May 28 12:58:55 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1163/2302] 10.27.203.238 () {64 vars in 1232 bytes} [Tue May 28 12:58:55 2024] POST /identity/v3/users => generated 435 bytes in 36 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:58:55 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd99a4b-6f68-4776-811c-13b89005382f tempest-ShareIpRulesForNFSNegativeTest-700172924 tempest-ShareIpRulesForNFSNegativeTest-700172924-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:55 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd99a4b-6f68-4776-811c-13b89005382f tempest-ShareIpRulesForNFSNegativeTest-700172924 tempest-ShareIpRulesForNFSNegativeTest-700172924-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:55 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b361c3b7-485b-4a58-b0ae-9564b1a415e2 tempest-ShareIpRulesForNFSNegativeTest-700172924 tempest-ShareIpRulesForNFSNegativeTest-700172924-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7640802a4c39457089742b080e6c98b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f81d1d8d7c946e8aa46d6e3e510424c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:55 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b361c3b7-485b-4a58-b0ae-9564b1a415e2 tempest-ShareIpRulesForNFSNegativeTest-700172924 tempest-ShareIpRulesForNFSNegativeTest-700172924-project-admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:55 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b361c3b7-485b-4a58-b0ae-9564b1a415e2 tempest-ShareIpRulesForNFSNegativeTest-700172924 tempest-ShareIpRulesForNFSNegativeTest-700172924-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:55 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b361c3b7-485b-4a58-b0ae-9564b1a415e2 tempest-ShareIpRulesForNFSNegativeTest-700172924 tempest-ShareIpRulesForNFSNegativeTest-700172924-project-admin] PATH_INFO: `/v3/roles` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:55 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b361c3b7-485b-4a58-b0ae-9564b1a415e2 tempest-ShareIpRulesForNFSNegativeTest-700172924 tempest-ShareIpRulesForNFSNegativeTest-700172924-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:55 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b361c3b7-485b-4a58-b0ae-9564b1a415e2 tempest-ShareIpRulesForNFSNegativeTest-700172924 tempest-ShareIpRulesForNFSNegativeTest-700172924-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:55 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1140/2303] 10.27.203.238 () {62 vars in 1210 bytes} [Tue May 28 12:58:55 2024] GET /identity/v3/roles => generated 1680 bytes in 17 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:58:55 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfef2b6-637b-44d6-921c-a7bd5941f067 tempest-ShareIpRulesForNFSNegativeTest-700172924 tempest-ShareIpRulesForNFSNegativeTest-700172924-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:55 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfef2b6-637b-44d6-921c-a7bd5941f067 tempest-ShareIpRulesForNFSNegativeTest-700172924 tempest-ShareIpRulesForNFSNegativeTest-700172924-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:55 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4233b7dc-f786-4e9a-a4de-3ea6217e7bcb tempest-ShareIpRulesForNFSNegativeTest-700172924 tempest-ShareIpRulesForNFSNegativeTest-700172924-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7640802a4c39457089742b080e6c98b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f81d1d8d7c946e8aa46d6e3e510424c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:55 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4233b7dc-f786-4e9a-a4de-3ea6217e7bcb tempest-ShareIpRulesForNFSNegativeTest-700172924 tempest-ShareIpRulesForNFSNegativeTest-700172924-project-admin] REQUEST_METHOD: `PUT` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:55 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4233b7dc-f786-4e9a-a4de-3ea6217e7bcb tempest-ShareIpRulesForNFSNegativeTest-700172924 tempest-ShareIpRulesForNFSNegativeTest-700172924-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:55 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4233b7dc-f786-4e9a-a4de-3ea6217e7bcb tempest-ShareIpRulesForNFSNegativeTest-700172924 tempest-ShareIpRulesForNFSNegativeTest-700172924-project-admin] PATH_INFO: `/v3/projects/7890e9d8a78c49a0bb9af26ec5dd4646/users/db0396a316ea4c5697d47df053fccbe4/roles/44620cad10ae407c90c91e2c296adb04` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:55 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4233b7dc-f786-4e9a-a4de-3ea6217e7bcb tempest-ShareIpRulesForNFSNegativeTest-700172924 tempest-ShareIpRulesForNFSNegativeTest-700172924-project-admin] RBAC: Authorizing `identity:create_grant(project_id=7890e9d8a78c49a0bb9af26ec5dd4646, user_id=db0396a316ea4c5697d47df053fccbe4, role_id=44620cad10ae407c90c91e2c296adb04)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:55 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4233b7dc-f786-4e9a-a4de-3ea6217e7bcb tempest-ShareIpRulesForNFSNegativeTest-700172924 tempest-ShareIpRulesForNFSNegativeTest-700172924-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:55 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1164/2304] 10.27.203.238 () {64 vars in 1571 bytes} [Tue May 28 12:58:55 2024] PUT /identity/v3/projects/7890e9d8a78c49a0bb9af26ec5dd4646/users/db0396a316ea4c5697d47df053fccbe4/roles/44620cad10ae407c90c91e2c296adb04 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:58:55 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-fd4e7f21-9ca8-4154-a280-eb93b6955427 tempest-ShareIpRulesForNFSNegativeTest-700172924 tempest-ShareIpRulesForNFSNegativeTest-700172924-project-admin] POST http://10.27.203.238/share/v2/8f81d1d8d7c946e8aa46d6e3e510424c/types May 28 12:58:55 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-fd4e7f21-9ca8-4154-a280-eb93b6955427 tempest-ShareIpRulesForNFSNegativeTest-700172924 tempest-ShareIpRulesForNFSNegativeTest-700172924-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share_type": {"name": "invalid_backend", "extra_specs": {"driver_handles_share_servers": "False", "share_backend_name": "invalid_backend"}, "share_type_access:is_public": true}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:58:55 l75lg1-v1 devstack@placement-api.service[78202]: DEBUG placement.requestlog [req-d0aa2c11-e031-4ff5-be1e-328348e40e71 req-26c08e7e-ee24-4a74-9b1b-40118ef5070a None None] Starting request: 10.27.203.238 "GET /placement/resource_providers/ef90d7d1-0808-4a15-ad77-f9a7391af2f4/allocations" {{(pid=78202) __call__ /opt/stack/placement/placement/requestlog.py:55}} May 28 12:58:55 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-fd4e7f21-9ca8-4154-a280-eb93b6955427 tempest-ShareIpRulesForNFSNegativeTest-700172924 tempest-ShareIpRulesForNFSNegativeTest-700172924-project-admin] http://10.27.203.238/share/v2/8f81d1d8d7c946e8aa46d6e3e510424c/types returned with HTTP 200 May 28 12:58:55 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 602/1203] 10.27.203.238 () {66 vars in 1359 bytes} [Tue May 28 12:58:55 2024] POST /share/v2/8f81d1d8d7c946e8aa46d6e3e510424c/types => generated 669 bytes in 24 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:58:55 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-6b307f8a-6c3e-4b75-86c1-674131a95acf tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] POST http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares May 28 12:58:55 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-6b307f8a-6c3e-4b75-86c1-674131a95acf tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share": {"share_proto": "nfs", "description": "Tempest's share", "snapshot_id": null, "name": "tempest-tempest-created-share-1977361109", "size": 1, "metadata": {}, "is_public": false, "share_type": "a6882835-6452-4e9f-ae9f-1b59f9974de9"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:58:55 l75lg1-v1 devstack@placement-api.service[78202]: INFO placement.requestlog [req-d0aa2c11-e031-4ff5-be1e-328348e40e71 req-26c08e7e-ee24-4a74-9b1b-40118ef5070a service placement] 10.27.203.238 "GET /placement/resource_providers/ef90d7d1-0808-4a15-ad77-f9a7391af2f4/allocations" status: 200 len: 54 microversion: 1.0 May 28 12:58:55 l75lg1-v1 devstack@placement-api.service[78202]: [pid: 78202|app: 0|req: 24/47] 10.27.203.238 () {62 vars in 1480 bytes} [Tue May 28 12:58:55 2024] GET /placement/resource_providers/ef90d7d1-0808-4a15-ad77-f9a7391af2f4/allocations => generated 54 bytes in 13 msecs (HTTP/1.1 200) 6 headers in 223 bytes (1 switches on core 0) May 28 12:58:55 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.v1.shares [None req-6b307f8a-6c3e-4b75-86c1-674131a95acf tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Create NFS share of 1 GB May 28 12:58:55 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.resource_tracker [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Total usable vcpus: 10, total allocated vcpus: 0 {{(pid=83654) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}} May 28 12:58:55 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.resource_tracker [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Final resource view: name=l75lg1-v1 phys_ram=16000MB used_ram=512MB phys_disk=28GB used_disk=0GB total_vcpus=10 used_vcpus=0 pci_stats=[] {{(pid=83654) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}} May 28 12:58:55 l75lg1-v1 devstack@placement-api.service[78201]: DEBUG placement.requestlog [req-d0aa2c11-e031-4ff5-be1e-328348e40e71 req-e6fa2c9c-7f28-4e33-86f8-061dec605fe8 None None] Starting request: 10.27.203.238 "GET /placement/resource_providers/ef90d7d1-0808-4a15-ad77-f9a7391af2f4/allocations" {{(pid=78201) __call__ /opt/stack/placement/placement/requestlog.py:55}} May 28 12:58:55 l75lg1-v1 devstack@placement-api.service[78201]: INFO placement.requestlog [req-d0aa2c11-e031-4ff5-be1e-328348e40e71 req-e6fa2c9c-7f28-4e33-86f8-061dec605fe8 service placement] 10.27.203.238 "GET /placement/resource_providers/ef90d7d1-0808-4a15-ad77-f9a7391af2f4/allocations" status: 200 len: 54 microversion: 1.0 May 28 12:58:55 l75lg1-v1 devstack@placement-api.service[78201]: [pid: 78201|app: 0|req: 24/48] 10.27.203.238 () {62 vars in 1480 bytes} [Tue May 28 12:58:55 2024] GET /placement/resource_providers/ef90d7d1-0808-4a15-ad77-f9a7391af2f4/allocations => generated 54 bytes in 14 msecs (HTTP/1.1 200) 6 headers in 223 bytes (1 switches on core 0) May 28 12:58:55 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.provider_tree [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Inventory has not changed in ProviderTree for provider: ef90d7d1-0808-4a15-ad77-f9a7391af2f4 {{(pid=83654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} May 28 12:58:55 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Expecting reply to msg cdf07c62c76b452a81a0a7c07570b234 in queue reply_37f4cbd1dd094961a22b8a65f222c327 May 28 12:58:55 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [-] Received RPC response for msg cdf07c62c76b452a81a0a7c07570b234 May 28 12:58:55 l75lg1-v1 dstat.sh[49771]: 28-05 12:58:55| 11 1 85 2 0|5728M 1750M 277M 7870M| 17k 5138B| 0 1412k| 0 210 |6100 9950 |1.00 1.02 1.00| 0 2.0 0| 0 0 | 0 2048M| 29 362 0 26 0 May 28 12:58:55 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.quota [None req-6b307f8a-6c3e-4b75-86c1-674131a95acf tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Created reservations ['fc497d43-6a31-416c-bbdf-6edbc216bd3e', 'e194f4bb-0d11-4be5-aebe-2b50515f934a', '6483e8cf-cded-440f-b356-07ebd5c1e299', 'aa1648f4-c1f1-435c-a17a-43da9f639477'] {{(pid=98329) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 12:58:55 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.quota [None req-6b307f8a-6c3e-4b75-86c1-674131a95acf tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Committed reservations ['fc497d43-6a31-416c-bbdf-6edbc216bd3e', 'e194f4bb-0d11-4be5-aebe-2b50515f934a', '6483e8cf-cded-440f-b356-07ebd5c1e299', 'aa1648f4-c1f1-435c-a17a-43da9f639477'] {{(pid=98329) commit /opt/stack/manila/manila/quota.py:1063}} May 28 12:58:55 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-66442e13-0b3c-473d-9466-474aa6d7d6e7 tempest-SchedulerStatsAdminTest-1331908757 tempest-SchedulerStatsAdminTest-1331908757-project-admin] http://10.27.203.238/share/v2/e3754ccde0c34ce9a33fe231011c1930/scheduler-stats/pools/detail?share_type=8d1107fc-a987-4450-befa-063bbc1e072b returned with HTTP 200 May 28 12:58:55 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 602/1204] 10.27.203.238 () {64 vars in 1501 bytes} [Tue May 28 12:58:54 2024] GET /share/v2/e3754ccde0c34ce9a33fe231011c1930/scheduler-stats/pools/detail?share_type=8d1107fc-a987-4450-befa-063bbc1e072b => generated 13 bytes in 515 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:58:55 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.host_manager [None req-6b307f8a-6c3e-4b75-86c1-674131a95acf tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Share service is down. (host: l75lg1-v1@generic2). May 28 12:58:55 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.host_manager [None req-6b307f8a-6c3e-4b75-86c1-674131a95acf tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Share service is down. (host: l75lg1-v1@generic1). May 28 12:58:55 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-6b307f8a-6c3e-4b75-86c1-674131a95acf tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Starting with 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:80}} May 28 12:58:55 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-4e9bddfb-f8a5-473a-9f83-417204981a47 tempest-PublicSharesTest-1667420263 tempest-PublicSharesTest-1667420263-project-member] GET http://10.27.203.238/share/v2/6d36e1eb1dbc449db6aca75b12a2ba18/shares/84e821d0-2b62-48db-80c7-259f61a14bac May 28 12:58:55 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-4e9bddfb-f8a5-473a-9f83-417204981a47 tempest-PublicSharesTest-1667420263 tempest-PublicSharesTest-1667420263-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:55 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-4e9bddfb-f8a5-473a-9f83-417204981a47 tempest-PublicSharesTest-1667420263 tempest-PublicSharesTest-1667420263-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:55 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-6b307f8a-6c3e-4b75-86c1-674131a95acf tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Filter OnlyHostFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:58:55 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-6b307f8a-6c3e-4b75-86c1-674131a95acf tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:58:55 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.capacity [None req-6b307f8a-6c3e-4b75-86c1-674131a95acf tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Space information for share creation on host l75lg1-v1@vast#vast (requested / avail): 1/2081 {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/capacity.py:83}} May 28 12:58:55 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-6b307f8a-6c3e-4b75-86c1-674131a95acf tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Filter CapacityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:58:55 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.utils [None req-6b307f8a-6c3e-4b75-86c1-674131a95acf tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Share type extra spec requirement "share_backend_name=invalid_backend" does not match reported capability "vast" {{(pid=98327) capabilities_satisfied /opt/stack/manila/manila/scheduler/utils.py:185}} May 28 12:58:55 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.capabilities [None req-6b307f8a-6c3e-4b75-86c1-674131a95acf tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] host: 'l75lg1-v1@vast#vast', free_capacity_gb: 2081.64910808485, pools: None fails resource_type extra_specs requirements {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/capabilities.py:45}} May 28 12:58:55 l75lg1-v1 manila-scheduler[98327]: INFO manila.scheduler.filters.base [None req-6b307f8a-6c3e-4b75-86c1-674131a95acf tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Filter CapabilitiesFilter returned 0 host(s) May 28 12:58:55 l75lg1-v1 manila-scheduler[98327]: ERROR manila.scheduler.manager [None req-6b307f8a-6c3e-4b75-86c1-674131a95acf tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Failed to schedule create_share: No valid host was found. Failed to find a weighted host, the last executed filter was CapabilitiesFilter.: manila.exception.NoValidHost: No valid host was found. Failed to find a weighted host, the last executed filter was CapabilitiesFilter. May 28 12:58:55 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-6b307f8a-6c3e-4b75-86c1-674131a95acf tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares returned with HTTP 200 May 28 12:58:55 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 603/1205] 10.27.203.238 () {66 vars in 1362 bytes} [Tue May 28 12:58:55 2024] POST /share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares => generated 1278 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:58:55 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-50a8add7-6858-4a70-b0e6-77af1fa2ca40 tempest-SchedulerStatsAdminTest-1331908757 tempest-SchedulerStatsAdminTest-1331908757-project-admin] POST http://10.27.203.238/share/v2/e3754ccde0c34ce9a33fe231011c1930/types May 28 12:58:55 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-50a8add7-6858-4a70-b0e6-77af1fa2ca40 tempest-SchedulerStatsAdminTest-1331908757 tempest-SchedulerStatsAdminTest-1331908757-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share_type": {"name": "tempest-unique_st_name-784152955", "extra_specs": {"driver_handles_share_servers": "False", "share_backend_name": "tempest-fake_name-859860377"}, "share_type_access:is_public": true}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:58:55 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-4e9bddfb-f8a5-473a-9f83-417204981a47 tempest-PublicSharesTest-1667420263 tempest-PublicSharesTest-1667420263-project-member] http://10.27.203.238/share/v2/6d36e1eb1dbc449db6aca75b12a2ba18/shares/84e821d0-2b62-48db-80c7-259f61a14bac returned with HTTP 200 May 28 12:58:55 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 603/1206] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:58:55 2024] GET /share/v2/6d36e1eb1dbc449db6aca75b12a2ba18/shares/84e821d0-2b62-48db-80c7-259f61a14bac => generated 1317 bytes in 28 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:58:55 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-363e5c42-ebb8-4cd1-a3db-cbe93cad845b tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] GET http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/5aa4e646-010d-48b4-8194-715d8ba7e33c May 28 12:58:55 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-363e5c42-ebb8-4cd1-a3db-cbe93cad845b tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:55 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-363e5c42-ebb8-4cd1-a3db-cbe93cad845b tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:55 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-50a8add7-6858-4a70-b0e6-77af1fa2ca40 tempest-SchedulerStatsAdminTest-1331908757 tempest-SchedulerStatsAdminTest-1331908757-project-admin] http://10.27.203.238/share/v2/e3754ccde0c34ce9a33fe231011c1930/types returned with HTTP 200 May 28 12:58:55 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 604/1207] 10.27.203.238 () {66 vars in 1359 bytes} [Tue May 28 12:58:55 2024] POST /share/v2/e3754ccde0c34ce9a33fe231011c1930/types => generated 727 bytes in 22 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:58:55 l75lg1-v1 manila-scheduler[98327]: INFO manila.message.api [None req-6b307f8a-6c3e-4b75-86c1-674131a95acf tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Creating message record for request_id = req-6b307f8a-6c3e-4b75-86c1-674131a95acf May 28 12:58:55 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-a139c7f0-e843-44ba-96b1-dea737551233 tempest-SchedulerStatsAdminTest-1331908757 tempest-SchedulerStatsAdminTest-1331908757-project-admin] GET http://10.27.203.238/share/v2/e3754ccde0c34ce9a33fe231011c1930/scheduler-stats/pools?share_type=tempest-unique_st_name-784152955 May 28 12:58:55 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-a139c7f0-e843-44ba-96b1-dea737551233 tempest-SchedulerStatsAdminTest-1331908757 tempest-SchedulerStatsAdminTest-1331908757-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:55 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-a139c7f0-e843-44ba-96b1-dea737551233 tempest-SchedulerStatsAdminTest-1331908757 tempest-SchedulerStatsAdminTest-1331908757-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:55 l75lg1-v1 devstack@m-api.service[98329]: INFO oslo_messaging._drivers.amqpdriver [None req-a139c7f0-e843-44ba-96b1-dea737551233 tempest-SchedulerStatsAdminTest-1331908757 tempest-SchedulerStatsAdminTest-1331908757-project-admin] Expecting reply to msg 6a1d54f883154604bfd93d69e8f75cb4 in queue reply_351c50596b2348218ab8657bb9280c03 May 28 12:58:55 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.utils [None req-a139c7f0-e843-44ba-96b1-dea737551233 tempest-SchedulerStatsAdminTest-1331908757 None] Share type extra spec requirement "share_backend_name=tempest-fake_name-859860377" does not match reported capability "vast" {{(pid=98327) capabilities_satisfied /opt/stack/manila/manila/scheduler/utils.py:185}} May 28 12:58:55 l75lg1-v1 devstack@m-api.service[98329]: INFO oslo_messaging._drivers.amqpdriver [-] Received RPC response for msg 6a1d54f883154604bfd93d69e8f75cb4 May 28 12:58:55 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-363e5c42-ebb8-4cd1-a3db-cbe93cad845b tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/5aa4e646-010d-48b4-8194-715d8ba7e33c returned with HTTP 200 May 28 12:58:55 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 604/1208] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:58:55 2024] GET /share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/5aa4e646-010d-48b4-8194-715d8ba7e33c => generated 1278 bytes in 27 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:58:55 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2a6f53f3-f91d-4c67-887f-32835add7dd1 tempest-ShareIpRulesForNFSTest-1748669711 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:58:55 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2a6f53f3-f91d-4c67-887f-32835add7dd1 tempest-ShareIpRulesForNFSTest-1748669711 None] [Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=1, created='2024-05-28T12:57:40.763635Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='377955ad-d094-4e49-ab32-1021d943a572', id=21, internal=False, is_s3_default_policy=False, name='b7a7d61c-2cea-442a-9809-507038e080d5', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=['*'], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=[], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=[], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T12:58:50.758361Z', tenant_id=1, tenant_name='default', title='b7a7d61c-2cea-442a-9809-507038e080d5', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/21/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[])] May 28 12:58:55 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2a6f53f3-f91d-4c67-887f-32835add7dd1 tempest-ShareIpRulesForNFSTest-1748669711 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 12:58:55 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-2a6f53f3-f91d-4c67-887f-32835add7dd1 tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:55 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-2a6f53f3-f91d-4c67-887f-32835add7dd1 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:55 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-2a6f53f3-f91d-4c67-887f-32835add7dd1 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.039s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:55 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-2a6f53f3-f91d-4c67-887f-32835add7dd1 tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:55 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-2a6f53f3-f91d-4c67-887f-32835add7dd1 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:55 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-2a6f53f3-f91d-4c67-887f-32835add7dd1 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.036s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:55 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-2a6f53f3-f91d-4c67-887f-32835add7dd1 tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:55 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-2a6f53f3-f91d-4c67-887f-32835add7dd1 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:55 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-2a6f53f3-f91d-4c67-887f-32835add7dd1 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:55 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-2a6f53f3-f91d-4c67-887f-32835add7dd1 tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:55 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-2a6f53f3-f91d-4c67-887f-32835add7dd1 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:55 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-2a6f53f3-f91d-4c67-887f-32835add7dd1 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:55 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-2a6f53f3-f91d-4c67-887f-32835add7dd1 tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:55 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-2a6f53f3-f91d-4c67-887f-32835add7dd1 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:55 l75lg1-v1 nova-compute[83654]: DEBUG nova.scheduler.client.report [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Inventory has not changed for provider ef90d7d1-0808-4a15-ad77-f9a7391af2f4 based on inventory data: {'VCPU': {'total': 10, 'reserved': 0, 'min_unit': 1, 'max_unit': 10, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16000, 'reserved': 512, 'min_unit': 1, 'max_unit': 16000, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 28, 'reserved': 0, 'min_unit': 1, 'max_unit': 28, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=83654) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}} May 28 12:58:55 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.resource_tracker [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Compute_service record updated for l75lg1-v1:l75lg1-v1 {{(pid=83654) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}} May 28 12:58:55 l75lg1-v1 nova-compute[83654]: DEBUG oslo_concurrency.lockutils [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.558s {{(pid=83654) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:55 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-2a6f53f3-f91d-4c67-887f-32835add7dd1 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.034s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:55 l75lg1-v1 manila-share[98474]: INFO manila.share.access [None req-2a6f53f3-f91d-4c67-887f-32835add7dd1 tempest-ShareIpRulesForNFSTest-1748669711 None] Access rules were successfully modified for share instance b7a7d61c-2cea-442a-9809-507038e080d5 belonging to share 1ddadc17-cf10-4a42-8bbd-8335fb3520a1. May 28 12:58:55 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-4b180551-58c5-42d4-9de8-bc86bc61d554 tempest-PublicSharesTest-1667420263 None] <<< [GET] https://127.0.0.1:40443/api/views/ May 28 12:58:55 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-4b180551-58c5-42d4-9de8-bc86bc61d554 tempest-PublicSharesTest-1667420263 None] [] May 28 12:58:55 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-4b180551-58c5-42d4-9de8-bc86bc61d554 tempest-PublicSharesTest-1667420263 None] --- [GET] https://127.0.0.1:40443/api/views/: Done May 28 12:58:55 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-4b180551-58c5-42d4-9de8-bc86bc61d554 tempest-PublicSharesTest-1667420263 None] >>> [POST] https://127.0.0.1:40443/api/views/ May 28 12:58:55 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-4b180551-58c5-42d4-9de8-bc86bc61d554 tempest-PublicSharesTest-1667420263 None] {'data': '{"name": "834576a8-b0ac-4cc8-a1a0-0067a9513141", "path": ' May 28 12:58:55 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-4b180551-58c5-42d4-9de8-bc86bc61d554 tempest-PublicSharesTest-1667420263 None] '"/manila/manila-834576a8-b0ac-4cc8-a1a0-0067a9513141", "policy_id": ' May 28 12:58:55 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-4b180551-58c5-42d4-9de8-bc86bc61d554 tempest-PublicSharesTest-1667420263 None] '33, "create_dir": true, "protocols": ["NFS"]}', May 28 12:58:55 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-4b180551-58c5-42d4-9de8-bc86bc61d554 tempest-PublicSharesTest-1667420263 None] 'json': None, May 28 12:58:55 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-4b180551-58c5-42d4-9de8-bc86bc61d554 tempest-PublicSharesTest-1667420263 None] 'params': None} May 28 12:58:55 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-a139c7f0-e843-44ba-96b1-dea737551233 tempest-SchedulerStatsAdminTest-1331908757 tempest-SchedulerStatsAdminTest-1331908757-project-admin] http://10.27.203.238/share/v2/e3754ccde0c34ce9a33fe231011c1930/scheduler-stats/pools?share_type=tempest-unique_st_name-784152955 returned with HTTP 200 May 28 12:58:55 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 605/1209] 10.27.203.238 () {64 vars in 1472 bytes} [Tue May 28 12:58:55 2024] GET /share/v2/e3754ccde0c34ce9a33fe231011c1930/scheduler-stats/pools?share_type=tempest-unique_st_name-784152955 => generated 13 bytes in 513 msecs (HTTP/1.1 200) 6 headers in 230 bytes (2 switches on core 0) May 28 12:58:55 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-09d07e75-43be-4f27-a289-8464016efa43 tempest-SchedulerStatsAdminTest-1331908757 tempest-SchedulerStatsAdminTest-1331908757-project-admin] POST http://10.27.203.238/share/v2/e3754ccde0c34ce9a33fe231011c1930/types May 28 12:58:55 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-09d07e75-43be-4f27-a289-8464016efa43 tempest-SchedulerStatsAdminTest-1331908757 tempest-SchedulerStatsAdminTest-1331908757-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share_type": {"name": "tempest-unique_st_name-424157883", "extra_specs": {"driver_handles_share_servers": "False", "share_backend_name": "tempest-fake_name-1650330180"}, "share_type_access:is_public": true}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:58:56 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-09d07e75-43be-4f27-a289-8464016efa43 tempest-SchedulerStatsAdminTest-1331908757 tempest-SchedulerStatsAdminTest-1331908757-project-admin] http://10.27.203.238/share/v2/e3754ccde0c34ce9a33fe231011c1930/types returned with HTTP 200 May 28 12:58:56 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 605/1210] 10.27.203.238 () {66 vars in 1359 bytes} [Tue May 28 12:58:55 2024] POST /share/v2/e3754ccde0c34ce9a33fe231011c1930/types => generated 729 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:58:56 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-9786464c-2536-491a-bc21-d9ad4ef1ba89 tempest-SchedulerStatsAdminTest-1331908757 tempest-SchedulerStatsAdminTest-1331908757-project-admin] GET http://10.27.203.238/share/v2/e3754ccde0c34ce9a33fe231011c1930/scheduler-stats/pools?share_type=57228b04-c011-460a-8e30-080b90e8ae5e May 28 12:58:56 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-9786464c-2536-491a-bc21-d9ad4ef1ba89 tempest-SchedulerStatsAdminTest-1331908757 tempest-SchedulerStatsAdminTest-1331908757-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:56 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-9786464c-2536-491a-bc21-d9ad4ef1ba89 tempest-SchedulerStatsAdminTest-1331908757 tempest-SchedulerStatsAdminTest-1331908757-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:56 l75lg1-v1 devstack@m-api.service[98329]: INFO oslo_messaging._drivers.amqpdriver [None req-9786464c-2536-491a-bc21-d9ad4ef1ba89 tempest-SchedulerStatsAdminTest-1331908757 tempest-SchedulerStatsAdminTest-1331908757-project-admin] Expecting reply to msg 8bf6e183d98e46ae8f87ca4dca56f508 in queue reply_351c50596b2348218ab8657bb9280c03 May 28 12:58:56 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.utils [None req-9786464c-2536-491a-bc21-d9ad4ef1ba89 tempest-SchedulerStatsAdminTest-1331908757 None] Share type extra spec requirement "share_backend_name=tempest-fake_name-1650330180" does not match reported capability "vast" {{(pid=98327) capabilities_satisfied /opt/stack/manila/manila/scheduler/utils.py:185}} May 28 12:58:56 l75lg1-v1 devstack@m-api.service[98329]: INFO oslo_messaging._drivers.amqpdriver [-] Received RPC response for msg 8bf6e183d98e46ae8f87ca4dca56f508 May 28 12:58:56 l75lg1-v1 dstat.sh[49771]: 28-05 12:58:56| 6 1 91 3 0|5728M 1750M 277M 7870M| 13k 4379B| 0 7922k| 0 858 |4627 7305 |1.00 1.02 1.00|1.0 1.0 0| 0 0 | 0 2048M| 29 360 0 26 0 May 28 12:58:56 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-4b180551-58c5-42d4-9de8-bc86bc61d554 tempest-PublicSharesTest-1667420263 None] <<< [POST] https://127.0.0.1:40443/api/views/ May 28 12:58:56 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-4b180551-58c5-42d4-9de8-bc86bc61d554 tempest-PublicSharesTest-1667420263 None] Bunch(abac_tags=[], abe_max_depth=None, abe_protocols=[], alias='', allow_anonymous_access=False, allow_s3_anonymous_access=False, auto_commit='0d', bucket='', bucket_creators=[], bucket_creators_groups=[], bucket_owner=None, bulk_permission_update_progress=None, bulk_permission_update_state=None, cluster='loop75-kfs', cluster_id=1, created='2024-05-28T12:58:56.175462Z', enabled=True, files_retention_mode='NONE', guid='3c2c05ec-831d-4dd0-87ff-e6998638aabd', id=32, ignore_oos=False, internal=False, is_remote=False, is_seamless=False, logical_capacity=0, max_retention_period=None, min_retention_period=None, name='834576a8-b0ac-4cc8-a1a0-0067a9513141', nfs_interop_flags='BOTH_NFS3_AND_NFS4_INTEROP_DISABLED', path='/manila/manila-834576a8-b0ac-4cc8-a1a0-0067a9513141', physical_capacity=0, policy='834576a8-b0ac-4cc8-a1a0-0067a9513141', policy_id=33, protocols=['NFS'], qos_policy=None, qos_policy_id=None, s3_locks=False, s3_locks_retention_mode='NONE', s3_locks_retention_period='', s3_object_ownership_rule='ObjectWriter', s3_unverified_lookup=False, s3_versioning=False, select_for_live_monitoring=False, share='', share_acl=Bunch(acl=[], enabled=False), sync='SYNCED', sync_time='2024-05-28T12:58:56.433883Z', tenant_id=1, tenant_name='default', title='/manila/manila-834576a8-b0ac-4cc8-a1a0-0067a9513141', url='https://127.0.0.1:40443/api/views/32/') May 28 12:58:56 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-4b180551-58c5-42d4-9de8-bc86bc61d554 tempest-PublicSharesTest-1667420263 None] --- [POST] https://127.0.0.1:40443/api/views/: Done May 28 12:58:56 l75lg1-v1 manila-share[98474]: INFO manila.share.manager [None req-4b180551-58c5-42d4-9de8-bc86bc61d554 tempest-PublicSharesTest-1667420263 None] Share instance 834576a8-b0ac-4cc8-a1a0-0067a9513141 created successfully. May 28 12:58:56 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-9786464c-2536-491a-bc21-d9ad4ef1ba89 tempest-SchedulerStatsAdminTest-1331908757 tempest-SchedulerStatsAdminTest-1331908757-project-admin] http://10.27.203.238/share/v2/e3754ccde0c34ce9a33fe231011c1930/scheduler-stats/pools?share_type=57228b04-c011-460a-8e30-080b90e8ae5e returned with HTTP 200 May 28 12:58:56 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 606/1211] 10.27.203.238 () {64 vars in 1480 bytes} [Tue May 28 12:58:56 2024] GET /share/v2/e3754ccde0c34ce9a33fe231011c1930/scheduler-stats/pools?share_type=57228b04-c011-460a-8e30-080b90e8ae5e => generated 13 bytes in 512 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:58:56 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-647b1950-af1a-40ef-993a-8deebb13fcf2 tempest-SchedulerStatsAdminTest-1331908757 tempest-SchedulerStatsAdminTest-1331908757-project-admin] DELETE http://10.27.203.238/share/v2/e3754ccde0c34ce9a33fe231011c1930/types/57228b04-c011-460a-8e30-080b90e8ae5e May 28 12:58:56 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-647b1950-af1a-40ef-993a-8deebb13fcf2 tempest-SchedulerStatsAdminTest-1331908757 tempest-SchedulerStatsAdminTest-1331908757-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:56 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-647b1950-af1a-40ef-993a-8deebb13fcf2 tempest-SchedulerStatsAdminTest-1331908757 tempest-SchedulerStatsAdminTest-1331908757-project-admin] Calling method 'ShareTypesController._delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:56 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-647b1950-af1a-40ef-993a-8deebb13fcf2 tempest-SchedulerStatsAdminTest-1331908757 tempest-SchedulerStatsAdminTest-1331908757-project-admin] http://10.27.203.238/share/v2/e3754ccde0c34ce9a33fe231011c1930/types/57228b04-c011-460a-8e30-080b90e8ae5e returned with HTTP 202 May 28 12:58:56 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 606/1212] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:58:56 2024] DELETE /share/v2/e3754ccde0c34ce9a33fe231011c1930/types/57228b04-c011-460a-8e30-080b90e8ae5e => generated 0 bytes in 43 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:58:56 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-ae733292-cbbd-4ef9-93e2-7bf2be0a4f1a tempest-SchedulerStatsAdminTest-1331908757 tempest-SchedulerStatsAdminTest-1331908757-project-admin] GET http://10.27.203.238/share/v2/e3754ccde0c34ce9a33fe231011c1930/types/57228b04-c011-460a-8e30-080b90e8ae5e May 28 12:58:56 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-ae733292-cbbd-4ef9-93e2-7bf2be0a4f1a tempest-SchedulerStatsAdminTest-1331908757 tempest-SchedulerStatsAdminTest-1331908757-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:56 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-ae733292-cbbd-4ef9-93e2-7bf2be0a4f1a tempest-SchedulerStatsAdminTest-1331908757 tempest-SchedulerStatsAdminTest-1331908757-project-admin] Calling method 'ShareTypesController.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:56 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-ae733292-cbbd-4ef9-93e2-7bf2be0a4f1a tempest-SchedulerStatsAdminTest-1331908757 tempest-SchedulerStatsAdminTest-1331908757-project-admin] HTTP exception thrown: Share type not found. May 28 12:58:56 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-ae733292-cbbd-4ef9-93e2-7bf2be0a4f1a tempest-SchedulerStatsAdminTest-1331908757 tempest-SchedulerStatsAdminTest-1331908757-project-admin] http://10.27.203.238/share/v2/e3754ccde0c34ce9a33fe231011c1930/types/57228b04-c011-460a-8e30-080b90e8ae5e returned with HTTP 404 May 28 12:58:56 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 607/1213] 10.27.203.238 () {64 vars in 1448 bytes} [Tue May 28 12:58:56 2024] GET /share/v2/e3754ccde0c34ce9a33fe231011c1930/types/57228b04-c011-460a-8e30-080b90e8ae5e => generated 67 bytes in 10 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 12:58:56 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-c7006ff4-8796-4bc6-8559-f263cc9d7eef tempest-SchedulerStatsAdminTest-1331908757 tempest-SchedulerStatsAdminTest-1331908757-project-admin] DELETE http://10.27.203.238/share/v2/e3754ccde0c34ce9a33fe231011c1930/types/c2bb7f9e-cf04-448d-ac4f-86b903cf8e45 May 28 12:58:56 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-c7006ff4-8796-4bc6-8559-f263cc9d7eef tempest-SchedulerStatsAdminTest-1331908757 tempest-SchedulerStatsAdminTest-1331908757-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:56 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-c7006ff4-8796-4bc6-8559-f263cc9d7eef tempest-SchedulerStatsAdminTest-1331908757 tempest-SchedulerStatsAdminTest-1331908757-project-admin] Calling method 'ShareTypesController._delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:56 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-c7006ff4-8796-4bc6-8559-f263cc9d7eef tempest-SchedulerStatsAdminTest-1331908757 tempest-SchedulerStatsAdminTest-1331908757-project-admin] http://10.27.203.238/share/v2/e3754ccde0c34ce9a33fe231011c1930/types/c2bb7f9e-cf04-448d-ac4f-86b903cf8e45 returned with HTTP 202 May 28 12:58:56 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 607/1214] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:58:56 2024] DELETE /share/v2/e3754ccde0c34ce9a33fe231011c1930/types/c2bb7f9e-cf04-448d-ac4f-86b903cf8e45 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:58:56 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-a158e1e1-b880-43ea-9fb9-bf252f26f783 tempest-SchedulerStatsAdminTest-1331908757 tempest-SchedulerStatsAdminTest-1331908757-project-admin] GET http://10.27.203.238/share/v2/e3754ccde0c34ce9a33fe231011c1930/types/c2bb7f9e-cf04-448d-ac4f-86b903cf8e45 May 28 12:58:56 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-a158e1e1-b880-43ea-9fb9-bf252f26f783 tempest-SchedulerStatsAdminTest-1331908757 tempest-SchedulerStatsAdminTest-1331908757-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:56 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-a158e1e1-b880-43ea-9fb9-bf252f26f783 tempest-SchedulerStatsAdminTest-1331908757 tempest-SchedulerStatsAdminTest-1331908757-project-admin] Calling method 'ShareTypesController.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:56 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-a158e1e1-b880-43ea-9fb9-bf252f26f783 tempest-SchedulerStatsAdminTest-1331908757 tempest-SchedulerStatsAdminTest-1331908757-project-admin] HTTP exception thrown: Share type not found. May 28 12:58:56 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-a158e1e1-b880-43ea-9fb9-bf252f26f783 tempest-SchedulerStatsAdminTest-1331908757 tempest-SchedulerStatsAdminTest-1331908757-project-admin] http://10.27.203.238/share/v2/e3754ccde0c34ce9a33fe231011c1930/types/c2bb7f9e-cf04-448d-ac4f-86b903cf8e45 returned with HTTP 404 May 28 12:58:56 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 608/1215] 10.27.203.238 () {64 vars in 1448 bytes} [Tue May 28 12:58:56 2024] GET /share/v2/e3754ccde0c34ce9a33fe231011c1930/types/c2bb7f9e-cf04-448d-ac4f-86b903cf8e45 => generated 67 bytes in 10 msecs (HTTP/1.1 404) 6 headers in 237 bytes (2 switches on core 0) May 28 12:58:56 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-d94b40cf-ef6a-433c-85d6-eeda67bd4a3b tempest-SchedulerStatsAdminTest-1331908757 tempest-SchedulerStatsAdminTest-1331908757-project-admin] DELETE http://10.27.203.238/share/v2/e3754ccde0c34ce9a33fe231011c1930/types/8d1107fc-a987-4450-befa-063bbc1e072b May 28 12:58:56 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-d94b40cf-ef6a-433c-85d6-eeda67bd4a3b tempest-SchedulerStatsAdminTest-1331908757 tempest-SchedulerStatsAdminTest-1331908757-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:56 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-d94b40cf-ef6a-433c-85d6-eeda67bd4a3b tempest-SchedulerStatsAdminTest-1331908757 tempest-SchedulerStatsAdminTest-1331908757-project-admin] Calling method 'ShareTypesController._delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:56 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-d94b40cf-ef6a-433c-85d6-eeda67bd4a3b tempest-SchedulerStatsAdminTest-1331908757 tempest-SchedulerStatsAdminTest-1331908757-project-admin] http://10.27.203.238/share/v2/e3754ccde0c34ce9a33fe231011c1930/types/8d1107fc-a987-4450-befa-063bbc1e072b returned with HTTP 202 May 28 12:58:56 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 608/1216] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:58:56 2024] DELETE /share/v2/e3754ccde0c34ce9a33fe231011c1930/types/8d1107fc-a987-4450-befa-063bbc1e072b => generated 0 bytes in 34 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:58:56 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-690fa2d9-5903-4cc9-9bd4-0b47f4b424e5 tempest-SchedulerStatsAdminTest-1331908757 tempest-SchedulerStatsAdminTest-1331908757-project-admin] GET http://10.27.203.238/share/v2/e3754ccde0c34ce9a33fe231011c1930/types/8d1107fc-a987-4450-befa-063bbc1e072b May 28 12:58:56 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-690fa2d9-5903-4cc9-9bd4-0b47f4b424e5 tempest-SchedulerStatsAdminTest-1331908757 tempest-SchedulerStatsAdminTest-1331908757-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:56 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-690fa2d9-5903-4cc9-9bd4-0b47f4b424e5 tempest-SchedulerStatsAdminTest-1331908757 tempest-SchedulerStatsAdminTest-1331908757-project-admin] Calling method 'ShareTypesController.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:56 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-690fa2d9-5903-4cc9-9bd4-0b47f4b424e5 tempest-SchedulerStatsAdminTest-1331908757 tempest-SchedulerStatsAdminTest-1331908757-project-admin] HTTP exception thrown: Share type not found. May 28 12:58:56 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-690fa2d9-5903-4cc9-9bd4-0b47f4b424e5 tempest-SchedulerStatsAdminTest-1331908757 tempest-SchedulerStatsAdminTest-1331908757-project-admin] http://10.27.203.238/share/v2/e3754ccde0c34ce9a33fe231011c1930/types/8d1107fc-a987-4450-befa-063bbc1e072b returned with HTTP 404 May 28 12:58:56 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 609/1217] 10.27.203.238 () {64 vars in 1448 bytes} [Tue May 28 12:58:56 2024] GET /share/v2/e3754ccde0c34ce9a33fe231011c1930/types/8d1107fc-a987-4450-befa-063bbc1e072b => generated 67 bytes in 11 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 12:58:56 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:58:56 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-cd4c4255-4e8d-49e3-83e0-c9479f5101c7 tempest-SchedulerStatsAdminTest-1331908757 tempest-SchedulerStatsAdminTest-1331908757-project-admin] DELETE http://10.27.203.238/share/v2/e3754ccde0c34ce9a33fe231011c1930/types/085b9b39-1579-4b3a-b13a-6f6b202c1624 May 28 12:58:56 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-cd4c4255-4e8d-49e3-83e0-c9479f5101c7 tempest-SchedulerStatsAdminTest-1331908757 tempest-SchedulerStatsAdminTest-1331908757-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:56 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-cd4c4255-4e8d-49e3-83e0-c9479f5101c7 tempest-SchedulerStatsAdminTest-1331908757 tempest-SchedulerStatsAdminTest-1331908757-project-admin] Calling method 'ShareTypesController._delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:56 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-cd4c4255-4e8d-49e3-83e0-c9479f5101c7 tempest-SchedulerStatsAdminTest-1331908757 tempest-SchedulerStatsAdminTest-1331908757-project-admin] http://10.27.203.238/share/v2/e3754ccde0c34ce9a33fe231011c1930/types/085b9b39-1579-4b3a-b13a-6f6b202c1624 returned with HTTP 202 May 28 12:58:56 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 609/1218] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:58:56 2024] DELETE /share/v2/e3754ccde0c34ce9a33fe231011c1930/types/085b9b39-1579-4b3a-b13a-6f6b202c1624 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:58:56 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-841cb544-3103-45f0-95dd-5f03fd8ac471 tempest-SchedulerStatsAdminTest-1331908757 tempest-SchedulerStatsAdminTest-1331908757-project-admin] GET http://10.27.203.238/share/v2/e3754ccde0c34ce9a33fe231011c1930/types/085b9b39-1579-4b3a-b13a-6f6b202c1624 May 28 12:58:56 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-841cb544-3103-45f0-95dd-5f03fd8ac471 tempest-SchedulerStatsAdminTest-1331908757 tempest-SchedulerStatsAdminTest-1331908757-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:56 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-841cb544-3103-45f0-95dd-5f03fd8ac471 tempest-SchedulerStatsAdminTest-1331908757 tempest-SchedulerStatsAdminTest-1331908757-project-admin] Calling method 'ShareTypesController.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:56 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-841cb544-3103-45f0-95dd-5f03fd8ac471 tempest-SchedulerStatsAdminTest-1331908757 tempest-SchedulerStatsAdminTest-1331908757-project-admin] HTTP exception thrown: Share type not found. May 28 12:58:56 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-841cb544-3103-45f0-95dd-5f03fd8ac471 tempest-SchedulerStatsAdminTest-1331908757 tempest-SchedulerStatsAdminTest-1331908757-project-admin] http://10.27.203.238/share/v2/e3754ccde0c34ce9a33fe231011c1930/types/085b9b39-1579-4b3a-b13a-6f6b202c1624 returned with HTTP 404 May 28 12:58:56 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 610/1219] 10.27.203.238 () {64 vars in 1448 bytes} [Tue May 28 12:58:56 2024] GET /share/v2/e3754ccde0c34ce9a33fe231011c1930/types/085b9b39-1579-4b3a-b13a-6f6b202c1624 => generated 67 bytes in 9 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 12:58:56 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-bb222e88-b8a9-48cb-8ee9-8daf9c58ced5 tempest-SchedulerStatsAdminTest-1331908757 tempest-SchedulerStatsAdminTest-1331908757-project-admin] DELETE http://10.27.203.238/share/v2/e3754ccde0c34ce9a33fe231011c1930/types/b9189440-fb1a-4773-b2bf-b984ae0533b2 May 28 12:58:56 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-bb222e88-b8a9-48cb-8ee9-8daf9c58ced5 tempest-SchedulerStatsAdminTest-1331908757 tempest-SchedulerStatsAdminTest-1331908757-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:56 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-bb222e88-b8a9-48cb-8ee9-8daf9c58ced5 tempest-SchedulerStatsAdminTest-1331908757 tempest-SchedulerStatsAdminTest-1331908757-project-admin] Calling method 'ShareTypesController._delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:56 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-bb222e88-b8a9-48cb-8ee9-8daf9c58ced5 tempest-SchedulerStatsAdminTest-1331908757 tempest-SchedulerStatsAdminTest-1331908757-project-admin] http://10.27.203.238/share/v2/e3754ccde0c34ce9a33fe231011c1930/types/b9189440-fb1a-4773-b2bf-b984ae0533b2 returned with HTTP 202 May 28 12:58:56 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 610/1220] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:58:56 2024] DELETE /share/v2/e3754ccde0c34ce9a33fe231011c1930/types/b9189440-fb1a-4773-b2bf-b984ae0533b2 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:58:56 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-93d91bcb-945a-4fc2-8fc1-ca5a36c13d99 tempest-SchedulerStatsAdminTest-1331908757 tempest-SchedulerStatsAdminTest-1331908757-project-admin] GET http://10.27.203.238/share/v2/e3754ccde0c34ce9a33fe231011c1930/types/b9189440-fb1a-4773-b2bf-b984ae0533b2 May 28 12:58:56 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-93d91bcb-945a-4fc2-8fc1-ca5a36c13d99 tempest-SchedulerStatsAdminTest-1331908757 tempest-SchedulerStatsAdminTest-1331908757-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:56 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-93d91bcb-945a-4fc2-8fc1-ca5a36c13d99 tempest-SchedulerStatsAdminTest-1331908757 tempest-SchedulerStatsAdminTest-1331908757-project-admin] Calling method 'ShareTypesController.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:56 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-93d91bcb-945a-4fc2-8fc1-ca5a36c13d99 tempest-SchedulerStatsAdminTest-1331908757 tempest-SchedulerStatsAdminTest-1331908757-project-admin] HTTP exception thrown: Share type not found. May 28 12:58:56 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-93d91bcb-945a-4fc2-8fc1-ca5a36c13d99 tempest-SchedulerStatsAdminTest-1331908757 tempest-SchedulerStatsAdminTest-1331908757-project-admin] http://10.27.203.238/share/v2/e3754ccde0c34ce9a33fe231011c1930/types/b9189440-fb1a-4773-b2bf-b984ae0533b2 returned with HTTP 404 May 28 12:58:56 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 611/1221] 10.27.203.238 () {64 vars in 1448 bytes} [Tue May 28 12:58:56 2024] GET /share/v2/e3754ccde0c34ce9a33fe231011c1930/types/b9189440-fb1a-4773-b2bf-b984ae0533b2 => generated 67 bytes in 9 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 12:58:56 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-46a41bc0-d126-4f04-82d3-ddf54d406e0a tempest-SchedulerStatsAdminTest-1331908757 tempest-SchedulerStatsAdminTest-1331908757-project-admin] DELETE http://10.27.203.238/share/v2/e3754ccde0c34ce9a33fe231011c1930/types/d22fee7e-88af-4f97-9a6c-52add4663545 May 28 12:58:56 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-46a41bc0-d126-4f04-82d3-ddf54d406e0a tempest-SchedulerStatsAdminTest-1331908757 tempest-SchedulerStatsAdminTest-1331908757-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:56 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-46a41bc0-d126-4f04-82d3-ddf54d406e0a tempest-SchedulerStatsAdminTest-1331908757 tempest-SchedulerStatsAdminTest-1331908757-project-admin] Calling method 'ShareTypesController._delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:56 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-46a41bc0-d126-4f04-82d3-ddf54d406e0a tempest-SchedulerStatsAdminTest-1331908757 tempest-SchedulerStatsAdminTest-1331908757-project-admin] http://10.27.203.238/share/v2/e3754ccde0c34ce9a33fe231011c1930/types/d22fee7e-88af-4f97-9a6c-52add4663545 returned with HTTP 202 May 28 12:58:56 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 611/1222] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:58:56 2024] DELETE /share/v2/e3754ccde0c34ce9a33fe231011c1930/types/d22fee7e-88af-4f97-9a6c-52add4663545 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:58:56 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-17bd86d6-6d13-499e-8e8f-c150d8d25951 tempest-SchedulerStatsAdminTest-1331908757 tempest-SchedulerStatsAdminTest-1331908757-project-admin] GET http://10.27.203.238/share/v2/e3754ccde0c34ce9a33fe231011c1930/types/d22fee7e-88af-4f97-9a6c-52add4663545 May 28 12:58:56 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-17bd86d6-6d13-499e-8e8f-c150d8d25951 tempest-SchedulerStatsAdminTest-1331908757 tempest-SchedulerStatsAdminTest-1331908757-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:56 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-17bd86d6-6d13-499e-8e8f-c150d8d25951 tempest-SchedulerStatsAdminTest-1331908757 tempest-SchedulerStatsAdminTest-1331908757-project-admin] Calling method 'ShareTypesController.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:56 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-17bd86d6-6d13-499e-8e8f-c150d8d25951 tempest-SchedulerStatsAdminTest-1331908757 tempest-SchedulerStatsAdminTest-1331908757-project-admin] HTTP exception thrown: Share type not found. May 28 12:58:56 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-17bd86d6-6d13-499e-8e8f-c150d8d25951 tempest-SchedulerStatsAdminTest-1331908757 tempest-SchedulerStatsAdminTest-1331908757-project-admin] http://10.27.203.238/share/v2/e3754ccde0c34ce9a33fe231011c1930/types/d22fee7e-88af-4f97-9a6c-52add4663545 returned with HTTP 404 May 28 12:58:56 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 612/1223] 10.27.203.238 () {64 vars in 1448 bytes} [Tue May 28 12:58:56 2024] GET /share/v2/e3754ccde0c34ce9a33fe231011c1930/types/d22fee7e-88af-4f97-9a6c-52add4663545 => generated 67 bytes in 10 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 12:58:56 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-eb47b0c9-a924-47d8-9ebc-4d46f14441cf tempest-SchedulerStatsAdminTest-1331908757 tempest-SchedulerStatsAdminTest-1331908757-project-admin] DELETE http://10.27.203.238/share/v2/e3754ccde0c34ce9a33fe231011c1930/types/83b5fc12-8b3d-42b7-8cbf-ca9c4e8471f4 May 28 12:58:56 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-eb47b0c9-a924-47d8-9ebc-4d46f14441cf tempest-SchedulerStatsAdminTest-1331908757 tempest-SchedulerStatsAdminTest-1331908757-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:56 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-eb47b0c9-a924-47d8-9ebc-4d46f14441cf tempest-SchedulerStatsAdminTest-1331908757 tempest-SchedulerStatsAdminTest-1331908757-project-admin] Calling method 'ShareTypesController._delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:56 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-eb47b0c9-a924-47d8-9ebc-4d46f14441cf tempest-SchedulerStatsAdminTest-1331908757 tempest-SchedulerStatsAdminTest-1331908757-project-admin] http://10.27.203.238/share/v2/e3754ccde0c34ce9a33fe231011c1930/types/83b5fc12-8b3d-42b7-8cbf-ca9c4e8471f4 returned with HTTP 202 May 28 12:58:56 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 612/1224] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:58:56 2024] DELETE /share/v2/e3754ccde0c34ce9a33fe231011c1930/types/83b5fc12-8b3d-42b7-8cbf-ca9c4e8471f4 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:58:56 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-08cab814-ff5e-40bf-88b5-e0bfada21613 tempest-SchedulerStatsAdminTest-1331908757 tempest-SchedulerStatsAdminTest-1331908757-project-admin] GET http://10.27.203.238/share/v2/e3754ccde0c34ce9a33fe231011c1930/types/83b5fc12-8b3d-42b7-8cbf-ca9c4e8471f4 May 28 12:58:56 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-08cab814-ff5e-40bf-88b5-e0bfada21613 tempest-SchedulerStatsAdminTest-1331908757 tempest-SchedulerStatsAdminTest-1331908757-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:56 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-08cab814-ff5e-40bf-88b5-e0bfada21613 tempest-SchedulerStatsAdminTest-1331908757 tempest-SchedulerStatsAdminTest-1331908757-project-admin] Calling method 'ShareTypesController.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:56 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-08cab814-ff5e-40bf-88b5-e0bfada21613 tempest-SchedulerStatsAdminTest-1331908757 tempest-SchedulerStatsAdminTest-1331908757-project-admin] HTTP exception thrown: Share type not found. May 28 12:58:56 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-08cab814-ff5e-40bf-88b5-e0bfada21613 tempest-SchedulerStatsAdminTest-1331908757 tempest-SchedulerStatsAdminTest-1331908757-project-admin] http://10.27.203.238/share/v2/e3754ccde0c34ce9a33fe231011c1930/types/83b5fc12-8b3d-42b7-8cbf-ca9c4e8471f4 returned with HTTP 404 May 28 12:58:56 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 613/1225] 10.27.203.238 () {64 vars in 1448 bytes} [Tue May 28 12:58:56 2024] GET /share/v2/e3754ccde0c34ce9a33fe231011c1930/types/83b5fc12-8b3d-42b7-8cbf-ca9c4e8471f4 => generated 67 bytes in 11 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 12:58:56 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-a880fa79-8542-4c16-ba57-f87d10f813e6 tempest-SchedulerStatsAdminTest-1331908757 tempest-SchedulerStatsAdminTest-1331908757-project-admin] DELETE http://10.27.203.238/share/v2/e3754ccde0c34ce9a33fe231011c1930/types/5393ecb9-e008-46c3-88ce-e487592b5b3e May 28 12:58:56 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-a880fa79-8542-4c16-ba57-f87d10f813e6 tempest-SchedulerStatsAdminTest-1331908757 tempest-SchedulerStatsAdminTest-1331908757-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:56 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-a880fa79-8542-4c16-ba57-f87d10f813e6 tempest-SchedulerStatsAdminTest-1331908757 tempest-SchedulerStatsAdminTest-1331908757-project-admin] Calling method 'ShareTypesController._delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:56 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-a880fa79-8542-4c16-ba57-f87d10f813e6 tempest-SchedulerStatsAdminTest-1331908757 tempest-SchedulerStatsAdminTest-1331908757-project-admin] http://10.27.203.238/share/v2/e3754ccde0c34ce9a33fe231011c1930/types/5393ecb9-e008-46c3-88ce-e487592b5b3e returned with HTTP 202 May 28 12:58:56 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 613/1226] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:58:56 2024] DELETE /share/v2/e3754ccde0c34ce9a33fe231011c1930/types/5393ecb9-e008-46c3-88ce-e487592b5b3e => generated 0 bytes in 42 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:58:56 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-11d019f6-d5c9-4668-962e-ecd53d218f69 tempest-SchedulerStatsAdminTest-1331908757 tempest-SchedulerStatsAdminTest-1331908757-project-admin] GET http://10.27.203.238/share/v2/e3754ccde0c34ce9a33fe231011c1930/types/5393ecb9-e008-46c3-88ce-e487592b5b3e May 28 12:58:56 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-11d019f6-d5c9-4668-962e-ecd53d218f69 tempest-SchedulerStatsAdminTest-1331908757 tempest-SchedulerStatsAdminTest-1331908757-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:56 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-11d019f6-d5c9-4668-962e-ecd53d218f69 tempest-SchedulerStatsAdminTest-1331908757 tempest-SchedulerStatsAdminTest-1331908757-project-admin] Calling method 'ShareTypesController.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:56 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-11d019f6-d5c9-4668-962e-ecd53d218f69 tempest-SchedulerStatsAdminTest-1331908757 tempest-SchedulerStatsAdminTest-1331908757-project-admin] HTTP exception thrown: Share type not found. May 28 12:58:56 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-11d019f6-d5c9-4668-962e-ecd53d218f69 tempest-SchedulerStatsAdminTest-1331908757 tempest-SchedulerStatsAdminTest-1331908757-project-admin] http://10.27.203.238/share/v2/e3754ccde0c34ce9a33fe231011c1930/types/5393ecb9-e008-46c3-88ce-e487592b5b3e returned with HTTP 404 May 28 12:58:56 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 614/1227] 10.27.203.238 () {64 vars in 1448 bytes} [Tue May 28 12:58:56 2024] GET /share/v2/e3754ccde0c34ce9a33fe231011c1930/types/5393ecb9-e008-46c3-88ce-e487592b5b3e => generated 67 bytes in 11 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 12:58:56 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b361c3b7-485b-4a58-b0ae-9564b1a415e2 tempest-ShareIpRulesForNFSNegativeTest-700172924 tempest-ShareIpRulesForNFSNegativeTest-700172924-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b361c3b7-485b-4a58-b0ae-9564b1a415e2 tempest-ShareIpRulesForNFSNegativeTest-700172924 tempest-ShareIpRulesForNFSNegativeTest-700172924-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46a89b0-8182-4fc0-83c3-f8168bcc435f None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46a89b0-8182-4fc0-83c3-f8168bcc435f None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46a89b0-8182-4fc0-83c3-f8168bcc435f None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46a89b0-8182-4fc0-83c3-f8168bcc435f None admin] PATH_INFO: `/v3/users/141d7fcf70c04ad6aea2346d8c2cb259` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46a89b0-8182-4fc0-83c3-f8168bcc435f None admin] RBAC: Authorizing `identity:delete_user(user_id=141d7fcf70c04ad6aea2346d8c2cb259)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46a89b0-8182-4fc0-83c3-f8168bcc435f None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-b46a89b0-8182-4fc0-83c3-f8168bcc435f None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '141d7fcf70c04ad6aea2346d8c2cb259', 'request_id': 'req-b46a89b0-8182-4fc0-83c3-f8168bcc435f'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:58:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-b46a89b0-8182-4fc0-83c3-f8168bcc435f None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '141d7fcf70c04ad6aea2346d8c2cb259', 'request_id': 'req-b46a89b0-8182-4fc0-83c3-f8168bcc435f'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:58:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-b46a89b0-8182-4fc0-83c3-f8168bcc435f None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '141d7fcf70c04ad6aea2346d8c2cb259', 'request_id': 'req-b46a89b0-8182-4fc0-83c3-f8168bcc435f'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:58:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-b46a89b0-8182-4fc0-83c3-f8168bcc435f None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '141d7fcf70c04ad6aea2346d8c2cb259', 'request_id': 'req-b46a89b0-8182-4fc0-83c3-f8168bcc435f'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:58:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-b46a89b0-8182-4fc0-83c3-f8168bcc435f None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '141d7fcf70c04ad6aea2346d8c2cb259', 'request_id': 'req-b46a89b0-8182-4fc0-83c3-f8168bcc435f'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:58:57 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1141/2305] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 12:58:56 2024] DELETE /identity/v3/users/141d7fcf70c04ad6aea2346d8c2cb259 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:58:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d932a390-6040-405c-8827-a677f863471a None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d932a390-6040-405c-8827-a677f863471a None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d932a390-6040-405c-8827-a677f863471a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:57 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-d932a390-6040-405c-8827-a677f863471a None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:58:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-d932a390-6040-405c-8827-a677f863471a None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:58:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-d932a390-6040-405c-8827-a677f863471a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:58:57 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1165/2306] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:58:57 2024] POST /identity/v3/auth/tokens => generated 2960 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 12:58:57 l75lg1-v1 neutron-server[77619]: DEBUG neutron.wsgi [-] (77619) accepted ('10.27.203.238', 35014) {{(pid=77619) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 12:58:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46a89b0-8182-4fc0-83c3-f8168bcc435f None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-b46a89b0-8182-4fc0-83c3-f8168bcc435f None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:58:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46a89b0-8182-4fc0-83c3-f8168bcc435f None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c139809-2c5b-4f71-8442-efa9b2d8306e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef17047035e4b518fd5360a01f2da1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:57 l75lg1-v1 dstat.sh[49771]: 28-05 12:58:57| 7 1 89 3 0|5728M 1750M 277M 7870M| 14k 1390B| 0 1704k| 0 246 |5786 9657 |1.00 1.02 1.00|1.0 1.0 0| 0 0 | 0 2048M| 29 362 0 28 0 May 28 12:58:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c139809-2c5b-4f71-8442-efa9b2d8306e service neutron] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c139809-2c5b-4f71-8442-efa9b2d8306e service neutron] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c139809-2c5b-4f71-8442-efa9b2d8306e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c139809-2c5b-4f71-8442-efa9b2d8306e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c139809-2c5b-4f71-8442-efa9b2d8306e service neutron] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:57 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1142/2307] 10.27.203.238 () {64 vars in 1432 bytes} [Tue May 28 12:58:57 2024] GET /identity/v3/auth/tokens => generated 2960 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 28 12:58:57 l75lg1-v1 neutron-server[77619]: INFO neutron.wsgi [None req-2d487056-0bca-421e-ad08-c6042342576a None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=e3754ccde0c34ce9a33fe231011c1930&name=default HTTP/1.1" status: 200 len: 216 time: 0.0739093 May 28 12:58:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d932a390-6040-405c-8827-a677f863471a None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-d932a390-6040-405c-8827-a677f863471a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:58:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d932a390-6040-405c-8827-a677f863471a None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99277c2a-1463-412f-be75-53caf0bf2ad4 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99277c2a-1463-412f-be75-53caf0bf2ad4 None admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99277c2a-1463-412f-be75-53caf0bf2ad4 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99277c2a-1463-412f-be75-53caf0bf2ad4 None admin] PATH_INFO: `/v3/projects/e3754ccde0c34ce9a33fe231011c1930` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99277c2a-1463-412f-be75-53caf0bf2ad4 None admin] RBAC: Authorizing `identity:delete_project(project_id=e3754ccde0c34ce9a33fe231011c1930)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99277c2a-1463-412f-be75-53caf0bf2ad4 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-99277c2a-1463-412f-be75-53caf0bf2ad4 None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3754ccde0c34ce9a33fe231011c1930', 'request_id': 'req-99277c2a-1463-412f-be75-53caf0bf2ad4'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:58:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-99277c2a-1463-412f-be75-53caf0bf2ad4 None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3754ccde0c34ce9a33fe231011c1930', 'request_id': 'req-99277c2a-1463-412f-be75-53caf0bf2ad4'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:58:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-99277c2a-1463-412f-be75-53caf0bf2ad4 None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3754ccde0c34ce9a33fe231011c1930', 'request_id': 'req-99277c2a-1463-412f-be75-53caf0bf2ad4'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:58:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-99277c2a-1463-412f-be75-53caf0bf2ad4 None admin] The token cache is being invalidate because project e3754ccde0c34ce9a33fe231011c1930 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 12:58:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-99277c2a-1463-412f-be75-53caf0bf2ad4 None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:58:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-99277c2a-1463-412f-be75-53caf0bf2ad4 None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:58:57 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1166/2308] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 12:58:57 2024] DELETE /identity/v3/projects/e3754ccde0c34ce9a33fe231011c1930 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:58:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4ffeb8-00db-4738-b178-3cd011b80ade None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4ffeb8-00db-4738-b178-3cd011b80ade None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4ffeb8-00db-4738-b178-3cd011b80ade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:57 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-9d4ffeb8-00db-4738-b178-3cd011b80ade None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:58:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-9d4ffeb8-00db-4738-b178-3cd011b80ade None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:58:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-9d4ffeb8-00db-4738-b178-3cd011b80ade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:58:57 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1143/2309] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:58:57 2024] POST /identity/v3/auth/tokens => generated 312 bytes in 18 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 28 12:58:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d01112-dcbf-4f05-88d1-feecb500d90a None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d01112-dcbf-4f05-88d1-feecb500d90a None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d01112-dcbf-4f05-88d1-feecb500d90a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:57 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-19d01112-dcbf-4f05-88d1-feecb500d90a None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:58:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-19d01112-dcbf-4f05-88d1-feecb500d90a None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:58:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-19d01112-dcbf-4f05-88d1-feecb500d90a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:58:57 l75lg1-v1 neutron-server[77623]: DEBUG dbcounter [-] [77623] Writing DB stats neutron:SELECT=1 {{(pid=77623) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:58:57 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1167/2310] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:58:57 2024] POST /identity/v3/auth/tokens => generated 2960 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 12:58:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4ffeb8-00db-4738-b178-3cd011b80ade None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4ffeb8-00db-4738-b178-3cd011b80ade None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ec3fc9-9cab-49b6-b6f0-3a616e844ce4 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ec3fc9-9cab-49b6-b6f0-3a616e844ce4 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ec3fc9-9cab-49b6-b6f0-3a616e844ce4 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ec3fc9-9cab-49b6-b6f0-3a616e844ce4 None admin] PATH_INFO: `/v3/domains` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ec3fc9-9cab-49b6-b6f0-3a616e844ce4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:58:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ec3fc9-9cab-49b6-b6f0-3a616e844ce4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ec3fc9-9cab-49b6-b6f0-3a616e844ce4 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:57 l75lg1-v1 neutron-server[77619]: DEBUG dbcounter [-] [77619] Writing DB stats neutron:SELECT=1 {{(pid=77619) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:58:57 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1144/2311] 10.27.203.238 () {62 vars in 1220 bytes} [Tue May 28 12:58:57 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:58:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d01112-dcbf-4f05-88d1-feecb500d90a None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d01112-dcbf-4f05-88d1-feecb500d90a None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1690a3c3-efcc-485a-ab5f-6b369f4619be None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1690a3c3-efcc-485a-ab5f-6b369f4619be None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1690a3c3-efcc-485a-ab5f-6b369f4619be None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1690a3c3-efcc-485a-ab5f-6b369f4619be None admin] PATH_INFO: `/v3/projects` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1690a3c3-efcc-485a-ab5f-6b369f4619be None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1690a3c3-efcc-485a-ab5f-6b369f4619be None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:57 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1168/2312] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 12:58:57 2024] POST /identity/v3/projects => generated 369 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:58:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ec3fc9-9cab-49b6-b6f0-3a616e844ce4 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ec3fc9-9cab-49b6-b6f0-3a616e844ce4 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb8ca5a-da81-41b5-8ff5-310107f3294a None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb8ca5a-da81-41b5-8ff5-310107f3294a None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb8ca5a-da81-41b5-8ff5-310107f3294a None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb8ca5a-da81-41b5-8ff5-310107f3294a None admin] PATH_INFO: `/v3/users` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb8ca5a-da81-41b5-8ff5-310107f3294a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb8ca5a-da81-41b5-8ff5-310107f3294a None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:57 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-2cb8ca5a-da81-41b5-8ff5-310107f3294a None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 12:58:57 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1145/2313] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 12:58:57 2024] POST /identity/v3/users => generated 292 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:58:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1690a3c3-efcc-485a-ab5f-6b369f4619be None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1690a3c3-efcc-485a-ab5f-6b369f4619be None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8dd684-3de1-42be-97a2-de02e4ce6cf5 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8dd684-3de1-42be-97a2-de02e4ce6cf5 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8dd684-3de1-42be-97a2-de02e4ce6cf5 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8dd684-3de1-42be-97a2-de02e4ce6cf5 None admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8dd684-3de1-42be-97a2-de02e4ce6cf5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8dd684-3de1-42be-97a2-de02e4ce6cf5 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:57 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-c0e93d59-a690-4c87-8bff-b470c034409e tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] GET http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/0e9e1ee3-c7cc-4239-bc5b-cace9d44e641 May 28 12:58:57 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1169/2314] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 12:58:57 2024] GET /identity/v3/roles => generated 1680 bytes in 16 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:58:57 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-c0e93d59-a690-4c87-8bff-b470c034409e tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:57 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-c0e93d59-a690-4c87-8bff-b470c034409e tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb8ca5a-da81-41b5-8ff5-310107f3294a None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb8ca5a-da81-41b5-8ff5-310107f3294a None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:57 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-c0e93d59-a690-4c87-8bff-b470c034409e tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] HTTP exception thrown: The resource could not be found. May 28 12:58:57 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-c0e93d59-a690-4c87-8bff-b470c034409e tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/0e9e1ee3-c7cc-4239-bc5b-cace9d44e641 returned with HTTP 404 May 28 12:58:57 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 614/1228] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:58:57 2024] GET /share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/0e9e1ee3-c7cc-4239-bc5b-cace9d44e641 => generated 78 bytes in 12 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 12:58:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c64f570-abb8-454c-847b-d08d4a89867b None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c64f570-abb8-454c-847b-d08d4a89867b None admin] REQUEST_METHOD: `PUT` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c64f570-abb8-454c-847b-d08d4a89867b None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c64f570-abb8-454c-847b-d08d4a89867b None admin] PATH_INFO: `/v3/projects/169e2bf0e6284c33bb6e8ba37eadf427/users/07cff7a575184066b67f8e453f02c2e6/roles/e7989893488f483baa107be56668c4f8` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:57 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-a7ea8ee3-0c0c-4569-9ae6-223ef96e5788 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] PUT http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/9e24a210-9e96-45d9-b31c-f6f3377eb0e7/metadata May 28 12:58:57 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-a7ea8ee3-0c0c-4569-9ae6-223ef96e5788 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Action: 'update_all_metadata', calling method: Controller.__getattribute__..version_select, body: {"metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "value"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:58:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c64f570-abb8-454c-847b-d08d4a89867b None admin] RBAC: Authorizing `identity:create_grant(project_id=169e2bf0e6284c33bb6e8ba37eadf427, user_id=07cff7a575184066b67f8e453f02c2e6, role_id=e7989893488f483baa107be56668c4f8)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c64f570-abb8-454c-847b-d08d4a89867b None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:57 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1146/2315] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 12:58:57 2024] PUT /identity/v3/projects/169e2bf0e6284c33bb6e8ba37eadf427/users/07cff7a575184066b67f8e453f02c2e6/roles/e7989893488f483baa107be56668c4f8 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:58:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8dd684-3de1-42be-97a2-de02e4ce6cf5 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8dd684-3de1-42be-97a2-de02e4ce6cf5 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f18b44-20ec-4a14-97c0-571374f0415e None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f18b44-20ec-4a14-97c0-571374f0415e None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f18b44-20ec-4a14-97c0-571374f0415e None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f18b44-20ec-4a14-97c0-571374f0415e None admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f18b44-20ec-4a14-97c0-571374f0415e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f18b44-20ec-4a14-97c0-571374f0415e None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:57 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1170/2316] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 12:58:57 2024] GET /identity/v3/roles => generated 1680 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:58:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c64f570-abb8-454c-847b-d08d4a89867b None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c64f570-abb8-454c-847b-d08d4a89867b None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88fc100-eb30-41bd-b0b1-53443048865c None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88fc100-eb30-41bd-b0b1-53443048865c None admin] REQUEST_METHOD: `PUT` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88fc100-eb30-41bd-b0b1-53443048865c None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88fc100-eb30-41bd-b0b1-53443048865c None admin] PATH_INFO: `/v3/projects/169e2bf0e6284c33bb6e8ba37eadf427/users/07cff7a575184066b67f8e453f02c2e6/roles/e7989893488f483baa107be56668c4f8` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88fc100-eb30-41bd-b0b1-53443048865c None admin] RBAC: Authorizing `identity:create_grant(project_id=169e2bf0e6284c33bb6e8ba37eadf427, user_id=07cff7a575184066b67f8e453f02c2e6, role_id=e7989893488f483baa107be56668c4f8)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88fc100-eb30-41bd-b0b1-53443048865c None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:57 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1147/2317] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 12:58:57 2024] PUT /identity/v3/projects/169e2bf0e6284c33bb6e8ba37eadf427/users/07cff7a575184066b67f8e453f02c2e6/roles/e7989893488f483baa107be56668c4f8 => generated 0 bytes in 18 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:58:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4107a1f-3a19-4c9a-8f1e-474ffe347d81 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4107a1f-3a19-4c9a-8f1e-474ffe347d81 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4107a1f-3a19-4c9a-8f1e-474ffe347d81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:57 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-c4107a1f-3a19-4c9a-8f1e-474ffe347d81 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:58:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-c4107a1f-3a19-4c9a-8f1e-474ffe347d81 None None] MFA Rules not processed for user `07cff7a575184066b67f8e453f02c2e6`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:58:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-c4107a1f-3a19-4c9a-8f1e-474ffe347d81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:58:57 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1171/2318] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:58:57 2024] POST /identity/v3/auth/tokens => generated 4063 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:58:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88fc100-eb30-41bd-b0b1-53443048865c None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-c88fc100-eb30-41bd-b0b1-53443048865c None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:58:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88fc100-eb30-41bd-b0b1-53443048865c None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e0ed4e-0191-4caa-853e-0adfb30622ee service manila] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f110cf6300f049c897d0aab63218d1e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e0ed4e-0191-4caa-853e-0adfb30622ee service manila] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e0ed4e-0191-4caa-853e-0adfb30622ee service manila] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e0ed4e-0191-4caa-853e-0adfb30622ee service manila] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e0ed4e-0191-4caa-853e-0adfb30622ee service manila] RBAC: Authorizing `identity:validate_token()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e0ed4e-0191-4caa-853e-0adfb30622ee service manila] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:57 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1148/2319] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 12:58:57 2024] GET /identity/v3/auth/tokens => generated 4063 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 12:58:57 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-1f40ee15-176a-4cb2-a528-d2fe8b021a0d tempest-ServicesAdminTest-55852734 tempest-ServicesAdminTest-55852734-project-admin] GET http://10.27.203.238/share/v1/169e2bf0e6284c33bb6e8ba37eadf427/os-services May 28 12:58:57 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-1f40ee15-176a-4cb2-a528-d2fe8b021a0d tempest-ServicesAdminTest-55852734 tempest-ServicesAdminTest-55852734-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:57 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-1f40ee15-176a-4cb2-a528-d2fe8b021a0d tempest-ServicesAdminTest-55852734 tempest-ServicesAdminTest-55852734-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:57 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-a7ea8ee3-0c0c-4569-9ae6-223ef96e5788 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/9e24a210-9e96-45d9-b31c-f6f3377eb0e7/metadata returned with HTTP 200 May 28 12:58:57 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 615/1229] 10.27.203.238 () {66 vars in 1499 bytes} [Tue May 28 12:58:57 2024] PUT /share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/9e24a210-9e96-45d9-b31c-f6f3377eb0e7/metadata => generated 282 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:58:57 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-07dc279f-2908-414e-b4eb-8d6f62f738da tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] GET http://10.27.203.238/share/v2/776f75906bc64f8f9316d5aab4b50bf1/share-access-rules?share_id=1ddadc17-cf10-4a42-8bbd-8335fb3520a1 May 28 12:58:57 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-07dc279f-2908-414e-b4eb-8d6f62f738da tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:57 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-07dc279f-2908-414e-b4eb-8d6f62f738da tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:57 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-1f40ee15-176a-4cb2-a528-d2fe8b021a0d tempest-ServicesAdminTest-55852734 tempest-ServicesAdminTest-55852734-project-admin] http://10.27.203.238/share/v1/169e2bf0e6284c33bb6e8ba37eadf427/os-services returned with HTTP 200 May 28 12:58:57 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 615/1230] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 12:58:57 2024] GET /share/v1/169e2bf0e6284c33bb6e8ba37eadf427/os-services => generated 820 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:58:57 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-f8afa6ce-7a3d-4368-b90a-43acb4d52dd0 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] GET http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/9e24a210-9e96-45d9-b31c-f6f3377eb0e7/metadata May 28 12:58:57 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-f8afa6ce-7a3d-4368-b90a-43acb4d52dd0 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:57 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-f8afa6ce-7a3d-4368-b90a-43acb4d52dd0 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:57 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-07dc279f-2908-414e-b4eb-8d6f62f738da tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] http://10.27.203.238/share/v2/776f75906bc64f8f9316d5aab4b50bf1/share-access-rules?share_id=1ddadc17-cf10-4a42-8bbd-8335fb3520a1 returned with HTTP 200 May 28 12:58:57 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 616/1231] 10.27.203.238 () {64 vars in 1467 bytes} [Tue May 28 12:58:57 2024] GET /share/v2/776f75906bc64f8f9316d5aab4b50bf1/share-access-rules?share_id=1ddadc17-cf10-4a42-8bbd-8335fb3520a1 => generated 19 bytes in 30 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:58:57 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-593d0405-f98c-4ffe-9a94-ff56dca1e0e1 tempest-ServicesAdminTest-55852734 tempest-ServicesAdminTest-55852734-project-admin] GET http://10.27.203.238/share/v1/169e2bf0e6284c33bb6e8ba37eadf427/os-services?host=l75lg1-v1%40generic2&binary=manila-share&zone=nova&status=enabled&state=stopped May 28 12:58:57 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-593d0405-f98c-4ffe-9a94-ff56dca1e0e1 tempest-ServicesAdminTest-55852734 tempest-ServicesAdminTest-55852734-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:57 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-593d0405-f98c-4ffe-9a94-ff56dca1e0e1 tempest-ServicesAdminTest-55852734 tempest-ServicesAdminTest-55852734-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:57 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-593d0405-f98c-4ffe-9a94-ff56dca1e0e1 tempest-ServicesAdminTest-55852734 tempest-ServicesAdminTest-55852734-project-admin] http://10.27.203.238/share/v1/169e2bf0e6284c33bb6e8ba37eadf427/os-services?host=l75lg1-v1%40generic2&binary=manila-share&zone=nova&status=enabled&state=stopped returned with HTTP 200 May 28 12:58:57 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 617/1232] 10.27.203.238 () {62 vars in 1481 bytes} [Tue May 28 12:58:57 2024] GET /share/v1/169e2bf0e6284c33bb6e8ba37eadf427/os-services?host=l75lg1-v1%40generic2&binary=manila-share&zone=nova&status=enabled&state=stopped => generated 182 bytes in 15 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:58:57 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-0582a3bd-1a90-43c9-97e5-8ff6de178dd9 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] POST http://10.27.203.238/share/v2/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action May 28 12:58:57 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-0582a3bd-1a90-43c9-97e5-8ff6de178dd9 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Action body: b'{"allow_access": {"access_type": "ip", "access_to": "2001:0DB8:7e4b:7991:ec45:7fcc:8303:b1fa", "access_level": "rw"}}' {{(pid=98329) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:58:57 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-0582a3bd-1a90-43c9-97e5-8ff6de178dd9 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Action: 'action', calling method: ShareController.allow_access, body: {"allow_access": {"access_type": "ip", "access_to": "2001:0DB8:7e4b:7991:ec45:7fcc:8303:b1fa", "access_level": "rw"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:58:57 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-f8afa6ce-7a3d-4368-b90a-43acb4d52dd0 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/9e24a210-9e96-45d9-b31c-f6f3377eb0e7/metadata returned with HTTP 200 May 28 12:58:57 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 616/1233] 10.27.203.238 () {64 vars in 1478 bytes} [Tue May 28 12:58:57 2024] GET /share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/9e24a210-9e96-45d9-b31c-f6f3377eb0e7/metadata => generated 282 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:58:57 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-e4392b9c-24f5-4a3f-8063-231e392c4693 tempest-ServicesAdminTest-55852734 tempest-ServicesAdminTest-55852734-project-admin] GET http://10.27.203.238/share/v1/169e2bf0e6284c33bb6e8ba37eadf427/os-services May 28 12:58:57 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-e4392b9c-24f5-4a3f-8063-231e392c4693 tempest-ServicesAdminTest-55852734 tempest-ServicesAdminTest-55852734-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:57 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-e4392b9c-24f5-4a3f-8063-231e392c4693 tempest-ServicesAdminTest-55852734 tempest-ServicesAdminTest-55852734-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:57 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-e4392b9c-24f5-4a3f-8063-231e392c4693 tempest-ServicesAdminTest-55852734 tempest-ServicesAdminTest-55852734-project-admin] http://10.27.203.238/share/v1/169e2bf0e6284c33bb6e8ba37eadf427/os-services returned with HTTP 200 May 28 12:58:57 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 617/1234] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 12:58:57 2024] GET /share/v1/169e2bf0e6284c33bb6e8ba37eadf427/os-services => generated 820 bytes in 15 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:58:57 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-c790d9db-7ed3-4aa4-8dfb-e95747e20793 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] PUT http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/9e24a210-9e96-45d9-b31c-f6f3377eb0e7/metadata May 28 12:58:57 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-c790d9db-7ed3-4aa4-8dfb-e95747e20793 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Action: 'update_all_metadata', calling method: Controller.__getattribute__..version_select, body: {"metadata": {"key": "vvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvv"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:58:57 l75lg1-v1 devstack@m-api.service[98329]: DEBUG oslo_concurrency.lockutils [None req-0582a3bd-1a90-43c9-97e5-8ff6de178dd9 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98329) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:57 l75lg1-v1 devstack@m-api.service[98329]: DEBUG oslo_concurrency.lockutils [None req-0582a3bd-1a90-43c9-97e5-8ff6de178dd9 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98329) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98329]: DEBUG oslo_concurrency.lockutils [None req-0582a3bd-1a90-43c9-97e5-8ff6de178dd9 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.037s {{(pid=98329) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-0582a3bd-1a90-43c9-97e5-8ff6de178dd9 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] http://10.27.203.238/share/v2/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action returned with HTTP 200 May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 618/1235] 10.27.203.238 () {66 vars in 1494 bytes} [Tue May 28 12:58:57 2024] POST /share/v2/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action => generated 337 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-b30e5d23-d867-42bc-b5fc-74cbf3d16d56 tempest-ServicesAdminTest-55852734 tempest-ServicesAdminTest-55852734-project-admin] GET http://10.27.203.238/share/v2/169e2bf0e6284c33bb6e8ba37eadf427/services?host=l75lg1-v1%40generic2&binary=manila-share&zone=nova&status=enabled&state=stopped May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-b30e5d23-d867-42bc-b5fc-74cbf3d16d56 tempest-ServicesAdminTest-55852734 tempest-ServicesAdminTest-55852734-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-b30e5d23-d867-42bc-b5fc-74cbf3d16d56 tempest-ServicesAdminTest-55852734 tempest-ServicesAdminTest-55852734-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:58 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [-] Expecting reply to msg 11712578be834b97b5f56339fae73595 in queue reply_37f4cbd1dd094961a22b8a65f222c327 May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-b30e5d23-d867-42bc-b5fc-74cbf3d16d56 tempest-ServicesAdminTest-55852734 tempest-ServicesAdminTest-55852734-project-admin] http://10.27.203.238/share/v2/169e2bf0e6284c33bb6e8ba37eadf427/services?host=l75lg1-v1%40generic2&binary=manila-share&zone=nova&status=enabled&state=stopped returned with HTTP 200 May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 619/1236] 10.27.203.238 () {64 vars in 1515 bytes} [Tue May 28 12:58:58 2024] GET /share/v2/169e2bf0e6284c33bb6e8ba37eadf427/services?host=l75lg1-v1%40generic2&binary=manila-share&zone=nova&status=enabled&state=stopped => generated 207 bytes in 13 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-72c521bb-dee3-496f-878f-3618fef9acbb tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] GET http://10.27.203.238/share/v2/776f75906bc64f8f9316d5aab4b50bf1/share-access-rules?share_id=1ddadc17-cf10-4a42-8bbd-8335fb3520a1 May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-72c521bb-dee3-496f-878f-3618fef9acbb tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-72c521bb-dee3-496f-878f-3618fef9acbb tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:58 l75lg1-v1 manila-share[98474]: DEBUG manila.share.manager [None req-0582a3bd-1a90-43c9-97e5-8ff6de178dd9 tempest-ShareIpRulesForNFSTest-1748669711 None] Received request to update access for share instance b7a7d61c-2cea-442a-9809-507038e080d5. {{(pid=98474) update_access_for_instances /opt/stack/manila/manila/share/manager.py:4353}} May 28 12:58:58 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [-] Received RPC response for msg 11712578be834b97b5f56339fae73595 May 28 12:58:58 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-0582a3bd-1a90-43c9-97e5-8ff6de178dd9 tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:58 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-0582a3bd-1a90-43c9-97e5-8ff6de178dd9 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:58 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-0582a3bd-1a90-43c9-97e5-8ff6de178dd9 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:58 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-0582a3bd-1a90-43c9-97e5-8ff6de178dd9 tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.lock.api [None req-72c521bb-dee3-496f-878f-3618fef9acbb tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Searching for locks by: {'resource_id': 'dcbfb2d2-f874-4731-aecb-8d02b182cdd2', 'resource_action': 'show', 'resource_type': 'access_rule'} {{(pid=98329) get_all /opt/stack/manila/manila/lock/api.py:112}} May 28 12:58:58 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-0582a3bd-1a90-43c9-97e5-8ff6de178dd9 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-72c521bb-dee3-496f-878f-3618fef9acbb tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] http://10.27.203.238/share/v2/776f75906bc64f8f9316d5aab4b50bf1/share-access-rules?share_id=1ddadc17-cf10-4a42-8bbd-8335fb3520a1 returned with HTTP 200 May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 620/1237] 10.27.203.238 () {64 vars in 1467 bytes} [Tue May 28 12:58:58 2024] GET /share/v2/776f75906bc64f8f9316d5aab4b50bf1/share-access-rules?share_id=1ddadc17-cf10-4a42-8bbd-8335fb3520a1 => generated 292 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-d3eb95e1-772c-4797-9925-a81cb1449beb tempest-ServicesAdminTest-55852734 tempest-ServicesAdminTest-55852734-project-admin] GET http://10.27.203.238/share/v1/169e2bf0e6284c33bb6e8ba37eadf427/os-services May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-d3eb95e1-772c-4797-9925-a81cb1449beb tempest-ServicesAdminTest-55852734 tempest-ServicesAdminTest-55852734-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-d3eb95e1-772c-4797-9925-a81cb1449beb tempest-ServicesAdminTest-55852734 tempest-ServicesAdminTest-55852734-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-d3eb95e1-772c-4797-9925-a81cb1449beb tempest-ServicesAdminTest-55852734 tempest-ServicesAdminTest-55852734-project-admin] http://10.27.203.238/share/v1/169e2bf0e6284c33bb6e8ba37eadf427/os-services returned with HTTP 200 May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 621/1238] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 12:58:58 2024] GET /share/v1/169e2bf0e6284c33bb6e8ba37eadf427/os-services => generated 820 bytes in 13 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-7dd7673a-6f47-4046-875c-abbb7b35ae39 tempest-ServicesAdminTest-55852734 tempest-ServicesAdminTest-55852734-project-admin] GET http://10.27.203.238/share/v1/169e2bf0e6284c33bb6e8ba37eadf427/os-services?zone=nova May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-7dd7673a-6f47-4046-875c-abbb7b35ae39 tempest-ServicesAdminTest-55852734 tempest-ServicesAdminTest-55852734-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-7dd7673a-6f47-4046-875c-abbb7b35ae39 tempest-ServicesAdminTest-55852734 tempest-ServicesAdminTest-55852734-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-7dd7673a-6f47-4046-875c-abbb7b35ae39 tempest-ServicesAdminTest-55852734 tempest-ServicesAdminTest-55852734-project-admin] http://10.27.203.238/share/v1/169e2bf0e6284c33bb6e8ba37eadf427/os-services?zone=nova returned with HTTP 200 May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 622/1239] 10.27.203.238 () {62 vars in 1331 bytes} [Tue May 28 12:58:58 2024] GET /share/v1/169e2bf0e6284c33bb6e8ba37eadf427/os-services?zone=nova => generated 820 bytes in 13 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-6d603d08-0cc9-4854-8a0e-c533bf17d891 tempest-ServicesAdminTest-55852734 tempest-ServicesAdminTest-55852734-project-admin] GET http://10.27.203.238/share/v1/169e2bf0e6284c33bb6e8ba37eadf427/os-services May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-6d603d08-0cc9-4854-8a0e-c533bf17d891 tempest-ServicesAdminTest-55852734 tempest-ServicesAdminTest-55852734-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-6d603d08-0cc9-4854-8a0e-c533bf17d891 tempest-ServicesAdminTest-55852734 tempest-ServicesAdminTest-55852734-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-c790d9db-7ed3-4aa4-8dfb-e95747e20793 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/9e24a210-9e96-45d9-b31c-f6f3377eb0e7/metadata returned with HTTP 200 May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-6d603d08-0cc9-4854-8a0e-c533bf17d891 tempest-ServicesAdminTest-55852734 tempest-ServicesAdminTest-55852734-project-admin] http://10.27.203.238/share/v1/169e2bf0e6284c33bb6e8ba37eadf427/os-services returned with HTTP 200 May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 623/1240] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 12:58:58 2024] GET /share/v1/169e2bf0e6284c33bb6e8ba37eadf427/os-services => generated 820 bytes in 14 msecs (HTTP/1.1 200) 6 headers in 230 bytes (2 switches on core 0) May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 618/1241] 10.27.203.238 () {66 vars in 1500 bytes} [Tue May 28 12:58:57 2024] PUT /share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/9e24a210-9e96-45d9-b31c-f6f3377eb0e7/metadata => generated 1048 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-ddc4ee93-d75b-49c7-a1fb-c6672124978f tempest-ServicesAdminTest-55852734 tempest-ServicesAdminTest-55852734-project-admin] GET http://10.27.203.238/share/v2/169e2bf0e6284c33bb6e8ba37eadf427/services?zone=nova May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-ddc4ee93-d75b-49c7-a1fb-c6672124978f tempest-ServicesAdminTest-55852734 tempest-ServicesAdminTest-55852734-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-ddc4ee93-d75b-49c7-a1fb-c6672124978f tempest-ServicesAdminTest-55852734 tempest-ServicesAdminTest-55852734-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-13b32559-a48a-4bc8-a382-3865a0557371 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] GET http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/9e24a210-9e96-45d9-b31c-f6f3377eb0e7/metadata May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-13b32559-a48a-4bc8-a382-3865a0557371 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-13b32559-a48a-4bc8-a382-3865a0557371 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:58 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-0582a3bd-1a90-43c9-97e5-8ff6de178dd9 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.063s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:58 l75lg1-v1 manila-share[98474]: DEBUG manila.share.access [None req-0582a3bd-1a90-43c9-97e5-8ff6de178dd9 tempest-ShareIpRulesForNFSTest-1748669711 None] Updating access rules for share instance b7a7d61c-2cea-442a-9809-507038e080d5 belonging to share 1ddadc17-cf10-4a42-8bbd-8335fb3520a1. {{(pid=98474) update_access_rules /opt/stack/manila/manila/share/access.py:298}} May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-ddc4ee93-d75b-49c7-a1fb-c6672124978f tempest-ServicesAdminTest-55852734 tempest-ServicesAdminTest-55852734-project-admin] http://10.27.203.238/share/v2/169e2bf0e6284c33bb6e8ba37eadf427/services?zone=nova returned with HTTP 200 May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 624/1242] 10.27.203.238 () {64 vars in 1365 bytes} [Tue May 28 12:58:58 2024] GET /share/v2/169e2bf0e6284c33bb6e8ba37eadf427/services?zone=nova => generated 945 bytes in 13 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-ae526efd-3a4a-4e22-9453-93ea7bd058f7 tempest-ServicesAdminTest-55852734 tempest-ServicesAdminTest-55852734-project-admin] GET http://10.27.203.238/share/v1/169e2bf0e6284c33bb6e8ba37eadf427/os-services May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-ae526efd-3a4a-4e22-9453-93ea7bd058f7 tempest-ServicesAdminTest-55852734 tempest-ServicesAdminTest-55852734-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-ae526efd-3a4a-4e22-9453-93ea7bd058f7 tempest-ServicesAdminTest-55852734 tempest-ServicesAdminTest-55852734-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:58 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-0582a3bd-1a90-43c9-97e5-8ff6de178dd9 tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:58 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-0582a3bd-1a90-43c9-97e5-8ff6de178dd9 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-ae526efd-3a4a-4e22-9453-93ea7bd058f7 tempest-ServicesAdminTest-55852734 tempest-ServicesAdminTest-55852734-project-admin] http://10.27.203.238/share/v1/169e2bf0e6284c33bb6e8ba37eadf427/os-services returned with HTTP 200 May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 625/1243] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 12:58:58 2024] GET /share/v1/169e2bf0e6284c33bb6e8ba37eadf427/os-services => generated 820 bytes in 14 msecs (HTTP/1.1 200) 6 headers in 230 bytes (2 switches on core 0) May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-f0097c5a-5de0-4e92-9756-357f8e01a7af tempest-ServicesAdminTest-55852734 tempest-ServicesAdminTest-55852734-project-admin] GET http://10.27.203.238/share/v1/169e2bf0e6284c33bb6e8ba37eadf427/os-services?binary=manila-share May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-f0097c5a-5de0-4e92-9756-357f8e01a7af tempest-ServicesAdminTest-55852734 tempest-ServicesAdminTest-55852734-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-f0097c5a-5de0-4e92-9756-357f8e01a7af tempest-ServicesAdminTest-55852734 tempest-ServicesAdminTest-55852734-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:58 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-0582a3bd-1a90-43c9-97e5-8ff6de178dd9 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.008s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:58 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-0582a3bd-1a90-43c9-97e5-8ff6de178dd9 tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:58 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-0582a3bd-1a90-43c9-97e5-8ff6de178dd9 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-f0097c5a-5de0-4e92-9756-357f8e01a7af tempest-ServicesAdminTest-55852734 tempest-ServicesAdminTest-55852734-project-admin] http://10.27.203.238/share/v1/169e2bf0e6284c33bb6e8ba37eadf427/os-services?binary=manila-share returned with HTTP 200 May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 626/1244] 10.27.203.238 () {62 vars in 1351 bytes} [Tue May 28 12:58:58 2024] GET /share/v1/169e2bf0e6284c33bb6e8ba37eadf427/os-services?binary=manila-share => generated 509 bytes in 15 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:58:58 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-0582a3bd-1a90-43c9-97e5-8ff6de178dd9 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.015s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:58 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-0582a3bd-1a90-43c9-97e5-8ff6de178dd9 tempest-ShareIpRulesForNFSTest-1748669711 None] changing access on None May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-030cfd4f-7769-4655-851e-bfa5467177c1 tempest-ServicesAdminTest-55852734 tempest-ServicesAdminTest-55852734-project-admin] GET http://10.27.203.238/share/v1/169e2bf0e6284c33bb6e8ba37eadf427/os-services May 28 12:58:58 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0582a3bd-1a90-43c9-97e5-8ff6de178dd9 tempest-ShareIpRulesForNFSTest-1748669711 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-030cfd4f-7769-4655-851e-bfa5467177c1 tempest-ServicesAdminTest-55852734 tempest-ServicesAdminTest-55852734-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:58 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0582a3bd-1a90-43c9-97e5-8ff6de178dd9 tempest-ShareIpRulesForNFSTest-1748669711 None] {'allow_redirects': True, May 28 12:58:58 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0582a3bd-1a90-43c9-97e5-8ff6de178dd9 tempest-ShareIpRulesForNFSTest-1748669711 None] 'params': {'name': 'b7a7d61c-2cea-442a-9809-507038e080d5'}} May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-030cfd4f-7769-4655-851e-bfa5467177c1 tempest-ServicesAdminTest-55852734 tempest-ServicesAdminTest-55852734-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-13b32559-a48a-4bc8-a382-3865a0557371 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/9e24a210-9e96-45d9-b31c-f6f3377eb0e7/metadata returned with HTTP 200 May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 619/1245] 10.27.203.238 () {64 vars in 1478 bytes} [Tue May 28 12:58:58 2024] GET /share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/9e24a210-9e96-45d9-b31c-f6f3377eb0e7/metadata => generated 1048 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 232 bytes (2 switches on core 0) May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-030cfd4f-7769-4655-851e-bfa5467177c1 tempest-ServicesAdminTest-55852734 tempest-ServicesAdminTest-55852734-project-admin] http://10.27.203.238/share/v1/169e2bf0e6284c33bb6e8ba37eadf427/os-services returned with HTTP 200 May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 627/1246] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 12:58:58 2024] GET /share/v1/169e2bf0e6284c33bb6e8ba37eadf427/os-services => generated 820 bytes in 16 msecs (HTTP/1.1 200) 6 headers in 230 bytes (2 switches on core 0) May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-4bc32dfa-0ebe-4cf4-b7ae-83bc938cda79 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] PUT http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/9e24a210-9e96-45d9-b31c-f6f3377eb0e7/metadata May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-4bc32dfa-0ebe-4cf4-b7ae-83bc938cda79 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Action: 'update_all_metadata', calling method: Controller.__getattribute__..version_select, body: {"metadata": {"k": "value"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-3fca6a88-02f1-4680-9432-503ba4da8739 tempest-ServicesAdminTest-55852734 tempest-ServicesAdminTest-55852734-project-admin] GET http://10.27.203.238/share/v2/169e2bf0e6284c33bb6e8ba37eadf427/services?binary=manila-share May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-3fca6a88-02f1-4680-9432-503ba4da8739 tempest-ServicesAdminTest-55852734 tempest-ServicesAdminTest-55852734-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-3fca6a88-02f1-4680-9432-503ba4da8739 tempest-ServicesAdminTest-55852734 tempest-ServicesAdminTest-55852734-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-3fca6a88-02f1-4680-9432-503ba4da8739 tempest-ServicesAdminTest-55852734 tempest-ServicesAdminTest-55852734-project-admin] http://10.27.203.238/share/v2/169e2bf0e6284c33bb6e8ba37eadf427/services?binary=manila-share returned with HTTP 200 May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 628/1247] 10.27.203.238 () {64 vars in 1385 bytes} [Tue May 28 12:58:58 2024] GET /share/v2/169e2bf0e6284c33bb6e8ba37eadf427/services?binary=manila-share => generated 584 bytes in 15 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-d9710a35-42c1-4e17-882c-f5d25dd639c7 tempest-ServicesAdminTest-55852734 tempest-ServicesAdminTest-55852734-project-admin] GET http://10.27.203.238/share/v1/169e2bf0e6284c33bb6e8ba37eadf427/os-services May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-d9710a35-42c1-4e17-882c-f5d25dd639c7 tempest-ServicesAdminTest-55852734 tempest-ServicesAdminTest-55852734-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-d9710a35-42c1-4e17-882c-f5d25dd639c7 tempest-ServicesAdminTest-55852734 tempest-ServicesAdminTest-55852734-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-d9710a35-42c1-4e17-882c-f5d25dd639c7 tempest-ServicesAdminTest-55852734 tempest-ServicesAdminTest-55852734-project-admin] http://10.27.203.238/share/v1/169e2bf0e6284c33bb6e8ba37eadf427/os-services returned with HTTP 200 May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 629/1248] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 12:58:58 2024] GET /share/v1/169e2bf0e6284c33bb6e8ba37eadf427/os-services => generated 820 bytes in 14 msecs (HTTP/1.1 200) 6 headers in 230 bytes (2 switches on core 0) May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-3b80f66e-805f-404a-a622-0a255e44ee61 tempest-ServicesAdminTest-55852734 tempest-ServicesAdminTest-55852734-project-admin] GET http://10.27.203.238/share/v1/169e2bf0e6284c33bb6e8ba37eadf427/os-services?host=l75lg1-v1%40generic2 May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-3b80f66e-805f-404a-a622-0a255e44ee61 tempest-ServicesAdminTest-55852734 tempest-ServicesAdminTest-55852734-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-3b80f66e-805f-404a-a622-0a255e44ee61 tempest-ServicesAdminTest-55852734 tempest-ServicesAdminTest-55852734-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-3b80f66e-805f-404a-a622-0a255e44ee61 tempest-ServicesAdminTest-55852734 tempest-ServicesAdminTest-55852734-project-admin] http://10.27.203.238/share/v1/169e2bf0e6284c33bb6e8ba37eadf427/os-services?host=l75lg1-v1%40generic2 returned with HTTP 200 May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 630/1249] 10.27.203.238 () {62 vars in 1363 bytes} [Tue May 28 12:58:58 2024] GET /share/v1/169e2bf0e6284c33bb6e8ba37eadf427/os-services?host=l75lg1-v1%40generic2 => generated 182 bytes in 21 msecs (HTTP/1.1 200) 6 headers in 230 bytes (2 switches on core 0) May 28 12:58:58 l75lg1-v1 dstat.sh[49771]: 28-05 12:58:58| 18 1 77 3 0|5728M 1749M 277M 7871M| 16k 22k| 0 3201k| 0 386 |9102 15k|1.00 1.02 1.00|3.0 1.0 2.0| 0 0 | 0 2048M| 29 361 0 30 0 May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-82a7ec70-9c3d-4d35-89ea-70988715a359 tempest-ServicesAdminTest-55852734 tempest-ServicesAdminTest-55852734-project-admin] GET http://10.27.203.238/share/v1/169e2bf0e6284c33bb6e8ba37eadf427/os-services May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-82a7ec70-9c3d-4d35-89ea-70988715a359 tempest-ServicesAdminTest-55852734 tempest-ServicesAdminTest-55852734-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-82a7ec70-9c3d-4d35-89ea-70988715a359 tempest-ServicesAdminTest-55852734 tempest-ServicesAdminTest-55852734-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-82a7ec70-9c3d-4d35-89ea-70988715a359 tempest-ServicesAdminTest-55852734 tempest-ServicesAdminTest-55852734-project-admin] http://10.27.203.238/share/v1/169e2bf0e6284c33bb6e8ba37eadf427/os-services returned with HTTP 200 May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 631/1250] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 12:58:58 2024] GET /share/v1/169e2bf0e6284c33bb6e8ba37eadf427/os-services => generated 820 bytes in 17 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-9b1b67b9-b888-4590-bb91-0b3efa7173e6 tempest-ServicesAdminTest-55852734 tempest-ServicesAdminTest-55852734-project-admin] GET http://10.27.203.238/share/v2/169e2bf0e6284c33bb6e8ba37eadf427/services?host=l75lg1-v1%40generic2 May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-9b1b67b9-b888-4590-bb91-0b3efa7173e6 tempest-ServicesAdminTest-55852734 tempest-ServicesAdminTest-55852734-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-9b1b67b9-b888-4590-bb91-0b3efa7173e6 tempest-ServicesAdminTest-55852734 tempest-ServicesAdminTest-55852734-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-9b1b67b9-b888-4590-bb91-0b3efa7173e6 tempest-ServicesAdminTest-55852734 tempest-ServicesAdminTest-55852734-project-admin] http://10.27.203.238/share/v2/169e2bf0e6284c33bb6e8ba37eadf427/services?host=l75lg1-v1%40generic2 returned with HTTP 200 May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 632/1251] 10.27.203.238 () {64 vars in 1397 bytes} [Tue May 28 12:58:58 2024] GET /share/v2/169e2bf0e6284c33bb6e8ba37eadf427/services?host=l75lg1-v1%40generic2 => generated 207 bytes in 13 msecs (HTTP/1.1 200) 6 headers in 231 bytes (2 switches on core 0) May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-3084e684-40a2-486f-a269-02bc876f64e5 tempest-ServicesAdminTest-55852734 tempest-ServicesAdminTest-55852734-project-admin] GET http://10.27.203.238/share/v1/169e2bf0e6284c33bb6e8ba37eadf427/os-services May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-3084e684-40a2-486f-a269-02bc876f64e5 tempest-ServicesAdminTest-55852734 tempest-ServicesAdminTest-55852734-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-3084e684-40a2-486f-a269-02bc876f64e5 tempest-ServicesAdminTest-55852734 tempest-ServicesAdminTest-55852734-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-3084e684-40a2-486f-a269-02bc876f64e5 tempest-ServicesAdminTest-55852734 tempest-ServicesAdminTest-55852734-project-admin] http://10.27.203.238/share/v1/169e2bf0e6284c33bb6e8ba37eadf427/os-services returned with HTTP 200 May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 633/1252] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 12:58:58 2024] GET /share/v1/169e2bf0e6284c33bb6e8ba37eadf427/os-services => generated 820 bytes in 14 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-db16f689-dc25-4ec1-84d1-1c7a139e2270 tempest-ServicesAdminTest-55852734 tempest-ServicesAdminTest-55852734-project-admin] GET http://10.27.203.238/share/v1/169e2bf0e6284c33bb6e8ba37eadf427/os-services?state=stopped May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-db16f689-dc25-4ec1-84d1-1c7a139e2270 tempest-ServicesAdminTest-55852734 tempest-ServicesAdminTest-55852734-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-db16f689-dc25-4ec1-84d1-1c7a139e2270 tempest-ServicesAdminTest-55852734 tempest-ServicesAdminTest-55852734-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-db16f689-dc25-4ec1-84d1-1c7a139e2270 tempest-ServicesAdminTest-55852734 tempest-ServicesAdminTest-55852734-project-admin] http://10.27.203.238/share/v1/169e2bf0e6284c33bb6e8ba37eadf427/os-services?state=stopped returned with HTTP 200 May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 634/1253] 10.27.203.238 () {62 vars in 1339 bytes} [Tue May 28 12:58:58 2024] GET /share/v1/169e2bf0e6284c33bb6e8ba37eadf427/os-services?state=stopped => generated 350 bytes in 14 msecs (HTTP/1.1 200) 6 headers in 230 bytes (2 switches on core 0) May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-b81dff8e-34b1-4689-b7d4-4be9851ae19b tempest-ServicesAdminTest-55852734 tempest-ServicesAdminTest-55852734-project-admin] GET http://10.27.203.238/share/v1/169e2bf0e6284c33bb6e8ba37eadf427/os-services May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-b81dff8e-34b1-4689-b7d4-4be9851ae19b tempest-ServicesAdminTest-55852734 tempest-ServicesAdminTest-55852734-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-b81dff8e-34b1-4689-b7d4-4be9851ae19b tempest-ServicesAdminTest-55852734 tempest-ServicesAdminTest-55852734-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-b81dff8e-34b1-4689-b7d4-4be9851ae19b tempest-ServicesAdminTest-55852734 tempest-ServicesAdminTest-55852734-project-admin] http://10.27.203.238/share/v1/169e2bf0e6284c33bb6e8ba37eadf427/os-services returned with HTTP 200 May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 635/1254] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 12:58:58 2024] GET /share/v1/169e2bf0e6284c33bb6e8ba37eadf427/os-services => generated 820 bytes in 14 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-06ad346e-6926-48c9-863c-9efbbf05f8a2 tempest-ServicesAdminTest-55852734 tempest-ServicesAdminTest-55852734-project-admin] GET http://10.27.203.238/share/v2/169e2bf0e6284c33bb6e8ba37eadf427/services?state=stopped May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-06ad346e-6926-48c9-863c-9efbbf05f8a2 tempest-ServicesAdminTest-55852734 tempest-ServicesAdminTest-55852734-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-06ad346e-6926-48c9-863c-9efbbf05f8a2 tempest-ServicesAdminTest-55852734 tempest-ServicesAdminTest-55852734-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-06ad346e-6926-48c9-863c-9efbbf05f8a2 tempest-ServicesAdminTest-55852734 tempest-ServicesAdminTest-55852734-project-admin] http://10.27.203.238/share/v2/169e2bf0e6284c33bb6e8ba37eadf427/services?state=stopped returned with HTTP 200 May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 636/1255] 10.27.203.238 () {64 vars in 1373 bytes} [Tue May 28 12:58:58 2024] GET /share/v2/169e2bf0e6284c33bb6e8ba37eadf427/services?state=stopped => generated 400 bytes in 14 msecs (HTTP/1.1 200) 6 headers in 231 bytes (2 switches on core 0) May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-61fb0984-149a-4182-831f-7e02460cdcc0 tempest-ServicesAdminTest-55852734 tempest-ServicesAdminTest-55852734-project-admin] GET http://10.27.203.238/share/v1/169e2bf0e6284c33bb6e8ba37eadf427/os-services May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-61fb0984-149a-4182-831f-7e02460cdcc0 tempest-ServicesAdminTest-55852734 tempest-ServicesAdminTest-55852734-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-61fb0984-149a-4182-831f-7e02460cdcc0 tempest-ServicesAdminTest-55852734 tempest-ServicesAdminTest-55852734-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-61fb0984-149a-4182-831f-7e02460cdcc0 tempest-ServicesAdminTest-55852734 tempest-ServicesAdminTest-55852734-project-admin] http://10.27.203.238/share/v1/169e2bf0e6284c33bb6e8ba37eadf427/os-services returned with HTTP 200 May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 637/1256] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 12:58:58 2024] GET /share/v1/169e2bf0e6284c33bb6e8ba37eadf427/os-services => generated 820 bytes in 14 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-e576d2aa-5b14-421c-9555-cce3a956549f tempest-ServicesAdminTest-55852734 tempest-ServicesAdminTest-55852734-project-admin] GET http://10.27.203.238/share/v1/169e2bf0e6284c33bb6e8ba37eadf427/os-services?status=enabled May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-e576d2aa-5b14-421c-9555-cce3a956549f tempest-ServicesAdminTest-55852734 tempest-ServicesAdminTest-55852734-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-e576d2aa-5b14-421c-9555-cce3a956549f tempest-ServicesAdminTest-55852734 tempest-ServicesAdminTest-55852734-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-4bc32dfa-0ebe-4cf4-b7ae-83bc938cda79 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/9e24a210-9e96-45d9-b31c-f6f3377eb0e7/metadata returned with HTTP 200 May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 620/1257] 10.27.203.238 () {66 vars in 1498 bytes} [Tue May 28 12:58:58 2024] PUT /share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/9e24a210-9e96-45d9-b31c-f6f3377eb0e7/metadata => generated 28 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-e576d2aa-5b14-421c-9555-cce3a956549f tempest-ServicesAdminTest-55852734 tempest-ServicesAdminTest-55852734-project-admin] http://10.27.203.238/share/v1/169e2bf0e6284c33bb6e8ba37eadf427/os-services?status=enabled returned with HTTP 200 May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 638/1258] 10.27.203.238 () {62 vars in 1341 bytes} [Tue May 28 12:58:58 2024] GET /share/v1/169e2bf0e6284c33bb6e8ba37eadf427/os-services?status=enabled => generated 820 bytes in 13 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-55cc8967-11af-49a9-942c-bbd2e6567b38 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] GET http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/9e24a210-9e96-45d9-b31c-f6f3377eb0e7/metadata May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-55cc8967-11af-49a9-942c-bbd2e6567b38 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-55cc8967-11af-49a9-942c-bbd2e6567b38 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-349cea07-5bf2-45e1-8002-c3530647660f tempest-ServicesAdminTest-55852734 tempest-ServicesAdminTest-55852734-project-admin] GET http://10.27.203.238/share/v1/169e2bf0e6284c33bb6e8ba37eadf427/os-services May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-349cea07-5bf2-45e1-8002-c3530647660f tempest-ServicesAdminTest-55852734 tempest-ServicesAdminTest-55852734-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-349cea07-5bf2-45e1-8002-c3530647660f tempest-ServicesAdminTest-55852734 tempest-ServicesAdminTest-55852734-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-349cea07-5bf2-45e1-8002-c3530647660f tempest-ServicesAdminTest-55852734 tempest-ServicesAdminTest-55852734-project-admin] http://10.27.203.238/share/v1/169e2bf0e6284c33bb6e8ba37eadf427/os-services returned with HTTP 200 May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 639/1259] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 12:58:58 2024] GET /share/v1/169e2bf0e6284c33bb6e8ba37eadf427/os-services => generated 820 bytes in 14 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-6d04335c-405d-407c-8e37-176805044859 tempest-ServicesAdminTest-55852734 tempest-ServicesAdminTest-55852734-project-admin] GET http://10.27.203.238/share/v2/169e2bf0e6284c33bb6e8ba37eadf427/services?status=enabled May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-6d04335c-405d-407c-8e37-176805044859 tempest-ServicesAdminTest-55852734 tempest-ServicesAdminTest-55852734-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-6d04335c-405d-407c-8e37-176805044859 tempest-ServicesAdminTest-55852734 tempest-ServicesAdminTest-55852734-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-6d04335c-405d-407c-8e37-176805044859 tempest-ServicesAdminTest-55852734 tempest-ServicesAdminTest-55852734-project-admin] http://10.27.203.238/share/v2/169e2bf0e6284c33bb6e8ba37eadf427/services?status=enabled returned with HTTP 200 May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 640/1260] 10.27.203.238 () {64 vars in 1375 bytes} [Tue May 28 12:58:58 2024] GET /share/v2/169e2bf0e6284c33bb6e8ba37eadf427/services?status=enabled => generated 945 bytes in 15 msecs (HTTP/1.1 200) 6 headers in 231 bytes (2 switches on core 0) May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-c7ebf073-0c89-4d1d-9e0c-89db7c87022f tempest-ServicesAdminTest-55852734 tempest-ServicesAdminTest-55852734-project-admin] GET http://10.27.203.238/share/v1/169e2bf0e6284c33bb6e8ba37eadf427/os-services May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-c7ebf073-0c89-4d1d-9e0c-89db7c87022f tempest-ServicesAdminTest-55852734 tempest-ServicesAdminTest-55852734-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-c7ebf073-0c89-4d1d-9e0c-89db7c87022f tempest-ServicesAdminTest-55852734 tempest-ServicesAdminTest-55852734-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-c7ebf073-0c89-4d1d-9e0c-89db7c87022f tempest-ServicesAdminTest-55852734 tempest-ServicesAdminTest-55852734-project-admin] http://10.27.203.238/share/v1/169e2bf0e6284c33bb6e8ba37eadf427/os-services returned with HTTP 200 May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 641/1261] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 12:58:58 2024] GET /share/v1/169e2bf0e6284c33bb6e8ba37eadf427/os-services => generated 820 bytes in 20 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-35f09c98-2ff8-4126-8ed2-e5ae07a501e6 tempest-ServicesAdminTest-55852734 tempest-ServicesAdminTest-55852734-project-admin] GET http://10.27.203.238/share/v1/169e2bf0e6284c33bb6e8ba37eadf427/os-services May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-35f09c98-2ff8-4126-8ed2-e5ae07a501e6 tempest-ServicesAdminTest-55852734 tempest-ServicesAdminTest-55852734-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-35f09c98-2ff8-4126-8ed2-e5ae07a501e6 tempest-ServicesAdminTest-55852734 tempest-ServicesAdminTest-55852734-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-55cc8967-11af-49a9-942c-bbd2e6567b38 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/9e24a210-9e96-45d9-b31c-f6f3377eb0e7/metadata returned with HTTP 200 May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 621/1262] 10.27.203.238 () {64 vars in 1478 bytes} [Tue May 28 12:58:58 2024] GET /share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/9e24a210-9e96-45d9-b31c-f6f3377eb0e7/metadata => generated 28 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 230 bytes (2 switches on core 0) May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-b9516bdd-419a-4d02-bf3c-843d169533d0 tempest-PublicSharesTest-1667420263 tempest-PublicSharesTest-1667420263-project-member] GET http://10.27.203.238/share/v2/6d36e1eb1dbc449db6aca75b12a2ba18/shares/84e821d0-2b62-48db-80c7-259f61a14bac May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-b9516bdd-419a-4d02-bf3c-843d169533d0 tempest-PublicSharesTest-1667420263 tempest-PublicSharesTest-1667420263-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-b9516bdd-419a-4d02-bf3c-843d169533d0 tempest-PublicSharesTest-1667420263 tempest-PublicSharesTest-1667420263-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-35f09c98-2ff8-4126-8ed2-e5ae07a501e6 tempest-ServicesAdminTest-55852734 tempest-ServicesAdminTest-55852734-project-admin] http://10.27.203.238/share/v1/169e2bf0e6284c33bb6e8ba37eadf427/os-services returned with HTTP 200 May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 642/1263] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 12:58:58 2024] GET /share/v1/169e2bf0e6284c33bb6e8ba37eadf427/os-services => generated 820 bytes in 16 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-9ec4e405-e7f3-42b6-84a8-cb5a893aa1f3 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] PUT http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/9e24a210-9e96-45d9-b31c-f6f3377eb0e7/metadata May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-9ec4e405-e7f3-42b6-84a8-cb5a893aa1f3 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Action: 'update_all_metadata', calling method: Controller.__getattribute__..version_select, body: {"metadata": {"key": "v"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-b9516bdd-419a-4d02-bf3c-843d169533d0 tempest-PublicSharesTest-1667420263 tempest-PublicSharesTest-1667420263-project-member] http://10.27.203.238/share/v2/6d36e1eb1dbc449db6aca75b12a2ba18/shares/84e821d0-2b62-48db-80c7-259f61a14bac returned with HTTP 200 May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 622/1264] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:58:58 2024] GET /share/v2/6d36e1eb1dbc449db6aca75b12a2ba18/shares/84e821d0-2b62-48db-80c7-259f61a14bac => generated 1320 bytes in 27 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-c6ce44fc-3b63-463e-aaab-6aeffefd3196 tempest-ServicesAdminTest-55852734 tempest-ServicesAdminTest-55852734-project-admin] GET http://10.27.203.238/share/v1/169e2bf0e6284c33bb6e8ba37eadf427/os-services May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-c6ce44fc-3b63-463e-aaab-6aeffefd3196 tempest-ServicesAdminTest-55852734 tempest-ServicesAdminTest-55852734-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-c6ce44fc-3b63-463e-aaab-6aeffefd3196 tempest-ServicesAdminTest-55852734 tempest-ServicesAdminTest-55852734-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-c6ce44fc-3b63-463e-aaab-6aeffefd3196 tempest-ServicesAdminTest-55852734 tempest-ServicesAdminTest-55852734-project-admin] http://10.27.203.238/share/v1/169e2bf0e6284c33bb6e8ba37eadf427/os-services returned with HTTP 200 May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 623/1265] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 12:58:58 2024] GET /share/v1/169e2bf0e6284c33bb6e8ba37eadf427/os-services => generated 820 bytes in 16 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-14ffe815-905e-4dba-9c01-6ab89048c032 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] GET http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/5aa4e646-010d-48b4-8194-715d8ba7e33c May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-14ffe815-905e-4dba-9c01-6ab89048c032 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-14ffe815-905e-4dba-9c01-6ab89048c032 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:58 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0582a3bd-1a90-43c9-97e5-8ff6de178dd9 tempest-ShareIpRulesForNFSTest-1748669711 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:58:58 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0582a3bd-1a90-43c9-97e5-8ff6de178dd9 tempest-ShareIpRulesForNFSTest-1748669711 None] [Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=1, created='2024-05-28T12:57:40.763635Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='377955ad-d094-4e49-ab32-1021d943a572', id=21, internal=False, is_s3_default_policy=False, name='b7a7d61c-2cea-442a-9809-507038e080d5', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=['*'], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=[], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=[], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T12:58:50.758361Z', tenant_id=1, tenant_name='default', title='b7a7d61c-2cea-442a-9809-507038e080d5', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/21/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[])] May 28 12:58:58 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0582a3bd-1a90-43c9-97e5-8ff6de178dd9 tempest-ShareIpRulesForNFSTest-1748669711 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 12:58:58 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-0582a3bd-1a90-43c9-97e5-8ff6de178dd9 tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:58 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-0582a3bd-1a90-43c9-97e5-8ff6de178dd9 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-14ffe815-905e-4dba-9c01-6ab89048c032 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/5aa4e646-010d-48b4-8194-715d8ba7e33c returned with HTTP 200 May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 624/1266] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:58:58 2024] GET /share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/5aa4e646-010d-48b4-8194-715d8ba7e33c => generated 1275 bytes in 27 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-a647b2c2-7926-4ece-9297-03675fae1def tempest-PublicSharesTest-1667420263 tempest-PublicSharesTest-1667420263-project-member] GET http://10.27.203.238/share/v2/6d36e1eb1dbc449db6aca75b12a2ba18/shares/84e821d0-2b62-48db-80c7-259f61a14bac May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-a647b2c2-7926-4ece-9297-03675fae1def tempest-PublicSharesTest-1667420263 tempest-PublicSharesTest-1667420263-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-a647b2c2-7926-4ece-9297-03675fae1def tempest-PublicSharesTest-1667420263 tempest-PublicSharesTest-1667420263-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-a647b2c2-7926-4ece-9297-03675fae1def tempest-PublicSharesTest-1667420263 tempest-PublicSharesTest-1667420263-project-member] http://10.27.203.238/share/v2/6d36e1eb1dbc449db6aca75b12a2ba18/shares/84e821d0-2b62-48db-80c7-259f61a14bac returned with HTTP 200 May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 625/1267] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:58:58 2024] GET /share/v2/6d36e1eb1dbc449db6aca75b12a2ba18/shares/84e821d0-2b62-48db-80c7-259f61a14bac => generated 1320 bytes in 23 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-568b1a0c-f19f-46ed-995e-702684a24a41 tempest-ServicesAdminTest-55852734 tempest-ServicesAdminTest-55852734-project-admin] GET http://10.27.203.238/share/v2/169e2bf0e6284c33bb6e8ba37eadf427/services May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-568b1a0c-f19f-46ed-995e-702684a24a41 tempest-ServicesAdminTest-55852734 tempest-ServicesAdminTest-55852734-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-568b1a0c-f19f-46ed-995e-702684a24a41 tempest-ServicesAdminTest-55852734 tempest-ServicesAdminTest-55852734-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-568b1a0c-f19f-46ed-995e-702684a24a41 tempest-ServicesAdminTest-55852734 tempest-ServicesAdminTest-55852734-project-admin] http://10.27.203.238/share/v2/169e2bf0e6284c33bb6e8ba37eadf427/services returned with HTTP 200 May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 626/1268] 10.27.203.238 () {64 vars in 1346 bytes} [Tue May 28 12:58:58 2024] GET /share/v2/169e2bf0e6284c33bb6e8ba37eadf427/services => generated 945 bytes in 14 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-8acfa454-eaeb-4960-8ed5-9585b23a6675 tempest-ShareIpRulesForNFSNegativeTest-700172924 tempest-ShareIpRulesForNFSNegativeTest-700172924-project-admin] POST http://10.27.203.238/share/v2/8f81d1d8d7c946e8aa46d6e3e510424c/shares/5aa4e646-010d-48b4-8194-715d8ba7e33c/action May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-8acfa454-eaeb-4960-8ed5-9585b23a6675 tempest-ShareIpRulesForNFSNegativeTest-700172924 tempest-ShareIpRulesForNFSNegativeTest-700172924-project-admin] Action body: b'{"allow_access": {"access_type": "ip", "access_to": "203.0.113.134", "access_level": null}}' {{(pid=98330) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-8acfa454-eaeb-4960-8ed5-9585b23a6675 tempest-ShareIpRulesForNFSNegativeTest-700172924 tempest-ShareIpRulesForNFSNegativeTest-700172924-project-admin] Action: 'action', calling method: ShareController.allow_access, body: {"allow_access": {"access_type": "ip", "access_to": "203.0.113.134", "access_level": null}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4107a1f-3a19-4c9a-8f1e-474ffe347d81 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-8acfa454-eaeb-4960-8ed5-9585b23a6675 tempest-ShareIpRulesForNFSNegativeTest-700172924 tempest-ShareIpRulesForNFSNegativeTest-700172924-project-admin] http://10.27.203.238/share/v2/8f81d1d8d7c946e8aa46d6e3e510424c/shares/5aa4e646-010d-48b4-8194-715d8ba7e33c/action returned with HTTP 400 May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 627/1269] 10.27.203.238 () {66 vars in 1493 bytes} [Tue May 28 12:58:58 2024] POST /share/v2/8f81d1d8d7c946e8aa46d6e3e510424c/shares/5aa4e646-010d-48b4-8194-715d8ba7e33c/action => generated 183 bytes in 26 msecs (HTTP/1.1 400) 6 headers in 240 bytes (1 switches on core 0) May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-557a9bba-398e-4064-9d73-ebaf403235cd tempest-PublicSharesTest-118543418 tempest-PublicSharesTest-118543418-project-admin] PUT http://10.27.203.238/share/v2/8ee1466a8fe242afa8e0d0378840bfc1/shares/84e821d0-2b62-48db-80c7-259f61a14bac May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-557a9bba-398e-4064-9d73-ebaf403235cd tempest-PublicSharesTest-118543418 tempest-PublicSharesTest-118543418-project-admin] Action: 'update', calling method: ShareMixin.update, body: {"share": {"display_name": "tempest-tempest-new-share-name-250575016", "display_description": "share is now updated", "is_public": true}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:58:58 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-0582a3bd-1a90-43c9-97e5-8ff6de178dd9 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.077s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:58 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-0582a3bd-1a90-43c9-97e5-8ff6de178dd9 tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:58 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-0582a3bd-1a90-43c9-97e5-8ff6de178dd9 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:58 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-0582a3bd-1a90-43c9-97e5-8ff6de178dd9 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:58 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-0582a3bd-1a90-43c9-97e5-8ff6de178dd9 tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:58 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-0582a3bd-1a90-43c9-97e5-8ff6de178dd9 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:58 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-0582a3bd-1a90-43c9-97e5-8ff6de178dd9 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:58 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-0582a3bd-1a90-43c9-97e5-8ff6de178dd9 tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:58 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-0582a3bd-1a90-43c9-97e5-8ff6de178dd9 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:58 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-0582a3bd-1a90-43c9-97e5-8ff6de178dd9 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:58 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-0582a3bd-1a90-43c9-97e5-8ff6de178dd9 tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:58 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-0582a3bd-1a90-43c9-97e5-8ff6de178dd9 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4107a1f-3a19-4c9a-8f1e-474ffe347d81 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd277538-cfe4-4fa4-ba26-85814384fdb2 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd277538-cfe4-4fa4-ba26-85814384fdb2 None admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd277538-cfe4-4fa4-ba26-85814384fdb2 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd277538-cfe4-4fa4-ba26-85814384fdb2 None admin] PATH_INFO: `/v3/users/07cff7a575184066b67f8e453f02c2e6` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd277538-cfe4-4fa4-ba26-85814384fdb2 None admin] RBAC: Authorizing `identity:delete_user(user_id=07cff7a575184066b67f8e453f02c2e6)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd277538-cfe4-4fa4-ba26-85814384fdb2 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-557a9bba-398e-4064-9d73-ebaf403235cd tempest-PublicSharesTest-118543418 tempest-PublicSharesTest-118543418-project-admin] http://10.27.203.238/share/v2/8ee1466a8fe242afa8e0d0378840bfc1/shares/84e821d0-2b62-48db-80c7-259f61a14bac returned with HTTP 200 May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 628/1270] 10.27.203.238 () {66 vars in 1472 bytes} [Tue May 28 12:58:58 2024] PUT /share/v2/8ee1466a8fe242afa8e0d0378840bfc1/shares/84e821d0-2b62-48db-80c7-259f61a14bac => generated 1377 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-3d80c349-a0ae-40b1-b58e-cbe7d399bd63 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] GET http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/share-replicas/detail?share_id=5aa4e646-010d-48b4-8194-715d8ba7e33c May 28 12:58:58 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-0582a3bd-1a90-43c9-97e5-8ff6de178dd9 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.073s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:58 l75lg1-v1 manila-share[98474]: INFO manila.share.access [None req-0582a3bd-1a90-43c9-97e5-8ff6de178dd9 tempest-ShareIpRulesForNFSTest-1748669711 None] Access rules were successfully modified for share instance b7a7d61c-2cea-442a-9809-507038e080d5 belonging to share 1ddadc17-cf10-4a42-8bbd-8335fb3520a1. May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-3d80c349-a0ae-40b1-b58e-cbe7d399bd63 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-3d80c349-a0ae-40b1-b58e-cbe7d399bd63 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-9ec4e405-e7f3-42b6-84a8-cb5a893aa1f3 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/9e24a210-9e96-45d9-b31c-f6f3377eb0e7/metadata returned with HTTP 200 May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 643/1271] 10.27.203.238 () {66 vars in 1498 bytes} [Tue May 28 12:58:58 2024] PUT /share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/9e24a210-9e96-45d9-b31c-f6f3377eb0e7/metadata => generated 26 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-3d80c349-a0ae-40b1-b58e-cbe7d399bd63 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/share-replicas/detail?share_id=5aa4e646-010d-48b4-8194-715d8ba7e33c returned with HTTP 200 May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-718b23d5-09b4-4f33-9e66-60daa7801858 tempest-PublicSharesTest-926778698 tempest-PublicSharesTest-926778698-project-member] GET http://10.27.203.238/share/v2/f72e4ec607ca4e899b33f8b656888e37/shares/84e821d0-2b62-48db-80c7-259f61a14bac May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-718b23d5-09b4-4f33-9e66-60daa7801858 tempest-PublicSharesTest-926778698 tempest-PublicSharesTest-926778698-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-718b23d5-09b4-4f33-9e66-60daa7801858 tempest-PublicSharesTest-926778698 tempest-PublicSharesTest-926778698-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-cd277538-cfe4-4fa4-ba26-85814384fdb2 None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07cff7a575184066b67f8e453f02c2e6', 'request_id': 'req-cd277538-cfe4-4fa4-ba26-85814384fdb2'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 629/1272] 10.27.203.238 () {64 vars in 1476 bytes} [Tue May 28 12:58:58 2024] GET /share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/share-replicas/detail?share_id=5aa4e646-010d-48b4-8194-715d8ba7e33c => generated 22 bytes in 14 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-b9bb6b58-ed44-40ac-b657-54f4a047efd0 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] GET http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/9e24a210-9e96-45d9-b31c-f6f3377eb0e7/metadata May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-b9bb6b58-ed44-40ac-b657-54f4a047efd0 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-b9bb6b58-ed44-40ac-b657-54f4a047efd0 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-cd277538-cfe4-4fa4-ba26-85814384fdb2 None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07cff7a575184066b67f8e453f02c2e6', 'request_id': 'req-cd277538-cfe4-4fa4-ba26-85814384fdb2'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-cd277538-cfe4-4fa4-ba26-85814384fdb2 None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07cff7a575184066b67f8e453f02c2e6', 'request_id': 'req-cd277538-cfe4-4fa4-ba26-85814384fdb2'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-cd277538-cfe4-4fa4-ba26-85814384fdb2 None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07cff7a575184066b67f8e453f02c2e6', 'request_id': 'req-cd277538-cfe4-4fa4-ba26-85814384fdb2'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-cd277538-cfe4-4fa4-ba26-85814384fdb2 None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07cff7a575184066b67f8e453f02c2e6', 'request_id': 'req-cd277538-cfe4-4fa4-ba26-85814384fdb2'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-718b23d5-09b4-4f33-9e66-60daa7801858 tempest-PublicSharesTest-926778698 tempest-PublicSharesTest-926778698-project-member] http://10.27.203.238/share/v2/f72e4ec607ca4e899b33f8b656888e37/shares/84e821d0-2b62-48db-80c7-259f61a14bac returned with HTTP 200 May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 644/1273] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:58:58 2024] GET /share/v2/f72e4ec607ca4e899b33f8b656888e37/shares/84e821d0-2b62-48db-80c7-259f61a14bac => generated 1321 bytes in 26 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-d59f78aa-32ef-4905-a696-e32a3a33b261 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] DELETE http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/5aa4e646-010d-48b4-8194-715d8ba7e33c May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-d59f78aa-32ef-4905-a696-e32a3a33b261 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-d59f78aa-32ef-4905-a696-e32a3a33b261 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Calling method 'ShareMixin.delete' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.v1.shares [None req-d59f78aa-32ef-4905-a696-e32a3a33b261 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Delete share with id: 5aa4e646-010d-48b4-8194-715d8ba7e33c May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1172/2320] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 12:58:58 2024] DELETE /identity/v3/users/07cff7a575184066b67f8e453f02c2e6 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4504f3-d427-4575-a8b8-ac99c2179d55 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4504f3-d427-4575-a8b8-ac99c2179d55 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4504f3-d427-4575-a8b8-ac99c2179d55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-9d4504f3-d427-4575-a8b8-ac99c2179d55 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-9d4504f3-d427-4575-a8b8-ac99c2179d55 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-9d4504f3-d427-4575-a8b8-ac99c2179d55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-b9bb6b58-ed44-40ac-b657-54f4a047efd0 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/9e24a210-9e96-45d9-b31c-f6f3377eb0e7/metadata returned with HTTP 200 May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 630/1274] 10.27.203.238 () {64 vars in 1478 bytes} [Tue May 28 12:58:58 2024] GET /share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/9e24a210-9e96-45d9-b31c-f6f3377eb0e7/metadata => generated 26 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd277538-cfe4-4fa4-ba26-85814384fdb2 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-e9d076d5-458f-4913-ba81-4bb3650b5efe tempest-PublicSharesTest-1667420263 tempest-PublicSharesTest-1667420263-project-member] GET http://10.27.203.238/share/v2/6d36e1eb1dbc449db6aca75b12a2ba18/share-replicas/detail?share_id=84e821d0-2b62-48db-80c7-259f61a14bac May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-cd277538-cfe4-4fa4-ba26-85814384fdb2 None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-e9d076d5-458f-4913-ba81-4bb3650b5efe tempest-PublicSharesTest-1667420263 tempest-PublicSharesTest-1667420263-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-e9d076d5-458f-4913-ba81-4bb3650b5efe tempest-PublicSharesTest-1667420263 tempest-PublicSharesTest-1667420263-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1149/2321] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:58:58 2024] POST /identity/v3/auth/tokens => generated 2960 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-e9d076d5-458f-4913-ba81-4bb3650b5efe tempest-PublicSharesTest-1667420263 tempest-PublicSharesTest-1667420263-project-member] http://10.27.203.238/share/v2/6d36e1eb1dbc449db6aca75b12a2ba18/share-replicas/detail?share_id=84e821d0-2b62-48db-80c7-259f61a14bac returned with HTTP 200 May 28 12:58:58 l75lg1-v1 neutron-server[77619]: DEBUG neutron.wsgi [-] (77619) accepted ('10.27.203.238', 35030) {{(pid=77619) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 631/1275] 10.27.203.238 () {64 vars in 1476 bytes} [Tue May 28 12:58:58 2024] GET /share/v2/6d36e1eb1dbc449db6aca75b12a2ba18/share-replicas/detail?share_id=84e821d0-2b62-48db-80c7-259f61a14bac => generated 22 bytes in 14 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4504f3-d427-4575-a8b8-ac99c2179d55 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-0ff54ac4-b262-4846-9adc-bdeb391988b0 tempest-PublicSharesTest-1667420263 tempest-PublicSharesTest-1667420263-project-member] DELETE http://10.27.203.238/share/v2/6d36e1eb1dbc449db6aca75b12a2ba18/shares/84e821d0-2b62-48db-80c7-259f61a14bac May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-9d4504f3-d427-4575-a8b8-ac99c2179d55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-0ff54ac4-b262-4846-9adc-bdeb391988b0 tempest-PublicSharesTest-1667420263 tempest-PublicSharesTest-1667420263-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-0ff54ac4-b262-4846-9adc-bdeb391988b0 tempest-PublicSharesTest-1667420263 tempest-PublicSharesTest-1667420263-project-member] Calling method 'ShareMixin.delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.v1.shares [None req-0ff54ac4-b262-4846-9adc-bdeb391988b0 tempest-PublicSharesTest-1667420263 tempest-PublicSharesTest-1667420263-project-member] Delete share with id: 84e821d0-2b62-48db-80c7-259f61a14bac May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd277538-cfe4-4fa4-ba26-85814384fdb2 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cd1911-7d79-49e9-970a-113396039224 tempest-SharesMetadataTest-1653637154 tempest-SharesMetadataTest-1653637154-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c56458627e0c4970bd67958e52ea88bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d702e4e22be4d49a78c389a89fb56b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cd1911-7d79-49e9-970a-113396039224 tempest-SharesMetadataTest-1653637154 tempest-SharesMetadataTest-1653637154-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cd1911-7d79-49e9-970a-113396039224 tempest-SharesMetadataTest-1653637154 tempest-SharesMetadataTest-1653637154-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cd1911-7d79-49e9-970a-113396039224 tempest-SharesMetadataTest-1653637154 tempest-SharesMetadataTest-1653637154-project-admin] PATH_INFO: `/v3/users/b9078b0601ac4efa93bdcc390f3d1208` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4504f3-d427-4575-a8b8-ac99c2179d55 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cd1911-7d79-49e9-970a-113396039224 tempest-SharesMetadataTest-1653637154 tempest-SharesMetadataTest-1653637154-project-admin] RBAC: Authorizing `identity:delete_user(user_id=b9078b0601ac4efa93bdcc390f3d1208)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d56cdea-f2aa-447e-87e2-5b28eefb4a47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef17047035e4b518fd5360a01f2da1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d56cdea-f2aa-447e-87e2-5b28eefb4a47 service neutron] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cd1911-7d79-49e9-970a-113396039224 tempest-SharesMetadataTest-1653637154 tempest-SharesMetadataTest-1653637154-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d56cdea-f2aa-447e-87e2-5b28eefb4a47 service neutron] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d56cdea-f2aa-447e-87e2-5b28eefb4a47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d56cdea-f2aa-447e-87e2-5b28eefb4a47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-29cd1911-7d79-49e9-970a-113396039224 tempest-SharesMetadataTest-1653637154 tempest-SharesMetadataTest-1653637154-project-admin] Could not find user: b9078b0601ac4efa93bdcc390f3d1208.: keystone.exception.UserNotFound: Could not find user: b9078b0601ac4efa93bdcc390f3d1208. May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: b9078b0601ac4efa93bdcc390f3d1208. May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d56cdea-f2aa-447e-87e2-5b28eefb4a47 service neutron] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1173/2322] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 12:58:58 2024] DELETE /identity/v3/users/b9078b0601ac4efa93bdcc390f3d1208 => generated 110 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cd1911-7d79-49e9-970a-113396039224 tempest-SharesMetadataTest-1653637154 tempest-SharesMetadataTest-1653637154-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1150/2323] 10.27.203.238 () {64 vars in 1432 bytes} [Tue May 28 12:58:58 2024] GET /identity/v3/auth/tokens => generated 2960 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cd1911-7d79-49e9-970a-113396039224 tempest-SharesMetadataTest-1653637154 tempest-SharesMetadataTest-1653637154-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c11b83-3caa-426d-b256-38f1864669f9 tempest-SharesMetadataTest-1653637154 tempest-SharesMetadataTest-1653637154-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c56458627e0c4970bd67958e52ea88bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d702e4e22be4d49a78c389a89fb56b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c11b83-3caa-426d-b256-38f1864669f9 tempest-SharesMetadataTest-1653637154 tempest-SharesMetadataTest-1653637154-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c11b83-3caa-426d-b256-38f1864669f9 tempest-SharesMetadataTest-1653637154 tempest-SharesMetadataTest-1653637154-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c11b83-3caa-426d-b256-38f1864669f9 tempest-SharesMetadataTest-1653637154 tempest-SharesMetadataTest-1653637154-project-admin] PATH_INFO: `/v3/users/567edee5a37f498e8a3f54a933728377` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:58 l75lg1-v1 neutron-server[77619]: INFO neutron.wsgi [None req-98aeac45-b108-4ced-98b0-c7f6ecc82687 None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=169e2bf0e6284c33bb6e8ba37eadf427&name=default HTTP/1.1" status: 200 len: 216 time: 0.0707285 May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d56cdea-f2aa-447e-87e2-5b28eefb4a47 service neutron] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c11b83-3caa-426d-b256-38f1864669f9 tempest-SharesMetadataTest-1653637154 tempest-SharesMetadataTest-1653637154-project-admin] RBAC: Authorizing `identity:delete_user(user_id=567edee5a37f498e8a3f54a933728377)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-7d56cdea-f2aa-447e-87e2-5b28eefb4a47 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c11b83-3caa-426d-b256-38f1864669f9 tempest-SharesMetadataTest-1653637154 tempest-SharesMetadataTest-1653637154-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d56cdea-f2aa-447e-87e2-5b28eefb4a47 service neutron] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-f4c11b83-3caa-426d-b256-38f1864669f9 tempest-SharesMetadataTest-1653637154 tempest-SharesMetadataTest-1653637154-project-admin] Could not find user: 567edee5a37f498e8a3f54a933728377.: keystone.exception.UserNotFound: Could not find user: 567edee5a37f498e8a3f54a933728377. May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 567edee5a37f498e8a3f54a933728377. May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1174/2324] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 12:58:58 2024] DELETE /identity/v3/users/567edee5a37f498e8a3f54a933728377 => generated 110 bytes in 24 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c11b83-3caa-426d-b256-38f1864669f9 tempest-SharesMetadataTest-1653637154 tempest-SharesMetadataTest-1653637154-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af22e799-ad5d-42a5-a5d9-e664f5ab7ca3 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af22e799-ad5d-42a5-a5d9-e664f5ab7ca3 None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af22e799-ad5d-42a5-a5d9-e664f5ab7ca3 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af22e799-ad5d-42a5-a5d9-e664f5ab7ca3 None admin] PATH_INFO: `/v3/projects/169e2bf0e6284c33bb6e8ba37eadf427` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af22e799-ad5d-42a5-a5d9-e664f5ab7ca3 None admin] RBAC: Authorizing `identity:delete_project(project_id=169e2bf0e6284c33bb6e8ba37eadf427)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c11b83-3caa-426d-b256-38f1864669f9 tempest-SharesMetadataTest-1653637154 tempest-SharesMetadataTest-1653637154-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af22e799-ad5d-42a5-a5d9-e664f5ab7ca3 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a773e4-6ea7-429e-9b8b-cf825cc7ddcf tempest-SharesMetadataTest-1653637154 tempest-SharesMetadataTest-1653637154-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c56458627e0c4970bd67958e52ea88bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d702e4e22be4d49a78c389a89fb56b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a773e4-6ea7-429e-9b8b-cf825cc7ddcf tempest-SharesMetadataTest-1653637154 tempest-SharesMetadataTest-1653637154-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a773e4-6ea7-429e-9b8b-cf825cc7ddcf tempest-SharesMetadataTest-1653637154 tempest-SharesMetadataTest-1653637154-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a773e4-6ea7-429e-9b8b-cf825cc7ddcf tempest-SharesMetadataTest-1653637154 tempest-SharesMetadataTest-1653637154-project-admin] PATH_INFO: `/v3/users/e1f712aac7e94e429048f60f92a8a736` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a773e4-6ea7-429e-9b8b-cf825cc7ddcf tempest-SharesMetadataTest-1653637154 tempest-SharesMetadataTest-1653637154-project-admin] RBAC: Authorizing `identity:delete_user(user_id=e1f712aac7e94e429048f60f92a8a736)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a773e4-6ea7-429e-9b8b-cf825cc7ddcf tempest-SharesMetadataTest-1653637154 tempest-SharesMetadataTest-1653637154-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-0ff54ac4-b262-4846-9adc-bdeb391988b0 tempest-PublicSharesTest-1667420263 tempest-PublicSharesTest-1667420263-project-member] http://10.27.203.238/share/v2/6d36e1eb1dbc449db6aca75b12a2ba18/shares/84e821d0-2b62-48db-80c7-259f61a14bac returned with HTTP 202 May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 632/1276] 10.27.203.238 () {64 vars in 1454 bytes} [Tue May 28 12:58:58 2024] DELETE /share/v2/6d36e1eb1dbc449db6aca75b12a2ba18/shares/84e821d0-2b62-48db-80c7-259f61a14bac => generated 0 bytes in 131 msecs (HTTP/1.1 202) 6 headers in 243 bytes (2 switches on core 0) May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-af22e799-ad5d-42a5-a5d9-e664f5ab7ca3 None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '169e2bf0e6284c33bb6e8ba37eadf427', 'request_id': 'req-af22e799-ad5d-42a5-a5d9-e664f5ab7ca3'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-d42f0e7a-bc0e-4d38-828d-274c8447a1fa tempest-PublicSharesTest-1667420263 tempest-PublicSharesTest-1667420263-project-member] GET http://10.27.203.238/share/v2/6d36e1eb1dbc449db6aca75b12a2ba18/shares/84e821d0-2b62-48db-80c7-259f61a14bac May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-d42f0e7a-bc0e-4d38-828d-274c8447a1fa tempest-PublicSharesTest-1667420263 tempest-PublicSharesTest-1667420263-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-d42f0e7a-bc0e-4d38-828d-274c8447a1fa tempest-PublicSharesTest-1667420263 tempest-PublicSharesTest-1667420263-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-af22e799-ad5d-42a5-a5d9-e664f5ab7ca3 None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '169e2bf0e6284c33bb6e8ba37eadf427', 'request_id': 'req-af22e799-ad5d-42a5-a5d9-e664f5ab7ca3'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.quota [None req-d59f78aa-32ef-4905-a696-e32a3a33b261 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Created reservations ['544d6ff3-dad7-4be6-980b-9afb41bae0ba', 'f8028d78-64b2-4b57-9176-952fda592cbc', '6e0be704-d114-423e-89ca-a577f672b8be', '70a19b46-efbb-4bdf-bfb3-64816fa1ab9a'] {{(pid=98329) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-09a773e4-6ea7-429e-9b8b-cf825cc7ddcf tempest-SharesMetadataTest-1653637154 tempest-SharesMetadataTest-1653637154-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1f712aac7e94e429048f60f92a8a736', 'request_id': 'req-09a773e4-6ea7-429e-9b8b-cf825cc7ddcf'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-d42f0e7a-bc0e-4d38-828d-274c8447a1fa tempest-PublicSharesTest-1667420263 tempest-PublicSharesTest-1667420263-project-member] http://10.27.203.238/share/v2/6d36e1eb1dbc449db6aca75b12a2ba18/shares/84e821d0-2b62-48db-80c7-259f61a14bac returned with HTTP 200 May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 633/1277] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:58:58 2024] GET /share/v2/6d36e1eb1dbc449db6aca75b12a2ba18/shares/84e821d0-2b62-48db-80c7-259f61a14bac => generated 1320 bytes in 23 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-af22e799-ad5d-42a5-a5d9-e664f5ab7ca3 None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '169e2bf0e6284c33bb6e8ba37eadf427', 'request_id': 'req-af22e799-ad5d-42a5-a5d9-e664f5ab7ca3'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-09a773e4-6ea7-429e-9b8b-cf825cc7ddcf tempest-SharesMetadataTest-1653637154 tempest-SharesMetadataTest-1653637154-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1f712aac7e94e429048f60f92a8a736', 'request_id': 'req-09a773e4-6ea7-429e-9b8b-cf825cc7ddcf'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-09a773e4-6ea7-429e-9b8b-cf825cc7ddcf tempest-SharesMetadataTest-1653637154 tempest-SharesMetadataTest-1653637154-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1f712aac7e94e429048f60f92a8a736', 'request_id': 'req-09a773e4-6ea7-429e-9b8b-cf825cc7ddcf'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-09a773e4-6ea7-429e-9b8b-cf825cc7ddcf tempest-SharesMetadataTest-1653637154 tempest-SharesMetadataTest-1653637154-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1f712aac7e94e429048f60f92a8a736', 'request_id': 'req-09a773e4-6ea7-429e-9b8b-cf825cc7ddcf'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-af22e799-ad5d-42a5-a5d9-e664f5ab7ca3 None admin] The token cache is being invalidate because project 169e2bf0e6284c33bb6e8ba37eadf427 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-af22e799-ad5d-42a5-a5d9-e664f5ab7ca3 None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-af22e799-ad5d-42a5-a5d9-e664f5ab7ca3 None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1151/2325] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 12:58:58 2024] DELETE /identity/v3/projects/169e2bf0e6284c33bb6e8ba37eadf427 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.quota [None req-d59f78aa-32ef-4905-a696-e32a3a33b261 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Committed reservations ['544d6ff3-dad7-4be6-980b-9afb41bae0ba', 'f8028d78-64b2-4b57-9176-952fda592cbc', '6e0be704-d114-423e-89ca-a577f672b8be', '70a19b46-efbb-4bdf-bfb3-64816fa1ab9a'] {{(pid=98329) commit /opt/stack/manila/manila/quota.py:1063}} May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e728ee97-5d64-4be0-866a-f41723e851d6 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e728ee97-5d64-4be0-866a-f41723e851d6 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e728ee97-5d64-4be0-866a-f41723e851d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-09a773e4-6ea7-429e-9b8b-cf825cc7ddcf tempest-SharesMetadataTest-1653637154 tempest-SharesMetadataTest-1653637154-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1f712aac7e94e429048f60f92a8a736', 'request_id': 'req-09a773e4-6ea7-429e-9b8b-cf825cc7ddcf'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:58:58 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-0ff54ac4-b262-4846-9adc-bdeb391988b0 tempest-PublicSharesTest-1667420263 None] Acquiring lock "locked_access_rules_operation_by_share_instance_834576a8-b0ac-4cc8-a1a0-0067a9513141" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:58 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-0ff54ac4-b262-4846-9adc-bdeb391988b0 tempest-PublicSharesTest-1667420263 None] Lock "locked_access_rules_operation_by_share_instance_834576a8-b0ac-4cc8-a1a0-0067a9513141" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-e728ee97-5d64-4be0-866a-f41723e851d6 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:58:58 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-0ff54ac4-b262-4846-9adc-bdeb391988b0 tempest-PublicSharesTest-1667420263 None] Lock "locked_access_rules_operation_by_share_instance_834576a8-b0ac-4cc8-a1a0-0067a9513141" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:58 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-0ff54ac4-b262-4846-9adc-bdeb391988b0 tempest-PublicSharesTest-1667420263 None] Acquiring lock "locked_access_rules_operation_by_share_instance_834576a8-b0ac-4cc8-a1a0-0067a9513141" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:58 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-0ff54ac4-b262-4846-9adc-bdeb391988b0 tempest-PublicSharesTest-1667420263 None] Lock "locked_access_rules_operation_by_share_instance_834576a8-b0ac-4cc8-a1a0-0067a9513141" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-e728ee97-5d64-4be0-866a-f41723e851d6 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-e728ee97-5d64-4be0-866a-f41723e851d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:58:58 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-0ff54ac4-b262-4846-9adc-bdeb391988b0 tempest-PublicSharesTest-1667420263 None] Lock "locked_access_rules_operation_by_share_instance_834576a8-b0ac-4cc8-a1a0-0067a9513141" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:58 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-0ff54ac4-b262-4846-9adc-bdeb391988b0 tempest-PublicSharesTest-1667420263 None] Acquiring lock "locked_access_rules_operation_by_share_instance_834576a8-b0ac-4cc8-a1a0-0067a9513141" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1175/2326] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 12:58:58 2024] DELETE /identity/v3/users/e1f712aac7e94e429048f60f92a8a736 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1152/2327] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:58:58 2024] POST /identity/v3/auth/tokens => generated 312 bytes in 19 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 28 12:58:58 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-0ff54ac4-b262-4846-9adc-bdeb391988b0 tempest-PublicSharesTest-1667420263 None] Lock "locked_access_rules_operation_by_share_instance_834576a8-b0ac-4cc8-a1a0-0067a9513141" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:58 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-0ff54ac4-b262-4846-9adc-bdeb391988b0 tempest-PublicSharesTest-1667420263 None] Lock "locked_access_rules_operation_by_share_instance_834576a8-b0ac-4cc8-a1a0-0067a9513141" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.005s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:58 l75lg1-v1 manila-share[98474]: DEBUG manila.share.access [None req-0ff54ac4-b262-4846-9adc-bdeb391988b0 tempest-PublicSharesTest-1667420263 None] All access rules have been synced for share instance 834576a8-b0ac-4cc8-a1a0-0067a9513141 belonging to share 84e821d0-2b62-48db-80c7-259f61a14bac. {{(pid=98474) update_access_rules /opt/stack/manila/manila/share/access.py:304}} May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-c36dbfa7-b373-4f6f-a617-d62e3eff6616 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] GET http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/share-replicas/detail?share_id=9e24a210-9e96-45d9-b31c-f6f3377eb0e7 May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-c36dbfa7-b373-4f6f-a617-d62e3eff6616 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:58 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-0ff54ac4-b262-4846-9adc-bdeb391988b0 tempest-PublicSharesTest-1667420263 None] deleting '/manila/manila-834576a8-b0ac-4cc8-a1a0-0067a9513141' May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-c36dbfa7-b373-4f6f-a617-d62e3eff6616 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-d59f78aa-32ef-4905-a696-e32a3a33b261 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/5aa4e646-010d-48b4-8194-715d8ba7e33c returned with HTTP 202 May 28 12:58:58 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0ff54ac4-b262-4846-9adc-bdeb391988b0 tempest-PublicSharesTest-1667420263 None] >>> [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/ May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 645/1278] 10.27.203.238 () {64 vars in 1454 bytes} [Tue May 28 12:58:58 2024] DELETE /share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/5aa4e646-010d-48b4-8194-715d8ba7e33c => generated 0 bytes in 263 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:58:58 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0ff54ac4-b262-4846-9adc-bdeb391988b0 tempest-PublicSharesTest-1667420263 None] {'data': '{"path": "/manila/manila-834576a8-b0ac-4cc8-a1a0-0067a9513141"}', May 28 12:58:58 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0ff54ac4-b262-4846-9adc-bdeb391988b0 tempest-PublicSharesTest-1667420263 None] 'params': None} May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dc6451-0fcf-434d-bbf8-116c678b1f17 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dc6451-0fcf-434d-bbf8-116c678b1f17 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dc6451-0fcf-434d-bbf8-116c678b1f17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-ae647d44-b73b-4d1d-a3bb-640ad697d8cc tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] GET http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/5aa4e646-010d-48b4-8194-715d8ba7e33c May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-ae647d44-b73b-4d1d-a3bb-640ad697d8cc tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-ae647d44-b73b-4d1d-a3bb-640ad697d8cc tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-c36dbfa7-b373-4f6f-a617-d62e3eff6616 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/share-replicas/detail?share_id=9e24a210-9e96-45d9-b31c-f6f3377eb0e7 returned with HTTP 200 May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 634/1279] 10.27.203.238 () {64 vars in 1476 bytes} [Tue May 28 12:58:58 2024] GET /share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/share-replicas/detail?share_id=9e24a210-9e96-45d9-b31c-f6f3377eb0e7 => generated 22 bytes in 13 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-e33a4def-e23e-4cb3-aa95-353e32ae4440 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] DELETE http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/9e24a210-9e96-45d9-b31c-f6f3377eb0e7 May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-e33a4def-e23e-4cb3-aa95-353e32ae4440 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-e33a4def-e23e-4cb3-aa95-353e32ae4440 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Calling method 'ShareMixin.delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-ae647d44-b73b-4d1d-a3bb-640ad697d8cc tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] HTTP exception thrown: The resource could not be found. May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-84dc6451-0fcf-434d-bbf8-116c678b1f17 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-ae647d44-b73b-4d1d-a3bb-640ad697d8cc tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/5aa4e646-010d-48b4-8194-715d8ba7e33c returned with HTTP 404 May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.v1.shares [None req-e33a4def-e23e-4cb3-aa95-353e32ae4440 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Delete share with id: 9e24a210-9e96-45d9-b31c-f6f3377eb0e7 May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 646/1280] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:58:58 2024] GET /share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/5aa4e646-010d-48b4-8194-715d8ba7e33c => generated 78 bytes in 12 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-84dc6451-0fcf-434d-bbf8-116c678b1f17 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:58:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-84dc6451-0fcf-434d-bbf8-116c678b1f17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-aa0efbc6-a268-469b-9d47-5c763167d257 tempest-ShareIpRulesForNFSNegativeTest-700172924 tempest-ShareIpRulesForNFSNegativeTest-700172924-project-admin] DELETE http://10.27.203.238/share/v2/8f81d1d8d7c946e8aa46d6e3e510424c/types/a6882835-6452-4e9f-ae9f-1b59f9974de9 May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-aa0efbc6-a268-469b-9d47-5c763167d257 tempest-ShareIpRulesForNFSNegativeTest-700172924 tempest-ShareIpRulesForNFSNegativeTest-700172924-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:58 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-aa0efbc6-a268-469b-9d47-5c763167d257 tempest-ShareIpRulesForNFSNegativeTest-700172924 tempest-ShareIpRulesForNFSNegativeTest-700172924-project-admin] Calling method 'ShareTypesController._delete' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1176/2328] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:58:58 2024] POST /identity/v3/auth/tokens => generated 2960 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e728ee97-5d64-4be0-866a-f41723e851d6 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e728ee97-5d64-4be0-866a-f41723e851d6 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:59 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-aa0efbc6-a268-469b-9d47-5c763167d257 tempest-ShareIpRulesForNFSNegativeTest-700172924 tempest-ShareIpRulesForNFSNegativeTest-700172924-project-admin] http://10.27.203.238/share/v2/8f81d1d8d7c946e8aa46d6e3e510424c/types/a6882835-6452-4e9f-ae9f-1b59f9974de9 returned with HTTP 202 May 28 12:58:59 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 647/1281] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:58:58 2024] DELETE /share/v2/8f81d1d8d7c946e8aa46d6e3e510424c/types/a6882835-6452-4e9f-ae9f-1b59f9974de9 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 6 headers in 243 bytes (2 switches on core 0) May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7f0eec-ce16-4918-a1c3-d7f614cebbf6 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7f0eec-ce16-4918-a1c3-d7f614cebbf6 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7f0eec-ce16-4918-a1c3-d7f614cebbf6 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7f0eec-ce16-4918-a1c3-d7f614cebbf6 None admin] PATH_INFO: `/v3/domains` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7f0eec-ce16-4918-a1c3-d7f614cebbf6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7f0eec-ce16-4918-a1c3-d7f614cebbf6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7f0eec-ce16-4918-a1c3-d7f614cebbf6 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:59 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-bea1c141-b504-48b0-9958-60205800ceb6 tempest-ShareIpRulesForNFSNegativeTest-700172924 tempest-ShareIpRulesForNFSNegativeTest-700172924-project-admin] GET http://10.27.203.238/share/v2/8f81d1d8d7c946e8aa46d6e3e510424c/types/a6882835-6452-4e9f-ae9f-1b59f9974de9 May 28 12:58:59 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-bea1c141-b504-48b0-9958-60205800ceb6 tempest-ShareIpRulesForNFSNegativeTest-700172924 tempest-ShareIpRulesForNFSNegativeTest-700172924-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:59 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-bea1c141-b504-48b0-9958-60205800ceb6 tempest-ShareIpRulesForNFSNegativeTest-700172924 tempest-ShareIpRulesForNFSNegativeTest-700172924-project-admin] Calling method 'ShareTypesController.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:59 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-bea1c141-b504-48b0-9958-60205800ceb6 tempest-ShareIpRulesForNFSNegativeTest-700172924 tempest-ShareIpRulesForNFSNegativeTest-700172924-project-admin] HTTP exception thrown: Share type not found. May 28 12:58:59 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-bea1c141-b504-48b0-9958-60205800ceb6 tempest-ShareIpRulesForNFSNegativeTest-700172924 tempest-ShareIpRulesForNFSNegativeTest-700172924-project-admin] http://10.27.203.238/share/v2/8f81d1d8d7c946e8aa46d6e3e510424c/types/a6882835-6452-4e9f-ae9f-1b59f9974de9 returned with HTTP 404 May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1153/2329] 10.27.203.238 () {62 vars in 1220 bytes} [Tue May 28 12:58:59 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:58:59 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 648/1282] 10.27.203.238 () {64 vars in 1448 bytes} [Tue May 28 12:58:59 2024] GET /share/v2/8f81d1d8d7c946e8aa46d6e3e510424c/types/a6882835-6452-4e9f-ae9f-1b59f9974de9 => generated 67 bytes in 10 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dc6451-0fcf-434d-bbf8-116c678b1f17 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dc6451-0fcf-434d-bbf8-116c678b1f17 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:59 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-64b6b83c-689d-413b-b4f8-269942b89902 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] POST http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action May 28 12:58:59 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-64b6b83c-689d-413b-b4f8-269942b89902 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Action body: b'{"allow_access": {"access_type": "ip", "access_to": "203.0.113.22", "access_level": "rw", "lock_visibility": true, "lock_deletion": true}}' {{(pid=98329) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:58:59 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-64b6b83c-689d-413b-b4f8-269942b89902 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Action: 'action', calling method: ShareController.allow_access, body: {"allow_access": {"access_type": "ip", "access_to": "203.0.113.22", "access_level": "rw", "lock_visibility": true, "lock_deletion": true}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf063af-34b8-4a01-86fa-8d3b1c875207 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf063af-34b8-4a01-86fa-8d3b1c875207 None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf063af-34b8-4a01-86fa-8d3b1c875207 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf063af-34b8-4a01-86fa-8d3b1c875207 None admin] PATH_INFO: `/v3/projects` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf063af-34b8-4a01-86fa-8d3b1c875207 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:59 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0ff54ac4-b262-4846-9adc-bdeb391988b0 tempest-PublicSharesTest-1667420263 None] <<< [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/ May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf063af-34b8-4a01-86fa-8d3b1c875207 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:59 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0ff54ac4-b262-4846-9adc-bdeb391988b0 tempest-PublicSharesTest-1667420263 None] 'OK' May 28 12:58:59 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0ff54ac4-b262-4846-9adc-bdeb391988b0 tempest-PublicSharesTest-1667420263 None] --- [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/: Done May 28 12:58:59 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0ff54ac4-b262-4846-9adc-bdeb391988b0 tempest-PublicSharesTest-1667420263 None] >>> [GET] https://127.0.0.1:40443/api/views/ May 28 12:58:59 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0ff54ac4-b262-4846-9adc-bdeb391988b0 tempest-PublicSharesTest-1667420263 None] {'allow_redirects': True, May 28 12:58:59 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0ff54ac4-b262-4846-9adc-bdeb391988b0 tempest-PublicSharesTest-1667420263 None] 'params': {'name': '834576a8-b0ac-4cc8-a1a0-0067a9513141'}} May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1177/2330] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 12:58:59 2024] POST /identity/v3/projects => generated 381 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7f0eec-ce16-4918-a1c3-d7f614cebbf6 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7f0eec-ce16-4918-a1c3-d7f614cebbf6 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:59 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-e33a4def-e23e-4cb3-aa95-353e32ae4440 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/9e24a210-9e96-45d9-b31c-f6f3377eb0e7 returned with HTTP 202 May 28 12:58:59 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 635/1283] 10.27.203.238 () {64 vars in 1454 bytes} [Tue May 28 12:58:58 2024] DELETE /share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/9e24a210-9e96-45d9-b31c-f6f3377eb0e7 => generated 0 bytes in 127 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:58:59 l75lg1-v1 devstack@m-api.service[98329]: DEBUG oslo_concurrency.lockutils [None req-64b6b83c-689d-413b-b4f8-269942b89902 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98329) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:59 l75lg1-v1 devstack@m-api.service[98329]: DEBUG oslo_concurrency.lockutils [None req-64b6b83c-689d-413b-b4f8-269942b89902 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98329) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:59 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-e812741b-b2e8-478c-b484-fa8ddbf6a256 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] GET http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/9e24a210-9e96-45d9-b31c-f6f3377eb0e7 May 28 12:58:59 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-e812741b-b2e8-478c-b484-fa8ddbf6a256 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:59 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-e812741b-b2e8-478c-b484-fa8ddbf6a256 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2cb468-358f-4af8-8630-d21442b7bd9a None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2cb468-358f-4af8-8630-d21442b7bd9a None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2cb468-358f-4af8-8630-d21442b7bd9a None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2cb468-358f-4af8-8630-d21442b7bd9a None admin] PATH_INFO: `/v3/users` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2cb468-358f-4af8-8630-d21442b7bd9a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2cb468-358f-4af8-8630-d21442b7bd9a None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-ef2cb468-358f-4af8-8630-d21442b7bd9a None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 12:58:59 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-e812741b-b2e8-478c-b484-fa8ddbf6a256 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/9e24a210-9e96-45d9-b31c-f6f3377eb0e7 returned with HTTP 200 May 28 12:58:59 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 636/1284] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:58:59 2024] GET /share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/9e24a210-9e96-45d9-b31c-f6f3377eb0e7 => generated 1326 bytes in 24 msecs (HTTP/1.1 200) 6 headers in 232 bytes (2 switches on core 0) May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1154/2331] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 12:58:59 2024] POST /identity/v3/users => generated 299 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:58:59 l75lg1-v1 devstack@m-api.service[98329]: DEBUG oslo_concurrency.lockutils [None req-64b6b83c-689d-413b-b4f8-269942b89902 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.048s {{(pid=98329) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf063af-34b8-4a01-86fa-8d3b1c875207 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf063af-34b8-4a01-86fa-8d3b1c875207 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f688896-cd37-4234-89ae-6cb28725715f None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f688896-cd37-4234-89ae-6cb28725715f None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f688896-cd37-4234-89ae-6cb28725715f None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f688896-cd37-4234-89ae-6cb28725715f None admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f688896-cd37-4234-89ae-6cb28725715f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f688896-cd37-4234-89ae-6cb28725715f None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1178/2332] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 12:58:59 2024] GET /identity/v3/roles => generated 1680 bytes in 16 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2cb468-358f-4af8-8630-d21442b7bd9a None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2cb468-358f-4af8-8630-d21442b7bd9a None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713158ed-0e46-4a96-a761-86bc15fe731d None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713158ed-0e46-4a96-a761-86bc15fe731d None admin] REQUEST_METHOD: `PUT` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713158ed-0e46-4a96-a761-86bc15fe731d None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713158ed-0e46-4a96-a761-86bc15fe731d None admin] PATH_INFO: `/v3/projects/69c481a96f964f9d8120576a305a17b5/users/e98090c4a86b441897a7e520ff496299/roles/44620cad10ae407c90c91e2c296adb04` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:59 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-e33a4def-e23e-4cb3-aa95-353e32ae4440 tempest-SharesMetadataTest-1561320255 None] Acquiring lock "locked_access_rules_operation_by_share_instance_5a6db1ad-927e-4228-b973-3ff998e29ada" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:59 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-e33a4def-e23e-4cb3-aa95-353e32ae4440 tempest-SharesMetadataTest-1561320255 None] Lock "locked_access_rules_operation_by_share_instance_5a6db1ad-927e-4228-b973-3ff998e29ada" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:59 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-64b6b83c-689d-413b-b4f8-269942b89902 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action returned with HTTP 200 May 28 12:58:59 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 649/1285] 10.27.203.238 () {66 vars in 1494 bytes} [Tue May 28 12:58:59 2024] POST /share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action => generated 310 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 231 bytes (2 switches on core 0) May 28 12:58:59 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-e33a4def-e23e-4cb3-aa95-353e32ae4440 tempest-SharesMetadataTest-1561320255 None] Lock "locked_access_rules_operation_by_share_instance_5a6db1ad-927e-4228-b973-3ff998e29ada" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.006s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:59 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-e33a4def-e23e-4cb3-aa95-353e32ae4440 tempest-SharesMetadataTest-1561320255 None] Acquiring lock "locked_access_rules_operation_by_share_instance_5a6db1ad-927e-4228-b973-3ff998e29ada" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713158ed-0e46-4a96-a761-86bc15fe731d None admin] RBAC: Authorizing `identity:create_grant(project_id=69c481a96f964f9d8120576a305a17b5, user_id=e98090c4a86b441897a7e520ff496299, role_id=44620cad10ae407c90c91e2c296adb04)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:59 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-e33a4def-e23e-4cb3-aa95-353e32ae4440 tempest-SharesMetadataTest-1561320255 None] Lock "locked_access_rules_operation_by_share_instance_5a6db1ad-927e-4228-b973-3ff998e29ada" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713158ed-0e46-4a96-a761-86bc15fe731d None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:59 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-75aee4f4-d49e-4f16-a841-dd99cdd0f609 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] GET http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/share-access-rules?share_id=72db8769-ece7-42ff-af27-2e778292a9b4 May 28 12:58:59 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-75aee4f4-d49e-4f16-a841-dd99cdd0f609 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:58:59 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-75aee4f4-d49e-4f16-a841-dd99cdd0f609 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:58:59 l75lg1-v1 manila-share[98474]: DEBUG manila.share.manager [None req-64b6b83c-689d-413b-b4f8-269942b89902 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Received request to update access for share instance 7fdd602c-79d0-479c-95a2-336b202c6639. {{(pid=98474) update_access_for_instances /opt/stack/manila/manila/share/manager.py:4353}} May 28 12:58:59 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-e33a4def-e23e-4cb3-aa95-353e32ae4440 tempest-SharesMetadataTest-1561320255 None] Lock "locked_access_rules_operation_by_share_instance_5a6db1ad-927e-4228-b973-3ff998e29ada" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.005s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:59 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-e33a4def-e23e-4cb3-aa95-353e32ae4440 tempest-SharesMetadataTest-1561320255 None] Acquiring lock "locked_access_rules_operation_by_share_instance_5a6db1ad-927e-4228-b973-3ff998e29ada" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:59 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-e33a4def-e23e-4cb3-aa95-353e32ae4440 tempest-SharesMetadataTest-1561320255 None] Lock "locked_access_rules_operation_by_share_instance_5a6db1ad-927e-4228-b973-3ff998e29ada" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1155/2333] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 12:58:59 2024] PUT /identity/v3/projects/69c481a96f964f9d8120576a305a17b5/users/e98090c4a86b441897a7e520ff496299/roles/44620cad10ae407c90c91e2c296adb04 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:58:59 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-e33a4def-e23e-4cb3-aa95-353e32ae4440 tempest-SharesMetadataTest-1561320255 None] Lock "locked_access_rules_operation_by_share_instance_5a6db1ad-927e-4228-b973-3ff998e29ada" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.011s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:59 l75lg1-v1 manila-share[98474]: DEBUG manila.share.access [None req-e33a4def-e23e-4cb3-aa95-353e32ae4440 tempest-SharesMetadataTest-1561320255 None] All access rules have been synced for share instance 5a6db1ad-927e-4228-b973-3ff998e29ada belonging to share 9e24a210-9e96-45d9-b31c-f6f3377eb0e7. {{(pid=98474) update_access_rules /opt/stack/manila/manila/share/access.py:304}} May 28 12:58:59 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-e33a4def-e23e-4cb3-aa95-353e32ae4440 tempest-SharesMetadataTest-1561320255 None] deleting '/manila/manila-5a6db1ad-927e-4228-b973-3ff998e29ada' May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a605dfc-a54d-48de-be30-cabfc409e016 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a605dfc-a54d-48de-be30-cabfc409e016 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:59 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e33a4def-e23e-4cb3-aa95-353e32ae4440 tempest-SharesMetadataTest-1561320255 None] >>> [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/ May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a605dfc-a54d-48de-be30-cabfc409e016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:59 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e33a4def-e23e-4cb3-aa95-353e32ae4440 tempest-SharesMetadataTest-1561320255 None] {'data': '{"path": "/manila/manila-5a6db1ad-927e-4228-b973-3ff998e29ada"}', May 28 12:58:59 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e33a4def-e23e-4cb3-aa95-353e32ae4440 tempest-SharesMetadataTest-1561320255 None] 'params': None} May 28 12:58:59 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-64b6b83c-689d-413b-b4f8-269942b89902 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:59 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-64b6b83c-689d-413b-b4f8-269942b89902 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-8a605dfc-a54d-48de-be30-cabfc409e016 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:58:59 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.lock.api [None req-75aee4f4-d49e-4f16-a841-dd99cdd0f609 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Searching for locks by: {'resource_id': '70301939-e5f7-4c71-990f-5b6b34c75d54', 'resource_action': 'show', 'resource_type': 'access_rule'} {{(pid=98330) get_all /opt/stack/manila/manila/lock/api.py:112}} May 28 12:58:59 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-64b6b83c-689d-413b-b4f8-269942b89902 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.005s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:59 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-64b6b83c-689d-413b-b4f8-269942b89902 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:59 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-64b6b83c-689d-413b-b4f8-269942b89902 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:59 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-75aee4f4-d49e-4f16-a841-dd99cdd0f609 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/share-access-rules?share_id=72db8769-ece7-42ff-af27-2e778292a9b4 returned with HTTP 200 May 28 12:58:59 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 637/1286] 10.27.203.238 () {64 vars in 1467 bytes} [Tue May 28 12:58:59 2024] GET /share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/share-access-rules?share_id=72db8769-ece7-42ff-af27-2e778292a9b4 => generated 265 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:58:59 l75lg1-v1 dstat.sh[49771]: 28-05 12:58:59| 27 2 64 7 0|5729M 1748M 277M 7871M| 15k 21k| 0 8974k| 0 807 | 12k 22k|1.00 1.02 1.00|6.0 1.0 1.0| 0 0 | 0 2048M| 29 363 0 32 0 May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-8a605dfc-a54d-48de-be30-cabfc409e016 None None] MFA Rules not processed for user `e98090c4a86b441897a7e520ff496299`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-8a605dfc-a54d-48de-be30-cabfc409e016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1179/2334] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:58:59 2024] POST /identity/v3/auth/tokens => generated 3952 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713158ed-0e46-4a96-a761-86bc15fe731d None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:59 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-64b6b83c-689d-413b-b4f8-269942b89902 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.082s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:59 l75lg1-v1 manila-share[98474]: DEBUG manila.share.access [None req-64b6b83c-689d-413b-b4f8-269942b89902 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Updating access rules for share instance 7fdd602c-79d0-479c-95a2-336b202c6639 belonging to share 72db8769-ece7-42ff-af27-2e778292a9b4. {{(pid=98474) update_access_rules /opt/stack/manila/manila/share/access.py:298}} May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713158ed-0e46-4a96-a761-86bc15fe731d None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:59 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e33a4def-e23e-4cb3-aa95-353e32ae4440 tempest-SharesMetadataTest-1561320255 None] <<< [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/ May 28 12:58:59 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e33a4def-e23e-4cb3-aa95-353e32ae4440 tempest-SharesMetadataTest-1561320255 None] 'OK' May 28 12:58:59 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e33a4def-e23e-4cb3-aa95-353e32ae4440 tempest-SharesMetadataTest-1561320255 None] --- [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/: Done May 28 12:58:59 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e33a4def-e23e-4cb3-aa95-353e32ae4440 tempest-SharesMetadataTest-1561320255 None] >>> [GET] https://127.0.0.1:40443/api/views/ May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3753bc3a-bdf1-4dbb-8b1a-312d2fd8839b None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3753bc3a-bdf1-4dbb-8b1a-312d2fd8839b None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3753bc3a-bdf1-4dbb-8b1a-312d2fd8839b None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3753bc3a-bdf1-4dbb-8b1a-312d2fd8839b None admin] PATH_INFO: `/v3/projects` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:59 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e33a4def-e23e-4cb3-aa95-353e32ae4440 tempest-SharesMetadataTest-1561320255 None] {'allow_redirects': True, May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3753bc3a-bdf1-4dbb-8b1a-312d2fd8839b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:59 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e33a4def-e23e-4cb3-aa95-353e32ae4440 tempest-SharesMetadataTest-1561320255 None] 'params': {'name': '5a6db1ad-927e-4228-b973-3ff998e29ada'}} May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3753bc3a-bdf1-4dbb-8b1a-312d2fd8839b None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:59 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-64b6b83c-689d-413b-b4f8-269942b89902 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:59 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-64b6b83c-689d-413b-b4f8-269942b89902 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1156/2335] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 12:58:59 2024] POST /identity/v3/projects => generated 379 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a605dfc-a54d-48de-be30-cabfc409e016 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:59 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-64b6b83c-689d-413b-b4f8-269942b89902 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.007s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:59 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-64b6b83c-689d-413b-b4f8-269942b89902 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:58:59 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-64b6b83c-689d-413b-b4f8-269942b89902 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a605dfc-a54d-48de-be30-cabfc409e016 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:59 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-64b6b83c-689d-413b-b4f8-269942b89902 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.014s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:58:59 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-64b6b83c-689d-413b-b4f8-269942b89902 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] changing access on None May 28 12:58:59 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-64b6b83c-689d-413b-b4f8-269942b89902 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:58:59 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-64b6b83c-689d-413b-b4f8-269942b89902 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] {'allow_redirects': True, May 28 12:58:59 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-64b6b83c-689d-413b-b4f8-269942b89902 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] 'params': {'name': '7fdd602c-79d0-479c-95a2-336b202c6639'}} May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c3da84-7bba-4117-8cdf-6235202d2ecf None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c3da84-7bba-4117-8cdf-6235202d2ecf None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c3da84-7bba-4117-8cdf-6235202d2ecf None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c3da84-7bba-4117-8cdf-6235202d2ecf None admin] PATH_INFO: `/v3/users` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c3da84-7bba-4117-8cdf-6235202d2ecf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c3da84-7bba-4117-8cdf-6235202d2ecf None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-86c3da84-7bba-4117-8cdf-6235202d2ecf None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1180/2336] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 12:58:59 2024] POST /identity/v3/users => generated 298 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3753bc3a-bdf1-4dbb-8b1a-312d2fd8839b None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3753bc3a-bdf1-4dbb-8b1a-312d2fd8839b None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ffe0f1-205c-48ba-9752-ce1fcfcfe146 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ffe0f1-205c-48ba-9752-ce1fcfcfe146 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ffe0f1-205c-48ba-9752-ce1fcfcfe146 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ffe0f1-205c-48ba-9752-ce1fcfcfe146 None admin] PATH_INFO: `/v3/roles` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ffe0f1-205c-48ba-9752-ce1fcfcfe146 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ffe0f1-205c-48ba-9752-ce1fcfcfe146 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1157/2337] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 12:58:59 2024] GET /identity/v3/roles => generated 1680 bytes in 16 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c3da84-7bba-4117-8cdf-6235202d2ecf None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c3da84-7bba-4117-8cdf-6235202d2ecf None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad17166-14dd-4643-80be-1daf1b989407 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad17166-14dd-4643-80be-1daf1b989407 None admin] REQUEST_METHOD: `PUT` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad17166-14dd-4643-80be-1daf1b989407 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad17166-14dd-4643-80be-1daf1b989407 None admin] PATH_INFO: `/v3/projects/c694f53ff803405fbe02034b963b9cc0/users/d0b3622f91ca475dad45c7fc9915b63a/roles/44620cad10ae407c90c91e2c296adb04` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad17166-14dd-4643-80be-1daf1b989407 None admin] RBAC: Authorizing `identity:create_grant(project_id=c694f53ff803405fbe02034b963b9cc0, user_id=d0b3622f91ca475dad45c7fc9915b63a, role_id=44620cad10ae407c90c91e2c296adb04)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad17166-14dd-4643-80be-1daf1b989407 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1181/2338] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 12:58:59 2024] PUT /identity/v3/projects/c694f53ff803405fbe02034b963b9cc0/users/d0b3622f91ca475dad45c7fc9915b63a/roles/44620cad10ae407c90c91e2c296adb04 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c7a359-5deb-44c1-a543-14fa17d7e851 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c7a359-5deb-44c1-a543-14fa17d7e851 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c7a359-5deb-44c1-a543-14fa17d7e851 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-76c7a359-5deb-44c1-a543-14fa17d7e851 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-76c7a359-5deb-44c1-a543-14fa17d7e851 None None] MFA Rules not processed for user `d0b3622f91ca475dad45c7fc9915b63a`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-76c7a359-5deb-44c1-a543-14fa17d7e851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1158/2339] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:58:59 2024] POST /identity/v3/auth/tokens => generated 3950 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad17166-14dd-4643-80be-1daf1b989407 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad17166-14dd-4643-80be-1daf1b989407 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcbc3c1-be99-4b68-861d-e91bbd17689b None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcbc3c1-be99-4b68-861d-e91bbd17689b None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcbc3c1-be99-4b68-861d-e91bbd17689b None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcbc3c1-be99-4b68-861d-e91bbd17689b None admin] PATH_INFO: `/v3/projects` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcbc3c1-be99-4b68-861d-e91bbd17689b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcbc3c1-be99-4b68-861d-e91bbd17689b None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1182/2340] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 12:58:59 2024] POST /identity/v3/projects => generated 379 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c7a359-5deb-44c1-a543-14fa17d7e851 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c7a359-5deb-44c1-a543-14fa17d7e851 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fdd6b7-71f6-49f5-acfc-7b30bc38507d None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fdd6b7-71f6-49f5-acfc-7b30bc38507d None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fdd6b7-71f6-49f5-acfc-7b30bc38507d None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fdd6b7-71f6-49f5-acfc-7b30bc38507d None admin] PATH_INFO: `/v3/users` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fdd6b7-71f6-49f5-acfc-7b30bc38507d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fdd6b7-71f6-49f5-acfc-7b30bc38507d None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-b1fdd6b7-71f6-49f5-acfc-7b30bc38507d None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1159/2341] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 12:58:59 2024] POST /identity/v3/users => generated 297 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcbc3c1-be99-4b68-861d-e91bbd17689b None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcbc3c1-be99-4b68-861d-e91bbd17689b None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d313e8-edde-4cfc-bbb9-4d6abcb05b2c None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d313e8-edde-4cfc-bbb9-4d6abcb05b2c None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d313e8-edde-4cfc-bbb9-4d6abcb05b2c None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d313e8-edde-4cfc-bbb9-4d6abcb05b2c None admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d313e8-edde-4cfc-bbb9-4d6abcb05b2c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d313e8-edde-4cfc-bbb9-4d6abcb05b2c None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:59 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0ff54ac4-b262-4846-9adc-bdeb391988b0 tempest-PublicSharesTest-1667420263 None] <<< [GET] https://127.0.0.1:40443/api/views/ May 28 12:58:59 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0ff54ac4-b262-4846-9adc-bdeb391988b0 tempest-PublicSharesTest-1667420263 None] [Bunch(abac_tags=[], abe_max_depth=None, abe_protocols=[], alias='', allow_anonymous_access=False, allow_s3_anonymous_access=False, auto_commit='0d', bucket='', bucket_creators=[], bucket_creators_groups=[], bucket_owner=None, bulk_permission_update_progress=None, bulk_permission_update_state=None, cluster='loop75-kfs', cluster_id=1, created='2024-05-28T12:58:56.175462Z', enabled=True, files_retention_mode='NONE', guid='3c2c05ec-831d-4dd0-87ff-e6998638aabd', id=32, ignore_oos=False, internal=False, is_remote=False, is_seamless=False, logical_capacity=0, max_retention_period=None, min_retention_period=None, name='834576a8-b0ac-4cc8-a1a0-0067a9513141', nfs_interop_flags='BOTH_NFS3_AND_NFS4_INTEROP_DISABLED', path='/manila/manila-834576a8-b0ac-4cc8-a1a0-0067a9513141', physical_capacity=0, policy='834576a8-b0ac-4cc8-a1a0-0067a9513141', policy_id=33, protocols=['NFS'], qos_policy=None, qos_policy_id=None, s3_locks=False, s3_locks_retention_mode='NONE', s3_locks_retention_period='', s3_unverified_lookup=False, s3_versioning=False, select_for_live_monitoring=False, share='', share_acl=Bunch(acl=[], enabled=False), sync='SYNCED', sync_time='2024-05-28T12:58:56.433883Z', tenant_id=1, tenant_name='default', title='/manila/manila-834576a8-b0ac-4cc8-a1a0-0067a9513141', url='https://127.0.0.1:40443/api/views/32/')] May 28 12:58:59 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0ff54ac4-b262-4846-9adc-bdeb391988b0 tempest-PublicSharesTest-1667420263 None] --- [GET] https://127.0.0.1:40443/api/views/: Done May 28 12:58:59 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0ff54ac4-b262-4846-9adc-bdeb391988b0 tempest-PublicSharesTest-1667420263 None] >>> [DELETE] https://127.0.0.1:40443/api/views/32/ May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1183/2342] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 12:58:59 2024] GET /identity/v3/roles => generated 1680 bytes in 17 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fdd6b7-71f6-49f5-acfc-7b30bc38507d None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fdd6b7-71f6-49f5-acfc-7b30bc38507d None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc13daf-8e1a-49f3-9f51-63dee6eec8fc None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc13daf-8e1a-49f3-9f51-63dee6eec8fc None admin] REQUEST_METHOD: `PUT` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc13daf-8e1a-49f3-9f51-63dee6eec8fc None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc13daf-8e1a-49f3-9f51-63dee6eec8fc None admin] PATH_INFO: `/v3/projects/12b7f375024d426b909d3ce9d9c2dce5/users/04c5375ea1c54473adec6ae2dbce8b7d/roles/e7989893488f483baa107be56668c4f8` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc13daf-8e1a-49f3-9f51-63dee6eec8fc None admin] RBAC: Authorizing `identity:create_grant(project_id=12b7f375024d426b909d3ce9d9c2dce5, user_id=04c5375ea1c54473adec6ae2dbce8b7d, role_id=e7989893488f483baa107be56668c4f8)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc13daf-8e1a-49f3-9f51-63dee6eec8fc None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1160/2343] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 12:58:59 2024] PUT /identity/v3/projects/12b7f375024d426b909d3ce9d9c2dce5/users/04c5375ea1c54473adec6ae2dbce8b7d/roles/e7989893488f483baa107be56668c4f8 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d313e8-edde-4cfc-bbb9-4d6abcb05b2c None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d313e8-edde-4cfc-bbb9-4d6abcb05b2c None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:59 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e33a4def-e23e-4cb3-aa95-353e32ae4440 tempest-SharesMetadataTest-1561320255 None] <<< [GET] https://127.0.0.1:40443/api/views/ May 28 12:58:59 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e33a4def-e23e-4cb3-aa95-353e32ae4440 tempest-SharesMetadataTest-1561320255 None] [Bunch(abac_tags=[], abe_max_depth=None, abe_protocols=[], alias='', allow_anonymous_access=False, allow_s3_anonymous_access=False, auto_commit='0d', bucket='', bucket_creators=[], bucket_creators_groups=[], bucket_owner=None, bulk_permission_update_progress=None, bulk_permission_update_state=None, cluster='loop75-kfs', cluster_id=1, created='2024-05-28T12:57:25.087651Z', enabled=True, files_retention_mode='NONE', guid='3d1d4674-2606-490b-ae43-88cfba8daced', id=17, ignore_oos=False, internal=False, is_remote=False, is_seamless=False, logical_capacity=0, max_retention_period=None, min_retention_period=None, name='5a6db1ad-927e-4228-b973-3ff998e29ada', nfs_interop_flags='BOTH_NFS3_AND_NFS4_INTEROP_DISABLED', path='/manila/manila-5a6db1ad-927e-4228-b973-3ff998e29ada', physical_capacity=0, policy='5a6db1ad-927e-4228-b973-3ff998e29ada', policy_id=18, protocols=['NFS'], qos_policy=None, qos_policy_id=None, s3_locks=False, s3_locks_retention_mode='NONE', s3_locks_retention_period='', s3_unverified_lookup=False, s3_versioning=False, select_for_live_monitoring=False, share='', share_acl=Bunch(acl=[], enabled=False), sync='SYNCED', sync_time='2024-05-28T12:57:25.450440Z', tenant_id=1, tenant_name='default', title='/manila/manila-5a6db1ad-927e-4228-b973-3ff998e29ada', url='https://127.0.0.1:40443/api/views/17/')] May 28 12:58:59 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e33a4def-e23e-4cb3-aa95-353e32ae4440 tempest-SharesMetadataTest-1561320255 None] --- [GET] https://127.0.0.1:40443/api/views/: Done May 28 12:58:59 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e33a4def-e23e-4cb3-aa95-353e32ae4440 tempest-SharesMetadataTest-1561320255 None] >>> [DELETE] https://127.0.0.1:40443/api/views/17/ May 28 12:58:59 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-64b6b83c-689d-413b-b4f8-269942b89902 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:58:59 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-64b6b83c-689d-413b-b4f8-269942b89902 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] [Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=1, created='2024-05-28T12:58:43.845440Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='31b6534b-d142-4561-992f-4f0759db302d', id=32, internal=False, is_s3_default_policy=False, name='7fdd602c-79d0-479c-95a2-336b202c6639', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=[], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['*'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['*'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T12:58:44.191603Z', tenant_id=1, tenant_name='default', title='7fdd602c-79d0-479c-95a2-336b202c6639', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/32/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[])] May 28 12:58:59 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-64b6b83c-689d-413b-b4f8-269942b89902 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 12:58:59 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-64b6b83c-689d-413b-b4f8-269942b89902 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] changing access on /manila/manila-7fdd602c-79d0-479c-95a2-336b202c6639. Rules: {'nfs_read_write': ['203.0.113.22'], 'nfs_read_only': []} May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6b091b-84e8-4d75-a17a-e51c09bcd19e None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:59 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-64b6b83c-689d-413b-b4f8-269942b89902 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] >>> [PATCH] https://127.0.0.1:40443/api/viewpolicies/32/ May 28 12:58:59 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-64b6b83c-689d-413b-b4f8-269942b89902 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] {'data': '{"name": "7fdd602c-79d0-479c-95a2-336b202c6639", "nfs_no_squash": ' May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6b091b-84e8-4d75-a17a-e51c09bcd19e None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6b091b-84e8-4d75-a17a-e51c09bcd19e None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:59 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-64b6b83c-689d-413b-b4f8-269942b89902 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] '["*"], "nfs_root_squash": ["*"], "nfs_read_write": ["203.0.113.22"], ' May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6b091b-84e8-4d75-a17a-e51c09bcd19e None admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:59 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-64b6b83c-689d-413b-b4f8-269942b89902 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] '"nfs_read_only": []}', May 28 12:58:59 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-64b6b83c-689d-413b-b4f8-269942b89902 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] 'params': None} May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6b091b-84e8-4d75-a17a-e51c09bcd19e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6b091b-84e8-4d75-a17a-e51c09bcd19e None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1184/2344] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 12:58:59 2024] GET /identity/v3/roles => generated 1680 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc13daf-8e1a-49f3-9f51-63dee6eec8fc None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc13daf-8e1a-49f3-9f51-63dee6eec8fc None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ddf191-4031-4b4d-9cb4-09345193e259 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ddf191-4031-4b4d-9cb4-09345193e259 None admin] REQUEST_METHOD: `PUT` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ddf191-4031-4b4d-9cb4-09345193e259 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ddf191-4031-4b4d-9cb4-09345193e259 None admin] PATH_INFO: `/v3/projects/12b7f375024d426b909d3ce9d9c2dce5/users/04c5375ea1c54473adec6ae2dbce8b7d/roles/e7989893488f483baa107be56668c4f8` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ddf191-4031-4b4d-9cb4-09345193e259 None admin] RBAC: Authorizing `identity:create_grant(project_id=12b7f375024d426b909d3ce9d9c2dce5, user_id=04c5375ea1c54473adec6ae2dbce8b7d, role_id=e7989893488f483baa107be56668c4f8)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ddf191-4031-4b4d-9cb4-09345193e259 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1161/2345] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 12:58:59 2024] PUT /identity/v3/projects/12b7f375024d426b909d3ce9d9c2dce5/users/04c5375ea1c54473adec6ae2dbce8b7d/roles/e7989893488f483baa107be56668c4f8 => generated 0 bytes in 20 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaa3da2-2446-4b5a-98d7-5a2e70c9be89 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaa3da2-2446-4b5a-98d7-5a2e70c9be89 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaa3da2-2446-4b5a-98d7-5a2e70c9be89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-ddaa3da2-2446-4b5a-98d7-5a2e70c9be89 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-ddaa3da2-2446-4b5a-98d7-5a2e70c9be89 None None] MFA Rules not processed for user `04c5375ea1c54473adec6ae2dbce8b7d`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-ddaa3da2-2446-4b5a-98d7-5a2e70c9be89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1185/2346] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:58:59 2024] POST /identity/v3/auth/tokens => generated 4073 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ddf191-4031-4b4d-9cb4-09345193e259 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ddf191-4031-4b4d-9cb4-09345193e259 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c6c294-042c-4d09-b335-cf62779eb6ea tempest-ShareNetworkAdminTest-442987898 tempest-ShareNetworkAdminTest-442987898-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04c5375ea1c54473adec6ae2dbce8b7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12b7f375024d426b909d3ce9d9c2dce5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c6c294-042c-4d09-b335-cf62779eb6ea tempest-ShareNetworkAdminTest-442987898 tempest-ShareNetworkAdminTest-442987898-project-admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c6c294-042c-4d09-b335-cf62779eb6ea tempest-ShareNetworkAdminTest-442987898 tempest-ShareNetworkAdminTest-442987898-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c6c294-042c-4d09-b335-cf62779eb6ea tempest-ShareNetworkAdminTest-442987898 tempest-ShareNetworkAdminTest-442987898-project-admin] PATH_INFO: `/v3/domains` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c6c294-042c-4d09-b335-cf62779eb6ea tempest-ShareNetworkAdminTest-442987898 tempest-ShareNetworkAdminTest-442987898-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c6c294-042c-4d09-b335-cf62779eb6ea tempest-ShareNetworkAdminTest-442987898 tempest-ShareNetworkAdminTest-442987898-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c6c294-042c-4d09-b335-cf62779eb6ea tempest-ShareNetworkAdminTest-442987898 tempest-ShareNetworkAdminTest-442987898-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1162/2347] 10.27.203.238 () {62 vars in 1241 bytes} [Tue May 28 12:58:59 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaa3da2-2446-4b5a-98d7-5a2e70c9be89 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaa3da2-2446-4b5a-98d7-5a2e70c9be89 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7e58d8-743f-4e66-aea5-7716c415463e tempest-ShareNetworkAdminTest-442987898 tempest-ShareNetworkAdminTest-442987898-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04c5375ea1c54473adec6ae2dbce8b7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12b7f375024d426b909d3ce9d9c2dce5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7e58d8-743f-4e66-aea5-7716c415463e tempest-ShareNetworkAdminTest-442987898 tempest-ShareNetworkAdminTest-442987898-project-admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7e58d8-743f-4e66-aea5-7716c415463e tempest-ShareNetworkAdminTest-442987898 tempest-ShareNetworkAdminTest-442987898-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7e58d8-743f-4e66-aea5-7716c415463e tempest-ShareNetworkAdminTest-442987898 tempest-ShareNetworkAdminTest-442987898-project-admin] PATH_INFO: `/v3/users` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7e58d8-743f-4e66-aea5-7716c415463e tempest-ShareNetworkAdminTest-442987898 tempest-ShareNetworkAdminTest-442987898-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7e58d8-743f-4e66-aea5-7716c415463e tempest-ShareNetworkAdminTest-442987898 tempest-ShareNetworkAdminTest-442987898-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-9c7e58d8-743f-4e66-aea5-7716c415463e tempest-ShareNetworkAdminTest-442987898 tempest-ShareNetworkAdminTest-442987898-project-admin] Truncating password to algorithm specific maximum length 72 characters. May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1186/2348] 10.27.203.238 () {64 vars in 1232 bytes} [Tue May 28 12:58:59 2024] POST /identity/v3/users => generated 435 bytes in 31 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c6c294-042c-4d09-b335-cf62779eb6ea tempest-ShareNetworkAdminTest-442987898 tempest-ShareNetworkAdminTest-442987898-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c6c294-042c-4d09-b335-cf62779eb6ea tempest-ShareNetworkAdminTest-442987898 tempest-ShareNetworkAdminTest-442987898-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd18e95-083c-45b6-bc2e-c5b563807538 tempest-ShareNetworkAdminTest-442987898 tempest-ShareNetworkAdminTest-442987898-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04c5375ea1c54473adec6ae2dbce8b7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12b7f375024d426b909d3ce9d9c2dce5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd18e95-083c-45b6-bc2e-c5b563807538 tempest-ShareNetworkAdminTest-442987898 tempest-ShareNetworkAdminTest-442987898-project-admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd18e95-083c-45b6-bc2e-c5b563807538 tempest-ShareNetworkAdminTest-442987898 tempest-ShareNetworkAdminTest-442987898-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd18e95-083c-45b6-bc2e-c5b563807538 tempest-ShareNetworkAdminTest-442987898 tempest-ShareNetworkAdminTest-442987898-project-admin] PATH_INFO: `/v3/roles` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd18e95-083c-45b6-bc2e-c5b563807538 tempest-ShareNetworkAdminTest-442987898 tempest-ShareNetworkAdminTest-442987898-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd18e95-083c-45b6-bc2e-c5b563807538 tempest-ShareNetworkAdminTest-442987898 tempest-ShareNetworkAdminTest-442987898-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1163/2349] 10.27.203.238 () {62 vars in 1210 bytes} [Tue May 28 12:58:59 2024] GET /identity/v3/roles => generated 1680 bytes in 17 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7e58d8-743f-4e66-aea5-7716c415463e tempest-ShareNetworkAdminTest-442987898 tempest-ShareNetworkAdminTest-442987898-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7e58d8-743f-4e66-aea5-7716c415463e tempest-ShareNetworkAdminTest-442987898 tempest-ShareNetworkAdminTest-442987898-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945d8044-c4dd-4cd4-83c0-cf3c4be5ab42 tempest-ShareNetworkAdminTest-442987898 tempest-ShareNetworkAdminTest-442987898-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04c5375ea1c54473adec6ae2dbce8b7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12b7f375024d426b909d3ce9d9c2dce5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945d8044-c4dd-4cd4-83c0-cf3c4be5ab42 tempest-ShareNetworkAdminTest-442987898 tempest-ShareNetworkAdminTest-442987898-project-admin] REQUEST_METHOD: `PUT` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945d8044-c4dd-4cd4-83c0-cf3c4be5ab42 tempest-ShareNetworkAdminTest-442987898 tempest-ShareNetworkAdminTest-442987898-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945d8044-c4dd-4cd4-83c0-cf3c4be5ab42 tempest-ShareNetworkAdminTest-442987898 tempest-ShareNetworkAdminTest-442987898-project-admin] PATH_INFO: `/v3/projects/12b7f375024d426b909d3ce9d9c2dce5/users/5000ae7b72ab4d8aad66382d4e873caf/roles/44620cad10ae407c90c91e2c296adb04` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945d8044-c4dd-4cd4-83c0-cf3c4be5ab42 tempest-ShareNetworkAdminTest-442987898 tempest-ShareNetworkAdminTest-442987898-project-admin] RBAC: Authorizing `identity:create_grant(project_id=12b7f375024d426b909d3ce9d9c2dce5, user_id=5000ae7b72ab4d8aad66382d4e873caf, role_id=44620cad10ae407c90c91e2c296adb04)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945d8044-c4dd-4cd4-83c0-cf3c4be5ab42 tempest-ShareNetworkAdminTest-442987898 tempest-ShareNetworkAdminTest-442987898-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1187/2350] 10.27.203.238 () {64 vars in 1571 bytes} [Tue May 28 12:58:59 2024] PUT /identity/v3/projects/12b7f375024d426b909d3ce9d9c2dce5/users/5000ae7b72ab4d8aad66382d4e873caf/roles/44620cad10ae407c90c91e2c296adb04 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd18e95-083c-45b6-bc2e-c5b563807538 tempest-ShareNetworkAdminTest-442987898 tempest-ShareNetworkAdminTest-442987898-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:58:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-fdd18e95-083c-45b6-bc2e-c5b563807538 tempest-ShareNetworkAdminTest-442987898 tempest-ShareNetworkAdminTest-442987898-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:59:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd18e95-083c-45b6-bc2e-c5b563807538 tempest-ShareNetworkAdminTest-442987898 tempest-ShareNetworkAdminTest-442987898-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5b65af-9541-4fd1-84b1-9e02a64afecf service manila] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f110cf6300f049c897d0aab63218d1e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5b65af-9541-4fd1-84b1-9e02a64afecf service manila] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5b65af-9541-4fd1-84b1-9e02a64afecf service manila] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5b65af-9541-4fd1-84b1-9e02a64afecf service manila] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5b65af-9541-4fd1-84b1-9e02a64afecf service manila] RBAC: Authorizing `identity:validate_token()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5b65af-9541-4fd1-84b1-9e02a64afecf service manila] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:00 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1164/2351] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 12:58:59 2024] GET /identity/v3/auth/tokens => generated 3952 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 12:59:00 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-3fdbec62-4914-4e6a-9065-9998d13ddaa0 tempest-ShareNetworkAdminTest-2146789644 tempest-ShareNetworkAdminTest-2146789644-project-member] POST http://10.27.203.238/share/v1/69c481a96f964f9d8120576a305a17b5/security-services May 28 12:59:00 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-3fdbec62-4914-4e6a-9065-9998d13ddaa0 tempest-ShareNetworkAdminTest-2146789644 tempest-ShareNetworkAdminTest-2146789644-project-member] Action: 'create', calling method: SecurityServiceController.create, body: {"security_service": {"type": "ldap", "name": "tempest-ss-name-158874306", "description": "tempest-ss-desc-62664892", "dns_ip": "203.0.113.87", "server": "203.0.113.77", "domain": "tempest-ss-domain-778038324", "user": "tempest-ss-user-637478769", "password": "***"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:59:00 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-3fdbec62-4914-4e6a-9065-9998d13ddaa0 tempest-ShareNetworkAdminTest-2146789644 tempest-ShareNetworkAdminTest-2146789644-project-member] http://10.27.203.238/share/v1/69c481a96f964f9d8120576a305a17b5/security-services returned with HTTP 200 May 28 12:59:00 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 650/1287] 10.27.203.238 () {64 vars in 1352 bytes} [Tue May 28 12:58:59 2024] POST /share/v1/69c481a96f964f9d8120576a305a17b5/security-services => generated 470 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:59:00 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-5dd2c3ba-272a-45d4-8994-36a3395a8c51 tempest-ShareNetworkAdminTest-2146789644 tempest-ShareNetworkAdminTest-2146789644-project-member] POST http://10.27.203.238/share/v1/69c481a96f964f9d8120576a305a17b5/share-networks May 28 12:59:00 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-5dd2c3ba-272a-45d4-8994-36a3395a8c51 tempest-ShareNetworkAdminTest-2146789644 tempest-ShareNetworkAdminTest-2146789644-project-member] Action: 'create', calling method: ShareNetworkController.create, body: {"share_network": {"name": "sn_with_ldap_ss", "neutron_net_id": "1111", "neutron_subnet_id": "2222", "created_at": "2002-02-02", "updated_at": null, "network_type": "vlan", "segmentation_id": 1000, "cidr": "10.0.0.0/24", "ip_version": 4, "description": "fake description"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:59:00 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.quota [None req-5dd2c3ba-272a-45d4-8994-36a3395a8c51 tempest-ShareNetworkAdminTest-2146789644 tempest-ShareNetworkAdminTest-2146789644-project-member] Created reservations ['3ae78613-879f-4ed8-9e1f-5c72931d7df0'] {{(pid=98330) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 12:59:00 l75lg1-v1 dstat.sh[49771]: 28-05 12:59:00| 11 1 84 3 0|5728M 1747M 277M 7872M| 16k 3627B| 0 2150k| 0 266 |7411 13k|1.00 1.02 1.00|3.0 2.0 0| 0 0 | 0 2048M| 29 362 0 32 0 May 28 12:59:00 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.quota [None req-5dd2c3ba-272a-45d4-8994-36a3395a8c51 tempest-ShareNetworkAdminTest-2146789644 tempest-ShareNetworkAdminTest-2146789644-project-member] Committed reservations ['3ae78613-879f-4ed8-9e1f-5c72931d7df0'] {{(pid=98330) commit /opt/stack/manila/manila/quota.py:1063}} May 28 12:59:00 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-5dd2c3ba-272a-45d4-8994-36a3395a8c51 tempest-ShareNetworkAdminTest-2146789644 tempest-ShareNetworkAdminTest-2146789644-project-member] http://10.27.203.238/share/v1/69c481a96f964f9d8120576a305a17b5/share-networks returned with HTTP 200 May 28 12:59:00 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 638/1288] 10.27.203.238 () {64 vars in 1343 bytes} [Tue May 28 12:59:00 2024] POST /share/v1/69c481a96f964f9d8120576a305a17b5/share-networks => generated 406 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:59:00 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-b99eab1c-64a5-41e8-a5b5-e9de5cbc0599 tempest-ShareNetworkAdminTest-2146789644 tempest-ShareNetworkAdminTest-2146789644-project-member] POST http://10.27.203.238/share/v1/69c481a96f964f9d8120576a305a17b5/share-networks/574d6092-137d-4981-8808-8e9affce4c42/action May 28 12:59:00 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-b99eab1c-64a5-41e8-a5b5-e9de5cbc0599 tempest-ShareNetworkAdminTest-2146789644 tempest-ShareNetworkAdminTest-2146789644-project-member] Action body: b'{"add_security_service": {"security_service_id": "78620523-b490-4fc9-bcf8-e82888dd7919"}}' {{(pid=98329) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:59:00 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-b99eab1c-64a5-41e8-a5b5-e9de5cbc0599 tempest-ShareNetworkAdminTest-2146789644 tempest-ShareNetworkAdminTest-2146789644-project-member] Action: 'action', calling method: ShareNetworkController.add_security_service, body: {"add_security_service": {"security_service_id": "78620523-b490-4fc9-bcf8-e82888dd7919"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:59:00 l75lg1-v1 neutron-server[77618]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.HashRingHealthCheckPeriodics.touch_hash_ring_nodes' {{(pid=77618) _process_scheduled /opt/stack/data/venv/lib/python3.10/site-packages/futurist/periodics.py:638}} May 28 12:59:00 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-b99eab1c-64a5-41e8-a5b5-e9de5cbc0599 tempest-ShareNetworkAdminTest-2146789644 tempest-ShareNetworkAdminTest-2146789644-project-member] http://10.27.203.238/share/v1/69c481a96f964f9d8120576a305a17b5/share-networks/574d6092-137d-4981-8808-8e9affce4c42/action returned with HTTP 200 May 28 12:59:00 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 651/1289] 10.27.203.238 () {64 vars in 1474 bytes} [Tue May 28 12:59:00 2024] POST /share/v1/69c481a96f964f9d8120576a305a17b5/share-networks/574d6092-137d-4981-8808-8e9affce4c42/action => generated 406 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:59:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945d8044-c4dd-4cd4-83c0-cf3c4be5ab42 tempest-ShareNetworkAdminTest-442987898 tempest-ShareNetworkAdminTest-442987898-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-945d8044-c4dd-4cd4-83c0-cf3c4be5ab42 tempest-ShareNetworkAdminTest-442987898 tempest-ShareNetworkAdminTest-442987898-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:59:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945d8044-c4dd-4cd4-83c0-cf3c4be5ab42 tempest-ShareNetworkAdminTest-442987898 tempest-ShareNetworkAdminTest-442987898-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01573a57-1f8b-4990-80a9-3454caef7653 service manila] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f110cf6300f049c897d0aab63218d1e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01573a57-1f8b-4990-80a9-3454caef7653 service manila] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01573a57-1f8b-4990-80a9-3454caef7653 service manila] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01573a57-1f8b-4990-80a9-3454caef7653 service manila] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01573a57-1f8b-4990-80a9-3454caef7653 service manila] RBAC: Authorizing `identity:validate_token()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01573a57-1f8b-4990-80a9-3454caef7653 service manila] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:00 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1188/2352] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 12:59:00 2024] GET /identity/v3/auth/tokens => generated 3950 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 12:59:00 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-df76fdf6-52bf-4752-9c47-8d2379e85d5a tempest-ShareNetworkAdminTest-598600044 tempest-ShareNetworkAdminTest-598600044-project-member] POST http://10.27.203.238/share/v2/c694f53ff803405fbe02034b963b9cc0/security-services May 28 12:59:00 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-df76fdf6-52bf-4752-9c47-8d2379e85d5a tempest-ShareNetworkAdminTest-598600044 tempest-ShareNetworkAdminTest-598600044-project-member] Action: 'create', calling method: SecurityServiceController.create, body: {"security_service": {"type": "kerberos", "name": "sn_with_ldap_ss", "neutron_net_id": "1111", "neutron_subnet_id": "2222", "created_at": "2002-02-02", "updated_at": null, "network_type": "vlan", "segmentation_id": 1000, "cidr": "10.0.0.0/24", "ip_version": 4, "description": "fake description"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:59:00 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-df76fdf6-52bf-4752-9c47-8d2379e85d5a tempest-ShareNetworkAdminTest-598600044 tempest-ShareNetworkAdminTest-598600044-project-member] http://10.27.203.238/share/v2/c694f53ff803405fbe02034b963b9cc0/security-services returned with HTTP 200 May 28 12:59:00 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 639/1290] 10.27.203.238 () {66 vars in 1395 bytes} [Tue May 28 12:59:00 2024] POST /share/v2/c694f53ff803405fbe02034b963b9cc0/security-services => generated 382 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:59:00 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-34d78969-5107-4847-8dd1-21da6d5e1a49 tempest-ShareNetworkAdminTest-598600044 tempest-ShareNetworkAdminTest-598600044-project-member] POST http://10.27.203.238/share/v2/c694f53ff803405fbe02034b963b9cc0/share-networks May 28 12:59:00 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-34d78969-5107-4847-8dd1-21da6d5e1a49 tempest-ShareNetworkAdminTest-598600044 tempest-ShareNetworkAdminTest-598600044-project-member] Action: 'create', calling method: ShareNetworkController.create, body: {"share_network": {"cleanup_in_class": true, "add_security_services": false, "name": "sn_with_kerberos_ss", "created_at": "2003-03-03", "updated_at": null, "neutron_net_id": "test net id", "neutron_subnet_id": "test subnet id", "network_type": "local", "segmentation_id": 2000, "cidr": "10.0.0.0/13", "ip_version": 6, "description": "fake description"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:59:00 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.quota [None req-34d78969-5107-4847-8dd1-21da6d5e1a49 tempest-ShareNetworkAdminTest-598600044 tempest-ShareNetworkAdminTest-598600044-project-member] Created reservations ['812a48e7-0d4d-4555-a53e-e0200b596c32'] {{(pid=98329) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 12:59:00 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.quota [None req-34d78969-5107-4847-8dd1-21da6d5e1a49 tempest-ShareNetworkAdminTest-598600044 tempest-ShareNetworkAdminTest-598600044-project-member] Committed reservations ['812a48e7-0d4d-4555-a53e-e0200b596c32'] {{(pid=98329) commit /opt/stack/manila/manila/quota.py:1063}} May 28 12:59:00 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-34d78969-5107-4847-8dd1-21da6d5e1a49 tempest-ShareNetworkAdminTest-598600044 tempest-ShareNetworkAdminTest-598600044-project-member] http://10.27.203.238/share/v2/c694f53ff803405fbe02034b963b9cc0/share-networks returned with HTTP 200 May 28 12:59:00 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 652/1291] 10.27.203.238 () {66 vars in 1386 bytes} [Tue May 28 12:59:00 2024] POST /share/v2/c694f53ff803405fbe02034b963b9cc0/share-networks => generated 723 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:59:00 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-beb08646-13e8-43e3-b926-f48bfb23b26f tempest-ShareNetworkAdminTest-598600044 tempest-ShareNetworkAdminTest-598600044-project-member] POST http://10.27.203.238/share/v2/c694f53ff803405fbe02034b963b9cc0/share-networks/dad12ce5-8573-4112-ac61-af56994c5509/action May 28 12:59:00 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-beb08646-13e8-43e3-b926-f48bfb23b26f tempest-ShareNetworkAdminTest-598600044 tempest-ShareNetworkAdminTest-598600044-project-member] Action body: b'{"add_security_service": {"security_service_id": "cd4c6b16-d28b-4b37-8ea6-700ac5f3a996"}}' {{(pid=98330) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:59:00 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-beb08646-13e8-43e3-b926-f48bfb23b26f tempest-ShareNetworkAdminTest-598600044 tempest-ShareNetworkAdminTest-598600044-project-member] Action: 'action', calling method: ShareNetworkController.add_security_service, body: {"add_security_service": {"security_service_id": "cd4c6b16-d28b-4b37-8ea6-700ac5f3a996"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:59:00 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-beb08646-13e8-43e3-b926-f48bfb23b26f tempest-ShareNetworkAdminTest-598600044 tempest-ShareNetworkAdminTest-598600044-project-member] http://10.27.203.238/share/v2/c694f53ff803405fbe02034b963b9cc0/share-networks/dad12ce5-8573-4112-ac61-af56994c5509/action returned with HTTP 200 May 28 12:59:00 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 640/1292] 10.27.203.238 () {66 vars in 1517 bytes} [Tue May 28 12:59:00 2024] POST /share/v2/c694f53ff803405fbe02034b963b9cc0/share-networks/dad12ce5-8573-4112-ac61-af56994c5509/action => generated 723 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:59:00 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-47c47674-78ff-4bb3-bd54-89f646333735 tempest-ShareNetworkAdminTest-2146789644 tempest-ShareNetworkAdminTest-2146789644-project-member] GET http://10.27.203.238/share/v1/69c481a96f964f9d8120576a305a17b5/share-networks May 28 12:59:00 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-47c47674-78ff-4bb3-bd54-89f646333735 tempest-ShareNetworkAdminTest-2146789644 tempest-ShareNetworkAdminTest-2146789644-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:00 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-47c47674-78ff-4bb3-bd54-89f646333735 tempest-ShareNetworkAdminTest-2146789644 tempest-ShareNetworkAdminTest-2146789644-project-member] Calling method 'ShareNetworkController.index' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:00 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-47c47674-78ff-4bb3-bd54-89f646333735 tempest-ShareNetworkAdminTest-2146789644 tempest-ShareNetworkAdminTest-2146789644-project-member] http://10.27.203.238/share/v1/69c481a96f964f9d8120576a305a17b5/share-networks returned with HTTP 200 May 28 12:59:00 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 653/1293] 10.27.203.238 () {62 vars in 1321 bytes} [Tue May 28 12:59:00 2024] GET /share/v1/69c481a96f964f9d8120576a305a17b5/share-networks => generated 95 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 229 bytes (1 switches on core 0) May 28 12:59:00 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-0035a956-1558-4ffd-adef-9ed47ae198f6 tempest-ShareNetworkAdminTest-2146789644 tempest-ShareNetworkAdminTest-2146789644-project-member] DELETE http://10.27.203.238/share/v1/69c481a96f964f9d8120576a305a17b5/security-services/78620523-b490-4fc9-bcf8-e82888dd7919 May 28 12:59:00 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-0035a956-1558-4ffd-adef-9ed47ae198f6 tempest-ShareNetworkAdminTest-2146789644 tempest-ShareNetworkAdminTest-2146789644-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:00 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-0035a956-1558-4ffd-adef-9ed47ae198f6 tempest-ShareNetworkAdminTest-2146789644 tempest-ShareNetworkAdminTest-2146789644-project-member] Calling method 'SecurityServiceController.delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:00 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.v1.security_service [None req-0035a956-1558-4ffd-adef-9ed47ae198f6 tempest-ShareNetworkAdminTest-2146789644 tempest-ShareNetworkAdminTest-2146789644-project-member] Delete security service with id: 78620523-b490-4fc9-bcf8-e82888dd7919 May 28 12:59:00 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-0035a956-1558-4ffd-adef-9ed47ae198f6 tempest-ShareNetworkAdminTest-2146789644 tempest-ShareNetworkAdminTest-2146789644-project-member] HTTP exception thrown: Cannot delete security service. It is assigned to share network(s) May 28 12:59:00 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-0035a956-1558-4ffd-adef-9ed47ae198f6 tempest-ShareNetworkAdminTest-2146789644 tempest-ShareNetworkAdminTest-2146789644-project-member] http://10.27.203.238/share/v1/69c481a96f964f9d8120576a305a17b5/security-services/78620523-b490-4fc9-bcf8-e82888dd7919 returned with HTTP 403 May 28 12:59:00 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 641/1294] 10.27.203.238 () {62 vars in 1444 bytes} [Tue May 28 12:59:00 2024] DELETE /share/v1/69c481a96f964f9d8120576a305a17b5/security-services/78620523-b490-4fc9-bcf8-e82888dd7919 => generated 109 bytes in 20 msecs (HTTP/1.1 403) 6 headers in 237 bytes (1 switches on core 0) May 28 12:59:00 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-58d20b89-2b61-401c-9488-23ec3367f863 tempest-ShareNetworkAdminTest-2146789644 tempest-ShareNetworkAdminTest-2146789644-project-member] GET http://10.27.203.238/share/v1/69c481a96f964f9d8120576a305a17b5/share-networks/detail?created_before=2002-10-10&created_since=2001-01-01&neutron_net_id=1111&neutron_subnet_id=2222&network_type=vlan&segmentation_id=1000&cidr=10.0.0.0%2F24&ip_version=4&name=sn_with_ldap_ss May 28 12:59:00 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-58d20b89-2b61-401c-9488-23ec3367f863 tempest-ShareNetworkAdminTest-2146789644 tempest-ShareNetworkAdminTest-2146789644-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:00 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-58d20b89-2b61-401c-9488-23ec3367f863 tempest-ShareNetworkAdminTest-2146789644 tempest-ShareNetworkAdminTest-2146789644-project-member] Calling method 'ShareNetworkController.detail' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:00 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-58d20b89-2b61-401c-9488-23ec3367f863 tempest-ShareNetworkAdminTest-2146789644 tempest-ShareNetworkAdminTest-2146789644-project-member] http://10.27.203.238/share/v1/69c481a96f964f9d8120576a305a17b5/share-networks/detail?created_before=2002-10-10&created_since=2001-01-01&neutron_net_id=1111&neutron_subnet_id=2222&network_type=vlan&segmentation_id=1000&cidr=10.0.0.0%2F24&ip_version=4&name=sn_with_ldap_ss returned with HTTP 200 May 28 12:59:00 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 654/1295] 10.27.203.238 () {62 vars in 1713 bytes} [Tue May 28 12:59:00 2024] GET /share/v1/69c481a96f964f9d8120576a305a17b5/share-networks/detail?created_before=2002-10-10&created_since=2001-01-01&neutron_net_id=1111&neutron_subnet_id=2222&network_type=vlan&segmentation_id=1000&cidr=10.0.0.0%2F24&ip_version=4&name=sn_with_ldap_ss => generated 409 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:59:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5b65af-9541-4fd1-84b1-9e02a64afecf service manila] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5b65af-9541-4fd1-84b1-9e02a64afecf service manila] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8d6920-51e8-4d65-9ea4-25ed9e595c96 service manila] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f110cf6300f049c897d0aab63218d1e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8d6920-51e8-4d65-9ea4-25ed9e595c96 service manila] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8d6920-51e8-4d65-9ea4-25ed9e595c96 service manila] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8d6920-51e8-4d65-9ea4-25ed9e595c96 service manila] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8d6920-51e8-4d65-9ea4-25ed9e595c96 service manila] RBAC: Authorizing `identity:validate_token()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8d6920-51e8-4d65-9ea4-25ed9e595c96 service manila] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:00 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1165/2353] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 12:59:00 2024] GET /identity/v3/auth/tokens => generated 4073 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 12:59:00 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-802b15f9-f01d-479a-acd3-40392450b494 tempest-ShareNetworkAdminTest-442987898 tempest-ShareNetworkAdminTest-442987898-project-admin] GET http://10.27.203.238/share/v2/12b7f375024d426b909d3ce9d9c2dce5/share-networks/detail?all_tenants=1 May 28 12:59:00 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-802b15f9-f01d-479a-acd3-40392450b494 tempest-ShareNetworkAdminTest-442987898 tempest-ShareNetworkAdminTest-442987898-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:00 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-802b15f9-f01d-479a-acd3-40392450b494 tempest-ShareNetworkAdminTest-442987898 tempest-ShareNetworkAdminTest-442987898-project-admin] Calling method 'ShareNetworkController.detail' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:00 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-802b15f9-f01d-479a-acd3-40392450b494 tempest-ShareNetworkAdminTest-442987898 tempest-ShareNetworkAdminTest-442987898-project-admin] http://10.27.203.238/share/v2/12b7f375024d426b909d3ce9d9c2dce5/share-networks/detail?all_tenants=1 returned with HTTP 200 May 28 12:59:00 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 642/1296] 10.27.203.238 () {64 vars in 1412 bytes} [Tue May 28 12:59:00 2024] GET /share/v2/12b7f375024d426b909d3ce9d9c2dce5/share-networks/detail?all_tenants=1 => generated 1410 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:59:00 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-bcae6783-8307-4f2d-809b-ece7a889de71 tempest-ShareNetworkAdminTest-442987898 tempest-ShareNetworkAdminTest-442987898-project-admin] GET http://10.27.203.238/share/v2/12b7f375024d426b909d3ce9d9c2dce5/share-networks/detail?project_id=c694f53ff803405fbe02034b963b9cc0 May 28 12:59:00 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-bcae6783-8307-4f2d-809b-ece7a889de71 tempest-ShareNetworkAdminTest-442987898 tempest-ShareNetworkAdminTest-442987898-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:00 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-bcae6783-8307-4f2d-809b-ece7a889de71 tempest-ShareNetworkAdminTest-442987898 tempest-ShareNetworkAdminTest-442987898-project-admin] Calling method 'ShareNetworkController.detail' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:00 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-bcae6783-8307-4f2d-809b-ece7a889de71 tempest-ShareNetworkAdminTest-442987898 tempest-ShareNetworkAdminTest-442987898-project-admin] http://10.27.203.238/share/v2/12b7f375024d426b909d3ce9d9c2dce5/share-networks/detail?project_id=c694f53ff803405fbe02034b963b9cc0 returned with HTTP 200 May 28 12:59:00 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 655/1297] 10.27.203.238 () {64 vars in 1472 bytes} [Tue May 28 12:59:00 2024] GET /share/v2/12b7f375024d426b909d3ce9d9c2dce5/share-networks/detail?project_id=c694f53ff803405fbe02034b963b9cc0 => generated 726 bytes in 28 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:59:00 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-3b5a6690-bdda-4e4f-bff4-4a7cadfd4998 tempest-ShareNetworkAdminTest-2146789644 tempest-ShareNetworkAdminTest-2146789644-project-member] GET http://10.27.203.238/share/v1/69c481a96f964f9d8120576a305a17b5/share-networks/detail?security_service_id=78620523-b490-4fc9-bcf8-e82888dd7919 May 28 12:59:00 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-3b5a6690-bdda-4e4f-bff4-4a7cadfd4998 tempest-ShareNetworkAdminTest-2146789644 tempest-ShareNetworkAdminTest-2146789644-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:00 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-3b5a6690-bdda-4e4f-bff4-4a7cadfd4998 tempest-ShareNetworkAdminTest-2146789644 tempest-ShareNetworkAdminTest-2146789644-project-member] Calling method 'ShareNetworkController.detail' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:01 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-3b5a6690-bdda-4e4f-bff4-4a7cadfd4998 tempest-ShareNetworkAdminTest-2146789644 tempest-ShareNetworkAdminTest-2146789644-project-member] http://10.27.203.238/share/v1/69c481a96f964f9d8120576a305a17b5/share-networks/detail?security_service_id=78620523-b490-4fc9-bcf8-e82888dd7919 returned with HTTP 200 May 28 12:59:01 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 643/1298] 10.27.203.238 () {62 vars in 1455 bytes} [Tue May 28 12:59:00 2024] GET /share/v1/69c481a96f964f9d8120576a305a17b5/share-networks/detail?security_service_id=78620523-b490-4fc9-bcf8-e82888dd7919 => generated 409 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:59:01 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-b250a8ad-e463-4b9a-903f-c5a71d9a20b2 tempest-ShareNetworkAdminTest-2146789644 tempest-ShareNetworkAdminTest-2146789644-project-member] GET http://10.27.203.238/share/v1/69c481a96f964f9d8120576a305a17b5/security-services?share_network_id=574d6092-137d-4981-8808-8e9affce4c42 May 28 12:59:01 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-b250a8ad-e463-4b9a-903f-c5a71d9a20b2 tempest-ShareNetworkAdminTest-2146789644 tempest-ShareNetworkAdminTest-2146789644-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:01 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-b250a8ad-e463-4b9a-903f-c5a71d9a20b2 tempest-ShareNetworkAdminTest-2146789644 tempest-ShareNetworkAdminTest-2146789644-project-member] Calling method 'SecurityServiceController.index' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:01 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.common [None req-b250a8ad-e463-4b9a-903f-c5a71d9a20b2 tempest-ShareNetworkAdminTest-2146789644 tempest-ShareNetworkAdminTest-2146789644-project-member] Removing options '' from query {{(pid=98329) remove_invalid_options /opt/stack/manila/manila/api/common.py:441}} May 28 12:59:01 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-b250a8ad-e463-4b9a-903f-c5a71d9a20b2 tempest-ShareNetworkAdminTest-2146789644 tempest-ShareNetworkAdminTest-2146789644-project-member] http://10.27.203.238/share/v1/69c481a96f964f9d8120576a305a17b5/security-services?share_network_id=574d6092-137d-4981-8808-8e9affce4c42 returned with HTTP 200 May 28 12:59:01 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 656/1299] 10.27.203.238 () {62 vars in 1437 bytes} [Tue May 28 12:59:01 2024] GET /share/v1/69c481a96f964f9d8120576a305a17b5/security-services?share_network_id=574d6092-137d-4981-8808-8e9affce4c42 => generated 141 bytes in 24 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:59:01 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-529c156f-3f98-4638-83fe-aa1f47f4abb7 tempest-ShareNetworkAdminTest-2146789644 tempest-ShareNetworkAdminTest-2146789644-project-member] GET http://10.27.203.238/share/v2/69c481a96f964f9d8120576a305a17b5/share-networks/detail?name~=ldap_ss&description~=fa May 28 12:59:01 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-529c156f-3f98-4638-83fe-aa1f47f4abb7 tempest-ShareNetworkAdminTest-2146789644 tempest-ShareNetworkAdminTest-2146789644-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:01 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-529c156f-3f98-4638-83fe-aa1f47f4abb7 tempest-ShareNetworkAdminTest-2146789644 tempest-ShareNetworkAdminTest-2146789644-project-member] Calling method 'ShareNetworkController.detail' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:01 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-d1d71b01-9a5f-43bf-a873-1b0fe3ff90e9 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] GET http://10.27.203.238/share/v2/776f75906bc64f8f9316d5aab4b50bf1/share-access-rules?share_id=1ddadc17-cf10-4a42-8bbd-8335fb3520a1 May 28 12:59:01 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-d1d71b01-9a5f-43bf-a873-1b0fe3ff90e9 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:01 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-d1d71b01-9a5f-43bf-a873-1b0fe3ff90e9 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:01 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-529c156f-3f98-4638-83fe-aa1f47f4abb7 tempest-ShareNetworkAdminTest-2146789644 tempest-ShareNetworkAdminTest-2146789644-project-member] http://10.27.203.238/share/v2/69c481a96f964f9d8120576a305a17b5/share-networks/detail?name~=ldap_ss&description~=fa returned with HTTP 200 May 28 12:59:01 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 644/1300] 10.27.203.238 () {64 vars in 1444 bytes} [Tue May 28 12:59:01 2024] GET /share/v2/69c481a96f964f9d8120576a305a17b5/share-networks/detail?name~=ldap_ss&description~=fa => generated 704 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:59:01 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-0f013ed7-7027-4697-a725-e1dc4196be2f tempest-ShareNetworkAdminTest-2146789644 tempest-ShareNetworkAdminTest-2146789644-project-member] GET http://10.27.203.238/share/v2/69c481a96f964f9d8120576a305a17b5/share-networks/detail May 28 12:59:01 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-0f013ed7-7027-4697-a725-e1dc4196be2f tempest-ShareNetworkAdminTest-2146789644 tempest-ShareNetworkAdminTest-2146789644-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:01 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-0f013ed7-7027-4697-a725-e1dc4196be2f tempest-ShareNetworkAdminTest-2146789644 tempest-ShareNetworkAdminTest-2146789644-project-member] Calling method 'ShareNetworkController.detail' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:01 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-0f013ed7-7027-4697-a725-e1dc4196be2f tempest-ShareNetworkAdminTest-2146789644 tempest-ShareNetworkAdminTest-2146789644-project-member] http://10.27.203.238/share/v2/69c481a96f964f9d8120576a305a17b5/share-networks/detail returned with HTTP 200 May 28 12:59:01 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 645/1301] 10.27.203.238 () {64 vars in 1385 bytes} [Tue May 28 12:59:01 2024] GET /share/v2/69c481a96f964f9d8120576a305a17b5/share-networks/detail => generated 704 bytes in 25 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:59:01 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.lock.api [None req-d1d71b01-9a5f-43bf-a873-1b0fe3ff90e9 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Searching for locks by: {'resource_id': 'dcbfb2d2-f874-4731-aecb-8d02b182cdd2', 'resource_action': 'show', 'resource_type': 'access_rule'} {{(pid=98329) get_all /opt/stack/manila/manila/lock/api.py:112}} May 28 12:59:01 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-d1d71b01-9a5f-43bf-a873-1b0fe3ff90e9 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] http://10.27.203.238/share/v2/776f75906bc64f8f9316d5aab4b50bf1/share-access-rules?share_id=1ddadc17-cf10-4a42-8bbd-8335fb3520a1 returned with HTTP 200 May 28 12:59:01 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-6992e5e2-ccd5-48a0-97ad-5c479de2f890 tempest-ShareNetworkAdminTest-2146789644 tempest-ShareNetworkAdminTest-2146789644-project-member] GET http://10.27.203.238/share/v1/69c481a96f964f9d8120576a305a17b5/share-networks/detail?all_tenants=1 May 28 12:59:01 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 657/1302] 10.27.203.238 () {64 vars in 1467 bytes} [Tue May 28 12:59:01 2024] GET /share/v2/776f75906bc64f8f9316d5aab4b50bf1/share-access-rules?share_id=1ddadc17-cf10-4a42-8bbd-8335fb3520a1 => generated 307 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:59:01 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-6992e5e2-ccd5-48a0-97ad-5c479de2f890 tempest-ShareNetworkAdminTest-2146789644 tempest-ShareNetworkAdminTest-2146789644-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:01 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-6992e5e2-ccd5-48a0-97ad-5c479de2f890 tempest-ShareNetworkAdminTest-2146789644 tempest-ShareNetworkAdminTest-2146789644-project-member] Calling method 'ShareNetworkController.detail' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:01 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-44246d78-b1f2-4b75-acf4-be51a29f2b40 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] POST http://10.27.203.238/share/v2/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action May 28 12:59:01 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-44246d78-b1f2-4b75-acf4-be51a29f2b40 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Action body: b'{"deny_access": {"access_id": "dcbfb2d2-f874-4731-aecb-8d02b182cdd2"}}' {{(pid=98329) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:59:01 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-44246d78-b1f2-4b75-acf4-be51a29f2b40 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Action: 'action', calling method: ShareController.deny_access, body: {"deny_access": {"access_id": "dcbfb2d2-f874-4731-aecb-8d02b182cdd2"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:59:01 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.lock.api [None req-44246d78-b1f2-4b75-acf4-be51a29f2b40 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Searching for locks by: {'resource_id': 'dcbfb2d2-f874-4731-aecb-8d02b182cdd2', 'resource_action': 'delete'} {{(pid=98329) get_all /opt/stack/manila/manila/lock/api.py:112}} May 28 12:59:01 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-6992e5e2-ccd5-48a0-97ad-5c479de2f890 tempest-ShareNetworkAdminTest-2146789644 tempest-ShareNetworkAdminTest-2146789644-project-member] http://10.27.203.238/share/v1/69c481a96f964f9d8120576a305a17b5/share-networks/detail?all_tenants=1 returned with HTTP 200 May 28 12:59:01 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 646/1303] 10.27.203.238 () {62 vars in 1369 bytes} [Tue May 28 12:59:01 2024] GET /share/v1/69c481a96f964f9d8120576a305a17b5/share-networks/detail?all_tenants=1 => generated 409 bytes in 26 msecs (HTTP/1.1 200) 6 headers in 230 bytes (2 switches on core 0) May 28 12:59:01 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-5b3963c6-0d42-4b67-b398-cacca80bb179 tempest-ShareNetworkAdminTest-2146789644 tempest-ShareNetworkAdminTest-2146789644-project-member] GET http://10.27.203.238/share/v1/69c481a96f964f9d8120576a305a17b5/share-networks/detail?project_id=some_project May 28 12:59:01 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-5b3963c6-0d42-4b67-b398-cacca80bb179 tempest-ShareNetworkAdminTest-2146789644 tempest-ShareNetworkAdminTest-2146789644-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:01 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-5b3963c6-0d42-4b67-b398-cacca80bb179 tempest-ShareNetworkAdminTest-2146789644 tempest-ShareNetworkAdminTest-2146789644-project-member] Calling method 'ShareNetworkController.detail' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:01 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-5b3963c6-0d42-4b67-b398-cacca80bb179 tempest-ShareNetworkAdminTest-2146789644 tempest-ShareNetworkAdminTest-2146789644-project-member] http://10.27.203.238/share/v1/69c481a96f964f9d8120576a305a17b5/share-networks/detail?project_id=some_project returned with HTTP 200 May 28 12:59:01 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 647/1304] 10.27.203.238 () {62 vars in 1389 bytes} [Tue May 28 12:59:01 2024] GET /share/v1/69c481a96f964f9d8120576a305a17b5/share-networks/detail?project_id=some_project => generated 409 bytes in 26 msecs (HTTP/1.1 200) 6 headers in 230 bytes (2 switches on core 0) May 28 12:59:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01573a57-1f8b-4990-80a9-3454caef7653 service manila] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01573a57-1f8b-4990-80a9-3454caef7653 service manila] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cf4f29-7003-4558-aabe-8e9e0eafb6cc tempest-ShareNetworkAdminTest-442987898 tempest-ShareNetworkAdminTest-442987898-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04c5375ea1c54473adec6ae2dbce8b7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12b7f375024d426b909d3ce9d9c2dce5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cf4f29-7003-4558-aabe-8e9e0eafb6cc tempest-ShareNetworkAdminTest-442987898 tempest-ShareNetworkAdminTest-442987898-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cf4f29-7003-4558-aabe-8e9e0eafb6cc tempest-ShareNetworkAdminTest-442987898 tempest-ShareNetworkAdminTest-442987898-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cf4f29-7003-4558-aabe-8e9e0eafb6cc tempest-ShareNetworkAdminTest-442987898 tempest-ShareNetworkAdminTest-442987898-project-admin] PATH_INFO: `/v3/users/5000ae7b72ab4d8aad66382d4e873caf` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cf4f29-7003-4558-aabe-8e9e0eafb6cc tempest-ShareNetworkAdminTest-442987898 tempest-ShareNetworkAdminTest-442987898-project-admin] RBAC: Authorizing `identity:delete_user(user_id=5000ae7b72ab4d8aad66382d4e873caf)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cf4f29-7003-4558-aabe-8e9e0eafb6cc tempest-ShareNetworkAdminTest-442987898 tempest-ShareNetworkAdminTest-442987898-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:01 l75lg1-v1 devstack@m-api.service[98329]: DEBUG oslo_concurrency.lockutils [None req-44246d78-b1f2-4b75-acf4-be51a29f2b40 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98329) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:01 l75lg1-v1 devstack@m-api.service[98329]: DEBUG oslo_concurrency.lockutils [None req-44246d78-b1f2-4b75-acf4-be51a29f2b40 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98329) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:01 l75lg1-v1 devstack@m-api.service[98329]: DEBUG oslo_concurrency.lockutils [None req-44246d78-b1f2-4b75-acf4-be51a29f2b40 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.048s {{(pid=98329) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:01 l75lg1-v1 devstack@m-api.service[98329]: DEBUG oslo_concurrency.lockutils [None req-44246d78-b1f2-4b75-acf4-be51a29f2b40 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98329) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:01 l75lg1-v1 dstat.sh[49771]: 28-05 12:59:01| 11 1 85 2 0|5729M 1746M 277M 7872M| 15k 13k| 0 1768k| 0 252 |6327 11k|1.00 1.02 1.00|1.0 1.0 0| 0 0 | 0 2048M| 29 363 0 29 0 May 28 12:59:01 l75lg1-v1 devstack@m-api.service[98329]: DEBUG oslo_concurrency.lockutils [None req-44246d78-b1f2-4b75-acf4-be51a29f2b40 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98329) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-33cf4f29-7003-4558-aabe-8e9e0eafb6cc tempest-ShareNetworkAdminTest-442987898 tempest-ShareNetworkAdminTest-442987898-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5000ae7b72ab4d8aad66382d4e873caf', 'request_id': 'req-33cf4f29-7003-4558-aabe-8e9e0eafb6cc'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-33cf4f29-7003-4558-aabe-8e9e0eafb6cc tempest-ShareNetworkAdminTest-442987898 tempest-ShareNetworkAdminTest-442987898-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5000ae7b72ab4d8aad66382d4e873caf', 'request_id': 'req-33cf4f29-7003-4558-aabe-8e9e0eafb6cc'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-33cf4f29-7003-4558-aabe-8e9e0eafb6cc tempest-ShareNetworkAdminTest-442987898 tempest-ShareNetworkAdminTest-442987898-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5000ae7b72ab4d8aad66382d4e873caf', 'request_id': 'req-33cf4f29-7003-4558-aabe-8e9e0eafb6cc'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-33cf4f29-7003-4558-aabe-8e9e0eafb6cc tempest-ShareNetworkAdminTest-442987898 tempest-ShareNetworkAdminTest-442987898-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5000ae7b72ab4d8aad66382d4e873caf', 'request_id': 'req-33cf4f29-7003-4558-aabe-8e9e0eafb6cc'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-33cf4f29-7003-4558-aabe-8e9e0eafb6cc tempest-ShareNetworkAdminTest-442987898 tempest-ShareNetworkAdminTest-442987898-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5000ae7b72ab4d8aad66382d4e873caf', 'request_id': 'req-33cf4f29-7003-4558-aabe-8e9e0eafb6cc'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:01 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1189/2354] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 12:59:01 2024] DELETE /identity/v3/users/5000ae7b72ab4d8aad66382d4e873caf => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:59:01 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-1bcfb901-c6dd-42b6-819d-ecf33d6dbc7b tempest-ShareNetworkAdminTest-2146789644 tempest-ShareNetworkAdminTest-2146789644-project-member] DELETE http://10.27.203.238/share/v1/69c481a96f964f9d8120576a305a17b5/share-networks/574d6092-137d-4981-8808-8e9affce4c42 May 28 12:59:01 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-1bcfb901-c6dd-42b6-819d-ecf33d6dbc7b tempest-ShareNetworkAdminTest-2146789644 tempest-ShareNetworkAdminTest-2146789644-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:01 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-1bcfb901-c6dd-42b6-819d-ecf33d6dbc7b tempest-ShareNetworkAdminTest-2146789644 tempest-ShareNetworkAdminTest-2146789644-project-member] Calling method 'ShareNetworkController.delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:01 l75lg1-v1 devstack@m-api.service[98329]: DEBUG oslo_concurrency.lockutils [None req-44246d78-b1f2-4b75-acf4-be51a29f2b40 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.069s {{(pid=98329) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:01 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-44246d78-b1f2-4b75-acf4-be51a29f2b40 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] http://10.27.203.238/share/v2/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action returned with HTTP 202 May 28 12:59:01 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 658/1305] 10.27.203.238 () {66 vars in 1493 bytes} [Tue May 28 12:59:01 2024] POST /share/v2/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action => generated 0 bytes in 202 msecs (HTTP/1.1 202) 6 headers in 243 bytes (2 switches on core 0) May 28 12:59:01 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-6d553dfc-51dd-4fc7-b32d-546295a28aac tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] GET http://10.27.203.238/share/v2/776f75906bc64f8f9316d5aab4b50bf1/share-access-rules?share_id=1ddadc17-cf10-4a42-8bbd-8335fb3520a1 May 28 12:59:01 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-6d553dfc-51dd-4fc7-b32d-546295a28aac tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:01 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-6d553dfc-51dd-4fc7-b32d-546295a28aac tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:01 l75lg1-v1 manila-share[98474]: DEBUG manila.share.manager [None req-44246d78-b1f2-4b75-acf4-be51a29f2b40 tempest-ShareIpRulesForNFSTest-1748669711 None] Received request to update access for share instance b7a7d61c-2cea-442a-9809-507038e080d5. {{(pid=98474) update_access_for_instances /opt/stack/manila/manila/share/manager.py:4353}} May 28 12:59:01 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-44246d78-b1f2-4b75-acf4-be51a29f2b40 tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:01 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-44246d78-b1f2-4b75-acf4-be51a29f2b40 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:01 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-44246d78-b1f2-4b75-acf4-be51a29f2b40 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:01 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-44246d78-b1f2-4b75-acf4-be51a29f2b40 tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:01 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-44246d78-b1f2-4b75-acf4-be51a29f2b40 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:01 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.lock.api [None req-6d553dfc-51dd-4fc7-b32d-546295a28aac tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Searching for locks by: {'resource_id': 'dcbfb2d2-f874-4731-aecb-8d02b182cdd2', 'resource_action': 'show', 'resource_type': 'access_rule'} {{(pid=98329) get_all /opt/stack/manila/manila/lock/api.py:112}} May 28 12:59:01 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-6d553dfc-51dd-4fc7-b32d-546295a28aac tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] http://10.27.203.238/share/v2/776f75906bc64f8f9316d5aab4b50bf1/share-access-rules?share_id=1ddadc17-cf10-4a42-8bbd-8335fb3520a1 returned with HTTP 200 May 28 12:59:01 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 659/1306] 10.27.203.238 () {64 vars in 1467 bytes} [Tue May 28 12:59:01 2024] GET /share/v2/776f75906bc64f8f9316d5aab4b50bf1/share-access-rules?share_id=1ddadc17-cf10-4a42-8bbd-8335fb3520a1 => generated 315 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:59:01 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-44246d78-b1f2-4b75-acf4-be51a29f2b40 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.052s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:01 l75lg1-v1 manila-share[98474]: DEBUG manila.share.access [None req-44246d78-b1f2-4b75-acf4-be51a29f2b40 tempest-ShareIpRulesForNFSTest-1748669711 None] Updating access rules for share instance b7a7d61c-2cea-442a-9809-507038e080d5 belonging to share 1ddadc17-cf10-4a42-8bbd-8335fb3520a1. {{(pid=98474) update_access_rules /opt/stack/manila/manila/share/access.py:298}} May 28 12:59:01 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-44246d78-b1f2-4b75-acf4-be51a29f2b40 tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:01 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-44246d78-b1f2-4b75-acf4-be51a29f2b40 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:01 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-44246d78-b1f2-4b75-acf4-be51a29f2b40 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.008s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:01 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-44246d78-b1f2-4b75-acf4-be51a29f2b40 tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:01 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-44246d78-b1f2-4b75-acf4-be51a29f2b40 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:01 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-44246d78-b1f2-4b75-acf4-be51a29f2b40 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.017s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:01 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-44246d78-b1f2-4b75-acf4-be51a29f2b40 tempest-ShareIpRulesForNFSTest-1748669711 None] changing access on None May 28 12:59:01 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-44246d78-b1f2-4b75-acf4-be51a29f2b40 tempest-ShareIpRulesForNFSTest-1748669711 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:59:01 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-44246d78-b1f2-4b75-acf4-be51a29f2b40 tempest-ShareIpRulesForNFSTest-1748669711 None] {'allow_redirects': True, May 28 12:59:01 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-44246d78-b1f2-4b75-acf4-be51a29f2b40 tempest-ShareIpRulesForNFSTest-1748669711 None] 'params': {'name': 'b7a7d61c-2cea-442a-9809-507038e080d5'}} May 28 12:59:01 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.quota [None req-1bcfb901-c6dd-42b6-819d-ecf33d6dbc7b tempest-ShareNetworkAdminTest-2146789644 tempest-ShareNetworkAdminTest-2146789644-project-member] Created reservations ['9a0e8f3d-638a-4348-9b7e-b08c342c8e21'] {{(pid=98330) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 12:59:01 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.quota [None req-1bcfb901-c6dd-42b6-819d-ecf33d6dbc7b tempest-ShareNetworkAdminTest-2146789644 tempest-ShareNetworkAdminTest-2146789644-project-member] Committed reservations ['9a0e8f3d-638a-4348-9b7e-b08c342c8e21'] {{(pid=98330) commit /opt/stack/manila/manila/quota.py:1063}} May 28 12:59:01 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-1bcfb901-c6dd-42b6-819d-ecf33d6dbc7b tempest-ShareNetworkAdminTest-2146789644 tempest-ShareNetworkAdminTest-2146789644-project-member] http://10.27.203.238/share/v1/69c481a96f964f9d8120576a305a17b5/share-networks/574d6092-137d-4981-8808-8e9affce4c42 returned with HTTP 202 May 28 12:59:01 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 648/1307] 10.27.203.238 () {62 vars in 1435 bytes} [Tue May 28 12:59:01 2024] DELETE /share/v1/69c481a96f964f9d8120576a305a17b5/share-networks/574d6092-137d-4981-8808-8e9affce4c42 => generated 0 bytes in 200 msecs (HTTP/1.1 202) 6 headers in 242 bytes (1 switches on core 0) May 28 12:59:01 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-76220bed-d3ee-4145-b948-771a656bc2de tempest-ShareNetworkAdminTest-2146789644 tempest-ShareNetworkAdminTest-2146789644-project-member] GET http://10.27.203.238/share/v1/69c481a96f964f9d8120576a305a17b5/share-networks/574d6092-137d-4981-8808-8e9affce4c42 May 28 12:59:01 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-76220bed-d3ee-4145-b948-771a656bc2de tempest-ShareNetworkAdminTest-2146789644 tempest-ShareNetworkAdminTest-2146789644-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:01 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-76220bed-d3ee-4145-b948-771a656bc2de tempest-ShareNetworkAdminTest-2146789644 tempest-ShareNetworkAdminTest-2146789644-project-member] Calling method 'ShareNetworkController.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:01 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-76220bed-d3ee-4145-b948-771a656bc2de tempest-ShareNetworkAdminTest-2146789644 tempest-ShareNetworkAdminTest-2146789644-project-member] HTTP exception thrown: Share network 574d6092-137d-4981-8808-8e9affce4c42 could not be found. May 28 12:59:01 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-76220bed-d3ee-4145-b948-771a656bc2de tempest-ShareNetworkAdminTest-2146789644 tempest-ShareNetworkAdminTest-2146789644-project-member] http://10.27.203.238/share/v1/69c481a96f964f9d8120576a305a17b5/share-networks/574d6092-137d-4981-8808-8e9affce4c42 returned with HTTP 404 May 28 12:59:01 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 660/1308] 10.27.203.238 () {62 vars in 1432 bytes} [Tue May 28 12:59:01 2024] GET /share/v1/69c481a96f964f9d8120576a305a17b5/share-networks/574d6092-137d-4981-8808-8e9affce4c42 => generated 116 bytes in 20 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 12:59:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8d6920-51e8-4d65-9ea4-25ed9e595c96 service manila] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8d6920-51e8-4d65-9ea4-25ed9e595c96 service manila] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d8efe3-360c-48c7-8c15-8a727cc5958b None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d8efe3-360c-48c7-8c15-8a727cc5958b None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d8efe3-360c-48c7-8c15-8a727cc5958b None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d8efe3-360c-48c7-8c15-8a727cc5958b None admin] PATH_INFO: `/v3/users/e98090c4a86b441897a7e520ff496299` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d8efe3-360c-48c7-8c15-8a727cc5958b None admin] RBAC: Authorizing `identity:delete_user(user_id=e98090c4a86b441897a7e520ff496299)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d8efe3-360c-48c7-8c15-8a727cc5958b None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-78d8efe3-360c-48c7-8c15-8a727cc5958b None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e98090c4a86b441897a7e520ff496299', 'request_id': 'req-78d8efe3-360c-48c7-8c15-8a727cc5958b'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-78d8efe3-360c-48c7-8c15-8a727cc5958b None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e98090c4a86b441897a7e520ff496299', 'request_id': 'req-78d8efe3-360c-48c7-8c15-8a727cc5958b'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-78d8efe3-360c-48c7-8c15-8a727cc5958b None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e98090c4a86b441897a7e520ff496299', 'request_id': 'req-78d8efe3-360c-48c7-8c15-8a727cc5958b'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-78d8efe3-360c-48c7-8c15-8a727cc5958b None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e98090c4a86b441897a7e520ff496299', 'request_id': 'req-78d8efe3-360c-48c7-8c15-8a727cc5958b'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-78d8efe3-360c-48c7-8c15-8a727cc5958b None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e98090c4a86b441897a7e520ff496299', 'request_id': 'req-78d8efe3-360c-48c7-8c15-8a727cc5958b'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:01 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1166/2355] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 12:59:01 2024] DELETE /identity/v3/users/e98090c4a86b441897a7e520ff496299 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:59:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cf4f29-7003-4558-aabe-8e9e0eafb6cc tempest-ShareNetworkAdminTest-442987898 tempest-ShareNetworkAdminTest-442987898-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-33cf4f29-7003-4558-aabe-8e9e0eafb6cc tempest-ShareNetworkAdminTest-442987898 tempest-ShareNetworkAdminTest-442987898-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:59:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cf4f29-7003-4558-aabe-8e9e0eafb6cc tempest-ShareNetworkAdminTest-442987898 tempest-ShareNetworkAdminTest-442987898-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5fcf4b-896f-4660-898a-a3ba381d0683 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5fcf4b-896f-4660-898a-a3ba381d0683 None admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5fcf4b-896f-4660-898a-a3ba381d0683 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5fcf4b-896f-4660-898a-a3ba381d0683 None admin] PATH_INFO: `/v3/users/d0b3622f91ca475dad45c7fc9915b63a` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5fcf4b-896f-4660-898a-a3ba381d0683 None admin] RBAC: Authorizing `identity:delete_user(user_id=d0b3622f91ca475dad45c7fc9915b63a)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5fcf4b-896f-4660-898a-a3ba381d0683 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-ea5fcf4b-896f-4660-898a-a3ba381d0683 None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0b3622f91ca475dad45c7fc9915b63a', 'request_id': 'req-ea5fcf4b-896f-4660-898a-a3ba381d0683'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-ea5fcf4b-896f-4660-898a-a3ba381d0683 None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0b3622f91ca475dad45c7fc9915b63a', 'request_id': 'req-ea5fcf4b-896f-4660-898a-a3ba381d0683'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-ea5fcf4b-896f-4660-898a-a3ba381d0683 None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0b3622f91ca475dad45c7fc9915b63a', 'request_id': 'req-ea5fcf4b-896f-4660-898a-a3ba381d0683'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-ea5fcf4b-896f-4660-898a-a3ba381d0683 None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0b3622f91ca475dad45c7fc9915b63a', 'request_id': 'req-ea5fcf4b-896f-4660-898a-a3ba381d0683'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-ea5fcf4b-896f-4660-898a-a3ba381d0683 None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0b3622f91ca475dad45c7fc9915b63a', 'request_id': 'req-ea5fcf4b-896f-4660-898a-a3ba381d0683'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:01 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1190/2356] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 12:59:01 2024] DELETE /identity/v3/users/d0b3622f91ca475dad45c7fc9915b63a => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:59:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d8efe3-360c-48c7-8c15-8a727cc5958b None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-78d8efe3-360c-48c7-8c15-8a727cc5958b None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:59:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d8efe3-360c-48c7-8c15-8a727cc5958b None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef9431f-9f6f-4c18-a1d0-599d15edfd63 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef9431f-9f6f-4c18-a1d0-599d15edfd63 None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef9431f-9f6f-4c18-a1d0-599d15edfd63 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef9431f-9f6f-4c18-a1d0-599d15edfd63 None admin] PATH_INFO: `/v3/users/04c5375ea1c54473adec6ae2dbce8b7d` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef9431f-9f6f-4c18-a1d0-599d15edfd63 None admin] RBAC: Authorizing `identity:delete_user(user_id=04c5375ea1c54473adec6ae2dbce8b7d)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef9431f-9f6f-4c18-a1d0-599d15edfd63 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-2ef9431f-9f6f-4c18-a1d0-599d15edfd63 None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04c5375ea1c54473adec6ae2dbce8b7d', 'request_id': 'req-2ef9431f-9f6f-4c18-a1d0-599d15edfd63'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-2ef9431f-9f6f-4c18-a1d0-599d15edfd63 None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04c5375ea1c54473adec6ae2dbce8b7d', 'request_id': 'req-2ef9431f-9f6f-4c18-a1d0-599d15edfd63'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-2ef9431f-9f6f-4c18-a1d0-599d15edfd63 None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04c5375ea1c54473adec6ae2dbce8b7d', 'request_id': 'req-2ef9431f-9f6f-4c18-a1d0-599d15edfd63'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-2ef9431f-9f6f-4c18-a1d0-599d15edfd63 None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04c5375ea1c54473adec6ae2dbce8b7d', 'request_id': 'req-2ef9431f-9f6f-4c18-a1d0-599d15edfd63'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-2ef9431f-9f6f-4c18-a1d0-599d15edfd63 None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04c5375ea1c54473adec6ae2dbce8b7d', 'request_id': 'req-2ef9431f-9f6f-4c18-a1d0-599d15edfd63'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:01 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1167/2357] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 12:59:01 2024] DELETE /identity/v3/users/04c5375ea1c54473adec6ae2dbce8b7d => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:59:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba79956d-55fa-419b-961f-963339740646 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba79956d-55fa-419b-961f-963339740646 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba79956d-55fa-419b-961f-963339740646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:01 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-ba79956d-55fa-419b-961f-963339740646 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:59:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-ba79956d-55fa-419b-961f-963339740646 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:59:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-ba79956d-55fa-419b-961f-963339740646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:59:01 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1191/2358] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:59:01 2024] POST /identity/v3/auth/tokens => generated 2960 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 12:59:01 l75lg1-v1 neutron-server[77618]: DEBUG neutron.wsgi [-] (77618) accepted ('10.27.203.238', 58076) {{(pid=77618) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 12:59:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef9431f-9f6f-4c18-a1d0-599d15edfd63 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-2ef9431f-9f6f-4c18-a1d0-599d15edfd63 None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:59:01 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-0a70f26e-2c1a-43f5-8778-b11932701dff tempest-PublicSharesTest-1667420263 tempest-PublicSharesTest-1667420263-project-member] GET http://10.27.203.238/share/v2/6d36e1eb1dbc449db6aca75b12a2ba18/shares/84e821d0-2b62-48db-80c7-259f61a14bac May 28 12:59:01 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-0a70f26e-2c1a-43f5-8778-b11932701dff tempest-PublicSharesTest-1667420263 tempest-PublicSharesTest-1667420263-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:01 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-0a70f26e-2c1a-43f5-8778-b11932701dff tempest-PublicSharesTest-1667420263 tempest-PublicSharesTest-1667420263-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:01 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-0a70f26e-2c1a-43f5-8778-b11932701dff tempest-PublicSharesTest-1667420263 tempest-PublicSharesTest-1667420263-project-member] http://10.27.203.238/share/v2/6d36e1eb1dbc449db6aca75b12a2ba18/shares/84e821d0-2b62-48db-80c7-259f61a14bac returned with HTTP 200 May 28 12:59:01 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 649/1309] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:59:01 2024] GET /share/v2/6d36e1eb1dbc449db6aca75b12a2ba18/shares/84e821d0-2b62-48db-80c7-259f61a14bac => generated 1320 bytes in 25 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:59:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef9431f-9f6f-4c18-a1d0-599d15edfd63 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:01 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e33a4def-e23e-4cb3-aa95-353e32ae4440 tempest-SharesMetadataTest-1561320255 None] <<< [DELETE] https://127.0.0.1:40443/api/views/17/ May 28 12:59:01 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e33a4def-e23e-4cb3-aa95-353e32ae4440 tempest-SharesMetadataTest-1561320255 None] --- [DELETE] https://127.0.0.1:40443/api/views/17/: Done May 28 12:59:01 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e33a4def-e23e-4cb3-aa95-353e32ae4440 tempest-SharesMetadataTest-1561320255 None] >>> [GET] https://127.0.0.1:40443/api/quotas/ May 28 12:59:01 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e33a4def-e23e-4cb3-aa95-353e32ae4440 tempest-SharesMetadataTest-1561320255 None] {'allow_redirects': True, May 28 12:59:01 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e33a4def-e23e-4cb3-aa95-353e32ae4440 tempest-SharesMetadataTest-1561320255 None] 'params': {'name': '5a6db1ad-927e-4228-b973-3ff998e29ada'}} May 28 12:59:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20436cf5-8373-45a5-b358-23b5987b8c03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef17047035e4b518fd5360a01f2da1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20436cf5-8373-45a5-b358-23b5987b8c03 service neutron] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20436cf5-8373-45a5-b358-23b5987b8c03 service neutron] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20436cf5-8373-45a5-b358-23b5987b8c03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20436cf5-8373-45a5-b358-23b5987b8c03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20436cf5-8373-45a5-b358-23b5987b8c03 service neutron] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:01 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1168/2359] 10.27.203.238 () {64 vars in 1432 bytes} [Tue May 28 12:59:01 2024] GET /identity/v3/auth/tokens => generated 2960 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 28 12:59:01 l75lg1-v1 neutron-server[77618]: INFO neutron.wsgi [None req-dcf394f5-6985-4f1f-9907-ce2d19796067 None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=12b7f375024d426b909d3ce9d9c2dce5&name=default HTTP/1.1" status: 200 len: 216 time: 0.0736661 May 28 12:59:02 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba79956d-55fa-419b-961f-963339740646 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:02 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-ba79956d-55fa-419b-961f-963339740646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:59:02 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba79956d-55fa-419b-961f-963339740646 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:02 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069ca134-2360-4e22-94b9-c57bca46e6cc None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:02 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069ca134-2360-4e22-94b9-c57bca46e6cc None admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:02 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069ca134-2360-4e22-94b9-c57bca46e6cc None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:02 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069ca134-2360-4e22-94b9-c57bca46e6cc None admin] PATH_INFO: `/v3/projects/12b7f375024d426b909d3ce9d9c2dce5` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:02 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069ca134-2360-4e22-94b9-c57bca46e6cc None admin] RBAC: Authorizing `identity:delete_project(project_id=12b7f375024d426b909d3ce9d9c2dce5)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:02 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069ca134-2360-4e22-94b9-c57bca46e6cc None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:02 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-069ca134-2360-4e22-94b9-c57bca46e6cc None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12b7f375024d426b909d3ce9d9c2dce5', 'request_id': 'req-069ca134-2360-4e22-94b9-c57bca46e6cc'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:02 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-069ca134-2360-4e22-94b9-c57bca46e6cc None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12b7f375024d426b909d3ce9d9c2dce5', 'request_id': 'req-069ca134-2360-4e22-94b9-c57bca46e6cc'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:02 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-069ca134-2360-4e22-94b9-c57bca46e6cc None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12b7f375024d426b909d3ce9d9c2dce5', 'request_id': 'req-069ca134-2360-4e22-94b9-c57bca46e6cc'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:02 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-069ca134-2360-4e22-94b9-c57bca46e6cc None admin] The token cache is being invalidate because project 12b7f375024d426b909d3ce9d9c2dce5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 12:59:02 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-069ca134-2360-4e22-94b9-c57bca46e6cc None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:02 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-069ca134-2360-4e22-94b9-c57bca46e6cc None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:02 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1192/2360] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 12:59:02 2024] DELETE /identity/v3/projects/12b7f375024d426b909d3ce9d9c2dce5 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:59:02 l75lg1-v1 neutron-server[77618]: DEBUG neutron.wsgi [-] (77618) accepted ('10.27.203.238', 58080) {{(pid=77618) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 12:59:02 l75lg1-v1 neutron-server[77618]: INFO neutron.wsgi [None req-becc69ea-29c1-4281-b816-2d5834fce36e None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=c694f53ff803405fbe02034b963b9cc0&name=default HTTP/1.1" status: 200 len: 216 time: 0.0086608 May 28 12:59:02 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20436cf5-8373-45a5-b358-23b5987b8c03 service neutron] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:02 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0ff54ac4-b262-4846-9adc-bdeb391988b0 tempest-PublicSharesTest-1667420263 None] <<< [DELETE] https://127.0.0.1:40443/api/views/32/ May 28 12:59:02 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20436cf5-8373-45a5-b358-23b5987b8c03 service neutron] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:02 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0ff54ac4-b262-4846-9adc-bdeb391988b0 tempest-PublicSharesTest-1667420263 None] --- [DELETE] https://127.0.0.1:40443/api/views/32/: Done May 28 12:59:02 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0ff54ac4-b262-4846-9adc-bdeb391988b0 tempest-PublicSharesTest-1667420263 None] >>> [GET] https://127.0.0.1:40443/api/quotas/ May 28 12:59:02 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0ff54ac4-b262-4846-9adc-bdeb391988b0 tempest-PublicSharesTest-1667420263 None] {'allow_redirects': True, May 28 12:59:02 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0ff54ac4-b262-4846-9adc-bdeb391988b0 tempest-PublicSharesTest-1667420263 None] 'params': {'name': '834576a8-b0ac-4cc8-a1a0-0067a9513141'}} May 28 12:59:02 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb01e01-b36d-4aaf-8b8a-6f5ada3db1e8 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:02 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb01e01-b36d-4aaf-8b8a-6f5ada3db1e8 None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:02 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb01e01-b36d-4aaf-8b8a-6f5ada3db1e8 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:02 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb01e01-b36d-4aaf-8b8a-6f5ada3db1e8 None admin] PATH_INFO: `/v3/projects/c694f53ff803405fbe02034b963b9cc0` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:02 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb01e01-b36d-4aaf-8b8a-6f5ada3db1e8 None admin] RBAC: Authorizing `identity:delete_project(project_id=c694f53ff803405fbe02034b963b9cc0)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:02 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb01e01-b36d-4aaf-8b8a-6f5ada3db1e8 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:02 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-f4955cac-96ca-4625-a899-17e27c96667e tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] GET http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/9e24a210-9e96-45d9-b31c-f6f3377eb0e7 May 28 12:59:02 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-f4955cac-96ca-4625-a899-17e27c96667e tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:02 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-f4955cac-96ca-4625-a899-17e27c96667e tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:02 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-f4955cac-96ca-4625-a899-17e27c96667e tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/9e24a210-9e96-45d9-b31c-f6f3377eb0e7 returned with HTTP 200 May 28 12:59:02 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 661/1310] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:59:02 2024] GET /share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/9e24a210-9e96-45d9-b31c-f6f3377eb0e7 => generated 1326 bytes in 24 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:59:02 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-7eb01e01-b36d-4aaf-8b8a-6f5ada3db1e8 None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c694f53ff803405fbe02034b963b9cc0', 'request_id': 'req-7eb01e01-b36d-4aaf-8b8a-6f5ada3db1e8'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:02 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-7eb01e01-b36d-4aaf-8b8a-6f5ada3db1e8 None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c694f53ff803405fbe02034b963b9cc0', 'request_id': 'req-7eb01e01-b36d-4aaf-8b8a-6f5ada3db1e8'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:02 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-64b6b83c-689d-413b-b4f8-269942b89902 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] <<< [PATCH] https://127.0.0.1:40443/api/viewpolicies/32/ May 28 12:59:02 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-64b6b83c-689d-413b-b4f8-269942b89902 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=1, created='2024-05-28T12:58:43.845440Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='31b6534b-d142-4561-992f-4f0759db302d', id=32, internal=False, is_s3_default_policy=False, name='7fdd602c-79d0-479c-95a2-336b202c6639', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=['*'], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['203.0.113.22'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['203.0.113.22'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='MODIFYING', sync_time='2024-05-28T12:59:01.322030Z', tenant_id=1, tenant_name='default', title='7fdd602c-79d0-479c-95a2-336b202c6639', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/32/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[]) May 28 12:59:02 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-64b6b83c-689d-413b-b4f8-269942b89902 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] --- [PATCH] https://127.0.0.1:40443/api/viewpolicies/32/: Done May 28 12:59:02 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-64b6b83c-689d-413b-b4f8-269942b89902 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:02 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-7eb01e01-b36d-4aaf-8b8a-6f5ada3db1e8 None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c694f53ff803405fbe02034b963b9cc0', 'request_id': 'req-7eb01e01-b36d-4aaf-8b8a-6f5ada3db1e8'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:02 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-64b6b83c-689d-413b-b4f8-269942b89902 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:02 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-7eb01e01-b36d-4aaf-8b8a-6f5ada3db1e8 None admin] The token cache is being invalidate because project c694f53ff803405fbe02034b963b9cc0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 12:59:02 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-7eb01e01-b36d-4aaf-8b8a-6f5ada3db1e8 None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:02 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-7eb01e01-b36d-4aaf-8b8a-6f5ada3db1e8 None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:02 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1169/2361] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 12:59:02 2024] DELETE /identity/v3/projects/c694f53ff803405fbe02034b963b9cc0 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:59:02 l75lg1-v1 neutron-server[77619]: DEBUG neutron.wsgi [-] (77619) accepted ('10.27.203.238', 58094) {{(pid=77619) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 12:59:02 l75lg1-v1 neutron-server[77619]: INFO neutron.wsgi [None req-9f06a8b1-1f53-4c84-9e77-69dc30dadca9 None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=69c481a96f964f9d8120576a305a17b5&name=default HTTP/1.1" status: 200 len: 216 time: 0.0080793 May 28 12:59:02 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069ca134-2360-4e22-94b9-c57bca46e6cc None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:02 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-069ca134-2360-4e22-94b9-c57bca46e6cc None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:59:02 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-44246d78-b1f2-4b75-acf4-be51a29f2b40 tempest-ShareIpRulesForNFSTest-1748669711 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:59:02 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-44246d78-b1f2-4b75-acf4-be51a29f2b40 tempest-ShareIpRulesForNFSTest-1748669711 None] [Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=1, created='2024-05-28T12:57:40.763635Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='377955ad-d094-4e49-ab32-1021d943a572', id=21, internal=False, is_s3_default_policy=False, name='b7a7d61c-2cea-442a-9809-507038e080d5', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=['*'], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=[], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=[], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T12:58:50.758361Z', tenant_id=1, tenant_name='default', title='b7a7d61c-2cea-442a-9809-507038e080d5', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/21/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[])] May 28 12:59:02 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-44246d78-b1f2-4b75-acf4-be51a29f2b40 tempest-ShareIpRulesForNFSTest-1748669711 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 12:59:02 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-44246d78-b1f2-4b75-acf4-be51a29f2b40 tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:02 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-44246d78-b1f2-4b75-acf4-be51a29f2b40 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:02 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069ca134-2360-4e22-94b9-c57bca46e6cc None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:02 l75lg1-v1 dstat.sh[49771]: 28-05 12:59:02| 12 2 83 2 0|5730M 1746M 277M 7872M| 15k 2142B| 0 2772k| 0 390 |8005 14k|0.92 1.01 0.99|2.0 1.0 0| 0 0 | 0 2048M| 29 362 0 33 0 May 28 12:59:02 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-f9cb597b-408b-4139-956f-c4dac953f788 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] GET http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/share-access-rules?share_id=72db8769-ece7-42ff-af27-2e778292a9b4 May 28 12:59:02 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-f9cb597b-408b-4139-956f-c4dac953f788 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:02 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-f9cb597b-408b-4139-956f-c4dac953f788 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:02 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d862ed-9125-4ea1-97ed-06dba75438e0 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:02 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d862ed-9125-4ea1-97ed-06dba75438e0 None admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:02 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d862ed-9125-4ea1-97ed-06dba75438e0 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:02 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d862ed-9125-4ea1-97ed-06dba75438e0 None admin] PATH_INFO: `/v3/projects/69c481a96f964f9d8120576a305a17b5` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:02 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d862ed-9125-4ea1-97ed-06dba75438e0 None admin] RBAC: Authorizing `identity:delete_project(project_id=69c481a96f964f9d8120576a305a17b5)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:02 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d862ed-9125-4ea1-97ed-06dba75438e0 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:02 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-44246d78-b1f2-4b75-acf4-be51a29f2b40 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.038s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:02 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-44246d78-b1f2-4b75-acf4-be51a29f2b40 tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:02 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-44246d78-b1f2-4b75-acf4-be51a29f2b40 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:02 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e33a4def-e23e-4cb3-aa95-353e32ae4440 tempest-SharesMetadataTest-1561320255 None] <<< [GET] https://127.0.0.1:40443/api/quotas/ May 28 12:59:02 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e33a4def-e23e-4cb3-aa95-353e32ae4440 tempest-SharesMetadataTest-1561320255 None] [Bunch(cluster='loop75-kfs', cluster_id=1, default_email=None, default_group_quota=None, default_user_quota=None, enable_alarms=True, enable_email_providers=True, grace_period=None, guid='baf75465-80a7-4139-a11e-6386234e88cb', hard_limit=1073741824, hard_limit_inodes=None, id=15, internal=False, is_user_quota=False, last_user_quotas_update=None, name='5a6db1ad-927e-4228-b973-3ff998e29ada', num_blocked_users=0, num_exceeded_users=0, path='/manila/manila-5a6db1ad-927e-4228-b973-3ff998e29ada', percent_capacity=0, percent_inodes=None, pretty_grace_period=None, pretty_grace_period_expiration=None, pretty_state='OK', soft_limit=None, soft_limit_inodes=None, state='OK', sync_state='SYNCHRONIZED', system_id=15, tenant_id=1, tenant_name='default', time_to_block=None, title='5a6db1ad-927e-4228-b973-3ff998e29ada', url='https://127.0.0.1:40443/api/quotas/15/', used_capacity=0, used_capacity_tb=0.0, used_effective_capacity=0, used_effective_capacity_tb=0.0, used_inodes=1, used_limited_capacity=0)] May 28 12:59:02 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e33a4def-e23e-4cb3-aa95-353e32ae4440 tempest-SharesMetadataTest-1561320255 None] --- [GET] https://127.0.0.1:40443/api/quotas/: Done May 28 12:59:02 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e33a4def-e23e-4cb3-aa95-353e32ae4440 tempest-SharesMetadataTest-1561320255 None] >>> [DELETE] https://127.0.0.1:40443/api/quotas/15/ May 28 12:59:02 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-64b6b83c-689d-413b-b4f8-269942b89902 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.100s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:02 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-64b6b83c-689d-413b-b4f8-269942b89902 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:02 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-64b6b83c-689d-413b-b4f8-269942b89902 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:02 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-64b6b83c-689d-413b-b4f8-269942b89902 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:02 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-64b6b83c-689d-413b-b4f8-269942b89902 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:02 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-64b6b83c-689d-413b-b4f8-269942b89902 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:02 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-64b6b83c-689d-413b-b4f8-269942b89902 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.006s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:02 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-64b6b83c-689d-413b-b4f8-269942b89902 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:02 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-64b6b83c-689d-413b-b4f8-269942b89902 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:02 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-64b6b83c-689d-413b-b4f8-269942b89902 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.006s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:02 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-64b6b83c-689d-413b-b4f8-269942b89902 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:02 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-64b6b83c-689d-413b-b4f8-269942b89902 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:02 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-e3d862ed-9125-4ea1-97ed-06dba75438e0 None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69c481a96f964f9d8120576a305a17b5', 'request_id': 'req-e3d862ed-9125-4ea1-97ed-06dba75438e0'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:02 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.lock.api [None req-f9cb597b-408b-4139-956f-c4dac953f788 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Searching for locks by: {'resource_id': '70301939-e5f7-4c71-990f-5b6b34c75d54', 'resource_action': 'show', 'resource_type': 'access_rule'} {{(pid=98330) get_all /opt/stack/manila/manila/lock/api.py:112}} May 28 12:59:02 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-e3d862ed-9125-4ea1-97ed-06dba75438e0 None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69c481a96f964f9d8120576a305a17b5', 'request_id': 'req-e3d862ed-9125-4ea1-97ed-06dba75438e0'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:02 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-f9cb597b-408b-4139-956f-c4dac953f788 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/share-access-rules?share_id=72db8769-ece7-42ff-af27-2e778292a9b4 returned with HTTP 200 May 28 12:59:02 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 650/1311] 10.27.203.238 () {64 vars in 1467 bytes} [Tue May 28 12:59:02 2024] GET /share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/share-access-rules?share_id=72db8769-ece7-42ff-af27-2e778292a9b4 => generated 280 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:59:02 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-e3d862ed-9125-4ea1-97ed-06dba75438e0 None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69c481a96f964f9d8120576a305a17b5', 'request_id': 'req-e3d862ed-9125-4ea1-97ed-06dba75438e0'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:02 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-cdf5148c-5bec-4b55-9293-b047234665c0 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] POST http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/resource-locks May 28 12:59:02 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-cdf5148c-5bec-4b55-9293-b047234665c0 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"resource_lock": {"resource_id": "70301939-e5f7-4c71-990f-5b6b34c75d54", "resource_type": "access_rule", "resource_action": "show", "lock_reason": "locked for testing"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:59:02 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-44246d78-b1f2-4b75-acf4-be51a29f2b40 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.065s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:02 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-44246d78-b1f2-4b75-acf4-be51a29f2b40 tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:02 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-44246d78-b1f2-4b75-acf4-be51a29f2b40 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:02 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-cdf5148c-5bec-4b55-9293-b047234665c0 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] HTTP exception thrown: Resource's visibility is already locked by other user. May 28 12:59:02 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-cdf5148c-5bec-4b55-9293-b047234665c0 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/resource-locks returned with HTTP 409 May 28 12:59:02 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 662/1312] 10.27.203.238 () {66 vars in 1386 bytes} [Tue May 28 12:59:02 2024] POST /share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/resource-locks => generated 110 bytes in 12 msecs (HTTP/1.1 409) 6 headers in 237 bytes (1 switches on core 0) May 28 12:59:02 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708c22c9-f2e2-4fe1-915d-9a3854ab8e0b None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:02 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708c22c9-f2e2-4fe1-915d-9a3854ab8e0b None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:02 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708c22c9-f2e2-4fe1-915d-9a3854ab8e0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:02 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-44246d78-b1f2-4b75-acf4-be51a29f2b40 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.011s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:02 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-44246d78-b1f2-4b75-acf4-be51a29f2b40 tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:02 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-44246d78-b1f2-4b75-acf4-be51a29f2b40 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:02 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-e3d862ed-9125-4ea1-97ed-06dba75438e0 None admin] The token cache is being invalidate because project 69c481a96f964f9d8120576a305a17b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 12:59:02 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-e3d862ed-9125-4ea1-97ed-06dba75438e0 None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:02 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-44246d78-b1f2-4b75-acf4-be51a29f2b40 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.004s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:02 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-44246d78-b1f2-4b75-acf4-be51a29f2b40 tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:02 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-e3d862ed-9125-4ea1-97ed-06dba75438e0 None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:02 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-44246d78-b1f2-4b75-acf4-be51a29f2b40 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:02 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1193/2362] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 12:59:02 2024] DELETE /identity/v3/projects/69c481a96f964f9d8120576a305a17b5 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:59:02 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-708c22c9-f2e2-4fe1-915d-9a3854ab8e0b None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:59:02 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd527c5-5623-4ce7-8485-996cd1974431 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:02 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd527c5-5623-4ce7-8485-996cd1974431 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:02 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd527c5-5623-4ce7-8485-996cd1974431 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:02 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-708c22c9-f2e2-4fe1-915d-9a3854ab8e0b None None] MFA Rules not processed for user `db0396a316ea4c5697d47df053fccbe4`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:59:02 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-708c22c9-f2e2-4fe1-915d-9a3854ab8e0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:59:02 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-dcd527c5-5623-4ce7-8485-996cd1974431 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:59:02 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-dcd527c5-5623-4ce7-8485-996cd1974431 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:59:02 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-dcd527c5-5623-4ce7-8485-996cd1974431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:59:02 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1194/2363] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:59:02 2024] POST /identity/v3/auth/tokens => generated 312 bytes in 24 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 28 12:59:02 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-64b6b83c-689d-413b-b4f8-269942b89902 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.071s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:02 l75lg1-v1 manila-share[98474]: INFO manila.share.access [None req-64b6b83c-689d-413b-b4f8-269942b89902 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Access rules were successfully modified for share instance 7fdd602c-79d0-479c-95a2-336b202c6639 belonging to share 72db8769-ece7-42ff-af27-2e778292a9b4. May 28 12:59:02 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a735f4-0698-4b1c-82d0-0f2e48f8628c None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:02 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a735f4-0698-4b1c-82d0-0f2e48f8628c None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:02 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a735f4-0698-4b1c-82d0-0f2e48f8628c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:02 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-44246d78-b1f2-4b75-acf4-be51a29f2b40 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.052s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:02 l75lg1-v1 manila-share[98474]: INFO manila.share.access [None req-44246d78-b1f2-4b75-acf4-be51a29f2b40 tempest-ShareIpRulesForNFSTest-1748669711 None] Access rules were successfully modified for share instance b7a7d61c-2cea-442a-9809-507038e080d5 belonging to share 1ddadc17-cf10-4a42-8bbd-8335fb3520a1. May 28 12:59:02 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-e0a735f4-0698-4b1c-82d0-0f2e48f8628c None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:59:02 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-e0a735f4-0698-4b1c-82d0-0f2e48f8628c None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:59:02 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-e0a735f4-0698-4b1c-82d0-0f2e48f8628c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:59:02 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1170/2364] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:59:02 2024] POST /identity/v3/auth/tokens => generated 3964 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 28 12:59:02 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708c22c9-f2e2-4fe1-915d-9a3854ab8e0b None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:02 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-708c22c9-f2e2-4fe1-915d-9a3854ab8e0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:59:02 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0ff54ac4-b262-4846-9adc-bdeb391988b0 tempest-PublicSharesTest-1667420263 None] <<< [GET] https://127.0.0.1:40443/api/quotas/ May 28 12:59:02 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0ff54ac4-b262-4846-9adc-bdeb391988b0 tempest-PublicSharesTest-1667420263 None] [Bunch(cluster='loop75-kfs', cluster_id=1, default_email=None, default_group_quota=None, default_user_quota=None, enable_alarms=True, enable_email_providers=True, grace_period=None, guid='cf7c19c2-ff7e-406b-a41a-cde4538ee6ba', hard_limit=1073741824, hard_limit_inodes=None, id=30, internal=False, is_user_quota=False, last_user_quotas_update=None, name='834576a8-b0ac-4cc8-a1a0-0067a9513141', num_blocked_users=0, num_exceeded_users=0, path='/manila/manila-834576a8-b0ac-4cc8-a1a0-0067a9513141', percent_capacity=0, percent_inodes=None, pretty_grace_period=None, pretty_grace_period_expiration=None, pretty_state='OK (CREATED)', soft_limit=None, soft_limit_inodes=None, state='OK', sync_state='CREATED', system_id=30, tenant_id=1, tenant_name='default', time_to_block=None, title='834576a8-b0ac-4cc8-a1a0-0067a9513141', url='https://127.0.0.1:40443/api/quotas/30/', used_capacity=0, used_capacity_tb=0.0, used_effective_capacity=0, used_effective_capacity_tb=0.0, used_inodes=0, used_limited_capacity=0)] May 28 12:59:02 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0ff54ac4-b262-4846-9adc-bdeb391988b0 tempest-PublicSharesTest-1667420263 None] --- [GET] https://127.0.0.1:40443/api/quotas/: Done May 28 12:59:02 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0ff54ac4-b262-4846-9adc-bdeb391988b0 tempest-PublicSharesTest-1667420263 None] >>> [DELETE] https://127.0.0.1:40443/api/quotas/30/ May 28 12:59:02 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1195/2365] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:59:02 2024] POST /identity/v3/auth/tokens => generated 2960 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 12:59:02 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a735f4-0698-4b1c-82d0-0f2e48f8628c None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:02 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a735f4-0698-4b1c-82d0-0f2e48f8628c None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:02 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3511aac0-c062-4987-8912-07d35b619854 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:02 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3511aac0-c062-4987-8912-07d35b619854 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:02 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3511aac0-c062-4987-8912-07d35b619854 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:02 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3511aac0-c062-4987-8912-07d35b619854 None admin] PATH_INFO: `/v3/domains` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:02 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3511aac0-c062-4987-8912-07d35b619854 None admin] RBAC: Adding query filter params (name=Default) {{(pid=51267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:59:02 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3511aac0-c062-4987-8912-07d35b619854 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:02 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3511aac0-c062-4987-8912-07d35b619854 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:02 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1196/2366] 10.27.203.238 () {62 vars in 1220 bytes} [Tue May 28 12:59:02 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 28 12:59:02 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3511aac0-c062-4987-8912-07d35b619854 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:02 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3511aac0-c062-4987-8912-07d35b619854 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:02 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b7fb81-dec1-4d03-9426-cf418c4e1cb0 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:02 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708c22c9-f2e2-4fe1-915d-9a3854ab8e0b None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:02 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b7fb81-dec1-4d03-9426-cf418c4e1cb0 None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:02 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b7fb81-dec1-4d03-9426-cf418c4e1cb0 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:02 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b7fb81-dec1-4d03-9426-cf418c4e1cb0 None admin] PATH_INFO: `/v3/projects` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:02 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b7fb81-dec1-4d03-9426-cf418c4e1cb0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:02 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b7fb81-dec1-4d03-9426-cf418c4e1cb0 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:02 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace3e7b7-bc4e-4413-876e-5ed482a81bbb service manila] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f110cf6300f049c897d0aab63218d1e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:02 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace3e7b7-bc4e-4413-876e-5ed482a81bbb service manila] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:02 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace3e7b7-bc4e-4413-876e-5ed482a81bbb service manila] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:02 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace3e7b7-bc4e-4413-876e-5ed482a81bbb service manila] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:02 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace3e7b7-bc4e-4413-876e-5ed482a81bbb service manila] RBAC: Authorizing `identity:validate_token()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:02 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace3e7b7-bc4e-4413-876e-5ed482a81bbb service manila] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:02 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1171/2367] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 12:59:02 2024] GET /identity/v3/auth/tokens => generated 3964 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 12:59:02 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-5655e9c9-27f1-440c-a5b0-dd96d95b8a50 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-manila_7890e9d8a78c49a0bb9af26ec5dd4646-1927039240] POST http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/resource-locks May 28 12:59:02 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-5655e9c9-27f1-440c-a5b0-dd96d95b8a50 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-manila_7890e9d8a78c49a0bb9af26ec5dd4646-1927039240] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"resource_lock": {"resource_id": "70301939-e5f7-4c71-990f-5b6b34c75d54", "resource_type": "access_rule", "resource_action": "show", "lock_reason": "locked for testing"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:59:02 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-5655e9c9-27f1-440c-a5b0-dd96d95b8a50 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-manila_7890e9d8a78c49a0bb9af26ec5dd4646-1927039240] HTTP exception thrown: Resource's visibility is already locked by other user. May 28 12:59:02 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-5655e9c9-27f1-440c-a5b0-dd96d95b8a50 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-manila_7890e9d8a78c49a0bb9af26ec5dd4646-1927039240] http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/resource-locks returned with HTTP 409 May 28 12:59:02 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 651/1313] 10.27.203.238 () {66 vars in 1386 bytes} [Tue May 28 12:59:02 2024] POST /share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/resource-locks => generated 110 bytes in 71 msecs (HTTP/1.1 409) 6 headers in 237 bytes (1 switches on core 0) May 28 12:59:02 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1197/2368] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 12:59:02 2024] POST /identity/v3/projects => generated 397 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 28 12:59:02 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-2f6b2e55-9e06-40a0-b67f-158be0ef75e0 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] POST http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action May 28 12:59:02 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-2f6b2e55-9e06-40a0-b67f-158be0ef75e0 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Action body: b'{"deny_access": {"access_id": "70301939-e5f7-4c71-990f-5b6b34c75d54", "unrestrict": true}}' {{(pid=98329) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:59:02 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-2f6b2e55-9e06-40a0-b67f-158be0ef75e0 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Action: 'action', calling method: ShareController.deny_access, body: {"deny_access": {"access_id": "70301939-e5f7-4c71-990f-5b6b34c75d54", "unrestrict": true}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:59:02 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.lock.api [None req-2f6b2e55-9e06-40a0-b67f-158be0ef75e0 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Searching for locks by: {'resource_id': '70301939-e5f7-4c71-990f-5b6b34c75d54', 'resource_action': 'delete'} {{(pid=98329) get_all /opt/stack/manila/manila/lock/api.py:112}} May 28 12:59:02 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace3e7b7-bc4e-4413-876e-5ed482a81bbb service manila] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:02 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace3e7b7-bc4e-4413-876e-5ed482a81bbb service manila] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:02 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44a2a9b-f100-47d3-9c37-a0114af0e7a1 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:02 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44a2a9b-f100-47d3-9c37-a0114af0e7a1 None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:02 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44a2a9b-f100-47d3-9c37-a0114af0e7a1 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:02 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44a2a9b-f100-47d3-9c37-a0114af0e7a1 None admin] PATH_INFO: `/v3/users` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:02 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44a2a9b-f100-47d3-9c37-a0114af0e7a1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:02 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44a2a9b-f100-47d3-9c37-a0114af0e7a1 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:02 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-b44a2a9b-f100-47d3-9c37-a0114af0e7a1 None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 12:59:02 l75lg1-v1 devstack@m-api.service[98329]: DEBUG oslo_concurrency.lockutils [None req-2f6b2e55-9e06-40a0-b67f-158be0ef75e0 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98329) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:02 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1172/2369] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 12:59:02 2024] POST /identity/v3/users => generated 306 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:59:02 l75lg1-v1 devstack@m-api.service[98329]: DEBUG oslo_concurrency.lockutils [None req-2f6b2e55-9e06-40a0-b67f-158be0ef75e0 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98329) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:02 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b7fb81-dec1-4d03-9426-cf418c4e1cb0 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:02 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b7fb81-dec1-4d03-9426-cf418c4e1cb0 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:02 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6befdeed-0b6d-4ecd-a18d-324379e670ec None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:02 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6befdeed-0b6d-4ecd-a18d-324379e670ec None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:02 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6befdeed-0b6d-4ecd-a18d-324379e670ec None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:02 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6befdeed-0b6d-4ecd-a18d-324379e670ec None admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:02 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6befdeed-0b6d-4ecd-a18d-324379e670ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:02 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6befdeed-0b6d-4ecd-a18d-324379e670ec None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:02 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1198/2370] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 12:59:02 2024] GET /identity/v3/roles => generated 1680 bytes in 16 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:59:02 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44a2a9b-f100-47d3-9c37-a0114af0e7a1 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:02 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44a2a9b-f100-47d3-9c37-a0114af0e7a1 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:02 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad84c17-d143-4863-a778-946c3ffb8fda None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:02 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad84c17-d143-4863-a778-946c3ffb8fda None admin] REQUEST_METHOD: `PUT` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:02 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad84c17-d143-4863-a778-946c3ffb8fda None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:02 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad84c17-d143-4863-a778-946c3ffb8fda None admin] PATH_INFO: `/v3/projects/dc4d2e38c8494b7f9c63363105aec90f/users/221677a58fbe49a9a815d68a34f17383/roles/e7989893488f483baa107be56668c4f8` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:02 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad84c17-d143-4863-a778-946c3ffb8fda None admin] RBAC: Authorizing `identity:create_grant(project_id=dc4d2e38c8494b7f9c63363105aec90f, user_id=221677a58fbe49a9a815d68a34f17383, role_id=e7989893488f483baa107be56668c4f8)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:02 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad84c17-d143-4863-a778-946c3ffb8fda None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:02 l75lg1-v1 devstack@m-api.service[98329]: DEBUG oslo_concurrency.lockutils [None req-2f6b2e55-9e06-40a0-b67f-158be0ef75e0 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.043s {{(pid=98329) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:02 l75lg1-v1 devstack@m-api.service[98329]: DEBUG oslo_concurrency.lockutils [None req-2f6b2e55-9e06-40a0-b67f-158be0ef75e0 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98329) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:02 l75lg1-v1 devstack@m-api.service[98329]: DEBUG oslo_concurrency.lockutils [None req-2f6b2e55-9e06-40a0-b67f-158be0ef75e0 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98329) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:02 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1173/2371] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 12:59:02 2024] PUT /identity/v3/projects/dc4d2e38c8494b7f9c63363105aec90f/users/221677a58fbe49a9a815d68a34f17383/roles/e7989893488f483baa107be56668c4f8 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:59:02 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6befdeed-0b6d-4ecd-a18d-324379e670ec None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:02 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6befdeed-0b6d-4ecd-a18d-324379e670ec None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:02 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9843a198-6fc1-456b-b8dc-53792c9fa2c6 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:02 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9843a198-6fc1-456b-b8dc-53792c9fa2c6 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:02 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9843a198-6fc1-456b-b8dc-53792c9fa2c6 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:02 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9843a198-6fc1-456b-b8dc-53792c9fa2c6 None admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:02 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9843a198-6fc1-456b-b8dc-53792c9fa2c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:02 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9843a198-6fc1-456b-b8dc-53792c9fa2c6 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:02 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1199/2372] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 12:59:02 2024] GET /identity/v3/roles => generated 1680 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:59:02 l75lg1-v1 devstack@m-api.service[98329]: DEBUG oslo_concurrency.lockutils [None req-2f6b2e55-9e06-40a0-b67f-158be0ef75e0 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.058s {{(pid=98329) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:02 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-2f6b2e55-9e06-40a0-b67f-158be0ef75e0 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action returned with HTTP 202 May 28 12:59:02 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad84c17-d143-4863-a778-946c3ffb8fda None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:02 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 663/1314] 10.27.203.238 () {66 vars in 1493 bytes} [Tue May 28 12:59:02 2024] POST /share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action => generated 0 bytes in 181 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:59:02 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad84c17-d143-4863-a778-946c3ffb8fda None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:02 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77a0cb6-2a61-4a4a-bebe-7239e3f3e570 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:02 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-bbc234b8-2bc6-46c0-bbcb-09392ddd6616 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] GET http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/share-access-rules?share_id=72db8769-ece7-42ff-af27-2e778292a9b4 May 28 12:59:02 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77a0cb6-2a61-4a4a-bebe-7239e3f3e570 None admin] REQUEST_METHOD: `PUT` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:02 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77a0cb6-2a61-4a4a-bebe-7239e3f3e570 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:02 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-bbc234b8-2bc6-46c0-bbcb-09392ddd6616 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:02 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77a0cb6-2a61-4a4a-bebe-7239e3f3e570 None admin] PATH_INFO: `/v3/projects/dc4d2e38c8494b7f9c63363105aec90f/users/221677a58fbe49a9a815d68a34f17383/roles/e7989893488f483baa107be56668c4f8` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:02 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-bbc234b8-2bc6-46c0-bbcb-09392ddd6616 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:02 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77a0cb6-2a61-4a4a-bebe-7239e3f3e570 None admin] RBAC: Authorizing `identity:create_grant(project_id=dc4d2e38c8494b7f9c63363105aec90f, user_id=221677a58fbe49a9a815d68a34f17383, role_id=e7989893488f483baa107be56668c4f8)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:02 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77a0cb6-2a61-4a4a-bebe-7239e3f3e570 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:02 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1174/2373] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 12:59:02 2024] PUT /identity/v3/projects/dc4d2e38c8494b7f9c63363105aec90f/users/221677a58fbe49a9a815d68a34f17383/roles/e7989893488f483baa107be56668c4f8 => generated 0 bytes in 20 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:59:02 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.lock.api [None req-bbc234b8-2bc6-46c0-bbcb-09392ddd6616 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Searching for locks by: {'resource_id': '70301939-e5f7-4c71-990f-5b6b34c75d54', 'resource_action': 'show', 'resource_type': 'access_rule'} {{(pid=98330) get_all /opt/stack/manila/manila/lock/api.py:112}} May 28 12:59:02 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-bbc234b8-2bc6-46c0-bbcb-09392ddd6616 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/share-access-rules?share_id=72db8769-ece7-42ff-af27-2e778292a9b4 returned with HTTP 200 May 28 12:59:02 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 652/1315] 10.27.203.238 () {64 vars in 1467 bytes} [Tue May 28 12:59:02 2024] GET /share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/share-access-rules?share_id=72db8769-ece7-42ff-af27-2e778292a9b4 => generated 288 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:59:02 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29ed3cd-972b-4399-b470-09bfd45b6697 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:02 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29ed3cd-972b-4399-b470-09bfd45b6697 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:02 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29ed3cd-972b-4399-b470-09bfd45b6697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:02 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-e29ed3cd-972b-4399-b470-09bfd45b6697 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:59:02 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-e29ed3cd-972b-4399-b470-09bfd45b6697 None None] MFA Rules not processed for user `221677a58fbe49a9a815d68a34f17383`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:59:02 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-e29ed3cd-972b-4399-b470-09bfd45b6697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:59:02 l75lg1-v1 manila-share[98474]: DEBUG manila.share.manager [None req-2f6b2e55-9e06-40a0-b67f-158be0ef75e0 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Received request to update access for share instance 7fdd602c-79d0-479c-95a2-336b202c6639. {{(pid=98474) update_access_for_instances /opt/stack/manila/manila/share/manager.py:4353}} May 28 12:59:02 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-2f6b2e55-9e06-40a0-b67f-158be0ef75e0 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:02 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-2f6b2e55-9e06-40a0-b67f-158be0ef75e0 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:02 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-2f6b2e55-9e06-40a0-b67f-158be0ef75e0 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:02 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-2f6b2e55-9e06-40a0-b67f-158be0ef75e0 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:02 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-2f6b2e55-9e06-40a0-b67f-158be0ef75e0 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:02 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1200/2374] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:59:02 2024] POST /identity/v3/auth/tokens => generated 4091 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:59:02 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77a0cb6-2a61-4a4a-bebe-7239e3f3e570 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:02 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-2f6b2e55-9e06-40a0-b67f-158be0ef75e0 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.051s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:02 l75lg1-v1 manila-share[98474]: DEBUG manila.share.access [None req-2f6b2e55-9e06-40a0-b67f-158be0ef75e0 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Updating access rules for share instance 7fdd602c-79d0-479c-95a2-336b202c6639 belonging to share 72db8769-ece7-42ff-af27-2e778292a9b4. {{(pid=98474) update_access_rules /opt/stack/manila/manila/share/access.py:298}} May 28 12:59:02 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77a0cb6-2a61-4a4a-bebe-7239e3f3e570 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:02 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7f1930-686d-44d7-bc2e-7eb99333e844 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:02 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7f1930-686d-44d7-bc2e-7eb99333e844 None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:02 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7f1930-686d-44d7-bc2e-7eb99333e844 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:02 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7f1930-686d-44d7-bc2e-7eb99333e844 None admin] PATH_INFO: `/v3/users/221677a58fbe49a9a815d68a34f17383` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:02 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7f1930-686d-44d7-bc2e-7eb99333e844 None admin] RBAC: Authorizing `identity:delete_user(user_id=221677a58fbe49a9a815d68a34f17383)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:02 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7f1930-686d-44d7-bc2e-7eb99333e844 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:02 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-2f6b2e55-9e06-40a0-b67f-158be0ef75e0 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:02 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-2f6b2e55-9e06-40a0-b67f-158be0ef75e0 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:02 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-2f6b2e55-9e06-40a0-b67f-158be0ef75e0 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.007s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:02 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-2f6b2e55-9e06-40a0-b67f-158be0ef75e0 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:02 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-2f6b2e55-9e06-40a0-b67f-158be0ef75e0 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:02 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-2f6b2e55-9e06-40a0-b67f-158be0ef75e0 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.013s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:02 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-2f6b2e55-9e06-40a0-b67f-158be0ef75e0 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] changing access on None May 28 12:59:02 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2f6b2e55-9e06-40a0-b67f-158be0ef75e0 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:59:02 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2f6b2e55-9e06-40a0-b67f-158be0ef75e0 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] {'allow_redirects': True, May 28 12:59:02 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2f6b2e55-9e06-40a0-b67f-158be0ef75e0 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] 'params': {'name': '7fdd602c-79d0-479c-95a2-336b202c6639'}} May 28 12:59:02 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-4f7f1930-686d-44d7-bc2e-7eb99333e844 None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '221677a58fbe49a9a815d68a34f17383', 'request_id': 'req-4f7f1930-686d-44d7-bc2e-7eb99333e844'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:02 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-4f7f1930-686d-44d7-bc2e-7eb99333e844 None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '221677a58fbe49a9a815d68a34f17383', 'request_id': 'req-4f7f1930-686d-44d7-bc2e-7eb99333e844'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:02 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-4f7f1930-686d-44d7-bc2e-7eb99333e844 None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '221677a58fbe49a9a815d68a34f17383', 'request_id': 'req-4f7f1930-686d-44d7-bc2e-7eb99333e844'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:02 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-4f7f1930-686d-44d7-bc2e-7eb99333e844 None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '221677a58fbe49a9a815d68a34f17383', 'request_id': 'req-4f7f1930-686d-44d7-bc2e-7eb99333e844'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:02 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-4f7f1930-686d-44d7-bc2e-7eb99333e844 None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '221677a58fbe49a9a815d68a34f17383', 'request_id': 'req-4f7f1930-686d-44d7-bc2e-7eb99333e844'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:02 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1175/2375] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 12:59:02 2024] DELETE /identity/v3/users/221677a58fbe49a9a815d68a34f17383 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:59:02 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba7d5d9-0302-4f5f-84ef-07bf3cc9ee1e None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:02 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba7d5d9-0302-4f5f-84ef-07bf3cc9ee1e None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:02 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba7d5d9-0302-4f5f-84ef-07bf3cc9ee1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:02 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-8ba7d5d9-0302-4f5f-84ef-07bf3cc9ee1e None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:59:02 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-8ba7d5d9-0302-4f5f-84ef-07bf3cc9ee1e None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:59:02 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-8ba7d5d9-0302-4f5f-84ef-07bf3cc9ee1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:59:02 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1201/2376] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:59:02 2024] POST /identity/v3/auth/tokens => generated 2960 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 12:59:02 l75lg1-v1 neutron-server[77619]: DEBUG neutron.wsgi [-] (77619) accepted ('10.27.203.238', 58106) {{(pid=77619) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 12:59:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7f1930-686d-44d7-bc2e-7eb99333e844 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-4f7f1930-686d-44d7-bc2e-7eb99333e844 None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:59:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7f1930-686d-44d7-bc2e-7eb99333e844 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51e7485-2661-4a06-90f1-ff446ee69cc1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef17047035e4b518fd5360a01f2da1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51e7485-2661-4a06-90f1-ff446ee69cc1 service neutron] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51e7485-2661-4a06-90f1-ff446ee69cc1 service neutron] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51e7485-2661-4a06-90f1-ff446ee69cc1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51e7485-2661-4a06-90f1-ff446ee69cc1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51e7485-2661-4a06-90f1-ff446ee69cc1 service neutron] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:03 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1176/2377] 10.27.203.238 () {64 vars in 1432 bytes} [Tue May 28 12:59:02 2024] GET /identity/v3/auth/tokens => generated 2960 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 28 12:59:03 l75lg1-v1 neutron-server[77619]: INFO neutron.wsgi [None req-a9be920e-ca6c-4a8e-86b3-a4a383d5f118 None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=dc4d2e38c8494b7f9c63363105aec90f&name=default HTTP/1.1" status: 200 len: 216 time: 0.0698717 May 28 12:59:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba7d5d9-0302-4f5f-84ef-07bf3cc9ee1e None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-8ba7d5d9-0302-4f5f-84ef-07bf3cc9ee1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:59:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba7d5d9-0302-4f5f-84ef-07bf3cc9ee1e None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6f4a37-dbb4-427b-88a3-687b995d3cce None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6f4a37-dbb4-427b-88a3-687b995d3cce None admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6f4a37-dbb4-427b-88a3-687b995d3cce None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6f4a37-dbb4-427b-88a3-687b995d3cce None admin] PATH_INFO: `/v3/projects/dc4d2e38c8494b7f9c63363105aec90f` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6f4a37-dbb4-427b-88a3-687b995d3cce None admin] RBAC: Authorizing `identity:delete_project(project_id=dc4d2e38c8494b7f9c63363105aec90f)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6f4a37-dbb4-427b-88a3-687b995d3cce None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-6c6f4a37-dbb4-427b-88a3-687b995d3cce None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc4d2e38c8494b7f9c63363105aec90f', 'request_id': 'req-6c6f4a37-dbb4-427b-88a3-687b995d3cce'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-6c6f4a37-dbb4-427b-88a3-687b995d3cce None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc4d2e38c8494b7f9c63363105aec90f', 'request_id': 'req-6c6f4a37-dbb4-427b-88a3-687b995d3cce'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-6c6f4a37-dbb4-427b-88a3-687b995d3cce None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc4d2e38c8494b7f9c63363105aec90f', 'request_id': 'req-6c6f4a37-dbb4-427b-88a3-687b995d3cce'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-6c6f4a37-dbb4-427b-88a3-687b995d3cce None admin] The token cache is being invalidate because project dc4d2e38c8494b7f9c63363105aec90f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 12:59:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-6c6f4a37-dbb4-427b-88a3-687b995d3cce None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-6c6f4a37-dbb4-427b-88a3-687b995d3cce None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:03 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1202/2378] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 12:59:03 2024] DELETE /identity/v3/projects/dc4d2e38c8494b7f9c63363105aec90f => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:59:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cf1950-7d5b-4082-9e93-c6c00bebe019 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cf1950-7d5b-4082-9e93-c6c00bebe019 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cf1950-7d5b-4082-9e93-c6c00bebe019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:03 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-98cf1950-7d5b-4082-9e93-c6c00bebe019 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:59:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-98cf1950-7d5b-4082-9e93-c6c00bebe019 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:59:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-98cf1950-7d5b-4082-9e93-c6c00bebe019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:59:03 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1177/2379] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:59:03 2024] POST /identity/v3/auth/tokens => generated 312 bytes in 20 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 28 12:59:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd885ea9-640f-4246-8e3e-746982dc250e None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd885ea9-640f-4246-8e3e-746982dc250e None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd885ea9-640f-4246-8e3e-746982dc250e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:03 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-dd885ea9-640f-4246-8e3e-746982dc250e None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:59:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-dd885ea9-640f-4246-8e3e-746982dc250e None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:59:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-dd885ea9-640f-4246-8e3e-746982dc250e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:59:03 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1203/2380] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:59:03 2024] POST /identity/v3/auth/tokens => generated 2960 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 12:59:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cf1950-7d5b-4082-9e93-c6c00bebe019 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:03 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2f6b2e55-9e06-40a0-b67f-158be0ef75e0 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:59:03 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2f6b2e55-9e06-40a0-b67f-158be0ef75e0 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] [Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=1, created='2024-05-28T12:58:43.845440Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='31b6534b-d142-4561-992f-4f0759db302d', id=32, internal=False, is_s3_default_policy=False, name='7fdd602c-79d0-479c-95a2-336b202c6639', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=['*'], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['203.0.113.22'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['203.0.113.22'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T12:59:02.079223Z', tenant_id=1, tenant_name='default', title='7fdd602c-79d0-479c-95a2-336b202c6639', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/32/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[])] May 28 12:59:03 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2f6b2e55-9e06-40a0-b67f-158be0ef75e0 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 12:59:03 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-2f6b2e55-9e06-40a0-b67f-158be0ef75e0 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] changing access on /manila/manila-7fdd602c-79d0-479c-95a2-336b202c6639. Rules: {'nfs_read_write': [], 'nfs_read_only': []} May 28 12:59:03 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2f6b2e55-9e06-40a0-b67f-158be0ef75e0 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] >>> [PATCH] https://127.0.0.1:40443/api/viewpolicies/32/ May 28 12:59:03 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2f6b2e55-9e06-40a0-b67f-158be0ef75e0 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] {'data': '{"name": "7fdd602c-79d0-479c-95a2-336b202c6639", "nfs_no_squash": ' May 28 12:59:03 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2f6b2e55-9e06-40a0-b67f-158be0ef75e0 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] '["*"], "nfs_root_squash": ["*"], "nfs_read_write": [], ' May 28 12:59:03 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2f6b2e55-9e06-40a0-b67f-158be0ef75e0 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] '"nfs_read_only": []}', May 28 12:59:03 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2f6b2e55-9e06-40a0-b67f-158be0ef75e0 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] 'params': None} May 28 12:59:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cf1950-7d5b-4082-9e93-c6c00bebe019 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:03 l75lg1-v1 dstat.sh[49771]: 28-05 12:59:03| 18 1 77 3 0|5730M 1745M 277M 7872M| 17k 5679B| 0 4772k| 0 447 |9515 17k|0.92 1.01 0.99|2.0 1.0 0| 0 0 | 0 2048M| 29 362 0 31 0 May 28 12:59:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d404a9cd-8469-4597-83eb-53efca477e34 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d404a9cd-8469-4597-83eb-53efca477e34 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d404a9cd-8469-4597-83eb-53efca477e34 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d404a9cd-8469-4597-83eb-53efca477e34 None admin] PATH_INFO: `/v3/domains` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d404a9cd-8469-4597-83eb-53efca477e34 None admin] RBAC: Adding query filter params (name=Default) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:59:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d404a9cd-8469-4597-83eb-53efca477e34 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d404a9cd-8469-4597-83eb-53efca477e34 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:03 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1178/2381] 10.27.203.238 () {62 vars in 1220 bytes} [Tue May 28 12:59:03 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:59:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd885ea9-640f-4246-8e3e-746982dc250e None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd885ea9-640f-4246-8e3e-746982dc250e None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3f5824-0643-481f-87b5-f315d6f66e9c None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3f5824-0643-481f-87b5-f315d6f66e9c None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3f5824-0643-481f-87b5-f315d6f66e9c None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3f5824-0643-481f-87b5-f315d6f66e9c None admin] PATH_INFO: `/v3/projects` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3f5824-0643-481f-87b5-f315d6f66e9c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3f5824-0643-481f-87b5-f315d6f66e9c None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:03 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1204/2382] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 12:59:03 2024] POST /identity/v3/projects => generated 369 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:59:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d404a9cd-8469-4597-83eb-53efca477e34 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d404a9cd-8469-4597-83eb-53efca477e34 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2e6b77-9827-49c2-bf55-bcb687a9b5d0 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2e6b77-9827-49c2-bf55-bcb687a9b5d0 None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2e6b77-9827-49c2-bf55-bcb687a9b5d0 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2e6b77-9827-49c2-bf55-bcb687a9b5d0 None admin] PATH_INFO: `/v3/users` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2e6b77-9827-49c2-bf55-bcb687a9b5d0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2e6b77-9827-49c2-bf55-bcb687a9b5d0 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:03 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-cb2e6b77-9827-49c2-bf55-bcb687a9b5d0 None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 12:59:03 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1179/2383] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 12:59:03 2024] POST /identity/v3/users => generated 292 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:59:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3f5824-0643-481f-87b5-f315d6f66e9c None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3f5824-0643-481f-87b5-f315d6f66e9c None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd94f1b3-6fee-45c3-af47-51c8c9588986 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd94f1b3-6fee-45c3-af47-51c8c9588986 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd94f1b3-6fee-45c3-af47-51c8c9588986 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd94f1b3-6fee-45c3-af47-51c8c9588986 None admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd94f1b3-6fee-45c3-af47-51c8c9588986 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd94f1b3-6fee-45c3-af47-51c8c9588986 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:03 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1205/2384] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 12:59:03 2024] GET /identity/v3/roles => generated 1680 bytes in 19 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:59:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2e6b77-9827-49c2-bf55-bcb687a9b5d0 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2e6b77-9827-49c2-bf55-bcb687a9b5d0 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6694105f-9a0c-4aed-8472-bad90387135a None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6694105f-9a0c-4aed-8472-bad90387135a None admin] REQUEST_METHOD: `PUT` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6694105f-9a0c-4aed-8472-bad90387135a None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6694105f-9a0c-4aed-8472-bad90387135a None admin] PATH_INFO: `/v3/projects/33b0ebad17d34f8cb4004ebcd1e0fb91/users/daaf92d9d1cb40428117f9aa7d5bc657/roles/e7989893488f483baa107be56668c4f8` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6694105f-9a0c-4aed-8472-bad90387135a None admin] RBAC: Authorizing `identity:create_grant(project_id=33b0ebad17d34f8cb4004ebcd1e0fb91, user_id=daaf92d9d1cb40428117f9aa7d5bc657, role_id=e7989893488f483baa107be56668c4f8)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6694105f-9a0c-4aed-8472-bad90387135a None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:03 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1180/2385] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 12:59:03 2024] PUT /identity/v3/projects/33b0ebad17d34f8cb4004ebcd1e0fb91/users/daaf92d9d1cb40428117f9aa7d5bc657/roles/e7989893488f483baa107be56668c4f8 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 28 12:59:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd94f1b3-6fee-45c3-af47-51c8c9588986 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd94f1b3-6fee-45c3-af47-51c8c9588986 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30de66a-17f4-4fc2-8349-bff2f9585424 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30de66a-17f4-4fc2-8349-bff2f9585424 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30de66a-17f4-4fc2-8349-bff2f9585424 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30de66a-17f4-4fc2-8349-bff2f9585424 None admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30de66a-17f4-4fc2-8349-bff2f9585424 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30de66a-17f4-4fc2-8349-bff2f9585424 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:03 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1206/2386] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 12:59:03 2024] GET /identity/v3/roles => generated 1680 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:59:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6694105f-9a0c-4aed-8472-bad90387135a None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6694105f-9a0c-4aed-8472-bad90387135a None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8497b7-44f6-43b2-b1bc-088fb3dace37 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8497b7-44f6-43b2-b1bc-088fb3dace37 None admin] REQUEST_METHOD: `PUT` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8497b7-44f6-43b2-b1bc-088fb3dace37 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8497b7-44f6-43b2-b1bc-088fb3dace37 None admin] PATH_INFO: `/v3/projects/33b0ebad17d34f8cb4004ebcd1e0fb91/users/daaf92d9d1cb40428117f9aa7d5bc657/roles/e7989893488f483baa107be56668c4f8` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8497b7-44f6-43b2-b1bc-088fb3dace37 None admin] RBAC: Authorizing `identity:create_grant(project_id=33b0ebad17d34f8cb4004ebcd1e0fb91, user_id=daaf92d9d1cb40428117f9aa7d5bc657, role_id=e7989893488f483baa107be56668c4f8)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8497b7-44f6-43b2-b1bc-088fb3dace37 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:03 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1181/2387] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 12:59:03 2024] PUT /identity/v3/projects/33b0ebad17d34f8cb4004ebcd1e0fb91/users/daaf92d9d1cb40428117f9aa7d5bc657/roles/e7989893488f483baa107be56668c4f8 => generated 0 bytes in 24 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:59:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbcc8dc-0813-4781-aa4a-0ac761f5c09f None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbcc8dc-0813-4781-aa4a-0ac761f5c09f None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbcc8dc-0813-4781-aa4a-0ac761f5c09f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:03 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-acbcc8dc-0813-4781-aa4a-0ac761f5c09f None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:59:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-acbcc8dc-0813-4781-aa4a-0ac761f5c09f None None] MFA Rules not processed for user `daaf92d9d1cb40428117f9aa7d5bc657`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:59:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-acbcc8dc-0813-4781-aa4a-0ac761f5c09f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:59:03 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1207/2388] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:59:03 2024] POST /identity/v3/auth/tokens => generated 4063 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:59:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8497b7-44f6-43b2-b1bc-088fb3dace37 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-0b8497b7-44f6-43b2-b1bc-088fb3dace37 None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:59:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8497b7-44f6-43b2-b1bc-088fb3dace37 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c06f42-ea5b-42b5-ace9-a52bbab29808 service manila] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f110cf6300f049c897d0aab63218d1e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c06f42-ea5b-42b5-ace9-a52bbab29808 service manila] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c06f42-ea5b-42b5-ace9-a52bbab29808 service manila] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c06f42-ea5b-42b5-ace9-a52bbab29808 service manila] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c06f42-ea5b-42b5-ace9-a52bbab29808 service manila] RBAC: Authorizing `identity:validate_token()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c06f42-ea5b-42b5-ace9-a52bbab29808 service manila] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:03 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1182/2389] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 12:59:03 2024] GET /identity/v3/auth/tokens => generated 4063 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 12:59:03 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-28605403-812a-4fec-8a8d-96b192026a5b tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] POST http://10.27.203.238/share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/types May 28 12:59:03 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-28605403-812a-4fec-8a8d-96b192026a5b tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share_type": {"name": "tempest-share-type-502382136", "extra_specs": {"driver_handles_share_servers": false, "vendor_name": "foobar"}, "share_type_access:is_public": true}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:59:03 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-28605403-812a-4fec-8a8d-96b192026a5b tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] http://10.27.203.238/share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/types returned with HTTP 200 May 28 12:59:03 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 664/1316] 10.27.203.238 () {66 vars in 1359 bytes} [Tue May 28 12:59:03 2024] POST /share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/types => generated 659 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:59:03 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-6ff71dcf-146c-4b1a-9dd6-44e31dded900 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] POST http://10.27.203.238/share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/shares May 28 12:59:03 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-6ff71dcf-146c-4b1a-9dd6-44e31dded900 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share": {"share_proto": "nfs", "description": "tempest-tempest-created-share-desc-2070461193", "snapshot_id": null, "name": "tempest-tempest-created-share-578230736", "size": 1, "metadata": {}, "is_public": false, "share_type": "70a6ce22-aed6-472b-934e-de4474b12a2f"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:59:03 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.v1.shares [None req-6ff71dcf-146c-4b1a-9dd6-44e31dded900 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Create NFS share of 1 GB May 28 12:59:03 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.quota [None req-6ff71dcf-146c-4b1a-9dd6-44e31dded900 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Created reservations ['ec6fddcf-ceb1-4082-bfe6-d2a29f46c338', 'd3e7df7a-8aa3-4c9f-a302-b337166a0543', '4ab7ac02-4968-4b62-8cb8-a5baea6874f9', 'b51056b8-55f6-41bc-a3ef-2e1e4d6bb7d9'] {{(pid=98330) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 12:59:03 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.quota [None req-6ff71dcf-146c-4b1a-9dd6-44e31dded900 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Committed reservations ['ec6fddcf-ceb1-4082-bfe6-d2a29f46c338', 'd3e7df7a-8aa3-4c9f-a302-b337166a0543', '4ab7ac02-4968-4b62-8cb8-a5baea6874f9', 'b51056b8-55f6-41bc-a3ef-2e1e4d6bb7d9'] {{(pid=98330) commit /opt/stack/manila/manila/quota.py:1063}} May 28 12:59:03 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.host_manager [None req-6ff71dcf-146c-4b1a-9dd6-44e31dded900 tempest-UserMessageTest-1084663522 None] Share service is down. (host: l75lg1-v1@generic2). May 28 12:59:03 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.host_manager [None req-6ff71dcf-146c-4b1a-9dd6-44e31dded900 tempest-UserMessageTest-1084663522 None] Share service is down. (host: l75lg1-v1@generic1). May 28 12:59:03 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-6ff71dcf-146c-4b1a-9dd6-44e31dded900 tempest-UserMessageTest-1084663522 None] Starting with 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:80}} May 28 12:59:03 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-6ff71dcf-146c-4b1a-9dd6-44e31dded900 tempest-UserMessageTest-1084663522 None] Filter OnlyHostFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:59:03 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-6ff71dcf-146c-4b1a-9dd6-44e31dded900 tempest-UserMessageTest-1084663522 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:59:03 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.capacity [None req-6ff71dcf-146c-4b1a-9dd6-44e31dded900 tempest-UserMessageTest-1084663522 None] Space information for share creation on host l75lg1-v1@vast#vast (requested / avail): 1/2081 {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/capacity.py:83}} May 28 12:59:03 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-6ff71dcf-146c-4b1a-9dd6-44e31dded900 tempest-UserMessageTest-1084663522 None] Filter CapacityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:59:03 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.utils [None req-6ff71dcf-146c-4b1a-9dd6-44e31dded900 tempest-UserMessageTest-1084663522 None] Share type extra spec requirement "vendor_name=foobar" does not match reported capability "VAST STORAGE" {{(pid=98327) capabilities_satisfied /opt/stack/manila/manila/scheduler/utils.py:185}} May 28 12:59:03 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.capabilities [None req-6ff71dcf-146c-4b1a-9dd6-44e31dded900 tempest-UserMessageTest-1084663522 None] host: 'l75lg1-v1@vast#vast', free_capacity_gb: 2081.64910808485, pools: None fails resource_type extra_specs requirements {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/capabilities.py:45}} May 28 12:59:03 l75lg1-v1 manila-scheduler[98327]: INFO manila.scheduler.filters.base [None req-6ff71dcf-146c-4b1a-9dd6-44e31dded900 tempest-UserMessageTest-1084663522 None] Filter CapabilitiesFilter returned 0 host(s) May 28 12:59:03 l75lg1-v1 manila-scheduler[98327]: ERROR manila.scheduler.manager [None req-6ff71dcf-146c-4b1a-9dd6-44e31dded900 tempest-UserMessageTest-1084663522 None] Failed to schedule create_share: No valid host was found. Failed to find a weighted host, the last executed filter was CapabilitiesFilter.: manila.exception.NoValidHost: No valid host was found. Failed to find a weighted host, the last executed filter was CapabilitiesFilter. May 28 12:59:03 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-6ff71dcf-146c-4b1a-9dd6-44e31dded900 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] http://10.27.203.238/share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/shares returned with HTTP 200 May 28 12:59:03 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 653/1317] 10.27.203.238 () {66 vars in 1362 bytes} [Tue May 28 12:59:03 2024] POST /share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/shares => generated 1370 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:59:03 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-214a0aa6-0c5f-4e7a-818a-4c526c6cb3df tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] GET http://10.27.203.238/share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/shares/7437f153-7d76-48cc-8e36-107ee4e9677a May 28 12:59:03 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-214a0aa6-0c5f-4e7a-818a-4c526c6cb3df tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:03 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-214a0aa6-0c5f-4e7a-818a-4c526c6cb3df tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:03 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-214a0aa6-0c5f-4e7a-818a-4c526c6cb3df tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] http://10.27.203.238/share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/shares/7437f153-7d76-48cc-8e36-107ee4e9677a returned with HTTP 200 May 28 12:59:03 l75lg1-v1 manila-scheduler[98327]: INFO manila.message.api [None req-6ff71dcf-146c-4b1a-9dd6-44e31dded900 tempest-UserMessageTest-1084663522 None] Creating message record for request_id = req-6ff71dcf-146c-4b1a-9dd6-44e31dded900 May 28 12:59:03 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 665/1318] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:59:03 2024] GET /share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/shares/7437f153-7d76-48cc-8e36-107ee4e9677a => generated 1370 bytes in 25 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:59:04 l75lg1-v1 dstat.sh[49771]: 28-05 12:59:04| 7 1 86 6 0|5730M 1745M 277M 7873M| 13k 278B| 0 7642k| 0 657 |6937 12k|0.92 1.01 0.99|1.0 1.0 0| 0 0 | 0 2048M| 29 361 0 31 0 May 28 12:59:04 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-9df519e3-c09e-4c7a-8869-dea18e921b4e tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] GET http://10.27.203.238/share/v2/776f75906bc64f8f9316d5aab4b50bf1/share-access-rules?share_id=1ddadc17-cf10-4a42-8bbd-8335fb3520a1 May 28 12:59:04 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-9df519e3-c09e-4c7a-8869-dea18e921b4e tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:04 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-9df519e3-c09e-4c7a-8869-dea18e921b4e tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:04 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-9df519e3-c09e-4c7a-8869-dea18e921b4e tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] http://10.27.203.238/share/v2/776f75906bc64f8f9316d5aab4b50bf1/share-access-rules?share_id=1ddadc17-cf10-4a42-8bbd-8335fb3520a1 returned with HTTP 200 May 28 12:59:04 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 654/1319] 10.27.203.238 () {64 vars in 1467 bytes} [Tue May 28 12:59:04 2024] GET /share/v2/776f75906bc64f8f9316d5aab4b50bf1/share-access-rules?share_id=1ddadc17-cf10-4a42-8bbd-8335fb3520a1 => generated 19 bytes in 31 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:59:04 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-12143fe7-f9cd-4e31-86a0-7430cba7f9d3 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] POST http://10.27.203.238/share/v1/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action May 28 12:59:04 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-12143fe7-f9cd-4e31-86a0-7430cba7f9d3 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Action body: b'{"os-allow_access": {"access_type": "ip", "access_to": "2.2.2.2", "access_level": "ro"}}' {{(pid=98329) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:59:04 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-12143fe7-f9cd-4e31-86a0-7430cba7f9d3 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Action: 'action', calling method: ShareController.allow_access, body: {"os-allow_access": {"access_type": "ip", "access_to": "2.2.2.2", "access_level": "ro"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:59:04 l75lg1-v1 devstack@m-api.service[98329]: DEBUG oslo_concurrency.lockutils [None req-12143fe7-f9cd-4e31-86a0-7430cba7f9d3 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98329) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:04 l75lg1-v1 devstack@m-api.service[98329]: DEBUG oslo_concurrency.lockutils [None req-12143fe7-f9cd-4e31-86a0-7430cba7f9d3 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98329) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:04 l75lg1-v1 devstack@m-api.service[98329]: DEBUG oslo_concurrency.lockutils [None req-12143fe7-f9cd-4e31-86a0-7430cba7f9d3 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.055s {{(pid=98329) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:04 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-12143fe7-f9cd-4e31-86a0-7430cba7f9d3 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] http://10.27.203.238/share/v1/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action returned with HTTP 200 May 28 12:59:04 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 666/1320] 10.27.203.238 () {64 vars in 1450 bytes} [Tue May 28 12:59:04 2024] POST /share/v1/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action => generated 193 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:59:04 l75lg1-v1 manila-share[98474]: DEBUG manila.share.manager [None req-12143fe7-f9cd-4e31-86a0-7430cba7f9d3 tempest-ShareIpRulesForNFSTest-1748669711 None] Received request to update access for share instance b7a7d61c-2cea-442a-9809-507038e080d5. {{(pid=98474) update_access_for_instances /opt/stack/manila/manila/share/manager.py:4353}} May 28 12:59:04 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-33c42ca8-88e2-469c-825d-361600c26109 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] POST http://10.27.203.238/share/v1/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action May 28 12:59:04 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-33c42ca8-88e2-469c-825d-361600c26109 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Action body: b'{"os-access_list": null}' {{(pid=98330) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:59:04 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-33c42ca8-88e2-469c-825d-361600c26109 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Action: 'action', calling method: ShareController.access_list, body: {"os-access_list": null} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:59:04 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-12143fe7-f9cd-4e31-86a0-7430cba7f9d3 tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:04 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-12143fe7-f9cd-4e31-86a0-7430cba7f9d3 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:04 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-12143fe7-f9cd-4e31-86a0-7430cba7f9d3 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:04 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-12143fe7-f9cd-4e31-86a0-7430cba7f9d3 tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:04 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-12143fe7-f9cd-4e31-86a0-7430cba7f9d3 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:04 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-33c42ca8-88e2-469c-825d-361600c26109 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] http://10.27.203.238/share/v1/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action returned with HTTP 200 May 28 12:59:04 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 655/1321] 10.27.203.238 () {64 vars in 1450 bytes} [Tue May 28 12:59:04 2024] POST /share/v1/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action => generated 148 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:59:04 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-12143fe7-f9cd-4e31-86a0-7430cba7f9d3 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.062s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:04 l75lg1-v1 manila-share[98474]: DEBUG manila.share.access [None req-12143fe7-f9cd-4e31-86a0-7430cba7f9d3 tempest-ShareIpRulesForNFSTest-1748669711 None] Updating access rules for share instance b7a7d61c-2cea-442a-9809-507038e080d5 belonging to share 1ddadc17-cf10-4a42-8bbd-8335fb3520a1. {{(pid=98474) update_access_rules /opt/stack/manila/manila/share/access.py:298}} May 28 12:59:04 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-12143fe7-f9cd-4e31-86a0-7430cba7f9d3 tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:04 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-12143fe7-f9cd-4e31-86a0-7430cba7f9d3 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:04 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-12143fe7-f9cd-4e31-86a0-7430cba7f9d3 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.008s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:04 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-12143fe7-f9cd-4e31-86a0-7430cba7f9d3 tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:04 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-12143fe7-f9cd-4e31-86a0-7430cba7f9d3 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:04 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-12143fe7-f9cd-4e31-86a0-7430cba7f9d3 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.015s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:04 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-12143fe7-f9cd-4e31-86a0-7430cba7f9d3 tempest-ShareIpRulesForNFSTest-1748669711 None] changing access on None May 28 12:59:04 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-12143fe7-f9cd-4e31-86a0-7430cba7f9d3 tempest-ShareIpRulesForNFSTest-1748669711 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:59:04 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-12143fe7-f9cd-4e31-86a0-7430cba7f9d3 tempest-ShareIpRulesForNFSTest-1748669711 None] {'allow_redirects': True, May 28 12:59:04 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-12143fe7-f9cd-4e31-86a0-7430cba7f9d3 tempest-ShareIpRulesForNFSTest-1748669711 None] 'params': {'name': 'b7a7d61c-2cea-442a-9809-507038e080d5'}} May 28 12:59:04 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-075d82e3-d7be-47d4-89be-ad891c5247d9 tempest-PublicSharesTest-1667420263 tempest-PublicSharesTest-1667420263-project-member] GET http://10.27.203.238/share/v2/6d36e1eb1dbc449db6aca75b12a2ba18/shares/84e821d0-2b62-48db-80c7-259f61a14bac May 28 12:59:04 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-075d82e3-d7be-47d4-89be-ad891c5247d9 tempest-PublicSharesTest-1667420263 tempest-PublicSharesTest-1667420263-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:04 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-075d82e3-d7be-47d4-89be-ad891c5247d9 tempest-PublicSharesTest-1667420263 tempest-PublicSharesTest-1667420263-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:04 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-075d82e3-d7be-47d4-89be-ad891c5247d9 tempest-PublicSharesTest-1667420263 tempest-PublicSharesTest-1667420263-project-member] http://10.27.203.238/share/v2/6d36e1eb1dbc449db6aca75b12a2ba18/shares/84e821d0-2b62-48db-80c7-259f61a14bac returned with HTTP 200 May 28 12:59:04 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 667/1322] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:59:04 2024] GET /share/v2/6d36e1eb1dbc449db6aca75b12a2ba18/shares/84e821d0-2b62-48db-80c7-259f61a14bac => generated 1320 bytes in 24 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:59:05 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-12143fe7-f9cd-4e31-86a0-7430cba7f9d3 tempest-ShareIpRulesForNFSTest-1748669711 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:59:05 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-12143fe7-f9cd-4e31-86a0-7430cba7f9d3 tempest-ShareIpRulesForNFSTest-1748669711 None] [Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=1, created='2024-05-28T12:57:40.763635Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='377955ad-d094-4e49-ab32-1021d943a572', id=21, internal=False, is_s3_default_policy=False, name='b7a7d61c-2cea-442a-9809-507038e080d5', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=['*'], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=[], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=[], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T12:58:50.758361Z', tenant_id=1, tenant_name='default', title='b7a7d61c-2cea-442a-9809-507038e080d5', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/21/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[])] May 28 12:59:05 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-12143fe7-f9cd-4e31-86a0-7430cba7f9d3 tempest-ShareIpRulesForNFSTest-1748669711 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 12:59:05 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-12143fe7-f9cd-4e31-86a0-7430cba7f9d3 tempest-ShareIpRulesForNFSTest-1748669711 None] changing access on /manila/manila-b7a7d61c-2cea-442a-9809-507038e080d5. Rules: {'nfs_read_write': [], 'nfs_read_only': ['2.2.2.2']} May 28 12:59:05 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-12143fe7-f9cd-4e31-86a0-7430cba7f9d3 tempest-ShareIpRulesForNFSTest-1748669711 None] >>> [PATCH] https://127.0.0.1:40443/api/viewpolicies/21/ May 28 12:59:05 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-12143fe7-f9cd-4e31-86a0-7430cba7f9d3 tempest-ShareIpRulesForNFSTest-1748669711 None] {'data': '{"name": "b7a7d61c-2cea-442a-9809-507038e080d5", "nfs_no_squash": ' May 28 12:59:05 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-12143fe7-f9cd-4e31-86a0-7430cba7f9d3 tempest-ShareIpRulesForNFSTest-1748669711 None] '["*"], "nfs_root_squash": ["*"], "nfs_read_write": [], ' May 28 12:59:05 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-12143fe7-f9cd-4e31-86a0-7430cba7f9d3 tempest-ShareIpRulesForNFSTest-1748669711 None] '"nfs_read_only": ["2.2.2.2"]}', May 28 12:59:05 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-12143fe7-f9cd-4e31-86a0-7430cba7f9d3 tempest-ShareIpRulesForNFSTest-1748669711 None] 'params': None} May 28 12:59:05 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-adacda1d-98f6-4514-bba9-a0bf51e1194a tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] GET http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/9e24a210-9e96-45d9-b31c-f6f3377eb0e7 May 28 12:59:05 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-adacda1d-98f6-4514-bba9-a0bf51e1194a tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:05 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-adacda1d-98f6-4514-bba9-a0bf51e1194a tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:05 l75lg1-v1 devstack@placement-api.service[78202]: DEBUG dbcounter [-] [78202] Writing DB stats placement:SELECT=2 {{(pid=78202) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:59:05 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-adacda1d-98f6-4514-bba9-a0bf51e1194a tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/9e24a210-9e96-45d9-b31c-f6f3377eb0e7 returned with HTTP 200 May 28 12:59:05 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 656/1323] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:59:05 2024] GET /share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/9e24a210-9e96-45d9-b31c-f6f3377eb0e7 => generated 1326 bytes in 25 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:59:05 l75lg1-v1 devstack@placement-api.service[78201]: DEBUG dbcounter [-] [78201] Writing DB stats placement:SELECT=2 {{(pid=78201) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:59:05 l75lg1-v1 nova-conductor[83648]: DEBUG dbcounter [-] [83648] Writing DB stats nova_cell1:SELECT=3 {{(pid=83648) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:59:05 l75lg1-v1 dstat.sh[49771]: 28-05 12:59:05| 5 0 93 1 0|5730M 1744M 277M 7873M| 12k 4282B| 0 1554k| 0 136 |3414 5574 |0.92 1.01 0.99| 0 1.0 0| 0 0 | 0 2048M| 29 361 0 31 0 May 28 12:59:05 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2f6b2e55-9e06-40a0-b67f-158be0ef75e0 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] <<< [PATCH] https://127.0.0.1:40443/api/viewpolicies/32/ May 28 12:59:05 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2f6b2e55-9e06-40a0-b67f-158be0ef75e0 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=1, created='2024-05-28T12:58:43.845440Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='31b6534b-d142-4561-992f-4f0759db302d', id=32, internal=False, is_s3_default_policy=False, name='7fdd602c-79d0-479c-95a2-336b202c6639', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=['*'], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=[], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=[], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='MODIFYING', sync_time='2024-05-28T12:59:04.501718Z', tenant_id=1, tenant_name='default', title='7fdd602c-79d0-479c-95a2-336b202c6639', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/32/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[]) May 28 12:59:05 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2f6b2e55-9e06-40a0-b67f-158be0ef75e0 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] --- [PATCH] https://127.0.0.1:40443/api/viewpolicies/32/: Done May 28 12:59:05 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-2f6b2e55-9e06-40a0-b67f-158be0ef75e0 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:05 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-2f6b2e55-9e06-40a0-b67f-158be0ef75e0 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:05 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-2f6b2e55-9e06-40a0-b67f-158be0ef75e0 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.028s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:05 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-2f6b2e55-9e06-40a0-b67f-158be0ef75e0 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:05 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-2f6b2e55-9e06-40a0-b67f-158be0ef75e0 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:05 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-2f6b2e55-9e06-40a0-b67f-158be0ef75e0 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.036s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:05 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-2f6b2e55-9e06-40a0-b67f-158be0ef75e0 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:05 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-2f6b2e55-9e06-40a0-b67f-158be0ef75e0 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:05 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-2f6b2e55-9e06-40a0-b67f-158be0ef75e0 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:05 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-2f6b2e55-9e06-40a0-b67f-158be0ef75e0 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:05 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-2f6b2e55-9e06-40a0-b67f-158be0ef75e0 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:05 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-2f6b2e55-9e06-40a0-b67f-158be0ef75e0 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:05 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-2f6b2e55-9e06-40a0-b67f-158be0ef75e0 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:05 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-2f6b2e55-9e06-40a0-b67f-158be0ef75e0 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:05 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-2f6b2e55-9e06-40a0-b67f-158be0ef75e0 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.041s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:05 l75lg1-v1 manila-share[98474]: INFO manila.share.access [None req-2f6b2e55-9e06-40a0-b67f-158be0ef75e0 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Access rules were successfully modified for share instance 7fdd602c-79d0-479c-95a2-336b202c6639 belonging to share 72db8769-ece7-42ff-af27-2e778292a9b4. May 28 12:59:05 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e33a4def-e23e-4cb3-aa95-353e32ae4440 tempest-SharesMetadataTest-1561320255 None] <<< [DELETE] https://127.0.0.1:40443/api/quotas/15/ May 28 12:59:05 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e33a4def-e23e-4cb3-aa95-353e32ae4440 tempest-SharesMetadataTest-1561320255 None] --- [DELETE] https://127.0.0.1:40443/api/quotas/15/: Done May 28 12:59:05 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e33a4def-e23e-4cb3-aa95-353e32ae4440 tempest-SharesMetadataTest-1561320255 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:59:05 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e33a4def-e23e-4cb3-aa95-353e32ae4440 tempest-SharesMetadataTest-1561320255 None] {'allow_redirects': True, May 28 12:59:05 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e33a4def-e23e-4cb3-aa95-353e32ae4440 tempest-SharesMetadataTest-1561320255 None] 'params': {'name': '5a6db1ad-927e-4228-b973-3ff998e29ada'}} May 28 12:59:05 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-783d4d0d-9df8-428a-abea-bb08c8612fb5 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] GET http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/share-access-rules?share_id=72db8769-ece7-42ff-af27-2e778292a9b4 May 28 12:59:05 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-783d4d0d-9df8-428a-abea-bb08c8612fb5 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:05 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-783d4d0d-9df8-428a-abea-bb08c8612fb5 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:05 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-783d4d0d-9df8-428a-abea-bb08c8612fb5 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/share-access-rules?share_id=72db8769-ece7-42ff-af27-2e778292a9b4 returned with HTTP 200 May 28 12:59:05 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 668/1324] 10.27.203.238 () {64 vars in 1467 bytes} [Tue May 28 12:59:05 2024] GET /share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/share-access-rules?share_id=72db8769-ece7-42ff-af27-2e778292a9b4 => generated 19 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:59:05 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-5c054369-bcd5-45fc-89ad-0140ed096f2e tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] POST http://10.27.203.238/share/v1/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action May 28 12:59:05 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-5c054369-bcd5-45fc-89ad-0140ed096f2e tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Action body: b'{"os-allow_access": {"access_type": "ip", "access_to": "1.2.3.256", "access_level": null}}' {{(pid=98330) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:59:05 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-5c054369-bcd5-45fc-89ad-0140ed096f2e tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Action: 'action', calling method: ShareController.allow_access, body: {"os-allow_access": {"access_type": "ip", "access_to": "1.2.3.256", "access_level": null}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:59:05 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-5c054369-bcd5-45fc-89ad-0140ed096f2e tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] HTTP exception thrown: Octet 256 (> 255) not permitted in '1.2.3.256' May 28 12:59:05 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-5c054369-bcd5-45fc-89ad-0140ed096f2e tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] http://10.27.203.238/share/v1/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action returned with HTTP 400 May 28 12:59:05 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 657/1325] 10.27.203.238 () {64 vars in 1450 bytes} [Tue May 28 12:59:05 2024] POST /share/v1/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action => generated 90 bytes in 37 msecs (HTTP/1.1 400) 6 headers in 238 bytes (1 switches on core 0) May 28 12:59:05 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-6ae0a5fd-cf6a-4914-aadc-28fb93c9e03d tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] POST http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action May 28 12:59:05 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-6ae0a5fd-cf6a-4914-aadc-28fb93c9e03d tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Action body: b'{"allow_access": {"access_type": "ip", "access_to": "1.2.3.256", "access_level": null}}' {{(pid=98329) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:59:05 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-6ae0a5fd-cf6a-4914-aadc-28fb93c9e03d tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Action: 'action', calling method: ShareController.allow_access, body: {"allow_access": {"access_type": "ip", "access_to": "1.2.3.256", "access_level": null}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:59:05 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-6ae0a5fd-cf6a-4914-aadc-28fb93c9e03d tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] HTTP exception thrown: '1.2.3.256' does not appear to be an IPv4 or IPv6 network May 28 12:59:05 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-6ae0a5fd-cf6a-4914-aadc-28fb93c9e03d tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action returned with HTTP 400 May 28 12:59:05 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 669/1326] 10.27.203.238 () {66 vars in 1493 bytes} [Tue May 28 12:59:05 2024] POST /share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action => generated 101 bytes in 25 msecs (HTTP/1.1 400) 6 headers in 240 bytes (1 switches on core 0) May 28 12:59:05 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-71d9975b-6879-45fe-836c-14b7c800e3cd tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] POST http://10.27.203.238/share/v1/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action May 28 12:59:05 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-71d9975b-6879-45fe-836c-14b7c800e3cd tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Action body: b'{"os-allow_access": {"access_type": "ip", "access_to": "1.1.1.-", "access_level": null}}' {{(pid=98330) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:59:05 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-71d9975b-6879-45fe-836c-14b7c800e3cd tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Action: 'action', calling method: ShareController.allow_access, body: {"os-allow_access": {"access_type": "ip", "access_to": "1.1.1.-", "access_level": null}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:59:05 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-71d9975b-6879-45fe-836c-14b7c800e3cd tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] HTTP exception thrown: Only decimal digits permitted in '-' in '1.1.1.-' May 28 12:59:05 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-71d9975b-6879-45fe-836c-14b7c800e3cd tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] http://10.27.203.238/share/v1/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action returned with HTTP 400 May 28 12:59:05 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 658/1327] 10.27.203.238 () {64 vars in 1450 bytes} [Tue May 28 12:59:05 2024] POST /share/v1/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action => generated 93 bytes in 35 msecs (HTTP/1.1 400) 6 headers in 238 bytes (1 switches on core 0) May 28 12:59:05 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-38f7ef7d-314a-4406-8c6c-cceec62e5278 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] POST http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action May 28 12:59:05 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-38f7ef7d-314a-4406-8c6c-cceec62e5278 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Action body: b'{"allow_access": {"access_type": "ip", "access_to": "1.1.1.-", "access_level": null}}' {{(pid=98329) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:59:05 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-38f7ef7d-314a-4406-8c6c-cceec62e5278 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Action: 'action', calling method: ShareController.allow_access, body: {"allow_access": {"access_type": "ip", "access_to": "1.1.1.-", "access_level": null}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:59:05 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-38f7ef7d-314a-4406-8c6c-cceec62e5278 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] HTTP exception thrown: '1.1.1.-' does not appear to be an IPv4 or IPv6 network May 28 12:59:05 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-38f7ef7d-314a-4406-8c6c-cceec62e5278 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action returned with HTTP 400 May 28 12:59:05 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 670/1328] 10.27.203.238 () {66 vars in 1493 bytes} [Tue May 28 12:59:05 2024] POST /share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action => generated 99 bytes in 25 msecs (HTTP/1.1 400) 6 headers in 239 bytes (1 switches on core 0) May 28 12:59:05 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-24c2ea5e-0c30-4abb-9353-66b76faf2040 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] POST http://10.27.203.238/share/v1/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action May 28 12:59:05 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-24c2ea5e-0c30-4abb-9353-66b76faf2040 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Action body: b'{"os-allow_access": {"access_type": "ip", "access_to": "1.2.3.4/33", "access_level": null}}' {{(pid=98330) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:59:05 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-24c2ea5e-0c30-4abb-9353-66b76faf2040 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Action: 'action', calling method: ShareController.allow_access, body: {"os-allow_access": {"access_type": "ip", "access_to": "1.2.3.4/33", "access_level": null}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:59:05 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-24c2ea5e-0c30-4abb-9353-66b76faf2040 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] HTTP exception thrown: '33' is not a valid netmask May 28 12:59:05 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-24c2ea5e-0c30-4abb-9353-66b76faf2040 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] http://10.27.203.238/share/v1/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action returned with HTTP 400 May 28 12:59:05 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 659/1329] 10.27.203.238 () {64 vars in 1450 bytes} [Tue May 28 12:59:05 2024] POST /share/v1/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action => generated 71 bytes in 28 msecs (HTTP/1.1 400) 6 headers in 238 bytes (1 switches on core 0) May 28 12:59:05 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-87372ff8-e499-4b6c-912f-32a2d51eba7b tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] POST http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action May 28 12:59:05 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-87372ff8-e499-4b6c-912f-32a2d51eba7b tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Action body: b'{"allow_access": {"access_type": "ip", "access_to": "1.2.3.4/33", "access_level": null}}' {{(pid=98329) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:59:05 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-87372ff8-e499-4b6c-912f-32a2d51eba7b tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Action: 'action', calling method: ShareController.allow_access, body: {"allow_access": {"access_type": "ip", "access_to": "1.2.3.4/33", "access_level": null}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:59:05 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-87372ff8-e499-4b6c-912f-32a2d51eba7b tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] HTTP exception thrown: '1.2.3.4/33' does not appear to be an IPv4 or IPv6 network May 28 12:59:05 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-87372ff8-e499-4b6c-912f-32a2d51eba7b tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action returned with HTTP 400 May 28 12:59:05 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 671/1330] 10.27.203.238 () {66 vars in 1493 bytes} [Tue May 28 12:59:05 2024] POST /share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action => generated 102 bytes in 28 msecs (HTTP/1.1 400) 6 headers in 240 bytes (1 switches on core 0) May 28 12:59:05 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-6941c2ec-4a26-4c00-bd13-2f46c596ee55 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] POST http://10.27.203.238/share/v1/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action May 28 12:59:05 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-6941c2ec-4a26-4c00-bd13-2f46c596ee55 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Action body: b'{"os-allow_access": {"access_type": "ip", "access_to": "1.2.3.*", "access_level": null}}' {{(pid=98330) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:59:05 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-6941c2ec-4a26-4c00-bd13-2f46c596ee55 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Action: 'action', calling method: ShareController.allow_access, body: {"os-allow_access": {"access_type": "ip", "access_to": "1.2.3.*", "access_level": null}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:59:05 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e33a4def-e23e-4cb3-aa95-353e32ae4440 tempest-SharesMetadataTest-1561320255 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:59:05 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e33a4def-e23e-4cb3-aa95-353e32ae4440 tempest-SharesMetadataTest-1561320255 None] [Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=0, created='2024-05-28T12:57:22.052824Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='87781126-ccab-4be7-a8c1-9e74530a49c8', id=18, internal=False, is_s3_default_policy=False, name='5a6db1ad-927e-4228-b973-3ff998e29ada', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=[], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['*'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['*'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T12:57:22.447464Z', tenant_id=1, tenant_name='default', title='5a6db1ad-927e-4228-b973-3ff998e29ada', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/18/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[])] May 28 12:59:05 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e33a4def-e23e-4cb3-aa95-353e32ae4440 tempest-SharesMetadataTest-1561320255 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 12:59:05 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e33a4def-e23e-4cb3-aa95-353e32ae4440 tempest-SharesMetadataTest-1561320255 None] >>> [DELETE] https://127.0.0.1:40443/api/viewpolicies/18/ May 28 12:59:06 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-6941c2ec-4a26-4c00-bd13-2f46c596ee55 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] HTTP exception thrown: Only decimal digits permitted in '*' in '1.2.3.*' May 28 12:59:06 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-6941c2ec-4a26-4c00-bd13-2f46c596ee55 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] http://10.27.203.238/share/v1/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action returned with HTTP 400 May 28 12:59:06 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 660/1331] 10.27.203.238 () {64 vars in 1450 bytes} [Tue May 28 12:59:05 2024] POST /share/v1/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action => generated 93 bytes in 23 msecs (HTTP/1.1 400) 6 headers in 238 bytes (1 switches on core 0) May 28 12:59:06 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-5a100e3c-3da9-4a2a-95be-c820d4e352bd tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] POST http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action May 28 12:59:06 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-5a100e3c-3da9-4a2a-95be-c820d4e352bd tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Action body: b'{"allow_access": {"access_type": "ip", "access_to": "1.2.3.*", "access_level": null}}' {{(pid=98329) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:59:06 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-5a100e3c-3da9-4a2a-95be-c820d4e352bd tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Action: 'action', calling method: ShareController.allow_access, body: {"allow_access": {"access_type": "ip", "access_to": "1.2.3.*", "access_level": null}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:59:06 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-5a100e3c-3da9-4a2a-95be-c820d4e352bd tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] HTTP exception thrown: '1.2.3.*' does not appear to be an IPv4 or IPv6 network May 28 12:59:06 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-5a100e3c-3da9-4a2a-95be-c820d4e352bd tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action returned with HTTP 400 May 28 12:59:06 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 672/1332] 10.27.203.238 () {66 vars in 1493 bytes} [Tue May 28 12:59:06 2024] POST /share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action => generated 99 bytes in 25 msecs (HTTP/1.1 400) 6 headers in 239 bytes (1 switches on core 0) May 28 12:59:06 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-4727834e-c2d1-4ea1-b006-1f60cbba31db tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] POST http://10.27.203.238/share/v1/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action May 28 12:59:06 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-4727834e-c2d1-4ea1-b006-1f60cbba31db tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Action body: b'{"os-allow_access": {"access_type": "ip", "access_to": "1.2.3.*/23", "access_level": null}}' {{(pid=98330) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:59:06 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-4727834e-c2d1-4ea1-b006-1f60cbba31db tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Action: 'action', calling method: ShareController.allow_access, body: {"os-allow_access": {"access_type": "ip", "access_to": "1.2.3.*/23", "access_level": null}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:59:06 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-4727834e-c2d1-4ea1-b006-1f60cbba31db tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] HTTP exception thrown: Only decimal digits permitted in '*' in '1.2.3.*' May 28 12:59:06 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-4727834e-c2d1-4ea1-b006-1f60cbba31db tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] http://10.27.203.238/share/v1/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action returned with HTTP 400 May 28 12:59:06 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 661/1333] 10.27.203.238 () {64 vars in 1450 bytes} [Tue May 28 12:59:06 2024] POST /share/v1/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action => generated 93 bytes in 22 msecs (HTTP/1.1 400) 6 headers in 238 bytes (1 switches on core 0) May 28 12:59:06 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-71913218-e4ca-4b42-9f43-60c076adf1d5 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] POST http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action May 28 12:59:06 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-71913218-e4ca-4b42-9f43-60c076adf1d5 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Action body: b'{"allow_access": {"access_type": "ip", "access_to": "1.2.3.*/23", "access_level": null}}' {{(pid=98329) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:59:06 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-71913218-e4ca-4b42-9f43-60c076adf1d5 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Action: 'action', calling method: ShareController.allow_access, body: {"allow_access": {"access_type": "ip", "access_to": "1.2.3.*/23", "access_level": null}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:59:06 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-71913218-e4ca-4b42-9f43-60c076adf1d5 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] HTTP exception thrown: '1.2.3.*/23' does not appear to be an IPv4 or IPv6 network May 28 12:59:06 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-71913218-e4ca-4b42-9f43-60c076adf1d5 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action returned with HTTP 400 May 28 12:59:06 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 673/1334] 10.27.203.238 () {66 vars in 1493 bytes} [Tue May 28 12:59:06 2024] POST /share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action => generated 102 bytes in 22 msecs (HTTP/1.1 400) 6 headers in 240 bytes (1 switches on core 0) May 28 12:59:06 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-89e64ad9-5ca8-4c43-8c1e-809606920c27 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] POST http://10.27.203.238/share/v1/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action May 28 12:59:06 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-89e64ad9-5ca8-4c43-8c1e-809606920c27 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Action body: b'{"os-allow_access": {"access_type": "ip", "access_to": "1.2.3.1|23", "access_level": null}}' {{(pid=98330) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:59:06 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-89e64ad9-5ca8-4c43-8c1e-809606920c27 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Action: 'action', calling method: ShareController.allow_access, body: {"os-allow_access": {"access_type": "ip", "access_to": "1.2.3.1|23", "access_level": null}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:59:06 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-89e64ad9-5ca8-4c43-8c1e-809606920c27 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] HTTP exception thrown: Only decimal digits permitted in '1|23' in '1.2.3.1|23' May 28 12:59:06 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-89e64ad9-5ca8-4c43-8c1e-809606920c27 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] http://10.27.203.238/share/v1/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action returned with HTTP 400 May 28 12:59:06 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 662/1335] 10.27.203.238 () {64 vars in 1450 bytes} [Tue May 28 12:59:06 2024] POST /share/v1/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action => generated 99 bytes in 21 msecs (HTTP/1.1 400) 6 headers in 238 bytes (1 switches on core 0) May 28 12:59:06 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-cf2f4f35-a48a-4444-8d5f-7a4c6f89be59 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] POST http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action May 28 12:59:06 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-cf2f4f35-a48a-4444-8d5f-7a4c6f89be59 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Action body: b'{"allow_access": {"access_type": "ip", "access_to": "1.2.3.1|23", "access_level": null}}' {{(pid=98329) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:59:06 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-cf2f4f35-a48a-4444-8d5f-7a4c6f89be59 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Action: 'action', calling method: ShareController.allow_access, body: {"allow_access": {"access_type": "ip", "access_to": "1.2.3.1|23", "access_level": null}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:59:06 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-cf2f4f35-a48a-4444-8d5f-7a4c6f89be59 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] HTTP exception thrown: '1.2.3.1|23' does not appear to be an IPv4 or IPv6 network May 28 12:59:06 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-cf2f4f35-a48a-4444-8d5f-7a4c6f89be59 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action returned with HTTP 400 May 28 12:59:06 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 674/1336] 10.27.203.238 () {66 vars in 1493 bytes} [Tue May 28 12:59:06 2024] POST /share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action => generated 102 bytes in 23 msecs (HTTP/1.1 400) 6 headers in 240 bytes (1 switches on core 0) May 28 12:59:06 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-71622d26-de58-4034-9b26-7d87b9edddf1 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] POST http://10.27.203.238/share/v1/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action May 28 12:59:06 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-71622d26-de58-4034-9b26-7d87b9edddf1 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Action body: b'{"os-allow_access": {"access_type": "ip", "access_to": "1.2.3.1/-1", "access_level": null}}' {{(pid=98330) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:59:06 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-71622d26-de58-4034-9b26-7d87b9edddf1 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Action: 'action', calling method: ShareController.allow_access, body: {"os-allow_access": {"access_type": "ip", "access_to": "1.2.3.1/-1", "access_level": null}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:59:06 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-71622d26-de58-4034-9b26-7d87b9edddf1 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] HTTP exception thrown: '-1' is not a valid netmask May 28 12:59:06 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-71622d26-de58-4034-9b26-7d87b9edddf1 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] http://10.27.203.238/share/v1/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action returned with HTTP 400 May 28 12:59:06 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 663/1337] 10.27.203.238 () {64 vars in 1450 bytes} [Tue May 28 12:59:06 2024] POST /share/v1/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action => generated 71 bytes in 23 msecs (HTTP/1.1 400) 6 headers in 238 bytes (1 switches on core 0) May 28 12:59:06 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-aac6b1b7-0aee-462b-9fac-ed24f3eb14e7 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] POST http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action May 28 12:59:06 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-aac6b1b7-0aee-462b-9fac-ed24f3eb14e7 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Action body: b'{"allow_access": {"access_type": "ip", "access_to": "1.2.3.1/-1", "access_level": null}}' {{(pid=98329) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:59:06 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-aac6b1b7-0aee-462b-9fac-ed24f3eb14e7 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Action: 'action', calling method: ShareController.allow_access, body: {"allow_access": {"access_type": "ip", "access_to": "1.2.3.1/-1", "access_level": null}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:59:06 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-aac6b1b7-0aee-462b-9fac-ed24f3eb14e7 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] HTTP exception thrown: '1.2.3.1/-1' does not appear to be an IPv4 or IPv6 network May 28 12:59:06 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-aac6b1b7-0aee-462b-9fac-ed24f3eb14e7 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action returned with HTTP 400 May 28 12:59:06 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 675/1338] 10.27.203.238 () {66 vars in 1493 bytes} [Tue May 28 12:59:06 2024] POST /share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action => generated 102 bytes in 23 msecs (HTTP/1.1 400) 6 headers in 240 bytes (1 switches on core 0) May 28 12:59:06 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-41d9424b-09e5-411b-8878-958fb3c04024 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] POST http://10.27.203.238/share/v1/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action May 28 12:59:06 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-41d9424b-09e5-411b-8878-958fb3c04024 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Action body: b'{"os-allow_access": {"access_type": "ip", "access_to": "1.2.3.1/", "access_level": null}}' {{(pid=98330) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:59:06 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-41d9424b-09e5-411b-8878-958fb3c04024 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Action: 'action', calling method: ShareController.allow_access, body: {"os-allow_access": {"access_type": "ip", "access_to": "1.2.3.1/", "access_level": null}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:59:06 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-41d9424b-09e5-411b-8878-958fb3c04024 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] HTTP exception thrown: '' is not a valid netmask May 28 12:59:06 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-41d9424b-09e5-411b-8878-958fb3c04024 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] http://10.27.203.238/share/v1/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action returned with HTTP 400 May 28 12:59:06 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 664/1339] 10.27.203.238 () {64 vars in 1450 bytes} [Tue May 28 12:59:06 2024] POST /share/v1/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action => generated 69 bytes in 23 msecs (HTTP/1.1 400) 6 headers in 238 bytes (1 switches on core 0) May 28 12:59:06 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-834de5b4-020c-4204-8d30-04feb3e1f389 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] POST http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action May 28 12:59:06 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-834de5b4-020c-4204-8d30-04feb3e1f389 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Action body: b'{"allow_access": {"access_type": "ip", "access_to": "1.2.3.1/", "access_level": null}}' {{(pid=98329) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:59:06 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-834de5b4-020c-4204-8d30-04feb3e1f389 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Action: 'action', calling method: ShareController.allow_access, body: {"allow_access": {"access_type": "ip", "access_to": "1.2.3.1/", "access_level": null}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:59:06 l75lg1-v1 dstat.sh[49771]: 28-05 12:59:06| 8 1 91 1 0|5731M 1743M 277M 7873M| 15k 16k| 0 684k| 0 67.0 |3894 5947 |0.92 1.01 0.99|1.0 1.0 0| 0 0 | 0 2048M| 29 362 0 31 0 May 28 12:59:06 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-834de5b4-020c-4204-8d30-04feb3e1f389 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] HTTP exception thrown: '1.2.3.1/' does not appear to be an IPv4 or IPv6 network May 28 12:59:06 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-834de5b4-020c-4204-8d30-04feb3e1f389 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action returned with HTTP 400 May 28 12:59:06 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 676/1340] 10.27.203.238 () {66 vars in 1493 bytes} [Tue May 28 12:59:06 2024] POST /share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action => generated 100 bytes in 24 msecs (HTTP/1.1 400) 6 headers in 240 bytes (1 switches on core 0) May 28 12:59:06 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-310cead3-f982-4811-bf8b-1627841bf2d4 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] POST http://10.27.203.238/share/v1/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action May 28 12:59:06 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-310cead3-f982-4811-bf8b-1627841bf2d4 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Action body: b'{"os-allow_access": {"access_type": "ip", "access_to": "ad80::abaa:0:c2:2/-3", "access_level": null}}' {{(pid=98330) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:59:06 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-310cead3-f982-4811-bf8b-1627841bf2d4 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Action: 'action', calling method: ShareController.allow_access, body: {"os-allow_access": {"access_type": "ip", "access_to": "ad80::abaa:0:c2:2/-3", "access_level": null}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:59:06 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-310cead3-f982-4811-bf8b-1627841bf2d4 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] HTTP exception thrown: Expected 4 octets in 'ad80::abaa:0:c2:2' May 28 12:59:06 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-310cead3-f982-4811-bf8b-1627841bf2d4 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] http://10.27.203.238/share/v1/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action returned with HTTP 400 May 28 12:59:06 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 665/1341] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:59:06 2024] POST /share/v1/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action => generated 84 bytes in 26 msecs (HTTP/1.1 400) 6 headers in 238 bytes (1 switches on core 0) May 28 12:59:06 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-7fd3b46c-9a33-4bf7-81db-b1699d381fc5 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] POST http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action May 28 12:59:06 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-7fd3b46c-9a33-4bf7-81db-b1699d381fc5 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Action body: b'{"allow_access": {"access_type": "ip", "access_to": "ad80::abaa:0:c2:2/-3", "access_level": null}}' {{(pid=98329) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:59:06 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-7fd3b46c-9a33-4bf7-81db-b1699d381fc5 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Action: 'action', calling method: ShareController.allow_access, body: {"allow_access": {"access_type": "ip", "access_to": "ad80::abaa:0:c2:2/-3", "access_level": null}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:59:06 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-7fd3b46c-9a33-4bf7-81db-b1699d381fc5 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] HTTP exception thrown: 'ad80::abaa:0:c2:2/-3' does not appear to be an IPv4 or IPv6 network May 28 12:59:06 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-7fd3b46c-9a33-4bf7-81db-b1699d381fc5 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action returned with HTTP 400 May 28 12:59:06 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 677/1342] 10.27.203.238 () {66 vars in 1493 bytes} [Tue May 28 12:59:06 2024] POST /share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action => generated 112 bytes in 27 msecs (HTTP/1.1 400) 6 headers in 240 bytes (1 switches on core 0) May 28 12:59:06 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-cfdf75bb-cdab-49a4-9a50-14cc7809946a tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] POST http://10.27.203.238/share/v1/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action May 28 12:59:06 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-cfdf75bb-cdab-49a4-9a50-14cc7809946a tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Action body: b'{"os-allow_access": {"access_type": "ip", "access_to": "AD80:ABAA::|26", "access_level": null}}' {{(pid=98330) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:59:06 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-cfdf75bb-cdab-49a4-9a50-14cc7809946a tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Action: 'action', calling method: ShareController.allow_access, body: {"os-allow_access": {"access_type": "ip", "access_to": "AD80:ABAA::|26", "access_level": null}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:59:06 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-cfdf75bb-cdab-49a4-9a50-14cc7809946a tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] HTTP exception thrown: Expected 4 octets in 'AD80:ABAA::|26' May 28 12:59:06 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-cfdf75bb-cdab-49a4-9a50-14cc7809946a tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] http://10.27.203.238/share/v1/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action returned with HTTP 400 May 28 12:59:06 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 666/1343] 10.27.203.238 () {64 vars in 1450 bytes} [Tue May 28 12:59:06 2024] POST /share/v1/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action => generated 81 bytes in 23 msecs (HTTP/1.1 400) 6 headers in 238 bytes (1 switches on core 0) May 28 12:59:06 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-5df222a7-f3e7-4d90-bc44-f7734b2ef293 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] POST http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action May 28 12:59:06 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-5df222a7-f3e7-4d90-bc44-f7734b2ef293 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Action body: b'{"allow_access": {"access_type": "ip", "access_to": "AD80:ABAA::|26", "access_level": null}}' {{(pid=98329) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:59:06 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-5df222a7-f3e7-4d90-bc44-f7734b2ef293 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Action: 'action', calling method: ShareController.allow_access, body: {"allow_access": {"access_type": "ip", "access_to": "AD80:ABAA::|26", "access_level": null}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:59:06 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-5df222a7-f3e7-4d90-bc44-f7734b2ef293 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] HTTP exception thrown: 'AD80:ABAA::|26' does not appear to be an IPv4 or IPv6 network May 28 12:59:06 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-5df222a7-f3e7-4d90-bc44-f7734b2ef293 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action returned with HTTP 400 May 28 12:59:06 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 678/1344] 10.27.203.238 () {66 vars in 1493 bytes} [Tue May 28 12:59:06 2024] POST /share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action => generated 106 bytes in 28 msecs (HTTP/1.1 400) 6 headers in 240 bytes (1 switches on core 0) May 28 12:59:06 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-9e5f8699-429d-4050-bca9-040acee80fe6 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] POST http://10.27.203.238/share/v1/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action May 28 12:59:06 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-9e5f8699-429d-4050-bca9-040acee80fe6 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Action body: b'{"os-allow_access": {"access_type": "ip", "access_to": "2001:DB8:2de:0:0:0:0:e13:200a", "access_level": null}}' {{(pid=98330) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:59:06 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-9e5f8699-429d-4050-bca9-040acee80fe6 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Action: 'action', calling method: ShareController.allow_access, body: {"os-allow_access": {"access_type": "ip", "access_to": "2001:DB8:2de:0:0:0:0:e13:200a", "access_level": null}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:59:06 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-9e5f8699-429d-4050-bca9-040acee80fe6 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] HTTP exception thrown: Expected 4 octets in '2001:DB8:2de:0:0:0:0:e13:200a' May 28 12:59:06 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-9e5f8699-429d-4050-bca9-040acee80fe6 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] http://10.27.203.238/share/v1/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action returned with HTTP 400 May 28 12:59:06 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 667/1345] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:59:06 2024] POST /share/v1/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action => generated 96 bytes in 23 msecs (HTTP/1.1 400) 6 headers in 238 bytes (1 switches on core 0) May 28 12:59:06 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-8dff2db9-fed4-4d6b-99cd-35be3f312448 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] POST http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action May 28 12:59:06 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-8dff2db9-fed4-4d6b-99cd-35be3f312448 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Action body: b'{"allow_access": {"access_type": "ip", "access_to": "2001:DB8:2de:0:0:0:0:e13:200a", "access_level": null}}' {{(pid=98329) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:59:06 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-8dff2db9-fed4-4d6b-99cd-35be3f312448 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Action: 'action', calling method: ShareController.allow_access, body: {"allow_access": {"access_type": "ip", "access_to": "2001:DB8:2de:0:0:0:0:e13:200a", "access_level": null}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:59:06 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-8dff2db9-fed4-4d6b-99cd-35be3f312448 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] HTTP exception thrown: '2001:DB8:2de:0:0:0:0:e13:200a' does not appear to be an IPv4 or IPv6 network May 28 12:59:06 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-8dff2db9-fed4-4d6b-99cd-35be3f312448 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action returned with HTTP 400 May 28 12:59:06 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 679/1346] 10.27.203.238 () {66 vars in 1494 bytes} [Tue May 28 12:59:06 2024] POST /share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action => generated 121 bytes in 28 msecs (HTTP/1.1 400) 6 headers in 240 bytes (1 switches on core 0) May 28 12:59:06 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-7bed0ea9-ee60-4045-ab9f-defa4178eda4 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] POST http://10.27.203.238/share/v1/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action May 28 12:59:06 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-7bed0ea9-ee60-4045-ab9f-defa4178eda4 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Action body: b'{"os-allow_access": {"access_type": "ip", "access_to": "2.2.2.2", "access_level": "su"}}' {{(pid=98330) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:59:06 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-7bed0ea9-ee60-4045-ab9f-defa4178eda4 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Action: 'action', calling method: ShareController.allow_access, body: {"os-allow_access": {"access_type": "ip", "access_to": "2.2.2.2", "access_level": "su"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:59:06 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-7bed0ea9-ee60-4045-ab9f-defa4178eda4 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] http://10.27.203.238/share/v1/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action returned with HTTP 400 May 28 12:59:06 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 668/1347] 10.27.203.238 () {64 vars in 1450 bytes} [Tue May 28 12:59:06 2024] POST /share/v1/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action => generated 96 bytes in 26 msecs (HTTP/1.1 400) 6 headers in 238 bytes (1 switches on core 0) May 28 12:59:06 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-d75d26fd-c4cd-4fed-8c85-cda63de3f848 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] POST http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action May 28 12:59:06 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-d75d26fd-c4cd-4fed-8c85-cda63de3f848 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Action body: b'{"allow_access": {"access_type": "ip", "access_to": "2.2.2.2", "access_level": "su"}}' {{(pid=98329) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:59:06 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-d75d26fd-c4cd-4fed-8c85-cda63de3f848 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Action: 'action', calling method: ShareController.allow_access, body: {"allow_access": {"access_type": "ip", "access_to": "2.2.2.2", "access_level": "su"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:59:06 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-d75d26fd-c4cd-4fed-8c85-cda63de3f848 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action returned with HTTP 400 May 28 12:59:06 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 680/1348] 10.27.203.238 () {66 vars in 1493 bytes} [Tue May 28 12:59:06 2024] POST /share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action => generated 96 bytes in 25 msecs (HTTP/1.1 400) 6 headers in 239 bytes (1 switches on core 0) May 28 12:59:06 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-de59a107-09cc-463a-b35a-05473944fb4f tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] POST http://10.27.203.238/share/v1/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action May 28 12:59:06 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-de59a107-09cc-463a-b35a-05473944fb4f tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Action body: b'{"os-allow_access": {"access_type": "ip", "access_to": "1.2.3.4", "access_level": "rw"}}' {{(pid=98330) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:59:06 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-de59a107-09cc-463a-b35a-05473944fb4f tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Action: 'action', calling method: ShareController.allow_access, body: {"os-allow_access": {"access_type": "ip", "access_to": "1.2.3.4", "access_level": "rw"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:59:06 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-de59a107-09cc-463a-b35a-05473944fb4f tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:06 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-de59a107-09cc-463a-b35a-05473944fb4f tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:06 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-de59a107-09cc-463a-b35a-05473944fb4f tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.046s {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:06 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-de59a107-09cc-463a-b35a-05473944fb4f tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] http://10.27.203.238/share/v1/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action returned with HTTP 200 May 28 12:59:06 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 669/1349] 10.27.203.238 () {64 vars in 1450 bytes} [Tue May 28 12:59:06 2024] POST /share/v1/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action => generated 193 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:59:06 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-8a7d15f3-57b0-4e52-9f6a-a47ad26f10a1 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] POST http://10.27.203.238/share/v1/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action May 28 12:59:06 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-8a7d15f3-57b0-4e52-9f6a-a47ad26f10a1 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Action body: b'{"os-access_list": null}' {{(pid=98329) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:59:06 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-8a7d15f3-57b0-4e52-9f6a-a47ad26f10a1 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Action: 'action', calling method: ShareController.access_list, body: {"os-access_list": null} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:59:06 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0ff54ac4-b262-4846-9adc-bdeb391988b0 tempest-PublicSharesTest-1667420263 None] <<< [DELETE] https://127.0.0.1:40443/api/quotas/30/ May 28 12:59:06 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0ff54ac4-b262-4846-9adc-bdeb391988b0 tempest-PublicSharesTest-1667420263 None] --- [DELETE] https://127.0.0.1:40443/api/quotas/30/: Done May 28 12:59:06 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0ff54ac4-b262-4846-9adc-bdeb391988b0 tempest-PublicSharesTest-1667420263 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:59:06 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0ff54ac4-b262-4846-9adc-bdeb391988b0 tempest-PublicSharesTest-1667420263 None] {'allow_redirects': True, May 28 12:59:06 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0ff54ac4-b262-4846-9adc-bdeb391988b0 tempest-PublicSharesTest-1667420263 None] 'params': {'name': '834576a8-b0ac-4cc8-a1a0-0067a9513141'}} May 28 12:59:06 l75lg1-v1 manila-share[98474]: DEBUG manila.share.manager [None req-de59a107-09cc-463a-b35a-05473944fb4f tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Received request to update access for share instance 7fdd602c-79d0-479c-95a2-336b202c6639. {{(pid=98474) update_access_for_instances /opt/stack/manila/manila/share/manager.py:4353}} May 28 12:59:06 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-de59a107-09cc-463a-b35a-05473944fb4f tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:06 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-de59a107-09cc-463a-b35a-05473944fb4f tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:06 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-de59a107-09cc-463a-b35a-05473944fb4f tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:06 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-de59a107-09cc-463a-b35a-05473944fb4f tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:06 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-de59a107-09cc-463a-b35a-05473944fb4f tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:06 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-8a7d15f3-57b0-4e52-9f6a-a47ad26f10a1 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] http://10.27.203.238/share/v1/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action returned with HTTP 200 May 28 12:59:06 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 681/1350] 10.27.203.238 () {64 vars in 1450 bytes} [Tue May 28 12:59:06 2024] POST /share/v1/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action => generated 148 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:59:06 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-de59a107-09cc-463a-b35a-05473944fb4f tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.051s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:06 l75lg1-v1 manila-share[98474]: DEBUG manila.share.access [None req-de59a107-09cc-463a-b35a-05473944fb4f tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Updating access rules for share instance 7fdd602c-79d0-479c-95a2-336b202c6639 belonging to share 72db8769-ece7-42ff-af27-2e778292a9b4. {{(pid=98474) update_access_rules /opt/stack/manila/manila/share/access.py:298}} May 28 12:59:06 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-de59a107-09cc-463a-b35a-05473944fb4f tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:06 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-de59a107-09cc-463a-b35a-05473944fb4f tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:06 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-de59a107-09cc-463a-b35a-05473944fb4f tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.007s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:06 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-de59a107-09cc-463a-b35a-05473944fb4f tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:06 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-de59a107-09cc-463a-b35a-05473944fb4f tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:06 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-de59a107-09cc-463a-b35a-05473944fb4f tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.014s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:06 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-de59a107-09cc-463a-b35a-05473944fb4f tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] changing access on None May 28 12:59:06 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-de59a107-09cc-463a-b35a-05473944fb4f tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:59:06 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-de59a107-09cc-463a-b35a-05473944fb4f tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] {'allow_redirects': True, May 28 12:59:06 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-de59a107-09cc-463a-b35a-05473944fb4f tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] 'params': {'name': '7fdd602c-79d0-479c-95a2-336b202c6639'}} May 28 12:59:06 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0ff54ac4-b262-4846-9adc-bdeb391988b0 tempest-PublicSharesTest-1667420263 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:59:06 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0ff54ac4-b262-4846-9adc-bdeb391988b0 tempest-PublicSharesTest-1667420263 None] [Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=0, created='2024-05-28T12:58:53.513887Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='e77919ef-e33f-42bf-a261-d7992af1d276', id=33, internal=False, is_s3_default_policy=False, name='834576a8-b0ac-4cc8-a1a0-0067a9513141', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=[], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['*'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['*'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T12:58:53.814067Z', tenant_id=1, tenant_name='default', title='834576a8-b0ac-4cc8-a1a0-0067a9513141', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/33/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[])] May 28 12:59:06 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0ff54ac4-b262-4846-9adc-bdeb391988b0 tempest-PublicSharesTest-1667420263 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 12:59:06 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0ff54ac4-b262-4846-9adc-bdeb391988b0 tempest-PublicSharesTest-1667420263 None] >>> [DELETE] https://127.0.0.1:40443/api/viewpolicies/33/ May 28 12:59:06 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-12143fe7-f9cd-4e31-86a0-7430cba7f9d3 tempest-ShareIpRulesForNFSTest-1748669711 None] <<< [PATCH] https://127.0.0.1:40443/api/viewpolicies/21/ May 28 12:59:06 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-12143fe7-f9cd-4e31-86a0-7430cba7f9d3 tempest-ShareIpRulesForNFSTest-1748669711 None] Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=1, created='2024-05-28T12:57:40.763635Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='377955ad-d094-4e49-ab32-1021d943a572', id=21, internal=False, is_s3_default_policy=False, name='b7a7d61c-2cea-442a-9809-507038e080d5', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=['*'], nfs_posix_acl=False, nfs_read_only=['2.2.2.2'], nfs_read_write=[], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=['2.2.2.2'], read_write=[], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='MODIFYING', sync_time='2024-05-28T12:59:06.380896Z', tenant_id=1, tenant_name='default', title='b7a7d61c-2cea-442a-9809-507038e080d5', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/21/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[]) May 28 12:59:06 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-12143fe7-f9cd-4e31-86a0-7430cba7f9d3 tempest-ShareIpRulesForNFSTest-1748669711 None] --- [PATCH] https://127.0.0.1:40443/api/viewpolicies/21/: Done May 28 12:59:06 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-12143fe7-f9cd-4e31-86a0-7430cba7f9d3 tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:06 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-12143fe7-f9cd-4e31-86a0-7430cba7f9d3 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:06 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-dca0d198-bc16-4c83-a07f-114b44d971e2 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] GET http://10.27.203.238/share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/shares/7437f153-7d76-48cc-8e36-107ee4e9677a May 28 12:59:06 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-dca0d198-bc16-4c83-a07f-114b44d971e2 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:06 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-dca0d198-bc16-4c83-a07f-114b44d971e2 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:06 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-dca0d198-bc16-4c83-a07f-114b44d971e2 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] http://10.27.203.238/share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/shares/7437f153-7d76-48cc-8e36-107ee4e9677a returned with HTTP 200 May 28 12:59:06 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 670/1351] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:59:06 2024] GET /share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/shares/7437f153-7d76-48cc-8e36-107ee4e9677a => generated 1367 bytes in 26 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:59:07 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-12143fe7-f9cd-4e31-86a0-7430cba7f9d3 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.054s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:07 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-12143fe7-f9cd-4e31-86a0-7430cba7f9d3 tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:07 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-12143fe7-f9cd-4e31-86a0-7430cba7f9d3 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:07 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-12143fe7-f9cd-4e31-86a0-7430cba7f9d3 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:07 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-12143fe7-f9cd-4e31-86a0-7430cba7f9d3 tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:07 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-12143fe7-f9cd-4e31-86a0-7430cba7f9d3 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:07 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-12143fe7-f9cd-4e31-86a0-7430cba7f9d3 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:07 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-12143fe7-f9cd-4e31-86a0-7430cba7f9d3 tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:07 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-12143fe7-f9cd-4e31-86a0-7430cba7f9d3 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:07 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-12143fe7-f9cd-4e31-86a0-7430cba7f9d3 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:07 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-12143fe7-f9cd-4e31-86a0-7430cba7f9d3 tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:07 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-12143fe7-f9cd-4e31-86a0-7430cba7f9d3 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:07 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-12143fe7-f9cd-4e31-86a0-7430cba7f9d3 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.039s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:07 l75lg1-v1 manila-share[98474]: INFO manila.share.access [None req-12143fe7-f9cd-4e31-86a0-7430cba7f9d3 tempest-ShareIpRulesForNFSTest-1748669711 None] Access rules were successfully modified for share instance b7a7d61c-2cea-442a-9809-507038e080d5 belonging to share 1ddadc17-cf10-4a42-8bbd-8335fb3520a1. May 28 12:59:07 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-de59a107-09cc-463a-b35a-05473944fb4f tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:59:07 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-de59a107-09cc-463a-b35a-05473944fb4f tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] [Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=1, created='2024-05-28T12:58:43.845440Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='31b6534b-d142-4561-992f-4f0759db302d', id=32, internal=False, is_s3_default_policy=False, name='7fdd602c-79d0-479c-95a2-336b202c6639', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=['*'], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=[], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=[], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T12:59:05.236408Z', tenant_id=1, tenant_name='default', title='7fdd602c-79d0-479c-95a2-336b202c6639', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/32/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[])] May 28 12:59:07 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-de59a107-09cc-463a-b35a-05473944fb4f tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 12:59:07 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-de59a107-09cc-463a-b35a-05473944fb4f tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] changing access on /manila/manila-7fdd602c-79d0-479c-95a2-336b202c6639. Rules: {'nfs_read_write': ['1.2.3.4'], 'nfs_read_only': []} May 28 12:59:07 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-de59a107-09cc-463a-b35a-05473944fb4f tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] >>> [PATCH] https://127.0.0.1:40443/api/viewpolicies/32/ May 28 12:59:07 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-de59a107-09cc-463a-b35a-05473944fb4f tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] {'data': '{"name": "7fdd602c-79d0-479c-95a2-336b202c6639", "nfs_no_squash": ' May 28 12:59:07 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-de59a107-09cc-463a-b35a-05473944fb4f tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] '["*"], "nfs_root_squash": ["*"], "nfs_read_write": ["1.2.3.4"], ' May 28 12:59:07 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-de59a107-09cc-463a-b35a-05473944fb4f tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] '"nfs_read_only": []}', May 28 12:59:07 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-de59a107-09cc-463a-b35a-05473944fb4f tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] 'params': None} May 28 12:59:07 l75lg1-v1 dstat.sh[49771]: 28-05 12:59:07| 7 1 90 1 0|5731M 1743M 277M 7873M| 17k 12k| 0 1020k| 0 121 |4228 6657 |1.17 1.06 1.01|1.0 1.0 0| 0 0 | 0 2048M| 29 361 0 31 0 May 28 12:59:07 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e33a4def-e23e-4cb3-aa95-353e32ae4440 tempest-SharesMetadataTest-1561320255 None] <<< [DELETE] https://127.0.0.1:40443/api/viewpolicies/18/ May 28 12:59:07 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e33a4def-e23e-4cb3-aa95-353e32ae4440 tempest-SharesMetadataTest-1561320255 None] --- [DELETE] https://127.0.0.1:40443/api/viewpolicies/18/: Done May 28 12:59:07 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-4d2aa8db-4a53-4d8c-a37d-2c95fc861639 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] POST http://10.27.203.238/share/v1/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action May 28 12:59:07 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-4d2aa8db-4a53-4d8c-a37d-2c95fc861639 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Action body: b'{"os-access_list": null}' {{(pid=98329) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:59:07 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-4d2aa8db-4a53-4d8c-a37d-2c95fc861639 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Action: 'action', calling method: ShareController.access_list, body: {"os-access_list": null} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:59:07 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-e33a4def-e23e-4cb3-aa95-353e32ae4440 tempest-SharesMetadataTest-1561320255 None] Created reservations ['f52d92ef-0956-4a50-9807-aee66a381522', 'db44ad7d-de94-41e7-a23f-dff85abecf32', 'f39579c2-c405-4107-bc9b-b69a838a2ad8', '61f9e54c-2121-42e3-b3e1-7ce3efbb8b09'] {{(pid=98474) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 12:59:07 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-e33a4def-e23e-4cb3-aa95-353e32ae4440 tempest-SharesMetadataTest-1561320255 None] Committed reservations ['f52d92ef-0956-4a50-9807-aee66a381522', 'db44ad7d-de94-41e7-a23f-dff85abecf32', 'f39579c2-c405-4107-bc9b-b69a838a2ad8', '61f9e54c-2121-42e3-b3e1-7ce3efbb8b09'] {{(pid=98474) commit /opt/stack/manila/manila/quota.py:1063}} May 28 12:59:07 l75lg1-v1 manila-share[98474]: INFO manila.share.manager [None req-e33a4def-e23e-4cb3-aa95-353e32ae4440 tempest-SharesMetadataTest-1561320255 None] Share instance 5a6db1ad-927e-4228-b973-3ff998e29ada: deleted successfully. May 28 12:59:07 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-4d2aa8db-4a53-4d8c-a37d-2c95fc861639 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] http://10.27.203.238/share/v1/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action returned with HTTP 200 May 28 12:59:07 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 682/1352] 10.27.203.238 () {64 vars in 1450 bytes} [Tue May 28 12:59:07 2024] POST /share/v1/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action => generated 151 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:59:07 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-4caa01fb-fd0b-400c-a509-68635696978e tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] POST http://10.27.203.238/share/v1/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action May 28 12:59:07 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-4caa01fb-fd0b-400c-a509-68635696978e tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Action body: b'{"os-deny_access": {"access_id": "c72cdeb0-b4cc-4b62-9a48-f0e59869b8e8"}}' {{(pid=98330) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:59:07 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-4caa01fb-fd0b-400c-a509-68635696978e tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Action: 'action', calling method: ShareController.deny_access, body: {"os-deny_access": {"access_id": "c72cdeb0-b4cc-4b62-9a48-f0e59869b8e8"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:59:07 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.lock.api [None req-4caa01fb-fd0b-400c-a509-68635696978e tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Searching for locks by: {'resource_id': 'c72cdeb0-b4cc-4b62-9a48-f0e59869b8e8', 'resource_action': 'delete'} {{(pid=98330) get_all /opt/stack/manila/manila/lock/api.py:112}} May 28 12:59:07 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-4caa01fb-fd0b-400c-a509-68635696978e tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:07 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-4caa01fb-fd0b-400c-a509-68635696978e tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:07 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-4caa01fb-fd0b-400c-a509-68635696978e tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.041s {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:07 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-4caa01fb-fd0b-400c-a509-68635696978e tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:07 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-4caa01fb-fd0b-400c-a509-68635696978e tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:07 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-4caa01fb-fd0b-400c-a509-68635696978e tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.057s {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:07 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-4caa01fb-fd0b-400c-a509-68635696978e tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] http://10.27.203.238/share/v1/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action returned with HTTP 202 May 28 12:59:07 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 671/1353] 10.27.203.238 () {64 vars in 1450 bytes} [Tue May 28 12:59:07 2024] POST /share/v1/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action => generated 0 bytes in 179 msecs (HTTP/1.1 202) 6 headers in 242 bytes (1 switches on core 0) May 28 12:59:07 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-ba885a84-4c59-4415-9706-72097a4f8a74 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] POST http://10.27.203.238/share/v1/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action May 28 12:59:07 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-ba885a84-4c59-4415-9706-72097a4f8a74 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Action body: b'{"os-access_list": null}' {{(pid=98329) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:59:07 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-ba885a84-4c59-4415-9706-72097a4f8a74 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Action: 'action', calling method: ShareController.access_list, body: {"os-access_list": null} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:59:07 l75lg1-v1 manila-share[98474]: DEBUG manila.share.manager [None req-4caa01fb-fd0b-400c-a509-68635696978e tempest-ShareIpRulesForNFSTest-1748669711 None] Received request to update access for share instance b7a7d61c-2cea-442a-9809-507038e080d5. {{(pid=98474) update_access_for_instances /opt/stack/manila/manila/share/manager.py:4353}} May 28 12:59:07 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-4caa01fb-fd0b-400c-a509-68635696978e tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:07 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-4caa01fb-fd0b-400c-a509-68635696978e tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:07 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-4caa01fb-fd0b-400c-a509-68635696978e tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:07 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-4caa01fb-fd0b-400c-a509-68635696978e tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:07 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-4caa01fb-fd0b-400c-a509-68635696978e tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:07 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-ba885a84-4c59-4415-9706-72097a4f8a74 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] http://10.27.203.238/share/v1/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action returned with HTTP 200 May 28 12:59:07 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 683/1354] 10.27.203.238 () {64 vars in 1450 bytes} [Tue May 28 12:59:07 2024] POST /share/v1/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action => generated 148 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:59:07 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-4caa01fb-fd0b-400c-a509-68635696978e tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.058s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:07 l75lg1-v1 manila-share[98474]: DEBUG manila.share.access [None req-4caa01fb-fd0b-400c-a509-68635696978e tempest-ShareIpRulesForNFSTest-1748669711 None] Updating access rules for share instance b7a7d61c-2cea-442a-9809-507038e080d5 belonging to share 1ddadc17-cf10-4a42-8bbd-8335fb3520a1. {{(pid=98474) update_access_rules /opt/stack/manila/manila/share/access.py:298}} May 28 12:59:07 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-4caa01fb-fd0b-400c-a509-68635696978e tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:07 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-4caa01fb-fd0b-400c-a509-68635696978e tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:07 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-4caa01fb-fd0b-400c-a509-68635696978e tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.007s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:07 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-f4c7bd86-b5de-4ec0-a368-2544672af429 tempest-PublicSharesTest-1667420263 tempest-PublicSharesTest-1667420263-project-member] GET http://10.27.203.238/share/v2/6d36e1eb1dbc449db6aca75b12a2ba18/shares/84e821d0-2b62-48db-80c7-259f61a14bac May 28 12:59:07 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-4caa01fb-fd0b-400c-a509-68635696978e tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:07 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-f4c7bd86-b5de-4ec0-a368-2544672af429 tempest-PublicSharesTest-1667420263 tempest-PublicSharesTest-1667420263-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:07 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-4caa01fb-fd0b-400c-a509-68635696978e tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:07 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-f4c7bd86-b5de-4ec0-a368-2544672af429 tempest-PublicSharesTest-1667420263 tempest-PublicSharesTest-1667420263-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:08 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-4caa01fb-fd0b-400c-a509-68635696978e tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.015s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:08 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-4caa01fb-fd0b-400c-a509-68635696978e tempest-ShareIpRulesForNFSTest-1748669711 None] changing access on None May 28 12:59:08 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-4caa01fb-fd0b-400c-a509-68635696978e tempest-ShareIpRulesForNFSTest-1748669711 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:59:08 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-4caa01fb-fd0b-400c-a509-68635696978e tempest-ShareIpRulesForNFSTest-1748669711 None] {'allow_redirects': True, May 28 12:59:08 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-4caa01fb-fd0b-400c-a509-68635696978e tempest-ShareIpRulesForNFSTest-1748669711 None] 'params': {'name': 'b7a7d61c-2cea-442a-9809-507038e080d5'}} May 28 12:59:08 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-f4c7bd86-b5de-4ec0-a368-2544672af429 tempest-PublicSharesTest-1667420263 tempest-PublicSharesTest-1667420263-project-member] http://10.27.203.238/share/v2/6d36e1eb1dbc449db6aca75b12a2ba18/shares/84e821d0-2b62-48db-80c7-259f61a14bac returned with HTTP 200 May 28 12:59:08 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 672/1355] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:59:07 2024] GET /share/v2/6d36e1eb1dbc449db6aca75b12a2ba18/shares/84e821d0-2b62-48db-80c7-259f61a14bac => generated 1320 bytes in 24 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:59:08 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-a137639c-6aed-45fd-b854-612d4e326829 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] GET http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/9e24a210-9e96-45d9-b31c-f6f3377eb0e7 May 28 12:59:08 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-a137639c-6aed-45fd-b854-612d4e326829 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:08 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-a137639c-6aed-45fd-b854-612d4e326829 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:08 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-a137639c-6aed-45fd-b854-612d4e326829 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] HTTP exception thrown: The resource could not be found. May 28 12:59:08 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-a137639c-6aed-45fd-b854-612d4e326829 tempest-SharesMetadataTest-1561320255 tempest-SharesMetadataTest-1561320255-project-member] http://10.27.203.238/share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/9e24a210-9e96-45d9-b31c-f6f3377eb0e7 returned with HTTP 404 May 28 12:59:08 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 684/1356] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:59:08 2024] GET /share/v2/698d6c02a1cc4bf2b16302eb8a31bc26/shares/9e24a210-9e96-45d9-b31c-f6f3377eb0e7 => generated 78 bytes in 12 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 12:59:08 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-2a1f30df-eda3-4c77-86cf-3b08c881b70e tempest-SharesMetadataTest-1653637154 tempest-SharesMetadataTest-1653637154-project-admin] DELETE http://10.27.203.238/share/v2/2d702e4e22be4d49a78c389a89fb56b5/types/10ddeb10-4cbf-44c0-94cd-48a1deaf7383 May 28 12:59:08 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-2a1f30df-eda3-4c77-86cf-3b08c881b70e tempest-SharesMetadataTest-1653637154 tempest-SharesMetadataTest-1653637154-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:08 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-2a1f30df-eda3-4c77-86cf-3b08c881b70e tempest-SharesMetadataTest-1653637154 tempest-SharesMetadataTest-1653637154-project-admin] Calling method 'ShareTypesController._delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:08 l75lg1-v1 dstat.sh[49771]: 28-05 12:59:08| 6 1 91 1 0|5732M 1742M 277M 7873M| 13k 735B| 0 1522k| 0 165 |3879 6593 |1.17 1.06 1.01|3.0 1.0 2.0| 0 0 | 0 2048M| 29 362 0 31 0 May 28 12:59:08 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-2a1f30df-eda3-4c77-86cf-3b08c881b70e tempest-SharesMetadataTest-1653637154 tempest-SharesMetadataTest-1653637154-project-admin] http://10.27.203.238/share/v2/2d702e4e22be4d49a78c389a89fb56b5/types/10ddeb10-4cbf-44c0-94cd-48a1deaf7383 returned with HTTP 202 May 28 12:59:08 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 673/1357] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:59:08 2024] DELETE /share/v2/2d702e4e22be4d49a78c389a89fb56b5/types/10ddeb10-4cbf-44c0-94cd-48a1deaf7383 => generated 0 bytes in 59 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:59:08 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-409f1359-b296-450a-babd-63aba5680d36 tempest-SharesMetadataTest-1653637154 tempest-SharesMetadataTest-1653637154-project-admin] GET http://10.27.203.238/share/v2/2d702e4e22be4d49a78c389a89fb56b5/types/10ddeb10-4cbf-44c0-94cd-48a1deaf7383 May 28 12:59:08 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-409f1359-b296-450a-babd-63aba5680d36 tempest-SharesMetadataTest-1653637154 tempest-SharesMetadataTest-1653637154-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:08 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-409f1359-b296-450a-babd-63aba5680d36 tempest-SharesMetadataTest-1653637154 tempest-SharesMetadataTest-1653637154-project-admin] Calling method 'ShareTypesController.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:08 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-409f1359-b296-450a-babd-63aba5680d36 tempest-SharesMetadataTest-1653637154 tempest-SharesMetadataTest-1653637154-project-admin] HTTP exception thrown: Share type not found. May 28 12:59:08 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-409f1359-b296-450a-babd-63aba5680d36 tempest-SharesMetadataTest-1653637154 tempest-SharesMetadataTest-1653637154-project-admin] http://10.27.203.238/share/v2/2d702e4e22be4d49a78c389a89fb56b5/types/10ddeb10-4cbf-44c0-94cd-48a1deaf7383 returned with HTTP 404 May 28 12:59:08 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 685/1358] 10.27.203.238 () {64 vars in 1448 bytes} [Tue May 28 12:59:08 2024] GET /share/v2/2d702e4e22be4d49a78c389a89fb56b5/types/10ddeb10-4cbf-44c0-94cd-48a1deaf7383 => generated 67 bytes in 11 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 12:59:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbcc8dc-0813-4781-aa4a-0ac761f5c09f None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-acbcc8dc-0813-4781-aa4a-0ac761f5c09f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:59:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbcc8dc-0813-4781-aa4a-0ac761f5c09f None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04de4128-576e-49bc-a378-db280ed76b59 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04de4128-576e-49bc-a378-db280ed76b59 None admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04de4128-576e-49bc-a378-db280ed76b59 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04de4128-576e-49bc-a378-db280ed76b59 None admin] PATH_INFO: `/v3/users/5cae310f9eae48e088e8afe98917a6fd` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04de4128-576e-49bc-a378-db280ed76b59 None admin] RBAC: Authorizing `identity:delete_user(user_id=5cae310f9eae48e088e8afe98917a6fd)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04de4128-576e-49bc-a378-db280ed76b59 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:08 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-4caa01fb-fd0b-400c-a509-68635696978e tempest-ShareIpRulesForNFSTest-1748669711 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:59:08 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-4caa01fb-fd0b-400c-a509-68635696978e tempest-ShareIpRulesForNFSTest-1748669711 None] [Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=1, created='2024-05-28T12:57:40.763635Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='377955ad-d094-4e49-ab32-1021d943a572', id=21, internal=False, is_s3_default_policy=False, name='b7a7d61c-2cea-442a-9809-507038e080d5', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=['*'], nfs_posix_acl=False, nfs_read_only=['2.2.2.2'], nfs_read_write=[], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=['2.2.2.2'], read_write=[], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T12:59:06.810809Z', tenant_id=1, tenant_name='default', title='b7a7d61c-2cea-442a-9809-507038e080d5', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/21/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[])] May 28 12:59:08 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-4caa01fb-fd0b-400c-a509-68635696978e tempest-ShareIpRulesForNFSTest-1748669711 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 12:59:08 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-4caa01fb-fd0b-400c-a509-68635696978e tempest-ShareIpRulesForNFSTest-1748669711 None] changing access on /manila/manila-b7a7d61c-2cea-442a-9809-507038e080d5. Rules: {'nfs_read_write': [], 'nfs_read_only': []} May 28 12:59:08 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-4caa01fb-fd0b-400c-a509-68635696978e tempest-ShareIpRulesForNFSTest-1748669711 None] >>> [PATCH] https://127.0.0.1:40443/api/viewpolicies/21/ May 28 12:59:08 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-4caa01fb-fd0b-400c-a509-68635696978e tempest-ShareIpRulesForNFSTest-1748669711 None] {'data': '{"name": "b7a7d61c-2cea-442a-9809-507038e080d5", "nfs_no_squash": ' May 28 12:59:08 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-4caa01fb-fd0b-400c-a509-68635696978e tempest-ShareIpRulesForNFSTest-1748669711 None] '["*"], "nfs_root_squash": ["*"], "nfs_read_write": [], ' May 28 12:59:08 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-4caa01fb-fd0b-400c-a509-68635696978e tempest-ShareIpRulesForNFSTest-1748669711 None] '"nfs_read_only": []}', May 28 12:59:08 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-4caa01fb-fd0b-400c-a509-68635696978e tempest-ShareIpRulesForNFSTest-1748669711 None] 'params': None} May 28 12:59:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-04de4128-576e-49bc-a378-db280ed76b59 None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5cae310f9eae48e088e8afe98917a6fd', 'request_id': 'req-04de4128-576e-49bc-a378-db280ed76b59'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-04de4128-576e-49bc-a378-db280ed76b59 None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5cae310f9eae48e088e8afe98917a6fd', 'request_id': 'req-04de4128-576e-49bc-a378-db280ed76b59'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-04de4128-576e-49bc-a378-db280ed76b59 None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5cae310f9eae48e088e8afe98917a6fd', 'request_id': 'req-04de4128-576e-49bc-a378-db280ed76b59'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-04de4128-576e-49bc-a378-db280ed76b59 None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5cae310f9eae48e088e8afe98917a6fd', 'request_id': 'req-04de4128-576e-49bc-a378-db280ed76b59'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-04de4128-576e-49bc-a378-db280ed76b59 None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5cae310f9eae48e088e8afe98917a6fd', 'request_id': 'req-04de4128-576e-49bc-a378-db280ed76b59'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:08 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1208/2390] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 12:59:08 2024] DELETE /identity/v3/users/5cae310f9eae48e088e8afe98917a6fd => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:59:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c06f42-ea5b-42b5-ace9-a52bbab29808 service manila] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c06f42-ea5b-42b5-ace9-a52bbab29808 service manila] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430cb49e-e0cc-4162-aac8-53b3737b2366 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430cb49e-e0cc-4162-aac8-53b3737b2366 None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430cb49e-e0cc-4162-aac8-53b3737b2366 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430cb49e-e0cc-4162-aac8-53b3737b2366 None admin] PATH_INFO: `/v3/users/e9171911f4cf49bf912e780367746517` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430cb49e-e0cc-4162-aac8-53b3737b2366 None admin] RBAC: Authorizing `identity:delete_user(user_id=e9171911f4cf49bf912e780367746517)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430cb49e-e0cc-4162-aac8-53b3737b2366 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-430cb49e-e0cc-4162-aac8-53b3737b2366 None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9171911f4cf49bf912e780367746517', 'request_id': 'req-430cb49e-e0cc-4162-aac8-53b3737b2366'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-430cb49e-e0cc-4162-aac8-53b3737b2366 None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9171911f4cf49bf912e780367746517', 'request_id': 'req-430cb49e-e0cc-4162-aac8-53b3737b2366'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-430cb49e-e0cc-4162-aac8-53b3737b2366 None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9171911f4cf49bf912e780367746517', 'request_id': 'req-430cb49e-e0cc-4162-aac8-53b3737b2366'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-430cb49e-e0cc-4162-aac8-53b3737b2366 None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9171911f4cf49bf912e780367746517', 'request_id': 'req-430cb49e-e0cc-4162-aac8-53b3737b2366'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-430cb49e-e0cc-4162-aac8-53b3737b2366 None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9171911f4cf49bf912e780367746517', 'request_id': 'req-430cb49e-e0cc-4162-aac8-53b3737b2366'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:08 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1183/2391] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 12:59:08 2024] DELETE /identity/v3/users/e9171911f4cf49bf912e780367746517 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:59:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04de4128-576e-49bc-a378-db280ed76b59 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-04de4128-576e-49bc-a378-db280ed76b59 None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:59:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04de4128-576e-49bc-a378-db280ed76b59 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a150c4c-6ecb-408a-beea-74c9ab144c73 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a150c4c-6ecb-408a-beea-74c9ab144c73 None admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a150c4c-6ecb-408a-beea-74c9ab144c73 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a150c4c-6ecb-408a-beea-74c9ab144c73 None admin] PATH_INFO: `/v3/users/c56458627e0c4970bd67958e52ea88bd` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a150c4c-6ecb-408a-beea-74c9ab144c73 None admin] RBAC: Authorizing `identity:delete_user(user_id=c56458627e0c4970bd67958e52ea88bd)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a150c4c-6ecb-408a-beea-74c9ab144c73 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-0a150c4c-6ecb-408a-beea-74c9ab144c73 None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c56458627e0c4970bd67958e52ea88bd', 'request_id': 'req-0a150c4c-6ecb-408a-beea-74c9ab144c73'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-0a150c4c-6ecb-408a-beea-74c9ab144c73 None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c56458627e0c4970bd67958e52ea88bd', 'request_id': 'req-0a150c4c-6ecb-408a-beea-74c9ab144c73'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-0a150c4c-6ecb-408a-beea-74c9ab144c73 None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c56458627e0c4970bd67958e52ea88bd', 'request_id': 'req-0a150c4c-6ecb-408a-beea-74c9ab144c73'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-0a150c4c-6ecb-408a-beea-74c9ab144c73 None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c56458627e0c4970bd67958e52ea88bd', 'request_id': 'req-0a150c4c-6ecb-408a-beea-74c9ab144c73'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-0a150c4c-6ecb-408a-beea-74c9ab144c73 None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c56458627e0c4970bd67958e52ea88bd', 'request_id': 'req-0a150c4c-6ecb-408a-beea-74c9ab144c73'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:08 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1209/2392] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 12:59:08 2024] DELETE /identity/v3/users/c56458627e0c4970bd67958e52ea88bd => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:59:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a52b1a-6583-4b27-9b2c-2511c279bbda None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a52b1a-6583-4b27-9b2c-2511c279bbda None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a52b1a-6583-4b27-9b2c-2511c279bbda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:08 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-40a52b1a-6583-4b27-9b2c-2511c279bbda None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:59:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-40a52b1a-6583-4b27-9b2c-2511c279bbda None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:59:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-40a52b1a-6583-4b27-9b2c-2511c279bbda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:59:08 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1184/2393] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:59:08 2024] POST /identity/v3/auth/tokens => generated 2960 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 12:59:08 l75lg1-v1 neutron-server[77619]: DEBUG neutron.wsgi [-] (77619) accepted ('10.27.203.238', 58120) {{(pid=77619) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 12:59:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a150c4c-6ecb-408a-beea-74c9ab144c73 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-0a150c4c-6ecb-408a-beea-74c9ab144c73 None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:59:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a150c4c-6ecb-408a-beea-74c9ab144c73 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57131ae1-cccd-41f2-8a82-a98dd12d3d47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef17047035e4b518fd5360a01f2da1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57131ae1-cccd-41f2-8a82-a98dd12d3d47 service neutron] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57131ae1-cccd-41f2-8a82-a98dd12d3d47 service neutron] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57131ae1-cccd-41f2-8a82-a98dd12d3d47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57131ae1-cccd-41f2-8a82-a98dd12d3d47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57131ae1-cccd-41f2-8a82-a98dd12d3d47 service neutron] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:08 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1210/2394] 10.27.203.238 () {64 vars in 1432 bytes} [Tue May 28 12:59:08 2024] GET /identity/v3/auth/tokens => generated 2960 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 28 12:59:08 l75lg1-v1 neutron-server[77619]: INFO neutron.wsgi [None req-a310100e-8806-4ecd-9d46-cd45d8673997 None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=698d6c02a1cc4bf2b16302eb8a31bc26&name=default HTTP/1.1" status: 200 len: 216 time: 0.0710268 May 28 12:59:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a52b1a-6583-4b27-9b2c-2511c279bbda None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-40a52b1a-6583-4b27-9b2c-2511c279bbda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:59:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a52b1a-6583-4b27-9b2c-2511c279bbda None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8b7e59-abb8-4a44-be07-a868e9f32d77 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8b7e59-abb8-4a44-be07-a868e9f32d77 None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8b7e59-abb8-4a44-be07-a868e9f32d77 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8b7e59-abb8-4a44-be07-a868e9f32d77 None admin] PATH_INFO: `/v3/projects/698d6c02a1cc4bf2b16302eb8a31bc26` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8b7e59-abb8-4a44-be07-a868e9f32d77 None admin] RBAC: Authorizing `identity:delete_project(project_id=698d6c02a1cc4bf2b16302eb8a31bc26)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8b7e59-abb8-4a44-be07-a868e9f32d77 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-ec8b7e59-abb8-4a44-be07-a868e9f32d77 None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '698d6c02a1cc4bf2b16302eb8a31bc26', 'request_id': 'req-ec8b7e59-abb8-4a44-be07-a868e9f32d77'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-ec8b7e59-abb8-4a44-be07-a868e9f32d77 None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '698d6c02a1cc4bf2b16302eb8a31bc26', 'request_id': 'req-ec8b7e59-abb8-4a44-be07-a868e9f32d77'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-ec8b7e59-abb8-4a44-be07-a868e9f32d77 None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '698d6c02a1cc4bf2b16302eb8a31bc26', 'request_id': 'req-ec8b7e59-abb8-4a44-be07-a868e9f32d77'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-ec8b7e59-abb8-4a44-be07-a868e9f32d77 None admin] The token cache is being invalidate because project 698d6c02a1cc4bf2b16302eb8a31bc26 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 12:59:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-ec8b7e59-abb8-4a44-be07-a868e9f32d77 None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-ec8b7e59-abb8-4a44-be07-a868e9f32d77 None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:08 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1185/2395] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 12:59:08 2024] DELETE /identity/v3/projects/698d6c02a1cc4bf2b16302eb8a31bc26 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:59:08 l75lg1-v1 neutron-server[77619]: DEBUG neutron.wsgi [-] (77619) accepted ('10.27.203.238', 58128) {{(pid=77619) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 12:59:08 l75lg1-v1 neutron-server[77619]: INFO neutron.wsgi [None req-0f498492-1472-4eec-a57c-030732270de4 None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=50673e34797a4dee8fd8c1fe56b1d6af&name=default HTTP/1.1" status: 200 len: 216 time: 0.0084221 May 28 12:59:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57131ae1-cccd-41f2-8a82-a98dd12d3d47 service neutron] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57131ae1-cccd-41f2-8a82-a98dd12d3d47 service neutron] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:08 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0ff54ac4-b262-4846-9adc-bdeb391988b0 tempest-PublicSharesTest-1667420263 None] <<< [DELETE] https://127.0.0.1:40443/api/viewpolicies/33/ May 28 12:59:08 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0ff54ac4-b262-4846-9adc-bdeb391988b0 tempest-PublicSharesTest-1667420263 None] --- [DELETE] https://127.0.0.1:40443/api/viewpolicies/33/: Done May 28 12:59:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b643e5f3-94d9-41f7-b5a1-483086839855 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b643e5f3-94d9-41f7-b5a1-483086839855 None admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b643e5f3-94d9-41f7-b5a1-483086839855 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b643e5f3-94d9-41f7-b5a1-483086839855 None admin] PATH_INFO: `/v3/projects/50673e34797a4dee8fd8c1fe56b1d6af` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b643e5f3-94d9-41f7-b5a1-483086839855 None admin] RBAC: Authorizing `identity:delete_project(project_id=50673e34797a4dee8fd8c1fe56b1d6af)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b643e5f3-94d9-41f7-b5a1-483086839855 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-b643e5f3-94d9-41f7-b5a1-483086839855 None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50673e34797a4dee8fd8c1fe56b1d6af', 'request_id': 'req-b643e5f3-94d9-41f7-b5a1-483086839855'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-b643e5f3-94d9-41f7-b5a1-483086839855 None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50673e34797a4dee8fd8c1fe56b1d6af', 'request_id': 'req-b643e5f3-94d9-41f7-b5a1-483086839855'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-b643e5f3-94d9-41f7-b5a1-483086839855 None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50673e34797a4dee8fd8c1fe56b1d6af', 'request_id': 'req-b643e5f3-94d9-41f7-b5a1-483086839855'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-b643e5f3-94d9-41f7-b5a1-483086839855 None admin] The token cache is being invalidate because project 50673e34797a4dee8fd8c1fe56b1d6af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 12:59:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-b643e5f3-94d9-41f7-b5a1-483086839855 None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-b643e5f3-94d9-41f7-b5a1-483086839855 None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:09 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1211/2396] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 12:59:08 2024] DELETE /identity/v3/projects/50673e34797a4dee8fd8c1fe56b1d6af => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:59:09 l75lg1-v1 neutron-server[77618]: DEBUG neutron.wsgi [-] (77618) accepted ('10.27.203.238', 58136) {{(pid=77618) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 12:59:09 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-0ff54ac4-b262-4846-9adc-bdeb391988b0 tempest-PublicSharesTest-1667420263 None] Created reservations ['294102e8-f858-4435-9921-0597424d5864', 'eb6fe35d-8544-4805-8c0a-66e6897f074f', '61d014d2-eb88-489b-8d98-0285d9a39c52', 'a7773d70-fc67-4b48-96ba-15c8229011a3'] {{(pid=98474) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 12:59:09 l75lg1-v1 neutron-server[77618]: INFO neutron.wsgi [None req-b2a930c0-2642-4889-925e-999be50e53c1 None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=2d702e4e22be4d49a78c389a89fb56b5&name=default HTTP/1.1" status: 200 len: 216 time: 0.0086198 May 28 12:59:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8b7e59-abb8-4a44-be07-a868e9f32d77 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-ec8b7e59-abb8-4a44-be07-a868e9f32d77 None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:59:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8b7e59-abb8-4a44-be07-a868e9f32d77 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:09 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-0ff54ac4-b262-4846-9adc-bdeb391988b0 tempest-PublicSharesTest-1667420263 None] Committed reservations ['294102e8-f858-4435-9921-0597424d5864', 'eb6fe35d-8544-4805-8c0a-66e6897f074f', '61d014d2-eb88-489b-8d98-0285d9a39c52', 'a7773d70-fc67-4b48-96ba-15c8229011a3'] {{(pid=98474) commit /opt/stack/manila/manila/quota.py:1063}} May 28 12:59:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fac2796-c6fb-4997-b34c-51efb1146e2a None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fac2796-c6fb-4997-b34c-51efb1146e2a None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fac2796-c6fb-4997-b34c-51efb1146e2a None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fac2796-c6fb-4997-b34c-51efb1146e2a None admin] PATH_INFO: `/v3/projects/2d702e4e22be4d49a78c389a89fb56b5` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fac2796-c6fb-4997-b34c-51efb1146e2a None admin] RBAC: Authorizing `identity:delete_project(project_id=2d702e4e22be4d49a78c389a89fb56b5)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fac2796-c6fb-4997-b34c-51efb1146e2a None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:09 l75lg1-v1 manila-share[98474]: INFO manila.share.manager [None req-0ff54ac4-b262-4846-9adc-bdeb391988b0 tempest-PublicSharesTest-1667420263 None] Share instance 834576a8-b0ac-4cc8-a1a0-0067a9513141: deleted successfully. May 28 12:59:09 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-de59a107-09cc-463a-b35a-05473944fb4f tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] <<< [PATCH] https://127.0.0.1:40443/api/viewpolicies/32/ May 28 12:59:09 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-de59a107-09cc-463a-b35a-05473944fb4f tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=1, created='2024-05-28T12:58:43.845440Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='31b6534b-d142-4561-992f-4f0759db302d', id=32, internal=False, is_s3_default_policy=False, name='7fdd602c-79d0-479c-95a2-336b202c6639', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=['*'], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['1.2.3.4'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['1.2.3.4'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='MODIFYING', sync_time='2024-05-28T12:59:08.513202Z', tenant_id=1, tenant_name='default', title='7fdd602c-79d0-479c-95a2-336b202c6639', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/32/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[]) May 28 12:59:09 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-de59a107-09cc-463a-b35a-05473944fb4f tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] --- [PATCH] https://127.0.0.1:40443/api/viewpolicies/32/: Done May 28 12:59:09 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-de59a107-09cc-463a-b35a-05473944fb4f tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:09 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-de59a107-09cc-463a-b35a-05473944fb4f tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-5fac2796-c6fb-4997-b34c-51efb1146e2a None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d702e4e22be4d49a78c389a89fb56b5', 'request_id': 'req-5fac2796-c6fb-4997-b34c-51efb1146e2a'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-5fac2796-c6fb-4997-b34c-51efb1146e2a None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d702e4e22be4d49a78c389a89fb56b5', 'request_id': 'req-5fac2796-c6fb-4997-b34c-51efb1146e2a'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-5fac2796-c6fb-4997-b34c-51efb1146e2a None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d702e4e22be4d49a78c389a89fb56b5', 'request_id': 'req-5fac2796-c6fb-4997-b34c-51efb1146e2a'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-5fac2796-c6fb-4997-b34c-51efb1146e2a None admin] The token cache is being invalidate because project 2d702e4e22be4d49a78c389a89fb56b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 12:59:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-5fac2796-c6fb-4997-b34c-51efb1146e2a None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-5fac2796-c6fb-4997-b34c-51efb1146e2a None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:09 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1186/2397] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 12:59:09 2024] DELETE /identity/v3/projects/2d702e4e22be4d49a78c389a89fb56b5 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:59:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b88b4ad-d9c5-4075-b7e4-e393b953b3a4 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b88b4ad-d9c5-4075-b7e4-e393b953b3a4 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b88b4ad-d9c5-4075-b7e4-e393b953b3a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:09 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-4b88b4ad-d9c5-4075-b7e4-e393b953b3a4 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:59:09 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-de59a107-09cc-463a-b35a-05473944fb4f tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.057s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:09 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-de59a107-09cc-463a-b35a-05473944fb4f tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:09 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-de59a107-09cc-463a-b35a-05473944fb4f tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:09 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-de59a107-09cc-463a-b35a-05473944fb4f tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:09 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-de59a107-09cc-463a-b35a-05473944fb4f tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:09 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-de59a107-09cc-463a-b35a-05473944fb4f tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-4b88b4ad-d9c5-4075-b7e4-e393b953b3a4 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:59:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-4b88b4ad-d9c5-4075-b7e4-e393b953b3a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:59:09 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-de59a107-09cc-463a-b35a-05473944fb4f tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:09 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-de59a107-09cc-463a-b35a-05473944fb4f tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:09 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-de59a107-09cc-463a-b35a-05473944fb4f tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:09 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1212/2398] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:59:09 2024] POST /identity/v3/auth/tokens => generated 312 bytes in 21 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 28 12:59:09 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-de59a107-09cc-463a-b35a-05473944fb4f tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:09 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-de59a107-09cc-463a-b35a-05473944fb4f tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:09 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-de59a107-09cc-463a-b35a-05473944fb4f tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513b256e-1b91-4dc7-9335-130de5b3d098 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513b256e-1b91-4dc7-9335-130de5b3d098 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513b256e-1b91-4dc7-9335-130de5b3d098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:09 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-513b256e-1b91-4dc7-9335-130de5b3d098 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:59:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-513b256e-1b91-4dc7-9335-130de5b3d098 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:59:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-513b256e-1b91-4dc7-9335-130de5b3d098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:59:09 l75lg1-v1 dstat.sh[49771]: 28-05 12:59:09| 11 2 84 4 0|5731M 1743M 277M 7873M| 14k 1123B| 0 1934k| 0 345 |7914 14k|1.17 1.06 1.01|2.0 1.0 0| 0 0 | 0 2048M| 29 362 0 34 0 May 28 12:59:09 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-de59a107-09cc-463a-b35a-05473944fb4f tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.058s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:09 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1187/2399] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:59:09 2024] POST /identity/v3/auth/tokens => generated 2960 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 12:59:09 l75lg1-v1 manila-share[98474]: INFO manila.share.access [None req-de59a107-09cc-463a-b35a-05473944fb4f tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Access rules were successfully modified for share instance 7fdd602c-79d0-479c-95a2-336b202c6639 belonging to share 72db8769-ece7-42ff-af27-2e778292a9b4. May 28 12:59:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b88b4ad-d9c5-4075-b7e4-e393b953b3a4 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b88b4ad-d9c5-4075-b7e4-e393b953b3a4 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9ae1ac-7e47-4e77-a76a-cf717656bfba None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9ae1ac-7e47-4e77-a76a-cf717656bfba None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9ae1ac-7e47-4e77-a76a-cf717656bfba None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9ae1ac-7e47-4e77-a76a-cf717656bfba None admin] PATH_INFO: `/v3/domains` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9ae1ac-7e47-4e77-a76a-cf717656bfba None admin] RBAC: Adding query filter params (name=Default) {{(pid=51267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:59:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9ae1ac-7e47-4e77-a76a-cf717656bfba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9ae1ac-7e47-4e77-a76a-cf717656bfba None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:09 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1213/2400] 10.27.203.238 () {62 vars in 1220 bytes} [Tue May 28 12:59:09 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:59:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513b256e-1b91-4dc7-9335-130de5b3d098 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513b256e-1b91-4dc7-9335-130de5b3d098 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3366928-a996-4f0d-b56b-6f120662d806 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3366928-a996-4f0d-b56b-6f120662d806 None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3366928-a996-4f0d-b56b-6f120662d806 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3366928-a996-4f0d-b56b-6f120662d806 None admin] PATH_INFO: `/v3/projects` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3366928-a996-4f0d-b56b-6f120662d806 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3366928-a996-4f0d-b56b-6f120662d806 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:09 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1188/2401] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 12:59:09 2024] POST /identity/v3/projects => generated 387 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:59:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9ae1ac-7e47-4e77-a76a-cf717656bfba None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9ae1ac-7e47-4e77-a76a-cf717656bfba None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ecd4f7-d41c-40fa-996c-68175f0eaf9d None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ecd4f7-d41c-40fa-996c-68175f0eaf9d None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ecd4f7-d41c-40fa-996c-68175f0eaf9d None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ecd4f7-d41c-40fa-996c-68175f0eaf9d None admin] PATH_INFO: `/v3/users` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ecd4f7-d41c-40fa-996c-68175f0eaf9d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ecd4f7-d41c-40fa-996c-68175f0eaf9d None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:09 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-96ecd4f7-d41c-40fa-996c-68175f0eaf9d None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 12:59:09 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1214/2402] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 12:59:09 2024] POST /identity/v3/users => generated 302 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:59:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3366928-a996-4f0d-b56b-6f120662d806 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3366928-a996-4f0d-b56b-6f120662d806 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db32c4b-1d50-454c-a264-3b3d79a524f2 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db32c4b-1d50-454c-a264-3b3d79a524f2 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db32c4b-1d50-454c-a264-3b3d79a524f2 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db32c4b-1d50-454c-a264-3b3d79a524f2 None admin] PATH_INFO: `/v3/roles` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db32c4b-1d50-454c-a264-3b3d79a524f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db32c4b-1d50-454c-a264-3b3d79a524f2 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:09 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1189/2403] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 12:59:09 2024] GET /identity/v3/roles => generated 1680 bytes in 16 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:59:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ecd4f7-d41c-40fa-996c-68175f0eaf9d None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ecd4f7-d41c-40fa-996c-68175f0eaf9d None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe11bfee-49fa-4538-b209-ac5ab7b1bdea None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe11bfee-49fa-4538-b209-ac5ab7b1bdea None admin] REQUEST_METHOD: `PUT` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe11bfee-49fa-4538-b209-ac5ab7b1bdea None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe11bfee-49fa-4538-b209-ac5ab7b1bdea None admin] PATH_INFO: `/v3/projects/87f1228e3b494ac1a895d7e6f466fa4b/users/ac6096f007544d4d84acaf218e85ceb4/roles/44620cad10ae407c90c91e2c296adb04` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe11bfee-49fa-4538-b209-ac5ab7b1bdea None admin] RBAC: Authorizing `identity:create_grant(project_id=87f1228e3b494ac1a895d7e6f466fa4b, user_id=ac6096f007544d4d84acaf218e85ceb4, role_id=44620cad10ae407c90c91e2c296adb04)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe11bfee-49fa-4538-b209-ac5ab7b1bdea None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:09 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1215/2404] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 12:59:09 2024] PUT /identity/v3/projects/87f1228e3b494ac1a895d7e6f466fa4b/users/ac6096f007544d4d84acaf218e85ceb4/roles/44620cad10ae407c90c91e2c296adb04 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:59:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2c8a66-2b28-4518-b6d2-a2662830101b None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2c8a66-2b28-4518-b6d2-a2662830101b None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2c8a66-2b28-4518-b6d2-a2662830101b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:09 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-0e2c8a66-2b28-4518-b6d2-a2662830101b None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:59:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-0e2c8a66-2b28-4518-b6d2-a2662830101b None None] MFA Rules not processed for user `ac6096f007544d4d84acaf218e85ceb4`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:59:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-0e2c8a66-2b28-4518-b6d2-a2662830101b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:59:09 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1190/2405] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:59:09 2024] POST /identity/v3/auth/tokens => generated 3958 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:59:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe11bfee-49fa-4538-b209-ac5ab7b1bdea None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe11bfee-49fa-4538-b209-ac5ab7b1bdea None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3993aef8-adbe-418c-bcc1-153ec7d4a3cd None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3993aef8-adbe-418c-bcc1-153ec7d4a3cd None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3993aef8-adbe-418c-bcc1-153ec7d4a3cd None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3993aef8-adbe-418c-bcc1-153ec7d4a3cd None admin] PATH_INFO: `/v3/projects` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3993aef8-adbe-418c-bcc1-153ec7d4a3cd None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3993aef8-adbe-418c-bcc1-153ec7d4a3cd None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:09 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1216/2406] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 12:59:09 2024] POST /identity/v3/projects => generated 383 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:59:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2c8a66-2b28-4518-b6d2-a2662830101b None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2c8a66-2b28-4518-b6d2-a2662830101b None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9e4be0-9b05-4260-a60d-bc6534f5c823 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9e4be0-9b05-4260-a60d-bc6534f5c823 None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9e4be0-9b05-4260-a60d-bc6534f5c823 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9e4be0-9b05-4260-a60d-bc6534f5c823 None admin] PATH_INFO: `/v3/users` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9e4be0-9b05-4260-a60d-bc6534f5c823 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9e4be0-9b05-4260-a60d-bc6534f5c823 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:09 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-de9e4be0-9b05-4260-a60d-bc6534f5c823 None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 12:59:09 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1191/2407] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 12:59:09 2024] POST /identity/v3/users => generated 300 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:59:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3993aef8-adbe-418c-bcc1-153ec7d4a3cd None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3993aef8-adbe-418c-bcc1-153ec7d4a3cd None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d351dd72-fa5a-4fdd-9159-228cae043e44 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d351dd72-fa5a-4fdd-9159-228cae043e44 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d351dd72-fa5a-4fdd-9159-228cae043e44 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d351dd72-fa5a-4fdd-9159-228cae043e44 None admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d351dd72-fa5a-4fdd-9159-228cae043e44 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d351dd72-fa5a-4fdd-9159-228cae043e44 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:09 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1217/2408] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 12:59:09 2024] GET /identity/v3/roles => generated 1680 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:59:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9e4be0-9b05-4260-a60d-bc6534f5c823 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9e4be0-9b05-4260-a60d-bc6534f5c823 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176107af-79e9-4bf0-b619-ee20a6e8defd None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176107af-79e9-4bf0-b619-ee20a6e8defd None admin] REQUEST_METHOD: `PUT` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176107af-79e9-4bf0-b619-ee20a6e8defd None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176107af-79e9-4bf0-b619-ee20a6e8defd None admin] PATH_INFO: `/v3/projects/7c57d03aaac8490283a91810fc80266e/users/2115eda170ff4b14bb198e46b523fb81/roles/44620cad10ae407c90c91e2c296adb04` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176107af-79e9-4bf0-b619-ee20a6e8defd None admin] RBAC: Authorizing `identity:create_grant(project_id=7c57d03aaac8490283a91810fc80266e, user_id=2115eda170ff4b14bb198e46b523fb81, role_id=44620cad10ae407c90c91e2c296adb04)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176107af-79e9-4bf0-b619-ee20a6e8defd None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:09 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-e40b2624-848a-4cf0-9e5d-489e7579a614 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] POST http://10.27.203.238/share/v1/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action May 28 12:59:09 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-e40b2624-848a-4cf0-9e5d-489e7579a614 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Action body: b'{"os-access_list": null}' {{(pid=98330) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:59:09 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-e40b2624-848a-4cf0-9e5d-489e7579a614 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Action: 'action', calling method: ShareController.access_list, body: {"os-access_list": null} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:59:09 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1192/2409] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 12:59:09 2024] PUT /identity/v3/projects/7c57d03aaac8490283a91810fc80266e/users/2115eda170ff4b14bb198e46b523fb81/roles/44620cad10ae407c90c91e2c296adb04 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:59:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee380695-640b-44c9-8264-5a6f70bf7224 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee380695-640b-44c9-8264-5a6f70bf7224 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee380695-640b-44c9-8264-5a6f70bf7224 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:09 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-ee380695-640b-44c9-8264-5a6f70bf7224 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:59:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-ee380695-640b-44c9-8264-5a6f70bf7224 None None] MFA Rules not processed for user `2115eda170ff4b14bb198e46b523fb81`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:59:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-ee380695-640b-44c9-8264-5a6f70bf7224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:59:09 l75lg1-v1 nova-conductor[83647]: DEBUG dbcounter [-] [83647] Writing DB stats nova_cell1:SELECT=5,nova_cell1:UPDATE=1 {{(pid=83647) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:59:09 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-e40b2624-848a-4cf0-9e5d-489e7579a614 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] http://10.27.203.238/share/v1/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action returned with HTTP 200 May 28 12:59:09 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 674/1359] 10.27.203.238 () {64 vars in 1450 bytes} [Tue May 28 12:59:09 2024] POST /share/v1/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action => generated 151 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:59:09 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-259794c2-cb72-4b2f-93a2-6c0fd0b73dc8 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] POST http://10.27.203.238/share/v1/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action May 28 12:59:09 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-259794c2-cb72-4b2f-93a2-6c0fd0b73dc8 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Action body: b'{"os-allow_access": {"access_type": "ip", "access_to": "1.2.3.4", "access_level": null}}' {{(pid=98329) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:59:09 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-259794c2-cb72-4b2f-93a2-6c0fd0b73dc8 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Action: 'action', calling method: ShareController.allow_access, body: {"os-allow_access": {"access_type": "ip", "access_to": "1.2.3.4", "access_level": null}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:59:09 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1218/2410] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:59:09 2024] POST /identity/v3/auth/tokens => generated 3954 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:59:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176107af-79e9-4bf0-b619-ee20a6e8defd None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176107af-79e9-4bf0-b619-ee20a6e8defd None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c29ff08-511d-40d4-aba3-75b9c58b9f03 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c29ff08-511d-40d4-aba3-75b9c58b9f03 None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c29ff08-511d-40d4-aba3-75b9c58b9f03 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c29ff08-511d-40d4-aba3-75b9c58b9f03 None admin] PATH_INFO: `/v3/projects` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c29ff08-511d-40d4-aba3-75b9c58b9f03 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c29ff08-511d-40d4-aba3-75b9c58b9f03 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:09 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-259794c2-cb72-4b2f-93a2-6c0fd0b73dc8 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] HTTP exception thrown: Share access ip:1.2.3.4 exists. May 28 12:59:09 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-259794c2-cb72-4b2f-93a2-6c0fd0b73dc8 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] http://10.27.203.238/share/v1/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action returned with HTTP 400 May 28 12:59:09 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 686/1360] 10.27.203.238 () {64 vars in 1450 bytes} [Tue May 28 12:59:09 2024] POST /share/v1/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action => generated 75 bytes in 62 msecs (HTTP/1.1 400) 6 headers in 238 bytes (1 switches on core 0) May 28 12:59:09 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-6cb7da83-796a-4f1a-a8a3-e31a2ef7f556 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] POST http://10.27.203.238/share/v1/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action May 28 12:59:09 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-6cb7da83-796a-4f1a-a8a3-e31a2ef7f556 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Action body: b'{"os-deny_access": {"access_id": "47c92444-bab4-4713-bc26-f2d3ce7b8d66"}}' {{(pid=98330) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:59:09 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-6cb7da83-796a-4f1a-a8a3-e31a2ef7f556 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Action: 'action', calling method: ShareController.deny_access, body: {"os-deny_access": {"access_id": "47c92444-bab4-4713-bc26-f2d3ce7b8d66"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:59:09 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1193/2411] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 12:59:09 2024] POST /identity/v3/projects => generated 387 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:59:09 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.lock.api [None req-6cb7da83-796a-4f1a-a8a3-e31a2ef7f556 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Searching for locks by: {'resource_id': '47c92444-bab4-4713-bc26-f2d3ce7b8d66', 'resource_action': 'delete'} {{(pid=98330) get_all /opt/stack/manila/manila/lock/api.py:112}} May 28 12:59:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee380695-640b-44c9-8264-5a6f70bf7224 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee380695-640b-44c9-8264-5a6f70bf7224 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343311fb-eedd-4f30-9cb6-50be824f1728 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343311fb-eedd-4f30-9cb6-50be824f1728 None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343311fb-eedd-4f30-9cb6-50be824f1728 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343311fb-eedd-4f30-9cb6-50be824f1728 None admin] PATH_INFO: `/v3/users` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343311fb-eedd-4f30-9cb6-50be824f1728 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343311fb-eedd-4f30-9cb6-50be824f1728 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:09 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-343311fb-eedd-4f30-9cb6-50be824f1728 None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 12:59:09 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1219/2412] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 12:59:09 2024] POST /identity/v3/users => generated 301 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:59:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c29ff08-511d-40d4-aba3-75b9c58b9f03 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c29ff08-511d-40d4-aba3-75b9c58b9f03 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7695f53c-9044-4e94-9bf2-cb91e1c4aa2b None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7695f53c-9044-4e94-9bf2-cb91e1c4aa2b None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7695f53c-9044-4e94-9bf2-cb91e1c4aa2b None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7695f53c-9044-4e94-9bf2-cb91e1c4aa2b None admin] PATH_INFO: `/v3/roles` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7695f53c-9044-4e94-9bf2-cb91e1c4aa2b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7695f53c-9044-4e94-9bf2-cb91e1c4aa2b None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:09 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-6cb7da83-796a-4f1a-a8a3-e31a2ef7f556 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:09 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-6cb7da83-796a-4f1a-a8a3-e31a2ef7f556 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:09 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1194/2413] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 12:59:09 2024] GET /identity/v3/roles => generated 1680 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:59:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343311fb-eedd-4f30-9cb6-50be824f1728 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343311fb-eedd-4f30-9cb6-50be824f1728 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcabac6-b2d4-45f4-868c-7a920cfdbd0c None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcabac6-b2d4-45f4-868c-7a920cfdbd0c None admin] REQUEST_METHOD: `PUT` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcabac6-b2d4-45f4-868c-7a920cfdbd0c None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcabac6-b2d4-45f4-868c-7a920cfdbd0c None admin] PATH_INFO: `/v3/projects/6e831d9989b1463da882ee355e32629c/users/dc37d1e963824f408d8df368c962d64f/roles/e7989893488f483baa107be56668c4f8` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcabac6-b2d4-45f4-868c-7a920cfdbd0c None admin] RBAC: Authorizing `identity:create_grant(project_id=6e831d9989b1463da882ee355e32629c, user_id=dc37d1e963824f408d8df368c962d64f, role_id=e7989893488f483baa107be56668c4f8)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcabac6-b2d4-45f4-868c-7a920cfdbd0c None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:09 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-6cb7da83-796a-4f1a-a8a3-e31a2ef7f556 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.052s {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:09 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-6cb7da83-796a-4f1a-a8a3-e31a2ef7f556 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:09 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-6cb7da83-796a-4f1a-a8a3-e31a2ef7f556 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:09 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1220/2414] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 12:59:09 2024] PUT /identity/v3/projects/6e831d9989b1463da882ee355e32629c/users/dc37d1e963824f408d8df368c962d64f/roles/e7989893488f483baa107be56668c4f8 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:59:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7695f53c-9044-4e94-9bf2-cb91e1c4aa2b None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7695f53c-9044-4e94-9bf2-cb91e1c4aa2b None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:10 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-75dc02d3-b6e0-4da4-a86c-5db5f8f66a50 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] GET http://10.27.203.238/share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/messages May 28 12:59:10 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-75dc02d3-b6e0-4da4-a86c-5db5f8f66a50 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:10 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-75dc02d3-b6e0-4da4-a86c-5db5f8f66a50 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:10 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.message.api [None req-75dc02d3-b6e0-4da4-a86c-5db5f8f66a50 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Searching for messages by: MultiDict([]) {{(pid=98329) get_all /opt/stack/manila/manila/message/api.py:78}} May 28 12:59:10 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-75dc02d3-b6e0-4da4-a86c-5db5f8f66a50 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] http://10.27.203.238/share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/messages returned with HTTP 200 May 28 12:59:10 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 687/1361] 10.27.203.238 () {64 vars in 1346 bytes} [Tue May 28 12:59:09 2024] GET /share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/messages => generated 1616 bytes in 14 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:59:10 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-91883ce6-abd0-4264-b3e2-0828794a3e42 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] DELETE http://10.27.203.238/share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/messages/8bfad895-7297-43e4-a0dc-925025cdb7b1 May 28 12:59:10 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-91883ce6-abd0-4264-b3e2-0828794a3e42 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:10 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-91883ce6-abd0-4264-b3e2-0828794a3e42 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:10 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1154b3be-889a-4207-9ef0-0e59ae8591b3 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:10 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1154b3be-889a-4207-9ef0-0e59ae8591b3 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:10 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1154b3be-889a-4207-9ef0-0e59ae8591b3 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:10 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1154b3be-889a-4207-9ef0-0e59ae8591b3 None admin] PATH_INFO: `/v3/roles` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:10 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1154b3be-889a-4207-9ef0-0e59ae8591b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:10 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1154b3be-889a-4207-9ef0-0e59ae8591b3 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:10 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1195/2415] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 12:59:09 2024] GET /identity/v3/roles => generated 1680 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:59:10 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-91883ce6-abd0-4264-b3e2-0828794a3e42 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] http://10.27.203.238/share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/messages/8bfad895-7297-43e4-a0dc-925025cdb7b1 returned with HTTP 204 May 28 12:59:10 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 688/1362] 10.27.203.238 () {64 vars in 1460 bytes} [Tue May 28 12:59:10 2024] DELETE /share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/messages/8bfad895-7297-43e4-a0dc-925025cdb7b1 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 6 headers in 245 bytes (1 switches on core 0) May 28 12:59:10 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcabac6-b2d4-45f4-868c-7a920cfdbd0c None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:10 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-6516e49b-53b6-42fd-a665-ba19670405bd tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] GET http://10.27.203.238/share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/messages/8bfad895-7297-43e4-a0dc-925025cdb7b1 May 28 12:59:10 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-6cb7da83-796a-4f1a-a8a3-e31a2ef7f556 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.072s {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:10 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-6516e49b-53b6-42fd-a665-ba19670405bd tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:10 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-6516e49b-53b6-42fd-a665-ba19670405bd tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:10 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcabac6-b2d4-45f4-868c-7a920cfdbd0c None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:10 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-6cb7da83-796a-4f1a-a8a3-e31a2ef7f556 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] http://10.27.203.238/share/v1/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action returned with HTTP 202 May 28 12:59:10 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 675/1363] 10.27.203.238 () {64 vars in 1450 bytes} [Tue May 28 12:59:09 2024] POST /share/v1/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action => generated 0 bytes in 217 msecs (HTTP/1.1 202) 6 headers in 242 bytes (1 switches on core 0) May 28 12:59:10 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f678d9-44e0-47a2-ae93-22de017447e6 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:10 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f678d9-44e0-47a2-ae93-22de017447e6 None admin] REQUEST_METHOD: `PUT` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:10 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-6516e49b-53b6-42fd-a665-ba19670405bd tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] HTTP exception thrown: Message 8bfad895-7297-43e4-a0dc-925025cdb7b1 could not be found. May 28 12:59:10 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f678d9-44e0-47a2-ae93-22de017447e6 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:10 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-6516e49b-53b6-42fd-a665-ba19670405bd tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] http://10.27.203.238/share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/messages/8bfad895-7297-43e4-a0dc-925025cdb7b1 returned with HTTP 404 May 28 12:59:10 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f678d9-44e0-47a2-ae93-22de017447e6 None admin] PATH_INFO: `/v3/projects/6e831d9989b1463da882ee355e32629c/users/dc37d1e963824f408d8df368c962d64f/roles/e7989893488f483baa107be56668c4f8` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:10 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 689/1364] 10.27.203.238 () {64 vars in 1457 bytes} [Tue May 28 12:59:10 2024] GET /share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/messages/8bfad895-7297-43e4-a0dc-925025cdb7b1 => generated 110 bytes in 10 msecs (HTTP/1.1 404) 6 headers in 238 bytes (2 switches on core 0) May 28 12:59:10 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f678d9-44e0-47a2-ae93-22de017447e6 None admin] RBAC: Authorizing `identity:create_grant(project_id=6e831d9989b1463da882ee355e32629c, user_id=dc37d1e963824f408d8df368c962d64f, role_id=e7989893488f483baa107be56668c4f8)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:10 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f678d9-44e0-47a2-ae93-22de017447e6 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:10 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-d7dea460-c920-4925-b678-6eae0375e696 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] POST http://10.27.203.238/share/v1/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action May 28 12:59:10 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-d7dea460-c920-4925-b678-6eae0375e696 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Action body: b'{"os-access_list": null}' {{(pid=98330) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:59:10 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-d7dea460-c920-4925-b678-6eae0375e696 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Action: 'action', calling method: ShareController.access_list, body: {"os-access_list": null} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:59:10 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-7475fbed-4cf7-42eb-97f0-468dd08555dd tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] DELETE http://10.27.203.238/share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/shares/7437f153-7d76-48cc-8e36-107ee4e9677a May 28 12:59:10 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-7475fbed-4cf7-42eb-97f0-468dd08555dd tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:10 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-7475fbed-4cf7-42eb-97f0-468dd08555dd tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Calling method 'ShareMixin.delete' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:10 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.v1.shares [None req-7475fbed-4cf7-42eb-97f0-468dd08555dd tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Delete share with id: 7437f153-7d76-48cc-8e36-107ee4e9677a May 28 12:59:10 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1221/2416] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 12:59:10 2024] PUT /identity/v3/projects/6e831d9989b1463da882ee355e32629c/users/dc37d1e963824f408d8df368c962d64f/roles/e7989893488f483baa107be56668c4f8 => generated 0 bytes in 23 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:59:10 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badef2c5-adda-41b4-b36d-4efae0f5761d None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:10 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badef2c5-adda-41b4-b36d-4efae0f5761d None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:10 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badef2c5-adda-41b4-b36d-4efae0f5761d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:10 l75lg1-v1 manila-share[98474]: DEBUG manila.share.manager [None req-6cb7da83-796a-4f1a-a8a3-e31a2ef7f556 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Received request to update access for share instance 7fdd602c-79d0-479c-95a2-336b202c6639. {{(pid=98474) update_access_for_instances /opt/stack/manila/manila/share/manager.py:4353}} May 28 12:59:10 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-badef2c5-adda-41b4-b36d-4efae0f5761d None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:59:10 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-6cb7da83-796a-4f1a-a8a3-e31a2ef7f556 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:10 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-6cb7da83-796a-4f1a-a8a3-e31a2ef7f556 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:10 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-badef2c5-adda-41b4-b36d-4efae0f5761d None None] MFA Rules not processed for user `dc37d1e963824f408d8df368c962d64f`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:59:10 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-badef2c5-adda-41b4-b36d-4efae0f5761d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:59:10 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-6cb7da83-796a-4f1a-a8a3-e31a2ef7f556 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:10 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-6cb7da83-796a-4f1a-a8a3-e31a2ef7f556 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:10 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-6cb7da83-796a-4f1a-a8a3-e31a2ef7f556 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:10 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-d7dea460-c920-4925-b678-6eae0375e696 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] http://10.27.203.238/share/v1/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action returned with HTTP 200 May 28 12:59:10 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 676/1365] 10.27.203.238 () {64 vars in 1450 bytes} [Tue May 28 12:59:10 2024] POST /share/v1/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action => generated 148 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 230 bytes (2 switches on core 0) May 28 12:59:10 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-6cb7da83-796a-4f1a-a8a3-e31a2ef7f556 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.052s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:10 l75lg1-v1 manila-share[98474]: DEBUG manila.share.access [None req-6cb7da83-796a-4f1a-a8a3-e31a2ef7f556 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Updating access rules for share instance 7fdd602c-79d0-479c-95a2-336b202c6639 belonging to share 72db8769-ece7-42ff-af27-2e778292a9b4. {{(pid=98474) update_access_rules /opt/stack/manila/manila/share/access.py:298}} May 28 12:59:10 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-6cb7da83-796a-4f1a-a8a3-e31a2ef7f556 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:10 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-6cb7da83-796a-4f1a-a8a3-e31a2ef7f556 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:10 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-6cb7da83-796a-4f1a-a8a3-e31a2ef7f556 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.008s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:10 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-6cb7da83-796a-4f1a-a8a3-e31a2ef7f556 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:10 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-6cb7da83-796a-4f1a-a8a3-e31a2ef7f556 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:10 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1196/2417] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:59:10 2024] POST /identity/v3/auth/tokens => generated 4081 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:59:10 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-6cb7da83-796a-4f1a-a8a3-e31a2ef7f556 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.014s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:10 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-6cb7da83-796a-4f1a-a8a3-e31a2ef7f556 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] changing access on None May 28 12:59:10 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-6cb7da83-796a-4f1a-a8a3-e31a2ef7f556 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:59:10 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-6cb7da83-796a-4f1a-a8a3-e31a2ef7f556 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] {'allow_redirects': True, May 28 12:59:10 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-6cb7da83-796a-4f1a-a8a3-e31a2ef7f556 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] 'params': {'name': '7fdd602c-79d0-479c-95a2-336b202c6639'}} May 28 12:59:10 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f678d9-44e0-47a2-ae93-22de017447e6 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:10 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f678d9-44e0-47a2-ae93-22de017447e6 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:10 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea574c0-c5a3-4bfe-a814-b54d1d6daf51 tempest-PublicSharesNegativeTest-1466961720 tempest-PublicSharesNegativeTest-1466961720-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc37d1e963824f408d8df368c962d64f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e831d9989b1463da882ee355e32629c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:10 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea574c0-c5a3-4bfe-a814-b54d1d6daf51 tempest-PublicSharesNegativeTest-1466961720 tempest-PublicSharesNegativeTest-1466961720-project-admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:10 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea574c0-c5a3-4bfe-a814-b54d1d6daf51 tempest-PublicSharesNegativeTest-1466961720 tempest-PublicSharesNegativeTest-1466961720-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:10 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea574c0-c5a3-4bfe-a814-b54d1d6daf51 tempest-PublicSharesNegativeTest-1466961720 tempest-PublicSharesNegativeTest-1466961720-project-admin] PATH_INFO: `/v3/domains` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:10 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea574c0-c5a3-4bfe-a814-b54d1d6daf51 tempest-PublicSharesNegativeTest-1466961720 tempest-PublicSharesNegativeTest-1466961720-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=51267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:59:10 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea574c0-c5a3-4bfe-a814-b54d1d6daf51 tempest-PublicSharesNegativeTest-1466961720 tempest-PublicSharesNegativeTest-1466961720-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:10 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea574c0-c5a3-4bfe-a814-b54d1d6daf51 tempest-PublicSharesNegativeTest-1466961720 tempest-PublicSharesNegativeTest-1466961720-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:10 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1222/2418] 10.27.203.238 () {62 vars in 1241 bytes} [Tue May 28 12:59:10 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:59:10 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badef2c5-adda-41b4-b36d-4efae0f5761d None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:10 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badef2c5-adda-41b4-b36d-4efae0f5761d None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:10 l75lg1-v1 dstat.sh[49771]: 28-05 12:59:10| 17 2 77 3 0|5733M 1741M 277M 7874M|9988B 670B| 0 2580k| 0 345 |9046 16k|1.17 1.06 1.01|4.0 1.0 0| 0 0 | 0 2048M| 29 363 0 35 0 May 28 12:59:10 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ba38fd-5a33-4728-84d0-9d51ea150e03 tempest-PublicSharesNegativeTest-1466961720 tempest-PublicSharesNegativeTest-1466961720-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc37d1e963824f408d8df368c962d64f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e831d9989b1463da882ee355e32629c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:10 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ba38fd-5a33-4728-84d0-9d51ea150e03 tempest-PublicSharesNegativeTest-1466961720 tempest-PublicSharesNegativeTest-1466961720-project-admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:10 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ba38fd-5a33-4728-84d0-9d51ea150e03 tempest-PublicSharesNegativeTest-1466961720 tempest-PublicSharesNegativeTest-1466961720-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:10 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ba38fd-5a33-4728-84d0-9d51ea150e03 tempest-PublicSharesNegativeTest-1466961720 tempest-PublicSharesNegativeTest-1466961720-project-admin] PATH_INFO: `/v3/users` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:10 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ba38fd-5a33-4728-84d0-9d51ea150e03 tempest-PublicSharesNegativeTest-1466961720 tempest-PublicSharesNegativeTest-1466961720-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:10 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ba38fd-5a33-4728-84d0-9d51ea150e03 tempest-PublicSharesNegativeTest-1466961720 tempest-PublicSharesNegativeTest-1466961720-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:10 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-38ba38fd-5a33-4728-84d0-9d51ea150e03 tempest-PublicSharesNegativeTest-1466961720 tempest-PublicSharesNegativeTest-1466961720-project-admin] Truncating password to algorithm specific maximum length 72 characters. May 28 12:59:10 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.quota [None req-7475fbed-4cf7-42eb-97f0-468dd08555dd tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Created reservations ['17b1e9f1-edea-4f91-9a17-95eeaf156fd6', '3a0b43f3-c5c1-4f6f-8529-a3c32c8bb9b8', 'df086ba8-d34a-49da-a50e-cc646d0c9d07', 'c4e1fe38-ded0-4478-be39-5d3126806ba5'] {{(pid=98329) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 12:59:10 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1197/2419] 10.27.203.238 () {64 vars in 1232 bytes} [Tue May 28 12:59:10 2024] POST /identity/v3/users => generated 435 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:59:10 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea574c0-c5a3-4bfe-a814-b54d1d6daf51 tempest-PublicSharesNegativeTest-1466961720 tempest-PublicSharesNegativeTest-1466961720-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:10 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea574c0-c5a3-4bfe-a814-b54d1d6daf51 tempest-PublicSharesNegativeTest-1466961720 tempest-PublicSharesNegativeTest-1466961720-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:10 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347c0385-c684-471b-aadf-59b099b9f4ad tempest-PublicSharesNegativeTest-1466961720 tempest-PublicSharesNegativeTest-1466961720-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc37d1e963824f408d8df368c962d64f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e831d9989b1463da882ee355e32629c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:10 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347c0385-c684-471b-aadf-59b099b9f4ad tempest-PublicSharesNegativeTest-1466961720 tempest-PublicSharesNegativeTest-1466961720-project-admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:10 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347c0385-c684-471b-aadf-59b099b9f4ad tempest-PublicSharesNegativeTest-1466961720 tempest-PublicSharesNegativeTest-1466961720-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:10 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347c0385-c684-471b-aadf-59b099b9f4ad tempest-PublicSharesNegativeTest-1466961720 tempest-PublicSharesNegativeTest-1466961720-project-admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:10 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347c0385-c684-471b-aadf-59b099b9f4ad tempest-PublicSharesNegativeTest-1466961720 tempest-PublicSharesNegativeTest-1466961720-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:10 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347c0385-c684-471b-aadf-59b099b9f4ad tempest-PublicSharesNegativeTest-1466961720 tempest-PublicSharesNegativeTest-1466961720-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:10 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1223/2420] 10.27.203.238 () {62 vars in 1210 bytes} [Tue May 28 12:59:10 2024] GET /identity/v3/roles => generated 1680 bytes in 17 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:59:10 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ba38fd-5a33-4728-84d0-9d51ea150e03 tempest-PublicSharesNegativeTest-1466961720 tempest-PublicSharesNegativeTest-1466961720-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:10 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ba38fd-5a33-4728-84d0-9d51ea150e03 tempest-PublicSharesNegativeTest-1466961720 tempest-PublicSharesNegativeTest-1466961720-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:10 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f461b40-a8a2-4a02-a406-bb85754c6c56 tempest-PublicSharesNegativeTest-1466961720 tempest-PublicSharesNegativeTest-1466961720-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc37d1e963824f408d8df368c962d64f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e831d9989b1463da882ee355e32629c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:10 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f461b40-a8a2-4a02-a406-bb85754c6c56 tempest-PublicSharesNegativeTest-1466961720 tempest-PublicSharesNegativeTest-1466961720-project-admin] REQUEST_METHOD: `PUT` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:10 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f461b40-a8a2-4a02-a406-bb85754c6c56 tempest-PublicSharesNegativeTest-1466961720 tempest-PublicSharesNegativeTest-1466961720-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:10 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f461b40-a8a2-4a02-a406-bb85754c6c56 tempest-PublicSharesNegativeTest-1466961720 tempest-PublicSharesNegativeTest-1466961720-project-admin] PATH_INFO: `/v3/projects/6e831d9989b1463da882ee355e32629c/users/9d3788d7291b4ee389136f181e35a26b/roles/44620cad10ae407c90c91e2c296adb04` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:10 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f461b40-a8a2-4a02-a406-bb85754c6c56 tempest-PublicSharesNegativeTest-1466961720 tempest-PublicSharesNegativeTest-1466961720-project-admin] RBAC: Authorizing `identity:create_grant(project_id=6e831d9989b1463da882ee355e32629c, user_id=9d3788d7291b4ee389136f181e35a26b, role_id=44620cad10ae407c90c91e2c296adb04)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:10 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.quota [None req-7475fbed-4cf7-42eb-97f0-468dd08555dd tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Committed reservations ['17b1e9f1-edea-4f91-9a17-95eeaf156fd6', '3a0b43f3-c5c1-4f6f-8529-a3c32c8bb9b8', 'df086ba8-d34a-49da-a50e-cc646d0c9d07', 'c4e1fe38-ded0-4478-be39-5d3126806ba5'] {{(pid=98329) commit /opt/stack/manila/manila/quota.py:1063}} May 28 12:59:10 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f461b40-a8a2-4a02-a406-bb85754c6c56 tempest-PublicSharesNegativeTest-1466961720 tempest-PublicSharesNegativeTest-1466961720-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:10 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-7475fbed-4cf7-42eb-97f0-468dd08555dd tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] http://10.27.203.238/share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/shares/7437f153-7d76-48cc-8e36-107ee4e9677a returned with HTTP 202 May 28 12:59:10 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 690/1366] 10.27.203.238 () {64 vars in 1454 bytes} [Tue May 28 12:59:10 2024] DELETE /share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/shares/7437f153-7d76-48cc-8e36-107ee4e9677a => generated 0 bytes in 281 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:59:10 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1198/2421] 10.27.203.238 () {64 vars in 1571 bytes} [Tue May 28 12:59:10 2024] PUT /identity/v3/projects/6e831d9989b1463da882ee355e32629c/users/9d3788d7291b4ee389136f181e35a26b/roles/44620cad10ae407c90c91e2c296adb04 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:59:10 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-d9a29417-4093-48f4-a3f1-15cdd83fc802 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] POST http://10.27.203.238/share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/types May 28 12:59:10 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-d9a29417-4093-48f4-a3f1-15cdd83fc802 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share_type": {"name": "tempest-share-type-796254952", "extra_specs": {"driver_handles_share_servers": false, "vendor_name": "foobar"}, "share_type_access:is_public": true}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:59:10 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347c0385-c684-471b-aadf-59b099b9f4ad tempest-PublicSharesNegativeTest-1466961720 tempest-PublicSharesNegativeTest-1466961720-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:10 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-347c0385-c684-471b-aadf-59b099b9f4ad tempest-PublicSharesNegativeTest-1466961720 tempest-PublicSharesNegativeTest-1466961720-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:59:10 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-d9a29417-4093-48f4-a3f1-15cdd83fc802 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] http://10.27.203.238/share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/types returned with HTTP 200 May 28 12:59:10 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 677/1367] 10.27.203.238 () {66 vars in 1359 bytes} [Tue May 28 12:59:10 2024] POST /share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/types => generated 659 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:59:10 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-8ba17d49-1611-4810-8f82-0182132697d4 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] POST http://10.27.203.238/share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/shares May 28 12:59:10 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-8ba17d49-1611-4810-8f82-0182132697d4 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share": {"share_proto": "nfs", "description": "tempest-tempest-created-share-desc-1730726789", "snapshot_id": null, "name": "tempest-tempest-created-share-928386902", "size": 1, "metadata": {}, "is_public": false, "share_type": "18edbb09-6fa2-4d1c-9f7d-775877d3261f"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:59:10 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.v1.shares [None req-8ba17d49-1611-4810-8f82-0182132697d4 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Create NFS share of 1 GB May 28 12:59:10 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347c0385-c684-471b-aadf-59b099b9f4ad tempest-PublicSharesNegativeTest-1466961720 tempest-PublicSharesNegativeTest-1466961720-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:10 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e83399-3d1a-418c-985f-49d77f9868e3 service manila] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f110cf6300f049c897d0aab63218d1e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:10 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e83399-3d1a-418c-985f-49d77f9868e3 service manila] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:10 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e83399-3d1a-418c-985f-49d77f9868e3 service manila] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:10 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e83399-3d1a-418c-985f-49d77f9868e3 service manila] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:10 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.quota [None req-8ba17d49-1611-4810-8f82-0182132697d4 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Created reservations ['26570ec4-397b-40fa-9473-8655fb252bb7', '3cb45dbc-d0d8-4398-b3e6-ef559fd912a9', 'e1569f63-74e3-4163-9766-8ed624779e95', '23cee753-b200-46a3-84bf-430e1a482925'] {{(pid=98330) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 12:59:10 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e83399-3d1a-418c-985f-49d77f9868e3 service manila] RBAC: Authorizing `identity:validate_token()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:10 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e83399-3d1a-418c-985f-49d77f9868e3 service manila] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:10 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1224/2422] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 12:59:10 2024] GET /identity/v3/auth/tokens => generated 4081 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 12:59:10 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-320b0223-0428-4d03-a0fc-3aa781fcc12f tempest-PublicSharesNegativeTest-1466961720 tempest-PublicSharesNegativeTest-1466961720-project-admin] POST http://10.27.203.238/share/v2/6e831d9989b1463da882ee355e32629c/types May 28 12:59:10 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-320b0223-0428-4d03-a0fc-3aa781fcc12f tempest-PublicSharesNegativeTest-1466961720 tempest-PublicSharesNegativeTest-1466961720-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share_type": {"name": "tempest-typeshare-type-847875930", "extra_specs": {"driver_handles_share_servers": "False"}, "share_type_access:is_public": true}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:59:10 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.quota [None req-8ba17d49-1611-4810-8f82-0182132697d4 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Committed reservations ['26570ec4-397b-40fa-9473-8655fb252bb7', '3cb45dbc-d0d8-4398-b3e6-ef559fd912a9', 'e1569f63-74e3-4163-9766-8ed624779e95', '23cee753-b200-46a3-84bf-430e1a482925'] {{(pid=98330) commit /opt/stack/manila/manila/quota.py:1063}} May 28 12:59:10 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-320b0223-0428-4d03-a0fc-3aa781fcc12f tempest-PublicSharesNegativeTest-1466961720 tempest-PublicSharesNegativeTest-1466961720-project-admin] http://10.27.203.238/share/v2/6e831d9989b1463da882ee355e32629c/types returned with HTTP 200 May 28 12:59:10 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 691/1368] 10.27.203.238 () {66 vars in 1359 bytes} [Tue May 28 12:59:10 2024] POST /share/v2/6e831d9989b1463da882ee355e32629c/types => generated 621 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:59:10 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-2603d0ce-3d3e-4ccc-ba4b-fecd694a3f11 tempest-PublicSharesNegativeTest-1466961720 tempest-PublicSharesNegativeTest-1466961720-project-admin] POST http://10.27.203.238/share/v2/6e831d9989b1463da882ee355e32629c/shares May 28 12:59:10 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-2603d0ce-3d3e-4ccc-ba4b-fecd694a3f11 tempest-PublicSharesNegativeTest-1466961720 tempest-PublicSharesNegativeTest-1466961720-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share": {"share_proto": "nfs", "description": "public_share_desc", "snapshot_id": null, "name": "public_share", "size": 1, "metadata": {"key": "value"}, "is_public": true, "share_type": "6f6c32d7-68c2-4369-a308-7bdbd4653be4"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:59:10 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.v1.shares [None req-2603d0ce-3d3e-4ccc-ba4b-fecd694a3f11 tempest-PublicSharesNegativeTest-1466961720 tempest-PublicSharesNegativeTest-1466961720-project-admin] Create NFS share of 1 GB May 28 12:59:10 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-4caa01fb-fd0b-400c-a509-68635696978e tempest-ShareIpRulesForNFSTest-1748669711 None] <<< [PATCH] https://127.0.0.1:40443/api/viewpolicies/21/ May 28 12:59:10 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-4caa01fb-fd0b-400c-a509-68635696978e tempest-ShareIpRulesForNFSTest-1748669711 None] Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=1, created='2024-05-28T12:57:40.763635Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='377955ad-d094-4e49-ab32-1021d943a572', id=21, internal=False, is_s3_default_policy=False, name='b7a7d61c-2cea-442a-9809-507038e080d5', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=['*'], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=[], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=[], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='MODIFYING', sync_time='2024-05-28T12:59:09.576719Z', tenant_id=1, tenant_name='default', title='b7a7d61c-2cea-442a-9809-507038e080d5', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/21/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[]) May 28 12:59:10 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-4caa01fb-fd0b-400c-a509-68635696978e tempest-ShareIpRulesForNFSTest-1748669711 None] --- [PATCH] https://127.0.0.1:40443/api/viewpolicies/21/: Done May 28 12:59:10 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-4caa01fb-fd0b-400c-a509-68635696978e tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:10 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-4caa01fb-fd0b-400c-a509-68635696978e tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:10 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.host_manager [None req-8ba17d49-1611-4810-8f82-0182132697d4 tempest-UserMessageTest-1084663522 None] Share service is down. (host: l75lg1-v1@generic2). May 28 12:59:10 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.host_manager [None req-8ba17d49-1611-4810-8f82-0182132697d4 tempest-UserMessageTest-1084663522 None] Share service is down. (host: l75lg1-v1@generic1). May 28 12:59:10 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-8ba17d49-1611-4810-8f82-0182132697d4 tempest-UserMessageTest-1084663522 None] Starting with 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:80}} May 28 12:59:10 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-8ba17d49-1611-4810-8f82-0182132697d4 tempest-UserMessageTest-1084663522 None] Filter OnlyHostFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:59:10 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-8ba17d49-1611-4810-8f82-0182132697d4 tempest-UserMessageTest-1084663522 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:59:10 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.capacity [None req-8ba17d49-1611-4810-8f82-0182132697d4 tempest-UserMessageTest-1084663522 None] Space information for share creation on host l75lg1-v1@vast#vast (requested / avail): 1/2081 {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/capacity.py:83}} May 28 12:59:10 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-8ba17d49-1611-4810-8f82-0182132697d4 tempest-UserMessageTest-1084663522 None] Filter CapacityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:59:10 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.utils [None req-8ba17d49-1611-4810-8f82-0182132697d4 tempest-UserMessageTest-1084663522 None] Share type extra spec requirement "vendor_name=foobar" does not match reported capability "VAST STORAGE" {{(pid=98327) capabilities_satisfied /opt/stack/manila/manila/scheduler/utils.py:185}} May 28 12:59:10 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.capabilities [None req-8ba17d49-1611-4810-8f82-0182132697d4 tempest-UserMessageTest-1084663522 None] host: 'l75lg1-v1@vast#vast', free_capacity_gb: 2081.64910808485, pools: None fails resource_type extra_specs requirements {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/capabilities.py:45}} May 28 12:59:10 l75lg1-v1 manila-scheduler[98327]: INFO manila.scheduler.filters.base [None req-8ba17d49-1611-4810-8f82-0182132697d4 tempest-UserMessageTest-1084663522 None] Filter CapabilitiesFilter returned 0 host(s) May 28 12:59:10 l75lg1-v1 manila-scheduler[98327]: ERROR manila.scheduler.manager [None req-8ba17d49-1611-4810-8f82-0182132697d4 tempest-UserMessageTest-1084663522 None] Failed to schedule create_share: No valid host was found. Failed to find a weighted host, the last executed filter was CapabilitiesFilter.: manila.exception.NoValidHost: No valid host was found. Failed to find a weighted host, the last executed filter was CapabilitiesFilter. May 28 12:59:10 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-8ba17d49-1611-4810-8f82-0182132697d4 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] http://10.27.203.238/share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/shares returned with HTTP 200 May 28 12:59:10 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 678/1369] 10.27.203.238 () {66 vars in 1362 bytes} [Tue May 28 12:59:10 2024] POST /share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/shares => generated 1370 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 232 bytes (2 switches on core 0) May 28 12:59:10 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-6cb7da83-796a-4f1a-a8a3-e31a2ef7f556 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:59:10 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-6cb7da83-796a-4f1a-a8a3-e31a2ef7f556 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] [Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=1, created='2024-05-28T12:58:43.845440Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='31b6534b-d142-4561-992f-4f0759db302d', id=32, internal=False, is_s3_default_policy=False, name='7fdd602c-79d0-479c-95a2-336b202c6639', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=['*'], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['1.2.3.4'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['1.2.3.4'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T12:59:09.005359Z', tenant_id=1, tenant_name='default', title='7fdd602c-79d0-479c-95a2-336b202c6639', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/32/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[])] May 28 12:59:10 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-6cb7da83-796a-4f1a-a8a3-e31a2ef7f556 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 12:59:10 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-6cb7da83-796a-4f1a-a8a3-e31a2ef7f556 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] changing access on /manila/manila-7fdd602c-79d0-479c-95a2-336b202c6639. Rules: {'nfs_read_write': [], 'nfs_read_only': []} May 28 12:59:10 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-6cb7da83-796a-4f1a-a8a3-e31a2ef7f556 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] >>> [PATCH] https://127.0.0.1:40443/api/viewpolicies/32/ May 28 12:59:10 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-6cb7da83-796a-4f1a-a8a3-e31a2ef7f556 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] {'data': '{"name": "7fdd602c-79d0-479c-95a2-336b202c6639", "nfs_no_squash": ' May 28 12:59:10 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-6cb7da83-796a-4f1a-a8a3-e31a2ef7f556 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] '["*"], "nfs_root_squash": ["*"], "nfs_read_write": [], ' May 28 12:59:10 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-6cb7da83-796a-4f1a-a8a3-e31a2ef7f556 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] '"nfs_read_only": []}', May 28 12:59:10 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-6cb7da83-796a-4f1a-a8a3-e31a2ef7f556 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] 'params': None} May 28 12:59:10 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-4caa01fb-fd0b-400c-a509-68635696978e tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.033s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:10 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-4caa01fb-fd0b-400c-a509-68635696978e tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:10 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-4caa01fb-fd0b-400c-a509-68635696978e tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:10 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-e8a76bbc-dab0-4495-9514-576e11684ece tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] GET http://10.27.203.238/share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/shares/ee66b05f-c433-47ec-899b-b6c21c117e1d May 28 12:59:10 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-e8a76bbc-dab0-4495-9514-576e11684ece tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:10 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-e8a76bbc-dab0-4495-9514-576e11684ece tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:10 l75lg1-v1 manila-scheduler[98327]: INFO manila.message.api [None req-8ba17d49-1611-4810-8f82-0182132697d4 tempest-UserMessageTest-1084663522 None] Creating message record for request_id = req-8ba17d49-1611-4810-8f82-0182132697d4 May 28 12:59:10 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.quota [None req-2603d0ce-3d3e-4ccc-ba4b-fecd694a3f11 tempest-PublicSharesNegativeTest-1466961720 tempest-PublicSharesNegativeTest-1466961720-project-admin] Created reservations ['3320b789-3b1c-4983-8324-4ee7206dea50', '2349f1d0-f944-4a54-9e0d-15616b9ba0f9', 'd48255f4-3bde-4f04-a677-c64f233c71df', '8aa2d1c9-599b-4f5c-822b-2f1596826d72'] {{(pid=98329) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 12:59:10 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-e8a76bbc-dab0-4495-9514-576e11684ece tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] http://10.27.203.238/share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/shares/ee66b05f-c433-47ec-899b-b6c21c117e1d returned with HTTP 200 May 28 12:59:10 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 679/1370] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:59:10 2024] GET /share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/shares/ee66b05f-c433-47ec-899b-b6c21c117e1d => generated 1370 bytes in 31 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:59:10 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-4caa01fb-fd0b-400c-a509-68635696978e tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.038s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:10 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-4caa01fb-fd0b-400c-a509-68635696978e tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:10 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-4caa01fb-fd0b-400c-a509-68635696978e tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:10 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-4caa01fb-fd0b-400c-a509-68635696978e tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:10 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-4caa01fb-fd0b-400c-a509-68635696978e tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:10 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-4caa01fb-fd0b-400c-a509-68635696978e tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:10 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-4caa01fb-fd0b-400c-a509-68635696978e tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:10 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-4caa01fb-fd0b-400c-a509-68635696978e tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:10 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-4caa01fb-fd0b-400c-a509-68635696978e tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:10 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.quota [None req-2603d0ce-3d3e-4ccc-ba4b-fecd694a3f11 tempest-PublicSharesNegativeTest-1466961720 tempest-PublicSharesNegativeTest-1466961720-project-admin] Committed reservations ['3320b789-3b1c-4983-8324-4ee7206dea50', '2349f1d0-f944-4a54-9e0d-15616b9ba0f9', 'd48255f4-3bde-4f04-a677-c64f233c71df', '8aa2d1c9-599b-4f5c-822b-2f1596826d72'] {{(pid=98329) commit /opt/stack/manila/manila/quota.py:1063}} May 28 12:59:10 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-4caa01fb-fd0b-400c-a509-68635696978e tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.038s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:10 l75lg1-v1 manila-share[98474]: INFO manila.share.access [None req-4caa01fb-fd0b-400c-a509-68635696978e tempest-ShareIpRulesForNFSTest-1748669711 None] Access rules were successfully modified for share instance b7a7d61c-2cea-442a-9809-507038e080d5 belonging to share 1ddadc17-cf10-4a42-8bbd-8335fb3520a1. May 28 12:59:10 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.host_manager [None req-2603d0ce-3d3e-4ccc-ba4b-fecd694a3f11 tempest-PublicSharesNegativeTest-1466961720 None] Share service is down. (host: l75lg1-v1@generic2). May 28 12:59:10 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.host_manager [None req-2603d0ce-3d3e-4ccc-ba4b-fecd694a3f11 tempest-PublicSharesNegativeTest-1466961720 None] Share service is down. (host: l75lg1-v1@generic1). May 28 12:59:10 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-2603d0ce-3d3e-4ccc-ba4b-fecd694a3f11 tempest-PublicSharesNegativeTest-1466961720 None] Starting with 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:80}} May 28 12:59:10 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-2603d0ce-3d3e-4ccc-ba4b-fecd694a3f11 tempest-PublicSharesNegativeTest-1466961720 None] Filter OnlyHostFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:59:10 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-2603d0ce-3d3e-4ccc-ba4b-fecd694a3f11 tempest-PublicSharesNegativeTest-1466961720 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:59:10 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.capacity [None req-2603d0ce-3d3e-4ccc-ba4b-fecd694a3f11 tempest-PublicSharesNegativeTest-1466961720 None] Space information for share creation on host l75lg1-v1@vast#vast (requested / avail): 1/2081 {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/capacity.py:83}} May 28 12:59:10 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-2603d0ce-3d3e-4ccc-ba4b-fecd694a3f11 tempest-PublicSharesNegativeTest-1466961720 None] Filter CapacityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:59:10 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-2603d0ce-3d3e-4ccc-ba4b-fecd694a3f11 tempest-PublicSharesNegativeTest-1466961720 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:59:10 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-2603d0ce-3d3e-4ccc-ba4b-fecd694a3f11 tempest-PublicSharesNegativeTest-1466961720 None] Driver Filter: Checking host 'l75lg1-v1@vast#vast' {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:37}} May 28 12:59:10 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-2603d0ce-3d3e-4ccc-ba4b-fecd694a3f11 tempest-PublicSharesNegativeTest-1466961720 None] Filter function not set :: passing host. {{(pid=98327) _check_filter_function /opt/stack/manila/manila/scheduler/filters/driver.py:53}} May 28 12:59:10 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-2603d0ce-3d3e-4ccc-ba4b-fecd694a3f11 tempest-PublicSharesNegativeTest-1466961720 None] Result: True {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:40}} May 28 12:59:10 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-2603d0ce-3d3e-4ccc-ba4b-fecd694a3f11 tempest-PublicSharesNegativeTest-1466961720 None] Done checking host 'l75lg1-v1@vast#vast' {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:41}} May 28 12:59:10 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-2603d0ce-3d3e-4ccc-ba4b-fecd694a3f11 tempest-PublicSharesNegativeTest-1466961720 None] Filter DriverFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:59:10 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-2603d0ce-3d3e-4ccc-ba4b-fecd694a3f11 tempest-PublicSharesNegativeTest-1466961720 None] Filter ShareReplicationFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:59:10 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-2603d0ce-3d3e-4ccc-ba4b-fecd694a3f11 tempest-PublicSharesNegativeTest-1466961720 None] Filter CreateFromSnapshotFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:59:10 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-2603d0ce-3d3e-4ccc-ba4b-fecd694a3f11 tempest-PublicSharesNegativeTest-1466961720 None] Filter AffinityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:59:10 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-2603d0ce-3d3e-4ccc-ba4b-fecd694a3f11 tempest-PublicSharesNegativeTest-1466961720 None] Filter AntiAffinityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:59:10 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.drivers.filter [None req-2603d0ce-3d3e-4ccc-ba4b-fecd694a3f11 tempest-PublicSharesNegativeTest-1466961720 None] Filtered share [host: 'l75lg1-v1@vast#vast', free_capacity_gb: 2081.64910808485, pools: None] {{(pid=98327) _schedule_share /opt/stack/manila/manila/scheduler/drivers/filter.py:268}} May 28 12:59:10 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-2603d0ce-3d3e-4ccc-ba4b-fecd694a3f11 tempest-PublicSharesNegativeTest-1466961720 None] Checking host 'l75lg1-v1@vast#vast' {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:46}} May 28 12:59:10 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.weighers.goodness [None req-2603d0ce-3d3e-4ccc-ba4b-fecd694a3f11 tempest-PublicSharesNegativeTest-1466961720 None] Goodness function not set :: defaulting to minimal goodness rating of 0. May 28 12:59:10 l75lg1-v1 manila-scheduler[98327]: INFO manila.scheduler.weighers.goodness [None req-2603d0ce-3d3e-4ccc-ba4b-fecd694a3f11 tempest-PublicSharesNegativeTest-1466961720 None] Goodness function result for host l75lg1-v1@vast#vast: 0. May 28 12:59:10 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-2603d0ce-3d3e-4ccc-ba4b-fecd694a3f11 tempest-PublicSharesNegativeTest-1466961720 None] Goodness: 0 {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:48}} May 28 12:59:10 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-2603d0ce-3d3e-4ccc-ba4b-fecd694a3f11 tempest-PublicSharesNegativeTest-1466961720 tempest-PublicSharesNegativeTest-1466961720-project-admin] http://10.27.203.238/share/v2/6e831d9989b1463da882ee355e32629c/shares returned with HTTP 200 May 28 12:59:10 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-2603d0ce-3d3e-4ccc-ba4b-fecd694a3f11 tempest-PublicSharesNegativeTest-1466961720 None] Done checking host 'l75lg1-v1@vast#vast' {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:49}} May 28 12:59:10 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.drivers.filter [None req-2603d0ce-3d3e-4ccc-ba4b-fecd694a3f11 tempest-PublicSharesNegativeTest-1466961720 None] Choosing for share: WeighedHost [host: l75lg1-v1@vast#vast, weight: 0.0] {{(pid=98327) _schedule_share /opt/stack/manila/manila/scheduler/drivers/filter.py:274}} May 28 12:59:10 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 692/1371] 10.27.203.238 () {66 vars in 1362 bytes} [Tue May 28 12:59:10 2024] POST /share/v2/6e831d9989b1463da882ee355e32629c/shares => generated 1336 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:59:10 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-85e1b4da-4a71-46da-a602-19da1af84690 tempest-PublicSharesNegativeTest-1466961720 tempest-PublicSharesNegativeTest-1466961720-project-admin] GET http://10.27.203.238/share/v2/6e831d9989b1463da882ee355e32629c/shares/eb49a187-afee-4d13-b48a-a957d46fc910 May 28 12:59:10 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-85e1b4da-4a71-46da-a602-19da1af84690 tempest-PublicSharesNegativeTest-1466961720 tempest-PublicSharesNegativeTest-1466961720-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:10 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-85e1b4da-4a71-46da-a602-19da1af84690 tempest-PublicSharesNegativeTest-1466961720 tempest-PublicSharesNegativeTest-1466961720-project-admin] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:10 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-85e1b4da-4a71-46da-a602-19da1af84690 tempest-PublicSharesNegativeTest-1466961720 tempest-PublicSharesNegativeTest-1466961720-project-admin] http://10.27.203.238/share/v2/6e831d9989b1463da882ee355e32629c/shares/eb49a187-afee-4d13-b48a-a957d46fc910 returned with HTTP 200 May 28 12:59:10 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 680/1372] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:59:10 2024] GET /share/v2/6e831d9989b1463da882ee355e32629c/shares/eb49a187-afee-4d13-b48a-a957d46fc910 => generated 1336 bytes in 23 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:59:10 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2603d0ce-3d3e-4ccc-ba4b-fecd694a3f11 tempest-PublicSharesNegativeTest-1466961720 None] >>> [GET] https://127.0.0.1:40443/api/vippools/ May 28 12:59:10 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2603d0ce-3d3e-4ccc-ba4b-fecd694a3f11 tempest-PublicSharesNegativeTest-1466961720 None] {'allow_redirects': True, 'params': {'name': 'vippool-1'}} May 28 12:59:10 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-fa72d256-f740-490b-9c70-2c7027a23055 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] POST http://10.27.203.238/share/v1/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action May 28 12:59:10 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-fa72d256-f740-490b-9c70-2c7027a23055 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Action body: b'{"os-access_list": null}' {{(pid=98329) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:59:10 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-fa72d256-f740-490b-9c70-2c7027a23055 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Action: 'action', calling method: ShareController.access_list, body: {"os-access_list": null} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:59:10 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-fa72d256-f740-490b-9c70-2c7027a23055 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] http://10.27.203.238/share/v1/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action returned with HTTP 200 May 28 12:59:10 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 693/1373] 10.27.203.238 () {64 vars in 1450 bytes} [Tue May 28 12:59:10 2024] POST /share/v1/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action => generated 19 bytes in 27 msecs (HTTP/1.1 200) 6 headers in 229 bytes (1 switches on core 0) May 28 12:59:10 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-56d7b8b2-bce1-424b-b4f4-a56dcb1b5cf9 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] POST http://10.27.203.238/share/v1/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action May 28 12:59:10 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-56d7b8b2-bce1-424b-b4f4-a56dcb1b5cf9 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Action body: b'{"os-allow_access": {"access_type": "ip", "access_to": "2.2.2.2", "access_level": "ro"}}' {{(pid=98330) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:59:10 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-56d7b8b2-bce1-424b-b4f4-a56dcb1b5cf9 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Action: 'action', calling method: ShareController.allow_access, body: {"os-allow_access": {"access_type": "ip", "access_to": "2.2.2.2", "access_level": "ro"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:59:11 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-56d7b8b2-bce1-424b-b4f4-a56dcb1b5cf9 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:11 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-56d7b8b2-bce1-424b-b4f4-a56dcb1b5cf9 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:11 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-fef46cb0-f2a4-4fa4-bbdf-60b0584bdf30 tempest-PublicSharesTest-1667420263 tempest-PublicSharesTest-1667420263-project-member] GET http://10.27.203.238/share/v2/6d36e1eb1dbc449db6aca75b12a2ba18/shares/84e821d0-2b62-48db-80c7-259f61a14bac May 28 12:59:11 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-fef46cb0-f2a4-4fa4-bbdf-60b0584bdf30 tempest-PublicSharesTest-1667420263 tempest-PublicSharesTest-1667420263-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:11 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-fef46cb0-f2a4-4fa4-bbdf-60b0584bdf30 tempest-PublicSharesTest-1667420263 tempest-PublicSharesTest-1667420263-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:11 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-fef46cb0-f2a4-4fa4-bbdf-60b0584bdf30 tempest-PublicSharesTest-1667420263 tempest-PublicSharesTest-1667420263-project-member] HTTP exception thrown: The resource could not be found. May 28 12:59:11 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-fef46cb0-f2a4-4fa4-bbdf-60b0584bdf30 tempest-PublicSharesTest-1667420263 tempest-PublicSharesTest-1667420263-project-member] http://10.27.203.238/share/v2/6d36e1eb1dbc449db6aca75b12a2ba18/shares/84e821d0-2b62-48db-80c7-259f61a14bac returned with HTTP 404 May 28 12:59:11 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 694/1374] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:59:11 2024] GET /share/v2/6d36e1eb1dbc449db6aca75b12a2ba18/shares/84e821d0-2b62-48db-80c7-259f61a14bac => generated 78 bytes in 11 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f461b40-a8a2-4a02-a406-bb85754c6c56 tempest-PublicSharesNegativeTest-1466961720 tempest-PublicSharesNegativeTest-1466961720-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-1f461b40-a8a2-4a02-a406-bb85754c6c56 tempest-PublicSharesNegativeTest-1466961720 tempest-PublicSharesNegativeTest-1466961720-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:59:11 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-56d7b8b2-bce1-424b-b4f4-a56dcb1b5cf9 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.044s {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:11 l75lg1-v1 cinder-scheduler[85128]: DEBUG dbcounter [-] [85128] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=85128) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:59:11 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-56d7b8b2-bce1-424b-b4f4-a56dcb1b5cf9 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] http://10.27.203.238/share/v1/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action returned with HTTP 200 May 28 12:59:11 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 681/1375] 10.27.203.238 () {64 vars in 1450 bytes} [Tue May 28 12:59:10 2024] POST /share/v1/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action => generated 193 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:59:11 l75lg1-v1 manila-share[98474]: DEBUG manila.share.manager [None req-56d7b8b2-bce1-424b-b4f4-a56dcb1b5cf9 tempest-ShareIpRulesForNFSTest-1748669711 None] Received request to update access for share instance b7a7d61c-2cea-442a-9809-507038e080d5. {{(pid=98474) update_access_for_instances /opt/stack/manila/manila/share/manager.py:4353}} May 28 12:59:11 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-b7719830-05c4-4d69-8381-8e65064c32a7 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] POST http://10.27.203.238/share/v1/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action May 28 12:59:11 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-b7719830-05c4-4d69-8381-8e65064c32a7 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Action body: b'{"os-access_list": null}' {{(pid=98329) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:59:11 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-b7719830-05c4-4d69-8381-8e65064c32a7 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Action: 'action', calling method: ShareController.access_list, body: {"os-access_list": null} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f461b40-a8a2-4a02-a406-bb85754c6c56 tempest-PublicSharesNegativeTest-1466961720 tempest-PublicSharesNegativeTest-1466961720-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0776bd56-87a6-4b4c-89be-db75999f3d00 tempest-PublicSharesTest-118543418 tempest-PublicSharesTest-118543418-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bc1f1b24efd484493c1e18638340a25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee1466a8fe242afa8e0d0378840bfc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0776bd56-87a6-4b4c-89be-db75999f3d00 tempest-PublicSharesTest-118543418 tempest-PublicSharesTest-118543418-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0776bd56-87a6-4b4c-89be-db75999f3d00 tempest-PublicSharesTest-118543418 tempest-PublicSharesTest-118543418-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0776bd56-87a6-4b4c-89be-db75999f3d00 tempest-PublicSharesTest-118543418 tempest-PublicSharesTest-118543418-project-admin] PATH_INFO: `/v3/users/8688f80695814f34bfb56342c4e54028` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0776bd56-87a6-4b4c-89be-db75999f3d00 tempest-PublicSharesTest-118543418 tempest-PublicSharesTest-118543418-project-admin] RBAC: Authorizing `identity:delete_user(user_id=8688f80695814f34bfb56342c4e54028)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0776bd56-87a6-4b4c-89be-db75999f3d00 tempest-PublicSharesTest-118543418 tempest-PublicSharesTest-118543418-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:11 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-56d7b8b2-bce1-424b-b4f4-a56dcb1b5cf9 tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:11 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-56d7b8b2-bce1-424b-b4f4-a56dcb1b5cf9 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:11 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-56d7b8b2-bce1-424b-b4f4-a56dcb1b5cf9 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:11 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-56d7b8b2-bce1-424b-b4f4-a56dcb1b5cf9 tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:11 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-56d7b8b2-bce1-424b-b4f4-a56dcb1b5cf9 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-0776bd56-87a6-4b4c-89be-db75999f3d00 tempest-PublicSharesTest-118543418 tempest-PublicSharesTest-118543418-project-admin] Could not find user: 8688f80695814f34bfb56342c4e54028.: keystone.exception.UserNotFound: Could not find user: 8688f80695814f34bfb56342c4e54028. May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 8688f80695814f34bfb56342c4e54028. May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1199/2423] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 12:59:11 2024] DELETE /identity/v3/users/8688f80695814f34bfb56342c4e54028 => generated 110 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e83399-3d1a-418c-985f-49d77f9868e3 service manila] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e83399-3d1a-418c-985f-49d77f9868e3 service manila] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cb7264-c311-455f-ad10-315506e49bdc tempest-PublicSharesTest-118543418 tempest-PublicSharesTest-118543418-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bc1f1b24efd484493c1e18638340a25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee1466a8fe242afa8e0d0378840bfc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cb7264-c311-455f-ad10-315506e49bdc tempest-PublicSharesTest-118543418 tempest-PublicSharesTest-118543418-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cb7264-c311-455f-ad10-315506e49bdc tempest-PublicSharesTest-118543418 tempest-PublicSharesTest-118543418-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cb7264-c311-455f-ad10-315506e49bdc tempest-PublicSharesTest-118543418 tempest-PublicSharesTest-118543418-project-admin] PATH_INFO: `/v3/users/108a25e436e9452a9a865957dcea1fc5` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cb7264-c311-455f-ad10-315506e49bdc tempest-PublicSharesTest-118543418 tempest-PublicSharesTest-118543418-project-admin] RBAC: Authorizing `identity:delete_user(user_id=108a25e436e9452a9a865957dcea1fc5)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cb7264-c311-455f-ad10-315506e49bdc tempest-PublicSharesTest-118543418 tempest-PublicSharesTest-118543418-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-51cb7264-c311-455f-ad10-315506e49bdc tempest-PublicSharesTest-118543418 tempest-PublicSharesTest-118543418-project-admin] Could not find user: 108a25e436e9452a9a865957dcea1fc5.: keystone.exception.UserNotFound: Could not find user: 108a25e436e9452a9a865957dcea1fc5. May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 108a25e436e9452a9a865957dcea1fc5. May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1225/2424] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 12:59:11 2024] DELETE /identity/v3/users/108a25e436e9452a9a865957dcea1fc5 => generated 110 bytes in 25 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 12:59:11 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-b7719830-05c4-4d69-8381-8e65064c32a7 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] http://10.27.203.238/share/v1/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action returned with HTTP 200 May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0776bd56-87a6-4b4c-89be-db75999f3d00 tempest-PublicSharesTest-118543418 tempest-PublicSharesTest-118543418-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:11 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 695/1376] 10.27.203.238 () {64 vars in 1450 bytes} [Tue May 28 12:59:11 2024] POST /share/v1/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action => generated 148 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:59:11 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2603d0ce-3d3e-4ccc-ba4b-fecd694a3f11 tempest-PublicSharesNegativeTest-1466961720 None] <<< [GET] https://127.0.0.1:40443/api/vippools/ May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0776bd56-87a6-4b4c-89be-db75999f3d00 tempest-PublicSharesTest-118543418 tempest-PublicSharesTest-118543418-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:11 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2603d0ce-3d3e-4ccc-ba4b-fecd694a3f11 tempest-PublicSharesNegativeTest-1466961720 None] [Bunch(active_cnode_ids=[], active_interfaces=4, cluster='loop75-kfs', cluster_id=1, cnode_ids=[], cnodes=[], domain_name='vippool-1', enable_l3=False, enable_weighted_balancing=False, enabled=True, end_ip='172.21.75.4', guid='f2abaede-b397-413a-8faa-3aeead6d3b28', gw_ip='', gw_ipv6='', id=2, ip_ranges=[['172.21.75.1', '172.21.75.4']], name='vippool-1', peer_asn=0, port_membership='ALL', ranges_summary='172.21.75.[1-4]', role='PROTOCOLS', start_ip='172.21.75.1', subnet_cidr=16, subnet_cidr_ipv6=None, sync='SYNCED', sync_time='2024-05-28T12:50:09.644123Z', tenant_id=1, tenant_name='default', title='172.21.75.1 - 172.21.75.4', url='https://127.0.0.1:40443/api/vippools/2/', vast_asn=0, vlan=0, vms_preferred=False)] May 28 12:59:11 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2603d0ce-3d3e-4ccc-ba4b-fecd694a3f11 tempest-PublicSharesNegativeTest-1466961720 None] --- [GET] https://127.0.0.1:40443/api/vippools/: Done May 28 12:59:11 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2603d0ce-3d3e-4ccc-ba4b-fecd694a3f11 tempest-PublicSharesNegativeTest-1466961720 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:59:11 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2603d0ce-3d3e-4ccc-ba4b-fecd694a3f11 tempest-PublicSharesNegativeTest-1466961720 None] {'allow_redirects': True, May 28 12:59:11 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2603d0ce-3d3e-4ccc-ba4b-fecd694a3f11 tempest-PublicSharesNegativeTest-1466961720 None] 'params': {'name': '67a5173e-4e46-4dc2-8375-e9849d8dde4c'}} May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926aaba6-bca4-433e-a2d1-bda41e904080 tempest-PublicSharesTest-118543418 tempest-PublicSharesTest-118543418-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bc1f1b24efd484493c1e18638340a25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee1466a8fe242afa8e0d0378840bfc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926aaba6-bca4-433e-a2d1-bda41e904080 tempest-PublicSharesTest-118543418 tempest-PublicSharesTest-118543418-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926aaba6-bca4-433e-a2d1-bda41e904080 tempest-PublicSharesTest-118543418 tempest-PublicSharesTest-118543418-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926aaba6-bca4-433e-a2d1-bda41e904080 tempest-PublicSharesTest-118543418 tempest-PublicSharesTest-118543418-project-admin] PATH_INFO: `/v3/users/5ae5cb1db3504baaba1df93dc154a004` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926aaba6-bca4-433e-a2d1-bda41e904080 tempest-PublicSharesTest-118543418 tempest-PublicSharesTest-118543418-project-admin] RBAC: Authorizing `identity:delete_user(user_id=5ae5cb1db3504baaba1df93dc154a004)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926aaba6-bca4-433e-a2d1-bda41e904080 tempest-PublicSharesTest-118543418 tempest-PublicSharesTest-118543418-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:11 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-56d7b8b2-bce1-424b-b4f4-a56dcb1b5cf9 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.058s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:11 l75lg1-v1 manila-share[98474]: DEBUG manila.share.access [None req-56d7b8b2-bce1-424b-b4f4-a56dcb1b5cf9 tempest-ShareIpRulesForNFSTest-1748669711 None] Updating access rules for share instance b7a7d61c-2cea-442a-9809-507038e080d5 belonging to share 1ddadc17-cf10-4a42-8bbd-8335fb3520a1. {{(pid=98474) update_access_rules /opt/stack/manila/manila/share/access.py:298}} May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-926aaba6-bca4-433e-a2d1-bda41e904080 tempest-PublicSharesTest-118543418 tempest-PublicSharesTest-118543418-project-admin] Could not find user: 5ae5cb1db3504baaba1df93dc154a004.: keystone.exception.UserNotFound: Could not find user: 5ae5cb1db3504baaba1df93dc154a004. May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 5ae5cb1db3504baaba1df93dc154a004. May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1200/2425] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 12:59:11 2024] DELETE /identity/v3/users/5ae5cb1db3504baaba1df93dc154a004 => generated 110 bytes in 28 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cb7264-c311-455f-ad10-315506e49bdc tempest-PublicSharesTest-118543418 tempest-PublicSharesTest-118543418-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cb7264-c311-455f-ad10-315506e49bdc tempest-PublicSharesTest-118543418 tempest-PublicSharesTest-118543418-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f38576-7278-4bb0-8e01-0cb22c7ac982 tempest-PublicSharesTest-118543418 tempest-PublicSharesTest-118543418-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bc1f1b24efd484493c1e18638340a25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee1466a8fe242afa8e0d0378840bfc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f38576-7278-4bb0-8e01-0cb22c7ac982 tempest-PublicSharesTest-118543418 tempest-PublicSharesTest-118543418-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f38576-7278-4bb0-8e01-0cb22c7ac982 tempest-PublicSharesTest-118543418 tempest-PublicSharesTest-118543418-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f38576-7278-4bb0-8e01-0cb22c7ac982 tempest-PublicSharesTest-118543418 tempest-PublicSharesTest-118543418-project-admin] PATH_INFO: `/v3/users/c2ac6ca3ea5a4ae498df6d12bb7caadc` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f38576-7278-4bb0-8e01-0cb22c7ac982 tempest-PublicSharesTest-118543418 tempest-PublicSharesTest-118543418-project-admin] RBAC: Authorizing `identity:delete_user(user_id=c2ac6ca3ea5a4ae498df6d12bb7caadc)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f38576-7278-4bb0-8e01-0cb22c7ac982 tempest-PublicSharesTest-118543418 tempest-PublicSharesTest-118543418-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:11 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-56d7b8b2-bce1-424b-b4f4-a56dcb1b5cf9 tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:11 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-56d7b8b2-bce1-424b-b4f4-a56dcb1b5cf9 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-24f38576-7278-4bb0-8e01-0cb22c7ac982 tempest-PublicSharesTest-118543418 tempest-PublicSharesTest-118543418-project-admin] Could not find user: c2ac6ca3ea5a4ae498df6d12bb7caadc.: keystone.exception.UserNotFound: Could not find user: c2ac6ca3ea5a4ae498df6d12bb7caadc. May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: c2ac6ca3ea5a4ae498df6d12bb7caadc. May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1226/2426] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 12:59:11 2024] DELETE /identity/v3/users/c2ac6ca3ea5a4ae498df6d12bb7caadc => generated 110 bytes in 24 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 12:59:11 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-56d7b8b2-bce1-424b-b4f4-a56dcb1b5cf9 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.008s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:11 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-56d7b8b2-bce1-424b-b4f4-a56dcb1b5cf9 tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926aaba6-bca4-433e-a2d1-bda41e904080 tempest-PublicSharesTest-118543418 tempest-PublicSharesTest-118543418-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:11 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-56d7b8b2-bce1-424b-b4f4-a56dcb1b5cf9 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926aaba6-bca4-433e-a2d1-bda41e904080 tempest-PublicSharesTest-118543418 tempest-PublicSharesTest-118543418-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ca200e-8f6f-4fac-993e-de8eea0a2311 tempest-PublicSharesTest-118543418 tempest-PublicSharesTest-118543418-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bc1f1b24efd484493c1e18638340a25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee1466a8fe242afa8e0d0378840bfc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ca200e-8f6f-4fac-993e-de8eea0a2311 tempest-PublicSharesTest-118543418 tempest-PublicSharesTest-118543418-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ca200e-8f6f-4fac-993e-de8eea0a2311 tempest-PublicSharesTest-118543418 tempest-PublicSharesTest-118543418-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ca200e-8f6f-4fac-993e-de8eea0a2311 tempest-PublicSharesTest-118543418 tempest-PublicSharesTest-118543418-project-admin] PATH_INFO: `/v3/users/f89f851af36d480ab7d10d3506c60899` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:11 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-56d7b8b2-bce1-424b-b4f4-a56dcb1b5cf9 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.015s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:11 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-56d7b8b2-bce1-424b-b4f4-a56dcb1b5cf9 tempest-ShareIpRulesForNFSTest-1748669711 None] changing access on None May 28 12:59:11 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-56d7b8b2-bce1-424b-b4f4-a56dcb1b5cf9 tempest-ShareIpRulesForNFSTest-1748669711 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ca200e-8f6f-4fac-993e-de8eea0a2311 tempest-PublicSharesTest-118543418 tempest-PublicSharesTest-118543418-project-admin] RBAC: Authorizing `identity:delete_user(user_id=f89f851af36d480ab7d10d3506c60899)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:11 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-56d7b8b2-bce1-424b-b4f4-a56dcb1b5cf9 tempest-ShareIpRulesForNFSTest-1748669711 None] {'allow_redirects': True, May 28 12:59:11 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-56d7b8b2-bce1-424b-b4f4-a56dcb1b5cf9 tempest-ShareIpRulesForNFSTest-1748669711 None] 'params': {'name': 'b7a7d61c-2cea-442a-9809-507038e080d5'}} May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ca200e-8f6f-4fac-993e-de8eea0a2311 tempest-PublicSharesTest-118543418 tempest-PublicSharesTest-118543418-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-74ca200e-8f6f-4fac-993e-de8eea0a2311 tempest-PublicSharesTest-118543418 tempest-PublicSharesTest-118543418-project-admin] Could not find user: f89f851af36d480ab7d10d3506c60899.: keystone.exception.UserNotFound: Could not find user: f89f851af36d480ab7d10d3506c60899. May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: f89f851af36d480ab7d10d3506c60899. May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1201/2427] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 12:59:11 2024] DELETE /identity/v3/users/f89f851af36d480ab7d10d3506c60899 => generated 110 bytes in 26 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f38576-7278-4bb0-8e01-0cb22c7ac982 tempest-PublicSharesTest-118543418 tempest-PublicSharesTest-118543418-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f38576-7278-4bb0-8e01-0cb22c7ac982 tempest-PublicSharesTest-118543418 tempest-PublicSharesTest-118543418-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f6c9e6-12a7-4ac4-90c7-35d89b2e8190 tempest-PublicSharesTest-118543418 tempest-PublicSharesTest-118543418-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bc1f1b24efd484493c1e18638340a25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee1466a8fe242afa8e0d0378840bfc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f6c9e6-12a7-4ac4-90c7-35d89b2e8190 tempest-PublicSharesTest-118543418 tempest-PublicSharesTest-118543418-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f6c9e6-12a7-4ac4-90c7-35d89b2e8190 tempest-PublicSharesTest-118543418 tempest-PublicSharesTest-118543418-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f6c9e6-12a7-4ac4-90c7-35d89b2e8190 tempest-PublicSharesTest-118543418 tempest-PublicSharesTest-118543418-project-admin] PATH_INFO: `/v3/users/6886717a9cfb42a0a4142a0b982570ee` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f6c9e6-12a7-4ac4-90c7-35d89b2e8190 tempest-PublicSharesTest-118543418 tempest-PublicSharesTest-118543418-project-admin] RBAC: Authorizing `identity:delete_user(user_id=6886717a9cfb42a0a4142a0b982570ee)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f6c9e6-12a7-4ac4-90c7-35d89b2e8190 tempest-PublicSharesTest-118543418 tempest-PublicSharesTest-118543418-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:11 l75lg1-v1 dstat.sh[49771]: 28-05 12:59:11| 15 1 78 4 0|5734M 1739M 277M 7874M| 18k 12k| 0 3311k| 0 471 |8529 16k|1.17 1.06 1.01|2.0 1.0 0| 0 0 | 0 2048M| 29 362 0 35 0 May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-e9f6c9e6-12a7-4ac4-90c7-35d89b2e8190 tempest-PublicSharesTest-118543418 tempest-PublicSharesTest-118543418-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6886717a9cfb42a0a4142a0b982570ee', 'request_id': 'req-e9f6c9e6-12a7-4ac4-90c7-35d89b2e8190'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-e9f6c9e6-12a7-4ac4-90c7-35d89b2e8190 tempest-PublicSharesTest-118543418 tempest-PublicSharesTest-118543418-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6886717a9cfb42a0a4142a0b982570ee', 'request_id': 'req-e9f6c9e6-12a7-4ac4-90c7-35d89b2e8190'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-e9f6c9e6-12a7-4ac4-90c7-35d89b2e8190 tempest-PublicSharesTest-118543418 tempest-PublicSharesTest-118543418-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6886717a9cfb42a0a4142a0b982570ee', 'request_id': 'req-e9f6c9e6-12a7-4ac4-90c7-35d89b2e8190'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-e9f6c9e6-12a7-4ac4-90c7-35d89b2e8190 tempest-PublicSharesTest-118543418 tempest-PublicSharesTest-118543418-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6886717a9cfb42a0a4142a0b982570ee', 'request_id': 'req-e9f6c9e6-12a7-4ac4-90c7-35d89b2e8190'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-e9f6c9e6-12a7-4ac4-90c7-35d89b2e8190 tempest-PublicSharesTest-118543418 tempest-PublicSharesTest-118543418-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6886717a9cfb42a0a4142a0b982570ee', 'request_id': 'req-e9f6c9e6-12a7-4ac4-90c7-35d89b2e8190'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1227/2428] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 12:59:11 2024] DELETE /identity/v3/users/6886717a9cfb42a0a4142a0b982570ee => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:59:11 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-801658f6-c6a4-48f5-b13d-d942af3b17f4 tempest-PublicSharesTest-118543418 tempest-PublicSharesTest-118543418-project-admin] DELETE http://10.27.203.238/share/v2/8ee1466a8fe242afa8e0d0378840bfc1/types/31514837-1b9c-4410-8444-5ea15e0aca59 May 28 12:59:11 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-801658f6-c6a4-48f5-b13d-d942af3b17f4 tempest-PublicSharesTest-118543418 tempest-PublicSharesTest-118543418-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:11 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-801658f6-c6a4-48f5-b13d-d942af3b17f4 tempest-PublicSharesTest-118543418 tempest-PublicSharesTest-118543418-project-admin] Calling method 'ShareTypesController._delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:11 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2603d0ce-3d3e-4ccc-ba4b-fecd694a3f11 tempest-PublicSharesNegativeTest-1466961720 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:59:11 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2603d0ce-3d3e-4ccc-ba4b-fecd694a3f11 tempest-PublicSharesNegativeTest-1466961720 None] [] May 28 12:59:11 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2603d0ce-3d3e-4ccc-ba4b-fecd694a3f11 tempest-PublicSharesNegativeTest-1466961720 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 12:59:11 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2603d0ce-3d3e-4ccc-ba4b-fecd694a3f11 tempest-PublicSharesNegativeTest-1466961720 None] >>> [POST] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:59:11 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2603d0ce-3d3e-4ccc-ba4b-fecd694a3f11 tempest-PublicSharesNegativeTest-1466961720 None] {'data': '{"name": "67a5173e-4e46-4dc2-8375-e9849d8dde4c"}', May 28 12:59:11 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2603d0ce-3d3e-4ccc-ba4b-fecd694a3f11 tempest-PublicSharesNegativeTest-1466961720 None] 'json': None, May 28 12:59:11 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2603d0ce-3d3e-4ccc-ba4b-fecd694a3f11 tempest-PublicSharesNegativeTest-1466961720 None] 'params': None} May 28 12:59:11 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-801658f6-c6a4-48f5-b13d-d942af3b17f4 tempest-PublicSharesTest-118543418 tempest-PublicSharesTest-118543418-project-admin] http://10.27.203.238/share/v2/8ee1466a8fe242afa8e0d0378840bfc1/types/31514837-1b9c-4410-8444-5ea15e0aca59 returned with HTTP 202 May 28 12:59:11 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 682/1377] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:59:11 2024] DELETE /share/v2/8ee1466a8fe242afa8e0d0378840bfc1/types/31514837-1b9c-4410-8444-5ea15e0aca59 => generated 0 bytes in 75 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:59:11 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-190190d2-89cb-4faf-84f6-0acb2969f9b7 tempest-PublicSharesTest-118543418 tempest-PublicSharesTest-118543418-project-admin] GET http://10.27.203.238/share/v2/8ee1466a8fe242afa8e0d0378840bfc1/types/31514837-1b9c-4410-8444-5ea15e0aca59 May 28 12:59:11 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-190190d2-89cb-4faf-84f6-0acb2969f9b7 tempest-PublicSharesTest-118543418 tempest-PublicSharesTest-118543418-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:11 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-190190d2-89cb-4faf-84f6-0acb2969f9b7 tempest-PublicSharesTest-118543418 tempest-PublicSharesTest-118543418-project-admin] Calling method 'ShareTypesController.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:11 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-190190d2-89cb-4faf-84f6-0acb2969f9b7 tempest-PublicSharesTest-118543418 tempest-PublicSharesTest-118543418-project-admin] HTTP exception thrown: Share type not found. May 28 12:59:11 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-190190d2-89cb-4faf-84f6-0acb2969f9b7 tempest-PublicSharesTest-118543418 tempest-PublicSharesTest-118543418-project-admin] http://10.27.203.238/share/v2/8ee1466a8fe242afa8e0d0378840bfc1/types/31514837-1b9c-4410-8444-5ea15e0aca59 returned with HTTP 404 May 28 12:59:11 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 696/1378] 10.27.203.238 () {64 vars in 1448 bytes} [Tue May 28 12:59:11 2024] GET /share/v2/8ee1466a8fe242afa8e0d0378840bfc1/types/31514837-1b9c-4410-8444-5ea15e0aca59 => generated 67 bytes in 10 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ca200e-8f6f-4fac-993e-de8eea0a2311 tempest-PublicSharesTest-118543418 tempest-PublicSharesTest-118543418-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-74ca200e-8f6f-4fac-993e-de8eea0a2311 tempest-PublicSharesTest-118543418 tempest-PublicSharesTest-118543418-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ca200e-8f6f-4fac-993e-de8eea0a2311 tempest-PublicSharesTest-118543418 tempest-PublicSharesTest-118543418-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a596af9c-1587-4556-bb48-591e307214f2 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a596af9c-1587-4556-bb48-591e307214f2 None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a596af9c-1587-4556-bb48-591e307214f2 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a596af9c-1587-4556-bb48-591e307214f2 None admin] PATH_INFO: `/v3/users/672c4552229b4f82a12c9d2e0e77332f` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a596af9c-1587-4556-bb48-591e307214f2 None admin] RBAC: Authorizing `identity:delete_user(user_id=672c4552229b4f82a12c9d2e0e77332f)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a596af9c-1587-4556-bb48-591e307214f2 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-a596af9c-1587-4556-bb48-591e307214f2 None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '672c4552229b4f82a12c9d2e0e77332f', 'request_id': 'req-a596af9c-1587-4556-bb48-591e307214f2'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-a596af9c-1587-4556-bb48-591e307214f2 None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '672c4552229b4f82a12c9d2e0e77332f', 'request_id': 'req-a596af9c-1587-4556-bb48-591e307214f2'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-a596af9c-1587-4556-bb48-591e307214f2 None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '672c4552229b4f82a12c9d2e0e77332f', 'request_id': 'req-a596af9c-1587-4556-bb48-591e307214f2'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-a596af9c-1587-4556-bb48-591e307214f2 None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '672c4552229b4f82a12c9d2e0e77332f', 'request_id': 'req-a596af9c-1587-4556-bb48-591e307214f2'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-a596af9c-1587-4556-bb48-591e307214f2 None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '672c4552229b4f82a12c9d2e0e77332f', 'request_id': 'req-a596af9c-1587-4556-bb48-591e307214f2'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1202/2429] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 12:59:11 2024] DELETE /identity/v3/users/672c4552229b4f82a12c9d2e0e77332f => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f6c9e6-12a7-4ac4-90c7-35d89b2e8190 tempest-PublicSharesTest-118543418 tempest-PublicSharesTest-118543418-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:11 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.periodic_task [None req-e3486ff9-a95e-41bc-8901-df75aedbeaad None None] Running periodic task DataManager.create_backup_continue {{(pid=98318) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f6c9e6-12a7-4ac4-90c7-35d89b2e8190 tempest-PublicSharesTest-118543418 tempest-PublicSharesTest-118543418-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:11 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.periodic_task [None req-e3486ff9-a95e-41bc-8901-df75aedbeaad None None] Running periodic task DataManager.restore_backup_continue {{(pid=98318) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0796b4b8-8015-44cc-a661-25181f32094c None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0796b4b8-8015-44cc-a661-25181f32094c None admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0796b4b8-8015-44cc-a661-25181f32094c None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0796b4b8-8015-44cc-a661-25181f32094c None admin] PATH_INFO: `/v3/users/31e9148b59af4472aa527a955469124d` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0796b4b8-8015-44cc-a661-25181f32094c None admin] RBAC: Authorizing `identity:delete_user(user_id=31e9148b59af4472aa527a955469124d)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0796b4b8-8015-44cc-a661-25181f32094c None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-0796b4b8-8015-44cc-a661-25181f32094c None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31e9148b59af4472aa527a955469124d', 'request_id': 'req-0796b4b8-8015-44cc-a661-25181f32094c'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-0796b4b8-8015-44cc-a661-25181f32094c None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31e9148b59af4472aa527a955469124d', 'request_id': 'req-0796b4b8-8015-44cc-a661-25181f32094c'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-0796b4b8-8015-44cc-a661-25181f32094c None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31e9148b59af4472aa527a955469124d', 'request_id': 'req-0796b4b8-8015-44cc-a661-25181f32094c'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-0796b4b8-8015-44cc-a661-25181f32094c None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31e9148b59af4472aa527a955469124d', 'request_id': 'req-0796b4b8-8015-44cc-a661-25181f32094c'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-0796b4b8-8015-44cc-a661-25181f32094c None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31e9148b59af4472aa527a955469124d', 'request_id': 'req-0796b4b8-8015-44cc-a661-25181f32094c'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1228/2430] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 12:59:11 2024] DELETE /identity/v3/users/31e9148b59af4472aa527a955469124d => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a596af9c-1587-4556-bb48-591e307214f2 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-a596af9c-1587-4556-bb48-591e307214f2 None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a596af9c-1587-4556-bb48-591e307214f2 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbe38bd-bf7e-4695-961a-9c6bf4628999 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbe38bd-bf7e-4695-961a-9c6bf4628999 None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbe38bd-bf7e-4695-961a-9c6bf4628999 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbe38bd-bf7e-4695-961a-9c6bf4628999 None admin] PATH_INFO: `/v3/users/3bc1f1b24efd484493c1e18638340a25` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbe38bd-bf7e-4695-961a-9c6bf4628999 None admin] RBAC: Authorizing `identity:delete_user(user_id=3bc1f1b24efd484493c1e18638340a25)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbe38bd-bf7e-4695-961a-9c6bf4628999 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:11 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-56d7b8b2-bce1-424b-b4f4-a56dcb1b5cf9 tempest-ShareIpRulesForNFSTest-1748669711 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:59:11 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-56d7b8b2-bce1-424b-b4f4-a56dcb1b5cf9 tempest-ShareIpRulesForNFSTest-1748669711 None] [Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=1, created='2024-05-28T12:57:40.763635Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='377955ad-d094-4e49-ab32-1021d943a572', id=21, internal=False, is_s3_default_policy=False, name='b7a7d61c-2cea-442a-9809-507038e080d5', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=['*'], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=[], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=[], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T12:59:10.384182Z', tenant_id=1, tenant_name='default', title='b7a7d61c-2cea-442a-9809-507038e080d5', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/21/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[])] May 28 12:59:11 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-56d7b8b2-bce1-424b-b4f4-a56dcb1b5cf9 tempest-ShareIpRulesForNFSTest-1748669711 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 12:59:11 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-56d7b8b2-bce1-424b-b4f4-a56dcb1b5cf9 tempest-ShareIpRulesForNFSTest-1748669711 None] changing access on /manila/manila-b7a7d61c-2cea-442a-9809-507038e080d5. Rules: {'nfs_read_write': [], 'nfs_read_only': ['2.2.2.2']} May 28 12:59:11 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-56d7b8b2-bce1-424b-b4f4-a56dcb1b5cf9 tempest-ShareIpRulesForNFSTest-1748669711 None] >>> [PATCH] https://127.0.0.1:40443/api/viewpolicies/21/ May 28 12:59:11 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-56d7b8b2-bce1-424b-b4f4-a56dcb1b5cf9 tempest-ShareIpRulesForNFSTest-1748669711 None] {'data': '{"name": "b7a7d61c-2cea-442a-9809-507038e080d5", "nfs_no_squash": ' May 28 12:59:11 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-56d7b8b2-bce1-424b-b4f4-a56dcb1b5cf9 tempest-ShareIpRulesForNFSTest-1748669711 None] '["*"], "nfs_root_squash": ["*"], "nfs_read_write": [], ' May 28 12:59:11 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-56d7b8b2-bce1-424b-b4f4-a56dcb1b5cf9 tempest-ShareIpRulesForNFSTest-1748669711 None] '"nfs_read_only": ["2.2.2.2"]}', May 28 12:59:11 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-56d7b8b2-bce1-424b-b4f4-a56dcb1b5cf9 tempest-ShareIpRulesForNFSTest-1748669711 None] 'params': None} May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-ecbe38bd-bf7e-4695-961a-9c6bf4628999 None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3bc1f1b24efd484493c1e18638340a25', 'request_id': 'req-ecbe38bd-bf7e-4695-961a-9c6bf4628999'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-ecbe38bd-bf7e-4695-961a-9c6bf4628999 None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3bc1f1b24efd484493c1e18638340a25', 'request_id': 'req-ecbe38bd-bf7e-4695-961a-9c6bf4628999'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-ecbe38bd-bf7e-4695-961a-9c6bf4628999 None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3bc1f1b24efd484493c1e18638340a25', 'request_id': 'req-ecbe38bd-bf7e-4695-961a-9c6bf4628999'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-ecbe38bd-bf7e-4695-961a-9c6bf4628999 None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3bc1f1b24efd484493c1e18638340a25', 'request_id': 'req-ecbe38bd-bf7e-4695-961a-9c6bf4628999'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-ecbe38bd-bf7e-4695-961a-9c6bf4628999 None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3bc1f1b24efd484493c1e18638340a25', 'request_id': 'req-ecbe38bd-bf7e-4695-961a-9c6bf4628999'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1203/2431] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 12:59:11 2024] DELETE /identity/v3/users/3bc1f1b24efd484493c1e18638340a25 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af3dabb-73ff-4bfd-b833-5916eeeb2e31 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af3dabb-73ff-4bfd-b833-5916eeeb2e31 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af3dabb-73ff-4bfd-b833-5916eeeb2e31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-3af3dabb-73ff-4bfd-b833-5916eeeb2e31 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-3af3dabb-73ff-4bfd-b833-5916eeeb2e31 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-3af3dabb-73ff-4bfd-b833-5916eeeb2e31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:59:11 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1229/2432] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:59:11 2024] POST /identity/v3/auth/tokens => generated 2960 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 12:59:11 l75lg1-v1 neutron-server[77618]: DEBUG neutron.wsgi [-] (77618) accepted ('10.27.203.238', 32782) {{(pid=77618) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 12:59:11 l75lg1-v1 neutron-server[77618]: DEBUG dbcounter [-] [77618] Writing DB stats neutron:UPDATE=1,neutron:SELECT=1 {{(pid=77618) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:59:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbe38bd-bf7e-4695-961a-9c6bf4628999 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-ecbe38bd-bf7e-4695-961a-9c6bf4628999 None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:59:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbe38bd-bf7e-4695-961a-9c6bf4628999 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b0236b-2200-4e01-836f-0051bd3783d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef17047035e4b518fd5360a01f2da1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b0236b-2200-4e01-836f-0051bd3783d0 service neutron] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b0236b-2200-4e01-836f-0051bd3783d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b0236b-2200-4e01-836f-0051bd3783d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b0236b-2200-4e01-836f-0051bd3783d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b0236b-2200-4e01-836f-0051bd3783d0 service neutron] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:12 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1204/2433] 10.27.203.238 () {64 vars in 1432 bytes} [Tue May 28 12:59:12 2024] GET /identity/v3/auth/tokens => generated 2960 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 28 12:59:12 l75lg1-v1 neutron-server[77618]: INFO neutron.wsgi [None req-f6833377-c4f3-4858-9b0e-a3f96c9275eb None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=f72e4ec607ca4e899b33f8b656888e37&name=default HTTP/1.1" status: 200 len: 216 time: 0.0690005 May 28 12:59:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af3dabb-73ff-4bfd-b833-5916eeeb2e31 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-3af3dabb-73ff-4bfd-b833-5916eeeb2e31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:59:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af3dabb-73ff-4bfd-b833-5916eeeb2e31 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baa6e0b-15ed-4e0a-903e-4ec0fa3f65b7 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baa6e0b-15ed-4e0a-903e-4ec0fa3f65b7 None admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baa6e0b-15ed-4e0a-903e-4ec0fa3f65b7 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baa6e0b-15ed-4e0a-903e-4ec0fa3f65b7 None admin] PATH_INFO: `/v3/projects/f72e4ec607ca4e899b33f8b656888e37` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7baa6e0b-15ed-4e0a-903e-4ec0fa3f65b7 None admin] RBAC: Authorizing `identity:delete_project(project_id=f72e4ec607ca4e899b33f8b656888e37)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7baa6e0b-15ed-4e0a-903e-4ec0fa3f65b7 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-7baa6e0b-15ed-4e0a-903e-4ec0fa3f65b7 None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f72e4ec607ca4e899b33f8b656888e37', 'request_id': 'req-7baa6e0b-15ed-4e0a-903e-4ec0fa3f65b7'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-7baa6e0b-15ed-4e0a-903e-4ec0fa3f65b7 None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f72e4ec607ca4e899b33f8b656888e37', 'request_id': 'req-7baa6e0b-15ed-4e0a-903e-4ec0fa3f65b7'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-7baa6e0b-15ed-4e0a-903e-4ec0fa3f65b7 None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f72e4ec607ca4e899b33f8b656888e37', 'request_id': 'req-7baa6e0b-15ed-4e0a-903e-4ec0fa3f65b7'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-7baa6e0b-15ed-4e0a-903e-4ec0fa3f65b7 None admin] The token cache is being invalidate because project f72e4ec607ca4e899b33f8b656888e37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 12:59:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-7baa6e0b-15ed-4e0a-903e-4ec0fa3f65b7 None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-7baa6e0b-15ed-4e0a-903e-4ec0fa3f65b7 None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:12 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1230/2434] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 12:59:12 2024] DELETE /identity/v3/projects/f72e4ec607ca4e899b33f8b656888e37 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:59:12 l75lg1-v1 neutron-server[77618]: DEBUG neutron.wsgi [-] (77618) accepted ('10.27.203.238', 32790) {{(pid=77618) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 12:59:12 l75lg1-v1 neutron-server[77618]: INFO neutron.wsgi [None req-d76641ec-e80f-4717-9fdc-2027c20c472e None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=8ee1466a8fe242afa8e0d0378840bfc1&name=default HTTP/1.1" status: 200 len: 216 time: 0.0083969 May 28 12:59:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b0236b-2200-4e01-836f-0051bd3783d0 service neutron] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b0236b-2200-4e01-836f-0051bd3783d0 service neutron] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf16da1-d55f-4c30-8d65-954d7806aaf9 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf16da1-d55f-4c30-8d65-954d7806aaf9 None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf16da1-d55f-4c30-8d65-954d7806aaf9 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf16da1-d55f-4c30-8d65-954d7806aaf9 None admin] PATH_INFO: `/v3/projects/8ee1466a8fe242afa8e0d0378840bfc1` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf16da1-d55f-4c30-8d65-954d7806aaf9 None admin] RBAC: Authorizing `identity:delete_project(project_id=8ee1466a8fe242afa8e0d0378840bfc1)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf16da1-d55f-4c30-8d65-954d7806aaf9 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-7bf16da1-d55f-4c30-8d65-954d7806aaf9 None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ee1466a8fe242afa8e0d0378840bfc1', 'request_id': 'req-7bf16da1-d55f-4c30-8d65-954d7806aaf9'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-7bf16da1-d55f-4c30-8d65-954d7806aaf9 None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ee1466a8fe242afa8e0d0378840bfc1', 'request_id': 'req-7bf16da1-d55f-4c30-8d65-954d7806aaf9'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:12 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2603d0ce-3d3e-4ccc-ba4b-fecd694a3f11 tempest-PublicSharesNegativeTest-1466961720 None] <<< [POST] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:59:12 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2603d0ce-3d3e-4ccc-ba4b-fecd694a3f11 tempest-PublicSharesNegativeTest-1466961720 None] Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=0, created='2024-05-28T12:59:11.849624Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='9a916e19-319b-44cb-a4a3-50f5fde37569', id=34, internal=False, is_s3_default_policy=False, name='67a5173e-4e46-4dc2-8375-e9849d8dde4c', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=[], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['*'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['*'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T12:59:12.177274Z', tenant_id=1, tenant_name='default', title='67a5173e-4e46-4dc2-8375-e9849d8dde4c', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/34/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[]) May 28 12:59:12 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2603d0ce-3d3e-4ccc-ba4b-fecd694a3f11 tempest-PublicSharesNegativeTest-1466961720 None] --- [POST] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 12:59:12 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2603d0ce-3d3e-4ccc-ba4b-fecd694a3f11 tempest-PublicSharesNegativeTest-1466961720 None] >>> [GET] https://127.0.0.1:40443/api/quotas/ May 28 12:59:12 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2603d0ce-3d3e-4ccc-ba4b-fecd694a3f11 tempest-PublicSharesNegativeTest-1466961720 None] {'allow_redirects': True, May 28 12:59:12 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2603d0ce-3d3e-4ccc-ba4b-fecd694a3f11 tempest-PublicSharesNegativeTest-1466961720 None] 'params': {'name': '67a5173e-4e46-4dc2-8375-e9849d8dde4c'}} May 28 12:59:12 l75lg1-v1 dstat.sh[49771]: 28-05 12:59:12| 8 1 82 9 0|5735M 1738M 277M 7874M| 12k 1829B| 0 17M| 0 1328 |7585 14k|1.07 1.04 1.01|4.0 2.0 0| 0 0 | 0 2048M| 29 362 0 37 0 May 28 12:59:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-7bf16da1-d55f-4c30-8d65-954d7806aaf9 None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ee1466a8fe242afa8e0d0378840bfc1', 'request_id': 'req-7bf16da1-d55f-4c30-8d65-954d7806aaf9'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-7bf16da1-d55f-4c30-8d65-954d7806aaf9 None admin] The token cache is being invalidate because project 8ee1466a8fe242afa8e0d0378840bfc1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 12:59:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-7bf16da1-d55f-4c30-8d65-954d7806aaf9 None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-7bf16da1-d55f-4c30-8d65-954d7806aaf9 None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:12 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1205/2435] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 12:59:12 2024] DELETE /identity/v3/projects/8ee1466a8fe242afa8e0d0378840bfc1 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:59:12 l75lg1-v1 neutron-server[77618]: DEBUG neutron.wsgi [-] (77618) accepted ('10.27.203.238', 32806) {{(pid=77618) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 12:59:12 l75lg1-v1 neutron-server[77618]: INFO neutron.wsgi [None req-832994ae-8d37-4c3e-8fe7-a41ced1801e7 None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=6d36e1eb1dbc449db6aca75b12a2ba18&name=default HTTP/1.1" status: 200 len: 216 time: 0.0084569 May 28 12:59:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baa6e0b-15ed-4e0a-903e-4ec0fa3f65b7 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-7baa6e0b-15ed-4e0a-903e-4ec0fa3f65b7 None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:59:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baa6e0b-15ed-4e0a-903e-4ec0fa3f65b7 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7093416f-edd7-4edc-baa8-7156a93e2a66 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7093416f-edd7-4edc-baa8-7156a93e2a66 None admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7093416f-edd7-4edc-baa8-7156a93e2a66 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7093416f-edd7-4edc-baa8-7156a93e2a66 None admin] PATH_INFO: `/v3/projects/6d36e1eb1dbc449db6aca75b12a2ba18` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7093416f-edd7-4edc-baa8-7156a93e2a66 None admin] RBAC: Authorizing `identity:delete_project(project_id=6d36e1eb1dbc449db6aca75b12a2ba18)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7093416f-edd7-4edc-baa8-7156a93e2a66 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-7093416f-edd7-4edc-baa8-7156a93e2a66 None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d36e1eb1dbc449db6aca75b12a2ba18', 'request_id': 'req-7093416f-edd7-4edc-baa8-7156a93e2a66'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-7093416f-edd7-4edc-baa8-7156a93e2a66 None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d36e1eb1dbc449db6aca75b12a2ba18', 'request_id': 'req-7093416f-edd7-4edc-baa8-7156a93e2a66'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-7093416f-edd7-4edc-baa8-7156a93e2a66 None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d36e1eb1dbc449db6aca75b12a2ba18', 'request_id': 'req-7093416f-edd7-4edc-baa8-7156a93e2a66'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-7093416f-edd7-4edc-baa8-7156a93e2a66 None admin] The token cache is being invalidate because project 6d36e1eb1dbc449db6aca75b12a2ba18 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 12:59:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-7093416f-edd7-4edc-baa8-7156a93e2a66 None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-7093416f-edd7-4edc-baa8-7156a93e2a66 None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:12 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1231/2436] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 12:59:12 2024] DELETE /identity/v3/projects/6d36e1eb1dbc449db6aca75b12a2ba18 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:59:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b3b6d7-0578-4e92-bc40-af3328b97664 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b3b6d7-0578-4e92-bc40-af3328b97664 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b3b6d7-0578-4e92-bc40-af3328b97664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:12 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-11b3b6d7-0578-4e92-bc40-af3328b97664 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:59:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-11b3b6d7-0578-4e92-bc40-af3328b97664 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:59:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-11b3b6d7-0578-4e92-bc40-af3328b97664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:59:12 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1206/2437] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:59:12 2024] POST /identity/v3/auth/tokens => generated 312 bytes in 19 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 28 12:59:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e254dac5-b9f6-4abd-bada-767715d6e87c None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e254dac5-b9f6-4abd-bada-767715d6e87c None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e254dac5-b9f6-4abd-bada-767715d6e87c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:12 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-e254dac5-b9f6-4abd-bada-767715d6e87c None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:59:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-e254dac5-b9f6-4abd-bada-767715d6e87c None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:59:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-e254dac5-b9f6-4abd-bada-767715d6e87c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:59:12 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1232/2438] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:59:12 2024] POST /identity/v3/auth/tokens => generated 2960 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 12:59:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b3b6d7-0578-4e92-bc40-af3328b97664 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b3b6d7-0578-4e92-bc40-af3328b97664 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e20e94b-3e96-462b-a9f7-534e1778353e None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e20e94b-3e96-462b-a9f7-534e1778353e None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e20e94b-3e96-462b-a9f7-534e1778353e None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e20e94b-3e96-462b-a9f7-534e1778353e None admin] PATH_INFO: `/v3/domains` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e20e94b-3e96-462b-a9f7-534e1778353e None admin] RBAC: Adding query filter params (name=Default) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:59:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e20e94b-3e96-462b-a9f7-534e1778353e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e20e94b-3e96-462b-a9f7-534e1778353e None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:12 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1207/2439] 10.27.203.238 () {62 vars in 1220 bytes} [Tue May 28 12:59:12 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:59:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e254dac5-b9f6-4abd-bada-767715d6e87c None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e254dac5-b9f6-4abd-bada-767715d6e87c None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af549b72-c420-4682-a281-93dd8eb04cb3 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af549b72-c420-4682-a281-93dd8eb04cb3 None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af549b72-c420-4682-a281-93dd8eb04cb3 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af549b72-c420-4682-a281-93dd8eb04cb3 None admin] PATH_INFO: `/v3/projects` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af549b72-c420-4682-a281-93dd8eb04cb3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af549b72-c420-4682-a281-93dd8eb04cb3 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:12 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1233/2440] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 12:59:12 2024] POST /identity/v3/projects => generated 383 bytes in 35 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:59:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e20e94b-3e96-462b-a9f7-534e1778353e None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e20e94b-3e96-462b-a9f7-534e1778353e None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b61d960-bbd5-4551-8ccc-516c078edd07 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b61d960-bbd5-4551-8ccc-516c078edd07 None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b61d960-bbd5-4551-8ccc-516c078edd07 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b61d960-bbd5-4551-8ccc-516c078edd07 None admin] PATH_INFO: `/v3/users` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b61d960-bbd5-4551-8ccc-516c078edd07 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b61d960-bbd5-4551-8ccc-516c078edd07 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:12 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-9b61d960-bbd5-4551-8ccc-516c078edd07 None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 12:59:12 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1208/2441] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 12:59:12 2024] POST /identity/v3/users => generated 300 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:59:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af549b72-c420-4682-a281-93dd8eb04cb3 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af549b72-c420-4682-a281-93dd8eb04cb3 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50f846b-dc06-4cbc-b241-01cd7249fff9 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50f846b-dc06-4cbc-b241-01cd7249fff9 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50f846b-dc06-4cbc-b241-01cd7249fff9 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50f846b-dc06-4cbc-b241-01cd7249fff9 None admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50f846b-dc06-4cbc-b241-01cd7249fff9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50f846b-dc06-4cbc-b241-01cd7249fff9 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:12 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-6cb7da83-796a-4f1a-a8a3-e31a2ef7f556 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] <<< [PATCH] https://127.0.0.1:40443/api/viewpolicies/32/ May 28 12:59:12 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-6cb7da83-796a-4f1a-a8a3-e31a2ef7f556 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=1, created='2024-05-28T12:58:43.845440Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='31b6534b-d142-4561-992f-4f0759db302d', id=32, internal=False, is_s3_default_policy=False, name='7fdd602c-79d0-479c-95a2-336b202c6639', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=['*'], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=[], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=[], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='MODIFYING', sync_time='2024-05-28T12:59:12.064203Z', tenant_id=1, tenant_name='default', title='7fdd602c-79d0-479c-95a2-336b202c6639', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/32/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[]) May 28 12:59:12 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-6cb7da83-796a-4f1a-a8a3-e31a2ef7f556 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] --- [PATCH] https://127.0.0.1:40443/api/viewpolicies/32/: Done May 28 12:59:12 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-6cb7da83-796a-4f1a-a8a3-e31a2ef7f556 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:12 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-6cb7da83-796a-4f1a-a8a3-e31a2ef7f556 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:12 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1234/2442] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 12:59:12 2024] GET /identity/v3/roles => generated 1680 bytes in 17 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:59:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b61d960-bbd5-4551-8ccc-516c078edd07 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b61d960-bbd5-4551-8ccc-516c078edd07 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df58200-0a3a-417c-8ac4-b6c3b324e543 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df58200-0a3a-417c-8ac4-b6c3b324e543 None admin] REQUEST_METHOD: `PUT` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df58200-0a3a-417c-8ac4-b6c3b324e543 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df58200-0a3a-417c-8ac4-b6c3b324e543 None admin] PATH_INFO: `/v3/projects/645fb190404541a78e449c703540d6f8/users/5ca41d036f8a486ea8febc1bc0fe8768/roles/44620cad10ae407c90c91e2c296adb04` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df58200-0a3a-417c-8ac4-b6c3b324e543 None admin] RBAC: Authorizing `identity:create_grant(project_id=645fb190404541a78e449c703540d6f8, user_id=5ca41d036f8a486ea8febc1bc0fe8768, role_id=44620cad10ae407c90c91e2c296adb04)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df58200-0a3a-417c-8ac4-b6c3b324e543 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:12 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-6cb7da83-796a-4f1a-a8a3-e31a2ef7f556 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.038s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:12 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-6cb7da83-796a-4f1a-a8a3-e31a2ef7f556 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:12 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-6cb7da83-796a-4f1a-a8a3-e31a2ef7f556 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:12 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1209/2443] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 12:59:12 2024] PUT /identity/v3/projects/645fb190404541a78e449c703540d6f8/users/5ca41d036f8a486ea8febc1bc0fe8768/roles/44620cad10ae407c90c91e2c296adb04 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:59:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8578ae63-8fa5-4e5a-8cef-79d6fa2344d1 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8578ae63-8fa5-4e5a-8cef-79d6fa2344d1 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8578ae63-8fa5-4e5a-8cef-79d6fa2344d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:12 l75lg1-v1 cinder-volume[85846]: DEBUG dbcounter [-] [85846] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=85846) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:59:12 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-8578ae63-8fa5-4e5a-8cef-79d6fa2344d1 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:59:12 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-6cb7da83-796a-4f1a-a8a3-e31a2ef7f556 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.031s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:12 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-6cb7da83-796a-4f1a-a8a3-e31a2ef7f556 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-8578ae63-8fa5-4e5a-8cef-79d6fa2344d1 None None] MFA Rules not processed for user `5ca41d036f8a486ea8febc1bc0fe8768`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:59:12 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-6cb7da83-796a-4f1a-a8a3-e31a2ef7f556 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-8578ae63-8fa5-4e5a-8cef-79d6fa2344d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:59:12 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-6cb7da83-796a-4f1a-a8a3-e31a2ef7f556 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:12 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-6cb7da83-796a-4f1a-a8a3-e31a2ef7f556 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:12 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-6cb7da83-796a-4f1a-a8a3-e31a2ef7f556 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:12 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-6cb7da83-796a-4f1a-a8a3-e31a2ef7f556 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:12 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-6cb7da83-796a-4f1a-a8a3-e31a2ef7f556 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:12 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-6cb7da83-796a-4f1a-a8a3-e31a2ef7f556 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:12 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-6cb7da83-796a-4f1a-a8a3-e31a2ef7f556 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.037s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:12 l75lg1-v1 manila-share[98474]: INFO manila.share.access [None req-6cb7da83-796a-4f1a-a8a3-e31a2ef7f556 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Access rules were successfully modified for share instance 7fdd602c-79d0-479c-95a2-336b202c6639 belonging to share 72db8769-ece7-42ff-af27-2e778292a9b4. May 28 12:59:12 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1235/2444] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:59:12 2024] POST /identity/v3/auth/tokens => generated 3954 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:59:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df58200-0a3a-417c-8ac4-b6c3b324e543 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df58200-0a3a-417c-8ac4-b6c3b324e543 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54eb33e-3e74-452a-8dc2-37ed918a7df1 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54eb33e-3e74-452a-8dc2-37ed918a7df1 None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54eb33e-3e74-452a-8dc2-37ed918a7df1 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54eb33e-3e74-452a-8dc2-37ed918a7df1 None admin] PATH_INFO: `/v3/projects` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:12 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2603d0ce-3d3e-4ccc-ba4b-fecd694a3f11 tempest-PublicSharesNegativeTest-1466961720 None] <<< [GET] https://127.0.0.1:40443/api/quotas/ May 28 12:59:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54eb33e-3e74-452a-8dc2-37ed918a7df1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:12 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2603d0ce-3d3e-4ccc-ba4b-fecd694a3f11 tempest-PublicSharesNegativeTest-1466961720 None] [] May 28 12:59:12 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2603d0ce-3d3e-4ccc-ba4b-fecd694a3f11 tempest-PublicSharesNegativeTest-1466961720 None] --- [GET] https://127.0.0.1:40443/api/quotas/: Done May 28 12:59:12 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2603d0ce-3d3e-4ccc-ba4b-fecd694a3f11 tempest-PublicSharesNegativeTest-1466961720 None] >>> [POST] https://127.0.0.1:40443/api/quotas/ May 28 12:59:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54eb33e-3e74-452a-8dc2-37ed918a7df1 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:12 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2603d0ce-3d3e-4ccc-ba4b-fecd694a3f11 tempest-PublicSharesNegativeTest-1466961720 None] {'data': '{"name": "67a5173e-4e46-4dc2-8375-e9849d8dde4c", "path": ' May 28 12:59:12 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2603d0ce-3d3e-4ccc-ba4b-fecd694a3f11 tempest-PublicSharesNegativeTest-1466961720 None] '"/manila/manila-67a5173e-4e46-4dc2-8375-e9849d8dde4c", "create_dir": ' May 28 12:59:12 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2603d0ce-3d3e-4ccc-ba4b-fecd694a3f11 tempest-PublicSharesNegativeTest-1466961720 None] 'true, "hard_limit": 1073741824}', May 28 12:59:12 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2603d0ce-3d3e-4ccc-ba4b-fecd694a3f11 tempest-PublicSharesNegativeTest-1466961720 None] 'json': None, May 28 12:59:12 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2603d0ce-3d3e-4ccc-ba4b-fecd694a3f11 tempest-PublicSharesNegativeTest-1466961720 None] 'params': None} May 28 12:59:12 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1210/2445] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 12:59:12 2024] POST /identity/v3/projects => generated 383 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:59:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8578ae63-8fa5-4e5a-8cef-79d6fa2344d1 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8578ae63-8fa5-4e5a-8cef-79d6fa2344d1 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6170be-1f09-4bd2-9b20-2ff46c940513 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6170be-1f09-4bd2-9b20-2ff46c940513 None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6170be-1f09-4bd2-9b20-2ff46c940513 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6170be-1f09-4bd2-9b20-2ff46c940513 None admin] PATH_INFO: `/v3/users` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6170be-1f09-4bd2-9b20-2ff46c940513 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6170be-1f09-4bd2-9b20-2ff46c940513 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:12 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-0e6170be-1f09-4bd2-9b20-2ff46c940513 None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 12:59:12 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1236/2446] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 12:59:12 2024] POST /identity/v3/users => generated 300 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:59:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54eb33e-3e74-452a-8dc2-37ed918a7df1 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54eb33e-3e74-452a-8dc2-37ed918a7df1 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56189c6-e2f3-4a9d-b09a-c22f14c66e18 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56189c6-e2f3-4a9d-b09a-c22f14c66e18 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56189c6-e2f3-4a9d-b09a-c22f14c66e18 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56189c6-e2f3-4a9d-b09a-c22f14c66e18 None admin] PATH_INFO: `/v3/roles` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56189c6-e2f3-4a9d-b09a-c22f14c66e18 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56189c6-e2f3-4a9d-b09a-c22f14c66e18 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:12 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1211/2447] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 12:59:12 2024] GET /identity/v3/roles => generated 1680 bytes in 16 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:59:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6170be-1f09-4bd2-9b20-2ff46c940513 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6170be-1f09-4bd2-9b20-2ff46c940513 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e597a14c-39f2-4f45-8a51-910cecfdd0c1 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e597a14c-39f2-4f45-8a51-910cecfdd0c1 None admin] REQUEST_METHOD: `PUT` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e597a14c-39f2-4f45-8a51-910cecfdd0c1 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e597a14c-39f2-4f45-8a51-910cecfdd0c1 None admin] PATH_INFO: `/v3/projects/4e33c80a983f4bea96588979487da461/users/f7889fe089c24eb495303b272012c99b/roles/44620cad10ae407c90c91e2c296adb04` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e597a14c-39f2-4f45-8a51-910cecfdd0c1 None admin] RBAC: Authorizing `identity:create_grant(project_id=4e33c80a983f4bea96588979487da461, user_id=f7889fe089c24eb495303b272012c99b, role_id=44620cad10ae407c90c91e2c296adb04)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e597a14c-39f2-4f45-8a51-910cecfdd0c1 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:12 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1237/2448] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 12:59:12 2024] PUT /identity/v3/projects/4e33c80a983f4bea96588979487da461/users/f7889fe089c24eb495303b272012c99b/roles/44620cad10ae407c90c91e2c296adb04 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:59:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0b8ecf-2b5e-4696-b20d-8fd7462f7669 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0b8ecf-2b5e-4696-b20d-8fd7462f7669 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0b8ecf-2b5e-4696-b20d-8fd7462f7669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:12 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-ec0b8ecf-2b5e-4696-b20d-8fd7462f7669 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:59:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-ec0b8ecf-2b5e-4696-b20d-8fd7462f7669 None None] MFA Rules not processed for user `f7889fe089c24eb495303b272012c99b`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:59:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-ec0b8ecf-2b5e-4696-b20d-8fd7462f7669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:59:12 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1212/2449] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:59:12 2024] POST /identity/v3/auth/tokens => generated 3954 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:59:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e597a14c-39f2-4f45-8a51-910cecfdd0c1 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e597a14c-39f2-4f45-8a51-910cecfdd0c1 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d2b4b5-c97e-437e-a8d9-c0ad9b3ee795 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d2b4b5-c97e-437e-a8d9-c0ad9b3ee795 None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d2b4b5-c97e-437e-a8d9-c0ad9b3ee795 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d2b4b5-c97e-437e-a8d9-c0ad9b3ee795 None admin] PATH_INFO: `/v3/projects` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d2b4b5-c97e-437e-a8d9-c0ad9b3ee795 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d2b4b5-c97e-437e-a8d9-c0ad9b3ee795 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:13 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1238/2450] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 12:59:12 2024] POST /identity/v3/projects => generated 381 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:59:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0b8ecf-2b5e-4696-b20d-8fd7462f7669 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0b8ecf-2b5e-4696-b20d-8fd7462f7669 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:13 l75lg1-v1 neutron-server[77619]: DEBUG dbcounter [-] [77619] Writing DB stats neutron:SELECT=2 {{(pid=77619) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:59:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a6ff2d-d5d4-4dc1-bf74-e0894c2aa655 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a6ff2d-d5d4-4dc1-bf74-e0894c2aa655 None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a6ff2d-d5d4-4dc1-bf74-e0894c2aa655 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a6ff2d-d5d4-4dc1-bf74-e0894c2aa655 None admin] PATH_INFO: `/v3/users` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a6ff2d-d5d4-4dc1-bf74-e0894c2aa655 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a6ff2d-d5d4-4dc1-bf74-e0894c2aa655 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:13 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-d5a6ff2d-d5d4-4dc1-bf74-e0894c2aa655 None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 12:59:13 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1213/2451] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 12:59:13 2024] POST /identity/v3/users => generated 298 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:59:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d2b4b5-c97e-437e-a8d9-c0ad9b3ee795 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d2b4b5-c97e-437e-a8d9-c0ad9b3ee795 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec59aa28-79d0-4e8b-a430-b7257800f24c None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec59aa28-79d0-4e8b-a430-b7257800f24c None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec59aa28-79d0-4e8b-a430-b7257800f24c None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec59aa28-79d0-4e8b-a430-b7257800f24c None admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec59aa28-79d0-4e8b-a430-b7257800f24c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec59aa28-79d0-4e8b-a430-b7257800f24c None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:13 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-7d3f164c-d63e-4f3f-b1e0-e409f6ef8b94 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] POST http://10.27.203.238/share/v1/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action May 28 12:59:13 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-7d3f164c-d63e-4f3f-b1e0-e409f6ef8b94 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Action body: b'{"os-access_list": null}' {{(pid=98330) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:59:13 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-7d3f164c-d63e-4f3f-b1e0-e409f6ef8b94 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Action: 'action', calling method: ShareController.access_list, body: {"os-access_list": null} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:59:13 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1239/2452] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 12:59:13 2024] GET /identity/v3/roles => generated 1680 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:59:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a6ff2d-d5d4-4dc1-bf74-e0894c2aa655 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a6ff2d-d5d4-4dc1-bf74-e0894c2aa655 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24300820-b82f-4ee7-a206-2a9fb3a05aa6 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24300820-b82f-4ee7-a206-2a9fb3a05aa6 None admin] REQUEST_METHOD: `PUT` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24300820-b82f-4ee7-a206-2a9fb3a05aa6 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24300820-b82f-4ee7-a206-2a9fb3a05aa6 None admin] PATH_INFO: `/v3/projects/16bb859669ab42a3b7cc595a5e30eb2e/users/caee34cb460c4ddcb13e607cbd3fabd9/roles/e7989893488f483baa107be56668c4f8` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:13 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-7d3f164c-d63e-4f3f-b1e0-e409f6ef8b94 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] http://10.27.203.238/share/v1/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action returned with HTTP 200 May 28 12:59:13 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 683/1379] 10.27.203.238 () {64 vars in 1450 bytes} [Tue May 28 12:59:13 2024] POST /share/v1/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action => generated 19 bytes in 27 msecs (HTTP/1.1 200) 6 headers in 229 bytes (1 switches on core 0) May 28 12:59:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24300820-b82f-4ee7-a206-2a9fb3a05aa6 None admin] RBAC: Authorizing `identity:create_grant(project_id=16bb859669ab42a3b7cc595a5e30eb2e, user_id=caee34cb460c4ddcb13e607cbd3fabd9, role_id=e7989893488f483baa107be56668c4f8)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24300820-b82f-4ee7-a206-2a9fb3a05aa6 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:13 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-e1d80d3c-78a0-4dfc-8900-541982a26a86 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] POST http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action May 28 12:59:13 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-e1d80d3c-78a0-4dfc-8900-541982a26a86 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Action body: b'{"allow_access": {"access_type": "ip", "access_to": "1.2.3.4", "access_level": "rw"}}' {{(pid=98329) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:59:13 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-e1d80d3c-78a0-4dfc-8900-541982a26a86 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Action: 'action', calling method: ShareController.allow_access, body: {"allow_access": {"access_type": "ip", "access_to": "1.2.3.4", "access_level": "rw"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:59:13 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1214/2453] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 12:59:13 2024] PUT /identity/v3/projects/16bb859669ab42a3b7cc595a5e30eb2e/users/caee34cb460c4ddcb13e607cbd3fabd9/roles/e7989893488f483baa107be56668c4f8 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:59:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec59aa28-79d0-4e8b-a430-b7257800f24c None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec59aa28-79d0-4e8b-a430-b7257800f24c None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057e9080-8f0e-4773-8f96-a3f527c549a2 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057e9080-8f0e-4773-8f96-a3f527c549a2 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057e9080-8f0e-4773-8f96-a3f527c549a2 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057e9080-8f0e-4773-8f96-a3f527c549a2 None admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057e9080-8f0e-4773-8f96-a3f527c549a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057e9080-8f0e-4773-8f96-a3f527c549a2 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:13 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1240/2454] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 12:59:13 2024] GET /identity/v3/roles => generated 1680 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:59:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24300820-b82f-4ee7-a206-2a9fb3a05aa6 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:13 l75lg1-v1 devstack@m-api.service[98329]: DEBUG oslo_concurrency.lockutils [None req-e1d80d3c-78a0-4dfc-8900-541982a26a86 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98329) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24300820-b82f-4ee7-a206-2a9fb3a05aa6 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:13 l75lg1-v1 devstack@m-api.service[98329]: DEBUG oslo_concurrency.lockutils [None req-e1d80d3c-78a0-4dfc-8900-541982a26a86 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98329) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4669a3cc-c3ef-4dff-a2be-9414560e7e37 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4669a3cc-c3ef-4dff-a2be-9414560e7e37 None admin] REQUEST_METHOD: `PUT` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4669a3cc-c3ef-4dff-a2be-9414560e7e37 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4669a3cc-c3ef-4dff-a2be-9414560e7e37 None admin] PATH_INFO: `/v3/projects/16bb859669ab42a3b7cc595a5e30eb2e/users/caee34cb460c4ddcb13e607cbd3fabd9/roles/e7989893488f483baa107be56668c4f8` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4669a3cc-c3ef-4dff-a2be-9414560e7e37 None admin] RBAC: Authorizing `identity:create_grant(project_id=16bb859669ab42a3b7cc595a5e30eb2e, user_id=caee34cb460c4ddcb13e607cbd3fabd9, role_id=e7989893488f483baa107be56668c4f8)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4669a3cc-c3ef-4dff-a2be-9414560e7e37 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:13 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1215/2455] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 12:59:13 2024] PUT /identity/v3/projects/16bb859669ab42a3b7cc595a5e30eb2e/users/caee34cb460c4ddcb13e607cbd3fabd9/roles/e7989893488f483baa107be56668c4f8 => generated 0 bytes in 19 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:59:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b80f39-52da-4ce1-afb9-2ca0d633b6ad None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b80f39-52da-4ce1-afb9-2ca0d633b6ad None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b80f39-52da-4ce1-afb9-2ca0d633b6ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:13 l75lg1-v1 dstat.sh[49771]: 28-05 12:59:13| 12 1 83 3 0|5735M 1738M 277M 7875M| 15k 5256B| 0 2555k| 0 306 |7992 14k|1.07 1.04 1.01|3.0 0 0| 0 0 | 0 2048M| 29 363 0 38 0 May 28 12:59:13 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-c0b80f39-52da-4ce1-afb9-2ca0d633b6ad None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:59:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-c0b80f39-52da-4ce1-afb9-2ca0d633b6ad None None] MFA Rules not processed for user `caee34cb460c4ddcb13e607cbd3fabd9`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:59:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-c0b80f39-52da-4ce1-afb9-2ca0d633b6ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:59:13 l75lg1-v1 devstack@m-api.service[98329]: DEBUG oslo_concurrency.lockutils [None req-e1d80d3c-78a0-4dfc-8900-541982a26a86 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.051s {{(pid=98329) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:13 l75lg1-v1 manila-share[98474]: DEBUG manila.share.manager [None req-e1d80d3c-78a0-4dfc-8900-541982a26a86 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Received request to update access for share instance 7fdd602c-79d0-479c-95a2-336b202c6639. {{(pid=98474) update_access_for_instances /opt/stack/manila/manila/share/manager.py:4353}} May 28 12:59:13 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-e1d80d3c-78a0-4dfc-8900-541982a26a86 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action returned with HTTP 200 May 28 12:59:13 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 697/1380] 10.27.203.238 () {66 vars in 1492 bytes} [Tue May 28 12:59:13 2024] POST /share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action => generated 193 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:59:13 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-58765856-e447-4f76-9036-1433f7e0874b tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] POST http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action May 28 12:59:13 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-58765856-e447-4f76-9036-1433f7e0874b tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Action body: b'{"access_list": null}' {{(pid=98330) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:59:13 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-58765856-e447-4f76-9036-1433f7e0874b tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Action: 'action', calling method: ShareController.access_list, body: {"access_list": null} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:59:13 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1241/2456] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:59:13 2024] POST /identity/v3/auth/tokens => generated 4075 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:59:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4669a3cc-c3ef-4dff-a2be-9414560e7e37 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:13 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-e1d80d3c-78a0-4dfc-8900-541982a26a86 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:13 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-e1d80d3c-78a0-4dfc-8900-541982a26a86 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4669a3cc-c3ef-4dff-a2be-9414560e7e37 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:13 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-e1d80d3c-78a0-4dfc-8900-541982a26a86 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:13 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-e1d80d3c-78a0-4dfc-8900-541982a26a86 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:13 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-e1d80d3c-78a0-4dfc-8900-541982a26a86 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b7e34b-3d13-49d7-b480-4f3034729c89 tempest-ResourceLockDeleteTest-671583867 tempest-ResourceLockDeleteTest-671583867-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caee34cb460c4ddcb13e607cbd3fabd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16bb859669ab42a3b7cc595a5e30eb2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b7e34b-3d13-49d7-b480-4f3034729c89 tempest-ResourceLockDeleteTest-671583867 tempest-ResourceLockDeleteTest-671583867-project-admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b7e34b-3d13-49d7-b480-4f3034729c89 tempest-ResourceLockDeleteTest-671583867 tempest-ResourceLockDeleteTest-671583867-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b7e34b-3d13-49d7-b480-4f3034729c89 tempest-ResourceLockDeleteTest-671583867 tempest-ResourceLockDeleteTest-671583867-project-admin] PATH_INFO: `/v3/domains` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b7e34b-3d13-49d7-b480-4f3034729c89 tempest-ResourceLockDeleteTest-671583867 tempest-ResourceLockDeleteTest-671583867-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:59:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b7e34b-3d13-49d7-b480-4f3034729c89 tempest-ResourceLockDeleteTest-671583867 tempest-ResourceLockDeleteTest-671583867-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b7e34b-3d13-49d7-b480-4f3034729c89 tempest-ResourceLockDeleteTest-671583867 tempest-ResourceLockDeleteTest-671583867-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:13 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1216/2457] 10.27.203.238 () {62 vars in 1241 bytes} [Tue May 28 12:59:13 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:59:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b80f39-52da-4ce1-afb9-2ca0d633b6ad None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b80f39-52da-4ce1-afb9-2ca0d633b6ad None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e29d77-b4cc-49b7-83be-e55e6660e482 tempest-ResourceLockDeleteTest-671583867 tempest-ResourceLockDeleteTest-671583867-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caee34cb460c4ddcb13e607cbd3fabd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16bb859669ab42a3b7cc595a5e30eb2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e29d77-b4cc-49b7-83be-e55e6660e482 tempest-ResourceLockDeleteTest-671583867 tempest-ResourceLockDeleteTest-671583867-project-admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e29d77-b4cc-49b7-83be-e55e6660e482 tempest-ResourceLockDeleteTest-671583867 tempest-ResourceLockDeleteTest-671583867-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e29d77-b4cc-49b7-83be-e55e6660e482 tempest-ResourceLockDeleteTest-671583867 tempest-ResourceLockDeleteTest-671583867-project-admin] PATH_INFO: `/v3/users` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e29d77-b4cc-49b7-83be-e55e6660e482 tempest-ResourceLockDeleteTest-671583867 tempest-ResourceLockDeleteTest-671583867-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e29d77-b4cc-49b7-83be-e55e6660e482 tempest-ResourceLockDeleteTest-671583867 tempest-ResourceLockDeleteTest-671583867-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:13 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-58765856-e447-4f76-9036-1433f7e0874b tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action returned with HTTP 200 May 28 12:59:13 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 684/1381] 10.27.203.238 () {66 vars in 1492 bytes} [Tue May 28 12:59:13 2024] POST /share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action => generated 148 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:59:13 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-61e29d77-b4cc-49b7-83be-e55e6660e482 tempest-ResourceLockDeleteTest-671583867 tempest-ResourceLockDeleteTest-671583867-project-admin] Truncating password to algorithm specific maximum length 72 characters. May 28 12:59:13 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1242/2458] 10.27.203.238 () {64 vars in 1232 bytes} [Tue May 28 12:59:13 2024] POST /identity/v3/users => generated 433 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:59:13 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-e1d80d3c-78a0-4dfc-8900-541982a26a86 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.055s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:13 l75lg1-v1 manila-share[98474]: DEBUG manila.share.access [None req-e1d80d3c-78a0-4dfc-8900-541982a26a86 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Updating access rules for share instance 7fdd602c-79d0-479c-95a2-336b202c6639 belonging to share 72db8769-ece7-42ff-af27-2e778292a9b4. {{(pid=98474) update_access_rules /opt/stack/manila/manila/share/access.py:298}} May 28 12:59:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b7e34b-3d13-49d7-b480-4f3034729c89 tempest-ResourceLockDeleteTest-671583867 tempest-ResourceLockDeleteTest-671583867-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b7e34b-3d13-49d7-b480-4f3034729c89 tempest-ResourceLockDeleteTest-671583867 tempest-ResourceLockDeleteTest-671583867-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af20f0c-941a-409a-b0a7-b80080bc3425 tempest-ResourceLockDeleteTest-671583867 tempest-ResourceLockDeleteTest-671583867-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caee34cb460c4ddcb13e607cbd3fabd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16bb859669ab42a3b7cc595a5e30eb2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af20f0c-941a-409a-b0a7-b80080bc3425 tempest-ResourceLockDeleteTest-671583867 tempest-ResourceLockDeleteTest-671583867-project-admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af20f0c-941a-409a-b0a7-b80080bc3425 tempest-ResourceLockDeleteTest-671583867 tempest-ResourceLockDeleteTest-671583867-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af20f0c-941a-409a-b0a7-b80080bc3425 tempest-ResourceLockDeleteTest-671583867 tempest-ResourceLockDeleteTest-671583867-project-admin] PATH_INFO: `/v3/roles` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af20f0c-941a-409a-b0a7-b80080bc3425 tempest-ResourceLockDeleteTest-671583867 tempest-ResourceLockDeleteTest-671583867-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af20f0c-941a-409a-b0a7-b80080bc3425 tempest-ResourceLockDeleteTest-671583867 tempest-ResourceLockDeleteTest-671583867-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:13 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1217/2459] 10.27.203.238 () {62 vars in 1210 bytes} [Tue May 28 12:59:13 2024] GET /identity/v3/roles => generated 1680 bytes in 17 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:59:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e29d77-b4cc-49b7-83be-e55e6660e482 tempest-ResourceLockDeleteTest-671583867 tempest-ResourceLockDeleteTest-671583867-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:13 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-e1d80d3c-78a0-4dfc-8900-541982a26a86 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:13 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-e1d80d3c-78a0-4dfc-8900-541982a26a86 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e29d77-b4cc-49b7-83be-e55e6660e482 tempest-ResourceLockDeleteTest-671583867 tempest-ResourceLockDeleteTest-671583867-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b4a455-1dba-435e-813d-7bdad88f2c45 tempest-ResourceLockDeleteTest-671583867 tempest-ResourceLockDeleteTest-671583867-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caee34cb460c4ddcb13e607cbd3fabd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16bb859669ab42a3b7cc595a5e30eb2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b4a455-1dba-435e-813d-7bdad88f2c45 tempest-ResourceLockDeleteTest-671583867 tempest-ResourceLockDeleteTest-671583867-project-admin] REQUEST_METHOD: `PUT` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b4a455-1dba-435e-813d-7bdad88f2c45 tempest-ResourceLockDeleteTest-671583867 tempest-ResourceLockDeleteTest-671583867-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b4a455-1dba-435e-813d-7bdad88f2c45 tempest-ResourceLockDeleteTest-671583867 tempest-ResourceLockDeleteTest-671583867-project-admin] PATH_INFO: `/v3/projects/16bb859669ab42a3b7cc595a5e30eb2e/users/b523155e680a4a14acd4f3a4295a8d26/roles/44620cad10ae407c90c91e2c296adb04` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:13 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-e1d80d3c-78a0-4dfc-8900-541982a26a86 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.008s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:13 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-e1d80d3c-78a0-4dfc-8900-541982a26a86 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:13 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-e1d80d3c-78a0-4dfc-8900-541982a26a86 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b4a455-1dba-435e-813d-7bdad88f2c45 tempest-ResourceLockDeleteTest-671583867 tempest-ResourceLockDeleteTest-671583867-project-admin] RBAC: Authorizing `identity:create_grant(project_id=16bb859669ab42a3b7cc595a5e30eb2e, user_id=b523155e680a4a14acd4f3a4295a8d26, role_id=44620cad10ae407c90c91e2c296adb04)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b4a455-1dba-435e-813d-7bdad88f2c45 tempest-ResourceLockDeleteTest-671583867 tempest-ResourceLockDeleteTest-671583867-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:13 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-e1d80d3c-78a0-4dfc-8900-541982a26a86 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.015s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:13 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-e1d80d3c-78a0-4dfc-8900-541982a26a86 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] changing access on None May 28 12:59:13 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e1d80d3c-78a0-4dfc-8900-541982a26a86 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:59:13 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e1d80d3c-78a0-4dfc-8900-541982a26a86 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] {'allow_redirects': True, May 28 12:59:13 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e1d80d3c-78a0-4dfc-8900-541982a26a86 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] 'params': {'name': '7fdd602c-79d0-479c-95a2-336b202c6639'}} May 28 12:59:13 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1243/2460] 10.27.203.238 () {64 vars in 1571 bytes} [Tue May 28 12:59:13 2024] PUT /identity/v3/projects/16bb859669ab42a3b7cc595a5e30eb2e/users/b523155e680a4a14acd4f3a4295a8d26/roles/44620cad10ae407c90c91e2c296adb04 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:59:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af20f0c-941a-409a-b0a7-b80080bc3425 tempest-ResourceLockDeleteTest-671583867 tempest-ResourceLockDeleteTest-671583867-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-2af20f0c-941a-409a-b0a7-b80080bc3425 tempest-ResourceLockDeleteTest-671583867 tempest-ResourceLockDeleteTest-671583867-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:59:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af20f0c-941a-409a-b0a7-b80080bc3425 tempest-ResourceLockDeleteTest-671583867 tempest-ResourceLockDeleteTest-671583867-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f765b4a-d288-4cfa-bc17-695b543023ae service manila] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f110cf6300f049c897d0aab63218d1e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f765b4a-d288-4cfa-bc17-695b543023ae service manila] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f765b4a-d288-4cfa-bc17-695b543023ae service manila] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f765b4a-d288-4cfa-bc17-695b543023ae service manila] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f765b4a-d288-4cfa-bc17-695b543023ae service manila] RBAC: Authorizing `identity:validate_token()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f765b4a-d288-4cfa-bc17-695b543023ae service manila] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:13 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1218/2461] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 12:59:13 2024] GET /identity/v3/auth/tokens => generated 4075 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 12:59:13 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-8361005e-07a6-4736-bdb7-b231c13e9b5e tempest-ResourceLockDeleteTest-671583867 tempest-ResourceLockDeleteTest-671583867-project-admin] POST http://10.27.203.238/share/v2/16bb859669ab42a3b7cc595a5e30eb2e/types May 28 12:59:13 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-8361005e-07a6-4736-bdb7-b231c13e9b5e tempest-ResourceLockDeleteTest-671583867 tempest-ResourceLockDeleteTest-671583867-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share_type": {"name": "tempest-typeshare-type-600664228", "extra_specs": {"driver_handles_share_servers": "False"}, "share_type_access:is_public": true}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:59:13 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-8361005e-07a6-4736-bdb7-b231c13e9b5e tempest-ResourceLockDeleteTest-671583867 tempest-ResourceLockDeleteTest-671583867-project-admin] http://10.27.203.238/share/v2/16bb859669ab42a3b7cc595a5e30eb2e/types returned with HTTP 200 May 28 12:59:13 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 698/1382] 10.27.203.238 () {66 vars in 1359 bytes} [Tue May 28 12:59:13 2024] POST /share/v2/16bb859669ab42a3b7cc595a5e30eb2e/types => generated 621 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:59:13 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-f21317fd-419e-41de-a5a5-fedd56b73ac4 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] GET http://10.27.203.238/share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/shares/ee66b05f-c433-47ec-899b-b6c21c117e1d May 28 12:59:13 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-f21317fd-419e-41de-a5a5-fedd56b73ac4 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:13 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-f21317fd-419e-41de-a5a5-fedd56b73ac4 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b4a455-1dba-435e-813d-7bdad88f2c45 tempest-ResourceLockDeleteTest-671583867 tempest-ResourceLockDeleteTest-671583867-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b4a455-1dba-435e-813d-7bdad88f2c45 tempest-ResourceLockDeleteTest-671583867 tempest-ResourceLockDeleteTest-671583867-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e37b3d-bb35-489f-8b3e-b4ac1149d3cf service manila] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f110cf6300f049c897d0aab63218d1e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e37b3d-bb35-489f-8b3e-b4ac1149d3cf service manila] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e37b3d-bb35-489f-8b3e-b4ac1149d3cf service manila] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e37b3d-bb35-489f-8b3e-b4ac1149d3cf service manila] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:13 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-f21317fd-419e-41de-a5a5-fedd56b73ac4 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] http://10.27.203.238/share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/shares/ee66b05f-c433-47ec-899b-b6c21c117e1d returned with HTTP 200 May 28 12:59:13 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 685/1383] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:59:13 2024] GET /share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/shares/ee66b05f-c433-47ec-899b-b6c21c117e1d => generated 1367 bytes in 25 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:59:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e37b3d-bb35-489f-8b3e-b4ac1149d3cf service manila] RBAC: Authorizing `identity:validate_token()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e37b3d-bb35-489f-8b3e-b4ac1149d3cf service manila] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:13 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1244/2462] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 12:59:13 2024] GET /identity/v3/auth/tokens => generated 3954 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 12:59:13 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-82e1de9e-1bd0-4e3a-ace8-e1e4f84e9240 tempest-ResourceLockDeleteTest-1157183439 tempest-ResourceLockDeleteTest-1157183439-project-member] POST http://10.27.203.238/share/v2/645fb190404541a78e449c703540d6f8/shares May 28 12:59:13 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-82e1de9e-1bd0-4e3a-ace8-e1e4f84e9240 tempest-ResourceLockDeleteTest-1157183439 tempest-ResourceLockDeleteTest-1157183439-project-member] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share": {"share_proto": "nfs", "description": "Tempest's share", "snapshot_id": null, "name": "tempest-tempest-created-share-1861530640", "size": 1, "metadata": {}, "is_public": false, "share_type": "305c3f64-cb34-4ade-92bf-ec56ac8e48be"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:59:13 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.v1.shares [None req-82e1de9e-1bd0-4e3a-ace8-e1e4f84e9240 tempest-ResourceLockDeleteTest-1157183439 tempest-ResourceLockDeleteTest-1157183439-project-member] Create NFS share of 1 GB May 28 12:59:13 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e1d80d3c-78a0-4dfc-8900-541982a26a86 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:59:13 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.quota [None req-82e1de9e-1bd0-4e3a-ace8-e1e4f84e9240 tempest-ResourceLockDeleteTest-1157183439 tempest-ResourceLockDeleteTest-1157183439-project-member] Created reservations ['1eae640f-ae65-4337-8bdf-9b8ddf239669', 'c85f96b5-1917-4ef9-a8ad-c209435f62c9', '3c3eaf5a-3694-411e-92fc-9885d7ab467a', '18e9e69a-60c2-4916-9d2b-ecdc8c8096f9'] {{(pid=98329) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 12:59:13 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e1d80d3c-78a0-4dfc-8900-541982a26a86 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] [Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=1, created='2024-05-28T12:58:43.845440Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='31b6534b-d142-4561-992f-4f0759db302d', id=32, internal=False, is_s3_default_policy=False, name='7fdd602c-79d0-479c-95a2-336b202c6639', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=['*'], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=[], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=[], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T12:59:12.484405Z', tenant_id=1, tenant_name='default', title='7fdd602c-79d0-479c-95a2-336b202c6639', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/32/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[])] May 28 12:59:13 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e1d80d3c-78a0-4dfc-8900-541982a26a86 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 12:59:13 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-e1d80d3c-78a0-4dfc-8900-541982a26a86 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] changing access on /manila/manila-7fdd602c-79d0-479c-95a2-336b202c6639. Rules: {'nfs_read_write': ['1.2.3.4'], 'nfs_read_only': []} May 28 12:59:13 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e1d80d3c-78a0-4dfc-8900-541982a26a86 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] >>> [PATCH] https://127.0.0.1:40443/api/viewpolicies/32/ May 28 12:59:13 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e1d80d3c-78a0-4dfc-8900-541982a26a86 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] {'data': '{"name": "7fdd602c-79d0-479c-95a2-336b202c6639", "nfs_no_squash": ' May 28 12:59:13 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e1d80d3c-78a0-4dfc-8900-541982a26a86 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] '["*"], "nfs_root_squash": ["*"], "nfs_read_write": ["1.2.3.4"], ' May 28 12:59:13 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e1d80d3c-78a0-4dfc-8900-541982a26a86 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] '"nfs_read_only": []}', May 28 12:59:13 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e1d80d3c-78a0-4dfc-8900-541982a26a86 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] 'params': None} May 28 12:59:13 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-f5876f84-6ac2-462a-a5c3-a73529e21832 tempest-PublicSharesNegativeTest-1466961720 tempest-PublicSharesNegativeTest-1466961720-project-admin] GET http://10.27.203.238/share/v2/6e831d9989b1463da882ee355e32629c/shares/eb49a187-afee-4d13-b48a-a957d46fc910 May 28 12:59:13 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-f5876f84-6ac2-462a-a5c3-a73529e21832 tempest-PublicSharesNegativeTest-1466961720 tempest-PublicSharesNegativeTest-1466961720-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:13 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-f5876f84-6ac2-462a-a5c3-a73529e21832 tempest-PublicSharesNegativeTest-1466961720 tempest-PublicSharesNegativeTest-1466961720-project-admin] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:13 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2603d0ce-3d3e-4ccc-ba4b-fecd694a3f11 tempest-PublicSharesNegativeTest-1466961720 None] <<< [POST] https://127.0.0.1:40443/api/quotas/ May 28 12:59:13 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2603d0ce-3d3e-4ccc-ba4b-fecd694a3f11 tempest-PublicSharesNegativeTest-1466961720 None] Bunch(cluster='loop75-kfs', cluster_id=1, default_email=None, default_group_quota=None, default_user_quota=None, enable_alarms=True, enable_email_providers=True, grace_period=None, group_quotas=[], guid='78437107-ad52-4756-8826-035f1174e6ae', hard_limit=1073741824, hard_limit_inodes=None, id=31, internal=False, is_user_quota=False, last_user_quotas_update=None, name='67a5173e-4e46-4dc2-8375-e9849d8dde4c', num_blocked_users=0, num_exceeded_users=0, path='/manila/manila-67a5173e-4e46-4dc2-8375-e9849d8dde4c', percent_capacity=0, percent_inodes=None, pretty_grace_period=None, pretty_grace_period_expiration=None, pretty_state='OK (CREATED)', soft_limit=None, soft_limit_inodes=None, state='OK', sync_state='CREATED', system_id=31, tenant_id=1, tenant_name='default', time_to_block=None, title='67a5173e-4e46-4dc2-8375-e9849d8dde4c', url='https://127.0.0.1:40443/api/quotas/31/', used_capacity=0, used_capacity_tb=0.0, used_effective_capacity=0, used_effective_capacity_tb=0.0, used_inodes=0, used_limited_capacity=0, user_quotas=[]) May 28 12:59:13 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2603d0ce-3d3e-4ccc-ba4b-fecd694a3f11 tempest-PublicSharesNegativeTest-1466961720 None] --- [POST] https://127.0.0.1:40443/api/quotas/: Done May 28 12:59:13 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2603d0ce-3d3e-4ccc-ba4b-fecd694a3f11 tempest-PublicSharesNegativeTest-1466961720 None] >>> [GET] https://127.0.0.1:40443/api/views/ May 28 12:59:13 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2603d0ce-3d3e-4ccc-ba4b-fecd694a3f11 tempest-PublicSharesNegativeTest-1466961720 None] {'allow_redirects': True, May 28 12:59:13 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2603d0ce-3d3e-4ccc-ba4b-fecd694a3f11 tempest-PublicSharesNegativeTest-1466961720 None] 'params': {'name': '67a5173e-4e46-4dc2-8375-e9849d8dde4c'}} May 28 12:59:13 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-f5876f84-6ac2-462a-a5c3-a73529e21832 tempest-PublicSharesNegativeTest-1466961720 tempest-PublicSharesNegativeTest-1466961720-project-admin] http://10.27.203.238/share/v2/6e831d9989b1463da882ee355e32629c/shares/eb49a187-afee-4d13-b48a-a957d46fc910 returned with HTTP 200 May 28 12:59:13 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 686/1384] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:59:13 2024] GET /share/v2/6e831d9989b1463da882ee355e32629c/shares/eb49a187-afee-4d13-b48a-a957d46fc910 => generated 1357 bytes in 27 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:59:13 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.quota [None req-82e1de9e-1bd0-4e3a-ace8-e1e4f84e9240 tempest-ResourceLockDeleteTest-1157183439 tempest-ResourceLockDeleteTest-1157183439-project-member] Committed reservations ['1eae640f-ae65-4337-8bdf-9b8ddf239669', 'c85f96b5-1917-4ef9-a8ad-c209435f62c9', '3c3eaf5a-3694-411e-92fc-9885d7ab467a', '18e9e69a-60c2-4916-9d2b-ecdc8c8096f9'] {{(pid=98329) commit /opt/stack/manila/manila/quota.py:1063}} May 28 12:59:13 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.host_manager [None req-82e1de9e-1bd0-4e3a-ace8-e1e4f84e9240 tempest-ResourceLockDeleteTest-1157183439 None] Share service is down. (host: l75lg1-v1@generic2). May 28 12:59:13 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.host_manager [None req-82e1de9e-1bd0-4e3a-ace8-e1e4f84e9240 tempest-ResourceLockDeleteTest-1157183439 None] Share service is down. (host: l75lg1-v1@generic1). May 28 12:59:13 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-82e1de9e-1bd0-4e3a-ace8-e1e4f84e9240 tempest-ResourceLockDeleteTest-1157183439 None] Starting with 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:80}} May 28 12:59:13 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-82e1de9e-1bd0-4e3a-ace8-e1e4f84e9240 tempest-ResourceLockDeleteTest-1157183439 None] Filter OnlyHostFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:59:13 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-82e1de9e-1bd0-4e3a-ace8-e1e4f84e9240 tempest-ResourceLockDeleteTest-1157183439 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:59:13 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.capacity [None req-82e1de9e-1bd0-4e3a-ace8-e1e4f84e9240 tempest-ResourceLockDeleteTest-1157183439 None] Space information for share creation on host l75lg1-v1@vast#vast (requested / avail): 1/2080 {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/capacity.py:83}} May 28 12:59:13 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-82e1de9e-1bd0-4e3a-ace8-e1e4f84e9240 tempest-ResourceLockDeleteTest-1157183439 None] Filter CapacityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:59:13 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-82e1de9e-1bd0-4e3a-ace8-e1e4f84e9240 tempest-ResourceLockDeleteTest-1157183439 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:59:13 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-82e1de9e-1bd0-4e3a-ace8-e1e4f84e9240 tempest-ResourceLockDeleteTest-1157183439 None] Driver Filter: Checking host 'l75lg1-v1@vast#vast' {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:37}} May 28 12:59:13 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-82e1de9e-1bd0-4e3a-ace8-e1e4f84e9240 tempest-ResourceLockDeleteTest-1157183439 None] Filter function not set :: passing host. {{(pid=98327) _check_filter_function /opt/stack/manila/manila/scheduler/filters/driver.py:53}} May 28 12:59:13 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-82e1de9e-1bd0-4e3a-ace8-e1e4f84e9240 tempest-ResourceLockDeleteTest-1157183439 None] Result: True {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:40}} May 28 12:59:13 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-82e1de9e-1bd0-4e3a-ace8-e1e4f84e9240 tempest-ResourceLockDeleteTest-1157183439 None] Done checking host 'l75lg1-v1@vast#vast' {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:41}} May 28 12:59:13 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-82e1de9e-1bd0-4e3a-ace8-e1e4f84e9240 tempest-ResourceLockDeleteTest-1157183439 None] Filter DriverFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:59:13 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-82e1de9e-1bd0-4e3a-ace8-e1e4f84e9240 tempest-ResourceLockDeleteTest-1157183439 None] Filter ShareReplicationFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:59:13 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-82e1de9e-1bd0-4e3a-ace8-e1e4f84e9240 tempest-ResourceLockDeleteTest-1157183439 None] Filter CreateFromSnapshotFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:59:13 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-82e1de9e-1bd0-4e3a-ace8-e1e4f84e9240 tempest-ResourceLockDeleteTest-1157183439 None] Filter AffinityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:59:13 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-82e1de9e-1bd0-4e3a-ace8-e1e4f84e9240 tempest-ResourceLockDeleteTest-1157183439 None] Filter AntiAffinityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:59:13 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.drivers.filter [None req-82e1de9e-1bd0-4e3a-ace8-e1e4f84e9240 tempest-ResourceLockDeleteTest-1157183439 None] Filtered share [host: 'l75lg1-v1@vast#vast', free_capacity_gb: 2080.64910808485, pools: None] {{(pid=98327) _schedule_share /opt/stack/manila/manila/scheduler/drivers/filter.py:268}} May 28 12:59:13 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-82e1de9e-1bd0-4e3a-ace8-e1e4f84e9240 tempest-ResourceLockDeleteTest-1157183439 None] Checking host 'l75lg1-v1@vast#vast' {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:46}} May 28 12:59:13 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.weighers.goodness [None req-82e1de9e-1bd0-4e3a-ace8-e1e4f84e9240 tempest-ResourceLockDeleteTest-1157183439 None] Goodness function not set :: defaulting to minimal goodness rating of 0. May 28 12:59:13 l75lg1-v1 manila-scheduler[98327]: INFO manila.scheduler.weighers.goodness [None req-82e1de9e-1bd0-4e3a-ace8-e1e4f84e9240 tempest-ResourceLockDeleteTest-1157183439 None] Goodness function result for host l75lg1-v1@vast#vast: 0. May 28 12:59:13 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-82e1de9e-1bd0-4e3a-ace8-e1e4f84e9240 tempest-ResourceLockDeleteTest-1157183439 None] Goodness: 0 {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:48}} May 28 12:59:13 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-82e1de9e-1bd0-4e3a-ace8-e1e4f84e9240 tempest-ResourceLockDeleteTest-1157183439 None] Done checking host 'l75lg1-v1@vast#vast' {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:49}} May 28 12:59:13 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.drivers.filter [None req-82e1de9e-1bd0-4e3a-ace8-e1e4f84e9240 tempest-ResourceLockDeleteTest-1157183439 None] Choosing for share: WeighedHost [host: l75lg1-v1@vast#vast, weight: 0.0] {{(pid=98327) _schedule_share /opt/stack/manila/manila/scheduler/drivers/filter.py:274}} May 28 12:59:13 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-82e1de9e-1bd0-4e3a-ace8-e1e4f84e9240 tempest-ResourceLockDeleteTest-1157183439 tempest-ResourceLockDeleteTest-1157183439-project-member] http://10.27.203.238/share/v2/645fb190404541a78e449c703540d6f8/shares returned with HTTP 200 May 28 12:59:13 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 699/1385] 10.27.203.238 () {66 vars in 1362 bytes} [Tue May 28 12:59:13 2024] POST /share/v2/645fb190404541a78e449c703540d6f8/shares => generated 1312 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:59:13 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-92cb923a-4a82-4109-bc10-c4659eef14ea tempest-ResourceLockDeleteTest-1157183439 tempest-ResourceLockDeleteTest-1157183439-project-member] GET http://10.27.203.238/share/v2/645fb190404541a78e449c703540d6f8/shares/ed309fc1-d1ff-4352-a44a-a56b44eb8d0e May 28 12:59:13 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-92cb923a-4a82-4109-bc10-c4659eef14ea tempest-ResourceLockDeleteTest-1157183439 tempest-ResourceLockDeleteTest-1157183439-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:13 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-92cb923a-4a82-4109-bc10-c4659eef14ea tempest-ResourceLockDeleteTest-1157183439 tempest-ResourceLockDeleteTest-1157183439-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:13 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-92cb923a-4a82-4109-bc10-c4659eef14ea tempest-ResourceLockDeleteTest-1157183439 tempest-ResourceLockDeleteTest-1157183439-project-member] http://10.27.203.238/share/v2/645fb190404541a78e449c703540d6f8/shares/ed309fc1-d1ff-4352-a44a-a56b44eb8d0e returned with HTTP 200 May 28 12:59:13 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 687/1386] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:59:13 2024] GET /share/v2/645fb190404541a78e449c703540d6f8/shares/ed309fc1-d1ff-4352-a44a-a56b44eb8d0e => generated 1312 bytes in 27 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:59:14 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-82e1de9e-1bd0-4e3a-ace8-e1e4f84e9240 tempest-ResourceLockDeleteTest-1157183439 None] >>> [GET] https://127.0.0.1:40443/api/vippools/ May 28 12:59:14 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-82e1de9e-1bd0-4e3a-ace8-e1e4f84e9240 tempest-ResourceLockDeleteTest-1157183439 None] {'allow_redirects': True, 'params': {'name': 'vippool-1'}} May 28 12:59:14 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-56d7b8b2-bce1-424b-b4f4-a56dcb1b5cf9 tempest-ShareIpRulesForNFSTest-1748669711 None] <<< [PATCH] https://127.0.0.1:40443/api/viewpolicies/21/ May 28 12:59:14 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-56d7b8b2-bce1-424b-b4f4-a56dcb1b5cf9 tempest-ShareIpRulesForNFSTest-1748669711 None] Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=1, created='2024-05-28T12:57:40.763635Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='377955ad-d094-4e49-ab32-1021d943a572', id=21, internal=False, is_s3_default_policy=False, name='b7a7d61c-2cea-442a-9809-507038e080d5', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=['*'], nfs_posix_acl=False, nfs_read_only=['2.2.2.2'], nfs_read_write=[], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=['2.2.2.2'], read_write=[], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='MODIFYING', sync_time='2024-05-28T12:59:13.183375Z', tenant_id=1, tenant_name='default', title='b7a7d61c-2cea-442a-9809-507038e080d5', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/21/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[]) May 28 12:59:14 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-56d7b8b2-bce1-424b-b4f4-a56dcb1b5cf9 tempest-ShareIpRulesForNFSTest-1748669711 None] --- [PATCH] https://127.0.0.1:40443/api/viewpolicies/21/: Done May 28 12:59:14 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-56d7b8b2-bce1-424b-b4f4-a56dcb1b5cf9 tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:14 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-56d7b8b2-bce1-424b-b4f4-a56dcb1b5cf9 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:14 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2603d0ce-3d3e-4ccc-ba4b-fecd694a3f11 tempest-PublicSharesNegativeTest-1466961720 None] <<< [GET] https://127.0.0.1:40443/api/views/ May 28 12:59:14 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2603d0ce-3d3e-4ccc-ba4b-fecd694a3f11 tempest-PublicSharesNegativeTest-1466961720 None] [] May 28 12:59:14 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2603d0ce-3d3e-4ccc-ba4b-fecd694a3f11 tempest-PublicSharesNegativeTest-1466961720 None] --- [GET] https://127.0.0.1:40443/api/views/: Done May 28 12:59:14 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2603d0ce-3d3e-4ccc-ba4b-fecd694a3f11 tempest-PublicSharesNegativeTest-1466961720 None] >>> [POST] https://127.0.0.1:40443/api/views/ May 28 12:59:14 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-7d689c0a-081f-4f33-b79e-f7509f5be826 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] POST http://10.27.203.238/share/v1/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action May 28 12:59:14 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2603d0ce-3d3e-4ccc-ba4b-fecd694a3f11 tempest-PublicSharesNegativeTest-1466961720 None] {'data': '{"name": "67a5173e-4e46-4dc2-8375-e9849d8dde4c", "path": ' May 28 12:59:14 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-7d689c0a-081f-4f33-b79e-f7509f5be826 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Action body: b'{"os-access_list": null}' {{(pid=98329) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:59:14 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-7d689c0a-081f-4f33-b79e-f7509f5be826 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Action: 'action', calling method: ShareController.access_list, body: {"os-access_list": null} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:59:14 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2603d0ce-3d3e-4ccc-ba4b-fecd694a3f11 tempest-PublicSharesNegativeTest-1466961720 None] '"/manila/manila-67a5173e-4e46-4dc2-8375-e9849d8dde4c", "policy_id": ' May 28 12:59:14 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2603d0ce-3d3e-4ccc-ba4b-fecd694a3f11 tempest-PublicSharesNegativeTest-1466961720 None] '34, "create_dir": true, "protocols": ["NFS"]}', May 28 12:59:14 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2603d0ce-3d3e-4ccc-ba4b-fecd694a3f11 tempest-PublicSharesNegativeTest-1466961720 None] 'json': None, May 28 12:59:14 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2603d0ce-3d3e-4ccc-ba4b-fecd694a3f11 tempest-PublicSharesNegativeTest-1466961720 None] 'params': None} May 28 12:59:14 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-56d7b8b2-bce1-424b-b4f4-a56dcb1b5cf9 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.085s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:14 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-56d7b8b2-bce1-424b-b4f4-a56dcb1b5cf9 tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:14 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-56d7b8b2-bce1-424b-b4f4-a56dcb1b5cf9 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:14 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-56d7b8b2-bce1-424b-b4f4-a56dcb1b5cf9 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:14 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-56d7b8b2-bce1-424b-b4f4-a56dcb1b5cf9 tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:14 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-56d7b8b2-bce1-424b-b4f4-a56dcb1b5cf9 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:14 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-56d7b8b2-bce1-424b-b4f4-a56dcb1b5cf9 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:14 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-56d7b8b2-bce1-424b-b4f4-a56dcb1b5cf9 tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:14 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-56d7b8b2-bce1-424b-b4f4-a56dcb1b5cf9 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:14 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-7d689c0a-081f-4f33-b79e-f7509f5be826 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] http://10.27.203.238/share/v1/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action returned with HTTP 200 May 28 12:59:14 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 700/1387] 10.27.203.238 () {64 vars in 1450 bytes} [Tue May 28 12:59:14 2024] POST /share/v1/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action => generated 148 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:59:14 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-56d7b8b2-bce1-424b-b4f4-a56dcb1b5cf9 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:14 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-56d7b8b2-bce1-424b-b4f4-a56dcb1b5cf9 tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:14 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-56d7b8b2-bce1-424b-b4f4-a56dcb1b5cf9 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:14 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-56d7b8b2-bce1-424b-b4f4-a56dcb1b5cf9 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.038s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:14 l75lg1-v1 manila-share[98474]: INFO manila.share.access [None req-56d7b8b2-bce1-424b-b4f4-a56dcb1b5cf9 tempest-ShareIpRulesForNFSTest-1748669711 None] Access rules were successfully modified for share instance b7a7d61c-2cea-442a-9809-507038e080d5 belonging to share 1ddadc17-cf10-4a42-8bbd-8335fb3520a1. May 28 12:59:14 l75lg1-v1 dstat.sh[49771]: 28-05 12:59:14| 12 2 83 3 0|5736M 1736M 277M 7876M| 18k 4354B| 0 2230k| 0 306 |6746 12k|1.07 1.04 1.01|1.0 2.0 0| 0 0 | 0 2048M| 29 361 0 38 0 May 28 12:59:14 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-82e1de9e-1bd0-4e3a-ace8-e1e4f84e9240 tempest-ResourceLockDeleteTest-1157183439 None] <<< [GET] https://127.0.0.1:40443/api/vippools/ May 28 12:59:14 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-82e1de9e-1bd0-4e3a-ace8-e1e4f84e9240 tempest-ResourceLockDeleteTest-1157183439 None] [Bunch(active_cnode_ids=[], active_interfaces=4, cluster='loop75-kfs', cluster_id=1, cnode_ids=[], cnodes=[], domain_name='vippool-1', enable_l3=False, enable_weighted_balancing=False, enabled=True, end_ip='172.21.75.4', guid='f2abaede-b397-413a-8faa-3aeead6d3b28', gw_ip='', gw_ipv6='', id=2, ip_ranges=[['172.21.75.1', '172.21.75.4']], name='vippool-1', peer_asn=0, port_membership='ALL', ranges_summary='172.21.75.[1-4]', role='PROTOCOLS', start_ip='172.21.75.1', subnet_cidr=16, subnet_cidr_ipv6=None, sync='SYNCED', sync_time='2024-05-28T12:50:09.644123Z', tenant_id=1, tenant_name='default', title='172.21.75.1 - 172.21.75.4', url='https://127.0.0.1:40443/api/vippools/2/', vast_asn=0, vlan=0, vms_preferred=False)] May 28 12:59:14 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-82e1de9e-1bd0-4e3a-ace8-e1e4f84e9240 tempest-ResourceLockDeleteTest-1157183439 None] --- [GET] https://127.0.0.1:40443/api/vippools/: Done May 28 12:59:14 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-82e1de9e-1bd0-4e3a-ace8-e1e4f84e9240 tempest-ResourceLockDeleteTest-1157183439 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:59:14 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-82e1de9e-1bd0-4e3a-ace8-e1e4f84e9240 tempest-ResourceLockDeleteTest-1157183439 None] {'allow_redirects': True, May 28 12:59:14 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-82e1de9e-1bd0-4e3a-ace8-e1e4f84e9240 tempest-ResourceLockDeleteTest-1157183439 None] 'params': {'name': '9fadf39f-1d93-4ddd-bd00-1fd7ccc09539'}} May 28 12:59:14 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-82e1de9e-1bd0-4e3a-ace8-e1e4f84e9240 tempest-ResourceLockDeleteTest-1157183439 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:59:14 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-82e1de9e-1bd0-4e3a-ace8-e1e4f84e9240 tempest-ResourceLockDeleteTest-1157183439 None] [] May 28 12:59:14 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-82e1de9e-1bd0-4e3a-ace8-e1e4f84e9240 tempest-ResourceLockDeleteTest-1157183439 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 12:59:14 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-82e1de9e-1bd0-4e3a-ace8-e1e4f84e9240 tempest-ResourceLockDeleteTest-1157183439 None] >>> [POST] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:59:14 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-82e1de9e-1bd0-4e3a-ace8-e1e4f84e9240 tempest-ResourceLockDeleteTest-1157183439 None] {'data': '{"name": "9fadf39f-1d93-4ddd-bd00-1fd7ccc09539"}', May 28 12:59:14 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-82e1de9e-1bd0-4e3a-ace8-e1e4f84e9240 tempest-ResourceLockDeleteTest-1157183439 None] 'json': None, May 28 12:59:14 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-82e1de9e-1bd0-4e3a-ace8-e1e4f84e9240 tempest-ResourceLockDeleteTest-1157183439 None] 'params': None} May 28 12:59:15 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2603d0ce-3d3e-4ccc-ba4b-fecd694a3f11 tempest-PublicSharesNegativeTest-1466961720 None] <<< [POST] https://127.0.0.1:40443/api/views/ May 28 12:59:15 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2603d0ce-3d3e-4ccc-ba4b-fecd694a3f11 tempest-PublicSharesNegativeTest-1466961720 None] Bunch(abac_tags=[], abe_max_depth=None, abe_protocols=[], alias='', allow_anonymous_access=False, allow_s3_anonymous_access=False, auto_commit='0d', bucket='', bucket_creators=[], bucket_creators_groups=[], bucket_owner=None, bulk_permission_update_progress=None, bulk_permission_update_state=None, cluster='loop75-kfs', cluster_id=1, created='2024-05-28T12:59:14.866595Z', enabled=True, files_retention_mode='NONE', guid='da0a0ec0-2b45-46d4-a798-76729b7020f2', id=33, ignore_oos=False, internal=False, is_remote=False, is_seamless=False, logical_capacity=0, max_retention_period=None, min_retention_period=None, name='67a5173e-4e46-4dc2-8375-e9849d8dde4c', nfs_interop_flags='BOTH_NFS3_AND_NFS4_INTEROP_DISABLED', path='/manila/manila-67a5173e-4e46-4dc2-8375-e9849d8dde4c', physical_capacity=0, policy='67a5173e-4e46-4dc2-8375-e9849d8dde4c', policy_id=34, protocols=['NFS'], qos_policy=None, qos_policy_id=None, s3_locks=False, s3_locks_retention_mode='NONE', s3_locks_retention_period='', s3_object_ownership_rule='ObjectWriter', s3_unverified_lookup=False, s3_versioning=False, select_for_live_monitoring=False, share='', share_acl=Bunch(acl=[], enabled=False), sync='SYNCED', sync_time='2024-05-28T12:59:15.144852Z', tenant_id=1, tenant_name='default', title='/manila/manila-67a5173e-4e46-4dc2-8375-e9849d8dde4c', url='https://127.0.0.1:40443/api/views/33/') May 28 12:59:15 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2603d0ce-3d3e-4ccc-ba4b-fecd694a3f11 tempest-PublicSharesNegativeTest-1466961720 None] --- [POST] https://127.0.0.1:40443/api/views/: Done May 28 12:59:15 l75lg1-v1 dstat.sh[49771]: 28-05 12:59:15| 1 0 97 1 0|5735M 1736M 277M 7876M| 17k 1736B| 0 1044k| 0 80.0 |2105 3376 |1.07 1.04 1.01|2.0 2.0 0| 0 0 | 0 2048M| 29 361 0 38 0 May 28 12:59:15 l75lg1-v1 manila-share[98474]: INFO manila.share.manager [None req-2603d0ce-3d3e-4ccc-ba4b-fecd694a3f11 tempest-PublicSharesNegativeTest-1466961720 None] Share instance 67a5173e-4e46-4dc2-8375-e9849d8dde4c created successfully. May 28 12:59:15 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-82e1de9e-1bd0-4e3a-ace8-e1e4f84e9240 tempest-ResourceLockDeleteTest-1157183439 None] <<< [POST] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:59:15 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-82e1de9e-1bd0-4e3a-ace8-e1e4f84e9240 tempest-ResourceLockDeleteTest-1157183439 None] Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=0, created='2024-05-28T12:59:15.263062Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='2df40b6b-03c5-491b-921f-16f9c8236d3b', id=35, internal=False, is_s3_default_policy=False, name='9fadf39f-1d93-4ddd-bd00-1fd7ccc09539', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=[], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['*'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['*'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T12:59:15.569875Z', tenant_id=1, tenant_name='default', title='9fadf39f-1d93-4ddd-bd00-1fd7ccc09539', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/35/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[]) May 28 12:59:15 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-82e1de9e-1bd0-4e3a-ace8-e1e4f84e9240 tempest-ResourceLockDeleteTest-1157183439 None] --- [POST] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 12:59:15 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-82e1de9e-1bd0-4e3a-ace8-e1e4f84e9240 tempest-ResourceLockDeleteTest-1157183439 None] >>> [GET] https://127.0.0.1:40443/api/quotas/ May 28 12:59:15 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-82e1de9e-1bd0-4e3a-ace8-e1e4f84e9240 tempest-ResourceLockDeleteTest-1157183439 None] {'allow_redirects': True, May 28 12:59:15 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-82e1de9e-1bd0-4e3a-ace8-e1e4f84e9240 tempest-ResourceLockDeleteTest-1157183439 None] 'params': {'name': '9fadf39f-1d93-4ddd-bd00-1fd7ccc09539'}} May 28 12:59:15 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e1d80d3c-78a0-4dfc-8900-541982a26a86 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] <<< [PATCH] https://127.0.0.1:40443/api/viewpolicies/32/ May 28 12:59:15 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e1d80d3c-78a0-4dfc-8900-541982a26a86 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=1, created='2024-05-28T12:58:43.845440Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='31b6534b-d142-4561-992f-4f0759db302d', id=32, internal=False, is_s3_default_policy=False, name='7fdd602c-79d0-479c-95a2-336b202c6639', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=['*'], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['1.2.3.4'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['1.2.3.4'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='MODIFYING', sync_time='2024-05-28T12:59:14.920894Z', tenant_id=1, tenant_name='default', title='7fdd602c-79d0-479c-95a2-336b202c6639', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/32/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[]) May 28 12:59:15 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e1d80d3c-78a0-4dfc-8900-541982a26a86 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] --- [PATCH] https://127.0.0.1:40443/api/viewpolicies/32/: Done May 28 12:59:15 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-e1d80d3c-78a0-4dfc-8900-541982a26a86 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:15 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-e1d80d3c-78a0-4dfc-8900-541982a26a86 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:15 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-e1d80d3c-78a0-4dfc-8900-541982a26a86 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.055s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:15 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-e1d80d3c-78a0-4dfc-8900-541982a26a86 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:15 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-e1d80d3c-78a0-4dfc-8900-541982a26a86 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:15 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-e1d80d3c-78a0-4dfc-8900-541982a26a86 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:15 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-e1d80d3c-78a0-4dfc-8900-541982a26a86 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:15 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-e1d80d3c-78a0-4dfc-8900-541982a26a86 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:15 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-e1d80d3c-78a0-4dfc-8900-541982a26a86 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:15 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-e1d80d3c-78a0-4dfc-8900-541982a26a86 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:15 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-e1d80d3c-78a0-4dfc-8900-541982a26a86 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:15 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-e1d80d3c-78a0-4dfc-8900-541982a26a86 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:15 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-e1d80d3c-78a0-4dfc-8900-541982a26a86 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:15 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-e1d80d3c-78a0-4dfc-8900-541982a26a86 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:15 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-e1d80d3c-78a0-4dfc-8900-541982a26a86 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.036s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:15 l75lg1-v1 manila-share[98474]: INFO manila.share.access [None req-e1d80d3c-78a0-4dfc-8900-541982a26a86 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Access rules were successfully modified for share instance 7fdd602c-79d0-479c-95a2-336b202c6639 belonging to share 72db8769-ece7-42ff-af27-2e778292a9b4. May 28 12:59:16 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-82e1de9e-1bd0-4e3a-ace8-e1e4f84e9240 tempest-ResourceLockDeleteTest-1157183439 None] <<< [GET] https://127.0.0.1:40443/api/quotas/ May 28 12:59:16 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-82e1de9e-1bd0-4e3a-ace8-e1e4f84e9240 tempest-ResourceLockDeleteTest-1157183439 None] [] May 28 12:59:16 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-82e1de9e-1bd0-4e3a-ace8-e1e4f84e9240 tempest-ResourceLockDeleteTest-1157183439 None] --- [GET] https://127.0.0.1:40443/api/quotas/: Done May 28 12:59:16 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-82e1de9e-1bd0-4e3a-ace8-e1e4f84e9240 tempest-ResourceLockDeleteTest-1157183439 None] >>> [POST] https://127.0.0.1:40443/api/quotas/ May 28 12:59:16 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-82e1de9e-1bd0-4e3a-ace8-e1e4f84e9240 tempest-ResourceLockDeleteTest-1157183439 None] {'data': '{"name": "9fadf39f-1d93-4ddd-bd00-1fd7ccc09539", "path": ' May 28 12:59:16 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-82e1de9e-1bd0-4e3a-ace8-e1e4f84e9240 tempest-ResourceLockDeleteTest-1157183439 None] '"/manila/manila-9fadf39f-1d93-4ddd-bd00-1fd7ccc09539", "create_dir": ' May 28 12:59:16 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-82e1de9e-1bd0-4e3a-ace8-e1e4f84e9240 tempest-ResourceLockDeleteTest-1157183439 None] 'true, "hard_limit": 1073741824}', May 28 12:59:16 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-82e1de9e-1bd0-4e3a-ace8-e1e4f84e9240 tempest-ResourceLockDeleteTest-1157183439 None] 'json': None, May 28 12:59:16 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-82e1de9e-1bd0-4e3a-ace8-e1e4f84e9240 tempest-ResourceLockDeleteTest-1157183439 None] 'params': None} May 28 12:59:16 l75lg1-v1 dstat.sh[49771]: 28-05 12:59:16| 2 0 96 1 0|5735M 1736M 277M 7876M| 25k 1734B| 0 1180k| 0 121 |2880 4543 |1.07 1.04 1.01|1.0 2.0 0| 0 0 | 0 2048M| 29 361 0 37 0 May 28 12:59:16 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-65858a45-6d3f-4f78-9812-8e949271bd25 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] POST http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action May 28 12:59:16 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-65858a45-6d3f-4f78-9812-8e949271bd25 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Action body: b'{"access_list": null}' {{(pid=98330) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:59:16 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-65858a45-6d3f-4f78-9812-8e949271bd25 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Action: 'action', calling method: ShareController.access_list, body: {"access_list": null} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:59:16 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-65858a45-6d3f-4f78-9812-8e949271bd25 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action returned with HTTP 200 May 28 12:59:16 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 688/1388] 10.27.203.238 () {66 vars in 1492 bytes} [Tue May 28 12:59:16 2024] POST /share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action => generated 151 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:59:16 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-cc94a747-5386-4a76-9e5c-d521fde6a732 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] POST http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action May 28 12:59:16 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-cc94a747-5386-4a76-9e5c-d521fde6a732 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Action body: b'{"allow_access": {"access_type": "ip", "access_to": "1.2.3.4", "access_level": null}}' {{(pid=98329) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:59:16 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-cc94a747-5386-4a76-9e5c-d521fde6a732 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Action: 'action', calling method: ShareController.allow_access, body: {"allow_access": {"access_type": "ip", "access_to": "1.2.3.4", "access_level": null}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:59:16 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-cc94a747-5386-4a76-9e5c-d521fde6a732 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] HTTP exception thrown: Share access ip:1.2.3.4 exists. May 28 12:59:16 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-cc94a747-5386-4a76-9e5c-d521fde6a732 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action returned with HTTP 400 May 28 12:59:16 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 701/1389] 10.27.203.238 () {66 vars in 1492 bytes} [Tue May 28 12:59:16 2024] POST /share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action => generated 75 bytes in 37 msecs (HTTP/1.1 400) 6 headers in 238 bytes (1 switches on core 0) May 28 12:59:16 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-7e8b4f97-febd-49b1-9cf4-b4f7260e2e3d tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] POST http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action May 28 12:59:16 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-7e8b4f97-febd-49b1-9cf4-b4f7260e2e3d tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Action body: b'{"deny_access": {"access_id": "53526cbe-c8bd-4921-9e5e-b7125df0092a"}}' {{(pid=98330) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:59:16 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-7e8b4f97-febd-49b1-9cf4-b4f7260e2e3d tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Action: 'action', calling method: ShareController.deny_access, body: {"deny_access": {"access_id": "53526cbe-c8bd-4921-9e5e-b7125df0092a"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:59:16 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.lock.api [None req-7e8b4f97-febd-49b1-9cf4-b4f7260e2e3d tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Searching for locks by: {'resource_id': '53526cbe-c8bd-4921-9e5e-b7125df0092a', 'resource_action': 'delete'} {{(pid=98330) get_all /opt/stack/manila/manila/lock/api.py:112}} May 28 12:59:16 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-7e8b4f97-febd-49b1-9cf4-b4f7260e2e3d tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:16 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-7e8b4f97-febd-49b1-9cf4-b4f7260e2e3d tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:16 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-7e8b4f97-febd-49b1-9cf4-b4f7260e2e3d tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.044s {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:16 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-7e8b4f97-febd-49b1-9cf4-b4f7260e2e3d tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:16 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-7e8b4f97-febd-49b1-9cf4-b4f7260e2e3d tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:16 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-443900f8-fb87-4a8e-97c0-d021f65a1b35 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] GET http://10.27.203.238/share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/messages May 28 12:59:16 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-443900f8-fb87-4a8e-97c0-d021f65a1b35 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:16 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-443900f8-fb87-4a8e-97c0-d021f65a1b35 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:16 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.message.api [None req-443900f8-fb87-4a8e-97c0-d021f65a1b35 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Searching for messages by: MultiDict([]) {{(pid=98329) get_all /opt/stack/manila/manila/message/api.py:78}} May 28 12:59:16 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-443900f8-fb87-4a8e-97c0-d021f65a1b35 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] http://10.27.203.238/share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/messages returned with HTTP 200 May 28 12:59:16 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 702/1390] 10.27.203.238 () {64 vars in 1346 bytes} [Tue May 28 12:59:16 2024] GET /share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/messages => generated 1616 bytes in 10 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:59:16 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-4c21a61e-ef51-47e3-a83a-75ddd8b588ed tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] GET http://10.27.203.238/share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/messages May 28 12:59:16 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-4c21a61e-ef51-47e3-a83a-75ddd8b588ed tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:16 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-4c21a61e-ef51-47e3-a83a-75ddd8b588ed tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:16 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.message.api [None req-4c21a61e-ef51-47e3-a83a-75ddd8b588ed tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Searching for messages by: MultiDict([]) {{(pid=98329) get_all /opt/stack/manila/manila/message/api.py:78}} May 28 12:59:16 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-4c21a61e-ef51-47e3-a83a-75ddd8b588ed tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] http://10.27.203.238/share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/messages returned with HTTP 200 May 28 12:59:16 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 703/1391] 10.27.203.238 () {64 vars in 1346 bytes} [Tue May 28 12:59:16 2024] GET /share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/messages => generated 1616 bytes in 9 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:59:16 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-aefe141a-a87b-4cf7-a420-fc4a4639a224 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] DELETE http://10.27.203.238/share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/shares/ee66b05f-c433-47ec-899b-b6c21c117e1d May 28 12:59:16 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-aefe141a-a87b-4cf7-a420-fc4a4639a224 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:16 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-aefe141a-a87b-4cf7-a420-fc4a4639a224 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Calling method 'ShareMixin.delete' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:16 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.v1.shares [None req-aefe141a-a87b-4cf7-a420-fc4a4639a224 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Delete share with id: ee66b05f-c433-47ec-899b-b6c21c117e1d May 28 12:59:16 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-7e8b4f97-febd-49b1-9cf4-b4f7260e2e3d tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.060s {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:16 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-7e8b4f97-febd-49b1-9cf4-b4f7260e2e3d tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action returned with HTTP 202 May 28 12:59:16 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 689/1392] 10.27.203.238 () {66 vars in 1493 bytes} [Tue May 28 12:59:16 2024] POST /share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action => generated 0 bytes in 202 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:59:16 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-44677371-f9e2-4c99-a6eb-694a4d97d730 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] GET http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/share-access-rules?share_id=72db8769-ece7-42ff-af27-2e778292a9b4 May 28 12:59:16 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-44677371-f9e2-4c99-a6eb-694a4d97d730 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:16 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-44677371-f9e2-4c99-a6eb-694a4d97d730 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:16 l75lg1-v1 manila-share[98474]: DEBUG manila.share.manager [None req-7e8b4f97-febd-49b1-9cf4-b4f7260e2e3d tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Received request to update access for share instance 7fdd602c-79d0-479c-95a2-336b202c6639. {{(pid=98474) update_access_for_instances /opt/stack/manila/manila/share/manager.py:4353}} May 28 12:59:16 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.lock.api [None req-44677371-f9e2-4c99-a6eb-694a4d97d730 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Searching for locks by: {'resource_id': '53526cbe-c8bd-4921-9e5e-b7125df0092a', 'resource_action': 'show', 'resource_type': 'access_rule'} {{(pid=98330) get_all /opt/stack/manila/manila/lock/api.py:112}} May 28 12:59:16 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-7e8b4f97-febd-49b1-9cf4-b4f7260e2e3d tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:16 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-7e8b4f97-febd-49b1-9cf4-b4f7260e2e3d tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:16 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-44677371-f9e2-4c99-a6eb-694a4d97d730 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/share-access-rules?share_id=72db8769-ece7-42ff-af27-2e778292a9b4 returned with HTTP 200 May 28 12:59:16 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 690/1393] 10.27.203.238 () {64 vars in 1467 bytes} [Tue May 28 12:59:16 2024] GET /share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/share-access-rules?share_id=72db8769-ece7-42ff-af27-2e778292a9b4 => generated 283 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 231 bytes (2 switches on core 0) May 28 12:59:16 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-7e8b4f97-febd-49b1-9cf4-b4f7260e2e3d tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.004s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:16 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-7e8b4f97-febd-49b1-9cf4-b4f7260e2e3d tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:16 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-7e8b4f97-febd-49b1-9cf4-b4f7260e2e3d tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:16 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-7e8b4f97-febd-49b1-9cf4-b4f7260e2e3d tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.057s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:16 l75lg1-v1 manila-share[98474]: DEBUG manila.share.access [None req-7e8b4f97-febd-49b1-9cf4-b4f7260e2e3d tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Updating access rules for share instance 7fdd602c-79d0-479c-95a2-336b202c6639 belonging to share 72db8769-ece7-42ff-af27-2e778292a9b4. {{(pid=98474) update_access_rules /opt/stack/manila/manila/share/access.py:298}} May 28 12:59:16 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-2c0f5b40-d9c1-4718-9b24-5737571bcd6d tempest-PublicSharesNegativeTest-1466961720 tempest-PublicSharesNegativeTest-1466961720-project-admin] GET http://10.27.203.238/share/v2/6e831d9989b1463da882ee355e32629c/shares/eb49a187-afee-4d13-b48a-a957d46fc910 May 28 12:59:16 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-2c0f5b40-d9c1-4718-9b24-5737571bcd6d tempest-PublicSharesNegativeTest-1466961720 tempest-PublicSharesNegativeTest-1466961720-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:16 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-2c0f5b40-d9c1-4718-9b24-5737571bcd6d tempest-PublicSharesNegativeTest-1466961720 tempest-PublicSharesNegativeTest-1466961720-project-admin] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:16 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-7e8b4f97-febd-49b1-9cf4-b4f7260e2e3d tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:16 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-7e8b4f97-febd-49b1-9cf4-b4f7260e2e3d tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:16 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-7e8b4f97-febd-49b1-9cf4-b4f7260e2e3d tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.008s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:16 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-7e8b4f97-febd-49b1-9cf4-b4f7260e2e3d tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:16 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-7e8b4f97-febd-49b1-9cf4-b4f7260e2e3d tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:16 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-2c0f5b40-d9c1-4718-9b24-5737571bcd6d tempest-PublicSharesNegativeTest-1466961720 tempest-PublicSharesNegativeTest-1466961720-project-admin] http://10.27.203.238/share/v2/6e831d9989b1463da882ee355e32629c/shares/eb49a187-afee-4d13-b48a-a957d46fc910 returned with HTTP 200 May 28 12:59:16 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 691/1394] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:59:16 2024] GET /share/v2/6e831d9989b1463da882ee355e32629c/shares/eb49a187-afee-4d13-b48a-a957d46fc910 => generated 1360 bytes in 24 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:59:16 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f765b4a-d288-4cfa-bc17-695b543023ae service manila] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:16 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-1f765b4a-d288-4cfa-bc17-695b543023ae service manila] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:59:16 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-7e8b4f97-febd-49b1-9cf4-b4f7260e2e3d tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.017s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:16 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-7e8b4f97-febd-49b1-9cf4-b4f7260e2e3d tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] changing access on None May 28 12:59:16 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-7e8b4f97-febd-49b1-9cf4-b4f7260e2e3d tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:59:16 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-7e8b4f97-febd-49b1-9cf4-b4f7260e2e3d tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] {'allow_redirects': True, May 28 12:59:16 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-7e8b4f97-febd-49b1-9cf4-b4f7260e2e3d tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] 'params': {'name': '7fdd602c-79d0-479c-95a2-336b202c6639'}} May 28 12:59:16 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f765b4a-d288-4cfa-bc17-695b543023ae service manila] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:16 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ea7286-adc8-4163-99d8-24c93a2efc73 service manila] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f110cf6300f049c897d0aab63218d1e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:16 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ea7286-adc8-4163-99d8-24c93a2efc73 service manila] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:16 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ea7286-adc8-4163-99d8-24c93a2efc73 service manila] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:16 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ea7286-adc8-4163-99d8-24c93a2efc73 service manila] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:16 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-b1ea7286-adc8-4163-99d8-24c93a2efc73 service manila] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:59:16 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.quota [None req-aefe141a-a87b-4cf7-a420-fc4a4639a224 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Created reservations ['3093c05a-cb95-43b2-8e53-f09bf66d4dd0', '39e783bb-4e55-4dec-a4ce-042194f00e53', 'f866ab23-4d85-4dba-a4ea-155f70c62996', '3799236c-5b9d-4cd9-b425-8bee5b9a4f31'] {{(pid=98329) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 12:59:16 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-82e1de9e-1bd0-4e3a-ace8-e1e4f84e9240 tempest-ResourceLockDeleteTest-1157183439 None] <<< [POST] https://127.0.0.1:40443/api/quotas/ May 28 12:59:16 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.quota [None req-aefe141a-a87b-4cf7-a420-fc4a4639a224 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Committed reservations ['3093c05a-cb95-43b2-8e53-f09bf66d4dd0', '39e783bb-4e55-4dec-a4ce-042194f00e53', 'f866ab23-4d85-4dba-a4ea-155f70c62996', '3799236c-5b9d-4cd9-b425-8bee5b9a4f31'] {{(pid=98329) commit /opt/stack/manila/manila/quota.py:1063}} May 28 12:59:16 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-82e1de9e-1bd0-4e3a-ace8-e1e4f84e9240 tempest-ResourceLockDeleteTest-1157183439 None] Bunch(cluster='loop75-kfs', cluster_id=1, default_email=None, default_group_quota=None, default_user_quota=None, enable_alarms=True, enable_email_providers=True, grace_period=None, group_quotas=[], guid='f9eefcf5-31f7-469e-ad5c-479e5cad09a2', hard_limit=1073741824, hard_limit_inodes=None, id=32, internal=False, is_user_quota=False, last_user_quotas_update=None, name='9fadf39f-1d93-4ddd-bd00-1fd7ccc09539', num_blocked_users=0, num_exceeded_users=0, path='/manila/manila-9fadf39f-1d93-4ddd-bd00-1fd7ccc09539', percent_capacity=0, percent_inodes=None, pretty_grace_period=None, pretty_grace_period_expiration=None, pretty_state='OK (CREATED)', soft_limit=None, soft_limit_inodes=None, state='OK', sync_state='CREATED', system_id=32, tenant_id=1, tenant_name='default', time_to_block=None, title='9fadf39f-1d93-4ddd-bd00-1fd7ccc09539', url='https://127.0.0.1:40443/api/quotas/32/', used_capacity=0, used_capacity_tb=0.0, used_effective_capacity=0, used_effective_capacity_tb=0.0, used_inodes=0, used_limited_capacity=0, user_quotas=[]) May 28 12:59:16 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-82e1de9e-1bd0-4e3a-ace8-e1e4f84e9240 tempest-ResourceLockDeleteTest-1157183439 None] --- [POST] https://127.0.0.1:40443/api/quotas/: Done May 28 12:59:16 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-82e1de9e-1bd0-4e3a-ace8-e1e4f84e9240 tempest-ResourceLockDeleteTest-1157183439 None] >>> [GET] https://127.0.0.1:40443/api/views/ May 28 12:59:16 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-82e1de9e-1bd0-4e3a-ace8-e1e4f84e9240 tempest-ResourceLockDeleteTest-1157183439 None] {'allow_redirects': True, May 28 12:59:16 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-82e1de9e-1bd0-4e3a-ace8-e1e4f84e9240 tempest-ResourceLockDeleteTest-1157183439 None] 'params': {'name': '9fadf39f-1d93-4ddd-bd00-1fd7ccc09539'}} May 28 12:59:16 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-aefe141a-a87b-4cf7-a420-fc4a4639a224 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] http://10.27.203.238/share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/shares/ee66b05f-c433-47ec-899b-b6c21c117e1d returned with HTTP 202 May 28 12:59:16 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 704/1395] 10.27.203.238 () {64 vars in 1454 bytes} [Tue May 28 12:59:16 2024] DELETE /share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/shares/ee66b05f-c433-47ec-899b-b6c21c117e1d => generated 0 bytes in 224 msecs (HTTP/1.1 202) 6 headers in 243 bytes (2 switches on core 0) May 28 12:59:16 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ea7286-adc8-4163-99d8-24c93a2efc73 service manila] RBAC: Authorizing `identity:validate_token()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:16 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ea7286-adc8-4163-99d8-24c93a2efc73 service manila] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:16 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1219/2463] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 12:59:16 2024] GET /identity/v3/auth/tokens => generated 3954 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 12:59:16 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-ea80df7a-2226-4991-9162-6e86b5ba4ee9 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] POST http://10.27.203.238/share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/types May 28 12:59:16 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-ea80df7a-2226-4991-9162-6e86b5ba4ee9 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share_type": {"name": "tempest-share-type-689610262", "extra_specs": {"driver_handles_share_servers": false, "vendor_name": "foobar"}, "share_type_access:is_public": true}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:59:16 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-517bf875-7d46-44b0-bb33-b724054dcbb4 tempest-PublicSharesNegativeTest-86905809 tempest-PublicSharesNegativeTest-86905809-project-member] DELETE http://10.27.203.238/share/v2/7c57d03aaac8490283a91810fc80266e/shares/eb49a187-afee-4d13-b48a-a957d46fc910/metadata/key May 28 12:59:16 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-517bf875-7d46-44b0-bb33-b724054dcbb4 tempest-PublicSharesNegativeTest-86905809 tempest-PublicSharesNegativeTest-86905809-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:16 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-517bf875-7d46-44b0-bb33-b724054dcbb4 tempest-PublicSharesNegativeTest-86905809 tempest-PublicSharesNegativeTest-86905809-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:16 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-ea80df7a-2226-4991-9162-6e86b5ba4ee9 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] http://10.27.203.238/share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/types returned with HTTP 200 May 28 12:59:16 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 705/1396] 10.27.203.238 () {66 vars in 1359 bytes} [Tue May 28 12:59:16 2024] POST /share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/types => generated 659 bytes in 22 msecs (HTTP/1.1 200) 6 headers in 231 bytes (2 switches on core 0) May 28 12:59:16 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-e2f4339e-0e1f-4fbb-b469-3dedca94c237 tempest-ResourceLockDeleteTest-1157183439 tempest-ResourceLockDeleteTest-1157183439-project-member] GET http://10.27.203.238/share/v2/645fb190404541a78e449c703540d6f8/shares/ed309fc1-d1ff-4352-a44a-a56b44eb8d0e May 28 12:59:16 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-e2f4339e-0e1f-4fbb-b469-3dedca94c237 tempest-ResourceLockDeleteTest-1157183439 tempest-ResourceLockDeleteTest-1157183439-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:16 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-e2f4339e-0e1f-4fbb-b469-3dedca94c237 tempest-ResourceLockDeleteTest-1157183439 tempest-ResourceLockDeleteTest-1157183439-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:16 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.policy [None req-517bf875-7d46-44b0-bb33-b724054dcbb4 tempest-PublicSharesNegativeTest-86905809 tempest-PublicSharesNegativeTest-86905809-project-member] Policy check for share:get failed with credentials {'is_admin': False, 'user_id': '2115eda170ff4b14bb198e46b523fb81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c57d03aaac8490283a91810fc80266e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98330) authorize /opt/stack/manila/manila/policy.py:208}} May 28 12:59:16 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-517bf875-7d46-44b0-bb33-b724054dcbb4 tempest-PublicSharesNegativeTest-86905809 tempest-PublicSharesNegativeTest-86905809-project-member] http://10.27.203.238/share/v2/7c57d03aaac8490283a91810fc80266e/shares/eb49a187-afee-4d13-b48a-a957d46fc910/metadata/key returned with HTTP 403 May 28 12:59:16 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 692/1397] 10.27.203.238 () {64 vars in 1493 bytes} [Tue May 28 12:59:16 2024] DELETE /share/v2/7c57d03aaac8490283a91810fc80266e/shares/eb49a187-afee-4d13-b48a-a957d46fc910/metadata/key => generated 90 bytes in 98 msecs (HTTP/1.1 403) 6 headers in 237 bytes (1 switches on core 0) May 28 12:59:16 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-75dfa9f5-0937-448d-90a3-0902d5f9764e tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] POST http://10.27.203.238/share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/shares May 28 12:59:16 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-75dfa9f5-0937-448d-90a3-0902d5f9764e tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share": {"share_proto": "nfs", "description": "tempest-tempest-created-share-desc-2141335459", "snapshot_id": null, "name": "tempest-tempest-created-share-702405635", "size": 1, "metadata": {}, "is_public": false, "share_type": "7072fb6e-708b-4734-944c-6ca799508a26"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:59:16 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.v1.shares [None req-75dfa9f5-0937-448d-90a3-0902d5f9764e tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Create NFS share of 1 GB May 28 12:59:16 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-e2f4339e-0e1f-4fbb-b469-3dedca94c237 tempest-ResourceLockDeleteTest-1157183439 tempest-ResourceLockDeleteTest-1157183439-project-member] http://10.27.203.238/share/v2/645fb190404541a78e449c703540d6f8/shares/ed309fc1-d1ff-4352-a44a-a56b44eb8d0e returned with HTTP 200 May 28 12:59:16 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 706/1398] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:59:16 2024] GET /share/v2/645fb190404541a78e449c703540d6f8/shares/ed309fc1-d1ff-4352-a44a-a56b44eb8d0e => generated 1314 bytes in 27 msecs (HTTP/1.1 200) 6 headers in 232 bytes (2 switches on core 0) May 28 12:59:16 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-d5322c76-cf65-4e20-ba1b-446edf9a8818 tempest-PublicSharesNegativeTest-86905809 tempest-PublicSharesNegativeTest-86905809-project-member] DELETE http://10.27.203.238/share/v2/7c57d03aaac8490283a91810fc80266e/shares/eb49a187-afee-4d13-b48a-a957d46fc910 May 28 12:59:16 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-d5322c76-cf65-4e20-ba1b-446edf9a8818 tempest-PublicSharesNegativeTest-86905809 tempest-PublicSharesNegativeTest-86905809-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:16 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-d5322c76-cf65-4e20-ba1b-446edf9a8818 tempest-PublicSharesNegativeTest-86905809 tempest-PublicSharesNegativeTest-86905809-project-member] Calling method 'ShareMixin.delete' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:16 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.v1.shares [None req-d5322c76-cf65-4e20-ba1b-446edf9a8818 tempest-PublicSharesNegativeTest-86905809 tempest-PublicSharesNegativeTest-86905809-project-member] Delete share with id: eb49a187-afee-4d13-b48a-a957d46fc910 May 28 12:59:16 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.policy [None req-d5322c76-cf65-4e20-ba1b-446edf9a8818 tempest-PublicSharesNegativeTest-86905809 tempest-PublicSharesNegativeTest-86905809-project-member] Policy check for share:delete failed with credentials {'is_admin': False, 'user_id': '2115eda170ff4b14bb198e46b523fb81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c57d03aaac8490283a91810fc80266e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98329) authorize /opt/stack/manila/manila/policy.py:208}} May 28 12:59:16 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-d5322c76-cf65-4e20-ba1b-446edf9a8818 tempest-PublicSharesNegativeTest-86905809 tempest-PublicSharesNegativeTest-86905809-project-member] http://10.27.203.238/share/v2/7c57d03aaac8490283a91810fc80266e/shares/eb49a187-afee-4d13-b48a-a957d46fc910 returned with HTTP 403 May 28 12:59:16 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 707/1399] 10.27.203.238 () {64 vars in 1454 bytes} [Tue May 28 12:59:16 2024] DELETE /share/v2/7c57d03aaac8490283a91810fc80266e/shares/eb49a187-afee-4d13-b48a-a957d46fc910 => generated 93 bytes in 22 msecs (HTTP/1.1 403) 6 headers in 237 bytes (1 switches on core 0) May 28 12:59:16 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-21a036ec-412a-443d-842e-8d99a4296ab8 tempest-PublicSharesNegativeTest-86905809 tempest-PublicSharesNegativeTest-86905809-project-member] POST http://10.27.203.238/share/v2/7c57d03aaac8490283a91810fc80266e/shares/eb49a187-afee-4d13-b48a-a957d46fc910/metadata May 28 12:59:16 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-21a036ec-412a-443d-842e-8d99a4296ab8 tempest-PublicSharesNegativeTest-86905809 tempest-PublicSharesNegativeTest-86905809-project-member] Action: 'create_metadata', calling method: Controller.__getattribute__..version_select, body: {"metadata": {"key": "value"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:59:17 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.quota [None req-75dfa9f5-0937-448d-90a3-0902d5f9764e tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Created reservations ['25adc88e-ead3-4faa-a0ec-4b54ed5f574b', '9f772940-9b50-4c8e-abd5-be655a81c096', '3bf97fe0-ff9d-42b9-b597-a755e4b07841', '419a8e21-a4e5-41fb-9d0f-6a52bcbfbba3'] {{(pid=98330) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 12:59:17 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.policy [None req-21a036ec-412a-443d-842e-8d99a4296ab8 tempest-PublicSharesNegativeTest-86905809 tempest-PublicSharesNegativeTest-86905809-project-member] Policy check for share:get failed with credentials {'is_admin': False, 'user_id': '2115eda170ff4b14bb198e46b523fb81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c57d03aaac8490283a91810fc80266e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98329) authorize /opt/stack/manila/manila/policy.py:208}} May 28 12:59:17 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-21a036ec-412a-443d-842e-8d99a4296ab8 tempest-PublicSharesNegativeTest-86905809 tempest-PublicSharesNegativeTest-86905809-project-member] http://10.27.203.238/share/v2/7c57d03aaac8490283a91810fc80266e/shares/eb49a187-afee-4d13-b48a-a957d46fc910/metadata returned with HTTP 403 May 28 12:59:17 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 708/1400] 10.27.203.238 () {66 vars in 1499 bytes} [Tue May 28 12:59:16 2024] POST /share/v2/7c57d03aaac8490283a91810fc80266e/shares/eb49a187-afee-4d13-b48a-a957d46fc910/metadata => generated 90 bytes in 56 msecs (HTTP/1.1 403) 6 headers in 237 bytes (1 switches on core 0) May 28 12:59:17 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-a8bf5dfa-fa55-489c-97b5-bac71bdbe514 tempest-PublicSharesNegativeTest-86905809 tempest-PublicSharesNegativeTest-86905809-project-member] PUT http://10.27.203.238/share/v2/7c57d03aaac8490283a91810fc80266e/shares/eb49a187-afee-4d13-b48a-a957d46fc910/metadata May 28 12:59:17 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-a8bf5dfa-fa55-489c-97b5-bac71bdbe514 tempest-PublicSharesNegativeTest-86905809 tempest-PublicSharesNegativeTest-86905809-project-member] Action: 'update_all_metadata', calling method: Controller.__getattribute__..version_select, body: {"metadata": {"key": "value"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:59:17 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.quota [None req-75dfa9f5-0937-448d-90a3-0902d5f9764e tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Committed reservations ['25adc88e-ead3-4faa-a0ec-4b54ed5f574b', '9f772940-9b50-4c8e-abd5-be655a81c096', '3bf97fe0-ff9d-42b9-b597-a755e4b07841', '419a8e21-a4e5-41fb-9d0f-6a52bcbfbba3'] {{(pid=98330) commit /opt/stack/manila/manila/quota.py:1063}} May 28 12:59:17 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.policy [None req-a8bf5dfa-fa55-489c-97b5-bac71bdbe514 tempest-PublicSharesNegativeTest-86905809 tempest-PublicSharesNegativeTest-86905809-project-member] Policy check for share:get failed with credentials {'is_admin': False, 'user_id': '2115eda170ff4b14bb198e46b523fb81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c57d03aaac8490283a91810fc80266e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98329) authorize /opt/stack/manila/manila/policy.py:208}} May 28 12:59:17 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-a8bf5dfa-fa55-489c-97b5-bac71bdbe514 tempest-PublicSharesNegativeTest-86905809 tempest-PublicSharesNegativeTest-86905809-project-member] http://10.27.203.238/share/v2/7c57d03aaac8490283a91810fc80266e/shares/eb49a187-afee-4d13-b48a-a957d46fc910/metadata returned with HTTP 403 May 28 12:59:17 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 709/1401] 10.27.203.238 () {66 vars in 1498 bytes} [Tue May 28 12:59:17 2024] PUT /share/v2/7c57d03aaac8490283a91810fc80266e/shares/eb49a187-afee-4d13-b48a-a957d46fc910/metadata => generated 90 bytes in 60 msecs (HTTP/1.1 403) 6 headers in 237 bytes (1 switches on core 0) May 28 12:59:17 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.host_manager [None req-75dfa9f5-0937-448d-90a3-0902d5f9764e tempest-UserMessageTest-1084663522 None] Share service is down. (host: l75lg1-v1@generic2). May 28 12:59:17 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.host_manager [None req-75dfa9f5-0937-448d-90a3-0902d5f9764e tempest-UserMessageTest-1084663522 None] Share service is down. (host: l75lg1-v1@generic1). May 28 12:59:17 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-c92826e0-9098-49c5-92b4-56c24cd2851b tempest-PublicSharesNegativeTest-86905809 tempest-PublicSharesNegativeTest-86905809-project-member] PUT http://10.27.203.238/share/v2/7c57d03aaac8490283a91810fc80266e/shares/eb49a187-afee-4d13-b48a-a957d46fc910 May 28 12:59:17 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-75dfa9f5-0937-448d-90a3-0902d5f9764e tempest-UserMessageTest-1084663522 None] Starting with 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:80}} May 28 12:59:17 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-c92826e0-9098-49c5-92b4-56c24cd2851b tempest-PublicSharesNegativeTest-86905809 tempest-PublicSharesNegativeTest-86905809-project-member] Action: 'update', calling method: ShareMixin.update, body: {"share": {"display_name": "new_name"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:59:17 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-75dfa9f5-0937-448d-90a3-0902d5f9764e tempest-UserMessageTest-1084663522 None] Filter OnlyHostFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:59:17 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-75dfa9f5-0937-448d-90a3-0902d5f9764e tempest-UserMessageTest-1084663522 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:59:17 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.capacity [None req-75dfa9f5-0937-448d-90a3-0902d5f9764e tempest-UserMessageTest-1084663522 None] Space information for share creation on host l75lg1-v1@vast#vast (requested / avail): 1/2079 {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/capacity.py:83}} May 28 12:59:17 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-75dfa9f5-0937-448d-90a3-0902d5f9764e tempest-UserMessageTest-1084663522 None] Filter CapacityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:59:17 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.utils [None req-75dfa9f5-0937-448d-90a3-0902d5f9764e tempest-UserMessageTest-1084663522 None] Share type extra spec requirement "vendor_name=foobar" does not match reported capability "VAST STORAGE" {{(pid=98327) capabilities_satisfied /opt/stack/manila/manila/scheduler/utils.py:185}} May 28 12:59:17 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.capabilities [None req-75dfa9f5-0937-448d-90a3-0902d5f9764e tempest-UserMessageTest-1084663522 None] host: 'l75lg1-v1@vast#vast', free_capacity_gb: 2079.64910808485, pools: None fails resource_type extra_specs requirements {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/capabilities.py:45}} May 28 12:59:17 l75lg1-v1 manila-scheduler[98327]: INFO manila.scheduler.filters.base [None req-75dfa9f5-0937-448d-90a3-0902d5f9764e tempest-UserMessageTest-1084663522 None] Filter CapabilitiesFilter returned 0 host(s) May 28 12:59:17 l75lg1-v1 manila-scheduler[98327]: ERROR manila.scheduler.manager [None req-75dfa9f5-0937-448d-90a3-0902d5f9764e tempest-UserMessageTest-1084663522 None] Failed to schedule create_share: No valid host was found. Failed to find a weighted host, the last executed filter was CapabilitiesFilter.: manila.exception.NoValidHost: No valid host was found. Failed to find a weighted host, the last executed filter was CapabilitiesFilter. May 28 12:59:17 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-75dfa9f5-0937-448d-90a3-0902d5f9764e tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] http://10.27.203.238/share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/shares returned with HTTP 200 May 28 12:59:17 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 693/1402] 10.27.203.238 () {66 vars in 1362 bytes} [Tue May 28 12:59:16 2024] POST /share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/shares => generated 1370 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:59:17 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-702781a2-9b6f-4660-800b-780cacd63dd9 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] GET http://10.27.203.238/share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/shares/3f890c77-5b7c-40a3-900d-99b36774b221 May 28 12:59:17 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-702781a2-9b6f-4660-800b-780cacd63dd9 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:17 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-702781a2-9b6f-4660-800b-780cacd63dd9 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:17 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.policy [None req-c92826e0-9098-49c5-92b4-56c24cd2851b tempest-PublicSharesNegativeTest-86905809 tempest-PublicSharesNegativeTest-86905809-project-member] Policy check for share:update failed with credentials {'is_admin': False, 'user_id': '2115eda170ff4b14bb198e46b523fb81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c57d03aaac8490283a91810fc80266e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98329) authorize /opt/stack/manila/manila/policy.py:208}} May 28 12:59:17 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-c92826e0-9098-49c5-92b4-56c24cd2851b tempest-PublicSharesNegativeTest-86905809 tempest-PublicSharesNegativeTest-86905809-project-member] http://10.27.203.238/share/v2/7c57d03aaac8490283a91810fc80266e/shares/eb49a187-afee-4d13-b48a-a957d46fc910 returned with HTTP 403 May 28 12:59:17 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 710/1403] 10.27.203.238 () {66 vars in 1471 bytes} [Tue May 28 12:59:17 2024] PUT /share/v2/7c57d03aaac8490283a91810fc80266e/shares/eb49a187-afee-4d13-b48a-a957d46fc910 => generated 93 bytes in 36 msecs (HTTP/1.1 403) 6 headers in 237 bytes (1 switches on core 0) May 28 12:59:17 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-702781a2-9b6f-4660-800b-780cacd63dd9 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] http://10.27.203.238/share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/shares/3f890c77-5b7c-40a3-900d-99b36774b221 returned with HTTP 200 May 28 12:59:17 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 694/1404] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:59:17 2024] GET /share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/shares/3f890c77-5b7c-40a3-900d-99b36774b221 => generated 1370 bytes in 27 msecs (HTTP/1.1 200) 6 headers in 232 bytes (2 switches on core 0) May 28 12:59:17 l75lg1-v1 manila-scheduler[98327]: INFO manila.message.api [None req-75dfa9f5-0937-448d-90a3-0902d5f9764e tempest-UserMessageTest-1084663522 None] Creating message record for request_id = req-75dfa9f5-0937-448d-90a3-0902d5f9764e May 28 12:59:17 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-1ffc8ab2-4e0f-4c0d-8d3d-4a5da66d88c8 tempest-PublicSharesNegativeTest-1466961720 tempest-PublicSharesNegativeTest-1466961720-project-admin] PUT http://10.27.203.238/share/v2/6e831d9989b1463da882ee355e32629c/shares/eb49a187-afee-4d13-b48a-a957d46fc910 May 28 12:59:17 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-1ffc8ab2-4e0f-4c0d-8d3d-4a5da66d88c8 tempest-PublicSharesNegativeTest-1466961720 tempest-PublicSharesNegativeTest-1466961720-project-admin] Action: 'update', calling method: ShareMixin.update, body: {"share": {"is_public": "truebar"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:59:17 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-7e8b4f97-febd-49b1-9cf4-b4f7260e2e3d tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:59:17 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-7e8b4f97-febd-49b1-9cf4-b4f7260e2e3d tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] [Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=1, created='2024-05-28T12:58:43.845440Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='31b6534b-d142-4561-992f-4f0759db302d', id=32, internal=False, is_s3_default_policy=False, name='7fdd602c-79d0-479c-95a2-336b202c6639', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=['*'], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['1.2.3.4'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['1.2.3.4'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T12:59:15.603908Z', tenant_id=1, tenant_name='default', title='7fdd602c-79d0-479c-95a2-336b202c6639', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/32/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[])] May 28 12:59:17 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-7e8b4f97-febd-49b1-9cf4-b4f7260e2e3d tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 12:59:17 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-7e8b4f97-febd-49b1-9cf4-b4f7260e2e3d tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] changing access on /manila/manila-7fdd602c-79d0-479c-95a2-336b202c6639. Rules: {'nfs_read_write': [], 'nfs_read_only': []} May 28 12:59:17 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-7e8b4f97-febd-49b1-9cf4-b4f7260e2e3d tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] >>> [PATCH] https://127.0.0.1:40443/api/viewpolicies/32/ May 28 12:59:17 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-7e8b4f97-febd-49b1-9cf4-b4f7260e2e3d tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] {'data': '{"name": "7fdd602c-79d0-479c-95a2-336b202c6639", "nfs_no_squash": ' May 28 12:59:17 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-7e8b4f97-febd-49b1-9cf4-b4f7260e2e3d tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] '["*"], "nfs_root_squash": ["*"], "nfs_read_write": [], ' May 28 12:59:17 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-7e8b4f97-febd-49b1-9cf4-b4f7260e2e3d tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] '"nfs_read_only": []}', May 28 12:59:17 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-7e8b4f97-febd-49b1-9cf4-b4f7260e2e3d tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] 'params': None} May 28 12:59:17 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-1ffc8ab2-4e0f-4c0d-8d3d-4a5da66d88c8 tempest-PublicSharesNegativeTest-1466961720 tempest-PublicSharesNegativeTest-1466961720-project-admin] http://10.27.203.238/share/v2/6e831d9989b1463da882ee355e32629c/shares/eb49a187-afee-4d13-b48a-a957d46fc910 returned with HTTP 400 May 28 12:59:17 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 711/1405] 10.27.203.238 () {66 vars in 1471 bytes} [Tue May 28 12:59:17 2024] PUT /share/v2/6e831d9989b1463da882ee355e32629c/shares/eb49a187-afee-4d13-b48a-a957d46fc910 => generated 168 bytes in 23 msecs (HTTP/1.1 400) 6 headers in 240 bytes (1 switches on core 0) May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e37b3d-bb35-489f-8b3e-b4ac1149d3cf service manila] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-78e37b3d-bb35-489f-8b3e-b4ac1149d3cf service manila] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:59:17 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-b84e9b6d-0360-4a88-b280-a1d3cf160511 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] POST http://10.27.203.238/share/v1/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action May 28 12:59:17 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-b84e9b6d-0360-4a88-b280-a1d3cf160511 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Action body: b'{"os-access_list": null}' {{(pid=98330) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:59:17 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-b84e9b6d-0360-4a88-b280-a1d3cf160511 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Action: 'action', calling method: ShareController.access_list, body: {"os-access_list": null} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e37b3d-bb35-489f-8b3e-b4ac1149d3cf service manila] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02793b0c-70ca-44b2-9298-6dc9766ac877 tempest-PublicSharesNegativeTest-1466961720 tempest-PublicSharesNegativeTest-1466961720-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc37d1e963824f408d8df368c962d64f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e831d9989b1463da882ee355e32629c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02793b0c-70ca-44b2-9298-6dc9766ac877 tempest-PublicSharesNegativeTest-1466961720 tempest-PublicSharesNegativeTest-1466961720-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02793b0c-70ca-44b2-9298-6dc9766ac877 tempest-PublicSharesNegativeTest-1466961720 tempest-PublicSharesNegativeTest-1466961720-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02793b0c-70ca-44b2-9298-6dc9766ac877 tempest-PublicSharesNegativeTest-1466961720 tempest-PublicSharesNegativeTest-1466961720-project-admin] PATH_INFO: `/v3/users/b9078b0601ac4efa93bdcc390f3d1208` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02793b0c-70ca-44b2-9298-6dc9766ac877 tempest-PublicSharesNegativeTest-1466961720 tempest-PublicSharesNegativeTest-1466961720-project-admin] RBAC: Authorizing `identity:delete_user(user_id=b9078b0601ac4efa93bdcc390f3d1208)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02793b0c-70ca-44b2-9298-6dc9766ac877 tempest-PublicSharesNegativeTest-1466961720 tempest-PublicSharesNegativeTest-1466961720-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-02793b0c-70ca-44b2-9298-6dc9766ac877 tempest-PublicSharesNegativeTest-1466961720 tempest-PublicSharesNegativeTest-1466961720-project-admin] Could not find user: b9078b0601ac4efa93bdcc390f3d1208.: keystone.exception.UserNotFound: Could not find user: b9078b0601ac4efa93bdcc390f3d1208. May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: b9078b0601ac4efa93bdcc390f3d1208. May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1245/2464] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 12:59:17 2024] DELETE /identity/v3/users/b9078b0601ac4efa93bdcc390f3d1208 => generated 110 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ea7286-adc8-4163-99d8-24c93a2efc73 service manila] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ea7286-adc8-4163-99d8-24c93a2efc73 service manila] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5016de9b-99a7-4f33-b395-3bba729c943b tempest-PublicSharesNegativeTest-1466961720 tempest-PublicSharesNegativeTest-1466961720-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc37d1e963824f408d8df368c962d64f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e831d9989b1463da882ee355e32629c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5016de9b-99a7-4f33-b395-3bba729c943b tempest-PublicSharesNegativeTest-1466961720 tempest-PublicSharesNegativeTest-1466961720-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5016de9b-99a7-4f33-b395-3bba729c943b tempest-PublicSharesNegativeTest-1466961720 tempest-PublicSharesNegativeTest-1466961720-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5016de9b-99a7-4f33-b395-3bba729c943b tempest-PublicSharesNegativeTest-1466961720 tempest-PublicSharesNegativeTest-1466961720-project-admin] PATH_INFO: `/v3/users/567edee5a37f498e8a3f54a933728377` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:17 l75lg1-v1 dstat.sh[49771]: 28-05 12:59:17| 15 1 77 6 0|5737M 1734M 277M 7876M| 15k 12k| 0 11M| 0 1332 |8306 14k|1.23 1.07 1.02|2.0 2.0 0| 0 0 | 0 2048M| 29 363 0 37 0 May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5016de9b-99a7-4f33-b395-3bba729c943b tempest-PublicSharesNegativeTest-1466961720 tempest-PublicSharesNegativeTest-1466961720-project-admin] RBAC: Authorizing `identity:delete_user(user_id=567edee5a37f498e8a3f54a933728377)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5016de9b-99a7-4f33-b395-3bba729c943b tempest-PublicSharesNegativeTest-1466961720 tempest-PublicSharesNegativeTest-1466961720-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-5016de9b-99a7-4f33-b395-3bba729c943b tempest-PublicSharesNegativeTest-1466961720 tempest-PublicSharesNegativeTest-1466961720-project-admin] Could not find user: 567edee5a37f498e8a3f54a933728377.: keystone.exception.UserNotFound: Could not find user: 567edee5a37f498e8a3f54a933728377. May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 567edee5a37f498e8a3f54a933728377. May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1220/2465] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 12:59:17 2024] DELETE /identity/v3/users/567edee5a37f498e8a3f54a933728377 => generated 110 bytes in 25 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02793b0c-70ca-44b2-9298-6dc9766ac877 tempest-PublicSharesNegativeTest-1466961720 tempest-PublicSharesNegativeTest-1466961720-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:17 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-b84e9b6d-0360-4a88-b280-a1d3cf160511 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] http://10.27.203.238/share/v1/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action returned with HTTP 200 May 28 12:59:17 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 695/1406] 10.27.203.238 () {64 vars in 1450 bytes} [Tue May 28 12:59:17 2024] POST /share/v1/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action => generated 151 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02793b0c-70ca-44b2-9298-6dc9766ac877 tempest-PublicSharesNegativeTest-1466961720 tempest-PublicSharesNegativeTest-1466961720-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:17 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-114b6357-b203-4ce5-92dc-cbfcb096481b tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] POST http://10.27.203.238/share/v1/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action May 28 12:59:17 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-114b6357-b203-4ce5-92dc-cbfcb096481b tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Action body: b'{"os-deny_access": {"access_id": "88971174-0626-49fa-8cd5-338e37ab882d"}}' {{(pid=98329) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:59:17 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-114b6357-b203-4ce5-92dc-cbfcb096481b tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Action: 'action', calling method: ShareController.deny_access, body: {"os-deny_access": {"access_id": "88971174-0626-49fa-8cd5-338e37ab882d"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa3b6f7-d560-406d-823b-812dc61244cf tempest-PublicSharesNegativeTest-1466961720 tempest-PublicSharesNegativeTest-1466961720-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc37d1e963824f408d8df368c962d64f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e831d9989b1463da882ee355e32629c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa3b6f7-d560-406d-823b-812dc61244cf tempest-PublicSharesNegativeTest-1466961720 tempest-PublicSharesNegativeTest-1466961720-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa3b6f7-d560-406d-823b-812dc61244cf tempest-PublicSharesNegativeTest-1466961720 tempest-PublicSharesNegativeTest-1466961720-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:17 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.lock.api [None req-114b6357-b203-4ce5-92dc-cbfcb096481b tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Searching for locks by: {'resource_id': '88971174-0626-49fa-8cd5-338e37ab882d', 'resource_action': 'delete'} {{(pid=98329) get_all /opt/stack/manila/manila/lock/api.py:112}} May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa3b6f7-d560-406d-823b-812dc61244cf tempest-PublicSharesNegativeTest-1466961720 tempest-PublicSharesNegativeTest-1466961720-project-admin] PATH_INFO: `/v3/users/e1f712aac7e94e429048f60f92a8a736` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa3b6f7-d560-406d-823b-812dc61244cf tempest-PublicSharesNegativeTest-1466961720 tempest-PublicSharesNegativeTest-1466961720-project-admin] RBAC: Authorizing `identity:delete_user(user_id=e1f712aac7e94e429048f60f92a8a736)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa3b6f7-d560-406d-823b-812dc61244cf tempest-PublicSharesNegativeTest-1466961720 tempest-PublicSharesNegativeTest-1466961720-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-eaa3b6f7-d560-406d-823b-812dc61244cf tempest-PublicSharesNegativeTest-1466961720 tempest-PublicSharesNegativeTest-1466961720-project-admin] Could not find user: e1f712aac7e94e429048f60f92a8a736.: keystone.exception.UserNotFound: Could not find user: e1f712aac7e94e429048f60f92a8a736. May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: e1f712aac7e94e429048f60f92a8a736. May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1246/2466] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 12:59:17 2024] DELETE /identity/v3/users/e1f712aac7e94e429048f60f92a8a736 => generated 110 bytes in 25 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5016de9b-99a7-4f33-b395-3bba729c943b tempest-PublicSharesNegativeTest-1466961720 tempest-PublicSharesNegativeTest-1466961720-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5016de9b-99a7-4f33-b395-3bba729c943b tempest-PublicSharesNegativeTest-1466961720 tempest-PublicSharesNegativeTest-1466961720-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ad8a9a-568d-42b0-b0f2-b3e6b0273157 tempest-PublicSharesNegativeTest-1466961720 tempest-PublicSharesNegativeTest-1466961720-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc37d1e963824f408d8df368c962d64f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e831d9989b1463da882ee355e32629c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ad8a9a-568d-42b0-b0f2-b3e6b0273157 tempest-PublicSharesNegativeTest-1466961720 tempest-PublicSharesNegativeTest-1466961720-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ad8a9a-568d-42b0-b0f2-b3e6b0273157 tempest-PublicSharesNegativeTest-1466961720 tempest-PublicSharesNegativeTest-1466961720-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ad8a9a-568d-42b0-b0f2-b3e6b0273157 tempest-PublicSharesNegativeTest-1466961720 tempest-PublicSharesNegativeTest-1466961720-project-admin] PATH_INFO: `/v3/users/9d3788d7291b4ee389136f181e35a26b` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ad8a9a-568d-42b0-b0f2-b3e6b0273157 tempest-PublicSharesNegativeTest-1466961720 tempest-PublicSharesNegativeTest-1466961720-project-admin] RBAC: Authorizing `identity:delete_user(user_id=9d3788d7291b4ee389136f181e35a26b)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ad8a9a-568d-42b0-b0f2-b3e6b0273157 tempest-PublicSharesNegativeTest-1466961720 tempest-PublicSharesNegativeTest-1466961720-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-85ad8a9a-568d-42b0-b0f2-b3e6b0273157 tempest-PublicSharesNegativeTest-1466961720 tempest-PublicSharesNegativeTest-1466961720-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d3788d7291b4ee389136f181e35a26b', 'request_id': 'req-85ad8a9a-568d-42b0-b0f2-b3e6b0273157'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-85ad8a9a-568d-42b0-b0f2-b3e6b0273157 tempest-PublicSharesNegativeTest-1466961720 tempest-PublicSharesNegativeTest-1466961720-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d3788d7291b4ee389136f181e35a26b', 'request_id': 'req-85ad8a9a-568d-42b0-b0f2-b3e6b0273157'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-85ad8a9a-568d-42b0-b0f2-b3e6b0273157 tempest-PublicSharesNegativeTest-1466961720 tempest-PublicSharesNegativeTest-1466961720-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d3788d7291b4ee389136f181e35a26b', 'request_id': 'req-85ad8a9a-568d-42b0-b0f2-b3e6b0273157'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-85ad8a9a-568d-42b0-b0f2-b3e6b0273157 tempest-PublicSharesNegativeTest-1466961720 tempest-PublicSharesNegativeTest-1466961720-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d3788d7291b4ee389136f181e35a26b', 'request_id': 'req-85ad8a9a-568d-42b0-b0f2-b3e6b0273157'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-85ad8a9a-568d-42b0-b0f2-b3e6b0273157 tempest-PublicSharesNegativeTest-1466961720 tempest-PublicSharesNegativeTest-1466961720-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d3788d7291b4ee389136f181e35a26b', 'request_id': 'req-85ad8a9a-568d-42b0-b0f2-b3e6b0273157'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1221/2467] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 12:59:17 2024] DELETE /identity/v3/users/9d3788d7291b4ee389136f181e35a26b => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa3b6f7-d560-406d-823b-812dc61244cf tempest-PublicSharesNegativeTest-1466961720 tempest-PublicSharesNegativeTest-1466961720-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-eaa3b6f7-d560-406d-823b-812dc61244cf tempest-PublicSharesNegativeTest-1466961720 tempest-PublicSharesNegativeTest-1466961720-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa3b6f7-d560-406d-823b-812dc61244cf tempest-PublicSharesNegativeTest-1466961720 tempest-PublicSharesNegativeTest-1466961720-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7714c72a-e076-4126-9d8d-974ac266ec82 service manila] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f110cf6300f049c897d0aab63218d1e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7714c72a-e076-4126-9d8d-974ac266ec82 service manila] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7714c72a-e076-4126-9d8d-974ac266ec82 service manila] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7714c72a-e076-4126-9d8d-974ac266ec82 service manila] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:17 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-82e1de9e-1bd0-4e3a-ace8-e1e4f84e9240 tempest-ResourceLockDeleteTest-1157183439 None] <<< [GET] https://127.0.0.1:40443/api/views/ May 28 12:59:17 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-82e1de9e-1bd0-4e3a-ace8-e1e4f84e9240 tempest-ResourceLockDeleteTest-1157183439 None] [] May 28 12:59:17 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-82e1de9e-1bd0-4e3a-ace8-e1e4f84e9240 tempest-ResourceLockDeleteTest-1157183439 None] --- [GET] https://127.0.0.1:40443/api/views/: Done May 28 12:59:17 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-82e1de9e-1bd0-4e3a-ace8-e1e4f84e9240 tempest-ResourceLockDeleteTest-1157183439 None] >>> [POST] https://127.0.0.1:40443/api/views/ May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-7714c72a-e076-4126-9d8d-974ac266ec82 service manila] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:59:17 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-82e1de9e-1bd0-4e3a-ace8-e1e4f84e9240 tempest-ResourceLockDeleteTest-1157183439 None] {'data': '{"name": "9fadf39f-1d93-4ddd-bd00-1fd7ccc09539", "path": ' May 28 12:59:17 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-82e1de9e-1bd0-4e3a-ace8-e1e4f84e9240 tempest-ResourceLockDeleteTest-1157183439 None] '"/manila/manila-9fadf39f-1d93-4ddd-bd00-1fd7ccc09539", "policy_id": ' May 28 12:59:17 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-82e1de9e-1bd0-4e3a-ace8-e1e4f84e9240 tempest-ResourceLockDeleteTest-1157183439 None] '35, "create_dir": true, "protocols": ["NFS"]}', May 28 12:59:17 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-82e1de9e-1bd0-4e3a-ace8-e1e4f84e9240 tempest-ResourceLockDeleteTest-1157183439 None] 'json': None, May 28 12:59:17 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-82e1de9e-1bd0-4e3a-ace8-e1e4f84e9240 tempest-ResourceLockDeleteTest-1157183439 None] 'params': None} May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7714c72a-e076-4126-9d8d-974ac266ec82 service manila] RBAC: Authorizing `identity:validate_token()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7714c72a-e076-4126-9d8d-974ac266ec82 service manila] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:17 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1247/2468] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 12:59:17 2024] GET /identity/v3/auth/tokens => generated 3958 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 12:59:17 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-0cb62a44-6ef3-4cdc-a05a-e9e478577335 tempest-PublicSharesNegativeTest-1419699180 tempest-PublicSharesNegativeTest-1419699180-project-member] GET http://10.27.203.238/share/v2/87f1228e3b494ac1a895d7e6f466fa4b/share-replicas/detail?share_id=eb49a187-afee-4d13-b48a-a957d46fc910 May 28 12:59:17 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-0cb62a44-6ef3-4cdc-a05a-e9e478577335 tempest-PublicSharesNegativeTest-1419699180 tempest-PublicSharesNegativeTest-1419699180-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:17 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-0cb62a44-6ef3-4cdc-a05a-e9e478577335 tempest-PublicSharesNegativeTest-1419699180 tempest-PublicSharesNegativeTest-1419699180-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:17 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-0cb62a44-6ef3-4cdc-a05a-e9e478577335 tempest-PublicSharesNegativeTest-1419699180 tempest-PublicSharesNegativeTest-1419699180-project-member] http://10.27.203.238/share/v2/87f1228e3b494ac1a895d7e6f466fa4b/share-replicas/detail?share_id=eb49a187-afee-4d13-b48a-a957d46fc910 returned with HTTP 200 May 28 12:59:17 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 696/1407] 10.27.203.238 () {64 vars in 1476 bytes} [Tue May 28 12:59:17 2024] GET /share/v2/87f1228e3b494ac1a895d7e6f466fa4b/share-replicas/detail?share_id=eb49a187-afee-4d13-b48a-a957d46fc910 => generated 22 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:59:17 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-06672101-d0ab-4d41-a04e-23420ae12224 tempest-PublicSharesNegativeTest-1466961720 tempest-PublicSharesNegativeTest-1466961720-project-admin] DELETE http://10.27.203.238/share/v2/6e831d9989b1463da882ee355e32629c/shares/eb49a187-afee-4d13-b48a-a957d46fc910 May 28 12:59:17 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-06672101-d0ab-4d41-a04e-23420ae12224 tempest-PublicSharesNegativeTest-1466961720 tempest-PublicSharesNegativeTest-1466961720-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:17 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-06672101-d0ab-4d41-a04e-23420ae12224 tempest-PublicSharesNegativeTest-1466961720 tempest-PublicSharesNegativeTest-1466961720-project-admin] Calling method 'ShareMixin.delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:17 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.v1.shares [None req-06672101-d0ab-4d41-a04e-23420ae12224 tempest-PublicSharesNegativeTest-1466961720 tempest-PublicSharesNegativeTest-1466961720-project-admin] Delete share with id: eb49a187-afee-4d13-b48a-a957d46fc910 May 28 12:59:17 l75lg1-v1 devstack@m-api.service[98329]: DEBUG oslo_concurrency.lockutils [None req-114b6357-b203-4ce5-92dc-cbfcb096481b tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98329) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:17 l75lg1-v1 devstack@m-api.service[98329]: DEBUG oslo_concurrency.lockutils [None req-114b6357-b203-4ce5-92dc-cbfcb096481b tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98329) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:17 l75lg1-v1 devstack@m-api.service[98329]: DEBUG oslo_concurrency.lockutils [None req-114b6357-b203-4ce5-92dc-cbfcb096481b tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.045s {{(pid=98329) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:17 l75lg1-v1 devstack@m-api.service[98329]: DEBUG oslo_concurrency.lockutils [None req-114b6357-b203-4ce5-92dc-cbfcb096481b tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98329) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:17 l75lg1-v1 devstack@m-api.service[98329]: DEBUG oslo_concurrency.lockutils [None req-114b6357-b203-4ce5-92dc-cbfcb096481b tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98329) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:17 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-06672101-d0ab-4d41-a04e-23420ae12224 tempest-PublicSharesNegativeTest-1466961720 tempest-PublicSharesNegativeTest-1466961720-project-admin] http://10.27.203.238/share/v2/6e831d9989b1463da882ee355e32629c/shares/eb49a187-afee-4d13-b48a-a957d46fc910 returned with HTTP 202 May 28 12:59:17 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 697/1408] 10.27.203.238 () {64 vars in 1454 bytes} [Tue May 28 12:59:17 2024] DELETE /share/v2/6e831d9989b1463da882ee355e32629c/shares/eb49a187-afee-4d13-b48a-a957d46fc910 => generated 0 bytes in 113 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:59:17 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-ade56f97-ea54-408c-b032-ab3f889e121d tempest-PublicSharesNegativeTest-1466961720 tempest-PublicSharesNegativeTest-1466961720-project-admin] GET http://10.27.203.238/share/v2/6e831d9989b1463da882ee355e32629c/shares/eb49a187-afee-4d13-b48a-a957d46fc910 May 28 12:59:17 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-ade56f97-ea54-408c-b032-ab3f889e121d tempest-PublicSharesNegativeTest-1466961720 tempest-PublicSharesNegativeTest-1466961720-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:17 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-ade56f97-ea54-408c-b032-ab3f889e121d tempest-PublicSharesNegativeTest-1466961720 tempest-PublicSharesNegativeTest-1466961720-project-admin] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:17 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-ade56f97-ea54-408c-b032-ab3f889e121d tempest-PublicSharesNegativeTest-1466961720 tempest-PublicSharesNegativeTest-1466961720-project-admin] http://10.27.203.238/share/v2/6e831d9989b1463da882ee355e32629c/shares/eb49a187-afee-4d13-b48a-a957d46fc910 returned with HTTP 200 May 28 12:59:17 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 698/1409] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:59:17 2024] GET /share/v2/6e831d9989b1463da882ee355e32629c/shares/eb49a187-afee-4d13-b48a-a957d46fc910 => generated 1359 bytes in 23 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:59:17 l75lg1-v1 devstack@m-api.service[98329]: DEBUG oslo_concurrency.lockutils [None req-114b6357-b203-4ce5-92dc-cbfcb096481b tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.057s {{(pid=98329) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:17 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-114b6357-b203-4ce5-92dc-cbfcb096481b tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] http://10.27.203.238/share/v1/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action returned with HTTP 202 May 28 12:59:17 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 712/1410] 10.27.203.238 () {64 vars in 1450 bytes} [Tue May 28 12:59:17 2024] POST /share/v1/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action => generated 0 bytes in 383 msecs (HTTP/1.1 202) 6 headers in 242 bytes (1 switches on core 0) May 28 12:59:17 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-f025ce02-bc4b-4e8a-97ec-a3f702d5bafe tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] POST http://10.27.203.238/share/v1/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action May 28 12:59:17 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-f025ce02-bc4b-4e8a-97ec-a3f702d5bafe tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Action body: b'{"os-access_list": null}' {{(pid=98330) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:59:17 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-f025ce02-bc4b-4e8a-97ec-a3f702d5bafe tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Action: 'action', calling method: ShareController.access_list, body: {"os-access_list": null} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:59:17 l75lg1-v1 manila-share[98474]: DEBUG manila.share.manager [None req-114b6357-b203-4ce5-92dc-cbfcb096481b tempest-ShareIpRulesForNFSTest-1748669711 None] Received request to update access for share instance b7a7d61c-2cea-442a-9809-507038e080d5. {{(pid=98474) update_access_for_instances /opt/stack/manila/manila/share/manager.py:4353}} May 28 12:59:17 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-f025ce02-bc4b-4e8a-97ec-a3f702d5bafe tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] http://10.27.203.238/share/v1/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action returned with HTTP 200 May 28 12:59:17 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 699/1411] 10.27.203.238 () {64 vars in 1450 bytes} [Tue May 28 12:59:17 2024] POST /share/v1/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action => generated 148 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:59:17 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-06672101-d0ab-4d41-a04e-23420ae12224 tempest-PublicSharesNegativeTest-1466961720 None] Acquiring lock "locked_access_rules_operation_by_share_instance_67a5173e-4e46-4dc2-8375-e9849d8dde4c" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:17 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-06672101-d0ab-4d41-a04e-23420ae12224 tempest-PublicSharesNegativeTest-1466961720 None] Lock "locked_access_rules_operation_by_share_instance_67a5173e-4e46-4dc2-8375-e9849d8dde4c" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:17 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-06672101-d0ab-4d41-a04e-23420ae12224 tempest-PublicSharesNegativeTest-1466961720 None] Lock "locked_access_rules_operation_by_share_instance_67a5173e-4e46-4dc2-8375-e9849d8dde4c" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.013s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:17 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-06672101-d0ab-4d41-a04e-23420ae12224 tempest-PublicSharesNegativeTest-1466961720 None] Acquiring lock "locked_access_rules_operation_by_share_instance_67a5173e-4e46-4dc2-8375-e9849d8dde4c" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:17 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-06672101-d0ab-4d41-a04e-23420ae12224 tempest-PublicSharesNegativeTest-1466961720 None] Lock "locked_access_rules_operation_by_share_instance_67a5173e-4e46-4dc2-8375-e9849d8dde4c" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:17 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-114b6357-b203-4ce5-92dc-cbfcb096481b tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:17 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-114b6357-b203-4ce5-92dc-cbfcb096481b tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:17 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-06672101-d0ab-4d41-a04e-23420ae12224 tempest-PublicSharesNegativeTest-1466961720 None] Lock "locked_access_rules_operation_by_share_instance_67a5173e-4e46-4dc2-8375-e9849d8dde4c" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.006s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:17 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-06672101-d0ab-4d41-a04e-23420ae12224 tempest-PublicSharesNegativeTest-1466961720 None] Acquiring lock "locked_access_rules_operation_by_share_instance_67a5173e-4e46-4dc2-8375-e9849d8dde4c" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:17 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-06672101-d0ab-4d41-a04e-23420ae12224 tempest-PublicSharesNegativeTest-1466961720 None] Lock "locked_access_rules_operation_by_share_instance_67a5173e-4e46-4dc2-8375-e9849d8dde4c" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:17 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-114b6357-b203-4ce5-92dc-cbfcb096481b tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.006s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:17 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-114b6357-b203-4ce5-92dc-cbfcb096481b tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:17 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-114b6357-b203-4ce5-92dc-cbfcb096481b tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:17 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-06672101-d0ab-4d41-a04e-23420ae12224 tempest-PublicSharesNegativeTest-1466961720 None] Lock "locked_access_rules_operation_by_share_instance_67a5173e-4e46-4dc2-8375-e9849d8dde4c" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.008s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:17 l75lg1-v1 manila-share[98474]: DEBUG manila.share.access [None req-06672101-d0ab-4d41-a04e-23420ae12224 tempest-PublicSharesNegativeTest-1466961720 None] All access rules have been synced for share instance 67a5173e-4e46-4dc2-8375-e9849d8dde4c belonging to share eb49a187-afee-4d13-b48a-a957d46fc910. {{(pid=98474) update_access_rules /opt/stack/manila/manila/share/access.py:304}} May 28 12:59:17 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-06672101-d0ab-4d41-a04e-23420ae12224 tempest-PublicSharesNegativeTest-1466961720 None] deleting '/manila/manila-67a5173e-4e46-4dc2-8375-e9849d8dde4c' May 28 12:59:17 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-06672101-d0ab-4d41-a04e-23420ae12224 tempest-PublicSharesNegativeTest-1466961720 None] >>> [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/ May 28 12:59:17 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-06672101-d0ab-4d41-a04e-23420ae12224 tempest-PublicSharesNegativeTest-1466961720 None] {'data': '{"path": "/manila/manila-67a5173e-4e46-4dc2-8375-e9849d8dde4c"}', May 28 12:59:17 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-06672101-d0ab-4d41-a04e-23420ae12224 tempest-PublicSharesNegativeTest-1466961720 None] 'params': None} May 28 12:59:17 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-114b6357-b203-4ce5-92dc-cbfcb096481b tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.055s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:17 l75lg1-v1 manila-share[98474]: DEBUG manila.share.access [None req-114b6357-b203-4ce5-92dc-cbfcb096481b tempest-ShareIpRulesForNFSTest-1748669711 None] Updating access rules for share instance b7a7d61c-2cea-442a-9809-507038e080d5 belonging to share 1ddadc17-cf10-4a42-8bbd-8335fb3520a1. {{(pid=98474) update_access_rules /opt/stack/manila/manila/share/access.py:298}} May 28 12:59:17 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-114b6357-b203-4ce5-92dc-cbfcb096481b tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:17 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-114b6357-b203-4ce5-92dc-cbfcb096481b tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:17 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-114b6357-b203-4ce5-92dc-cbfcb096481b tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.007s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:17 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-114b6357-b203-4ce5-92dc-cbfcb096481b tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:17 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-114b6357-b203-4ce5-92dc-cbfcb096481b tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:17 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-06672101-d0ab-4d41-a04e-23420ae12224 tempest-PublicSharesNegativeTest-1466961720 None] <<< [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/ May 28 12:59:17 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-06672101-d0ab-4d41-a04e-23420ae12224 tempest-PublicSharesNegativeTest-1466961720 None] 'OK' May 28 12:59:17 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-06672101-d0ab-4d41-a04e-23420ae12224 tempest-PublicSharesNegativeTest-1466961720 None] --- [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/: Done May 28 12:59:17 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-06672101-d0ab-4d41-a04e-23420ae12224 tempest-PublicSharesNegativeTest-1466961720 None] >>> [GET] https://127.0.0.1:40443/api/views/ May 28 12:59:17 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-06672101-d0ab-4d41-a04e-23420ae12224 tempest-PublicSharesNegativeTest-1466961720 None] {'allow_redirects': True, May 28 12:59:17 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-06672101-d0ab-4d41-a04e-23420ae12224 tempest-PublicSharesNegativeTest-1466961720 None] 'params': {'name': '67a5173e-4e46-4dc2-8375-e9849d8dde4c'}} May 28 12:59:17 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-114b6357-b203-4ce5-92dc-cbfcb096481b tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.018s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:17 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-114b6357-b203-4ce5-92dc-cbfcb096481b tempest-ShareIpRulesForNFSTest-1748669711 None] changing access on None May 28 12:59:17 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-114b6357-b203-4ce5-92dc-cbfcb096481b tempest-ShareIpRulesForNFSTest-1748669711 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:59:17 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-114b6357-b203-4ce5-92dc-cbfcb096481b tempest-ShareIpRulesForNFSTest-1748669711 None] {'allow_redirects': True, May 28 12:59:17 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-114b6357-b203-4ce5-92dc-cbfcb096481b tempest-ShareIpRulesForNFSTest-1748669711 None] 'params': {'name': 'b7a7d61c-2cea-442a-9809-507038e080d5'}} May 28 12:59:18 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-114b6357-b203-4ce5-92dc-cbfcb096481b tempest-ShareIpRulesForNFSTest-1748669711 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:59:18 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-114b6357-b203-4ce5-92dc-cbfcb096481b tempest-ShareIpRulesForNFSTest-1748669711 None] [Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=1, created='2024-05-28T12:57:40.763635Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='377955ad-d094-4e49-ab32-1021d943a572', id=21, internal=False, is_s3_default_policy=False, name='b7a7d61c-2cea-442a-9809-507038e080d5', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=['*'], nfs_posix_acl=False, nfs_read_only=['2.2.2.2'], nfs_read_write=[], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=['2.2.2.2'], read_write=[], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T12:59:13.955440Z', tenant_id=1, tenant_name='default', title='b7a7d61c-2cea-442a-9809-507038e080d5', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/21/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[])] May 28 12:59:18 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-114b6357-b203-4ce5-92dc-cbfcb096481b tempest-ShareIpRulesForNFSTest-1748669711 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 12:59:18 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-114b6357-b203-4ce5-92dc-cbfcb096481b tempest-ShareIpRulesForNFSTest-1748669711 None] changing access on /manila/manila-b7a7d61c-2cea-442a-9809-507038e080d5. Rules: {'nfs_read_write': [], 'nfs_read_only': []} May 28 12:59:18 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-114b6357-b203-4ce5-92dc-cbfcb096481b tempest-ShareIpRulesForNFSTest-1748669711 None] >>> [PATCH] https://127.0.0.1:40443/api/viewpolicies/21/ May 28 12:59:18 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-114b6357-b203-4ce5-92dc-cbfcb096481b tempest-ShareIpRulesForNFSTest-1748669711 None] {'data': '{"name": "b7a7d61c-2cea-442a-9809-507038e080d5", "nfs_no_squash": ' May 28 12:59:18 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-114b6357-b203-4ce5-92dc-cbfcb096481b tempest-ShareIpRulesForNFSTest-1748669711 None] '["*"], "nfs_root_squash": ["*"], "nfs_read_write": [], ' May 28 12:59:18 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-114b6357-b203-4ce5-92dc-cbfcb096481b tempest-ShareIpRulesForNFSTest-1748669711 None] '"nfs_read_only": []}', May 28 12:59:18 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-114b6357-b203-4ce5-92dc-cbfcb096481b tempest-ShareIpRulesForNFSTest-1748669711 None] 'params': None} May 28 12:59:18 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-82e1de9e-1bd0-4e3a-ace8-e1e4f84e9240 tempest-ResourceLockDeleteTest-1157183439 None] <<< [POST] https://127.0.0.1:40443/api/views/ May 28 12:59:18 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-82e1de9e-1bd0-4e3a-ace8-e1e4f84e9240 tempest-ResourceLockDeleteTest-1157183439 None] Bunch(abac_tags=[], abe_max_depth=None, abe_protocols=[], alias='', allow_anonymous_access=False, allow_s3_anonymous_access=False, auto_commit='0d', bucket='', bucket_creators=[], bucket_creators_groups=[], bucket_owner=None, bulk_permission_update_progress=None, bulk_permission_update_state=None, cluster='loop75-kfs', cluster_id=1, created='2024-05-28T12:59:17.854534Z', enabled=True, files_retention_mode='NONE', guid='24b418c6-09bf-4e75-bfbc-79fefd399a8b', id=34, ignore_oos=False, internal=False, is_remote=False, is_seamless=False, logical_capacity=0, max_retention_period=None, min_retention_period=None, name='9fadf39f-1d93-4ddd-bd00-1fd7ccc09539', nfs_interop_flags='BOTH_NFS3_AND_NFS4_INTEROP_DISABLED', path='/manila/manila-9fadf39f-1d93-4ddd-bd00-1fd7ccc09539', physical_capacity=0, policy='9fadf39f-1d93-4ddd-bd00-1fd7ccc09539', policy_id=35, protocols=['NFS'], qos_policy=None, qos_policy_id=None, s3_locks=False, s3_locks_retention_mode='NONE', s3_locks_retention_period='', s3_object_ownership_rule='ObjectWriter', s3_unverified_lookup=False, s3_versioning=False, select_for_live_monitoring=False, share='', share_acl=Bunch(acl=[], enabled=False), sync='SYNCED', sync_time='2024-05-28T12:59:18.126740Z', tenant_id=1, tenant_name='default', title='/manila/manila-9fadf39f-1d93-4ddd-bd00-1fd7ccc09539', url='https://127.0.0.1:40443/api/views/34/') May 28 12:59:18 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-82e1de9e-1bd0-4e3a-ace8-e1e4f84e9240 tempest-ResourceLockDeleteTest-1157183439 None] --- [POST] https://127.0.0.1:40443/api/views/: Done May 28 12:59:18 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-06672101-d0ab-4d41-a04e-23420ae12224 tempest-PublicSharesNegativeTest-1466961720 None] <<< [GET] https://127.0.0.1:40443/api/views/ May 28 12:59:18 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-06672101-d0ab-4d41-a04e-23420ae12224 tempest-PublicSharesNegativeTest-1466961720 None] [Bunch(abac_tags=[], abe_max_depth=None, abe_protocols=[], alias='', allow_anonymous_access=False, allow_s3_anonymous_access=False, auto_commit='0d', bucket='', bucket_creators=[], bucket_creators_groups=[], bucket_owner=None, bulk_permission_update_progress=None, bulk_permission_update_state=None, cluster='loop75-kfs', cluster_id=1, created='2024-05-28T12:59:14.866595Z', enabled=True, files_retention_mode='NONE', guid='da0a0ec0-2b45-46d4-a798-76729b7020f2', id=33, ignore_oos=False, internal=False, is_remote=False, is_seamless=False, logical_capacity=0, max_retention_period=None, min_retention_period=None, name='67a5173e-4e46-4dc2-8375-e9849d8dde4c', nfs_interop_flags='BOTH_NFS3_AND_NFS4_INTEROP_DISABLED', path='/manila/manila-67a5173e-4e46-4dc2-8375-e9849d8dde4c', physical_capacity=0, policy='67a5173e-4e46-4dc2-8375-e9849d8dde4c', policy_id=34, protocols=['NFS'], qos_policy=None, qos_policy_id=None, s3_locks=False, s3_locks_retention_mode='NONE', s3_locks_retention_period='', s3_unverified_lookup=False, s3_versioning=False, select_for_live_monitoring=False, share='', share_acl=Bunch(acl=[], enabled=False), sync='SYNCED', sync_time='2024-05-28T12:59:15.144852Z', tenant_id=1, tenant_name='default', title='/manila/manila-67a5173e-4e46-4dc2-8375-e9849d8dde4c', url='https://127.0.0.1:40443/api/views/33/')] May 28 12:59:18 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-06672101-d0ab-4d41-a04e-23420ae12224 tempest-PublicSharesNegativeTest-1466961720 None] --- [GET] https://127.0.0.1:40443/api/views/: Done May 28 12:59:18 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-06672101-d0ab-4d41-a04e-23420ae12224 tempest-PublicSharesNegativeTest-1466961720 None] >>> [DELETE] https://127.0.0.1:40443/api/views/33/ May 28 12:59:18 l75lg1-v1 manila-share[98474]: INFO manila.share.manager [None req-82e1de9e-1bd0-4e3a-ace8-e1e4f84e9240 tempest-ResourceLockDeleteTest-1157183439 None] Share instance 9fadf39f-1d93-4ddd-bd00-1fd7ccc09539 created successfully. May 28 12:59:18 l75lg1-v1 dstat.sh[49771]: 28-05 12:59:18| 12 1 86 1 0|5738M 1733M 277M 7876M| 19k 4834B| 0 1328k| 0 137 |5307 8674 |1.23 1.07 1.02|2.0 1.0 2.0| 0 0 | 0 2048M| 29 361 0 37 0 May 28 12:59:18 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-7e8b4f97-febd-49b1-9cf4-b4f7260e2e3d tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] <<< [PATCH] https://127.0.0.1:40443/api/viewpolicies/32/ May 28 12:59:18 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-7e8b4f97-febd-49b1-9cf4-b4f7260e2e3d tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=1, created='2024-05-28T12:58:43.845440Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='31b6534b-d142-4561-992f-4f0759db302d', id=32, internal=False, is_s3_default_policy=False, name='7fdd602c-79d0-479c-95a2-336b202c6639', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=['*'], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=[], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=[], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='MODIFYING', sync_time='2024-05-28T12:59:18.306849Z', tenant_id=1, tenant_name='default', title='7fdd602c-79d0-479c-95a2-336b202c6639', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/32/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[]) May 28 12:59:18 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-7e8b4f97-febd-49b1-9cf4-b4f7260e2e3d tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] --- [PATCH] https://127.0.0.1:40443/api/viewpolicies/32/: Done May 28 12:59:18 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-7e8b4f97-febd-49b1-9cf4-b4f7260e2e3d tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:18 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-7e8b4f97-febd-49b1-9cf4-b4f7260e2e3d tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:18 l75lg1-v1 neutron-server[77619]: DEBUG dbcounter [-] [77619] Writing DB stats neutron:SELECT=4 {{(pid=77619) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:59:18 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-7e8b4f97-febd-49b1-9cf4-b4f7260e2e3d tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.086s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:18 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-7e8b4f97-febd-49b1-9cf4-b4f7260e2e3d tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:18 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-7e8b4f97-febd-49b1-9cf4-b4f7260e2e3d tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:18 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-7e8b4f97-febd-49b1-9cf4-b4f7260e2e3d tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.022s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:18 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-7e8b4f97-febd-49b1-9cf4-b4f7260e2e3d tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:18 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-7e8b4f97-febd-49b1-9cf4-b4f7260e2e3d tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:18 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-7e8b4f97-febd-49b1-9cf4-b4f7260e2e3d tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:18 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-7e8b4f97-febd-49b1-9cf4-b4f7260e2e3d tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:18 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-7e8b4f97-febd-49b1-9cf4-b4f7260e2e3d tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:18 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-7e8b4f97-febd-49b1-9cf4-b4f7260e2e3d tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:18 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-7e8b4f97-febd-49b1-9cf4-b4f7260e2e3d tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:18 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-7e8b4f97-febd-49b1-9cf4-b4f7260e2e3d tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:19 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-7e8b4f97-febd-49b1-9cf4-b4f7260e2e3d tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.037s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:19 l75lg1-v1 manila-share[98474]: INFO manila.share.access [None req-7e8b4f97-febd-49b1-9cf4-b4f7260e2e3d tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Access rules were successfully modified for share instance 7fdd602c-79d0-479c-95a2-336b202c6639 belonging to share 72db8769-ece7-42ff-af27-2e778292a9b4. May 28 12:59:19 l75lg1-v1 dstat.sh[49771]: 28-05 12:59:19| 2 1 96 1 0|5738M 1733M 277M 7876M|9644B 66B| 0 1116k| 0 120 |2499 4184 |1.23 1.07 1.02|1.0 1.0 0| 0 0 | 0 2048M| 29 361 0 37 0 May 28 12:59:19 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-a24bcbd7-07e6-490a-8b5e-fb1b70a3b05d tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] GET http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/share-access-rules?share_id=72db8769-ece7-42ff-af27-2e778292a9b4 May 28 12:59:19 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-a24bcbd7-07e6-490a-8b5e-fb1b70a3b05d tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:19 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-a24bcbd7-07e6-490a-8b5e-fb1b70a3b05d tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:19 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-a24bcbd7-07e6-490a-8b5e-fb1b70a3b05d tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/share-access-rules?share_id=72db8769-ece7-42ff-af27-2e778292a9b4 returned with HTTP 200 May 28 12:59:19 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 713/1412] 10.27.203.238 () {64 vars in 1467 bytes} [Tue May 28 12:59:19 2024] GET /share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/share-access-rules?share_id=72db8769-ece7-42ff-af27-2e778292a9b4 => generated 19 bytes in 29 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:59:19 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-ffb09745-facc-442b-bfa9-f6cb08fba538 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] POST http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action May 28 12:59:19 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-ffb09745-facc-442b-bfa9-f6cb08fba538 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Action body: b'{"allow_access": {"access_type": "ip", "access_to": "1.2.3.4", "access_level": "rw"}}' {{(pid=98330) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:59:19 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-ffb09745-facc-442b-bfa9-f6cb08fba538 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Action: 'action', calling method: ShareController.allow_access, body: {"allow_access": {"access_type": "ip", "access_to": "1.2.3.4", "access_level": "rw"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:59:19 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-ffb09745-facc-442b-bfa9-f6cb08fba538 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:19 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-ffb09745-facc-442b-bfa9-f6cb08fba538 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:19 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-ffb09745-facc-442b-bfa9-f6cb08fba538 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.038s {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:19 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-ffb09745-facc-442b-bfa9-f6cb08fba538 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action returned with HTTP 200 May 28 12:59:19 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 700/1413] 10.27.203.238 () {66 vars in 1493 bytes} [Tue May 28 12:59:19 2024] POST /share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action => generated 305 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:59:19 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-b2ef5235-e080-4b8c-a8ca-25a67d503dc2 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] GET http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/share-access-rules?share_id=72db8769-ece7-42ff-af27-2e778292a9b4 May 28 12:59:19 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-b2ef5235-e080-4b8c-a8ca-25a67d503dc2 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:19 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-b2ef5235-e080-4b8c-a8ca-25a67d503dc2 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:19 l75lg1-v1 manila-share[98474]: DEBUG manila.share.manager [None req-ffb09745-facc-442b-bfa9-f6cb08fba538 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Received request to update access for share instance 7fdd602c-79d0-479c-95a2-336b202c6639. {{(pid=98474) update_access_for_instances /opt/stack/manila/manila/share/manager.py:4353}} May 28 12:59:19 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-ffb09745-facc-442b-bfa9-f6cb08fba538 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:19 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-ffb09745-facc-442b-bfa9-f6cb08fba538 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:19 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.lock.api [None req-b2ef5235-e080-4b8c-a8ca-25a67d503dc2 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Searching for locks by: {'resource_id': 'edfd3b97-9ec3-4134-9a5f-5ccaa70b6c09', 'resource_action': 'show', 'resource_type': 'access_rule'} {{(pid=98329) get_all /opt/stack/manila/manila/lock/api.py:112}} May 28 12:59:19 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-ffb09745-facc-442b-bfa9-f6cb08fba538 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:19 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-ffb09745-facc-442b-bfa9-f6cb08fba538 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:19 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-ffb09745-facc-442b-bfa9-f6cb08fba538 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:19 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-b2ef5235-e080-4b8c-a8ca-25a67d503dc2 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/share-access-rules?share_id=72db8769-ece7-42ff-af27-2e778292a9b4 returned with HTTP 200 May 28 12:59:19 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 714/1414] 10.27.203.238 () {64 vars in 1467 bytes} [Tue May 28 12:59:19 2024] GET /share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/share-access-rules?share_id=72db8769-ece7-42ff-af27-2e778292a9b4 => generated 260 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:59:19 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-114b6357-b203-4ce5-92dc-cbfcb096481b tempest-ShareIpRulesForNFSTest-1748669711 None] <<< [PATCH] https://127.0.0.1:40443/api/viewpolicies/21/ May 28 12:59:19 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-114b6357-b203-4ce5-92dc-cbfcb096481b tempest-ShareIpRulesForNFSTest-1748669711 None] Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=1, created='2024-05-28T12:57:40.763635Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='377955ad-d094-4e49-ab32-1021d943a572', id=21, internal=False, is_s3_default_policy=False, name='b7a7d61c-2cea-442a-9809-507038e080d5', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=['*'], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=[], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=[], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='MODIFYING', sync_time='2024-05-28T12:59:19.345165Z', tenant_id=1, tenant_name='default', title='b7a7d61c-2cea-442a-9809-507038e080d5', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/21/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[]) May 28 12:59:19 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-114b6357-b203-4ce5-92dc-cbfcb096481b tempest-ShareIpRulesForNFSTest-1748669711 None] --- [PATCH] https://127.0.0.1:40443/api/viewpolicies/21/: Done May 28 12:59:19 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-114b6357-b203-4ce5-92dc-cbfcb096481b tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:19 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-114b6357-b203-4ce5-92dc-cbfcb096481b tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:19 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-d06ca763-566e-483b-8592-6a04b765d543 tempest-ResourceLockDeleteTest-1157183439 tempest-ResourceLockDeleteTest-1157183439-project-member] GET http://10.27.203.238/share/v2/645fb190404541a78e449c703540d6f8/shares/ed309fc1-d1ff-4352-a44a-a56b44eb8d0e May 28 12:59:19 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-d06ca763-566e-483b-8592-6a04b765d543 tempest-ResourceLockDeleteTest-1157183439 tempest-ResourceLockDeleteTest-1157183439-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:19 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-d06ca763-566e-483b-8592-6a04b765d543 tempest-ResourceLockDeleteTest-1157183439 tempest-ResourceLockDeleteTest-1157183439-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:19 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-d06ca763-566e-483b-8592-6a04b765d543 tempest-ResourceLockDeleteTest-1157183439 tempest-ResourceLockDeleteTest-1157183439-project-member] http://10.27.203.238/share/v2/645fb190404541a78e449c703540d6f8/shares/ed309fc1-d1ff-4352-a44a-a56b44eb8d0e returned with HTTP 200 May 28 12:59:19 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 701/1415] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:59:19 2024] GET /share/v2/645fb190404541a78e449c703540d6f8/shares/ed309fc1-d1ff-4352-a44a-a56b44eb8d0e => generated 1317 bytes in 25 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:59:19 l75lg1-v1 nova-conductor[83648]: DEBUG dbcounter [-] [83648] Writing DB stats nova_cell1:SELECT=3 {{(pid=83648) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:59:19 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-f6dfbe09-fafd-4de7-ac9b-aa76b09ba8e5 tempest-ResourceLockDeleteTest-1157183439 tempest-ResourceLockDeleteTest-1157183439-project-member] POST http://10.27.203.238/share/v2/645fb190404541a78e449c703540d6f8/resource-locks May 28 12:59:19 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-f6dfbe09-fafd-4de7-ac9b-aa76b09ba8e5 tempest-ResourceLockDeleteTest-1157183439 tempest-ResourceLockDeleteTest-1157183439-project-member] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"resource_lock": {"resource_id": "ed309fc1-d1ff-4352-a44a-a56b44eb8d0e", "resource_type": "share", "resource_action": "delete", "lock_reason": "locked by tempest tests"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:59:19 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-114b6357-b203-4ce5-92dc-cbfcb096481b tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.056s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:19 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-114b6357-b203-4ce5-92dc-cbfcb096481b tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:19 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-114b6357-b203-4ce5-92dc-cbfcb096481b tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:20 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-ffb09745-facc-442b-bfa9-f6cb08fba538 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.091s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:20 l75lg1-v1 manila-share[98474]: DEBUG manila.share.access [None req-ffb09745-facc-442b-bfa9-f6cb08fba538 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Updating access rules for share instance 7fdd602c-79d0-479c-95a2-336b202c6639 belonging to share 72db8769-ece7-42ff-af27-2e778292a9b4. {{(pid=98474) update_access_rules /opt/stack/manila/manila/share/access.py:298}} May 28 12:59:20 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-f6dfbe09-fafd-4de7-ac9b-aa76b09ba8e5 tempest-ResourceLockDeleteTest-1157183439 tempest-ResourceLockDeleteTest-1157183439-project-member] http://10.27.203.238/share/v2/645fb190404541a78e449c703540d6f8/resource-locks returned with HTTP 200 May 28 12:59:20 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 715/1416] 10.27.203.238 () {66 vars in 1386 bytes} [Tue May 28 12:59:19 2024] POST /share/v2/645fb190404541a78e449c703540d6f8/resource-locks => generated 700 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:59:20 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-e410b4b0-23f8-47cb-b607-566f19949cd4 tempest-ResourceLockDeleteTest-1157183439 tempest-ResourceLockDeleteTest-1157183439-project-member] POST http://10.27.203.238/share/v2/645fb190404541a78e449c703540d6f8/resource-locks May 28 12:59:20 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-e410b4b0-23f8-47cb-b607-566f19949cd4 tempest-ResourceLockDeleteTest-1157183439 tempest-ResourceLockDeleteTest-1157183439-project-member] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"resource_lock": {"resource_id": "ed309fc1-d1ff-4352-a44a-a56b44eb8d0e", "resource_type": "share", "resource_action": "delete", "lock_reason": "locked by tempest tests"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:59:20 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-114b6357-b203-4ce5-92dc-cbfcb096481b tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.030s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:20 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-114b6357-b203-4ce5-92dc-cbfcb096481b tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:20 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-114b6357-b203-4ce5-92dc-cbfcb096481b tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:20 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-114b6357-b203-4ce5-92dc-cbfcb096481b tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.009s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:20 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-114b6357-b203-4ce5-92dc-cbfcb096481b tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:20 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-114b6357-b203-4ce5-92dc-cbfcb096481b tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:20 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-ffb09745-facc-442b-bfa9-f6cb08fba538 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:20 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-ffb09745-facc-442b-bfa9-f6cb08fba538 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:20 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-ffb09745-facc-442b-bfa9-f6cb08fba538 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.007s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:20 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-ffb09745-facc-442b-bfa9-f6cb08fba538 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:20 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-ffb09745-facc-442b-bfa9-f6cb08fba538 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:20 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-e410b4b0-23f8-47cb-b607-566f19949cd4 tempest-ResourceLockDeleteTest-1157183439 tempest-ResourceLockDeleteTest-1157183439-project-member] http://10.27.203.238/share/v2/645fb190404541a78e449c703540d6f8/resource-locks returned with HTTP 200 May 28 12:59:20 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 702/1417] 10.27.203.238 () {66 vars in 1386 bytes} [Tue May 28 12:59:20 2024] POST /share/v2/645fb190404541a78e449c703540d6f8/resource-locks => generated 700 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:59:20 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-114b6357-b203-4ce5-92dc-cbfcb096481b tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.026s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:20 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-114b6357-b203-4ce5-92dc-cbfcb096481b tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:20 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-114b6357-b203-4ce5-92dc-cbfcb096481b tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:20 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-ffb09745-facc-442b-bfa9-f6cb08fba538 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.016s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:20 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-ffb09745-facc-442b-bfa9-f6cb08fba538 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] changing access on None May 28 12:59:20 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ffb09745-facc-442b-bfa9-f6cb08fba538 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:59:20 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ffb09745-facc-442b-bfa9-f6cb08fba538 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] {'allow_redirects': True, May 28 12:59:20 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ffb09745-facc-442b-bfa9-f6cb08fba538 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] 'params': {'name': '7fdd602c-79d0-479c-95a2-336b202c6639'}} May 28 12:59:20 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-18479f42-5034-4ead-8a2c-d0d488706446 tempest-ResourceLockDeleteTest-1157183439 tempest-ResourceLockDeleteTest-1157183439-project-member] GET http://10.27.203.238/share/v2/645fb190404541a78e449c703540d6f8/resource-locks?resource_id=ed309fc1-d1ff-4352-a44a-a56b44eb8d0e May 28 12:59:20 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-18479f42-5034-4ead-8a2c-d0d488706446 tempest-ResourceLockDeleteTest-1157183439 tempest-ResourceLockDeleteTest-1157183439-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:20 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-18479f42-5034-4ead-8a2c-d0d488706446 tempest-ResourceLockDeleteTest-1157183439 tempest-ResourceLockDeleteTest-1157183439-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:20 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.lock.api [None req-18479f42-5034-4ead-8a2c-d0d488706446 tempest-ResourceLockDeleteTest-1157183439 tempest-ResourceLockDeleteTest-1157183439-project-member] Searching for locks by: MultiDict([('resource_id', 'ed309fc1-d1ff-4352-a44a-a56b44eb8d0e')]) {{(pid=98329) get_all /opt/stack/manila/manila/lock/api.py:112}} May 28 12:59:20 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-18479f42-5034-4ead-8a2c-d0d488706446 tempest-ResourceLockDeleteTest-1157183439 tempest-ResourceLockDeleteTest-1157183439-project-member] http://10.27.203.238/share/v2/645fb190404541a78e449c703540d6f8/resource-locks?resource_id=ed309fc1-d1ff-4352-a44a-a56b44eb8d0e returned with HTTP 200 May 28 12:59:20 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 716/1418] 10.27.203.238 () {64 vars in 1461 bytes} [Tue May 28 12:59:20 2024] GET /share/v2/645fb190404541a78e449c703540d6f8/resource-locks?resource_id=ed309fc1-d1ff-4352-a44a-a56b44eb8d0e => generated 1386 bytes in 13 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:59:20 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-8f6dc48f-60ba-47da-9807-416df0dcb6e1 tempest-ResourceLockDeleteTest-1157183439 tempest-ResourceLockDeleteTest-1157183439-project-member] DELETE http://10.27.203.238/share/v2/645fb190404541a78e449c703540d6f8/resource-locks/bfb88902-5d83-497e-8518-47d736887065 May 28 12:59:20 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-8f6dc48f-60ba-47da-9807-416df0dcb6e1 tempest-ResourceLockDeleteTest-1157183439 tempest-ResourceLockDeleteTest-1157183439-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:20 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-8f6dc48f-60ba-47da-9807-416df0dcb6e1 tempest-ResourceLockDeleteTest-1157183439 tempest-ResourceLockDeleteTest-1157183439-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:20 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-8f6dc48f-60ba-47da-9807-416df0dcb6e1 tempest-ResourceLockDeleteTest-1157183439 tempest-ResourceLockDeleteTest-1157183439-project-member] http://10.27.203.238/share/v2/645fb190404541a78e449c703540d6f8/resource-locks/bfb88902-5d83-497e-8518-47d736887065 returned with HTTP 204 May 28 12:59:20 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 703/1419] 10.27.203.238 () {64 vars in 1478 bytes} [Tue May 28 12:59:20 2024] DELETE /share/v2/645fb190404541a78e449c703540d6f8/resource-locks/bfb88902-5d83-497e-8518-47d736887065 => generated 0 bytes in 24 msecs (HTTP/1.1 204) 6 headers in 245 bytes (1 switches on core 0) May 28 12:59:20 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-114b6357-b203-4ce5-92dc-cbfcb096481b tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.042s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:20 l75lg1-v1 manila-share[98474]: INFO manila.share.access [None req-114b6357-b203-4ce5-92dc-cbfcb096481b tempest-ShareIpRulesForNFSTest-1748669711 None] Access rules were successfully modified for share instance b7a7d61c-2cea-442a-9809-507038e080d5 belonging to share 1ddadc17-cf10-4a42-8bbd-8335fb3520a1. May 28 12:59:20 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-25d660c4-172b-4c59-aa09-8a91f85dd2bb tempest-ResourceLockDeleteTest-1157183439 tempest-ResourceLockDeleteTest-1157183439-project-member] GET http://10.27.203.238/share/v2/645fb190404541a78e449c703540d6f8/resource-locks?resource_id=ed309fc1-d1ff-4352-a44a-a56b44eb8d0e May 28 12:59:20 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-25d660c4-172b-4c59-aa09-8a91f85dd2bb tempest-ResourceLockDeleteTest-1157183439 tempest-ResourceLockDeleteTest-1157183439-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:20 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-25d660c4-172b-4c59-aa09-8a91f85dd2bb tempest-ResourceLockDeleteTest-1157183439 tempest-ResourceLockDeleteTest-1157183439-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:20 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.lock.api [None req-25d660c4-172b-4c59-aa09-8a91f85dd2bb tempest-ResourceLockDeleteTest-1157183439 tempest-ResourceLockDeleteTest-1157183439-project-member] Searching for locks by: MultiDict([('resource_id', 'ed309fc1-d1ff-4352-a44a-a56b44eb8d0e')]) {{(pid=98329) get_all /opt/stack/manila/manila/lock/api.py:112}} May 28 12:59:20 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-25d660c4-172b-4c59-aa09-8a91f85dd2bb tempest-ResourceLockDeleteTest-1157183439 tempest-ResourceLockDeleteTest-1157183439-project-member] http://10.27.203.238/share/v2/645fb190404541a78e449c703540d6f8/resource-locks?resource_id=ed309fc1-d1ff-4352-a44a-a56b44eb8d0e returned with HTTP 200 May 28 12:59:20 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 717/1420] 10.27.203.238 () {64 vars in 1461 bytes} [Tue May 28 12:59:20 2024] GET /share/v2/645fb190404541a78e449c703540d6f8/resource-locks?resource_id=ed309fc1-d1ff-4352-a44a-a56b44eb8d0e => generated 703 bytes in 11 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:59:20 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-492793a6-4fed-460f-a242-c9c3b521a5e1 tempest-ResourceLockDeleteTest-1157183439 tempest-ResourceLockDeleteTest-1157183439-project-member] DELETE http://10.27.203.238/share/v2/645fb190404541a78e449c703540d6f8/resource-locks/e406ee5f-dadf-4021-a75a-88ee8db44e84 May 28 12:59:20 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-492793a6-4fed-460f-a242-c9c3b521a5e1 tempest-ResourceLockDeleteTest-1157183439 tempest-ResourceLockDeleteTest-1157183439-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:20 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-492793a6-4fed-460f-a242-c9c3b521a5e1 tempest-ResourceLockDeleteTest-1157183439 tempest-ResourceLockDeleteTest-1157183439-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:20 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-492793a6-4fed-460f-a242-c9c3b521a5e1 tempest-ResourceLockDeleteTest-1157183439 tempest-ResourceLockDeleteTest-1157183439-project-member] http://10.27.203.238/share/v2/645fb190404541a78e449c703540d6f8/resource-locks/e406ee5f-dadf-4021-a75a-88ee8db44e84 returned with HTTP 204 May 28 12:59:20 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 704/1421] 10.27.203.238 () {64 vars in 1478 bytes} [Tue May 28 12:59:20 2024] DELETE /share/v2/645fb190404541a78e449c703540d6f8/resource-locks/e406ee5f-dadf-4021-a75a-88ee8db44e84 => generated 0 bytes in 20 msecs (HTTP/1.1 204) 6 headers in 245 bytes (1 switches on core 0) May 28 12:59:20 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-9e16c51d-590c-4fe4-86a1-422184cadcbd tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] GET http://10.27.203.238/share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/shares/3f890c77-5b7c-40a3-900d-99b36774b221 May 28 12:59:20 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-9e16c51d-590c-4fe4-86a1-422184cadcbd tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:20 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-9e16c51d-590c-4fe4-86a1-422184cadcbd tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:20 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-836b46e9-fccf-4e44-a0e0-b29bbd635f50 tempest-ResourceLockDeleteTest-1157183439 tempest-ResourceLockDeleteTest-1157183439-project-member] DELETE http://10.27.203.238/share/v2/645fb190404541a78e449c703540d6f8/resource-locks/bfb88902-5d83-497e-8518-47d736887065 May 28 12:59:20 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-836b46e9-fccf-4e44-a0e0-b29bbd635f50 tempest-ResourceLockDeleteTest-1157183439 tempest-ResourceLockDeleteTest-1157183439-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:20 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-836b46e9-fccf-4e44-a0e0-b29bbd635f50 tempest-ResourceLockDeleteTest-1157183439 tempest-ResourceLockDeleteTest-1157183439-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:20 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-836b46e9-fccf-4e44-a0e0-b29bbd635f50 tempest-ResourceLockDeleteTest-1157183439 tempest-ResourceLockDeleteTest-1157183439-project-member] HTTP exception thrown: Resource lock bfb88902-5d83-497e-8518-47d736887065 could not be found. May 28 12:59:20 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-836b46e9-fccf-4e44-a0e0-b29bbd635f50 tempest-ResourceLockDeleteTest-1157183439 tempest-ResourceLockDeleteTest-1157183439-project-member] http://10.27.203.238/share/v2/645fb190404541a78e449c703540d6f8/resource-locks/bfb88902-5d83-497e-8518-47d736887065 returned with HTTP 404 May 28 12:59:20 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 718/1422] 10.27.203.238 () {64 vars in 1478 bytes} [Tue May 28 12:59:20 2024] DELETE /share/v2/645fb190404541a78e449c703540d6f8/resource-locks/bfb88902-5d83-497e-8518-47d736887065 => generated 116 bytes in 13 msecs (HTTP/1.1 404) 6 headers in 238 bytes (1 switches on core 0) May 28 12:59:20 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-9e384288-b679-4690-af62-d06df3e67644 tempest-ResourceLockDeleteTest-1157183439 tempest-ResourceLockDeleteTest-1157183439-project-member] POST http://10.27.203.238/share/v2/645fb190404541a78e449c703540d6f8/shares May 28 12:59:20 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-9e384288-b679-4690-af62-d06df3e67644 tempest-ResourceLockDeleteTest-1157183439 tempest-ResourceLockDeleteTest-1157183439-project-member] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share": {"share_proto": "nfs", "description": "Tempest's share", "snapshot_id": null, "name": "tempest-tempest-created-share-772094697", "size": 1, "metadata": {}, "is_public": false, "share_type": "305c3f64-cb34-4ade-92bf-ec56ac8e48be"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:59:20 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.v1.shares [None req-9e384288-b679-4690-af62-d06df3e67644 tempest-ResourceLockDeleteTest-1157183439 tempest-ResourceLockDeleteTest-1157183439-project-member] Create NFS share of 1 GB May 28 12:59:20 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-9e16c51d-590c-4fe4-86a1-422184cadcbd tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] http://10.27.203.238/share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/shares/3f890c77-5b7c-40a3-900d-99b36774b221 returned with HTTP 200 May 28 12:59:20 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 705/1423] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:59:20 2024] GET /share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/shares/3f890c77-5b7c-40a3-900d-99b36774b221 => generated 1367 bytes in 24 msecs (HTTP/1.1 200) 6 headers in 232 bytes (2 switches on core 0) May 28 12:59:20 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.quota [None req-9e384288-b679-4690-af62-d06df3e67644 tempest-ResourceLockDeleteTest-1157183439 tempest-ResourceLockDeleteTest-1157183439-project-member] Created reservations ['8f6d24e9-2115-4a14-9e98-d4c31598c1c3', 'ef2b05d3-141c-4d67-a924-4facb7380c36', '75400811-8b82-431c-9c53-7e3c67ae76f2', '8ddfb616-417b-42aa-890d-0514f17b834b'] {{(pid=98329) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 12:59:20 l75lg1-v1 dstat.sh[49771]: 28-05 12:59:20| 8 1 90 2 0|5738M 1733M 277M 7877M| 10k 8524B| 0 1668k| 0 226 |4687 7831 |1.23 1.07 1.02|3.0 2.0 0| 0 0 | 0 2048M| 29 362 0 32 0 May 28 12:59:20 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.quota [None req-9e384288-b679-4690-af62-d06df3e67644 tempest-ResourceLockDeleteTest-1157183439 tempest-ResourceLockDeleteTest-1157183439-project-member] Committed reservations ['8f6d24e9-2115-4a14-9e98-d4c31598c1c3', 'ef2b05d3-141c-4d67-a924-4facb7380c36', '75400811-8b82-431c-9c53-7e3c67ae76f2', '8ddfb616-417b-42aa-890d-0514f17b834b'] {{(pid=98329) commit /opt/stack/manila/manila/quota.py:1063}} May 28 12:59:20 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.host_manager [None req-9e384288-b679-4690-af62-d06df3e67644 tempest-ResourceLockDeleteTest-1157183439 None] Share service is down. (host: l75lg1-v1@generic2). May 28 12:59:20 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.host_manager [None req-9e384288-b679-4690-af62-d06df3e67644 tempest-ResourceLockDeleteTest-1157183439 None] Share service is down. (host: l75lg1-v1@generic1). May 28 12:59:20 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-9e384288-b679-4690-af62-d06df3e67644 tempest-ResourceLockDeleteTest-1157183439 None] Starting with 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:80}} May 28 12:59:20 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-9e384288-b679-4690-af62-d06df3e67644 tempest-ResourceLockDeleteTest-1157183439 None] Filter OnlyHostFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:59:20 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-9e384288-b679-4690-af62-d06df3e67644 tempest-ResourceLockDeleteTest-1157183439 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:59:20 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.capacity [None req-9e384288-b679-4690-af62-d06df3e67644 tempest-ResourceLockDeleteTest-1157183439 None] Space information for share creation on host l75lg1-v1@vast#vast (requested / avail): 1/2079 {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/capacity.py:83}} May 28 12:59:20 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-9e384288-b679-4690-af62-d06df3e67644 tempest-ResourceLockDeleteTest-1157183439 None] Filter CapacityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:59:20 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-9e384288-b679-4690-af62-d06df3e67644 tempest-ResourceLockDeleteTest-1157183439 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:59:20 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-9e384288-b679-4690-af62-d06df3e67644 tempest-ResourceLockDeleteTest-1157183439 None] Driver Filter: Checking host 'l75lg1-v1@vast#vast' {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:37}} May 28 12:59:20 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-9e384288-b679-4690-af62-d06df3e67644 tempest-ResourceLockDeleteTest-1157183439 None] Filter function not set :: passing host. {{(pid=98327) _check_filter_function /opt/stack/manila/manila/scheduler/filters/driver.py:53}} May 28 12:59:20 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-9e384288-b679-4690-af62-d06df3e67644 tempest-ResourceLockDeleteTest-1157183439 None] Result: True {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:40}} May 28 12:59:20 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-9e384288-b679-4690-af62-d06df3e67644 tempest-ResourceLockDeleteTest-1157183439 None] Done checking host 'l75lg1-v1@vast#vast' {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:41}} May 28 12:59:20 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-9e384288-b679-4690-af62-d06df3e67644 tempest-ResourceLockDeleteTest-1157183439 None] Filter DriverFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:59:20 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-9e384288-b679-4690-af62-d06df3e67644 tempest-ResourceLockDeleteTest-1157183439 None] Filter ShareReplicationFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:59:20 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-9e384288-b679-4690-af62-d06df3e67644 tempest-ResourceLockDeleteTest-1157183439 None] Filter CreateFromSnapshotFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:59:20 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-9e384288-b679-4690-af62-d06df3e67644 tempest-ResourceLockDeleteTest-1157183439 tempest-ResourceLockDeleteTest-1157183439-project-member] http://10.27.203.238/share/v2/645fb190404541a78e449c703540d6f8/shares returned with HTTP 200 May 28 12:59:20 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 719/1424] 10.27.203.238 () {66 vars in 1362 bytes} [Tue May 28 12:59:20 2024] POST /share/v2/645fb190404541a78e449c703540d6f8/shares => generated 1311 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:59:20 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-9e384288-b679-4690-af62-d06df3e67644 tempest-ResourceLockDeleteTest-1157183439 None] Filter AffinityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:59:20 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-9e384288-b679-4690-af62-d06df3e67644 tempest-ResourceLockDeleteTest-1157183439 None] Filter AntiAffinityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:59:20 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.drivers.filter [None req-9e384288-b679-4690-af62-d06df3e67644 tempest-ResourceLockDeleteTest-1157183439 None] Filtered share [host: 'l75lg1-v1@vast#vast', free_capacity_gb: 2079.64910808485, pools: None] {{(pid=98327) _schedule_share /opt/stack/manila/manila/scheduler/drivers/filter.py:268}} May 28 12:59:20 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-9e384288-b679-4690-af62-d06df3e67644 tempest-ResourceLockDeleteTest-1157183439 None] Checking host 'l75lg1-v1@vast#vast' {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:46}} May 28 12:59:20 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.weighers.goodness [None req-9e384288-b679-4690-af62-d06df3e67644 tempest-ResourceLockDeleteTest-1157183439 None] Goodness function not set :: defaulting to minimal goodness rating of 0. May 28 12:59:20 l75lg1-v1 manila-scheduler[98327]: INFO manila.scheduler.weighers.goodness [None req-9e384288-b679-4690-af62-d06df3e67644 tempest-ResourceLockDeleteTest-1157183439 None] Goodness function result for host l75lg1-v1@vast#vast: 0. May 28 12:59:20 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-9e384288-b679-4690-af62-d06df3e67644 tempest-ResourceLockDeleteTest-1157183439 None] Goodness: 0 {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:48}} May 28 12:59:20 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-9e384288-b679-4690-af62-d06df3e67644 tempest-ResourceLockDeleteTest-1157183439 None] Done checking host 'l75lg1-v1@vast#vast' {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:49}} May 28 12:59:20 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.drivers.filter [None req-9e384288-b679-4690-af62-d06df3e67644 tempest-ResourceLockDeleteTest-1157183439 None] Choosing for share: WeighedHost [host: l75lg1-v1@vast#vast, weight: 0.0] {{(pid=98327) _schedule_share /opt/stack/manila/manila/scheduler/drivers/filter.py:274}} May 28 12:59:20 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-9a70a51f-cf60-4b42-a212-8c3d72cf86e5 tempest-ResourceLockDeleteTest-1157183439 tempest-ResourceLockDeleteTest-1157183439-project-member] GET http://10.27.203.238/share/v2/645fb190404541a78e449c703540d6f8/shares/2de4a970-0a05-4094-bdb1-ff3d4f9d20d2 May 28 12:59:20 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-9a70a51f-cf60-4b42-a212-8c3d72cf86e5 tempest-ResourceLockDeleteTest-1157183439 tempest-ResourceLockDeleteTest-1157183439-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:20 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-9a70a51f-cf60-4b42-a212-8c3d72cf86e5 tempest-ResourceLockDeleteTest-1157183439 tempest-ResourceLockDeleteTest-1157183439-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:20 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9e384288-b679-4690-af62-d06df3e67644 tempest-ResourceLockDeleteTest-1157183439 None] >>> [GET] https://127.0.0.1:40443/api/vippools/ May 28 12:59:20 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9e384288-b679-4690-af62-d06df3e67644 tempest-ResourceLockDeleteTest-1157183439 None] {'allow_redirects': True, 'params': {'name': 'vippool-1'}} May 28 12:59:20 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-9a70a51f-cf60-4b42-a212-8c3d72cf86e5 tempest-ResourceLockDeleteTest-1157183439 tempest-ResourceLockDeleteTest-1157183439-project-member] http://10.27.203.238/share/v2/645fb190404541a78e449c703540d6f8/shares/2de4a970-0a05-4094-bdb1-ff3d4f9d20d2 returned with HTTP 200 May 28 12:59:20 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 706/1425] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:59:20 2024] GET /share/v2/645fb190404541a78e449c703540d6f8/shares/2de4a970-0a05-4094-bdb1-ff3d4f9d20d2 => generated 1311 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:59:20 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-ae247579-8094-434c-9c62-1f8255dd408d tempest-PublicSharesNegativeTest-1466961720 tempest-PublicSharesNegativeTest-1466961720-project-admin] GET http://10.27.203.238/share/v2/6e831d9989b1463da882ee355e32629c/shares/eb49a187-afee-4d13-b48a-a957d46fc910 May 28 12:59:20 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-ae247579-8094-434c-9c62-1f8255dd408d tempest-PublicSharesNegativeTest-1466961720 tempest-PublicSharesNegativeTest-1466961720-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:20 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-ae247579-8094-434c-9c62-1f8255dd408d tempest-PublicSharesNegativeTest-1466961720 tempest-PublicSharesNegativeTest-1466961720-project-admin] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:20 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ffb09745-facc-442b-bfa9-f6cb08fba538 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:59:20 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ffb09745-facc-442b-bfa9-f6cb08fba538 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] [Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=1, created='2024-05-28T12:58:43.845440Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='31b6534b-d142-4561-992f-4f0759db302d', id=32, internal=False, is_s3_default_policy=False, name='7fdd602c-79d0-479c-95a2-336b202c6639', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=['*'], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=[], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=[], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T12:59:18.732647Z', tenant_id=1, tenant_name='default', title='7fdd602c-79d0-479c-95a2-336b202c6639', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/32/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[])] May 28 12:59:20 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ffb09745-facc-442b-bfa9-f6cb08fba538 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 12:59:20 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-ffb09745-facc-442b-bfa9-f6cb08fba538 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] changing access on /manila/manila-7fdd602c-79d0-479c-95a2-336b202c6639. Rules: {'nfs_read_write': ['1.2.3.4'], 'nfs_read_only': []} May 28 12:59:20 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ffb09745-facc-442b-bfa9-f6cb08fba538 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] >>> [PATCH] https://127.0.0.1:40443/api/viewpolicies/32/ May 28 12:59:20 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ffb09745-facc-442b-bfa9-f6cb08fba538 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] {'data': '{"name": "7fdd602c-79d0-479c-95a2-336b202c6639", "nfs_no_squash": ' May 28 12:59:20 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ffb09745-facc-442b-bfa9-f6cb08fba538 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] '["*"], "nfs_root_squash": ["*"], "nfs_read_write": ["1.2.3.4"], ' May 28 12:59:20 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ffb09745-facc-442b-bfa9-f6cb08fba538 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] '"nfs_read_only": []}', May 28 12:59:20 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ffb09745-facc-442b-bfa9-f6cb08fba538 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] 'params': None} May 28 12:59:20 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-ae247579-8094-434c-9c62-1f8255dd408d tempest-PublicSharesNegativeTest-1466961720 tempest-PublicSharesNegativeTest-1466961720-project-admin] http://10.27.203.238/share/v2/6e831d9989b1463da882ee355e32629c/shares/eb49a187-afee-4d13-b48a-a957d46fc910 returned with HTTP 200 May 28 12:59:20 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 720/1426] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:59:20 2024] GET /share/v2/6e831d9989b1463da882ee355e32629c/shares/eb49a187-afee-4d13-b48a-a957d46fc910 => generated 1359 bytes in 27 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:59:20 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-3cd3e2f5-1d72-47a0-b3c9-2ccec0e96116 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] POST http://10.27.203.238/share/v1/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action May 28 12:59:20 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-3cd3e2f5-1d72-47a0-b3c9-2ccec0e96116 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Action body: b'{"os-access_list": null}' {{(pid=98330) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:59:20 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-3cd3e2f5-1d72-47a0-b3c9-2ccec0e96116 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Action: 'action', calling method: ShareController.access_list, body: {"os-access_list": null} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:59:20 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-3cd3e2f5-1d72-47a0-b3c9-2ccec0e96116 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] http://10.27.203.238/share/v1/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action returned with HTTP 200 May 28 12:59:20 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 707/1427] 10.27.203.238 () {64 vars in 1450 bytes} [Tue May 28 12:59:20 2024] POST /share/v1/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action => generated 19 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 229 bytes (1 switches on core 0) May 28 12:59:20 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-48a05eeb-50f8-4d65-bfac-8cc326edaaaa tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] POST http://10.27.203.238/share/v2/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action May 28 12:59:20 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-48a05eeb-50f8-4d65-bfac-8cc326edaaaa tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Action body: b'{"allow_access": {"access_type": "ip", "access_to": "2.2.2.2", "access_level": "ro"}}' {{(pid=98329) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:59:20 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-48a05eeb-50f8-4d65-bfac-8cc326edaaaa tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Action: 'action', calling method: ShareController.allow_access, body: {"allow_access": {"access_type": "ip", "access_to": "2.2.2.2", "access_level": "ro"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:59:20 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9e384288-b679-4690-af62-d06df3e67644 tempest-ResourceLockDeleteTest-1157183439 None] <<< [GET] https://127.0.0.1:40443/api/vippools/ May 28 12:59:20 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9e384288-b679-4690-af62-d06df3e67644 tempest-ResourceLockDeleteTest-1157183439 None] [Bunch(active_cnode_ids=[], active_interfaces=4, cluster='loop75-kfs', cluster_id=1, cnode_ids=[], cnodes=[], domain_name='vippool-1', enable_l3=False, enable_weighted_balancing=False, enabled=True, end_ip='172.21.75.4', guid='f2abaede-b397-413a-8faa-3aeead6d3b28', gw_ip='', gw_ipv6='', id=2, ip_ranges=[['172.21.75.1', '172.21.75.4']], name='vippool-1', peer_asn=0, port_membership='ALL', ranges_summary='172.21.75.[1-4]', role='PROTOCOLS', start_ip='172.21.75.1', subnet_cidr=16, subnet_cidr_ipv6=None, sync='SYNCED', sync_time='2024-05-28T12:50:09.644123Z', tenant_id=1, tenant_name='default', title='172.21.75.1 - 172.21.75.4', url='https://127.0.0.1:40443/api/vippools/2/', vast_asn=0, vlan=0, vms_preferred=False)] May 28 12:59:20 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9e384288-b679-4690-af62-d06df3e67644 tempest-ResourceLockDeleteTest-1157183439 None] --- [GET] https://127.0.0.1:40443/api/vippools/: Done May 28 12:59:20 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9e384288-b679-4690-af62-d06df3e67644 tempest-ResourceLockDeleteTest-1157183439 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:59:20 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9e384288-b679-4690-af62-d06df3e67644 tempest-ResourceLockDeleteTest-1157183439 None] {'allow_redirects': True, May 28 12:59:20 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9e384288-b679-4690-af62-d06df3e67644 tempest-ResourceLockDeleteTest-1157183439 None] 'params': {'name': 'b16b1d63-ae6f-4f71-846e-84edd63a87f6'}} May 28 12:59:20 l75lg1-v1 devstack@m-api.service[98329]: DEBUG oslo_concurrency.lockutils [None req-48a05eeb-50f8-4d65-bfac-8cc326edaaaa tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98329) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:20 l75lg1-v1 devstack@m-api.service[98329]: DEBUG oslo_concurrency.lockutils [None req-48a05eeb-50f8-4d65-bfac-8cc326edaaaa tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98329) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:20 l75lg1-v1 devstack@m-api.service[98329]: DEBUG oslo_concurrency.lockutils [None req-48a05eeb-50f8-4d65-bfac-8cc326edaaaa tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.037s {{(pid=98329) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:20 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-48a05eeb-50f8-4d65-bfac-8cc326edaaaa tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] http://10.27.203.238/share/v2/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action returned with HTTP 200 May 28 12:59:20 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 721/1428] 10.27.203.238 () {66 vars in 1493 bytes} [Tue May 28 12:59:20 2024] POST /share/v2/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action => generated 213 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:59:20 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-0d930cae-8eed-4223-8746-0fdc6058dbac tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] POST http://10.27.203.238/share/v2/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action May 28 12:59:20 l75lg1-v1 manila-share[98474]: DEBUG manila.share.manager [None req-48a05eeb-50f8-4d65-bfac-8cc326edaaaa tempest-ShareIpRulesForNFSTest-1748669711 None] Received request to update access for share instance b7a7d61c-2cea-442a-9809-507038e080d5. {{(pid=98474) update_access_for_instances /opt/stack/manila/manila/share/manager.py:4353}} May 28 12:59:20 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-0d930cae-8eed-4223-8746-0fdc6058dbac tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Action body: b'{"access_list": null}' {{(pid=98330) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:59:20 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-0d930cae-8eed-4223-8746-0fdc6058dbac tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Action: 'action', calling method: ShareController.access_list, body: {"access_list": null} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:59:20 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-48a05eeb-50f8-4d65-bfac-8cc326edaaaa tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:20 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-48a05eeb-50f8-4d65-bfac-8cc326edaaaa tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:20 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-48a05eeb-50f8-4d65-bfac-8cc326edaaaa tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:20 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-48a05eeb-50f8-4d65-bfac-8cc326edaaaa tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:20 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-48a05eeb-50f8-4d65-bfac-8cc326edaaaa tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:20 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-0d930cae-8eed-4223-8746-0fdc6058dbac tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] http://10.27.203.238/share/v2/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action returned with HTTP 200 May 28 12:59:20 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 708/1429] 10.27.203.238 () {66 vars in 1493 bytes} [Tue May 28 12:59:20 2024] POST /share/v2/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action => generated 168 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:59:20 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-06672101-d0ab-4d41-a04e-23420ae12224 tempest-PublicSharesNegativeTest-1466961720 None] <<< [DELETE] https://127.0.0.1:40443/api/views/33/ May 28 12:59:20 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-06672101-d0ab-4d41-a04e-23420ae12224 tempest-PublicSharesNegativeTest-1466961720 None] --- [DELETE] https://127.0.0.1:40443/api/views/33/: Done May 28 12:59:20 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-06672101-d0ab-4d41-a04e-23420ae12224 tempest-PublicSharesNegativeTest-1466961720 None] >>> [GET] https://127.0.0.1:40443/api/quotas/ May 28 12:59:20 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-06672101-d0ab-4d41-a04e-23420ae12224 tempest-PublicSharesNegativeTest-1466961720 None] {'allow_redirects': True, May 28 12:59:20 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-06672101-d0ab-4d41-a04e-23420ae12224 tempest-PublicSharesNegativeTest-1466961720 None] 'params': {'name': '67a5173e-4e46-4dc2-8375-e9849d8dde4c'}} May 28 12:59:20 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-48a05eeb-50f8-4d65-bfac-8cc326edaaaa tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.054s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:20 l75lg1-v1 manila-share[98474]: DEBUG manila.share.access [None req-48a05eeb-50f8-4d65-bfac-8cc326edaaaa tempest-ShareIpRulesForNFSTest-1748669711 None] Updating access rules for share instance b7a7d61c-2cea-442a-9809-507038e080d5 belonging to share 1ddadc17-cf10-4a42-8bbd-8335fb3520a1. {{(pid=98474) update_access_rules /opt/stack/manila/manila/share/access.py:298}} May 28 12:59:20 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-48a05eeb-50f8-4d65-bfac-8cc326edaaaa tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:20 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-48a05eeb-50f8-4d65-bfac-8cc326edaaaa tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:20 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-48a05eeb-50f8-4d65-bfac-8cc326edaaaa tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.007s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:20 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-48a05eeb-50f8-4d65-bfac-8cc326edaaaa tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:20 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-48a05eeb-50f8-4d65-bfac-8cc326edaaaa tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:20 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-48a05eeb-50f8-4d65-bfac-8cc326edaaaa tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.014s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:20 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-48a05eeb-50f8-4d65-bfac-8cc326edaaaa tempest-ShareIpRulesForNFSTest-1748669711 None] changing access on None May 28 12:59:20 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-48a05eeb-50f8-4d65-bfac-8cc326edaaaa tempest-ShareIpRulesForNFSTest-1748669711 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:59:20 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-48a05eeb-50f8-4d65-bfac-8cc326edaaaa tempest-ShareIpRulesForNFSTest-1748669711 None] {'allow_redirects': True, May 28 12:59:20 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-48a05eeb-50f8-4d65-bfac-8cc326edaaaa tempest-ShareIpRulesForNFSTest-1748669711 None] 'params': {'name': 'b7a7d61c-2cea-442a-9809-507038e080d5'}} May 28 12:59:21 l75lg1-v1 dstat.sh[49771]: 28-05 12:59:21| 9 0 88 2 0|5739M 1732M 277M 7877M| 18k 6415B| 0 1284k| 0 164 |4446 7150 |1.23 1.07 1.02|1.0 1.0 0| 0 0 | 0 2048M| 29 361 0 32 0 May 28 12:59:21 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-06672101-d0ab-4d41-a04e-23420ae12224 tempest-PublicSharesNegativeTest-1466961720 None] <<< [GET] https://127.0.0.1:40443/api/quotas/ May 28 12:59:21 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-06672101-d0ab-4d41-a04e-23420ae12224 tempest-PublicSharesNegativeTest-1466961720 None] [Bunch(cluster='loop75-kfs', cluster_id=1, default_email=None, default_group_quota=None, default_user_quota=None, enable_alarms=True, enable_email_providers=True, grace_period=None, guid='78437107-ad52-4756-8826-035f1174e6ae', hard_limit=1073741824, hard_limit_inodes=None, id=31, internal=False, is_user_quota=False, last_user_quotas_update=None, name='67a5173e-4e46-4dc2-8375-e9849d8dde4c', num_blocked_users=0, num_exceeded_users=0, path='/manila/manila-67a5173e-4e46-4dc2-8375-e9849d8dde4c', percent_capacity=0, percent_inodes=None, pretty_grace_period=None, pretty_grace_period_expiration=None, pretty_state='OK (CREATED)', soft_limit=None, soft_limit_inodes=None, state='OK', sync_state='CREATED', system_id=31, tenant_id=1, tenant_name='default', time_to_block=None, title='67a5173e-4e46-4dc2-8375-e9849d8dde4c', url='https://127.0.0.1:40443/api/quotas/31/', used_capacity=0, used_capacity_tb=0.0, used_effective_capacity=0, used_effective_capacity_tb=0.0, used_inodes=0, used_limited_capacity=0)] May 28 12:59:21 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-06672101-d0ab-4d41-a04e-23420ae12224 tempest-PublicSharesNegativeTest-1466961720 None] --- [GET] https://127.0.0.1:40443/api/quotas/: Done May 28 12:59:21 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-06672101-d0ab-4d41-a04e-23420ae12224 tempest-PublicSharesNegativeTest-1466961720 None] >>> [DELETE] https://127.0.0.1:40443/api/quotas/31/ May 28 12:59:21 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9e384288-b679-4690-af62-d06df3e67644 tempest-ResourceLockDeleteTest-1157183439 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:59:21 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9e384288-b679-4690-af62-d06df3e67644 tempest-ResourceLockDeleteTest-1157183439 None] [] May 28 12:59:21 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9e384288-b679-4690-af62-d06df3e67644 tempest-ResourceLockDeleteTest-1157183439 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 12:59:21 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9e384288-b679-4690-af62-d06df3e67644 tempest-ResourceLockDeleteTest-1157183439 None] >>> [POST] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:59:21 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9e384288-b679-4690-af62-d06df3e67644 tempest-ResourceLockDeleteTest-1157183439 None] {'data': '{"name": "b16b1d63-ae6f-4f71-846e-84edd63a87f6"}', May 28 12:59:21 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9e384288-b679-4690-af62-d06df3e67644 tempest-ResourceLockDeleteTest-1157183439 None] 'json': None, May 28 12:59:21 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9e384288-b679-4690-af62-d06df3e67644 tempest-ResourceLockDeleteTest-1157183439 None] 'params': None} May 28 12:59:21 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-48a05eeb-50f8-4d65-bfac-8cc326edaaaa tempest-ShareIpRulesForNFSTest-1748669711 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:59:21 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-48a05eeb-50f8-4d65-bfac-8cc326edaaaa tempest-ShareIpRulesForNFSTest-1748669711 None] [Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=1, created='2024-05-28T12:57:40.763635Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='377955ad-d094-4e49-ab32-1021d943a572', id=21, internal=False, is_s3_default_policy=False, name='b7a7d61c-2cea-442a-9809-507038e080d5', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=['*'], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=[], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=[], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T12:59:19.805479Z', tenant_id=1, tenant_name='default', title='b7a7d61c-2cea-442a-9809-507038e080d5', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/21/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[])] May 28 12:59:21 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-48a05eeb-50f8-4d65-bfac-8cc326edaaaa tempest-ShareIpRulesForNFSTest-1748669711 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 12:59:21 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-48a05eeb-50f8-4d65-bfac-8cc326edaaaa tempest-ShareIpRulesForNFSTest-1748669711 None] changing access on /manila/manila-b7a7d61c-2cea-442a-9809-507038e080d5. Rules: {'nfs_read_write': [], 'nfs_read_only': ['2.2.2.2']} May 28 12:59:21 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-48a05eeb-50f8-4d65-bfac-8cc326edaaaa tempest-ShareIpRulesForNFSTest-1748669711 None] >>> [PATCH] https://127.0.0.1:40443/api/viewpolicies/21/ May 28 12:59:21 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-48a05eeb-50f8-4d65-bfac-8cc326edaaaa tempest-ShareIpRulesForNFSTest-1748669711 None] {'data': '{"name": "b7a7d61c-2cea-442a-9809-507038e080d5", "nfs_no_squash": ' May 28 12:59:21 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-48a05eeb-50f8-4d65-bfac-8cc326edaaaa tempest-ShareIpRulesForNFSTest-1748669711 None] '["*"], "nfs_root_squash": ["*"], "nfs_read_write": [], ' May 28 12:59:21 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-48a05eeb-50f8-4d65-bfac-8cc326edaaaa tempest-ShareIpRulesForNFSTest-1748669711 None] '"nfs_read_only": ["2.2.2.2"]}', May 28 12:59:21 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-48a05eeb-50f8-4d65-bfac-8cc326edaaaa tempest-ShareIpRulesForNFSTest-1748669711 None] 'params': None} May 28 12:59:22 l75lg1-v1 neutron-server[77618]: DEBUG dbcounter [-] [77618] Writing DB stats neutron:SELECT=2 {{(pid=77618) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:59:22 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9e384288-b679-4690-af62-d06df3e67644 tempest-ResourceLockDeleteTest-1157183439 None] <<< [POST] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:59:22 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9e384288-b679-4690-af62-d06df3e67644 tempest-ResourceLockDeleteTest-1157183439 None] Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=0, created='2024-05-28T12:59:21.728524Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='0aadea7a-6266-46a2-8223-c9c2564969e3', id=36, internal=False, is_s3_default_policy=False, name='b16b1d63-ae6f-4f71-846e-84edd63a87f6', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=[], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['*'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['*'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T12:59:22.084991Z', tenant_id=1, tenant_name='default', title='b16b1d63-ae6f-4f71-846e-84edd63a87f6', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/36/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[]) May 28 12:59:22 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9e384288-b679-4690-af62-d06df3e67644 tempest-ResourceLockDeleteTest-1157183439 None] --- [POST] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 12:59:22 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9e384288-b679-4690-af62-d06df3e67644 tempest-ResourceLockDeleteTest-1157183439 None] >>> [GET] https://127.0.0.1:40443/api/quotas/ May 28 12:59:22 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9e384288-b679-4690-af62-d06df3e67644 tempest-ResourceLockDeleteTest-1157183439 None] {'allow_redirects': True, May 28 12:59:22 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9e384288-b679-4690-af62-d06df3e67644 tempest-ResourceLockDeleteTest-1157183439 None] 'params': {'name': 'b16b1d63-ae6f-4f71-846e-84edd63a87f6'}} May 28 12:59:22 l75lg1-v1 dstat.sh[49771]: 28-05 12:59:22| 1 1 98 1 0|5739M 1732M 277M 7877M| 15k 3114B| 0 868k| 0 85.0 |2186 3595 |1.13 1.05 1.01|1.0 1.0 0| 0 0 | 0 2048M| 29 361 0 30 0 May 28 12:59:22 l75lg1-v1 neutron-server[77618]: DEBUG dbcounter [-] [77618] Writing DB stats neutron:SELECT=4 {{(pid=77618) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:59:22 l75lg1-v1 neutron-server[77623]: DEBUG dbcounter [-] [77623] Writing DB stats neutron:SELECT=2 {{(pid=77623) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:59:22 l75lg1-v1 neutron-server[77623]: DEBUG dbcounter [-] [77623] Writing DB stats neutron:SELECT=2 {{(pid=77623) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:59:22 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ffb09745-facc-442b-bfa9-f6cb08fba538 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] <<< [PATCH] https://127.0.0.1:40443/api/viewpolicies/32/ May 28 12:59:22 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ffb09745-facc-442b-bfa9-f6cb08fba538 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=1, created='2024-05-28T12:58:43.845440Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='31b6534b-d142-4561-992f-4f0759db302d', id=32, internal=False, is_s3_default_policy=False, name='7fdd602c-79d0-479c-95a2-336b202c6639', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=['*'], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['1.2.3.4'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['1.2.3.4'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='MODIFYING', sync_time='2024-05-28T12:59:21.894966Z', tenant_id=1, tenant_name='default', title='7fdd602c-79d0-479c-95a2-336b202c6639', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/32/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[]) May 28 12:59:22 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ffb09745-facc-442b-bfa9-f6cb08fba538 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] --- [PATCH] https://127.0.0.1:40443/api/viewpolicies/32/: Done May 28 12:59:22 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-ffb09745-facc-442b-bfa9-f6cb08fba538 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:22 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-ffb09745-facc-442b-bfa9-f6cb08fba538 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:22 l75lg1-v1 manila-share[98474]: DEBUG dbcounter [-] [98474] Writing DB stats manila:SELECT=2578,manila:UPDATE=237,manila:INSERT=63 {{(pid=98474) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:59:22 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9e384288-b679-4690-af62-d06df3e67644 tempest-ResourceLockDeleteTest-1157183439 None] <<< [GET] https://127.0.0.1:40443/api/quotas/ May 28 12:59:22 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9e384288-b679-4690-af62-d06df3e67644 tempest-ResourceLockDeleteTest-1157183439 None] [] May 28 12:59:22 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9e384288-b679-4690-af62-d06df3e67644 tempest-ResourceLockDeleteTest-1157183439 None] --- [GET] https://127.0.0.1:40443/api/quotas/: Done May 28 12:59:22 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9e384288-b679-4690-af62-d06df3e67644 tempest-ResourceLockDeleteTest-1157183439 None] >>> [POST] https://127.0.0.1:40443/api/quotas/ May 28 12:59:22 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9e384288-b679-4690-af62-d06df3e67644 tempest-ResourceLockDeleteTest-1157183439 None] {'data': '{"name": "b16b1d63-ae6f-4f71-846e-84edd63a87f6", "path": ' May 28 12:59:22 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9e384288-b679-4690-af62-d06df3e67644 tempest-ResourceLockDeleteTest-1157183439 None] '"/manila/manila-b16b1d63-ae6f-4f71-846e-84edd63a87f6", "create_dir": ' May 28 12:59:22 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9e384288-b679-4690-af62-d06df3e67644 tempest-ResourceLockDeleteTest-1157183439 None] 'true, "hard_limit": 1073741824}', May 28 12:59:22 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9e384288-b679-4690-af62-d06df3e67644 tempest-ResourceLockDeleteTest-1157183439 None] 'json': None, May 28 12:59:22 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9e384288-b679-4690-af62-d06df3e67644 tempest-ResourceLockDeleteTest-1157183439 None] 'params': None} May 28 12:59:22 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-ffb09745-facc-442b-bfa9-f6cb08fba538 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.065s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:22 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-ffb09745-facc-442b-bfa9-f6cb08fba538 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:22 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-ffb09745-facc-442b-bfa9-f6cb08fba538 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:22 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-ffb09745-facc-442b-bfa9-f6cb08fba538 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:22 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-ffb09745-facc-442b-bfa9-f6cb08fba538 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:22 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-ffb09745-facc-442b-bfa9-f6cb08fba538 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:22 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-ffb09745-facc-442b-bfa9-f6cb08fba538 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:22 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-ffb09745-facc-442b-bfa9-f6cb08fba538 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:22 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-ffb09745-facc-442b-bfa9-f6cb08fba538 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:22 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-ffb09745-facc-442b-bfa9-f6cb08fba538 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:22 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-ffb09745-facc-442b-bfa9-f6cb08fba538 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:22 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-ffb09745-facc-442b-bfa9-f6cb08fba538 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:22 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-ffb09745-facc-442b-bfa9-f6cb08fba538 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.036s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:22 l75lg1-v1 manila-share[98474]: INFO manila.share.access [None req-ffb09745-facc-442b-bfa9-f6cb08fba538 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Access rules were successfully modified for share instance 7fdd602c-79d0-479c-95a2-336b202c6639 belonging to share 72db8769-ece7-42ff-af27-2e778292a9b4. May 28 12:59:22 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-8a508892-ea4f-41eb-9a90-3c05c83d8266 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] GET http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/share-access-rules?share_id=72db8769-ece7-42ff-af27-2e778292a9b4 May 28 12:59:22 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-8a508892-ea4f-41eb-9a90-3c05c83d8266 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:22 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-8a508892-ea4f-41eb-9a90-3c05c83d8266 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:22 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.lock.api [None req-8a508892-ea4f-41eb-9a90-3c05c83d8266 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Searching for locks by: {'resource_id': 'edfd3b97-9ec3-4134-9a5f-5ccaa70b6c09', 'resource_action': 'show', 'resource_type': 'access_rule'} {{(pid=98329) get_all /opt/stack/manila/manila/lock/api.py:112}} May 28 12:59:22 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-8a508892-ea4f-41eb-9a90-3c05c83d8266 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/share-access-rules?share_id=72db8769-ece7-42ff-af27-2e778292a9b4 returned with HTTP 200 May 28 12:59:22 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 722/1430] 10.27.203.238 () {64 vars in 1467 bytes} [Tue May 28 12:59:22 2024] GET /share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/share-access-rules?share_id=72db8769-ece7-42ff-af27-2e778292a9b4 => generated 275 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:59:22 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-8a51ae40-6dda-4f00-aa27-1b5b449d87e8 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] POST http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action May 28 12:59:22 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-8a51ae40-6dda-4f00-aa27-1b5b449d87e8 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Action body: b'{"allow_access": {"access_type": "ip", "access_to": "1.2.3.4", "access_level": null}}' {{(pid=98330) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:59:22 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-8a51ae40-6dda-4f00-aa27-1b5b449d87e8 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Action: 'action', calling method: ShareController.allow_access, body: {"allow_access": {"access_type": "ip", "access_to": "1.2.3.4", "access_level": null}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:59:23 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-8a51ae40-6dda-4f00-aa27-1b5b449d87e8 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] HTTP exception thrown: Share access ip:1.2.3.4 exists. May 28 12:59:23 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-8a51ae40-6dda-4f00-aa27-1b5b449d87e8 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action returned with HTTP 400 May 28 12:59:23 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 709/1431] 10.27.203.238 () {66 vars in 1493 bytes} [Tue May 28 12:59:22 2024] POST /share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action => generated 75 bytes in 35 msecs (HTTP/1.1 400) 6 headers in 239 bytes (1 switches on core 0) May 28 12:59:23 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-d0125512-6291-4cb5-9f35-1ec49edb36d6 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] POST http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action May 28 12:59:23 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-d0125512-6291-4cb5-9f35-1ec49edb36d6 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Action body: b'{"deny_access": {"access_id": "edfd3b97-9ec3-4134-9a5f-5ccaa70b6c09"}}' {{(pid=98329) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:59:23 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-d0125512-6291-4cb5-9f35-1ec49edb36d6 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Action: 'action', calling method: ShareController.deny_access, body: {"deny_access": {"access_id": "edfd3b97-9ec3-4134-9a5f-5ccaa70b6c09"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:59:23 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.lock.api [None req-d0125512-6291-4cb5-9f35-1ec49edb36d6 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Searching for locks by: {'resource_id': 'edfd3b97-9ec3-4134-9a5f-5ccaa70b6c09', 'resource_action': 'delete'} {{(pid=98329) get_all /opt/stack/manila/manila/lock/api.py:112}} May 28 12:59:23 l75lg1-v1 devstack@m-api.service[98329]: DEBUG oslo_concurrency.lockutils [None req-d0125512-6291-4cb5-9f35-1ec49edb36d6 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98329) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:23 l75lg1-v1 devstack@m-api.service[98329]: DEBUG oslo_concurrency.lockutils [None req-d0125512-6291-4cb5-9f35-1ec49edb36d6 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98329) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:23 l75lg1-v1 devstack@m-api.service[98329]: DEBUG oslo_concurrency.lockutils [None req-d0125512-6291-4cb5-9f35-1ec49edb36d6 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.040s {{(pid=98329) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:23 l75lg1-v1 devstack@m-api.service[98329]: DEBUG oslo_concurrency.lockutils [None req-d0125512-6291-4cb5-9f35-1ec49edb36d6 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98329) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:23 l75lg1-v1 devstack@m-api.service[98329]: DEBUG oslo_concurrency.lockutils [None req-d0125512-6291-4cb5-9f35-1ec49edb36d6 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98329) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:23 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-5d7c04ec-aec4-4e9c-a895-7aa3a954f881 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] GET http://10.27.203.238/share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/messages May 28 12:59:23 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-5d7c04ec-aec4-4e9c-a895-7aa3a954f881 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:23 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-5d7c04ec-aec4-4e9c-a895-7aa3a954f881 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:23 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.message.api [None req-5d7c04ec-aec4-4e9c-a895-7aa3a954f881 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Searching for messages by: MultiDict([]) {{(pid=98330) get_all /opt/stack/manila/manila/message/api.py:78}} May 28 12:59:23 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-5d7c04ec-aec4-4e9c-a895-7aa3a954f881 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] http://10.27.203.238/share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/messages returned with HTTP 200 May 28 12:59:23 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 710/1432] 10.27.203.238 () {64 vars in 1346 bytes} [Tue May 28 12:59:23 2024] GET /share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/messages => generated 2417 bytes in 12 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:59:23 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-a45e5a98-d436-4a21-a551-32097ee0e20e tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] POST http://10.27.203.238/share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/types May 28 12:59:23 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-a45e5a98-d436-4a21-a551-32097ee0e20e tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share_type": {"name": "tempest-share-type-1306371838", "extra_specs": {"driver_handles_share_servers": false, "vendor_name": "foobar"}, "share_type_access:is_public": true}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:59:23 l75lg1-v1 devstack@m-api.service[98329]: DEBUG oslo_concurrency.lockutils [None req-d0125512-6291-4cb5-9f35-1ec49edb36d6 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.066s {{(pid=98329) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:23 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-d0125512-6291-4cb5-9f35-1ec49edb36d6 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action returned with HTTP 202 May 28 12:59:23 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 723/1433] 10.27.203.238 () {66 vars in 1493 bytes} [Tue May 28 12:59:23 2024] POST /share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action => generated 0 bytes in 182 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:59:23 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-44337c49-a421-424b-ac38-074d8b1a8e02 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] GET http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/share-access-rules?share_id=72db8769-ece7-42ff-af27-2e778292a9b4 May 28 12:59:23 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-44337c49-a421-424b-ac38-074d8b1a8e02 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:23 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-44337c49-a421-424b-ac38-074d8b1a8e02 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:23 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-a45e5a98-d436-4a21-a551-32097ee0e20e tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] http://10.27.203.238/share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/types returned with HTTP 200 May 28 12:59:23 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 711/1434] 10.27.203.238 () {66 vars in 1359 bytes} [Tue May 28 12:59:23 2024] POST /share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/types => generated 661 bytes in 27 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:59:23 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-6f474251-d83a-4d8a-aeac-5e79bf32609d tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] POST http://10.27.203.238/share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/shares May 28 12:59:23 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-6f474251-d83a-4d8a-aeac-5e79bf32609d tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share": {"share_proto": "nfs", "description": "tempest-tempest-created-share-desc-530998684", "snapshot_id": null, "name": "tempest-tempest-created-share-601931517", "size": 1, "metadata": {}, "is_public": false, "share_type": "291790ef-c741-4b2b-ba05-f0ce22d6436c"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:59:23 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.v1.shares [None req-6f474251-d83a-4d8a-aeac-5e79bf32609d tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Create NFS share of 1 GB May 28 12:59:23 l75lg1-v1 manila-share[98474]: DEBUG manila.share.manager [None req-d0125512-6291-4cb5-9f35-1ec49edb36d6 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Received request to update access for share instance 7fdd602c-79d0-479c-95a2-336b202c6639. {{(pid=98474) update_access_for_instances /opt/stack/manila/manila/share/manager.py:4353}} May 28 12:59:23 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.lock.api [None req-44337c49-a421-424b-ac38-074d8b1a8e02 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Searching for locks by: {'resource_id': 'edfd3b97-9ec3-4134-9a5f-5ccaa70b6c09', 'resource_action': 'show', 'resource_type': 'access_rule'} {{(pid=98329) get_all /opt/stack/manila/manila/lock/api.py:112}} May 28 12:59:23 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-44337c49-a421-424b-ac38-074d8b1a8e02 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/share-access-rules?share_id=72db8769-ece7-42ff-af27-2e778292a9b4 returned with HTTP 200 May 28 12:59:23 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 724/1435] 10.27.203.238 () {64 vars in 1467 bytes} [Tue May 28 12:59:23 2024] GET /share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/share-access-rules?share_id=72db8769-ece7-42ff-af27-2e778292a9b4 => generated 283 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 231 bytes (2 switches on core 0) May 28 12:59:23 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-d0125512-6291-4cb5-9f35-1ec49edb36d6 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:23 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-d0125512-6291-4cb5-9f35-1ec49edb36d6 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:23 l75lg1-v1 dstat.sh[49771]: 28-05 12:59:23| 6 1 92 1 0|5739M 1731M 277M 7877M| 15k 1069B| 0 1141k| 0 151 |3753 6280 |1.13 1.05 1.01|4.0 1.0 0| 0 0 | 0 2048M| 29 363 0 30 0 May 28 12:59:23 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-d0125512-6291-4cb5-9f35-1ec49edb36d6 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.004s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:23 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-d0125512-6291-4cb5-9f35-1ec49edb36d6 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:23 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-d0125512-6291-4cb5-9f35-1ec49edb36d6 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:23 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-d0125512-6291-4cb5-9f35-1ec49edb36d6 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.062s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:23 l75lg1-v1 manila-share[98474]: DEBUG manila.share.access [None req-d0125512-6291-4cb5-9f35-1ec49edb36d6 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Updating access rules for share instance 7fdd602c-79d0-479c-95a2-336b202c6639 belonging to share 72db8769-ece7-42ff-af27-2e778292a9b4. {{(pid=98474) update_access_rules /opt/stack/manila/manila/share/access.py:298}} May 28 12:59:23 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-d0125512-6291-4cb5-9f35-1ec49edb36d6 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:23 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-d0125512-6291-4cb5-9f35-1ec49edb36d6 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:23 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.quota [None req-6f474251-d83a-4d8a-aeac-5e79bf32609d tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Created reservations ['c45eaf82-1e33-4cfa-8c93-79e3b54ae28f', '4ed421dd-2aa9-46bc-9aa6-10b046087af1', '46babeca-fbf7-44fe-b79f-a05b9ab756c0', 'c905aadd-d63a-4ec4-ba8a-f5816bf17334'] {{(pid=98330) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 12:59:23 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-d0125512-6291-4cb5-9f35-1ec49edb36d6 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.007s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:23 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-d0125512-6291-4cb5-9f35-1ec49edb36d6 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:23 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-d0125512-6291-4cb5-9f35-1ec49edb36d6 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:23 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-d0125512-6291-4cb5-9f35-1ec49edb36d6 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.015s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:23 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-d0125512-6291-4cb5-9f35-1ec49edb36d6 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] changing access on None May 28 12:59:23 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d0125512-6291-4cb5-9f35-1ec49edb36d6 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:59:23 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d0125512-6291-4cb5-9f35-1ec49edb36d6 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] {'allow_redirects': True, May 28 12:59:23 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d0125512-6291-4cb5-9f35-1ec49edb36d6 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] 'params': {'name': '7fdd602c-79d0-479c-95a2-336b202c6639'}} May 28 12:59:23 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.quota [None req-6f474251-d83a-4d8a-aeac-5e79bf32609d tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Committed reservations ['c45eaf82-1e33-4cfa-8c93-79e3b54ae28f', '4ed421dd-2aa9-46bc-9aa6-10b046087af1', '46babeca-fbf7-44fe-b79f-a05b9ab756c0', 'c905aadd-d63a-4ec4-ba8a-f5816bf17334'] {{(pid=98330) commit /opt/stack/manila/manila/quota.py:1063}} May 28 12:59:23 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.host_manager [None req-6f474251-d83a-4d8a-aeac-5e79bf32609d tempest-UserMessageTest-1084663522 None] Share service is down. (host: l75lg1-v1@generic2). May 28 12:59:23 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.host_manager [None req-6f474251-d83a-4d8a-aeac-5e79bf32609d tempest-UserMessageTest-1084663522 None] Share service is down. (host: l75lg1-v1@generic1). May 28 12:59:23 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-6f474251-d83a-4d8a-aeac-5e79bf32609d tempest-UserMessageTest-1084663522 None] Starting with 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:80}} May 28 12:59:23 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-6f474251-d83a-4d8a-aeac-5e79bf32609d tempest-UserMessageTest-1084663522 None] Filter OnlyHostFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:59:23 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-6f474251-d83a-4d8a-aeac-5e79bf32609d tempest-UserMessageTest-1084663522 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:59:23 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.capacity [None req-6f474251-d83a-4d8a-aeac-5e79bf32609d tempest-UserMessageTest-1084663522 None] Space information for share creation on host l75lg1-v1@vast#vast (requested / avail): 1/2078 {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/capacity.py:83}} May 28 12:59:23 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-6f474251-d83a-4d8a-aeac-5e79bf32609d tempest-UserMessageTest-1084663522 None] Filter CapacityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:59:23 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.utils [None req-6f474251-d83a-4d8a-aeac-5e79bf32609d tempest-UserMessageTest-1084663522 None] Share type extra spec requirement "vendor_name=foobar" does not match reported capability "VAST STORAGE" {{(pid=98327) capabilities_satisfied /opt/stack/manila/manila/scheduler/utils.py:185}} May 28 12:59:23 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.capabilities [None req-6f474251-d83a-4d8a-aeac-5e79bf32609d tempest-UserMessageTest-1084663522 None] host: 'l75lg1-v1@vast#vast', free_capacity_gb: 2078.64910808485, pools: None fails resource_type extra_specs requirements {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/capabilities.py:45}} May 28 12:59:23 l75lg1-v1 manila-scheduler[98327]: INFO manila.scheduler.filters.base [None req-6f474251-d83a-4d8a-aeac-5e79bf32609d tempest-UserMessageTest-1084663522 None] Filter CapabilitiesFilter returned 0 host(s) May 28 12:59:23 l75lg1-v1 manila-scheduler[98327]: ERROR manila.scheduler.manager [None req-6f474251-d83a-4d8a-aeac-5e79bf32609d tempest-UserMessageTest-1084663522 None] Failed to schedule create_share: No valid host was found. Failed to find a weighted host, the last executed filter was CapabilitiesFilter.: manila.exception.NoValidHost: No valid host was found. Failed to find a weighted host, the last executed filter was CapabilitiesFilter. May 28 12:59:23 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-6f474251-d83a-4d8a-aeac-5e79bf32609d tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] http://10.27.203.238/share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/shares returned with HTTP 200 May 28 12:59:23 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 712/1436] 10.27.203.238 () {66 vars in 1362 bytes} [Tue May 28 12:59:23 2024] POST /share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/shares => generated 1371 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 232 bytes (2 switches on core 0) May 28 12:59:23 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-48a05eeb-50f8-4d65-bfac-8cc326edaaaa tempest-ShareIpRulesForNFSTest-1748669711 None] <<< [PATCH] https://127.0.0.1:40443/api/viewpolicies/21/ May 28 12:59:23 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-48a05eeb-50f8-4d65-bfac-8cc326edaaaa tempest-ShareIpRulesForNFSTest-1748669711 None] Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=1, created='2024-05-28T12:57:40.763635Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='377955ad-d094-4e49-ab32-1021d943a572', id=21, internal=False, is_s3_default_policy=False, name='b7a7d61c-2cea-442a-9809-507038e080d5', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=['*'], nfs_posix_acl=False, nfs_read_only=['2.2.2.2'], nfs_read_write=[], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=['2.2.2.2'], read_write=[], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='MODIFYING', sync_time='2024-05-28T12:59:22.867464Z', tenant_id=1, tenant_name='default', title='b7a7d61c-2cea-442a-9809-507038e080d5', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/21/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[]) May 28 12:59:23 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-48a05eeb-50f8-4d65-bfac-8cc326edaaaa tempest-ShareIpRulesForNFSTest-1748669711 None] --- [PATCH] https://127.0.0.1:40443/api/viewpolicies/21/: Done May 28 12:59:23 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-48a05eeb-50f8-4d65-bfac-8cc326edaaaa tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:23 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-48a05eeb-50f8-4d65-bfac-8cc326edaaaa tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:23 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-4b96b8ac-3624-4e0d-abf8-0a0ca78d7665 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] GET http://10.27.203.238/share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/shares/daa12cac-d3f4-4eba-9040-13504d17378c May 28 12:59:23 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-4b96b8ac-3624-4e0d-abf8-0a0ca78d7665 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:23 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-4b96b8ac-3624-4e0d-abf8-0a0ca78d7665 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:23 l75lg1-v1 manila-scheduler[98327]: INFO manila.message.api [None req-6f474251-d83a-4d8a-aeac-5e79bf32609d tempest-UserMessageTest-1084663522 None] Creating message record for request_id = req-6f474251-d83a-4d8a-aeac-5e79bf32609d May 28 12:59:23 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-4b96b8ac-3624-4e0d-abf8-0a0ca78d7665 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] http://10.27.203.238/share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/shares/daa12cac-d3f4-4eba-9040-13504d17378c returned with HTTP 200 May 28 12:59:23 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 725/1437] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:59:23 2024] GET /share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/shares/daa12cac-d3f4-4eba-9040-13504d17378c => generated 1371 bytes in 29 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:59:23 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9e384288-b679-4690-af62-d06df3e67644 tempest-ResourceLockDeleteTest-1157183439 None] <<< [POST] https://127.0.0.1:40443/api/quotas/ May 28 12:59:23 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9e384288-b679-4690-af62-d06df3e67644 tempest-ResourceLockDeleteTest-1157183439 None] Bunch(cluster='loop75-kfs', cluster_id=1, default_email=None, default_group_quota=None, default_user_quota=None, enable_alarms=True, enable_email_providers=True, grace_period=None, group_quotas=[], guid='b5dc601e-2286-4bbf-b81f-427edc9349a7', hard_limit=1073741824, hard_limit_inodes=None, id=33, internal=False, is_user_quota=False, last_user_quotas_update=None, name='b16b1d63-ae6f-4f71-846e-84edd63a87f6', num_blocked_users=0, num_exceeded_users=0, path='/manila/manila-b16b1d63-ae6f-4f71-846e-84edd63a87f6', percent_capacity=0, percent_inodes=None, pretty_grace_period=None, pretty_grace_period_expiration=None, pretty_state='OK (CREATED)', soft_limit=None, soft_limit_inodes=None, state='OK', sync_state='CREATED', system_id=33, tenant_id=1, tenant_name='default', time_to_block=None, title='b16b1d63-ae6f-4f71-846e-84edd63a87f6', url='https://127.0.0.1:40443/api/quotas/33/', used_capacity=0, used_capacity_tb=0.0, used_effective_capacity=0, used_effective_capacity_tb=0.0, used_inodes=0, used_limited_capacity=0, user_quotas=[]) May 28 12:59:23 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9e384288-b679-4690-af62-d06df3e67644 tempest-ResourceLockDeleteTest-1157183439 None] --- [POST] https://127.0.0.1:40443/api/quotas/: Done May 28 12:59:23 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9e384288-b679-4690-af62-d06df3e67644 tempest-ResourceLockDeleteTest-1157183439 None] >>> [GET] https://127.0.0.1:40443/api/views/ May 28 12:59:23 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9e384288-b679-4690-af62-d06df3e67644 tempest-ResourceLockDeleteTest-1157183439 None] {'allow_redirects': True, May 28 12:59:23 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9e384288-b679-4690-af62-d06df3e67644 tempest-ResourceLockDeleteTest-1157183439 None] 'params': {'name': 'b16b1d63-ae6f-4f71-846e-84edd63a87f6'}} May 28 12:59:23 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-48a05eeb-50f8-4d65-bfac-8cc326edaaaa tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.062s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:23 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-48a05eeb-50f8-4d65-bfac-8cc326edaaaa tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:23 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-48a05eeb-50f8-4d65-bfac-8cc326edaaaa tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:23 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-48a05eeb-50f8-4d65-bfac-8cc326edaaaa tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:23 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-48a05eeb-50f8-4d65-bfac-8cc326edaaaa tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:23 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-48a05eeb-50f8-4d65-bfac-8cc326edaaaa tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:23 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-48a05eeb-50f8-4d65-bfac-8cc326edaaaa tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.004s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:23 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-48a05eeb-50f8-4d65-bfac-8cc326edaaaa tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:23 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-48a05eeb-50f8-4d65-bfac-8cc326edaaaa tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:23 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-48a05eeb-50f8-4d65-bfac-8cc326edaaaa tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:23 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-48a05eeb-50f8-4d65-bfac-8cc326edaaaa tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:23 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-48a05eeb-50f8-4d65-bfac-8cc326edaaaa tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:23 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-48a05eeb-50f8-4d65-bfac-8cc326edaaaa tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.036s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:23 l75lg1-v1 manila-share[98474]: INFO manila.share.access [None req-48a05eeb-50f8-4d65-bfac-8cc326edaaaa tempest-ShareIpRulesForNFSTest-1748669711 None] Access rules were successfully modified for share instance b7a7d61c-2cea-442a-9809-507038e080d5 belonging to share 1ddadc17-cf10-4a42-8bbd-8335fb3520a1. May 28 12:59:23 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-7f8dfd72-0547-4be9-a2a0-5d706199e4cb tempest-ResourceLockDeleteTest-1157183439 tempest-ResourceLockDeleteTest-1157183439-project-member] GET http://10.27.203.238/share/v2/645fb190404541a78e449c703540d6f8/shares/2de4a970-0a05-4094-bdb1-ff3d4f9d20d2 May 28 12:59:23 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-7f8dfd72-0547-4be9-a2a0-5d706199e4cb tempest-ResourceLockDeleteTest-1157183439 tempest-ResourceLockDeleteTest-1157183439-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:23 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-7f8dfd72-0547-4be9-a2a0-5d706199e4cb tempest-ResourceLockDeleteTest-1157183439 tempest-ResourceLockDeleteTest-1157183439-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:23 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-7f8dfd72-0547-4be9-a2a0-5d706199e4cb tempest-ResourceLockDeleteTest-1157183439 tempest-ResourceLockDeleteTest-1157183439-project-member] http://10.27.203.238/share/v2/645fb190404541a78e449c703540d6f8/shares/2de4a970-0a05-4094-bdb1-ff3d4f9d20d2 returned with HTTP 200 May 28 12:59:23 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 713/1438] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:59:23 2024] GET /share/v2/645fb190404541a78e449c703540d6f8/shares/2de4a970-0a05-4094-bdb1-ff3d4f9d20d2 => generated 1313 bytes in 27 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:59:23 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-5a8ee6f8-00dc-4c25-a96b-f202a9c945c1 tempest-PublicSharesNegativeTest-1466961720 tempest-PublicSharesNegativeTest-1466961720-project-admin] GET http://10.27.203.238/share/v2/6e831d9989b1463da882ee355e32629c/shares/eb49a187-afee-4d13-b48a-a957d46fc910 May 28 12:59:23 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-5a8ee6f8-00dc-4c25-a96b-f202a9c945c1 tempest-PublicSharesNegativeTest-1466961720 tempest-PublicSharesNegativeTest-1466961720-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:23 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-5a8ee6f8-00dc-4c25-a96b-f202a9c945c1 tempest-PublicSharesNegativeTest-1466961720 tempest-PublicSharesNegativeTest-1466961720-project-admin] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:23 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-5a8ee6f8-00dc-4c25-a96b-f202a9c945c1 tempest-PublicSharesNegativeTest-1466961720 tempest-PublicSharesNegativeTest-1466961720-project-admin] http://10.27.203.238/share/v2/6e831d9989b1463da882ee355e32629c/shares/eb49a187-afee-4d13-b48a-a957d46fc910 returned with HTTP 200 May 28 12:59:23 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 726/1439] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:59:23 2024] GET /share/v2/6e831d9989b1463da882ee355e32629c/shares/eb49a187-afee-4d13-b48a-a957d46fc910 => generated 1359 bytes in 24 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:59:23 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d0125512-6291-4cb5-9f35-1ec49edb36d6 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:59:23 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d0125512-6291-4cb5-9f35-1ec49edb36d6 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] [Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=1, created='2024-05-28T12:58:43.845440Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='31b6534b-d142-4561-992f-4f0759db302d', id=32, internal=False, is_s3_default_policy=False, name='7fdd602c-79d0-479c-95a2-336b202c6639', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=['*'], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['1.2.3.4'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['1.2.3.4'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T12:59:22.331353Z', tenant_id=1, tenant_name='default', title='7fdd602c-79d0-479c-95a2-336b202c6639', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/32/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[])] May 28 12:59:23 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d0125512-6291-4cb5-9f35-1ec49edb36d6 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 12:59:23 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-d0125512-6291-4cb5-9f35-1ec49edb36d6 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] changing access on /manila/manila-7fdd602c-79d0-479c-95a2-336b202c6639. Rules: {'nfs_read_write': [], 'nfs_read_only': []} May 28 12:59:23 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d0125512-6291-4cb5-9f35-1ec49edb36d6 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] >>> [PATCH] https://127.0.0.1:40443/api/viewpolicies/32/ May 28 12:59:23 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d0125512-6291-4cb5-9f35-1ec49edb36d6 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] {'data': '{"name": "7fdd602c-79d0-479c-95a2-336b202c6639", "nfs_no_squash": ' May 28 12:59:23 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d0125512-6291-4cb5-9f35-1ec49edb36d6 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] '["*"], "nfs_root_squash": ["*"], "nfs_read_write": [], ' May 28 12:59:23 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d0125512-6291-4cb5-9f35-1ec49edb36d6 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] '"nfs_read_only": []}', May 28 12:59:23 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d0125512-6291-4cb5-9f35-1ec49edb36d6 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] 'params': None} May 28 12:59:23 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9e384288-b679-4690-af62-d06df3e67644 tempest-ResourceLockDeleteTest-1157183439 None] <<< [GET] https://127.0.0.1:40443/api/views/ May 28 12:59:23 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9e384288-b679-4690-af62-d06df3e67644 tempest-ResourceLockDeleteTest-1157183439 None] [] May 28 12:59:23 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9e384288-b679-4690-af62-d06df3e67644 tempest-ResourceLockDeleteTest-1157183439 None] --- [GET] https://127.0.0.1:40443/api/views/: Done May 28 12:59:23 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9e384288-b679-4690-af62-d06df3e67644 tempest-ResourceLockDeleteTest-1157183439 None] >>> [POST] https://127.0.0.1:40443/api/views/ May 28 12:59:23 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9e384288-b679-4690-af62-d06df3e67644 tempest-ResourceLockDeleteTest-1157183439 None] {'data': '{"name": "b16b1d63-ae6f-4f71-846e-84edd63a87f6", "path": ' May 28 12:59:23 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9e384288-b679-4690-af62-d06df3e67644 tempest-ResourceLockDeleteTest-1157183439 None] '"/manila/manila-b16b1d63-ae6f-4f71-846e-84edd63a87f6", "policy_id": ' May 28 12:59:23 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9e384288-b679-4690-af62-d06df3e67644 tempest-ResourceLockDeleteTest-1157183439 None] '36, "create_dir": true, "protocols": ["NFS"]}', May 28 12:59:23 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9e384288-b679-4690-af62-d06df3e67644 tempest-ResourceLockDeleteTest-1157183439 None] 'json': None, May 28 12:59:23 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9e384288-b679-4690-af62-d06df3e67644 tempest-ResourceLockDeleteTest-1157183439 None] 'params': None} May 28 12:59:23 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-05d83472-9764-4bdd-afe4-94238f1627c5 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] POST http://10.27.203.238/share/v2/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action May 28 12:59:23 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-05d83472-9764-4bdd-afe4-94238f1627c5 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Action body: b'{"access_list": null}' {{(pid=98330) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:59:23 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-05d83472-9764-4bdd-afe4-94238f1627c5 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Action: 'action', calling method: ShareController.access_list, body: {"access_list": null} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:59:23 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-05d83472-9764-4bdd-afe4-94238f1627c5 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] http://10.27.203.238/share/v2/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action returned with HTTP 200 May 28 12:59:23 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 714/1440] 10.27.203.238 () {66 vars in 1493 bytes} [Tue May 28 12:59:23 2024] POST /share/v2/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action => generated 171 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:59:23 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-d2ed8e23-09ed-42b0-8844-6ed62e3cda1f tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] POST http://10.27.203.238/share/v2/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action May 28 12:59:23 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-d2ed8e23-09ed-42b0-8844-6ed62e3cda1f tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Action body: b'{"deny_access": {"access_id": "63901b85-2286-42d7-8c17-cc917fd7cd5a"}}' {{(pid=98329) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:59:23 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-d2ed8e23-09ed-42b0-8844-6ed62e3cda1f tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Action: 'action', calling method: ShareController.deny_access, body: {"deny_access": {"access_id": "63901b85-2286-42d7-8c17-cc917fd7cd5a"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:59:23 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.lock.api [None req-d2ed8e23-09ed-42b0-8844-6ed62e3cda1f tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Searching for locks by: {'resource_id': '63901b85-2286-42d7-8c17-cc917fd7cd5a', 'resource_action': 'delete'} {{(pid=98329) get_all /opt/stack/manila/manila/lock/api.py:112}} May 28 12:59:24 l75lg1-v1 devstack@m-api.service[98329]: DEBUG oslo_concurrency.lockutils [None req-d2ed8e23-09ed-42b0-8844-6ed62e3cda1f tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98329) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:24 l75lg1-v1 devstack@m-api.service[98329]: DEBUG oslo_concurrency.lockutils [None req-d2ed8e23-09ed-42b0-8844-6ed62e3cda1f tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98329) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:24 l75lg1-v1 devstack@m-api.service[98329]: DEBUG oslo_concurrency.lockutils [None req-d2ed8e23-09ed-42b0-8844-6ed62e3cda1f tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.043s {{(pid=98329) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:24 l75lg1-v1 devstack@m-api.service[98329]: DEBUG oslo_concurrency.lockutils [None req-d2ed8e23-09ed-42b0-8844-6ed62e3cda1f tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98329) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:24 l75lg1-v1 devstack@m-api.service[98329]: DEBUG oslo_concurrency.lockutils [None req-d2ed8e23-09ed-42b0-8844-6ed62e3cda1f tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98329) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:24 l75lg1-v1 devstack@m-api.service[98329]: DEBUG oslo_concurrency.lockutils [None req-d2ed8e23-09ed-42b0-8844-6ed62e3cda1f tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.058s {{(pid=98329) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:24 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-d2ed8e23-09ed-42b0-8844-6ed62e3cda1f tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] http://10.27.203.238/share/v2/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action returned with HTTP 202 May 28 12:59:24 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 727/1441] 10.27.203.238 () {66 vars in 1493 bytes} [Tue May 28 12:59:23 2024] POST /share/v2/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action => generated 0 bytes in 186 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:59:24 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-582b9b91-928c-41d0-8d6e-3ee234bdcbd0 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] GET http://10.27.203.238/share/v2/776f75906bc64f8f9316d5aab4b50bf1/share-access-rules?share_id=1ddadc17-cf10-4a42-8bbd-8335fb3520a1 May 28 12:59:24 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-582b9b91-928c-41d0-8d6e-3ee234bdcbd0 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:24 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-582b9b91-928c-41d0-8d6e-3ee234bdcbd0 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "_check_child_processes" by "neutron.agent.linux.external_process.ProcessMonitor._check_child_processes" {{(pid=76818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_concurrency.lockutils [-] Lock "_check_child_processes" acquired by "neutron.agent.linux.external_process.ProcessMonitor._check_child_processes" :: waited 0.000s {{(pid=76818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_concurrency.lockutils [-] Lock "_check_child_processes" "released" by "neutron.agent.linux.external_process.ProcessMonitor._check_child_processes" :: held 0.001s {{(pid=76818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:24 l75lg1-v1 manila-share[98474]: DEBUG manila.share.manager [None req-d2ed8e23-09ed-42b0-8844-6ed62e3cda1f tempest-ShareIpRulesForNFSTest-1748669711 None] Received request to update access for share instance b7a7d61c-2cea-442a-9809-507038e080d5. {{(pid=98474) update_access_for_instances /opt/stack/manila/manila/share/manager.py:4353}} May 28 12:59:24 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.lock.api [None req-582b9b91-928c-41d0-8d6e-3ee234bdcbd0 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Searching for locks by: {'resource_id': '63901b85-2286-42d7-8c17-cc917fd7cd5a', 'resource_action': 'show', 'resource_type': 'access_rule'} {{(pid=98330) get_all /opt/stack/manila/manila/lock/api.py:112}} May 28 12:59:24 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-d2ed8e23-09ed-42b0-8844-6ed62e3cda1f tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:24 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-d2ed8e23-09ed-42b0-8844-6ed62e3cda1f tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:24 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-582b9b91-928c-41d0-8d6e-3ee234bdcbd0 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] http://10.27.203.238/share/v2/776f75906bc64f8f9316d5aab4b50bf1/share-access-rules?share_id=1ddadc17-cf10-4a42-8bbd-8335fb3520a1 returned with HTTP 200 May 28 12:59:24 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 715/1442] 10.27.203.238 () {64 vars in 1467 bytes} [Tue May 28 12:59:24 2024] GET /share/v2/776f75906bc64f8f9316d5aab4b50bf1/share-access-rules?share_id=1ddadc17-cf10-4a42-8bbd-8335fb3520a1 => generated 283 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:59:24 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-d2ed8e23-09ed-42b0-8844-6ed62e3cda1f tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.004s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:24 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-d2ed8e23-09ed-42b0-8844-6ed62e3cda1f tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:24 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-d2ed8e23-09ed-42b0-8844-6ed62e3cda1f tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:24 l75lg1-v1 dstat.sh[49771]: 28-05 12:59:24| 9 1 87 3 0|5739M 1731M 277M 7877M| 23k 3298B| 0 2359k| 0 280 |5348 8944 |1.13 1.05 1.01|1.0 2.0 0| 0 0 | 0 2048M| 29 361 0 30 0 May 28 12:59:24 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-d2ed8e23-09ed-42b0-8844-6ed62e3cda1f tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.064s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:24 l75lg1-v1 manila-share[98474]: DEBUG manila.share.access [None req-d2ed8e23-09ed-42b0-8844-6ed62e3cda1f tempest-ShareIpRulesForNFSTest-1748669711 None] Updating access rules for share instance b7a7d61c-2cea-442a-9809-507038e080d5 belonging to share 1ddadc17-cf10-4a42-8bbd-8335fb3520a1. {{(pid=98474) update_access_rules /opt/stack/manila/manila/share/access.py:298}} May 28 12:59:24 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-d2ed8e23-09ed-42b0-8844-6ed62e3cda1f tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:24 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-d2ed8e23-09ed-42b0-8844-6ed62e3cda1f tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:24 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-d2ed8e23-09ed-42b0-8844-6ed62e3cda1f tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.007s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:24 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-d2ed8e23-09ed-42b0-8844-6ed62e3cda1f tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:24 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-d2ed8e23-09ed-42b0-8844-6ed62e3cda1f tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:24 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-d2ed8e23-09ed-42b0-8844-6ed62e3cda1f tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.014s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:24 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-d2ed8e23-09ed-42b0-8844-6ed62e3cda1f tempest-ShareIpRulesForNFSTest-1748669711 None] changing access on None May 28 12:59:24 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d2ed8e23-09ed-42b0-8844-6ed62e3cda1f tempest-ShareIpRulesForNFSTest-1748669711 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:59:24 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d2ed8e23-09ed-42b0-8844-6ed62e3cda1f tempest-ShareIpRulesForNFSTest-1748669711 None] {'allow_redirects': True, May 28 12:59:24 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d2ed8e23-09ed-42b0-8844-6ed62e3cda1f tempest-ShareIpRulesForNFSTest-1748669711 None] 'params': {'name': 'b7a7d61c-2cea-442a-9809-507038e080d5'}} May 28 12:59:24 l75lg1-v1 neutron-server[77623]: DEBUG neutron.db.agents_db [None req-fe40ce8c-640e-4db7-a17a-6e8888cce266 None None] Agent healthcheck: found 0 active agents {{(pid=77623) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:319}} May 28 12:59:24 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-06672101-d0ab-4d41-a04e-23420ae12224 tempest-PublicSharesNegativeTest-1466961720 None] <<< [DELETE] https://127.0.0.1:40443/api/quotas/31/ May 28 12:59:24 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-06672101-d0ab-4d41-a04e-23420ae12224 tempest-PublicSharesNegativeTest-1466961720 None] --- [DELETE] https://127.0.0.1:40443/api/quotas/31/: Done May 28 12:59:24 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-06672101-d0ab-4d41-a04e-23420ae12224 tempest-PublicSharesNegativeTest-1466961720 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:59:24 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-06672101-d0ab-4d41-a04e-23420ae12224 tempest-PublicSharesNegativeTest-1466961720 None] {'allow_redirects': True, May 28 12:59:24 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-06672101-d0ab-4d41-a04e-23420ae12224 tempest-PublicSharesNegativeTest-1466961720 None] 'params': {'name': '67a5173e-4e46-4dc2-8375-e9849d8dde4c'}} May 28 12:59:24 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9e384288-b679-4690-af62-d06df3e67644 tempest-ResourceLockDeleteTest-1157183439 None] <<< [POST] https://127.0.0.1:40443/api/views/ May 28 12:59:24 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9e384288-b679-4690-af62-d06df3e67644 tempest-ResourceLockDeleteTest-1157183439 None] Bunch(abac_tags=[], abe_max_depth=None, abe_protocols=[], alias='', allow_anonymous_access=False, allow_s3_anonymous_access=False, auto_commit='0d', bucket='', bucket_creators=[], bucket_creators_groups=[], bucket_owner=None, bulk_permission_update_progress=None, bulk_permission_update_state=None, cluster='loop75-kfs', cluster_id=1, created='2024-05-28T12:59:24.330288Z', enabled=True, files_retention_mode='NONE', guid='7d63b484-93ba-4757-8928-93aaf1d20d4a', id=35, ignore_oos=False, internal=False, is_remote=False, is_seamless=False, logical_capacity=0, max_retention_period=None, min_retention_period=None, name='b16b1d63-ae6f-4f71-846e-84edd63a87f6', nfs_interop_flags='BOTH_NFS3_AND_NFS4_INTEROP_DISABLED', path='/manila/manila-b16b1d63-ae6f-4f71-846e-84edd63a87f6', physical_capacity=0, policy='b16b1d63-ae6f-4f71-846e-84edd63a87f6', policy_id=36, protocols=['NFS'], qos_policy=None, qos_policy_id=None, s3_locks=False, s3_locks_retention_mode='NONE', s3_locks_retention_period='', s3_object_ownership_rule='ObjectWriter', s3_unverified_lookup=False, s3_versioning=False, select_for_live_monitoring=False, share='', share_acl=Bunch(acl=[], enabled=False), sync='SYNCED', sync_time='2024-05-28T12:59:24.651160Z', tenant_id=1, tenant_name='default', title='/manila/manila-b16b1d63-ae6f-4f71-846e-84edd63a87f6', url='https://127.0.0.1:40443/api/views/35/') May 28 12:59:24 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9e384288-b679-4690-af62-d06df3e67644 tempest-ResourceLockDeleteTest-1157183439 None] --- [POST] https://127.0.0.1:40443/api/views/: Done May 28 12:59:24 l75lg1-v1 manila-share[98474]: INFO manila.share.manager [None req-9e384288-b679-4690-af62-d06df3e67644 tempest-ResourceLockDeleteTest-1157183439 None] Share instance b16b1d63-ae6f-4f71-846e-84edd63a87f6 created successfully. May 28 12:59:25 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d2ed8e23-09ed-42b0-8844-6ed62e3cda1f tempest-ShareIpRulesForNFSTest-1748669711 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:59:25 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d2ed8e23-09ed-42b0-8844-6ed62e3cda1f tempest-ShareIpRulesForNFSTest-1748669711 None] [Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=1, created='2024-05-28T12:57:40.763635Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='377955ad-d094-4e49-ab32-1021d943a572', id=21, internal=False, is_s3_default_policy=False, name='b7a7d61c-2cea-442a-9809-507038e080d5', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=['*'], nfs_posix_acl=False, nfs_read_only=['2.2.2.2'], nfs_read_write=[], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=['2.2.2.2'], read_write=[], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T12:59:23.322250Z', tenant_id=1, tenant_name='default', title='b7a7d61c-2cea-442a-9809-507038e080d5', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/21/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[])] May 28 12:59:25 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d2ed8e23-09ed-42b0-8844-6ed62e3cda1f tempest-ShareIpRulesForNFSTest-1748669711 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 12:59:25 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-d2ed8e23-09ed-42b0-8844-6ed62e3cda1f tempest-ShareIpRulesForNFSTest-1748669711 None] changing access on /manila/manila-b7a7d61c-2cea-442a-9809-507038e080d5. Rules: {'nfs_read_write': [], 'nfs_read_only': []} May 28 12:59:25 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d2ed8e23-09ed-42b0-8844-6ed62e3cda1f tempest-ShareIpRulesForNFSTest-1748669711 None] >>> [PATCH] https://127.0.0.1:40443/api/viewpolicies/21/ May 28 12:59:25 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d2ed8e23-09ed-42b0-8844-6ed62e3cda1f tempest-ShareIpRulesForNFSTest-1748669711 None] {'data': '{"name": "b7a7d61c-2cea-442a-9809-507038e080d5", "nfs_no_squash": ' May 28 12:59:25 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d2ed8e23-09ed-42b0-8844-6ed62e3cda1f tempest-ShareIpRulesForNFSTest-1748669711 None] '["*"], "nfs_root_squash": ["*"], "nfs_read_write": [], ' May 28 12:59:25 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d2ed8e23-09ed-42b0-8844-6ed62e3cda1f tempest-ShareIpRulesForNFSTest-1748669711 None] '"nfs_read_only": []}', May 28 12:59:25 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d2ed8e23-09ed-42b0-8844-6ed62e3cda1f tempest-ShareIpRulesForNFSTest-1748669711 None] 'params': None} May 28 12:59:25 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-06672101-d0ab-4d41-a04e-23420ae12224 tempest-PublicSharesNegativeTest-1466961720 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:59:25 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-06672101-d0ab-4d41-a04e-23420ae12224 tempest-PublicSharesNegativeTest-1466961720 None] [Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=0, created='2024-05-28T12:59:11.849624Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='9a916e19-319b-44cb-a4a3-50f5fde37569', id=34, internal=False, is_s3_default_policy=False, name='67a5173e-4e46-4dc2-8375-e9849d8dde4c', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=[], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['*'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['*'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T12:59:12.177274Z', tenant_id=1, tenant_name='default', title='67a5173e-4e46-4dc2-8375-e9849d8dde4c', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/34/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[])] May 28 12:59:25 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-06672101-d0ab-4d41-a04e-23420ae12224 tempest-PublicSharesNegativeTest-1466961720 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 12:59:25 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-06672101-d0ab-4d41-a04e-23420ae12224 tempest-PublicSharesNegativeTest-1466961720 None] >>> [DELETE] https://127.0.0.1:40443/api/viewpolicies/34/ May 28 12:59:25 l75lg1-v1 dstat.sh[49771]: 28-05 12:59:25| 3 0 96 1 0|5739M 1731M 277M 7877M| 18k 3116B| 0 1232k| 0 107 |2574 4048 |1.13 1.05 1.01|2.0 1.0 0| 0 0 | 0 2048M| 29 361 0 30 0 May 28 12:59:25 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_service.periodic_task [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85846) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:59:25 l75lg1-v1 cinder-volume[85846]: DEBUG cinder.volume.drivers.lvm [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] Updating volume stats {{(pid=85846) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}} May 28 12:59:25 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:390}} May 28 12:59:25 l75lg1-v1 sudo[98945]: vastdata : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 May 28 12:59:25 l75lg1-v1 sudo[98945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) May 28 12:59:25 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d0125512-6291-4cb5-9f35-1ec49edb36d6 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] <<< [PATCH] https://127.0.0.1:40443/api/viewpolicies/32/ May 28 12:59:25 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d0125512-6291-4cb5-9f35-1ec49edb36d6 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=1, created='2024-05-28T12:58:43.845440Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='31b6534b-d142-4561-992f-4f0759db302d', id=32, internal=False, is_s3_default_policy=False, name='7fdd602c-79d0-479c-95a2-336b202c6639', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=['*'], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=[], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=[], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='MODIFYING', sync_time='2024-05-28T12:59:25.290274Z', tenant_id=1, tenant_name='default', title='7fdd602c-79d0-479c-95a2-336b202c6639', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/32/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[]) May 28 12:59:25 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d0125512-6291-4cb5-9f35-1ec49edb36d6 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] --- [PATCH] https://127.0.0.1:40443/api/viewpolicies/32/: Done May 28 12:59:25 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-d0125512-6291-4cb5-9f35-1ec49edb36d6 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:25 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-d0125512-6291-4cb5-9f35-1ec49edb36d6 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:25 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-d0125512-6291-4cb5-9f35-1ec49edb36d6 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.029s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:25 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-d0125512-6291-4cb5-9f35-1ec49edb36d6 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:25 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-d0125512-6291-4cb5-9f35-1ec49edb36d6 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:25 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-d0125512-6291-4cb5-9f35-1ec49edb36d6 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.033s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:25 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-d0125512-6291-4cb5-9f35-1ec49edb36d6 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:25 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-d0125512-6291-4cb5-9f35-1ec49edb36d6 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:25 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-d0125512-6291-4cb5-9f35-1ec49edb36d6 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:25 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-d0125512-6291-4cb5-9f35-1ec49edb36d6 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:25 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-d0125512-6291-4cb5-9f35-1ec49edb36d6 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:25 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-d0125512-6291-4cb5-9f35-1ec49edb36d6 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:25 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-d0125512-6291-4cb5-9f35-1ec49edb36d6 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:25 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-d0125512-6291-4cb5-9f35-1ec49edb36d6 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:25 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-d0125512-6291-4cb5-9f35-1ec49edb36d6 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.041s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:25 l75lg1-v1 manila-share[98474]: INFO manila.share.access [None req-d0125512-6291-4cb5-9f35-1ec49edb36d6 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Access rules were successfully modified for share instance 7fdd602c-79d0-479c-95a2-336b202c6639 belonging to share 72db8769-ece7-42ff-af27-2e778292a9b4. May 28 12:59:26 l75lg1-v1 sudo[98945]: pam_unix(sudo:session): session closed for user root May 28 12:59:26 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.476s {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:428}} May 28 12:59:26 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:390}} May 28 12:59:26 l75lg1-v1 sudo[98992]: vastdata : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 May 28 12:59:26 l75lg1-v1 sudo[98992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) May 28 12:59:26 l75lg1-v1 dstat.sh[49771]: 28-05 12:59:26| 7 1 86 4 0|5771M 1700M 277M 7879M| 14k 66B| 256k 5823k|2.00 457 |3957 6640 |1.13 1.05 1.01|3.0 1.0 49| 0 0 | 0 2048M| 29 361 0 30 0 May 28 12:59:26 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-c99f48ba-cd14-4a11-9ab2-b6b497759808 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] GET http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/share-access-rules?share_id=72db8769-ece7-42ff-af27-2e778292a9b4 May 28 12:59:26 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-c99f48ba-cd14-4a11-9ab2-b6b497759808 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:26 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-c99f48ba-cd14-4a11-9ab2-b6b497759808 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:26 l75lg1-v1 devstack@m-api.service[98329]: DEBUG dbcounter [-] [98329] Writing DB stats manila:SELECT=1902,manila:UPDATE=111,manila:INSERT=120 {{(pid=98329) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:59:26 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-c99f48ba-cd14-4a11-9ab2-b6b497759808 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/share-access-rules?share_id=72db8769-ece7-42ff-af27-2e778292a9b4 returned with HTTP 200 May 28 12:59:26 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 728/1443] 10.27.203.238 () {64 vars in 1467 bytes} [Tue May 28 12:59:26 2024] GET /share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/share-access-rules?share_id=72db8769-ece7-42ff-af27-2e778292a9b4 => generated 19 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:59:26 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-e26a579e-a015-40c0-84da-e6b3d957b387 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] POST http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action May 28 12:59:26 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-e26a579e-a015-40c0-84da-e6b3d957b387 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Action body: b'{"allow_access": {"access_type": "ip", "access_to": "10.20.30.40", "access_level": "rw"}}' {{(pid=98330) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:59:26 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-e26a579e-a015-40c0-84da-e6b3d957b387 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Action: 'action', calling method: ShareController.allow_access, body: {"allow_access": {"access_type": "ip", "access_to": "10.20.30.40", "access_level": "rw"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:59:26 l75lg1-v1 devstack@m-api.service[98330]: DEBUG dbcounter [-] [98330] Writing DB stats manila:SELECT=1795,manila:UPDATE=155,manila:INSERT=97 {{(pid=98330) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:59:26 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-e26a579e-a015-40c0-84da-e6b3d957b387 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:26 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-e26a579e-a015-40c0-84da-e6b3d957b387 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:26 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-e26a579e-a015-40c0-84da-e6b3d957b387 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.046s {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:26 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-e26a579e-a015-40c0-84da-e6b3d957b387 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action returned with HTTP 200 May 28 12:59:26 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 716/1444] 10.27.203.238 () {66 vars in 1493 bytes} [Tue May 28 12:59:26 2024] POST /share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action => generated 309 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:59:26 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-d5ed7da0-3ed1-4ec5-b444-58705b09d678 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] GET http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/share-access-rules?share_id=72db8769-ece7-42ff-af27-2e778292a9b4 May 28 12:59:26 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-d5ed7da0-3ed1-4ec5-b444-58705b09d678 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:26 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-d5ed7da0-3ed1-4ec5-b444-58705b09d678 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:26 l75lg1-v1 manila-share[98474]: DEBUG manila.share.manager [None req-e26a579e-a015-40c0-84da-e6b3d957b387 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Received request to update access for share instance 7fdd602c-79d0-479c-95a2-336b202c6639. {{(pid=98474) update_access_for_instances /opt/stack/manila/manila/share/manager.py:4353}} May 28 12:59:26 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.lock.api [None req-d5ed7da0-3ed1-4ec5-b444-58705b09d678 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Searching for locks by: {'resource_id': '610f3149-4f86-4f0d-ab7f-d42026c6f34d', 'resource_action': 'show', 'resource_type': 'access_rule'} {{(pid=98329) get_all /opt/stack/manila/manila/lock/api.py:112}} May 28 12:59:26 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-e26a579e-a015-40c0-84da-e6b3d957b387 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:26 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-e26a579e-a015-40c0-84da-e6b3d957b387 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:26 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-e26a579e-a015-40c0-84da-e6b3d957b387 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:26 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-e26a579e-a015-40c0-84da-e6b3d957b387 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:26 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-e26a579e-a015-40c0-84da-e6b3d957b387 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:26 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-d5ed7da0-3ed1-4ec5-b444-58705b09d678 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/share-access-rules?share_id=72db8769-ece7-42ff-af27-2e778292a9b4 returned with HTTP 200 May 28 12:59:26 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 729/1445] 10.27.203.238 () {64 vars in 1467 bytes} [Tue May 28 12:59:26 2024] GET /share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/share-access-rules?share_id=72db8769-ece7-42ff-af27-2e778292a9b4 => generated 264 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:59:26 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-2bff0c02-bb25-44e3-8cd2-9ae0724c3b64 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] GET http://10.27.203.238/share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/shares/daa12cac-d3f4-4eba-9040-13504d17378c May 28 12:59:26 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-2bff0c02-bb25-44e3-8cd2-9ae0724c3b64 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:26 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-2bff0c02-bb25-44e3-8cd2-9ae0724c3b64 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:26 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-e26a579e-a015-40c0-84da-e6b3d957b387 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.051s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:26 l75lg1-v1 manila-share[98474]: DEBUG manila.share.access [None req-e26a579e-a015-40c0-84da-e6b3d957b387 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Updating access rules for share instance 7fdd602c-79d0-479c-95a2-336b202c6639 belonging to share 72db8769-ece7-42ff-af27-2e778292a9b4. {{(pid=98474) update_access_rules /opt/stack/manila/manila/share/access.py:298}} May 28 12:59:26 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-2bff0c02-bb25-44e3-8cd2-9ae0724c3b64 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] http://10.27.203.238/share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/shares/daa12cac-d3f4-4eba-9040-13504d17378c returned with HTTP 200 May 28 12:59:26 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 717/1446] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:59:26 2024] GET /share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/shares/daa12cac-d3f4-4eba-9040-13504d17378c => generated 1368 bytes in 29 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:59:26 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-e26a579e-a015-40c0-84da-e6b3d957b387 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:26 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-e26a579e-a015-40c0-84da-e6b3d957b387 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:26 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-e26a579e-a015-40c0-84da-e6b3d957b387 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.007s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:26 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-e26a579e-a015-40c0-84da-e6b3d957b387 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:26 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-e26a579e-a015-40c0-84da-e6b3d957b387 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:26 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-e26a579e-a015-40c0-84da-e6b3d957b387 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.017s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:26 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-e26a579e-a015-40c0-84da-e6b3d957b387 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] changing access on None May 28 12:59:26 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e26a579e-a015-40c0-84da-e6b3d957b387 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:59:26 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e26a579e-a015-40c0-84da-e6b3d957b387 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] {'allow_redirects': True, May 28 12:59:26 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e26a579e-a015-40c0-84da-e6b3d957b387 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] 'params': {'name': '7fdd602c-79d0-479c-95a2-336b202c6639'}} May 28 12:59:26 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-7468943e-2ba5-47eb-8b30-f2058aaf38bd tempest-ResourceLockDeleteTest-1157183439 tempest-ResourceLockDeleteTest-1157183439-project-member] GET http://10.27.203.238/share/v2/645fb190404541a78e449c703540d6f8/shares/2de4a970-0a05-4094-bdb1-ff3d4f9d20d2 May 28 12:59:26 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-7468943e-2ba5-47eb-8b30-f2058aaf38bd tempest-ResourceLockDeleteTest-1157183439 tempest-ResourceLockDeleteTest-1157183439-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:26 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-7468943e-2ba5-47eb-8b30-f2058aaf38bd tempest-ResourceLockDeleteTest-1157183439 tempest-ResourceLockDeleteTest-1157183439-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:26 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-7468943e-2ba5-47eb-8b30-f2058aaf38bd tempest-ResourceLockDeleteTest-1157183439 tempest-ResourceLockDeleteTest-1157183439-project-member] http://10.27.203.238/share/v2/645fb190404541a78e449c703540d6f8/shares/2de4a970-0a05-4094-bdb1-ff3d4f9d20d2 returned with HTTP 200 May 28 12:59:26 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 730/1447] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:59:26 2024] GET /share/v2/645fb190404541a78e449c703540d6f8/shares/2de4a970-0a05-4094-bdb1-ff3d4f9d20d2 => generated 1316 bytes in 27 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:59:26 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-b3f9d27b-d6cb-4f2a-84fb-6d7cdde45cd2 tempest-ResourceLockDeleteTest-1157183439 tempest-ResourceLockDeleteTest-1157183439-project-member] POST http://10.27.203.238/share/v2/645fb190404541a78e449c703540d6f8/resource-locks May 28 12:59:26 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-b3f9d27b-d6cb-4f2a-84fb-6d7cdde45cd2 tempest-ResourceLockDeleteTest-1157183439 tempest-ResourceLockDeleteTest-1157183439-project-member] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"resource_lock": {"resource_id": "2de4a970-0a05-4094-bdb1-ff3d4f9d20d2", "resource_type": "share", "resource_action": "delete", "lock_reason": "locked by tempest tests"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:59:26 l75lg1-v1 sudo[98992]: pam_unix(sudo:session): session closed for user root May 28 12:59:26 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.490s {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:428}} May 28 12:59:26 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:390}} May 28 12:59:26 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-b3f9d27b-d6cb-4f2a-84fb-6d7cdde45cd2 tempest-ResourceLockDeleteTest-1157183439 tempest-ResourceLockDeleteTest-1157183439-project-member] http://10.27.203.238/share/v2/645fb190404541a78e449c703540d6f8/resource-locks returned with HTTP 200 May 28 12:59:26 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 718/1448] 10.27.203.238 () {66 vars in 1386 bytes} [Tue May 28 12:59:26 2024] POST /share/v2/645fb190404541a78e449c703540d6f8/resource-locks => generated 700 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:59:26 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-ed15edfb-492f-4b99-ba8e-6d87a1db2c49 tempest-ResourceLockDeleteTest-1157183439 tempest-ResourceLockDeleteTest-1157183439-project-member] POST http://10.27.203.238/share/v2/645fb190404541a78e449c703540d6f8/resource-locks May 28 12:59:26 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-ed15edfb-492f-4b99-ba8e-6d87a1db2c49 tempest-ResourceLockDeleteTest-1157183439 tempest-ResourceLockDeleteTest-1157183439-project-member] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"resource_lock": {"resource_id": "2de4a970-0a05-4094-bdb1-ff3d4f9d20d2", "resource_type": "share", "resource_action": "delete", "lock_reason": "locked by tempest tests"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:59:26 l75lg1-v1 sudo[98997]: vastdata : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool May 28 12:59:26 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-fd7b3ad9-bedb-41fc-8fe4-ed8ab900d2b3 tempest-PublicSharesNegativeTest-1466961720 tempest-PublicSharesNegativeTest-1466961720-project-admin] GET http://10.27.203.238/share/v2/6e831d9989b1463da882ee355e32629c/shares/eb49a187-afee-4d13-b48a-a957d46fc910 May 28 12:59:26 l75lg1-v1 sudo[98997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) May 28 12:59:26 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-fd7b3ad9-bedb-41fc-8fe4-ed8ab900d2b3 tempest-PublicSharesNegativeTest-1466961720 tempest-PublicSharesNegativeTest-1466961720-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:26 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-fd7b3ad9-bedb-41fc-8fe4-ed8ab900d2b3 tempest-PublicSharesNegativeTest-1466961720 tempest-PublicSharesNegativeTest-1466961720-project-admin] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:26 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-fd7b3ad9-bedb-41fc-8fe4-ed8ab900d2b3 tempest-PublicSharesNegativeTest-1466961720 tempest-PublicSharesNegativeTest-1466961720-project-admin] http://10.27.203.238/share/v2/6e831d9989b1463da882ee355e32629c/shares/eb49a187-afee-4d13-b48a-a957d46fc910 returned with HTTP 200 May 28 12:59:26 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 719/1449] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:59:26 2024] GET /share/v2/6e831d9989b1463da882ee355e32629c/shares/eb49a187-afee-4d13-b48a-a957d46fc910 => generated 1359 bytes in 28 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:59:26 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-ed15edfb-492f-4b99-ba8e-6d87a1db2c49 tempest-ResourceLockDeleteTest-1157183439 tempest-ResourceLockDeleteTest-1157183439-project-member] http://10.27.203.238/share/v2/645fb190404541a78e449c703540d6f8/resource-locks returned with HTTP 200 May 28 12:59:26 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 731/1450] 10.27.203.238 () {66 vars in 1386 bytes} [Tue May 28 12:59:26 2024] POST /share/v2/645fb190404541a78e449c703540d6f8/resource-locks => generated 700 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:59:26 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-77ba8de5-2585-42a8-927a-e79f220e349a tempest-ResourceLockDeleteTest-1157183439 tempest-ResourceLockDeleteTest-1157183439-project-member] DELETE http://10.27.203.238/share/v2/645fb190404541a78e449c703540d6f8/shares/2de4a970-0a05-4094-bdb1-ff3d4f9d20d2 May 28 12:59:26 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-77ba8de5-2585-42a8-927a-e79f220e349a tempest-ResourceLockDeleteTest-1157183439 tempest-ResourceLockDeleteTest-1157183439-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:26 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-77ba8de5-2585-42a8-927a-e79f220e349a tempest-ResourceLockDeleteTest-1157183439 tempest-ResourceLockDeleteTest-1157183439-project-member] Calling method 'ShareMixin.delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:26 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.v1.shares [None req-77ba8de5-2585-42a8-927a-e79f220e349a tempest-ResourceLockDeleteTest-1157183439 tempest-ResourceLockDeleteTest-1157183439-project-member] Delete share with id: 2de4a970-0a05-4094-bdb1-ff3d4f9d20d2 May 28 12:59:26 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-06672101-d0ab-4d41-a04e-23420ae12224 tempest-PublicSharesNegativeTest-1466961720 None] <<< [DELETE] https://127.0.0.1:40443/api/viewpolicies/34/ May 28 12:59:26 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-06672101-d0ab-4d41-a04e-23420ae12224 tempest-PublicSharesNegativeTest-1466961720 None] --- [DELETE] https://127.0.0.1:40443/api/viewpolicies/34/: Done May 28 12:59:26 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-77ba8de5-2585-42a8-927a-e79f220e349a tempest-ResourceLockDeleteTest-1157183439 tempest-ResourceLockDeleteTest-1157183439-project-member] HTTP exception thrown: Resource lock/s [4111d7b0-6c61-4ac3-8e3b-8314352b0c10, 388f9c8c-df32-491d-82b2-a8b6107b32d8] prevent delete action. May 28 12:59:26 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-77ba8de5-2585-42a8-927a-e79f220e349a tempest-ResourceLockDeleteTest-1157183439 tempest-ResourceLockDeleteTest-1157183439-project-member] http://10.27.203.238/share/v2/645fb190404541a78e449c703540d6f8/shares/2de4a970-0a05-4094-bdb1-ff3d4f9d20d2 returned with HTTP 403 May 28 12:59:26 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 720/1451] 10.27.203.238 () {64 vars in 1454 bytes} [Tue May 28 12:59:26 2024] DELETE /share/v2/645fb190404541a78e449c703540d6f8/shares/2de4a970-0a05-4094-bdb1-ff3d4f9d20d2 => generated 158 bytes in 28 msecs (HTTP/1.1 403) 6 headers in 238 bytes (1 switches on core 0) May 28 12:59:26 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-3df2c7bc-910e-4e7c-8b36-c2790cbd15d6 tempest-ResourceLockDeleteTest-671583867 tempest-ResourceLockDeleteTest-671583867-project-admin] DELETE http://10.27.203.238/share/v2/16bb859669ab42a3b7cc595a5e30eb2e/shares/2de4a970-0a05-4094-bdb1-ff3d4f9d20d2 May 28 12:59:26 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-3df2c7bc-910e-4e7c-8b36-c2790cbd15d6 tempest-ResourceLockDeleteTest-671583867 tempest-ResourceLockDeleteTest-671583867-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:26 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-3df2c7bc-910e-4e7c-8b36-c2790cbd15d6 tempest-ResourceLockDeleteTest-671583867 tempest-ResourceLockDeleteTest-671583867-project-admin] Calling method 'ShareMixin.delete' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:26 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.v1.shares [None req-3df2c7bc-910e-4e7c-8b36-c2790cbd15d6 tempest-ResourceLockDeleteTest-671583867 tempest-ResourceLockDeleteTest-671583867-project-admin] Delete share with id: 2de4a970-0a05-4094-bdb1-ff3d4f9d20d2 May 28 12:59:26 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-3df2c7bc-910e-4e7c-8b36-c2790cbd15d6 tempest-ResourceLockDeleteTest-671583867 tempest-ResourceLockDeleteTest-671583867-project-admin] HTTP exception thrown: Resource lock/s [4111d7b0-6c61-4ac3-8e3b-8314352b0c10, 388f9c8c-df32-491d-82b2-a8b6107b32d8] prevent delete action. May 28 12:59:26 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-3df2c7bc-910e-4e7c-8b36-c2790cbd15d6 tempest-ResourceLockDeleteTest-671583867 tempest-ResourceLockDeleteTest-671583867-project-admin] http://10.27.203.238/share/v2/16bb859669ab42a3b7cc595a5e30eb2e/shares/2de4a970-0a05-4094-bdb1-ff3d4f9d20d2 returned with HTTP 403 May 28 12:59:26 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 732/1452] 10.27.203.238 () {64 vars in 1454 bytes} [Tue May 28 12:59:26 2024] DELETE /share/v2/16bb859669ab42a3b7cc595a5e30eb2e/shares/2de4a970-0a05-4094-bdb1-ff3d4f9d20d2 => generated 158 bytes in 30 msecs (HTTP/1.1 403) 6 headers in 238 bytes (1 switches on core 0) May 28 12:59:26 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-247354a2-da7c-4e4d-afed-59b8a1fa6dbf tempest-ResourceLockDeleteTest-671583867 tempest-ResourceLockDeleteTest-671583867-project-admin] DELETE http://10.27.203.238/share/v2/16bb859669ab42a3b7cc595a5e30eb2e/shares/2de4a970-0a05-4094-bdb1-ff3d4f9d20d2?force=True May 28 12:59:26 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-247354a2-da7c-4e4d-afed-59b8a1fa6dbf tempest-ResourceLockDeleteTest-671583867 tempest-ResourceLockDeleteTest-671583867-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:26 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-247354a2-da7c-4e4d-afed-59b8a1fa6dbf tempest-ResourceLockDeleteTest-671583867 tempest-ResourceLockDeleteTest-671583867-project-admin] Calling method 'ShareMixin.delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:26 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.v1.shares [None req-247354a2-da7c-4e4d-afed-59b8a1fa6dbf tempest-ResourceLockDeleteTest-671583867 tempest-ResourceLockDeleteTest-671583867-project-admin] Delete share with id: 2de4a970-0a05-4094-bdb1-ff3d4f9d20d2 May 28 12:59:26 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-247354a2-da7c-4e4d-afed-59b8a1fa6dbf tempest-ResourceLockDeleteTest-671583867 tempest-ResourceLockDeleteTest-671583867-project-admin] HTTP exception thrown: Resource lock/s [4111d7b0-6c61-4ac3-8e3b-8314352b0c10, 388f9c8c-df32-491d-82b2-a8b6107b32d8] prevent delete action. May 28 12:59:26 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-247354a2-da7c-4e4d-afed-59b8a1fa6dbf tempest-ResourceLockDeleteTest-671583867 tempest-ResourceLockDeleteTest-671583867-project-admin] http://10.27.203.238/share/v2/16bb859669ab42a3b7cc595a5e30eb2e/shares/2de4a970-0a05-4094-bdb1-ff3d4f9d20d2?force=True returned with HTTP 403 May 28 12:59:26 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 721/1453] 10.27.203.238 () {64 vars in 1475 bytes} [Tue May 28 12:59:26 2024] DELETE /share/v2/16bb859669ab42a3b7cc595a5e30eb2e/shares/2de4a970-0a05-4094-bdb1-ff3d4f9d20d2?force=True => generated 158 bytes in 27 msecs (HTTP/1.1 403) 6 headers in 238 bytes (1 switches on core 0) May 28 12:59:26 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d2ed8e23-09ed-42b0-8844-6ed62e3cda1f tempest-ShareIpRulesForNFSTest-1748669711 None] <<< [PATCH] https://127.0.0.1:40443/api/viewpolicies/21/ May 28 12:59:26 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d2ed8e23-09ed-42b0-8844-6ed62e3cda1f tempest-ShareIpRulesForNFSTest-1748669711 None] Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=1, created='2024-05-28T12:57:40.763635Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='377955ad-d094-4e49-ab32-1021d943a572', id=21, internal=False, is_s3_default_policy=False, name='b7a7d61c-2cea-442a-9809-507038e080d5', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=['*'], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=[], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=[], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='MODIFYING', sync_time='2024-05-28T12:59:26.268123Z', tenant_id=1, tenant_name='default', title='b7a7d61c-2cea-442a-9809-507038e080d5', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/21/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[]) May 28 12:59:26 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d2ed8e23-09ed-42b0-8844-6ed62e3cda1f tempest-ShareIpRulesForNFSTest-1748669711 None] --- [PATCH] https://127.0.0.1:40443/api/viewpolicies/21/: Done May 28 12:59:26 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-d2ed8e23-09ed-42b0-8844-6ed62e3cda1f tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:26 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-d2ed8e23-09ed-42b0-8844-6ed62e3cda1f tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:26 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-aea039df-2364-4c3c-83d9-4af52be4bf28 tempest-ResourceLockDeleteTest-1157183439 tempest-ResourceLockDeleteTest-1157183439-project-member] DELETE http://10.27.203.238/share/v2/645fb190404541a78e449c703540d6f8/resource-locks/388f9c8c-df32-491d-82b2-a8b6107b32d8 May 28 12:59:26 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-aea039df-2364-4c3c-83d9-4af52be4bf28 tempest-ResourceLockDeleteTest-1157183439 tempest-ResourceLockDeleteTest-1157183439-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:26 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-aea039df-2364-4c3c-83d9-4af52be4bf28 tempest-ResourceLockDeleteTest-1157183439 tempest-ResourceLockDeleteTest-1157183439-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:26 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-aea039df-2364-4c3c-83d9-4af52be4bf28 tempest-ResourceLockDeleteTest-1157183439 tempest-ResourceLockDeleteTest-1157183439-project-member] http://10.27.203.238/share/v2/645fb190404541a78e449c703540d6f8/resource-locks/388f9c8c-df32-491d-82b2-a8b6107b32d8 returned with HTTP 204 May 28 12:59:26 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 733/1454] 10.27.203.238 () {64 vars in 1478 bytes} [Tue May 28 12:59:26 2024] DELETE /share/v2/645fb190404541a78e449c703540d6f8/resource-locks/388f9c8c-df32-491d-82b2-a8b6107b32d8 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 6 headers in 245 bytes (1 switches on core 0) May 28 12:59:26 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-d2ed8e23-09ed-42b0-8844-6ed62e3cda1f tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.034s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:26 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-d2ed8e23-09ed-42b0-8844-6ed62e3cda1f tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:26 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-d2ed8e23-09ed-42b0-8844-6ed62e3cda1f tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:26 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-8e7b9779-c138-4d34-a804-b238038c919f tempest-ResourceLockDeleteTest-1157183439 tempest-ResourceLockDeleteTest-1157183439-project-member] DELETE http://10.27.203.238/share/v2/645fb190404541a78e449c703540d6f8/shares/2de4a970-0a05-4094-bdb1-ff3d4f9d20d2 May 28 12:59:26 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-8e7b9779-c138-4d34-a804-b238038c919f tempest-ResourceLockDeleteTest-1157183439 tempest-ResourceLockDeleteTest-1157183439-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:26 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-8e7b9779-c138-4d34-a804-b238038c919f tempest-ResourceLockDeleteTest-1157183439 tempest-ResourceLockDeleteTest-1157183439-project-member] Calling method 'ShareMixin.delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:26 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.v1.shares [None req-8e7b9779-c138-4d34-a804-b238038c919f tempest-ResourceLockDeleteTest-1157183439 tempest-ResourceLockDeleteTest-1157183439-project-member] Delete share with id: 2de4a970-0a05-4094-bdb1-ff3d4f9d20d2 May 28 12:59:26 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-8e7b9779-c138-4d34-a804-b238038c919f tempest-ResourceLockDeleteTest-1157183439 tempest-ResourceLockDeleteTest-1157183439-project-member] HTTP exception thrown: Resource lock/s [4111d7b0-6c61-4ac3-8e3b-8314352b0c10] prevent delete action. May 28 12:59:26 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-8e7b9779-c138-4d34-a804-b238038c919f tempest-ResourceLockDeleteTest-1157183439 tempest-ResourceLockDeleteTest-1157183439-project-member] http://10.27.203.238/share/v2/645fb190404541a78e449c703540d6f8/shares/2de4a970-0a05-4094-bdb1-ff3d4f9d20d2 returned with HTTP 403 May 28 12:59:26 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 722/1455] 10.27.203.238 () {64 vars in 1454 bytes} [Tue May 28 12:59:26 2024] DELETE /share/v2/645fb190404541a78e449c703540d6f8/shares/2de4a970-0a05-4094-bdb1-ff3d4f9d20d2 => generated 120 bytes in 31 msecs (HTTP/1.1 403) 6 headers in 238 bytes (1 switches on core 0) May 28 12:59:26 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e26a579e-a015-40c0-84da-e6b3d957b387 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:59:26 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e26a579e-a015-40c0-84da-e6b3d957b387 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] [Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=1, created='2024-05-28T12:58:43.845440Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='31b6534b-d142-4561-992f-4f0759db302d', id=32, internal=False, is_s3_default_policy=False, name='7fdd602c-79d0-479c-95a2-336b202c6639', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=['*'], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=[], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=[], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T12:59:25.718114Z', tenant_id=1, tenant_name='default', title='7fdd602c-79d0-479c-95a2-336b202c6639', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/32/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[])] May 28 12:59:26 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e26a579e-a015-40c0-84da-e6b3d957b387 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 12:59:26 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-e26a579e-a015-40c0-84da-e6b3d957b387 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] changing access on /manila/manila-7fdd602c-79d0-479c-95a2-336b202c6639. Rules: {'nfs_read_write': ['10.20.30.40'], 'nfs_read_only': []} May 28 12:59:26 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e26a579e-a015-40c0-84da-e6b3d957b387 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] >>> [PATCH] https://127.0.0.1:40443/api/viewpolicies/32/ May 28 12:59:26 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e26a579e-a015-40c0-84da-e6b3d957b387 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] {'data': '{"name": "7fdd602c-79d0-479c-95a2-336b202c6639", "nfs_no_squash": ' May 28 12:59:26 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e26a579e-a015-40c0-84da-e6b3d957b387 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] '["*"], "nfs_root_squash": ["*"], "nfs_read_write": ["10.20.30.40"], ' May 28 12:59:26 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e26a579e-a015-40c0-84da-e6b3d957b387 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] '"nfs_read_only": []}', May 28 12:59:26 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e26a579e-a015-40c0-84da-e6b3d957b387 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] 'params': None} May 28 12:59:26 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-3f769a11-6eb2-46dd-9350-fa6feb08dc5d tempest-ResourceLockDeleteTest-1157183439 tempest-ResourceLockDeleteTest-1157183439-project-member] DELETE http://10.27.203.238/share/v2/645fb190404541a78e449c703540d6f8/resource-locks/4111d7b0-6c61-4ac3-8e3b-8314352b0c10 May 28 12:59:26 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-3f769a11-6eb2-46dd-9350-fa6feb08dc5d tempest-ResourceLockDeleteTest-1157183439 tempest-ResourceLockDeleteTest-1157183439-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:26 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-3f769a11-6eb2-46dd-9350-fa6feb08dc5d tempest-ResourceLockDeleteTest-1157183439 tempest-ResourceLockDeleteTest-1157183439-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:26 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-06672101-d0ab-4d41-a04e-23420ae12224 tempest-PublicSharesNegativeTest-1466961720 None] Created reservations ['0e3ffcc2-2188-4602-85a9-120b69a08181', '60b74497-9bbe-4b06-a3e2-ac421ebe7a50', 'f2523fa2-9ae4-4e8a-9f70-e3bc9348bd78', 'eec8779a-990f-4f71-8715-d9de69014f8a'] {{(pid=98474) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 12:59:26 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-d2ed8e23-09ed-42b0-8844-6ed62e3cda1f tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.040s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:26 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-d2ed8e23-09ed-42b0-8844-6ed62e3cda1f tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:26 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-d2ed8e23-09ed-42b0-8844-6ed62e3cda1f tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:26 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-d2ed8e23-09ed-42b0-8844-6ed62e3cda1f tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.006s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:26 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-d2ed8e23-09ed-42b0-8844-6ed62e3cda1f tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:26 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-d2ed8e23-09ed-42b0-8844-6ed62e3cda1f tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:26 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-d2ed8e23-09ed-42b0-8844-6ed62e3cda1f tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.005s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:26 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-d2ed8e23-09ed-42b0-8844-6ed62e3cda1f tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:26 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-d2ed8e23-09ed-42b0-8844-6ed62e3cda1f tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:26 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-3f769a11-6eb2-46dd-9350-fa6feb08dc5d tempest-ResourceLockDeleteTest-1157183439 tempest-ResourceLockDeleteTest-1157183439-project-member] http://10.27.203.238/share/v2/645fb190404541a78e449c703540d6f8/resource-locks/4111d7b0-6c61-4ac3-8e3b-8314352b0c10 returned with HTTP 204 May 28 12:59:26 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 734/1456] 10.27.203.238 () {64 vars in 1478 bytes} [Tue May 28 12:59:26 2024] DELETE /share/v2/645fb190404541a78e449c703540d6f8/resource-locks/4111d7b0-6c61-4ac3-8e3b-8314352b0c10 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 6 headers in 245 bytes (1 switches on core 0) May 28 12:59:26 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-b3e7547a-dff0-4eb2-b72d-1538064bf1f1 tempest-ResourceLockDeleteTest-1157183439 tempest-ResourceLockDeleteTest-1157183439-project-member] DELETE http://10.27.203.238/share/v2/645fb190404541a78e449c703540d6f8/shares/2de4a970-0a05-4094-bdb1-ff3d4f9d20d2 May 28 12:59:26 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-b3e7547a-dff0-4eb2-b72d-1538064bf1f1 tempest-ResourceLockDeleteTest-1157183439 tempest-ResourceLockDeleteTest-1157183439-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:26 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-b3e7547a-dff0-4eb2-b72d-1538064bf1f1 tempest-ResourceLockDeleteTest-1157183439 tempest-ResourceLockDeleteTest-1157183439-project-member] Calling method 'ShareMixin.delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:26 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.v1.shares [None req-b3e7547a-dff0-4eb2-b72d-1538064bf1f1 tempest-ResourceLockDeleteTest-1157183439 tempest-ResourceLockDeleteTest-1157183439-project-member] Delete share with id: 2de4a970-0a05-4094-bdb1-ff3d4f9d20d2 May 28 12:59:26 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-06672101-d0ab-4d41-a04e-23420ae12224 tempest-PublicSharesNegativeTest-1466961720 None] Committed reservations ['0e3ffcc2-2188-4602-85a9-120b69a08181', '60b74497-9bbe-4b06-a3e2-ac421ebe7a50', 'f2523fa2-9ae4-4e8a-9f70-e3bc9348bd78', 'eec8779a-990f-4f71-8715-d9de69014f8a'] {{(pid=98474) commit /opt/stack/manila/manila/quota.py:1063}} May 28 12:59:26 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-d2ed8e23-09ed-42b0-8844-6ed62e3cda1f tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.055s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:26 l75lg1-v1 manila-share[98474]: INFO manila.share.access [None req-d2ed8e23-09ed-42b0-8844-6ed62e3cda1f tempest-ShareIpRulesForNFSTest-1748669711 None] Access rules were successfully modified for share instance b7a7d61c-2cea-442a-9809-507038e080d5 belonging to share 1ddadc17-cf10-4a42-8bbd-8335fb3520a1. May 28 12:59:26 l75lg1-v1 manila-share[98474]: INFO manila.share.manager [None req-06672101-d0ab-4d41-a04e-23420ae12224 tempest-PublicSharesNegativeTest-1466961720 None] Share instance 67a5173e-4e46-4dc2-8375-e9849d8dde4c: deleted successfully. May 28 12:59:27 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-b3e7547a-dff0-4eb2-b72d-1538064bf1f1 tempest-ResourceLockDeleteTest-1157183439 tempest-ResourceLockDeleteTest-1157183439-project-member] http://10.27.203.238/share/v2/645fb190404541a78e449c703540d6f8/shares/2de4a970-0a05-4094-bdb1-ff3d4f9d20d2 returned with HTTP 202 May 28 12:59:27 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 723/1457] 10.27.203.238 () {64 vars in 1454 bytes} [Tue May 28 12:59:26 2024] DELETE /share/v2/645fb190404541a78e449c703540d6f8/shares/2de4a970-0a05-4094-bdb1-ff3d4f9d20d2 => generated 0 bytes in 130 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:59:27 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-c1569b68-d414-48c6-b0ac-5136a73c8103 tempest-ResourceLockDeleteTest-1157183439 tempest-ResourceLockDeleteTest-1157183439-project-member] GET http://10.27.203.238/share/v2/645fb190404541a78e449c703540d6f8/shares/2de4a970-0a05-4094-bdb1-ff3d4f9d20d2 May 28 12:59:27 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-c1569b68-d414-48c6-b0ac-5136a73c8103 tempest-ResourceLockDeleteTest-1157183439 tempest-ResourceLockDeleteTest-1157183439-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:27 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-c1569b68-d414-48c6-b0ac-5136a73c8103 tempest-ResourceLockDeleteTest-1157183439 tempest-ResourceLockDeleteTest-1157183439-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:27 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-c1569b68-d414-48c6-b0ac-5136a73c8103 tempest-ResourceLockDeleteTest-1157183439 tempest-ResourceLockDeleteTest-1157183439-project-member] http://10.27.203.238/share/v2/645fb190404541a78e449c703540d6f8/shares/2de4a970-0a05-4094-bdb1-ff3d4f9d20d2 returned with HTTP 200 May 28 12:59:27 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 735/1458] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:59:27 2024] GET /share/v2/645fb190404541a78e449c703540d6f8/shares/2de4a970-0a05-4094-bdb1-ff3d4f9d20d2 => generated 1315 bytes in 26 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:59:27 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-b3e7547a-dff0-4eb2-b72d-1538064bf1f1 tempest-ResourceLockDeleteTest-1157183439 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b16b1d63-ae6f-4f71-846e-84edd63a87f6" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:27 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-b3e7547a-dff0-4eb2-b72d-1538064bf1f1 tempest-ResourceLockDeleteTest-1157183439 None] Lock "locked_access_rules_operation_by_share_instance_b16b1d63-ae6f-4f71-846e-84edd63a87f6" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:27 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-b3e7547a-dff0-4eb2-b72d-1538064bf1f1 tempest-ResourceLockDeleteTest-1157183439 None] Lock "locked_access_rules_operation_by_share_instance_b16b1d63-ae6f-4f71-846e-84edd63a87f6" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:27 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-b3e7547a-dff0-4eb2-b72d-1538064bf1f1 tempest-ResourceLockDeleteTest-1157183439 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b16b1d63-ae6f-4f71-846e-84edd63a87f6" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:27 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-b3e7547a-dff0-4eb2-b72d-1538064bf1f1 tempest-ResourceLockDeleteTest-1157183439 None] Lock "locked_access_rules_operation_by_share_instance_b16b1d63-ae6f-4f71-846e-84edd63a87f6" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:27 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-b3e7547a-dff0-4eb2-b72d-1538064bf1f1 tempest-ResourceLockDeleteTest-1157183439 None] Lock "locked_access_rules_operation_by_share_instance_b16b1d63-ae6f-4f71-846e-84edd63a87f6" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:27 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-b3e7547a-dff0-4eb2-b72d-1538064bf1f1 tempest-ResourceLockDeleteTest-1157183439 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b16b1d63-ae6f-4f71-846e-84edd63a87f6" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:27 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-b3e7547a-dff0-4eb2-b72d-1538064bf1f1 tempest-ResourceLockDeleteTest-1157183439 None] Lock "locked_access_rules_operation_by_share_instance_b16b1d63-ae6f-4f71-846e-84edd63a87f6" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:27 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-b3e7547a-dff0-4eb2-b72d-1538064bf1f1 tempest-ResourceLockDeleteTest-1157183439 None] Lock "locked_access_rules_operation_by_share_instance_b16b1d63-ae6f-4f71-846e-84edd63a87f6" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.004s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:27 l75lg1-v1 manila-share[98474]: DEBUG manila.share.access [None req-b3e7547a-dff0-4eb2-b72d-1538064bf1f1 tempest-ResourceLockDeleteTest-1157183439 None] All access rules have been synced for share instance b16b1d63-ae6f-4f71-846e-84edd63a87f6 belonging to share 2de4a970-0a05-4094-bdb1-ff3d4f9d20d2. {{(pid=98474) update_access_rules /opt/stack/manila/manila/share/access.py:304}} May 28 12:59:27 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-b3e7547a-dff0-4eb2-b72d-1538064bf1f1 tempest-ResourceLockDeleteTest-1157183439 None] deleting '/manila/manila-b16b1d63-ae6f-4f71-846e-84edd63a87f6' May 28 12:59:27 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b3e7547a-dff0-4eb2-b72d-1538064bf1f1 tempest-ResourceLockDeleteTest-1157183439 None] >>> [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/ May 28 12:59:27 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b3e7547a-dff0-4eb2-b72d-1538064bf1f1 tempest-ResourceLockDeleteTest-1157183439 None] {'data': '{"path": "/manila/manila-b16b1d63-ae6f-4f71-846e-84edd63a87f6"}', May 28 12:59:27 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b3e7547a-dff0-4eb2-b72d-1538064bf1f1 tempest-ResourceLockDeleteTest-1157183439 None] 'params': None} May 28 12:59:27 l75lg1-v1 sudo[98997]: pam_unix(sudo:session): session closed for user root May 28 12:59:27 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.483s {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:428}} May 28 12:59:27 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:390}} May 28 12:59:27 l75lg1-v1 sudo[99000]: vastdata : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 May 28 12:59:27 l75lg1-v1 sudo[99000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) May 28 12:59:27 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-af3aee54-d07f-452d-8b4a-4964361515c7 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] GET http://10.27.203.238/share/v2/776f75906bc64f8f9316d5aab4b50bf1/share-access-rules?share_id=1ddadc17-cf10-4a42-8bbd-8335fb3520a1 May 28 12:59:27 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-af3aee54-d07f-452d-8b4a-4964361515c7 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:27 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-af3aee54-d07f-452d-8b4a-4964361515c7 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:27 l75lg1-v1 dstat.sh[49771]: 28-05 12:59:27| 21 3 74 3 0|5742M 1728M 277M 7877M| 17k 5619B| 641k 1541k|5.00 227 |6707 11k|1.12 1.05 1.01|2.0 1.0 8.0| 0 0 | 0 2048M| 29 362 0 31 0 May 28 12:59:27 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-af3aee54-d07f-452d-8b4a-4964361515c7 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] http://10.27.203.238/share/v2/776f75906bc64f8f9316d5aab4b50bf1/share-access-rules?share_id=1ddadc17-cf10-4a42-8bbd-8335fb3520a1 returned with HTTP 200 May 28 12:59:27 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 724/1459] 10.27.203.238 () {64 vars in 1467 bytes} [Tue May 28 12:59:27 2024] GET /share/v2/776f75906bc64f8f9316d5aab4b50bf1/share-access-rules?share_id=1ddadc17-cf10-4a42-8bbd-8335fb3520a1 => generated 19 bytes in 28 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:59:27 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b3e7547a-dff0-4eb2-b72d-1538064bf1f1 tempest-ResourceLockDeleteTest-1157183439 None] <<< [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/ May 28 12:59:27 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b3e7547a-dff0-4eb2-b72d-1538064bf1f1 tempest-ResourceLockDeleteTest-1157183439 None] 'OK' May 28 12:59:27 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b3e7547a-dff0-4eb2-b72d-1538064bf1f1 tempest-ResourceLockDeleteTest-1157183439 None] --- [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/: Done May 28 12:59:27 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b3e7547a-dff0-4eb2-b72d-1538064bf1f1 tempest-ResourceLockDeleteTest-1157183439 None] >>> [GET] https://127.0.0.1:40443/api/views/ May 28 12:59:27 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b3e7547a-dff0-4eb2-b72d-1538064bf1f1 tempest-ResourceLockDeleteTest-1157183439 None] {'allow_redirects': True, May 28 12:59:27 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b3e7547a-dff0-4eb2-b72d-1538064bf1f1 tempest-ResourceLockDeleteTest-1157183439 None] 'params': {'name': 'b16b1d63-ae6f-4f71-846e-84edd63a87f6'}} May 28 12:59:27 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-bf023d15-ebb0-49d9-9673-6dd45afdd77f tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] POST http://10.27.203.238/share/v2/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action May 28 12:59:27 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-bf023d15-ebb0-49d9-9673-6dd45afdd77f tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Action body: b'{"allow_access": {"access_type": "ip", "access_to": "2.2.2.2", "access_level": "ro"}}' {{(pid=98329) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:59:27 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-bf023d15-ebb0-49d9-9673-6dd45afdd77f tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Action: 'action', calling method: ShareController.allow_access, body: {"allow_access": {"access_type": "ip", "access_to": "2.2.2.2", "access_level": "ro"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:59:27 l75lg1-v1 devstack@m-api.service[98329]: DEBUG oslo_concurrency.lockutils [None req-bf023d15-ebb0-49d9-9673-6dd45afdd77f tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98329) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:27 l75lg1-v1 devstack@m-api.service[98329]: DEBUG oslo_concurrency.lockutils [None req-bf023d15-ebb0-49d9-9673-6dd45afdd77f tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98329) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:27 l75lg1-v1 devstack@m-api.service[98329]: DEBUG oslo_concurrency.lockutils [None req-bf023d15-ebb0-49d9-9673-6dd45afdd77f tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.055s {{(pid=98329) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:27 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-bf023d15-ebb0-49d9-9673-6dd45afdd77f tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] http://10.27.203.238/share/v2/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action returned with HTTP 200 May 28 12:59:27 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 736/1460] 10.27.203.238 () {66 vars in 1493 bytes} [Tue May 28 12:59:27 2024] POST /share/v2/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action => generated 225 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:59:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG dbcounter [-] [51266] Writing DB stats keystone:SELECT=1400,keystone:DELETE=176,keystone:INSERT=90 {{(pid=51266) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:59:27 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-202e70d3-00ad-4345-9881-7809bb970020 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] POST http://10.27.203.238/share/v2/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action May 28 12:59:27 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-202e70d3-00ad-4345-9881-7809bb970020 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Action body: b'{"access_list": null}' {{(pid=98330) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:59:27 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-202e70d3-00ad-4345-9881-7809bb970020 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Action: 'action', calling method: ShareController.access_list, body: {"access_list": null} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:59:27 l75lg1-v1 manila-share[98474]: DEBUG manila.share.manager [None req-bf023d15-ebb0-49d9-9673-6dd45afdd77f tempest-ShareIpRulesForNFSTest-1748669711 None] Received request to update access for share instance b7a7d61c-2cea-442a-9809-507038e080d5. {{(pid=98474) update_access_for_instances /opt/stack/manila/manila/share/manager.py:4353}} May 28 12:59:27 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-202e70d3-00ad-4345-9881-7809bb970020 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] http://10.27.203.238/share/v2/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action returned with HTTP 200 May 28 12:59:27 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 725/1461] 10.27.203.238 () {66 vars in 1493 bytes} [Tue May 28 12:59:27 2024] POST /share/v2/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action => generated 180 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:59:27 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-bf023d15-ebb0-49d9-9673-6dd45afdd77f tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:27 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-bf023d15-ebb0-49d9-9673-6dd45afdd77f tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:27 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-bf023d15-ebb0-49d9-9673-6dd45afdd77f tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:27 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-bf023d15-ebb0-49d9-9673-6dd45afdd77f tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:27 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-bf023d15-ebb0-49d9-9673-6dd45afdd77f tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG dbcounter [-] [51267] Writing DB stats keystone:SELECT=1406,keystone:DELETE=197,keystone:INSERT=81 {{(pid=51267) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:59:27 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-bf023d15-ebb0-49d9-9673-6dd45afdd77f tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.061s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:27 l75lg1-v1 manila-share[98474]: DEBUG manila.share.access [None req-bf023d15-ebb0-49d9-9673-6dd45afdd77f tempest-ShareIpRulesForNFSTest-1748669711 None] Updating access rules for share instance b7a7d61c-2cea-442a-9809-507038e080d5 belonging to share 1ddadc17-cf10-4a42-8bbd-8335fb3520a1. {{(pid=98474) update_access_rules /opt/stack/manila/manila/share/access.py:298}} May 28 12:59:27 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-bf023d15-ebb0-49d9-9673-6dd45afdd77f tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:27 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-bf023d15-ebb0-49d9-9673-6dd45afdd77f tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:27 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-bf023d15-ebb0-49d9-9673-6dd45afdd77f tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.007s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:27 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-bf023d15-ebb0-49d9-9673-6dd45afdd77f tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:27 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-bf023d15-ebb0-49d9-9673-6dd45afdd77f tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:27 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-bf023d15-ebb0-49d9-9673-6dd45afdd77f tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.015s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:27 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-bf023d15-ebb0-49d9-9673-6dd45afdd77f tempest-ShareIpRulesForNFSTest-1748669711 None] changing access on None May 28 12:59:27 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bf023d15-ebb0-49d9-9673-6dd45afdd77f tempest-ShareIpRulesForNFSTest-1748669711 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:59:27 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bf023d15-ebb0-49d9-9673-6dd45afdd77f tempest-ShareIpRulesForNFSTest-1748669711 None] {'allow_redirects': True, May 28 12:59:27 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bf023d15-ebb0-49d9-9673-6dd45afdd77f tempest-ShareIpRulesForNFSTest-1748669711 None] 'params': {'name': 'b7a7d61c-2cea-442a-9809-507038e080d5'}} May 28 12:59:27 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b3e7547a-dff0-4eb2-b72d-1538064bf1f1 tempest-ResourceLockDeleteTest-1157183439 None] <<< [GET] https://127.0.0.1:40443/api/views/ May 28 12:59:27 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b3e7547a-dff0-4eb2-b72d-1538064bf1f1 tempest-ResourceLockDeleteTest-1157183439 None] [Bunch(abac_tags=[], abe_max_depth=None, abe_protocols=[], alias='', allow_anonymous_access=False, allow_s3_anonymous_access=False, auto_commit='0d', bucket='', bucket_creators=[], bucket_creators_groups=[], bucket_owner=None, bulk_permission_update_progress=None, bulk_permission_update_state=None, cluster='loop75-kfs', cluster_id=1, created='2024-05-28T12:59:24.330288Z', enabled=True, files_retention_mode='NONE', guid='7d63b484-93ba-4757-8928-93aaf1d20d4a', id=35, ignore_oos=False, internal=False, is_remote=False, is_seamless=False, logical_capacity=0, max_retention_period=None, min_retention_period=None, name='b16b1d63-ae6f-4f71-846e-84edd63a87f6', nfs_interop_flags='BOTH_NFS3_AND_NFS4_INTEROP_DISABLED', path='/manila/manila-b16b1d63-ae6f-4f71-846e-84edd63a87f6', physical_capacity=0, policy='b16b1d63-ae6f-4f71-846e-84edd63a87f6', policy_id=36, protocols=['NFS'], qos_policy=None, qos_policy_id=None, s3_locks=False, s3_locks_retention_mode='NONE', s3_locks_retention_period='', s3_unverified_lookup=False, s3_versioning=False, select_for_live_monitoring=False, share='', share_acl=Bunch(acl=[], enabled=False), sync='SYNCED', sync_time='2024-05-28T12:59:24.651160Z', tenant_id=1, tenant_name='default', title='/manila/manila-b16b1d63-ae6f-4f71-846e-84edd63a87f6', url='https://127.0.0.1:40443/api/views/35/')] May 28 12:59:27 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b3e7547a-dff0-4eb2-b72d-1538064bf1f1 tempest-ResourceLockDeleteTest-1157183439 None] --- [GET] https://127.0.0.1:40443/api/views/: Done May 28 12:59:27 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b3e7547a-dff0-4eb2-b72d-1538064bf1f1 tempest-ResourceLockDeleteTest-1157183439 None] >>> [DELETE] https://127.0.0.1:40443/api/views/35/ May 28 12:59:27 l75lg1-v1 sudo[99000]: pam_unix(sudo:session): session closed for user root May 28 12:59:27 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.492s {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:428}} May 28 12:59:27 l75lg1-v1 cinder-volume[85846]: DEBUG cinder.manager [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] Notifying Schedulers of capabilities ... {{(pid=85846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 28 12:59:27 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.scheduler.host_manager [None req-e54f1e64-090e-488c-be49-abb0d93df067 None None] Received volume service update from l75lg1-v1@lvmdriver-1: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:l75lg1-v1:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up', 'allocated_capacity_gb': 0, 'cacheable': True}], 'shared_targets': False, 'sparse_copy_volume': True, 'filter_function': None, 'goodness_function': None} {{(pid=85128) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:628}} May 28 12:59:28 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bf023d15-ebb0-49d9-9673-6dd45afdd77f tempest-ShareIpRulesForNFSTest-1748669711 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:59:28 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bf023d15-ebb0-49d9-9673-6dd45afdd77f tempest-ShareIpRulesForNFSTest-1748669711 None] [Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=1, created='2024-05-28T12:57:40.763635Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='377955ad-d094-4e49-ab32-1021d943a572', id=21, internal=False, is_s3_default_policy=False, name='b7a7d61c-2cea-442a-9809-507038e080d5', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=['*'], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=[], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=[], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T12:59:26.696043Z', tenant_id=1, tenant_name='default', title='b7a7d61c-2cea-442a-9809-507038e080d5', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/21/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[])] May 28 12:59:28 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bf023d15-ebb0-49d9-9673-6dd45afdd77f tempest-ShareIpRulesForNFSTest-1748669711 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 12:59:28 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-bf023d15-ebb0-49d9-9673-6dd45afdd77f tempest-ShareIpRulesForNFSTest-1748669711 None] changing access on /manila/manila-b7a7d61c-2cea-442a-9809-507038e080d5. Rules: {'nfs_read_write': [], 'nfs_read_only': ['2.2.2.2']} May 28 12:59:28 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bf023d15-ebb0-49d9-9673-6dd45afdd77f tempest-ShareIpRulesForNFSTest-1748669711 None] >>> [PATCH] https://127.0.0.1:40443/api/viewpolicies/21/ May 28 12:59:28 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bf023d15-ebb0-49d9-9673-6dd45afdd77f tempest-ShareIpRulesForNFSTest-1748669711 None] {'data': '{"name": "b7a7d61c-2cea-442a-9809-507038e080d5", "nfs_no_squash": ' May 28 12:59:28 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bf023d15-ebb0-49d9-9673-6dd45afdd77f tempest-ShareIpRulesForNFSTest-1748669711 None] '["*"], "nfs_root_squash": ["*"], "nfs_read_write": [], ' May 28 12:59:28 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bf023d15-ebb0-49d9-9673-6dd45afdd77f tempest-ShareIpRulesForNFSTest-1748669711 None] '"nfs_read_only": ["2.2.2.2"]}', May 28 12:59:28 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bf023d15-ebb0-49d9-9673-6dd45afdd77f tempest-ShareIpRulesForNFSTest-1748669711 None] 'params': None} May 28 12:59:28 l75lg1-v1 dstat.sh[49771]: 28-05 12:59:28| 7 1 90 1 0|5740M 1730M 277M 7877M| 21k 5499B| 256k 1020k|2.00 118 |3549 5117 |1.12 1.05 1.01| 0 2.0 9.0| 0 0 | 0 2048M| 29 361 0 30 0 May 28 12:59:28 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e26a579e-a015-40c0-84da-e6b3d957b387 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] <<< [PATCH] https://127.0.0.1:40443/api/viewpolicies/32/ May 28 12:59:28 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e26a579e-a015-40c0-84da-e6b3d957b387 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=1, created='2024-05-28T12:58:43.845440Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='31b6534b-d142-4561-992f-4f0759db302d', id=32, internal=False, is_s3_default_policy=False, name='7fdd602c-79d0-479c-95a2-336b202c6639', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=['*'], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['10.20.30.40'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['10.20.30.40'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='MODIFYING', sync_time='2024-05-28T12:59:28.100153Z', tenant_id=1, tenant_name='default', title='7fdd602c-79d0-479c-95a2-336b202c6639', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/32/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[]) May 28 12:59:28 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e26a579e-a015-40c0-84da-e6b3d957b387 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] --- [PATCH] https://127.0.0.1:40443/api/viewpolicies/32/: Done May 28 12:59:28 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-e26a579e-a015-40c0-84da-e6b3d957b387 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:28 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-e26a579e-a015-40c0-84da-e6b3d957b387 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:28 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-e26a579e-a015-40c0-84da-e6b3d957b387 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.052s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:28 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-e26a579e-a015-40c0-84da-e6b3d957b387 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:28 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-e26a579e-a015-40c0-84da-e6b3d957b387 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:28 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-e26a579e-a015-40c0-84da-e6b3d957b387 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:28 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-e26a579e-a015-40c0-84da-e6b3d957b387 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:28 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-e26a579e-a015-40c0-84da-e6b3d957b387 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:28 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-e26a579e-a015-40c0-84da-e6b3d957b387 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:28 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-e26a579e-a015-40c0-84da-e6b3d957b387 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:28 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-e26a579e-a015-40c0-84da-e6b3d957b387 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:28 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-e26a579e-a015-40c0-84da-e6b3d957b387 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:28 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-e26a579e-a015-40c0-84da-e6b3d957b387 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:28 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-e26a579e-a015-40c0-84da-e6b3d957b387 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:29 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-e26a579e-a015-40c0-84da-e6b3d957b387 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.039s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:29 l75lg1-v1 manila-share[98474]: INFO manila.share.access [None req-e26a579e-a015-40c0-84da-e6b3d957b387 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Access rules were successfully modified for share instance 7fdd602c-79d0-479c-95a2-336b202c6639 belonging to share 72db8769-ece7-42ff-af27-2e778292a9b4. May 28 12:59:29 l75lg1-v1 dstat.sh[49771]: 28-05 12:59:29| 2 0 97 1 0|5740M 1730M 277M 7878M| 15k 66B| 0 1120k| 0 113 |2297 3717 |1.12 1.05 1.01|1.0 1.0 0| 0 0 | 0 2048M| 29 361 0 30 0 May 28 12:59:29 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-432bbe11-2fa7-4653-833a-294d78f3545c tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] GET http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/share-access-rules?share_id=72db8769-ece7-42ff-af27-2e778292a9b4 May 28 12:59:29 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-432bbe11-2fa7-4653-833a-294d78f3545c tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:29 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-432bbe11-2fa7-4653-833a-294d78f3545c tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:29 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.lock.api [None req-432bbe11-2fa7-4653-833a-294d78f3545c tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Searching for locks by: {'resource_id': '610f3149-4f86-4f0d-ab7f-d42026c6f34d', 'resource_action': 'show', 'resource_type': 'access_rule'} {{(pid=98329) get_all /opt/stack/manila/manila/lock/api.py:112}} May 28 12:59:29 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-432bbe11-2fa7-4653-833a-294d78f3545c tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/share-access-rules?share_id=72db8769-ece7-42ff-af27-2e778292a9b4 returned with HTTP 200 May 28 12:59:29 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 737/1462] 10.27.203.238 () {64 vars in 1467 bytes} [Tue May 28 12:59:29 2024] GET /share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/share-access-rules?share_id=72db8769-ece7-42ff-af27-2e778292a9b4 => generated 279 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:59:29 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-3dd3e19c-48f5-4cf7-905c-4eda2683efd1 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] POST http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action May 28 12:59:29 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-3dd3e19c-48f5-4cf7-905c-4eda2683efd1 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Action body: b'{"allow_access": {"access_type": "ip", "access_to": "10.20.30.40", "access_level": null}}' {{(pid=98330) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:59:29 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-3dd3e19c-48f5-4cf7-905c-4eda2683efd1 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Action: 'action', calling method: ShareController.allow_access, body: {"allow_access": {"access_type": "ip", "access_to": "10.20.30.40", "access_level": null}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:59:29 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-740e9dc6-39c5-4472-b589-98cae4235b2e tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] GET http://10.27.203.238/share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/messages May 28 12:59:29 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-740e9dc6-39c5-4472-b589-98cae4235b2e tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:29 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-740e9dc6-39c5-4472-b589-98cae4235b2e tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:29 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.message.api [None req-740e9dc6-39c5-4472-b589-98cae4235b2e tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Searching for messages by: MultiDict([]) {{(pid=98329) get_all /opt/stack/manila/manila/message/api.py:78}} May 28 12:59:29 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-740e9dc6-39c5-4472-b589-98cae4235b2e tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] http://10.27.203.238/share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/messages returned with HTTP 200 May 28 12:59:29 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 738/1463] 10.27.203.238 () {64 vars in 1346 bytes} [Tue May 28 12:59:29 2024] GET /share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/messages => generated 3218 bytes in 11 msecs (HTTP/1.1 200) 6 headers in 232 bytes (2 switches on core 0) May 28 12:59:29 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-0aeca51a-1af7-4bc1-a2fb-270836af49e4 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] GET http://10.27.203.238/share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/messages?resource_id=3f890c77-5b7c-40a3-900d-99b36774b221 May 28 12:59:29 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-0aeca51a-1af7-4bc1-a2fb-270836af49e4 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:29 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-0aeca51a-1af7-4bc1-a2fb-270836af49e4 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:29 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.message.api [None req-0aeca51a-1af7-4bc1-a2fb-270836af49e4 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Searching for messages by: MultiDict([('resource_id', '3f890c77-5b7c-40a3-900d-99b36774b221')]) {{(pid=98329) get_all /opt/stack/manila/manila/message/api.py:78}} May 28 12:59:29 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-0aeca51a-1af7-4bc1-a2fb-270836af49e4 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] http://10.27.203.238/share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/messages?resource_id=3f890c77-5b7c-40a3-900d-99b36774b221 returned with HTTP 200 May 28 12:59:29 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 739/1464] 10.27.203.238 () {64 vars in 1443 bytes} [Tue May 28 12:59:29 2024] GET /share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/messages?resource_id=3f890c77-5b7c-40a3-900d-99b36774b221 => generated 815 bytes in 11 msecs (HTTP/1.1 200) 6 headers in 231 bytes (2 switches on core 0) May 28 12:59:29 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-048537c1-82f6-46d9-a098-a4b75082a779 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] DELETE http://10.27.203.238/share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/shares/daa12cac-d3f4-4eba-9040-13504d17378c May 28 12:59:29 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-048537c1-82f6-46d9-a098-a4b75082a779 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:29 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-048537c1-82f6-46d9-a098-a4b75082a779 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Calling method 'ShareMixin.delete' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:29 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.v1.shares [None req-048537c1-82f6-46d9-a098-a4b75082a779 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Delete share with id: daa12cac-d3f4-4eba-9040-13504d17378c May 28 12:59:29 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-3dd3e19c-48f5-4cf7-905c-4eda2683efd1 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] HTTP exception thrown: Share access ip:10.20.30.40 exists. May 28 12:59:29 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-3dd3e19c-48f5-4cf7-905c-4eda2683efd1 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action returned with HTTP 400 May 28 12:59:29 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 726/1465] 10.27.203.238 () {66 vars in 1493 bytes} [Tue May 28 12:59:29 2024] POST /share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action => generated 79 bytes in 36 msecs (HTTP/1.1 400) 6 headers in 239 bytes (1 switches on core 0) May 28 12:59:29 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-11207d0a-1610-44f9-8db4-b4694bdf7bac tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] POST http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action May 28 12:59:29 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-11207d0a-1610-44f9-8db4-b4694bdf7bac tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Action body: b'{"allow_access": {"access_type": "ip", "access_to": "10.20.30.40/32", "access_level": null}}' {{(pid=98330) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:59:29 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-11207d0a-1610-44f9-8db4-b4694bdf7bac tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Action: 'action', calling method: ShareController.allow_access, body: {"allow_access": {"access_type": "ip", "access_to": "10.20.30.40/32", "access_level": null}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:59:29 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-11207d0a-1610-44f9-8db4-b4694bdf7bac tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] HTTP exception thrown: Share access ip:10.20.30.40/32 exists. May 28 12:59:29 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-11207d0a-1610-44f9-8db4-b4694bdf7bac tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action returned with HTTP 400 May 28 12:59:29 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 727/1466] 10.27.203.238 () {66 vars in 1493 bytes} [Tue May 28 12:59:29 2024] POST /share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action => generated 82 bytes in 36 msecs (HTTP/1.1 400) 6 headers in 239 bytes (1 switches on core 0) May 28 12:59:29 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-82022991-02bd-49b6-a7c5-6e1cbdbff008 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] POST http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action May 28 12:59:29 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-82022991-02bd-49b6-a7c5-6e1cbdbff008 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Action body: b'{"deny_access": {"access_id": "610f3149-4f86-4f0d-ab7f-d42026c6f34d"}}' {{(pid=98330) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:59:29 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-82022991-02bd-49b6-a7c5-6e1cbdbff008 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Action: 'action', calling method: ShareController.deny_access, body: {"deny_access": {"access_id": "610f3149-4f86-4f0d-ab7f-d42026c6f34d"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:59:29 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.lock.api [None req-82022991-02bd-49b6-a7c5-6e1cbdbff008 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Searching for locks by: {'resource_id': '610f3149-4f86-4f0d-ab7f-d42026c6f34d', 'resource_action': 'delete'} {{(pid=98330) get_all /opt/stack/manila/manila/lock/api.py:112}} May 28 12:59:29 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-82022991-02bd-49b6-a7c5-6e1cbdbff008 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:29 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-82022991-02bd-49b6-a7c5-6e1cbdbff008 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:29 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-82022991-02bd-49b6-a7c5-6e1cbdbff008 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.038s {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:29 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-82022991-02bd-49b6-a7c5-6e1cbdbff008 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:29 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-82022991-02bd-49b6-a7c5-6e1cbdbff008 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:29 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.quota [None req-048537c1-82f6-46d9-a098-a4b75082a779 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Created reservations ['13cde04b-5c33-428a-8c2e-9c6b75c6ac8c', '596fff9f-90ed-472d-8402-5fccfb074e45', 'ff745e69-d1ef-4521-9044-f0fc0288efe3', '380bae6b-8881-47ef-9465-3c5e84bcf8ee'] {{(pid=98329) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 12:59:29 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.quota [None req-048537c1-82f6-46d9-a098-a4b75082a779 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Committed reservations ['13cde04b-5c33-428a-8c2e-9c6b75c6ac8c', '596fff9f-90ed-472d-8402-5fccfb074e45', 'ff745e69-d1ef-4521-9044-f0fc0288efe3', '380bae6b-8881-47ef-9465-3c5e84bcf8ee'] {{(pid=98329) commit /opt/stack/manila/manila/quota.py:1063}} May 28 12:59:29 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-048537c1-82f6-46d9-a098-a4b75082a779 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] http://10.27.203.238/share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/shares/daa12cac-d3f4-4eba-9040-13504d17378c returned with HTTP 202 May 28 12:59:29 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 740/1467] 10.27.203.238 () {64 vars in 1454 bytes} [Tue May 28 12:59:29 2024] DELETE /share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/shares/daa12cac-d3f4-4eba-9040-13504d17378c => generated 0 bytes in 207 msecs (HTTP/1.1 202) 6 headers in 243 bytes (2 switches on core 0) May 28 12:59:29 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-b82f631d-3839-4420-b184-a66dafc19d53 tempest-PublicSharesNegativeTest-1466961720 tempest-PublicSharesNegativeTest-1466961720-project-admin] GET http://10.27.203.238/share/v2/6e831d9989b1463da882ee355e32629c/shares/eb49a187-afee-4d13-b48a-a957d46fc910 May 28 12:59:29 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-b82f631d-3839-4420-b184-a66dafc19d53 tempest-PublicSharesNegativeTest-1466961720 tempest-PublicSharesNegativeTest-1466961720-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:29 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-b82f631d-3839-4420-b184-a66dafc19d53 tempest-PublicSharesNegativeTest-1466961720 tempest-PublicSharesNegativeTest-1466961720-project-admin] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:29 l75lg1-v1 nova-conductor[83647]: DEBUG dbcounter [-] [83647] Writing DB stats nova_cell1:UPDATE=4,nova_cell1:SELECT=3 {{(pid=83647) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:59:29 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-82022991-02bd-49b6-a7c5-6e1cbdbff008 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.056s {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:29 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-82022991-02bd-49b6-a7c5-6e1cbdbff008 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action returned with HTTP 202 May 28 12:59:29 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-b82f631d-3839-4420-b184-a66dafc19d53 tempest-PublicSharesNegativeTest-1466961720 tempest-PublicSharesNegativeTest-1466961720-project-admin] HTTP exception thrown: The resource could not be found. May 28 12:59:29 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 728/1468] 10.27.203.238 () {66 vars in 1493 bytes} [Tue May 28 12:59:29 2024] POST /share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action => generated 0 bytes in 172 msecs (HTTP/1.1 202) 6 headers in 243 bytes (2 switches on core 0) May 28 12:59:29 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-b82f631d-3839-4420-b184-a66dafc19d53 tempest-PublicSharesNegativeTest-1466961720 tempest-PublicSharesNegativeTest-1466961720-project-admin] http://10.27.203.238/share/v2/6e831d9989b1463da882ee355e32629c/shares/eb49a187-afee-4d13-b48a-a957d46fc910 returned with HTTP 404 May 28 12:59:29 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 741/1469] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:59:29 2024] GET /share/v2/6e831d9989b1463da882ee355e32629c/shares/eb49a187-afee-4d13-b48a-a957d46fc910 => generated 78 bytes in 13 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 12:59:29 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-2d55cf53-1a62-4d63-8abc-c2743cc422d2 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] DELETE http://10.27.203.238/share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/shares/3f890c77-5b7c-40a3-900d-99b36774b221 May 28 12:59:29 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-2d55cf53-1a62-4d63-8abc-c2743cc422d2 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:29 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-2d55cf53-1a62-4d63-8abc-c2743cc422d2 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Calling method 'ShareMixin.delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:29 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.v1.shares [None req-2d55cf53-1a62-4d63-8abc-c2743cc422d2 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Delete share with id: 3f890c77-5b7c-40a3-900d-99b36774b221 May 28 12:59:29 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-546a00ca-9f70-4830-9837-4f883922f9d6 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] GET http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/share-access-rules?share_id=72db8769-ece7-42ff-af27-2e778292a9b4 May 28 12:59:29 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-546a00ca-9f70-4830-9837-4f883922f9d6 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:29 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-546a00ca-9f70-4830-9837-4f883922f9d6 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:29 l75lg1-v1 manila-share[98474]: DEBUG manila.share.manager [None req-82022991-02bd-49b6-a7c5-6e1cbdbff008 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Received request to update access for share instance 7fdd602c-79d0-479c-95a2-336b202c6639. {{(pid=98474) update_access_for_instances /opt/stack/manila/manila/share/manager.py:4353}} May 28 12:59:29 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.lock.api [None req-546a00ca-9f70-4830-9837-4f883922f9d6 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Searching for locks by: {'resource_id': '610f3149-4f86-4f0d-ab7f-d42026c6f34d', 'resource_action': 'show', 'resource_type': 'access_rule'} {{(pid=98329) get_all /opt/stack/manila/manila/lock/api.py:112}} May 28 12:59:29 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-82022991-02bd-49b6-a7c5-6e1cbdbff008 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:29 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-82022991-02bd-49b6-a7c5-6e1cbdbff008 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:29 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-546a00ca-9f70-4830-9837-4f883922f9d6 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/share-access-rules?share_id=72db8769-ece7-42ff-af27-2e778292a9b4 returned with HTTP 200 May 28 12:59:29 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 742/1470] 10.27.203.238 () {64 vars in 1467 bytes} [Tue May 28 12:59:29 2024] GET /share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/share-access-rules?share_id=72db8769-ece7-42ff-af27-2e778292a9b4 => generated 287 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 231 bytes (2 switches on core 0) May 28 12:59:29 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-82022991-02bd-49b6-a7c5-6e1cbdbff008 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:29 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-82022991-02bd-49b6-a7c5-6e1cbdbff008 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:29 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-82022991-02bd-49b6-a7c5-6e1cbdbff008 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:29 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-b27bd651-e2ba-4fb3-bc18-8060e9124056 tempest-PublicSharesNegativeTest-1466961720 tempest-PublicSharesNegativeTest-1466961720-project-admin] DELETE http://10.27.203.238/share/v2/6e831d9989b1463da882ee355e32629c/types/6f6c32d7-68c2-4369-a308-7bdbd4653be4 May 28 12:59:29 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-b27bd651-e2ba-4fb3-bc18-8060e9124056 tempest-PublicSharesNegativeTest-1466961720 tempest-PublicSharesNegativeTest-1466961720-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:29 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-b27bd651-e2ba-4fb3-bc18-8060e9124056 tempest-PublicSharesNegativeTest-1466961720 tempest-PublicSharesNegativeTest-1466961720-project-admin] Calling method 'ShareTypesController._delete' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:29 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bf023d15-ebb0-49d9-9673-6dd45afdd77f tempest-ShareIpRulesForNFSTest-1748669711 None] <<< [PATCH] https://127.0.0.1:40443/api/viewpolicies/21/ May 28 12:59:29 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bf023d15-ebb0-49d9-9673-6dd45afdd77f tempest-ShareIpRulesForNFSTest-1748669711 None] Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=1, created='2024-05-28T12:57:40.763635Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='377955ad-d094-4e49-ab32-1021d943a572', id=21, internal=False, is_s3_default_policy=False, name='b7a7d61c-2cea-442a-9809-507038e080d5', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=['*'], nfs_posix_acl=False, nfs_read_only=['2.2.2.2'], nfs_read_write=[], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=['2.2.2.2'], read_write=[], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='MODIFYING', sync_time='2024-05-28T12:59:29.280225Z', tenant_id=1, tenant_name='default', title='b7a7d61c-2cea-442a-9809-507038e080d5', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/21/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[]) May 28 12:59:29 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bf023d15-ebb0-49d9-9673-6dd45afdd77f tempest-ShareIpRulesForNFSTest-1748669711 None] --- [PATCH] https://127.0.0.1:40443/api/viewpolicies/21/: Done May 28 12:59:29 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-bf023d15-ebb0-49d9-9673-6dd45afdd77f tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:29 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-bf023d15-ebb0-49d9-9673-6dd45afdd77f tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:29 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-b27bd651-e2ba-4fb3-bc18-8060e9124056 tempest-PublicSharesNegativeTest-1466961720 tempest-PublicSharesNegativeTest-1466961720-project-admin] http://10.27.203.238/share/v2/6e831d9989b1463da882ee355e32629c/types/6f6c32d7-68c2-4369-a308-7bdbd4653be4 returned with HTTP 202 May 28 12:59:29 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 743/1471] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:59:29 2024] DELETE /share/v2/6e831d9989b1463da882ee355e32629c/types/6f6c32d7-68c2-4369-a308-7bdbd4653be4 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:59:29 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-44ee8812-f4a0-4d45-b300-3fb25aeed7f0 tempest-PublicSharesNegativeTest-1466961720 tempest-PublicSharesNegativeTest-1466961720-project-admin] GET http://10.27.203.238/share/v2/6e831d9989b1463da882ee355e32629c/types/6f6c32d7-68c2-4369-a308-7bdbd4653be4 May 28 12:59:29 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-44ee8812-f4a0-4d45-b300-3fb25aeed7f0 tempest-PublicSharesNegativeTest-1466961720 tempest-PublicSharesNegativeTest-1466961720-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:29 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-44ee8812-f4a0-4d45-b300-3fb25aeed7f0 tempest-PublicSharesNegativeTest-1466961720 tempest-PublicSharesNegativeTest-1466961720-project-admin] Calling method 'ShareTypesController.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:29 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-44ee8812-f4a0-4d45-b300-3fb25aeed7f0 tempest-PublicSharesNegativeTest-1466961720 tempest-PublicSharesNegativeTest-1466961720-project-admin] HTTP exception thrown: Share type not found. May 28 12:59:29 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-44ee8812-f4a0-4d45-b300-3fb25aeed7f0 tempest-PublicSharesNegativeTest-1466961720 tempest-PublicSharesNegativeTest-1466961720-project-admin] http://10.27.203.238/share/v2/6e831d9989b1463da882ee355e32629c/types/6f6c32d7-68c2-4369-a308-7bdbd4653be4 returned with HTTP 404 May 28 12:59:29 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 744/1472] 10.27.203.238 () {64 vars in 1448 bytes} [Tue May 28 12:59:29 2024] GET /share/v2/6e831d9989b1463da882ee355e32629c/types/6f6c32d7-68c2-4369-a308-7bdbd4653be4 => generated 67 bytes in 11 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 12:59:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ad8a9a-568d-42b0-b0f2-b3e6b0273157 tempest-PublicSharesNegativeTest-1466961720 tempest-PublicSharesNegativeTest-1466961720-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-85ad8a9a-568d-42b0-b0f2-b3e6b0273157 tempest-PublicSharesNegativeTest-1466961720 tempest-PublicSharesNegativeTest-1466961720-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:59:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ad8a9a-568d-42b0-b0f2-b3e6b0273157 tempest-PublicSharesNegativeTest-1466961720 tempest-PublicSharesNegativeTest-1466961720-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7960c8-163e-4b2b-b8e0-fc6b6a0f983b None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7960c8-163e-4b2b-b8e0-fc6b6a0f983b None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7960c8-163e-4b2b-b8e0-fc6b6a0f983b None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7960c8-163e-4b2b-b8e0-fc6b6a0f983b None admin] PATH_INFO: `/v3/users/ac6096f007544d4d84acaf218e85ceb4` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7960c8-163e-4b2b-b8e0-fc6b6a0f983b None admin] RBAC: Authorizing `identity:delete_user(user_id=ac6096f007544d4d84acaf218e85ceb4)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7960c8-163e-4b2b-b8e0-fc6b6a0f983b None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:29 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-82022991-02bd-49b6-a7c5-6e1cbdbff008 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.102s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:29 l75lg1-v1 manila-share[98474]: DEBUG manila.share.access [None req-82022991-02bd-49b6-a7c5-6e1cbdbff008 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Updating access rules for share instance 7fdd602c-79d0-479c-95a2-336b202c6639 belonging to share 72db8769-ece7-42ff-af27-2e778292a9b4. {{(pid=98474) update_access_rules /opt/stack/manila/manila/share/access.py:298}} May 28 12:59:29 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-bf023d15-ebb0-49d9-9673-6dd45afdd77f tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.099s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:29 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-bf023d15-ebb0-49d9-9673-6dd45afdd77f tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:29 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-bf023d15-ebb0-49d9-9673-6dd45afdd77f tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:29 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-bf023d15-ebb0-49d9-9673-6dd45afdd77f tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:29 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-bf023d15-ebb0-49d9-9673-6dd45afdd77f tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:29 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-bf023d15-ebb0-49d9-9673-6dd45afdd77f tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:29 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b3e7547a-dff0-4eb2-b72d-1538064bf1f1 tempest-ResourceLockDeleteTest-1157183439 None] <<< [DELETE] https://127.0.0.1:40443/api/views/35/ May 28 12:59:29 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b3e7547a-dff0-4eb2-b72d-1538064bf1f1 tempest-ResourceLockDeleteTest-1157183439 None] --- [DELETE] https://127.0.0.1:40443/api/views/35/: Done May 28 12:59:29 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b3e7547a-dff0-4eb2-b72d-1538064bf1f1 tempest-ResourceLockDeleteTest-1157183439 None] >>> [GET] https://127.0.0.1:40443/api/quotas/ May 28 12:59:29 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b3e7547a-dff0-4eb2-b72d-1538064bf1f1 tempest-ResourceLockDeleteTest-1157183439 None] {'allow_redirects': True, May 28 12:59:29 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b3e7547a-dff0-4eb2-b72d-1538064bf1f1 tempest-ResourceLockDeleteTest-1157183439 None] 'params': {'name': 'b16b1d63-ae6f-4f71-846e-84edd63a87f6'}} May 28 12:59:29 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-bf023d15-ebb0-49d9-9673-6dd45afdd77f tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.016s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:29 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-bf023d15-ebb0-49d9-9673-6dd45afdd77f tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:29 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-bf023d15-ebb0-49d9-9673-6dd45afdd77f tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:29 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-82022991-02bd-49b6-a7c5-6e1cbdbff008 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:29 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-82022991-02bd-49b6-a7c5-6e1cbdbff008 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-7b7960c8-163e-4b2b-b8e0-fc6b6a0f983b None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac6096f007544d4d84acaf218e85ceb4', 'request_id': 'req-7b7960c8-163e-4b2b-b8e0-fc6b6a0f983b'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-7b7960c8-163e-4b2b-b8e0-fc6b6a0f983b None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac6096f007544d4d84acaf218e85ceb4', 'request_id': 'req-7b7960c8-163e-4b2b-b8e0-fc6b6a0f983b'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:29 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.quota [None req-2d55cf53-1a62-4d63-8abc-c2743cc422d2 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Created reservations ['2026fc64-ae23-4bb7-a426-e70878266e1b', '6ab10926-bbc6-4ea1-a503-7ec9b025f5ad', '8e06a732-cb14-4d67-86f3-8331f553c5bb', 'e3fd4f32-0305-4cd5-8c12-fa1584b0038b'] {{(pid=98330) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 12:59:29 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-82022991-02bd-49b6-a7c5-6e1cbdbff008 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.007s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:29 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-82022991-02bd-49b6-a7c5-6e1cbdbff008 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:29 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-82022991-02bd-49b6-a7c5-6e1cbdbff008 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:29 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-bf023d15-ebb0-49d9-9673-6dd45afdd77f tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.013s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:29 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-bf023d15-ebb0-49d9-9673-6dd45afdd77f tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:29 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-bf023d15-ebb0-49d9-9673-6dd45afdd77f tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-7b7960c8-163e-4b2b-b8e0-fc6b6a0f983b None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac6096f007544d4d84acaf218e85ceb4', 'request_id': 'req-7b7960c8-163e-4b2b-b8e0-fc6b6a0f983b'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-7b7960c8-163e-4b2b-b8e0-fc6b6a0f983b None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac6096f007544d4d84acaf218e85ceb4', 'request_id': 'req-7b7960c8-163e-4b2b-b8e0-fc6b6a0f983b'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-7b7960c8-163e-4b2b-b8e0-fc6b6a0f983b None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac6096f007544d4d84acaf218e85ceb4', 'request_id': 'req-7b7960c8-163e-4b2b-b8e0-fc6b6a0f983b'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:29 l75lg1-v1 nova-conductor[83648]: DEBUG dbcounter [-] [83648] Writing DB stats nova_cell1:SELECT=1 {{(pid=83648) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:59:29 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.quota [None req-2d55cf53-1a62-4d63-8abc-c2743cc422d2 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Committed reservations ['2026fc64-ae23-4bb7-a426-e70878266e1b', '6ab10926-bbc6-4ea1-a503-7ec9b025f5ad', '8e06a732-cb14-4d67-86f3-8331f553c5bb', 'e3fd4f32-0305-4cd5-8c12-fa1584b0038b'] {{(pid=98330) commit /opt/stack/manila/manila/quota.py:1063}} May 28 12:59:29 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1222/2469] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 12:59:29 2024] DELETE /identity/v3/users/ac6096f007544d4d84acaf218e85ceb4 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:59:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7714c72a-e076-4126-9d8d-974ac266ec82 service manila] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:29 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-2d55cf53-1a62-4d63-8abc-c2743cc422d2 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] http://10.27.203.238/share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/shares/3f890c77-5b7c-40a3-900d-99b36774b221 returned with HTTP 202 May 28 12:59:29 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 729/1473] 10.27.203.238 () {64 vars in 1454 bytes} [Tue May 28 12:59:29 2024] DELETE /share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/shares/3f890c77-5b7c-40a3-900d-99b36774b221 => generated 0 bytes in 235 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:59:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7714c72a-e076-4126-9d8d-974ac266ec82 service manila] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:30 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-efe0ca77-fa7c-491b-bf37-eec3be815852 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] POST http://10.27.203.238/share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/types May 28 12:59:30 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-82022991-02bd-49b6-a7c5-6e1cbdbff008 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.043s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:30 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-82022991-02bd-49b6-a7c5-6e1cbdbff008 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] changing access on None May 28 12:59:30 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-efe0ca77-fa7c-491b-bf37-eec3be815852 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share_type": {"name": "tempest-share-type-1938624407", "extra_specs": {"driver_handles_share_servers": false, "vendor_name": "foobar"}, "share_type_access:is_public": true}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:59:30 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-82022991-02bd-49b6-a7c5-6e1cbdbff008 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:59:30 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-82022991-02bd-49b6-a7c5-6e1cbdbff008 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] {'allow_redirects': True, May 28 12:59:30 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-82022991-02bd-49b6-a7c5-6e1cbdbff008 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] 'params': {'name': '7fdd602c-79d0-479c-95a2-336b202c6639'}} May 28 12:59:30 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-bf023d15-ebb0-49d9-9673-6dd45afdd77f tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.057s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:30 l75lg1-v1 manila-share[98474]: INFO manila.share.access [None req-bf023d15-ebb0-49d9-9673-6dd45afdd77f tempest-ShareIpRulesForNFSTest-1748669711 None] Access rules were successfully modified for share instance b7a7d61c-2cea-442a-9809-507038e080d5 belonging to share 1ddadc17-cf10-4a42-8bbd-8335fb3520a1. May 28 12:59:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca612184-ed81-4d19-a38f-b481a12a6c91 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca612184-ed81-4d19-a38f-b481a12a6c91 None admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca612184-ed81-4d19-a38f-b481a12a6c91 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca612184-ed81-4d19-a38f-b481a12a6c91 None admin] PATH_INFO: `/v3/users/2115eda170ff4b14bb198e46b523fb81` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca612184-ed81-4d19-a38f-b481a12a6c91 None admin] RBAC: Authorizing `identity:delete_user(user_id=2115eda170ff4b14bb198e46b523fb81)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca612184-ed81-4d19-a38f-b481a12a6c91 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:30 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-efe0ca77-fa7c-491b-bf37-eec3be815852 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] http://10.27.203.238/share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/types returned with HTTP 200 May 28 12:59:30 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 745/1474] 10.27.203.238 () {66 vars in 1359 bytes} [Tue May 28 12:59:30 2024] POST /share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/types => generated 661 bytes in 30 msecs (HTTP/1.1 200) 6 headers in 231 bytes (2 switches on core 0) May 28 12:59:30 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-5eb466a4-eb2f-4def-9e5c-dbcbc3d53d75 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] POST http://10.27.203.238/share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/shares May 28 12:59:30 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-5eb466a4-eb2f-4def-9e5c-dbcbc3d53d75 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share": {"share_proto": "nfs", "description": "tempest-tempest-created-share-desc-1563957111", "snapshot_id": null, "name": "tempest-tempest-created-share-385090178", "size": 1, "metadata": {}, "is_public": false, "share_type": "4cb71112-8c21-4a60-9f4a-e7939e3a25b1"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:59:30 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.v1.shares [None req-5eb466a4-eb2f-4def-9e5c-dbcbc3d53d75 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Create NFS share of 1 GB May 28 12:59:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-ca612184-ed81-4d19-a38f-b481a12a6c91 None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2115eda170ff4b14bb198e46b523fb81', 'request_id': 'req-ca612184-ed81-4d19-a38f-b481a12a6c91'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-ca612184-ed81-4d19-a38f-b481a12a6c91 None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2115eda170ff4b14bb198e46b523fb81', 'request_id': 'req-ca612184-ed81-4d19-a38f-b481a12a6c91'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-ca612184-ed81-4d19-a38f-b481a12a6c91 None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2115eda170ff4b14bb198e46b523fb81', 'request_id': 'req-ca612184-ed81-4d19-a38f-b481a12a6c91'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-ca612184-ed81-4d19-a38f-b481a12a6c91 None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2115eda170ff4b14bb198e46b523fb81', 'request_id': 'req-ca612184-ed81-4d19-a38f-b481a12a6c91'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-ca612184-ed81-4d19-a38f-b481a12a6c91 None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2115eda170ff4b14bb198e46b523fb81', 'request_id': 'req-ca612184-ed81-4d19-a38f-b481a12a6c91'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:30 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1248/2470] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 12:59:29 2024] DELETE /identity/v3/users/2115eda170ff4b14bb198e46b523fb81 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:59:30 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.quota [None req-5eb466a4-eb2f-4def-9e5c-dbcbc3d53d75 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Created reservations ['1896a6e4-91f8-49b6-98c0-11b479c5387e', '8e16e2b1-bc1a-4ea0-bc68-0a27066b0c0d', 'aae078d6-fbaa-4836-95b0-e7f994b205ed', 'f57c27d9-6fc0-40a0-b5f4-1920e49b49b2'] {{(pid=98330) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 12:59:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7960c8-163e-4b2b-b8e0-fc6b6a0f983b None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-7b7960c8-163e-4b2b-b8e0-fc6b6a0f983b None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:59:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7960c8-163e-4b2b-b8e0-fc6b6a0f983b None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:30 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-db5263d2-3bd9-40f2-af7a-658a727d50fc tempest-ResourceLockDeleteTest-1157183439 tempest-ResourceLockDeleteTest-1157183439-project-member] GET http://10.27.203.238/share/v2/645fb190404541a78e449c703540d6f8/shares/2de4a970-0a05-4094-bdb1-ff3d4f9d20d2 May 28 12:59:30 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-db5263d2-3bd9-40f2-af7a-658a727d50fc tempest-ResourceLockDeleteTest-1157183439 tempest-ResourceLockDeleteTest-1157183439-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:30 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-db5263d2-3bd9-40f2-af7a-658a727d50fc tempest-ResourceLockDeleteTest-1157183439 tempest-ResourceLockDeleteTest-1157183439-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:30 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-db5263d2-3bd9-40f2-af7a-658a727d50fc tempest-ResourceLockDeleteTest-1157183439 tempest-ResourceLockDeleteTest-1157183439-project-member] http://10.27.203.238/share/v2/645fb190404541a78e449c703540d6f8/shares/2de4a970-0a05-4094-bdb1-ff3d4f9d20d2 returned with HTTP 200 May 28 12:59:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666e6eaf-5bc6-458e-92ce-9724d87fbae9 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666e6eaf-5bc6-458e-92ce-9724d87fbae9 None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666e6eaf-5bc6-458e-92ce-9724d87fbae9 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666e6eaf-5bc6-458e-92ce-9724d87fbae9 None admin] PATH_INFO: `/v3/users/dc37d1e963824f408d8df368c962d64f` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:30 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 746/1475] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:59:30 2024] GET /share/v2/645fb190404541a78e449c703540d6f8/shares/2de4a970-0a05-4094-bdb1-ff3d4f9d20d2 => generated 1315 bytes in 26 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:59:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666e6eaf-5bc6-458e-92ce-9724d87fbae9 None admin] RBAC: Authorizing `identity:delete_user(user_id=dc37d1e963824f408d8df368c962d64f)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666e6eaf-5bc6-458e-92ce-9724d87fbae9 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:30 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.quota [None req-5eb466a4-eb2f-4def-9e5c-dbcbc3d53d75 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Committed reservations ['1896a6e4-91f8-49b6-98c0-11b479c5387e', '8e16e2b1-bc1a-4ea0-bc68-0a27066b0c0d', 'aae078d6-fbaa-4836-95b0-e7f994b205ed', 'f57c27d9-6fc0-40a0-b5f4-1920e49b49b2'] {{(pid=98330) commit /opt/stack/manila/manila/quota.py:1063}} May 28 12:59:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-666e6eaf-5bc6-458e-92ce-9724d87fbae9 None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc37d1e963824f408d8df368c962d64f', 'request_id': 'req-666e6eaf-5bc6-458e-92ce-9724d87fbae9'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-666e6eaf-5bc6-458e-92ce-9724d87fbae9 None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc37d1e963824f408d8df368c962d64f', 'request_id': 'req-666e6eaf-5bc6-458e-92ce-9724d87fbae9'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-666e6eaf-5bc6-458e-92ce-9724d87fbae9 None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc37d1e963824f408d8df368c962d64f', 'request_id': 'req-666e6eaf-5bc6-458e-92ce-9724d87fbae9'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-666e6eaf-5bc6-458e-92ce-9724d87fbae9 None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc37d1e963824f408d8df368c962d64f', 'request_id': 'req-666e6eaf-5bc6-458e-92ce-9724d87fbae9'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-666e6eaf-5bc6-458e-92ce-9724d87fbae9 None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc37d1e963824f408d8df368c962d64f', 'request_id': 'req-666e6eaf-5bc6-458e-92ce-9724d87fbae9'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:30 l75lg1-v1 manila-scheduler[98327]: DEBUG dbcounter [-] [98327] Writing DB stats manila:SELECT=149,manila:UPDATE=18,manila:INSERT=5 {{(pid=98327) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:59:30 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.host_manager [None req-5eb466a4-eb2f-4def-9e5c-dbcbc3d53d75 tempest-UserMessageTest-1084663522 None] Share service is down. (host: l75lg1-v1@generic2). May 28 12:59:30 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.host_manager [None req-5eb466a4-eb2f-4def-9e5c-dbcbc3d53d75 tempest-UserMessageTest-1084663522 None] Share service is down. (host: l75lg1-v1@generic1). May 28 12:59:30 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-5eb466a4-eb2f-4def-9e5c-dbcbc3d53d75 tempest-UserMessageTest-1084663522 None] Starting with 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:80}} May 28 12:59:30 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-5eb466a4-eb2f-4def-9e5c-dbcbc3d53d75 tempest-UserMessageTest-1084663522 None] Filter OnlyHostFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:59:30 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-5eb466a4-eb2f-4def-9e5c-dbcbc3d53d75 tempest-UserMessageTest-1084663522 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:59:30 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.capacity [None req-5eb466a4-eb2f-4def-9e5c-dbcbc3d53d75 tempest-UserMessageTest-1084663522 None] Space information for share creation on host l75lg1-v1@vast#vast (requested / avail): 1/2078 {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/capacity.py:83}} May 28 12:59:30 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-5eb466a4-eb2f-4def-9e5c-dbcbc3d53d75 tempest-UserMessageTest-1084663522 None] Filter CapacityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:59:30 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.utils [None req-5eb466a4-eb2f-4def-9e5c-dbcbc3d53d75 tempest-UserMessageTest-1084663522 None] Share type extra spec requirement "vendor_name=foobar" does not match reported capability "VAST STORAGE" {{(pid=98327) capabilities_satisfied /opt/stack/manila/manila/scheduler/utils.py:185}} May 28 12:59:30 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.capabilities [None req-5eb466a4-eb2f-4def-9e5c-dbcbc3d53d75 tempest-UserMessageTest-1084663522 None] host: 'l75lg1-v1@vast#vast', free_capacity_gb: 2078.64910808485, pools: None fails resource_type extra_specs requirements {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/capabilities.py:45}} May 28 12:59:30 l75lg1-v1 manila-scheduler[98327]: INFO manila.scheduler.filters.base [None req-5eb466a4-eb2f-4def-9e5c-dbcbc3d53d75 tempest-UserMessageTest-1084663522 None] Filter CapabilitiesFilter returned 0 host(s) May 28 12:59:30 l75lg1-v1 manila-scheduler[98327]: ERROR manila.scheduler.manager [None req-5eb466a4-eb2f-4def-9e5c-dbcbc3d53d75 tempest-UserMessageTest-1084663522 None] Failed to schedule create_share: No valid host was found. Failed to find a weighted host, the last executed filter was CapabilitiesFilter.: manila.exception.NoValidHost: No valid host was found. Failed to find a weighted host, the last executed filter was CapabilitiesFilter. May 28 12:59:30 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-5eb466a4-eb2f-4def-9e5c-dbcbc3d53d75 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] http://10.27.203.238/share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/shares returned with HTTP 200 May 28 12:59:30 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 730/1476] 10.27.203.238 () {66 vars in 1362 bytes} [Tue May 28 12:59:30 2024] POST /share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/shares => generated 1372 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:59:30 l75lg1-v1 dstat.sh[49771]: 28-05 12:59:30| 16 1 78 3 0|5740M 1730M 277M 7878M| 14k 5228B| 0 2430k| 0 413 |8218 14k|1.12 1.05 1.01|4.0 2.0 1.0| 0 0 | 0 2048M| 29 365 0 30 0 May 28 12:59:30 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1223/2471] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 12:59:30 2024] DELETE /identity/v3/users/dc37d1e963824f408d8df368c962d64f => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:59:30 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-f742bb17-581b-48e3-a77c-be7f3e88ac1b tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] GET http://10.27.203.238/share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/shares/8c461c9a-d030-496e-b267-c05fe4731b2f May 28 12:59:30 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-f742bb17-581b-48e3-a77c-be7f3e88ac1b tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de69e714-8652-48ab-9268-eb9714206d06 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de69e714-8652-48ab-9268-eb9714206d06 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de69e714-8652-48ab-9268-eb9714206d06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:30 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-f742bb17-581b-48e3-a77c-be7f3e88ac1b tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:30 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-de69e714-8652-48ab-9268-eb9714206d06 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:59:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-de69e714-8652-48ab-9268-eb9714206d06 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:59:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-de69e714-8652-48ab-9268-eb9714206d06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:59:30 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-f742bb17-581b-48e3-a77c-be7f3e88ac1b tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] http://10.27.203.238/share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/shares/8c461c9a-d030-496e-b267-c05fe4731b2f returned with HTTP 200 May 28 12:59:30 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 747/1477] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:59:30 2024] GET /share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/shares/8c461c9a-d030-496e-b267-c05fe4731b2f => generated 1372 bytes in 31 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:59:30 l75lg1-v1 manila-scheduler[98327]: INFO manila.message.api [None req-5eb466a4-eb2f-4def-9e5c-dbcbc3d53d75 tempest-UserMessageTest-1084663522 None] Creating message record for request_id = req-5eb466a4-eb2f-4def-9e5c-dbcbc3d53d75 May 28 12:59:30 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1249/2472] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:59:30 2024] POST /identity/v3/auth/tokens => generated 2960 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 12:59:30 l75lg1-v1 neutron-server[77619]: DEBUG neutron.wsgi [-] (77619) accepted ('10.27.203.238', 35884) {{(pid=77619) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 12:59:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666e6eaf-5bc6-458e-92ce-9724d87fbae9 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-666e6eaf-5bc6-458e-92ce-9724d87fbae9 None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:59:30 l75lg1-v1 neutron-server[77618]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.HashRingHealthCheckPeriodics.touch_hash_ring_nodes' {{(pid=77618) _process_scheduled /opt/stack/data/venv/lib/python3.10/site-packages/futurist/periodics.py:638}} May 28 12:59:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666e6eaf-5bc6-458e-92ce-9724d87fbae9 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a055f8-b531-4ff9-b9b7-09fab80f4824 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef17047035e4b518fd5360a01f2da1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a055f8-b531-4ff9-b9b7-09fab80f4824 service neutron] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a055f8-b531-4ff9-b9b7-09fab80f4824 service neutron] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a055f8-b531-4ff9-b9b7-09fab80f4824 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a055f8-b531-4ff9-b9b7-09fab80f4824 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a055f8-b531-4ff9-b9b7-09fab80f4824 service neutron] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:30 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1224/2473] 10.27.203.238 () {64 vars in 1432 bytes} [Tue May 28 12:59:30 2024] GET /identity/v3/auth/tokens => generated 2960 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 28 12:59:30 l75lg1-v1 neutron-server[77619]: INFO neutron.wsgi [None req-43cacf9d-1695-4c85-9de0-dafdf51a03cd None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=87f1228e3b494ac1a895d7e6f466fa4b&name=default HTTP/1.1" status: 200 len: 216 time: 0.0732329 May 28 12:59:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de69e714-8652-48ab-9268-eb9714206d06 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-de69e714-8652-48ab-9268-eb9714206d06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:59:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de69e714-8652-48ab-9268-eb9714206d06 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137621e7-b1da-4790-a2b2-a32e07e0729b None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137621e7-b1da-4790-a2b2-a32e07e0729b None admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137621e7-b1da-4790-a2b2-a32e07e0729b None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137621e7-b1da-4790-a2b2-a32e07e0729b None admin] PATH_INFO: `/v3/projects/87f1228e3b494ac1a895d7e6f466fa4b` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137621e7-b1da-4790-a2b2-a32e07e0729b None admin] RBAC: Authorizing `identity:delete_project(project_id=87f1228e3b494ac1a895d7e6f466fa4b)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137621e7-b1da-4790-a2b2-a32e07e0729b None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:30 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-82022991-02bd-49b6-a7c5-6e1cbdbff008 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:59:30 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-82022991-02bd-49b6-a7c5-6e1cbdbff008 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] [Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=1, created='2024-05-28T12:58:43.845440Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='31b6534b-d142-4561-992f-4f0759db302d', id=32, internal=False, is_s3_default_policy=False, name='7fdd602c-79d0-479c-95a2-336b202c6639', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=['*'], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['10.20.30.40'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['10.20.30.40'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T12:59:28.760067Z', tenant_id=1, tenant_name='default', title='7fdd602c-79d0-479c-95a2-336b202c6639', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/32/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[])] May 28 12:59:30 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-82022991-02bd-49b6-a7c5-6e1cbdbff008 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 12:59:30 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-82022991-02bd-49b6-a7c5-6e1cbdbff008 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] changing access on /manila/manila-7fdd602c-79d0-479c-95a2-336b202c6639. Rules: {'nfs_read_write': [], 'nfs_read_only': []} May 28 12:59:30 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-82022991-02bd-49b6-a7c5-6e1cbdbff008 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] >>> [PATCH] https://127.0.0.1:40443/api/viewpolicies/32/ May 28 12:59:30 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-82022991-02bd-49b6-a7c5-6e1cbdbff008 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] {'data': '{"name": "7fdd602c-79d0-479c-95a2-336b202c6639", "nfs_no_squash": ' May 28 12:59:30 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-82022991-02bd-49b6-a7c5-6e1cbdbff008 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] '["*"], "nfs_root_squash": ["*"], "nfs_read_write": [], ' May 28 12:59:30 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-82022991-02bd-49b6-a7c5-6e1cbdbff008 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] '"nfs_read_only": []}', May 28 12:59:30 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-82022991-02bd-49b6-a7c5-6e1cbdbff008 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] 'params': None} May 28 12:59:30 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b3e7547a-dff0-4eb2-b72d-1538064bf1f1 tempest-ResourceLockDeleteTest-1157183439 None] <<< [GET] https://127.0.0.1:40443/api/quotas/ May 28 12:59:30 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-f4cc657a-1de7-4147-87e3-b65c14ff8364 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] POST http://10.27.203.238/share/v2/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action May 28 12:59:30 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b3e7547a-dff0-4eb2-b72d-1538064bf1f1 tempest-ResourceLockDeleteTest-1157183439 None] [Bunch(cluster='loop75-kfs', cluster_id=1, default_email=None, default_group_quota=None, default_user_quota=None, enable_alarms=True, enable_email_providers=True, grace_period=None, guid='b5dc601e-2286-4bbf-b81f-427edc9349a7', hard_limit=1073741824, hard_limit_inodes=None, id=33, internal=False, is_user_quota=False, last_user_quotas_update=None, name='b16b1d63-ae6f-4f71-846e-84edd63a87f6', num_blocked_users=0, num_exceeded_users=0, path='/manila/manila-b16b1d63-ae6f-4f71-846e-84edd63a87f6', percent_capacity=0, percent_inodes=None, pretty_grace_period=None, pretty_grace_period_expiration=None, pretty_state='OK (CREATED)', soft_limit=None, soft_limit_inodes=None, state='OK', sync_state='CREATED', system_id=33, tenant_id=1, tenant_name='default', time_to_block=None, title='b16b1d63-ae6f-4f71-846e-84edd63a87f6', url='https://127.0.0.1:40443/api/quotas/33/', used_capacity=0, used_capacity_tb=0.0, used_effective_capacity=0, used_effective_capacity_tb=0.0, used_inodes=0, used_limited_capacity=0)] May 28 12:59:30 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b3e7547a-dff0-4eb2-b72d-1538064bf1f1 tempest-ResourceLockDeleteTest-1157183439 None] --- [GET] https://127.0.0.1:40443/api/quotas/: Done May 28 12:59:30 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-f4cc657a-1de7-4147-87e3-b65c14ff8364 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Action body: b'{"access_list": null}' {{(pid=98330) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:59:30 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b3e7547a-dff0-4eb2-b72d-1538064bf1f1 tempest-ResourceLockDeleteTest-1157183439 None] >>> [DELETE] https://127.0.0.1:40443/api/quotas/33/ May 28 12:59:30 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-f4cc657a-1de7-4147-87e3-b65c14ff8364 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Action: 'action', calling method: ShareController.access_list, body: {"access_list": null} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:59:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-137621e7-b1da-4790-a2b2-a32e07e0729b None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87f1228e3b494ac1a895d7e6f466fa4b', 'request_id': 'req-137621e7-b1da-4790-a2b2-a32e07e0729b'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-137621e7-b1da-4790-a2b2-a32e07e0729b None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87f1228e3b494ac1a895d7e6f466fa4b', 'request_id': 'req-137621e7-b1da-4790-a2b2-a32e07e0729b'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-137621e7-b1da-4790-a2b2-a32e07e0729b None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87f1228e3b494ac1a895d7e6f466fa4b', 'request_id': 'req-137621e7-b1da-4790-a2b2-a32e07e0729b'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-137621e7-b1da-4790-a2b2-a32e07e0729b None admin] The token cache is being invalidate because project 87f1228e3b494ac1a895d7e6f466fa4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 12:59:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-137621e7-b1da-4790-a2b2-a32e07e0729b None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-137621e7-b1da-4790-a2b2-a32e07e0729b None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:30 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1250/2474] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 12:59:30 2024] DELETE /identity/v3/projects/87f1228e3b494ac1a895d7e6f466fa4b => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:59:30 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-f4cc657a-1de7-4147-87e3-b65c14ff8364 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] http://10.27.203.238/share/v2/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action returned with HTTP 200 May 28 12:59:30 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 731/1478] 10.27.203.238 () {66 vars in 1493 bytes} [Tue May 28 12:59:30 2024] POST /share/v2/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action => generated 171 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:59:30 l75lg1-v1 neutron-server[77618]: DEBUG neutron.wsgi [-] (77618) accepted ('10.27.203.238', 35900) {{(pid=77618) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 12:59:30 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-83169fec-9805-48a5-96cd-e2a4edcf98d8 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] GET http://10.27.203.238/share/v2/776f75906bc64f8f9316d5aab4b50bf1/share-access-rules?share_id=1ddadc17-cf10-4a42-8bbd-8335fb3520a1 May 28 12:59:30 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-83169fec-9805-48a5-96cd-e2a4edcf98d8 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:30 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-83169fec-9805-48a5-96cd-e2a4edcf98d8 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:30 l75lg1-v1 neutron-server[77618]: INFO neutron.wsgi [None req-de00aa26-3c80-4052-ba28-88296ece90aa None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=6e831d9989b1463da882ee355e32629c&name=default HTTP/1.1" status: 200 len: 216 time: 0.0094364 May 28 12:59:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a055f8-b531-4ff9-b9b7-09fab80f4824 service neutron] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a055f8-b531-4ff9-b9b7-09fab80f4824 service neutron] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:30 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.lock.api [None req-83169fec-9805-48a5-96cd-e2a4edcf98d8 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Searching for locks by: {'resource_id': '54b2b2a3-0c98-44d7-adf1-1a14bbca74e0', 'resource_action': 'show', 'resource_type': 'access_rule'} {{(pid=98329) get_all /opt/stack/manila/manila/lock/api.py:112}} May 28 12:59:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70757af-38c2-4636-b8c2-2f26cc6fc6f0 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70757af-38c2-4636-b8c2-2f26cc6fc6f0 None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70757af-38c2-4636-b8c2-2f26cc6fc6f0 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70757af-38c2-4636-b8c2-2f26cc6fc6f0 None admin] PATH_INFO: `/v3/projects/6e831d9989b1463da882ee355e32629c` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70757af-38c2-4636-b8c2-2f26cc6fc6f0 None admin] RBAC: Authorizing `identity:delete_project(project_id=6e831d9989b1463da882ee355e32629c)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70757af-38c2-4636-b8c2-2f26cc6fc6f0 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:30 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-83169fec-9805-48a5-96cd-e2a4edcf98d8 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] http://10.27.203.238/share/v2/776f75906bc64f8f9316d5aab4b50bf1/share-access-rules?share_id=1ddadc17-cf10-4a42-8bbd-8335fb3520a1 returned with HTTP 200 May 28 12:59:30 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 748/1479] 10.27.203.238 () {64 vars in 1467 bytes} [Tue May 28 12:59:30 2024] GET /share/v2/776f75906bc64f8f9316d5aab4b50bf1/share-access-rules?share_id=1ddadc17-cf10-4a42-8bbd-8335fb3520a1 => generated 275 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:59:30 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-0f7a88c6-2853-4848-8e3c-d55d80648534 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] POST http://10.27.203.238/share/v2/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action May 28 12:59:30 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-0f7a88c6-2853-4848-8e3c-d55d80648534 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Action body: b'{"deny_access": {"access_id": "54b2b2a3-0c98-44d7-adf1-1a14bbca74e0"}}' {{(pid=98330) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:59:30 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-0f7a88c6-2853-4848-8e3c-d55d80648534 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Action: 'action', calling method: ShareController.deny_access, body: {"deny_access": {"access_id": "54b2b2a3-0c98-44d7-adf1-1a14bbca74e0"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:59:30 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.lock.api [None req-0f7a88c6-2853-4848-8e3c-d55d80648534 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Searching for locks by: {'resource_id': '54b2b2a3-0c98-44d7-adf1-1a14bbca74e0', 'resource_action': 'delete'} {{(pid=98330) get_all /opt/stack/manila/manila/lock/api.py:112}} May 28 12:59:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-e70757af-38c2-4636-b8c2-2f26cc6fc6f0 None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e831d9989b1463da882ee355e32629c', 'request_id': 'req-e70757af-38c2-4636-b8c2-2f26cc6fc6f0'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-e70757af-38c2-4636-b8c2-2f26cc6fc6f0 None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e831d9989b1463da882ee355e32629c', 'request_id': 'req-e70757af-38c2-4636-b8c2-2f26cc6fc6f0'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-e70757af-38c2-4636-b8c2-2f26cc6fc6f0 None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e831d9989b1463da882ee355e32629c', 'request_id': 'req-e70757af-38c2-4636-b8c2-2f26cc6fc6f0'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-e70757af-38c2-4636-b8c2-2f26cc6fc6f0 None admin] The token cache is being invalidate because project 6e831d9989b1463da882ee355e32629c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 12:59:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-e70757af-38c2-4636-b8c2-2f26cc6fc6f0 None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-e70757af-38c2-4636-b8c2-2f26cc6fc6f0 None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:30 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1225/2475] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 12:59:30 2024] DELETE /identity/v3/projects/6e831d9989b1463da882ee355e32629c => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:59:30 l75lg1-v1 neutron-server[77619]: DEBUG neutron.wsgi [-] (77619) accepted ('10.27.203.238', 35908) {{(pid=77619) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 12:59:30 l75lg1-v1 neutron-server[77619]: INFO neutron.wsgi [None req-5210ef44-3ebb-4c70-b365-b11bea91ee35 None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=7c57d03aaac8490283a91810fc80266e&name=default HTTP/1.1" status: 200 len: 216 time: 0.0082743 May 28 12:59:30 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-0f7a88c6-2853-4848-8e3c-d55d80648534 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:30 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-0f7a88c6-2853-4848-8e3c-d55d80648534 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137621e7-b1da-4790-a2b2-a32e07e0729b None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-137621e7-b1da-4790-a2b2-a32e07e0729b None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:59:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137621e7-b1da-4790-a2b2-a32e07e0729b None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4299a286-7f71-41ad-aa38-920d444c817c None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4299a286-7f71-41ad-aa38-920d444c817c None admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4299a286-7f71-41ad-aa38-920d444c817c None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4299a286-7f71-41ad-aa38-920d444c817c None admin] PATH_INFO: `/v3/projects/7c57d03aaac8490283a91810fc80266e` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4299a286-7f71-41ad-aa38-920d444c817c None admin] RBAC: Authorizing `identity:delete_project(project_id=7c57d03aaac8490283a91810fc80266e)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:30 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-0f7a88c6-2853-4848-8e3c-d55d80648534 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.038s {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:30 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-0f7a88c6-2853-4848-8e3c-d55d80648534 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4299a286-7f71-41ad-aa38-920d444c817c None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:30 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-0f7a88c6-2853-4848-8e3c-d55d80648534 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-4299a286-7f71-41ad-aa38-920d444c817c None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c57d03aaac8490283a91810fc80266e', 'request_id': 'req-4299a286-7f71-41ad-aa38-920d444c817c'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-4299a286-7f71-41ad-aa38-920d444c817c None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c57d03aaac8490283a91810fc80266e', 'request_id': 'req-4299a286-7f71-41ad-aa38-920d444c817c'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-4299a286-7f71-41ad-aa38-920d444c817c None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c57d03aaac8490283a91810fc80266e', 'request_id': 'req-4299a286-7f71-41ad-aa38-920d444c817c'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:30 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-0f7a88c6-2853-4848-8e3c-d55d80648534 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.055s {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:30 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-0f7a88c6-2853-4848-8e3c-d55d80648534 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] http://10.27.203.238/share/v2/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action returned with HTTP 202 May 28 12:59:30 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 732/1480] 10.27.203.238 () {66 vars in 1493 bytes} [Tue May 28 12:59:30 2024] POST /share/v2/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action => generated 0 bytes in 179 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:59:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-4299a286-7f71-41ad-aa38-920d444c817c None admin] The token cache is being invalidate because project 7c57d03aaac8490283a91810fc80266e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 12:59:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-4299a286-7f71-41ad-aa38-920d444c817c None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-4299a286-7f71-41ad-aa38-920d444c817c None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:30 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1251/2476] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 12:59:30 2024] DELETE /identity/v3/projects/7c57d03aaac8490283a91810fc80266e => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:59:30 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-080480eb-900b-48d1-8759-d0e1b4f368c5 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] GET http://10.27.203.238/share/v2/776f75906bc64f8f9316d5aab4b50bf1/share-access-rules?share_id=1ddadc17-cf10-4a42-8bbd-8335fb3520a1 May 28 12:59:30 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-080480eb-900b-48d1-8759-d0e1b4f368c5 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:30 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-080480eb-900b-48d1-8759-d0e1b4f368c5 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e2dbc4-75b7-4b22-a921-ba41bfda8391 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e2dbc4-75b7-4b22-a921-ba41bfda8391 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e2dbc4-75b7-4b22-a921-ba41bfda8391 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:30 l75lg1-v1 manila-share[98474]: DEBUG manila.share.manager [None req-0f7a88c6-2853-4848-8e3c-d55d80648534 tempest-ShareIpRulesForNFSTest-1748669711 None] Received request to update access for share instance b7a7d61c-2cea-442a-9809-507038e080d5. {{(pid=98474) update_access_for_instances /opt/stack/manila/manila/share/manager.py:4353}} May 28 12:59:30 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-71e2dbc4-75b7-4b22-a921-ba41bfda8391 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:59:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-71e2dbc4-75b7-4b22-a921-ba41bfda8391 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:59:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-71e2dbc4-75b7-4b22-a921-ba41bfda8391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:59:30 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1226/2477] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:59:30 2024] POST /identity/v3/auth/tokens => generated 312 bytes in 19 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 28 12:59:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2d0b24-a3ba-47c8-a3d5-ccd5ec13e0fa None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2d0b24-a3ba-47c8-a3d5-ccd5ec13e0fa None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2d0b24-a3ba-47c8-a3d5-ccd5ec13e0fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:30 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-0f7a88c6-2853-4848-8e3c-d55d80648534 tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:30 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.lock.api [None req-080480eb-900b-48d1-8759-d0e1b4f368c5 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Searching for locks by: {'resource_id': '54b2b2a3-0c98-44d7-adf1-1a14bbca74e0', 'resource_action': 'show', 'resource_type': 'access_rule'} {{(pid=98329) get_all /opt/stack/manila/manila/lock/api.py:112}} May 28 12:59:30 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-0f7a88c6-2853-4848-8e3c-d55d80648534 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:30 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-0f7a88c6-2853-4848-8e3c-d55d80648534 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:30 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-0f7a88c6-2853-4848-8e3c-d55d80648534 tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:30 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-0f7a88c6-2853-4848-8e3c-d55d80648534 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:30 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-080480eb-900b-48d1-8759-d0e1b4f368c5 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] http://10.27.203.238/share/v2/776f75906bc64f8f9316d5aab4b50bf1/share-access-rules?share_id=1ddadc17-cf10-4a42-8bbd-8335fb3520a1 returned with HTTP 200 May 28 12:59:30 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-cd2d0b24-a3ba-47c8-a3d5-ccd5ec13e0fa None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:59:30 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 749/1481] 10.27.203.238 () {64 vars in 1467 bytes} [Tue May 28 12:59:30 2024] GET /share/v2/776f75906bc64f8f9316d5aab4b50bf1/share-access-rules?share_id=1ddadc17-cf10-4a42-8bbd-8335fb3520a1 => generated 283 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:59:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-cd2d0b24-a3ba-47c8-a3d5-ccd5ec13e0fa None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:59:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-cd2d0b24-a3ba-47c8-a3d5-ccd5ec13e0fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:59:30 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1252/2478] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:59:30 2024] POST /identity/v3/auth/tokens => generated 2960 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 12:59:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e2dbc4-75b7-4b22-a921-ba41bfda8391 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e2dbc4-75b7-4b22-a921-ba41bfda8391 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:30 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-0f7a88c6-2853-4848-8e3c-d55d80648534 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.052s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:30 l75lg1-v1 manila-share[98474]: DEBUG manila.share.access [None req-0f7a88c6-2853-4848-8e3c-d55d80648534 tempest-ShareIpRulesForNFSTest-1748669711 None] Updating access rules for share instance b7a7d61c-2cea-442a-9809-507038e080d5 belonging to share 1ddadc17-cf10-4a42-8bbd-8335fb3520a1. {{(pid=98474) update_access_rules /opt/stack/manila/manila/share/access.py:298}} May 28 12:59:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d645771f-335d-43ea-b587-aec103ded0b5 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d645771f-335d-43ea-b587-aec103ded0b5 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d645771f-335d-43ea-b587-aec103ded0b5 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d645771f-335d-43ea-b587-aec103ded0b5 None admin] PATH_INFO: `/v3/domains` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d645771f-335d-43ea-b587-aec103ded0b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:59:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d645771f-335d-43ea-b587-aec103ded0b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d645771f-335d-43ea-b587-aec103ded0b5 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:30 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1227/2479] 10.27.203.238 () {62 vars in 1220 bytes} [Tue May 28 12:59:30 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:59:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2d0b24-a3ba-47c8-a3d5-ccd5ec13e0fa None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2d0b24-a3ba-47c8-a3d5-ccd5ec13e0fa None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bb79d4-67b7-4a04-a802-2be053dbb050 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:30 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-0f7a88c6-2853-4848-8e3c-d55d80648534 tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bb79d4-67b7-4a04-a802-2be053dbb050 None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bb79d4-67b7-4a04-a802-2be053dbb050 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bb79d4-67b7-4a04-a802-2be053dbb050 None admin] PATH_INFO: `/v3/projects` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:30 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-0f7a88c6-2853-4848-8e3c-d55d80648534 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bb79d4-67b7-4a04-a802-2be053dbb050 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bb79d4-67b7-4a04-a802-2be053dbb050 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:30 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-0f7a88c6-2853-4848-8e3c-d55d80648534 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.007s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:30 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-0f7a88c6-2853-4848-8e3c-d55d80648534 tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:30 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-0f7a88c6-2853-4848-8e3c-d55d80648534 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:30 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-0f7a88c6-2853-4848-8e3c-d55d80648534 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.014s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:30 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-0f7a88c6-2853-4848-8e3c-d55d80648534 tempest-ShareIpRulesForNFSTest-1748669711 None] changing access on None May 28 12:59:30 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0f7a88c6-2853-4848-8e3c-d55d80648534 tempest-ShareIpRulesForNFSTest-1748669711 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:59:30 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0f7a88c6-2853-4848-8e3c-d55d80648534 tempest-ShareIpRulesForNFSTest-1748669711 None] {'allow_redirects': True, May 28 12:59:30 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0f7a88c6-2853-4848-8e3c-d55d80648534 tempest-ShareIpRulesForNFSTest-1748669711 None] 'params': {'name': 'b7a7d61c-2cea-442a-9809-507038e080d5'}} May 28 12:59:30 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1253/2480] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 12:59:30 2024] POST /identity/v3/projects => generated 405 bytes in 36 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:59:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d645771f-335d-43ea-b587-aec103ded0b5 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d645771f-335d-43ea-b587-aec103ded0b5 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc79386-5316-4616-8b77-f7b5bcc4cb9d None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc79386-5316-4616-8b77-f7b5bcc4cb9d None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc79386-5316-4616-8b77-f7b5bcc4cb9d None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc79386-5316-4616-8b77-f7b5bcc4cb9d None admin] PATH_INFO: `/v3/users` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc79386-5316-4616-8b77-f7b5bcc4cb9d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc79386-5316-4616-8b77-f7b5bcc4cb9d None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:30 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-2fc79386-5316-4616-8b77-f7b5bcc4cb9d None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 12:59:30 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1228/2481] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 12:59:30 2024] POST /identity/v3/users => generated 311 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:59:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bb79d4-67b7-4a04-a802-2be053dbb050 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bb79d4-67b7-4a04-a802-2be053dbb050 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e7bbdc-8276-4973-b687-48b7e5132e45 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e7bbdc-8276-4973-b687-48b7e5132e45 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e7bbdc-8276-4973-b687-48b7e5132e45 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e7bbdc-8276-4973-b687-48b7e5132e45 None admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e7bbdc-8276-4973-b687-48b7e5132e45 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e7bbdc-8276-4973-b687-48b7e5132e45 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:30 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1254/2482] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 12:59:30 2024] GET /identity/v3/roles => generated 1680 bytes in 17 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:59:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc79386-5316-4616-8b77-f7b5bcc4cb9d None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc79386-5316-4616-8b77-f7b5bcc4cb9d None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5590cf16-dea7-43c7-b0c9-152dc22fd764 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5590cf16-dea7-43c7-b0c9-152dc22fd764 None admin] REQUEST_METHOD: `PUT` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5590cf16-dea7-43c7-b0c9-152dc22fd764 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5590cf16-dea7-43c7-b0c9-152dc22fd764 None admin] PATH_INFO: `/v3/projects/86e4aff17ad94d75a624b038464bfeb2/users/00d8f965a4b14713996fc0c79279060e/roles/44620cad10ae407c90c91e2c296adb04` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5590cf16-dea7-43c7-b0c9-152dc22fd764 None admin] RBAC: Authorizing `identity:create_grant(project_id=86e4aff17ad94d75a624b038464bfeb2, user_id=00d8f965a4b14713996fc0c79279060e, role_id=44620cad10ae407c90c91e2c296adb04)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5590cf16-dea7-43c7-b0c9-152dc22fd764 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:30 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1229/2483] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 12:59:30 2024] PUT /identity/v3/projects/86e4aff17ad94d75a624b038464bfeb2/users/00d8f965a4b14713996fc0c79279060e/roles/44620cad10ae407c90c91e2c296adb04 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:59:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec770aa-57ce-48ab-933e-a6833b7b4c3c None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec770aa-57ce-48ab-933e-a6833b7b4c3c None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec770aa-57ce-48ab-933e-a6833b7b4c3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:30 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-0ec770aa-57ce-48ab-933e-a6833b7b4c3c None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:59:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-0ec770aa-57ce-48ab-933e-a6833b7b4c3c None None] MFA Rules not processed for user `00d8f965a4b14713996fc0c79279060e`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:59:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-0ec770aa-57ce-48ab-933e-a6833b7b4c3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:59:31 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1255/2484] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:59:30 2024] POST /identity/v3/auth/tokens => generated 3976 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:59:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5590cf16-dea7-43c7-b0c9-152dc22fd764 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5590cf16-dea7-43c7-b0c9-152dc22fd764 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66531109-592c-4c26-9df0-679f41e35b81 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66531109-592c-4c26-9df0-679f41e35b81 None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66531109-592c-4c26-9df0-679f41e35b81 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66531109-592c-4c26-9df0-679f41e35b81 None admin] PATH_INFO: `/v3/projects` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66531109-592c-4c26-9df0-679f41e35b81 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66531109-592c-4c26-9df0-679f41e35b81 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:31 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1230/2485] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 12:59:31 2024] POST /identity/v3/projects => generated 407 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:59:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec770aa-57ce-48ab-933e-a6833b7b4c3c None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec770aa-57ce-48ab-933e-a6833b7b4c3c None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93936949-1335-4d11-a75e-1b68f4613747 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93936949-1335-4d11-a75e-1b68f4613747 None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93936949-1335-4d11-a75e-1b68f4613747 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93936949-1335-4d11-a75e-1b68f4613747 None admin] PATH_INFO: `/v3/users` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93936949-1335-4d11-a75e-1b68f4613747 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93936949-1335-4d11-a75e-1b68f4613747 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:31 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-93936949-1335-4d11-a75e-1b68f4613747 None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 12:59:31 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1256/2486] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 12:59:31 2024] POST /identity/v3/users => generated 312 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:59:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66531109-592c-4c26-9df0-679f41e35b81 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66531109-592c-4c26-9df0-679f41e35b81 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a0fefa-090b-4400-9727-e37bc38d2f1c None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a0fefa-090b-4400-9727-e37bc38d2f1c None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a0fefa-090b-4400-9727-e37bc38d2f1c None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a0fefa-090b-4400-9727-e37bc38d2f1c None admin] PATH_INFO: `/v3/roles` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a0fefa-090b-4400-9727-e37bc38d2f1c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a0fefa-090b-4400-9727-e37bc38d2f1c None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:31 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1231/2487] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 12:59:31 2024] GET /identity/v3/roles => generated 1680 bytes in 19 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:59:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93936949-1335-4d11-a75e-1b68f4613747 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93936949-1335-4d11-a75e-1b68f4613747 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603d7a32-5408-4c02-b06e-cdeffa21acf0 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603d7a32-5408-4c02-b06e-cdeffa21acf0 None admin] REQUEST_METHOD: `PUT` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603d7a32-5408-4c02-b06e-cdeffa21acf0 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603d7a32-5408-4c02-b06e-cdeffa21acf0 None admin] PATH_INFO: `/v3/projects/b058127419ad4e429a8f95650aea3857/users/78f09898a9d348a1be1b598fd55a1cc0/roles/44620cad10ae407c90c91e2c296adb04` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603d7a32-5408-4c02-b06e-cdeffa21acf0 None admin] RBAC: Authorizing `identity:create_grant(project_id=b058127419ad4e429a8f95650aea3857, user_id=78f09898a9d348a1be1b598fd55a1cc0, role_id=44620cad10ae407c90c91e2c296adb04)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603d7a32-5408-4c02-b06e-cdeffa21acf0 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:31 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1257/2488] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 12:59:31 2024] PUT /identity/v3/projects/b058127419ad4e429a8f95650aea3857/users/78f09898a9d348a1be1b598fd55a1cc0/roles/44620cad10ae407c90c91e2c296adb04 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:59:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa99cad-1ec3-49d4-bccf-ab5aeb6cb291 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa99cad-1ec3-49d4-bccf-ab5aeb6cb291 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa99cad-1ec3-49d4-bccf-ab5aeb6cb291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:31 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-caa99cad-1ec3-49d4-bccf-ab5aeb6cb291 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:59:31 l75lg1-v1 dstat.sh[49771]: 28-05 12:59:31| 16 2 80 3 0|5740M 1729M 277M 7878M| 17k 3949B| 0 2742k| 0 353 |8325 14k|1.12 1.05 1.01|2.0 1.0 0| 0 0 | 0 2048M| 29 364 0 33 0 May 28 12:59:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-caa99cad-1ec3-49d4-bccf-ab5aeb6cb291 None None] MFA Rules not processed for user `78f09898a9d348a1be1b598fd55a1cc0`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:59:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-caa99cad-1ec3-49d4-bccf-ab5aeb6cb291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:59:31 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1232/2489] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:59:31 2024] POST /identity/v3/auth/tokens => generated 3978 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:59:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603d7a32-5408-4c02-b06e-cdeffa21acf0 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603d7a32-5408-4c02-b06e-cdeffa21acf0 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9150c1-dbe6-4b35-a6b8-6c0a4f93f9ed None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9150c1-dbe6-4b35-a6b8-6c0a4f93f9ed None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9150c1-dbe6-4b35-a6b8-6c0a4f93f9ed None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9150c1-dbe6-4b35-a6b8-6c0a4f93f9ed None admin] PATH_INFO: `/v3/projects` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9150c1-dbe6-4b35-a6b8-6c0a4f93f9ed None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9150c1-dbe6-4b35-a6b8-6c0a4f93f9ed None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:31 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1258/2490] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 12:59:31 2024] POST /identity/v3/projects => generated 405 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:59:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa99cad-1ec3-49d4-bccf-ab5aeb6cb291 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa99cad-1ec3-49d4-bccf-ab5aeb6cb291 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfb3ccc-357e-4eee-ae5b-bf0be6fff605 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfb3ccc-357e-4eee-ae5b-bf0be6fff605 None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfb3ccc-357e-4eee-ae5b-bf0be6fff605 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfb3ccc-357e-4eee-ae5b-bf0be6fff605 None admin] PATH_INFO: `/v3/users` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfb3ccc-357e-4eee-ae5b-bf0be6fff605 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfb3ccc-357e-4eee-ae5b-bf0be6fff605 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:31 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-8dfb3ccc-357e-4eee-ae5b-bf0be6fff605 None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 12:59:31 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0f7a88c6-2853-4848-8e3c-d55d80648534 tempest-ShareIpRulesForNFSTest-1748669711 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:59:31 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0f7a88c6-2853-4848-8e3c-d55d80648534 tempest-ShareIpRulesForNFSTest-1748669711 None] [Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=1, created='2024-05-28T12:57:40.763635Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='377955ad-d094-4e49-ab32-1021d943a572', id=21, internal=False, is_s3_default_policy=False, name='b7a7d61c-2cea-442a-9809-507038e080d5', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=['*'], nfs_posix_acl=False, nfs_read_only=['2.2.2.2'], nfs_read_write=[], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=['2.2.2.2'], read_write=[], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T12:59:29.705563Z', tenant_id=1, tenant_name='default', title='b7a7d61c-2cea-442a-9809-507038e080d5', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/21/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[])] May 28 12:59:31 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0f7a88c6-2853-4848-8e3c-d55d80648534 tempest-ShareIpRulesForNFSTest-1748669711 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 12:59:31 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-0f7a88c6-2853-4848-8e3c-d55d80648534 tempest-ShareIpRulesForNFSTest-1748669711 None] changing access on /manila/manila-b7a7d61c-2cea-442a-9809-507038e080d5. Rules: {'nfs_read_write': [], 'nfs_read_only': []} May 28 12:59:31 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0f7a88c6-2853-4848-8e3c-d55d80648534 tempest-ShareIpRulesForNFSTest-1748669711 None] >>> [PATCH] https://127.0.0.1:40443/api/viewpolicies/21/ May 28 12:59:31 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0f7a88c6-2853-4848-8e3c-d55d80648534 tempest-ShareIpRulesForNFSTest-1748669711 None] {'data': '{"name": "b7a7d61c-2cea-442a-9809-507038e080d5", "nfs_no_squash": ' May 28 12:59:31 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0f7a88c6-2853-4848-8e3c-d55d80648534 tempest-ShareIpRulesForNFSTest-1748669711 None] '["*"], "nfs_root_squash": ["*"], "nfs_read_write": [], ' May 28 12:59:31 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0f7a88c6-2853-4848-8e3c-d55d80648534 tempest-ShareIpRulesForNFSTest-1748669711 None] '"nfs_read_only": []}', May 28 12:59:31 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0f7a88c6-2853-4848-8e3c-d55d80648534 tempest-ShareIpRulesForNFSTest-1748669711 None] 'params': None} May 28 12:59:31 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1233/2491] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 12:59:31 2024] POST /identity/v3/users => generated 310 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:59:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9150c1-dbe6-4b35-a6b8-6c0a4f93f9ed None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9150c1-dbe6-4b35-a6b8-6c0a4f93f9ed None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7405b3-f0cb-4acf-8c86-ba9985856a10 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7405b3-f0cb-4acf-8c86-ba9985856a10 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7405b3-f0cb-4acf-8c86-ba9985856a10 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7405b3-f0cb-4acf-8c86-ba9985856a10 None admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7405b3-f0cb-4acf-8c86-ba9985856a10 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7405b3-f0cb-4acf-8c86-ba9985856a10 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:31 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1259/2492] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 12:59:31 2024] GET /identity/v3/roles => generated 1680 bytes in 18 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:59:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfb3ccc-357e-4eee-ae5b-bf0be6fff605 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfb3ccc-357e-4eee-ae5b-bf0be6fff605 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8004572c-0e88-47be-86e9-a3c1df9827ee None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8004572c-0e88-47be-86e9-a3c1df9827ee None admin] REQUEST_METHOD: `PUT` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8004572c-0e88-47be-86e9-a3c1df9827ee None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8004572c-0e88-47be-86e9-a3c1df9827ee None admin] PATH_INFO: `/v3/projects/1c8bc02239694668aa5810b9e0fc29f3/users/c23c4f0d80fc4a328a0d37c798eb66f3/roles/e7989893488f483baa107be56668c4f8` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8004572c-0e88-47be-86e9-a3c1df9827ee None admin] RBAC: Authorizing `identity:create_grant(project_id=1c8bc02239694668aa5810b9e0fc29f3, user_id=c23c4f0d80fc4a328a0d37c798eb66f3, role_id=e7989893488f483baa107be56668c4f8)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8004572c-0e88-47be-86e9-a3c1df9827ee None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:31 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1234/2493] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 12:59:31 2024] PUT /identity/v3/projects/1c8bc02239694668aa5810b9e0fc29f3/users/c23c4f0d80fc4a328a0d37c798eb66f3/roles/e7989893488f483baa107be56668c4f8 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:59:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7405b3-f0cb-4acf-8c86-ba9985856a10 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7405b3-f0cb-4acf-8c86-ba9985856a10 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2903fd-e1b8-44a5-bece-bb778899db7b None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2903fd-e1b8-44a5-bece-bb778899db7b None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2903fd-e1b8-44a5-bece-bb778899db7b None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2903fd-e1b8-44a5-bece-bb778899db7b None admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2903fd-e1b8-44a5-bece-bb778899db7b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2903fd-e1b8-44a5-bece-bb778899db7b None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:31 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1260/2494] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 12:59:31 2024] GET /identity/v3/roles => generated 1680 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:59:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8004572c-0e88-47be-86e9-a3c1df9827ee None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8004572c-0e88-47be-86e9-a3c1df9827ee None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a203867-84ca-42b8-9531-b66a62b72907 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a203867-84ca-42b8-9531-b66a62b72907 None admin] REQUEST_METHOD: `PUT` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a203867-84ca-42b8-9531-b66a62b72907 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a203867-84ca-42b8-9531-b66a62b72907 None admin] PATH_INFO: `/v3/projects/1c8bc02239694668aa5810b9e0fc29f3/users/c23c4f0d80fc4a328a0d37c798eb66f3/roles/e7989893488f483baa107be56668c4f8` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a203867-84ca-42b8-9531-b66a62b72907 None admin] RBAC: Authorizing `identity:create_grant(project_id=1c8bc02239694668aa5810b9e0fc29f3, user_id=c23c4f0d80fc4a328a0d37c798eb66f3, role_id=e7989893488f483baa107be56668c4f8)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a203867-84ca-42b8-9531-b66a62b72907 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:31 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1235/2495] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 12:59:31 2024] PUT /identity/v3/projects/1c8bc02239694668aa5810b9e0fc29f3/users/c23c4f0d80fc4a328a0d37c798eb66f3/roles/e7989893488f483baa107be56668c4f8 => generated 0 bytes in 19 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:59:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1139cc-fd7f-4583-a1f8-2baa341ad7ec None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1139cc-fd7f-4583-a1f8-2baa341ad7ec None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1139cc-fd7f-4583-a1f8-2baa341ad7ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:31 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-ef1139cc-fd7f-4583-a1f8-2baa341ad7ec None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:59:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-ef1139cc-fd7f-4583-a1f8-2baa341ad7ec None None] MFA Rules not processed for user `c23c4f0d80fc4a328a0d37c798eb66f3`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:59:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-ef1139cc-fd7f-4583-a1f8-2baa341ad7ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:59:31 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1261/2496] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:59:31 2024] POST /identity/v3/auth/tokens => generated 4099 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:59:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a203867-84ca-42b8-9531-b66a62b72907 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a203867-84ca-42b8-9531-b66a62b72907 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e21ad1-1c20-4bee-95e9-3ce6cabfe65b tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c23c4f0d80fc4a328a0d37c798eb66f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c8bc02239694668aa5810b9e0fc29f3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e21ad1-1c20-4bee-95e9-3ce6cabfe65b tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e21ad1-1c20-4bee-95e9-3ce6cabfe65b tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e21ad1-1c20-4bee-95e9-3ce6cabfe65b tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] PATH_INFO: `/v3/domains` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e21ad1-1c20-4bee-95e9-3ce6cabfe65b tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:59:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e21ad1-1c20-4bee-95e9-3ce6cabfe65b tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e21ad1-1c20-4bee-95e9-3ce6cabfe65b tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:31 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1236/2497] 10.27.203.238 () {62 vars in 1241 bytes} [Tue May 28 12:59:31 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:59:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1139cc-fd7f-4583-a1f8-2baa341ad7ec None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1139cc-fd7f-4583-a1f8-2baa341ad7ec None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48557f91-7d31-4610-a0fa-d1c705e5ec82 tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c23c4f0d80fc4a328a0d37c798eb66f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c8bc02239694668aa5810b9e0fc29f3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48557f91-7d31-4610-a0fa-d1c705e5ec82 tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48557f91-7d31-4610-a0fa-d1c705e5ec82 tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48557f91-7d31-4610-a0fa-d1c705e5ec82 tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] PATH_INFO: `/v3/users` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48557f91-7d31-4610-a0fa-d1c705e5ec82 tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48557f91-7d31-4610-a0fa-d1c705e5ec82 tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:31 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-48557f91-7d31-4610-a0fa-d1c705e5ec82 tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] Truncating password to algorithm specific maximum length 72 characters. May 28 12:59:31 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1262/2498] 10.27.203.238 () {64 vars in 1232 bytes} [Tue May 28 12:59:31 2024] POST /identity/v3/users => generated 433 bytes in 35 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 28 12:59:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e21ad1-1c20-4bee-95e9-3ce6cabfe65b tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e21ad1-1c20-4bee-95e9-3ce6cabfe65b tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595a16bb-c0d1-48d4-9c9a-34434785af4f tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c23c4f0d80fc4a328a0d37c798eb66f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c8bc02239694668aa5810b9e0fc29f3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595a16bb-c0d1-48d4-9c9a-34434785af4f tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595a16bb-c0d1-48d4-9c9a-34434785af4f tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595a16bb-c0d1-48d4-9c9a-34434785af4f tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] PATH_INFO: `/v3/roles` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595a16bb-c0d1-48d4-9c9a-34434785af4f tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595a16bb-c0d1-48d4-9c9a-34434785af4f tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:31 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1237/2499] 10.27.203.238 () {62 vars in 1210 bytes} [Tue May 28 12:59:31 2024] GET /identity/v3/roles => generated 1680 bytes in 17 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:59:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48557f91-7d31-4610-a0fa-d1c705e5ec82 tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48557f91-7d31-4610-a0fa-d1c705e5ec82 tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96737891-cd4c-4ddd-b910-c8b689577293 tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c23c4f0d80fc4a328a0d37c798eb66f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c8bc02239694668aa5810b9e0fc29f3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96737891-cd4c-4ddd-b910-c8b689577293 tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] REQUEST_METHOD: `PUT` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96737891-cd4c-4ddd-b910-c8b689577293 tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96737891-cd4c-4ddd-b910-c8b689577293 tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] PATH_INFO: `/v3/projects/1c8bc02239694668aa5810b9e0fc29f3/users/2eb81a384d764f8cb6d0d7e830959013/roles/44620cad10ae407c90c91e2c296adb04` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96737891-cd4c-4ddd-b910-c8b689577293 tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] RBAC: Authorizing `identity:create_grant(project_id=1c8bc02239694668aa5810b9e0fc29f3, user_id=2eb81a384d764f8cb6d0d7e830959013, role_id=44620cad10ae407c90c91e2c296adb04)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96737891-cd4c-4ddd-b910-c8b689577293 tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:31 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1263/2500] 10.27.203.238 () {64 vars in 1571 bytes} [Tue May 28 12:59:31 2024] PUT /identity/v3/projects/1c8bc02239694668aa5810b9e0fc29f3/users/2eb81a384d764f8cb6d0d7e830959013/roles/44620cad10ae407c90c91e2c296adb04 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:59:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595a16bb-c0d1-48d4-9c9a-34434785af4f tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-595a16bb-c0d1-48d4-9c9a-34434785af4f tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:59:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595a16bb-c0d1-48d4-9c9a-34434785af4f tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e67d5c9-f251-47ca-976e-c6baca522e64 service manila] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f110cf6300f049c897d0aab63218d1e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e67d5c9-f251-47ca-976e-c6baca522e64 service manila] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e67d5c9-f251-47ca-976e-c6baca522e64 service manila] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e67d5c9-f251-47ca-976e-c6baca522e64 service manila] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e67d5c9-f251-47ca-976e-c6baca522e64 service manila] RBAC: Authorizing `identity:validate_token()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e67d5c9-f251-47ca-976e-c6baca522e64 service manila] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:31 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1238/2501] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 12:59:31 2024] GET /identity/v3/auth/tokens => generated 4099 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 12:59:31 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-4c0e682c-ea19-441e-b5cc-51166c6a1a00 tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] POST http://10.27.203.238/share/v2/1c8bc02239694668aa5810b9e0fc29f3/types May 28 12:59:31 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-4c0e682c-ea19-441e-b5cc-51166c6a1a00 tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share_type": {"name": "tempest-typeshare-type-52975600", "extra_specs": {"driver_handles_share_servers": "False"}, "share_type_access:is_public": true}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:59:31 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-4c0e682c-ea19-441e-b5cc-51166c6a1a00 tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] http://10.27.203.238/share/v2/1c8bc02239694668aa5810b9e0fc29f3/types returned with HTTP 200 May 28 12:59:31 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 733/1482] 10.27.203.238 () {66 vars in 1359 bytes} [Tue May 28 12:59:31 2024] POST /share/v2/1c8bc02239694668aa5810b9e0fc29f3/types => generated 619 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:59:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96737891-cd4c-4ddd-b910-c8b689577293 tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-96737891-cd4c-4ddd-b910-c8b689577293 tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:59:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96737891-cd4c-4ddd-b910-c8b689577293 tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed7b9a5-16a6-496c-8a29-12497af5ba00 service manila] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f110cf6300f049c897d0aab63218d1e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed7b9a5-16a6-496c-8a29-12497af5ba00 service manila] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed7b9a5-16a6-496c-8a29-12497af5ba00 service manila] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed7b9a5-16a6-496c-8a29-12497af5ba00 service manila] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed7b9a5-16a6-496c-8a29-12497af5ba00 service manila] RBAC: Authorizing `identity:validate_token()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed7b9a5-16a6-496c-8a29-12497af5ba00 service manila] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:32 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1264/2502] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 12:59:31 2024] GET /identity/v3/auth/tokens => generated 3976 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 12:59:32 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-21a13525-ffbb-4ef6-bcdf-5eefd6b9cefc tempest-ResourceLockNegativeTestWithShares-789426285 tempest-ResourceLockNegativeTestWithShares-789426285-project-member] POST http://10.27.203.238/share/v2/86e4aff17ad94d75a624b038464bfeb2/shares May 28 12:59:32 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-21a13525-ffbb-4ef6-bcdf-5eefd6b9cefc tempest-ResourceLockNegativeTestWithShares-789426285 tempest-ResourceLockNegativeTestWithShares-789426285-project-member] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share": {"share_proto": "nfs", "description": "Tempest's share", "snapshot_id": null, "name": "tempest-tempest-created-share-159651794", "size": 1, "metadata": {}, "is_public": false, "share_type": "b2679f2f-05f6-4d90-aef6-3a564ca7c99b"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:59:32 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.v1.shares [None req-21a13525-ffbb-4ef6-bcdf-5eefd6b9cefc tempest-ResourceLockNegativeTestWithShares-789426285 tempest-ResourceLockNegativeTestWithShares-789426285-project-member] Create NFS share of 1 GB May 28 12:59:32 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.quota [None req-21a13525-ffbb-4ef6-bcdf-5eefd6b9cefc tempest-ResourceLockNegativeTestWithShares-789426285 tempest-ResourceLockNegativeTestWithShares-789426285-project-member] Created reservations ['5d3a889d-6a11-418b-a416-e9df0b4ac3b7', '6e0a107f-d3e3-4da3-bf60-f87e51e617e7', '497ee723-a149-4768-bba9-c22c5f6d5379', 'c5833ba7-6a9d-4851-a8d1-d063ce2f8c2a'] {{(pid=98329) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 12:59:32 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.quota [None req-21a13525-ffbb-4ef6-bcdf-5eefd6b9cefc tempest-ResourceLockNegativeTestWithShares-789426285 tempest-ResourceLockNegativeTestWithShares-789426285-project-member] Committed reservations ['5d3a889d-6a11-418b-a416-e9df0b4ac3b7', '6e0a107f-d3e3-4da3-bf60-f87e51e617e7', '497ee723-a149-4768-bba9-c22c5f6d5379', 'c5833ba7-6a9d-4851-a8d1-d063ce2f8c2a'] {{(pid=98329) commit /opt/stack/manila/manila/quota.py:1063}} May 28 12:59:32 l75lg1-v1 dstat.sh[49771]: 28-05 12:59:32| 9 1 86 3 0|5740M 1729M 277M 7878M| 13k 990B| 0 8769k| 0 904 |7063 12k|1.19 1.07 1.02|2.0 1.0 0| 0 0 | 0 2048M| 29 364 0 33 0 May 28 12:59:32 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.host_manager [None req-21a13525-ffbb-4ef6-bcdf-5eefd6b9cefc tempest-ResourceLockNegativeTestWithShares-789426285 None] Share service is down. (host: l75lg1-v1@generic2). May 28 12:59:32 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.host_manager [None req-21a13525-ffbb-4ef6-bcdf-5eefd6b9cefc tempest-ResourceLockNegativeTestWithShares-789426285 None] Share service is down. (host: l75lg1-v1@generic1). May 28 12:59:32 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-21a13525-ffbb-4ef6-bcdf-5eefd6b9cefc tempest-ResourceLockNegativeTestWithShares-789426285 None] Starting with 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:80}} May 28 12:59:32 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-21a13525-ffbb-4ef6-bcdf-5eefd6b9cefc tempest-ResourceLockNegativeTestWithShares-789426285 None] Filter OnlyHostFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:59:32 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-21a13525-ffbb-4ef6-bcdf-5eefd6b9cefc tempest-ResourceLockNegativeTestWithShares-789426285 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:59:32 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.capacity [None req-21a13525-ffbb-4ef6-bcdf-5eefd6b9cefc tempest-ResourceLockNegativeTestWithShares-789426285 None] Space information for share creation on host l75lg1-v1@vast#vast (requested / avail): 1/2078 {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/capacity.py:83}} May 28 12:59:32 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-21a13525-ffbb-4ef6-bcdf-5eefd6b9cefc tempest-ResourceLockNegativeTestWithShares-789426285 None] Filter CapacityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:59:32 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-21a13525-ffbb-4ef6-bcdf-5eefd6b9cefc tempest-ResourceLockNegativeTestWithShares-789426285 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:59:32 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-21a13525-ffbb-4ef6-bcdf-5eefd6b9cefc tempest-ResourceLockNegativeTestWithShares-789426285 None] Driver Filter: Checking host 'l75lg1-v1@vast#vast' {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:37}} May 28 12:59:32 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-21a13525-ffbb-4ef6-bcdf-5eefd6b9cefc tempest-ResourceLockNegativeTestWithShares-789426285 None] Filter function not set :: passing host. {{(pid=98327) _check_filter_function /opt/stack/manila/manila/scheduler/filters/driver.py:53}} May 28 12:59:32 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-21a13525-ffbb-4ef6-bcdf-5eefd6b9cefc tempest-ResourceLockNegativeTestWithShares-789426285 None] Result: True {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:40}} May 28 12:59:32 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-21a13525-ffbb-4ef6-bcdf-5eefd6b9cefc tempest-ResourceLockNegativeTestWithShares-789426285 None] Done checking host 'l75lg1-v1@vast#vast' {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:41}} May 28 12:59:32 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-21a13525-ffbb-4ef6-bcdf-5eefd6b9cefc tempest-ResourceLockNegativeTestWithShares-789426285 None] Filter DriverFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:59:32 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-21a13525-ffbb-4ef6-bcdf-5eefd6b9cefc tempest-ResourceLockNegativeTestWithShares-789426285 None] Filter ShareReplicationFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:59:32 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-21a13525-ffbb-4ef6-bcdf-5eefd6b9cefc tempest-ResourceLockNegativeTestWithShares-789426285 None] Filter CreateFromSnapshotFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:59:32 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-21a13525-ffbb-4ef6-bcdf-5eefd6b9cefc tempest-ResourceLockNegativeTestWithShares-789426285 None] Filter AffinityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:59:32 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-21a13525-ffbb-4ef6-bcdf-5eefd6b9cefc tempest-ResourceLockNegativeTestWithShares-789426285 None] Filter AntiAffinityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:59:32 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.drivers.filter [None req-21a13525-ffbb-4ef6-bcdf-5eefd6b9cefc tempest-ResourceLockNegativeTestWithShares-789426285 None] Filtered share [host: 'l75lg1-v1@vast#vast', free_capacity_gb: 2078.64910808485, pools: None] {{(pid=98327) _schedule_share /opt/stack/manila/manila/scheduler/drivers/filter.py:268}} May 28 12:59:32 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-21a13525-ffbb-4ef6-bcdf-5eefd6b9cefc tempest-ResourceLockNegativeTestWithShares-789426285 None] Checking host 'l75lg1-v1@vast#vast' {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:46}} May 28 12:59:32 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.weighers.goodness [None req-21a13525-ffbb-4ef6-bcdf-5eefd6b9cefc tempest-ResourceLockNegativeTestWithShares-789426285 None] Goodness function not set :: defaulting to minimal goodness rating of 0. May 28 12:59:32 l75lg1-v1 manila-scheduler[98327]: INFO manila.scheduler.weighers.goodness [None req-21a13525-ffbb-4ef6-bcdf-5eefd6b9cefc tempest-ResourceLockNegativeTestWithShares-789426285 None] Goodness function result for host l75lg1-v1@vast#vast: 0. May 28 12:59:32 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-21a13525-ffbb-4ef6-bcdf-5eefd6b9cefc tempest-ResourceLockNegativeTestWithShares-789426285 None] Goodness: 0 {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:48}} May 28 12:59:32 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-21a13525-ffbb-4ef6-bcdf-5eefd6b9cefc tempest-ResourceLockNegativeTestWithShares-789426285 None] Done checking host 'l75lg1-v1@vast#vast' {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:49}} May 28 12:59:32 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.drivers.filter [None req-21a13525-ffbb-4ef6-bcdf-5eefd6b9cefc tempest-ResourceLockNegativeTestWithShares-789426285 None] Choosing for share: WeighedHost [host: l75lg1-v1@vast#vast, weight: 0.0] {{(pid=98327) _schedule_share /opt/stack/manila/manila/scheduler/drivers/filter.py:274}} May 28 12:59:32 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-21a13525-ffbb-4ef6-bcdf-5eefd6b9cefc tempest-ResourceLockNegativeTestWithShares-789426285 tempest-ResourceLockNegativeTestWithShares-789426285-project-member] http://10.27.203.238/share/v2/86e4aff17ad94d75a624b038464bfeb2/shares returned with HTTP 200 May 28 12:59:32 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 750/1483] 10.27.203.238 () {66 vars in 1362 bytes} [Tue May 28 12:59:31 2024] POST /share/v2/86e4aff17ad94d75a624b038464bfeb2/shares => generated 1309 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:59:32 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-f1a84334-aa2a-44ef-8133-5385cdae3cdb tempest-ResourceLockNegativeTestWithShares-789426285 tempest-ResourceLockNegativeTestWithShares-789426285-project-member] GET http://10.27.203.238/share/v2/86e4aff17ad94d75a624b038464bfeb2/shares/a5984861-5086-4848-82ce-0960e763197b May 28 12:59:32 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-f1a84334-aa2a-44ef-8133-5385cdae3cdb tempest-ResourceLockNegativeTestWithShares-789426285 tempest-ResourceLockNegativeTestWithShares-789426285-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:32 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-f1a84334-aa2a-44ef-8133-5385cdae3cdb tempest-ResourceLockNegativeTestWithShares-789426285 tempest-ResourceLockNegativeTestWithShares-789426285-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:32 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-f1a84334-aa2a-44ef-8133-5385cdae3cdb tempest-ResourceLockNegativeTestWithShares-789426285 tempest-ResourceLockNegativeTestWithShares-789426285-project-member] http://10.27.203.238/share/v2/86e4aff17ad94d75a624b038464bfeb2/shares/a5984861-5086-4848-82ce-0960e763197b returned with HTTP 200 May 28 12:59:32 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 734/1484] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:59:32 2024] GET /share/v2/86e4aff17ad94d75a624b038464bfeb2/shares/a5984861-5086-4848-82ce-0960e763197b => generated 1309 bytes in 25 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:59:32 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-82022991-02bd-49b6-a7c5-6e1cbdbff008 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] <<< [PATCH] https://127.0.0.1:40443/api/viewpolicies/32/ May 28 12:59:32 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-82022991-02bd-49b6-a7c5-6e1cbdbff008 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=1, created='2024-05-28T12:58:43.845440Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='31b6534b-d142-4561-992f-4f0759db302d', id=32, internal=False, is_s3_default_policy=False, name='7fdd602c-79d0-479c-95a2-336b202c6639', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=['*'], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=[], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=[], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='MODIFYING', sync_time='2024-05-28T12:59:31.565191Z', tenant_id=1, tenant_name='default', title='7fdd602c-79d0-479c-95a2-336b202c6639', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/32/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[]) May 28 12:59:32 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-82022991-02bd-49b6-a7c5-6e1cbdbff008 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] --- [PATCH] https://127.0.0.1:40443/api/viewpolicies/32/: Done May 28 12:59:32 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-82022991-02bd-49b6-a7c5-6e1cbdbff008 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:32 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-82022991-02bd-49b6-a7c5-6e1cbdbff008 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:32 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-82022991-02bd-49b6-a7c5-6e1cbdbff008 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.055s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:32 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-82022991-02bd-49b6-a7c5-6e1cbdbff008 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:32 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-82022991-02bd-49b6-a7c5-6e1cbdbff008 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:32 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-21a13525-ffbb-4ef6-bcdf-5eefd6b9cefc tempest-ResourceLockNegativeTestWithShares-789426285 None] >>> [GET] https://127.0.0.1:40443/api/vippools/ May 28 12:59:32 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-21a13525-ffbb-4ef6-bcdf-5eefd6b9cefc tempest-ResourceLockNegativeTestWithShares-789426285 None] {'allow_redirects': True, 'params': {'name': 'vippool-1'}} May 28 12:59:32 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-82022991-02bd-49b6-a7c5-6e1cbdbff008 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.047s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:32 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-82022991-02bd-49b6-a7c5-6e1cbdbff008 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:32 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-82022991-02bd-49b6-a7c5-6e1cbdbff008 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:32 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-82022991-02bd-49b6-a7c5-6e1cbdbff008 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:32 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-82022991-02bd-49b6-a7c5-6e1cbdbff008 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:32 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-82022991-02bd-49b6-a7c5-6e1cbdbff008 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:32 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-82022991-02bd-49b6-a7c5-6e1cbdbff008 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:32 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-82022991-02bd-49b6-a7c5-6e1cbdbff008 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:32 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-82022991-02bd-49b6-a7c5-6e1cbdbff008 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:32 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-82022991-02bd-49b6-a7c5-6e1cbdbff008 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.038s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:32 l75lg1-v1 manila-share[98474]: INFO manila.share.access [None req-82022991-02bd-49b6-a7c5-6e1cbdbff008 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Access rules were successfully modified for share instance 7fdd602c-79d0-479c-95a2-336b202c6639 belonging to share 72db8769-ece7-42ff-af27-2e778292a9b4. May 28 12:59:32 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-21a13525-ffbb-4ef6-bcdf-5eefd6b9cefc tempest-ResourceLockNegativeTestWithShares-789426285 None] <<< [GET] https://127.0.0.1:40443/api/vippools/ May 28 12:59:32 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-21a13525-ffbb-4ef6-bcdf-5eefd6b9cefc tempest-ResourceLockNegativeTestWithShares-789426285 None] [Bunch(active_cnode_ids=[], active_interfaces=4, cluster='loop75-kfs', cluster_id=1, cnode_ids=[], cnodes=[], domain_name='vippool-1', enable_l3=False, enable_weighted_balancing=False, enabled=True, end_ip='172.21.75.4', guid='f2abaede-b397-413a-8faa-3aeead6d3b28', gw_ip='', gw_ipv6='', id=2, ip_ranges=[['172.21.75.1', '172.21.75.4']], name='vippool-1', peer_asn=0, port_membership='ALL', ranges_summary='172.21.75.[1-4]', role='PROTOCOLS', start_ip='172.21.75.1', subnet_cidr=16, subnet_cidr_ipv6=None, sync='SYNCED', sync_time='2024-05-28T12:50:09.644123Z', tenant_id=1, tenant_name='default', title='172.21.75.1 - 172.21.75.4', url='https://127.0.0.1:40443/api/vippools/2/', vast_asn=0, vlan=0, vms_preferred=False)] May 28 12:59:32 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-21a13525-ffbb-4ef6-bcdf-5eefd6b9cefc tempest-ResourceLockNegativeTestWithShares-789426285 None] --- [GET] https://127.0.0.1:40443/api/vippools/: Done May 28 12:59:32 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-21a13525-ffbb-4ef6-bcdf-5eefd6b9cefc tempest-ResourceLockNegativeTestWithShares-789426285 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:59:32 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-21a13525-ffbb-4ef6-bcdf-5eefd6b9cefc tempest-ResourceLockNegativeTestWithShares-789426285 None] {'allow_redirects': True, May 28 12:59:32 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-21a13525-ffbb-4ef6-bcdf-5eefd6b9cefc tempest-ResourceLockNegativeTestWithShares-789426285 None] 'params': {'name': 'f1a7f25a-f865-4592-93e1-c1e62b2447b8'}} May 28 12:59:32 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-e50f3d83-0955-47e4-bde0-13a9d4092b60 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] GET http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/share-access-rules?share_id=72db8769-ece7-42ff-af27-2e778292a9b4 May 28 12:59:32 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-e50f3d83-0955-47e4-bde0-13a9d4092b60 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:32 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-e50f3d83-0955-47e4-bde0-13a9d4092b60 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:32 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-e50f3d83-0955-47e4-bde0-13a9d4092b60 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/share-access-rules?share_id=72db8769-ece7-42ff-af27-2e778292a9b4 returned with HTTP 200 May 28 12:59:32 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 751/1485] 10.27.203.238 () {64 vars in 1467 bytes} [Tue May 28 12:59:32 2024] GET /share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/share-access-rules?share_id=72db8769-ece7-42ff-af27-2e778292a9b4 => generated 19 bytes in 31 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:59:32 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-f6772c2b-0fbd-4b35-8228-01f007716765 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] POST http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action May 28 12:59:32 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-f6772c2b-0fbd-4b35-8228-01f007716765 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Action body: b'{"allow_access": {"access_type": "ip", "access_to": "fd8c:b029:bba6:ac54::1", "access_level": "rw"}}' {{(pid=98330) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:59:32 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-f6772c2b-0fbd-4b35-8228-01f007716765 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Action: 'action', calling method: ShareController.allow_access, body: {"allow_access": {"access_type": "ip", "access_to": "fd8c:b029:bba6:ac54::1", "access_level": "rw"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:59:32 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-f6772c2b-0fbd-4b35-8228-01f007716765 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:32 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-f6772c2b-0fbd-4b35-8228-01f007716765 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:32 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-f6772c2b-0fbd-4b35-8228-01f007716765 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.049s {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:32 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-f6772c2b-0fbd-4b35-8228-01f007716765 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action returned with HTTP 200 May 28 12:59:32 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 735/1486] 10.27.203.238 () {66 vars in 1494 bytes} [Tue May 28 12:59:32 2024] POST /share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action => generated 320 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:59:32 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-81f33c74-9faa-465c-9889-3efb52c0f89e tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] GET http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/share-access-rules?share_id=72db8769-ece7-42ff-af27-2e778292a9b4 May 28 12:59:32 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-81f33c74-9faa-465c-9889-3efb52c0f89e tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:32 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-81f33c74-9faa-465c-9889-3efb52c0f89e tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:32 l75lg1-v1 manila-share[98474]: DEBUG manila.share.manager [None req-f6772c2b-0fbd-4b35-8228-01f007716765 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Received request to update access for share instance 7fdd602c-79d0-479c-95a2-336b202c6639. {{(pid=98474) update_access_for_instances /opt/stack/manila/manila/share/manager.py:4353}} May 28 12:59:33 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-f6772c2b-0fbd-4b35-8228-01f007716765 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:33 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-f6772c2b-0fbd-4b35-8228-01f007716765 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:33 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-f6772c2b-0fbd-4b35-8228-01f007716765 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.004s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:33 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-f6772c2b-0fbd-4b35-8228-01f007716765 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:33 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.lock.api [None req-81f33c74-9faa-465c-9889-3efb52c0f89e tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Searching for locks by: {'resource_id': '57a01137-a0cf-440f-ae42-3e69a0a2c1ed', 'resource_action': 'show', 'resource_type': 'access_rule'} {{(pid=98329) get_all /opt/stack/manila/manila/lock/api.py:112}} May 28 12:59:33 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-f6772c2b-0fbd-4b35-8228-01f007716765 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:33 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-21a13525-ffbb-4ef6-bcdf-5eefd6b9cefc tempest-ResourceLockNegativeTestWithShares-789426285 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:59:33 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-21a13525-ffbb-4ef6-bcdf-5eefd6b9cefc tempest-ResourceLockNegativeTestWithShares-789426285 None] [] May 28 12:59:33 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-21a13525-ffbb-4ef6-bcdf-5eefd6b9cefc tempest-ResourceLockNegativeTestWithShares-789426285 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 12:59:33 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-21a13525-ffbb-4ef6-bcdf-5eefd6b9cefc tempest-ResourceLockNegativeTestWithShares-789426285 None] >>> [POST] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:59:33 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-21a13525-ffbb-4ef6-bcdf-5eefd6b9cefc tempest-ResourceLockNegativeTestWithShares-789426285 None] {'data': '{"name": "f1a7f25a-f865-4592-93e1-c1e62b2447b8"}', May 28 12:59:33 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-21a13525-ffbb-4ef6-bcdf-5eefd6b9cefc tempest-ResourceLockNegativeTestWithShares-789426285 None] 'json': None, May 28 12:59:33 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-21a13525-ffbb-4ef6-bcdf-5eefd6b9cefc tempest-ResourceLockNegativeTestWithShares-789426285 None] 'params': None} May 28 12:59:33 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-81f33c74-9faa-465c-9889-3efb52c0f89e tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/share-access-rules?share_id=72db8769-ece7-42ff-af27-2e778292a9b4 returned with HTTP 200 May 28 12:59:33 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 752/1487] 10.27.203.238 () {64 vars in 1467 bytes} [Tue May 28 12:59:32 2024] GET /share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/share-access-rules?share_id=72db8769-ece7-42ff-af27-2e778292a9b4 => generated 275 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:59:33 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-f6772c2b-0fbd-4b35-8228-01f007716765 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.062s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:33 l75lg1-v1 manila-share[98474]: DEBUG manila.share.access [None req-f6772c2b-0fbd-4b35-8228-01f007716765 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Updating access rules for share instance 7fdd602c-79d0-479c-95a2-336b202c6639 belonging to share 72db8769-ece7-42ff-af27-2e778292a9b4. {{(pid=98474) update_access_rules /opt/stack/manila/manila/share/access.py:298}} May 28 12:59:33 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-f6772c2b-0fbd-4b35-8228-01f007716765 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:33 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-f6772c2b-0fbd-4b35-8228-01f007716765 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:33 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-f6772c2b-0fbd-4b35-8228-01f007716765 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.008s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:33 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-f6772c2b-0fbd-4b35-8228-01f007716765 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:33 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-f6772c2b-0fbd-4b35-8228-01f007716765 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:33 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-f6772c2b-0fbd-4b35-8228-01f007716765 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.014s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:33 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-f6772c2b-0fbd-4b35-8228-01f007716765 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] changing access on None May 28 12:59:33 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f6772c2b-0fbd-4b35-8228-01f007716765 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:59:33 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f6772c2b-0fbd-4b35-8228-01f007716765 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] {'allow_redirects': True, May 28 12:59:33 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f6772c2b-0fbd-4b35-8228-01f007716765 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] 'params': {'name': '7fdd602c-79d0-479c-95a2-336b202c6639'}} May 28 12:59:33 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-107e73a2-5a23-438c-84fb-d94ec41d32e9 tempest-ResourceLockDeleteTest-1157183439 tempest-ResourceLockDeleteTest-1157183439-project-member] GET http://10.27.203.238/share/v2/645fb190404541a78e449c703540d6f8/shares/2de4a970-0a05-4094-bdb1-ff3d4f9d20d2 May 28 12:59:33 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-107e73a2-5a23-438c-84fb-d94ec41d32e9 tempest-ResourceLockDeleteTest-1157183439 tempest-ResourceLockDeleteTest-1157183439-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:33 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-107e73a2-5a23-438c-84fb-d94ec41d32e9 tempest-ResourceLockDeleteTest-1157183439 tempest-ResourceLockDeleteTest-1157183439-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:33 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-107e73a2-5a23-438c-84fb-d94ec41d32e9 tempest-ResourceLockDeleteTest-1157183439 tempest-ResourceLockDeleteTest-1157183439-project-member] http://10.27.203.238/share/v2/645fb190404541a78e449c703540d6f8/shares/2de4a970-0a05-4094-bdb1-ff3d4f9d20d2 returned with HTTP 200 May 28 12:59:33 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 736/1488] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:59:33 2024] GET /share/v2/645fb190404541a78e449c703540d6f8/shares/2de4a970-0a05-4094-bdb1-ff3d4f9d20d2 => generated 1315 bytes in 28 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:59:33 l75lg1-v1 dstat.sh[49771]: 28-05 12:59:33| 8 1 90 2 0|5740M 1729M 277M 7879M| 17k 6189B| 0 1842k| 0 201 |4570 7293 |1.19 1.07 1.02|1.0 1.0 0| 0 0 | 0 2048M| 29 363 0 33 0 May 28 12:59:33 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-d8cc89b0-23f0-4bde-8fe7-fc07c3faf86f tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] GET http://10.27.203.238/share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/shares/8c461c9a-d030-496e-b267-c05fe4731b2f May 28 12:59:33 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-d8cc89b0-23f0-4bde-8fe7-fc07c3faf86f tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:33 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-d8cc89b0-23f0-4bde-8fe7-fc07c3faf86f tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:33 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-d8cc89b0-23f0-4bde-8fe7-fc07c3faf86f tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] http://10.27.203.238/share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/shares/8c461c9a-d030-496e-b267-c05fe4731b2f returned with HTTP 200 May 28 12:59:33 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 753/1489] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:59:33 2024] GET /share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/shares/8c461c9a-d030-496e-b267-c05fe4731b2f => generated 1369 bytes in 25 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:59:33 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0f7a88c6-2853-4848-8e3c-d55d80648534 tempest-ShareIpRulesForNFSTest-1748669711 None] <<< [PATCH] https://127.0.0.1:40443/api/viewpolicies/21/ May 28 12:59:33 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0f7a88c6-2853-4848-8e3c-d55d80648534 tempest-ShareIpRulesForNFSTest-1748669711 None] Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=1, created='2024-05-28T12:57:40.763635Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='377955ad-d094-4e49-ab32-1021d943a572', id=21, internal=False, is_s3_default_policy=False, name='b7a7d61c-2cea-442a-9809-507038e080d5', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=['*'], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=[], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=[], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='MODIFYING', sync_time='2024-05-28T12:59:32.652197Z', tenant_id=1, tenant_name='default', title='b7a7d61c-2cea-442a-9809-507038e080d5', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/21/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[]) May 28 12:59:33 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0f7a88c6-2853-4848-8e3c-d55d80648534 tempest-ShareIpRulesForNFSTest-1748669711 None] --- [PATCH] https://127.0.0.1:40443/api/viewpolicies/21/: Done May 28 12:59:33 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-0f7a88c6-2853-4848-8e3c-d55d80648534 tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:33 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-0f7a88c6-2853-4848-8e3c-d55d80648534 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:33 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-0f7a88c6-2853-4848-8e3c-d55d80648534 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.043s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:33 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-0f7a88c6-2853-4848-8e3c-d55d80648534 tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:33 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-0f7a88c6-2853-4848-8e3c-d55d80648534 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:33 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-0f7a88c6-2853-4848-8e3c-d55d80648534 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.033s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:33 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-0f7a88c6-2853-4848-8e3c-d55d80648534 tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:33 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-0f7a88c6-2853-4848-8e3c-d55d80648534 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:33 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-0f7a88c6-2853-4848-8e3c-d55d80648534 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.005s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:33 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-0f7a88c6-2853-4848-8e3c-d55d80648534 tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:33 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-0f7a88c6-2853-4848-8e3c-d55d80648534 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:33 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-0f7a88c6-2853-4848-8e3c-d55d80648534 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.004s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:33 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-0f7a88c6-2853-4848-8e3c-d55d80648534 tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:33 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-0f7a88c6-2853-4848-8e3c-d55d80648534 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:33 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-0f7a88c6-2853-4848-8e3c-d55d80648534 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.048s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:33 l75lg1-v1 manila-share[98474]: INFO manila.share.access [None req-0f7a88c6-2853-4848-8e3c-d55d80648534 tempest-ShareIpRulesForNFSTest-1748669711 None] Access rules were successfully modified for share instance b7a7d61c-2cea-442a-9809-507038e080d5 belonging to share 1ddadc17-cf10-4a42-8bbd-8335fb3520a1. May 28 12:59:33 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b3e7547a-dff0-4eb2-b72d-1538064bf1f1 tempest-ResourceLockDeleteTest-1157183439 None] <<< [DELETE] https://127.0.0.1:40443/api/quotas/33/ May 28 12:59:33 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b3e7547a-dff0-4eb2-b72d-1538064bf1f1 tempest-ResourceLockDeleteTest-1157183439 None] --- [DELETE] https://127.0.0.1:40443/api/quotas/33/: Done May 28 12:59:33 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b3e7547a-dff0-4eb2-b72d-1538064bf1f1 tempest-ResourceLockDeleteTest-1157183439 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:59:33 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b3e7547a-dff0-4eb2-b72d-1538064bf1f1 tempest-ResourceLockDeleteTest-1157183439 None] {'allow_redirects': True, May 28 12:59:33 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b3e7547a-dff0-4eb2-b72d-1538064bf1f1 tempest-ResourceLockDeleteTest-1157183439 None] 'params': {'name': 'b16b1d63-ae6f-4f71-846e-84edd63a87f6'}} May 28 12:59:33 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f6772c2b-0fbd-4b35-8228-01f007716765 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:59:33 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f6772c2b-0fbd-4b35-8228-01f007716765 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] [Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=1, created='2024-05-28T12:58:43.845440Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='31b6534b-d142-4561-992f-4f0759db302d', id=32, internal=False, is_s3_default_policy=False, name='7fdd602c-79d0-479c-95a2-336b202c6639', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=['*'], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=[], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=[], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T12:59:32.000989Z', tenant_id=1, tenant_name='default', title='7fdd602c-79d0-479c-95a2-336b202c6639', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/32/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[])] May 28 12:59:33 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f6772c2b-0fbd-4b35-8228-01f007716765 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 12:59:33 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-f6772c2b-0fbd-4b35-8228-01f007716765 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:33 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-f6772c2b-0fbd-4b35-8228-01f007716765 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:33 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-f6772c2b-0fbd-4b35-8228-01f007716765 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.073s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:33 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-f6772c2b-0fbd-4b35-8228-01f007716765 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:33 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-f6772c2b-0fbd-4b35-8228-01f007716765 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:33 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-f6772c2b-0fbd-4b35-8228-01f007716765 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:33 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-f6772c2b-0fbd-4b35-8228-01f007716765 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:33 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-f6772c2b-0fbd-4b35-8228-01f007716765 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:33 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-d0cab7be-09aa-4ee6-8f75-24098b0190a8 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] GET http://10.27.203.238/share/v2/776f75906bc64f8f9316d5aab4b50bf1/share-access-rules?share_id=1ddadc17-cf10-4a42-8bbd-8335fb3520a1 May 28 12:59:33 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-f6772c2b-0fbd-4b35-8228-01f007716765 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.004s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:33 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-f6772c2b-0fbd-4b35-8228-01f007716765 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:33 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-f6772c2b-0fbd-4b35-8228-01f007716765 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:33 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-d0cab7be-09aa-4ee6-8f75-24098b0190a8 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:33 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-d0cab7be-09aa-4ee6-8f75-24098b0190a8 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:33 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-f6772c2b-0fbd-4b35-8228-01f007716765 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:33 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-f6772c2b-0fbd-4b35-8228-01f007716765 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:33 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-f6772c2b-0fbd-4b35-8228-01f007716765 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:33 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-d0cab7be-09aa-4ee6-8f75-24098b0190a8 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] http://10.27.203.238/share/v2/776f75906bc64f8f9316d5aab4b50bf1/share-access-rules?share_id=1ddadc17-cf10-4a42-8bbd-8335fb3520a1 returned with HTTP 200 May 28 12:59:33 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 737/1490] 10.27.203.238 () {64 vars in 1467 bytes} [Tue May 28 12:59:33 2024] GET /share/v2/776f75906bc64f8f9316d5aab4b50bf1/share-access-rules?share_id=1ddadc17-cf10-4a42-8bbd-8335fb3520a1 => generated 19 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:59:33 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-b292ab86-6ca1-4371-8218-f8aa8cb445ca tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] POST http://10.27.203.238/share/v2/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action May 28 12:59:33 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-b292ab86-6ca1-4371-8218-f8aa8cb445ca tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Action body: b'{"allow_access": {"access_type": "ip", "access_to": "2.2.2.2", "access_level": "ro"}}' {{(pid=98329) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:59:33 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-b292ab86-6ca1-4371-8218-f8aa8cb445ca tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Action: 'action', calling method: ShareController.allow_access, body: {"allow_access": {"access_type": "ip", "access_to": "2.2.2.2", "access_level": "ro"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:59:33 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-f6772c2b-0fbd-4b35-8228-01f007716765 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.047s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:33 l75lg1-v1 manila-share[98474]: INFO manila.share.access [None req-f6772c2b-0fbd-4b35-8228-01f007716765 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Access rules were successfully modified for share instance 7fdd602c-79d0-479c-95a2-336b202c6639 belonging to share 72db8769-ece7-42ff-af27-2e778292a9b4. May 28 12:59:33 l75lg1-v1 devstack@m-api.service[98329]: DEBUG oslo_concurrency.lockutils [None req-b292ab86-6ca1-4371-8218-f8aa8cb445ca tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98329) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:33 l75lg1-v1 devstack@m-api.service[98329]: DEBUG oslo_concurrency.lockutils [None req-b292ab86-6ca1-4371-8218-f8aa8cb445ca tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98329) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:33 l75lg1-v1 devstack@m-api.service[98329]: DEBUG oslo_concurrency.lockutils [None req-b292ab86-6ca1-4371-8218-f8aa8cb445ca tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.039s {{(pid=98329) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:33 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-b292ab86-6ca1-4371-8218-f8aa8cb445ca tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] http://10.27.203.238/share/v2/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action returned with HTTP 200 May 28 12:59:33 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 754/1491] 10.27.203.238 () {66 vars in 1493 bytes} [Tue May 28 12:59:33 2024] POST /share/v2/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action => generated 305 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:59:33 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-49fb3482-5f3c-4daa-981d-fb20a4d6e59d tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] GET http://10.27.203.238/share/v2/776f75906bc64f8f9316d5aab4b50bf1/share-access-rules?share_id=1ddadc17-cf10-4a42-8bbd-8335fb3520a1 May 28 12:59:33 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-49fb3482-5f3c-4daa-981d-fb20a4d6e59d tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:33 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-49fb3482-5f3c-4daa-981d-fb20a4d6e59d tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:33 l75lg1-v1 manila-share[98474]: DEBUG manila.share.manager [None req-b292ab86-6ca1-4371-8218-f8aa8cb445ca tempest-ShareIpRulesForNFSTest-1748669711 None] Received request to update access for share instance b7a7d61c-2cea-442a-9809-507038e080d5. {{(pid=98474) update_access_for_instances /opt/stack/manila/manila/share/manager.py:4353}} May 28 12:59:33 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-b292ab86-6ca1-4371-8218-f8aa8cb445ca tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:33 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-b292ab86-6ca1-4371-8218-f8aa8cb445ca tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:33 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.lock.api [None req-49fb3482-5f3c-4daa-981d-fb20a4d6e59d tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Searching for locks by: {'resource_id': '3b8c1ee2-429e-433d-9592-2ba2cd2834af', 'resource_action': 'show', 'resource_type': 'access_rule'} {{(pid=98330) get_all /opt/stack/manila/manila/lock/api.py:112}} May 28 12:59:33 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-b292ab86-6ca1-4371-8218-f8aa8cb445ca tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.004s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:33 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-b292ab86-6ca1-4371-8218-f8aa8cb445ca tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:33 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-b292ab86-6ca1-4371-8218-f8aa8cb445ca tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:33 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-49fb3482-5f3c-4daa-981d-fb20a4d6e59d tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] http://10.27.203.238/share/v2/776f75906bc64f8f9316d5aab4b50bf1/share-access-rules?share_id=1ddadc17-cf10-4a42-8bbd-8335fb3520a1 returned with HTTP 200 May 28 12:59:33 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 738/1492] 10.27.203.238 () {64 vars in 1467 bytes} [Tue May 28 12:59:33 2024] GET /share/v2/776f75906bc64f8f9316d5aab4b50bf1/share-access-rules?share_id=1ddadc17-cf10-4a42-8bbd-8335fb3520a1 => generated 260 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 231 bytes (2 switches on core 0) May 28 12:59:34 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-b292ab86-6ca1-4371-8218-f8aa8cb445ca tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.055s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:34 l75lg1-v1 manila-share[98474]: DEBUG manila.share.access [None req-b292ab86-6ca1-4371-8218-f8aa8cb445ca tempest-ShareIpRulesForNFSTest-1748669711 None] Updating access rules for share instance b7a7d61c-2cea-442a-9809-507038e080d5 belonging to share 1ddadc17-cf10-4a42-8bbd-8335fb3520a1. {{(pid=98474) update_access_rules /opt/stack/manila/manila/share/access.py:298}} May 28 12:59:34 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-b292ab86-6ca1-4371-8218-f8aa8cb445ca tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:34 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-b292ab86-6ca1-4371-8218-f8aa8cb445ca tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:34 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-21a13525-ffbb-4ef6-bcdf-5eefd6b9cefc tempest-ResourceLockNegativeTestWithShares-789426285 None] <<< [POST] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:59:34 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-21a13525-ffbb-4ef6-bcdf-5eefd6b9cefc tempest-ResourceLockNegativeTestWithShares-789426285 None] Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=0, created='2024-05-28T12:59:33.611257Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='bf977100-91be-426a-a144-d77a77a436f6', id=37, internal=False, is_s3_default_policy=False, name='f1a7f25a-f865-4592-93e1-c1e62b2447b8', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=[], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['*'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['*'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T12:59:33.978437Z', tenant_id=1, tenant_name='default', title='f1a7f25a-f865-4592-93e1-c1e62b2447b8', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/37/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[]) May 28 12:59:34 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-21a13525-ffbb-4ef6-bcdf-5eefd6b9cefc tempest-ResourceLockNegativeTestWithShares-789426285 None] --- [POST] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 12:59:34 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-21a13525-ffbb-4ef6-bcdf-5eefd6b9cefc tempest-ResourceLockNegativeTestWithShares-789426285 None] >>> [GET] https://127.0.0.1:40443/api/quotas/ May 28 12:59:34 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-21a13525-ffbb-4ef6-bcdf-5eefd6b9cefc tempest-ResourceLockNegativeTestWithShares-789426285 None] {'allow_redirects': True, May 28 12:59:34 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-21a13525-ffbb-4ef6-bcdf-5eefd6b9cefc tempest-ResourceLockNegativeTestWithShares-789426285 None] 'params': {'name': 'f1a7f25a-f865-4592-93e1-c1e62b2447b8'}} May 28 12:59:34 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-b292ab86-6ca1-4371-8218-f8aa8cb445ca tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.012s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:34 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-b292ab86-6ca1-4371-8218-f8aa8cb445ca tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:34 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-b292ab86-6ca1-4371-8218-f8aa8cb445ca tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:34 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-b292ab86-6ca1-4371-8218-f8aa8cb445ca tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.073s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:34 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-b292ab86-6ca1-4371-8218-f8aa8cb445ca tempest-ShareIpRulesForNFSTest-1748669711 None] changing access on None May 28 12:59:34 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b292ab86-6ca1-4371-8218-f8aa8cb445ca tempest-ShareIpRulesForNFSTest-1748669711 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:59:34 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b292ab86-6ca1-4371-8218-f8aa8cb445ca tempest-ShareIpRulesForNFSTest-1748669711 None] {'allow_redirects': True, May 28 12:59:34 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b292ab86-6ca1-4371-8218-f8aa8cb445ca tempest-ShareIpRulesForNFSTest-1748669711 None] 'params': {'name': 'b7a7d61c-2cea-442a-9809-507038e080d5'}} May 28 12:59:34 l75lg1-v1 dstat.sh[49771]: 28-05 12:59:34| 8 1 90 2 0|5740M 1729M 277M 7879M| 17k 5019B| 0 2080k| 0 199 |4236 7098 |1.19 1.07 1.02|1.0 1.0 0| 0 0 | 0 2048M| 29 363 0 33 0 May 28 12:59:34 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b3e7547a-dff0-4eb2-b72d-1538064bf1f1 tempest-ResourceLockDeleteTest-1157183439 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:59:34 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b3e7547a-dff0-4eb2-b72d-1538064bf1f1 tempest-ResourceLockDeleteTest-1157183439 None] [Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=0, created='2024-05-28T12:59:21.728524Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='0aadea7a-6266-46a2-8223-c9c2564969e3', id=36, internal=False, is_s3_default_policy=False, name='b16b1d63-ae6f-4f71-846e-84edd63a87f6', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=[], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['*'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['*'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T12:59:22.084991Z', tenant_id=1, tenant_name='default', title='b16b1d63-ae6f-4f71-846e-84edd63a87f6', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/36/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[])] May 28 12:59:34 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b3e7547a-dff0-4eb2-b72d-1538064bf1f1 tempest-ResourceLockDeleteTest-1157183439 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 12:59:34 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b3e7547a-dff0-4eb2-b72d-1538064bf1f1 tempest-ResourceLockDeleteTest-1157183439 None] >>> [DELETE] https://127.0.0.1:40443/api/viewpolicies/36/ May 28 12:59:34 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-21a13525-ffbb-4ef6-bcdf-5eefd6b9cefc tempest-ResourceLockNegativeTestWithShares-789426285 None] <<< [GET] https://127.0.0.1:40443/api/quotas/ May 28 12:59:34 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-21a13525-ffbb-4ef6-bcdf-5eefd6b9cefc tempest-ResourceLockNegativeTestWithShares-789426285 None] [] May 28 12:59:34 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-21a13525-ffbb-4ef6-bcdf-5eefd6b9cefc tempest-ResourceLockNegativeTestWithShares-789426285 None] --- [GET] https://127.0.0.1:40443/api/quotas/: Done May 28 12:59:34 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-21a13525-ffbb-4ef6-bcdf-5eefd6b9cefc tempest-ResourceLockNegativeTestWithShares-789426285 None] >>> [POST] https://127.0.0.1:40443/api/quotas/ May 28 12:59:34 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-21a13525-ffbb-4ef6-bcdf-5eefd6b9cefc tempest-ResourceLockNegativeTestWithShares-789426285 None] {'data': '{"name": "f1a7f25a-f865-4592-93e1-c1e62b2447b8", "path": ' May 28 12:59:34 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-21a13525-ffbb-4ef6-bcdf-5eefd6b9cefc tempest-ResourceLockNegativeTestWithShares-789426285 None] '"/manila/manila-f1a7f25a-f865-4592-93e1-c1e62b2447b8", "create_dir": ' May 28 12:59:34 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-21a13525-ffbb-4ef6-bcdf-5eefd6b9cefc tempest-ResourceLockNegativeTestWithShares-789426285 None] 'true, "hard_limit": 1073741824}', May 28 12:59:34 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-21a13525-ffbb-4ef6-bcdf-5eefd6b9cefc tempest-ResourceLockNegativeTestWithShares-789426285 None] 'json': None, May 28 12:59:34 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-21a13525-ffbb-4ef6-bcdf-5eefd6b9cefc tempest-ResourceLockNegativeTestWithShares-789426285 None] 'params': None} May 28 12:59:34 l75lg1-v1 neutron-server[77623]: DEBUG dbcounter [-] [77623] Writing DB stats neutron:SELECT=1 {{(pid=77623) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:59:34 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b292ab86-6ca1-4371-8218-f8aa8cb445ca tempest-ShareIpRulesForNFSTest-1748669711 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:59:34 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b292ab86-6ca1-4371-8218-f8aa8cb445ca tempest-ShareIpRulesForNFSTest-1748669711 None] [Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=1, created='2024-05-28T12:57:40.763635Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='377955ad-d094-4e49-ab32-1021d943a572', id=21, internal=False, is_s3_default_policy=False, name='b7a7d61c-2cea-442a-9809-507038e080d5', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=['*'], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=[], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=[], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T12:59:33.405811Z', tenant_id=1, tenant_name='default', title='b7a7d61c-2cea-442a-9809-507038e080d5', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/21/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[])] May 28 12:59:34 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b292ab86-6ca1-4371-8218-f8aa8cb445ca tempest-ShareIpRulesForNFSTest-1748669711 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 12:59:34 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-b292ab86-6ca1-4371-8218-f8aa8cb445ca tempest-ShareIpRulesForNFSTest-1748669711 None] changing access on /manila/manila-b7a7d61c-2cea-442a-9809-507038e080d5. Rules: {'nfs_read_write': [], 'nfs_read_only': ['2.2.2.2']} May 28 12:59:34 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b292ab86-6ca1-4371-8218-f8aa8cb445ca tempest-ShareIpRulesForNFSTest-1748669711 None] >>> [PATCH] https://127.0.0.1:40443/api/viewpolicies/21/ May 28 12:59:34 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b292ab86-6ca1-4371-8218-f8aa8cb445ca tempest-ShareIpRulesForNFSTest-1748669711 None] {'data': '{"name": "b7a7d61c-2cea-442a-9809-507038e080d5", "nfs_no_squash": ' May 28 12:59:34 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b292ab86-6ca1-4371-8218-f8aa8cb445ca tempest-ShareIpRulesForNFSTest-1748669711 None] '["*"], "nfs_root_squash": ["*"], "nfs_read_write": [], ' May 28 12:59:34 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b292ab86-6ca1-4371-8218-f8aa8cb445ca tempest-ShareIpRulesForNFSTest-1748669711 None] '"nfs_read_only": ["2.2.2.2"]}', May 28 12:59:34 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b292ab86-6ca1-4371-8218-f8aa8cb445ca tempest-ShareIpRulesForNFSTest-1748669711 None] 'params': None} May 28 12:59:35 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-21a13525-ffbb-4ef6-bcdf-5eefd6b9cefc tempest-ResourceLockNegativeTestWithShares-789426285 None] <<< [POST] https://127.0.0.1:40443/api/quotas/ May 28 12:59:35 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-21a13525-ffbb-4ef6-bcdf-5eefd6b9cefc tempest-ResourceLockNegativeTestWithShares-789426285 None] Bunch(cluster='loop75-kfs', cluster_id=1, default_email=None, default_group_quota=None, default_user_quota=None, enable_alarms=True, enable_email_providers=True, grace_period=None, group_quotas=[], guid='9e1e633e-3738-4034-b8a1-531e54112a1a', hard_limit=1073741824, hard_limit_inodes=None, id=34, internal=False, is_user_quota=False, last_user_quotas_update=None, name='f1a7f25a-f865-4592-93e1-c1e62b2447b8', num_blocked_users=0, num_exceeded_users=0, path='/manila/manila-f1a7f25a-f865-4592-93e1-c1e62b2447b8', percent_capacity=0, percent_inodes=None, pretty_grace_period=None, pretty_grace_period_expiration=None, pretty_state='OK (CREATED)', soft_limit=None, soft_limit_inodes=None, state='OK', sync_state='CREATED', system_id=34, tenant_id=1, tenant_name='default', time_to_block=None, title='f1a7f25a-f865-4592-93e1-c1e62b2447b8', url='https://127.0.0.1:40443/api/quotas/34/', used_capacity=0, used_capacity_tb=0.0, used_effective_capacity=0, used_effective_capacity_tb=0.0, used_inodes=0, used_limited_capacity=0, user_quotas=[]) May 28 12:59:35 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-21a13525-ffbb-4ef6-bcdf-5eefd6b9cefc tempest-ResourceLockNegativeTestWithShares-789426285 None] --- [POST] https://127.0.0.1:40443/api/quotas/: Done May 28 12:59:35 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-21a13525-ffbb-4ef6-bcdf-5eefd6b9cefc tempest-ResourceLockNegativeTestWithShares-789426285 None] >>> [GET] https://127.0.0.1:40443/api/views/ May 28 12:59:35 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-21a13525-ffbb-4ef6-bcdf-5eefd6b9cefc tempest-ResourceLockNegativeTestWithShares-789426285 None] {'allow_redirects': True, May 28 12:59:35 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-21a13525-ffbb-4ef6-bcdf-5eefd6b9cefc tempest-ResourceLockNegativeTestWithShares-789426285 None] 'params': {'name': 'f1a7f25a-f865-4592-93e1-c1e62b2447b8'}} May 28 12:59:35 l75lg1-v1 dstat.sh[49771]: 28-05 12:59:35| 1 1 95 4 0|5740M 1729M 277M 7879M| 20k 3284B| 0 6257k| 0 441 |2939 4571 |1.19 1.07 1.02|1.0 1.0 0| 0 0 | 0 2048M| 29 363 0 33 0 May 28 12:59:35 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-547ac8b8-8ef8-435b-952e-d2881a31115b tempest-ResourceLockNegativeTestWithShares-789426285 tempest-ResourceLockNegativeTestWithShares-789426285-project-member] GET http://10.27.203.238/share/v2/86e4aff17ad94d75a624b038464bfeb2/shares/a5984861-5086-4848-82ce-0960e763197b May 28 12:59:35 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-547ac8b8-8ef8-435b-952e-d2881a31115b tempest-ResourceLockNegativeTestWithShares-789426285 tempest-ResourceLockNegativeTestWithShares-789426285-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:35 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-547ac8b8-8ef8-435b-952e-d2881a31115b tempest-ResourceLockNegativeTestWithShares-789426285 tempest-ResourceLockNegativeTestWithShares-789426285-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:35 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-547ac8b8-8ef8-435b-952e-d2881a31115b tempest-ResourceLockNegativeTestWithShares-789426285 tempest-ResourceLockNegativeTestWithShares-789426285-project-member] http://10.27.203.238/share/v2/86e4aff17ad94d75a624b038464bfeb2/shares/a5984861-5086-4848-82ce-0960e763197b returned with HTTP 200 May 28 12:59:35 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 755/1493] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:59:35 2024] GET /share/v2/86e4aff17ad94d75a624b038464bfeb2/shares/a5984861-5086-4848-82ce-0960e763197b => generated 1311 bytes in 28 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:59:35 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-21a13525-ffbb-4ef6-bcdf-5eefd6b9cefc tempest-ResourceLockNegativeTestWithShares-789426285 None] <<< [GET] https://127.0.0.1:40443/api/views/ May 28 12:59:35 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-21a13525-ffbb-4ef6-bcdf-5eefd6b9cefc tempest-ResourceLockNegativeTestWithShares-789426285 None] [] May 28 12:59:35 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-21a13525-ffbb-4ef6-bcdf-5eefd6b9cefc tempest-ResourceLockNegativeTestWithShares-789426285 None] --- [GET] https://127.0.0.1:40443/api/views/: Done May 28 12:59:35 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-21a13525-ffbb-4ef6-bcdf-5eefd6b9cefc tempest-ResourceLockNegativeTestWithShares-789426285 None] >>> [POST] https://127.0.0.1:40443/api/views/ May 28 12:59:35 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-21a13525-ffbb-4ef6-bcdf-5eefd6b9cefc tempest-ResourceLockNegativeTestWithShares-789426285 None] {'data': '{"name": "f1a7f25a-f865-4592-93e1-c1e62b2447b8", "path": ' May 28 12:59:35 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-21a13525-ffbb-4ef6-bcdf-5eefd6b9cefc tempest-ResourceLockNegativeTestWithShares-789426285 None] '"/manila/manila-f1a7f25a-f865-4592-93e1-c1e62b2447b8", "policy_id": ' May 28 12:59:35 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-21a13525-ffbb-4ef6-bcdf-5eefd6b9cefc tempest-ResourceLockNegativeTestWithShares-789426285 None] '37, "create_dir": true, "protocols": ["NFS"]}', May 28 12:59:35 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-21a13525-ffbb-4ef6-bcdf-5eefd6b9cefc tempest-ResourceLockNegativeTestWithShares-789426285 None] 'json': None, May 28 12:59:35 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-21a13525-ffbb-4ef6-bcdf-5eefd6b9cefc tempest-ResourceLockNegativeTestWithShares-789426285 None] 'params': None} May 28 12:59:35 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b3e7547a-dff0-4eb2-b72d-1538064bf1f1 tempest-ResourceLockDeleteTest-1157183439 None] <<< [DELETE] https://127.0.0.1:40443/api/viewpolicies/36/ May 28 12:59:35 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b3e7547a-dff0-4eb2-b72d-1538064bf1f1 tempest-ResourceLockDeleteTest-1157183439 None] --- [DELETE] https://127.0.0.1:40443/api/viewpolicies/36/: Done May 28 12:59:36 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-8b195518-411d-4b44-b3bf-5c4d402d7080 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] GET http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/share-access-rules?share_id=72db8769-ece7-42ff-af27-2e778292a9b4 May 28 12:59:36 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-8b195518-411d-4b44-b3bf-5c4d402d7080 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:36 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-8b195518-411d-4b44-b3bf-5c4d402d7080 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:36 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-b3e7547a-dff0-4eb2-b72d-1538064bf1f1 tempest-ResourceLockDeleteTest-1157183439 None] Created reservations ['4e400725-dcbe-4aeb-9bc9-ecde1be39777', 'cda6550c-3bcf-49d1-962a-50a11fc59f1c', '7a59bcd6-57dc-4e82-b30f-d3bf481e9d7e', 'd2dcb355-2ff0-4b87-9eba-d60cf226733a'] {{(pid=98474) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 12:59:36 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.lock.api [None req-8b195518-411d-4b44-b3bf-5c4d402d7080 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Searching for locks by: {'resource_id': '57a01137-a0cf-440f-ae42-3e69a0a2c1ed', 'resource_action': 'show', 'resource_type': 'access_rule'} {{(pid=98330) get_all /opt/stack/manila/manila/lock/api.py:112}} May 28 12:59:36 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-8b195518-411d-4b44-b3bf-5c4d402d7080 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/share-access-rules?share_id=72db8769-ece7-42ff-af27-2e778292a9b4 returned with HTTP 200 May 28 12:59:36 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-b3e7547a-dff0-4eb2-b72d-1538064bf1f1 tempest-ResourceLockDeleteTest-1157183439 None] Committed reservations ['4e400725-dcbe-4aeb-9bc9-ecde1be39777', 'cda6550c-3bcf-49d1-962a-50a11fc59f1c', '7a59bcd6-57dc-4e82-b30f-d3bf481e9d7e', 'd2dcb355-2ff0-4b87-9eba-d60cf226733a'] {{(pid=98474) commit /opt/stack/manila/manila/quota.py:1063}} May 28 12:59:36 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 739/1494] 10.27.203.238 () {64 vars in 1467 bytes} [Tue May 28 12:59:36 2024] GET /share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/share-access-rules?share_id=72db8769-ece7-42ff-af27-2e778292a9b4 => generated 290 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:59:36 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-d57bab92-f9e8-40e7-bd87-5230159a27f9 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] POST http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action May 28 12:59:36 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-d57bab92-f9e8-40e7-bd87-5230159a27f9 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Action body: b'{"allow_access": {"access_type": "ip", "access_to": "fd8c:b029:bba6:ac54::1", "access_level": null}}' {{(pid=98329) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:59:36 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-d57bab92-f9e8-40e7-bd87-5230159a27f9 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Action: 'action', calling method: ShareController.allow_access, body: {"allow_access": {"access_type": "ip", "access_to": "fd8c:b029:bba6:ac54::1", "access_level": null}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:59:36 l75lg1-v1 manila-share[98474]: INFO manila.share.manager [None req-b3e7547a-dff0-4eb2-b72d-1538064bf1f1 tempest-ResourceLockDeleteTest-1157183439 None] Share instance b16b1d63-ae6f-4f71-846e-84edd63a87f6: deleted successfully. May 28 12:59:36 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-d57bab92-f9e8-40e7-bd87-5230159a27f9 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] HTTP exception thrown: Share access ip:fd8c:b029:bba6:ac54::1 exists. May 28 12:59:36 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-d57bab92-f9e8-40e7-bd87-5230159a27f9 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action returned with HTTP 400 May 28 12:59:36 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 756/1495] 10.27.203.238 () {66 vars in 1494 bytes} [Tue May 28 12:59:36 2024] POST /share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action => generated 90 bytes in 40 msecs (HTTP/1.1 400) 6 headers in 239 bytes (1 switches on core 0) May 28 12:59:36 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-9c94544b-235e-4da2-a3dd-362ce9085679 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] POST http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action May 28 12:59:36 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-9c94544b-235e-4da2-a3dd-362ce9085679 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Action body: b'{"allow_access": {"access_type": "ip", "access_to": "fd8c:b029:bba6:ac54::1/128", "access_level": null}}' {{(pid=98330) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:59:36 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-9c94544b-235e-4da2-a3dd-362ce9085679 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Action: 'action', calling method: ShareController.allow_access, body: {"allow_access": {"access_type": "ip", "access_to": "fd8c:b029:bba6:ac54::1/128", "access_level": null}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:59:36 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-9c94544b-235e-4da2-a3dd-362ce9085679 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] HTTP exception thrown: Share access ip:fd8c:b029:bba6:ac54::1/128 exists. May 28 12:59:36 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-9c94544b-235e-4da2-a3dd-362ce9085679 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action returned with HTTP 400 May 28 12:59:36 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 740/1496] 10.27.203.238 () {66 vars in 1494 bytes} [Tue May 28 12:59:36 2024] POST /share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action => generated 94 bytes in 37 msecs (HTTP/1.1 400) 6 headers in 239 bytes (1 switches on core 0) May 28 12:59:36 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-df342792-d57c-4cd5-a407-d4ac8735b849 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] POST http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action May 28 12:59:36 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-df342792-d57c-4cd5-a407-d4ac8735b849 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Action body: b'{"deny_access": {"access_id": "57a01137-a0cf-440f-ae42-3e69a0a2c1ed"}}' {{(pid=98329) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:59:36 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-df342792-d57c-4cd5-a407-d4ac8735b849 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Action: 'action', calling method: ShareController.deny_access, body: {"deny_access": {"access_id": "57a01137-a0cf-440f-ae42-3e69a0a2c1ed"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:59:36 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.lock.api [None req-df342792-d57c-4cd5-a407-d4ac8735b849 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Searching for locks by: {'resource_id': '57a01137-a0cf-440f-ae42-3e69a0a2c1ed', 'resource_action': 'delete'} {{(pid=98329) get_all /opt/stack/manila/manila/lock/api.py:112}} May 28 12:59:36 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-75e34fbd-90e9-4d2a-ab7e-3db51e762b80 tempest-ResourceLockDeleteTest-1157183439 tempest-ResourceLockDeleteTest-1157183439-project-member] GET http://10.27.203.238/share/v2/645fb190404541a78e449c703540d6f8/shares/2de4a970-0a05-4094-bdb1-ff3d4f9d20d2 May 28 12:59:36 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-75e34fbd-90e9-4d2a-ab7e-3db51e762b80 tempest-ResourceLockDeleteTest-1157183439 tempest-ResourceLockDeleteTest-1157183439-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:36 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-75e34fbd-90e9-4d2a-ab7e-3db51e762b80 tempest-ResourceLockDeleteTest-1157183439 tempest-ResourceLockDeleteTest-1157183439-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:36 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-75e34fbd-90e9-4d2a-ab7e-3db51e762b80 tempest-ResourceLockDeleteTest-1157183439 tempest-ResourceLockDeleteTest-1157183439-project-member] HTTP exception thrown: The resource could not be found. May 28 12:59:36 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-75e34fbd-90e9-4d2a-ab7e-3db51e762b80 tempest-ResourceLockDeleteTest-1157183439 tempest-ResourceLockDeleteTest-1157183439-project-member] http://10.27.203.238/share/v2/645fb190404541a78e449c703540d6f8/shares/2de4a970-0a05-4094-bdb1-ff3d4f9d20d2 returned with HTTP 404 May 28 12:59:36 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 741/1497] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:59:36 2024] GET /share/v2/645fb190404541a78e449c703540d6f8/shares/2de4a970-0a05-4094-bdb1-ff3d4f9d20d2 => generated 78 bytes in 11 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 12:59:36 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-41f94a8c-2768-49c5-9c74-c588df210d9d tempest-ResourceLockDeleteTest-1157183439 tempest-ResourceLockDeleteTest-1157183439-project-member] DELETE http://10.27.203.238/share/v2/645fb190404541a78e449c703540d6f8/resource-locks/4111d7b0-6c61-4ac3-8e3b-8314352b0c10 May 28 12:59:36 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-41f94a8c-2768-49c5-9c74-c588df210d9d tempest-ResourceLockDeleteTest-1157183439 tempest-ResourceLockDeleteTest-1157183439-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:36 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-41f94a8c-2768-49c5-9c74-c588df210d9d tempest-ResourceLockDeleteTest-1157183439 tempest-ResourceLockDeleteTest-1157183439-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:36 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-41f94a8c-2768-49c5-9c74-c588df210d9d tempest-ResourceLockDeleteTest-1157183439 tempest-ResourceLockDeleteTest-1157183439-project-member] HTTP exception thrown: Resource lock 4111d7b0-6c61-4ac3-8e3b-8314352b0c10 could not be found. May 28 12:59:36 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-41f94a8c-2768-49c5-9c74-c588df210d9d tempest-ResourceLockDeleteTest-1157183439 tempest-ResourceLockDeleteTest-1157183439-project-member] http://10.27.203.238/share/v2/645fb190404541a78e449c703540d6f8/resource-locks/4111d7b0-6c61-4ac3-8e3b-8314352b0c10 returned with HTTP 404 May 28 12:59:36 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 742/1498] 10.27.203.238 () {64 vars in 1478 bytes} [Tue May 28 12:59:36 2024] DELETE /share/v2/645fb190404541a78e449c703540d6f8/resource-locks/4111d7b0-6c61-4ac3-8e3b-8314352b0c10 => generated 116 bytes in 10 msecs (HTTP/1.1 404) 6 headers in 238 bytes (2 switches on core 0) May 28 12:59:36 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-6b105217-53f9-493b-9627-139711c1f4e4 tempest-ResourceLockDeleteTest-1157183439 tempest-ResourceLockDeleteTest-1157183439-project-member] DELETE http://10.27.203.238/share/v2/645fb190404541a78e449c703540d6f8/resource-locks/388f9c8c-df32-491d-82b2-a8b6107b32d8 May 28 12:59:36 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-6b105217-53f9-493b-9627-139711c1f4e4 tempest-ResourceLockDeleteTest-1157183439 tempest-ResourceLockDeleteTest-1157183439-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:36 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-6b105217-53f9-493b-9627-139711c1f4e4 tempest-ResourceLockDeleteTest-1157183439 tempest-ResourceLockDeleteTest-1157183439-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:36 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-6b105217-53f9-493b-9627-139711c1f4e4 tempest-ResourceLockDeleteTest-1157183439 tempest-ResourceLockDeleteTest-1157183439-project-member] HTTP exception thrown: Resource lock 388f9c8c-df32-491d-82b2-a8b6107b32d8 could not be found. May 28 12:59:36 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-6b105217-53f9-493b-9627-139711c1f4e4 tempest-ResourceLockDeleteTest-1157183439 tempest-ResourceLockDeleteTest-1157183439-project-member] http://10.27.203.238/share/v2/645fb190404541a78e449c703540d6f8/resource-locks/388f9c8c-df32-491d-82b2-a8b6107b32d8 returned with HTTP 404 May 28 12:59:36 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 743/1499] 10.27.203.238 () {64 vars in 1478 bytes} [Tue May 28 12:59:36 2024] DELETE /share/v2/645fb190404541a78e449c703540d6f8/resource-locks/388f9c8c-df32-491d-82b2-a8b6107b32d8 => generated 116 bytes in 9 msecs (HTTP/1.1 404) 6 headers in 238 bytes (2 switches on core 0) May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e67d5c9-f251-47ca-976e-c6baca522e64 service manila] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-1e67d5c9-f251-47ca-976e-c6baca522e64 service manila] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:59:36 l75lg1-v1 dstat.sh[49771]: 28-05 12:59:36| 5 0 94 1 0|5740M 1728M 277M 7879M| 13k 9410B| 0 871k| 0 98.9 |3227 5327 |1.19 1.07 1.02|5.0 1.0 0| 0 0 | 0 2048M| 29 365 0 34 0 May 28 12:59:36 l75lg1-v1 devstack@m-api.service[98329]: DEBUG oslo_concurrency.lockutils [None req-df342792-d57c-4cd5-a407-d4ac8735b849 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98329) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:36 l75lg1-v1 devstack@m-api.service[98329]: DEBUG oslo_concurrency.lockutils [None req-df342792-d57c-4cd5-a407-d4ac8735b849 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98329) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e67d5c9-f251-47ca-976e-c6baca522e64 service manila] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd70c10-2791-41be-bf3d-345b05e5b087 tempest-ResourceLockDeleteTest-671583867 tempest-ResourceLockDeleteTest-671583867-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caee34cb460c4ddcb13e607cbd3fabd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16bb859669ab42a3b7cc595a5e30eb2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd70c10-2791-41be-bf3d-345b05e5b087 tempest-ResourceLockDeleteTest-671583867 tempest-ResourceLockDeleteTest-671583867-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd70c10-2791-41be-bf3d-345b05e5b087 tempest-ResourceLockDeleteTest-671583867 tempest-ResourceLockDeleteTest-671583867-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd70c10-2791-41be-bf3d-345b05e5b087 tempest-ResourceLockDeleteTest-671583867 tempest-ResourceLockDeleteTest-671583867-project-admin] PATH_INFO: `/v3/users/8688f80695814f34bfb56342c4e54028` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd70c10-2791-41be-bf3d-345b05e5b087 tempest-ResourceLockDeleteTest-671583867 tempest-ResourceLockDeleteTest-671583867-project-admin] RBAC: Authorizing `identity:delete_user(user_id=8688f80695814f34bfb56342c4e54028)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd70c10-2791-41be-bf3d-345b05e5b087 tempest-ResourceLockDeleteTest-671583867 tempest-ResourceLockDeleteTest-671583867-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-acd70c10-2791-41be-bf3d-345b05e5b087 tempest-ResourceLockDeleteTest-671583867 tempest-ResourceLockDeleteTest-671583867-project-admin] Could not find user: 8688f80695814f34bfb56342c4e54028.: keystone.exception.UserNotFound: Could not find user: 8688f80695814f34bfb56342c4e54028. May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 8688f80695814f34bfb56342c4e54028. May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1239/2503] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 12:59:36 2024] DELETE /identity/v3/users/8688f80695814f34bfb56342c4e54028 => generated 110 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed7b9a5-16a6-496c-8a29-12497af5ba00 service manila] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed7b9a5-16a6-496c-8a29-12497af5ba00 service manila] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdecf993-a694-4601-bcf5-4cc2217c5488 tempest-ResourceLockDeleteTest-671583867 tempest-ResourceLockDeleteTest-671583867-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caee34cb460c4ddcb13e607cbd3fabd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16bb859669ab42a3b7cc595a5e30eb2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdecf993-a694-4601-bcf5-4cc2217c5488 tempest-ResourceLockDeleteTest-671583867 tempest-ResourceLockDeleteTest-671583867-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdecf993-a694-4601-bcf5-4cc2217c5488 tempest-ResourceLockDeleteTest-671583867 tempest-ResourceLockDeleteTest-671583867-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdecf993-a694-4601-bcf5-4cc2217c5488 tempest-ResourceLockDeleteTest-671583867 tempest-ResourceLockDeleteTest-671583867-project-admin] PATH_INFO: `/v3/users/108a25e436e9452a9a865957dcea1fc5` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:36 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-e57f53ae-7d8f-43e9-9ada-2482d82c59e5 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] GET http://10.27.203.238/share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/messages May 28 12:59:36 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-e57f53ae-7d8f-43e9-9ada-2482d82c59e5 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:36 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-e57f53ae-7d8f-43e9-9ada-2482d82c59e5 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:36 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.message.api [None req-e57f53ae-7d8f-43e9-9ada-2482d82c59e5 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Searching for messages by: MultiDict([]) {{(pid=98330) get_all /opt/stack/manila/manila/message/api.py:78}} May 28 12:59:36 l75lg1-v1 devstack@m-api.service[98329]: DEBUG oslo_concurrency.lockutils [None req-df342792-d57c-4cd5-a407-d4ac8735b849 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.065s {{(pid=98329) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:36 l75lg1-v1 devstack@m-api.service[98329]: DEBUG oslo_concurrency.lockutils [None req-df342792-d57c-4cd5-a407-d4ac8735b849 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98329) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:36 l75lg1-v1 devstack@m-api.service[98329]: DEBUG oslo_concurrency.lockutils [None req-df342792-d57c-4cd5-a407-d4ac8735b849 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98329) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdecf993-a694-4601-bcf5-4cc2217c5488 tempest-ResourceLockDeleteTest-671583867 tempest-ResourceLockDeleteTest-671583867-project-admin] RBAC: Authorizing `identity:delete_user(user_id=108a25e436e9452a9a865957dcea1fc5)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdecf993-a694-4601-bcf5-4cc2217c5488 tempest-ResourceLockDeleteTest-671583867 tempest-ResourceLockDeleteTest-671583867-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:36 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-e57f53ae-7d8f-43e9-9ada-2482d82c59e5 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] http://10.27.203.238/share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/messages returned with HTTP 200 May 28 12:59:36 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 744/1500] 10.27.203.238 () {64 vars in 1346 bytes} [Tue May 28 12:59:36 2024] GET /share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/messages => generated 4019 bytes in 12 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:59:36 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-a9cecab2-4bc8-4ba1-82bf-f4f1364970de tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] POST http://10.27.203.238/share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/types May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-fdecf993-a694-4601-bcf5-4cc2217c5488 tempest-ResourceLockDeleteTest-671583867 tempest-ResourceLockDeleteTest-671583867-project-admin] Could not find user: 108a25e436e9452a9a865957dcea1fc5.: keystone.exception.UserNotFound: Could not find user: 108a25e436e9452a9a865957dcea1fc5. May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:59:36 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-a9cecab2-4bc8-4ba1-82bf-f4f1364970de tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share_type": {"name": "tempest-share-type-1208588171", "extra_specs": {"driver_handles_share_servers": false, "vendor_name": "foobar"}, "share_type_access:is_public": true}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 108a25e436e9452a9a865957dcea1fc5. May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1265/2504] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 12:59:36 2024] DELETE /identity/v3/users/108a25e436e9452a9a865957dcea1fc5 => generated 110 bytes in 28 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd70c10-2791-41be-bf3d-345b05e5b087 tempest-ResourceLockDeleteTest-671583867 tempest-ResourceLockDeleteTest-671583867-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd70c10-2791-41be-bf3d-345b05e5b087 tempest-ResourceLockDeleteTest-671583867 tempest-ResourceLockDeleteTest-671583867-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d947aa-a7e9-404d-b977-8b7dcc034e96 tempest-ResourceLockDeleteTest-671583867 tempest-ResourceLockDeleteTest-671583867-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caee34cb460c4ddcb13e607cbd3fabd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16bb859669ab42a3b7cc595a5e30eb2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d947aa-a7e9-404d-b977-8b7dcc034e96 tempest-ResourceLockDeleteTest-671583867 tempest-ResourceLockDeleteTest-671583867-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d947aa-a7e9-404d-b977-8b7dcc034e96 tempest-ResourceLockDeleteTest-671583867 tempest-ResourceLockDeleteTest-671583867-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d947aa-a7e9-404d-b977-8b7dcc034e96 tempest-ResourceLockDeleteTest-671583867 tempest-ResourceLockDeleteTest-671583867-project-admin] PATH_INFO: `/v3/users/5ae5cb1db3504baaba1df93dc154a004` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d947aa-a7e9-404d-b977-8b7dcc034e96 tempest-ResourceLockDeleteTest-671583867 tempest-ResourceLockDeleteTest-671583867-project-admin] RBAC: Authorizing `identity:delete_user(user_id=5ae5cb1db3504baaba1df93dc154a004)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:36 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-a9cecab2-4bc8-4ba1-82bf-f4f1364970de tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] http://10.27.203.238/share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/types returned with HTTP 200 May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d947aa-a7e9-404d-b977-8b7dcc034e96 tempest-ResourceLockDeleteTest-671583867 tempest-ResourceLockDeleteTest-671583867-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:36 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 745/1501] 10.27.203.238 () {66 vars in 1359 bytes} [Tue May 28 12:59:36 2024] POST /share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/types => generated 661 bytes in 24 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:59:36 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-3c238a3c-98f7-4462-aaca-24becb87c055 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] POST http://10.27.203.238/share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/shares May 28 12:59:36 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-3c238a3c-98f7-4462-aaca-24becb87c055 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share": {"share_proto": "nfs", "description": "tempest-tempest-created-share-desc-1343000994", "snapshot_id": null, "name": "tempest-tempest-created-share-1133633479", "size": 1, "metadata": {}, "is_public": false, "share_type": "8ba62ddc-37c8-4aa2-91e9-6e9922bf3c3b"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-00d947aa-a7e9-404d-b977-8b7dcc034e96 tempest-ResourceLockDeleteTest-671583867 tempest-ResourceLockDeleteTest-671583867-project-admin] Could not find user: 5ae5cb1db3504baaba1df93dc154a004.: keystone.exception.UserNotFound: Could not find user: 5ae5cb1db3504baaba1df93dc154a004. May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:59:36 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.v1.shares [None req-3c238a3c-98f7-4462-aaca-24becb87c055 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Create NFS share of 1 GB May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 5ae5cb1db3504baaba1df93dc154a004. May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1240/2505] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 12:59:36 2024] DELETE /identity/v3/users/5ae5cb1db3504baaba1df93dc154a004 => generated 110 bytes in 24 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdecf993-a694-4601-bcf5-4cc2217c5488 tempest-ResourceLockDeleteTest-671583867 tempest-ResourceLockDeleteTest-671583867-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdecf993-a694-4601-bcf5-4cc2217c5488 tempest-ResourceLockDeleteTest-671583867 tempest-ResourceLockDeleteTest-671583867-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4502d1-8005-479c-82d2-a2ba458c0bfe tempest-ResourceLockDeleteTest-671583867 tempest-ResourceLockDeleteTest-671583867-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caee34cb460c4ddcb13e607cbd3fabd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16bb859669ab42a3b7cc595a5e30eb2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4502d1-8005-479c-82d2-a2ba458c0bfe tempest-ResourceLockDeleteTest-671583867 tempest-ResourceLockDeleteTest-671583867-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4502d1-8005-479c-82d2-a2ba458c0bfe tempest-ResourceLockDeleteTest-671583867 tempest-ResourceLockDeleteTest-671583867-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4502d1-8005-479c-82d2-a2ba458c0bfe tempest-ResourceLockDeleteTest-671583867 tempest-ResourceLockDeleteTest-671583867-project-admin] PATH_INFO: `/v3/users/c2ac6ca3ea5a4ae498df6d12bb7caadc` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4502d1-8005-479c-82d2-a2ba458c0bfe tempest-ResourceLockDeleteTest-671583867 tempest-ResourceLockDeleteTest-671583867-project-admin] RBAC: Authorizing `identity:delete_user(user_id=c2ac6ca3ea5a4ae498df6d12bb7caadc)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4502d1-8005-479c-82d2-a2ba458c0bfe tempest-ResourceLockDeleteTest-671583867 tempest-ResourceLockDeleteTest-671583867-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:36 l75lg1-v1 devstack@m-api.service[98329]: DEBUG oslo_concurrency.lockutils [None req-df342792-d57c-4cd5-a407-d4ac8735b849 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.063s {{(pid=98329) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:36 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-df342792-d57c-4cd5-a407-d4ac8735b849 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action returned with HTTP 202 May 28 12:59:36 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 757/1502] 10.27.203.238 () {66 vars in 1493 bytes} [Tue May 28 12:59:36 2024] POST /share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action => generated 0 bytes in 212 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-5a4502d1-8005-479c-82d2-a2ba458c0bfe tempest-ResourceLockDeleteTest-671583867 tempest-ResourceLockDeleteTest-671583867-project-admin] Could not find user: c2ac6ca3ea5a4ae498df6d12bb7caadc.: keystone.exception.UserNotFound: Could not find user: c2ac6ca3ea5a4ae498df6d12bb7caadc. May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: c2ac6ca3ea5a4ae498df6d12bb7caadc. May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1266/2506] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 12:59:36 2024] DELETE /identity/v3/users/c2ac6ca3ea5a4ae498df6d12bb7caadc => generated 110 bytes in 27 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 12:59:36 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-0904b2de-fbdf-4b61-8db0-27168fd85e9c tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] GET http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/share-access-rules?share_id=72db8769-ece7-42ff-af27-2e778292a9b4 May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d947aa-a7e9-404d-b977-8b7dcc034e96 tempest-ResourceLockDeleteTest-671583867 tempest-ResourceLockDeleteTest-671583867-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:36 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-0904b2de-fbdf-4b61-8db0-27168fd85e9c tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:36 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-0904b2de-fbdf-4b61-8db0-27168fd85e9c tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d947aa-a7e9-404d-b977-8b7dcc034e96 tempest-ResourceLockDeleteTest-671583867 tempest-ResourceLockDeleteTest-671583867-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55457143-d28f-4ac4-93a1-42533c88f4f8 tempest-ResourceLockDeleteTest-671583867 tempest-ResourceLockDeleteTest-671583867-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caee34cb460c4ddcb13e607cbd3fabd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16bb859669ab42a3b7cc595a5e30eb2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55457143-d28f-4ac4-93a1-42533c88f4f8 tempest-ResourceLockDeleteTest-671583867 tempest-ResourceLockDeleteTest-671583867-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55457143-d28f-4ac4-93a1-42533c88f4f8 tempest-ResourceLockDeleteTest-671583867 tempest-ResourceLockDeleteTest-671583867-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55457143-d28f-4ac4-93a1-42533c88f4f8 tempest-ResourceLockDeleteTest-671583867 tempest-ResourceLockDeleteTest-671583867-project-admin] PATH_INFO: `/v3/users/f89f851af36d480ab7d10d3506c60899` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55457143-d28f-4ac4-93a1-42533c88f4f8 tempest-ResourceLockDeleteTest-671583867 tempest-ResourceLockDeleteTest-671583867-project-admin] RBAC: Authorizing `identity:delete_user(user_id=f89f851af36d480ab7d10d3506c60899)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55457143-d28f-4ac4-93a1-42533c88f4f8 tempest-ResourceLockDeleteTest-671583867 tempest-ResourceLockDeleteTest-671583867-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:36 l75lg1-v1 manila-share[98474]: DEBUG manila.share.manager [None req-df342792-d57c-4cd5-a407-d4ac8735b849 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Received request to update access for share instance 7fdd602c-79d0-479c-95a2-336b202c6639. {{(pid=98474) update_access_for_instances /opt/stack/manila/manila/share/manager.py:4353}} May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-55457143-d28f-4ac4-93a1-42533c88f4f8 tempest-ResourceLockDeleteTest-671583867 tempest-ResourceLockDeleteTest-671583867-project-admin] Could not find user: f89f851af36d480ab7d10d3506c60899.: keystone.exception.UserNotFound: Could not find user: f89f851af36d480ab7d10d3506c60899. May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: f89f851af36d480ab7d10d3506c60899. May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1241/2507] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 12:59:36 2024] DELETE /identity/v3/users/f89f851af36d480ab7d10d3506c60899 => generated 110 bytes in 25 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4502d1-8005-479c-82d2-a2ba458c0bfe tempest-ResourceLockDeleteTest-671583867 tempest-ResourceLockDeleteTest-671583867-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4502d1-8005-479c-82d2-a2ba458c0bfe tempest-ResourceLockDeleteTest-671583867 tempest-ResourceLockDeleteTest-671583867-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1816153-fbd5-409c-97f1-bb5dd349704a tempest-ResourceLockDeleteTest-671583867 tempest-ResourceLockDeleteTest-671583867-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caee34cb460c4ddcb13e607cbd3fabd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16bb859669ab42a3b7cc595a5e30eb2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1816153-fbd5-409c-97f1-bb5dd349704a tempest-ResourceLockDeleteTest-671583867 tempest-ResourceLockDeleteTest-671583867-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1816153-fbd5-409c-97f1-bb5dd349704a tempest-ResourceLockDeleteTest-671583867 tempest-ResourceLockDeleteTest-671583867-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1816153-fbd5-409c-97f1-bb5dd349704a tempest-ResourceLockDeleteTest-671583867 tempest-ResourceLockDeleteTest-671583867-project-admin] PATH_INFO: `/v3/users/6886717a9cfb42a0a4142a0b982570ee` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:36 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.quota [None req-3c238a3c-98f7-4462-aaca-24becb87c055 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Created reservations ['d9ed49c4-9df0-402b-a133-04d7643e266a', 'b85f4acc-bfdd-4951-90b5-adfd4f4b6083', '8104a319-3972-4f8d-b175-2e84bd27873e', '413e3e96-68fc-4da1-a626-ba2f39cd9be2'] {{(pid=98330) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 12:59:36 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.lock.api [None req-0904b2de-fbdf-4b61-8db0-27168fd85e9c tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Searching for locks by: {'resource_id': '57a01137-a0cf-440f-ae42-3e69a0a2c1ed', 'resource_action': 'show', 'resource_type': 'access_rule'} {{(pid=98329) get_all /opt/stack/manila/manila/lock/api.py:112}} May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1816153-fbd5-409c-97f1-bb5dd349704a tempest-ResourceLockDeleteTest-671583867 tempest-ResourceLockDeleteTest-671583867-project-admin] RBAC: Authorizing `identity:delete_user(user_id=6886717a9cfb42a0a4142a0b982570ee)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1816153-fbd5-409c-97f1-bb5dd349704a tempest-ResourceLockDeleteTest-671583867 tempest-ResourceLockDeleteTest-671583867-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:36 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-df342792-d57c-4cd5-a407-d4ac8735b849 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:36 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-df342792-d57c-4cd5-a407-d4ac8735b849 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:36 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-0904b2de-fbdf-4b61-8db0-27168fd85e9c tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/share-access-rules?share_id=72db8769-ece7-42ff-af27-2e778292a9b4 returned with HTTP 200 May 28 12:59:36 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 758/1503] 10.27.203.238 () {64 vars in 1467 bytes} [Tue May 28 12:59:36 2024] GET /share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/share-access-rules?share_id=72db8769-ece7-42ff-af27-2e778292a9b4 => generated 298 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:59:36 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-df342792-d57c-4cd5-a407-d4ac8735b849 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.004s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:36 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-df342792-d57c-4cd5-a407-d4ac8735b849 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:36 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-df342792-d57c-4cd5-a407-d4ac8735b849 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-f1816153-fbd5-409c-97f1-bb5dd349704a tempest-ResourceLockDeleteTest-671583867 tempest-ResourceLockDeleteTest-671583867-project-admin] Could not find user: 6886717a9cfb42a0a4142a0b982570ee.: keystone.exception.UserNotFound: Could not find user: 6886717a9cfb42a0a4142a0b982570ee. May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 6886717a9cfb42a0a4142a0b982570ee. May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1267/2508] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 12:59:36 2024] DELETE /identity/v3/users/6886717a9cfb42a0a4142a0b982570ee => generated 110 bytes in 25 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55457143-d28f-4ac4-93a1-42533c88f4f8 tempest-ResourceLockDeleteTest-671583867 tempest-ResourceLockDeleteTest-671583867-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55457143-d28f-4ac4-93a1-42533c88f4f8 tempest-ResourceLockDeleteTest-671583867 tempest-ResourceLockDeleteTest-671583867-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef073d54-4aec-4ab5-87dc-e208a1cd6c4f tempest-ResourceLockDeleteTest-671583867 tempest-ResourceLockDeleteTest-671583867-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caee34cb460c4ddcb13e607cbd3fabd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16bb859669ab42a3b7cc595a5e30eb2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef073d54-4aec-4ab5-87dc-e208a1cd6c4f tempest-ResourceLockDeleteTest-671583867 tempest-ResourceLockDeleteTest-671583867-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef073d54-4aec-4ab5-87dc-e208a1cd6c4f tempest-ResourceLockDeleteTest-671583867 tempest-ResourceLockDeleteTest-671583867-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef073d54-4aec-4ab5-87dc-e208a1cd6c4f tempest-ResourceLockDeleteTest-671583867 tempest-ResourceLockDeleteTest-671583867-project-admin] PATH_INFO: `/v3/users/b523155e680a4a14acd4f3a4295a8d26` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef073d54-4aec-4ab5-87dc-e208a1cd6c4f tempest-ResourceLockDeleteTest-671583867 tempest-ResourceLockDeleteTest-671583867-project-admin] RBAC: Authorizing `identity:delete_user(user_id=b523155e680a4a14acd4f3a4295a8d26)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef073d54-4aec-4ab5-87dc-e208a1cd6c4f tempest-ResourceLockDeleteTest-671583867 tempest-ResourceLockDeleteTest-671583867-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:36 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.quota [None req-3c238a3c-98f7-4462-aaca-24becb87c055 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Committed reservations ['d9ed49c4-9df0-402b-a133-04d7643e266a', 'b85f4acc-bfdd-4951-90b5-adfd4f4b6083', '8104a319-3972-4f8d-b175-2e84bd27873e', '413e3e96-68fc-4da1-a626-ba2f39cd9be2'] {{(pid=98330) commit /opt/stack/manila/manila/quota.py:1063}} May 28 12:59:36 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-21a13525-ffbb-4ef6-bcdf-5eefd6b9cefc tempest-ResourceLockNegativeTestWithShares-789426285 None] <<< [POST] https://127.0.0.1:40443/api/views/ May 28 12:59:36 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-21a13525-ffbb-4ef6-bcdf-5eefd6b9cefc tempest-ResourceLockNegativeTestWithShares-789426285 None] Bunch(abac_tags=[], abe_max_depth=None, abe_protocols=[], alias='', allow_anonymous_access=False, allow_s3_anonymous_access=False, auto_commit='0d', bucket='', bucket_creators=[], bucket_creators_groups=[], bucket_owner=None, bulk_permission_update_progress=None, bulk_permission_update_state=None, cluster='loop75-kfs', cluster_id=1, created='2024-05-28T12:59:36.124148Z', enabled=True, files_retention_mode='NONE', guid='d11bcb3a-2493-4895-afd5-5df67b5522a7', id=36, ignore_oos=False, internal=False, is_remote=False, is_seamless=False, logical_capacity=0, max_retention_period=None, min_retention_period=None, name='f1a7f25a-f865-4592-93e1-c1e62b2447b8', nfs_interop_flags='BOTH_NFS3_AND_NFS4_INTEROP_DISABLED', path='/manila/manila-f1a7f25a-f865-4592-93e1-c1e62b2447b8', physical_capacity=0, policy='f1a7f25a-f865-4592-93e1-c1e62b2447b8', policy_id=37, protocols=['NFS'], qos_policy=None, qos_policy_id=None, s3_locks=False, s3_locks_retention_mode='NONE', s3_locks_retention_period='', s3_object_ownership_rule='ObjectWriter', s3_unverified_lookup=False, s3_versioning=False, select_for_live_monitoring=False, share='', share_acl=Bunch(acl=[], enabled=False), sync='SYNCED', sync_time='2024-05-28T12:59:36.414904Z', tenant_id=1, tenant_name='default', title='/manila/manila-f1a7f25a-f865-4592-93e1-c1e62b2447b8', url='https://127.0.0.1:40443/api/views/36/') May 28 12:59:36 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-21a13525-ffbb-4ef6-bcdf-5eefd6b9cefc tempest-ResourceLockNegativeTestWithShares-789426285 None] --- [POST] https://127.0.0.1:40443/api/views/: Done May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-ef073d54-4aec-4ab5-87dc-e208a1cd6c4f tempest-ResourceLockDeleteTest-671583867 tempest-ResourceLockDeleteTest-671583867-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b523155e680a4a14acd4f3a4295a8d26', 'request_id': 'req-ef073d54-4aec-4ab5-87dc-e208a1cd6c4f'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:36 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-df342792-d57c-4cd5-a407-d4ac8735b849 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.078s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-ef073d54-4aec-4ab5-87dc-e208a1cd6c4f tempest-ResourceLockDeleteTest-671583867 tempest-ResourceLockDeleteTest-671583867-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b523155e680a4a14acd4f3a4295a8d26', 'request_id': 'req-ef073d54-4aec-4ab5-87dc-e208a1cd6c4f'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:36 l75lg1-v1 manila-share[98474]: DEBUG manila.share.access [None req-df342792-d57c-4cd5-a407-d4ac8735b849 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Updating access rules for share instance 7fdd602c-79d0-479c-95a2-336b202c6639 belonging to share 72db8769-ece7-42ff-af27-2e778292a9b4. {{(pid=98474) update_access_rules /opt/stack/manila/manila/share/access.py:298}} May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-ef073d54-4aec-4ab5-87dc-e208a1cd6c4f tempest-ResourceLockDeleteTest-671583867 tempest-ResourceLockDeleteTest-671583867-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b523155e680a4a14acd4f3a4295a8d26', 'request_id': 'req-ef073d54-4aec-4ab5-87dc-e208a1cd6c4f'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-ef073d54-4aec-4ab5-87dc-e208a1cd6c4f tempest-ResourceLockDeleteTest-671583867 tempest-ResourceLockDeleteTest-671583867-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b523155e680a4a14acd4f3a4295a8d26', 'request_id': 'req-ef073d54-4aec-4ab5-87dc-e208a1cd6c4f'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-ef073d54-4aec-4ab5-87dc-e208a1cd6c4f tempest-ResourceLockDeleteTest-671583867 tempest-ResourceLockDeleteTest-671583867-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b523155e680a4a14acd4f3a4295a8d26', 'request_id': 'req-ef073d54-4aec-4ab5-87dc-e208a1cd6c4f'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:36 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1242/2509] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 12:59:36 2024] DELETE /identity/v3/users/b523155e680a4a14acd4f3a4295a8d26 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:59:36 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-2ea4d47b-7e48-4fde-854c-9ceeb26c5255 tempest-ResourceLockDeleteTest-1157183439 tempest-ResourceLockDeleteTest-1157183439-project-member] GET http://10.27.203.238/share/v2/645fb190404541a78e449c703540d6f8/share-replicas/detail?share_id=2de4a970-0a05-4094-bdb1-ff3d4f9d20d2 May 28 12:59:36 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-2ea4d47b-7e48-4fde-854c-9ceeb26c5255 tempest-ResourceLockDeleteTest-1157183439 tempest-ResourceLockDeleteTest-1157183439-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:36 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-2ea4d47b-7e48-4fde-854c-9ceeb26c5255 tempest-ResourceLockDeleteTest-1157183439 tempest-ResourceLockDeleteTest-1157183439-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:36 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-df342792-d57c-4cd5-a407-d4ac8735b849 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:36 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-df342792-d57c-4cd5-a407-d4ac8735b849 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:36 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-2ea4d47b-7e48-4fde-854c-9ceeb26c5255 tempest-ResourceLockDeleteTest-1157183439 tempest-ResourceLockDeleteTest-1157183439-project-member] http://10.27.203.238/share/v2/645fb190404541a78e449c703540d6f8/share-replicas/detail?share_id=2de4a970-0a05-4094-bdb1-ff3d4f9d20d2 returned with HTTP 200 May 28 12:59:36 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.host_manager [None req-3c238a3c-98f7-4462-aaca-24becb87c055 tempest-UserMessageTest-1084663522 None] Share service is down. (host: l75lg1-v1@generic2). May 28 12:59:36 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.host_manager [None req-3c238a3c-98f7-4462-aaca-24becb87c055 tempest-UserMessageTest-1084663522 None] Share service is down. (host: l75lg1-v1@generic1). May 28 12:59:36 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-3c238a3c-98f7-4462-aaca-24becb87c055 tempest-UserMessageTest-1084663522 None] Starting with 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:80}} May 28 12:59:36 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 759/1504] 10.27.203.238 () {64 vars in 1476 bytes} [Tue May 28 12:59:36 2024] GET /share/v2/645fb190404541a78e449c703540d6f8/share-replicas/detail?share_id=2de4a970-0a05-4094-bdb1-ff3d4f9d20d2 => generated 22 bytes in 17 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:59:36 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b292ab86-6ca1-4371-8218-f8aa8cb445ca tempest-ShareIpRulesForNFSTest-1748669711 None] <<< [PATCH] https://127.0.0.1:40443/api/viewpolicies/21/ May 28 12:59:36 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-3c238a3c-98f7-4462-aaca-24becb87c055 tempest-UserMessageTest-1084663522 None] Filter OnlyHostFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:59:36 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b292ab86-6ca1-4371-8218-f8aa8cb445ca tempest-ShareIpRulesForNFSTest-1748669711 None] Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=1, created='2024-05-28T12:57:40.763635Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='377955ad-d094-4e49-ab32-1021d943a572', id=21, internal=False, is_s3_default_policy=False, name='b7a7d61c-2cea-442a-9809-507038e080d5', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=['*'], nfs_posix_acl=False, nfs_read_only=['2.2.2.2'], nfs_read_write=[], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=['2.2.2.2'], read_write=[], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='MODIFYING', sync_time='2024-05-28T12:59:35.670852Z', tenant_id=1, tenant_name='default', title='b7a7d61c-2cea-442a-9809-507038e080d5', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/21/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[]) May 28 12:59:36 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b292ab86-6ca1-4371-8218-f8aa8cb445ca tempest-ShareIpRulesForNFSTest-1748669711 None] --- [PATCH] https://127.0.0.1:40443/api/viewpolicies/21/: Done May 28 12:59:36 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-3c238a3c-98f7-4462-aaca-24becb87c055 tempest-UserMessageTest-1084663522 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:59:36 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.capacity [None req-3c238a3c-98f7-4462-aaca-24becb87c055 tempest-UserMessageTest-1084663522 None] Space information for share creation on host l75lg1-v1@vast#vast (requested / avail): 1/2077 {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/capacity.py:83}} May 28 12:59:36 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-3c238a3c-98f7-4462-aaca-24becb87c055 tempest-UserMessageTest-1084663522 None] Filter CapacityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:59:36 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-b292ab86-6ca1-4371-8218-f8aa8cb445ca tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:36 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.utils [None req-3c238a3c-98f7-4462-aaca-24becb87c055 tempest-UserMessageTest-1084663522 None] Share type extra spec requirement "vendor_name=foobar" does not match reported capability "VAST STORAGE" {{(pid=98327) capabilities_satisfied /opt/stack/manila/manila/scheduler/utils.py:185}} May 28 12:59:36 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.capabilities [None req-3c238a3c-98f7-4462-aaca-24becb87c055 tempest-UserMessageTest-1084663522 None] host: 'l75lg1-v1@vast#vast', free_capacity_gb: 2077.64910808485, pools: None fails resource_type extra_specs requirements {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/capabilities.py:45}} May 28 12:59:36 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-b292ab86-6ca1-4371-8218-f8aa8cb445ca tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:36 l75lg1-v1 manila-scheduler[98327]: INFO manila.scheduler.filters.base [None req-3c238a3c-98f7-4462-aaca-24becb87c055 tempest-UserMessageTest-1084663522 None] Filter CapabilitiesFilter returned 0 host(s) May 28 12:59:36 l75lg1-v1 manila-scheduler[98327]: ERROR manila.scheduler.manager [None req-3c238a3c-98f7-4462-aaca-24becb87c055 tempest-UserMessageTest-1084663522 None] Failed to schedule create_share: No valid host was found. Failed to find a weighted host, the last executed filter was CapabilitiesFilter.: manila.exception.NoValidHost: No valid host was found. Failed to find a weighted host, the last executed filter was CapabilitiesFilter. May 28 12:59:36 l75lg1-v1 manila-share[98474]: INFO manila.share.manager [None req-21a13525-ffbb-4ef6-bcdf-5eefd6b9cefc tempest-ResourceLockNegativeTestWithShares-789426285 None] Share instance f1a7f25a-f865-4592-93e1-c1e62b2447b8 created successfully. May 28 12:59:36 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-bc1c21c1-0130-466d-9112-0bce1c19b70f tempest-ResourceLockDeleteTest-1157183439 tempest-ResourceLockDeleteTest-1157183439-project-member] DELETE http://10.27.203.238/share/v2/645fb190404541a78e449c703540d6f8/shares/2de4a970-0a05-4094-bdb1-ff3d4f9d20d2 May 28 12:59:36 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-bc1c21c1-0130-466d-9112-0bce1c19b70f tempest-ResourceLockDeleteTest-1157183439 tempest-ResourceLockDeleteTest-1157183439-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:36 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-bc1c21c1-0130-466d-9112-0bce1c19b70f tempest-ResourceLockDeleteTest-1157183439 tempest-ResourceLockDeleteTest-1157183439-project-member] Calling method 'ShareMixin.delete' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:36 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-df342792-d57c-4cd5-a407-d4ac8735b849 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.017s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:36 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-df342792-d57c-4cd5-a407-d4ac8735b849 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:36 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-df342792-d57c-4cd5-a407-d4ac8735b849 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:36 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.v1.shares [None req-bc1c21c1-0130-466d-9112-0bce1c19b70f tempest-ResourceLockDeleteTest-1157183439 tempest-ResourceLockDeleteTest-1157183439-project-member] Delete share with id: 2de4a970-0a05-4094-bdb1-ff3d4f9d20d2 May 28 12:59:36 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-3c238a3c-98f7-4462-aaca-24becb87c055 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] http://10.27.203.238/share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/shares returned with HTTP 200 May 28 12:59:36 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 746/1505] 10.27.203.238 () {66 vars in 1362 bytes} [Tue May 28 12:59:36 2024] POST /share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/shares => generated 1373 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:59:36 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-8fb033d2-4736-4609-a5e8-724979a55e83 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] GET http://10.27.203.238/share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/shares/9154359e-259b-4835-9888-c3df80cb12bd May 28 12:59:36 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-8fb033d2-4736-4609-a5e8-724979a55e83 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:36 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-bc1c21c1-0130-466d-9112-0bce1c19b70f tempest-ResourceLockDeleteTest-1157183439 tempest-ResourceLockDeleteTest-1157183439-project-member] HTTP exception thrown: The resource could not be found. May 28 12:59:36 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-bc1c21c1-0130-466d-9112-0bce1c19b70f tempest-ResourceLockDeleteTest-1157183439 tempest-ResourceLockDeleteTest-1157183439-project-member] http://10.27.203.238/share/v2/645fb190404541a78e449c703540d6f8/shares/2de4a970-0a05-4094-bdb1-ff3d4f9d20d2 returned with HTTP 404 May 28 12:59:36 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-8fb033d2-4736-4609-a5e8-724979a55e83 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:36 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 760/1506] 10.27.203.238 () {64 vars in 1454 bytes} [Tue May 28 12:59:36 2024] DELETE /share/v2/645fb190404541a78e449c703540d6f8/shares/2de4a970-0a05-4094-bdb1-ff3d4f9d20d2 => generated 78 bytes in 15 msecs (HTTP/1.1 404) 6 headers in 237 bytes (2 switches on core 0) May 28 12:59:36 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-c09fea5a-efc5-4d44-aa08-e6e82c0e1906 tempest-ResourceLockDeleteTest-1157183439 tempest-ResourceLockDeleteTest-1157183439-project-member] GET http://10.27.203.238/share/v2/645fb190404541a78e449c703540d6f8/share-replicas/detail?share_id=ed309fc1-d1ff-4352-a44a-a56b44eb8d0e May 28 12:59:36 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-c09fea5a-efc5-4d44-aa08-e6e82c0e1906 tempest-ResourceLockDeleteTest-1157183439 tempest-ResourceLockDeleteTest-1157183439-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:36 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-c09fea5a-efc5-4d44-aa08-e6e82c0e1906 tempest-ResourceLockDeleteTest-1157183439 tempest-ResourceLockDeleteTest-1157183439-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:36 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-c09fea5a-efc5-4d44-aa08-e6e82c0e1906 tempest-ResourceLockDeleteTest-1157183439 tempest-ResourceLockDeleteTest-1157183439-project-member] http://10.27.203.238/share/v2/645fb190404541a78e449c703540d6f8/share-replicas/detail?share_id=ed309fc1-d1ff-4352-a44a-a56b44eb8d0e returned with HTTP 200 May 28 12:59:36 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 761/1507] 10.27.203.238 () {64 vars in 1476 bytes} [Tue May 28 12:59:36 2024] GET /share/v2/645fb190404541a78e449c703540d6f8/share-replicas/detail?share_id=ed309fc1-d1ff-4352-a44a-a56b44eb8d0e => generated 22 bytes in 14 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:59:36 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-8fb033d2-4736-4609-a5e8-724979a55e83 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] http://10.27.203.238/share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/shares/9154359e-259b-4835-9888-c3df80cb12bd returned with HTTP 200 May 28 12:59:36 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 747/1508] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:59:36 2024] GET /share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/shares/9154359e-259b-4835-9888-c3df80cb12bd => generated 1373 bytes in 27 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:59:36 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-c1817b1a-9641-4100-a7a6-5923abdafa13 tempest-ResourceLockDeleteTest-1157183439 tempest-ResourceLockDeleteTest-1157183439-project-member] DELETE http://10.27.203.238/share/v2/645fb190404541a78e449c703540d6f8/shares/ed309fc1-d1ff-4352-a44a-a56b44eb8d0e May 28 12:59:36 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-c1817b1a-9641-4100-a7a6-5923abdafa13 tempest-ResourceLockDeleteTest-1157183439 tempest-ResourceLockDeleteTest-1157183439-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:36 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-c1817b1a-9641-4100-a7a6-5923abdafa13 tempest-ResourceLockDeleteTest-1157183439 tempest-ResourceLockDeleteTest-1157183439-project-member] Calling method 'ShareMixin.delete' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:36 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.v1.shares [None req-c1817b1a-9641-4100-a7a6-5923abdafa13 tempest-ResourceLockDeleteTest-1157183439 tempest-ResourceLockDeleteTest-1157183439-project-member] Delete share with id: ed309fc1-d1ff-4352-a44a-a56b44eb8d0e May 28 12:59:36 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-df342792-d57c-4cd5-a407-d4ac8735b849 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.036s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:36 l75lg1-v1 manila-scheduler[98327]: INFO manila.message.api [None req-3c238a3c-98f7-4462-aaca-24becb87c055 tempest-UserMessageTest-1084663522 None] Creating message record for request_id = req-3c238a3c-98f7-4462-aaca-24becb87c055 May 28 12:59:36 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-df342792-d57c-4cd5-a407-d4ac8735b849 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] changing access on None May 28 12:59:36 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-df342792-d57c-4cd5-a407-d4ac8735b849 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:59:36 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-df342792-d57c-4cd5-a407-d4ac8735b849 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] {'allow_redirects': True, May 28 12:59:36 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-df342792-d57c-4cd5-a407-d4ac8735b849 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] 'params': {'name': '7fdd602c-79d0-479c-95a2-336b202c6639'}} May 28 12:59:36 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-b292ab86-6ca1-4371-8218-f8aa8cb445ca tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.087s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:36 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-b292ab86-6ca1-4371-8218-f8aa8cb445ca tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:36 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-b292ab86-6ca1-4371-8218-f8aa8cb445ca tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:36 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-b292ab86-6ca1-4371-8218-f8aa8cb445ca tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:36 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-b292ab86-6ca1-4371-8218-f8aa8cb445ca tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:36 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-b292ab86-6ca1-4371-8218-f8aa8cb445ca tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:36 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-b292ab86-6ca1-4371-8218-f8aa8cb445ca tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.004s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:36 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-b292ab86-6ca1-4371-8218-f8aa8cb445ca tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:36 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-b292ab86-6ca1-4371-8218-f8aa8cb445ca tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:36 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-b292ab86-6ca1-4371-8218-f8aa8cb445ca tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:36 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-b292ab86-6ca1-4371-8218-f8aa8cb445ca tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:36 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-b292ab86-6ca1-4371-8218-f8aa8cb445ca tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:36 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-b292ab86-6ca1-4371-8218-f8aa8cb445ca tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.040s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:36 l75lg1-v1 manila-share[98474]: INFO manila.share.access [None req-b292ab86-6ca1-4371-8218-f8aa8cb445ca tempest-ShareIpRulesForNFSTest-1748669711 None] Access rules were successfully modified for share instance b7a7d61c-2cea-442a-9809-507038e080d5 belonging to share 1ddadc17-cf10-4a42-8bbd-8335fb3520a1. May 28 12:59:36 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-c1817b1a-9641-4100-a7a6-5923abdafa13 tempest-ResourceLockDeleteTest-1157183439 tempest-ResourceLockDeleteTest-1157183439-project-member] http://10.27.203.238/share/v2/645fb190404541a78e449c703540d6f8/shares/ed309fc1-d1ff-4352-a44a-a56b44eb8d0e returned with HTTP 202 May 28 12:59:36 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 762/1509] 10.27.203.238 () {64 vars in 1454 bytes} [Tue May 28 12:59:36 2024] DELETE /share/v2/645fb190404541a78e449c703540d6f8/shares/ed309fc1-d1ff-4352-a44a-a56b44eb8d0e => generated 0 bytes in 136 msecs (HTTP/1.1 202) 6 headers in 243 bytes (2 switches on core 0) May 28 12:59:36 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-be4c0a32-f1c8-4ce3-9c8f-bf8f19da00af tempest-ResourceLockDeleteTest-1157183439 tempest-ResourceLockDeleteTest-1157183439-project-member] GET http://10.27.203.238/share/v2/645fb190404541a78e449c703540d6f8/shares/ed309fc1-d1ff-4352-a44a-a56b44eb8d0e May 28 12:59:36 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-be4c0a32-f1c8-4ce3-9c8f-bf8f19da00af tempest-ResourceLockDeleteTest-1157183439 tempest-ResourceLockDeleteTest-1157183439-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:36 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-be4c0a32-f1c8-4ce3-9c8f-bf8f19da00af tempest-ResourceLockDeleteTest-1157183439 tempest-ResourceLockDeleteTest-1157183439-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:36 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-be4c0a32-f1c8-4ce3-9c8f-bf8f19da00af tempest-ResourceLockDeleteTest-1157183439 tempest-ResourceLockDeleteTest-1157183439-project-member] http://10.27.203.238/share/v2/645fb190404541a78e449c703540d6f8/shares/ed309fc1-d1ff-4352-a44a-a56b44eb8d0e returned with HTTP 200 May 28 12:59:36 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 748/1510] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:59:36 2024] GET /share/v2/645fb190404541a78e449c703540d6f8/shares/ed309fc1-d1ff-4352-a44a-a56b44eb8d0e => generated 1316 bytes in 24 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:59:36 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c1817b1a-9641-4100-a7a6-5923abdafa13 tempest-ResourceLockDeleteTest-1157183439 None] Acquiring lock "locked_access_rules_operation_by_share_instance_9fadf39f-1d93-4ddd-bd00-1fd7ccc09539" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:36 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c1817b1a-9641-4100-a7a6-5923abdafa13 tempest-ResourceLockDeleteTest-1157183439 None] Lock "locked_access_rules_operation_by_share_instance_9fadf39f-1d93-4ddd-bd00-1fd7ccc09539" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:36 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c1817b1a-9641-4100-a7a6-5923abdafa13 tempest-ResourceLockDeleteTest-1157183439 None] Lock "locked_access_rules_operation_by_share_instance_9fadf39f-1d93-4ddd-bd00-1fd7ccc09539" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:36 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c1817b1a-9641-4100-a7a6-5923abdafa13 tempest-ResourceLockDeleteTest-1157183439 None] Acquiring lock "locked_access_rules_operation_by_share_instance_9fadf39f-1d93-4ddd-bd00-1fd7ccc09539" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:36 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c1817b1a-9641-4100-a7a6-5923abdafa13 tempest-ResourceLockDeleteTest-1157183439 None] Lock "locked_access_rules_operation_by_share_instance_9fadf39f-1d93-4ddd-bd00-1fd7ccc09539" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:36 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c1817b1a-9641-4100-a7a6-5923abdafa13 tempest-ResourceLockDeleteTest-1157183439 None] Lock "locked_access_rules_operation_by_share_instance_9fadf39f-1d93-4ddd-bd00-1fd7ccc09539" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:36 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c1817b1a-9641-4100-a7a6-5923abdafa13 tempest-ResourceLockDeleteTest-1157183439 None] Acquiring lock "locked_access_rules_operation_by_share_instance_9fadf39f-1d93-4ddd-bd00-1fd7ccc09539" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:36 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c1817b1a-9641-4100-a7a6-5923abdafa13 tempest-ResourceLockDeleteTest-1157183439 None] Lock "locked_access_rules_operation_by_share_instance_9fadf39f-1d93-4ddd-bd00-1fd7ccc09539" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:36 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c1817b1a-9641-4100-a7a6-5923abdafa13 tempest-ResourceLockDeleteTest-1157183439 None] Lock "locked_access_rules_operation_by_share_instance_9fadf39f-1d93-4ddd-bd00-1fd7ccc09539" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:36 l75lg1-v1 manila-share[98474]: DEBUG manila.share.access [None req-c1817b1a-9641-4100-a7a6-5923abdafa13 tempest-ResourceLockDeleteTest-1157183439 None] All access rules have been synced for share instance 9fadf39f-1d93-4ddd-bd00-1fd7ccc09539 belonging to share ed309fc1-d1ff-4352-a44a-a56b44eb8d0e. {{(pid=98474) update_access_rules /opt/stack/manila/manila/share/access.py:304}} May 28 12:59:36 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-c1817b1a-9641-4100-a7a6-5923abdafa13 tempest-ResourceLockDeleteTest-1157183439 None] deleting '/manila/manila-9fadf39f-1d93-4ddd-bd00-1fd7ccc09539' May 28 12:59:36 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c1817b1a-9641-4100-a7a6-5923abdafa13 tempest-ResourceLockDeleteTest-1157183439 None] >>> [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/ May 28 12:59:36 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c1817b1a-9641-4100-a7a6-5923abdafa13 tempest-ResourceLockDeleteTest-1157183439 None] {'data': '{"path": "/manila/manila-9fadf39f-1d93-4ddd-bd00-1fd7ccc09539"}', May 28 12:59:36 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c1817b1a-9641-4100-a7a6-5923abdafa13 tempest-ResourceLockDeleteTest-1157183439 None] 'params': None} May 28 12:59:36 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c1817b1a-9641-4100-a7a6-5923abdafa13 tempest-ResourceLockDeleteTest-1157183439 None] <<< [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/ May 28 12:59:36 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c1817b1a-9641-4100-a7a6-5923abdafa13 tempest-ResourceLockDeleteTest-1157183439 None] 'OK' May 28 12:59:36 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c1817b1a-9641-4100-a7a6-5923abdafa13 tempest-ResourceLockDeleteTest-1157183439 None] --- [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/: Done May 28 12:59:36 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c1817b1a-9641-4100-a7a6-5923abdafa13 tempest-ResourceLockDeleteTest-1157183439 None] >>> [GET] https://127.0.0.1:40443/api/views/ May 28 12:59:36 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c1817b1a-9641-4100-a7a6-5923abdafa13 tempest-ResourceLockDeleteTest-1157183439 None] {'allow_redirects': True, May 28 12:59:36 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c1817b1a-9641-4100-a7a6-5923abdafa13 tempest-ResourceLockDeleteTest-1157183439 None] 'params': {'name': '9fadf39f-1d93-4ddd-bd00-1fd7ccc09539'}} May 28 12:59:36 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-372b388e-a9cb-444b-bb67-ba0a89db4531 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] GET http://10.27.203.238/share/v2/776f75906bc64f8f9316d5aab4b50bf1/share-access-rules?share_id=1ddadc17-cf10-4a42-8bbd-8335fb3520a1 May 28 12:59:36 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-372b388e-a9cb-444b-bb67-ba0a89db4531 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:36 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-372b388e-a9cb-444b-bb67-ba0a89db4531 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:37 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.lock.api [None req-372b388e-a9cb-444b-bb67-ba0a89db4531 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Searching for locks by: {'resource_id': '3b8c1ee2-429e-433d-9592-2ba2cd2834af', 'resource_action': 'show', 'resource_type': 'access_rule'} {{(pid=98329) get_all /opt/stack/manila/manila/lock/api.py:112}} May 28 12:59:37 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-372b388e-a9cb-444b-bb67-ba0a89db4531 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] http://10.27.203.238/share/v2/776f75906bc64f8f9316d5aab4b50bf1/share-access-rules?share_id=1ddadc17-cf10-4a42-8bbd-8335fb3520a1 returned with HTTP 200 May 28 12:59:37 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 763/1511] 10.27.203.238 () {64 vars in 1467 bytes} [Tue May 28 12:59:36 2024] GET /share/v2/776f75906bc64f8f9316d5aab4b50bf1/share-access-rules?share_id=1ddadc17-cf10-4a42-8bbd-8335fb3520a1 => generated 275 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:59:37 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-b814f25b-62b0-408a-b215-b9a0cdafa5de tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] GET http://10.27.203.238/share/v2/776f75906bc64f8f9316d5aab4b50bf1/share-access-rules?share_id=1ddadc17-cf10-4a42-8bbd-8335fb3520a1 May 28 12:59:37 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-b814f25b-62b0-408a-b215-b9a0cdafa5de tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:37 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-b814f25b-62b0-408a-b215-b9a0cdafa5de tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:37 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.lock.api [None req-b814f25b-62b0-408a-b215-b9a0cdafa5de tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Searching for locks by: {'resource_id': '3b8c1ee2-429e-433d-9592-2ba2cd2834af', 'resource_action': 'show', 'resource_type': 'access_rule'} {{(pid=98330) get_all /opt/stack/manila/manila/lock/api.py:112}} May 28 12:59:37 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-b814f25b-62b0-408a-b215-b9a0cdafa5de tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] http://10.27.203.238/share/v2/776f75906bc64f8f9316d5aab4b50bf1/share-access-rules?share_id=1ddadc17-cf10-4a42-8bbd-8335fb3520a1 returned with HTTP 200 May 28 12:59:37 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 749/1512] 10.27.203.238 () {64 vars in 1467 bytes} [Tue May 28 12:59:37 2024] GET /share/v2/776f75906bc64f8f9316d5aab4b50bf1/share-access-rules?share_id=1ddadc17-cf10-4a42-8bbd-8335fb3520a1 => generated 275 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:59:37 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-a70a44ba-e14f-41ed-b9e7-93af7c6b3bfc tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] POST http://10.27.203.238/share/v2/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action May 28 12:59:37 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-a70a44ba-e14f-41ed-b9e7-93af7c6b3bfc tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Action body: b'{"deny_access": {"access_id": "3b8c1ee2-429e-433d-9592-2ba2cd2834af"}}' {{(pid=98329) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:59:37 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-a70a44ba-e14f-41ed-b9e7-93af7c6b3bfc tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Action: 'action', calling method: ShareController.deny_access, body: {"deny_access": {"access_id": "3b8c1ee2-429e-433d-9592-2ba2cd2834af"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:59:37 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.lock.api [None req-a70a44ba-e14f-41ed-b9e7-93af7c6b3bfc tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Searching for locks by: {'resource_id': '3b8c1ee2-429e-433d-9592-2ba2cd2834af', 'resource_action': 'delete'} {{(pid=98329) get_all /opt/stack/manila/manila/lock/api.py:112}} May 28 12:59:37 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-df342792-d57c-4cd5-a407-d4ac8735b849 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:59:37 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-df342792-d57c-4cd5-a407-d4ac8735b849 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] [Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=1, created='2024-05-28T12:58:43.845440Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='31b6534b-d142-4561-992f-4f0759db302d', id=32, internal=False, is_s3_default_policy=False, name='7fdd602c-79d0-479c-95a2-336b202c6639', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=['*'], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=[], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=[], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T12:59:32.000989Z', tenant_id=1, tenant_name='default', title='7fdd602c-79d0-479c-95a2-336b202c6639', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/32/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[])] May 28 12:59:37 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-df342792-d57c-4cd5-a407-d4ac8735b849 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 12:59:37 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-df342792-d57c-4cd5-a407-d4ac8735b849 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:37 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-df342792-d57c-4cd5-a407-d4ac8735b849 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:37 l75lg1-v1 devstack@m-api.service[98329]: DEBUG oslo_concurrency.lockutils [None req-a70a44ba-e14f-41ed-b9e7-93af7c6b3bfc tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98329) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:37 l75lg1-v1 devstack@m-api.service[98329]: DEBUG oslo_concurrency.lockutils [None req-a70a44ba-e14f-41ed-b9e7-93af7c6b3bfc tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98329) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:37 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-df342792-d57c-4cd5-a407-d4ac8735b849 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.028s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:37 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-df342792-d57c-4cd5-a407-d4ac8735b849 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:37 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-df342792-d57c-4cd5-a407-d4ac8735b849 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:37 l75lg1-v1 devstack@m-api.service[98329]: DEBUG oslo_concurrency.lockutils [None req-a70a44ba-e14f-41ed-b9e7-93af7c6b3bfc tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.038s {{(pid=98329) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:37 l75lg1-v1 devstack@m-api.service[98329]: DEBUG oslo_concurrency.lockutils [None req-a70a44ba-e14f-41ed-b9e7-93af7c6b3bfc tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98329) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:37 l75lg1-v1 devstack@m-api.service[98329]: DEBUG oslo_concurrency.lockutils [None req-a70a44ba-e14f-41ed-b9e7-93af7c6b3bfc tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98329) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:37 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-df342792-d57c-4cd5-a407-d4ac8735b849 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.023s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:37 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-df342792-d57c-4cd5-a407-d4ac8735b849 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:37 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-df342792-d57c-4cd5-a407-d4ac8735b849 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:37 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-df342792-d57c-4cd5-a407-d4ac8735b849 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:37 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-df342792-d57c-4cd5-a407-d4ac8735b849 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:37 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-df342792-d57c-4cd5-a407-d4ac8735b849 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:37 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-df342792-d57c-4cd5-a407-d4ac8735b849 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:37 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-df342792-d57c-4cd5-a407-d4ac8735b849 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:37 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-df342792-d57c-4cd5-a407-d4ac8735b849 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:37 l75lg1-v1 dstat.sh[49771]: 28-05 12:59:37| 17 2 77 3 0|5740M 1727M 277M 7880M| 18k 2356B| 0 3386k| 0 400 |7967 14k|1.17 1.07 1.01|3.0 1.0 0| 0 0 | 0 2048M| 29 364 0 35 0 May 28 12:59:37 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-df342792-d57c-4cd5-a407-d4ac8735b849 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.048s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:37 l75lg1-v1 manila-share[98474]: INFO manila.share.access [None req-df342792-d57c-4cd5-a407-d4ac8735b849 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Access rules were successfully modified for share instance 7fdd602c-79d0-479c-95a2-336b202c6639 belonging to share 72db8769-ece7-42ff-af27-2e778292a9b4. May 28 12:59:37 l75lg1-v1 devstack@m-api.service[98329]: DEBUG oslo_concurrency.lockutils [None req-a70a44ba-e14f-41ed-b9e7-93af7c6b3bfc tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.071s {{(pid=98329) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:37 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-a70a44ba-e14f-41ed-b9e7-93af7c6b3bfc tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] http://10.27.203.238/share/v2/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action returned with HTTP 202 May 28 12:59:37 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 764/1513] 10.27.203.238 () {66 vars in 1493 bytes} [Tue May 28 12:59:37 2024] POST /share/v2/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1/action => generated 0 bytes in 189 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:59:37 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-a757b390-66b9-4b35-9d7b-49c694cccbf4 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] GET http://10.27.203.238/share/v2/776f75906bc64f8f9316d5aab4b50bf1/share-access-rules?share_id=1ddadc17-cf10-4a42-8bbd-8335fb3520a1 May 28 12:59:37 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-a757b390-66b9-4b35-9d7b-49c694cccbf4 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:37 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-a757b390-66b9-4b35-9d7b-49c694cccbf4 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:37 l75lg1-v1 manila-share[98474]: DEBUG manila.share.manager [None req-a70a44ba-e14f-41ed-b9e7-93af7c6b3bfc tempest-ShareIpRulesForNFSTest-1748669711 None] Received request to update access for share instance b7a7d61c-2cea-442a-9809-507038e080d5. {{(pid=98474) update_access_for_instances /opt/stack/manila/manila/share/manager.py:4353}} May 28 12:59:37 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-a70a44ba-e14f-41ed-b9e7-93af7c6b3bfc tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:37 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-a70a44ba-e14f-41ed-b9e7-93af7c6b3bfc tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:37 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.lock.api [None req-a757b390-66b9-4b35-9d7b-49c694cccbf4 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Searching for locks by: {'resource_id': '3b8c1ee2-429e-433d-9592-2ba2cd2834af', 'resource_action': 'show', 'resource_type': 'access_rule'} {{(pid=98330) get_all /opt/stack/manila/manila/lock/api.py:112}} May 28 12:59:37 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-a70a44ba-e14f-41ed-b9e7-93af7c6b3bfc tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.004s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:37 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-a70a44ba-e14f-41ed-b9e7-93af7c6b3bfc tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:37 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-a70a44ba-e14f-41ed-b9e7-93af7c6b3bfc tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:37 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-a757b390-66b9-4b35-9d7b-49c694cccbf4 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] http://10.27.203.238/share/v2/776f75906bc64f8f9316d5aab4b50bf1/share-access-rules?share_id=1ddadc17-cf10-4a42-8bbd-8335fb3520a1 returned with HTTP 200 May 28 12:59:37 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 750/1514] 10.27.203.238 () {64 vars in 1467 bytes} [Tue May 28 12:59:37 2024] GET /share/v2/776f75906bc64f8f9316d5aab4b50bf1/share-access-rules?share_id=1ddadc17-cf10-4a42-8bbd-8335fb3520a1 => generated 283 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:59:37 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-a70a44ba-e14f-41ed-b9e7-93af7c6b3bfc tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.053s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:37 l75lg1-v1 manila-share[98474]: DEBUG manila.share.access [None req-a70a44ba-e14f-41ed-b9e7-93af7c6b3bfc tempest-ShareIpRulesForNFSTest-1748669711 None] Updating access rules for share instance b7a7d61c-2cea-442a-9809-507038e080d5 belonging to share 1ddadc17-cf10-4a42-8bbd-8335fb3520a1. {{(pid=98474) update_access_rules /opt/stack/manila/manila/share/access.py:298}} May 28 12:59:37 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-a70a44ba-e14f-41ed-b9e7-93af7c6b3bfc tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:37 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-a70a44ba-e14f-41ed-b9e7-93af7c6b3bfc tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:37 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-a70a44ba-e14f-41ed-b9e7-93af7c6b3bfc tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.007s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:37 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-a70a44ba-e14f-41ed-b9e7-93af7c6b3bfc tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:37 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-a70a44ba-e14f-41ed-b9e7-93af7c6b3bfc tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:37 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-a70a44ba-e14f-41ed-b9e7-93af7c6b3bfc tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.014s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:37 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-a70a44ba-e14f-41ed-b9e7-93af7c6b3bfc tempest-ShareIpRulesForNFSTest-1748669711 None] changing access on None May 28 12:59:37 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a70a44ba-e14f-41ed-b9e7-93af7c6b3bfc tempest-ShareIpRulesForNFSTest-1748669711 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:59:37 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a70a44ba-e14f-41ed-b9e7-93af7c6b3bfc tempest-ShareIpRulesForNFSTest-1748669711 None] {'allow_redirects': True, May 28 12:59:37 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a70a44ba-e14f-41ed-b9e7-93af7c6b3bfc tempest-ShareIpRulesForNFSTest-1748669711 None] 'params': {'name': 'b7a7d61c-2cea-442a-9809-507038e080d5'}} May 28 12:59:37 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c1817b1a-9641-4100-a7a6-5923abdafa13 tempest-ResourceLockDeleteTest-1157183439 None] <<< [GET] https://127.0.0.1:40443/api/views/ May 28 12:59:37 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c1817b1a-9641-4100-a7a6-5923abdafa13 tempest-ResourceLockDeleteTest-1157183439 None] [Bunch(abac_tags=[], abe_max_depth=None, abe_protocols=[], alias='', allow_anonymous_access=False, allow_s3_anonymous_access=False, auto_commit='0d', bucket='', bucket_creators=[], bucket_creators_groups=[], bucket_owner=None, bulk_permission_update_progress=None, bulk_permission_update_state=None, cluster='loop75-kfs', cluster_id=1, created='2024-05-28T12:59:17.854534Z', enabled=True, files_retention_mode='NONE', guid='24b418c6-09bf-4e75-bfbc-79fefd399a8b', id=34, ignore_oos=False, internal=False, is_remote=False, is_seamless=False, logical_capacity=0, max_retention_period=None, min_retention_period=None, name='9fadf39f-1d93-4ddd-bd00-1fd7ccc09539', nfs_interop_flags='BOTH_NFS3_AND_NFS4_INTEROP_DISABLED', path='/manila/manila-9fadf39f-1d93-4ddd-bd00-1fd7ccc09539', physical_capacity=0, policy='9fadf39f-1d93-4ddd-bd00-1fd7ccc09539', policy_id=35, protocols=['NFS'], qos_policy=None, qos_policy_id=None, s3_locks=False, s3_locks_retention_mode='NONE', s3_locks_retention_period='', s3_unverified_lookup=False, s3_versioning=False, select_for_live_monitoring=False, share='', share_acl=Bunch(acl=[], enabled=False), sync='SYNCED', sync_time='2024-05-28T12:59:18.126740Z', tenant_id=1, tenant_name='default', title='/manila/manila-9fadf39f-1d93-4ddd-bd00-1fd7ccc09539', url='https://127.0.0.1:40443/api/views/34/')] May 28 12:59:37 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c1817b1a-9641-4100-a7a6-5923abdafa13 tempest-ResourceLockDeleteTest-1157183439 None] --- [GET] https://127.0.0.1:40443/api/views/: Done May 28 12:59:37 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c1817b1a-9641-4100-a7a6-5923abdafa13 tempest-ResourceLockDeleteTest-1157183439 None] >>> [DELETE] https://127.0.0.1:40443/api/views/34/ May 28 12:59:37 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a70a44ba-e14f-41ed-b9e7-93af7c6b3bfc tempest-ShareIpRulesForNFSTest-1748669711 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:59:37 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a70a44ba-e14f-41ed-b9e7-93af7c6b3bfc tempest-ShareIpRulesForNFSTest-1748669711 None] [Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=1, created='2024-05-28T12:57:40.763635Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='377955ad-d094-4e49-ab32-1021d943a572', id=21, internal=False, is_s3_default_policy=False, name='b7a7d61c-2cea-442a-9809-507038e080d5', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=['*'], nfs_posix_acl=False, nfs_read_only=['2.2.2.2'], nfs_read_write=[], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=['2.2.2.2'], read_write=[], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T12:59:36.402860Z', tenant_id=1, tenant_name='default', title='b7a7d61c-2cea-442a-9809-507038e080d5', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/21/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[])] May 28 12:59:37 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a70a44ba-e14f-41ed-b9e7-93af7c6b3bfc tempest-ShareIpRulesForNFSTest-1748669711 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 12:59:37 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-a70a44ba-e14f-41ed-b9e7-93af7c6b3bfc tempest-ShareIpRulesForNFSTest-1748669711 None] changing access on /manila/manila-b7a7d61c-2cea-442a-9809-507038e080d5. Rules: {'nfs_read_write': [], 'nfs_read_only': []} May 28 12:59:37 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a70a44ba-e14f-41ed-b9e7-93af7c6b3bfc tempest-ShareIpRulesForNFSTest-1748669711 None] >>> [PATCH] https://127.0.0.1:40443/api/viewpolicies/21/ May 28 12:59:37 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a70a44ba-e14f-41ed-b9e7-93af7c6b3bfc tempest-ShareIpRulesForNFSTest-1748669711 None] {'data': '{"name": "b7a7d61c-2cea-442a-9809-507038e080d5", "nfs_no_squash": ' May 28 12:59:37 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a70a44ba-e14f-41ed-b9e7-93af7c6b3bfc tempest-ShareIpRulesForNFSTest-1748669711 None] '["*"], "nfs_root_squash": ["*"], "nfs_read_write": [], ' May 28 12:59:37 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a70a44ba-e14f-41ed-b9e7-93af7c6b3bfc tempest-ShareIpRulesForNFSTest-1748669711 None] '"nfs_read_only": []}', May 28 12:59:37 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a70a44ba-e14f-41ed-b9e7-93af7c6b3bfc tempest-ShareIpRulesForNFSTest-1748669711 None] 'params': None} May 28 12:59:38 l75lg1-v1 dstat.sh[49771]: 28-05 12:59:38| 4 1 95 1 0|5741M 1727M 277M 7880M| 20k 2305B| 0 964k| 0 92.0 |2839 4472 |1.17 1.07 1.01|1.0 1.0 2.0| 0 0 | 0 2048M| 29 363 0 35 0 May 28 12:59:38 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-16642c36-5aef-44e7-b641-3ae3ad316259 tempest-ResourceLockNegativeTestWithShares-789426285 tempest-ResourceLockNegativeTestWithShares-789426285-project-member] GET http://10.27.203.238/share/v2/86e4aff17ad94d75a624b038464bfeb2/shares/a5984861-5086-4848-82ce-0960e763197b May 28 12:59:38 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-16642c36-5aef-44e7-b641-3ae3ad316259 tempest-ResourceLockNegativeTestWithShares-789426285 tempest-ResourceLockNegativeTestWithShares-789426285-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:38 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-16642c36-5aef-44e7-b641-3ae3ad316259 tempest-ResourceLockNegativeTestWithShares-789426285 tempest-ResourceLockNegativeTestWithShares-789426285-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:38 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-16642c36-5aef-44e7-b641-3ae3ad316259 tempest-ResourceLockNegativeTestWithShares-789426285 tempest-ResourceLockNegativeTestWithShares-789426285-project-member] http://10.27.203.238/share/v2/86e4aff17ad94d75a624b038464bfeb2/shares/a5984861-5086-4848-82ce-0960e763197b returned with HTTP 200 May 28 12:59:38 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 765/1515] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:59:38 2024] GET /share/v2/86e4aff17ad94d75a624b038464bfeb2/shares/a5984861-5086-4848-82ce-0960e763197b => generated 1314 bytes in 28 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:59:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1816153-fbd5-409c-97f1-bb5dd349704a tempest-ResourceLockDeleteTest-671583867 tempest-ResourceLockDeleteTest-671583867-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-f1816153-fbd5-409c-97f1-bb5dd349704a tempest-ResourceLockDeleteTest-671583867 tempest-ResourceLockDeleteTest-671583867-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:59:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1816153-fbd5-409c-97f1-bb5dd349704a tempest-ResourceLockDeleteTest-671583867 tempest-ResourceLockDeleteTest-671583867-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845d1e10-d996-4b0d-a62b-1959b2ab9920 tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c23c4f0d80fc4a328a0d37c798eb66f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c8bc02239694668aa5810b9e0fc29f3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845d1e10-d996-4b0d-a62b-1959b2ab9920 tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845d1e10-d996-4b0d-a62b-1959b2ab9920 tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845d1e10-d996-4b0d-a62b-1959b2ab9920 tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] PATH_INFO: `/v3/projects/86e4aff17ad94d75a624b038464bfeb2` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845d1e10-d996-4b0d-a62b-1959b2ab9920 tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] RBAC: Authorizing `identity:get_project(project_id=86e4aff17ad94d75a624b038464bfeb2)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845d1e10-d996-4b0d-a62b-1959b2ab9920 tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:38 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1268/2510] 10.27.203.238 () {62 vars in 1318 bytes} [Tue May 28 12:59:38 2024] GET /identity/v3/projects/86e4aff17ad94d75a624b038464bfeb2 => generated 405 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:59:38 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-4e730b38-e62d-4f16-90f1-b6c1b9eb1ef1 tempest-ResourceLockNegativeTestWithShares-789426285 tempest-ResourceLockNegativeTestWithShares-789426285-project-member] POST http://10.27.203.238/share/v2/86e4aff17ad94d75a624b038464bfeb2/resource-locks May 28 12:59:38 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-4e730b38-e62d-4f16-90f1-b6c1b9eb1ef1 tempest-ResourceLockNegativeTestWithShares-789426285 tempest-ResourceLockNegativeTestWithShares-789426285-project-member] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"resource_lock": {"resource_id": "a5984861-5086-4848-82ce-0960e763197b", "resource_type": "share", "resource_action": "delete", "lock_reason": "invalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalid"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:59:38 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-4e730b38-e62d-4f16-90f1-b6c1b9eb1ef1 tempest-ResourceLockNegativeTestWithShares-789426285 tempest-ResourceLockNegativeTestWithShares-789426285-project-member] HTTP exception thrown: 'lock_reason' can contain a maximum of 1023 characters. May 28 12:59:38 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-4e730b38-e62d-4f16-90f1-b6c1b9eb1ef1 tempest-ResourceLockNegativeTestWithShares-789426285 tempest-ResourceLockNegativeTestWithShares-789426285-project-member] http://10.27.203.238/share/v2/86e4aff17ad94d75a624b038464bfeb2/resource-locks returned with HTTP 400 May 28 12:59:38 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 751/1516] 10.27.203.238 () {66 vars in 1387 bytes} [Tue May 28 12:59:38 2024] POST /share/v2/86e4aff17ad94d75a624b038464bfeb2/resource-locks => generated 99 bytes in 6 msecs (HTTP/1.1 400) 6 headers in 239 bytes (1 switches on core 0) May 28 12:59:38 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-f48e3052-f08e-4753-89c6-3e36097fbde4 tempest-ResourceLockNegativeTestWithShares-789426285 tempest-ResourceLockNegativeTestWithShares-789426285-project-member] POST http://10.27.203.238/share/v2/86e4aff17ad94d75a624b038464bfeb2/resource-locks May 28 12:59:38 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-f48e3052-f08e-4753-89c6-3e36097fbde4 tempest-ResourceLockNegativeTestWithShares-789426285 tempest-ResourceLockNegativeTestWithShares-789426285-project-member] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"resource_lock": {"resource_id": "a5984861-5086-4848-82ce-0960e763197b", "resource_type": "share", "resource_action": "invalid-action", "lock_reason": null}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:59:38 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-f48e3052-f08e-4753-89c6-3e36097fbde4 tempest-ResourceLockNegativeTestWithShares-789426285 tempest-ResourceLockNegativeTestWithShares-789426285-project-member] HTTP exception thrown: 'resource_action' can only be one of ['delete'] May 28 12:59:38 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-f48e3052-f08e-4753-89c6-3e36097fbde4 tempest-ResourceLockNegativeTestWithShares-789426285 tempest-ResourceLockNegativeTestWithShares-789426285-project-member] http://10.27.203.238/share/v2/86e4aff17ad94d75a624b038464bfeb2/resource-locks returned with HTTP 400 May 28 12:59:38 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 766/1517] 10.27.203.238 () {66 vars in 1386 bytes} [Tue May 28 12:59:38 2024] POST /share/v2/86e4aff17ad94d75a624b038464bfeb2/resource-locks => generated 91 bytes in 7 msecs (HTTP/1.1 400) 6 headers in 239 bytes (1 switches on core 0) May 28 12:59:38 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-26136dc2-2141-45cf-8b1e-4685ebd49de8 tempest-ResourceLockNegativeTestWithShares-789426285 tempest-ResourceLockNegativeTestWithShares-789426285-project-member] POST http://10.27.203.238/share/v2/86e4aff17ad94d75a624b038464bfeb2/resource-locks May 28 12:59:38 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-26136dc2-2141-45cf-8b1e-4685ebd49de8 tempest-ResourceLockNegativeTestWithShares-789426285 tempest-ResourceLockNegativeTestWithShares-789426285-project-member] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"resource_lock": {"resource_id": "a5984861-5086-4848-82ce-0960e763197b", "resource_type": "share", "resource_action": "delete", "lock_reason": "locked by tempest tests"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:59:38 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-26136dc2-2141-45cf-8b1e-4685ebd49de8 tempest-ResourceLockNegativeTestWithShares-789426285 tempest-ResourceLockNegativeTestWithShares-789426285-project-member] http://10.27.203.238/share/v2/86e4aff17ad94d75a624b038464bfeb2/resource-locks returned with HTTP 200 May 28 12:59:38 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 752/1518] 10.27.203.238 () {66 vars in 1386 bytes} [Tue May 28 12:59:38 2024] POST /share/v2/86e4aff17ad94d75a624b038464bfeb2/resource-locks => generated 700 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:59:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef073d54-4aec-4ab5-87dc-e208a1cd6c4f tempest-ResourceLockDeleteTest-671583867 tempest-ResourceLockDeleteTest-671583867-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef073d54-4aec-4ab5-87dc-e208a1cd6c4f tempest-ResourceLockDeleteTest-671583867 tempest-ResourceLockDeleteTest-671583867-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23fd0fb-5980-42f8-a93c-2159441cd2f0 tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c23c4f0d80fc4a328a0d37c798eb66f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c8bc02239694668aa5810b9e0fc29f3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23fd0fb-5980-42f8-a93c-2159441cd2f0 tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23fd0fb-5980-42f8-a93c-2159441cd2f0 tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23fd0fb-5980-42f8-a93c-2159441cd2f0 tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] PATH_INFO: `/v3/domains` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23fd0fb-5980-42f8-a93c-2159441cd2f0 tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:59:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23fd0fb-5980-42f8-a93c-2159441cd2f0 tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23fd0fb-5980-42f8-a93c-2159441cd2f0 tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:38 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1243/2511] 10.27.203.238 () {62 vars in 1241 bytes} [Tue May 28 12:59:38 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 19 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:59:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845d1e10-d996-4b0d-a62b-1959b2ab9920 tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845d1e10-d996-4b0d-a62b-1959b2ab9920 tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af92ad40-6fa8-4bea-9ae9-9c858ddbf23b tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c23c4f0d80fc4a328a0d37c798eb66f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c8bc02239694668aa5810b9e0fc29f3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af92ad40-6fa8-4bea-9ae9-9c858ddbf23b tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af92ad40-6fa8-4bea-9ae9-9c858ddbf23b tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af92ad40-6fa8-4bea-9ae9-9c858ddbf23b tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] PATH_INFO: `/v3/users` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af92ad40-6fa8-4bea-9ae9-9c858ddbf23b tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af92ad40-6fa8-4bea-9ae9-9c858ddbf23b tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:38 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-af92ad40-6fa8-4bea-9ae9-9c858ddbf23b tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] Truncating password to algorithm specific maximum length 72 characters. May 28 12:59:38 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1269/2512] 10.27.203.238 () {64 vars in 1232 bytes} [Tue May 28 12:59:38 2024] POST /identity/v3/users => generated 435 bytes in 34 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:59:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23fd0fb-5980-42f8-a93c-2159441cd2f0 tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23fd0fb-5980-42f8-a93c-2159441cd2f0 tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1681dab-439c-4a98-ae6e-0587ed3d4a03 tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c23c4f0d80fc4a328a0d37c798eb66f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c8bc02239694668aa5810b9e0fc29f3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1681dab-439c-4a98-ae6e-0587ed3d4a03 tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1681dab-439c-4a98-ae6e-0587ed3d4a03 tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1681dab-439c-4a98-ae6e-0587ed3d4a03 tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] PATH_INFO: `/v3/roles` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1681dab-439c-4a98-ae6e-0587ed3d4a03 tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1681dab-439c-4a98-ae6e-0587ed3d4a03 tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:38 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1244/2513] 10.27.203.238 () {62 vars in 1210 bytes} [Tue May 28 12:59:38 2024] GET /identity/v3/roles => generated 1680 bytes in 17 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:59:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af92ad40-6fa8-4bea-9ae9-9c858ddbf23b tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af92ad40-6fa8-4bea-9ae9-9c858ddbf23b tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abee469-0903-4aaf-897b-4420c8c1ac6f tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c23c4f0d80fc4a328a0d37c798eb66f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c8bc02239694668aa5810b9e0fc29f3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abee469-0903-4aaf-897b-4420c8c1ac6f tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] REQUEST_METHOD: `PUT` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abee469-0903-4aaf-897b-4420c8c1ac6f tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abee469-0903-4aaf-897b-4420c8c1ac6f tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] PATH_INFO: `/v3/projects/86e4aff17ad94d75a624b038464bfeb2/users/0f30b8ae74474de0b34a7f48f86a312e/roles/44620cad10ae407c90c91e2c296adb04` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abee469-0903-4aaf-897b-4420c8c1ac6f tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] RBAC: Authorizing `identity:create_grant(project_id=86e4aff17ad94d75a624b038464bfeb2, user_id=0f30b8ae74474de0b34a7f48f86a312e, role_id=44620cad10ae407c90c91e2c296adb04)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abee469-0903-4aaf-897b-4420c8c1ac6f tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:38 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1270/2514] 10.27.203.238 () {64 vars in 1571 bytes} [Tue May 28 12:59:38 2024] PUT /identity/v3/projects/86e4aff17ad94d75a624b038464bfeb2/users/0f30b8ae74474de0b34a7f48f86a312e/roles/44620cad10ae407c90c91e2c296adb04 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:59:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8068912b-4e0d-4478-8ba3-c79d7dd01c9e None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8068912b-4e0d-4478-8ba3-c79d7dd01c9e None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8068912b-4e0d-4478-8ba3-c79d7dd01c9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:38 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-8068912b-4e0d-4478-8ba3-c79d7dd01c9e None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:59:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-8068912b-4e0d-4478-8ba3-c79d7dd01c9e None None] MFA Rules not processed for user `0f30b8ae74474de0b34a7f48f86a312e`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:59:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-8068912b-4e0d-4478-8ba3-c79d7dd01c9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:59:38 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1245/2515] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:59:38 2024] POST /identity/v3/auth/tokens => generated 3967 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:59:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abee469-0903-4aaf-897b-4420c8c1ac6f tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-4abee469-0903-4aaf-897b-4420c8c1ac6f tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:59:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abee469-0903-4aaf-897b-4420c8c1ac6f tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e786b96-8813-44b3-8791-263593f53577 service manila] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f110cf6300f049c897d0aab63218d1e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e786b96-8813-44b3-8791-263593f53577 service manila] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e786b96-8813-44b3-8791-263593f53577 service manila] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e786b96-8813-44b3-8791-263593f53577 service manila] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e786b96-8813-44b3-8791-263593f53577 service manila] RBAC: Authorizing `identity:validate_token()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e786b96-8813-44b3-8791-263593f53577 service manila] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:38 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1271/2516] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 12:59:38 2024] GET /identity/v3/auth/tokens => generated 3967 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 12:59:38 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-976781d2-44e8-461f-bb6d-c67bc9e2b41b tempest-ResourceLockNegativeTestWithShares-789426285 tempest-manila_86e4aff17ad94d75a624b038464bfeb2-2055597637] DELETE http://10.27.203.238/share/v2/86e4aff17ad94d75a624b038464bfeb2/resource-locks/300bc5a7-0d92-47a0-9759-31be9b26d946 May 28 12:59:38 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-976781d2-44e8-461f-bb6d-c67bc9e2b41b tempest-ResourceLockNegativeTestWithShares-789426285 tempest-manila_86e4aff17ad94d75a624b038464bfeb2-2055597637] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:38 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-976781d2-44e8-461f-bb6d-c67bc9e2b41b tempest-ResourceLockNegativeTestWithShares-789426285 tempest-manila_86e4aff17ad94d75a624b038464bfeb2-2055597637] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:38 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.policy [None req-976781d2-44e8-461f-bb6d-c67bc9e2b41b tempest-ResourceLockNegativeTestWithShares-789426285 tempest-manila_86e4aff17ad94d75a624b038464bfeb2-2055597637] Policy check for resource_lock:delete failed with credentials {'is_admin': False, 'user_id': '0f30b8ae74474de0b34a7f48f86a312e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e4aff17ad94d75a624b038464bfeb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98329) authorize /opt/stack/manila/manila/policy.py:208}} May 28 12:59:38 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-976781d2-44e8-461f-bb6d-c67bc9e2b41b tempest-ResourceLockNegativeTestWithShares-789426285 tempest-manila_86e4aff17ad94d75a624b038464bfeb2-2055597637] http://10.27.203.238/share/v2/86e4aff17ad94d75a624b038464bfeb2/resource-locks/300bc5a7-0d92-47a0-9759-31be9b26d946 returned with HTTP 403 May 28 12:59:38 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 767/1519] 10.27.203.238 () {64 vars in 1478 bytes} [Tue May 28 12:59:38 2024] DELETE /share/v2/86e4aff17ad94d75a624b038464bfeb2/resource-locks/300bc5a7-0d92-47a0-9759-31be9b26d946 => generated 101 bytes in 76 msecs (HTTP/1.1 403) 6 headers in 238 bytes (2 switches on core 0) May 28 12:59:38 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-2d467f70-74c8-40f7-ba4a-faef236e71e5 tempest-ResourceLockNegativeTestWithShares-789426285 tempest-ResourceLockNegativeTestWithShares-789426285-project-member] POST http://10.27.203.238/share/v2/86e4aff17ad94d75a624b038464bfeb2/resource-locks May 28 12:59:38 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-2d467f70-74c8-40f7-ba4a-faef236e71e5 tempest-ResourceLockNegativeTestWithShares-789426285 tempest-ResourceLockNegativeTestWithShares-789426285-project-member] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"resource_lock": {"resource_id": "a5984861-5086-4848-82ce-0960e763197b", "resource_type": "share", "resource_action": "delete", "lock_reason": "locked by tempest tests"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:59:38 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-2d467f70-74c8-40f7-ba4a-faef236e71e5 tempest-ResourceLockNegativeTestWithShares-789426285 tempest-ResourceLockNegativeTestWithShares-789426285-project-member] http://10.27.203.238/share/v2/86e4aff17ad94d75a624b038464bfeb2/resource-locks returned with HTTP 200 May 28 12:59:38 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 753/1520] 10.27.203.238 () {66 vars in 1386 bytes} [Tue May 28 12:59:38 2024] POST /share/v2/86e4aff17ad94d75a624b038464bfeb2/resource-locks => generated 700 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:59:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8068912b-4e0d-4478-8ba3-c79d7dd01c9e None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8068912b-4e0d-4478-8ba3-c79d7dd01c9e None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4848d92-180c-4e6d-9040-8eeac7b92837 tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c23c4f0d80fc4a328a0d37c798eb66f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c8bc02239694668aa5810b9e0fc29f3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4848d92-180c-4e6d-9040-8eeac7b92837 tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4848d92-180c-4e6d-9040-8eeac7b92837 tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4848d92-180c-4e6d-9040-8eeac7b92837 tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] PATH_INFO: `/v3/domains` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4848d92-180c-4e6d-9040-8eeac7b92837 tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:59:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4848d92-180c-4e6d-9040-8eeac7b92837 tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4848d92-180c-4e6d-9040-8eeac7b92837 tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:38 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1246/2517] 10.27.203.238 () {62 vars in 1241 bytes} [Tue May 28 12:59:38 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:59:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e786b96-8813-44b3-8791-263593f53577 service manila] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e786b96-8813-44b3-8791-263593f53577 service manila] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebfea5b-fb68-4942-81c8-2afe1b8229ba tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c23c4f0d80fc4a328a0d37c798eb66f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c8bc02239694668aa5810b9e0fc29f3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebfea5b-fb68-4942-81c8-2afe1b8229ba tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebfea5b-fb68-4942-81c8-2afe1b8229ba tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebfea5b-fb68-4942-81c8-2afe1b8229ba tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] PATH_INFO: `/v3/users` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebfea5b-fb68-4942-81c8-2afe1b8229ba tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebfea5b-fb68-4942-81c8-2afe1b8229ba tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:38 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-eebfea5b-fb68-4942-81c8-2afe1b8229ba tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] Truncating password to algorithm specific maximum length 72 characters. May 28 12:59:38 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1272/2518] 10.27.203.238 () {64 vars in 1232 bytes} [Tue May 28 12:59:38 2024] POST /identity/v3/users => generated 433 bytes in 33 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:59:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4848d92-180c-4e6d-9040-8eeac7b92837 tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4848d92-180c-4e6d-9040-8eeac7b92837 tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892b0287-fdd8-4248-9065-be593c1b42fa tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c23c4f0d80fc4a328a0d37c798eb66f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c8bc02239694668aa5810b9e0fc29f3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892b0287-fdd8-4248-9065-be593c1b42fa tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892b0287-fdd8-4248-9065-be593c1b42fa tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892b0287-fdd8-4248-9065-be593c1b42fa tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] PATH_INFO: `/v3/roles` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892b0287-fdd8-4248-9065-be593c1b42fa tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892b0287-fdd8-4248-9065-be593c1b42fa tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:38 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1247/2519] 10.27.203.238 () {62 vars in 1210 bytes} [Tue May 28 12:59:38 2024] GET /identity/v3/roles => generated 1680 bytes in 16 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:59:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebfea5b-fb68-4942-81c8-2afe1b8229ba tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebfea5b-fb68-4942-81c8-2afe1b8229ba tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08b30e2-7fc5-4fa0-875f-e24f57568aee tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c23c4f0d80fc4a328a0d37c798eb66f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c8bc02239694668aa5810b9e0fc29f3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08b30e2-7fc5-4fa0-875f-e24f57568aee tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] REQUEST_METHOD: `PUT` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08b30e2-7fc5-4fa0-875f-e24f57568aee tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08b30e2-7fc5-4fa0-875f-e24f57568aee tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] PATH_INFO: `/v3/projects/86e4aff17ad94d75a624b038464bfeb2/users/7013a62752274b85851c128bd3c241f3/roles/44620cad10ae407c90c91e2c296adb04` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08b30e2-7fc5-4fa0-875f-e24f57568aee tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] RBAC: Authorizing `identity:create_grant(project_id=86e4aff17ad94d75a624b038464bfeb2, user_id=7013a62752274b85851c128bd3c241f3, role_id=44620cad10ae407c90c91e2c296adb04)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08b30e2-7fc5-4fa0-875f-e24f57568aee tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:38 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1273/2520] 10.27.203.238 () {64 vars in 1571 bytes} [Tue May 28 12:59:38 2024] PUT /identity/v3/projects/86e4aff17ad94d75a624b038464bfeb2/users/7013a62752274b85851c128bd3c241f3/roles/44620cad10ae407c90c91e2c296adb04 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:59:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31a7d6f-50be-40ba-bad2-36df6bc9112e None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31a7d6f-50be-40ba-bad2-36df6bc9112e None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31a7d6f-50be-40ba-bad2-36df6bc9112e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:38 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-c31a7d6f-50be-40ba-bad2-36df6bc9112e None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:59:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-c31a7d6f-50be-40ba-bad2-36df6bc9112e None None] MFA Rules not processed for user `7013a62752274b85851c128bd3c241f3`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:59:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-c31a7d6f-50be-40ba-bad2-36df6bc9112e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1248/2521] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:59:38 2024] POST /identity/v3/auth/tokens => generated 3966 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08b30e2-7fc5-4fa0-875f-e24f57568aee tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08b30e2-7fc5-4fa0-875f-e24f57568aee tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3b5e3f-7b0d-45fe-8f69-4d17981b0d10 service manila] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f110cf6300f049c897d0aab63218d1e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3b5e3f-7b0d-45fe-8f69-4d17981b0d10 service manila] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3b5e3f-7b0d-45fe-8f69-4d17981b0d10 service manila] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3b5e3f-7b0d-45fe-8f69-4d17981b0d10 service manila] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3b5e3f-7b0d-45fe-8f69-4d17981b0d10 service manila] RBAC: Authorizing `identity:validate_token()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3b5e3f-7b0d-45fe-8f69-4d17981b0d10 service manila] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1274/2522] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 12:59:39 2024] GET /identity/v3/auth/tokens => generated 3966 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 12:59:39 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-8230ca11-56b0-4943-b832-752ee9e3b21d tempest-ResourceLockNegativeTestWithShares-789426285 tempest-manila_86e4aff17ad94d75a624b038464bfeb2-114086631] PUT http://10.27.203.238/share/v2/86e4aff17ad94d75a624b038464bfeb2/resource-locks/557d092f-7be1-43a9-8960-483fd53350a5 May 28 12:59:39 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-8230ca11-56b0-4943-b832-752ee9e3b21d tempest-ResourceLockNegativeTestWithShares-789426285 tempest-manila_86e4aff17ad94d75a624b038464bfeb2-114086631] Action: 'update', calling method: Controller.__getattribute__..version_select, body: {"resource_lock": {"lock_reason": "I shouldn't be able to do this"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:59:39 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.policy [None req-8230ca11-56b0-4943-b832-752ee9e3b21d tempest-ResourceLockNegativeTestWithShares-789426285 tempest-manila_86e4aff17ad94d75a624b038464bfeb2-114086631] Policy check for resource_lock:update failed with credentials {'is_admin': False, 'user_id': '7013a62752274b85851c128bd3c241f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e4aff17ad94d75a624b038464bfeb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98329) authorize /opt/stack/manila/manila/policy.py:208}} May 28 12:59:39 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-8230ca11-56b0-4943-b832-752ee9e3b21d tempest-ResourceLockNegativeTestWithShares-789426285 tempest-manila_86e4aff17ad94d75a624b038464bfeb2-114086631] http://10.27.203.238/share/v2/86e4aff17ad94d75a624b038464bfeb2/resource-locks/557d092f-7be1-43a9-8960-483fd53350a5 returned with HTTP 403 May 28 12:59:39 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 768/1521] 10.27.203.238 () {66 vars in 1495 bytes} [Tue May 28 12:59:39 2024] PUT /share/v2/86e4aff17ad94d75a624b038464bfeb2/resource-locks/557d092f-7be1-43a9-8960-483fd53350a5 => generated 101 bytes in 72 msecs (HTTP/1.1 403) 6 headers in 238 bytes (1 switches on core 0) May 28 12:59:39 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-22ac66d3-92b1-4b75-9592-92ba1fa57168 tempest-ResourceLockNegativeTestWithShares-789426285 tempest-ResourceLockNegativeTestWithShares-789426285-project-member] POST http://10.27.203.238/share/v2/86e4aff17ad94d75a624b038464bfeb2/resource-locks May 28 12:59:39 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-22ac66d3-92b1-4b75-9592-92ba1fa57168 tempest-ResourceLockNegativeTestWithShares-789426285 tempest-ResourceLockNegativeTestWithShares-789426285-project-member] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"resource_lock": {"resource_id": "a5984861-5086-4848-82ce-0960e763197b", "resource_type": "share", "resource_action": "delete", "lock_reason": "locked by tempest tests"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:59:39 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-22ac66d3-92b1-4b75-9592-92ba1fa57168 tempest-ResourceLockNegativeTestWithShares-789426285 tempest-ResourceLockNegativeTestWithShares-789426285-project-member] http://10.27.203.238/share/v2/86e4aff17ad94d75a624b038464bfeb2/resource-locks returned with HTTP 200 May 28 12:59:39 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 754/1522] 10.27.203.238 () {66 vars in 1386 bytes} [Tue May 28 12:59:39 2024] POST /share/v2/86e4aff17ad94d75a624b038464bfeb2/resource-locks => generated 700 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:59:39 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-202ac6df-37c5-46ab-ab69-6cd83e8e3594 tempest-ResourceLockNegativeTestWithShares-789426285 tempest-ResourceLockNegativeTestWithShares-789426285-project-member] PUT http://10.27.203.238/share/v2/86e4aff17ad94d75a624b038464bfeb2/resource-locks/07ed0369-0a7e-48b6-8da4-908d227c1051 May 28 12:59:39 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-202ac6df-37c5-46ab-ab69-6cd83e8e3594 tempest-ResourceLockNegativeTestWithShares-789426285 tempest-ResourceLockNegativeTestWithShares-789426285-project-member] Action: 'update', calling method: Controller.__getattribute__..version_select, body: {"resource_lock": {"resource_action": "invalid-action"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:59:39 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-202ac6df-37c5-46ab-ab69-6cd83e8e3594 tempest-ResourceLockNegativeTestWithShares-789426285 tempest-ResourceLockNegativeTestWithShares-789426285-project-member] HTTP exception thrown: 'resource_action' can only be one of ['delete'] May 28 12:59:39 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-202ac6df-37c5-46ab-ab69-6cd83e8e3594 tempest-ResourceLockNegativeTestWithShares-789426285 tempest-ResourceLockNegativeTestWithShares-789426285-project-member] http://10.27.203.238/share/v2/86e4aff17ad94d75a624b038464bfeb2/resource-locks/07ed0369-0a7e-48b6-8da4-908d227c1051 returned with HTTP 400 May 28 12:59:39 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 769/1523] 10.27.203.238 () {66 vars in 1495 bytes} [Tue May 28 12:59:39 2024] PUT /share/v2/86e4aff17ad94d75a624b038464bfeb2/resource-locks/07ed0369-0a7e-48b6-8da4-908d227c1051 => generated 91 bytes in 10 msecs (HTTP/1.1 400) 6 headers in 239 bytes (1 switches on core 0) May 28 12:59:39 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-24c3a898-5bf5-4960-a11a-6ad51e0f079b tempest-ResourceLockNegativeTestWithShares-789426285 tempest-ResourceLockNegativeTestWithShares-789426285-project-member] PUT http://10.27.203.238/share/v2/86e4aff17ad94d75a624b038464bfeb2/resource-locks/07ed0369-0a7e-48b6-8da4-908d227c1051 May 28 12:59:39 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-24c3a898-5bf5-4960-a11a-6ad51e0f079b tempest-ResourceLockNegativeTestWithShares-789426285 tempest-ResourceLockNegativeTestWithShares-789426285-project-member] Action: 'update', calling method: Controller.__getattribute__..version_select, body: {"resource_lock": {"lock_reason": "invalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalidinvalid"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:59:39 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-24c3a898-5bf5-4960-a11a-6ad51e0f079b tempest-ResourceLockNegativeTestWithShares-789426285 tempest-ResourceLockNegativeTestWithShares-789426285-project-member] HTTP exception thrown: 'lock_reason' can contain a maximum of 1023 characters. May 28 12:59:39 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-24c3a898-5bf5-4960-a11a-6ad51e0f079b tempest-ResourceLockNegativeTestWithShares-789426285 tempest-ResourceLockNegativeTestWithShares-789426285-project-member] http://10.27.203.238/share/v2/86e4aff17ad94d75a624b038464bfeb2/resource-locks/07ed0369-0a7e-48b6-8da4-908d227c1051 returned with HTTP 400 May 28 12:59:39 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 755/1524] 10.27.203.238 () {66 vars in 1497 bytes} [Tue May 28 12:59:39 2024] PUT /share/v2/86e4aff17ad94d75a624b038464bfeb2/resource-locks/07ed0369-0a7e-48b6-8da4-908d227c1051 => generated 99 bytes in 11 msecs (HTTP/1.1 400) 6 headers in 239 bytes (1 switches on core 0) May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31a7d6f-50be-40ba-bad2-36df6bc9112e None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31a7d6f-50be-40ba-bad2-36df6bc9112e None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fb7e2f-a4ab-416b-b171-fecf7e7b0d6e tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c23c4f0d80fc4a328a0d37c798eb66f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c8bc02239694668aa5810b9e0fc29f3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fb7e2f-a4ab-416b-b171-fecf7e7b0d6e tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fb7e2f-a4ab-416b-b171-fecf7e7b0d6e tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fb7e2f-a4ab-416b-b171-fecf7e7b0d6e tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] PATH_INFO: `/v3/users/b9078b0601ac4efa93bdcc390f3d1208` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fb7e2f-a4ab-416b-b171-fecf7e7b0d6e tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] RBAC: Authorizing `identity:delete_user(user_id=b9078b0601ac4efa93bdcc390f3d1208)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fb7e2f-a4ab-416b-b171-fecf7e7b0d6e tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:39 l75lg1-v1 dstat.sh[49771]: 28-05 12:59:39| 9 1 88 1 0|5741M 1726M 277M 7880M| 12k 10k| 0 1856k| 0 162 |6347 10k|1.17 1.07 1.01|2.0 2.0 0| 0 0 | 0 2048M| 29 364 0 35 0 May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-79fb7e2f-a4ab-416b-b171-fecf7e7b0d6e tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] Could not find user: b9078b0601ac4efa93bdcc390f3d1208.: keystone.exception.UserNotFound: Could not find user: b9078b0601ac4efa93bdcc390f3d1208. May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: b9078b0601ac4efa93bdcc390f3d1208. May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1249/2523] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 12:59:39 2024] DELETE /identity/v3/users/b9078b0601ac4efa93bdcc390f3d1208 => generated 110 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3b5e3f-7b0d-45fe-8f69-4d17981b0d10 service manila] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3b5e3f-7b0d-45fe-8f69-4d17981b0d10 service manila] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde3ade6-bbfb-4134-99fd-da4e77055617 tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c23c4f0d80fc4a328a0d37c798eb66f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c8bc02239694668aa5810b9e0fc29f3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde3ade6-bbfb-4134-99fd-da4e77055617 tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde3ade6-bbfb-4134-99fd-da4e77055617 tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde3ade6-bbfb-4134-99fd-da4e77055617 tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] PATH_INFO: `/v3/users/567edee5a37f498e8a3f54a933728377` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde3ade6-bbfb-4134-99fd-da4e77055617 tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] RBAC: Authorizing `identity:delete_user(user_id=567edee5a37f498e8a3f54a933728377)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde3ade6-bbfb-4134-99fd-da4e77055617 tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-bde3ade6-bbfb-4134-99fd-da4e77055617 tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] Could not find user: 567edee5a37f498e8a3f54a933728377.: keystone.exception.UserNotFound: Could not find user: 567edee5a37f498e8a3f54a933728377. May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 567edee5a37f498e8a3f54a933728377. May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1275/2524] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 12:59:39 2024] DELETE /identity/v3/users/567edee5a37f498e8a3f54a933728377 => generated 110 bytes in 26 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fb7e2f-a4ab-416b-b171-fecf7e7b0d6e tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fb7e2f-a4ab-416b-b171-fecf7e7b0d6e tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef874469-46a9-45ff-9b87-46d5c335f6e6 tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c23c4f0d80fc4a328a0d37c798eb66f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c8bc02239694668aa5810b9e0fc29f3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef874469-46a9-45ff-9b87-46d5c335f6e6 tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef874469-46a9-45ff-9b87-46d5c335f6e6 tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef874469-46a9-45ff-9b87-46d5c335f6e6 tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] PATH_INFO: `/v3/users/e1f712aac7e94e429048f60f92a8a736` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef874469-46a9-45ff-9b87-46d5c335f6e6 tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] RBAC: Authorizing `identity:delete_user(user_id=e1f712aac7e94e429048f60f92a8a736)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef874469-46a9-45ff-9b87-46d5c335f6e6 tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-ef874469-46a9-45ff-9b87-46d5c335f6e6 tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] Could not find user: e1f712aac7e94e429048f60f92a8a736.: keystone.exception.UserNotFound: Could not find user: e1f712aac7e94e429048f60f92a8a736. May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: e1f712aac7e94e429048f60f92a8a736. May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1250/2525] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 12:59:39 2024] DELETE /identity/v3/users/e1f712aac7e94e429048f60f92a8a736 => generated 110 bytes in 24 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde3ade6-bbfb-4134-99fd-da4e77055617 tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde3ade6-bbfb-4134-99fd-da4e77055617 tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0508f4db-1549-408a-8342-a2e24d5c2185 tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c23c4f0d80fc4a328a0d37c798eb66f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c8bc02239694668aa5810b9e0fc29f3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0508f4db-1549-408a-8342-a2e24d5c2185 tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0508f4db-1549-408a-8342-a2e24d5c2185 tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0508f4db-1549-408a-8342-a2e24d5c2185 tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] PATH_INFO: `/v3/users/9d3788d7291b4ee389136f181e35a26b` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0508f4db-1549-408a-8342-a2e24d5c2185 tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] RBAC: Authorizing `identity:delete_user(user_id=9d3788d7291b4ee389136f181e35a26b)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0508f4db-1549-408a-8342-a2e24d5c2185 tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-0508f4db-1549-408a-8342-a2e24d5c2185 tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] Could not find user: 9d3788d7291b4ee389136f181e35a26b.: keystone.exception.UserNotFound: Could not find user: 9d3788d7291b4ee389136f181e35a26b. May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 9d3788d7291b4ee389136f181e35a26b. May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1276/2526] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 12:59:39 2024] DELETE /identity/v3/users/9d3788d7291b4ee389136f181e35a26b => generated 110 bytes in 25 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef874469-46a9-45ff-9b87-46d5c335f6e6 tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef874469-46a9-45ff-9b87-46d5c335f6e6 tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0401416-b859-483e-9df6-4606226685b3 tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c23c4f0d80fc4a328a0d37c798eb66f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c8bc02239694668aa5810b9e0fc29f3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0401416-b859-483e-9df6-4606226685b3 tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0401416-b859-483e-9df6-4606226685b3 tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0401416-b859-483e-9df6-4606226685b3 tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] PATH_INFO: `/v3/users/2eb81a384d764f8cb6d0d7e830959013` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0401416-b859-483e-9df6-4606226685b3 tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] RBAC: Authorizing `identity:delete_user(user_id=2eb81a384d764f8cb6d0d7e830959013)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0401416-b859-483e-9df6-4606226685b3 tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-e0401416-b859-483e-9df6-4606226685b3 tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2eb81a384d764f8cb6d0d7e830959013', 'request_id': 'req-e0401416-b859-483e-9df6-4606226685b3'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-e0401416-b859-483e-9df6-4606226685b3 tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2eb81a384d764f8cb6d0d7e830959013', 'request_id': 'req-e0401416-b859-483e-9df6-4606226685b3'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-e0401416-b859-483e-9df6-4606226685b3 tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2eb81a384d764f8cb6d0d7e830959013', 'request_id': 'req-e0401416-b859-483e-9df6-4606226685b3'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-e0401416-b859-483e-9df6-4606226685b3 tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2eb81a384d764f8cb6d0d7e830959013', 'request_id': 'req-e0401416-b859-483e-9df6-4606226685b3'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-e0401416-b859-483e-9df6-4606226685b3 tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2eb81a384d764f8cb6d0d7e830959013', 'request_id': 'req-e0401416-b859-483e-9df6-4606226685b3'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1251/2527] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 12:59:39 2024] DELETE /identity/v3/users/2eb81a384d764f8cb6d0d7e830959013 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0508f4db-1549-408a-8342-a2e24d5c2185 tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-0508f4db-1549-408a-8342-a2e24d5c2185 tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:59:39 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-a914aba9-922e-4354-a018-19a6def1915e tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] GET http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/share-access-rules?share_id=72db8769-ece7-42ff-af27-2e778292a9b4 May 28 12:59:39 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-a914aba9-922e-4354-a018-19a6def1915e tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:39 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-a914aba9-922e-4354-a018-19a6def1915e tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0508f4db-1549-408a-8342-a2e24d5c2185 tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:39 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-a914aba9-922e-4354-a018-19a6def1915e tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/share-access-rules?share_id=72db8769-ece7-42ff-af27-2e778292a9b4 returned with HTTP 200 May 28 12:59:39 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 770/1525] 10.27.203.238 () {64 vars in 1467 bytes} [Tue May 28 12:59:39 2024] GET /share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/share-access-rules?share_id=72db8769-ece7-42ff-af27-2e778292a9b4 => generated 19 bytes in 31 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:59:39 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-9bdd23f5-e4f3-44d6-b48c-aa4932d96265 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] POST http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action May 28 12:59:39 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-9bdd23f5-e4f3-44d6-b48c-aa4932d96265 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Action body: b'{"allow_access": {"access_type": "ip", "access_to": "fd2c:b029:bba6:df54::1/128", "access_level": "rw"}}' {{(pid=98330) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:59:39 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-9bdd23f5-e4f3-44d6-b48c-aa4932d96265 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Action: 'action', calling method: ShareController.allow_access, body: {"allow_access": {"access_type": "ip", "access_to": "fd2c:b029:bba6:df54::1/128", "access_level": "rw"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc2c389-8522-4c19-b15d-32535e61c5b0 tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c23c4f0d80fc4a328a0d37c798eb66f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c8bc02239694668aa5810b9e0fc29f3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc2c389-8522-4c19-b15d-32535e61c5b0 tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc2c389-8522-4c19-b15d-32535e61c5b0 tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc2c389-8522-4c19-b15d-32535e61c5b0 tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] PATH_INFO: `/v3/users/0f30b8ae74474de0b34a7f48f86a312e` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc2c389-8522-4c19-b15d-32535e61c5b0 tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] RBAC: Authorizing `identity:delete_user(user_id=0f30b8ae74474de0b34a7f48f86a312e)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc2c389-8522-4c19-b15d-32535e61c5b0 tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:39 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-9bdd23f5-e4f3-44d6-b48c-aa4932d96265 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:39 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-9bdd23f5-e4f3-44d6-b48c-aa4932d96265 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:39 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c1817b1a-9641-4100-a7a6-5923abdafa13 tempest-ResourceLockDeleteTest-1157183439 None] <<< [DELETE] https://127.0.0.1:40443/api/views/34/ May 28 12:59:39 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c1817b1a-9641-4100-a7a6-5923abdafa13 tempest-ResourceLockDeleteTest-1157183439 None] --- [DELETE] https://127.0.0.1:40443/api/views/34/: Done May 28 12:59:39 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c1817b1a-9641-4100-a7a6-5923abdafa13 tempest-ResourceLockDeleteTest-1157183439 None] >>> [GET] https://127.0.0.1:40443/api/quotas/ May 28 12:59:39 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c1817b1a-9641-4100-a7a6-5923abdafa13 tempest-ResourceLockDeleteTest-1157183439 None] {'allow_redirects': True, May 28 12:59:39 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c1817b1a-9641-4100-a7a6-5923abdafa13 tempest-ResourceLockDeleteTest-1157183439 None] 'params': {'name': '9fadf39f-1d93-4ddd-bd00-1fd7ccc09539'}} May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-5bc2c389-8522-4c19-b15d-32535e61c5b0 tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f30b8ae74474de0b34a7f48f86a312e', 'request_id': 'req-5bc2c389-8522-4c19-b15d-32535e61c5b0'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-5bc2c389-8522-4c19-b15d-32535e61c5b0 tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f30b8ae74474de0b34a7f48f86a312e', 'request_id': 'req-5bc2c389-8522-4c19-b15d-32535e61c5b0'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-5bc2c389-8522-4c19-b15d-32535e61c5b0 tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f30b8ae74474de0b34a7f48f86a312e', 'request_id': 'req-5bc2c389-8522-4c19-b15d-32535e61c5b0'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-5bc2c389-8522-4c19-b15d-32535e61c5b0 tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f30b8ae74474de0b34a7f48f86a312e', 'request_id': 'req-5bc2c389-8522-4c19-b15d-32535e61c5b0'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-5bc2c389-8522-4c19-b15d-32535e61c5b0 tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f30b8ae74474de0b34a7f48f86a312e', 'request_id': 'req-5bc2c389-8522-4c19-b15d-32535e61c5b0'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1277/2528] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 12:59:39 2024] DELETE /identity/v3/users/0f30b8ae74474de0b34a7f48f86a312e => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:59:39 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-9bdd23f5-e4f3-44d6-b48c-aa4932d96265 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.050s {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0401416-b859-483e-9df6-4606226685b3 tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:39 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-9bdd23f5-e4f3-44d6-b48c-aa4932d96265 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action returned with HTTP 200 May 28 12:59:39 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 756/1526] 10.27.203.238 () {66 vars in 1494 bytes} [Tue May 28 12:59:39 2024] POST /share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action => generated 324 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0401416-b859-483e-9df6-4606226685b3 tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:39 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-e47fcfae-6ecc-4fef-b734-a5ddbc4610a8 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] GET http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/share-access-rules?share_id=72db8769-ece7-42ff-af27-2e778292a9b4 May 28 12:59:39 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-e47fcfae-6ecc-4fef-b734-a5ddbc4610a8 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:39 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-e47fcfae-6ecc-4fef-b734-a5ddbc4610a8 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:39 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-a3509738-e3ba-4b2e-8c0d-00fe87c72c58 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] GET http://10.27.203.238/share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/shares/9154359e-259b-4835-9888-c3df80cb12bd May 28 12:59:39 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-a3509738-e3ba-4b2e-8c0d-00fe87c72c58 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:39 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-a3509738-e3ba-4b2e-8c0d-00fe87c72c58 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:39 l75lg1-v1 manila-share[98474]: DEBUG manila.share.manager [None req-9bdd23f5-e4f3-44d6-b48c-aa4932d96265 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Received request to update access for share instance 7fdd602c-79d0-479c-95a2-336b202c6639. {{(pid=98474) update_access_for_instances /opt/stack/manila/manila/share/manager.py:4353}} May 28 12:59:39 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-a3509738-e3ba-4b2e-8c0d-00fe87c72c58 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] http://10.27.203.238/share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/shares/9154359e-259b-4835-9888-c3df80cb12bd returned with HTTP 200 May 28 12:59:39 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 757/1527] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:59:39 2024] GET /share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/shares/9154359e-259b-4835-9888-c3df80cb12bd => generated 1370 bytes in 30 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:59:39 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.lock.api [None req-e47fcfae-6ecc-4fef-b734-a5ddbc4610a8 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Searching for locks by: {'resource_id': '92aed90f-4f97-4ac6-bae1-6feb29133d5a', 'resource_action': 'show', 'resource_type': 'access_rule'} {{(pid=98329) get_all /opt/stack/manila/manila/lock/api.py:112}} May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b9bf7b-3ace-4095-a0df-b2991297cfc2 tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c23c4f0d80fc4a328a0d37c798eb66f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c8bc02239694668aa5810b9e0fc29f3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b9bf7b-3ace-4095-a0df-b2991297cfc2 tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b9bf7b-3ace-4095-a0df-b2991297cfc2 tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b9bf7b-3ace-4095-a0df-b2991297cfc2 tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] PATH_INFO: `/v3/users/7013a62752274b85851c128bd3c241f3` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b9bf7b-3ace-4095-a0df-b2991297cfc2 tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] RBAC: Authorizing `identity:delete_user(user_id=7013a62752274b85851c128bd3c241f3)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b9bf7b-3ace-4095-a0df-b2991297cfc2 tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:39 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-e47fcfae-6ecc-4fef-b734-a5ddbc4610a8 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/share-access-rules?share_id=72db8769-ece7-42ff-af27-2e778292a9b4 returned with HTTP 200 May 28 12:59:39 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 771/1528] 10.27.203.238 () {64 vars in 1467 bytes} [Tue May 28 12:59:39 2024] GET /share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/share-access-rules?share_id=72db8769-ece7-42ff-af27-2e778292a9b4 => generated 279 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:59:39 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-9bdd23f5-e4f3-44d6-b48c-aa4932d96265 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:39 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-9bdd23f5-e4f3-44d6-b48c-aa4932d96265 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:39 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-9bdd23f5-e4f3-44d6-b48c-aa4932d96265 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.004s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:39 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-9bdd23f5-e4f3-44d6-b48c-aa4932d96265 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:39 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-9bdd23f5-e4f3-44d6-b48c-aa4932d96265 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-28b9bf7b-3ace-4095-a0df-b2991297cfc2 tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7013a62752274b85851c128bd3c241f3', 'request_id': 'req-28b9bf7b-3ace-4095-a0df-b2991297cfc2'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-28b9bf7b-3ace-4095-a0df-b2991297cfc2 tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7013a62752274b85851c128bd3c241f3', 'request_id': 'req-28b9bf7b-3ace-4095-a0df-b2991297cfc2'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-28b9bf7b-3ace-4095-a0df-b2991297cfc2 tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7013a62752274b85851c128bd3c241f3', 'request_id': 'req-28b9bf7b-3ace-4095-a0df-b2991297cfc2'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-28b9bf7b-3ace-4095-a0df-b2991297cfc2 tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7013a62752274b85851c128bd3c241f3', 'request_id': 'req-28b9bf7b-3ace-4095-a0df-b2991297cfc2'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-28b9bf7b-3ace-4095-a0df-b2991297cfc2 tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7013a62752274b85851c128bd3c241f3', 'request_id': 'req-28b9bf7b-3ace-4095-a0df-b2991297cfc2'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:39 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-9bdd23f5-e4f3-44d6-b48c-aa4932d96265 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.073s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:39 l75lg1-v1 manila-share[98474]: DEBUG manila.share.access [None req-9bdd23f5-e4f3-44d6-b48c-aa4932d96265 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Updating access rules for share instance 7fdd602c-79d0-479c-95a2-336b202c6639 belonging to share 72db8769-ece7-42ff-af27-2e778292a9b4. {{(pid=98474) update_access_rules /opt/stack/manila/manila/share/access.py:298}} May 28 12:59:39 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1252/2529] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 12:59:39 2024] DELETE /identity/v3/users/7013a62752274b85851c128bd3c241f3 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:59:39 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-9c637d39-e583-4298-af5b-968468d506ae tempest-ResourceLockNegativeTestWithShares-789426285 tempest-ResourceLockNegativeTestWithShares-789426285-project-member] DELETE http://10.27.203.238/share/v2/86e4aff17ad94d75a624b038464bfeb2/resource-locks/07ed0369-0a7e-48b6-8da4-908d227c1051 May 28 12:59:39 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-9c637d39-e583-4298-af5b-968468d506ae tempest-ResourceLockNegativeTestWithShares-789426285 tempest-ResourceLockNegativeTestWithShares-789426285-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:39 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-9c637d39-e583-4298-af5b-968468d506ae tempest-ResourceLockNegativeTestWithShares-789426285 tempest-ResourceLockNegativeTestWithShares-789426285-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:39 l75lg1-v1 nova-conductor[83647]: DEBUG dbcounter [-] [83647] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=1 {{(pid=83647) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:59:39 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-9bdd23f5-e4f3-44d6-b48c-aa4932d96265 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:39 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-9bdd23f5-e4f3-44d6-b48c-aa4932d96265 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:39 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-9bdd23f5-e4f3-44d6-b48c-aa4932d96265 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.007s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:39 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-9bdd23f5-e4f3-44d6-b48c-aa4932d96265 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:39 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-9bdd23f5-e4f3-44d6-b48c-aa4932d96265 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:39 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-9c637d39-e583-4298-af5b-968468d506ae tempest-ResourceLockNegativeTestWithShares-789426285 tempest-ResourceLockNegativeTestWithShares-789426285-project-member] http://10.27.203.238/share/v2/86e4aff17ad94d75a624b038464bfeb2/resource-locks/07ed0369-0a7e-48b6-8da4-908d227c1051 returned with HTTP 204 May 28 12:59:39 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 758/1529] 10.27.203.238 () {64 vars in 1478 bytes} [Tue May 28 12:59:39 2024] DELETE /share/v2/86e4aff17ad94d75a624b038464bfeb2/resource-locks/07ed0369-0a7e-48b6-8da4-908d227c1051 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 6 headers in 245 bytes (1 switches on core 0) May 28 12:59:39 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-e2301a85-9886-4e34-b0e9-37d544bdb6f5 tempest-ResourceLockDeleteTest-1157183439 tempest-ResourceLockDeleteTest-1157183439-project-member] GET http://10.27.203.238/share/v2/645fb190404541a78e449c703540d6f8/shares/ed309fc1-d1ff-4352-a44a-a56b44eb8d0e May 28 12:59:39 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-e2301a85-9886-4e34-b0e9-37d544bdb6f5 tempest-ResourceLockDeleteTest-1157183439 tempest-ResourceLockDeleteTest-1157183439-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:39 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-e2301a85-9886-4e34-b0e9-37d544bdb6f5 tempest-ResourceLockDeleteTest-1157183439 tempest-ResourceLockDeleteTest-1157183439-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:39 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-c726d131-bc5b-46a6-877a-01a4c350e893 tempest-ResourceLockNegativeTestWithShares-789426285 tempest-ResourceLockNegativeTestWithShares-789426285-project-member] DELETE http://10.27.203.238/share/v2/86e4aff17ad94d75a624b038464bfeb2/resource-locks/557d092f-7be1-43a9-8960-483fd53350a5 May 28 12:59:39 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-c726d131-bc5b-46a6-877a-01a4c350e893 tempest-ResourceLockNegativeTestWithShares-789426285 tempest-ResourceLockNegativeTestWithShares-789426285-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:39 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-c726d131-bc5b-46a6-877a-01a4c350e893 tempest-ResourceLockNegativeTestWithShares-789426285 tempest-ResourceLockNegativeTestWithShares-789426285-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:39 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-9bdd23f5-e4f3-44d6-b48c-aa4932d96265 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.015s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:39 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-9bdd23f5-e4f3-44d6-b48c-aa4932d96265 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] changing access on None May 28 12:59:39 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9bdd23f5-e4f3-44d6-b48c-aa4932d96265 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:59:39 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9bdd23f5-e4f3-44d6-b48c-aa4932d96265 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] {'allow_redirects': True, May 28 12:59:39 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9bdd23f5-e4f3-44d6-b48c-aa4932d96265 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] 'params': {'name': '7fdd602c-79d0-479c-95a2-336b202c6639'}} May 28 12:59:39 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-c726d131-bc5b-46a6-877a-01a4c350e893 tempest-ResourceLockNegativeTestWithShares-789426285 tempest-ResourceLockNegativeTestWithShares-789426285-project-member] http://10.27.203.238/share/v2/86e4aff17ad94d75a624b038464bfeb2/resource-locks/557d092f-7be1-43a9-8960-483fd53350a5 returned with HTTP 204 May 28 12:59:39 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 759/1530] 10.27.203.238 () {64 vars in 1478 bytes} [Tue May 28 12:59:39 2024] DELETE /share/v2/86e4aff17ad94d75a624b038464bfeb2/resource-locks/557d092f-7be1-43a9-8960-483fd53350a5 => generated 0 bytes in 21 msecs (HTTP/1.1 204) 6 headers in 245 bytes (1 switches on core 0) May 28 12:59:39 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-e2301a85-9886-4e34-b0e9-37d544bdb6f5 tempest-ResourceLockDeleteTest-1157183439 tempest-ResourceLockDeleteTest-1157183439-project-member] http://10.27.203.238/share/v2/645fb190404541a78e449c703540d6f8/shares/ed309fc1-d1ff-4352-a44a-a56b44eb8d0e returned with HTTP 200 May 28 12:59:39 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 772/1531] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:59:39 2024] GET /share/v2/645fb190404541a78e449c703540d6f8/shares/ed309fc1-d1ff-4352-a44a-a56b44eb8d0e => generated 1316 bytes in 27 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:59:39 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-582021af-210e-4166-a3bf-011908c957a7 tempest-ResourceLockNegativeTestWithShares-789426285 tempest-ResourceLockNegativeTestWithShares-789426285-project-member] DELETE http://10.27.203.238/share/v2/86e4aff17ad94d75a624b038464bfeb2/resource-locks/300bc5a7-0d92-47a0-9759-31be9b26d946 May 28 12:59:39 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-582021af-210e-4166-a3bf-011908c957a7 tempest-ResourceLockNegativeTestWithShares-789426285 tempest-ResourceLockNegativeTestWithShares-789426285-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:39 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-582021af-210e-4166-a3bf-011908c957a7 tempest-ResourceLockNegativeTestWithShares-789426285 tempest-ResourceLockNegativeTestWithShares-789426285-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:39 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-582021af-210e-4166-a3bf-011908c957a7 tempest-ResourceLockNegativeTestWithShares-789426285 tempest-ResourceLockNegativeTestWithShares-789426285-project-member] http://10.27.203.238/share/v2/86e4aff17ad94d75a624b038464bfeb2/resource-locks/300bc5a7-0d92-47a0-9759-31be9b26d946 returned with HTTP 204 May 28 12:59:39 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 760/1532] 10.27.203.238 () {64 vars in 1478 bytes} [Tue May 28 12:59:39 2024] DELETE /share/v2/86e4aff17ad94d75a624b038464bfeb2/resource-locks/300bc5a7-0d92-47a0-9759-31be9b26d946 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 6 headers in 245 bytes (1 switches on core 0) May 28 12:59:39 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-dd2588fa-7119-47c5-958e-e5e8dbcba6b0 tempest-ResourceLockNegativeTestWithShares-789426285 tempest-ResourceLockNegativeTestWithShares-789426285-project-member] GET http://10.27.203.238/share/v2/86e4aff17ad94d75a624b038464bfeb2/share-replicas/detail?share_id=a5984861-5086-4848-82ce-0960e763197b May 28 12:59:39 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-dd2588fa-7119-47c5-958e-e5e8dbcba6b0 tempest-ResourceLockNegativeTestWithShares-789426285 tempest-ResourceLockNegativeTestWithShares-789426285-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:39 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-dd2588fa-7119-47c5-958e-e5e8dbcba6b0 tempest-ResourceLockNegativeTestWithShares-789426285 tempest-ResourceLockNegativeTestWithShares-789426285-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:39 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-dd2588fa-7119-47c5-958e-e5e8dbcba6b0 tempest-ResourceLockNegativeTestWithShares-789426285 tempest-ResourceLockNegativeTestWithShares-789426285-project-member] http://10.27.203.238/share/v2/86e4aff17ad94d75a624b038464bfeb2/share-replicas/detail?share_id=a5984861-5086-4848-82ce-0960e763197b returned with HTTP 200 May 28 12:59:39 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 773/1533] 10.27.203.238 () {64 vars in 1476 bytes} [Tue May 28 12:59:39 2024] GET /share/v2/86e4aff17ad94d75a624b038464bfeb2/share-replicas/detail?share_id=a5984861-5086-4848-82ce-0960e763197b => generated 22 bytes in 18 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:59:39 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-9e862c6b-9e72-442f-b15f-ddb768c3334e tempest-ResourceLockNegativeTestWithShares-789426285 tempest-ResourceLockNegativeTestWithShares-789426285-project-member] DELETE http://10.27.203.238/share/v2/86e4aff17ad94d75a624b038464bfeb2/shares/a5984861-5086-4848-82ce-0960e763197b May 28 12:59:39 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-9e862c6b-9e72-442f-b15f-ddb768c3334e tempest-ResourceLockNegativeTestWithShares-789426285 tempest-ResourceLockNegativeTestWithShares-789426285-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:39 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-9e862c6b-9e72-442f-b15f-ddb768c3334e tempest-ResourceLockNegativeTestWithShares-789426285 tempest-ResourceLockNegativeTestWithShares-789426285-project-member] Calling method 'ShareMixin.delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:39 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.v1.shares [None req-9e862c6b-9e72-442f-b15f-ddb768c3334e tempest-ResourceLockNegativeTestWithShares-789426285 tempest-ResourceLockNegativeTestWithShares-789426285-project-member] Delete share with id: a5984861-5086-4848-82ce-0960e763197b May 28 12:59:39 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a70a44ba-e14f-41ed-b9e7-93af7c6b3bfc tempest-ShareIpRulesForNFSTest-1748669711 None] <<< [PATCH] https://127.0.0.1:40443/api/viewpolicies/21/ May 28 12:59:39 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a70a44ba-e14f-41ed-b9e7-93af7c6b3bfc tempest-ShareIpRulesForNFSTest-1748669711 None] Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=1, created='2024-05-28T12:57:40.763635Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='377955ad-d094-4e49-ab32-1021d943a572', id=21, internal=False, is_s3_default_policy=False, name='b7a7d61c-2cea-442a-9809-507038e080d5', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=['*'], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=[], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=[], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='MODIFYING', sync_time='2024-05-28T12:59:39.091943Z', tenant_id=1, tenant_name='default', title='b7a7d61c-2cea-442a-9809-507038e080d5', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/21/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[]) May 28 12:59:39 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a70a44ba-e14f-41ed-b9e7-93af7c6b3bfc tempest-ShareIpRulesForNFSTest-1748669711 None] --- [PATCH] https://127.0.0.1:40443/api/viewpolicies/21/: Done May 28 12:59:39 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-a70a44ba-e14f-41ed-b9e7-93af7c6b3bfc tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:39 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-a70a44ba-e14f-41ed-b9e7-93af7c6b3bfc tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:39 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-a70a44ba-e14f-41ed-b9e7-93af7c6b3bfc tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.029s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:39 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-a70a44ba-e14f-41ed-b9e7-93af7c6b3bfc tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:39 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-a70a44ba-e14f-41ed-b9e7-93af7c6b3bfc tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:39 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-a70a44ba-e14f-41ed-b9e7-93af7c6b3bfc tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.025s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:39 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-a70a44ba-e14f-41ed-b9e7-93af7c6b3bfc tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:39 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-a70a44ba-e14f-41ed-b9e7-93af7c6b3bfc tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:39 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-a70a44ba-e14f-41ed-b9e7-93af7c6b3bfc tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:39 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-a70a44ba-e14f-41ed-b9e7-93af7c6b3bfc tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:39 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-a70a44ba-e14f-41ed-b9e7-93af7c6b3bfc tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:39 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-a70a44ba-e14f-41ed-b9e7-93af7c6b3bfc tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:39 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-a70a44ba-e14f-41ed-b9e7-93af7c6b3bfc tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:39 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-a70a44ba-e14f-41ed-b9e7-93af7c6b3bfc tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:39 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-a70a44ba-e14f-41ed-b9e7-93af7c6b3bfc tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.036s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:39 l75lg1-v1 manila-share[98474]: INFO manila.share.access [None req-a70a44ba-e14f-41ed-b9e7-93af7c6b3bfc tempest-ShareIpRulesForNFSTest-1748669711 None] Access rules were successfully modified for share instance b7a7d61c-2cea-442a-9809-507038e080d5 belonging to share 1ddadc17-cf10-4a42-8bbd-8335fb3520a1. May 28 12:59:39 l75lg1-v1 nova-conductor[83648]: DEBUG dbcounter [-] [83648] Writing DB stats nova_cell1:SELECT=1 {{(pid=83648) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:59:40 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-9e862c6b-9e72-442f-b15f-ddb768c3334e tempest-ResourceLockNegativeTestWithShares-789426285 tempest-ResourceLockNegativeTestWithShares-789426285-project-member] http://10.27.203.238/share/v2/86e4aff17ad94d75a624b038464bfeb2/shares/a5984861-5086-4848-82ce-0960e763197b returned with HTTP 202 May 28 12:59:40 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 761/1534] 10.27.203.238 () {64 vars in 1454 bytes} [Tue May 28 12:59:39 2024] DELETE /share/v2/86e4aff17ad94d75a624b038464bfeb2/shares/a5984861-5086-4848-82ce-0960e763197b => generated 0 bytes in 151 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:59:40 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-617e169f-1299-49e7-9814-579f90517843 tempest-ResourceLockNegativeTestWithShares-789426285 tempest-ResourceLockNegativeTestWithShares-789426285-project-member] GET http://10.27.203.238/share/v2/86e4aff17ad94d75a624b038464bfeb2/shares/a5984861-5086-4848-82ce-0960e763197b May 28 12:59:40 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-617e169f-1299-49e7-9814-579f90517843 tempest-ResourceLockNegativeTestWithShares-789426285 tempest-ResourceLockNegativeTestWithShares-789426285-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:40 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-617e169f-1299-49e7-9814-579f90517843 tempest-ResourceLockNegativeTestWithShares-789426285 tempest-ResourceLockNegativeTestWithShares-789426285-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:40 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-617e169f-1299-49e7-9814-579f90517843 tempest-ResourceLockNegativeTestWithShares-789426285 tempest-ResourceLockNegativeTestWithShares-789426285-project-member] http://10.27.203.238/share/v2/86e4aff17ad94d75a624b038464bfeb2/shares/a5984861-5086-4848-82ce-0960e763197b returned with HTTP 200 May 28 12:59:40 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 774/1535] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:59:40 2024] GET /share/v2/86e4aff17ad94d75a624b038464bfeb2/shares/a5984861-5086-4848-82ce-0960e763197b => generated 1313 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:59:40 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-9e862c6b-9e72-442f-b15f-ddb768c3334e tempest-ResourceLockNegativeTestWithShares-789426285 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f1a7f25a-f865-4592-93e1-c1e62b2447b8" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:40 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-9e862c6b-9e72-442f-b15f-ddb768c3334e tempest-ResourceLockNegativeTestWithShares-789426285 None] Lock "locked_access_rules_operation_by_share_instance_f1a7f25a-f865-4592-93e1-c1e62b2447b8" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:40 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-9e862c6b-9e72-442f-b15f-ddb768c3334e tempest-ResourceLockNegativeTestWithShares-789426285 None] Lock "locked_access_rules_operation_by_share_instance_f1a7f25a-f865-4592-93e1-c1e62b2447b8" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:40 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-9e862c6b-9e72-442f-b15f-ddb768c3334e tempest-ResourceLockNegativeTestWithShares-789426285 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f1a7f25a-f865-4592-93e1-c1e62b2447b8" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:40 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-9e862c6b-9e72-442f-b15f-ddb768c3334e tempest-ResourceLockNegativeTestWithShares-789426285 None] Lock "locked_access_rules_operation_by_share_instance_f1a7f25a-f865-4592-93e1-c1e62b2447b8" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:40 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-9e862c6b-9e72-442f-b15f-ddb768c3334e tempest-ResourceLockNegativeTestWithShares-789426285 None] Lock "locked_access_rules_operation_by_share_instance_f1a7f25a-f865-4592-93e1-c1e62b2447b8" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:40 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-9e862c6b-9e72-442f-b15f-ddb768c3334e tempest-ResourceLockNegativeTestWithShares-789426285 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f1a7f25a-f865-4592-93e1-c1e62b2447b8" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:40 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-9e862c6b-9e72-442f-b15f-ddb768c3334e tempest-ResourceLockNegativeTestWithShares-789426285 None] Lock "locked_access_rules_operation_by_share_instance_f1a7f25a-f865-4592-93e1-c1e62b2447b8" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:40 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-9e862c6b-9e72-442f-b15f-ddb768c3334e tempest-ResourceLockNegativeTestWithShares-789426285 None] Lock "locked_access_rules_operation_by_share_instance_f1a7f25a-f865-4592-93e1-c1e62b2447b8" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:40 l75lg1-v1 manila-share[98474]: DEBUG manila.share.access [None req-9e862c6b-9e72-442f-b15f-ddb768c3334e tempest-ResourceLockNegativeTestWithShares-789426285 None] All access rules have been synced for share instance f1a7f25a-f865-4592-93e1-c1e62b2447b8 belonging to share a5984861-5086-4848-82ce-0960e763197b. {{(pid=98474) update_access_rules /opt/stack/manila/manila/share/access.py:304}} May 28 12:59:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-9e862c6b-9e72-442f-b15f-ddb768c3334e tempest-ResourceLockNegativeTestWithShares-789426285 None] deleting '/manila/manila-f1a7f25a-f865-4592-93e1-c1e62b2447b8' May 28 12:59:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9e862c6b-9e72-442f-b15f-ddb768c3334e tempest-ResourceLockNegativeTestWithShares-789426285 None] >>> [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/ May 28 12:59:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9e862c6b-9e72-442f-b15f-ddb768c3334e tempest-ResourceLockNegativeTestWithShares-789426285 None] {'data': '{"path": "/manila/manila-f1a7f25a-f865-4592-93e1-c1e62b2447b8"}', May 28 12:59:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9e862c6b-9e72-442f-b15f-ddb768c3334e tempest-ResourceLockNegativeTestWithShares-789426285 None] 'params': None} May 28 12:59:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9bdd23f5-e4f3-44d6-b48c-aa4932d96265 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:59:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9bdd23f5-e4f3-44d6-b48c-aa4932d96265 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] [Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=1, created='2024-05-28T12:58:43.845440Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='31b6534b-d142-4561-992f-4f0759db302d', id=32, internal=False, is_s3_default_policy=False, name='7fdd602c-79d0-479c-95a2-336b202c6639', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=['*'], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=[], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=[], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T12:59:32.000989Z', tenant_id=1, tenant_name='default', title='7fdd602c-79d0-479c-95a2-336b202c6639', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/32/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[])] May 28 12:59:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9bdd23f5-e4f3-44d6-b48c-aa4932d96265 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 12:59:40 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-9bdd23f5-e4f3-44d6-b48c-aa4932d96265 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:40 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-9bdd23f5-e4f3-44d6-b48c-aa4932d96265 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9e862c6b-9e72-442f-b15f-ddb768c3334e tempest-ResourceLockNegativeTestWithShares-789426285 None] <<< [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/ May 28 12:59:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9e862c6b-9e72-442f-b15f-ddb768c3334e tempest-ResourceLockNegativeTestWithShares-789426285 None] 'OK' May 28 12:59:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9e862c6b-9e72-442f-b15f-ddb768c3334e tempest-ResourceLockNegativeTestWithShares-789426285 None] --- [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/: Done May 28 12:59:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9e862c6b-9e72-442f-b15f-ddb768c3334e tempest-ResourceLockNegativeTestWithShares-789426285 None] >>> [GET] https://127.0.0.1:40443/api/views/ May 28 12:59:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9e862c6b-9e72-442f-b15f-ddb768c3334e tempest-ResourceLockNegativeTestWithShares-789426285 None] {'allow_redirects': True, May 28 12:59:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9e862c6b-9e72-442f-b15f-ddb768c3334e tempest-ResourceLockNegativeTestWithShares-789426285 None] 'params': {'name': 'f1a7f25a-f865-4592-93e1-c1e62b2447b8'}} May 28 12:59:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c1817b1a-9641-4100-a7a6-5923abdafa13 tempest-ResourceLockDeleteTest-1157183439 None] <<< [GET] https://127.0.0.1:40443/api/quotas/ May 28 12:59:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c1817b1a-9641-4100-a7a6-5923abdafa13 tempest-ResourceLockDeleteTest-1157183439 None] [Bunch(cluster='loop75-kfs', cluster_id=1, default_email=None, default_group_quota=None, default_user_quota=None, enable_alarms=True, enable_email_providers=True, grace_period=None, guid='f9eefcf5-31f7-469e-ad5c-479e5cad09a2', hard_limit=1073741824, hard_limit_inodes=None, id=32, internal=False, is_user_quota=False, last_user_quotas_update=None, name='9fadf39f-1d93-4ddd-bd00-1fd7ccc09539', num_blocked_users=0, num_exceeded_users=0, path='/manila/manila-9fadf39f-1d93-4ddd-bd00-1fd7ccc09539', percent_capacity=0, percent_inodes=None, pretty_grace_period=None, pretty_grace_period_expiration=None, pretty_state='OK (CREATED)', soft_limit=None, soft_limit_inodes=None, state='OK', sync_state='CREATED', system_id=32, tenant_id=1, tenant_name='default', time_to_block=None, title='9fadf39f-1d93-4ddd-bd00-1fd7ccc09539', url='https://127.0.0.1:40443/api/quotas/32/', used_capacity=0, used_capacity_tb=0.0, used_effective_capacity=0, used_effective_capacity_tb=0.0, used_inodes=0, used_limited_capacity=0)] May 28 12:59:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c1817b1a-9641-4100-a7a6-5923abdafa13 tempest-ResourceLockDeleteTest-1157183439 None] --- [GET] https://127.0.0.1:40443/api/quotas/: Done May 28 12:59:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c1817b1a-9641-4100-a7a6-5923abdafa13 tempest-ResourceLockDeleteTest-1157183439 None] >>> [DELETE] https://127.0.0.1:40443/api/quotas/32/ May 28 12:59:40 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-9bdd23f5-e4f3-44d6-b48c-aa4932d96265 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.055s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:40 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-9bdd23f5-e4f3-44d6-b48c-aa4932d96265 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:40 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-9bdd23f5-e4f3-44d6-b48c-aa4932d96265 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:40 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-9bdd23f5-e4f3-44d6-b48c-aa4932d96265 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:40 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-9bdd23f5-e4f3-44d6-b48c-aa4932d96265 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:40 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-9bdd23f5-e4f3-44d6-b48c-aa4932d96265 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:40 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-9bdd23f5-e4f3-44d6-b48c-aa4932d96265 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:40 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-9bdd23f5-e4f3-44d6-b48c-aa4932d96265 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:40 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-9bdd23f5-e4f3-44d6-b48c-aa4932d96265 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:40 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-9bdd23f5-e4f3-44d6-b48c-aa4932d96265 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:40 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-9bdd23f5-e4f3-44d6-b48c-aa4932d96265 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:40 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-9bdd23f5-e4f3-44d6-b48c-aa4932d96265 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:40 l75lg1-v1 dstat.sh[49771]: 28-05 12:59:40| 14 2 81 2 0|5741M 1725M 277M 7881M| 18k 7051B| 0 2200k| 0 335 |7663 13k|1.17 1.07 1.01|3.0 2.0 0| 0 0 | 0 2048M| 29 363 0 31 0 May 28 12:59:40 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-9bdd23f5-e4f3-44d6-b48c-aa4932d96265 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.060s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:40 l75lg1-v1 manila-share[98474]: INFO manila.share.access [None req-9bdd23f5-e4f3-44d6-b48c-aa4932d96265 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Access rules were successfully modified for share instance 7fdd602c-79d0-479c-95a2-336b202c6639 belonging to share 72db8769-ece7-42ff-af27-2e778292a9b4. May 28 12:59:40 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-3548140b-453c-4511-a8ef-3a85cf92953c tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] GET http://10.27.203.238/share/v2/776f75906bc64f8f9316d5aab4b50bf1/share-access-rules?share_id=1ddadc17-cf10-4a42-8bbd-8335fb3520a1 May 28 12:59:40 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-3548140b-453c-4511-a8ef-3a85cf92953c tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:40 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-3548140b-453c-4511-a8ef-3a85cf92953c tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:40 l75lg1-v1 neutron-server[77623]: DEBUG dbcounter [-] [77623] Writing DB stats neutron:DELETE=1 {{(pid=77623) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:59:40 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-3548140b-453c-4511-a8ef-3a85cf92953c tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] http://10.27.203.238/share/v2/776f75906bc64f8f9316d5aab4b50bf1/share-access-rules?share_id=1ddadc17-cf10-4a42-8bbd-8335fb3520a1 returned with HTTP 200 May 28 12:59:40 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 762/1536] 10.27.203.238 () {64 vars in 1467 bytes} [Tue May 28 12:59:40 2024] GET /share/v2/776f75906bc64f8f9316d5aab4b50bf1/share-access-rules?share_id=1ddadc17-cf10-4a42-8bbd-8335fb3520a1 => generated 19 bytes in 30 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc2c389-8522-4c19-b15d-32535e61c5b0 tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-5bc2c389-8522-4c19-b15d-32535e61c5b0 tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc2c389-8522-4c19-b15d-32535e61c5b0 tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3831b150-3295-4314-a2fc-ecac693ae50f tempest-ShareIpRulesForNFSTest-2105398077 tempest-ShareIpRulesForNFSTest-2105398077-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baf3846d3024ef88eeb58770fe946c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be41abb2eae44a6481cf94a21e347d1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3831b150-3295-4314-a2fc-ecac693ae50f tempest-ShareIpRulesForNFSTest-2105398077 tempest-ShareIpRulesForNFSTest-2105398077-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3831b150-3295-4314-a2fc-ecac693ae50f tempest-ShareIpRulesForNFSTest-2105398077 tempest-ShareIpRulesForNFSTest-2105398077-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3831b150-3295-4314-a2fc-ecac693ae50f tempest-ShareIpRulesForNFSTest-2105398077 tempest-ShareIpRulesForNFSTest-2105398077-project-admin] PATH_INFO: `/v3/users/981b3e419ab1466ba64538f100d39f99` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3831b150-3295-4314-a2fc-ecac693ae50f tempest-ShareIpRulesForNFSTest-2105398077 tempest-ShareIpRulesForNFSTest-2105398077-project-admin] RBAC: Authorizing `identity:delete_user(user_id=981b3e419ab1466ba64538f100d39f99)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:40 l75lg1-v1 neutron-server[77618]: DEBUG dbcounter [-] [77618] Writing DB stats neutron:UPDATE=1,neutron:SELECT=2 {{(pid=77618) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3831b150-3295-4314-a2fc-ecac693ae50f tempest-ShareIpRulesForNFSTest-2105398077 tempest-ShareIpRulesForNFSTest-2105398077-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-3831b150-3295-4314-a2fc-ecac693ae50f tempest-ShareIpRulesForNFSTest-2105398077 tempest-ShareIpRulesForNFSTest-2105398077-project-admin] Could not find user: 981b3e419ab1466ba64538f100d39f99.: keystone.exception.UserNotFound: Could not find user: 981b3e419ab1466ba64538f100d39f99. May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 981b3e419ab1466ba64538f100d39f99. May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1278/2530] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 12:59:40 2024] DELETE /identity/v3/users/981b3e419ab1466ba64538f100d39f99 => generated 110 bytes in 118 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b9bf7b-3ace-4095-a0df-b2991297cfc2 tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-28b9bf7b-3ace-4095-a0df-b2991297cfc2 tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b9bf7b-3ace-4095-a0df-b2991297cfc2 tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a31467-9f57-4a50-a0fc-ac6efbfc9004 tempest-ShareIpRulesForNFSTest-2105398077 tempest-ShareIpRulesForNFSTest-2105398077-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baf3846d3024ef88eeb58770fe946c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be41abb2eae44a6481cf94a21e347d1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a31467-9f57-4a50-a0fc-ac6efbfc9004 tempest-ShareIpRulesForNFSTest-2105398077 tempest-ShareIpRulesForNFSTest-2105398077-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a31467-9f57-4a50-a0fc-ac6efbfc9004 tempest-ShareIpRulesForNFSTest-2105398077 tempest-ShareIpRulesForNFSTest-2105398077-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a31467-9f57-4a50-a0fc-ac6efbfc9004 tempest-ShareIpRulesForNFSTest-2105398077 tempest-ShareIpRulesForNFSTest-2105398077-project-admin] PATH_INFO: `/v3/users/b06cddbef69143b790020ff2c97c502e` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a31467-9f57-4a50-a0fc-ac6efbfc9004 tempest-ShareIpRulesForNFSTest-2105398077 tempest-ShareIpRulesForNFSTest-2105398077-project-admin] RBAC: Authorizing `identity:delete_user(user_id=b06cddbef69143b790020ff2c97c502e)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a31467-9f57-4a50-a0fc-ac6efbfc9004 tempest-ShareIpRulesForNFSTest-2105398077 tempest-ShareIpRulesForNFSTest-2105398077-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-10a31467-9f57-4a50-a0fc-ac6efbfc9004 tempest-ShareIpRulesForNFSTest-2105398077 tempest-ShareIpRulesForNFSTest-2105398077-project-admin] Could not find user: b06cddbef69143b790020ff2c97c502e.: keystone.exception.UserNotFound: Could not find user: b06cddbef69143b790020ff2c97c502e. May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: b06cddbef69143b790020ff2c97c502e. May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1253/2531] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 12:59:40 2024] DELETE /identity/v3/users/b06cddbef69143b790020ff2c97c502e => generated 110 bytes in 32 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3831b150-3295-4314-a2fc-ecac693ae50f tempest-ShareIpRulesForNFSTest-2105398077 tempest-ShareIpRulesForNFSTest-2105398077-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3831b150-3295-4314-a2fc-ecac693ae50f tempest-ShareIpRulesForNFSTest-2105398077 tempest-ShareIpRulesForNFSTest-2105398077-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373ce035-802b-482e-b08c-3b7680386fb9 tempest-ShareIpRulesForNFSTest-2105398077 tempest-ShareIpRulesForNFSTest-2105398077-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baf3846d3024ef88eeb58770fe946c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be41abb2eae44a6481cf94a21e347d1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373ce035-802b-482e-b08c-3b7680386fb9 tempest-ShareIpRulesForNFSTest-2105398077 tempest-ShareIpRulesForNFSTest-2105398077-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373ce035-802b-482e-b08c-3b7680386fb9 tempest-ShareIpRulesForNFSTest-2105398077 tempest-ShareIpRulesForNFSTest-2105398077-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373ce035-802b-482e-b08c-3b7680386fb9 tempest-ShareIpRulesForNFSTest-2105398077 tempest-ShareIpRulesForNFSTest-2105398077-project-admin] PATH_INFO: `/v3/users/6285dcecc86746a7b4eee34cf3c3f672` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373ce035-802b-482e-b08c-3b7680386fb9 tempest-ShareIpRulesForNFSTest-2105398077 tempest-ShareIpRulesForNFSTest-2105398077-project-admin] RBAC: Authorizing `identity:delete_user(user_id=6285dcecc86746a7b4eee34cf3c3f672)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373ce035-802b-482e-b08c-3b7680386fb9 tempest-ShareIpRulesForNFSTest-2105398077 tempest-ShareIpRulesForNFSTest-2105398077-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-373ce035-802b-482e-b08c-3b7680386fb9 tempest-ShareIpRulesForNFSTest-2105398077 tempest-ShareIpRulesForNFSTest-2105398077-project-admin] Could not find user: 6285dcecc86746a7b4eee34cf3c3f672.: keystone.exception.UserNotFound: Could not find user: 6285dcecc86746a7b4eee34cf3c3f672. May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 6285dcecc86746a7b4eee34cf3c3f672. May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1279/2532] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 12:59:40 2024] DELETE /identity/v3/users/6285dcecc86746a7b4eee34cf3c3f672 => generated 110 bytes in 29 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a31467-9f57-4a50-a0fc-ac6efbfc9004 tempest-ShareIpRulesForNFSTest-2105398077 tempest-ShareIpRulesForNFSTest-2105398077-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a31467-9f57-4a50-a0fc-ac6efbfc9004 tempest-ShareIpRulesForNFSTest-2105398077 tempest-ShareIpRulesForNFSTest-2105398077-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d604bf8-33bd-4b8a-8e5f-ac6959f78705 tempest-ShareIpRulesForNFSTest-2105398077 tempest-ShareIpRulesForNFSTest-2105398077-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baf3846d3024ef88eeb58770fe946c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be41abb2eae44a6481cf94a21e347d1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d604bf8-33bd-4b8a-8e5f-ac6959f78705 tempest-ShareIpRulesForNFSTest-2105398077 tempest-ShareIpRulesForNFSTest-2105398077-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d604bf8-33bd-4b8a-8e5f-ac6959f78705 tempest-ShareIpRulesForNFSTest-2105398077 tempest-ShareIpRulesForNFSTest-2105398077-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d604bf8-33bd-4b8a-8e5f-ac6959f78705 tempest-ShareIpRulesForNFSTest-2105398077 tempest-ShareIpRulesForNFSTest-2105398077-project-admin] PATH_INFO: `/v3/users/b12d90b85fc7452f83fec53a2941a759` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d604bf8-33bd-4b8a-8e5f-ac6959f78705 tempest-ShareIpRulesForNFSTest-2105398077 tempest-ShareIpRulesForNFSTest-2105398077-project-admin] RBAC: Authorizing `identity:delete_user(user_id=b12d90b85fc7452f83fec53a2941a759)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9e862c6b-9e72-442f-b15f-ddb768c3334e tempest-ResourceLockNegativeTestWithShares-789426285 None] <<< [GET] https://127.0.0.1:40443/api/views/ May 28 12:59:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9e862c6b-9e72-442f-b15f-ddb768c3334e tempest-ResourceLockNegativeTestWithShares-789426285 None] [Bunch(abac_tags=[], abe_max_depth=None, abe_protocols=[], alias='', allow_anonymous_access=False, allow_s3_anonymous_access=False, auto_commit='0d', bucket='', bucket_creators=[], bucket_creators_groups=[], bucket_owner=None, bulk_permission_update_progress=None, bulk_permission_update_state=None, cluster='loop75-kfs', cluster_id=1, created='2024-05-28T12:59:36.124148Z', enabled=True, files_retention_mode='NONE', guid='d11bcb3a-2493-4895-afd5-5df67b5522a7', id=36, ignore_oos=False, internal=False, is_remote=False, is_seamless=False, logical_capacity=0, max_retention_period=None, min_retention_period=None, name='f1a7f25a-f865-4592-93e1-c1e62b2447b8', nfs_interop_flags='BOTH_NFS3_AND_NFS4_INTEROP_DISABLED', path='/manila/manila-f1a7f25a-f865-4592-93e1-c1e62b2447b8', physical_capacity=0, policy='f1a7f25a-f865-4592-93e1-c1e62b2447b8', policy_id=37, protocols=['NFS'], qos_policy=None, qos_policy_id=None, s3_locks=False, s3_locks_retention_mode='NONE', s3_locks_retention_period='', s3_unverified_lookup=False, s3_versioning=False, select_for_live_monitoring=False, share='', share_acl=Bunch(acl=[], enabled=False), sync='SYNCED', sync_time='2024-05-28T12:59:36.414904Z', tenant_id=1, tenant_name='default', title='/manila/manila-f1a7f25a-f865-4592-93e1-c1e62b2447b8', url='https://127.0.0.1:40443/api/views/36/')] May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d604bf8-33bd-4b8a-8e5f-ac6959f78705 tempest-ShareIpRulesForNFSTest-2105398077 tempest-ShareIpRulesForNFSTest-2105398077-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9e862c6b-9e72-442f-b15f-ddb768c3334e tempest-ResourceLockNegativeTestWithShares-789426285 None] --- [GET] https://127.0.0.1:40443/api/views/: Done May 28 12:59:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9e862c6b-9e72-442f-b15f-ddb768c3334e tempest-ResourceLockNegativeTestWithShares-789426285 None] >>> [DELETE] https://127.0.0.1:40443/api/views/36/ May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-9d604bf8-33bd-4b8a-8e5f-ac6959f78705 tempest-ShareIpRulesForNFSTest-2105398077 tempest-ShareIpRulesForNFSTest-2105398077-project-admin] Could not find user: b12d90b85fc7452f83fec53a2941a759.: keystone.exception.UserNotFound: Could not find user: b12d90b85fc7452f83fec53a2941a759. May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: b12d90b85fc7452f83fec53a2941a759. May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1254/2533] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 12:59:40 2024] DELETE /identity/v3/users/b12d90b85fc7452f83fec53a2941a759 => generated 110 bytes in 24 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373ce035-802b-482e-b08c-3b7680386fb9 tempest-ShareIpRulesForNFSTest-2105398077 tempest-ShareIpRulesForNFSTest-2105398077-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373ce035-802b-482e-b08c-3b7680386fb9 tempest-ShareIpRulesForNFSTest-2105398077 tempest-ShareIpRulesForNFSTest-2105398077-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d43ab01-fdd2-4c3f-9db1-bddb99600c23 tempest-ShareIpRulesForNFSTest-2105398077 tempest-ShareIpRulesForNFSTest-2105398077-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baf3846d3024ef88eeb58770fe946c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be41abb2eae44a6481cf94a21e347d1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d43ab01-fdd2-4c3f-9db1-bddb99600c23 tempest-ShareIpRulesForNFSTest-2105398077 tempest-ShareIpRulesForNFSTest-2105398077-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d43ab01-fdd2-4c3f-9db1-bddb99600c23 tempest-ShareIpRulesForNFSTest-2105398077 tempest-ShareIpRulesForNFSTest-2105398077-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d43ab01-fdd2-4c3f-9db1-bddb99600c23 tempest-ShareIpRulesForNFSTest-2105398077 tempest-ShareIpRulesForNFSTest-2105398077-project-admin] PATH_INFO: `/v3/users/fa87d7e402e34eeab8ec8ddf1839bb59` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d43ab01-fdd2-4c3f-9db1-bddb99600c23 tempest-ShareIpRulesForNFSTest-2105398077 tempest-ShareIpRulesForNFSTest-2105398077-project-admin] RBAC: Authorizing `identity:delete_user(user_id=fa87d7e402e34eeab8ec8ddf1839bb59)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d43ab01-fdd2-4c3f-9db1-bddb99600c23 tempest-ShareIpRulesForNFSTest-2105398077 tempest-ShareIpRulesForNFSTest-2105398077-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:40 l75lg1-v1 neutron-server[77619]: DEBUG dbcounter [-] [77619] Writing DB stats neutron:SELECT=2 {{(pid=77619) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-5d43ab01-fdd2-4c3f-9db1-bddb99600c23 tempest-ShareIpRulesForNFSTest-2105398077 tempest-ShareIpRulesForNFSTest-2105398077-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa87d7e402e34eeab8ec8ddf1839bb59', 'request_id': 'req-5d43ab01-fdd2-4c3f-9db1-bddb99600c23'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-5d43ab01-fdd2-4c3f-9db1-bddb99600c23 tempest-ShareIpRulesForNFSTest-2105398077 tempest-ShareIpRulesForNFSTest-2105398077-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa87d7e402e34eeab8ec8ddf1839bb59', 'request_id': 'req-5d43ab01-fdd2-4c3f-9db1-bddb99600c23'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-5d43ab01-fdd2-4c3f-9db1-bddb99600c23 tempest-ShareIpRulesForNFSTest-2105398077 tempest-ShareIpRulesForNFSTest-2105398077-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa87d7e402e34eeab8ec8ddf1839bb59', 'request_id': 'req-5d43ab01-fdd2-4c3f-9db1-bddb99600c23'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-5d43ab01-fdd2-4c3f-9db1-bddb99600c23 tempest-ShareIpRulesForNFSTest-2105398077 tempest-ShareIpRulesForNFSTest-2105398077-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa87d7e402e34eeab8ec8ddf1839bb59', 'request_id': 'req-5d43ab01-fdd2-4c3f-9db1-bddb99600c23'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-5d43ab01-fdd2-4c3f-9db1-bddb99600c23 tempest-ShareIpRulesForNFSTest-2105398077 tempest-ShareIpRulesForNFSTest-2105398077-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa87d7e402e34eeab8ec8ddf1839bb59', 'request_id': 'req-5d43ab01-fdd2-4c3f-9db1-bddb99600c23'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:40 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1280/2534] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 12:59:40 2024] DELETE /identity/v3/users/fa87d7e402e34eeab8ec8ddf1839bb59 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:59:40 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-67f73418-8c89-49f8-bb74-2233fbad638c tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] GET http://10.27.203.238/share/v2/776f75906bc64f8f9316d5aab4b50bf1/share-replicas/detail?share_id=1ddadc17-cf10-4a42-8bbd-8335fb3520a1 May 28 12:59:40 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-67f73418-8c89-49f8-bb74-2233fbad638c tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:40 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-67f73418-8c89-49f8-bb74-2233fbad638c tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:40 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-67f73418-8c89-49f8-bb74-2233fbad638c tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] http://10.27.203.238/share/v2/776f75906bc64f8f9316d5aab4b50bf1/share-replicas/detail?share_id=1ddadc17-cf10-4a42-8bbd-8335fb3520a1 returned with HTTP 200 May 28 12:59:40 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 775/1537] 10.27.203.238 () {64 vars in 1476 bytes} [Tue May 28 12:59:40 2024] GET /share/v2/776f75906bc64f8f9316d5aab4b50bf1/share-replicas/detail?share_id=1ddadc17-cf10-4a42-8bbd-8335fb3520a1 => generated 22 bytes in 15 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:59:40 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-f00cabcb-e006-4e5f-b659-9d36127b4944 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] DELETE http://10.27.203.238/share/v2/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1 May 28 12:59:40 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-f00cabcb-e006-4e5f-b659-9d36127b4944 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:40 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-f00cabcb-e006-4e5f-b659-9d36127b4944 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Calling method 'ShareMixin.delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:40 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.v1.shares [None req-f00cabcb-e006-4e5f-b659-9d36127b4944 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Delete share with id: 1ddadc17-cf10-4a42-8bbd-8335fb3520a1 May 28 12:59:40 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-f00cabcb-e006-4e5f-b659-9d36127b4944 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] http://10.27.203.238/share/v2/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1 returned with HTTP 202 May 28 12:59:40 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 763/1538] 10.27.203.238 () {64 vars in 1454 bytes} [Tue May 28 12:59:40 2024] DELETE /share/v2/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1 => generated 0 bytes in 138 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:59:40 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-d64a3cf4-cc04-4831-957f-e0ba8ea8ac19 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] GET http://10.27.203.238/share/v2/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1 May 28 12:59:40 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-d64a3cf4-cc04-4831-957f-e0ba8ea8ac19 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:40 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-d64a3cf4-cc04-4831-957f-e0ba8ea8ac19 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:40 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-d64a3cf4-cc04-4831-957f-e0ba8ea8ac19 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] http://10.27.203.238/share/v2/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1 returned with HTTP 200 May 28 12:59:40 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 776/1539] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:59:40 2024] GET /share/v2/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1 => generated 1316 bytes in 31 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:59:40 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-f00cabcb-e006-4e5f-b659-9d36127b4944 tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:40 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-f00cabcb-e006-4e5f-b659-9d36127b4944 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:40 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-f00cabcb-e006-4e5f-b659-9d36127b4944 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:40 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-f00cabcb-e006-4e5f-b659-9d36127b4944 tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:40 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-f00cabcb-e006-4e5f-b659-9d36127b4944 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:40 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-f00cabcb-e006-4e5f-b659-9d36127b4944 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:40 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-f00cabcb-e006-4e5f-b659-9d36127b4944 tempest-ShareIpRulesForNFSTest-1748669711 None] Acquiring lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:40 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-f00cabcb-e006-4e5f-b659-9d36127b4944 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:40 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-f00cabcb-e006-4e5f-b659-9d36127b4944 tempest-ShareIpRulesForNFSTest-1748669711 None] Lock "locked_access_rules_operation_by_share_instance_b7a7d61c-2cea-442a-9809-507038e080d5" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:40 l75lg1-v1 manila-share[98474]: DEBUG manila.share.access [None req-f00cabcb-e006-4e5f-b659-9d36127b4944 tempest-ShareIpRulesForNFSTest-1748669711 None] All access rules have been synced for share instance b7a7d61c-2cea-442a-9809-507038e080d5 belonging to share 1ddadc17-cf10-4a42-8bbd-8335fb3520a1. {{(pid=98474) update_access_rules /opt/stack/manila/manila/share/access.py:304}} May 28 12:59:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-f00cabcb-e006-4e5f-b659-9d36127b4944 tempest-ShareIpRulesForNFSTest-1748669711 None] deleting '/manila/manila-b7a7d61c-2cea-442a-9809-507038e080d5' May 28 12:59:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f00cabcb-e006-4e5f-b659-9d36127b4944 tempest-ShareIpRulesForNFSTest-1748669711 None] >>> [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/ May 28 12:59:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f00cabcb-e006-4e5f-b659-9d36127b4944 tempest-ShareIpRulesForNFSTest-1748669711 None] {'data': '{"path": "/manila/manila-b7a7d61c-2cea-442a-9809-507038e080d5"}', May 28 12:59:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f00cabcb-e006-4e5f-b659-9d36127b4944 tempest-ShareIpRulesForNFSTest-1748669711 None] 'params': None} May 28 12:59:41 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f00cabcb-e006-4e5f-b659-9d36127b4944 tempest-ShareIpRulesForNFSTest-1748669711 None] <<< [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/ May 28 12:59:41 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f00cabcb-e006-4e5f-b659-9d36127b4944 tempest-ShareIpRulesForNFSTest-1748669711 None] 'OK' May 28 12:59:41 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f00cabcb-e006-4e5f-b659-9d36127b4944 tempest-ShareIpRulesForNFSTest-1748669711 None] --- [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/: Done May 28 12:59:41 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f00cabcb-e006-4e5f-b659-9d36127b4944 tempest-ShareIpRulesForNFSTest-1748669711 None] >>> [GET] https://127.0.0.1:40443/api/views/ May 28 12:59:41 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f00cabcb-e006-4e5f-b659-9d36127b4944 tempest-ShareIpRulesForNFSTest-1748669711 None] {'allow_redirects': True, May 28 12:59:41 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f00cabcb-e006-4e5f-b659-9d36127b4944 tempest-ShareIpRulesForNFSTest-1748669711 None] 'params': {'name': 'b7a7d61c-2cea-442a-9809-507038e080d5'}} May 28 12:59:41 l75lg1-v1 dstat.sh[49771]: 28-05 12:59:41| 7 0 90 1 0|5741M 1725M 277M 7882M| 19k 4700B| 0 1680k| 0 174 |4815 8166 |1.17 1.07 1.01|1.0 2.0 0| 0 0 | 0 2048M| 29 363 0 31 0 May 28 12:59:41 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f00cabcb-e006-4e5f-b659-9d36127b4944 tempest-ShareIpRulesForNFSTest-1748669711 None] <<< [GET] https://127.0.0.1:40443/api/views/ May 28 12:59:41 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f00cabcb-e006-4e5f-b659-9d36127b4944 tempest-ShareIpRulesForNFSTest-1748669711 None] [Bunch(abac_tags=[], abe_max_depth=None, abe_protocols=[], alias='', allow_anonymous_access=False, allow_s3_anonymous_access=False, auto_commit='0d', bucket='', bucket_creators=[], bucket_creators_groups=[], bucket_owner=None, bulk_permission_update_progress=None, bulk_permission_update_state=None, cluster='loop75-kfs', cluster_id=1, created='2024-05-28T12:57:43.771237Z', enabled=True, files_retention_mode='NONE', guid='63641add-d7f2-4515-b5d2-49626cd8ed6a', id=20, ignore_oos=False, internal=False, is_remote=False, is_seamless=False, logical_capacity=0, max_retention_period='0d', min_retention_period='0d', name='b7a7d61c-2cea-442a-9809-507038e080d5', nfs_interop_flags='BOTH_NFS3_AND_NFS4_INTEROP_DISABLED', path='/manila/manila-b7a7d61c-2cea-442a-9809-507038e080d5', physical_capacity=0, policy='b7a7d61c-2cea-442a-9809-507038e080d5', policy_id=21, protocols=['NFS'], qos_policy=None, qos_policy_id=None, s3_locks=False, s3_locks_retention_mode='NONE', s3_locks_retention_period='', s3_unverified_lookup=False, s3_versioning=False, select_for_live_monitoring=False, share='', share_acl=Bunch(acl=[], enabled=False), sync='SYNCED', sync_time='2024-05-28T12:59:08.483355Z', tenant_id=1, tenant_name='default', title='/manila/manila-b7a7d61c-2cea-442a-9809-507038e080d5', url='https://127.0.0.1:40443/api/views/20/')] May 28 12:59:41 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f00cabcb-e006-4e5f-b659-9d36127b4944 tempest-ShareIpRulesForNFSTest-1748669711 None] --- [GET] https://127.0.0.1:40443/api/views/: Done May 28 12:59:41 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f00cabcb-e006-4e5f-b659-9d36127b4944 tempest-ShareIpRulesForNFSTest-1748669711 None] >>> [DELETE] https://127.0.0.1:40443/api/views/20/ May 28 12:59:41 l75lg1-v1 manila-data[98318]: DEBUG dbcounter [-] [98318] Writing DB stats manila:SELECT=30,manila:UPDATE=7 {{(pid=98318) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:59:42 l75lg1-v1 dstat.sh[49771]: 28-05 12:59:42| 1 0 97 1 0|5741M 1725M 277M 7882M| 13k 646B| 0 968k| 0 99.0 |2345 3734 |1.08 1.05 1.01|1.0 1.0 0| 0 0 | 0 2048M| 29 363 0 27 0 May 28 12:59:42 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-1a3504a0-8423-42d1-aced-a153f62049db tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] GET http://10.27.203.238/share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/messages May 28 12:59:42 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-1a3504a0-8423-42d1-aced-a153f62049db tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:42 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-1a3504a0-8423-42d1-aced-a153f62049db tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:42 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.message.api [None req-1a3504a0-8423-42d1-aced-a153f62049db tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Searching for messages by: MultiDict([]) {{(pid=98330) get_all /opt/stack/manila/manila/message/api.py:78}} May 28 12:59:42 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-1a3504a0-8423-42d1-aced-a153f62049db tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] http://10.27.203.238/share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/messages returned with HTTP 200 May 28 12:59:42 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 764/1540] 10.27.203.238 () {64 vars in 1346 bytes} [Tue May 28 12:59:42 2024] GET /share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/messages => generated 4820 bytes in 12 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:59:42 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-26ce22ec-1aff-4924-b780-fe65db1087b5 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] GET http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/share-access-rules?share_id=72db8769-ece7-42ff-af27-2e778292a9b4 May 28 12:59:42 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-26ce22ec-1aff-4924-b780-fe65db1087b5 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:42 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-26ce22ec-1aff-4924-b780-fe65db1087b5 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:42 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-ad704982-aace-4375-80e8-57df588e1559 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] POST http://10.27.203.238/share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/types May 28 12:59:42 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-ad704982-aace-4375-80e8-57df588e1559 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share_type": {"name": "tempest-share-type-1464299139", "extra_specs": {"driver_handles_share_servers": false, "vendor_name": "foobar"}, "share_type_access:is_public": true}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:59:42 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-ad704982-aace-4375-80e8-57df588e1559 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] http://10.27.203.238/share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/types returned with HTTP 200 May 28 12:59:42 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 765/1541] 10.27.203.238 () {66 vars in 1359 bytes} [Tue May 28 12:59:42 2024] POST /share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/types => generated 661 bytes in 24 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:59:42 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-72f6d91a-937d-402c-9a41-8c66b33c2269 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] POST http://10.27.203.238/share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/shares May 28 12:59:42 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-72f6d91a-937d-402c-9a41-8c66b33c2269 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share": {"share_proto": "nfs", "description": "tempest-tempest-created-share-desc-1151595402", "snapshot_id": null, "name": "tempest-tempest-created-share-1800060894", "size": 1, "metadata": {}, "is_public": false, "share_type": "ffa207cc-9f4c-49d2-aebd-e976439c3b15"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:59:42 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.v1.shares [None req-72f6d91a-937d-402c-9a41-8c66b33c2269 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Create NFS share of 1 GB May 28 12:59:42 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.lock.api [None req-26ce22ec-1aff-4924-b780-fe65db1087b5 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Searching for locks by: {'resource_id': '92aed90f-4f97-4ac6-bae1-6feb29133d5a', 'resource_action': 'show', 'resource_type': 'access_rule'} {{(pid=98329) get_all /opt/stack/manila/manila/lock/api.py:112}} May 28 12:59:42 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-26ce22ec-1aff-4924-b780-fe65db1087b5 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/share-access-rules?share_id=72db8769-ece7-42ff-af27-2e778292a9b4 returned with HTTP 200 May 28 12:59:42 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 777/1542] 10.27.203.238 () {64 vars in 1467 bytes} [Tue May 28 12:59:42 2024] GET /share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/share-access-rules?share_id=72db8769-ece7-42ff-af27-2e778292a9b4 => generated 294 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:59:42 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-15db64d9-64ba-45e5-8a88-393609a679aa tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] POST http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action May 28 12:59:42 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-15db64d9-64ba-45e5-8a88-393609a679aa tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Action body: b'{"allow_access": {"access_type": "ip", "access_to": "fd2c:b029:bba6:df54::1/128", "access_level": null}}' {{(pid=98329) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:59:42 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-15db64d9-64ba-45e5-8a88-393609a679aa tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Action: 'action', calling method: ShareController.allow_access, body: {"allow_access": {"access_type": "ip", "access_to": "fd2c:b029:bba6:df54::1/128", "access_level": null}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:59:42 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9e862c6b-9e72-442f-b15f-ddb768c3334e tempest-ResourceLockNegativeTestWithShares-789426285 None] <<< [DELETE] https://127.0.0.1:40443/api/views/36/ May 28 12:59:42 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9e862c6b-9e72-442f-b15f-ddb768c3334e tempest-ResourceLockNegativeTestWithShares-789426285 None] --- [DELETE] https://127.0.0.1:40443/api/views/36/: Done May 28 12:59:42 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9e862c6b-9e72-442f-b15f-ddb768c3334e tempest-ResourceLockNegativeTestWithShares-789426285 None] >>> [GET] https://127.0.0.1:40443/api/quotas/ May 28 12:59:42 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9e862c6b-9e72-442f-b15f-ddb768c3334e tempest-ResourceLockNegativeTestWithShares-789426285 None] {'allow_redirects': True, May 28 12:59:42 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9e862c6b-9e72-442f-b15f-ddb768c3334e tempest-ResourceLockNegativeTestWithShares-789426285 None] 'params': {'name': 'f1a7f25a-f865-4592-93e1-c1e62b2447b8'}} May 28 12:59:42 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-15db64d9-64ba-45e5-8a88-393609a679aa tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] HTTP exception thrown: Share access ip:fd2c:b029:bba6:df54::1/128 exists. May 28 12:59:42 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-15db64d9-64ba-45e5-8a88-393609a679aa tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action returned with HTTP 400 May 28 12:59:42 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 778/1543] 10.27.203.238 () {66 vars in 1494 bytes} [Tue May 28 12:59:42 2024] POST /share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action => generated 94 bytes in 45 msecs (HTTP/1.1 400) 6 headers in 239 bytes (2 switches on core 0) May 28 12:59:42 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-8fe2ab9f-5df4-4a75-b4f5-da94163fab21 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] POST http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action May 28 12:59:42 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-8fe2ab9f-5df4-4a75-b4f5-da94163fab21 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Action body: b'{"allow_access": {"access_type": "ip", "access_to": "fd2c:b029:bba6:df54::1", "access_level": null}}' {{(pid=98329) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:59:42 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-8fe2ab9f-5df4-4a75-b4f5-da94163fab21 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Action: 'action', calling method: ShareController.allow_access, body: {"allow_access": {"access_type": "ip", "access_to": "fd2c:b029:bba6:df54::1", "access_level": null}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:59:42 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.quota [None req-72f6d91a-937d-402c-9a41-8c66b33c2269 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Created reservations ['59bd8a83-7b17-4064-a863-8bdeec07c0b9', 'e9042e6d-a647-4464-a1ca-7a550e3dd0b1', '67359523-29a4-4c7c-8f0b-edd66ab3b1e0', 'e10585e4-8563-4c69-ba4d-73b86412c37a'] {{(pid=98330) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 12:59:42 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-8fe2ab9f-5df4-4a75-b4f5-da94163fab21 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] HTTP exception thrown: Share access ip:fd2c:b029:bba6:df54::1 exists. May 28 12:59:42 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-8fe2ab9f-5df4-4a75-b4f5-da94163fab21 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action returned with HTTP 400 May 28 12:59:42 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 779/1544] 10.27.203.238 () {66 vars in 1494 bytes} [Tue May 28 12:59:42 2024] POST /share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action => generated 90 bytes in 42 msecs (HTTP/1.1 400) 6 headers in 239 bytes (1 switches on core 0) May 28 12:59:42 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-868b54e9-c842-40aa-91e5-833abcedfdbb tempest-ResourceLockDeleteTest-1157183439 tempest-ResourceLockDeleteTest-1157183439-project-member] GET http://10.27.203.238/share/v2/645fb190404541a78e449c703540d6f8/shares/ed309fc1-d1ff-4352-a44a-a56b44eb8d0e May 28 12:59:42 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-868b54e9-c842-40aa-91e5-833abcedfdbb tempest-ResourceLockDeleteTest-1157183439 tempest-ResourceLockDeleteTest-1157183439-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:42 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-868b54e9-c842-40aa-91e5-833abcedfdbb tempest-ResourceLockDeleteTest-1157183439 tempest-ResourceLockDeleteTest-1157183439-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:42 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.quota [None req-72f6d91a-937d-402c-9a41-8c66b33c2269 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Committed reservations ['59bd8a83-7b17-4064-a863-8bdeec07c0b9', 'e9042e6d-a647-4464-a1ca-7a550e3dd0b1', '67359523-29a4-4c7c-8f0b-edd66ab3b1e0', 'e10585e4-8563-4c69-ba4d-73b86412c37a'] {{(pid=98330) commit /opt/stack/manila/manila/quota.py:1063}} May 28 12:59:42 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-868b54e9-c842-40aa-91e5-833abcedfdbb tempest-ResourceLockDeleteTest-1157183439 tempest-ResourceLockDeleteTest-1157183439-project-member] http://10.27.203.238/share/v2/645fb190404541a78e449c703540d6f8/shares/ed309fc1-d1ff-4352-a44a-a56b44eb8d0e returned with HTTP 200 May 28 12:59:42 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 780/1545] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:59:42 2024] GET /share/v2/645fb190404541a78e449c703540d6f8/shares/ed309fc1-d1ff-4352-a44a-a56b44eb8d0e => generated 1316 bytes in 29 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:59:42 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-19dbf516-eb1d-4492-816c-3d4ae973bc32 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] POST http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action May 28 12:59:42 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-19dbf516-eb1d-4492-816c-3d4ae973bc32 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Action body: b'{"deny_access": {"access_id": "92aed90f-4f97-4ac6-bae1-6feb29133d5a"}}' {{(pid=98329) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:59:42 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-19dbf516-eb1d-4492-816c-3d4ae973bc32 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Action: 'action', calling method: ShareController.deny_access, body: {"deny_access": {"access_id": "92aed90f-4f97-4ac6-bae1-6feb29133d5a"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:59:42 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.lock.api [None req-19dbf516-eb1d-4492-816c-3d4ae973bc32 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Searching for locks by: {'resource_id': '92aed90f-4f97-4ac6-bae1-6feb29133d5a', 'resource_action': 'delete'} {{(pid=98329) get_all /opt/stack/manila/manila/lock/api.py:112}} May 28 12:59:42 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.host_manager [None req-72f6d91a-937d-402c-9a41-8c66b33c2269 tempest-UserMessageTest-1084663522 None] Share service is down. (host: l75lg1-v1@generic2). May 28 12:59:42 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.host_manager [None req-72f6d91a-937d-402c-9a41-8c66b33c2269 tempest-UserMessageTest-1084663522 None] Share service is down. (host: l75lg1-v1@generic1). May 28 12:59:42 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-72f6d91a-937d-402c-9a41-8c66b33c2269 tempest-UserMessageTest-1084663522 None] Starting with 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:80}} May 28 12:59:42 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-72f6d91a-937d-402c-9a41-8c66b33c2269 tempest-UserMessageTest-1084663522 None] Filter OnlyHostFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:59:42 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-72f6d91a-937d-402c-9a41-8c66b33c2269 tempest-UserMessageTest-1084663522 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:59:42 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.capacity [None req-72f6d91a-937d-402c-9a41-8c66b33c2269 tempest-UserMessageTest-1084663522 None] Space information for share creation on host l75lg1-v1@vast#vast (requested / avail): 1/2077 {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/capacity.py:83}} May 28 12:59:42 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-72f6d91a-937d-402c-9a41-8c66b33c2269 tempest-UserMessageTest-1084663522 None] Filter CapacityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:59:42 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.utils [None req-72f6d91a-937d-402c-9a41-8c66b33c2269 tempest-UserMessageTest-1084663522 None] Share type extra spec requirement "vendor_name=foobar" does not match reported capability "VAST STORAGE" {{(pid=98327) capabilities_satisfied /opt/stack/manila/manila/scheduler/utils.py:185}} May 28 12:59:42 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.capabilities [None req-72f6d91a-937d-402c-9a41-8c66b33c2269 tempest-UserMessageTest-1084663522 None] host: 'l75lg1-v1@vast#vast', free_capacity_gb: 2077.64910808485, pools: None fails resource_type extra_specs requirements {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/capabilities.py:45}} May 28 12:59:42 l75lg1-v1 manila-scheduler[98327]: INFO manila.scheduler.filters.base [None req-72f6d91a-937d-402c-9a41-8c66b33c2269 tempest-UserMessageTest-1084663522 None] Filter CapabilitiesFilter returned 0 host(s) May 28 12:59:42 l75lg1-v1 manila-scheduler[98327]: ERROR manila.scheduler.manager [None req-72f6d91a-937d-402c-9a41-8c66b33c2269 tempest-UserMessageTest-1084663522 None] Failed to schedule create_share: No valid host was found. Failed to find a weighted host, the last executed filter was CapabilitiesFilter.: manila.exception.NoValidHost: No valid host was found. Failed to find a weighted host, the last executed filter was CapabilitiesFilter. May 28 12:59:42 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-72f6d91a-937d-402c-9a41-8c66b33c2269 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] http://10.27.203.238/share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/shares returned with HTTP 200 May 28 12:59:42 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 766/1546] 10.27.203.238 () {66 vars in 1362 bytes} [Tue May 28 12:59:42 2024] POST /share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/shares => generated 1373 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:59:42 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-6cfd9f3e-d235-45d4-9244-1daa779cf9e8 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] GET http://10.27.203.238/share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/shares/8b1f3a6c-ac54-4c87-a5e9-f2b895b72f8c May 28 12:59:42 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-6cfd9f3e-d235-45d4-9244-1daa779cf9e8 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:42 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-6cfd9f3e-d235-45d4-9244-1daa779cf9e8 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:42 l75lg1-v1 manila-scheduler[98327]: INFO manila.message.api [None req-72f6d91a-937d-402c-9a41-8c66b33c2269 tempest-UserMessageTest-1084663522 None] Creating message record for request_id = req-72f6d91a-937d-402c-9a41-8c66b33c2269 May 28 12:59:42 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-6cfd9f3e-d235-45d4-9244-1daa779cf9e8 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] http://10.27.203.238/share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/shares/8b1f3a6c-ac54-4c87-a5e9-f2b895b72f8c returned with HTTP 200 May 28 12:59:42 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 767/1547] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:59:42 2024] GET /share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/shares/8b1f3a6c-ac54-4c87-a5e9-f2b895b72f8c => generated 1373 bytes in 27 msecs (HTTP/1.1 200) 6 headers in 232 bytes (2 switches on core 0) May 28 12:59:42 l75lg1-v1 devstack@m-api.service[98329]: DEBUG oslo_concurrency.lockutils [None req-19dbf516-eb1d-4492-816c-3d4ae973bc32 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98329) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:42 l75lg1-v1 devstack@m-api.service[98329]: DEBUG oslo_concurrency.lockutils [None req-19dbf516-eb1d-4492-816c-3d4ae973bc32 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98329) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:42 l75lg1-v1 devstack@m-api.service[98329]: DEBUG oslo_concurrency.lockutils [None req-19dbf516-eb1d-4492-816c-3d4ae973bc32 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.045s {{(pid=98329) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:42 l75lg1-v1 devstack@m-api.service[98329]: DEBUG oslo_concurrency.lockutils [None req-19dbf516-eb1d-4492-816c-3d4ae973bc32 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98329) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:42 l75lg1-v1 devstack@m-api.service[98329]: DEBUG oslo_concurrency.lockutils [None req-19dbf516-eb1d-4492-816c-3d4ae973bc32 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98329) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:43 l75lg1-v1 devstack@m-api.service[98329]: DEBUG oslo_concurrency.lockutils [None req-19dbf516-eb1d-4492-816c-3d4ae973bc32 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.061s {{(pid=98329) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:43 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-19dbf516-eb1d-4492-816c-3d4ae973bc32 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action returned with HTTP 202 May 28 12:59:43 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 781/1548] 10.27.203.238 () {66 vars in 1493 bytes} [Tue May 28 12:59:42 2024] POST /share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action => generated 0 bytes in 190 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:59:43 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-24d8b5e6-0b4a-4d79-80e3-78cca58181dd tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] GET http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/share-access-rules?share_id=72db8769-ece7-42ff-af27-2e778292a9b4 May 28 12:59:43 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-24d8b5e6-0b4a-4d79-80e3-78cca58181dd tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:43 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-24d8b5e6-0b4a-4d79-80e3-78cca58181dd tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:43 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9e862c6b-9e72-442f-b15f-ddb768c3334e tempest-ResourceLockNegativeTestWithShares-789426285 None] <<< [GET] https://127.0.0.1:40443/api/quotas/ May 28 12:59:43 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9e862c6b-9e72-442f-b15f-ddb768c3334e tempest-ResourceLockNegativeTestWithShares-789426285 None] [Bunch(cluster='loop75-kfs', cluster_id=1, default_email=None, default_group_quota=None, default_user_quota=None, enable_alarms=True, enable_email_providers=True, grace_period=None, guid='9e1e633e-3738-4034-b8a1-531e54112a1a', hard_limit=1073741824, hard_limit_inodes=None, id=34, internal=False, is_user_quota=False, last_user_quotas_update=None, name='f1a7f25a-f865-4592-93e1-c1e62b2447b8', num_blocked_users=0, num_exceeded_users=0, path='/manila/manila-f1a7f25a-f865-4592-93e1-c1e62b2447b8', percent_capacity=0, percent_inodes=None, pretty_grace_period=None, pretty_grace_period_expiration=None, pretty_state='OK (Calculating)', soft_limit=None, soft_limit_inodes=None, state='OK', sync_state='Calculating', system_id=34, tenant_id=1, tenant_name='default', time_to_block=None, title='f1a7f25a-f865-4592-93e1-c1e62b2447b8', url='https://127.0.0.1:40443/api/quotas/34/', used_capacity=0, used_capacity_tb=0.0, used_effective_capacity=0, used_effective_capacity_tb=0.0, used_inodes=0, used_limited_capacity=0)] May 28 12:59:43 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9e862c6b-9e72-442f-b15f-ddb768c3334e tempest-ResourceLockNegativeTestWithShares-789426285 None] --- [GET] https://127.0.0.1:40443/api/quotas/: Done May 28 12:59:43 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9e862c6b-9e72-442f-b15f-ddb768c3334e tempest-ResourceLockNegativeTestWithShares-789426285 None] >>> [DELETE] https://127.0.0.1:40443/api/quotas/34/ May 28 12:59:43 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-0c886365-cbfb-4f24-bdf5-98ed3fde1b0a tempest-ResourceLockNegativeTestWithShares-789426285 tempest-ResourceLockNegativeTestWithShares-789426285-project-member] GET http://10.27.203.238/share/v2/86e4aff17ad94d75a624b038464bfeb2/shares/a5984861-5086-4848-82ce-0960e763197b May 28 12:59:43 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-0c886365-cbfb-4f24-bdf5-98ed3fde1b0a tempest-ResourceLockNegativeTestWithShares-789426285 tempest-ResourceLockNegativeTestWithShares-789426285-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:43 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-0c886365-cbfb-4f24-bdf5-98ed3fde1b0a tempest-ResourceLockNegativeTestWithShares-789426285 tempest-ResourceLockNegativeTestWithShares-789426285-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:43 l75lg1-v1 manila-share[98474]: DEBUG manila.share.manager [None req-19dbf516-eb1d-4492-816c-3d4ae973bc32 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Received request to update access for share instance 7fdd602c-79d0-479c-95a2-336b202c6639. {{(pid=98474) update_access_for_instances /opt/stack/manila/manila/share/manager.py:4353}} May 28 12:59:43 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-0c886365-cbfb-4f24-bdf5-98ed3fde1b0a tempest-ResourceLockNegativeTestWithShares-789426285 tempest-ResourceLockNegativeTestWithShares-789426285-project-member] http://10.27.203.238/share/v2/86e4aff17ad94d75a624b038464bfeb2/shares/a5984861-5086-4848-82ce-0960e763197b returned with HTTP 200 May 28 12:59:43 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 782/1549] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:59:43 2024] GET /share/v2/86e4aff17ad94d75a624b038464bfeb2/shares/a5984861-5086-4848-82ce-0960e763197b => generated 1313 bytes in 27 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:59:43 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-19dbf516-eb1d-4492-816c-3d4ae973bc32 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:43 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-19dbf516-eb1d-4492-816c-3d4ae973bc32 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:43 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-19dbf516-eb1d-4492-816c-3d4ae973bc32 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:43 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-19dbf516-eb1d-4492-816c-3d4ae973bc32 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:43 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.lock.api [None req-24d8b5e6-0b4a-4d79-80e3-78cca58181dd tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Searching for locks by: {'resource_id': '92aed90f-4f97-4ac6-bae1-6feb29133d5a', 'resource_action': 'show', 'resource_type': 'access_rule'} {{(pid=98330) get_all /opt/stack/manila/manila/lock/api.py:112}} May 28 12:59:43 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-19dbf516-eb1d-4492-816c-3d4ae973bc32 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:43 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-24d8b5e6-0b4a-4d79-80e3-78cca58181dd tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/share-access-rules?share_id=72db8769-ece7-42ff-af27-2e778292a9b4 returned with HTTP 200 May 28 12:59:43 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 768/1550] 10.27.203.238 () {64 vars in 1467 bytes} [Tue May 28 12:59:43 2024] GET /share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/share-access-rules?share_id=72db8769-ece7-42ff-af27-2e778292a9b4 => generated 302 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:59:43 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-19dbf516-eb1d-4492-816c-3d4ae973bc32 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.054s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:43 l75lg1-v1 manila-share[98474]: DEBUG manila.share.access [None req-19dbf516-eb1d-4492-816c-3d4ae973bc32 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Updating access rules for share instance 7fdd602c-79d0-479c-95a2-336b202c6639 belonging to share 72db8769-ece7-42ff-af27-2e778292a9b4. {{(pid=98474) update_access_rules /opt/stack/manila/manila/share/access.py:298}} May 28 12:59:43 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-19dbf516-eb1d-4492-816c-3d4ae973bc32 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:43 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-19dbf516-eb1d-4492-816c-3d4ae973bc32 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:43 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-19dbf516-eb1d-4492-816c-3d4ae973bc32 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.007s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:43 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-19dbf516-eb1d-4492-816c-3d4ae973bc32 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:43 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-19dbf516-eb1d-4492-816c-3d4ae973bc32 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:43 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-19dbf516-eb1d-4492-816c-3d4ae973bc32 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.014s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:43 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-19dbf516-eb1d-4492-816c-3d4ae973bc32 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] changing access on None May 28 12:59:43 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-19dbf516-eb1d-4492-816c-3d4ae973bc32 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:59:43 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-19dbf516-eb1d-4492-816c-3d4ae973bc32 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] {'allow_redirects': True, May 28 12:59:43 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-19dbf516-eb1d-4492-816c-3d4ae973bc32 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] 'params': {'name': '7fdd602c-79d0-479c-95a2-336b202c6639'}} May 28 12:59:43 l75lg1-v1 dstat.sh[49771]: 28-05 12:59:43| 10 1 87 2 0|5740M 1725M 277M 7882M| 11k 1992B| 0 1779k| 0 257 |5505 9100 |1.08 1.05 1.01|1.0 1.0 0| 0 0 | 0 2048M| 29 363 0 27 0 May 28 12:59:43 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-19dbf516-eb1d-4492-816c-3d4ae973bc32 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:59:43 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-19dbf516-eb1d-4492-816c-3d4ae973bc32 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] [Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=1, created='2024-05-28T12:58:43.845440Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='31b6534b-d142-4561-992f-4f0759db302d', id=32, internal=False, is_s3_default_policy=False, name='7fdd602c-79d0-479c-95a2-336b202c6639', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=['*'], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=[], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=[], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T12:59:32.000989Z', tenant_id=1, tenant_name='default', title='7fdd602c-79d0-479c-95a2-336b202c6639', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/32/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[])] May 28 12:59:43 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-19dbf516-eb1d-4492-816c-3d4ae973bc32 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 12:59:43 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-19dbf516-eb1d-4492-816c-3d4ae973bc32 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:43 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-19dbf516-eb1d-4492-816c-3d4ae973bc32 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:43 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-19dbf516-eb1d-4492-816c-3d4ae973bc32 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.048s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:43 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-19dbf516-eb1d-4492-816c-3d4ae973bc32 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:43 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-19dbf516-eb1d-4492-816c-3d4ae973bc32 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:43 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:59:43 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.manager [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Cleaning up deleted instances {{(pid=83654) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11226}} May 28 12:59:43 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Expecting reply to msg 80a28bd3f8f4435594cef61cdf5c414a in queue reply_37f4cbd1dd094961a22b8a65f222c327 May 28 12:59:43 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [-] Received RPC response for msg 80a28bd3f8f4435594cef61cdf5c414a May 28 12:59:43 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-19dbf516-eb1d-4492-816c-3d4ae973bc32 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.051s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:43 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-19dbf516-eb1d-4492-816c-3d4ae973bc32 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:43 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-19dbf516-eb1d-4492-816c-3d4ae973bc32 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:43 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-19dbf516-eb1d-4492-816c-3d4ae973bc32 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.004s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:43 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-19dbf516-eb1d-4492-816c-3d4ae973bc32 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:43 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-19dbf516-eb1d-4492-816c-3d4ae973bc32 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:43 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-19dbf516-eb1d-4492-816c-3d4ae973bc32 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:43 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-19dbf516-eb1d-4492-816c-3d4ae973bc32 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:43 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-19dbf516-eb1d-4492-816c-3d4ae973bc32 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:43 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-19dbf516-eb1d-4492-816c-3d4ae973bc32 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.057s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:43 l75lg1-v1 manila-share[98474]: INFO manila.share.access [None req-19dbf516-eb1d-4492-816c-3d4ae973bc32 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Access rules were successfully modified for share instance 7fdd602c-79d0-479c-95a2-336b202c6639 belonging to share 72db8769-ece7-42ff-af27-2e778292a9b4. May 28 12:59:43 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f00cabcb-e006-4e5f-b659-9d36127b4944 tempest-ShareIpRulesForNFSTest-1748669711 None] <<< [DELETE] https://127.0.0.1:40443/api/views/20/ May 28 12:59:43 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f00cabcb-e006-4e5f-b659-9d36127b4944 tempest-ShareIpRulesForNFSTest-1748669711 None] --- [DELETE] https://127.0.0.1:40443/api/views/20/: Done May 28 12:59:43 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f00cabcb-e006-4e5f-b659-9d36127b4944 tempest-ShareIpRulesForNFSTest-1748669711 None] >>> [GET] https://127.0.0.1:40443/api/quotas/ May 28 12:59:43 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f00cabcb-e006-4e5f-b659-9d36127b4944 tempest-ShareIpRulesForNFSTest-1748669711 None] {'allow_redirects': True, May 28 12:59:43 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f00cabcb-e006-4e5f-b659-9d36127b4944 tempest-ShareIpRulesForNFSTest-1748669711 None] 'params': {'name': 'b7a7d61c-2cea-442a-9809-507038e080d5'}} May 28 12:59:43 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-3cd3c257-473f-4bc3-9f73-ceac180c14a3 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] GET http://10.27.203.238/share/v2/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1 May 28 12:59:43 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-3cd3c257-473f-4bc3-9f73-ceac180c14a3 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:43 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-3cd3c257-473f-4bc3-9f73-ceac180c14a3 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:43 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-3cd3c257-473f-4bc3-9f73-ceac180c14a3 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] http://10.27.203.238/share/v2/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1 returned with HTTP 200 May 28 12:59:43 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 783/1551] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:59:43 2024] GET /share/v2/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1 => generated 1316 bytes in 24 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:59:44 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.manager [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] There are 0 instances to clean {{(pid=83654) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11235}} May 28 12:59:44 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:59:44 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Expecting reply to msg c2505d5827fa454a8949bdad7910dfbc in queue reply_37f4cbd1dd094961a22b8a65f222c327 May 28 12:59:44 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [-] Received RPC response for msg c2505d5827fa454a8949bdad7910dfbc May 28 12:59:44 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f00cabcb-e006-4e5f-b659-9d36127b4944 tempest-ShareIpRulesForNFSTest-1748669711 None] <<< [GET] https://127.0.0.1:40443/api/quotas/ May 28 12:59:44 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f00cabcb-e006-4e5f-b659-9d36127b4944 tempest-ShareIpRulesForNFSTest-1748669711 None] [Bunch(cluster='loop75-kfs', cluster_id=1, default_email=None, default_group_quota=None, default_user_quota=None, enable_alarms=True, enable_email_providers=True, grace_period=None, guid='7cee33d4-fd10-4965-96a8-0fb543190acd', hard_limit=1073741824, hard_limit_inodes=None, id=18, internal=False, is_user_quota=False, last_user_quotas_update=None, name='b7a7d61c-2cea-442a-9809-507038e080d5', num_blocked_users=0, num_exceeded_users=0, path='/manila/manila-b7a7d61c-2cea-442a-9809-507038e080d5', percent_capacity=0, percent_inodes=None, pretty_grace_period=None, pretty_grace_period_expiration=None, pretty_state='OK', soft_limit=None, soft_limit_inodes=None, state='OK', sync_state='SYNCHRONIZED', system_id=18, tenant_id=1, tenant_name='default', time_to_block=None, title='b7a7d61c-2cea-442a-9809-507038e080d5', url='https://127.0.0.1:40443/api/quotas/18/', used_capacity=0, used_capacity_tb=0.0, used_effective_capacity=0, used_effective_capacity_tb=0.0, used_inodes=1, used_limited_capacity=0)] May 28 12:59:44 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f00cabcb-e006-4e5f-b659-9d36127b4944 tempest-ShareIpRulesForNFSTest-1748669711 None] --- [GET] https://127.0.0.1:40443/api/quotas/: Done May 28 12:59:44 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f00cabcb-e006-4e5f-b659-9d36127b4944 tempest-ShareIpRulesForNFSTest-1748669711 None] >>> [DELETE] https://127.0.0.1:40443/api/quotas/18/ May 28 12:59:44 l75lg1-v1 dstat.sh[49771]: 28-05 12:59:44| 3 1 92 5 0|5740M 1725M 277M 7882M| 15k 1391B| 0 6424k| 0 475 |3866 6034 |1.08 1.05 1.01|2.0 1.0 0| 0 0 | 0 2048M| 29 363 0 27 0 May 28 12:59:44 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c1817b1a-9641-4100-a7a6-5923abdafa13 tempest-ResourceLockDeleteTest-1157183439 None] <<< [DELETE] https://127.0.0.1:40443/api/quotas/32/ May 28 12:59:44 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c1817b1a-9641-4100-a7a6-5923abdafa13 tempest-ResourceLockDeleteTest-1157183439 None] --- [DELETE] https://127.0.0.1:40443/api/quotas/32/: Done May 28 12:59:44 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c1817b1a-9641-4100-a7a6-5923abdafa13 tempest-ResourceLockDeleteTest-1157183439 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:59:44 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c1817b1a-9641-4100-a7a6-5923abdafa13 tempest-ResourceLockDeleteTest-1157183439 None] {'allow_redirects': True, May 28 12:59:44 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c1817b1a-9641-4100-a7a6-5923abdafa13 tempest-ResourceLockDeleteTest-1157183439 None] 'params': {'name': '9fadf39f-1d93-4ddd-bd00-1fd7ccc09539'}} May 28 12:59:44 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c1817b1a-9641-4100-a7a6-5923abdafa13 tempest-ResourceLockDeleteTest-1157183439 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:59:44 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c1817b1a-9641-4100-a7a6-5923abdafa13 tempest-ResourceLockDeleteTest-1157183439 None] [Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=0, created='2024-05-28T12:59:15.263062Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='2df40b6b-03c5-491b-921f-16f9c8236d3b', id=35, internal=False, is_s3_default_policy=False, name='9fadf39f-1d93-4ddd-bd00-1fd7ccc09539', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=[], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['*'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['*'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T12:59:15.569875Z', tenant_id=1, tenant_name='default', title='9fadf39f-1d93-4ddd-bd00-1fd7ccc09539', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/35/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[])] May 28 12:59:44 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c1817b1a-9641-4100-a7a6-5923abdafa13 tempest-ResourceLockDeleteTest-1157183439 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 12:59:44 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c1817b1a-9641-4100-a7a6-5923abdafa13 tempest-ResourceLockDeleteTest-1157183439 None] >>> [DELETE] https://127.0.0.1:40443/api/viewpolicies/35/ May 28 12:59:45 l75lg1-v1 dstat.sh[49771]: 28-05 12:59:45| 1 0 98 0 0|5741M 1725M 277M 7882M| 17k 1390B| 0 744k| 0 25.0 |1763 2666 |1.08 1.05 1.01|1.0 1.0 0| 0 0 | 0 2048M| 29 363 0 27 0 May 28 12:59:45 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-89ba59f6-b3cf-49ca-b1a6-e7229c3e6c82 tempest-ResourceLockDeleteTest-1157183439 tempest-ResourceLockDeleteTest-1157183439-project-member] GET http://10.27.203.238/share/v2/645fb190404541a78e449c703540d6f8/shares/ed309fc1-d1ff-4352-a44a-a56b44eb8d0e May 28 12:59:45 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-89ba59f6-b3cf-49ca-b1a6-e7229c3e6c82 tempest-ResourceLockDeleteTest-1157183439 tempest-ResourceLockDeleteTest-1157183439-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:45 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-89ba59f6-b3cf-49ca-b1a6-e7229c3e6c82 tempest-ResourceLockDeleteTest-1157183439 tempest-ResourceLockDeleteTest-1157183439-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:45 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-89ba59f6-b3cf-49ca-b1a6-e7229c3e6c82 tempest-ResourceLockDeleteTest-1157183439 tempest-ResourceLockDeleteTest-1157183439-project-member] http://10.27.203.238/share/v2/645fb190404541a78e449c703540d6f8/shares/ed309fc1-d1ff-4352-a44a-a56b44eb8d0e returned with HTTP 200 May 28 12:59:45 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 769/1552] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:59:45 2024] GET /share/v2/645fb190404541a78e449c703540d6f8/shares/ed309fc1-d1ff-4352-a44a-a56b44eb8d0e => generated 1316 bytes in 28 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:59:45 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-913f34fe-0dd0-45d4-baeb-11d2b9d2b967 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] GET http://10.27.203.238/share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/shares/8b1f3a6c-ac54-4c87-a5e9-f2b895b72f8c May 28 12:59:45 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-913f34fe-0dd0-45d4-baeb-11d2b9d2b967 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:45 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-913f34fe-0dd0-45d4-baeb-11d2b9d2b967 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:45 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-913f34fe-0dd0-45d4-baeb-11d2b9d2b967 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] http://10.27.203.238/share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/shares/8b1f3a6c-ac54-4c87-a5e9-f2b895b72f8c returned with HTTP 200 May 28 12:59:45 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 784/1553] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:59:45 2024] GET /share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/shares/8b1f3a6c-ac54-4c87-a5e9-f2b895b72f8c => generated 1370 bytes in 25 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:59:46 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-86359593-cf26-4f34-9fc4-f2065fccb21f tempest-ResourceLockNegativeTestWithShares-789426285 tempest-ResourceLockNegativeTestWithShares-789426285-project-member] GET http://10.27.203.238/share/v2/86e4aff17ad94d75a624b038464bfeb2/shares/a5984861-5086-4848-82ce-0960e763197b May 28 12:59:46 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-86359593-cf26-4f34-9fc4-f2065fccb21f tempest-ResourceLockNegativeTestWithShares-789426285 tempest-ResourceLockNegativeTestWithShares-789426285-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:46 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-86359593-cf26-4f34-9fc4-f2065fccb21f tempest-ResourceLockNegativeTestWithShares-789426285 tempest-ResourceLockNegativeTestWithShares-789426285-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:46 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-86359593-cf26-4f34-9fc4-f2065fccb21f tempest-ResourceLockNegativeTestWithShares-789426285 tempest-ResourceLockNegativeTestWithShares-789426285-project-member] http://10.27.203.238/share/v2/86e4aff17ad94d75a624b038464bfeb2/shares/a5984861-5086-4848-82ce-0960e763197b returned with HTTP 200 May 28 12:59:46 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 770/1554] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:59:46 2024] GET /share/v2/86e4aff17ad94d75a624b038464bfeb2/shares/a5984861-5086-4848-82ce-0960e763197b => generated 1313 bytes in 27 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:59:46 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-91e9530b-9b05-48d2-9dab-f817b1284873 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] GET http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/share-access-rules?share_id=72db8769-ece7-42ff-af27-2e778292a9b4 May 28 12:59:46 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-91e9530b-9b05-48d2-9dab-f817b1284873 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:46 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-91e9530b-9b05-48d2-9dab-f817b1284873 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:46 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-91e9530b-9b05-48d2-9dab-f817b1284873 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/share-access-rules?share_id=72db8769-ece7-42ff-af27-2e778292a9b4 returned with HTTP 200 May 28 12:59:46 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 785/1555] 10.27.203.238 () {64 vars in 1467 bytes} [Tue May 28 12:59:46 2024] GET /share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/share-access-rules?share_id=72db8769-ece7-42ff-af27-2e778292a9b4 => generated 19 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:59:46 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-77551ec4-f7d8-4f99-bff2-2a0f4e05d528 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] POST http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action May 28 12:59:46 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-77551ec4-f7d8-4f99-bff2-2a0f4e05d528 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Action body: b'{"allow_access": {"access_type": "ip", "access_to": "10.10.30.40/32", "access_level": "rw"}}' {{(pid=98330) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:59:46 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-77551ec4-f7d8-4f99-bff2-2a0f4e05d528 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Action: 'action', calling method: ShareController.allow_access, body: {"allow_access": {"access_type": "ip", "access_to": "10.10.30.40/32", "access_level": "rw"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:59:46 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-77551ec4-f7d8-4f99-bff2-2a0f4e05d528 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:46 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-77551ec4-f7d8-4f99-bff2-2a0f4e05d528 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:46 l75lg1-v1 dstat.sh[49771]: 28-05 12:59:46| 3 0 96 0 0|5741M 1725M 277M 7882M| 17k 3339B| 0 636k| 0 56.0 |2469 3753 |1.08 1.05 1.01|2.0 1.0 0| 0 0 | 0 2048M| 29 364 0 27 0 May 28 12:59:46 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-77551ec4-f7d8-4f99-bff2-2a0f4e05d528 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.050s {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:46 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-77551ec4-f7d8-4f99-bff2-2a0f4e05d528 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action returned with HTTP 200 May 28 12:59:46 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 771/1556] 10.27.203.238 () {66 vars in 1493 bytes} [Tue May 28 12:59:46 2024] POST /share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action => generated 312 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:59:46 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-c02ccc5f-5441-4a2c-bd4c-dccf275aa4ac tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] GET http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/share-access-rules?share_id=72db8769-ece7-42ff-af27-2e778292a9b4 May 28 12:59:46 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-c02ccc5f-5441-4a2c-bd4c-dccf275aa4ac tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:46 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-c02ccc5f-5441-4a2c-bd4c-dccf275aa4ac tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:46 l75lg1-v1 manila-share[98474]: DEBUG manila.share.manager [None req-77551ec4-f7d8-4f99-bff2-2a0f4e05d528 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Received request to update access for share instance 7fdd602c-79d0-479c-95a2-336b202c6639. {{(pid=98474) update_access_for_instances /opt/stack/manila/manila/share/manager.py:4353}} May 28 12:59:46 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-77551ec4-f7d8-4f99-bff2-2a0f4e05d528 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:46 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-77551ec4-f7d8-4f99-bff2-2a0f4e05d528 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:46 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.lock.api [None req-c02ccc5f-5441-4a2c-bd4c-dccf275aa4ac tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Searching for locks by: {'resource_id': '571b2898-66b3-497d-944f-2c7e5223dd6b', 'resource_action': 'show', 'resource_type': 'access_rule'} {{(pid=98329) get_all /opt/stack/manila/manila/lock/api.py:112}} May 28 12:59:46 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-77551ec4-f7d8-4f99-bff2-2a0f4e05d528 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:46 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-77551ec4-f7d8-4f99-bff2-2a0f4e05d528 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:46 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-77551ec4-f7d8-4f99-bff2-2a0f4e05d528 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:46 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-c02ccc5f-5441-4a2c-bd4c-dccf275aa4ac tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/share-access-rules?share_id=72db8769-ece7-42ff-af27-2e778292a9b4 returned with HTTP 200 May 28 12:59:46 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 786/1557] 10.27.203.238 () {64 vars in 1467 bytes} [Tue May 28 12:59:46 2024] GET /share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/share-access-rules?share_id=72db8769-ece7-42ff-af27-2e778292a9b4 => generated 267 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:59:46 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-77551ec4-f7d8-4f99-bff2-2a0f4e05d528 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.054s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:46 l75lg1-v1 manila-share[98474]: DEBUG manila.share.access [None req-77551ec4-f7d8-4f99-bff2-2a0f4e05d528 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Updating access rules for share instance 7fdd602c-79d0-479c-95a2-336b202c6639 belonging to share 72db8769-ece7-42ff-af27-2e778292a9b4. {{(pid=98474) update_access_rules /opt/stack/manila/manila/share/access.py:298}} May 28 12:59:46 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f00cabcb-e006-4e5f-b659-9d36127b4944 tempest-ShareIpRulesForNFSTest-1748669711 None] <<< [DELETE] https://127.0.0.1:40443/api/quotas/18/ May 28 12:59:46 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f00cabcb-e006-4e5f-b659-9d36127b4944 tempest-ShareIpRulesForNFSTest-1748669711 None] --- [DELETE] https://127.0.0.1:40443/api/quotas/18/: Done May 28 12:59:46 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f00cabcb-e006-4e5f-b659-9d36127b4944 tempest-ShareIpRulesForNFSTest-1748669711 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:59:46 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f00cabcb-e006-4e5f-b659-9d36127b4944 tempest-ShareIpRulesForNFSTest-1748669711 None] {'allow_redirects': True, May 28 12:59:46 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f00cabcb-e006-4e5f-b659-9d36127b4944 tempest-ShareIpRulesForNFSTest-1748669711 None] 'params': {'name': 'b7a7d61c-2cea-442a-9809-507038e080d5'}} May 28 12:59:46 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9e862c6b-9e72-442f-b15f-ddb768c3334e tempest-ResourceLockNegativeTestWithShares-789426285 None] <<< [DELETE] https://127.0.0.1:40443/api/quotas/34/ May 28 12:59:46 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9e862c6b-9e72-442f-b15f-ddb768c3334e tempest-ResourceLockNegativeTestWithShares-789426285 None] --- [DELETE] https://127.0.0.1:40443/api/quotas/34/: Done May 28 12:59:46 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9e862c6b-9e72-442f-b15f-ddb768c3334e tempest-ResourceLockNegativeTestWithShares-789426285 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:59:46 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9e862c6b-9e72-442f-b15f-ddb768c3334e tempest-ResourceLockNegativeTestWithShares-789426285 None] {'allow_redirects': True, May 28 12:59:46 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9e862c6b-9e72-442f-b15f-ddb768c3334e tempest-ResourceLockNegativeTestWithShares-789426285 None] 'params': {'name': 'f1a7f25a-f865-4592-93e1-c1e62b2447b8'}} May 28 12:59:46 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-77551ec4-f7d8-4f99-bff2-2a0f4e05d528 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:46 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-77551ec4-f7d8-4f99-bff2-2a0f4e05d528 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:46 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-77551ec4-f7d8-4f99-bff2-2a0f4e05d528 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.008s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:46 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-77551ec4-f7d8-4f99-bff2-2a0f4e05d528 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:46 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-77551ec4-f7d8-4f99-bff2-2a0f4e05d528 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:46 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-77551ec4-f7d8-4f99-bff2-2a0f4e05d528 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.019s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:46 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-77551ec4-f7d8-4f99-bff2-2a0f4e05d528 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] changing access on None May 28 12:59:46 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-77551ec4-f7d8-4f99-bff2-2a0f4e05d528 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:59:46 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-77551ec4-f7d8-4f99-bff2-2a0f4e05d528 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] {'allow_redirects': True, May 28 12:59:46 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-77551ec4-f7d8-4f99-bff2-2a0f4e05d528 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] 'params': {'name': '7fdd602c-79d0-479c-95a2-336b202c6639'}} May 28 12:59:46 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c1817b1a-9641-4100-a7a6-5923abdafa13 tempest-ResourceLockDeleteTest-1157183439 None] <<< [DELETE] https://127.0.0.1:40443/api/viewpolicies/35/ May 28 12:59:46 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c1817b1a-9641-4100-a7a6-5923abdafa13 tempest-ResourceLockDeleteTest-1157183439 None] --- [DELETE] https://127.0.0.1:40443/api/viewpolicies/35/: Done May 28 12:59:46 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-c1817b1a-9641-4100-a7a6-5923abdafa13 tempest-ResourceLockDeleteTest-1157183439 None] Created reservations ['4ed78f72-13f0-4ec4-a5cb-c0de3530a608', '07f1ba99-f91f-48d4-8710-d10e617c1b88', '7ab1acf9-f9c9-4cc0-b10c-eec078a4cd00', '5a44aafb-64bf-493b-995b-7238bfb81035'] {{(pid=98474) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 12:59:46 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-c1817b1a-9641-4100-a7a6-5923abdafa13 tempest-ResourceLockDeleteTest-1157183439 None] Committed reservations ['4ed78f72-13f0-4ec4-a5cb-c0de3530a608', '07f1ba99-f91f-48d4-8710-d10e617c1b88', '7ab1acf9-f9c9-4cc0-b10c-eec078a4cd00', '5a44aafb-64bf-493b-995b-7238bfb81035'] {{(pid=98474) commit /opt/stack/manila/manila/quota.py:1063}} May 28 12:59:46 l75lg1-v1 manila-share[98474]: INFO manila.share.manager [None req-c1817b1a-9641-4100-a7a6-5923abdafa13 tempest-ResourceLockDeleteTest-1157183439 None] Share instance 9fadf39f-1d93-4ddd-bd00-1fd7ccc09539: deleted successfully. May 28 12:59:46 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f00cabcb-e006-4e5f-b659-9d36127b4944 tempest-ShareIpRulesForNFSTest-1748669711 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:59:46 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f00cabcb-e006-4e5f-b659-9d36127b4944 tempest-ShareIpRulesForNFSTest-1748669711 None] [Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=0, created='2024-05-28T12:57:40.763635Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='377955ad-d094-4e49-ab32-1021d943a572', id=21, internal=False, is_s3_default_policy=False, name='b7a7d61c-2cea-442a-9809-507038e080d5', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=['*'], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=[], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=[], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T12:59:39.740029Z', tenant_id=1, tenant_name='default', title='b7a7d61c-2cea-442a-9809-507038e080d5', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/21/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[])] May 28 12:59:46 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f00cabcb-e006-4e5f-b659-9d36127b4944 tempest-ShareIpRulesForNFSTest-1748669711 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 12:59:46 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f00cabcb-e006-4e5f-b659-9d36127b4944 tempest-ShareIpRulesForNFSTest-1748669711 None] >>> [DELETE] https://127.0.0.1:40443/api/viewpolicies/21/ May 28 12:59:46 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9e862c6b-9e72-442f-b15f-ddb768c3334e tempest-ResourceLockNegativeTestWithShares-789426285 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:59:46 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9e862c6b-9e72-442f-b15f-ddb768c3334e tempest-ResourceLockNegativeTestWithShares-789426285 None] [Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=0, created='2024-05-28T12:59:33.611257Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='bf977100-91be-426a-a144-d77a77a436f6', id=37, internal=False, is_s3_default_policy=False, name='f1a7f25a-f865-4592-93e1-c1e62b2447b8', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=[], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['*'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['*'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T12:59:33.978437Z', tenant_id=1, tenant_name='default', title='f1a7f25a-f865-4592-93e1-c1e62b2447b8', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/37/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[])] May 28 12:59:46 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9e862c6b-9e72-442f-b15f-ddb768c3334e tempest-ResourceLockNegativeTestWithShares-789426285 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 12:59:46 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9e862c6b-9e72-442f-b15f-ddb768c3334e tempest-ResourceLockNegativeTestWithShares-789426285 None] >>> [DELETE] https://127.0.0.1:40443/api/viewpolicies/37/ May 28 12:59:46 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-77551ec4-f7d8-4f99-bff2-2a0f4e05d528 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:59:46 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-77551ec4-f7d8-4f99-bff2-2a0f4e05d528 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] [Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=1, created='2024-05-28T12:58:43.845440Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='31b6534b-d142-4561-992f-4f0759db302d', id=32, internal=False, is_s3_default_policy=False, name='7fdd602c-79d0-479c-95a2-336b202c6639', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=['*'], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=[], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=[], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T12:59:32.000989Z', tenant_id=1, tenant_name='default', title='7fdd602c-79d0-479c-95a2-336b202c6639', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/32/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[])] May 28 12:59:46 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-77551ec4-f7d8-4f99-bff2-2a0f4e05d528 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 12:59:46 l75lg1-v1 manila-share[98474]: ERROR manila.share.drivers.vastdata [None req-77551ec4-f7d8-4f99-bff2-2a0f4e05d528 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] failed to resolve host '10.10.30.40/32': [Errno -2] Name or service not known (ignoring): socket.gaierror: [Errno -2] Name or service not known May 28 12:59:46 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-77551ec4-f7d8-4f99-bff2-2a0f4e05d528 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] changing access on /manila/manila-7fdd602c-79d0-479c-95a2-336b202c6639. Rules: {'nfs_read_write': [], 'nfs_read_only': []} May 28 12:59:46 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-77551ec4-f7d8-4f99-bff2-2a0f4e05d528 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] >>> [PATCH] https://127.0.0.1:40443/api/viewpolicies/32/ May 28 12:59:46 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-77551ec4-f7d8-4f99-bff2-2a0f4e05d528 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] {'data': '{"name": "7fdd602c-79d0-479c-95a2-336b202c6639", "nfs_no_squash": ' May 28 12:59:46 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-77551ec4-f7d8-4f99-bff2-2a0f4e05d528 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] '["*"], "nfs_root_squash": ["*"], "nfs_read_write": [], ' May 28 12:59:46 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-77551ec4-f7d8-4f99-bff2-2a0f4e05d528 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] '"nfs_read_only": []}', May 28 12:59:46 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-77551ec4-f7d8-4f99-bff2-2a0f4e05d528 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] 'params': None} May 28 12:59:46 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-21fe8455-6d31-48b7-99ed-7dc98b8d6f76 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] GET http://10.27.203.238/share/v2/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1 May 28 12:59:46 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-21fe8455-6d31-48b7-99ed-7dc98b8d6f76 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:46 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-21fe8455-6d31-48b7-99ed-7dc98b8d6f76 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:46 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-21fe8455-6d31-48b7-99ed-7dc98b8d6f76 tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] http://10.27.203.238/share/v2/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1 returned with HTTP 200 May 28 12:59:46 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 772/1558] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:59:46 2024] GET /share/v2/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1 => generated 1316 bytes in 28 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:59:47 l75lg1-v1 dstat.sh[49771]: 28-05 12:59:47| 5 1 93 1 0|5740M 1725M 277M 7882M| 21k 5569B| 0 7655k| 0 772 |3855 5994 |0.99 1.03 1.00|1.0 1.0 0| 0 0 | 0 2048M| 29 363 0 27 0 May 28 12:59:47 l75lg1-v1 manila-share[98474]: DEBUG oslo_service.periodic_task [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] Running periodic task ShareManager._publish_service_capabilities {{(pid=98474) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:59:47 l75lg1-v1 manila-share[98474]: DEBUG manila.manager [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] Notifying Schedulers of capabilities ... {{(pid=98474) _publish_service_capabilities /opt/stack/manila/manila/manager.py:172}} May 28 12:59:47 l75lg1-v1 manila-share[98474]: DEBUG oslo_service.periodic_task [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] Running periodic task ShareManager.migration_driver_continue {{(pid=98474) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:59:47 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.host_manager [None req-a2800d5b-c3aa-4bc8-9b35-2db6e7fcc80e None None] Received share service update from l75lg1-v1@vast: {'share_backend_name': 'vast', 'driver_handles_share_servers': False, 'vendor_name': 'VAST STORAGE', 'driver_version': '1.0', 'storage_protocol': 'NFS', 'total_capacity_gb': 2083.02392578125, 'free_capacity_gb': 2082.6478263456374, 'reserved_percentage': 0, 'reserved_snapshot_percentage': 0, 'reserved_share_extend_percentage': 0, 'qos': False, 'pools': None, 'snapshot_support': True, 'create_share_from_snapshot_support': False, 'revert_to_snapshot_support': False, 'mount_snapshot_support': False, 'replication_domain': None, 'filter_function': None, 'goodness_function': None, 'security_service_update_support': False, 'network_allocation_update_support': False, 'share_server_multiple_subnet_support': False, 'mount_point_name_support': False, 'data_reduction': 5.29, 'provisioned_capacity_gb': 0.3760994356125593, 'share_group_stats': {'consistent_snapshot_support': None}, 'ipv4_support': True, 'ipv6_support': False} {{(pid=98327) update_service_capabilities /opt/stack/manila/manila/scheduler/host_manager.py:632}} May 28 12:59:47 l75lg1-v1 manila-share[98474]: DEBUG oslo_service.periodic_task [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] Running periodic task ShareManager.do_deferred_share_deletion {{(pid=98474) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:59:47 l75lg1-v1 manila-share[98474]: DEBUG manila.share.manager [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] Checking for shares in 'deferred_deleting' status to process their deletion. {{(pid=98474) do_deferred_share_deletion /opt/stack/manila/manila/share/manager.py:3663}} May 28 12:59:47 l75lg1-v1 manila-share[98474]: DEBUG oslo_service.periodic_task [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] Running periodic task ShareManager.do_deferred_snapshot_deletion {{(pid=98474) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:59:47 l75lg1-v1 manila-share[98474]: DEBUG manila.share.manager [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] Checking for snapshots in 'deferred_deleting' status to process their deletion. {{(pid=98474) do_deferred_snapshot_deletion /opt/stack/manila/manila/share/manager.py:3980}} May 28 12:59:47 l75lg1-v1 manila-share[98474]: DEBUG oslo_service.periodic_task [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] Running periodic task ShareManager._report_driver_status {{(pid=98474) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:59:47 l75lg1-v1 manila-share[98474]: INFO manila.share.manager [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] Updating share status May 28 12:59:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] >>> [GET] https://127.0.0.1:40443/api/monitors/ad_hoc_query/ May 28 12:59:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] {'allow_redirects': True, May 28 12:59:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] 'params': {'object_type': 'cluster', May 28 12:59:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] 'prop_list': ['Capacity,drr', May 28 12:59:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] 'Capacity,logical_space', May 28 12:59:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] 'Capacity,logical_space_in_use', May 28 12:59:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] 'Capacity,physical_space', May 28 12:59:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] 'Capacity,physical_space_in_use'], May 28 12:59:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] 'time_frame': '1m'}} May 28 12:59:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] <<< [GET] https://127.0.0.1:40443/api/monitors/ad_hoc_query/ May 28 12:59:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] Bunch(data=[['2024-05-28T12:59:41Z', 1, 448971613.0, 2223930.0, 5.29, 711246584217.0, 2236629909504.0], ['2024-05-28T12:59:29Z', 1, 448865118.0, 2223930.0, 5.29, 711246584217.0, 2236629909504.0], ['2024-05-28T12:59:19Z', 1, 431440734.0, 2223930.0, 5.29, 711246584217.0, 2236629909504.0], ['2024-05-28T12:59:09Z', 1, 431367006.0, 2223930.0, 5.29, 711246584217.0, 2236629909504.0], ['2024-05-28T12:58:59Z', 1, 425567070.0, 2223930.0, 5.29, 711246584217.0, 2236629909504.0], ['2024-05-28T12:58:49Z', 1, 425435998.0, 2223930.0, 5.29, 711246584217.0, 2236629909504.0]], granularity=None, object_ids=[1], prop_list=['timestamp', 'object_id', 'Capacity,logical_space_in_use', 'Capacity,physical_space_in_use', 'Capacity,drr', 'Capacity,physical_space', 'Capacity,logical_space']) May 28 12:59:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] --- [GET] https://127.0.0.1:40443/api/monitors/ad_hoc_query/: Done May 28 12:59:47 l75lg1-v1 manila-share[98474]: DEBUG manila.share.driver [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] Updating share stats. {{(pid=98474) _update_share_stats /opt/stack/manila/manila/share/driver.py:1326}} May 28 12:59:47 l75lg1-v1 manila-share[98474]: DEBUG oslo_service.periodic_task [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] Running periodic task ShareManager.create_backup_continue {{(pid=98474) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:59:47 l75lg1-v1 manila-share[98474]: DEBUG oslo_service.periodic_task [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] Running periodic task ShareManager.restore_backup_continue {{(pid=98474) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:59:47 l75lg1-v1 manila-share[98474]: DEBUG oslo_service.periodic_task [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] Running periodic task ShareManager.periodic_share_status_update {{(pid=98474) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:59:47 l75lg1-v1 manila-share[98474]: DEBUG manila.share.manager [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] Updating status of share instances. {{(pid=98474) periodic_share_status_update /opt/stack/manila/manila/share/manager.py:5475}} May 28 12:59:48 l75lg1-v1 dstat.sh[49771]: 28-05 12:59:48| 2 0 97 0 0|5741M 1724M 277M 7882M| 18k 919B| 0 591k| 0 45.0 |2111 3147 |0.99 1.03 1.00|1.0 1.0 2.0| 0 0 | 0 2048M| 29 363 0 26 0 May 28 12:59:48 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9e862c6b-9e72-442f-b15f-ddb768c3334e tempest-ResourceLockNegativeTestWithShares-789426285 None] <<< [DELETE] https://127.0.0.1:40443/api/viewpolicies/37/ May 28 12:59:48 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9e862c6b-9e72-442f-b15f-ddb768c3334e tempest-ResourceLockNegativeTestWithShares-789426285 None] --- [DELETE] https://127.0.0.1:40443/api/viewpolicies/37/: Done May 28 12:59:48 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-9e862c6b-9e72-442f-b15f-ddb768c3334e tempest-ResourceLockNegativeTestWithShares-789426285 None] Created reservations ['138a8866-a45d-441a-9879-0e77ed3c92d5', '804e8571-10e2-4cff-84a7-ac56ebfce59a', '6e4f37ff-e68b-4ffc-a8b0-a8e30af1ab2a', '75ab4594-47a7-47fd-a530-f8e576331e6f'] {{(pid=98474) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 12:59:48 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-9e862c6b-9e72-442f-b15f-ddb768c3334e tempest-ResourceLockNegativeTestWithShares-789426285 None] Committed reservations ['138a8866-a45d-441a-9879-0e77ed3c92d5', '804e8571-10e2-4cff-84a7-ac56ebfce59a', '6e4f37ff-e68b-4ffc-a8b0-a8e30af1ab2a', '75ab4594-47a7-47fd-a530-f8e576331e6f'] {{(pid=98474) commit /opt/stack/manila/manila/quota.py:1063}} May 28 12:59:48 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f00cabcb-e006-4e5f-b659-9d36127b4944 tempest-ShareIpRulesForNFSTest-1748669711 None] <<< [DELETE] https://127.0.0.1:40443/api/viewpolicies/21/ May 28 12:59:48 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f00cabcb-e006-4e5f-b659-9d36127b4944 tempest-ShareIpRulesForNFSTest-1748669711 None] --- [DELETE] https://127.0.0.1:40443/api/viewpolicies/21/: Done May 28 12:59:48 l75lg1-v1 manila-share[98474]: INFO manila.share.manager [None req-9e862c6b-9e72-442f-b15f-ddb768c3334e tempest-ResourceLockNegativeTestWithShares-789426285 None] Share instance f1a7f25a-f865-4592-93e1-c1e62b2447b8: deleted successfully. May 28 12:59:48 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-f00cabcb-e006-4e5f-b659-9d36127b4944 tempest-ShareIpRulesForNFSTest-1748669711 None] Created reservations ['ad1e2f07-4b7a-43d8-a8d7-fc549fe8b56d', 'f7fd8d35-0f73-430e-847f-7234ed2449d6', '67bf6288-6b28-4235-940c-df3ff89a9682', '724b7875-0a2d-468a-833f-503e01d90848'] {{(pid=98474) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 12:59:48 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-f00cabcb-e006-4e5f-b659-9d36127b4944 tempest-ShareIpRulesForNFSTest-1748669711 None] Committed reservations ['ad1e2f07-4b7a-43d8-a8d7-fc549fe8b56d', 'f7fd8d35-0f73-430e-847f-7234ed2449d6', '67bf6288-6b28-4235-940c-df3ff89a9682', '724b7875-0a2d-468a-833f-503e01d90848'] {{(pid=98474) commit /opt/stack/manila/manila/quota.py:1063}} May 28 12:59:48 l75lg1-v1 manila-share[98474]: INFO manila.share.manager [None req-f00cabcb-e006-4e5f-b659-9d36127b4944 tempest-ShareIpRulesForNFSTest-1748669711 None] Share instance b7a7d61c-2cea-442a-9809-507038e080d5: deleted successfully. May 28 12:59:48 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-eef0c28b-14f8-4c78-aec8-35368c14e10b tempest-ResourceLockDeleteTest-1157183439 tempest-ResourceLockDeleteTest-1157183439-project-member] GET http://10.27.203.238/share/v2/645fb190404541a78e449c703540d6f8/shares/ed309fc1-d1ff-4352-a44a-a56b44eb8d0e May 28 12:59:48 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-eef0c28b-14f8-4c78-aec8-35368c14e10b tempest-ResourceLockDeleteTest-1157183439 tempest-ResourceLockDeleteTest-1157183439-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:48 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-eef0c28b-14f8-4c78-aec8-35368c14e10b tempest-ResourceLockDeleteTest-1157183439 tempest-ResourceLockDeleteTest-1157183439-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:48 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-eef0c28b-14f8-4c78-aec8-35368c14e10b tempest-ResourceLockDeleteTest-1157183439 tempest-ResourceLockDeleteTest-1157183439-project-member] HTTP exception thrown: The resource could not be found. May 28 12:59:48 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-eef0c28b-14f8-4c78-aec8-35368c14e10b tempest-ResourceLockDeleteTest-1157183439 tempest-ResourceLockDeleteTest-1157183439-project-member] http://10.27.203.238/share/v2/645fb190404541a78e449c703540d6f8/shares/ed309fc1-d1ff-4352-a44a-a56b44eb8d0e returned with HTTP 404 May 28 12:59:48 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 787/1559] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:59:48 2024] GET /share/v2/645fb190404541a78e449c703540d6f8/shares/ed309fc1-d1ff-4352-a44a-a56b44eb8d0e => generated 78 bytes in 12 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 12:59:48 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-f57f5363-eb6b-4c6d-bbc1-f8eebb262912 tempest-ResourceLockDeleteTest-671583867 tempest-ResourceLockDeleteTest-671583867-project-admin] DELETE http://10.27.203.238/share/v2/16bb859669ab42a3b7cc595a5e30eb2e/types/305c3f64-cb34-4ade-92bf-ec56ac8e48be May 28 12:59:48 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-f57f5363-eb6b-4c6d-bbc1-f8eebb262912 tempest-ResourceLockDeleteTest-671583867 tempest-ResourceLockDeleteTest-671583867-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:48 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-f57f5363-eb6b-4c6d-bbc1-f8eebb262912 tempest-ResourceLockDeleteTest-671583867 tempest-ResourceLockDeleteTest-671583867-project-admin] Calling method 'ShareTypesController._delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:48 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-77551ec4-f7d8-4f99-bff2-2a0f4e05d528 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] <<< [PATCH] https://127.0.0.1:40443/api/viewpolicies/32/ May 28 12:59:48 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-77551ec4-f7d8-4f99-bff2-2a0f4e05d528 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=1, created='2024-05-28T12:58:43.845440Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='31b6534b-d142-4561-992f-4f0759db302d', id=32, internal=False, is_s3_default_policy=False, name='7fdd602c-79d0-479c-95a2-336b202c6639', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=['*'], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=[], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=[], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='MODIFYING', sync_time='2024-05-28T12:59:48.283675Z', tenant_id=1, tenant_name='default', title='7fdd602c-79d0-479c-95a2-336b202c6639', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/32/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[]) May 28 12:59:48 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-77551ec4-f7d8-4f99-bff2-2a0f4e05d528 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] --- [PATCH] https://127.0.0.1:40443/api/viewpolicies/32/: Done May 28 12:59:48 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-f57f5363-eb6b-4c6d-bbc1-f8eebb262912 tempest-ResourceLockDeleteTest-671583867 tempest-ResourceLockDeleteTest-671583867-project-admin] http://10.27.203.238/share/v2/16bb859669ab42a3b7cc595a5e30eb2e/types/305c3f64-cb34-4ade-92bf-ec56ac8e48be returned with HTTP 202 May 28 12:59:48 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 773/1560] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:59:48 2024] DELETE /share/v2/16bb859669ab42a3b7cc595a5e30eb2e/types/305c3f64-cb34-4ade-92bf-ec56ac8e48be => generated 0 bytes in 50 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:59:48 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-77551ec4-f7d8-4f99-bff2-2a0f4e05d528 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:48 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-77551ec4-f7d8-4f99-bff2-2a0f4e05d528 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:48 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-616c2d18-c383-4f60-be64-1e1d4e42ae25 tempest-ResourceLockDeleteTest-671583867 tempest-ResourceLockDeleteTest-671583867-project-admin] GET http://10.27.203.238/share/v2/16bb859669ab42a3b7cc595a5e30eb2e/types/305c3f64-cb34-4ade-92bf-ec56ac8e48be May 28 12:59:48 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-616c2d18-c383-4f60-be64-1e1d4e42ae25 tempest-ResourceLockDeleteTest-671583867 tempest-ResourceLockDeleteTest-671583867-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:48 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-616c2d18-c383-4f60-be64-1e1d4e42ae25 tempest-ResourceLockDeleteTest-671583867 tempest-ResourceLockDeleteTest-671583867-project-admin] Calling method 'ShareTypesController.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:48 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-616c2d18-c383-4f60-be64-1e1d4e42ae25 tempest-ResourceLockDeleteTest-671583867 tempest-ResourceLockDeleteTest-671583867-project-admin] HTTP exception thrown: Share type not found. May 28 12:59:48 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-616c2d18-c383-4f60-be64-1e1d4e42ae25 tempest-ResourceLockDeleteTest-671583867 tempest-ResourceLockDeleteTest-671583867-project-admin] http://10.27.203.238/share/v2/16bb859669ab42a3b7cc595a5e30eb2e/types/305c3f64-cb34-4ade-92bf-ec56ac8e48be returned with HTTP 404 May 28 12:59:48 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 788/1561] 10.27.203.238 () {64 vars in 1448 bytes} [Tue May 28 12:59:48 2024] GET /share/v2/16bb859669ab42a3b7cc595a5e30eb2e/types/305c3f64-cb34-4ade-92bf-ec56ac8e48be => generated 67 bytes in 10 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 12:59:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d604bf8-33bd-4b8a-8e5f-ac6959f78705 tempest-ShareIpRulesForNFSTest-2105398077 tempest-ShareIpRulesForNFSTest-2105398077-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:48 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-ced63988-7df0-4a32-9bb1-78e66f52a02b tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] GET http://10.27.203.238/share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/messages May 28 12:59:48 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-9d604bf8-33bd-4b8a-8e5f-ac6959f78705 tempest-ShareIpRulesForNFSTest-2105398077 tempest-ShareIpRulesForNFSTest-2105398077-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:59:48 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-ced63988-7df0-4a32-9bb1-78e66f52a02b tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:48 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-ced63988-7df0-4a32-9bb1-78e66f52a02b tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:48 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.message.api [None req-ced63988-7df0-4a32-9bb1-78e66f52a02b tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Searching for messages by: MultiDict([]) {{(pid=98330) get_all /opt/stack/manila/manila/message/api.py:78}} May 28 12:59:48 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-ced63988-7df0-4a32-9bb1-78e66f52a02b tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] http://10.27.203.238/share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/messages returned with HTTP 200 May 28 12:59:48 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 774/1562] 10.27.203.238 () {64 vars in 1346 bytes} [Tue May 28 12:59:48 2024] GET /share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/messages => generated 5621 bytes in 12 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:59:48 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-e4b8b669-c1d4-4a3e-8069-ddad50364337 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] GET http://10.27.203.238/share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/messages?sort_key=resource_id&sort_dir=asc&limit=2 May 28 12:59:48 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-e4b8b669-c1d4-4a3e-8069-ddad50364337 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:48 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-e4b8b669-c1d4-4a3e-8069-ddad50364337 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:48 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.message.api [None req-e4b8b669-c1d4-4a3e-8069-ddad50364337 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Searching for messages by: MultiDict([('limit', '2')]) {{(pid=98329) get_all /opt/stack/manila/manila/message/api.py:78}} May 28 12:59:48 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-e4b8b669-c1d4-4a3e-8069-ddad50364337 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] http://10.27.203.238/share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/messages?sort_key=resource_id&sort_dir=asc&limit=2 returned with HTTP 200 May 28 12:59:48 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 789/1563] 10.27.203.238 () {64 vars in 1429 bytes} [Tue May 28 12:59:48 2024] GET /share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/messages?sort_key=resource_id&sort_dir=asc&limit=2 => generated 1822 bytes in 12 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:59:49 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-6a166bd5-4ff1-4fbc-b9bb-57ac6809ada5 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] DELETE http://10.27.203.238/share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/shares/8b1f3a6c-ac54-4c87-a5e9-f2b895b72f8c May 28 12:59:49 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-6a166bd5-4ff1-4fbc-b9bb-57ac6809ada5 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:49 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-6a166bd5-4ff1-4fbc-b9bb-57ac6809ada5 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Calling method 'ShareMixin.delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:49 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.v1.shares [None req-6a166bd5-4ff1-4fbc-b9bb-57ac6809ada5 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Delete share with id: 8b1f3a6c-ac54-4c87-a5e9-f2b895b72f8c May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d604bf8-33bd-4b8a-8e5f-ac6959f78705 tempest-ShareIpRulesForNFSTest-2105398077 tempest-ShareIpRulesForNFSTest-2105398077-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:49 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-77551ec4-f7d8-4f99-bff2-2a0f4e05d528 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.057s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:49 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-77551ec4-f7d8-4f99-bff2-2a0f4e05d528 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:49 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-77551ec4-f7d8-4f99-bff2-2a0f4e05d528 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:49 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-77551ec4-f7d8-4f99-bff2-2a0f4e05d528 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:49 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-77551ec4-f7d8-4f99-bff2-2a0f4e05d528 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:49 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-77551ec4-f7d8-4f99-bff2-2a0f4e05d528 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:49 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-77551ec4-f7d8-4f99-bff2-2a0f4e05d528 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.004s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:49 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-77551ec4-f7d8-4f99-bff2-2a0f4e05d528 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:49 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-77551ec4-f7d8-4f99-bff2-2a0f4e05d528 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:49 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-77551ec4-f7d8-4f99-bff2-2a0f4e05d528 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:49 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-77551ec4-f7d8-4f99-bff2-2a0f4e05d528 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:49 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-77551ec4-f7d8-4f99-bff2-2a0f4e05d528 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6d915e-d50d-436b-90d1-8d90f55810fc None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6d915e-d50d-436b-90d1-8d90f55810fc None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6d915e-d50d-436b-90d1-8d90f55810fc None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6d915e-d50d-436b-90d1-8d90f55810fc None admin] PATH_INFO: `/v3/users/5ca41d036f8a486ea8febc1bc0fe8768` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6d915e-d50d-436b-90d1-8d90f55810fc None admin] RBAC: Authorizing `identity:delete_user(user_id=5ca41d036f8a486ea8febc1bc0fe8768)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6d915e-d50d-436b-90d1-8d90f55810fc None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:49 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-77551ec4-f7d8-4f99-bff2-2a0f4e05d528 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.053s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:49 l75lg1-v1 manila-share[98474]: INFO manila.share.access [None req-77551ec4-f7d8-4f99-bff2-2a0f4e05d528 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Access rules were successfully modified for share instance 7fdd602c-79d0-479c-95a2-336b202c6639 belonging to share 72db8769-ece7-42ff-af27-2e778292a9b4. May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-ea6d915e-d50d-436b-90d1-8d90f55810fc None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ca41d036f8a486ea8febc1bc0fe8768', 'request_id': 'req-ea6d915e-d50d-436b-90d1-8d90f55810fc'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-ea6d915e-d50d-436b-90d1-8d90f55810fc None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ca41d036f8a486ea8febc1bc0fe8768', 'request_id': 'req-ea6d915e-d50d-436b-90d1-8d90f55810fc'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-ea6d915e-d50d-436b-90d1-8d90f55810fc None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ca41d036f8a486ea8febc1bc0fe8768', 'request_id': 'req-ea6d915e-d50d-436b-90d1-8d90f55810fc'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-ea6d915e-d50d-436b-90d1-8d90f55810fc None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ca41d036f8a486ea8febc1bc0fe8768', 'request_id': 'req-ea6d915e-d50d-436b-90d1-8d90f55810fc'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-ea6d915e-d50d-436b-90d1-8d90f55810fc None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ca41d036f8a486ea8febc1bc0fe8768', 'request_id': 'req-ea6d915e-d50d-436b-90d1-8d90f55810fc'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:49 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-a00f1e19-3c93-4d58-b32a-9a290d8ec934 tempest-ResourceLockNegativeTestWithShares-789426285 tempest-ResourceLockNegativeTestWithShares-789426285-project-member] GET http://10.27.203.238/share/v2/86e4aff17ad94d75a624b038464bfeb2/shares/a5984861-5086-4848-82ce-0960e763197b May 28 12:59:49 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-a00f1e19-3c93-4d58-b32a-9a290d8ec934 tempest-ResourceLockNegativeTestWithShares-789426285 tempest-ResourceLockNegativeTestWithShares-789426285-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:49 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-a00f1e19-3c93-4d58-b32a-9a290d8ec934 tempest-ResourceLockNegativeTestWithShares-789426285 tempest-ResourceLockNegativeTestWithShares-789426285-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1255/2535] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 12:59:48 2024] DELETE /identity/v3/users/5ca41d036f8a486ea8febc1bc0fe8768 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:59:49 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-a00f1e19-3c93-4d58-b32a-9a290d8ec934 tempest-ResourceLockNegativeTestWithShares-789426285 tempest-ResourceLockNegativeTestWithShares-789426285-project-member] HTTP exception thrown: The resource could not be found. May 28 12:59:49 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-a00f1e19-3c93-4d58-b32a-9a290d8ec934 tempest-ResourceLockNegativeTestWithShares-789426285 tempest-ResourceLockNegativeTestWithShares-789426285-project-member] http://10.27.203.238/share/v2/86e4aff17ad94d75a624b038464bfeb2/shares/a5984861-5086-4848-82ce-0960e763197b returned with HTTP 404 May 28 12:59:49 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 790/1564] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:59:49 2024] GET /share/v2/86e4aff17ad94d75a624b038464bfeb2/shares/a5984861-5086-4848-82ce-0960e763197b => generated 78 bytes in 13 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d43ab01-fdd2-4c3f-9db1-bddb99600c23 tempest-ShareIpRulesForNFSTest-2105398077 tempest-ShareIpRulesForNFSTest-2105398077-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d43ab01-fdd2-4c3f-9db1-bddb99600c23 tempest-ShareIpRulesForNFSTest-2105398077 tempest-ShareIpRulesForNFSTest-2105398077-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:49 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-3e13609c-9b2f-46d4-bccf-b84b8441ce9e tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] DELETE http://10.27.203.238/share/v2/1c8bc02239694668aa5810b9e0fc29f3/types/b2679f2f-05f6-4d90-aef6-3a564ca7c99b May 28 12:59:49 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-3e13609c-9b2f-46d4-bccf-b84b8441ce9e tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:49 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-3e13609c-9b2f-46d4-bccf-b84b8441ce9e tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] Calling method 'ShareTypesController._delete' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4af409-1e0d-4b2e-8d82-fc8888894d28 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4af409-1e0d-4b2e-8d82-fc8888894d28 None admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4af409-1e0d-4b2e-8d82-fc8888894d28 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4af409-1e0d-4b2e-8d82-fc8888894d28 None admin] PATH_INFO: `/v3/users/f7889fe089c24eb495303b272012c99b` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4af409-1e0d-4b2e-8d82-fc8888894d28 None admin] RBAC: Authorizing `identity:delete_user(user_id=f7889fe089c24eb495303b272012c99b)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4af409-1e0d-4b2e-8d82-fc8888894d28 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:49 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-3e13609c-9b2f-46d4-bccf-b84b8441ce9e tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] http://10.27.203.238/share/v2/1c8bc02239694668aa5810b9e0fc29f3/types/b2679f2f-05f6-4d90-aef6-3a564ca7c99b returned with HTTP 202 May 28 12:59:49 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 791/1565] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:59:49 2024] DELETE /share/v2/1c8bc02239694668aa5810b9e0fc29f3/types/b2679f2f-05f6-4d90-aef6-3a564ca7c99b => generated 0 bytes in 70 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:59:49 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-9d3b2536-1b53-409d-adad-487ca00869c4 tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] GET http://10.27.203.238/share/v2/1c8bc02239694668aa5810b9e0fc29f3/types/b2679f2f-05f6-4d90-aef6-3a564ca7c99b May 28 12:59:49 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-9d3b2536-1b53-409d-adad-487ca00869c4 tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:49 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-9d3b2536-1b53-409d-adad-487ca00869c4 tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] Calling method 'ShareTypesController.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:49 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-9d3b2536-1b53-409d-adad-487ca00869c4 tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] HTTP exception thrown: Share type not found. May 28 12:59:49 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-9d3b2536-1b53-409d-adad-487ca00869c4 tempest-ResourceLockNegativeTestWithShares-327943796 tempest-ResourceLockNegativeTestWithShares-327943796-project-admin] http://10.27.203.238/share/v2/1c8bc02239694668aa5810b9e0fc29f3/types/b2679f2f-05f6-4d90-aef6-3a564ca7c99b returned with HTTP 404 May 28 12:59:49 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 792/1566] 10.27.203.238 () {64 vars in 1448 bytes} [Tue May 28 12:59:49 2024] GET /share/v2/1c8bc02239694668aa5810b9e0fc29f3/types/b2679f2f-05f6-4d90-aef6-3a564ca7c99b => generated 67 bytes in 11 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 12:59:49 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.quota [None req-6a166bd5-4ff1-4fbc-b9bb-57ac6809ada5 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Created reservations ['60576eb4-b681-49f3-9022-eaad8a69f5af', 'b077a9ba-aca5-496a-9ef5-a77092047212', '07a17226-ae9b-4ba5-8c8d-7d996908ece2', '478f1141-d617-4fcd-9899-aa79b584dc36'] {{(pid=98330) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6d915e-d50d-436b-90d1-8d90f55810fc None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-ea6d915e-d50d-436b-90d1-8d90f55810fc None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-cf4af409-1e0d-4b2e-8d82-fc8888894d28 None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7889fe089c24eb495303b272012c99b', 'request_id': 'req-cf4af409-1e0d-4b2e-8d82-fc8888894d28'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6d915e-d50d-436b-90d1-8d90f55810fc None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-cf4af409-1e0d-4b2e-8d82-fc8888894d28 None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7889fe089c24eb495303b272012c99b', 'request_id': 'req-cf4af409-1e0d-4b2e-8d82-fc8888894d28'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-cf4af409-1e0d-4b2e-8d82-fc8888894d28 None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7889fe089c24eb495303b272012c99b', 'request_id': 'req-cf4af409-1e0d-4b2e-8d82-fc8888894d28'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-cf4af409-1e0d-4b2e-8d82-fc8888894d28 None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7889fe089c24eb495303b272012c99b', 'request_id': 'req-cf4af409-1e0d-4b2e-8d82-fc8888894d28'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:49 l75lg1-v1 dstat.sh[49771]: 28-05 12:59:49| 9 1 87 2 0|5741M 1724M 277M 7883M| 17k 198B| 0 2013k| 0 340 |6072 11k|0.99 1.03 1.00|2.0 2.0 0| 0 0 | 0 2048M| 29 366 0 27 0 May 28 12:59:49 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.quota [None req-6a166bd5-4ff1-4fbc-b9bb-57ac6809ada5 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Committed reservations ['60576eb4-b681-49f3-9022-eaad8a69f5af', 'b077a9ba-aca5-496a-9ef5-a77092047212', '07a17226-ae9b-4ba5-8c8d-7d996908ece2', '478f1141-d617-4fcd-9899-aa79b584dc36'] {{(pid=98330) commit /opt/stack/manila/manila/quota.py:1063}} May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb0369c-65c8-4db2-ac37-9a32689051fe None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-cf4af409-1e0d-4b2e-8d82-fc8888894d28 None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7889fe089c24eb495303b272012c99b', 'request_id': 'req-cf4af409-1e0d-4b2e-8d82-fc8888894d28'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb0369c-65c8-4db2-ac37-9a32689051fe None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb0369c-65c8-4db2-ac37-9a32689051fe None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb0369c-65c8-4db2-ac37-9a32689051fe None admin] PATH_INFO: `/v3/users/00d8f965a4b14713996fc0c79279060e` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb0369c-65c8-4db2-ac37-9a32689051fe None admin] RBAC: Authorizing `identity:delete_user(user_id=00d8f965a4b14713996fc0c79279060e)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb0369c-65c8-4db2-ac37-9a32689051fe None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:49 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-6a166bd5-4ff1-4fbc-b9bb-57ac6809ada5 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] http://10.27.203.238/share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/shares/8b1f3a6c-ac54-4c87-a5e9-f2b895b72f8c returned with HTTP 202 May 28 12:59:49 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 775/1567] 10.27.203.238 () {64 vars in 1454 bytes} [Tue May 28 12:59:48 2024] DELETE /share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/shares/8b1f3a6c-ac54-4c87-a5e9-f2b895b72f8c => generated 0 bytes in 269 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1281/2536] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 12:59:49 2024] DELETE /identity/v3/users/f7889fe089c24eb495303b272012c99b => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4af409-1e0d-4b2e-8d82-fc8888894d28 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:49 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-bad7d836-392f-4e29-a275-6bd703cceaad tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] DELETE http://10.27.203.238/share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/shares/9154359e-259b-4835-9888-c3df80cb12bd May 28 12:59:49 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-bad7d836-392f-4e29-a275-6bd703cceaad tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-cf4af409-1e0d-4b2e-8d82-fc8888894d28 None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:59:49 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-bad7d836-392f-4e29-a275-6bd703cceaad tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Calling method 'ShareMixin.delete' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:49 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.v1.shares [None req-bad7d836-392f-4e29-a275-6bd703cceaad tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Delete share with id: 9154359e-259b-4835-9888-c3df80cb12bd May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4af409-1e0d-4b2e-8d82-fc8888894d28 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4a8210-b61b-40af-acbe-49e479431f73 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4a8210-b61b-40af-acbe-49e479431f73 None admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4a8210-b61b-40af-acbe-49e479431f73 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4a8210-b61b-40af-acbe-49e479431f73 None admin] PATH_INFO: `/v3/users/caee34cb460c4ddcb13e607cbd3fabd9` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4a8210-b61b-40af-acbe-49e479431f73 None admin] RBAC: Authorizing `identity:delete_user(user_id=caee34cb460c4ddcb13e607cbd3fabd9)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4a8210-b61b-40af-acbe-49e479431f73 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-bcb0369c-65c8-4db2-ac37-9a32689051fe None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00d8f965a4b14713996fc0c79279060e', 'request_id': 'req-bcb0369c-65c8-4db2-ac37-9a32689051fe'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-bcb0369c-65c8-4db2-ac37-9a32689051fe None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00d8f965a4b14713996fc0c79279060e', 'request_id': 'req-bcb0369c-65c8-4db2-ac37-9a32689051fe'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:49 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-c447cf87-698f-4291-a998-5da423e31f08 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] GET http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/share-access-rules?share_id=72db8769-ece7-42ff-af27-2e778292a9b4 May 28 12:59:49 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-c447cf87-698f-4291-a998-5da423e31f08 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:49 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-c447cf87-698f-4291-a998-5da423e31f08 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-bcb0369c-65c8-4db2-ac37-9a32689051fe None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00d8f965a4b14713996fc0c79279060e', 'request_id': 'req-bcb0369c-65c8-4db2-ac37-9a32689051fe'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-bcb0369c-65c8-4db2-ac37-9a32689051fe None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00d8f965a4b14713996fc0c79279060e', 'request_id': 'req-bcb0369c-65c8-4db2-ac37-9a32689051fe'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-bcb0369c-65c8-4db2-ac37-9a32689051fe None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00d8f965a4b14713996fc0c79279060e', 'request_id': 'req-bcb0369c-65c8-4db2-ac37-9a32689051fe'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1256/2537] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 12:59:49 2024] DELETE /identity/v3/users/00d8f965a4b14713996fc0c79279060e => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb0369c-65c8-4db2-ac37-9a32689051fe None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-bcb0369c-65c8-4db2-ac37-9a32689051fe None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:59:49 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.lock.api [None req-c447cf87-698f-4291-a998-5da423e31f08 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Searching for locks by: {'resource_id': '571b2898-66b3-497d-944f-2c7e5223dd6b', 'resource_action': 'show', 'resource_type': 'access_rule'} {{(pid=98330) get_all /opt/stack/manila/manila/lock/api.py:112}} May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-ba4a8210-b61b-40af-acbe-49e479431f73 None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'caee34cb460c4ddcb13e607cbd3fabd9', 'request_id': 'req-ba4a8210-b61b-40af-acbe-49e479431f73'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:49 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-c447cf87-698f-4291-a998-5da423e31f08 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/share-access-rules?share_id=72db8769-ece7-42ff-af27-2e778292a9b4 returned with HTTP 200 May 28 12:59:49 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 776/1568] 10.27.203.238 () {64 vars in 1467 bytes} [Tue May 28 12:59:49 2024] GET /share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/share-access-rules?share_id=72db8769-ece7-42ff-af27-2e778292a9b4 => generated 282 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-ba4a8210-b61b-40af-acbe-49e479431f73 None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'caee34cb460c4ddcb13e607cbd3fabd9', 'request_id': 'req-ba4a8210-b61b-40af-acbe-49e479431f73'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-ba4a8210-b61b-40af-acbe-49e479431f73 None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'caee34cb460c4ddcb13e607cbd3fabd9', 'request_id': 'req-ba4a8210-b61b-40af-acbe-49e479431f73'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-ba4a8210-b61b-40af-acbe-49e479431f73 None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'caee34cb460c4ddcb13e607cbd3fabd9', 'request_id': 'req-ba4a8210-b61b-40af-acbe-49e479431f73'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:49 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-300ca8f0-b0b7-407b-935e-5bb0363925b9 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] POST http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action May 28 12:59:49 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-300ca8f0-b0b7-407b-935e-5bb0363925b9 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Action body: b'{"allow_access": {"access_type": "ip", "access_to": "10.10.30.40/32", "access_level": null}}' {{(pid=98330) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:59:49 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-300ca8f0-b0b7-407b-935e-5bb0363925b9 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Action: 'action', calling method: ShareController.allow_access, body: {"allow_access": {"access_type": "ip", "access_to": "10.10.30.40/32", "access_level": null}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb0369c-65c8-4db2-ac37-9a32689051fe None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-ba4a8210-b61b-40af-acbe-49e479431f73 None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'caee34cb460c4ddcb13e607cbd3fabd9', 'request_id': 'req-ba4a8210-b61b-40af-acbe-49e479431f73'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1282/2538] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 12:59:49 2024] DELETE /identity/v3/users/caee34cb460c4ddcb13e607cbd3fabd9 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7379feb5-f406-440b-8b42-d117e4c6133f None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7379feb5-f406-440b-8b42-d117e4c6133f None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7379feb5-f406-440b-8b42-d117e4c6133f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:49 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-300ca8f0-b0b7-407b-935e-5bb0363925b9 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] HTTP exception thrown: Share access ip:10.10.30.40/32 exists. May 28 12:59:49 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-300ca8f0-b0b7-407b-935e-5bb0363925b9 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action returned with HTTP 400 May 28 12:59:49 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 777/1569] 10.27.203.238 () {66 vars in 1493 bytes} [Tue May 28 12:59:49 2024] POST /share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action => generated 82 bytes in 41 msecs (HTTP/1.1 400) 6 headers in 239 bytes (2 switches on core 0) May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-7379feb5-f406-440b-8b42-d117e4c6133f None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd67ead3-76e9-40dd-94a3-9eec5afde7ea None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-7379feb5-f406-440b-8b42-d117e4c6133f None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd67ead3-76e9-40dd-94a3-9eec5afde7ea None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd67ead3-76e9-40dd-94a3-9eec5afde7ea None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd67ead3-76e9-40dd-94a3-9eec5afde7ea None admin] PATH_INFO: `/v3/users/78f09898a9d348a1be1b598fd55a1cc0` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-7379feb5-f406-440b-8b42-d117e4c6133f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd67ead3-76e9-40dd-94a3-9eec5afde7ea None admin] RBAC: Authorizing `identity:delete_user(user_id=78f09898a9d348a1be1b598fd55a1cc0)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:49 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-33afef9c-fd9a-4187-892b-c73ac1d1c37c tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] POST http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action May 28 12:59:49 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-33afef9c-fd9a-4187-892b-c73ac1d1c37c tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Action body: b'{"allow_access": {"access_type": "ip", "access_to": "10.10.30.40", "access_level": null}}' {{(pid=98330) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd67ead3-76e9-40dd-94a3-9eec5afde7ea None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:49 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-33afef9c-fd9a-4187-892b-c73ac1d1c37c tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Action: 'action', calling method: ShareController.allow_access, body: {"allow_access": {"access_type": "ip", "access_to": "10.10.30.40", "access_level": null}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1283/2539] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:59:49 2024] POST /identity/v3/auth/tokens => generated 2960 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 28 12:59:49 l75lg1-v1 neutron-server[77619]: DEBUG neutron.wsgi [-] (77619) accepted ('10.27.203.238', 44334) {{(pid=77619) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7379feb5-f406-440b-8b42-d117e4c6133f None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-7379feb5-f406-440b-8b42-d117e4c6133f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:59:49 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-33afef9c-fd9a-4187-892b-c73ac1d1c37c tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] HTTP exception thrown: Share access ip:10.10.30.40 exists. May 28 12:59:49 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-33afef9c-fd9a-4187-892b-c73ac1d1c37c tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action returned with HTTP 400 May 28 12:59:49 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 778/1570] 10.27.203.238 () {66 vars in 1493 bytes} [Tue May 28 12:59:49 2024] POST /share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action => generated 79 bytes in 43 msecs (HTTP/1.1 400) 6 headers in 239 bytes (2 switches on core 0) May 28 12:59:49 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-ed0a7819-4d25-4529-a43e-03a7ee4ac7c2 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] POST http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action May 28 12:59:49 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-ed0a7819-4d25-4529-a43e-03a7ee4ac7c2 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Action body: b'{"deny_access": {"access_id": "571b2898-66b3-497d-944f-2c7e5223dd6b"}}' {{(pid=98330) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:59:49 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-ed0a7819-4d25-4529-a43e-03a7ee4ac7c2 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Action: 'action', calling method: ShareController.deny_access, body: {"deny_access": {"access_id": "571b2898-66b3-497d-944f-2c7e5223dd6b"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:59:49 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.lock.api [None req-ed0a7819-4d25-4529-a43e-03a7ee4ac7c2 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Searching for locks by: {'resource_id': '571b2898-66b3-497d-944f-2c7e5223dd6b', 'resource_action': 'delete'} {{(pid=98330) get_all /opt/stack/manila/manila/lock/api.py:112}} May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-fd67ead3-76e9-40dd-94a3-9eec5afde7ea None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78f09898a9d348a1be1b598fd55a1cc0', 'request_id': 'req-fd67ead3-76e9-40dd-94a3-9eec5afde7ea'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-fd67ead3-76e9-40dd-94a3-9eec5afde7ea None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78f09898a9d348a1be1b598fd55a1cc0', 'request_id': 'req-fd67ead3-76e9-40dd-94a3-9eec5afde7ea'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-fd67ead3-76e9-40dd-94a3-9eec5afde7ea None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78f09898a9d348a1be1b598fd55a1cc0', 'request_id': 'req-fd67ead3-76e9-40dd-94a3-9eec5afde7ea'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:49 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.quota [None req-bad7d836-392f-4e29-a275-6bd703cceaad tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Created reservations ['8811d67e-8ecf-4591-a4e2-f06796264fb3', '52605d76-c926-439f-891c-841b670d0d23', 'f31b8e21-65e2-48bb-89a1-514075d48a9b', '56391f91-603c-4ca6-8485-28ed23eef1bb'] {{(pid=98329) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-fd67ead3-76e9-40dd-94a3-9eec5afde7ea None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78f09898a9d348a1be1b598fd55a1cc0', 'request_id': 'req-fd67ead3-76e9-40dd-94a3-9eec5afde7ea'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-fd67ead3-76e9-40dd-94a3-9eec5afde7ea None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78f09898a9d348a1be1b598fd55a1cc0', 'request_id': 'req-fd67ead3-76e9-40dd-94a3-9eec5afde7ea'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7379feb5-f406-440b-8b42-d117e4c6133f None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:49 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.quota [None req-bad7d836-392f-4e29-a275-6bd703cceaad tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Committed reservations ['8811d67e-8ecf-4591-a4e2-f06796264fb3', '52605d76-c926-439f-891c-841b670d0d23', 'f31b8e21-65e2-48bb-89a1-514075d48a9b', '56391f91-603c-4ca6-8485-28ed23eef1bb'] {{(pid=98329) commit /opt/stack/manila/manila/quota.py:1063}} May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1257/2540] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 12:59:49 2024] DELETE /identity/v3/users/78f09898a9d348a1be1b598fd55a1cc0 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd67ead3-76e9-40dd-94a3-9eec5afde7ea None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-fd67ead3-76e9-40dd-94a3-9eec5afde7ea None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:59:49 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-bad7d836-392f-4e29-a275-6bd703cceaad tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] http://10.27.203.238/share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/shares/9154359e-259b-4835-9888-c3df80cb12bd returned with HTTP 202 May 28 12:59:49 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 793/1571] 10.27.203.238 () {64 vars in 1454 bytes} [Tue May 28 12:59:49 2024] DELETE /share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/shares/9154359e-259b-4835-9888-c3df80cb12bd => generated 0 bytes in 234 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:59:49 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-2fada9e6-9719-4554-b9f7-1891ec2be8ee tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] DELETE http://10.27.203.238/share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/shares/8c461c9a-d030-496e-b267-c05fe4731b2f May 28 12:59:49 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-2fada9e6-9719-4554-b9f7-1891ec2be8ee tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:49 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-2fada9e6-9719-4554-b9f7-1891ec2be8ee tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Calling method 'ShareMixin.delete' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:49 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.v1.shares [None req-2fada9e6-9719-4554-b9f7-1891ec2be8ee tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Delete share with id: 8c461c9a-d030-496e-b267-c05fe4731b2f May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2260eee-8b35-427b-8442-36b27d926bab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef17047035e4b518fd5360a01f2da1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2260eee-8b35-427b-8442-36b27d926bab service neutron] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2260eee-8b35-427b-8442-36b27d926bab service neutron] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2260eee-8b35-427b-8442-36b27d926bab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-c2260eee-8b35-427b-8442-36b27d926bab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd67ead3-76e9-40dd-94a3-9eec5afde7ea None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91f0355-020b-436a-9ad7-598cebd71329 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:49 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-ed0a7819-4d25-4529-a43e-03a7ee4ac7c2 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91f0355-020b-436a-9ad7-598cebd71329 None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91f0355-020b-436a-9ad7-598cebd71329 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91f0355-020b-436a-9ad7-598cebd71329 None admin] PATH_INFO: `/v3/users/c23c4f0d80fc4a328a0d37c798eb66f3` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:49 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-ed0a7819-4d25-4529-a43e-03a7ee4ac7c2 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91f0355-020b-436a-9ad7-598cebd71329 None admin] RBAC: Authorizing `identity:delete_user(user_id=c23c4f0d80fc4a328a0d37c798eb66f3)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91f0355-020b-436a-9ad7-598cebd71329 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2260eee-8b35-427b-8442-36b27d926bab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2260eee-8b35-427b-8442-36b27d926bab service neutron] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1284/2541] 10.27.203.238 () {64 vars in 1432 bytes} [Tue May 28 12:59:49 2024] GET /identity/v3/auth/tokens => generated 2960 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 28 12:59:49 l75lg1-v1 neutron-server[77619]: INFO neutron.wsgi [None req-8b896fa3-64cf-467e-867b-5d116d3c577e None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=645fb190404541a78e449c703540d6f8&name=default HTTP/1.1" status: 200 len: 216 time: 0.1376154 May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2260eee-8b35-427b-8442-36b27d926bab service neutron] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-c2260eee-8b35-427b-8442-36b27d926bab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-f91f0355-020b-436a-9ad7-598cebd71329 None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c23c4f0d80fc4a328a0d37c798eb66f3', 'request_id': 'req-f91f0355-020b-436a-9ad7-598cebd71329'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-f91f0355-020b-436a-9ad7-598cebd71329 None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c23c4f0d80fc4a328a0d37c798eb66f3', 'request_id': 'req-f91f0355-020b-436a-9ad7-598cebd71329'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:49 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-ed0a7819-4d25-4529-a43e-03a7ee4ac7c2 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.052s {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:49 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-ed0a7819-4d25-4529-a43e-03a7ee4ac7c2 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2260eee-8b35-427b-8442-36b27d926bab service neutron] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:49 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-ed0a7819-4d25-4529-a43e-03a7ee4ac7c2 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-f91f0355-020b-436a-9ad7-598cebd71329 None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c23c4f0d80fc4a328a0d37c798eb66f3', 'request_id': 'req-f91f0355-020b-436a-9ad7-598cebd71329'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-f91f0355-020b-436a-9ad7-598cebd71329 None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c23c4f0d80fc4a328a0d37c798eb66f3', 'request_id': 'req-f91f0355-020b-436a-9ad7-598cebd71329'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-f91f0355-020b-436a-9ad7-598cebd71329 None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c23c4f0d80fc4a328a0d37c798eb66f3', 'request_id': 'req-f91f0355-020b-436a-9ad7-598cebd71329'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1258/2542] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 12:59:49 2024] DELETE /identity/v3/users/c23c4f0d80fc4a328a0d37c798eb66f3 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88282d3-8d01-4cb8-a813-ba6bddeb0453 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88282d3-8d01-4cb8-a813-ba6bddeb0453 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88282d3-8d01-4cb8-a813-ba6bddeb0453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec0cca1-ea78-47bb-ad8a-1af636f8f530 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec0cca1-ea78-47bb-ad8a-1af636f8f530 None admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec0cca1-ea78-47bb-ad8a-1af636f8f530 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec0cca1-ea78-47bb-ad8a-1af636f8f530 None admin] PATH_INFO: `/v3/projects/645fb190404541a78e449c703540d6f8` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec0cca1-ea78-47bb-ad8a-1af636f8f530 None admin] RBAC: Authorizing `identity:delete_project(project_id=645fb190404541a78e449c703540d6f8)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec0cca1-ea78-47bb-ad8a-1af636f8f530 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-c88282d3-8d01-4cb8-a813-ba6bddeb0453 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-c88282d3-8d01-4cb8-a813-ba6bddeb0453 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-c88282d3-8d01-4cb8-a813-ba6bddeb0453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:59:49 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-ed0a7819-4d25-4529-a43e-03a7ee4ac7c2 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.066s {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:49 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-ed0a7819-4d25-4529-a43e-03a7ee4ac7c2 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action returned with HTTP 202 May 28 12:59:49 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 779/1572] 10.27.203.238 () {66 vars in 1493 bytes} [Tue May 28 12:59:49 2024] POST /share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action => generated 0 bytes in 208 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1259/2543] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:59:49 2024] POST /identity/v3/auth/tokens => generated 2960 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 28 12:59:49 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-25619fdd-a4fc-47ce-a906-cd10f90e64ee tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] GET http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/share-access-rules?share_id=72db8769-ece7-42ff-af27-2e778292a9b4 May 28 12:59:49 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-25619fdd-a4fc-47ce-a906-cd10f90e64ee tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:49 l75lg1-v1 neutron-server[77619]: DEBUG neutron.wsgi [-] (77619) accepted ('10.27.203.238', 44340) {{(pid=77619) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 12:59:49 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-25619fdd-a4fc-47ce-a906-cd10f90e64ee tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88282d3-8d01-4cb8-a813-ba6bddeb0453 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-c88282d3-8d01-4cb8-a813-ba6bddeb0453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-8ec0cca1-ea78-47bb-ad8a-1af636f8f530 None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '645fb190404541a78e449c703540d6f8', 'request_id': 'req-8ec0cca1-ea78-47bb-ad8a-1af636f8f530'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-8ec0cca1-ea78-47bb-ad8a-1af636f8f530 None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '645fb190404541a78e449c703540d6f8', 'request_id': 'req-8ec0cca1-ea78-47bb-ad8a-1af636f8f530'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:49 l75lg1-v1 manila-share[98474]: DEBUG manila.share.manager [None req-ed0a7819-4d25-4529-a43e-03a7ee4ac7c2 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Received request to update access for share instance 7fdd602c-79d0-479c-95a2-336b202c6639. {{(pid=98474) update_access_for_instances /opt/stack/manila/manila/share/manager.py:4353}} May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-8ec0cca1-ea78-47bb-ad8a-1af636f8f530 None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '645fb190404541a78e449c703540d6f8', 'request_id': 'req-8ec0cca1-ea78-47bb-ad8a-1af636f8f530'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:49 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.quota [None req-2fada9e6-9719-4554-b9f7-1891ec2be8ee tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Created reservations ['137b44b8-5d5d-4bf3-9381-80783f615038', 'cb887c28-db44-4f6c-9d04-29fc80a8dea0', 'af185291-ddc5-4ffa-9805-017a9a92e640', 'd321b232-a8c5-4837-b4ae-646228135b37'] {{(pid=98329) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-8ec0cca1-ea78-47bb-ad8a-1af636f8f530 None admin] The token cache is being invalidate because project 645fb190404541a78e449c703540d6f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-8ec0cca1-ea78-47bb-ad8a-1af636f8f530 None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-8ec0cca1-ea78-47bb-ad8a-1af636f8f530 None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1285/2544] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 12:59:49 2024] DELETE /identity/v3/projects/645fb190404541a78e449c703540d6f8 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:59:49 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-ed0a7819-4d25-4529-a43e-03a7ee4ac7c2 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:49 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-ed0a7819-4d25-4529-a43e-03a7ee4ac7c2 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:49 l75lg1-v1 neutron-server[77619]: DEBUG neutron.wsgi [-] (77619) accepted ('10.27.203.238', 44346) {{(pid=77619) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 12:59:49 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.quota [None req-2fada9e6-9719-4554-b9f7-1891ec2be8ee tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Committed reservations ['137b44b8-5d5d-4bf3-9381-80783f615038', 'cb887c28-db44-4f6c-9d04-29fc80a8dea0', 'af185291-ddc5-4ffa-9805-017a9a92e640', 'd321b232-a8c5-4837-b4ae-646228135b37'] {{(pid=98329) commit /opt/stack/manila/manila/quota.py:1063}} May 28 12:59:49 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.lock.api [None req-25619fdd-a4fc-47ce-a906-cd10f90e64ee tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Searching for locks by: {'resource_id': '571b2898-66b3-497d-944f-2c7e5223dd6b', 'resource_action': 'show', 'resource_type': 'access_rule'} {{(pid=98330) get_all /opt/stack/manila/manila/lock/api.py:112}} May 28 12:59:49 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-ed0a7819-4d25-4529-a43e-03a7ee4ac7c2 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:49 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-ed0a7819-4d25-4529-a43e-03a7ee4ac7c2 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:49 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-ed0a7819-4d25-4529-a43e-03a7ee4ac7c2 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:49 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-25619fdd-a4fc-47ce-a906-cd10f90e64ee tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/share-access-rules?share_id=72db8769-ece7-42ff-af27-2e778292a9b4 returned with HTTP 200 May 28 12:59:49 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 780/1573] 10.27.203.238 () {64 vars in 1467 bytes} [Tue May 28 12:59:49 2024] GET /share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/share-access-rules?share_id=72db8769-ece7-42ff-af27-2e778292a9b4 => generated 290 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:59:49 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-2fada9e6-9719-4554-b9f7-1891ec2be8ee tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] http://10.27.203.238/share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/shares/8c461c9a-d030-496e-b267-c05fe4731b2f returned with HTTP 202 May 28 12:59:49 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 794/1574] 10.27.203.238 () {64 vars in 1454 bytes} [Tue May 28 12:59:49 2024] DELETE /share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/shares/8c461c9a-d030-496e-b267-c05fe4731b2f => generated 0 bytes in 216 msecs (HTTP/1.1 202) 6 headers in 243 bytes (2 switches on core 0) May 28 12:59:49 l75lg1-v1 neutron-server[77619]: INFO neutron.wsgi [None req-51c13db8-2a78-4c1d-8b42-a8386075590b None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=16bb859669ab42a3b7cc595a5e30eb2e&name=default HTTP/1.1" status: 200 len: 216 time: 0.0104482 May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88282d3-8d01-4cb8-a813-ba6bddeb0453 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec0cca1-ea78-47bb-ad8a-1af636f8f530 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-8ec0cca1-ea78-47bb-ad8a-1af636f8f530 None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:59:49 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-53986484-4169-429b-8bca-2f13e878483e tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] POST http://10.27.203.238/share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/types May 28 12:59:49 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-53986484-4169-429b-8bca-2f13e878483e tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share_type": {"name": "tempest-share-type-1681555458", "extra_specs": {"driver_handles_share_servers": false, "vendor_name": "foobar"}, "share_type_access:is_public": true}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:59:49 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-53986484-4169-429b-8bca-2f13e878483e tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] http://10.27.203.238/share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/types returned with HTTP 200 May 28 12:59:49 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 781/1575] 10.27.203.238 () {66 vars in 1359 bytes} [Tue May 28 12:59:49 2024] POST /share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/types => generated 661 bytes in 31 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:59:49 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-c5fc80a8-01b2-4957-9dfe-979585fc6e25 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] POST http://10.27.203.238/share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/shares May 28 12:59:49 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-c5fc80a8-01b2-4957-9dfe-979585fc6e25 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share": {"share_proto": "nfs", "description": "tempest-tempest-created-share-desc-1747442270", "snapshot_id": null, "name": "tempest-tempest-created-share-276310180", "size": 1, "metadata": {}, "is_public": false, "share_type": "efeec024-6fbf-472e-819c-7ec1a0f198ff"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:59:49 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.v1.shares [None req-c5fc80a8-01b2-4957-9dfe-979585fc6e25 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Create NFS share of 1 GB May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec0cca1-ea78-47bb-ad8a-1af636f8f530 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2a3264-9370-4136-b53e-cd9619600bf1 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2a3264-9370-4136-b53e-cd9619600bf1 None admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2a3264-9370-4136-b53e-cd9619600bf1 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2a3264-9370-4136-b53e-cd9619600bf1 None admin] PATH_INFO: `/v3/projects/16bb859669ab42a3b7cc595a5e30eb2e` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2a3264-9370-4136-b53e-cd9619600bf1 None admin] RBAC: Authorizing `identity:delete_project(project_id=16bb859669ab42a3b7cc595a5e30eb2e)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:49 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-ed0a7819-4d25-4529-a43e-03a7ee4ac7c2 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.062s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2a3264-9370-4136-b53e-cd9619600bf1 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:49 l75lg1-v1 manila-share[98474]: DEBUG manila.share.access [None req-ed0a7819-4d25-4529-a43e-03a7ee4ac7c2 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Updating access rules for share instance 7fdd602c-79d0-479c-95a2-336b202c6639 belonging to share 72db8769-ece7-42ff-af27-2e778292a9b4. {{(pid=98474) update_access_rules /opt/stack/manila/manila/share/access.py:298}} May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c9437f-f12f-41f1-9f9d-244b361d9dd5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef17047035e4b518fd5360a01f2da1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c9437f-f12f-41f1-9f9d-244b361d9dd5 service neutron] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c9437f-f12f-41f1-9f9d-244b361d9dd5 service neutron] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c9437f-f12f-41f1-9f9d-244b361d9dd5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-f0c9437f-f12f-41f1-9f9d-244b361d9dd5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:59:49 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-ed0a7819-4d25-4529-a43e-03a7ee4ac7c2 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:49 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-ed0a7819-4d25-4529-a43e-03a7ee4ac7c2 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c9437f-f12f-41f1-9f9d-244b361d9dd5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c9437f-f12f-41f1-9f9d-244b361d9dd5 service neutron] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1260/2545] 10.27.203.238 () {64 vars in 1432 bytes} [Tue May 28 12:59:49 2024] GET /identity/v3/auth/tokens => generated 2960 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 28 12:59:49 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-ed0a7819-4d25-4529-a43e-03a7ee4ac7c2 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.008s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:49 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-ed0a7819-4d25-4529-a43e-03a7ee4ac7c2 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:49 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-ed0a7819-4d25-4529-a43e-03a7ee4ac7c2 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:49 l75lg1-v1 neutron-server[77619]: INFO neutron.wsgi [None req-6685b7e5-524a-479d-a107-a803ccc267f6 None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=b058127419ad4e429a8f95650aea3857&name=default HTTP/1.1" status: 200 len: 216 time: 0.1432686 May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c9437f-f12f-41f1-9f9d-244b361d9dd5 service neutron] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-f0c9437f-f12f-41f1-9f9d-244b361d9dd5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:59:49 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-ed0a7819-4d25-4529-a43e-03a7ee4ac7c2 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.014s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:49 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-ed0a7819-4d25-4529-a43e-03a7ee4ac7c2 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] changing access on None May 28 12:59:49 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ed0a7819-4d25-4529-a43e-03a7ee4ac7c2 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:59:49 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ed0a7819-4d25-4529-a43e-03a7ee4ac7c2 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] {'allow_redirects': True, May 28 12:59:49 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ed0a7819-4d25-4529-a43e-03a7ee4ac7c2 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] 'params': {'name': '7fdd602c-79d0-479c-95a2-336b202c6639'}} May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-da2a3264-9370-4136-b53e-cd9619600bf1 None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16bb859669ab42a3b7cc595a5e30eb2e', 'request_id': 'req-da2a3264-9370-4136-b53e-cd9619600bf1'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c9437f-f12f-41f1-9f9d-244b361d9dd5 service neutron] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-da2a3264-9370-4136-b53e-cd9619600bf1 None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16bb859669ab42a3b7cc595a5e30eb2e', 'request_id': 'req-da2a3264-9370-4136-b53e-cd9619600bf1'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-da2a3264-9370-4136-b53e-cd9619600bf1 None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16bb859669ab42a3b7cc595a5e30eb2e', 'request_id': 'req-da2a3264-9370-4136-b53e-cd9619600bf1'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:49 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.quota [None req-c5fc80a8-01b2-4957-9dfe-979585fc6e25 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Created reservations ['7efb6958-8577-428a-aa29-259f3c3b207d', 'cffddfc3-34ca-4302-8910-fed0be036618', 'ad10ac0c-f37a-4569-b676-b9276dec20e0', '9d3e0afb-df4e-4430-97ed-19aed5d39998'] {{(pid=98329) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6995a2-e21a-4d5a-9c2e-0618cf750313 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6995a2-e21a-4d5a-9c2e-0618cf750313 None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6995a2-e21a-4d5a-9c2e-0618cf750313 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6995a2-e21a-4d5a-9c2e-0618cf750313 None admin] PATH_INFO: `/v3/projects/b058127419ad4e429a8f95650aea3857` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6995a2-e21a-4d5a-9c2e-0618cf750313 None admin] RBAC: Authorizing `identity:delete_project(project_id=b058127419ad4e429a8f95650aea3857)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6995a2-e21a-4d5a-9c2e-0618cf750313 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-da2a3264-9370-4136-b53e-cd9619600bf1 None admin] The token cache is being invalidate because project 16bb859669ab42a3b7cc595a5e30eb2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-da2a3264-9370-4136-b53e-cd9619600bf1 None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-da2a3264-9370-4136-b53e-cd9619600bf1 None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1286/2546] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 12:59:49 2024] DELETE /identity/v3/projects/16bb859669ab42a3b7cc595a5e30eb2e => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:59:49 l75lg1-v1 neutron-server[77618]: DEBUG neutron.wsgi [-] (77618) accepted ('10.27.203.238', 44352) {{(pid=77618) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 12:59:49 l75lg1-v1 neutron-server[77618]: INFO neutron.wsgi [None req-1211b1e6-1aeb-45fe-9e6c-5a6064669848 None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=4e33c80a983f4bea96588979487da461&name=default HTTP/1.1" status: 200 len: 216 time: 0.0085130 May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2a3264-9370-4136-b53e-cd9619600bf1 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-da2a3264-9370-4136-b53e-cd9619600bf1 None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:59:49 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.quota [None req-c5fc80a8-01b2-4957-9dfe-979585fc6e25 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Committed reservations ['7efb6958-8577-428a-aa29-259f3c3b207d', 'cffddfc3-34ca-4302-8910-fed0be036618', 'ad10ac0c-f37a-4569-b676-b9276dec20e0', '9d3e0afb-df4e-4430-97ed-19aed5d39998'] {{(pid=98329) commit /opt/stack/manila/manila/quota.py:1063}} May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2a3264-9370-4136-b53e-cd9619600bf1 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-5d6995a2-e21a-4d5a-9c2e-0618cf750313 None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b058127419ad4e429a8f95650aea3857', 'request_id': 'req-5d6995a2-e21a-4d5a-9c2e-0618cf750313'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-5d6995a2-e21a-4d5a-9c2e-0618cf750313 None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b058127419ad4e429a8f95650aea3857', 'request_id': 'req-5d6995a2-e21a-4d5a-9c2e-0618cf750313'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e133b0b4-73e5-424c-badf-5e8d17d25a7c None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e133b0b4-73e5-424c-badf-5e8d17d25a7c None admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e133b0b4-73e5-424c-badf-5e8d17d25a7c None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e133b0b4-73e5-424c-badf-5e8d17d25a7c None admin] PATH_INFO: `/v3/projects/4e33c80a983f4bea96588979487da461` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e133b0b4-73e5-424c-badf-5e8d17d25a7c None admin] RBAC: Authorizing `identity:delete_project(project_id=4e33c80a983f4bea96588979487da461)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-5d6995a2-e21a-4d5a-9c2e-0618cf750313 None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b058127419ad4e429a8f95650aea3857', 'request_id': 'req-5d6995a2-e21a-4d5a-9c2e-0618cf750313'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e133b0b4-73e5-424c-badf-5e8d17d25a7c None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-5d6995a2-e21a-4d5a-9c2e-0618cf750313 None admin] The token cache is being invalidate because project b058127419ad4e429a8f95650aea3857 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-5d6995a2-e21a-4d5a-9c2e-0618cf750313 None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-5d6995a2-e21a-4d5a-9c2e-0618cf750313 None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1261/2547] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 12:59:49 2024] DELETE /identity/v3/projects/b058127419ad4e429a8f95650aea3857 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 28 12:59:49 l75lg1-v1 neutron-server[77618]: DEBUG neutron.wsgi [-] (77618) accepted ('10.27.203.238', 44358) {{(pid=77618) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 12:59:49 l75lg1-v1 neutron-server[77618]: INFO neutron.wsgi [None req-f2fe9762-70ed-4a7a-b7a9-e477028fc1b1 None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=1c8bc02239694668aa5810b9e0fc29f3&name=default HTTP/1.1" status: 200 len: 216 time: 0.0089657 May 28 12:59:49 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.host_manager [None req-c5fc80a8-01b2-4957-9dfe-979585fc6e25 tempest-UserMessageTest-1084663522 None] Share service is down. (host: l75lg1-v1@generic2). May 28 12:59:49 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.host_manager [None req-c5fc80a8-01b2-4957-9dfe-979585fc6e25 tempest-UserMessageTest-1084663522 None] Share service is down. (host: l75lg1-v1@generic1). May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6995a2-e21a-4d5a-9c2e-0618cf750313 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:49 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-c5fc80a8-01b2-4957-9dfe-979585fc6e25 tempest-UserMessageTest-1084663522 None] Starting with 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:80}} May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-5d6995a2-e21a-4d5a-9c2e-0618cf750313 None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:59:49 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-c5fc80a8-01b2-4957-9dfe-979585fc6e25 tempest-UserMessageTest-1084663522 None] Filter OnlyHostFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:59:49 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-c5fc80a8-01b2-4957-9dfe-979585fc6e25 tempest-UserMessageTest-1084663522 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:59:49 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.capacity [None req-c5fc80a8-01b2-4957-9dfe-979585fc6e25 tempest-UserMessageTest-1084663522 None] Space information for share creation on host l75lg1-v1@vast#vast (requested / avail): 1/2082 {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/capacity.py:83}} May 28 12:59:49 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-c5fc80a8-01b2-4957-9dfe-979585fc6e25 tempest-UserMessageTest-1084663522 None] Filter CapacityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:59:49 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.utils [None req-c5fc80a8-01b2-4957-9dfe-979585fc6e25 tempest-UserMessageTest-1084663522 None] Share type extra spec requirement "vendor_name=foobar" does not match reported capability "VAST STORAGE" {{(pid=98327) capabilities_satisfied /opt/stack/manila/manila/scheduler/utils.py:185}} May 28 12:59:49 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.capabilities [None req-c5fc80a8-01b2-4957-9dfe-979585fc6e25 tempest-UserMessageTest-1084663522 None] host: 'l75lg1-v1@vast#vast', free_capacity_gb: 2082.6478263456374, pools: None fails resource_type extra_specs requirements {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/capabilities.py:45}} May 28 12:59:49 l75lg1-v1 manila-scheduler[98327]: INFO manila.scheduler.filters.base [None req-c5fc80a8-01b2-4957-9dfe-979585fc6e25 tempest-UserMessageTest-1084663522 None] Filter CapabilitiesFilter returned 0 host(s) May 28 12:59:49 l75lg1-v1 manila-scheduler[98327]: ERROR manila.scheduler.manager [None req-c5fc80a8-01b2-4957-9dfe-979585fc6e25 tempest-UserMessageTest-1084663522 None] Failed to schedule create_share: No valid host was found. Failed to find a weighted host, the last executed filter was CapabilitiesFilter.: manila.exception.NoValidHost: No valid host was found. Failed to find a weighted host, the last executed filter was CapabilitiesFilter. May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6995a2-e21a-4d5a-9c2e-0618cf750313 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-e133b0b4-73e5-424c-badf-5e8d17d25a7c None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e33c80a983f4bea96588979487da461', 'request_id': 'req-e133b0b4-73e5-424c-badf-5e8d17d25a7c'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:49 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-c5fc80a8-01b2-4957-9dfe-979585fc6e25 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] http://10.27.203.238/share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/shares returned with HTTP 200 May 28 12:59:49 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 795/1576] 10.27.203.238 () {66 vars in 1362 bytes} [Tue May 28 12:59:49 2024] POST /share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/shares => generated 1372 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-e133b0b4-73e5-424c-badf-5e8d17d25a7c None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e33c80a983f4bea96588979487da461', 'request_id': 'req-e133b0b4-73e5-424c-badf-5e8d17d25a7c'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:49 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-49ae745f-da04-43cf-99be-f89d98efa620 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] GET http://10.27.203.238/share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/shares/6bf55297-267e-4c0f-8a15-10257c79ab6a May 28 12:59:49 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-1a173e92-b8db-4263-bd84-7aee7aabd03d tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] GET http://10.27.203.238/share/v2/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1 May 28 12:59:49 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-49ae745f-da04-43cf-99be-f89d98efa620 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:49 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-1a173e92-b8db-4263-bd84-7aee7aabd03d tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:49 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-49ae745f-da04-43cf-99be-f89d98efa620 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:49 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-1a173e92-b8db-4263-bd84-7aee7aabd03d tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-e133b0b4-73e5-424c-badf-5e8d17d25a7c None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e33c80a983f4bea96588979487da461', 'request_id': 'req-e133b0b4-73e5-424c-badf-5e8d17d25a7c'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:49 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-1a173e92-b8db-4263-bd84-7aee7aabd03d tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] HTTP exception thrown: The resource could not be found. May 28 12:59:49 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-1a173e92-b8db-4263-bd84-7aee7aabd03d tempest-ShareIpRulesForNFSTest-1748669711 tempest-ShareIpRulesForNFSTest-1748669711-project-member] http://10.27.203.238/share/v2/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1 returned with HTTP 404 May 28 12:59:49 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 796/1577] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:59:49 2024] GET /share/v2/776f75906bc64f8f9316d5aab4b50bf1/shares/1ddadc17-cf10-4a42-8bbd-8335fb3520a1 => generated 78 bytes in 12 msecs (HTTP/1.1 404) 6 headers in 237 bytes (2 switches on core 0) May 28 12:59:49 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-4fc099a5-ce44-4d1c-8bb1-62c25aeb4103 tempest-ShareIpRulesForNFSTest-2105398077 tempest-ShareIpRulesForNFSTest-2105398077-project-admin] DELETE http://10.27.203.238/share/v2/be41abb2eae44a6481cf94a21e347d1e/types/9752aa1f-dff4-4911-9901-18941d761370 May 28 12:59:49 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-4fc099a5-ce44-4d1c-8bb1-62c25aeb4103 tempest-ShareIpRulesForNFSTest-2105398077 tempest-ShareIpRulesForNFSTest-2105398077-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:49 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-4fc099a5-ce44-4d1c-8bb1-62c25aeb4103 tempest-ShareIpRulesForNFSTest-2105398077 tempest-ShareIpRulesForNFSTest-2105398077-project-admin] Calling method 'ShareTypesController._delete' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe59f3b-33c1-4553-88e7-fb5b30d2724e None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe59f3b-33c1-4553-88e7-fb5b30d2724e None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe59f3b-33c1-4553-88e7-fb5b30d2724e None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe59f3b-33c1-4553-88e7-fb5b30d2724e None admin] PATH_INFO: `/v3/projects/1c8bc02239694668aa5810b9e0fc29f3` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe59f3b-33c1-4553-88e7-fb5b30d2724e None admin] RBAC: Authorizing `identity:delete_project(project_id=1c8bc02239694668aa5810b9e0fc29f3)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:49 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-49ae745f-da04-43cf-99be-f89d98efa620 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] http://10.27.203.238/share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/shares/6bf55297-267e-4c0f-8a15-10257c79ab6a returned with HTTP 200 May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe59f3b-33c1-4553-88e7-fb5b30d2724e None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:49 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 782/1578] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:59:49 2024] GET /share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/shares/6bf55297-267e-4c0f-8a15-10257c79ab6a => generated 1372 bytes in 25 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-e133b0b4-73e5-424c-badf-5e8d17d25a7c None admin] The token cache is being invalidate because project 4e33c80a983f4bea96588979487da461 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-e133b0b4-73e5-424c-badf-5e8d17d25a7c None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-e133b0b4-73e5-424c-badf-5e8d17d25a7c None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1287/2548] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 12:59:49 2024] DELETE /identity/v3/projects/4e33c80a983f4bea96588979487da461 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:59:49 l75lg1-v1 manila-scheduler[98327]: INFO manila.message.api [None req-c5fc80a8-01b2-4957-9dfe-979585fc6e25 tempest-UserMessageTest-1084663522 None] Creating message record for request_id = req-c5fc80a8-01b2-4957-9dfe-979585fc6e25 May 28 12:59:49 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38189fb-0613-44c7-b672-a3aabcef2108 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38189fb-0613-44c7-b672-a3aabcef2108 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38189fb-0613-44c7-b672-a3aabcef2108 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-d38189fb-0613-44c7-b672-a3aabcef2108 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-d38189fb-0613-44c7-b672-a3aabcef2108 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-d38189fb-0613-44c7-b672-a3aabcef2108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1288/2549] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:59:49 2024] POST /identity/v3/auth/tokens => generated 312 bytes in 18 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea1b2f3-4077-4a9f-b9ee-282b8cff4f1a None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea1b2f3-4077-4a9f-b9ee-282b8cff4f1a None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea1b2f3-4077-4a9f-b9ee-282b8cff4f1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:50 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-4fc099a5-ce44-4d1c-8bb1-62c25aeb4103 tempest-ShareIpRulesForNFSTest-2105398077 tempest-ShareIpRulesForNFSTest-2105398077-project-admin] http://10.27.203.238/share/v2/be41abb2eae44a6481cf94a21e347d1e/types/9752aa1f-dff4-4911-9901-18941d761370 returned with HTTP 202 May 28 12:59:50 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 797/1579] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:59:49 2024] DELETE /share/v2/be41abb2eae44a6481cf94a21e347d1e/types/9752aa1f-dff4-4911-9901-18941d761370 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 6 headers in 243 bytes (2 switches on core 0) May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-eea1b2f3-4077-4a9f-b9ee-282b8cff4f1a None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-eea1b2f3-4077-4a9f-b9ee-282b8cff4f1a None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-eea1b2f3-4077-4a9f-b9ee-282b8cff4f1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:59:50 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-6b95a7e9-bb1e-481a-9e50-e3baf06e580f tempest-ShareIpRulesForNFSTest-2105398077 tempest-ShareIpRulesForNFSTest-2105398077-project-admin] GET http://10.27.203.238/share/v2/be41abb2eae44a6481cf94a21e347d1e/types/9752aa1f-dff4-4911-9901-18941d761370 May 28 12:59:50 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-6b95a7e9-bb1e-481a-9e50-e3baf06e580f tempest-ShareIpRulesForNFSTest-2105398077 tempest-ShareIpRulesForNFSTest-2105398077-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:50 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-6b95a7e9-bb1e-481a-9e50-e3baf06e580f tempest-ShareIpRulesForNFSTest-2105398077 tempest-ShareIpRulesForNFSTest-2105398077-project-admin] Calling method 'ShareTypesController.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-afe59f3b-33c1-4553-88e7-fb5b30d2724e None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c8bc02239694668aa5810b9e0fc29f3', 'request_id': 'req-afe59f3b-33c1-4553-88e7-fb5b30d2724e'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-afe59f3b-33c1-4553-88e7-fb5b30d2724e None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c8bc02239694668aa5810b9e0fc29f3', 'request_id': 'req-afe59f3b-33c1-4553-88e7-fb5b30d2724e'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:50 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-6b95a7e9-bb1e-481a-9e50-e3baf06e580f tempest-ShareIpRulesForNFSTest-2105398077 tempest-ShareIpRulesForNFSTest-2105398077-project-admin] HTTP exception thrown: Share type not found. May 28 12:59:50 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-6b95a7e9-bb1e-481a-9e50-e3baf06e580f tempest-ShareIpRulesForNFSTest-2105398077 tempest-ShareIpRulesForNFSTest-2105398077-project-admin] http://10.27.203.238/share/v2/be41abb2eae44a6481cf94a21e347d1e/types/9752aa1f-dff4-4911-9901-18941d761370 returned with HTTP 404 May 28 12:59:50 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 783/1580] 10.27.203.238 () {64 vars in 1448 bytes} [Tue May 28 12:59:50 2024] GET /share/v2/be41abb2eae44a6481cf94a21e347d1e/types/9752aa1f-dff4-4911-9901-18941d761370 => generated 67 bytes in 15 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-afe59f3b-33c1-4553-88e7-fb5b30d2724e None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c8bc02239694668aa5810b9e0fc29f3', 'request_id': 'req-afe59f3b-33c1-4553-88e7-fb5b30d2724e'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1289/2550] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:59:50 2024] POST /identity/v3/auth/tokens => generated 2960 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea1b2f3-4077-4a9f-b9ee-282b8cff4f1a None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-eea1b2f3-4077-4a9f-b9ee-282b8cff4f1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-afe59f3b-33c1-4553-88e7-fb5b30d2724e None admin] The token cache is being invalidate because project 1c8bc02239694668aa5810b9e0fc29f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-afe59f3b-33c1-4553-88e7-fb5b30d2724e None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-afe59f3b-33c1-4553-88e7-fb5b30d2724e None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea1b2f3-4077-4a9f-b9ee-282b8cff4f1a None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1262/2551] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 12:59:49 2024] DELETE /identity/v3/projects/1c8bc02239694668aa5810b9e0fc29f3 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe59f3b-33c1-4553-88e7-fb5b30d2724e None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-afe59f3b-33c1-4553-88e7-fb5b30d2724e None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:59:50 l75lg1-v1 neutron-server[77618]: DEBUG neutron.wsgi [-] (77618) accepted ('10.27.203.238', 44372) {{(pid=77618) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5ad66d-0a17-4739-9533-ceb08316bc47 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5ad66d-0a17-4739-9533-ceb08316bc47 None admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5ad66d-0a17-4739-9533-ceb08316bc47 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5ad66d-0a17-4739-9533-ceb08316bc47 None admin] PATH_INFO: `/v3/users/8937c78e76024a40a3ee7b019a2d366f` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5ad66d-0a17-4739-9533-ceb08316bc47 None admin] RBAC: Authorizing `identity:delete_user(user_id=8937c78e76024a40a3ee7b019a2d366f)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5ad66d-0a17-4739-9533-ceb08316bc47 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe59f3b-33c1-4553-88e7-fb5b30d2724e None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:50 l75lg1-v1 neutron-server[77618]: INFO neutron.wsgi [None req-ad096b8d-30e3-4e31-a84d-f3ff10b2c726 None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=86e4aff17ad94d75a624b038464bfeb2&name=default HTTP/1.1" status: 200 len: 216 time: 0.0082879 May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cfec7d-b6c7-4eba-af48-76b980db3275 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cfec7d-b6c7-4eba-af48-76b980db3275 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cfec7d-b6c7-4eba-af48-76b980db3275 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cfec7d-b6c7-4eba-af48-76b980db3275 None admin] PATH_INFO: `/v3/domains` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cfec7d-b6c7-4eba-af48-76b980db3275 None admin] RBAC: Adding query filter params (name=Default) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cfec7d-b6c7-4eba-af48-76b980db3275 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cfec7d-b6c7-4eba-af48-76b980db3275 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1263/2552] 10.27.203.238 () {62 vars in 1220 bytes} [Tue May 28 12:59:50 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cfec7d-b6c7-4eba-af48-76b980db3275 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-74cfec7d-b6c7-4eba-af48-76b980db3275 None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cfec7d-b6c7-4eba-af48-76b980db3275 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9272d9b-3005-4cab-b4a6-799e5bc42d49 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9272d9b-3005-4cab-b4a6-799e5bc42d49 None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9272d9b-3005-4cab-b4a6-799e5bc42d49 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9272d9b-3005-4cab-b4a6-799e5bc42d49 None admin] PATH_INFO: `/v3/projects/86e4aff17ad94d75a624b038464bfeb2` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9272d9b-3005-4cab-b4a6-799e5bc42d49 None admin] RBAC: Authorizing `identity:delete_project(project_id=86e4aff17ad94d75a624b038464bfeb2)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9272d9b-3005-4cab-b4a6-799e5bc42d49 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-8e5ad66d-0a17-4739-9533-ceb08316bc47 None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8937c78e76024a40a3ee7b019a2d366f', 'request_id': 'req-8e5ad66d-0a17-4739-9533-ceb08316bc47'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:50 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ed0a7819-4d25-4529-a43e-03a7ee4ac7c2 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-8e5ad66d-0a17-4739-9533-ceb08316bc47 None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8937c78e76024a40a3ee7b019a2d366f', 'request_id': 'req-8e5ad66d-0a17-4739-9533-ceb08316bc47'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:50 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ed0a7819-4d25-4529-a43e-03a7ee4ac7c2 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] [Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=1, created='2024-05-28T12:58:43.845440Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='31b6534b-d142-4561-992f-4f0759db302d', id=32, internal=False, is_s3_default_policy=False, name='7fdd602c-79d0-479c-95a2-336b202c6639', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=['*'], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=[], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=[], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T12:59:48.852644Z', tenant_id=1, tenant_name='default', title='7fdd602c-79d0-479c-95a2-336b202c6639', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/32/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[])] May 28 12:59:50 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ed0a7819-4d25-4529-a43e-03a7ee4ac7c2 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-8e5ad66d-0a17-4739-9533-ceb08316bc47 None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8937c78e76024a40a3ee7b019a2d366f', 'request_id': 'req-8e5ad66d-0a17-4739-9533-ceb08316bc47'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-8e5ad66d-0a17-4739-9533-ceb08316bc47 None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8937c78e76024a40a3ee7b019a2d366f', 'request_id': 'req-8e5ad66d-0a17-4739-9533-ceb08316bc47'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:50 l75lg1-v1 manila-share[98474]: ERROR manila.share.drivers.vastdata [None req-ed0a7819-4d25-4529-a43e-03a7ee4ac7c2 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] failed to resolve host '10.10.30.40/32': [Errno -2] Name or service not known (ignoring): socket.gaierror: [Errno -2] Name or service not known May 28 12:59:50 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-ed0a7819-4d25-4529-a43e-03a7ee4ac7c2 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] changing access on /manila/manila-7fdd602c-79d0-479c-95a2-336b202c6639. Rules: {'nfs_read_write': [], 'nfs_read_only': []} May 28 12:59:50 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ed0a7819-4d25-4529-a43e-03a7ee4ac7c2 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] >>> [PATCH] https://127.0.0.1:40443/api/viewpolicies/32/ May 28 12:59:50 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ed0a7819-4d25-4529-a43e-03a7ee4ac7c2 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] {'data': '{"name": "7fdd602c-79d0-479c-95a2-336b202c6639", "nfs_no_squash": ' May 28 12:59:50 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ed0a7819-4d25-4529-a43e-03a7ee4ac7c2 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] '["*"], "nfs_root_squash": ["*"], "nfs_read_write": [], ' May 28 12:59:50 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ed0a7819-4d25-4529-a43e-03a7ee4ac7c2 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] '"nfs_read_only": []}', May 28 12:59:50 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ed0a7819-4d25-4529-a43e-03a7ee4ac7c2 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] 'params': None} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-8e5ad66d-0a17-4739-9533-ceb08316bc47 None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8937c78e76024a40a3ee7b019a2d366f', 'request_id': 'req-8e5ad66d-0a17-4739-9533-ceb08316bc47'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-e9272d9b-3005-4cab-b4a6-799e5bc42d49 None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86e4aff17ad94d75a624b038464bfeb2', 'request_id': 'req-e9272d9b-3005-4cab-b4a6-799e5bc42d49'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-e9272d9b-3005-4cab-b4a6-799e5bc42d49 None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86e4aff17ad94d75a624b038464bfeb2', 'request_id': 'req-e9272d9b-3005-4cab-b4a6-799e5bc42d49'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1290/2553] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 12:59:50 2024] DELETE /identity/v3/users/8937c78e76024a40a3ee7b019a2d366f => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5ad66d-0a17-4739-9533-ceb08316bc47 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-8e5ad66d-0a17-4739-9533-ceb08316bc47 None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-e9272d9b-3005-4cab-b4a6-799e5bc42d49 None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86e4aff17ad94d75a624b038464bfeb2', 'request_id': 'req-e9272d9b-3005-4cab-b4a6-799e5bc42d49'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-e9272d9b-3005-4cab-b4a6-799e5bc42d49 None admin] The token cache is being invalidate because project 86e4aff17ad94d75a624b038464bfeb2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-e9272d9b-3005-4cab-b4a6-799e5bc42d49 None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-e9272d9b-3005-4cab-b4a6-799e5bc42d49 None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1264/2554] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 12:59:50 2024] DELETE /identity/v3/projects/86e4aff17ad94d75a624b038464bfeb2 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9272d9b-3005-4cab-b4a6-799e5bc42d49 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-e9272d9b-3005-4cab-b4a6-799e5bc42d49 None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5ad66d-0a17-4739-9533-ceb08316bc47 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c57caea-6946-48e7-8578-a491a4763b7f None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c57caea-6946-48e7-8578-a491a4763b7f None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c57caea-6946-48e7-8578-a491a4763b7f None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c57caea-6946-48e7-8578-a491a4763b7f None admin] PATH_INFO: `/v3/projects` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c57caea-6946-48e7-8578-a491a4763b7f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c57caea-6946-48e7-8578-a491a4763b7f None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9272d9b-3005-4cab-b4a6-799e5bc42d49 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1291/2555] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 12:59:50 2024] POST /identity/v3/projects => generated 367 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0280d71-7d09-49b1-a439-d014aba16892 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0280d71-7d09-49b1-a439-d014aba16892 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0280d71-7d09-49b1-a439-d014aba16892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faee564-b5f0-42c0-9825-83cbe93c2eeb None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faee564-b5f0-42c0-9825-83cbe93c2eeb None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faee564-b5f0-42c0-9825-83cbe93c2eeb None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faee564-b5f0-42c0-9825-83cbe93c2eeb None admin] PATH_INFO: `/v3/users/8a096898300641eabaf2d505168d8804` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faee564-b5f0-42c0-9825-83cbe93c2eeb None admin] RBAC: Authorizing `identity:delete_user(user_id=8a096898300641eabaf2d505168d8804)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faee564-b5f0-42c0-9825-83cbe93c2eeb None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:50 l75lg1-v1 dstat.sh[49771]: 28-05 12:59:50| 29 2 63 4 0|5742M 1722M 277M 7883M| 18k 8938B| 0 4377k| 0 683 | 15k 26k|0.99 1.03 1.00|2.0 1.0 0| 0 0 | 0 2048M| 29 366 0 35 0 May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-a0280d71-7d09-49b1-a439-d014aba16892 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-a0280d71-7d09-49b1-a439-d014aba16892 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-a0280d71-7d09-49b1-a439-d014aba16892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1292/2556] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:59:50 2024] POST /identity/v3/auth/tokens => generated 312 bytes in 24 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0280d71-7d09-49b1-a439-d014aba16892 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-a0280d71-7d09-49b1-a439-d014aba16892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0280d71-7d09-49b1-a439-d014aba16892 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71d5028-698d-40b8-a789-87f020d32094 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71d5028-698d-40b8-a789-87f020d32094 None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71d5028-698d-40b8-a789-87f020d32094 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71d5028-698d-40b8-a789-87f020d32094 None admin] PATH_INFO: `/v3/users` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71d5028-698d-40b8-a789-87f020d32094 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71d5028-698d-40b8-a789-87f020d32094 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-c71d5028-698d-40b8-a789-87f020d32094 None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-6faee564-b5f0-42c0-9825-83cbe93c2eeb None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a096898300641eabaf2d505168d8804', 'request_id': 'req-6faee564-b5f0-42c0-9825-83cbe93c2eeb'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-6faee564-b5f0-42c0-9825-83cbe93c2eeb None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a096898300641eabaf2d505168d8804', 'request_id': 'req-6faee564-b5f0-42c0-9825-83cbe93c2eeb'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-6faee564-b5f0-42c0-9825-83cbe93c2eeb None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a096898300641eabaf2d505168d8804', 'request_id': 'req-6faee564-b5f0-42c0-9825-83cbe93c2eeb'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-6faee564-b5f0-42c0-9825-83cbe93c2eeb None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a096898300641eabaf2d505168d8804', 'request_id': 'req-6faee564-b5f0-42c0-9825-83cbe93c2eeb'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-6faee564-b5f0-42c0-9825-83cbe93c2eeb None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a096898300641eabaf2d505168d8804', 'request_id': 'req-6faee564-b5f0-42c0-9825-83cbe93c2eeb'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1293/2557] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 12:59:50 2024] POST /identity/v3/users => generated 292 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e8e479-56ef-4071-b0d8-0b962327e4c4 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e8e479-56ef-4071-b0d8-0b962327e4c4 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e8e479-56ef-4071-b0d8-0b962327e4c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-04e8e479-56ef-4071-b0d8-0b962327e4c4 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-04e8e479-56ef-4071-b0d8-0b962327e4c4 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-04e8e479-56ef-4071-b0d8-0b962327e4c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1265/2558] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 12:59:50 2024] DELETE /identity/v3/users/8a096898300641eabaf2d505168d8804 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faee564-b5f0-42c0-9825-83cbe93c2eeb None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-6faee564-b5f0-42c0-9825-83cbe93c2eeb None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1294/2559] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:59:50 2024] POST /identity/v3/auth/tokens => generated 2960 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e8e479-56ef-4071-b0d8-0b962327e4c4 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-04e8e479-56ef-4071-b0d8-0b962327e4c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e8e479-56ef-4071-b0d8-0b962327e4c4 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61f4073-0c9f-420b-93ae-1a143b7066ba None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faee564-b5f0-42c0-9825-83cbe93c2eeb None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61f4073-0c9f-420b-93ae-1a143b7066ba None admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61f4073-0c9f-420b-93ae-1a143b7066ba None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61f4073-0c9f-420b-93ae-1a143b7066ba None admin] PATH_INFO: `/v3/users/4baf3846d3024ef88eeb58770fe946c9` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61f4073-0c9f-420b-93ae-1a143b7066ba None admin] RBAC: Authorizing `identity:delete_user(user_id=4baf3846d3024ef88eeb58770fe946c9)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61f4073-0c9f-420b-93ae-1a143b7066ba None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48c81bc-f4a7-4a8a-b18d-fd5aac0b6e16 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48c81bc-f4a7-4a8a-b18d-fd5aac0b6e16 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48c81bc-f4a7-4a8a-b18d-fd5aac0b6e16 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48c81bc-f4a7-4a8a-b18d-fd5aac0b6e16 None admin] PATH_INFO: `/v3/roles` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48c81bc-f4a7-4a8a-b18d-fd5aac0b6e16 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48c81bc-f4a7-4a8a-b18d-fd5aac0b6e16 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1266/2560] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 12:59:50 2024] GET /identity/v3/roles => generated 1680 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48c81bc-f4a7-4a8a-b18d-fd5aac0b6e16 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48c81bc-f4a7-4a8a-b18d-fd5aac0b6e16 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277e5e35-b34b-4b49-ad33-006a60af4156 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277e5e35-b34b-4b49-ad33-006a60af4156 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277e5e35-b34b-4b49-ad33-006a60af4156 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277e5e35-b34b-4b49-ad33-006a60af4156 None admin] PATH_INFO: `/v3/domains` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277e5e35-b34b-4b49-ad33-006a60af4156 None admin] RBAC: Adding query filter params (name=Default) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277e5e35-b34b-4b49-ad33-006a60af4156 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277e5e35-b34b-4b49-ad33-006a60af4156 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1267/2561] 10.27.203.238 () {62 vars in 1220 bytes} [Tue May 28 12:59:50 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277e5e35-b34b-4b49-ad33-006a60af4156 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277e5e35-b34b-4b49-ad33-006a60af4156 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e107da27-39b0-4b2f-a43c-e97c137d9e42 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e107da27-39b0-4b2f-a43c-e97c137d9e42 None admin] REQUEST_METHOD: `PUT` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e107da27-39b0-4b2f-a43c-e97c137d9e42 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e107da27-39b0-4b2f-a43c-e97c137d9e42 None admin] PATH_INFO: `/v3/projects/a4f3887fa28c457390f5b66615564430/users/c153f63532ba4a37a0dea611e7cd28fc/roles/44620cad10ae407c90c91e2c296adb04` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-f61f4073-0c9f-420b-93ae-1a143b7066ba None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4baf3846d3024ef88eeb58770fe946c9', 'request_id': 'req-f61f4073-0c9f-420b-93ae-1a143b7066ba'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e107da27-39b0-4b2f-a43c-e97c137d9e42 None admin] RBAC: Authorizing `identity:create_grant(project_id=a4f3887fa28c457390f5b66615564430, user_id=c153f63532ba4a37a0dea611e7cd28fc, role_id=44620cad10ae407c90c91e2c296adb04)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e107da27-39b0-4b2f-a43c-e97c137d9e42 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-f61f4073-0c9f-420b-93ae-1a143b7066ba None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4baf3846d3024ef88eeb58770fe946c9', 'request_id': 'req-f61f4073-0c9f-420b-93ae-1a143b7066ba'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-f61f4073-0c9f-420b-93ae-1a143b7066ba None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4baf3846d3024ef88eeb58770fe946c9', 'request_id': 'req-f61f4073-0c9f-420b-93ae-1a143b7066ba'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-f61f4073-0c9f-420b-93ae-1a143b7066ba None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4baf3846d3024ef88eeb58770fe946c9', 'request_id': 'req-f61f4073-0c9f-420b-93ae-1a143b7066ba'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1268/2562] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 12:59:50 2024] PUT /identity/v3/projects/a4f3887fa28c457390f5b66615564430/users/c153f63532ba4a37a0dea611e7cd28fc/roles/44620cad10ae407c90c91e2c296adb04 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e107da27-39b0-4b2f-a43c-e97c137d9e42 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-f61f4073-0c9f-420b-93ae-1a143b7066ba None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4baf3846d3024ef88eeb58770fe946c9', 'request_id': 'req-f61f4073-0c9f-420b-93ae-1a143b7066ba'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-e107da27-39b0-4b2f-a43c-e97c137d9e42 None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1295/2563] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 12:59:50 2024] DELETE /identity/v3/users/4baf3846d3024ef88eeb58770fe946c9 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc671bf-77a3-456b-9079-86a726721a81 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc671bf-77a3-456b-9079-86a726721a81 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc671bf-77a3-456b-9079-86a726721a81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-efc671bf-77a3-456b-9079-86a726721a81 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e107da27-39b0-4b2f-a43c-e97c137d9e42 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-efc671bf-77a3-456b-9079-86a726721a81 None None] MFA Rules not processed for user `c153f63532ba4a37a0dea611e7cd28fc`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-efc671bf-77a3-456b-9079-86a726721a81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d021635-b7a2-4a33-b62a-22284101c2f2 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d021635-b7a2-4a33-b62a-22284101c2f2 None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d021635-b7a2-4a33-b62a-22284101c2f2 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d021635-b7a2-4a33-b62a-22284101c2f2 None admin] PATH_INFO: `/v3/projects` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d021635-b7a2-4a33-b62a-22284101c2f2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d021635-b7a2-4a33-b62a-22284101c2f2 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1296/2564] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:59:50 2024] POST /identity/v3/auth/tokens => generated 3938 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06f024e-f747-4c2d-8d0d-e989111a79df None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06f024e-f747-4c2d-8d0d-e989111a79df None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06f024e-f747-4c2d-8d0d-e989111a79df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1269/2565] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 12:59:50 2024] POST /identity/v3/projects => generated 415 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d021635-b7a2-4a33-b62a-22284101c2f2 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-6d021635-b7a2-4a33-b62a-22284101c2f2 None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-c06f024e-f747-4c2d-8d0d-e989111a79df None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-c06f024e-f747-4c2d-8d0d-e989111a79df None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-c06f024e-f747-4c2d-8d0d-e989111a79df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:59:50 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:59:50 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:59:50 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d021635-b7a2-4a33-b62a-22284101c2f2 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a431a810-f1be-4c1e-ad0e-1fffe2f816e9 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a431a810-f1be-4c1e-ad0e-1fffe2f816e9 None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a431a810-f1be-4c1e-ad0e-1fffe2f816e9 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a431a810-f1be-4c1e-ad0e-1fffe2f816e9 None admin] PATH_INFO: `/v3/projects` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a431a810-f1be-4c1e-ad0e-1fffe2f816e9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a431a810-f1be-4c1e-ad0e-1fffe2f816e9 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1297/2566] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:59:50 2024] POST /identity/v3/auth/tokens => generated 2960 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06f024e-f747-4c2d-8d0d-e989111a79df None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:50 l75lg1-v1 neutron-server[77618]: DEBUG neutron.wsgi [-] (77618) accepted ('10.27.203.238', 41244) {{(pid=77618) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06f024e-f747-4c2d-8d0d-e989111a79df None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04799349-c3d7-4da5-ad3e-6fa2f8ba20dd None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04799349-c3d7-4da5-ad3e-6fa2f8ba20dd None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04799349-c3d7-4da5-ad3e-6fa2f8ba20dd None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04799349-c3d7-4da5-ad3e-6fa2f8ba20dd None admin] PATH_INFO: `/v3/users` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04799349-c3d7-4da5-ad3e-6fa2f8ba20dd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04799349-c3d7-4da5-ad3e-6fa2f8ba20dd None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-04799349-c3d7-4da5-ad3e-6fa2f8ba20dd None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1270/2567] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 12:59:50 2024] POST /identity/v3/projects => generated 367 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a431a810-f1be-4c1e-ad0e-1fffe2f816e9 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-a431a810-f1be-4c1e-ad0e-1fffe2f816e9 None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1298/2568] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 12:59:50 2024] POST /identity/v3/users => generated 316 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04799349-c3d7-4da5-ad3e-6fa2f8ba20dd None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04799349-c3d7-4da5-ad3e-6fa2f8ba20dd None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa86c129-d75e-42e6-9a94-a67900ce0917 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa86c129-d75e-42e6-9a94-a67900ce0917 None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa86c129-d75e-42e6-9a94-a67900ce0917 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa86c129-d75e-42e6-9a94-a67900ce0917 None admin] PATH_INFO: `/v3/users` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa86c129-d75e-42e6-9a94-a67900ce0917 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a431a810-f1be-4c1e-ad0e-1fffe2f816e9 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa86c129-d75e-42e6-9a94-a67900ce0917 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79163b95-2ba2-4483-a11a-3358d1c21a5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef17047035e4b518fd5360a01f2da1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79163b95-2ba2-4483-a11a-3358d1c21a5a service neutron] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79163b95-2ba2-4483-a11a-3358d1c21a5a service neutron] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-fa86c129-d75e-42e6-9a94-a67900ce0917 None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79163b95-2ba2-4483-a11a-3358d1c21a5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79163b95-2ba2-4483-a11a-3358d1c21a5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79163b95-2ba2-4483-a11a-3358d1c21a5a service neutron] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1271/2569] 10.27.203.238 () {64 vars in 1432 bytes} [Tue May 28 12:59:50 2024] GET /identity/v3/auth/tokens => generated 2960 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79163b95-2ba2-4483-a11a-3358d1c21a5a service neutron] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79163b95-2ba2-4483-a11a-3358d1c21a5a service neutron] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1299/2570] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 12:59:50 2024] POST /identity/v3/users => generated 292 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dd9274-b741-4ce3-838f-128780daa5a4 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa86c129-d75e-42e6-9a94-a67900ce0917 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dd9274-b741-4ce3-838f-128780daa5a4 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dd9274-b741-4ce3-838f-128780daa5a4 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dd9274-b741-4ce3-838f-128780daa5a4 None admin] PATH_INFO: `/v3/roles` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dd9274-b741-4ce3-838f-128780daa5a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:50 l75lg1-v1 neutron-server[77618]: INFO neutron.wsgi [None req-6c2be1ee-e322-49d5-86ce-42cf5eba6c53 None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=776f75906bc64f8f9316d5aab4b50bf1&name=default HTTP/1.1" status: 200 len: 216 time: 0.1020992 May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dd9274-b741-4ce3-838f-128780daa5a4 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa86c129-d75e-42e6-9a94-a67900ce0917 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c246643-fdc2-49e8-a38a-5909ee1e5ea8 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c246643-fdc2-49e8-a38a-5909ee1e5ea8 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c246643-fdc2-49e8-a38a-5909ee1e5ea8 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c246643-fdc2-49e8-a38a-5909ee1e5ea8 None admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c246643-fdc2-49e8-a38a-5909ee1e5ea8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c246643-fdc2-49e8-a38a-5909ee1e5ea8 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1272/2571] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 12:59:50 2024] GET /identity/v3/roles => generated 1680 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dd9274-b741-4ce3-838f-128780daa5a4 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-94dd9274-b741-4ce3-838f-128780daa5a4 None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1300/2572] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 12:59:50 2024] GET /identity/v3/roles => generated 1680 bytes in 19 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c246643-fdc2-49e8-a38a-5909ee1e5ea8 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dd9274-b741-4ce3-838f-128780daa5a4 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c246643-fdc2-49e8-a38a-5909ee1e5ea8 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f5e61e-bab6-4843-a79b-b5471dc3dc27 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3354373-d2c7-46cb-bd8e-d92f116e4e38 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f5e61e-bab6-4843-a79b-b5471dc3dc27 None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3354373-d2c7-46cb-bd8e-d92f116e4e38 None admin] REQUEST_METHOD: `PUT` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f5e61e-bab6-4843-a79b-b5471dc3dc27 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3354373-d2c7-46cb-bd8e-d92f116e4e38 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f5e61e-bab6-4843-a79b-b5471dc3dc27 None admin] PATH_INFO: `/v3/projects/776f75906bc64f8f9316d5aab4b50bf1` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3354373-d2c7-46cb-bd8e-d92f116e4e38 None admin] PATH_INFO: `/v3/projects/ec850008fab34430bc3261f8c74f5611/users/869ea9c4ad8b4dc093edb323b66436ab/roles/44620cad10ae407c90c91e2c296adb04` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f5e61e-bab6-4843-a79b-b5471dc3dc27 None admin] RBAC: Authorizing `identity:delete_project(project_id=776f75906bc64f8f9316d5aab4b50bf1)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f5e61e-bab6-4843-a79b-b5471dc3dc27 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3354373-d2c7-46cb-bd8e-d92f116e4e38 None admin] RBAC: Authorizing `identity:create_grant(project_id=ec850008fab34430bc3261f8c74f5611, user_id=869ea9c4ad8b4dc093edb323b66436ab, role_id=44620cad10ae407c90c91e2c296adb04)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3354373-d2c7-46cb-bd8e-d92f116e4e38 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1301/2573] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 12:59:50 2024] PUT /identity/v3/projects/ec850008fab34430bc3261f8c74f5611/users/869ea9c4ad8b4dc093edb323b66436ab/roles/44620cad10ae407c90c91e2c296adb04 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3354373-d2c7-46cb-bd8e-d92f116e4e38 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-44f5e61e-bab6-4843-a79b-b5471dc3dc27 None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '776f75906bc64f8f9316d5aab4b50bf1', 'request_id': 'req-44f5e61e-bab6-4843-a79b-b5471dc3dc27'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-44f5e61e-bab6-4843-a79b-b5471dc3dc27 None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '776f75906bc64f8f9316d5aab4b50bf1', 'request_id': 'req-44f5e61e-bab6-4843-a79b-b5471dc3dc27'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-44f5e61e-bab6-4843-a79b-b5471dc3dc27 None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '776f75906bc64f8f9316d5aab4b50bf1', 'request_id': 'req-44f5e61e-bab6-4843-a79b-b5471dc3dc27'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3354373-d2c7-46cb-bd8e-d92f116e4e38 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-44f5e61e-bab6-4843-a79b-b5471dc3dc27 None admin] The token cache is being invalidate because project 776f75906bc64f8f9316d5aab4b50bf1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-44f5e61e-bab6-4843-a79b-b5471dc3dc27 None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-44f5e61e-bab6-4843-a79b-b5471dc3dc27 None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1273/2574] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 12:59:50 2024] DELETE /identity/v3/projects/776f75906bc64f8f9316d5aab4b50bf1 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc58c0a-4523-476f-afe3-d33a404d7a04 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc58c0a-4523-476f-afe3-d33a404d7a04 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc58c0a-4523-476f-afe3-d33a404d7a04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:50 l75lg1-v1 neutron-server[77619]: DEBUG neutron.wsgi [-] (77619) accepted ('10.27.203.238', 41248) {{(pid=77619) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 12:59:50 l75lg1-v1 neutron-server[77619]: INFO neutron.wsgi [None req-9196f6fb-fb3f-4470-b102-ee4f4f4463f1 None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=be41abb2eae44a6481cf94a21e347d1e&name=default HTTP/1.1" status: 200 len: 216 time: 0.0097640 May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-0bc58c0a-4523-476f-afe3-d33a404d7a04 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-0bc58c0a-4523-476f-afe3-d33a404d7a04 None None] MFA Rules not processed for user `869ea9c4ad8b4dc093edb323b66436ab`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-0bc58c0a-4523-476f-afe3-d33a404d7a04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd77cf5-bb08-4d1e-834d-af552ee28f4c None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd77cf5-bb08-4d1e-834d-af552ee28f4c None admin] REQUEST_METHOD: `PUT` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd77cf5-bb08-4d1e-834d-af552ee28f4c None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd77cf5-bb08-4d1e-834d-af552ee28f4c None admin] PATH_INFO: `/v3/projects/fc1d7dd820ad45ef972127f6f0f4980e/users/3e37f1dedc43413abaedb9537451a247/roles/44620cad10ae407c90c91e2c296adb04` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd77cf5-bb08-4d1e-834d-af552ee28f4c None admin] RBAC: Authorizing `identity:create_grant(project_id=fc1d7dd820ad45ef972127f6f0f4980e, user_id=3e37f1dedc43413abaedb9537451a247, role_id=44620cad10ae407c90c91e2c296adb04)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd77cf5-bb08-4d1e-834d-af552ee28f4c None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1302/2575] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 12:59:50 2024] PUT /identity/v3/projects/fc1d7dd820ad45ef972127f6f0f4980e/users/3e37f1dedc43413abaedb9537451a247/roles/44620cad10ae407c90c91e2c296adb04 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd77cf5-bb08-4d1e-834d-af552ee28f4c None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-5cd77cf5-bb08-4d1e-834d-af552ee28f4c None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1274/2576] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:59:50 2024] POST /identity/v3/auth/tokens => generated 3986 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5f045e-3269-4464-b5eb-95ee05477ad5 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5f045e-3269-4464-b5eb-95ee05477ad5 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5f045e-3269-4464-b5eb-95ee05477ad5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-2a5f045e-3269-4464-b5eb-95ee05477ad5 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-2a5f045e-3269-4464-b5eb-95ee05477ad5 None None] MFA Rules not processed for user `3e37f1dedc43413abaedb9537451a247`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-2a5f045e-3269-4464-b5eb-95ee05477ad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd77cf5-bb08-4d1e-834d-af552ee28f4c None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15fd01a-9e4a-47fc-b520-0f4489de4a66 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15fd01a-9e4a-47fc-b520-0f4489de4a66 None admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15fd01a-9e4a-47fc-b520-0f4489de4a66 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15fd01a-9e4a-47fc-b520-0f4489de4a66 None admin] PATH_INFO: `/v3/projects/be41abb2eae44a6481cf94a21e347d1e` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15fd01a-9e4a-47fc-b520-0f4489de4a66 None admin] RBAC: Authorizing `identity:delete_project(project_id=be41abb2eae44a6481cf94a21e347d1e)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15fd01a-9e4a-47fc-b520-0f4489de4a66 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1275/2577] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:59:50 2024] POST /identity/v3/auth/tokens => generated 3938 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5f045e-3269-4464-b5eb-95ee05477ad5 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-2a5f045e-3269-4464-b5eb-95ee05477ad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5f045e-3269-4464-b5eb-95ee05477ad5 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-b15fd01a-9e4a-47fc-b520-0f4489de4a66 None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be41abb2eae44a6481cf94a21e347d1e', 'request_id': 'req-b15fd01a-9e4a-47fc-b520-0f4489de4a66'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-b15fd01a-9e4a-47fc-b520-0f4489de4a66 None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be41abb2eae44a6481cf94a21e347d1e', 'request_id': 'req-b15fd01a-9e4a-47fc-b520-0f4489de4a66'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-b15fd01a-9e4a-47fc-b520-0f4489de4a66 None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be41abb2eae44a6481cf94a21e347d1e', 'request_id': 'req-b15fd01a-9e4a-47fc-b520-0f4489de4a66'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d61533-03cf-4074-add9-b7ac6b51d56c None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d61533-03cf-4074-add9-b7ac6b51d56c None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d61533-03cf-4074-add9-b7ac6b51d56c None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d61533-03cf-4074-add9-b7ac6b51d56c None admin] PATH_INFO: `/v3/projects` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d61533-03cf-4074-add9-b7ac6b51d56c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d61533-03cf-4074-add9-b7ac6b51d56c None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-b15fd01a-9e4a-47fc-b520-0f4489de4a66 None admin] The token cache is being invalidate because project be41abb2eae44a6481cf94a21e347d1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-b15fd01a-9e4a-47fc-b520-0f4489de4a66 None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-b15fd01a-9e4a-47fc-b520-0f4489de4a66 None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1303/2578] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 12:59:50 2024] DELETE /identity/v3/projects/be41abb2eae44a6481cf94a21e347d1e => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15fd01a-9e4a-47fc-b520-0f4489de4a66 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-b15fd01a-9e4a-47fc-b520-0f4489de4a66 None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:59:51 l75lg1-v1 neutron-server[77618]: DEBUG neutron.wsgi [-] (77618) accepted ('10.27.203.238', 41256) {{(pid=77618) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15fd01a-9e4a-47fc-b520-0f4489de4a66 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:51 l75lg1-v1 neutron-server[77618]: INFO neutron.wsgi [None req-a58ba343-8e2a-40c4-b18c-e019864b0f37 None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=a8833f25920b4057b32b03094b1ca6f8&name=default HTTP/1.1" status: 200 len: 216 time: 0.0083985 May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384aeb92-0744-4f75-b197-6fb81a5b7253 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384aeb92-0744-4f75-b197-6fb81a5b7253 None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384aeb92-0744-4f75-b197-6fb81a5b7253 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384aeb92-0744-4f75-b197-6fb81a5b7253 None admin] PATH_INFO: `/v3/projects` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384aeb92-0744-4f75-b197-6fb81a5b7253 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384aeb92-0744-4f75-b197-6fb81a5b7253 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1276/2579] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 12:59:50 2024] POST /identity/v3/projects => generated 415 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d61533-03cf-4074-add9-b7ac6b51d56c None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-c5d61533-03cf-4074-add9-b7ac6b51d56c None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1304/2580] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 12:59:51 2024] POST /identity/v3/projects => generated 367 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384aeb92-0744-4f75-b197-6fb81a5b7253 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d61533-03cf-4074-add9-b7ac6b51d56c None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-384aeb92-0744-4f75-b197-6fb81a5b7253 None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55a46ac-9740-4f26-8d40-7b76be05fbeb None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55a46ac-9740-4f26-8d40-7b76be05fbeb None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55a46ac-9740-4f26-8d40-7b76be05fbeb None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55a46ac-9740-4f26-8d40-7b76be05fbeb None admin] PATH_INFO: `/v3/projects/a8833f25920b4057b32b03094b1ca6f8` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55a46ac-9740-4f26-8d40-7b76be05fbeb None admin] RBAC: Authorizing `identity:delete_project(project_id=a8833f25920b4057b32b03094b1ca6f8)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55a46ac-9740-4f26-8d40-7b76be05fbeb None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384aeb92-0744-4f75-b197-6fb81a5b7253 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542b0f93-1cf9-4ce2-a728-2c630b25b0a5 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542b0f93-1cf9-4ce2-a728-2c630b25b0a5 None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542b0f93-1cf9-4ce2-a728-2c630b25b0a5 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542b0f93-1cf9-4ce2-a728-2c630b25b0a5 None admin] PATH_INFO: `/v3/users` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542b0f93-1cf9-4ce2-a728-2c630b25b0a5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542b0f93-1cf9-4ce2-a728-2c630b25b0a5 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-542b0f93-1cf9-4ce2-a728-2c630b25b0a5 None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1305/2581] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 12:59:51 2024] POST /identity/v3/users => generated 316 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542b0f93-1cf9-4ce2-a728-2c630b25b0a5 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-a55a46ac-9740-4f26-8d40-7b76be05fbeb None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8833f25920b4057b32b03094b1ca6f8', 'request_id': 'req-a55a46ac-9740-4f26-8d40-7b76be05fbeb'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542b0f93-1cf9-4ce2-a728-2c630b25b0a5 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-a55a46ac-9740-4f26-8d40-7b76be05fbeb None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8833f25920b4057b32b03094b1ca6f8', 'request_id': 'req-a55a46ac-9740-4f26-8d40-7b76be05fbeb'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-a55a46ac-9740-4f26-8d40-7b76be05fbeb None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8833f25920b4057b32b03094b1ca6f8', 'request_id': 'req-a55a46ac-9740-4f26-8d40-7b76be05fbeb'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-a55a46ac-9740-4f26-8d40-7b76be05fbeb None admin] The token cache is being invalidate because project a8833f25920b4057b32b03094b1ca6f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-a55a46ac-9740-4f26-8d40-7b76be05fbeb None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ee30a9-c5e4-4825-b115-36e0d5309350 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-a55a46ac-9740-4f26-8d40-7b76be05fbeb None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ee30a9-c5e4-4825-b115-36e0d5309350 None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ee30a9-c5e4-4825-b115-36e0d5309350 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ee30a9-c5e4-4825-b115-36e0d5309350 None admin] PATH_INFO: `/v3/users` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ee30a9-c5e4-4825-b115-36e0d5309350 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1277/2582] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 12:59:51 2024] DELETE /identity/v3/projects/a8833f25920b4057b32b03094b1ca6f8 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ee30a9-c5e4-4825-b115-36e0d5309350 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55a46ac-9740-4f26-8d40-7b76be05fbeb None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-a55a46ac-9740-4f26-8d40-7b76be05fbeb None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-55ee30a9-c5e4-4825-b115-36e0d5309350 None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55a46ac-9740-4f26-8d40-7b76be05fbeb None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54224322-1b5f-47d4-91a7-7c87999853e9 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54224322-1b5f-47d4-91a7-7c87999853e9 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54224322-1b5f-47d4-91a7-7c87999853e9 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54224322-1b5f-47d4-91a7-7c87999853e9 None admin] PATH_INFO: `/v3/roles` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54224322-1b5f-47d4-91a7-7c87999853e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54224322-1b5f-47d4-91a7-7c87999853e9 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1306/2583] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 12:59:51 2024] POST /identity/v3/users => generated 291 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cde3fe-f15e-48df-b597-87f568adcb3e None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cde3fe-f15e-48df-b597-87f568adcb3e None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cde3fe-f15e-48df-b597-87f568adcb3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1278/2584] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 12:59:51 2024] GET /identity/v3/roles => generated 1680 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54224322-1b5f-47d4-91a7-7c87999853e9 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-54224322-1b5f-47d4-91a7-7c87999853e9 None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-b8cde3fe-f15e-48df-b597-87f568adcb3e None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54224322-1b5f-47d4-91a7-7c87999853e9 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-b8cde3fe-f15e-48df-b597-87f568adcb3e None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-b8cde3fe-f15e-48df-b597-87f568adcb3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95292681-4f66-4f1b-b337-2c928d0879e8 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95292681-4f66-4f1b-b337-2c928d0879e8 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95292681-4f66-4f1b-b337-2c928d0879e8 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1307/2585] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:59:51 2024] POST /identity/v3/auth/tokens => generated 312 bytes in 19 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95292681-4f66-4f1b-b337-2c928d0879e8 None admin] PATH_INFO: `/v3/roles` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cde3fe-f15e-48df-b597-87f568adcb3e None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95292681-4f66-4f1b-b337-2c928d0879e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95292681-4f66-4f1b-b337-2c928d0879e8 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cde3fe-f15e-48df-b597-87f568adcb3e None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7b0f29-8981-4aad-a75c-0a48e2d1ac8f None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7b0f29-8981-4aad-a75c-0a48e2d1ac8f None admin] REQUEST_METHOD: `PUT` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7b0f29-8981-4aad-a75c-0a48e2d1ac8f None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7b0f29-8981-4aad-a75c-0a48e2d1ac8f None admin] PATH_INFO: `/v3/projects/2eed962b52a8433c9c503bd3155203e0/users/1e9067b4178d457496506d1821472cf3/roles/44620cad10ae407c90c91e2c296adb04` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1279/2586] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 12:59:51 2024] GET /identity/v3/roles => generated 1680 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43d6dbd-43fc-4bb7-9716-33e9de14c9a9 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43d6dbd-43fc-4bb7-9716-33e9de14c9a9 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43d6dbd-43fc-4bb7-9716-33e9de14c9a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7b0f29-8981-4aad-a75c-0a48e2d1ac8f None admin] RBAC: Authorizing `identity:create_grant(project_id=2eed962b52a8433c9c503bd3155203e0, user_id=1e9067b4178d457496506d1821472cf3, role_id=44620cad10ae407c90c91e2c296adb04)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7b0f29-8981-4aad-a75c-0a48e2d1ac8f None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:51 l75lg1-v1 dstat.sh[49771]: 28-05 12:59:51| 18 2 75 4 0|5742M 1721M 277M 7884M| 17k 574B| 0 4312k| 0 491 | 12k 21k|0.99 1.03 1.00|2.0 1.0 0| 0 0 | 0 2048M| 29 364 0 38 2 May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-a43d6dbd-43fc-4bb7-9716-33e9de14c9a9 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-a43d6dbd-43fc-4bb7-9716-33e9de14c9a9 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-a43d6dbd-43fc-4bb7-9716-33e9de14c9a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1280/2587] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:59:51 2024] POST /identity/v3/auth/tokens => generated 2960 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43d6dbd-43fc-4bb7-9716-33e9de14c9a9 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43d6dbd-43fc-4bb7-9716-33e9de14c9a9 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d8c70f-d265-45b7-ab9f-f9124ef88d9b None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d8c70f-d265-45b7-ab9f-f9124ef88d9b None admin] REQUEST_METHOD: `PUT` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d8c70f-d265-45b7-ab9f-f9124ef88d9b None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d8c70f-d265-45b7-ab9f-f9124ef88d9b None admin] PATH_INFO: `/v3/projects/f353f66e6e00471aa584ea2e39c0ab0e/users/91af4223eb404925980daea7f7bde321/roles/e7989893488f483baa107be56668c4f8` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d8c70f-d265-45b7-ab9f-f9124ef88d9b None admin] RBAC: Authorizing `identity:create_grant(project_id=f353f66e6e00471aa584ea2e39c0ab0e, user_id=91af4223eb404925980daea7f7bde321, role_id=e7989893488f483baa107be56668c4f8)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d8c70f-d265-45b7-ab9f-f9124ef88d9b None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1308/2588] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 12:59:51 2024] PUT /identity/v3/projects/2eed962b52a8433c9c503bd3155203e0/users/1e9067b4178d457496506d1821472cf3/roles/44620cad10ae407c90c91e2c296adb04 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7b0f29-8981-4aad-a75c-0a48e2d1ac8f None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7b0f29-8981-4aad-a75c-0a48e2d1ac8f None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ad694a-e98f-4783-9ccb-b2ede0131ecf None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ad694a-e98f-4783-9ccb-b2ede0131ecf None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ad694a-e98f-4783-9ccb-b2ede0131ecf None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ad694a-e98f-4783-9ccb-b2ede0131ecf None admin] PATH_INFO: `/v3/domains` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ad694a-e98f-4783-9ccb-b2ede0131ecf None admin] RBAC: Adding query filter params (name=Default) {{(pid=51267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ad694a-e98f-4783-9ccb-b2ede0131ecf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1281/2589] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 12:59:51 2024] PUT /identity/v3/projects/f353f66e6e00471aa584ea2e39c0ab0e/users/91af4223eb404925980daea7f7bde321/roles/e7989893488f483baa107be56668c4f8 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4b66ce-383d-481e-8ca0-63c3979a59c2 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4b66ce-383d-481e-8ca0-63c3979a59c2 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ad694a-e98f-4783-9ccb-b2ede0131ecf None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4b66ce-383d-481e-8ca0-63c3979a59c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1309/2590] 10.27.203.238 () {62 vars in 1220 bytes} [Tue May 28 12:59:51 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ad694a-e98f-4783-9ccb-b2ede0131ecf None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-7b4b66ce-383d-481e-8ca0-63c3979a59c2 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ad694a-e98f-4783-9ccb-b2ede0131ecf None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-7b4b66ce-383d-481e-8ca0-63c3979a59c2 None None] MFA Rules not processed for user `1e9067b4178d457496506d1821472cf3`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-7b4b66ce-383d-481e-8ca0-63c3979a59c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc21651-fd04-4a6e-a5a2-67d1826cc984 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc21651-fd04-4a6e-a5a2-67d1826cc984 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc21651-fd04-4a6e-a5a2-67d1826cc984 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc21651-fd04-4a6e-a5a2-67d1826cc984 None admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc21651-fd04-4a6e-a5a2-67d1826cc984 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc21651-fd04-4a6e-a5a2-67d1826cc984 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1310/2591] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 12:59:51 2024] GET /identity/v3/roles => generated 1680 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc21651-fd04-4a6e-a5a2-67d1826cc984 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc21651-fd04-4a6e-a5a2-67d1826cc984 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163d3473-2c05-4f55-8330-eb8744468eb4 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163d3473-2c05-4f55-8330-eb8744468eb4 None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163d3473-2c05-4f55-8330-eb8744468eb4 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163d3473-2c05-4f55-8330-eb8744468eb4 None admin] PATH_INFO: `/v3/projects` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163d3473-2c05-4f55-8330-eb8744468eb4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163d3473-2c05-4f55-8330-eb8744468eb4 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1282/2592] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:59:51 2024] POST /identity/v3/auth/tokens => generated 3986 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4b66ce-383d-481e-8ca0-63c3979a59c2 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4b66ce-383d-481e-8ca0-63c3979a59c2 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5540a6a-febd-4493-9386-70f1f351c0fe None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5540a6a-febd-4493-9386-70f1f351c0fe None admin] REQUEST_METHOD: `PUT` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5540a6a-febd-4493-9386-70f1f351c0fe None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5540a6a-febd-4493-9386-70f1f351c0fe None admin] PATH_INFO: `/v3/projects/f353f66e6e00471aa584ea2e39c0ab0e/users/91af4223eb404925980daea7f7bde321/roles/e7989893488f483baa107be56668c4f8` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5540a6a-febd-4493-9386-70f1f351c0fe None admin] RBAC: Authorizing `identity:create_grant(project_id=f353f66e6e00471aa584ea2e39c0ab0e, user_id=91af4223eb404925980daea7f7bde321, role_id=e7989893488f483baa107be56668c4f8)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5540a6a-febd-4493-9386-70f1f351c0fe None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1283/2593] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 12:59:51 2024] PUT /identity/v3/projects/f353f66e6e00471aa584ea2e39c0ab0e/users/91af4223eb404925980daea7f7bde321/roles/e7989893488f483baa107be56668c4f8 => generated 0 bytes in 20 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5540a6a-febd-4493-9386-70f1f351c0fe None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1311/2594] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 12:59:51 2024] POST /identity/v3/projects => generated 401 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95ac82e-52b6-4d0c-bee1-e08abcb749cd None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95ac82e-52b6-4d0c-bee1-e08abcb749cd None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95ac82e-52b6-4d0c-bee1-e08abcb749cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-f95ac82e-52b6-4d0c-bee1-e08abcb749cd None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5540a6a-febd-4493-9386-70f1f351c0fe None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-f95ac82e-52b6-4d0c-bee1-e08abcb749cd None None] MFA Rules not processed for user `91af4223eb404925980daea7f7bde321`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-f95ac82e-52b6-4d0c-bee1-e08abcb749cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057f6ca0-006c-4f0e-8878-9486312811d2 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057f6ca0-006c-4f0e-8878-9486312811d2 None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057f6ca0-006c-4f0e-8878-9486312811d2 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057f6ca0-006c-4f0e-8878-9486312811d2 None admin] PATH_INFO: `/v3/projects` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057f6ca0-006c-4f0e-8878-9486312811d2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057f6ca0-006c-4f0e-8878-9486312811d2 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1312/2595] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:59:51 2024] POST /identity/v3/auth/tokens => generated 4061 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95ac82e-52b6-4d0c-bee1-e08abcb749cd None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95ac82e-52b6-4d0c-bee1-e08abcb749cd None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20db15c6-1958-4eeb-b063-d1ff515b624f None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20db15c6-1958-4eeb-b063-d1ff515b624f None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20db15c6-1958-4eeb-b063-d1ff515b624f None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20db15c6-1958-4eeb-b063-d1ff515b624f None admin] PATH_INFO: `/v3/users` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20db15c6-1958-4eeb-b063-d1ff515b624f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20db15c6-1958-4eeb-b063-d1ff515b624f None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-20db15c6-1958-4eeb-b063-d1ff515b624f None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1284/2596] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 12:59:51 2024] POST /identity/v3/projects => generated 413 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057f6ca0-006c-4f0e-8878-9486312811d2 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1313/2597] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 12:59:51 2024] POST /identity/v3/users => generated 308 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20db15c6-1958-4eeb-b063-d1ff515b624f None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20db15c6-1958-4eeb-b063-d1ff515b624f None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:51 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:59:51 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.manager [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=83654) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10545}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae28a0d9-326a-47b7-b65d-549d62028bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae28a0d9-326a-47b7-b65d-549d62028bb6 None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae28a0d9-326a-47b7-b65d-549d62028bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae28a0d9-326a-47b7-b65d-549d62028bb6 None admin] PATH_INFO: `/v3/users` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae28a0d9-326a-47b7-b65d-549d62028bb6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae28a0d9-326a-47b7-b65d-549d62028bb6 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057f6ca0-006c-4f0e-8878-9486312811d2 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-ae28a0d9-326a-47b7-b65d-549d62028bb6 None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c69cc51-4aac-47ce-9b29-63bb0ed454e0 tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91af4223eb404925980daea7f7bde321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f353f66e6e00471aa584ea2e39c0ab0e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c69cc51-4aac-47ce-9b29-63bb0ed454e0 tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c69cc51-4aac-47ce-9b29-63bb0ed454e0 tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c69cc51-4aac-47ce-9b29-63bb0ed454e0 tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] PATH_INFO: `/v3/domains` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c69cc51-4aac-47ce-9b29-63bb0ed454e0 tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c69cc51-4aac-47ce-9b29-63bb0ed454e0 tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c69cc51-4aac-47ce-9b29-63bb0ed454e0 tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1285/2598] 10.27.203.238 () {62 vars in 1241 bytes} [Tue May 28 12:59:51 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c69cc51-4aac-47ce-9b29-63bb0ed454e0 tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c69cc51-4aac-47ce-9b29-63bb0ed454e0 tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bfa31f-cf68-4e6b-9d4f-e7f1ca15d76f None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bfa31f-cf68-4e6b-9d4f-e7f1ca15d76f None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bfa31f-cf68-4e6b-9d4f-e7f1ca15d76f None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bfa31f-cf68-4e6b-9d4f-e7f1ca15d76f None admin] PATH_INFO: `/v3/roles` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bfa31f-cf68-4e6b-9d4f-e7f1ca15d76f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bfa31f-cf68-4e6b-9d4f-e7f1ca15d76f None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1286/2599] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 12:59:51 2024] GET /identity/v3/roles => generated 1680 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bfa31f-cf68-4e6b-9d4f-e7f1ca15d76f None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1314/2600] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 12:59:51 2024] POST /identity/v3/users => generated 314 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bfa31f-cf68-4e6b-9d4f-e7f1ca15d76f None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae28a0d9-326a-47b7-b65d-549d62028bb6 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae28a0d9-326a-47b7-b65d-549d62028bb6 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e11a6ab-422a-4c46-8a94-6b292e2e1399 tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91af4223eb404925980daea7f7bde321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f353f66e6e00471aa584ea2e39c0ab0e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e11a6ab-422a-4c46-8a94-6b292e2e1399 tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e11a6ab-422a-4c46-8a94-6b292e2e1399 tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e11a6ab-422a-4c46-8a94-6b292e2e1399 tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] PATH_INFO: `/v3/users` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e11a6ab-422a-4c46-8a94-6b292e2e1399 tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e11a6ab-422a-4c46-8a94-6b292e2e1399 tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605fd996-6e92-4670-b360-e662b2d65c85 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605fd996-6e92-4670-b360-e662b2d65c85 None admin] REQUEST_METHOD: `PUT` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605fd996-6e92-4670-b360-e662b2d65c85 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605fd996-6e92-4670-b360-e662b2d65c85 None admin] PATH_INFO: `/v3/projects/3520fb8495ee410b81f6760a62e1bca2/users/bd14fa1f9f8a4d93b7f67c5b53f29c99/roles/e7989893488f483baa107be56668c4f8` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-4e11a6ab-422a-4c46-8a94-6b292e2e1399 tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] Truncating password to algorithm specific maximum length 72 characters. May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605fd996-6e92-4670-b360-e662b2d65c85 None admin] RBAC: Authorizing `identity:create_grant(project_id=3520fb8495ee410b81f6760a62e1bca2, user_id=bd14fa1f9f8a4d93b7f67c5b53f29c99, role_id=e7989893488f483baa107be56668c4f8)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605fd996-6e92-4670-b360-e662b2d65c85 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1287/2601] 10.27.203.238 () {64 vars in 1232 bytes} [Tue May 28 12:59:51 2024] POST /identity/v3/users => generated 435 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e11a6ab-422a-4c46-8a94-6b292e2e1399 tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e11a6ab-422a-4c46-8a94-6b292e2e1399 tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1315/2602] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 12:59:51 2024] PUT /identity/v3/projects/3520fb8495ee410b81f6760a62e1bca2/users/bd14fa1f9f8a4d93b7f67c5b53f29c99/roles/e7989893488f483baa107be56668c4f8 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605fd996-6e92-4670-b360-e662b2d65c85 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe4fd75-69f4-4fe1-bab2-1d35f2298cb5 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe4fd75-69f4-4fe1-bab2-1d35f2298cb5 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe4fd75-69f4-4fe1-bab2-1d35f2298cb5 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe4fd75-69f4-4fe1-bab2-1d35f2298cb5 None admin] PATH_INFO: `/v3/roles` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe4fd75-69f4-4fe1-bab2-1d35f2298cb5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe4fd75-69f4-4fe1-bab2-1d35f2298cb5 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1288/2603] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 12:59:51 2024] GET /identity/v3/roles => generated 1680 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe4fd75-69f4-4fe1-bab2-1d35f2298cb5 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe4fd75-69f4-4fe1-bab2-1d35f2298cb5 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6fea48-caa5-40e7-bd86-8a3ff1af2539 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6fea48-caa5-40e7-bd86-8a3ff1af2539 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6fea48-caa5-40e7-bd86-8a3ff1af2539 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6fea48-caa5-40e7-bd86-8a3ff1af2539 None admin] PATH_INFO: `/v3/roles` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6fea48-caa5-40e7-bd86-8a3ff1af2539 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6fea48-caa5-40e7-bd86-8a3ff1af2539 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1289/2604] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 12:59:51 2024] GET /identity/v3/roles => generated 1680 bytes in 16 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6fea48-caa5-40e7-bd86-8a3ff1af2539 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6fea48-caa5-40e7-bd86-8a3ff1af2539 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605fd996-6e92-4670-b360-e662b2d65c85 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4ef99d-35be-4016-bb01-dc3f2999b4fe None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4ef99d-35be-4016-bb01-dc3f2999b4fe None admin] REQUEST_METHOD: `PUT` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4ef99d-35be-4016-bb01-dc3f2999b4fe None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4ef99d-35be-4016-bb01-dc3f2999b4fe None admin] PATH_INFO: `/v3/projects/8f5f6af328db444086f50a26f4d62e63/users/b04fbccbd4af4d03ba7d54550e06e586/roles/e7989893488f483baa107be56668c4f8` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee639399-9263-4ee9-be2e-555864ec16d4 tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91af4223eb404925980daea7f7bde321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f353f66e6e00471aa584ea2e39c0ab0e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee639399-9263-4ee9-be2e-555864ec16d4 tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee639399-9263-4ee9-be2e-555864ec16d4 tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee639399-9263-4ee9-be2e-555864ec16d4 tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee639399-9263-4ee9-be2e-555864ec16d4 tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee639399-9263-4ee9-be2e-555864ec16d4 tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1316/2605] 10.27.203.238 () {62 vars in 1210 bytes} [Tue May 28 12:59:51 2024] GET /identity/v3/roles => generated 1680 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4ef99d-35be-4016-bb01-dc3f2999b4fe None admin] RBAC: Authorizing `identity:create_grant(project_id=8f5f6af328db444086f50a26f4d62e63, user_id=b04fbccbd4af4d03ba7d54550e06e586, role_id=e7989893488f483baa107be56668c4f8)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee639399-9263-4ee9-be2e-555864ec16d4 tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4ef99d-35be-4016-bb01-dc3f2999b4fe None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee639399-9263-4ee9-be2e-555864ec16d4 tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10f41c8-0968-4ade-9215-bfe3f0d90dc2 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10f41c8-0968-4ade-9215-bfe3f0d90dc2 None admin] REQUEST_METHOD: `PUT` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10f41c8-0968-4ade-9215-bfe3f0d90dc2 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10f41c8-0968-4ade-9215-bfe3f0d90dc2 None admin] PATH_INFO: `/v3/projects/3520fb8495ee410b81f6760a62e1bca2/users/bd14fa1f9f8a4d93b7f67c5b53f29c99/roles/e7989893488f483baa107be56668c4f8` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10f41c8-0968-4ade-9215-bfe3f0d90dc2 None admin] RBAC: Authorizing `identity:create_grant(project_id=3520fb8495ee410b81f6760a62e1bca2, user_id=bd14fa1f9f8a4d93b7f67c5b53f29c99, role_id=e7989893488f483baa107be56668c4f8)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10f41c8-0968-4ade-9215-bfe3f0d90dc2 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1317/2606] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 12:59:51 2024] PUT /identity/v3/projects/3520fb8495ee410b81f6760a62e1bca2/users/bd14fa1f9f8a4d93b7f67c5b53f29c99/roles/e7989893488f483baa107be56668c4f8 => generated 0 bytes in 21 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10f41c8-0968-4ade-9215-bfe3f0d90dc2 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1290/2607] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 12:59:51 2024] PUT /identity/v3/projects/8f5f6af328db444086f50a26f4d62e63/users/b04fbccbd4af4d03ba7d54550e06e586/roles/e7989893488f483baa107be56668c4f8 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4442af3-e599-4645-855a-8358db6508cf None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4442af3-e599-4645-855a-8358db6508cf None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4442af3-e599-4645-855a-8358db6508cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-c4442af3-e599-4645-855a-8358db6508cf None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-c4442af3-e599-4645-855a-8358db6508cf None None] MFA Rules not processed for user `bd14fa1f9f8a4d93b7f67c5b53f29c99`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-c4442af3-e599-4645-855a-8358db6508cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10f41c8-0968-4ade-9215-bfe3f0d90dc2 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605d65db-4aed-45c6-a987-2319e75e4a5c tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91af4223eb404925980daea7f7bde321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f353f66e6e00471aa584ea2e39c0ab0e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605d65db-4aed-45c6-a987-2319e75e4a5c tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] REQUEST_METHOD: `PUT` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605d65db-4aed-45c6-a987-2319e75e4a5c tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1291/2608] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:59:51 2024] POST /identity/v3/auth/tokens => generated 4095 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605d65db-4aed-45c6-a987-2319e75e4a5c tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] PATH_INFO: `/v3/projects/f353f66e6e00471aa584ea2e39c0ab0e/users/756070dd0b274fd8835b10a8fbe293d9/roles/44620cad10ae407c90c91e2c296adb04` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4442af3-e599-4645-855a-8358db6508cf None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605d65db-4aed-45c6-a987-2319e75e4a5c tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] RBAC: Authorizing `identity:create_grant(project_id=f353f66e6e00471aa584ea2e39c0ab0e, user_id=756070dd0b274fd8835b10a8fbe293d9, role_id=44620cad10ae407c90c91e2c296adb04)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605d65db-4aed-45c6-a987-2319e75e4a5c tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4442af3-e599-4645-855a-8358db6508cf None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c6df4e-c215-4377-883b-dbd9705d5ad9 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c6df4e-c215-4377-883b-dbd9705d5ad9 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c6df4e-c215-4377-883b-dbd9705d5ad9 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c6df4e-c215-4377-883b-dbd9705d5ad9 None admin] PATH_INFO: `/v3/roles` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c6df4e-c215-4377-883b-dbd9705d5ad9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c6df4e-c215-4377-883b-dbd9705d5ad9 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1292/2609] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 12:59:51 2024] GET /identity/v3/roles => generated 1680 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c6df4e-c215-4377-883b-dbd9705d5ad9 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-14c6df4e-c215-4377-883b-dbd9705d5ad9 None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1318/2610] 10.27.203.238 () {64 vars in 1571 bytes} [Tue May 28 12:59:51 2024] PUT /identity/v3/projects/f353f66e6e00471aa584ea2e39c0ab0e/users/756070dd0b274fd8835b10a8fbe293d9/roles/44620cad10ae407c90c91e2c296adb04 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605d65db-4aed-45c6-a987-2319e75e4a5c tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605d65db-4aed-45c6-a987-2319e75e4a5c tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c6df4e-c215-4377-883b-dbd9705d5ad9 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc27c936-737d-4537-b6c0-8300a75bc201 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc27c936-737d-4537-b6c0-8300a75bc201 None admin] REQUEST_METHOD: `PUT` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc27c936-737d-4537-b6c0-8300a75bc201 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc27c936-737d-4537-b6c0-8300a75bc201 None admin] PATH_INFO: `/v3/projects/8f5f6af328db444086f50a26f4d62e63/users/b04fbccbd4af4d03ba7d54550e06e586/roles/e7989893488f483baa107be56668c4f8` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc27c936-737d-4537-b6c0-8300a75bc201 None admin] RBAC: Authorizing `identity:create_grant(project_id=8f5f6af328db444086f50a26f4d62e63, user_id=b04fbccbd4af4d03ba7d54550e06e586, role_id=e7989893488f483baa107be56668c4f8)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:51 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ed0a7819-4d25-4529-a43e-03a7ee4ac7c2 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] <<< [PATCH] https://127.0.0.1:40443/api/viewpolicies/32/ May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc27c936-737d-4537-b6c0-8300a75bc201 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:51 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ed0a7819-4d25-4529-a43e-03a7ee4ac7c2 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=1, created='2024-05-28T12:58:43.845440Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='31b6534b-d142-4561-992f-4f0759db302d', id=32, internal=False, is_s3_default_policy=False, name='7fdd602c-79d0-479c-95a2-336b202c6639', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=['*'], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=[], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=[], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='MODIFYING', sync_time='2024-05-28T12:59:51.387894Z', tenant_id=1, tenant_name='default', title='7fdd602c-79d0-479c-95a2-336b202c6639', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/32/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[]) May 28 12:59:51 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ed0a7819-4d25-4529-a43e-03a7ee4ac7c2 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] --- [PATCH] https://127.0.0.1:40443/api/viewpolicies/32/: Done May 28 12:59:51 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-ed0a7819-4d25-4529-a43e-03a7ee4ac7c2 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:51 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-ed0a7819-4d25-4529-a43e-03a7ee4ac7c2 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1319/2611] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 12:59:51 2024] PUT /identity/v3/projects/8f5f6af328db444086f50a26f4d62e63/users/b04fbccbd4af4d03ba7d54550e06e586/roles/e7989893488f483baa107be56668c4f8 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc27c936-737d-4537-b6c0-8300a75bc201 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-bc27c936-737d-4537-b6c0-8300a75bc201 None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:59:51 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-ed0a7819-4d25-4529-a43e-03a7ee4ac7c2 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.030s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:51 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-ed0a7819-4d25-4529-a43e-03a7ee4ac7c2 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:51 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-ed0a7819-4d25-4529-a43e-03a7ee4ac7c2 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094233df-2582-47b7-99b3-3a5a10da2ba1 service manila] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f110cf6300f049c897d0aab63218d1e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094233df-2582-47b7-99b3-3a5a10da2ba1 service manila] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094233df-2582-47b7-99b3-3a5a10da2ba1 service manila] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094233df-2582-47b7-99b3-3a5a10da2ba1 service manila] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc27c936-737d-4537-b6c0-8300a75bc201 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:51 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-ed0a7819-4d25-4529-a43e-03a7ee4ac7c2 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.027s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:51 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-ed0a7819-4d25-4529-a43e-03a7ee4ac7c2 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:51 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-ed0a7819-4d25-4529-a43e-03a7ee4ac7c2 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3107b922-add4-4105-aa8e-a56cf902a95d service manila] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f110cf6300f049c897d0aab63218d1e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3107b922-add4-4105-aa8e-a56cf902a95d service manila] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3107b922-add4-4105-aa8e-a56cf902a95d service manila] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3107b922-add4-4105-aa8e-a56cf902a95d service manila] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:52 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-ed0a7819-4d25-4529-a43e-03a7ee4ac7c2 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:52 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-ed0a7819-4d25-4529-a43e-03a7ee4ac7c2 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:52 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-ed0a7819-4d25-4529-a43e-03a7ee4ac7c2 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:52 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-ed0a7819-4d25-4529-a43e-03a7ee4ac7c2 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:52 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-ed0a7819-4d25-4529-a43e-03a7ee4ac7c2 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:52 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-ed0a7819-4d25-4529-a43e-03a7ee4ac7c2 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094233df-2582-47b7-99b3-3a5a10da2ba1 service manila] RBAC: Authorizing `identity:validate_token()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094233df-2582-47b7-99b3-3a5a10da2ba1 service manila] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1293/2612] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 12:59:51 2024] GET /identity/v3/auth/tokens => generated 4095 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa80422-3fc4-4b02-bef4-10a261010b79 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa80422-3fc4-4b02-bef4-10a261010b79 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa80422-3fc4-4b02-bef4-10a261010b79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:52 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-6d8de220-ad07-4e49-a17c-80af69776cb5 tempest-ShareNetworkSubnetsNegativeTest-1848515568 tempest-ShareNetworkSubnetsNegativeTest-1848515568-project-admin] POST http://10.27.203.238/share/v2/3520fb8495ee410b81f6760a62e1bca2/share-networks May 28 12:59:52 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-6d8de220-ad07-4e49-a17c-80af69776cb5 tempest-ShareNetworkSubnetsNegativeTest-1848515568 tempest-ShareNetworkSubnetsNegativeTest-1848515568-project-admin] Action: 'create', calling method: ShareNetworkController.create, body: {"share_network": {"cleanup_in_class": true}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-afa80422-3fc4-4b02-bef4-10a261010b79 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-afa80422-3fc4-4b02-bef4-10a261010b79 None None] MFA Rules not processed for user `b04fbccbd4af4d03ba7d54550e06e586`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:59:52 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-ed0a7819-4d25-4529-a43e-03a7ee4ac7c2 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.040s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-afa80422-3fc4-4b02-bef4-10a261010b79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:59:52 l75lg1-v1 manila-share[98474]: INFO manila.share.access [None req-ed0a7819-4d25-4529-a43e-03a7ee4ac7c2 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Access rules were successfully modified for share instance 7fdd602c-79d0-479c-95a2-336b202c6639 belonging to share 72db8769-ece7-42ff-af27-2e778292a9b4. May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3107b922-add4-4105-aa8e-a56cf902a95d service manila] RBAC: Authorizing `identity:validate_token()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3107b922-add4-4105-aa8e-a56cf902a95d service manila] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1320/2613] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 12:59:51 2024] GET /identity/v3/auth/tokens => generated 4061 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 12:59:52 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-41aa3904-0810-4637-9752-5012d7415890 tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] POST http://10.27.203.238/share/v2/f353f66e6e00471aa584ea2e39c0ab0e/types May 28 12:59:52 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-41aa3904-0810-4637-9752-5012d7415890 tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share_type": {"name": "tempest-typeshare-type-547314785", "extra_specs": {"driver_handles_share_servers": "False"}, "share_type_access:is_public": true}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:59:52 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.quota [None req-6d8de220-ad07-4e49-a17c-80af69776cb5 tempest-ShareNetworkSubnetsNegativeTest-1848515568 tempest-ShareNetworkSubnetsNegativeTest-1848515568-project-admin] Created reservations ['56aca55a-746d-4087-aaa1-d02eb297615e'] {{(pid=98329) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 12:59:52 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-41aa3904-0810-4637-9752-5012d7415890 tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] http://10.27.203.238/share/v2/f353f66e6e00471aa584ea2e39c0ab0e/types returned with HTTP 200 May 28 12:59:52 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 784/1581] 10.27.203.238 () {66 vars in 1359 bytes} [Tue May 28 12:59:51 2024] POST /share/v2/f353f66e6e00471aa584ea2e39c0ab0e/types => generated 621 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3107b922-add4-4105-aa8e-a56cf902a95d service manila] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3107b922-add4-4105-aa8e-a56cf902a95d service manila] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b82d4cb-492a-4385-ba0d-ddb581395851 service manila] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f110cf6300f049c897d0aab63218d1e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b82d4cb-492a-4385-ba0d-ddb581395851 service manila] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b82d4cb-492a-4385-ba0d-ddb581395851 service manila] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b82d4cb-492a-4385-ba0d-ddb581395851 service manila] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-6b82d4cb-492a-4385-ba0d-ddb581395851 service manila] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1294/2614] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:59:52 2024] POST /identity/v3/auth/tokens => generated 4107 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa80422-3fc4-4b02-bef4-10a261010b79 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa80422-3fc4-4b02-bef4-10a261010b79 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1759925-b5e4-4254-b87e-a61d40fa800a tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571 tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b04fbccbd4af4d03ba7d54550e06e586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f5f6af328db444086f50a26f4d62e63', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1759925-b5e4-4254-b87e-a61d40fa800a tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571 tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571-project-admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1759925-b5e4-4254-b87e-a61d40fa800a tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571 tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1759925-b5e4-4254-b87e-a61d40fa800a tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571 tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571-project-admin] PATH_INFO: `/v3/domains` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1759925-b5e4-4254-b87e-a61d40fa800a tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571 tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1759925-b5e4-4254-b87e-a61d40fa800a tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571 tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1759925-b5e4-4254-b87e-a61d40fa800a tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571 tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1295/2615] 10.27.203.238 () {62 vars in 1241 bytes} [Tue May 28 12:59:52 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1759925-b5e4-4254-b87e-a61d40fa800a tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571 tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1759925-b5e4-4254-b87e-a61d40fa800a tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571 tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b476d790-afd9-4918-ac11-f304b14579c0 tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571 tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b04fbccbd4af4d03ba7d54550e06e586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f5f6af328db444086f50a26f4d62e63', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b476d790-afd9-4918-ac11-f304b14579c0 tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571 tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571-project-admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b476d790-afd9-4918-ac11-f304b14579c0 tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571 tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b476d790-afd9-4918-ac11-f304b14579c0 tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571 tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571-project-admin] PATH_INFO: `/v3/users` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b476d790-afd9-4918-ac11-f304b14579c0 tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571 tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b476d790-afd9-4918-ac11-f304b14579c0 tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571 tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-b476d790-afd9-4918-ac11-f304b14579c0 tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571 tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571-project-admin] Truncating password to algorithm specific maximum length 72 characters. May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b82d4cb-492a-4385-ba0d-ddb581395851 service manila] RBAC: Authorizing `identity:validate_token()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:52 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.quota [None req-6d8de220-ad07-4e49-a17c-80af69776cb5 tempest-ShareNetworkSubnetsNegativeTest-1848515568 tempest-ShareNetworkSubnetsNegativeTest-1848515568-project-admin] Committed reservations ['56aca55a-746d-4087-aaa1-d02eb297615e'] {{(pid=98329) commit /opt/stack/manila/manila/quota.py:1063}} May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b82d4cb-492a-4385-ba0d-ddb581395851 service manila] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1321/2616] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 12:59:52 2024] GET /identity/v3/auth/tokens => generated 3938 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 12:59:52 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-e7245d6a-0625-4258-a172-a4e5aad67460 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] POST http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/shares May 28 12:59:52 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-e7245d6a-0625-4258-a172-a4e5aad67460 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share": {"share_proto": "nfs", "description": "Tempest's share", "snapshot_id": null, "name": "tempest-tempest-created-share-509111124", "size": 1, "metadata": {}, "is_public": false, "share_type": "1749967d-80e1-4d76-8cac-122e8902d0cd"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:59:52 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.v1.shares [None req-e7245d6a-0625-4258-a172-a4e5aad67460 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Create NFS share of 1 GB May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1296/2617] 10.27.203.238 () {64 vars in 1232 bytes} [Tue May 28 12:59:52 2024] POST /identity/v3/users => generated 435 bytes in 33 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b82d4cb-492a-4385-ba0d-ddb581395851 service manila] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:52 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-6d8de220-ad07-4e49-a17c-80af69776cb5 tempest-ShareNetworkSubnetsNegativeTest-1848515568 tempest-ShareNetworkSubnetsNegativeTest-1848515568-project-admin] http://10.27.203.238/share/v2/3520fb8495ee410b81f6760a62e1bca2/share-networks returned with HTTP 200 May 28 12:59:52 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 798/1582] 10.27.203.238 () {66 vars in 1385 bytes} [Tue May 28 12:59:51 2024] POST /share/v2/3520fb8495ee410b81f6760a62e1bca2/share-networks => generated 662 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b82d4cb-492a-4385-ba0d-ddb581395851 service manila] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:52 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-7f1498c3-8a58-4ad3-b167-1942df69b30f tempest-ShareNetworkSubnetsNegativeTest-1848515568 tempest-ShareNetworkSubnetsNegativeTest-1848515568-project-admin] POST http://10.27.203.238/share/v2/3520fb8495ee410b81f6760a62e1bca2/types May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25a8598-eaa6-4f4e-afc6-490cbd4fdb6f tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571 tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b04fbccbd4af4d03ba7d54550e06e586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f5f6af328db444086f50a26f4d62e63', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:52 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-7f1498c3-8a58-4ad3-b167-1942df69b30f tempest-ShareNetworkSubnetsNegativeTest-1848515568 tempest-ShareNetworkSubnetsNegativeTest-1848515568-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share_type": {"name": "tempest-typeshare-type-1973271420", "extra_specs": {"driver_handles_share_servers": "False"}, "share_type_access:is_public": true}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25a8598-eaa6-4f4e-afc6-490cbd4fdb6f tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571 tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571-project-admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25a8598-eaa6-4f4e-afc6-490cbd4fdb6f tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571 tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25a8598-eaa6-4f4e-afc6-490cbd4fdb6f tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571 tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571-project-admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25a8598-eaa6-4f4e-afc6-490cbd4fdb6f tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571 tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25a8598-eaa6-4f4e-afc6-490cbd4fdb6f tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571 tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1322/2618] 10.27.203.238 () {62 vars in 1210 bytes} [Tue May 28 12:59:52 2024] GET /identity/v3/roles => generated 1680 bytes in 18 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b476d790-afd9-4918-ac11-f304b14579c0 tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571 tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b476d790-afd9-4918-ac11-f304b14579c0 tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571 tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:52 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-7f1498c3-8a58-4ad3-b167-1942df69b30f tempest-ShareNetworkSubnetsNegativeTest-1848515568 tempest-ShareNetworkSubnetsNegativeTest-1848515568-project-admin] http://10.27.203.238/share/v2/3520fb8495ee410b81f6760a62e1bca2/types returned with HTTP 200 May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6db0a4-0045-4f8a-ab9e-a875dee646bc tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571 tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b04fbccbd4af4d03ba7d54550e06e586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f5f6af328db444086f50a26f4d62e63', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:52 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 799/1583] 10.27.203.238 () {66 vars in 1359 bytes} [Tue May 28 12:59:52 2024] POST /share/v2/3520fb8495ee410b81f6760a62e1bca2/types => generated 623 bytes in 24 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6db0a4-0045-4f8a-ab9e-a875dee646bc tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571 tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571-project-admin] REQUEST_METHOD: `PUT` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6db0a4-0045-4f8a-ab9e-a875dee646bc tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571 tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6db0a4-0045-4f8a-ab9e-a875dee646bc tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571 tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571-project-admin] PATH_INFO: `/v3/projects/8f5f6af328db444086f50a26f4d62e63/users/dacf9ff99e1c456cb98dc54de91b36a3/roles/44620cad10ae407c90c91e2c296adb04` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:52 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-bb2c26cb-cd80-4936-a652-e99ffebc3f19 tempest-ShareNetworkSubnetsNegativeTest-1848515568 tempest-ShareNetworkSubnetsNegativeTest-1848515568-project-admin] GET http://10.27.203.238/share/v2/3520fb8495ee410b81f6760a62e1bca2/availability-zones May 28 12:59:52 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-bb2c26cb-cd80-4936-a652-e99ffebc3f19 tempest-ShareNetworkSubnetsNegativeTest-1848515568 tempest-ShareNetworkSubnetsNegativeTest-1848515568-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:52 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-bb2c26cb-cd80-4936-a652-e99ffebc3f19 tempest-ShareNetworkSubnetsNegativeTest-1848515568 tempest-ShareNetworkSubnetsNegativeTest-1848515568-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6db0a4-0045-4f8a-ab9e-a875dee646bc tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571 tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571-project-admin] RBAC: Authorizing `identity:create_grant(project_id=8f5f6af328db444086f50a26f4d62e63, user_id=dacf9ff99e1c456cb98dc54de91b36a3, role_id=44620cad10ae407c90c91e2c296adb04)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:52 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-bb2c26cb-cd80-4936-a652-e99ffebc3f19 tempest-ShareNetworkSubnetsNegativeTest-1848515568 tempest-ShareNetworkSubnetsNegativeTest-1848515568-project-admin] http://10.27.203.238/share/v2/3520fb8495ee410b81f6760a62e1bca2/availability-zones returned with HTTP 200 May 28 12:59:52 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 800/1584] 10.27.203.238 () {64 vars in 1376 bytes} [Tue May 28 12:59:52 2024] GET /share/v2/3520fb8495ee410b81f6760a62e1bca2/availability-zones => generated 152 bytes in 9 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6db0a4-0045-4f8a-ab9e-a875dee646bc tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571 tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:52 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-6fb34b66-a8ce-48c5-8e6b-d7f0a4910cca tempest-ShareNetworkSubnetsNegativeTest-1848515568 tempest-ShareNetworkSubnetsNegativeTest-1848515568-project-admin] POST http://10.27.203.238/share/v2/3520fb8495ee410b81f6760a62e1bca2/share-networks/ddde945b-30cc-46ff-a60c-f44924d1ac7f/subnets May 28 12:59:52 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-6fb34b66-a8ce-48c5-8e6b-d7f0a4910cca tempest-ShareNetworkSubnetsNegativeTest-1848515568 tempest-ShareNetworkSubnetsNegativeTest-1848515568-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share-network-subnet": {"share_network_id": "ddde945b-30cc-46ff-a60c-f44924d1ac7f", "availability_zone": "non-existent-az"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1297/2619] 10.27.203.238 () {64 vars in 1571 bytes} [Tue May 28 12:59:52 2024] PUT /identity/v3/projects/8f5f6af328db444086f50a26f4d62e63/users/dacf9ff99e1c456cb98dc54de91b36a3/roles/44620cad10ae407c90c91e2c296adb04 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25a8598-eaa6-4f4e-afc6-490cbd4fdb6f tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571 tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25a8598-eaa6-4f4e-afc6-490cbd4fdb6f tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571 tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:52 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.quota [None req-e7245d6a-0625-4258-a172-a4e5aad67460 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Created reservations ['a1d45a5f-a2e4-4c2e-9041-b6eb3591efc5', '82ed4ba7-c9e8-4ffe-9407-56f6870d4d63', '40d3edd3-2ae1-4ce9-a4d5-cfeefa44233e', 'eaaad03c-b807-4184-aa29-3adbf4c59110'] {{(pid=98330) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 12:59:52 l75lg1-v1 dstat.sh[49771]: 28-05 12:59:52| 20 3 68 8 0|5742M 1721M 277M 7884M| 11k 434B| 0 9618k| 0 833 | 13k 23k|1.23 1.08 1.02|3.0 1.0 0| 0 0 | 0 2048M| 29 364 0 38 2 May 28 12:59:52 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-6fb34b66-a8ce-48c5-8e6b-d7f0a4910cca tempest-ShareNetworkSubnetsNegativeTest-1848515568 tempest-ShareNetworkSubnetsNegativeTest-1848515568-project-admin] HTTP exception thrown: The provided availability zone non-existent-az does not exist. May 28 12:59:52 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-6fb34b66-a8ce-48c5-8e6b-d7f0a4910cca tempest-ShareNetworkSubnetsNegativeTest-1848515568 tempest-ShareNetworkSubnetsNegativeTest-1848515568-project-admin] http://10.27.203.238/share/v2/3520fb8495ee410b81f6760a62e1bca2/share-networks/ddde945b-30cc-46ff-a60c-f44924d1ac7f/subnets returned with HTTP 400 May 28 12:59:52 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 801/1585] 10.27.203.238 () {66 vars in 1521 bytes} [Tue May 28 12:59:52 2024] POST /share/v2/3520fb8495ee410b81f6760a62e1bca2/share-networks/ddde945b-30cc-46ff-a60c-f44924d1ac7f/subnets => generated 106 bytes in 39 msecs (HTTP/1.1 400) 6 headers in 240 bytes (2 switches on core 0) May 28 12:59:52 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-e67a314e-7376-44b6-b684-069d6578676f tempest-ShareNetworkSubnetsNegativeTest-1848515568 tempest-ShareNetworkSubnetsNegativeTest-1848515568-project-admin] POST http://10.27.203.238/share/v2/3520fb8495ee410b81f6760a62e1bca2/share-networks/ddde945b-30cc-46ff-a60c-f44924d1ac7f/subnets May 28 12:59:52 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-e67a314e-7376-44b6-b684-069d6578676f tempest-ShareNetworkSubnetsNegativeTest-1848515568 tempest-ShareNetworkSubnetsNegativeTest-1848515568-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share-network-subnet": {"share_network_id": "ddde945b-30cc-46ff-a60c-f44924d1ac7f", "availability_zone": "nova", "neutron_subnet_id": "tempest-subnet-id-819125195"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:59:52 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-e67a314e-7376-44b6-b684-069d6578676f tempest-ShareNetworkSubnetsNegativeTest-1848515568 tempest-ShareNetworkSubnetsNegativeTest-1848515568-project-admin] HTTP exception thrown: When creating a new share network subnet you need to specify both neutron_net_id and neutron_subnet_id or none of them. May 28 12:59:52 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-e67a314e-7376-44b6-b684-069d6578676f tempest-ShareNetworkSubnetsNegativeTest-1848515568 tempest-ShareNetworkSubnetsNegativeTest-1848515568-project-admin] http://10.27.203.238/share/v2/3520fb8495ee410b81f6760a62e1bca2/share-networks/ddde945b-30cc-46ff-a60c-f44924d1ac7f/subnets returned with HTTP 400 May 28 12:59:52 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 802/1586] 10.27.203.238 () {66 vars in 1521 bytes} [Tue May 28 12:59:52 2024] POST /share/v2/3520fb8495ee410b81f6760a62e1bca2/share-networks/ddde945b-30cc-46ff-a60c-f44924d1ac7f/subnets => generated 163 bytes in 7 msecs (HTTP/1.1 400) 6 headers in 240 bytes (2 switches on core 0) May 28 12:59:52 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-f91c8cca-fcc6-48ef-9014-763911a83ae0 tempest-ShareNetworkSubnetsNegativeTest-1848515568 tempest-ShareNetworkSubnetsNegativeTest-1848515568-project-admin] POST http://10.27.203.238/share/v2/3520fb8495ee410b81f6760a62e1bca2/share-networks/fake_inexistent_id/subnets May 28 12:59:52 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-f91c8cca-fcc6-48ef-9014-763911a83ae0 tempest-ShareNetworkSubnetsNegativeTest-1848515568 tempest-ShareNetworkSubnetsNegativeTest-1848515568-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share-network-subnet": {"share_network_id": "fake_inexistent_id", "neutron_net_id": "tempest-net-id-590390868", "neutron_subnet_id": "tempest-subnet-id-1977840983"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bbbe4b-4b53-4d10-8327-476fd434c05c tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571 tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b04fbccbd4af4d03ba7d54550e06e586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f5f6af328db444086f50a26f4d62e63', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bbbe4b-4b53-4d10-8327-476fd434c05c tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571 tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bbbe4b-4b53-4d10-8327-476fd434c05c tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571 tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bbbe4b-4b53-4d10-8327-476fd434c05c tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571 tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571-project-admin] PATH_INFO: `/v3/users/b9078b0601ac4efa93bdcc390f3d1208` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:52 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-f91c8cca-fcc6-48ef-9014-763911a83ae0 tempest-ShareNetworkSubnetsNegativeTest-1848515568 tempest-ShareNetworkSubnetsNegativeTest-1848515568-project-admin] HTTP exception thrown: Share network fake_inexistent_id could not be found. May 28 12:59:52 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-f91c8cca-fcc6-48ef-9014-763911a83ae0 tempest-ShareNetworkSubnetsNegativeTest-1848515568 tempest-ShareNetworkSubnetsNegativeTest-1848515568-project-admin] http://10.27.203.238/share/v2/3520fb8495ee410b81f6760a62e1bca2/share-networks/fake_inexistent_id/subnets returned with HTTP 404 May 28 12:59:52 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 803/1587] 10.27.203.238 () {66 vars in 1467 bytes} [Tue May 28 12:59:52 2024] POST /share/v2/3520fb8495ee410b81f6760a62e1bca2/share-networks/fake_inexistent_id/subnets => generated 98 bytes in 19 msecs (HTTP/1.1 404) 6 headers in 237 bytes (2 switches on core 0) May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bbbe4b-4b53-4d10-8327-476fd434c05c tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571 tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571-project-admin] RBAC: Authorizing `identity:delete_user(user_id=b9078b0601ac4efa93bdcc390f3d1208)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bbbe4b-4b53-4d10-8327-476fd434c05c tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571 tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:52 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-574d8a9a-9ca5-4f20-90e0-b47fad660d64 tempest-ShareNetworkSubnetsNegativeTest-1848515568 tempest-ShareNetworkSubnetsNegativeTest-1848515568-project-admin] DELETE http://10.27.203.238/share/v2/3520fb8495ee410b81f6760a62e1bca2/share-networks/ddde945b-30cc-46ff-a60c-f44924d1ac7f/subnets/fake-subnet May 28 12:59:52 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-574d8a9a-9ca5-4f20-90e0-b47fad660d64 tempest-ShareNetworkSubnetsNegativeTest-1848515568 tempest-ShareNetworkSubnetsNegativeTest-1848515568-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:52 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-574d8a9a-9ca5-4f20-90e0-b47fad660d64 tempest-ShareNetworkSubnetsNegativeTest-1848515568 tempest-ShareNetworkSubnetsNegativeTest-1848515568-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:52 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.quota [None req-e7245d6a-0625-4258-a172-a4e5aad67460 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Committed reservations ['a1d45a5f-a2e4-4c2e-9041-b6eb3591efc5', '82ed4ba7-c9e8-4ffe-9407-56f6870d4d63', '40d3edd3-2ae1-4ce9-a4d5-cfeefa44233e', 'eaaad03c-b807-4184-aa29-3adbf4c59110'] {{(pid=98330) commit /opt/stack/manila/manila/quota.py:1063}} May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-97bbbe4b-4b53-4d10-8327-476fd434c05c tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571 tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571-project-admin] Could not find user: b9078b0601ac4efa93bdcc390f3d1208.: keystone.exception.UserNotFound: Could not find user: b9078b0601ac4efa93bdcc390f3d1208. May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: b9078b0601ac4efa93bdcc390f3d1208. May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1323/2620] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 12:59:52 2024] DELETE /identity/v3/users/b9078b0601ac4efa93bdcc390f3d1208 => generated 110 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6db0a4-0045-4f8a-ab9e-a875dee646bc tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571 tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6db0a4-0045-4f8a-ab9e-a875dee646bc tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571 tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043581a8-3323-494b-8699-765f00bfd323 tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571 tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b04fbccbd4af4d03ba7d54550e06e586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f5f6af328db444086f50a26f4d62e63', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043581a8-3323-494b-8699-765f00bfd323 tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571 tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043581a8-3323-494b-8699-765f00bfd323 tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571 tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043581a8-3323-494b-8699-765f00bfd323 tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571 tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571-project-admin] PATH_INFO: `/v3/users/567edee5a37f498e8a3f54a933728377` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043581a8-3323-494b-8699-765f00bfd323 tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571 tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571-project-admin] RBAC: Authorizing `identity:delete_user(user_id=567edee5a37f498e8a3f54a933728377)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043581a8-3323-494b-8699-765f00bfd323 tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571 tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:52 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-574d8a9a-9ca5-4f20-90e0-b47fad660d64 tempest-ShareNetworkSubnetsNegativeTest-1848515568 tempest-ShareNetworkSubnetsNegativeTest-1848515568-project-admin] HTTP exception thrown: Share network subnet fake-subnet could not be found. May 28 12:59:52 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-574d8a9a-9ca5-4f20-90e0-b47fad660d64 tempest-ShareNetworkSubnetsNegativeTest-1848515568 tempest-ShareNetworkSubnetsNegativeTest-1848515568-project-admin] http://10.27.203.238/share/v2/3520fb8495ee410b81f6760a62e1bca2/share-networks/ddde945b-30cc-46ff-a60c-f44924d1ac7f/subnets/fake-subnet returned with HTTP 404 May 28 12:59:52 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 804/1588] 10.27.203.238 () {64 vars in 1538 bytes} [Tue May 28 12:59:52 2024] DELETE /share/v2/3520fb8495ee410b81f6760a62e1bca2/share-networks/ddde945b-30cc-46ff-a60c-f44924d1ac7f/subnets/fake-subnet => generated 98 bytes in 31 msecs (HTTP/1.1 404) 6 headers in 237 bytes (2 switches on core 0) May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-043581a8-3323-494b-8699-765f00bfd323 tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571 tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571-project-admin] Could not find user: 567edee5a37f498e8a3f54a933728377.: keystone.exception.UserNotFound: Could not find user: 567edee5a37f498e8a3f54a933728377. May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 12:59:52 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-6acbbdd5-46f0-487a-a246-58a894085e91 tempest-ShareNetworkSubnetsNegativeTest-1848515568 tempest-ShareNetworkSubnetsNegativeTest-1848515568-project-admin] DELETE http://10.27.203.238/share/v2/3520fb8495ee410b81f6760a62e1bca2/share-networks/fake-sn/subnets/fake-subnet May 28 12:59:52 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-6acbbdd5-46f0-487a-a246-58a894085e91 tempest-ShareNetworkSubnetsNegativeTest-1848515568 tempest-ShareNetworkSubnetsNegativeTest-1848515568-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:52 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-6acbbdd5-46f0-487a-a246-58a894085e91 tempest-ShareNetworkSubnetsNegativeTest-1848515568 tempest-ShareNetworkSubnetsNegativeTest-1848515568-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 567edee5a37f498e8a3f54a933728377. May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1298/2621] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 12:59:52 2024] DELETE /identity/v3/users/567edee5a37f498e8a3f54a933728377 => generated 110 bytes in 25 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bbbe4b-4b53-4d10-8327-476fd434c05c tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571 tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bbbe4b-4b53-4d10-8327-476fd434c05c tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571 tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d155d574-945d-46b0-a81d-30cc51ba85eb tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571 tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b04fbccbd4af4d03ba7d54550e06e586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f5f6af328db444086f50a26f4d62e63', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d155d574-945d-46b0-a81d-30cc51ba85eb tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571 tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d155d574-945d-46b0-a81d-30cc51ba85eb tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571 tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d155d574-945d-46b0-a81d-30cc51ba85eb tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571 tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571-project-admin] PATH_INFO: `/v3/users/e1f712aac7e94e429048f60f92a8a736` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:52 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-6acbbdd5-46f0-487a-a246-58a894085e91 tempest-ShareNetworkSubnetsNegativeTest-1848515568 tempest-ShareNetworkSubnetsNegativeTest-1848515568-project-admin] HTTP exception thrown: Share network fake-sn could not be found. May 28 12:59:52 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-6acbbdd5-46f0-487a-a246-58a894085e91 tempest-ShareNetworkSubnetsNegativeTest-1848515568 tempest-ShareNetworkSubnetsNegativeTest-1848515568-project-admin] http://10.27.203.238/share/v2/3520fb8495ee410b81f6760a62e1bca2/share-networks/fake-sn/subnets/fake-subnet returned with HTTP 404 May 28 12:59:52 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 805/1589] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:59:52 2024] DELETE /share/v2/3520fb8495ee410b81f6760a62e1bca2/share-networks/fake-sn/subnets/fake-subnet => generated 87 bytes in 18 msecs (HTTP/1.1 404) 6 headers in 237 bytes (2 switches on core 0) May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d155d574-945d-46b0-a81d-30cc51ba85eb tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571 tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571-project-admin] RBAC: Authorizing `identity:delete_user(user_id=e1f712aac7e94e429048f60f92a8a736)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d155d574-945d-46b0-a81d-30cc51ba85eb tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571 tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:52 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-9b1509ee-3b35-4759-9cac-a20a758b0d67 tempest-ShareNetworkSubnetsNegativeTest-1848515568 tempest-ShareNetworkSubnetsNegativeTest-1848515568-project-admin] GET http://10.27.203.238/share/v2/3520fb8495ee410b81f6760a62e1bca2/availability-zones May 28 12:59:52 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-9b1509ee-3b35-4759-9cac-a20a758b0d67 tempest-ShareNetworkSubnetsNegativeTest-1848515568 tempest-ShareNetworkSubnetsNegativeTest-1848515568-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:52 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-9b1509ee-3b35-4759-9cac-a20a758b0d67 tempest-ShareNetworkSubnetsNegativeTest-1848515568 tempest-ShareNetworkSubnetsNegativeTest-1848515568-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-d155d574-945d-46b0-a81d-30cc51ba85eb tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571 tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571-project-admin] Could not find user: e1f712aac7e94e429048f60f92a8a736.: keystone.exception.UserNotFound: Could not find user: e1f712aac7e94e429048f60f92a8a736. May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:59:52 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-9b1509ee-3b35-4759-9cac-a20a758b0d67 tempest-ShareNetworkSubnetsNegativeTest-1848515568 tempest-ShareNetworkSubnetsNegativeTest-1848515568-project-admin] http://10.27.203.238/share/v2/3520fb8495ee410b81f6760a62e1bca2/availability-zones returned with HTTP 200 May 28 12:59:52 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 806/1590] 10.27.203.238 () {64 vars in 1376 bytes} [Tue May 28 12:59:52 2024] GET /share/v2/3520fb8495ee410b81f6760a62e1bca2/availability-zones => generated 152 bytes in 8 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: e1f712aac7e94e429048f60f92a8a736. May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1324/2622] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 12:59:52 2024] DELETE /identity/v3/users/e1f712aac7e94e429048f60f92a8a736 => generated 110 bytes in 23 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043581a8-3323-494b-8699-765f00bfd323 tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571 tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:52 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-93db141a-a1a0-46c5-b360-bd36f1ae1871 tempest-ShareNetworkSubnetsNegativeTest-1848515568 tempest-ShareNetworkSubnetsNegativeTest-1848515568-project-admin] POST http://10.27.203.238/share/v2/3520fb8495ee410b81f6760a62e1bca2/share-networks/ddde945b-30cc-46ff-a60c-f44924d1ac7f/subnets May 28 12:59:52 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-93db141a-a1a0-46c5-b360-bd36f1ae1871 tempest-ShareNetworkSubnetsNegativeTest-1848515568 tempest-ShareNetworkSubnetsNegativeTest-1848515568-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share-network-subnet": {"share_network_id": "ddde945b-30cc-46ff-a60c-f44924d1ac7f", "availability_zone": "nova", "neutron_net_id": "tempest-net-id-2086170011", "neutron_subnet_id": "tempest-subnet-id-692989374"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043581a8-3323-494b-8699-765f00bfd323 tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571 tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd58605-dc3d-4eb6-8ce7-bd7c6af4c48d tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571 tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b04fbccbd4af4d03ba7d54550e06e586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f5f6af328db444086f50a26f4d62e63', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd58605-dc3d-4eb6-8ce7-bd7c6af4c48d tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571 tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd58605-dc3d-4eb6-8ce7-bd7c6af4c48d tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571 tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd58605-dc3d-4eb6-8ce7-bd7c6af4c48d tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571 tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571-project-admin] PATH_INFO: `/v3/users/9d3788d7291b4ee389136f181e35a26b` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd58605-dc3d-4eb6-8ce7-bd7c6af4c48d tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571 tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571-project-admin] RBAC: Authorizing `identity:delete_user(user_id=9d3788d7291b4ee389136f181e35a26b)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd58605-dc3d-4eb6-8ce7-bd7c6af4c48d tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571 tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:52 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.host_manager [None req-e7245d6a-0625-4258-a172-a4e5aad67460 tempest-ShareRulesTest-1530341375 None] Share service is down. (host: l75lg1-v1@generic2). May 28 12:59:52 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.host_manager [None req-e7245d6a-0625-4258-a172-a4e5aad67460 tempest-ShareRulesTest-1530341375 None] Share service is down. (host: l75lg1-v1@generic1). May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-fcd58605-dc3d-4eb6-8ce7-bd7c6af4c48d tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571 tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571-project-admin] Could not find user: 9d3788d7291b4ee389136f181e35a26b.: keystone.exception.UserNotFound: Could not find user: 9d3788d7291b4ee389136f181e35a26b. May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:59:52 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-e7245d6a-0625-4258-a172-a4e5aad67460 tempest-ShareRulesTest-1530341375 None] Starting with 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:80}} May 28 12:59:52 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-e7245d6a-0625-4258-a172-a4e5aad67460 tempest-ShareRulesTest-1530341375 None] Filter OnlyHostFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:59:52 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-e7245d6a-0625-4258-a172-a4e5aad67460 tempest-ShareRulesTest-1530341375 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 12:59:52 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.capacity [None req-e7245d6a-0625-4258-a172-a4e5aad67460 tempest-ShareRulesTest-1530341375 None] Space information for share creation on host l75lg1-v1@vast#vast (requested / avail): 1/2082 {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/capacity.py:83}} May 28 12:59:52 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-e7245d6a-0625-4258-a172-a4e5aad67460 tempest-ShareRulesTest-1530341375 None] Filter CapacityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:59:52 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-e7245d6a-0625-4258-a172-a4e5aad67460 tempest-ShareRulesTest-1530341375 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:59:52 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-e7245d6a-0625-4258-a172-a4e5aad67460 tempest-ShareRulesTest-1530341375 None] Driver Filter: Checking host 'l75lg1-v1@vast#vast' {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:37}} May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 9d3788d7291b4ee389136f181e35a26b. May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1299/2623] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 12:59:52 2024] DELETE /identity/v3/users/9d3788d7291b4ee389136f181e35a26b => generated 110 bytes in 29 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 12:59:52 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-e7245d6a-0625-4258-a172-a4e5aad67460 tempest-ShareRulesTest-1530341375 None] Filter function not set :: passing host. {{(pid=98327) _check_filter_function /opt/stack/manila/manila/scheduler/filters/driver.py:53}} May 28 12:59:52 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-e7245d6a-0625-4258-a172-a4e5aad67460 tempest-ShareRulesTest-1530341375 None] Result: True {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:40}} May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d155d574-945d-46b0-a81d-30cc51ba85eb tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571 tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:52 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-e7245d6a-0625-4258-a172-a4e5aad67460 tempest-ShareRulesTest-1530341375 None] Done checking host 'l75lg1-v1@vast#vast' {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:41}} May 28 12:59:52 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-e7245d6a-0625-4258-a172-a4e5aad67460 tempest-ShareRulesTest-1530341375 None] Filter DriverFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:59:52 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-e7245d6a-0625-4258-a172-a4e5aad67460 tempest-ShareRulesTest-1530341375 None] Filter ShareReplicationFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:59:52 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-e7245d6a-0625-4258-a172-a4e5aad67460 tempest-ShareRulesTest-1530341375 None] Filter CreateFromSnapshotFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:59:52 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-e7245d6a-0625-4258-a172-a4e5aad67460 tempest-ShareRulesTest-1530341375 None] Filter AffinityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:59:52 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-e7245d6a-0625-4258-a172-a4e5aad67460 tempest-ShareRulesTest-1530341375 None] Filter AntiAffinityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d155d574-945d-46b0-a81d-30cc51ba85eb tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571 tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:52 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.drivers.filter [None req-e7245d6a-0625-4258-a172-a4e5aad67460 tempest-ShareRulesTest-1530341375 None] Filtered share [host: 'l75lg1-v1@vast#vast', free_capacity_gb: 2082.6478263456374, pools: None] {{(pid=98327) _schedule_share /opt/stack/manila/manila/scheduler/drivers/filter.py:268}} May 28 12:59:52 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-e7245d6a-0625-4258-a172-a4e5aad67460 tempest-ShareRulesTest-1530341375 None] Checking host 'l75lg1-v1@vast#vast' {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:46}} May 28 12:59:52 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.weighers.goodness [None req-e7245d6a-0625-4258-a172-a4e5aad67460 tempest-ShareRulesTest-1530341375 None] Goodness function not set :: defaulting to minimal goodness rating of 0. May 28 12:59:52 l75lg1-v1 manila-scheduler[98327]: INFO manila.scheduler.weighers.goodness [None req-e7245d6a-0625-4258-a172-a4e5aad67460 tempest-ShareRulesTest-1530341375 None] Goodness function result for host l75lg1-v1@vast#vast: 0. May 28 12:59:52 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-e7245d6a-0625-4258-a172-a4e5aad67460 tempest-ShareRulesTest-1530341375 None] Goodness: 0 {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:48}} May 28 12:59:52 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-e7245d6a-0625-4258-a172-a4e5aad67460 tempest-ShareRulesTest-1530341375 None] Done checking host 'l75lg1-v1@vast#vast' {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:49}} May 28 12:59:52 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.drivers.filter [None req-e7245d6a-0625-4258-a172-a4e5aad67460 tempest-ShareRulesTest-1530341375 None] Choosing for share: WeighedHost [host: l75lg1-v1@vast#vast, weight: 0.0] {{(pid=98327) _schedule_share /opt/stack/manila/manila/scheduler/drivers/filter.py:274}} May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaf5e2a-5f38-48b9-b630-c18afda55163 tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571 tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b04fbccbd4af4d03ba7d54550e06e586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f5f6af328db444086f50a26f4d62e63', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaf5e2a-5f38-48b9-b630-c18afda55163 tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571 tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaf5e2a-5f38-48b9-b630-c18afda55163 tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571 tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaf5e2a-5f38-48b9-b630-c18afda55163 tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571 tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571-project-admin] PATH_INFO: `/v3/users/2eb81a384d764f8cb6d0d7e830959013` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:52 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-e7245d6a-0625-4258-a172-a4e5aad67460 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/shares returned with HTTP 200 May 28 12:59:52 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 785/1591] 10.27.203.238 () {66 vars in 1362 bytes} [Tue May 28 12:59:52 2024] POST /share/v2/a4f3887fa28c457390f5b66615564430/shares => generated 1311 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 232 bytes (2 switches on core 0) May 28 12:59:52 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-30680bda-c009-4b72-acda-d7395645e8e2 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] GET http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/shares/b330db31-7766-443d-9c19-26fe349665aa May 28 12:59:52 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-30680bda-c009-4b72-acda-d7395645e8e2 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:52 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-30680bda-c009-4b72-acda-d7395645e8e2 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdaf5e2a-5f38-48b9-b630-c18afda55163 tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571 tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571-project-admin] RBAC: Authorizing `identity:delete_user(user_id=2eb81a384d764f8cb6d0d7e830959013)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdaf5e2a-5f38-48b9-b630-c18afda55163 tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571 tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-fdaf5e2a-5f38-48b9-b630-c18afda55163 tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571 tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571-project-admin] Could not find user: 2eb81a384d764f8cb6d0d7e830959013.: keystone.exception.UserNotFound: Could not find user: 2eb81a384d764f8cb6d0d7e830959013. May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 2eb81a384d764f8cb6d0d7e830959013. May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1325/2624] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 12:59:52 2024] DELETE /identity/v3/users/2eb81a384d764f8cb6d0d7e830959013 => generated 110 bytes in 27 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd58605-dc3d-4eb6-8ce7-bd7c6af4c48d tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571 tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:52 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-93db141a-a1a0-46c5-b360-bd36f1ae1871 tempest-ShareNetworkSubnetsNegativeTest-1848515568 tempest-ShareNetworkSubnetsNegativeTest-1848515568-project-admin] http://10.27.203.238/share/v2/3520fb8495ee410b81f6760a62e1bca2/share-networks/ddde945b-30cc-46ff-a60c-f44924d1ac7f/subnets returned with HTTP 200 May 28 12:59:52 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 807/1592] 10.27.203.238 () {66 vars in 1521 bytes} [Tue May 28 12:59:52 2024] POST /share/v2/3520fb8495ee410b81f6760a62e1bca2/share-networks/ddde945b-30cc-46ff-a60c-f44924d1ac7f/subnets => generated 479 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 231 bytes (2 switches on core 0) May 28 12:59:52 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-30680bda-c009-4b72-acda-d7395645e8e2 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/shares/b330db31-7766-443d-9c19-26fe349665aa returned with HTTP 200 May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd58605-dc3d-4eb6-8ce7-bd7c6af4c48d tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571 tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:52 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 786/1593] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:59:52 2024] GET /share/v2/a4f3887fa28c457390f5b66615564430/shares/b330db31-7766-443d-9c19-26fe349665aa => generated 1311 bytes in 25 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:59:52 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-348b8324-fe59-48ce-b3e6-1c13ddd642c4 tempest-ShareNetworkSubnetsNegativeTest-1848515568 tempest-ShareNetworkSubnetsNegativeTest-1848515568-project-admin] DELETE http://10.27.203.238/share/v2/3520fb8495ee410b81f6760a62e1bca2/share-networks/ddde945b-30cc-46ff-a60c-f44924d1ac7f/subnets/6fe5355f-d36c-47ae-963a-9e799e6a9667 May 28 12:59:52 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-348b8324-fe59-48ce-b3e6-1c13ddd642c4 tempest-ShareNetworkSubnetsNegativeTest-1848515568 tempest-ShareNetworkSubnetsNegativeTest-1848515568-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4786aa3c-9759-40c5-944d-dcf978a76cd8 tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571 tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b04fbccbd4af4d03ba7d54550e06e586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f5f6af328db444086f50a26f4d62e63', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:52 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-348b8324-fe59-48ce-b3e6-1c13ddd642c4 tempest-ShareNetworkSubnetsNegativeTest-1848515568 tempest-ShareNetworkSubnetsNegativeTest-1848515568-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4786aa3c-9759-40c5-944d-dcf978a76cd8 tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571 tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4786aa3c-9759-40c5-944d-dcf978a76cd8 tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571 tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4786aa3c-9759-40c5-944d-dcf978a76cd8 tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571 tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571-project-admin] PATH_INFO: `/v3/users/0f30b8ae74474de0b34a7f48f86a312e` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4786aa3c-9759-40c5-944d-dcf978a76cd8 tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571 tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571-project-admin] RBAC: Authorizing `identity:delete_user(user_id=0f30b8ae74474de0b34a7f48f86a312e)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4786aa3c-9759-40c5-944d-dcf978a76cd8 tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571 tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-4786aa3c-9759-40c5-944d-dcf978a76cd8 tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571 tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571-project-admin] Could not find user: 0f30b8ae74474de0b34a7f48f86a312e.: keystone.exception.UserNotFound: Could not find user: 0f30b8ae74474de0b34a7f48f86a312e. May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 0f30b8ae74474de0b34a7f48f86a312e. May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1300/2625] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 12:59:52 2024] DELETE /identity/v3/users/0f30b8ae74474de0b34a7f48f86a312e => generated 110 bytes in 28 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaf5e2a-5f38-48b9-b630-c18afda55163 tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571 tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaf5e2a-5f38-48b9-b630-c18afda55163 tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571 tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eba1e06-0b91-495b-9b1e-1b26fc62f1b3 tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571 tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b04fbccbd4af4d03ba7d54550e06e586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f5f6af328db444086f50a26f4d62e63', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eba1e06-0b91-495b-9b1e-1b26fc62f1b3 tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571 tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eba1e06-0b91-495b-9b1e-1b26fc62f1b3 tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571 tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eba1e06-0b91-495b-9b1e-1b26fc62f1b3 tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571 tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571-project-admin] PATH_INFO: `/v3/users/7013a62752274b85851c128bd3c241f3` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eba1e06-0b91-495b-9b1e-1b26fc62f1b3 tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571 tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571-project-admin] RBAC: Authorizing `identity:delete_user(user_id=7013a62752274b85851c128bd3c241f3)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eba1e06-0b91-495b-9b1e-1b26fc62f1b3 tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571 tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-4eba1e06-0b91-495b-9b1e-1b26fc62f1b3 tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571 tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571-project-admin] Could not find user: 7013a62752274b85851c128bd3c241f3.: keystone.exception.UserNotFound: Could not find user: 7013a62752274b85851c128bd3c241f3. May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 7013a62752274b85851c128bd3c241f3. May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1326/2626] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 12:59:52 2024] DELETE /identity/v3/users/7013a62752274b85851c128bd3c241f3 => generated 110 bytes in 24 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4786aa3c-9759-40c5-944d-dcf978a76cd8 tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571 tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4786aa3c-9759-40c5-944d-dcf978a76cd8 tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571 tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:52 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-348b8324-fe59-48ce-b3e6-1c13ddd642c4 tempest-ShareNetworkSubnetsNegativeTest-1848515568 tempest-ShareNetworkSubnetsNegativeTest-1848515568-project-admin] http://10.27.203.238/share/v2/3520fb8495ee410b81f6760a62e1bca2/share-networks/ddde945b-30cc-46ff-a60c-f44924d1ac7f/subnets/6fe5355f-d36c-47ae-963a-9e799e6a9667 returned with HTTP 202 May 28 12:59:52 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 808/1594] 10.27.203.238 () {64 vars in 1613 bytes} [Tue May 28 12:59:52 2024] DELETE /share/v2/3520fb8495ee410b81f6760a62e1bca2/share-networks/ddde945b-30cc-46ff-a60c-f44924d1ac7f/subnets/6fe5355f-d36c-47ae-963a-9e799e6a9667 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e8b54b-8fd2-4065-a30a-f2c3c6d29756 tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571 tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b04fbccbd4af4d03ba7d54550e06e586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f5f6af328db444086f50a26f4d62e63', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e8b54b-8fd2-4065-a30a-f2c3c6d29756 tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571 tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e8b54b-8fd2-4065-a30a-f2c3c6d29756 tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571 tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e8b54b-8fd2-4065-a30a-f2c3c6d29756 tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571 tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571-project-admin] PATH_INFO: `/v3/users/dacf9ff99e1c456cb98dc54de91b36a3` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e8b54b-8fd2-4065-a30a-f2c3c6d29756 tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571 tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571-project-admin] RBAC: Authorizing `identity:delete_user(user_id=dacf9ff99e1c456cb98dc54de91b36a3)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e8b54b-8fd2-4065-a30a-f2c3c6d29756 tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571 tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:52 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-8aa6abc1-c95b-4b31-9d2b-e12b59e960eb tempest-ShareNetworkSubnetsNegativeTest-1848515568 tempest-ShareNetworkSubnetsNegativeTest-1848515568-project-admin] GET http://10.27.203.238/share/v2/3520fb8495ee410b81f6760a62e1bca2/share-networks/ddde945b-30cc-46ff-a60c-f44924d1ac7f May 28 12:59:52 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-8aa6abc1-c95b-4b31-9d2b-e12b59e960eb tempest-ShareNetworkSubnetsNegativeTest-1848515568 tempest-ShareNetworkSubnetsNegativeTest-1848515568-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:52 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-8aa6abc1-c95b-4b31-9d2b-e12b59e960eb tempest-ShareNetworkSubnetsNegativeTest-1848515568 tempest-ShareNetworkSubnetsNegativeTest-1848515568-project-admin] Calling method 'ShareNetworkController.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:52 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e7245d6a-0625-4258-a172-a4e5aad67460 tempest-ShareRulesTest-1530341375 None] >>> [GET] https://127.0.0.1:40443/api/vippools/ May 28 12:59:52 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e7245d6a-0625-4258-a172-a4e5aad67460 tempest-ShareRulesTest-1530341375 None] {'allow_redirects': True, 'params': {'name': 'vippool-1'}} May 28 12:59:52 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-8aa6abc1-c95b-4b31-9d2b-e12b59e960eb tempest-ShareNetworkSubnetsNegativeTest-1848515568 tempest-ShareNetworkSubnetsNegativeTest-1848515568-project-admin] http://10.27.203.238/share/v2/3520fb8495ee410b81f6760a62e1bca2/share-networks/ddde945b-30cc-46ff-a60c-f44924d1ac7f returned with HTTP 200 May 28 12:59:52 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 787/1595] 10.27.203.238 () {64 vars in 1475 bytes} [Tue May 28 12:59:52 2024] GET /share/v2/3520fb8495ee410b81f6760a62e1bca2/share-networks/ddde945b-30cc-46ff-a60c-f44924d1ac7f => generated 662 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:59:52 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-f834c56d-0b5a-45c3-a017-41e347bde3d4 tempest-ShareNetworkSubnetsNegativeTest-1848515568 tempest-ShareNetworkSubnetsNegativeTest-1848515568-project-admin] GET http://10.27.203.238/share/v2/3520fb8495ee410b81f6760a62e1bca2/share-networks/ddde945b-30cc-46ff-a60c-f44924d1ac7f/subnets/6fe5355f-d36c-47ae-963a-9e799e6a9667 May 28 12:59:52 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-f834c56d-0b5a-45c3-a017-41e347bde3d4 tempest-ShareNetworkSubnetsNegativeTest-1848515568 tempest-ShareNetworkSubnetsNegativeTest-1848515568-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:52 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-f834c56d-0b5a-45c3-a017-41e347bde3d4 tempest-ShareNetworkSubnetsNegativeTest-1848515568 tempest-ShareNetworkSubnetsNegativeTest-1848515568-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-41e8b54b-8fd2-4065-a30a-f2c3c6d29756 tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571 tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dacf9ff99e1c456cb98dc54de91b36a3', 'request_id': 'req-41e8b54b-8fd2-4065-a30a-f2c3c6d29756'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-41e8b54b-8fd2-4065-a30a-f2c3c6d29756 tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571 tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dacf9ff99e1c456cb98dc54de91b36a3', 'request_id': 'req-41e8b54b-8fd2-4065-a30a-f2c3c6d29756'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-41e8b54b-8fd2-4065-a30a-f2c3c6d29756 tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571 tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dacf9ff99e1c456cb98dc54de91b36a3', 'request_id': 'req-41e8b54b-8fd2-4065-a30a-f2c3c6d29756'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-41e8b54b-8fd2-4065-a30a-f2c3c6d29756 tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571 tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dacf9ff99e1c456cb98dc54de91b36a3', 'request_id': 'req-41e8b54b-8fd2-4065-a30a-f2c3c6d29756'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-41e8b54b-8fd2-4065-a30a-f2c3c6d29756 tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571 tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dacf9ff99e1c456cb98dc54de91b36a3', 'request_id': 'req-41e8b54b-8fd2-4065-a30a-f2c3c6d29756'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:52 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-f834c56d-0b5a-45c3-a017-41e347bde3d4 tempest-ShareNetworkSubnetsNegativeTest-1848515568 tempest-ShareNetworkSubnetsNegativeTest-1848515568-project-admin] HTTP exception thrown: Share network subnet 6fe5355f-d36c-47ae-963a-9e799e6a9667 could not be found. May 28 12:59:52 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-f834c56d-0b5a-45c3-a017-41e347bde3d4 tempest-ShareNetworkSubnetsNegativeTest-1848515568 tempest-ShareNetworkSubnetsNegativeTest-1848515568-project-admin] http://10.27.203.238/share/v2/3520fb8495ee410b81f6760a62e1bca2/share-networks/ddde945b-30cc-46ff-a60c-f44924d1ac7f/subnets/6fe5355f-d36c-47ae-963a-9e799e6a9667 returned with HTTP 404 May 28 12:59:52 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 809/1596] 10.27.203.238 () {64 vars in 1610 bytes} [Tue May 28 12:59:52 2024] GET /share/v2/3520fb8495ee410b81f6760a62e1bca2/share-networks/ddde945b-30cc-46ff-a60c-f44924d1ac7f/subnets/6fe5355f-d36c-47ae-963a-9e799e6a9667 => generated 123 bytes in 32 msecs (HTTP/1.1 404) 6 headers in 238 bytes (1 switches on core 0) May 28 12:59:52 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-32d2e2e3-b2b2-471f-b3d2-f970a9f1ca4f tempest-ShareNetworkSubnetsNegativeTest-1848515568 tempest-ShareNetworkSubnetsNegativeTest-1848515568-project-admin] DELETE http://10.27.203.238/share/v2/3520fb8495ee410b81f6760a62e1bca2/share-networks/ddde945b-30cc-46ff-a60c-f44924d1ac7f/subnets/6fe5355f-d36c-47ae-963a-9e799e6a9667 May 28 12:59:52 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-32d2e2e3-b2b2-471f-b3d2-f970a9f1ca4f tempest-ShareNetworkSubnetsNegativeTest-1848515568 tempest-ShareNetworkSubnetsNegativeTest-1848515568-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:52 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-32d2e2e3-b2b2-471f-b3d2-f970a9f1ca4f tempest-ShareNetworkSubnetsNegativeTest-1848515568 tempest-ShareNetworkSubnetsNegativeTest-1848515568-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:52 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:59:52 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1301/2627] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 12:59:52 2024] DELETE /identity/v3/users/dacf9ff99e1c456cb98dc54de91b36a3 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eba1e06-0b91-495b-9b1e-1b26fc62f1b3 tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571 tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-4eba1e06-0b91-495b-9b1e-1b26fc62f1b3 tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571 tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:59:52 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-32d2e2e3-b2b2-471f-b3d2-f970a9f1ca4f tempest-ShareNetworkSubnetsNegativeTest-1848515568 tempest-ShareNetworkSubnetsNegativeTest-1848515568-project-admin] HTTP exception thrown: Share network subnet 6fe5355f-d36c-47ae-963a-9e799e6a9667 could not be found. May 28 12:59:52 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-32d2e2e3-b2b2-471f-b3d2-f970a9f1ca4f tempest-ShareNetworkSubnetsNegativeTest-1848515568 tempest-ShareNetworkSubnetsNegativeTest-1848515568-project-admin] http://10.27.203.238/share/v2/3520fb8495ee410b81f6760a62e1bca2/share-networks/ddde945b-30cc-46ff-a60c-f44924d1ac7f/subnets/6fe5355f-d36c-47ae-963a-9e799e6a9667 returned with HTTP 404 May 28 12:59:52 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 788/1597] 10.27.203.238 () {64 vars in 1613 bytes} [Tue May 28 12:59:52 2024] DELETE /share/v2/3520fb8495ee410b81f6760a62e1bca2/share-networks/ddde945b-30cc-46ff-a60c-f44924d1ac7f/subnets/6fe5355f-d36c-47ae-963a-9e799e6a9667 => generated 123 bytes in 31 msecs (HTTP/1.1 404) 6 headers in 238 bytes (1 switches on core 0) May 28 12:59:52 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-542925dc-9020-4df2-8428-39c34f0038bf tempest-ShareNetworkSubnetsNegativeTest-1848515568 tempest-ShareNetworkSubnetsNegativeTest-1848515568-project-admin] GET http://10.27.203.238/share/v2/3520fb8495ee410b81f6760a62e1bca2/share-networks/ddde945b-30cc-46ff-a60c-f44924d1ac7f/subnets/fake-subnet May 28 12:59:52 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-542925dc-9020-4df2-8428-39c34f0038bf tempest-ShareNetworkSubnetsNegativeTest-1848515568 tempest-ShareNetworkSubnetsNegativeTest-1848515568-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:52 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-542925dc-9020-4df2-8428-39c34f0038bf tempest-ShareNetworkSubnetsNegativeTest-1848515568 tempest-ShareNetworkSubnetsNegativeTest-1848515568-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eba1e06-0b91-495b-9b1e-1b26fc62f1b3 tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571 tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:52 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-542925dc-9020-4df2-8428-39c34f0038bf tempest-ShareNetworkSubnetsNegativeTest-1848515568 tempest-ShareNetworkSubnetsNegativeTest-1848515568-project-admin] HTTP exception thrown: Share network subnet fake-subnet could not be found. May 28 12:59:52 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-542925dc-9020-4df2-8428-39c34f0038bf tempest-ShareNetworkSubnetsNegativeTest-1848515568 tempest-ShareNetworkSubnetsNegativeTest-1848515568-project-admin] http://10.27.203.238/share/v2/3520fb8495ee410b81f6760a62e1bca2/share-networks/ddde945b-30cc-46ff-a60c-f44924d1ac7f/subnets/fake-subnet returned with HTTP 404 May 28 12:59:52 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 810/1598] 10.27.203.238 () {64 vars in 1535 bytes} [Tue May 28 12:59:52 2024] GET /share/v2/3520fb8495ee410b81f6760a62e1bca2/share-networks/ddde945b-30cc-46ff-a60c-f44924d1ac7f/subnets/fake-subnet => generated 98 bytes in 30 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 12:59:52 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-29fe8ef0-06fa-4131-8535-31b58ed1cd6e tempest-ShareNetworkSubnetsNegativeTest-1848515568 tempest-ShareNetworkSubnetsNegativeTest-1848515568-project-admin] GET http://10.27.203.238/share/v2/3520fb8495ee410b81f6760a62e1bca2/share-networks/fake-sn/subnets/fake-subnet May 28 12:59:52 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-29fe8ef0-06fa-4131-8535-31b58ed1cd6e tempest-ShareNetworkSubnetsNegativeTest-1848515568 tempest-ShareNetworkSubnetsNegativeTest-1848515568-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:52 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-29fe8ef0-06fa-4131-8535-31b58ed1cd6e tempest-ShareNetworkSubnetsNegativeTest-1848515568 tempest-ShareNetworkSubnetsNegativeTest-1848515568-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4c9e7a-d785-4887-a42f-85e3257e98b1 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4c9e7a-d785-4887-a42f-85e3257e98b1 None admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4c9e7a-d785-4887-a42f-85e3257e98b1 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4c9e7a-d785-4887-a42f-85e3257e98b1 None admin] PATH_INFO: `/v3/users/869ea9c4ad8b4dc093edb323b66436ab` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4c9e7a-d785-4887-a42f-85e3257e98b1 None admin] RBAC: Authorizing `identity:delete_user(user_id=869ea9c4ad8b4dc093edb323b66436ab)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4c9e7a-d785-4887-a42f-85e3257e98b1 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:52 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-29fe8ef0-06fa-4131-8535-31b58ed1cd6e tempest-ShareNetworkSubnetsNegativeTest-1848515568 tempest-ShareNetworkSubnetsNegativeTest-1848515568-project-admin] HTTP exception thrown: Share network fake-sn could not be found. May 28 12:59:52 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-29fe8ef0-06fa-4131-8535-31b58ed1cd6e tempest-ShareNetworkSubnetsNegativeTest-1848515568 tempest-ShareNetworkSubnetsNegativeTest-1848515568-project-admin] http://10.27.203.238/share/v2/3520fb8495ee410b81f6760a62e1bca2/share-networks/fake-sn/subnets/fake-subnet returned with HTTP 404 May 28 12:59:52 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 789/1599] 10.27.203.238 () {64 vars in 1448 bytes} [Tue May 28 12:59:52 2024] GET /share/v2/3520fb8495ee410b81f6760a62e1bca2/share-networks/fake-sn/subnets/fake-subnet => generated 87 bytes in 18 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 12:59:52 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-08b80773-5b86-423f-be2b-9205bea0e3ec tempest-ShareNetworkSubnetsNegativeTest-1848515568 tempest-ShareNetworkSubnetsNegativeTest-1848515568-project-admin] DELETE http://10.27.203.238/share/v2/3520fb8495ee410b81f6760a62e1bca2/types/7df28dc3-579f-4066-b43a-bf9d271c20a4 May 28 12:59:52 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-08b80773-5b86-423f-be2b-9205bea0e3ec tempest-ShareNetworkSubnetsNegativeTest-1848515568 tempest-ShareNetworkSubnetsNegativeTest-1848515568-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:52 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-08b80773-5b86-423f-be2b-9205bea0e3ec tempest-ShareNetworkSubnetsNegativeTest-1848515568 tempest-ShareNetworkSubnetsNegativeTest-1848515568-project-admin] Calling method 'ShareTypesController._delete' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-6d4c9e7a-d785-4887-a42f-85e3257e98b1 None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '869ea9c4ad8b4dc093edb323b66436ab', 'request_id': 'req-6d4c9e7a-d785-4887-a42f-85e3257e98b1'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:52 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-08b80773-5b86-423f-be2b-9205bea0e3ec tempest-ShareNetworkSubnetsNegativeTest-1848515568 tempest-ShareNetworkSubnetsNegativeTest-1848515568-project-admin] http://10.27.203.238/share/v2/3520fb8495ee410b81f6760a62e1bca2/types/7df28dc3-579f-4066-b43a-bf9d271c20a4 returned with HTTP 202 May 28 12:59:52 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 811/1600] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:59:52 2024] DELETE /share/v2/3520fb8495ee410b81f6760a62e1bca2/types/7df28dc3-579f-4066-b43a-bf9d271c20a4 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-6d4c9e7a-d785-4887-a42f-85e3257e98b1 None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '869ea9c4ad8b4dc093edb323b66436ab', 'request_id': 'req-6d4c9e7a-d785-4887-a42f-85e3257e98b1'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-6d4c9e7a-d785-4887-a42f-85e3257e98b1 None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '869ea9c4ad8b4dc093edb323b66436ab', 'request_id': 'req-6d4c9e7a-d785-4887-a42f-85e3257e98b1'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-6d4c9e7a-d785-4887-a42f-85e3257e98b1 None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '869ea9c4ad8b4dc093edb323b66436ab', 'request_id': 'req-6d4c9e7a-d785-4887-a42f-85e3257e98b1'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:52 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-9cceab32-2fff-4a6e-b014-538b499a2095 tempest-ShareNetworkSubnetsNegativeTest-1848515568 tempest-ShareNetworkSubnetsNegativeTest-1848515568-project-admin] GET http://10.27.203.238/share/v2/3520fb8495ee410b81f6760a62e1bca2/types/7df28dc3-579f-4066-b43a-bf9d271c20a4 May 28 12:59:52 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-9cceab32-2fff-4a6e-b014-538b499a2095 tempest-ShareNetworkSubnetsNegativeTest-1848515568 tempest-ShareNetworkSubnetsNegativeTest-1848515568-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:52 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-9cceab32-2fff-4a6e-b014-538b499a2095 tempest-ShareNetworkSubnetsNegativeTest-1848515568 tempest-ShareNetworkSubnetsNegativeTest-1848515568-project-admin] Calling method 'ShareTypesController.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:52 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-9cceab32-2fff-4a6e-b014-538b499a2095 tempest-ShareNetworkSubnetsNegativeTest-1848515568 tempest-ShareNetworkSubnetsNegativeTest-1848515568-project-admin] HTTP exception thrown: Share type not found. May 28 12:59:52 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-9cceab32-2fff-4a6e-b014-538b499a2095 tempest-ShareNetworkSubnetsNegativeTest-1848515568 tempest-ShareNetworkSubnetsNegativeTest-1848515568-project-admin] http://10.27.203.238/share/v2/3520fb8495ee410b81f6760a62e1bca2/types/7df28dc3-579f-4066-b43a-bf9d271c20a4 returned with HTTP 404 May 28 12:59:52 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 790/1601] 10.27.203.238 () {64 vars in 1448 bytes} [Tue May 28 12:59:52 2024] GET /share/v2/3520fb8495ee410b81f6760a62e1bca2/types/7df28dc3-579f-4066-b43a-bf9d271c20a4 => generated 67 bytes in 10 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-6d4c9e7a-d785-4887-a42f-85e3257e98b1 None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '869ea9c4ad8b4dc093edb323b66436ab', 'request_id': 'req-6d4c9e7a-d785-4887-a42f-85e3257e98b1'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e8b54b-8fd2-4065-a30a-f2c3c6d29756 tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571 tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-41e8b54b-8fd2-4065-a30a-f2c3c6d29756 tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571 tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1327/2628] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 12:59:52 2024] DELETE /identity/v3/users/869ea9c4ad8b4dc093edb323b66436ab => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e8b54b-8fd2-4065-a30a-f2c3c6d29756 tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571 tempest-ShareCertRulesForGLUSTERFSNegativeTest-287127571-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4c9e7a-d785-4887-a42f-85e3257e98b1 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-6d4c9e7a-d785-4887-a42f-85e3257e98b1 None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:59:52 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-fa655bd8-ddc1-4654-bb20-2b3817ae6764 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] GET http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/share-access-rules?share_id=72db8769-ece7-42ff-af27-2e778292a9b4 May 28 12:59:52 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-fa655bd8-ddc1-4654-bb20-2b3817ae6764 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:52 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-fa655bd8-ddc1-4654-bb20-2b3817ae6764 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cddb7e-db36-4afd-89c9-af424a5804a3 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cddb7e-db36-4afd-89c9-af424a5804a3 None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cddb7e-db36-4afd-89c9-af424a5804a3 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cddb7e-db36-4afd-89c9-af424a5804a3 None admin] PATH_INFO: `/v3/users/bd14fa1f9f8a4d93b7f67c5b53f29c99` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cddb7e-db36-4afd-89c9-af424a5804a3 None admin] RBAC: Authorizing `identity:delete_user(user_id=bd14fa1f9f8a4d93b7f67c5b53f29c99)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cddb7e-db36-4afd-89c9-af424a5804a3 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:52 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-fa655bd8-ddc1-4654-bb20-2b3817ae6764 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/share-access-rules?share_id=72db8769-ece7-42ff-af27-2e778292a9b4 returned with HTTP 200 May 28 12:59:52 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 812/1602] 10.27.203.238 () {64 vars in 1467 bytes} [Tue May 28 12:59:52 2024] GET /share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/share-access-rules?share_id=72db8769-ece7-42ff-af27-2e778292a9b4 => generated 19 bytes in 30 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4c9e7a-d785-4887-a42f-85e3257e98b1 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:52 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-fd00bed9-ed6c-4ed4-b0e3-928a7e03cc40 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] POST http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbb9ad5-481f-44f7-be8d-f846e0df9b9f None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:52 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-fd00bed9-ed6c-4ed4-b0e3-928a7e03cc40 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Action body: b'{"allow_access": {"access_type": "ip", "access_to": "203.0.113.84", "access_level": "rw", "lock_visibility": true, "lock_deletion": true}}' {{(pid=98330) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbb9ad5-481f-44f7-be8d-f846e0df9b9f None admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbb9ad5-481f-44f7-be8d-f846e0df9b9f None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbb9ad5-481f-44f7-be8d-f846e0df9b9f None admin] PATH_INFO: `/v3/users/1e9067b4178d457496506d1821472cf3` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:52 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-fd00bed9-ed6c-4ed4-b0e3-928a7e03cc40 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Action: 'action', calling method: ShareController.allow_access, body: {"allow_access": {"access_type": "ip", "access_to": "203.0.113.84", "access_level": "rw", "lock_visibility": true, "lock_deletion": true}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbb9ad5-481f-44f7-be8d-f846e0df9b9f None admin] RBAC: Authorizing `identity:delete_user(user_id=1e9067b4178d457496506d1821472cf3)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbb9ad5-481f-44f7-be8d-f846e0df9b9f None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-25cddb7e-db36-4afd-89c9-af424a5804a3 None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd14fa1f9f8a4d93b7f67c5b53f29c99', 'request_id': 'req-25cddb7e-db36-4afd-89c9-af424a5804a3'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-25cddb7e-db36-4afd-89c9-af424a5804a3 None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd14fa1f9f8a4d93b7f67c5b53f29c99', 'request_id': 'req-25cddb7e-db36-4afd-89c9-af424a5804a3'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-dcbb9ad5-481f-44f7-be8d-f846e0df9b9f None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e9067b4178d457496506d1821472cf3', 'request_id': 'req-dcbb9ad5-481f-44f7-be8d-f846e0df9b9f'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:52 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-fd00bed9-ed6c-4ed4-b0e3-928a7e03cc40 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-25cddb7e-db36-4afd-89c9-af424a5804a3 None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd14fa1f9f8a4d93b7f67c5b53f29c99', 'request_id': 'req-25cddb7e-db36-4afd-89c9-af424a5804a3'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:52 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-fd00bed9-ed6c-4ed4-b0e3-928a7e03cc40 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-25cddb7e-db36-4afd-89c9-af424a5804a3 None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd14fa1f9f8a4d93b7f67c5b53f29c99', 'request_id': 'req-25cddb7e-db36-4afd-89c9-af424a5804a3'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-25cddb7e-db36-4afd-89c9-af424a5804a3 None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd14fa1f9f8a4d93b7f67c5b53f29c99', 'request_id': 'req-25cddb7e-db36-4afd-89c9-af424a5804a3'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-dcbb9ad5-481f-44f7-be8d-f846e0df9b9f None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e9067b4178d457496506d1821472cf3', 'request_id': 'req-dcbb9ad5-481f-44f7-be8d-f846e0df9b9f'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-dcbb9ad5-481f-44f7-be8d-f846e0df9b9f None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e9067b4178d457496506d1821472cf3', 'request_id': 'req-dcbb9ad5-481f-44f7-be8d-f846e0df9b9f'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-dcbb9ad5-481f-44f7-be8d-f846e0df9b9f None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e9067b4178d457496506d1821472cf3', 'request_id': 'req-dcbb9ad5-481f-44f7-be8d-f846e0df9b9f'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-dcbb9ad5-481f-44f7-be8d-f846e0df9b9f None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e9067b4178d457496506d1821472cf3', 'request_id': 'req-dcbb9ad5-481f-44f7-be8d-f846e0df9b9f'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1328/2629] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 12:59:52 2024] DELETE /identity/v3/users/1e9067b4178d457496506d1821472cf3 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbb9ad5-481f-44f7-be8d-f846e0df9b9f None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-dcbb9ad5-481f-44f7-be8d-f846e0df9b9f None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1302/2630] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 12:59:52 2024] DELETE /identity/v3/users/bd14fa1f9f8a4d93b7f67c5b53f29c99 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdeb63c-8d98-4389-9b6f-03fb03db1bfb None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdeb63c-8d98-4389-9b6f-03fb03db1bfb None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdeb63c-8d98-4389-9b6f-03fb03db1bfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:52 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-fd00bed9-ed6c-4ed4-b0e3-928a7e03cc40 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.045s {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-9bdeb63c-8d98-4389-9b6f-03fb03db1bfb None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-9bdeb63c-8d98-4389-9b6f-03fb03db1bfb None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-9bdeb63c-8d98-4389-9b6f-03fb03db1bfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:59:52 l75lg1-v1 manila-share[98474]: DEBUG manila.share.manager [None req-fd00bed9-ed6c-4ed4-b0e3-928a7e03cc40 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Received request to update access for share instance 7fdd602c-79d0-479c-95a2-336b202c6639. {{(pid=98474) update_access_for_instances /opt/stack/manila/manila/share/manager.py:4353}} May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbb9ad5-481f-44f7-be8d-f846e0df9b9f None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:52 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-fd00bed9-ed6c-4ed4-b0e3-928a7e03cc40 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action returned with HTTP 200 May 28 12:59:52 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 791/1603] 10.27.203.238 () {66 vars in 1494 bytes} [Tue May 28 12:59:52 2024] POST /share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action => generated 310 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:59:52 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-1a66c58e-1366-4fb9-999d-1495bdb0ca8d tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] GET http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/share-access-rules?share_id=72db8769-ece7-42ff-af27-2e778292a9b4 May 28 12:59:52 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-1a66c58e-1366-4fb9-999d-1495bdb0ca8d tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:52 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-1a66c58e-1366-4fb9-999d-1495bdb0ca8d tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:52 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-fd00bed9-ed6c-4ed4-b0e3-928a7e03cc40 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:52 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-fd00bed9-ed6c-4ed4-b0e3-928a7e03cc40 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:52 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-fd00bed9-ed6c-4ed4-b0e3-928a7e03cc40 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.004s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:52 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-fd00bed9-ed6c-4ed4-b0e3-928a7e03cc40 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1303/2631] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:59:52 2024] POST /identity/v3/auth/tokens => generated 2960 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 12:59:52 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-fd00bed9-ed6c-4ed4-b0e3-928a7e03cc40 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.002s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c42d0a-d8a6-488a-970e-ff504a09331e None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c42d0a-d8a6-488a-970e-ff504a09331e None admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c42d0a-d8a6-488a-970e-ff504a09331e None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c42d0a-d8a6-488a-970e-ff504a09331e None admin] PATH_INFO: `/v3/users/b04fbccbd4af4d03ba7d54550e06e586` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:52 l75lg1-v1 neutron-server[77618]: DEBUG neutron.wsgi [-] (77618) accepted ('10.27.203.238', 41264) {{(pid=77618) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c42d0a-d8a6-488a-970e-ff504a09331e None admin] RBAC: Authorizing `identity:delete_user(user_id=b04fbccbd4af4d03ba7d54550e06e586)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c42d0a-d8a6-488a-970e-ff504a09331e None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdeb63c-8d98-4389-9b6f-03fb03db1bfb None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-9bdeb63c-8d98-4389-9b6f-03fb03db1bfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:59:52 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.lock.api [None req-1a66c58e-1366-4fb9-999d-1495bdb0ca8d tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Searching for locks by: {'resource_id': 'f540cca6-17b6-4c40-bb6a-afd8f0d66073', 'resource_action': 'show', 'resource_type': 'access_rule'} {{(pid=98329) get_all /opt/stack/manila/manila/lock/api.py:112}} May 28 12:59:52 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-1a66c58e-1366-4fb9-999d-1495bdb0ca8d tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/share-access-rules?share_id=72db8769-ece7-42ff-af27-2e778292a9b4 returned with HTTP 200 May 28 12:59:52 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 813/1604] 10.27.203.238 () {64 vars in 1467 bytes} [Tue May 28 12:59:52 2024] GET /share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/share-access-rules?share_id=72db8769-ece7-42ff-af27-2e778292a9b4 => generated 265 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:59:52 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-fd00bed9-ed6c-4ed4-b0e3-928a7e03cc40 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.058s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:52 l75lg1-v1 manila-share[98474]: DEBUG manila.share.access [None req-fd00bed9-ed6c-4ed4-b0e3-928a7e03cc40 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Updating access rules for share instance 7fdd602c-79d0-479c-95a2-336b202c6639 belonging to share 72db8769-ece7-42ff-af27-2e778292a9b4. {{(pid=98474) update_access_rules /opt/stack/manila/manila/share/access.py:298}} May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-16c42d0a-d8a6-488a-970e-ff504a09331e None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b04fbccbd4af4d03ba7d54550e06e586', 'request_id': 'req-16c42d0a-d8a6-488a-970e-ff504a09331e'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:52 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-fefb4ffd-6ff4-4b70-8d84-37604778aed3 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] GET http://10.27.203.238/share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/shares/6bf55297-267e-4c0f-8a15-10257c79ab6a May 28 12:59:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdeb63c-8d98-4389-9b6f-03fb03db1bfb None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:52 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-fefb4ffd-6ff4-4b70-8d84-37604778aed3 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:52 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-fefb4ffd-6ff4-4b70-8d84-37604778aed3 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-16c42d0a-d8a6-488a-970e-ff504a09331e None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b04fbccbd4af4d03ba7d54550e06e586', 'request_id': 'req-16c42d0a-d8a6-488a-970e-ff504a09331e'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-16c42d0a-d8a6-488a-970e-ff504a09331e None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b04fbccbd4af4d03ba7d54550e06e586', 'request_id': 'req-16c42d0a-d8a6-488a-970e-ff504a09331e'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-16c42d0a-d8a6-488a-970e-ff504a09331e None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b04fbccbd4af4d03ba7d54550e06e586', 'request_id': 'req-16c42d0a-d8a6-488a-970e-ff504a09331e'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:53 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-fd00bed9-ed6c-4ed4-b0e3-928a7e03cc40 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:53 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-fd00bed9-ed6c-4ed4-b0e3-928a7e03cc40 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-16c42d0a-d8a6-488a-970e-ff504a09331e None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b04fbccbd4af4d03ba7d54550e06e586', 'request_id': 'req-16c42d0a-d8a6-488a-970e-ff504a09331e'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:53 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-fefb4ffd-6ff4-4b70-8d84-37604778aed3 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] http://10.27.203.238/share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/shares/6bf55297-267e-4c0f-8a15-10257c79ab6a returned with HTTP 200 May 28 12:59:53 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 792/1605] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:59:52 2024] GET /share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/shares/6bf55297-267e-4c0f-8a15-10257c79ab6a => generated 1369 bytes in 25 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:59:53 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-fd00bed9-ed6c-4ed4-b0e3-928a7e03cc40 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.008s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:53 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-fd00bed9-ed6c-4ed4-b0e3-928a7e03cc40 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:53 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-fd00bed9-ed6c-4ed4-b0e3-928a7e03cc40 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1329/2632] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 12:59:52 2024] DELETE /identity/v3/users/b04fbccbd4af4d03ba7d54550e06e586 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da4c28c-1e82-4828-8172-3239e33f0567 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da4c28c-1e82-4828-8172-3239e33f0567 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da4c28c-1e82-4828-8172-3239e33f0567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc785fa-a818-4571-99c6-6708cf8addfc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef17047035e4b518fd5360a01f2da1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc785fa-a818-4571-99c6-6708cf8addfc service neutron] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc785fa-a818-4571-99c6-6708cf8addfc service neutron] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc785fa-a818-4571-99c6-6708cf8addfc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-edc785fa-a818-4571-99c6-6708cf8addfc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:59:53 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-fd00bed9-ed6c-4ed4-b0e3-928a7e03cc40 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.018s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-2da4c28c-1e82-4828-8172-3239e33f0567 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:59:53 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-fd00bed9-ed6c-4ed4-b0e3-928a7e03cc40 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] changing access on None May 28 12:59:53 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-fd00bed9-ed6c-4ed4-b0e3-928a7e03cc40 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:59:53 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-fd00bed9-ed6c-4ed4-b0e3-928a7e03cc40 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] {'allow_redirects': True, May 28 12:59:53 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-fd00bed9-ed6c-4ed4-b0e3-928a7e03cc40 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] 'params': {'name': '7fdd602c-79d0-479c-95a2-336b202c6639'}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-2da4c28c-1e82-4828-8172-3239e33f0567 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-2da4c28c-1e82-4828-8172-3239e33f0567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc785fa-a818-4571-99c6-6708cf8addfc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc785fa-a818-4571-99c6-6708cf8addfc service neutron] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1304/2633] 10.27.203.238 () {64 vars in 1432 bytes} [Tue May 28 12:59:52 2024] GET /identity/v3/auth/tokens => generated 2960 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1330/2634] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:59:53 2024] POST /identity/v3/auth/tokens => generated 2960 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 28 12:59:53 l75lg1-v1 neutron-server[77619]: DEBUG neutron.wsgi [-] (77619) accepted ('10.27.203.238', 41270) {{(pid=77619) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 12:59:53 l75lg1-v1 neutron-server[77618]: INFO neutron.wsgi [None req-be92778a-e049-46c1-9a7f-f83f19da36c5 None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=3520fb8495ee410b81f6760a62e1bca2&name=default HTTP/1.1" status: 200 len: 216 time: 0.1431184 May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc785fa-a818-4571-99c6-6708cf8addfc service neutron] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da4c28c-1e82-4828-8172-3239e33f0567 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-edc785fa-a818-4571-99c6-6708cf8addfc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-2da4c28c-1e82-4828-8172-3239e33f0567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da4c28c-1e82-4828-8172-3239e33f0567 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc785fa-a818-4571-99c6-6708cf8addfc service neutron] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab05d42-463f-4cd8-9eb8-9360ce34022a None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab05d42-463f-4cd8-9eb8-9360ce34022a None admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab05d42-463f-4cd8-9eb8-9360ce34022a None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab05d42-463f-4cd8-9eb8-9360ce34022a None admin] PATH_INFO: `/v3/projects/3520fb8495ee410b81f6760a62e1bca2` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab05d42-463f-4cd8-9eb8-9360ce34022a None admin] RBAC: Authorizing `identity:delete_project(project_id=3520fb8495ee410b81f6760a62e1bca2)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab05d42-463f-4cd8-9eb8-9360ce34022a None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69247c05-21d5-4023-bdee-0e093ed42442 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef17047035e4b518fd5360a01f2da1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69247c05-21d5-4023-bdee-0e093ed42442 service neutron] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69247c05-21d5-4023-bdee-0e093ed42442 service neutron] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69247c05-21d5-4023-bdee-0e093ed42442 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69247c05-21d5-4023-bdee-0e093ed42442 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69247c05-21d5-4023-bdee-0e093ed42442 service neutron] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-2ab05d42-463f-4cd8-9eb8-9360ce34022a None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3520fb8495ee410b81f6760a62e1bca2', 'request_id': 'req-2ab05d42-463f-4cd8-9eb8-9360ce34022a'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1305/2635] 10.27.203.238 () {64 vars in 1432 bytes} [Tue May 28 12:59:53 2024] GET /identity/v3/auth/tokens => generated 2960 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-2ab05d42-463f-4cd8-9eb8-9360ce34022a None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3520fb8495ee410b81f6760a62e1bca2', 'request_id': 'req-2ab05d42-463f-4cd8-9eb8-9360ce34022a'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:53 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e7245d6a-0625-4258-a172-a4e5aad67460 tempest-ShareRulesTest-1530341375 None] <<< [GET] https://127.0.0.1:40443/api/vippools/ May 28 12:59:53 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e7245d6a-0625-4258-a172-a4e5aad67460 tempest-ShareRulesTest-1530341375 None] [Bunch(active_cnode_ids=[], active_interfaces=4, cluster='loop75-kfs', cluster_id=1, cnode_ids=[], cnodes=[], domain_name='vippool-1', enable_l3=False, enable_weighted_balancing=False, enabled=True, end_ip='172.21.75.4', guid='f2abaede-b397-413a-8faa-3aeead6d3b28', gw_ip='', gw_ipv6='', id=2, ip_ranges=[['172.21.75.1', '172.21.75.4']], name='vippool-1', peer_asn=0, port_membership='ALL', ranges_summary='172.21.75.[1-4]', role='PROTOCOLS', start_ip='172.21.75.1', subnet_cidr=16, subnet_cidr_ipv6=None, sync='SYNCED', sync_time='2024-05-28T12:50:09.644123Z', tenant_id=1, tenant_name='default', title='172.21.75.1 - 172.21.75.4', url='https://127.0.0.1:40443/api/vippools/2/', vast_asn=0, vlan=0, vms_preferred=False)] May 28 12:59:53 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e7245d6a-0625-4258-a172-a4e5aad67460 tempest-ShareRulesTest-1530341375 None] --- [GET] https://127.0.0.1:40443/api/vippools/: Done May 28 12:59:53 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e7245d6a-0625-4258-a172-a4e5aad67460 tempest-ShareRulesTest-1530341375 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:59:53 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e7245d6a-0625-4258-a172-a4e5aad67460 tempest-ShareRulesTest-1530341375 None] {'allow_redirects': True, May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-2ab05d42-463f-4cd8-9eb8-9360ce34022a None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3520fb8495ee410b81f6760a62e1bca2', 'request_id': 'req-2ab05d42-463f-4cd8-9eb8-9360ce34022a'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:53 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e7245d6a-0625-4258-a172-a4e5aad67460 tempest-ShareRulesTest-1530341375 None] 'params': {'name': 'f7e47502-a0f7-44de-953d-b7b5697ae0b2'}} May 28 12:59:53 l75lg1-v1 neutron-server[77619]: INFO neutron.wsgi [None req-93704597-2d6e-4338-b14c-6333e9326a02 None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=ec850008fab34430bc3261f8c74f5611&name=default HTTP/1.1" status: 200 len: 216 time: 0.0750208 May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69247c05-21d5-4023-bdee-0e093ed42442 service neutron] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-69247c05-21d5-4023-bdee-0e093ed42442 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69247c05-21d5-4023-bdee-0e093ed42442 service neutron] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-2ab05d42-463f-4cd8-9eb8-9360ce34022a None admin] The token cache is being invalidate because project 3520fb8495ee410b81f6760a62e1bca2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-2ab05d42-463f-4cd8-9eb8-9360ce34022a None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-2ab05d42-463f-4cd8-9eb8-9360ce34022a None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1331/2636] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 12:59:53 2024] DELETE /identity/v3/projects/3520fb8495ee410b81f6760a62e1bca2 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ac5f1c-67ef-485a-b0d9-07bcffed9097 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ac5f1c-67ef-485a-b0d9-07bcffed9097 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ac5f1c-67ef-485a-b0d9-07bcffed9097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-56ac5f1c-67ef-485a-b0d9-07bcffed9097 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-56ac5f1c-67ef-485a-b0d9-07bcffed9097 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-56ac5f1c-67ef-485a-b0d9-07bcffed9097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1332/2637] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:59:53 2024] POST /identity/v3/auth/tokens => generated 312 bytes in 18 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465d4260-e468-40af-8b04-86e5e29c0e0b None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465d4260-e468-40af-8b04-86e5e29c0e0b None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465d4260-e468-40af-8b04-86e5e29c0e0b None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465d4260-e468-40af-8b04-86e5e29c0e0b None admin] PATH_INFO: `/v3/projects/ec850008fab34430bc3261f8c74f5611` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465d4260-e468-40af-8b04-86e5e29c0e0b None admin] RBAC: Authorizing `identity:delete_project(project_id=ec850008fab34430bc3261f8c74f5611)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465d4260-e468-40af-8b04-86e5e29c0e0b None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c584e5-d6ec-4e99-99b1-1eaf18aef3fb None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c584e5-d6ec-4e99-99b1-1eaf18aef3fb None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c584e5-d6ec-4e99-99b1-1eaf18aef3fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-50c584e5-d6ec-4e99-99b1-1eaf18aef3fb None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-50c584e5-d6ec-4e99-99b1-1eaf18aef3fb None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-50c584e5-d6ec-4e99-99b1-1eaf18aef3fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1333/2638] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:59:53 2024] POST /identity/v3/auth/tokens => generated 2960 bytes in 22 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c584e5-d6ec-4e99-99b1-1eaf18aef3fb None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c584e5-d6ec-4e99-99b1-1eaf18aef3fb None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-465d4260-e468-40af-8b04-86e5e29c0e0b None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec850008fab34430bc3261f8c74f5611', 'request_id': 'req-465d4260-e468-40af-8b04-86e5e29c0e0b'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-465d4260-e468-40af-8b04-86e5e29c0e0b None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec850008fab34430bc3261f8c74f5611', 'request_id': 'req-465d4260-e468-40af-8b04-86e5e29c0e0b'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:53 l75lg1-v1 dstat.sh[49771]: 28-05 12:59:53| 25 3 69 3 0|5744M 1718M 277M 7886M| 15k 22k| 0 4050k| 0 530 | 14k 23k|1.23 1.08 1.02|5.0 1.0 0| 0 0 | 0 2048M| 29 363 0 43 2 May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c5d1b5-e8af-4302-af4f-0d19f0f2a80a None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c5d1b5-e8af-4302-af4f-0d19f0f2a80a None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c5d1b5-e8af-4302-af4f-0d19f0f2a80a None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c5d1b5-e8af-4302-af4f-0d19f0f2a80a None admin] PATH_INFO: `/v3/domains` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c5d1b5-e8af-4302-af4f-0d19f0f2a80a None admin] RBAC: Adding query filter params (name=Default) {{(pid=51267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c5d1b5-e8af-4302-af4f-0d19f0f2a80a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c5d1b5-e8af-4302-af4f-0d19f0f2a80a None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-465d4260-e468-40af-8b04-86e5e29c0e0b None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec850008fab34430bc3261f8c74f5611', 'request_id': 'req-465d4260-e468-40af-8b04-86e5e29c0e0b'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1334/2639] 10.27.203.238 () {62 vars in 1220 bytes} [Tue May 28 12:59:53 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c5d1b5-e8af-4302-af4f-0d19f0f2a80a None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-465d4260-e468-40af-8b04-86e5e29c0e0b None admin] The token cache is being invalidate because project ec850008fab34430bc3261f8c74f5611 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-465d4260-e468-40af-8b04-86e5e29c0e0b None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-465d4260-e468-40af-8b04-86e5e29c0e0b None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c5d1b5-e8af-4302-af4f-0d19f0f2a80a None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1306/2640] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 12:59:53 2024] DELETE /identity/v3/projects/ec850008fab34430bc3261f8c74f5611 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 28 12:59:53 l75lg1-v1 neutron-server[77619]: DEBUG neutron.wsgi [-] (77619) accepted ('10.27.203.238', 41276) {{(pid=77619) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96a98eb-5fbc-4429-b062-fa7366c18664 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96a98eb-5fbc-4429-b062-fa7366c18664 None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96a98eb-5fbc-4429-b062-fa7366c18664 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96a98eb-5fbc-4429-b062-fa7366c18664 None admin] PATH_INFO: `/v3/projects` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96a98eb-5fbc-4429-b062-fa7366c18664 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96a98eb-5fbc-4429-b062-fa7366c18664 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:53 l75lg1-v1 neutron-server[77619]: INFO neutron.wsgi [None req-c996e8f8-a466-4024-934e-8285c6c3c364 None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=8f5f6af328db444086f50a26f4d62e63&name=default HTTP/1.1" status: 200 len: 216 time: 0.0089536 May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465d4260-e468-40af-8b04-86e5e29c0e0b None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-465d4260-e468-40af-8b04-86e5e29c0e0b None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465d4260-e468-40af-8b04-86e5e29c0e0b None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55bb7cd-08ee-4841-9d1e-4fba8be914ac None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55bb7cd-08ee-4841-9d1e-4fba8be914ac None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55bb7cd-08ee-4841-9d1e-4fba8be914ac None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55bb7cd-08ee-4841-9d1e-4fba8be914ac None admin] PATH_INFO: `/v3/projects/8f5f6af328db444086f50a26f4d62e63` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55bb7cd-08ee-4841-9d1e-4fba8be914ac None admin] RBAC: Authorizing `identity:delete_project(project_id=8f5f6af328db444086f50a26f4d62e63)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55bb7cd-08ee-4841-9d1e-4fba8be914ac None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1335/2641] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 12:59:53 2024] POST /identity/v3/projects => generated 373 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96a98eb-5fbc-4429-b062-fa7366c18664 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-c96a98eb-5fbc-4429-b062-fa7366c18664 None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96a98eb-5fbc-4429-b062-fa7366c18664 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-c55bb7cd-08ee-4841-9d1e-4fba8be914ac None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f5f6af328db444086f50a26f4d62e63', 'request_id': 'req-c55bb7cd-08ee-4841-9d1e-4fba8be914ac'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-c55bb7cd-08ee-4841-9d1e-4fba8be914ac None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f5f6af328db444086f50a26f4d62e63', 'request_id': 'req-c55bb7cd-08ee-4841-9d1e-4fba8be914ac'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b06be2-4dab-47c3-95f4-437c3f2a6d66 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b06be2-4dab-47c3-95f4-437c3f2a6d66 None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b06be2-4dab-47c3-95f4-437c3f2a6d66 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b06be2-4dab-47c3-95f4-437c3f2a6d66 None admin] PATH_INFO: `/v3/users` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b06be2-4dab-47c3-95f4-437c3f2a6d66 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b06be2-4dab-47c3-95f4-437c3f2a6d66 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-c3b06be2-4dab-47c3-95f4-437c3f2a6d66 None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-c55bb7cd-08ee-4841-9d1e-4fba8be914ac None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f5f6af328db444086f50a26f4d62e63', 'request_id': 'req-c55bb7cd-08ee-4841-9d1e-4fba8be914ac'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:53 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-fd00bed9-ed6c-4ed4-b0e3-928a7e03cc40 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:59:53 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-fd00bed9-ed6c-4ed4-b0e3-928a7e03cc40 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] [Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=1, created='2024-05-28T12:58:43.845440Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='31b6534b-d142-4561-992f-4f0759db302d', id=32, internal=False, is_s3_default_policy=False, name='7fdd602c-79d0-479c-95a2-336b202c6639', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=['*'], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=[], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=[], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T12:59:51.815868Z', tenant_id=1, tenant_name='default', title='7fdd602c-79d0-479c-95a2-336b202c6639', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/32/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[])] May 28 12:59:53 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-fd00bed9-ed6c-4ed4-b0e3-928a7e03cc40 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 12:59:53 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-fd00bed9-ed6c-4ed4-b0e3-928a7e03cc40 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] changing access on /manila/manila-7fdd602c-79d0-479c-95a2-336b202c6639. Rules: {'nfs_read_write': ['203.0.113.84'], 'nfs_read_only': []} May 28 12:59:53 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-fd00bed9-ed6c-4ed4-b0e3-928a7e03cc40 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] >>> [PATCH] https://127.0.0.1:40443/api/viewpolicies/32/ May 28 12:59:53 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-fd00bed9-ed6c-4ed4-b0e3-928a7e03cc40 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] {'data': '{"name": "7fdd602c-79d0-479c-95a2-336b202c6639", "nfs_no_squash": ' May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-c55bb7cd-08ee-4841-9d1e-4fba8be914ac None admin] The token cache is being invalidate because project 8f5f6af328db444086f50a26f4d62e63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-c55bb7cd-08ee-4841-9d1e-4fba8be914ac None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:53 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-fd00bed9-ed6c-4ed4-b0e3-928a7e03cc40 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] '["*"], "nfs_root_squash": ["*"], "nfs_read_write": ["203.0.113.84"], ' May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-c55bb7cd-08ee-4841-9d1e-4fba8be914ac None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:53 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-fd00bed9-ed6c-4ed4-b0e3-928a7e03cc40 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] '"nfs_read_only": []}', May 28 12:59:53 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-fd00bed9-ed6c-4ed4-b0e3-928a7e03cc40 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] 'params': None} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1307/2642] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 12:59:53 2024] DELETE /identity/v3/projects/8f5f6af328db444086f50a26f4d62e63 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 28 12:59:53 l75lg1-v1 neutron-server[77619]: DEBUG neutron.wsgi [-] (77619) accepted ('10.27.203.238', 41292) {{(pid=77619) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 12:59:53 l75lg1-v1 neutron-server[77619]: INFO neutron.wsgi [None req-1ef8b527-5dfe-43bd-8f39-5364f0d1ea9f None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=2eed962b52a8433c9c503bd3155203e0&name=default HTTP/1.1" status: 200 len: 216 time: 0.0085955 May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1336/2643] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 12:59:53 2024] POST /identity/v3/users => generated 295 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55bb7cd-08ee-4841-9d1e-4fba8be914ac None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-c55bb7cd-08ee-4841-9d1e-4fba8be914ac None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b06be2-4dab-47c3-95f4-437c3f2a6d66 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-c3b06be2-4dab-47c3-95f4-437c3f2a6d66 None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55bb7cd-08ee-4841-9d1e-4fba8be914ac None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b06be2-4dab-47c3-95f4-437c3f2a6d66 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00edd7d7-8412-4928-87b8-721c871a8ba6 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00edd7d7-8412-4928-87b8-721c871a8ba6 None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00edd7d7-8412-4928-87b8-721c871a8ba6 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d61a42-b1c6-4e87-be10-1f02996ffefd None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00edd7d7-8412-4928-87b8-721c871a8ba6 None admin] PATH_INFO: `/v3/projects/2eed962b52a8433c9c503bd3155203e0` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d61a42-b1c6-4e87-be10-1f02996ffefd None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d61a42-b1c6-4e87-be10-1f02996ffefd None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d61a42-b1c6-4e87-be10-1f02996ffefd None admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00edd7d7-8412-4928-87b8-721c871a8ba6 None admin] RBAC: Authorizing `identity:delete_project(project_id=2eed962b52a8433c9c503bd3155203e0)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d61a42-b1c6-4e87-be10-1f02996ffefd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00edd7d7-8412-4928-87b8-721c871a8ba6 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d61a42-b1c6-4e87-be10-1f02996ffefd None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1337/2644] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 12:59:53 2024] GET /identity/v3/roles => generated 1680 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d61a42-b1c6-4e87-be10-1f02996ffefd None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d61a42-b1c6-4e87-be10-1f02996ffefd None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8162aaae-5fb9-4c37-96a7-313582db83b2 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8162aaae-5fb9-4c37-96a7-313582db83b2 None admin] REQUEST_METHOD: `PUT` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8162aaae-5fb9-4c37-96a7-313582db83b2 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8162aaae-5fb9-4c37-96a7-313582db83b2 None admin] PATH_INFO: `/v3/projects/a9041f7c5fff43159545a43cdafa94d5/users/34dfe2e86b2e48f9854064756768aa07/roles/44620cad10ae407c90c91e2c296adb04` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8162aaae-5fb9-4c37-96a7-313582db83b2 None admin] RBAC: Authorizing `identity:create_grant(project_id=a9041f7c5fff43159545a43cdafa94d5, user_id=34dfe2e86b2e48f9854064756768aa07, role_id=44620cad10ae407c90c91e2c296adb04)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8162aaae-5fb9-4c37-96a7-313582db83b2 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-00edd7d7-8412-4928-87b8-721c871a8ba6 None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2eed962b52a8433c9c503bd3155203e0', 'request_id': 'req-00edd7d7-8412-4928-87b8-721c871a8ba6'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-00edd7d7-8412-4928-87b8-721c871a8ba6 None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2eed962b52a8433c9c503bd3155203e0', 'request_id': 'req-00edd7d7-8412-4928-87b8-721c871a8ba6'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1338/2645] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 12:59:53 2024] PUT /identity/v3/projects/a9041f7c5fff43159545a43cdafa94d5/users/34dfe2e86b2e48f9854064756768aa07/roles/44620cad10ae407c90c91e2c296adb04 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-00edd7d7-8412-4928-87b8-721c871a8ba6 None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2eed962b52a8433c9c503bd3155203e0', 'request_id': 'req-00edd7d7-8412-4928-87b8-721c871a8ba6'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bfd9ed-eea1-495c-a4c5-2339075f76c8 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bfd9ed-eea1-495c-a4c5-2339075f76c8 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bfd9ed-eea1-495c-a4c5-2339075f76c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-00edd7d7-8412-4928-87b8-721c871a8ba6 None admin] The token cache is being invalidate because project 2eed962b52a8433c9c503bd3155203e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-00edd7d7-8412-4928-87b8-721c871a8ba6 None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-00edd7d7-8412-4928-87b8-721c871a8ba6 None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:53 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e7245d6a-0625-4258-a172-a4e5aad67460 tempest-ShareRulesTest-1530341375 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:59:53 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e7245d6a-0625-4258-a172-a4e5aad67460 tempest-ShareRulesTest-1530341375 None] [] May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1308/2646] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 12:59:53 2024] DELETE /identity/v3/projects/2eed962b52a8433c9c503bd3155203e0 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:59:53 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e7245d6a-0625-4258-a172-a4e5aad67460 tempest-ShareRulesTest-1530341375 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 12:59:53 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e7245d6a-0625-4258-a172-a4e5aad67460 tempest-ShareRulesTest-1530341375 None] >>> [POST] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:59:53 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e7245d6a-0625-4258-a172-a4e5aad67460 tempest-ShareRulesTest-1530341375 None] {'data': '{"name": "f7e47502-a0f7-44de-953d-b7b5697ae0b2"}', May 28 12:59:53 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e7245d6a-0625-4258-a172-a4e5aad67460 tempest-ShareRulesTest-1530341375 None] 'json': None, May 28 12:59:53 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e7245d6a-0625-4258-a172-a4e5aad67460 tempest-ShareRulesTest-1530341375 None] 'params': None} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-83bfd9ed-eea1-495c-a4c5-2339075f76c8 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b03ca8-b04a-40be-8d57-db7617a05678 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b03ca8-b04a-40be-8d57-db7617a05678 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b03ca8-b04a-40be-8d57-db7617a05678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-83bfd9ed-eea1-495c-a4c5-2339075f76c8 None None] MFA Rules not processed for user `34dfe2e86b2e48f9854064756768aa07`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-83bfd9ed-eea1-495c-a4c5-2339075f76c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-f4b03ca8-b04a-40be-8d57-db7617a05678 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-f4b03ca8-b04a-40be-8d57-db7617a05678 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-f4b03ca8-b04a-40be-8d57-db7617a05678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1309/2647] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:59:53 2024] POST /identity/v3/auth/tokens => generated 312 bytes in 19 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670ee563-9a43-4a1a-b5a1-24931045e3fd None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670ee563-9a43-4a1a-b5a1-24931045e3fd None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670ee563-9a43-4a1a-b5a1-24931045e3fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-670ee563-9a43-4a1a-b5a1-24931045e3fd None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-670ee563-9a43-4a1a-b5a1-24931045e3fd None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-670ee563-9a43-4a1a-b5a1-24931045e3fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1339/2648] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:59:53 2024] POST /identity/v3/auth/tokens => generated 3944 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bfd9ed-eea1-495c-a4c5-2339075f76c8 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-83bfd9ed-eea1-495c-a4c5-2339075f76c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1310/2649] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:59:53 2024] POST /identity/v3/auth/tokens => generated 2960 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670ee563-9a43-4a1a-b5a1-24931045e3fd None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670ee563-9a43-4a1a-b5a1-24931045e3fd None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d3c50a-7d2d-490d-ae96-1d2149390571 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d3c50a-7d2d-490d-ae96-1d2149390571 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d3c50a-7d2d-490d-ae96-1d2149390571 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d3c50a-7d2d-490d-ae96-1d2149390571 None admin] PATH_INFO: `/v3/domains` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d3c50a-7d2d-490d-ae96-1d2149390571 None admin] RBAC: Adding query filter params (name=Default) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d3c50a-7d2d-490d-ae96-1d2149390571 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d3c50a-7d2d-490d-ae96-1d2149390571 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bfd9ed-eea1-495c-a4c5-2339075f76c8 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1311/2650] 10.27.203.238 () {62 vars in 1220 bytes} [Tue May 28 12:59:53 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148f0780-119d-4bf9-8e35-3a021d3ebc39 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148f0780-119d-4bf9-8e35-3a021d3ebc39 None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148f0780-119d-4bf9-8e35-3a021d3ebc39 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148f0780-119d-4bf9-8e35-3a021d3ebc39 None admin] PATH_INFO: `/v3/projects` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148f0780-119d-4bf9-8e35-3a021d3ebc39 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d3c50a-7d2d-490d-ae96-1d2149390571 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148f0780-119d-4bf9-8e35-3a021d3ebc39 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d3c50a-7d2d-490d-ae96-1d2149390571 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30ffffe-f237-4cf2-8952-b1a393adfb5f None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30ffffe-f237-4cf2-8952-b1a393adfb5f None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30ffffe-f237-4cf2-8952-b1a393adfb5f None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30ffffe-f237-4cf2-8952-b1a393adfb5f None admin] PATH_INFO: `/v3/projects` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30ffffe-f237-4cf2-8952-b1a393adfb5f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30ffffe-f237-4cf2-8952-b1a393adfb5f None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:53 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:59:53 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.manager [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Starting heal instance info cache {{(pid=83654) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}} May 28 12:59:53 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.manager [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Rebuilding the list of instances to heal {{(pid=83654) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9930}} May 28 12:59:53 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Expecting reply to msg 65fb6e82b9a84900b5d8dd03ced0ccb9 in queue reply_37f4cbd1dd094961a22b8a65f222c327 May 28 12:59:53 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [-] Received RPC response for msg 65fb6e82b9a84900b5d8dd03ced0ccb9 May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1340/2651] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 12:59:53 2024] POST /identity/v3/projects => generated 373 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148f0780-119d-4bf9-8e35-3a021d3ebc39 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1312/2652] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 12:59:53 2024] POST /identity/v3/projects => generated 391 bytes in 35 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30ffffe-f237-4cf2-8952-b1a393adfb5f None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148f0780-119d-4bf9-8e35-3a021d3ebc39 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30ffffe-f237-4cf2-8952-b1a393adfb5f None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f9af11-bd5f-488a-8fb8-f3816bf363bd None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f9af11-bd5f-488a-8fb8-f3816bf363bd None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f9af11-bd5f-488a-8fb8-f3816bf363bd None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f9af11-bd5f-488a-8fb8-f3816bf363bd None admin] PATH_INFO: `/v3/users` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f9af11-bd5f-488a-8fb8-f3816bf363bd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f9af11-bd5f-488a-8fb8-f3816bf363bd None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dd41ea-3fdf-4f52-abb3-b540b5c8c73a None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dd41ea-3fdf-4f52-abb3-b540b5c8c73a None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dd41ea-3fdf-4f52-abb3-b540b5c8c73a None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dd41ea-3fdf-4f52-abb3-b540b5c8c73a None admin] PATH_INFO: `/v3/users` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-a2f9af11-bd5f-488a-8fb8-f3816bf363bd None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dd41ea-3fdf-4f52-abb3-b540b5c8c73a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dd41ea-3fdf-4f52-abb3-b540b5c8c73a None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-36dd41ea-3fdf-4f52-abb3-b540b5c8c73a None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1313/2653] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 12:59:53 2024] POST /identity/v3/users => generated 304 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f9af11-bd5f-488a-8fb8-f3816bf363bd None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1341/2654] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 12:59:53 2024] POST /identity/v3/users => generated 295 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dd41ea-3fdf-4f52-abb3-b540b5c8c73a None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f9af11-bd5f-488a-8fb8-f3816bf363bd None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dd41ea-3fdf-4f52-abb3-b540b5c8c73a None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef19e1d-06e1-4a53-8097-06794eae8a82 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef19e1d-06e1-4a53-8097-06794eae8a82 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef19e1d-06e1-4a53-8097-06794eae8a82 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef19e1d-06e1-4a53-8097-06794eae8a82 None admin] PATH_INFO: `/v3/roles` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef19e1d-06e1-4a53-8097-06794eae8a82 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef19e1d-06e1-4a53-8097-06794eae8a82 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fb1d90-c5db-487c-af9e-b1c893ae3622 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fb1d90-c5db-487c-af9e-b1c893ae3622 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fb1d90-c5db-487c-af9e-b1c893ae3622 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fb1d90-c5db-487c-af9e-b1c893ae3622 None admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fb1d90-c5db-487c-af9e-b1c893ae3622 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fb1d90-c5db-487c-af9e-b1c893ae3622 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1314/2655] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 12:59:53 2024] GET /identity/v3/roles => generated 1680 bytes in 16 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef19e1d-06e1-4a53-8097-06794eae8a82 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1342/2656] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 12:59:53 2024] GET /identity/v3/roles => generated 1680 bytes in 16 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fb1d90-c5db-487c-af9e-b1c893ae3622 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef19e1d-06e1-4a53-8097-06794eae8a82 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fb1d90-c5db-487c-af9e-b1c893ae3622 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db812c38-339c-4ef5-a85f-deeb4e305fa1 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db812c38-339c-4ef5-a85f-deeb4e305fa1 None admin] REQUEST_METHOD: `PUT` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db812c38-339c-4ef5-a85f-deeb4e305fa1 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db812c38-339c-4ef5-a85f-deeb4e305fa1 None admin] PATH_INFO: `/v3/projects/b56adc05fb6b4d5aa0d5d21be50ec8ca/users/e0d21671f9dd4388a6cf3294a49afb54/roles/44620cad10ae407c90c91e2c296adb04` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb383c70-1e39-4fc8-8308-6b9e1e554abb None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb383c70-1e39-4fc8-8308-6b9e1e554abb None admin] REQUEST_METHOD: `PUT` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb383c70-1e39-4fc8-8308-6b9e1e554abb None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb383c70-1e39-4fc8-8308-6b9e1e554abb None admin] PATH_INFO: `/v3/projects/9ff04f236a21441e967d489f4f05af09/users/8cd6ee6f70004de383e974cb1cd3adaf/roles/44620cad10ae407c90c91e2c296adb04` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db812c38-339c-4ef5-a85f-deeb4e305fa1 None admin] RBAC: Authorizing `identity:create_grant(project_id=b56adc05fb6b4d5aa0d5d21be50ec8ca, user_id=e0d21671f9dd4388a6cf3294a49afb54, role_id=44620cad10ae407c90c91e2c296adb04)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db812c38-339c-4ef5-a85f-deeb4e305fa1 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb383c70-1e39-4fc8-8308-6b9e1e554abb None admin] RBAC: Authorizing `identity:create_grant(project_id=9ff04f236a21441e967d489f4f05af09, user_id=8cd6ee6f70004de383e974cb1cd3adaf, role_id=44620cad10ae407c90c91e2c296adb04)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb383c70-1e39-4fc8-8308-6b9e1e554abb None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1315/2657] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 12:59:53 2024] PUT /identity/v3/projects/b56adc05fb6b4d5aa0d5d21be50ec8ca/users/e0d21671f9dd4388a6cf3294a49afb54/roles/44620cad10ae407c90c91e2c296adb04 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1343/2658] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 12:59:53 2024] PUT /identity/v3/projects/9ff04f236a21441e967d489f4f05af09/users/8cd6ee6f70004de383e974cb1cd3adaf/roles/44620cad10ae407c90c91e2c296adb04 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fec048-db3d-4c70-8288-62edea375d91 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fec048-db3d-4c70-8288-62edea375d91 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fec048-db3d-4c70-8288-62edea375d91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26033a77-c9c7-453f-a8d1-84d950fafb00 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26033a77-c9c7-453f-a8d1-84d950fafb00 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26033a77-c9c7-453f-a8d1-84d950fafb00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-48fec048-db3d-4c70-8288-62edea375d91 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-26033a77-c9c7-453f-a8d1-84d950fafb00 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-26033a77-c9c7-453f-a8d1-84d950fafb00 None None] MFA Rules not processed for user `8cd6ee6f70004de383e974cb1cd3adaf`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-48fec048-db3d-4c70-8288-62edea375d91 None None] MFA Rules not processed for user `e0d21671f9dd4388a6cf3294a49afb54`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-26033a77-c9c7-453f-a8d1-84d950fafb00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-48fec048-db3d-4c70-8288-62edea375d91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1344/2659] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:59:53 2024] POST /identity/v3/auth/tokens => generated 3944 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1316/2660] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:59:53 2024] POST /identity/v3/auth/tokens => generated 3962 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26033a77-c9c7-453f-a8d1-84d950fafb00 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fec048-db3d-4c70-8288-62edea375d91 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-48fec048-db3d-4c70-8288-62edea375d91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26033a77-c9c7-453f-a8d1-84d950fafb00 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ce4b07-6d50-4f12-afdd-c15f2f4f6a08 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ce4b07-6d50-4f12-afdd-c15f2f4f6a08 None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ce4b07-6d50-4f12-afdd-c15f2f4f6a08 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ce4b07-6d50-4f12-afdd-c15f2f4f6a08 None admin] PATH_INFO: `/v3/projects` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ce4b07-6d50-4f12-afdd-c15f2f4f6a08 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ce4b07-6d50-4f12-afdd-c15f2f4f6a08 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fec048-db3d-4c70-8288-62edea375d91 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ef0211-cc80-4810-9373-7859d9d65414 service manila] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f110cf6300f049c897d0aab63218d1e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ef0211-cc80-4810-9373-7859d9d65414 service manila] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ef0211-cc80-4810-9373-7859d9d65414 service manila] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ef0211-cc80-4810-9373-7859d9d65414 service manila] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ef0211-cc80-4810-9373-7859d9d65414 service manila] RBAC: Authorizing `identity:validate_token()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ef0211-cc80-4810-9373-7859d9d65414 service manila] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1345/2661] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 12:59:53 2024] POST /identity/v3/projects => generated 371 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1317/2662] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 12:59:53 2024] GET /identity/v3/auth/tokens => generated 3962 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ce4b07-6d50-4f12-afdd-c15f2f4f6a08 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:53 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-aa0b8a0c-d37d-407f-8e30-c7c3b77c7cad tempest-SchedulerStatsNegativeTest-1097209255 tempest-SchedulerStatsNegativeTest-1097209255-project-member] GET http://10.27.203.238/share/v1/b56adc05fb6b4d5aa0d5d21be50ec8ca/scheduler-stats/pools/detail May 28 12:59:53 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-aa0b8a0c-d37d-407f-8e30-c7c3b77c7cad tempest-SchedulerStatsNegativeTest-1097209255 tempest-SchedulerStatsNegativeTest-1097209255-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:53 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-aa0b8a0c-d37d-407f-8e30-c7c3b77c7cad tempest-SchedulerStatsNegativeTest-1097209255 tempest-SchedulerStatsNegativeTest-1097209255-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:53 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.policy [None req-aa0b8a0c-d37d-407f-8e30-c7c3b77c7cad tempest-SchedulerStatsNegativeTest-1097209255 tempest-SchedulerStatsNegativeTest-1097209255-project-member] Policy check for scheduler_stats:pools:detail failed with credentials {'is_admin': False, 'user_id': 'e0d21671f9dd4388a6cf3294a49afb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56adc05fb6b4d5aa0d5d21be50ec8ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98329) authorize /opt/stack/manila/manila/policy.py:208}} May 28 12:59:53 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-aa0b8a0c-d37d-407f-8e30-c7c3b77c7cad tempest-SchedulerStatsNegativeTest-1097209255 tempest-SchedulerStatsNegativeTest-1097209255-project-member] HTTP exception thrown: Access was denied to this resource. May 28 12:59:53 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-aa0b8a0c-d37d-407f-8e30-c7c3b77c7cad tempest-SchedulerStatsNegativeTest-1097209255 tempest-SchedulerStatsNegativeTest-1097209255-project-member] http://10.27.203.238/share/v1/b56adc05fb6b4d5aa0d5d21be50ec8ca/scheduler-stats/pools/detail returned with HTTP 403 May 28 12:59:53 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 814/1606] 10.27.203.238 () {62 vars in 1363 bytes} [Tue May 28 12:59:53 2024] GET /share/v1/b56adc05fb6b4d5aa0d5d21be50ec8ca/scheduler-stats/pools/detail => generated 78 bytes in 69 msecs (HTTP/1.1 403) 6 headers in 236 bytes (1 switches on core 0) May 28 12:59:53 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-48315532-a5bc-403e-9ac9-6540fbcb2b93 tempest-SchedulerStatsNegativeTest-1097209255 tempest-SchedulerStatsNegativeTest-1097209255-project-member] GET http://10.27.203.238/share/v1/b56adc05fb6b4d5aa0d5d21be50ec8ca/scheduler-stats/pools May 28 12:59:53 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-48315532-a5bc-403e-9ac9-6540fbcb2b93 tempest-SchedulerStatsNegativeTest-1097209255 tempest-SchedulerStatsNegativeTest-1097209255-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:53 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-48315532-a5bc-403e-9ac9-6540fbcb2b93 tempest-SchedulerStatsNegativeTest-1097209255 tempest-SchedulerStatsNegativeTest-1097209255-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:53 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.policy [None req-48315532-a5bc-403e-9ac9-6540fbcb2b93 tempest-SchedulerStatsNegativeTest-1097209255 tempest-SchedulerStatsNegativeTest-1097209255-project-member] Policy check for scheduler_stats:pools:index failed with credentials {'is_admin': False, 'user_id': 'e0d21671f9dd4388a6cf3294a49afb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56adc05fb6b4d5aa0d5d21be50ec8ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98330) authorize /opt/stack/manila/manila/policy.py:208}} May 28 12:59:53 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-48315532-a5bc-403e-9ac9-6540fbcb2b93 tempest-SchedulerStatsNegativeTest-1097209255 tempest-SchedulerStatsNegativeTest-1097209255-project-member] HTTP exception thrown: Access was denied to this resource. May 28 12:59:53 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-48315532-a5bc-403e-9ac9-6540fbcb2b93 tempest-SchedulerStatsNegativeTest-1097209255 tempest-SchedulerStatsNegativeTest-1097209255-project-member] http://10.27.203.238/share/v1/b56adc05fb6b4d5aa0d5d21be50ec8ca/scheduler-stats/pools returned with HTTP 403 May 28 12:59:53 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 793/1607] 10.27.203.238 () {62 vars in 1342 bytes} [Tue May 28 12:59:53 2024] GET /share/v1/b56adc05fb6b4d5aa0d5d21be50ec8ca/scheduler-stats/pools => generated 78 bytes in 8 msecs (HTTP/1.1 403) 6 headers in 236 bytes (1 switches on core 0) May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ef0211-cc80-4810-9373-7859d9d65414 service manila] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ce4b07-6d50-4f12-afdd-c15f2f4f6a08 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ef0211-cc80-4810-9373-7859d9d65414 service manila] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f934ac7b-969a-4112-b87f-994c57092935 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f934ac7b-969a-4112-b87f-994c57092935 None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f934ac7b-969a-4112-b87f-994c57092935 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f934ac7b-969a-4112-b87f-994c57092935 None admin] PATH_INFO: `/v3/users` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f934ac7b-969a-4112-b87f-994c57092935 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f934ac7b-969a-4112-b87f-994c57092935 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9e1cdf-4f45-48cc-b2d1-7b1f2e06eb39 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9e1cdf-4f45-48cc-b2d1-7b1f2e06eb39 None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9e1cdf-4f45-48cc-b2d1-7b1f2e06eb39 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9e1cdf-4f45-48cc-b2d1-7b1f2e06eb39 None admin] PATH_INFO: `/v3/users/e0d21671f9dd4388a6cf3294a49afb54` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-f934ac7b-969a-4112-b87f-994c57092935 None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9e1cdf-4f45-48cc-b2d1-7b1f2e06eb39 None admin] RBAC: Authorizing `identity:delete_user(user_id=e0d21671f9dd4388a6cf3294a49afb54)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9e1cdf-4f45-48cc-b2d1-7b1f2e06eb39 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1346/2663] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 12:59:53 2024] POST /identity/v3/users => generated 293 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f934ac7b-969a-4112-b87f-994c57092935 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f934ac7b-969a-4112-b87f-994c57092935 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7989bda-c097-4ff8-b95d-3d281cb94d99 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7989bda-c097-4ff8-b95d-3d281cb94d99 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7989bda-c097-4ff8-b95d-3d281cb94d99 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7989bda-c097-4ff8-b95d-3d281cb94d99 None admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7989bda-c097-4ff8-b95d-3d281cb94d99 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7989bda-c097-4ff8-b95d-3d281cb94d99 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1347/2664] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 12:59:53 2024] GET /identity/v3/roles => generated 1680 bytes in 17 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7989bda-c097-4ff8-b95d-3d281cb94d99 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7989bda-c097-4ff8-b95d-3d281cb94d99 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b925753d-b284-4d53-8079-712242d01dbb None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b925753d-b284-4d53-8079-712242d01dbb None admin] REQUEST_METHOD: `PUT` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b925753d-b284-4d53-8079-712242d01dbb None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b925753d-b284-4d53-8079-712242d01dbb None admin] PATH_INFO: `/v3/projects/aef340a63eac420b916f1faf294d92d9/users/6b35183570c8402f817ad2fd23ea9f20/roles/e7989893488f483baa107be56668c4f8` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-1b9e1cdf-4f45-48cc-b2d1-7b1f2e06eb39 None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0d21671f9dd4388a6cf3294a49afb54', 'request_id': 'req-1b9e1cdf-4f45-48cc-b2d1-7b1f2e06eb39'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-1b9e1cdf-4f45-48cc-b2d1-7b1f2e06eb39 None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0d21671f9dd4388a6cf3294a49afb54', 'request_id': 'req-1b9e1cdf-4f45-48cc-b2d1-7b1f2e06eb39'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-1b9e1cdf-4f45-48cc-b2d1-7b1f2e06eb39 None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0d21671f9dd4388a6cf3294a49afb54', 'request_id': 'req-1b9e1cdf-4f45-48cc-b2d1-7b1f2e06eb39'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b925753d-b284-4d53-8079-712242d01dbb None admin] RBAC: Authorizing `identity:create_grant(project_id=aef340a63eac420b916f1faf294d92d9, user_id=6b35183570c8402f817ad2fd23ea9f20, role_id=e7989893488f483baa107be56668c4f8)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b925753d-b284-4d53-8079-712242d01dbb None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-1b9e1cdf-4f45-48cc-b2d1-7b1f2e06eb39 None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0d21671f9dd4388a6cf3294a49afb54', 'request_id': 'req-1b9e1cdf-4f45-48cc-b2d1-7b1f2e06eb39'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-1b9e1cdf-4f45-48cc-b2d1-7b1f2e06eb39 None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0d21671f9dd4388a6cf3294a49afb54', 'request_id': 'req-1b9e1cdf-4f45-48cc-b2d1-7b1f2e06eb39'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1348/2665] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 12:59:53 2024] PUT /identity/v3/projects/aef340a63eac420b916f1faf294d92d9/users/6b35183570c8402f817ad2fd23ea9f20/roles/e7989893488f483baa107be56668c4f8 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b925753d-b284-4d53-8079-712242d01dbb None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-b925753d-b284-4d53-8079-712242d01dbb None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1318/2666] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 12:59:53 2024] DELETE /identity/v3/users/e0d21671f9dd4388a6cf3294a49afb54 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15195012-8948-4037-bf3c-fdaa729b4e15 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15195012-8948-4037-bf3c-fdaa729b4e15 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:53 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15195012-8948-4037-bf3c-fdaa729b4e15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-15195012-8948-4037-bf3c-fdaa729b4e15 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-15195012-8948-4037-bf3c-fdaa729b4e15 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-15195012-8948-4037-bf3c-fdaa729b4e15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b925753d-b284-4d53-8079-712242d01dbb None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1319/2667] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:59:53 2024] POST /identity/v3/auth/tokens => generated 2960 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 12:59:54 l75lg1-v1 neutron-server[77619]: DEBUG neutron.wsgi [-] (77619) accepted ('10.27.203.238', 41300) {{(pid=77619) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbbc0ae-7dc2-4c59-94cf-bda23fa17e87 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbbc0ae-7dc2-4c59-94cf-bda23fa17e87 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbbc0ae-7dc2-4c59-94cf-bda23fa17e87 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbbc0ae-7dc2-4c59-94cf-bda23fa17e87 None admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbbc0ae-7dc2-4c59-94cf-bda23fa17e87 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbbc0ae-7dc2-4c59-94cf-bda23fa17e87 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15195012-8948-4037-bf3c-fdaa729b4e15 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-15195012-8948-4037-bf3c-fdaa729b4e15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1349/2668] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 12:59:53 2024] GET /identity/v3/roles => generated 1680 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbbc0ae-7dc2-4c59-94cf-bda23fa17e87 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbbc0ae-7dc2-4c59-94cf-bda23fa17e87 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447c5e51-26ba-47c3-9ecf-d4531fd6caa6 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447c5e51-26ba-47c3-9ecf-d4531fd6caa6 None admin] REQUEST_METHOD: `PUT` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447c5e51-26ba-47c3-9ecf-d4531fd6caa6 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447c5e51-26ba-47c3-9ecf-d4531fd6caa6 None admin] PATH_INFO: `/v3/projects/aef340a63eac420b916f1faf294d92d9/users/6b35183570c8402f817ad2fd23ea9f20/roles/e7989893488f483baa107be56668c4f8` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447c5e51-26ba-47c3-9ecf-d4531fd6caa6 None admin] RBAC: Authorizing `identity:create_grant(project_id=aef340a63eac420b916f1faf294d92d9, user_id=6b35183570c8402f817ad2fd23ea9f20, role_id=e7989893488f483baa107be56668c4f8)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447c5e51-26ba-47c3-9ecf-d4531fd6caa6 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1350/2669] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 12:59:54 2024] PUT /identity/v3/projects/aef340a63eac420b916f1faf294d92d9/users/6b35183570c8402f817ad2fd23ea9f20/roles/e7989893488f483baa107be56668c4f8 => generated 0 bytes in 20 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e4ba70-8ca0-4be0-a528-2c13e72561a0 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e4ba70-8ca0-4be0-a528-2c13e72561a0 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e4ba70-8ca0-4be0-a528-2c13e72561a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:54 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.manager [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Didn't find any instances for network info cache update. {{(pid=83654) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10012}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15195012-8948-4037-bf3c-fdaa729b4e15 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-c5e4ba70-8ca0-4be0-a528-2c13e72561a0 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-c5e4ba70-8ca0-4be0-a528-2c13e72561a0 None None] MFA Rules not processed for user `6b35183570c8402f817ad2fd23ea9f20`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-c5e4ba70-8ca0-4be0-a528-2c13e72561a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae46f2d-8838-495f-a9cd-885eeff704f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef17047035e4b518fd5360a01f2da1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae46f2d-8838-495f-a9cd-885eeff704f9 service neutron] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae46f2d-8838-495f-a9cd-885eeff704f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae46f2d-8838-495f-a9cd-885eeff704f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1351/2670] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:59:54 2024] POST /identity/v3/auth/tokens => generated 4065 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae46f2d-8838-495f-a9cd-885eeff704f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e4ba70-8ca0-4be0-a528-2c13e72561a0 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae46f2d-8838-495f-a9cd-885eeff704f9 service neutron] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1320/2671] 10.27.203.238 () {64 vars in 1432 bytes} [Tue May 28 12:59:54 2024] GET /identity/v3/auth/tokens => generated 2960 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e4ba70-8ca0-4be0-a528-2c13e72561a0 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743f5896-fe8d-48c5-94d9-d629a91dd588 tempest-ShareNetworksTest-972401819 tempest-ShareNetworksTest-972401819-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b35183570c8402f817ad2fd23ea9f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef340a63eac420b916f1faf294d92d9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743f5896-fe8d-48c5-94d9-d629a91dd588 tempest-ShareNetworksTest-972401819 tempest-ShareNetworksTest-972401819-project-admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743f5896-fe8d-48c5-94d9-d629a91dd588 tempest-ShareNetworksTest-972401819 tempest-ShareNetworksTest-972401819-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743f5896-fe8d-48c5-94d9-d629a91dd588 tempest-ShareNetworksTest-972401819 tempest-ShareNetworksTest-972401819-project-admin] PATH_INFO: `/v3/domains` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743f5896-fe8d-48c5-94d9-d629a91dd588 tempest-ShareNetworksTest-972401819 tempest-ShareNetworksTest-972401819-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=51267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743f5896-fe8d-48c5-94d9-d629a91dd588 tempest-ShareNetworksTest-972401819 tempest-ShareNetworksTest-972401819-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743f5896-fe8d-48c5-94d9-d629a91dd588 tempest-ShareNetworksTest-972401819 tempest-ShareNetworksTest-972401819-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:54 l75lg1-v1 neutron-server[77619]: INFO neutron.wsgi [None req-d242f177-5c8b-4f92-8852-7ff07a1140de None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=b56adc05fb6b4d5aa0d5d21be50ec8ca&name=default HTTP/1.1" status: 200 len: 216 time: 0.1295176 May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae46f2d-8838-495f-a9cd-885eeff704f9 service neutron] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-2ae46f2d-8838-495f-a9cd-885eeff704f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1352/2672] 10.27.203.238 () {62 vars in 1241 bytes} [Tue May 28 12:59:54 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743f5896-fe8d-48c5-94d9-d629a91dd588 tempest-ShareNetworksTest-972401819 tempest-ShareNetworksTest-972401819-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae46f2d-8838-495f-a9cd-885eeff704f9 service neutron] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743f5896-fe8d-48c5-94d9-d629a91dd588 tempest-ShareNetworksTest-972401819 tempest-ShareNetworksTest-972401819-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034546f4-3f76-4cd0-b40c-184b8039a7f8 tempest-ShareNetworksTest-972401819 tempest-ShareNetworksTest-972401819-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b35183570c8402f817ad2fd23ea9f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef340a63eac420b916f1faf294d92d9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a1070f-52d4-4070-b913-b8b613c3fd5a None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034546f4-3f76-4cd0-b40c-184b8039a7f8 tempest-ShareNetworksTest-972401819 tempest-ShareNetworksTest-972401819-project-admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034546f4-3f76-4cd0-b40c-184b8039a7f8 tempest-ShareNetworksTest-972401819 tempest-ShareNetworksTest-972401819-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034546f4-3f76-4cd0-b40c-184b8039a7f8 tempest-ShareNetworksTest-972401819 tempest-ShareNetworksTest-972401819-project-admin] PATH_INFO: `/v3/users` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a1070f-52d4-4070-b913-b8b613c3fd5a None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a1070f-52d4-4070-b913-b8b613c3fd5a None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034546f4-3f76-4cd0-b40c-184b8039a7f8 tempest-ShareNetworksTest-972401819 tempest-ShareNetworksTest-972401819-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a1070f-52d4-4070-b913-b8b613c3fd5a None admin] PATH_INFO: `/v3/projects/b56adc05fb6b4d5aa0d5d21be50ec8ca` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034546f4-3f76-4cd0-b40c-184b8039a7f8 tempest-ShareNetworksTest-972401819 tempest-ShareNetworksTest-972401819-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a1070f-52d4-4070-b913-b8b613c3fd5a None admin] RBAC: Authorizing `identity:delete_project(project_id=b56adc05fb6b4d5aa0d5d21be50ec8ca)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a1070f-52d4-4070-b913-b8b613c3fd5a None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-034546f4-3f76-4cd0-b40c-184b8039a7f8 tempest-ShareNetworksTest-972401819 tempest-ShareNetworksTest-972401819-project-admin] Truncating password to algorithm specific maximum length 72 characters. May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1353/2673] 10.27.203.238 () {64 vars in 1232 bytes} [Tue May 28 12:59:54 2024] POST /identity/v3/users => generated 433 bytes in 30 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034546f4-3f76-4cd0-b40c-184b8039a7f8 tempest-ShareNetworksTest-972401819 tempest-ShareNetworksTest-972401819-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034546f4-3f76-4cd0-b40c-184b8039a7f8 tempest-ShareNetworksTest-972401819 tempest-ShareNetworksTest-972401819-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5f6099-d54c-4838-aadc-c33c94c36d25 tempest-ShareNetworksTest-972401819 tempest-ShareNetworksTest-972401819-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b35183570c8402f817ad2fd23ea9f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef340a63eac420b916f1faf294d92d9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5f6099-d54c-4838-aadc-c33c94c36d25 tempest-ShareNetworksTest-972401819 tempest-ShareNetworksTest-972401819-project-admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5f6099-d54c-4838-aadc-c33c94c36d25 tempest-ShareNetworksTest-972401819 tempest-ShareNetworksTest-972401819-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5f6099-d54c-4838-aadc-c33c94c36d25 tempest-ShareNetworksTest-972401819 tempest-ShareNetworksTest-972401819-project-admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5f6099-d54c-4838-aadc-c33c94c36d25 tempest-ShareNetworksTest-972401819 tempest-ShareNetworksTest-972401819-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5f6099-d54c-4838-aadc-c33c94c36d25 tempest-ShareNetworksTest-972401819 tempest-ShareNetworksTest-972401819-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-f8a1070f-52d4-4070-b913-b8b613c3fd5a None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b56adc05fb6b4d5aa0d5d21be50ec8ca', 'request_id': 'req-f8a1070f-52d4-4070-b913-b8b613c3fd5a'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1354/2674] 10.27.203.238 () {62 vars in 1210 bytes} [Tue May 28 12:59:54 2024] GET /identity/v3/roles => generated 1680 bytes in 18 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-f8a1070f-52d4-4070-b913-b8b613c3fd5a None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b56adc05fb6b4d5aa0d5d21be50ec8ca', 'request_id': 'req-f8a1070f-52d4-4070-b913-b8b613c3fd5a'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5f6099-d54c-4838-aadc-c33c94c36d25 tempest-ShareNetworksTest-972401819 tempest-ShareNetworksTest-972401819-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5f6099-d54c-4838-aadc-c33c94c36d25 tempest-ShareNetworksTest-972401819 tempest-ShareNetworksTest-972401819-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:54 l75lg1-v1 dstat.sh[49771]: 28-05 12:59:54| 19 2 76 3 0|5744M 1716M 277M 7886M| 15k 5546B| 0 2984k| 0 383 | 12k 21k|1.23 1.08 1.02|3.0 1.0 0| 0 0 | 0 2048M| 29 363 0 47 2 May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-f8a1070f-52d4-4070-b913-b8b613c3fd5a None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b56adc05fb6b4d5aa0d5d21be50ec8ca', 'request_id': 'req-f8a1070f-52d4-4070-b913-b8b613c3fd5a'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-f8a1070f-52d4-4070-b913-b8b613c3fd5a None admin] The token cache is being invalidate because project b56adc05fb6b4d5aa0d5d21be50ec8ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-f8a1070f-52d4-4070-b913-b8b613c3fd5a None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-f8a1070f-52d4-4070-b913-b8b613c3fd5a None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1321/2675] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 12:59:54 2024] DELETE /identity/v3/projects/b56adc05fb6b4d5aa0d5d21be50ec8ca => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4c69dc-eb3c-4093-b13b-4f0bcb02d644 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4c69dc-eb3c-4093-b13b-4f0bcb02d644 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4c69dc-eb3c-4093-b13b-4f0bcb02d644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a144c79-894e-4756-ab9b-066388e0b194 tempest-ShareNetworksTest-972401819 tempest-ShareNetworksTest-972401819-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b35183570c8402f817ad2fd23ea9f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef340a63eac420b916f1faf294d92d9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a144c79-894e-4756-ab9b-066388e0b194 tempest-ShareNetworksTest-972401819 tempest-ShareNetworksTest-972401819-project-admin] REQUEST_METHOD: `PUT` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a144c79-894e-4756-ab9b-066388e0b194 tempest-ShareNetworksTest-972401819 tempest-ShareNetworksTest-972401819-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-9c4c69dc-eb3c-4093-b13b-4f0bcb02d644 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a144c79-894e-4756-ab9b-066388e0b194 tempest-ShareNetworksTest-972401819 tempest-ShareNetworksTest-972401819-project-admin] PATH_INFO: `/v3/projects/aef340a63eac420b916f1faf294d92d9/users/a78a8004069a4253a6b38f609ac636bd/roles/44620cad10ae407c90c91e2c296adb04` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-9c4c69dc-eb3c-4093-b13b-4f0bcb02d644 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-9c4c69dc-eb3c-4093-b13b-4f0bcb02d644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1322/2676] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:59:54 2024] POST /identity/v3/auth/tokens => generated 312 bytes in 22 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a144c79-894e-4756-ab9b-066388e0b194 tempest-ShareNetworksTest-972401819 tempest-ShareNetworksTest-972401819-project-admin] RBAC: Authorizing `identity:create_grant(project_id=aef340a63eac420b916f1faf294d92d9, user_id=a78a8004069a4253a6b38f609ac636bd, role_id=44620cad10ae407c90c91e2c296adb04)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a144c79-894e-4756-ab9b-066388e0b194 tempest-ShareNetworksTest-972401819 tempest-ShareNetworksTest-972401819-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:54 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e7245d6a-0625-4258-a172-a4e5aad67460 tempest-ShareRulesTest-1530341375 None] <<< [POST] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d7c111-83be-448e-9278-7b6ff4054ea3 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d7c111-83be-448e-9278-7b6ff4054ea3 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d7c111-83be-448e-9278-7b6ff4054ea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:54 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e7245d6a-0625-4258-a172-a4e5aad67460 tempest-ShareRulesTest-1530341375 None] Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=0, created='2024-05-28T12:59:53.824250Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='0fa84ccd-850f-48fa-a965-23e5abe31188', id=38, internal=False, is_s3_default_policy=False, name='f7e47502-a0f7-44de-953d-b7b5697ae0b2', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=[], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['*'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['*'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T12:59:54.246720Z', tenant_id=1, tenant_name='default', title='f7e47502-a0f7-44de-953d-b7b5697ae0b2', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/38/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[]) May 28 12:59:54 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e7245d6a-0625-4258-a172-a4e5aad67460 tempest-ShareRulesTest-1530341375 None] --- [POST] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 12:59:54 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e7245d6a-0625-4258-a172-a4e5aad67460 tempest-ShareRulesTest-1530341375 None] >>> [GET] https://127.0.0.1:40443/api/quotas/ May 28 12:59:54 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e7245d6a-0625-4258-a172-a4e5aad67460 tempest-ShareRulesTest-1530341375 None] {'allow_redirects': True, May 28 12:59:54 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e7245d6a-0625-4258-a172-a4e5aad67460 tempest-ShareRulesTest-1530341375 None] 'params': {'name': 'f7e47502-a0f7-44de-953d-b7b5697ae0b2'}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1355/2677] 10.27.203.238 () {64 vars in 1571 bytes} [Tue May 28 12:59:54 2024] PUT /identity/v3/projects/aef340a63eac420b916f1faf294d92d9/users/a78a8004069a4253a6b38f609ac636bd/roles/44620cad10ae407c90c91e2c296adb04 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-37d7c111-83be-448e-9278-7b6ff4054ea3 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-37d7c111-83be-448e-9278-7b6ff4054ea3 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a144c79-894e-4756-ab9b-066388e0b194 tempest-ShareNetworksTest-972401819 tempest-ShareNetworksTest-972401819-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-37d7c111-83be-448e-9278-7b6ff4054ea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-3a144c79-894e-4756-ab9b-066388e0b194 tempest-ShareNetworksTest-972401819 tempest-ShareNetworksTest-972401819-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1323/2678] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:59:54 2024] POST /identity/v3/auth/tokens => generated 2960 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d7c111-83be-448e-9278-7b6ff4054ea3 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d7c111-83be-448e-9278-7b6ff4054ea3 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5470b5-c335-442d-b43e-c7b4a5284faa None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5470b5-c335-442d-b43e-c7b4a5284faa None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5470b5-c335-442d-b43e-c7b4a5284faa None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5470b5-c335-442d-b43e-c7b4a5284faa None admin] PATH_INFO: `/v3/domains` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5470b5-c335-442d-b43e-c7b4a5284faa None admin] RBAC: Adding query filter params (name=Default) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5470b5-c335-442d-b43e-c7b4a5284faa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5470b5-c335-442d-b43e-c7b4a5284faa None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a144c79-894e-4756-ab9b-066388e0b194 tempest-ShareNetworksTest-972401819 tempest-ShareNetworksTest-972401819-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e01bd9d-7248-47d1-8ed7-9b59eabe2373 service manila] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f110cf6300f049c897d0aab63218d1e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e01bd9d-7248-47d1-8ed7-9b59eabe2373 service manila] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e01bd9d-7248-47d1-8ed7-9b59eabe2373 service manila] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e01bd9d-7248-47d1-8ed7-9b59eabe2373 service manila] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-4e01bd9d-7248-47d1-8ed7-9b59eabe2373 service manila] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1324/2679] 10.27.203.238 () {62 vars in 1220 bytes} [Tue May 28 12:59:54 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5470b5-c335-442d-b43e-c7b4a5284faa None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5470b5-c335-442d-b43e-c7b4a5284faa None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f80e1a-0fdd-4c34-9b02-38b0d9030f29 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f80e1a-0fdd-4c34-9b02-38b0d9030f29 None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f80e1a-0fdd-4c34-9b02-38b0d9030f29 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f80e1a-0fdd-4c34-9b02-38b0d9030f29 None admin] PATH_INFO: `/v3/projects` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f80e1a-0fdd-4c34-9b02-38b0d9030f29 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f80e1a-0fdd-4c34-9b02-38b0d9030f29 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1325/2680] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 12:59:54 2024] POST /identity/v3/projects => generated 387 bytes in 34 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f80e1a-0fdd-4c34-9b02-38b0d9030f29 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e01bd9d-7248-47d1-8ed7-9b59eabe2373 service manila] RBAC: Authorizing `identity:validate_token()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e01bd9d-7248-47d1-8ed7-9b59eabe2373 service manila] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1356/2681] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 12:59:54 2024] GET /identity/v3/auth/tokens => generated 4065 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 12:59:54 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-28f1498e-70d9-423d-8c8b-a962ff2dfc10 tempest-ShareNetworksTest-972401819 tempest-ShareNetworksTest-972401819-project-admin] POST http://10.27.203.238/share/v2/aef340a63eac420b916f1faf294d92d9/types May 28 12:59:54 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-28f1498e-70d9-423d-8c8b-a962ff2dfc10 tempest-ShareNetworksTest-972401819 tempest-ShareNetworksTest-972401819-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share_type": {"name": "tempest-typeshare-type-396586582", "extra_specs": {"driver_handles_share_servers": "False"}, "share_type_access:is_public": true}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f80e1a-0fdd-4c34-9b02-38b0d9030f29 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fee805a-860d-4afe-88f5-27600f2087d1 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fee805a-860d-4afe-88f5-27600f2087d1 None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fee805a-860d-4afe-88f5-27600f2087d1 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fee805a-860d-4afe-88f5-27600f2087d1 None admin] PATH_INFO: `/v3/users` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fee805a-860d-4afe-88f5-27600f2087d1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fee805a-860d-4afe-88f5-27600f2087d1 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-5fee805a-860d-4afe-88f5-27600f2087d1 None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 12:59:54 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-28f1498e-70d9-423d-8c8b-a962ff2dfc10 tempest-ShareNetworksTest-972401819 tempest-ShareNetworksTest-972401819-project-admin] http://10.27.203.238/share/v2/aef340a63eac420b916f1faf294d92d9/types returned with HTTP 200 May 28 12:59:54 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 815/1608] 10.27.203.238 () {66 vars in 1359 bytes} [Tue May 28 12:59:54 2024] POST /share/v2/aef340a63eac420b916f1faf294d92d9/types => generated 621 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e01bd9d-7248-47d1-8ed7-9b59eabe2373 service manila] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-4e01bd9d-7248-47d1-8ed7-9b59eabe2373 service manila] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e01bd9d-7248-47d1-8ed7-9b59eabe2373 service manila] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1326/2682] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 12:59:54 2024] POST /identity/v3/users => generated 302 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fee805a-860d-4afe-88f5-27600f2087d1 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fee805a-860d-4afe-88f5-27600f2087d1 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a501192-35ad-4c84-aed5-e91dd0da269f None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a501192-35ad-4c84-aed5-e91dd0da269f None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a501192-35ad-4c84-aed5-e91dd0da269f None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a501192-35ad-4c84-aed5-e91dd0da269f None admin] PATH_INFO: `/v3/roles` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a501192-35ad-4c84-aed5-e91dd0da269f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a501192-35ad-4c84-aed5-e91dd0da269f None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1327/2683] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 12:59:54 2024] GET /identity/v3/roles => generated 1680 bytes in 15 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a501192-35ad-4c84-aed5-e91dd0da269f None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a501192-35ad-4c84-aed5-e91dd0da269f None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a278a3bc-f2cd-4fa7-a946-eda420d0ced1 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a278a3bc-f2cd-4fa7-a946-eda420d0ced1 None admin] REQUEST_METHOD: `PUT` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a278a3bc-f2cd-4fa7-a946-eda420d0ced1 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a278a3bc-f2cd-4fa7-a946-eda420d0ced1 None admin] PATH_INFO: `/v3/projects/cac556dc39a14bbdbdbabfc80672fb1f/users/692b6e726f024058993a2054338212cc/roles/44620cad10ae407c90c91e2c296adb04` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81715015-9f02-47c2-977a-d3fe25081c7a service manila] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f110cf6300f049c897d0aab63218d1e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81715015-9f02-47c2-977a-d3fe25081c7a service manila] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81715015-9f02-47c2-977a-d3fe25081c7a service manila] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81715015-9f02-47c2-977a-d3fe25081c7a service manila] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-81715015-9f02-47c2-977a-d3fe25081c7a service manila] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a278a3bc-f2cd-4fa7-a946-eda420d0ced1 None admin] RBAC: Authorizing `identity:create_grant(project_id=cac556dc39a14bbdbdbabfc80672fb1f, user_id=692b6e726f024058993a2054338212cc, role_id=44620cad10ae407c90c91e2c296adb04)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a278a3bc-f2cd-4fa7-a946-eda420d0ced1 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1328/2684] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 12:59:54 2024] PUT /identity/v3/projects/cac556dc39a14bbdbdbabfc80672fb1f/users/692b6e726f024058993a2054338212cc/roles/44620cad10ae407c90c91e2c296adb04 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf52434c-35f8-447f-83ae-ad3fe4b41cd4 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf52434c-35f8-447f-83ae-ad3fe4b41cd4 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf52434c-35f8-447f-83ae-ad3fe4b41cd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-cf52434c-35f8-447f-83ae-ad3fe4b41cd4 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81715015-9f02-47c2-977a-d3fe25081c7a service manila] RBAC: Authorizing `identity:validate_token()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81715015-9f02-47c2-977a-d3fe25081c7a service manila] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-cf52434c-35f8-447f-83ae-ad3fe4b41cd4 None None] MFA Rules not processed for user `692b6e726f024058993a2054338212cc`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1357/2685] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 12:59:54 2024] GET /identity/v3/auth/tokens => generated 3944 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-cf52434c-35f8-447f-83ae-ad3fe4b41cd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:59:54 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-03133b3d-5f6e-4a5b-a822-a251d3076fce tempest-ShareNetworksTest-2070207761 tempest-ShareNetworksTest-2070207761-project-member] POST http://10.27.203.238/share/v1/a9041f7c5fff43159545a43cdafa94d5/security-services May 28 12:59:54 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-03133b3d-5f6e-4a5b-a822-a251d3076fce tempest-ShareNetworksTest-2070207761 tempest-ShareNetworksTest-2070207761-project-member] Action: 'create', calling method: SecurityServiceController.create, body: {"security_service": {"type": "ldap", "name": "tempest-ss-name-546572277", "description": "tempest-ss-desc-226411730", "dns_ip": "203.0.113.210", "server": "203.0.113.39", "domain": "tempest-ss-domain-862866733", "user": "tempest-ss-user-1759633056", "password": "***"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:59:54 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-03133b3d-5f6e-4a5b-a822-a251d3076fce tempest-ShareNetworksTest-2070207761 tempest-ShareNetworksTest-2070207761-project-member] http://10.27.203.238/share/v1/a9041f7c5fff43159545a43cdafa94d5/security-services returned with HTTP 200 May 28 12:59:54 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 794/1609] 10.27.203.238 () {64 vars in 1352 bytes} [Tue May 28 12:59:54 2024] POST /share/v1/a9041f7c5fff43159545a43cdafa94d5/security-services => generated 473 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:59:54 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-dd06ff88-c688-40e6-ae63-fc6e914bc1c4 tempest-ShareNetworksTest-2070207761 tempest-ShareNetworksTest-2070207761-project-member] POST http://10.27.203.238/share/v1/a9041f7c5fff43159545a43cdafa94d5/share-networks May 28 12:59:54 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-dd06ff88-c688-40e6-ae63-fc6e914bc1c4 tempest-ShareNetworksTest-2070207761 tempest-ShareNetworksTest-2070207761-project-member] Action: 'create', calling method: ShareNetworkController.create, body: {"share_network": {"name": "sn_with_ldap_ss", "neutron_net_id": "1111", "neutron_subnet_id": "2222", "created_at": "2002-02-02", "updated_at": null, "network_type": "vlan", "segmentation_id": 1000, "cidr": "10.0.0.0/24", "ip_version": 4, "description": "fake description"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1329/2686] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:59:54 2024] POST /identity/v3/auth/tokens => generated 3958 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81715015-9f02-47c2-977a-d3fe25081c7a service manila] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81715015-9f02-47c2-977a-d3fe25081c7a service manila] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:54 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.quota [None req-dd06ff88-c688-40e6-ae63-fc6e914bc1c4 tempest-ShareNetworksTest-2070207761 tempest-ShareNetworksTest-2070207761-project-member] Created reservations ['aef58142-9761-4adc-9fef-b0406a32b13d'] {{(pid=98329) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3310ac-bc6f-4ca5-bfc7-368ec120344f None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3310ac-bc6f-4ca5-bfc7-368ec120344f None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3310ac-bc6f-4ca5-bfc7-368ec120344f None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3310ac-bc6f-4ca5-bfc7-368ec120344f None admin] PATH_INFO: `/v3/projects` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3310ac-bc6f-4ca5-bfc7-368ec120344f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3310ac-bc6f-4ca5-bfc7-368ec120344f None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1358/2687] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 12:59:54 2024] POST /identity/v3/projects => generated 389 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf52434c-35f8-447f-83ae-ad3fe4b41cd4 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:54 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.quota [None req-dd06ff88-c688-40e6-ae63-fc6e914bc1c4 tempest-ShareNetworksTest-2070207761 tempest-ShareNetworksTest-2070207761-project-member] Committed reservations ['aef58142-9761-4adc-9fef-b0406a32b13d'] {{(pid=98329) commit /opt/stack/manila/manila/quota.py:1063}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf52434c-35f8-447f-83ae-ad3fe4b41cd4 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:54 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-dd06ff88-c688-40e6-ae63-fc6e914bc1c4 tempest-ShareNetworksTest-2070207761 tempest-ShareNetworksTest-2070207761-project-member] http://10.27.203.238/share/v1/a9041f7c5fff43159545a43cdafa94d5/share-networks returned with HTTP 200 May 28 12:59:54 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 816/1610] 10.27.203.238 () {64 vars in 1343 bytes} [Tue May 28 12:59:54 2024] POST /share/v1/a9041f7c5fff43159545a43cdafa94d5/share-networks => generated 406 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:59:54 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-22d88189-5ac2-4a7c-905a-726c6f0834e1 tempest-ShareNetworksTest-2070207761 tempest-ShareNetworksTest-2070207761-project-member] POST http://10.27.203.238/share/v1/a9041f7c5fff43159545a43cdafa94d5/share-networks/ecf94647-1e2c-413b-8980-9c32c6fec7ca/action May 28 12:59:54 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-22d88189-5ac2-4a7c-905a-726c6f0834e1 tempest-ShareNetworksTest-2070207761 tempest-ShareNetworksTest-2070207761-project-member] Action body: b'{"add_security_service": {"security_service_id": "1af2637a-3277-46ef-891d-1759eb92c188"}}' {{(pid=98330) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:59:54 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-22d88189-5ac2-4a7c-905a-726c6f0834e1 tempest-ShareNetworksTest-2070207761 tempest-ShareNetworksTest-2070207761-project-member] Action: 'action', calling method: ShareNetworkController.add_security_service, body: {"add_security_service": {"security_service_id": "1af2637a-3277-46ef-891d-1759eb92c188"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124d7ac0-3dc7-4bb6-a313-4aef6f9f6046 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124d7ac0-3dc7-4bb6-a313-4aef6f9f6046 None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124d7ac0-3dc7-4bb6-a313-4aef6f9f6046 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124d7ac0-3dc7-4bb6-a313-4aef6f9f6046 None admin] PATH_INFO: `/v3/users` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124d7ac0-3dc7-4bb6-a313-4aef6f9f6046 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124d7ac0-3dc7-4bb6-a313-4aef6f9f6046 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-124d7ac0-3dc7-4bb6-a313-4aef6f9f6046 None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1330/2688] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 12:59:54 2024] POST /identity/v3/users => generated 303 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3310ac-bc6f-4ca5-bfc7-368ec120344f None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3310ac-bc6f-4ca5-bfc7-368ec120344f None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535d8764-aee4-4461-84af-eb5fb9ba1da1 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535d8764-aee4-4461-84af-eb5fb9ba1da1 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535d8764-aee4-4461-84af-eb5fb9ba1da1 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535d8764-aee4-4461-84af-eb5fb9ba1da1 None admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535d8764-aee4-4461-84af-eb5fb9ba1da1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535d8764-aee4-4461-84af-eb5fb9ba1da1 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1359/2689] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 12:59:54 2024] GET /identity/v3/roles => generated 1680 bytes in 18 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124d7ac0-3dc7-4bb6-a313-4aef6f9f6046 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124d7ac0-3dc7-4bb6-a313-4aef6f9f6046 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:54 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-22d88189-5ac2-4a7c-905a-726c6f0834e1 tempest-ShareNetworksTest-2070207761 tempest-ShareNetworksTest-2070207761-project-member] http://10.27.203.238/share/v1/a9041f7c5fff43159545a43cdafa94d5/share-networks/ecf94647-1e2c-413b-8980-9c32c6fec7ca/action returned with HTTP 200 May 28 12:59:54 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 795/1611] 10.27.203.238 () {64 vars in 1474 bytes} [Tue May 28 12:59:54 2024] POST /share/v1/a9041f7c5fff43159545a43cdafa94d5/share-networks/ecf94647-1e2c-413b-8980-9c32c6fec7ca/action => generated 406 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe967348-1f63-4e30-8435-3694db74ab24 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe967348-1f63-4e30-8435-3694db74ab24 None admin] REQUEST_METHOD: `PUT` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe967348-1f63-4e30-8435-3694db74ab24 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe967348-1f63-4e30-8435-3694db74ab24 None admin] PATH_INFO: `/v3/projects/c7a348e5c74641978595dc43c2dcb08a/users/f5d442b2e2004e5c81ae90b7692a94ad/roles/44620cad10ae407c90c91e2c296adb04` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:54 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-08293c76-f708-44c2-b454-fcbc744430ff tempest-ShareNetworksTest-2070207761 tempest-ShareNetworksTest-2070207761-project-member] POST http://10.27.203.238/share/v1/a9041f7c5fff43159545a43cdafa94d5/security-services May 28 12:59:54 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-08293c76-f708-44c2-b454-fcbc744430ff tempest-ShareNetworksTest-2070207761 tempest-ShareNetworksTest-2070207761-project-member] Action: 'create', calling method: SecurityServiceController.create, body: {"security_service": {"type": "kerberos", "name": "sn_with_ldap_ss", "neutron_net_id": "1111", "neutron_subnet_id": "2222", "created_at": "2002-02-02", "updated_at": null, "network_type": "vlan", "segmentation_id": 1000, "cidr": "10.0.0.0/24", "ip_version": 4, "description": "fake description"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe967348-1f63-4e30-8435-3694db74ab24 None admin] RBAC: Authorizing `identity:create_grant(project_id=c7a348e5c74641978595dc43c2dcb08a, user_id=f5d442b2e2004e5c81ae90b7692a94ad, role_id=44620cad10ae407c90c91e2c296adb04)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe967348-1f63-4e30-8435-3694db74ab24 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:54 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-08293c76-f708-44c2-b454-fcbc744430ff tempest-ShareNetworksTest-2070207761 tempest-ShareNetworksTest-2070207761-project-member] http://10.27.203.238/share/v1/a9041f7c5fff43159545a43cdafa94d5/security-services returned with HTTP 200 May 28 12:59:54 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 817/1612] 10.27.203.238 () {64 vars in 1352 bytes} [Tue May 28 12:59:54 2024] POST /share/v1/a9041f7c5fff43159545a43cdafa94d5/security-services => generated 345 bytes in 14 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:59:54 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-cd644700-d822-4985-9698-48861588b036 tempest-ShareNetworksTest-2070207761 tempest-ShareNetworksTest-2070207761-project-member] POST http://10.27.203.238/share/v1/a9041f7c5fff43159545a43cdafa94d5/share-networks May 28 12:59:54 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-cd644700-d822-4985-9698-48861588b036 tempest-ShareNetworksTest-2070207761 tempest-ShareNetworksTest-2070207761-project-member] Action: 'create', calling method: ShareNetworkController.create, body: {"share_network": {"name": "sn_with_kerberos_ss", "created_at": "2003-03-03", "updated_at": null, "neutron_net_id": "test net id", "neutron_subnet_id": "test subnet id", "network_type": "local", "segmentation_id": 2000, "cidr": "10.0.0.0/13", "ip_version": 6, "description": "fake description"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1331/2690] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 12:59:54 2024] PUT /identity/v3/projects/c7a348e5c74641978595dc43c2dcb08a/users/f5d442b2e2004e5c81ae90b7692a94ad/roles/44620cad10ae407c90c91e2c296adb04 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fe52fe-64e9-4564-ba67-8b6221547083 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fe52fe-64e9-4564-ba67-8b6221547083 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fe52fe-64e9-4564-ba67-8b6221547083 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-01fe52fe-64e9-4564-ba67-8b6221547083 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:59:54 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.quota [None req-cd644700-d822-4985-9698-48861588b036 tempest-ShareNetworksTest-2070207761 tempest-ShareNetworksTest-2070207761-project-member] Created reservations ['6b234f04-101d-4265-85bf-140f28ab1379'] {{(pid=98330) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-01fe52fe-64e9-4564-ba67-8b6221547083 None None] MFA Rules not processed for user `f5d442b2e2004e5c81ae90b7692a94ad`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-01fe52fe-64e9-4564-ba67-8b6221547083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1360/2691] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:59:54 2024] POST /identity/v3/auth/tokens => generated 3960 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe967348-1f63-4e30-8435-3694db74ab24 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:54 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.quota [None req-cd644700-d822-4985-9698-48861588b036 tempest-ShareNetworksTest-2070207761 tempest-ShareNetworksTest-2070207761-project-member] Committed reservations ['6b234f04-101d-4265-85bf-140f28ab1379'] {{(pid=98330) commit /opt/stack/manila/manila/quota.py:1063}} May 28 12:59:54 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-cd644700-d822-4985-9698-48861588b036 tempest-ShareNetworksTest-2070207761 tempest-ShareNetworksTest-2070207761-project-member] http://10.27.203.238/share/v1/a9041f7c5fff43159545a43cdafa94d5/share-networks returned with HTTP 200 May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe967348-1f63-4e30-8435-3694db74ab24 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:54 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 796/1613] 10.27.203.238 () {64 vars in 1343 bytes} [Tue May 28 12:59:54 2024] POST /share/v1/a9041f7c5fff43159545a43cdafa94d5/share-networks => generated 428 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17efa34-2cbc-42b4-a936-93ddae19d545 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17efa34-2cbc-42b4-a936-93ddae19d545 None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17efa34-2cbc-42b4-a936-93ddae19d545 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17efa34-2cbc-42b4-a936-93ddae19d545 None admin] PATH_INFO: `/v3/projects` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17efa34-2cbc-42b4-a936-93ddae19d545 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17efa34-2cbc-42b4-a936-93ddae19d545 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:54 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-b965c0c5-edc5-4f61-b8dd-eba90d06c58b tempest-ShareNetworksTest-2070207761 tempest-ShareNetworksTest-2070207761-project-member] POST http://10.27.203.238/share/v1/a9041f7c5fff43159545a43cdafa94d5/share-networks/dde9e748-fa6a-4e84-afda-0136bb8aade5/action May 28 12:59:54 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-b965c0c5-edc5-4f61-b8dd-eba90d06c58b tempest-ShareNetworksTest-2070207761 tempest-ShareNetworksTest-2070207761-project-member] Action body: b'{"add_security_service": {"security_service_id": "65dd6a86-1f95-4274-8d5e-cfa0789bae7c"}}' {{(pid=98329) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:59:54 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-b965c0c5-edc5-4f61-b8dd-eba90d06c58b tempest-ShareNetworksTest-2070207761 tempest-ShareNetworksTest-2070207761-project-member] Action: 'action', calling method: ShareNetworkController.add_security_service, body: {"add_security_service": {"security_service_id": "65dd6a86-1f95-4274-8d5e-cfa0789bae7c"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1332/2692] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 12:59:54 2024] POST /identity/v3/projects => generated 389 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fe52fe-64e9-4564-ba67-8b6221547083 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fe52fe-64e9-4564-ba67-8b6221547083 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:54 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e7245d6a-0625-4258-a172-a4e5aad67460 tempest-ShareRulesTest-1530341375 None] <<< [GET] https://127.0.0.1:40443/api/quotas/ May 28 12:59:54 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e7245d6a-0625-4258-a172-a4e5aad67460 tempest-ShareRulesTest-1530341375 None] [] May 28 12:59:54 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e7245d6a-0625-4258-a172-a4e5aad67460 tempest-ShareRulesTest-1530341375 None] --- [GET] https://127.0.0.1:40443/api/quotas/: Done May 28 12:59:54 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e7245d6a-0625-4258-a172-a4e5aad67460 tempest-ShareRulesTest-1530341375 None] >>> [POST] https://127.0.0.1:40443/api/quotas/ May 28 12:59:54 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e7245d6a-0625-4258-a172-a4e5aad67460 tempest-ShareRulesTest-1530341375 None] {'data': '{"name": "f7e47502-a0f7-44de-953d-b7b5697ae0b2", "path": ' May 28 12:59:54 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e7245d6a-0625-4258-a172-a4e5aad67460 tempest-ShareRulesTest-1530341375 None] '"/manila/manila-f7e47502-a0f7-44de-953d-b7b5697ae0b2", "create_dir": ' May 28 12:59:54 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e7245d6a-0625-4258-a172-a4e5aad67460 tempest-ShareRulesTest-1530341375 None] 'true, "hard_limit": 1073741824}', May 28 12:59:54 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e7245d6a-0625-4258-a172-a4e5aad67460 tempest-ShareRulesTest-1530341375 None] 'json': None, May 28 12:59:54 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e7245d6a-0625-4258-a172-a4e5aad67460 tempest-ShareRulesTest-1530341375 None] 'params': None} May 28 12:59:54 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-b965c0c5-edc5-4f61-b8dd-eba90d06c58b tempest-ShareNetworksTest-2070207761 tempest-ShareNetworksTest-2070207761-project-member] http://10.27.203.238/share/v1/a9041f7c5fff43159545a43cdafa94d5/share-networks/dde9e748-fa6a-4e84-afda-0136bb8aade5/action returned with HTTP 200 May 28 12:59:54 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 818/1614] 10.27.203.238 () {64 vars in 1474 bytes} [Tue May 28 12:59:54 2024] POST /share/v1/a9041f7c5fff43159545a43cdafa94d5/share-networks/dde9e748-fa6a-4e84-afda-0136bb8aade5/action => generated 428 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc34ac75-1582-41bb-992f-6d13572715f7 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc34ac75-1582-41bb-992f-6d13572715f7 None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc34ac75-1582-41bb-992f-6d13572715f7 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc34ac75-1582-41bb-992f-6d13572715f7 None admin] PATH_INFO: `/v3/users` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc34ac75-1582-41bb-992f-6d13572715f7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc34ac75-1582-41bb-992f-6d13572715f7 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:54 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-66351fa8-e36f-4f0c-8d55-f00f1d8722c7 tempest-ShareNetworksTest-2070207761 tempest-ShareNetworksTest-2070207761-project-member] POST http://10.27.203.238/share/v1/a9041f7c5fff43159545a43cdafa94d5/share-networks May 28 12:59:54 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-66351fa8-e36f-4f0c-8d55-f00f1d8722c7 tempest-ShareNetworksTest-2070207761 tempest-ShareNetworksTest-2070207761-project-member] Action: 'create', calling method: ShareNetworkController.create, body: {"share_network": {"name": "tempest-sn-name-1414228971", "description": "tempest-sn-desc-1117018711", "neutron_net_id": "tempest-net-id-1985522787", "neutron_subnet_id": "tempest-subnet-id-298487137"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-fc34ac75-1582-41bb-992f-6d13572715f7 None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 12:59:54 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1361/2693] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 12:59:54 2024] POST /identity/v3/users => generated 302 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:59:54 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.quota [None req-66351fa8-e36f-4f0c-8d55-f00f1d8722c7 tempest-ShareNetworksTest-2070207761 tempest-ShareNetworksTest-2070207761-project-member] Created reservations ['f9f20e48-5913-4113-8648-40bfbdcabee9'] {{(pid=98330) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 12:59:55 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17efa34-2cbc-42b4-a936-93ddae19d545 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:55 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17efa34-2cbc-42b4-a936-93ddae19d545 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:55 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def21000-7b37-48d7-983d-fae5cb5fc389 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:55 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def21000-7b37-48d7-983d-fae5cb5fc389 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:55 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def21000-7b37-48d7-983d-fae5cb5fc389 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:55 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def21000-7b37-48d7-983d-fae5cb5fc389 None admin] PATH_INFO: `/v3/roles` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:55 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def21000-7b37-48d7-983d-fae5cb5fc389 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:55 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def21000-7b37-48d7-983d-fae5cb5fc389 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:55 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1333/2694] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 12:59:54 2024] GET /identity/v3/roles => generated 1680 bytes in 17 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:59:55 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc34ac75-1582-41bb-992f-6d13572715f7 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:55 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc34ac75-1582-41bb-992f-6d13572715f7 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:55 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62b873e-4020-47ca-b6b4-f0db15c077b2 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:55 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62b873e-4020-47ca-b6b4-f0db15c077b2 None admin] REQUEST_METHOD: `PUT` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:55 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62b873e-4020-47ca-b6b4-f0db15c077b2 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:55 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62b873e-4020-47ca-b6b4-f0db15c077b2 None admin] PATH_INFO: `/v3/projects/b26e2f4af8614f3ea1f0aba07abd852c/users/16f4189b208748b8aa156ef28ced43cc/roles/e7989893488f483baa107be56668c4f8` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:55 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62b873e-4020-47ca-b6b4-f0db15c077b2 None admin] RBAC: Authorizing `identity:create_grant(project_id=b26e2f4af8614f3ea1f0aba07abd852c, user_id=16f4189b208748b8aa156ef28ced43cc, role_id=e7989893488f483baa107be56668c4f8)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:55 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62b873e-4020-47ca-b6b4-f0db15c077b2 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:55 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.quota [None req-66351fa8-e36f-4f0c-8d55-f00f1d8722c7 tempest-ShareNetworksTest-2070207761 tempest-ShareNetworksTest-2070207761-project-member] Committed reservations ['f9f20e48-5913-4113-8648-40bfbdcabee9'] {{(pid=98330) commit /opt/stack/manila/manila/quota.py:1063}} May 28 12:59:55 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1362/2695] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 12:59:55 2024] PUT /identity/v3/projects/b26e2f4af8614f3ea1f0aba07abd852c/users/16f4189b208748b8aa156ef28ced43cc/roles/e7989893488f483baa107be56668c4f8 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:59:55 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def21000-7b37-48d7-983d-fae5cb5fc389 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:55 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def21000-7b37-48d7-983d-fae5cb5fc389 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:55 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-66351fa8-e36f-4f0c-8d55-f00f1d8722c7 tempest-ShareNetworksTest-2070207761 tempest-ShareNetworksTest-2070207761-project-member] http://10.27.203.238/share/v1/a9041f7c5fff43159545a43cdafa94d5/share-networks returned with HTTP 200 May 28 12:59:55 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 797/1615] 10.27.203.238 () {64 vars in 1343 bytes} [Tue May 28 12:59:54 2024] POST /share/v1/a9041f7c5fff43159545a43cdafa94d5/share-networks => generated 463 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:59:55 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-ab61a452-b107-4b85-bf46-e183d3eea419 tempest-ShareNetworksTest-2070207761 tempest-ShareNetworksTest-2070207761-project-member] DELETE http://10.27.203.238/share/v1/a9041f7c5fff43159545a43cdafa94d5/share-networks/e1903f19-263c-498c-aed8-ed107429d85b May 28 12:59:55 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-ab61a452-b107-4b85-bf46-e183d3eea419 tempest-ShareNetworksTest-2070207761 tempest-ShareNetworksTest-2070207761-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:55 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-ab61a452-b107-4b85-bf46-e183d3eea419 tempest-ShareNetworksTest-2070207761 tempest-ShareNetworksTest-2070207761-project-member] Calling method 'ShareNetworkController.delete' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:55 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbed6cd0-3be2-4d73-ad60-c874dc9c5b77 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:55 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbed6cd0-3be2-4d73-ad60-c874dc9c5b77 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:55 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbed6cd0-3be2-4d73-ad60-c874dc9c5b77 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:55 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbed6cd0-3be2-4d73-ad60-c874dc9c5b77 None admin] PATH_INFO: `/v3/roles` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:55 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbed6cd0-3be2-4d73-ad60-c874dc9c5b77 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:55 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbed6cd0-3be2-4d73-ad60-c874dc9c5b77 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:55 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1334/2696] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 12:59:55 2024] GET /identity/v3/roles => generated 1680 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:59:55 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62b873e-4020-47ca-b6b4-f0db15c077b2 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:55 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62b873e-4020-47ca-b6b4-f0db15c077b2 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:55 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77c0a5f-1d77-4854-ad74-102ea28c46bd None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:55 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77c0a5f-1d77-4854-ad74-102ea28c46bd None admin] REQUEST_METHOD: `PUT` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:55 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77c0a5f-1d77-4854-ad74-102ea28c46bd None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:55 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77c0a5f-1d77-4854-ad74-102ea28c46bd None admin] PATH_INFO: `/v3/projects/b26e2f4af8614f3ea1f0aba07abd852c/users/16f4189b208748b8aa156ef28ced43cc/roles/e7989893488f483baa107be56668c4f8` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:55 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77c0a5f-1d77-4854-ad74-102ea28c46bd None admin] RBAC: Authorizing `identity:create_grant(project_id=b26e2f4af8614f3ea1f0aba07abd852c, user_id=16f4189b208748b8aa156ef28ced43cc, role_id=e7989893488f483baa107be56668c4f8)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:55 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77c0a5f-1d77-4854-ad74-102ea28c46bd None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:55 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1363/2697] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 12:59:55 2024] PUT /identity/v3/projects/b26e2f4af8614f3ea1f0aba07abd852c/users/16f4189b208748b8aa156ef28ced43cc/roles/e7989893488f483baa107be56668c4f8 => generated 0 bytes in 19 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:59:55 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ca7f6c-21b0-4605-8ea1-ccc57e081883 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:55 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ca7f6c-21b0-4605-8ea1-ccc57e081883 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:55 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ca7f6c-21b0-4605-8ea1-ccc57e081883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:55 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-07ca7f6c-21b0-4605-8ea1-ccc57e081883 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:59:55 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-07ca7f6c-21b0-4605-8ea1-ccc57e081883 None None] MFA Rules not processed for user `16f4189b208748b8aa156ef28ced43cc`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:59:55 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-07ca7f6c-21b0-4605-8ea1-ccc57e081883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:59:55 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1335/2698] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:59:55 2024] POST /identity/v3/auth/tokens => generated 4083 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 12:59:55 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77c0a5f-1d77-4854-ad74-102ea28c46bd None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:55 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.quota [None req-ab61a452-b107-4b85-bf46-e183d3eea419 tempest-ShareNetworksTest-2070207761 tempest-ShareNetworksTest-2070207761-project-member] Created reservations ['971ec61a-d6e4-4cac-8ca8-266a43f4a70b'] {{(pid=98329) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 12:59:55 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77c0a5f-1d77-4854-ad74-102ea28c46bd None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:55 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c640177f-2b07-4839-a5e8-5a5e2ca5367d tempest-ShareTransferNegativeTest-1910579163 tempest-ShareTransferNegativeTest-1910579163-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16f4189b208748b8aa156ef28ced43cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b26e2f4af8614f3ea1f0aba07abd852c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:55 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c640177f-2b07-4839-a5e8-5a5e2ca5367d tempest-ShareTransferNegativeTest-1910579163 tempest-ShareTransferNegativeTest-1910579163-project-admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:55 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c640177f-2b07-4839-a5e8-5a5e2ca5367d tempest-ShareTransferNegativeTest-1910579163 tempest-ShareTransferNegativeTest-1910579163-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:55 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c640177f-2b07-4839-a5e8-5a5e2ca5367d tempest-ShareTransferNegativeTest-1910579163 tempest-ShareTransferNegativeTest-1910579163-project-admin] PATH_INFO: `/v3/domains` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:55 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c640177f-2b07-4839-a5e8-5a5e2ca5367d tempest-ShareTransferNegativeTest-1910579163 tempest-ShareTransferNegativeTest-1910579163-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=51267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:59:55 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c640177f-2b07-4839-a5e8-5a5e2ca5367d tempest-ShareTransferNegativeTest-1910579163 tempest-ShareTransferNegativeTest-1910579163-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:55 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c640177f-2b07-4839-a5e8-5a5e2ca5367d tempest-ShareTransferNegativeTest-1910579163 tempest-ShareTransferNegativeTest-1910579163-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:55 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1364/2699] 10.27.203.238 () {62 vars in 1241 bytes} [Tue May 28 12:59:55 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:59:55 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.quota [None req-ab61a452-b107-4b85-bf46-e183d3eea419 tempest-ShareNetworksTest-2070207761 tempest-ShareNetworksTest-2070207761-project-member] Committed reservations ['971ec61a-d6e4-4cac-8ca8-266a43f4a70b'] {{(pid=98329) commit /opt/stack/manila/manila/quota.py:1063}} May 28 12:59:55 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-ab61a452-b107-4b85-bf46-e183d3eea419 tempest-ShareNetworksTest-2070207761 tempest-ShareNetworksTest-2070207761-project-member] http://10.27.203.238/share/v1/a9041f7c5fff43159545a43cdafa94d5/share-networks/e1903f19-263c-498c-aed8-ed107429d85b returned with HTTP 202 May 28 12:59:55 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 819/1616] 10.27.203.238 () {62 vars in 1435 bytes} [Tue May 28 12:59:55 2024] DELETE /share/v1/a9041f7c5fff43159545a43cdafa94d5/share-networks/e1903f19-263c-498c-aed8-ed107429d85b => generated 0 bytes in 156 msecs (HTTP/1.1 202) 6 headers in 242 bytes (1 switches on core 0) May 28 12:59:55 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ca7f6c-21b0-4605-8ea1-ccc57e081883 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:55 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ca7f6c-21b0-4605-8ea1-ccc57e081883 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:55 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-f29b9402-9273-451f-9e42-c55cc2eab8ab tempest-ShareNetworksTest-2070207761 tempest-ShareNetworksTest-2070207761-project-member] DELETE http://10.27.203.238/share/v1/a9041f7c5fff43159545a43cdafa94d5/security-services/65dd6a86-1f95-4274-8d5e-cfa0789bae7c May 28 12:59:55 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-f29b9402-9273-451f-9e42-c55cc2eab8ab tempest-ShareNetworksTest-2070207761 tempest-ShareNetworksTest-2070207761-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:55 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d584444-9201-4410-ac87-742b3a0db922 tempest-ShareTransferNegativeTest-1910579163 tempest-ShareTransferNegativeTest-1910579163-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16f4189b208748b8aa156ef28ced43cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b26e2f4af8614f3ea1f0aba07abd852c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:55 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d584444-9201-4410-ac87-742b3a0db922 tempest-ShareTransferNegativeTest-1910579163 tempest-ShareTransferNegativeTest-1910579163-project-admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:55 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-f29b9402-9273-451f-9e42-c55cc2eab8ab tempest-ShareNetworksTest-2070207761 tempest-ShareNetworksTest-2070207761-project-member] Calling method 'SecurityServiceController.delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:55 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.v1.security_service [None req-f29b9402-9273-451f-9e42-c55cc2eab8ab tempest-ShareNetworksTest-2070207761 tempest-ShareNetworksTest-2070207761-project-member] Delete security service with id: 65dd6a86-1f95-4274-8d5e-cfa0789bae7c May 28 12:59:55 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d584444-9201-4410-ac87-742b3a0db922 tempest-ShareTransferNegativeTest-1910579163 tempest-ShareTransferNegativeTest-1910579163-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:55 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d584444-9201-4410-ac87-742b3a0db922 tempest-ShareTransferNegativeTest-1910579163 tempest-ShareTransferNegativeTest-1910579163-project-admin] PATH_INFO: `/v3/users` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:55 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d584444-9201-4410-ac87-742b3a0db922 tempest-ShareTransferNegativeTest-1910579163 tempest-ShareTransferNegativeTest-1910579163-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:55 l75lg1-v1 dstat.sh[49771]: 28-05 12:59:55| 17 2 76 3 0|5745M 1714M 277M 7888M| 19k 2946B| 0 4652k| 0 504 | 11k 20k|1.23 1.08 1.02|3.0 2.0 0| 0 0 | 0 2048M| 29 363 0 47 2 May 28 12:59:55 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d584444-9201-4410-ac87-742b3a0db922 tempest-ShareTransferNegativeTest-1910579163 tempest-ShareTransferNegativeTest-1910579163-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:55 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-7d584444-9201-4410-ac87-742b3a0db922 tempest-ShareTransferNegativeTest-1910579163 tempest-ShareTransferNegativeTest-1910579163-project-admin] Truncating password to algorithm specific maximum length 72 characters. May 28 12:59:55 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-f29b9402-9273-451f-9e42-c55cc2eab8ab tempest-ShareNetworksTest-2070207761 tempest-ShareNetworksTest-2070207761-project-member] HTTP exception thrown: Cannot delete security service. It is assigned to share network(s) May 28 12:59:55 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-f29b9402-9273-451f-9e42-c55cc2eab8ab tempest-ShareNetworksTest-2070207761 tempest-ShareNetworksTest-2070207761-project-member] http://10.27.203.238/share/v1/a9041f7c5fff43159545a43cdafa94d5/security-services/65dd6a86-1f95-4274-8d5e-cfa0789bae7c returned with HTTP 403 May 28 12:59:55 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 798/1617] 10.27.203.238 () {62 vars in 1444 bytes} [Tue May 28 12:59:55 2024] DELETE /share/v1/a9041f7c5fff43159545a43cdafa94d5/security-services/65dd6a86-1f95-4274-8d5e-cfa0789bae7c => generated 109 bytes in 18 msecs (HTTP/1.1 403) 6 headers in 237 bytes (1 switches on core 0) May 28 12:59:55 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-2e476f97-ae2d-4aac-85ab-a8bb8976c7b9 tempest-ShareNetworksTest-2070207761 tempest-ShareNetworksTest-2070207761-project-member] DELETE http://10.27.203.238/share/v1/a9041f7c5fff43159545a43cdafa94d5/security-services/1af2637a-3277-46ef-891d-1759eb92c188 May 28 12:59:55 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-2e476f97-ae2d-4aac-85ab-a8bb8976c7b9 tempest-ShareNetworksTest-2070207761 tempest-ShareNetworksTest-2070207761-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:55 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-2e476f97-ae2d-4aac-85ab-a8bb8976c7b9 tempest-ShareNetworksTest-2070207761 tempest-ShareNetworksTest-2070207761-project-member] Calling method 'SecurityServiceController.delete' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:55 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.v1.security_service [None req-2e476f97-ae2d-4aac-85ab-a8bb8976c7b9 tempest-ShareNetworksTest-2070207761 tempest-ShareNetworksTest-2070207761-project-member] Delete security service with id: 1af2637a-3277-46ef-891d-1759eb92c188 May 28 12:59:55 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-2e476f97-ae2d-4aac-85ab-a8bb8976c7b9 tempest-ShareNetworksTest-2070207761 tempest-ShareNetworksTest-2070207761-project-member] HTTP exception thrown: Cannot delete security service. It is assigned to share network(s) May 28 12:59:55 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-2e476f97-ae2d-4aac-85ab-a8bb8976c7b9 tempest-ShareNetworksTest-2070207761 tempest-ShareNetworksTest-2070207761-project-member] http://10.27.203.238/share/v1/a9041f7c5fff43159545a43cdafa94d5/security-services/1af2637a-3277-46ef-891d-1759eb92c188 returned with HTTP 403 May 28 12:59:55 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1336/2700] 10.27.203.238 () {64 vars in 1232 bytes} [Tue May 28 12:59:55 2024] POST /identity/v3/users => generated 433 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:59:55 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 820/1618] 10.27.203.238 () {62 vars in 1444 bytes} [Tue May 28 12:59:55 2024] DELETE /share/v1/a9041f7c5fff43159545a43cdafa94d5/security-services/1af2637a-3277-46ef-891d-1759eb92c188 => generated 109 bytes in 21 msecs (HTTP/1.1 403) 6 headers in 237 bytes (1 switches on core 0) May 28 12:59:55 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c640177f-2b07-4839-a5e8-5a5e2ca5367d tempest-ShareTransferNegativeTest-1910579163 tempest-ShareTransferNegativeTest-1910579163-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:55 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-45588879-0fcd-4fb9-bed9-74e3960854fc tempest-ShareNetworksTest-2070207761 tempest-ShareNetworksTest-2070207761-project-member] POST http://10.27.203.238/share/v1/a9041f7c5fff43159545a43cdafa94d5/share-networks May 28 12:59:55 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-45588879-0fcd-4fb9-bed9-74e3960854fc tempest-ShareNetworksTest-2070207761 tempest-ShareNetworksTest-2070207761-project-member] Action: 'create', calling method: ShareNetworkController.create, body: {"share_network": {"name": "tempest-sn-name-324178545", "description": "tempest-sn-desc-596627921", "neutron_net_id": "tempest-net-id-398434222", "neutron_subnet_id": "tempest-subnet-id-246821685"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:59:55 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c640177f-2b07-4839-a5e8-5a5e2ca5367d tempest-ShareTransferNegativeTest-1910579163 tempest-ShareTransferNegativeTest-1910579163-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:55 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a93bfd1-2c86-4435-ad34-3e7afddd144e tempest-ShareTransferNegativeTest-1910579163 tempest-ShareTransferNegativeTest-1910579163-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16f4189b208748b8aa156ef28ced43cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b26e2f4af8614f3ea1f0aba07abd852c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:55 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a93bfd1-2c86-4435-ad34-3e7afddd144e tempest-ShareTransferNegativeTest-1910579163 tempest-ShareTransferNegativeTest-1910579163-project-admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:55 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a93bfd1-2c86-4435-ad34-3e7afddd144e tempest-ShareTransferNegativeTest-1910579163 tempest-ShareTransferNegativeTest-1910579163-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:55 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a93bfd1-2c86-4435-ad34-3e7afddd144e tempest-ShareTransferNegativeTest-1910579163 tempest-ShareTransferNegativeTest-1910579163-project-admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:55 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a93bfd1-2c86-4435-ad34-3e7afddd144e tempest-ShareTransferNegativeTest-1910579163 tempest-ShareTransferNegativeTest-1910579163-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:55 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a93bfd1-2c86-4435-ad34-3e7afddd144e tempest-ShareTransferNegativeTest-1910579163 tempest-ShareTransferNegativeTest-1910579163-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:55 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1365/2701] 10.27.203.238 () {62 vars in 1210 bytes} [Tue May 28 12:59:55 2024] GET /identity/v3/roles => generated 1680 bytes in 17 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:59:55 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d584444-9201-4410-ac87-742b3a0db922 tempest-ShareTransferNegativeTest-1910579163 tempest-ShareTransferNegativeTest-1910579163-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:55 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d584444-9201-4410-ac87-742b3a0db922 tempest-ShareTransferNegativeTest-1910579163 tempest-ShareTransferNegativeTest-1910579163-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:55 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ad9403-18fe-4dd9-9c96-48c019ebbb86 tempest-ShareTransferNegativeTest-1910579163 tempest-ShareTransferNegativeTest-1910579163-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16f4189b208748b8aa156ef28ced43cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b26e2f4af8614f3ea1f0aba07abd852c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:55 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ad9403-18fe-4dd9-9c96-48c019ebbb86 tempest-ShareTransferNegativeTest-1910579163 tempest-ShareTransferNegativeTest-1910579163-project-admin] REQUEST_METHOD: `PUT` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:55 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ad9403-18fe-4dd9-9c96-48c019ebbb86 tempest-ShareTransferNegativeTest-1910579163 tempest-ShareTransferNegativeTest-1910579163-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:55 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ad9403-18fe-4dd9-9c96-48c019ebbb86 tempest-ShareTransferNegativeTest-1910579163 tempest-ShareTransferNegativeTest-1910579163-project-admin] PATH_INFO: `/v3/projects/b26e2f4af8614f3ea1f0aba07abd852c/users/b31873af346a4deca6e4f761309cbf30/roles/44620cad10ae407c90c91e2c296adb04` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:55 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ad9403-18fe-4dd9-9c96-48c019ebbb86 tempest-ShareTransferNegativeTest-1910579163 tempest-ShareTransferNegativeTest-1910579163-project-admin] RBAC: Authorizing `identity:create_grant(project_id=b26e2f4af8614f3ea1f0aba07abd852c, user_id=b31873af346a4deca6e4f761309cbf30, role_id=44620cad10ae407c90c91e2c296adb04)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:55 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ad9403-18fe-4dd9-9c96-48c019ebbb86 tempest-ShareTransferNegativeTest-1910579163 tempest-ShareTransferNegativeTest-1910579163-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:55 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.quota [None req-45588879-0fcd-4fb9-bed9-74e3960854fc tempest-ShareNetworksTest-2070207761 tempest-ShareNetworksTest-2070207761-project-member] Created reservations ['a5ac7aba-47d7-42ec-a0ff-ce1d4fddb437'] {{(pid=98330) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 12:59:55 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1337/2702] 10.27.203.238 () {64 vars in 1571 bytes} [Tue May 28 12:59:55 2024] PUT /identity/v3/projects/b26e2f4af8614f3ea1f0aba07abd852c/users/b31873af346a4deca6e4f761309cbf30/roles/44620cad10ae407c90c91e2c296adb04 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:59:55 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a93bfd1-2c86-4435-ad34-3e7afddd144e tempest-ShareTransferNegativeTest-1910579163 tempest-ShareTransferNegativeTest-1910579163-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:55 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.quota [None req-45588879-0fcd-4fb9-bed9-74e3960854fc tempest-ShareNetworksTest-2070207761 tempest-ShareNetworksTest-2070207761-project-member] Committed reservations ['a5ac7aba-47d7-42ec-a0ff-ce1d4fddb437'] {{(pid=98330) commit /opt/stack/manila/manila/quota.py:1063}} May 28 12:59:55 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a93bfd1-2c86-4435-ad34-3e7afddd144e tempest-ShareTransferNegativeTest-1910579163 tempest-ShareTransferNegativeTest-1910579163-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:55 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-45588879-0fcd-4fb9-bed9-74e3960854fc tempest-ShareNetworksTest-2070207761 tempest-ShareNetworksTest-2070207761-project-member] http://10.27.203.238/share/v1/a9041f7c5fff43159545a43cdafa94d5/share-networks returned with HTTP 200 May 28 12:59:55 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 799/1619] 10.27.203.238 () {64 vars in 1343 bytes} [Tue May 28 12:59:55 2024] POST /share/v1/a9041f7c5fff43159545a43cdafa94d5/share-networks => generated 460 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:59:55 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-14e13274-d370-4930-a815-db64502159e9 tempest-ShareNetworksTest-2070207761 tempest-ShareNetworksTest-2070207761-project-member] POST http://10.27.203.238/share/v1/a9041f7c5fff43159545a43cdafa94d5/share-networks May 28 12:59:55 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-14e13274-d370-4930-a815-db64502159e9 tempest-ShareNetworksTest-2070207761 tempest-ShareNetworksTest-2070207761-project-member] Action: 'create', calling method: ShareNetworkController.create, body: {"share_network": {"name": "tempest-sn-name-324178545", "description": "tempest-sn-desc-596627921", "neutron_net_id": "tempest-net-id-398434222", "neutron_subnet_id": "tempest-subnet-id-246821685"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:59:55 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-fd00bed9-ed6c-4ed4-b0e3-928a7e03cc40 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] <<< [PATCH] https://127.0.0.1:40443/api/viewpolicies/32/ May 28 12:59:55 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-fd00bed9-ed6c-4ed4-b0e3-928a7e03cc40 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=1, created='2024-05-28T12:58:43.845440Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='31b6534b-d142-4561-992f-4f0759db302d', id=32, internal=False, is_s3_default_policy=False, name='7fdd602c-79d0-479c-95a2-336b202c6639', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=['*'], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['203.0.113.84'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['203.0.113.84'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='MODIFYING', sync_time='2024-05-28T12:59:54.598176Z', tenant_id=1, tenant_name='default', title='7fdd602c-79d0-479c-95a2-336b202c6639', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/32/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[]) May 28 12:59:55 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-fd00bed9-ed6c-4ed4-b0e3-928a7e03cc40 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] --- [PATCH] https://127.0.0.1:40443/api/viewpolicies/32/: Done May 28 12:59:55 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-fd00bed9-ed6c-4ed4-b0e3-928a7e03cc40 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:55 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-fd00bed9-ed6c-4ed4-b0e3-928a7e03cc40 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:55 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40337fb5-b653-4fd8-9bf4-28f0fe28b576 service manila] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f110cf6300f049c897d0aab63218d1e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:55 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40337fb5-b653-4fd8-9bf4-28f0fe28b576 service manila] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:55 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40337fb5-b653-4fd8-9bf4-28f0fe28b576 service manila] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:55 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40337fb5-b653-4fd8-9bf4-28f0fe28b576 service manila] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:55 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.quota [None req-14e13274-d370-4930-a815-db64502159e9 tempest-ShareNetworksTest-2070207761 tempest-ShareNetworksTest-2070207761-project-member] Created reservations ['c7781b5a-db6c-4613-b7b0-f729a92eb5f2'] {{(pid=98330) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 12:59:55 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40337fb5-b653-4fd8-9bf4-28f0fe28b576 service manila] RBAC: Authorizing `identity:validate_token()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:55 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40337fb5-b653-4fd8-9bf4-28f0fe28b576 service manila] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:55 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1366/2703] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 12:59:55 2024] GET /identity/v3/auth/tokens => generated 4083 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 12:59:55 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-fd00bed9-ed6c-4ed4-b0e3-928a7e03cc40 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.058s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:55 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-fd00bed9-ed6c-4ed4-b0e3-928a7e03cc40 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:55 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-fd00bed9-ed6c-4ed4-b0e3-928a7e03cc40 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:55 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-fd00bed9-ed6c-4ed4-b0e3-928a7e03cc40 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:55 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-fd00bed9-ed6c-4ed4-b0e3-928a7e03cc40 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:55 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-fd00bed9-ed6c-4ed4-b0e3-928a7e03cc40 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:55 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-7c28e6f2-9499-4122-a055-5c30037b46c5 tempest-ShareTransferNegativeTest-1910579163 tempest-ShareTransferNegativeTest-1910579163-project-admin] POST http://10.27.203.238/share/v2/b26e2f4af8614f3ea1f0aba07abd852c/types May 28 12:59:55 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-7c28e6f2-9499-4122-a055-5c30037b46c5 tempest-ShareTransferNegativeTest-1910579163 tempest-ShareTransferNegativeTest-1910579163-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share_type": {"name": "tempest-typeshare-type-2137769837", "extra_specs": {"driver_handles_share_servers": "False"}, "share_type_access:is_public": true}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:59:55 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-fd00bed9-ed6c-4ed4-b0e3-928a7e03cc40 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:55 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-fd00bed9-ed6c-4ed4-b0e3-928a7e03cc40 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:55 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-fd00bed9-ed6c-4ed4-b0e3-928a7e03cc40 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:55 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-fd00bed9-ed6c-4ed4-b0e3-928a7e03cc40 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.004s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:55 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-fd00bed9-ed6c-4ed4-b0e3-928a7e03cc40 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:55 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-fd00bed9-ed6c-4ed4-b0e3-928a7e03cc40 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:55 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.quota [None req-14e13274-d370-4930-a815-db64502159e9 tempest-ShareNetworksTest-2070207761 tempest-ShareNetworksTest-2070207761-project-member] Committed reservations ['c7781b5a-db6c-4613-b7b0-f729a92eb5f2'] {{(pid=98330) commit /opt/stack/manila/manila/quota.py:1063}} May 28 12:59:55 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-7c28e6f2-9499-4122-a055-5c30037b46c5 tempest-ShareTransferNegativeTest-1910579163 tempest-ShareTransferNegativeTest-1910579163-project-admin] http://10.27.203.238/share/v2/b26e2f4af8614f3ea1f0aba07abd852c/types returned with HTTP 200 May 28 12:59:55 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 821/1620] 10.27.203.238 () {66 vars in 1359 bytes} [Tue May 28 12:59:55 2024] POST /share/v2/b26e2f4af8614f3ea1f0aba07abd852c/types => generated 623 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:59:55 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-097c25da-5730-46e6-97d4-342403e051dc tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] GET http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/shares/b330db31-7766-443d-9c19-26fe349665aa May 28 12:59:55 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-097c25da-5730-46e6-97d4-342403e051dc tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:55 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-097c25da-5730-46e6-97d4-342403e051dc tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:55 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-14e13274-d370-4930-a815-db64502159e9 tempest-ShareNetworksTest-2070207761 tempest-ShareNetworksTest-2070207761-project-member] http://10.27.203.238/share/v1/a9041f7c5fff43159545a43cdafa94d5/share-networks returned with HTTP 200 May 28 12:59:55 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 800/1621] 10.27.203.238 () {64 vars in 1343 bytes} [Tue May 28 12:59:55 2024] POST /share/v1/a9041f7c5fff43159545a43cdafa94d5/share-networks => generated 460 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 230 bytes (2 switches on core 0) May 28 12:59:55 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ad9403-18fe-4dd9-9c96-48c019ebbb86 tempest-ShareTransferNegativeTest-1910579163 tempest-ShareTransferNegativeTest-1910579163-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:55 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-12ad9403-18fe-4dd9-9c96-48c019ebbb86 tempest-ShareTransferNegativeTest-1910579163 tempest-ShareTransferNegativeTest-1910579163-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:59:55 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ad9403-18fe-4dd9-9c96-48c019ebbb86 tempest-ShareTransferNegativeTest-1910579163 tempest-ShareTransferNegativeTest-1910579163-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:55 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-097c25da-5730-46e6-97d4-342403e051dc tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/shares/b330db31-7766-443d-9c19-26fe349665aa returned with HTTP 200 May 28 12:59:55 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 822/1622] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:59:55 2024] GET /share/v2/a4f3887fa28c457390f5b66615564430/shares/b330db31-7766-443d-9c19-26fe349665aa => generated 1313 bytes in 30 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:59:55 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a43e76-6253-440a-bb9d-c550dc63abcc service manila] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f110cf6300f049c897d0aab63218d1e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:55 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a43e76-6253-440a-bb9d-c550dc63abcc service manila] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:55 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a43e76-6253-440a-bb9d-c550dc63abcc service manila] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:55 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a43e76-6253-440a-bb9d-c550dc63abcc service manila] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:55 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-fd00bed9-ed6c-4ed4-b0e3-928a7e03cc40 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.055s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:55 l75lg1-v1 manila-share[98474]: INFO manila.share.access [None req-fd00bed9-ed6c-4ed4-b0e3-928a7e03cc40 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Access rules were successfully modified for share instance 7fdd602c-79d0-479c-95a2-336b202c6639 belonging to share 72db8769-ece7-42ff-af27-2e778292a9b4. May 28 12:59:55 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-838ef073-785f-4c73-872d-2c2cf4779b58 tempest-ShareNetworksTest-2070207761 tempest-ShareNetworksTest-2070207761-project-member] DELETE http://10.27.203.238/share/v1/a9041f7c5fff43159545a43cdafa94d5/share-networks/3b642636-c334-4da4-8ef2-e22e79b0c587 May 28 12:59:55 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-838ef073-785f-4c73-872d-2c2cf4779b58 tempest-ShareNetworksTest-2070207761 tempest-ShareNetworksTest-2070207761-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:55 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-838ef073-785f-4c73-872d-2c2cf4779b58 tempest-ShareNetworksTest-2070207761 tempest-ShareNetworksTest-2070207761-project-member] Calling method 'ShareNetworkController.delete' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:55 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:59:55 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager.update_available_resource {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:59:55 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Expecting reply to msg b72aaa5d85654c48a57555b2777afc55 in queue reply_37f4cbd1dd094961a22b8a65f222c327 May 28 12:59:55 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a43e76-6253-440a-bb9d-c550dc63abcc service manila] RBAC: Authorizing `identity:validate_token()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:55 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a43e76-6253-440a-bb9d-c550dc63abcc service manila] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:55 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1338/2704] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 12:59:55 2024] GET /identity/v3/auth/tokens => generated 3958 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 12:59:55 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [-] Received RPC response for msg b72aaa5d85654c48a57555b2777afc55 May 28 12:59:55 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-1adee421-ddbc-4654-8d24-e67ca3f3a79a tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] POST http://10.27.203.238/share/v2/cac556dc39a14bbdbdbabfc80672fb1f/shares May 28 12:59:55 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-1adee421-ddbc-4654-8d24-e67ca3f3a79a tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share": {"share_proto": "nfs", "description": "Tempest's share", "snapshot_id": null, "name": "tempest-tempest-share-name-1508700291", "size": 1, "metadata": {}, "is_public": false, "share_type": "7d4af55a-ed87-4690-a9e6-1a8ea4a42df2"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:59:55 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.v1.shares [None req-1adee421-ddbc-4654-8d24-e67ca3f3a79a tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] Create NFS share of 1 GB May 28 12:59:55 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.quota [None req-838ef073-785f-4c73-872d-2c2cf4779b58 tempest-ShareNetworksTest-2070207761 tempest-ShareNetworksTest-2070207761-project-member] Created reservations ['343e3534-14e1-4f9d-955c-fbe0be0cc10d'] {{(pid=98329) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 12:59:55 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.quota [None req-838ef073-785f-4c73-872d-2c2cf4779b58 tempest-ShareNetworksTest-2070207761 tempest-ShareNetworksTest-2070207761-project-member] Committed reservations ['343e3534-14e1-4f9d-955c-fbe0be0cc10d'] {{(pid=98329) commit /opt/stack/manila/manila/quota.py:1063}} May 28 12:59:55 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-838ef073-785f-4c73-872d-2c2cf4779b58 tempest-ShareNetworksTest-2070207761 tempest-ShareNetworksTest-2070207761-project-member] http://10.27.203.238/share/v1/a9041f7c5fff43159545a43cdafa94d5/share-networks/3b642636-c334-4da4-8ef2-e22e79b0c587 returned with HTTP 202 May 28 12:59:55 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 823/1623] 10.27.203.238 () {62 vars in 1435 bytes} [Tue May 28 12:59:55 2024] DELETE /share/v1/a9041f7c5fff43159545a43cdafa94d5/share-networks/3b642636-c334-4da4-8ef2-e22e79b0c587 => generated 0 bytes in 133 msecs (HTTP/1.1 202) 6 headers in 242 bytes (1 switches on core 0) May 28 12:59:55 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-628b9bab-f3f3-4f49-b1f7-717116d4a9a9 tempest-ShareNetworksTest-2070207761 tempest-ShareNetworksTest-2070207761-project-member] GET http://10.27.203.238/share/v1/a9041f7c5fff43159545a43cdafa94d5/share-networks/3b642636-c334-4da4-8ef2-e22e79b0c587 May 28 12:59:55 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-628b9bab-f3f3-4f49-b1f7-717116d4a9a9 tempest-ShareNetworksTest-2070207761 tempest-ShareNetworksTest-2070207761-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:55 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-628b9bab-f3f3-4f49-b1f7-717116d4a9a9 tempest-ShareNetworksTest-2070207761 tempest-ShareNetworksTest-2070207761-project-member] Calling method 'ShareNetworkController.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:55 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-628b9bab-f3f3-4f49-b1f7-717116d4a9a9 tempest-ShareNetworksTest-2070207761 tempest-ShareNetworksTest-2070207761-project-member] HTTP exception thrown: Share network 3b642636-c334-4da4-8ef2-e22e79b0c587 could not be found. May 28 12:59:55 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-628b9bab-f3f3-4f49-b1f7-717116d4a9a9 tempest-ShareNetworksTest-2070207761 tempest-ShareNetworksTest-2070207761-project-member] http://10.27.203.238/share/v1/a9041f7c5fff43159545a43cdafa94d5/share-networks/3b642636-c334-4da4-8ef2-e22e79b0c587 returned with HTTP 404 May 28 12:59:55 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 824/1624] 10.27.203.238 () {62 vars in 1432 bytes} [Tue May 28 12:59:55 2024] GET /share/v1/a9041f7c5fff43159545a43cdafa94d5/share-networks/3b642636-c334-4da4-8ef2-e22e79b0c587 => generated 116 bytes in 18 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 12:59:55 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.quota [None req-1adee421-ddbc-4654-8d24-e67ca3f3a79a tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] Created reservations ['cde56c24-47c9-4266-be27-defe3d0c7eba', 'cf047f86-5ce4-4d10-a317-47bc4ef2aa9e', '1e5409a5-6670-47b1-a248-866281ce7914', 'b1caa58e-273c-415b-9cda-99403a608d1a'] {{(pid=98330) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 12:59:55 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-7fde74e0-ca33-46b5-84a7-4bf9b4ac20e1 tempest-ShareNetworksTest-2070207761 tempest-ShareNetworksTest-2070207761-project-member] DELETE http://10.27.203.238/share/v1/a9041f7c5fff43159545a43cdafa94d5/share-networks/5d5defb8-cda4-4c33-81b4-dc9f2e56f888 May 28 12:59:55 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-7fde74e0-ca33-46b5-84a7-4bf9b4ac20e1 tempest-ShareNetworksTest-2070207761 tempest-ShareNetworksTest-2070207761-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:55 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-7fde74e0-ca33-46b5-84a7-4bf9b4ac20e1 tempest-ShareNetworksTest-2070207761 tempest-ShareNetworksTest-2070207761-project-member] Calling method 'ShareNetworkController.delete' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:55 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.quota [None req-1adee421-ddbc-4654-8d24-e67ca3f3a79a tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] Committed reservations ['cde56c24-47c9-4266-be27-defe3d0c7eba', 'cf047f86-5ce4-4d10-a317-47bc4ef2aa9e', '1e5409a5-6670-47b1-a248-866281ce7914', 'b1caa58e-273c-415b-9cda-99403a608d1a'] {{(pid=98330) commit /opt/stack/manila/manila/quota.py:1063}} May 28 12:59:55 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e7245d6a-0625-4258-a172-a4e5aad67460 tempest-ShareRulesTest-1530341375 None] <<< [POST] https://127.0.0.1:40443/api/quotas/ May 28 12:59:55 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e7245d6a-0625-4258-a172-a4e5aad67460 tempest-ShareRulesTest-1530341375 None] Bunch(cluster='loop75-kfs', cluster_id=1, default_email=None, default_group_quota=None, default_user_quota=None, enable_alarms=True, enable_email_providers=True, grace_period=None, group_quotas=[], guid='c6775eb2-8344-4d82-bcab-9184e22461fd', hard_limit=1073741824, hard_limit_inodes=None, id=35, internal=False, is_user_quota=False, last_user_quotas_update=None, name='f7e47502-a0f7-44de-953d-b7b5697ae0b2', num_blocked_users=0, num_exceeded_users=0, path='/manila/manila-f7e47502-a0f7-44de-953d-b7b5697ae0b2', percent_capacity=0, percent_inodes=None, pretty_grace_period=None, pretty_grace_period_expiration=None, pretty_state='OK (CREATED)', soft_limit=None, soft_limit_inodes=None, state='OK', sync_state='CREATED', system_id=35, tenant_id=1, tenant_name='default', time_to_block=None, title='f7e47502-a0f7-44de-953d-b7b5697ae0b2', url='https://127.0.0.1:40443/api/quotas/35/', used_capacity=0, used_capacity_tb=0.0, used_effective_capacity=0, used_effective_capacity_tb=0.0, used_inodes=0, used_limited_capacity=0, user_quotas=[]) May 28 12:59:55 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e7245d6a-0625-4258-a172-a4e5aad67460 tempest-ShareRulesTest-1530341375 None] --- [POST] https://127.0.0.1:40443/api/quotas/: Done May 28 12:59:55 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e7245d6a-0625-4258-a172-a4e5aad67460 tempest-ShareRulesTest-1530341375 None] >>> [GET] https://127.0.0.1:40443/api/views/ May 28 12:59:55 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e7245d6a-0625-4258-a172-a4e5aad67460 tempest-ShareRulesTest-1530341375 None] {'allow_redirects': True, May 28 12:59:55 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e7245d6a-0625-4258-a172-a4e5aad67460 tempest-ShareRulesTest-1530341375 None] 'params': {'name': 'f7e47502-a0f7-44de-953d-b7b5697ae0b2'}} May 28 12:59:55 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.quota [None req-7fde74e0-ca33-46b5-84a7-4bf9b4ac20e1 tempest-ShareNetworksTest-2070207761 tempest-ShareNetworksTest-2070207761-project-member] Created reservations ['86ba925c-ee66-45cd-8f5f-2cfbdcf3c4e7'] {{(pid=98329) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 12:59:55 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.quota [None req-7fde74e0-ca33-46b5-84a7-4bf9b4ac20e1 tempest-ShareNetworksTest-2070207761 tempest-ShareNetworksTest-2070207761-project-member] Committed reservations ['86ba925c-ee66-45cd-8f5f-2cfbdcf3c4e7'] {{(pid=98329) commit /opt/stack/manila/manila/quota.py:1063}} May 28 12:59:55 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-7fde74e0-ca33-46b5-84a7-4bf9b4ac20e1 tempest-ShareNetworksTest-2070207761 tempest-ShareNetworksTest-2070207761-project-member] http://10.27.203.238/share/v1/a9041f7c5fff43159545a43cdafa94d5/share-networks/5d5defb8-cda4-4c33-81b4-dc9f2e56f888 returned with HTTP 202 May 28 12:59:55 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 825/1625] 10.27.203.238 () {62 vars in 1435 bytes} [Tue May 28 12:59:55 2024] DELETE /share/v1/a9041f7c5fff43159545a43cdafa94d5/share-networks/5d5defb8-cda4-4c33-81b4-dc9f2e56f888 => generated 0 bytes in 127 msecs (HTTP/1.1 202) 6 headers in 242 bytes (1 switches on core 0) May 28 12:59:55 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.host_manager [None req-1adee421-ddbc-4654-8d24-e67ca3f3a79a tempest-ShareTransferNegativeTest-884271560 None] Share service is down. (host: l75lg1-v1@generic2). May 28 12:59:55 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.host_manager [None req-1adee421-ddbc-4654-8d24-e67ca3f3a79a tempest-ShareTransferNegativeTest-884271560 None] Share service is down. (host: l75lg1-v1@generic1). May 28 12:59:55 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-1adee421-ddbc-4654-8d24-e67ca3f3a79a tempest-ShareTransferNegativeTest-884271560 None] Starting with 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:80}} May 28 12:59:55 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-1adee421-ddbc-4654-8d24-e67ca3f3a79a tempest-ShareTransferNegativeTest-884271560 None] Filter OnlyHostFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:59:55 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-1adee421-ddbc-4654-8d24-e67ca3f3a79a tempest-ShareTransferNegativeTest-884271560 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:59:55 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.capacity [None req-1adee421-ddbc-4654-8d24-e67ca3f3a79a tempest-ShareTransferNegativeTest-884271560 None] Space information for share creation on host l75lg1-v1@vast#vast (requested / avail): 1/2081 {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/capacity.py:83}} May 28 12:59:55 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-1adee421-ddbc-4654-8d24-e67ca3f3a79a tempest-ShareTransferNegativeTest-884271560 None] Filter CapacityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:59:55 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-1adee421-ddbc-4654-8d24-e67ca3f3a79a tempest-ShareTransferNegativeTest-884271560 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:59:55 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-1adee421-ddbc-4654-8d24-e67ca3f3a79a tempest-ShareTransferNegativeTest-884271560 None] Driver Filter: Checking host 'l75lg1-v1@vast#vast' {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:37}} May 28 12:59:55 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-1adee421-ddbc-4654-8d24-e67ca3f3a79a tempest-ShareTransferNegativeTest-884271560 None] Filter function not set :: passing host. {{(pid=98327) _check_filter_function /opt/stack/manila/manila/scheduler/filters/driver.py:53}} May 28 12:59:55 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-1adee421-ddbc-4654-8d24-e67ca3f3a79a tempest-ShareTransferNegativeTest-884271560 None] Result: True {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:40}} May 28 12:59:55 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-1adee421-ddbc-4654-8d24-e67ca3f3a79a tempest-ShareTransferNegativeTest-884271560 None] Done checking host 'l75lg1-v1@vast#vast' {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:41}} May 28 12:59:55 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-1adee421-ddbc-4654-8d24-e67ca3f3a79a tempest-ShareTransferNegativeTest-884271560 None] Filter DriverFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:59:55 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-1adee421-ddbc-4654-8d24-e67ca3f3a79a tempest-ShareTransferNegativeTest-884271560 None] Filter ShareReplicationFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:59:55 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-1adee421-ddbc-4654-8d24-e67ca3f3a79a tempest-ShareTransferNegativeTest-884271560 None] Filter CreateFromSnapshotFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:59:55 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-3a8b894e-b1e9-4a5e-9dcc-45a219e8cb7c tempest-ShareNetworksTest-2070207761 tempest-ShareNetworksTest-2070207761-project-member] GET http://10.27.203.238/share/v1/a9041f7c5fff43159545a43cdafa94d5/share-networks/5d5defb8-cda4-4c33-81b4-dc9f2e56f888 May 28 12:59:55 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-3a8b894e-b1e9-4a5e-9dcc-45a219e8cb7c tempest-ShareNetworksTest-2070207761 tempest-ShareNetworksTest-2070207761-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:55 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-1adee421-ddbc-4654-8d24-e67ca3f3a79a tempest-ShareTransferNegativeTest-884271560 None] Filter AffinityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:59:55 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-3a8b894e-b1e9-4a5e-9dcc-45a219e8cb7c tempest-ShareNetworksTest-2070207761 tempest-ShareNetworksTest-2070207761-project-member] Calling method 'ShareNetworkController.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:55 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-1adee421-ddbc-4654-8d24-e67ca3f3a79a tempest-ShareTransferNegativeTest-884271560 None] Filter AntiAffinityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:59:55 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.drivers.filter [None req-1adee421-ddbc-4654-8d24-e67ca3f3a79a tempest-ShareTransferNegativeTest-884271560 None] Filtered share [host: 'l75lg1-v1@vast#vast', free_capacity_gb: 2081.6478263456374, pools: None] {{(pid=98327) _schedule_share /opt/stack/manila/manila/scheduler/drivers/filter.py:268}} May 28 12:59:55 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-1adee421-ddbc-4654-8d24-e67ca3f3a79a tempest-ShareTransferNegativeTest-884271560 None] Checking host 'l75lg1-v1@vast#vast' {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:46}} May 28 12:59:55 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.weighers.goodness [None req-1adee421-ddbc-4654-8d24-e67ca3f3a79a tempest-ShareTransferNegativeTest-884271560 None] Goodness function not set :: defaulting to minimal goodness rating of 0. May 28 12:59:55 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-1adee421-ddbc-4654-8d24-e67ca3f3a79a tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] http://10.27.203.238/share/v2/cac556dc39a14bbdbdbabfc80672fb1f/shares returned with HTTP 200 May 28 12:59:55 l75lg1-v1 manila-scheduler[98327]: INFO manila.scheduler.weighers.goodness [None req-1adee421-ddbc-4654-8d24-e67ca3f3a79a tempest-ShareTransferNegativeTest-884271560 None] Goodness function result for host l75lg1-v1@vast#vast: 0. May 28 12:59:55 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-1adee421-ddbc-4654-8d24-e67ca3f3a79a tempest-ShareTransferNegativeTest-884271560 None] Goodness: 0 {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:48}} May 28 12:59:55 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 801/1626] 10.27.203.238 () {66 vars in 1362 bytes} [Tue May 28 12:59:55 2024] POST /share/v2/cac556dc39a14bbdbdbabfc80672fb1f/shares => generated 1311 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:59:55 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-1adee421-ddbc-4654-8d24-e67ca3f3a79a tempest-ShareTransferNegativeTest-884271560 None] Done checking host 'l75lg1-v1@vast#vast' {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:49}} May 28 12:59:55 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.drivers.filter [None req-1adee421-ddbc-4654-8d24-e67ca3f3a79a tempest-ShareTransferNegativeTest-884271560 None] Choosing for share: WeighedHost [host: l75lg1-v1@vast#vast, weight: 0.0] {{(pid=98327) _schedule_share /opt/stack/manila/manila/scheduler/drivers/filter.py:274}} May 28 12:59:55 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-c8943f3e-6b54-4f71-b75d-09f31f6fb0cb tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] GET http://10.27.203.238/share/v2/cac556dc39a14bbdbdbabfc80672fb1f/shares/bd070603-3332-4a76-a743-411df92ace16 May 28 12:59:55 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-c8943f3e-6b54-4f71-b75d-09f31f6fb0cb tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:55 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-c8943f3e-6b54-4f71-b75d-09f31f6fb0cb tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:55 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-3a8b894e-b1e9-4a5e-9dcc-45a219e8cb7c tempest-ShareNetworksTest-2070207761 tempest-ShareNetworksTest-2070207761-project-member] HTTP exception thrown: Share network 5d5defb8-cda4-4c33-81b4-dc9f2e56f888 could not be found. May 28 12:59:55 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-3a8b894e-b1e9-4a5e-9dcc-45a219e8cb7c tempest-ShareNetworksTest-2070207761 tempest-ShareNetworksTest-2070207761-project-member] http://10.27.203.238/share/v1/a9041f7c5fff43159545a43cdafa94d5/share-networks/5d5defb8-cda4-4c33-81b4-dc9f2e56f888 returned with HTTP 404 May 28 12:59:55 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 826/1627] 10.27.203.238 () {62 vars in 1432 bytes} [Tue May 28 12:59:55 2024] GET /share/v1/a9041f7c5fff43159545a43cdafa94d5/share-networks/5d5defb8-cda4-4c33-81b4-dc9f2e56f888 => generated 116 bytes in 23 msecs (HTTP/1.1 404) 6 headers in 237 bytes (2 switches on core 0) May 28 12:59:55 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-ca1e3000-b92f-40d8-bc38-31d6377ac92c tempest-ShareNetworksTest-2070207761 tempest-ShareNetworksTest-2070207761-project-member] GET http://10.27.203.238/share/v1/a9041f7c5fff43159545a43cdafa94d5/share-networks/ecf94647-1e2c-413b-8980-9c32c6fec7ca May 28 12:59:55 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-ca1e3000-b92f-40d8-bc38-31d6377ac92c tempest-ShareNetworksTest-2070207761 tempest-ShareNetworksTest-2070207761-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:55 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-ca1e3000-b92f-40d8-bc38-31d6377ac92c tempest-ShareNetworksTest-2070207761 tempest-ShareNetworksTest-2070207761-project-member] Calling method 'ShareNetworkController.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:55 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-c8943f3e-6b54-4f71-b75d-09f31f6fb0cb tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] http://10.27.203.238/share/v2/cac556dc39a14bbdbdbabfc80672fb1f/shares/bd070603-3332-4a76-a743-411df92ace16 returned with HTTP 200 May 28 12:59:55 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 802/1628] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:59:55 2024] GET /share/v2/cac556dc39a14bbdbdbabfc80672fb1f/shares/bd070603-3332-4a76-a743-411df92ace16 => generated 1311 bytes in 26 msecs (HTTP/1.1 200) 6 headers in 232 bytes (2 switches on core 0) May 28 12:59:55 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-ca1e3000-b92f-40d8-bc38-31d6377ac92c tempest-ShareNetworksTest-2070207761 tempest-ShareNetworksTest-2070207761-project-member] http://10.27.203.238/share/v1/a9041f7c5fff43159545a43cdafa94d5/share-networks/ecf94647-1e2c-413b-8980-9c32c6fec7ca returned with HTTP 200 May 28 12:59:55 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 827/1629] 10.27.203.238 () {62 vars in 1432 bytes} [Tue May 28 12:59:55 2024] GET /share/v1/a9041f7c5fff43159545a43cdafa94d5/share-networks/ecf94647-1e2c-413b-8980-9c32c6fec7ca => generated 406 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:59:55 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-0d8b47c3-959e-4ef3-885d-ca104307ba9d tempest-ShareNetworksTest-2070207761 tempest-ShareNetworksTest-2070207761-project-member] GET http://10.27.203.238/share/v1/a9041f7c5fff43159545a43cdafa94d5/share-networks May 28 12:59:55 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-0d8b47c3-959e-4ef3-885d-ca104307ba9d tempest-ShareNetworksTest-2070207761 tempest-ShareNetworksTest-2070207761-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:55 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-0d8b47c3-959e-4ef3-885d-ca104307ba9d tempest-ShareNetworksTest-2070207761 tempest-ShareNetworksTest-2070207761-project-member] Calling method 'ShareNetworkController.index' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:55 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-0d8b47c3-959e-4ef3-885d-ca104307ba9d tempest-ShareNetworksTest-2070207761 tempest-ShareNetworksTest-2070207761-project-member] http://10.27.203.238/share/v1/a9041f7c5fff43159545a43cdafa94d5/share-networks returned with HTTP 200 May 28 12:59:55 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 803/1630] 10.27.203.238 () {62 vars in 1321 bytes} [Tue May 28 12:59:55 2024] GET /share/v1/a9041f7c5fff43159545a43cdafa94d5/share-networks => generated 174 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 230 bytes (2 switches on core 0) May 28 12:59:55 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-a9a48239-cd56-44f0-9899-c50cbb20dcc0 tempest-ShareNetworksTest-2070207761 tempest-ShareNetworksTest-2070207761-project-member] GET http://10.27.203.238/share/v1/a9041f7c5fff43159545a43cdafa94d5/share-networks/detail?created_before=2002-10-10&created_since=2001-01-01&neutron_net_id=1111&neutron_subnet_id=2222&network_type=vlan&segmentation_id=1000&cidr=10.0.0.0%2F24&ip_version=4&name=sn_with_ldap_ss May 28 12:59:55 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-a9a48239-cd56-44f0-9899-c50cbb20dcc0 tempest-ShareNetworksTest-2070207761 tempest-ShareNetworksTest-2070207761-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:55 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-a9a48239-cd56-44f0-9899-c50cbb20dcc0 tempest-ShareNetworksTest-2070207761 tempest-ShareNetworksTest-2070207761-project-member] Calling method 'ShareNetworkController.detail' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:55 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-a9a48239-cd56-44f0-9899-c50cbb20dcc0 tempest-ShareNetworksTest-2070207761 tempest-ShareNetworksTest-2070207761-project-member] http://10.27.203.238/share/v1/a9041f7c5fff43159545a43cdafa94d5/share-networks/detail?created_before=2002-10-10&created_since=2001-01-01&neutron_net_id=1111&neutron_subnet_id=2222&network_type=vlan&segmentation_id=1000&cidr=10.0.0.0%2F24&ip_version=4&name=sn_with_ldap_ss returned with HTTP 200 May 28 12:59:55 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 828/1631] 10.27.203.238 () {62 vars in 1713 bytes} [Tue May 28 12:59:55 2024] GET /share/v1/a9041f7c5fff43159545a43cdafa94d5/share-networks/detail?created_before=2002-10-10&created_since=2001-01-01&neutron_net_id=1111&neutron_subnet_id=2222&network_type=vlan&segmentation_id=1000&cidr=10.0.0.0%2F24&ip_version=4&name=sn_with_ldap_ss => generated 409 bytes in 27 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:59:55 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-311875b6-54ac-4f9a-8721-48a1ef5ed642 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] GET http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/share-access-rules?share_id=72db8769-ece7-42ff-af27-2e778292a9b4 May 28 12:59:55 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-311875b6-54ac-4f9a-8721-48a1ef5ed642 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:55 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-311875b6-54ac-4f9a-8721-48a1ef5ed642 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:55 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-b34d0fb1-ab2f-4b7a-b770-315a071c4912 tempest-ShareNetworksTest-2070207761 tempest-ShareNetworksTest-2070207761-project-member] GET http://10.27.203.238/share/v1/a9041f7c5fff43159545a43cdafa94d5/share-networks/detail?security_service_id=1af2637a-3277-46ef-891d-1759eb92c188 May 28 12:59:55 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-b34d0fb1-ab2f-4b7a-b770-315a071c4912 tempest-ShareNetworksTest-2070207761 tempest-ShareNetworksTest-2070207761-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:55 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-b34d0fb1-ab2f-4b7a-b770-315a071c4912 tempest-ShareNetworksTest-2070207761 tempest-ShareNetworksTest-2070207761-project-member] Calling method 'ShareNetworkController.detail' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:56 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.lock.api [None req-311875b6-54ac-4f9a-8721-48a1ef5ed642 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Searching for locks by: {'resource_id': 'f540cca6-17b6-4c40-bb6a-afd8f0d66073', 'resource_action': 'show', 'resource_type': 'access_rule'} {{(pid=98330) get_all /opt/stack/manila/manila/lock/api.py:112}} May 28 12:59:56 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-b34d0fb1-ab2f-4b7a-b770-315a071c4912 tempest-ShareNetworksTest-2070207761 tempest-ShareNetworksTest-2070207761-project-member] http://10.27.203.238/share/v1/a9041f7c5fff43159545a43cdafa94d5/share-networks/detail?security_service_id=1af2637a-3277-46ef-891d-1759eb92c188 returned with HTTP 200 May 28 12:59:56 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 829/1632] 10.27.203.238 () {62 vars in 1455 bytes} [Tue May 28 12:59:55 2024] GET /share/v1/a9041f7c5fff43159545a43cdafa94d5/share-networks/detail?security_service_id=1af2637a-3277-46ef-891d-1759eb92c188 => generated 409 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:59:56 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-311875b6-54ac-4f9a-8721-48a1ef5ed642 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/share-access-rules?share_id=72db8769-ece7-42ff-af27-2e778292a9b4 returned with HTTP 200 May 28 12:59:56 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 804/1633] 10.27.203.238 () {64 vars in 1467 bytes} [Tue May 28 12:59:55 2024] GET /share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/share-access-rules?share_id=72db8769-ece7-42ff-af27-2e778292a9b4 => generated 280 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:59:56 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-f2c20a8e-fbb8-41ba-bc72-bbf60fd88db5 tempest-ShareNetworksTest-2070207761 tempest-ShareNetworksTest-2070207761-project-member] GET http://10.27.203.238/share/v1/a9041f7c5fff43159545a43cdafa94d5/security-services?share_network_id=ecf94647-1e2c-413b-8980-9c32c6fec7ca May 28 12:59:56 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-f2c20a8e-fbb8-41ba-bc72-bbf60fd88db5 tempest-ShareNetworksTest-2070207761 tempest-ShareNetworksTest-2070207761-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:56 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-f2c20a8e-fbb8-41ba-bc72-bbf60fd88db5 tempest-ShareNetworksTest-2070207761 tempest-ShareNetworksTest-2070207761-project-member] Calling method 'SecurityServiceController.index' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:56 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-d366d82d-cad9-4057-b858-38b51a85bf2f tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] GET http://10.27.203.238/share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/messages May 28 12:59:56 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-d366d82d-cad9-4057-b858-38b51a85bf2f tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:56 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-d366d82d-cad9-4057-b858-38b51a85bf2f tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:56 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.message.api [None req-d366d82d-cad9-4057-b858-38b51a85bf2f tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Searching for messages by: MultiDict([]) {{(pid=98329) get_all /opt/stack/manila/manila/message/api.py:78}} May 28 12:59:56 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-d366d82d-cad9-4057-b858-38b51a85bf2f tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] http://10.27.203.238/share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/messages returned with HTTP 200 May 28 12:59:56 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 830/1634] 10.27.203.238 () {64 vars in 1346 bytes} [Tue May 28 12:59:56 2024] GET /share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/messages => generated 6422 bytes in 13 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:59:56 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1adee421-ddbc-4654-8d24-e67ca3f3a79a tempest-ShareTransferNegativeTest-884271560 None] >>> [GET] https://127.0.0.1:40443/api/vippools/ May 28 12:59:56 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-9692e586-3b19-4d84-900a-0cc0fee47ea1 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-manila_7890e9d8a78c49a0bb9af26ec5dd4646-1927039240] POST http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action May 28 12:59:56 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1adee421-ddbc-4654-8d24-e67ca3f3a79a tempest-ShareTransferNegativeTest-884271560 None] {'allow_redirects': True, 'params': {'name': 'vippool-1'}} May 28 12:59:56 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-9692e586-3b19-4d84-900a-0cc0fee47ea1 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-manila_7890e9d8a78c49a0bb9af26ec5dd4646-1927039240] Action body: b'{"deny_access": {"access_id": "f540cca6-17b6-4c40-bb6a-afd8f0d66073", "unrestrict": true}}' {{(pid=98329) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:59:56 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-9692e586-3b19-4d84-900a-0cc0fee47ea1 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-manila_7890e9d8a78c49a0bb9af26ec5dd4646-1927039240] Action: 'action', calling method: ShareController.deny_access, body: {"deny_access": {"access_id": "f540cca6-17b6-4c40-bb6a-afd8f0d66073", "unrestrict": true}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:59:56 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.lock.api [None req-9692e586-3b19-4d84-900a-0cc0fee47ea1 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-manila_7890e9d8a78c49a0bb9af26ec5dd4646-1927039240] Searching for locks by: {'resource_id': 'f540cca6-17b6-4c40-bb6a-afd8f0d66073', 'resource_action': 'delete'} {{(pid=98329) get_all /opt/stack/manila/manila/lock/api.py:112}} May 28 12:59:56 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.common [None req-f2c20a8e-fbb8-41ba-bc72-bbf60fd88db5 tempest-ShareNetworksTest-2070207761 tempest-ShareNetworksTest-2070207761-project-member] Removing options '' from query {{(pid=98330) remove_invalid_options /opt/stack/manila/manila/api/common.py:441}} May 28 12:59:56 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-f2c20a8e-fbb8-41ba-bc72-bbf60fd88db5 tempest-ShareNetworksTest-2070207761 tempest-ShareNetworksTest-2070207761-project-member] http://10.27.203.238/share/v1/a9041f7c5fff43159545a43cdafa94d5/security-services?share_network_id=ecf94647-1e2c-413b-8980-9c32c6fec7ca returned with HTTP 200 May 28 12:59:56 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 805/1635] 10.27.203.238 () {62 vars in 1437 bytes} [Tue May 28 12:59:56 2024] GET /share/v1/a9041f7c5fff43159545a43cdafa94d5/security-services?share_network_id=ecf94647-1e2c-413b-8980-9c32c6fec7ca => generated 141 bytes in 25 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:59:56 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.policy [None req-9692e586-3b19-4d84-900a-0cc0fee47ea1 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-manila_7890e9d8a78c49a0bb9af26ec5dd4646-1927039240] Policy check for resource_lock:delete failed with credentials {'is_admin': False, 'user_id': 'db0396a316ea4c5697d47df053fccbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7890e9d8a78c49a0bb9af26ec5dd4646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98329) authorize /opt/stack/manila/manila/policy.py:208}} May 28 12:59:56 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-9692e586-3b19-4d84-900a-0cc0fee47ea1 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-manila_7890e9d8a78c49a0bb9af26ec5dd4646-1927039240] HTTP exception thrown: Unable to drop access rule restrictions that are not placed by you. May 28 12:59:56 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-9692e586-3b19-4d84-900a-0cc0fee47ea1 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-manila_7890e9d8a78c49a0bb9af26ec5dd4646-1927039240] http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action returned with HTTP 403 May 28 12:59:56 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 831/1636] 10.27.203.238 () {66 vars in 1493 bytes} [Tue May 28 12:59:56 2024] POST /share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action => generated 110 bytes in 15 msecs (HTTP/1.1 403) 6 headers in 238 bytes (1 switches on core 0) May 28 12:59:56 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-25c3b60b-d092-4bfa-ba44-48d2798fc9e5 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] POST http://10.27.203.238/share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/types May 28 12:59:56 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-25c3b60b-d092-4bfa-ba44-48d2798fc9e5 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share_type": {"name": "tempest-share-type-1511644383", "extra_specs": {"driver_handles_share_servers": false, "vendor_name": "foobar"}, "share_type_access:is_public": true}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:59:56 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-e3eff7f4-a815-42ba-b0d4-962e9668bb6d tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] POST http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action May 28 12:59:56 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-e3eff7f4-a815-42ba-b0d4-962e9668bb6d tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Action body: b'{"deny_access": {"access_id": "f540cca6-17b6-4c40-bb6a-afd8f0d66073", "unrestrict": true}}' {{(pid=98329) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:59:56 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-e3eff7f4-a815-42ba-b0d4-962e9668bb6d tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Action: 'action', calling method: ShareController.deny_access, body: {"deny_access": {"access_id": "f540cca6-17b6-4c40-bb6a-afd8f0d66073", "unrestrict": true}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:59:56 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.lock.api [None req-e3eff7f4-a815-42ba-b0d4-962e9668bb6d tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Searching for locks by: {'resource_id': 'f540cca6-17b6-4c40-bb6a-afd8f0d66073', 'resource_action': 'delete'} {{(pid=98329) get_all /opt/stack/manila/manila/lock/api.py:112}} May 28 12:59:56 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-25c3b60b-d092-4bfa-ba44-48d2798fc9e5 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] http://10.27.203.238/share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/types returned with HTTP 200 May 28 12:59:56 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 806/1637] 10.27.203.238 () {66 vars in 1359 bytes} [Tue May 28 12:59:56 2024] POST /share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/types => generated 661 bytes in 28 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:59:56 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-ac9ad7f5-5ec6-464f-aa7f-02ea570fa6bc tempest-ShareNetworksTest-2070207761 tempest-ShareNetworksTest-2070207761-project-member] GET http://10.27.203.238/share/v2/a9041f7c5fff43159545a43cdafa94d5/share-networks/detail?name~=ldap_ss&description~=fa May 28 12:59:56 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-ac9ad7f5-5ec6-464f-aa7f-02ea570fa6bc tempest-ShareNetworksTest-2070207761 tempest-ShareNetworksTest-2070207761-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:56 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-ac9ad7f5-5ec6-464f-aa7f-02ea570fa6bc tempest-ShareNetworksTest-2070207761 tempest-ShareNetworksTest-2070207761-project-member] Calling method 'ShareNetworkController.detail' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:56 l75lg1-v1 nova-compute[83654]: DEBUG oslo_concurrency.lockutils [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=83654) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:56 l75lg1-v1 nova-compute[83654]: DEBUG oslo_concurrency.lockutils [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=83654) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:56 l75lg1-v1 nova-compute[83654]: DEBUG oslo_concurrency.lockutils [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=83654) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:56 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.resource_tracker [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Auditing locally available compute resources for l75lg1-v1 (node: l75lg1-v1) {{(pid=83654) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}} May 28 12:59:56 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-ac9ad7f5-5ec6-464f-aa7f-02ea570fa6bc tempest-ShareNetworksTest-2070207761 tempest-ShareNetworksTest-2070207761-project-member] http://10.27.203.238/share/v2/a9041f7c5fff43159545a43cdafa94d5/share-networks/detail?name~=ldap_ss&description~=fa returned with HTTP 200 May 28 12:59:56 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 807/1638] 10.27.203.238 () {64 vars in 1444 bytes} [Tue May 28 12:59:56 2024] GET /share/v2/a9041f7c5fff43159545a43cdafa94d5/share-networks/detail?name~=ldap_ss&description~=fa => generated 704 bytes in 31 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:59:56 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-9a21ac95-6b2e-4f44-b86a-47709677a173 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] POST http://10.27.203.238/share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/shares May 28 12:59:56 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-9a21ac95-6b2e-4f44-b86a-47709677a173 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share": {"share_proto": "nfs", "description": "tempest-tempest-created-share-desc-814047320", "snapshot_id": null, "name": "tempest-tempest-created-share-693916083", "size": 1, "metadata": {}, "is_public": false, "share_type": "18791357-4918-4776-94fd-a844ce7bbb2f"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:59:56 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.v1.shares [None req-9a21ac95-6b2e-4f44-b86a-47709677a173 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Create NFS share of 1 GB May 28 12:59:56 l75lg1-v1 devstack@m-api.service[98329]: DEBUG oslo_concurrency.lockutils [None req-e3eff7f4-a815-42ba-b0d4-962e9668bb6d tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98329) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:56 l75lg1-v1 devstack@m-api.service[98329]: DEBUG oslo_concurrency.lockutils [None req-e3eff7f4-a815-42ba-b0d4-962e9668bb6d tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98329) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:56 l75lg1-v1 devstack@m-api.service[98329]: DEBUG oslo_concurrency.lockutils [None req-e3eff7f4-a815-42ba-b0d4-962e9668bb6d tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.045s {{(pid=98329) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:56 l75lg1-v1 devstack@m-api.service[98329]: DEBUG oslo_concurrency.lockutils [None req-e3eff7f4-a815-42ba-b0d4-962e9668bb6d tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98329) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:56 l75lg1-v1 devstack@m-api.service[98329]: DEBUG oslo_concurrency.lockutils [None req-e3eff7f4-a815-42ba-b0d4-962e9668bb6d tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98329) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:56 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.resource_tracker [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Hypervisor/Node resource view: name=l75lg1-v1 free_ram=9878MB free_disk=15.576404571533203GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_01_1", "address": "0000:00:01.1", "product_id": "7010", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7010", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7000", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7000", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "0100", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_0100", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_09_0", "address": "0000:00:09.0", "product_id": "1001", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1001", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "293a", "vendor_id": "8086", "numa_node": null, "label": "label_8086_293a", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_2", "address": "0000:00:07.2", "product_id": "2936", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2936", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "1237", "vendor_id": "8086", "numa_node": null, "label": "label_8086_1237", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "2935", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2935", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "2934", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2934", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_05_0", "address": "0000:00:05.0", "product_id": "1000", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1000", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "1000", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1000", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_06_0", "address": "0000:00:06.0", "product_id": "2668", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2668", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "1000", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1000", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0a_0", "address": "0000:00:0a.0", "product_id": "1002", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1002", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_3", "address": "0000:00:01.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_08_0", "address": "0000:00:08.0", "product_id": "1003", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1003", "dev_type": "type-PCI"}] {{(pid=83654) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}} May 28 12:59:56 l75lg1-v1 nova-compute[83654]: DEBUG oslo_concurrency.lockutils [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=83654) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:56 l75lg1-v1 nova-compute[83654]: DEBUG oslo_concurrency.lockutils [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=83654) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:56 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.quota [None req-9a21ac95-6b2e-4f44-b86a-47709677a173 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Created reservations ['67ccaa40-07e4-4024-bfcb-82c574395e84', '62335d76-1e25-47bc-b701-6e40beae17d4', 'a4f2f3be-90af-4ceb-8491-9f631cea3bac', 'f3870ed7-87cb-4ebe-8076-a325d2b060fa'] {{(pid=98330) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 12:59:56 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Expecting reply to msg 490160fb409441b498163a055a676567 in queue reply_37f4cbd1dd094961a22b8a65f222c327 May 28 12:59:56 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [-] Received RPC response for msg 490160fb409441b498163a055a676567 May 28 12:59:56 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.quota [None req-9a21ac95-6b2e-4f44-b86a-47709677a173 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Committed reservations ['67ccaa40-07e4-4024-bfcb-82c574395e84', '62335d76-1e25-47bc-b701-6e40beae17d4', 'a4f2f3be-90af-4ceb-8491-9f631cea3bac', 'f3870ed7-87cb-4ebe-8076-a325d2b060fa'] {{(pid=98330) commit /opt/stack/manila/manila/quota.py:1063}} May 28 12:59:56 l75lg1-v1 dstat.sh[49771]: 28-05 12:59:56| 20 2 72 5 0|5746M 1713M 278M 7888M| 15k 15k| 0 4327k| 0 572 | 11k 20k|1.23 1.08 1.02|1.0 1.0 0| 0 0 | 0 2048M| 29 364 0 47 2 May 28 12:59:56 l75lg1-v1 devstack@m-api.service[98329]: DEBUG oslo_concurrency.lockutils [None req-e3eff7f4-a815-42ba-b0d4-962e9668bb6d tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.071s {{(pid=98329) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:56 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-e3eff7f4-a815-42ba-b0d4-962e9668bb6d tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action returned with HTTP 202 May 28 12:59:56 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 832/1639] 10.27.203.238 () {66 vars in 1493 bytes} [Tue May 28 12:59:56 2024] POST /share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action => generated 0 bytes in 204 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:59:56 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-9815ca4b-db94-4d3f-92af-5bdc72124e3c tempest-ShareNetworksTest-2070207761 tempest-ShareNetworksTest-2070207761-project-member] GET http://10.27.203.238/share/v2/a9041f7c5fff43159545a43cdafa94d5/share-networks/detail May 28 12:59:56 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-9815ca4b-db94-4d3f-92af-5bdc72124e3c tempest-ShareNetworksTest-2070207761 tempest-ShareNetworksTest-2070207761-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:56 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-9815ca4b-db94-4d3f-92af-5bdc72124e3c tempest-ShareNetworksTest-2070207761 tempest-ShareNetworksTest-2070207761-project-member] Calling method 'ShareNetworkController.detail' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:56 l75lg1-v1 manila-share[98474]: DEBUG manila.share.manager [None req-e3eff7f4-a815-42ba-b0d4-962e9668bb6d tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Received request to update access for share instance 7fdd602c-79d0-479c-95a2-336b202c6639. {{(pid=98474) update_access_for_instances /opt/stack/manila/manila/share/manager.py:4353}} May 28 12:59:56 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-9815ca4b-db94-4d3f-92af-5bdc72124e3c tempest-ShareNetworksTest-2070207761 tempest-ShareNetworksTest-2070207761-project-member] http://10.27.203.238/share/v2/a9041f7c5fff43159545a43cdafa94d5/share-networks/detail returned with HTTP 200 May 28 12:59:56 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 833/1640] 10.27.203.238 () {64 vars in 1385 bytes} [Tue May 28 12:59:56 2024] GET /share/v2/a9041f7c5fff43159545a43cdafa94d5/share-networks/detail => generated 1410 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:59:56 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-41694efd-4c90-4108-870e-7157f6252944 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] GET http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/share-access-rules?share_id=72db8769-ece7-42ff-af27-2e778292a9b4 May 28 12:59:56 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-41694efd-4c90-4108-870e-7157f6252944 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:56 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-41694efd-4c90-4108-870e-7157f6252944 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:56 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-e3eff7f4-a815-42ba-b0d4-962e9668bb6d tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:56 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.host_manager [None req-9a21ac95-6b2e-4f44-b86a-47709677a173 tempest-UserMessageTest-1084663522 None] Share service is down. (host: l75lg1-v1@generic2). May 28 12:59:56 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-e3eff7f4-a815-42ba-b0d4-962e9668bb6d tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:56 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.host_manager [None req-9a21ac95-6b2e-4f44-b86a-47709677a173 tempest-UserMessageTest-1084663522 None] Share service is down. (host: l75lg1-v1@generic1). May 28 12:59:56 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-9a21ac95-6b2e-4f44-b86a-47709677a173 tempest-UserMessageTest-1084663522 None] Starting with 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:80}} May 28 12:59:56 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-9a21ac95-6b2e-4f44-b86a-47709677a173 tempest-UserMessageTest-1084663522 None] Filter OnlyHostFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:59:56 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-9a21ac95-6b2e-4f44-b86a-47709677a173 tempest-UserMessageTest-1084663522 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:59:56 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.capacity [None req-9a21ac95-6b2e-4f44-b86a-47709677a173 tempest-UserMessageTest-1084663522 None] Space information for share creation on host l75lg1-v1@vast#vast (requested / avail): 1/2080 {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/capacity.py:83}} May 28 12:59:56 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-9a21ac95-6b2e-4f44-b86a-47709677a173 tempest-UserMessageTest-1084663522 None] Filter CapacityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:59:56 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.utils [None req-9a21ac95-6b2e-4f44-b86a-47709677a173 tempest-UserMessageTest-1084663522 None] Share type extra spec requirement "vendor_name=foobar" does not match reported capability "VAST STORAGE" {{(pid=98327) capabilities_satisfied /opt/stack/manila/manila/scheduler/utils.py:185}} May 28 12:59:56 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.capabilities [None req-9a21ac95-6b2e-4f44-b86a-47709677a173 tempest-UserMessageTest-1084663522 None] host: 'l75lg1-v1@vast#vast', free_capacity_gb: 2080.6478263456374, pools: None fails resource_type extra_specs requirements {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/capabilities.py:45}} May 28 12:59:56 l75lg1-v1 manila-scheduler[98327]: INFO manila.scheduler.filters.base [None req-9a21ac95-6b2e-4f44-b86a-47709677a173 tempest-UserMessageTest-1084663522 None] Filter CapabilitiesFilter returned 0 host(s) May 28 12:59:56 l75lg1-v1 manila-scheduler[98327]: ERROR manila.scheduler.manager [None req-9a21ac95-6b2e-4f44-b86a-47709677a173 tempest-UserMessageTest-1084663522 None] Failed to schedule create_share: No valid host was found. Failed to find a weighted host, the last executed filter was CapabilitiesFilter.: manila.exception.NoValidHost: No valid host was found. Failed to find a weighted host, the last executed filter was CapabilitiesFilter. May 28 12:59:56 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-e3eff7f4-a815-42ba-b0d4-962e9668bb6d tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.004s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:56 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-e3eff7f4-a815-42ba-b0d4-962e9668bb6d tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:56 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-e3eff7f4-a815-42ba-b0d4-962e9668bb6d tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:56 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1adee421-ddbc-4654-8d24-e67ca3f3a79a tempest-ShareTransferNegativeTest-884271560 None] <<< [GET] https://127.0.0.1:40443/api/vippools/ May 28 12:59:56 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1adee421-ddbc-4654-8d24-e67ca3f3a79a tempest-ShareTransferNegativeTest-884271560 None] [Bunch(active_cnode_ids=[], active_interfaces=4, cluster='loop75-kfs', cluster_id=1, cnode_ids=[], cnodes=[], domain_name='vippool-1', enable_l3=False, enable_weighted_balancing=False, enabled=True, end_ip='172.21.75.4', guid='f2abaede-b397-413a-8faa-3aeead6d3b28', gw_ip='', gw_ipv6='', id=2, ip_ranges=[['172.21.75.1', '172.21.75.4']], name='vippool-1', peer_asn=0, port_membership='ALL', ranges_summary='172.21.75.[1-4]', role='PROTOCOLS', start_ip='172.21.75.1', subnet_cidr=16, subnet_cidr_ipv6=None, sync='SYNCED', sync_time='2024-05-28T12:50:09.644123Z', tenant_id=1, tenant_name='default', title='172.21.75.1 - 172.21.75.4', url='https://127.0.0.1:40443/api/vippools/2/', vast_asn=0, vlan=0, vms_preferred=False)] May 28 12:59:56 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1adee421-ddbc-4654-8d24-e67ca3f3a79a tempest-ShareTransferNegativeTest-884271560 None] --- [GET] https://127.0.0.1:40443/api/vippools/: Done May 28 12:59:56 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1adee421-ddbc-4654-8d24-e67ca3f3a79a tempest-ShareTransferNegativeTest-884271560 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:59:56 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1adee421-ddbc-4654-8d24-e67ca3f3a79a tempest-ShareTransferNegativeTest-884271560 None] {'allow_redirects': True, May 28 12:59:56 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1adee421-ddbc-4654-8d24-e67ca3f3a79a tempest-ShareTransferNegativeTest-884271560 None] 'params': {'name': 'e89b90ae-d644-4b77-81a0-3d997b90fad0'}} May 28 12:59:56 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-9a21ac95-6b2e-4f44-b86a-47709677a173 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] http://10.27.203.238/share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/shares returned with HTTP 200 May 28 12:59:56 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 808/1641] 10.27.203.238 () {66 vars in 1362 bytes} [Tue May 28 12:59:56 2024] POST /share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/shares => generated 1371 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:59:56 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-bb09d2fa-8124-40aa-a5a0-afb72aa4c335 tempest-ShareNetworksTest-2070207761 tempest-ShareNetworksTest-2070207761-project-member] POST http://10.27.203.238/share/v1/a9041f7c5fff43159545a43cdafa94d5/share-networks May 28 12:59:56 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-bb09d2fa-8124-40aa-a5a0-afb72aa4c335 tempest-ShareNetworksTest-2070207761 tempest-ShareNetworksTest-2070207761-project-member] Action: 'create', calling method: ShareNetworkController.create, body: {"share_network": {"name": "tempest-sn-name-1696728045", "description": "tempest-sn-desc-895276040", "neutron_net_id": "tempest-net-id-344115113", "neutron_subnet_id": "tempest-subnet-id-1425118288"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:59:56 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.lock.api [None req-41694efd-4c90-4108-870e-7157f6252944 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Searching for locks by: {'resource_id': 'f540cca6-17b6-4c40-bb6a-afd8f0d66073', 'resource_action': 'show', 'resource_type': 'access_rule'} {{(pid=98329) get_all /opt/stack/manila/manila/lock/api.py:112}} May 28 12:59:56 l75lg1-v1 manila-scheduler[98327]: INFO manila.message.api [None req-9a21ac95-6b2e-4f44-b86a-47709677a173 tempest-UserMessageTest-1084663522 None] Creating message record for request_id = req-9a21ac95-6b2e-4f44-b86a-47709677a173 May 28 12:59:56 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-41694efd-4c90-4108-870e-7157f6252944 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/share-access-rules?share_id=72db8769-ece7-42ff-af27-2e778292a9b4 returned with HTTP 200 May 28 12:59:56 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 834/1642] 10.27.203.238 () {64 vars in 1467 bytes} [Tue May 28 12:59:56 2024] GET /share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/share-access-rules?share_id=72db8769-ece7-42ff-af27-2e778292a9b4 => generated 288 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:59:56 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-4c49af28-830b-4a06-801f-a1f248714369 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] GET http://10.27.203.238/share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/shares/8d55f5b5-0397-4cf5-ae7e-437e2de600d2 May 28 12:59:56 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-4c49af28-830b-4a06-801f-a1f248714369 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:56 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-4c49af28-830b-4a06-801f-a1f248714369 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:56 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e7245d6a-0625-4258-a172-a4e5aad67460 tempest-ShareRulesTest-1530341375 None] <<< [GET] https://127.0.0.1:40443/api/views/ May 28 12:59:56 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e7245d6a-0625-4258-a172-a4e5aad67460 tempest-ShareRulesTest-1530341375 None] [] May 28 12:59:56 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e7245d6a-0625-4258-a172-a4e5aad67460 tempest-ShareRulesTest-1530341375 None] --- [GET] https://127.0.0.1:40443/api/views/: Done May 28 12:59:56 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e7245d6a-0625-4258-a172-a4e5aad67460 tempest-ShareRulesTest-1530341375 None] >>> [POST] https://127.0.0.1:40443/api/views/ May 28 12:59:56 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e7245d6a-0625-4258-a172-a4e5aad67460 tempest-ShareRulesTest-1530341375 None] {'data': '{"name": "f7e47502-a0f7-44de-953d-b7b5697ae0b2", "path": ' May 28 12:59:56 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e7245d6a-0625-4258-a172-a4e5aad67460 tempest-ShareRulesTest-1530341375 None] '"/manila/manila-f7e47502-a0f7-44de-953d-b7b5697ae0b2", "policy_id": ' May 28 12:59:56 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e7245d6a-0625-4258-a172-a4e5aad67460 tempest-ShareRulesTest-1530341375 None] '38, "create_dir": true, "protocols": ["NFS"]}', May 28 12:59:56 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e7245d6a-0625-4258-a172-a4e5aad67460 tempest-ShareRulesTest-1530341375 None] 'json': None, May 28 12:59:56 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e7245d6a-0625-4258-a172-a4e5aad67460 tempest-ShareRulesTest-1530341375 None] 'params': None} May 28 12:59:56 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-4c49af28-830b-4a06-801f-a1f248714369 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] http://10.27.203.238/share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/shares/8d55f5b5-0397-4cf5-ae7e-437e2de600d2 returned with HTTP 200 May 28 12:59:56 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 835/1643] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:59:56 2024] GET /share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/shares/8d55f5b5-0397-4cf5-ae7e-437e2de600d2 => generated 1368 bytes in 26 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:59:56 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.quota [None req-bb09d2fa-8124-40aa-a5a0-afb72aa4c335 tempest-ShareNetworksTest-2070207761 tempest-ShareNetworksTest-2070207761-project-member] Created reservations ['a784f500-d585-4dd1-a064-d5cd51b008f6'] {{(pid=98330) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 12:59:56 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-e3eff7f4-a815-42ba-b0d4-962e9668bb6d tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.076s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:56 l75lg1-v1 manila-share[98474]: DEBUG manila.share.access [None req-e3eff7f4-a815-42ba-b0d4-962e9668bb6d tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Updating access rules for share instance 7fdd602c-79d0-479c-95a2-336b202c6639 belonging to share 72db8769-ece7-42ff-af27-2e778292a9b4. {{(pid=98474) update_access_rules /opt/stack/manila/manila/share/access.py:298}} May 28 12:59:56 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-e3eff7f4-a815-42ba-b0d4-962e9668bb6d tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:56 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-e3eff7f4-a815-42ba-b0d4-962e9668bb6d tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:56 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-e3eff7f4-a815-42ba-b0d4-962e9668bb6d tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.007s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:56 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-e3eff7f4-a815-42ba-b0d4-962e9668bb6d tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:56 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-e3eff7f4-a815-42ba-b0d4-962e9668bb6d tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:56 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-e3eff7f4-a815-42ba-b0d4-962e9668bb6d tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.027s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:56 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-e3eff7f4-a815-42ba-b0d4-962e9668bb6d tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] changing access on None May 28 12:59:56 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e3eff7f4-a815-42ba-b0d4-962e9668bb6d tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:59:56 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e3eff7f4-a815-42ba-b0d4-962e9668bb6d tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] {'allow_redirects': True, May 28 12:59:56 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e3eff7f4-a815-42ba-b0d4-962e9668bb6d tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] 'params': {'name': '7fdd602c-79d0-479c-95a2-336b202c6639'}} May 28 12:59:56 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.quota [None req-bb09d2fa-8124-40aa-a5a0-afb72aa4c335 tempest-ShareNetworksTest-2070207761 tempest-ShareNetworksTest-2070207761-project-member] Committed reservations ['a784f500-d585-4dd1-a064-d5cd51b008f6'] {{(pid=98330) commit /opt/stack/manila/manila/quota.py:1063}} May 28 12:59:56 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-bb09d2fa-8124-40aa-a5a0-afb72aa4c335 tempest-ShareNetworksTest-2070207761 tempest-ShareNetworksTest-2070207761-project-member] http://10.27.203.238/share/v1/a9041f7c5fff43159545a43cdafa94d5/share-networks returned with HTTP 200 May 28 12:59:56 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 809/1644] 10.27.203.238 () {64 vars in 1343 bytes} [Tue May 28 12:59:56 2024] POST /share/v1/a9041f7c5fff43159545a43cdafa94d5/share-networks => generated 462 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:59:56 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-2a21e160-2e44-47c4-a4c5-8b550f20026b tempest-ShareNetworksTest-2070207761 tempest-ShareNetworksTest-2070207761-project-member] DELETE http://10.27.203.238/share/v1/a9041f7c5fff43159545a43cdafa94d5/share-networks/8123d5ea-43d9-4197-bbf1-5ba01da29a91 May 28 12:59:56 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-2a21e160-2e44-47c4-a4c5-8b550f20026b tempest-ShareNetworksTest-2070207761 tempest-ShareNetworksTest-2070207761-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:56 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-2a21e160-2e44-47c4-a4c5-8b550f20026b tempest-ShareNetworksTest-2070207761 tempest-ShareNetworksTest-2070207761-project-member] Calling method 'ShareNetworkController.delete' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:56 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.quota [None req-2a21e160-2e44-47c4-a4c5-8b550f20026b tempest-ShareNetworksTest-2070207761 tempest-ShareNetworksTest-2070207761-project-member] Created reservations ['994ee921-b659-4754-8190-92f8b935c3fa'] {{(pid=98329) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 12:59:56 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1adee421-ddbc-4654-8d24-e67ca3f3a79a tempest-ShareTransferNegativeTest-884271560 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:59:56 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1adee421-ddbc-4654-8d24-e67ca3f3a79a tempest-ShareTransferNegativeTest-884271560 None] [] May 28 12:59:56 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1adee421-ddbc-4654-8d24-e67ca3f3a79a tempest-ShareTransferNegativeTest-884271560 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 12:59:56 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1adee421-ddbc-4654-8d24-e67ca3f3a79a tempest-ShareTransferNegativeTest-884271560 None] >>> [POST] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:59:56 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1adee421-ddbc-4654-8d24-e67ca3f3a79a tempest-ShareTransferNegativeTest-884271560 None] {'data': '{"name": "e89b90ae-d644-4b77-81a0-3d997b90fad0"}', May 28 12:59:56 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1adee421-ddbc-4654-8d24-e67ca3f3a79a tempest-ShareTransferNegativeTest-884271560 None] 'json': None, May 28 12:59:56 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1adee421-ddbc-4654-8d24-e67ca3f3a79a tempest-ShareTransferNegativeTest-884271560 None] 'params': None} May 28 12:59:56 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.quota [None req-2a21e160-2e44-47c4-a4c5-8b550f20026b tempest-ShareNetworksTest-2070207761 tempest-ShareNetworksTest-2070207761-project-member] Committed reservations ['994ee921-b659-4754-8190-92f8b935c3fa'] {{(pid=98329) commit /opt/stack/manila/manila/quota.py:1063}} May 28 12:59:56 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-2a21e160-2e44-47c4-a4c5-8b550f20026b tempest-ShareNetworksTest-2070207761 tempest-ShareNetworksTest-2070207761-project-member] http://10.27.203.238/share/v1/a9041f7c5fff43159545a43cdafa94d5/share-networks/8123d5ea-43d9-4197-bbf1-5ba01da29a91 returned with HTTP 202 May 28 12:59:56 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 836/1645] 10.27.203.238 () {62 vars in 1435 bytes} [Tue May 28 12:59:56 2024] DELETE /share/v1/a9041f7c5fff43159545a43cdafa94d5/share-networks/8123d5ea-43d9-4197-bbf1-5ba01da29a91 => generated 0 bytes in 176 msecs (HTTP/1.1 202) 6 headers in 242 bytes (1 switches on core 0) May 28 12:59:56 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-c0de95f5-64cc-444e-9ffd-f8049f7e33db tempest-ShareNetworksTest-2070207761 tempest-ShareNetworksTest-2070207761-project-member] POST http://10.27.203.238/share/v1/a9041f7c5fff43159545a43cdafa94d5/share-networks May 28 12:59:56 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-c0de95f5-64cc-444e-9ffd-f8049f7e33db tempest-ShareNetworksTest-2070207761 tempest-ShareNetworksTest-2070207761-project-member] Action: 'create', calling method: ShareNetworkController.create, body: {"share_network": {"name": "tempest-sn-name-1696728045", "description": "tempest-sn-desc-895276040", "neutron_net_id": "tempest-net-id-344115113", "neutron_subnet_id": "tempest-subnet-id-1425118288"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:59:56 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Expecting reply to msg 80285685728248c1a84ba50427f7afe7 in queue reply_37f4cbd1dd094961a22b8a65f222c327 May 28 12:59:56 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [-] Received RPC response for msg 80285685728248c1a84ba50427f7afe7 May 28 12:59:56 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.quota [None req-c0de95f5-64cc-444e-9ffd-f8049f7e33db tempest-ShareNetworksTest-2070207761 tempest-ShareNetworksTest-2070207761-project-member] Created reservations ['9cb39f25-9791-4d6e-a916-3e11c7d82411'] {{(pid=98330) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 12:59:56 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e3eff7f4-a815-42ba-b0d4-962e9668bb6d tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:59:56 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e3eff7f4-a815-42ba-b0d4-962e9668bb6d tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] [Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=1, created='2024-05-28T12:58:43.845440Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='31b6534b-d142-4561-992f-4f0759db302d', id=32, internal=False, is_s3_default_policy=False, name='7fdd602c-79d0-479c-95a2-336b202c6639', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=['*'], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['203.0.113.84'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['203.0.113.84'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T12:59:55.270012Z', tenant_id=1, tenant_name='default', title='7fdd602c-79d0-479c-95a2-336b202c6639', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/32/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[])] May 28 12:59:56 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e3eff7f4-a815-42ba-b0d4-962e9668bb6d tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 12:59:56 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-e3eff7f4-a815-42ba-b0d4-962e9668bb6d tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] changing access on /manila/manila-7fdd602c-79d0-479c-95a2-336b202c6639. Rules: {'nfs_read_write': [], 'nfs_read_only': []} May 28 12:59:56 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e3eff7f4-a815-42ba-b0d4-962e9668bb6d tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] >>> [PATCH] https://127.0.0.1:40443/api/viewpolicies/32/ May 28 12:59:56 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e3eff7f4-a815-42ba-b0d4-962e9668bb6d tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] {'data': '{"name": "7fdd602c-79d0-479c-95a2-336b202c6639", "nfs_no_squash": ' May 28 12:59:56 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e3eff7f4-a815-42ba-b0d4-962e9668bb6d tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] '["*"], "nfs_root_squash": ["*"], "nfs_read_write": [], ' May 28 12:59:56 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e3eff7f4-a815-42ba-b0d4-962e9668bb6d tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] '"nfs_read_only": []}', May 28 12:59:56 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e3eff7f4-a815-42ba-b0d4-962e9668bb6d tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] 'params': None} May 28 12:59:56 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.quota [None req-c0de95f5-64cc-444e-9ffd-f8049f7e33db tempest-ShareNetworksTest-2070207761 tempest-ShareNetworksTest-2070207761-project-member] Committed reservations ['9cb39f25-9791-4d6e-a916-3e11c7d82411'] {{(pid=98330) commit /opt/stack/manila/manila/quota.py:1063}} May 28 12:59:56 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-c0de95f5-64cc-444e-9ffd-f8049f7e33db tempest-ShareNetworksTest-2070207761 tempest-ShareNetworksTest-2070207761-project-member] http://10.27.203.238/share/v1/a9041f7c5fff43159545a43cdafa94d5/share-networks returned with HTTP 200 May 28 12:59:56 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 810/1646] 10.27.203.238 () {64 vars in 1343 bytes} [Tue May 28 12:59:56 2024] POST /share/v1/a9041f7c5fff43159545a43cdafa94d5/share-networks => generated 462 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:59:56 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-e1e01205-0bbb-4ee3-be2e-9b4c4f846ab4 tempest-ShareNetworksTest-2070207761 tempest-ShareNetworksTest-2070207761-project-member] DELETE http://10.27.203.238/share/v1/a9041f7c5fff43159545a43cdafa94d5/share-networks/7ff60c1b-4242-44ae-be9c-0de10d980d40 May 28 12:59:56 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-e1e01205-0bbb-4ee3-be2e-9b4c4f846ab4 tempest-ShareNetworksTest-2070207761 tempest-ShareNetworksTest-2070207761-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:56 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-e1e01205-0bbb-4ee3-be2e-9b4c4f846ab4 tempest-ShareNetworksTest-2070207761 tempest-ShareNetworksTest-2070207761-project-member] Calling method 'ShareNetworkController.delete' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:56 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.quota [None req-e1e01205-0bbb-4ee3-be2e-9b4c4f846ab4 tempest-ShareNetworksTest-2070207761 tempest-ShareNetworksTest-2070207761-project-member] Created reservations ['1bbe941e-bf46-458f-a7ba-4973a2fc45e7'] {{(pid=98329) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 12:59:56 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.quota [None req-e1e01205-0bbb-4ee3-be2e-9b4c4f846ab4 tempest-ShareNetworksTest-2070207761 tempest-ShareNetworksTest-2070207761-project-member] Committed reservations ['1bbe941e-bf46-458f-a7ba-4973a2fc45e7'] {{(pid=98329) commit /opt/stack/manila/manila/quota.py:1063}} May 28 12:59:56 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-e1e01205-0bbb-4ee3-be2e-9b4c4f846ab4 tempest-ShareNetworksTest-2070207761 tempest-ShareNetworksTest-2070207761-project-member] http://10.27.203.238/share/v1/a9041f7c5fff43159545a43cdafa94d5/share-networks/7ff60c1b-4242-44ae-be9c-0de10d980d40 returned with HTTP 202 May 28 12:59:56 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 837/1647] 10.27.203.238 () {62 vars in 1435 bytes} [Tue May 28 12:59:56 2024] DELETE /share/v1/a9041f7c5fff43159545a43cdafa94d5/share-networks/7ff60c1b-4242-44ae-be9c-0de10d980d40 => generated 0 bytes in 113 msecs (HTTP/1.1 202) 6 headers in 242 bytes (1 switches on core 0) May 28 12:59:56 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-132a16cf-b2fd-4e2b-9177-395339673d0a tempest-ShareNetworksTest-2070207761 tempest-ShareNetworksTest-2070207761-project-member] GET http://10.27.203.238/share/v1/a9041f7c5fff43159545a43cdafa94d5/share-networks/detail?all_tenants=1 May 28 12:59:56 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-132a16cf-b2fd-4e2b-9177-395339673d0a tempest-ShareNetworksTest-2070207761 tempest-ShareNetworksTest-2070207761-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:56 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-132a16cf-b2fd-4e2b-9177-395339673d0a tempest-ShareNetworksTest-2070207761 tempest-ShareNetworksTest-2070207761-project-member] Calling method 'ShareNetworkController.detail' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:56 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-132a16cf-b2fd-4e2b-9177-395339673d0a tempest-ShareNetworksTest-2070207761 tempest-ShareNetworksTest-2070207761-project-member] http://10.27.203.238/share/v1/a9041f7c5fff43159545a43cdafa94d5/share-networks/detail?all_tenants=1 returned with HTTP 200 May 28 12:59:56 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 811/1648] 10.27.203.238 () {62 vars in 1369 bytes} [Tue May 28 12:59:56 2024] GET /share/v1/a9041f7c5fff43159545a43cdafa94d5/share-networks/detail?all_tenants=1 => generated 820 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:59:57 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-369ecbb4-6b30-49ea-965e-dd4b4d9b0e2b tempest-ShareNetworksTest-2070207761 tempest-ShareNetworksTest-2070207761-project-member] GET http://10.27.203.238/share/v1/a9041f7c5fff43159545a43cdafa94d5/share-networks/detail?project_id=some_project May 28 12:59:57 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-369ecbb4-6b30-49ea-965e-dd4b4d9b0e2b tempest-ShareNetworksTest-2070207761 tempest-ShareNetworksTest-2070207761-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:57 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-369ecbb4-6b30-49ea-965e-dd4b4d9b0e2b tempest-ShareNetworksTest-2070207761 tempest-ShareNetworksTest-2070207761-project-member] Calling method 'ShareNetworkController.detail' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:57 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-369ecbb4-6b30-49ea-965e-dd4b4d9b0e2b tempest-ShareNetworksTest-2070207761 tempest-ShareNetworksTest-2070207761-project-member] http://10.27.203.238/share/v1/a9041f7c5fff43159545a43cdafa94d5/share-networks/detail?project_id=some_project returned with HTTP 200 May 28 12:59:57 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 838/1649] 10.27.203.238 () {62 vars in 1389 bytes} [Tue May 28 12:59:57 2024] GET /share/v1/a9041f7c5fff43159545a43cdafa94d5/share-networks/detail?project_id=some_project => generated 820 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:59:57 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-2e90fabd-3855-4dfe-834e-67217475785f tempest-ShareNetworksTest-2070207761 tempest-ShareNetworksTest-2070207761-project-member] PUT http://10.27.203.238/share/v1/a9041f7c5fff43159545a43cdafa94d5/share-networks/ecf94647-1e2c-413b-8980-9c32c6fec7ca May 28 12:59:57 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-2e90fabd-3855-4dfe-834e-67217475785f tempest-ShareNetworksTest-2070207761 tempest-ShareNetworksTest-2070207761-project-member] Action: 'update', calling method: ShareNetworkController.update, body: {"share_network": {"name": "tempest-sn-name-1560142448", "description": "tempest-sn-desc-541272479", "neutron_net_id": "tempest-net-id-851753894", "neutron_subnet_id": "tempest-subnet-id-2088110014"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:59:57 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-2e90fabd-3855-4dfe-834e-67217475785f tempest-ShareNetworksTest-2070207761 tempest-ShareNetworksTest-2070207761-project-member] http://10.27.203.238/share/v1/a9041f7c5fff43159545a43cdafa94d5/share-networks/ecf94647-1e2c-413b-8980-9c32c6fec7ca returned with HTTP 200 May 28 12:59:57 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 812/1650] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 12:59:57 2024] PUT /share/v1/a9041f7c5fff43159545a43cdafa94d5/share-networks/ecf94647-1e2c-413b-8980-9c32c6fec7ca => generated 494 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40337fb5-b653-4fd8-9bf4-28f0fe28b576 service manila] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:57 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e7245d6a-0625-4258-a172-a4e5aad67460 tempest-ShareRulesTest-1530341375 None] <<< [POST] https://127.0.0.1:40443/api/views/ May 28 12:59:57 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e7245d6a-0625-4258-a172-a4e5aad67460 tempest-ShareRulesTest-1530341375 None] Bunch(abac_tags=[], abe_max_depth=None, abe_protocols=[], alias='', allow_anonymous_access=False, allow_s3_anonymous_access=False, auto_commit='0d', bucket='', bucket_creators=[], bucket_creators_groups=[], bucket_owner=None, bulk_permission_update_progress=None, bulk_permission_update_state=None, cluster='loop75-kfs', cluster_id=1, created='2024-05-28T12:59:56.829066Z', enabled=True, files_retention_mode='NONE', guid='0cdeeb19-099f-47c9-896b-f45929d9cc4f', id=37, ignore_oos=False, internal=False, is_remote=False, is_seamless=False, logical_capacity=0, max_retention_period=None, min_retention_period=None, name='f7e47502-a0f7-44de-953d-b7b5697ae0b2', nfs_interop_flags='BOTH_NFS3_AND_NFS4_INTEROP_DISABLED', path='/manila/manila-f7e47502-a0f7-44de-953d-b7b5697ae0b2', physical_capacity=0, policy='f7e47502-a0f7-44de-953d-b7b5697ae0b2', policy_id=38, protocols=['NFS'], qos_policy=None, qos_policy_id=None, s3_locks=False, s3_locks_retention_mode='NONE', s3_locks_retention_period='', s3_object_ownership_rule='ObjectWriter', s3_unverified_lookup=False, s3_versioning=False, select_for_live_monitoring=False, share='', share_acl=Bunch(acl=[], enabled=False), sync='SYNCED', sync_time='2024-05-28T12:59:57.099248Z', tenant_id=1, tenant_name='default', title='/manila/manila-f7e47502-a0f7-44de-953d-b7b5697ae0b2', url='https://127.0.0.1:40443/api/views/37/') May 28 12:59:57 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e7245d6a-0625-4258-a172-a4e5aad67460 tempest-ShareRulesTest-1530341375 None] --- [POST] https://127.0.0.1:40443/api/views/: Done May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40337fb5-b653-4fd8-9bf4-28f0fe28b576 service manila] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030325e9-17c3-44da-a269-88ba91891406 tempest-ShareNetworksTest-972401819 tempest-ShareNetworksTest-972401819-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b35183570c8402f817ad2fd23ea9f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef340a63eac420b916f1faf294d92d9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030325e9-17c3-44da-a269-88ba91891406 tempest-ShareNetworksTest-972401819 tempest-ShareNetworksTest-972401819-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030325e9-17c3-44da-a269-88ba91891406 tempest-ShareNetworksTest-972401819 tempest-ShareNetworksTest-972401819-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030325e9-17c3-44da-a269-88ba91891406 tempest-ShareNetworksTest-972401819 tempest-ShareNetworksTest-972401819-project-admin] PATH_INFO: `/v3/users/981b3e419ab1466ba64538f100d39f99` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030325e9-17c3-44da-a269-88ba91891406 tempest-ShareNetworksTest-972401819 tempest-ShareNetworksTest-972401819-project-admin] RBAC: Authorizing `identity:delete_user(user_id=981b3e419ab1466ba64538f100d39f99)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030325e9-17c3-44da-a269-88ba91891406 tempest-ShareNetworksTest-972401819 tempest-ShareNetworksTest-972401819-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-030325e9-17c3-44da-a269-88ba91891406 tempest-ShareNetworksTest-972401819 tempest-ShareNetworksTest-972401819-project-admin] Could not find user: 981b3e419ab1466ba64538f100d39f99.: keystone.exception.UserNotFound: Could not find user: 981b3e419ab1466ba64538f100d39f99. May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 981b3e419ab1466ba64538f100d39f99. May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1367/2705] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 12:59:57 2024] DELETE /identity/v3/users/981b3e419ab1466ba64538f100d39f99 => generated 110 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a43e76-6253-440a-bb9d-c550dc63abcc service manila] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a43e76-6253-440a-bb9d-c550dc63abcc service manila] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:57 l75lg1-v1 devstack@placement-api.service[78202]: DEBUG placement.requestlog [req-79123ddb-7b23-45a0-b8b6-9f4428bace19 req-5ed62155-47ba-4c81-b242-0ee0ed8d713a None None] Starting request: 10.27.203.238 "GET /placement/resource_providers/ef90d7d1-0808-4a15-ad77-f9a7391af2f4/allocations" {{(pid=78202) __call__ /opt/stack/placement/placement/requestlog.py:55}} May 28 12:59:57 l75lg1-v1 manila-share[98474]: INFO manila.share.manager [None req-e7245d6a-0625-4258-a172-a4e5aad67460 tempest-ShareRulesTest-1530341375 None] Share instance f7e47502-a0f7-44de-953d-b7b5697ae0b2 created successfully. May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af354392-e5cf-489e-ab8f-ac952fe185c3 tempest-ShareNetworksTest-972401819 tempest-ShareNetworksTest-972401819-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b35183570c8402f817ad2fd23ea9f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef340a63eac420b916f1faf294d92d9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af354392-e5cf-489e-ab8f-ac952fe185c3 tempest-ShareNetworksTest-972401819 tempest-ShareNetworksTest-972401819-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af354392-e5cf-489e-ab8f-ac952fe185c3 tempest-ShareNetworksTest-972401819 tempest-ShareNetworksTest-972401819-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af354392-e5cf-489e-ab8f-ac952fe185c3 tempest-ShareNetworksTest-972401819 tempest-ShareNetworksTest-972401819-project-admin] PATH_INFO: `/v3/users/b06cddbef69143b790020ff2c97c502e` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:57 l75lg1-v1 devstack@placement-api.service[78202]: INFO placement.requestlog [req-79123ddb-7b23-45a0-b8b6-9f4428bace19 req-5ed62155-47ba-4c81-b242-0ee0ed8d713a service placement] 10.27.203.238 "GET /placement/resource_providers/ef90d7d1-0808-4a15-ad77-f9a7391af2f4/allocations" status: 200 len: 54 microversion: 1.0 May 28 12:59:57 l75lg1-v1 devstack@placement-api.service[78202]: [pid: 78202|app: 0|req: 25/49] 10.27.203.238 () {62 vars in 1480 bytes} [Tue May 28 12:59:57 2024] GET /placement/resource_providers/ef90d7d1-0808-4a15-ad77-f9a7391af2f4/allocations => generated 54 bytes in 12 msecs (HTTP/1.1 200) 6 headers in 223 bytes (1 switches on core 0) May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af354392-e5cf-489e-ab8f-ac952fe185c3 tempest-ShareNetworksTest-972401819 tempest-ShareNetworksTest-972401819-project-admin] RBAC: Authorizing `identity:delete_user(user_id=b06cddbef69143b790020ff2c97c502e)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:57 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.resource_tracker [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Total usable vcpus: 10, total allocated vcpus: 0 {{(pid=83654) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}} May 28 12:59:57 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.resource_tracker [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Final resource view: name=l75lg1-v1 phys_ram=16000MB used_ram=512MB phys_disk=28GB used_disk=0GB total_vcpus=10 used_vcpus=0 pci_stats=[] {{(pid=83654) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}} May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af354392-e5cf-489e-ab8f-ac952fe185c3 tempest-ShareNetworksTest-972401819 tempest-ShareNetworksTest-972401819-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:57 l75lg1-v1 devstack@placement-api.service[78201]: DEBUG placement.requestlog [req-79123ddb-7b23-45a0-b8b6-9f4428bace19 req-848c65cf-0597-4fed-bb68-e243fc0076df None None] Starting request: 10.27.203.238 "GET /placement/resource_providers/ef90d7d1-0808-4a15-ad77-f9a7391af2f4/allocations" {{(pid=78201) __call__ /opt/stack/placement/placement/requestlog.py:55}} May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-af354392-e5cf-489e-ab8f-ac952fe185c3 tempest-ShareNetworksTest-972401819 tempest-ShareNetworksTest-972401819-project-admin] Could not find user: b06cddbef69143b790020ff2c97c502e.: keystone.exception.UserNotFound: Could not find user: b06cddbef69143b790020ff2c97c502e. May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: b06cddbef69143b790020ff2c97c502e. May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1339/2706] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 12:59:57 2024] DELETE /identity/v3/users/b06cddbef69143b790020ff2c97c502e => generated 110 bytes in 29 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030325e9-17c3-44da-a269-88ba91891406 tempest-ShareNetworksTest-972401819 tempest-ShareNetworksTest-972401819-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:57 l75lg1-v1 devstack@placement-api.service[78201]: INFO placement.requestlog [req-79123ddb-7b23-45a0-b8b6-9f4428bace19 req-848c65cf-0597-4fed-bb68-e243fc0076df service placement] 10.27.203.238 "GET /placement/resource_providers/ef90d7d1-0808-4a15-ad77-f9a7391af2f4/allocations" status: 200 len: 54 microversion: 1.0 May 28 12:59:57 l75lg1-v1 devstack@placement-api.service[78201]: [pid: 78201|app: 0|req: 25/50] 10.27.203.238 () {62 vars in 1480 bytes} [Tue May 28 12:59:57 2024] GET /placement/resource_providers/ef90d7d1-0808-4a15-ad77-f9a7391af2f4/allocations => generated 54 bytes in 12 msecs (HTTP/1.1 200) 6 headers in 223 bytes (1 switches on core 0) May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030325e9-17c3-44da-a269-88ba91891406 tempest-ShareNetworksTest-972401819 tempest-ShareNetworksTest-972401819-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:57 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.provider_tree [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Inventory has not changed in ProviderTree for provider: ef90d7d1-0808-4a15-ad77-f9a7391af2f4 {{(pid=83654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} May 28 12:59:57 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Expecting reply to msg 8df3eb07dcf645c3bf989bd58dbee2c2 in queue reply_37f4cbd1dd094961a22b8a65f222c327 May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242d4ff9-59b0-469e-b2b2-04d6523359d7 tempest-ShareNetworksTest-972401819 tempest-ShareNetworksTest-972401819-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b35183570c8402f817ad2fd23ea9f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef340a63eac420b916f1faf294d92d9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242d4ff9-59b0-469e-b2b2-04d6523359d7 tempest-ShareNetworksTest-972401819 tempest-ShareNetworksTest-972401819-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242d4ff9-59b0-469e-b2b2-04d6523359d7 tempest-ShareNetworksTest-972401819 tempest-ShareNetworksTest-972401819-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242d4ff9-59b0-469e-b2b2-04d6523359d7 tempest-ShareNetworksTest-972401819 tempest-ShareNetworksTest-972401819-project-admin] PATH_INFO: `/v3/users/6285dcecc86746a7b4eee34cf3c3f672` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:57 l75lg1-v1 dstat.sh[49771]: 28-05 12:59:57| 13 1 78 7 0|5747M 1711M 278M 7889M| 18k 11k| 0 10M| 0 930 |9081 15k|1.21 1.08 1.02|2.0 1.0 0| 0 0 | 0 2048M| 29 362 0 48 2 May 28 12:59:57 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [-] Received RPC response for msg 8df3eb07dcf645c3bf989bd58dbee2c2 May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242d4ff9-59b0-469e-b2b2-04d6523359d7 tempest-ShareNetworksTest-972401819 tempest-ShareNetworksTest-972401819-project-admin] RBAC: Authorizing `identity:delete_user(user_id=6285dcecc86746a7b4eee34cf3c3f672)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242d4ff9-59b0-469e-b2b2-04d6523359d7 tempest-ShareNetworksTest-972401819 tempest-ShareNetworksTest-972401819-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-242d4ff9-59b0-469e-b2b2-04d6523359d7 tempest-ShareNetworksTest-972401819 tempest-ShareNetworksTest-972401819-project-admin] Could not find user: 6285dcecc86746a7b4eee34cf3c3f672.: keystone.exception.UserNotFound: Could not find user: 6285dcecc86746a7b4eee34cf3c3f672. May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 6285dcecc86746a7b4eee34cf3c3f672. May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1368/2707] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 12:59:57 2024] DELETE /identity/v3/users/6285dcecc86746a7b4eee34cf3c3f672 => generated 110 bytes in 27 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af354392-e5cf-489e-ab8f-ac952fe185c3 tempest-ShareNetworksTest-972401819 tempest-ShareNetworksTest-972401819-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af354392-e5cf-489e-ab8f-ac952fe185c3 tempest-ShareNetworksTest-972401819 tempest-ShareNetworksTest-972401819-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b15c0c-588d-4c3c-98f3-e6b89973c49a tempest-ShareNetworksTest-972401819 tempest-ShareNetworksTest-972401819-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b35183570c8402f817ad2fd23ea9f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef340a63eac420b916f1faf294d92d9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b15c0c-588d-4c3c-98f3-e6b89973c49a tempest-ShareNetworksTest-972401819 tempest-ShareNetworksTest-972401819-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b15c0c-588d-4c3c-98f3-e6b89973c49a tempest-ShareNetworksTest-972401819 tempest-ShareNetworksTest-972401819-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b15c0c-588d-4c3c-98f3-e6b89973c49a tempest-ShareNetworksTest-972401819 tempest-ShareNetworksTest-972401819-project-admin] PATH_INFO: `/v3/users/b12d90b85fc7452f83fec53a2941a759` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b15c0c-588d-4c3c-98f3-e6b89973c49a tempest-ShareNetworksTest-972401819 tempest-ShareNetworksTest-972401819-project-admin] RBAC: Authorizing `identity:delete_user(user_id=b12d90b85fc7452f83fec53a2941a759)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b15c0c-588d-4c3c-98f3-e6b89973c49a tempest-ShareNetworksTest-972401819 tempest-ShareNetworksTest-972401819-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-92b15c0c-588d-4c3c-98f3-e6b89973c49a tempest-ShareNetworksTest-972401819 tempest-ShareNetworksTest-972401819-project-admin] Could not find user: b12d90b85fc7452f83fec53a2941a759.: keystone.exception.UserNotFound: Could not find user: b12d90b85fc7452f83fec53a2941a759. May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: b12d90b85fc7452f83fec53a2941a759. May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1340/2708] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 12:59:57 2024] DELETE /identity/v3/users/b12d90b85fc7452f83fec53a2941a759 => generated 110 bytes in 23 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242d4ff9-59b0-469e-b2b2-04d6523359d7 tempest-ShareNetworksTest-972401819 tempest-ShareNetworksTest-972401819-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242d4ff9-59b0-469e-b2b2-04d6523359d7 tempest-ShareNetworksTest-972401819 tempest-ShareNetworksTest-972401819-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5114e41-ff18-4c60-a269-76fbc01463c5 tempest-ShareNetworksTest-972401819 tempest-ShareNetworksTest-972401819-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b35183570c8402f817ad2fd23ea9f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef340a63eac420b916f1faf294d92d9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5114e41-ff18-4c60-a269-76fbc01463c5 tempest-ShareNetworksTest-972401819 tempest-ShareNetworksTest-972401819-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5114e41-ff18-4c60-a269-76fbc01463c5 tempest-ShareNetworksTest-972401819 tempest-ShareNetworksTest-972401819-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5114e41-ff18-4c60-a269-76fbc01463c5 tempest-ShareNetworksTest-972401819 tempest-ShareNetworksTest-972401819-project-admin] PATH_INFO: `/v3/users/fa87d7e402e34eeab8ec8ddf1839bb59` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5114e41-ff18-4c60-a269-76fbc01463c5 tempest-ShareNetworksTest-972401819 tempest-ShareNetworksTest-972401819-project-admin] RBAC: Authorizing `identity:delete_user(user_id=fa87d7e402e34eeab8ec8ddf1839bb59)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5114e41-ff18-4c60-a269-76fbc01463c5 tempest-ShareNetworksTest-972401819 tempest-ShareNetworksTest-972401819-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-d5114e41-ff18-4c60-a269-76fbc01463c5 tempest-ShareNetworksTest-972401819 tempest-ShareNetworksTest-972401819-project-admin] Could not find user: fa87d7e402e34eeab8ec8ddf1839bb59.: keystone.exception.UserNotFound: Could not find user: fa87d7e402e34eeab8ec8ddf1839bb59. May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: fa87d7e402e34eeab8ec8ddf1839bb59. May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1369/2709] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 12:59:57 2024] DELETE /identity/v3/users/fa87d7e402e34eeab8ec8ddf1839bb59 => generated 110 bytes in 23 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b15c0c-588d-4c3c-98f3-e6b89973c49a tempest-ShareNetworksTest-972401819 tempest-ShareNetworksTest-972401819-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b15c0c-588d-4c3c-98f3-e6b89973c49a tempest-ShareNetworksTest-972401819 tempest-ShareNetworksTest-972401819-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e69e20-c335-48e2-8564-05b00a92be29 tempest-ShareNetworksTest-972401819 tempest-ShareNetworksTest-972401819-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b35183570c8402f817ad2fd23ea9f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef340a63eac420b916f1faf294d92d9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e69e20-c335-48e2-8564-05b00a92be29 tempest-ShareNetworksTest-972401819 tempest-ShareNetworksTest-972401819-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e69e20-c335-48e2-8564-05b00a92be29 tempest-ShareNetworksTest-972401819 tempest-ShareNetworksTest-972401819-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e69e20-c335-48e2-8564-05b00a92be29 tempest-ShareNetworksTest-972401819 tempest-ShareNetworksTest-972401819-project-admin] PATH_INFO: `/v3/users/a78a8004069a4253a6b38f609ac636bd` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e69e20-c335-48e2-8564-05b00a92be29 tempest-ShareNetworksTest-972401819 tempest-ShareNetworksTest-972401819-project-admin] RBAC: Authorizing `identity:delete_user(user_id=a78a8004069a4253a6b38f609ac636bd)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e69e20-c335-48e2-8564-05b00a92be29 tempest-ShareNetworksTest-972401819 tempest-ShareNetworksTest-972401819-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-b0e69e20-c335-48e2-8564-05b00a92be29 tempest-ShareNetworksTest-972401819 tempest-ShareNetworksTest-972401819-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a78a8004069a4253a6b38f609ac636bd', 'request_id': 'req-b0e69e20-c335-48e2-8564-05b00a92be29'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-b0e69e20-c335-48e2-8564-05b00a92be29 tempest-ShareNetworksTest-972401819 tempest-ShareNetworksTest-972401819-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a78a8004069a4253a6b38f609ac636bd', 'request_id': 'req-b0e69e20-c335-48e2-8564-05b00a92be29'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-b0e69e20-c335-48e2-8564-05b00a92be29 tempest-ShareNetworksTest-972401819 tempest-ShareNetworksTest-972401819-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a78a8004069a4253a6b38f609ac636bd', 'request_id': 'req-b0e69e20-c335-48e2-8564-05b00a92be29'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-b0e69e20-c335-48e2-8564-05b00a92be29 tempest-ShareNetworksTest-972401819 tempest-ShareNetworksTest-972401819-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a78a8004069a4253a6b38f609ac636bd', 'request_id': 'req-b0e69e20-c335-48e2-8564-05b00a92be29'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-b0e69e20-c335-48e2-8564-05b00a92be29 tempest-ShareNetworksTest-972401819 tempest-ShareNetworksTest-972401819-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a78a8004069a4253a6b38f609ac636bd', 'request_id': 'req-b0e69e20-c335-48e2-8564-05b00a92be29'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1341/2710] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 12:59:57 2024] DELETE /identity/v3/users/a78a8004069a4253a6b38f609ac636bd => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:59:57 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-b816ccc7-b7e4-495a-ba9a-fd57d4ac7e0d tempest-ShareNetworksTest-2070207761 tempest-ShareNetworksTest-2070207761-project-member] DELETE http://10.27.203.238/share/v1/a9041f7c5fff43159545a43cdafa94d5/share-networks/dde9e748-fa6a-4e84-afda-0136bb8aade5 May 28 12:59:57 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-b816ccc7-b7e4-495a-ba9a-fd57d4ac7e0d tempest-ShareNetworksTest-2070207761 tempest-ShareNetworksTest-2070207761-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:57 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-b816ccc7-b7e4-495a-ba9a-fd57d4ac7e0d tempest-ShareNetworksTest-2070207761 tempest-ShareNetworksTest-2070207761-project-member] Calling method 'ShareNetworkController.delete' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:57 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.quota [None req-b816ccc7-b7e4-495a-ba9a-fd57d4ac7e0d tempest-ShareNetworksTest-2070207761 tempest-ShareNetworksTest-2070207761-project-member] Created reservations ['e2bf6038-0fbf-44ca-a133-ec36806021bf'] {{(pid=98329) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 12:59:57 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.quota [None req-b816ccc7-b7e4-495a-ba9a-fd57d4ac7e0d tempest-ShareNetworksTest-2070207761 tempest-ShareNetworksTest-2070207761-project-member] Committed reservations ['e2bf6038-0fbf-44ca-a133-ec36806021bf'] {{(pid=98329) commit /opt/stack/manila/manila/quota.py:1063}} May 28 12:59:57 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-b816ccc7-b7e4-495a-ba9a-fd57d4ac7e0d tempest-ShareNetworksTest-2070207761 tempest-ShareNetworksTest-2070207761-project-member] http://10.27.203.238/share/v1/a9041f7c5fff43159545a43cdafa94d5/share-networks/dde9e748-fa6a-4e84-afda-0136bb8aade5 returned with HTTP 202 May 28 12:59:57 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 839/1651] 10.27.203.238 () {62 vars in 1435 bytes} [Tue May 28 12:59:57 2024] DELETE /share/v1/a9041f7c5fff43159545a43cdafa94d5/share-networks/dde9e748-fa6a-4e84-afda-0136bb8aade5 => generated 0 bytes in 162 msecs (HTTP/1.1 202) 6 headers in 242 bytes (1 switches on core 0) May 28 12:59:57 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-16ecb208-404c-4956-879d-b6b994bd5116 tempest-ShareNetworksTest-2070207761 tempest-ShareNetworksTest-2070207761-project-member] GET http://10.27.203.238/share/v1/a9041f7c5fff43159545a43cdafa94d5/share-networks/dde9e748-fa6a-4e84-afda-0136bb8aade5 May 28 12:59:57 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-16ecb208-404c-4956-879d-b6b994bd5116 tempest-ShareNetworksTest-2070207761 tempest-ShareNetworksTest-2070207761-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:57 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-16ecb208-404c-4956-879d-b6b994bd5116 tempest-ShareNetworksTest-2070207761 tempest-ShareNetworksTest-2070207761-project-member] Calling method 'ShareNetworkController.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:57 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-16ecb208-404c-4956-879d-b6b994bd5116 tempest-ShareNetworksTest-2070207761 tempest-ShareNetworksTest-2070207761-project-member] HTTP exception thrown: Share network dde9e748-fa6a-4e84-afda-0136bb8aade5 could not be found. May 28 12:59:57 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-16ecb208-404c-4956-879d-b6b994bd5116 tempest-ShareNetworksTest-2070207761 tempest-ShareNetworksTest-2070207761-project-member] http://10.27.203.238/share/v1/a9041f7c5fff43159545a43cdafa94d5/share-networks/dde9e748-fa6a-4e84-afda-0136bb8aade5 returned with HTTP 404 May 28 12:59:57 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 813/1652] 10.27.203.238 () {62 vars in 1432 bytes} [Tue May 28 12:59:57 2024] GET /share/v1/a9041f7c5fff43159545a43cdafa94d5/share-networks/dde9e748-fa6a-4e84-afda-0136bb8aade5 => generated 116 bytes in 20 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 12:59:57 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-7b302258-f816-4d28-8eb7-edfda691ab24 tempest-ShareNetworksTest-2070207761 tempest-ShareNetworksTest-2070207761-project-member] DELETE http://10.27.203.238/share/v1/a9041f7c5fff43159545a43cdafa94d5/share-networks/ecf94647-1e2c-413b-8980-9c32c6fec7ca May 28 12:59:57 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-7b302258-f816-4d28-8eb7-edfda691ab24 tempest-ShareNetworksTest-2070207761 tempest-ShareNetworksTest-2070207761-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:57 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-7b302258-f816-4d28-8eb7-edfda691ab24 tempest-ShareNetworksTest-2070207761 tempest-ShareNetworksTest-2070207761-project-member] Calling method 'ShareNetworkController.delete' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:57 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1adee421-ddbc-4654-8d24-e67ca3f3a79a tempest-ShareTransferNegativeTest-884271560 None] <<< [POST] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:59:57 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1adee421-ddbc-4654-8d24-e67ca3f3a79a tempest-ShareTransferNegativeTest-884271560 None] Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=0, created='2024-05-28T12:59:57.251328Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='fd9abce8-86bf-432b-8bd1-98263cf159ce', id=39, internal=False, is_s3_default_policy=False, name='e89b90ae-d644-4b77-81a0-3d997b90fad0', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=[], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['*'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['*'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T12:59:57.597483Z', tenant_id=1, tenant_name='default', title='e89b90ae-d644-4b77-81a0-3d997b90fad0', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/39/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[]) May 28 12:59:57 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1adee421-ddbc-4654-8d24-e67ca3f3a79a tempest-ShareTransferNegativeTest-884271560 None] --- [POST] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 12:59:57 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1adee421-ddbc-4654-8d24-e67ca3f3a79a tempest-ShareTransferNegativeTest-884271560 None] >>> [GET] https://127.0.0.1:40443/api/quotas/ May 28 12:59:57 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1adee421-ddbc-4654-8d24-e67ca3f3a79a tempest-ShareTransferNegativeTest-884271560 None] {'allow_redirects': True, May 28 12:59:57 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1adee421-ddbc-4654-8d24-e67ca3f3a79a tempest-ShareTransferNegativeTest-884271560 None] 'params': {'name': 'e89b90ae-d644-4b77-81a0-3d997b90fad0'}} May 28 12:59:57 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.quota [None req-7b302258-f816-4d28-8eb7-edfda691ab24 tempest-ShareNetworksTest-2070207761 tempest-ShareNetworksTest-2070207761-project-member] Created reservations ['0f6c775f-6aa3-4458-9a43-e69122979e47'] {{(pid=98329) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 12:59:57 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.quota [None req-7b302258-f816-4d28-8eb7-edfda691ab24 tempest-ShareNetworksTest-2070207761 tempest-ShareNetworksTest-2070207761-project-member] Committed reservations ['0f6c775f-6aa3-4458-9a43-e69122979e47'] {{(pid=98329) commit /opt/stack/manila/manila/quota.py:1063}} May 28 12:59:57 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-7b302258-f816-4d28-8eb7-edfda691ab24 tempest-ShareNetworksTest-2070207761 tempest-ShareNetworksTest-2070207761-project-member] http://10.27.203.238/share/v1/a9041f7c5fff43159545a43cdafa94d5/share-networks/ecf94647-1e2c-413b-8980-9c32c6fec7ca returned with HTTP 202 May 28 12:59:57 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 840/1653] 10.27.203.238 () {62 vars in 1435 bytes} [Tue May 28 12:59:57 2024] DELETE /share/v1/a9041f7c5fff43159545a43cdafa94d5/share-networks/ecf94647-1e2c-413b-8980-9c32c6fec7ca => generated 0 bytes in 149 msecs (HTTP/1.1 202) 6 headers in 242 bytes (1 switches on core 0) May 28 12:59:57 l75lg1-v1 nova-compute[83654]: DEBUG nova.scheduler.client.report [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Inventory has not changed for provider ef90d7d1-0808-4a15-ad77-f9a7391af2f4 based on inventory data: {'VCPU': {'total': 10, 'reserved': 0, 'min_unit': 1, 'max_unit': 10, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16000, 'reserved': 512, 'min_unit': 1, 'max_unit': 16000, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 28, 'reserved': 0, 'min_unit': 1, 'max_unit': 28, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=83654) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}} May 28 12:59:57 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-4f47d62c-dcb3-43c8-b832-e14329f3cba1 tempest-ShareNetworksTest-2070207761 tempest-ShareNetworksTest-2070207761-project-member] GET http://10.27.203.238/share/v1/a9041f7c5fff43159545a43cdafa94d5/share-networks/ecf94647-1e2c-413b-8980-9c32c6fec7ca May 28 12:59:57 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-4f47d62c-dcb3-43c8-b832-e14329f3cba1 tempest-ShareNetworksTest-2070207761 tempest-ShareNetworksTest-2070207761-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:57 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-4f47d62c-dcb3-43c8-b832-e14329f3cba1 tempest-ShareNetworksTest-2070207761 tempest-ShareNetworksTest-2070207761-project-member] Calling method 'ShareNetworkController.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:57 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.resource_tracker [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Compute_service record updated for l75lg1-v1:l75lg1-v1 {{(pid=83654) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}} May 28 12:59:57 l75lg1-v1 nova-compute[83654]: DEBUG oslo_concurrency.lockutils [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.557s {{(pid=83654) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:57 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-4f47d62c-dcb3-43c8-b832-e14329f3cba1 tempest-ShareNetworksTest-2070207761 tempest-ShareNetworksTest-2070207761-project-member] HTTP exception thrown: Share network ecf94647-1e2c-413b-8980-9c32c6fec7ca could not be found. May 28 12:59:57 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-4f47d62c-dcb3-43c8-b832-e14329f3cba1 tempest-ShareNetworksTest-2070207761 tempest-ShareNetworksTest-2070207761-project-member] http://10.27.203.238/share/v1/a9041f7c5fff43159545a43cdafa94d5/share-networks/ecf94647-1e2c-413b-8980-9c32c6fec7ca returned with HTTP 404 May 28 12:59:57 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 814/1654] 10.27.203.238 () {62 vars in 1432 bytes} [Tue May 28 12:59:57 2024] GET /share/v1/a9041f7c5fff43159545a43cdafa94d5/share-networks/ecf94647-1e2c-413b-8980-9c32c6fec7ca => generated 116 bytes in 19 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 12:59:57 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-aed4d90a-8b6e-4bf7-a51a-ded567ba79a6 tempest-ShareNetworksTest-972401819 tempest-ShareNetworksTest-972401819-project-admin] DELETE http://10.27.203.238/share/v2/aef340a63eac420b916f1faf294d92d9/types/bee52c94-7518-4a02-b920-8756b1d9a448 May 28 12:59:57 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-aed4d90a-8b6e-4bf7-a51a-ded567ba79a6 tempest-ShareNetworksTest-972401819 tempest-ShareNetworksTest-972401819-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:57 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-aed4d90a-8b6e-4bf7-a51a-ded567ba79a6 tempest-ShareNetworksTest-972401819 tempest-ShareNetworksTest-972401819-project-admin] Calling method 'ShareTypesController._delete' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:57 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-aed4d90a-8b6e-4bf7-a51a-ded567ba79a6 tempest-ShareNetworksTest-972401819 tempest-ShareNetworksTest-972401819-project-admin] http://10.27.203.238/share/v2/aef340a63eac420b916f1faf294d92d9/types/bee52c94-7518-4a02-b920-8756b1d9a448 returned with HTTP 202 May 28 12:59:57 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 841/1655] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:59:57 2024] DELETE /share/v2/aef340a63eac420b916f1faf294d92d9/types/bee52c94-7518-4a02-b920-8756b1d9a448 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:59:57 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-cb99d6c4-926d-41bf-b78f-d7eb6ecc3e7f tempest-ShareNetworksTest-972401819 tempest-ShareNetworksTest-972401819-project-admin] GET http://10.27.203.238/share/v2/aef340a63eac420b916f1faf294d92d9/types/bee52c94-7518-4a02-b920-8756b1d9a448 May 28 12:59:57 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-cb99d6c4-926d-41bf-b78f-d7eb6ecc3e7f tempest-ShareNetworksTest-972401819 tempest-ShareNetworksTest-972401819-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:57 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-cb99d6c4-926d-41bf-b78f-d7eb6ecc3e7f tempest-ShareNetworksTest-972401819 tempest-ShareNetworksTest-972401819-project-admin] Calling method 'ShareTypesController.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:57 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-cb99d6c4-926d-41bf-b78f-d7eb6ecc3e7f tempest-ShareNetworksTest-972401819 tempest-ShareNetworksTest-972401819-project-admin] HTTP exception thrown: Share type not found. May 28 12:59:57 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-cb99d6c4-926d-41bf-b78f-d7eb6ecc3e7f tempest-ShareNetworksTest-972401819 tempest-ShareNetworksTest-972401819-project-admin] http://10.27.203.238/share/v2/aef340a63eac420b916f1faf294d92d9/types/bee52c94-7518-4a02-b920-8756b1d9a448 returned with HTTP 404 May 28 12:59:57 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 815/1656] 10.27.203.238 () {64 vars in 1448 bytes} [Tue May 28 12:59:57 2024] GET /share/v2/aef340a63eac420b916f1faf294d92d9/types/bee52c94-7518-4a02-b920-8756b1d9a448 => generated 67 bytes in 10 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5114e41-ff18-4c60-a269-76fbc01463c5 tempest-ShareNetworksTest-972401819 tempest-ShareNetworksTest-972401819-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-d5114e41-ff18-4c60-a269-76fbc01463c5 tempest-ShareNetworksTest-972401819 tempest-ShareNetworksTest-972401819-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5114e41-ff18-4c60-a269-76fbc01463c5 tempest-ShareNetworksTest-972401819 tempest-ShareNetworksTest-972401819-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc76e73d-673d-4927-925d-7391ec03be72 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc76e73d-673d-4927-925d-7391ec03be72 None admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc76e73d-673d-4927-925d-7391ec03be72 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc76e73d-673d-4927-925d-7391ec03be72 None admin] PATH_INFO: `/v3/users/34dfe2e86b2e48f9854064756768aa07` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc76e73d-673d-4927-925d-7391ec03be72 None admin] RBAC: Authorizing `identity:delete_user(user_id=34dfe2e86b2e48f9854064756768aa07)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc76e73d-673d-4927-925d-7391ec03be72 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-bc76e73d-673d-4927-925d-7391ec03be72 None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34dfe2e86b2e48f9854064756768aa07', 'request_id': 'req-bc76e73d-673d-4927-925d-7391ec03be72'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-bc76e73d-673d-4927-925d-7391ec03be72 None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34dfe2e86b2e48f9854064756768aa07', 'request_id': 'req-bc76e73d-673d-4927-925d-7391ec03be72'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-bc76e73d-673d-4927-925d-7391ec03be72 None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34dfe2e86b2e48f9854064756768aa07', 'request_id': 'req-bc76e73d-673d-4927-925d-7391ec03be72'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-bc76e73d-673d-4927-925d-7391ec03be72 None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34dfe2e86b2e48f9854064756768aa07', 'request_id': 'req-bc76e73d-673d-4927-925d-7391ec03be72'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-bc76e73d-673d-4927-925d-7391ec03be72 None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34dfe2e86b2e48f9854064756768aa07', 'request_id': 'req-bc76e73d-673d-4927-925d-7391ec03be72'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1370/2711] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 12:59:57 2024] DELETE /identity/v3/users/34dfe2e86b2e48f9854064756768aa07 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e69e20-c335-48e2-8564-05b00a92be29 tempest-ShareNetworksTest-972401819 tempest-ShareNetworksTest-972401819-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e69e20-c335-48e2-8564-05b00a92be29 tempest-ShareNetworksTest-972401819 tempest-ShareNetworksTest-972401819-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:57 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1adee421-ddbc-4654-8d24-e67ca3f3a79a tempest-ShareTransferNegativeTest-884271560 None] <<< [GET] https://127.0.0.1:40443/api/quotas/ May 28 12:59:57 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1adee421-ddbc-4654-8d24-e67ca3f3a79a tempest-ShareTransferNegativeTest-884271560 None] [] May 28 12:59:57 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1adee421-ddbc-4654-8d24-e67ca3f3a79a tempest-ShareTransferNegativeTest-884271560 None] --- [GET] https://127.0.0.1:40443/api/quotas/: Done May 28 12:59:57 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1adee421-ddbc-4654-8d24-e67ca3f3a79a tempest-ShareTransferNegativeTest-884271560 None] >>> [POST] https://127.0.0.1:40443/api/quotas/ May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcf13fe-c993-435b-bbe0-044c20497466 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:57 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1adee421-ddbc-4654-8d24-e67ca3f3a79a tempest-ShareTransferNegativeTest-884271560 None] {'data': '{"name": "e89b90ae-d644-4b77-81a0-3d997b90fad0", "path": ' May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcf13fe-c993-435b-bbe0-044c20497466 None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcf13fe-c993-435b-bbe0-044c20497466 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcf13fe-c993-435b-bbe0-044c20497466 None admin] PATH_INFO: `/v3/users/8cd6ee6f70004de383e974cb1cd3adaf` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:57 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1adee421-ddbc-4654-8d24-e67ca3f3a79a tempest-ShareTransferNegativeTest-884271560 None] '"/manila/manila-e89b90ae-d644-4b77-81a0-3d997b90fad0", "create_dir": ' May 28 12:59:57 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1adee421-ddbc-4654-8d24-e67ca3f3a79a tempest-ShareTransferNegativeTest-884271560 None] 'true, "hard_limit": 1073741824}', May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcf13fe-c993-435b-bbe0-044c20497466 None admin] RBAC: Authorizing `identity:delete_user(user_id=8cd6ee6f70004de383e974cb1cd3adaf)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:57 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1adee421-ddbc-4654-8d24-e67ca3f3a79a tempest-ShareTransferNegativeTest-884271560 None] 'json': None, May 28 12:59:57 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1adee421-ddbc-4654-8d24-e67ca3f3a79a tempest-ShareTransferNegativeTest-884271560 None] 'params': None} May 28 12:59:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcf13fe-c993-435b-bbe0-044c20497466 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-cdcf13fe-c993-435b-bbe0-044c20497466 None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8cd6ee6f70004de383e974cb1cd3adaf', 'request_id': 'req-cdcf13fe-c993-435b-bbe0-044c20497466'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-cdcf13fe-c993-435b-bbe0-044c20497466 None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8cd6ee6f70004de383e974cb1cd3adaf', 'request_id': 'req-cdcf13fe-c993-435b-bbe0-044c20497466'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-cdcf13fe-c993-435b-bbe0-044c20497466 None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8cd6ee6f70004de383e974cb1cd3adaf', 'request_id': 'req-cdcf13fe-c993-435b-bbe0-044c20497466'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-cdcf13fe-c993-435b-bbe0-044c20497466 None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8cd6ee6f70004de383e974cb1cd3adaf', 'request_id': 'req-cdcf13fe-c993-435b-bbe0-044c20497466'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-cdcf13fe-c993-435b-bbe0-044c20497466 None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8cd6ee6f70004de383e974cb1cd3adaf', 'request_id': 'req-cdcf13fe-c993-435b-bbe0-044c20497466'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:58 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1342/2712] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 12:59:57 2024] DELETE /identity/v3/users/8cd6ee6f70004de383e974cb1cd3adaf => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:59:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc76e73d-673d-4927-925d-7391ec03be72 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-bc76e73d-673d-4927-925d-7391ec03be72 None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:59:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc76e73d-673d-4927-925d-7391ec03be72 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698b87ac-24fe-4e35-a131-09e357e5f56b None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698b87ac-24fe-4e35-a131-09e357e5f56b None admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698b87ac-24fe-4e35-a131-09e357e5f56b None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698b87ac-24fe-4e35-a131-09e357e5f56b None admin] PATH_INFO: `/v3/users/6b35183570c8402f817ad2fd23ea9f20` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698b87ac-24fe-4e35-a131-09e357e5f56b None admin] RBAC: Authorizing `identity:delete_user(user_id=6b35183570c8402f817ad2fd23ea9f20)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698b87ac-24fe-4e35-a131-09e357e5f56b None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-698b87ac-24fe-4e35-a131-09e357e5f56b None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b35183570c8402f817ad2fd23ea9f20', 'request_id': 'req-698b87ac-24fe-4e35-a131-09e357e5f56b'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-698b87ac-24fe-4e35-a131-09e357e5f56b None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b35183570c8402f817ad2fd23ea9f20', 'request_id': 'req-698b87ac-24fe-4e35-a131-09e357e5f56b'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-698b87ac-24fe-4e35-a131-09e357e5f56b None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b35183570c8402f817ad2fd23ea9f20', 'request_id': 'req-698b87ac-24fe-4e35-a131-09e357e5f56b'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-698b87ac-24fe-4e35-a131-09e357e5f56b None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b35183570c8402f817ad2fd23ea9f20', 'request_id': 'req-698b87ac-24fe-4e35-a131-09e357e5f56b'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-698b87ac-24fe-4e35-a131-09e357e5f56b None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b35183570c8402f817ad2fd23ea9f20', 'request_id': 'req-698b87ac-24fe-4e35-a131-09e357e5f56b'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:58 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1371/2713] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 12:59:58 2024] DELETE /identity/v3/users/6b35183570c8402f817ad2fd23ea9f20 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:59:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cbb615-2f9b-4a41-97d3-eea234c04336 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cbb615-2f9b-4a41-97d3-eea234c04336 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cbb615-2f9b-4a41-97d3-eea234c04336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:58 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-e8cbb615-2f9b-4a41-97d3-eea234c04336 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 12:59:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-e8cbb615-2f9b-4a41-97d3-eea234c04336 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 12:59:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-e8cbb615-2f9b-4a41-97d3-eea234c04336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:59:58 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1343/2714] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 12:59:58 2024] POST /identity/v3/auth/tokens => generated 2960 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 12:59:58 l75lg1-v1 neutron-server[77618]: DEBUG neutron.wsgi [-] (77618) accepted ('10.27.203.238', 41314) {{(pid=77618) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 12:59:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698b87ac-24fe-4e35-a131-09e357e5f56b None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-698b87ac-24fe-4e35-a131-09e357e5f56b None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:59:58 l75lg1-v1 dstat.sh[49771]: 28-05 12:59:58| 9 1 86 3 0|5747M 1710M 278M 7889M| 18k 1668B| 0 2340k| 0 353 |7778 14k|1.21 1.08 1.02|2.0 1.0 2.0| 0 0 | 0 2048M| 29 364 0 49 2 May 28 12:59:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698b87ac-24fe-4e35-a131-09e357e5f56b None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be78c28-087f-4df8-afb6-59db4013640d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef17047035e4b518fd5360a01f2da1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be78c28-087f-4df8-afb6-59db4013640d service neutron] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be78c28-087f-4df8-afb6-59db4013640d service neutron] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be78c28-087f-4df8-afb6-59db4013640d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be78c28-087f-4df8-afb6-59db4013640d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be78c28-087f-4df8-afb6-59db4013640d service neutron] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:58 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1372/2715] 10.27.203.238 () {64 vars in 1432 bytes} [Tue May 28 12:59:58 2024] GET /identity/v3/auth/tokens => generated 2960 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 28 12:59:58 l75lg1-v1 neutron-server[77618]: INFO neutron.wsgi [None req-f576ec1f-13ed-473d-ad7a-40d621a6c8d3 None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=aef340a63eac420b916f1faf294d92d9&name=default HTTP/1.1" status: 200 len: 216 time: 0.0767841 May 28 12:59:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cbb615-2f9b-4a41-97d3-eea234c04336 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-e8cbb615-2f9b-4a41-97d3-eea234c04336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:59:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cbb615-2f9b-4a41-97d3-eea234c04336 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb5169d-f68f-44f1-9b4d-7cf1b4b960e3 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb5169d-f68f-44f1-9b4d-7cf1b4b960e3 None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb5169d-f68f-44f1-9b4d-7cf1b4b960e3 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb5169d-f68f-44f1-9b4d-7cf1b4b960e3 None admin] PATH_INFO: `/v3/projects/aef340a63eac420b916f1faf294d92d9` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb5169d-f68f-44f1-9b4d-7cf1b4b960e3 None admin] RBAC: Authorizing `identity:delete_project(project_id=aef340a63eac420b916f1faf294d92d9)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb5169d-f68f-44f1-9b4d-7cf1b4b960e3 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-6fb5169d-f68f-44f1-9b4d-7cf1b4b960e3 None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aef340a63eac420b916f1faf294d92d9', 'request_id': 'req-6fb5169d-f68f-44f1-9b4d-7cf1b4b960e3'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-6fb5169d-f68f-44f1-9b4d-7cf1b4b960e3 None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aef340a63eac420b916f1faf294d92d9', 'request_id': 'req-6fb5169d-f68f-44f1-9b4d-7cf1b4b960e3'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-6fb5169d-f68f-44f1-9b4d-7cf1b4b960e3 None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aef340a63eac420b916f1faf294d92d9', 'request_id': 'req-6fb5169d-f68f-44f1-9b4d-7cf1b4b960e3'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-6fb5169d-f68f-44f1-9b4d-7cf1b4b960e3 None admin] The token cache is being invalidate because project aef340a63eac420b916f1faf294d92d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 12:59:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-6fb5169d-f68f-44f1-9b4d-7cf1b4b960e3 None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-6fb5169d-f68f-44f1-9b4d-7cf1b4b960e3 None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:58 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1344/2716] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 12:59:58 2024] DELETE /identity/v3/projects/aef340a63eac420b916f1faf294d92d9 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:59:58 l75lg1-v1 neutron-server[77618]: DEBUG neutron.wsgi [-] (77618) accepted ('10.27.203.238', 41320) {{(pid=77618) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 12:59:58 l75lg1-v1 neutron-server[77618]: INFO neutron.wsgi [None req-f35fb090-f3ab-4c7d-9035-945d9f70e067 None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=9ff04f236a21441e967d489f4f05af09&name=default HTTP/1.1" status: 200 len: 216 time: 0.0085464 May 28 12:59:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be78c28-087f-4df8-afb6-59db4013640d service neutron] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be78c28-087f-4df8-afb6-59db4013640d service neutron] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8818c5-5e91-4e2f-9602-af2b0e2dea8e None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8818c5-5e91-4e2f-9602-af2b0e2dea8e None admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8818c5-5e91-4e2f-9602-af2b0e2dea8e None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8818c5-5e91-4e2f-9602-af2b0e2dea8e None admin] PATH_INFO: `/v3/projects/9ff04f236a21441e967d489f4f05af09` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8818c5-5e91-4e2f-9602-af2b0e2dea8e None admin] RBAC: Authorizing `identity:delete_project(project_id=9ff04f236a21441e967d489f4f05af09)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8818c5-5e91-4e2f-9602-af2b0e2dea8e None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-5d8818c5-5e91-4e2f-9602-af2b0e2dea8e None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ff04f236a21441e967d489f4f05af09', 'request_id': 'req-5d8818c5-5e91-4e2f-9602-af2b0e2dea8e'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-5d8818c5-5e91-4e2f-9602-af2b0e2dea8e None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ff04f236a21441e967d489f4f05af09', 'request_id': 'req-5d8818c5-5e91-4e2f-9602-af2b0e2dea8e'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-5d8818c5-5e91-4e2f-9602-af2b0e2dea8e None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ff04f236a21441e967d489f4f05af09', 'request_id': 'req-5d8818c5-5e91-4e2f-9602-af2b0e2dea8e'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:58 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e3eff7f4-a815-42ba-b0d4-962e9668bb6d tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] <<< [PATCH] https://127.0.0.1:40443/api/viewpolicies/32/ May 28 12:59:58 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e3eff7f4-a815-42ba-b0d4-962e9668bb6d tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=1, created='2024-05-28T12:58:43.845440Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='31b6534b-d142-4561-992f-4f0759db302d', id=32, internal=False, is_s3_default_policy=False, name='7fdd602c-79d0-479c-95a2-336b202c6639', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=['*'], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=[], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=[], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='MODIFYING', sync_time='2024-05-28T12:59:57.930578Z', tenant_id=1, tenant_name='default', title='7fdd602c-79d0-479c-95a2-336b202c6639', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/32/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[]) May 28 12:59:58 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e3eff7f4-a815-42ba-b0d4-962e9668bb6d tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] --- [PATCH] https://127.0.0.1:40443/api/viewpolicies/32/: Done May 28 12:59:58 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-e3eff7f4-a815-42ba-b0d4-962e9668bb6d tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:58 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-e3eff7f4-a815-42ba-b0d4-962e9668bb6d tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-5d8818c5-5e91-4e2f-9602-af2b0e2dea8e None admin] The token cache is being invalidate because project 9ff04f236a21441e967d489f4f05af09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 12:59:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-5d8818c5-5e91-4e2f-9602-af2b0e2dea8e None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-5d8818c5-5e91-4e2f-9602-af2b0e2dea8e None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:58 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1373/2717] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 12:59:58 2024] DELETE /identity/v3/projects/9ff04f236a21441e967d489f4f05af09 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:59:58 l75lg1-v1 neutron-server[77618]: DEBUG neutron.wsgi [-] (77618) accepted ('10.27.203.238', 41322) {{(pid=77618) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 12:59:58 l75lg1-v1 neutron-server[77618]: INFO neutron.wsgi [None req-ce9c30f8-738f-4f0e-bb98-9cca63656517 None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=a9041f7c5fff43159545a43cdafa94d5&name=default HTTP/1.1" status: 200 len: 216 time: 0.0082734 May 28 12:59:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb5169d-f68f-44f1-9b4d-7cf1b4b960e3 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-6fb5169d-f68f-44f1-9b4d-7cf1b4b960e3 None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:59:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb5169d-f68f-44f1-9b4d-7cf1b4b960e3 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:58 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-e3eff7f4-a815-42ba-b0d4-962e9668bb6d tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.032s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:58 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-e3eff7f4-a815-42ba-b0d4-962e9668bb6d tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:58 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-e3eff7f4-a815-42ba-b0d4-962e9668bb6d tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5a0d2b-0a8a-4bba-b9af-fabdbe431653 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5a0d2b-0a8a-4bba-b9af-fabdbe431653 None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5a0d2b-0a8a-4bba-b9af-fabdbe431653 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5a0d2b-0a8a-4bba-b9af-fabdbe431653 None admin] PATH_INFO: `/v3/projects/a9041f7c5fff43159545a43cdafa94d5` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5a0d2b-0a8a-4bba-b9af-fabdbe431653 None admin] RBAC: Authorizing `identity:delete_project(project_id=a9041f7c5fff43159545a43cdafa94d5)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5a0d2b-0a8a-4bba-b9af-fabdbe431653 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:58 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-e3eff7f4-a815-42ba-b0d4-962e9668bb6d tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.032s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:58 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-e3eff7f4-a815-42ba-b0d4-962e9668bb6d tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:58 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-e3eff7f4-a815-42ba-b0d4-962e9668bb6d tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:58 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-e3eff7f4-a815-42ba-b0d4-962e9668bb6d tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.004s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:58 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-e3eff7f4-a815-42ba-b0d4-962e9668bb6d tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:58 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-e3eff7f4-a815-42ba-b0d4-962e9668bb6d tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:58 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-a38f9ce0-2bba-42fc-8878-28195a3aed60 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] GET http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/shares/b330db31-7766-443d-9c19-26fe349665aa May 28 12:59:58 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-a38f9ce0-2bba-42fc-8878-28195a3aed60 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:58 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-a38f9ce0-2bba-42fc-8878-28195a3aed60 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:58 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-e3eff7f4-a815-42ba-b0d4-962e9668bb6d tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.004s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:58 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-e3eff7f4-a815-42ba-b0d4-962e9668bb6d tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:58 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-e3eff7f4-a815-42ba-b0d4-962e9668bb6d tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:58 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-a38f9ce0-2bba-42fc-8878-28195a3aed60 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/shares/b330db31-7766-443d-9c19-26fe349665aa returned with HTTP 200 May 28 12:59:58 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 842/1657] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:59:58 2024] GET /share/v2/a4f3887fa28c457390f5b66615564430/shares/b330db31-7766-443d-9c19-26fe349665aa => generated 1316 bytes in 26 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:59:58 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 12:59:58 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.manager [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Cleaning up deleted instances with incomplete migration {{(pid=83654) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11264}} May 28 12:59:58 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Expecting reply to msg ddac3b4942504991b4c33237ace50318 in queue reply_37f4cbd1dd094961a22b8a65f222c327 May 28 12:59:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8818c5-5e91-4e2f-9602-af2b0e2dea8e None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-5d8818c5-5e91-4e2f-9602-af2b0e2dea8e None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:59:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-2f5a0d2b-0a8a-4bba-b9af-fabdbe431653 None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9041f7c5fff43159545a43cdafa94d5', 'request_id': 'req-2f5a0d2b-0a8a-4bba-b9af-fabdbe431653'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:58 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [-] Received RPC response for msg ddac3b4942504991b4c33237ace50318 May 28 12:59:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-2f5a0d2b-0a8a-4bba-b9af-fabdbe431653 None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9041f7c5fff43159545a43cdafa94d5', 'request_id': 'req-2f5a0d2b-0a8a-4bba-b9af-fabdbe431653'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-2f5a0d2b-0a8a-4bba-b9af-fabdbe431653 None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9041f7c5fff43159545a43cdafa94d5', 'request_id': 'req-2f5a0d2b-0a8a-4bba-b9af-fabdbe431653'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:58 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-e3eff7f4-a815-42ba-b0d4-962e9668bb6d tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.053s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:58 l75lg1-v1 manila-share[98474]: INFO manila.share.access [None req-e3eff7f4-a815-42ba-b0d4-962e9668bb6d tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Access rules were successfully modified for share instance 7fdd602c-79d0-479c-95a2-336b202c6639 belonging to share 72db8769-ece7-42ff-af27-2e778292a9b4. May 28 12:59:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-2f5a0d2b-0a8a-4bba-b9af-fabdbe431653 None admin] The token cache is being invalidate because project a9041f7c5fff43159545a43cdafa94d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 12:59:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-2f5a0d2b-0a8a-4bba-b9af-fabdbe431653 None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-2f5a0d2b-0a8a-4bba-b9af-fabdbe431653 None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 12:59:58 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1345/2718] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 12:59:58 2024] DELETE /identity/v3/projects/a9041f7c5fff43159545a43cdafa94d5 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:59:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8818c5-5e91-4e2f-9602-af2b0e2dea8e None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fede16-b0a1-4dee-bf3e-544b40173844 tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91af4223eb404925980daea7f7bde321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f353f66e6e00471aa584ea2e39c0ab0e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fede16-b0a1-4dee-bf3e-544b40173844 tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fede16-b0a1-4dee-bf3e-544b40173844 tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fede16-b0a1-4dee-bf3e-544b40173844 tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] PATH_INFO: `/v3/projects/a4f3887fa28c457390f5b66615564430` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fede16-b0a1-4dee-bf3e-544b40173844 tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] RBAC: Authorizing `identity:get_project(project_id=a4f3887fa28c457390f5b66615564430)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fede16-b0a1-4dee-bf3e-544b40173844 tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:58 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1374/2719] 10.27.203.238 () {62 vars in 1318 bytes} [Tue May 28 12:59:58 2024] GET /identity/v3/projects/a4f3887fa28c457390f5b66615564430 => generated 367 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:59:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5a0d2b-0a8a-4bba-b9af-fabdbe431653 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-2f5a0d2b-0a8a-4bba-b9af-fabdbe431653 None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 12:59:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5a0d2b-0a8a-4bba-b9af-fabdbe431653 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925b6d7b-da86-4649-af7a-9814e423799b tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91af4223eb404925980daea7f7bde321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f353f66e6e00471aa584ea2e39c0ab0e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925b6d7b-da86-4649-af7a-9814e423799b tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925b6d7b-da86-4649-af7a-9814e423799b tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925b6d7b-da86-4649-af7a-9814e423799b tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] PATH_INFO: `/v3/domains` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925b6d7b-da86-4649-af7a-9814e423799b tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 12:59:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925b6d7b-da86-4649-af7a-9814e423799b tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925b6d7b-da86-4649-af7a-9814e423799b tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:58 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1346/2720] 10.27.203.238 () {62 vars in 1241 bytes} [Tue May 28 12:59:58 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 12:59:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fede16-b0a1-4dee-bf3e-544b40173844 tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fede16-b0a1-4dee-bf3e-544b40173844 tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703db52a-94da-40fa-b335-e2a5b682c1eb tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91af4223eb404925980daea7f7bde321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f353f66e6e00471aa584ea2e39c0ab0e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703db52a-94da-40fa-b335-e2a5b682c1eb tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703db52a-94da-40fa-b335-e2a5b682c1eb tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703db52a-94da-40fa-b335-e2a5b682c1eb tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] PATH_INFO: `/v3/users` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703db52a-94da-40fa-b335-e2a5b682c1eb tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703db52a-94da-40fa-b335-e2a5b682c1eb tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:58 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-703db52a-94da-40fa-b335-e2a5b682c1eb tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] Truncating password to algorithm specific maximum length 72 characters. May 28 12:59:58 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1375/2721] 10.27.203.238 () {64 vars in 1232 bytes} [Tue May 28 12:59:58 2024] POST /identity/v3/users => generated 433 bytes in 34 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 12:59:58 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1adee421-ddbc-4654-8d24-e67ca3f3a79a tempest-ShareTransferNegativeTest-884271560 None] <<< [POST] https://127.0.0.1:40443/api/quotas/ May 28 12:59:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925b6d7b-da86-4649-af7a-9814e423799b tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:58 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1adee421-ddbc-4654-8d24-e67ca3f3a79a tempest-ShareTransferNegativeTest-884271560 None] Bunch(cluster='loop75-kfs', cluster_id=1, default_email=None, default_group_quota=None, default_user_quota=None, enable_alarms=True, enable_email_providers=True, grace_period=None, group_quotas=[], guid='c6d0bed5-e8ec-41bc-b76f-83d21586c9f3', hard_limit=1073741824, hard_limit_inodes=None, id=36, internal=False, is_user_quota=False, last_user_quotas_update=None, name='e89b90ae-d644-4b77-81a0-3d997b90fad0', num_blocked_users=0, num_exceeded_users=0, path='/manila/manila-e89b90ae-d644-4b77-81a0-3d997b90fad0', percent_capacity=0, percent_inodes=None, pretty_grace_period=None, pretty_grace_period_expiration=None, pretty_state='OK (CREATED)', soft_limit=None, soft_limit_inodes=None, state='OK', sync_state='CREATED', system_id=36, tenant_id=1, tenant_name='default', time_to_block=None, title='e89b90ae-d644-4b77-81a0-3d997b90fad0', url='https://127.0.0.1:40443/api/quotas/36/', used_capacity=0, used_capacity_tb=0.0, used_effective_capacity=0, used_effective_capacity_tb=0.0, used_inodes=0, used_limited_capacity=0, user_quotas=[]) May 28 12:59:58 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1adee421-ddbc-4654-8d24-e67ca3f3a79a tempest-ShareTransferNegativeTest-884271560 None] --- [POST] https://127.0.0.1:40443/api/quotas/: Done May 28 12:59:58 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1adee421-ddbc-4654-8d24-e67ca3f3a79a tempest-ShareTransferNegativeTest-884271560 None] >>> [GET] https://127.0.0.1:40443/api/views/ May 28 12:59:58 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1adee421-ddbc-4654-8d24-e67ca3f3a79a tempest-ShareTransferNegativeTest-884271560 None] {'allow_redirects': True, May 28 12:59:58 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1adee421-ddbc-4654-8d24-e67ca3f3a79a tempest-ShareTransferNegativeTest-884271560 None] 'params': {'name': 'e89b90ae-d644-4b77-81a0-3d997b90fad0'}} May 28 12:59:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925b6d7b-da86-4649-af7a-9814e423799b tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331035e4-b26d-4fe4-8ea0-5e284ce35292 tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91af4223eb404925980daea7f7bde321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f353f66e6e00471aa584ea2e39c0ab0e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331035e4-b26d-4fe4-8ea0-5e284ce35292 tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331035e4-b26d-4fe4-8ea0-5e284ce35292 tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331035e4-b26d-4fe4-8ea0-5e284ce35292 tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] PATH_INFO: `/v3/roles` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331035e4-b26d-4fe4-8ea0-5e284ce35292 tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331035e4-b26d-4fe4-8ea0-5e284ce35292 tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:58 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1347/2722] 10.27.203.238 () {62 vars in 1210 bytes} [Tue May 28 12:59:58 2024] GET /identity/v3/roles => generated 1680 bytes in 17 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 12:59:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703db52a-94da-40fa-b335-e2a5b682c1eb tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 12:59:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703db52a-94da-40fa-b335-e2a5b682c1eb tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 12:59:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea507e33-a492-4651-9dc3-6d1d89295855 tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91af4223eb404925980daea7f7bde321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f353f66e6e00471aa584ea2e39c0ab0e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 12:59:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea507e33-a492-4651-9dc3-6d1d89295855 tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] REQUEST_METHOD: `PUT` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 12:59:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea507e33-a492-4651-9dc3-6d1d89295855 tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 12:59:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea507e33-a492-4651-9dc3-6d1d89295855 tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] PATH_INFO: `/v3/projects/a4f3887fa28c457390f5b66615564430/users/cdf8594f55cb448e9b2312d051486331/roles/44620cad10ae407c90c91e2c296adb04` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 12:59:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea507e33-a492-4651-9dc3-6d1d89295855 tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] RBAC: Authorizing `identity:create_grant(project_id=a4f3887fa28c457390f5b66615564430, user_id=cdf8594f55cb448e9b2312d051486331, role_id=44620cad10ae407c90c91e2c296adb04)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 12:59:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea507e33-a492-4651-9dc3-6d1d89295855 tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 12:59:58 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1376/2723] 10.27.203.238 () {64 vars in 1571 bytes} [Tue May 28 12:59:58 2024] PUT /identity/v3/projects/a4f3887fa28c457390f5b66615564430/users/cdf8594f55cb448e9b2312d051486331/roles/44620cad10ae407c90c91e2c296adb04 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 12:59:58 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-a0afd0ae-de57-414c-b9ae-a2ebd5f83eee tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] POST http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/shares May 28 12:59:58 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-a0afd0ae-de57-414c-b9ae-a2ebd5f83eee tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share": {"share_proto": "nfs", "description": "Tempest's share", "snapshot_id": null, "name": "tempest-tempest-created-share-462150732", "size": 1, "metadata": {}, "is_public": false, "share_type": "1749967d-80e1-4d76-8cac-122e8902d0cd"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:59:58 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.v1.shares [None req-a0afd0ae-de57-414c-b9ae-a2ebd5f83eee tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Create NFS share of 1 GB May 28 12:59:58 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.quota [None req-a0afd0ae-de57-414c-b9ae-a2ebd5f83eee tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Created reservations ['8e90adf1-7281-4d58-91d9-769f8dae65bb', '7ec7e003-2e81-4516-8cce-004f9a734a4b', '815d2f5a-7bc6-4913-adf0-869bd4ba1ca8', '46f32c74-3f35-4f11-91e5-923d043227d0'] {{(pid=98330) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 12:59:58 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-c98e821b-94d6-4cb8-bb1a-2a60428242a3 tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] GET http://10.27.203.238/share/v2/cac556dc39a14bbdbdbabfc80672fb1f/shares/bd070603-3332-4a76-a743-411df92ace16 May 28 12:59:58 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-c98e821b-94d6-4cb8-bb1a-2a60428242a3 tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:58 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-c98e821b-94d6-4cb8-bb1a-2a60428242a3 tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:58 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-c98e821b-94d6-4cb8-bb1a-2a60428242a3 tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] http://10.27.203.238/share/v2/cac556dc39a14bbdbdbabfc80672fb1f/shares/bd070603-3332-4a76-a743-411df92ace16 returned with HTTP 200 May 28 12:59:58 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 843/1658] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:59:58 2024] GET /share/v2/cac556dc39a14bbdbdbabfc80672fb1f/shares/bd070603-3332-4a76-a743-411df92ace16 => generated 1313 bytes in 25 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:59:58 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.quota [None req-a0afd0ae-de57-414c-b9ae-a2ebd5f83eee tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Committed reservations ['8e90adf1-7281-4d58-91d9-769f8dae65bb', '7ec7e003-2e81-4516-8cce-004f9a734a4b', '815d2f5a-7bc6-4913-adf0-869bd4ba1ca8', '46f32c74-3f35-4f11-91e5-923d043227d0'] {{(pid=98330) commit /opt/stack/manila/manila/quota.py:1063}} May 28 12:59:58 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.host_manager [None req-a0afd0ae-de57-414c-b9ae-a2ebd5f83eee tempest-ShareRulesTest-1530341375 None] Share service is down. (host: l75lg1-v1@generic2). May 28 12:59:58 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.host_manager [None req-a0afd0ae-de57-414c-b9ae-a2ebd5f83eee tempest-ShareRulesTest-1530341375 None] Share service is down. (host: l75lg1-v1@generic1). May 28 12:59:58 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-a0afd0ae-de57-414c-b9ae-a2ebd5f83eee tempest-ShareRulesTest-1530341375 None] Starting with 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:80}} May 28 12:59:58 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-a0afd0ae-de57-414c-b9ae-a2ebd5f83eee tempest-ShareRulesTest-1530341375 None] Filter OnlyHostFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:59:58 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-a0afd0ae-de57-414c-b9ae-a2ebd5f83eee tempest-ShareRulesTest-1530341375 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:59:58 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.capacity [None req-a0afd0ae-de57-414c-b9ae-a2ebd5f83eee tempest-ShareRulesTest-1530341375 None] Space information for share creation on host l75lg1-v1@vast#vast (requested / avail): 1/2080 {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/capacity.py:83}} May 28 12:59:58 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-a0afd0ae-de57-414c-b9ae-a2ebd5f83eee tempest-ShareRulesTest-1530341375 None] Filter CapacityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:59:58 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-a0afd0ae-de57-414c-b9ae-a2ebd5f83eee tempest-ShareRulesTest-1530341375 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:59:58 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-a0afd0ae-de57-414c-b9ae-a2ebd5f83eee tempest-ShareRulesTest-1530341375 None] Driver Filter: Checking host 'l75lg1-v1@vast#vast' {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:37}} May 28 12:59:58 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-a0afd0ae-de57-414c-b9ae-a2ebd5f83eee tempest-ShareRulesTest-1530341375 None] Filter function not set :: passing host. {{(pid=98327) _check_filter_function /opt/stack/manila/manila/scheduler/filters/driver.py:53}} May 28 12:59:58 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-a0afd0ae-de57-414c-b9ae-a2ebd5f83eee tempest-ShareRulesTest-1530341375 None] Result: True {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:40}} May 28 12:59:58 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-a0afd0ae-de57-414c-b9ae-a2ebd5f83eee tempest-ShareRulesTest-1530341375 None] Done checking host 'l75lg1-v1@vast#vast' {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:41}} May 28 12:59:58 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-a0afd0ae-de57-414c-b9ae-a2ebd5f83eee tempest-ShareRulesTest-1530341375 None] Filter DriverFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:59:58 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-a0afd0ae-de57-414c-b9ae-a2ebd5f83eee tempest-ShareRulesTest-1530341375 None] Filter ShareReplicationFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:59:58 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-a0afd0ae-de57-414c-b9ae-a2ebd5f83eee tempest-ShareRulesTest-1530341375 None] Filter CreateFromSnapshotFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:59:58 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-a0afd0ae-de57-414c-b9ae-a2ebd5f83eee tempest-ShareRulesTest-1530341375 None] Filter AffinityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:59:58 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-a0afd0ae-de57-414c-b9ae-a2ebd5f83eee tempest-ShareRulesTest-1530341375 None] Filter AntiAffinityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 12:59:58 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.drivers.filter [None req-a0afd0ae-de57-414c-b9ae-a2ebd5f83eee tempest-ShareRulesTest-1530341375 None] Filtered share [host: 'l75lg1-v1@vast#vast', free_capacity_gb: 2080.6478263456374, pools: None] {{(pid=98327) _schedule_share /opt/stack/manila/manila/scheduler/drivers/filter.py:268}} May 28 12:59:58 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-a0afd0ae-de57-414c-b9ae-a2ebd5f83eee tempest-ShareRulesTest-1530341375 None] Checking host 'l75lg1-v1@vast#vast' {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:46}} May 28 12:59:58 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.weighers.goodness [None req-a0afd0ae-de57-414c-b9ae-a2ebd5f83eee tempest-ShareRulesTest-1530341375 None] Goodness function not set :: defaulting to minimal goodness rating of 0. May 28 12:59:58 l75lg1-v1 manila-scheduler[98327]: INFO manila.scheduler.weighers.goodness [None req-a0afd0ae-de57-414c-b9ae-a2ebd5f83eee tempest-ShareRulesTest-1530341375 None] Goodness function result for host l75lg1-v1@vast#vast: 0. May 28 12:59:58 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-a0afd0ae-de57-414c-b9ae-a2ebd5f83eee tempest-ShareRulesTest-1530341375 None] Goodness: 0 {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:48}} May 28 12:59:58 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-a0afd0ae-de57-414c-b9ae-a2ebd5f83eee tempest-ShareRulesTest-1530341375 None] Done checking host 'l75lg1-v1@vast#vast' {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:49}} May 28 12:59:58 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.drivers.filter [None req-a0afd0ae-de57-414c-b9ae-a2ebd5f83eee tempest-ShareRulesTest-1530341375 None] Choosing for share: WeighedHost [host: l75lg1-v1@vast#vast, weight: 0.0] {{(pid=98327) _schedule_share /opt/stack/manila/manila/scheduler/drivers/filter.py:274}} May 28 12:59:58 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-a0afd0ae-de57-414c-b9ae-a2ebd5f83eee tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/shares returned with HTTP 200 May 28 12:59:58 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 816/1659] 10.27.203.238 () {66 vars in 1362 bytes} [Tue May 28 12:59:58 2024] POST /share/v2/a4f3887fa28c457390f5b66615564430/shares => generated 1311 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:59:59 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-75e51913-104f-4b43-8e76-819f90db6181 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] GET http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/shares/510f7bcd-a0ee-49a6-8093-2640036f2ca3 May 28 12:59:59 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-75e51913-104f-4b43-8e76-819f90db6181 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:59 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-75e51913-104f-4b43-8e76-819f90db6181 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:59 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-75e51913-104f-4b43-8e76-819f90db6181 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/shares/510f7bcd-a0ee-49a6-8093-2640036f2ca3 returned with HTTP 200 May 28 12:59:59 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 844/1660] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 12:59:58 2024] GET /share/v2/a4f3887fa28c457390f5b66615564430/shares/510f7bcd-a0ee-49a6-8093-2640036f2ca3 => generated 1311 bytes in 26 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:59:59 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a0afd0ae-de57-414c-b9ae-a2ebd5f83eee tempest-ShareRulesTest-1530341375 None] >>> [GET] https://127.0.0.1:40443/api/vippools/ May 28 12:59:59 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a0afd0ae-de57-414c-b9ae-a2ebd5f83eee tempest-ShareRulesTest-1530341375 None] {'allow_redirects': True, 'params': {'name': 'vippool-1'}} May 28 12:59:59 l75lg1-v1 dstat.sh[49771]: 28-05 12:59:59| 13 2 83 2 0|5679M 1778M 278M 7890M| 15k 5551B| 0 2913k| 0 361 |7649 13k|1.21 1.08 1.02|1.0 1.0 0| 0 0 | 0 2048M| 29 361 0 49 2 May 28 12:59:59 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1adee421-ddbc-4654-8d24-e67ca3f3a79a tempest-ShareTransferNegativeTest-884271560 None] <<< [GET] https://127.0.0.1:40443/api/views/ May 28 12:59:59 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1adee421-ddbc-4654-8d24-e67ca3f3a79a tempest-ShareTransferNegativeTest-884271560 None] [] May 28 12:59:59 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1adee421-ddbc-4654-8d24-e67ca3f3a79a tempest-ShareTransferNegativeTest-884271560 None] --- [GET] https://127.0.0.1:40443/api/views/: Done May 28 12:59:59 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1adee421-ddbc-4654-8d24-e67ca3f3a79a tempest-ShareTransferNegativeTest-884271560 None] >>> [POST] https://127.0.0.1:40443/api/views/ May 28 12:59:59 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1adee421-ddbc-4654-8d24-e67ca3f3a79a tempest-ShareTransferNegativeTest-884271560 None] {'data': '{"name": "e89b90ae-d644-4b77-81a0-3d997b90fad0", "path": ' May 28 12:59:59 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1adee421-ddbc-4654-8d24-e67ca3f3a79a tempest-ShareTransferNegativeTest-884271560 None] '"/manila/manila-e89b90ae-d644-4b77-81a0-3d997b90fad0", "policy_id": ' May 28 12:59:59 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1adee421-ddbc-4654-8d24-e67ca3f3a79a tempest-ShareTransferNegativeTest-884271560 None] '39, "create_dir": true, "protocols": ["NFS"]}', May 28 12:59:59 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1adee421-ddbc-4654-8d24-e67ca3f3a79a tempest-ShareTransferNegativeTest-884271560 None] 'json': None, May 28 12:59:59 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1adee421-ddbc-4654-8d24-e67ca3f3a79a tempest-ShareTransferNegativeTest-884271560 None] 'params': None} May 28 12:59:59 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-ddc10c47-2658-4ecf-a4b4-1a7e3d9f525e tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] GET http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/share-access-rules?share_id=72db8769-ece7-42ff-af27-2e778292a9b4 May 28 12:59:59 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-ddc10c47-2658-4ecf-a4b4-1a7e3d9f525e tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:59 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-ddc10c47-2658-4ecf-a4b4-1a7e3d9f525e tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:59 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a0afd0ae-de57-414c-b9ae-a2ebd5f83eee tempest-ShareRulesTest-1530341375 None] <<< [GET] https://127.0.0.1:40443/api/vippools/ May 28 12:59:59 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a0afd0ae-de57-414c-b9ae-a2ebd5f83eee tempest-ShareRulesTest-1530341375 None] [Bunch(active_cnode_ids=[], active_interfaces=4, cluster='loop75-kfs', cluster_id=1, cnode_ids=[], cnodes=[], domain_name='vippool-1', enable_l3=False, enable_weighted_balancing=False, enabled=True, end_ip='172.21.75.4', guid='f2abaede-b397-413a-8faa-3aeead6d3b28', gw_ip='', gw_ipv6='', id=2, ip_ranges=[['172.21.75.1', '172.21.75.4']], name='vippool-1', peer_asn=0, port_membership='ALL', ranges_summary='172.21.75.[1-4]', role='PROTOCOLS', start_ip='172.21.75.1', subnet_cidr=16, subnet_cidr_ipv6=None, sync='SYNCED', sync_time='2024-05-28T12:50:09.644123Z', tenant_id=1, tenant_name='default', title='172.21.75.1 - 172.21.75.4', url='https://127.0.0.1:40443/api/vippools/2/', vast_asn=0, vlan=0, vms_preferred=False)] May 28 12:59:59 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a0afd0ae-de57-414c-b9ae-a2ebd5f83eee tempest-ShareRulesTest-1530341375 None] --- [GET] https://127.0.0.1:40443/api/vippools/: Done May 28 12:59:59 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a0afd0ae-de57-414c-b9ae-a2ebd5f83eee tempest-ShareRulesTest-1530341375 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:59:59 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a0afd0ae-de57-414c-b9ae-a2ebd5f83eee tempest-ShareRulesTest-1530341375 None] {'allow_redirects': True, May 28 12:59:59 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a0afd0ae-de57-414c-b9ae-a2ebd5f83eee tempest-ShareRulesTest-1530341375 None] 'params': {'name': 'ee46a1d1-f743-461e-8bb5-467ee0e99edd'}} May 28 12:59:59 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-2aaaa434-59ea-430a-a012-6cdea1b49aac tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] GET http://10.27.203.238/share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/messages May 28 12:59:59 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-ddc10c47-2658-4ecf-a4b4-1a7e3d9f525e tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/share-access-rules?share_id=72db8769-ece7-42ff-af27-2e778292a9b4 returned with HTTP 200 May 28 12:59:59 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-2aaaa434-59ea-430a-a012-6cdea1b49aac tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:59 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-2aaaa434-59ea-430a-a012-6cdea1b49aac tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:59 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 817/1661] 10.27.203.238 () {64 vars in 1467 bytes} [Tue May 28 12:59:59 2024] GET /share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/share-access-rules?share_id=72db8769-ece7-42ff-af27-2e778292a9b4 => generated 19 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 12:59:59 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.message.api [None req-2aaaa434-59ea-430a-a012-6cdea1b49aac tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Searching for messages by: MultiDict([]) {{(pid=98329) get_all /opt/stack/manila/manila/message/api.py:78}} May 28 12:59:59 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-2aaaa434-59ea-430a-a012-6cdea1b49aac tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] http://10.27.203.238/share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/messages returned with HTTP 200 May 28 12:59:59 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 845/1662] 10.27.203.238 () {64 vars in 1346 bytes} [Tue May 28 12:59:59 2024] GET /share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/messages => generated 7223 bytes in 12 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 12:59:59 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-c600b7a8-9cbf-4b7b-80c7-e1c7c3749a0b tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] POST http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action May 28 12:59:59 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-c600b7a8-9cbf-4b7b-80c7-e1c7c3749a0b tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Action body: b'{"allow_access": {"access_type": "ip", "access_to": "203.0.113.166", "access_level": "rw", "lock_visibility": true, "lock_deletion": true}}' {{(pid=98330) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 12:59:59 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-c600b7a8-9cbf-4b7b-80c7-e1c7c3749a0b tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Action: 'action', calling method: ShareController.allow_access, body: {"allow_access": {"access_type": "ip", "access_to": "203.0.113.166", "access_level": "rw", "lock_visibility": true, "lock_deletion": true}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:59:59 l75lg1-v1 neutron-server[77623]: DEBUG dbcounter [-] [77623] Writing DB stats neutron:SELECT=3 {{(pid=77623) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 12:59:59 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-302f7d91-dafb-4f87-9b08-a84d72e75b01 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] GET http://10.27.203.238/share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/messages?created_since=2024-05-28+12%3A59%3A48.996277 May 28 12:59:59 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-302f7d91-dafb-4f87-9b08-a84d72e75b01 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:59 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-302f7d91-dafb-4f87-9b08-a84d72e75b01 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:59 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.message.api [None req-302f7d91-dafb-4f87-9b08-a84d72e75b01 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Searching for messages by: MultiDict([('created_since', datetime.datetime(2024, 5, 28, 12, 59, 48, 996277, tzinfo=datetime.timezone.utc))]) {{(pid=98329) get_all /opt/stack/manila/manila/message/api.py:78}} May 28 12:59:59 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-302f7d91-dafb-4f87-9b08-a84d72e75b01 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] http://10.27.203.238/share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/messages?created_since=2024-05-28+12%3A59%3A48.996277 returned with HTTP 200 May 28 12:59:59 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 846/1663] 10.27.203.238 () {64 vars in 1435 bytes} [Tue May 28 12:59:59 2024] GET /share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/messages?created_since=2024-05-28+12%3A59%3A48.996277 => generated 1616 bytes in 11 msecs (HTTP/1.1 200) 6 headers in 232 bytes (2 switches on core 0) May 28 12:59:59 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-d0725c5d-8aae-4f95-969c-d0ea0afd2c65 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] GET http://10.27.203.238/share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/messages?created_since=2024-05-28+12%3A59%3A48.996277&created_before=2024-05-28+12%3A59%3A55.355229 May 28 12:59:59 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-d0725c5d-8aae-4f95-969c-d0ea0afd2c65 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:59 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-d0725c5d-8aae-4f95-969c-d0ea0afd2c65 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:59 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.message.api [None req-d0725c5d-8aae-4f95-969c-d0ea0afd2c65 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Searching for messages by: MultiDict([('created_since', datetime.datetime(2024, 5, 28, 12, 59, 48, 996277, tzinfo=datetime.timezone.utc)), ('created_before', datetime.datetime(2024, 5, 28, 12, 59, 55, 355229, tzinfo=datetime.timezone.utc))]) {{(pid=98329) get_all /opt/stack/manila/manila/message/api.py:78}} May 28 12:59:59 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-d0725c5d-8aae-4f95-969c-d0ea0afd2c65 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] http://10.27.203.238/share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/messages?created_since=2024-05-28+12%3A59%3A48.996277&created_before=2024-05-28+12%3A59%3A55.355229 returned with HTTP 200 May 28 12:59:59 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 847/1664] 10.27.203.238 () {64 vars in 1527 bytes} [Tue May 28 12:59:59 2024] GET /share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/messages?created_since=2024-05-28+12%3A59%3A48.996277&created_before=2024-05-28+12%3A59%3A55.355229 => generated 815 bytes in 11 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:59:59 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-089d6b76-a7e3-4ad9-81d2-b3af901a5c57 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] GET http://10.27.203.238/share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/messages?created_before=2024-05-28+12%3A59%3A55.355229 May 28 12:59:59 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-089d6b76-a7e3-4ad9-81d2-b3af901a5c57 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:59 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-089d6b76-a7e3-4ad9-81d2-b3af901a5c57 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:59 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.message.api [None req-089d6b76-a7e3-4ad9-81d2-b3af901a5c57 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Searching for messages by: MultiDict([('created_before', datetime.datetime(2024, 5, 28, 12, 59, 55, 355229, tzinfo=datetime.timezone.utc))]) {{(pid=98329) get_all /opt/stack/manila/manila/message/api.py:78}} May 28 12:59:59 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-089d6b76-a7e3-4ad9-81d2-b3af901a5c57 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] http://10.27.203.238/share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/messages?created_before=2024-05-28+12%3A59%3A55.355229 returned with HTTP 200 May 28 12:59:59 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 848/1665] 10.27.203.238 () {64 vars in 1437 bytes} [Tue May 28 12:59:59 2024] GET /share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/messages?created_before=2024-05-28+12%3A59%3A55.355229 => generated 6422 bytes in 15 msecs (HTTP/1.1 200) 6 headers in 232 bytes (2 switches on core 0) May 28 12:59:59 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-e9f9ad3c-47d7-4b65-89a9-9ce2796a235f tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] DELETE http://10.27.203.238/share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/shares/8d55f5b5-0397-4cf5-ae7e-437e2de600d2 May 28 12:59:59 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-e9f9ad3c-47d7-4b65-89a9-9ce2796a235f tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:59 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-e9f9ad3c-47d7-4b65-89a9-9ce2796a235f tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Calling method 'ShareMixin.delete' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:59 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.v1.shares [None req-e9f9ad3c-47d7-4b65-89a9-9ce2796a235f tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Delete share with id: 8d55f5b5-0397-4cf5-ae7e-437e2de600d2 May 28 12:59:59 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-c600b7a8-9cbf-4b7b-80c7-e1c7c3749a0b tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:59 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-c600b7a8-9cbf-4b7b-80c7-e1c7c3749a0b tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:59 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-c600b7a8-9cbf-4b7b-80c7-e1c7c3749a0b tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.041s {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:59 l75lg1-v1 manila-share[98474]: DEBUG manila.share.manager [None req-c600b7a8-9cbf-4b7b-80c7-e1c7c3749a0b tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Received request to update access for share instance 7fdd602c-79d0-479c-95a2-336b202c6639. {{(pid=98474) update_access_for_instances /opt/stack/manila/manila/share/manager.py:4353}} May 28 12:59:59 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-c600b7a8-9cbf-4b7b-80c7-e1c7c3749a0b tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action returned with HTTP 200 May 28 12:59:59 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 818/1666] 10.27.203.238 () {66 vars in 1494 bytes} [Tue May 28 12:59:59 2024] POST /share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action => generated 311 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:59:59 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-22bba8fb-71e5-4123-adf0-69b8f2c36760 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] GET http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/share-access-rules?share_id=72db8769-ece7-42ff-af27-2e778292a9b4 May 28 12:59:59 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-22bba8fb-71e5-4123-adf0-69b8f2c36760 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:59 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-22bba8fb-71e5-4123-adf0-69b8f2c36760 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:59 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c600b7a8-9cbf-4b7b-80c7-e1c7c3749a0b tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:59 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c600b7a8-9cbf-4b7b-80c7-e1c7c3749a0b tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:59 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c600b7a8-9cbf-4b7b-80c7-e1c7c3749a0b tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.004s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:59 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c600b7a8-9cbf-4b7b-80c7-e1c7c3749a0b tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:59 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c600b7a8-9cbf-4b7b-80c7-e1c7c3749a0b tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:59 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.lock.api [None req-22bba8fb-71e5-4123-adf0-69b8f2c36760 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Searching for locks by: {'resource_id': 'bcc00ae5-e7de-4e35-b5a6-3e24eaf91e0e', 'resource_action': 'show', 'resource_type': 'access_rule'} {{(pid=98330) get_all /opt/stack/manila/manila/lock/api.py:112}} May 28 12:59:59 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-22bba8fb-71e5-4123-adf0-69b8f2c36760 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/share-access-rules?share_id=72db8769-ece7-42ff-af27-2e778292a9b4 returned with HTTP 200 May 28 12:59:59 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 819/1667] 10.27.203.238 () {64 vars in 1467 bytes} [Tue May 28 12:59:59 2024] GET /share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/share-access-rules?share_id=72db8769-ece7-42ff-af27-2e778292a9b4 => generated 266 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:59:59 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.quota [None req-e9f9ad3c-47d7-4b65-89a9-9ce2796a235f tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Created reservations ['f5cd009f-796e-4f0f-87a6-47f4f74f7683', '3e732c72-29b1-4eb4-b78c-011c22f3cd91', 'fa384778-ed8b-46b3-a3b6-251375d5439f', '86fd6039-c11b-4f4f-8e0b-2b4d5a55209c'] {{(pid=98329) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 12:59:59 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c600b7a8-9cbf-4b7b-80c7-e1c7c3749a0b tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.062s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:59 l75lg1-v1 manila-share[98474]: DEBUG manila.share.access [None req-c600b7a8-9cbf-4b7b-80c7-e1c7c3749a0b tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Updating access rules for share instance 7fdd602c-79d0-479c-95a2-336b202c6639 belonging to share 72db8769-ece7-42ff-af27-2e778292a9b4. {{(pid=98474) update_access_rules /opt/stack/manila/manila/share/access.py:298}} May 28 12:59:59 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.quota [None req-e9f9ad3c-47d7-4b65-89a9-9ce2796a235f tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Committed reservations ['f5cd009f-796e-4f0f-87a6-47f4f74f7683', '3e732c72-29b1-4eb4-b78c-011c22f3cd91', 'fa384778-ed8b-46b3-a3b6-251375d5439f', '86fd6039-c11b-4f4f-8e0b-2b4d5a55209c'] {{(pid=98329) commit /opt/stack/manila/manila/quota.py:1063}} May 28 12:59:59 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c600b7a8-9cbf-4b7b-80c7-e1c7c3749a0b tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:59 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c600b7a8-9cbf-4b7b-80c7-e1c7c3749a0b tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:59 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c600b7a8-9cbf-4b7b-80c7-e1c7c3749a0b tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.007s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:59 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c600b7a8-9cbf-4b7b-80c7-e1c7c3749a0b tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 12:59:59 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-e9f9ad3c-47d7-4b65-89a9-9ce2796a235f tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] http://10.27.203.238/share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/shares/8d55f5b5-0397-4cf5-ae7e-437e2de600d2 returned with HTTP 202 May 28 12:59:59 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c600b7a8-9cbf-4b7b-80c7-e1c7c3749a0b tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 12:59:59 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 849/1668] 10.27.203.238 () {64 vars in 1454 bytes} [Tue May 28 12:59:59 2024] DELETE /share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/shares/8d55f5b5-0397-4cf5-ae7e-437e2de600d2 => generated 0 bytes in 214 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:59:59 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-672fbaca-dffb-4ff9-a69a-b0a0fee76496 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] DELETE http://10.27.203.238/share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/shares/6bf55297-267e-4c0f-8a15-10257c79ab6a May 28 12:59:59 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-672fbaca-dffb-4ff9-a69a-b0a0fee76496 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 12:59:59 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-672fbaca-dffb-4ff9-a69a-b0a0fee76496 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Calling method 'ShareMixin.delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 12:59:59 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.v1.shares [None req-672fbaca-dffb-4ff9-a69a-b0a0fee76496 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Delete share with id: 6bf55297-267e-4c0f-8a15-10257c79ab6a May 28 12:59:59 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c600b7a8-9cbf-4b7b-80c7-e1c7c3749a0b tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.015s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 12:59:59 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-c600b7a8-9cbf-4b7b-80c7-e1c7c3749a0b tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] changing access on None May 28 12:59:59 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c600b7a8-9cbf-4b7b-80c7-e1c7c3749a0b tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:59:59 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c600b7a8-9cbf-4b7b-80c7-e1c7c3749a0b tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] {'allow_redirects': True, May 28 12:59:59 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c600b7a8-9cbf-4b7b-80c7-e1c7c3749a0b tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] 'params': {'name': '7fdd602c-79d0-479c-95a2-336b202c6639'}} May 28 12:59:59 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.quota [None req-672fbaca-dffb-4ff9-a69a-b0a0fee76496 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Created reservations ['11c5955c-9bcc-4e8b-8946-1544462bab39', '5085f3e2-b44a-46c2-9630-fc848c41f706', 'f8f41b52-b6f5-4bd0-bc59-fad4b4bb5329', 'd4ee8c6c-d567-473b-8c82-b5d42caa74b4'] {{(pid=98330) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 12:59:59 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.quota [None req-672fbaca-dffb-4ff9-a69a-b0a0fee76496 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Committed reservations ['11c5955c-9bcc-4e8b-8946-1544462bab39', '5085f3e2-b44a-46c2-9630-fc848c41f706', 'f8f41b52-b6f5-4bd0-bc59-fad4b4bb5329', 'd4ee8c6c-d567-473b-8c82-b5d42caa74b4'] {{(pid=98330) commit /opt/stack/manila/manila/quota.py:1063}} May 28 12:59:59 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-672fbaca-dffb-4ff9-a69a-b0a0fee76496 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] http://10.27.203.238/share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/shares/6bf55297-267e-4c0f-8a15-10257c79ab6a returned with HTTP 202 May 28 12:59:59 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 820/1669] 10.27.203.238 () {64 vars in 1454 bytes} [Tue May 28 12:59:59 2024] DELETE /share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/shares/6bf55297-267e-4c0f-8a15-10257c79ab6a => generated 0 bytes in 241 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 12:59:59 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-7892e0c3-551b-46f7-844f-c0e720a8490a tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] POST http://10.27.203.238/share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/types May 28 12:59:59 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-7892e0c3-551b-46f7-844f-c0e720a8490a tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share_type": {"name": "tempest-share-type-680925725", "extra_specs": {"driver_handles_share_servers": false, "vendor_name": "foobar"}, "share_type_access:is_public": true}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:59:59 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-7892e0c3-551b-46f7-844f-c0e720a8490a tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] http://10.27.203.238/share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/types returned with HTTP 200 May 28 12:59:59 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 850/1670] 10.27.203.238 () {66 vars in 1359 bytes} [Tue May 28 12:59:59 2024] POST /share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/types => generated 659 bytes in 25 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 12:59:59 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-780f9966-3473-4758-b825-88b2719633cb tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] POST http://10.27.203.238/share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/shares May 28 12:59:59 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a0afd0ae-de57-414c-b9ae-a2ebd5f83eee tempest-ShareRulesTest-1530341375 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:59:59 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a0afd0ae-de57-414c-b9ae-a2ebd5f83eee tempest-ShareRulesTest-1530341375 None] [] May 28 12:59:59 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a0afd0ae-de57-414c-b9ae-a2ebd5f83eee tempest-ShareRulesTest-1530341375 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 12:59:59 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-780f9966-3473-4758-b825-88b2719633cb tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share": {"share_proto": "nfs", "description": "tempest-tempest-created-share-desc-1649700310", "snapshot_id": null, "name": "tempest-tempest-created-share-155764801", "size": 1, "metadata": {}, "is_public": false, "share_type": "5c6c7e5a-307f-4a6d-b824-a061f86076f2"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 12:59:59 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a0afd0ae-de57-414c-b9ae-a2ebd5f83eee tempest-ShareRulesTest-1530341375 None] >>> [POST] https://127.0.0.1:40443/api/viewpolicies/ May 28 12:59:59 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a0afd0ae-de57-414c-b9ae-a2ebd5f83eee tempest-ShareRulesTest-1530341375 None] {'data': '{"name": "ee46a1d1-f743-461e-8bb5-467ee0e99edd"}', May 28 12:59:59 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a0afd0ae-de57-414c-b9ae-a2ebd5f83eee tempest-ShareRulesTest-1530341375 None] 'json': None, May 28 12:59:59 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a0afd0ae-de57-414c-b9ae-a2ebd5f83eee tempest-ShareRulesTest-1530341375 None] 'params': None} May 28 12:59:59 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.v1.shares [None req-780f9966-3473-4758-b825-88b2719633cb tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Create NFS share of 1 GB May 28 13:00:00 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.quota [None req-780f9966-3473-4758-b825-88b2719633cb tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Created reservations ['b819ceb7-befb-4c66-b3a6-f2824417cba3', '1efdcd03-8f9f-4b56-b3ca-bb9f6a7b2cf2', '053fad78-9a4c-4258-b32d-d69d483c9570', '08d2b9db-fef6-4425-88f4-ce8500aff423'] {{(pid=98330) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 13:00:00 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.quota [None req-780f9966-3473-4758-b825-88b2719633cb tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Committed reservations ['b819ceb7-befb-4c66-b3a6-f2824417cba3', '1efdcd03-8f9f-4b56-b3ca-bb9f6a7b2cf2', '053fad78-9a4c-4258-b32d-d69d483c9570', '08d2b9db-fef6-4425-88f4-ce8500aff423'] {{(pid=98330) commit /opt/stack/manila/manila/quota.py:1063}} May 28 13:00:00 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.host_manager [None req-780f9966-3473-4758-b825-88b2719633cb tempest-UserMessageTest-1084663522 None] Share service is down. (host: l75lg1-v1@generic2). May 28 13:00:00 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.host_manager [None req-780f9966-3473-4758-b825-88b2719633cb tempest-UserMessageTest-1084663522 None] Share service is down. (host: l75lg1-v1@generic1). May 28 13:00:00 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-780f9966-3473-4758-b825-88b2719633cb tempest-UserMessageTest-1084663522 None] Starting with 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:80}} May 28 13:00:00 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-780f9966-3473-4758-b825-88b2719633cb tempest-UserMessageTest-1084663522 None] Filter OnlyHostFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:00:00 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-780f9966-3473-4758-b825-88b2719633cb tempest-UserMessageTest-1084663522 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:00:00 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.capacity [None req-780f9966-3473-4758-b825-88b2719633cb tempest-UserMessageTest-1084663522 None] Space information for share creation on host l75lg1-v1@vast#vast (requested / avail): 1/2079 {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/capacity.py:83}} May 28 13:00:00 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-780f9966-3473-4758-b825-88b2719633cb tempest-UserMessageTest-1084663522 None] Filter CapacityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:00:00 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.utils [None req-780f9966-3473-4758-b825-88b2719633cb tempest-UserMessageTest-1084663522 None] Share type extra spec requirement "vendor_name=foobar" does not match reported capability "VAST STORAGE" {{(pid=98327) capabilities_satisfied /opt/stack/manila/manila/scheduler/utils.py:185}} May 28 13:00:00 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.capabilities [None req-780f9966-3473-4758-b825-88b2719633cb tempest-UserMessageTest-1084663522 None] host: 'l75lg1-v1@vast#vast', free_capacity_gb: 2079.6478263456374, pools: None fails resource_type extra_specs requirements {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/capabilities.py:45}} May 28 13:00:00 l75lg1-v1 manila-scheduler[98327]: INFO manila.scheduler.filters.base [None req-780f9966-3473-4758-b825-88b2719633cb tempest-UserMessageTest-1084663522 None] Filter CapabilitiesFilter returned 0 host(s) May 28 13:00:00 l75lg1-v1 manila-scheduler[98327]: ERROR manila.scheduler.manager [None req-780f9966-3473-4758-b825-88b2719633cb tempest-UserMessageTest-1084663522 None] Failed to schedule create_share: No valid host was found. Failed to find a weighted host, the last executed filter was CapabilitiesFilter.: manila.exception.NoValidHost: No valid host was found. Failed to find a weighted host, the last executed filter was CapabilitiesFilter. May 28 13:00:00 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-780f9966-3473-4758-b825-88b2719633cb tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] http://10.27.203.238/share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/shares returned with HTTP 200 May 28 13:00:00 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1adee421-ddbc-4654-8d24-e67ca3f3a79a tempest-ShareTransferNegativeTest-884271560 None] <<< [POST] https://127.0.0.1:40443/api/views/ May 28 13:00:00 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 821/1671] 10.27.203.238 () {66 vars in 1362 bytes} [Tue May 28 12:59:59 2024] POST /share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/shares => generated 1370 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:00:00 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1adee421-ddbc-4654-8d24-e67ca3f3a79a tempest-ShareTransferNegativeTest-884271560 None] Bunch(abac_tags=[], abe_max_depth=None, abe_protocols=[], alias='', allow_anonymous_access=False, allow_s3_anonymous_access=False, auto_commit='0d', bucket='', bucket_creators=[], bucket_creators_groups=[], bucket_owner=None, bulk_permission_update_progress=None, bulk_permission_update_state=None, cluster='loop75-kfs', cluster_id=1, created='2024-05-28T12:59:59.792711Z', enabled=True, files_retention_mode='NONE', guid='1dfed4c5-cd54-4fdd-8915-0e1349dd3e85', id=38, ignore_oos=False, internal=False, is_remote=False, is_seamless=False, logical_capacity=0, max_retention_period=None, min_retention_period=None, name='e89b90ae-d644-4b77-81a0-3d997b90fad0', nfs_interop_flags='BOTH_NFS3_AND_NFS4_INTEROP_DISABLED', path='/manila/manila-e89b90ae-d644-4b77-81a0-3d997b90fad0', physical_capacity=0, policy='e89b90ae-d644-4b77-81a0-3d997b90fad0', policy_id=39, protocols=['NFS'], qos_policy=None, qos_policy_id=None, s3_locks=False, s3_locks_retention_mode='NONE', s3_locks_retention_period='', s3_object_ownership_rule='ObjectWriter', s3_unverified_lookup=False, s3_versioning=False, select_for_live_monitoring=False, share='', share_acl=Bunch(acl=[], enabled=False), sync='SYNCED', sync_time='2024-05-28T13:00:00.062823Z', tenant_id=1, tenant_name='default', title='/manila/manila-e89b90ae-d644-4b77-81a0-3d997b90fad0', url='https://127.0.0.1:40443/api/views/38/') May 28 13:00:00 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1adee421-ddbc-4654-8d24-e67ca3f3a79a tempest-ShareTransferNegativeTest-884271560 None] --- [POST] https://127.0.0.1:40443/api/views/: Done May 28 13:00:00 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-21fef87c-6a65-4779-bbfc-ff92142dc45c tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] GET http://10.27.203.238/share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/shares/7eaac6de-9c35-40b2-8f16-30e039e8da55 May 28 13:00:00 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-21fef87c-6a65-4779-bbfc-ff92142dc45c tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:00 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-21fef87c-6a65-4779-bbfc-ff92142dc45c tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:00 l75lg1-v1 manila-scheduler[98327]: INFO manila.message.api [None req-780f9966-3473-4758-b825-88b2719633cb tempest-UserMessageTest-1084663522 None] Creating message record for request_id = req-780f9966-3473-4758-b825-88b2719633cb May 28 13:00:00 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-21fef87c-6a65-4779-bbfc-ff92142dc45c tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] http://10.27.203.238/share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/shares/7eaac6de-9c35-40b2-8f16-30e039e8da55 returned with HTTP 200 May 28 13:00:00 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 851/1672] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:00:00 2024] GET /share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/shares/7eaac6de-9c35-40b2-8f16-30e039e8da55 => generated 1370 bytes in 26 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:00:00 l75lg1-v1 manila-share[98474]: INFO manila.share.manager [None req-1adee421-ddbc-4654-8d24-e67ca3f3a79a tempest-ShareTransferNegativeTest-884271560 None] Share instance e89b90ae-d644-4b77-81a0-3d997b90fad0 created successfully. May 28 13:00:00 l75lg1-v1 dstat.sh[49771]: 28-05 13:00:00| 12 1 83 4 0|5679M 1777M 278M 7890M| 19k 10k| 0 3848k| 0 530 |7349 12k|1.21 1.08 1.02|1.0 2.0 0| 0 0 | 0 2048M| 29 361 0 49 2 May 28 13:00:00 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c600b7a8-9cbf-4b7b-80c7-e1c7c3749a0b tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:00:00 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c600b7a8-9cbf-4b7b-80c7-e1c7c3749a0b tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] [Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=1, created='2024-05-28T12:58:43.845440Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='31b6534b-d142-4561-992f-4f0759db302d', id=32, internal=False, is_s3_default_policy=False, name='7fdd602c-79d0-479c-95a2-336b202c6639', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=['*'], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=[], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=[], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T12:59:58.349710Z', tenant_id=1, tenant_name='default', title='7fdd602c-79d0-479c-95a2-336b202c6639', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/32/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[])] May 28 13:00:00 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c600b7a8-9cbf-4b7b-80c7-e1c7c3749a0b tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 13:00:00 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-c600b7a8-9cbf-4b7b-80c7-e1c7c3749a0b tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] changing access on /manila/manila-7fdd602c-79d0-479c-95a2-336b202c6639. Rules: {'nfs_read_write': ['203.0.113.166'], 'nfs_read_only': []} May 28 13:00:00 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c600b7a8-9cbf-4b7b-80c7-e1c7c3749a0b tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] >>> [PATCH] https://127.0.0.1:40443/api/viewpolicies/32/ May 28 13:00:00 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c600b7a8-9cbf-4b7b-80c7-e1c7c3749a0b tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] {'data': '{"name": "7fdd602c-79d0-479c-95a2-336b202c6639", "nfs_no_squash": ' May 28 13:00:00 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c600b7a8-9cbf-4b7b-80c7-e1c7c3749a0b tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] '["*"], "nfs_root_squash": ["*"], "nfs_read_write": ' May 28 13:00:00 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c600b7a8-9cbf-4b7b-80c7-e1c7c3749a0b tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] '["203.0.113.166"], "nfs_read_only": []}', May 28 13:00:00 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c600b7a8-9cbf-4b7b-80c7-e1c7c3749a0b tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] 'params': None} May 28 13:00:00 l75lg1-v1 neutron-server[77618]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.HashRingHealthCheckPeriodics.touch_hash_ring_nodes' {{(pid=77618) _process_scheduled /opt/stack/data/venv/lib/python3.10/site-packages/futurist/periodics.py:638}} May 28 13:00:00 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a0afd0ae-de57-414c-b9ae-a2ebd5f83eee tempest-ShareRulesTest-1530341375 None] <<< [POST] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:00:00 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a0afd0ae-de57-414c-b9ae-a2ebd5f83eee tempest-ShareRulesTest-1530341375 None] Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=0, created='2024-05-28T13:00:00.296044Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='0c5a8a38-6377-4415-a54d-f55b3cc6ff10', id=40, internal=False, is_s3_default_policy=False, name='ee46a1d1-f743-461e-8bb5-467ee0e99edd', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=[], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['*'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['*'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T13:00:00.631914Z', tenant_id=1, tenant_name='default', title='ee46a1d1-f743-461e-8bb5-467ee0e99edd', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/40/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[]) May 28 13:00:00 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a0afd0ae-de57-414c-b9ae-a2ebd5f83eee tempest-ShareRulesTest-1530341375 None] --- [POST] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 13:00:00 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a0afd0ae-de57-414c-b9ae-a2ebd5f83eee tempest-ShareRulesTest-1530341375 None] >>> [GET] https://127.0.0.1:40443/api/quotas/ May 28 13:00:00 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a0afd0ae-de57-414c-b9ae-a2ebd5f83eee tempest-ShareRulesTest-1530341375 None] {'allow_redirects': True, May 28 13:00:00 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a0afd0ae-de57-414c-b9ae-a2ebd5f83eee tempest-ShareRulesTest-1530341375 None] 'params': {'name': 'ee46a1d1-f743-461e-8bb5-467ee0e99edd'}} May 28 13:00:01 l75lg1-v1 dstat.sh[49771]: 28-05 13:00:01| 1 1 91 7 0|5680M 1777M 278M 7890M| 23k 1732B| 0 9014k| 0 743 |4296 6548 |1.21 1.08 1.02|1.0 1.0 0| 0 0 | 0 2048M| 29 361 0 47 2 May 28 13:00:01 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a0afd0ae-de57-414c-b9ae-a2ebd5f83eee tempest-ShareRulesTest-1530341375 None] <<< [GET] https://127.0.0.1:40443/api/quotas/ May 28 13:00:01 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a0afd0ae-de57-414c-b9ae-a2ebd5f83eee tempest-ShareRulesTest-1530341375 None] [] May 28 13:00:01 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a0afd0ae-de57-414c-b9ae-a2ebd5f83eee tempest-ShareRulesTest-1530341375 None] --- [GET] https://127.0.0.1:40443/api/quotas/: Done May 28 13:00:01 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a0afd0ae-de57-414c-b9ae-a2ebd5f83eee tempest-ShareRulesTest-1530341375 None] >>> [POST] https://127.0.0.1:40443/api/quotas/ May 28 13:00:01 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a0afd0ae-de57-414c-b9ae-a2ebd5f83eee tempest-ShareRulesTest-1530341375 None] {'data': '{"name": "ee46a1d1-f743-461e-8bb5-467ee0e99edd", "path": ' May 28 13:00:01 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a0afd0ae-de57-414c-b9ae-a2ebd5f83eee tempest-ShareRulesTest-1530341375 None] '"/manila/manila-ee46a1d1-f743-461e-8bb5-467ee0e99edd", "create_dir": ' May 28 13:00:01 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a0afd0ae-de57-414c-b9ae-a2ebd5f83eee tempest-ShareRulesTest-1530341375 None] 'true, "hard_limit": 1073741824}', May 28 13:00:01 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a0afd0ae-de57-414c-b9ae-a2ebd5f83eee tempest-ShareRulesTest-1530341375 None] 'json': None, May 28 13:00:01 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a0afd0ae-de57-414c-b9ae-a2ebd5f83eee tempest-ShareRulesTest-1530341375 None] 'params': None} May 28 13:00:01 l75lg1-v1 neutron-server[77623]: DEBUG neutron.db.agents_db [None req-fe40ce8c-640e-4db7-a17a-6e8888cce266 None None] Agent healthcheck: found 0 active agents {{(pid=77623) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:319}} May 28 13:00:01 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-8551a043-358d-4f39-a0e6-a4ee2427afd1 tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] GET http://10.27.203.238/share/v2/cac556dc39a14bbdbdbabfc80672fb1f/shares/bd070603-3332-4a76-a743-411df92ace16 May 28 13:00:01 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-8551a043-358d-4f39-a0e6-a4ee2427afd1 tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:01 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-8551a043-358d-4f39-a0e6-a4ee2427afd1 tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:01 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-8551a043-358d-4f39-a0e6-a4ee2427afd1 tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] http://10.27.203.238/share/v2/cac556dc39a14bbdbdbabfc80672fb1f/shares/bd070603-3332-4a76-a743-411df92ace16 returned with HTTP 200 May 28 13:00:01 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 822/1673] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:00:01 2024] GET /share/v2/cac556dc39a14bbdbdbabfc80672fb1f/shares/bd070603-3332-4a76-a743-411df92ace16 => generated 1316 bytes in 26 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:00:01 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-10f22d6e-ba00-4ab4-8711-59fffa5c60fe tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] POST http://10.27.203.238/share/v2/cac556dc39a14bbdbdbabfc80672fb1f/share-transfers May 28 13:00:01 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-10f22d6e-ba00-4ab4-8711-59fffa5c60fe tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"transfer": {"share_id": "bd070603-3332-4a76-a743-411df92ace16", "name": "tempest-tempest-created-share-transfer-1866280223"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:00:01 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.v2.share_transfer [None req-10f22d6e-ba00-4ab4-8711-59fffa5c60fe tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] Creating new share transfer {'transfer': {'share_id': 'bd070603-3332-4a76-a743-411df92ace16', 'name': 'tempest-tempest-created-share-transfer-1866280223'}} {{(pid=98329) create /opt/stack/manila/manila/api/v2/share_transfer.py:104}} May 28 13:00:01 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.v2.share_transfer [None req-10f22d6e-ba00-4ab4-8711-59fffa5c60fe tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] Creating transfer of share bd070603-3332-4a76-a743-411df92ace16 {{(pid=98329) create /opt/stack/manila/manila/api/v2/share_transfer.py:125}} May 28 13:00:01 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.transfer.api [None req-10f22d6e-ba00-4ab4-8711-59fffa5c60fe tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] Generating transfer record for share bd070603-3332-4a76-a743-411df92ace16 {{(pid=98329) create /opt/stack/manila/manila/transfer/api.py:162}} May 28 13:00:02 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-10f22d6e-ba00-4ab4-8711-59fffa5c60fe tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] http://10.27.203.238/share/v2/cac556dc39a14bbdbdbabfc80672fb1f/share-transfers returned with HTTP 202 May 28 13:00:02 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 852/1674] 10.27.203.238 () {66 vars in 1389 bytes} [Tue May 28 13:00:01 2024] POST /share/v2/cac556dc39a14bbdbdbabfc80672fb1f/share-transfers => generated 728 bytes in 75 msecs (HTTP/1.1 202) 6 headers in 237 bytes (1 switches on core 0) May 28 13:00:02 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-72be5c5c-9123-431f-851b-1971360427dd tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] GET http://10.27.203.238/share/v1/cac556dc39a14bbdbdbabfc80672fb1f/shares/bd070603-3332-4a76-a743-411df92ace16 May 28 13:00:02 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-72be5c5c-9123-431f-851b-1971360427dd tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:02 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-72be5c5c-9123-431f-851b-1971360427dd tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:02 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a0afd0ae-de57-414c-b9ae-a2ebd5f83eee tempest-ShareRulesTest-1530341375 None] <<< [POST] https://127.0.0.1:40443/api/quotas/ May 28 13:00:02 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a0afd0ae-de57-414c-b9ae-a2ebd5f83eee tempest-ShareRulesTest-1530341375 None] Bunch(cluster='loop75-kfs', cluster_id=1, default_email=None, default_group_quota=None, default_user_quota=None, enable_alarms=True, enable_email_providers=True, grace_period=None, group_quotas=[], guid='749205de-01aa-40c1-8c27-49d8b4bff402', hard_limit=1073741824, hard_limit_inodes=None, id=37, internal=False, is_user_quota=False, last_user_quotas_update=None, name='ee46a1d1-f743-461e-8bb5-467ee0e99edd', num_blocked_users=0, num_exceeded_users=0, path='/manila/manila-ee46a1d1-f743-461e-8bb5-467ee0e99edd', percent_capacity=0, percent_inodes=None, pretty_grace_period=None, pretty_grace_period_expiration=None, pretty_state='OK (CREATED)', soft_limit=None, soft_limit_inodes=None, state='OK', sync_state='CREATED', system_id=37, tenant_id=1, tenant_name='default', time_to_block=None, title='ee46a1d1-f743-461e-8bb5-467ee0e99edd', url='https://127.0.0.1:40443/api/quotas/37/', used_capacity=0, used_capacity_tb=0.0, used_effective_capacity=0, used_effective_capacity_tb=0.0, used_inodes=0, used_limited_capacity=0, user_quotas=[]) May 28 13:00:02 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a0afd0ae-de57-414c-b9ae-a2ebd5f83eee tempest-ShareRulesTest-1530341375 None] --- [POST] https://127.0.0.1:40443/api/quotas/: Done May 28 13:00:02 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a0afd0ae-de57-414c-b9ae-a2ebd5f83eee tempest-ShareRulesTest-1530341375 None] >>> [GET] https://127.0.0.1:40443/api/views/ May 28 13:00:02 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a0afd0ae-de57-414c-b9ae-a2ebd5f83eee tempest-ShareRulesTest-1530341375 None] {'allow_redirects': True, May 28 13:00:02 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a0afd0ae-de57-414c-b9ae-a2ebd5f83eee tempest-ShareRulesTest-1530341375 None] 'params': {'name': 'ee46a1d1-f743-461e-8bb5-467ee0e99edd'}} May 28 13:00:02 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-cb555727-f6a3-48db-93b6-f28e34d9e03b tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] GET http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/shares/510f7bcd-a0ee-49a6-8093-2640036f2ca3 May 28 13:00:02 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-cb555727-f6a3-48db-93b6-f28e34d9e03b tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:02 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-cb555727-f6a3-48db-93b6-f28e34d9e03b tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:02 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-72be5c5c-9123-431f-851b-1971360427dd tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] http://10.27.203.238/share/v1/cac556dc39a14bbdbdbabfc80672fb1f/shares/bd070603-3332-4a76-a743-411df92ace16 returned with HTTP 200 May 28 13:00:02 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 823/1675] 10.27.203.238 () {62 vars in 1408 bytes} [Tue May 28 13:00:02 2024] GET /share/v1/cac556dc39a14bbdbdbabfc80672fb1f/shares/bd070603-3332-4a76-a743-411df92ace16 => generated 905 bytes in 27 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:00:02 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331035e4-b26d-4fe4-8ea0-5e284ce35292 tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:02 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-331035e4-b26d-4fe4-8ea0-5e284ce35292 tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:00:02 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-cb555727-f6a3-48db-93b6-f28e34d9e03b tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/shares/510f7bcd-a0ee-49a6-8093-2640036f2ca3 returned with HTTP 200 May 28 13:00:02 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 853/1676] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:00:02 2024] GET /share/v2/a4f3887fa28c457390f5b66615564430/shares/510f7bcd-a0ee-49a6-8093-2640036f2ca3 => generated 1313 bytes in 28 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:00:02 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331035e4-b26d-4fe4-8ea0-5e284ce35292 tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:02 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6664bbe-e09a-496e-843c-ae3cfbfb1e70 service manila] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f110cf6300f049c897d0aab63218d1e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:02 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6664bbe-e09a-496e-843c-ae3cfbfb1e70 service manila] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:02 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6664bbe-e09a-496e-843c-ae3cfbfb1e70 service manila] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:02 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6664bbe-e09a-496e-843c-ae3cfbfb1e70 service manila] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:02 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-a6664bbe-e09a-496e-843c-ae3cfbfb1e70 service manila] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:00:02 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6664bbe-e09a-496e-843c-ae3cfbfb1e70 service manila] RBAC: Authorizing `identity:validate_token()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:02 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6664bbe-e09a-496e-843c-ae3cfbfb1e70 service manila] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:02 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1348/2724] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 13:00:02 2024] GET /identity/v3/auth/tokens => generated 3960 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 13:00:02 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-4cfb6947-da4b-462c-99e3-d6526c05ad5a tempest-ShareTransferNegativeTest-1518106491 tempest-ShareTransferNegativeTest-1518106491-project-member] POST http://10.27.203.238/share/v2/c7a348e5c74641978595dc43c2dcb08a/share-transfers/7f987764-83ca-40cf-8696-05079b490538/accept May 28 13:00:02 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-4cfb6947-da4b-462c-99e3-d6526c05ad5a tempest-ShareTransferNegativeTest-1518106491 tempest-ShareTransferNegativeTest-1518106491-project-member] Action: 'accept', calling method: Controller.__getattribute__..version_select, body: {"accept": {"auth_key": "incorrect_auth_key", "clear_access_rules": false}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:00:02 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.v2.share_transfer [None req-4cfb6947-da4b-462c-99e3-d6526c05ad5a tempest-ShareTransferNegativeTest-1518106491 tempest-ShareTransferNegativeTest-1518106491-project-member] Accepting share transfer 7f987764-83ca-40cf-8696-05079b490538 {{(pid=98330) accept /opt/stack/manila/manila/api/v2/share_transfer.py:143}} May 28 13:00:02 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.v2.share_transfer [None req-4cfb6947-da4b-462c-99e3-d6526c05ad5a tempest-ShareTransferNegativeTest-1518106491 tempest-ShareTransferNegativeTest-1518106491-project-member] Accepting transfer 7f987764-83ca-40cf-8696-05079b490538 {{(pid=98330) accept /opt/stack/manila/manila/api/v2/share_transfer.py:167}} May 28 13:00:02 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.transfer.api [None req-4cfb6947-da4b-462c-99e3-d6526c05ad5a tempest-ShareTransferNegativeTest-1518106491 tempest-ShareTransferNegativeTest-1518106491-project-member] Attempt to transfer 7f987764-83ca-40cf-8696-05079b490538 with invalid auth key. May 28 13:00:02 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-4cfb6947-da4b-462c-99e3-d6526c05ad5a tempest-ShareTransferNegativeTest-1518106491 tempest-ShareTransferNegativeTest-1518106491-project-member] HTTP exception thrown: Invalid auth key: Attempt to transfer 7f987764-83ca-40cf-8696-05079b490538 with invalid auth key. May 28 13:00:02 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-4cfb6947-da4b-462c-99e3-d6526c05ad5a tempest-ShareTransferNegativeTest-1518106491 tempest-ShareTransferNegativeTest-1518106491-project-member] http://10.27.203.238/share/v2/c7a348e5c74641978595dc43c2dcb08a/share-transfers/7f987764-83ca-40cf-8696-05079b490538/accept returned with HTTP 400 May 28 13:00:02 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 824/1677] 10.27.203.238 () {66 vars in 1520 bytes} [Tue May 28 13:00:02 2024] POST /share/v2/c7a348e5c74641978595dc43c2dcb08a/share-transfers/7f987764-83ca-40cf-8696-05079b490538/accept => generated 141 bytes in 158 msecs (HTTP/1.1 400) 6 headers in 240 bytes (1 switches on core 0) May 28 13:00:02 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-21638200-6842-4fe5-985d-5cb969816b24 tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] DELETE http://10.27.203.238/share/v2/cac556dc39a14bbdbdbabfc80672fb1f/share-transfers/7f987764-83ca-40cf-8696-05079b490538 May 28 13:00:02 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-21638200-6842-4fe5-985d-5cb969816b24 tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:02 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-21638200-6842-4fe5-985d-5cb969816b24 tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:02 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.v2.share_transfer [None req-21638200-6842-4fe5-985d-5cb969816b24 tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] Delete transfer with id: 7f987764-83ca-40cf-8696-05079b490538 {{(pid=98329) delete /opt/stack/manila/manila/api/v2/share_transfer.py:193}} May 28 13:00:02 l75lg1-v1 dstat.sh[49771]: 28-05 13:00:02| 4 1 94 1 0|5680M 1777M 278M 7890M| 16k 1740B| 0 733k| 0 75.1 |3336 5495 |1.28 1.09 1.02|2.0 1.0 0| 0 0 | 0 2048M| 29 362 0 47 2 May 28 13:00:02 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.transfer.api [None req-21638200-6842-4fe5-985d-5cb969816b24 tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] Transfer 7f987764-83ca-40cf-8696-05079b490538 has been deleted successful. May 28 13:00:02 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-21638200-6842-4fe5-985d-5cb969816b24 tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] http://10.27.203.238/share/v2/cac556dc39a14bbdbdbabfc80672fb1f/share-transfers/7f987764-83ca-40cf-8696-05079b490538 returned with HTTP 200 May 28 13:00:02 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 854/1678] 10.27.203.238 () {64 vars in 1481 bytes} [Tue May 28 13:00:02 2024] DELETE /share/v2/cac556dc39a14bbdbdbabfc80672fb1f/share-transfers/7f987764-83ca-40cf-8696-05079b490538 => generated 0 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 237 bytes (1 switches on core 0) May 28 13:00:02 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-e8db310b-3ed8-4e64-aa3a-b01ac82391ed tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] GET http://10.27.203.238/share/v1/cac556dc39a14bbdbdbabfc80672fb1f/shares/bd070603-3332-4a76-a743-411df92ace16 May 28 13:00:02 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-e8db310b-3ed8-4e64-aa3a-b01ac82391ed tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:02 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-e8db310b-3ed8-4e64-aa3a-b01ac82391ed tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:02 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-e8db310b-3ed8-4e64-aa3a-b01ac82391ed tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] http://10.27.203.238/share/v1/cac556dc39a14bbdbdbabfc80672fb1f/shares/bd070603-3332-4a76-a743-411df92ace16 returned with HTTP 200 May 28 13:00:02 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 825/1679] 10.27.203.238 () {62 vars in 1408 bytes} [Tue May 28 13:00:02 2024] GET /share/v1/cac556dc39a14bbdbdbabfc80672fb1f/shares/bd070603-3332-4a76-a743-411df92ace16 => generated 962 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:00:02 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-ae6b4d2a-1cde-480c-a3e3-0f3cad1a2402 tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] POST http://10.27.203.238/share/v2/cac556dc39a14bbdbdbabfc80672fb1f/shares May 28 13:00:02 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-ae6b4d2a-1cde-480c-a3e3-0f3cad1a2402 tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share": {"share_proto": "nfs", "description": "Tempest's share", "snapshot_id": null, "name": "tempest-tempest-share-name-1583235284", "size": 1, "metadata": {}, "is_public": false, "share_type": "7d4af55a-ed87-4690-a9e6-1a8ea4a42df2"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:00:02 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.v1.shares [None req-ae6b4d2a-1cde-480c-a3e3-0f3cad1a2402 tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] Create NFS share of 1 GB May 28 13:00:02 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.quota [None req-ae6b4d2a-1cde-480c-a3e3-0f3cad1a2402 tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] Created reservations ['e5e70776-c24b-4b2b-8c3a-0c5061d3a6c8', 'dd1e9740-9bd4-4d6c-96fb-bcdde2c817a0', '132e2bcc-c41f-47f6-b13c-1ff0bd492731', '4e810d24-a601-4c7a-a411-ffd49e9500d1'] {{(pid=98329) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 13:00:02 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c600b7a8-9cbf-4b7b-80c7-e1c7c3749a0b tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] <<< [PATCH] https://127.0.0.1:40443/api/viewpolicies/32/ May 28 13:00:02 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c600b7a8-9cbf-4b7b-80c7-e1c7c3749a0b tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=1, created='2024-05-28T12:58:43.845440Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='31b6534b-d142-4561-992f-4f0759db302d', id=32, internal=False, is_s3_default_policy=False, name='7fdd602c-79d0-479c-95a2-336b202c6639', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=['*'], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['203.0.113.166'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['203.0.113.166'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='MODIFYING', sync_time='2024-05-28T13:00:01.614609Z', tenant_id=1, tenant_name='default', title='7fdd602c-79d0-479c-95a2-336b202c6639', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/32/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[]) May 28 13:00:02 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c600b7a8-9cbf-4b7b-80c7-e1c7c3749a0b tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] --- [PATCH] https://127.0.0.1:40443/api/viewpolicies/32/: Done May 28 13:00:02 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c600b7a8-9cbf-4b7b-80c7-e1c7c3749a0b tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:00:02 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c600b7a8-9cbf-4b7b-80c7-e1c7c3749a0b tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:00:02 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.quota [None req-ae6b4d2a-1cde-480c-a3e3-0f3cad1a2402 tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] Committed reservations ['e5e70776-c24b-4b2b-8c3a-0c5061d3a6c8', 'dd1e9740-9bd4-4d6c-96fb-bcdde2c817a0', '132e2bcc-c41f-47f6-b13c-1ff0bd492731', '4e810d24-a601-4c7a-a411-ffd49e9500d1'] {{(pid=98329) commit /opt/stack/manila/manila/quota.py:1063}} May 28 13:00:02 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c600b7a8-9cbf-4b7b-80c7-e1c7c3749a0b tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.055s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:00:02 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c600b7a8-9cbf-4b7b-80c7-e1c7c3749a0b tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:00:02 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c600b7a8-9cbf-4b7b-80c7-e1c7c3749a0b tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:00:02 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c600b7a8-9cbf-4b7b-80c7-e1c7c3749a0b tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:00:02 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c600b7a8-9cbf-4b7b-80c7-e1c7c3749a0b tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:00:02 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c600b7a8-9cbf-4b7b-80c7-e1c7c3749a0b tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:00:02 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c600b7a8-9cbf-4b7b-80c7-e1c7c3749a0b tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:00:02 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c600b7a8-9cbf-4b7b-80c7-e1c7c3749a0b tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:00:02 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c600b7a8-9cbf-4b7b-80c7-e1c7c3749a0b tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:00:02 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c600b7a8-9cbf-4b7b-80c7-e1c7c3749a0b tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:00:02 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c600b7a8-9cbf-4b7b-80c7-e1c7c3749a0b tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:00:02 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c600b7a8-9cbf-4b7b-80c7-e1c7c3749a0b tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:00:02 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.host_manager [None req-ae6b4d2a-1cde-480c-a3e3-0f3cad1a2402 tempest-ShareTransferNegativeTest-884271560 None] Share service is down. (host: l75lg1-v1@generic2). May 28 13:00:02 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.host_manager [None req-ae6b4d2a-1cde-480c-a3e3-0f3cad1a2402 tempest-ShareTransferNegativeTest-884271560 None] Share service is down. (host: l75lg1-v1@generic1). May 28 13:00:02 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-ae6b4d2a-1cde-480c-a3e3-0f3cad1a2402 tempest-ShareTransferNegativeTest-884271560 None] Starting with 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:80}} May 28 13:00:02 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-ae6b4d2a-1cde-480c-a3e3-0f3cad1a2402 tempest-ShareTransferNegativeTest-884271560 None] Filter OnlyHostFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:00:02 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-ae6b4d2a-1cde-480c-a3e3-0f3cad1a2402 tempest-ShareTransferNegativeTest-884271560 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:00:02 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.capacity [None req-ae6b4d2a-1cde-480c-a3e3-0f3cad1a2402 tempest-ShareTransferNegativeTest-884271560 None] Space information for share creation on host l75lg1-v1@vast#vast (requested / avail): 1/2079 {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/capacity.py:83}} May 28 13:00:02 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-ae6b4d2a-1cde-480c-a3e3-0f3cad1a2402 tempest-ShareTransferNegativeTest-884271560 None] Filter CapacityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:00:02 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-ae6b4d2a-1cde-480c-a3e3-0f3cad1a2402 tempest-ShareTransferNegativeTest-884271560 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:00:02 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-ae6b4d2a-1cde-480c-a3e3-0f3cad1a2402 tempest-ShareTransferNegativeTest-884271560 None] Driver Filter: Checking host 'l75lg1-v1@vast#vast' {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:37}} May 28 13:00:02 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-ae6b4d2a-1cde-480c-a3e3-0f3cad1a2402 tempest-ShareTransferNegativeTest-884271560 None] Filter function not set :: passing host. {{(pid=98327) _check_filter_function /opt/stack/manila/manila/scheduler/filters/driver.py:53}} May 28 13:00:02 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-ae6b4d2a-1cde-480c-a3e3-0f3cad1a2402 tempest-ShareTransferNegativeTest-884271560 None] Result: True {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:40}} May 28 13:00:02 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-ae6b4d2a-1cde-480c-a3e3-0f3cad1a2402 tempest-ShareTransferNegativeTest-884271560 None] Done checking host 'l75lg1-v1@vast#vast' {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:41}} May 28 13:00:02 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-ae6b4d2a-1cde-480c-a3e3-0f3cad1a2402 tempest-ShareTransferNegativeTest-884271560 None] Filter DriverFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:00:02 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-ae6b4d2a-1cde-480c-a3e3-0f3cad1a2402 tempest-ShareTransferNegativeTest-884271560 None] Filter ShareReplicationFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:00:02 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-ae6b4d2a-1cde-480c-a3e3-0f3cad1a2402 tempest-ShareTransferNegativeTest-884271560 None] Filter CreateFromSnapshotFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:00:02 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-ae6b4d2a-1cde-480c-a3e3-0f3cad1a2402 tempest-ShareTransferNegativeTest-884271560 None] Filter AffinityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:00:02 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-ae6b4d2a-1cde-480c-a3e3-0f3cad1a2402 tempest-ShareTransferNegativeTest-884271560 None] Filter AntiAffinityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:00:02 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.drivers.filter [None req-ae6b4d2a-1cde-480c-a3e3-0f3cad1a2402 tempest-ShareTransferNegativeTest-884271560 None] Filtered share [host: 'l75lg1-v1@vast#vast', free_capacity_gb: 2079.6478263456374, pools: None] {{(pid=98327) _schedule_share /opt/stack/manila/manila/scheduler/drivers/filter.py:268}} May 28 13:00:02 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-ae6b4d2a-1cde-480c-a3e3-0f3cad1a2402 tempest-ShareTransferNegativeTest-884271560 None] Checking host 'l75lg1-v1@vast#vast' {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:46}} May 28 13:00:02 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.weighers.goodness [None req-ae6b4d2a-1cde-480c-a3e3-0f3cad1a2402 tempest-ShareTransferNegativeTest-884271560 None] Goodness function not set :: defaulting to minimal goodness rating of 0. May 28 13:00:02 l75lg1-v1 manila-scheduler[98327]: INFO manila.scheduler.weighers.goodness [None req-ae6b4d2a-1cde-480c-a3e3-0f3cad1a2402 tempest-ShareTransferNegativeTest-884271560 None] Goodness function result for host l75lg1-v1@vast#vast: 0. May 28 13:00:02 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-ae6b4d2a-1cde-480c-a3e3-0f3cad1a2402 tempest-ShareTransferNegativeTest-884271560 None] Goodness: 0 {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:48}} May 28 13:00:02 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-ae6b4d2a-1cde-480c-a3e3-0f3cad1a2402 tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] http://10.27.203.238/share/v2/cac556dc39a14bbdbdbabfc80672fb1f/shares returned with HTTP 200 May 28 13:00:02 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-ae6b4d2a-1cde-480c-a3e3-0f3cad1a2402 tempest-ShareTransferNegativeTest-884271560 None] Done checking host 'l75lg1-v1@vast#vast' {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:49}} May 28 13:00:02 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.drivers.filter [None req-ae6b4d2a-1cde-480c-a3e3-0f3cad1a2402 tempest-ShareTransferNegativeTest-884271560 None] Choosing for share: WeighedHost [host: l75lg1-v1@vast#vast, weight: 0.0] {{(pid=98327) _schedule_share /opt/stack/manila/manila/scheduler/drivers/filter.py:274}} May 28 13:00:02 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 855/1680] 10.27.203.238 () {66 vars in 1362 bytes} [Tue May 28 13:00:02 2024] POST /share/v2/cac556dc39a14bbdbdbabfc80672fb1f/shares => generated 1311 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:00:02 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-fb58277a-63d8-4940-9547-4bc9588eccf5 tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] GET http://10.27.203.238/share/v2/cac556dc39a14bbdbdbabfc80672fb1f/shares/0c7ef0a2-5628-47dd-9eba-98153028dd8a May 28 13:00:02 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-fb58277a-63d8-4940-9547-4bc9588eccf5 tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:02 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-fb58277a-63d8-4940-9547-4bc9588eccf5 tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:02 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c600b7a8-9cbf-4b7b-80c7-e1c7c3749a0b tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.040s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:00:02 l75lg1-v1 manila-share[98474]: INFO manila.share.access [None req-c600b7a8-9cbf-4b7b-80c7-e1c7c3749a0b tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Access rules were successfully modified for share instance 7fdd602c-79d0-479c-95a2-336b202c6639 belonging to share 72db8769-ece7-42ff-af27-2e778292a9b4. May 28 13:00:02 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-fb58277a-63d8-4940-9547-4bc9588eccf5 tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] http://10.27.203.238/share/v2/cac556dc39a14bbdbdbabfc80672fb1f/shares/0c7ef0a2-5628-47dd-9eba-98153028dd8a returned with HTTP 200 May 28 13:00:02 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 826/1681] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:00:02 2024] GET /share/v2/cac556dc39a14bbdbdbabfc80672fb1f/shares/0c7ef0a2-5628-47dd-9eba-98153028dd8a => generated 1311 bytes in 29 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:00:02 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-9d4ab300-2886-4966-8991-a7e30576d4f2 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] GET http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/share-access-rules?share_id=72db8769-ece7-42ff-af27-2e778292a9b4 May 28 13:00:02 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-9d4ab300-2886-4966-8991-a7e30576d4f2 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:02 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-9d4ab300-2886-4966-8991-a7e30576d4f2 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:02 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ae6b4d2a-1cde-480c-a3e3-0f3cad1a2402 tempest-ShareTransferNegativeTest-884271560 None] >>> [GET] https://127.0.0.1:40443/api/vippools/ May 28 13:00:02 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ae6b4d2a-1cde-480c-a3e3-0f3cad1a2402 tempest-ShareTransferNegativeTest-884271560 None] {'allow_redirects': True, 'params': {'name': 'vippool-1'}} May 28 13:00:02 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a0afd0ae-de57-414c-b9ae-a2ebd5f83eee tempest-ShareRulesTest-1530341375 None] <<< [GET] https://127.0.0.1:40443/api/views/ May 28 13:00:02 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a0afd0ae-de57-414c-b9ae-a2ebd5f83eee tempest-ShareRulesTest-1530341375 None] [] May 28 13:00:02 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a0afd0ae-de57-414c-b9ae-a2ebd5f83eee tempest-ShareRulesTest-1530341375 None] --- [GET] https://127.0.0.1:40443/api/views/: Done May 28 13:00:02 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a0afd0ae-de57-414c-b9ae-a2ebd5f83eee tempest-ShareRulesTest-1530341375 None] >>> [POST] https://127.0.0.1:40443/api/views/ May 28 13:00:02 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a0afd0ae-de57-414c-b9ae-a2ebd5f83eee tempest-ShareRulesTest-1530341375 None] {'data': '{"name": "ee46a1d1-f743-461e-8bb5-467ee0e99edd", "path": ' May 28 13:00:02 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a0afd0ae-de57-414c-b9ae-a2ebd5f83eee tempest-ShareRulesTest-1530341375 None] '"/manila/manila-ee46a1d1-f743-461e-8bb5-467ee0e99edd", "policy_id": ' May 28 13:00:02 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a0afd0ae-de57-414c-b9ae-a2ebd5f83eee tempest-ShareRulesTest-1530341375 None] '40, "create_dir": true, "protocols": ["NFS"]}', May 28 13:00:02 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a0afd0ae-de57-414c-b9ae-a2ebd5f83eee tempest-ShareRulesTest-1530341375 None] 'json': None, May 28 13:00:02 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a0afd0ae-de57-414c-b9ae-a2ebd5f83eee tempest-ShareRulesTest-1530341375 None] 'params': None} May 28 13:00:02 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.lock.api [None req-9d4ab300-2886-4966-8991-a7e30576d4f2 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Searching for locks by: {'resource_id': 'bcc00ae5-e7de-4e35-b5a6-3e24eaf91e0e', 'resource_action': 'show', 'resource_type': 'access_rule'} {{(pid=98329) get_all /opt/stack/manila/manila/lock/api.py:112}} May 28 13:00:02 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-9d4ab300-2886-4966-8991-a7e30576d4f2 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/share-access-rules?share_id=72db8769-ece7-42ff-af27-2e778292a9b4 returned with HTTP 200 May 28 13:00:02 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 856/1682] 10.27.203.238 () {64 vars in 1467 bytes} [Tue May 28 13:00:02 2024] GET /share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/share-access-rules?share_id=72db8769-ece7-42ff-af27-2e778292a9b4 => generated 281 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:00:02 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-d82d9f05-9b22-43fb-9b26-35cc4765ecdb tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] POST http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action May 28 13:00:02 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-d82d9f05-9b22-43fb-9b26-35cc4765ecdb tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Action body: b'{"deny_access": {"access_id": "bcc00ae5-e7de-4e35-b5a6-3e24eaf91e0e"}}' {{(pid=98330) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 13:00:02 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-d82d9f05-9b22-43fb-9b26-35cc4765ecdb tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Action: 'action', calling method: ShareController.deny_access, body: {"deny_access": {"access_id": "bcc00ae5-e7de-4e35-b5a6-3e24eaf91e0e"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:00:02 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.lock.api [None req-d82d9f05-9b22-43fb-9b26-35cc4765ecdb tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Searching for locks by: {'resource_id': 'bcc00ae5-e7de-4e35-b5a6-3e24eaf91e0e', 'resource_action': 'delete'} {{(pid=98330) get_all /opt/stack/manila/manila/lock/api.py:112}} May 28 13:00:02 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-d82d9f05-9b22-43fb-9b26-35cc4765ecdb tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] HTTP exception thrown: Cannot deny access for share '72db8769-ece7-42ff-af27-2e778292a9b4' since it has been locked. Please remove the locks and retry the operation May 28 13:00:02 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-d82d9f05-9b22-43fb-9b26-35cc4765ecdb tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action returned with HTTP 403 May 28 13:00:02 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 827/1683] 10.27.203.238 () {66 vars in 1493 bytes} [Tue May 28 13:00:02 2024] POST /share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action => generated 184 bytes in 12 msecs (HTTP/1.1 403) 6 headers in 238 bytes (1 switches on core 0) May 28 13:00:02 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-27716b69-fd7b-4121-ab63-e84ba67ba92d tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] POST http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action May 28 13:00:02 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-27716b69-fd7b-4121-ab63-e84ba67ba92d tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Action body: b'{"deny_access": {"access_id": "bcc00ae5-e7de-4e35-b5a6-3e24eaf91e0e"}}' {{(pid=98329) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 13:00:02 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-27716b69-fd7b-4121-ab63-e84ba67ba92d tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Action: 'action', calling method: ShareController.deny_access, body: {"deny_access": {"access_id": "bcc00ae5-e7de-4e35-b5a6-3e24eaf91e0e"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:00:02 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.lock.api [None req-27716b69-fd7b-4121-ab63-e84ba67ba92d tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Searching for locks by: {'resource_id': 'bcc00ae5-e7de-4e35-b5a6-3e24eaf91e0e', 'resource_action': 'delete'} {{(pid=98329) get_all /opt/stack/manila/manila/lock/api.py:112}} May 28 13:00:02 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-27716b69-fd7b-4121-ab63-e84ba67ba92d tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] HTTP exception thrown: Cannot deny access for share '72db8769-ece7-42ff-af27-2e778292a9b4' since it has been locked. Please remove the locks and retry the operation May 28 13:00:02 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-27716b69-fd7b-4121-ab63-e84ba67ba92d tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action returned with HTTP 403 May 28 13:00:02 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 857/1684] 10.27.203.238 () {66 vars in 1493 bytes} [Tue May 28 13:00:02 2024] POST /share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action => generated 184 bytes in 11 msecs (HTTP/1.1 403) 6 headers in 238 bytes (1 switches on core 0) May 28 13:00:02 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-8f220b3d-70c6-42e2-96c6-4b6240821f77 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] POST http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action May 28 13:00:02 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-8f220b3d-70c6-42e2-96c6-4b6240821f77 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Action body: b'{"deny_access": {"access_id": "bcc00ae5-e7de-4e35-b5a6-3e24eaf91e0e", "unrestrict": true}}' {{(pid=98330) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 13:00:02 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-8f220b3d-70c6-42e2-96c6-4b6240821f77 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Action: 'action', calling method: ShareController.deny_access, body: {"deny_access": {"access_id": "bcc00ae5-e7de-4e35-b5a6-3e24eaf91e0e", "unrestrict": true}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:00:02 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.lock.api [None req-8f220b3d-70c6-42e2-96c6-4b6240821f77 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Searching for locks by: {'resource_id': 'bcc00ae5-e7de-4e35-b5a6-3e24eaf91e0e', 'resource_action': 'delete'} {{(pid=98330) get_all /opt/stack/manila/manila/lock/api.py:112}} May 28 13:00:02 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-8f220b3d-70c6-42e2-96c6-4b6240821f77 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:00:02 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-8f220b3d-70c6-42e2-96c6-4b6240821f77 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:00:02 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-8f220b3d-70c6-42e2-96c6-4b6240821f77 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.035s {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:00:02 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-8f220b3d-70c6-42e2-96c6-4b6240821f77 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:00:02 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-8f220b3d-70c6-42e2-96c6-4b6240821f77 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:00:02 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-8f220b3d-70c6-42e2-96c6-4b6240821f77 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.052s {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:00:02 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-8f220b3d-70c6-42e2-96c6-4b6240821f77 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action returned with HTTP 202 May 28 13:00:02 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 828/1685] 10.27.203.238 () {66 vars in 1493 bytes} [Tue May 28 13:00:02 2024] POST /share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action => generated 0 bytes in 171 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 13:00:02 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-d5d47de5-525c-4127-b174-1921b4812062 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] GET http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/share-access-rules?share_id=72db8769-ece7-42ff-af27-2e778292a9b4 May 28 13:00:02 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-d5d47de5-525c-4127-b174-1921b4812062 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:02 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-d5d47de5-525c-4127-b174-1921b4812062 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:02 l75lg1-v1 manila-share[98474]: DEBUG manila.share.manager [None req-8f220b3d-70c6-42e2-96c6-4b6240821f77 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Received request to update access for share instance 7fdd602c-79d0-479c-95a2-336b202c6639. {{(pid=98474) update_access_for_instances /opt/stack/manila/manila/share/manager.py:4353}} May 28 13:00:02 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.lock.api [None req-d5d47de5-525c-4127-b174-1921b4812062 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Searching for locks by: {'resource_id': 'bcc00ae5-e7de-4e35-b5a6-3e24eaf91e0e', 'resource_action': 'show', 'resource_type': 'access_rule'} {{(pid=98329) get_all /opt/stack/manila/manila/lock/api.py:112}} May 28 13:00:02 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-8f220b3d-70c6-42e2-96c6-4b6240821f77 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:00:02 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-8f220b3d-70c6-42e2-96c6-4b6240821f77 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:00:02 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-8f220b3d-70c6-42e2-96c6-4b6240821f77 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:00:02 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-8f220b3d-70c6-42e2-96c6-4b6240821f77 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:00:02 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-d5d47de5-525c-4127-b174-1921b4812062 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/share-access-rules?share_id=72db8769-ece7-42ff-af27-2e778292a9b4 returned with HTTP 200 May 28 13:00:02 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-8f220b3d-70c6-42e2-96c6-4b6240821f77 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:00:02 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 858/1686] 10.27.203.238 () {64 vars in 1467 bytes} [Tue May 28 13:00:02 2024] GET /share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/share-access-rules?share_id=72db8769-ece7-42ff-af27-2e778292a9b4 => generated 289 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:00:02 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ae6b4d2a-1cde-480c-a3e3-0f3cad1a2402 tempest-ShareTransferNegativeTest-884271560 None] <<< [GET] https://127.0.0.1:40443/api/vippools/ May 28 13:00:02 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ae6b4d2a-1cde-480c-a3e3-0f3cad1a2402 tempest-ShareTransferNegativeTest-884271560 None] [Bunch(active_cnode_ids=[], active_interfaces=4, cluster='loop75-kfs', cluster_id=1, cnode_ids=[], cnodes=[], domain_name='vippool-1', enable_l3=False, enable_weighted_balancing=False, enabled=True, end_ip='172.21.75.4', guid='f2abaede-b397-413a-8faa-3aeead6d3b28', gw_ip='', gw_ipv6='', id=2, ip_ranges=[['172.21.75.1', '172.21.75.4']], name='vippool-1', peer_asn=0, port_membership='ALL', ranges_summary='172.21.75.[1-4]', role='PROTOCOLS', start_ip='172.21.75.1', subnet_cidr=16, subnet_cidr_ipv6=None, sync='SYNCED', sync_time='2024-05-28T12:50:09.644123Z', tenant_id=1, tenant_name='default', title='172.21.75.1 - 172.21.75.4', url='https://127.0.0.1:40443/api/vippools/2/', vast_asn=0, vlan=0, vms_preferred=False)] May 28 13:00:02 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ae6b4d2a-1cde-480c-a3e3-0f3cad1a2402 tempest-ShareTransferNegativeTest-884271560 None] --- [GET] https://127.0.0.1:40443/api/vippools/: Done May 28 13:00:02 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ae6b4d2a-1cde-480c-a3e3-0f3cad1a2402 tempest-ShareTransferNegativeTest-884271560 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:00:02 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ae6b4d2a-1cde-480c-a3e3-0f3cad1a2402 tempest-ShareTransferNegativeTest-884271560 None] {'allow_redirects': True, May 28 13:00:02 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ae6b4d2a-1cde-480c-a3e3-0f3cad1a2402 tempest-ShareTransferNegativeTest-884271560 None] 'params': {'name': 'e21891ab-7145-4d59-b238-375b52d59cb7'}} May 28 13:00:02 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-8f220b3d-70c6-42e2-96c6-4b6240821f77 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.056s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:00:02 l75lg1-v1 manila-share[98474]: DEBUG manila.share.access [None req-8f220b3d-70c6-42e2-96c6-4b6240821f77 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Updating access rules for share instance 7fdd602c-79d0-479c-95a2-336b202c6639 belonging to share 72db8769-ece7-42ff-af27-2e778292a9b4. {{(pid=98474) update_access_rules /opt/stack/manila/manila/share/access.py:298}} May 28 13:00:02 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-8f220b3d-70c6-42e2-96c6-4b6240821f77 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:00:02 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-8f220b3d-70c6-42e2-96c6-4b6240821f77 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:00:02 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-8f220b3d-70c6-42e2-96c6-4b6240821f77 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.007s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:00:02 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-8f220b3d-70c6-42e2-96c6-4b6240821f77 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:00:02 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-8f220b3d-70c6-42e2-96c6-4b6240821f77 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:00:03 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-8f220b3d-70c6-42e2-96c6-4b6240821f77 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.017s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:00:03 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-8f220b3d-70c6-42e2-96c6-4b6240821f77 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] changing access on None May 28 13:00:03 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8f220b3d-70c6-42e2-96c6-4b6240821f77 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:00:03 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8f220b3d-70c6-42e2-96c6-4b6240821f77 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] {'allow_redirects': True, May 28 13:00:03 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8f220b3d-70c6-42e2-96c6-4b6240821f77 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] 'params': {'name': '7fdd602c-79d0-479c-95a2-336b202c6639'}} May 28 13:00:03 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-07f8ba8e-61e2-4430-93fc-fbb6f5c4afe8 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] GET http://10.27.203.238/share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/shares/7eaac6de-9c35-40b2-8f16-30e039e8da55 May 28 13:00:03 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-07f8ba8e-61e2-4430-93fc-fbb6f5c4afe8 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:03 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-07f8ba8e-61e2-4430-93fc-fbb6f5c4afe8 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:03 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-07f8ba8e-61e2-4430-93fc-fbb6f5c4afe8 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] http://10.27.203.238/share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/shares/7eaac6de-9c35-40b2-8f16-30e039e8da55 returned with HTTP 200 May 28 13:00:03 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 829/1687] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:00:03 2024] GET /share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/shares/7eaac6de-9c35-40b2-8f16-30e039e8da55 => generated 1367 bytes in 27 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:00:03 l75lg1-v1 dstat.sh[49771]: 28-05 13:00:03| 11 1 85 3 0|5680M 1777M 278M 7890M| 19k 6387B| 0 12M| 0 1188 |6064 9847 |1.28 1.09 1.02|1.0 1.0 2.0| 0 0 | 0 2048M| 29 361 0 43 2 May 28 13:00:03 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8f220b3d-70c6-42e2-96c6-4b6240821f77 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:00:03 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8f220b3d-70c6-42e2-96c6-4b6240821f77 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] [Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=1, created='2024-05-28T12:58:43.845440Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='31b6534b-d142-4561-992f-4f0759db302d', id=32, internal=False, is_s3_default_policy=False, name='7fdd602c-79d0-479c-95a2-336b202c6639', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=['*'], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['203.0.113.166'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['203.0.113.166'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T13:00:02.296617Z', tenant_id=1, tenant_name='default', title='7fdd602c-79d0-479c-95a2-336b202c6639', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/32/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[])] May 28 13:00:03 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8f220b3d-70c6-42e2-96c6-4b6240821f77 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 13:00:03 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-8f220b3d-70c6-42e2-96c6-4b6240821f77 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] changing access on /manila/manila-7fdd602c-79d0-479c-95a2-336b202c6639. Rules: {'nfs_read_write': [], 'nfs_read_only': []} May 28 13:00:03 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8f220b3d-70c6-42e2-96c6-4b6240821f77 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] >>> [PATCH] https://127.0.0.1:40443/api/viewpolicies/32/ May 28 13:00:03 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8f220b3d-70c6-42e2-96c6-4b6240821f77 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] {'data': '{"name": "7fdd602c-79d0-479c-95a2-336b202c6639", "nfs_no_squash": ' May 28 13:00:03 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8f220b3d-70c6-42e2-96c6-4b6240821f77 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] '["*"], "nfs_root_squash": ["*"], "nfs_read_write": [], ' May 28 13:00:03 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8f220b3d-70c6-42e2-96c6-4b6240821f77 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] '"nfs_read_only": []}', May 28 13:00:03 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8f220b3d-70c6-42e2-96c6-4b6240821f77 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] 'params': None} May 28 13:00:03 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a0afd0ae-de57-414c-b9ae-a2ebd5f83eee tempest-ShareRulesTest-1530341375 None] <<< [POST] https://127.0.0.1:40443/api/views/ May 28 13:00:03 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a0afd0ae-de57-414c-b9ae-a2ebd5f83eee tempest-ShareRulesTest-1530341375 None] Bunch(abac_tags=[], abe_max_depth=None, abe_protocols=[], alias='', allow_anonymous_access=False, allow_s3_anonymous_access=False, auto_commit='0d', bucket='', bucket_creators=[], bucket_creators_groups=[], bucket_owner=None, bulk_permission_update_progress=None, bulk_permission_update_state=None, cluster='loop75-kfs', cluster_id=1, created='2024-05-28T13:00:03.036019Z', enabled=True, files_retention_mode='NONE', guid='3ed91fde-e932-493f-93b2-9b536b622c48', id=39, ignore_oos=False, internal=False, is_remote=False, is_seamless=False, logical_capacity=0, max_retention_period=None, min_retention_period=None, name='ee46a1d1-f743-461e-8bb5-467ee0e99edd', nfs_interop_flags='BOTH_NFS3_AND_NFS4_INTEROP_DISABLED', path='/manila/manila-ee46a1d1-f743-461e-8bb5-467ee0e99edd', physical_capacity=0, policy='ee46a1d1-f743-461e-8bb5-467ee0e99edd', policy_id=40, protocols=['NFS'], qos_policy=None, qos_policy_id=None, s3_locks=False, s3_locks_retention_mode='NONE', s3_locks_retention_period='', s3_object_ownership_rule='ObjectWriter', s3_unverified_lookup=False, s3_versioning=False, select_for_live_monitoring=False, share='', share_acl=Bunch(acl=[], enabled=False), sync='SYNCED', sync_time='2024-05-28T13:00:03.293378Z', tenant_id=1, tenant_name='default', title='/manila/manila-ee46a1d1-f743-461e-8bb5-467ee0e99edd', url='https://127.0.0.1:40443/api/views/39/') May 28 13:00:03 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a0afd0ae-de57-414c-b9ae-a2ebd5f83eee tempest-ShareRulesTest-1530341375 None] --- [POST] https://127.0.0.1:40443/api/views/: Done May 28 13:00:03 l75lg1-v1 neutron-server[77619]: DEBUG dbcounter [-] [77619] Writing DB stats neutron:SELECT=3 {{(pid=77619) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:00:03 l75lg1-v1 manila-share[98474]: INFO manila.share.manager [None req-a0afd0ae-de57-414c-b9ae-a2ebd5f83eee tempest-ShareRulesTest-1530341375 None] Share instance ee46a1d1-f743-461e-8bb5-467ee0e99edd created successfully. May 28 13:00:03 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ae6b4d2a-1cde-480c-a3e3-0f3cad1a2402 tempest-ShareTransferNegativeTest-884271560 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:00:03 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ae6b4d2a-1cde-480c-a3e3-0f3cad1a2402 tempest-ShareTransferNegativeTest-884271560 None] [] May 28 13:00:03 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ae6b4d2a-1cde-480c-a3e3-0f3cad1a2402 tempest-ShareTransferNegativeTest-884271560 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 13:00:03 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ae6b4d2a-1cde-480c-a3e3-0f3cad1a2402 tempest-ShareTransferNegativeTest-884271560 None] >>> [POST] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:00:03 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ae6b4d2a-1cde-480c-a3e3-0f3cad1a2402 tempest-ShareTransferNegativeTest-884271560 None] {'data': '{"name": "e21891ab-7145-4d59-b238-375b52d59cb7"}', May 28 13:00:03 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ae6b4d2a-1cde-480c-a3e3-0f3cad1a2402 tempest-ShareTransferNegativeTest-884271560 None] 'json': None, May 28 13:00:03 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ae6b4d2a-1cde-480c-a3e3-0f3cad1a2402 tempest-ShareTransferNegativeTest-884271560 None] 'params': None} May 28 13:00:04 l75lg1-v1 neutron-server[77619]: DEBUG dbcounter [-] [77619] Writing DB stats neutron:SELECT=5 {{(pid=77619) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:00:04 l75lg1-v1 dstat.sh[49771]: 28-05 13:00:04| 1 0 98 1 0|5680M 1776M 278M 7890M| 19k 1782B| 0 1080k| 0 92.0 |2172 3593 |1.28 1.09 1.02|1.0 1.0 0| 0 0 | 0 2048M| 29 361 0 43 2 May 28 13:00:04 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ae6b4d2a-1cde-480c-a3e3-0f3cad1a2402 tempest-ShareTransferNegativeTest-884271560 None] <<< [POST] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:00:04 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ae6b4d2a-1cde-480c-a3e3-0f3cad1a2402 tempest-ShareTransferNegativeTest-884271560 None] Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=0, created='2024-05-28T13:00:03.855400Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='9718bd76-381d-400e-86d8-cc6104214c23', id=41, internal=False, is_s3_default_policy=False, name='e21891ab-7145-4d59-b238-375b52d59cb7', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=[], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['*'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['*'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T13:00:04.222280Z', tenant_id=1, tenant_name='default', title='e21891ab-7145-4d59-b238-375b52d59cb7', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/41/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[]) May 28 13:00:04 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ae6b4d2a-1cde-480c-a3e3-0f3cad1a2402 tempest-ShareTransferNegativeTest-884271560 None] --- [POST] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 13:00:04 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ae6b4d2a-1cde-480c-a3e3-0f3cad1a2402 tempest-ShareTransferNegativeTest-884271560 None] >>> [GET] https://127.0.0.1:40443/api/quotas/ May 28 13:00:04 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ae6b4d2a-1cde-480c-a3e3-0f3cad1a2402 tempest-ShareTransferNegativeTest-884271560 None] {'allow_redirects': True, May 28 13:00:04 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ae6b4d2a-1cde-480c-a3e3-0f3cad1a2402 tempest-ShareTransferNegativeTest-884271560 None] 'params': {'name': 'e21891ab-7145-4d59-b238-375b52d59cb7'}} May 28 13:00:05 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ae6b4d2a-1cde-480c-a3e3-0f3cad1a2402 tempest-ShareTransferNegativeTest-884271560 None] <<< [GET] https://127.0.0.1:40443/api/quotas/ May 28 13:00:05 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ae6b4d2a-1cde-480c-a3e3-0f3cad1a2402 tempest-ShareTransferNegativeTest-884271560 None] [] May 28 13:00:05 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ae6b4d2a-1cde-480c-a3e3-0f3cad1a2402 tempest-ShareTransferNegativeTest-884271560 None] --- [GET] https://127.0.0.1:40443/api/quotas/: Done May 28 13:00:05 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ae6b4d2a-1cde-480c-a3e3-0f3cad1a2402 tempest-ShareTransferNegativeTest-884271560 None] >>> [POST] https://127.0.0.1:40443/api/quotas/ May 28 13:00:05 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ae6b4d2a-1cde-480c-a3e3-0f3cad1a2402 tempest-ShareTransferNegativeTest-884271560 None] {'data': '{"name": "e21891ab-7145-4d59-b238-375b52d59cb7", "path": ' May 28 13:00:05 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ae6b4d2a-1cde-480c-a3e3-0f3cad1a2402 tempest-ShareTransferNegativeTest-884271560 None] '"/manila/manila-e21891ab-7145-4d59-b238-375b52d59cb7", "create_dir": ' May 28 13:00:05 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ae6b4d2a-1cde-480c-a3e3-0f3cad1a2402 tempest-ShareTransferNegativeTest-884271560 None] 'true, "hard_limit": 1073741824}', May 28 13:00:05 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ae6b4d2a-1cde-480c-a3e3-0f3cad1a2402 tempest-ShareTransferNegativeTest-884271560 None] 'json': None, May 28 13:00:05 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ae6b4d2a-1cde-480c-a3e3-0f3cad1a2402 tempest-ShareTransferNegativeTest-884271560 None] 'params': None} May 28 13:00:05 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-b49a454b-fdbc-4da2-be6f-e25ec283d61f tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] GET http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/shares/510f7bcd-a0ee-49a6-8093-2640036f2ca3 May 28 13:00:05 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-b49a454b-fdbc-4da2-be6f-e25ec283d61f tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:05 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-b49a454b-fdbc-4da2-be6f-e25ec283d61f tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:05 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-b49a454b-fdbc-4da2-be6f-e25ec283d61f tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/shares/510f7bcd-a0ee-49a6-8093-2640036f2ca3 returned with HTTP 200 May 28 13:00:05 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 859/1688] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:00:05 2024] GET /share/v2/a4f3887fa28c457390f5b66615564430/shares/510f7bcd-a0ee-49a6-8093-2640036f2ca3 => generated 1316 bytes in 25 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:00:05 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-d8ef247d-5467-419e-8944-be05c4fd834d tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] POST http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/shares/510f7bcd-a0ee-49a6-8093-2640036f2ca3/action May 28 13:00:05 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-d8ef247d-5467-419e-8944-be05c4fd834d tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Action body: b'{"allow_access": {"access_type": "ip", "access_to": "203.0.113.77", "access_level": "rw"}}' {{(pid=98330) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 13:00:05 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-d8ef247d-5467-419e-8944-be05c4fd834d tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Action: 'action', calling method: ShareController.allow_access, body: {"allow_access": {"access_type": "ip", "access_to": "203.0.113.77", "access_level": "rw"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:00:05 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-d8ef247d-5467-419e-8944-be05c4fd834d tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Acquiring lock "locked_access_rules_operation_by_share_instance_ee46a1d1-f743-461e-8bb5-467ee0e99edd" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:00:05 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-d8ef247d-5467-419e-8944-be05c4fd834d tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Lock "locked_access_rules_operation_by_share_instance_ee46a1d1-f743-461e-8bb5-467ee0e99edd" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:00:05 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-d8ef247d-5467-419e-8944-be05c4fd834d tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Lock "locked_access_rules_operation_by_share_instance_ee46a1d1-f743-461e-8bb5-467ee0e99edd" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.047s {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:00:05 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8f220b3d-70c6-42e2-96c6-4b6240821f77 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] <<< [PATCH] https://127.0.0.1:40443/api/viewpolicies/32/ May 28 13:00:05 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8f220b3d-70c6-42e2-96c6-4b6240821f77 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=1, created='2024-05-28T12:58:43.845440Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='31b6534b-d142-4561-992f-4f0759db302d', id=32, internal=False, is_s3_default_policy=False, name='7fdd602c-79d0-479c-95a2-336b202c6639', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=['*'], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=[], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=[], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='MODIFYING', sync_time='2024-05-28T13:00:04.638579Z', tenant_id=1, tenant_name='default', title='7fdd602c-79d0-479c-95a2-336b202c6639', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/32/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[]) May 28 13:00:05 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8f220b3d-70c6-42e2-96c6-4b6240821f77 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] --- [PATCH] https://127.0.0.1:40443/api/viewpolicies/32/: Done May 28 13:00:05 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-8f220b3d-70c6-42e2-96c6-4b6240821f77 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:00:05 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-8f220b3d-70c6-42e2-96c6-4b6240821f77 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:00:05 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-d8ef247d-5467-419e-8944-be05c4fd834d tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/shares/510f7bcd-a0ee-49a6-8093-2640036f2ca3/action returned with HTTP 200 May 28 13:00:05 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 830/1689] 10.27.203.238 () {66 vars in 1493 bytes} [Tue May 28 13:00:05 2024] POST /share/v2/a4f3887fa28c457390f5b66615564430/shares/510f7bcd-a0ee-49a6-8093-2640036f2ca3/action => generated 218 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:00:05 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-d013942a-e42e-4f13-934a-8ed65700dc98 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] POST http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/shares/510f7bcd-a0ee-49a6-8093-2640036f2ca3/action May 28 13:00:05 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-d013942a-e42e-4f13-934a-8ed65700dc98 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Action body: b'{"access_list": null}' {{(pid=98329) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 13:00:05 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-d013942a-e42e-4f13-934a-8ed65700dc98 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Action: 'action', calling method: ShareController.access_list, body: {"access_list": null} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:00:05 l75lg1-v1 dstat.sh[49771]: 28-05 13:00:05| 3 0 96 1 0|5680M 1776M 278M 7890M| 23k 1734B| 0 956k| 0 84.0 |2508 4161 |1.28 1.09 1.02|3.0 1.0 0| 0 0 | 0 2048M| 29 362 0 42 2 May 28 13:00:05 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-8f220b3d-70c6-42e2-96c6-4b6240821f77 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.038s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:00:05 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-8f220b3d-70c6-42e2-96c6-4b6240821f77 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:00:05 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-8f220b3d-70c6-42e2-96c6-4b6240821f77 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:00:05 l75lg1-v1 manila-share[98474]: DEBUG manila.share.manager [None req-d8ef247d-5467-419e-8944-be05c4fd834d tempest-ShareRulesTest-1530341375 None] Received request to update access for share instance ee46a1d1-f743-461e-8bb5-467ee0e99edd. {{(pid=98474) update_access_for_instances /opt/stack/manila/manila/share/manager.py:4353}} May 28 13:00:05 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-d013942a-e42e-4f13-934a-8ed65700dc98 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/shares/510f7bcd-a0ee-49a6-8093-2640036f2ca3/action returned with HTTP 200 May 28 13:00:05 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 860/1690] 10.27.203.238 () {66 vars in 1493 bytes} [Tue May 28 13:00:05 2024] POST /share/v2/a4f3887fa28c457390f5b66615564430/shares/510f7bcd-a0ee-49a6-8093-2640036f2ca3/action => generated 173 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:00:05 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-d8ef247d-5467-419e-8944-be05c4fd834d tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_ee46a1d1-f743-461e-8bb5-467ee0e99edd" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:00:05 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-d8ef247d-5467-419e-8944-be05c4fd834d tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_ee46a1d1-f743-461e-8bb5-467ee0e99edd" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:00:05 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-d8ef247d-5467-419e-8944-be05c4fd834d tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_ee46a1d1-f743-461e-8bb5-467ee0e99edd" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.004s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:00:05 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-d8ef247d-5467-419e-8944-be05c4fd834d tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_ee46a1d1-f743-461e-8bb5-467ee0e99edd" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:00:05 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-d8ef247d-5467-419e-8944-be05c4fd834d tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_ee46a1d1-f743-461e-8bb5-467ee0e99edd" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:00:05 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-8f220b3d-70c6-42e2-96c6-4b6240821f77 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.066s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:00:05 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-8f220b3d-70c6-42e2-96c6-4b6240821f77 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:00:05 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-8f220b3d-70c6-42e2-96c6-4b6240821f77 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:00:05 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-8f220b3d-70c6-42e2-96c6-4b6240821f77 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.008s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:00:05 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-8f220b3d-70c6-42e2-96c6-4b6240821f77 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:00:05 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-8f220b3d-70c6-42e2-96c6-4b6240821f77 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:00:05 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-8f220b3d-70c6-42e2-96c6-4b6240821f77 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.006s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:00:05 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-8f220b3d-70c6-42e2-96c6-4b6240821f77 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:00:05 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-8f220b3d-70c6-42e2-96c6-4b6240821f77 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:00:05 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-8f220b3d-70c6-42e2-96c6-4b6240821f77 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.050s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:00:05 l75lg1-v1 manila-share[98474]: INFO manila.share.access [None req-8f220b3d-70c6-42e2-96c6-4b6240821f77 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Access rules were successfully modified for share instance 7fdd602c-79d0-479c-95a2-336b202c6639 belonging to share 72db8769-ece7-42ff-af27-2e778292a9b4. May 28 13:00:05 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-d8ef247d-5467-419e-8944-be05c4fd834d tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_ee46a1d1-f743-461e-8bb5-467ee0e99edd" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.077s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:00:05 l75lg1-v1 manila-share[98474]: DEBUG manila.share.access [None req-d8ef247d-5467-419e-8944-be05c4fd834d tempest-ShareRulesTest-1530341375 None] Updating access rules for share instance ee46a1d1-f743-461e-8bb5-467ee0e99edd belonging to share 510f7bcd-a0ee-49a6-8093-2640036f2ca3. {{(pid=98474) update_access_rules /opt/stack/manila/manila/share/access.py:298}} May 28 13:00:05 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-d8ef247d-5467-419e-8944-be05c4fd834d tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_ee46a1d1-f743-461e-8bb5-467ee0e99edd" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:00:05 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-d8ef247d-5467-419e-8944-be05c4fd834d tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_ee46a1d1-f743-461e-8bb5-467ee0e99edd" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:00:05 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-d8ef247d-5467-419e-8944-be05c4fd834d tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_ee46a1d1-f743-461e-8bb5-467ee0e99edd" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.007s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:00:05 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-d8ef247d-5467-419e-8944-be05c4fd834d tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_ee46a1d1-f743-461e-8bb5-467ee0e99edd" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:00:05 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-d8ef247d-5467-419e-8944-be05c4fd834d tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_ee46a1d1-f743-461e-8bb5-467ee0e99edd" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:00:05 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-d8ef247d-5467-419e-8944-be05c4fd834d tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_ee46a1d1-f743-461e-8bb5-467ee0e99edd" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.014s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:00:05 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-d8ef247d-5467-419e-8944-be05c4fd834d tempest-ShareRulesTest-1530341375 None] changing access on None May 28 13:00:05 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d8ef247d-5467-419e-8944-be05c4fd834d tempest-ShareRulesTest-1530341375 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:00:05 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d8ef247d-5467-419e-8944-be05c4fd834d tempest-ShareRulesTest-1530341375 None] {'allow_redirects': True, May 28 13:00:05 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d8ef247d-5467-419e-8944-be05c4fd834d tempest-ShareRulesTest-1530341375 None] 'params': {'name': 'ee46a1d1-f743-461e-8bb5-467ee0e99edd'}} May 28 13:00:05 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-21d1f20e-518e-4c6d-b976-24a17913e4ae tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] GET http://10.27.203.238/share/v2/cac556dc39a14bbdbdbabfc80672fb1f/shares/0c7ef0a2-5628-47dd-9eba-98153028dd8a May 28 13:00:05 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-21d1f20e-518e-4c6d-b976-24a17913e4ae tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:05 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-21d1f20e-518e-4c6d-b976-24a17913e4ae tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:05 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-21d1f20e-518e-4c6d-b976-24a17913e4ae tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] http://10.27.203.238/share/v2/cac556dc39a14bbdbdbabfc80672fb1f/shares/0c7ef0a2-5628-47dd-9eba-98153028dd8a returned with HTTP 200 May 28 13:00:05 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 831/1691] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:00:05 2024] GET /share/v2/cac556dc39a14bbdbdbabfc80672fb1f/shares/0c7ef0a2-5628-47dd-9eba-98153028dd8a => generated 1313 bytes in 28 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:00:05 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ae6b4d2a-1cde-480c-a3e3-0f3cad1a2402 tempest-ShareTransferNegativeTest-884271560 None] <<< [POST] https://127.0.0.1:40443/api/quotas/ May 28 13:00:05 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ae6b4d2a-1cde-480c-a3e3-0f3cad1a2402 tempest-ShareTransferNegativeTest-884271560 None] Bunch(cluster='loop75-kfs', cluster_id=1, default_email=None, default_group_quota=None, default_user_quota=None, enable_alarms=True, enable_email_providers=True, grace_period=None, group_quotas=[], guid='31ba1ce3-9332-4452-8bfa-4815ed286c51', hard_limit=1073741824, hard_limit_inodes=None, id=38, internal=False, is_user_quota=False, last_user_quotas_update=None, name='e21891ab-7145-4d59-b238-375b52d59cb7', num_blocked_users=0, num_exceeded_users=0, path='/manila/manila-e21891ab-7145-4d59-b238-375b52d59cb7', percent_capacity=0, percent_inodes=None, pretty_grace_period=None, pretty_grace_period_expiration=None, pretty_state='OK (CREATED)', soft_limit=None, soft_limit_inodes=None, state='OK', sync_state='CREATED', system_id=38, tenant_id=1, tenant_name='default', time_to_block=None, title='e21891ab-7145-4d59-b238-375b52d59cb7', url='https://127.0.0.1:40443/api/quotas/38/', used_capacity=0, used_capacity_tb=0.0, used_effective_capacity=0, used_effective_capacity_tb=0.0, used_inodes=0, used_limited_capacity=0, user_quotas=[]) May 28 13:00:05 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ae6b4d2a-1cde-480c-a3e3-0f3cad1a2402 tempest-ShareTransferNegativeTest-884271560 None] --- [POST] https://127.0.0.1:40443/api/quotas/: Done May 28 13:00:05 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ae6b4d2a-1cde-480c-a3e3-0f3cad1a2402 tempest-ShareTransferNegativeTest-884271560 None] >>> [GET] https://127.0.0.1:40443/api/views/ May 28 13:00:05 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ae6b4d2a-1cde-480c-a3e3-0f3cad1a2402 tempest-ShareTransferNegativeTest-884271560 None] {'allow_redirects': True, May 28 13:00:05 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ae6b4d2a-1cde-480c-a3e3-0f3cad1a2402 tempest-ShareTransferNegativeTest-884271560 None] 'params': {'name': 'e21891ab-7145-4d59-b238-375b52d59cb7'}} May 28 13:00:05 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-5d5ff814-fcf6-46dd-b54d-84ff72cffcd9 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] GET http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/share-access-rules?share_id=72db8769-ece7-42ff-af27-2e778292a9b4 May 28 13:00:05 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-5d5ff814-fcf6-46dd-b54d-84ff72cffcd9 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:05 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-5d5ff814-fcf6-46dd-b54d-84ff72cffcd9 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:05 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-5d5ff814-fcf6-46dd-b54d-84ff72cffcd9 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/share-access-rules?share_id=72db8769-ece7-42ff-af27-2e778292a9b4 returned with HTTP 200 May 28 13:00:05 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 861/1692] 10.27.203.238 () {64 vars in 1467 bytes} [Tue May 28 13:00:05 2024] GET /share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/share-access-rules?share_id=72db8769-ece7-42ff-af27-2e778292a9b4 => generated 19 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:00:05 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-960c297a-a426-4abb-b988-df385d0658b6 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] POST http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action May 28 13:00:05 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-960c297a-a426-4abb-b988-df385d0658b6 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Action body: b'{"allow_access": {"access_type": "ip", "access_to": "203.0.113.123", "access_level": "rw", "lock_visibility": true, "lock_deletion": true}}' {{(pid=98330) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 13:00:05 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-960c297a-a426-4abb-b988-df385d0658b6 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Action: 'action', calling method: ShareController.allow_access, body: {"allow_access": {"access_type": "ip", "access_to": "203.0.113.123", "access_level": "rw", "lock_visibility": true, "lock_deletion": true}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:00:06 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-960c297a-a426-4abb-b988-df385d0658b6 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:00:06 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-960c297a-a426-4abb-b988-df385d0658b6 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:00:06 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-960c297a-a426-4abb-b988-df385d0658b6 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.043s {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:00:06 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d8ef247d-5467-419e-8944-be05c4fd834d tempest-ShareRulesTest-1530341375 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:00:06 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d8ef247d-5467-419e-8944-be05c4fd834d tempest-ShareRulesTest-1530341375 None] [Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=1, created='2024-05-28T13:00:00.296044Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='0c5a8a38-6377-4415-a54d-f55b3cc6ff10', id=40, internal=False, is_s3_default_policy=False, name='ee46a1d1-f743-461e-8bb5-467ee0e99edd', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=[], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['*'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['*'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T13:00:00.631914Z', tenant_id=1, tenant_name='default', title='ee46a1d1-f743-461e-8bb5-467ee0e99edd', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/40/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[])] May 28 13:00:06 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d8ef247d-5467-419e-8944-be05c4fd834d tempest-ShareRulesTest-1530341375 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 13:00:06 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-d8ef247d-5467-419e-8944-be05c4fd834d tempest-ShareRulesTest-1530341375 None] changing access on /manila/manila-ee46a1d1-f743-461e-8bb5-467ee0e99edd. Rules: {'nfs_read_write': ['203.0.113.77'], 'nfs_read_only': []} May 28 13:00:06 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d8ef247d-5467-419e-8944-be05c4fd834d tempest-ShareRulesTest-1530341375 None] >>> [PATCH] https://127.0.0.1:40443/api/viewpolicies/40/ May 28 13:00:06 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d8ef247d-5467-419e-8944-be05c4fd834d tempest-ShareRulesTest-1530341375 None] {'data': '{"name": "ee46a1d1-f743-461e-8bb5-467ee0e99edd", "nfs_no_squash": ' May 28 13:00:06 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d8ef247d-5467-419e-8944-be05c4fd834d tempest-ShareRulesTest-1530341375 None] '["*"], "nfs_root_squash": ["*"], "nfs_read_write": ["203.0.113.77"], ' May 28 13:00:06 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d8ef247d-5467-419e-8944-be05c4fd834d tempest-ShareRulesTest-1530341375 None] '"nfs_read_only": []}', May 28 13:00:06 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d8ef247d-5467-419e-8944-be05c4fd834d tempest-ShareRulesTest-1530341375 None] 'params': None} May 28 13:00:06 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-960c297a-a426-4abb-b988-df385d0658b6 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action returned with HTTP 200 May 28 13:00:06 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 832/1693] 10.27.203.238 () {66 vars in 1494 bytes} [Tue May 28 13:00:05 2024] POST /share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action => generated 311 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:00:06 l75lg1-v1 manila-share[98474]: DEBUG manila.share.manager [None req-960c297a-a426-4abb-b988-df385d0658b6 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Received request to update access for share instance 7fdd602c-79d0-479c-95a2-336b202c6639. {{(pid=98474) update_access_for_instances /opt/stack/manila/manila/share/manager.py:4353}} May 28 13:00:06 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-fa29cb77-2485-4c9a-9fb5-9ca35256703c tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] GET http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/share-access-rules?share_id=72db8769-ece7-42ff-af27-2e778292a9b4 May 28 13:00:06 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-fa29cb77-2485-4c9a-9fb5-9ca35256703c tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:06 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-fa29cb77-2485-4c9a-9fb5-9ca35256703c tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:06 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-960c297a-a426-4abb-b988-df385d0658b6 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:00:06 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-960c297a-a426-4abb-b988-df385d0658b6 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:00:06 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-960c297a-a426-4abb-b988-df385d0658b6 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:00:06 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-960c297a-a426-4abb-b988-df385d0658b6 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:00:06 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-960c297a-a426-4abb-b988-df385d0658b6 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:00:06 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.lock.api [None req-fa29cb77-2485-4c9a-9fb5-9ca35256703c tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Searching for locks by: {'resource_id': '5cf49388-5ee6-49d7-9adc-19ee2d605e86', 'resource_action': 'show', 'resource_type': 'access_rule'} {{(pid=98329) get_all /opt/stack/manila/manila/lock/api.py:112}} May 28 13:00:06 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-fa29cb77-2485-4c9a-9fb5-9ca35256703c tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/share-access-rules?share_id=72db8769-ece7-42ff-af27-2e778292a9b4 returned with HTTP 200 May 28 13:00:06 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 862/1694] 10.27.203.238 () {64 vars in 1467 bytes} [Tue May 28 13:00:06 2024] GET /share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/share-access-rules?share_id=72db8769-ece7-42ff-af27-2e778292a9b4 => generated 266 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:00:06 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-960c297a-a426-4abb-b988-df385d0658b6 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.053s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:00:06 l75lg1-v1 manila-share[98474]: DEBUG manila.share.access [None req-960c297a-a426-4abb-b988-df385d0658b6 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Updating access rules for share instance 7fdd602c-79d0-479c-95a2-336b202c6639 belonging to share 72db8769-ece7-42ff-af27-2e778292a9b4. {{(pid=98474) update_access_rules /opt/stack/manila/manila/share/access.py:298}} May 28 13:00:06 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-a2d439e8-844b-449a-b594-2fa260963fb9 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] GET http://10.27.203.238/share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/messages May 28 13:00:06 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-a2d439e8-844b-449a-b594-2fa260963fb9 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:06 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-a2d439e8-844b-449a-b594-2fa260963fb9 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:06 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.message.api [None req-a2d439e8-844b-449a-b594-2fa260963fb9 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Searching for messages by: MultiDict([]) {{(pid=98330) get_all /opt/stack/manila/manila/message/api.py:78}} May 28 13:00:06 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-a2d439e8-844b-449a-b594-2fa260963fb9 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] http://10.27.203.238/share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/messages returned with HTTP 200 May 28 13:00:06 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 833/1695] 10.27.203.238 () {64 vars in 1346 bytes} [Tue May 28 13:00:06 2024] GET /share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/messages => generated 8024 bytes in 13 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:00:06 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-960c297a-a426-4abb-b988-df385d0658b6 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:00:06 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-960c297a-a426-4abb-b988-df385d0658b6 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:00:06 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-b4f6c2da-815e-4b7e-9115-bfd5c2d8a5a0 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] GET http://10.27.203.238/share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/messages/000c1d75-8f46-4f5e-b164-9704c716a253 May 28 13:00:06 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-b4f6c2da-815e-4b7e-9115-bfd5c2d8a5a0 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:06 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-b4f6c2da-815e-4b7e-9115-bfd5c2d8a5a0 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:06 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-b4f6c2da-815e-4b7e-9115-bfd5c2d8a5a0 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] http://10.27.203.238/share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/messages/000c1d75-8f46-4f5e-b164-9704c716a253 returned with HTTP 200 May 28 13:00:06 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 863/1696] 10.27.203.238 () {64 vars in 1457 bytes} [Tue May 28 13:00:06 2024] GET /share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/messages/000c1d75-8f46-4f5e-b164-9704c716a253 => generated 812 bytes in 10 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:00:06 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-960c297a-a426-4abb-b988-df385d0658b6 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.007s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:00:06 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-960c297a-a426-4abb-b988-df385d0658b6 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:00:06 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-960c297a-a426-4abb-b988-df385d0658b6 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:00:06 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-94982b2d-ef50-47b2-902c-135c0ccc148c tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] DELETE http://10.27.203.238/share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/messages/000c1d75-8f46-4f5e-b164-9704c716a253 May 28 13:00:06 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-94982b2d-ef50-47b2-902c-135c0ccc148c tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:06 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-94982b2d-ef50-47b2-902c-135c0ccc148c tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:06 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-960c297a-a426-4abb-b988-df385d0658b6 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.018s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:00:06 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-960c297a-a426-4abb-b988-df385d0658b6 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] changing access on None May 28 13:00:06 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-960c297a-a426-4abb-b988-df385d0658b6 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:00:06 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-960c297a-a426-4abb-b988-df385d0658b6 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] {'allow_redirects': True, May 28 13:00:06 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-960c297a-a426-4abb-b988-df385d0658b6 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] 'params': {'name': '7fdd602c-79d0-479c-95a2-336b202c6639'}} May 28 13:00:06 l75lg1-v1 dstat.sh[49771]: 28-05 13:00:06| 7 1 90 1 0|5680M 1776M 278M 7890M| 15k 5765B| 0 1272k| 0 174 |4335 6988 |1.28 1.09 1.02|3.0 2.0 0| 0 0 | 0 2048M| 29 362 0 42 2 May 28 13:00:06 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-94982b2d-ef50-47b2-902c-135c0ccc148c tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] http://10.27.203.238/share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/messages/000c1d75-8f46-4f5e-b164-9704c716a253 returned with HTTP 204 May 28 13:00:06 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 834/1697] 10.27.203.238 () {64 vars in 1460 bytes} [Tue May 28 13:00:06 2024] DELETE /share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/messages/000c1d75-8f46-4f5e-b164-9704c716a253 => generated 0 bytes in 24 msecs (HTTP/1.1 204) 6 headers in 245 bytes (1 switches on core 0) May 28 13:00:06 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-f4e2a911-ef39-471a-bcb6-f24cc86a4a42 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] DELETE http://10.27.203.238/share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/shares/7eaac6de-9c35-40b2-8f16-30e039e8da55 May 28 13:00:06 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-f4e2a911-ef39-471a-bcb6-f24cc86a4a42 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:06 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-f4e2a911-ef39-471a-bcb6-f24cc86a4a42 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Calling method 'ShareMixin.delete' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:06 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.v1.shares [None req-f4e2a911-ef39-471a-bcb6-f24cc86a4a42 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Delete share with id: 7eaac6de-9c35-40b2-8f16-30e039e8da55 May 28 13:00:06 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.quota [None req-f4e2a911-ef39-471a-bcb6-f24cc86a4a42 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Created reservations ['f0b3eb3b-a5a8-46c3-8a0c-4374182871cc', '68059cc8-050a-4414-a4fd-27126ee2526c', 'fc8d25cc-c879-4a41-a5d2-839836cb19f5', 'd8e3144f-b2ba-48d6-b83a-75e6d043315d'] {{(pid=98329) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 13:00:06 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.quota [None req-f4e2a911-ef39-471a-bcb6-f24cc86a4a42 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Committed reservations ['f0b3eb3b-a5a8-46c3-8a0c-4374182871cc', '68059cc8-050a-4414-a4fd-27126ee2526c', 'fc8d25cc-c879-4a41-a5d2-839836cb19f5', 'd8e3144f-b2ba-48d6-b83a-75e6d043315d'] {{(pid=98329) commit /opt/stack/manila/manila/quota.py:1063}} May 28 13:00:06 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-f4e2a911-ef39-471a-bcb6-f24cc86a4a42 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] http://10.27.203.238/share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/shares/7eaac6de-9c35-40b2-8f16-30e039e8da55 returned with HTTP 202 May 28 13:00:06 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 864/1698] 10.27.203.238 () {64 vars in 1454 bytes} [Tue May 28 13:00:06 2024] DELETE /share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/shares/7eaac6de-9c35-40b2-8f16-30e039e8da55 => generated 0 bytes in 215 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 13:00:06 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-c7d128e1-8d8a-47f8-9813-b3daf2072467 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] DELETE http://10.27.203.238/share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/types/5c6c7e5a-307f-4a6d-b824-a061f86076f2 May 28 13:00:06 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-c7d128e1-8d8a-47f8-9813-b3daf2072467 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:06 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-c7d128e1-8d8a-47f8-9813-b3daf2072467 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Calling method 'ShareTypesController._delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:06 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-c7d128e1-8d8a-47f8-9813-b3daf2072467 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] http://10.27.203.238/share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/types/5c6c7e5a-307f-4a6d-b824-a061f86076f2 returned with HTTP 202 May 28 13:00:06 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 835/1699] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:00:06 2024] DELETE /share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/types/5c6c7e5a-307f-4a6d-b824-a061f86076f2 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 13:00:06 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-95fb71f8-5890-4f04-bd62-a272bf7bc807 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] GET http://10.27.203.238/share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/types/5c6c7e5a-307f-4a6d-b824-a061f86076f2 May 28 13:00:06 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-95fb71f8-5890-4f04-bd62-a272bf7bc807 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:06 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-95fb71f8-5890-4f04-bd62-a272bf7bc807 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Calling method 'ShareTypesController.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:06 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-95fb71f8-5890-4f04-bd62-a272bf7bc807 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] HTTP exception thrown: Share type not found. May 28 13:00:06 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-95fb71f8-5890-4f04-bd62-a272bf7bc807 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] http://10.27.203.238/share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/types/5c6c7e5a-307f-4a6d-b824-a061f86076f2 returned with HTTP 404 May 28 13:00:06 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 865/1700] 10.27.203.238 () {64 vars in 1448 bytes} [Tue May 28 13:00:06 2024] GET /share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/types/5c6c7e5a-307f-4a6d-b824-a061f86076f2 => generated 67 bytes in 10 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 13:00:06 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-120a6939-607d-4fc8-9d06-f2fdffeb32db tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] DELETE http://10.27.203.238/share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/types/18791357-4918-4776-94fd-a844ce7bbb2f May 28 13:00:06 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-120a6939-607d-4fc8-9d06-f2fdffeb32db tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:06 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-120a6939-607d-4fc8-9d06-f2fdffeb32db tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Calling method 'ShareTypesController._delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:06 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-120a6939-607d-4fc8-9d06-f2fdffeb32db tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] http://10.27.203.238/share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/types/18791357-4918-4776-94fd-a844ce7bbb2f returned with HTTP 202 May 28 13:00:06 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 836/1701] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:00:06 2024] DELETE /share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/types/18791357-4918-4776-94fd-a844ce7bbb2f => generated 0 bytes in 58 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 13:00:06 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-3544a257-9d53-46ac-8796-ce6a65c3572d tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] GET http://10.27.203.238/share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/types/18791357-4918-4776-94fd-a844ce7bbb2f May 28 13:00:06 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-3544a257-9d53-46ac-8796-ce6a65c3572d tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:06 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-3544a257-9d53-46ac-8796-ce6a65c3572d tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Calling method 'ShareTypesController.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:06 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-960c297a-a426-4abb-b988-df385d0658b6 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:00:06 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-960c297a-a426-4abb-b988-df385d0658b6 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] [Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=1, created='2024-05-28T12:58:43.845440Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='31b6534b-d142-4561-992f-4f0759db302d', id=32, internal=False, is_s3_default_policy=False, name='7fdd602c-79d0-479c-95a2-336b202c6639', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=['*'], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=[], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=[], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T13:00:05.072856Z', tenant_id=1, tenant_name='default', title='7fdd602c-79d0-479c-95a2-336b202c6639', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/32/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[])] May 28 13:00:06 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-960c297a-a426-4abb-b988-df385d0658b6 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 13:00:06 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-960c297a-a426-4abb-b988-df385d0658b6 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] changing access on /manila/manila-7fdd602c-79d0-479c-95a2-336b202c6639. Rules: {'nfs_read_write': ['203.0.113.123'], 'nfs_read_only': []} May 28 13:00:06 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-960c297a-a426-4abb-b988-df385d0658b6 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] >>> [PATCH] https://127.0.0.1:40443/api/viewpolicies/32/ May 28 13:00:06 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-960c297a-a426-4abb-b988-df385d0658b6 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] {'data': '{"name": "7fdd602c-79d0-479c-95a2-336b202c6639", "nfs_no_squash": ' May 28 13:00:06 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-960c297a-a426-4abb-b988-df385d0658b6 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] '["*"], "nfs_root_squash": ["*"], "nfs_read_write": ' May 28 13:00:06 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-960c297a-a426-4abb-b988-df385d0658b6 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] '["203.0.113.123"], "nfs_read_only": []}', May 28 13:00:06 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-960c297a-a426-4abb-b988-df385d0658b6 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] 'params': None} May 28 13:00:06 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-3544a257-9d53-46ac-8796-ce6a65c3572d tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] HTTP exception thrown: Share type not found. May 28 13:00:06 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-3544a257-9d53-46ac-8796-ce6a65c3572d tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] http://10.27.203.238/share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/types/18791357-4918-4776-94fd-a844ce7bbb2f returned with HTTP 404 May 28 13:00:06 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 866/1702] 10.27.203.238 () {64 vars in 1448 bytes} [Tue May 28 13:00:06 2024] GET /share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/types/18791357-4918-4776-94fd-a844ce7bbb2f => generated 67 bytes in 10 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 13:00:06 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-6070b965-1bab-4b9e-8bcf-e67e258ab0d0 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] DELETE http://10.27.203.238/share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/types/efeec024-6fbf-472e-819c-7ec1a0f198ff May 28 13:00:06 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-6070b965-1bab-4b9e-8bcf-e67e258ab0d0 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:06 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-6070b965-1bab-4b9e-8bcf-e67e258ab0d0 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Calling method 'ShareTypesController._delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:06 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-6070b965-1bab-4b9e-8bcf-e67e258ab0d0 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] http://10.27.203.238/share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/types/efeec024-6fbf-472e-819c-7ec1a0f198ff returned with HTTP 202 May 28 13:00:06 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 837/1703] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:00:06 2024] DELETE /share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/types/efeec024-6fbf-472e-819c-7ec1a0f198ff => generated 0 bytes in 59 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 13:00:06 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-d3770e4e-a1a3-44fd-adcd-a13662f59aef tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] GET http://10.27.203.238/share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/types/efeec024-6fbf-472e-819c-7ec1a0f198ff May 28 13:00:06 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-d3770e4e-a1a3-44fd-adcd-a13662f59aef tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:06 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-d3770e4e-a1a3-44fd-adcd-a13662f59aef tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Calling method 'ShareTypesController.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:06 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-d3770e4e-a1a3-44fd-adcd-a13662f59aef tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] HTTP exception thrown: Share type not found. May 28 13:00:06 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-d3770e4e-a1a3-44fd-adcd-a13662f59aef tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] http://10.27.203.238/share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/types/efeec024-6fbf-472e-819c-7ec1a0f198ff returned with HTTP 404 May 28 13:00:06 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 867/1704] 10.27.203.238 () {64 vars in 1448 bytes} [Tue May 28 13:00:06 2024] GET /share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/types/efeec024-6fbf-472e-819c-7ec1a0f198ff => generated 67 bytes in 11 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 13:00:06 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-a63aea95-96f4-4275-b634-eccae4ad6cca tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] DELETE http://10.27.203.238/share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/types/ffa207cc-9f4c-49d2-aebd-e976439c3b15 May 28 13:00:06 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-a63aea95-96f4-4275-b634-eccae4ad6cca tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:06 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-a63aea95-96f4-4275-b634-eccae4ad6cca tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Calling method 'ShareTypesController._delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:06 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-a63aea95-96f4-4275-b634-eccae4ad6cca tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] http://10.27.203.238/share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/types/ffa207cc-9f4c-49d2-aebd-e976439c3b15 returned with HTTP 202 May 28 13:00:06 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 838/1705] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:00:06 2024] DELETE /share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/types/ffa207cc-9f4c-49d2-aebd-e976439c3b15 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 13:00:06 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ae6b4d2a-1cde-480c-a3e3-0f3cad1a2402 tempest-ShareTransferNegativeTest-884271560 None] <<< [GET] https://127.0.0.1:40443/api/views/ May 28 13:00:06 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ae6b4d2a-1cde-480c-a3e3-0f3cad1a2402 tempest-ShareTransferNegativeTest-884271560 None] [] May 28 13:00:06 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ae6b4d2a-1cde-480c-a3e3-0f3cad1a2402 tempest-ShareTransferNegativeTest-884271560 None] --- [GET] https://127.0.0.1:40443/api/views/: Done May 28 13:00:06 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ae6b4d2a-1cde-480c-a3e3-0f3cad1a2402 tempest-ShareTransferNegativeTest-884271560 None] >>> [POST] https://127.0.0.1:40443/api/views/ May 28 13:00:06 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ae6b4d2a-1cde-480c-a3e3-0f3cad1a2402 tempest-ShareTransferNegativeTest-884271560 None] {'data': '{"name": "e21891ab-7145-4d59-b238-375b52d59cb7", "path": ' May 28 13:00:06 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ae6b4d2a-1cde-480c-a3e3-0f3cad1a2402 tempest-ShareTransferNegativeTest-884271560 None] '"/manila/manila-e21891ab-7145-4d59-b238-375b52d59cb7", "policy_id": ' May 28 13:00:06 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ae6b4d2a-1cde-480c-a3e3-0f3cad1a2402 tempest-ShareTransferNegativeTest-884271560 None] '41, "create_dir": true, "protocols": ["NFS"]}', May 28 13:00:06 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ae6b4d2a-1cde-480c-a3e3-0f3cad1a2402 tempest-ShareTransferNegativeTest-884271560 None] 'json': None, May 28 13:00:06 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ae6b4d2a-1cde-480c-a3e3-0f3cad1a2402 tempest-ShareTransferNegativeTest-884271560 None] 'params': None} May 28 13:00:06 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-117694dd-9210-48cf-9033-c390a54f3cce tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] GET http://10.27.203.238/share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/types/ffa207cc-9f4c-49d2-aebd-e976439c3b15 May 28 13:00:06 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-117694dd-9210-48cf-9033-c390a54f3cce tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:06 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-117694dd-9210-48cf-9033-c390a54f3cce tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Calling method 'ShareTypesController.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:06 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-117694dd-9210-48cf-9033-c390a54f3cce tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] HTTP exception thrown: Share type not found. May 28 13:00:06 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-117694dd-9210-48cf-9033-c390a54f3cce tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] http://10.27.203.238/share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/types/ffa207cc-9f4c-49d2-aebd-e976439c3b15 returned with HTTP 404 May 28 13:00:06 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 868/1706] 10.27.203.238 () {64 vars in 1448 bytes} [Tue May 28 13:00:06 2024] GET /share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/types/ffa207cc-9f4c-49d2-aebd-e976439c3b15 => generated 67 bytes in 11 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 13:00:06 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-d92acabb-ebf2-4e1b-946c-7611a4822ec4 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] DELETE http://10.27.203.238/share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/types/8ba62ddc-37c8-4aa2-91e9-6e9922bf3c3b May 28 13:00:06 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-d92acabb-ebf2-4e1b-946c-7611a4822ec4 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:06 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-d92acabb-ebf2-4e1b-946c-7611a4822ec4 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Calling method 'ShareTypesController._delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:06 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-d92acabb-ebf2-4e1b-946c-7611a4822ec4 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] http://10.27.203.238/share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/types/8ba62ddc-37c8-4aa2-91e9-6e9922bf3c3b returned with HTTP 202 May 28 13:00:06 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 839/1707] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:00:06 2024] DELETE /share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/types/8ba62ddc-37c8-4aa2-91e9-6e9922bf3c3b => generated 0 bytes in 50 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 13:00:06 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-a7d40c33-c1d2-4820-88e1-9e966c6c5774 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] GET http://10.27.203.238/share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/types/8ba62ddc-37c8-4aa2-91e9-6e9922bf3c3b May 28 13:00:06 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-a7d40c33-c1d2-4820-88e1-9e966c6c5774 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:06 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-a7d40c33-c1d2-4820-88e1-9e966c6c5774 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Calling method 'ShareTypesController.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:06 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-a7d40c33-c1d2-4820-88e1-9e966c6c5774 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] HTTP exception thrown: Share type not found. May 28 13:00:06 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-a7d40c33-c1d2-4820-88e1-9e966c6c5774 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] http://10.27.203.238/share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/types/8ba62ddc-37c8-4aa2-91e9-6e9922bf3c3b returned with HTTP 404 May 28 13:00:06 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 869/1708] 10.27.203.238 () {64 vars in 1448 bytes} [Tue May 28 13:00:06 2024] GET /share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/types/8ba62ddc-37c8-4aa2-91e9-6e9922bf3c3b => generated 67 bytes in 11 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 13:00:06 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-68c9c16f-399b-4b42-b15c-7b0f36feb8fb tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] DELETE http://10.27.203.238/share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/types/4cb71112-8c21-4a60-9f4a-e7939e3a25b1 May 28 13:00:06 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-68c9c16f-399b-4b42-b15c-7b0f36feb8fb tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:06 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-68c9c16f-399b-4b42-b15c-7b0f36feb8fb tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Calling method 'ShareTypesController._delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:06 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-68c9c16f-399b-4b42-b15c-7b0f36feb8fb tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] http://10.27.203.238/share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/types/4cb71112-8c21-4a60-9f4a-e7939e3a25b1 returned with HTTP 202 May 28 13:00:06 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 840/1709] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:00:06 2024] DELETE /share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/types/4cb71112-8c21-4a60-9f4a-e7939e3a25b1 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 13:00:06 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-c3ac7160-0cef-41ec-bbb7-ef732444fe00 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] GET http://10.27.203.238/share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/types/4cb71112-8c21-4a60-9f4a-e7939e3a25b1 May 28 13:00:06 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-c3ac7160-0cef-41ec-bbb7-ef732444fe00 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:06 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-c3ac7160-0cef-41ec-bbb7-ef732444fe00 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Calling method 'ShareTypesController.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:06 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-c3ac7160-0cef-41ec-bbb7-ef732444fe00 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] HTTP exception thrown: Share type not found. May 28 13:00:06 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-c3ac7160-0cef-41ec-bbb7-ef732444fe00 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] http://10.27.203.238/share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/types/4cb71112-8c21-4a60-9f4a-e7939e3a25b1 returned with HTTP 404 May 28 13:00:06 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 870/1710] 10.27.203.238 () {64 vars in 1448 bytes} [Tue May 28 13:00:06 2024] GET /share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/types/4cb71112-8c21-4a60-9f4a-e7939e3a25b1 => generated 67 bytes in 11 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 13:00:06 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-1fef2d2e-e4bf-4168-8782-caaeb0aab8f2 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] DELETE http://10.27.203.238/share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/types/291790ef-c741-4b2b-ba05-f0ce22d6436c May 28 13:00:06 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-1fef2d2e-e4bf-4168-8782-caaeb0aab8f2 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:06 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-1fef2d2e-e4bf-4168-8782-caaeb0aab8f2 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Calling method 'ShareTypesController._delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:06 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-1fef2d2e-e4bf-4168-8782-caaeb0aab8f2 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] http://10.27.203.238/share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/types/291790ef-c741-4b2b-ba05-f0ce22d6436c returned with HTTP 202 May 28 13:00:06 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 841/1711] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:00:06 2024] DELETE /share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/types/291790ef-c741-4b2b-ba05-f0ce22d6436c => generated 0 bytes in 46 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 13:00:06 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-3c7a276a-5cb9-4f3b-99fd-cc267f5c4fb8 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] GET http://10.27.203.238/share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/types/291790ef-c741-4b2b-ba05-f0ce22d6436c May 28 13:00:06 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-3c7a276a-5cb9-4f3b-99fd-cc267f5c4fb8 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:06 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-3c7a276a-5cb9-4f3b-99fd-cc267f5c4fb8 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Calling method 'ShareTypesController.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:06 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-3c7a276a-5cb9-4f3b-99fd-cc267f5c4fb8 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] HTTP exception thrown: Share type not found. May 28 13:00:06 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-3c7a276a-5cb9-4f3b-99fd-cc267f5c4fb8 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] http://10.27.203.238/share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/types/291790ef-c741-4b2b-ba05-f0ce22d6436c returned with HTTP 404 May 28 13:00:06 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 871/1712] 10.27.203.238 () {64 vars in 1448 bytes} [Tue May 28 13:00:06 2024] GET /share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/types/291790ef-c741-4b2b-ba05-f0ce22d6436c => generated 67 bytes in 11 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 13:00:06 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-7c43a64a-505d-4890-9a7e-ebb769c578b9 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] DELETE http://10.27.203.238/share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/types/7072fb6e-708b-4734-944c-6ca799508a26 May 28 13:00:06 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-7c43a64a-505d-4890-9a7e-ebb769c578b9 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:06 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-7c43a64a-505d-4890-9a7e-ebb769c578b9 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Calling method 'ShareTypesController._delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:06 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-7c43a64a-505d-4890-9a7e-ebb769c578b9 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] http://10.27.203.238/share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/types/7072fb6e-708b-4734-944c-6ca799508a26 returned with HTTP 202 May 28 13:00:06 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 842/1713] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:00:06 2024] DELETE /share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/types/7072fb6e-708b-4734-944c-6ca799508a26 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 13:00:06 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-a4fe5747-7114-475d-b6df-b3e3c2d9987e tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] GET http://10.27.203.238/share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/types/7072fb6e-708b-4734-944c-6ca799508a26 May 28 13:00:06 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-a4fe5747-7114-475d-b6df-b3e3c2d9987e tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:06 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-a4fe5747-7114-475d-b6df-b3e3c2d9987e tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Calling method 'ShareTypesController.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:06 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-a4fe5747-7114-475d-b6df-b3e3c2d9987e tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] HTTP exception thrown: Share type not found. May 28 13:00:06 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-a4fe5747-7114-475d-b6df-b3e3c2d9987e tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] http://10.27.203.238/share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/types/7072fb6e-708b-4734-944c-6ca799508a26 returned with HTTP 404 May 28 13:00:06 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 872/1714] 10.27.203.238 () {64 vars in 1448 bytes} [Tue May 28 13:00:06 2024] GET /share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/types/7072fb6e-708b-4734-944c-6ca799508a26 => generated 67 bytes in 10 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 13:00:06 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-7f8fd648-cfb6-44dc-b5f9-a723fa66cd72 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] DELETE http://10.27.203.238/share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/types/18edbb09-6fa2-4d1c-9f7d-775877d3261f May 28 13:00:06 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-7f8fd648-cfb6-44dc-b5f9-a723fa66cd72 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:06 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-7f8fd648-cfb6-44dc-b5f9-a723fa66cd72 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Calling method 'ShareTypesController._delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:07 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-7f8fd648-cfb6-44dc-b5f9-a723fa66cd72 tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] http://10.27.203.238/share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/types/18edbb09-6fa2-4d1c-9f7d-775877d3261f returned with HTTP 202 May 28 13:00:07 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 843/1715] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:00:06 2024] DELETE /share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/types/18edbb09-6fa2-4d1c-9f7d-775877d3261f => generated 0 bytes in 53 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 13:00:07 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-ab221b0e-2c05-4101-b39e-fb3ed15875be tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] GET http://10.27.203.238/share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/types/18edbb09-6fa2-4d1c-9f7d-775877d3261f May 28 13:00:07 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-ab221b0e-2c05-4101-b39e-fb3ed15875be tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:07 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-ab221b0e-2c05-4101-b39e-fb3ed15875be tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Calling method 'ShareTypesController.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:07 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-ab221b0e-2c05-4101-b39e-fb3ed15875be tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] HTTP exception thrown: Share type not found. May 28 13:00:07 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-ab221b0e-2c05-4101-b39e-fb3ed15875be tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] http://10.27.203.238/share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/types/18edbb09-6fa2-4d1c-9f7d-775877d3261f returned with HTTP 404 May 28 13:00:07 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 873/1716] 10.27.203.238 () {64 vars in 1448 bytes} [Tue May 28 13:00:07 2024] GET /share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/types/18edbb09-6fa2-4d1c-9f7d-775877d3261f => generated 67 bytes in 13 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 13:00:07 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-c9a4d734-2f79-4f84-8ab9-cf169d07638a tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] DELETE http://10.27.203.238/share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/types/70a6ce22-aed6-472b-934e-de4474b12a2f May 28 13:00:07 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-c9a4d734-2f79-4f84-8ab9-cf169d07638a tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:07 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-c9a4d734-2f79-4f84-8ab9-cf169d07638a tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Calling method 'ShareTypesController._delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:07 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-c9a4d734-2f79-4f84-8ab9-cf169d07638a tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] http://10.27.203.238/share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/types/70a6ce22-aed6-472b-934e-de4474b12a2f returned with HTTP 202 May 28 13:00:07 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 844/1717] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:00:07 2024] DELETE /share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/types/70a6ce22-aed6-472b-934e-de4474b12a2f => generated 0 bytes in 61 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 13:00:07 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-2f5ab3ba-71b0-4790-9bf7-70cbc53b243e tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] GET http://10.27.203.238/share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/types/70a6ce22-aed6-472b-934e-de4474b12a2f May 28 13:00:07 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-2f5ab3ba-71b0-4790-9bf7-70cbc53b243e tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:07 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-2f5ab3ba-71b0-4790-9bf7-70cbc53b243e tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] Calling method 'ShareTypesController.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:07 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-2f5ab3ba-71b0-4790-9bf7-70cbc53b243e tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] HTTP exception thrown: Share type not found. May 28 13:00:07 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-2f5ab3ba-71b0-4790-9bf7-70cbc53b243e tempest-UserMessageTest-1084663522 tempest-UserMessageTest-1084663522-project-admin] http://10.27.203.238/share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/types/70a6ce22-aed6-472b-934e-de4474b12a2f returned with HTTP 404 May 28 13:00:07 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 874/1718] 10.27.203.238 () {64 vars in 1448 bytes} [Tue May 28 13:00:07 2024] GET /share/v2/33b0ebad17d34f8cb4004ebcd1e0fb91/types/70a6ce22-aed6-472b-934e-de4474b12a2f => generated 67 bytes in 11 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 13:00:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea507e33-a492-4651-9dc3-6d1d89295855 tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-ea507e33-a492-4651-9dc3-6d1d89295855 tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:00:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea507e33-a492-4651-9dc3-6d1d89295855 tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc0787a-87c1-47b2-a52a-52220513c434 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc0787a-87c1-47b2-a52a-52220513c434 None admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc0787a-87c1-47b2-a52a-52220513c434 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc0787a-87c1-47b2-a52a-52220513c434 None admin] PATH_INFO: `/v3/users/daaf92d9d1cb40428117f9aa7d5bc657` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc0787a-87c1-47b2-a52a-52220513c434 None admin] RBAC: Authorizing `identity:delete_user(user_id=daaf92d9d1cb40428117f9aa7d5bc657)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc0787a-87c1-47b2-a52a-52220513c434 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:07 l75lg1-v1 devstack@placement-api.service[78202]: DEBUG dbcounter [-] [78202] Writing DB stats placement:SELECT=2 {{(pid=78202) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:00:07 l75lg1-v1 devstack@placement-api.service[78201]: DEBUG dbcounter [-] [78201] Writing DB stats placement:SELECT=2 {{(pid=78201) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:00:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-1dc0787a-87c1-47b2-a52a-52220513c434 None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'daaf92d9d1cb40428117f9aa7d5bc657', 'request_id': 'req-1dc0787a-87c1-47b2-a52a-52220513c434'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:07 l75lg1-v1 dstat.sh[49771]: 28-05 13:00:07| 9 1 86 4 0|5680M 1776M 278M 7891M| 11k 6008B| 0 2683k| 0 452 |7334 12k|1.26 1.09 1.02|1.0 1.0 0| 0 0 | 0 2048M| 29 362 0 42 2 May 28 13:00:07 l75lg1-v1 nova-conductor[83648]: DEBUG dbcounter [-] [83648] Writing DB stats nova_cell1:SELECT=4 {{(pid=83648) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:00:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-1dc0787a-87c1-47b2-a52a-52220513c434 None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'daaf92d9d1cb40428117f9aa7d5bc657', 'request_id': 'req-1dc0787a-87c1-47b2-a52a-52220513c434'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-1dc0787a-87c1-47b2-a52a-52220513c434 None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'daaf92d9d1cb40428117f9aa7d5bc657', 'request_id': 'req-1dc0787a-87c1-47b2-a52a-52220513c434'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-1dc0787a-87c1-47b2-a52a-52220513c434 None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'daaf92d9d1cb40428117f9aa7d5bc657', 'request_id': 'req-1dc0787a-87c1-47b2-a52a-52220513c434'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-1dc0787a-87c1-47b2-a52a-52220513c434 None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'daaf92d9d1cb40428117f9aa7d5bc657', 'request_id': 'req-1dc0787a-87c1-47b2-a52a-52220513c434'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:07 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1377/2725] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 13:00:07 2024] DELETE /identity/v3/users/daaf92d9d1cb40428117f9aa7d5bc657 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:00:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e17456f-71ee-46e3-92b4-b2d94cc5b188 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e17456f-71ee-46e3-92b4-b2d94cc5b188 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e17456f-71ee-46e3-92b4-b2d94cc5b188 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:07 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-5e17456f-71ee-46e3-92b4-b2d94cc5b188 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 13:00:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-5e17456f-71ee-46e3-92b4-b2d94cc5b188 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 13:00:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-5e17456f-71ee-46e3-92b4-b2d94cc5b188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:00:07 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1349/2726] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 13:00:07 2024] POST /identity/v3/auth/tokens => generated 2960 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 13:00:07 l75lg1-v1 neutron-server[77618]: DEBUG neutron.wsgi [-] (77618) accepted ('10.27.203.238', 58498) {{(pid=77618) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 13:00:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc0787a-87c1-47b2-a52a-52220513c434 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-1dc0787a-87c1-47b2-a52a-52220513c434 None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:00:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc0787a-87c1-47b2-a52a-52220513c434 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb55c828-a78c-4401-85ac-bcee658002c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef17047035e4b518fd5360a01f2da1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb55c828-a78c-4401-85ac-bcee658002c3 service neutron] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb55c828-a78c-4401-85ac-bcee658002c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb55c828-a78c-4401-85ac-bcee658002c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb55c828-a78c-4401-85ac-bcee658002c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb55c828-a78c-4401-85ac-bcee658002c3 service neutron] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:07 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1378/2727] 10.27.203.238 () {64 vars in 1432 bytes} [Tue May 28 13:00:07 2024] GET /identity/v3/auth/tokens => generated 2960 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 28 13:00:07 l75lg1-v1 neutron-server[77618]: INFO neutron.wsgi [None req-f8be2f42-6225-44b4-8f4d-a53803d5641d None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=33b0ebad17d34f8cb4004ebcd1e0fb91&name=default HTTP/1.1" status: 200 len: 216 time: 0.1278520 May 28 13:00:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e17456f-71ee-46e3-92b4-b2d94cc5b188 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-5e17456f-71ee-46e3-92b4-b2d94cc5b188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:00:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e17456f-71ee-46e3-92b4-b2d94cc5b188 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bffcbf-efa0-4f1e-9335-46b0bab343f2 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bffcbf-efa0-4f1e-9335-46b0bab343f2 None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bffcbf-efa0-4f1e-9335-46b0bab343f2 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bffcbf-efa0-4f1e-9335-46b0bab343f2 None admin] PATH_INFO: `/v3/projects/33b0ebad17d34f8cb4004ebcd1e0fb91` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bffcbf-efa0-4f1e-9335-46b0bab343f2 None admin] RBAC: Authorizing `identity:delete_project(project_id=33b0ebad17d34f8cb4004ebcd1e0fb91)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bffcbf-efa0-4f1e-9335-46b0bab343f2 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-83bffcbf-efa0-4f1e-9335-46b0bab343f2 None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33b0ebad17d34f8cb4004ebcd1e0fb91', 'request_id': 'req-83bffcbf-efa0-4f1e-9335-46b0bab343f2'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-83bffcbf-efa0-4f1e-9335-46b0bab343f2 None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33b0ebad17d34f8cb4004ebcd1e0fb91', 'request_id': 'req-83bffcbf-efa0-4f1e-9335-46b0bab343f2'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:07 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ae6b4d2a-1cde-480c-a3e3-0f3cad1a2402 tempest-ShareTransferNegativeTest-884271560 None] <<< [POST] https://127.0.0.1:40443/api/views/ May 28 13:00:07 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ae6b4d2a-1cde-480c-a3e3-0f3cad1a2402 tempest-ShareTransferNegativeTest-884271560 None] Bunch(abac_tags=[], abe_max_depth=None, abe_protocols=[], alias='', allow_anonymous_access=False, allow_s3_anonymous_access=False, auto_commit='0d', bucket='', bucket_creators=[], bucket_creators_groups=[], bucket_owner=None, bulk_permission_update_progress=None, bulk_permission_update_state=None, cluster='loop75-kfs', cluster_id=1, created='2024-05-28T13:00:07.168642Z', enabled=True, files_retention_mode='NONE', guid='8710772f-3a14-41a8-afe3-153430307cc8', id=40, ignore_oos=False, internal=False, is_remote=False, is_seamless=False, logical_capacity=0, max_retention_period=None, min_retention_period=None, name='e21891ab-7145-4d59-b238-375b52d59cb7', nfs_interop_flags='BOTH_NFS3_AND_NFS4_INTEROP_DISABLED', path='/manila/manila-e21891ab-7145-4d59-b238-375b52d59cb7', physical_capacity=0, policy='e21891ab-7145-4d59-b238-375b52d59cb7', policy_id=41, protocols=['NFS'], qos_policy=None, qos_policy_id=None, s3_locks=False, s3_locks_retention_mode='NONE', s3_locks_retention_period='', s3_object_ownership_rule='ObjectWriter', s3_unverified_lookup=False, s3_versioning=False, select_for_live_monitoring=False, share='', share_acl=Bunch(acl=[], enabled=False), sync='SYNCED', sync_time='2024-05-28T13:00:07.522030Z', tenant_id=1, tenant_name='default', title='/manila/manila-e21891ab-7145-4d59-b238-375b52d59cb7', url='https://127.0.0.1:40443/api/views/40/') May 28 13:00:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-83bffcbf-efa0-4f1e-9335-46b0bab343f2 None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33b0ebad17d34f8cb4004ebcd1e0fb91', 'request_id': 'req-83bffcbf-efa0-4f1e-9335-46b0bab343f2'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:07 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ae6b4d2a-1cde-480c-a3e3-0f3cad1a2402 tempest-ShareTransferNegativeTest-884271560 None] --- [POST] https://127.0.0.1:40443/api/views/: Done May 28 13:00:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-83bffcbf-efa0-4f1e-9335-46b0bab343f2 None admin] The token cache is being invalidate because project 33b0ebad17d34f8cb4004ebcd1e0fb91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 13:00:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-83bffcbf-efa0-4f1e-9335-46b0bab343f2 None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-83bffcbf-efa0-4f1e-9335-46b0bab343f2 None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:07 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1350/2728] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 13:00:07 2024] DELETE /identity/v3/projects/33b0ebad17d34f8cb4004ebcd1e0fb91 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:00:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba89f85-9d72-427a-b58d-c552f50a64e8 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba89f85-9d72-427a-b58d-c552f50a64e8 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba89f85-9d72-427a-b58d-c552f50a64e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:07 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-0ba89f85-9d72-427a-b58d-c552f50a64e8 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 13:00:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-0ba89f85-9d72-427a-b58d-c552f50a64e8 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 13:00:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-0ba89f85-9d72-427a-b58d-c552f50a64e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:00:07 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1379/2729] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 13:00:07 2024] POST /identity/v3/auth/tokens => generated 312 bytes in 21 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 28 13:00:07 l75lg1-v1 manila-share[98474]: INFO manila.share.manager [None req-ae6b4d2a-1cde-480c-a3e3-0f3cad1a2402 tempest-ShareTransferNegativeTest-884271560 None] Share instance e21891ab-7145-4d59-b238-375b52d59cb7 created successfully. May 28 13:00:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb28d86-aac5-4c1d-bc6a-48117aaec359 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb28d86-aac5-4c1d-bc6a-48117aaec359 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb28d86-aac5-4c1d-bc6a-48117aaec359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:07 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-cbb28d86-aac5-4c1d-bc6a-48117aaec359 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 13:00:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-cbb28d86-aac5-4c1d-bc6a-48117aaec359 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 13:00:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-cbb28d86-aac5-4c1d-bc6a-48117aaec359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:00:07 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1351/2730] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 13:00:07 2024] POST /identity/v3/auth/tokens => generated 2960 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 13:00:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba89f85-9d72-427a-b58d-c552f50a64e8 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba89f85-9d72-427a-b58d-c552f50a64e8 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096b04c0-6937-46df-af3f-87758f724b9a None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096b04c0-6937-46df-af3f-87758f724b9a None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096b04c0-6937-46df-af3f-87758f724b9a None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096b04c0-6937-46df-af3f-87758f724b9a None admin] PATH_INFO: `/v3/domains` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096b04c0-6937-46df-af3f-87758f724b9a None admin] RBAC: Adding query filter params (name=Default) {{(pid=51267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 13:00:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096b04c0-6937-46df-af3f-87758f724b9a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096b04c0-6937-46df-af3f-87758f724b9a None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:07 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1380/2731] 10.27.203.238 () {62 vars in 1220 bytes} [Tue May 28 13:00:07 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 13:00:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb28d86-aac5-4c1d-bc6a-48117aaec359 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb28d86-aac5-4c1d-bc6a-48117aaec359 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9800a7ae-01b8-46a8-b99a-ec0420183966 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9800a7ae-01b8-46a8-b99a-ec0420183966 None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9800a7ae-01b8-46a8-b99a-ec0420183966 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9800a7ae-01b8-46a8-b99a-ec0420183966 None admin] PATH_INFO: `/v3/projects` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9800a7ae-01b8-46a8-b99a-ec0420183966 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9800a7ae-01b8-46a8-b99a-ec0420183966 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:07 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1352/2732] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 13:00:07 2024] POST /identity/v3/projects => generated 383 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 13:00:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096b04c0-6937-46df-af3f-87758f724b9a None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096b04c0-6937-46df-af3f-87758f724b9a None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0338b1f0-c9dd-41ee-b959-bcb9030cb6c6 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0338b1f0-c9dd-41ee-b959-bcb9030cb6c6 None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0338b1f0-c9dd-41ee-b959-bcb9030cb6c6 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0338b1f0-c9dd-41ee-b959-bcb9030cb6c6 None admin] PATH_INFO: `/v3/users` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0338b1f0-c9dd-41ee-b959-bcb9030cb6c6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0338b1f0-c9dd-41ee-b959-bcb9030cb6c6 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:07 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-0338b1f0-c9dd-41ee-b959-bcb9030cb6c6 None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 13:00:07 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1381/2733] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 13:00:07 2024] POST /identity/v3/users => generated 300 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 13:00:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9800a7ae-01b8-46a8-b99a-ec0420183966 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9800a7ae-01b8-46a8-b99a-ec0420183966 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b1e47f-6470-4596-a530-718693ee8870 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b1e47f-6470-4596-a530-718693ee8870 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b1e47f-6470-4596-a530-718693ee8870 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b1e47f-6470-4596-a530-718693ee8870 None admin] PATH_INFO: `/v3/roles` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b1e47f-6470-4596-a530-718693ee8870 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b1e47f-6470-4596-a530-718693ee8870 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:07 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1353/2734] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 13:00:07 2024] GET /identity/v3/roles => generated 1680 bytes in 19 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 13:00:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0338b1f0-c9dd-41ee-b959-bcb9030cb6c6 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0338b1f0-c9dd-41ee-b959-bcb9030cb6c6 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b6e5a0-9c49-4f7b-8456-8a5fa9dedce9 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b6e5a0-9c49-4f7b-8456-8a5fa9dedce9 None admin] REQUEST_METHOD: `PUT` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b6e5a0-9c49-4f7b-8456-8a5fa9dedce9 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b6e5a0-9c49-4f7b-8456-8a5fa9dedce9 None admin] PATH_INFO: `/v3/projects/ca9b4c5f200844bdbcc6db13e907f21e/users/6a672f6bb8834b02a837a77e45bb8ed0/roles/44620cad10ae407c90c91e2c296adb04` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b6e5a0-9c49-4f7b-8456-8a5fa9dedce9 None admin] RBAC: Authorizing `identity:create_grant(project_id=ca9b4c5f200844bdbcc6db13e907f21e, user_id=6a672f6bb8834b02a837a77e45bb8ed0, role_id=44620cad10ae407c90c91e2c296adb04)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b6e5a0-9c49-4f7b-8456-8a5fa9dedce9 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:07 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1382/2735] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 13:00:07 2024] PUT /identity/v3/projects/ca9b4c5f200844bdbcc6db13e907f21e/users/6a672f6bb8834b02a837a77e45bb8ed0/roles/44620cad10ae407c90c91e2c296adb04 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:00:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0c08c8-c269-497d-aacf-859c9fd202ce None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0c08c8-c269-497d-aacf-859c9fd202ce None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0c08c8-c269-497d-aacf-859c9fd202ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:07 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-6f0c08c8-c269-497d-aacf-859c9fd202ce None None] Truncating password to algorithm specific maximum length 72 characters. May 28 13:00:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-6f0c08c8-c269-497d-aacf-859c9fd202ce None None] MFA Rules not processed for user `6a672f6bb8834b02a837a77e45bb8ed0`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 13:00:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-6f0c08c8-c269-497d-aacf-859c9fd202ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:00:08 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1354/2736] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 13:00:07 2024] POST /identity/v3/auth/tokens => generated 3954 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 13:00:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b6e5a0-9c49-4f7b-8456-8a5fa9dedce9 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b6e5a0-9c49-4f7b-8456-8a5fa9dedce9 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38083866-45bb-4ba1-8077-f836fb0d4bd5 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38083866-45bb-4ba1-8077-f836fb0d4bd5 None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38083866-45bb-4ba1-8077-f836fb0d4bd5 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38083866-45bb-4ba1-8077-f836fb0d4bd5 None admin] PATH_INFO: `/v3/projects` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38083866-45bb-4ba1-8077-f836fb0d4bd5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38083866-45bb-4ba1-8077-f836fb0d4bd5 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:08 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1383/2737] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 13:00:08 2024] POST /identity/v3/projects => generated 385 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 13:00:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0c08c8-c269-497d-aacf-859c9fd202ce None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0c08c8-c269-497d-aacf-859c9fd202ce None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e972bcc1-9991-4a2c-a484-6597ec52229b None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e972bcc1-9991-4a2c-a484-6597ec52229b None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e972bcc1-9991-4a2c-a484-6597ec52229b None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e972bcc1-9991-4a2c-a484-6597ec52229b None admin] PATH_INFO: `/v3/users` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e972bcc1-9991-4a2c-a484-6597ec52229b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e972bcc1-9991-4a2c-a484-6597ec52229b None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:08 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-e972bcc1-9991-4a2c-a484-6597ec52229b None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 13:00:08 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1355/2738] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 13:00:08 2024] POST /identity/v3/users => generated 301 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 13:00:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38083866-45bb-4ba1-8077-f836fb0d4bd5 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38083866-45bb-4ba1-8077-f836fb0d4bd5 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9237d6-f0fe-44da-8907-3dc580c00d71 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9237d6-f0fe-44da-8907-3dc580c00d71 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9237d6-f0fe-44da-8907-3dc580c00d71 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9237d6-f0fe-44da-8907-3dc580c00d71 None admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9237d6-f0fe-44da-8907-3dc580c00d71 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9237d6-f0fe-44da-8907-3dc580c00d71 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:08 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1384/2739] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 13:00:08 2024] GET /identity/v3/roles => generated 1680 bytes in 18 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 13:00:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e972bcc1-9991-4a2c-a484-6597ec52229b None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e972bcc1-9991-4a2c-a484-6597ec52229b None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7330ce47-238d-4d74-ac17-ab33e5064b61 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7330ce47-238d-4d74-ac17-ab33e5064b61 None admin] REQUEST_METHOD: `PUT` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7330ce47-238d-4d74-ac17-ab33e5064b61 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7330ce47-238d-4d74-ac17-ab33e5064b61 None admin] PATH_INFO: `/v3/projects/59c1579619b6422fa4c591102b473b67/users/a3e32284463040608cbbc67da535d0ec/roles/44620cad10ae407c90c91e2c296adb04` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7330ce47-238d-4d74-ac17-ab33e5064b61 None admin] RBAC: Authorizing `identity:create_grant(project_id=59c1579619b6422fa4c591102b473b67, user_id=a3e32284463040608cbbc67da535d0ec, role_id=44620cad10ae407c90c91e2c296adb04)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7330ce47-238d-4d74-ac17-ab33e5064b61 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:08 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1356/2740] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 13:00:08 2024] PUT /identity/v3/projects/59c1579619b6422fa4c591102b473b67/users/a3e32284463040608cbbc67da535d0ec/roles/44620cad10ae407c90c91e2c296adb04 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:00:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de71739-2e9e-4f77-b8cb-f7d1b5a927cd None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de71739-2e9e-4f77-b8cb-f7d1b5a927cd None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de71739-2e9e-4f77-b8cb-f7d1b5a927cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:08 l75lg1-v1 dstat.sh[49771]: 28-05 13:00:08| 9 2 83 6 0|5680M 1775M 278M 7891M| 15k 66B| 0 8030k| 0 657 |7365 12k|1.26 1.09 1.02|1.0 1.0 2.0| 0 0 | 0 2048M| 29 362 0 43 2 May 28 13:00:08 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-7de71739-2e9e-4f77-b8cb-f7d1b5a927cd None None] Truncating password to algorithm specific maximum length 72 characters. May 28 13:00:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-7de71739-2e9e-4f77-b8cb-f7d1b5a927cd None None] MFA Rules not processed for user `a3e32284463040608cbbc67da535d0ec`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 13:00:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-7de71739-2e9e-4f77-b8cb-f7d1b5a927cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:00:08 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-cd3156bc-7f9b-4e24-a583-a0f7b0e4fbd7 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] POST http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/shares/510f7bcd-a0ee-49a6-8093-2640036f2ca3/action May 28 13:00:08 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-cd3156bc-7f9b-4e24-a583-a0f7b0e4fbd7 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Action body: b'{"access_list": null}' {{(pid=98330) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 13:00:08 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-cd3156bc-7f9b-4e24-a583-a0f7b0e4fbd7 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Action: 'action', calling method: ShareController.access_list, body: {"access_list": null} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:00:08 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1385/2741] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 13:00:08 2024] POST /identity/v3/auth/tokens => generated 3956 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 13:00:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7330ce47-238d-4d74-ac17-ab33e5064b61 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7330ce47-238d-4d74-ac17-ab33e5064b61 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:08 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-cd3156bc-7f9b-4e24-a583-a0f7b0e4fbd7 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/shares/510f7bcd-a0ee-49a6-8093-2640036f2ca3/action returned with HTTP 200 May 28 13:00:08 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 845/1719] 10.27.203.238 () {66 vars in 1493 bytes} [Tue May 28 13:00:08 2024] POST /share/v2/a4f3887fa28c457390f5b66615564430/shares/510f7bcd-a0ee-49a6-8093-2640036f2ca3/action => generated 173 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:00:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751fa7d7-f526-4a7e-bbcb-049f23672d5d None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751fa7d7-f526-4a7e-bbcb-049f23672d5d None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751fa7d7-f526-4a7e-bbcb-049f23672d5d None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751fa7d7-f526-4a7e-bbcb-049f23672d5d None admin] PATH_INFO: `/v3/projects` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751fa7d7-f526-4a7e-bbcb-049f23672d5d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751fa7d7-f526-4a7e-bbcb-049f23672d5d None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:08 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1357/2742] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 13:00:08 2024] POST /identity/v3/projects => generated 383 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 13:00:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de71739-2e9e-4f77-b8cb-f7d1b5a927cd None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de71739-2e9e-4f77-b8cb-f7d1b5a927cd None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c381ce37-547a-43c3-a72f-24986548dbba None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c381ce37-547a-43c3-a72f-24986548dbba None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c381ce37-547a-43c3-a72f-24986548dbba None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c381ce37-547a-43c3-a72f-24986548dbba None admin] PATH_INFO: `/v3/users` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c381ce37-547a-43c3-a72f-24986548dbba None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c381ce37-547a-43c3-a72f-24986548dbba None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:08 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-c381ce37-547a-43c3-a72f-24986548dbba None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 13:00:08 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1386/2743] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 13:00:08 2024] POST /identity/v3/users => generated 299 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 13:00:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751fa7d7-f526-4a7e-bbcb-049f23672d5d None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751fa7d7-f526-4a7e-bbcb-049f23672d5d None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4aa6ee2-f37d-4005-b02f-26267b11b29f None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aa6ee2-f37d-4005-b02f-26267b11b29f None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aa6ee2-f37d-4005-b02f-26267b11b29f None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aa6ee2-f37d-4005-b02f-26267b11b29f None admin] PATH_INFO: `/v3/roles` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4aa6ee2-f37d-4005-b02f-26267b11b29f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4aa6ee2-f37d-4005-b02f-26267b11b29f None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:08 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1358/2744] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 13:00:08 2024] GET /identity/v3/roles => generated 1680 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 13:00:08 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d8ef247d-5467-419e-8944-be05c4fd834d tempest-ShareRulesTest-1530341375 None] <<< [PATCH] https://127.0.0.1:40443/api/viewpolicies/40/ May 28 13:00:08 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d8ef247d-5467-419e-8944-be05c4fd834d tempest-ShareRulesTest-1530341375 None] Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=1, created='2024-05-28T13:00:00.296044Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='0c5a8a38-6377-4415-a54d-f55b3cc6ff10', id=40, internal=False, is_s3_default_policy=False, name='ee46a1d1-f743-461e-8bb5-467ee0e99edd', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=['*'], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['203.0.113.77'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['203.0.113.77'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='MODIFYING', sync_time='2024-05-28T13:00:07.366380Z', tenant_id=1, tenant_name='default', title='ee46a1d1-f743-461e-8bb5-467ee0e99edd', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/40/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[]) May 28 13:00:08 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d8ef247d-5467-419e-8944-be05c4fd834d tempest-ShareRulesTest-1530341375 None] --- [PATCH] https://127.0.0.1:40443/api/viewpolicies/40/: Done May 28 13:00:08 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-d8ef247d-5467-419e-8944-be05c4fd834d tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_ee46a1d1-f743-461e-8bb5-467ee0e99edd" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:00:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c381ce37-547a-43c3-a72f-24986548dbba None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:08 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-d8ef247d-5467-419e-8944-be05c4fd834d tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_ee46a1d1-f743-461e-8bb5-467ee0e99edd" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:00:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c381ce37-547a-43c3-a72f-24986548dbba None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa54344f-2d83-478e-b823-89ff4714132f None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa54344f-2d83-478e-b823-89ff4714132f None admin] REQUEST_METHOD: `PUT` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa54344f-2d83-478e-b823-89ff4714132f None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa54344f-2d83-478e-b823-89ff4714132f None admin] PATH_INFO: `/v3/projects/7942989ad1ef4db2b2e923f7316c8511/users/f355576e8bff4613bc147c19f97c711c/roles/e7989893488f483baa107be56668c4f8` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa54344f-2d83-478e-b823-89ff4714132f None admin] RBAC: Authorizing `identity:create_grant(project_id=7942989ad1ef4db2b2e923f7316c8511, user_id=f355576e8bff4613bc147c19f97c711c, role_id=e7989893488f483baa107be56668c4f8)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa54344f-2d83-478e-b823-89ff4714132f None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:08 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1387/2745] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 13:00:08 2024] PUT /identity/v3/projects/7942989ad1ef4db2b2e923f7316c8511/users/f355576e8bff4613bc147c19f97c711c/roles/e7989893488f483baa107be56668c4f8 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:00:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4aa6ee2-f37d-4005-b02f-26267b11b29f None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4aa6ee2-f37d-4005-b02f-26267b11b29f None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:08 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-d8ef247d-5467-419e-8944-be05c4fd834d tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_ee46a1d1-f743-461e-8bb5-467ee0e99edd" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.066s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:00:08 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-d8ef247d-5467-419e-8944-be05c4fd834d tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_ee46a1d1-f743-461e-8bb5-467ee0e99edd" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:00:08 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-d8ef247d-5467-419e-8944-be05c4fd834d tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_ee46a1d1-f743-461e-8bb5-467ee0e99edd" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:00:08 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-d8ef247d-5467-419e-8944-be05c4fd834d tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_ee46a1d1-f743-461e-8bb5-467ee0e99edd" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:00:08 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-d8ef247d-5467-419e-8944-be05c4fd834d tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_ee46a1d1-f743-461e-8bb5-467ee0e99edd" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:00:08 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-d8ef247d-5467-419e-8944-be05c4fd834d tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_ee46a1d1-f743-461e-8bb5-467ee0e99edd" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:00:08 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-d8ef247d-5467-419e-8944-be05c4fd834d tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_ee46a1d1-f743-461e-8bb5-467ee0e99edd" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.004s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:00:08 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-d8ef247d-5467-419e-8944-be05c4fd834d tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_ee46a1d1-f743-461e-8bb5-467ee0e99edd" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:00:08 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-d8ef247d-5467-419e-8944-be05c4fd834d tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_ee46a1d1-f743-461e-8bb5-467ee0e99edd" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:00:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc14b25-bdc1-48cd-abc2-7849912907bc None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc14b25-bdc1-48cd-abc2-7849912907bc None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc14b25-bdc1-48cd-abc2-7849912907bc None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc14b25-bdc1-48cd-abc2-7849912907bc None admin] PATH_INFO: `/v3/roles` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc14b25-bdc1-48cd-abc2-7849912907bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:08 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-d8ef247d-5467-419e-8944-be05c4fd834d tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_ee46a1d1-f743-461e-8bb5-467ee0e99edd" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.004s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:00:08 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-d8ef247d-5467-419e-8944-be05c4fd834d tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_ee46a1d1-f743-461e-8bb5-467ee0e99edd" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:00:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc14b25-bdc1-48cd-abc2-7849912907bc None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:08 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-d8ef247d-5467-419e-8944-be05c4fd834d tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_ee46a1d1-f743-461e-8bb5-467ee0e99edd" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:00:08 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1359/2746] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 13:00:08 2024] GET /identity/v3/roles => generated 1680 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 13:00:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa54344f-2d83-478e-b823-89ff4714132f None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa54344f-2d83-478e-b823-89ff4714132f None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7ed270-6f7f-47d1-8fe5-5781d541ccd5 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7ed270-6f7f-47d1-8fe5-5781d541ccd5 None admin] REQUEST_METHOD: `PUT` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7ed270-6f7f-47d1-8fe5-5781d541ccd5 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7ed270-6f7f-47d1-8fe5-5781d541ccd5 None admin] PATH_INFO: `/v3/projects/7942989ad1ef4db2b2e923f7316c8511/users/f355576e8bff4613bc147c19f97c711c/roles/e7989893488f483baa107be56668c4f8` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7ed270-6f7f-47d1-8fe5-5781d541ccd5 None admin] RBAC: Authorizing `identity:create_grant(project_id=7942989ad1ef4db2b2e923f7316c8511, user_id=f355576e8bff4613bc147c19f97c711c, role_id=e7989893488f483baa107be56668c4f8)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7ed270-6f7f-47d1-8fe5-5781d541ccd5 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:08 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1388/2747] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 13:00:08 2024] PUT /identity/v3/projects/7942989ad1ef4db2b2e923f7316c8511/users/f355576e8bff4613bc147c19f97c711c/roles/e7989893488f483baa107be56668c4f8 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:00:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bb45e7-eeb9-4866-8227-9ff40449415c None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:08 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-243a978d-2430-475e-b6f1-2ae5c9232f33 tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] GET http://10.27.203.238/share/v2/cac556dc39a14bbdbdbabfc80672fb1f/shares/0c7ef0a2-5628-47dd-9eba-98153028dd8a May 28 13:00:08 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-243a978d-2430-475e-b6f1-2ae5c9232f33 tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:08 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-243a978d-2430-475e-b6f1-2ae5c9232f33 tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bb45e7-eeb9-4866-8227-9ff40449415c None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:08 l75lg1-v1 nova-conductor[83647]: DEBUG dbcounter [-] [83647] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=2 {{(pid=83647) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:00:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bb45e7-eeb9-4866-8227-9ff40449415c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:08 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-d8ef247d-5467-419e-8944-be05c4fd834d tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_ee46a1d1-f743-461e-8bb5-467ee0e99edd" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.049s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:00:08 l75lg1-v1 manila-share[98474]: INFO manila.share.access [None req-d8ef247d-5467-419e-8944-be05c4fd834d tempest-ShareRulesTest-1530341375 None] Access rules were successfully modified for share instance ee46a1d1-f743-461e-8bb5-467ee0e99edd belonging to share 510f7bcd-a0ee-49a6-8093-2640036f2ca3. May 28 13:00:08 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-62bb45e7-eeb9-4866-8227-9ff40449415c None None] Truncating password to algorithm specific maximum length 72 characters. May 28 13:00:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-62bb45e7-eeb9-4866-8227-9ff40449415c None None] MFA Rules not processed for user `f355576e8bff4613bc147c19f97c711c`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 13:00:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-62bb45e7-eeb9-4866-8227-9ff40449415c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:00:08 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-243a978d-2430-475e-b6f1-2ae5c9232f33 tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] http://10.27.203.238/share/v2/cac556dc39a14bbdbdbabfc80672fb1f/shares/0c7ef0a2-5628-47dd-9eba-98153028dd8a returned with HTTP 200 May 28 13:00:08 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 875/1720] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:00:08 2024] GET /share/v2/cac556dc39a14bbdbdbabfc80672fb1f/shares/0c7ef0a2-5628-47dd-9eba-98153028dd8a => generated 1316 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:00:08 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-f4e53c71-0f39-4ec3-9700-19965c7d3284 tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] POST http://10.27.203.238/share/v2/cac556dc39a14bbdbdbabfc80672fb1f/share-transfers May 28 13:00:08 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-f4e53c71-0f39-4ec3-9700-19965c7d3284 tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"transfer": {"share_id": "0c7ef0a2-5628-47dd-9eba-98153028dd8a", "name": "tempest-tempest-created-share-transfer-1336160610"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:00:08 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.v2.share_transfer [None req-f4e53c71-0f39-4ec3-9700-19965c7d3284 tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] Creating new share transfer {'transfer': {'share_id': '0c7ef0a2-5628-47dd-9eba-98153028dd8a', 'name': 'tempest-tempest-created-share-transfer-1336160610'}} {{(pid=98330) create /opt/stack/manila/manila/api/v2/share_transfer.py:104}} May 28 13:00:08 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.v2.share_transfer [None req-f4e53c71-0f39-4ec3-9700-19965c7d3284 tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] Creating transfer of share 0c7ef0a2-5628-47dd-9eba-98153028dd8a {{(pid=98330) create /opt/stack/manila/manila/api/v2/share_transfer.py:125}} May 28 13:00:08 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.transfer.api [None req-f4e53c71-0f39-4ec3-9700-19965c7d3284 tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] Generating transfer record for share 0c7ef0a2-5628-47dd-9eba-98153028dd8a {{(pid=98330) create /opt/stack/manila/manila/transfer/api.py:162}} May 28 13:00:08 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1360/2748] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 13:00:08 2024] POST /identity/v3/auth/tokens => generated 4077 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 13:00:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7ed270-6f7f-47d1-8fe5-5781d541ccd5 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7ed270-6f7f-47d1-8fe5-5781d541ccd5 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbbbe2e-d403-4758-9c62-ec071368e894 tempest-UserMessageNegativeTest-278135351 tempest-UserMessageNegativeTest-278135351-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f355576e8bff4613bc147c19f97c711c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7942989ad1ef4db2b2e923f7316c8511', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbbbe2e-d403-4758-9c62-ec071368e894 tempest-UserMessageNegativeTest-278135351 tempest-UserMessageNegativeTest-278135351-project-admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbbbe2e-d403-4758-9c62-ec071368e894 tempest-UserMessageNegativeTest-278135351 tempest-UserMessageNegativeTest-278135351-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbbbe2e-d403-4758-9c62-ec071368e894 tempest-UserMessageNegativeTest-278135351 tempest-UserMessageNegativeTest-278135351-project-admin] PATH_INFO: `/v3/domains` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbbbe2e-d403-4758-9c62-ec071368e894 tempest-UserMessageNegativeTest-278135351 tempest-UserMessageNegativeTest-278135351-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=51267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 13:00:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbbbe2e-d403-4758-9c62-ec071368e894 tempest-UserMessageNegativeTest-278135351 tempest-UserMessageNegativeTest-278135351-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbbbe2e-d403-4758-9c62-ec071368e894 tempest-UserMessageNegativeTest-278135351 tempest-UserMessageNegativeTest-278135351-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:08 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-f4e53c71-0f39-4ec3-9700-19965c7d3284 tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] http://10.27.203.238/share/v2/cac556dc39a14bbdbdbabfc80672fb1f/share-transfers returned with HTTP 202 May 28 13:00:08 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 846/1721] 10.27.203.238 () {66 vars in 1389 bytes} [Tue May 28 13:00:08 2024] POST /share/v2/cac556dc39a14bbdbdbabfc80672fb1f/share-transfers => generated 728 bytes in 83 msecs (HTTP/1.1 202) 6 headers in 237 bytes (1 switches on core 0) May 28 13:00:08 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-cf0f0c91-b9cc-45fe-bbc8-b98714a34521 tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] GET http://10.27.203.238/share/v1/cac556dc39a14bbdbdbabfc80672fb1f/shares/0c7ef0a2-5628-47dd-9eba-98153028dd8a May 28 13:00:08 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-cf0f0c91-b9cc-45fe-bbc8-b98714a34521 tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:08 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-cf0f0c91-b9cc-45fe-bbc8-b98714a34521 tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:08 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1389/2749] 10.27.203.238 () {62 vars in 1241 bytes} [Tue May 28 13:00:08 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 13:00:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bb45e7-eeb9-4866-8227-9ff40449415c None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bb45e7-eeb9-4866-8227-9ff40449415c None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cd8c54-caff-4a1f-b016-7b62beded598 tempest-UserMessageNegativeTest-278135351 tempest-UserMessageNegativeTest-278135351-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f355576e8bff4613bc147c19f97c711c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7942989ad1ef4db2b2e923f7316c8511', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cd8c54-caff-4a1f-b016-7b62beded598 tempest-UserMessageNegativeTest-278135351 tempest-UserMessageNegativeTest-278135351-project-admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cd8c54-caff-4a1f-b016-7b62beded598 tempest-UserMessageNegativeTest-278135351 tempest-UserMessageNegativeTest-278135351-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cd8c54-caff-4a1f-b016-7b62beded598 tempest-UserMessageNegativeTest-278135351 tempest-UserMessageNegativeTest-278135351-project-admin] PATH_INFO: `/v3/users` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cd8c54-caff-4a1f-b016-7b62beded598 tempest-UserMessageNegativeTest-278135351 tempest-UserMessageNegativeTest-278135351-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cd8c54-caff-4a1f-b016-7b62beded598 tempest-UserMessageNegativeTest-278135351 tempest-UserMessageNegativeTest-278135351-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:08 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-16cd8c54-caff-4a1f-b016-7b62beded598 tempest-UserMessageNegativeTest-278135351 tempest-UserMessageNegativeTest-278135351-project-admin] Truncating password to algorithm specific maximum length 72 characters. May 28 13:00:08 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-cf0f0c91-b9cc-45fe-bbc8-b98714a34521 tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] http://10.27.203.238/share/v1/cac556dc39a14bbdbdbabfc80672fb1f/shares/0c7ef0a2-5628-47dd-9eba-98153028dd8a returned with HTTP 200 May 28 13:00:08 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 876/1722] 10.27.203.238 () {62 vars in 1408 bytes} [Tue May 28 13:00:08 2024] GET /share/v1/cac556dc39a14bbdbdbabfc80672fb1f/shares/0c7ef0a2-5628-47dd-9eba-98153028dd8a => generated 905 bytes in 29 msecs (HTTP/1.1 200) 6 headers in 230 bytes (2 switches on core 0) May 28 13:00:08 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-44204389-25b1-4213-a82f-bdbce4a7d344 tempest-ShareTransferNegativeTest-1518106491 tempest-ShareTransferNegativeTest-1518106491-project-member] POST http://10.27.203.238/share/v2/c7a348e5c74641978595dc43c2dcb08a/share-transfers/5a218555-42e9-42f4-822a-b64bc5011fbb/accept May 28 13:00:08 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-44204389-25b1-4213-a82f-bdbce4a7d344 tempest-ShareTransferNegativeTest-1518106491 tempest-ShareTransferNegativeTest-1518106491-project-member] Action: 'accept', calling method: Controller.__getattribute__..version_select, body: {"accept": {"auth_key": "", "clear_access_rules": false}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:00:08 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.v2.share_transfer [None req-44204389-25b1-4213-a82f-bdbce4a7d344 tempest-ShareTransferNegativeTest-1518106491 tempest-ShareTransferNegativeTest-1518106491-project-member] Accepting share transfer 5a218555-42e9-42f4-822a-b64bc5011fbb {{(pid=98330) accept /opt/stack/manila/manila/api/v2/share_transfer.py:143}} May 28 13:00:08 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-44204389-25b1-4213-a82f-bdbce4a7d344 tempest-ShareTransferNegativeTest-1518106491 tempest-ShareTransferNegativeTest-1518106491-project-member] HTTP exception thrown: Must supply 'auth_key' while accepting a share transfer. May 28 13:00:08 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-44204389-25b1-4213-a82f-bdbce4a7d344 tempest-ShareTransferNegativeTest-1518106491 tempest-ShareTransferNegativeTest-1518106491-project-member] http://10.27.203.238/share/v2/c7a348e5c74641978595dc43c2dcb08a/share-transfers/5a218555-42e9-42f4-822a-b64bc5011fbb/accept returned with HTTP 400 May 28 13:00:08 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 847/1723] 10.27.203.238 () {66 vars in 1520 bytes} [Tue May 28 13:00:08 2024] POST /share/v2/c7a348e5c74641978595dc43c2dcb08a/share-transfers/5a218555-42e9-42f4-822a-b64bc5011fbb/accept => generated 100 bytes in 7 msecs (HTTP/1.1 400) 6 headers in 240 bytes (1 switches on core 0) May 28 13:00:08 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-75327cc2-9773-45e7-88e2-e7eb9f080275 tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] DELETE http://10.27.203.238/share/v2/cac556dc39a14bbdbdbabfc80672fb1f/share-transfers/5a218555-42e9-42f4-822a-b64bc5011fbb May 28 13:00:08 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-75327cc2-9773-45e7-88e2-e7eb9f080275 tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:08 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-75327cc2-9773-45e7-88e2-e7eb9f080275 tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:08 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.v2.share_transfer [None req-75327cc2-9773-45e7-88e2-e7eb9f080275 tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] Delete transfer with id: 5a218555-42e9-42f4-822a-b64bc5011fbb {{(pid=98329) delete /opt/stack/manila/manila/api/v2/share_transfer.py:193}} May 28 13:00:08 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1361/2750] 10.27.203.238 () {64 vars in 1232 bytes} [Tue May 28 13:00:08 2024] POST /identity/v3/users => generated 433 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 13:00:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbbbe2e-d403-4758-9c62-ec071368e894 tempest-UserMessageNegativeTest-278135351 tempest-UserMessageNegativeTest-278135351-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbbbe2e-d403-4758-9c62-ec071368e894 tempest-UserMessageNegativeTest-278135351 tempest-UserMessageNegativeTest-278135351-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1de66e-d6ef-473b-aa2f-17106d1f143e tempest-UserMessageNegativeTest-278135351 tempest-UserMessageNegativeTest-278135351-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f355576e8bff4613bc147c19f97c711c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7942989ad1ef4db2b2e923f7316c8511', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1de66e-d6ef-473b-aa2f-17106d1f143e tempest-UserMessageNegativeTest-278135351 tempest-UserMessageNegativeTest-278135351-project-admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1de66e-d6ef-473b-aa2f-17106d1f143e tempest-UserMessageNegativeTest-278135351 tempest-UserMessageNegativeTest-278135351-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1de66e-d6ef-473b-aa2f-17106d1f143e tempest-UserMessageNegativeTest-278135351 tempest-UserMessageNegativeTest-278135351-project-admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1de66e-d6ef-473b-aa2f-17106d1f143e tempest-UserMessageNegativeTest-278135351 tempest-UserMessageNegativeTest-278135351-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1de66e-d6ef-473b-aa2f-17106d1f143e tempest-UserMessageNegativeTest-278135351 tempest-UserMessageNegativeTest-278135351-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:08 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1390/2751] 10.27.203.238 () {62 vars in 1210 bytes} [Tue May 28 13:00:08 2024] GET /identity/v3/roles => generated 1680 bytes in 18 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 13:00:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cd8c54-caff-4a1f-b016-7b62beded598 tempest-UserMessageNegativeTest-278135351 tempest-UserMessageNegativeTest-278135351-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cd8c54-caff-4a1f-b016-7b62beded598 tempest-UserMessageNegativeTest-278135351 tempest-UserMessageNegativeTest-278135351-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa17a94b-081f-4286-b303-d572668bb1c8 tempest-UserMessageNegativeTest-278135351 tempest-UserMessageNegativeTest-278135351-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f355576e8bff4613bc147c19f97c711c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7942989ad1ef4db2b2e923f7316c8511', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa17a94b-081f-4286-b303-d572668bb1c8 tempest-UserMessageNegativeTest-278135351 tempest-UserMessageNegativeTest-278135351-project-admin] REQUEST_METHOD: `PUT` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa17a94b-081f-4286-b303-d572668bb1c8 tempest-UserMessageNegativeTest-278135351 tempest-UserMessageNegativeTest-278135351-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa17a94b-081f-4286-b303-d572668bb1c8 tempest-UserMessageNegativeTest-278135351 tempest-UserMessageNegativeTest-278135351-project-admin] PATH_INFO: `/v3/projects/7942989ad1ef4db2b2e923f7316c8511/users/3fc09c87f69946d2bf009e72ac589cd4/roles/44620cad10ae407c90c91e2c296adb04` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:08 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-960c297a-a426-4abb-b988-df385d0658b6 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] <<< [PATCH] https://127.0.0.1:40443/api/viewpolicies/32/ May 28 13:00:08 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-960c297a-a426-4abb-b988-df385d0658b6 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=1, created='2024-05-28T12:58:43.845440Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='31b6534b-d142-4561-992f-4f0759db302d', id=32, internal=False, is_s3_default_policy=False, name='7fdd602c-79d0-479c-95a2-336b202c6639', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=['*'], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['203.0.113.123'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['203.0.113.123'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='MODIFYING', sync_time='2024-05-28T13:00:07.925657Z', tenant_id=1, tenant_name='default', title='7fdd602c-79d0-479c-95a2-336b202c6639', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/32/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[]) May 28 13:00:08 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-960c297a-a426-4abb-b988-df385d0658b6 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] --- [PATCH] https://127.0.0.1:40443/api/viewpolicies/32/: Done May 28 13:00:08 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-960c297a-a426-4abb-b988-df385d0658b6 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:00:08 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-960c297a-a426-4abb-b988-df385d0658b6 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:00:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa17a94b-081f-4286-b303-d572668bb1c8 tempest-UserMessageNegativeTest-278135351 tempest-UserMessageNegativeTest-278135351-project-admin] RBAC: Authorizing `identity:create_grant(project_id=7942989ad1ef4db2b2e923f7316c8511, user_id=3fc09c87f69946d2bf009e72ac589cd4, role_id=44620cad10ae407c90c91e2c296adb04)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa17a94b-081f-4286-b303-d572668bb1c8 tempest-UserMessageNegativeTest-278135351 tempest-UserMessageNegativeTest-278135351-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:08 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1362/2752] 10.27.203.238 () {64 vars in 1571 bytes} [Tue May 28 13:00:08 2024] PUT /identity/v3/projects/7942989ad1ef4db2b2e923f7316c8511/users/3fc09c87f69946d2bf009e72ac589cd4/roles/44620cad10ae407c90c91e2c296adb04 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:00:08 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.transfer.api [None req-75327cc2-9773-45e7-88e2-e7eb9f080275 tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] Transfer 5a218555-42e9-42f4-822a-b64bc5011fbb has been deleted successful. May 28 13:00:08 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-75327cc2-9773-45e7-88e2-e7eb9f080275 tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] http://10.27.203.238/share/v2/cac556dc39a14bbdbdbabfc80672fb1f/share-transfers/5a218555-42e9-42f4-822a-b64bc5011fbb returned with HTTP 200 May 28 13:00:08 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 877/1724] 10.27.203.238 () {64 vars in 1481 bytes} [Tue May 28 13:00:08 2024] DELETE /share/v2/cac556dc39a14bbdbdbabfc80672fb1f/share-transfers/5a218555-42e9-42f4-822a-b64bc5011fbb => generated 0 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 237 bytes (1 switches on core 0) May 28 13:00:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1de66e-d6ef-473b-aa2f-17106d1f143e tempest-UserMessageNegativeTest-278135351 tempest-UserMessageNegativeTest-278135351-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-3e1de66e-d6ef-473b-aa2f-17106d1f143e tempest-UserMessageNegativeTest-278135351 tempest-UserMessageNegativeTest-278135351-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:00:08 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-7d41d888-6619-45b3-af7e-62bcc5459096 tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] GET http://10.27.203.238/share/v1/cac556dc39a14bbdbdbabfc80672fb1f/shares/0c7ef0a2-5628-47dd-9eba-98153028dd8a May 28 13:00:08 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-7d41d888-6619-45b3-af7e-62bcc5459096 tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:08 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-7d41d888-6619-45b3-af7e-62bcc5459096 tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:08 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-7d41d888-6619-45b3-af7e-62bcc5459096 tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] http://10.27.203.238/share/v1/cac556dc39a14bbdbdbabfc80672fb1f/shares/0c7ef0a2-5628-47dd-9eba-98153028dd8a returned with HTTP 200 May 28 13:00:08 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 878/1725] 10.27.203.238 () {62 vars in 1408 bytes} [Tue May 28 13:00:08 2024] GET /share/v1/cac556dc39a14bbdbdbabfc80672fb1f/shares/0c7ef0a2-5628-47dd-9eba-98153028dd8a => generated 962 bytes in 29 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:00:08 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-fb4bb6a2-41f6-4912-a6ba-cb53063ee9e0 tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] DELETE http://10.27.203.238/share/v2/cac556dc39a14bbdbdbabfc80672fb1f/share-transfers/1e809c88-7bb9-4403-a8cb-32ec24e95182 May 28 13:00:08 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-fb4bb6a2-41f6-4912-a6ba-cb53063ee9e0 tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:08 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-fb4bb6a2-41f6-4912-a6ba-cb53063ee9e0 tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:08 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.v2.share_transfer [None req-fb4bb6a2-41f6-4912-a6ba-cb53063ee9e0 tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] Delete transfer with id: 1e809c88-7bb9-4403-a8cb-32ec24e95182 {{(pid=98329) delete /opt/stack/manila/manila/api/v2/share_transfer.py:193}} May 28 13:00:08 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-960c297a-a426-4abb-b988-df385d0658b6 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.076s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:00:08 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-960c297a-a426-4abb-b988-df385d0658b6 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:00:08 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-960c297a-a426-4abb-b988-df385d0658b6 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:00:08 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-960c297a-a426-4abb-b988-df385d0658b6 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:00:08 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-960c297a-a426-4abb-b988-df385d0658b6 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:00:08 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-960c297a-a426-4abb-b988-df385d0658b6 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:00:08 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault [None req-fb4bb6a2-41f6-4912-a6ba-cb53063ee9e0 tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] Caught error: Transfer 1e809c88-7bb9-4403-a8cb-32ec24e95182 could not be found.: manila.exception.TransferNotFound: Transfer 1e809c88-7bb9-4403-a8cb-32ec24e95182 could not be found. May 28 13:00:08 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault Traceback (most recent call last): May 28 13:00:08 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/api/middleware/fault.py", line 76, in __call__ May 28 13:00:08 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault return req.get_response(self.application) May 28 13:00:08 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/request.py", line 1313, in send May 28 13:00:08 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault status, headers, app_iter = self.call_application( May 28 13:00:08 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/request.py", line 1278, in call_application May 28 13:00:08 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault app_iter = application(self.environ, start_response) May 28 13:00:08 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 129, in __call__ May 28 13:00:08 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault resp = self.call_func(req, *args, **kw) May 28 13:00:08 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 193, in call_func May 28 13:00:08 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault return self.func(req, *args, **kwargs) May 28 13:00:08 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_middleware/base.py", line 124, in __call__ May 28 13:00:08 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault response = req.get_response(self.application) May 28 13:00:08 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/request.py", line 1313, in send May 28 13:00:08 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault status, headers, app_iter = self.call_application( May 28 13:00:08 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/request.py", line 1278, in call_application May 28 13:00:08 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault app_iter = application(self.environ, start_response) May 28 13:00:08 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 143, in __call__ May 28 13:00:08 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault return resp(environ, start_response) May 28 13:00:08 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 129, in __call__ May 28 13:00:08 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault resp = self.call_func(req, *args, **kw) May 28 13:00:08 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 193, in call_func May 28 13:00:08 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault return self.func(req, *args, **kwargs) May 28 13:00:08 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/osprofiler/web.py", line 111, in __call__ May 28 13:00:08 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault return request.get_response(self.application) May 28 13:00:08 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/request.py", line 1313, in send May 28 13:00:08 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault status, headers, app_iter = self.call_application( May 28 13:00:08 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/request.py", line 1278, in call_application May 28 13:00:08 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault app_iter = application(self.environ, start_response) May 28 13:00:08 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 129, in __call__ May 28 13:00:08 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault resp = self.call_func(req, *args, **kw) May 28 13:00:08 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 193, in call_func May 28 13:00:08 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault return self.func(req, *args, **kwargs) May 28 13:00:08 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py", line 340, in __call__ May 28 13:00:08 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault response = req.get_response(self._app) May 28 13:00:08 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/request.py", line 1313, in send May 28 13:00:08 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault status, headers, app_iter = self.call_application( May 28 13:00:08 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/request.py", line 1278, in call_application May 28 13:00:08 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault app_iter = application(self.environ, start_response) May 28 13:00:08 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 143, in __call__ May 28 13:00:08 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault return resp(environ, start_response) May 28 13:00:08 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 143, in __call__ May 28 13:00:08 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault return resp(environ, start_response) May 28 13:00:08 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/routes/middleware.py", line 153, in __call__ May 28 13:00:08 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault response = self.app(environ, start_response) May 28 13:00:08 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 143, in __call__ May 28 13:00:08 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault return resp(environ, start_response) May 28 13:00:08 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 129, in __call__ May 28 13:00:08 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault resp = self.call_func(req, *args, **kw) May 28 13:00:08 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 193, in call_func May 28 13:00:08 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault return self.func(req, *args, **kwargs) May 28 13:00:08 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/api/openstack/wsgi.py", line 764, in __call__ May 28 13:00:08 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault return self._process_stack(request, action, action_args, May 28 13:00:08 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/api/openstack/wsgi.py", line 829, in _process_stack May 28 13:00:08 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault action_result = self.dispatch(meth, request, action_args) May 28 13:00:08 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/api/openstack/wsgi.py", line 924, in dispatch May 28 13:00:08 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault return method(req=request, **action_args) May 28 13:00:08 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/api/openstack/wsgi.py", line 1066, in version_select May 28 13:00:08 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault return func.func(self, *args, **kwargs) May 28 13:00:08 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/api/openstack/wsgi.py", line 1160, in wrapper May 28 13:00:08 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault return f(self, req, *args, **kwargs) May 28 13:00:08 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/api/v2/share_transfer.py", line 196, in delete May 28 13:00:08 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-960c297a-a426-4abb-b988-df385d0658b6 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.005s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:00:08 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-960c297a-a426-4abb-b988-df385d0658b6 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:00:08 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault self.transfer_api.delete(context, transfer_id=id) May 28 13:00:08 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/transfer/api.py", line 74, in delete May 28 13:00:08 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault transfer = self.db.transfer_get(context, transfer_id) May 28 13:00:08 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/db/api.py", line 507, in transfer_get May 28 13:00:08 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault return IMPL.transfer_get(context, transfer_id) May 28 13:00:08 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/enginefacade.py", line 998, in wrapper May 28 13:00:08 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault return fn(*args, **kwargs) May 28 13:00:08 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/db/sqlalchemy/api.py", line 2677, in transfer_get May 28 13:00:08 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault return _transfer_get(context, transfer_id, read_deleted=read_deleted) May 28 13:00:08 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/db/sqlalchemy/api.py", line 2670, in _transfer_get May 28 13:00:08 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault raise exception.TransferNotFound(transfer_id=transfer_id) May 28 13:00:08 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault manila.exception.TransferNotFound: Transfer 1e809c88-7bb9-4403-a8cb-32ec24e95182 could not be found. May 28 13:00:08 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault May 28 13:00:08 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.middleware.fault [None req-fb4bb6a2-41f6-4912-a6ba-cb53063ee9e0 tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] http://10.27.203.238/share/v2/cac556dc39a14bbdbdbabfc80672fb1f/share-transfers/1e809c88-7bb9-4403-a8cb-32ec24e95182 returned with HTTP 404 May 28 13:00:08 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-960c297a-a426-4abb-b988-df385d0658b6 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:00:08 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 879/1726] 10.27.203.238 () {64 vars in 1481 bytes} [Tue May 28 13:00:08 2024] DELETE /share/v2/cac556dc39a14bbdbdbabfc80672fb1f/share-transfers/1e809c88-7bb9-4403-a8cb-32ec24e95182 => generated 129 bytes in 14 msecs (HTTP/1.1 404) 6 headers in 238 bytes (1 switches on core 0) May 28 13:00:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1de66e-d6ef-473b-aa2f-17106d1f143e tempest-UserMessageNegativeTest-278135351 tempest-UserMessageNegativeTest-278135351-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:08 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-960c297a-a426-4abb-b988-df385d0658b6 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.004s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:00:08 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-960c297a-a426-4abb-b988-df385d0658b6 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:00:08 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-960c297a-a426-4abb-b988-df385d0658b6 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:00:08 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-e2ed177f-c4f4-4c2b-845f-14363b42af3d tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] POST http://10.27.203.238/share/v2/cac556dc39a14bbdbdbabfc80672fb1f/shares May 28 13:00:08 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-e2ed177f-c4f4-4c2b-845f-14363b42af3d tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share": {"share_proto": "nfs", "description": "Tempest's share", "snapshot_id": null, "name": "tempest-tempest-share-name-1701661855", "size": 1, "metadata": {}, "is_public": false, "share_type": "7d4af55a-ed87-4690-a9e6-1a8ea4a42df2"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:00:08 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.v1.shares [None req-e2ed177f-c4f4-4c2b-845f-14363b42af3d tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] Create NFS share of 1 GB May 28 13:00:08 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-960c297a-a426-4abb-b988-df385d0658b6 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.043s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:00:08 l75lg1-v1 manila-share[98474]: INFO manila.share.access [None req-960c297a-a426-4abb-b988-df385d0658b6 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Access rules were successfully modified for share instance 7fdd602c-79d0-479c-95a2-336b202c6639 belonging to share 72db8769-ece7-42ff-af27-2e778292a9b4. May 28 13:00:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d28b336-1153-4c0c-ad53-b5540da2dba8 service manila] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f110cf6300f049c897d0aab63218d1e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d28b336-1153-4c0c-ad53-b5540da2dba8 service manila] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d28b336-1153-4c0c-ad53-b5540da2dba8 service manila] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d28b336-1153-4c0c-ad53-b5540da2dba8 service manila] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:08 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.quota [None req-e2ed177f-c4f4-4c2b-845f-14363b42af3d tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] Created reservations ['c2266017-babf-4ef3-bdf7-222e79657f8f', 'fbcc3533-b6f2-4778-bc10-b4fe74a631be', 'db3f9fb3-7f8b-4d4b-868d-1f606de69d57', 'b9d78b0e-3620-4d1c-aa5a-34f2c0ae9e94'] {{(pid=98329) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 13:00:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d28b336-1153-4c0c-ad53-b5540da2dba8 service manila] RBAC: Authorizing `identity:validate_token()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d28b336-1153-4c0c-ad53-b5540da2dba8 service manila] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:09 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1391/2753] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 13:00:08 2024] GET /identity/v3/auth/tokens => generated 4077 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 13:00:09 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-7b4913e6-f5ad-419f-8be8-d3db6997f774 tempest-UserMessageNegativeTest-278135351 tempest-UserMessageNegativeTest-278135351-project-admin] POST http://10.27.203.238/share/v2/7942989ad1ef4db2b2e923f7316c8511/types May 28 13:00:09 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-7b4913e6-f5ad-419f-8be8-d3db6997f774 tempest-UserMessageNegativeTest-278135351 tempest-UserMessageNegativeTest-278135351-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share_type": {"name": "tempest-share-type-1741004318", "extra_specs": {"driver_handles_share_servers": false, "vendor_name": "foobar"}, "share_type_access:is_public": true}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:00:09 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.quota [None req-e2ed177f-c4f4-4c2b-845f-14363b42af3d tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] Committed reservations ['c2266017-babf-4ef3-bdf7-222e79657f8f', 'fbcc3533-b6f2-4778-bc10-b4fe74a631be', 'db3f9fb3-7f8b-4d4b-868d-1f606de69d57', 'b9d78b0e-3620-4d1c-aa5a-34f2c0ae9e94'] {{(pid=98329) commit /opt/stack/manila/manila/quota.py:1063}} May 28 13:00:09 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-7b4913e6-f5ad-419f-8be8-d3db6997f774 tempest-UserMessageNegativeTest-278135351 tempest-UserMessageNegativeTest-278135351-project-admin] http://10.27.203.238/share/v2/7942989ad1ef4db2b2e923f7316c8511/types returned with HTTP 200 May 28 13:00:09 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 848/1727] 10.27.203.238 () {66 vars in 1359 bytes} [Tue May 28 13:00:08 2024] POST /share/v2/7942989ad1ef4db2b2e923f7316c8511/types => generated 661 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:00:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa17a94b-081f-4286-b303-d572668bb1c8 tempest-UserMessageNegativeTest-278135351 tempest-UserMessageNegativeTest-278135351-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa17a94b-081f-4286-b303-d572668bb1c8 tempest-UserMessageNegativeTest-278135351 tempest-UserMessageNegativeTest-278135351-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fca14a-5e6e-47ee-8c6f-6ccee64df9a1 service manila] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f110cf6300f049c897d0aab63218d1e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fca14a-5e6e-47ee-8c6f-6ccee64df9a1 service manila] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fca14a-5e6e-47ee-8c6f-6ccee64df9a1 service manila] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fca14a-5e6e-47ee-8c6f-6ccee64df9a1 service manila] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:09 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.host_manager [None req-e2ed177f-c4f4-4c2b-845f-14363b42af3d tempest-ShareTransferNegativeTest-884271560 None] Share service is down. (host: l75lg1-v1@generic2). May 28 13:00:09 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.host_manager [None req-e2ed177f-c4f4-4c2b-845f-14363b42af3d tempest-ShareTransferNegativeTest-884271560 None] Share service is down. (host: l75lg1-v1@generic1). May 28 13:00:09 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-e2ed177f-c4f4-4c2b-845f-14363b42af3d tempest-ShareTransferNegativeTest-884271560 None] Starting with 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:80}} May 28 13:00:09 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-e2ed177f-c4f4-4c2b-845f-14363b42af3d tempest-ShareTransferNegativeTest-884271560 None] Filter OnlyHostFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:00:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fca14a-5e6e-47ee-8c6f-6ccee64df9a1 service manila] RBAC: Authorizing `identity:validate_token()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:09 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-e2ed177f-c4f4-4c2b-845f-14363b42af3d tempest-ShareTransferNegativeTest-884271560 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:00:09 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.capacity [None req-e2ed177f-c4f4-4c2b-845f-14363b42af3d tempest-ShareTransferNegativeTest-884271560 None] Space information for share creation on host l75lg1-v1@vast#vast (requested / avail): 1/2078 {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/capacity.py:83}} May 28 13:00:09 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-e2ed177f-c4f4-4c2b-845f-14363b42af3d tempest-ShareTransferNegativeTest-884271560 None] Filter CapacityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:00:09 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-e2ed177f-c4f4-4c2b-845f-14363b42af3d tempest-ShareTransferNegativeTest-884271560 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:00:09 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-e2ed177f-c4f4-4c2b-845f-14363b42af3d tempest-ShareTransferNegativeTest-884271560 None] Driver Filter: Checking host 'l75lg1-v1@vast#vast' {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:37}} May 28 13:00:09 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-e2ed177f-c4f4-4c2b-845f-14363b42af3d tempest-ShareTransferNegativeTest-884271560 None] Filter function not set :: passing host. {{(pid=98327) _check_filter_function /opt/stack/manila/manila/scheduler/filters/driver.py:53}} May 28 13:00:09 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-e2ed177f-c4f4-4c2b-845f-14363b42af3d tempest-ShareTransferNegativeTest-884271560 None] Result: True {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:40}} May 28 13:00:09 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-e2ed177f-c4f4-4c2b-845f-14363b42af3d tempest-ShareTransferNegativeTest-884271560 None] Done checking host 'l75lg1-v1@vast#vast' {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:41}} May 28 13:00:09 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-e2ed177f-c4f4-4c2b-845f-14363b42af3d tempest-ShareTransferNegativeTest-884271560 None] Filter DriverFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:00:09 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-e2ed177f-c4f4-4c2b-845f-14363b42af3d tempest-ShareTransferNegativeTest-884271560 None] Filter ShareReplicationFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:00:09 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-e2ed177f-c4f4-4c2b-845f-14363b42af3d tempest-ShareTransferNegativeTest-884271560 None] Filter CreateFromSnapshotFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:00:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fca14a-5e6e-47ee-8c6f-6ccee64df9a1 service manila] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:09 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-e2ed177f-c4f4-4c2b-845f-14363b42af3d tempest-ShareTransferNegativeTest-884271560 None] Filter AffinityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:00:09 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-e2ed177f-c4f4-4c2b-845f-14363b42af3d tempest-ShareTransferNegativeTest-884271560 None] Filter AntiAffinityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:00:09 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.drivers.filter [None req-e2ed177f-c4f4-4c2b-845f-14363b42af3d tempest-ShareTransferNegativeTest-884271560 None] Filtered share [host: 'l75lg1-v1@vast#vast', free_capacity_gb: 2078.6478263456374, pools: None] {{(pid=98327) _schedule_share /opt/stack/manila/manila/scheduler/drivers/filter.py:268}} May 28 13:00:09 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-e2ed177f-c4f4-4c2b-845f-14363b42af3d tempest-ShareTransferNegativeTest-884271560 None] Checking host 'l75lg1-v1@vast#vast' {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:46}} May 28 13:00:09 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.weighers.goodness [None req-e2ed177f-c4f4-4c2b-845f-14363b42af3d tempest-ShareTransferNegativeTest-884271560 None] Goodness function not set :: defaulting to minimal goodness rating of 0. May 28 13:00:09 l75lg1-v1 manila-scheduler[98327]: INFO manila.scheduler.weighers.goodness [None req-e2ed177f-c4f4-4c2b-845f-14363b42af3d tempest-ShareTransferNegativeTest-884271560 None] Goodness function result for host l75lg1-v1@vast#vast: 0. May 28 13:00:09 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-e2ed177f-c4f4-4c2b-845f-14363b42af3d tempest-ShareTransferNegativeTest-884271560 None] Goodness: 0 {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:48}} May 28 13:00:09 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-e2ed177f-c4f4-4c2b-845f-14363b42af3d tempest-ShareTransferNegativeTest-884271560 None] Done checking host 'l75lg1-v1@vast#vast' {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:49}} May 28 13:00:09 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.drivers.filter [None req-e2ed177f-c4f4-4c2b-845f-14363b42af3d tempest-ShareTransferNegativeTest-884271560 None] Choosing for share: WeighedHost [host: l75lg1-v1@vast#vast, weight: 0.0] {{(pid=98327) _schedule_share /opt/stack/manila/manila/scheduler/drivers/filter.py:274}} May 28 13:00:09 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1363/2754] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 13:00:09 2024] GET /identity/v3/auth/tokens => generated 3954 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 13:00:09 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-e2ed177f-c4f4-4c2b-845f-14363b42af3d tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] http://10.27.203.238/share/v2/cac556dc39a14bbdbdbabfc80672fb1f/shares returned with HTTP 200 May 28 13:00:09 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 880/1728] 10.27.203.238 () {66 vars in 1362 bytes} [Tue May 28 13:00:08 2024] POST /share/v2/cac556dc39a14bbdbdbabfc80672fb1f/shares => generated 1311 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:00:09 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-fb6089a0-33c9-41c0-a227-495134a5661f tempest-UserMessageNegativeTest-781603078 tempest-UserMessageNegativeTest-781603078-project-member] POST http://10.27.203.238/share/v2/ca9b4c5f200844bdbcc6db13e907f21e/shares May 28 13:00:09 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-fb6089a0-33c9-41c0-a227-495134a5661f tempest-UserMessageNegativeTest-781603078 tempest-UserMessageNegativeTest-781603078-project-member] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share": {"share_proto": "nfs", "description": "tempest-tempest-created-share-desc-245627670", "snapshot_id": null, "name": "tempest-tempest-created-share-1162182931", "size": 1, "metadata": {}, "is_public": false, "share_type": "b3ebc319-dcc2-4092-bb27-3af25168a699"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:00:09 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.v1.shares [None req-fb6089a0-33c9-41c0-a227-495134a5661f tempest-UserMessageNegativeTest-781603078 tempest-UserMessageNegativeTest-781603078-project-member] Create NFS share of 1 GB May 28 13:00:09 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-6d2bb424-2679-410e-87e9-39f6dcaf7e85 tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] GET http://10.27.203.238/share/v2/cac556dc39a14bbdbdbabfc80672fb1f/shares/03abb6c7-1707-45b3-a692-3b1de0dd1fba May 28 13:00:09 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-6d2bb424-2679-410e-87e9-39f6dcaf7e85 tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:09 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-6d2bb424-2679-410e-87e9-39f6dcaf7e85 tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:09 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-6d2bb424-2679-410e-87e9-39f6dcaf7e85 tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] http://10.27.203.238/share/v2/cac556dc39a14bbdbdbabfc80672fb1f/shares/03abb6c7-1707-45b3-a692-3b1de0dd1fba returned with HTTP 200 May 28 13:00:09 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 881/1729] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:00:09 2024] GET /share/v2/cac556dc39a14bbdbdbabfc80672fb1f/shares/03abb6c7-1707-45b3-a692-3b1de0dd1fba => generated 1311 bytes in 25 msecs (HTTP/1.1 200) 6 headers in 232 bytes (2 switches on core 0) May 28 13:00:09 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-ea457e69-0d9c-45c8-acc2-5ed43566a2a4 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] GET http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/share-access-rules?share_id=72db8769-ece7-42ff-af27-2e778292a9b4 May 28 13:00:09 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-ea457e69-0d9c-45c8-acc2-5ed43566a2a4 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:09 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-ea457e69-0d9c-45c8-acc2-5ed43566a2a4 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:09 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.lock.api [None req-ea457e69-0d9c-45c8-acc2-5ed43566a2a4 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Searching for locks by: {'resource_id': '5cf49388-5ee6-49d7-9adc-19ee2d605e86', 'resource_action': 'show', 'resource_type': 'access_rule'} {{(pid=98329) get_all /opt/stack/manila/manila/lock/api.py:112}} May 28 13:00:09 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-ea457e69-0d9c-45c8-acc2-5ed43566a2a4 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/share-access-rules?share_id=72db8769-ece7-42ff-af27-2e778292a9b4 returned with HTTP 200 May 28 13:00:09 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 882/1730] 10.27.203.238 () {64 vars in 1467 bytes} [Tue May 28 13:00:09 2024] GET /share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/share-access-rules?share_id=72db8769-ece7-42ff-af27-2e778292a9b4 => generated 281 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:00:09 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-58e9f60d-ab13-4f76-bfb9-7c8b46461f8c tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-manila_7890e9d8a78c49a0bb9af26ec5dd4646-1927039240] POST http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action May 28 13:00:09 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-58e9f60d-ab13-4f76-bfb9-7c8b46461f8c tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-manila_7890e9d8a78c49a0bb9af26ec5dd4646-1927039240] Action body: b'{"deny_access": {"access_id": "5cf49388-5ee6-49d7-9adc-19ee2d605e86"}}' {{(pid=98329) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 13:00:09 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-58e9f60d-ab13-4f76-bfb9-7c8b46461f8c tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-manila_7890e9d8a78c49a0bb9af26ec5dd4646-1927039240] Action: 'action', calling method: ShareController.deny_access, body: {"deny_access": {"access_id": "5cf49388-5ee6-49d7-9adc-19ee2d605e86"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:00:09 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.lock.api [None req-58e9f60d-ab13-4f76-bfb9-7c8b46461f8c tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-manila_7890e9d8a78c49a0bb9af26ec5dd4646-1927039240] Searching for locks by: {'resource_id': '5cf49388-5ee6-49d7-9adc-19ee2d605e86', 'resource_action': 'delete'} {{(pid=98329) get_all /opt/stack/manila/manila/lock/api.py:112}} May 28 13:00:09 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.quota [None req-fb6089a0-33c9-41c0-a227-495134a5661f tempest-UserMessageNegativeTest-781603078 tempest-UserMessageNegativeTest-781603078-project-member] Created reservations ['0abd2c01-ea17-46ad-8970-aa61aeb9be50', 'd93dd6b4-eb94-475e-9854-9d9260be7369', '6bcb906b-9f82-4487-b7ed-1bfc18adc1e2', 'dc75c110-5621-42fe-a76d-72bf86b226e2'] {{(pid=98330) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 13:00:09 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-58e9f60d-ab13-4f76-bfb9-7c8b46461f8c tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-manila_7890e9d8a78c49a0bb9af26ec5dd4646-1927039240] HTTP exception thrown: Cannot deny access for share '72db8769-ece7-42ff-af27-2e778292a9b4' since it has been locked. Please remove the locks and retry the operation May 28 13:00:09 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-58e9f60d-ab13-4f76-bfb9-7c8b46461f8c tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-manila_7890e9d8a78c49a0bb9af26ec5dd4646-1927039240] http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action returned with HTTP 403 May 28 13:00:09 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 883/1731] 10.27.203.238 () {66 vars in 1493 bytes} [Tue May 28 13:00:09 2024] POST /share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action => generated 184 bytes in 11 msecs (HTTP/1.1 403) 6 headers in 238 bytes (1 switches on core 0) May 28 13:00:09 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-94cb43d5-38bb-4613-906f-a5bb6ebc16df tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-manila_7890e9d8a78c49a0bb9af26ec5dd4646-1927039240] POST http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action May 28 13:00:09 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-94cb43d5-38bb-4613-906f-a5bb6ebc16df tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-manila_7890e9d8a78c49a0bb9af26ec5dd4646-1927039240] Action body: b'{"deny_access": {"access_id": "5cf49388-5ee6-49d7-9adc-19ee2d605e86"}}' {{(pid=98329) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 13:00:09 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-94cb43d5-38bb-4613-906f-a5bb6ebc16df tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-manila_7890e9d8a78c49a0bb9af26ec5dd4646-1927039240] Action: 'action', calling method: ShareController.deny_access, body: {"deny_access": {"access_id": "5cf49388-5ee6-49d7-9adc-19ee2d605e86"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:00:09 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.lock.api [None req-94cb43d5-38bb-4613-906f-a5bb6ebc16df tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-manila_7890e9d8a78c49a0bb9af26ec5dd4646-1927039240] Searching for locks by: {'resource_id': '5cf49388-5ee6-49d7-9adc-19ee2d605e86', 'resource_action': 'delete'} {{(pid=98329) get_all /opt/stack/manila/manila/lock/api.py:112}} May 28 13:00:09 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-94cb43d5-38bb-4613-906f-a5bb6ebc16df tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-manila_7890e9d8a78c49a0bb9af26ec5dd4646-1927039240] HTTP exception thrown: Cannot deny access for share '72db8769-ece7-42ff-af27-2e778292a9b4' since it has been locked. Please remove the locks and retry the operation May 28 13:00:09 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-94cb43d5-38bb-4613-906f-a5bb6ebc16df tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-manila_7890e9d8a78c49a0bb9af26ec5dd4646-1927039240] http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action returned with HTTP 403 May 28 13:00:09 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 884/1732] 10.27.203.238 () {66 vars in 1493 bytes} [Tue May 28 13:00:09 2024] POST /share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action => generated 184 bytes in 12 msecs (HTTP/1.1 403) 6 headers in 238 bytes (1 switches on core 0) May 28 13:00:09 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-0637416d-e366-4553-b2f3-3a4ab3a0f389 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] POST http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action May 28 13:00:09 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-0637416d-e366-4553-b2f3-3a4ab3a0f389 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Action body: b'{"deny_access": {"access_id": "5cf49388-5ee6-49d7-9adc-19ee2d605e86", "unrestrict": true}}' {{(pid=98329) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 13:00:09 l75lg1-v1 dstat.sh[49771]: 28-05 13:00:09| 20 2 75 3 0|5680M 1774M 278M 7892M| 14k 5054B| 0 2584k| 0 390 |9693 17k|1.26 1.09 1.02|4.0 2.0 0| 0 0 | 0 2048M| 29 363 0 43 2 May 28 13:00:09 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-0637416d-e366-4553-b2f3-3a4ab3a0f389 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Action: 'action', calling method: ShareController.deny_access, body: {"deny_access": {"access_id": "5cf49388-5ee6-49d7-9adc-19ee2d605e86", "unrestrict": true}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:00:09 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.lock.api [None req-0637416d-e366-4553-b2f3-3a4ab3a0f389 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Searching for locks by: {'resource_id': '5cf49388-5ee6-49d7-9adc-19ee2d605e86', 'resource_action': 'delete'} {{(pid=98329) get_all /opt/stack/manila/manila/lock/api.py:112}} May 28 13:00:09 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e2ed177f-c4f4-4c2b-845f-14363b42af3d tempest-ShareTransferNegativeTest-884271560 None] >>> [GET] https://127.0.0.1:40443/api/vippools/ May 28 13:00:09 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e2ed177f-c4f4-4c2b-845f-14363b42af3d tempest-ShareTransferNegativeTest-884271560 None] {'allow_redirects': True, 'params': {'name': 'vippool-1'}} May 28 13:00:09 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.quota [None req-fb6089a0-33c9-41c0-a227-495134a5661f tempest-UserMessageNegativeTest-781603078 tempest-UserMessageNegativeTest-781603078-project-member] Committed reservations ['0abd2c01-ea17-46ad-8970-aa61aeb9be50', 'd93dd6b4-eb94-475e-9854-9d9260be7369', '6bcb906b-9f82-4487-b7ed-1bfc18adc1e2', 'dc75c110-5621-42fe-a76d-72bf86b226e2'] {{(pid=98330) commit /opt/stack/manila/manila/quota.py:1063}} May 28 13:00:09 l75lg1-v1 devstack@m-api.service[98329]: DEBUG oslo_concurrency.lockutils [None req-0637416d-e366-4553-b2f3-3a4ab3a0f389 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98329) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:00:09 l75lg1-v1 devstack@m-api.service[98329]: DEBUG oslo_concurrency.lockutils [None req-0637416d-e366-4553-b2f3-3a4ab3a0f389 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98329) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:00:09 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.host_manager [None req-fb6089a0-33c9-41c0-a227-495134a5661f tempest-UserMessageNegativeTest-781603078 None] Share service is down. (host: l75lg1-v1@generic2). May 28 13:00:09 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.host_manager [None req-fb6089a0-33c9-41c0-a227-495134a5661f tempest-UserMessageNegativeTest-781603078 None] Share service is down. (host: l75lg1-v1@generic1). May 28 13:00:09 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-fb6089a0-33c9-41c0-a227-495134a5661f tempest-UserMessageNegativeTest-781603078 None] Starting with 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:80}} May 28 13:00:09 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-fb6089a0-33c9-41c0-a227-495134a5661f tempest-UserMessageNegativeTest-781603078 None] Filter OnlyHostFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:00:09 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-fb6089a0-33c9-41c0-a227-495134a5661f tempest-UserMessageNegativeTest-781603078 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:00:09 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.capacity [None req-fb6089a0-33c9-41c0-a227-495134a5661f tempest-UserMessageNegativeTest-781603078 None] Space information for share creation on host l75lg1-v1@vast#vast (requested / avail): 1/2077 {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/capacity.py:83}} May 28 13:00:09 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-fb6089a0-33c9-41c0-a227-495134a5661f tempest-UserMessageNegativeTest-781603078 None] Filter CapacityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:00:09 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.utils [None req-fb6089a0-33c9-41c0-a227-495134a5661f tempest-UserMessageNegativeTest-781603078 None] Share type extra spec requirement "vendor_name=foobar" does not match reported capability "VAST STORAGE" {{(pid=98327) capabilities_satisfied /opt/stack/manila/manila/scheduler/utils.py:185}} May 28 13:00:09 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.capabilities [None req-fb6089a0-33c9-41c0-a227-495134a5661f tempest-UserMessageNegativeTest-781603078 None] host: 'l75lg1-v1@vast#vast', free_capacity_gb: 2077.6478263456374, pools: None fails resource_type extra_specs requirements {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/capabilities.py:45}} May 28 13:00:09 l75lg1-v1 manila-scheduler[98327]: INFO manila.scheduler.filters.base [None req-fb6089a0-33c9-41c0-a227-495134a5661f tempest-UserMessageNegativeTest-781603078 None] Filter CapabilitiesFilter returned 0 host(s) May 28 13:00:09 l75lg1-v1 manila-scheduler[98327]: ERROR manila.scheduler.manager [None req-fb6089a0-33c9-41c0-a227-495134a5661f tempest-UserMessageNegativeTest-781603078 None] Failed to schedule create_share: No valid host was found. Failed to find a weighted host, the last executed filter was CapabilitiesFilter.: manila.exception.NoValidHost: No valid host was found. Failed to find a weighted host, the last executed filter was CapabilitiesFilter. May 28 13:00:09 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-fb6089a0-33c9-41c0-a227-495134a5661f tempest-UserMessageNegativeTest-781603078 tempest-UserMessageNegativeTest-781603078-project-member] http://10.27.203.238/share/v2/ca9b4c5f200844bdbcc6db13e907f21e/shares returned with HTTP 200 May 28 13:00:09 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 849/1733] 10.27.203.238 () {66 vars in 1362 bytes} [Tue May 28 13:00:09 2024] POST /share/v2/ca9b4c5f200844bdbcc6db13e907f21e/shares => generated 1335 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:00:09 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-7f024dea-f7c2-41c6-a66e-972d68b9da53 tempest-UserMessageNegativeTest-781603078 tempest-UserMessageNegativeTest-781603078-project-member] GET http://10.27.203.238/share/v2/ca9b4c5f200844bdbcc6db13e907f21e/shares/196fd448-d12b-4a72-b5dc-1b2a6ccc0416 May 28 13:00:09 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-7f024dea-f7c2-41c6-a66e-972d68b9da53 tempest-UserMessageNegativeTest-781603078 tempest-UserMessageNegativeTest-781603078-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:09 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-7f024dea-f7c2-41c6-a66e-972d68b9da53 tempest-UserMessageNegativeTest-781603078 tempest-UserMessageNegativeTest-781603078-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:09 l75lg1-v1 manila-scheduler[98327]: INFO manila.message.api [None req-fb6089a0-33c9-41c0-a227-495134a5661f tempest-UserMessageNegativeTest-781603078 None] Creating message record for request_id = req-fb6089a0-33c9-41c0-a227-495134a5661f May 28 13:00:09 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-7f024dea-f7c2-41c6-a66e-972d68b9da53 tempest-UserMessageNegativeTest-781603078 tempest-UserMessageNegativeTest-781603078-project-member] http://10.27.203.238/share/v2/ca9b4c5f200844bdbcc6db13e907f21e/shares/196fd448-d12b-4a72-b5dc-1b2a6ccc0416 returned with HTTP 200 May 28 13:00:09 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 850/1734] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:00:09 2024] GET /share/v2/ca9b4c5f200844bdbcc6db13e907f21e/shares/196fd448-d12b-4a72-b5dc-1b2a6ccc0416 => generated 1335 bytes in 27 msecs (HTTP/1.1 200) 6 headers in 232 bytes (2 switches on core 0) May 28 13:00:09 l75lg1-v1 devstack@m-api.service[98329]: DEBUG oslo_concurrency.lockutils [None req-0637416d-e366-4553-b2f3-3a4ab3a0f389 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.047s {{(pid=98329) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:00:09 l75lg1-v1 devstack@m-api.service[98329]: DEBUG oslo_concurrency.lockutils [None req-0637416d-e366-4553-b2f3-3a4ab3a0f389 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98329) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:00:09 l75lg1-v1 devstack@m-api.service[98329]: DEBUG oslo_concurrency.lockutils [None req-0637416d-e366-4553-b2f3-3a4ab3a0f389 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98329) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:00:09 l75lg1-v1 devstack@m-api.service[98329]: DEBUG oslo_concurrency.lockutils [None req-0637416d-e366-4553-b2f3-3a4ab3a0f389 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.057s {{(pid=98329) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:00:09 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-0637416d-e366-4553-b2f3-3a4ab3a0f389 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action returned with HTTP 202 May 28 13:00:09 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 885/1735] 10.27.203.238 () {66 vars in 1493 bytes} [Tue May 28 13:00:09 2024] POST /share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4/action => generated 0 bytes in 206 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 13:00:09 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-d0ac1fa4-63ff-4815-830b-12d2e78cae8c tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] GET http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/share-access-rules?share_id=72db8769-ece7-42ff-af27-2e778292a9b4 May 28 13:00:09 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-d0ac1fa4-63ff-4815-830b-12d2e78cae8c tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:09 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-d0ac1fa4-63ff-4815-830b-12d2e78cae8c tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:09 l75lg1-v1 manila-share[98474]: DEBUG manila.share.manager [None req-0637416d-e366-4553-b2f3-3a4ab3a0f389 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Received request to update access for share instance 7fdd602c-79d0-479c-95a2-336b202c6639. {{(pid=98474) update_access_for_instances /opt/stack/manila/manila/share/manager.py:4353}} May 28 13:00:09 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.lock.api [None req-d0ac1fa4-63ff-4815-830b-12d2e78cae8c tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Searching for locks by: {'resource_id': '5cf49388-5ee6-49d7-9adc-19ee2d605e86', 'resource_action': 'show', 'resource_type': 'access_rule'} {{(pid=98330) get_all /opt/stack/manila/manila/lock/api.py:112}} May 28 13:00:09 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-d0ac1fa4-63ff-4815-830b-12d2e78cae8c tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/share-access-rules?share_id=72db8769-ece7-42ff-af27-2e778292a9b4 returned with HTTP 200 May 28 13:00:09 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 851/1736] 10.27.203.238 () {64 vars in 1467 bytes} [Tue May 28 13:00:09 2024] GET /share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/share-access-rules?share_id=72db8769-ece7-42ff-af27-2e778292a9b4 => generated 289 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:00:09 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-0637416d-e366-4553-b2f3-3a4ab3a0f389 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:00:09 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-0637416d-e366-4553-b2f3-3a4ab3a0f389 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:00:09 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-0637416d-e366-4553-b2f3-3a4ab3a0f389 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.004s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:00:09 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-0637416d-e366-4553-b2f3-3a4ab3a0f389 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:00:09 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-0637416d-e366-4553-b2f3-3a4ab3a0f389 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:00:09 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-0637416d-e366-4553-b2f3-3a4ab3a0f389 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.071s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:00:09 l75lg1-v1 manila-share[98474]: DEBUG manila.share.access [None req-0637416d-e366-4553-b2f3-3a4ab3a0f389 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Updating access rules for share instance 7fdd602c-79d0-479c-95a2-336b202c6639 belonging to share 72db8769-ece7-42ff-af27-2e778292a9b4. {{(pid=98474) update_access_rules /opt/stack/manila/manila/share/access.py:298}} May 28 13:00:09 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-0637416d-e366-4553-b2f3-3a4ab3a0f389 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:00:09 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-0637416d-e366-4553-b2f3-3a4ab3a0f389 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:00:09 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-0637416d-e366-4553-b2f3-3a4ab3a0f389 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.007s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:00:09 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-0637416d-e366-4553-b2f3-3a4ab3a0f389 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:00:09 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-0637416d-e366-4553-b2f3-3a4ab3a0f389 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:00:09 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-0637416d-e366-4553-b2f3-3a4ab3a0f389 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.014s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:00:09 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-0637416d-e366-4553-b2f3-3a4ab3a0f389 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] changing access on None May 28 13:00:09 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0637416d-e366-4553-b2f3-3a4ab3a0f389 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:00:09 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0637416d-e366-4553-b2f3-3a4ab3a0f389 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] {'allow_redirects': True, May 28 13:00:09 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0637416d-e366-4553-b2f3-3a4ab3a0f389 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] 'params': {'name': '7fdd602c-79d0-479c-95a2-336b202c6639'}} May 28 13:00:09 l75lg1-v1 nova-conductor[83647]: DEBUG dbcounter [-] [83647] Writing DB stats nova_cell1:SELECT=4,nova_cell1:UPDATE=2,nova_cell1:DELETE=1 {{(pid=83647) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:00:09 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e2ed177f-c4f4-4c2b-845f-14363b42af3d tempest-ShareTransferNegativeTest-884271560 None] <<< [GET] https://127.0.0.1:40443/api/vippools/ May 28 13:00:09 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e2ed177f-c4f4-4c2b-845f-14363b42af3d tempest-ShareTransferNegativeTest-884271560 None] [Bunch(active_cnode_ids=[], active_interfaces=4, cluster='loop75-kfs', cluster_id=1, cnode_ids=[], cnodes=[], domain_name='vippool-1', enable_l3=False, enable_weighted_balancing=False, enabled=True, end_ip='172.21.75.4', guid='f2abaede-b397-413a-8faa-3aeead6d3b28', gw_ip='', gw_ipv6='', id=2, ip_ranges=[['172.21.75.1', '172.21.75.4']], name='vippool-1', peer_asn=0, port_membership='ALL', ranges_summary='172.21.75.[1-4]', role='PROTOCOLS', start_ip='172.21.75.1', subnet_cidr=16, subnet_cidr_ipv6=None, sync='SYNCED', sync_time='2024-05-28T12:50:09.644123Z', tenant_id=1, tenant_name='default', title='172.21.75.1 - 172.21.75.4', url='https://127.0.0.1:40443/api/vippools/2/', vast_asn=0, vlan=0, vms_preferred=False)] May 28 13:00:09 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e2ed177f-c4f4-4c2b-845f-14363b42af3d tempest-ShareTransferNegativeTest-884271560 None] --- [GET] https://127.0.0.1:40443/api/vippools/: Done May 28 13:00:09 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e2ed177f-c4f4-4c2b-845f-14363b42af3d tempest-ShareTransferNegativeTest-884271560 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:00:09 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e2ed177f-c4f4-4c2b-845f-14363b42af3d tempest-ShareTransferNegativeTest-884271560 None] {'allow_redirects': True, May 28 13:00:09 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e2ed177f-c4f4-4c2b-845f-14363b42af3d tempest-ShareTransferNegativeTest-884271560 None] 'params': {'name': 'f8e9c921-56e5-4b4a-a619-44221b8150a3'}} May 28 13:00:09 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0637416d-e366-4553-b2f3-3a4ab3a0f389 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:00:09 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0637416d-e366-4553-b2f3-3a4ab3a0f389 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] [Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=1, created='2024-05-28T12:58:43.845440Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='31b6534b-d142-4561-992f-4f0759db302d', id=32, internal=False, is_s3_default_policy=False, name='7fdd602c-79d0-479c-95a2-336b202c6639', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=['*'], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['203.0.113.123'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['203.0.113.123'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T13:00:08.658947Z', tenant_id=1, tenant_name='default', title='7fdd602c-79d0-479c-95a2-336b202c6639', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/32/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[])] May 28 13:00:09 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0637416d-e366-4553-b2f3-3a4ab3a0f389 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 13:00:09 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-0637416d-e366-4553-b2f3-3a4ab3a0f389 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] changing access on /manila/manila-7fdd602c-79d0-479c-95a2-336b202c6639. Rules: {'nfs_read_write': [], 'nfs_read_only': []} May 28 13:00:09 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0637416d-e366-4553-b2f3-3a4ab3a0f389 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] >>> [PATCH] https://127.0.0.1:40443/api/viewpolicies/32/ May 28 13:00:09 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0637416d-e366-4553-b2f3-3a4ab3a0f389 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] {'data': '{"name": "7fdd602c-79d0-479c-95a2-336b202c6639", "nfs_no_squash": ' May 28 13:00:09 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0637416d-e366-4553-b2f3-3a4ab3a0f389 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] '["*"], "nfs_root_squash": ["*"], "nfs_read_write": [], ' May 28 13:00:09 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0637416d-e366-4553-b2f3-3a4ab3a0f389 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] '"nfs_read_only": []}', May 28 13:00:09 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0637416d-e366-4553-b2f3-3a4ab3a0f389 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] 'params': None} May 28 13:00:09 l75lg1-v1 nova-conductor[83648]: DEBUG dbcounter [-] [83648] Writing DB stats nova_cell1:SELECT=3 {{(pid=83648) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:00:10 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e2ed177f-c4f4-4c2b-845f-14363b42af3d tempest-ShareTransferNegativeTest-884271560 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:00:10 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e2ed177f-c4f4-4c2b-845f-14363b42af3d tempest-ShareTransferNegativeTest-884271560 None] [] May 28 13:00:10 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e2ed177f-c4f4-4c2b-845f-14363b42af3d tempest-ShareTransferNegativeTest-884271560 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 13:00:10 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e2ed177f-c4f4-4c2b-845f-14363b42af3d tempest-ShareTransferNegativeTest-884271560 None] >>> [POST] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:00:10 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e2ed177f-c4f4-4c2b-845f-14363b42af3d tempest-ShareTransferNegativeTest-884271560 None] {'data': '{"name": "f8e9c921-56e5-4b4a-a619-44221b8150a3"}', May 28 13:00:10 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e2ed177f-c4f4-4c2b-845f-14363b42af3d tempest-ShareTransferNegativeTest-884271560 None] 'json': None, May 28 13:00:10 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e2ed177f-c4f4-4c2b-845f-14363b42af3d tempest-ShareTransferNegativeTest-884271560 None] 'params': None} May 28 13:00:10 l75lg1-v1 dstat.sh[49771]: 28-05 13:00:10| 7 1 90 2 0|5681M 1774M 278M 7892M| 15k 3772B| 0 1916k| 0 208 |4392 7266 |1.26 1.09 1.02|1.0 1.0 0| 0 0 | 0 2048M| 29 361 0 43 2 May 28 13:00:10 l75lg1-v1 neutron-server[77618]: DEBUG dbcounter [-] [77618] Writing DB stats neutron:SELECT=5,neutron:UPDATE=1 {{(pid=77618) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:00:11 l75lg1-v1 dstat.sh[49771]: 28-05 13:00:11| 1 0 98 1 0|5681M 1774M 278M 7892M| 13k 0 | 0 1108k| 0 93.0 |1925 3084 |1.26 1.09 1.02|2.0 1.0 0| 0 0 | 0 2048M| 29 361 0 39 2 May 28 13:00:11 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-5ed4fd2a-523f-4a27-a0b4-05105f489990 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] POST http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/shares/510f7bcd-a0ee-49a6-8093-2640036f2ca3/action May 28 13:00:11 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-5ed4fd2a-523f-4a27-a0b4-05105f489990 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Action body: b'{"access_list": null}' {{(pid=98329) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 13:00:11 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-5ed4fd2a-523f-4a27-a0b4-05105f489990 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Action: 'action', calling method: ShareController.access_list, body: {"access_list": null} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:00:11 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-5ed4fd2a-523f-4a27-a0b4-05105f489990 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/shares/510f7bcd-a0ee-49a6-8093-2640036f2ca3/action returned with HTTP 200 May 28 13:00:11 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 886/1737] 10.27.203.238 () {66 vars in 1493 bytes} [Tue May 28 13:00:11 2024] POST /share/v2/a4f3887fa28c457390f5b66615564430/shares/510f7bcd-a0ee-49a6-8093-2640036f2ca3/action => generated 176 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:00:11 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-fb4afaea-b258-496e-8343-96602644b4fd tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] DELETE http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/shares/510f7bcd-a0ee-49a6-8093-2640036f2ca3 May 28 13:00:11 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-fb4afaea-b258-496e-8343-96602644b4fd tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:11 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-fb4afaea-b258-496e-8343-96602644b4fd tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Calling method 'ShareMixin.delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:11 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.v1.shares [None req-fb4afaea-b258-496e-8343-96602644b4fd tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Delete share with id: 510f7bcd-a0ee-49a6-8093-2640036f2ca3 May 28 13:00:11 l75lg1-v1 neutron-server[77623]: DEBUG dbcounter [-] [77623] Writing DB stats neutron:SELECT=1 {{(pid=77623) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:00:11 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e2ed177f-c4f4-4c2b-845f-14363b42af3d tempest-ShareTransferNegativeTest-884271560 None] <<< [POST] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:00:11 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e2ed177f-c4f4-4c2b-845f-14363b42af3d tempest-ShareTransferNegativeTest-884271560 None] Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=0, created='2024-05-28T13:00:10.875276Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='002017a6-3153-41e2-8337-4a4b751666b1', id=42, internal=False, is_s3_default_policy=False, name='f8e9c921-56e5-4b4a-a619-44221b8150a3', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=[], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['*'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['*'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T13:00:11.399026Z', tenant_id=1, tenant_name='default', title='f8e9c921-56e5-4b4a-a619-44221b8150a3', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/42/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[]) May 28 13:00:11 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e2ed177f-c4f4-4c2b-845f-14363b42af3d tempest-ShareTransferNegativeTest-884271560 None] --- [POST] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 13:00:11 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e2ed177f-c4f4-4c2b-845f-14363b42af3d tempest-ShareTransferNegativeTest-884271560 None] >>> [GET] https://127.0.0.1:40443/api/quotas/ May 28 13:00:11 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e2ed177f-c4f4-4c2b-845f-14363b42af3d tempest-ShareTransferNegativeTest-884271560 None] {'allow_redirects': True, May 28 13:00:11 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e2ed177f-c4f4-4c2b-845f-14363b42af3d tempest-ShareTransferNegativeTest-884271560 None] 'params': {'name': 'f8e9c921-56e5-4b4a-a619-44221b8150a3'}} May 28 13:00:11 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-fb4afaea-b258-496e-8343-96602644b4fd tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/shares/510f7bcd-a0ee-49a6-8093-2640036f2ca3 returned with HTTP 202 May 28 13:00:11 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 852/1738] 10.27.203.238 () {64 vars in 1454 bytes} [Tue May 28 13:00:11 2024] DELETE /share/v2/a4f3887fa28c457390f5b66615564430/shares/510f7bcd-a0ee-49a6-8093-2640036f2ca3 => generated 0 bytes in 131 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 13:00:11 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-8d8fff88-5dbd-48db-b34d-d5b8d708d833 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] GET http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/shares/510f7bcd-a0ee-49a6-8093-2640036f2ca3 May 28 13:00:11 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-8d8fff88-5dbd-48db-b34d-d5b8d708d833 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:11 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-8d8fff88-5dbd-48db-b34d-d5b8d708d833 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:11 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-8d8fff88-5dbd-48db-b34d-d5b8d708d833 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/shares/510f7bcd-a0ee-49a6-8093-2640036f2ca3 returned with HTTP 200 May 28 13:00:11 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 887/1739] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:00:11 2024] GET /share/v2/a4f3887fa28c457390f5b66615564430/shares/510f7bcd-a0ee-49a6-8093-2640036f2ca3 => generated 1315 bytes in 25 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:00:11 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-fb4afaea-b258-496e-8343-96602644b4fd tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_ee46a1d1-f743-461e-8bb5-467ee0e99edd" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:00:11 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-fb4afaea-b258-496e-8343-96602644b4fd tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_ee46a1d1-f743-461e-8bb5-467ee0e99edd" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.002s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:00:11 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-fb4afaea-b258-496e-8343-96602644b4fd tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_ee46a1d1-f743-461e-8bb5-467ee0e99edd" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.068s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:00:11 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-fb4afaea-b258-496e-8343-96602644b4fd tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_ee46a1d1-f743-461e-8bb5-467ee0e99edd" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:00:11 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-fb4afaea-b258-496e-8343-96602644b4fd tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_ee46a1d1-f743-461e-8bb5-467ee0e99edd" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:00:11 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-fb4afaea-b258-496e-8343-96602644b4fd tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_ee46a1d1-f743-461e-8bb5-467ee0e99edd" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:00:11 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-fb4afaea-b258-496e-8343-96602644b4fd tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_ee46a1d1-f743-461e-8bb5-467ee0e99edd" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:00:11 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-fb4afaea-b258-496e-8343-96602644b4fd tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_ee46a1d1-f743-461e-8bb5-467ee0e99edd" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:00:11 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.periodic_task [None req-e3486ff9-a95e-41bc-8901-df75aedbeaad None None] Running periodic task DataManager.create_backup_continue {{(pid=98318) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 13:00:11 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.periodic_task [None req-e3486ff9-a95e-41bc-8901-df75aedbeaad None None] Running periodic task DataManager.restore_backup_continue {{(pid=98318) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 13:00:11 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-fb4afaea-b258-496e-8343-96602644b4fd tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_ee46a1d1-f743-461e-8bb5-467ee0e99edd" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.059s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:00:11 l75lg1-v1 manila-share[98474]: DEBUG manila.share.access [None req-fb4afaea-b258-496e-8343-96602644b4fd tempest-ShareRulesTest-1530341375 None] Updating access rules for share instance ee46a1d1-f743-461e-8bb5-467ee0e99edd belonging to share 510f7bcd-a0ee-49a6-8093-2640036f2ca3. {{(pid=98474) update_access_rules /opt/stack/manila/manila/share/access.py:298}} May 28 13:00:11 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-fb4afaea-b258-496e-8343-96602644b4fd tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_ee46a1d1-f743-461e-8bb5-467ee0e99edd" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:00:11 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-fb4afaea-b258-496e-8343-96602644b4fd tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_ee46a1d1-f743-461e-8bb5-467ee0e99edd" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:00:11 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-fb4afaea-b258-496e-8343-96602644b4fd tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_ee46a1d1-f743-461e-8bb5-467ee0e99edd" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.047s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:00:11 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-fb4afaea-b258-496e-8343-96602644b4fd tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_ee46a1d1-f743-461e-8bb5-467ee0e99edd" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:00:11 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-fb4afaea-b258-496e-8343-96602644b4fd tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_ee46a1d1-f743-461e-8bb5-467ee0e99edd" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:00:11 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e2ed177f-c4f4-4c2b-845f-14363b42af3d tempest-ShareTransferNegativeTest-884271560 None] <<< [GET] https://127.0.0.1:40443/api/quotas/ May 28 13:00:11 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e2ed177f-c4f4-4c2b-845f-14363b42af3d tempest-ShareTransferNegativeTest-884271560 None] [] May 28 13:00:11 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e2ed177f-c4f4-4c2b-845f-14363b42af3d tempest-ShareTransferNegativeTest-884271560 None] --- [GET] https://127.0.0.1:40443/api/quotas/: Done May 28 13:00:11 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e2ed177f-c4f4-4c2b-845f-14363b42af3d tempest-ShareTransferNegativeTest-884271560 None] >>> [POST] https://127.0.0.1:40443/api/quotas/ May 28 13:00:11 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e2ed177f-c4f4-4c2b-845f-14363b42af3d tempest-ShareTransferNegativeTest-884271560 None] {'data': '{"name": "f8e9c921-56e5-4b4a-a619-44221b8150a3", "path": ' May 28 13:00:11 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e2ed177f-c4f4-4c2b-845f-14363b42af3d tempest-ShareTransferNegativeTest-884271560 None] '"/manila/manila-f8e9c921-56e5-4b4a-a619-44221b8150a3", "create_dir": ' May 28 13:00:11 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e2ed177f-c4f4-4c2b-845f-14363b42af3d tempest-ShareTransferNegativeTest-884271560 None] 'true, "hard_limit": 1073741824}', May 28 13:00:11 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e2ed177f-c4f4-4c2b-845f-14363b42af3d tempest-ShareTransferNegativeTest-884271560 None] 'json': None, May 28 13:00:11 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e2ed177f-c4f4-4c2b-845f-14363b42af3d tempest-ShareTransferNegativeTest-884271560 None] 'params': None} May 28 13:00:11 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-fb4afaea-b258-496e-8343-96602644b4fd tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_ee46a1d1-f743-461e-8bb5-467ee0e99edd" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.021s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:00:11 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-fb4afaea-b258-496e-8343-96602644b4fd tempest-ShareRulesTest-1530341375 None] changing access on None May 28 13:00:11 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-fb4afaea-b258-496e-8343-96602644b4fd tempest-ShareRulesTest-1530341375 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:00:11 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-fb4afaea-b258-496e-8343-96602644b4fd tempest-ShareRulesTest-1530341375 None] {'allow_redirects': True, May 28 13:00:11 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-fb4afaea-b258-496e-8343-96602644b4fd tempest-ShareRulesTest-1530341375 None] 'params': {'name': 'ee46a1d1-f743-461e-8bb5-467ee0e99edd'}} May 28 13:00:12 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-20a1af6e-b0fd-4d4f-9a2b-7d23e8a5449e tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] GET http://10.27.203.238/share/v2/cac556dc39a14bbdbdbabfc80672fb1f/shares/03abb6c7-1707-45b3-a692-3b1de0dd1fba May 28 13:00:12 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-20a1af6e-b0fd-4d4f-9a2b-7d23e8a5449e tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:12 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-20a1af6e-b0fd-4d4f-9a2b-7d23e8a5449e tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:12 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-fb4afaea-b258-496e-8343-96602644b4fd tempest-ShareRulesTest-1530341375 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:00:12 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-fb4afaea-b258-496e-8343-96602644b4fd tempest-ShareRulesTest-1530341375 None] [Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=1, created='2024-05-28T13:00:00.296044Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='0c5a8a38-6377-4415-a54d-f55b3cc6ff10', id=40, internal=False, is_s3_default_policy=False, name='ee46a1d1-f743-461e-8bb5-467ee0e99edd', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=['*'], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['203.0.113.77'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['203.0.113.77'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T13:00:08.246604Z', tenant_id=1, tenant_name='default', title='ee46a1d1-f743-461e-8bb5-467ee0e99edd', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/40/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[])] May 28 13:00:12 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-fb4afaea-b258-496e-8343-96602644b4fd tempest-ShareRulesTest-1530341375 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 13:00:12 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-fb4afaea-b258-496e-8343-96602644b4fd tempest-ShareRulesTest-1530341375 None] changing access on /manila/manila-ee46a1d1-f743-461e-8bb5-467ee0e99edd. Rules: {'nfs_read_write': [], 'nfs_read_only': []} May 28 13:00:12 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-fb4afaea-b258-496e-8343-96602644b4fd tempest-ShareRulesTest-1530341375 None] >>> [PATCH] https://127.0.0.1:40443/api/viewpolicies/40/ May 28 13:00:12 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-fb4afaea-b258-496e-8343-96602644b4fd tempest-ShareRulesTest-1530341375 None] {'data': '{"name": "ee46a1d1-f743-461e-8bb5-467ee0e99edd", "nfs_no_squash": ' May 28 13:00:12 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-fb4afaea-b258-496e-8343-96602644b4fd tempest-ShareRulesTest-1530341375 None] '["*"], "nfs_root_squash": ["*"], "nfs_read_write": [], ' May 28 13:00:12 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-fb4afaea-b258-496e-8343-96602644b4fd tempest-ShareRulesTest-1530341375 None] '"nfs_read_only": []}', May 28 13:00:12 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-fb4afaea-b258-496e-8343-96602644b4fd tempest-ShareRulesTest-1530341375 None] 'params': None} May 28 13:00:12 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-20a1af6e-b0fd-4d4f-9a2b-7d23e8a5449e tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] http://10.27.203.238/share/v2/cac556dc39a14bbdbdbabfc80672fb1f/shares/03abb6c7-1707-45b3-a692-3b1de0dd1fba returned with HTTP 200 May 28 13:00:12 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 853/1740] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:00:12 2024] GET /share/v2/cac556dc39a14bbdbdbabfc80672fb1f/shares/03abb6c7-1707-45b3-a692-3b1de0dd1fba => generated 1313 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:00:12 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0637416d-e366-4553-b2f3-3a4ab3a0f389 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] <<< [PATCH] https://127.0.0.1:40443/api/viewpolicies/32/ May 28 13:00:12 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0637416d-e366-4553-b2f3-3a4ab3a0f389 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=1, created='2024-05-28T12:58:43.845440Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='31b6534b-d142-4561-992f-4f0759db302d', id=32, internal=False, is_s3_default_policy=False, name='7fdd602c-79d0-479c-95a2-336b202c6639', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=['*'], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=[], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=[], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='MODIFYING', sync_time='2024-05-28T13:00:11.389828Z', tenant_id=1, tenant_name='default', title='7fdd602c-79d0-479c-95a2-336b202c6639', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/32/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[]) May 28 13:00:12 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0637416d-e366-4553-b2f3-3a4ab3a0f389 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] --- [PATCH] https://127.0.0.1:40443/api/viewpolicies/32/: Done May 28 13:00:12 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-0637416d-e366-4553-b2f3-3a4ab3a0f389 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:00:12 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-0637416d-e366-4553-b2f3-3a4ab3a0f389 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:00:12 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-0637416d-e366-4553-b2f3-3a4ab3a0f389 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.028s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:00:12 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-0637416d-e366-4553-b2f3-3a4ab3a0f389 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:00:12 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-0637416d-e366-4553-b2f3-3a4ab3a0f389 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:00:12 l75lg1-v1 dstat.sh[49771]: 28-05 13:00:12| 7 1 90 2 0|5681M 1774M 278M 7892M| 17k 3394B| 0 1300k| 0 148 |3733 6268 |1.23 1.09 1.02|1.0 1.0 0| 0 0 | 0 2048M| 29 361 0 39 2 May 28 13:00:12 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-0637416d-e366-4553-b2f3-3a4ab3a0f389 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.047s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:00:12 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-0637416d-e366-4553-b2f3-3a4ab3a0f389 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:00:12 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-0637416d-e366-4553-b2f3-3a4ab3a0f389 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:00:12 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-0637416d-e366-4553-b2f3-3a4ab3a0f389 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.004s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:00:12 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-0637416d-e366-4553-b2f3-3a4ab3a0f389 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:00:12 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-0637416d-e366-4553-b2f3-3a4ab3a0f389 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:00:12 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-0637416d-e366-4553-b2f3-3a4ab3a0f389 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:00:12 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-0637416d-e366-4553-b2f3-3a4ab3a0f389 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:00:12 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-0637416d-e366-4553-b2f3-3a4ab3a0f389 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:00:12 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-0637416d-e366-4553-b2f3-3a4ab3a0f389 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.058s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:00:12 l75lg1-v1 manila-share[98474]: INFO manila.share.access [None req-0637416d-e366-4553-b2f3-3a4ab3a0f389 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Access rules were successfully modified for share instance 7fdd602c-79d0-479c-95a2-336b202c6639 belonging to share 72db8769-ece7-42ff-af27-2e778292a9b4. May 28 13:00:12 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-a230d7f1-6665-4b04-baca-498a0fc07703 tempest-UserMessageNegativeTest-781603078 tempest-UserMessageNegativeTest-781603078-project-member] GET http://10.27.203.238/share/v2/ca9b4c5f200844bdbcc6db13e907f21e/shares/196fd448-d12b-4a72-b5dc-1b2a6ccc0416 May 28 13:00:12 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-a230d7f1-6665-4b04-baca-498a0fc07703 tempest-UserMessageNegativeTest-781603078 tempest-UserMessageNegativeTest-781603078-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:12 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-a230d7f1-6665-4b04-baca-498a0fc07703 tempest-UserMessageNegativeTest-781603078 tempest-UserMessageNegativeTest-781603078-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:12 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-a230d7f1-6665-4b04-baca-498a0fc07703 tempest-UserMessageNegativeTest-781603078 tempest-UserMessageNegativeTest-781603078-project-member] http://10.27.203.238/share/v2/ca9b4c5f200844bdbcc6db13e907f21e/shares/196fd448-d12b-4a72-b5dc-1b2a6ccc0416 returned with HTTP 200 May 28 13:00:12 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 888/1741] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:00:12 2024] GET /share/v2/ca9b4c5f200844bdbcc6db13e907f21e/shares/196fd448-d12b-4a72-b5dc-1b2a6ccc0416 => generated 1332 bytes in 24 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:00:12 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-3ad821a4-4d84-4c3c-8b2b-9d50c92058c1 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] GET http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/share-access-rules?share_id=72db8769-ece7-42ff-af27-2e778292a9b4 May 28 13:00:12 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-3ad821a4-4d84-4c3c-8b2b-9d50c92058c1 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:12 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-3ad821a4-4d84-4c3c-8b2b-9d50c92058c1 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:12 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-3ad821a4-4d84-4c3c-8b2b-9d50c92058c1 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/share-access-rules?share_id=72db8769-ece7-42ff-af27-2e778292a9b4 returned with HTTP 200 May 28 13:00:12 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 854/1742] 10.27.203.238 () {64 vars in 1467 bytes} [Tue May 28 13:00:12 2024] GET /share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/share-access-rules?share_id=72db8769-ece7-42ff-af27-2e778292a9b4 => generated 19 bytes in 31 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d28b336-1153-4c0c-ad53-b5540da2dba8 service manila] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-5d28b336-1153-4c0c-ad53-b5540da2dba8 service manila] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d28b336-1153-4c0c-ad53-b5540da2dba8 service manila] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060bf731-e46c-4a3a-84e3-d6b370b60dfb tempest-ShareIpRulesForNFSNegativeTest-700172924 tempest-ShareIpRulesForNFSNegativeTest-700172924-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7640802a4c39457089742b080e6c98b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f81d1d8d7c946e8aa46d6e3e510424c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060bf731-e46c-4a3a-84e3-d6b370b60dfb tempest-ShareIpRulesForNFSNegativeTest-700172924 tempest-ShareIpRulesForNFSNegativeTest-700172924-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060bf731-e46c-4a3a-84e3-d6b370b60dfb tempest-ShareIpRulesForNFSNegativeTest-700172924 tempest-ShareIpRulesForNFSNegativeTest-700172924-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060bf731-e46c-4a3a-84e3-d6b370b60dfb tempest-ShareIpRulesForNFSNegativeTest-700172924 tempest-ShareIpRulesForNFSNegativeTest-700172924-project-admin] PATH_INFO: `/v3/users/14783f4fbce14880b4db4a628827607e` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060bf731-e46c-4a3a-84e3-d6b370b60dfb tempest-ShareIpRulesForNFSNegativeTest-700172924 tempest-ShareIpRulesForNFSNegativeTest-700172924-project-admin] RBAC: Authorizing `identity:delete_user(user_id=14783f4fbce14880b4db4a628827607e)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060bf731-e46c-4a3a-84e3-d6b370b60dfb tempest-ShareIpRulesForNFSNegativeTest-700172924 tempest-ShareIpRulesForNFSNegativeTest-700172924-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-060bf731-e46c-4a3a-84e3-d6b370b60dfb tempest-ShareIpRulesForNFSNegativeTest-700172924 tempest-ShareIpRulesForNFSNegativeTest-700172924-project-admin] Could not find user: 14783f4fbce14880b4db4a628827607e.: keystone.exception.UserNotFound: Could not find user: 14783f4fbce14880b4db4a628827607e. May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 14783f4fbce14880b4db4a628827607e. May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1392/2755] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:00:12 2024] DELETE /identity/v3/users/14783f4fbce14880b4db4a628827607e => generated 110 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fca14a-5e6e-47ee-8c6f-6ccee64df9a1 service manila] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fca14a-5e6e-47ee-8c6f-6ccee64df9a1 service manila] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c933a95a-5d98-40d2-bce9-ebaa453d5092 tempest-ShareIpRulesForNFSNegativeTest-700172924 tempest-ShareIpRulesForNFSNegativeTest-700172924-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7640802a4c39457089742b080e6c98b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f81d1d8d7c946e8aa46d6e3e510424c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c933a95a-5d98-40d2-bce9-ebaa453d5092 tempest-ShareIpRulesForNFSNegativeTest-700172924 tempest-ShareIpRulesForNFSNegativeTest-700172924-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c933a95a-5d98-40d2-bce9-ebaa453d5092 tempest-ShareIpRulesForNFSNegativeTest-700172924 tempest-ShareIpRulesForNFSNegativeTest-700172924-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c933a95a-5d98-40d2-bce9-ebaa453d5092 tempest-ShareIpRulesForNFSNegativeTest-700172924 tempest-ShareIpRulesForNFSNegativeTest-700172924-project-admin] PATH_INFO: `/v3/users/9eca355145fd413390b5efe7a0d95465` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c933a95a-5d98-40d2-bce9-ebaa453d5092 tempest-ShareIpRulesForNFSNegativeTest-700172924 tempest-ShareIpRulesForNFSNegativeTest-700172924-project-admin] RBAC: Authorizing `identity:delete_user(user_id=9eca355145fd413390b5efe7a0d95465)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c933a95a-5d98-40d2-bce9-ebaa453d5092 tempest-ShareIpRulesForNFSNegativeTest-700172924 tempest-ShareIpRulesForNFSNegativeTest-700172924-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-c933a95a-5d98-40d2-bce9-ebaa453d5092 tempest-ShareIpRulesForNFSNegativeTest-700172924 tempest-ShareIpRulesForNFSNegativeTest-700172924-project-admin] Could not find user: 9eca355145fd413390b5efe7a0d95465.: keystone.exception.UserNotFound: Could not find user: 9eca355145fd413390b5efe7a0d95465. May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 9eca355145fd413390b5efe7a0d95465. May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1364/2756] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:00:12 2024] DELETE /identity/v3/users/9eca355145fd413390b5efe7a0d95465 => generated 110 bytes in 26 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060bf731-e46c-4a3a-84e3-d6b370b60dfb tempest-ShareIpRulesForNFSNegativeTest-700172924 tempest-ShareIpRulesForNFSNegativeTest-700172924-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060bf731-e46c-4a3a-84e3-d6b370b60dfb tempest-ShareIpRulesForNFSNegativeTest-700172924 tempest-ShareIpRulesForNFSNegativeTest-700172924-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c797fe-1556-4586-a7dd-81486f0ff33f tempest-ShareIpRulesForNFSNegativeTest-700172924 tempest-ShareIpRulesForNFSNegativeTest-700172924-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7640802a4c39457089742b080e6c98b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f81d1d8d7c946e8aa46d6e3e510424c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c797fe-1556-4586-a7dd-81486f0ff33f tempest-ShareIpRulesForNFSNegativeTest-700172924 tempest-ShareIpRulesForNFSNegativeTest-700172924-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c797fe-1556-4586-a7dd-81486f0ff33f tempest-ShareIpRulesForNFSNegativeTest-700172924 tempest-ShareIpRulesForNFSNegativeTest-700172924-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c797fe-1556-4586-a7dd-81486f0ff33f tempest-ShareIpRulesForNFSNegativeTest-700172924 tempest-ShareIpRulesForNFSNegativeTest-700172924-project-admin] PATH_INFO: `/v3/users/91ab54ee09854b549923fb7671247f5c` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c797fe-1556-4586-a7dd-81486f0ff33f tempest-ShareIpRulesForNFSNegativeTest-700172924 tempest-ShareIpRulesForNFSNegativeTest-700172924-project-admin] RBAC: Authorizing `identity:delete_user(user_id=91ab54ee09854b549923fb7671247f5c)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c797fe-1556-4586-a7dd-81486f0ff33f tempest-ShareIpRulesForNFSNegativeTest-700172924 tempest-ShareIpRulesForNFSNegativeTest-700172924-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-64c797fe-1556-4586-a7dd-81486f0ff33f tempest-ShareIpRulesForNFSNegativeTest-700172924 tempest-ShareIpRulesForNFSNegativeTest-700172924-project-admin] Could not find user: 91ab54ee09854b549923fb7671247f5c.: keystone.exception.UserNotFound: Could not find user: 91ab54ee09854b549923fb7671247f5c. May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 91ab54ee09854b549923fb7671247f5c. May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1393/2757] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:00:12 2024] DELETE /identity/v3/users/91ab54ee09854b549923fb7671247f5c => generated 110 bytes in 23 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c933a95a-5d98-40d2-bce9-ebaa453d5092 tempest-ShareIpRulesForNFSNegativeTest-700172924 tempest-ShareIpRulesForNFSNegativeTest-700172924-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c933a95a-5d98-40d2-bce9-ebaa453d5092 tempest-ShareIpRulesForNFSNegativeTest-700172924 tempest-ShareIpRulesForNFSNegativeTest-700172924-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df57669-a1e1-4b9a-b61e-bc3671d7c6a5 tempest-ShareIpRulesForNFSNegativeTest-700172924 tempest-ShareIpRulesForNFSNegativeTest-700172924-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7640802a4c39457089742b080e6c98b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f81d1d8d7c946e8aa46d6e3e510424c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df57669-a1e1-4b9a-b61e-bc3671d7c6a5 tempest-ShareIpRulesForNFSNegativeTest-700172924 tempest-ShareIpRulesForNFSNegativeTest-700172924-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df57669-a1e1-4b9a-b61e-bc3671d7c6a5 tempest-ShareIpRulesForNFSNegativeTest-700172924 tempest-ShareIpRulesForNFSNegativeTest-700172924-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df57669-a1e1-4b9a-b61e-bc3671d7c6a5 tempest-ShareIpRulesForNFSNegativeTest-700172924 tempest-ShareIpRulesForNFSNegativeTest-700172924-project-admin] PATH_INFO: `/v3/users/2889a927897c49bd92a0d1cfdf27e7f5` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df57669-a1e1-4b9a-b61e-bc3671d7c6a5 tempest-ShareIpRulesForNFSNegativeTest-700172924 tempest-ShareIpRulesForNFSNegativeTest-700172924-project-admin] RBAC: Authorizing `identity:delete_user(user_id=2889a927897c49bd92a0d1cfdf27e7f5)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df57669-a1e1-4b9a-b61e-bc3671d7c6a5 tempest-ShareIpRulesForNFSNegativeTest-700172924 tempest-ShareIpRulesForNFSNegativeTest-700172924-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-2df57669-a1e1-4b9a-b61e-bc3671d7c6a5 tempest-ShareIpRulesForNFSNegativeTest-700172924 tempest-ShareIpRulesForNFSNegativeTest-700172924-project-admin] Could not find user: 2889a927897c49bd92a0d1cfdf27e7f5.: keystone.exception.UserNotFound: Could not find user: 2889a927897c49bd92a0d1cfdf27e7f5. May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 2889a927897c49bd92a0d1cfdf27e7f5. May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1365/2758] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:00:12 2024] DELETE /identity/v3/users/2889a927897c49bd92a0d1cfdf27e7f5 => generated 110 bytes in 25 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c797fe-1556-4586-a7dd-81486f0ff33f tempest-ShareIpRulesForNFSNegativeTest-700172924 tempest-ShareIpRulesForNFSNegativeTest-700172924-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c797fe-1556-4586-a7dd-81486f0ff33f tempest-ShareIpRulesForNFSNegativeTest-700172924 tempest-ShareIpRulesForNFSNegativeTest-700172924-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc71ce3-73bc-4d7c-b887-ed84e898a03b tempest-ShareIpRulesForNFSNegativeTest-700172924 tempest-ShareIpRulesForNFSNegativeTest-700172924-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7640802a4c39457089742b080e6c98b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f81d1d8d7c946e8aa46d6e3e510424c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc71ce3-73bc-4d7c-b887-ed84e898a03b tempest-ShareIpRulesForNFSNegativeTest-700172924 tempest-ShareIpRulesForNFSNegativeTest-700172924-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc71ce3-73bc-4d7c-b887-ed84e898a03b tempest-ShareIpRulesForNFSNegativeTest-700172924 tempest-ShareIpRulesForNFSNegativeTest-700172924-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc71ce3-73bc-4d7c-b887-ed84e898a03b tempest-ShareIpRulesForNFSNegativeTest-700172924 tempest-ShareIpRulesForNFSNegativeTest-700172924-project-admin] PATH_INFO: `/v3/users/bd43e5d1c359462d807b6e8a8581fa73` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc71ce3-73bc-4d7c-b887-ed84e898a03b tempest-ShareIpRulesForNFSNegativeTest-700172924 tempest-ShareIpRulesForNFSNegativeTest-700172924-project-admin] RBAC: Authorizing `identity:delete_user(user_id=bd43e5d1c359462d807b6e8a8581fa73)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc71ce3-73bc-4d7c-b887-ed84e898a03b tempest-ShareIpRulesForNFSNegativeTest-700172924 tempest-ShareIpRulesForNFSNegativeTest-700172924-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-6cc71ce3-73bc-4d7c-b887-ed84e898a03b tempest-ShareIpRulesForNFSNegativeTest-700172924 tempest-ShareIpRulesForNFSNegativeTest-700172924-project-admin] Could not find user: bd43e5d1c359462d807b6e8a8581fa73.: keystone.exception.UserNotFound: Could not find user: bd43e5d1c359462d807b6e8a8581fa73. May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: bd43e5d1c359462d807b6e8a8581fa73. May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1394/2759] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:00:12 2024] DELETE /identity/v3/users/bd43e5d1c359462d807b6e8a8581fa73 => generated 110 bytes in 24 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df57669-a1e1-4b9a-b61e-bc3671d7c6a5 tempest-ShareIpRulesForNFSNegativeTest-700172924 tempest-ShareIpRulesForNFSNegativeTest-700172924-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df57669-a1e1-4b9a-b61e-bc3671d7c6a5 tempest-ShareIpRulesForNFSNegativeTest-700172924 tempest-ShareIpRulesForNFSNegativeTest-700172924-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede735dc-3624-4f5b-ab9f-b1a934f1cb2a tempest-ShareIpRulesForNFSNegativeTest-700172924 tempest-ShareIpRulesForNFSNegativeTest-700172924-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7640802a4c39457089742b080e6c98b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f81d1d8d7c946e8aa46d6e3e510424c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede735dc-3624-4f5b-ab9f-b1a934f1cb2a tempest-ShareIpRulesForNFSNegativeTest-700172924 tempest-ShareIpRulesForNFSNegativeTest-700172924-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede735dc-3624-4f5b-ab9f-b1a934f1cb2a tempest-ShareIpRulesForNFSNegativeTest-700172924 tempest-ShareIpRulesForNFSNegativeTest-700172924-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede735dc-3624-4f5b-ab9f-b1a934f1cb2a tempest-ShareIpRulesForNFSNegativeTest-700172924 tempest-ShareIpRulesForNFSNegativeTest-700172924-project-admin] PATH_INFO: `/v3/users/18c7667276334e98bdd11d2b9d1875cc` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede735dc-3624-4f5b-ab9f-b1a934f1cb2a tempest-ShareIpRulesForNFSNegativeTest-700172924 tempest-ShareIpRulesForNFSNegativeTest-700172924-project-admin] RBAC: Authorizing `identity:delete_user(user_id=18c7667276334e98bdd11d2b9d1875cc)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede735dc-3624-4f5b-ab9f-b1a934f1cb2a tempest-ShareIpRulesForNFSNegativeTest-700172924 tempest-ShareIpRulesForNFSNegativeTest-700172924-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:12 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e2ed177f-c4f4-4c2b-845f-14363b42af3d tempest-ShareTransferNegativeTest-884271560 None] <<< [POST] https://127.0.0.1:40443/api/quotas/ May 28 13:00:12 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e2ed177f-c4f4-4c2b-845f-14363b42af3d tempest-ShareTransferNegativeTest-884271560 None] Bunch(cluster='loop75-kfs', cluster_id=1, default_email=None, default_group_quota=None, default_user_quota=None, enable_alarms=True, enable_email_providers=True, grace_period=None, group_quotas=[], guid='b40682dd-5910-4f89-838b-0ef0eef45cc7', hard_limit=1073741824, hard_limit_inodes=None, id=39, internal=False, is_user_quota=False, last_user_quotas_update=None, name='f8e9c921-56e5-4b4a-a619-44221b8150a3', num_blocked_users=0, num_exceeded_users=0, path='/manila/manila-f8e9c921-56e5-4b4a-a619-44221b8150a3', percent_capacity=0, percent_inodes=None, pretty_grace_period=None, pretty_grace_period_expiration=None, pretty_state='OK (CREATED)', soft_limit=None, soft_limit_inodes=None, state='OK', sync_state='CREATED', system_id=39, tenant_id=1, tenant_name='default', time_to_block=None, title='f8e9c921-56e5-4b4a-a619-44221b8150a3', url='https://127.0.0.1:40443/api/quotas/39/', used_capacity=0, used_capacity_tb=0.0, used_effective_capacity=0, used_effective_capacity_tb=0.0, used_inodes=0, used_limited_capacity=0, user_quotas=[]) May 28 13:00:12 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e2ed177f-c4f4-4c2b-845f-14363b42af3d tempest-ShareTransferNegativeTest-884271560 None] --- [POST] https://127.0.0.1:40443/api/quotas/: Done May 28 13:00:12 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e2ed177f-c4f4-4c2b-845f-14363b42af3d tempest-ShareTransferNegativeTest-884271560 None] >>> [GET] https://127.0.0.1:40443/api/views/ May 28 13:00:12 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e2ed177f-c4f4-4c2b-845f-14363b42af3d tempest-ShareTransferNegativeTest-884271560 None] {'allow_redirects': True, May 28 13:00:12 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e2ed177f-c4f4-4c2b-845f-14363b42af3d tempest-ShareTransferNegativeTest-884271560 None] 'params': {'name': 'f8e9c921-56e5-4b4a-a619-44221b8150a3'}} May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-ede735dc-3624-4f5b-ab9f-b1a934f1cb2a tempest-ShareIpRulesForNFSNegativeTest-700172924 tempest-ShareIpRulesForNFSNegativeTest-700172924-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18c7667276334e98bdd11d2b9d1875cc', 'request_id': 'req-ede735dc-3624-4f5b-ab9f-b1a934f1cb2a'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-ede735dc-3624-4f5b-ab9f-b1a934f1cb2a tempest-ShareIpRulesForNFSNegativeTest-700172924 tempest-ShareIpRulesForNFSNegativeTest-700172924-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18c7667276334e98bdd11d2b9d1875cc', 'request_id': 'req-ede735dc-3624-4f5b-ab9f-b1a934f1cb2a'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-ede735dc-3624-4f5b-ab9f-b1a934f1cb2a tempest-ShareIpRulesForNFSNegativeTest-700172924 tempest-ShareIpRulesForNFSNegativeTest-700172924-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18c7667276334e98bdd11d2b9d1875cc', 'request_id': 'req-ede735dc-3624-4f5b-ab9f-b1a934f1cb2a'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-ede735dc-3624-4f5b-ab9f-b1a934f1cb2a tempest-ShareIpRulesForNFSNegativeTest-700172924 tempest-ShareIpRulesForNFSNegativeTest-700172924-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18c7667276334e98bdd11d2b9d1875cc', 'request_id': 'req-ede735dc-3624-4f5b-ab9f-b1a934f1cb2a'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-ede735dc-3624-4f5b-ab9f-b1a934f1cb2a tempest-ShareIpRulesForNFSNegativeTest-700172924 tempest-ShareIpRulesForNFSNegativeTest-700172924-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18c7667276334e98bdd11d2b9d1875cc', 'request_id': 'req-ede735dc-3624-4f5b-ab9f-b1a934f1cb2a'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1366/2760] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:00:12 2024] DELETE /identity/v3/users/18c7667276334e98bdd11d2b9d1875cc => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc71ce3-73bc-4d7c-b887-ed84e898a03b tempest-ShareIpRulesForNFSNegativeTest-700172924 tempest-ShareIpRulesForNFSNegativeTest-700172924-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-6cc71ce3-73bc-4d7c-b887-ed84e898a03b tempest-ShareIpRulesForNFSNegativeTest-700172924 tempest-ShareIpRulesForNFSNegativeTest-700172924-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc71ce3-73bc-4d7c-b887-ed84e898a03b tempest-ShareIpRulesForNFSNegativeTest-700172924 tempest-ShareIpRulesForNFSNegativeTest-700172924-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c38d0f-5fcd-476b-b4ce-bab5be69e114 tempest-ShareIpRulesForNFSNegativeTest-700172924 tempest-ShareIpRulesForNFSNegativeTest-700172924-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7640802a4c39457089742b080e6c98b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f81d1d8d7c946e8aa46d6e3e510424c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c38d0f-5fcd-476b-b4ce-bab5be69e114 tempest-ShareIpRulesForNFSNegativeTest-700172924 tempest-ShareIpRulesForNFSNegativeTest-700172924-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c38d0f-5fcd-476b-b4ce-bab5be69e114 tempest-ShareIpRulesForNFSNegativeTest-700172924 tempest-ShareIpRulesForNFSNegativeTest-700172924-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c38d0f-5fcd-476b-b4ce-bab5be69e114 tempest-ShareIpRulesForNFSNegativeTest-700172924 tempest-ShareIpRulesForNFSNegativeTest-700172924-project-admin] PATH_INFO: `/v3/users/db0396a316ea4c5697d47df053fccbe4` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c38d0f-5fcd-476b-b4ce-bab5be69e114 tempest-ShareIpRulesForNFSNegativeTest-700172924 tempest-ShareIpRulesForNFSNegativeTest-700172924-project-admin] RBAC: Authorizing `identity:delete_user(user_id=db0396a316ea4c5697d47df053fccbe4)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c38d0f-5fcd-476b-b4ce-bab5be69e114 tempest-ShareIpRulesForNFSNegativeTest-700172924 tempest-ShareIpRulesForNFSNegativeTest-700172924-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-e0c38d0f-5fcd-476b-b4ce-bab5be69e114 tempest-ShareIpRulesForNFSNegativeTest-700172924 tempest-ShareIpRulesForNFSNegativeTest-700172924-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db0396a316ea4c5697d47df053fccbe4', 'request_id': 'req-e0c38d0f-5fcd-476b-b4ce-bab5be69e114'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-e0c38d0f-5fcd-476b-b4ce-bab5be69e114 tempest-ShareIpRulesForNFSNegativeTest-700172924 tempest-ShareIpRulesForNFSNegativeTest-700172924-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db0396a316ea4c5697d47df053fccbe4', 'request_id': 'req-e0c38d0f-5fcd-476b-b4ce-bab5be69e114'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-e0c38d0f-5fcd-476b-b4ce-bab5be69e114 tempest-ShareIpRulesForNFSNegativeTest-700172924 tempest-ShareIpRulesForNFSNegativeTest-700172924-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db0396a316ea4c5697d47df053fccbe4', 'request_id': 'req-e0c38d0f-5fcd-476b-b4ce-bab5be69e114'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-e0c38d0f-5fcd-476b-b4ce-bab5be69e114 tempest-ShareIpRulesForNFSNegativeTest-700172924 tempest-ShareIpRulesForNFSNegativeTest-700172924-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db0396a316ea4c5697d47df053fccbe4', 'request_id': 'req-e0c38d0f-5fcd-476b-b4ce-bab5be69e114'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-e0c38d0f-5fcd-476b-b4ce-bab5be69e114 tempest-ShareIpRulesForNFSNegativeTest-700172924 tempest-ShareIpRulesForNFSNegativeTest-700172924-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db0396a316ea4c5697d47df053fccbe4', 'request_id': 'req-e0c38d0f-5fcd-476b-b4ce-bab5be69e114'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:12 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1395/2761] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:00:12 2024] DELETE /identity/v3/users/db0396a316ea4c5697d47df053fccbe4 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:00:12 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-b2b04547-f0b3-4bf9-a257-a4c2a7e7a729 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] DELETE http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/snapshots/0fba4486-6341-49ab-a9dc-333609ce1d2e May 28 13:00:12 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-b2b04547-f0b3-4bf9-a257-a4c2a7e7a729 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:12 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-b2b04547-f0b3-4bf9-a257-a4c2a7e7a729 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Calling method 'ShareSnapshotMixin.delete' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:12 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.v1.share_snapshots [None req-b2b04547-f0b3-4bf9-a257-a4c2a7e7a729 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Delete snapshot with id: 0fba4486-6341-49ab-a9dc-333609ce1d2e May 28 13:00:13 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-b2b04547-f0b3-4bf9-a257-a4c2a7e7a729 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/snapshots/0fba4486-6341-49ab-a9dc-333609ce1d2e returned with HTTP 202 May 28 13:00:13 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 889/1743] 10.27.203.238 () {64 vars in 1463 bytes} [Tue May 28 13:00:12 2024] DELETE /share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/snapshots/0fba4486-6341-49ab-a9dc-333609ce1d2e => generated 0 bytes in 89 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 13:00:13 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-e73e4cda-20d8-4336-abf7-f947ffc06bba tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] GET http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/snapshots/0fba4486-6341-49ab-a9dc-333609ce1d2e May 28 13:00:13 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-e73e4cda-20d8-4336-abf7-f947ffc06bba tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:13 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-e73e4cda-20d8-4336-abf7-f947ffc06bba tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Calling method 'ShareSnapshotMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:13 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-e73e4cda-20d8-4336-abf7-f947ffc06bba tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/snapshots/0fba4486-6341-49ab-a9dc-333609ce1d2e returned with HTTP 200 May 28 13:00:13 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 855/1744] 10.27.203.238 () {64 vars in 1460 bytes} [Tue May 28 13:00:13 2024] GET /share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/snapshots/0fba4486-6341-49ab-a9dc-333609ce1d2e => generated 722 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:00:13 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b2b04547-f0b3-4bf9-a257-a4c2a7e7a729 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] >>> [GET] https://127.0.0.1:40443/api/snapshots/ May 28 13:00:13 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b2b04547-f0b3-4bf9-a257-a4c2a7e7a729 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] {'allow_redirects': True, May 28 13:00:13 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b2b04547-f0b3-4bf9-a257-a4c2a7e7a729 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] 'params': {'name': 'share-snapshot-5fdc999d-abe8-4e79-a497-bb575e26d5e8'}} May 28 13:00:13 l75lg1-v1 dstat.sh[49771]: 28-05 13:00:13| 8 1 87 3 0|5682M 1773M 278M 7893M| 12k 4451B| 0 3977k| 0 364 |6541 11k|1.23 1.09 1.02|1.0 1.0 0| 0 0 | 0 2048M| 29 361 0 36 2 May 28 13:00:13 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e2ed177f-c4f4-4c2b-845f-14363b42af3d tempest-ShareTransferNegativeTest-884271560 None] <<< [GET] https://127.0.0.1:40443/api/views/ May 28 13:00:13 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e2ed177f-c4f4-4c2b-845f-14363b42af3d tempest-ShareTransferNegativeTest-884271560 None] [] May 28 13:00:13 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e2ed177f-c4f4-4c2b-845f-14363b42af3d tempest-ShareTransferNegativeTest-884271560 None] --- [GET] https://127.0.0.1:40443/api/views/: Done May 28 13:00:13 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e2ed177f-c4f4-4c2b-845f-14363b42af3d tempest-ShareTransferNegativeTest-884271560 None] >>> [POST] https://127.0.0.1:40443/api/views/ May 28 13:00:13 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e2ed177f-c4f4-4c2b-845f-14363b42af3d tempest-ShareTransferNegativeTest-884271560 None] {'data': '{"name": "f8e9c921-56e5-4b4a-a619-44221b8150a3", "path": ' May 28 13:00:13 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e2ed177f-c4f4-4c2b-845f-14363b42af3d tempest-ShareTransferNegativeTest-884271560 None] '"/manila/manila-f8e9c921-56e5-4b4a-a619-44221b8150a3", "policy_id": ' May 28 13:00:13 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e2ed177f-c4f4-4c2b-845f-14363b42af3d tempest-ShareTransferNegativeTest-884271560 None] '42, "create_dir": true, "protocols": ["NFS"]}', May 28 13:00:13 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e2ed177f-c4f4-4c2b-845f-14363b42af3d tempest-ShareTransferNegativeTest-884271560 None] 'json': None, May 28 13:00:13 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e2ed177f-c4f4-4c2b-845f-14363b42af3d tempest-ShareTransferNegativeTest-884271560 None] 'params': None} May 28 13:00:13 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b2b04547-f0b3-4bf9-a257-a4c2a7e7a729 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] <<< [GET] https://127.0.0.1:40443/api/snapshots/ May 28 13:00:13 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b2b04547-f0b3-4bf9-a257-a4c2a7e7a729 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] [Bunch(access_path='/.vast_all_snapshots/1000000011_share-snapshot-5fdc999d-abe8-4e79-a497-bb575e26d5e8', aggr_phys_estimation=0, cluster='loop75-kfs', created='2024-05-28T12:58:49.395321Z', eta_sec=30819898784.54463, expiration_time='3001-01-19T07:59:58Z', guid='fc7eef1d-8506-4ae0-a79e-3ff3cd2aeee9', id=12, indestructible=False, locked=False, name='share-snapshot-5fdc999d-abe8-4e79-a497-bb575e26d5e8', path='/manila/manila-7fdd602c-79d0-479c-95a2-336b202c6639/', policy=None, policy_id=None, protection_policy_id=None, state='SUCCEED', tenant_id=1, tenant_name='default', title='share-snapshot-5fdc999d-abe8-4e79-a497-bb575e26d5e8(/manila/manila-7fdd602c-79d0-479c-95a2-336b202c6639/)', type='local', unique_phys_estimation=0, url='https://127.0.0.1:40443/api/snapshots/12/')] May 28 13:00:13 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b2b04547-f0b3-4bf9-a257-a4c2a7e7a729 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] --- [GET] https://127.0.0.1:40443/api/snapshots/: Done May 28 13:00:13 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b2b04547-f0b3-4bf9-a257-a4c2a7e7a729 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] >>> [DELETE] https://127.0.0.1:40443/api/snapshots/12/ May 28 13:00:13 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-fb4afaea-b258-496e-8343-96602644b4fd tempest-ShareRulesTest-1530341375 None] <<< [PATCH] https://127.0.0.1:40443/api/viewpolicies/40/ May 28 13:00:14 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-fb4afaea-b258-496e-8343-96602644b4fd tempest-ShareRulesTest-1530341375 None] Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=1, created='2024-05-28T13:00:00.296044Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='0c5a8a38-6377-4415-a54d-f55b3cc6ff10', id=40, internal=False, is_s3_default_policy=False, name='ee46a1d1-f743-461e-8bb5-467ee0e99edd', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=['*'], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=[], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=[], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='MODIFYING', sync_time='2024-05-28T13:00:13.461308Z', tenant_id=1, tenant_name='default', title='ee46a1d1-f743-461e-8bb5-467ee0e99edd', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/40/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[]) May 28 13:00:14 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-fb4afaea-b258-496e-8343-96602644b4fd tempest-ShareRulesTest-1530341375 None] --- [PATCH] https://127.0.0.1:40443/api/viewpolicies/40/: Done May 28 13:00:14 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-fb4afaea-b258-496e-8343-96602644b4fd tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_ee46a1d1-f743-461e-8bb5-467ee0e99edd" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:00:14 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-fb4afaea-b258-496e-8343-96602644b4fd tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_ee46a1d1-f743-461e-8bb5-467ee0e99edd" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:00:14 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-fb4afaea-b258-496e-8343-96602644b4fd tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_ee46a1d1-f743-461e-8bb5-467ee0e99edd" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.029s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:00:14 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-fb4afaea-b258-496e-8343-96602644b4fd tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_ee46a1d1-f743-461e-8bb5-467ee0e99edd" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:00:14 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-fb4afaea-b258-496e-8343-96602644b4fd tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_ee46a1d1-f743-461e-8bb5-467ee0e99edd" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:00:14 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-fb4afaea-b258-496e-8343-96602644b4fd tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_ee46a1d1-f743-461e-8bb5-467ee0e99edd" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.026s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:00:14 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-fb4afaea-b258-496e-8343-96602644b4fd tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_ee46a1d1-f743-461e-8bb5-467ee0e99edd" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:00:14 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-fb4afaea-b258-496e-8343-96602644b4fd tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_ee46a1d1-f743-461e-8bb5-467ee0e99edd" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:00:14 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-fb4afaea-b258-496e-8343-96602644b4fd tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_ee46a1d1-f743-461e-8bb5-467ee0e99edd" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.004s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:00:14 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-fb4afaea-b258-496e-8343-96602644b4fd tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_ee46a1d1-f743-461e-8bb5-467ee0e99edd" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:00:14 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-fb4afaea-b258-496e-8343-96602644b4fd tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_ee46a1d1-f743-461e-8bb5-467ee0e99edd" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:00:14 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-fb4afaea-b258-496e-8343-96602644b4fd tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_ee46a1d1-f743-461e-8bb5-467ee0e99edd" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.004s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:00:14 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-fb4afaea-b258-496e-8343-96602644b4fd tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_ee46a1d1-f743-461e-8bb5-467ee0e99edd" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:00:14 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-fb4afaea-b258-496e-8343-96602644b4fd tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_ee46a1d1-f743-461e-8bb5-467ee0e99edd" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:00:14 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-fb4afaea-b258-496e-8343-96602644b4fd tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_ee46a1d1-f743-461e-8bb5-467ee0e99edd" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.042s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:00:14 l75lg1-v1 manila-share[98474]: INFO manila.share.access [None req-fb4afaea-b258-496e-8343-96602644b4fd tempest-ShareRulesTest-1530341375 None] Access rules were successfully modified for share instance ee46a1d1-f743-461e-8bb5-467ee0e99edd belonging to share 510f7bcd-a0ee-49a6-8093-2640036f2ca3. May 28 13:00:14 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-fb4afaea-b258-496e-8343-96602644b4fd tempest-ShareRulesTest-1530341375 None] deleting '/manila/manila-ee46a1d1-f743-461e-8bb5-467ee0e99edd' May 28 13:00:14 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-fb4afaea-b258-496e-8343-96602644b4fd tempest-ShareRulesTest-1530341375 None] >>> [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/ May 28 13:00:14 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-fb4afaea-b258-496e-8343-96602644b4fd tempest-ShareRulesTest-1530341375 None] {'data': '{"path": "/manila/manila-ee46a1d1-f743-461e-8bb5-467ee0e99edd"}', May 28 13:00:14 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-fb4afaea-b258-496e-8343-96602644b4fd tempest-ShareRulesTest-1530341375 None] 'params': None} May 28 13:00:14 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-fb4afaea-b258-496e-8343-96602644b4fd tempest-ShareRulesTest-1530341375 None] <<< [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/ May 28 13:00:14 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-fb4afaea-b258-496e-8343-96602644b4fd tempest-ShareRulesTest-1530341375 None] 'OK' May 28 13:00:14 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-fb4afaea-b258-496e-8343-96602644b4fd tempest-ShareRulesTest-1530341375 None] --- [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/: Done May 28 13:00:14 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-fb4afaea-b258-496e-8343-96602644b4fd tempest-ShareRulesTest-1530341375 None] >>> [GET] https://127.0.0.1:40443/api/views/ May 28 13:00:14 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-fb4afaea-b258-496e-8343-96602644b4fd tempest-ShareRulesTest-1530341375 None] {'allow_redirects': True, May 28 13:00:14 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-fb4afaea-b258-496e-8343-96602644b4fd tempest-ShareRulesTest-1530341375 None] 'params': {'name': 'ee46a1d1-f743-461e-8bb5-467ee0e99edd'}} May 28 13:00:14 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e2ed177f-c4f4-4c2b-845f-14363b42af3d tempest-ShareTransferNegativeTest-884271560 None] <<< [POST] https://127.0.0.1:40443/api/views/ May 28 13:00:14 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e2ed177f-c4f4-4c2b-845f-14363b42af3d tempest-ShareTransferNegativeTest-884271560 None] Bunch(abac_tags=[], abe_max_depth=None, abe_protocols=[], alias='', allow_anonymous_access=False, allow_s3_anonymous_access=False, auto_commit='0d', bucket='', bucket_creators=[], bucket_creators_groups=[], bucket_owner=None, bulk_permission_update_progress=None, bulk_permission_update_state=None, cluster='loop75-kfs', cluster_id=1, created='2024-05-28T13:00:13.859103Z', enabled=True, files_retention_mode='NONE', guid='bd4002f0-cdd1-438b-9fc7-8bd760ba0dbe', id=41, ignore_oos=False, internal=False, is_remote=False, is_seamless=False, logical_capacity=0, max_retention_period=None, min_retention_period=None, name='f8e9c921-56e5-4b4a-a619-44221b8150a3', nfs_interop_flags='BOTH_NFS3_AND_NFS4_INTEROP_DISABLED', path='/manila/manila-f8e9c921-56e5-4b4a-a619-44221b8150a3', physical_capacity=0, policy='f8e9c921-56e5-4b4a-a619-44221b8150a3', policy_id=42, protocols=['NFS'], qos_policy=None, qos_policy_id=None, s3_locks=False, s3_locks_retention_mode='NONE', s3_locks_retention_period='', s3_object_ownership_rule='ObjectWriter', s3_unverified_lookup=False, s3_versioning=False, select_for_live_monitoring=False, share='', share_acl=Bunch(acl=[], enabled=False), sync='SYNCED', sync_time='2024-05-28T13:00:14.144608Z', tenant_id=1, tenant_name='default', title='/manila/manila-f8e9c921-56e5-4b4a-a619-44221b8150a3', url='https://127.0.0.1:40443/api/views/41/') May 28 13:00:14 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e2ed177f-c4f4-4c2b-845f-14363b42af3d tempest-ShareTransferNegativeTest-884271560 None] --- [POST] https://127.0.0.1:40443/api/views/: Done May 28 13:00:14 l75lg1-v1 dstat.sh[49771]: 28-05 13:00:14| 2 0 97 0 0|5682M 1772M 278M 7893M| 16k 3247B| 0 628k| 0 62.0 |2243 3790 |1.23 1.09 1.02|2.0 1.0 0| 0 0 | 0 2048M| 29 361 0 36 2 May 28 13:00:14 l75lg1-v1 manila-share[98474]: INFO manila.share.manager [None req-e2ed177f-c4f4-4c2b-845f-14363b42af3d tempest-ShareTransferNegativeTest-884271560 None] Share instance f8e9c921-56e5-4b4a-a619-44221b8150a3 created successfully. May 28 13:00:14 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-e2285948-6f5b-4a1f-900d-0faa47e22866 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] GET http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/shares/510f7bcd-a0ee-49a6-8093-2640036f2ca3 May 28 13:00:14 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-e2285948-6f5b-4a1f-900d-0faa47e22866 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:14 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-e2285948-6f5b-4a1f-900d-0faa47e22866 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:14 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-e2285948-6f5b-4a1f-900d-0faa47e22866 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/shares/510f7bcd-a0ee-49a6-8093-2640036f2ca3 returned with HTTP 200 May 28 13:00:14 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 890/1745] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:00:14 2024] GET /share/v2/a4f3887fa28c457390f5b66615564430/shares/510f7bcd-a0ee-49a6-8093-2640036f2ca3 => generated 1315 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:00:14 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b2b04547-f0b3-4bf9-a257-a4c2a7e7a729 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] <<< [DELETE] https://127.0.0.1:40443/api/snapshots/12/ May 28 13:00:14 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b2b04547-f0b3-4bf9-a257-a4c2a7e7a729 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] --- [DELETE] https://127.0.0.1:40443/api/snapshots/12/: Done May 28 13:00:14 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-b2b04547-f0b3-4bf9-a257-a4c2a7e7a729 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Created reservations ['9a4f4204-08fc-4cef-8b9d-694792ed1fb4', 'd994d899-7ce5-4167-bf0d-e19362be466c', '52f5c273-29d3-4e09-a664-7ca3a32c6c24', '6c09a418-9bd2-47fa-b6ec-2129eb4714bc'] {{(pid=98474) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 13:00:14 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-fb4afaea-b258-496e-8343-96602644b4fd tempest-ShareRulesTest-1530341375 None] <<< [GET] https://127.0.0.1:40443/api/views/ May 28 13:00:14 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-fb4afaea-b258-496e-8343-96602644b4fd tempest-ShareRulesTest-1530341375 None] [Bunch(abac_tags=[], abe_max_depth=None, abe_protocols=[], alias='', allow_anonymous_access=False, allow_s3_anonymous_access=False, auto_commit='0d', bucket='', bucket_creators=[], bucket_creators_groups=[], bucket_owner=None, bulk_permission_update_progress=None, bulk_permission_update_state=None, cluster='loop75-kfs', cluster_id=1, created='2024-05-28T13:00:03.036019Z', enabled=True, files_retention_mode='NONE', guid='3ed91fde-e932-493f-93b2-9b536b622c48', id=39, ignore_oos=False, internal=False, is_remote=False, is_seamless=False, logical_capacity=0, max_retention_period='0d', min_retention_period='0d', name='ee46a1d1-f743-461e-8bb5-467ee0e99edd', nfs_interop_flags='BOTH_NFS3_AND_NFS4_INTEROP_DISABLED', path='/manila/manila-ee46a1d1-f743-461e-8bb5-467ee0e99edd', physical_capacity=0, policy='ee46a1d1-f743-461e-8bb5-467ee0e99edd', policy_id=40, protocols=['NFS'], qos_policy=None, qos_policy_id=None, s3_locks=False, s3_locks_retention_mode='NONE', s3_locks_retention_period='', s3_unverified_lookup=False, s3_versioning=False, select_for_live_monitoring=False, share='', share_acl=Bunch(acl=[], enabled=False), sync='SYNCED', sync_time='2024-05-28T13:00:09.039237Z', tenant_id=1, tenant_name='default', title='/manila/manila-ee46a1d1-f743-461e-8bb5-467ee0e99edd', url='https://127.0.0.1:40443/api/views/39/')] May 28 13:00:14 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-fb4afaea-b258-496e-8343-96602644b4fd tempest-ShareRulesTest-1530341375 None] --- [GET] https://127.0.0.1:40443/api/views/: Done May 28 13:00:14 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-fb4afaea-b258-496e-8343-96602644b4fd tempest-ShareRulesTest-1530341375 None] >>> [DELETE] https://127.0.0.1:40443/api/views/39/ May 28 13:00:14 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-b2b04547-f0b3-4bf9-a257-a4c2a7e7a729 tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Committed reservations ['9a4f4204-08fc-4cef-8b9d-694792ed1fb4', 'd994d899-7ce5-4167-bf0d-e19362be466c', '52f5c273-29d3-4e09-a664-7ca3a32c6c24', '6c09a418-9bd2-47fa-b6ec-2129eb4714bc'] {{(pid=98474) commit /opt/stack/manila/manila/quota.py:1063}} May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-d8e79332-fd8e-4738-9891-ade8d7fb3cd3 tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] GET http://10.27.203.238/share/v2/cac556dc39a14bbdbdbabfc80672fb1f/shares/03abb6c7-1707-45b3-a692-3b1de0dd1fba May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-d8e79332-fd8e-4738-9891-ade8d7fb3cd3 tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-d8e79332-fd8e-4738-9891-ade8d7fb3cd3 tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-d8e79332-fd8e-4738-9891-ade8d7fb3cd3 tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] http://10.27.203.238/share/v2/cac556dc39a14bbdbdbabfc80672fb1f/shares/03abb6c7-1707-45b3-a692-3b1de0dd1fba returned with HTTP 200 May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 856/1746] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:00:15 2024] GET /share/v2/cac556dc39a14bbdbdbabfc80672fb1f/shares/03abb6c7-1707-45b3-a692-3b1de0dd1fba => generated 1316 bytes in 27 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-4848e092-ae27-4a89-8f80-8f16cc072e45 tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] POST http://10.27.203.238/share/v2/cac556dc39a14bbdbdbabfc80672fb1f/share-transfers May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-4848e092-ae27-4a89-8f80-8f16cc072e45 tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"transfer": {"share_id": "03abb6c7-1707-45b3-a692-3b1de0dd1fba", "name": "tempest-tempest-created-share-transfer-333687257"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.v2.share_transfer [None req-4848e092-ae27-4a89-8f80-8f16cc072e45 tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] Creating new share transfer {'transfer': {'share_id': '03abb6c7-1707-45b3-a692-3b1de0dd1fba', 'name': 'tempest-tempest-created-share-transfer-333687257'}} {{(pid=98329) create /opt/stack/manila/manila/api/v2/share_transfer.py:104}} May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.v2.share_transfer [None req-4848e092-ae27-4a89-8f80-8f16cc072e45 tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] Creating transfer of share 03abb6c7-1707-45b3-a692-3b1de0dd1fba {{(pid=98329) create /opt/stack/manila/manila/api/v2/share_transfer.py:125}} May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.transfer.api [None req-4848e092-ae27-4a89-8f80-8f16cc072e45 tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] Generating transfer record for share 03abb6c7-1707-45b3-a692-3b1de0dd1fba {{(pid=98329) create /opt/stack/manila/manila/transfer/api.py:162}} May 28 13:00:15 l75lg1-v1 dstat.sh[49771]: 28-05 13:00:15| 3 0 96 1 0|5682M 1772M 278M 7893M| 19k 778B| 0 772k| 0 113 |2875 4623 |1.23 1.09 1.02|2.0 1.0 0| 0 0 | 0 2048M| 29 362 0 36 2 May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-4848e092-ae27-4a89-8f80-8f16cc072e45 tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] http://10.27.203.238/share/v2/cac556dc39a14bbdbdbabfc80672fb1f/share-transfers returned with HTTP 202 May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 891/1747] 10.27.203.238 () {66 vars in 1389 bytes} [Tue May 28 13:00:15 2024] POST /share/v2/cac556dc39a14bbdbdbabfc80672fb1f/share-transfers => generated 727 bytes in 93 msecs (HTTP/1.1 202) 6 headers in 237 bytes (1 switches on core 0) May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-5ea31fd3-de44-4614-b79e-93436928e016 tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] GET http://10.27.203.238/share/v1/cac556dc39a14bbdbdbabfc80672fb1f/shares/03abb6c7-1707-45b3-a692-3b1de0dd1fba May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-5ea31fd3-de44-4614-b79e-93436928e016 tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-5ea31fd3-de44-4614-b79e-93436928e016 tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-5ea31fd3-de44-4614-b79e-93436928e016 tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] http://10.27.203.238/share/v1/cac556dc39a14bbdbdbabfc80672fb1f/shares/03abb6c7-1707-45b3-a692-3b1de0dd1fba returned with HTTP 200 May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 857/1748] 10.27.203.238 () {62 vars in 1408 bytes} [Tue May 28 13:00:15 2024] GET /share/v1/cac556dc39a14bbdbdbabfc80672fb1f/shares/03abb6c7-1707-45b3-a692-3b1de0dd1fba => generated 905 bytes in 25 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-b48de64f-4df6-4921-97ff-6940e50e4f4b tempest-ShareTransferNegativeTest-1518106491 tempest-ShareTransferNegativeTest-1518106491-project-member] DELETE http://10.27.203.238/share/v2/c7a348e5c74641978595dc43c2dcb08a/share-transfers/e059714f-4bf6-4b3e-a104-788680ee28f7 May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-b48de64f-4df6-4921-97ff-6940e50e4f4b tempest-ShareTransferNegativeTest-1518106491 tempest-ShareTransferNegativeTest-1518106491-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-b48de64f-4df6-4921-97ff-6940e50e4f4b tempest-ShareTransferNegativeTest-1518106491 tempest-ShareTransferNegativeTest-1518106491-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.v2.share_transfer [None req-b48de64f-4df6-4921-97ff-6940e50e4f4b tempest-ShareTransferNegativeTest-1518106491 tempest-ShareTransferNegativeTest-1518106491-project-member] Delete transfer with id: e059714f-4bf6-4b3e-a104-788680ee28f7 {{(pid=98329) delete /opt/stack/manila/manila/api/v2/share_transfer.py:193}} May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault [None req-b48de64f-4df6-4921-97ff-6940e50e4f4b tempest-ShareTransferNegativeTest-1518106491 tempest-ShareTransferNegativeTest-1518106491-project-member] Caught error: Transfer e059714f-4bf6-4b3e-a104-788680ee28f7 could not be found.: manila.exception.TransferNotFound: Transfer e059714f-4bf6-4b3e-a104-788680ee28f7 could not be found. May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault Traceback (most recent call last): May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/api/middleware/fault.py", line 76, in __call__ May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault return req.get_response(self.application) May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/request.py", line 1313, in send May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault status, headers, app_iter = self.call_application( May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/request.py", line 1278, in call_application May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault app_iter = application(self.environ, start_response) May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 129, in __call__ May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault resp = self.call_func(req, *args, **kw) May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 193, in call_func May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault return self.func(req, *args, **kwargs) May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_middleware/base.py", line 124, in __call__ May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault response = req.get_response(self.application) May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/request.py", line 1313, in send May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault status, headers, app_iter = self.call_application( May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/request.py", line 1278, in call_application May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault app_iter = application(self.environ, start_response) May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 143, in __call__ May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault return resp(environ, start_response) May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 129, in __call__ May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault resp = self.call_func(req, *args, **kw) May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 193, in call_func May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault return self.func(req, *args, **kwargs) May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/osprofiler/web.py", line 111, in __call__ May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault return request.get_response(self.application) May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/request.py", line 1313, in send May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault status, headers, app_iter = self.call_application( May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/request.py", line 1278, in call_application May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault app_iter = application(self.environ, start_response) May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 129, in __call__ May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault resp = self.call_func(req, *args, **kw) May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 193, in call_func May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault return self.func(req, *args, **kwargs) May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py", line 340, in __call__ May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault response = req.get_response(self._app) May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/request.py", line 1313, in send May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault status, headers, app_iter = self.call_application( May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/request.py", line 1278, in call_application May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault app_iter = application(self.environ, start_response) May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 143, in __call__ May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault return resp(environ, start_response) May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 143, in __call__ May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault return resp(environ, start_response) May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/routes/middleware.py", line 153, in __call__ May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault response = self.app(environ, start_response) May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 143, in __call__ May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault return resp(environ, start_response) May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 129, in __call__ May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault resp = self.call_func(req, *args, **kw) May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 193, in call_func May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault return self.func(req, *args, **kwargs) May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/api/openstack/wsgi.py", line 764, in __call__ May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault return self._process_stack(request, action, action_args, May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/api/openstack/wsgi.py", line 829, in _process_stack May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault action_result = self.dispatch(meth, request, action_args) May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/api/openstack/wsgi.py", line 924, in dispatch May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault return method(req=request, **action_args) May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/api/openstack/wsgi.py", line 1066, in version_select May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault return func.func(self, *args, **kwargs) May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/api/openstack/wsgi.py", line 1160, in wrapper May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault return f(self, req, *args, **kwargs) May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/api/v2/share_transfer.py", line 196, in delete May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault self.transfer_api.delete(context, transfer_id=id) May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/transfer/api.py", line 74, in delete May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault transfer = self.db.transfer_get(context, transfer_id) May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/db/api.py", line 507, in transfer_get May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault return IMPL.transfer_get(context, transfer_id) May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/enginefacade.py", line 998, in wrapper May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault return fn(*args, **kwargs) May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/db/sqlalchemy/api.py", line 2677, in transfer_get May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault return _transfer_get(context, transfer_id, read_deleted=read_deleted) May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/db/sqlalchemy/api.py", line 2670, in _transfer_get May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault raise exception.TransferNotFound(transfer_id=transfer_id) May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault manila.exception.TransferNotFound: Transfer e059714f-4bf6-4b3e-a104-788680ee28f7 could not be found. May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.middleware.fault [None req-b48de64f-4df6-4921-97ff-6940e50e4f4b tempest-ShareTransferNegativeTest-1518106491 tempest-ShareTransferNegativeTest-1518106491-project-member] http://10.27.203.238/share/v2/c7a348e5c74641978595dc43c2dcb08a/share-transfers/e059714f-4bf6-4b3e-a104-788680ee28f7 returned with HTTP 404 May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 892/1749] 10.27.203.238 () {64 vars in 1481 bytes} [Tue May 28 13:00:15 2024] DELETE /share/v2/c7a348e5c74641978595dc43c2dcb08a/share-transfers/e059714f-4bf6-4b3e-a104-788680ee28f7 => generated 129 bytes in 13 msecs (HTTP/1.1 404) 6 headers in 238 bytes (1 switches on core 0) May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-f7eeb5a5-d521-4917-b4bd-c85ece79398f tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] DELETE http://10.27.203.238/share/v2/cac556dc39a14bbdbdbabfc80672fb1f/share-transfers/e059714f-4bf6-4b3e-a104-788680ee28f7 May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-f7eeb5a5-d521-4917-b4bd-c85ece79398f tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-f7eeb5a5-d521-4917-b4bd-c85ece79398f tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.v2.share_transfer [None req-f7eeb5a5-d521-4917-b4bd-c85ece79398f tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] Delete transfer with id: e059714f-4bf6-4b3e-a104-788680ee28f7 {{(pid=98330) delete /opt/stack/manila/manila/api/v2/share_transfer.py:193}} May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-49ca5c81-ecfc-49e4-ba9b-e4f4c06c4b10 tempest-UserMessageNegativeTest-781603078 tempest-UserMessageNegativeTest-781603078-project-member] GET http://10.27.203.238/share/v2/ca9b4c5f200844bdbcc6db13e907f21e/messages May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-49ca5c81-ecfc-49e4-ba9b-e4f4c06c4b10 tempest-UserMessageNegativeTest-781603078 tempest-UserMessageNegativeTest-781603078-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-49ca5c81-ecfc-49e4-ba9b-e4f4c06c4b10 tempest-UserMessageNegativeTest-781603078 tempest-UserMessageNegativeTest-781603078-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.message.api [None req-49ca5c81-ecfc-49e4-ba9b-e4f4c06c4b10 tempest-UserMessageNegativeTest-781603078 tempest-UserMessageNegativeTest-781603078-project-member] Searching for messages by: MultiDict([]) {{(pid=98329) get_all /opt/stack/manila/manila/message/api.py:78}} May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-49ca5c81-ecfc-49e4-ba9b-e4f4c06c4b10 tempest-UserMessageNegativeTest-781603078 tempest-UserMessageNegativeTest-781603078-project-member] http://10.27.203.238/share/v2/ca9b4c5f200844bdbcc6db13e907f21e/messages returned with HTTP 200 May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 893/1750] 10.27.203.238 () {64 vars in 1346 bytes} [Tue May 28 13:00:15 2024] GET /share/v2/ca9b4c5f200844bdbcc6db13e907f21e/messages => generated 815 bytes in 12 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.transfer.api [None req-f7eeb5a5-d521-4917-b4bd-c85ece79398f tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] Transfer e059714f-4bf6-4b3e-a104-788680ee28f7 has been deleted successful. May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-f7eeb5a5-d521-4917-b4bd-c85ece79398f tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] http://10.27.203.238/share/v2/cac556dc39a14bbdbdbabfc80672fb1f/share-transfers/e059714f-4bf6-4b3e-a104-788680ee28f7 returned with HTTP 200 May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 858/1751] 10.27.203.238 () {64 vars in 1481 bytes} [Tue May 28 13:00:15 2024] DELETE /share/v2/cac556dc39a14bbdbdbabfc80672fb1f/share-transfers/e059714f-4bf6-4b3e-a104-788680ee28f7 => generated 0 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 237 bytes (1 switches on core 0) May 28 13:00:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede735dc-3624-4f5b-ab9f-b1a934f1cb2a tempest-ShareIpRulesForNFSNegativeTest-700172924 tempest-ShareIpRulesForNFSNegativeTest-700172924-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-ede735dc-3624-4f5b-ab9f-b1a934f1cb2a tempest-ShareIpRulesForNFSNegativeTest-700172924 tempest-ShareIpRulesForNFSNegativeTest-700172924-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-ea1e6f33-1af4-4246-a037-afd3f85eda18 tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] GET http://10.27.203.238/share/v1/cac556dc39a14bbdbdbabfc80672fb1f/shares/03abb6c7-1707-45b3-a692-3b1de0dd1fba May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-ea1e6f33-1af4-4246-a037-afd3f85eda18 tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-ea1e6f33-1af4-4246-a037-afd3f85eda18 tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-ea1e6f33-1af4-4246-a037-afd3f85eda18 tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] http://10.27.203.238/share/v1/cac556dc39a14bbdbdbabfc80672fb1f/shares/03abb6c7-1707-45b3-a692-3b1de0dd1fba returned with HTTP 200 May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 859/1752] 10.27.203.238 () {62 vars in 1408 bytes} [Tue May 28 13:00:15 2024] GET /share/v1/cac556dc39a14bbdbdbabfc80672fb1f/shares/03abb6c7-1707-45b3-a692-3b1de0dd1fba => generated 962 bytes in 25 msecs (HTTP/1.1 200) 6 headers in 230 bytes (2 switches on core 0) May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-527c112a-17b7-409e-8ffe-cde12b3e0356 tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] GET http://10.27.203.238/share/v2/cac556dc39a14bbdbdbabfc80672fb1f/share-transfers/b4f02603-16fd-42ec-901a-2a19b954c754 May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-527c112a-17b7-409e-8ffe-cde12b3e0356 tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-527c112a-17b7-409e-8ffe-cde12b3e0356 tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault [None req-527c112a-17b7-409e-8ffe-cde12b3e0356 tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] Caught error: Transfer b4f02603-16fd-42ec-901a-2a19b954c754 could not be found.: manila.exception.TransferNotFound: Transfer b4f02603-16fd-42ec-901a-2a19b954c754 could not be found. May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault Traceback (most recent call last): May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/api/middleware/fault.py", line 76, in __call__ May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return req.get_response(self.application) May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/request.py", line 1313, in send May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault status, headers, app_iter = self.call_application( May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/request.py", line 1278, in call_application May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault app_iter = application(self.environ, start_response) May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 129, in __call__ May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault resp = self.call_func(req, *args, **kw) May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 193, in call_func May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return self.func(req, *args, **kwargs) May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_middleware/base.py", line 124, in __call__ May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault response = req.get_response(self.application) May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/request.py", line 1313, in send May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault status, headers, app_iter = self.call_application( May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/request.py", line 1278, in call_application May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault app_iter = application(self.environ, start_response) May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 143, in __call__ May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return resp(environ, start_response) May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 129, in __call__ May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault resp = self.call_func(req, *args, **kw) May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 193, in call_func May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return self.func(req, *args, **kwargs) May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/osprofiler/web.py", line 111, in __call__ May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return request.get_response(self.application) May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/request.py", line 1313, in send May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault status, headers, app_iter = self.call_application( May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/request.py", line 1278, in call_application May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault app_iter = application(self.environ, start_response) May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 129, in __call__ May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault resp = self.call_func(req, *args, **kw) May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 193, in call_func May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return self.func(req, *args, **kwargs) May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py", line 340, in __call__ May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault response = req.get_response(self._app) May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/request.py", line 1313, in send May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault status, headers, app_iter = self.call_application( May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/request.py", line 1278, in call_application May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault app_iter = application(self.environ, start_response) May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 143, in __call__ May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return resp(environ, start_response) May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 143, in __call__ May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return resp(environ, start_response) May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/routes/middleware.py", line 153, in __call__ May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault response = self.app(environ, start_response) May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 143, in __call__ May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return resp(environ, start_response) May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 129, in __call__ May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault resp = self.call_func(req, *args, **kw) May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 193, in call_func May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return self.func(req, *args, **kwargs) May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/api/openstack/wsgi.py", line 764, in __call__ May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return self._process_stack(request, action, action_args, May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/api/openstack/wsgi.py", line 829, in _process_stack May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault action_result = self.dispatch(meth, request, action_args) May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/api/openstack/wsgi.py", line 924, in dispatch May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return method(req=request, **action_args) May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/api/openstack/wsgi.py", line 1066, in version_select May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return func.func(self, *args, **kwargs) May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/api/v2/share_transfer.py", line 54, in show May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault transfer = self.transfer_api.get(context, transfer_id=id) May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/transfer/api.py", line 69, in get May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault transfer = self.db.transfer_get(context, transfer_id) May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/db/api.py", line 507, in transfer_get May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return IMPL.transfer_get(context, transfer_id) May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/enginefacade.py", line 998, in wrapper May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return fn(*args, **kwargs) May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/db/sqlalchemy/api.py", line 2677, in transfer_get May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return _transfer_get(context, transfer_id, read_deleted=read_deleted) May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/db/sqlalchemy/api.py", line 2670, in _transfer_get May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault raise exception.TransferNotFound(transfer_id=transfer_id) May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault manila.exception.TransferNotFound: Transfer b4f02603-16fd-42ec-901a-2a19b954c754 could not be found. May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.middleware.fault [None req-527c112a-17b7-409e-8ffe-cde12b3e0356 tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] http://10.27.203.238/share/v2/cac556dc39a14bbdbdbabfc80672fb1f/share-transfers/b4f02603-16fd-42ec-901a-2a19b954c754 returned with HTTP 404 May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 860/1753] 10.27.203.238 () {64 vars in 1478 bytes} [Tue May 28 13:00:15 2024] GET /share/v2/cac556dc39a14bbdbdbabfc80672fb1f/share-transfers/b4f02603-16fd-42ec-901a-2a19b954c754 => generated 129 bytes in 10 msecs (HTTP/1.1 404) 6 headers in 238 bytes (1 switches on core 0) May 28 13:00:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede735dc-3624-4f5b-ab9f-b1a934f1cb2a tempest-ShareIpRulesForNFSNegativeTest-700172924 tempest-ShareIpRulesForNFSNegativeTest-700172924-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-e4e7a7cf-517f-4d42-8ae9-b8bec829b48a tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] POST http://10.27.203.238/share/v2/cac556dc39a14bbdbdbabfc80672fb1f/shares May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-e4e7a7cf-517f-4d42-8ae9-b8bec829b48a tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share": {"share_proto": "nfs", "description": "Tempest's share", "snapshot_id": null, "name": "tempest-tempest-share-name-886454444", "size": 1, "metadata": {}, "is_public": false, "share_type": "7d4af55a-ed87-4690-a9e6-1a8ea4a42df2"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.v1.shares [None req-e4e7a7cf-517f-4d42-8ae9-b8bec829b48a tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] Create NFS share of 1 GB May 28 13:00:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407daaf2-18c9-4e23-aff2-17ddb88ea0ab service manila] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f110cf6300f049c897d0aab63218d1e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407daaf2-18c9-4e23-aff2-17ddb88ea0ab service manila] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407daaf2-18c9-4e23-aff2-17ddb88ea0ab service manila] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407daaf2-18c9-4e23-aff2-17ddb88ea0ab service manila] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-407daaf2-18c9-4e23-aff2-17ddb88ea0ab service manila] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.quota [None req-e4e7a7cf-517f-4d42-8ae9-b8bec829b48a tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] Created reservations ['f2dfcbaf-3523-46d8-97e3-8db946d46b6d', 'dcba8bf5-d398-4428-8b06-30663dfa5a72', 'b0b463bb-7902-45b7-a014-75778dee79d9', 'f862f6bb-5566-434c-876d-4dc4009364bd'] {{(pid=98330) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 13:00:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407daaf2-18c9-4e23-aff2-17ddb88ea0ab service manila] RBAC: Authorizing `identity:validate_token()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407daaf2-18c9-4e23-aff2-17ddb88ea0ab service manila] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:15 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1367/2762] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 13:00:15 2024] GET /identity/v3/auth/tokens => generated 3956 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-d1a52cf1-2849-4c35-bfa2-9e943210d4d4 tempest-UserMessageNegativeTest-1434999480 tempest-UserMessageNegativeTest-1434999480-project-member] DELETE http://10.27.203.238/share/v2/59c1579619b6422fa4c591102b473b67/messages/1eb082ca-c55b-445b-8c9f-63bddf942988 May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-d1a52cf1-2849-4c35-bfa2-9e943210d4d4 tempest-UserMessageNegativeTest-1434999480 tempest-UserMessageNegativeTest-1434999480-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-d1a52cf1-2849-4c35-bfa2-9e943210d4d4 tempest-UserMessageNegativeTest-1434999480 tempest-UserMessageNegativeTest-1434999480-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-d1a52cf1-2849-4c35-bfa2-9e943210d4d4 tempest-UserMessageNegativeTest-1434999480 tempest-UserMessageNegativeTest-1434999480-project-member] HTTP exception thrown: Message 1eb082ca-c55b-445b-8c9f-63bddf942988 could not be found. May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-d1a52cf1-2849-4c35-bfa2-9e943210d4d4 tempest-UserMessageNegativeTest-1434999480 tempest-UserMessageNegativeTest-1434999480-project-member] http://10.27.203.238/share/v2/59c1579619b6422fa4c591102b473b67/messages/1eb082ca-c55b-445b-8c9f-63bddf942988 returned with HTTP 404 May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 894/1754] 10.27.203.238 () {64 vars in 1460 bytes} [Tue May 28 13:00:15 2024] DELETE /share/v2/59c1579619b6422fa4c591102b473b67/messages/1eb082ca-c55b-445b-8c9f-63bddf942988 => generated 110 bytes in 149 msecs (HTTP/1.1 404) 6 headers in 238 bytes (1 switches on core 0) May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-a9797a90-1232-4763-915a-b730ee21d2b1 tempest-UserMessageNegativeTest-781603078 tempest-UserMessageNegativeTest-781603078-project-member] DELETE http://10.27.203.238/share/v2/ca9b4c5f200844bdbcc6db13e907f21e/shares/196fd448-d12b-4a72-b5dc-1b2a6ccc0416 May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-a9797a90-1232-4763-915a-b730ee21d2b1 tempest-UserMessageNegativeTest-781603078 tempest-UserMessageNegativeTest-781603078-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-a9797a90-1232-4763-915a-b730ee21d2b1 tempest-UserMessageNegativeTest-781603078 tempest-UserMessageNegativeTest-781603078-project-member] Calling method 'ShareMixin.delete' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.v1.shares [None req-a9797a90-1232-4763-915a-b730ee21d2b1 tempest-UserMessageNegativeTest-781603078 tempest-UserMessageNegativeTest-781603078-project-member] Delete share with id: 196fd448-d12b-4a72-b5dc-1b2a6ccc0416 May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.quota [None req-e4e7a7cf-517f-4d42-8ae9-b8bec829b48a tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] Committed reservations ['f2dfcbaf-3523-46d8-97e3-8db946d46b6d', 'dcba8bf5-d398-4428-8b06-30663dfa5a72', 'b0b463bb-7902-45b7-a014-75778dee79d9', 'f862f6bb-5566-434c-876d-4dc4009364bd'] {{(pid=98330) commit /opt/stack/manila/manila/quota.py:1063}} May 28 13:00:15 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.host_manager [None req-e4e7a7cf-517f-4d42-8ae9-b8bec829b48a tempest-ShareTransferNegativeTest-884271560 None] Share service is down. (host: l75lg1-v1@generic2). May 28 13:00:15 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.host_manager [None req-e4e7a7cf-517f-4d42-8ae9-b8bec829b48a tempest-ShareTransferNegativeTest-884271560 None] Share service is down. (host: l75lg1-v1@generic1). May 28 13:00:15 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-e4e7a7cf-517f-4d42-8ae9-b8bec829b48a tempest-ShareTransferNegativeTest-884271560 None] Starting with 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:80}} May 28 13:00:15 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-e4e7a7cf-517f-4d42-8ae9-b8bec829b48a tempest-ShareTransferNegativeTest-884271560 None] Filter OnlyHostFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:00:15 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-e4e7a7cf-517f-4d42-8ae9-b8bec829b48a tempest-ShareTransferNegativeTest-884271560 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:00:15 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.capacity [None req-e4e7a7cf-517f-4d42-8ae9-b8bec829b48a tempest-ShareTransferNegativeTest-884271560 None] Space information for share creation on host l75lg1-v1@vast#vast (requested / avail): 1/2077 {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/capacity.py:83}} May 28 13:00:15 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-e4e7a7cf-517f-4d42-8ae9-b8bec829b48a tempest-ShareTransferNegativeTest-884271560 None] Filter CapacityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:00:15 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-e4e7a7cf-517f-4d42-8ae9-b8bec829b48a tempest-ShareTransferNegativeTest-884271560 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:00:15 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-e4e7a7cf-517f-4d42-8ae9-b8bec829b48a tempest-ShareTransferNegativeTest-884271560 None] Driver Filter: Checking host 'l75lg1-v1@vast#vast' {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:37}} May 28 13:00:15 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-e4e7a7cf-517f-4d42-8ae9-b8bec829b48a tempest-ShareTransferNegativeTest-884271560 None] Filter function not set :: passing host. {{(pid=98327) _check_filter_function /opt/stack/manila/manila/scheduler/filters/driver.py:53}} May 28 13:00:15 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-e4e7a7cf-517f-4d42-8ae9-b8bec829b48a tempest-ShareTransferNegativeTest-884271560 None] Result: True {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:40}} May 28 13:00:15 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-e4e7a7cf-517f-4d42-8ae9-b8bec829b48a tempest-ShareTransferNegativeTest-884271560 None] Done checking host 'l75lg1-v1@vast#vast' {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:41}} May 28 13:00:15 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-e4e7a7cf-517f-4d42-8ae9-b8bec829b48a tempest-ShareTransferNegativeTest-884271560 None] Filter DriverFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:00:15 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-e4e7a7cf-517f-4d42-8ae9-b8bec829b48a tempest-ShareTransferNegativeTest-884271560 None] Filter ShareReplicationFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:00:15 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-e4e7a7cf-517f-4d42-8ae9-b8bec829b48a tempest-ShareTransferNegativeTest-884271560 None] Filter CreateFromSnapshotFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:00:15 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-e4e7a7cf-517f-4d42-8ae9-b8bec829b48a tempest-ShareTransferNegativeTest-884271560 None] Filter AffinityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:00:15 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-e4e7a7cf-517f-4d42-8ae9-b8bec829b48a tempest-ShareTransferNegativeTest-884271560 None] Filter AntiAffinityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:00:15 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.drivers.filter [None req-e4e7a7cf-517f-4d42-8ae9-b8bec829b48a tempest-ShareTransferNegativeTest-884271560 None] Filtered share [host: 'l75lg1-v1@vast#vast', free_capacity_gb: 2077.6478263456374, pools: None] {{(pid=98327) _schedule_share /opt/stack/manila/manila/scheduler/drivers/filter.py:268}} May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-e4e7a7cf-517f-4d42-8ae9-b8bec829b48a tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] http://10.27.203.238/share/v2/cac556dc39a14bbdbdbabfc80672fb1f/shares returned with HTTP 200 May 28 13:00:15 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-e4e7a7cf-517f-4d42-8ae9-b8bec829b48a tempest-ShareTransferNegativeTest-884271560 None] Checking host 'l75lg1-v1@vast#vast' {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:46}} May 28 13:00:15 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.weighers.goodness [None req-e4e7a7cf-517f-4d42-8ae9-b8bec829b48a tempest-ShareTransferNegativeTest-884271560 None] Goodness function not set :: defaulting to minimal goodness rating of 0. May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 861/1755] 10.27.203.238 () {66 vars in 1362 bytes} [Tue May 28 13:00:15 2024] POST /share/v2/cac556dc39a14bbdbdbabfc80672fb1f/shares => generated 1310 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 232 bytes (2 switches on core 0) May 28 13:00:15 l75lg1-v1 manila-scheduler[98327]: INFO manila.scheduler.weighers.goodness [None req-e4e7a7cf-517f-4d42-8ae9-b8bec829b48a tempest-ShareTransferNegativeTest-884271560 None] Goodness function result for host l75lg1-v1@vast#vast: 0. May 28 13:00:15 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-e4e7a7cf-517f-4d42-8ae9-b8bec829b48a tempest-ShareTransferNegativeTest-884271560 None] Goodness: 0 {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:48}} May 28 13:00:15 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-e4e7a7cf-517f-4d42-8ae9-b8bec829b48a tempest-ShareTransferNegativeTest-884271560 None] Done checking host 'l75lg1-v1@vast#vast' {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:49}} May 28 13:00:15 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.drivers.filter [None req-e4e7a7cf-517f-4d42-8ae9-b8bec829b48a tempest-ShareTransferNegativeTest-884271560 None] Choosing for share: WeighedHost [host: l75lg1-v1@vast#vast, weight: 0.0] {{(pid=98327) _schedule_share /opt/stack/manila/manila/scheduler/drivers/filter.py:274}} May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-618da7ee-ffd0-41ea-bf1f-92b264a796e7 tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] GET http://10.27.203.238/share/v2/cac556dc39a14bbdbdbabfc80672fb1f/shares/a6923a53-b5dd-4f5b-803b-5f00144de747 May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-618da7ee-ffd0-41ea-bf1f-92b264a796e7 tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-618da7ee-ffd0-41ea-bf1f-92b264a796e7 tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-618da7ee-ffd0-41ea-bf1f-92b264a796e7 tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] http://10.27.203.238/share/v2/cac556dc39a14bbdbdbabfc80672fb1f/shares/a6923a53-b5dd-4f5b-803b-5f00144de747 returned with HTTP 200 May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 862/1756] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:00:15 2024] GET /share/v2/cac556dc39a14bbdbdbabfc80672fb1f/shares/a6923a53-b5dd-4f5b-803b-5f00144de747 => generated 1310 bytes in 26 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:00:15 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e4e7a7cf-517f-4d42-8ae9-b8bec829b48a tempest-ShareTransferNegativeTest-884271560 None] >>> [GET] https://127.0.0.1:40443/api/vippools/ May 28 13:00:15 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e4e7a7cf-517f-4d42-8ae9-b8bec829b48a tempest-ShareTransferNegativeTest-884271560 None] {'allow_redirects': True, 'params': {'name': 'vippool-1'}} May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.quota [None req-a9797a90-1232-4763-915a-b730ee21d2b1 tempest-UserMessageNegativeTest-781603078 tempest-UserMessageNegativeTest-781603078-project-member] Created reservations ['08705dd8-583d-4783-8a1d-ea3b62ecd919', 'a18a47e5-707c-4c95-952d-db00ac3165e8', '972b3e36-2c99-4fd0-b66b-fb13dcafb182', '77187f32-9533-473b-8f9e-7d880afb0bea'] {{(pid=98329) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.quota [None req-a9797a90-1232-4763-915a-b730ee21d2b1 tempest-UserMessageNegativeTest-781603078 tempest-UserMessageNegativeTest-781603078-project-member] Committed reservations ['08705dd8-583d-4783-8a1d-ea3b62ecd919', 'a18a47e5-707c-4c95-952d-db00ac3165e8', '972b3e36-2c99-4fd0-b66b-fb13dcafb182', '77187f32-9533-473b-8f9e-7d880afb0bea'] {{(pid=98329) commit /opt/stack/manila/manila/quota.py:1063}} May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-a9797a90-1232-4763-915a-b730ee21d2b1 tempest-UserMessageNegativeTest-781603078 tempest-UserMessageNegativeTest-781603078-project-member] http://10.27.203.238/share/v2/ca9b4c5f200844bdbcc6db13e907f21e/shares/196fd448-d12b-4a72-b5dc-1b2a6ccc0416 returned with HTTP 202 May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 895/1757] 10.27.203.238 () {64 vars in 1454 bytes} [Tue May 28 13:00:15 2024] DELETE /share/v2/ca9b4c5f200844bdbcc6db13e907f21e/shares/196fd448-d12b-4a72-b5dc-1b2a6ccc0416 => generated 0 bytes in 231 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-4c7d2f33-9d75-436b-b884-3335d19a1fbd tempest-UserMessageNegativeTest-278135351 tempest-UserMessageNegativeTest-278135351-project-admin] POST http://10.27.203.238/share/v2/7942989ad1ef4db2b2e923f7316c8511/types May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-4c7d2f33-9d75-436b-b884-3335d19a1fbd tempest-UserMessageNegativeTest-278135351 tempest-UserMessageNegativeTest-278135351-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share_type": {"name": "tempest-share-type-1396966182", "extra_specs": {"driver_handles_share_servers": false, "vendor_name": "foobar"}, "share_type_access:is_public": true}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-4c7d2f33-9d75-436b-b884-3335d19a1fbd tempest-UserMessageNegativeTest-278135351 tempest-UserMessageNegativeTest-278135351-project-admin] http://10.27.203.238/share/v2/7942989ad1ef4db2b2e923f7316c8511/types returned with HTTP 200 May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 863/1758] 10.27.203.238 () {66 vars in 1359 bytes} [Tue May 28 13:00:15 2024] POST /share/v2/7942989ad1ef4db2b2e923f7316c8511/types => generated 661 bytes in 24 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-0cbe7f0c-4db1-4168-b3b8-f87e117e04ce tempest-UserMessageNegativeTest-781603078 tempest-UserMessageNegativeTest-781603078-project-member] POST http://10.27.203.238/share/v2/ca9b4c5f200844bdbcc6db13e907f21e/shares May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-0cbe7f0c-4db1-4168-b3b8-f87e117e04ce tempest-UserMessageNegativeTest-781603078 tempest-UserMessageNegativeTest-781603078-project-member] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share": {"share_proto": "nfs", "description": "tempest-tempest-created-share-desc-245688081", "snapshot_id": null, "name": "tempest-tempest-created-share-1776499901", "size": 1, "metadata": {}, "is_public": false, "share_type": "2c88293c-c1cf-4f32-b55e-f32ed6d44103"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.v1.shares [None req-0cbe7f0c-4db1-4168-b3b8-f87e117e04ce tempest-UserMessageNegativeTest-781603078 tempest-UserMessageNegativeTest-781603078-project-member] Create NFS share of 1 GB May 28 13:00:15 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.quota [None req-0cbe7f0c-4db1-4168-b3b8-f87e117e04ce tempest-UserMessageNegativeTest-781603078 tempest-UserMessageNegativeTest-781603078-project-member] Created reservations ['c65ae8cc-6030-4527-a31b-b186b6e40ea4', '15ea0388-29e5-492a-90f2-2c6a28de28a9', '18f1d526-d4f7-4952-883e-5a95bd92950e', '9bb16ed4-af74-4f99-b990-161f5f829099'] {{(pid=98329) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 13:00:16 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e4e7a7cf-517f-4d42-8ae9-b8bec829b48a tempest-ShareTransferNegativeTest-884271560 None] <<< [GET] https://127.0.0.1:40443/api/vippools/ May 28 13:00:16 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e4e7a7cf-517f-4d42-8ae9-b8bec829b48a tempest-ShareTransferNegativeTest-884271560 None] [Bunch(active_cnode_ids=[], active_interfaces=4, cluster='loop75-kfs', cluster_id=1, cnode_ids=[], cnodes=[], domain_name='vippool-1', enable_l3=False, enable_weighted_balancing=False, enabled=True, end_ip='172.21.75.4', guid='f2abaede-b397-413a-8faa-3aeead6d3b28', gw_ip='', gw_ipv6='', id=2, ip_ranges=[['172.21.75.1', '172.21.75.4']], name='vippool-1', peer_asn=0, port_membership='ALL', ranges_summary='172.21.75.[1-4]', role='PROTOCOLS', start_ip='172.21.75.1', subnet_cidr=16, subnet_cidr_ipv6=None, sync='SYNCED', sync_time='2024-05-28T12:50:09.644123Z', tenant_id=1, tenant_name='default', title='172.21.75.1 - 172.21.75.4', url='https://127.0.0.1:40443/api/vippools/2/', vast_asn=0, vlan=0, vms_preferred=False)] May 28 13:00:16 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e4e7a7cf-517f-4d42-8ae9-b8bec829b48a tempest-ShareTransferNegativeTest-884271560 None] --- [GET] https://127.0.0.1:40443/api/vippools/: Done May 28 13:00:16 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e4e7a7cf-517f-4d42-8ae9-b8bec829b48a tempest-ShareTransferNegativeTest-884271560 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:00:16 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e4e7a7cf-517f-4d42-8ae9-b8bec829b48a tempest-ShareTransferNegativeTest-884271560 None] {'allow_redirects': True, May 28 13:00:16 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e4e7a7cf-517f-4d42-8ae9-b8bec829b48a tempest-ShareTransferNegativeTest-884271560 None] 'params': {'name': 'fa81edfd-59ee-49f5-8dbe-094d49593280'}} May 28 13:00:16 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-c4240788-bdd3-43ae-8671-05c54a6206bb tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] GET http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/snapshots/0fba4486-6341-49ab-a9dc-333609ce1d2e May 28 13:00:16 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-c4240788-bdd3-43ae-8671-05c54a6206bb tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:16 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-c4240788-bdd3-43ae-8671-05c54a6206bb tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Calling method 'ShareSnapshotMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:16 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-c4240788-bdd3-43ae-8671-05c54a6206bb tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] HTTP exception thrown: The resource could not be found. May 28 13:00:16 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-c4240788-bdd3-43ae-8671-05c54a6206bb tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/snapshots/0fba4486-6341-49ab-a9dc-333609ce1d2e returned with HTTP 404 May 28 13:00:16 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 864/1759] 10.27.203.238 () {64 vars in 1460 bytes} [Tue May 28 13:00:16 2024] GET /share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/snapshots/0fba4486-6341-49ab-a9dc-333609ce1d2e => generated 78 bytes in 14 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 13:00:16 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-b72126e9-738e-4c6b-b634-2555bee36cc5 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] GET http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/share-replicas/detail?share_id=72db8769-ece7-42ff-af27-2e778292a9b4 May 28 13:00:16 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-b72126e9-738e-4c6b-b634-2555bee36cc5 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:16 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-b72126e9-738e-4c6b-b634-2555bee36cc5 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:16 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-b72126e9-738e-4c6b-b634-2555bee36cc5 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/share-replicas/detail?share_id=72db8769-ece7-42ff-af27-2e778292a9b4 returned with HTTP 200 May 28 13:00:16 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 865/1760] 10.27.203.238 () {64 vars in 1476 bytes} [Tue May 28 13:00:16 2024] GET /share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/share-replicas/detail?share_id=72db8769-ece7-42ff-af27-2e778292a9b4 => generated 22 bytes in 12 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:00:16 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-8607af16-e418-4e23-b92d-484e0ba8ad4b tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] DELETE http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4 May 28 13:00:16 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-8607af16-e418-4e23-b92d-484e0ba8ad4b tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:16 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-8607af16-e418-4e23-b92d-484e0ba8ad4b tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Calling method 'ShareMixin.delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:16 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.v1.shares [None req-8607af16-e418-4e23-b92d-484e0ba8ad4b tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Delete share with id: 72db8769-ece7-42ff-af27-2e778292a9b4 May 28 13:00:16 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.quota [None req-0cbe7f0c-4db1-4168-b3b8-f87e117e04ce tempest-UserMessageNegativeTest-781603078 tempest-UserMessageNegativeTest-781603078-project-member] Committed reservations ['c65ae8cc-6030-4527-a31b-b186b6e40ea4', '15ea0388-29e5-492a-90f2-2c6a28de28a9', '18f1d526-d4f7-4952-883e-5a95bd92950e', '9bb16ed4-af74-4f99-b990-161f5f829099'] {{(pid=98329) commit /opt/stack/manila/manila/quota.py:1063}} May 28 13:00:16 l75lg1-v1 dstat.sh[49771]: 28-05 13:00:16| 14 1 81 3 0|5684M 1770M 278M 7893M| 15k 8454B| 0 2523k| 0 367 |7507 13k|1.23 1.09 1.02|5.0 1.0 0| 0 0 | 0 2048M| 29 363 0 36 2 May 28 13:00:16 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-8607af16-e418-4e23-b92d-484e0ba8ad4b tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4 returned with HTTP 202 May 28 13:00:16 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 866/1761] 10.27.203.238 () {64 vars in 1454 bytes} [Tue May 28 13:00:16 2024] DELETE /share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4 => generated 0 bytes in 130 msecs (HTTP/1.1 202) 6 headers in 243 bytes (2 switches on core 0) May 28 13:00:16 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-d5a5d068-38c3-4818-a93d-705292418a41 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] GET http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4 May 28 13:00:16 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-d5a5d068-38c3-4818-a93d-705292418a41 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:16 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-d5a5d068-38c3-4818-a93d-705292418a41 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:16 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.host_manager [None req-0cbe7f0c-4db1-4168-b3b8-f87e117e04ce tempest-UserMessageNegativeTest-781603078 None] Share service is down. (host: l75lg1-v1@generic2). May 28 13:00:16 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.host_manager [None req-0cbe7f0c-4db1-4168-b3b8-f87e117e04ce tempest-UserMessageNegativeTest-781603078 None] Share service is down. (host: l75lg1-v1@generic1). May 28 13:00:16 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-0cbe7f0c-4db1-4168-b3b8-f87e117e04ce tempest-UserMessageNegativeTest-781603078 None] Starting with 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:80}} May 28 13:00:16 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-0cbe7f0c-4db1-4168-b3b8-f87e117e04ce tempest-UserMessageNegativeTest-781603078 None] Filter OnlyHostFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:00:16 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-0cbe7f0c-4db1-4168-b3b8-f87e117e04ce tempest-UserMessageNegativeTest-781603078 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:00:16 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.capacity [None req-0cbe7f0c-4db1-4168-b3b8-f87e117e04ce tempest-UserMessageNegativeTest-781603078 None] Space information for share creation on host l75lg1-v1@vast#vast (requested / avail): 1/2076 {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/capacity.py:83}} May 28 13:00:16 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-0cbe7f0c-4db1-4168-b3b8-f87e117e04ce tempest-UserMessageNegativeTest-781603078 None] Filter CapacityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:00:16 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.utils [None req-0cbe7f0c-4db1-4168-b3b8-f87e117e04ce tempest-UserMessageNegativeTest-781603078 None] Share type extra spec requirement "vendor_name=foobar" does not match reported capability "VAST STORAGE" {{(pid=98327) capabilities_satisfied /opt/stack/manila/manila/scheduler/utils.py:185}} May 28 13:00:16 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.capabilities [None req-0cbe7f0c-4db1-4168-b3b8-f87e117e04ce tempest-UserMessageNegativeTest-781603078 None] host: 'l75lg1-v1@vast#vast', free_capacity_gb: 2076.6478263456374, pools: None fails resource_type extra_specs requirements {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/capabilities.py:45}} May 28 13:00:16 l75lg1-v1 manila-scheduler[98327]: INFO manila.scheduler.filters.base [None req-0cbe7f0c-4db1-4168-b3b8-f87e117e04ce tempest-UserMessageNegativeTest-781603078 None] Filter CapabilitiesFilter returned 0 host(s) May 28 13:00:16 l75lg1-v1 manila-scheduler[98327]: ERROR manila.scheduler.manager [None req-0cbe7f0c-4db1-4168-b3b8-f87e117e04ce tempest-UserMessageNegativeTest-781603078 None] Failed to schedule create_share: No valid host was found. Failed to find a weighted host, the last executed filter was CapabilitiesFilter.: manila.exception.NoValidHost: No valid host was found. Failed to find a weighted host, the last executed filter was CapabilitiesFilter. May 28 13:00:16 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-0cbe7f0c-4db1-4168-b3b8-f87e117e04ce tempest-UserMessageNegativeTest-781603078 tempest-UserMessageNegativeTest-781603078-project-member] http://10.27.203.238/share/v2/ca9b4c5f200844bdbcc6db13e907f21e/shares returned with HTTP 200 May 28 13:00:16 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 896/1762] 10.27.203.238 () {66 vars in 1362 bytes} [Tue May 28 13:00:15 2024] POST /share/v2/ca9b4c5f200844bdbcc6db13e907f21e/shares => generated 1335 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:00:16 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-b7d36ee9-1c30-4e90-b755-f10992550fdc tempest-UserMessageNegativeTest-781603078 tempest-UserMessageNegativeTest-781603078-project-member] GET http://10.27.203.238/share/v2/ca9b4c5f200844bdbcc6db13e907f21e/shares/e1213560-b32f-45ad-8936-66e8b683bf67 May 28 13:00:16 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-b7d36ee9-1c30-4e90-b755-f10992550fdc tempest-UserMessageNegativeTest-781603078 tempest-UserMessageNegativeTest-781603078-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:16 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-b7d36ee9-1c30-4e90-b755-f10992550fdc tempest-UserMessageNegativeTest-781603078 tempest-UserMessageNegativeTest-781603078-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:16 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-d5a5d068-38c3-4818-a93d-705292418a41 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4 returned with HTTP 200 May 28 13:00:16 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 867/1763] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:00:16 2024] GET /share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4 => generated 1315 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:00:16 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-b7d36ee9-1c30-4e90-b755-f10992550fdc tempest-UserMessageNegativeTest-781603078 tempest-UserMessageNegativeTest-781603078-project-member] http://10.27.203.238/share/v2/ca9b4c5f200844bdbcc6db13e907f21e/shares/e1213560-b32f-45ad-8936-66e8b683bf67 returned with HTTP 200 May 28 13:00:16 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 897/1764] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:00:16 2024] GET /share/v2/ca9b4c5f200844bdbcc6db13e907f21e/shares/e1213560-b32f-45ad-8936-66e8b683bf67 => generated 1335 bytes in 26 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:00:16 l75lg1-v1 manila-scheduler[98327]: INFO manila.message.api [None req-0cbe7f0c-4db1-4168-b3b8-f87e117e04ce tempest-UserMessageNegativeTest-781603078 None] Creating message record for request_id = req-0cbe7f0c-4db1-4168-b3b8-f87e117e04ce May 28 13:00:16 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-8607af16-e418-4e23-b92d-484e0ba8ad4b tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:00:16 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-8607af16-e418-4e23-b92d-484e0ba8ad4b tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:00:16 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-8607af16-e418-4e23-b92d-484e0ba8ad4b tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:00:16 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-8607af16-e418-4e23-b92d-484e0ba8ad4b tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:00:16 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-8607af16-e418-4e23-b92d-484e0ba8ad4b tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:00:16 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-8607af16-e418-4e23-b92d-484e0ba8ad4b tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:00:16 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-8607af16-e418-4e23-b92d-484e0ba8ad4b tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:00:16 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-8607af16-e418-4e23-b92d-484e0ba8ad4b tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:00:16 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-8607af16-e418-4e23-b92d-484e0ba8ad4b tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Lock "locked_access_rules_operation_by_share_instance_7fdd602c-79d0-479c-95a2-336b202c6639" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:00:16 l75lg1-v1 manila-share[98474]: DEBUG manila.share.access [None req-8607af16-e418-4e23-b92d-484e0ba8ad4b tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] All access rules have been synced for share instance 7fdd602c-79d0-479c-95a2-336b202c6639 belonging to share 72db8769-ece7-42ff-af27-2e778292a9b4. {{(pid=98474) update_access_rules /opt/stack/manila/manila/share/access.py:304}} May 28 13:00:16 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-8607af16-e418-4e23-b92d-484e0ba8ad4b tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] deleting '/manila/manila-7fdd602c-79d0-479c-95a2-336b202c6639' May 28 13:00:16 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8607af16-e418-4e23-b92d-484e0ba8ad4b tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] >>> [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/ May 28 13:00:16 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8607af16-e418-4e23-b92d-484e0ba8ad4b tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] {'data': '{"path": "/manila/manila-7fdd602c-79d0-479c-95a2-336b202c6639"}', May 28 13:00:16 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8607af16-e418-4e23-b92d-484e0ba8ad4b tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] 'params': None} May 28 13:00:16 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8607af16-e418-4e23-b92d-484e0ba8ad4b tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] <<< [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/ May 28 13:00:16 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8607af16-e418-4e23-b92d-484e0ba8ad4b tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] 'OK' May 28 13:00:16 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8607af16-e418-4e23-b92d-484e0ba8ad4b tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] --- [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/: Done May 28 13:00:16 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8607af16-e418-4e23-b92d-484e0ba8ad4b tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] >>> [GET] https://127.0.0.1:40443/api/views/ May 28 13:00:16 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8607af16-e418-4e23-b92d-484e0ba8ad4b tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] {'allow_redirects': True, May 28 13:00:16 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8607af16-e418-4e23-b92d-484e0ba8ad4b tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] 'params': {'name': '7fdd602c-79d0-479c-95a2-336b202c6639'}} May 28 13:00:16 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e4e7a7cf-517f-4d42-8ae9-b8bec829b48a tempest-ShareTransferNegativeTest-884271560 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:00:16 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e4e7a7cf-517f-4d42-8ae9-b8bec829b48a tempest-ShareTransferNegativeTest-884271560 None] [] May 28 13:00:16 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e4e7a7cf-517f-4d42-8ae9-b8bec829b48a tempest-ShareTransferNegativeTest-884271560 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 13:00:16 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e4e7a7cf-517f-4d42-8ae9-b8bec829b48a tempest-ShareTransferNegativeTest-884271560 None] >>> [POST] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:00:16 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e4e7a7cf-517f-4d42-8ae9-b8bec829b48a tempest-ShareTransferNegativeTest-884271560 None] {'data': '{"name": "fa81edfd-59ee-49f5-8dbe-094d49593280"}', May 28 13:00:16 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e4e7a7cf-517f-4d42-8ae9-b8bec829b48a tempest-ShareTransferNegativeTest-884271560 None] 'json': None, May 28 13:00:16 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e4e7a7cf-517f-4d42-8ae9-b8bec829b48a tempest-ShareTransferNegativeTest-884271560 None] 'params': None} May 28 13:00:17 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-fb4afaea-b258-496e-8343-96602644b4fd tempest-ShareRulesTest-1530341375 None] <<< [DELETE] https://127.0.0.1:40443/api/views/39/ May 28 13:00:17 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-fb4afaea-b258-496e-8343-96602644b4fd tempest-ShareRulesTest-1530341375 None] --- [DELETE] https://127.0.0.1:40443/api/views/39/: Done May 28 13:00:17 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-fb4afaea-b258-496e-8343-96602644b4fd tempest-ShareRulesTest-1530341375 None] >>> [GET] https://127.0.0.1:40443/api/quotas/ May 28 13:00:17 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-fb4afaea-b258-496e-8343-96602644b4fd tempest-ShareRulesTest-1530341375 None] {'allow_redirects': True, May 28 13:00:17 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-fb4afaea-b258-496e-8343-96602644b4fd tempest-ShareRulesTest-1530341375 None] 'params': {'name': 'ee46a1d1-f743-461e-8bb5-467ee0e99edd'}} May 28 13:00:17 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8607af16-e418-4e23-b92d-484e0ba8ad4b tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] <<< [GET] https://127.0.0.1:40443/api/views/ May 28 13:00:17 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8607af16-e418-4e23-b92d-484e0ba8ad4b tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] [Bunch(abac_tags=[], abe_max_depth=None, abe_protocols=[], alias='', allow_anonymous_access=False, allow_s3_anonymous_access=False, auto_commit='0d', bucket='', bucket_creators=[], bucket_creators_groups=[], bucket_owner=None, bulk_permission_update_progress=None, bulk_permission_update_state=None, cluster='loop75-kfs', cluster_id=1, created='2024-05-28T12:58:46.921819Z', enabled=True, files_retention_mode='NONE', guid='faf90737-2dcb-403b-a84d-fbc18d7ca2ef', id=31, ignore_oos=False, internal=False, is_remote=False, is_seamless=False, logical_capacity=0, max_retention_period='0d', min_retention_period='0d', name='7fdd602c-79d0-479c-95a2-336b202c6639', nfs_interop_flags='BOTH_NFS3_AND_NFS4_INTEROP_DISABLED', path='/manila/manila-7fdd602c-79d0-479c-95a2-336b202c6639', physical_capacity=0, policy='7fdd602c-79d0-479c-95a2-336b202c6639', policy_id=32, protocols=['NFS'], qos_policy=None, qos_policy_id=None, s3_locks=False, s3_locks_retention_mode='NONE', s3_locks_retention_period='', s3_unverified_lookup=False, s3_versioning=False, select_for_live_monitoring=False, share='', share_acl=Bunch(acl=[], enabled=False), sync='SYNCED', sync_time='2024-05-28T13:00:09.039223Z', tenant_id=1, tenant_name='default', title='/manila/manila-7fdd602c-79d0-479c-95a2-336b202c6639', url='https://127.0.0.1:40443/api/views/31/')] May 28 13:00:17 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8607af16-e418-4e23-b92d-484e0ba8ad4b tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] --- [GET] https://127.0.0.1:40443/api/views/: Done May 28 13:00:17 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8607af16-e418-4e23-b92d-484e0ba8ad4b tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] >>> [DELETE] https://127.0.0.1:40443/api/views/31/ May 28 13:00:17 l75lg1-v1 dstat.sh[49771]: 28-05 13:00:17| 4 1 93 2 0|5684M 1770M 278M 7893M| 16k 3566B| 0 5983k| 0 440 |3761 5868 |1.14 1.07 1.02|2.0 0 0| 0 0 | 0 2048M| 29 361 0 36 2 May 28 13:00:17 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e4e7a7cf-517f-4d42-8ae9-b8bec829b48a tempest-ShareTransferNegativeTest-884271560 None] <<< [POST] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:00:17 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e4e7a7cf-517f-4d42-8ae9-b8bec829b48a tempest-ShareTransferNegativeTest-884271560 None] Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=0, created='2024-05-28T13:00:17.005002Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='98bbdab2-de2a-46a7-b4c8-2ff696db8c45', id=43, internal=False, is_s3_default_policy=False, name='fa81edfd-59ee-49f5-8dbe-094d49593280', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=[], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['*'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['*'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T13:00:17.384725Z', tenant_id=1, tenant_name='default', title='fa81edfd-59ee-49f5-8dbe-094d49593280', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/43/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[]) May 28 13:00:17 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e4e7a7cf-517f-4d42-8ae9-b8bec829b48a tempest-ShareTransferNegativeTest-884271560 None] --- [POST] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 13:00:17 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e4e7a7cf-517f-4d42-8ae9-b8bec829b48a tempest-ShareTransferNegativeTest-884271560 None] >>> [GET] https://127.0.0.1:40443/api/quotas/ May 28 13:00:17 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e4e7a7cf-517f-4d42-8ae9-b8bec829b48a tempest-ShareTransferNegativeTest-884271560 None] {'allow_redirects': True, May 28 13:00:17 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e4e7a7cf-517f-4d42-8ae9-b8bec829b48a tempest-ShareTransferNegativeTest-884271560 None] 'params': {'name': 'fa81edfd-59ee-49f5-8dbe-094d49593280'}} May 28 13:00:17 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-fb4afaea-b258-496e-8343-96602644b4fd tempest-ShareRulesTest-1530341375 None] <<< [GET] https://127.0.0.1:40443/api/quotas/ May 28 13:00:17 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-fb4afaea-b258-496e-8343-96602644b4fd tempest-ShareRulesTest-1530341375 None] [Bunch(cluster='loop75-kfs', cluster_id=1, default_email=None, default_group_quota=None, default_user_quota=None, enable_alarms=True, enable_email_providers=True, grace_period=None, guid='749205de-01aa-40c1-8c27-49d8b4bff402', hard_limit=1073741824, hard_limit_inodes=None, id=37, internal=False, is_user_quota=False, last_user_quotas_update=None, name='ee46a1d1-f743-461e-8bb5-467ee0e99edd', num_blocked_users=0, num_exceeded_users=0, path='/manila/manila-ee46a1d1-f743-461e-8bb5-467ee0e99edd', percent_capacity=0, percent_inodes=None, pretty_grace_period=None, pretty_grace_period_expiration=None, pretty_state='OK (Calculating)', soft_limit=None, soft_limit_inodes=None, state='OK', sync_state='Calculating', system_id=37, tenant_id=1, tenant_name='default', time_to_block=None, title='ee46a1d1-f743-461e-8bb5-467ee0e99edd', url='https://127.0.0.1:40443/api/quotas/37/', used_capacity=0, used_capacity_tb=0.0, used_effective_capacity=0, used_effective_capacity_tb=0.0, used_inodes=0, used_limited_capacity=0)] May 28 13:00:17 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-fb4afaea-b258-496e-8343-96602644b4fd tempest-ShareRulesTest-1530341375 None] --- [GET] https://127.0.0.1:40443/api/quotas/: Done May 28 13:00:17 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-fb4afaea-b258-496e-8343-96602644b4fd tempest-ShareRulesTest-1530341375 None] >>> [DELETE] https://127.0.0.1:40443/api/quotas/37/ May 28 13:00:17 l75lg1-v1 neutron-server[77618]: DEBUG dbcounter [-] [77618] Writing DB stats neutron:SELECT=6 {{(pid=77618) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:00:17 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-79422231-6d87-44d5-b662-2f07dfaca47d tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] GET http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/shares/510f7bcd-a0ee-49a6-8093-2640036f2ca3 May 28 13:00:17 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-79422231-6d87-44d5-b662-2f07dfaca47d tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:17 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-79422231-6d87-44d5-b662-2f07dfaca47d tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:17 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-79422231-6d87-44d5-b662-2f07dfaca47d tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/shares/510f7bcd-a0ee-49a6-8093-2640036f2ca3 returned with HTTP 200 May 28 13:00:17 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 868/1765] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:00:17 2024] GET /share/v2/a4f3887fa28c457390f5b66615564430/shares/510f7bcd-a0ee-49a6-8093-2640036f2ca3 => generated 1315 bytes in 24 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:00:18 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e4e7a7cf-517f-4d42-8ae9-b8bec829b48a tempest-ShareTransferNegativeTest-884271560 None] <<< [GET] https://127.0.0.1:40443/api/quotas/ May 28 13:00:18 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e4e7a7cf-517f-4d42-8ae9-b8bec829b48a tempest-ShareTransferNegativeTest-884271560 None] [] May 28 13:00:18 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e4e7a7cf-517f-4d42-8ae9-b8bec829b48a tempest-ShareTransferNegativeTest-884271560 None] --- [GET] https://127.0.0.1:40443/api/quotas/: Done May 28 13:00:18 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e4e7a7cf-517f-4d42-8ae9-b8bec829b48a tempest-ShareTransferNegativeTest-884271560 None] >>> [POST] https://127.0.0.1:40443/api/quotas/ May 28 13:00:18 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e4e7a7cf-517f-4d42-8ae9-b8bec829b48a tempest-ShareTransferNegativeTest-884271560 None] {'data': '{"name": "fa81edfd-59ee-49f5-8dbe-094d49593280", "path": ' May 28 13:00:18 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e4e7a7cf-517f-4d42-8ae9-b8bec829b48a tempest-ShareTransferNegativeTest-884271560 None] '"/manila/manila-fa81edfd-59ee-49f5-8dbe-094d49593280", "create_dir": ' May 28 13:00:18 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e4e7a7cf-517f-4d42-8ae9-b8bec829b48a tempest-ShareTransferNegativeTest-884271560 None] 'true, "hard_limit": 1073741824}', May 28 13:00:18 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e4e7a7cf-517f-4d42-8ae9-b8bec829b48a tempest-ShareTransferNegativeTest-884271560 None] 'json': None, May 28 13:00:18 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e4e7a7cf-517f-4d42-8ae9-b8bec829b48a tempest-ShareTransferNegativeTest-884271560 None] 'params': None} May 28 13:00:18 l75lg1-v1 dstat.sh[49771]: 28-05 13:00:18| 1 0 98 0 0|5685M 1768M 278M 7893M| 19k 2494B| 0 6765k| 0 662 |2084 3160 |1.14 1.07 1.02|1.0 1.0 2.0| 0 0 | 0 2048M| 29 361 0 36 2 May 28 13:00:18 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-f28a1cec-251f-4769-854d-d85c3cf5c317 tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] GET http://10.27.203.238/share/v2/cac556dc39a14bbdbdbabfc80672fb1f/shares/a6923a53-b5dd-4f5b-803b-5f00144de747 May 28 13:00:18 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-f28a1cec-251f-4769-854d-d85c3cf5c317 tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:18 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-f28a1cec-251f-4769-854d-d85c3cf5c317 tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:18 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-f28a1cec-251f-4769-854d-d85c3cf5c317 tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] http://10.27.203.238/share/v2/cac556dc39a14bbdbdbabfc80672fb1f/shares/a6923a53-b5dd-4f5b-803b-5f00144de747 returned with HTTP 200 May 28 13:00:18 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 898/1766] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:00:18 2024] GET /share/v2/cac556dc39a14bbdbdbabfc80672fb1f/shares/a6923a53-b5dd-4f5b-803b-5f00144de747 => generated 1312 bytes in 27 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:00:18 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e4e7a7cf-517f-4d42-8ae9-b8bec829b48a tempest-ShareTransferNegativeTest-884271560 None] <<< [POST] https://127.0.0.1:40443/api/quotas/ May 28 13:00:18 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e4e7a7cf-517f-4d42-8ae9-b8bec829b48a tempest-ShareTransferNegativeTest-884271560 None] Bunch(cluster='loop75-kfs', cluster_id=1, default_email=None, default_group_quota=None, default_user_quota=None, enable_alarms=True, enable_email_providers=True, grace_period=None, group_quotas=[], guid='c00d9075-e49f-41ab-babb-3f8f05469f28', hard_limit=1073741824, hard_limit_inodes=None, id=40, internal=False, is_user_quota=False, last_user_quotas_update=None, name='fa81edfd-59ee-49f5-8dbe-094d49593280', num_blocked_users=0, num_exceeded_users=0, path='/manila/manila-fa81edfd-59ee-49f5-8dbe-094d49593280', percent_capacity=0, percent_inodes=None, pretty_grace_period=None, pretty_grace_period_expiration=None, pretty_state='OK (CREATED)', soft_limit=None, soft_limit_inodes=None, state='OK', sync_state='CREATED', system_id=40, tenant_id=1, tenant_name='default', time_to_block=None, title='fa81edfd-59ee-49f5-8dbe-094d49593280', url='https://127.0.0.1:40443/api/quotas/40/', used_capacity=0, used_capacity_tb=0.0, used_effective_capacity=0, used_effective_capacity_tb=0.0, used_inodes=0, used_limited_capacity=0, user_quotas=[]) May 28 13:00:18 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e4e7a7cf-517f-4d42-8ae9-b8bec829b48a tempest-ShareTransferNegativeTest-884271560 None] --- [POST] https://127.0.0.1:40443/api/quotas/: Done May 28 13:00:18 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e4e7a7cf-517f-4d42-8ae9-b8bec829b48a tempest-ShareTransferNegativeTest-884271560 None] >>> [GET] https://127.0.0.1:40443/api/views/ May 28 13:00:18 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e4e7a7cf-517f-4d42-8ae9-b8bec829b48a tempest-ShareTransferNegativeTest-884271560 None] {'allow_redirects': True, May 28 13:00:18 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e4e7a7cf-517f-4d42-8ae9-b8bec829b48a tempest-ShareTransferNegativeTest-884271560 None] 'params': {'name': 'fa81edfd-59ee-49f5-8dbe-094d49593280'}} May 28 13:00:19 l75lg1-v1 dstat.sh[49771]: 28-05 13:00:19| 1 0 98 1 0|5685M 1768M 278M 7893M| 15k 736B| 0 588k| 0 46.0 |1895 2959 |1.14 1.07 1.02|1.0 0 0| 0 0 | 0 2048M| 29 361 0 36 2 May 28 13:00:19 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8607af16-e418-4e23-b92d-484e0ba8ad4b tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] <<< [DELETE] https://127.0.0.1:40443/api/views/31/ May 28 13:00:19 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8607af16-e418-4e23-b92d-484e0ba8ad4b tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] --- [DELETE] https://127.0.0.1:40443/api/views/31/: Done May 28 13:00:19 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8607af16-e418-4e23-b92d-484e0ba8ad4b tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] >>> [GET] https://127.0.0.1:40443/api/quotas/ May 28 13:00:19 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8607af16-e418-4e23-b92d-484e0ba8ad4b tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] {'allow_redirects': True, May 28 13:00:19 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8607af16-e418-4e23-b92d-484e0ba8ad4b tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] 'params': {'name': '7fdd602c-79d0-479c-95a2-336b202c6639'}} May 28 13:00:19 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-33e4337c-0d88-4317-9267-c8f89b82a8c4 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] GET http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4 May 28 13:00:19 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-33e4337c-0d88-4317-9267-c8f89b82a8c4 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:19 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-33e4337c-0d88-4317-9267-c8f89b82a8c4 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:19 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-8b9230e8-8637-461f-b518-8ddd5b2787b0 tempest-UserMessageNegativeTest-781603078 tempest-UserMessageNegativeTest-781603078-project-member] GET http://10.27.203.238/share/v2/ca9b4c5f200844bdbcc6db13e907f21e/shares/e1213560-b32f-45ad-8936-66e8b683bf67 May 28 13:00:19 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-8b9230e8-8637-461f-b518-8ddd5b2787b0 tempest-UserMessageNegativeTest-781603078 tempest-UserMessageNegativeTest-781603078-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:19 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-8b9230e8-8637-461f-b518-8ddd5b2787b0 tempest-UserMessageNegativeTest-781603078 tempest-UserMessageNegativeTest-781603078-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:19 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-33e4337c-0d88-4317-9267-c8f89b82a8c4 tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4 returned with HTTP 200 May 28 13:00:19 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 869/1767] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:00:19 2024] GET /share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4 => generated 1315 bytes in 28 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:00:19 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-8b9230e8-8637-461f-b518-8ddd5b2787b0 tempest-UserMessageNegativeTest-781603078 tempest-UserMessageNegativeTest-781603078-project-member] http://10.27.203.238/share/v2/ca9b4c5f200844bdbcc6db13e907f21e/shares/e1213560-b32f-45ad-8936-66e8b683bf67 returned with HTTP 200 May 28 13:00:19 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 899/1768] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:00:19 2024] GET /share/v2/ca9b4c5f200844bdbcc6db13e907f21e/shares/e1213560-b32f-45ad-8936-66e8b683bf67 => generated 1332 bytes in 23 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:00:19 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e4e7a7cf-517f-4d42-8ae9-b8bec829b48a tempest-ShareTransferNegativeTest-884271560 None] <<< [GET] https://127.0.0.1:40443/api/views/ May 28 13:00:19 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e4e7a7cf-517f-4d42-8ae9-b8bec829b48a tempest-ShareTransferNegativeTest-884271560 None] [] May 28 13:00:19 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e4e7a7cf-517f-4d42-8ae9-b8bec829b48a tempest-ShareTransferNegativeTest-884271560 None] --- [GET] https://127.0.0.1:40443/api/views/: Done May 28 13:00:19 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e4e7a7cf-517f-4d42-8ae9-b8bec829b48a tempest-ShareTransferNegativeTest-884271560 None] >>> [POST] https://127.0.0.1:40443/api/views/ May 28 13:00:19 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e4e7a7cf-517f-4d42-8ae9-b8bec829b48a tempest-ShareTransferNegativeTest-884271560 None] {'data': '{"name": "fa81edfd-59ee-49f5-8dbe-094d49593280", "path": ' May 28 13:00:19 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e4e7a7cf-517f-4d42-8ae9-b8bec829b48a tempest-ShareTransferNegativeTest-884271560 None] '"/manila/manila-fa81edfd-59ee-49f5-8dbe-094d49593280", "policy_id": ' May 28 13:00:19 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e4e7a7cf-517f-4d42-8ae9-b8bec829b48a tempest-ShareTransferNegativeTest-884271560 None] '43, "create_dir": true, "protocols": ["NFS"]}', May 28 13:00:19 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e4e7a7cf-517f-4d42-8ae9-b8bec829b48a tempest-ShareTransferNegativeTest-884271560 None] 'json': None, May 28 13:00:19 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e4e7a7cf-517f-4d42-8ae9-b8bec829b48a tempest-ShareTransferNegativeTest-884271560 None] 'params': None} May 28 13:00:19 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8607af16-e418-4e23-b92d-484e0ba8ad4b tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] <<< [GET] https://127.0.0.1:40443/api/quotas/ May 28 13:00:19 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8607af16-e418-4e23-b92d-484e0ba8ad4b tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] [Bunch(cluster='loop75-kfs', cluster_id=1, default_email=None, default_group_quota=None, default_user_quota=None, enable_alarms=True, enable_email_providers=True, grace_period=None, guid='0e87f0bf-2eb1-4a2d-b001-3e888e655eb8', hard_limit=1073741824, hard_limit_inodes=None, id=29, internal=False, is_user_quota=False, last_user_quotas_update=None, name='7fdd602c-79d0-479c-95a2-336b202c6639', num_blocked_users=0, num_exceeded_users=0, path='/manila/manila-7fdd602c-79d0-479c-95a2-336b202c6639', percent_capacity=0, percent_inodes=None, pretty_grace_period=None, pretty_grace_period_expiration=None, pretty_state='OK', soft_limit=None, soft_limit_inodes=None, state='OK', sync_state='SYNCHRONIZED', system_id=29, tenant_id=1, tenant_name='default', time_to_block=None, title='7fdd602c-79d0-479c-95a2-336b202c6639', url='https://127.0.0.1:40443/api/quotas/29/', used_capacity=0, used_capacity_tb=0.0, used_effective_capacity=0, used_effective_capacity_tb=0.0, used_inodes=1, used_limited_capacity=0)] May 28 13:00:19 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8607af16-e418-4e23-b92d-484e0ba8ad4b tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] --- [GET] https://127.0.0.1:40443/api/quotas/: Done May 28 13:00:19 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8607af16-e418-4e23-b92d-484e0ba8ad4b tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] >>> [DELETE] https://127.0.0.1:40443/api/quotas/29/ May 28 13:00:19 l75lg1-v1 nova-conductor[83647]: DEBUG dbcounter [-] [83647] Writing DB stats nova_cell1:SELECT=1,nova_cell1:UPDATE=1 {{(pid=83647) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:00:20 l75lg1-v1 nova-conductor[83648]: DEBUG dbcounter [-] [83648] Writing DB stats nova_cell1:SELECT=1 {{(pid=83648) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:00:20 l75lg1-v1 dstat.sh[49771]: 28-05 13:00:20| 1 0 97 1 0|5685M 1768M 278M 7893M| 15k 2264B| 0 552k| 0 63.0 |2302 3736 |1.14 1.07 1.02|1.0 1.0 0| 0 0 | 0 2048M| 29 361 0 36 2 May 28 13:00:20 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e4e7a7cf-517f-4d42-8ae9-b8bec829b48a tempest-ShareTransferNegativeTest-884271560 None] <<< [POST] https://127.0.0.1:40443/api/views/ May 28 13:00:20 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e4e7a7cf-517f-4d42-8ae9-b8bec829b48a tempest-ShareTransferNegativeTest-884271560 None] Bunch(abac_tags=[], abe_max_depth=None, abe_protocols=[], alias='', allow_anonymous_access=False, allow_s3_anonymous_access=False, auto_commit='0d', bucket='', bucket_creators=[], bucket_creators_groups=[], bucket_owner=None, bulk_permission_update_progress=None, bulk_permission_update_state=None, cluster='loop75-kfs', cluster_id=1, created='2024-05-28T13:00:19.991013Z', enabled=True, files_retention_mode='NONE', guid='a9c5658a-6f9b-4728-b702-d080653cc976', id=42, ignore_oos=False, internal=False, is_remote=False, is_seamless=False, logical_capacity=0, max_retention_period=None, min_retention_period=None, name='fa81edfd-59ee-49f5-8dbe-094d49593280', nfs_interop_flags='BOTH_NFS3_AND_NFS4_INTEROP_DISABLED', path='/manila/manila-fa81edfd-59ee-49f5-8dbe-094d49593280', physical_capacity=0, policy='fa81edfd-59ee-49f5-8dbe-094d49593280', policy_id=43, protocols=['NFS'], qos_policy=None, qos_policy_id=None, s3_locks=False, s3_locks_retention_mode='NONE', s3_locks_retention_period='', s3_object_ownership_rule='ObjectWriter', s3_unverified_lookup=False, s3_versioning=False, select_for_live_monitoring=False, share='', share_acl=Bunch(acl=[], enabled=False), sync='SYNCED', sync_time='2024-05-28T13:00:20.255275Z', tenant_id=1, tenant_name='default', title='/manila/manila-fa81edfd-59ee-49f5-8dbe-094d49593280', url='https://127.0.0.1:40443/api/views/42/') May 28 13:00:20 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e4e7a7cf-517f-4d42-8ae9-b8bec829b48a tempest-ShareTransferNegativeTest-884271560 None] --- [POST] https://127.0.0.1:40443/api/views/: Done May 28 13:00:20 l75lg1-v1 manila-share[98474]: INFO manila.share.manager [None req-e4e7a7cf-517f-4d42-8ae9-b8bec829b48a tempest-ShareTransferNegativeTest-884271560 None] Share instance fa81edfd-59ee-49f5-8dbe-094d49593280 created successfully. May 28 13:00:20 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-2572a1c0-dc1f-4ef3-865d-8c106c493d14 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] GET http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/shares/510f7bcd-a0ee-49a6-8093-2640036f2ca3 May 28 13:00:20 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-2572a1c0-dc1f-4ef3-865d-8c106c493d14 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:20 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-2572a1c0-dc1f-4ef3-865d-8c106c493d14 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:20 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-2572a1c0-dc1f-4ef3-865d-8c106c493d14 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/shares/510f7bcd-a0ee-49a6-8093-2640036f2ca3 returned with HTTP 200 May 28 13:00:20 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 870/1769] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:00:20 2024] GET /share/v2/a4f3887fa28c457390f5b66615564430/shares/510f7bcd-a0ee-49a6-8093-2640036f2ca3 => generated 1315 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:00:21 l75lg1-v1 dstat.sh[49771]: 28-05 13:00:21| 1 0 97 0 0|5685M 1768M 278M 7893M| 16k 66B| 0 648k| 0 50.0 |2088 3372 |1.14 1.07 1.02|1.0 1.0 0| 0 0 | 0 2048M| 29 361 0 36 2 May 28 13:00:21 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-fb4afaea-b258-496e-8343-96602644b4fd tempest-ShareRulesTest-1530341375 None] <<< [DELETE] https://127.0.0.1:40443/api/quotas/37/ May 28 13:00:21 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-fb4afaea-b258-496e-8343-96602644b4fd tempest-ShareRulesTest-1530341375 None] --- [DELETE] https://127.0.0.1:40443/api/quotas/37/: Done May 28 13:00:21 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-68f603f5-d7ee-40d3-87ae-7ccc2b57abfb tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] GET http://10.27.203.238/share/v2/cac556dc39a14bbdbdbabfc80672fb1f/shares/a6923a53-b5dd-4f5b-803b-5f00144de747 May 28 13:00:21 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-fb4afaea-b258-496e-8343-96602644b4fd tempest-ShareRulesTest-1530341375 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:00:21 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-68f603f5-d7ee-40d3-87ae-7ccc2b57abfb tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:21 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-68f603f5-d7ee-40d3-87ae-7ccc2b57abfb tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:21 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-fb4afaea-b258-496e-8343-96602644b4fd tempest-ShareRulesTest-1530341375 None] {'allow_redirects': True, May 28 13:00:21 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-fb4afaea-b258-496e-8343-96602644b4fd tempest-ShareRulesTest-1530341375 None] 'params': {'name': 'ee46a1d1-f743-461e-8bb5-467ee0e99edd'}} May 28 13:00:21 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-68f603f5-d7ee-40d3-87ae-7ccc2b57abfb tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] http://10.27.203.238/share/v2/cac556dc39a14bbdbdbabfc80672fb1f/shares/a6923a53-b5dd-4f5b-803b-5f00144de747 returned with HTTP 200 May 28 13:00:21 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 900/1770] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:00:21 2024] GET /share/v2/cac556dc39a14bbdbdbabfc80672fb1f/shares/a6923a53-b5dd-4f5b-803b-5f00144de747 => generated 1315 bytes in 25 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:00:21 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-f15f84ca-fe7f-44fc-9e03-fd8e043bbed0 tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] POST http://10.27.203.238/share/v2/cac556dc39a14bbdbdbabfc80672fb1f/share-transfers May 28 13:00:21 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-f15f84ca-fe7f-44fc-9e03-fd8e043bbed0 tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"transfer": {"share_id": "a6923a53-b5dd-4f5b-803b-5f00144de747", "name": "tempest-tempest-created-share-transfer-1533229664"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:00:21 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.v2.share_transfer [None req-f15f84ca-fe7f-44fc-9e03-fd8e043bbed0 tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] Creating new share transfer {'transfer': {'share_id': 'a6923a53-b5dd-4f5b-803b-5f00144de747', 'name': 'tempest-tempest-created-share-transfer-1533229664'}} {{(pid=98330) create /opt/stack/manila/manila/api/v2/share_transfer.py:104}} May 28 13:00:21 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.v2.share_transfer [None req-f15f84ca-fe7f-44fc-9e03-fd8e043bbed0 tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] Creating transfer of share a6923a53-b5dd-4f5b-803b-5f00144de747 {{(pid=98330) create /opt/stack/manila/manila/api/v2/share_transfer.py:125}} May 28 13:00:21 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.transfer.api [None req-f15f84ca-fe7f-44fc-9e03-fd8e043bbed0 tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] Generating transfer record for share a6923a53-b5dd-4f5b-803b-5f00144de747 {{(pid=98330) create /opt/stack/manila/manila/transfer/api.py:162}} May 28 13:00:21 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8607af16-e418-4e23-b92d-484e0ba8ad4b tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] <<< [DELETE] https://127.0.0.1:40443/api/quotas/29/ May 28 13:00:21 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8607af16-e418-4e23-b92d-484e0ba8ad4b tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] --- [DELETE] https://127.0.0.1:40443/api/quotas/29/: Done May 28 13:00:21 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8607af16-e418-4e23-b92d-484e0ba8ad4b tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:00:21 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8607af16-e418-4e23-b92d-484e0ba8ad4b tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] {'allow_redirects': True, May 28 13:00:21 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8607af16-e418-4e23-b92d-484e0ba8ad4b tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] 'params': {'name': '7fdd602c-79d0-479c-95a2-336b202c6639'}} May 28 13:00:21 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-f15f84ca-fe7f-44fc-9e03-fd8e043bbed0 tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] http://10.27.203.238/share/v2/cac556dc39a14bbdbdbabfc80672fb1f/share-transfers returned with HTTP 202 May 28 13:00:21 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 871/1771] 10.27.203.238 () {66 vars in 1389 bytes} [Tue May 28 13:00:21 2024] POST /share/v2/cac556dc39a14bbdbdbabfc80672fb1f/share-transfers => generated 728 bytes in 88 msecs (HTTP/1.1 202) 6 headers in 237 bytes (1 switches on core 0) May 28 13:00:21 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-8838ac99-8d26-45d9-b0fa-33d462a8ffca tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] GET http://10.27.203.238/share/v1/cac556dc39a14bbdbdbabfc80672fb1f/shares/a6923a53-b5dd-4f5b-803b-5f00144de747 May 28 13:00:21 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-8838ac99-8d26-45d9-b0fa-33d462a8ffca tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:21 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-8838ac99-8d26-45d9-b0fa-33d462a8ffca tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:21 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-8838ac99-8d26-45d9-b0fa-33d462a8ffca tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] http://10.27.203.238/share/v1/cac556dc39a14bbdbdbabfc80672fb1f/shares/a6923a53-b5dd-4f5b-803b-5f00144de747 returned with HTTP 200 May 28 13:00:21 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 901/1772] 10.27.203.238 () {62 vars in 1408 bytes} [Tue May 28 13:00:21 2024] GET /share/v1/cac556dc39a14bbdbdbabfc80672fb1f/shares/a6923a53-b5dd-4f5b-803b-5f00144de747 => generated 904 bytes in 24 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:00:21 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-a1ac5492-2762-4348-b388-133770c0141e tempest-ShareTransferNegativeTest-1518106491 tempest-ShareTransferNegativeTest-1518106491-project-member] GET http://10.27.203.238/share/v2/c7a348e5c74641978595dc43c2dcb08a/share-transfers/6ad4eae4-d27b-462c-8f7c-be462713e6fb May 28 13:00:21 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-a1ac5492-2762-4348-b388-133770c0141e tempest-ShareTransferNegativeTest-1518106491 tempest-ShareTransferNegativeTest-1518106491-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:21 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-a1ac5492-2762-4348-b388-133770c0141e tempest-ShareTransferNegativeTest-1518106491 tempest-ShareTransferNegativeTest-1518106491-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:21 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault [None req-a1ac5492-2762-4348-b388-133770c0141e tempest-ShareTransferNegativeTest-1518106491 tempest-ShareTransferNegativeTest-1518106491-project-member] Caught error: Transfer 6ad4eae4-d27b-462c-8f7c-be462713e6fb could not be found.: manila.exception.TransferNotFound: Transfer 6ad4eae4-d27b-462c-8f7c-be462713e6fb could not be found. May 28 13:00:21 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault Traceback (most recent call last): May 28 13:00:21 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/api/middleware/fault.py", line 76, in __call__ May 28 13:00:21 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return req.get_response(self.application) May 28 13:00:21 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/request.py", line 1313, in send May 28 13:00:21 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault status, headers, app_iter = self.call_application( May 28 13:00:21 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/request.py", line 1278, in call_application May 28 13:00:21 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault app_iter = application(self.environ, start_response) May 28 13:00:21 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 129, in __call__ May 28 13:00:21 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault resp = self.call_func(req, *args, **kw) May 28 13:00:21 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 193, in call_func May 28 13:00:21 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return self.func(req, *args, **kwargs) May 28 13:00:21 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_middleware/base.py", line 124, in __call__ May 28 13:00:21 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault response = req.get_response(self.application) May 28 13:00:21 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/request.py", line 1313, in send May 28 13:00:21 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault status, headers, app_iter = self.call_application( May 28 13:00:21 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/request.py", line 1278, in call_application May 28 13:00:21 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault app_iter = application(self.environ, start_response) May 28 13:00:21 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 143, in __call__ May 28 13:00:21 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return resp(environ, start_response) May 28 13:00:21 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 129, in __call__ May 28 13:00:21 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault resp = self.call_func(req, *args, **kw) May 28 13:00:21 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 193, in call_func May 28 13:00:21 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return self.func(req, *args, **kwargs) May 28 13:00:21 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/osprofiler/web.py", line 111, in __call__ May 28 13:00:21 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return request.get_response(self.application) May 28 13:00:21 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/request.py", line 1313, in send May 28 13:00:21 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault status, headers, app_iter = self.call_application( May 28 13:00:21 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/request.py", line 1278, in call_application May 28 13:00:21 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault app_iter = application(self.environ, start_response) May 28 13:00:21 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 129, in __call__ May 28 13:00:21 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault resp = self.call_func(req, *args, **kw) May 28 13:00:21 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 193, in call_func May 28 13:00:21 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return self.func(req, *args, **kwargs) May 28 13:00:21 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py", line 340, in __call__ May 28 13:00:21 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault response = req.get_response(self._app) May 28 13:00:21 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/request.py", line 1313, in send May 28 13:00:21 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault status, headers, app_iter = self.call_application( May 28 13:00:21 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/request.py", line 1278, in call_application May 28 13:00:21 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault app_iter = application(self.environ, start_response) May 28 13:00:21 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 143, in __call__ May 28 13:00:21 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return resp(environ, start_response) May 28 13:00:21 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 143, in __call__ May 28 13:00:21 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return resp(environ, start_response) May 28 13:00:21 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/routes/middleware.py", line 153, in __call__ May 28 13:00:21 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault response = self.app(environ, start_response) May 28 13:00:21 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 143, in __call__ May 28 13:00:21 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return resp(environ, start_response) May 28 13:00:21 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 129, in __call__ May 28 13:00:21 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault resp = self.call_func(req, *args, **kw) May 28 13:00:21 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 193, in call_func May 28 13:00:21 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return self.func(req, *args, **kwargs) May 28 13:00:21 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/api/openstack/wsgi.py", line 764, in __call__ May 28 13:00:21 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return self._process_stack(request, action, action_args, May 28 13:00:21 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/api/openstack/wsgi.py", line 829, in _process_stack May 28 13:00:21 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault action_result = self.dispatch(meth, request, action_args) May 28 13:00:21 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/api/openstack/wsgi.py", line 924, in dispatch May 28 13:00:21 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return method(req=request, **action_args) May 28 13:00:21 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/api/openstack/wsgi.py", line 1066, in version_select May 28 13:00:21 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return func.func(self, *args, **kwargs) May 28 13:00:21 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/api/v2/share_transfer.py", line 54, in show May 28 13:00:21 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault transfer = self.transfer_api.get(context, transfer_id=id) May 28 13:00:21 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/transfer/api.py", line 69, in get May 28 13:00:21 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault transfer = self.db.transfer_get(context, transfer_id) May 28 13:00:21 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/db/api.py", line 507, in transfer_get May 28 13:00:21 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return IMPL.transfer_get(context, transfer_id) May 28 13:00:21 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/enginefacade.py", line 998, in wrapper May 28 13:00:21 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return fn(*args, **kwargs) May 28 13:00:21 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/db/sqlalchemy/api.py", line 2677, in transfer_get May 28 13:00:21 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return _transfer_get(context, transfer_id, read_deleted=read_deleted) May 28 13:00:21 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/db/sqlalchemy/api.py", line 2670, in _transfer_get May 28 13:00:21 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault raise exception.TransferNotFound(transfer_id=transfer_id) May 28 13:00:21 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault manila.exception.TransferNotFound: Transfer 6ad4eae4-d27b-462c-8f7c-be462713e6fb could not be found. May 28 13:00:21 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault May 28 13:00:21 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.middleware.fault [None req-a1ac5492-2762-4348-b388-133770c0141e tempest-ShareTransferNegativeTest-1518106491 tempest-ShareTransferNegativeTest-1518106491-project-member] http://10.27.203.238/share/v2/c7a348e5c74641978595dc43c2dcb08a/share-transfers/6ad4eae4-d27b-462c-8f7c-be462713e6fb returned with HTTP 404 May 28 13:00:21 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 872/1773] 10.27.203.238 () {64 vars in 1478 bytes} [Tue May 28 13:00:21 2024] GET /share/v2/c7a348e5c74641978595dc43c2dcb08a/share-transfers/6ad4eae4-d27b-462c-8f7c-be462713e6fb => generated 129 bytes in 10 msecs (HTTP/1.1 404) 6 headers in 238 bytes (1 switches on core 0) May 28 13:00:21 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-bda7c390-92e4-4c73-931f-4f3c49ee3b6f tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] DELETE http://10.27.203.238/share/v2/cac556dc39a14bbdbdbabfc80672fb1f/share-transfers/6ad4eae4-d27b-462c-8f7c-be462713e6fb May 28 13:00:21 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-bda7c390-92e4-4c73-931f-4f3c49ee3b6f tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:21 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-bda7c390-92e4-4c73-931f-4f3c49ee3b6f tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:21 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.v2.share_transfer [None req-bda7c390-92e4-4c73-931f-4f3c49ee3b6f tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] Delete transfer with id: 6ad4eae4-d27b-462c-8f7c-be462713e6fb {{(pid=98329) delete /opt/stack/manila/manila/api/v2/share_transfer.py:193}} May 28 13:00:21 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.transfer.api [None req-bda7c390-92e4-4c73-931f-4f3c49ee3b6f tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] Transfer 6ad4eae4-d27b-462c-8f7c-be462713e6fb has been deleted successful. May 28 13:00:21 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-bda7c390-92e4-4c73-931f-4f3c49ee3b6f tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] http://10.27.203.238/share/v2/cac556dc39a14bbdbdbabfc80672fb1f/share-transfers/6ad4eae4-d27b-462c-8f7c-be462713e6fb returned with HTTP 200 May 28 13:00:21 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 902/1774] 10.27.203.238 () {64 vars in 1481 bytes} [Tue May 28 13:00:21 2024] DELETE /share/v2/cac556dc39a14bbdbdbabfc80672fb1f/share-transfers/6ad4eae4-d27b-462c-8f7c-be462713e6fb => generated 0 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 237 bytes (1 switches on core 0) May 28 13:00:21 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-536dab08-5020-49c7-bd64-4051f9d2fb62 tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] GET http://10.27.203.238/share/v1/cac556dc39a14bbdbdbabfc80672fb1f/shares/a6923a53-b5dd-4f5b-803b-5f00144de747 May 28 13:00:21 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-536dab08-5020-49c7-bd64-4051f9d2fb62 tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:21 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-536dab08-5020-49c7-bd64-4051f9d2fb62 tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:21 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-536dab08-5020-49c7-bd64-4051f9d2fb62 tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] http://10.27.203.238/share/v1/cac556dc39a14bbdbdbabfc80672fb1f/shares/a6923a53-b5dd-4f5b-803b-5f00144de747 returned with HTTP 200 May 28 13:00:21 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 873/1775] 10.27.203.238 () {62 vars in 1408 bytes} [Tue May 28 13:00:21 2024] GET /share/v1/cac556dc39a14bbdbdbabfc80672fb1f/shares/a6923a53-b5dd-4f5b-803b-5f00144de747 => generated 961 bytes in 24 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:00:21 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c38d0f-5fcd-476b-b4ce-bab5be69e114 tempest-ShareIpRulesForNFSNegativeTest-700172924 tempest-ShareIpRulesForNFSNegativeTest-700172924-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:21 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-e0c38d0f-5fcd-476b-b4ce-bab5be69e114 tempest-ShareIpRulesForNFSNegativeTest-700172924 tempest-ShareIpRulesForNFSNegativeTest-700172924-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c38d0f-5fcd-476b-b4ce-bab5be69e114 tempest-ShareIpRulesForNFSNegativeTest-700172924 tempest-ShareIpRulesForNFSNegativeTest-700172924-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9d7557-f2e5-420c-9d9c-168e4a4aec94 tempest-ShareTransferNegativeTest-1910579163 tempest-ShareTransferNegativeTest-1910579163-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16f4189b208748b8aa156ef28ced43cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b26e2f4af8614f3ea1f0aba07abd852c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9d7557-f2e5-420c-9d9c-168e4a4aec94 tempest-ShareTransferNegativeTest-1910579163 tempest-ShareTransferNegativeTest-1910579163-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9d7557-f2e5-420c-9d9c-168e4a4aec94 tempest-ShareTransferNegativeTest-1910579163 tempest-ShareTransferNegativeTest-1910579163-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9d7557-f2e5-420c-9d9c-168e4a4aec94 tempest-ShareTransferNegativeTest-1910579163 tempest-ShareTransferNegativeTest-1910579163-project-admin] PATH_INFO: `/v3/users/b9078b0601ac4efa93bdcc390f3d1208` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9d7557-f2e5-420c-9d9c-168e4a4aec94 tempest-ShareTransferNegativeTest-1910579163 tempest-ShareTransferNegativeTest-1910579163-project-admin] RBAC: Authorizing `identity:delete_user(user_id=b9078b0601ac4efa93bdcc390f3d1208)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9d7557-f2e5-420c-9d9c-168e4a4aec94 tempest-ShareTransferNegativeTest-1910579163 tempest-ShareTransferNegativeTest-1910579163-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-cf9d7557-f2e5-420c-9d9c-168e4a4aec94 tempest-ShareTransferNegativeTest-1910579163 tempest-ShareTransferNegativeTest-1910579163-project-admin] Could not find user: b9078b0601ac4efa93bdcc390f3d1208.: keystone.exception.UserNotFound: Could not find user: b9078b0601ac4efa93bdcc390f3d1208. May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: b9078b0601ac4efa93bdcc390f3d1208. May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1396/2763] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:00:21 2024] DELETE /identity/v3/users/b9078b0601ac4efa93bdcc390f3d1208 => generated 110 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407daaf2-18c9-4e23-aff2-17ddb88ea0ab service manila] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407daaf2-18c9-4e23-aff2-17ddb88ea0ab service manila] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4846cd-a2e2-4c64-9a35-af38298b10cb tempest-ShareTransferNegativeTest-1910579163 tempest-ShareTransferNegativeTest-1910579163-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16f4189b208748b8aa156ef28ced43cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b26e2f4af8614f3ea1f0aba07abd852c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4846cd-a2e2-4c64-9a35-af38298b10cb tempest-ShareTransferNegativeTest-1910579163 tempest-ShareTransferNegativeTest-1910579163-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4846cd-a2e2-4c64-9a35-af38298b10cb tempest-ShareTransferNegativeTest-1910579163 tempest-ShareTransferNegativeTest-1910579163-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4846cd-a2e2-4c64-9a35-af38298b10cb tempest-ShareTransferNegativeTest-1910579163 tempest-ShareTransferNegativeTest-1910579163-project-admin] PATH_INFO: `/v3/users/567edee5a37f498e8a3f54a933728377` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4846cd-a2e2-4c64-9a35-af38298b10cb tempest-ShareTransferNegativeTest-1910579163 tempest-ShareTransferNegativeTest-1910579163-project-admin] RBAC: Authorizing `identity:delete_user(user_id=567edee5a37f498e8a3f54a933728377)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4846cd-a2e2-4c64-9a35-af38298b10cb tempest-ShareTransferNegativeTest-1910579163 tempest-ShareTransferNegativeTest-1910579163-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-ca4846cd-a2e2-4c64-9a35-af38298b10cb tempest-ShareTransferNegativeTest-1910579163 tempest-ShareTransferNegativeTest-1910579163-project-admin] Could not find user: 567edee5a37f498e8a3f54a933728377.: keystone.exception.UserNotFound: Could not find user: 567edee5a37f498e8a3f54a933728377. May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 567edee5a37f498e8a3f54a933728377. May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1368/2764] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:00:22 2024] DELETE /identity/v3/users/567edee5a37f498e8a3f54a933728377 => generated 110 bytes in 24 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9d7557-f2e5-420c-9d9c-168e4a4aec94 tempest-ShareTransferNegativeTest-1910579163 tempest-ShareTransferNegativeTest-1910579163-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9d7557-f2e5-420c-9d9c-168e4a4aec94 tempest-ShareTransferNegativeTest-1910579163 tempest-ShareTransferNegativeTest-1910579163-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fec767-a125-4cd2-93a8-29404587df4f tempest-ShareTransferNegativeTest-1910579163 tempest-ShareTransferNegativeTest-1910579163-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16f4189b208748b8aa156ef28ced43cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b26e2f4af8614f3ea1f0aba07abd852c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fec767-a125-4cd2-93a8-29404587df4f tempest-ShareTransferNegativeTest-1910579163 tempest-ShareTransferNegativeTest-1910579163-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fec767-a125-4cd2-93a8-29404587df4f tempest-ShareTransferNegativeTest-1910579163 tempest-ShareTransferNegativeTest-1910579163-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fec767-a125-4cd2-93a8-29404587df4f tempest-ShareTransferNegativeTest-1910579163 tempest-ShareTransferNegativeTest-1910579163-project-admin] PATH_INFO: `/v3/users/e1f712aac7e94e429048f60f92a8a736` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fec767-a125-4cd2-93a8-29404587df4f tempest-ShareTransferNegativeTest-1910579163 tempest-ShareTransferNegativeTest-1910579163-project-admin] RBAC: Authorizing `identity:delete_user(user_id=e1f712aac7e94e429048f60f92a8a736)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fec767-a125-4cd2-93a8-29404587df4f tempest-ShareTransferNegativeTest-1910579163 tempest-ShareTransferNegativeTest-1910579163-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-40fec767-a125-4cd2-93a8-29404587df4f tempest-ShareTransferNegativeTest-1910579163 tempest-ShareTransferNegativeTest-1910579163-project-admin] Could not find user: e1f712aac7e94e429048f60f92a8a736.: keystone.exception.UserNotFound: Could not find user: e1f712aac7e94e429048f60f92a8a736. May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: e1f712aac7e94e429048f60f92a8a736. May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1397/2765] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:00:22 2024] DELETE /identity/v3/users/e1f712aac7e94e429048f60f92a8a736 => generated 110 bytes in 24 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4846cd-a2e2-4c64-9a35-af38298b10cb tempest-ShareTransferNegativeTest-1910579163 tempest-ShareTransferNegativeTest-1910579163-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4846cd-a2e2-4c64-9a35-af38298b10cb tempest-ShareTransferNegativeTest-1910579163 tempest-ShareTransferNegativeTest-1910579163-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df269951-77a3-477e-8331-9bf0965cfe84 tempest-ShareTransferNegativeTest-1910579163 tempest-ShareTransferNegativeTest-1910579163-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16f4189b208748b8aa156ef28ced43cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b26e2f4af8614f3ea1f0aba07abd852c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df269951-77a3-477e-8331-9bf0965cfe84 tempest-ShareTransferNegativeTest-1910579163 tempest-ShareTransferNegativeTest-1910579163-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df269951-77a3-477e-8331-9bf0965cfe84 tempest-ShareTransferNegativeTest-1910579163 tempest-ShareTransferNegativeTest-1910579163-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df269951-77a3-477e-8331-9bf0965cfe84 tempest-ShareTransferNegativeTest-1910579163 tempest-ShareTransferNegativeTest-1910579163-project-admin] PATH_INFO: `/v3/users/9d3788d7291b4ee389136f181e35a26b` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df269951-77a3-477e-8331-9bf0965cfe84 tempest-ShareTransferNegativeTest-1910579163 tempest-ShareTransferNegativeTest-1910579163-project-admin] RBAC: Authorizing `identity:delete_user(user_id=9d3788d7291b4ee389136f181e35a26b)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df269951-77a3-477e-8331-9bf0965cfe84 tempest-ShareTransferNegativeTest-1910579163 tempest-ShareTransferNegativeTest-1910579163-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:22 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8607af16-e418-4e23-b92d-484e0ba8ad4b tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:00:22 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8607af16-e418-4e23-b92d-484e0ba8ad4b tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] [Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=0, created='2024-05-28T12:58:43.845440Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='31b6534b-d142-4561-992f-4f0759db302d', id=32, internal=False, is_s3_default_policy=False, name='7fdd602c-79d0-479c-95a2-336b202c6639', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=['*'], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=[], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=[], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T13:00:12.030373Z', tenant_id=1, tenant_name='default', title='7fdd602c-79d0-479c-95a2-336b202c6639', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/32/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[])] May 28 13:00:22 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8607af16-e418-4e23-b92d-484e0ba8ad4b tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 13:00:22 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8607af16-e418-4e23-b92d-484e0ba8ad4b tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] >>> [DELETE] https://127.0.0.1:40443/api/viewpolicies/32/ May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-df269951-77a3-477e-8331-9bf0965cfe84 tempest-ShareTransferNegativeTest-1910579163 tempest-ShareTransferNegativeTest-1910579163-project-admin] Could not find user: 9d3788d7291b4ee389136f181e35a26b.: keystone.exception.UserNotFound: Could not find user: 9d3788d7291b4ee389136f181e35a26b. May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 9d3788d7291b4ee389136f181e35a26b. May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1369/2766] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:00:22 2024] DELETE /identity/v3/users/9d3788d7291b4ee389136f181e35a26b => generated 110 bytes in 25 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fec767-a125-4cd2-93a8-29404587df4f tempest-ShareTransferNegativeTest-1910579163 tempest-ShareTransferNegativeTest-1910579163-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fec767-a125-4cd2-93a8-29404587df4f tempest-ShareTransferNegativeTest-1910579163 tempest-ShareTransferNegativeTest-1910579163-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c8035e-f9c4-41fa-a385-fa92aaa8bf1f tempest-ShareTransferNegativeTest-1910579163 tempest-ShareTransferNegativeTest-1910579163-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16f4189b208748b8aa156ef28ced43cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b26e2f4af8614f3ea1f0aba07abd852c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c8035e-f9c4-41fa-a385-fa92aaa8bf1f tempest-ShareTransferNegativeTest-1910579163 tempest-ShareTransferNegativeTest-1910579163-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c8035e-f9c4-41fa-a385-fa92aaa8bf1f tempest-ShareTransferNegativeTest-1910579163 tempest-ShareTransferNegativeTest-1910579163-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c8035e-f9c4-41fa-a385-fa92aaa8bf1f tempest-ShareTransferNegativeTest-1910579163 tempest-ShareTransferNegativeTest-1910579163-project-admin] PATH_INFO: `/v3/users/2eb81a384d764f8cb6d0d7e830959013` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c8035e-f9c4-41fa-a385-fa92aaa8bf1f tempest-ShareTransferNegativeTest-1910579163 tempest-ShareTransferNegativeTest-1910579163-project-admin] RBAC: Authorizing `identity:delete_user(user_id=2eb81a384d764f8cb6d0d7e830959013)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c8035e-f9c4-41fa-a385-fa92aaa8bf1f tempest-ShareTransferNegativeTest-1910579163 tempest-ShareTransferNegativeTest-1910579163-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-43c8035e-f9c4-41fa-a385-fa92aaa8bf1f tempest-ShareTransferNegativeTest-1910579163 tempest-ShareTransferNegativeTest-1910579163-project-admin] Could not find user: 2eb81a384d764f8cb6d0d7e830959013.: keystone.exception.UserNotFound: Could not find user: 2eb81a384d764f8cb6d0d7e830959013. May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 2eb81a384d764f8cb6d0d7e830959013. May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1398/2767] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:00:22 2024] DELETE /identity/v3/users/2eb81a384d764f8cb6d0d7e830959013 => generated 110 bytes in 23 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df269951-77a3-477e-8331-9bf0965cfe84 tempest-ShareTransferNegativeTest-1910579163 tempest-ShareTransferNegativeTest-1910579163-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df269951-77a3-477e-8331-9bf0965cfe84 tempest-ShareTransferNegativeTest-1910579163 tempest-ShareTransferNegativeTest-1910579163-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a04163-22c8-486c-a2f1-80cdba88df87 tempest-ShareTransferNegativeTest-1910579163 tempest-ShareTransferNegativeTest-1910579163-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16f4189b208748b8aa156ef28ced43cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b26e2f4af8614f3ea1f0aba07abd852c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a04163-22c8-486c-a2f1-80cdba88df87 tempest-ShareTransferNegativeTest-1910579163 tempest-ShareTransferNegativeTest-1910579163-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a04163-22c8-486c-a2f1-80cdba88df87 tempest-ShareTransferNegativeTest-1910579163 tempest-ShareTransferNegativeTest-1910579163-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a04163-22c8-486c-a2f1-80cdba88df87 tempest-ShareTransferNegativeTest-1910579163 tempest-ShareTransferNegativeTest-1910579163-project-admin] PATH_INFO: `/v3/users/0f30b8ae74474de0b34a7f48f86a312e` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a04163-22c8-486c-a2f1-80cdba88df87 tempest-ShareTransferNegativeTest-1910579163 tempest-ShareTransferNegativeTest-1910579163-project-admin] RBAC: Authorizing `identity:delete_user(user_id=0f30b8ae74474de0b34a7f48f86a312e)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a04163-22c8-486c-a2f1-80cdba88df87 tempest-ShareTransferNegativeTest-1910579163 tempest-ShareTransferNegativeTest-1910579163-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-89a04163-22c8-486c-a2f1-80cdba88df87 tempest-ShareTransferNegativeTest-1910579163 tempest-ShareTransferNegativeTest-1910579163-project-admin] Could not find user: 0f30b8ae74474de0b34a7f48f86a312e.: keystone.exception.UserNotFound: Could not find user: 0f30b8ae74474de0b34a7f48f86a312e. May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 0f30b8ae74474de0b34a7f48f86a312e. May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1370/2768] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:00:22 2024] DELETE /identity/v3/users/0f30b8ae74474de0b34a7f48f86a312e => generated 110 bytes in 24 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c8035e-f9c4-41fa-a385-fa92aaa8bf1f tempest-ShareTransferNegativeTest-1910579163 tempest-ShareTransferNegativeTest-1910579163-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c8035e-f9c4-41fa-a385-fa92aaa8bf1f tempest-ShareTransferNegativeTest-1910579163 tempest-ShareTransferNegativeTest-1910579163-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91523e69-eb03-438f-986e-6c9ab765dc80 tempest-ShareTransferNegativeTest-1910579163 tempest-ShareTransferNegativeTest-1910579163-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16f4189b208748b8aa156ef28ced43cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b26e2f4af8614f3ea1f0aba07abd852c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91523e69-eb03-438f-986e-6c9ab765dc80 tempest-ShareTransferNegativeTest-1910579163 tempest-ShareTransferNegativeTest-1910579163-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91523e69-eb03-438f-986e-6c9ab765dc80 tempest-ShareTransferNegativeTest-1910579163 tempest-ShareTransferNegativeTest-1910579163-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91523e69-eb03-438f-986e-6c9ab765dc80 tempest-ShareTransferNegativeTest-1910579163 tempest-ShareTransferNegativeTest-1910579163-project-admin] PATH_INFO: `/v3/users/7013a62752274b85851c128bd3c241f3` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91523e69-eb03-438f-986e-6c9ab765dc80 tempest-ShareTransferNegativeTest-1910579163 tempest-ShareTransferNegativeTest-1910579163-project-admin] RBAC: Authorizing `identity:delete_user(user_id=7013a62752274b85851c128bd3c241f3)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91523e69-eb03-438f-986e-6c9ab765dc80 tempest-ShareTransferNegativeTest-1910579163 tempest-ShareTransferNegativeTest-1910579163-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-91523e69-eb03-438f-986e-6c9ab765dc80 tempest-ShareTransferNegativeTest-1910579163 tempest-ShareTransferNegativeTest-1910579163-project-admin] Could not find user: 7013a62752274b85851c128bd3c241f3.: keystone.exception.UserNotFound: Could not find user: 7013a62752274b85851c128bd3c241f3. May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 7013a62752274b85851c128bd3c241f3. May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1399/2769] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:00:22 2024] DELETE /identity/v3/users/7013a62752274b85851c128bd3c241f3 => generated 110 bytes in 23 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a04163-22c8-486c-a2f1-80cdba88df87 tempest-ShareTransferNegativeTest-1910579163 tempest-ShareTransferNegativeTest-1910579163-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a04163-22c8-486c-a2f1-80cdba88df87 tempest-ShareTransferNegativeTest-1910579163 tempest-ShareTransferNegativeTest-1910579163-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88b68ad-b110-453d-8220-23764ed31b63 tempest-ShareTransferNegativeTest-1910579163 tempest-ShareTransferNegativeTest-1910579163-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16f4189b208748b8aa156ef28ced43cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b26e2f4af8614f3ea1f0aba07abd852c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88b68ad-b110-453d-8220-23764ed31b63 tempest-ShareTransferNegativeTest-1910579163 tempest-ShareTransferNegativeTest-1910579163-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88b68ad-b110-453d-8220-23764ed31b63 tempest-ShareTransferNegativeTest-1910579163 tempest-ShareTransferNegativeTest-1910579163-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88b68ad-b110-453d-8220-23764ed31b63 tempest-ShareTransferNegativeTest-1910579163 tempest-ShareTransferNegativeTest-1910579163-project-admin] PATH_INFO: `/v3/users/dacf9ff99e1c456cb98dc54de91b36a3` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88b68ad-b110-453d-8220-23764ed31b63 tempest-ShareTransferNegativeTest-1910579163 tempest-ShareTransferNegativeTest-1910579163-project-admin] RBAC: Authorizing `identity:delete_user(user_id=dacf9ff99e1c456cb98dc54de91b36a3)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:22 l75lg1-v1 dstat.sh[49771]: 28-05 13:00:22| 6 1 92 1 0|5685M 1768M 278M 7894M| 14k 5073B| 0 804k| 0 88.0 |4447 7778 |1.20 1.09 1.02|2.0 1.0 0| 0 0 | 0 2048M| 29 362 0 37 2 May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88b68ad-b110-453d-8220-23764ed31b63 tempest-ShareTransferNegativeTest-1910579163 tempest-ShareTransferNegativeTest-1910579163-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-b88b68ad-b110-453d-8220-23764ed31b63 tempest-ShareTransferNegativeTest-1910579163 tempest-ShareTransferNegativeTest-1910579163-project-admin] Could not find user: dacf9ff99e1c456cb98dc54de91b36a3.: keystone.exception.UserNotFound: Could not find user: dacf9ff99e1c456cb98dc54de91b36a3. May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: dacf9ff99e1c456cb98dc54de91b36a3. May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1371/2770] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:00:22 2024] DELETE /identity/v3/users/dacf9ff99e1c456cb98dc54de91b36a3 => generated 110 bytes in 25 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91523e69-eb03-438f-986e-6c9ab765dc80 tempest-ShareTransferNegativeTest-1910579163 tempest-ShareTransferNegativeTest-1910579163-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91523e69-eb03-438f-986e-6c9ab765dc80 tempest-ShareTransferNegativeTest-1910579163 tempest-ShareTransferNegativeTest-1910579163-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231b7f98-b91e-4ee1-aedf-a1404fbb81f8 tempest-ShareTransferNegativeTest-1910579163 tempest-ShareTransferNegativeTest-1910579163-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16f4189b208748b8aa156ef28ced43cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b26e2f4af8614f3ea1f0aba07abd852c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231b7f98-b91e-4ee1-aedf-a1404fbb81f8 tempest-ShareTransferNegativeTest-1910579163 tempest-ShareTransferNegativeTest-1910579163-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231b7f98-b91e-4ee1-aedf-a1404fbb81f8 tempest-ShareTransferNegativeTest-1910579163 tempest-ShareTransferNegativeTest-1910579163-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231b7f98-b91e-4ee1-aedf-a1404fbb81f8 tempest-ShareTransferNegativeTest-1910579163 tempest-ShareTransferNegativeTest-1910579163-project-admin] PATH_INFO: `/v3/users/b31873af346a4deca6e4f761309cbf30` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231b7f98-b91e-4ee1-aedf-a1404fbb81f8 tempest-ShareTransferNegativeTest-1910579163 tempest-ShareTransferNegativeTest-1910579163-project-admin] RBAC: Authorizing `identity:delete_user(user_id=b31873af346a4deca6e4f761309cbf30)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231b7f98-b91e-4ee1-aedf-a1404fbb81f8 tempest-ShareTransferNegativeTest-1910579163 tempest-ShareTransferNegativeTest-1910579163-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:22 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-fb4afaea-b258-496e-8343-96602644b4fd tempest-ShareRulesTest-1530341375 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:00:22 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-fb4afaea-b258-496e-8343-96602644b4fd tempest-ShareRulesTest-1530341375 None] [Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=0, created='2024-05-28T13:00:00.296044Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='0c5a8a38-6377-4415-a54d-f55b3cc6ff10', id=40, internal=False, is_s3_default_policy=False, name='ee46a1d1-f743-461e-8bb5-467ee0e99edd', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=['*'], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=[], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=[], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T13:00:13.872469Z', tenant_id=1, tenant_name='default', title='ee46a1d1-f743-461e-8bb5-467ee0e99edd', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/40/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[])] May 28 13:00:22 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-fb4afaea-b258-496e-8343-96602644b4fd tempest-ShareRulesTest-1530341375 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 13:00:22 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-fb4afaea-b258-496e-8343-96602644b4fd tempest-ShareRulesTest-1530341375 None] >>> [DELETE] https://127.0.0.1:40443/api/viewpolicies/40/ May 28 13:00:22 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-783f8cf7-5727-47db-bf93-b3a48f5bab9e tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] GET http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4 May 28 13:00:22 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-783f8cf7-5727-47db-bf93-b3a48f5bab9e tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:22 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-783f8cf7-5727-47db-bf93-b3a48f5bab9e tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-231b7f98-b91e-4ee1-aedf-a1404fbb81f8 tempest-ShareTransferNegativeTest-1910579163 tempest-ShareTransferNegativeTest-1910579163-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b31873af346a4deca6e4f761309cbf30', 'request_id': 'req-231b7f98-b91e-4ee1-aedf-a1404fbb81f8'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:22 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-6ba6c772-5120-4a2a-80de-125751b2b3f0 tempest-UserMessageNegativeTest-781603078 tempest-UserMessageNegativeTest-781603078-project-member] GET http://10.27.203.238/share/v2/ca9b4c5f200844bdbcc6db13e907f21e/messages May 28 13:00:22 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-6ba6c772-5120-4a2a-80de-125751b2b3f0 tempest-UserMessageNegativeTest-781603078 tempest-UserMessageNegativeTest-781603078-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:22 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-6ba6c772-5120-4a2a-80de-125751b2b3f0 tempest-UserMessageNegativeTest-781603078 tempest-UserMessageNegativeTest-781603078-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:22 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.message.api [None req-6ba6c772-5120-4a2a-80de-125751b2b3f0 tempest-UserMessageNegativeTest-781603078 tempest-UserMessageNegativeTest-781603078-project-member] Searching for messages by: MultiDict([]) {{(pid=98330) get_all /opt/stack/manila/manila/message/api.py:78}} May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-231b7f98-b91e-4ee1-aedf-a1404fbb81f8 tempest-ShareTransferNegativeTest-1910579163 tempest-ShareTransferNegativeTest-1910579163-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b31873af346a4deca6e4f761309cbf30', 'request_id': 'req-231b7f98-b91e-4ee1-aedf-a1404fbb81f8'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-231b7f98-b91e-4ee1-aedf-a1404fbb81f8 tempest-ShareTransferNegativeTest-1910579163 tempest-ShareTransferNegativeTest-1910579163-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b31873af346a4deca6e4f761309cbf30', 'request_id': 'req-231b7f98-b91e-4ee1-aedf-a1404fbb81f8'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-231b7f98-b91e-4ee1-aedf-a1404fbb81f8 tempest-ShareTransferNegativeTest-1910579163 tempest-ShareTransferNegativeTest-1910579163-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b31873af346a4deca6e4f761309cbf30', 'request_id': 'req-231b7f98-b91e-4ee1-aedf-a1404fbb81f8'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:22 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-6ba6c772-5120-4a2a-80de-125751b2b3f0 tempest-UserMessageNegativeTest-781603078 tempest-UserMessageNegativeTest-781603078-project-member] http://10.27.203.238/share/v2/ca9b4c5f200844bdbcc6db13e907f21e/messages returned with HTTP 200 May 28 13:00:22 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 874/1776] 10.27.203.238 () {64 vars in 1346 bytes} [Tue May 28 13:00:22 2024] GET /share/v2/ca9b4c5f200844bdbcc6db13e907f21e/messages => generated 1616 bytes in 12 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:00:22 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-618d8230-1727-47d7-a07d-7dd2932e3795 tempest-UserMessageNegativeTest-781603078 tempest-UserMessageNegativeTest-781603078-project-member] DELETE http://10.27.203.238/share/v2/ca9b4c5f200844bdbcc6db13e907f21e/messages/6d1d53ad-c59a-44b7-ac66-c65db698c623 May 28 13:00:22 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-618d8230-1727-47d7-a07d-7dd2932e3795 tempest-UserMessageNegativeTest-781603078 tempest-UserMessageNegativeTest-781603078-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:22 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-618d8230-1727-47d7-a07d-7dd2932e3795 tempest-UserMessageNegativeTest-781603078 tempest-UserMessageNegativeTest-781603078-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:22 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-783f8cf7-5727-47db-bf93-b3a48f5bab9e tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4 returned with HTTP 200 May 28 13:00:22 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 903/1777] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:00:22 2024] GET /share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4 => generated 1315 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:00:22 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-618d8230-1727-47d7-a07d-7dd2932e3795 tempest-UserMessageNegativeTest-781603078 tempest-UserMessageNegativeTest-781603078-project-member] HTTP exception thrown: Message 6d1d53ad-c59a-44b7-ac66-c65db698c623 could not be found. May 28 13:00:22 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-618d8230-1727-47d7-a07d-7dd2932e3795 tempest-UserMessageNegativeTest-781603078 tempest-UserMessageNegativeTest-781603078-project-member] http://10.27.203.238/share/v2/ca9b4c5f200844bdbcc6db13e907f21e/messages/6d1d53ad-c59a-44b7-ac66-c65db698c623 returned with HTTP 404 May 28 13:00:22 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 875/1778] 10.27.203.238 () {64 vars in 1460 bytes} [Tue May 28 13:00:22 2024] DELETE /share/v2/ca9b4c5f200844bdbcc6db13e907f21e/messages/6d1d53ad-c59a-44b7-ac66-c65db698c623 => generated 110 bytes in 10 msecs (HTTP/1.1 404) 6 headers in 238 bytes (1 switches on core 0) May 28 13:00:22 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-faacc043-94cf-443b-92c3-c46d133ed146 tempest-UserMessageNegativeTest-781603078 tempest-UserMessageNegativeTest-781603078-project-member] DELETE http://10.27.203.238/share/v2/ca9b4c5f200844bdbcc6db13e907f21e/shares/e1213560-b32f-45ad-8936-66e8b683bf67 May 28 13:00:22 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-faacc043-94cf-443b-92c3-c46d133ed146 tempest-UserMessageNegativeTest-781603078 tempest-UserMessageNegativeTest-781603078-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:22 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-faacc043-94cf-443b-92c3-c46d133ed146 tempest-UserMessageNegativeTest-781603078 tempest-UserMessageNegativeTest-781603078-project-member] Calling method 'ShareMixin.delete' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:22 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.v1.shares [None req-faacc043-94cf-443b-92c3-c46d133ed146 tempest-UserMessageNegativeTest-781603078 tempest-UserMessageNegativeTest-781603078-project-member] Delete share with id: e1213560-b32f-45ad-8936-66e8b683bf67 May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-231b7f98-b91e-4ee1-aedf-a1404fbb81f8 tempest-ShareTransferNegativeTest-1910579163 tempest-ShareTransferNegativeTest-1910579163-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b31873af346a4deca6e4f761309cbf30', 'request_id': 'req-231b7f98-b91e-4ee1-aedf-a1404fbb81f8'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:22 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1400/2771] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:00:22 2024] DELETE /identity/v3/users/b31873af346a4deca6e4f761309cbf30 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:00:22 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-ff35c54f-1ad9-4636-a76c-b4e7abd9a9ef tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] GET http://10.27.203.238/share/v2/cac556dc39a14bbdbdbabfc80672fb1f/share-replicas/detail?share_id=a6923a53-b5dd-4f5b-803b-5f00144de747 May 28 13:00:22 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-ff35c54f-1ad9-4636-a76c-b4e7abd9a9ef tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:22 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-ff35c54f-1ad9-4636-a76c-b4e7abd9a9ef tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:22 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-ff35c54f-1ad9-4636-a76c-b4e7abd9a9ef tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] http://10.27.203.238/share/v2/cac556dc39a14bbdbdbabfc80672fb1f/share-replicas/detail?share_id=a6923a53-b5dd-4f5b-803b-5f00144de747 returned with HTTP 200 May 28 13:00:22 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 876/1779] 10.27.203.238 () {64 vars in 1476 bytes} [Tue May 28 13:00:22 2024] GET /share/v2/cac556dc39a14bbdbdbabfc80672fb1f/share-replicas/detail?share_id=a6923a53-b5dd-4f5b-803b-5f00144de747 => generated 22 bytes in 16 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:00:22 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-f4706723-1f7b-4c2e-af13-5731a7d30ebc tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] DELETE http://10.27.203.238/share/v2/cac556dc39a14bbdbdbabfc80672fb1f/shares/a6923a53-b5dd-4f5b-803b-5f00144de747 May 28 13:00:22 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-f4706723-1f7b-4c2e-af13-5731a7d30ebc tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:22 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-f4706723-1f7b-4c2e-af13-5731a7d30ebc tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] Calling method 'ShareMixin.delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:22 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.v1.shares [None req-f4706723-1f7b-4c2e-af13-5731a7d30ebc tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] Delete share with id: a6923a53-b5dd-4f5b-803b-5f00144de747 May 28 13:00:22 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-f4706723-1f7b-4c2e-af13-5731a7d30ebc tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] http://10.27.203.238/share/v2/cac556dc39a14bbdbdbabfc80672fb1f/shares/a6923a53-b5dd-4f5b-803b-5f00144de747 returned with HTTP 202 May 28 13:00:22 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 877/1780] 10.27.203.238 () {64 vars in 1454 bytes} [Tue May 28 13:00:22 2024] DELETE /share/v2/cac556dc39a14bbdbdbabfc80672fb1f/shares/a6923a53-b5dd-4f5b-803b-5f00144de747 => generated 0 bytes in 127 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 13:00:22 l75lg1-v1 manila-share[98474]: DEBUG dbcounter [-] [98474] Writing DB stats manila:SELECT=2188,manila:UPDATE=198,manila:INSERT=32 {{(pid=98474) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:00:22 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-4de170bb-aa85-4654-a93f-43bb2837ff6e tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] GET http://10.27.203.238/share/v2/cac556dc39a14bbdbdbabfc80672fb1f/shares/a6923a53-b5dd-4f5b-803b-5f00144de747 May 28 13:00:22 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-4de170bb-aa85-4654-a93f-43bb2837ff6e tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:22 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-4de170bb-aa85-4654-a93f-43bb2837ff6e tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:22 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-4de170bb-aa85-4654-a93f-43bb2837ff6e tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] http://10.27.203.238/share/v2/cac556dc39a14bbdbdbabfc80672fb1f/shares/a6923a53-b5dd-4f5b-803b-5f00144de747 returned with HTTP 200 May 28 13:00:22 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 878/1781] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:00:22 2024] GET /share/v2/cac556dc39a14bbdbdbabfc80672fb1f/shares/a6923a53-b5dd-4f5b-803b-5f00144de747 => generated 1314 bytes in 24 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:00:22 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-f4706723-1f7b-4c2e-af13-5731a7d30ebc tempest-ShareTransferNegativeTest-884271560 None] Acquiring lock "locked_access_rules_operation_by_share_instance_fa81edfd-59ee-49f5-8dbe-094d49593280" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:00:22 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-f4706723-1f7b-4c2e-af13-5731a7d30ebc tempest-ShareTransferNegativeTest-884271560 None] Lock "locked_access_rules_operation_by_share_instance_fa81edfd-59ee-49f5-8dbe-094d49593280" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:00:22 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.quota [None req-faacc043-94cf-443b-92c3-c46d133ed146 tempest-UserMessageNegativeTest-781603078 tempest-UserMessageNegativeTest-781603078-project-member] Created reservations ['dd0853e1-74ba-4bb4-bf04-12f2e1831851', '5d047d8d-64b0-417b-a4f6-de74d9fc171e', 'f8089cea-be7f-47c3-b09b-d0e0cf25b376', '5e69fc49-74e1-482b-9464-97b4e7c01245'] {{(pid=98329) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 13:00:22 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-f4706723-1f7b-4c2e-af13-5731a7d30ebc tempest-ShareTransferNegativeTest-884271560 None] Lock "locked_access_rules_operation_by_share_instance_fa81edfd-59ee-49f5-8dbe-094d49593280" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:00:22 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-f4706723-1f7b-4c2e-af13-5731a7d30ebc tempest-ShareTransferNegativeTest-884271560 None] Acquiring lock "locked_access_rules_operation_by_share_instance_fa81edfd-59ee-49f5-8dbe-094d49593280" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:00:22 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-f4706723-1f7b-4c2e-af13-5731a7d30ebc tempest-ShareTransferNegativeTest-884271560 None] Lock "locked_access_rules_operation_by_share_instance_fa81edfd-59ee-49f5-8dbe-094d49593280" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:00:22 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-f4706723-1f7b-4c2e-af13-5731a7d30ebc tempest-ShareTransferNegativeTest-884271560 None] Lock "locked_access_rules_operation_by_share_instance_fa81edfd-59ee-49f5-8dbe-094d49593280" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:00:22 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-f4706723-1f7b-4c2e-af13-5731a7d30ebc tempest-ShareTransferNegativeTest-884271560 None] Acquiring lock "locked_access_rules_operation_by_share_instance_fa81edfd-59ee-49f5-8dbe-094d49593280" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:00:22 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-f4706723-1f7b-4c2e-af13-5731a7d30ebc tempest-ShareTransferNegativeTest-884271560 None] Lock "locked_access_rules_operation_by_share_instance_fa81edfd-59ee-49f5-8dbe-094d49593280" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:00:22 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-f4706723-1f7b-4c2e-af13-5731a7d30ebc tempest-ShareTransferNegativeTest-884271560 None] Lock "locked_access_rules_operation_by_share_instance_fa81edfd-59ee-49f5-8dbe-094d49593280" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:00:22 l75lg1-v1 manila-share[98474]: DEBUG manila.share.access [None req-f4706723-1f7b-4c2e-af13-5731a7d30ebc tempest-ShareTransferNegativeTest-884271560 None] All access rules have been synced for share instance fa81edfd-59ee-49f5-8dbe-094d49593280 belonging to share a6923a53-b5dd-4f5b-803b-5f00144de747. {{(pid=98474) update_access_rules /opt/stack/manila/manila/share/access.py:304}} May 28 13:00:22 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-f4706723-1f7b-4c2e-af13-5731a7d30ebc tempest-ShareTransferNegativeTest-884271560 None] deleting '/manila/manila-fa81edfd-59ee-49f5-8dbe-094d49593280' May 28 13:00:22 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f4706723-1f7b-4c2e-af13-5731a7d30ebc tempest-ShareTransferNegativeTest-884271560 None] >>> [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/ May 28 13:00:22 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f4706723-1f7b-4c2e-af13-5731a7d30ebc tempest-ShareTransferNegativeTest-884271560 None] {'data': '{"path": "/manila/manila-fa81edfd-59ee-49f5-8dbe-094d49593280"}', May 28 13:00:22 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f4706723-1f7b-4c2e-af13-5731a7d30ebc tempest-ShareTransferNegativeTest-884271560 None] 'params': None} May 28 13:00:22 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.quota [None req-faacc043-94cf-443b-92c3-c46d133ed146 tempest-UserMessageNegativeTest-781603078 tempest-UserMessageNegativeTest-781603078-project-member] Committed reservations ['dd0853e1-74ba-4bb4-bf04-12f2e1831851', '5d047d8d-64b0-417b-a4f6-de74d9fc171e', 'f8089cea-be7f-47c3-b09b-d0e0cf25b376', '5e69fc49-74e1-482b-9464-97b4e7c01245'] {{(pid=98329) commit /opt/stack/manila/manila/quota.py:1063}} May 28 13:00:22 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-faacc043-94cf-443b-92c3-c46d133ed146 tempest-UserMessageNegativeTest-781603078 tempest-UserMessageNegativeTest-781603078-project-member] http://10.27.203.238/share/v2/ca9b4c5f200844bdbcc6db13e907f21e/shares/e1213560-b32f-45ad-8936-66e8b683bf67 returned with HTTP 202 May 28 13:00:22 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 904/1782] 10.27.203.238 () {64 vars in 1454 bytes} [Tue May 28 13:00:22 2024] DELETE /share/v2/ca9b4c5f200844bdbcc6db13e907f21e/shares/e1213560-b32f-45ad-8936-66e8b683bf67 => generated 0 bytes in 283 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 13:00:22 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-d7dc0b27-3423-4ac6-b2de-f64be76e1ff0 tempest-UserMessageNegativeTest-278135351 tempest-UserMessageNegativeTest-278135351-project-admin] POST http://10.27.203.238/share/v2/7942989ad1ef4db2b2e923f7316c8511/types May 28 13:00:22 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-d7dc0b27-3423-4ac6-b2de-f64be76e1ff0 tempest-UserMessageNegativeTest-278135351 tempest-UserMessageNegativeTest-278135351-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share_type": {"name": "tempest-share-type-975052078", "extra_specs": {"driver_handles_share_servers": false, "vendor_name": "foobar"}, "share_type_access:is_public": true}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:00:22 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-d7dc0b27-3423-4ac6-b2de-f64be76e1ff0 tempest-UserMessageNegativeTest-278135351 tempest-UserMessageNegativeTest-278135351-project-admin] http://10.27.203.238/share/v2/7942989ad1ef4db2b2e923f7316c8511/types returned with HTTP 200 May 28 13:00:22 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 879/1783] 10.27.203.238 () {66 vars in 1359 bytes} [Tue May 28 13:00:22 2024] POST /share/v2/7942989ad1ef4db2b2e923f7316c8511/types => generated 659 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:00:22 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-189ae00d-ccc3-4728-8424-4c4e8561a053 tempest-UserMessageNegativeTest-781603078 tempest-UserMessageNegativeTest-781603078-project-member] POST http://10.27.203.238/share/v2/ca9b4c5f200844bdbcc6db13e907f21e/shares May 28 13:00:22 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-189ae00d-ccc3-4728-8424-4c4e8561a053 tempest-UserMessageNegativeTest-781603078 tempest-UserMessageNegativeTest-781603078-project-member] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share": {"share_proto": "nfs", "description": "tempest-tempest-created-share-desc-1772645824", "snapshot_id": null, "name": "tempest-tempest-created-share-701295262", "size": 1, "metadata": {}, "is_public": false, "share_type": "38b0bcd7-3e12-43db-9b61-6942639a43c7"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:00:22 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.v1.shares [None req-189ae00d-ccc3-4728-8424-4c4e8561a053 tempest-UserMessageNegativeTest-781603078 tempest-UserMessageNegativeTest-781603078-project-member] Create NFS share of 1 GB May 28 13:00:22 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f4706723-1f7b-4c2e-af13-5731a7d30ebc tempest-ShareTransferNegativeTest-884271560 None] <<< [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/ May 28 13:00:22 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f4706723-1f7b-4c2e-af13-5731a7d30ebc tempest-ShareTransferNegativeTest-884271560 None] 'OK' May 28 13:00:22 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f4706723-1f7b-4c2e-af13-5731a7d30ebc tempest-ShareTransferNegativeTest-884271560 None] --- [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/: Done May 28 13:00:22 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f4706723-1f7b-4c2e-af13-5731a7d30ebc tempest-ShareTransferNegativeTest-884271560 None] >>> [GET] https://127.0.0.1:40443/api/views/ May 28 13:00:22 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f4706723-1f7b-4c2e-af13-5731a7d30ebc tempest-ShareTransferNegativeTest-884271560 None] {'allow_redirects': True, May 28 13:00:22 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f4706723-1f7b-4c2e-af13-5731a7d30ebc tempest-ShareTransferNegativeTest-884271560 None] 'params': {'name': 'fa81edfd-59ee-49f5-8dbe-094d49593280'}} May 28 13:00:22 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.quota [None req-189ae00d-ccc3-4728-8424-4c4e8561a053 tempest-UserMessageNegativeTest-781603078 tempest-UserMessageNegativeTest-781603078-project-member] Created reservations ['14363e6a-25de-4391-9c2e-b926b61d4ee8', 'cfcec9ba-f59a-4fb4-8e30-e18d735b45de', 'a7889311-bf1a-483a-985a-3ad5af9f5b18', '4ccbd444-b1b4-44bc-968c-16f2ecc3c5fd'] {{(pid=98329) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 13:00:22 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.quota [None req-189ae00d-ccc3-4728-8424-4c4e8561a053 tempest-UserMessageNegativeTest-781603078 tempest-UserMessageNegativeTest-781603078-project-member] Committed reservations ['14363e6a-25de-4391-9c2e-b926b61d4ee8', 'cfcec9ba-f59a-4fb4-8e30-e18d735b45de', 'a7889311-bf1a-483a-985a-3ad5af9f5b18', '4ccbd444-b1b4-44bc-968c-16f2ecc3c5fd'] {{(pid=98329) commit /opt/stack/manila/manila/quota.py:1063}} May 28 13:00:22 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.host_manager [None req-189ae00d-ccc3-4728-8424-4c4e8561a053 tempest-UserMessageNegativeTest-781603078 None] Share service is down. (host: l75lg1-v1@generic2). May 28 13:00:22 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.host_manager [None req-189ae00d-ccc3-4728-8424-4c4e8561a053 tempest-UserMessageNegativeTest-781603078 None] Share service is down. (host: l75lg1-v1@generic1). May 28 13:00:22 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-189ae00d-ccc3-4728-8424-4c4e8561a053 tempest-UserMessageNegativeTest-781603078 None] Starting with 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:80}} May 28 13:00:22 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-189ae00d-ccc3-4728-8424-4c4e8561a053 tempest-UserMessageNegativeTest-781603078 None] Filter OnlyHostFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:00:22 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-189ae00d-ccc3-4728-8424-4c4e8561a053 tempest-UserMessageNegativeTest-781603078 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:00:22 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.capacity [None req-189ae00d-ccc3-4728-8424-4c4e8561a053 tempest-UserMessageNegativeTest-781603078 None] Space information for share creation on host l75lg1-v1@vast#vast (requested / avail): 1/2076 {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/capacity.py:83}} May 28 13:00:22 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-189ae00d-ccc3-4728-8424-4c4e8561a053 tempest-UserMessageNegativeTest-781603078 None] Filter CapacityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:00:22 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.utils [None req-189ae00d-ccc3-4728-8424-4c4e8561a053 tempest-UserMessageNegativeTest-781603078 None] Share type extra spec requirement "vendor_name=foobar" does not match reported capability "VAST STORAGE" {{(pid=98327) capabilities_satisfied /opt/stack/manila/manila/scheduler/utils.py:185}} May 28 13:00:22 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.capabilities [None req-189ae00d-ccc3-4728-8424-4c4e8561a053 tempest-UserMessageNegativeTest-781603078 None] host: 'l75lg1-v1@vast#vast', free_capacity_gb: 2076.6478263456374, pools: None fails resource_type extra_specs requirements {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/capabilities.py:45}} May 28 13:00:22 l75lg1-v1 manila-scheduler[98327]: INFO manila.scheduler.filters.base [None req-189ae00d-ccc3-4728-8424-4c4e8561a053 tempest-UserMessageNegativeTest-781603078 None] Filter CapabilitiesFilter returned 0 host(s) May 28 13:00:22 l75lg1-v1 manila-scheduler[98327]: ERROR manila.scheduler.manager [None req-189ae00d-ccc3-4728-8424-4c4e8561a053 tempest-UserMessageNegativeTest-781603078 None] Failed to schedule create_share: No valid host was found. Failed to find a weighted host, the last executed filter was CapabilitiesFilter.: manila.exception.NoValidHost: No valid host was found. Failed to find a weighted host, the last executed filter was CapabilitiesFilter. May 28 13:00:22 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-189ae00d-ccc3-4728-8424-4c4e8561a053 tempest-UserMessageNegativeTest-781603078 tempest-UserMessageNegativeTest-781603078-project-member] http://10.27.203.238/share/v2/ca9b4c5f200844bdbcc6db13e907f21e/shares returned with HTTP 200 May 28 13:00:22 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 905/1784] 10.27.203.238 () {66 vars in 1362 bytes} [Tue May 28 13:00:22 2024] POST /share/v2/ca9b4c5f200844bdbcc6db13e907f21e/shares => generated 1333 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:00:22 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-02a31769-0229-454e-981e-70513d41639a tempest-UserMessageNegativeTest-781603078 tempest-UserMessageNegativeTest-781603078-project-member] GET http://10.27.203.238/share/v2/ca9b4c5f200844bdbcc6db13e907f21e/shares/a94015c0-bde2-41e5-8a32-24098a0bf251 May 28 13:00:22 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-02a31769-0229-454e-981e-70513d41639a tempest-UserMessageNegativeTest-781603078 tempest-UserMessageNegativeTest-781603078-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:22 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-02a31769-0229-454e-981e-70513d41639a tempest-UserMessageNegativeTest-781603078 tempest-UserMessageNegativeTest-781603078-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:22 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-02a31769-0229-454e-981e-70513d41639a tempest-UserMessageNegativeTest-781603078 tempest-UserMessageNegativeTest-781603078-project-member] http://10.27.203.238/share/v2/ca9b4c5f200844bdbcc6db13e907f21e/shares/a94015c0-bde2-41e5-8a32-24098a0bf251 returned with HTTP 200 May 28 13:00:22 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 880/1785] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:00:22 2024] GET /share/v2/ca9b4c5f200844bdbcc6db13e907f21e/shares/a94015c0-bde2-41e5-8a32-24098a0bf251 => generated 1333 bytes in 29 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:00:22 l75lg1-v1 manila-scheduler[98327]: INFO manila.message.api [None req-189ae00d-ccc3-4728-8424-4c4e8561a053 tempest-UserMessageNegativeTest-781603078 None] Creating message record for request_id = req-189ae00d-ccc3-4728-8424-4c4e8561a053 May 28 13:00:23 l75lg1-v1 dstat.sh[49771]: 28-05 13:00:23| 9 1 85 5 0|5685M 1768M 278M 7894M| 14k 4971B| 0 1794k| 0 283 |6244 10k|1.20 1.09 1.02| 0 1.0 0| 0 0 | 0 2048M| 29 361 0 37 2 May 28 13:00:23 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f4706723-1f7b-4c2e-af13-5731a7d30ebc tempest-ShareTransferNegativeTest-884271560 None] <<< [GET] https://127.0.0.1:40443/api/views/ May 28 13:00:23 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f4706723-1f7b-4c2e-af13-5731a7d30ebc tempest-ShareTransferNegativeTest-884271560 None] [Bunch(abac_tags=[], abe_max_depth=None, abe_protocols=[], alias='', allow_anonymous_access=False, allow_s3_anonymous_access=False, auto_commit='0d', bucket='', bucket_creators=[], bucket_creators_groups=[], bucket_owner=None, bulk_permission_update_progress=None, bulk_permission_update_state=None, cluster='loop75-kfs', cluster_id=1, created='2024-05-28T13:00:19.991013Z', enabled=True, files_retention_mode='NONE', guid='a9c5658a-6f9b-4728-b702-d080653cc976', id=42, ignore_oos=False, internal=False, is_remote=False, is_seamless=False, logical_capacity=0, max_retention_period=None, min_retention_period=None, name='fa81edfd-59ee-49f5-8dbe-094d49593280', nfs_interop_flags='BOTH_NFS3_AND_NFS4_INTEROP_DISABLED', path='/manila/manila-fa81edfd-59ee-49f5-8dbe-094d49593280', physical_capacity=0, policy='fa81edfd-59ee-49f5-8dbe-094d49593280', policy_id=43, protocols=['NFS'], qos_policy=None, qos_policy_id=None, s3_locks=False, s3_locks_retention_mode='NONE', s3_locks_retention_period='', s3_unverified_lookup=False, s3_versioning=False, select_for_live_monitoring=False, share='', share_acl=Bunch(acl=[], enabled=False), sync='SYNCED', sync_time='2024-05-28T13:00:20.255275Z', tenant_id=1, tenant_name='default', title='/manila/manila-fa81edfd-59ee-49f5-8dbe-094d49593280', url='https://127.0.0.1:40443/api/views/42/')] May 28 13:00:23 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f4706723-1f7b-4c2e-af13-5731a7d30ebc tempest-ShareTransferNegativeTest-884271560 None] --- [GET] https://127.0.0.1:40443/api/views/: Done May 28 13:00:23 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f4706723-1f7b-4c2e-af13-5731a7d30ebc tempest-ShareTransferNegativeTest-884271560 None] >>> [DELETE] https://127.0.0.1:40443/api/views/42/ May 28 13:00:23 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-918ac0c2-3384-42e2-85df-a123f30272d1 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] GET http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/shares/510f7bcd-a0ee-49a6-8093-2640036f2ca3 May 28 13:00:23 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-918ac0c2-3384-42e2-85df-a123f30272d1 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:23 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-918ac0c2-3384-42e2-85df-a123f30272d1 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:23 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-918ac0c2-3384-42e2-85df-a123f30272d1 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/shares/510f7bcd-a0ee-49a6-8093-2640036f2ca3 returned with HTTP 200 May 28 13:00:23 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 906/1786] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:00:23 2024] GET /share/v2/a4f3887fa28c457390f5b66615564430/shares/510f7bcd-a0ee-49a6-8093-2640036f2ca3 => generated 1315 bytes in 29 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:00:23 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-fb4afaea-b258-496e-8343-96602644b4fd tempest-ShareRulesTest-1530341375 None] <<< [DELETE] https://127.0.0.1:40443/api/viewpolicies/40/ May 28 13:00:23 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-fb4afaea-b258-496e-8343-96602644b4fd tempest-ShareRulesTest-1530341375 None] --- [DELETE] https://127.0.0.1:40443/api/viewpolicies/40/: Done May 28 13:00:23 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8607af16-e418-4e23-b92d-484e0ba8ad4b tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] <<< [DELETE] https://127.0.0.1:40443/api/viewpolicies/32/ May 28 13:00:23 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8607af16-e418-4e23-b92d-484e0ba8ad4b tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] --- [DELETE] https://127.0.0.1:40443/api/viewpolicies/32/: Done May 28 13:00:24 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-fb4afaea-b258-496e-8343-96602644b4fd tempest-ShareRulesTest-1530341375 None] Created reservations ['be7a7656-cdc4-49f7-a6ef-4be7030db355', '6b89ebb9-2d79-4f05-a610-7de50e2624de', '3cacc502-d93b-433c-93ad-87ff9db907fe', '1e198b66-4849-447f-8909-a0afbc23338b'] {{(pid=98474) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 13:00:24 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-fb4afaea-b258-496e-8343-96602644b4fd tempest-ShareRulesTest-1530341375 None] Committed reservations ['be7a7656-cdc4-49f7-a6ef-4be7030db355', '6b89ebb9-2d79-4f05-a610-7de50e2624de', '3cacc502-d93b-433c-93ad-87ff9db907fe', '1e198b66-4849-447f-8909-a0afbc23338b'] {{(pid=98474) commit /opt/stack/manila/manila/quota.py:1063}} May 28 13:00:24 l75lg1-v1 manila-share[98474]: INFO manila.share.manager [None req-fb4afaea-b258-496e-8343-96602644b4fd tempest-ShareRulesTest-1530341375 None] Share instance ee46a1d1-f743-461e-8bb5-467ee0e99edd: deleted successfully. May 28 13:00:24 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-8607af16-e418-4e23-b92d-484e0ba8ad4b tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Created reservations ['d7045636-2487-445f-a9e7-7cc5dff39127', '3dc855df-8ba3-4350-b8a6-49dbed7d1c35', '0a3d5670-6963-4293-a2ca-f9d21d7ed74d', 'f56cc3c6-3c1a-4392-a231-9d28d437f852'] {{(pid=98474) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 13:00:24 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-8607af16-e418-4e23-b92d-484e0ba8ad4b tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Committed reservations ['d7045636-2487-445f-a9e7-7cc5dff39127', '3dc855df-8ba3-4350-b8a6-49dbed7d1c35', '0a3d5670-6963-4293-a2ca-f9d21d7ed74d', 'f56cc3c6-3c1a-4392-a231-9d28d437f852'] {{(pid=98474) commit /opt/stack/manila/manila/quota.py:1063}} May 28 13:00:24 l75lg1-v1 manila-share[98474]: INFO manila.share.manager [None req-8607af16-e418-4e23-b92d-484e0ba8ad4b tempest-ShareIpRulesForNFSNegativeTest-1514344441 None] Share instance 7fdd602c-79d0-479c-95a2-336b202c6639: deleted successfully. May 28 13:00:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "_check_child_processes" by "neutron.agent.linux.external_process.ProcessMonitor._check_child_processes" {{(pid=76818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:00:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_concurrency.lockutils [-] Lock "_check_child_processes" acquired by "neutron.agent.linux.external_process.ProcessMonitor._check_child_processes" :: waited 0.001s {{(pid=76818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:00:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_concurrency.lockutils [-] Lock "_check_child_processes" "released" by "neutron.agent.linux.external_process.ProcessMonitor._check_child_processes" :: held 0.001s {{(pid=76818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:00:24 l75lg1-v1 dstat.sh[49771]: 28-05 13:00:24| 3 1 93 3 0|5685M 1767M 278M 7894M| 15k 778B| 0 1292k| 0 170 |3066 5018 |1.20 1.09 1.02|1.0 0 0| 0 0 | 0 2048M| 29 361 0 37 2 May 28 13:00:25 l75lg1-v1 dstat.sh[49771]: 28-05 13:00:25| 1 0 98 1 0|5685M 1767M 278M 7894M| 18k 0 | 0 681k| 0 54.0 |1944 3051 |1.20 1.09 1.02|1.0 1.0 0| 0 0 | 0 2048M| 29 361 0 37 2 May 28 13:00:25 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-4bb4f16f-f0d7-41c9-9f58-b1aba82ca5ca tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] GET http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4 May 28 13:00:25 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-4bb4f16f-f0d7-41c9-9f58-b1aba82ca5ca tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:25 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-4bb4f16f-f0d7-41c9-9f58-b1aba82ca5ca tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:25 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-4bb4f16f-f0d7-41c9-9f58-b1aba82ca5ca tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] HTTP exception thrown: The resource could not be found. May 28 13:00:25 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-4bb4f16f-f0d7-41c9-9f58-b1aba82ca5ca tempest-ShareIpRulesForNFSNegativeTest-1514344441 tempest-ShareIpRulesForNFSNegativeTest-1514344441-project-member] http://10.27.203.238/share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4 returned with HTTP 404 May 28 13:00:25 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 881/1787] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:00:25 2024] GET /share/v2/7890e9d8a78c49a0bb9af26ec5dd4646/shares/72db8769-ece7-42ff-af27-2e778292a9b4 => generated 78 bytes in 11 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 13:00:25 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-39cc9b00-fd2e-46c4-9343-f378d024072a tempest-ShareIpRulesForNFSNegativeTest-700172924 tempest-ShareIpRulesForNFSNegativeTest-700172924-project-admin] DELETE http://10.27.203.238/share/v2/8f81d1d8d7c946e8aa46d6e3e510424c/types/5037523b-c9cb-479e-b3dc-93d142b602f8 May 28 13:00:25 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-39cc9b00-fd2e-46c4-9343-f378d024072a tempest-ShareIpRulesForNFSNegativeTest-700172924 tempest-ShareIpRulesForNFSNegativeTest-700172924-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:25 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-39cc9b00-fd2e-46c4-9343-f378d024072a tempest-ShareIpRulesForNFSNegativeTest-700172924 tempest-ShareIpRulesForNFSNegativeTest-700172924-project-admin] Calling method 'ShareTypesController._delete' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:25 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-39cc9b00-fd2e-46c4-9343-f378d024072a tempest-ShareIpRulesForNFSNegativeTest-700172924 tempest-ShareIpRulesForNFSNegativeTest-700172924-project-admin] http://10.27.203.238/share/v2/8f81d1d8d7c946e8aa46d6e3e510424c/types/5037523b-c9cb-479e-b3dc-93d142b602f8 returned with HTTP 202 May 28 13:00:25 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 907/1788] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:00:25 2024] DELETE /share/v2/8f81d1d8d7c946e8aa46d6e3e510424c/types/5037523b-c9cb-479e-b3dc-93d142b602f8 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 13:00:25 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-4e3bd111-dd2a-47f3-8e3e-5499fb945586 tempest-ShareIpRulesForNFSNegativeTest-700172924 tempest-ShareIpRulesForNFSNegativeTest-700172924-project-admin] GET http://10.27.203.238/share/v2/8f81d1d8d7c946e8aa46d6e3e510424c/types/5037523b-c9cb-479e-b3dc-93d142b602f8 May 28 13:00:25 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-4e3bd111-dd2a-47f3-8e3e-5499fb945586 tempest-ShareIpRulesForNFSNegativeTest-700172924 tempest-ShareIpRulesForNFSNegativeTest-700172924-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:25 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-4e3bd111-dd2a-47f3-8e3e-5499fb945586 tempest-ShareIpRulesForNFSNegativeTest-700172924 tempest-ShareIpRulesForNFSNegativeTest-700172924-project-admin] Calling method 'ShareTypesController.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:25 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-4e3bd111-dd2a-47f3-8e3e-5499fb945586 tempest-ShareIpRulesForNFSNegativeTest-700172924 tempest-ShareIpRulesForNFSNegativeTest-700172924-project-admin] HTTP exception thrown: Share type not found. May 28 13:00:25 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-4e3bd111-dd2a-47f3-8e3e-5499fb945586 tempest-ShareIpRulesForNFSNegativeTest-700172924 tempest-ShareIpRulesForNFSNegativeTest-700172924-project-admin] http://10.27.203.238/share/v2/8f81d1d8d7c946e8aa46d6e3e510424c/types/5037523b-c9cb-479e-b3dc-93d142b602f8 returned with HTTP 404 May 28 13:00:25 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 882/1789] 10.27.203.238 () {64 vars in 1448 bytes} [Tue May 28 13:00:25 2024] GET /share/v2/8f81d1d8d7c946e8aa46d6e3e510424c/types/5037523b-c9cb-479e-b3dc-93d142b602f8 => generated 67 bytes in 10 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 13:00:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88b68ad-b110-453d-8220-23764ed31b63 tempest-ShareTransferNegativeTest-1910579163 tempest-ShareTransferNegativeTest-1910579163-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-b88b68ad-b110-453d-8220-23764ed31b63 tempest-ShareTransferNegativeTest-1910579163 tempest-ShareTransferNegativeTest-1910579163-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:00:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88b68ad-b110-453d-8220-23764ed31b63 tempest-ShareTransferNegativeTest-1910579163 tempest-ShareTransferNegativeTest-1910579163-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf204509-1294-4d9f-b276-c4cff5ca69fc None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf204509-1294-4d9f-b276-c4cff5ca69fc None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf204509-1294-4d9f-b276-c4cff5ca69fc None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf204509-1294-4d9f-b276-c4cff5ca69fc None admin] PATH_INFO: `/v3/users/e65e0f7c2ec4409e8ee189360165f84e` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf204509-1294-4d9f-b276-c4cff5ca69fc None admin] RBAC: Authorizing `identity:delete_user(user_id=e65e0f7c2ec4409e8ee189360165f84e)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf204509-1294-4d9f-b276-c4cff5ca69fc None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-bf204509-1294-4d9f-b276-c4cff5ca69fc None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e65e0f7c2ec4409e8ee189360165f84e', 'request_id': 'req-bf204509-1294-4d9f-b276-c4cff5ca69fc'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-bf204509-1294-4d9f-b276-c4cff5ca69fc None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e65e0f7c2ec4409e8ee189360165f84e', 'request_id': 'req-bf204509-1294-4d9f-b276-c4cff5ca69fc'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-bf204509-1294-4d9f-b276-c4cff5ca69fc None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e65e0f7c2ec4409e8ee189360165f84e', 'request_id': 'req-bf204509-1294-4d9f-b276-c4cff5ca69fc'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-bf204509-1294-4d9f-b276-c4cff5ca69fc None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e65e0f7c2ec4409e8ee189360165f84e', 'request_id': 'req-bf204509-1294-4d9f-b276-c4cff5ca69fc'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-bf204509-1294-4d9f-b276-c4cff5ca69fc None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e65e0f7c2ec4409e8ee189360165f84e', 'request_id': 'req-bf204509-1294-4d9f-b276-c4cff5ca69fc'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:25 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-629429de-c8f9-4abc-9cff-380f9099658d tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] GET http://10.27.203.238/share/v2/cac556dc39a14bbdbdbabfc80672fb1f/shares/a6923a53-b5dd-4f5b-803b-5f00144de747 May 28 13:00:25 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-629429de-c8f9-4abc-9cff-380f9099658d tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:25 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-629429de-c8f9-4abc-9cff-380f9099658d tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:25 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1372/2772] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 13:00:25 2024] DELETE /identity/v3/users/e65e0f7c2ec4409e8ee189360165f84e => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:00:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231b7f98-b91e-4ee1-aedf-a1404fbb81f8 tempest-ShareTransferNegativeTest-1910579163 tempest-ShareTransferNegativeTest-1910579163-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231b7f98-b91e-4ee1-aedf-a1404fbb81f8 tempest-ShareTransferNegativeTest-1910579163 tempest-ShareTransferNegativeTest-1910579163-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:25 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-629429de-c8f9-4abc-9cff-380f9099658d tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] http://10.27.203.238/share/v2/cac556dc39a14bbdbdbabfc80672fb1f/shares/a6923a53-b5dd-4f5b-803b-5f00144de747 returned with HTTP 200 May 28 13:00:25 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 908/1790] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:00:25 2024] GET /share/v2/cac556dc39a14bbdbdbabfc80672fb1f/shares/a6923a53-b5dd-4f5b-803b-5f00144de747 => generated 1314 bytes in 29 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:00:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7859f3d-8ac3-4500-b713-ff1141478d32 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7859f3d-8ac3-4500-b713-ff1141478d32 None admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7859f3d-8ac3-4500-b713-ff1141478d32 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7859f3d-8ac3-4500-b713-ff1141478d32 None admin] PATH_INFO: `/v3/users/3e48f2d8cc2748adbed1aedb6a5f8093` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7859f3d-8ac3-4500-b713-ff1141478d32 None admin] RBAC: Authorizing `identity:delete_user(user_id=3e48f2d8cc2748adbed1aedb6a5f8093)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7859f3d-8ac3-4500-b713-ff1141478d32 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:25 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f4706723-1f7b-4c2e-af13-5731a7d30ebc tempest-ShareTransferNegativeTest-884271560 None] <<< [DELETE] https://127.0.0.1:40443/api/views/42/ May 28 13:00:25 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f4706723-1f7b-4c2e-af13-5731a7d30ebc tempest-ShareTransferNegativeTest-884271560 None] --- [DELETE] https://127.0.0.1:40443/api/views/42/: Done May 28 13:00:25 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f4706723-1f7b-4c2e-af13-5731a7d30ebc tempest-ShareTransferNegativeTest-884271560 None] >>> [GET] https://127.0.0.1:40443/api/quotas/ May 28 13:00:25 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f4706723-1f7b-4c2e-af13-5731a7d30ebc tempest-ShareTransferNegativeTest-884271560 None] {'allow_redirects': True, May 28 13:00:25 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f4706723-1f7b-4c2e-af13-5731a7d30ebc tempest-ShareTransferNegativeTest-884271560 None] 'params': {'name': 'fa81edfd-59ee-49f5-8dbe-094d49593280'}} May 28 13:00:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-e7859f3d-8ac3-4500-b713-ff1141478d32 None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e48f2d8cc2748adbed1aedb6a5f8093', 'request_id': 'req-e7859f3d-8ac3-4500-b713-ff1141478d32'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-e7859f3d-8ac3-4500-b713-ff1141478d32 None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e48f2d8cc2748adbed1aedb6a5f8093', 'request_id': 'req-e7859f3d-8ac3-4500-b713-ff1141478d32'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-e7859f3d-8ac3-4500-b713-ff1141478d32 None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e48f2d8cc2748adbed1aedb6a5f8093', 'request_id': 'req-e7859f3d-8ac3-4500-b713-ff1141478d32'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-e7859f3d-8ac3-4500-b713-ff1141478d32 None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e48f2d8cc2748adbed1aedb6a5f8093', 'request_id': 'req-e7859f3d-8ac3-4500-b713-ff1141478d32'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-e7859f3d-8ac3-4500-b713-ff1141478d32 None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e48f2d8cc2748adbed1aedb6a5f8093', 'request_id': 'req-e7859f3d-8ac3-4500-b713-ff1141478d32'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:25 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1401/2773] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 13:00:25 2024] DELETE /identity/v3/users/3e48f2d8cc2748adbed1aedb6a5f8093 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:00:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf204509-1294-4d9f-b276-c4cff5ca69fc None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-bf204509-1294-4d9f-b276-c4cff5ca69fc None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:00:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf204509-1294-4d9f-b276-c4cff5ca69fc None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:25 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_service.periodic_task [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85846) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 13:00:25 l75lg1-v1 cinder-volume[85846]: DEBUG cinder.volume.drivers.lvm [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] Updating volume stats {{(pid=85846) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}} May 28 13:00:25 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:390}} May 28 13:00:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7ba3c3-82f5-4c36-b3f3-fafe4c5500bb None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7ba3c3-82f5-4c36-b3f3-fafe4c5500bb None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7ba3c3-82f5-4c36-b3f3-fafe4c5500bb None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7ba3c3-82f5-4c36-b3f3-fafe4c5500bb None admin] PATH_INFO: `/v3/users/7640802a4c39457089742b080e6c98b9` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7ba3c3-82f5-4c36-b3f3-fafe4c5500bb None admin] RBAC: Authorizing `identity:delete_user(user_id=7640802a4c39457089742b080e6c98b9)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7ba3c3-82f5-4c36-b3f3-fafe4c5500bb None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:25 l75lg1-v1 sudo[99024]: vastdata : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 May 28 13:00:25 l75lg1-v1 sudo[99024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) May 28 13:00:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-9e7ba3c3-82f5-4c36-b3f3-fafe4c5500bb None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7640802a4c39457089742b080e6c98b9', 'request_id': 'req-9e7ba3c3-82f5-4c36-b3f3-fafe4c5500bb'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-9e7ba3c3-82f5-4c36-b3f3-fafe4c5500bb None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7640802a4c39457089742b080e6c98b9', 'request_id': 'req-9e7ba3c3-82f5-4c36-b3f3-fafe4c5500bb'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-9e7ba3c3-82f5-4c36-b3f3-fafe4c5500bb None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7640802a4c39457089742b080e6c98b9', 'request_id': 'req-9e7ba3c3-82f5-4c36-b3f3-fafe4c5500bb'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-9e7ba3c3-82f5-4c36-b3f3-fafe4c5500bb None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7640802a4c39457089742b080e6c98b9', 'request_id': 'req-9e7ba3c3-82f5-4c36-b3f3-fafe4c5500bb'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-9e7ba3c3-82f5-4c36-b3f3-fafe4c5500bb None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7640802a4c39457089742b080e6c98b9', 'request_id': 'req-9e7ba3c3-82f5-4c36-b3f3-fafe4c5500bb'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:25 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1373/2774] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 13:00:25 2024] DELETE /identity/v3/users/7640802a4c39457089742b080e6c98b9 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:00:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7b2265-1a10-4bf6-9c29-1b499c78a34d None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7b2265-1a10-4bf6-9c29-1b499c78a34d None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7b2265-1a10-4bf6-9c29-1b499c78a34d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:25 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-7d7b2265-1a10-4bf6-9c29-1b499c78a34d None None] Truncating password to algorithm specific maximum length 72 characters. May 28 13:00:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-7d7b2265-1a10-4bf6-9c29-1b499c78a34d None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 13:00:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-7d7b2265-1a10-4bf6-9c29-1b499c78a34d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:00:25 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1402/2775] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 13:00:25 2024] POST /identity/v3/auth/tokens => generated 2960 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 13:00:25 l75lg1-v1 neutron-server[77619]: DEBUG neutron.wsgi [-] (77619) accepted ('10.27.203.238', 40442) {{(pid=77619) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 13:00:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7ba3c3-82f5-4c36-b3f3-fafe4c5500bb None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-9e7ba3c3-82f5-4c36-b3f3-fafe4c5500bb None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:00:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7ba3c3-82f5-4c36-b3f3-fafe4c5500bb None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c8db11-4343-49f0-ab0f-530f74eff583 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef17047035e4b518fd5360a01f2da1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c8db11-4343-49f0-ab0f-530f74eff583 service neutron] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c8db11-4343-49f0-ab0f-530f74eff583 service neutron] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c8db11-4343-49f0-ab0f-530f74eff583 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c8db11-4343-49f0-ab0f-530f74eff583 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c8db11-4343-49f0-ab0f-530f74eff583 service neutron] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:25 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1374/2776] 10.27.203.238 () {64 vars in 1432 bytes} [Tue May 28 13:00:25 2024] GET /identity/v3/auth/tokens => generated 2960 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 28 13:00:25 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-ab6e933d-4623-4536-9589-0a999a8eea0e tempest-UserMessageNegativeTest-781603078 tempest-UserMessageNegativeTest-781603078-project-member] GET http://10.27.203.238/share/v2/ca9b4c5f200844bdbcc6db13e907f21e/shares/a94015c0-bde2-41e5-8a32-24098a0bf251 May 28 13:00:25 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-ab6e933d-4623-4536-9589-0a999a8eea0e tempest-UserMessageNegativeTest-781603078 tempest-UserMessageNegativeTest-781603078-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:25 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-ab6e933d-4623-4536-9589-0a999a8eea0e tempest-UserMessageNegativeTest-781603078 tempest-UserMessageNegativeTest-781603078-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:25 l75lg1-v1 neutron-server[77619]: INFO neutron.wsgi [None req-a662bcbd-26fa-45e6-806f-77dbcb330982 None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=211270827a6144e49c856696ee8f6eba&name=default HTTP/1.1" status: 200 len: 216 time: 0.0790553 May 28 13:00:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7b2265-1a10-4bf6-9c29-1b499c78a34d None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-7d7b2265-1a10-4bf6-9c29-1b499c78a34d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:00:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7b2265-1a10-4bf6-9c29-1b499c78a34d None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:25 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-ab6e933d-4623-4536-9589-0a999a8eea0e tempest-UserMessageNegativeTest-781603078 tempest-UserMessageNegativeTest-781603078-project-member] http://10.27.203.238/share/v2/ca9b4c5f200844bdbcc6db13e907f21e/shares/a94015c0-bde2-41e5-8a32-24098a0bf251 returned with HTTP 200 May 28 13:00:25 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 883/1791] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:00:25 2024] GET /share/v2/ca9b4c5f200844bdbcc6db13e907f21e/shares/a94015c0-bde2-41e5-8a32-24098a0bf251 => generated 1330 bytes in 26 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:00:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cee909-b027-4df4-9bb0-682502c3b7eb None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cee909-b027-4df4-9bb0-682502c3b7eb None admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cee909-b027-4df4-9bb0-682502c3b7eb None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cee909-b027-4df4-9bb0-682502c3b7eb None admin] PATH_INFO: `/v3/projects/211270827a6144e49c856696ee8f6eba` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cee909-b027-4df4-9bb0-682502c3b7eb None admin] RBAC: Authorizing `identity:delete_project(project_id=211270827a6144e49c856696ee8f6eba)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cee909-b027-4df4-9bb0-682502c3b7eb None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:26 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f4706723-1f7b-4c2e-af13-5731a7d30ebc tempest-ShareTransferNegativeTest-884271560 None] <<< [GET] https://127.0.0.1:40443/api/quotas/ May 28 13:00:26 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f4706723-1f7b-4c2e-af13-5731a7d30ebc tempest-ShareTransferNegativeTest-884271560 None] [Bunch(cluster='loop75-kfs', cluster_id=1, default_email=None, default_group_quota=None, default_user_quota=None, enable_alarms=True, enable_email_providers=True, grace_period=None, guid='c00d9075-e49f-41ab-babb-3f8f05469f28', hard_limit=1073741824, hard_limit_inodes=None, id=40, internal=False, is_user_quota=False, last_user_quotas_update=None, name='fa81edfd-59ee-49f5-8dbe-094d49593280', num_blocked_users=0, num_exceeded_users=0, path='/manila/manila-fa81edfd-59ee-49f5-8dbe-094d49593280', percent_capacity=0, percent_inodes=None, pretty_grace_period=None, pretty_grace_period_expiration=None, pretty_state='OK (CREATED)', soft_limit=None, soft_limit_inodes=None, state='OK', sync_state='CREATED', system_id=40, tenant_id=1, tenant_name='default', time_to_block=None, title='fa81edfd-59ee-49f5-8dbe-094d49593280', url='https://127.0.0.1:40443/api/quotas/40/', used_capacity=0, used_capacity_tb=0.0, used_effective_capacity=0, used_effective_capacity_tb=0.0, used_inodes=0, used_limited_capacity=0)] May 28 13:00:26 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f4706723-1f7b-4c2e-af13-5731a7d30ebc tempest-ShareTransferNegativeTest-884271560 None] --- [GET] https://127.0.0.1:40443/api/quotas/: Done May 28 13:00:26 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f4706723-1f7b-4c2e-af13-5731a7d30ebc tempest-ShareTransferNegativeTest-884271560 None] >>> [DELETE] https://127.0.0.1:40443/api/quotas/40/ May 28 13:00:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-a3cee909-b027-4df4-9bb0-682502c3b7eb None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '211270827a6144e49c856696ee8f6eba', 'request_id': 'req-a3cee909-b027-4df4-9bb0-682502c3b7eb'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-a3cee909-b027-4df4-9bb0-682502c3b7eb None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '211270827a6144e49c856696ee8f6eba', 'request_id': 'req-a3cee909-b027-4df4-9bb0-682502c3b7eb'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-a3cee909-b027-4df4-9bb0-682502c3b7eb None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '211270827a6144e49c856696ee8f6eba', 'request_id': 'req-a3cee909-b027-4df4-9bb0-682502c3b7eb'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-a3cee909-b027-4df4-9bb0-682502c3b7eb None admin] The token cache is being invalidate because project 211270827a6144e49c856696ee8f6eba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 13:00:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-a3cee909-b027-4df4-9bb0-682502c3b7eb None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-a3cee909-b027-4df4-9bb0-682502c3b7eb None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:26 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1403/2777] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 13:00:25 2024] DELETE /identity/v3/projects/211270827a6144e49c856696ee8f6eba => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:00:26 l75lg1-v1 neutron-server[77619]: DEBUG neutron.wsgi [-] (77619) accepted ('10.27.203.238', 40448) {{(pid=77619) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 13:00:26 l75lg1-v1 neutron-server[77619]: INFO neutron.wsgi [None req-5e51ab41-940e-43ab-9213-295c15a42907 None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=7890e9d8a78c49a0bb9af26ec5dd4646&name=default HTTP/1.1" status: 200 len: 216 time: 0.0081654 May 28 13:00:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c8db11-4343-49f0-ab0f-530f74eff583 service neutron] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c8db11-4343-49f0-ab0f-530f74eff583 service neutron] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dd8360-c115-4f68-9456-d07a839ed588 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dd8360-c115-4f68-9456-d07a839ed588 None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dd8360-c115-4f68-9456-d07a839ed588 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dd8360-c115-4f68-9456-d07a839ed588 None admin] PATH_INFO: `/v3/projects/7890e9d8a78c49a0bb9af26ec5dd4646` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dd8360-c115-4f68-9456-d07a839ed588 None admin] RBAC: Authorizing `identity:delete_project(project_id=7890e9d8a78c49a0bb9af26ec5dd4646)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dd8360-c115-4f68-9456-d07a839ed588 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-e6dd8360-c115-4f68-9456-d07a839ed588 None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7890e9d8a78c49a0bb9af26ec5dd4646', 'request_id': 'req-e6dd8360-c115-4f68-9456-d07a839ed588'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-e6dd8360-c115-4f68-9456-d07a839ed588 None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7890e9d8a78c49a0bb9af26ec5dd4646', 'request_id': 'req-e6dd8360-c115-4f68-9456-d07a839ed588'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-e6dd8360-c115-4f68-9456-d07a839ed588 None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7890e9d8a78c49a0bb9af26ec5dd4646', 'request_id': 'req-e6dd8360-c115-4f68-9456-d07a839ed588'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-e6dd8360-c115-4f68-9456-d07a839ed588 None admin] The token cache is being invalidate because project 7890e9d8a78c49a0bb9af26ec5dd4646 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 13:00:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-e6dd8360-c115-4f68-9456-d07a839ed588 None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-e6dd8360-c115-4f68-9456-d07a839ed588 None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:26 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1375/2778] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 13:00:26 2024] DELETE /identity/v3/projects/7890e9d8a78c49a0bb9af26ec5dd4646 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:00:26 l75lg1-v1 neutron-server[77618]: DEBUG neutron.wsgi [-] (77618) accepted ('10.27.203.238', 40462) {{(pid=77618) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 13:00:26 l75lg1-v1 neutron-server[77618]: INFO neutron.wsgi [None req-e112dd9d-558f-4889-9c17-af9080acf57d None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=8f81d1d8d7c946e8aa46d6e3e510424c&name=default HTTP/1.1" status: 200 len: 216 time: 0.0084217 May 28 13:00:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cee909-b027-4df4-9bb0-682502c3b7eb None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-a3cee909-b027-4df4-9bb0-682502c3b7eb None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:00:26 l75lg1-v1 sudo[99024]: pam_unix(sudo:session): session closed for user root May 28 13:00:26 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.474s {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:428}} May 28 13:00:26 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:390}} May 28 13:00:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cee909-b027-4df4-9bb0-682502c3b7eb None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:26 l75lg1-v1 sudo[99027]: vastdata : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 May 28 13:00:26 l75lg1-v1 sudo[99027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) May 28 13:00:26 l75lg1-v1 dstat.sh[49771]: 28-05 13:00:26| 12 2 82 3 0|5688M 1764M 278M 7894M| 15k 1562B| 256k 2012k|2.00 267 |6799 11k|1.20 1.09 1.02|2.0 1.0 5.0| 0 0 | 0 2048M| 29 362 0 41 2 May 28 13:00:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ea2d2f-231b-4bfa-bc29-6319c5b446ea None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ea2d2f-231b-4bfa-bc29-6319c5b446ea None admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ea2d2f-231b-4bfa-bc29-6319c5b446ea None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ea2d2f-231b-4bfa-bc29-6319c5b446ea None admin] PATH_INFO: `/v3/projects/8f81d1d8d7c946e8aa46d6e3e510424c` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ea2d2f-231b-4bfa-bc29-6319c5b446ea None admin] RBAC: Authorizing `identity:delete_project(project_id=8f81d1d8d7c946e8aa46d6e3e510424c)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ea2d2f-231b-4bfa-bc29-6319c5b446ea None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-84ea2d2f-231b-4bfa-bc29-6319c5b446ea None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f81d1d8d7c946e8aa46d6e3e510424c', 'request_id': 'req-84ea2d2f-231b-4bfa-bc29-6319c5b446ea'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-84ea2d2f-231b-4bfa-bc29-6319c5b446ea None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f81d1d8d7c946e8aa46d6e3e510424c', 'request_id': 'req-84ea2d2f-231b-4bfa-bc29-6319c5b446ea'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-84ea2d2f-231b-4bfa-bc29-6319c5b446ea None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f81d1d8d7c946e8aa46d6e3e510424c', 'request_id': 'req-84ea2d2f-231b-4bfa-bc29-6319c5b446ea'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-84ea2d2f-231b-4bfa-bc29-6319c5b446ea None admin] The token cache is being invalidate because project 8f81d1d8d7c946e8aa46d6e3e510424c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 13:00:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-84ea2d2f-231b-4bfa-bc29-6319c5b446ea None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-84ea2d2f-231b-4bfa-bc29-6319c5b446ea None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:26 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1404/2779] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 13:00:26 2024] DELETE /identity/v3/projects/8f81d1d8d7c946e8aa46d6e3e510424c => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:00:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d230f941-2d7b-45ab-ad0f-983d0d6a6dce None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d230f941-2d7b-45ab-ad0f-983d0d6a6dce None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d230f941-2d7b-45ab-ad0f-983d0d6a6dce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:26 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-d230f941-2d7b-45ab-ad0f-983d0d6a6dce None None] Truncating password to algorithm specific maximum length 72 characters. May 28 13:00:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-d230f941-2d7b-45ab-ad0f-983d0d6a6dce None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 13:00:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-d230f941-2d7b-45ab-ad0f-983d0d6a6dce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:00:26 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1376/2780] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 13:00:26 2024] POST /identity/v3/auth/tokens => generated 312 bytes in 20 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 28 13:00:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f11dd7a-68eb-4aa9-bbf4-fe8640db4535 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f11dd7a-68eb-4aa9-bbf4-fe8640db4535 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f11dd7a-68eb-4aa9-bbf4-fe8640db4535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:26 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-9f11dd7a-68eb-4aa9-bbf4-fe8640db4535 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 13:00:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-9f11dd7a-68eb-4aa9-bbf4-fe8640db4535 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 13:00:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-9f11dd7a-68eb-4aa9-bbf4-fe8640db4535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:00:26 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1405/2781] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 13:00:26 2024] POST /identity/v3/auth/tokens => generated 2960 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 13:00:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d230f941-2d7b-45ab-ad0f-983d0d6a6dce None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d230f941-2d7b-45ab-ad0f-983d0d6a6dce None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19257b7d-9659-4911-80df-6db67bbbb1da None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19257b7d-9659-4911-80df-6db67bbbb1da None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19257b7d-9659-4911-80df-6db67bbbb1da None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19257b7d-9659-4911-80df-6db67bbbb1da None admin] PATH_INFO: `/v3/domains` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19257b7d-9659-4911-80df-6db67bbbb1da None admin] RBAC: Adding query filter params (name=Default) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 13:00:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19257b7d-9659-4911-80df-6db67bbbb1da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19257b7d-9659-4911-80df-6db67bbbb1da None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:26 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1377/2782] 10.27.203.238 () {62 vars in 1220 bytes} [Tue May 28 13:00:26 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 13:00:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f11dd7a-68eb-4aa9-bbf4-fe8640db4535 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f11dd7a-68eb-4aa9-bbf4-fe8640db4535 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b4d470-8ca9-4724-9bc1-1869b9fe88a2 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b4d470-8ca9-4724-9bc1-1869b9fe88a2 None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b4d470-8ca9-4724-9bc1-1869b9fe88a2 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b4d470-8ca9-4724-9bc1-1869b9fe88a2 None admin] PATH_INFO: `/v3/projects` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b4d470-8ca9-4724-9bc1-1869b9fe88a2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b4d470-8ca9-4724-9bc1-1869b9fe88a2 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:26 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1406/2783] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 13:00:26 2024] POST /identity/v3/projects => generated 405 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 13:00:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19257b7d-9659-4911-80df-6db67bbbb1da None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19257b7d-9659-4911-80df-6db67bbbb1da None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216d7e6d-dedc-4679-a97a-b31062e69f47 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216d7e6d-dedc-4679-a97a-b31062e69f47 None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216d7e6d-dedc-4679-a97a-b31062e69f47 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216d7e6d-dedc-4679-a97a-b31062e69f47 None admin] PATH_INFO: `/v3/users` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216d7e6d-dedc-4679-a97a-b31062e69f47 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216d7e6d-dedc-4679-a97a-b31062e69f47 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:26 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-216d7e6d-dedc-4679-a97a-b31062e69f47 None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 13:00:26 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1378/2784] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 13:00:26 2024] POST /identity/v3/users => generated 311 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 13:00:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b4d470-8ca9-4724-9bc1-1869b9fe88a2 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b4d470-8ca9-4724-9bc1-1869b9fe88a2 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c5682a-221d-4f86-8394-48a7ffc05b5f None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c5682a-221d-4f86-8394-48a7ffc05b5f None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c5682a-221d-4f86-8394-48a7ffc05b5f None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c5682a-221d-4f86-8394-48a7ffc05b5f None admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c5682a-221d-4f86-8394-48a7ffc05b5f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c5682a-221d-4f86-8394-48a7ffc05b5f None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:26 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1407/2785] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 13:00:26 2024] GET /identity/v3/roles => generated 1680 bytes in 17 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 13:00:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216d7e6d-dedc-4679-a97a-b31062e69f47 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216d7e6d-dedc-4679-a97a-b31062e69f47 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0a2632-6027-4073-89d9-45fadab64c9e None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0a2632-6027-4073-89d9-45fadab64c9e None admin] REQUEST_METHOD: `PUT` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0a2632-6027-4073-89d9-45fadab64c9e None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0a2632-6027-4073-89d9-45fadab64c9e None admin] PATH_INFO: `/v3/projects/10f017758f4e4b5381145aa958076664/users/ebfada476d7b46d79b951c998c816040/roles/44620cad10ae407c90c91e2c296adb04` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0a2632-6027-4073-89d9-45fadab64c9e None admin] RBAC: Authorizing `identity:create_grant(project_id=10f017758f4e4b5381145aa958076664, user_id=ebfada476d7b46d79b951c998c816040, role_id=44620cad10ae407c90c91e2c296adb04)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0a2632-6027-4073-89d9-45fadab64c9e None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:26 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1379/2786] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 13:00:26 2024] PUT /identity/v3/projects/10f017758f4e4b5381145aa958076664/users/ebfada476d7b46d79b951c998c816040/roles/44620cad10ae407c90c91e2c296adb04 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:00:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69d0d86-9ab4-430f-b5b4-3bec999ddc15 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69d0d86-9ab4-430f-b5b4-3bec999ddc15 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69d0d86-9ab4-430f-b5b4-3bec999ddc15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:26 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-c69d0d86-9ab4-430f-b5b4-3bec999ddc15 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 13:00:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-c69d0d86-9ab4-430f-b5b4-3bec999ddc15 None None] MFA Rules not processed for user `ebfada476d7b46d79b951c998c816040`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 13:00:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-c69d0d86-9ab4-430f-b5b4-3bec999ddc15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:00:26 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1408/2787] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 13:00:26 2024] POST /identity/v3/auth/tokens => generated 3976 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 13:00:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0a2632-6027-4073-89d9-45fadab64c9e None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:26 l75lg1-v1 sudo[99027]: pam_unix(sudo:session): session closed for user root May 28 13:00:26 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.536s {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:428}} May 28 13:00:26 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-18101c92-6db6-49b5-aa8e-3ffe06c4db86 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] GET http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/shares/510f7bcd-a0ee-49a6-8093-2640036f2ca3 May 28 13:00:26 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-18101c92-6db6-49b5-aa8e-3ffe06c4db86 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:26 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-18101c92-6db6-49b5-aa8e-3ffe06c4db86 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:26 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:390}} May 28 13:00:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0a2632-6027-4073-89d9-45fadab64c9e None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:26 l75lg1-v1 devstack@m-api.service[98329]: DEBUG dbcounter [-] [98329] Writing DB stats manila:SELECT=1689,manila:INSERT=111,manila:UPDATE=188 {{(pid=98329) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:00:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0a879e-6c4d-47b2-a553-f4536c76d656 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0a879e-6c4d-47b2-a553-f4536c76d656 None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0a879e-6c4d-47b2-a553-f4536c76d656 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0a879e-6c4d-47b2-a553-f4536c76d656 None admin] PATH_INFO: `/v3/projects` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0a879e-6c4d-47b2-a553-f4536c76d656 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:26 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-18101c92-6db6-49b5-aa8e-3ffe06c4db86 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] HTTP exception thrown: The resource could not be found. May 28 13:00:26 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-18101c92-6db6-49b5-aa8e-3ffe06c4db86 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/shares/510f7bcd-a0ee-49a6-8093-2640036f2ca3 returned with HTTP 404 May 28 13:00:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0a879e-6c4d-47b2-a553-f4536c76d656 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:26 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 909/1792] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:00:26 2024] GET /share/v2/a4f3887fa28c457390f5b66615564430/shares/510f7bcd-a0ee-49a6-8093-2640036f2ca3 => generated 78 bytes in 14 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 13:00:26 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-fd8bab71-8d03-4b46-ba70-a298bb9640b7 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] POST http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/shares/510f7bcd-a0ee-49a6-8093-2640036f2ca3/action May 28 13:00:26 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-fd8bab71-8d03-4b46-ba70-a298bb9640b7 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Action body: b'{"access_list": null}' {{(pid=98330) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 13:00:26 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-fd8bab71-8d03-4b46-ba70-a298bb9640b7 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Action: 'action', calling method: ShareController.access_list, body: {"access_list": null} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:00:26 l75lg1-v1 sudo[99076]: vastdata : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool May 28 13:00:26 l75lg1-v1 sudo[99076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) May 28 13:00:26 l75lg1-v1 devstack@m-api.service[98330]: DEBUG dbcounter [-] [98330] Writing DB stats manila:SELECT=1654,manila:INSERT=167,manila:UPDATE=198 {{(pid=98330) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:00:26 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault [None req-fd8bab71-8d03-4b46-ba70-a298bb9640b7 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Caught error: Resource could not be found.: manila.exception.NotFound: Resource could not be found. May 28 13:00:26 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault Traceback (most recent call last): May 28 13:00:26 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/api/middleware/fault.py", line 76, in __call__ May 28 13:00:26 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return req.get_response(self.application) May 28 13:00:26 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/request.py", line 1313, in send May 28 13:00:26 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault status, headers, app_iter = self.call_application( May 28 13:00:26 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/request.py", line 1278, in call_application May 28 13:00:26 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault app_iter = application(self.environ, start_response) May 28 13:00:26 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 129, in __call__ May 28 13:00:26 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault resp = self.call_func(req, *args, **kw) May 28 13:00:26 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 193, in call_func May 28 13:00:26 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return self.func(req, *args, **kwargs) May 28 13:00:26 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_middleware/base.py", line 124, in __call__ May 28 13:00:26 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault response = req.get_response(self.application) May 28 13:00:26 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/request.py", line 1313, in send May 28 13:00:26 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault status, headers, app_iter = self.call_application( May 28 13:00:26 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/request.py", line 1278, in call_application May 28 13:00:26 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault app_iter = application(self.environ, start_response) May 28 13:00:26 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 143, in __call__ May 28 13:00:26 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return resp(environ, start_response) May 28 13:00:26 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 129, in __call__ May 28 13:00:26 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault resp = self.call_func(req, *args, **kw) May 28 13:00:26 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 193, in call_func May 28 13:00:26 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return self.func(req, *args, **kwargs) May 28 13:00:26 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/osprofiler/web.py", line 111, in __call__ May 28 13:00:26 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return request.get_response(self.application) May 28 13:00:26 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/request.py", line 1313, in send May 28 13:00:26 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault status, headers, app_iter = self.call_application( May 28 13:00:26 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/request.py", line 1278, in call_application May 28 13:00:26 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault app_iter = application(self.environ, start_response) May 28 13:00:26 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 129, in __call__ May 28 13:00:26 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault resp = self.call_func(req, *args, **kw) May 28 13:00:26 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 193, in call_func May 28 13:00:26 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return self.func(req, *args, **kwargs) May 28 13:00:26 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py", line 340, in __call__ May 28 13:00:26 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault response = req.get_response(self._app) May 28 13:00:26 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/request.py", line 1313, in send May 28 13:00:26 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault status, headers, app_iter = self.call_application( May 28 13:00:26 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/request.py", line 1278, in call_application May 28 13:00:26 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault app_iter = application(self.environ, start_response) May 28 13:00:26 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 143, in __call__ May 28 13:00:26 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return resp(environ, start_response) May 28 13:00:26 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 143, in __call__ May 28 13:00:26 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return resp(environ, start_response) May 28 13:00:26 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/routes/middleware.py", line 153, in __call__ May 28 13:00:26 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault response = self.app(environ, start_response) May 28 13:00:26 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 143, in __call__ May 28 13:00:26 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return resp(environ, start_response) May 28 13:00:26 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 129, in __call__ May 28 13:00:26 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault resp = self.call_func(req, *args, **kw) May 28 13:00:26 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 193, in call_func May 28 13:00:26 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return self.func(req, *args, **kwargs) May 28 13:00:26 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/api/openstack/wsgi.py", line 764, in __call__ May 28 13:00:26 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return self._process_stack(request, action, action_args, May 28 13:00:26 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/api/openstack/wsgi.py", line 829, in _process_stack May 28 13:00:26 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault action_result = self.dispatch(meth, request, action_args) May 28 13:00:26 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/api/openstack/wsgi.py", line 924, in dispatch May 28 13:00:26 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return method(req=request, **action_args) May 28 13:00:26 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/api/openstack/wsgi.py", line 1066, in version_select May 28 13:00:26 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return func.func(self, *args, **kwargs) May 28 13:00:26 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/api/v2/shares.py", line 523, in access_list May 28 13:00:26 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return self._access_list(req, id, body) May 28 13:00:26 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/api/v1/shares.py", line 667, in _access_list May 28 13:00:26 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault share = self.share_api.get(context, id) May 28 13:00:26 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/share/api.py", line 2211, in get May 28 13:00:26 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault rv = self.db.share_get(context, share_id) May 28 13:00:26 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/db/api.py", line 404, in share_get May 28 13:00:26 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return IMPL.share_get(context, share_id, **kwargs) May 28 13:00:26 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/db/sqlalchemy/api.py", line 166, in wrapper May 28 13:00:26 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return f(*args, **kwargs) May 28 13:00:26 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/enginefacade.py", line 998, in wrapper May 28 13:00:26 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return fn(*args, **kwargs) May 28 13:00:26 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/db/sqlalchemy/api.py", line 2367, in share_get May 28 13:00:26 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return _share_get(context, share_id, **kwargs) May 28 13:00:26 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/db/sqlalchemy/api.py", line 2378, in _share_get May 28 13:00:26 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault raise exception.NotFound() May 28 13:00:26 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault manila.exception.NotFound: Resource could not be found. May 28 13:00:26 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault May 28 13:00:26 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.middleware.fault [None req-fd8bab71-8d03-4b46-ba70-a298bb9640b7 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/shares/510f7bcd-a0ee-49a6-8093-2640036f2ca3/action returned with HTTP 404 May 28 13:00:26 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 884/1793] 10.27.203.238 () {66 vars in 1493 bytes} [Tue May 28 13:00:26 2024] POST /share/v2/a4f3887fa28c457390f5b66615564430/shares/510f7bcd-a0ee-49a6-8093-2640036f2ca3/action => generated 84 bytes in 15 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 13:00:26 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-5091ec63-b127-490a-ba42-6df40d830b35 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] POST http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/shares May 28 13:00:26 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-5091ec63-b127-490a-ba42-6df40d830b35 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share": {"share_proto": "nfs", "description": "Tempest's share", "snapshot_id": null, "name": "tempest-tempest-created-share-1141180252", "size": 1, "metadata": {}, "is_public": false, "share_type": "1749967d-80e1-4d76-8cac-122e8902d0cd"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:00:26 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.v1.shares [None req-5091ec63-b127-490a-ba42-6df40d830b35 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Create NFS share of 1 GB May 28 13:00:26 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1380/2788] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 13:00:26 2024] POST /identity/v3/projects => generated 405 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 13:00:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69d0d86-9ab4-430f-b5b4-3bec999ddc15 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69d0d86-9ab4-430f-b5b4-3bec999ddc15 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecb4334-c6a9-48c8-a9d2-4a22dbc32f9d None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecb4334-c6a9-48c8-a9d2-4a22dbc32f9d None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecb4334-c6a9-48c8-a9d2-4a22dbc32f9d None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecb4334-c6a9-48c8-a9d2-4a22dbc32f9d None admin] PATH_INFO: `/v3/users` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecb4334-c6a9-48c8-a9d2-4a22dbc32f9d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecb4334-c6a9-48c8-a9d2-4a22dbc32f9d None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:26 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-5ecb4334-c6a9-48c8-a9d2-4a22dbc32f9d None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 13:00:26 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1409/2789] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 13:00:26 2024] POST /identity/v3/users => generated 311 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 13:00:26 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.quota [None req-5091ec63-b127-490a-ba42-6df40d830b35 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Created reservations ['1be493f3-7046-42fb-b7f3-7356cfdf2f97', 'b900dda6-462b-4ecd-8543-283fc2a2ccea', 'a35c8d19-b513-4844-83c4-8d31294127fe', 'efe301c0-2ab4-47b2-bf38-82027cebb411'] {{(pid=98329) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 13:00:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0a879e-6c4d-47b2-a553-f4536c76d656 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0a879e-6c4d-47b2-a553-f4536c76d656 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba26add1-f730-47f5-9705-a0525781345d None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba26add1-f730-47f5-9705-a0525781345d None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba26add1-f730-47f5-9705-a0525781345d None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba26add1-f730-47f5-9705-a0525781345d None admin] PATH_INFO: `/v3/roles` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba26add1-f730-47f5-9705-a0525781345d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba26add1-f730-47f5-9705-a0525781345d None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:26 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1381/2790] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 13:00:26 2024] GET /identity/v3/roles => generated 1680 bytes in 18 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 13:00:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecb4334-c6a9-48c8-a9d2-4a22dbc32f9d None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecb4334-c6a9-48c8-a9d2-4a22dbc32f9d None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f23815f-4bfd-467c-b316-132ca31d2923 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f23815f-4bfd-467c-b316-132ca31d2923 None admin] REQUEST_METHOD: `PUT` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f23815f-4bfd-467c-b316-132ca31d2923 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f23815f-4bfd-467c-b316-132ca31d2923 None admin] PATH_INFO: `/v3/projects/9a3ff659931047a1bd9b6864af365142/users/c3921d54c31444e3bff75d02cd13f8e2/roles/44620cad10ae407c90c91e2c296adb04` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f23815f-4bfd-467c-b316-132ca31d2923 None admin] RBAC: Authorizing `identity:create_grant(project_id=9a3ff659931047a1bd9b6864af365142, user_id=c3921d54c31444e3bff75d02cd13f8e2, role_id=44620cad10ae407c90c91e2c296adb04)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f23815f-4bfd-467c-b316-132ca31d2923 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:26 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1410/2791] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 13:00:26 2024] PUT /identity/v3/projects/9a3ff659931047a1bd9b6864af365142/users/c3921d54c31444e3bff75d02cd13f8e2/roles/44620cad10ae407c90c91e2c296adb04 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:00:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5026924-9d8b-47f6-aaa3-2930bed22bc5 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5026924-9d8b-47f6-aaa3-2930bed22bc5 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5026924-9d8b-47f6-aaa3-2930bed22bc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:26 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.quota [None req-5091ec63-b127-490a-ba42-6df40d830b35 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Committed reservations ['1be493f3-7046-42fb-b7f3-7356cfdf2f97', 'b900dda6-462b-4ecd-8543-283fc2a2ccea', 'a35c8d19-b513-4844-83c4-8d31294127fe', 'efe301c0-2ab4-47b2-bf38-82027cebb411'] {{(pid=98329) commit /opt/stack/manila/manila/quota.py:1063}} May 28 13:00:26 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-b5026924-9d8b-47f6-aaa3-2930bed22bc5 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 13:00:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-b5026924-9d8b-47f6-aaa3-2930bed22bc5 None None] MFA Rules not processed for user `c3921d54c31444e3bff75d02cd13f8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 13:00:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-b5026924-9d8b-47f6-aaa3-2930bed22bc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:00:26 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1382/2792] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 13:00:26 2024] POST /identity/v3/auth/tokens => generated 3976 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f23815f-4bfd-467c-b316-132ca31d2923 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:27 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.host_manager [None req-5091ec63-b127-490a-ba42-6df40d830b35 tempest-ShareRulesTest-1530341375 None] Share service is down. (host: l75lg1-v1@generic2). May 28 13:00:27 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.host_manager [None req-5091ec63-b127-490a-ba42-6df40d830b35 tempest-ShareRulesTest-1530341375 None] Share service is down. (host: l75lg1-v1@generic1). May 28 13:00:27 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-5091ec63-b127-490a-ba42-6df40d830b35 tempest-ShareRulesTest-1530341375 None] Starting with 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:80}} May 28 13:00:27 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-5091ec63-b127-490a-ba42-6df40d830b35 tempest-ShareRulesTest-1530341375 None] Filter OnlyHostFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:00:27 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-5091ec63-b127-490a-ba42-6df40d830b35 tempest-ShareRulesTest-1530341375 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:00:27 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.capacity [None req-5091ec63-b127-490a-ba42-6df40d830b35 tempest-ShareRulesTest-1530341375 None] Space information for share creation on host l75lg1-v1@vast#vast (requested / avail): 1/2076 {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/capacity.py:83}} May 28 13:00:27 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-5091ec63-b127-490a-ba42-6df40d830b35 tempest-ShareRulesTest-1530341375 None] Filter CapacityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:00:27 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-5091ec63-b127-490a-ba42-6df40d830b35 tempest-ShareRulesTest-1530341375 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:00:27 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-5091ec63-b127-490a-ba42-6df40d830b35 tempest-ShareRulesTest-1530341375 None] Driver Filter: Checking host 'l75lg1-v1@vast#vast' {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:37}} May 28 13:00:27 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-5091ec63-b127-490a-ba42-6df40d830b35 tempest-ShareRulesTest-1530341375 None] Filter function not set :: passing host. {{(pid=98327) _check_filter_function /opt/stack/manila/manila/scheduler/filters/driver.py:53}} May 28 13:00:27 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-5091ec63-b127-490a-ba42-6df40d830b35 tempest-ShareRulesTest-1530341375 None] Result: True {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:40}} May 28 13:00:27 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-5091ec63-b127-490a-ba42-6df40d830b35 tempest-ShareRulesTest-1530341375 None] Done checking host 'l75lg1-v1@vast#vast' {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:41}} May 28 13:00:27 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-5091ec63-b127-490a-ba42-6df40d830b35 tempest-ShareRulesTest-1530341375 None] Filter DriverFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:00:27 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-5091ec63-b127-490a-ba42-6df40d830b35 tempest-ShareRulesTest-1530341375 None] Filter ShareReplicationFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:00:27 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-5091ec63-b127-490a-ba42-6df40d830b35 tempest-ShareRulesTest-1530341375 None] Filter CreateFromSnapshotFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:00:27 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-5091ec63-b127-490a-ba42-6df40d830b35 tempest-ShareRulesTest-1530341375 None] Filter AffinityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:00:27 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-5091ec63-b127-490a-ba42-6df40d830b35 tempest-ShareRulesTest-1530341375 None] Filter AntiAffinityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:00:27 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.drivers.filter [None req-5091ec63-b127-490a-ba42-6df40d830b35 tempest-ShareRulesTest-1530341375 None] Filtered share [host: 'l75lg1-v1@vast#vast', free_capacity_gb: 2076.6478263456374, pools: None] {{(pid=98327) _schedule_share /opt/stack/manila/manila/scheduler/drivers/filter.py:268}} May 28 13:00:27 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-5091ec63-b127-490a-ba42-6df40d830b35 tempest-ShareRulesTest-1530341375 None] Checking host 'l75lg1-v1@vast#vast' {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:46}} May 28 13:00:27 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.weighers.goodness [None req-5091ec63-b127-490a-ba42-6df40d830b35 tempest-ShareRulesTest-1530341375 None] Goodness function not set :: defaulting to minimal goodness rating of 0. May 28 13:00:27 l75lg1-v1 manila-scheduler[98327]: INFO manila.scheduler.weighers.goodness [None req-5091ec63-b127-490a-ba42-6df40d830b35 tempest-ShareRulesTest-1530341375 None] Goodness function result for host l75lg1-v1@vast#vast: 0. May 28 13:00:27 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-5091ec63-b127-490a-ba42-6df40d830b35 tempest-ShareRulesTest-1530341375 None] Goodness: 0 {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:48}} May 28 13:00:27 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-5091ec63-b127-490a-ba42-6df40d830b35 tempest-ShareRulesTest-1530341375 None] Done checking host 'l75lg1-v1@vast#vast' {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:49}} May 28 13:00:27 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.drivers.filter [None req-5091ec63-b127-490a-ba42-6df40d830b35 tempest-ShareRulesTest-1530341375 None] Choosing for share: WeighedHost [host: l75lg1-v1@vast#vast, weight: 0.0] {{(pid=98327) _schedule_share /opt/stack/manila/manila/scheduler/drivers/filter.py:274}} May 28 13:00:27 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-5091ec63-b127-490a-ba42-6df40d830b35 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/shares returned with HTTP 200 May 28 13:00:27 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 910/1794] 10.27.203.238 () {66 vars in 1362 bytes} [Tue May 28 13:00:26 2024] POST /share/v2/a4f3887fa28c457390f5b66615564430/shares => generated 1312 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:00:27 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-b8ef0a16-b966-4917-a84e-358c4ef7d204 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] GET http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/shares/f4283c2a-3835-416e-9703-f5745babbf5c May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f23815f-4bfd-467c-b316-132ca31d2923 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:27 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-b8ef0a16-b966-4917-a84e-358c4ef7d204 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:27 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-b8ef0a16-b966-4917-a84e-358c4ef7d204 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a21f916-4fb1-467b-a27b-005db875b49a None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a21f916-4fb1-467b-a27b-005db875b49a None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a21f916-4fb1-467b-a27b-005db875b49a None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a21f916-4fb1-467b-a27b-005db875b49a None admin] PATH_INFO: `/v3/projects` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a21f916-4fb1-467b-a27b-005db875b49a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a21f916-4fb1-467b-a27b-005db875b49a None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:27 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-b8ef0a16-b966-4917-a84e-358c4ef7d204 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/shares/f4283c2a-3835-416e-9703-f5745babbf5c returned with HTTP 200 May 28 13:00:27 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 885/1795] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:00:27 2024] GET /share/v2/a4f3887fa28c457390f5b66615564430/shares/f4283c2a-3835-416e-9703-f5745babbf5c => generated 1312 bytes in 28 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1411/2793] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 13:00:26 2024] POST /identity/v3/projects => generated 403 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5026924-9d8b-47f6-aaa3-2930bed22bc5 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5026924-9d8b-47f6-aaa3-2930bed22bc5 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbf96ef-f40f-4bc0-9e99-89b32753b41e None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbf96ef-f40f-4bc0-9e99-89b32753b41e None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbf96ef-f40f-4bc0-9e99-89b32753b41e None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbf96ef-f40f-4bc0-9e99-89b32753b41e None admin] PATH_INFO: `/v3/users` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbf96ef-f40f-4bc0-9e99-89b32753b41e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbf96ef-f40f-4bc0-9e99-89b32753b41e None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-6cbf96ef-f40f-4bc0-9e99-89b32753b41e None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1383/2794] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 13:00:27 2024] POST /identity/v3/users => generated 309 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a21f916-4fb1-467b-a27b-005db875b49a None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a21f916-4fb1-467b-a27b-005db875b49a None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e2b9cf-276c-4551-86cc-f3fb71add488 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e2b9cf-276c-4551-86cc-f3fb71add488 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e2b9cf-276c-4551-86cc-f3fb71add488 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e2b9cf-276c-4551-86cc-f3fb71add488 None admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e2b9cf-276c-4551-86cc-f3fb71add488 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:27 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-5091ec63-b127-490a-ba42-6df40d830b35 tempest-ShareRulesTest-1530341375 None] >>> [GET] https://127.0.0.1:40443/api/vippools/ May 28 13:00:27 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-5091ec63-b127-490a-ba42-6df40d830b35 tempest-ShareRulesTest-1530341375 None] {'allow_redirects': True, 'params': {'name': 'vippool-1'}} May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e2b9cf-276c-4551-86cc-f3fb71add488 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1412/2795] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 13:00:27 2024] GET /identity/v3/roles => generated 1680 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbf96ef-f40f-4bc0-9e99-89b32753b41e None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbf96ef-f40f-4bc0-9e99-89b32753b41e None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8a70f2-8ee1-430d-bf78-62db5899e88b None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8a70f2-8ee1-430d-bf78-62db5899e88b None admin] REQUEST_METHOD: `PUT` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8a70f2-8ee1-430d-bf78-62db5899e88b None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8a70f2-8ee1-430d-bf78-62db5899e88b None admin] PATH_INFO: `/v3/projects/4a6a71724c0c476588127b06c11dec79/users/331dd8e64cda49cfa79d4430fdeb4629/roles/e7989893488f483baa107be56668c4f8` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8a70f2-8ee1-430d-bf78-62db5899e88b None admin] RBAC: Authorizing `identity:create_grant(project_id=4a6a71724c0c476588127b06c11dec79, user_id=331dd8e64cda49cfa79d4430fdeb4629, role_id=e7989893488f483baa107be56668c4f8)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8a70f2-8ee1-430d-bf78-62db5899e88b None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1384/2796] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 13:00:27 2024] PUT /identity/v3/projects/4a6a71724c0c476588127b06c11dec79/users/331dd8e64cda49cfa79d4430fdeb4629/roles/e7989893488f483baa107be56668c4f8 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e2b9cf-276c-4551-86cc-f3fb71add488 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e2b9cf-276c-4551-86cc-f3fb71add488 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df3b146-5957-494f-bc8d-c737683adb39 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df3b146-5957-494f-bc8d-c737683adb39 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df3b146-5957-494f-bc8d-c737683adb39 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df3b146-5957-494f-bc8d-c737683adb39 None admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df3b146-5957-494f-bc8d-c737683adb39 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df3b146-5957-494f-bc8d-c737683adb39 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1413/2797] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 13:00:27 2024] GET /identity/v3/roles => generated 1680 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8a70f2-8ee1-430d-bf78-62db5899e88b None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8a70f2-8ee1-430d-bf78-62db5899e88b None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02723a6e-55f1-47d4-899f-c081155e0681 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02723a6e-55f1-47d4-899f-c081155e0681 None admin] REQUEST_METHOD: `PUT` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02723a6e-55f1-47d4-899f-c081155e0681 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02723a6e-55f1-47d4-899f-c081155e0681 None admin] PATH_INFO: `/v3/projects/4a6a71724c0c476588127b06c11dec79/users/331dd8e64cda49cfa79d4430fdeb4629/roles/e7989893488f483baa107be56668c4f8` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02723a6e-55f1-47d4-899f-c081155e0681 None admin] RBAC: Authorizing `identity:create_grant(project_id=4a6a71724c0c476588127b06c11dec79, user_id=331dd8e64cda49cfa79d4430fdeb4629, role_id=e7989893488f483baa107be56668c4f8)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02723a6e-55f1-47d4-899f-c081155e0681 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:27 l75lg1-v1 dstat.sh[49771]: 28-05 13:00:27| 22 4 68 5 0|5707M 1745M 278M 7895M| 12k 6188B| 641k 6402k|5.00 593 | 11k 18k|1.51 1.15 1.04|3.0 1.0 50| 0 0 | 0 2048M| 29 362 0 41 2 May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1385/2798] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 13:00:27 2024] PUT /identity/v3/projects/4a6a71724c0c476588127b06c11dec79/users/331dd8e64cda49cfa79d4430fdeb4629/roles/e7989893488f483baa107be56668c4f8 => generated 0 bytes in 19 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8977bc-dede-42dd-843e-eb2ee4deed1d None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8977bc-dede-42dd-843e-eb2ee4deed1d None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8977bc-dede-42dd-843e-eb2ee4deed1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:27 l75lg1-v1 sudo[99076]: pam_unix(sudo:session): session closed for user root May 28 13:00:27 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.518s {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:428}} May 28 13:00:27 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:390}} May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-fa8977bc-dede-42dd-843e-eb2ee4deed1d None None] Truncating password to algorithm specific maximum length 72 characters. May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-fa8977bc-dede-42dd-843e-eb2ee4deed1d None None] MFA Rules not processed for user `331dd8e64cda49cfa79d4430fdeb4629`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-fa8977bc-dede-42dd-843e-eb2ee4deed1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:00:27 l75lg1-v1 sudo[99079]: vastdata : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 May 28 13:00:27 l75lg1-v1 sudo[99079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1414/2799] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 13:00:27 2024] POST /identity/v3/auth/tokens => generated 4097 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02723a6e-55f1-47d4-899f-c081155e0681 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02723a6e-55f1-47d4-899f-c081155e0681 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8373d8fa-75b3-4d4d-8069-eac82f91ad52 tempest-ShareUserRulesForCIFSNegativeTest-419859256 tempest-ShareUserRulesForCIFSNegativeTest-419859256-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '331dd8e64cda49cfa79d4430fdeb4629', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a6a71724c0c476588127b06c11dec79', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8373d8fa-75b3-4d4d-8069-eac82f91ad52 tempest-ShareUserRulesForCIFSNegativeTest-419859256 tempest-ShareUserRulesForCIFSNegativeTest-419859256-project-admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8373d8fa-75b3-4d4d-8069-eac82f91ad52 tempest-ShareUserRulesForCIFSNegativeTest-419859256 tempest-ShareUserRulesForCIFSNegativeTest-419859256-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8373d8fa-75b3-4d4d-8069-eac82f91ad52 tempest-ShareUserRulesForCIFSNegativeTest-419859256 tempest-ShareUserRulesForCIFSNegativeTest-419859256-project-admin] PATH_INFO: `/v3/domains` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8373d8fa-75b3-4d4d-8069-eac82f91ad52 tempest-ShareUserRulesForCIFSNegativeTest-419859256 tempest-ShareUserRulesForCIFSNegativeTest-419859256-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8373d8fa-75b3-4d4d-8069-eac82f91ad52 tempest-ShareUserRulesForCIFSNegativeTest-419859256 tempest-ShareUserRulesForCIFSNegativeTest-419859256-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8373d8fa-75b3-4d4d-8069-eac82f91ad52 tempest-ShareUserRulesForCIFSNegativeTest-419859256 tempest-ShareUserRulesForCIFSNegativeTest-419859256-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1386/2800] 10.27.203.238 () {62 vars in 1241 bytes} [Tue May 28 13:00:27 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8977bc-dede-42dd-843e-eb2ee4deed1d None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8977bc-dede-42dd-843e-eb2ee4deed1d None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18df7dbc-70ed-4e1b-99ef-4cd8743578b3 tempest-ShareUserRulesForCIFSNegativeTest-419859256 tempest-ShareUserRulesForCIFSNegativeTest-419859256-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '331dd8e64cda49cfa79d4430fdeb4629', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a6a71724c0c476588127b06c11dec79', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18df7dbc-70ed-4e1b-99ef-4cd8743578b3 tempest-ShareUserRulesForCIFSNegativeTest-419859256 tempest-ShareUserRulesForCIFSNegativeTest-419859256-project-admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18df7dbc-70ed-4e1b-99ef-4cd8743578b3 tempest-ShareUserRulesForCIFSNegativeTest-419859256 tempest-ShareUserRulesForCIFSNegativeTest-419859256-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18df7dbc-70ed-4e1b-99ef-4cd8743578b3 tempest-ShareUserRulesForCIFSNegativeTest-419859256 tempest-ShareUserRulesForCIFSNegativeTest-419859256-project-admin] PATH_INFO: `/v3/users` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18df7dbc-70ed-4e1b-99ef-4cd8743578b3 tempest-ShareUserRulesForCIFSNegativeTest-419859256 tempest-ShareUserRulesForCIFSNegativeTest-419859256-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18df7dbc-70ed-4e1b-99ef-4cd8743578b3 tempest-ShareUserRulesForCIFSNegativeTest-419859256 tempest-ShareUserRulesForCIFSNegativeTest-419859256-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-18df7dbc-70ed-4e1b-99ef-4cd8743578b3 tempest-ShareUserRulesForCIFSNegativeTest-419859256 tempest-ShareUserRulesForCIFSNegativeTest-419859256-project-admin] Truncating password to algorithm specific maximum length 72 characters. May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1415/2801] 10.27.203.238 () {64 vars in 1232 bytes} [Tue May 28 13:00:27 2024] POST /identity/v3/users => generated 435 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8373d8fa-75b3-4d4d-8069-eac82f91ad52 tempest-ShareUserRulesForCIFSNegativeTest-419859256 tempest-ShareUserRulesForCIFSNegativeTest-419859256-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8373d8fa-75b3-4d4d-8069-eac82f91ad52 tempest-ShareUserRulesForCIFSNegativeTest-419859256 tempest-ShareUserRulesForCIFSNegativeTest-419859256-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4185204-0f2d-45b8-9e0a-e95134615738 tempest-ShareUserRulesForCIFSNegativeTest-419859256 tempest-ShareUserRulesForCIFSNegativeTest-419859256-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '331dd8e64cda49cfa79d4430fdeb4629', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a6a71724c0c476588127b06c11dec79', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4185204-0f2d-45b8-9e0a-e95134615738 tempest-ShareUserRulesForCIFSNegativeTest-419859256 tempest-ShareUserRulesForCIFSNegativeTest-419859256-project-admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4185204-0f2d-45b8-9e0a-e95134615738 tempest-ShareUserRulesForCIFSNegativeTest-419859256 tempest-ShareUserRulesForCIFSNegativeTest-419859256-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4185204-0f2d-45b8-9e0a-e95134615738 tempest-ShareUserRulesForCIFSNegativeTest-419859256 tempest-ShareUserRulesForCIFSNegativeTest-419859256-project-admin] PATH_INFO: `/v3/roles` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4185204-0f2d-45b8-9e0a-e95134615738 tempest-ShareUserRulesForCIFSNegativeTest-419859256 tempest-ShareUserRulesForCIFSNegativeTest-419859256-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4185204-0f2d-45b8-9e0a-e95134615738 tempest-ShareUserRulesForCIFSNegativeTest-419859256 tempest-ShareUserRulesForCIFSNegativeTest-419859256-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG dbcounter [-] [51266] Writing DB stats keystone:SELECT=1948,keystone:DELETE=278,keystone:INSERT=96 {{(pid=51266) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1387/2802] 10.27.203.238 () {62 vars in 1210 bytes} [Tue May 28 13:00:27 2024] GET /identity/v3/roles => generated 1680 bytes in 17 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18df7dbc-70ed-4e1b-99ef-4cd8743578b3 tempest-ShareUserRulesForCIFSNegativeTest-419859256 tempest-ShareUserRulesForCIFSNegativeTest-419859256-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18df7dbc-70ed-4e1b-99ef-4cd8743578b3 tempest-ShareUserRulesForCIFSNegativeTest-419859256 tempest-ShareUserRulesForCIFSNegativeTest-419859256-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be4bc86-0f36-4f1a-a2c7-3a88d2120bb2 tempest-ShareUserRulesForCIFSNegativeTest-419859256 tempest-ShareUserRulesForCIFSNegativeTest-419859256-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '331dd8e64cda49cfa79d4430fdeb4629', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a6a71724c0c476588127b06c11dec79', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be4bc86-0f36-4f1a-a2c7-3a88d2120bb2 tempest-ShareUserRulesForCIFSNegativeTest-419859256 tempest-ShareUserRulesForCIFSNegativeTest-419859256-project-admin] REQUEST_METHOD: `PUT` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be4bc86-0f36-4f1a-a2c7-3a88d2120bb2 tempest-ShareUserRulesForCIFSNegativeTest-419859256 tempest-ShareUserRulesForCIFSNegativeTest-419859256-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be4bc86-0f36-4f1a-a2c7-3a88d2120bb2 tempest-ShareUserRulesForCIFSNegativeTest-419859256 tempest-ShareUserRulesForCIFSNegativeTest-419859256-project-admin] PATH_INFO: `/v3/projects/4a6a71724c0c476588127b06c11dec79/users/8408bca6708d4e57b4e6ae91fa7eb8e3/roles/44620cad10ae407c90c91e2c296adb04` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be4bc86-0f36-4f1a-a2c7-3a88d2120bb2 tempest-ShareUserRulesForCIFSNegativeTest-419859256 tempest-ShareUserRulesForCIFSNegativeTest-419859256-project-admin] RBAC: Authorizing `identity:create_grant(project_id=4a6a71724c0c476588127b06c11dec79, user_id=8408bca6708d4e57b4e6ae91fa7eb8e3, role_id=44620cad10ae407c90c91e2c296adb04)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be4bc86-0f36-4f1a-a2c7-3a88d2120bb2 tempest-ShareUserRulesForCIFSNegativeTest-419859256 tempest-ShareUserRulesForCIFSNegativeTest-419859256-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG dbcounter [-] [51267] Writing DB stats keystone:SELECT=1989,keystone:DELETE=230,keystone:INSERT=125 {{(pid=51267) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1416/2803] 10.27.203.238 () {64 vars in 1571 bytes} [Tue May 28 13:00:27 2024] PUT /identity/v3/projects/4a6a71724c0c476588127b06c11dec79/users/8408bca6708d4e57b4e6ae91fa7eb8e3/roles/44620cad10ae407c90c91e2c296adb04 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4185204-0f2d-45b8-9e0a-e95134615738 tempest-ShareUserRulesForCIFSNegativeTest-419859256 tempest-ShareUserRulesForCIFSNegativeTest-419859256-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4185204-0f2d-45b8-9e0a-e95134615738 tempest-ShareUserRulesForCIFSNegativeTest-419859256 tempest-ShareUserRulesForCIFSNegativeTest-419859256-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b63f2f9-6d09-4773-b0d9-f774e75cb218 tempest-ShareUserRulesForCIFSNegativeTest-419859256 tempest-ShareUserRulesForCIFSNegativeTest-419859256-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '331dd8e64cda49cfa79d4430fdeb4629', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a6a71724c0c476588127b06c11dec79', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b63f2f9-6d09-4773-b0d9-f774e75cb218 tempest-ShareUserRulesForCIFSNegativeTest-419859256 tempest-ShareUserRulesForCIFSNegativeTest-419859256-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b63f2f9-6d09-4773-b0d9-f774e75cb218 tempest-ShareUserRulesForCIFSNegativeTest-419859256 tempest-ShareUserRulesForCIFSNegativeTest-419859256-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b63f2f9-6d09-4773-b0d9-f774e75cb218 tempest-ShareUserRulesForCIFSNegativeTest-419859256 tempest-ShareUserRulesForCIFSNegativeTest-419859256-project-admin] PATH_INFO: `/v3/users/14783f4fbce14880b4db4a628827607e` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b63f2f9-6d09-4773-b0d9-f774e75cb218 tempest-ShareUserRulesForCIFSNegativeTest-419859256 tempest-ShareUserRulesForCIFSNegativeTest-419859256-project-admin] RBAC: Authorizing `identity:delete_user(user_id=14783f4fbce14880b4db4a628827607e)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b63f2f9-6d09-4773-b0d9-f774e75cb218 tempest-ShareUserRulesForCIFSNegativeTest-419859256 tempest-ShareUserRulesForCIFSNegativeTest-419859256-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-5b63f2f9-6d09-4773-b0d9-f774e75cb218 tempest-ShareUserRulesForCIFSNegativeTest-419859256 tempest-ShareUserRulesForCIFSNegativeTest-419859256-project-admin] Could not find user: 14783f4fbce14880b4db4a628827607e.: keystone.exception.UserNotFound: Could not find user: 14783f4fbce14880b4db4a628827607e. May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 14783f4fbce14880b4db4a628827607e. May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1388/2804] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:00:27 2024] DELETE /identity/v3/users/14783f4fbce14880b4db4a628827607e => generated 110 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be4bc86-0f36-4f1a-a2c7-3a88d2120bb2 tempest-ShareUserRulesForCIFSNegativeTest-419859256 tempest-ShareUserRulesForCIFSNegativeTest-419859256-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be4bc86-0f36-4f1a-a2c7-3a88d2120bb2 tempest-ShareUserRulesForCIFSNegativeTest-419859256 tempest-ShareUserRulesForCIFSNegativeTest-419859256-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77c1eb4-03ee-4e3b-8110-2667b97385cc tempest-ShareUserRulesForCIFSNegativeTest-419859256 tempest-ShareUserRulesForCIFSNegativeTest-419859256-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '331dd8e64cda49cfa79d4430fdeb4629', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a6a71724c0c476588127b06c11dec79', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77c1eb4-03ee-4e3b-8110-2667b97385cc tempest-ShareUserRulesForCIFSNegativeTest-419859256 tempest-ShareUserRulesForCIFSNegativeTest-419859256-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77c1eb4-03ee-4e3b-8110-2667b97385cc tempest-ShareUserRulesForCIFSNegativeTest-419859256 tempest-ShareUserRulesForCIFSNegativeTest-419859256-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77c1eb4-03ee-4e3b-8110-2667b97385cc tempest-ShareUserRulesForCIFSNegativeTest-419859256 tempest-ShareUserRulesForCIFSNegativeTest-419859256-project-admin] PATH_INFO: `/v3/users/9eca355145fd413390b5efe7a0d95465` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77c1eb4-03ee-4e3b-8110-2667b97385cc tempest-ShareUserRulesForCIFSNegativeTest-419859256 tempest-ShareUserRulesForCIFSNegativeTest-419859256-project-admin] RBAC: Authorizing `identity:delete_user(user_id=9eca355145fd413390b5efe7a0d95465)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77c1eb4-03ee-4e3b-8110-2667b97385cc tempest-ShareUserRulesForCIFSNegativeTest-419859256 tempest-ShareUserRulesForCIFSNegativeTest-419859256-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-c77c1eb4-03ee-4e3b-8110-2667b97385cc tempest-ShareUserRulesForCIFSNegativeTest-419859256 tempest-ShareUserRulesForCIFSNegativeTest-419859256-project-admin] Could not find user: 9eca355145fd413390b5efe7a0d95465.: keystone.exception.UserNotFound: Could not find user: 9eca355145fd413390b5efe7a0d95465. May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 9eca355145fd413390b5efe7a0d95465. May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1417/2805] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:00:27 2024] DELETE /identity/v3/users/9eca355145fd413390b5efe7a0d95465 => generated 110 bytes in 29 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b63f2f9-6d09-4773-b0d9-f774e75cb218 tempest-ShareUserRulesForCIFSNegativeTest-419859256 tempest-ShareUserRulesForCIFSNegativeTest-419859256-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b63f2f9-6d09-4773-b0d9-f774e75cb218 tempest-ShareUserRulesForCIFSNegativeTest-419859256 tempest-ShareUserRulesForCIFSNegativeTest-419859256-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ad075b-fb36-4421-a954-a2ad3d1f211c tempest-ShareUserRulesForCIFSNegativeTest-419859256 tempest-ShareUserRulesForCIFSNegativeTest-419859256-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '331dd8e64cda49cfa79d4430fdeb4629', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a6a71724c0c476588127b06c11dec79', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ad075b-fb36-4421-a954-a2ad3d1f211c tempest-ShareUserRulesForCIFSNegativeTest-419859256 tempest-ShareUserRulesForCIFSNegativeTest-419859256-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ad075b-fb36-4421-a954-a2ad3d1f211c tempest-ShareUserRulesForCIFSNegativeTest-419859256 tempest-ShareUserRulesForCIFSNegativeTest-419859256-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ad075b-fb36-4421-a954-a2ad3d1f211c tempest-ShareUserRulesForCIFSNegativeTest-419859256 tempest-ShareUserRulesForCIFSNegativeTest-419859256-project-admin] PATH_INFO: `/v3/users/91ab54ee09854b549923fb7671247f5c` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ad075b-fb36-4421-a954-a2ad3d1f211c tempest-ShareUserRulesForCIFSNegativeTest-419859256 tempest-ShareUserRulesForCIFSNegativeTest-419859256-project-admin] RBAC: Authorizing `identity:delete_user(user_id=91ab54ee09854b549923fb7671247f5c)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ad075b-fb36-4421-a954-a2ad3d1f211c tempest-ShareUserRulesForCIFSNegativeTest-419859256 tempest-ShareUserRulesForCIFSNegativeTest-419859256-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-d1ad075b-fb36-4421-a954-a2ad3d1f211c tempest-ShareUserRulesForCIFSNegativeTest-419859256 tempest-ShareUserRulesForCIFSNegativeTest-419859256-project-admin] Could not find user: 91ab54ee09854b549923fb7671247f5c.: keystone.exception.UserNotFound: Could not find user: 91ab54ee09854b549923fb7671247f5c. May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 91ab54ee09854b549923fb7671247f5c. May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1389/2806] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:00:27 2024] DELETE /identity/v3/users/91ab54ee09854b549923fb7671247f5c => generated 110 bytes in 23 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77c1eb4-03ee-4e3b-8110-2667b97385cc tempest-ShareUserRulesForCIFSNegativeTest-419859256 tempest-ShareUserRulesForCIFSNegativeTest-419859256-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77c1eb4-03ee-4e3b-8110-2667b97385cc tempest-ShareUserRulesForCIFSNegativeTest-419859256 tempest-ShareUserRulesForCIFSNegativeTest-419859256-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe94ea3-e89b-4c70-8bb8-7a9c62a7f7b7 tempest-ShareUserRulesForCIFSNegativeTest-419859256 tempest-ShareUserRulesForCIFSNegativeTest-419859256-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '331dd8e64cda49cfa79d4430fdeb4629', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a6a71724c0c476588127b06c11dec79', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe94ea3-e89b-4c70-8bb8-7a9c62a7f7b7 tempest-ShareUserRulesForCIFSNegativeTest-419859256 tempest-ShareUserRulesForCIFSNegativeTest-419859256-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe94ea3-e89b-4c70-8bb8-7a9c62a7f7b7 tempest-ShareUserRulesForCIFSNegativeTest-419859256 tempest-ShareUserRulesForCIFSNegativeTest-419859256-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe94ea3-e89b-4c70-8bb8-7a9c62a7f7b7 tempest-ShareUserRulesForCIFSNegativeTest-419859256 tempest-ShareUserRulesForCIFSNegativeTest-419859256-project-admin] PATH_INFO: `/v3/users/2889a927897c49bd92a0d1cfdf27e7f5` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe94ea3-e89b-4c70-8bb8-7a9c62a7f7b7 tempest-ShareUserRulesForCIFSNegativeTest-419859256 tempest-ShareUserRulesForCIFSNegativeTest-419859256-project-admin] RBAC: Authorizing `identity:delete_user(user_id=2889a927897c49bd92a0d1cfdf27e7f5)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe94ea3-e89b-4c70-8bb8-7a9c62a7f7b7 tempest-ShareUserRulesForCIFSNegativeTest-419859256 tempest-ShareUserRulesForCIFSNegativeTest-419859256-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-4fe94ea3-e89b-4c70-8bb8-7a9c62a7f7b7 tempest-ShareUserRulesForCIFSNegativeTest-419859256 tempest-ShareUserRulesForCIFSNegativeTest-419859256-project-admin] Could not find user: 2889a927897c49bd92a0d1cfdf27e7f5.: keystone.exception.UserNotFound: Could not find user: 2889a927897c49bd92a0d1cfdf27e7f5. May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 2889a927897c49bd92a0d1cfdf27e7f5. May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1418/2807] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:00:27 2024] DELETE /identity/v3/users/2889a927897c49bd92a0d1cfdf27e7f5 => generated 110 bytes in 25 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ad075b-fb36-4421-a954-a2ad3d1f211c tempest-ShareUserRulesForCIFSNegativeTest-419859256 tempest-ShareUserRulesForCIFSNegativeTest-419859256-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ad075b-fb36-4421-a954-a2ad3d1f211c tempest-ShareUserRulesForCIFSNegativeTest-419859256 tempest-ShareUserRulesForCIFSNegativeTest-419859256-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc563d64-a6d7-48f8-a863-4f8bb1ccd324 tempest-ShareUserRulesForCIFSNegativeTest-419859256 tempest-ShareUserRulesForCIFSNegativeTest-419859256-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '331dd8e64cda49cfa79d4430fdeb4629', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a6a71724c0c476588127b06c11dec79', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc563d64-a6d7-48f8-a863-4f8bb1ccd324 tempest-ShareUserRulesForCIFSNegativeTest-419859256 tempest-ShareUserRulesForCIFSNegativeTest-419859256-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc563d64-a6d7-48f8-a863-4f8bb1ccd324 tempest-ShareUserRulesForCIFSNegativeTest-419859256 tempest-ShareUserRulesForCIFSNegativeTest-419859256-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc563d64-a6d7-48f8-a863-4f8bb1ccd324 tempest-ShareUserRulesForCIFSNegativeTest-419859256 tempest-ShareUserRulesForCIFSNegativeTest-419859256-project-admin] PATH_INFO: `/v3/users/bd43e5d1c359462d807b6e8a8581fa73` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:27 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-5091ec63-b127-490a-ba42-6df40d830b35 tempest-ShareRulesTest-1530341375 None] <<< [GET] https://127.0.0.1:40443/api/vippools/ May 28 13:00:27 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-5091ec63-b127-490a-ba42-6df40d830b35 tempest-ShareRulesTest-1530341375 None] [Bunch(active_cnode_ids=[], active_interfaces=4, cluster='loop75-kfs', cluster_id=1, cnode_ids=[], cnodes=[], domain_name='vippool-1', enable_l3=False, enable_weighted_balancing=False, enabled=True, end_ip='172.21.75.4', guid='f2abaede-b397-413a-8faa-3aeead6d3b28', gw_ip='', gw_ipv6='', id=2, ip_ranges=[['172.21.75.1', '172.21.75.4']], name='vippool-1', peer_asn=0, port_membership='ALL', ranges_summary='172.21.75.[1-4]', role='PROTOCOLS', start_ip='172.21.75.1', subnet_cidr=16, subnet_cidr_ipv6=None, sync='SYNCED', sync_time='2024-05-28T12:50:09.644123Z', tenant_id=1, tenant_name='default', title='172.21.75.1 - 172.21.75.4', url='https://127.0.0.1:40443/api/vippools/2/', vast_asn=0, vlan=0, vms_preferred=False)] May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc563d64-a6d7-48f8-a863-4f8bb1ccd324 tempest-ShareUserRulesForCIFSNegativeTest-419859256 tempest-ShareUserRulesForCIFSNegativeTest-419859256-project-admin] RBAC: Authorizing `identity:delete_user(user_id=bd43e5d1c359462d807b6e8a8581fa73)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:27 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-5091ec63-b127-490a-ba42-6df40d830b35 tempest-ShareRulesTest-1530341375 None] --- [GET] https://127.0.0.1:40443/api/vippools/: Done May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc563d64-a6d7-48f8-a863-4f8bb1ccd324 tempest-ShareUserRulesForCIFSNegativeTest-419859256 tempest-ShareUserRulesForCIFSNegativeTest-419859256-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:27 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-5091ec63-b127-490a-ba42-6df40d830b35 tempest-ShareRulesTest-1530341375 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:00:27 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-5091ec63-b127-490a-ba42-6df40d830b35 tempest-ShareRulesTest-1530341375 None] {'allow_redirects': True, May 28 13:00:27 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-5091ec63-b127-490a-ba42-6df40d830b35 tempest-ShareRulesTest-1530341375 None] 'params': {'name': '5eddb781-43d4-4883-ae43-e9856f3a4c10'}} May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-dc563d64-a6d7-48f8-a863-4f8bb1ccd324 tempest-ShareUserRulesForCIFSNegativeTest-419859256 tempest-ShareUserRulesForCIFSNegativeTest-419859256-project-admin] Could not find user: bd43e5d1c359462d807b6e8a8581fa73.: keystone.exception.UserNotFound: Could not find user: bd43e5d1c359462d807b6e8a8581fa73. May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: bd43e5d1c359462d807b6e8a8581fa73. May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1390/2808] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:00:27 2024] DELETE /identity/v3/users/bd43e5d1c359462d807b6e8a8581fa73 => generated 110 bytes in 23 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe94ea3-e89b-4c70-8bb8-7a9c62a7f7b7 tempest-ShareUserRulesForCIFSNegativeTest-419859256 tempest-ShareUserRulesForCIFSNegativeTest-419859256-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe94ea3-e89b-4c70-8bb8-7a9c62a7f7b7 tempest-ShareUserRulesForCIFSNegativeTest-419859256 tempest-ShareUserRulesForCIFSNegativeTest-419859256-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15773e04-b767-4a15-8040-515c63a1ba1a tempest-ShareUserRulesForCIFSNegativeTest-419859256 tempest-ShareUserRulesForCIFSNegativeTest-419859256-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '331dd8e64cda49cfa79d4430fdeb4629', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a6a71724c0c476588127b06c11dec79', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15773e04-b767-4a15-8040-515c63a1ba1a tempest-ShareUserRulesForCIFSNegativeTest-419859256 tempest-ShareUserRulesForCIFSNegativeTest-419859256-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15773e04-b767-4a15-8040-515c63a1ba1a tempest-ShareUserRulesForCIFSNegativeTest-419859256 tempest-ShareUserRulesForCIFSNegativeTest-419859256-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15773e04-b767-4a15-8040-515c63a1ba1a tempest-ShareUserRulesForCIFSNegativeTest-419859256 tempest-ShareUserRulesForCIFSNegativeTest-419859256-project-admin] PATH_INFO: `/v3/users/18c7667276334e98bdd11d2b9d1875cc` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15773e04-b767-4a15-8040-515c63a1ba1a tempest-ShareUserRulesForCIFSNegativeTest-419859256 tempest-ShareUserRulesForCIFSNegativeTest-419859256-project-admin] RBAC: Authorizing `identity:delete_user(user_id=18c7667276334e98bdd11d2b9d1875cc)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15773e04-b767-4a15-8040-515c63a1ba1a tempest-ShareUserRulesForCIFSNegativeTest-419859256 tempest-ShareUserRulesForCIFSNegativeTest-419859256-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-15773e04-b767-4a15-8040-515c63a1ba1a tempest-ShareUserRulesForCIFSNegativeTest-419859256 tempest-ShareUserRulesForCIFSNegativeTest-419859256-project-admin] Could not find user: 18c7667276334e98bdd11d2b9d1875cc.: keystone.exception.UserNotFound: Could not find user: 18c7667276334e98bdd11d2b9d1875cc. May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 18c7667276334e98bdd11d2b9d1875cc. May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1419/2809] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:00:27 2024] DELETE /identity/v3/users/18c7667276334e98bdd11d2b9d1875cc => generated 110 bytes in 26 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc563d64-a6d7-48f8-a863-4f8bb1ccd324 tempest-ShareUserRulesForCIFSNegativeTest-419859256 tempest-ShareUserRulesForCIFSNegativeTest-419859256-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc563d64-a6d7-48f8-a863-4f8bb1ccd324 tempest-ShareUserRulesForCIFSNegativeTest-419859256 tempest-ShareUserRulesForCIFSNegativeTest-419859256-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f54e5c-e5c1-4e52-89be-2717f6229fed tempest-ShareUserRulesForCIFSNegativeTest-419859256 tempest-ShareUserRulesForCIFSNegativeTest-419859256-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '331dd8e64cda49cfa79d4430fdeb4629', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a6a71724c0c476588127b06c11dec79', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f54e5c-e5c1-4e52-89be-2717f6229fed tempest-ShareUserRulesForCIFSNegativeTest-419859256 tempest-ShareUserRulesForCIFSNegativeTest-419859256-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f54e5c-e5c1-4e52-89be-2717f6229fed tempest-ShareUserRulesForCIFSNegativeTest-419859256 tempest-ShareUserRulesForCIFSNegativeTest-419859256-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f54e5c-e5c1-4e52-89be-2717f6229fed tempest-ShareUserRulesForCIFSNegativeTest-419859256 tempest-ShareUserRulesForCIFSNegativeTest-419859256-project-admin] PATH_INFO: `/v3/users/db0396a316ea4c5697d47df053fccbe4` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f54e5c-e5c1-4e52-89be-2717f6229fed tempest-ShareUserRulesForCIFSNegativeTest-419859256 tempest-ShareUserRulesForCIFSNegativeTest-419859256-project-admin] RBAC: Authorizing `identity:delete_user(user_id=db0396a316ea4c5697d47df053fccbe4)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f54e5c-e5c1-4e52-89be-2717f6229fed tempest-ShareUserRulesForCIFSNegativeTest-419859256 tempest-ShareUserRulesForCIFSNegativeTest-419859256-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-96f54e5c-e5c1-4e52-89be-2717f6229fed tempest-ShareUserRulesForCIFSNegativeTest-419859256 tempest-ShareUserRulesForCIFSNegativeTest-419859256-project-admin] Could not find user: db0396a316ea4c5697d47df053fccbe4.: keystone.exception.UserNotFound: Could not find user: db0396a316ea4c5697d47df053fccbe4. May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: db0396a316ea4c5697d47df053fccbe4. May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1391/2810] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:00:27 2024] DELETE /identity/v3/users/db0396a316ea4c5697d47df053fccbe4 => generated 110 bytes in 25 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15773e04-b767-4a15-8040-515c63a1ba1a tempest-ShareUserRulesForCIFSNegativeTest-419859256 tempest-ShareUserRulesForCIFSNegativeTest-419859256-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15773e04-b767-4a15-8040-515c63a1ba1a tempest-ShareUserRulesForCIFSNegativeTest-419859256 tempest-ShareUserRulesForCIFSNegativeTest-419859256-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c13f7f-aa81-4324-828d-06060259a561 tempest-ShareUserRulesForCIFSNegativeTest-419859256 tempest-ShareUserRulesForCIFSNegativeTest-419859256-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '331dd8e64cda49cfa79d4430fdeb4629', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a6a71724c0c476588127b06c11dec79', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c13f7f-aa81-4324-828d-06060259a561 tempest-ShareUserRulesForCIFSNegativeTest-419859256 tempest-ShareUserRulesForCIFSNegativeTest-419859256-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c13f7f-aa81-4324-828d-06060259a561 tempest-ShareUserRulesForCIFSNegativeTest-419859256 tempest-ShareUserRulesForCIFSNegativeTest-419859256-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c13f7f-aa81-4324-828d-06060259a561 tempest-ShareUserRulesForCIFSNegativeTest-419859256 tempest-ShareUserRulesForCIFSNegativeTest-419859256-project-admin] PATH_INFO: `/v3/users/8408bca6708d4e57b4e6ae91fa7eb8e3` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c13f7f-aa81-4324-828d-06060259a561 tempest-ShareUserRulesForCIFSNegativeTest-419859256 tempest-ShareUserRulesForCIFSNegativeTest-419859256-project-admin] RBAC: Authorizing `identity:delete_user(user_id=8408bca6708d4e57b4e6ae91fa7eb8e3)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c13f7f-aa81-4324-828d-06060259a561 tempest-ShareUserRulesForCIFSNegativeTest-419859256 tempest-ShareUserRulesForCIFSNegativeTest-419859256-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:27 l75lg1-v1 sudo[99079]: pam_unix(sudo:session): session closed for user root May 28 13:00:27 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.502s {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:428}} May 28 13:00:27 l75lg1-v1 cinder-volume[85846]: DEBUG cinder.manager [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] Notifying Schedulers of capabilities ... {{(pid=85846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 28 13:00:27 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.scheduler.host_manager [None req-54bb2441-21f9-45c1-9b41-315e2d125ba7 None None] Received volume service update from l75lg1-v1@lvmdriver-1: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:l75lg1-v1:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up', 'allocated_capacity_gb': 0, 'cacheable': True}], 'shared_targets': False, 'sparse_copy_volume': True, 'filter_function': None, 'goodness_function': None} {{(pid=85128) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:628}} May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-36c13f7f-aa81-4324-828d-06060259a561 tempest-ShareUserRulesForCIFSNegativeTest-419859256 tempest-ShareUserRulesForCIFSNegativeTest-419859256-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8408bca6708d4e57b4e6ae91fa7eb8e3', 'request_id': 'req-36c13f7f-aa81-4324-828d-06060259a561'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-36c13f7f-aa81-4324-828d-06060259a561 tempest-ShareUserRulesForCIFSNegativeTest-419859256 tempest-ShareUserRulesForCIFSNegativeTest-419859256-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8408bca6708d4e57b4e6ae91fa7eb8e3', 'request_id': 'req-36c13f7f-aa81-4324-828d-06060259a561'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-36c13f7f-aa81-4324-828d-06060259a561 tempest-ShareUserRulesForCIFSNegativeTest-419859256 tempest-ShareUserRulesForCIFSNegativeTest-419859256-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8408bca6708d4e57b4e6ae91fa7eb8e3', 'request_id': 'req-36c13f7f-aa81-4324-828d-06060259a561'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-36c13f7f-aa81-4324-828d-06060259a561 tempest-ShareUserRulesForCIFSNegativeTest-419859256 tempest-ShareUserRulesForCIFSNegativeTest-419859256-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8408bca6708d4e57b4e6ae91fa7eb8e3', 'request_id': 'req-36c13f7f-aa81-4324-828d-06060259a561'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-36c13f7f-aa81-4324-828d-06060259a561 tempest-ShareUserRulesForCIFSNegativeTest-419859256 tempest-ShareUserRulesForCIFSNegativeTest-419859256-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8408bca6708d4e57b4e6ae91fa7eb8e3', 'request_id': 'req-36c13f7f-aa81-4324-828d-06060259a561'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1420/2811] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:00:27 2024] DELETE /identity/v3/users/8408bca6708d4e57b4e6ae91fa7eb8e3 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f54e5c-e5c1-4e52-89be-2717f6229fed tempest-ShareUserRulesForCIFSNegativeTest-419859256 tempest-ShareUserRulesForCIFSNegativeTest-419859256-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-96f54e5c-e5c1-4e52-89be-2717f6229fed tempest-ShareUserRulesForCIFSNegativeTest-419859256 tempest-ShareUserRulesForCIFSNegativeTest-419859256-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f54e5c-e5c1-4e52-89be-2717f6229fed tempest-ShareUserRulesForCIFSNegativeTest-419859256 tempest-ShareUserRulesForCIFSNegativeTest-419859256-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d820b447-7055-47c1-8319-e02a5ffcf5a4 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d820b447-7055-47c1-8319-e02a5ffcf5a4 None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d820b447-7055-47c1-8319-e02a5ffcf5a4 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d820b447-7055-47c1-8319-e02a5ffcf5a4 None admin] PATH_INFO: `/v3/users/ebfada476d7b46d79b951c998c816040` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d820b447-7055-47c1-8319-e02a5ffcf5a4 None admin] RBAC: Authorizing `identity:delete_user(user_id=ebfada476d7b46d79b951c998c816040)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d820b447-7055-47c1-8319-e02a5ffcf5a4 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-d820b447-7055-47c1-8319-e02a5ffcf5a4 None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ebfada476d7b46d79b951c998c816040', 'request_id': 'req-d820b447-7055-47c1-8319-e02a5ffcf5a4'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-d820b447-7055-47c1-8319-e02a5ffcf5a4 None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ebfada476d7b46d79b951c998c816040', 'request_id': 'req-d820b447-7055-47c1-8319-e02a5ffcf5a4'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-d820b447-7055-47c1-8319-e02a5ffcf5a4 None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ebfada476d7b46d79b951c998c816040', 'request_id': 'req-d820b447-7055-47c1-8319-e02a5ffcf5a4'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-d820b447-7055-47c1-8319-e02a5ffcf5a4 None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ebfada476d7b46d79b951c998c816040', 'request_id': 'req-d820b447-7055-47c1-8319-e02a5ffcf5a4'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-d820b447-7055-47c1-8319-e02a5ffcf5a4 None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ebfada476d7b46d79b951c998c816040', 'request_id': 'req-d820b447-7055-47c1-8319-e02a5ffcf5a4'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1392/2812] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 13:00:27 2024] DELETE /identity/v3/users/ebfada476d7b46d79b951c998c816040 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c13f7f-aa81-4324-828d-06060259a561 tempest-ShareUserRulesForCIFSNegativeTest-419859256 tempest-ShareUserRulesForCIFSNegativeTest-419859256-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c13f7f-aa81-4324-828d-06060259a561 tempest-ShareUserRulesForCIFSNegativeTest-419859256 tempest-ShareUserRulesForCIFSNegativeTest-419859256-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:28 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-5091ec63-b127-490a-ba42-6df40d830b35 tempest-ShareRulesTest-1530341375 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:00:28 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-5091ec63-b127-490a-ba42-6df40d830b35 tempest-ShareRulesTest-1530341375 None] [] May 28 13:00:28 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-5091ec63-b127-490a-ba42-6df40d830b35 tempest-ShareRulesTest-1530341375 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 13:00:28 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-5091ec63-b127-490a-ba42-6df40d830b35 tempest-ShareRulesTest-1530341375 None] >>> [POST] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:00:28 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-5091ec63-b127-490a-ba42-6df40d830b35 tempest-ShareRulesTest-1530341375 None] {'data': '{"name": "5eddb781-43d4-4883-ae43-e9856f3a4c10"}', May 28 13:00:28 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-5091ec63-b127-490a-ba42-6df40d830b35 tempest-ShareRulesTest-1530341375 None] 'json': None, May 28 13:00:28 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-5091ec63-b127-490a-ba42-6df40d830b35 tempest-ShareRulesTest-1530341375 None] 'params': None} May 28 13:00:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460e7a82-7fbb-4580-af87-2b596eecb3ac None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460e7a82-7fbb-4580-af87-2b596eecb3ac None admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460e7a82-7fbb-4580-af87-2b596eecb3ac None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460e7a82-7fbb-4580-af87-2b596eecb3ac None admin] PATH_INFO: `/v3/users/c3921d54c31444e3bff75d02cd13f8e2` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460e7a82-7fbb-4580-af87-2b596eecb3ac None admin] RBAC: Authorizing `identity:delete_user(user_id=c3921d54c31444e3bff75d02cd13f8e2)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460e7a82-7fbb-4580-af87-2b596eecb3ac None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-460e7a82-7fbb-4580-af87-2b596eecb3ac None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3921d54c31444e3bff75d02cd13f8e2', 'request_id': 'req-460e7a82-7fbb-4580-af87-2b596eecb3ac'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-460e7a82-7fbb-4580-af87-2b596eecb3ac None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3921d54c31444e3bff75d02cd13f8e2', 'request_id': 'req-460e7a82-7fbb-4580-af87-2b596eecb3ac'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-460e7a82-7fbb-4580-af87-2b596eecb3ac None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3921d54c31444e3bff75d02cd13f8e2', 'request_id': 'req-460e7a82-7fbb-4580-af87-2b596eecb3ac'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-460e7a82-7fbb-4580-af87-2b596eecb3ac None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3921d54c31444e3bff75d02cd13f8e2', 'request_id': 'req-460e7a82-7fbb-4580-af87-2b596eecb3ac'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-460e7a82-7fbb-4580-af87-2b596eecb3ac None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3921d54c31444e3bff75d02cd13f8e2', 'request_id': 'req-460e7a82-7fbb-4580-af87-2b596eecb3ac'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:28 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1421/2813] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 13:00:27 2024] DELETE /identity/v3/users/c3921d54c31444e3bff75d02cd13f8e2 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:00:28 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d820b447-7055-47c1-8319-e02a5ffcf5a4 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:28 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-d820b447-7055-47c1-8319-e02a5ffcf5a4 None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:00:28 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d820b447-7055-47c1-8319-e02a5ffcf5a4 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:28 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7b386e-da1e-4e89-bb26-cfa1627edb2e None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:28 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7b386e-da1e-4e89-bb26-cfa1627edb2e None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:28 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7b386e-da1e-4e89-bb26-cfa1627edb2e None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:28 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7b386e-da1e-4e89-bb26-cfa1627edb2e None admin] PATH_INFO: `/v3/users/331dd8e64cda49cfa79d4430fdeb4629` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:28 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7b386e-da1e-4e89-bb26-cfa1627edb2e None admin] RBAC: Authorizing `identity:delete_user(user_id=331dd8e64cda49cfa79d4430fdeb4629)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:28 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7b386e-da1e-4e89-bb26-cfa1627edb2e None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:28 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-2c7b386e-da1e-4e89-bb26-cfa1627edb2e None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '331dd8e64cda49cfa79d4430fdeb4629', 'request_id': 'req-2c7b386e-da1e-4e89-bb26-cfa1627edb2e'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:28 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-2c7b386e-da1e-4e89-bb26-cfa1627edb2e None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '331dd8e64cda49cfa79d4430fdeb4629', 'request_id': 'req-2c7b386e-da1e-4e89-bb26-cfa1627edb2e'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:28 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-2c7b386e-da1e-4e89-bb26-cfa1627edb2e None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '331dd8e64cda49cfa79d4430fdeb4629', 'request_id': 'req-2c7b386e-da1e-4e89-bb26-cfa1627edb2e'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:28 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-2c7b386e-da1e-4e89-bb26-cfa1627edb2e None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '331dd8e64cda49cfa79d4430fdeb4629', 'request_id': 'req-2c7b386e-da1e-4e89-bb26-cfa1627edb2e'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:28 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-2c7b386e-da1e-4e89-bb26-cfa1627edb2e None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '331dd8e64cda49cfa79d4430fdeb4629', 'request_id': 'req-2c7b386e-da1e-4e89-bb26-cfa1627edb2e'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:28 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1393/2814] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 13:00:28 2024] DELETE /identity/v3/users/331dd8e64cda49cfa79d4430fdeb4629 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:00:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee7d159-5803-4d45-840c-549574bd3f7f None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee7d159-5803-4d45-840c-549574bd3f7f None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee7d159-5803-4d45-840c-549574bd3f7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:28 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-8ee7d159-5803-4d45-840c-549574bd3f7f None None] Truncating password to algorithm specific maximum length 72 characters. May 28 13:00:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-8ee7d159-5803-4d45-840c-549574bd3f7f None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 13:00:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-8ee7d159-5803-4d45-840c-549574bd3f7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:00:28 l75lg1-v1 dstat.sh[49771]: 28-05 13:00:28| 13 3 79 5 0|5686M 1765M 278M 7896M| 18k 1497B| 256k 6955k|2.00 614 |9535 17k|1.51 1.15 1.04|2.0 1.0 11| 0 0 | 0 2048M| 29 362 0 41 2 May 28 13:00:28 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1422/2815] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 13:00:28 2024] POST /identity/v3/auth/tokens => generated 2960 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 13:00:28 l75lg1-v1 neutron-server[77618]: DEBUG neutron.wsgi [-] (77618) accepted ('10.27.203.238', 40464) {{(pid=77618) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 13:00:28 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7b386e-da1e-4e89-bb26-cfa1627edb2e None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:28 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-2c7b386e-da1e-4e89-bb26-cfa1627edb2e None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:00:28 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7b386e-da1e-4e89-bb26-cfa1627edb2e None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:28 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5a9429-189e-44b1-ba90-a5d631568132 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef17047035e4b518fd5360a01f2da1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:28 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5a9429-189e-44b1-ba90-a5d631568132 service neutron] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:28 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5a9429-189e-44b1-ba90-a5d631568132 service neutron] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:28 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5a9429-189e-44b1-ba90-a5d631568132 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:28 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5a9429-189e-44b1-ba90-a5d631568132 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:28 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5a9429-189e-44b1-ba90-a5d631568132 service neutron] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:28 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1394/2816] 10.27.203.238 () {64 vars in 1432 bytes} [Tue May 28 13:00:28 2024] GET /identity/v3/auth/tokens => generated 2960 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 28 13:00:28 l75lg1-v1 neutron-server[77618]: INFO neutron.wsgi [None req-056eec6d-9c33-494e-a5fe-159bcc3acf39 None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=9a3ff659931047a1bd9b6864af365142&name=default HTTP/1.1" status: 200 len: 216 time: 0.0702875 May 28 13:00:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee7d159-5803-4d45-840c-549574bd3f7f None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-8ee7d159-5803-4d45-840c-549574bd3f7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:00:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee7d159-5803-4d45-840c-549574bd3f7f None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009625cd-4e4c-400f-86ff-a8829543333c None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009625cd-4e4c-400f-86ff-a8829543333c None admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009625cd-4e4c-400f-86ff-a8829543333c None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009625cd-4e4c-400f-86ff-a8829543333c None admin] PATH_INFO: `/v3/projects/9a3ff659931047a1bd9b6864af365142` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009625cd-4e4c-400f-86ff-a8829543333c None admin] RBAC: Authorizing `identity:delete_project(project_id=9a3ff659931047a1bd9b6864af365142)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009625cd-4e4c-400f-86ff-a8829543333c None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-009625cd-4e4c-400f-86ff-a8829543333c None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a3ff659931047a1bd9b6864af365142', 'request_id': 'req-009625cd-4e4c-400f-86ff-a8829543333c'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-009625cd-4e4c-400f-86ff-a8829543333c None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a3ff659931047a1bd9b6864af365142', 'request_id': 'req-009625cd-4e4c-400f-86ff-a8829543333c'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-009625cd-4e4c-400f-86ff-a8829543333c None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a3ff659931047a1bd9b6864af365142', 'request_id': 'req-009625cd-4e4c-400f-86ff-a8829543333c'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-009625cd-4e4c-400f-86ff-a8829543333c None admin] The token cache is being invalidate because project 9a3ff659931047a1bd9b6864af365142 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 13:00:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-009625cd-4e4c-400f-86ff-a8829543333c None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-009625cd-4e4c-400f-86ff-a8829543333c None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:28 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1423/2817] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 13:00:28 2024] DELETE /identity/v3/projects/9a3ff659931047a1bd9b6864af365142 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:00:28 l75lg1-v1 neutron-server[77618]: DEBUG neutron.wsgi [-] (77618) accepted ('10.27.203.238', 40476) {{(pid=77618) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 13:00:28 l75lg1-v1 neutron-server[77618]: INFO neutron.wsgi [None req-cc2446ee-f069-4df3-81e7-ba7f9e9a97b1 None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=10f017758f4e4b5381145aa958076664&name=default HTTP/1.1" status: 200 len: 216 time: 0.0093381 May 28 13:00:28 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5a9429-189e-44b1-ba90-a5d631568132 service neutron] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:28 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5a9429-189e-44b1-ba90-a5d631568132 service neutron] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:28 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f2098c-4e51-4614-b9f4-ea51596515b4 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:28 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f2098c-4e51-4614-b9f4-ea51596515b4 None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:28 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f2098c-4e51-4614-b9f4-ea51596515b4 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:28 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f2098c-4e51-4614-b9f4-ea51596515b4 None admin] PATH_INFO: `/v3/projects/10f017758f4e4b5381145aa958076664` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:28 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f2098c-4e51-4614-b9f4-ea51596515b4 None admin] RBAC: Authorizing `identity:delete_project(project_id=10f017758f4e4b5381145aa958076664)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:28 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f2098c-4e51-4614-b9f4-ea51596515b4 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:28 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-e1f2098c-4e51-4614-b9f4-ea51596515b4 None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10f017758f4e4b5381145aa958076664', 'request_id': 'req-e1f2098c-4e51-4614-b9f4-ea51596515b4'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:28 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-e1f2098c-4e51-4614-b9f4-ea51596515b4 None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10f017758f4e4b5381145aa958076664', 'request_id': 'req-e1f2098c-4e51-4614-b9f4-ea51596515b4'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:28 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-e1f2098c-4e51-4614-b9f4-ea51596515b4 None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10f017758f4e4b5381145aa958076664', 'request_id': 'req-e1f2098c-4e51-4614-b9f4-ea51596515b4'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:28 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-e1f2098c-4e51-4614-b9f4-ea51596515b4 None admin] The token cache is being invalidate because project 10f017758f4e4b5381145aa958076664 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 13:00:28 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-e1f2098c-4e51-4614-b9f4-ea51596515b4 None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:28 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-e1f2098c-4e51-4614-b9f4-ea51596515b4 None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:28 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1395/2818] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 13:00:28 2024] DELETE /identity/v3/projects/10f017758f4e4b5381145aa958076664 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:00:28 l75lg1-v1 neutron-server[77618]: DEBUG neutron.wsgi [-] (77618) accepted ('10.27.203.238', 40488) {{(pid=77618) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 13:00:28 l75lg1-v1 neutron-server[77618]: INFO neutron.wsgi [None req-c0255ca1-ba42-428e-b0af-f5aa5572154d None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=4a6a71724c0c476588127b06c11dec79&name=default HTTP/1.1" status: 200 len: 216 time: 0.0079963 May 28 13:00:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009625cd-4e4c-400f-86ff-a8829543333c None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-009625cd-4e4c-400f-86ff-a8829543333c None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:00:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009625cd-4e4c-400f-86ff-a8829543333c None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:28 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-7488f347-347a-4fc8-988e-d977faabc231 tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] GET http://10.27.203.238/share/v2/cac556dc39a14bbdbdbabfc80672fb1f/shares/a6923a53-b5dd-4f5b-803b-5f00144de747 May 28 13:00:28 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-7488f347-347a-4fc8-988e-d977faabc231 tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:28 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-7488f347-347a-4fc8-988e-d977faabc231 tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7650ae-1bf9-41bd-98f7-081fbff04501 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7650ae-1bf9-41bd-98f7-081fbff04501 None admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7650ae-1bf9-41bd-98f7-081fbff04501 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7650ae-1bf9-41bd-98f7-081fbff04501 None admin] PATH_INFO: `/v3/projects/4a6a71724c0c476588127b06c11dec79` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7650ae-1bf9-41bd-98f7-081fbff04501 None admin] RBAC: Authorizing `identity:delete_project(project_id=4a6a71724c0c476588127b06c11dec79)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7650ae-1bf9-41bd-98f7-081fbff04501 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:28 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-7488f347-347a-4fc8-988e-d977faabc231 tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] http://10.27.203.238/share/v2/cac556dc39a14bbdbdbabfc80672fb1f/shares/a6923a53-b5dd-4f5b-803b-5f00144de747 returned with HTTP 200 May 28 13:00:28 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 911/1796] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:00:28 2024] GET /share/v2/cac556dc39a14bbdbdbabfc80672fb1f/shares/a6923a53-b5dd-4f5b-803b-5f00144de747 => generated 1314 bytes in 26 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:00:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-0b7650ae-1bf9-41bd-98f7-081fbff04501 None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a6a71724c0c476588127b06c11dec79', 'request_id': 'req-0b7650ae-1bf9-41bd-98f7-081fbff04501'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-0b7650ae-1bf9-41bd-98f7-081fbff04501 None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a6a71724c0c476588127b06c11dec79', 'request_id': 'req-0b7650ae-1bf9-41bd-98f7-081fbff04501'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-0b7650ae-1bf9-41bd-98f7-081fbff04501 None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a6a71724c0c476588127b06c11dec79', 'request_id': 'req-0b7650ae-1bf9-41bd-98f7-081fbff04501'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-0b7650ae-1bf9-41bd-98f7-081fbff04501 None admin] The token cache is being invalidate because project 4a6a71724c0c476588127b06c11dec79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 13:00:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-0b7650ae-1bf9-41bd-98f7-081fbff04501 None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-0b7650ae-1bf9-41bd-98f7-081fbff04501 None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:28 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1424/2819] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 13:00:28 2024] DELETE /identity/v3/projects/4a6a71724c0c476588127b06c11dec79 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:00:28 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83565078-8c4f-4f59-a95e-ea033a322ac9 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:28 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83565078-8c4f-4f59-a95e-ea033a322ac9 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:28 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83565078-8c4f-4f59-a95e-ea033a322ac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:28 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-83565078-8c4f-4f59-a95e-ea033a322ac9 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 13:00:28 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-83565078-8c4f-4f59-a95e-ea033a322ac9 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 13:00:28 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-83565078-8c4f-4f59-a95e-ea033a322ac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:00:28 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1396/2820] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 13:00:28 2024] POST /identity/v3/auth/tokens => generated 312 bytes in 19 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 28 13:00:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacb5e52-d38b-4218-b16a-c51d3e8bda9e None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacb5e52-d38b-4218-b16a-c51d3e8bda9e None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacb5e52-d38b-4218-b16a-c51d3e8bda9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:28 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-5091ec63-b127-490a-ba42-6df40d830b35 tempest-ShareRulesTest-1530341375 None] <<< [POST] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:00:28 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-5091ec63-b127-490a-ba42-6df40d830b35 tempest-ShareRulesTest-1530341375 None] Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=0, created='2024-05-28T13:00:28.342982Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='ab44815a-6cee-4df3-a9a3-333372151587', id=44, internal=False, is_s3_default_policy=False, name='5eddb781-43d4-4883-ae43-e9856f3a4c10', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=[], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['*'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['*'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T13:00:28.675597Z', tenant_id=1, tenant_name='default', title='5eddb781-43d4-4883-ae43-e9856f3a4c10', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/44/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[]) May 28 13:00:28 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-5091ec63-b127-490a-ba42-6df40d830b35 tempest-ShareRulesTest-1530341375 None] --- [POST] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 13:00:28 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-5091ec63-b127-490a-ba42-6df40d830b35 tempest-ShareRulesTest-1530341375 None] >>> [GET] https://127.0.0.1:40443/api/quotas/ May 28 13:00:28 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-5091ec63-b127-490a-ba42-6df40d830b35 tempest-ShareRulesTest-1530341375 None] {'allow_redirects': True, May 28 13:00:28 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-5091ec63-b127-490a-ba42-6df40d830b35 tempest-ShareRulesTest-1530341375 None] 'params': {'name': '5eddb781-43d4-4883-ae43-e9856f3a4c10'}} May 28 13:00:28 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-aacb5e52-d38b-4218-b16a-c51d3e8bda9e None None] Truncating password to algorithm specific maximum length 72 characters. May 28 13:00:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-aacb5e52-d38b-4218-b16a-c51d3e8bda9e None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 13:00:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-aacb5e52-d38b-4218-b16a-c51d3e8bda9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:00:28 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1425/2821] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 13:00:28 2024] POST /identity/v3/auth/tokens => generated 2960 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 13:00:28 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83565078-8c4f-4f59-a95e-ea033a322ac9 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:28 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83565078-8c4f-4f59-a95e-ea033a322ac9 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:28 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65586ed1-15e9-497c-af9b-953becd144cb None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:28 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65586ed1-15e9-497c-af9b-953becd144cb None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:28 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65586ed1-15e9-497c-af9b-953becd144cb None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:28 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65586ed1-15e9-497c-af9b-953becd144cb None admin] PATH_INFO: `/v3/domains` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:28 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65586ed1-15e9-497c-af9b-953becd144cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 13:00:28 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65586ed1-15e9-497c-af9b-953becd144cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:28 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65586ed1-15e9-497c-af9b-953becd144cb None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:28 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1397/2822] 10.27.203.238 () {62 vars in 1220 bytes} [Tue May 28 13:00:28 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 13:00:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacb5e52-d38b-4218-b16a-c51d3e8bda9e None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacb5e52-d38b-4218-b16a-c51d3e8bda9e None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103c7a28-ad83-4f78-8003-cc40b3de2e01 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103c7a28-ad83-4f78-8003-cc40b3de2e01 None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103c7a28-ad83-4f78-8003-cc40b3de2e01 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103c7a28-ad83-4f78-8003-cc40b3de2e01 None admin] PATH_INFO: `/v3/projects` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103c7a28-ad83-4f78-8003-cc40b3de2e01 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103c7a28-ad83-4f78-8003-cc40b3de2e01 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:28 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1426/2823] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 13:00:28 2024] POST /identity/v3/projects => generated 391 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 13:00:28 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65586ed1-15e9-497c-af9b-953becd144cb None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:28 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65586ed1-15e9-497c-af9b-953becd144cb None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:28 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cbc2da-7ec2-4266-aa3e-b87f57a8eaad None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:28 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cbc2da-7ec2-4266-aa3e-b87f57a8eaad None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:28 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cbc2da-7ec2-4266-aa3e-b87f57a8eaad None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:28 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cbc2da-7ec2-4266-aa3e-b87f57a8eaad None admin] PATH_INFO: `/v3/users` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:28 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cbc2da-7ec2-4266-aa3e-b87f57a8eaad None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:28 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cbc2da-7ec2-4266-aa3e-b87f57a8eaad None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:28 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-c1cbc2da-7ec2-4266-aa3e-b87f57a8eaad None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 13:00:28 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1398/2824] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 13:00:28 2024] POST /identity/v3/users => generated 304 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 13:00:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103c7a28-ad83-4f78-8003-cc40b3de2e01 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103c7a28-ad83-4f78-8003-cc40b3de2e01 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01f6e4b-6fad-4fe7-809b-748b8b7fd007 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01f6e4b-6fad-4fe7-809b-748b8b7fd007 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01f6e4b-6fad-4fe7-809b-748b8b7fd007 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01f6e4b-6fad-4fe7-809b-748b8b7fd007 None admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01f6e4b-6fad-4fe7-809b-748b8b7fd007 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01f6e4b-6fad-4fe7-809b-748b8b7fd007 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:28 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1427/2825] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 13:00:28 2024] GET /identity/v3/roles => generated 1680 bytes in 16 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 13:00:28 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cbc2da-7ec2-4266-aa3e-b87f57a8eaad None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:28 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cbc2da-7ec2-4266-aa3e-b87f57a8eaad None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:28 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276f3651-5d32-4b8b-9141-5967a363e844 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:28 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276f3651-5d32-4b8b-9141-5967a363e844 None admin] REQUEST_METHOD: `PUT` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:28 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276f3651-5d32-4b8b-9141-5967a363e844 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:28 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276f3651-5d32-4b8b-9141-5967a363e844 None admin] PATH_INFO: `/v3/projects/2150b042403d4dcf974c4f1ca9e74c12/users/ec715434ce2e44bba5fd4e824aba7170/roles/44620cad10ae407c90c91e2c296adb04` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:28 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276f3651-5d32-4b8b-9141-5967a363e844 None admin] RBAC: Authorizing `identity:create_grant(project_id=2150b042403d4dcf974c4f1ca9e74c12, user_id=ec715434ce2e44bba5fd4e824aba7170, role_id=44620cad10ae407c90c91e2c296adb04)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:28 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276f3651-5d32-4b8b-9141-5967a363e844 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:28 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1399/2826] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 13:00:28 2024] PUT /identity/v3/projects/2150b042403d4dcf974c4f1ca9e74c12/users/ec715434ce2e44bba5fd4e824aba7170/roles/44620cad10ae407c90c91e2c296adb04 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:00:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3314bbb6-e127-4e70-8122-3de21b2f0e93 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3314bbb6-e127-4e70-8122-3de21b2f0e93 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:28 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3314bbb6-e127-4e70-8122-3de21b2f0e93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:28 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-3314bbb6-e127-4e70-8122-3de21b2f0e93 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 13:00:29 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-69071ac9-6e4f-4166-bf2f-89a58fab8b17 tempest-UserMessageNegativeTest-781603078 tempest-UserMessageNegativeTest-781603078-project-member] GET http://10.27.203.238/share/v2/ca9b4c5f200844bdbcc6db13e907f21e/messages May 28 13:00:29 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-69071ac9-6e4f-4166-bf2f-89a58fab8b17 tempest-UserMessageNegativeTest-781603078 tempest-UserMessageNegativeTest-781603078-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:29 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-69071ac9-6e4f-4166-bf2f-89a58fab8b17 tempest-UserMessageNegativeTest-781603078 tempest-UserMessageNegativeTest-781603078-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:29 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.message.api [None req-69071ac9-6e4f-4166-bf2f-89a58fab8b17 tempest-UserMessageNegativeTest-781603078 tempest-UserMessageNegativeTest-781603078-project-member] Searching for messages by: MultiDict([]) {{(pid=98330) get_all /opt/stack/manila/manila/message/api.py:78}} May 28 13:00:29 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-69071ac9-6e4f-4166-bf2f-89a58fab8b17 tempest-UserMessageNegativeTest-781603078 tempest-UserMessageNegativeTest-781603078-project-member] http://10.27.203.238/share/v2/ca9b4c5f200844bdbcc6db13e907f21e/messages returned with HTTP 200 May 28 13:00:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-3314bbb6-e127-4e70-8122-3de21b2f0e93 None None] MFA Rules not processed for user `ec715434ce2e44bba5fd4e824aba7170`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 13:00:29 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 886/1797] 10.27.203.238 () {64 vars in 1346 bytes} [Tue May 28 13:00:28 2024] GET /share/v2/ca9b4c5f200844bdbcc6db13e907f21e/messages => generated 2417 bytes in 11 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:00:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-3314bbb6-e127-4e70-8122-3de21b2f0e93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:00:29 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-8c696dcc-44fd-4e24-b7d6-b8f753986417 tempest-UserMessageNegativeTest-781603078 tempest-UserMessageNegativeTest-781603078-project-member] GET http://10.27.203.238/share/v2/ca9b4c5f200844bdbcc6db13e907f21e/messages?created_since=invalid_time May 28 13:00:29 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-8c696dcc-44fd-4e24-b7d6-b8f753986417 tempest-UserMessageNegativeTest-781603078 tempest-UserMessageNegativeTest-781603078-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:29 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-8c696dcc-44fd-4e24-b7d6-b8f753986417 tempest-UserMessageNegativeTest-781603078 tempest-UserMessageNegativeTest-781603078-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:29 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-8c696dcc-44fd-4e24-b7d6-b8f753986417 tempest-UserMessageNegativeTest-781603078 tempest-UserMessageNegativeTest-781603078-project-member] HTTP exception thrown: Invalid value specified for the query key: created_since May 28 13:00:29 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-8c696dcc-44fd-4e24-b7d6-b8f753986417 tempest-UserMessageNegativeTest-781603078 tempest-UserMessageNegativeTest-781603078-project-member] http://10.27.203.238/share/v2/ca9b4c5f200844bdbcc6db13e907f21e/messages?created_since=invalid_time returned with HTTP 400 May 28 13:00:29 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 912/1798] 10.27.203.238 () {64 vars in 1399 bytes} [Tue May 28 13:00:29 2024] GET /share/v2/ca9b4c5f200844bdbcc6db13e907f21e/messages?created_since=invalid_time => generated 100 bytes in 8 msecs (HTTP/1.1 400) 6 headers in 240 bytes (1 switches on core 0) May 28 13:00:29 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-8201bcc3-b44e-495b-b36b-38f6a5f97790 tempest-UserMessageNegativeTest-781603078 tempest-UserMessageNegativeTest-781603078-project-member] GET http://10.27.203.238/share/v2/ca9b4c5f200844bdbcc6db13e907f21e/messages?created_before=invalid_time May 28 13:00:29 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-8201bcc3-b44e-495b-b36b-38f6a5f97790 tempest-UserMessageNegativeTest-781603078 tempest-UserMessageNegativeTest-781603078-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:29 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-8201bcc3-b44e-495b-b36b-38f6a5f97790 tempest-UserMessageNegativeTest-781603078 tempest-UserMessageNegativeTest-781603078-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:29 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-8201bcc3-b44e-495b-b36b-38f6a5f97790 tempest-UserMessageNegativeTest-781603078 tempest-UserMessageNegativeTest-781603078-project-member] HTTP exception thrown: Invalid value specified for the query key: created_before May 28 13:00:29 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-8201bcc3-b44e-495b-b36b-38f6a5f97790 tempest-UserMessageNegativeTest-781603078 tempest-UserMessageNegativeTest-781603078-project-member] http://10.27.203.238/share/v2/ca9b4c5f200844bdbcc6db13e907f21e/messages?created_before=invalid_time returned with HTTP 400 May 28 13:00:29 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 887/1799] 10.27.203.238 () {64 vars in 1401 bytes} [Tue May 28 13:00:29 2024] GET /share/v2/ca9b4c5f200844bdbcc6db13e907f21e/messages?created_before=invalid_time => generated 101 bytes in 6 msecs (HTTP/1.1 400) 6 headers in 240 bytes (1 switches on core 0) May 28 13:00:29 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-74dcf608-1c36-47d2-b4d1-73a1fecd9c00 tempest-UserMessageNegativeTest-781603078 tempest-UserMessageNegativeTest-781603078-project-member] DELETE http://10.27.203.238/share/v2/ca9b4c5f200844bdbcc6db13e907f21e/shares/a94015c0-bde2-41e5-8a32-24098a0bf251 May 28 13:00:29 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-74dcf608-1c36-47d2-b4d1-73a1fecd9c00 tempest-UserMessageNegativeTest-781603078 tempest-UserMessageNegativeTest-781603078-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:29 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-74dcf608-1c36-47d2-b4d1-73a1fecd9c00 tempest-UserMessageNegativeTest-781603078 tempest-UserMessageNegativeTest-781603078-project-member] Calling method 'ShareMixin.delete' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:29 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.v1.shares [None req-74dcf608-1c36-47d2-b4d1-73a1fecd9c00 tempest-UserMessageNegativeTest-781603078 tempest-UserMessageNegativeTest-781603078-project-member] Delete share with id: a94015c0-bde2-41e5-8a32-24098a0bf251 May 28 13:00:29 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1428/2827] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 13:00:28 2024] POST /identity/v3/auth/tokens => generated 3962 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 13:00:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276f3651-5d32-4b8b-9141-5967a363e844 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-276f3651-5d32-4b8b-9141-5967a363e844 None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:00:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276f3651-5d32-4b8b-9141-5967a363e844 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63152d4b-f136-498e-bfba-89804c9cad8e service manila] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f110cf6300f049c897d0aab63218d1e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63152d4b-f136-498e-bfba-89804c9cad8e service manila] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63152d4b-f136-498e-bfba-89804c9cad8e service manila] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63152d4b-f136-498e-bfba-89804c9cad8e service manila] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63152d4b-f136-498e-bfba-89804c9cad8e service manila] RBAC: Authorizing `identity:validate_token()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63152d4b-f136-498e-bfba-89804c9cad8e service manila] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:29 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1400/2828] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 13:00:29 2024] GET /identity/v3/auth/tokens => generated 3962 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 13:00:29 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-80ff4fa3-ef40-4b24-9260-e5d7ae1a3f45 tempest-SecurityServicesMappingTest-771779632 tempest-SecurityServicesMappingTest-771779632-project-member] POST http://10.27.203.238/share/v1/2150b042403d4dcf974c4f1ca9e74c12/share-networks May 28 13:00:29 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-80ff4fa3-ef40-4b24-9260-e5d7ae1a3f45 tempest-SecurityServicesMappingTest-771779632 tempest-SecurityServicesMappingTest-771779632-project-member] Action: 'create', calling method: ShareNetworkController.create, body: {"share_network": {"name": "tempest-sn-name-1237633701", "description": "tempest-sn-desc-380001982", "neutron_net_id": "tempest-net-id-860598335", "neutron_subnet_id": "tempest-subnet-id-378917991"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:00:29 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.quota [None req-80ff4fa3-ef40-4b24-9260-e5d7ae1a3f45 tempest-SecurityServicesMappingTest-771779632 tempest-SecurityServicesMappingTest-771779632-project-member] Created reservations ['d529739e-08f3-4a8d-9e09-f20d253b4597'] {{(pid=98330) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 13:00:29 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-5091ec63-b127-490a-ba42-6df40d830b35 tempest-ShareRulesTest-1530341375 None] <<< [GET] https://127.0.0.1:40443/api/quotas/ May 28 13:00:29 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-5091ec63-b127-490a-ba42-6df40d830b35 tempest-ShareRulesTest-1530341375 None] [] May 28 13:00:29 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-5091ec63-b127-490a-ba42-6df40d830b35 tempest-ShareRulesTest-1530341375 None] --- [GET] https://127.0.0.1:40443/api/quotas/: Done May 28 13:00:29 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-5091ec63-b127-490a-ba42-6df40d830b35 tempest-ShareRulesTest-1530341375 None] >>> [POST] https://127.0.0.1:40443/api/quotas/ May 28 13:00:29 l75lg1-v1 dstat.sh[49771]: 28-05 13:00:29| 11 1 84 3 0|5687M 1764M 278M 7896M| 17k 1586B| 0 1336k| 0 210 |7467 13k|1.51 1.15 1.04|1.0 1.0 0| 0 0 | 0 2048M| 29 363 0 45 2 May 28 13:00:29 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-5091ec63-b127-490a-ba42-6df40d830b35 tempest-ShareRulesTest-1530341375 None] {'data': '{"name": "5eddb781-43d4-4883-ae43-e9856f3a4c10", "path": ' May 28 13:00:29 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-5091ec63-b127-490a-ba42-6df40d830b35 tempest-ShareRulesTest-1530341375 None] '"/manila/manila-5eddb781-43d4-4883-ae43-e9856f3a4c10", "create_dir": ' May 28 13:00:29 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-5091ec63-b127-490a-ba42-6df40d830b35 tempest-ShareRulesTest-1530341375 None] 'true, "hard_limit": 1073741824}', May 28 13:00:29 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-5091ec63-b127-490a-ba42-6df40d830b35 tempest-ShareRulesTest-1530341375 None] 'json': None, May 28 13:00:29 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-5091ec63-b127-490a-ba42-6df40d830b35 tempest-ShareRulesTest-1530341375 None] 'params': None} May 28 13:00:29 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.quota [None req-74dcf608-1c36-47d2-b4d1-73a1fecd9c00 tempest-UserMessageNegativeTest-781603078 tempest-UserMessageNegativeTest-781603078-project-member] Created reservations ['a8704115-7756-412b-8cf6-5fa4909b4a97', 'caa2a49f-cb8e-410f-b9e1-612b957a7741', 'd929b8d2-cd60-4db4-a529-800f5d1c2f44', 'baff89b4-6ac7-4d37-a848-3f9bffa2c760'] {{(pid=98329) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 13:00:29 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.quota [None req-80ff4fa3-ef40-4b24-9260-e5d7ae1a3f45 tempest-SecurityServicesMappingTest-771779632 tempest-SecurityServicesMappingTest-771779632-project-member] Committed reservations ['d529739e-08f3-4a8d-9e09-f20d253b4597'] {{(pid=98330) commit /opt/stack/manila/manila/quota.py:1063}} May 28 13:00:29 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f4706723-1f7b-4c2e-af13-5731a7d30ebc tempest-ShareTransferNegativeTest-884271560 None] <<< [DELETE] https://127.0.0.1:40443/api/quotas/40/ May 28 13:00:29 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f4706723-1f7b-4c2e-af13-5731a7d30ebc tempest-ShareTransferNegativeTest-884271560 None] --- [DELETE] https://127.0.0.1:40443/api/quotas/40/: Done May 28 13:00:29 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f4706723-1f7b-4c2e-af13-5731a7d30ebc tempest-ShareTransferNegativeTest-884271560 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:00:29 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f4706723-1f7b-4c2e-af13-5731a7d30ebc tempest-ShareTransferNegativeTest-884271560 None] {'allow_redirects': True, May 28 13:00:29 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f4706723-1f7b-4c2e-af13-5731a7d30ebc tempest-ShareTransferNegativeTest-884271560 None] 'params': {'name': 'fa81edfd-59ee-49f5-8dbe-094d49593280'}} May 28 13:00:29 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-80ff4fa3-ef40-4b24-9260-e5d7ae1a3f45 tempest-SecurityServicesMappingTest-771779632 tempest-SecurityServicesMappingTest-771779632-project-member] http://10.27.203.238/share/v1/2150b042403d4dcf974c4f1ca9e74c12/share-networks returned with HTTP 200 May 28 13:00:29 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 888/1800] 10.27.203.238 () {64 vars in 1343 bytes} [Tue May 28 13:00:29 2024] POST /share/v1/2150b042403d4dcf974c4f1ca9e74c12/share-networks => generated 461 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:00:29 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-49fa9a7c-267a-4579-ac9e-1b82e998a6d8 tempest-SecurityServicesMappingTest-771779632 tempest-SecurityServicesMappingTest-771779632-project-member] POST http://10.27.203.238/share/v1/2150b042403d4dcf974c4f1ca9e74c12/security-services May 28 13:00:29 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-49fa9a7c-267a-4579-ac9e-1b82e998a6d8 tempest-SecurityServicesMappingTest-771779632 tempest-SecurityServicesMappingTest-771779632-project-member] Action: 'create', calling method: SecurityServiceController.create, body: {"security_service": {"type": "ldap", "name": "tempest-ss-name-1386592993", "description": "tempest-ss-desc-997158251", "dns_ip": "203.0.113.222", "server": "203.0.113.118", "domain": "tempest-ss-domain-721369251", "user": "tempest-ss-user-1074183554", "password": "***"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:00:29 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.quota [None req-74dcf608-1c36-47d2-b4d1-73a1fecd9c00 tempest-UserMessageNegativeTest-781603078 tempest-UserMessageNegativeTest-781603078-project-member] Committed reservations ['a8704115-7756-412b-8cf6-5fa4909b4a97', 'caa2a49f-cb8e-410f-b9e1-612b957a7741', 'd929b8d2-cd60-4db4-a529-800f5d1c2f44', 'baff89b4-6ac7-4d37-a848-3f9bffa2c760'] {{(pid=98329) commit /opt/stack/manila/manila/quota.py:1063}} May 28 13:00:29 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-49fa9a7c-267a-4579-ac9e-1b82e998a6d8 tempest-SecurityServicesMappingTest-771779632 tempest-SecurityServicesMappingTest-771779632-project-member] http://10.27.203.238/share/v1/2150b042403d4dcf974c4f1ca9e74c12/security-services returned with HTTP 200 May 28 13:00:29 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 889/1801] 10.27.203.238 () {64 vars in 1352 bytes} [Tue May 28 13:00:29 2024] POST /share/v1/2150b042403d4dcf974c4f1ca9e74c12/security-services => generated 476 bytes in 22 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:00:29 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-74dcf608-1c36-47d2-b4d1-73a1fecd9c00 tempest-UserMessageNegativeTest-781603078 tempest-UserMessageNegativeTest-781603078-project-member] http://10.27.203.238/share/v2/ca9b4c5f200844bdbcc6db13e907f21e/shares/a94015c0-bde2-41e5-8a32-24098a0bf251 returned with HTTP 202 May 28 13:00:29 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 913/1802] 10.27.203.238 () {64 vars in 1454 bytes} [Tue May 28 13:00:29 2024] DELETE /share/v2/ca9b4c5f200844bdbcc6db13e907f21e/shares/a94015c0-bde2-41e5-8a32-24098a0bf251 => generated 0 bytes in 326 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 13:00:29 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-be7c1e72-ba0b-4a3b-92d7-2b2561128028 tempest-SecurityServicesMappingTest-771779632 tempest-SecurityServicesMappingTest-771779632-project-member] POST http://10.27.203.238/share/v1/2150b042403d4dcf974c4f1ca9e74c12/share-networks/325a20f2-9a55-406d-ac45-cc2b27b2dc30/action May 28 13:00:29 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-be7c1e72-ba0b-4a3b-92d7-2b2561128028 tempest-SecurityServicesMappingTest-771779632 tempest-SecurityServicesMappingTest-771779632-project-member] Action body: b'{"add_security_service": {"security_service_id": "87dfca48-ea2e-4b4c-a12a-98d951e61afb"}}' {{(pid=98330) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 13:00:29 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-be7c1e72-ba0b-4a3b-92d7-2b2561128028 tempest-SecurityServicesMappingTest-771779632 tempest-SecurityServicesMappingTest-771779632-project-member] Action: 'action', calling method: ShareNetworkController.add_security_service, body: {"add_security_service": {"security_service_id": "87dfca48-ea2e-4b4c-a12a-98d951e61afb"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:00:29 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-8ff0d7ed-8cab-45b5-ae07-08ab752147ee tempest-UserMessageNegativeTest-278135351 tempest-UserMessageNegativeTest-278135351-project-admin] POST http://10.27.203.238/share/v2/7942989ad1ef4db2b2e923f7316c8511/types May 28 13:00:29 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-8ff0d7ed-8cab-45b5-ae07-08ab752147ee tempest-UserMessageNegativeTest-278135351 tempest-UserMessageNegativeTest-278135351-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share_type": {"name": "tempest-share-type-502973820", "extra_specs": {"driver_handles_share_servers": false, "vendor_name": "foobar"}, "share_type_access:is_public": true}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:00:29 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-8ff0d7ed-8cab-45b5-ae07-08ab752147ee tempest-UserMessageNegativeTest-278135351 tempest-UserMessageNegativeTest-278135351-project-admin] http://10.27.203.238/share/v2/7942989ad1ef4db2b2e923f7316c8511/types returned with HTTP 200 May 28 13:00:29 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 914/1803] 10.27.203.238 () {66 vars in 1359 bytes} [Tue May 28 13:00:29 2024] POST /share/v2/7942989ad1ef4db2b2e923f7316c8511/types => generated 659 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:00:29 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-1239f354-9137-4a14-88c3-8f0d829948f0 tempest-UserMessageNegativeTest-781603078 tempest-UserMessageNegativeTest-781603078-project-member] POST http://10.27.203.238/share/v2/ca9b4c5f200844bdbcc6db13e907f21e/shares May 28 13:00:29 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-1239f354-9137-4a14-88c3-8f0d829948f0 tempest-UserMessageNegativeTest-781603078 tempest-UserMessageNegativeTest-781603078-project-member] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share": {"share_proto": "nfs", "description": "tempest-tempest-created-share-desc-979498279", "snapshot_id": null, "name": "tempest-tempest-created-share-1978638209", "size": 1, "metadata": {}, "is_public": false, "share_type": "c9262be3-1b4b-4aba-a74e-efdea4f8422d"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:00:29 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.v1.shares [None req-1239f354-9137-4a14-88c3-8f0d829948f0 tempest-UserMessageNegativeTest-781603078 tempest-UserMessageNegativeTest-781603078-project-member] Create NFS share of 1 GB May 28 13:00:29 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.quota [None req-1239f354-9137-4a14-88c3-8f0d829948f0 tempest-UserMessageNegativeTest-781603078 tempest-UserMessageNegativeTest-781603078-project-member] Created reservations ['03940c8c-6e2d-46c8-af3f-eddf1369bd15', '032a9eaa-c3e0-43ba-9c76-60fb33c58a4a', 'f4e1c699-efe0-4474-9f2c-9ef6fa32bdd1', 'c77c1e2a-ebc1-45d3-981e-31cdd3a94499'] {{(pid=98329) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 13:00:29 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.quota [None req-1239f354-9137-4a14-88c3-8f0d829948f0 tempest-UserMessageNegativeTest-781603078 tempest-UserMessageNegativeTest-781603078-project-member] Committed reservations ['03940c8c-6e2d-46c8-af3f-eddf1369bd15', '032a9eaa-c3e0-43ba-9c76-60fb33c58a4a', 'f4e1c699-efe0-4474-9f2c-9ef6fa32bdd1', 'c77c1e2a-ebc1-45d3-981e-31cdd3a94499'] {{(pid=98329) commit /opt/stack/manila/manila/quota.py:1063}} May 28 13:00:29 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.host_manager [None req-1239f354-9137-4a14-88c3-8f0d829948f0 tempest-UserMessageNegativeTest-781603078 None] Share service is down. (host: l75lg1-v1@generic2). May 28 13:00:29 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.host_manager [None req-1239f354-9137-4a14-88c3-8f0d829948f0 tempest-UserMessageNegativeTest-781603078 None] Share service is down. (host: l75lg1-v1@generic1). May 28 13:00:29 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-1239f354-9137-4a14-88c3-8f0d829948f0 tempest-UserMessageNegativeTest-781603078 None] Starting with 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:80}} May 28 13:00:29 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-1239f354-9137-4a14-88c3-8f0d829948f0 tempest-UserMessageNegativeTest-781603078 None] Filter OnlyHostFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:00:29 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-1239f354-9137-4a14-88c3-8f0d829948f0 tempest-UserMessageNegativeTest-781603078 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:00:29 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.capacity [None req-1239f354-9137-4a14-88c3-8f0d829948f0 tempest-UserMessageNegativeTest-781603078 None] Space information for share creation on host l75lg1-v1@vast#vast (requested / avail): 1/2075 {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/capacity.py:83}} May 28 13:00:29 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-1239f354-9137-4a14-88c3-8f0d829948f0 tempest-UserMessageNegativeTest-781603078 None] Filter CapacityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:00:29 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.utils [None req-1239f354-9137-4a14-88c3-8f0d829948f0 tempest-UserMessageNegativeTest-781603078 None] Share type extra spec requirement "vendor_name=foobar" does not match reported capability "VAST STORAGE" {{(pid=98327) capabilities_satisfied /opt/stack/manila/manila/scheduler/utils.py:185}} May 28 13:00:29 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.capabilities [None req-1239f354-9137-4a14-88c3-8f0d829948f0 tempest-UserMessageNegativeTest-781603078 None] host: 'l75lg1-v1@vast#vast', free_capacity_gb: 2075.6478263456374, pools: None fails resource_type extra_specs requirements {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/capabilities.py:45}} May 28 13:00:29 l75lg1-v1 manila-scheduler[98327]: INFO manila.scheduler.filters.base [None req-1239f354-9137-4a14-88c3-8f0d829948f0 tempest-UserMessageNegativeTest-781603078 None] Filter CapabilitiesFilter returned 0 host(s) May 28 13:00:29 l75lg1-v1 manila-scheduler[98327]: ERROR manila.scheduler.manager [None req-1239f354-9137-4a14-88c3-8f0d829948f0 tempest-UserMessageNegativeTest-781603078 None] Failed to schedule create_share: No valid host was found. Failed to find a weighted host, the last executed filter was CapabilitiesFilter.: manila.exception.NoValidHost: No valid host was found. Failed to find a weighted host, the last executed filter was CapabilitiesFilter. May 28 13:00:29 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-1239f354-9137-4a14-88c3-8f0d829948f0 tempest-UserMessageNegativeTest-781603078 tempest-UserMessageNegativeTest-781603078-project-member] http://10.27.203.238/share/v2/ca9b4c5f200844bdbcc6db13e907f21e/shares returned with HTTP 200 May 28 13:00:29 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 915/1804] 10.27.203.238 () {66 vars in 1362 bytes} [Tue May 28 13:00:29 2024] POST /share/v2/ca9b4c5f200844bdbcc6db13e907f21e/shares => generated 1333 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:00:29 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-51ead249-a242-403a-bd9a-2899e30be7e7 tempest-UserMessageNegativeTest-781603078 tempest-UserMessageNegativeTest-781603078-project-member] GET http://10.27.203.238/share/v2/ca9b4c5f200844bdbcc6db13e907f21e/shares/47cad5db-9d67-4af7-91ff-034b26ea9f93 May 28 13:00:29 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-51ead249-a242-403a-bd9a-2899e30be7e7 tempest-UserMessageNegativeTest-781603078 tempest-UserMessageNegativeTest-781603078-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:29 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-51ead249-a242-403a-bd9a-2899e30be7e7 tempest-UserMessageNegativeTest-781603078 tempest-UserMessageNegativeTest-781603078-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:29 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f4706723-1f7b-4c2e-af13-5731a7d30ebc tempest-ShareTransferNegativeTest-884271560 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:00:29 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f4706723-1f7b-4c2e-af13-5731a7d30ebc tempest-ShareTransferNegativeTest-884271560 None] [Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=0, created='2024-05-28T13:00:17.005002Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='98bbdab2-de2a-46a7-b4c8-2ff696db8c45', id=43, internal=False, is_s3_default_policy=False, name='fa81edfd-59ee-49f5-8dbe-094d49593280', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=[], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['*'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['*'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T13:00:17.384725Z', tenant_id=1, tenant_name='default', title='fa81edfd-59ee-49f5-8dbe-094d49593280', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/43/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[])] May 28 13:00:29 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f4706723-1f7b-4c2e-af13-5731a7d30ebc tempest-ShareTransferNegativeTest-884271560 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 13:00:29 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f4706723-1f7b-4c2e-af13-5731a7d30ebc tempest-ShareTransferNegativeTest-884271560 None] >>> [DELETE] https://127.0.0.1:40443/api/viewpolicies/43/ May 28 13:00:29 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-51ead249-a242-403a-bd9a-2899e30be7e7 tempest-UserMessageNegativeTest-781603078 tempest-UserMessageNegativeTest-781603078-project-member] http://10.27.203.238/share/v2/ca9b4c5f200844bdbcc6db13e907f21e/shares/47cad5db-9d67-4af7-91ff-034b26ea9f93 returned with HTTP 200 May 28 13:00:29 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 916/1805] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:00:29 2024] GET /share/v2/ca9b4c5f200844bdbcc6db13e907f21e/shares/47cad5db-9d67-4af7-91ff-034b26ea9f93 => generated 1333 bytes in 24 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:00:29 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-be7c1e72-ba0b-4a3b-92d7-2b2561128028 tempest-SecurityServicesMappingTest-771779632 tempest-SecurityServicesMappingTest-771779632-project-member] http://10.27.203.238/share/v1/2150b042403d4dcf974c4f1ca9e74c12/share-networks/325a20f2-9a55-406d-ac45-cc2b27b2dc30/action returned with HTTP 200 May 28 13:00:29 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 890/1806] 10.27.203.238 () {64 vars in 1474 bytes} [Tue May 28 13:00:29 2024] POST /share/v1/2150b042403d4dcf974c4f1ca9e74c12/share-networks/325a20f2-9a55-406d-ac45-cc2b27b2dc30/action => generated 461 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:00:29 l75lg1-v1 manila-scheduler[98327]: INFO manila.message.api [None req-1239f354-9137-4a14-88c3-8f0d829948f0 tempest-UserMessageNegativeTest-781603078 None] Creating message record for request_id = req-1239f354-9137-4a14-88c3-8f0d829948f0 May 28 13:00:29 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-4054717a-d346-48c8-8197-25a462851477 tempest-SecurityServicesMappingTest-771779632 tempest-SecurityServicesMappingTest-771779632-project-member] POST http://10.27.203.238/share/v1/2150b042403d4dcf974c4f1ca9e74c12/share-networks/325a20f2-9a55-406d-ac45-cc2b27b2dc30/action May 28 13:00:29 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-4054717a-d346-48c8-8197-25a462851477 tempest-SecurityServicesMappingTest-771779632 tempest-SecurityServicesMappingTest-771779632-project-member] Action body: b'{"remove_security_service": {"security_service_id": "87dfca48-ea2e-4b4c-a12a-98d951e61afb"}}' {{(pid=98329) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 13:00:29 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-4054717a-d346-48c8-8197-25a462851477 tempest-SecurityServicesMappingTest-771779632 tempest-SecurityServicesMappingTest-771779632-project-member] Action: 'action', calling method: ShareNetworkController.remove_security_service, body: {"remove_security_service": {"security_service_id": "87dfca48-ea2e-4b4c-a12a-98d951e61afb"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:00:29 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-4054717a-d346-48c8-8197-25a462851477 tempest-SecurityServicesMappingTest-771779632 tempest-SecurityServicesMappingTest-771779632-project-member] http://10.27.203.238/share/v1/2150b042403d4dcf974c4f1ca9e74c12/share-networks/325a20f2-9a55-406d-ac45-cc2b27b2dc30/action returned with HTTP 200 May 28 13:00:29 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 917/1807] 10.27.203.238 () {64 vars in 1474 bytes} [Tue May 28 13:00:29 2024] POST /share/v1/2150b042403d4dcf974c4f1ca9e74c12/share-networks/325a20f2-9a55-406d-ac45-cc2b27b2dc30/action => generated 461 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:00:29 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-fb2a64fd-398b-4e7a-9bd5-8af7d88a99ec tempest-SecurityServicesMappingTest-771779632 tempest-SecurityServicesMappingTest-771779632-project-member] DELETE http://10.27.203.238/share/v1/2150b042403d4dcf974c4f1ca9e74c12/security-services/87dfca48-ea2e-4b4c-a12a-98d951e61afb May 28 13:00:29 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-fb2a64fd-398b-4e7a-9bd5-8af7d88a99ec tempest-SecurityServicesMappingTest-771779632 tempest-SecurityServicesMappingTest-771779632-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:29 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-fb2a64fd-398b-4e7a-9bd5-8af7d88a99ec tempest-SecurityServicesMappingTest-771779632 tempest-SecurityServicesMappingTest-771779632-project-member] Calling method 'SecurityServiceController.delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:29 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.v1.security_service [None req-fb2a64fd-398b-4e7a-9bd5-8af7d88a99ec tempest-SecurityServicesMappingTest-771779632 tempest-SecurityServicesMappingTest-771779632-project-member] Delete security service with id: 87dfca48-ea2e-4b4c-a12a-98d951e61afb May 28 13:00:29 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-fb2a64fd-398b-4e7a-9bd5-8af7d88a99ec tempest-SecurityServicesMappingTest-771779632 tempest-SecurityServicesMappingTest-771779632-project-member] http://10.27.203.238/share/v1/2150b042403d4dcf974c4f1ca9e74c12/security-services/87dfca48-ea2e-4b4c-a12a-98d951e61afb returned with HTTP 202 May 28 13:00:29 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 891/1808] 10.27.203.238 () {62 vars in 1444 bytes} [Tue May 28 13:00:29 2024] DELETE /share/v1/2150b042403d4dcf974c4f1ca9e74c12/security-services/87dfca48-ea2e-4b4c-a12a-98d951e61afb => generated 0 bytes in 33 msecs (HTTP/1.1 202) 6 headers in 242 bytes (1 switches on core 0) May 28 13:00:29 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-7dd33271-b8b8-48cf-afde-f18920595ca6 tempest-SecurityServicesMappingTest-771779632 tempest-SecurityServicesMappingTest-771779632-project-member] GET http://10.27.203.238/share/v1/2150b042403d4dcf974c4f1ca9e74c12/security-services/87dfca48-ea2e-4b4c-a12a-98d951e61afb May 28 13:00:29 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-7dd33271-b8b8-48cf-afde-f18920595ca6 tempest-SecurityServicesMappingTest-771779632 tempest-SecurityServicesMappingTest-771779632-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:29 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-7dd33271-b8b8-48cf-afde-f18920595ca6 tempest-SecurityServicesMappingTest-771779632 tempest-SecurityServicesMappingTest-771779632-project-member] Calling method 'SecurityServiceController.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:29 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-7dd33271-b8b8-48cf-afde-f18920595ca6 tempest-SecurityServicesMappingTest-771779632 tempest-SecurityServicesMappingTest-771779632-project-member] HTTP exception thrown: The resource could not be found. May 28 13:00:29 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-7dd33271-b8b8-48cf-afde-f18920595ca6 tempest-SecurityServicesMappingTest-771779632 tempest-SecurityServicesMappingTest-771779632-project-member] http://10.27.203.238/share/v1/2150b042403d4dcf974c4f1ca9e74c12/security-services/87dfca48-ea2e-4b4c-a12a-98d951e61afb returned with HTTP 404 May 28 13:00:29 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 918/1809] 10.27.203.238 () {62 vars in 1441 bytes} [Tue May 28 13:00:29 2024] GET /share/v1/2150b042403d4dcf974c4f1ca9e74c12/security-services/87dfca48-ea2e-4b4c-a12a-98d951e61afb => generated 78 bytes in 8 msecs (HTTP/1.1 404) 6 headers in 236 bytes (1 switches on core 0) May 28 13:00:29 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-10d2b094-e217-4a08-ba5f-835790587efe tempest-SecurityServicesMappingTest-771779632 tempest-SecurityServicesMappingTest-771779632-project-member] DELETE http://10.27.203.238/share/v1/2150b042403d4dcf974c4f1ca9e74c12/share-networks/325a20f2-9a55-406d-ac45-cc2b27b2dc30 May 28 13:00:29 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-10d2b094-e217-4a08-ba5f-835790587efe tempest-SecurityServicesMappingTest-771779632 tempest-SecurityServicesMappingTest-771779632-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:29 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-10d2b094-e217-4a08-ba5f-835790587efe tempest-SecurityServicesMappingTest-771779632 tempest-SecurityServicesMappingTest-771779632-project-member] Calling method 'ShareNetworkController.delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:29 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.quota [None req-10d2b094-e217-4a08-ba5f-835790587efe tempest-SecurityServicesMappingTest-771779632 tempest-SecurityServicesMappingTest-771779632-project-member] Created reservations ['20e01189-8312-479e-90b7-d8b7da72e891'] {{(pid=98330) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 13:00:29 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.quota [None req-10d2b094-e217-4a08-ba5f-835790587efe tempest-SecurityServicesMappingTest-771779632 tempest-SecurityServicesMappingTest-771779632-project-member] Committed reservations ['20e01189-8312-479e-90b7-d8b7da72e891'] {{(pid=98330) commit /opt/stack/manila/manila/quota.py:1063}} May 28 13:00:29 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-10d2b094-e217-4a08-ba5f-835790587efe tempest-SecurityServicesMappingTest-771779632 tempest-SecurityServicesMappingTest-771779632-project-member] http://10.27.203.238/share/v1/2150b042403d4dcf974c4f1ca9e74c12/share-networks/325a20f2-9a55-406d-ac45-cc2b27b2dc30 returned with HTTP 202 May 28 13:00:29 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 892/1810] 10.27.203.238 () {62 vars in 1435 bytes} [Tue May 28 13:00:29 2024] DELETE /share/v1/2150b042403d4dcf974c4f1ca9e74c12/share-networks/325a20f2-9a55-406d-ac45-cc2b27b2dc30 => generated 0 bytes in 128 msecs (HTTP/1.1 202) 6 headers in 242 bytes (1 switches on core 0) May 28 13:00:29 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-cfe90cb8-f85c-4b6d-ae9b-6c4561be206b tempest-SecurityServicesMappingTest-771779632 tempest-SecurityServicesMappingTest-771779632-project-member] GET http://10.27.203.238/share/v1/2150b042403d4dcf974c4f1ca9e74c12/share-networks/325a20f2-9a55-406d-ac45-cc2b27b2dc30 May 28 13:00:29 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-cfe90cb8-f85c-4b6d-ae9b-6c4561be206b tempest-SecurityServicesMappingTest-771779632 tempest-SecurityServicesMappingTest-771779632-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:29 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-cfe90cb8-f85c-4b6d-ae9b-6c4561be206b tempest-SecurityServicesMappingTest-771779632 tempest-SecurityServicesMappingTest-771779632-project-member] Calling method 'ShareNetworkController.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:29 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-cfe90cb8-f85c-4b6d-ae9b-6c4561be206b tempest-SecurityServicesMappingTest-771779632 tempest-SecurityServicesMappingTest-771779632-project-member] HTTP exception thrown: Share network 325a20f2-9a55-406d-ac45-cc2b27b2dc30 could not be found. May 28 13:00:29 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-cfe90cb8-f85c-4b6d-ae9b-6c4561be206b tempest-SecurityServicesMappingTest-771779632 tempest-SecurityServicesMappingTest-771779632-project-member] http://10.27.203.238/share/v1/2150b042403d4dcf974c4f1ca9e74c12/share-networks/325a20f2-9a55-406d-ac45-cc2b27b2dc30 returned with HTTP 404 May 28 13:00:29 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 919/1811] 10.27.203.238 () {62 vars in 1432 bytes} [Tue May 28 13:00:29 2024] GET /share/v1/2150b042403d4dcf974c4f1ca9e74c12/share-networks/325a20f2-9a55-406d-ac45-cc2b27b2dc30 => generated 116 bytes in 17 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 13:00:29 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-562eed2f-61b7-4a48-bafa-68d49b4b4573 tempest-SecurityServicesMappingTest-771779632 tempest-SecurityServicesMappingTest-771779632-project-member] POST http://10.27.203.238/share/v1/2150b042403d4dcf974c4f1ca9e74c12/share-networks May 28 13:00:29 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-562eed2f-61b7-4a48-bafa-68d49b4b4573 tempest-SecurityServicesMappingTest-771779632 tempest-SecurityServicesMappingTest-771779632-project-member] Action: 'create', calling method: ShareNetworkController.create, body: {"share_network": {"name": "tempest-sn-name-1004010064", "description": "tempest-sn-desc-868239619", "neutron_net_id": "tempest-net-id-1463077754", "neutron_subnet_id": "tempest-subnet-id-1568486219"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:00:29 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.quota [None req-562eed2f-61b7-4a48-bafa-68d49b4b4573 tempest-SecurityServicesMappingTest-771779632 tempest-SecurityServicesMappingTest-771779632-project-member] Created reservations ['e8c0904f-650d-4620-96ad-8d7cbb59d6ef'] {{(pid=98330) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 13:00:29 l75lg1-v1 nova-conductor[83648]: DEBUG dbcounter [-] [83648] Writing DB stats nova_cell1:SELECT=1 {{(pid=83648) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:00:30 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-5091ec63-b127-490a-ba42-6df40d830b35 tempest-ShareRulesTest-1530341375 None] <<< [POST] https://127.0.0.1:40443/api/quotas/ May 28 13:00:30 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-5091ec63-b127-490a-ba42-6df40d830b35 tempest-ShareRulesTest-1530341375 None] Bunch(cluster='loop75-kfs', cluster_id=1, default_email=None, default_group_quota=None, default_user_quota=None, enable_alarms=True, enable_email_providers=True, grace_period=None, group_quotas=[], guid='6d38b950-be34-4831-a246-2c88464878ab', hard_limit=1073741824, hard_limit_inodes=None, id=41, internal=False, is_user_quota=False, last_user_quotas_update=None, name='5eddb781-43d4-4883-ae43-e9856f3a4c10', num_blocked_users=0, num_exceeded_users=0, path='/manila/manila-5eddb781-43d4-4883-ae43-e9856f3a4c10', percent_capacity=0, percent_inodes=None, pretty_grace_period=None, pretty_grace_period_expiration=None, pretty_state='OK (CREATED)', soft_limit=None, soft_limit_inodes=None, state='OK', sync_state='CREATED', system_id=41, tenant_id=1, tenant_name='default', time_to_block=None, title='5eddb781-43d4-4883-ae43-e9856f3a4c10', url='https://127.0.0.1:40443/api/quotas/41/', used_capacity=0, used_capacity_tb=0.0, used_effective_capacity=0, used_effective_capacity_tb=0.0, used_inodes=0, used_limited_capacity=0, user_quotas=[]) May 28 13:00:30 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-5091ec63-b127-490a-ba42-6df40d830b35 tempest-ShareRulesTest-1530341375 None] --- [POST] https://127.0.0.1:40443/api/quotas/: Done May 28 13:00:30 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-5091ec63-b127-490a-ba42-6df40d830b35 tempest-ShareRulesTest-1530341375 None] >>> [GET] https://127.0.0.1:40443/api/views/ May 28 13:00:30 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-5091ec63-b127-490a-ba42-6df40d830b35 tempest-ShareRulesTest-1530341375 None] {'allow_redirects': True, May 28 13:00:30 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-5091ec63-b127-490a-ba42-6df40d830b35 tempest-ShareRulesTest-1530341375 None] 'params': {'name': '5eddb781-43d4-4883-ae43-e9856f3a4c10'}} May 28 13:00:30 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.quota [None req-562eed2f-61b7-4a48-bafa-68d49b4b4573 tempest-SecurityServicesMappingTest-771779632 tempest-SecurityServicesMappingTest-771779632-project-member] Committed reservations ['e8c0904f-650d-4620-96ad-8d7cbb59d6ef'] {{(pid=98330) commit /opt/stack/manila/manila/quota.py:1063}} May 28 13:00:30 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-7271658c-ecb1-4786-b400-453ce57b4a8e tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] GET http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/shares/f4283c2a-3835-416e-9703-f5745babbf5c May 28 13:00:30 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-7271658c-ecb1-4786-b400-453ce57b4a8e tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:30 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-7271658c-ecb1-4786-b400-453ce57b4a8e tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:30 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-562eed2f-61b7-4a48-bafa-68d49b4b4573 tempest-SecurityServicesMappingTest-771779632 tempest-SecurityServicesMappingTest-771779632-project-member] http://10.27.203.238/share/v1/2150b042403d4dcf974c4f1ca9e74c12/share-networks returned with HTTP 200 May 28 13:00:30 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 893/1812] 10.27.203.238 () {64 vars in 1343 bytes} [Tue May 28 13:00:29 2024] POST /share/v1/2150b042403d4dcf974c4f1ca9e74c12/share-networks => generated 463 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:00:30 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-7271658c-ecb1-4786-b400-453ce57b4a8e tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/shares/f4283c2a-3835-416e-9703-f5745babbf5c returned with HTTP 200 May 28 13:00:30 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 920/1813] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:00:30 2024] GET /share/v2/a4f3887fa28c457390f5b66615564430/shares/f4283c2a-3835-416e-9703-f5745babbf5c => generated 1314 bytes in 26 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:00:30 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-32e51490-8311-4b27-af71-3b855db1298f tempest-SecurityServicesMappingTest-771779632 tempest-SecurityServicesMappingTest-771779632-project-member] POST http://10.27.203.238/share/v1/2150b042403d4dcf974c4f1ca9e74c12/security-services May 28 13:00:30 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-32e51490-8311-4b27-af71-3b855db1298f tempest-SecurityServicesMappingTest-771779632 tempest-SecurityServicesMappingTest-771779632-project-member] Action: 'create', calling method: SecurityServiceController.create, body: {"security_service": {"type": "ldap", "name": "tempest-ss-name-942052735", "description": "tempest-ss-desc-1091748201", "dns_ip": "203.0.113.222", "server": "203.0.113.159", "domain": "tempest-ss-domain-476167831", "user": "tempest-ss-user-1739250814", "password": "***"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:00:30 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-32e51490-8311-4b27-af71-3b855db1298f tempest-SecurityServicesMappingTest-771779632 tempest-SecurityServicesMappingTest-771779632-project-member] http://10.27.203.238/share/v1/2150b042403d4dcf974c4f1ca9e74c12/security-services returned with HTTP 200 May 28 13:00:30 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 894/1814] 10.27.203.238 () {64 vars in 1352 bytes} [Tue May 28 13:00:30 2024] POST /share/v1/2150b042403d4dcf974c4f1ca9e74c12/security-services => generated 475 bytes in 25 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:00:30 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-ea321649-5dd4-473f-95dd-ed810d2e5670 tempest-SecurityServicesMappingTest-771779632 tempest-SecurityServicesMappingTest-771779632-project-member] POST http://10.27.203.238/share/v1/2150b042403d4dcf974c4f1ca9e74c12/share-networks/b9ed98ea-224f-4025-b996-7314112ad32d/action May 28 13:00:30 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-ea321649-5dd4-473f-95dd-ed810d2e5670 tempest-SecurityServicesMappingTest-771779632 tempest-SecurityServicesMappingTest-771779632-project-member] Action body: b'{"add_security_service": {"security_service_id": "1f84f081-2a88-4a37-8390-4dea9bef9ad4"}}' {{(pid=98329) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 13:00:30 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-ea321649-5dd4-473f-95dd-ed810d2e5670 tempest-SecurityServicesMappingTest-771779632 tempest-SecurityServicesMappingTest-771779632-project-member] Action: 'action', calling method: ShareNetworkController.add_security_service, body: {"add_security_service": {"security_service_id": "1f84f081-2a88-4a37-8390-4dea9bef9ad4"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:00:30 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-ea321649-5dd4-473f-95dd-ed810d2e5670 tempest-SecurityServicesMappingTest-771779632 tempest-SecurityServicesMappingTest-771779632-project-member] http://10.27.203.238/share/v1/2150b042403d4dcf974c4f1ca9e74c12/share-networks/b9ed98ea-224f-4025-b996-7314112ad32d/action returned with HTTP 200 May 28 13:00:30 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 921/1815] 10.27.203.238 () {64 vars in 1474 bytes} [Tue May 28 13:00:30 2024] POST /share/v1/2150b042403d4dcf974c4f1ca9e74c12/share-networks/b9ed98ea-224f-4025-b996-7314112ad32d/action => generated 463 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:00:30 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-6d53ee94-c2bb-4214-9da9-3dfa1fcfe219 tempest-SecurityServicesMappingTest-771779632 tempest-SecurityServicesMappingTest-771779632-project-member] GET http://10.27.203.238/share/v1/2150b042403d4dcf974c4f1ca9e74c12/security-services?share_network_id=b9ed98ea-224f-4025-b996-7314112ad32d May 28 13:00:30 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-6d53ee94-c2bb-4214-9da9-3dfa1fcfe219 tempest-SecurityServicesMappingTest-771779632 tempest-SecurityServicesMappingTest-771779632-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:30 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-6d53ee94-c2bb-4214-9da9-3dfa1fcfe219 tempest-SecurityServicesMappingTest-771779632 tempest-SecurityServicesMappingTest-771779632-project-member] Calling method 'SecurityServiceController.index' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:30 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.common [None req-6d53ee94-c2bb-4214-9da9-3dfa1fcfe219 tempest-SecurityServicesMappingTest-771779632 tempest-SecurityServicesMappingTest-771779632-project-member] Removing options '' from query {{(pid=98330) remove_invalid_options /opt/stack/manila/manila/api/common.py:441}} May 28 13:00:30 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-6d53ee94-c2bb-4214-9da9-3dfa1fcfe219 tempest-SecurityServicesMappingTest-771779632 tempest-SecurityServicesMappingTest-771779632-project-member] http://10.27.203.238/share/v1/2150b042403d4dcf974c4f1ca9e74c12/security-services?share_network_id=b9ed98ea-224f-4025-b996-7314112ad32d returned with HTTP 200 May 28 13:00:30 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 895/1816] 10.27.203.238 () {62 vars in 1437 bytes} [Tue May 28 13:00:30 2024] GET /share/v1/2150b042403d4dcf974c4f1ca9e74c12/security-services?share_network_id=b9ed98ea-224f-4025-b996-7314112ad32d => generated 141 bytes in 31 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:00:30 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-1a6ccd53-2718-48f7-a9bd-a6d4c373106c tempest-SecurityServicesMappingTest-771779632 tempest-SecurityServicesMappingTest-771779632-project-member] DELETE http://10.27.203.238/share/v1/2150b042403d4dcf974c4f1ca9e74c12/security-services/1f84f081-2a88-4a37-8390-4dea9bef9ad4 May 28 13:00:30 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-1a6ccd53-2718-48f7-a9bd-a6d4c373106c tempest-SecurityServicesMappingTest-771779632 tempest-SecurityServicesMappingTest-771779632-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:30 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-1a6ccd53-2718-48f7-a9bd-a6d4c373106c tempest-SecurityServicesMappingTest-771779632 tempest-SecurityServicesMappingTest-771779632-project-member] Calling method 'SecurityServiceController.delete' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:30 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.v1.security_service [None req-1a6ccd53-2718-48f7-a9bd-a6d4c373106c tempest-SecurityServicesMappingTest-771779632 tempest-SecurityServicesMappingTest-771779632-project-member] Delete security service with id: 1f84f081-2a88-4a37-8390-4dea9bef9ad4 May 28 13:00:30 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-1a6ccd53-2718-48f7-a9bd-a6d4c373106c tempest-SecurityServicesMappingTest-771779632 tempest-SecurityServicesMappingTest-771779632-project-member] HTTP exception thrown: Cannot delete security service. It is assigned to share network(s) May 28 13:00:30 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-1a6ccd53-2718-48f7-a9bd-a6d4c373106c tempest-SecurityServicesMappingTest-771779632 tempest-SecurityServicesMappingTest-771779632-project-member] http://10.27.203.238/share/v1/2150b042403d4dcf974c4f1ca9e74c12/security-services/1f84f081-2a88-4a37-8390-4dea9bef9ad4 returned with HTTP 403 May 28 13:00:30 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 922/1817] 10.27.203.238 () {62 vars in 1444 bytes} [Tue May 28 13:00:30 2024] DELETE /share/v1/2150b042403d4dcf974c4f1ca9e74c12/security-services/1f84f081-2a88-4a37-8390-4dea9bef9ad4 => generated 109 bytes in 18 msecs (HTTP/1.1 403) 6 headers in 237 bytes (1 switches on core 0) May 28 13:00:30 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-84ac57a2-b154-4329-b83e-b99756150f88 tempest-SecurityServicesMappingTest-771779632 tempest-SecurityServicesMappingTest-771779632-project-member] DELETE http://10.27.203.238/share/v1/2150b042403d4dcf974c4f1ca9e74c12/share-networks/b9ed98ea-224f-4025-b996-7314112ad32d May 28 13:00:30 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-84ac57a2-b154-4329-b83e-b99756150f88 tempest-SecurityServicesMappingTest-771779632 tempest-SecurityServicesMappingTest-771779632-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:30 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-84ac57a2-b154-4329-b83e-b99756150f88 tempest-SecurityServicesMappingTest-771779632 tempest-SecurityServicesMappingTest-771779632-project-member] Calling method 'ShareNetworkController.delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:30 l75lg1-v1 dstat.sh[49771]: 28-05 13:00:30| 11 1 81 6 0|5687M 1764M 278M 7896M| 18k 8955B| 0 2872k| 0 433 |6768 12k|1.51 1.15 1.04|2.0 1.0 0| 0 0 | 0 2048M| 29 362 0 45 2 May 28 13:00:30 l75lg1-v1 neutron-server[77618]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.HashRingHealthCheckPeriodics.touch_hash_ring_nodes' {{(pid=77618) _process_scheduled /opt/stack/data/venv/lib/python3.10/site-packages/futurist/periodics.py:638}} May 28 13:00:30 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.quota [None req-84ac57a2-b154-4329-b83e-b99756150f88 tempest-SecurityServicesMappingTest-771779632 tempest-SecurityServicesMappingTest-771779632-project-member] Created reservations ['d3f97e76-43e9-4c9f-93b2-f830bc8e91dc'] {{(pid=98330) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 13:00:30 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.quota [None req-84ac57a2-b154-4329-b83e-b99756150f88 tempest-SecurityServicesMappingTest-771779632 tempest-SecurityServicesMappingTest-771779632-project-member] Committed reservations ['d3f97e76-43e9-4c9f-93b2-f830bc8e91dc'] {{(pid=98330) commit /opt/stack/manila/manila/quota.py:1063}} May 28 13:00:30 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-84ac57a2-b154-4329-b83e-b99756150f88 tempest-SecurityServicesMappingTest-771779632 tempest-SecurityServicesMappingTest-771779632-project-member] http://10.27.203.238/share/v1/2150b042403d4dcf974c4f1ca9e74c12/share-networks/b9ed98ea-224f-4025-b996-7314112ad32d returned with HTTP 202 May 28 13:00:30 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 896/1818] 10.27.203.238 () {62 vars in 1435 bytes} [Tue May 28 13:00:30 2024] DELETE /share/v1/2150b042403d4dcf974c4f1ca9e74c12/share-networks/b9ed98ea-224f-4025-b996-7314112ad32d => generated 0 bytes in 171 msecs (HTTP/1.1 202) 6 headers in 242 bytes (1 switches on core 0) May 28 13:00:30 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-5dfb19c9-b0b1-4768-9ed3-dd404d161272 tempest-SecurityServicesMappingTest-771779632 tempest-SecurityServicesMappingTest-771779632-project-member] GET http://10.27.203.238/share/v1/2150b042403d4dcf974c4f1ca9e74c12/share-networks/b9ed98ea-224f-4025-b996-7314112ad32d May 28 13:00:30 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-5dfb19c9-b0b1-4768-9ed3-dd404d161272 tempest-SecurityServicesMappingTest-771779632 tempest-SecurityServicesMappingTest-771779632-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:30 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-5dfb19c9-b0b1-4768-9ed3-dd404d161272 tempest-SecurityServicesMappingTest-771779632 tempest-SecurityServicesMappingTest-771779632-project-member] Calling method 'ShareNetworkController.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:30 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-5dfb19c9-b0b1-4768-9ed3-dd404d161272 tempest-SecurityServicesMappingTest-771779632 tempest-SecurityServicesMappingTest-771779632-project-member] HTTP exception thrown: Share network b9ed98ea-224f-4025-b996-7314112ad32d could not be found. May 28 13:00:30 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-5dfb19c9-b0b1-4768-9ed3-dd404d161272 tempest-SecurityServicesMappingTest-771779632 tempest-SecurityServicesMappingTest-771779632-project-member] http://10.27.203.238/share/v1/2150b042403d4dcf974c4f1ca9e74c12/share-networks/b9ed98ea-224f-4025-b996-7314112ad32d returned with HTTP 404 May 28 13:00:30 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 923/1819] 10.27.203.238 () {62 vars in 1432 bytes} [Tue May 28 13:00:30 2024] GET /share/v1/2150b042403d4dcf974c4f1ca9e74c12/share-networks/b9ed98ea-224f-4025-b996-7314112ad32d => generated 116 bytes in 21 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 13:00:30 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-6bd846e8-13b6-401c-b817-1dcbb73037f1 tempest-SecurityServicesMappingTest-771779632 tempest-SecurityServicesMappingTest-771779632-project-member] POST http://10.27.203.238/share/v1/2150b042403d4dcf974c4f1ca9e74c12/share-networks May 28 13:00:30 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-6bd846e8-13b6-401c-b817-1dcbb73037f1 tempest-SecurityServicesMappingTest-771779632 tempest-SecurityServicesMappingTest-771779632-project-member] Action: 'create', calling method: ShareNetworkController.create, body: {"share_network": {"name": "tempest-sn-name-118748464", "description": "tempest-sn-desc-1231025119", "neutron_net_id": "tempest-net-id-209559210", "neutron_subnet_id": "tempest-subnet-id-1328077832"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:00:30 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.quota [None req-6bd846e8-13b6-401c-b817-1dcbb73037f1 tempest-SecurityServicesMappingTest-771779632 tempest-SecurityServicesMappingTest-771779632-project-member] Created reservations ['53d53248-e1d2-4b3c-8fa3-665741a922d6'] {{(pid=98330) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 13:00:30 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-5091ec63-b127-490a-ba42-6df40d830b35 tempest-ShareRulesTest-1530341375 None] <<< [GET] https://127.0.0.1:40443/api/views/ May 28 13:00:30 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-5091ec63-b127-490a-ba42-6df40d830b35 tempest-ShareRulesTest-1530341375 None] [] May 28 13:00:30 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-5091ec63-b127-490a-ba42-6df40d830b35 tempest-ShareRulesTest-1530341375 None] --- [GET] https://127.0.0.1:40443/api/views/: Done May 28 13:00:30 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-5091ec63-b127-490a-ba42-6df40d830b35 tempest-ShareRulesTest-1530341375 None] >>> [POST] https://127.0.0.1:40443/api/views/ May 28 13:00:30 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-5091ec63-b127-490a-ba42-6df40d830b35 tempest-ShareRulesTest-1530341375 None] {'data': '{"name": "5eddb781-43d4-4883-ae43-e9856f3a4c10", "path": ' May 28 13:00:30 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-5091ec63-b127-490a-ba42-6df40d830b35 tempest-ShareRulesTest-1530341375 None] '"/manila/manila-5eddb781-43d4-4883-ae43-e9856f3a4c10", "policy_id": ' May 28 13:00:30 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-5091ec63-b127-490a-ba42-6df40d830b35 tempest-ShareRulesTest-1530341375 None] '44, "create_dir": true, "protocols": ["NFS"]}', May 28 13:00:30 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-5091ec63-b127-490a-ba42-6df40d830b35 tempest-ShareRulesTest-1530341375 None] 'json': None, May 28 13:00:30 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-5091ec63-b127-490a-ba42-6df40d830b35 tempest-ShareRulesTest-1530341375 None] 'params': None} May 28 13:00:30 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.quota [None req-6bd846e8-13b6-401c-b817-1dcbb73037f1 tempest-SecurityServicesMappingTest-771779632 tempest-SecurityServicesMappingTest-771779632-project-member] Committed reservations ['53d53248-e1d2-4b3c-8fa3-665741a922d6'] {{(pid=98330) commit /opt/stack/manila/manila/quota.py:1063}} May 28 13:00:30 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-6bd846e8-13b6-401c-b817-1dcbb73037f1 tempest-SecurityServicesMappingTest-771779632 tempest-SecurityServicesMappingTest-771779632-project-member] http://10.27.203.238/share/v1/2150b042403d4dcf974c4f1ca9e74c12/share-networks returned with HTTP 200 May 28 13:00:30 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 897/1820] 10.27.203.238 () {64 vars in 1343 bytes} [Tue May 28 13:00:30 2024] POST /share/v1/2150b042403d4dcf974c4f1ca9e74c12/share-networks => generated 462 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:00:30 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-b0ce4b50-3827-4203-8a21-425572e9a0a6 tempest-SecurityServicesMappingTest-771779632 tempest-SecurityServicesMappingTest-771779632-project-member] POST http://10.27.203.238/share/v1/2150b042403d4dcf974c4f1ca9e74c12/security-services May 28 13:00:30 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-b0ce4b50-3827-4203-8a21-425572e9a0a6 tempest-SecurityServicesMappingTest-771779632 tempest-SecurityServicesMappingTest-771779632-project-member] Action: 'create', calling method: SecurityServiceController.create, body: {"security_service": {"type": "ldap", "name": "tempest-ss-name-71331794", "description": "tempest-ss-desc-1906294507", "dns_ip": "203.0.113.77", "server": "203.0.113.115", "domain": "tempest-ss-domain-882837294", "user": "tempest-ss-user-337841387", "password": "***"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:00:30 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-b0ce4b50-3827-4203-8a21-425572e9a0a6 tempest-SecurityServicesMappingTest-771779632 tempest-SecurityServicesMappingTest-771779632-project-member] http://10.27.203.238/share/v1/2150b042403d4dcf974c4f1ca9e74c12/security-services returned with HTTP 200 May 28 13:00:30 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 924/1821] 10.27.203.238 () {64 vars in 1352 bytes} [Tue May 28 13:00:30 2024] POST /share/v1/2150b042403d4dcf974c4f1ca9e74c12/security-services => generated 473 bytes in 19 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:00:30 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-76dd0f29-3f27-4cb4-b900-31cf87e688ce tempest-SecurityServicesMappingTest-771779632 tempest-SecurityServicesMappingTest-771779632-project-member] POST http://10.27.203.238/share/v1/2150b042403d4dcf974c4f1ca9e74c12/share-networks/f54e529a-8bc6-4ba9-b91c-c2895ca23d52/action May 28 13:00:30 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-76dd0f29-3f27-4cb4-b900-31cf87e688ce tempest-SecurityServicesMappingTest-771779632 tempest-SecurityServicesMappingTest-771779632-project-member] Action body: b'{"add_security_service": {"security_service_id": "de863d97-26b8-407e-88ec-3a40b9660bcd"}}' {{(pid=98330) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 13:00:30 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-76dd0f29-3f27-4cb4-b900-31cf87e688ce tempest-SecurityServicesMappingTest-771779632 tempest-SecurityServicesMappingTest-771779632-project-member] Action: 'action', calling method: ShareNetworkController.add_security_service, body: {"add_security_service": {"security_service_id": "de863d97-26b8-407e-88ec-3a40b9660bcd"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:00:30 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-76dd0f29-3f27-4cb4-b900-31cf87e688ce tempest-SecurityServicesMappingTest-771779632 tempest-SecurityServicesMappingTest-771779632-project-member] http://10.27.203.238/share/v1/2150b042403d4dcf974c4f1ca9e74c12/share-networks/f54e529a-8bc6-4ba9-b91c-c2895ca23d52/action returned with HTTP 200 May 28 13:00:30 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 898/1822] 10.27.203.238 () {64 vars in 1474 bytes} [Tue May 28 13:00:30 2024] POST /share/v1/2150b042403d4dcf974c4f1ca9e74c12/share-networks/f54e529a-8bc6-4ba9-b91c-c2895ca23d52/action => generated 462 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:00:30 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-c823d832-96b3-4579-89a0-d2f24cd5941f tempest-SecurityServicesMappingTest-771779632 tempest-SecurityServicesMappingTest-771779632-project-member] POST http://10.27.203.238/share/v1/2150b042403d4dcf974c4f1ca9e74c12/share-networks/f54e529a-8bc6-4ba9-b91c-c2895ca23d52/action May 28 13:00:30 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-c823d832-96b3-4579-89a0-d2f24cd5941f tempest-SecurityServicesMappingTest-771779632 tempest-SecurityServicesMappingTest-771779632-project-member] Action body: b'{"remove_security_service": {"security_service_id": "de863d97-26b8-407e-88ec-3a40b9660bcd"}}' {{(pid=98329) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 13:00:30 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-c823d832-96b3-4579-89a0-d2f24cd5941f tempest-SecurityServicesMappingTest-771779632 tempest-SecurityServicesMappingTest-771779632-project-member] Action: 'action', calling method: ShareNetworkController.remove_security_service, body: {"remove_security_service": {"security_service_id": "de863d97-26b8-407e-88ec-3a40b9660bcd"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:00:30 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-c823d832-96b3-4579-89a0-d2f24cd5941f tempest-SecurityServicesMappingTest-771779632 tempest-SecurityServicesMappingTest-771779632-project-member] http://10.27.203.238/share/v1/2150b042403d4dcf974c4f1ca9e74c12/share-networks/f54e529a-8bc6-4ba9-b91c-c2895ca23d52/action returned with HTTP 200 May 28 13:00:30 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 925/1823] 10.27.203.238 () {64 vars in 1474 bytes} [Tue May 28 13:00:30 2024] POST /share/v1/2150b042403d4dcf974c4f1ca9e74c12/share-networks/f54e529a-8bc6-4ba9-b91c-c2895ca23d52/action => generated 462 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:00:30 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-8ad6ff7e-b36b-4ab1-ba38-b095e77e65da tempest-SecurityServicesMappingTest-771779632 tempest-SecurityServicesMappingTest-771779632-project-member] POST http://10.27.203.238/share/v1/2150b042403d4dcf974c4f1ca9e74c12/share-networks/f54e529a-8bc6-4ba9-b91c-c2895ca23d52/action May 28 13:00:30 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-8ad6ff7e-b36b-4ab1-ba38-b095e77e65da tempest-SecurityServicesMappingTest-771779632 tempest-SecurityServicesMappingTest-771779632-project-member] Action body: b'{"add_security_service": {"security_service_id": "de863d97-26b8-407e-88ec-3a40b9660bcd"}}' {{(pid=98330) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 13:00:30 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-8ad6ff7e-b36b-4ab1-ba38-b095e77e65da tempest-SecurityServicesMappingTest-771779632 tempest-SecurityServicesMappingTest-771779632-project-member] Action: 'action', calling method: ShareNetworkController.add_security_service, body: {"add_security_service": {"security_service_id": "de863d97-26b8-407e-88ec-3a40b9660bcd"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:00:30 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-8ad6ff7e-b36b-4ab1-ba38-b095e77e65da tempest-SecurityServicesMappingTest-771779632 tempest-SecurityServicesMappingTest-771779632-project-member] http://10.27.203.238/share/v1/2150b042403d4dcf974c4f1ca9e74c12/share-networks/f54e529a-8bc6-4ba9-b91c-c2895ca23d52/action returned with HTTP 200 May 28 13:00:30 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 899/1824] 10.27.203.238 () {64 vars in 1474 bytes} [Tue May 28 13:00:30 2024] POST /share/v1/2150b042403d4dcf974c4f1ca9e74c12/share-networks/f54e529a-8bc6-4ba9-b91c-c2895ca23d52/action => generated 462 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:00:30 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-c23cb01a-05fb-4dd1-b665-c8c359efeb0d tempest-SecurityServicesMappingTest-771779632 tempest-SecurityServicesMappingTest-771779632-project-member] DELETE http://10.27.203.238/share/v1/2150b042403d4dcf974c4f1ca9e74c12/security-services/de863d97-26b8-407e-88ec-3a40b9660bcd May 28 13:00:30 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-c23cb01a-05fb-4dd1-b665-c8c359efeb0d tempest-SecurityServicesMappingTest-771779632 tempest-SecurityServicesMappingTest-771779632-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:30 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-c23cb01a-05fb-4dd1-b665-c8c359efeb0d tempest-SecurityServicesMappingTest-771779632 tempest-SecurityServicesMappingTest-771779632-project-member] Calling method 'SecurityServiceController.delete' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:30 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.v1.security_service [None req-c23cb01a-05fb-4dd1-b665-c8c359efeb0d tempest-SecurityServicesMappingTest-771779632 tempest-SecurityServicesMappingTest-771779632-project-member] Delete security service with id: de863d97-26b8-407e-88ec-3a40b9660bcd May 28 13:00:30 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-c23cb01a-05fb-4dd1-b665-c8c359efeb0d tempest-SecurityServicesMappingTest-771779632 tempest-SecurityServicesMappingTest-771779632-project-member] HTTP exception thrown: Cannot delete security service. It is assigned to share network(s) May 28 13:00:30 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-c23cb01a-05fb-4dd1-b665-c8c359efeb0d tempest-SecurityServicesMappingTest-771779632 tempest-SecurityServicesMappingTest-771779632-project-member] http://10.27.203.238/share/v1/2150b042403d4dcf974c4f1ca9e74c12/security-services/de863d97-26b8-407e-88ec-3a40b9660bcd returned with HTTP 403 May 28 13:00:30 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 926/1825] 10.27.203.238 () {62 vars in 1444 bytes} [Tue May 28 13:00:30 2024] DELETE /share/v1/2150b042403d4dcf974c4f1ca9e74c12/security-services/de863d97-26b8-407e-88ec-3a40b9660bcd => generated 109 bytes in 18 msecs (HTTP/1.1 403) 6 headers in 237 bytes (1 switches on core 0) May 28 13:00:30 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-9467be60-fdd9-4bba-9531-5952fe8ea224 tempest-SecurityServicesMappingTest-771779632 tempest-SecurityServicesMappingTest-771779632-project-member] DELETE http://10.27.203.238/share/v1/2150b042403d4dcf974c4f1ca9e74c12/share-networks/f54e529a-8bc6-4ba9-b91c-c2895ca23d52 May 28 13:00:30 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-9467be60-fdd9-4bba-9531-5952fe8ea224 tempest-SecurityServicesMappingTest-771779632 tempest-SecurityServicesMappingTest-771779632-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:30 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-9467be60-fdd9-4bba-9531-5952fe8ea224 tempest-SecurityServicesMappingTest-771779632 tempest-SecurityServicesMappingTest-771779632-project-member] Calling method 'ShareNetworkController.delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:30 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.quota [None req-9467be60-fdd9-4bba-9531-5952fe8ea224 tempest-SecurityServicesMappingTest-771779632 tempest-SecurityServicesMappingTest-771779632-project-member] Created reservations ['324ec0e7-5ca7-4ae6-a185-ca47be0f2deb'] {{(pid=98330) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 13:00:30 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.quota [None req-9467be60-fdd9-4bba-9531-5952fe8ea224 tempest-SecurityServicesMappingTest-771779632 tempest-SecurityServicesMappingTest-771779632-project-member] Committed reservations ['324ec0e7-5ca7-4ae6-a185-ca47be0f2deb'] {{(pid=98330) commit /opt/stack/manila/manila/quota.py:1063}} May 28 13:00:30 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-9467be60-fdd9-4bba-9531-5952fe8ea224 tempest-SecurityServicesMappingTest-771779632 tempest-SecurityServicesMappingTest-771779632-project-member] http://10.27.203.238/share/v1/2150b042403d4dcf974c4f1ca9e74c12/share-networks/f54e529a-8bc6-4ba9-b91c-c2895ca23d52 returned with HTTP 202 May 28 13:00:30 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 900/1826] 10.27.203.238 () {62 vars in 1435 bytes} [Tue May 28 13:00:30 2024] DELETE /share/v1/2150b042403d4dcf974c4f1ca9e74c12/share-networks/f54e529a-8bc6-4ba9-b91c-c2895ca23d52 => generated 0 bytes in 172 msecs (HTTP/1.1 202) 6 headers in 242 bytes (1 switches on core 0) May 28 13:00:31 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-11253672-09ed-4c74-bd92-bc347835df66 tempest-SecurityServicesMappingTest-771779632 tempest-SecurityServicesMappingTest-771779632-project-member] GET http://10.27.203.238/share/v1/2150b042403d4dcf974c4f1ca9e74c12/share-networks/f54e529a-8bc6-4ba9-b91c-c2895ca23d52 May 28 13:00:31 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-11253672-09ed-4c74-bd92-bc347835df66 tempest-SecurityServicesMappingTest-771779632 tempest-SecurityServicesMappingTest-771779632-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:31 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-11253672-09ed-4c74-bd92-bc347835df66 tempest-SecurityServicesMappingTest-771779632 tempest-SecurityServicesMappingTest-771779632-project-member] Calling method 'ShareNetworkController.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:31 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-11253672-09ed-4c74-bd92-bc347835df66 tempest-SecurityServicesMappingTest-771779632 tempest-SecurityServicesMappingTest-771779632-project-member] HTTP exception thrown: Share network f54e529a-8bc6-4ba9-b91c-c2895ca23d52 could not be found. May 28 13:00:31 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-11253672-09ed-4c74-bd92-bc347835df66 tempest-SecurityServicesMappingTest-771779632 tempest-SecurityServicesMappingTest-771779632-project-member] http://10.27.203.238/share/v1/2150b042403d4dcf974c4f1ca9e74c12/share-networks/f54e529a-8bc6-4ba9-b91c-c2895ca23d52 returned with HTTP 404 May 28 13:00:31 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 927/1827] 10.27.203.238 () {62 vars in 1432 bytes} [Tue May 28 13:00:31 2024] GET /share/v1/2150b042403d4dcf974c4f1ca9e74c12/share-networks/f54e529a-8bc6-4ba9-b91c-c2895ca23d52 => generated 116 bytes in 19 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 13:00:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3314bbb6-e127-4e70-8122-3de21b2f0e93 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3314bbb6-e127-4e70-8122-3de21b2f0e93 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d1ec6c-7c8f-4b45-97e8-196ea30a590b None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d1ec6c-7c8f-4b45-97e8-196ea30a590b None admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d1ec6c-7c8f-4b45-97e8-196ea30a590b None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d1ec6c-7c8f-4b45-97e8-196ea30a590b None admin] PATH_INFO: `/v3/users/ec715434ce2e44bba5fd4e824aba7170` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d1ec6c-7c8f-4b45-97e8-196ea30a590b None admin] RBAC: Authorizing `identity:delete_user(user_id=ec715434ce2e44bba5fd4e824aba7170)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d1ec6c-7c8f-4b45-97e8-196ea30a590b None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-a0d1ec6c-7c8f-4b45-97e8-196ea30a590b None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec715434ce2e44bba5fd4e824aba7170', 'request_id': 'req-a0d1ec6c-7c8f-4b45-97e8-196ea30a590b'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-a0d1ec6c-7c8f-4b45-97e8-196ea30a590b None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec715434ce2e44bba5fd4e824aba7170', 'request_id': 'req-a0d1ec6c-7c8f-4b45-97e8-196ea30a590b'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-a0d1ec6c-7c8f-4b45-97e8-196ea30a590b None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec715434ce2e44bba5fd4e824aba7170', 'request_id': 'req-a0d1ec6c-7c8f-4b45-97e8-196ea30a590b'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-a0d1ec6c-7c8f-4b45-97e8-196ea30a590b None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec715434ce2e44bba5fd4e824aba7170', 'request_id': 'req-a0d1ec6c-7c8f-4b45-97e8-196ea30a590b'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-a0d1ec6c-7c8f-4b45-97e8-196ea30a590b None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec715434ce2e44bba5fd4e824aba7170', 'request_id': 'req-a0d1ec6c-7c8f-4b45-97e8-196ea30a590b'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:31 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1429/2829] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 13:00:31 2024] DELETE /identity/v3/users/ec715434ce2e44bba5fd4e824aba7170 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:00:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad72baa-bf89-46f9-bd29-ccc3924d3c48 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad72baa-bf89-46f9-bd29-ccc3924d3c48 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad72baa-bf89-46f9-bd29-ccc3924d3c48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:31 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-aad72baa-bf89-46f9-bd29-ccc3924d3c48 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 13:00:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-aad72baa-bf89-46f9-bd29-ccc3924d3c48 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 13:00:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-aad72baa-bf89-46f9-bd29-ccc3924d3c48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:00:31 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1401/2830] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 13:00:31 2024] POST /identity/v3/auth/tokens => generated 2960 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 13:00:31 l75lg1-v1 neutron-server[77618]: DEBUG neutron.wsgi [-] (77618) accepted ('10.27.203.238', 36332) {{(pid=77618) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 13:00:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d1ec6c-7c8f-4b45-97e8-196ea30a590b None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-a0d1ec6c-7c8f-4b45-97e8-196ea30a590b None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:00:31 l75lg1-v1 dstat.sh[49771]: 28-05 13:00:31| 8 1 86 4 0|5687M 1763M 278M 7896M| 12k 8403B| 0 3188k| 0 366 |6624 12k|1.51 1.15 1.04|1.0 1.0 0| 0 0 | 0 2048M| 29 364 0 42 2 May 28 13:00:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d1ec6c-7c8f-4b45-97e8-196ea30a590b None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5177a5-2f54-4693-b6e7-ed4a3d6b046e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef17047035e4b518fd5360a01f2da1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5177a5-2f54-4693-b6e7-ed4a3d6b046e service neutron] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5177a5-2f54-4693-b6e7-ed4a3d6b046e service neutron] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5177a5-2f54-4693-b6e7-ed4a3d6b046e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5177a5-2f54-4693-b6e7-ed4a3d6b046e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5177a5-2f54-4693-b6e7-ed4a3d6b046e service neutron] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:31 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1430/2831] 10.27.203.238 () {64 vars in 1432 bytes} [Tue May 28 13:00:31 2024] GET /identity/v3/auth/tokens => generated 2960 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 28 13:00:31 l75lg1-v1 neutron-server[77618]: INFO neutron.wsgi [None req-a702ca09-6792-41ba-a7d1-a3900bbcfee9 None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=2150b042403d4dcf974c4f1ca9e74c12&name=default HTTP/1.1" status: 200 len: 216 time: 0.0715270 May 28 13:00:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad72baa-bf89-46f9-bd29-ccc3924d3c48 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-aad72baa-bf89-46f9-bd29-ccc3924d3c48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:00:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad72baa-bf89-46f9-bd29-ccc3924d3c48 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42ffce0-fcb6-4092-b377-62daf79fa53b None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42ffce0-fcb6-4092-b377-62daf79fa53b None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42ffce0-fcb6-4092-b377-62daf79fa53b None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42ffce0-fcb6-4092-b377-62daf79fa53b None admin] PATH_INFO: `/v3/projects/2150b042403d4dcf974c4f1ca9e74c12` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42ffce0-fcb6-4092-b377-62daf79fa53b None admin] RBAC: Authorizing `identity:delete_project(project_id=2150b042403d4dcf974c4f1ca9e74c12)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42ffce0-fcb6-4092-b377-62daf79fa53b None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-e42ffce0-fcb6-4092-b377-62daf79fa53b None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2150b042403d4dcf974c4f1ca9e74c12', 'request_id': 'req-e42ffce0-fcb6-4092-b377-62daf79fa53b'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-e42ffce0-fcb6-4092-b377-62daf79fa53b None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2150b042403d4dcf974c4f1ca9e74c12', 'request_id': 'req-e42ffce0-fcb6-4092-b377-62daf79fa53b'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-e42ffce0-fcb6-4092-b377-62daf79fa53b None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2150b042403d4dcf974c4f1ca9e74c12', 'request_id': 'req-e42ffce0-fcb6-4092-b377-62daf79fa53b'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-e42ffce0-fcb6-4092-b377-62daf79fa53b None admin] The token cache is being invalidate because project 2150b042403d4dcf974c4f1ca9e74c12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 13:00:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-e42ffce0-fcb6-4092-b377-62daf79fa53b None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-e42ffce0-fcb6-4092-b377-62daf79fa53b None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:31 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f4706723-1f7b-4c2e-af13-5731a7d30ebc tempest-ShareTransferNegativeTest-884271560 None] <<< [DELETE] https://127.0.0.1:40443/api/viewpolicies/43/ May 28 13:00:31 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f4706723-1f7b-4c2e-af13-5731a7d30ebc tempest-ShareTransferNegativeTest-884271560 None] --- [DELETE] https://127.0.0.1:40443/api/viewpolicies/43/: Done May 28 13:00:31 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1402/2832] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 13:00:31 2024] DELETE /identity/v3/projects/2150b042403d4dcf974c4f1ca9e74c12 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:00:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe6f9dc-f24e-4392-a3a1-4fde984c5335 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe6f9dc-f24e-4392-a3a1-4fde984c5335 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe6f9dc-f24e-4392-a3a1-4fde984c5335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:31 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-cfe6f9dc-f24e-4392-a3a1-4fde984c5335 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 13:00:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-cfe6f9dc-f24e-4392-a3a1-4fde984c5335 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 13:00:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-cfe6f9dc-f24e-4392-a3a1-4fde984c5335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:00:31 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1431/2833] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 13:00:31 2024] POST /identity/v3/auth/tokens => generated 312 bytes in 19 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 28 13:00:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8893dea1-257d-4577-9d92-aab12c69e537 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8893dea1-257d-4577-9d92-aab12c69e537 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8893dea1-257d-4577-9d92-aab12c69e537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:31 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-8893dea1-257d-4577-9d92-aab12c69e537 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 13:00:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-8893dea1-257d-4577-9d92-aab12c69e537 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 13:00:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-8893dea1-257d-4577-9d92-aab12c69e537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:00:31 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1403/2834] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 13:00:31 2024] POST /identity/v3/auth/tokens => generated 2960 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 13:00:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe6f9dc-f24e-4392-a3a1-4fde984c5335 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe6f9dc-f24e-4392-a3a1-4fde984c5335 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482a022f-1371-4320-a107-0be2f89621bc None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482a022f-1371-4320-a107-0be2f89621bc None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482a022f-1371-4320-a107-0be2f89621bc None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482a022f-1371-4320-a107-0be2f89621bc None admin] PATH_INFO: `/v3/domains` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482a022f-1371-4320-a107-0be2f89621bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=51267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 13:00:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482a022f-1371-4320-a107-0be2f89621bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482a022f-1371-4320-a107-0be2f89621bc None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:31 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1432/2835] 10.27.203.238 () {62 vars in 1220 bytes} [Tue May 28 13:00:31 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 13:00:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8893dea1-257d-4577-9d92-aab12c69e537 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8893dea1-257d-4577-9d92-aab12c69e537 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:31 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-f4706723-1f7b-4c2e-af13-5731a7d30ebc tempest-ShareTransferNegativeTest-884271560 None] Created reservations ['63c603ca-e40e-4e74-a80c-01aa2545d990', 'bbf22d6b-46c2-463d-95df-5be9ad2555a4', 'e1549567-c713-4f0c-8105-8da303862f87', '02bc0bc0-2b93-445b-bad5-c1382677e795'] {{(pid=98474) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 13:00:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6df35d-cfce-49d4-ba28-16b35adb33e2 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6df35d-cfce-49d4-ba28-16b35adb33e2 None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6df35d-cfce-49d4-ba28-16b35adb33e2 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6df35d-cfce-49d4-ba28-16b35adb33e2 None admin] PATH_INFO: `/v3/projects` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6df35d-cfce-49d4-ba28-16b35adb33e2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6df35d-cfce-49d4-ba28-16b35adb33e2 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:31 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-f4706723-1f7b-4c2e-af13-5731a7d30ebc tempest-ShareTransferNegativeTest-884271560 None] Committed reservations ['63c603ca-e40e-4e74-a80c-01aa2545d990', 'bbf22d6b-46c2-463d-95df-5be9ad2555a4', 'e1549567-c713-4f0c-8105-8da303862f87', '02bc0bc0-2b93-445b-bad5-c1382677e795'] {{(pid=98474) commit /opt/stack/manila/manila/quota.py:1063}} May 28 13:00:31 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1404/2836] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 13:00:31 2024] POST /identity/v3/projects => generated 395 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 13:00:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482a022f-1371-4320-a107-0be2f89621bc None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482a022f-1371-4320-a107-0be2f89621bc None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:31 l75lg1-v1 manila-share[98474]: INFO manila.share.manager [None req-f4706723-1f7b-4c2e-af13-5731a7d30ebc tempest-ShareTransferNegativeTest-884271560 None] Share instance fa81edfd-59ee-49f5-8dbe-094d49593280: deleted successfully. May 28 13:00:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7df3f7-02af-4c16-aa29-9af1791b5741 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7df3f7-02af-4c16-aa29-9af1791b5741 None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7df3f7-02af-4c16-aa29-9af1791b5741 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7df3f7-02af-4c16-aa29-9af1791b5741 None admin] PATH_INFO: `/v3/users` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7df3f7-02af-4c16-aa29-9af1791b5741 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7df3f7-02af-4c16-aa29-9af1791b5741 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:31 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-6b7df3f7-02af-4c16-aa29-9af1791b5741 None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 13:00:31 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1433/2837] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 13:00:31 2024] POST /identity/v3/users => generated 306 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 13:00:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6df35d-cfce-49d4-ba28-16b35adb33e2 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6df35d-cfce-49d4-ba28-16b35adb33e2 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:31 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-5091ec63-b127-490a-ba42-6df40d830b35 tempest-ShareRulesTest-1530341375 None] <<< [POST] https://127.0.0.1:40443/api/views/ May 28 13:00:31 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-5091ec63-b127-490a-ba42-6df40d830b35 tempest-ShareRulesTest-1530341375 None] Bunch(abac_tags=[], abe_max_depth=None, abe_protocols=[], alias='', allow_anonymous_access=False, allow_s3_anonymous_access=False, auto_commit='0d', bucket='', bucket_creators=[], bucket_creators_groups=[], bucket_owner=None, bulk_permission_update_progress=None, bulk_permission_update_state=None, cluster='loop75-kfs', cluster_id=1, created='2024-05-28T13:00:31.218578Z', enabled=True, files_retention_mode='NONE', guid='0eb2b1e4-8c9a-4a76-9a7a-523f14fc36fa', id=43, ignore_oos=False, internal=False, is_remote=False, is_seamless=False, logical_capacity=0, max_retention_period=None, min_retention_period=None, name='5eddb781-43d4-4883-ae43-e9856f3a4c10', nfs_interop_flags='BOTH_NFS3_AND_NFS4_INTEROP_DISABLED', path='/manila/manila-5eddb781-43d4-4883-ae43-e9856f3a4c10', physical_capacity=0, policy='5eddb781-43d4-4883-ae43-e9856f3a4c10', policy_id=44, protocols=['NFS'], qos_policy=None, qos_policy_id=None, s3_locks=False, s3_locks_retention_mode='NONE', s3_locks_retention_period='', s3_object_ownership_rule='ObjectWriter', s3_unverified_lookup=False, s3_versioning=False, select_for_live_monitoring=False, share='', share_acl=Bunch(acl=[], enabled=False), sync='SYNCED', sync_time='2024-05-28T13:00:31.516964Z', tenant_id=1, tenant_name='default', title='/manila/manila-5eddb781-43d4-4883-ae43-e9856f3a4c10', url='https://127.0.0.1:40443/api/views/43/') May 28 13:00:31 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-5091ec63-b127-490a-ba42-6df40d830b35 tempest-ShareRulesTest-1530341375 None] --- [POST] https://127.0.0.1:40443/api/views/: Done May 28 13:00:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0295191e-bf86-431d-b4e2-66f9fcebb061 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0295191e-bf86-431d-b4e2-66f9fcebb061 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0295191e-bf86-431d-b4e2-66f9fcebb061 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0295191e-bf86-431d-b4e2-66f9fcebb061 None admin] PATH_INFO: `/v3/roles` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0295191e-bf86-431d-b4e2-66f9fcebb061 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0295191e-bf86-431d-b4e2-66f9fcebb061 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:31 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1405/2838] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 13:00:31 2024] GET /identity/v3/roles => generated 1680 bytes in 18 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 13:00:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7df3f7-02af-4c16-aa29-9af1791b5741 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7df3f7-02af-4c16-aa29-9af1791b5741 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4fb830-738b-42b3-94c2-70f2395bc05b None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4fb830-738b-42b3-94c2-70f2395bc05b None admin] REQUEST_METHOD: `PUT` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4fb830-738b-42b3-94c2-70f2395bc05b None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4fb830-738b-42b3-94c2-70f2395bc05b None admin] PATH_INFO: `/v3/projects/fbb20f2175704a80968d536160c6c6fa/users/4941407a10fe456dba68792c9db13acf/roles/44620cad10ae407c90c91e2c296adb04` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:31 l75lg1-v1 manila-share[98474]: INFO manila.share.manager [None req-5091ec63-b127-490a-ba42-6df40d830b35 tempest-ShareRulesTest-1530341375 None] Share instance 5eddb781-43d4-4883-ae43-e9856f3a4c10 created successfully. May 28 13:00:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4fb830-738b-42b3-94c2-70f2395bc05b None admin] RBAC: Authorizing `identity:create_grant(project_id=fbb20f2175704a80968d536160c6c6fa, user_id=4941407a10fe456dba68792c9db13acf, role_id=44620cad10ae407c90c91e2c296adb04)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4fb830-738b-42b3-94c2-70f2395bc05b None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:31 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-b8174f1c-cf9b-4c3e-9027-90ede4d3e2e4 tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] GET http://10.27.203.238/share/v2/cac556dc39a14bbdbdbabfc80672fb1f/shares/a6923a53-b5dd-4f5b-803b-5f00144de747 May 28 13:00:31 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-b8174f1c-cf9b-4c3e-9027-90ede4d3e2e4 tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:31 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-b8174f1c-cf9b-4c3e-9027-90ede4d3e2e4 tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:31 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1434/2839] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 13:00:31 2024] PUT /identity/v3/projects/fbb20f2175704a80968d536160c6c6fa/users/4941407a10fe456dba68792c9db13acf/roles/44620cad10ae407c90c91e2c296adb04 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:00:31 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-b8174f1c-cf9b-4c3e-9027-90ede4d3e2e4 tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] HTTP exception thrown: The resource could not be found. May 28 13:00:31 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-b8174f1c-cf9b-4c3e-9027-90ede4d3e2e4 tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] http://10.27.203.238/share/v2/cac556dc39a14bbdbdbabfc80672fb1f/shares/a6923a53-b5dd-4f5b-803b-5f00144de747 returned with HTTP 404 May 28 13:00:31 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 901/1828] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:00:31 2024] GET /share/v2/cac556dc39a14bbdbdbabfc80672fb1f/shares/a6923a53-b5dd-4f5b-803b-5f00144de747 => generated 78 bytes in 11 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 13:00:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77581cb2-4643-46c3-acc0-28461141e769 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77581cb2-4643-46c3-acc0-28461141e769 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77581cb2-4643-46c3-acc0-28461141e769 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:31 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-7581d9f7-d79d-4bba-ba5c-63110cdccd53 tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] GET http://10.27.203.238/share/v2/cac556dc39a14bbdbdbabfc80672fb1f/share-replicas/detail?share_id=03abb6c7-1707-45b3-a692-3b1de0dd1fba May 28 13:00:31 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-7581d9f7-d79d-4bba-ba5c-63110cdccd53 tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:31 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-7581d9f7-d79d-4bba-ba5c-63110cdccd53 tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:31 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-77581cb2-4643-46c3-acc0-28461141e769 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 13:00:31 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-7581d9f7-d79d-4bba-ba5c-63110cdccd53 tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] http://10.27.203.238/share/v2/cac556dc39a14bbdbdbabfc80672fb1f/share-replicas/detail?share_id=03abb6c7-1707-45b3-a692-3b1de0dd1fba returned with HTTP 200 May 28 13:00:31 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 928/1829] 10.27.203.238 () {64 vars in 1476 bytes} [Tue May 28 13:00:31 2024] GET /share/v2/cac556dc39a14bbdbdbabfc80672fb1f/share-replicas/detail?share_id=03abb6c7-1707-45b3-a692-3b1de0dd1fba => generated 22 bytes in 13 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:00:31 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-8b4f0fd1-edd5-4fef-976a-4a87ae5862d3 tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] DELETE http://10.27.203.238/share/v2/cac556dc39a14bbdbdbabfc80672fb1f/shares/03abb6c7-1707-45b3-a692-3b1de0dd1fba May 28 13:00:31 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-8b4f0fd1-edd5-4fef-976a-4a87ae5862d3 tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:31 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-8b4f0fd1-edd5-4fef-976a-4a87ae5862d3 tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] Calling method 'ShareMixin.delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:31 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.v1.shares [None req-8b4f0fd1-edd5-4fef-976a-4a87ae5862d3 tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] Delete share with id: 03abb6c7-1707-45b3-a692-3b1de0dd1fba May 28 13:00:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-77581cb2-4643-46c3-acc0-28461141e769 None None] MFA Rules not processed for user `4941407a10fe456dba68792c9db13acf`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 13:00:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-77581cb2-4643-46c3-acc0-28461141e769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:00:31 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1406/2840] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 13:00:31 2024] POST /identity/v3/auth/tokens => generated 3966 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 13:00:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4fb830-738b-42b3-94c2-70f2395bc05b None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4fb830-738b-42b3-94c2-70f2395bc05b None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a73efee-9c15-4843-8256-852b53f8ecd9 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a73efee-9c15-4843-8256-852b53f8ecd9 None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a73efee-9c15-4843-8256-852b53f8ecd9 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a73efee-9c15-4843-8256-852b53f8ecd9 None admin] PATH_INFO: `/v3/projects` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a73efee-9c15-4843-8256-852b53f8ecd9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a73efee-9c15-4843-8256-852b53f8ecd9 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:31 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1435/2841] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 13:00:31 2024] POST /identity/v3/projects => generated 395 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 13:00:31 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-8b4f0fd1-edd5-4fef-976a-4a87ae5862d3 tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] http://10.27.203.238/share/v2/cac556dc39a14bbdbdbabfc80672fb1f/shares/03abb6c7-1707-45b3-a692-3b1de0dd1fba returned with HTTP 202 May 28 13:00:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77581cb2-4643-46c3-acc0-28461141e769 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:31 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 902/1830] 10.27.203.238 () {64 vars in 1454 bytes} [Tue May 28 13:00:31 2024] DELETE /share/v2/cac556dc39a14bbdbdbabfc80672fb1f/shares/03abb6c7-1707-45b3-a692-3b1de0dd1fba => generated 0 bytes in 123 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 13:00:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77581cb2-4643-46c3-acc0-28461141e769 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:31 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-6ca2152d-ac18-441e-9e3b-ab77444e9574 tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] GET http://10.27.203.238/share/v2/cac556dc39a14bbdbdbabfc80672fb1f/shares/03abb6c7-1707-45b3-a692-3b1de0dd1fba May 28 13:00:31 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-6ca2152d-ac18-441e-9e3b-ab77444e9574 tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:31 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-6ca2152d-ac18-441e-9e3b-ab77444e9574 tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:31 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-6ca2152d-ac18-441e-9e3b-ab77444e9574 tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] http://10.27.203.238/share/v2/cac556dc39a14bbdbdbabfc80672fb1f/shares/03abb6c7-1707-45b3-a692-3b1de0dd1fba returned with HTTP 200 May 28 13:00:31 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 929/1831] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:00:31 2024] GET /share/v2/cac556dc39a14bbdbdbabfc80672fb1f/shares/03abb6c7-1707-45b3-a692-3b1de0dd1fba => generated 1315 bytes in 25 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:00:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1314a0f8-3bce-4f4f-9e72-077f7ae8365e None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1314a0f8-3bce-4f4f-9e72-077f7ae8365e None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1314a0f8-3bce-4f4f-9e72-077f7ae8365e None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1314a0f8-3bce-4f4f-9e72-077f7ae8365e None admin] PATH_INFO: `/v3/users` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1314a0f8-3bce-4f4f-9e72-077f7ae8365e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1314a0f8-3bce-4f4f-9e72-077f7ae8365e None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:31 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-1314a0f8-3bce-4f4f-9e72-077f7ae8365e None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 13:00:31 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-8b4f0fd1-edd5-4fef-976a-4a87ae5862d3 tempest-ShareTransferNegativeTest-884271560 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f8e9c921-56e5-4b4a-a619-44221b8150a3" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:00:31 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-8b4f0fd1-edd5-4fef-976a-4a87ae5862d3 tempest-ShareTransferNegativeTest-884271560 None] Lock "locked_access_rules_operation_by_share_instance_f8e9c921-56e5-4b4a-a619-44221b8150a3" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:00:31 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-8b4f0fd1-edd5-4fef-976a-4a87ae5862d3 tempest-ShareTransferNegativeTest-884271560 None] Lock "locked_access_rules_operation_by_share_instance_f8e9c921-56e5-4b4a-a619-44221b8150a3" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:00:31 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-8b4f0fd1-edd5-4fef-976a-4a87ae5862d3 tempest-ShareTransferNegativeTest-884271560 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f8e9c921-56e5-4b4a-a619-44221b8150a3" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:00:31 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1407/2842] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 13:00:31 2024] POST /identity/v3/users => generated 306 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 13:00:31 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-8b4f0fd1-edd5-4fef-976a-4a87ae5862d3 tempest-ShareTransferNegativeTest-884271560 None] Lock "locked_access_rules_operation_by_share_instance_f8e9c921-56e5-4b4a-a619-44221b8150a3" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:00:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a73efee-9c15-4843-8256-852b53f8ecd9 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:31 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-8b4f0fd1-edd5-4fef-976a-4a87ae5862d3 tempest-ShareTransferNegativeTest-884271560 None] Lock "locked_access_rules_operation_by_share_instance_f8e9c921-56e5-4b4a-a619-44221b8150a3" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:00:31 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-8b4f0fd1-edd5-4fef-976a-4a87ae5862d3 tempest-ShareTransferNegativeTest-884271560 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f8e9c921-56e5-4b4a-a619-44221b8150a3" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:00:31 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-8b4f0fd1-edd5-4fef-976a-4a87ae5862d3 tempest-ShareTransferNegativeTest-884271560 None] Lock "locked_access_rules_operation_by_share_instance_f8e9c921-56e5-4b4a-a619-44221b8150a3" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:00:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a73efee-9c15-4843-8256-852b53f8ecd9 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:31 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-8b4f0fd1-edd5-4fef-976a-4a87ae5862d3 tempest-ShareTransferNegativeTest-884271560 None] Lock "locked_access_rules_operation_by_share_instance_f8e9c921-56e5-4b4a-a619-44221b8150a3" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:00:31 l75lg1-v1 manila-share[98474]: DEBUG manila.share.access [None req-8b4f0fd1-edd5-4fef-976a-4a87ae5862d3 tempest-ShareTransferNegativeTest-884271560 None] All access rules have been synced for share instance f8e9c921-56e5-4b4a-a619-44221b8150a3 belonging to share 03abb6c7-1707-45b3-a692-3b1de0dd1fba. {{(pid=98474) update_access_rules /opt/stack/manila/manila/share/access.py:304}} May 28 13:00:31 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-8b4f0fd1-edd5-4fef-976a-4a87ae5862d3 tempest-ShareTransferNegativeTest-884271560 None] deleting '/manila/manila-f8e9c921-56e5-4b4a-a619-44221b8150a3' May 28 13:00:31 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8b4f0fd1-edd5-4fef-976a-4a87ae5862d3 tempest-ShareTransferNegativeTest-884271560 None] >>> [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/ May 28 13:00:31 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8b4f0fd1-edd5-4fef-976a-4a87ae5862d3 tempest-ShareTransferNegativeTest-884271560 None] {'data': '{"path": "/manila/manila-f8e9c921-56e5-4b4a-a619-44221b8150a3"}', May 28 13:00:31 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8b4f0fd1-edd5-4fef-976a-4a87ae5862d3 tempest-ShareTransferNegativeTest-884271560 None] 'params': None} May 28 13:00:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2d554c-a6f2-43f5-83dc-36c7be0200b2 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2d554c-a6f2-43f5-83dc-36c7be0200b2 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2d554c-a6f2-43f5-83dc-36c7be0200b2 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2d554c-a6f2-43f5-83dc-36c7be0200b2 None admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2d554c-a6f2-43f5-83dc-36c7be0200b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2d554c-a6f2-43f5-83dc-36c7be0200b2 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:31 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1436/2843] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 13:00:31 2024] GET /identity/v3/roles => generated 1680 bytes in 17 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 13:00:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1314a0f8-3bce-4f4f-9e72-077f7ae8365e None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1314a0f8-3bce-4f4f-9e72-077f7ae8365e None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81a983a-307a-457c-9a71-d05da1d616ed None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81a983a-307a-457c-9a71-d05da1d616ed None admin] REQUEST_METHOD: `PUT` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81a983a-307a-457c-9a71-d05da1d616ed None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81a983a-307a-457c-9a71-d05da1d616ed None admin] PATH_INFO: `/v3/projects/d9902b1c25914651b9a3e2f4a7240931/users/e86236f2863547b99b41c162048f8f0f/roles/44620cad10ae407c90c91e2c296adb04` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81a983a-307a-457c-9a71-d05da1d616ed None admin] RBAC: Authorizing `identity:create_grant(project_id=d9902b1c25914651b9a3e2f4a7240931, user_id=e86236f2863547b99b41c162048f8f0f, role_id=44620cad10ae407c90c91e2c296adb04)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81a983a-307a-457c-9a71-d05da1d616ed None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:31 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1408/2844] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 13:00:31 2024] PUT /identity/v3/projects/d9902b1c25914651b9a3e2f4a7240931/users/e86236f2863547b99b41c162048f8f0f/roles/44620cad10ae407c90c91e2c296adb04 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:00:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3e17c2-5f2e-4380-a5d8-c94544c849ea None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3e17c2-5f2e-4380-a5d8-c94544c849ea None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3e17c2-5f2e-4380-a5d8-c94544c849ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:31 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-9c3e17c2-5f2e-4380-a5d8-c94544c849ea None None] Truncating password to algorithm specific maximum length 72 characters. May 28 13:00:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-9c3e17c2-5f2e-4380-a5d8-c94544c849ea None None] MFA Rules not processed for user `e86236f2863547b99b41c162048f8f0f`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 13:00:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-9c3e17c2-5f2e-4380-a5d8-c94544c849ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:00:31 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8b4f0fd1-edd5-4fef-976a-4a87ae5862d3 tempest-ShareTransferNegativeTest-884271560 None] <<< [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/ May 28 13:00:31 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8b4f0fd1-edd5-4fef-976a-4a87ae5862d3 tempest-ShareTransferNegativeTest-884271560 None] 'OK' May 28 13:00:31 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8b4f0fd1-edd5-4fef-976a-4a87ae5862d3 tempest-ShareTransferNegativeTest-884271560 None] --- [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/: Done May 28 13:00:31 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8b4f0fd1-edd5-4fef-976a-4a87ae5862d3 tempest-ShareTransferNegativeTest-884271560 None] >>> [GET] https://127.0.0.1:40443/api/views/ May 28 13:00:31 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8b4f0fd1-edd5-4fef-976a-4a87ae5862d3 tempest-ShareTransferNegativeTest-884271560 None] {'allow_redirects': True, May 28 13:00:31 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8b4f0fd1-edd5-4fef-976a-4a87ae5862d3 tempest-ShareTransferNegativeTest-884271560 None] 'params': {'name': 'f8e9c921-56e5-4b4a-a619-44221b8150a3'}} May 28 13:00:31 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1437/2845] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 13:00:31 2024] POST /identity/v3/auth/tokens => generated 3966 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 13:00:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81a983a-307a-457c-9a71-d05da1d616ed None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81a983a-307a-457c-9a71-d05da1d616ed None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4ea193-43df-4474-92cb-d5b6e114fbe8 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4ea193-43df-4474-92cb-d5b6e114fbe8 None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4ea193-43df-4474-92cb-d5b6e114fbe8 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4ea193-43df-4474-92cb-d5b6e114fbe8 None admin] PATH_INFO: `/v3/projects` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4ea193-43df-4474-92cb-d5b6e114fbe8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4ea193-43df-4474-92cb-d5b6e114fbe8 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:32 l75lg1-v1 manila-scheduler[98327]: DEBUG dbcounter [-] [98327] Writing DB stats manila:SELECT=214,manila:UPDATE=24,manila:INSERT=10 {{(pid=98327) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:00:32 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1409/2846] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 13:00:31 2024] POST /identity/v3/projects => generated 393 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 13:00:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3e17c2-5f2e-4380-a5d8-c94544c849ea None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3e17c2-5f2e-4380-a5d8-c94544c849ea None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00712dcc-a715-4610-b0b7-f68c03850a6c None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00712dcc-a715-4610-b0b7-f68c03850a6c None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00712dcc-a715-4610-b0b7-f68c03850a6c None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00712dcc-a715-4610-b0b7-f68c03850a6c None admin] PATH_INFO: `/v3/users` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00712dcc-a715-4610-b0b7-f68c03850a6c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00712dcc-a715-4610-b0b7-f68c03850a6c None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:32 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-00712dcc-a715-4610-b0b7-f68c03850a6c None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 13:00:32 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1438/2847] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 13:00:32 2024] POST /identity/v3/users => generated 304 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 13:00:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4ea193-43df-4474-92cb-d5b6e114fbe8 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4ea193-43df-4474-92cb-d5b6e114fbe8 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07b044e-36fa-4144-82a1-79e29e7de76d None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07b044e-36fa-4144-82a1-79e29e7de76d None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07b044e-36fa-4144-82a1-79e29e7de76d None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07b044e-36fa-4144-82a1-79e29e7de76d None admin] PATH_INFO: `/v3/roles` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07b044e-36fa-4144-82a1-79e29e7de76d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07b044e-36fa-4144-82a1-79e29e7de76d None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:32 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1410/2848] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 13:00:32 2024] GET /identity/v3/roles => generated 1680 bytes in 19 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 13:00:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00712dcc-a715-4610-b0b7-f68c03850a6c None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00712dcc-a715-4610-b0b7-f68c03850a6c None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cde6d8f-f391-44ab-9b23-07cba619361b None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cde6d8f-f391-44ab-9b23-07cba619361b None admin] REQUEST_METHOD: `PUT` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cde6d8f-f391-44ab-9b23-07cba619361b None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cde6d8f-f391-44ab-9b23-07cba619361b None admin] PATH_INFO: `/v3/projects/0ff0c39307664dd8a995693c95b2fc9d/users/29ab7bfdd7ae43e0a7bbaa31f9a3ad5f/roles/e7989893488f483baa107be56668c4f8` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cde6d8f-f391-44ab-9b23-07cba619361b None admin] RBAC: Authorizing `identity:create_grant(project_id=0ff0c39307664dd8a995693c95b2fc9d, user_id=29ab7bfdd7ae43e0a7bbaa31f9a3ad5f, role_id=e7989893488f483baa107be56668c4f8)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cde6d8f-f391-44ab-9b23-07cba619361b None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:32 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1439/2849] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 13:00:32 2024] PUT /identity/v3/projects/0ff0c39307664dd8a995693c95b2fc9d/users/29ab7bfdd7ae43e0a7bbaa31f9a3ad5f/roles/e7989893488f483baa107be56668c4f8 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:00:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07b044e-36fa-4144-82a1-79e29e7de76d None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07b044e-36fa-4144-82a1-79e29e7de76d None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676e5110-a8d2-481f-9b1e-4e30fad3e193 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676e5110-a8d2-481f-9b1e-4e30fad3e193 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676e5110-a8d2-481f-9b1e-4e30fad3e193 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676e5110-a8d2-481f-9b1e-4e30fad3e193 None admin] PATH_INFO: `/v3/roles` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676e5110-a8d2-481f-9b1e-4e30fad3e193 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676e5110-a8d2-481f-9b1e-4e30fad3e193 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:32 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1411/2850] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 13:00:32 2024] GET /identity/v3/roles => generated 1680 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 13:00:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cde6d8f-f391-44ab-9b23-07cba619361b None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cde6d8f-f391-44ab-9b23-07cba619361b None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62128c78-b7a7-4f6c-9059-0169cfe8e31f None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62128c78-b7a7-4f6c-9059-0169cfe8e31f None admin] REQUEST_METHOD: `PUT` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62128c78-b7a7-4f6c-9059-0169cfe8e31f None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62128c78-b7a7-4f6c-9059-0169cfe8e31f None admin] PATH_INFO: `/v3/projects/0ff0c39307664dd8a995693c95b2fc9d/users/29ab7bfdd7ae43e0a7bbaa31f9a3ad5f/roles/e7989893488f483baa107be56668c4f8` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62128c78-b7a7-4f6c-9059-0169cfe8e31f None admin] RBAC: Authorizing `identity:create_grant(project_id=0ff0c39307664dd8a995693c95b2fc9d, user_id=29ab7bfdd7ae43e0a7bbaa31f9a3ad5f, role_id=e7989893488f483baa107be56668c4f8)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62128c78-b7a7-4f6c-9059-0169cfe8e31f None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:32 l75lg1-v1 dstat.sh[49771]: 28-05 13:00:32| 14 2 80 4 0|5687M 1763M 278M 7896M| 20k 1720B| 0 3036k| 0 397 |8460 16k|1.71 1.20 1.06|2.0 1.0 0| 0 0 | 0 2048M| 29 362 0 43 2 May 28 13:00:32 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1440/2851] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 13:00:32 2024] PUT /identity/v3/projects/0ff0c39307664dd8a995693c95b2fc9d/users/29ab7bfdd7ae43e0a7bbaa31f9a3ad5f/roles/e7989893488f483baa107be56668c4f8 => generated 0 bytes in 23 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:00:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869d5179-90ed-4b4e-b2bc-2e49ab24c2d9 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869d5179-90ed-4b4e-b2bc-2e49ab24c2d9 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869d5179-90ed-4b4e-b2bc-2e49ab24c2d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:32 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-869d5179-90ed-4b4e-b2bc-2e49ab24c2d9 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 13:00:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-869d5179-90ed-4b4e-b2bc-2e49ab24c2d9 None None] MFA Rules not processed for user `29ab7bfdd7ae43e0a7bbaa31f9a3ad5f`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 13:00:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-869d5179-90ed-4b4e-b2bc-2e49ab24c2d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:00:32 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1412/2852] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 13:00:32 2024] POST /identity/v3/auth/tokens => generated 4087 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 13:00:32 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8b4f0fd1-edd5-4fef-976a-4a87ae5862d3 tempest-ShareTransferNegativeTest-884271560 None] <<< [GET] https://127.0.0.1:40443/api/views/ May 28 13:00:32 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8b4f0fd1-edd5-4fef-976a-4a87ae5862d3 tempest-ShareTransferNegativeTest-884271560 None] [Bunch(abac_tags=[], abe_max_depth=None, abe_protocols=[], alias='', allow_anonymous_access=False, allow_s3_anonymous_access=False, auto_commit='0d', bucket='', bucket_creators=[], bucket_creators_groups=[], bucket_owner=None, bulk_permission_update_progress=None, bulk_permission_update_state=None, cluster='loop75-kfs', cluster_id=1, created='2024-05-28T13:00:13.859103Z', enabled=True, files_retention_mode='NONE', guid='bd4002f0-cdd1-438b-9fc7-8bd760ba0dbe', id=41, ignore_oos=False, internal=False, is_remote=False, is_seamless=False, logical_capacity=0, max_retention_period=None, min_retention_period=None, name='f8e9c921-56e5-4b4a-a619-44221b8150a3', nfs_interop_flags='BOTH_NFS3_AND_NFS4_INTEROP_DISABLED', path='/manila/manila-f8e9c921-56e5-4b4a-a619-44221b8150a3', physical_capacity=0, policy='f8e9c921-56e5-4b4a-a619-44221b8150a3', policy_id=42, protocols=['NFS'], qos_policy=None, qos_policy_id=None, s3_locks=False, s3_locks_retention_mode='NONE', s3_locks_retention_period='', s3_unverified_lookup=False, s3_versioning=False, select_for_live_monitoring=False, share='', share_acl=Bunch(acl=[], enabled=False), sync='SYNCED', sync_time='2024-05-28T13:00:14.144608Z', tenant_id=1, tenant_name='default', title='/manila/manila-f8e9c921-56e5-4b4a-a619-44221b8150a3', url='https://127.0.0.1:40443/api/views/41/')] May 28 13:00:32 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8b4f0fd1-edd5-4fef-976a-4a87ae5862d3 tempest-ShareTransferNegativeTest-884271560 None] --- [GET] https://127.0.0.1:40443/api/views/: Done May 28 13:00:32 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8b4f0fd1-edd5-4fef-976a-4a87ae5862d3 tempest-ShareTransferNegativeTest-884271560 None] >>> [DELETE] https://127.0.0.1:40443/api/views/41/ May 28 13:00:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62128c78-b7a7-4f6c-9059-0169cfe8e31f None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62128c78-b7a7-4f6c-9059-0169cfe8e31f None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a0dce5-67c8-422d-90f4-0900fbdea252 tempest-SecurityServicesNegativeTest-691864033 tempest-SecurityServicesNegativeTest-691864033-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29ab7bfdd7ae43e0a7bbaa31f9a3ad5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff0c39307664dd8a995693c95b2fc9d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a0dce5-67c8-422d-90f4-0900fbdea252 tempest-SecurityServicesNegativeTest-691864033 tempest-SecurityServicesNegativeTest-691864033-project-admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a0dce5-67c8-422d-90f4-0900fbdea252 tempest-SecurityServicesNegativeTest-691864033 tempest-SecurityServicesNegativeTest-691864033-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a0dce5-67c8-422d-90f4-0900fbdea252 tempest-SecurityServicesNegativeTest-691864033 tempest-SecurityServicesNegativeTest-691864033-project-admin] PATH_INFO: `/v3/domains` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a0dce5-67c8-422d-90f4-0900fbdea252 tempest-SecurityServicesNegativeTest-691864033 tempest-SecurityServicesNegativeTest-691864033-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=51267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 13:00:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a0dce5-67c8-422d-90f4-0900fbdea252 tempest-SecurityServicesNegativeTest-691864033 tempest-SecurityServicesNegativeTest-691864033-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a0dce5-67c8-422d-90f4-0900fbdea252 tempest-SecurityServicesNegativeTest-691864033 tempest-SecurityServicesNegativeTest-691864033-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:32 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1441/2853] 10.27.203.238 () {62 vars in 1241 bytes} [Tue May 28 13:00:32 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 13:00:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869d5179-90ed-4b4e-b2bc-2e49ab24c2d9 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869d5179-90ed-4b4e-b2bc-2e49ab24c2d9 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e59b06f-ee6a-4519-95ff-0ceda4063fc7 tempest-SecurityServicesNegativeTest-691864033 tempest-SecurityServicesNegativeTest-691864033-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29ab7bfdd7ae43e0a7bbaa31f9a3ad5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff0c39307664dd8a995693c95b2fc9d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e59b06f-ee6a-4519-95ff-0ceda4063fc7 tempest-SecurityServicesNegativeTest-691864033 tempest-SecurityServicesNegativeTest-691864033-project-admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e59b06f-ee6a-4519-95ff-0ceda4063fc7 tempest-SecurityServicesNegativeTest-691864033 tempest-SecurityServicesNegativeTest-691864033-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e59b06f-ee6a-4519-95ff-0ceda4063fc7 tempest-SecurityServicesNegativeTest-691864033 tempest-SecurityServicesNegativeTest-691864033-project-admin] PATH_INFO: `/v3/users` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e59b06f-ee6a-4519-95ff-0ceda4063fc7 tempest-SecurityServicesNegativeTest-691864033 tempest-SecurityServicesNegativeTest-691864033-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e59b06f-ee6a-4519-95ff-0ceda4063fc7 tempest-SecurityServicesNegativeTest-691864033 tempest-SecurityServicesNegativeTest-691864033-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:32 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-8e59b06f-ee6a-4519-95ff-0ceda4063fc7 tempest-SecurityServicesNegativeTest-691864033 tempest-SecurityServicesNegativeTest-691864033-project-admin] Truncating password to algorithm specific maximum length 72 characters. May 28 13:00:32 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1413/2854] 10.27.203.238 () {64 vars in 1232 bytes} [Tue May 28 13:00:32 2024] POST /identity/v3/users => generated 433 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 13:00:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a0dce5-67c8-422d-90f4-0900fbdea252 tempest-SecurityServicesNegativeTest-691864033 tempest-SecurityServicesNegativeTest-691864033-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a0dce5-67c8-422d-90f4-0900fbdea252 tempest-SecurityServicesNegativeTest-691864033 tempest-SecurityServicesNegativeTest-691864033-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63478f8-fa8f-48c2-a471-63ac0457fcd0 tempest-SecurityServicesNegativeTest-691864033 tempest-SecurityServicesNegativeTest-691864033-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29ab7bfdd7ae43e0a7bbaa31f9a3ad5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff0c39307664dd8a995693c95b2fc9d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63478f8-fa8f-48c2-a471-63ac0457fcd0 tempest-SecurityServicesNegativeTest-691864033 tempest-SecurityServicesNegativeTest-691864033-project-admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63478f8-fa8f-48c2-a471-63ac0457fcd0 tempest-SecurityServicesNegativeTest-691864033 tempest-SecurityServicesNegativeTest-691864033-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63478f8-fa8f-48c2-a471-63ac0457fcd0 tempest-SecurityServicesNegativeTest-691864033 tempest-SecurityServicesNegativeTest-691864033-project-admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63478f8-fa8f-48c2-a471-63ac0457fcd0 tempest-SecurityServicesNegativeTest-691864033 tempest-SecurityServicesNegativeTest-691864033-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63478f8-fa8f-48c2-a471-63ac0457fcd0 tempest-SecurityServicesNegativeTest-691864033 tempest-SecurityServicesNegativeTest-691864033-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:32 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1442/2855] 10.27.203.238 () {62 vars in 1210 bytes} [Tue May 28 13:00:32 2024] GET /identity/v3/roles => generated 1680 bytes in 18 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 13:00:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e59b06f-ee6a-4519-95ff-0ceda4063fc7 tempest-SecurityServicesNegativeTest-691864033 tempest-SecurityServicesNegativeTest-691864033-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e59b06f-ee6a-4519-95ff-0ceda4063fc7 tempest-SecurityServicesNegativeTest-691864033 tempest-SecurityServicesNegativeTest-691864033-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68fef18-e4fd-475e-ba0a-ba7a78647880 tempest-SecurityServicesNegativeTest-691864033 tempest-SecurityServicesNegativeTest-691864033-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29ab7bfdd7ae43e0a7bbaa31f9a3ad5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff0c39307664dd8a995693c95b2fc9d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68fef18-e4fd-475e-ba0a-ba7a78647880 tempest-SecurityServicesNegativeTest-691864033 tempest-SecurityServicesNegativeTest-691864033-project-admin] REQUEST_METHOD: `PUT` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68fef18-e4fd-475e-ba0a-ba7a78647880 tempest-SecurityServicesNegativeTest-691864033 tempest-SecurityServicesNegativeTest-691864033-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68fef18-e4fd-475e-ba0a-ba7a78647880 tempest-SecurityServicesNegativeTest-691864033 tempest-SecurityServicesNegativeTest-691864033-project-admin] PATH_INFO: `/v3/projects/0ff0c39307664dd8a995693c95b2fc9d/users/e593bd019bc24f30b8b269cbdd2e3494/roles/44620cad10ae407c90c91e2c296adb04` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68fef18-e4fd-475e-ba0a-ba7a78647880 tempest-SecurityServicesNegativeTest-691864033 tempest-SecurityServicesNegativeTest-691864033-project-admin] RBAC: Authorizing `identity:create_grant(project_id=0ff0c39307664dd8a995693c95b2fc9d, user_id=e593bd019bc24f30b8b269cbdd2e3494, role_id=44620cad10ae407c90c91e2c296adb04)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68fef18-e4fd-475e-ba0a-ba7a78647880 tempest-SecurityServicesNegativeTest-691864033 tempest-SecurityServicesNegativeTest-691864033-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:32 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1414/2856] 10.27.203.238 () {64 vars in 1571 bytes} [Tue May 28 13:00:32 2024] PUT /identity/v3/projects/0ff0c39307664dd8a995693c95b2fc9d/users/e593bd019bc24f30b8b269cbdd2e3494/roles/44620cad10ae407c90c91e2c296adb04 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:00:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63478f8-fa8f-48c2-a471-63ac0457fcd0 tempest-SecurityServicesNegativeTest-691864033 tempest-SecurityServicesNegativeTest-691864033-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-e63478f8-fa8f-48c2-a471-63ac0457fcd0 tempest-SecurityServicesNegativeTest-691864033 tempest-SecurityServicesNegativeTest-691864033-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:00:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63478f8-fa8f-48c2-a471-63ac0457fcd0 tempest-SecurityServicesNegativeTest-691864033 tempest-SecurityServicesNegativeTest-691864033-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:32 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-aad92a6b-6bc8-444f-b717-f152a6b8f72b tempest-UserMessageNegativeTest-781603078 tempest-UserMessageNegativeTest-781603078-project-member] GET http://10.27.203.238/share/v2/ca9b4c5f200844bdbcc6db13e907f21e/shares/47cad5db-9d67-4af7-91ff-034b26ea9f93 May 28 13:00:32 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-aad92a6b-6bc8-444f-b717-f152a6b8f72b tempest-UserMessageNegativeTest-781603078 tempest-UserMessageNegativeTest-781603078-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:32 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-aad92a6b-6bc8-444f-b717-f152a6b8f72b tempest-UserMessageNegativeTest-781603078 tempest-UserMessageNegativeTest-781603078-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:32 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-aad92a6b-6bc8-444f-b717-f152a6b8f72b tempest-UserMessageNegativeTest-781603078 tempest-UserMessageNegativeTest-781603078-project-member] http://10.27.203.238/share/v2/ca9b4c5f200844bdbcc6db13e907f21e/shares/47cad5db-9d67-4af7-91ff-034b26ea9f93 returned with HTTP 200 May 28 13:00:32 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 930/1832] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:00:32 2024] GET /share/v2/ca9b4c5f200844bdbcc6db13e907f21e/shares/47cad5db-9d67-4af7-91ff-034b26ea9f93 => generated 1330 bytes in 29 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:00:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715b03d9-d4c1-4b7f-a1d4-fecdd34560f6 service manila] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f110cf6300f049c897d0aab63218d1e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715b03d9-d4c1-4b7f-a1d4-fecdd34560f6 service manila] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715b03d9-d4c1-4b7f-a1d4-fecdd34560f6 service manila] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715b03d9-d4c1-4b7f-a1d4-fecdd34560f6 service manila] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715b03d9-d4c1-4b7f-a1d4-fecdd34560f6 service manila] RBAC: Authorizing `identity:validate_token()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715b03d9-d4c1-4b7f-a1d4-fecdd34560f6 service manila] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:32 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1443/2857] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 13:00:32 2024] GET /identity/v3/auth/tokens => generated 4087 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 13:00:32 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-9abe59c9-c0fd-400a-b7a2-e64f091ca532 tempest-SecurityServicesNegativeTest-691864033 tempest-SecurityServicesNegativeTest-691864033-project-admin] POST http://10.27.203.238/share/v2/0ff0c39307664dd8a995693c95b2fc9d/types May 28 13:00:32 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-9abe59c9-c0fd-400a-b7a2-e64f091ca532 tempest-SecurityServicesNegativeTest-691864033 tempest-SecurityServicesNegativeTest-691864033-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share_type": {"name": "tempest-typeshare-type-1750176425", "extra_specs": {"driver_handles_share_servers": "False"}, "share_type_access:is_public": true}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:00:32 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-9abe59c9-c0fd-400a-b7a2-e64f091ca532 tempest-SecurityServicesNegativeTest-691864033 tempest-SecurityServicesNegativeTest-691864033-project-admin] http://10.27.203.238/share/v2/0ff0c39307664dd8a995693c95b2fc9d/types returned with HTTP 200 May 28 13:00:32 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 903/1833] 10.27.203.238 () {66 vars in 1359 bytes} [Tue May 28 13:00:32 2024] POST /share/v2/0ff0c39307664dd8a995693c95b2fc9d/types => generated 623 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:00:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68fef18-e4fd-475e-ba0a-ba7a78647880 tempest-SecurityServicesNegativeTest-691864033 tempest-SecurityServicesNegativeTest-691864033-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-d68fef18-e4fd-475e-ba0a-ba7a78647880 tempest-SecurityServicesNegativeTest-691864033 tempest-SecurityServicesNegativeTest-691864033-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:00:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68fef18-e4fd-475e-ba0a-ba7a78647880 tempest-SecurityServicesNegativeTest-691864033 tempest-SecurityServicesNegativeTest-691864033-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf1e65a-87b8-47fa-9106-e54d1fd44e4e service manila] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f110cf6300f049c897d0aab63218d1e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf1e65a-87b8-47fa-9106-e54d1fd44e4e service manila] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf1e65a-87b8-47fa-9106-e54d1fd44e4e service manila] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf1e65a-87b8-47fa-9106-e54d1fd44e4e service manila] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf1e65a-87b8-47fa-9106-e54d1fd44e4e service manila] RBAC: Authorizing `identity:validate_token()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf1e65a-87b8-47fa-9106-e54d1fd44e4e service manila] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:32 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1415/2858] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 13:00:32 2024] GET /identity/v3/auth/tokens => generated 3966 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 13:00:32 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-039d35d0-cc90-485f-bb8a-8ce521c9710a tempest-SecurityServicesNegativeTest-1440674276 tempest-SecurityServicesNegativeTest-1440674276-project-member] POST http://10.27.203.238/share/v1/fbb20f2175704a80968d536160c6c6fa/security-services May 28 13:00:32 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-039d35d0-cc90-485f-bb8a-8ce521c9710a tempest-SecurityServicesNegativeTest-1440674276 tempest-SecurityServicesNegativeTest-1440674276-project-member] Action: 'create', calling method: SecurityServiceController.create, body: {"security_service": {"type": "ldap", "name": "tempest-ss-name-5416937", "description": "tempest-ss-desc-1625480610", "dns_ip": "203.0.113.3", "server": "203.0.113.237", "domain": "tempest-ss-domain-2117600654", "user": "tempest-ss-user-1622753044", "password": "***"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:00:32 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-039d35d0-cc90-485f-bb8a-8ce521c9710a tempest-SecurityServicesNegativeTest-1440674276 tempest-SecurityServicesNegativeTest-1440674276-project-member] http://10.27.203.238/share/v1/fbb20f2175704a80968d536160c6c6fa/security-services returned with HTTP 200 May 28 13:00:32 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 931/1834] 10.27.203.238 () {64 vars in 1352 bytes} [Tue May 28 13:00:32 2024] POST /share/v1/fbb20f2175704a80968d536160c6c6fa/security-services => generated 472 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:00:32 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-922d40a5-5deb-47af-9f52-d309f1d11068 tempest-SecurityServicesNegativeTest-1440674276 tempest-SecurityServicesNegativeTest-1440674276-project-member] DELETE http://10.27.203.238/share/v1/fbb20f2175704a80968d536160c6c6fa/security-services/4e8f8447-5272-451d-9e1e-1d2028baaa53 May 28 13:00:32 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-922d40a5-5deb-47af-9f52-d309f1d11068 tempest-SecurityServicesNegativeTest-1440674276 tempest-SecurityServicesNegativeTest-1440674276-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:32 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-922d40a5-5deb-47af-9f52-d309f1d11068 tempest-SecurityServicesNegativeTest-1440674276 tempest-SecurityServicesNegativeTest-1440674276-project-member] Calling method 'SecurityServiceController.delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:32 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.v1.security_service [None req-922d40a5-5deb-47af-9f52-d309f1d11068 tempest-SecurityServicesNegativeTest-1440674276 tempest-SecurityServicesNegativeTest-1440674276-project-member] Delete security service with id: 4e8f8447-5272-451d-9e1e-1d2028baaa53 May 28 13:00:32 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-922d40a5-5deb-47af-9f52-d309f1d11068 tempest-SecurityServicesNegativeTest-1440674276 tempest-SecurityServicesNegativeTest-1440674276-project-member] http://10.27.203.238/share/v1/fbb20f2175704a80968d536160c6c6fa/security-services/4e8f8447-5272-451d-9e1e-1d2028baaa53 returned with HTTP 202 May 28 13:00:32 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 904/1835] 10.27.203.238 () {62 vars in 1444 bytes} [Tue May 28 13:00:32 2024] DELETE /share/v1/fbb20f2175704a80968d536160c6c6fa/security-services/4e8f8447-5272-451d-9e1e-1d2028baaa53 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 6 headers in 242 bytes (1 switches on core 0) May 28 13:00:32 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-0261d1a1-d448-4f8e-a057-7972000f1fe1 tempest-SecurityServicesNegativeTest-1440674276 tempest-SecurityServicesNegativeTest-1440674276-project-member] GET http://10.27.203.238/share/v1/fbb20f2175704a80968d536160c6c6fa/security-services/4e8f8447-5272-451d-9e1e-1d2028baaa53 May 28 13:00:32 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-0261d1a1-d448-4f8e-a057-7972000f1fe1 tempest-SecurityServicesNegativeTest-1440674276 tempest-SecurityServicesNegativeTest-1440674276-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:32 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-0261d1a1-d448-4f8e-a057-7972000f1fe1 tempest-SecurityServicesNegativeTest-1440674276 tempest-SecurityServicesNegativeTest-1440674276-project-member] Calling method 'SecurityServiceController.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:32 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-0261d1a1-d448-4f8e-a057-7972000f1fe1 tempest-SecurityServicesNegativeTest-1440674276 tempest-SecurityServicesNegativeTest-1440674276-project-member] HTTP exception thrown: The resource could not be found. May 28 13:00:32 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-0261d1a1-d448-4f8e-a057-7972000f1fe1 tempest-SecurityServicesNegativeTest-1440674276 tempest-SecurityServicesNegativeTest-1440674276-project-member] http://10.27.203.238/share/v1/fbb20f2175704a80968d536160c6c6fa/security-services/4e8f8447-5272-451d-9e1e-1d2028baaa53 returned with HTTP 404 May 28 13:00:32 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 932/1836] 10.27.203.238 () {62 vars in 1441 bytes} [Tue May 28 13:00:32 2024] GET /share/v1/fbb20f2175704a80968d536160c6c6fa/security-services/4e8f8447-5272-451d-9e1e-1d2028baaa53 => generated 78 bytes in 8 msecs (HTTP/1.1 404) 6 headers in 236 bytes (1 switches on core 0) May 28 13:00:32 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-d04e0a7b-7c2b-4894-97ac-4d24e489b620 tempest-SecurityServicesNegativeTest-1440674276 tempest-SecurityServicesNegativeTest-1440674276-project-member] DELETE http://10.27.203.238/share/v1/fbb20f2175704a80968d536160c6c6fa/security-services/4e8f8447-5272-451d-9e1e-1d2028baaa53 May 28 13:00:32 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-d04e0a7b-7c2b-4894-97ac-4d24e489b620 tempest-SecurityServicesNegativeTest-1440674276 tempest-SecurityServicesNegativeTest-1440674276-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:32 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-d04e0a7b-7c2b-4894-97ac-4d24e489b620 tempest-SecurityServicesNegativeTest-1440674276 tempest-SecurityServicesNegativeTest-1440674276-project-member] Calling method 'SecurityServiceController.delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:32 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.v1.security_service [None req-d04e0a7b-7c2b-4894-97ac-4d24e489b620 tempest-SecurityServicesNegativeTest-1440674276 tempest-SecurityServicesNegativeTest-1440674276-project-member] Delete security service with id: 4e8f8447-5272-451d-9e1e-1d2028baaa53 May 28 13:00:32 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-d04e0a7b-7c2b-4894-97ac-4d24e489b620 tempest-SecurityServicesNegativeTest-1440674276 tempest-SecurityServicesNegativeTest-1440674276-project-member] HTTP exception thrown: The resource could not be found. May 28 13:00:32 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-d04e0a7b-7c2b-4894-97ac-4d24e489b620 tempest-SecurityServicesNegativeTest-1440674276 tempest-SecurityServicesNegativeTest-1440674276-project-member] http://10.27.203.238/share/v1/fbb20f2175704a80968d536160c6c6fa/security-services/4e8f8447-5272-451d-9e1e-1d2028baaa53 returned with HTTP 404 May 28 13:00:32 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 905/1837] 10.27.203.238 () {62 vars in 1444 bytes} [Tue May 28 13:00:32 2024] DELETE /share/v1/fbb20f2175704a80968d536160c6c6fa/security-services/4e8f8447-5272-451d-9e1e-1d2028baaa53 => generated 78 bytes in 8 msecs (HTTP/1.1 404) 6 headers in 236 bytes (1 switches on core 0) May 28 13:00:32 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-3c9f464b-576b-4d25-9fe4-1e9d2f06fb13 tempest-SecurityServicesNegativeTest-1440674276 tempest-SecurityServicesNegativeTest-1440674276-project-member] POST http://10.27.203.238/share/v1/fbb20f2175704a80968d536160c6c6fa/security-services May 28 13:00:32 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-3c9f464b-576b-4d25-9fe4-1e9d2f06fb13 tempest-SecurityServicesNegativeTest-1440674276 tempest-SecurityServicesNegativeTest-1440674276-project-member] Action: 'create', calling method: SecurityServiceController.create, body: {"security_service": {"type": ""}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:00:32 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-3c9f464b-576b-4d25-9fe4-1e9d2f06fb13 tempest-SecurityServicesNegativeTest-1440674276 tempest-SecurityServicesNegativeTest-1440674276-project-member] http://10.27.203.238/share/v1/fbb20f2175704a80968d536160c6c6fa/security-services returned with HTTP 400 May 28 13:00:32 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 933/1838] 10.27.203.238 () {64 vars in 1351 bytes} [Tue May 28 13:00:32 2024] POST /share/v1/fbb20f2175704a80968d536160c6c6fa/security-services => generated 161 bytes in 5 msecs (HTTP/1.1 400) 6 headers in 239 bytes (1 switches on core 0) May 28 13:00:32 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-deb90f84-35a9-4b5f-a3cb-82d66a916867 tempest-SecurityServicesNegativeTest-1440674276 tempest-SecurityServicesNegativeTest-1440674276-project-member] POST http://10.27.203.238/share/v1/fbb20f2175704a80968d536160c6c6fa/security-services May 28 13:00:32 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-deb90f84-35a9-4b5f-a3cb-82d66a916867 tempest-SecurityServicesNegativeTest-1440674276 tempest-SecurityServicesNegativeTest-1440674276-project-member] Action: 'create', calling method: SecurityServiceController.create, body: {"security_service": {"type": "wrong_type"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:00:32 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-deb90f84-35a9-4b5f-a3cb-82d66a916867 tempest-SecurityServicesNegativeTest-1440674276 tempest-SecurityServicesNegativeTest-1440674276-project-member] http://10.27.203.238/share/v1/fbb20f2175704a80968d536160c6c6fa/security-services returned with HTTP 400 May 28 13:00:32 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 906/1839] 10.27.203.238 () {64 vars in 1351 bytes} [Tue May 28 13:00:32 2024] POST /share/v1/fbb20f2175704a80968d536160c6c6fa/security-services => generated 171 bytes in 5 msecs (HTTP/1.1 400) 6 headers in 239 bytes (1 switches on core 0) May 28 13:00:32 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-b20a94eb-26ff-4769-be2f-498cf5784021 tempest-SecurityServicesNegativeTest-1440674276 tempest-SecurityServicesNegativeTest-1440674276-project-member] DELETE http://10.27.203.238/share/v1/fbb20f2175704a80968d536160c6c6fa/security-services/wrong_id May 28 13:00:32 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-b20a94eb-26ff-4769-be2f-498cf5784021 tempest-SecurityServicesNegativeTest-1440674276 tempest-SecurityServicesNegativeTest-1440674276-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:32 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-b20a94eb-26ff-4769-be2f-498cf5784021 tempest-SecurityServicesNegativeTest-1440674276 tempest-SecurityServicesNegativeTest-1440674276-project-member] Calling method 'SecurityServiceController.delete' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:32 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.v1.security_service [None req-b20a94eb-26ff-4769-be2f-498cf5784021 tempest-SecurityServicesNegativeTest-1440674276 tempest-SecurityServicesNegativeTest-1440674276-project-member] Delete security service with id: wrong_id May 28 13:00:32 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-b20a94eb-26ff-4769-be2f-498cf5784021 tempest-SecurityServicesNegativeTest-1440674276 tempest-SecurityServicesNegativeTest-1440674276-project-member] HTTP exception thrown: The resource could not be found. May 28 13:00:32 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-b20a94eb-26ff-4769-be2f-498cf5784021 tempest-SecurityServicesNegativeTest-1440674276 tempest-SecurityServicesNegativeTest-1440674276-project-member] http://10.27.203.238/share/v1/fbb20f2175704a80968d536160c6c6fa/security-services/wrong_id returned with HTTP 404 May 28 13:00:32 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 934/1840] 10.27.203.238 () {62 vars in 1360 bytes} [Tue May 28 13:00:32 2024] DELETE /share/v1/fbb20f2175704a80968d536160c6c6fa/security-services/wrong_id => generated 78 bytes in 8 msecs (HTTP/1.1 404) 6 headers in 236 bytes (1 switches on core 0) May 28 13:00:32 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 907/1841] 10.27.203.238 () {62 vars in 1336 bytes} [Tue May 28 13:00:32 2024] DELETE /share/v1/fbb20f2175704a80968d536160c6c6fa/security-services/ => generated 112 bytes in 3 msecs (HTTP/1.1 404) 3 headers in 98 bytes (1 switches on core 0) May 28 13:00:32 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-f46c0f20-006e-4169-868d-fe848de8b7aa tempest-SecurityServicesNegativeTest-1440674276 tempest-SecurityServicesNegativeTest-1440674276-project-member] GET http://10.27.203.238/share/v1/fbb20f2175704a80968d536160c6c6fa/security-services/wrong_id May 28 13:00:32 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-f46c0f20-006e-4169-868d-fe848de8b7aa tempest-SecurityServicesNegativeTest-1440674276 tempest-SecurityServicesNegativeTest-1440674276-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:32 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-f46c0f20-006e-4169-868d-fe848de8b7aa tempest-SecurityServicesNegativeTest-1440674276 tempest-SecurityServicesNegativeTest-1440674276-project-member] Calling method 'SecurityServiceController.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:32 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-f46c0f20-006e-4169-868d-fe848de8b7aa tempest-SecurityServicesNegativeTest-1440674276 tempest-SecurityServicesNegativeTest-1440674276-project-member] HTTP exception thrown: The resource could not be found. May 28 13:00:32 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-f46c0f20-006e-4169-868d-fe848de8b7aa tempest-SecurityServicesNegativeTest-1440674276 tempest-SecurityServicesNegativeTest-1440674276-project-member] http://10.27.203.238/share/v1/fbb20f2175704a80968d536160c6c6fa/security-services/wrong_id returned with HTTP 404 May 28 13:00:32 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 935/1842] 10.27.203.238 () {62 vars in 1357 bytes} [Tue May 28 13:00:32 2024] GET /share/v1/fbb20f2175704a80968d536160c6c6fa/security-services/wrong_id => generated 78 bytes in 7 msecs (HTTP/1.1 404) 6 headers in 236 bytes (1 switches on core 0) May 28 13:00:32 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 908/1843] 10.27.203.238 () {62 vars in 1333 bytes} [Tue May 28 13:00:32 2024] GET /share/v1/fbb20f2175704a80968d536160c6c6fa/security-services/ => generated 112 bytes in 3 msecs (HTTP/1.1 404) 3 headers in 98 bytes (1 switches on core 0) May 28 13:00:32 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-e64368e7-980b-4979-b38b-862bd5310cd6 tempest-SecurityServicesNegativeTest-1440674276 tempest-SecurityServicesNegativeTest-1440674276-project-member] PUT http://10.27.203.238/share/v1/fbb20f2175704a80968d536160c6c6fa/security-services/wrong_id May 28 13:00:32 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-e64368e7-980b-4979-b38b-862bd5310cd6 tempest-SecurityServicesNegativeTest-1440674276 tempest-SecurityServicesNegativeTest-1440674276-project-member] Action: 'update', calling method: SecurityServiceController.update, body: {"security_service": {"name": "name"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:00:32 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-e64368e7-980b-4979-b38b-862bd5310cd6 tempest-SecurityServicesNegativeTest-1440674276 tempest-SecurityServicesNegativeTest-1440674276-project-member] HTTP exception thrown: The resource could not be found. May 28 13:00:33 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-e64368e7-980b-4979-b38b-862bd5310cd6 tempest-SecurityServicesNegativeTest-1440674276 tempest-SecurityServicesNegativeTest-1440674276-project-member] http://10.27.203.238/share/v1/fbb20f2175704a80968d536160c6c6fa/security-services/wrong_id returned with HTTP 404 May 28 13:00:33 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 936/1844] 10.27.203.238 () {64 vars in 1377 bytes} [Tue May 28 13:00:32 2024] PUT /share/v1/fbb20f2175704a80968d536160c6c6fa/security-services/wrong_id => generated 78 bytes in 7 msecs (HTTP/1.1 404) 6 headers in 236 bytes (1 switches on core 0) May 28 13:00:33 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 909/1845] 10.27.203.238 () {64 vars in 1353 bytes} [Tue May 28 13:00:33 2024] PUT /share/v1/fbb20f2175704a80968d536160c6c6fa/security-services/ => generated 112 bytes in 2 msecs (HTTP/1.1 404) 3 headers in 98 bytes (1 switches on core 0) May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715b03d9-d4c1-4b7f-a1d4-fecdd34560f6 service manila] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715b03d9-d4c1-4b7f-a1d4-fecdd34560f6 service manila] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8440fc5d-4153-42b8-8609-0bd9e33cf2ba tempest-SecurityServicesNegativeTest-691864033 tempest-SecurityServicesNegativeTest-691864033-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29ab7bfdd7ae43e0a7bbaa31f9a3ad5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff0c39307664dd8a995693c95b2fc9d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8440fc5d-4153-42b8-8609-0bd9e33cf2ba tempest-SecurityServicesNegativeTest-691864033 tempest-SecurityServicesNegativeTest-691864033-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8440fc5d-4153-42b8-8609-0bd9e33cf2ba tempest-SecurityServicesNegativeTest-691864033 tempest-SecurityServicesNegativeTest-691864033-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8440fc5d-4153-42b8-8609-0bd9e33cf2ba tempest-SecurityServicesNegativeTest-691864033 tempest-SecurityServicesNegativeTest-691864033-project-admin] PATH_INFO: `/v3/users/14783f4fbce14880b4db4a628827607e` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8440fc5d-4153-42b8-8609-0bd9e33cf2ba tempest-SecurityServicesNegativeTest-691864033 tempest-SecurityServicesNegativeTest-691864033-project-admin] RBAC: Authorizing `identity:delete_user(user_id=14783f4fbce14880b4db4a628827607e)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8440fc5d-4153-42b8-8609-0bd9e33cf2ba tempest-SecurityServicesNegativeTest-691864033 tempest-SecurityServicesNegativeTest-691864033-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-8440fc5d-4153-42b8-8609-0bd9e33cf2ba tempest-SecurityServicesNegativeTest-691864033 tempest-SecurityServicesNegativeTest-691864033-project-admin] Could not find user: 14783f4fbce14880b4db4a628827607e.: keystone.exception.UserNotFound: Could not find user: 14783f4fbce14880b4db4a628827607e. May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 14783f4fbce14880b4db4a628827607e. May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1444/2859] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:00:33 2024] DELETE /identity/v3/users/14783f4fbce14880b4db4a628827607e => generated 110 bytes in 23 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf1e65a-87b8-47fa-9106-e54d1fd44e4e service manila] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf1e65a-87b8-47fa-9106-e54d1fd44e4e service manila] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ad3808-bae3-49cc-88fd-a18df18766ff tempest-SecurityServicesNegativeTest-691864033 tempest-SecurityServicesNegativeTest-691864033-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29ab7bfdd7ae43e0a7bbaa31f9a3ad5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff0c39307664dd8a995693c95b2fc9d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ad3808-bae3-49cc-88fd-a18df18766ff tempest-SecurityServicesNegativeTest-691864033 tempest-SecurityServicesNegativeTest-691864033-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ad3808-bae3-49cc-88fd-a18df18766ff tempest-SecurityServicesNegativeTest-691864033 tempest-SecurityServicesNegativeTest-691864033-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ad3808-bae3-49cc-88fd-a18df18766ff tempest-SecurityServicesNegativeTest-691864033 tempest-SecurityServicesNegativeTest-691864033-project-admin] PATH_INFO: `/v3/users/9eca355145fd413390b5efe7a0d95465` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ad3808-bae3-49cc-88fd-a18df18766ff tempest-SecurityServicesNegativeTest-691864033 tempest-SecurityServicesNegativeTest-691864033-project-admin] RBAC: Authorizing `identity:delete_user(user_id=9eca355145fd413390b5efe7a0d95465)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ad3808-bae3-49cc-88fd-a18df18766ff tempest-SecurityServicesNegativeTest-691864033 tempest-SecurityServicesNegativeTest-691864033-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-35ad3808-bae3-49cc-88fd-a18df18766ff tempest-SecurityServicesNegativeTest-691864033 tempest-SecurityServicesNegativeTest-691864033-project-admin] Could not find user: 9eca355145fd413390b5efe7a0d95465.: keystone.exception.UserNotFound: Could not find user: 9eca355145fd413390b5efe7a0d95465. May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 9eca355145fd413390b5efe7a0d95465. May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1416/2860] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:00:33 2024] DELETE /identity/v3/users/9eca355145fd413390b5efe7a0d95465 => generated 110 bytes in 24 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8440fc5d-4153-42b8-8609-0bd9e33cf2ba tempest-SecurityServicesNegativeTest-691864033 tempest-SecurityServicesNegativeTest-691864033-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8440fc5d-4153-42b8-8609-0bd9e33cf2ba tempest-SecurityServicesNegativeTest-691864033 tempest-SecurityServicesNegativeTest-691864033-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e73e77f-766d-4028-9d78-e62bda9a3a89 tempest-SecurityServicesNegativeTest-691864033 tempest-SecurityServicesNegativeTest-691864033-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29ab7bfdd7ae43e0a7bbaa31f9a3ad5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff0c39307664dd8a995693c95b2fc9d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e73e77f-766d-4028-9d78-e62bda9a3a89 tempest-SecurityServicesNegativeTest-691864033 tempest-SecurityServicesNegativeTest-691864033-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e73e77f-766d-4028-9d78-e62bda9a3a89 tempest-SecurityServicesNegativeTest-691864033 tempest-SecurityServicesNegativeTest-691864033-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e73e77f-766d-4028-9d78-e62bda9a3a89 tempest-SecurityServicesNegativeTest-691864033 tempest-SecurityServicesNegativeTest-691864033-project-admin] PATH_INFO: `/v3/users/91ab54ee09854b549923fb7671247f5c` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e73e77f-766d-4028-9d78-e62bda9a3a89 tempest-SecurityServicesNegativeTest-691864033 tempest-SecurityServicesNegativeTest-691864033-project-admin] RBAC: Authorizing `identity:delete_user(user_id=91ab54ee09854b549923fb7671247f5c)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e73e77f-766d-4028-9d78-e62bda9a3a89 tempest-SecurityServicesNegativeTest-691864033 tempest-SecurityServicesNegativeTest-691864033-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-2e73e77f-766d-4028-9d78-e62bda9a3a89 tempest-SecurityServicesNegativeTest-691864033 tempest-SecurityServicesNegativeTest-691864033-project-admin] Could not find user: 91ab54ee09854b549923fb7671247f5c.: keystone.exception.UserNotFound: Could not find user: 91ab54ee09854b549923fb7671247f5c. May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 91ab54ee09854b549923fb7671247f5c. May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1445/2861] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:00:33 2024] DELETE /identity/v3/users/91ab54ee09854b549923fb7671247f5c => generated 110 bytes in 23 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ad3808-bae3-49cc-88fd-a18df18766ff tempest-SecurityServicesNegativeTest-691864033 tempest-SecurityServicesNegativeTest-691864033-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ad3808-bae3-49cc-88fd-a18df18766ff tempest-SecurityServicesNegativeTest-691864033 tempest-SecurityServicesNegativeTest-691864033-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:33 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-4993dec4-42a5-42fc-8777-d78d61dfeb92 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] GET http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/shares/f4283c2a-3835-416e-9703-f5745babbf5c May 28 13:00:33 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-4993dec4-42a5-42fc-8777-d78d61dfeb92 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:33 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-4993dec4-42a5-42fc-8777-d78d61dfeb92 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f27bb55-172c-4863-8aa1-b65462e76920 tempest-SecurityServicesNegativeTest-691864033 tempest-SecurityServicesNegativeTest-691864033-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29ab7bfdd7ae43e0a7bbaa31f9a3ad5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff0c39307664dd8a995693c95b2fc9d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f27bb55-172c-4863-8aa1-b65462e76920 tempest-SecurityServicesNegativeTest-691864033 tempest-SecurityServicesNegativeTest-691864033-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f27bb55-172c-4863-8aa1-b65462e76920 tempest-SecurityServicesNegativeTest-691864033 tempest-SecurityServicesNegativeTest-691864033-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f27bb55-172c-4863-8aa1-b65462e76920 tempest-SecurityServicesNegativeTest-691864033 tempest-SecurityServicesNegativeTest-691864033-project-admin] PATH_INFO: `/v3/users/2889a927897c49bd92a0d1cfdf27e7f5` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f27bb55-172c-4863-8aa1-b65462e76920 tempest-SecurityServicesNegativeTest-691864033 tempest-SecurityServicesNegativeTest-691864033-project-admin] RBAC: Authorizing `identity:delete_user(user_id=2889a927897c49bd92a0d1cfdf27e7f5)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f27bb55-172c-4863-8aa1-b65462e76920 tempest-SecurityServicesNegativeTest-691864033 tempest-SecurityServicesNegativeTest-691864033-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-4f27bb55-172c-4863-8aa1-b65462e76920 tempest-SecurityServicesNegativeTest-691864033 tempest-SecurityServicesNegativeTest-691864033-project-admin] Could not find user: 2889a927897c49bd92a0d1cfdf27e7f5.: keystone.exception.UserNotFound: Could not find user: 2889a927897c49bd92a0d1cfdf27e7f5. May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 2889a927897c49bd92a0d1cfdf27e7f5. May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1417/2862] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:00:33 2024] DELETE /identity/v3/users/2889a927897c49bd92a0d1cfdf27e7f5 => generated 110 bytes in 24 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e73e77f-766d-4028-9d78-e62bda9a3a89 tempest-SecurityServicesNegativeTest-691864033 tempest-SecurityServicesNegativeTest-691864033-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e73e77f-766d-4028-9d78-e62bda9a3a89 tempest-SecurityServicesNegativeTest-691864033 tempest-SecurityServicesNegativeTest-691864033-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:33 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-4993dec4-42a5-42fc-8777-d78d61dfeb92 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/shares/f4283c2a-3835-416e-9703-f5745babbf5c returned with HTTP 200 May 28 13:00:33 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 937/1846] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:00:33 2024] GET /share/v2/a4f3887fa28c457390f5b66615564430/shares/f4283c2a-3835-416e-9703-f5745babbf5c => generated 1317 bytes in 30 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b2c70f-b04d-41a1-8fce-a44b2b7d8f8a tempest-SecurityServicesNegativeTest-691864033 tempest-SecurityServicesNegativeTest-691864033-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29ab7bfdd7ae43e0a7bbaa31f9a3ad5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff0c39307664dd8a995693c95b2fc9d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b2c70f-b04d-41a1-8fce-a44b2b7d8f8a tempest-SecurityServicesNegativeTest-691864033 tempest-SecurityServicesNegativeTest-691864033-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b2c70f-b04d-41a1-8fce-a44b2b7d8f8a tempest-SecurityServicesNegativeTest-691864033 tempest-SecurityServicesNegativeTest-691864033-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b2c70f-b04d-41a1-8fce-a44b2b7d8f8a tempest-SecurityServicesNegativeTest-691864033 tempest-SecurityServicesNegativeTest-691864033-project-admin] PATH_INFO: `/v3/users/bd43e5d1c359462d807b6e8a8581fa73` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:33 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-41955ae2-33c8-43bb-8d54-95a6c9ae3321 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] POST http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/shares/f4283c2a-3835-416e-9703-f5745babbf5c/action May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b2c70f-b04d-41a1-8fce-a44b2b7d8f8a tempest-SecurityServicesNegativeTest-691864033 tempest-SecurityServicesNegativeTest-691864033-project-admin] RBAC: Authorizing `identity:delete_user(user_id=bd43e5d1c359462d807b6e8a8581fa73)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:33 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-41955ae2-33c8-43bb-8d54-95a6c9ae3321 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Action body: b'{"allow_access": {"access_type": "ip", "access_to": "203.0.113.77", "access_level": "rw"}}' {{(pid=98330) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 13:00:33 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-41955ae2-33c8-43bb-8d54-95a6c9ae3321 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Action: 'action', calling method: ShareController.allow_access, body: {"allow_access": {"access_type": "ip", "access_to": "203.0.113.77", "access_level": "rw"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b2c70f-b04d-41a1-8fce-a44b2b7d8f8a tempest-SecurityServicesNegativeTest-691864033 tempest-SecurityServicesNegativeTest-691864033-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-b3b2c70f-b04d-41a1-8fce-a44b2b7d8f8a tempest-SecurityServicesNegativeTest-691864033 tempest-SecurityServicesNegativeTest-691864033-project-admin] Could not find user: bd43e5d1c359462d807b6e8a8581fa73.: keystone.exception.UserNotFound: Could not find user: bd43e5d1c359462d807b6e8a8581fa73. May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: bd43e5d1c359462d807b6e8a8581fa73. May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1446/2863] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:00:33 2024] DELETE /identity/v3/users/bd43e5d1c359462d807b6e8a8581fa73 => generated 110 bytes in 23 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f27bb55-172c-4863-8aa1-b65462e76920 tempest-SecurityServicesNegativeTest-691864033 tempest-SecurityServicesNegativeTest-691864033-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f27bb55-172c-4863-8aa1-b65462e76920 tempest-SecurityServicesNegativeTest-691864033 tempest-SecurityServicesNegativeTest-691864033-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5389c4d4-a089-4260-8625-32f279349fb0 tempest-SecurityServicesNegativeTest-691864033 tempest-SecurityServicesNegativeTest-691864033-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29ab7bfdd7ae43e0a7bbaa31f9a3ad5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff0c39307664dd8a995693c95b2fc9d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5389c4d4-a089-4260-8625-32f279349fb0 tempest-SecurityServicesNegativeTest-691864033 tempest-SecurityServicesNegativeTest-691864033-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5389c4d4-a089-4260-8625-32f279349fb0 tempest-SecurityServicesNegativeTest-691864033 tempest-SecurityServicesNegativeTest-691864033-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5389c4d4-a089-4260-8625-32f279349fb0 tempest-SecurityServicesNegativeTest-691864033 tempest-SecurityServicesNegativeTest-691864033-project-admin] PATH_INFO: `/v3/users/18c7667276334e98bdd11d2b9d1875cc` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5389c4d4-a089-4260-8625-32f279349fb0 tempest-SecurityServicesNegativeTest-691864033 tempest-SecurityServicesNegativeTest-691864033-project-admin] RBAC: Authorizing `identity:delete_user(user_id=18c7667276334e98bdd11d2b9d1875cc)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5389c4d4-a089-4260-8625-32f279349fb0 tempest-SecurityServicesNegativeTest-691864033 tempest-SecurityServicesNegativeTest-691864033-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-5389c4d4-a089-4260-8625-32f279349fb0 tempest-SecurityServicesNegativeTest-691864033 tempest-SecurityServicesNegativeTest-691864033-project-admin] Could not find user: 18c7667276334e98bdd11d2b9d1875cc.: keystone.exception.UserNotFound: Could not find user: 18c7667276334e98bdd11d2b9d1875cc. May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 18c7667276334e98bdd11d2b9d1875cc. May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1418/2864] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:00:33 2024] DELETE /identity/v3/users/18c7667276334e98bdd11d2b9d1875cc => generated 110 bytes in 28 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b2c70f-b04d-41a1-8fce-a44b2b7d8f8a tempest-SecurityServicesNegativeTest-691864033 tempest-SecurityServicesNegativeTest-691864033-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b2c70f-b04d-41a1-8fce-a44b2b7d8f8a tempest-SecurityServicesNegativeTest-691864033 tempest-SecurityServicesNegativeTest-691864033-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067256c9-a177-4a49-8ec2-2e4477c1954b tempest-SecurityServicesNegativeTest-691864033 tempest-SecurityServicesNegativeTest-691864033-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29ab7bfdd7ae43e0a7bbaa31f9a3ad5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff0c39307664dd8a995693c95b2fc9d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067256c9-a177-4a49-8ec2-2e4477c1954b tempest-SecurityServicesNegativeTest-691864033 tempest-SecurityServicesNegativeTest-691864033-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067256c9-a177-4a49-8ec2-2e4477c1954b tempest-SecurityServicesNegativeTest-691864033 tempest-SecurityServicesNegativeTest-691864033-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067256c9-a177-4a49-8ec2-2e4477c1954b tempest-SecurityServicesNegativeTest-691864033 tempest-SecurityServicesNegativeTest-691864033-project-admin] PATH_INFO: `/v3/users/db0396a316ea4c5697d47df053fccbe4` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067256c9-a177-4a49-8ec2-2e4477c1954b tempest-SecurityServicesNegativeTest-691864033 tempest-SecurityServicesNegativeTest-691864033-project-admin] RBAC: Authorizing `identity:delete_user(user_id=db0396a316ea4c5697d47df053fccbe4)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067256c9-a177-4a49-8ec2-2e4477c1954b tempest-SecurityServicesNegativeTest-691864033 tempest-SecurityServicesNegativeTest-691864033-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-067256c9-a177-4a49-8ec2-2e4477c1954b tempest-SecurityServicesNegativeTest-691864033 tempest-SecurityServicesNegativeTest-691864033-project-admin] Could not find user: db0396a316ea4c5697d47df053fccbe4.: keystone.exception.UserNotFound: Could not find user: db0396a316ea4c5697d47df053fccbe4. May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: db0396a316ea4c5697d47df053fccbe4. May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1447/2865] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:00:33 2024] DELETE /identity/v3/users/db0396a316ea4c5697d47df053fccbe4 => generated 110 bytes in 23 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5389c4d4-a089-4260-8625-32f279349fb0 tempest-SecurityServicesNegativeTest-691864033 tempest-SecurityServicesNegativeTest-691864033-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:33 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-41955ae2-33c8-43bb-8d54-95a6c9ae3321 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Acquiring lock "locked_access_rules_operation_by_share_instance_5eddb781-43d4-4883-ae43-e9856f3a4c10" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:00:33 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-41955ae2-33c8-43bb-8d54-95a6c9ae3321 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Lock "locked_access_rules_operation_by_share_instance_5eddb781-43d4-4883-ae43-e9856f3a4c10" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5389c4d4-a089-4260-8625-32f279349fb0 tempest-SecurityServicesNegativeTest-691864033 tempest-SecurityServicesNegativeTest-691864033-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30366e98-4d03-4e07-badf-f2948903c7d5 tempest-SecurityServicesNegativeTest-691864033 tempest-SecurityServicesNegativeTest-691864033-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29ab7bfdd7ae43e0a7bbaa31f9a3ad5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff0c39307664dd8a995693c95b2fc9d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30366e98-4d03-4e07-badf-f2948903c7d5 tempest-SecurityServicesNegativeTest-691864033 tempest-SecurityServicesNegativeTest-691864033-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30366e98-4d03-4e07-badf-f2948903c7d5 tempest-SecurityServicesNegativeTest-691864033 tempest-SecurityServicesNegativeTest-691864033-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30366e98-4d03-4e07-badf-f2948903c7d5 tempest-SecurityServicesNegativeTest-691864033 tempest-SecurityServicesNegativeTest-691864033-project-admin] PATH_INFO: `/v3/users/8408bca6708d4e57b4e6ae91fa7eb8e3` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30366e98-4d03-4e07-badf-f2948903c7d5 tempest-SecurityServicesNegativeTest-691864033 tempest-SecurityServicesNegativeTest-691864033-project-admin] RBAC: Authorizing `identity:delete_user(user_id=8408bca6708d4e57b4e6ae91fa7eb8e3)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30366e98-4d03-4e07-badf-f2948903c7d5 tempest-SecurityServicesNegativeTest-691864033 tempest-SecurityServicesNegativeTest-691864033-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-30366e98-4d03-4e07-badf-f2948903c7d5 tempest-SecurityServicesNegativeTest-691864033 tempest-SecurityServicesNegativeTest-691864033-project-admin] Could not find user: 8408bca6708d4e57b4e6ae91fa7eb8e3.: keystone.exception.UserNotFound: Could not find user: 8408bca6708d4e57b4e6ae91fa7eb8e3. May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 8408bca6708d4e57b4e6ae91fa7eb8e3. May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1419/2866] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:00:33 2024] DELETE /identity/v3/users/8408bca6708d4e57b4e6ae91fa7eb8e3 => generated 110 bytes in 24 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067256c9-a177-4a49-8ec2-2e4477c1954b tempest-SecurityServicesNegativeTest-691864033 tempest-SecurityServicesNegativeTest-691864033-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067256c9-a177-4a49-8ec2-2e4477c1954b tempest-SecurityServicesNegativeTest-691864033 tempest-SecurityServicesNegativeTest-691864033-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23883404-c6b8-44aa-aca7-36d020c30ee9 tempest-SecurityServicesNegativeTest-691864033 tempest-SecurityServicesNegativeTest-691864033-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29ab7bfdd7ae43e0a7bbaa31f9a3ad5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff0c39307664dd8a995693c95b2fc9d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23883404-c6b8-44aa-aca7-36d020c30ee9 tempest-SecurityServicesNegativeTest-691864033 tempest-SecurityServicesNegativeTest-691864033-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23883404-c6b8-44aa-aca7-36d020c30ee9 tempest-SecurityServicesNegativeTest-691864033 tempest-SecurityServicesNegativeTest-691864033-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23883404-c6b8-44aa-aca7-36d020c30ee9 tempest-SecurityServicesNegativeTest-691864033 tempest-SecurityServicesNegativeTest-691864033-project-admin] PATH_INFO: `/v3/users/e593bd019bc24f30b8b269cbdd2e3494` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23883404-c6b8-44aa-aca7-36d020c30ee9 tempest-SecurityServicesNegativeTest-691864033 tempest-SecurityServicesNegativeTest-691864033-project-admin] RBAC: Authorizing `identity:delete_user(user_id=e593bd019bc24f30b8b269cbdd2e3494)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23883404-c6b8-44aa-aca7-36d020c30ee9 tempest-SecurityServicesNegativeTest-691864033 tempest-SecurityServicesNegativeTest-691864033-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:33 l75lg1-v1 dstat.sh[49771]: 28-05 13:00:33| 12 2 82 4 0|5688M 1762M 278M 7897M| 18k 15k| 0 8840k| 0 680 |9029 15k|1.71 1.20 1.06|2.0 1.0 0| 0 0 | 0 2048M| 29 363 0 43 2 May 28 13:00:33 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-41955ae2-33c8-43bb-8d54-95a6c9ae3321 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Lock "locked_access_rules_operation_by_share_instance_5eddb781-43d4-4883-ae43-e9856f3a4c10" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.056s {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:00:33 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-41955ae2-33c8-43bb-8d54-95a6c9ae3321 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/shares/f4283c2a-3835-416e-9703-f5745babbf5c/action returned with HTTP 200 May 28 13:00:33 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 910/1847] 10.27.203.238 () {66 vars in 1493 bytes} [Tue May 28 13:00:33 2024] POST /share/v2/a4f3887fa28c457390f5b66615564430/shares/f4283c2a-3835-416e-9703-f5745babbf5c/action => generated 230 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:00:33 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-5f8ec1a4-ac3a-4c3d-a8a1-e987abbacf06 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] POST http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/shares/f4283c2a-3835-416e-9703-f5745babbf5c/action May 28 13:00:33 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-5f8ec1a4-ac3a-4c3d-a8a1-e987abbacf06 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Action body: b'{"access_list": null}' {{(pid=98329) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 13:00:33 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-5f8ec1a4-ac3a-4c3d-a8a1-e987abbacf06 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Action: 'action', calling method: ShareController.access_list, body: {"access_list": null} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-23883404-c6b8-44aa-aca7-36d020c30ee9 tempest-SecurityServicesNegativeTest-691864033 tempest-SecurityServicesNegativeTest-691864033-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e593bd019bc24f30b8b269cbdd2e3494', 'request_id': 'req-23883404-c6b8-44aa-aca7-36d020c30ee9'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:33 l75lg1-v1 manila-share[98474]: DEBUG manila.share.manager [None req-41955ae2-33c8-43bb-8d54-95a6c9ae3321 tempest-ShareRulesTest-1530341375 None] Received request to update access for share instance 5eddb781-43d4-4883-ae43-e9856f3a4c10. {{(pid=98474) update_access_for_instances /opt/stack/manila/manila/share/manager.py:4353}} May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-23883404-c6b8-44aa-aca7-36d020c30ee9 tempest-SecurityServicesNegativeTest-691864033 tempest-SecurityServicesNegativeTest-691864033-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e593bd019bc24f30b8b269cbdd2e3494', 'request_id': 'req-23883404-c6b8-44aa-aca7-36d020c30ee9'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-23883404-c6b8-44aa-aca7-36d020c30ee9 tempest-SecurityServicesNegativeTest-691864033 tempest-SecurityServicesNegativeTest-691864033-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e593bd019bc24f30b8b269cbdd2e3494', 'request_id': 'req-23883404-c6b8-44aa-aca7-36d020c30ee9'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-23883404-c6b8-44aa-aca7-36d020c30ee9 tempest-SecurityServicesNegativeTest-691864033 tempest-SecurityServicesNegativeTest-691864033-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e593bd019bc24f30b8b269cbdd2e3494', 'request_id': 'req-23883404-c6b8-44aa-aca7-36d020c30ee9'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-23883404-c6b8-44aa-aca7-36d020c30ee9 tempest-SecurityServicesNegativeTest-691864033 tempest-SecurityServicesNegativeTest-691864033-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e593bd019bc24f30b8b269cbdd2e3494', 'request_id': 'req-23883404-c6b8-44aa-aca7-36d020c30ee9'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:33 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-5f8ec1a4-ac3a-4c3d-a8a1-e987abbacf06 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/shares/f4283c2a-3835-416e-9703-f5745babbf5c/action returned with HTTP 200 May 28 13:00:33 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 938/1848] 10.27.203.238 () {66 vars in 1493 bytes} [Tue May 28 13:00:33 2024] POST /share/v2/a4f3887fa28c457390f5b66615564430/shares/f4283c2a-3835-416e-9703-f5745babbf5c/action => generated 185 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:00:33 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-41955ae2-33c8-43bb-8d54-95a6c9ae3321 tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_5eddb781-43d4-4883-ae43-e9856f3a4c10" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:00:33 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-41955ae2-33c8-43bb-8d54-95a6c9ae3321 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_5eddb781-43d4-4883-ae43-e9856f3a4c10" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1448/2867] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:00:33 2024] DELETE /identity/v3/users/e593bd019bc24f30b8b269cbdd2e3494 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:00:33 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-41955ae2-33c8-43bb-8d54-95a6c9ae3321 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_5eddb781-43d4-4883-ae43-e9856f3a4c10" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.004s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:00:33 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-41955ae2-33c8-43bb-8d54-95a6c9ae3321 tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_5eddb781-43d4-4883-ae43-e9856f3a4c10" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:00:33 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-41955ae2-33c8-43bb-8d54-95a6c9ae3321 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_5eddb781-43d4-4883-ae43-e9856f3a4c10" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:00:33 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-e504975d-9150-4f96-bc5a-70441eb3a539 tempest-SecurityServicesNegativeTest-691864033 tempest-SecurityServicesNegativeTest-691864033-project-admin] DELETE http://10.27.203.238/share/v2/0ff0c39307664dd8a995693c95b2fc9d/types/0232ad18-ccdf-49f9-890f-8671aa292f75 May 28 13:00:33 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-e504975d-9150-4f96-bc5a-70441eb3a539 tempest-SecurityServicesNegativeTest-691864033 tempest-SecurityServicesNegativeTest-691864033-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:33 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-e504975d-9150-4f96-bc5a-70441eb3a539 tempest-SecurityServicesNegativeTest-691864033 tempest-SecurityServicesNegativeTest-691864033-project-admin] Calling method 'ShareTypesController._delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:33 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-e504975d-9150-4f96-bc5a-70441eb3a539 tempest-SecurityServicesNegativeTest-691864033 tempest-SecurityServicesNegativeTest-691864033-project-admin] http://10.27.203.238/share/v2/0ff0c39307664dd8a995693c95b2fc9d/types/0232ad18-ccdf-49f9-890f-8671aa292f75 returned with HTTP 202 May 28 13:00:33 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 911/1849] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:00:33 2024] DELETE /share/v2/0ff0c39307664dd8a995693c95b2fc9d/types/0232ad18-ccdf-49f9-890f-8671aa292f75 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 13:00:33 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-7c4fceb0-375c-4861-8cd8-955a7eb97cdb tempest-SecurityServicesNegativeTest-691864033 tempest-SecurityServicesNegativeTest-691864033-project-admin] GET http://10.27.203.238/share/v2/0ff0c39307664dd8a995693c95b2fc9d/types/0232ad18-ccdf-49f9-890f-8671aa292f75 May 28 13:00:33 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-7c4fceb0-375c-4861-8cd8-955a7eb97cdb tempest-SecurityServicesNegativeTest-691864033 tempest-SecurityServicesNegativeTest-691864033-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:33 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-7c4fceb0-375c-4861-8cd8-955a7eb97cdb tempest-SecurityServicesNegativeTest-691864033 tempest-SecurityServicesNegativeTest-691864033-project-admin] Calling method 'ShareTypesController.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:33 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-7c4fceb0-375c-4861-8cd8-955a7eb97cdb tempest-SecurityServicesNegativeTest-691864033 tempest-SecurityServicesNegativeTest-691864033-project-admin] HTTP exception thrown: Share type not found. May 28 13:00:33 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-7c4fceb0-375c-4861-8cd8-955a7eb97cdb tempest-SecurityServicesNegativeTest-691864033 tempest-SecurityServicesNegativeTest-691864033-project-admin] http://10.27.203.238/share/v2/0ff0c39307664dd8a995693c95b2fc9d/types/0232ad18-ccdf-49f9-890f-8671aa292f75 returned with HTTP 404 May 28 13:00:33 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 939/1850] 10.27.203.238 () {64 vars in 1448 bytes} [Tue May 28 13:00:33 2024] GET /share/v2/0ff0c39307664dd8a995693c95b2fc9d/types/0232ad18-ccdf-49f9-890f-8671aa292f75 => generated 67 bytes in 10 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30366e98-4d03-4e07-badf-f2948903c7d5 tempest-SecurityServicesNegativeTest-691864033 tempest-SecurityServicesNegativeTest-691864033-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-30366e98-4d03-4e07-badf-f2948903c7d5 tempest-SecurityServicesNegativeTest-691864033 tempest-SecurityServicesNegativeTest-691864033-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:00:33 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-41955ae2-33c8-43bb-8d54-95a6c9ae3321 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_5eddb781-43d4-4883-ae43-e9856f3a4c10" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.055s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:00:33 l75lg1-v1 manila-share[98474]: DEBUG manila.share.access [None req-41955ae2-33c8-43bb-8d54-95a6c9ae3321 tempest-ShareRulesTest-1530341375 None] Updating access rules for share instance 5eddb781-43d4-4883-ae43-e9856f3a4c10 belonging to share f4283c2a-3835-416e-9703-f5745babbf5c. {{(pid=98474) update_access_rules /opt/stack/manila/manila/share/access.py:298}} May 28 13:00:33 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-41955ae2-33c8-43bb-8d54-95a6c9ae3321 tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_5eddb781-43d4-4883-ae43-e9856f3a4c10" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:00:33 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-41955ae2-33c8-43bb-8d54-95a6c9ae3321 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_5eddb781-43d4-4883-ae43-e9856f3a4c10" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30366e98-4d03-4e07-badf-f2948903c7d5 tempest-SecurityServicesNegativeTest-691864033 tempest-SecurityServicesNegativeTest-691864033-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:33 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-41955ae2-33c8-43bb-8d54-95a6c9ae3321 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_5eddb781-43d4-4883-ae43-e9856f3a4c10" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.007s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:00:33 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-41955ae2-33c8-43bb-8d54-95a6c9ae3321 tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_5eddb781-43d4-4883-ae43-e9856f3a4c10" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:00:33 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-41955ae2-33c8-43bb-8d54-95a6c9ae3321 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_5eddb781-43d4-4883-ae43-e9856f3a4c10" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:00:33 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-41955ae2-33c8-43bb-8d54-95a6c9ae3321 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_5eddb781-43d4-4883-ae43-e9856f3a4c10" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.014s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:00:33 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-41955ae2-33c8-43bb-8d54-95a6c9ae3321 tempest-ShareRulesTest-1530341375 None] changing access on None May 28 13:00:33 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-41955ae2-33c8-43bb-8d54-95a6c9ae3321 tempest-ShareRulesTest-1530341375 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:00:33 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-41955ae2-33c8-43bb-8d54-95a6c9ae3321 tempest-ShareRulesTest-1530341375 None] {'allow_redirects': True, May 28 13:00:33 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-41955ae2-33c8-43bb-8d54-95a6c9ae3321 tempest-ShareRulesTest-1530341375 None] 'params': {'name': '5eddb781-43d4-4883-ae43-e9856f3a4c10'}} May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679692b3-4b1e-4959-8844-b1a6658a6ada None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679692b3-4b1e-4959-8844-b1a6658a6ada None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679692b3-4b1e-4959-8844-b1a6658a6ada None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679692b3-4b1e-4959-8844-b1a6658a6ada None admin] PATH_INFO: `/v3/users/4941407a10fe456dba68792c9db13acf` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679692b3-4b1e-4959-8844-b1a6658a6ada None admin] RBAC: Authorizing `identity:delete_user(user_id=4941407a10fe456dba68792c9db13acf)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679692b3-4b1e-4959-8844-b1a6658a6ada None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-679692b3-4b1e-4959-8844-b1a6658a6ada None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4941407a10fe456dba68792c9db13acf', 'request_id': 'req-679692b3-4b1e-4959-8844-b1a6658a6ada'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-679692b3-4b1e-4959-8844-b1a6658a6ada None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4941407a10fe456dba68792c9db13acf', 'request_id': 'req-679692b3-4b1e-4959-8844-b1a6658a6ada'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-679692b3-4b1e-4959-8844-b1a6658a6ada None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4941407a10fe456dba68792c9db13acf', 'request_id': 'req-679692b3-4b1e-4959-8844-b1a6658a6ada'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-679692b3-4b1e-4959-8844-b1a6658a6ada None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4941407a10fe456dba68792c9db13acf', 'request_id': 'req-679692b3-4b1e-4959-8844-b1a6658a6ada'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-679692b3-4b1e-4959-8844-b1a6658a6ada None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4941407a10fe456dba68792c9db13acf', 'request_id': 'req-679692b3-4b1e-4959-8844-b1a6658a6ada'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1420/2868] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 13:00:33 2024] DELETE /identity/v3/users/4941407a10fe456dba68792c9db13acf => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23883404-c6b8-44aa-aca7-36d020c30ee9 tempest-SecurityServicesNegativeTest-691864033 tempest-SecurityServicesNegativeTest-691864033-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23883404-c6b8-44aa-aca7-36d020c30ee9 tempest-SecurityServicesNegativeTest-691864033 tempest-SecurityServicesNegativeTest-691864033-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c1fd40-c704-4f19-b06c-c6594b2583ba None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c1fd40-c704-4f19-b06c-c6594b2583ba None admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c1fd40-c704-4f19-b06c-c6594b2583ba None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c1fd40-c704-4f19-b06c-c6594b2583ba None admin] PATH_INFO: `/v3/users/e86236f2863547b99b41c162048f8f0f` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c1fd40-c704-4f19-b06c-c6594b2583ba None admin] RBAC: Authorizing `identity:delete_user(user_id=e86236f2863547b99b41c162048f8f0f)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c1fd40-c704-4f19-b06c-c6594b2583ba None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-44c1fd40-c704-4f19-b06c-c6594b2583ba None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e86236f2863547b99b41c162048f8f0f', 'request_id': 'req-44c1fd40-c704-4f19-b06c-c6594b2583ba'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-44c1fd40-c704-4f19-b06c-c6594b2583ba None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e86236f2863547b99b41c162048f8f0f', 'request_id': 'req-44c1fd40-c704-4f19-b06c-c6594b2583ba'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-44c1fd40-c704-4f19-b06c-c6594b2583ba None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e86236f2863547b99b41c162048f8f0f', 'request_id': 'req-44c1fd40-c704-4f19-b06c-c6594b2583ba'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-44c1fd40-c704-4f19-b06c-c6594b2583ba None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e86236f2863547b99b41c162048f8f0f', 'request_id': 'req-44c1fd40-c704-4f19-b06c-c6594b2583ba'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-44c1fd40-c704-4f19-b06c-c6594b2583ba None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e86236f2863547b99b41c162048f8f0f', 'request_id': 'req-44c1fd40-c704-4f19-b06c-c6594b2583ba'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1449/2869] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 13:00:33 2024] DELETE /identity/v3/users/e86236f2863547b99b41c162048f8f0f => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679692b3-4b1e-4959-8844-b1a6658a6ada None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-679692b3-4b1e-4959-8844-b1a6658a6ada None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679692b3-4b1e-4959-8844-b1a6658a6ada None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc986dfb-9ac8-48f4-841f-3bee7a235fbf None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc986dfb-9ac8-48f4-841f-3bee7a235fbf None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc986dfb-9ac8-48f4-841f-3bee7a235fbf None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc986dfb-9ac8-48f4-841f-3bee7a235fbf None admin] PATH_INFO: `/v3/users/29ab7bfdd7ae43e0a7bbaa31f9a3ad5f` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc986dfb-9ac8-48f4-841f-3bee7a235fbf None admin] RBAC: Authorizing `identity:delete_user(user_id=29ab7bfdd7ae43e0a7bbaa31f9a3ad5f)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc986dfb-9ac8-48f4-841f-3bee7a235fbf None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-dc986dfb-9ac8-48f4-841f-3bee7a235fbf None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29ab7bfdd7ae43e0a7bbaa31f9a3ad5f', 'request_id': 'req-dc986dfb-9ac8-48f4-841f-3bee7a235fbf'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-dc986dfb-9ac8-48f4-841f-3bee7a235fbf None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29ab7bfdd7ae43e0a7bbaa31f9a3ad5f', 'request_id': 'req-dc986dfb-9ac8-48f4-841f-3bee7a235fbf'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-dc986dfb-9ac8-48f4-841f-3bee7a235fbf None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29ab7bfdd7ae43e0a7bbaa31f9a3ad5f', 'request_id': 'req-dc986dfb-9ac8-48f4-841f-3bee7a235fbf'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-dc986dfb-9ac8-48f4-841f-3bee7a235fbf None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29ab7bfdd7ae43e0a7bbaa31f9a3ad5f', 'request_id': 'req-dc986dfb-9ac8-48f4-841f-3bee7a235fbf'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-dc986dfb-9ac8-48f4-841f-3bee7a235fbf None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29ab7bfdd7ae43e0a7bbaa31f9a3ad5f', 'request_id': 'req-dc986dfb-9ac8-48f4-841f-3bee7a235fbf'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1421/2870] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 13:00:33 2024] DELETE /identity/v3/users/29ab7bfdd7ae43e0a7bbaa31f9a3ad5f => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e6bc74-8c2a-42a3-808a-e5619f2bdfaf None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e6bc74-8c2a-42a3-808a-e5619f2bdfaf None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e6bc74-8c2a-42a3-808a-e5619f2bdfaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-01e6bc74-8c2a-42a3-808a-e5619f2bdfaf None None] Truncating password to algorithm specific maximum length 72 characters. May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-01e6bc74-8c2a-42a3-808a-e5619f2bdfaf None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-01e6bc74-8c2a-42a3-808a-e5619f2bdfaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1450/2871] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 13:00:33 2024] POST /identity/v3/auth/tokens => generated 2960 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 13:00:33 l75lg1-v1 neutron-server[77618]: DEBUG neutron.wsgi [-] (77618) accepted ('10.27.203.238', 36338) {{(pid=77618) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc986dfb-9ac8-48f4-841f-3bee7a235fbf None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-dc986dfb-9ac8-48f4-841f-3bee7a235fbf None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc986dfb-9ac8-48f4-841f-3bee7a235fbf None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a33113d-edbd-445a-b227-000c306ab022 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef17047035e4b518fd5360a01f2da1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a33113d-edbd-445a-b227-000c306ab022 service neutron] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a33113d-edbd-445a-b227-000c306ab022 service neutron] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a33113d-edbd-445a-b227-000c306ab022 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a33113d-edbd-445a-b227-000c306ab022 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a33113d-edbd-445a-b227-000c306ab022 service neutron] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1422/2872] 10.27.203.238 () {64 vars in 1432 bytes} [Tue May 28 13:00:33 2024] GET /identity/v3/auth/tokens => generated 2960 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 28 13:00:33 l75lg1-v1 neutron-server[77618]: INFO neutron.wsgi [None req-1ed4b944-342c-4cbe-888f-bd6cc0e48f6d None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=d9902b1c25914651b9a3e2f4a7240931&name=default HTTP/1.1" status: 200 len: 216 time: 0.0718269 May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e6bc74-8c2a-42a3-808a-e5619f2bdfaf None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-01e6bc74-8c2a-42a3-808a-e5619f2bdfaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e6bc74-8c2a-42a3-808a-e5619f2bdfaf None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35d0428-33c8-478c-9705-2921886a178c None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35d0428-33c8-478c-9705-2921886a178c None admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35d0428-33c8-478c-9705-2921886a178c None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35d0428-33c8-478c-9705-2921886a178c None admin] PATH_INFO: `/v3/projects/d9902b1c25914651b9a3e2f4a7240931` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35d0428-33c8-478c-9705-2921886a178c None admin] RBAC: Authorizing `identity:delete_project(project_id=d9902b1c25914651b9a3e2f4a7240931)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35d0428-33c8-478c-9705-2921886a178c None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-c35d0428-33c8-478c-9705-2921886a178c None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9902b1c25914651b9a3e2f4a7240931', 'request_id': 'req-c35d0428-33c8-478c-9705-2921886a178c'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-c35d0428-33c8-478c-9705-2921886a178c None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9902b1c25914651b9a3e2f4a7240931', 'request_id': 'req-c35d0428-33c8-478c-9705-2921886a178c'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:34 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-41955ae2-33c8-43bb-8d54-95a6c9ae3321 tempest-ShareRulesTest-1530341375 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:00:34 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-41955ae2-33c8-43bb-8d54-95a6c9ae3321 tempest-ShareRulesTest-1530341375 None] [Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=1, created='2024-05-28T13:00:28.342982Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='ab44815a-6cee-4df3-a9a3-333372151587', id=44, internal=False, is_s3_default_policy=False, name='5eddb781-43d4-4883-ae43-e9856f3a4c10', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=[], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['*'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['*'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T13:00:28.675597Z', tenant_id=1, tenant_name='default', title='5eddb781-43d4-4883-ae43-e9856f3a4c10', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/44/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[])] May 28 13:00:34 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-41955ae2-33c8-43bb-8d54-95a6c9ae3321 tempest-ShareRulesTest-1530341375 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 13:00:34 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-41955ae2-33c8-43bb-8d54-95a6c9ae3321 tempest-ShareRulesTest-1530341375 None] changing access on /manila/manila-5eddb781-43d4-4883-ae43-e9856f3a4c10. Rules: {'nfs_read_write': ['203.0.113.77'], 'nfs_read_only': []} May 28 13:00:34 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-41955ae2-33c8-43bb-8d54-95a6c9ae3321 tempest-ShareRulesTest-1530341375 None] >>> [PATCH] https://127.0.0.1:40443/api/viewpolicies/44/ May 28 13:00:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-c35d0428-33c8-478c-9705-2921886a178c None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9902b1c25914651b9a3e2f4a7240931', 'request_id': 'req-c35d0428-33c8-478c-9705-2921886a178c'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:34 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-41955ae2-33c8-43bb-8d54-95a6c9ae3321 tempest-ShareRulesTest-1530341375 None] {'data': '{"name": "5eddb781-43d4-4883-ae43-e9856f3a4c10", "nfs_no_squash": ' May 28 13:00:34 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-41955ae2-33c8-43bb-8d54-95a6c9ae3321 tempest-ShareRulesTest-1530341375 None] '["*"], "nfs_root_squash": ["*"], "nfs_read_write": ["203.0.113.77"], ' May 28 13:00:34 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-41955ae2-33c8-43bb-8d54-95a6c9ae3321 tempest-ShareRulesTest-1530341375 None] '"nfs_read_only": []}', May 28 13:00:34 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-41955ae2-33c8-43bb-8d54-95a6c9ae3321 tempest-ShareRulesTest-1530341375 None] 'params': None} May 28 13:00:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-c35d0428-33c8-478c-9705-2921886a178c None admin] The token cache is being invalidate because project d9902b1c25914651b9a3e2f4a7240931 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 13:00:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-c35d0428-33c8-478c-9705-2921886a178c None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-c35d0428-33c8-478c-9705-2921886a178c None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:34 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1451/2873] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 13:00:33 2024] DELETE /identity/v3/projects/d9902b1c25914651b9a3e2f4a7240931 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:00:34 l75lg1-v1 neutron-server[77619]: DEBUG neutron.wsgi [-] (77619) accepted ('10.27.203.238', 36344) {{(pid=77619) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 13:00:34 l75lg1-v1 neutron-server[77619]: INFO neutron.wsgi [None req-cfe1481b-cf69-4ca0-80f0-6a1e1190e5d9 None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=fbb20f2175704a80968d536160c6c6fa&name=default HTTP/1.1" status: 200 len: 216 time: 0.0084124 May 28 13:00:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a33113d-edbd-445a-b227-000c306ab022 service neutron] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a33113d-edbd-445a-b227-000c306ab022 service neutron] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa7810d-d974-4175-b24f-abee8164ea09 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa7810d-d974-4175-b24f-abee8164ea09 None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa7810d-d974-4175-b24f-abee8164ea09 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa7810d-d974-4175-b24f-abee8164ea09 None admin] PATH_INFO: `/v3/projects/fbb20f2175704a80968d536160c6c6fa` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa7810d-d974-4175-b24f-abee8164ea09 None admin] RBAC: Authorizing `identity:delete_project(project_id=fbb20f2175704a80968d536160c6c6fa)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa7810d-d974-4175-b24f-abee8164ea09 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-9aa7810d-d974-4175-b24f-abee8164ea09 None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fbb20f2175704a80968d536160c6c6fa', 'request_id': 'req-9aa7810d-d974-4175-b24f-abee8164ea09'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-9aa7810d-d974-4175-b24f-abee8164ea09 None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fbb20f2175704a80968d536160c6c6fa', 'request_id': 'req-9aa7810d-d974-4175-b24f-abee8164ea09'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-9aa7810d-d974-4175-b24f-abee8164ea09 None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fbb20f2175704a80968d536160c6c6fa', 'request_id': 'req-9aa7810d-d974-4175-b24f-abee8164ea09'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-9aa7810d-d974-4175-b24f-abee8164ea09 None admin] The token cache is being invalidate because project fbb20f2175704a80968d536160c6c6fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 13:00:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-9aa7810d-d974-4175-b24f-abee8164ea09 None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-9aa7810d-d974-4175-b24f-abee8164ea09 None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:34 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1423/2874] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 13:00:34 2024] DELETE /identity/v3/projects/fbb20f2175704a80968d536160c6c6fa => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:00:34 l75lg1-v1 neutron-server[77619]: DEBUG neutron.wsgi [-] (77619) accepted ('10.27.203.238', 36348) {{(pid=77619) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 13:00:34 l75lg1-v1 neutron-server[77619]: INFO neutron.wsgi [None req-da79e72d-bc6a-4f6b-9aff-783e665a2a01 None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=0ff0c39307664dd8a995693c95b2fc9d&name=default HTTP/1.1" status: 200 len: 216 time: 0.0083234 May 28 13:00:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35d0428-33c8-478c-9705-2921886a178c None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-c35d0428-33c8-478c-9705-2921886a178c None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:00:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35d0428-33c8-478c-9705-2921886a178c None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d4e19b-7318-41d3-beae-47d4f63daee2 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d4e19b-7318-41d3-beae-47d4f63daee2 None admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d4e19b-7318-41d3-beae-47d4f63daee2 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d4e19b-7318-41d3-beae-47d4f63daee2 None admin] PATH_INFO: `/v3/projects/0ff0c39307664dd8a995693c95b2fc9d` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d4e19b-7318-41d3-beae-47d4f63daee2 None admin] RBAC: Authorizing `identity:delete_project(project_id=0ff0c39307664dd8a995693c95b2fc9d)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d4e19b-7318-41d3-beae-47d4f63daee2 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-87d4e19b-7318-41d3-beae-47d4f63daee2 None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ff0c39307664dd8a995693c95b2fc9d', 'request_id': 'req-87d4e19b-7318-41d3-beae-47d4f63daee2'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-87d4e19b-7318-41d3-beae-47d4f63daee2 None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ff0c39307664dd8a995693c95b2fc9d', 'request_id': 'req-87d4e19b-7318-41d3-beae-47d4f63daee2'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-87d4e19b-7318-41d3-beae-47d4f63daee2 None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ff0c39307664dd8a995693c95b2fc9d', 'request_id': 'req-87d4e19b-7318-41d3-beae-47d4f63daee2'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:34 l75lg1-v1 dstat.sh[49771]: 28-05 13:00:34| 11 1 84 3 0|5688M 1761M 278M 7898M| 15k 1840B| 0 10M| 0 994 |8197 14k|1.71 1.20 1.06|1.0 2.0 0| 0 0 | 0 2048M| 29 362 0 46 2 May 28 13:00:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-87d4e19b-7318-41d3-beae-47d4f63daee2 None admin] The token cache is being invalidate because project 0ff0c39307664dd8a995693c95b2fc9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 13:00:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-87d4e19b-7318-41d3-beae-47d4f63daee2 None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-87d4e19b-7318-41d3-beae-47d4f63daee2 None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:34 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1452/2875] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 13:00:34 2024] DELETE /identity/v3/projects/0ff0c39307664dd8a995693c95b2fc9d => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:00:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36e4d90-b2c5-4799-902d-7f6868c9c1e8 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36e4d90-b2c5-4799-902d-7f6868c9c1e8 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36e4d90-b2c5-4799-902d-7f6868c9c1e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:34 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-d36e4d90-b2c5-4799-902d-7f6868c9c1e8 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 13:00:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-d36e4d90-b2c5-4799-902d-7f6868c9c1e8 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 13:00:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-d36e4d90-b2c5-4799-902d-7f6868c9c1e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:00:34 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1424/2876] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 13:00:34 2024] POST /identity/v3/auth/tokens => generated 312 bytes in 20 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 28 13:00:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef60f1a5-9831-4d6e-9446-5733ed502005 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef60f1a5-9831-4d6e-9446-5733ed502005 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef60f1a5-9831-4d6e-9446-5733ed502005 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:34 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-ef60f1a5-9831-4d6e-9446-5733ed502005 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 13:00:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-ef60f1a5-9831-4d6e-9446-5733ed502005 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 13:00:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-ef60f1a5-9831-4d6e-9446-5733ed502005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:00:34 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1453/2877] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 13:00:34 2024] POST /identity/v3/auth/tokens => generated 2960 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 13:00:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36e4d90-b2c5-4799-902d-7f6868c9c1e8 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36e4d90-b2c5-4799-902d-7f6868c9c1e8 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0189785-15a0-4f01-8061-c08c31e5aa6a None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0189785-15a0-4f01-8061-c08c31e5aa6a None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0189785-15a0-4f01-8061-c08c31e5aa6a None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0189785-15a0-4f01-8061-c08c31e5aa6a None admin] PATH_INFO: `/v3/domains` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0189785-15a0-4f01-8061-c08c31e5aa6a None admin] RBAC: Adding query filter params (name=Default) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 13:00:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0189785-15a0-4f01-8061-c08c31e5aa6a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0189785-15a0-4f01-8061-c08c31e5aa6a None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:34 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1425/2878] 10.27.203.238 () {62 vars in 1220 bytes} [Tue May 28 13:00:34 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 13:00:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef60f1a5-9831-4d6e-9446-5733ed502005 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef60f1a5-9831-4d6e-9446-5733ed502005 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273d6d21-0847-4763-a4cd-66ba05a71bd4 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273d6d21-0847-4763-a4cd-66ba05a71bd4 None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273d6d21-0847-4763-a4cd-66ba05a71bd4 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273d6d21-0847-4763-a4cd-66ba05a71bd4 None admin] PATH_INFO: `/v3/projects` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273d6d21-0847-4763-a4cd-66ba05a71bd4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273d6d21-0847-4763-a4cd-66ba05a71bd4 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:34 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1454/2879] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 13:00:34 2024] POST /identity/v3/projects => generated 397 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 13:00:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0189785-15a0-4f01-8061-c08c31e5aa6a None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0189785-15a0-4f01-8061-c08c31e5aa6a None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375ca539-4485-48fb-8c3c-21b886241c31 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375ca539-4485-48fb-8c3c-21b886241c31 None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375ca539-4485-48fb-8c3c-21b886241c31 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375ca539-4485-48fb-8c3c-21b886241c31 None admin] PATH_INFO: `/v3/users` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375ca539-4485-48fb-8c3c-21b886241c31 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375ca539-4485-48fb-8c3c-21b886241c31 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:34 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-375ca539-4485-48fb-8c3c-21b886241c31 None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 13:00:34 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1426/2880] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 13:00:34 2024] POST /identity/v3/users => generated 307 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 13:00:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273d6d21-0847-4763-a4cd-66ba05a71bd4 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273d6d21-0847-4763-a4cd-66ba05a71bd4 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab127ffc-8672-451b-85b6-f23f8ea385ef None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab127ffc-8672-451b-85b6-f23f8ea385ef None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab127ffc-8672-451b-85b6-f23f8ea385ef None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab127ffc-8672-451b-85b6-f23f8ea385ef None admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab127ffc-8672-451b-85b6-f23f8ea385ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab127ffc-8672-451b-85b6-f23f8ea385ef None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:34 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1455/2881] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 13:00:34 2024] GET /identity/v3/roles => generated 1680 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 13:00:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375ca539-4485-48fb-8c3c-21b886241c31 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375ca539-4485-48fb-8c3c-21b886241c31 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d14fe6-53d0-4b53-84c1-53b427623b1e None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d14fe6-53d0-4b53-84c1-53b427623b1e None admin] REQUEST_METHOD: `PUT` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d14fe6-53d0-4b53-84c1-53b427623b1e None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d14fe6-53d0-4b53-84c1-53b427623b1e None admin] PATH_INFO: `/v3/projects/284d76edec3144579d6fb3f6dbc0dd4e/users/0dd83bef5ade4133b0c60f813dd626cb/roles/44620cad10ae407c90c91e2c296adb04` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d14fe6-53d0-4b53-84c1-53b427623b1e None admin] RBAC: Authorizing `identity:create_grant(project_id=284d76edec3144579d6fb3f6dbc0dd4e, user_id=0dd83bef5ade4133b0c60f813dd626cb, role_id=44620cad10ae407c90c91e2c296adb04)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d14fe6-53d0-4b53-84c1-53b427623b1e None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:34 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8b4f0fd1-edd5-4fef-976a-4a87ae5862d3 tempest-ShareTransferNegativeTest-884271560 None] <<< [DELETE] https://127.0.0.1:40443/api/views/41/ May 28 13:00:34 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8b4f0fd1-edd5-4fef-976a-4a87ae5862d3 tempest-ShareTransferNegativeTest-884271560 None] --- [DELETE] https://127.0.0.1:40443/api/views/41/: Done May 28 13:00:34 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8b4f0fd1-edd5-4fef-976a-4a87ae5862d3 tempest-ShareTransferNegativeTest-884271560 None] >>> [GET] https://127.0.0.1:40443/api/quotas/ May 28 13:00:34 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8b4f0fd1-edd5-4fef-976a-4a87ae5862d3 tempest-ShareTransferNegativeTest-884271560 None] {'allow_redirects': True, May 28 13:00:34 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8b4f0fd1-edd5-4fef-976a-4a87ae5862d3 tempest-ShareTransferNegativeTest-884271560 None] 'params': {'name': 'f8e9c921-56e5-4b4a-a619-44221b8150a3'}} May 28 13:00:34 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1427/2882] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 13:00:34 2024] PUT /identity/v3/projects/284d76edec3144579d6fb3f6dbc0dd4e/users/0dd83bef5ade4133b0c60f813dd626cb/roles/44620cad10ae407c90c91e2c296adb04 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:00:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca26624-bf80-4687-9c56-4076524ebc14 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca26624-bf80-4687-9c56-4076524ebc14 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca26624-bf80-4687-9c56-4076524ebc14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:34 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-7ca26624-bf80-4687-9c56-4076524ebc14 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 13:00:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-7ca26624-bf80-4687-9c56-4076524ebc14 None None] MFA Rules not processed for user `0dd83bef5ade4133b0c60f813dd626cb`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 13:00:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-7ca26624-bf80-4687-9c56-4076524ebc14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:00:34 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1456/2883] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 13:00:34 2024] POST /identity/v3/auth/tokens => generated 3968 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 13:00:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d14fe6-53d0-4b53-84c1-53b427623b1e None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d14fe6-53d0-4b53-84c1-53b427623b1e None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d50865-cd36-4243-99a2-6f4886382d2a None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d50865-cd36-4243-99a2-6f4886382d2a None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d50865-cd36-4243-99a2-6f4886382d2a None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d50865-cd36-4243-99a2-6f4886382d2a None admin] PATH_INFO: `/v3/projects` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d50865-cd36-4243-99a2-6f4886382d2a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d50865-cd36-4243-99a2-6f4886382d2a None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:34 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1428/2884] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 13:00:34 2024] POST /identity/v3/projects => generated 399 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 13:00:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca26624-bf80-4687-9c56-4076524ebc14 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca26624-bf80-4687-9c56-4076524ebc14 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e64060-80b6-48f3-990e-5999a2065730 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e64060-80b6-48f3-990e-5999a2065730 None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e64060-80b6-48f3-990e-5999a2065730 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e64060-80b6-48f3-990e-5999a2065730 None admin] PATH_INFO: `/v3/users` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e64060-80b6-48f3-990e-5999a2065730 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e64060-80b6-48f3-990e-5999a2065730 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:34 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-39e64060-80b6-48f3-990e-5999a2065730 None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 13:00:34 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-fcb5e764-b600-4011-bed9-e4ca53666b09 tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] GET http://10.27.203.238/share/v2/cac556dc39a14bbdbdbabfc80672fb1f/shares/03abb6c7-1707-45b3-a692-3b1de0dd1fba May 28 13:00:34 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-fcb5e764-b600-4011-bed9-e4ca53666b09 tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:34 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-fcb5e764-b600-4011-bed9-e4ca53666b09 tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:34 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1457/2885] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 13:00:34 2024] POST /identity/v3/users => generated 308 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 13:00:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d50865-cd36-4243-99a2-6f4886382d2a None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d50865-cd36-4243-99a2-6f4886382d2a None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1224e4f-9617-472b-9ac2-c9081144bbe7 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1224e4f-9617-472b-9ac2-c9081144bbe7 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1224e4f-9617-472b-9ac2-c9081144bbe7 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1224e4f-9617-472b-9ac2-c9081144bbe7 None admin] PATH_INFO: `/v3/roles` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1224e4f-9617-472b-9ac2-c9081144bbe7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1224e4f-9617-472b-9ac2-c9081144bbe7 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:34 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1429/2886] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 13:00:34 2024] GET /identity/v3/roles => generated 1680 bytes in 17 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 13:00:34 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-fcb5e764-b600-4011-bed9-e4ca53666b09 tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] http://10.27.203.238/share/v2/cac556dc39a14bbdbdbabfc80672fb1f/shares/03abb6c7-1707-45b3-a692-3b1de0dd1fba returned with HTTP 200 May 28 13:00:34 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 912/1851] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:00:34 2024] GET /share/v2/cac556dc39a14bbdbdbabfc80672fb1f/shares/03abb6c7-1707-45b3-a692-3b1de0dd1fba => generated 1315 bytes in 28 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:00:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e64060-80b6-48f3-990e-5999a2065730 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e64060-80b6-48f3-990e-5999a2065730 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29188722-a91c-4f19-81a8-385ba9ab1b43 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29188722-a91c-4f19-81a8-385ba9ab1b43 None admin] REQUEST_METHOD: `PUT` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29188722-a91c-4f19-81a8-385ba9ab1b43 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29188722-a91c-4f19-81a8-385ba9ab1b43 None admin] PATH_INFO: `/v3/projects/7631375e6ec649fc94b5cca62d03ea51/users/4aa0df52df4847d09e8d886a65400804/roles/44620cad10ae407c90c91e2c296adb04` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29188722-a91c-4f19-81a8-385ba9ab1b43 None admin] RBAC: Authorizing `identity:create_grant(project_id=7631375e6ec649fc94b5cca62d03ea51, user_id=4aa0df52df4847d09e8d886a65400804, role_id=44620cad10ae407c90c91e2c296adb04)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29188722-a91c-4f19-81a8-385ba9ab1b43 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:34 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1458/2887] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 13:00:34 2024] PUT /identity/v3/projects/7631375e6ec649fc94b5cca62d03ea51/users/4aa0df52df4847d09e8d886a65400804/roles/44620cad10ae407c90c91e2c296adb04 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:00:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469d2708-4f79-4840-a11e-16c00aeeab41 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469d2708-4f79-4840-a11e-16c00aeeab41 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469d2708-4f79-4840-a11e-16c00aeeab41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:34 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-469d2708-4f79-4840-a11e-16c00aeeab41 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 13:00:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-469d2708-4f79-4840-a11e-16c00aeeab41 None None] MFA Rules not processed for user `4aa0df52df4847d09e8d886a65400804`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 13:00:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-469d2708-4f79-4840-a11e-16c00aeeab41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:00:34 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1430/2888] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 13:00:34 2024] POST /identity/v3/auth/tokens => generated 3970 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 13:00:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29188722-a91c-4f19-81a8-385ba9ab1b43 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29188722-a91c-4f19-81a8-385ba9ab1b43 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192eaf51-8592-4ac9-8dd6-9401ba263800 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192eaf51-8592-4ac9-8dd6-9401ba263800 None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192eaf51-8592-4ac9-8dd6-9401ba263800 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192eaf51-8592-4ac9-8dd6-9401ba263800 None admin] PATH_INFO: `/v3/projects` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192eaf51-8592-4ac9-8dd6-9401ba263800 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192eaf51-8592-4ac9-8dd6-9401ba263800 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:35 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1459/2889] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 13:00:34 2024] POST /identity/v3/projects => generated 399 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 13:00:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469d2708-4f79-4840-a11e-16c00aeeab41 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469d2708-4f79-4840-a11e-16c00aeeab41 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d605481-ca97-4f58-90cd-2fde77ec5b20 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d605481-ca97-4f58-90cd-2fde77ec5b20 None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d605481-ca97-4f58-90cd-2fde77ec5b20 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d605481-ca97-4f58-90cd-2fde77ec5b20 None admin] PATH_INFO: `/v3/users` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d605481-ca97-4f58-90cd-2fde77ec5b20 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d605481-ca97-4f58-90cd-2fde77ec5b20 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:35 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-5d605481-ca97-4f58-90cd-2fde77ec5b20 None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 13:00:35 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1431/2890] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 13:00:35 2024] POST /identity/v3/users => generated 307 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 13:00:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192eaf51-8592-4ac9-8dd6-9401ba263800 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192eaf51-8592-4ac9-8dd6-9401ba263800 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de01f3a-662d-4f2f-ac35-df99533e8ac6 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de01f3a-662d-4f2f-ac35-df99533e8ac6 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de01f3a-662d-4f2f-ac35-df99533e8ac6 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de01f3a-662d-4f2f-ac35-df99533e8ac6 None admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de01f3a-662d-4f2f-ac35-df99533e8ac6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de01f3a-662d-4f2f-ac35-df99533e8ac6 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:35 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1460/2891] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 13:00:35 2024] GET /identity/v3/roles => generated 1680 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 13:00:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d605481-ca97-4f58-90cd-2fde77ec5b20 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d605481-ca97-4f58-90cd-2fde77ec5b20 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d89d64-9cd2-4e96-8f5b-d745764f4759 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d89d64-9cd2-4e96-8f5b-d745764f4759 None admin] REQUEST_METHOD: `PUT` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d89d64-9cd2-4e96-8f5b-d745764f4759 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d89d64-9cd2-4e96-8f5b-d745764f4759 None admin] PATH_INFO: `/v3/projects/bb20757ddd604868aff8ad38db5def87/users/56313694cffb4df8b0b20f48edb02368/roles/e7989893488f483baa107be56668c4f8` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d89d64-9cd2-4e96-8f5b-d745764f4759 None admin] RBAC: Authorizing `identity:create_grant(project_id=bb20757ddd604868aff8ad38db5def87, user_id=56313694cffb4df8b0b20f48edb02368, role_id=e7989893488f483baa107be56668c4f8)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d89d64-9cd2-4e96-8f5b-d745764f4759 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:35 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1432/2892] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 13:00:35 2024] PUT /identity/v3/projects/bb20757ddd604868aff8ad38db5def87/users/56313694cffb4df8b0b20f48edb02368/roles/e7989893488f483baa107be56668c4f8 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:00:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de01f3a-662d-4f2f-ac35-df99533e8ac6 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de01f3a-662d-4f2f-ac35-df99533e8ac6 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6973489-5be1-45e4-97ec-946dae0d9169 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6973489-5be1-45e4-97ec-946dae0d9169 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6973489-5be1-45e4-97ec-946dae0d9169 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6973489-5be1-45e4-97ec-946dae0d9169 None admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6973489-5be1-45e4-97ec-946dae0d9169 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6973489-5be1-45e4-97ec-946dae0d9169 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:35 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8b4f0fd1-edd5-4fef-976a-4a87ae5862d3 tempest-ShareTransferNegativeTest-884271560 None] <<< [GET] https://127.0.0.1:40443/api/quotas/ May 28 13:00:35 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8b4f0fd1-edd5-4fef-976a-4a87ae5862d3 tempest-ShareTransferNegativeTest-884271560 None] [Bunch(cluster='loop75-kfs', cluster_id=1, default_email=None, default_group_quota=None, default_user_quota=None, enable_alarms=True, enable_email_providers=True, grace_period=None, guid='b40682dd-5910-4f89-838b-0ef0eef45cc7', hard_limit=1073741824, hard_limit_inodes=None, id=39, internal=False, is_user_quota=False, last_user_quotas_update=None, name='f8e9c921-56e5-4b4a-a619-44221b8150a3', num_blocked_users=0, num_exceeded_users=0, path='/manila/manila-f8e9c921-56e5-4b4a-a619-44221b8150a3', percent_capacity=0, percent_inodes=None, pretty_grace_period=None, pretty_grace_period_expiration=None, pretty_state='OK (CREATED)', soft_limit=None, soft_limit_inodes=None, state='OK', sync_state='CREATED', system_id=39, tenant_id=1, tenant_name='default', time_to_block=None, title='f8e9c921-56e5-4b4a-a619-44221b8150a3', url='https://127.0.0.1:40443/api/quotas/39/', used_capacity=0, used_capacity_tb=0.0, used_effective_capacity=0, used_effective_capacity_tb=0.0, used_inodes=0, used_limited_capacity=0)] May 28 13:00:35 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1461/2893] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 13:00:35 2024] GET /identity/v3/roles => generated 1680 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 13:00:35 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8b4f0fd1-edd5-4fef-976a-4a87ae5862d3 tempest-ShareTransferNegativeTest-884271560 None] --- [GET] https://127.0.0.1:40443/api/quotas/: Done May 28 13:00:35 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8b4f0fd1-edd5-4fef-976a-4a87ae5862d3 tempest-ShareTransferNegativeTest-884271560 None] >>> [DELETE] https://127.0.0.1:40443/api/quotas/39/ May 28 13:00:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d89d64-9cd2-4e96-8f5b-d745764f4759 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d89d64-9cd2-4e96-8f5b-d745764f4759 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113c8b39-6d23-454f-94e9-ac82c9bff071 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113c8b39-6d23-454f-94e9-ac82c9bff071 None admin] REQUEST_METHOD: `PUT` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113c8b39-6d23-454f-94e9-ac82c9bff071 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113c8b39-6d23-454f-94e9-ac82c9bff071 None admin] PATH_INFO: `/v3/projects/bb20757ddd604868aff8ad38db5def87/users/56313694cffb4df8b0b20f48edb02368/roles/e7989893488f483baa107be56668c4f8` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113c8b39-6d23-454f-94e9-ac82c9bff071 None admin] RBAC: Authorizing `identity:create_grant(project_id=bb20757ddd604868aff8ad38db5def87, user_id=56313694cffb4df8b0b20f48edb02368, role_id=e7989893488f483baa107be56668c4f8)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113c8b39-6d23-454f-94e9-ac82c9bff071 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:35 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1433/2894] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 13:00:35 2024] PUT /identity/v3/projects/bb20757ddd604868aff8ad38db5def87/users/56313694cffb4df8b0b20f48edb02368/roles/e7989893488f483baa107be56668c4f8 => generated 0 bytes in 19 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:00:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aca52bb-5175-4ed6-ba71-52e39627ba7a None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aca52bb-5175-4ed6-ba71-52e39627ba7a None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aca52bb-5175-4ed6-ba71-52e39627ba7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:35 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-6aca52bb-5175-4ed6-ba71-52e39627ba7a None None] Truncating password to algorithm specific maximum length 72 characters. May 28 13:00:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-6aca52bb-5175-4ed6-ba71-52e39627ba7a None None] MFA Rules not processed for user `56313694cffb4df8b0b20f48edb02368`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 13:00:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-6aca52bb-5175-4ed6-ba71-52e39627ba7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:00:35 l75lg1-v1 dstat.sh[49771]: 28-05 13:00:35| 10 1 86 2 0|5688M 1761M 278M 7898M| 19k 1324B| 0 1320k| 0 186 |7089 12k|1.71 1.20 1.06|5.0 0 0| 0 0 | 0 2048M| 29 362 0 46 2 May 28 13:00:35 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1462/2895] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 13:00:35 2024] POST /identity/v3/auth/tokens => generated 4093 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 13:00:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113c8b39-6d23-454f-94e9-ac82c9bff071 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113c8b39-6d23-454f-94e9-ac82c9bff071 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc854c73-cbfa-4e7d-8578-34d11ede931d tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56313694cffb4df8b0b20f48edb02368', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb20757ddd604868aff8ad38db5def87', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc854c73-cbfa-4e7d-8578-34d11ede931d tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc854c73-cbfa-4e7d-8578-34d11ede931d tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc854c73-cbfa-4e7d-8578-34d11ede931d tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] PATH_INFO: `/v3/domains` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc854c73-cbfa-4e7d-8578-34d11ede931d tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 13:00:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc854c73-cbfa-4e7d-8578-34d11ede931d tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc854c73-cbfa-4e7d-8578-34d11ede931d tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:35 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1434/2896] 10.27.203.238 () {62 vars in 1241 bytes} [Tue May 28 13:00:35 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 13:00:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aca52bb-5175-4ed6-ba71-52e39627ba7a None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aca52bb-5175-4ed6-ba71-52e39627ba7a None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8315a59d-28c5-41c3-91f8-80805788a8b2 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56313694cffb4df8b0b20f48edb02368', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb20757ddd604868aff8ad38db5def87', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8315a59d-28c5-41c3-91f8-80805788a8b2 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8315a59d-28c5-41c3-91f8-80805788a8b2 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8315a59d-28c5-41c3-91f8-80805788a8b2 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] PATH_INFO: `/v3/users` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8315a59d-28c5-41c3-91f8-80805788a8b2 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8315a59d-28c5-41c3-91f8-80805788a8b2 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:35 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-8315a59d-28c5-41c3-91f8-80805788a8b2 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] Truncating password to algorithm specific maximum length 72 characters. May 28 13:00:35 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1463/2897] 10.27.203.238 () {64 vars in 1232 bytes} [Tue May 28 13:00:35 2024] POST /identity/v3/users => generated 433 bytes in 33 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 13:00:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc854c73-cbfa-4e7d-8578-34d11ede931d tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc854c73-cbfa-4e7d-8578-34d11ede931d tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c395902-2fda-4a63-aeeb-9969910ca5b9 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56313694cffb4df8b0b20f48edb02368', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb20757ddd604868aff8ad38db5def87', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c395902-2fda-4a63-aeeb-9969910ca5b9 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c395902-2fda-4a63-aeeb-9969910ca5b9 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c395902-2fda-4a63-aeeb-9969910ca5b9 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] PATH_INFO: `/v3/roles` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c395902-2fda-4a63-aeeb-9969910ca5b9 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c395902-2fda-4a63-aeeb-9969910ca5b9 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:35 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1435/2898] 10.27.203.238 () {62 vars in 1210 bytes} [Tue May 28 13:00:35 2024] GET /identity/v3/roles => generated 1680 bytes in 17 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 13:00:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8315a59d-28c5-41c3-91f8-80805788a8b2 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8315a59d-28c5-41c3-91f8-80805788a8b2 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631c213f-672d-44a7-9079-fa04987d0ab0 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56313694cffb4df8b0b20f48edb02368', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb20757ddd604868aff8ad38db5def87', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631c213f-672d-44a7-9079-fa04987d0ab0 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] REQUEST_METHOD: `PUT` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631c213f-672d-44a7-9079-fa04987d0ab0 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631c213f-672d-44a7-9079-fa04987d0ab0 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] PATH_INFO: `/v3/projects/bb20757ddd604868aff8ad38db5def87/users/eb30733c944e480eb147435ead450b9c/roles/44620cad10ae407c90c91e2c296adb04` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631c213f-672d-44a7-9079-fa04987d0ab0 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] RBAC: Authorizing `identity:create_grant(project_id=bb20757ddd604868aff8ad38db5def87, user_id=eb30733c944e480eb147435ead450b9c, role_id=44620cad10ae407c90c91e2c296adb04)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631c213f-672d-44a7-9079-fa04987d0ab0 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:35 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1464/2899] 10.27.203.238 () {64 vars in 1571 bytes} [Tue May 28 13:00:35 2024] PUT /identity/v3/projects/bb20757ddd604868aff8ad38db5def87/users/eb30733c944e480eb147435ead450b9c/roles/44620cad10ae407c90c91e2c296adb04 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 28 13:00:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c395902-2fda-4a63-aeeb-9969910ca5b9 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-3c395902-2fda-4a63-aeeb-9969910ca5b9 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:00:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c395902-2fda-4a63-aeeb-9969910ca5b9 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e740797-ce0b-4f21-bc8e-58dae413c7ba service manila] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f110cf6300f049c897d0aab63218d1e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e740797-ce0b-4f21-bc8e-58dae413c7ba service manila] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e740797-ce0b-4f21-bc8e-58dae413c7ba service manila] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e740797-ce0b-4f21-bc8e-58dae413c7ba service manila] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e740797-ce0b-4f21-bc8e-58dae413c7ba service manila] RBAC: Authorizing `identity:validate_token()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e740797-ce0b-4f21-bc8e-58dae413c7ba service manila] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:35 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1436/2900] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 13:00:35 2024] GET /identity/v3/auth/tokens => generated 4093 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 13:00:35 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-4d00bc2e-8892-46a9-a137-dadc5aa20da6 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] POST http://10.27.203.238/share/v2/bb20757ddd604868aff8ad38db5def87/types May 28 13:00:35 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-4d00bc2e-8892-46a9-a137-dadc5aa20da6 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share_type": {"name": "tempest-typeshare-type-824945873", "extra_specs": {"driver_handles_share_servers": "False"}, "share_type_access:is_public": true}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:00:35 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-4d00bc2e-8892-46a9-a137-dadc5aa20da6 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] http://10.27.203.238/share/v2/bb20757ddd604868aff8ad38db5def87/types returned with HTTP 200 May 28 13:00:35 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 940/1852] 10.27.203.238 () {66 vars in 1359 bytes} [Tue May 28 13:00:35 2024] POST /share/v2/bb20757ddd604868aff8ad38db5def87/types => generated 621 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:00:35 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-ac06f68b-92ed-4000-aaf7-89b9e24bf591 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] POST http://10.27.203.238/share/v2/bb20757ddd604868aff8ad38db5def87/share-group-types May 28 13:00:35 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-ac06f68b-92ed-4000-aaf7-89b9e24bf591 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share_group_type": {"name": "tempest-unique_sgtype_name-374616779", "share_types": ["7d2ea8e8-bada-4826-a8a8-53b4e9ff301f"]}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:00:35 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-ac06f68b-92ed-4000-aaf7-89b9e24bf591 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] http://10.27.203.238/share/v2/bb20757ddd604868aff8ad38db5def87/share-group-types returned with HTTP 200 May 28 13:00:35 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 913/1853] 10.27.203.238 () {66 vars in 1395 bytes} [Tue May 28 13:00:35 2024] POST /share/v2/bb20757ddd604868aff8ad38db5def87/share-group-types => generated 232 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:00:35 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-77d192a2-6f2f-4f43-85a7-d12b69804053 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] GET http://10.27.203.238/share/v2/bb20757ddd604868aff8ad38db5def87/services May 28 13:00:35 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-77d192a2-6f2f-4f43-85a7-d12b69804053 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:35 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-77d192a2-6f2f-4f43-85a7-d12b69804053 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:35 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-77d192a2-6f2f-4f43-85a7-d12b69804053 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] http://10.27.203.238/share/v2/bb20757ddd604868aff8ad38db5def87/services returned with HTTP 200 May 28 13:00:35 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 941/1854] 10.27.203.238 () {64 vars in 1346 bytes} [Tue May 28 13:00:35 2024] GET /share/v2/bb20757ddd604868aff8ad38db5def87/services => generated 945 bytes in 15 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:00:35 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-2c5dd67c-6174-4d5d-bae8-0cb6cd799cdb tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] GET http://10.27.203.238/share/v2/bb20757ddd604868aff8ad38db5def87/scheduler-stats/pools/detail?share_type=7d2ea8e8-bada-4826-a8a8-53b4e9ff301f May 28 13:00:35 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-2c5dd67c-6174-4d5d-bae8-0cb6cd799cdb tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:35 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-2c5dd67c-6174-4d5d-bae8-0cb6cd799cdb tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:35 l75lg1-v1 devstack@m-api.service[98330]: INFO oslo_messaging._drivers.amqpdriver [None req-2c5dd67c-6174-4d5d-bae8-0cb6cd799cdb tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] Expecting reply to msg b816bb06080b41acb65b3693661661fa in queue reply_cde4727073384bdbbe2d3acaf79ae8a7 May 28 13:00:35 l75lg1-v1 devstack@m-api.service[98330]: INFO oslo_messaging._drivers.amqpdriver [-] Received RPC response for msg b816bb06080b41acb65b3693661661fa May 28 13:00:35 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-09a31fe3-ba8e-4ffb-be1b-b8a8e794bfa3 tempest-UserMessageNegativeTest-781603078 tempest-UserMessageNegativeTest-781603078-project-member] GET http://10.27.203.238/share/v2/ca9b4c5f200844bdbcc6db13e907f21e/messages May 28 13:00:35 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-09a31fe3-ba8e-4ffb-be1b-b8a8e794bfa3 tempest-UserMessageNegativeTest-781603078 tempest-UserMessageNegativeTest-781603078-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:35 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-09a31fe3-ba8e-4ffb-be1b-b8a8e794bfa3 tempest-UserMessageNegativeTest-781603078 tempest-UserMessageNegativeTest-781603078-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:35 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.message.api [None req-09a31fe3-ba8e-4ffb-be1b-b8a8e794bfa3 tempest-UserMessageNegativeTest-781603078 tempest-UserMessageNegativeTest-781603078-project-member] Searching for messages by: MultiDict([]) {{(pid=98329) get_all /opt/stack/manila/manila/message/api.py:78}} May 28 13:00:35 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-09a31fe3-ba8e-4ffb-be1b-b8a8e794bfa3 tempest-UserMessageNegativeTest-781603078 tempest-UserMessageNegativeTest-781603078-project-member] http://10.27.203.238/share/v2/ca9b4c5f200844bdbcc6db13e907f21e/messages returned with HTTP 200 May 28 13:00:35 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 942/1855] 10.27.203.238 () {64 vars in 1346 bytes} [Tue May 28 13:00:35 2024] GET /share/v2/ca9b4c5f200844bdbcc6db13e907f21e/messages => generated 3218 bytes in 11 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:00:35 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-a8e7e999-e925-4afd-a892-6ea6605d8d1e tempest-UserMessageNegativeTest-1434999480 tempest-UserMessageNegativeTest-1434999480-project-member] GET http://10.27.203.238/share/v2/59c1579619b6422fa4c591102b473b67/messages/cd2e884b-1f00-478b-93d1-9c37ae772a8d May 28 13:00:35 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-a8e7e999-e925-4afd-a892-6ea6605d8d1e tempest-UserMessageNegativeTest-1434999480 tempest-UserMessageNegativeTest-1434999480-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:35 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-a8e7e999-e925-4afd-a892-6ea6605d8d1e tempest-UserMessageNegativeTest-1434999480 tempest-UserMessageNegativeTest-1434999480-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:35 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-a8e7e999-e925-4afd-a892-6ea6605d8d1e tempest-UserMessageNegativeTest-1434999480 tempest-UserMessageNegativeTest-1434999480-project-member] HTTP exception thrown: Message cd2e884b-1f00-478b-93d1-9c37ae772a8d could not be found. May 28 13:00:35 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-a8e7e999-e925-4afd-a892-6ea6605d8d1e tempest-UserMessageNegativeTest-1434999480 tempest-UserMessageNegativeTest-1434999480-project-member] http://10.27.203.238/share/v2/59c1579619b6422fa4c591102b473b67/messages/cd2e884b-1f00-478b-93d1-9c37ae772a8d returned with HTTP 404 May 28 13:00:35 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 943/1856] 10.27.203.238 () {64 vars in 1457 bytes} [Tue May 28 13:00:35 2024] GET /share/v2/59c1579619b6422fa4c591102b473b67/messages/cd2e884b-1f00-478b-93d1-9c37ae772a8d => generated 110 bytes in 9 msecs (HTTP/1.1 404) 6 headers in 238 bytes (1 switches on core 0) May 28 13:00:35 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-c1d1a703-0226-492a-861a-c28ca418bcde tempest-UserMessageNegativeTest-781603078 tempest-UserMessageNegativeTest-781603078-project-member] DELETE http://10.27.203.238/share/v2/ca9b4c5f200844bdbcc6db13e907f21e/shares/47cad5db-9d67-4af7-91ff-034b26ea9f93 May 28 13:00:35 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-c1d1a703-0226-492a-861a-c28ca418bcde tempest-UserMessageNegativeTest-781603078 tempest-UserMessageNegativeTest-781603078-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:35 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-c1d1a703-0226-492a-861a-c28ca418bcde tempest-UserMessageNegativeTest-781603078 tempest-UserMessageNegativeTest-781603078-project-member] Calling method 'ShareMixin.delete' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:35 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.v1.shares [None req-c1d1a703-0226-492a-861a-c28ca418bcde tempest-UserMessageNegativeTest-781603078 tempest-UserMessageNegativeTest-781603078-project-member] Delete share with id: 47cad5db-9d67-4af7-91ff-034b26ea9f93 May 28 13:00:35 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-41955ae2-33c8-43bb-8d54-95a6c9ae3321 tempest-ShareRulesTest-1530341375 None] <<< [PATCH] https://127.0.0.1:40443/api/viewpolicies/44/ May 28 13:00:35 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-41955ae2-33c8-43bb-8d54-95a6c9ae3321 tempest-ShareRulesTest-1530341375 None] Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=1, created='2024-05-28T13:00:28.342982Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='ab44815a-6cee-4df3-a9a3-333372151587', id=44, internal=False, is_s3_default_policy=False, name='5eddb781-43d4-4883-ae43-e9856f3a4c10', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=['*'], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['203.0.113.77'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['203.0.113.77'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='MODIFYING', sync_time='2024-05-28T13:00:35.322087Z', tenant_id=1, tenant_name='default', title='5eddb781-43d4-4883-ae43-e9856f3a4c10', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/44/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[]) May 28 13:00:35 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-41955ae2-33c8-43bb-8d54-95a6c9ae3321 tempest-ShareRulesTest-1530341375 None] --- [PATCH] https://127.0.0.1:40443/api/viewpolicies/44/: Done May 28 13:00:35 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-41955ae2-33c8-43bb-8d54-95a6c9ae3321 tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_5eddb781-43d4-4883-ae43-e9856f3a4c10" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:00:35 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-41955ae2-33c8-43bb-8d54-95a6c9ae3321 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_5eddb781-43d4-4883-ae43-e9856f3a4c10" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:00:35 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.quota [None req-c1d1a703-0226-492a-861a-c28ca418bcde tempest-UserMessageNegativeTest-781603078 tempest-UserMessageNegativeTest-781603078-project-member] Created reservations ['43575d61-829e-4ddb-91b8-f5959d71d25a', '2a63f73b-b478-4ead-a7fe-39dd83d4acfc', '55a3df40-9980-4969-8786-e24318dab6df', '30eb26c5-96a6-43b9-b98b-598cb9a29b26'] {{(pid=98329) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 13:00:35 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-41955ae2-33c8-43bb-8d54-95a6c9ae3321 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_5eddb781-43d4-4883-ae43-e9856f3a4c10" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.058s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:00:35 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-41955ae2-33c8-43bb-8d54-95a6c9ae3321 tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_5eddb781-43d4-4883-ae43-e9856f3a4c10" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:00:35 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-41955ae2-33c8-43bb-8d54-95a6c9ae3321 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_5eddb781-43d4-4883-ae43-e9856f3a4c10" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:00:35 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-41955ae2-33c8-43bb-8d54-95a6c9ae3321 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_5eddb781-43d4-4883-ae43-e9856f3a4c10" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:00:35 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-41955ae2-33c8-43bb-8d54-95a6c9ae3321 tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_5eddb781-43d4-4883-ae43-e9856f3a4c10" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:00:35 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-41955ae2-33c8-43bb-8d54-95a6c9ae3321 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_5eddb781-43d4-4883-ae43-e9856f3a4c10" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:00:35 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.quota [None req-c1d1a703-0226-492a-861a-c28ca418bcde tempest-UserMessageNegativeTest-781603078 tempest-UserMessageNegativeTest-781603078-project-member] Committed reservations ['43575d61-829e-4ddb-91b8-f5959d71d25a', '2a63f73b-b478-4ead-a7fe-39dd83d4acfc', '55a3df40-9980-4969-8786-e24318dab6df', '30eb26c5-96a6-43b9-b98b-598cb9a29b26'] {{(pid=98329) commit /opt/stack/manila/manila/quota.py:1063}} May 28 13:00:35 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-41955ae2-33c8-43bb-8d54-95a6c9ae3321 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_5eddb781-43d4-4883-ae43-e9856f3a4c10" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:00:35 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-41955ae2-33c8-43bb-8d54-95a6c9ae3321 tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_5eddb781-43d4-4883-ae43-e9856f3a4c10" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:00:35 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-41955ae2-33c8-43bb-8d54-95a6c9ae3321 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_5eddb781-43d4-4883-ae43-e9856f3a4c10" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:00:35 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-41955ae2-33c8-43bb-8d54-95a6c9ae3321 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_5eddb781-43d4-4883-ae43-e9856f3a4c10" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:00:35 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-41955ae2-33c8-43bb-8d54-95a6c9ae3321 tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_5eddb781-43d4-4883-ae43-e9856f3a4c10" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:00:35 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-41955ae2-33c8-43bb-8d54-95a6c9ae3321 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_5eddb781-43d4-4883-ae43-e9856f3a4c10" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:00:35 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-c1d1a703-0226-492a-861a-c28ca418bcde tempest-UserMessageNegativeTest-781603078 tempest-UserMessageNegativeTest-781603078-project-member] http://10.27.203.238/share/v2/ca9b4c5f200844bdbcc6db13e907f21e/shares/47cad5db-9d67-4af7-91ff-034b26ea9f93 returned with HTTP 202 May 28 13:00:35 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 944/1857] 10.27.203.238 () {64 vars in 1454 bytes} [Tue May 28 13:00:35 2024] DELETE /share/v2/ca9b4c5f200844bdbcc6db13e907f21e/shares/47cad5db-9d67-4af7-91ff-034b26ea9f93 => generated 0 bytes in 241 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 13:00:35 l75lg1-v1 neutron-server[77619]: DEBUG dbcounter [-] [77619] Writing DB stats neutron:SELECT=1 {{(pid=77619) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:00:35 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-b1f56cb7-c47d-49c3-a3d1-e89d4efe787a tempest-UserMessageNegativeTest-278135351 tempest-UserMessageNegativeTest-278135351-project-admin] POST http://10.27.203.238/share/v2/7942989ad1ef4db2b2e923f7316c8511/types May 28 13:00:35 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-b1f56cb7-c47d-49c3-a3d1-e89d4efe787a tempest-UserMessageNegativeTest-278135351 tempest-UserMessageNegativeTest-278135351-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share_type": {"name": "tempest-share-type-1581251415", "extra_specs": {"driver_handles_share_servers": false, "vendor_name": "foobar"}, "share_type_access:is_public": true}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:00:35 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-b1f56cb7-c47d-49c3-a3d1-e89d4efe787a tempest-UserMessageNegativeTest-278135351 tempest-UserMessageNegativeTest-278135351-project-admin] http://10.27.203.238/share/v2/7942989ad1ef4db2b2e923f7316c8511/types returned with HTTP 200 May 28 13:00:35 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 945/1858] 10.27.203.238 () {66 vars in 1359 bytes} [Tue May 28 13:00:35 2024] POST /share/v2/7942989ad1ef4db2b2e923f7316c8511/types => generated 661 bytes in 25 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:00:36 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-41955ae2-33c8-43bb-8d54-95a6c9ae3321 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_5eddb781-43d4-4883-ae43-e9856f3a4c10" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.039s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:00:36 l75lg1-v1 manila-share[98474]: INFO manila.share.access [None req-41955ae2-33c8-43bb-8d54-95a6c9ae3321 tempest-ShareRulesTest-1530341375 None] Access rules were successfully modified for share instance 5eddb781-43d4-4883-ae43-e9856f3a4c10 belonging to share f4283c2a-3835-416e-9703-f5745babbf5c. May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-fd02477c-213f-4bcd-b381-072f0bb2dc1d tempest-UserMessageNegativeTest-781603078 tempest-UserMessageNegativeTest-781603078-project-member] POST http://10.27.203.238/share/v2/ca9b4c5f200844bdbcc6db13e907f21e/shares May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-fd02477c-213f-4bcd-b381-072f0bb2dc1d tempest-UserMessageNegativeTest-781603078 tempest-UserMessageNegativeTest-781603078-project-member] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share": {"share_proto": "nfs", "description": "tempest-tempest-created-share-desc-603073787", "snapshot_id": null, "name": "tempest-tempest-created-share-1518498647", "size": 1, "metadata": {}, "is_public": false, "share_type": "0fbf68c0-d5aa-4aac-9ee0-4880e66888ff"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.v1.shares [None req-fd02477c-213f-4bcd-b381-072f0bb2dc1d tempest-UserMessageNegativeTest-781603078 tempest-UserMessageNegativeTest-781603078-project-member] Create NFS share of 1 GB May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.quota [None req-fd02477c-213f-4bcd-b381-072f0bb2dc1d tempest-UserMessageNegativeTest-781603078 tempest-UserMessageNegativeTest-781603078-project-member] Created reservations ['35c1a30c-e194-4460-84c1-23ef954b5e4a', '9f37cdc4-871a-4ca3-9075-b55ce2ca2959', '1580eb4d-b21a-472f-8bc3-d49388dea662', 'bee53c94-4e26-49b1-a02e-c32d516dbe22'] {{(pid=98329) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.quota [None req-fd02477c-213f-4bcd-b381-072f0bb2dc1d tempest-UserMessageNegativeTest-781603078 tempest-UserMessageNegativeTest-781603078-project-member] Committed reservations ['35c1a30c-e194-4460-84c1-23ef954b5e4a', '9f37cdc4-871a-4ca3-9075-b55ce2ca2959', '1580eb4d-b21a-472f-8bc3-d49388dea662', 'bee53c94-4e26-49b1-a02e-c32d516dbe22'] {{(pid=98329) commit /opt/stack/manila/manila/quota.py:1063}} May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-2c5dd67c-6174-4d5d-bae8-0cb6cd799cdb tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] http://10.27.203.238/share/v2/bb20757ddd604868aff8ad38db5def87/scheduler-stats/pools/detail?share_type=7d2ea8e8-bada-4826-a8a8-53b4e9ff301f returned with HTTP 200 May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 914/1859] 10.27.203.238 () {64 vars in 1501 bytes} [Tue May 28 13:00:35 2024] GET /share/v2/bb20757ddd604868aff8ad38db5def87/scheduler-stats/pools/detail?share_type=7d2ea8e8-bada-4826-a8a8-53b4e9ff301f => generated 1086 bytes in 513 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-8f18024a-89c0-4eed-86d0-86281dc2e1d0 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] GET http://10.27.203.238/share/v2/bb20757ddd604868aff8ad38db5def87/services May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-8f18024a-89c0-4eed-86d0-86281dc2e1d0 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-8f18024a-89c0-4eed-86d0-86281dc2e1d0 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:36 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.host_manager [None req-fd02477c-213f-4bcd-b381-072f0bb2dc1d tempest-UserMessageNegativeTest-781603078 None] Share service is down. (host: l75lg1-v1@generic2). May 28 13:00:36 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.host_manager [None req-fd02477c-213f-4bcd-b381-072f0bb2dc1d tempest-UserMessageNegativeTest-781603078 None] Share service is down. (host: l75lg1-v1@generic1). May 28 13:00:36 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-fd02477c-213f-4bcd-b381-072f0bb2dc1d tempest-UserMessageNegativeTest-781603078 None] Starting with 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:80}} May 28 13:00:36 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-fd02477c-213f-4bcd-b381-072f0bb2dc1d tempest-UserMessageNegativeTest-781603078 None] Filter OnlyHostFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:00:36 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-fd02477c-213f-4bcd-b381-072f0bb2dc1d tempest-UserMessageNegativeTest-781603078 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:00:36 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.capacity [None req-fd02477c-213f-4bcd-b381-072f0bb2dc1d tempest-UserMessageNegativeTest-781603078 None] Space information for share creation on host l75lg1-v1@vast#vast (requested / avail): 1/2075 {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/capacity.py:83}} May 28 13:00:36 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-fd02477c-213f-4bcd-b381-072f0bb2dc1d tempest-UserMessageNegativeTest-781603078 None] Filter CapacityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-8f18024a-89c0-4eed-86d0-86281dc2e1d0 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] http://10.27.203.238/share/v2/bb20757ddd604868aff8ad38db5def87/services returned with HTTP 200 May 28 13:00:36 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.utils [None req-fd02477c-213f-4bcd-b381-072f0bb2dc1d tempest-UserMessageNegativeTest-781603078 None] Share type extra spec requirement "vendor_name=foobar" does not match reported capability "VAST STORAGE" {{(pid=98327) capabilities_satisfied /opt/stack/manila/manila/scheduler/utils.py:185}} May 28 13:00:36 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.capabilities [None req-fd02477c-213f-4bcd-b381-072f0bb2dc1d tempest-UserMessageNegativeTest-781603078 None] host: 'l75lg1-v1@vast#vast', free_capacity_gb: 2075.6478263456374, pools: None fails resource_type extra_specs requirements {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/capabilities.py:45}} May 28 13:00:36 l75lg1-v1 manila-scheduler[98327]: INFO manila.scheduler.filters.base [None req-fd02477c-213f-4bcd-b381-072f0bb2dc1d tempest-UserMessageNegativeTest-781603078 None] Filter CapabilitiesFilter returned 0 host(s) May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 915/1860] 10.27.203.238 () {64 vars in 1346 bytes} [Tue May 28 13:00:36 2024] GET /share/v2/bb20757ddd604868aff8ad38db5def87/services => generated 945 bytes in 16 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:00:36 l75lg1-v1 manila-scheduler[98327]: ERROR manila.scheduler.manager [None req-fd02477c-213f-4bcd-b381-072f0bb2dc1d tempest-UserMessageNegativeTest-781603078 None] Failed to schedule create_share: No valid host was found. Failed to find a weighted host, the last executed filter was CapabilitiesFilter.: manila.exception.NoValidHost: No valid host was found. Failed to find a weighted host, the last executed filter was CapabilitiesFilter. May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-fd02477c-213f-4bcd-b381-072f0bb2dc1d tempest-UserMessageNegativeTest-781603078 tempest-UserMessageNegativeTest-781603078-project-member] http://10.27.203.238/share/v2/ca9b4c5f200844bdbcc6db13e907f21e/shares returned with HTTP 200 May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 946/1861] 10.27.203.238 () {66 vars in 1362 bytes} [Tue May 28 13:00:36 2024] POST /share/v2/ca9b4c5f200844bdbcc6db13e907f21e/shares => generated 1335 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-25a03c5c-bf43-41a9-910e-3678f9d0c4ac tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] POST http://10.27.203.238/share/v2/bb20757ddd604868aff8ad38db5def87/types May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-25a03c5c-bf43-41a9-910e-3678f9d0c4ac tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share_type": {"name": "tempest-az_share_type-937693360", "extra_specs": {"driver_handles_share_servers": "False", "availability_zones": "az1, az2, az 3 "}, "share_type_access:is_public": true}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-d12bcf1a-e906-4fe5-90f6-6380e7e8f44e tempest-UserMessageNegativeTest-781603078 tempest-UserMessageNegativeTest-781603078-project-member] GET http://10.27.203.238/share/v2/ca9b4c5f200844bdbcc6db13e907f21e/shares/431c69fe-4a0e-48fc-ac60-0aa49079e1b2 May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-d12bcf1a-e906-4fe5-90f6-6380e7e8f44e tempest-UserMessageNegativeTest-781603078 tempest-UserMessageNegativeTest-781603078-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-d12bcf1a-e906-4fe5-90f6-6380e7e8f44e tempest-UserMessageNegativeTest-781603078 tempest-UserMessageNegativeTest-781603078-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-25a03c5c-bf43-41a9-910e-3678f9d0c4ac tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] http://10.27.203.238/share/v2/bb20757ddd604868aff8ad38db5def87/types returned with HTTP 200 May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 916/1862] 10.27.203.238 () {66 vars in 1359 bytes} [Tue May 28 13:00:36 2024] POST /share/v2/bb20757ddd604868aff8ad38db5def87/types => generated 695 bytes in 23 msecs (HTTP/1.1 200) 6 headers in 231 bytes (2 switches on core 0) May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-d12bcf1a-e906-4fe5-90f6-6380e7e8f44e tempest-UserMessageNegativeTest-781603078 tempest-UserMessageNegativeTest-781603078-project-member] http://10.27.203.238/share/v2/ca9b4c5f200844bdbcc6db13e907f21e/shares/431c69fe-4a0e-48fc-ac60-0aa49079e1b2 returned with HTTP 200 May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 947/1863] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:00:36 2024] GET /share/v2/ca9b4c5f200844bdbcc6db13e907f21e/shares/431c69fe-4a0e-48fc-ac60-0aa49079e1b2 => generated 1335 bytes in 24 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-cb834e15-e673-4dff-8bde-62b39f99300e tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] GET http://10.27.203.238/share/v2/bb20757ddd604868aff8ad38db5def87/types/3a400c66-942c-481f-bd83-22347d3b28c4 May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-cb834e15-e673-4dff-8bde-62b39f99300e tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-cb834e15-e673-4dff-8bde-62b39f99300e tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] Calling method 'ShareTypesController.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:36 l75lg1-v1 manila-scheduler[98327]: INFO manila.message.api [None req-fd02477c-213f-4bcd-b381-072f0bb2dc1d tempest-UserMessageNegativeTest-781603078 None] Creating message record for request_id = req-fd02477c-213f-4bcd-b381-072f0bb2dc1d May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-cb834e15-e673-4dff-8bde-62b39f99300e tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] http://10.27.203.238/share/v2/bb20757ddd604868aff8ad38db5def87/types/3a400c66-942c-481f-bd83-22347d3b28c4 returned with HTTP 200 May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 917/1864] 10.27.203.238 () {64 vars in 1448 bytes} [Tue May 28 13:00:36 2024] GET /share/v2/bb20757ddd604868aff8ad38db5def87/types/3a400c66-942c-481f-bd83-22347d3b28c4 => generated 695 bytes in 11 msecs (HTTP/1.1 200) 6 headers in 231 bytes (2 switches on core 0) May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-26fa7587-dd26-4a0e-8051-a0f0e4034396 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] DELETE http://10.27.203.238/share/v2/bb20757ddd604868aff8ad38db5def87/types/3a400c66-942c-481f-bd83-22347d3b28c4 May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-26fa7587-dd26-4a0e-8051-a0f0e4034396 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-26fa7587-dd26-4a0e-8051-a0f0e4034396 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] Calling method 'ShareTypesController._delete' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:36 l75lg1-v1 dstat.sh[49771]: 28-05 13:00:36| 10 1 84 3 0|5689M 1760M 278M 7898M| 13k 2986B| 0 3112k| 0 379 |7532 13k|1.71 1.20 1.06|1.0 1.0 0| 0 0 | 0 2048M| 29 362 0 46 2 May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-26fa7587-dd26-4a0e-8051-a0f0e4034396 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] http://10.27.203.238/share/v2/bb20757ddd604868aff8ad38db5def87/types/3a400c66-942c-481f-bd83-22347d3b28c4 returned with HTTP 202 May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 948/1865] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:00:36 2024] DELETE /share/v2/bb20757ddd604868aff8ad38db5def87/types/3a400c66-942c-481f-bd83-22347d3b28c4 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-da9d9f54-dad3-464c-b5c0-812a89d73b43 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] GET http://10.27.203.238/share/v2/bb20757ddd604868aff8ad38db5def87/types/3a400c66-942c-481f-bd83-22347d3b28c4 May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-da9d9f54-dad3-464c-b5c0-812a89d73b43 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-da9d9f54-dad3-464c-b5c0-812a89d73b43 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] Calling method 'ShareTypesController.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-da9d9f54-dad3-464c-b5c0-812a89d73b43 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] HTTP exception thrown: Share type not found. May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-da9d9f54-dad3-464c-b5c0-812a89d73b43 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] http://10.27.203.238/share/v2/bb20757ddd604868aff8ad38db5def87/types/3a400c66-942c-481f-bd83-22347d3b28c4 returned with HTTP 404 May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 918/1866] 10.27.203.238 () {64 vars in 1448 bytes} [Tue May 28 13:00:36 2024] GET /share/v2/bb20757ddd604868aff8ad38db5def87/types/3a400c66-942c-481f-bd83-22347d3b28c4 => generated 67 bytes in 11 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-cf4a5da6-b7e9-43d4-a9a8-6633aebda849 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] POST http://10.27.203.238/share/v2/bb20757ddd604868aff8ad38db5def87/types May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-cf4a5da6-b7e9-43d4-a9a8-6633aebda849 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share_type": {"name": "tempest-az_share_type-2003774303", "extra_specs": {"driver_handles_share_servers": "False", "availability_zones": "az1,az2,az 3"}, "share_type_access:is_public": true}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-c7ed0e30-8f90-4399-97d3-df925cb81341 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] POST http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/shares/f4283c2a-3835-416e-9703-f5745babbf5c/action May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-c7ed0e30-8f90-4399-97d3-df925cb81341 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Action body: b'{"access_list": null}' {{(pid=98330) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-c7ed0e30-8f90-4399-97d3-df925cb81341 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Action: 'action', calling method: ShareController.access_list, body: {"access_list": null} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-cf4a5da6-b7e9-43d4-a9a8-6633aebda849 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] http://10.27.203.238/share/v2/bb20757ddd604868aff8ad38db5def87/types returned with HTTP 200 May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 949/1867] 10.27.203.238 () {66 vars in 1359 bytes} [Tue May 28 13:00:36 2024] POST /share/v2/bb20757ddd604868aff8ad38db5def87/types => generated 697 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-ac08333b-459e-412a-8181-1ff54e3b3783 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] GET http://10.27.203.238/share/v2/bb20757ddd604868aff8ad38db5def87/types/0f799e28-6deb-404b-877f-05be1b6444da May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-ac08333b-459e-412a-8181-1ff54e3b3783 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-ac08333b-459e-412a-8181-1ff54e3b3783 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] Calling method 'ShareTypesController.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-ac08333b-459e-412a-8181-1ff54e3b3783 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] http://10.27.203.238/share/v2/bb20757ddd604868aff8ad38db5def87/types/0f799e28-6deb-404b-877f-05be1b6444da returned with HTTP 200 May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 950/1868] 10.27.203.238 () {64 vars in 1448 bytes} [Tue May 28 13:00:36 2024] GET /share/v2/bb20757ddd604868aff8ad38db5def87/types/0f799e28-6deb-404b-877f-05be1b6444da => generated 697 bytes in 10 msecs (HTTP/1.1 200) 6 headers in 231 bytes (2 switches on core 0) May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-2174da98-9533-4002-928f-97d9886a5890 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] DELETE http://10.27.203.238/share/v2/bb20757ddd604868aff8ad38db5def87/types/0f799e28-6deb-404b-877f-05be1b6444da May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-2174da98-9533-4002-928f-97d9886a5890 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-2174da98-9533-4002-928f-97d9886a5890 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] Calling method 'ShareTypesController._delete' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-c7ed0e30-8f90-4399-97d3-df925cb81341 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/shares/f4283c2a-3835-416e-9703-f5745babbf5c/action returned with HTTP 200 May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 919/1869] 10.27.203.238 () {66 vars in 1493 bytes} [Tue May 28 13:00:36 2024] POST /share/v2/a4f3887fa28c457390f5b66615564430/shares/f4283c2a-3835-416e-9703-f5745babbf5c/action => generated 176 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-0b0e5f5a-fadc-40f6-b378-78c8005ec504 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] DELETE http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/shares/f4283c2a-3835-416e-9703-f5745babbf5c May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-0b0e5f5a-fadc-40f6-b378-78c8005ec504 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-0b0e5f5a-fadc-40f6-b378-78c8005ec504 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Calling method 'ShareMixin.delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.v1.shares [None req-0b0e5f5a-fadc-40f6-b378-78c8005ec504 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Delete share with id: f4283c2a-3835-416e-9703-f5745babbf5c May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-2174da98-9533-4002-928f-97d9886a5890 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] http://10.27.203.238/share/v2/bb20757ddd604868aff8ad38db5def87/types/0f799e28-6deb-404b-877f-05be1b6444da returned with HTTP 202 May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 951/1870] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:00:36 2024] DELETE /share/v2/bb20757ddd604868aff8ad38db5def87/types/0f799e28-6deb-404b-877f-05be1b6444da => generated 0 bytes in 40 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-aec87858-d71c-43cd-8605-885b8f5c330c tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] GET http://10.27.203.238/share/v2/bb20757ddd604868aff8ad38db5def87/types/0f799e28-6deb-404b-877f-05be1b6444da May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-aec87858-d71c-43cd-8605-885b8f5c330c tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-aec87858-d71c-43cd-8605-885b8f5c330c tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] Calling method 'ShareTypesController.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-aec87858-d71c-43cd-8605-885b8f5c330c tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] HTTP exception thrown: Share type not found. May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-aec87858-d71c-43cd-8605-885b8f5c330c tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] http://10.27.203.238/share/v2/bb20757ddd604868aff8ad38db5def87/types/0f799e28-6deb-404b-877f-05be1b6444da returned with HTTP 404 May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 952/1871] 10.27.203.238 () {64 vars in 1448 bytes} [Tue May 28 13:00:36 2024] GET /share/v2/bb20757ddd604868aff8ad38db5def87/types/0f799e28-6deb-404b-877f-05be1b6444da => generated 67 bytes in 9 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-81914005-7014-48cb-899a-0e014c37619a tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] POST http://10.27.203.238/share/v2/bb20757ddd604868aff8ad38db5def87/types May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-81914005-7014-48cb-899a-0e014c37619a tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share_type": {"name": "tempest-az_share_type-1341132154", "extra_specs": {"driver_handles_share_servers": "False", "availability_zones": "az1 ,az2, az 3"}, "share_type_access:is_public": true}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:00:36 l75lg1-v1 neutron-server[77623]: DEBUG dbcounter [-] [77623] Writing DB stats neutron:SELECT=2 {{(pid=77623) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:00:36 l75lg1-v1 neutron-server[77623]: DEBUG dbcounter [-] [77623] Writing DB stats neutron:SELECT=1 {{(pid=77623) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-81914005-7014-48cb-899a-0e014c37619a tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] http://10.27.203.238/share/v2/bb20757ddd604868aff8ad38db5def87/types returned with HTTP 200 May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 953/1872] 10.27.203.238 () {66 vars in 1359 bytes} [Tue May 28 13:00:36 2024] POST /share/v2/bb20757ddd604868aff8ad38db5def87/types => generated 697 bytes in 24 msecs (HTTP/1.1 200) 6 headers in 231 bytes (2 switches on core 0) May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-ea064f10-ef63-4f99-aaa8-e1c822d6ec57 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] GET http://10.27.203.238/share/v2/bb20757ddd604868aff8ad38db5def87/types/67748e46-745c-480a-8980-bfbe265bd122 May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-ea064f10-ef63-4f99-aaa8-e1c822d6ec57 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-ea064f10-ef63-4f99-aaa8-e1c822d6ec57 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] Calling method 'ShareTypesController.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-ea064f10-ef63-4f99-aaa8-e1c822d6ec57 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] http://10.27.203.238/share/v2/bb20757ddd604868aff8ad38db5def87/types/67748e46-745c-480a-8980-bfbe265bd122 returned with HTTP 200 May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 954/1873] 10.27.203.238 () {64 vars in 1448 bytes} [Tue May 28 13:00:36 2024] GET /share/v2/bb20757ddd604868aff8ad38db5def87/types/67748e46-745c-480a-8980-bfbe265bd122 => generated 697 bytes in 9 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-242e210d-4d16-44a0-aa9f-c53a3f1367c9 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] DELETE http://10.27.203.238/share/v2/bb20757ddd604868aff8ad38db5def87/types/67748e46-745c-480a-8980-bfbe265bd122 May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-242e210d-4d16-44a0-aa9f-c53a3f1367c9 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-242e210d-4d16-44a0-aa9f-c53a3f1367c9 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] Calling method 'ShareTypesController._delete' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-242e210d-4d16-44a0-aa9f-c53a3f1367c9 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] http://10.27.203.238/share/v2/bb20757ddd604868aff8ad38db5def87/types/67748e46-745c-480a-8980-bfbe265bd122 returned with HTTP 202 May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 955/1874] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:00:36 2024] DELETE /share/v2/bb20757ddd604868aff8ad38db5def87/types/67748e46-745c-480a-8980-bfbe265bd122 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 6 headers in 243 bytes (2 switches on core 0) May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-0b0e5f5a-fadc-40f6-b378-78c8005ec504 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/shares/f4283c2a-3835-416e-9703-f5745babbf5c returned with HTTP 202 May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 920/1875] 10.27.203.238 () {64 vars in 1454 bytes} [Tue May 28 13:00:36 2024] DELETE /share/v2/a4f3887fa28c457390f5b66615564430/shares/f4283c2a-3835-416e-9703-f5745babbf5c => generated 0 bytes in 132 msecs (HTTP/1.1 202) 6 headers in 243 bytes (2 switches on core 0) May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-309f2774-886f-4507-a6ed-2c211b36760c tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] GET http://10.27.203.238/share/v2/bb20757ddd604868aff8ad38db5def87/types/67748e46-745c-480a-8980-bfbe265bd122 May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-309f2774-886f-4507-a6ed-2c211b36760c tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-309f2774-886f-4507-a6ed-2c211b36760c tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] Calling method 'ShareTypesController.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-326f833e-ee07-4fdd-8479-ca4370caa921 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] GET http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/shares/f4283c2a-3835-416e-9703-f5745babbf5c May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-326f833e-ee07-4fdd-8479-ca4370caa921 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-326f833e-ee07-4fdd-8479-ca4370caa921 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-309f2774-886f-4507-a6ed-2c211b36760c tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] HTTP exception thrown: Share type not found. May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-309f2774-886f-4507-a6ed-2c211b36760c tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] http://10.27.203.238/share/v2/bb20757ddd604868aff8ad38db5def87/types/67748e46-745c-480a-8980-bfbe265bd122 returned with HTTP 404 May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 956/1876] 10.27.203.238 () {64 vars in 1448 bytes} [Tue May 28 13:00:36 2024] GET /share/v2/bb20757ddd604868aff8ad38db5def87/types/67748e46-745c-480a-8980-bfbe265bd122 => generated 67 bytes in 9 msecs (HTTP/1.1 404) 6 headers in 237 bytes (2 switches on core 0) May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-d2a663c2-8abe-473e-9b24-61787be39453 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] POST http://10.27.203.238/share/v2/bb20757ddd604868aff8ad38db5def87/types May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-d2a663c2-8abe-473e-9b24-61787be39453 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share_type": {"name": "tempest-support_some_azs_share_type-1860380670", "extra_specs": {"driver_handles_share_servers": "False", "availability_zones": "az1, az2, az 3"}, "share_type_access:is_public": true}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-326f833e-ee07-4fdd-8479-ca4370caa921 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/shares/f4283c2a-3835-416e-9703-f5745babbf5c returned with HTTP 200 May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 921/1877] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:00:36 2024] GET /share/v2/a4f3887fa28c457390f5b66615564430/shares/f4283c2a-3835-416e-9703-f5745babbf5c => generated 1316 bytes in 25 msecs (HTTP/1.1 200) 6 headers in 232 bytes (2 switches on core 0) May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-d2a663c2-8abe-473e-9b24-61787be39453 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] http://10.27.203.238/share/v2/bb20757ddd604868aff8ad38db5def87/types returned with HTTP 200 May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 957/1878] 10.27.203.238 () {66 vars in 1359 bytes} [Tue May 28 13:00:36 2024] POST /share/v2/bb20757ddd604868aff8ad38db5def87/types => generated 725 bytes in 20 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-3153b3f3-91ab-42db-909c-63dca385326a tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] POST http://10.27.203.238/share/v2/bb20757ddd604868aff8ad38db5def87/types May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-3153b3f3-91ab-42db-909c-63dca385326a tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share_type": {"name": "tempest-support_any_az_share_type-1021037167", "extra_specs": {"driver_handles_share_servers": "False"}, "share_type_access:is_public": true}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-3153b3f3-91ab-42db-909c-63dca385326a tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] http://10.27.203.238/share/v2/bb20757ddd604868aff8ad38db5def87/types returned with HTTP 200 May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 922/1879] 10.27.203.238 () {66 vars in 1359 bytes} [Tue May 28 13:00:36 2024] POST /share/v2/bb20757ddd604868aff8ad38db5def87/types => generated 645 bytes in 23 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:00:36 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-0b0e5f5a-fadc-40f6-b378-78c8005ec504 tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_5eddb781-43d4-4883-ae43-e9856f3a4c10" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:00:36 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-0b0e5f5a-fadc-40f6-b378-78c8005ec504 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_5eddb781-43d4-4883-ae43-e9856f3a4c10" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-5853a35a-a0d1-4731-8823-951553fe1fbc tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] GET http://10.27.203.238/share/v2/bb20757ddd604868aff8ad38db5def87/types?extra_specs=%7B%27availability_zones%27%3A+%27az1%27%7D May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-5853a35a-a0d1-4731-8823-951553fe1fbc tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-5853a35a-a0d1-4731-8823-951553fe1fbc tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] Calling method 'ShareTypesController.index' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.share.share_types [None req-5853a35a-a0d1-4731-8823-951553fe1fbc tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] Searching by: {'availability_zones': ['az1']} {{(pid=98329) get_all_types /opt/stack/manila/manila/share/share_types.py:146}} May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-5853a35a-a0d1-4731-8823-951553fe1fbc tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] http://10.27.203.238/share/v2/bb20757ddd604868aff8ad38db5def87/types?extra_specs=%7B%27availability_zones%27%3A+%27az1%27%7D returned with HTTP 200 May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 958/1880] 10.27.203.238 () {64 vars in 1448 bytes} [Tue May 28 13:00:36 2024] GET /share/v2/bb20757ddd604868aff8ad38db5def87/types?extra_specs=%7B%27availability_zones%27%3A+%27az1%27%7D => generated 7927 bytes in 14 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-10b7b6f5-9898-4c4d-ab5d-b702846c97cb tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] DELETE http://10.27.203.238/share/v2/bb20757ddd604868aff8ad38db5def87/types/7eeeea8a-311e-4aed-a159-41f2497e73c3 May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-10b7b6f5-9898-4c4d-ab5d-b702846c97cb tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-10b7b6f5-9898-4c4d-ab5d-b702846c97cb tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] Calling method 'ShareTypesController._delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:36 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-0b0e5f5a-fadc-40f6-b378-78c8005ec504 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_5eddb781-43d4-4883-ae43-e9856f3a4c10" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.050s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:00:36 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-0b0e5f5a-fadc-40f6-b378-78c8005ec504 tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_5eddb781-43d4-4883-ae43-e9856f3a4c10" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:00:36 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-0b0e5f5a-fadc-40f6-b378-78c8005ec504 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_5eddb781-43d4-4883-ae43-e9856f3a4c10" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:00:36 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-0b0e5f5a-fadc-40f6-b378-78c8005ec504 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_5eddb781-43d4-4883-ae43-e9856f3a4c10" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:00:36 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-0b0e5f5a-fadc-40f6-b378-78c8005ec504 tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_5eddb781-43d4-4883-ae43-e9856f3a4c10" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:00:36 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-0b0e5f5a-fadc-40f6-b378-78c8005ec504 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_5eddb781-43d4-4883-ae43-e9856f3a4c10" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-10b7b6f5-9898-4c4d-ab5d-b702846c97cb tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] http://10.27.203.238/share/v2/bb20757ddd604868aff8ad38db5def87/types/7eeeea8a-311e-4aed-a159-41f2497e73c3 returned with HTTP 202 May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 923/1881] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:00:36 2024] DELETE /share/v2/bb20757ddd604868aff8ad38db5def87/types/7eeeea8a-311e-4aed-a159-41f2497e73c3 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-b92be615-dfe9-4d74-8ea6-37292ec642b5 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] GET http://10.27.203.238/share/v2/bb20757ddd604868aff8ad38db5def87/types/7eeeea8a-311e-4aed-a159-41f2497e73c3 May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-b92be615-dfe9-4d74-8ea6-37292ec642b5 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-b92be615-dfe9-4d74-8ea6-37292ec642b5 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] Calling method 'ShareTypesController.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-b92be615-dfe9-4d74-8ea6-37292ec642b5 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] HTTP exception thrown: Share type not found. May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-b92be615-dfe9-4d74-8ea6-37292ec642b5 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] http://10.27.203.238/share/v2/bb20757ddd604868aff8ad38db5def87/types/7eeeea8a-311e-4aed-a159-41f2497e73c3 returned with HTTP 404 May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 959/1882] 10.27.203.238 () {64 vars in 1448 bytes} [Tue May 28 13:00:36 2024] GET /share/v2/bb20757ddd604868aff8ad38db5def87/types/7eeeea8a-311e-4aed-a159-41f2497e73c3 => generated 67 bytes in 10 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-749facfe-2c44-4df3-83fc-dfa0543f59cd tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] DELETE http://10.27.203.238/share/v2/bb20757ddd604868aff8ad38db5def87/types/43abbd8f-fddd-4985-af2f-8ea825340b54 May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-749facfe-2c44-4df3-83fc-dfa0543f59cd tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-749facfe-2c44-4df3-83fc-dfa0543f59cd tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] Calling method 'ShareTypesController._delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-749facfe-2c44-4df3-83fc-dfa0543f59cd tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] http://10.27.203.238/share/v2/bb20757ddd604868aff8ad38db5def87/types/43abbd8f-fddd-4985-af2f-8ea825340b54 returned with HTTP 202 May 28 13:00:36 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-0b0e5f5a-fadc-40f6-b378-78c8005ec504 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_5eddb781-43d4-4883-ae43-e9856f3a4c10" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.060s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:00:36 l75lg1-v1 manila-share[98474]: DEBUG manila.share.access [None req-0b0e5f5a-fadc-40f6-b378-78c8005ec504 tempest-ShareRulesTest-1530341375 None] Updating access rules for share instance 5eddb781-43d4-4883-ae43-e9856f3a4c10 belonging to share f4283c2a-3835-416e-9703-f5745babbf5c. {{(pid=98474) update_access_rules /opt/stack/manila/manila/share/access.py:298}} May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 924/1883] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:00:36 2024] DELETE /share/v2/bb20757ddd604868aff8ad38db5def87/types/43abbd8f-fddd-4985-af2f-8ea825340b54 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-80d1b93a-ba02-404c-b5c4-a533a438c7eb tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] GET http://10.27.203.238/share/v2/bb20757ddd604868aff8ad38db5def87/types/43abbd8f-fddd-4985-af2f-8ea825340b54 May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-80d1b93a-ba02-404c-b5c4-a533a438c7eb tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-80d1b93a-ba02-404c-b5c4-a533a438c7eb tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] Calling method 'ShareTypesController.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-80d1b93a-ba02-404c-b5c4-a533a438c7eb tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] HTTP exception thrown: Share type not found. May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-80d1b93a-ba02-404c-b5c4-a533a438c7eb tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] http://10.27.203.238/share/v2/bb20757ddd604868aff8ad38db5def87/types/43abbd8f-fddd-4985-af2f-8ea825340b54 returned with HTTP 404 May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 960/1884] 10.27.203.238 () {64 vars in 1448 bytes} [Tue May 28 13:00:36 2024] GET /share/v2/bb20757ddd604868aff8ad38db5def87/types/43abbd8f-fddd-4985-af2f-8ea825340b54 => generated 67 bytes in 9 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-d0d31bce-50bb-4b2b-92da-d49efc15aaa3 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] POST http://10.27.203.238/share/v2/bb20757ddd604868aff8ad38db5def87/types May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-d0d31bce-50bb-4b2b-92da-d49efc15aaa3 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share_type": {"name": "tempest-support_some_azs_share_type-198199617", "extra_specs": {"driver_handles_share_servers": "False", "availability_zones": "az1, az2, az 3"}, "share_type_access:is_public": true}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:00:36 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-0b0e5f5a-fadc-40f6-b378-78c8005ec504 tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_5eddb781-43d4-4883-ae43-e9856f3a4c10" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:00:36 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-0b0e5f5a-fadc-40f6-b378-78c8005ec504 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_5eddb781-43d4-4883-ae43-e9856f3a4c10" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-d0d31bce-50bb-4b2b-92da-d49efc15aaa3 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] http://10.27.203.238/share/v2/bb20757ddd604868aff8ad38db5def87/types returned with HTTP 200 May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 925/1885] 10.27.203.238 () {66 vars in 1359 bytes} [Tue May 28 13:00:36 2024] POST /share/v2/bb20757ddd604868aff8ad38db5def87/types => generated 723 bytes in 23 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-2e1920df-2b9c-44db-aa61-b6f5f35f4fed tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] POST http://10.27.203.238/share/v2/bb20757ddd604868aff8ad38db5def87/types May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-2e1920df-2b9c-44db-aa61-b6f5f35f4fed tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share_type": {"name": "tempest-support_any_az_share_type-191309465", "extra_specs": {"driver_handles_share_servers": "False"}, "share_type_access:is_public": true}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:00:36 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-0b0e5f5a-fadc-40f6-b378-78c8005ec504 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_5eddb781-43d4-4883-ae43-e9856f3a4c10" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.043s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:00:36 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-0b0e5f5a-fadc-40f6-b378-78c8005ec504 tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_5eddb781-43d4-4883-ae43-e9856f3a4c10" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-2e1920df-2b9c-44db-aa61-b6f5f35f4fed tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] http://10.27.203.238/share/v2/bb20757ddd604868aff8ad38db5def87/types returned with HTTP 200 May 28 13:00:36 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-0b0e5f5a-fadc-40f6-b378-78c8005ec504 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_5eddb781-43d4-4883-ae43-e9856f3a4c10" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 961/1886] 10.27.203.238 () {66 vars in 1359 bytes} [Tue May 28 13:00:36 2024] POST /share/v2/bb20757ddd604868aff8ad38db5def87/types => generated 643 bytes in 27 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-24e1f4ec-5fa4-4da0-982c-406bbed17210 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] GET http://10.27.203.238/share/v2/bb20757ddd604868aff8ad38db5def87/types?extra_specs=%7B%27availability_zones%27%3A+%27az2%27%7D May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-24e1f4ec-5fa4-4da0-982c-406bbed17210 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-24e1f4ec-5fa4-4da0-982c-406bbed17210 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] Calling method 'ShareTypesController.index' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:36 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-0b0e5f5a-fadc-40f6-b378-78c8005ec504 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_5eddb781-43d4-4883-ae43-e9856f3a4c10" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.016s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.share.share_types [None req-24e1f4ec-5fa4-4da0-982c-406bbed17210 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] Searching by: {'availability_zones': ['az2']} {{(pid=98330) get_all_types /opt/stack/manila/manila/share/share_types.py:146}} May 28 13:00:36 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-0b0e5f5a-fadc-40f6-b378-78c8005ec504 tempest-ShareRulesTest-1530341375 None] changing access on None May 28 13:00:36 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0b0e5f5a-fadc-40f6-b378-78c8005ec504 tempest-ShareRulesTest-1530341375 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:00:36 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0b0e5f5a-fadc-40f6-b378-78c8005ec504 tempest-ShareRulesTest-1530341375 None] {'allow_redirects': True, May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-24e1f4ec-5fa4-4da0-982c-406bbed17210 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] http://10.27.203.238/share/v2/bb20757ddd604868aff8ad38db5def87/types?extra_specs=%7B%27availability_zones%27%3A+%27az2%27%7D returned with HTTP 200 May 28 13:00:36 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0b0e5f5a-fadc-40f6-b378-78c8005ec504 tempest-ShareRulesTest-1530341375 None] 'params': {'name': '5eddb781-43d4-4883-ae43-e9856f3a4c10'}} May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 926/1887] 10.27.203.238 () {64 vars in 1448 bytes} [Tue May 28 13:00:36 2024] GET /share/v2/bb20757ddd604868aff8ad38db5def87/types?extra_specs=%7B%27availability_zones%27%3A+%27az2%27%7D => generated 7923 bytes in 15 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-ec2bdcbf-2119-47ac-95a0-6cbe432aaf48 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] DELETE http://10.27.203.238/share/v2/bb20757ddd604868aff8ad38db5def87/types/0e765cf8-9df9-4498-bac6-a7de7853f131 May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-ec2bdcbf-2119-47ac-95a0-6cbe432aaf48 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-ec2bdcbf-2119-47ac-95a0-6cbe432aaf48 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] Calling method 'ShareTypesController._delete' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-ec2bdcbf-2119-47ac-95a0-6cbe432aaf48 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] http://10.27.203.238/share/v2/bb20757ddd604868aff8ad38db5def87/types/0e765cf8-9df9-4498-bac6-a7de7853f131 returned with HTTP 202 May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 962/1888] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:00:36 2024] DELETE /share/v2/bb20757ddd604868aff8ad38db5def87/types/0e765cf8-9df9-4498-bac6-a7de7853f131 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-65b4791e-cb64-4ac0-93bd-eadb36a4e100 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] GET http://10.27.203.238/share/v2/bb20757ddd604868aff8ad38db5def87/types/0e765cf8-9df9-4498-bac6-a7de7853f131 May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-65b4791e-cb64-4ac0-93bd-eadb36a4e100 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-65b4791e-cb64-4ac0-93bd-eadb36a4e100 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] Calling method 'ShareTypesController.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-65b4791e-cb64-4ac0-93bd-eadb36a4e100 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] HTTP exception thrown: Share type not found. May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-65b4791e-cb64-4ac0-93bd-eadb36a4e100 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] http://10.27.203.238/share/v2/bb20757ddd604868aff8ad38db5def87/types/0e765cf8-9df9-4498-bac6-a7de7853f131 returned with HTTP 404 May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 927/1889] 10.27.203.238 () {64 vars in 1448 bytes} [Tue May 28 13:00:36 2024] GET /share/v2/bb20757ddd604868aff8ad38db5def87/types/0e765cf8-9df9-4498-bac6-a7de7853f131 => generated 67 bytes in 10 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-13368000-998d-415d-b606-b9c8a7468b4a tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] DELETE http://10.27.203.238/share/v2/bb20757ddd604868aff8ad38db5def87/types/d619ecf0-a918-417a-a26e-bedb1ad384fe May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-13368000-998d-415d-b606-b9c8a7468b4a tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-13368000-998d-415d-b606-b9c8a7468b4a tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] Calling method 'ShareTypesController._delete' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-13368000-998d-415d-b606-b9c8a7468b4a tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] http://10.27.203.238/share/v2/bb20757ddd604868aff8ad38db5def87/types/d619ecf0-a918-417a-a26e-bedb1ad384fe returned with HTTP 202 May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 963/1890] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:00:36 2024] DELETE /share/v2/bb20757ddd604868aff8ad38db5def87/types/d619ecf0-a918-417a-a26e-bedb1ad384fe => generated 0 bytes in 36 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-cc0d59b0-6d4c-4dca-a386-f578222bd76b tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] GET http://10.27.203.238/share/v2/bb20757ddd604868aff8ad38db5def87/types/d619ecf0-a918-417a-a26e-bedb1ad384fe May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-cc0d59b0-6d4c-4dca-a386-f578222bd76b tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-cc0d59b0-6d4c-4dca-a386-f578222bd76b tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] Calling method 'ShareTypesController.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-cc0d59b0-6d4c-4dca-a386-f578222bd76b tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] HTTP exception thrown: Share type not found. May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-cc0d59b0-6d4c-4dca-a386-f578222bd76b tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] http://10.27.203.238/share/v2/bb20757ddd604868aff8ad38db5def87/types/d619ecf0-a918-417a-a26e-bedb1ad384fe returned with HTTP 404 May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 928/1891] 10.27.203.238 () {64 vars in 1448 bytes} [Tue May 28 13:00:36 2024] GET /share/v2/bb20757ddd604868aff8ad38db5def87/types/d619ecf0-a918-417a-a26e-bedb1ad384fe => generated 67 bytes in 9 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-a457f86a-7627-44b5-802a-2c5675160c3a tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] POST http://10.27.203.238/share/v2/bb20757ddd604868aff8ad38db5def87/types May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-a457f86a-7627-44b5-802a-2c5675160c3a tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share_type": {"name": "tempest-support_some_azs_share_type-466441857", "extra_specs": {"driver_handles_share_servers": "False", "availability_zones": "az1, az2, az 3"}, "share_type_access:is_public": true}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-a457f86a-7627-44b5-802a-2c5675160c3a tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] http://10.27.203.238/share/v2/bb20757ddd604868aff8ad38db5def87/types returned with HTTP 200 May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 964/1892] 10.27.203.238 () {66 vars in 1359 bytes} [Tue May 28 13:00:36 2024] POST /share/v2/bb20757ddd604868aff8ad38db5def87/types => generated 723 bytes in 27 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-7810e867-4324-4dd9-8396-933e1bd8a59f tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] POST http://10.27.203.238/share/v2/bb20757ddd604868aff8ad38db5def87/types May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-7810e867-4324-4dd9-8396-933e1bd8a59f tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share_type": {"name": "tempest-support_any_az_share_type-115535860", "extra_specs": {"driver_handles_share_servers": "False"}, "share_type_access:is_public": true}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-7810e867-4324-4dd9-8396-933e1bd8a59f tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] http://10.27.203.238/share/v2/bb20757ddd604868aff8ad38db5def87/types returned with HTTP 200 May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 929/1893] 10.27.203.238 () {66 vars in 1359 bytes} [Tue May 28 13:00:36 2024] POST /share/v2/bb20757ddd604868aff8ad38db5def87/types => generated 643 bytes in 27 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-2e1a8f7a-3e30-4b6c-acce-f0a08ea5a913 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] GET http://10.27.203.238/share/v2/bb20757ddd604868aff8ad38db5def87/types?extra_specs=%7B%27availability_zones%27%3A+%27az+3%27%7D May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-2e1a8f7a-3e30-4b6c-acce-f0a08ea5a913 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-2e1a8f7a-3e30-4b6c-acce-f0a08ea5a913 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] Calling method 'ShareTypesController.index' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.share.share_types [None req-2e1a8f7a-3e30-4b6c-acce-f0a08ea5a913 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] Searching by: {'availability_zones': ['az 3']} {{(pid=98329) get_all_types /opt/stack/manila/manila/share/share_types.py:146}} May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-2e1a8f7a-3e30-4b6c-acce-f0a08ea5a913 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] http://10.27.203.238/share/v2/bb20757ddd604868aff8ad38db5def87/types?extra_specs=%7B%27availability_zones%27%3A+%27az+3%27%7D returned with HTTP 200 May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 965/1894] 10.27.203.238 () {64 vars in 1450 bytes} [Tue May 28 13:00:36 2024] GET /share/v2/bb20757ddd604868aff8ad38db5def87/types?extra_specs=%7B%27availability_zones%27%3A+%27az+3%27%7D => generated 7923 bytes in 17 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-f87b5849-a96b-429e-851d-c8a0b9f29d25 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] DELETE http://10.27.203.238/share/v2/bb20757ddd604868aff8ad38db5def87/types/7c834e8e-578d-413a-aa46-bbc9d83fc8cf May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-f87b5849-a96b-429e-851d-c8a0b9f29d25 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-f87b5849-a96b-429e-851d-c8a0b9f29d25 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] Calling method 'ShareTypesController._delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-f87b5849-a96b-429e-851d-c8a0b9f29d25 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] http://10.27.203.238/share/v2/bb20757ddd604868aff8ad38db5def87/types/7c834e8e-578d-413a-aa46-bbc9d83fc8cf returned with HTTP 202 May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 930/1895] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:00:36 2024] DELETE /share/v2/bb20757ddd604868aff8ad38db5def87/types/7c834e8e-578d-413a-aa46-bbc9d83fc8cf => generated 0 bytes in 34 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-30ba8773-1cdb-49ad-94d4-d0ec5f3e4792 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] GET http://10.27.203.238/share/v2/bb20757ddd604868aff8ad38db5def87/types/7c834e8e-578d-413a-aa46-bbc9d83fc8cf May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-30ba8773-1cdb-49ad-94d4-d0ec5f3e4792 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-30ba8773-1cdb-49ad-94d4-d0ec5f3e4792 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] Calling method 'ShareTypesController.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-30ba8773-1cdb-49ad-94d4-d0ec5f3e4792 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] HTTP exception thrown: Share type not found. May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-30ba8773-1cdb-49ad-94d4-d0ec5f3e4792 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] http://10.27.203.238/share/v2/bb20757ddd604868aff8ad38db5def87/types/7c834e8e-578d-413a-aa46-bbc9d83fc8cf returned with HTTP 404 May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 966/1896] 10.27.203.238 () {64 vars in 1448 bytes} [Tue May 28 13:00:36 2024] GET /share/v2/bb20757ddd604868aff8ad38db5def87/types/7c834e8e-578d-413a-aa46-bbc9d83fc8cf => generated 67 bytes in 12 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-d8d08163-5c63-4501-866e-d06b591bf8c6 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] DELETE http://10.27.203.238/share/v2/bb20757ddd604868aff8ad38db5def87/types/97ba80e3-8d3b-4987-a8c0-035990d7c9d8 May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-d8d08163-5c63-4501-866e-d06b591bf8c6 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:36 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-d8d08163-5c63-4501-866e-d06b591bf8c6 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] Calling method 'ShareTypesController._delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:37 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-d8d08163-5c63-4501-866e-d06b591bf8c6 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] http://10.27.203.238/share/v2/bb20757ddd604868aff8ad38db5def87/types/97ba80e3-8d3b-4987-a8c0-035990d7c9d8 returned with HTTP 202 May 28 13:00:37 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 931/1897] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:00:36 2024] DELETE /share/v2/bb20757ddd604868aff8ad38db5def87/types/97ba80e3-8d3b-4987-a8c0-035990d7c9d8 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 13:00:37 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-316e02a3-2138-4bf8-ad48-500882cade06 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] GET http://10.27.203.238/share/v2/bb20757ddd604868aff8ad38db5def87/types/97ba80e3-8d3b-4987-a8c0-035990d7c9d8 May 28 13:00:37 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-316e02a3-2138-4bf8-ad48-500882cade06 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:37 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-316e02a3-2138-4bf8-ad48-500882cade06 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] Calling method 'ShareTypesController.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:37 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-316e02a3-2138-4bf8-ad48-500882cade06 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] HTTP exception thrown: Share type not found. May 28 13:00:37 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-316e02a3-2138-4bf8-ad48-500882cade06 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] http://10.27.203.238/share/v2/bb20757ddd604868aff8ad38db5def87/types/97ba80e3-8d3b-4987-a8c0-035990d7c9d8 returned with HTTP 404 May 28 13:00:37 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 967/1898] 10.27.203.238 () {64 vars in 1448 bytes} [Tue May 28 13:00:37 2024] GET /share/v2/bb20757ddd604868aff8ad38db5def87/types/97ba80e3-8d3b-4987-a8c0-035990d7c9d8 => generated 67 bytes in 16 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 13:00:37 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-ffbe70c1-cc07-47c6-accd-fc075594ab6b tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] POST http://10.27.203.238/share/v2/bb20757ddd604868aff8ad38db5def87/types May 28 13:00:37 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-ffbe70c1-cc07-47c6-accd-fc075594ab6b tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share_type": {"name": "tempest-support_some_azs_share_type-1624002905", "extra_specs": {"driver_handles_share_servers": "False", "availability_zones": "az1, az2, az 3"}, "share_type_access:is_public": true}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:00:37 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-ffbe70c1-cc07-47c6-accd-fc075594ab6b tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] http://10.27.203.238/share/v2/bb20757ddd604868aff8ad38db5def87/types returned with HTTP 200 May 28 13:00:37 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 932/1899] 10.27.203.238 () {66 vars in 1359 bytes} [Tue May 28 13:00:37 2024] POST /share/v2/bb20757ddd604868aff8ad38db5def87/types => generated 725 bytes in 20 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:00:37 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-e37a6642-7788-4265-b82f-f9a9c0e550cb tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] POST http://10.27.203.238/share/v2/bb20757ddd604868aff8ad38db5def87/types May 28 13:00:37 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-e37a6642-7788-4265-b82f-f9a9c0e550cb tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share_type": {"name": "tempest-support_any_az_share_type-1777389942", "extra_specs": {"driver_handles_share_servers": "False"}, "share_type_access:is_public": true}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:00:37 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-e37a6642-7788-4265-b82f-f9a9c0e550cb tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] http://10.27.203.238/share/v2/bb20757ddd604868aff8ad38db5def87/types returned with HTTP 200 May 28 13:00:37 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 968/1900] 10.27.203.238 () {66 vars in 1359 bytes} [Tue May 28 13:00:37 2024] POST /share/v2/bb20757ddd604868aff8ad38db5def87/types => generated 645 bytes in 21 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:00:37 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-22484d40-366a-4464-9b97-23b2df55212b tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] GET http://10.27.203.238/share/v2/bb20757ddd604868aff8ad38db5def87/types?extra_specs=%7B%27availability_zones%27%3A+%27az1%2C++az+3%27%7D May 28 13:00:37 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-22484d40-366a-4464-9b97-23b2df55212b tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:37 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-22484d40-366a-4464-9b97-23b2df55212b tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] Calling method 'ShareTypesController.index' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:37 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.share.share_types [None req-22484d40-366a-4464-9b97-23b2df55212b tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] Searching by: {'availability_zones': ['az1', 'az 3']} {{(pid=98330) get_all_types /opt/stack/manila/manila/share/share_types.py:146}} May 28 13:00:37 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-22484d40-366a-4464-9b97-23b2df55212b tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] http://10.27.203.238/share/v2/bb20757ddd604868aff8ad38db5def87/types?extra_specs=%7B%27availability_zones%27%3A+%27az1%2C++az+3%27%7D returned with HTTP 200 May 28 13:00:37 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 933/1901] 10.27.203.238 () {64 vars in 1466 bytes} [Tue May 28 13:00:37 2024] GET /share/v2/bb20757ddd604868aff8ad38db5def87/types?extra_specs=%7B%27availability_zones%27%3A+%27az1%2C++az+3%27%7D => generated 7927 bytes in 15 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:00:37 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-9d73e79c-c30a-4867-a2d2-04afd62fac52 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] DELETE http://10.27.203.238/share/v2/bb20757ddd604868aff8ad38db5def87/types/4828ba63-475b-449e-8b61-a5980ad6309d May 28 13:00:37 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-9d73e79c-c30a-4867-a2d2-04afd62fac52 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:37 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-9d73e79c-c30a-4867-a2d2-04afd62fac52 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] Calling method 'ShareTypesController._delete' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:37 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-9d73e79c-c30a-4867-a2d2-04afd62fac52 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] http://10.27.203.238/share/v2/bb20757ddd604868aff8ad38db5def87/types/4828ba63-475b-449e-8b61-a5980ad6309d returned with HTTP 202 May 28 13:00:37 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 969/1902] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:00:37 2024] DELETE /share/v2/bb20757ddd604868aff8ad38db5def87/types/4828ba63-475b-449e-8b61-a5980ad6309d => generated 0 bytes in 33 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 13:00:37 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-bfbdc80e-42b2-4eb8-a687-24319b46b4e2 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] GET http://10.27.203.238/share/v2/bb20757ddd604868aff8ad38db5def87/types/4828ba63-475b-449e-8b61-a5980ad6309d May 28 13:00:37 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-bfbdc80e-42b2-4eb8-a687-24319b46b4e2 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:37 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-bfbdc80e-42b2-4eb8-a687-24319b46b4e2 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] Calling method 'ShareTypesController.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:37 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-bfbdc80e-42b2-4eb8-a687-24319b46b4e2 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] HTTP exception thrown: Share type not found. May 28 13:00:37 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-bfbdc80e-42b2-4eb8-a687-24319b46b4e2 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] http://10.27.203.238/share/v2/bb20757ddd604868aff8ad38db5def87/types/4828ba63-475b-449e-8b61-a5980ad6309d returned with HTTP 404 May 28 13:00:37 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 934/1903] 10.27.203.238 () {64 vars in 1448 bytes} [Tue May 28 13:00:37 2024] GET /share/v2/bb20757ddd604868aff8ad38db5def87/types/4828ba63-475b-449e-8b61-a5980ad6309d => generated 67 bytes in 9 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 13:00:37 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-9e4d40e6-4b14-469e-82a2-8be64a392945 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] DELETE http://10.27.203.238/share/v2/bb20757ddd604868aff8ad38db5def87/types/31c009af-fac2-4c13-bb90-c2d75528143d May 28 13:00:37 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-9e4d40e6-4b14-469e-82a2-8be64a392945 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:37 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-9e4d40e6-4b14-469e-82a2-8be64a392945 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] Calling method 'ShareTypesController._delete' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:37 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-9e4d40e6-4b14-469e-82a2-8be64a392945 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] http://10.27.203.238/share/v2/bb20757ddd604868aff8ad38db5def87/types/31c009af-fac2-4c13-bb90-c2d75528143d returned with HTTP 202 May 28 13:00:37 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 970/1904] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:00:37 2024] DELETE /share/v2/bb20757ddd604868aff8ad38db5def87/types/31c009af-fac2-4c13-bb90-c2d75528143d => generated 0 bytes in 33 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 13:00:37 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-d80477be-82ec-40c4-a503-6824bc6a26cc tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] GET http://10.27.203.238/share/v2/bb20757ddd604868aff8ad38db5def87/types/31c009af-fac2-4c13-bb90-c2d75528143d May 28 13:00:37 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-d80477be-82ec-40c4-a503-6824bc6a26cc tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:37 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-d80477be-82ec-40c4-a503-6824bc6a26cc tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] Calling method 'ShareTypesController.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:37 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-d80477be-82ec-40c4-a503-6824bc6a26cc tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] HTTP exception thrown: Share type not found. May 28 13:00:37 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-d80477be-82ec-40c4-a503-6824bc6a26cc tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] http://10.27.203.238/share/v2/bb20757ddd604868aff8ad38db5def87/types/31c009af-fac2-4c13-bb90-c2d75528143d returned with HTTP 404 May 28 13:00:37 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 935/1905] 10.27.203.238 () {64 vars in 1448 bytes} [Tue May 28 13:00:37 2024] GET /share/v2/bb20757ddd604868aff8ad38db5def87/types/31c009af-fac2-4c13-bb90-c2d75528143d => generated 67 bytes in 10 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 13:00:37 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-91c0391e-dca1-44d5-bd11-10c8a83268f3 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] POST http://10.27.203.238/share/v2/bb20757ddd604868aff8ad38db5def87/types May 28 13:00:37 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-91c0391e-dca1-44d5-bd11-10c8a83268f3 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share_type": {"name": "tempest-support_some_azs_share_type-28022062", "extra_specs": {"driver_handles_share_servers": "False", "availability_zones": "az1, az2, az 3"}, "share_type_access:is_public": true}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:00:37 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-91c0391e-dca1-44d5-bd11-10c8a83268f3 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] http://10.27.203.238/share/v2/bb20757ddd604868aff8ad38db5def87/types returned with HTTP 200 May 28 13:00:37 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 971/1906] 10.27.203.238 () {66 vars in 1359 bytes} [Tue May 28 13:00:37 2024] POST /share/v2/bb20757ddd604868aff8ad38db5def87/types => generated 721 bytes in 21 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:00:37 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-15982d03-e630-4942-897f-d3bc88319224 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] POST http://10.27.203.238/share/v2/bb20757ddd604868aff8ad38db5def87/types May 28 13:00:37 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-15982d03-e630-4942-897f-d3bc88319224 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share_type": {"name": "tempest-support_any_az_share_type-55033640", "extra_specs": {"driver_handles_share_servers": "False"}, "share_type_access:is_public": true}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:00:37 l75lg1-v1 dstat.sh[49771]: 28-05 13:00:37| 13 1 81 4 0|5689M 1759M 278M 7899M| 17k 18k| 0 3260k| 0 460 |8789 14k|1.65 1.20 1.06| 0 1.0 0| 0 0 | 0 2048M| 29 362 0 46 2 May 28 13:00:37 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0b0e5f5a-fadc-40f6-b378-78c8005ec504 tempest-ShareRulesTest-1530341375 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:00:37 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0b0e5f5a-fadc-40f6-b378-78c8005ec504 tempest-ShareRulesTest-1530341375 None] [Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=1, created='2024-05-28T13:00:28.342982Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='ab44815a-6cee-4df3-a9a3-333372151587', id=44, internal=False, is_s3_default_policy=False, name='5eddb781-43d4-4883-ae43-e9856f3a4c10', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=['*'], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['203.0.113.77'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['203.0.113.77'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T13:00:35.756541Z', tenant_id=1, tenant_name='default', title='5eddb781-43d4-4883-ae43-e9856f3a4c10', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/44/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[])] May 28 13:00:37 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0b0e5f5a-fadc-40f6-b378-78c8005ec504 tempest-ShareRulesTest-1530341375 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 13:00:37 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-0b0e5f5a-fadc-40f6-b378-78c8005ec504 tempest-ShareRulesTest-1530341375 None] changing access on /manila/manila-5eddb781-43d4-4883-ae43-e9856f3a4c10. Rules: {'nfs_read_write': [], 'nfs_read_only': []} May 28 13:00:37 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0b0e5f5a-fadc-40f6-b378-78c8005ec504 tempest-ShareRulesTest-1530341375 None] >>> [PATCH] https://127.0.0.1:40443/api/viewpolicies/44/ May 28 13:00:37 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-15982d03-e630-4942-897f-d3bc88319224 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] http://10.27.203.238/share/v2/bb20757ddd604868aff8ad38db5def87/types returned with HTTP 200 May 28 13:00:37 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0b0e5f5a-fadc-40f6-b378-78c8005ec504 tempest-ShareRulesTest-1530341375 None] {'data': '{"name": "5eddb781-43d4-4883-ae43-e9856f3a4c10", "nfs_no_squash": ' May 28 13:00:37 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 936/1907] 10.27.203.238 () {66 vars in 1359 bytes} [Tue May 28 13:00:37 2024] POST /share/v2/bb20757ddd604868aff8ad38db5def87/types => generated 641 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:00:37 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0b0e5f5a-fadc-40f6-b378-78c8005ec504 tempest-ShareRulesTest-1530341375 None] '["*"], "nfs_root_squash": ["*"], "nfs_read_write": [], ' May 28 13:00:37 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0b0e5f5a-fadc-40f6-b378-78c8005ec504 tempest-ShareRulesTest-1530341375 None] '"nfs_read_only": []}', May 28 13:00:37 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0b0e5f5a-fadc-40f6-b378-78c8005ec504 tempest-ShareRulesTest-1530341375 None] 'params': None} May 28 13:00:37 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-bb2f57ec-6c76-4b6e-bf04-82b45e803368 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] GET http://10.27.203.238/share/v2/bb20757ddd604868aff8ad38db5def87/types?extra_specs=%7B%27availability_zones%27%3A+%27az+3%2C+az1%27%7D May 28 13:00:37 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-bb2f57ec-6c76-4b6e-bf04-82b45e803368 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:37 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-bb2f57ec-6c76-4b6e-bf04-82b45e803368 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] Calling method 'ShareTypesController.index' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:37 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.share.share_types [None req-bb2f57ec-6c76-4b6e-bf04-82b45e803368 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] Searching by: {'availability_zones': ['az 3', 'az1']} {{(pid=98329) get_all_types /opt/stack/manila/manila/share/share_types.py:146}} May 28 13:00:37 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-bb2f57ec-6c76-4b6e-bf04-82b45e803368 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] http://10.27.203.238/share/v2/bb20757ddd604868aff8ad38db5def87/types?extra_specs=%7B%27availability_zones%27%3A+%27az+3%2C+az1%27%7D returned with HTTP 200 May 28 13:00:37 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 972/1908] 10.27.203.238 () {64 vars in 1464 bytes} [Tue May 28 13:00:37 2024] GET /share/v2/bb20757ddd604868aff8ad38db5def87/types?extra_specs=%7B%27availability_zones%27%3A+%27az+3%2C+az1%27%7D => generated 7919 bytes in 15 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:00:37 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-f389f10a-525c-4b51-b586-1d84286bf755 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] DELETE http://10.27.203.238/share/v2/bb20757ddd604868aff8ad38db5def87/types/1f2562f8-294b-4b09-94b4-71cf3b21b664 May 28 13:00:37 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-f389f10a-525c-4b51-b586-1d84286bf755 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:37 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-f389f10a-525c-4b51-b586-1d84286bf755 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] Calling method 'ShareTypesController._delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:37 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-f389f10a-525c-4b51-b586-1d84286bf755 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] http://10.27.203.238/share/v2/bb20757ddd604868aff8ad38db5def87/types/1f2562f8-294b-4b09-94b4-71cf3b21b664 returned with HTTP 202 May 28 13:00:37 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 937/1909] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:00:37 2024] DELETE /share/v2/bb20757ddd604868aff8ad38db5def87/types/1f2562f8-294b-4b09-94b4-71cf3b21b664 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 13:00:37 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-6ee64838-8ae7-4106-a2b2-a53cf55ddd92 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] GET http://10.27.203.238/share/v2/bb20757ddd604868aff8ad38db5def87/types/1f2562f8-294b-4b09-94b4-71cf3b21b664 May 28 13:00:37 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-6ee64838-8ae7-4106-a2b2-a53cf55ddd92 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:37 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-6ee64838-8ae7-4106-a2b2-a53cf55ddd92 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] Calling method 'ShareTypesController.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:37 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-6ee64838-8ae7-4106-a2b2-a53cf55ddd92 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] HTTP exception thrown: Share type not found. May 28 13:00:37 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-6ee64838-8ae7-4106-a2b2-a53cf55ddd92 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] http://10.27.203.238/share/v2/bb20757ddd604868aff8ad38db5def87/types/1f2562f8-294b-4b09-94b4-71cf3b21b664 returned with HTTP 404 May 28 13:00:37 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 973/1910] 10.27.203.238 () {64 vars in 1448 bytes} [Tue May 28 13:00:37 2024] GET /share/v2/bb20757ddd604868aff8ad38db5def87/types/1f2562f8-294b-4b09-94b4-71cf3b21b664 => generated 67 bytes in 10 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 13:00:37 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-d5bb53f8-c5d4-4878-840f-96fe0d0fe2b9 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] DELETE http://10.27.203.238/share/v2/bb20757ddd604868aff8ad38db5def87/types/39108131-b027-42e1-8a6b-01372b0a06c1 May 28 13:00:37 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-d5bb53f8-c5d4-4878-840f-96fe0d0fe2b9 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:37 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-d5bb53f8-c5d4-4878-840f-96fe0d0fe2b9 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] Calling method 'ShareTypesController._delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:37 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-d5bb53f8-c5d4-4878-840f-96fe0d0fe2b9 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] http://10.27.203.238/share/v2/bb20757ddd604868aff8ad38db5def87/types/39108131-b027-42e1-8a6b-01372b0a06c1 returned with HTTP 202 May 28 13:00:37 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 938/1911] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:00:37 2024] DELETE /share/v2/bb20757ddd604868aff8ad38db5def87/types/39108131-b027-42e1-8a6b-01372b0a06c1 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 13:00:37 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-6c5159bf-af55-49de-9e96-5101a7b215bf tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] GET http://10.27.203.238/share/v2/bb20757ddd604868aff8ad38db5def87/types/39108131-b027-42e1-8a6b-01372b0a06c1 May 28 13:00:37 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-6c5159bf-af55-49de-9e96-5101a7b215bf tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:37 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-6c5159bf-af55-49de-9e96-5101a7b215bf tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] Calling method 'ShareTypesController.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:37 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-6c5159bf-af55-49de-9e96-5101a7b215bf tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] HTTP exception thrown: Share type not found. May 28 13:00:37 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-6c5159bf-af55-49de-9e96-5101a7b215bf tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] http://10.27.203.238/share/v2/bb20757ddd604868aff8ad38db5def87/types/39108131-b027-42e1-8a6b-01372b0a06c1 returned with HTTP 404 May 28 13:00:37 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 974/1912] 10.27.203.238 () {64 vars in 1448 bytes} [Tue May 28 13:00:37 2024] GET /share/v2/bb20757ddd604868aff8ad38db5def87/types/39108131-b027-42e1-8a6b-01372b0a06c1 => generated 67 bytes in 10 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 13:00:37 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-d80037a9-b8d2-4087-8b2e-55e600d560ed tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] POST http://10.27.203.238/share/v2/bb20757ddd604868aff8ad38db5def87/types May 28 13:00:37 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-d80037a9-b8d2-4087-8b2e-55e600d560ed tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share_type": {"name": "tempest-support_some_azs_share_type-143640366", "extra_specs": {"driver_handles_share_servers": "False", "availability_zones": "az1, az2, az 3"}, "share_type_access:is_public": true}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:00:37 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-d80037a9-b8d2-4087-8b2e-55e600d560ed tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] http://10.27.203.238/share/v2/bb20757ddd604868aff8ad38db5def87/types returned with HTTP 200 May 28 13:00:37 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 939/1913] 10.27.203.238 () {66 vars in 1359 bytes} [Tue May 28 13:00:37 2024] POST /share/v2/bb20757ddd604868aff8ad38db5def87/types => generated 723 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:00:37 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-187bd993-771c-42eb-8907-647d62a1dd5e tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] POST http://10.27.203.238/share/v2/bb20757ddd604868aff8ad38db5def87/types May 28 13:00:37 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-187bd993-771c-42eb-8907-647d62a1dd5e tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share_type": {"name": "tempest-support_any_az_share_type-178985633", "extra_specs": {"driver_handles_share_servers": "False"}, "share_type_access:is_public": true}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:00:37 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-187bd993-771c-42eb-8907-647d62a1dd5e tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] http://10.27.203.238/share/v2/bb20757ddd604868aff8ad38db5def87/types returned with HTTP 200 May 28 13:00:37 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 975/1914] 10.27.203.238 () {66 vars in 1359 bytes} [Tue May 28 13:00:37 2024] POST /share/v2/bb20757ddd604868aff8ad38db5def87/types => generated 643 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:00:37 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-700b05aa-22fc-45eb-a804-daded5e71135 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] GET http://10.27.203.238/share/v2/bb20757ddd604868aff8ad38db5def87/types?extra_specs=%7B%27availability_zones%27%3A+%27az2%2C+az+3%2C+az1%27%7D May 28 13:00:37 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-700b05aa-22fc-45eb-a804-daded5e71135 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:37 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-700b05aa-22fc-45eb-a804-daded5e71135 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] Calling method 'ShareTypesController.index' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:37 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.share.share_types [None req-700b05aa-22fc-45eb-a804-daded5e71135 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] Searching by: {'availability_zones': ['az2', 'az 3', 'az1']} {{(pid=98330) get_all_types /opt/stack/manila/manila/share/share_types.py:146}} May 28 13:00:37 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-700b05aa-22fc-45eb-a804-daded5e71135 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] http://10.27.203.238/share/v2/bb20757ddd604868aff8ad38db5def87/types?extra_specs=%7B%27availability_zones%27%3A+%27az2%2C+az+3%2C+az1%27%7D returned with HTTP 200 May 28 13:00:37 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 940/1915] 10.27.203.238 () {64 vars in 1478 bytes} [Tue May 28 13:00:37 2024] GET /share/v2/bb20757ddd604868aff8ad38db5def87/types?extra_specs=%7B%27availability_zones%27%3A+%27az2%2C+az+3%2C+az1%27%7D => generated 7923 bytes in 17 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:00:37 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-e0879e3a-b3ad-4d98-87c1-37398d05065a tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] DELETE http://10.27.203.238/share/v2/bb20757ddd604868aff8ad38db5def87/types/4e178303-0022-47e8-8238-88bca60f395c May 28 13:00:37 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-e0879e3a-b3ad-4d98-87c1-37398d05065a tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:37 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-e0879e3a-b3ad-4d98-87c1-37398d05065a tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] Calling method 'ShareTypesController._delete' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:37 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8b4f0fd1-edd5-4fef-976a-4a87ae5862d3 tempest-ShareTransferNegativeTest-884271560 None] <<< [DELETE] https://127.0.0.1:40443/api/quotas/39/ May 28 13:00:37 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8b4f0fd1-edd5-4fef-976a-4a87ae5862d3 tempest-ShareTransferNegativeTest-884271560 None] --- [DELETE] https://127.0.0.1:40443/api/quotas/39/: Done May 28 13:00:37 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8b4f0fd1-edd5-4fef-976a-4a87ae5862d3 tempest-ShareTransferNegativeTest-884271560 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:00:37 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8b4f0fd1-edd5-4fef-976a-4a87ae5862d3 tempest-ShareTransferNegativeTest-884271560 None] {'allow_redirects': True, May 28 13:00:37 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8b4f0fd1-edd5-4fef-976a-4a87ae5862d3 tempest-ShareTransferNegativeTest-884271560 None] 'params': {'name': 'f8e9c921-56e5-4b4a-a619-44221b8150a3'}} May 28 13:00:37 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-e0879e3a-b3ad-4d98-87c1-37398d05065a tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] http://10.27.203.238/share/v2/bb20757ddd604868aff8ad38db5def87/types/4e178303-0022-47e8-8238-88bca60f395c returned with HTTP 202 May 28 13:00:37 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 976/1916] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:00:37 2024] DELETE /share/v2/bb20757ddd604868aff8ad38db5def87/types/4e178303-0022-47e8-8238-88bca60f395c => generated 0 bytes in 84 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 13:00:37 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-4444a791-8f15-4b76-967f-0779f23353ad tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] GET http://10.27.203.238/share/v2/bb20757ddd604868aff8ad38db5def87/types/4e178303-0022-47e8-8238-88bca60f395c May 28 13:00:37 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-4444a791-8f15-4b76-967f-0779f23353ad tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:37 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-4444a791-8f15-4b76-967f-0779f23353ad tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] Calling method 'ShareTypesController.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:37 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-4444a791-8f15-4b76-967f-0779f23353ad tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] HTTP exception thrown: Share type not found. May 28 13:00:37 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-4444a791-8f15-4b76-967f-0779f23353ad tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] http://10.27.203.238/share/v2/bb20757ddd604868aff8ad38db5def87/types/4e178303-0022-47e8-8238-88bca60f395c returned with HTTP 404 May 28 13:00:37 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 941/1917] 10.27.203.238 () {64 vars in 1448 bytes} [Tue May 28 13:00:37 2024] GET /share/v2/bb20757ddd604868aff8ad38db5def87/types/4e178303-0022-47e8-8238-88bca60f395c => generated 67 bytes in 12 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 13:00:37 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-fc9ff316-9223-4aee-8d32-e6677ef467cb tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] DELETE http://10.27.203.238/share/v2/bb20757ddd604868aff8ad38db5def87/types/17242148-5508-40cf-99a0-6937edfca0f3 May 28 13:00:37 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-fc9ff316-9223-4aee-8d32-e6677ef467cb tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:37 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-fc9ff316-9223-4aee-8d32-e6677ef467cb tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] Calling method 'ShareTypesController._delete' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:37 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-fc9ff316-9223-4aee-8d32-e6677ef467cb tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] http://10.27.203.238/share/v2/bb20757ddd604868aff8ad38db5def87/types/17242148-5508-40cf-99a0-6937edfca0f3 returned with HTTP 202 May 28 13:00:37 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 977/1918] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:00:37 2024] DELETE /share/v2/bb20757ddd604868aff8ad38db5def87/types/17242148-5508-40cf-99a0-6937edfca0f3 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 13:00:37 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-39d90913-56f2-4e30-aa60-128199bb6813 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] GET http://10.27.203.238/share/v2/bb20757ddd604868aff8ad38db5def87/types/17242148-5508-40cf-99a0-6937edfca0f3 May 28 13:00:37 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-39d90913-56f2-4e30-aa60-128199bb6813 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:37 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-39d90913-56f2-4e30-aa60-128199bb6813 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] Calling method 'ShareTypesController.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:37 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-39d90913-56f2-4e30-aa60-128199bb6813 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] HTTP exception thrown: Share type not found. May 28 13:00:37 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-39d90913-56f2-4e30-aa60-128199bb6813 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] http://10.27.203.238/share/v2/bb20757ddd604868aff8ad38db5def87/types/17242148-5508-40cf-99a0-6937edfca0f3 returned with HTTP 404 May 28 13:00:37 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 942/1919] 10.27.203.238 () {64 vars in 1448 bytes} [Tue May 28 13:00:37 2024] GET /share/v2/bb20757ddd604868aff8ad38db5def87/types/17242148-5508-40cf-99a0-6937edfca0f3 => generated 67 bytes in 10 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 13:00:37 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-dc7b45a0-4487-4996-a275-da8f8b9b3600 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] PUT http://10.27.203.238/share/v2/bb20757ddd604868aff8ad38db5def87/types/7d2ea8e8-bada-4826-a8a8-53b4e9ff301f/extra_specs/availability_zones May 28 13:00:37 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-dc7b45a0-4487-4996-a275-da8f8b9b3600 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] Action: 'update', calling method: ShareTypeExtraSpecsController.update, body: {"availability_zones": "nova"} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:00:37 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-dc7b45a0-4487-4996-a275-da8f8b9b3600 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] http://10.27.203.238/share/v2/bb20757ddd604868aff8ad38db5def87/types/7d2ea8e8-bada-4826-a8a8-53b4e9ff301f/extra_specs/availability_zones returned with HTTP 200 May 28 13:00:37 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 978/1920] 10.27.203.238 () {66 vars in 1561 bytes} [Tue May 28 13:00:37 2024] PUT /share/v2/bb20757ddd604868aff8ad38db5def87/types/7d2ea8e8-bada-4826-a8a8-53b4e9ff301f/extra_specs/availability_zones => generated 30 bytes in 31 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:00:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631c213f-672d-44a7-9079-fa04987d0ab0 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-631c213f-672d-44a7-9079-fa04987d0ab0 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:00:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631c213f-672d-44a7-9079-fa04987d0ab0 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354b53bd-84c2-40fb-a378-83d789c6442c service manila] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f110cf6300f049c897d0aab63218d1e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354b53bd-84c2-40fb-a378-83d789c6442c service manila] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354b53bd-84c2-40fb-a378-83d789c6442c service manila] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354b53bd-84c2-40fb-a378-83d789c6442c service manila] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354b53bd-84c2-40fb-a378-83d789c6442c service manila] RBAC: Authorizing `identity:validate_token()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354b53bd-84c2-40fb-a378-83d789c6442c service manila] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:37 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1465/2901] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 13:00:37 2024] GET /identity/v3/auth/tokens => generated 3968 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 13:00:37 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-e060b217-e2ee-419c-8f77-9c4452fd8ed0 tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] POST http://10.27.203.238/share/v2/284d76edec3144579d6fb3f6dbc0dd4e/shares May 28 13:00:37 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-e060b217-e2ee-419c-8f77-9c4452fd8ed0 tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share": {"share_proto": "nfs", "description": "Tempest's share", "snapshot_id": null, "name": "tempest-tempest-created-share-1923793792", "size": 1, "metadata": {}, "is_public": false, "share_type": "7d2ea8e8-bada-4826-a8a8-53b4e9ff301f"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:00:37 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.v1.shares [None req-e060b217-e2ee-419c-8f77-9c4452fd8ed0 tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] Create NFS share of 1 GB May 28 13:00:37 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-87fcda57-3249-45c2-8a4b-05b7f7b269c6 tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] GET http://10.27.203.238/share/v2/cac556dc39a14bbdbdbabfc80672fb1f/shares/03abb6c7-1707-45b3-a692-3b1de0dd1fba May 28 13:00:37 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-87fcda57-3249-45c2-8a4b-05b7f7b269c6 tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:37 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-87fcda57-3249-45c2-8a4b-05b7f7b269c6 tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:37 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8b4f0fd1-edd5-4fef-976a-4a87ae5862d3 tempest-ShareTransferNegativeTest-884271560 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:00:37 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8b4f0fd1-edd5-4fef-976a-4a87ae5862d3 tempest-ShareTransferNegativeTest-884271560 None] [Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=0, created='2024-05-28T13:00:10.875276Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='002017a6-3153-41e2-8337-4a4b751666b1', id=42, internal=False, is_s3_default_policy=False, name='f8e9c921-56e5-4b4a-a619-44221b8150a3', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=[], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['*'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['*'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T13:00:11.399026Z', tenant_id=1, tenant_name='default', title='f8e9c921-56e5-4b4a-a619-44221b8150a3', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/42/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[])] May 28 13:00:37 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8b4f0fd1-edd5-4fef-976a-4a87ae5862d3 tempest-ShareTransferNegativeTest-884271560 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 13:00:37 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8b4f0fd1-edd5-4fef-976a-4a87ae5862d3 tempest-ShareTransferNegativeTest-884271560 None] >>> [DELETE] https://127.0.0.1:40443/api/viewpolicies/42/ May 28 13:00:37 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.quota [None req-e060b217-e2ee-419c-8f77-9c4452fd8ed0 tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] Created reservations ['0b425e77-60bb-409f-a114-a3b786174007', '556fd475-1aea-45a9-9be7-7ac21fd92a47', '452125d0-02e2-4d53-934f-df041418965e', '26932ed1-370d-479c-a00a-f284dbf58704'] {{(pid=98330) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 13:00:37 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-87fcda57-3249-45c2-8a4b-05b7f7b269c6 tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] http://10.27.203.238/share/v2/cac556dc39a14bbdbdbabfc80672fb1f/shares/03abb6c7-1707-45b3-a692-3b1de0dd1fba returned with HTTP 200 May 28 13:00:37 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 979/1921] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:00:37 2024] GET /share/v2/cac556dc39a14bbdbdbabfc80672fb1f/shares/03abb6c7-1707-45b3-a692-3b1de0dd1fba => generated 1315 bytes in 29 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:00:37 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.quota [None req-e060b217-e2ee-419c-8f77-9c4452fd8ed0 tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] Committed reservations ['0b425e77-60bb-409f-a114-a3b786174007', '556fd475-1aea-45a9-9be7-7ac21fd92a47', '452125d0-02e2-4d53-934f-df041418965e', '26932ed1-370d-479c-a00a-f284dbf58704'] {{(pid=98330) commit /opt/stack/manila/manila/quota.py:1063}} May 28 13:00:37 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.host_manager [None req-e060b217-e2ee-419c-8f77-9c4452fd8ed0 tempest-ShareTypeAvailabilityZonesTest-364532124 None] Share service is down. (host: l75lg1-v1@generic2). May 28 13:00:37 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.host_manager [None req-e060b217-e2ee-419c-8f77-9c4452fd8ed0 tempest-ShareTypeAvailabilityZonesTest-364532124 None] Share service is down. (host: l75lg1-v1@generic1). May 28 13:00:37 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-e060b217-e2ee-419c-8f77-9c4452fd8ed0 tempest-ShareTypeAvailabilityZonesTest-364532124 None] Starting with 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:80}} May 28 13:00:37 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-e060b217-e2ee-419c-8f77-9c4452fd8ed0 tempest-ShareTypeAvailabilityZonesTest-364532124 None] Filter OnlyHostFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:00:37 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-e060b217-e2ee-419c-8f77-9c4452fd8ed0 tempest-ShareTypeAvailabilityZonesTest-364532124 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:00:37 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.capacity [None req-e060b217-e2ee-419c-8f77-9c4452fd8ed0 tempest-ShareTypeAvailabilityZonesTest-364532124 None] Space information for share creation on host l75lg1-v1@vast#vast (requested / avail): 1/2075 {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/capacity.py:83}} May 28 13:00:37 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-e060b217-e2ee-419c-8f77-9c4452fd8ed0 tempest-ShareTypeAvailabilityZonesTest-364532124 None] Filter CapacityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:00:37 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-e060b217-e2ee-419c-8f77-9c4452fd8ed0 tempest-ShareTypeAvailabilityZonesTest-364532124 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:00:37 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-e060b217-e2ee-419c-8f77-9c4452fd8ed0 tempest-ShareTypeAvailabilityZonesTest-364532124 None] Driver Filter: Checking host 'l75lg1-v1@vast#vast' {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:37}} May 28 13:00:37 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-e060b217-e2ee-419c-8f77-9c4452fd8ed0 tempest-ShareTypeAvailabilityZonesTest-364532124 None] Filter function not set :: passing host. {{(pid=98327) _check_filter_function /opt/stack/manila/manila/scheduler/filters/driver.py:53}} May 28 13:00:37 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-e060b217-e2ee-419c-8f77-9c4452fd8ed0 tempest-ShareTypeAvailabilityZonesTest-364532124 None] Result: True {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:40}} May 28 13:00:37 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-e060b217-e2ee-419c-8f77-9c4452fd8ed0 tempest-ShareTypeAvailabilityZonesTest-364532124 None] Done checking host 'l75lg1-v1@vast#vast' {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:41}} May 28 13:00:37 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-e060b217-e2ee-419c-8f77-9c4452fd8ed0 tempest-ShareTypeAvailabilityZonesTest-364532124 None] Filter DriverFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:00:37 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-e060b217-e2ee-419c-8f77-9c4452fd8ed0 tempest-ShareTypeAvailabilityZonesTest-364532124 None] Filter ShareReplicationFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:00:37 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-e060b217-e2ee-419c-8f77-9c4452fd8ed0 tempest-ShareTypeAvailabilityZonesTest-364532124 None] Filter CreateFromSnapshotFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:00:37 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-e060b217-e2ee-419c-8f77-9c4452fd8ed0 tempest-ShareTypeAvailabilityZonesTest-364532124 None] Filter AffinityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:00:37 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-e060b217-e2ee-419c-8f77-9c4452fd8ed0 tempest-ShareTypeAvailabilityZonesTest-364532124 None] Filter AntiAffinityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:00:37 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.drivers.filter [None req-e060b217-e2ee-419c-8f77-9c4452fd8ed0 tempest-ShareTypeAvailabilityZonesTest-364532124 None] Filtered share [host: 'l75lg1-v1@vast#vast', free_capacity_gb: 2075.6478263456374, pools: None] {{(pid=98327) _schedule_share /opt/stack/manila/manila/scheduler/drivers/filter.py:268}} May 28 13:00:37 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-e060b217-e2ee-419c-8f77-9c4452fd8ed0 tempest-ShareTypeAvailabilityZonesTest-364532124 None] Checking host 'l75lg1-v1@vast#vast' {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:46}} May 28 13:00:37 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.weighers.goodness [None req-e060b217-e2ee-419c-8f77-9c4452fd8ed0 tempest-ShareTypeAvailabilityZonesTest-364532124 None] Goodness function not set :: defaulting to minimal goodness rating of 0. May 28 13:00:37 l75lg1-v1 manila-scheduler[98327]: INFO manila.scheduler.weighers.goodness [None req-e060b217-e2ee-419c-8f77-9c4452fd8ed0 tempest-ShareTypeAvailabilityZonesTest-364532124 None] Goodness function result for host l75lg1-v1@vast#vast: 0. May 28 13:00:37 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-e060b217-e2ee-419c-8f77-9c4452fd8ed0 tempest-ShareTypeAvailabilityZonesTest-364532124 None] Goodness: 0 {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:48}} May 28 13:00:37 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-e060b217-e2ee-419c-8f77-9c4452fd8ed0 tempest-ShareTypeAvailabilityZonesTest-364532124 None] Done checking host 'l75lg1-v1@vast#vast' {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:49}} May 28 13:00:37 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.drivers.filter [None req-e060b217-e2ee-419c-8f77-9c4452fd8ed0 tempest-ShareTypeAvailabilityZonesTest-364532124 None] Choosing for share: WeighedHost [host: l75lg1-v1@vast#vast, weight: 0.0] {{(pid=98327) _schedule_share /opt/stack/manila/manila/scheduler/drivers/filter.py:274}} May 28 13:00:37 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-e060b217-e2ee-419c-8f77-9c4452fd8ed0 tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] http://10.27.203.238/share/v2/284d76edec3144579d6fb3f6dbc0dd4e/shares returned with HTTP 200 May 28 13:00:37 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 943/1922] 10.27.203.238 () {66 vars in 1362 bytes} [Tue May 28 13:00:37 2024] POST /share/v2/284d76edec3144579d6fb3f6dbc0dd4e/shares => generated 1206 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:00:38 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-fa773952-fcbf-4e95-acab-3b97a0254c62 tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] GET http://10.27.203.238/share/v2/284d76edec3144579d6fb3f6dbc0dd4e/shares/da80429c-1281-4450-a386-ed0e9d82a3ff May 28 13:00:38 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-fa773952-fcbf-4e95-acab-3b97a0254c62 tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:38 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-fa773952-fcbf-4e95-acab-3b97a0254c62 tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:38 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-fa773952-fcbf-4e95-acab-3b97a0254c62 tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] http://10.27.203.238/share/v2/284d76edec3144579d6fb3f6dbc0dd4e/shares/da80429c-1281-4450-a386-ed0e9d82a3ff returned with HTTP 200 May 28 13:00:38 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 980/1923] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:00:37 2024] GET /share/v2/284d76edec3144579d6fb3f6dbc0dd4e/shares/da80429c-1281-4450-a386-ed0e9d82a3ff => generated 1312 bytes in 28 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:00:38 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e060b217-e2ee-419c-8f77-9c4452fd8ed0 tempest-ShareTypeAvailabilityZonesTest-364532124 None] >>> [GET] https://127.0.0.1:40443/api/vippools/ May 28 13:00:38 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e060b217-e2ee-419c-8f77-9c4452fd8ed0 tempest-ShareTypeAvailabilityZonesTest-364532124 None] {'allow_redirects': True, 'params': {'name': 'vippool-1'}} May 28 13:00:38 l75lg1-v1 dstat.sh[49771]: 28-05 13:00:38| 8 1 82 8 0|5689M 1759M 278M 7899M| 26k 8902B| 0 8916k| 0 790 |8021 13k|1.65 1.20 1.06|1.0 1.0 2.0| 0 0 | 0 2048M| 29 361 0 44 2 May 28 13:00:38 l75lg1-v1 neutron-server[77623]: DEBUG neutron.db.agents_db [None req-fe40ce8c-640e-4db7-a17a-6e8888cce266 None None] Agent healthcheck: found 0 active agents {{(pid=77623) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:319}} May 28 13:00:38 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e060b217-e2ee-419c-8f77-9c4452fd8ed0 tempest-ShareTypeAvailabilityZonesTest-364532124 None] <<< [GET] https://127.0.0.1:40443/api/vippools/ May 28 13:00:38 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e060b217-e2ee-419c-8f77-9c4452fd8ed0 tempest-ShareTypeAvailabilityZonesTest-364532124 None] [Bunch(active_cnode_ids=[], active_interfaces=4, cluster='loop75-kfs', cluster_id=1, cnode_ids=[], cnodes=[], domain_name='vippool-1', enable_l3=False, enable_weighted_balancing=False, enabled=True, end_ip='172.21.75.4', guid='f2abaede-b397-413a-8faa-3aeead6d3b28', gw_ip='', gw_ipv6='', id=2, ip_ranges=[['172.21.75.1', '172.21.75.4']], name='vippool-1', peer_asn=0, port_membership='ALL', ranges_summary='172.21.75.[1-4]', role='PROTOCOLS', start_ip='172.21.75.1', subnet_cidr=16, subnet_cidr_ipv6=None, sync='SYNCED', sync_time='2024-05-28T12:50:09.644123Z', tenant_id=1, tenant_name='default', title='172.21.75.1 - 172.21.75.4', url='https://127.0.0.1:40443/api/vippools/2/', vast_asn=0, vlan=0, vms_preferred=False)] May 28 13:00:38 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e060b217-e2ee-419c-8f77-9c4452fd8ed0 tempest-ShareTypeAvailabilityZonesTest-364532124 None] --- [GET] https://127.0.0.1:40443/api/vippools/: Done May 28 13:00:38 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e060b217-e2ee-419c-8f77-9c4452fd8ed0 tempest-ShareTypeAvailabilityZonesTest-364532124 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:00:38 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e060b217-e2ee-419c-8f77-9c4452fd8ed0 tempest-ShareTypeAvailabilityZonesTest-364532124 None] {'allow_redirects': True, May 28 13:00:38 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e060b217-e2ee-419c-8f77-9c4452fd8ed0 tempest-ShareTypeAvailabilityZonesTest-364532124 None] 'params': {'name': '946d9bf7-603c-4faa-8dbe-2cf88c9c8291'}} May 28 13:00:39 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0b0e5f5a-fadc-40f6-b378-78c8005ec504 tempest-ShareRulesTest-1530341375 None] <<< [PATCH] https://127.0.0.1:40443/api/viewpolicies/44/ May 28 13:00:39 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0b0e5f5a-fadc-40f6-b378-78c8005ec504 tempest-ShareRulesTest-1530341375 None] Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=1, created='2024-05-28T13:00:28.342982Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='ab44815a-6cee-4df3-a9a3-333372151587', id=44, internal=False, is_s3_default_policy=False, name='5eddb781-43d4-4883-ae43-e9856f3a4c10', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=['*'], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=[], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=[], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='MODIFYING', sync_time='2024-05-28T13:00:38.498655Z', tenant_id=1, tenant_name='default', title='5eddb781-43d4-4883-ae43-e9856f3a4c10', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/44/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[]) May 28 13:00:39 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0b0e5f5a-fadc-40f6-b378-78c8005ec504 tempest-ShareRulesTest-1530341375 None] --- [PATCH] https://127.0.0.1:40443/api/viewpolicies/44/: Done May 28 13:00:39 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-0b0e5f5a-fadc-40f6-b378-78c8005ec504 tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_5eddb781-43d4-4883-ae43-e9856f3a4c10" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:00:39 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-0b0e5f5a-fadc-40f6-b378-78c8005ec504 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_5eddb781-43d4-4883-ae43-e9856f3a4c10" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:00:39 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e060b217-e2ee-419c-8f77-9c4452fd8ed0 tempest-ShareTypeAvailabilityZonesTest-364532124 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:00:39 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e060b217-e2ee-419c-8f77-9c4452fd8ed0 tempest-ShareTypeAvailabilityZonesTest-364532124 None] [] May 28 13:00:39 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e060b217-e2ee-419c-8f77-9c4452fd8ed0 tempest-ShareTypeAvailabilityZonesTest-364532124 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 13:00:39 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e060b217-e2ee-419c-8f77-9c4452fd8ed0 tempest-ShareTypeAvailabilityZonesTest-364532124 None] >>> [POST] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:00:39 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e060b217-e2ee-419c-8f77-9c4452fd8ed0 tempest-ShareTypeAvailabilityZonesTest-364532124 None] {'data': '{"name": "946d9bf7-603c-4faa-8dbe-2cf88c9c8291"}', May 28 13:00:39 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e060b217-e2ee-419c-8f77-9c4452fd8ed0 tempest-ShareTypeAvailabilityZonesTest-364532124 None] 'json': None, May 28 13:00:39 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e060b217-e2ee-419c-8f77-9c4452fd8ed0 tempest-ShareTypeAvailabilityZonesTest-364532124 None] 'params': None} May 28 13:00:39 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-0b0e5f5a-fadc-40f6-b378-78c8005ec504 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_5eddb781-43d4-4883-ae43-e9856f3a4c10" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.033s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:00:39 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-0b0e5f5a-fadc-40f6-b378-78c8005ec504 tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_5eddb781-43d4-4883-ae43-e9856f3a4c10" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:00:39 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-0b0e5f5a-fadc-40f6-b378-78c8005ec504 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_5eddb781-43d4-4883-ae43-e9856f3a4c10" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:00:39 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-0b0e5f5a-fadc-40f6-b378-78c8005ec504 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_5eddb781-43d4-4883-ae43-e9856f3a4c10" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.031s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:00:39 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-0b0e5f5a-fadc-40f6-b378-78c8005ec504 tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_5eddb781-43d4-4883-ae43-e9856f3a4c10" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:00:39 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-0b0e5f5a-fadc-40f6-b378-78c8005ec504 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_5eddb781-43d4-4883-ae43-e9856f3a4c10" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:00:39 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-0b0e5f5a-fadc-40f6-b378-78c8005ec504 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_5eddb781-43d4-4883-ae43-e9856f3a4c10" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:00:39 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-0b0e5f5a-fadc-40f6-b378-78c8005ec504 tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_5eddb781-43d4-4883-ae43-e9856f3a4c10" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:00:39 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-0b0e5f5a-fadc-40f6-b378-78c8005ec504 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_5eddb781-43d4-4883-ae43-e9856f3a4c10" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:00:39 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-0b0e5f5a-fadc-40f6-b378-78c8005ec504 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_5eddb781-43d4-4883-ae43-e9856f3a4c10" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:00:39 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-0b0e5f5a-fadc-40f6-b378-78c8005ec504 tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_5eddb781-43d4-4883-ae43-e9856f3a4c10" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:00:39 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-0b0e5f5a-fadc-40f6-b378-78c8005ec504 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_5eddb781-43d4-4883-ae43-e9856f3a4c10" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:00:39 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-0b0e5f5a-fadc-40f6-b378-78c8005ec504 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_5eddb781-43d4-4883-ae43-e9856f3a4c10" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.037s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:00:39 l75lg1-v1 manila-share[98474]: INFO manila.share.access [None req-0b0e5f5a-fadc-40f6-b378-78c8005ec504 tempest-ShareRulesTest-1530341375 None] Access rules were successfully modified for share instance 5eddb781-43d4-4883-ae43-e9856f3a4c10 belonging to share f4283c2a-3835-416e-9703-f5745babbf5c. May 28 13:00:39 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-0b0e5f5a-fadc-40f6-b378-78c8005ec504 tempest-ShareRulesTest-1530341375 None] deleting '/manila/manila-5eddb781-43d4-4883-ae43-e9856f3a4c10' May 28 13:00:39 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0b0e5f5a-fadc-40f6-b378-78c8005ec504 tempest-ShareRulesTest-1530341375 None] >>> [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/ May 28 13:00:39 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0b0e5f5a-fadc-40f6-b378-78c8005ec504 tempest-ShareRulesTest-1530341375 None] {'data': '{"path": "/manila/manila-5eddb781-43d4-4883-ae43-e9856f3a4c10"}', May 28 13:00:39 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0b0e5f5a-fadc-40f6-b378-78c8005ec504 tempest-ShareRulesTest-1530341375 None] 'params': None} May 28 13:00:39 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-4c856168-322f-4ce4-8d37-d113b67643d5 tempest-UserMessageNegativeTest-781603078 tempest-UserMessageNegativeTest-781603078-project-member] GET http://10.27.203.238/share/v2/ca9b4c5f200844bdbcc6db13e907f21e/shares/431c69fe-4a0e-48fc-ac60-0aa49079e1b2 May 28 13:00:39 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-4c856168-322f-4ce4-8d37-d113b67643d5 tempest-UserMessageNegativeTest-781603078 tempest-UserMessageNegativeTest-781603078-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:39 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-4c856168-322f-4ce4-8d37-d113b67643d5 tempest-UserMessageNegativeTest-781603078 tempest-UserMessageNegativeTest-781603078-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:39 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-4c856168-322f-4ce4-8d37-d113b67643d5 tempest-UserMessageNegativeTest-781603078 tempest-UserMessageNegativeTest-781603078-project-member] http://10.27.203.238/share/v2/ca9b4c5f200844bdbcc6db13e907f21e/shares/431c69fe-4a0e-48fc-ac60-0aa49079e1b2 returned with HTTP 200 May 28 13:00:39 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 944/1924] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:00:39 2024] GET /share/v2/ca9b4c5f200844bdbcc6db13e907f21e/shares/431c69fe-4a0e-48fc-ac60-0aa49079e1b2 => generated 1332 bytes in 26 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:00:39 l75lg1-v1 dstat.sh[49771]: 28-05 13:00:39| 2 0 96 1 0|5689M 1758M 278M 7899M| 16k 2416B| 0 5384k| 0 647 |2570 4020 |1.65 1.20 1.06|1.0 2.0 0| 0 0 | 0 2048M| 29 361 0 44 2 May 28 13:00:39 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0b0e5f5a-fadc-40f6-b378-78c8005ec504 tempest-ShareRulesTest-1530341375 None] <<< [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/ May 28 13:00:39 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0b0e5f5a-fadc-40f6-b378-78c8005ec504 tempest-ShareRulesTest-1530341375 None] 'OK' May 28 13:00:39 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0b0e5f5a-fadc-40f6-b378-78c8005ec504 tempest-ShareRulesTest-1530341375 None] --- [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/: Done May 28 13:00:39 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0b0e5f5a-fadc-40f6-b378-78c8005ec504 tempest-ShareRulesTest-1530341375 None] >>> [GET] https://127.0.0.1:40443/api/views/ May 28 13:00:39 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0b0e5f5a-fadc-40f6-b378-78c8005ec504 tempest-ShareRulesTest-1530341375 None] {'allow_redirects': True, May 28 13:00:39 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0b0e5f5a-fadc-40f6-b378-78c8005ec504 tempest-ShareRulesTest-1530341375 None] 'params': {'name': '5eddb781-43d4-4883-ae43-e9856f3a4c10'}} May 28 13:00:39 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-6972ea86-aa77-40ef-9335-9e0b0309bee5 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] GET http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/shares/f4283c2a-3835-416e-9703-f5745babbf5c May 28 13:00:39 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-6972ea86-aa77-40ef-9335-9e0b0309bee5 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:39 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-6972ea86-aa77-40ef-9335-9e0b0309bee5 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:39 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-6972ea86-aa77-40ef-9335-9e0b0309bee5 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/shares/f4283c2a-3835-416e-9703-f5745babbf5c returned with HTTP 200 May 28 13:00:39 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 981/1925] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:00:39 2024] GET /share/v2/a4f3887fa28c457390f5b66615564430/shares/f4283c2a-3835-416e-9703-f5745babbf5c => generated 1316 bytes in 26 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:00:39 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8b4f0fd1-edd5-4fef-976a-4a87ae5862d3 tempest-ShareTransferNegativeTest-884271560 None] <<< [DELETE] https://127.0.0.1:40443/api/viewpolicies/42/ May 28 13:00:39 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8b4f0fd1-edd5-4fef-976a-4a87ae5862d3 tempest-ShareTransferNegativeTest-884271560 None] --- [DELETE] https://127.0.0.1:40443/api/viewpolicies/42/: Done May 28 13:00:39 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-8b4f0fd1-edd5-4fef-976a-4a87ae5862d3 tempest-ShareTransferNegativeTest-884271560 None] Created reservations ['e728aded-9247-41c1-8af9-0bbe576dd1df', '82fe3089-8d65-4d81-b894-43af2811fa02', '30c44608-534e-4a45-a338-6b2e67e05dbd', 'e9dde0e6-0028-418b-bf1f-7030af511597'] {{(pid=98474) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 13:00:39 l75lg1-v1 nova-conductor[83647]: DEBUG dbcounter [-] [83647] Writing DB stats nova_cell1:SELECT=2,nova_cell1:UPDATE=2 {{(pid=83647) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:00:39 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-8b4f0fd1-edd5-4fef-976a-4a87ae5862d3 tempest-ShareTransferNegativeTest-884271560 None] Committed reservations ['e728aded-9247-41c1-8af9-0bbe576dd1df', '82fe3089-8d65-4d81-b894-43af2811fa02', '30c44608-534e-4a45-a338-6b2e67e05dbd', 'e9dde0e6-0028-418b-bf1f-7030af511597'] {{(pid=98474) commit /opt/stack/manila/manila/quota.py:1063}} May 28 13:00:39 l75lg1-v1 manila-share[98474]: INFO manila.share.manager [None req-8b4f0fd1-edd5-4fef-976a-4a87ae5862d3 tempest-ShareTransferNegativeTest-884271560 None] Share instance f8e9c921-56e5-4b4a-a619-44221b8150a3: deleted successfully. May 28 13:00:39 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e060b217-e2ee-419c-8f77-9c4452fd8ed0 tempest-ShareTypeAvailabilityZonesTest-364532124 None] <<< [POST] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:00:39 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e060b217-e2ee-419c-8f77-9c4452fd8ed0 tempest-ShareTypeAvailabilityZonesTest-364532124 None] Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=0, created='2024-05-28T13:00:39.443803Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='1ca71fd1-116f-4fdc-94d0-9f70de97877e', id=45, internal=False, is_s3_default_policy=False, name='946d9bf7-603c-4faa-8dbe-2cf88c9c8291', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=[], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['*'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['*'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T13:00:39.819542Z', tenant_id=1, tenant_name='default', title='946d9bf7-603c-4faa-8dbe-2cf88c9c8291', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/45/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[]) May 28 13:00:39 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e060b217-e2ee-419c-8f77-9c4452fd8ed0 tempest-ShareTypeAvailabilityZonesTest-364532124 None] --- [POST] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 13:00:39 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e060b217-e2ee-419c-8f77-9c4452fd8ed0 tempest-ShareTypeAvailabilityZonesTest-364532124 None] >>> [GET] https://127.0.0.1:40443/api/quotas/ May 28 13:00:39 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e060b217-e2ee-419c-8f77-9c4452fd8ed0 tempest-ShareTypeAvailabilityZonesTest-364532124 None] {'allow_redirects': True, May 28 13:00:39 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e060b217-e2ee-419c-8f77-9c4452fd8ed0 tempest-ShareTypeAvailabilityZonesTest-364532124 None] 'params': {'name': '946d9bf7-603c-4faa-8dbe-2cf88c9c8291'}} May 28 13:00:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0b0e5f5a-fadc-40f6-b378-78c8005ec504 tempest-ShareRulesTest-1530341375 None] <<< [GET] https://127.0.0.1:40443/api/views/ May 28 13:00:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0b0e5f5a-fadc-40f6-b378-78c8005ec504 tempest-ShareRulesTest-1530341375 None] [Bunch(abac_tags=[], abe_max_depth=None, abe_protocols=[], alias='', allow_anonymous_access=False, allow_s3_anonymous_access=False, auto_commit='0d', bucket='', bucket_creators=[], bucket_creators_groups=[], bucket_owner=None, bulk_permission_update_progress=None, bulk_permission_update_state=None, cluster='loop75-kfs', cluster_id=1, created='2024-05-28T13:00:31.218578Z', enabled=True, files_retention_mode='NONE', guid='0eb2b1e4-8c9a-4a76-9a7a-523f14fc36fa', id=43, ignore_oos=False, internal=False, is_remote=False, is_seamless=False, logical_capacity=0, max_retention_period=None, min_retention_period=None, name='5eddb781-43d4-4883-ae43-e9856f3a4c10', nfs_interop_flags='BOTH_NFS3_AND_NFS4_INTEROP_DISABLED', path='/manila/manila-5eddb781-43d4-4883-ae43-e9856f3a4c10', physical_capacity=0, policy='5eddb781-43d4-4883-ae43-e9856f3a4c10', policy_id=44, protocols=['NFS'], qos_policy=None, qos_policy_id=None, s3_locks=False, s3_locks_retention_mode='NONE', s3_locks_retention_period='', s3_unverified_lookup=False, s3_versioning=False, select_for_live_monitoring=False, share='', share_acl=Bunch(acl=[], enabled=False), sync='SYNCED', sync_time='2024-05-28T13:00:31.516964Z', tenant_id=1, tenant_name='default', title='/manila/manila-5eddb781-43d4-4883-ae43-e9856f3a4c10', url='https://127.0.0.1:40443/api/views/43/')] May 28 13:00:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0b0e5f5a-fadc-40f6-b378-78c8005ec504 tempest-ShareRulesTest-1530341375 None] --- [GET] https://127.0.0.1:40443/api/views/: Done May 28 13:00:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0b0e5f5a-fadc-40f6-b378-78c8005ec504 tempest-ShareRulesTest-1530341375 None] >>> [DELETE] https://127.0.0.1:40443/api/views/43/ May 28 13:00:40 l75lg1-v1 nova-conductor[83648]: DEBUG dbcounter [-] [83648] Writing DB stats nova_cell1:SELECT=1 {{(pid=83648) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:00:40 l75lg1-v1 dstat.sh[49771]: 28-05 13:00:40| 2 1 96 1 0|5689M 1758M 278M 7899M| 20k 2220B| 0 904k| 0 112 |2804 4408 |1.65 1.20 1.06|1.0 1.0 0| 0 0 | 0 2048M| 29 361 0 44 2 May 28 13:00:40 l75lg1-v1 neutron-server[77618]: DEBUG dbcounter [-] [77618] Writing DB stats neutron:SELECT=3 {{(pid=77618) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:00:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e060b217-e2ee-419c-8f77-9c4452fd8ed0 tempest-ShareTypeAvailabilityZonesTest-364532124 None] <<< [GET] https://127.0.0.1:40443/api/quotas/ May 28 13:00:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e060b217-e2ee-419c-8f77-9c4452fd8ed0 tempest-ShareTypeAvailabilityZonesTest-364532124 None] [] May 28 13:00:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e060b217-e2ee-419c-8f77-9c4452fd8ed0 tempest-ShareTypeAvailabilityZonesTest-364532124 None] --- [GET] https://127.0.0.1:40443/api/quotas/: Done May 28 13:00:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e060b217-e2ee-419c-8f77-9c4452fd8ed0 tempest-ShareTypeAvailabilityZonesTest-364532124 None] >>> [POST] https://127.0.0.1:40443/api/quotas/ May 28 13:00:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e060b217-e2ee-419c-8f77-9c4452fd8ed0 tempest-ShareTypeAvailabilityZonesTest-364532124 None] {'data': '{"name": "946d9bf7-603c-4faa-8dbe-2cf88c9c8291", "path": ' May 28 13:00:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e060b217-e2ee-419c-8f77-9c4452fd8ed0 tempest-ShareTypeAvailabilityZonesTest-364532124 None] '"/manila/manila-946d9bf7-603c-4faa-8dbe-2cf88c9c8291", "create_dir": ' May 28 13:00:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e060b217-e2ee-419c-8f77-9c4452fd8ed0 tempest-ShareTypeAvailabilityZonesTest-364532124 None] 'true, "hard_limit": 1073741824}', May 28 13:00:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e060b217-e2ee-419c-8f77-9c4452fd8ed0 tempest-ShareTypeAvailabilityZonesTest-364532124 None] 'json': None, May 28 13:00:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e060b217-e2ee-419c-8f77-9c4452fd8ed0 tempest-ShareTypeAvailabilityZonesTest-364532124 None] 'params': None} May 28 13:00:40 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-4cea8f7a-5722-4a2a-a551-fa3c59926c62 tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] GET http://10.27.203.238/share/v2/cac556dc39a14bbdbdbabfc80672fb1f/shares/03abb6c7-1707-45b3-a692-3b1de0dd1fba May 28 13:00:40 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-4cea8f7a-5722-4a2a-a551-fa3c59926c62 tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:40 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-4cea8f7a-5722-4a2a-a551-fa3c59926c62 tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:40 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-4cea8f7a-5722-4a2a-a551-fa3c59926c62 tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] HTTP exception thrown: The resource could not be found. May 28 13:00:40 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-4cea8f7a-5722-4a2a-a551-fa3c59926c62 tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] http://10.27.203.238/share/v2/cac556dc39a14bbdbdbabfc80672fb1f/shares/03abb6c7-1707-45b3-a692-3b1de0dd1fba returned with HTTP 404 May 28 13:00:40 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 945/1926] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:00:40 2024] GET /share/v2/cac556dc39a14bbdbdbabfc80672fb1f/shares/03abb6c7-1707-45b3-a692-3b1de0dd1fba => generated 78 bytes in 13 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 13:00:40 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-65ef86fd-122c-49ea-8690-7ca5ccf76b51 tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] GET http://10.27.203.238/share/v2/cac556dc39a14bbdbdbabfc80672fb1f/share-replicas/detail?share_id=0c7ef0a2-5628-47dd-9eba-98153028dd8a May 28 13:00:40 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-65ef86fd-122c-49ea-8690-7ca5ccf76b51 tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:40 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-65ef86fd-122c-49ea-8690-7ca5ccf76b51 tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:40 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-65ef86fd-122c-49ea-8690-7ca5ccf76b51 tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] http://10.27.203.238/share/v2/cac556dc39a14bbdbdbabfc80672fb1f/share-replicas/detail?share_id=0c7ef0a2-5628-47dd-9eba-98153028dd8a returned with HTTP 200 May 28 13:00:40 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 982/1927] 10.27.203.238 () {64 vars in 1476 bytes} [Tue May 28 13:00:40 2024] GET /share/v2/cac556dc39a14bbdbdbabfc80672fb1f/share-replicas/detail?share_id=0c7ef0a2-5628-47dd-9eba-98153028dd8a => generated 22 bytes in 15 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:00:40 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-df1d3fc8-e0d9-4d36-8fd1-0a8f7df857d7 tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] DELETE http://10.27.203.238/share/v2/cac556dc39a14bbdbdbabfc80672fb1f/shares/0c7ef0a2-5628-47dd-9eba-98153028dd8a May 28 13:00:40 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-df1d3fc8-e0d9-4d36-8fd1-0a8f7df857d7 tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:40 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-df1d3fc8-e0d9-4d36-8fd1-0a8f7df857d7 tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] Calling method 'ShareMixin.delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:40 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.v1.shares [None req-df1d3fc8-e0d9-4d36-8fd1-0a8f7df857d7 tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] Delete share with id: 0c7ef0a2-5628-47dd-9eba-98153028dd8a May 28 13:00:41 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-47c04b2e-70d0-4f6f-af2e-4c135398f34b tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] GET http://10.27.203.238/share/v2/284d76edec3144579d6fb3f6dbc0dd4e/shares/da80429c-1281-4450-a386-ed0e9d82a3ff May 28 13:00:41 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-47c04b2e-70d0-4f6f-af2e-4c135398f34b tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:41 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-47c04b2e-70d0-4f6f-af2e-4c135398f34b tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:41 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-47c04b2e-70d0-4f6f-af2e-4c135398f34b tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] http://10.27.203.238/share/v2/284d76edec3144579d6fb3f6dbc0dd4e/shares/da80429c-1281-4450-a386-ed0e9d82a3ff returned with HTTP 200 May 28 13:00:41 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 983/1928] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:00:41 2024] GET /share/v2/284d76edec3144579d6fb3f6dbc0dd4e/shares/da80429c-1281-4450-a386-ed0e9d82a3ff => generated 1314 bytes in 29 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:00:41 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-df1d3fc8-e0d9-4d36-8fd1-0a8f7df857d7 tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] http://10.27.203.238/share/v2/cac556dc39a14bbdbdbabfc80672fb1f/shares/0c7ef0a2-5628-47dd-9eba-98153028dd8a returned with HTTP 202 May 28 13:00:41 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 946/1929] 10.27.203.238 () {64 vars in 1454 bytes} [Tue May 28 13:00:40 2024] DELETE /share/v2/cac556dc39a14bbdbdbabfc80672fb1f/shares/0c7ef0a2-5628-47dd-9eba-98153028dd8a => generated 0 bytes in 142 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 13:00:41 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-3b9dc195-b1cb-4175-b3bf-ebe388b6a9b9 tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] GET http://10.27.203.238/share/v2/cac556dc39a14bbdbdbabfc80672fb1f/shares/0c7ef0a2-5628-47dd-9eba-98153028dd8a May 28 13:00:41 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-3b9dc195-b1cb-4175-b3bf-ebe388b6a9b9 tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:41 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-3b9dc195-b1cb-4175-b3bf-ebe388b6a9b9 tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:41 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-3b9dc195-b1cb-4175-b3bf-ebe388b6a9b9 tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] http://10.27.203.238/share/v2/cac556dc39a14bbdbdbabfc80672fb1f/shares/0c7ef0a2-5628-47dd-9eba-98153028dd8a returned with HTTP 200 May 28 13:00:41 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 984/1930] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:00:41 2024] GET /share/v2/cac556dc39a14bbdbdbabfc80672fb1f/shares/0c7ef0a2-5628-47dd-9eba-98153028dd8a => generated 1315 bytes in 27 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:00:41 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-df1d3fc8-e0d9-4d36-8fd1-0a8f7df857d7 tempest-ShareTransferNegativeTest-884271560 None] Acquiring lock "locked_access_rules_operation_by_share_instance_e21891ab-7145-4d59-b238-375b52d59cb7" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:00:41 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-df1d3fc8-e0d9-4d36-8fd1-0a8f7df857d7 tempest-ShareTransferNegativeTest-884271560 None] Lock "locked_access_rules_operation_by_share_instance_e21891ab-7145-4d59-b238-375b52d59cb7" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:00:41 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-df1d3fc8-e0d9-4d36-8fd1-0a8f7df857d7 tempest-ShareTransferNegativeTest-884271560 None] Lock "locked_access_rules_operation_by_share_instance_e21891ab-7145-4d59-b238-375b52d59cb7" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:00:41 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-df1d3fc8-e0d9-4d36-8fd1-0a8f7df857d7 tempest-ShareTransferNegativeTest-884271560 None] Acquiring lock "locked_access_rules_operation_by_share_instance_e21891ab-7145-4d59-b238-375b52d59cb7" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:00:41 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-df1d3fc8-e0d9-4d36-8fd1-0a8f7df857d7 tempest-ShareTransferNegativeTest-884271560 None] Lock "locked_access_rules_operation_by_share_instance_e21891ab-7145-4d59-b238-375b52d59cb7" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:00:41 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-df1d3fc8-e0d9-4d36-8fd1-0a8f7df857d7 tempest-ShareTransferNegativeTest-884271560 None] Lock "locked_access_rules_operation_by_share_instance_e21891ab-7145-4d59-b238-375b52d59cb7" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:00:41 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-df1d3fc8-e0d9-4d36-8fd1-0a8f7df857d7 tempest-ShareTransferNegativeTest-884271560 None] Acquiring lock "locked_access_rules_operation_by_share_instance_e21891ab-7145-4d59-b238-375b52d59cb7" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:00:41 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-df1d3fc8-e0d9-4d36-8fd1-0a8f7df857d7 tempest-ShareTransferNegativeTest-884271560 None] Lock "locked_access_rules_operation_by_share_instance_e21891ab-7145-4d59-b238-375b52d59cb7" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:00:41 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-df1d3fc8-e0d9-4d36-8fd1-0a8f7df857d7 tempest-ShareTransferNegativeTest-884271560 None] Lock "locked_access_rules_operation_by_share_instance_e21891ab-7145-4d59-b238-375b52d59cb7" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:00:41 l75lg1-v1 manila-share[98474]: DEBUG manila.share.access [None req-df1d3fc8-e0d9-4d36-8fd1-0a8f7df857d7 tempest-ShareTransferNegativeTest-884271560 None] All access rules have been synced for share instance e21891ab-7145-4d59-b238-375b52d59cb7 belonging to share 0c7ef0a2-5628-47dd-9eba-98153028dd8a. {{(pid=98474) update_access_rules /opt/stack/manila/manila/share/access.py:304}} May 28 13:00:41 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-df1d3fc8-e0d9-4d36-8fd1-0a8f7df857d7 tempest-ShareTransferNegativeTest-884271560 None] deleting '/manila/manila-e21891ab-7145-4d59-b238-375b52d59cb7' May 28 13:00:41 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-df1d3fc8-e0d9-4d36-8fd1-0a8f7df857d7 tempest-ShareTransferNegativeTest-884271560 None] >>> [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/ May 28 13:00:41 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-df1d3fc8-e0d9-4d36-8fd1-0a8f7df857d7 tempest-ShareTransferNegativeTest-884271560 None] {'data': '{"path": "/manila/manila-e21891ab-7145-4d59-b238-375b52d59cb7"}', May 28 13:00:41 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-df1d3fc8-e0d9-4d36-8fd1-0a8f7df857d7 tempest-ShareTransferNegativeTest-884271560 None] 'params': None} May 28 13:00:41 l75lg1-v1 dstat.sh[49771]: 28-05 13:00:41| 4 0 94 1 0|5689M 1758M 278M 7899M| 17k 1784B| 0 824k| 0 61.0 |2714 4155 |1.65 1.20 1.06|1.0 1.0 0| 0 0 | 0 2048M| 29 361 0 44 2 May 28 13:00:41 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-df1d3fc8-e0d9-4d36-8fd1-0a8f7df857d7 tempest-ShareTransferNegativeTest-884271560 None] <<< [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/ May 28 13:00:41 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-df1d3fc8-e0d9-4d36-8fd1-0a8f7df857d7 tempest-ShareTransferNegativeTest-884271560 None] 'OK' May 28 13:00:41 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-df1d3fc8-e0d9-4d36-8fd1-0a8f7df857d7 tempest-ShareTransferNegativeTest-884271560 None] --- [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/: Done May 28 13:00:41 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-df1d3fc8-e0d9-4d36-8fd1-0a8f7df857d7 tempest-ShareTransferNegativeTest-884271560 None] >>> [GET] https://127.0.0.1:40443/api/views/ May 28 13:00:41 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-df1d3fc8-e0d9-4d36-8fd1-0a8f7df857d7 tempest-ShareTransferNegativeTest-884271560 None] {'allow_redirects': True, May 28 13:00:41 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-df1d3fc8-e0d9-4d36-8fd1-0a8f7df857d7 tempest-ShareTransferNegativeTest-884271560 None] 'params': {'name': 'e21891ab-7145-4d59-b238-375b52d59cb7'}} May 28 13:00:41 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e060b217-e2ee-419c-8f77-9c4452fd8ed0 tempest-ShareTypeAvailabilityZonesTest-364532124 None] <<< [POST] https://127.0.0.1:40443/api/quotas/ May 28 13:00:41 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e060b217-e2ee-419c-8f77-9c4452fd8ed0 tempest-ShareTypeAvailabilityZonesTest-364532124 None] Bunch(cluster='loop75-kfs', cluster_id=1, default_email=None, default_group_quota=None, default_user_quota=None, enable_alarms=True, enable_email_providers=True, grace_period=None, group_quotas=[], guid='399ae783-a3a0-4a28-9824-9659f1da5759', hard_limit=1073741824, hard_limit_inodes=None, id=42, internal=False, is_user_quota=False, last_user_quotas_update=None, name='946d9bf7-603c-4faa-8dbe-2cf88c9c8291', num_blocked_users=0, num_exceeded_users=0, path='/manila/manila-946d9bf7-603c-4faa-8dbe-2cf88c9c8291', percent_capacity=0, percent_inodes=None, pretty_grace_period=None, pretty_grace_period_expiration=None, pretty_state='OK (CREATED)', soft_limit=None, soft_limit_inodes=None, state='OK', sync_state='CREATED', system_id=42, tenant_id=1, tenant_name='default', time_to_block=None, title='946d9bf7-603c-4faa-8dbe-2cf88c9c8291', url='https://127.0.0.1:40443/api/quotas/42/', used_capacity=0, used_capacity_tb=0.0, used_effective_capacity=0, used_effective_capacity_tb=0.0, used_inodes=0, used_limited_capacity=0, user_quotas=[]) May 28 13:00:41 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e060b217-e2ee-419c-8f77-9c4452fd8ed0 tempest-ShareTypeAvailabilityZonesTest-364532124 None] --- [POST] https://127.0.0.1:40443/api/quotas/: Done May 28 13:00:41 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e060b217-e2ee-419c-8f77-9c4452fd8ed0 tempest-ShareTypeAvailabilityZonesTest-364532124 None] >>> [GET] https://127.0.0.1:40443/api/views/ May 28 13:00:41 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e060b217-e2ee-419c-8f77-9c4452fd8ed0 tempest-ShareTypeAvailabilityZonesTest-364532124 None] {'allow_redirects': True, May 28 13:00:41 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e060b217-e2ee-419c-8f77-9c4452fd8ed0 tempest-ShareTypeAvailabilityZonesTest-364532124 None] 'params': {'name': '946d9bf7-603c-4faa-8dbe-2cf88c9c8291'}} May 28 13:00:41 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-df1d3fc8-e0d9-4d36-8fd1-0a8f7df857d7 tempest-ShareTransferNegativeTest-884271560 None] <<< [GET] https://127.0.0.1:40443/api/views/ May 28 13:00:41 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-df1d3fc8-e0d9-4d36-8fd1-0a8f7df857d7 tempest-ShareTransferNegativeTest-884271560 None] [Bunch(abac_tags=[], abe_max_depth=None, abe_protocols=[], alias='', allow_anonymous_access=False, allow_s3_anonymous_access=False, auto_commit='0d', bucket='', bucket_creators=[], bucket_creators_groups=[], bucket_owner=None, bulk_permission_update_progress=None, bulk_permission_update_state=None, cluster='loop75-kfs', cluster_id=1, created='2024-05-28T13:00:07.168642Z', enabled=True, files_retention_mode='NONE', guid='8710772f-3a14-41a8-afe3-153430307cc8', id=40, ignore_oos=False, internal=False, is_remote=False, is_seamless=False, logical_capacity=0, max_retention_period='0d', min_retention_period='0d', name='e21891ab-7145-4d59-b238-375b52d59cb7', nfs_interop_flags='BOTH_NFS3_AND_NFS4_INTEROP_DISABLED', path='/manila/manila-e21891ab-7145-4d59-b238-375b52d59cb7', physical_capacity=0, policy='e21891ab-7145-4d59-b238-375b52d59cb7', policy_id=41, protocols=['NFS'], qos_policy=None, qos_policy_id=None, s3_locks=False, s3_locks_retention_mode='NONE', s3_locks_retention_period='', s3_unverified_lookup=False, s3_versioning=False, select_for_live_monitoring=False, share='', share_acl=Bunch(acl=[], enabled=False), sync='SYNCED', sync_time='2024-05-28T13:00:09.039241Z', tenant_id=1, tenant_name='default', title='/manila/manila-e21891ab-7145-4d59-b238-375b52d59cb7', url='https://127.0.0.1:40443/api/views/40/')] May 28 13:00:41 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-df1d3fc8-e0d9-4d36-8fd1-0a8f7df857d7 tempest-ShareTransferNegativeTest-884271560 None] --- [GET] https://127.0.0.1:40443/api/views/: Done May 28 13:00:41 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-df1d3fc8-e0d9-4d36-8fd1-0a8f7df857d7 tempest-ShareTransferNegativeTest-884271560 None] >>> [DELETE] https://127.0.0.1:40443/api/views/40/ May 28 13:00:41 l75lg1-v1 nova-scheduler[81196]: DEBUG dbcounter [-] [81196] Writing DB stats nova_cell0:SELECT=1,nova_cell0:UPDATE=1 {{(pid=81196) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:00:41 l75lg1-v1 nova-scheduler[81194]: DEBUG dbcounter [-] [81194] Writing DB stats nova_cell0:SELECT=1 {{(pid=81194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:00:42 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e060b217-e2ee-419c-8f77-9c4452fd8ed0 tempest-ShareTypeAvailabilityZonesTest-364532124 None] <<< [GET] https://127.0.0.1:40443/api/views/ May 28 13:00:42 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e060b217-e2ee-419c-8f77-9c4452fd8ed0 tempest-ShareTypeAvailabilityZonesTest-364532124 None] [] May 28 13:00:42 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e060b217-e2ee-419c-8f77-9c4452fd8ed0 tempest-ShareTypeAvailabilityZonesTest-364532124 None] --- [GET] https://127.0.0.1:40443/api/views/: Done May 28 13:00:42 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e060b217-e2ee-419c-8f77-9c4452fd8ed0 tempest-ShareTypeAvailabilityZonesTest-364532124 None] >>> [POST] https://127.0.0.1:40443/api/views/ May 28 13:00:42 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e060b217-e2ee-419c-8f77-9c4452fd8ed0 tempest-ShareTypeAvailabilityZonesTest-364532124 None] {'data': '{"name": "946d9bf7-603c-4faa-8dbe-2cf88c9c8291", "path": ' May 28 13:00:42 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e060b217-e2ee-419c-8f77-9c4452fd8ed0 tempest-ShareTypeAvailabilityZonesTest-364532124 None] '"/manila/manila-946d9bf7-603c-4faa-8dbe-2cf88c9c8291", "policy_id": ' May 28 13:00:42 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e060b217-e2ee-419c-8f77-9c4452fd8ed0 tempest-ShareTypeAvailabilityZonesTest-364532124 None] '45, "create_dir": true, "protocols": ["NFS"]}', May 28 13:00:42 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e060b217-e2ee-419c-8f77-9c4452fd8ed0 tempest-ShareTypeAvailabilityZonesTest-364532124 None] 'json': None, May 28 13:00:42 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e060b217-e2ee-419c-8f77-9c4452fd8ed0 tempest-ShareTypeAvailabilityZonesTest-364532124 None] 'params': None} May 28 13:00:42 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0b0e5f5a-fadc-40f6-b378-78c8005ec504 tempest-ShareRulesTest-1530341375 None] <<< [DELETE] https://127.0.0.1:40443/api/views/43/ May 28 13:00:42 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0b0e5f5a-fadc-40f6-b378-78c8005ec504 tempest-ShareRulesTest-1530341375 None] --- [DELETE] https://127.0.0.1:40443/api/views/43/: Done May 28 13:00:42 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0b0e5f5a-fadc-40f6-b378-78c8005ec504 tempest-ShareRulesTest-1530341375 None] >>> [GET] https://127.0.0.1:40443/api/quotas/ May 28 13:00:42 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0b0e5f5a-fadc-40f6-b378-78c8005ec504 tempest-ShareRulesTest-1530341375 None] {'allow_redirects': True, May 28 13:00:42 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0b0e5f5a-fadc-40f6-b378-78c8005ec504 tempest-ShareRulesTest-1530341375 None] 'params': {'name': '5eddb781-43d4-4883-ae43-e9856f3a4c10'}} May 28 13:00:42 l75lg1-v1 dstat.sh[49771]: 28-05 13:00:42| 1 0 97 1 0|5689M 1758M 278M 7899M| 24k 3966B| 0 936k| 0 96.0 |2740 4223 |1.68 1.21 1.06| 0 1.0 0| 0 0 | 0 2048M| 29 361 0 44 2 May 28 13:00:42 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-868e4693-2d05-48b4-afd3-3651062c08f1 tempest-UserMessageNegativeTest-781603078 tempest-UserMessageNegativeTest-781603078-project-member] GET http://10.27.203.238/share/v2/ca9b4c5f200844bdbcc6db13e907f21e/messages May 28 13:00:42 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-868e4693-2d05-48b4-afd3-3651062c08f1 tempest-UserMessageNegativeTest-781603078 tempest-UserMessageNegativeTest-781603078-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:42 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-868e4693-2d05-48b4-afd3-3651062c08f1 tempest-UserMessageNegativeTest-781603078 tempest-UserMessageNegativeTest-781603078-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:42 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.message.api [None req-868e4693-2d05-48b4-afd3-3651062c08f1 tempest-UserMessageNegativeTest-781603078 tempest-UserMessageNegativeTest-781603078-project-member] Searching for messages by: MultiDict([]) {{(pid=98330) get_all /opt/stack/manila/manila/message/api.py:78}} May 28 13:00:42 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-868e4693-2d05-48b4-afd3-3651062c08f1 tempest-UserMessageNegativeTest-781603078 tempest-UserMessageNegativeTest-781603078-project-member] http://10.27.203.238/share/v2/ca9b4c5f200844bdbcc6db13e907f21e/messages returned with HTTP 200 May 28 13:00:42 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 947/1931] 10.27.203.238 () {64 vars in 1346 bytes} [Tue May 28 13:00:42 2024] GET /share/v2/ca9b4c5f200844bdbcc6db13e907f21e/messages => generated 4019 bytes in 12 msecs (HTTP/1.1 200) 6 headers in 232 bytes (2 switches on core 0) May 28 13:00:42 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-ded29c5f-37b8-4776-8b11-f3a78cffb488 tempest-UserMessageNegativeTest-781603078 tempest-UserMessageNegativeTest-781603078-project-member] GET http://10.27.203.238/share/v2/ca9b4c5f200844bdbcc6db13e907f21e/messages/dc7413b3-09e6-4a69-8c95-07a73a45c857 May 28 13:00:42 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-ded29c5f-37b8-4776-8b11-f3a78cffb488 tempest-UserMessageNegativeTest-781603078 tempest-UserMessageNegativeTest-781603078-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:42 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-ded29c5f-37b8-4776-8b11-f3a78cffb488 tempest-UserMessageNegativeTest-781603078 tempest-UserMessageNegativeTest-781603078-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:42 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-ded29c5f-37b8-4776-8b11-f3a78cffb488 tempest-UserMessageNegativeTest-781603078 tempest-UserMessageNegativeTest-781603078-project-member] HTTP exception thrown: Message dc7413b3-09e6-4a69-8c95-07a73a45c857 could not be found. May 28 13:00:42 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-ded29c5f-37b8-4776-8b11-f3a78cffb488 tempest-UserMessageNegativeTest-781603078 tempest-UserMessageNegativeTest-781603078-project-member] http://10.27.203.238/share/v2/ca9b4c5f200844bdbcc6db13e907f21e/messages/dc7413b3-09e6-4a69-8c95-07a73a45c857 returned with HTTP 404 May 28 13:00:42 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 985/1932] 10.27.203.238 () {64 vars in 1457 bytes} [Tue May 28 13:00:42 2024] GET /share/v2/ca9b4c5f200844bdbcc6db13e907f21e/messages/dc7413b3-09e6-4a69-8c95-07a73a45c857 => generated 110 bytes in 11 msecs (HTTP/1.1 404) 6 headers in 238 bytes (1 switches on core 0) May 28 13:00:42 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-975a5756-f1d7-4dcd-a970-616afb68e17f tempest-UserMessageNegativeTest-781603078 tempest-UserMessageNegativeTest-781603078-project-member] DELETE http://10.27.203.238/share/v2/ca9b4c5f200844bdbcc6db13e907f21e/shares/431c69fe-4a0e-48fc-ac60-0aa49079e1b2 May 28 13:00:42 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-975a5756-f1d7-4dcd-a970-616afb68e17f tempest-UserMessageNegativeTest-781603078 tempest-UserMessageNegativeTest-781603078-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:42 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-975a5756-f1d7-4dcd-a970-616afb68e17f tempest-UserMessageNegativeTest-781603078 tempest-UserMessageNegativeTest-781603078-project-member] Calling method 'ShareMixin.delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:42 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.v1.shares [None req-975a5756-f1d7-4dcd-a970-616afb68e17f tempest-UserMessageNegativeTest-781603078 tempest-UserMessageNegativeTest-781603078-project-member] Delete share with id: 431c69fe-4a0e-48fc-ac60-0aa49079e1b2 May 28 13:00:42 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.quota [None req-975a5756-f1d7-4dcd-a970-616afb68e17f tempest-UserMessageNegativeTest-781603078 tempest-UserMessageNegativeTest-781603078-project-member] Created reservations ['b01ee315-20d9-473b-9cd7-2a441c4b094a', '5bf77eae-68f8-474b-af4a-80535c140a89', '65506bd4-2d5b-4297-a3bc-8710ff5ad4eb', '71b0230f-5090-46a2-8d44-147b79c7bbe1'] {{(pid=98330) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 13:00:42 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.quota [None req-975a5756-f1d7-4dcd-a970-616afb68e17f tempest-UserMessageNegativeTest-781603078 tempest-UserMessageNegativeTest-781603078-project-member] Committed reservations ['b01ee315-20d9-473b-9cd7-2a441c4b094a', '5bf77eae-68f8-474b-af4a-80535c140a89', '65506bd4-2d5b-4297-a3bc-8710ff5ad4eb', '71b0230f-5090-46a2-8d44-147b79c7bbe1'] {{(pid=98330) commit /opt/stack/manila/manila/quota.py:1063}} May 28 13:00:42 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-975a5756-f1d7-4dcd-a970-616afb68e17f tempest-UserMessageNegativeTest-781603078 tempest-UserMessageNegativeTest-781603078-project-member] http://10.27.203.238/share/v2/ca9b4c5f200844bdbcc6db13e907f21e/shares/431c69fe-4a0e-48fc-ac60-0aa49079e1b2 returned with HTTP 202 May 28 13:00:42 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 948/1933] 10.27.203.238 () {64 vars in 1454 bytes} [Tue May 28 13:00:42 2024] DELETE /share/v2/ca9b4c5f200844bdbcc6db13e907f21e/shares/431c69fe-4a0e-48fc-ac60-0aa49079e1b2 => generated 0 bytes in 255 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 13:00:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e740797-ce0b-4f21-bc8e-58dae413c7ba service manila] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-7e740797-ce0b-4f21-bc8e-58dae413c7ba service manila] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:00:42 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-be414d59-a402-4383-9d4f-fcd80e46f35c tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] GET http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/shares/f4283c2a-3835-416e-9703-f5745babbf5c May 28 13:00:42 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-be414d59-a402-4383-9d4f-fcd80e46f35c tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:42 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-be414d59-a402-4383-9d4f-fcd80e46f35c tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:42 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0b0e5f5a-fadc-40f6-b378-78c8005ec504 tempest-ShareRulesTest-1530341375 None] <<< [GET] https://127.0.0.1:40443/api/quotas/ May 28 13:00:42 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0b0e5f5a-fadc-40f6-b378-78c8005ec504 tempest-ShareRulesTest-1530341375 None] [Bunch(cluster='loop75-kfs', cluster_id=1, default_email=None, default_group_quota=None, default_user_quota=None, enable_alarms=True, enable_email_providers=True, grace_period=None, guid='6d38b950-be34-4831-a246-2c88464878ab', hard_limit=1073741824, hard_limit_inodes=None, id=41, internal=False, is_user_quota=False, last_user_quotas_update=None, name='5eddb781-43d4-4883-ae43-e9856f3a4c10', num_blocked_users=0, num_exceeded_users=0, path='/manila/manila-5eddb781-43d4-4883-ae43-e9856f3a4c10', percent_capacity=0, percent_inodes=None, pretty_grace_period=None, pretty_grace_period_expiration=None, pretty_state='OK', soft_limit=None, soft_limit_inodes=None, state='OK', sync_state='SYNCHRONIZED', system_id=41, tenant_id=1, tenant_name='default', time_to_block=None, title='5eddb781-43d4-4883-ae43-e9856f3a4c10', url='https://127.0.0.1:40443/api/quotas/41/', used_capacity=0, used_capacity_tb=0.0, used_effective_capacity=0, used_effective_capacity_tb=0.0, used_inodes=1, used_limited_capacity=0)] May 28 13:00:42 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0b0e5f5a-fadc-40f6-b378-78c8005ec504 tempest-ShareRulesTest-1530341375 None] --- [GET] https://127.0.0.1:40443/api/quotas/: Done May 28 13:00:42 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0b0e5f5a-fadc-40f6-b378-78c8005ec504 tempest-ShareRulesTest-1530341375 None] >>> [DELETE] https://127.0.0.1:40443/api/quotas/41/ May 28 13:00:42 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-be414d59-a402-4383-9d4f-fcd80e46f35c tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/shares/f4283c2a-3835-416e-9703-f5745babbf5c returned with HTTP 200 May 28 13:00:42 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 986/1934] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:00:42 2024] GET /share/v2/a4f3887fa28c457390f5b66615564430/shares/f4283c2a-3835-416e-9703-f5745babbf5c => generated 1316 bytes in 25 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:00:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e740797-ce0b-4f21-bc8e-58dae413c7ba service manila] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab5cd18-d513-4c8a-bebd-337238626380 tempest-UserMessageNegativeTest-278135351 tempest-UserMessageNegativeTest-278135351-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f355576e8bff4613bc147c19f97c711c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7942989ad1ef4db2b2e923f7316c8511', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab5cd18-d513-4c8a-bebd-337238626380 tempest-UserMessageNegativeTest-278135351 tempest-UserMessageNegativeTest-278135351-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab5cd18-d513-4c8a-bebd-337238626380 tempest-UserMessageNegativeTest-278135351 tempest-UserMessageNegativeTest-278135351-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab5cd18-d513-4c8a-bebd-337238626380 tempest-UserMessageNegativeTest-278135351 tempest-UserMessageNegativeTest-278135351-project-admin] PATH_INFO: `/v3/users/5000ae7b72ab4d8aad66382d4e873caf` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab5cd18-d513-4c8a-bebd-337238626380 tempest-UserMessageNegativeTest-278135351 tempest-UserMessageNegativeTest-278135351-project-admin] RBAC: Authorizing `identity:delete_user(user_id=5000ae7b72ab4d8aad66382d4e873caf)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab5cd18-d513-4c8a-bebd-337238626380 tempest-UserMessageNegativeTest-278135351 tempest-UserMessageNegativeTest-278135351-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:42 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-cab5cd18-d513-4c8a-bebd-337238626380 tempest-UserMessageNegativeTest-278135351 tempest-UserMessageNegativeTest-278135351-project-admin] Could not find user: 5000ae7b72ab4d8aad66382d4e873caf.: keystone.exception.UserNotFound: Could not find user: 5000ae7b72ab4d8aad66382d4e873caf. May 28 13:00:42 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:00:42 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:00:42 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:00:42 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:00:42 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:00:42 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:00:42 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:00:42 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:00:42 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:00:42 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:00:42 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:00:42 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:00:42 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:00:42 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:00:42 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:00:42 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:00:42 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:00:42 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:00:42 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:00:42 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:00:42 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:00:42 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:00:42 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:00:42 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:00:42 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:00:42 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:00:42 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:00:42 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:00:42 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:00:42 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:00:42 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:00:42 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:00:42 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 13:00:42 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:00:42 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 13:00:42 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:00:42 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:00:42 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:00:42 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 13:00:42 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:00:42 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 13:00:42 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:00:42 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:00:42 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:00:42 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:00:42 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:00:42 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:00:42 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 5000ae7b72ab4d8aad66382d4e873caf. May 28 13:00:42 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 13:00:42 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1437/2902] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:00:42 2024] DELETE /identity/v3/users/5000ae7b72ab4d8aad66382d4e873caf => generated 110 bytes in 88 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:00:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354b53bd-84c2-40fb-a378-83d789c6442c service manila] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354b53bd-84c2-40fb-a378-83d789c6442c service manila] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c118d26-5919-4efe-8f85-d36f73d2f0ff tempest-UserMessageNegativeTest-278135351 tempest-UserMessageNegativeTest-278135351-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f355576e8bff4613bc147c19f97c711c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7942989ad1ef4db2b2e923f7316c8511', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c118d26-5919-4efe-8f85-d36f73d2f0ff tempest-UserMessageNegativeTest-278135351 tempest-UserMessageNegativeTest-278135351-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c118d26-5919-4efe-8f85-d36f73d2f0ff tempest-UserMessageNegativeTest-278135351 tempest-UserMessageNegativeTest-278135351-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c118d26-5919-4efe-8f85-d36f73d2f0ff tempest-UserMessageNegativeTest-278135351 tempest-UserMessageNegativeTest-278135351-project-admin] PATH_INFO: `/v3/users/3fc09c87f69946d2bf009e72ac589cd4` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c118d26-5919-4efe-8f85-d36f73d2f0ff tempest-UserMessageNegativeTest-278135351 tempest-UserMessageNegativeTest-278135351-project-admin] RBAC: Authorizing `identity:delete_user(user_id=3fc09c87f69946d2bf009e72ac589cd4)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c118d26-5919-4efe-8f85-d36f73d2f0ff tempest-UserMessageNegativeTest-278135351 tempest-UserMessageNegativeTest-278135351-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-0c118d26-5919-4efe-8f85-d36f73d2f0ff tempest-UserMessageNegativeTest-278135351 tempest-UserMessageNegativeTest-278135351-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3fc09c87f69946d2bf009e72ac589cd4', 'request_id': 'req-0c118d26-5919-4efe-8f85-d36f73d2f0ff'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-0c118d26-5919-4efe-8f85-d36f73d2f0ff tempest-UserMessageNegativeTest-278135351 tempest-UserMessageNegativeTest-278135351-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3fc09c87f69946d2bf009e72ac589cd4', 'request_id': 'req-0c118d26-5919-4efe-8f85-d36f73d2f0ff'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-0c118d26-5919-4efe-8f85-d36f73d2f0ff tempest-UserMessageNegativeTest-278135351 tempest-UserMessageNegativeTest-278135351-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3fc09c87f69946d2bf009e72ac589cd4', 'request_id': 'req-0c118d26-5919-4efe-8f85-d36f73d2f0ff'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-0c118d26-5919-4efe-8f85-d36f73d2f0ff tempest-UserMessageNegativeTest-278135351 tempest-UserMessageNegativeTest-278135351-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3fc09c87f69946d2bf009e72ac589cd4', 'request_id': 'req-0c118d26-5919-4efe-8f85-d36f73d2f0ff'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-0c118d26-5919-4efe-8f85-d36f73d2f0ff tempest-UserMessageNegativeTest-278135351 tempest-UserMessageNegativeTest-278135351-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3fc09c87f69946d2bf009e72ac589cd4', 'request_id': 'req-0c118d26-5919-4efe-8f85-d36f73d2f0ff'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:42 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1466/2903] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:00:42 2024] DELETE /identity/v3/users/3fc09c87f69946d2bf009e72ac589cd4 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:00:42 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-5422c2bd-28ba-4e37-aa33-28d0b6c2f872 tempest-UserMessageNegativeTest-278135351 tempest-UserMessageNegativeTest-278135351-project-admin] DELETE http://10.27.203.238/share/v2/7942989ad1ef4db2b2e923f7316c8511/types/0fbf68c0-d5aa-4aac-9ee0-4880e66888ff May 28 13:00:42 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-5422c2bd-28ba-4e37-aa33-28d0b6c2f872 tempest-UserMessageNegativeTest-278135351 tempest-UserMessageNegativeTest-278135351-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:42 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-5422c2bd-28ba-4e37-aa33-28d0b6c2f872 tempest-UserMessageNegativeTest-278135351 tempest-UserMessageNegativeTest-278135351-project-admin] Calling method 'ShareTypesController._delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:42 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-5422c2bd-28ba-4e37-aa33-28d0b6c2f872 tempest-UserMessageNegativeTest-278135351 tempest-UserMessageNegativeTest-278135351-project-admin] http://10.27.203.238/share/v2/7942989ad1ef4db2b2e923f7316c8511/types/0fbf68c0-d5aa-4aac-9ee0-4880e66888ff returned with HTTP 202 May 28 13:00:42 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 949/1935] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:00:42 2024] DELETE /share/v2/7942989ad1ef4db2b2e923f7316c8511/types/0fbf68c0-d5aa-4aac-9ee0-4880e66888ff => generated 0 bytes in 44 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 13:00:42 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-aad53d08-a0fa-4971-813f-02e9fb2ba3e5 tempest-UserMessageNegativeTest-278135351 tempest-UserMessageNegativeTest-278135351-project-admin] GET http://10.27.203.238/share/v2/7942989ad1ef4db2b2e923f7316c8511/types/0fbf68c0-d5aa-4aac-9ee0-4880e66888ff May 28 13:00:42 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-aad53d08-a0fa-4971-813f-02e9fb2ba3e5 tempest-UserMessageNegativeTest-278135351 tempest-UserMessageNegativeTest-278135351-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:42 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-aad53d08-a0fa-4971-813f-02e9fb2ba3e5 tempest-UserMessageNegativeTest-278135351 tempest-UserMessageNegativeTest-278135351-project-admin] Calling method 'ShareTypesController.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:42 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-aad53d08-a0fa-4971-813f-02e9fb2ba3e5 tempest-UserMessageNegativeTest-278135351 tempest-UserMessageNegativeTest-278135351-project-admin] HTTP exception thrown: Share type not found. May 28 13:00:42 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-aad53d08-a0fa-4971-813f-02e9fb2ba3e5 tempest-UserMessageNegativeTest-278135351 tempest-UserMessageNegativeTest-278135351-project-admin] http://10.27.203.238/share/v2/7942989ad1ef4db2b2e923f7316c8511/types/0fbf68c0-d5aa-4aac-9ee0-4880e66888ff returned with HTTP 404 May 28 13:00:42 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 987/1936] 10.27.203.238 () {64 vars in 1448 bytes} [Tue May 28 13:00:42 2024] GET /share/v2/7942989ad1ef4db2b2e923f7316c8511/types/0fbf68c0-d5aa-4aac-9ee0-4880e66888ff => generated 67 bytes in 10 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 13:00:42 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-67d14598-71f5-4381-88ba-eefcf5479412 tempest-UserMessageNegativeTest-278135351 tempest-UserMessageNegativeTest-278135351-project-admin] DELETE http://10.27.203.238/share/v2/7942989ad1ef4db2b2e923f7316c8511/types/c9262be3-1b4b-4aba-a74e-efdea4f8422d May 28 13:00:42 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-67d14598-71f5-4381-88ba-eefcf5479412 tempest-UserMessageNegativeTest-278135351 tempest-UserMessageNegativeTest-278135351-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:42 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-67d14598-71f5-4381-88ba-eefcf5479412 tempest-UserMessageNegativeTest-278135351 tempest-UserMessageNegativeTest-278135351-project-admin] Calling method 'ShareTypesController._delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:42 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-67d14598-71f5-4381-88ba-eefcf5479412 tempest-UserMessageNegativeTest-278135351 tempest-UserMessageNegativeTest-278135351-project-admin] http://10.27.203.238/share/v2/7942989ad1ef4db2b2e923f7316c8511/types/c9262be3-1b4b-4aba-a74e-efdea4f8422d returned with HTTP 202 May 28 13:00:42 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 950/1937] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:00:42 2024] DELETE /share/v2/7942989ad1ef4db2b2e923f7316c8511/types/c9262be3-1b4b-4aba-a74e-efdea4f8422d => generated 0 bytes in 58 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 13:00:42 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-35495ab6-2424-408a-b0bd-c02f5f231d39 tempest-UserMessageNegativeTest-278135351 tempest-UserMessageNegativeTest-278135351-project-admin] GET http://10.27.203.238/share/v2/7942989ad1ef4db2b2e923f7316c8511/types/c9262be3-1b4b-4aba-a74e-efdea4f8422d May 28 13:00:42 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-35495ab6-2424-408a-b0bd-c02f5f231d39 tempest-UserMessageNegativeTest-278135351 tempest-UserMessageNegativeTest-278135351-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:42 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-35495ab6-2424-408a-b0bd-c02f5f231d39 tempest-UserMessageNegativeTest-278135351 tempest-UserMessageNegativeTest-278135351-project-admin] Calling method 'ShareTypesController.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:42 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-35495ab6-2424-408a-b0bd-c02f5f231d39 tempest-UserMessageNegativeTest-278135351 tempest-UserMessageNegativeTest-278135351-project-admin] HTTP exception thrown: Share type not found. May 28 13:00:42 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-35495ab6-2424-408a-b0bd-c02f5f231d39 tempest-UserMessageNegativeTest-278135351 tempest-UserMessageNegativeTest-278135351-project-admin] http://10.27.203.238/share/v2/7942989ad1ef4db2b2e923f7316c8511/types/c9262be3-1b4b-4aba-a74e-efdea4f8422d returned with HTTP 404 May 28 13:00:42 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 988/1938] 10.27.203.238 () {64 vars in 1448 bytes} [Tue May 28 13:00:42 2024] GET /share/v2/7942989ad1ef4db2b2e923f7316c8511/types/c9262be3-1b4b-4aba-a74e-efdea4f8422d => generated 67 bytes in 11 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 13:00:42 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-676f99bf-4cee-4b10-8c94-60427a70b171 tempest-UserMessageNegativeTest-278135351 tempest-UserMessageNegativeTest-278135351-project-admin] DELETE http://10.27.203.238/share/v2/7942989ad1ef4db2b2e923f7316c8511/types/38b0bcd7-3e12-43db-9b61-6942639a43c7 May 28 13:00:42 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-676f99bf-4cee-4b10-8c94-60427a70b171 tempest-UserMessageNegativeTest-278135351 tempest-UserMessageNegativeTest-278135351-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:42 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-676f99bf-4cee-4b10-8c94-60427a70b171 tempest-UserMessageNegativeTest-278135351 tempest-UserMessageNegativeTest-278135351-project-admin] Calling method 'ShareTypesController._delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:42 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-676f99bf-4cee-4b10-8c94-60427a70b171 tempest-UserMessageNegativeTest-278135351 tempest-UserMessageNegativeTest-278135351-project-admin] http://10.27.203.238/share/v2/7942989ad1ef4db2b2e923f7316c8511/types/38b0bcd7-3e12-43db-9b61-6942639a43c7 returned with HTTP 202 May 28 13:00:42 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 951/1939] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:00:42 2024] DELETE /share/v2/7942989ad1ef4db2b2e923f7316c8511/types/38b0bcd7-3e12-43db-9b61-6942639a43c7 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 13:00:42 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-bc3c5dd5-0ac2-4a7d-a66a-55f0c37f63cc tempest-UserMessageNegativeTest-278135351 tempest-UserMessageNegativeTest-278135351-project-admin] GET http://10.27.203.238/share/v2/7942989ad1ef4db2b2e923f7316c8511/types/38b0bcd7-3e12-43db-9b61-6942639a43c7 May 28 13:00:42 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-bc3c5dd5-0ac2-4a7d-a66a-55f0c37f63cc tempest-UserMessageNegativeTest-278135351 tempest-UserMessageNegativeTest-278135351-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:42 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-bc3c5dd5-0ac2-4a7d-a66a-55f0c37f63cc tempest-UserMessageNegativeTest-278135351 tempest-UserMessageNegativeTest-278135351-project-admin] Calling method 'ShareTypesController.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:42 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-bc3c5dd5-0ac2-4a7d-a66a-55f0c37f63cc tempest-UserMessageNegativeTest-278135351 tempest-UserMessageNegativeTest-278135351-project-admin] HTTP exception thrown: Share type not found. May 28 13:00:42 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-bc3c5dd5-0ac2-4a7d-a66a-55f0c37f63cc tempest-UserMessageNegativeTest-278135351 tempest-UserMessageNegativeTest-278135351-project-admin] http://10.27.203.238/share/v2/7942989ad1ef4db2b2e923f7316c8511/types/38b0bcd7-3e12-43db-9b61-6942639a43c7 returned with HTTP 404 May 28 13:00:42 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 989/1940] 10.27.203.238 () {64 vars in 1448 bytes} [Tue May 28 13:00:42 2024] GET /share/v2/7942989ad1ef4db2b2e923f7316c8511/types/38b0bcd7-3e12-43db-9b61-6942639a43c7 => generated 67 bytes in 11 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 13:00:42 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-d42e7a5c-af15-455b-9fea-e1939290d2c7 tempest-UserMessageNegativeTest-278135351 tempest-UserMessageNegativeTest-278135351-project-admin] DELETE http://10.27.203.238/share/v2/7942989ad1ef4db2b2e923f7316c8511/types/2c88293c-c1cf-4f32-b55e-f32ed6d44103 May 28 13:00:42 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-d42e7a5c-af15-455b-9fea-e1939290d2c7 tempest-UserMessageNegativeTest-278135351 tempest-UserMessageNegativeTest-278135351-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:42 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-d42e7a5c-af15-455b-9fea-e1939290d2c7 tempest-UserMessageNegativeTest-278135351 tempest-UserMessageNegativeTest-278135351-project-admin] Calling method 'ShareTypesController._delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:42 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-d42e7a5c-af15-455b-9fea-e1939290d2c7 tempest-UserMessageNegativeTest-278135351 tempest-UserMessageNegativeTest-278135351-project-admin] http://10.27.203.238/share/v2/7942989ad1ef4db2b2e923f7316c8511/types/2c88293c-c1cf-4f32-b55e-f32ed6d44103 returned with HTTP 202 May 28 13:00:42 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 952/1941] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:00:42 2024] DELETE /share/v2/7942989ad1ef4db2b2e923f7316c8511/types/2c88293c-c1cf-4f32-b55e-f32ed6d44103 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 13:00:42 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-7680b9cc-3def-45e2-b40c-ac6206907149 tempest-UserMessageNegativeTest-278135351 tempest-UserMessageNegativeTest-278135351-project-admin] GET http://10.27.203.238/share/v2/7942989ad1ef4db2b2e923f7316c8511/types/2c88293c-c1cf-4f32-b55e-f32ed6d44103 May 28 13:00:42 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-7680b9cc-3def-45e2-b40c-ac6206907149 tempest-UserMessageNegativeTest-278135351 tempest-UserMessageNegativeTest-278135351-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:42 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-7680b9cc-3def-45e2-b40c-ac6206907149 tempest-UserMessageNegativeTest-278135351 tempest-UserMessageNegativeTest-278135351-project-admin] Calling method 'ShareTypesController.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:42 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-7680b9cc-3def-45e2-b40c-ac6206907149 tempest-UserMessageNegativeTest-278135351 tempest-UserMessageNegativeTest-278135351-project-admin] HTTP exception thrown: Share type not found. May 28 13:00:42 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-7680b9cc-3def-45e2-b40c-ac6206907149 tempest-UserMessageNegativeTest-278135351 tempest-UserMessageNegativeTest-278135351-project-admin] http://10.27.203.238/share/v2/7942989ad1ef4db2b2e923f7316c8511/types/2c88293c-c1cf-4f32-b55e-f32ed6d44103 returned with HTTP 404 May 28 13:00:42 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 990/1942] 10.27.203.238 () {64 vars in 1448 bytes} [Tue May 28 13:00:42 2024] GET /share/v2/7942989ad1ef4db2b2e923f7316c8511/types/2c88293c-c1cf-4f32-b55e-f32ed6d44103 => generated 67 bytes in 10 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 13:00:43 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-4d165a0e-d1e5-473f-8d0b-aa80eb6380e1 tempest-UserMessageNegativeTest-278135351 tempest-UserMessageNegativeTest-278135351-project-admin] DELETE http://10.27.203.238/share/v2/7942989ad1ef4db2b2e923f7316c8511/types/b3ebc319-dcc2-4092-bb27-3af25168a699 May 28 13:00:43 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-4d165a0e-d1e5-473f-8d0b-aa80eb6380e1 tempest-UserMessageNegativeTest-278135351 tempest-UserMessageNegativeTest-278135351-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:43 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-4d165a0e-d1e5-473f-8d0b-aa80eb6380e1 tempest-UserMessageNegativeTest-278135351 tempest-UserMessageNegativeTest-278135351-project-admin] Calling method 'ShareTypesController._delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:43 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-4d165a0e-d1e5-473f-8d0b-aa80eb6380e1 tempest-UserMessageNegativeTest-278135351 tempest-UserMessageNegativeTest-278135351-project-admin] http://10.27.203.238/share/v2/7942989ad1ef4db2b2e923f7316c8511/types/b3ebc319-dcc2-4092-bb27-3af25168a699 returned with HTTP 202 May 28 13:00:43 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 953/1943] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:00:42 2024] DELETE /share/v2/7942989ad1ef4db2b2e923f7316c8511/types/b3ebc319-dcc2-4092-bb27-3af25168a699 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 13:00:43 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-1884c431-fc38-42d2-bf11-6716b9f09936 tempest-UserMessageNegativeTest-278135351 tempest-UserMessageNegativeTest-278135351-project-admin] GET http://10.27.203.238/share/v2/7942989ad1ef4db2b2e923f7316c8511/types/b3ebc319-dcc2-4092-bb27-3af25168a699 May 28 13:00:43 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-1884c431-fc38-42d2-bf11-6716b9f09936 tempest-UserMessageNegativeTest-278135351 tempest-UserMessageNegativeTest-278135351-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:43 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-1884c431-fc38-42d2-bf11-6716b9f09936 tempest-UserMessageNegativeTest-278135351 tempest-UserMessageNegativeTest-278135351-project-admin] Calling method 'ShareTypesController.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:43 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-1884c431-fc38-42d2-bf11-6716b9f09936 tempest-UserMessageNegativeTest-278135351 tempest-UserMessageNegativeTest-278135351-project-admin] HTTP exception thrown: Share type not found. May 28 13:00:43 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-1884c431-fc38-42d2-bf11-6716b9f09936 tempest-UserMessageNegativeTest-278135351 tempest-UserMessageNegativeTest-278135351-project-admin] http://10.27.203.238/share/v2/7942989ad1ef4db2b2e923f7316c8511/types/b3ebc319-dcc2-4092-bb27-3af25168a699 returned with HTTP 404 May 28 13:00:43 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 991/1944] 10.27.203.238 () {64 vars in 1448 bytes} [Tue May 28 13:00:43 2024] GET /share/v2/7942989ad1ef4db2b2e923f7316c8511/types/b3ebc319-dcc2-4092-bb27-3af25168a699 => generated 67 bytes in 10 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 13:00:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab5cd18-d513-4c8a-bebd-337238626380 tempest-UserMessageNegativeTest-278135351 tempest-UserMessageNegativeTest-278135351-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-cab5cd18-d513-4c8a-bebd-337238626380 tempest-UserMessageNegativeTest-278135351 tempest-UserMessageNegativeTest-278135351-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:00:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab5cd18-d513-4c8a-bebd-337238626380 tempest-UserMessageNegativeTest-278135351 tempest-UserMessageNegativeTest-278135351-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3da5d3b-d8db-4027-a2bc-b2a6ca829d73 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3da5d3b-d8db-4027-a2bc-b2a6ca829d73 None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3da5d3b-d8db-4027-a2bc-b2a6ca829d73 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3da5d3b-d8db-4027-a2bc-b2a6ca829d73 None admin] PATH_INFO: `/v3/users/6a672f6bb8834b02a837a77e45bb8ed0` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3da5d3b-d8db-4027-a2bc-b2a6ca829d73 None admin] RBAC: Authorizing `identity:delete_user(user_id=6a672f6bb8834b02a837a77e45bb8ed0)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3da5d3b-d8db-4027-a2bc-b2a6ca829d73 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-c3da5d3b-d8db-4027-a2bc-b2a6ca829d73 None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a672f6bb8834b02a837a77e45bb8ed0', 'request_id': 'req-c3da5d3b-d8db-4027-a2bc-b2a6ca829d73'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-c3da5d3b-d8db-4027-a2bc-b2a6ca829d73 None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a672f6bb8834b02a837a77e45bb8ed0', 'request_id': 'req-c3da5d3b-d8db-4027-a2bc-b2a6ca829d73'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-c3da5d3b-d8db-4027-a2bc-b2a6ca829d73 None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a672f6bb8834b02a837a77e45bb8ed0', 'request_id': 'req-c3da5d3b-d8db-4027-a2bc-b2a6ca829d73'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-c3da5d3b-d8db-4027-a2bc-b2a6ca829d73 None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a672f6bb8834b02a837a77e45bb8ed0', 'request_id': 'req-c3da5d3b-d8db-4027-a2bc-b2a6ca829d73'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-c3da5d3b-d8db-4027-a2bc-b2a6ca829d73 None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a672f6bb8834b02a837a77e45bb8ed0', 'request_id': 'req-c3da5d3b-d8db-4027-a2bc-b2a6ca829d73'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:43 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1438/2904] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 13:00:43 2024] DELETE /identity/v3/users/6a672f6bb8834b02a837a77e45bb8ed0 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:00:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c118d26-5919-4efe-8f85-d36f73d2f0ff tempest-UserMessageNegativeTest-278135351 tempest-UserMessageNegativeTest-278135351-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c118d26-5919-4efe-8f85-d36f73d2f0ff tempest-UserMessageNegativeTest-278135351 tempest-UserMessageNegativeTest-278135351-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c28ec9d-c611-4e81-8485-777f8dba6f77 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c28ec9d-c611-4e81-8485-777f8dba6f77 None admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c28ec9d-c611-4e81-8485-777f8dba6f77 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c28ec9d-c611-4e81-8485-777f8dba6f77 None admin] PATH_INFO: `/v3/users/a3e32284463040608cbbc67da535d0ec` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c28ec9d-c611-4e81-8485-777f8dba6f77 None admin] RBAC: Authorizing `identity:delete_user(user_id=a3e32284463040608cbbc67da535d0ec)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c28ec9d-c611-4e81-8485-777f8dba6f77 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:43 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e060b217-e2ee-419c-8f77-9c4452fd8ed0 tempest-ShareTypeAvailabilityZonesTest-364532124 None] <<< [POST] https://127.0.0.1:40443/api/views/ May 28 13:00:43 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e060b217-e2ee-419c-8f77-9c4452fd8ed0 tempest-ShareTypeAvailabilityZonesTest-364532124 None] Bunch(abac_tags=[], abe_max_depth=None, abe_protocols=[], alias='', allow_anonymous_access=False, allow_s3_anonymous_access=False, auto_commit='0d', bucket='', bucket_creators=[], bucket_creators_groups=[], bucket_owner=None, bulk_permission_update_progress=None, bulk_permission_update_state=None, cluster='loop75-kfs', cluster_id=1, created='2024-05-28T13:00:42.880677Z', enabled=True, files_retention_mode='NONE', guid='f572bdb3-4b85-4d7e-91da-53af8011e5e8', id=44, ignore_oos=False, internal=False, is_remote=False, is_seamless=False, logical_capacity=0, max_retention_period=None, min_retention_period=None, name='946d9bf7-603c-4faa-8dbe-2cf88c9c8291', nfs_interop_flags='BOTH_NFS3_AND_NFS4_INTEROP_DISABLED', path='/manila/manila-946d9bf7-603c-4faa-8dbe-2cf88c9c8291', physical_capacity=0, policy='946d9bf7-603c-4faa-8dbe-2cf88c9c8291', policy_id=45, protocols=['NFS'], qos_policy=None, qos_policy_id=None, s3_locks=False, s3_locks_retention_mode='NONE', s3_locks_retention_period='', s3_object_ownership_rule='ObjectWriter', s3_unverified_lookup=False, s3_versioning=False, select_for_live_monitoring=False, share='', share_acl=Bunch(acl=[], enabled=False), sync='SYNCED', sync_time='2024-05-28T13:00:43.176101Z', tenant_id=1, tenant_name='default', title='/manila/manila-946d9bf7-603c-4faa-8dbe-2cf88c9c8291', url='https://127.0.0.1:40443/api/views/44/') May 28 13:00:43 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e060b217-e2ee-419c-8f77-9c4452fd8ed0 tempest-ShareTypeAvailabilityZonesTest-364532124 None] --- [POST] https://127.0.0.1:40443/api/views/: Done May 28 13:00:43 l75lg1-v1 dstat.sh[49771]: 28-05 13:00:43| 9 1 86 3 0|5689M 1758M 278M 7899M| 15k 2890B| 0 1792k| 0 328 |7429 12k|1.68 1.21 1.06|2.0 2.0 0| 0 0 | 0 2048M| 29 362 0 45 2 May 28 13:00:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-6c28ec9d-c611-4e81-8485-777f8dba6f77 None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3e32284463040608cbbc67da535d0ec', 'request_id': 'req-6c28ec9d-c611-4e81-8485-777f8dba6f77'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:43 l75lg1-v1 manila-share[98474]: INFO manila.share.manager [None req-e060b217-e2ee-419c-8f77-9c4452fd8ed0 tempest-ShareTypeAvailabilityZonesTest-364532124 None] Share instance 946d9bf7-603c-4faa-8dbe-2cf88c9c8291 created successfully. May 28 13:00:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-6c28ec9d-c611-4e81-8485-777f8dba6f77 None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3e32284463040608cbbc67da535d0ec', 'request_id': 'req-6c28ec9d-c611-4e81-8485-777f8dba6f77'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-6c28ec9d-c611-4e81-8485-777f8dba6f77 None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3e32284463040608cbbc67da535d0ec', 'request_id': 'req-6c28ec9d-c611-4e81-8485-777f8dba6f77'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-6c28ec9d-c611-4e81-8485-777f8dba6f77 None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3e32284463040608cbbc67da535d0ec', 'request_id': 'req-6c28ec9d-c611-4e81-8485-777f8dba6f77'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-6c28ec9d-c611-4e81-8485-777f8dba6f77 None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3e32284463040608cbbc67da535d0ec', 'request_id': 'req-6c28ec9d-c611-4e81-8485-777f8dba6f77'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:43 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1467/2905] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 13:00:43 2024] DELETE /identity/v3/users/a3e32284463040608cbbc67da535d0ec => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:00:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3da5d3b-d8db-4027-a2bc-b2a6ca829d73 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-c3da5d3b-d8db-4027-a2bc-b2a6ca829d73 None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:00:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3da5d3b-d8db-4027-a2bc-b2a6ca829d73 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5516b82f-e3a7-463b-a863-ef2cf3bf701b None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5516b82f-e3a7-463b-a863-ef2cf3bf701b None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5516b82f-e3a7-463b-a863-ef2cf3bf701b None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5516b82f-e3a7-463b-a863-ef2cf3bf701b None admin] PATH_INFO: `/v3/users/f355576e8bff4613bc147c19f97c711c` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5516b82f-e3a7-463b-a863-ef2cf3bf701b None admin] RBAC: Authorizing `identity:delete_user(user_id=f355576e8bff4613bc147c19f97c711c)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5516b82f-e3a7-463b-a863-ef2cf3bf701b None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-5516b82f-e3a7-463b-a863-ef2cf3bf701b None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f355576e8bff4613bc147c19f97c711c', 'request_id': 'req-5516b82f-e3a7-463b-a863-ef2cf3bf701b'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-5516b82f-e3a7-463b-a863-ef2cf3bf701b None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f355576e8bff4613bc147c19f97c711c', 'request_id': 'req-5516b82f-e3a7-463b-a863-ef2cf3bf701b'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-5516b82f-e3a7-463b-a863-ef2cf3bf701b None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f355576e8bff4613bc147c19f97c711c', 'request_id': 'req-5516b82f-e3a7-463b-a863-ef2cf3bf701b'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-5516b82f-e3a7-463b-a863-ef2cf3bf701b None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f355576e8bff4613bc147c19f97c711c', 'request_id': 'req-5516b82f-e3a7-463b-a863-ef2cf3bf701b'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-5516b82f-e3a7-463b-a863-ef2cf3bf701b None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f355576e8bff4613bc147c19f97c711c', 'request_id': 'req-5516b82f-e3a7-463b-a863-ef2cf3bf701b'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:43 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1439/2906] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 13:00:43 2024] DELETE /identity/v3/users/f355576e8bff4613bc147c19f97c711c => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:00:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3add6ff-b5fb-4939-9a22-f01b66620b65 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3add6ff-b5fb-4939-9a22-f01b66620b65 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3add6ff-b5fb-4939-9a22-f01b66620b65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:43 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-b3add6ff-b5fb-4939-9a22-f01b66620b65 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 13:00:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-b3add6ff-b5fb-4939-9a22-f01b66620b65 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 13:00:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-b3add6ff-b5fb-4939-9a22-f01b66620b65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:00:43 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1468/2907] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 13:00:43 2024] POST /identity/v3/auth/tokens => generated 2960 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 13:00:43 l75lg1-v1 neutron-server[77619]: DEBUG neutron.wsgi [-] (77619) accepted ('10.27.203.238', 41868) {{(pid=77619) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 13:00:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5516b82f-e3a7-463b-a863-ef2cf3bf701b None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-5516b82f-e3a7-463b-a863-ef2cf3bf701b None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:00:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5516b82f-e3a7-463b-a863-ef2cf3bf701b None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a971eb5b-c068-4b2f-816a-4f3c8fb4a096 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef17047035e4b518fd5360a01f2da1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a971eb5b-c068-4b2f-816a-4f3c8fb4a096 service neutron] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a971eb5b-c068-4b2f-816a-4f3c8fb4a096 service neutron] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a971eb5b-c068-4b2f-816a-4f3c8fb4a096 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a971eb5b-c068-4b2f-816a-4f3c8fb4a096 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a971eb5b-c068-4b2f-816a-4f3c8fb4a096 service neutron] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:43 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1440/2908] 10.27.203.238 () {64 vars in 1432 bytes} [Tue May 28 13:00:43 2024] GET /identity/v3/auth/tokens => generated 2960 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 28 13:00:43 l75lg1-v1 neutron-server[77619]: INFO neutron.wsgi [None req-765f1cab-9433-4397-9db7-95211230677e None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=ca9b4c5f200844bdbcc6db13e907f21e&name=default HTTP/1.1" status: 200 len: 216 time: 0.0742958 May 28 13:00:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3add6ff-b5fb-4939-9a22-f01b66620b65 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-b3add6ff-b5fb-4939-9a22-f01b66620b65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:00:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3add6ff-b5fb-4939-9a22-f01b66620b65 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad838ced-9ae3-4c8f-882c-98d43d66c967 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad838ced-9ae3-4c8f-882c-98d43d66c967 None admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad838ced-9ae3-4c8f-882c-98d43d66c967 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad838ced-9ae3-4c8f-882c-98d43d66c967 None admin] PATH_INFO: `/v3/projects/ca9b4c5f200844bdbcc6db13e907f21e` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad838ced-9ae3-4c8f-882c-98d43d66c967 None admin] RBAC: Authorizing `identity:delete_project(project_id=ca9b4c5f200844bdbcc6db13e907f21e)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad838ced-9ae3-4c8f-882c-98d43d66c967 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-ad838ced-9ae3-4c8f-882c-98d43d66c967 None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca9b4c5f200844bdbcc6db13e907f21e', 'request_id': 'req-ad838ced-9ae3-4c8f-882c-98d43d66c967'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-ad838ced-9ae3-4c8f-882c-98d43d66c967 None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca9b4c5f200844bdbcc6db13e907f21e', 'request_id': 'req-ad838ced-9ae3-4c8f-882c-98d43d66c967'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-ad838ced-9ae3-4c8f-882c-98d43d66c967 None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca9b4c5f200844bdbcc6db13e907f21e', 'request_id': 'req-ad838ced-9ae3-4c8f-882c-98d43d66c967'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-ad838ced-9ae3-4c8f-882c-98d43d66c967 None admin] The token cache is being invalidate because project ca9b4c5f200844bdbcc6db13e907f21e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 13:00:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-ad838ced-9ae3-4c8f-882c-98d43d66c967 None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-ad838ced-9ae3-4c8f-882c-98d43d66c967 None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:43 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1469/2909] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 13:00:43 2024] DELETE /identity/v3/projects/ca9b4c5f200844bdbcc6db13e907f21e => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:00:43 l75lg1-v1 neutron-server[77619]: DEBUG neutron.wsgi [-] (77619) accepted ('10.27.203.238', 41884) {{(pid=77619) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 13:00:43 l75lg1-v1 neutron-server[77619]: INFO neutron.wsgi [None req-93437a2b-e84b-4c06-a403-85056857702e None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=59c1579619b6422fa4c591102b473b67&name=default HTTP/1.1" status: 200 len: 216 time: 0.0085623 May 28 13:00:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a971eb5b-c068-4b2f-816a-4f3c8fb4a096 service neutron] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a971eb5b-c068-4b2f-816a-4f3c8fb4a096 service neutron] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb5671b-1edd-4cfe-9330-5a6dac7732f6 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb5671b-1edd-4cfe-9330-5a6dac7732f6 None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb5671b-1edd-4cfe-9330-5a6dac7732f6 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb5671b-1edd-4cfe-9330-5a6dac7732f6 None admin] PATH_INFO: `/v3/projects/59c1579619b6422fa4c591102b473b67` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb5671b-1edd-4cfe-9330-5a6dac7732f6 None admin] RBAC: Authorizing `identity:delete_project(project_id=59c1579619b6422fa4c591102b473b67)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb5671b-1edd-4cfe-9330-5a6dac7732f6 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-4bb5671b-1edd-4cfe-9330-5a6dac7732f6 None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59c1579619b6422fa4c591102b473b67', 'request_id': 'req-4bb5671b-1edd-4cfe-9330-5a6dac7732f6'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-4bb5671b-1edd-4cfe-9330-5a6dac7732f6 None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59c1579619b6422fa4c591102b473b67', 'request_id': 'req-4bb5671b-1edd-4cfe-9330-5a6dac7732f6'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-4bb5671b-1edd-4cfe-9330-5a6dac7732f6 None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59c1579619b6422fa4c591102b473b67', 'request_id': 'req-4bb5671b-1edd-4cfe-9330-5a6dac7732f6'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-4bb5671b-1edd-4cfe-9330-5a6dac7732f6 None admin] The token cache is being invalidate because project 59c1579619b6422fa4c591102b473b67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 13:00:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-4bb5671b-1edd-4cfe-9330-5a6dac7732f6 None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-4bb5671b-1edd-4cfe-9330-5a6dac7732f6 None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:43 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1441/2910] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 13:00:43 2024] DELETE /identity/v3/projects/59c1579619b6422fa4c591102b473b67 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:00:43 l75lg1-v1 neutron-server[77619]: DEBUG neutron.wsgi [-] (77619) accepted ('10.27.203.238', 41896) {{(pid=77619) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 13:00:43 l75lg1-v1 neutron-server[77619]: INFO neutron.wsgi [None req-733655d0-a0d5-479d-b6a1-16496ba7b13a None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=7942989ad1ef4db2b2e923f7316c8511&name=default HTTP/1.1" status: 200 len: 216 time: 0.0086622 May 28 13:00:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad838ced-9ae3-4c8f-882c-98d43d66c967 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-ad838ced-9ae3-4c8f-882c-98d43d66c967 None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:00:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad838ced-9ae3-4c8f-882c-98d43d66c967 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc0c609-619e-47e4-9c03-08ae9c0b79bb None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc0c609-619e-47e4-9c03-08ae9c0b79bb None admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc0c609-619e-47e4-9c03-08ae9c0b79bb None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc0c609-619e-47e4-9c03-08ae9c0b79bb None admin] PATH_INFO: `/v3/projects/7942989ad1ef4db2b2e923f7316c8511` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc0c609-619e-47e4-9c03-08ae9c0b79bb None admin] RBAC: Authorizing `identity:delete_project(project_id=7942989ad1ef4db2b2e923f7316c8511)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc0c609-619e-47e4-9c03-08ae9c0b79bb None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-2cc0c609-619e-47e4-9c03-08ae9c0b79bb None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7942989ad1ef4db2b2e923f7316c8511', 'request_id': 'req-2cc0c609-619e-47e4-9c03-08ae9c0b79bb'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-2cc0c609-619e-47e4-9c03-08ae9c0b79bb None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7942989ad1ef4db2b2e923f7316c8511', 'request_id': 'req-2cc0c609-619e-47e4-9c03-08ae9c0b79bb'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-2cc0c609-619e-47e4-9c03-08ae9c0b79bb None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7942989ad1ef4db2b2e923f7316c8511', 'request_id': 'req-2cc0c609-619e-47e4-9c03-08ae9c0b79bb'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-2cc0c609-619e-47e4-9c03-08ae9c0b79bb None admin] The token cache is being invalidate because project 7942989ad1ef4db2b2e923f7316c8511 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 13:00:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-2cc0c609-619e-47e4-9c03-08ae9c0b79bb None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-2cc0c609-619e-47e4-9c03-08ae9c0b79bb None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:43 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1470/2911] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 13:00:43 2024] DELETE /identity/v3/projects/7942989ad1ef4db2b2e923f7316c8511 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:00:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c0f41d-dbd1-49cb-b789-e514f694cf8a None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c0f41d-dbd1-49cb-b789-e514f694cf8a None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c0f41d-dbd1-49cb-b789-e514f694cf8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:43 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-07c0f41d-dbd1-49cb-b789-e514f694cf8a None None] Truncating password to algorithm specific maximum length 72 characters. May 28 13:00:43 l75lg1-v1 neutron-server[77618]: DEBUG dbcounter [-] [77618] Writing DB stats neutron:SELECT=4,neutron:UPDATE=1 {{(pid=77618) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:00:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-07c0f41d-dbd1-49cb-b789-e514f694cf8a None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 13:00:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-07c0f41d-dbd1-49cb-b789-e514f694cf8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:00:43 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1442/2912] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 13:00:43 2024] POST /identity/v3/auth/tokens => generated 312 bytes in 22 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 28 13:00:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9cf4ee-8ded-4b88-bd48-993b3a5167c5 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9cf4ee-8ded-4b88-bd48-993b3a5167c5 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9cf4ee-8ded-4b88-bd48-993b3a5167c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:43 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-cc9cf4ee-8ded-4b88-bd48-993b3a5167c5 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 13:00:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-cc9cf4ee-8ded-4b88-bd48-993b3a5167c5 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 13:00:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-cc9cf4ee-8ded-4b88-bd48-993b3a5167c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:00:43 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1471/2913] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 13:00:43 2024] POST /identity/v3/auth/tokens => generated 2960 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 13:00:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c0f41d-dbd1-49cb-b789-e514f694cf8a None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c0f41d-dbd1-49cb-b789-e514f694cf8a None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c8436b-9bc8-4aa0-bda6-2be380ed9450 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c8436b-9bc8-4aa0-bda6-2be380ed9450 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c8436b-9bc8-4aa0-bda6-2be380ed9450 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c8436b-9bc8-4aa0-bda6-2be380ed9450 None admin] PATH_INFO: `/v3/domains` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c8436b-9bc8-4aa0-bda6-2be380ed9450 None admin] RBAC: Adding query filter params (name=Default) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 13:00:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c8436b-9bc8-4aa0-bda6-2be380ed9450 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c8436b-9bc8-4aa0-bda6-2be380ed9450 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:44 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1443/2914] 10.27.203.238 () {62 vars in 1220 bytes} [Tue May 28 13:00:43 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 13:00:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9cf4ee-8ded-4b88-bd48-993b3a5167c5 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9cf4ee-8ded-4b88-bd48-993b3a5167c5 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a685e404-ddb6-452e-8059-0e1c83495917 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a685e404-ddb6-452e-8059-0e1c83495917 None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a685e404-ddb6-452e-8059-0e1c83495917 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a685e404-ddb6-452e-8059-0e1c83495917 None admin] PATH_INFO: `/v3/projects` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a685e404-ddb6-452e-8059-0e1c83495917 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a685e404-ddb6-452e-8059-0e1c83495917 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:44 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1472/2915] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 13:00:44 2024] POST /identity/v3/projects => generated 401 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 13:00:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c8436b-9bc8-4aa0-bda6-2be380ed9450 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:44 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-1a1e230f-f212-4d7d-8d63-1c35211e2817 tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] GET http://10.27.203.238/share/v2/284d76edec3144579d6fb3f6dbc0dd4e/shares/da80429c-1281-4450-a386-ed0e9d82a3ff May 28 13:00:44 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-1a1e230f-f212-4d7d-8d63-1c35211e2817 tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:44 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-1a1e230f-f212-4d7d-8d63-1c35211e2817 tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c8436b-9bc8-4aa0-bda6-2be380ed9450 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:44 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-1a1e230f-f212-4d7d-8d63-1c35211e2817 tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] http://10.27.203.238/share/v2/284d76edec3144579d6fb3f6dbc0dd4e/shares/da80429c-1281-4450-a386-ed0e9d82a3ff returned with HTTP 200 May 28 13:00:44 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 954/1945] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:00:44 2024] GET /share/v2/284d76edec3144579d6fb3f6dbc0dd4e/shares/da80429c-1281-4450-a386-ed0e9d82a3ff => generated 1317 bytes in 26 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:00:44 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-2236152e-728d-459c-b88a-70facf8b8987 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] PUT http://10.27.203.238/share/v2/bb20757ddd604868aff8ad38db5def87/types/7d2ea8e8-bada-4826-a8a8-53b4e9ff301f/extra_specs/availability_zones May 28 13:00:44 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-2236152e-728d-459c-b88a-70facf8b8987 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] Action: 'update', calling method: ShareTypeExtraSpecsController.update, body: {"availability_zones": "az_that_doesnt_exist"} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:00:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a60be50-32f9-4829-9507-88f7763f869e None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a60be50-32f9-4829-9507-88f7763f869e None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a60be50-32f9-4829-9507-88f7763f869e None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a60be50-32f9-4829-9507-88f7763f869e None admin] PATH_INFO: `/v3/users` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a60be50-32f9-4829-9507-88f7763f869e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a60be50-32f9-4829-9507-88f7763f869e None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:44 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-9d1c45fd-c89b-46de-81bc-10d581873517 tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] GET http://10.27.203.238/share/v2/cac556dc39a14bbdbdbabfc80672fb1f/shares/0c7ef0a2-5628-47dd-9eba-98153028dd8a May 28 13:00:44 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-9d1c45fd-c89b-46de-81bc-10d581873517 tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:44 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-7a60be50-32f9-4829-9507-88f7763f869e None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 13:00:44 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-9d1c45fd-c89b-46de-81bc-10d581873517 tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:44 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-2236152e-728d-459c-b88a-70facf8b8987 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] http://10.27.203.238/share/v2/bb20757ddd604868aff8ad38db5def87/types/7d2ea8e8-bada-4826-a8a8-53b4e9ff301f/extra_specs/availability_zones returned with HTTP 200 May 28 13:00:44 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 992/1946] 10.27.203.238 () {66 vars in 1561 bytes} [Tue May 28 13:00:44 2024] PUT /share/v2/bb20757ddd604868aff8ad38db5def87/types/7d2ea8e8-bada-4826-a8a8-53b4e9ff301f/extra_specs/availability_zones => generated 46 bytes in 24 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:00:44 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-2ee65bb9-323a-4b84-b37e-5e80a5aca94a tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] POST http://10.27.203.238/share/v2/284d76edec3144579d6fb3f6dbc0dd4e/shares May 28 13:00:44 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-2ee65bb9-323a-4b84-b37e-5e80a5aca94a tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share": {"share_proto": "nfs", "description": "Tempest's share", "snapshot_id": null, "name": "tempest-tempest-created-share-1623858982", "size": 1, "metadata": {}, "is_public": false, "share_type": "7d2ea8e8-bada-4826-a8a8-53b4e9ff301f"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:00:44 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.v1.shares [None req-2ee65bb9-323a-4b84-b37e-5e80a5aca94a tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] Create NFS share of 1 GB May 28 13:00:44 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1444/2916] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 13:00:44 2024] POST /identity/v3/users => generated 309 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 13:00:44 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-9d1c45fd-c89b-46de-81bc-10d581873517 tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] http://10.27.203.238/share/v2/cac556dc39a14bbdbdbabfc80672fb1f/shares/0c7ef0a2-5628-47dd-9eba-98153028dd8a returned with HTTP 200 May 28 13:00:44 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 955/1947] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:00:44 2024] GET /share/v2/cac556dc39a14bbdbdbabfc80672fb1f/shares/0c7ef0a2-5628-47dd-9eba-98153028dd8a => generated 1315 bytes in 29 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:00:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a685e404-ddb6-452e-8059-0e1c83495917 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a685e404-ddb6-452e-8059-0e1c83495917 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0869266f-6f33-4ad4-8ea2-13e3c545a814 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0869266f-6f33-4ad4-8ea2-13e3c545a814 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0869266f-6f33-4ad4-8ea2-13e3c545a814 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0869266f-6f33-4ad4-8ea2-13e3c545a814 None admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0869266f-6f33-4ad4-8ea2-13e3c545a814 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0869266f-6f33-4ad4-8ea2-13e3c545a814 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:44 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1473/2917] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 13:00:44 2024] GET /identity/v3/roles => generated 1680 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 13:00:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a60be50-32f9-4829-9507-88f7763f869e None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a60be50-32f9-4829-9507-88f7763f869e None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77a6e73-9c5a-4e51-bf47-f4bbe256971c None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77a6e73-9c5a-4e51-bf47-f4bbe256971c None admin] REQUEST_METHOD: `PUT` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77a6e73-9c5a-4e51-bf47-f4bbe256971c None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77a6e73-9c5a-4e51-bf47-f4bbe256971c None admin] PATH_INFO: `/v3/projects/0b376d107c864059beda8a4c177e12ed/users/a93e6b0fb8d14a5eb22917129ec8a011/roles/44620cad10ae407c90c91e2c296adb04` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:44 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-df1d3fc8-e0d9-4d36-8fd1-0a8f7df857d7 tempest-ShareTransferNegativeTest-884271560 None] <<< [DELETE] https://127.0.0.1:40443/api/views/40/ May 28 13:00:44 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-df1d3fc8-e0d9-4d36-8fd1-0a8f7df857d7 tempest-ShareTransferNegativeTest-884271560 None] --- [DELETE] https://127.0.0.1:40443/api/views/40/: Done May 28 13:00:44 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-df1d3fc8-e0d9-4d36-8fd1-0a8f7df857d7 tempest-ShareTransferNegativeTest-884271560 None] >>> [GET] https://127.0.0.1:40443/api/quotas/ May 28 13:00:44 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-df1d3fc8-e0d9-4d36-8fd1-0a8f7df857d7 tempest-ShareTransferNegativeTest-884271560 None] {'allow_redirects': True, May 28 13:00:44 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-df1d3fc8-e0d9-4d36-8fd1-0a8f7df857d7 tempest-ShareTransferNegativeTest-884271560 None] 'params': {'name': 'e21891ab-7145-4d59-b238-375b52d59cb7'}} May 28 13:00:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77a6e73-9c5a-4e51-bf47-f4bbe256971c None admin] RBAC: Authorizing `identity:create_grant(project_id=0b376d107c864059beda8a4c177e12ed, user_id=a93e6b0fb8d14a5eb22917129ec8a011, role_id=44620cad10ae407c90c91e2c296adb04)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77a6e73-9c5a-4e51-bf47-f4bbe256971c None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:44 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1445/2918] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 13:00:44 2024] PUT /identity/v3/projects/0b376d107c864059beda8a4c177e12ed/users/a93e6b0fb8d14a5eb22917129ec8a011/roles/44620cad10ae407c90c91e2c296adb04 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:00:44 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.quota [None req-2ee65bb9-323a-4b84-b37e-5e80a5aca94a tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] Created reservations ['4477d049-7314-4fe7-a966-efe6bac4571b', 'acca974a-ada1-4c5b-af20-f33eabb2178f', 'b80f633b-cabc-457b-9188-198cc595322a', 'b47560b1-c693-4051-9668-d92b95f7a9c0'] {{(pid=98329) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 13:00:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72d8deb-19a0-4a91-927d-3bc7ac9aa467 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72d8deb-19a0-4a91-927d-3bc7ac9aa467 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72d8deb-19a0-4a91-927d-3bc7ac9aa467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:44 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-d72d8deb-19a0-4a91-927d-3bc7ac9aa467 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 13:00:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-d72d8deb-19a0-4a91-927d-3bc7ac9aa467 None None] MFA Rules not processed for user `a93e6b0fb8d14a5eb22917129ec8a011`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 13:00:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-d72d8deb-19a0-4a91-927d-3bc7ac9aa467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:00:44 l75lg1-v1 dstat.sh[49771]: 28-05 13:00:44| 11 2 84 3 0|5691M 1756M 278M 7900M| 16k 2597B| 0 2386k| 0 354 |7855 14k|1.68 1.21 1.06|4.0 3.0 0| 0 0 | 0 2048M| 29 363 0 49 2 May 28 13:00:44 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.quota [None req-2ee65bb9-323a-4b84-b37e-5e80a5aca94a tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] Committed reservations ['4477d049-7314-4fe7-a966-efe6bac4571b', 'acca974a-ada1-4c5b-af20-f33eabb2178f', 'b80f633b-cabc-457b-9188-198cc595322a', 'b47560b1-c693-4051-9668-d92b95f7a9c0'] {{(pid=98329) commit /opt/stack/manila/manila/quota.py:1063}} May 28 13:00:44 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1474/2919] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 13:00:44 2024] POST /identity/v3/auth/tokens => generated 3972 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 13:00:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77a6e73-9c5a-4e51-bf47-f4bbe256971c None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77a6e73-9c5a-4e51-bf47-f4bbe256971c None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee83e16-d541-4e17-96c7-c8519cb1b8ea None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee83e16-d541-4e17-96c7-c8519cb1b8ea None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee83e16-d541-4e17-96c7-c8519cb1b8ea None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee83e16-d541-4e17-96c7-c8519cb1b8ea None admin] PATH_INFO: `/v3/projects` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee83e16-d541-4e17-96c7-c8519cb1b8ea None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee83e16-d541-4e17-96c7-c8519cb1b8ea None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:44 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.host_manager [None req-2ee65bb9-323a-4b84-b37e-5e80a5aca94a tempest-ShareTypeAvailabilityZonesTest-364532124 None] Share service is down. (host: l75lg1-v1@generic2). May 28 13:00:44 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.host_manager [None req-2ee65bb9-323a-4b84-b37e-5e80a5aca94a tempest-ShareTypeAvailabilityZonesTest-364532124 None] Share service is down. (host: l75lg1-v1@generic1). May 28 13:00:44 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-2ee65bb9-323a-4b84-b37e-5e80a5aca94a tempest-ShareTypeAvailabilityZonesTest-364532124 None] Starting with 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:80}} May 28 13:00:44 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-2ee65bb9-323a-4b84-b37e-5e80a5aca94a tempest-ShareTypeAvailabilityZonesTest-364532124 None] Filter OnlyHostFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:00:44 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-2ee65bb9-323a-4b84-b37e-5e80a5aca94a tempest-ShareTypeAvailabilityZonesTest-364532124 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:00:44 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.capacity [None req-2ee65bb9-323a-4b84-b37e-5e80a5aca94a tempest-ShareTypeAvailabilityZonesTest-364532124 None] Space information for share creation on host l75lg1-v1@vast#vast (requested / avail): 1/2074 {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/capacity.py:83}} May 28 13:00:44 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-2ee65bb9-323a-4b84-b37e-5e80a5aca94a tempest-ShareTypeAvailabilityZonesTest-364532124 None] Filter CapacityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:00:44 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-2ee65bb9-323a-4b84-b37e-5e80a5aca94a tempest-ShareTypeAvailabilityZonesTest-364532124 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:00:44 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-2ee65bb9-323a-4b84-b37e-5e80a5aca94a tempest-ShareTypeAvailabilityZonesTest-364532124 None] Driver Filter: Checking host 'l75lg1-v1@vast#vast' {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:37}} May 28 13:00:44 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-2ee65bb9-323a-4b84-b37e-5e80a5aca94a tempest-ShareTypeAvailabilityZonesTest-364532124 None] Filter function not set :: passing host. {{(pid=98327) _check_filter_function /opt/stack/manila/manila/scheduler/filters/driver.py:53}} May 28 13:00:44 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-2ee65bb9-323a-4b84-b37e-5e80a5aca94a tempest-ShareTypeAvailabilityZonesTest-364532124 None] Result: True {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:40}} May 28 13:00:44 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-2ee65bb9-323a-4b84-b37e-5e80a5aca94a tempest-ShareTypeAvailabilityZonesTest-364532124 None] Done checking host 'l75lg1-v1@vast#vast' {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:41}} May 28 13:00:44 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-2ee65bb9-323a-4b84-b37e-5e80a5aca94a tempest-ShareTypeAvailabilityZonesTest-364532124 None] Filter DriverFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:00:44 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-2ee65bb9-323a-4b84-b37e-5e80a5aca94a tempest-ShareTypeAvailabilityZonesTest-364532124 None] Filter ShareReplicationFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:00:44 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-2ee65bb9-323a-4b84-b37e-5e80a5aca94a tempest-ShareTypeAvailabilityZonesTest-364532124 None] Filter CreateFromSnapshotFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:00:44 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-2ee65bb9-323a-4b84-b37e-5e80a5aca94a tempest-ShareTypeAvailabilityZonesTest-364532124 None] Filter AffinityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:00:44 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-2ee65bb9-323a-4b84-b37e-5e80a5aca94a tempest-ShareTypeAvailabilityZonesTest-364532124 None] Filter AntiAffinityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:00:44 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.drivers.filter [None req-2ee65bb9-323a-4b84-b37e-5e80a5aca94a tempest-ShareTypeAvailabilityZonesTest-364532124 None] Filtered share [host: 'l75lg1-v1@vast#vast', free_capacity_gb: 2074.6478263456374, pools: None] {{(pid=98327) _schedule_share /opt/stack/manila/manila/scheduler/drivers/filter.py:268}} May 28 13:00:44 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-2ee65bb9-323a-4b84-b37e-5e80a5aca94a tempest-ShareTypeAvailabilityZonesTest-364532124 None] Checking host 'l75lg1-v1@vast#vast' {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:46}} May 28 13:00:44 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.weighers.goodness [None req-2ee65bb9-323a-4b84-b37e-5e80a5aca94a tempest-ShareTypeAvailabilityZonesTest-364532124 None] Goodness function not set :: defaulting to minimal goodness rating of 0. May 28 13:00:44 l75lg1-v1 manila-scheduler[98327]: INFO manila.scheduler.weighers.goodness [None req-2ee65bb9-323a-4b84-b37e-5e80a5aca94a tempest-ShareTypeAvailabilityZonesTest-364532124 None] Goodness function result for host l75lg1-v1@vast#vast: 0. May 28 13:00:44 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-2ee65bb9-323a-4b84-b37e-5e80a5aca94a tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] http://10.27.203.238/share/v2/284d76edec3144579d6fb3f6dbc0dd4e/shares returned with HTTP 200 May 28 13:00:44 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-2ee65bb9-323a-4b84-b37e-5e80a5aca94a tempest-ShareTypeAvailabilityZonesTest-364532124 None] Goodness: 0 {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:48}} May 28 13:00:44 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-2ee65bb9-323a-4b84-b37e-5e80a5aca94a tempest-ShareTypeAvailabilityZonesTest-364532124 None] Done checking host 'l75lg1-v1@vast#vast' {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:49}} May 28 13:00:44 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 993/1948] 10.27.203.238 () {66 vars in 1362 bytes} [Tue May 28 13:00:44 2024] POST /share/v2/284d76edec3144579d6fb3f6dbc0dd4e/shares => generated 1206 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 232 bytes (2 switches on core 0) May 28 13:00:44 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.drivers.filter [None req-2ee65bb9-323a-4b84-b37e-5e80a5aca94a tempest-ShareTypeAvailabilityZonesTest-364532124 None] Choosing for share: WeighedHost [host: l75lg1-v1@vast#vast, weight: 0.0] {{(pid=98327) _schedule_share /opt/stack/manila/manila/scheduler/drivers/filter.py:274}} May 28 13:00:44 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1446/2920] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 13:00:44 2024] POST /identity/v3/projects => generated 401 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 13:00:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72d8deb-19a0-4a91-927d-3bc7ac9aa467 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:44 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-78a796b3-2b3b-4056-b51d-e356420a1473 tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] GET http://10.27.203.238/share/v2/284d76edec3144579d6fb3f6dbc0dd4e/shares/433f546f-3297-46a0-b412-18630103d191 May 28 13:00:44 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-78a796b3-2b3b-4056-b51d-e356420a1473 tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:44 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-78a796b3-2b3b-4056-b51d-e356420a1473 tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72d8deb-19a0-4a91-927d-3bc7ac9aa467 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:44 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-78a796b3-2b3b-4056-b51d-e356420a1473 tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] http://10.27.203.238/share/v2/284d76edec3144579d6fb3f6dbc0dd4e/shares/433f546f-3297-46a0-b412-18630103d191 returned with HTTP 200 May 28 13:00:44 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 956/1949] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:00:44 2024] GET /share/v2/284d76edec3144579d6fb3f6dbc0dd4e/shares/433f546f-3297-46a0-b412-18630103d191 => generated 1312 bytes in 26 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:00:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba8fc56-f49c-4c8a-8306-37d1770eb9c2 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba8fc56-f49c-4c8a-8306-37d1770eb9c2 None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba8fc56-f49c-4c8a-8306-37d1770eb9c2 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba8fc56-f49c-4c8a-8306-37d1770eb9c2 None admin] PATH_INFO: `/v3/users` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba8fc56-f49c-4c8a-8306-37d1770eb9c2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba8fc56-f49c-4c8a-8306-37d1770eb9c2 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:44 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-1ba8fc56-f49c-4c8a-8306-37d1770eb9c2 None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 13:00:44 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1475/2921] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 13:00:44 2024] POST /identity/v3/users => generated 309 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 13:00:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee83e16-d541-4e17-96c7-c8519cb1b8ea None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee83e16-d541-4e17-96c7-c8519cb1b8ea None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cedbad5-d7a7-404b-8aac-b70f49d8427b None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cedbad5-d7a7-404b-8aac-b70f49d8427b None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cedbad5-d7a7-404b-8aac-b70f49d8427b None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cedbad5-d7a7-404b-8aac-b70f49d8427b None admin] PATH_INFO: `/v3/roles` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cedbad5-d7a7-404b-8aac-b70f49d8427b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cedbad5-d7a7-404b-8aac-b70f49d8427b None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:44 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1447/2922] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 13:00:44 2024] GET /identity/v3/roles => generated 1680 bytes in 18 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 13:00:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba8fc56-f49c-4c8a-8306-37d1770eb9c2 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba8fc56-f49c-4c8a-8306-37d1770eb9c2 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0a99f3-ce16-4327-b54a-75658d9f5bbd None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0a99f3-ce16-4327-b54a-75658d9f5bbd None admin] REQUEST_METHOD: `PUT` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0a99f3-ce16-4327-b54a-75658d9f5bbd None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0a99f3-ce16-4327-b54a-75658d9f5bbd None admin] PATH_INFO: `/v3/projects/4bd9770e677e45d39cf34fdbbb5594a2/users/db5dd5ae5b1e43f1baa6f93efd57818a/roles/44620cad10ae407c90c91e2c296adb04` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0a99f3-ce16-4327-b54a-75658d9f5bbd None admin] RBAC: Authorizing `identity:create_grant(project_id=4bd9770e677e45d39cf34fdbbb5594a2, user_id=db5dd5ae5b1e43f1baa6f93efd57818a, role_id=44620cad10ae407c90c91e2c296adb04)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0a99f3-ce16-4327-b54a-75658d9f5bbd None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:44 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2ee65bb9-323a-4b84-b37e-5e80a5aca94a tempest-ShareTypeAvailabilityZonesTest-364532124 None] >>> [GET] https://127.0.0.1:40443/api/vippools/ May 28 13:00:44 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2ee65bb9-323a-4b84-b37e-5e80a5aca94a tempest-ShareTypeAvailabilityZonesTest-364532124 None] {'allow_redirects': True, 'params': {'name': 'vippool-1'}} May 28 13:00:44 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-df1d3fc8-e0d9-4d36-8fd1-0a8f7df857d7 tempest-ShareTransferNegativeTest-884271560 None] <<< [GET] https://127.0.0.1:40443/api/quotas/ May 28 13:00:44 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1476/2923] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 13:00:44 2024] PUT /identity/v3/projects/4bd9770e677e45d39cf34fdbbb5594a2/users/db5dd5ae5b1e43f1baa6f93efd57818a/roles/44620cad10ae407c90c91e2c296adb04 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:00:44 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-df1d3fc8-e0d9-4d36-8fd1-0a8f7df857d7 tempest-ShareTransferNegativeTest-884271560 None] [Bunch(cluster='loop75-kfs', cluster_id=1, default_email=None, default_group_quota=None, default_user_quota=None, enable_alarms=True, enable_email_providers=True, grace_period=None, guid='31ba1ce3-9332-4452-8bfa-4815ed286c51', hard_limit=1073741824, hard_limit_inodes=None, id=38, internal=False, is_user_quota=False, last_user_quotas_update=None, name='e21891ab-7145-4d59-b238-375b52d59cb7', num_blocked_users=0, num_exceeded_users=0, path='/manila/manila-e21891ab-7145-4d59-b238-375b52d59cb7', percent_capacity=0, percent_inodes=None, pretty_grace_period=None, pretty_grace_period_expiration=None, pretty_state='OK', soft_limit=None, soft_limit_inodes=None, state='OK', sync_state='SYNCHRONIZED', system_id=38, tenant_id=1, tenant_name='default', time_to_block=None, title='e21891ab-7145-4d59-b238-375b52d59cb7', url='https://127.0.0.1:40443/api/quotas/38/', used_capacity=0, used_capacity_tb=0.0, used_effective_capacity=0, used_effective_capacity_tb=0.0, used_inodes=1, used_limited_capacity=0)] May 28 13:00:44 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-df1d3fc8-e0d9-4d36-8fd1-0a8f7df857d7 tempest-ShareTransferNegativeTest-884271560 None] --- [GET] https://127.0.0.1:40443/api/quotas/: Done May 28 13:00:44 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-df1d3fc8-e0d9-4d36-8fd1-0a8f7df857d7 tempest-ShareTransferNegativeTest-884271560 None] >>> [DELETE] https://127.0.0.1:40443/api/quotas/38/ May 28 13:00:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa6e64a-0df8-421c-b6a5-a0d078ec8e8a None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa6e64a-0df8-421c-b6a5-a0d078ec8e8a None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa6e64a-0df8-421c-b6a5-a0d078ec8e8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:44 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-3fa6e64a-0df8-421c-b6a5-a0d078ec8e8a None None] Truncating password to algorithm specific maximum length 72 characters. May 28 13:00:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-3fa6e64a-0df8-421c-b6a5-a0d078ec8e8a None None] MFA Rules not processed for user `db5dd5ae5b1e43f1baa6f93efd57818a`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 13:00:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-3fa6e64a-0df8-421c-b6a5-a0d078ec8e8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:00:44 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1448/2924] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 13:00:44 2024] POST /identity/v3/auth/tokens => generated 3972 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 13:00:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0a99f3-ce16-4327-b54a-75658d9f5bbd None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0a99f3-ce16-4327-b54a-75658d9f5bbd None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e84ea7-b3ee-4f59-9ec6-6f826bc5a6dc None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e84ea7-b3ee-4f59-9ec6-6f826bc5a6dc None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e84ea7-b3ee-4f59-9ec6-6f826bc5a6dc None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e84ea7-b3ee-4f59-9ec6-6f826bc5a6dc None admin] PATH_INFO: `/v3/projects` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e84ea7-b3ee-4f59-9ec6-6f826bc5a6dc None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e84ea7-b3ee-4f59-9ec6-6f826bc5a6dc None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:44 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1477/2925] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 13:00:44 2024] POST /identity/v3/projects => generated 401 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 13:00:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa6e64a-0df8-421c-b6a5-a0d078ec8e8a None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa6e64a-0df8-421c-b6a5-a0d078ec8e8a None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb9696a-dfdf-4150-9f93-146287112820 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb9696a-dfdf-4150-9f93-146287112820 None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb9696a-dfdf-4150-9f93-146287112820 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb9696a-dfdf-4150-9f93-146287112820 None admin] PATH_INFO: `/v3/users` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb9696a-dfdf-4150-9f93-146287112820 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb9696a-dfdf-4150-9f93-146287112820 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:44 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-5fb9696a-dfdf-4150-9f93-146287112820 None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 13:00:44 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1449/2926] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 13:00:44 2024] POST /identity/v3/users => generated 308 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 13:00:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e84ea7-b3ee-4f59-9ec6-6f826bc5a6dc None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e84ea7-b3ee-4f59-9ec6-6f826bc5a6dc None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7b13e8-499d-4039-a0af-2de28f674c0a None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7b13e8-499d-4039-a0af-2de28f674c0a None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7b13e8-499d-4039-a0af-2de28f674c0a None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7b13e8-499d-4039-a0af-2de28f674c0a None admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7b13e8-499d-4039-a0af-2de28f674c0a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7b13e8-499d-4039-a0af-2de28f674c0a None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:44 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1478/2927] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 13:00:44 2024] GET /identity/v3/roles => generated 1680 bytes in 18 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 13:00:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb9696a-dfdf-4150-9f93-146287112820 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb9696a-dfdf-4150-9f93-146287112820 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9a334b-a25d-4449-a323-e38e9eac9b4f None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9a334b-a25d-4449-a323-e38e9eac9b4f None admin] REQUEST_METHOD: `PUT` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9a334b-a25d-4449-a323-e38e9eac9b4f None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9a334b-a25d-4449-a323-e38e9eac9b4f None admin] PATH_INFO: `/v3/projects/7f76af93a3214ae5a0f7f887df042201/users/276a6609300d4504bcbfad8865786e7c/roles/e7989893488f483baa107be56668c4f8` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9a334b-a25d-4449-a323-e38e9eac9b4f None admin] RBAC: Authorizing `identity:create_grant(project_id=7f76af93a3214ae5a0f7f887df042201, user_id=276a6609300d4504bcbfad8865786e7c, role_id=e7989893488f483baa107be56668c4f8)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9a334b-a25d-4449-a323-e38e9eac9b4f None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:44 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1450/2928] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 13:00:44 2024] PUT /identity/v3/projects/7f76af93a3214ae5a0f7f887df042201/users/276a6609300d4504bcbfad8865786e7c/roles/e7989893488f483baa107be56668c4f8 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:00:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7b13e8-499d-4039-a0af-2de28f674c0a None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7b13e8-499d-4039-a0af-2de28f674c0a None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1675bf58-291c-41e9-82e0-13f75d475eb1 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1675bf58-291c-41e9-82e0-13f75d475eb1 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1675bf58-291c-41e9-82e0-13f75d475eb1 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1675bf58-291c-41e9-82e0-13f75d475eb1 None admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1675bf58-291c-41e9-82e0-13f75d475eb1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1675bf58-291c-41e9-82e0-13f75d475eb1 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:44 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1479/2929] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 13:00:44 2024] GET /identity/v3/roles => generated 1680 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 13:00:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9a334b-a25d-4449-a323-e38e9eac9b4f None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9a334b-a25d-4449-a323-e38e9eac9b4f None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18bc6f3-c017-4437-a733-14d591490baf None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18bc6f3-c017-4437-a733-14d591490baf None admin] REQUEST_METHOD: `PUT` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18bc6f3-c017-4437-a733-14d591490baf None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18bc6f3-c017-4437-a733-14d591490baf None admin] PATH_INFO: `/v3/projects/7f76af93a3214ae5a0f7f887df042201/users/276a6609300d4504bcbfad8865786e7c/roles/e7989893488f483baa107be56668c4f8` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18bc6f3-c017-4437-a733-14d591490baf None admin] RBAC: Authorizing `identity:create_grant(project_id=7f76af93a3214ae5a0f7f887df042201, user_id=276a6609300d4504bcbfad8865786e7c, role_id=e7989893488f483baa107be56668c4f8)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18bc6f3-c017-4437-a733-14d591490baf None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:44 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1451/2930] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 13:00:44 2024] PUT /identity/v3/projects/7f76af93a3214ae5a0f7f887df042201/users/276a6609300d4504bcbfad8865786e7c/roles/e7989893488f483baa107be56668c4f8 => generated 0 bytes in 19 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:00:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cad3bdb-912f-45d2-a16c-915f29979221 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cad3bdb-912f-45d2-a16c-915f29979221 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cad3bdb-912f-45d2-a16c-915f29979221 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:44 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-4cad3bdb-912f-45d2-a16c-915f29979221 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 13:00:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-4cad3bdb-912f-45d2-a16c-915f29979221 None None] MFA Rules not processed for user `276a6609300d4504bcbfad8865786e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 13:00:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-4cad3bdb-912f-45d2-a16c-915f29979221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:00:44 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1480/2931] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 13:00:44 2024] POST /identity/v3/auth/tokens => generated 4095 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 13:00:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18bc6f3-c017-4437-a733-14d591490baf None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18bc6f3-c017-4437-a733-14d591490baf None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c36296-5823-42c2-a217-4eafd350da3f tempest-ResourceLockNegativeTestAPIOnly-1366986999 tempest-ResourceLockNegativeTestAPIOnly-1366986999-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276a6609300d4504bcbfad8865786e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f76af93a3214ae5a0f7f887df042201', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c36296-5823-42c2-a217-4eafd350da3f tempest-ResourceLockNegativeTestAPIOnly-1366986999 tempest-ResourceLockNegativeTestAPIOnly-1366986999-project-admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c36296-5823-42c2-a217-4eafd350da3f tempest-ResourceLockNegativeTestAPIOnly-1366986999 tempest-ResourceLockNegativeTestAPIOnly-1366986999-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c36296-5823-42c2-a217-4eafd350da3f tempest-ResourceLockNegativeTestAPIOnly-1366986999 tempest-ResourceLockNegativeTestAPIOnly-1366986999-project-admin] PATH_INFO: `/v3/domains` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c36296-5823-42c2-a217-4eafd350da3f tempest-ResourceLockNegativeTestAPIOnly-1366986999 tempest-ResourceLockNegativeTestAPIOnly-1366986999-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 13:00:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c36296-5823-42c2-a217-4eafd350da3f tempest-ResourceLockNegativeTestAPIOnly-1366986999 tempest-ResourceLockNegativeTestAPIOnly-1366986999-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c36296-5823-42c2-a217-4eafd350da3f tempest-ResourceLockNegativeTestAPIOnly-1366986999 tempest-ResourceLockNegativeTestAPIOnly-1366986999-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:44 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1452/2932] 10.27.203.238 () {62 vars in 1241 bytes} [Tue May 28 13:00:44 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 13:00:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cad3bdb-912f-45d2-a16c-915f29979221 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cad3bdb-912f-45d2-a16c-915f29979221 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b77903-b619-4d70-9715-d670b4ac7bdc tempest-ResourceLockNegativeTestAPIOnly-1366986999 tempest-ResourceLockNegativeTestAPIOnly-1366986999-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276a6609300d4504bcbfad8865786e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f76af93a3214ae5a0f7f887df042201', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b77903-b619-4d70-9715-d670b4ac7bdc tempest-ResourceLockNegativeTestAPIOnly-1366986999 tempest-ResourceLockNegativeTestAPIOnly-1366986999-project-admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b77903-b619-4d70-9715-d670b4ac7bdc tempest-ResourceLockNegativeTestAPIOnly-1366986999 tempest-ResourceLockNegativeTestAPIOnly-1366986999-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b77903-b619-4d70-9715-d670b4ac7bdc tempest-ResourceLockNegativeTestAPIOnly-1366986999 tempest-ResourceLockNegativeTestAPIOnly-1366986999-project-admin] PATH_INFO: `/v3/users` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b77903-b619-4d70-9715-d670b4ac7bdc tempest-ResourceLockNegativeTestAPIOnly-1366986999 tempest-ResourceLockNegativeTestAPIOnly-1366986999-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b77903-b619-4d70-9715-d670b4ac7bdc tempest-ResourceLockNegativeTestAPIOnly-1366986999 tempest-ResourceLockNegativeTestAPIOnly-1366986999-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:44 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-a7b77903-b619-4d70-9715-d670b4ac7bdc tempest-ResourceLockNegativeTestAPIOnly-1366986999 tempest-ResourceLockNegativeTestAPIOnly-1366986999-project-admin] Truncating password to algorithm specific maximum length 72 characters. May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1481/2933] 10.27.203.238 () {64 vars in 1232 bytes} [Tue May 28 13:00:44 2024] POST /identity/v3/users => generated 431 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c36296-5823-42c2-a217-4eafd350da3f tempest-ResourceLockNegativeTestAPIOnly-1366986999 tempest-ResourceLockNegativeTestAPIOnly-1366986999-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c36296-5823-42c2-a217-4eafd350da3f tempest-ResourceLockNegativeTestAPIOnly-1366986999 tempest-ResourceLockNegativeTestAPIOnly-1366986999-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7d97dd-2a9d-406d-a559-1b03dc8e73c5 tempest-ResourceLockNegativeTestAPIOnly-1366986999 tempest-ResourceLockNegativeTestAPIOnly-1366986999-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276a6609300d4504bcbfad8865786e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f76af93a3214ae5a0f7f887df042201', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7d97dd-2a9d-406d-a559-1b03dc8e73c5 tempest-ResourceLockNegativeTestAPIOnly-1366986999 tempest-ResourceLockNegativeTestAPIOnly-1366986999-project-admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7d97dd-2a9d-406d-a559-1b03dc8e73c5 tempest-ResourceLockNegativeTestAPIOnly-1366986999 tempest-ResourceLockNegativeTestAPIOnly-1366986999-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7d97dd-2a9d-406d-a559-1b03dc8e73c5 tempest-ResourceLockNegativeTestAPIOnly-1366986999 tempest-ResourceLockNegativeTestAPIOnly-1366986999-project-admin] PATH_INFO: `/v3/roles` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7d97dd-2a9d-406d-a559-1b03dc8e73c5 tempest-ResourceLockNegativeTestAPIOnly-1366986999 tempest-ResourceLockNegativeTestAPIOnly-1366986999-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7d97dd-2a9d-406d-a559-1b03dc8e73c5 tempest-ResourceLockNegativeTestAPIOnly-1366986999 tempest-ResourceLockNegativeTestAPIOnly-1366986999-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1453/2934] 10.27.203.238 () {62 vars in 1210 bytes} [Tue May 28 13:00:45 2024] GET /identity/v3/roles => generated 1680 bytes in 17 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b77903-b619-4d70-9715-d670b4ac7bdc tempest-ResourceLockNegativeTestAPIOnly-1366986999 tempest-ResourceLockNegativeTestAPIOnly-1366986999-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b77903-b619-4d70-9715-d670b4ac7bdc tempest-ResourceLockNegativeTestAPIOnly-1366986999 tempest-ResourceLockNegativeTestAPIOnly-1366986999-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94867543-8c85-4703-827d-7c90cd37c08d tempest-ResourceLockNegativeTestAPIOnly-1366986999 tempest-ResourceLockNegativeTestAPIOnly-1366986999-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276a6609300d4504bcbfad8865786e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f76af93a3214ae5a0f7f887df042201', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94867543-8c85-4703-827d-7c90cd37c08d tempest-ResourceLockNegativeTestAPIOnly-1366986999 tempest-ResourceLockNegativeTestAPIOnly-1366986999-project-admin] REQUEST_METHOD: `PUT` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94867543-8c85-4703-827d-7c90cd37c08d tempest-ResourceLockNegativeTestAPIOnly-1366986999 tempest-ResourceLockNegativeTestAPIOnly-1366986999-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94867543-8c85-4703-827d-7c90cd37c08d tempest-ResourceLockNegativeTestAPIOnly-1366986999 tempest-ResourceLockNegativeTestAPIOnly-1366986999-project-admin] PATH_INFO: `/v3/projects/7f76af93a3214ae5a0f7f887df042201/users/6533c69a593a4e35a8693da46fbd9f3b/roles/44620cad10ae407c90c91e2c296adb04` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94867543-8c85-4703-827d-7c90cd37c08d tempest-ResourceLockNegativeTestAPIOnly-1366986999 tempest-ResourceLockNegativeTestAPIOnly-1366986999-project-admin] RBAC: Authorizing `identity:create_grant(project_id=7f76af93a3214ae5a0f7f887df042201, user_id=6533c69a593a4e35a8693da46fbd9f3b, role_id=44620cad10ae407c90c91e2c296adb04)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94867543-8c85-4703-827d-7c90cd37c08d tempest-ResourceLockNegativeTestAPIOnly-1366986999 tempest-ResourceLockNegativeTestAPIOnly-1366986999-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1482/2935] 10.27.203.238 () {64 vars in 1571 bytes} [Tue May 28 13:00:45 2024] PUT /identity/v3/projects/7f76af93a3214ae5a0f7f887df042201/users/6533c69a593a4e35a8693da46fbd9f3b/roles/44620cad10ae407c90c91e2c296adb04 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:00:45 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2ee65bb9-323a-4b84-b37e-5e80a5aca94a tempest-ShareTypeAvailabilityZonesTest-364532124 None] <<< [GET] https://127.0.0.1:40443/api/vippools/ May 28 13:00:45 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2ee65bb9-323a-4b84-b37e-5e80a5aca94a tempest-ShareTypeAvailabilityZonesTest-364532124 None] [Bunch(active_cnode_ids=[], active_interfaces=4, cluster='loop75-kfs', cluster_id=1, cnode_ids=[], cnodes=[], domain_name='vippool-1', enable_l3=False, enable_weighted_balancing=False, enabled=True, end_ip='172.21.75.4', guid='f2abaede-b397-413a-8faa-3aeead6d3b28', gw_ip='', gw_ipv6='', id=2, ip_ranges=[['172.21.75.1', '172.21.75.4']], name='vippool-1', peer_asn=0, port_membership='ALL', ranges_summary='172.21.75.[1-4]', role='PROTOCOLS', start_ip='172.21.75.1', subnet_cidr=16, subnet_cidr_ipv6=None, sync='SYNCED', sync_time='2024-05-28T12:50:09.644123Z', tenant_id=1, tenant_name='default', title='172.21.75.1 - 172.21.75.4', url='https://127.0.0.1:40443/api/vippools/2/', vast_asn=0, vlan=0, vms_preferred=False)] May 28 13:00:45 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2ee65bb9-323a-4b84-b37e-5e80a5aca94a tempest-ShareTypeAvailabilityZonesTest-364532124 None] --- [GET] https://127.0.0.1:40443/api/vippools/: Done May 28 13:00:45 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2ee65bb9-323a-4b84-b37e-5e80a5aca94a tempest-ShareTypeAvailabilityZonesTest-364532124 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:00:45 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2ee65bb9-323a-4b84-b37e-5e80a5aca94a tempest-ShareTypeAvailabilityZonesTest-364532124 None] {'allow_redirects': True, May 28 13:00:45 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2ee65bb9-323a-4b84-b37e-5e80a5aca94a tempest-ShareTypeAvailabilityZonesTest-364532124 None] 'params': {'name': '1d36626a-c0bd-47a1-a990-d50f95cbf99c'}} May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7d97dd-2a9d-406d-a559-1b03dc8e73c5 tempest-ResourceLockNegativeTestAPIOnly-1366986999 tempest-ResourceLockNegativeTestAPIOnly-1366986999-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-ba7d97dd-2a9d-406d-a559-1b03dc8e73c5 tempest-ResourceLockNegativeTestAPIOnly-1366986999 tempest-ResourceLockNegativeTestAPIOnly-1366986999-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7d97dd-2a9d-406d-a559-1b03dc8e73c5 tempest-ResourceLockNegativeTestAPIOnly-1366986999 tempest-ResourceLockNegativeTestAPIOnly-1366986999-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e48077-de56-4325-a4bc-8c6161c38b6b service manila] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f110cf6300f049c897d0aab63218d1e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e48077-de56-4325-a4bc-8c6161c38b6b service manila] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e48077-de56-4325-a4bc-8c6161c38b6b service manila] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e48077-de56-4325-a4bc-8c6161c38b6b service manila] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e48077-de56-4325-a4bc-8c6161c38b6b service manila] RBAC: Authorizing `identity:validate_token()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e48077-de56-4325-a4bc-8c6161c38b6b service manila] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1454/2936] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 13:00:45 2024] GET /identity/v3/auth/tokens => generated 3972 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 13:00:45 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-e6665fa1-7d43-4533-afab-68ef95aa1388 tempest-ResourceLockNegativeTestAPIOnly-1945215551 tempest-ResourceLockNegativeTestAPIOnly-1945215551-project-member] POST http://10.27.203.238/share/v2/0b376d107c864059beda8a4c177e12ed/resource-locks May 28 13:00:45 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-e6665fa1-7d43-4533-afab-68ef95aa1388 tempest-ResourceLockNegativeTestAPIOnly-1945215551 tempest-ResourceLockNegativeTestAPIOnly-1945215551-project-member] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"resource_lock": {"resource_id": "invalid-share-id", "resource_type": "share", "resource_action": "delete", "lock_reason": null}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:00:45 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-e6665fa1-7d43-4533-afab-68ef95aa1388 tempest-ResourceLockNegativeTestAPIOnly-1945215551 tempest-ResourceLockNegativeTestAPIOnly-1945215551-project-member] HTTP exception thrown: Resource ID is required and must be in uuid format. May 28 13:00:45 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-e6665fa1-7d43-4533-afab-68ef95aa1388 tempest-ResourceLockNegativeTestAPIOnly-1945215551 tempest-ResourceLockNegativeTestAPIOnly-1945215551-project-member] http://10.27.203.238/share/v2/0b376d107c864059beda8a4c177e12ed/resource-locks returned with HTTP 400 May 28 13:00:45 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 994/1950] 10.27.203.238 () {66 vars in 1386 bytes} [Tue May 28 13:00:45 2024] POST /share/v2/0b376d107c864059beda8a4c177e12ed/resource-locks => generated 95 bytes in 137 msecs (HTTP/1.1 400) 6 headers in 239 bytes (1 switches on core 0) May 28 13:00:45 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-79370541-f930-4e14-aea5-e9b8daba6f62 tempest-ResourceLockNegativeTestAPIOnly-1945215551 tempest-ResourceLockNegativeTestAPIOnly-1945215551-project-member] DELETE http://10.27.203.238/share/v2/0b376d107c864059beda8a4c177e12ed/resource-locks/invalid-lock-id May 28 13:00:45 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-79370541-f930-4e14-aea5-e9b8daba6f62 tempest-ResourceLockNegativeTestAPIOnly-1945215551 tempest-ResourceLockNegativeTestAPIOnly-1945215551-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:45 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-79370541-f930-4e14-aea5-e9b8daba6f62 tempest-ResourceLockNegativeTestAPIOnly-1945215551 tempest-ResourceLockNegativeTestAPIOnly-1945215551-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:45 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-79370541-f930-4e14-aea5-e9b8daba6f62 tempest-ResourceLockNegativeTestAPIOnly-1945215551 tempest-ResourceLockNegativeTestAPIOnly-1945215551-project-member] HTTP exception thrown: Resource lock invalid-lock-id could not be found. May 28 13:00:45 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-79370541-f930-4e14-aea5-e9b8daba6f62 tempest-ResourceLockNegativeTestAPIOnly-1945215551 tempest-ResourceLockNegativeTestAPIOnly-1945215551-project-member] http://10.27.203.238/share/v2/0b376d107c864059beda8a4c177e12ed/resource-locks/invalid-lock-id returned with HTTP 404 May 28 13:00:45 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 957/1951] 10.27.203.238 () {64 vars in 1415 bytes} [Tue May 28 13:00:45 2024] DELETE /share/v2/0b376d107c864059beda8a4c177e12ed/resource-locks/invalid-lock-id => generated 95 bytes in 10 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94867543-8c85-4703-827d-7c90cd37c08d tempest-ResourceLockNegativeTestAPIOnly-1366986999 tempest-ResourceLockNegativeTestAPIOnly-1366986999-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:45 l75lg1-v1 dstat.sh[49771]: 28-05 13:00:45| 12 2 83 3 0|5691M 1756M 278M 7900M| 17k 4489B| 0 2389k| 0 275 |7684 13k|1.68 1.21 1.06|1.0 1.0 0| 0 0 | 0 2048M| 29 362 0 49 2 May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94867543-8c85-4703-827d-7c90cd37c08d tempest-ResourceLockNegativeTestAPIOnly-1366986999 tempest-ResourceLockNegativeTestAPIOnly-1366986999-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ae4845-07b7-4e42-8c83-0a3f872069ee tempest-ResourceLockNegativeTestAPIOnly-1366986999 tempest-ResourceLockNegativeTestAPIOnly-1366986999-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276a6609300d4504bcbfad8865786e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f76af93a3214ae5a0f7f887df042201', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ae4845-07b7-4e42-8c83-0a3f872069ee tempest-ResourceLockNegativeTestAPIOnly-1366986999 tempest-ResourceLockNegativeTestAPIOnly-1366986999-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ae4845-07b7-4e42-8c83-0a3f872069ee tempest-ResourceLockNegativeTestAPIOnly-1366986999 tempest-ResourceLockNegativeTestAPIOnly-1366986999-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ae4845-07b7-4e42-8c83-0a3f872069ee tempest-ResourceLockNegativeTestAPIOnly-1366986999 tempest-ResourceLockNegativeTestAPIOnly-1366986999-project-admin] PATH_INFO: `/v3/users/5000ae7b72ab4d8aad66382d4e873caf` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ae4845-07b7-4e42-8c83-0a3f872069ee tempest-ResourceLockNegativeTestAPIOnly-1366986999 tempest-ResourceLockNegativeTestAPIOnly-1366986999-project-admin] RBAC: Authorizing `identity:delete_user(user_id=5000ae7b72ab4d8aad66382d4e873caf)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ae4845-07b7-4e42-8c83-0a3f872069ee tempest-ResourceLockNegativeTestAPIOnly-1366986999 tempest-ResourceLockNegativeTestAPIOnly-1366986999-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-e1ae4845-07b7-4e42-8c83-0a3f872069ee tempest-ResourceLockNegativeTestAPIOnly-1366986999 tempest-ResourceLockNegativeTestAPIOnly-1366986999-project-admin] Could not find user: 5000ae7b72ab4d8aad66382d4e873caf.: keystone.exception.UserNotFound: Could not find user: 5000ae7b72ab4d8aad66382d4e873caf. May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 5000ae7b72ab4d8aad66382d4e873caf. May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1483/2937] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:00:45 2024] DELETE /identity/v3/users/5000ae7b72ab4d8aad66382d4e873caf => generated 110 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e48077-de56-4325-a4bc-8c6161c38b6b service manila] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e48077-de56-4325-a4bc-8c6161c38b6b service manila] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b18528-049a-462d-b651-01006539361e tempest-ResourceLockNegativeTestAPIOnly-1366986999 tempest-ResourceLockNegativeTestAPIOnly-1366986999-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276a6609300d4504bcbfad8865786e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f76af93a3214ae5a0f7f887df042201', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b18528-049a-462d-b651-01006539361e tempest-ResourceLockNegativeTestAPIOnly-1366986999 tempest-ResourceLockNegativeTestAPIOnly-1366986999-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b18528-049a-462d-b651-01006539361e tempest-ResourceLockNegativeTestAPIOnly-1366986999 tempest-ResourceLockNegativeTestAPIOnly-1366986999-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b18528-049a-462d-b651-01006539361e tempest-ResourceLockNegativeTestAPIOnly-1366986999 tempest-ResourceLockNegativeTestAPIOnly-1366986999-project-admin] PATH_INFO: `/v3/users/3fc09c87f69946d2bf009e72ac589cd4` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b18528-049a-462d-b651-01006539361e tempest-ResourceLockNegativeTestAPIOnly-1366986999 tempest-ResourceLockNegativeTestAPIOnly-1366986999-project-admin] RBAC: Authorizing `identity:delete_user(user_id=3fc09c87f69946d2bf009e72ac589cd4)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b18528-049a-462d-b651-01006539361e tempest-ResourceLockNegativeTestAPIOnly-1366986999 tempest-ResourceLockNegativeTestAPIOnly-1366986999-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-49b18528-049a-462d-b651-01006539361e tempest-ResourceLockNegativeTestAPIOnly-1366986999 tempest-ResourceLockNegativeTestAPIOnly-1366986999-project-admin] Could not find user: 3fc09c87f69946d2bf009e72ac589cd4.: keystone.exception.UserNotFound: Could not find user: 3fc09c87f69946d2bf009e72ac589cd4. May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 3fc09c87f69946d2bf009e72ac589cd4. May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1455/2938] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:00:45 2024] DELETE /identity/v3/users/3fc09c87f69946d2bf009e72ac589cd4 => generated 110 bytes in 27 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ae4845-07b7-4e42-8c83-0a3f872069ee tempest-ResourceLockNegativeTestAPIOnly-1366986999 tempest-ResourceLockNegativeTestAPIOnly-1366986999-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ae4845-07b7-4e42-8c83-0a3f872069ee tempest-ResourceLockNegativeTestAPIOnly-1366986999 tempest-ResourceLockNegativeTestAPIOnly-1366986999-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d49db9-37ea-4868-9ce6-a2b0708c059e tempest-ResourceLockNegativeTestAPIOnly-1366986999 tempest-ResourceLockNegativeTestAPIOnly-1366986999-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276a6609300d4504bcbfad8865786e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f76af93a3214ae5a0f7f887df042201', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d49db9-37ea-4868-9ce6-a2b0708c059e tempest-ResourceLockNegativeTestAPIOnly-1366986999 tempest-ResourceLockNegativeTestAPIOnly-1366986999-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d49db9-37ea-4868-9ce6-a2b0708c059e tempest-ResourceLockNegativeTestAPIOnly-1366986999 tempest-ResourceLockNegativeTestAPIOnly-1366986999-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d49db9-37ea-4868-9ce6-a2b0708c059e tempest-ResourceLockNegativeTestAPIOnly-1366986999 tempest-ResourceLockNegativeTestAPIOnly-1366986999-project-admin] PATH_INFO: `/v3/users/6533c69a593a4e35a8693da46fbd9f3b` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d49db9-37ea-4868-9ce6-a2b0708c059e tempest-ResourceLockNegativeTestAPIOnly-1366986999 tempest-ResourceLockNegativeTestAPIOnly-1366986999-project-admin] RBAC: Authorizing `identity:delete_user(user_id=6533c69a593a4e35a8693da46fbd9f3b)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d49db9-37ea-4868-9ce6-a2b0708c059e tempest-ResourceLockNegativeTestAPIOnly-1366986999 tempest-ResourceLockNegativeTestAPIOnly-1366986999-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:45 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2ee65bb9-323a-4b84-b37e-5e80a5aca94a tempest-ShareTypeAvailabilityZonesTest-364532124 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:00:45 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2ee65bb9-323a-4b84-b37e-5e80a5aca94a tempest-ShareTypeAvailabilityZonesTest-364532124 None] [] May 28 13:00:45 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2ee65bb9-323a-4b84-b37e-5e80a5aca94a tempest-ShareTypeAvailabilityZonesTest-364532124 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 13:00:45 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2ee65bb9-323a-4b84-b37e-5e80a5aca94a tempest-ShareTypeAvailabilityZonesTest-364532124 None] >>> [POST] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:00:45 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2ee65bb9-323a-4b84-b37e-5e80a5aca94a tempest-ShareTypeAvailabilityZonesTest-364532124 None] {'data': '{"name": "1d36626a-c0bd-47a1-a990-d50f95cbf99c"}', May 28 13:00:45 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2ee65bb9-323a-4b84-b37e-5e80a5aca94a tempest-ShareTypeAvailabilityZonesTest-364532124 None] 'json': None, May 28 13:00:45 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2ee65bb9-323a-4b84-b37e-5e80a5aca94a tempest-ShareTypeAvailabilityZonesTest-364532124 None] 'params': None} May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-56d49db9-37ea-4868-9ce6-a2b0708c059e tempest-ResourceLockNegativeTestAPIOnly-1366986999 tempest-ResourceLockNegativeTestAPIOnly-1366986999-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6533c69a593a4e35a8693da46fbd9f3b', 'request_id': 'req-56d49db9-37ea-4868-9ce6-a2b0708c059e'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-56d49db9-37ea-4868-9ce6-a2b0708c059e tempest-ResourceLockNegativeTestAPIOnly-1366986999 tempest-ResourceLockNegativeTestAPIOnly-1366986999-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6533c69a593a4e35a8693da46fbd9f3b', 'request_id': 'req-56d49db9-37ea-4868-9ce6-a2b0708c059e'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-56d49db9-37ea-4868-9ce6-a2b0708c059e tempest-ResourceLockNegativeTestAPIOnly-1366986999 tempest-ResourceLockNegativeTestAPIOnly-1366986999-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6533c69a593a4e35a8693da46fbd9f3b', 'request_id': 'req-56d49db9-37ea-4868-9ce6-a2b0708c059e'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-56d49db9-37ea-4868-9ce6-a2b0708c059e tempest-ResourceLockNegativeTestAPIOnly-1366986999 tempest-ResourceLockNegativeTestAPIOnly-1366986999-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6533c69a593a4e35a8693da46fbd9f3b', 'request_id': 'req-56d49db9-37ea-4868-9ce6-a2b0708c059e'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-56d49db9-37ea-4868-9ce6-a2b0708c059e tempest-ResourceLockNegativeTestAPIOnly-1366986999 tempest-ResourceLockNegativeTestAPIOnly-1366986999-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6533c69a593a4e35a8693da46fbd9f3b', 'request_id': 'req-56d49db9-37ea-4868-9ce6-a2b0708c059e'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1484/2939] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:00:45 2024] DELETE /identity/v3/users/6533c69a593a4e35a8693da46fbd9f3b => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b18528-049a-462d-b651-01006539361e tempest-ResourceLockNegativeTestAPIOnly-1366986999 tempest-ResourceLockNegativeTestAPIOnly-1366986999-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-49b18528-049a-462d-b651-01006539361e tempest-ResourceLockNegativeTestAPIOnly-1366986999 tempest-ResourceLockNegativeTestAPIOnly-1366986999-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b18528-049a-462d-b651-01006539361e tempest-ResourceLockNegativeTestAPIOnly-1366986999 tempest-ResourceLockNegativeTestAPIOnly-1366986999-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9d287c-87df-4da9-9974-02fdf49ff6c4 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9d287c-87df-4da9-9974-02fdf49ff6c4 None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9d287c-87df-4da9-9974-02fdf49ff6c4 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9d287c-87df-4da9-9974-02fdf49ff6c4 None admin] PATH_INFO: `/v3/users/a93e6b0fb8d14a5eb22917129ec8a011` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9d287c-87df-4da9-9974-02fdf49ff6c4 None admin] RBAC: Authorizing `identity:delete_user(user_id=a93e6b0fb8d14a5eb22917129ec8a011)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9d287c-87df-4da9-9974-02fdf49ff6c4 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:45 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-e954c92f-bf7f-4cda-af84-761e9589d5a1 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] GET http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/shares/f4283c2a-3835-416e-9703-f5745babbf5c May 28 13:00:45 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-e954c92f-bf7f-4cda-af84-761e9589d5a1 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:45 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-e954c92f-bf7f-4cda-af84-761e9589d5a1 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:45 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-e954c92f-bf7f-4cda-af84-761e9589d5a1 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/shares/f4283c2a-3835-416e-9703-f5745babbf5c returned with HTTP 200 May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-3b9d287c-87df-4da9-9974-02fdf49ff6c4 None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a93e6b0fb8d14a5eb22917129ec8a011', 'request_id': 'req-3b9d287c-87df-4da9-9974-02fdf49ff6c4'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:45 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 995/1952] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:00:45 2024] GET /share/v2/a4f3887fa28c457390f5b66615564430/shares/f4283c2a-3835-416e-9703-f5745babbf5c => generated 1316 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-3b9d287c-87df-4da9-9974-02fdf49ff6c4 None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a93e6b0fb8d14a5eb22917129ec8a011', 'request_id': 'req-3b9d287c-87df-4da9-9974-02fdf49ff6c4'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-3b9d287c-87df-4da9-9974-02fdf49ff6c4 None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a93e6b0fb8d14a5eb22917129ec8a011', 'request_id': 'req-3b9d287c-87df-4da9-9974-02fdf49ff6c4'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-3b9d287c-87df-4da9-9974-02fdf49ff6c4 None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a93e6b0fb8d14a5eb22917129ec8a011', 'request_id': 'req-3b9d287c-87df-4da9-9974-02fdf49ff6c4'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-3b9d287c-87df-4da9-9974-02fdf49ff6c4 None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a93e6b0fb8d14a5eb22917129ec8a011', 'request_id': 'req-3b9d287c-87df-4da9-9974-02fdf49ff6c4'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1456/2940] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 13:00:45 2024] DELETE /identity/v3/users/a93e6b0fb8d14a5eb22917129ec8a011 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d49db9-37ea-4868-9ce6-a2b0708c059e tempest-ResourceLockNegativeTestAPIOnly-1366986999 tempest-ResourceLockNegativeTestAPIOnly-1366986999-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d49db9-37ea-4868-9ce6-a2b0708c059e tempest-ResourceLockNegativeTestAPIOnly-1366986999 tempest-ResourceLockNegativeTestAPIOnly-1366986999-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081d6c00-8f55-4cb4-b9ea-cdd900f702b8 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081d6c00-8f55-4cb4-b9ea-cdd900f702b8 None admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081d6c00-8f55-4cb4-b9ea-cdd900f702b8 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081d6c00-8f55-4cb4-b9ea-cdd900f702b8 None admin] PATH_INFO: `/v3/users/db5dd5ae5b1e43f1baa6f93efd57818a` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081d6c00-8f55-4cb4-b9ea-cdd900f702b8 None admin] RBAC: Authorizing `identity:delete_user(user_id=db5dd5ae5b1e43f1baa6f93efd57818a)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081d6c00-8f55-4cb4-b9ea-cdd900f702b8 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-081d6c00-8f55-4cb4-b9ea-cdd900f702b8 None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db5dd5ae5b1e43f1baa6f93efd57818a', 'request_id': 'req-081d6c00-8f55-4cb4-b9ea-cdd900f702b8'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-081d6c00-8f55-4cb4-b9ea-cdd900f702b8 None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db5dd5ae5b1e43f1baa6f93efd57818a', 'request_id': 'req-081d6c00-8f55-4cb4-b9ea-cdd900f702b8'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-081d6c00-8f55-4cb4-b9ea-cdd900f702b8 None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db5dd5ae5b1e43f1baa6f93efd57818a', 'request_id': 'req-081d6c00-8f55-4cb4-b9ea-cdd900f702b8'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-081d6c00-8f55-4cb4-b9ea-cdd900f702b8 None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db5dd5ae5b1e43f1baa6f93efd57818a', 'request_id': 'req-081d6c00-8f55-4cb4-b9ea-cdd900f702b8'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-081d6c00-8f55-4cb4-b9ea-cdd900f702b8 None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db5dd5ae5b1e43f1baa6f93efd57818a', 'request_id': 'req-081d6c00-8f55-4cb4-b9ea-cdd900f702b8'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1485/2941] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 13:00:45 2024] DELETE /identity/v3/users/db5dd5ae5b1e43f1baa6f93efd57818a => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9d287c-87df-4da9-9974-02fdf49ff6c4 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-3b9d287c-87df-4da9-9974-02fdf49ff6c4 None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9d287c-87df-4da9-9974-02fdf49ff6c4 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:45 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0b0e5f5a-fadc-40f6-b378-78c8005ec504 tempest-ShareRulesTest-1530341375 None] <<< [DELETE] https://127.0.0.1:40443/api/quotas/41/ May 28 13:00:45 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0b0e5f5a-fadc-40f6-b378-78c8005ec504 tempest-ShareRulesTest-1530341375 None] --- [DELETE] https://127.0.0.1:40443/api/quotas/41/: Done May 28 13:00:45 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0b0e5f5a-fadc-40f6-b378-78c8005ec504 tempest-ShareRulesTest-1530341375 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:00:45 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0b0e5f5a-fadc-40f6-b378-78c8005ec504 tempest-ShareRulesTest-1530341375 None] {'allow_redirects': True, May 28 13:00:45 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0b0e5f5a-fadc-40f6-b378-78c8005ec504 tempest-ShareRulesTest-1530341375 None] 'params': {'name': '5eddb781-43d4-4883-ae43-e9856f3a4c10'}} May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861f7fc9-c458-499d-b54a-57050cd680ea None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861f7fc9-c458-499d-b54a-57050cd680ea None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861f7fc9-c458-499d-b54a-57050cd680ea None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861f7fc9-c458-499d-b54a-57050cd680ea None admin] PATH_INFO: `/v3/users/276a6609300d4504bcbfad8865786e7c` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861f7fc9-c458-499d-b54a-57050cd680ea None admin] RBAC: Authorizing `identity:delete_user(user_id=276a6609300d4504bcbfad8865786e7c)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861f7fc9-c458-499d-b54a-57050cd680ea None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-861f7fc9-c458-499d-b54a-57050cd680ea None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '276a6609300d4504bcbfad8865786e7c', 'request_id': 'req-861f7fc9-c458-499d-b54a-57050cd680ea'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-861f7fc9-c458-499d-b54a-57050cd680ea None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '276a6609300d4504bcbfad8865786e7c', 'request_id': 'req-861f7fc9-c458-499d-b54a-57050cd680ea'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-861f7fc9-c458-499d-b54a-57050cd680ea None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '276a6609300d4504bcbfad8865786e7c', 'request_id': 'req-861f7fc9-c458-499d-b54a-57050cd680ea'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-861f7fc9-c458-499d-b54a-57050cd680ea None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '276a6609300d4504bcbfad8865786e7c', 'request_id': 'req-861f7fc9-c458-499d-b54a-57050cd680ea'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-861f7fc9-c458-499d-b54a-57050cd680ea None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '276a6609300d4504bcbfad8865786e7c', 'request_id': 'req-861f7fc9-c458-499d-b54a-57050cd680ea'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1457/2942] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 13:00:45 2024] DELETE /identity/v3/users/276a6609300d4504bcbfad8865786e7c => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83125b42-022b-45f7-9f47-4bcb70907baa None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83125b42-022b-45f7-9f47-4bcb70907baa None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83125b42-022b-45f7-9f47-4bcb70907baa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-83125b42-022b-45f7-9f47-4bcb70907baa None None] Truncating password to algorithm specific maximum length 72 characters. May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-83125b42-022b-45f7-9f47-4bcb70907baa None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-83125b42-022b-45f7-9f47-4bcb70907baa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1486/2943] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 13:00:45 2024] POST /identity/v3/auth/tokens => generated 2960 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 13:00:45 l75lg1-v1 neutron-server[77618]: DEBUG neutron.wsgi [-] (77618) accepted ('10.27.203.238', 41906) {{(pid=77618) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861f7fc9-c458-499d-b54a-57050cd680ea None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-861f7fc9-c458-499d-b54a-57050cd680ea None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:00:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861f7fc9-c458-499d-b54a-57050cd680ea None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53db968e-e155-49c1-8f33-d8b4b14f486c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef17047035e4b518fd5360a01f2da1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53db968e-e155-49c1-8f33-d8b4b14f486c service neutron] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53db968e-e155-49c1-8f33-d8b4b14f486c service neutron] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53db968e-e155-49c1-8f33-d8b4b14f486c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53db968e-e155-49c1-8f33-d8b4b14f486c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53db968e-e155-49c1-8f33-d8b4b14f486c service neutron] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:46 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1458/2944] 10.27.203.238 () {64 vars in 1432 bytes} [Tue May 28 13:00:45 2024] GET /identity/v3/auth/tokens => generated 2960 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 28 13:00:46 l75lg1-v1 neutron-server[77618]: INFO neutron.wsgi [None req-a5db8aaa-8701-4e3b-b9b2-7a1548958a05 None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=4bd9770e677e45d39cf34fdbbb5594a2&name=default HTTP/1.1" status: 200 len: 216 time: 0.0782859 May 28 13:00:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83125b42-022b-45f7-9f47-4bcb70907baa None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-83125b42-022b-45f7-9f47-4bcb70907baa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:00:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83125b42-022b-45f7-9f47-4bcb70907baa None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086304ad-dee9-4a19-9662-b9d0bbbdd7fe None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086304ad-dee9-4a19-9662-b9d0bbbdd7fe None admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086304ad-dee9-4a19-9662-b9d0bbbdd7fe None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086304ad-dee9-4a19-9662-b9d0bbbdd7fe None admin] PATH_INFO: `/v3/projects/4bd9770e677e45d39cf34fdbbb5594a2` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086304ad-dee9-4a19-9662-b9d0bbbdd7fe None admin] RBAC: Authorizing `identity:delete_project(project_id=4bd9770e677e45d39cf34fdbbb5594a2)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086304ad-dee9-4a19-9662-b9d0bbbdd7fe None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-086304ad-dee9-4a19-9662-b9d0bbbdd7fe None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4bd9770e677e45d39cf34fdbbb5594a2', 'request_id': 'req-086304ad-dee9-4a19-9662-b9d0bbbdd7fe'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-086304ad-dee9-4a19-9662-b9d0bbbdd7fe None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4bd9770e677e45d39cf34fdbbb5594a2', 'request_id': 'req-086304ad-dee9-4a19-9662-b9d0bbbdd7fe'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-086304ad-dee9-4a19-9662-b9d0bbbdd7fe None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4bd9770e677e45d39cf34fdbbb5594a2', 'request_id': 'req-086304ad-dee9-4a19-9662-b9d0bbbdd7fe'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-086304ad-dee9-4a19-9662-b9d0bbbdd7fe None admin] The token cache is being invalidate because project 4bd9770e677e45d39cf34fdbbb5594a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 13:00:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-086304ad-dee9-4a19-9662-b9d0bbbdd7fe None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-086304ad-dee9-4a19-9662-b9d0bbbdd7fe None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:46 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1487/2945] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 13:00:46 2024] DELETE /identity/v3/projects/4bd9770e677e45d39cf34fdbbb5594a2 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:00:46 l75lg1-v1 neutron-server[77618]: DEBUG neutron.wsgi [-] (77618) accepted ('10.27.203.238', 41922) {{(pid=77618) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 13:00:46 l75lg1-v1 neutron-server[77618]: INFO neutron.wsgi [None req-7db6f147-51ec-4ba3-bd7a-c1489771e83f None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=0b376d107c864059beda8a4c177e12ed&name=default HTTP/1.1" status: 200 len: 216 time: 0.0107675 May 28 13:00:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53db968e-e155-49c1-8f33-d8b4b14f486c service neutron] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53db968e-e155-49c1-8f33-d8b4b14f486c service neutron] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13b0b61-4fb1-4781-8c0e-ca6179b99baf None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13b0b61-4fb1-4781-8c0e-ca6179b99baf None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13b0b61-4fb1-4781-8c0e-ca6179b99baf None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13b0b61-4fb1-4781-8c0e-ca6179b99baf None admin] PATH_INFO: `/v3/projects/0b376d107c864059beda8a4c177e12ed` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13b0b61-4fb1-4781-8c0e-ca6179b99baf None admin] RBAC: Authorizing `identity:delete_project(project_id=0b376d107c864059beda8a4c177e12ed)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13b0b61-4fb1-4781-8c0e-ca6179b99baf None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-e13b0b61-4fb1-4781-8c0e-ca6179b99baf None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b376d107c864059beda8a4c177e12ed', 'request_id': 'req-e13b0b61-4fb1-4781-8c0e-ca6179b99baf'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-e13b0b61-4fb1-4781-8c0e-ca6179b99baf None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b376d107c864059beda8a4c177e12ed', 'request_id': 'req-e13b0b61-4fb1-4781-8c0e-ca6179b99baf'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:46 l75lg1-v1 dstat.sh[49771]: 28-05 13:00:46| 9 2 83 6 0|5691M 1755M 278M 7900M| 14k 1498B| 0 8329k| 0 699 |8645 15k|1.68 1.21 1.06|2.0 1.0 0| 0 0 | 0 2048M| 29 362 0 51 2 May 28 13:00:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-e13b0b61-4fb1-4781-8c0e-ca6179b99baf None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b376d107c864059beda8a4c177e12ed', 'request_id': 'req-e13b0b61-4fb1-4781-8c0e-ca6179b99baf'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-e13b0b61-4fb1-4781-8c0e-ca6179b99baf None admin] The token cache is being invalidate because project 0b376d107c864059beda8a4c177e12ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 13:00:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-e13b0b61-4fb1-4781-8c0e-ca6179b99baf None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-e13b0b61-4fb1-4781-8c0e-ca6179b99baf None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:46 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1459/2946] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 13:00:46 2024] DELETE /identity/v3/projects/0b376d107c864059beda8a4c177e12ed => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:00:46 l75lg1-v1 neutron-server[77618]: DEBUG neutron.wsgi [-] (77618) accepted ('10.27.203.238', 41938) {{(pid=77618) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 13:00:46 l75lg1-v1 neutron-server[77618]: INFO neutron.wsgi [None req-70896c01-c85b-4448-b87d-fda2005d92dd None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=7f76af93a3214ae5a0f7f887df042201&name=default HTTP/1.1" status: 200 len: 216 time: 0.0084348 May 28 13:00:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086304ad-dee9-4a19-9662-b9d0bbbdd7fe None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-086304ad-dee9-4a19-9662-b9d0bbbdd7fe None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:00:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086304ad-dee9-4a19-9662-b9d0bbbdd7fe None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e2578b-5fbd-4f1f-9c46-0667db518a32 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e2578b-5fbd-4f1f-9c46-0667db518a32 None admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e2578b-5fbd-4f1f-9c46-0667db518a32 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e2578b-5fbd-4f1f-9c46-0667db518a32 None admin] PATH_INFO: `/v3/projects/7f76af93a3214ae5a0f7f887df042201` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e2578b-5fbd-4f1f-9c46-0667db518a32 None admin] RBAC: Authorizing `identity:delete_project(project_id=7f76af93a3214ae5a0f7f887df042201)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e2578b-5fbd-4f1f-9c46-0667db518a32 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:46 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0b0e5f5a-fadc-40f6-b378-78c8005ec504 tempest-ShareRulesTest-1530341375 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:00:46 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0b0e5f5a-fadc-40f6-b378-78c8005ec504 tempest-ShareRulesTest-1530341375 None] [Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=0, created='2024-05-28T13:00:28.342982Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='ab44815a-6cee-4df3-a9a3-333372151587', id=44, internal=False, is_s3_default_policy=False, name='5eddb781-43d4-4883-ae43-e9856f3a4c10', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=['*'], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=[], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=[], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T13:00:38.930200Z', tenant_id=1, tenant_name='default', title='5eddb781-43d4-4883-ae43-e9856f3a4c10', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/44/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[])] May 28 13:00:46 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0b0e5f5a-fadc-40f6-b378-78c8005ec504 tempest-ShareRulesTest-1530341375 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 13:00:46 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0b0e5f5a-fadc-40f6-b378-78c8005ec504 tempest-ShareRulesTest-1530341375 None] >>> [DELETE] https://127.0.0.1:40443/api/viewpolicies/44/ May 28 13:00:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-a7e2578b-5fbd-4f1f-9c46-0667db518a32 None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f76af93a3214ae5a0f7f887df042201', 'request_id': 'req-a7e2578b-5fbd-4f1f-9c46-0667db518a32'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-a7e2578b-5fbd-4f1f-9c46-0667db518a32 None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f76af93a3214ae5a0f7f887df042201', 'request_id': 'req-a7e2578b-5fbd-4f1f-9c46-0667db518a32'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-a7e2578b-5fbd-4f1f-9c46-0667db518a32 None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f76af93a3214ae5a0f7f887df042201', 'request_id': 'req-a7e2578b-5fbd-4f1f-9c46-0667db518a32'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-a7e2578b-5fbd-4f1f-9c46-0667db518a32 None admin] The token cache is being invalidate because project 7f76af93a3214ae5a0f7f887df042201 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 13:00:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-a7e2578b-5fbd-4f1f-9c46-0667db518a32 None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-a7e2578b-5fbd-4f1f-9c46-0667db518a32 None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:46 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1488/2947] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 13:00:46 2024] DELETE /identity/v3/projects/7f76af93a3214ae5a0f7f887df042201 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:00:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf8416a-7a0c-4f40-92ea-6aeffcb19ead None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf8416a-7a0c-4f40-92ea-6aeffcb19ead None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf8416a-7a0c-4f40-92ea-6aeffcb19ead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:46 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-bdf8416a-7a0c-4f40-92ea-6aeffcb19ead None None] Truncating password to algorithm specific maximum length 72 characters. May 28 13:00:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-bdf8416a-7a0c-4f40-92ea-6aeffcb19ead None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 13:00:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-bdf8416a-7a0c-4f40-92ea-6aeffcb19ead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:00:46 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1460/2948] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 13:00:46 2024] POST /identity/v3/auth/tokens => generated 312 bytes in 22 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 28 13:00:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e918893-c0df-4403-a6b5-823d6fab6de8 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e918893-c0df-4403-a6b5-823d6fab6de8 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e918893-c0df-4403-a6b5-823d6fab6de8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:46 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-5e918893-c0df-4403-a6b5-823d6fab6de8 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 13:00:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-5e918893-c0df-4403-a6b5-823d6fab6de8 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 13:00:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-5e918893-c0df-4403-a6b5-823d6fab6de8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:00:46 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1489/2949] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 13:00:46 2024] POST /identity/v3/auth/tokens => generated 2960 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 13:00:46 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2ee65bb9-323a-4b84-b37e-5e80a5aca94a tempest-ShareTypeAvailabilityZonesTest-364532124 None] <<< [POST] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:00:46 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2ee65bb9-323a-4b84-b37e-5e80a5aca94a tempest-ShareTypeAvailabilityZonesTest-364532124 None] Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=0, created='2024-05-28T13:00:46.065473Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='005fae1a-ea9f-4aed-a9c5-bffcb8eaf9d2', id=46, internal=False, is_s3_default_policy=False, name='1d36626a-c0bd-47a1-a990-d50f95cbf99c', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=[], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['*'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['*'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T13:00:46.441308Z', tenant_id=1, tenant_name='default', title='1d36626a-c0bd-47a1-a990-d50f95cbf99c', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/46/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[]) May 28 13:00:46 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2ee65bb9-323a-4b84-b37e-5e80a5aca94a tempest-ShareTypeAvailabilityZonesTest-364532124 None] --- [POST] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 13:00:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf8416a-7a0c-4f40-92ea-6aeffcb19ead None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:46 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2ee65bb9-323a-4b84-b37e-5e80a5aca94a tempest-ShareTypeAvailabilityZonesTest-364532124 None] >>> [GET] https://127.0.0.1:40443/api/quotas/ May 28 13:00:46 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2ee65bb9-323a-4b84-b37e-5e80a5aca94a tempest-ShareTypeAvailabilityZonesTest-364532124 None] {'allow_redirects': True, May 28 13:00:46 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2ee65bb9-323a-4b84-b37e-5e80a5aca94a tempest-ShareTypeAvailabilityZonesTest-364532124 None] 'params': {'name': '1d36626a-c0bd-47a1-a990-d50f95cbf99c'}} May 28 13:00:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf8416a-7a0c-4f40-92ea-6aeffcb19ead None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110920a5-2af4-44d5-8d53-f96cf43f2312 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110920a5-2af4-44d5-8d53-f96cf43f2312 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110920a5-2af4-44d5-8d53-f96cf43f2312 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110920a5-2af4-44d5-8d53-f96cf43f2312 None admin] PATH_INFO: `/v3/domains` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110920a5-2af4-44d5-8d53-f96cf43f2312 None admin] RBAC: Adding query filter params (name=Default) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 13:00:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110920a5-2af4-44d5-8d53-f96cf43f2312 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110920a5-2af4-44d5-8d53-f96cf43f2312 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:46 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1461/2950] 10.27.203.238 () {62 vars in 1220 bytes} [Tue May 28 13:00:46 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 13:00:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e918893-c0df-4403-a6b5-823d6fab6de8 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e918893-c0df-4403-a6b5-823d6fab6de8 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825d56cd-2881-430b-9b42-c653c61fb73e None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825d56cd-2881-430b-9b42-c653c61fb73e None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825d56cd-2881-430b-9b42-c653c61fb73e None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825d56cd-2881-430b-9b42-c653c61fb73e None admin] PATH_INFO: `/v3/projects` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825d56cd-2881-430b-9b42-c653c61fb73e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825d56cd-2881-430b-9b42-c653c61fb73e None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:46 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1490/2951] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 13:00:46 2024] POST /identity/v3/projects => generated 381 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 13:00:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110920a5-2af4-44d5-8d53-f96cf43f2312 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110920a5-2af4-44d5-8d53-f96cf43f2312 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1dbe99-a4e6-4109-8f49-1e5cecb8ac30 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1dbe99-a4e6-4109-8f49-1e5cecb8ac30 None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1dbe99-a4e6-4109-8f49-1e5cecb8ac30 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1dbe99-a4e6-4109-8f49-1e5cecb8ac30 None admin] PATH_INFO: `/v3/users` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1dbe99-a4e6-4109-8f49-1e5cecb8ac30 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1dbe99-a4e6-4109-8f49-1e5cecb8ac30 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:46 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-1f1dbe99-a4e6-4109-8f49-1e5cecb8ac30 None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 13:00:46 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1462/2952] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 13:00:46 2024] POST /identity/v3/users => generated 299 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 13:00:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825d56cd-2881-430b-9b42-c653c61fb73e None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825d56cd-2881-430b-9b42-c653c61fb73e None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb37c77-434e-4fc6-8574-96fafbb6b022 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb37c77-434e-4fc6-8574-96fafbb6b022 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb37c77-434e-4fc6-8574-96fafbb6b022 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb37c77-434e-4fc6-8574-96fafbb6b022 None admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb37c77-434e-4fc6-8574-96fafbb6b022 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb37c77-434e-4fc6-8574-96fafbb6b022 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:46 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1491/2953] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 13:00:46 2024] GET /identity/v3/roles => generated 1680 bytes in 17 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 13:00:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1dbe99-a4e6-4109-8f49-1e5cecb8ac30 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1dbe99-a4e6-4109-8f49-1e5cecb8ac30 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:46 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-df1d3fc8-e0d9-4d36-8fd1-0a8f7df857d7 tempest-ShareTransferNegativeTest-884271560 None] <<< [DELETE] https://127.0.0.1:40443/api/quotas/38/ May 28 13:00:46 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-df1d3fc8-e0d9-4d36-8fd1-0a8f7df857d7 tempest-ShareTransferNegativeTest-884271560 None] --- [DELETE] https://127.0.0.1:40443/api/quotas/38/: Done May 28 13:00:46 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-df1d3fc8-e0d9-4d36-8fd1-0a8f7df857d7 tempest-ShareTransferNegativeTest-884271560 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:00:46 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-df1d3fc8-e0d9-4d36-8fd1-0a8f7df857d7 tempest-ShareTransferNegativeTest-884271560 None] {'allow_redirects': True, May 28 13:00:46 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-df1d3fc8-e0d9-4d36-8fd1-0a8f7df857d7 tempest-ShareTransferNegativeTest-884271560 None] 'params': {'name': 'e21891ab-7145-4d59-b238-375b52d59cb7'}} May 28 13:00:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ea2732-ac8a-4aea-a8ab-e4e844db6e39 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ea2732-ac8a-4aea-a8ab-e4e844db6e39 None admin] REQUEST_METHOD: `PUT` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ea2732-ac8a-4aea-a8ab-e4e844db6e39 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ea2732-ac8a-4aea-a8ab-e4e844db6e39 None admin] PATH_INFO: `/v3/projects/329a14ab984146feb9f91e467ab4e3b5/users/2fa39ddec14b4264baadbcad8beeaa18/roles/44620cad10ae407c90c91e2c296adb04` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ea2732-ac8a-4aea-a8ab-e4e844db6e39 None admin] RBAC: Authorizing `identity:create_grant(project_id=329a14ab984146feb9f91e467ab4e3b5, user_id=2fa39ddec14b4264baadbcad8beeaa18, role_id=44620cad10ae407c90c91e2c296adb04)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ea2732-ac8a-4aea-a8ab-e4e844db6e39 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:46 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1463/2954] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 13:00:46 2024] PUT /identity/v3/projects/329a14ab984146feb9f91e467ab4e3b5/users/2fa39ddec14b4264baadbcad8beeaa18/roles/44620cad10ae407c90c91e2c296adb04 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:00:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2289de-6a40-4f2d-9def-3158f6c706be None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2289de-6a40-4f2d-9def-3158f6c706be None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2289de-6a40-4f2d-9def-3158f6c706be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:46 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-4b2289de-6a40-4f2d-9def-3158f6c706be None None] Truncating password to algorithm specific maximum length 72 characters. May 28 13:00:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-4b2289de-6a40-4f2d-9def-3158f6c706be None None] MFA Rules not processed for user `2fa39ddec14b4264baadbcad8beeaa18`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 13:00:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-4b2289de-6a40-4f2d-9def-3158f6c706be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:00:46 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1492/2955] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 13:00:46 2024] POST /identity/v3/auth/tokens => generated 3952 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 13:00:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ea2732-ac8a-4aea-a8ab-e4e844db6e39 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ea2732-ac8a-4aea-a8ab-e4e844db6e39 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6c9ea7-6aa9-4546-9086-f9417dfaa7c7 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6c9ea7-6aa9-4546-9086-f9417dfaa7c7 None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6c9ea7-6aa9-4546-9086-f9417dfaa7c7 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6c9ea7-6aa9-4546-9086-f9417dfaa7c7 None admin] PATH_INFO: `/v3/projects` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6c9ea7-6aa9-4546-9086-f9417dfaa7c7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6c9ea7-6aa9-4546-9086-f9417dfaa7c7 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:46 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1464/2956] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 13:00:46 2024] POST /identity/v3/projects => generated 383 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 13:00:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2289de-6a40-4f2d-9def-3158f6c706be None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2289de-6a40-4f2d-9def-3158f6c706be None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d046d62-2fe3-48b7-b712-303768059c14 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d046d62-2fe3-48b7-b712-303768059c14 None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d046d62-2fe3-48b7-b712-303768059c14 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d046d62-2fe3-48b7-b712-303768059c14 None admin] PATH_INFO: `/v3/users` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d046d62-2fe3-48b7-b712-303768059c14 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d046d62-2fe3-48b7-b712-303768059c14 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:46 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-5d046d62-2fe3-48b7-b712-303768059c14 None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 13:00:46 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1493/2957] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 13:00:46 2024] POST /identity/v3/users => generated 300 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 13:00:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6c9ea7-6aa9-4546-9086-f9417dfaa7c7 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6c9ea7-6aa9-4546-9086-f9417dfaa7c7 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3303c8d7-7597-46a9-a311-5fd7b161e859 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3303c8d7-7597-46a9-a311-5fd7b161e859 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3303c8d7-7597-46a9-a311-5fd7b161e859 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3303c8d7-7597-46a9-a311-5fd7b161e859 None admin] PATH_INFO: `/v3/roles` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3303c8d7-7597-46a9-a311-5fd7b161e859 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3303c8d7-7597-46a9-a311-5fd7b161e859 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:46 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1465/2958] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 13:00:46 2024] GET /identity/v3/roles => generated 1680 bytes in 19 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 13:00:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d046d62-2fe3-48b7-b712-303768059c14 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d046d62-2fe3-48b7-b712-303768059c14 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963a32fb-5db1-4922-bfe4-30546c17fe69 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963a32fb-5db1-4922-bfe4-30546c17fe69 None admin] REQUEST_METHOD: `PUT` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963a32fb-5db1-4922-bfe4-30546c17fe69 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963a32fb-5db1-4922-bfe4-30546c17fe69 None admin] PATH_INFO: `/v3/projects/23657740d87e423db1788bcc1fd1a8bf/users/3dbabbbe168342768f75a3028aaecc36/roles/44620cad10ae407c90c91e2c296adb04` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963a32fb-5db1-4922-bfe4-30546c17fe69 None admin] RBAC: Authorizing `identity:create_grant(project_id=23657740d87e423db1788bcc1fd1a8bf, user_id=3dbabbbe168342768f75a3028aaecc36, role_id=44620cad10ae407c90c91e2c296adb04)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963a32fb-5db1-4922-bfe4-30546c17fe69 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:46 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1494/2959] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 13:00:46 2024] PUT /identity/v3/projects/23657740d87e423db1788bcc1fd1a8bf/users/3dbabbbe168342768f75a3028aaecc36/roles/44620cad10ae407c90c91e2c296adb04 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:00:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ee3fac-7005-4fdd-8a0e-6ca6d1007022 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ee3fac-7005-4fdd-8a0e-6ca6d1007022 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ee3fac-7005-4fdd-8a0e-6ca6d1007022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:46 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-68ee3fac-7005-4fdd-8a0e-6ca6d1007022 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 13:00:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-68ee3fac-7005-4fdd-8a0e-6ca6d1007022 None None] MFA Rules not processed for user `3dbabbbe168342768f75a3028aaecc36`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 13:00:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-68ee3fac-7005-4fdd-8a0e-6ca6d1007022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:00:47 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1466/2960] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 13:00:46 2024] POST /identity/v3/auth/tokens => generated 3954 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 13:00:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963a32fb-5db1-4922-bfe4-30546c17fe69 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2ee65bb9-323a-4b84-b37e-5e80a5aca94a tempest-ShareTypeAvailabilityZonesTest-364532124 None] <<< [GET] https://127.0.0.1:40443/api/quotas/ May 28 13:00:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2ee65bb9-323a-4b84-b37e-5e80a5aca94a tempest-ShareTypeAvailabilityZonesTest-364532124 None] [] May 28 13:00:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2ee65bb9-323a-4b84-b37e-5e80a5aca94a tempest-ShareTypeAvailabilityZonesTest-364532124 None] --- [GET] https://127.0.0.1:40443/api/quotas/: Done May 28 13:00:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2ee65bb9-323a-4b84-b37e-5e80a5aca94a tempest-ShareTypeAvailabilityZonesTest-364532124 None] >>> [POST] https://127.0.0.1:40443/api/quotas/ May 28 13:00:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2ee65bb9-323a-4b84-b37e-5e80a5aca94a tempest-ShareTypeAvailabilityZonesTest-364532124 None] {'data': '{"name": "1d36626a-c0bd-47a1-a990-d50f95cbf99c", "path": ' May 28 13:00:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2ee65bb9-323a-4b84-b37e-5e80a5aca94a tempest-ShareTypeAvailabilityZonesTest-364532124 None] '"/manila/manila-1d36626a-c0bd-47a1-a990-d50f95cbf99c", "create_dir": ' May 28 13:00:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2ee65bb9-323a-4b84-b37e-5e80a5aca94a tempest-ShareTypeAvailabilityZonesTest-364532124 None] 'true, "hard_limit": 1073741824}', May 28 13:00:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2ee65bb9-323a-4b84-b37e-5e80a5aca94a tempest-ShareTypeAvailabilityZonesTest-364532124 None] 'json': None, May 28 13:00:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2ee65bb9-323a-4b84-b37e-5e80a5aca94a tempest-ShareTypeAvailabilityZonesTest-364532124 None] 'params': None} May 28 13:00:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963a32fb-5db1-4922-bfe4-30546c17fe69 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e9580f-e9c4-471c-87a5-733bb5d58e80 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e9580f-e9c4-471c-87a5-733bb5d58e80 None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e9580f-e9c4-471c-87a5-733bb5d58e80 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e9580f-e9c4-471c-87a5-733bb5d58e80 None admin] PATH_INFO: `/v3/projects` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e9580f-e9c4-471c-87a5-733bb5d58e80 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e9580f-e9c4-471c-87a5-733bb5d58e80 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:47 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1495/2961] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 13:00:47 2024] POST /identity/v3/projects => generated 383 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 13:00:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ee3fac-7005-4fdd-8a0e-6ca6d1007022 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ee3fac-7005-4fdd-8a0e-6ca6d1007022 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063dc824-ad42-4bdc-a34e-965eddb2006e None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063dc824-ad42-4bdc-a34e-965eddb2006e None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063dc824-ad42-4bdc-a34e-965eddb2006e None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063dc824-ad42-4bdc-a34e-965eddb2006e None admin] PATH_INFO: `/v3/users` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063dc824-ad42-4bdc-a34e-965eddb2006e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063dc824-ad42-4bdc-a34e-965eddb2006e None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:47 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-063dc824-ad42-4bdc-a34e-965eddb2006e None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 13:00:47 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-60c75d7a-b22b-481a-86ec-87ac8fc729e6 tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] GET http://10.27.203.238/share/v2/cac556dc39a14bbdbdbabfc80672fb1f/shares/0c7ef0a2-5628-47dd-9eba-98153028dd8a May 28 13:00:47 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-60c75d7a-b22b-481a-86ec-87ac8fc729e6 tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:47 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-60c75d7a-b22b-481a-86ec-87ac8fc729e6 tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:47 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1467/2962] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 13:00:47 2024] POST /identity/v3/users => generated 299 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 13:00:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e9580f-e9c4-471c-87a5-733bb5d58e80 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e9580f-e9c4-471c-87a5-733bb5d58e80 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:47 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-60c75d7a-b22b-481a-86ec-87ac8fc729e6 tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] http://10.27.203.238/share/v2/cac556dc39a14bbdbdbabfc80672fb1f/shares/0c7ef0a2-5628-47dd-9eba-98153028dd8a returned with HTTP 200 May 28 13:00:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f05208b-cf0d-4a5c-b6dd-96db1536e036 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f05208b-cf0d-4a5c-b6dd-96db1536e036 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f05208b-cf0d-4a5c-b6dd-96db1536e036 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f05208b-cf0d-4a5c-b6dd-96db1536e036 None admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:47 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 958/1953] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:00:47 2024] GET /share/v2/cac556dc39a14bbdbdbabfc80672fb1f/shares/0c7ef0a2-5628-47dd-9eba-98153028dd8a => generated 1315 bytes in 31 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:00:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f05208b-cf0d-4a5c-b6dd-96db1536e036 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f05208b-cf0d-4a5c-b6dd-96db1536e036 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:47 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1496/2963] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 13:00:47 2024] GET /identity/v3/roles => generated 1680 bytes in 18 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 13:00:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063dc824-ad42-4bdc-a34e-965eddb2006e None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063dc824-ad42-4bdc-a34e-965eddb2006e None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77256ba5-e092-4a17-8650-7cb36c6344eb None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77256ba5-e092-4a17-8650-7cb36c6344eb None admin] REQUEST_METHOD: `PUT` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77256ba5-e092-4a17-8650-7cb36c6344eb None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77256ba5-e092-4a17-8650-7cb36c6344eb None admin] PATH_INFO: `/v3/projects/011748bb7e2247e88228bd066607700e/users/ffcac1016e3c4ee3a3ad1b48da439b19/roles/e7989893488f483baa107be56668c4f8` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77256ba5-e092-4a17-8650-7cb36c6344eb None admin] RBAC: Authorizing `identity:create_grant(project_id=011748bb7e2247e88228bd066607700e, user_id=ffcac1016e3c4ee3a3ad1b48da439b19, role_id=e7989893488f483baa107be56668c4f8)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77256ba5-e092-4a17-8650-7cb36c6344eb None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:47 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1468/2964] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 13:00:47 2024] PUT /identity/v3/projects/011748bb7e2247e88228bd066607700e/users/ffcac1016e3c4ee3a3ad1b48da439b19/roles/e7989893488f483baa107be56668c4f8 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:00:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f05208b-cf0d-4a5c-b6dd-96db1536e036 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f05208b-cf0d-4a5c-b6dd-96db1536e036 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:47 l75lg1-v1 dstat.sh[49771]: 28-05 13:00:47| 10 1 86 2 0|5691M 1755M 278M 7900M| 19k 4084B| 0 1646k| 0 222 |7792 13k|1.79 1.24 1.08|3.0 1.0 0| 0 0 | 0 2048M| 29 362 0 52 2 May 28 13:00:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-df1d3fc8-e0d9-4d36-8fd1-0a8f7df857d7 tempest-ShareTransferNegativeTest-884271560 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:00:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-df1d3fc8-e0d9-4d36-8fd1-0a8f7df857d7 tempest-ShareTransferNegativeTest-884271560 None] [Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=0, created='2024-05-28T13:00:03.855400Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='9718bd76-381d-400e-86d8-cc6104214c23', id=41, internal=False, is_s3_default_policy=False, name='e21891ab-7145-4d59-b238-375b52d59cb7', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=[], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['*'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['*'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T13:00:04.222280Z', tenant_id=1, tenant_name='default', title='e21891ab-7145-4d59-b238-375b52d59cb7', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/41/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[])] May 28 13:00:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-df1d3fc8-e0d9-4d36-8fd1-0a8f7df857d7 tempest-ShareTransferNegativeTest-884271560 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 13:00:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-df1d3fc8-e0d9-4d36-8fd1-0a8f7df857d7 tempest-ShareTransferNegativeTest-884271560 None] >>> [DELETE] https://127.0.0.1:40443/api/viewpolicies/41/ May 28 13:00:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823c8caa-7410-4d72-aae6-4525a1f27822 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823c8caa-7410-4d72-aae6-4525a1f27822 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823c8caa-7410-4d72-aae6-4525a1f27822 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823c8caa-7410-4d72-aae6-4525a1f27822 None admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823c8caa-7410-4d72-aae6-4525a1f27822 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823c8caa-7410-4d72-aae6-4525a1f27822 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:47 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1497/2965] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 13:00:47 2024] GET /identity/v3/roles => generated 1680 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 13:00:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77256ba5-e092-4a17-8650-7cb36c6344eb None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77256ba5-e092-4a17-8650-7cb36c6344eb None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3cce82-7f11-441f-aafa-f2b8815a6727 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3cce82-7f11-441f-aafa-f2b8815a6727 None admin] REQUEST_METHOD: `PUT` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3cce82-7f11-441f-aafa-f2b8815a6727 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3cce82-7f11-441f-aafa-f2b8815a6727 None admin] PATH_INFO: `/v3/projects/011748bb7e2247e88228bd066607700e/users/ffcac1016e3c4ee3a3ad1b48da439b19/roles/e7989893488f483baa107be56668c4f8` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3cce82-7f11-441f-aafa-f2b8815a6727 None admin] RBAC: Authorizing `identity:create_grant(project_id=011748bb7e2247e88228bd066607700e, user_id=ffcac1016e3c4ee3a3ad1b48da439b19, role_id=e7989893488f483baa107be56668c4f8)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3cce82-7f11-441f-aafa-f2b8815a6727 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:47 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1469/2966] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 13:00:47 2024] PUT /identity/v3/projects/011748bb7e2247e88228bd066607700e/users/ffcac1016e3c4ee3a3ad1b48da439b19/roles/e7989893488f483baa107be56668c4f8 => generated 0 bytes in 18 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:00:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8848358f-f4c0-425a-9e80-6a5e2edadeaa None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8848358f-f4c0-425a-9e80-6a5e2edadeaa None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8848358f-f4c0-425a-9e80-6a5e2edadeaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:47 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-8848358f-f4c0-425a-9e80-6a5e2edadeaa None None] Truncating password to algorithm specific maximum length 72 characters. May 28 13:00:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-8848358f-f4c0-425a-9e80-6a5e2edadeaa None None] MFA Rules not processed for user `ffcac1016e3c4ee3a3ad1b48da439b19`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 13:00:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-8848358f-f4c0-425a-9e80-6a5e2edadeaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:00:47 l75lg1-v1 manila-share[98474]: DEBUG oslo_service.periodic_task [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] Running periodic task ShareManager._publish_service_capabilities {{(pid=98474) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 13:00:47 l75lg1-v1 manila-share[98474]: DEBUG manila.manager [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] Notifying Schedulers of capabilities ... {{(pid=98474) _publish_service_capabilities /opt/stack/manila/manila/manager.py:172}} May 28 13:00:47 l75lg1-v1 manila-share[98474]: DEBUG oslo_service.periodic_task [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] Running periodic task ShareManager.migration_driver_continue {{(pid=98474) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 13:00:47 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.host_manager [None req-dbe1e487-e9bb-4165-b677-d5e5a86b54f6 None None] Received share service update from l75lg1-v1@vast: {'share_backend_name': 'vast', 'driver_handles_share_servers': False, 'vendor_name': 'VAST STORAGE', 'driver_version': '1.0', 'storage_protocol': 'NFS', 'total_capacity_gb': 2083.02392578125, 'free_capacity_gb': 2082.6277076322585, 'reserved_percentage': 0, 'reserved_snapshot_percentage': 0, 'reserved_share_extend_percentage': 0, 'qos': False, 'pools': None, 'snapshot_support': True, 'create_share_from_snapshot_support': False, 'revert_to_snapshot_support': False, 'mount_snapshot_support': False, 'replication_domain': None, 'filter_function': None, 'goodness_function': None, 'security_service_update_support': False, 'network_allocation_update_support': False, 'share_server_multiple_subnet_support': False, 'mount_point_name_support': False, 'data_reduction': 5.29, 'provisioned_capacity_gb': 0.39621814899146557, 'share_group_stats': {'consistent_snapshot_support': None}, 'ipv4_support': True, 'ipv6_support': False} {{(pid=98327) update_service_capabilities /opt/stack/manila/manila/scheduler/host_manager.py:632}} May 28 13:00:47 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1498/2967] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 13:00:47 2024] POST /identity/v3/auth/tokens => generated 4077 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 13:00:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3cce82-7f11-441f-aafa-f2b8815a6727 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3cce82-7f11-441f-aafa-f2b8815a6727 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:47 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-8db19eb4-0429-471d-bd73-227296e0c7c9 tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] GET http://10.27.203.238/share/v2/284d76edec3144579d6fb3f6dbc0dd4e/shares/433f546f-3297-46a0-b412-18630103d191 May 28 13:00:47 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-8db19eb4-0429-471d-bd73-227296e0c7c9 tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:47 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-8db19eb4-0429-471d-bd73-227296e0c7c9 tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561cd8b2-0a18-447f-954e-8ca4c9f606d3 tempest-ShareRulesNegativeTest-1738210631 tempest-ShareRulesNegativeTest-1738210631-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffcac1016e3c4ee3a3ad1b48da439b19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011748bb7e2247e88228bd066607700e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561cd8b2-0a18-447f-954e-8ca4c9f606d3 tempest-ShareRulesNegativeTest-1738210631 tempest-ShareRulesNegativeTest-1738210631-project-admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561cd8b2-0a18-447f-954e-8ca4c9f606d3 tempest-ShareRulesNegativeTest-1738210631 tempest-ShareRulesNegativeTest-1738210631-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561cd8b2-0a18-447f-954e-8ca4c9f606d3 tempest-ShareRulesNegativeTest-1738210631 tempest-ShareRulesNegativeTest-1738210631-project-admin] PATH_INFO: `/v3/domains` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561cd8b2-0a18-447f-954e-8ca4c9f606d3 tempest-ShareRulesNegativeTest-1738210631 tempest-ShareRulesNegativeTest-1738210631-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 13:00:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561cd8b2-0a18-447f-954e-8ca4c9f606d3 tempest-ShareRulesNegativeTest-1738210631 tempest-ShareRulesNegativeTest-1738210631-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561cd8b2-0a18-447f-954e-8ca4c9f606d3 tempest-ShareRulesNegativeTest-1738210631 tempest-ShareRulesNegativeTest-1738210631-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:47 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1470/2968] 10.27.203.238 () {62 vars in 1241 bytes} [Tue May 28 13:00:47 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 13:00:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8848358f-f4c0-425a-9e80-6a5e2edadeaa None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8848358f-f4c0-425a-9e80-6a5e2edadeaa None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:47 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-8db19eb4-0429-471d-bd73-227296e0c7c9 tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] http://10.27.203.238/share/v2/284d76edec3144579d6fb3f6dbc0dd4e/shares/433f546f-3297-46a0-b412-18630103d191 returned with HTTP 200 May 28 13:00:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e67cbb-ebb2-4ece-9af9-e024e7aa5542 tempest-ShareRulesNegativeTest-1738210631 tempest-ShareRulesNegativeTest-1738210631-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffcac1016e3c4ee3a3ad1b48da439b19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011748bb7e2247e88228bd066607700e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:47 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 996/1954] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:00:47 2024] GET /share/v2/284d76edec3144579d6fb3f6dbc0dd4e/shares/433f546f-3297-46a0-b412-18630103d191 => generated 1314 bytes in 27 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:00:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e67cbb-ebb2-4ece-9af9-e024e7aa5542 tempest-ShareRulesNegativeTest-1738210631 tempest-ShareRulesNegativeTest-1738210631-project-admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e67cbb-ebb2-4ece-9af9-e024e7aa5542 tempest-ShareRulesNegativeTest-1738210631 tempest-ShareRulesNegativeTest-1738210631-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e67cbb-ebb2-4ece-9af9-e024e7aa5542 tempest-ShareRulesNegativeTest-1738210631 tempest-ShareRulesNegativeTest-1738210631-project-admin] PATH_INFO: `/v3/users` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e67cbb-ebb2-4ece-9af9-e024e7aa5542 tempest-ShareRulesNegativeTest-1738210631 tempest-ShareRulesNegativeTest-1738210631-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e67cbb-ebb2-4ece-9af9-e024e7aa5542 tempest-ShareRulesNegativeTest-1738210631 tempest-ShareRulesNegativeTest-1738210631-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:47 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-b7e67cbb-ebb2-4ece-9af9-e024e7aa5542 tempest-ShareRulesNegativeTest-1738210631 tempest-ShareRulesNegativeTest-1738210631-project-admin] Truncating password to algorithm specific maximum length 72 characters. May 28 13:00:47 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1499/2969] 10.27.203.238 () {64 vars in 1232 bytes} [Tue May 28 13:00:47 2024] POST /identity/v3/users => generated 435 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 13:00:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561cd8b2-0a18-447f-954e-8ca4c9f606d3 tempest-ShareRulesNegativeTest-1738210631 tempest-ShareRulesNegativeTest-1738210631-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561cd8b2-0a18-447f-954e-8ca4c9f606d3 tempest-ShareRulesNegativeTest-1738210631 tempest-ShareRulesNegativeTest-1738210631-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05b5506-c047-4340-b81a-eaf4a84b9c2d tempest-ShareRulesNegativeTest-1738210631 tempest-ShareRulesNegativeTest-1738210631-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffcac1016e3c4ee3a3ad1b48da439b19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011748bb7e2247e88228bd066607700e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05b5506-c047-4340-b81a-eaf4a84b9c2d tempest-ShareRulesNegativeTest-1738210631 tempest-ShareRulesNegativeTest-1738210631-project-admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05b5506-c047-4340-b81a-eaf4a84b9c2d tempest-ShareRulesNegativeTest-1738210631 tempest-ShareRulesNegativeTest-1738210631-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05b5506-c047-4340-b81a-eaf4a84b9c2d tempest-ShareRulesNegativeTest-1738210631 tempest-ShareRulesNegativeTest-1738210631-project-admin] PATH_INFO: `/v3/roles` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05b5506-c047-4340-b81a-eaf4a84b9c2d tempest-ShareRulesNegativeTest-1738210631 tempest-ShareRulesNegativeTest-1738210631-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05b5506-c047-4340-b81a-eaf4a84b9c2d tempest-ShareRulesNegativeTest-1738210631 tempest-ShareRulesNegativeTest-1738210631-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:47 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1471/2970] 10.27.203.238 () {62 vars in 1210 bytes} [Tue May 28 13:00:47 2024] GET /identity/v3/roles => generated 1680 bytes in 16 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 13:00:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e67cbb-ebb2-4ece-9af9-e024e7aa5542 tempest-ShareRulesNegativeTest-1738210631 tempest-ShareRulesNegativeTest-1738210631-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e67cbb-ebb2-4ece-9af9-e024e7aa5542 tempest-ShareRulesNegativeTest-1738210631 tempest-ShareRulesNegativeTest-1738210631-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c75305e-1ffb-477d-aef8-3d7e62294cac tempest-ShareRulesNegativeTest-1738210631 tempest-ShareRulesNegativeTest-1738210631-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffcac1016e3c4ee3a3ad1b48da439b19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011748bb7e2247e88228bd066607700e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c75305e-1ffb-477d-aef8-3d7e62294cac tempest-ShareRulesNegativeTest-1738210631 tempest-ShareRulesNegativeTest-1738210631-project-admin] REQUEST_METHOD: `PUT` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:47 l75lg1-v1 manila-share[98474]: DEBUG oslo_service.periodic_task [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] Running periodic task ShareManager.do_deferred_share_deletion {{(pid=98474) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 13:00:47 l75lg1-v1 manila-share[98474]: DEBUG manila.share.manager [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] Checking for shares in 'deferred_deleting' status to process their deletion. {{(pid=98474) do_deferred_share_deletion /opt/stack/manila/manila/share/manager.py:3663}} May 28 13:00:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c75305e-1ffb-477d-aef8-3d7e62294cac tempest-ShareRulesNegativeTest-1738210631 tempest-ShareRulesNegativeTest-1738210631-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c75305e-1ffb-477d-aef8-3d7e62294cac tempest-ShareRulesNegativeTest-1738210631 tempest-ShareRulesNegativeTest-1738210631-project-admin] PATH_INFO: `/v3/projects/011748bb7e2247e88228bd066607700e/users/929590f760014a429cece4b4e674f84e/roles/44620cad10ae407c90c91e2c296adb04` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:47 l75lg1-v1 manila-share[98474]: DEBUG oslo_service.periodic_task [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] Running periodic task ShareManager.do_deferred_snapshot_deletion {{(pid=98474) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 13:00:47 l75lg1-v1 manila-share[98474]: DEBUG manila.share.manager [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] Checking for snapshots in 'deferred_deleting' status to process their deletion. {{(pid=98474) do_deferred_snapshot_deletion /opt/stack/manila/manila/share/manager.py:3980}} May 28 13:00:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c75305e-1ffb-477d-aef8-3d7e62294cac tempest-ShareRulesNegativeTest-1738210631 tempest-ShareRulesNegativeTest-1738210631-project-admin] RBAC: Authorizing `identity:create_grant(project_id=011748bb7e2247e88228bd066607700e, user_id=929590f760014a429cece4b4e674f84e, role_id=44620cad10ae407c90c91e2c296adb04)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c75305e-1ffb-477d-aef8-3d7e62294cac tempest-ShareRulesNegativeTest-1738210631 tempest-ShareRulesNegativeTest-1738210631-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:47 l75lg1-v1 manila-share[98474]: DEBUG oslo_service.periodic_task [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] Running periodic task ShareManager._report_driver_status {{(pid=98474) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 13:00:47 l75lg1-v1 manila-share[98474]: INFO manila.share.manager [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] Updating share status May 28 13:00:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] >>> [GET] https://127.0.0.1:40443/api/monitors/ad_hoc_query/ May 28 13:00:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] {'allow_redirects': True, May 28 13:00:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] 'params': {'object_type': 'cluster', May 28 13:00:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] 'prop_list': ['Capacity,drr', May 28 13:00:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] 'Capacity,logical_space', May 28 13:00:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] 'Capacity,logical_space_in_use', May 28 13:00:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] 'Capacity,physical_space', May 28 13:00:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] 'Capacity,physical_space_in_use'], May 28 13:00:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] 'time_frame': '1m'}} May 28 13:00:47 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1500/2971] 10.27.203.238 () {64 vars in 1571 bytes} [Tue May 28 13:00:47 2024] PUT /identity/v3/projects/011748bb7e2247e88228bd066607700e/users/929590f760014a429cece4b4e674f84e/roles/44620cad10ae407c90c91e2c296adb04 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:00:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05b5506-c047-4340-b81a-eaf4a84b9c2d tempest-ShareRulesNegativeTest-1738210631 tempest-ShareRulesNegativeTest-1738210631-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-a05b5506-c047-4340-b81a-eaf4a84b9c2d tempest-ShareRulesNegativeTest-1738210631 tempest-ShareRulesNegativeTest-1738210631-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:00:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05b5506-c047-4340-b81a-eaf4a84b9c2d tempest-ShareRulesNegativeTest-1738210631 tempest-ShareRulesNegativeTest-1738210631-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d505d57-d503-41ac-a795-cabff2f7601a service manila] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f110cf6300f049c897d0aab63218d1e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d505d57-d503-41ac-a795-cabff2f7601a service manila] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d505d57-d503-41ac-a795-cabff2f7601a service manila] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d505d57-d503-41ac-a795-cabff2f7601a service manila] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] <<< [GET] https://127.0.0.1:40443/api/monitors/ad_hoc_query/ May 28 13:00:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] Bunch(data=[['2024-05-28T13:00:41Z', 1, 454043655.0, 2223930.0, 5.29, 711246584217.0, 2236629909504.0], ['2024-05-28T13:00:30Z', 1, 453863431.0, 2223930.0, 5.29, 711246584217.0, 2236629909504.0], ['2024-05-28T13:00:20Z', 1, 449562234.0, 2223930.0, 5.29, 711246584217.0, 2236629909504.0], ['2024-05-28T13:00:11Z', 1, 449274718.0, 2223930.0, 5.29, 711246584217.0, 2236629909504.0], ['2024-05-28T13:00:00Z', 1, 449135454.0, 2223930.0, 5.29, 711246584217.0, 2236629909504.0], ['2024-05-28T12:59:50Z', 1, 449069917.0, 2223930.0, 5.29, 711246584217.0, 2236629909504.0]], granularity=None, object_ids=[1], prop_list=['timestamp', 'object_id', 'Capacity,logical_space_in_use', 'Capacity,physical_space_in_use', 'Capacity,drr', 'Capacity,physical_space', 'Capacity,logical_space']) May 28 13:00:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] --- [GET] https://127.0.0.1:40443/api/monitors/ad_hoc_query/: Done May 28 13:00:47 l75lg1-v1 manila-share[98474]: DEBUG manila.share.driver [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] Updating share stats. {{(pid=98474) _update_share_stats /opt/stack/manila/manila/share/driver.py:1326}} May 28 13:00:47 l75lg1-v1 manila-share[98474]: DEBUG oslo_service.periodic_task [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] Running periodic task ShareManager.create_backup_continue {{(pid=98474) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 13:00:47 l75lg1-v1 manila-share[98474]: DEBUG oslo_service.periodic_task [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] Running periodic task ShareManager.restore_backup_continue {{(pid=98474) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 13:00:47 l75lg1-v1 manila-share[98474]: DEBUG oslo_service.periodic_task [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] Running periodic task ShareManager.periodic_share_status_update {{(pid=98474) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 13:00:47 l75lg1-v1 manila-share[98474]: DEBUG manila.share.manager [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] Updating status of share instances. {{(pid=98474) periodic_share_status_update /opt/stack/manila/manila/share/manager.py:5475}} May 28 13:00:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d505d57-d503-41ac-a795-cabff2f7601a service manila] RBAC: Authorizing `identity:validate_token()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d505d57-d503-41ac-a795-cabff2f7601a service manila] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:47 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1472/2972] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 13:00:47 2024] GET /identity/v3/auth/tokens => generated 4077 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 13:00:47 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-3d20f7a7-e4f3-409b-aab8-3d0974ecf43a tempest-ShareRulesNegativeTest-1738210631 tempest-ShareRulesNegativeTest-1738210631-project-admin] POST http://10.27.203.238/share/v2/011748bb7e2247e88228bd066607700e/types May 28 13:00:47 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-3d20f7a7-e4f3-409b-aab8-3d0974ecf43a tempest-ShareRulesNegativeTest-1738210631 tempest-ShareRulesNegativeTest-1738210631-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share_type": {"name": "tempest-typeshare-type-593446257", "extra_specs": {"driver_handles_share_servers": "False", "snapshot_support": true}, "share_type_access:is_public": true}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:00:47 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-3d20f7a7-e4f3-409b-aab8-3d0974ecf43a tempest-ShareRulesNegativeTest-1738210631 tempest-ShareRulesNegativeTest-1738210631-project-admin] http://10.27.203.238/share/v2/011748bb7e2247e88228bd066607700e/types returned with HTTP 200 May 28 13:00:47 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 959/1955] 10.27.203.238 () {66 vars in 1359 bytes} [Tue May 28 13:00:47 2024] POST /share/v2/011748bb7e2247e88228bd066607700e/types => generated 677 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:00:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c75305e-1ffb-477d-aef8-3d7e62294cac tempest-ShareRulesNegativeTest-1738210631 tempest-ShareRulesNegativeTest-1738210631-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-9c75305e-1ffb-477d-aef8-3d7e62294cac tempest-ShareRulesNegativeTest-1738210631 tempest-ShareRulesNegativeTest-1738210631-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:00:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c75305e-1ffb-477d-aef8-3d7e62294cac tempest-ShareRulesNegativeTest-1738210631 tempest-ShareRulesNegativeTest-1738210631-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11efd01d-5b78-4c55-8cfa-006d8df25dd2 service manila] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f110cf6300f049c897d0aab63218d1e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11efd01d-5b78-4c55-8cfa-006d8df25dd2 service manila] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11efd01d-5b78-4c55-8cfa-006d8df25dd2 service manila] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11efd01d-5b78-4c55-8cfa-006d8df25dd2 service manila] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11efd01d-5b78-4c55-8cfa-006d8df25dd2 service manila] RBAC: Authorizing `identity:validate_token()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11efd01d-5b78-4c55-8cfa-006d8df25dd2 service manila] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:47 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1501/2973] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 13:00:47 2024] GET /identity/v3/auth/tokens => generated 3952 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 13:00:47 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-6924aa00-1b38-441d-a0d1-dc81d9823d0c tempest-ShareRulesNegativeTest-930400775 tempest-ShareRulesNegativeTest-930400775-project-member] POST http://10.27.203.238/share/v2/329a14ab984146feb9f91e467ab4e3b5/shares May 28 13:00:47 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-6924aa00-1b38-441d-a0d1-dc81d9823d0c tempest-ShareRulesNegativeTest-930400775 tempest-ShareRulesNegativeTest-930400775-project-member] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share": {"share_proto": "nfs", "description": "Tempest's share", "snapshot_id": null, "name": "tempest-tempest-created-share-807207618", "size": 1, "metadata": {}, "is_public": false, "share_type": "014d638f-6718-47b3-a401-a453a3d85ba9"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:00:47 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.v1.shares [None req-6924aa00-1b38-441d-a0d1-dc81d9823d0c tempest-ShareRulesNegativeTest-930400775 tempest-ShareRulesNegativeTest-930400775-project-member] Create NFS share of 1 GB May 28 13:00:47 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.quota [None req-6924aa00-1b38-441d-a0d1-dc81d9823d0c tempest-ShareRulesNegativeTest-930400775 tempest-ShareRulesNegativeTest-930400775-project-member] Created reservations ['e028a478-2741-42e3-8366-9b91f831131c', '783cd71b-61cb-433e-b988-b7d6907451cb', 'd064a15f-4f47-48f3-87b4-abfc8604d2c4', 'eee49a80-202e-45aa-abfd-77ed4ef38adb'] {{(pid=98329) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 13:00:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2ee65bb9-323a-4b84-b37e-5e80a5aca94a tempest-ShareTypeAvailabilityZonesTest-364532124 None] <<< [POST] https://127.0.0.1:40443/api/quotas/ May 28 13:00:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2ee65bb9-323a-4b84-b37e-5e80a5aca94a tempest-ShareTypeAvailabilityZonesTest-364532124 None] Bunch(cluster='loop75-kfs', cluster_id=1, default_email=None, default_group_quota=None, default_user_quota=None, enable_alarms=True, enable_email_providers=True, grace_period=None, group_quotas=[], guid='a2d403af-2565-449d-aa91-de510e77e092', hard_limit=1073741824, hard_limit_inodes=None, id=43, internal=False, is_user_quota=False, last_user_quotas_update=None, name='1d36626a-c0bd-47a1-a990-d50f95cbf99c', num_blocked_users=0, num_exceeded_users=0, path='/manila/manila-1d36626a-c0bd-47a1-a990-d50f95cbf99c', percent_capacity=0, percent_inodes=None, pretty_grace_period=None, pretty_grace_period_expiration=None, pretty_state='OK (CREATED)', soft_limit=None, soft_limit_inodes=None, state='OK', sync_state='CREATED', system_id=43, tenant_id=1, tenant_name='default', time_to_block=None, title='1d36626a-c0bd-47a1-a990-d50f95cbf99c', url='https://127.0.0.1:40443/api/quotas/43/', used_capacity=0, used_capacity_tb=0.0, used_effective_capacity=0, used_effective_capacity_tb=0.0, used_inodes=0, used_limited_capacity=0, user_quotas=[]) May 28 13:00:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2ee65bb9-323a-4b84-b37e-5e80a5aca94a tempest-ShareTypeAvailabilityZonesTest-364532124 None] --- [POST] https://127.0.0.1:40443/api/quotas/: Done May 28 13:00:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2ee65bb9-323a-4b84-b37e-5e80a5aca94a tempest-ShareTypeAvailabilityZonesTest-364532124 None] >>> [GET] https://127.0.0.1:40443/api/views/ May 28 13:00:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2ee65bb9-323a-4b84-b37e-5e80a5aca94a tempest-ShareTypeAvailabilityZonesTest-364532124 None] {'allow_redirects': True, May 28 13:00:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2ee65bb9-323a-4b84-b37e-5e80a5aca94a tempest-ShareTypeAvailabilityZonesTest-364532124 None] 'params': {'name': '1d36626a-c0bd-47a1-a990-d50f95cbf99c'}} May 28 13:00:47 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.quota [None req-6924aa00-1b38-441d-a0d1-dc81d9823d0c tempest-ShareRulesNegativeTest-930400775 tempest-ShareRulesNegativeTest-930400775-project-member] Committed reservations ['e028a478-2741-42e3-8366-9b91f831131c', '783cd71b-61cb-433e-b988-b7d6907451cb', 'd064a15f-4f47-48f3-87b4-abfc8604d2c4', 'eee49a80-202e-45aa-abfd-77ed4ef38adb'] {{(pid=98329) commit /opt/stack/manila/manila/quota.py:1063}} May 28 13:00:47 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.host_manager [None req-6924aa00-1b38-441d-a0d1-dc81d9823d0c tempest-ShareRulesNegativeTest-930400775 None] Share service is down. (host: l75lg1-v1@generic2). May 28 13:00:47 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.host_manager [None req-6924aa00-1b38-441d-a0d1-dc81d9823d0c tempest-ShareRulesNegativeTest-930400775 None] Share service is down. (host: l75lg1-v1@generic1). May 28 13:00:47 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-6924aa00-1b38-441d-a0d1-dc81d9823d0c tempest-ShareRulesNegativeTest-930400775 None] Starting with 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:80}} May 28 13:00:47 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-6924aa00-1b38-441d-a0d1-dc81d9823d0c tempest-ShareRulesNegativeTest-930400775 None] Filter OnlyHostFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:00:47 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-6924aa00-1b38-441d-a0d1-dc81d9823d0c tempest-ShareRulesNegativeTest-930400775 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:00:47 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.capacity [None req-6924aa00-1b38-441d-a0d1-dc81d9823d0c tempest-ShareRulesNegativeTest-930400775 None] Space information for share creation on host l75lg1-v1@vast#vast (requested / avail): 1/2082 {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/capacity.py:83}} May 28 13:00:47 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-6924aa00-1b38-441d-a0d1-dc81d9823d0c tempest-ShareRulesNegativeTest-930400775 None] Filter CapacityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:00:47 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-6924aa00-1b38-441d-a0d1-dc81d9823d0c tempest-ShareRulesNegativeTest-930400775 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:00:47 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-6924aa00-1b38-441d-a0d1-dc81d9823d0c tempest-ShareRulesNegativeTest-930400775 None] Driver Filter: Checking host 'l75lg1-v1@vast#vast' {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:37}} May 28 13:00:47 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-6924aa00-1b38-441d-a0d1-dc81d9823d0c tempest-ShareRulesNegativeTest-930400775 None] Filter function not set :: passing host. {{(pid=98327) _check_filter_function /opt/stack/manila/manila/scheduler/filters/driver.py:53}} May 28 13:00:47 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-6924aa00-1b38-441d-a0d1-dc81d9823d0c tempest-ShareRulesNegativeTest-930400775 None] Result: True {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:40}} May 28 13:00:47 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-6924aa00-1b38-441d-a0d1-dc81d9823d0c tempest-ShareRulesNegativeTest-930400775 None] Done checking host 'l75lg1-v1@vast#vast' {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:41}} May 28 13:00:47 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-6924aa00-1b38-441d-a0d1-dc81d9823d0c tempest-ShareRulesNegativeTest-930400775 None] Filter DriverFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:00:47 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-6924aa00-1b38-441d-a0d1-dc81d9823d0c tempest-ShareRulesNegativeTest-930400775 None] Filter ShareReplicationFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:00:47 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-6924aa00-1b38-441d-a0d1-dc81d9823d0c tempest-ShareRulesNegativeTest-930400775 None] Filter CreateFromSnapshotFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:00:47 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-6924aa00-1b38-441d-a0d1-dc81d9823d0c tempest-ShareRulesNegativeTest-930400775 None] Filter AffinityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:00:47 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-6924aa00-1b38-441d-a0d1-dc81d9823d0c tempest-ShareRulesNegativeTest-930400775 None] Filter AntiAffinityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:00:47 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.drivers.filter [None req-6924aa00-1b38-441d-a0d1-dc81d9823d0c tempest-ShareRulesNegativeTest-930400775 None] Filtered share [host: 'l75lg1-v1@vast#vast', free_capacity_gb: 2082.6277076322585, pools: None] {{(pid=98327) _schedule_share /opt/stack/manila/manila/scheduler/drivers/filter.py:268}} May 28 13:00:47 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-6924aa00-1b38-441d-a0d1-dc81d9823d0c tempest-ShareRulesNegativeTest-930400775 None] Checking host 'l75lg1-v1@vast#vast' {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:46}} May 28 13:00:47 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.weighers.goodness [None req-6924aa00-1b38-441d-a0d1-dc81d9823d0c tempest-ShareRulesNegativeTest-930400775 None] Goodness function not set :: defaulting to minimal goodness rating of 0. May 28 13:00:47 l75lg1-v1 manila-scheduler[98327]: INFO manila.scheduler.weighers.goodness [None req-6924aa00-1b38-441d-a0d1-dc81d9823d0c tempest-ShareRulesNegativeTest-930400775 None] Goodness function result for host l75lg1-v1@vast#vast: 0. May 28 13:00:47 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-6924aa00-1b38-441d-a0d1-dc81d9823d0c tempest-ShareRulesNegativeTest-930400775 None] Goodness: 0 {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:48}} May 28 13:00:47 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-6924aa00-1b38-441d-a0d1-dc81d9823d0c tempest-ShareRulesNegativeTest-930400775 None] Done checking host 'l75lg1-v1@vast#vast' {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:49}} May 28 13:00:47 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.drivers.filter [None req-6924aa00-1b38-441d-a0d1-dc81d9823d0c tempest-ShareRulesNegativeTest-930400775 None] Choosing for share: WeighedHost [host: l75lg1-v1@vast#vast, weight: 0.0] {{(pid=98327) _schedule_share /opt/stack/manila/manila/scheduler/drivers/filter.py:274}} May 28 13:00:47 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-6924aa00-1b38-441d-a0d1-dc81d9823d0c tempest-ShareRulesNegativeTest-930400775 tempest-ShareRulesNegativeTest-930400775-project-member] http://10.27.203.238/share/v2/329a14ab984146feb9f91e467ab4e3b5/shares returned with HTTP 200 May 28 13:00:47 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 997/1956] 10.27.203.238 () {66 vars in 1362 bytes} [Tue May 28 13:00:47 2024] POST /share/v2/329a14ab984146feb9f91e467ab4e3b5/shares => generated 1310 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:00:47 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-ecce79a6-597e-4a84-871b-68c388e11520 tempest-ShareRulesNegativeTest-930400775 tempest-ShareRulesNegativeTest-930400775-project-member] GET http://10.27.203.238/share/v2/329a14ab984146feb9f91e467ab4e3b5/shares/623ccf6c-1398-4ab6-9f67-73e600565f38 May 28 13:00:47 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-ecce79a6-597e-4a84-871b-68c388e11520 tempest-ShareRulesNegativeTest-930400775 tempest-ShareRulesNegativeTest-930400775-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:47 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-ecce79a6-597e-4a84-871b-68c388e11520 tempest-ShareRulesNegativeTest-930400775 tempest-ShareRulesNegativeTest-930400775-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:47 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-ecce79a6-597e-4a84-871b-68c388e11520 tempest-ShareRulesNegativeTest-930400775 tempest-ShareRulesNegativeTest-930400775-project-member] http://10.27.203.238/share/v2/329a14ab984146feb9f91e467ab4e3b5/shares/623ccf6c-1398-4ab6-9f67-73e600565f38 returned with HTTP 200 May 28 13:00:47 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 960/1957] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:00:47 2024] GET /share/v2/329a14ab984146feb9f91e467ab4e3b5/shares/623ccf6c-1398-4ab6-9f67-73e600565f38 => generated 1310 bytes in 25 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:00:48 l75lg1-v1 nova-conductor[83229]: DEBUG dbcounter [-] [83229] Writing DB stats nova_cell0:SELECT=1,nova_cell0:UPDATE=1 {{(pid=83229) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:00:48 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0b0e5f5a-fadc-40f6-b378-78c8005ec504 tempest-ShareRulesTest-1530341375 None] <<< [DELETE] https://127.0.0.1:40443/api/viewpolicies/44/ May 28 13:00:48 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0b0e5f5a-fadc-40f6-b378-78c8005ec504 tempest-ShareRulesTest-1530341375 None] --- [DELETE] https://127.0.0.1:40443/api/viewpolicies/44/: Done May 28 13:00:48 l75lg1-v1 nova-conductor[83233]: DEBUG dbcounter [-] [83233] Writing DB stats nova_cell0:SELECT=1 {{(pid=83233) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:00:48 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-6924aa00-1b38-441d-a0d1-dc81d9823d0c tempest-ShareRulesNegativeTest-930400775 None] >>> [GET] https://127.0.0.1:40443/api/vippools/ May 28 13:00:48 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-6924aa00-1b38-441d-a0d1-dc81d9823d0c tempest-ShareRulesNegativeTest-930400775 None] {'allow_redirects': True, 'params': {'name': 'vippool-1'}} May 28 13:00:48 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-0b0e5f5a-fadc-40f6-b378-78c8005ec504 tempest-ShareRulesTest-1530341375 None] Created reservations ['f5205392-f289-490f-8156-fae835842bfe', '12d0388c-39e7-46fd-90e7-84f973cb9f0d', 'e3e86e42-77c5-4447-adc0-1a492b32af9a', '115fdea2-649c-4235-b6ed-045932334d18'] {{(pid=98474) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 13:00:48 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-0b0e5f5a-fadc-40f6-b378-78c8005ec504 tempest-ShareRulesTest-1530341375 None] Committed reservations ['f5205392-f289-490f-8156-fae835842bfe', '12d0388c-39e7-46fd-90e7-84f973cb9f0d', 'e3e86e42-77c5-4447-adc0-1a492b32af9a', '115fdea2-649c-4235-b6ed-045932334d18'] {{(pid=98474) commit /opt/stack/manila/manila/quota.py:1063}} May 28 13:00:48 l75lg1-v1 manila-share[98474]: INFO manila.share.manager [None req-0b0e5f5a-fadc-40f6-b378-78c8005ec504 tempest-ShareRulesTest-1530341375 None] Share instance 5eddb781-43d4-4883-ae43-e9856f3a4c10: deleted successfully. May 28 13:00:48 l75lg1-v1 dstat.sh[49771]: 28-05 13:00:48| 12 2 84 3 0|5697M 1749M 278M 7901M| 34k 3026B| 0 2003k| 0 325 |7554 13k|1.79 1.24 1.08|1.0 1.0 2.0| 0 0 | 0 2048M| 29 361 0 52 2 May 28 13:00:48 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2ee65bb9-323a-4b84-b37e-5e80a5aca94a tempest-ShareTypeAvailabilityZonesTest-364532124 None] <<< [GET] https://127.0.0.1:40443/api/views/ May 28 13:00:48 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2ee65bb9-323a-4b84-b37e-5e80a5aca94a tempest-ShareTypeAvailabilityZonesTest-364532124 None] [] May 28 13:00:48 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2ee65bb9-323a-4b84-b37e-5e80a5aca94a tempest-ShareTypeAvailabilityZonesTest-364532124 None] --- [GET] https://127.0.0.1:40443/api/views/: Done May 28 13:00:48 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2ee65bb9-323a-4b84-b37e-5e80a5aca94a tempest-ShareTypeAvailabilityZonesTest-364532124 None] >>> [POST] https://127.0.0.1:40443/api/views/ May 28 13:00:48 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2ee65bb9-323a-4b84-b37e-5e80a5aca94a tempest-ShareTypeAvailabilityZonesTest-364532124 None] {'data': '{"name": "1d36626a-c0bd-47a1-a990-d50f95cbf99c", "path": ' May 28 13:00:48 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2ee65bb9-323a-4b84-b37e-5e80a5aca94a tempest-ShareTypeAvailabilityZonesTest-364532124 None] '"/manila/manila-1d36626a-c0bd-47a1-a990-d50f95cbf99c", "policy_id": ' May 28 13:00:48 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2ee65bb9-323a-4b84-b37e-5e80a5aca94a tempest-ShareTypeAvailabilityZonesTest-364532124 None] '46, "create_dir": true, "protocols": ["NFS"]}', May 28 13:00:48 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2ee65bb9-323a-4b84-b37e-5e80a5aca94a tempest-ShareTypeAvailabilityZonesTest-364532124 None] 'json': None, May 28 13:00:48 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2ee65bb9-323a-4b84-b37e-5e80a5aca94a tempest-ShareTypeAvailabilityZonesTest-364532124 None] 'params': None} May 28 13:00:48 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-6924aa00-1b38-441d-a0d1-dc81d9823d0c tempest-ShareRulesNegativeTest-930400775 None] <<< [GET] https://127.0.0.1:40443/api/vippools/ May 28 13:00:48 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-6924aa00-1b38-441d-a0d1-dc81d9823d0c tempest-ShareRulesNegativeTest-930400775 None] [Bunch(active_cnode_ids=[], active_interfaces=4, cluster='loop75-kfs', cluster_id=1, cnode_ids=[], cnodes=[], domain_name='vippool-1', enable_l3=False, enable_weighted_balancing=False, enabled=True, end_ip='172.21.75.4', guid='f2abaede-b397-413a-8faa-3aeead6d3b28', gw_ip='', gw_ipv6='', id=2, ip_ranges=[['172.21.75.1', '172.21.75.4']], name='vippool-1', peer_asn=0, port_membership='ALL', ranges_summary='172.21.75.[1-4]', role='PROTOCOLS', start_ip='172.21.75.1', subnet_cidr=16, subnet_cidr_ipv6=None, sync='SYNCED', sync_time='2024-05-28T12:50:09.644123Z', tenant_id=1, tenant_name='default', title='172.21.75.1 - 172.21.75.4', url='https://127.0.0.1:40443/api/vippools/2/', vast_asn=0, vlan=0, vms_preferred=False)] May 28 13:00:48 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-6924aa00-1b38-441d-a0d1-dc81d9823d0c tempest-ShareRulesNegativeTest-930400775 None] --- [GET] https://127.0.0.1:40443/api/vippools/: Done May 28 13:00:48 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-6924aa00-1b38-441d-a0d1-dc81d9823d0c tempest-ShareRulesNegativeTest-930400775 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:00:48 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-6924aa00-1b38-441d-a0d1-dc81d9823d0c tempest-ShareRulesNegativeTest-930400775 None] {'allow_redirects': True, May 28 13:00:48 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-6924aa00-1b38-441d-a0d1-dc81d9823d0c tempest-ShareRulesNegativeTest-930400775 None] 'params': {'name': 'e0a28587-55d6-44c6-8c73-249d5047f95e'}} May 28 13:00:48 l75lg1-v1 neutron-server[77623]: DEBUG dbcounter [-] [77623] Writing DB stats neutron:SELECT=1 {{(pid=77623) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:00:48 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-19b96baa-1d10-4bb2-ba1a-a5f8f183f5b6 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] GET http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/shares/f4283c2a-3835-416e-9703-f5745babbf5c May 28 13:00:48 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-19b96baa-1d10-4bb2-ba1a-a5f8f183f5b6 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:48 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-19b96baa-1d10-4bb2-ba1a-a5f8f183f5b6 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:48 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-19b96baa-1d10-4bb2-ba1a-a5f8f183f5b6 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] HTTP exception thrown: The resource could not be found. May 28 13:00:48 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-19b96baa-1d10-4bb2-ba1a-a5f8f183f5b6 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/shares/f4283c2a-3835-416e-9703-f5745babbf5c returned with HTTP 404 May 28 13:00:48 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 998/1958] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:00:48 2024] GET /share/v2/a4f3887fa28c457390f5b66615564430/shares/f4283c2a-3835-416e-9703-f5745babbf5c => generated 78 bytes in 11 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 13:00:48 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-adf8d2bc-27a9-4b08-9eec-613e27a35fae tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] POST http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/shares/f4283c2a-3835-416e-9703-f5745babbf5c/action May 28 13:00:48 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-adf8d2bc-27a9-4b08-9eec-613e27a35fae tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Action body: b'{"access_list": null}' {{(pid=98330) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 13:00:48 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-adf8d2bc-27a9-4b08-9eec-613e27a35fae tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Action: 'action', calling method: ShareController.access_list, body: {"access_list": null} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:00:48 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault [None req-adf8d2bc-27a9-4b08-9eec-613e27a35fae tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Caught error: Resource could not be found.: manila.exception.NotFound: Resource could not be found. May 28 13:00:48 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault Traceback (most recent call last): May 28 13:00:48 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/api/middleware/fault.py", line 76, in __call__ May 28 13:00:48 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return req.get_response(self.application) May 28 13:00:48 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/request.py", line 1313, in send May 28 13:00:48 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault status, headers, app_iter = self.call_application( May 28 13:00:48 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/request.py", line 1278, in call_application May 28 13:00:48 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault app_iter = application(self.environ, start_response) May 28 13:00:48 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 129, in __call__ May 28 13:00:48 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault resp = self.call_func(req, *args, **kw) May 28 13:00:48 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 193, in call_func May 28 13:00:48 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return self.func(req, *args, **kwargs) May 28 13:00:48 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_middleware/base.py", line 124, in __call__ May 28 13:00:48 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault response = req.get_response(self.application) May 28 13:00:48 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/request.py", line 1313, in send May 28 13:00:48 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault status, headers, app_iter = self.call_application( May 28 13:00:48 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/request.py", line 1278, in call_application May 28 13:00:48 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault app_iter = application(self.environ, start_response) May 28 13:00:48 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 143, in __call__ May 28 13:00:48 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return resp(environ, start_response) May 28 13:00:48 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 129, in __call__ May 28 13:00:48 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault resp = self.call_func(req, *args, **kw) May 28 13:00:48 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 193, in call_func May 28 13:00:48 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return self.func(req, *args, **kwargs) May 28 13:00:48 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/osprofiler/web.py", line 111, in __call__ May 28 13:00:48 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return request.get_response(self.application) May 28 13:00:48 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/request.py", line 1313, in send May 28 13:00:48 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault status, headers, app_iter = self.call_application( May 28 13:00:48 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/request.py", line 1278, in call_application May 28 13:00:48 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault app_iter = application(self.environ, start_response) May 28 13:00:48 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 129, in __call__ May 28 13:00:48 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault resp = self.call_func(req, *args, **kw) May 28 13:00:48 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 193, in call_func May 28 13:00:48 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return self.func(req, *args, **kwargs) May 28 13:00:48 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py", line 340, in __call__ May 28 13:00:48 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault response = req.get_response(self._app) May 28 13:00:48 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/request.py", line 1313, in send May 28 13:00:48 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault status, headers, app_iter = self.call_application( May 28 13:00:48 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/request.py", line 1278, in call_application May 28 13:00:48 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault app_iter = application(self.environ, start_response) May 28 13:00:48 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 143, in __call__ May 28 13:00:48 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return resp(environ, start_response) May 28 13:00:48 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 143, in __call__ May 28 13:00:48 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return resp(environ, start_response) May 28 13:00:48 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/routes/middleware.py", line 153, in __call__ May 28 13:00:48 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault response = self.app(environ, start_response) May 28 13:00:48 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 143, in __call__ May 28 13:00:48 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return resp(environ, start_response) May 28 13:00:48 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 129, in __call__ May 28 13:00:48 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault resp = self.call_func(req, *args, **kw) May 28 13:00:48 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 193, in call_func May 28 13:00:48 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return self.func(req, *args, **kwargs) May 28 13:00:48 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/api/openstack/wsgi.py", line 764, in __call__ May 28 13:00:48 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return self._process_stack(request, action, action_args, May 28 13:00:48 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/api/openstack/wsgi.py", line 829, in _process_stack May 28 13:00:48 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault action_result = self.dispatch(meth, request, action_args) May 28 13:00:48 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/api/openstack/wsgi.py", line 924, in dispatch May 28 13:00:48 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return method(req=request, **action_args) May 28 13:00:48 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/api/openstack/wsgi.py", line 1066, in version_select May 28 13:00:48 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return func.func(self, *args, **kwargs) May 28 13:00:48 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/api/v2/shares.py", line 523, in access_list May 28 13:00:48 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return self._access_list(req, id, body) May 28 13:00:48 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/api/v1/shares.py", line 667, in _access_list May 28 13:00:48 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault share = self.share_api.get(context, id) May 28 13:00:48 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/share/api.py", line 2211, in get May 28 13:00:48 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault rv = self.db.share_get(context, share_id) May 28 13:00:48 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/db/api.py", line 404, in share_get May 28 13:00:48 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return IMPL.share_get(context, share_id, **kwargs) May 28 13:00:48 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/db/sqlalchemy/api.py", line 166, in wrapper May 28 13:00:48 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return f(*args, **kwargs) May 28 13:00:48 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/enginefacade.py", line 998, in wrapper May 28 13:00:48 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return fn(*args, **kwargs) May 28 13:00:48 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/db/sqlalchemy/api.py", line 2367, in share_get May 28 13:00:48 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return _share_get(context, share_id, **kwargs) May 28 13:00:48 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/db/sqlalchemy/api.py", line 2378, in _share_get May 28 13:00:48 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault raise exception.NotFound() May 28 13:00:48 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault manila.exception.NotFound: Resource could not be found. May 28 13:00:48 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault May 28 13:00:48 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.middleware.fault [None req-adf8d2bc-27a9-4b08-9eec-613e27a35fae tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/shares/f4283c2a-3835-416e-9703-f5745babbf5c/action returned with HTTP 404 May 28 13:00:48 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 961/1959] 10.27.203.238 () {66 vars in 1493 bytes} [Tue May 28 13:00:48 2024] POST /share/v2/a4f3887fa28c457390f5b66615564430/shares/f4283c2a-3835-416e-9703-f5745babbf5c/action => generated 84 bytes in 12 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 13:00:48 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-49571241-7d96-45b7-8298-01a6acc3eece tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] POST http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/shares May 28 13:00:48 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-49571241-7d96-45b7-8298-01a6acc3eece tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share": {"share_proto": "nfs", "description": "Tempest's share", "snapshot_id": null, "name": "tempest-tempest-created-share-457699590", "size": 1, "metadata": {}, "is_public": false, "share_type": "1749967d-80e1-4d76-8cac-122e8902d0cd"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:00:48 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.v1.shares [None req-49571241-7d96-45b7-8298-01a6acc3eece tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Create NFS share of 1 GB May 28 13:00:48 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.quota [None req-49571241-7d96-45b7-8298-01a6acc3eece tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Created reservations ['6b8ec3c4-17d1-4ade-9201-ab3e57820e53', '3b794e41-e88f-4da2-b650-76b24fe9c95d', '16d7af0b-5f3e-4308-b752-7ba736f8f6c2', 'f8551f0f-5d47-4f13-81a8-9d31d6a9e0cf'] {{(pid=98329) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 13:00:48 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.quota [None req-49571241-7d96-45b7-8298-01a6acc3eece tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Committed reservations ['6b8ec3c4-17d1-4ade-9201-ab3e57820e53', '3b794e41-e88f-4da2-b650-76b24fe9c95d', '16d7af0b-5f3e-4308-b752-7ba736f8f6c2', 'f8551f0f-5d47-4f13-81a8-9d31d6a9e0cf'] {{(pid=98329) commit /opt/stack/manila/manila/quota.py:1063}} May 28 13:00:48 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.host_manager [None req-49571241-7d96-45b7-8298-01a6acc3eece tempest-ShareRulesTest-1530341375 None] Share service is down. (host: l75lg1-v1@generic2). May 28 13:00:48 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.host_manager [None req-49571241-7d96-45b7-8298-01a6acc3eece tempest-ShareRulesTest-1530341375 None] Share service is down. (host: l75lg1-v1@generic1). May 28 13:00:48 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-49571241-7d96-45b7-8298-01a6acc3eece tempest-ShareRulesTest-1530341375 None] Starting with 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:80}} May 28 13:00:48 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-df1d3fc8-e0d9-4d36-8fd1-0a8f7df857d7 tempest-ShareTransferNegativeTest-884271560 None] <<< [DELETE] https://127.0.0.1:40443/api/viewpolicies/41/ May 28 13:00:48 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-49571241-7d96-45b7-8298-01a6acc3eece tempest-ShareRulesTest-1530341375 None] Filter OnlyHostFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:00:48 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-49571241-7d96-45b7-8298-01a6acc3eece tempest-ShareRulesTest-1530341375 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:00:48 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-df1d3fc8-e0d9-4d36-8fd1-0a8f7df857d7 tempest-ShareTransferNegativeTest-884271560 None] --- [DELETE] https://127.0.0.1:40443/api/viewpolicies/41/: Done May 28 13:00:48 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.capacity [None req-49571241-7d96-45b7-8298-01a6acc3eece tempest-ShareRulesTest-1530341375 None] Space information for share creation on host l75lg1-v1@vast#vast (requested / avail): 1/2081 {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/capacity.py:83}} May 28 13:00:48 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-49571241-7d96-45b7-8298-01a6acc3eece tempest-ShareRulesTest-1530341375 None] Filter CapacityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:00:48 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-49571241-7d96-45b7-8298-01a6acc3eece tempest-ShareRulesTest-1530341375 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:00:48 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-49571241-7d96-45b7-8298-01a6acc3eece tempest-ShareRulesTest-1530341375 None] Driver Filter: Checking host 'l75lg1-v1@vast#vast' {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:37}} May 28 13:00:48 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-49571241-7d96-45b7-8298-01a6acc3eece tempest-ShareRulesTest-1530341375 None] Filter function not set :: passing host. {{(pid=98327) _check_filter_function /opt/stack/manila/manila/scheduler/filters/driver.py:53}} May 28 13:00:48 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-49571241-7d96-45b7-8298-01a6acc3eece tempest-ShareRulesTest-1530341375 None] Result: True {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:40}} May 28 13:00:48 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-49571241-7d96-45b7-8298-01a6acc3eece tempest-ShareRulesTest-1530341375 None] Done checking host 'l75lg1-v1@vast#vast' {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:41}} May 28 13:00:48 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-49571241-7d96-45b7-8298-01a6acc3eece tempest-ShareRulesTest-1530341375 None] Filter DriverFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:00:48 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-49571241-7d96-45b7-8298-01a6acc3eece tempest-ShareRulesTest-1530341375 None] Filter ShareReplicationFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:00:48 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-49571241-7d96-45b7-8298-01a6acc3eece tempest-ShareRulesTest-1530341375 None] Filter CreateFromSnapshotFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:00:48 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-49571241-7d96-45b7-8298-01a6acc3eece tempest-ShareRulesTest-1530341375 None] Filter AffinityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:00:48 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-49571241-7d96-45b7-8298-01a6acc3eece tempest-ShareRulesTest-1530341375 None] Filter AntiAffinityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:00:48 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.drivers.filter [None req-49571241-7d96-45b7-8298-01a6acc3eece tempest-ShareRulesTest-1530341375 None] Filtered share [host: 'l75lg1-v1@vast#vast', free_capacity_gb: 2081.6277076322585, pools: None] {{(pid=98327) _schedule_share /opt/stack/manila/manila/scheduler/drivers/filter.py:268}} May 28 13:00:48 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-49571241-7d96-45b7-8298-01a6acc3eece tempest-ShareRulesTest-1530341375 None] Checking host 'l75lg1-v1@vast#vast' {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:46}} May 28 13:00:48 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.weighers.goodness [None req-49571241-7d96-45b7-8298-01a6acc3eece tempest-ShareRulesTest-1530341375 None] Goodness function not set :: defaulting to minimal goodness rating of 0. May 28 13:00:48 l75lg1-v1 manila-scheduler[98327]: INFO manila.scheduler.weighers.goodness [None req-49571241-7d96-45b7-8298-01a6acc3eece tempest-ShareRulesTest-1530341375 None] Goodness function result for host l75lg1-v1@vast#vast: 0. May 28 13:00:48 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-49571241-7d96-45b7-8298-01a6acc3eece tempest-ShareRulesTest-1530341375 None] Goodness: 0 {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:48}} May 28 13:00:48 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-49571241-7d96-45b7-8298-01a6acc3eece tempest-ShareRulesTest-1530341375 None] Done checking host 'l75lg1-v1@vast#vast' {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:49}} May 28 13:00:48 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.drivers.filter [None req-49571241-7d96-45b7-8298-01a6acc3eece tempest-ShareRulesTest-1530341375 None] Choosing for share: WeighedHost [host: l75lg1-v1@vast#vast, weight: 0.0] {{(pid=98327) _schedule_share /opt/stack/manila/manila/scheduler/drivers/filter.py:274}} May 28 13:00:48 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-49571241-7d96-45b7-8298-01a6acc3eece tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/shares returned with HTTP 200 May 28 13:00:48 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 999/1960] 10.27.203.238 () {66 vars in 1362 bytes} [Tue May 28 13:00:48 2024] POST /share/v2/a4f3887fa28c457390f5b66615564430/shares => generated 1311 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:00:48 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-7fbe0a9e-3d18-435d-ac5e-8ffc4924d0a6 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] GET http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/shares/415b1daa-22c2-48a3-873e-80762e65a747 May 28 13:00:48 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-7fbe0a9e-3d18-435d-ac5e-8ffc4924d0a6 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:48 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-7fbe0a9e-3d18-435d-ac5e-8ffc4924d0a6 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:48 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-7fbe0a9e-3d18-435d-ac5e-8ffc4924d0a6 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/shares/415b1daa-22c2-48a3-873e-80762e65a747 returned with HTTP 200 May 28 13:00:48 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 962/1961] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:00:48 2024] GET /share/v2/a4f3887fa28c457390f5b66615564430/shares/415b1daa-22c2-48a3-873e-80762e65a747 => generated 1311 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:00:48 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-6924aa00-1b38-441d-a0d1-dc81d9823d0c tempest-ShareRulesNegativeTest-930400775 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:00:48 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-6924aa00-1b38-441d-a0d1-dc81d9823d0c tempest-ShareRulesNegativeTest-930400775 None] [] May 28 13:00:48 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-6924aa00-1b38-441d-a0d1-dc81d9823d0c tempest-ShareRulesNegativeTest-930400775 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 13:00:48 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-6924aa00-1b38-441d-a0d1-dc81d9823d0c tempest-ShareRulesNegativeTest-930400775 None] >>> [POST] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:00:48 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-6924aa00-1b38-441d-a0d1-dc81d9823d0c tempest-ShareRulesNegativeTest-930400775 None] {'data': '{"name": "e0a28587-55d6-44c6-8c73-249d5047f95e"}', May 28 13:00:48 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-6924aa00-1b38-441d-a0d1-dc81d9823d0c tempest-ShareRulesNegativeTest-930400775 None] 'json': None, May 28 13:00:48 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-6924aa00-1b38-441d-a0d1-dc81d9823d0c tempest-ShareRulesNegativeTest-930400775 None] 'params': None} May 28 13:00:49 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-49571241-7d96-45b7-8298-01a6acc3eece tempest-ShareRulesTest-1530341375 None] >>> [GET] https://127.0.0.1:40443/api/vippools/ May 28 13:00:49 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-49571241-7d96-45b7-8298-01a6acc3eece tempest-ShareRulesTest-1530341375 None] {'allow_redirects': True, 'params': {'name': 'vippool-1'}} May 28 13:00:49 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-df1d3fc8-e0d9-4d36-8fd1-0a8f7df857d7 tempest-ShareTransferNegativeTest-884271560 None] Created reservations ['ca9205cc-6b26-4774-85d9-0d4d34755c1b', 'bd06f3b3-41d5-45c8-b39e-210bd2966fc3', '7eb63274-0098-4026-a5ad-9054659529bd', '4ba22d91-27b6-43d1-9570-ca256252228e'] {{(pid=98474) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 13:00:49 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-df1d3fc8-e0d9-4d36-8fd1-0a8f7df857d7 tempest-ShareTransferNegativeTest-884271560 None] Committed reservations ['ca9205cc-6b26-4774-85d9-0d4d34755c1b', 'bd06f3b3-41d5-45c8-b39e-210bd2966fc3', '7eb63274-0098-4026-a5ad-9054659529bd', '4ba22d91-27b6-43d1-9570-ca256252228e'] {{(pid=98474) commit /opt/stack/manila/manila/quota.py:1063}} May 28 13:00:49 l75lg1-v1 manila-share[98474]: INFO manila.share.manager [None req-df1d3fc8-e0d9-4d36-8fd1-0a8f7df857d7 tempest-ShareTransferNegativeTest-884271560 None] Share instance e21891ab-7145-4d59-b238-375b52d59cb7: deleted successfully. May 28 13:00:49 l75lg1-v1 dstat.sh[49771]: 28-05 13:00:49| 6 1 90 2 0|5696M 1749M 278M 7901M| 15k 7875B| 0 2008k| 0 270 |4499 7706 |1.79 1.24 1.08|1.0 1.0 0| 0 0 | 0 2048M| 29 361 0 53 2 May 28 13:00:49 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-49571241-7d96-45b7-8298-01a6acc3eece tempest-ShareRulesTest-1530341375 None] <<< [GET] https://127.0.0.1:40443/api/vippools/ May 28 13:00:49 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-49571241-7d96-45b7-8298-01a6acc3eece tempest-ShareRulesTest-1530341375 None] [Bunch(active_cnode_ids=[], active_interfaces=4, cluster='loop75-kfs', cluster_id=1, cnode_ids=[], cnodes=[], domain_name='vippool-1', enable_l3=False, enable_weighted_balancing=False, enabled=True, end_ip='172.21.75.4', guid='f2abaede-b397-413a-8faa-3aeead6d3b28', gw_ip='', gw_ipv6='', id=2, ip_ranges=[['172.21.75.1', '172.21.75.4']], name='vippool-1', peer_asn=0, port_membership='ALL', ranges_summary='172.21.75.[1-4]', role='PROTOCOLS', start_ip='172.21.75.1', subnet_cidr=16, subnet_cidr_ipv6=None, sync='SYNCED', sync_time='2024-05-28T12:50:09.644123Z', tenant_id=1, tenant_name='default', title='172.21.75.1 - 172.21.75.4', url='https://127.0.0.1:40443/api/vippools/2/', vast_asn=0, vlan=0, vms_preferred=False)] May 28 13:00:49 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-49571241-7d96-45b7-8298-01a6acc3eece tempest-ShareRulesTest-1530341375 None] --- [GET] https://127.0.0.1:40443/api/vippools/: Done May 28 13:00:49 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-49571241-7d96-45b7-8298-01a6acc3eece tempest-ShareRulesTest-1530341375 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:00:49 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-49571241-7d96-45b7-8298-01a6acc3eece tempest-ShareRulesTest-1530341375 None] {'allow_redirects': True, May 28 13:00:49 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-49571241-7d96-45b7-8298-01a6acc3eece tempest-ShareRulesTest-1530341375 None] 'params': {'name': 'f20d9b3a-8716-4664-aff7-80ddf3014290'}} May 28 13:00:49 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2ee65bb9-323a-4b84-b37e-5e80a5aca94a tempest-ShareTypeAvailabilityZonesTest-364532124 None] <<< [POST] https://127.0.0.1:40443/api/views/ May 28 13:00:49 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2ee65bb9-323a-4b84-b37e-5e80a5aca94a tempest-ShareTypeAvailabilityZonesTest-364532124 None] Bunch(abac_tags=[], abe_max_depth=None, abe_protocols=[], alias='', allow_anonymous_access=False, allow_s3_anonymous_access=False, auto_commit='0d', bucket='', bucket_creators=[], bucket_creators_groups=[], bucket_owner=None, bulk_permission_update_progress=None, bulk_permission_update_state=None, cluster='loop75-kfs', cluster_id=1, created='2024-05-28T13:00:49.067017Z', enabled=True, files_retention_mode='NONE', guid='b2569ce7-532c-41d8-bf29-3182c0242482', id=45, ignore_oos=False, internal=False, is_remote=False, is_seamless=False, logical_capacity=0, max_retention_period=None, min_retention_period=None, name='1d36626a-c0bd-47a1-a990-d50f95cbf99c', nfs_interop_flags='BOTH_NFS3_AND_NFS4_INTEROP_DISABLED', path='/manila/manila-1d36626a-c0bd-47a1-a990-d50f95cbf99c', physical_capacity=0, policy='1d36626a-c0bd-47a1-a990-d50f95cbf99c', policy_id=46, protocols=['NFS'], qos_policy=None, qos_policy_id=None, s3_locks=False, s3_locks_retention_mode='NONE', s3_locks_retention_period='', s3_object_ownership_rule='ObjectWriter', s3_unverified_lookup=False, s3_versioning=False, select_for_live_monitoring=False, share='', share_acl=Bunch(acl=[], enabled=False), sync='SYNCED', sync_time='2024-05-28T13:00:49.324874Z', tenant_id=1, tenant_name='default', title='/manila/manila-1d36626a-c0bd-47a1-a990-d50f95cbf99c', url='https://127.0.0.1:40443/api/views/45/') May 28 13:00:49 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2ee65bb9-323a-4b84-b37e-5e80a5aca94a tempest-ShareTypeAvailabilityZonesTest-364532124 None] --- [POST] https://127.0.0.1:40443/api/views/: Done May 28 13:00:49 l75lg1-v1 manila-share[98474]: INFO manila.share.manager [None req-2ee65bb9-323a-4b84-b37e-5e80a5aca94a tempest-ShareTypeAvailabilityZonesTest-364532124 None] Share instance 1d36626a-c0bd-47a1-a990-d50f95cbf99c created successfully. May 28 13:00:49 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-6924aa00-1b38-441d-a0d1-dc81d9823d0c tempest-ShareRulesNegativeTest-930400775 None] <<< [POST] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:00:49 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-6924aa00-1b38-441d-a0d1-dc81d9823d0c tempest-ShareRulesNegativeTest-930400775 None] Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=0, created='2024-05-28T13:00:49.397495Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='50b7ba16-b07b-48e1-9e62-ee344100e7dc', id=47, internal=False, is_s3_default_policy=False, name='e0a28587-55d6-44c6-8c73-249d5047f95e', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=[], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['*'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['*'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T13:00:49.703457Z', tenant_id=1, tenant_name='default', title='e0a28587-55d6-44c6-8c73-249d5047f95e', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/47/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[]) May 28 13:00:49 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-6924aa00-1b38-441d-a0d1-dc81d9823d0c tempest-ShareRulesNegativeTest-930400775 None] --- [POST] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 13:00:49 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-6924aa00-1b38-441d-a0d1-dc81d9823d0c tempest-ShareRulesNegativeTest-930400775 None] >>> [GET] https://127.0.0.1:40443/api/quotas/ May 28 13:00:49 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-6924aa00-1b38-441d-a0d1-dc81d9823d0c tempest-ShareRulesNegativeTest-930400775 None] {'allow_redirects': True, May 28 13:00:49 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-6924aa00-1b38-441d-a0d1-dc81d9823d0c tempest-ShareRulesNegativeTest-930400775 None] 'params': {'name': 'e0a28587-55d6-44c6-8c73-249d5047f95e'}} May 28 13:00:49 l75lg1-v1 nova-conductor[83647]: DEBUG dbcounter [-] [83647] Writing DB stats nova_cell1:SELECT=1,nova_cell1:UPDATE=1 {{(pid=83647) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:00:49 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-49571241-7d96-45b7-8298-01a6acc3eece tempest-ShareRulesTest-1530341375 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:00:49 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-49571241-7d96-45b7-8298-01a6acc3eece tempest-ShareRulesTest-1530341375 None] [] May 28 13:00:49 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-49571241-7d96-45b7-8298-01a6acc3eece tempest-ShareRulesTest-1530341375 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 13:00:49 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-49571241-7d96-45b7-8298-01a6acc3eece tempest-ShareRulesTest-1530341375 None] >>> [POST] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:00:49 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-49571241-7d96-45b7-8298-01a6acc3eece tempest-ShareRulesTest-1530341375 None] {'data': '{"name": "f20d9b3a-8716-4664-aff7-80ddf3014290"}', May 28 13:00:49 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-49571241-7d96-45b7-8298-01a6acc3eece tempest-ShareRulesTest-1530341375 None] 'json': None, May 28 13:00:49 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-49571241-7d96-45b7-8298-01a6acc3eece tempest-ShareRulesTest-1530341375 None] 'params': None} May 28 13:00:50 l75lg1-v1 nova-conductor[83648]: DEBUG dbcounter [-] [83648] Writing DB stats nova_cell1:SELECT=1 {{(pid=83648) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:00:50 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-6924aa00-1b38-441d-a0d1-dc81d9823d0c tempest-ShareRulesNegativeTest-930400775 None] <<< [GET] https://127.0.0.1:40443/api/quotas/ May 28 13:00:50 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-6924aa00-1b38-441d-a0d1-dc81d9823d0c tempest-ShareRulesNegativeTest-930400775 None] [] May 28 13:00:50 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-6924aa00-1b38-441d-a0d1-dc81d9823d0c tempest-ShareRulesNegativeTest-930400775 None] --- [GET] https://127.0.0.1:40443/api/quotas/: Done May 28 13:00:50 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-6924aa00-1b38-441d-a0d1-dc81d9823d0c tempest-ShareRulesNegativeTest-930400775 None] >>> [POST] https://127.0.0.1:40443/api/quotas/ May 28 13:00:50 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-6924aa00-1b38-441d-a0d1-dc81d9823d0c tempest-ShareRulesNegativeTest-930400775 None] {'data': '{"name": "e0a28587-55d6-44c6-8c73-249d5047f95e", "path": ' May 28 13:00:50 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-6924aa00-1b38-441d-a0d1-dc81d9823d0c tempest-ShareRulesNegativeTest-930400775 None] '"/manila/manila-e0a28587-55d6-44c6-8c73-249d5047f95e", "create_dir": ' May 28 13:00:50 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-6924aa00-1b38-441d-a0d1-dc81d9823d0c tempest-ShareRulesNegativeTest-930400775 None] 'true, "hard_limit": 1073741824}', May 28 13:00:50 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-6924aa00-1b38-441d-a0d1-dc81d9823d0c tempest-ShareRulesNegativeTest-930400775 None] 'json': None, May 28 13:00:50 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-6924aa00-1b38-441d-a0d1-dc81d9823d0c tempest-ShareRulesNegativeTest-930400775 None] 'params': None} May 28 13:00:50 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 13:00:50 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-4bd20ab0-cbef-4862-8153-829fc08cfd4f tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] GET http://10.27.203.238/share/v2/cac556dc39a14bbdbdbabfc80672fb1f/shares/0c7ef0a2-5628-47dd-9eba-98153028dd8a May 28 13:00:50 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-4bd20ab0-cbef-4862-8153-829fc08cfd4f tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:50 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-4bd20ab0-cbef-4862-8153-829fc08cfd4f tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:50 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-4bd20ab0-cbef-4862-8153-829fc08cfd4f tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] HTTP exception thrown: The resource could not be found. May 28 13:00:50 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-4bd20ab0-cbef-4862-8153-829fc08cfd4f tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] http://10.27.203.238/share/v2/cac556dc39a14bbdbdbabfc80672fb1f/shares/0c7ef0a2-5628-47dd-9eba-98153028dd8a returned with HTTP 404 May 28 13:00:50 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1000/1962] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:00:50 2024] GET /share/v2/cac556dc39a14bbdbdbabfc80672fb1f/shares/0c7ef0a2-5628-47dd-9eba-98153028dd8a => generated 78 bytes in 13 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 13:00:50 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-17b715ab-0599-4aaa-8bb3-511d4e7a1942 tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] GET http://10.27.203.238/share/v2/cac556dc39a14bbdbdbabfc80672fb1f/share-replicas/detail?share_id=bd070603-3332-4a76-a743-411df92ace16 May 28 13:00:50 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-17b715ab-0599-4aaa-8bb3-511d4e7a1942 tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:50 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-17b715ab-0599-4aaa-8bb3-511d4e7a1942 tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:50 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-17b715ab-0599-4aaa-8bb3-511d4e7a1942 tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] http://10.27.203.238/share/v2/cac556dc39a14bbdbdbabfc80672fb1f/share-replicas/detail?share_id=bd070603-3332-4a76-a743-411df92ace16 returned with HTTP 200 May 28 13:00:50 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 963/1963] 10.27.203.238 () {64 vars in 1476 bytes} [Tue May 28 13:00:50 2024] GET /share/v2/cac556dc39a14bbdbdbabfc80672fb1f/share-replicas/detail?share_id=bd070603-3332-4a76-a743-411df92ace16 => generated 22 bytes in 12 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:00:50 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-bd7f0e79-6ba7-4b97-a4f2-b303489b4237 tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] DELETE http://10.27.203.238/share/v2/cac556dc39a14bbdbdbabfc80672fb1f/shares/bd070603-3332-4a76-a743-411df92ace16 May 28 13:00:50 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-bd7f0e79-6ba7-4b97-a4f2-b303489b4237 tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:50 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-bd7f0e79-6ba7-4b97-a4f2-b303489b4237 tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] Calling method 'ShareMixin.delete' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:50 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.v1.shares [None req-bd7f0e79-6ba7-4b97-a4f2-b303489b4237 tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] Delete share with id: bd070603-3332-4a76-a743-411df92ace16 May 28 13:00:50 l75lg1-v1 dstat.sh[49771]: 28-05 13:00:50| 2 0 96 1 0|5697M 1749M 278M 7901M| 20k 3404B| 0 1276k| 0 127 |2907 4675 |1.79 1.24 1.08|2.0 1.0 0| 0 0 | 0 2048M| 29 362 0 51 2 May 28 13:00:50 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-bd7f0e79-6ba7-4b97-a4f2-b303489b4237 tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] http://10.27.203.238/share/v2/cac556dc39a14bbdbdbabfc80672fb1f/shares/bd070603-3332-4a76-a743-411df92ace16 returned with HTTP 202 May 28 13:00:50 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1001/1964] 10.27.203.238 () {64 vars in 1454 bytes} [Tue May 28 13:00:50 2024] DELETE /share/v2/cac556dc39a14bbdbdbabfc80672fb1f/shares/bd070603-3332-4a76-a743-411df92ace16 => generated 0 bytes in 123 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 13:00:50 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-60956611-2eea-40e9-955b-ff2127a79c21 tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] GET http://10.27.203.238/share/v2/cac556dc39a14bbdbdbabfc80672fb1f/shares/bd070603-3332-4a76-a743-411df92ace16 May 28 13:00:50 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-60956611-2eea-40e9-955b-ff2127a79c21 tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:50 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-60956611-2eea-40e9-955b-ff2127a79c21 tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:50 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-60956611-2eea-40e9-955b-ff2127a79c21 tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] http://10.27.203.238/share/v2/cac556dc39a14bbdbdbabfc80672fb1f/shares/bd070603-3332-4a76-a743-411df92ace16 returned with HTTP 200 May 28 13:00:50 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 964/1965] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:00:50 2024] GET /share/v2/cac556dc39a14bbdbdbabfc80672fb1f/shares/bd070603-3332-4a76-a743-411df92ace16 => generated 1315 bytes in 26 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:00:50 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-bd7f0e79-6ba7-4b97-a4f2-b303489b4237 tempest-ShareTransferNegativeTest-884271560 None] Acquiring lock "locked_access_rules_operation_by_share_instance_e89b90ae-d644-4b77-81a0-3d997b90fad0" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:00:50 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-bd7f0e79-6ba7-4b97-a4f2-b303489b4237 tempest-ShareTransferNegativeTest-884271560 None] Lock "locked_access_rules_operation_by_share_instance_e89b90ae-d644-4b77-81a0-3d997b90fad0" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:00:50 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-bd7f0e79-6ba7-4b97-a4f2-b303489b4237 tempest-ShareTransferNegativeTest-884271560 None] Lock "locked_access_rules_operation_by_share_instance_e89b90ae-d644-4b77-81a0-3d997b90fad0" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:00:50 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-bd7f0e79-6ba7-4b97-a4f2-b303489b4237 tempest-ShareTransferNegativeTest-884271560 None] Acquiring lock "locked_access_rules_operation_by_share_instance_e89b90ae-d644-4b77-81a0-3d997b90fad0" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:00:50 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-bd7f0e79-6ba7-4b97-a4f2-b303489b4237 tempest-ShareTransferNegativeTest-884271560 None] Lock "locked_access_rules_operation_by_share_instance_e89b90ae-d644-4b77-81a0-3d997b90fad0" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:00:50 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-bd7f0e79-6ba7-4b97-a4f2-b303489b4237 tempest-ShareTransferNegativeTest-884271560 None] Lock "locked_access_rules_operation_by_share_instance_e89b90ae-d644-4b77-81a0-3d997b90fad0" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:00:50 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-bd7f0e79-6ba7-4b97-a4f2-b303489b4237 tempest-ShareTransferNegativeTest-884271560 None] Acquiring lock "locked_access_rules_operation_by_share_instance_e89b90ae-d644-4b77-81a0-3d997b90fad0" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:00:50 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-bd7f0e79-6ba7-4b97-a4f2-b303489b4237 tempest-ShareTransferNegativeTest-884271560 None] Lock "locked_access_rules_operation_by_share_instance_e89b90ae-d644-4b77-81a0-3d997b90fad0" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:00:50 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-bd7f0e79-6ba7-4b97-a4f2-b303489b4237 tempest-ShareTransferNegativeTest-884271560 None] Lock "locked_access_rules_operation_by_share_instance_e89b90ae-d644-4b77-81a0-3d997b90fad0" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:00:50 l75lg1-v1 manila-share[98474]: DEBUG manila.share.access [None req-bd7f0e79-6ba7-4b97-a4f2-b303489b4237 tempest-ShareTransferNegativeTest-884271560 None] All access rules have been synced for share instance e89b90ae-d644-4b77-81a0-3d997b90fad0 belonging to share bd070603-3332-4a76-a743-411df92ace16. {{(pid=98474) update_access_rules /opt/stack/manila/manila/share/access.py:304}} May 28 13:00:50 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-bd7f0e79-6ba7-4b97-a4f2-b303489b4237 tempest-ShareTransferNegativeTest-884271560 None] deleting '/manila/manila-e89b90ae-d644-4b77-81a0-3d997b90fad0' May 28 13:00:50 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bd7f0e79-6ba7-4b97-a4f2-b303489b4237 tempest-ShareTransferNegativeTest-884271560 None] >>> [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/ May 28 13:00:50 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bd7f0e79-6ba7-4b97-a4f2-b303489b4237 tempest-ShareTransferNegativeTest-884271560 None] {'data': '{"path": "/manila/manila-e89b90ae-d644-4b77-81a0-3d997b90fad0"}', May 28 13:00:50 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bd7f0e79-6ba7-4b97-a4f2-b303489b4237 tempest-ShareTransferNegativeTest-884271560 None] 'params': None} May 28 13:00:50 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-06fd97c0-d76b-410c-a918-12b2ce582f74 tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] GET http://10.27.203.238/share/v2/284d76edec3144579d6fb3f6dbc0dd4e/shares/433f546f-3297-46a0-b412-18630103d191 May 28 13:00:50 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-06fd97c0-d76b-410c-a918-12b2ce582f74 tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:50 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-06fd97c0-d76b-410c-a918-12b2ce582f74 tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:50 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-06fd97c0-d76b-410c-a918-12b2ce582f74 tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] http://10.27.203.238/share/v2/284d76edec3144579d6fb3f6dbc0dd4e/shares/433f546f-3297-46a0-b412-18630103d191 returned with HTTP 200 May 28 13:00:50 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1002/1966] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:00:50 2024] GET /share/v2/284d76edec3144579d6fb3f6dbc0dd4e/shares/433f546f-3297-46a0-b412-18630103d191 => generated 1317 bytes in 26 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:00:50 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-83cda872-fe74-45f1-8ecc-af74522faebd tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] GET http://10.27.203.238/share/v2/284d76edec3144579d6fb3f6dbc0dd4e/shares/433f546f-3297-46a0-b412-18630103d191 May 28 13:00:50 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-83cda872-fe74-45f1-8ecc-af74522faebd tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:50 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-83cda872-fe74-45f1-8ecc-af74522faebd tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:50 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-83cda872-fe74-45f1-8ecc-af74522faebd tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] http://10.27.203.238/share/v2/284d76edec3144579d6fb3f6dbc0dd4e/shares/433f546f-3297-46a0-b412-18630103d191 returned with HTTP 200 May 28 13:00:50 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 965/1967] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:00:50 2024] GET /share/v2/284d76edec3144579d6fb3f6dbc0dd4e/shares/433f546f-3297-46a0-b412-18630103d191 => generated 1317 bytes in 25 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:00:50 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-a8d52c6f-0d86-42fc-83c9-89a01e46007e tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] GET http://10.27.203.238/share/v2/284d76edec3144579d6fb3f6dbc0dd4e/share-replicas/detail?share_id=433f546f-3297-46a0-b412-18630103d191 May 28 13:00:50 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-a8d52c6f-0d86-42fc-83c9-89a01e46007e tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:50 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-a8d52c6f-0d86-42fc-83c9-89a01e46007e tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:50 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-a8d52c6f-0d86-42fc-83c9-89a01e46007e tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] http://10.27.203.238/share/v2/284d76edec3144579d6fb3f6dbc0dd4e/share-replicas/detail?share_id=433f546f-3297-46a0-b412-18630103d191 returned with HTTP 200 May 28 13:00:50 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1003/1968] 10.27.203.238 () {64 vars in 1476 bytes} [Tue May 28 13:00:50 2024] GET /share/v2/284d76edec3144579d6fb3f6dbc0dd4e/share-replicas/detail?share_id=433f546f-3297-46a0-b412-18630103d191 => generated 22 bytes in 13 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:00:50 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-914df302-1a94-49cd-951e-378d1ac5e45a tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] DELETE http://10.27.203.238/share/v2/284d76edec3144579d6fb3f6dbc0dd4e/shares/433f546f-3297-46a0-b412-18630103d191 May 28 13:00:50 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-914df302-1a94-49cd-951e-378d1ac5e45a tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:50 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-914df302-1a94-49cd-951e-378d1ac5e45a tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] Calling method 'ShareMixin.delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:50 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.v1.shares [None req-914df302-1a94-49cd-951e-378d1ac5e45a tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] Delete share with id: 433f546f-3297-46a0-b412-18630103d191 May 28 13:00:50 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bd7f0e79-6ba7-4b97-a4f2-b303489b4237 tempest-ShareTransferNegativeTest-884271560 None] <<< [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/ May 28 13:00:50 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bd7f0e79-6ba7-4b97-a4f2-b303489b4237 tempest-ShareTransferNegativeTest-884271560 None] 'OK' May 28 13:00:50 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bd7f0e79-6ba7-4b97-a4f2-b303489b4237 tempest-ShareTransferNegativeTest-884271560 None] --- [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/: Done May 28 13:00:50 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bd7f0e79-6ba7-4b97-a4f2-b303489b4237 tempest-ShareTransferNegativeTest-884271560 None] >>> [GET] https://127.0.0.1:40443/api/views/ May 28 13:00:50 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bd7f0e79-6ba7-4b97-a4f2-b303489b4237 tempest-ShareTransferNegativeTest-884271560 None] {'allow_redirects': True, May 28 13:00:50 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bd7f0e79-6ba7-4b97-a4f2-b303489b4237 tempest-ShareTransferNegativeTest-884271560 None] 'params': {'name': 'e89b90ae-d644-4b77-81a0-3d997b90fad0'}} May 28 13:00:50 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 13:00:50 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-914df302-1a94-49cd-951e-378d1ac5e45a tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] http://10.27.203.238/share/v2/284d76edec3144579d6fb3f6dbc0dd4e/shares/433f546f-3297-46a0-b412-18630103d191 returned with HTTP 202 May 28 13:00:50 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 966/1969] 10.27.203.238 () {64 vars in 1454 bytes} [Tue May 28 13:00:50 2024] DELETE /share/v2/284d76edec3144579d6fb3f6dbc0dd4e/shares/433f546f-3297-46a0-b412-18630103d191 => generated 0 bytes in 134 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 13:00:50 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-eac667c9-4a28-4ca5-af01-0a78ca120dfd tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] GET http://10.27.203.238/share/v2/284d76edec3144579d6fb3f6dbc0dd4e/shares/433f546f-3297-46a0-b412-18630103d191 May 28 13:00:50 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-eac667c9-4a28-4ca5-af01-0a78ca120dfd tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:50 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-eac667c9-4a28-4ca5-af01-0a78ca120dfd tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:50 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-eac667c9-4a28-4ca5-af01-0a78ca120dfd tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] http://10.27.203.238/share/v2/284d76edec3144579d6fb3f6dbc0dd4e/shares/433f546f-3297-46a0-b412-18630103d191 returned with HTTP 200 May 28 13:00:50 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1004/1970] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:00:50 2024] GET /share/v2/284d76edec3144579d6fb3f6dbc0dd4e/shares/433f546f-3297-46a0-b412-18630103d191 => generated 1316 bytes in 28 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:00:50 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-914df302-1a94-49cd-951e-378d1ac5e45a tempest-ShareTypeAvailabilityZonesTest-364532124 None] Acquiring lock "locked_access_rules_operation_by_share_instance_1d36626a-c0bd-47a1-a990-d50f95cbf99c" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:00:50 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-914df302-1a94-49cd-951e-378d1ac5e45a tempest-ShareTypeAvailabilityZonesTest-364532124 None] Lock "locked_access_rules_operation_by_share_instance_1d36626a-c0bd-47a1-a990-d50f95cbf99c" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:00:50 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-914df302-1a94-49cd-951e-378d1ac5e45a tempest-ShareTypeAvailabilityZonesTest-364532124 None] Lock "locked_access_rules_operation_by_share_instance_1d36626a-c0bd-47a1-a990-d50f95cbf99c" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:00:50 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-914df302-1a94-49cd-951e-378d1ac5e45a tempest-ShareTypeAvailabilityZonesTest-364532124 None] Acquiring lock "locked_access_rules_operation_by_share_instance_1d36626a-c0bd-47a1-a990-d50f95cbf99c" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:00:50 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-914df302-1a94-49cd-951e-378d1ac5e45a tempest-ShareTypeAvailabilityZonesTest-364532124 None] Lock "locked_access_rules_operation_by_share_instance_1d36626a-c0bd-47a1-a990-d50f95cbf99c" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:00:50 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-914df302-1a94-49cd-951e-378d1ac5e45a tempest-ShareTypeAvailabilityZonesTest-364532124 None] Lock "locked_access_rules_operation_by_share_instance_1d36626a-c0bd-47a1-a990-d50f95cbf99c" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:00:50 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-914df302-1a94-49cd-951e-378d1ac5e45a tempest-ShareTypeAvailabilityZonesTest-364532124 None] Acquiring lock "locked_access_rules_operation_by_share_instance_1d36626a-c0bd-47a1-a990-d50f95cbf99c" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:00:50 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-914df302-1a94-49cd-951e-378d1ac5e45a tempest-ShareTypeAvailabilityZonesTest-364532124 None] Lock "locked_access_rules_operation_by_share_instance_1d36626a-c0bd-47a1-a990-d50f95cbf99c" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:00:50 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-914df302-1a94-49cd-951e-378d1ac5e45a tempest-ShareTypeAvailabilityZonesTest-364532124 None] Lock "locked_access_rules_operation_by_share_instance_1d36626a-c0bd-47a1-a990-d50f95cbf99c" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:00:50 l75lg1-v1 manila-share[98474]: DEBUG manila.share.access [None req-914df302-1a94-49cd-951e-378d1ac5e45a tempest-ShareTypeAvailabilityZonesTest-364532124 None] All access rules have been synced for share instance 1d36626a-c0bd-47a1-a990-d50f95cbf99c belonging to share 433f546f-3297-46a0-b412-18630103d191. {{(pid=98474) update_access_rules /opt/stack/manila/manila/share/access.py:304}} May 28 13:00:50 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-914df302-1a94-49cd-951e-378d1ac5e45a tempest-ShareTypeAvailabilityZonesTest-364532124 None] deleting '/manila/manila-1d36626a-c0bd-47a1-a990-d50f95cbf99c' May 28 13:00:50 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-914df302-1a94-49cd-951e-378d1ac5e45a tempest-ShareTypeAvailabilityZonesTest-364532124 None] >>> [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/ May 28 13:00:50 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-914df302-1a94-49cd-951e-378d1ac5e45a tempest-ShareTypeAvailabilityZonesTest-364532124 None] {'data': '{"path": "/manila/manila-1d36626a-c0bd-47a1-a990-d50f95cbf99c"}', May 28 13:00:50 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-914df302-1a94-49cd-951e-378d1ac5e45a tempest-ShareTypeAvailabilityZonesTest-364532124 None] 'params': None} May 28 13:00:50 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-49571241-7d96-45b7-8298-01a6acc3eece tempest-ShareRulesTest-1530341375 None] <<< [POST] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:00:50 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-49571241-7d96-45b7-8298-01a6acc3eece tempest-ShareRulesTest-1530341375 None] Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=0, created='2024-05-28T13:00:50.357495Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='1099a621-1733-438b-a032-2bf134301842', id=48, internal=False, is_s3_default_policy=False, name='f20d9b3a-8716-4664-aff7-80ddf3014290', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=[], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['*'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['*'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T13:00:50.722728Z', tenant_id=1, tenant_name='default', title='f20d9b3a-8716-4664-aff7-80ddf3014290', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/48/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[]) May 28 13:00:50 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-49571241-7d96-45b7-8298-01a6acc3eece tempest-ShareRulesTest-1530341375 None] --- [POST] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 13:00:50 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-49571241-7d96-45b7-8298-01a6acc3eece tempest-ShareRulesTest-1530341375 None] >>> [GET] https://127.0.0.1:40443/api/quotas/ May 28 13:00:50 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-49571241-7d96-45b7-8298-01a6acc3eece tempest-ShareRulesTest-1530341375 None] {'allow_redirects': True, May 28 13:00:50 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-49571241-7d96-45b7-8298-01a6acc3eece tempest-ShareRulesTest-1530341375 None] 'params': {'name': 'f20d9b3a-8716-4664-aff7-80ddf3014290'}} May 28 13:00:50 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-914df302-1a94-49cd-951e-378d1ac5e45a tempest-ShareTypeAvailabilityZonesTest-364532124 None] <<< [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/ May 28 13:00:50 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-914df302-1a94-49cd-951e-378d1ac5e45a tempest-ShareTypeAvailabilityZonesTest-364532124 None] 'OK' May 28 13:00:50 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-914df302-1a94-49cd-951e-378d1ac5e45a tempest-ShareTypeAvailabilityZonesTest-364532124 None] --- [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/: Done May 28 13:00:50 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-914df302-1a94-49cd-951e-378d1ac5e45a tempest-ShareTypeAvailabilityZonesTest-364532124 None] >>> [GET] https://127.0.0.1:40443/api/views/ May 28 13:00:50 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-914df302-1a94-49cd-951e-378d1ac5e45a tempest-ShareTypeAvailabilityZonesTest-364532124 None] {'allow_redirects': True, May 28 13:00:50 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-914df302-1a94-49cd-951e-378d1ac5e45a tempest-ShareTypeAvailabilityZonesTest-364532124 None] 'params': {'name': '1d36626a-c0bd-47a1-a990-d50f95cbf99c'}} May 28 13:00:50 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bd7f0e79-6ba7-4b97-a4f2-b303489b4237 tempest-ShareTransferNegativeTest-884271560 None] <<< [GET] https://127.0.0.1:40443/api/views/ May 28 13:00:50 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bd7f0e79-6ba7-4b97-a4f2-b303489b4237 tempest-ShareTransferNegativeTest-884271560 None] [Bunch(abac_tags=[], abe_max_depth=None, abe_protocols=[], alias='', allow_anonymous_access=False, allow_s3_anonymous_access=False, auto_commit='0d', bucket='', bucket_creators=[], bucket_creators_groups=[], bucket_owner=None, bulk_permission_update_progress=None, bulk_permission_update_state=None, cluster='loop75-kfs', cluster_id=1, created='2024-05-28T12:59:59.792711Z', enabled=True, files_retention_mode='NONE', guid='1dfed4c5-cd54-4fdd-8915-0e1349dd3e85', id=38, ignore_oos=False, internal=False, is_remote=False, is_seamless=False, logical_capacity=0, max_retention_period='0d', min_retention_period='0d', name='e89b90ae-d644-4b77-81a0-3d997b90fad0', nfs_interop_flags='BOTH_NFS3_AND_NFS4_INTEROP_DISABLED', path='/manila/manila-e89b90ae-d644-4b77-81a0-3d997b90fad0', physical_capacity=0, policy='e89b90ae-d644-4b77-81a0-3d997b90fad0', policy_id=39, protocols=['NFS'], qos_policy=None, qos_policy_id=None, s3_locks=False, s3_locks_retention_mode='NONE', s3_locks_retention_period='', s3_unverified_lookup=False, s3_versioning=False, select_for_live_monitoring=False, share='', share_acl=Bunch(acl=[], enabled=False), sync='SYNCED', sync_time='2024-05-28T13:00:09.039232Z', tenant_id=1, tenant_name='default', title='/manila/manila-e89b90ae-d644-4b77-81a0-3d997b90fad0', url='https://127.0.0.1:40443/api/views/38/')] May 28 13:00:50 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bd7f0e79-6ba7-4b97-a4f2-b303489b4237 tempest-ShareTransferNegativeTest-884271560 None] --- [GET] https://127.0.0.1:40443/api/views/: Done May 28 13:00:50 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bd7f0e79-6ba7-4b97-a4f2-b303489b4237 tempest-ShareTransferNegativeTest-884271560 None] >>> [DELETE] https://127.0.0.1:40443/api/views/38/ May 28 13:00:50 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-f4dc081b-8d5d-4042-9ca1-357169a8370e tempest-ShareRulesNegativeTest-930400775 tempest-ShareRulesNegativeTest-930400775-project-member] GET http://10.27.203.238/share/v2/329a14ab984146feb9f91e467ab4e3b5/shares/623ccf6c-1398-4ab6-9f67-73e600565f38 May 28 13:00:50 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-f4dc081b-8d5d-4042-9ca1-357169a8370e tempest-ShareRulesNegativeTest-930400775 tempest-ShareRulesNegativeTest-930400775-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:50 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-f4dc081b-8d5d-4042-9ca1-357169a8370e tempest-ShareRulesNegativeTest-930400775 tempest-ShareRulesNegativeTest-930400775-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:51 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-f4dc081b-8d5d-4042-9ca1-357169a8370e tempest-ShareRulesNegativeTest-930400775 tempest-ShareRulesNegativeTest-930400775-project-member] http://10.27.203.238/share/v2/329a14ab984146feb9f91e467ab4e3b5/shares/623ccf6c-1398-4ab6-9f67-73e600565f38 returned with HTTP 200 May 28 13:00:51 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 967/1971] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:00:50 2024] GET /share/v2/329a14ab984146feb9f91e467ab4e3b5/shares/623ccf6c-1398-4ab6-9f67-73e600565f38 => generated 1312 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:00:51 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-6924aa00-1b38-441d-a0d1-dc81d9823d0c tempest-ShareRulesNegativeTest-930400775 None] <<< [POST] https://127.0.0.1:40443/api/quotas/ May 28 13:00:51 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-6924aa00-1b38-441d-a0d1-dc81d9823d0c tempest-ShareRulesNegativeTest-930400775 None] Bunch(cluster='loop75-kfs', cluster_id=1, default_email=None, default_group_quota=None, default_user_quota=None, enable_alarms=True, enable_email_providers=True, grace_period=None, group_quotas=[], guid='5372c080-8289-4d14-9a86-ebfe36c78208', hard_limit=1073741824, hard_limit_inodes=None, id=44, internal=False, is_user_quota=False, last_user_quotas_update=None, name='e0a28587-55d6-44c6-8c73-249d5047f95e', num_blocked_users=0, num_exceeded_users=0, path='/manila/manila-e0a28587-55d6-44c6-8c73-249d5047f95e', percent_capacity=0, percent_inodes=None, pretty_grace_period=None, pretty_grace_period_expiration=None, pretty_state='OK (CREATED)', soft_limit=None, soft_limit_inodes=None, state='OK', sync_state='CREATED', system_id=44, tenant_id=1, tenant_name='default', time_to_block=None, title='e0a28587-55d6-44c6-8c73-249d5047f95e', url='https://127.0.0.1:40443/api/quotas/44/', used_capacity=0, used_capacity_tb=0.0, used_effective_capacity=0, used_effective_capacity_tb=0.0, used_inodes=0, used_limited_capacity=0, user_quotas=[]) May 28 13:00:51 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-6924aa00-1b38-441d-a0d1-dc81d9823d0c tempest-ShareRulesNegativeTest-930400775 None] --- [POST] https://127.0.0.1:40443/api/quotas/: Done May 28 13:00:51 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-6924aa00-1b38-441d-a0d1-dc81d9823d0c tempest-ShareRulesNegativeTest-930400775 None] >>> [GET] https://127.0.0.1:40443/api/views/ May 28 13:00:51 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-6924aa00-1b38-441d-a0d1-dc81d9823d0c tempest-ShareRulesNegativeTest-930400775 None] {'allow_redirects': True, May 28 13:00:51 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-6924aa00-1b38-441d-a0d1-dc81d9823d0c tempest-ShareRulesNegativeTest-930400775 None] 'params': {'name': 'e0a28587-55d6-44c6-8c73-249d5047f95e'}} May 28 13:00:51 l75lg1-v1 dstat.sh[49771]: 28-05 13:00:51| 7 1 91 1 0|5697M 1749M 278M 7901M| 21k 5293B| 0 1128k| 0 91.0 |3653 5669 |1.79 1.24 1.08|1.0 1.0 0| 0 0 | 0 2048M| 29 361 0 52 2 May 28 13:00:51 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-49571241-7d96-45b7-8298-01a6acc3eece tempest-ShareRulesTest-1530341375 None] <<< [GET] https://127.0.0.1:40443/api/quotas/ May 28 13:00:51 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-49571241-7d96-45b7-8298-01a6acc3eece tempest-ShareRulesTest-1530341375 None] [] May 28 13:00:51 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-49571241-7d96-45b7-8298-01a6acc3eece tempest-ShareRulesTest-1530341375 None] --- [GET] https://127.0.0.1:40443/api/quotas/: Done May 28 13:00:51 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-49571241-7d96-45b7-8298-01a6acc3eece tempest-ShareRulesTest-1530341375 None] >>> [POST] https://127.0.0.1:40443/api/quotas/ May 28 13:00:51 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-49571241-7d96-45b7-8298-01a6acc3eece tempest-ShareRulesTest-1530341375 None] {'data': '{"name": "f20d9b3a-8716-4664-aff7-80ddf3014290", "path": ' May 28 13:00:51 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-49571241-7d96-45b7-8298-01a6acc3eece tempest-ShareRulesTest-1530341375 None] '"/manila/manila-f20d9b3a-8716-4664-aff7-80ddf3014290", "create_dir": ' May 28 13:00:51 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-49571241-7d96-45b7-8298-01a6acc3eece tempest-ShareRulesTest-1530341375 None] 'true, "hard_limit": 1073741824}', May 28 13:00:51 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-49571241-7d96-45b7-8298-01a6acc3eece tempest-ShareRulesTest-1530341375 None] 'json': None, May 28 13:00:51 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-49571241-7d96-45b7-8298-01a6acc3eece tempest-ShareRulesTest-1530341375 None] 'params': None} May 28 13:00:51 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-914df302-1a94-49cd-951e-378d1ac5e45a tempest-ShareTypeAvailabilityZonesTest-364532124 None] <<< [GET] https://127.0.0.1:40443/api/views/ May 28 13:00:51 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-914df302-1a94-49cd-951e-378d1ac5e45a tempest-ShareTypeAvailabilityZonesTest-364532124 None] [Bunch(abac_tags=[], abe_max_depth=None, abe_protocols=[], alias='', allow_anonymous_access=False, allow_s3_anonymous_access=False, auto_commit='0d', bucket='', bucket_creators=[], bucket_creators_groups=[], bucket_owner=None, bulk_permission_update_progress=None, bulk_permission_update_state=None, cluster='loop75-kfs', cluster_id=1, created='2024-05-28T13:00:49.067017Z', enabled=True, files_retention_mode='NONE', guid='b2569ce7-532c-41d8-bf29-3182c0242482', id=45, ignore_oos=False, internal=False, is_remote=False, is_seamless=False, logical_capacity=0, max_retention_period=None, min_retention_period=None, name='1d36626a-c0bd-47a1-a990-d50f95cbf99c', nfs_interop_flags='BOTH_NFS3_AND_NFS4_INTEROP_DISABLED', path='/manila/manila-1d36626a-c0bd-47a1-a990-d50f95cbf99c', physical_capacity=0, policy='1d36626a-c0bd-47a1-a990-d50f95cbf99c', policy_id=46, protocols=['NFS'], qos_policy=None, qos_policy_id=None, s3_locks=False, s3_locks_retention_mode='NONE', s3_locks_retention_period='', s3_unverified_lookup=False, s3_versioning=False, select_for_live_monitoring=False, share='', share_acl=Bunch(acl=[], enabled=False), sync='SYNCED', sync_time='2024-05-28T13:00:49.324874Z', tenant_id=1, tenant_name='default', title='/manila/manila-1d36626a-c0bd-47a1-a990-d50f95cbf99c', url='https://127.0.0.1:40443/api/views/45/')] May 28 13:00:51 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-914df302-1a94-49cd-951e-378d1ac5e45a tempest-ShareTypeAvailabilityZonesTest-364532124 None] --- [GET] https://127.0.0.1:40443/api/views/: Done May 28 13:00:51 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-914df302-1a94-49cd-951e-378d1ac5e45a tempest-ShareTypeAvailabilityZonesTest-364532124 None] >>> [DELETE] https://127.0.0.1:40443/api/views/45/ May 28 13:00:51 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 13:00:51 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-6924aa00-1b38-441d-a0d1-dc81d9823d0c tempest-ShareRulesNegativeTest-930400775 None] <<< [GET] https://127.0.0.1:40443/api/views/ May 28 13:00:51 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-6924aa00-1b38-441d-a0d1-dc81d9823d0c tempest-ShareRulesNegativeTest-930400775 None] [] May 28 13:00:51 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-6924aa00-1b38-441d-a0d1-dc81d9823d0c tempest-ShareRulesNegativeTest-930400775 None] --- [GET] https://127.0.0.1:40443/api/views/: Done May 28 13:00:51 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-6924aa00-1b38-441d-a0d1-dc81d9823d0c tempest-ShareRulesNegativeTest-930400775 None] >>> [POST] https://127.0.0.1:40443/api/views/ May 28 13:00:51 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-6924aa00-1b38-441d-a0d1-dc81d9823d0c tempest-ShareRulesNegativeTest-930400775 None] {'data': '{"name": "e0a28587-55d6-44c6-8c73-249d5047f95e", "path": ' May 28 13:00:51 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-6924aa00-1b38-441d-a0d1-dc81d9823d0c tempest-ShareRulesNegativeTest-930400775 None] '"/manila/manila-e0a28587-55d6-44c6-8c73-249d5047f95e", "policy_id": ' May 28 13:00:51 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-6924aa00-1b38-441d-a0d1-dc81d9823d0c tempest-ShareRulesNegativeTest-930400775 None] '47, "create_dir": true, "protocols": ["NFS"]}', May 28 13:00:51 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-6924aa00-1b38-441d-a0d1-dc81d9823d0c tempest-ShareRulesNegativeTest-930400775 None] 'json': None, May 28 13:00:51 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-6924aa00-1b38-441d-a0d1-dc81d9823d0c tempest-ShareRulesNegativeTest-930400775 None] 'params': None} May 28 13:00:51 l75lg1-v1 manila-data[98318]: DEBUG dbcounter [-] [98318] Writing DB stats manila:SELECT=30,manila:UPDATE=7 {{(pid=98318) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:00:51 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-2f6c2dc9-c6cd-4ae6-8b74-636923620a5d tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] GET http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/shares/415b1daa-22c2-48a3-873e-80762e65a747 May 28 13:00:51 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-2f6c2dc9-c6cd-4ae6-8b74-636923620a5d tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:51 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-2f6c2dc9-c6cd-4ae6-8b74-636923620a5d tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:51 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-2f6c2dc9-c6cd-4ae6-8b74-636923620a5d tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/shares/415b1daa-22c2-48a3-873e-80762e65a747 returned with HTTP 200 May 28 13:00:51 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1005/1972] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:00:51 2024] GET /share/v2/a4f3887fa28c457390f5b66615564430/shares/415b1daa-22c2-48a3-873e-80762e65a747 => generated 1313 bytes in 29 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:00:52 l75lg1-v1 dstat.sh[49771]: 28-05 13:00:52| 2 0 97 1 0|5697M 1749M 278M 7901M| 20k 2520B| 0 1073k| 0 81.1 |2323 3652 |1.80 1.25 1.08|1.0 1.0 0| 0 0 | 0 2048M| 29 361 0 42 2 May 28 13:00:52 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-49571241-7d96-45b7-8298-01a6acc3eece tempest-ShareRulesTest-1530341375 None] <<< [POST] https://127.0.0.1:40443/api/quotas/ May 28 13:00:52 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-49571241-7d96-45b7-8298-01a6acc3eece tempest-ShareRulesTest-1530341375 None] Bunch(cluster='loop75-kfs', cluster_id=1, default_email=None, default_group_quota=None, default_user_quota=None, enable_alarms=True, enable_email_providers=True, grace_period=None, group_quotas=[], guid='888d62ee-28d1-4a7f-8a91-d67f243b5982', hard_limit=1073741824, hard_limit_inodes=None, id=45, internal=False, is_user_quota=False, last_user_quotas_update=None, name='f20d9b3a-8716-4664-aff7-80ddf3014290', num_blocked_users=0, num_exceeded_users=0, path='/manila/manila-f20d9b3a-8716-4664-aff7-80ddf3014290', percent_capacity=0, percent_inodes=None, pretty_grace_period=None, pretty_grace_period_expiration=None, pretty_state='OK (CREATED)', soft_limit=None, soft_limit_inodes=None, state='OK', sync_state='CREATED', system_id=45, tenant_id=1, tenant_name='default', time_to_block=None, title='f20d9b3a-8716-4664-aff7-80ddf3014290', url='https://127.0.0.1:40443/api/quotas/45/', used_capacity=0, used_capacity_tb=0.0, used_effective_capacity=0, used_effective_capacity_tb=0.0, used_inodes=0, used_limited_capacity=0, user_quotas=[]) May 28 13:00:52 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-49571241-7d96-45b7-8298-01a6acc3eece tempest-ShareRulesTest-1530341375 None] --- [POST] https://127.0.0.1:40443/api/quotas/: Done May 28 13:00:52 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-49571241-7d96-45b7-8298-01a6acc3eece tempest-ShareRulesTest-1530341375 None] >>> [GET] https://127.0.0.1:40443/api/views/ May 28 13:00:52 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-49571241-7d96-45b7-8298-01a6acc3eece tempest-ShareRulesTest-1530341375 None] {'allow_redirects': True, May 28 13:00:52 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-49571241-7d96-45b7-8298-01a6acc3eece tempest-ShareRulesTest-1530341375 None] 'params': {'name': 'f20d9b3a-8716-4664-aff7-80ddf3014290'}} May 28 13:00:52 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-6924aa00-1b38-441d-a0d1-dc81d9823d0c tempest-ShareRulesNegativeTest-930400775 None] <<< [POST] https://127.0.0.1:40443/api/views/ May 28 13:00:52 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-6924aa00-1b38-441d-a0d1-dc81d9823d0c tempest-ShareRulesNegativeTest-930400775 None] Bunch(abac_tags=[], abe_max_depth=None, abe_protocols=[], alias='', allow_anonymous_access=False, allow_s3_anonymous_access=False, auto_commit='0d', bucket='', bucket_creators=[], bucket_creators_groups=[], bucket_owner=None, bulk_permission_update_progress=None, bulk_permission_update_state=None, cluster='loop75-kfs', cluster_id=1, created='2024-05-28T13:00:52.047642Z', enabled=True, files_retention_mode='NONE', guid='9de010c1-040b-481a-a326-33fc03c88505', id=46, ignore_oos=False, internal=False, is_remote=False, is_seamless=False, logical_capacity=0, max_retention_period=None, min_retention_period=None, name='e0a28587-55d6-44c6-8c73-249d5047f95e', nfs_interop_flags='BOTH_NFS3_AND_NFS4_INTEROP_DISABLED', path='/manila/manila-e0a28587-55d6-44c6-8c73-249d5047f95e', physical_capacity=0, policy='e0a28587-55d6-44c6-8c73-249d5047f95e', policy_id=47, protocols=['NFS'], qos_policy=None, qos_policy_id=None, s3_locks=False, s3_locks_retention_mode='NONE', s3_locks_retention_period='', s3_object_ownership_rule='ObjectWriter', s3_unverified_lookup=False, s3_versioning=False, select_for_live_monitoring=False, share='', share_acl=Bunch(acl=[], enabled=False), sync='SYNCED', sync_time='2024-05-28T13:00:52.355580Z', tenant_id=1, tenant_name='default', title='/manila/manila-e0a28587-55d6-44c6-8c73-249d5047f95e', url='https://127.0.0.1:40443/api/views/46/') May 28 13:00:52 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-6924aa00-1b38-441d-a0d1-dc81d9823d0c tempest-ShareRulesNegativeTest-930400775 None] --- [POST] https://127.0.0.1:40443/api/views/: Done May 28 13:00:52 l75lg1-v1 manila-share[98474]: INFO manila.share.manager [None req-6924aa00-1b38-441d-a0d1-dc81d9823d0c tempest-ShareRulesNegativeTest-930400775 None] Share instance e0a28587-55d6-44c6-8c73-249d5047f95e created successfully. May 28 13:00:52 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 13:00:52 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.manager [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=83654) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10545}} May 28 13:00:52 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-49571241-7d96-45b7-8298-01a6acc3eece tempest-ShareRulesTest-1530341375 None] <<< [GET] https://127.0.0.1:40443/api/views/ May 28 13:00:52 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-49571241-7d96-45b7-8298-01a6acc3eece tempest-ShareRulesTest-1530341375 None] [] May 28 13:00:52 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-49571241-7d96-45b7-8298-01a6acc3eece tempest-ShareRulesTest-1530341375 None] --- [GET] https://127.0.0.1:40443/api/views/: Done May 28 13:00:52 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-49571241-7d96-45b7-8298-01a6acc3eece tempest-ShareRulesTest-1530341375 None] >>> [POST] https://127.0.0.1:40443/api/views/ May 28 13:00:52 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-49571241-7d96-45b7-8298-01a6acc3eece tempest-ShareRulesTest-1530341375 None] {'data': '{"name": "f20d9b3a-8716-4664-aff7-80ddf3014290", "path": ' May 28 13:00:52 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-49571241-7d96-45b7-8298-01a6acc3eece tempest-ShareRulesTest-1530341375 None] '"/manila/manila-f20d9b3a-8716-4664-aff7-80ddf3014290", "policy_id": ' May 28 13:00:52 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-49571241-7d96-45b7-8298-01a6acc3eece tempest-ShareRulesTest-1530341375 None] '48, "create_dir": true, "protocols": ["NFS"]}', May 28 13:00:52 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-49571241-7d96-45b7-8298-01a6acc3eece tempest-ShareRulesTest-1530341375 None] 'json': None, May 28 13:00:52 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-49571241-7d96-45b7-8298-01a6acc3eece tempest-ShareRulesTest-1530341375 None] 'params': None} May 28 13:00:53 l75lg1-v1 dstat.sh[49771]: 28-05 13:00:53| 1 0 97 1 0|5697M 1749M 278M 7901M| 16k 1741B| 0 744k| 0 88.9 |2209 3602 |1.80 1.25 1.08|1.0 1.0 0| 0 0 | 0 2048M| 29 361 0 42 2 May 28 13:00:53 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bd7f0e79-6ba7-4b97-a4f2-b303489b4237 tempest-ShareTransferNegativeTest-884271560 None] <<< [DELETE] https://127.0.0.1:40443/api/views/38/ May 28 13:00:53 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bd7f0e79-6ba7-4b97-a4f2-b303489b4237 tempest-ShareTransferNegativeTest-884271560 None] --- [DELETE] https://127.0.0.1:40443/api/views/38/: Done May 28 13:00:53 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bd7f0e79-6ba7-4b97-a4f2-b303489b4237 tempest-ShareTransferNegativeTest-884271560 None] >>> [GET] https://127.0.0.1:40443/api/quotas/ May 28 13:00:53 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bd7f0e79-6ba7-4b97-a4f2-b303489b4237 tempest-ShareTransferNegativeTest-884271560 None] {'allow_redirects': True, May 28 13:00:53 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bd7f0e79-6ba7-4b97-a4f2-b303489b4237 tempest-ShareTransferNegativeTest-884271560 None] 'params': {'name': 'e89b90ae-d644-4b77-81a0-3d997b90fad0'}} May 28 13:00:53 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-7bce4c24-e190-417a-b2aa-b03da675af1e tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] GET http://10.27.203.238/share/v2/cac556dc39a14bbdbdbabfc80672fb1f/shares/bd070603-3332-4a76-a743-411df92ace16 May 28 13:00:53 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-7bce4c24-e190-417a-b2aa-b03da675af1e tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:53 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-7bce4c24-e190-417a-b2aa-b03da675af1e tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:53 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-7bce4c24-e190-417a-b2aa-b03da675af1e tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] http://10.27.203.238/share/v2/cac556dc39a14bbdbdbabfc80672fb1f/shares/bd070603-3332-4a76-a743-411df92ace16 returned with HTTP 200 May 28 13:00:53 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 968/1973] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:00:53 2024] GET /share/v2/cac556dc39a14bbdbdbabfc80672fb1f/shares/bd070603-3332-4a76-a743-411df92ace16 => generated 1315 bytes in 26 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:00:53 l75lg1-v1 neutron-server[77619]: DEBUG dbcounter [-] [77619] Writing DB stats neutron:SELECT=1 {{(pid=77619) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:00:53 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 13:00:53 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 13:00:53 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-7806a4b5-689e-4694-80fa-082c31c36ad9 tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] GET http://10.27.203.238/share/v2/284d76edec3144579d6fb3f6dbc0dd4e/shares/433f546f-3297-46a0-b412-18630103d191 May 28 13:00:53 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-7806a4b5-689e-4694-80fa-082c31c36ad9 tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:53 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-7806a4b5-689e-4694-80fa-082c31c36ad9 tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:53 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-7806a4b5-689e-4694-80fa-082c31c36ad9 tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] http://10.27.203.238/share/v2/284d76edec3144579d6fb3f6dbc0dd4e/shares/433f546f-3297-46a0-b412-18630103d191 returned with HTTP 200 May 28 13:00:53 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1006/1974] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:00:53 2024] GET /share/v2/284d76edec3144579d6fb3f6dbc0dd4e/shares/433f546f-3297-46a0-b412-18630103d191 => generated 1316 bytes in 26 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:00:53 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-914df302-1a94-49cd-951e-378d1ac5e45a tempest-ShareTypeAvailabilityZonesTest-364532124 None] <<< [DELETE] https://127.0.0.1:40443/api/views/45/ May 28 13:00:53 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-914df302-1a94-49cd-951e-378d1ac5e45a tempest-ShareTypeAvailabilityZonesTest-364532124 None] --- [DELETE] https://127.0.0.1:40443/api/views/45/: Done May 28 13:00:53 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-914df302-1a94-49cd-951e-378d1ac5e45a tempest-ShareTypeAvailabilityZonesTest-364532124 None] >>> [GET] https://127.0.0.1:40443/api/quotas/ May 28 13:00:53 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-914df302-1a94-49cd-951e-378d1ac5e45a tempest-ShareTypeAvailabilityZonesTest-364532124 None] {'allow_redirects': True, May 28 13:00:53 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-914df302-1a94-49cd-951e-378d1ac5e45a tempest-ShareTypeAvailabilityZonesTest-364532124 None] 'params': {'name': '1d36626a-c0bd-47a1-a990-d50f95cbf99c'}} May 28 13:00:53 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-49571241-7d96-45b7-8298-01a6acc3eece tempest-ShareRulesTest-1530341375 None] <<< [POST] https://127.0.0.1:40443/api/views/ May 28 13:00:53 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-49571241-7d96-45b7-8298-01a6acc3eece tempest-ShareRulesTest-1530341375 None] Bunch(abac_tags=[], abe_max_depth=None, abe_protocols=[], alias='', allow_anonymous_access=False, allow_s3_anonymous_access=False, auto_commit='0d', bucket='', bucket_creators=[], bucket_creators_groups=[], bucket_owner=None, bulk_permission_update_progress=None, bulk_permission_update_state=None, cluster='loop75-kfs', cluster_id=1, created='2024-05-28T13:00:53.357897Z', enabled=True, files_retention_mode='NONE', guid='e48712f1-60b3-442b-97b9-5c81050d337d', id=47, ignore_oos=False, internal=False, is_remote=False, is_seamless=False, logical_capacity=0, max_retention_period=None, min_retention_period=None, name='f20d9b3a-8716-4664-aff7-80ddf3014290', nfs_interop_flags='BOTH_NFS3_AND_NFS4_INTEROP_DISABLED', path='/manila/manila-f20d9b3a-8716-4664-aff7-80ddf3014290', physical_capacity=0, policy='f20d9b3a-8716-4664-aff7-80ddf3014290', policy_id=48, protocols=['NFS'], qos_policy=None, qos_policy_id=None, s3_locks=False, s3_locks_retention_mode='NONE', s3_locks_retention_period='', s3_object_ownership_rule='ObjectWriter', s3_unverified_lookup=False, s3_versioning=False, select_for_live_monitoring=False, share='', share_acl=Bunch(acl=[], enabled=False), sync='SYNCED', sync_time='2024-05-28T13:00:53.627908Z', tenant_id=1, tenant_name='default', title='/manila/manila-f20d9b3a-8716-4664-aff7-80ddf3014290', url='https://127.0.0.1:40443/api/views/47/') May 28 13:00:53 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-49571241-7d96-45b7-8298-01a6acc3eece tempest-ShareRulesTest-1530341375 None] --- [POST] https://127.0.0.1:40443/api/views/: Done May 28 13:00:53 l75lg1-v1 manila-share[98474]: INFO manila.share.manager [None req-49571241-7d96-45b7-8298-01a6acc3eece tempest-ShareRulesTest-1530341375 None] Share instance f20d9b3a-8716-4664-aff7-80ddf3014290 created successfully. May 28 13:00:53 l75lg1-v1 neutron-server[77619]: DEBUG dbcounter [-] [77619] Writing DB stats neutron:SELECT=5 {{(pid=77619) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:00:53 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bd7f0e79-6ba7-4b97-a4f2-b303489b4237 tempest-ShareTransferNegativeTest-884271560 None] <<< [GET] https://127.0.0.1:40443/api/quotas/ May 28 13:00:53 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bd7f0e79-6ba7-4b97-a4f2-b303489b4237 tempest-ShareTransferNegativeTest-884271560 None] [Bunch(cluster='loop75-kfs', cluster_id=1, default_email=None, default_group_quota=None, default_user_quota=None, enable_alarms=True, enable_email_providers=True, grace_period=None, guid='c6d0bed5-e8ec-41bc-b76f-83d21586c9f3', hard_limit=1073741824, hard_limit_inodes=None, id=36, internal=False, is_user_quota=False, last_user_quotas_update=None, name='e89b90ae-d644-4b77-81a0-3d997b90fad0', num_blocked_users=0, num_exceeded_users=0, path='/manila/manila-e89b90ae-d644-4b77-81a0-3d997b90fad0', percent_capacity=0, percent_inodes=None, pretty_grace_period=None, pretty_grace_period_expiration=None, pretty_state='OK', soft_limit=None, soft_limit_inodes=None, state='OK', sync_state='SYNCHRONIZED', system_id=36, tenant_id=1, tenant_name='default', time_to_block=None, title='e89b90ae-d644-4b77-81a0-3d997b90fad0', url='https://127.0.0.1:40443/api/quotas/36/', used_capacity=0, used_capacity_tb=0.0, used_effective_capacity=0, used_effective_capacity_tb=0.0, used_inodes=1, used_limited_capacity=0)] May 28 13:00:53 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bd7f0e79-6ba7-4b97-a4f2-b303489b4237 tempest-ShareTransferNegativeTest-884271560 None] --- [GET] https://127.0.0.1:40443/api/quotas/: Done May 28 13:00:53 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bd7f0e79-6ba7-4b97-a4f2-b303489b4237 tempest-ShareTransferNegativeTest-884271560 None] >>> [DELETE] https://127.0.0.1:40443/api/quotas/36/ May 28 13:00:54 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-914df302-1a94-49cd-951e-378d1ac5e45a tempest-ShareTypeAvailabilityZonesTest-364532124 None] <<< [GET] https://127.0.0.1:40443/api/quotas/ May 28 13:00:54 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-914df302-1a94-49cd-951e-378d1ac5e45a tempest-ShareTypeAvailabilityZonesTest-364532124 None] [Bunch(cluster='loop75-kfs', cluster_id=1, default_email=None, default_group_quota=None, default_user_quota=None, enable_alarms=True, enable_email_providers=True, grace_period=None, guid='a2d403af-2565-449d-aa91-de510e77e092', hard_limit=1073741824, hard_limit_inodes=None, id=43, internal=False, is_user_quota=False, last_user_quotas_update=None, name='1d36626a-c0bd-47a1-a990-d50f95cbf99c', num_blocked_users=0, num_exceeded_users=0, path='/manila/manila-1d36626a-c0bd-47a1-a990-d50f95cbf99c', percent_capacity=0, percent_inodes=None, pretty_grace_period=None, pretty_grace_period_expiration=None, pretty_state='OK (CREATED)', soft_limit=None, soft_limit_inodes=None, state='OK', sync_state='CREATED', system_id=43, tenant_id=1, tenant_name='default', time_to_block=None, title='1d36626a-c0bd-47a1-a990-d50f95cbf99c', url='https://127.0.0.1:40443/api/quotas/43/', used_capacity=0, used_capacity_tb=0.0, used_effective_capacity=0, used_effective_capacity_tb=0.0, used_inodes=0, used_limited_capacity=0)] May 28 13:00:54 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-914df302-1a94-49cd-951e-378d1ac5e45a tempest-ShareTypeAvailabilityZonesTest-364532124 None] --- [GET] https://127.0.0.1:40443/api/quotas/: Done May 28 13:00:54 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-914df302-1a94-49cd-951e-378d1ac5e45a tempest-ShareTypeAvailabilityZonesTest-364532124 None] >>> [DELETE] https://127.0.0.1:40443/api/quotas/43/ May 28 13:00:54 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-cff9b7ba-704c-4f45-bf1b-39a8b65f98cd tempest-ShareRulesNegativeTest-930400775 tempest-ShareRulesNegativeTest-930400775-project-member] GET http://10.27.203.238/share/v2/329a14ab984146feb9f91e467ab4e3b5/shares/623ccf6c-1398-4ab6-9f67-73e600565f38 May 28 13:00:54 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-cff9b7ba-704c-4f45-bf1b-39a8b65f98cd tempest-ShareRulesNegativeTest-930400775 tempest-ShareRulesNegativeTest-930400775-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:54 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-cff9b7ba-704c-4f45-bf1b-39a8b65f98cd tempest-ShareRulesNegativeTest-930400775 tempest-ShareRulesNegativeTest-930400775-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:54 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-cff9b7ba-704c-4f45-bf1b-39a8b65f98cd tempest-ShareRulesNegativeTest-930400775 tempest-ShareRulesNegativeTest-930400775-project-member] http://10.27.203.238/share/v2/329a14ab984146feb9f91e467ab4e3b5/shares/623ccf6c-1398-4ab6-9f67-73e600565f38 returned with HTTP 200 May 28 13:00:54 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 969/1975] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:00:54 2024] GET /share/v2/329a14ab984146feb9f91e467ab4e3b5/shares/623ccf6c-1398-4ab6-9f67-73e600565f38 => generated 1315 bytes in 27 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:00:54 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-c313e1ef-5c59-4943-8400-4f67771384fa tempest-ShareRulesNegativeTest-930400775 tempest-ShareRulesNegativeTest-930400775-project-member] POST http://10.27.203.238/share/v2/329a14ab984146feb9f91e467ab4e3b5/snapshots May 28 13:00:54 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-c313e1ef-5c59-4943-8400-4f67771384fa tempest-ShareRulesNegativeTest-930400775 tempest-ShareRulesNegativeTest-930400775-project-member] Action: 'create', calling method: ShareSnapshotMixin.create, body: {"snapshot": {"name": "tempest-tempest-created-share-snap-797292091", "force": false, "description": "Tempest's snapshot", "share_id": "623ccf6c-1398-4ab6-9f67-73e600565f38"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:00:54 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.v1.share_snapshots [None req-c313e1ef-5c59-4943-8400-4f67771384fa tempest-ShareRulesNegativeTest-930400775 tempest-ShareRulesNegativeTest-930400775-project-member] Create snapshot from share 623ccf6c-1398-4ab6-9f67-73e600565f38 May 28 13:00:54 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.quota [None req-c313e1ef-5c59-4943-8400-4f67771384fa tempest-ShareRulesNegativeTest-930400775 tempest-ShareRulesNegativeTest-930400775-project-member] Created reservations ['31b42926-7870-497e-9e14-a0dca44e7db8', 'ebdf2adb-f3c3-490e-8b59-d691efc8f15c', 'd44a80fa-19fb-481d-874e-c84676c13ea0', '2830f2fe-fa36-41fc-8389-d33161e5aadd'] {{(pid=98329) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 13:00:54 l75lg1-v1 dstat.sh[49771]: 28-05 13:00:54| 3 1 94 2 0|5697M 1749M 278M 7901M| 19k 2706B| 0 8097k| 0 834 |3299 5237 |1.80 1.25 1.08|2.0 1.0 0| 0 0 | 0 2048M| 29 362 0 35 2 May 28 13:00:54 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.quota [None req-c313e1ef-5c59-4943-8400-4f67771384fa tempest-ShareRulesNegativeTest-930400775 tempest-ShareRulesNegativeTest-930400775-project-member] Committed reservations ['31b42926-7870-497e-9e14-a0dca44e7db8', 'ebdf2adb-f3c3-490e-8b59-d691efc8f15c', 'd44a80fa-19fb-481d-874e-c84676c13ea0', '2830f2fe-fa36-41fc-8389-d33161e5aadd'] {{(pid=98329) commit /opt/stack/manila/manila/quota.py:1063}} May 28 13:00:54 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-c313e1ef-5c59-4943-8400-4f67771384fa tempest-ShareRulesNegativeTest-930400775 tempest-ShareRulesNegativeTest-930400775-project-member] http://10.27.203.238/share/v2/329a14ab984146feb9f91e467ab4e3b5/snapshots returned with HTTP 202 May 28 13:00:54 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1007/1976] 10.27.203.238 () {66 vars in 1371 bytes} [Tue May 28 13:00:54 2024] POST /share/v2/329a14ab984146feb9f91e467ab4e3b5/snapshots => generated 722 bytes in 242 msecs (HTTP/1.1 202) 6 headers in 237 bytes (1 switches on core 0) May 28 13:00:54 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-13837e2f-d5cd-4b3d-9a92-6d29d36a5d86 tempest-ShareRulesNegativeTest-930400775 tempest-ShareRulesNegativeTest-930400775-project-member] GET http://10.27.203.238/share/v2/329a14ab984146feb9f91e467ab4e3b5/snapshots/98f3b924-cebf-46a4-9429-7f55792a0941 May 28 13:00:54 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-13837e2f-d5cd-4b3d-9a92-6d29d36a5d86 tempest-ShareRulesNegativeTest-930400775 tempest-ShareRulesNegativeTest-930400775-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:54 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-13837e2f-d5cd-4b3d-9a92-6d29d36a5d86 tempest-ShareRulesNegativeTest-930400775 tempest-ShareRulesNegativeTest-930400775-project-member] Calling method 'ShareSnapshotMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:54 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-13837e2f-d5cd-4b3d-9a92-6d29d36a5d86 tempest-ShareRulesNegativeTest-930400775 tempest-ShareRulesNegativeTest-930400775-project-member] http://10.27.203.238/share/v2/329a14ab984146feb9f91e467ab4e3b5/snapshots/98f3b924-cebf-46a4-9429-7f55792a0941 returned with HTTP 200 May 28 13:00:54 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 970/1977] 10.27.203.238 () {64 vars in 1460 bytes} [Tue May 28 13:00:54 2024] GET /share/v2/329a14ab984146feb9f91e467ab4e3b5/snapshots/98f3b924-cebf-46a4-9429-7f55792a0941 => generated 722 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:00:54 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c313e1ef-5c59-4943-8400-4f67771384fa tempest-ShareRulesNegativeTest-930400775 None] >>> [POST] https://127.0.0.1:40443/api/snapshots/ May 28 13:00:54 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c313e1ef-5c59-4943-8400-4f67771384fa tempest-ShareRulesNegativeTest-930400775 None] {'data': '{"path": "/manila/manila-e0a28587-55d6-44c6-8c73-249d5047f95e", ' May 28 13:00:54 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c313e1ef-5c59-4943-8400-4f67771384fa tempest-ShareRulesNegativeTest-930400775 None] '"name": "share-snapshot-851bfc5e-de6d-4c8a-8ed3-1d93e02d4dc5"}', May 28 13:00:54 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c313e1ef-5c59-4943-8400-4f67771384fa tempest-ShareRulesNegativeTest-930400775 None] 'json': None, May 28 13:00:54 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c313e1ef-5c59-4943-8400-4f67771384fa tempest-ShareRulesNegativeTest-930400775 None] 'params': None} May 28 13:00:54 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 13:00:54 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.manager [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Starting heal instance info cache {{(pid=83654) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}} May 28 13:00:54 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.manager [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Rebuilding the list of instances to heal {{(pid=83654) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9930}} May 28 13:00:54 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Expecting reply to msg 44d24d64414440ce9f8c6490f569393c in queue reply_37f4cbd1dd094961a22b8a65f222c327 May 28 13:00:54 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [-] Received RPC response for msg 44d24d64414440ce9f8c6490f569393c May 28 13:00:54 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-71bf5dd7-7726-486e-b894-9c07897aad76 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] GET http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/shares/415b1daa-22c2-48a3-873e-80762e65a747 May 28 13:00:54 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-71bf5dd7-7726-486e-b894-9c07897aad76 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:54 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-71bf5dd7-7726-486e-b894-9c07897aad76 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:54 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-71bf5dd7-7726-486e-b894-9c07897aad76 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/shares/415b1daa-22c2-48a3-873e-80762e65a747 returned with HTTP 200 May 28 13:00:54 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1008/1978] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:00:54 2024] GET /share/v2/a4f3887fa28c457390f5b66615564430/shares/415b1daa-22c2-48a3-873e-80762e65a747 => generated 1316 bytes in 28 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:00:54 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-ec671006-1eab-4e6d-a131-37a72a714c20 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] POST http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/shares/415b1daa-22c2-48a3-873e-80762e65a747/action May 28 13:00:54 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-ec671006-1eab-4e6d-a131-37a72a714c20 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Action body: b'{"allow_access": {"access_type": "ip", "access_to": "203.0.113.77", "access_level": "rw"}}' {{(pid=98330) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 13:00:54 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-ec671006-1eab-4e6d-a131-37a72a714c20 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Action: 'action', calling method: ShareController.allow_access, body: {"allow_access": {"access_type": "ip", "access_to": "203.0.113.77", "access_level": "rw"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:00:55 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-ec671006-1eab-4e6d-a131-37a72a714c20 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Acquiring lock "locked_access_rules_operation_by_share_instance_f20d9b3a-8716-4664-aff7-80ddf3014290" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:00:55 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-ec671006-1eab-4e6d-a131-37a72a714c20 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Lock "locked_access_rules_operation_by_share_instance_f20d9b3a-8716-4664-aff7-80ddf3014290" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:00:55 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.manager [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Didn't find any instances for network info cache update. {{(pid=83654) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10012}} May 28 13:00:55 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-ec671006-1eab-4e6d-a131-37a72a714c20 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Lock "locked_access_rules_operation_by_share_instance_f20d9b3a-8716-4664-aff7-80ddf3014290" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.044s {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:00:55 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-ec671006-1eab-4e6d-a131-37a72a714c20 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/shares/415b1daa-22c2-48a3-873e-80762e65a747/action returned with HTTP 200 May 28 13:00:55 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 971/1979] 10.27.203.238 () {66 vars in 1493 bytes} [Tue May 28 13:00:54 2024] POST /share/v2/a4f3887fa28c457390f5b66615564430/shares/415b1daa-22c2-48a3-873e-80762e65a747/action => generated 310 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:00:55 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-55c3b42e-268c-41b5-847f-df088855a91d tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] GET http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/share-access-rules?share_id=415b1daa-22c2-48a3-873e-80762e65a747 May 28 13:00:55 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-55c3b42e-268c-41b5-847f-df088855a91d tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:55 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-55c3b42e-268c-41b5-847f-df088855a91d tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:55 l75lg1-v1 manila-share[98474]: DEBUG manila.share.manager [None req-ec671006-1eab-4e6d-a131-37a72a714c20 tempest-ShareRulesTest-1530341375 None] Received request to update access for share instance f20d9b3a-8716-4664-aff7-80ddf3014290. {{(pid=98474) update_access_for_instances /opt/stack/manila/manila/share/manager.py:4353}} May 28 13:00:55 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-ec671006-1eab-4e6d-a131-37a72a714c20 tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f20d9b3a-8716-4664-aff7-80ddf3014290" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:00:55 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-ec671006-1eab-4e6d-a131-37a72a714c20 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f20d9b3a-8716-4664-aff7-80ddf3014290" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:00:55 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.lock.api [None req-55c3b42e-268c-41b5-847f-df088855a91d tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Searching for locks by: {'resource_id': 'eebb2fbe-ccfe-4057-986c-639ddd3ccbad', 'resource_action': 'show', 'resource_type': 'access_rule'} {{(pid=98329) get_all /opt/stack/manila/manila/lock/api.py:112}} May 28 13:00:55 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-ec671006-1eab-4e6d-a131-37a72a714c20 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f20d9b3a-8716-4664-aff7-80ddf3014290" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:00:55 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-ec671006-1eab-4e6d-a131-37a72a714c20 tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f20d9b3a-8716-4664-aff7-80ddf3014290" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:00:55 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-ec671006-1eab-4e6d-a131-37a72a714c20 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f20d9b3a-8716-4664-aff7-80ddf3014290" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:00:55 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-55c3b42e-268c-41b5-847f-df088855a91d tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/share-access-rules?share_id=415b1daa-22c2-48a3-873e-80762e65a747 returned with HTTP 200 May 28 13:00:55 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1009/1980] 10.27.203.238 () {64 vars in 1467 bytes} [Tue May 28 13:00:55 2024] GET /share/v2/a4f3887fa28c457390f5b66615564430/share-access-rules?share_id=415b1daa-22c2-48a3-873e-80762e65a747 => generated 265 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:00:55 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-ec671006-1eab-4e6d-a131-37a72a714c20 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f20d9b3a-8716-4664-aff7-80ddf3014290" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.056s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:00:55 l75lg1-v1 manila-share[98474]: DEBUG manila.share.access [None req-ec671006-1eab-4e6d-a131-37a72a714c20 tempest-ShareRulesTest-1530341375 None] Updating access rules for share instance f20d9b3a-8716-4664-aff7-80ddf3014290 belonging to share 415b1daa-22c2-48a3-873e-80762e65a747. {{(pid=98474) update_access_rules /opt/stack/manila/manila/share/access.py:298}} May 28 13:00:55 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-ec671006-1eab-4e6d-a131-37a72a714c20 tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f20d9b3a-8716-4664-aff7-80ddf3014290" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:00:55 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-ec671006-1eab-4e6d-a131-37a72a714c20 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f20d9b3a-8716-4664-aff7-80ddf3014290" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:00:55 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-ec671006-1eab-4e6d-a131-37a72a714c20 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f20d9b3a-8716-4664-aff7-80ddf3014290" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.010s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:00:55 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-ec671006-1eab-4e6d-a131-37a72a714c20 tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f20d9b3a-8716-4664-aff7-80ddf3014290" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:00:55 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-ec671006-1eab-4e6d-a131-37a72a714c20 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f20d9b3a-8716-4664-aff7-80ddf3014290" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:00:55 l75lg1-v1 dstat.sh[49771]: 28-05 13:00:55| 5 1 92 2 0|5696M 1749M 278M 7901M| 13k 911B| 0 1171k| 0 141 |3546 5872 |1.80 1.25 1.08|3.0 1.0 0| 0 0 | 0 2048M| 29 361 0 35 2 May 28 13:00:55 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-ec671006-1eab-4e6d-a131-37a72a714c20 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f20d9b3a-8716-4664-aff7-80ddf3014290" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.017s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:00:55 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-ec671006-1eab-4e6d-a131-37a72a714c20 tempest-ShareRulesTest-1530341375 None] changing access on None May 28 13:00:55 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ec671006-1eab-4e6d-a131-37a72a714c20 tempest-ShareRulesTest-1530341375 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:00:55 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ec671006-1eab-4e6d-a131-37a72a714c20 tempest-ShareRulesTest-1530341375 None] {'allow_redirects': True, May 28 13:00:55 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ec671006-1eab-4e6d-a131-37a72a714c20 tempest-ShareRulesTest-1530341375 None] 'params': {'name': 'f20d9b3a-8716-4664-aff7-80ddf3014290'}} May 28 13:00:55 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ec671006-1eab-4e6d-a131-37a72a714c20 tempest-ShareRulesTest-1530341375 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:00:55 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ec671006-1eab-4e6d-a131-37a72a714c20 tempest-ShareRulesTest-1530341375 None] [Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=1, created='2024-05-28T13:00:50.357495Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='1099a621-1733-438b-a032-2bf134301842', id=48, internal=False, is_s3_default_policy=False, name='f20d9b3a-8716-4664-aff7-80ddf3014290', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=[], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['*'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['*'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T13:00:50.722728Z', tenant_id=1, tenant_name='default', title='f20d9b3a-8716-4664-aff7-80ddf3014290', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/48/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[])] May 28 13:00:55 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ec671006-1eab-4e6d-a131-37a72a714c20 tempest-ShareRulesTest-1530341375 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 13:00:55 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-ec671006-1eab-4e6d-a131-37a72a714c20 tempest-ShareRulesTest-1530341375 None] changing access on /manila/manila-f20d9b3a-8716-4664-aff7-80ddf3014290. Rules: {'nfs_read_write': ['203.0.113.77'], 'nfs_read_only': []} May 28 13:00:55 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ec671006-1eab-4e6d-a131-37a72a714c20 tempest-ShareRulesTest-1530341375 None] >>> [PATCH] https://127.0.0.1:40443/api/viewpolicies/48/ May 28 13:00:55 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ec671006-1eab-4e6d-a131-37a72a714c20 tempest-ShareRulesTest-1530341375 None] {'data': '{"name": "f20d9b3a-8716-4664-aff7-80ddf3014290", "nfs_no_squash": ' May 28 13:00:55 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ec671006-1eab-4e6d-a131-37a72a714c20 tempest-ShareRulesTest-1530341375 None] '["*"], "nfs_root_squash": ["*"], "nfs_read_write": ["203.0.113.77"], ' May 28 13:00:55 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ec671006-1eab-4e6d-a131-37a72a714c20 tempest-ShareRulesTest-1530341375 None] '"nfs_read_only": []}', May 28 13:00:55 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ec671006-1eab-4e6d-a131-37a72a714c20 tempest-ShareRulesTest-1530341375 None] 'params': None} May 28 13:00:56 l75lg1-v1 neutron-server[77618]: DEBUG dbcounter [-] [77618] Writing DB stats neutron:SELECT=1 {{(pid=77618) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:00:56 l75lg1-v1 dstat.sh[49771]: 28-05 13:00:56| 1 0 95 3 0|5696M 1749M 278M 7901M| 14k 1669B| 0 4826k| 0 368 |2724 4290 |1.80 1.25 1.08| 0 1.0 0| 0 0 | 0 2048M| 29 361 0 33 2 May 28 13:00:56 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bd7f0e79-6ba7-4b97-a4f2-b303489b4237 tempest-ShareTransferNegativeTest-884271560 None] <<< [DELETE] https://127.0.0.1:40443/api/quotas/36/ May 28 13:00:56 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bd7f0e79-6ba7-4b97-a4f2-b303489b4237 tempest-ShareTransferNegativeTest-884271560 None] --- [DELETE] https://127.0.0.1:40443/api/quotas/36/: Done May 28 13:00:56 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bd7f0e79-6ba7-4b97-a4f2-b303489b4237 tempest-ShareTransferNegativeTest-884271560 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:00:56 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bd7f0e79-6ba7-4b97-a4f2-b303489b4237 tempest-ShareTransferNegativeTest-884271560 None] {'allow_redirects': True, May 28 13:00:56 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bd7f0e79-6ba7-4b97-a4f2-b303489b4237 tempest-ShareTransferNegativeTest-884271560 None] 'params': {'name': 'e89b90ae-d644-4b77-81a0-3d997b90fad0'}} May 28 13:00:56 l75lg1-v1 neutron-server[77618]: DEBUG dbcounter [-] [77618] Writing DB stats neutron:SELECT=2 {{(pid=77618) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:00:56 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-5b18158e-cd9c-4b47-bd98-75a7ac87571a tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] GET http://10.27.203.238/share/v2/cac556dc39a14bbdbdbabfc80672fb1f/shares/bd070603-3332-4a76-a743-411df92ace16 May 28 13:00:56 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-5b18158e-cd9c-4b47-bd98-75a7ac87571a tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:56 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-5b18158e-cd9c-4b47-bd98-75a7ac87571a tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:56 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-5b18158e-cd9c-4b47-bd98-75a7ac87571a tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] http://10.27.203.238/share/v2/cac556dc39a14bbdbdbabfc80672fb1f/shares/bd070603-3332-4a76-a743-411df92ace16 returned with HTTP 200 May 28 13:00:56 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 972/1981] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:00:56 2024] GET /share/v2/cac556dc39a14bbdbdbabfc80672fb1f/shares/bd070603-3332-4a76-a743-411df92ace16 => generated 1315 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:00:56 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bd7f0e79-6ba7-4b97-a4f2-b303489b4237 tempest-ShareTransferNegativeTest-884271560 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:00:56 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bd7f0e79-6ba7-4b97-a4f2-b303489b4237 tempest-ShareTransferNegativeTest-884271560 None] [Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=0, created='2024-05-28T12:59:57.251328Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='fd9abce8-86bf-432b-8bd1-98263cf159ce', id=39, internal=False, is_s3_default_policy=False, name='e89b90ae-d644-4b77-81a0-3d997b90fad0', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=[], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['*'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['*'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T12:59:57.597483Z', tenant_id=1, tenant_name='default', title='e89b90ae-d644-4b77-81a0-3d997b90fad0', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/39/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[])] May 28 13:00:56 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bd7f0e79-6ba7-4b97-a4f2-b303489b4237 tempest-ShareTransferNegativeTest-884271560 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 13:00:56 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bd7f0e79-6ba7-4b97-a4f2-b303489b4237 tempest-ShareTransferNegativeTest-884271560 None] >>> [DELETE] https://127.0.0.1:40443/api/viewpolicies/39/ May 28 13:00:56 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-84f34d54-491d-4250-9b2b-ec594c188473 tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] GET http://10.27.203.238/share/v2/284d76edec3144579d6fb3f6dbc0dd4e/shares/433f546f-3297-46a0-b412-18630103d191 May 28 13:00:56 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-84f34d54-491d-4250-9b2b-ec594c188473 tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:56 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-84f34d54-491d-4250-9b2b-ec594c188473 tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:56 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-84f34d54-491d-4250-9b2b-ec594c188473 tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] http://10.27.203.238/share/v2/284d76edec3144579d6fb3f6dbc0dd4e/shares/433f546f-3297-46a0-b412-18630103d191 returned with HTTP 200 May 28 13:00:56 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1010/1982] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:00:56 2024] GET /share/v2/284d76edec3144579d6fb3f6dbc0dd4e/shares/433f546f-3297-46a0-b412-18630103d191 => generated 1316 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:00:57 l75lg1-v1 dstat.sh[49771]: 28-05 13:00:57| 2 0 97 0 0|5696M 1749M 278M 7901M| 14k 1390B| 0 512k| 0 28.0 |1980 3001 |1.74 1.25 1.08| 0 1.0 0| 0 0 | 0 2048M| 29 361 0 33 2 May 28 13:00:57 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-914df302-1a94-49cd-951e-378d1ac5e45a tempest-ShareTypeAvailabilityZonesTest-364532124 None] <<< [DELETE] https://127.0.0.1:40443/api/quotas/43/ May 28 13:00:57 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-914df302-1a94-49cd-951e-378d1ac5e45a tempest-ShareTypeAvailabilityZonesTest-364532124 None] --- [DELETE] https://127.0.0.1:40443/api/quotas/43/: Done May 28 13:00:57 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-914df302-1a94-49cd-951e-378d1ac5e45a tempest-ShareTypeAvailabilityZonesTest-364532124 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:00:57 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-914df302-1a94-49cd-951e-378d1ac5e45a tempest-ShareTypeAvailabilityZonesTest-364532124 None] {'allow_redirects': True, May 28 13:00:57 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-914df302-1a94-49cd-951e-378d1ac5e45a tempest-ShareTypeAvailabilityZonesTest-364532124 None] 'params': {'name': '1d36626a-c0bd-47a1-a990-d50f95cbf99c'}} May 28 13:00:57 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-4b8264f8-73ad-4fc5-baa5-7272d73c79b1 tempest-ShareRulesNegativeTest-930400775 tempest-ShareRulesNegativeTest-930400775-project-member] GET http://10.27.203.238/share/v2/329a14ab984146feb9f91e467ab4e3b5/snapshots/98f3b924-cebf-46a4-9429-7f55792a0941 May 28 13:00:57 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-4b8264f8-73ad-4fc5-baa5-7272d73c79b1 tempest-ShareRulesNegativeTest-930400775 tempest-ShareRulesNegativeTest-930400775-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:57 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-4b8264f8-73ad-4fc5-baa5-7272d73c79b1 tempest-ShareRulesNegativeTest-930400775 tempest-ShareRulesNegativeTest-930400775-project-member] Calling method 'ShareSnapshotMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:57 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-4b8264f8-73ad-4fc5-baa5-7272d73c79b1 tempest-ShareRulesNegativeTest-930400775 tempest-ShareRulesNegativeTest-930400775-project-member] http://10.27.203.238/share/v2/329a14ab984146feb9f91e467ab4e3b5/snapshots/98f3b924-cebf-46a4-9429-7f55792a0941 returned with HTTP 200 May 28 13:00:57 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 973/1983] 10.27.203.238 () {64 vars in 1460 bytes} [Tue May 28 13:00:57 2024] GET /share/v2/329a14ab984146feb9f91e467ab4e3b5/snapshots/98f3b924-cebf-46a4-9429-7f55792a0941 => generated 722 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:00:57 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 13:00:57 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager.update_available_resource {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 13:00:57 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Expecting reply to msg 6c18aaa511764915acb39772626ae419 in queue reply_37f4cbd1dd094961a22b8a65f222c327 May 28 13:00:57 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [-] Received RPC response for msg 6c18aaa511764915acb39772626ae419 May 28 13:00:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG dbcounter [-] [51266] Writing DB stats keystone:SELECT=966,keystone:DELETE=115,keystone:INSERT=57 {{(pid=51266) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:00:57 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c313e1ef-5c59-4943-8400-4f67771384fa tempest-ShareRulesNegativeTest-930400775 None] <<< [POST] https://127.0.0.1:40443/api/snapshots/ May 28 13:00:57 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c313e1ef-5c59-4943-8400-4f67771384fa tempest-ShareRulesNegativeTest-930400775 None] Bunch(access_path='/.vast_all_snapshots/1000000012_share-snapshot-851bfc5e-de6d-4c8a-8ed3-1d93e02d4dc5', aggr_phys_estimation=0, cluster='loop75-kfs', created='2024-05-28T13:00:54.738011Z', eta_sec=30819898740.344383, expiration_time='3001-01-19T07:59:58Z', guid='7b97bfe3-80c8-4591-be53-9f24487682eb', id=13, indestructible=False, locked=False, name='share-snapshot-851bfc5e-de6d-4c8a-8ed3-1d93e02d4dc5', path='/manila/manila-e0a28587-55d6-44c6-8c73-249d5047f95e/', policy=None, policy_id=None, protection_policy_id=None, state='SUCCEED', tenant_id=1, tenant_name='default', title='share-snapshot-851bfc5e-de6d-4c8a-8ed3-1d93e02d4dc5(/manila/manila-e0a28587-55d6-44c6-8c73-249d5047f95e/)', type='local', unique_phys_estimation=0, url='https://127.0.0.1:40443/api/snapshots/13/') May 28 13:00:57 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c313e1ef-5c59-4943-8400-4f67771384fa tempest-ShareRulesNegativeTest-930400775 None] --- [POST] https://127.0.0.1:40443/api/snapshots/: Done May 28 13:00:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG dbcounter [-] [51267] Writing DB stats keystone:SELECT=907,keystone:DELETE=146,keystone:INSERT=58 {{(pid=51267) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:00:57 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ec671006-1eab-4e6d-a131-37a72a714c20 tempest-ShareRulesTest-1530341375 None] <<< [PATCH] https://127.0.0.1:40443/api/viewpolicies/48/ May 28 13:00:57 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ec671006-1eab-4e6d-a131-37a72a714c20 tempest-ShareRulesTest-1530341375 None] Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=1, created='2024-05-28T13:00:50.357495Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='1099a621-1733-438b-a032-2bf134301842', id=48, internal=False, is_s3_default_policy=False, name='f20d9b3a-8716-4664-aff7-80ddf3014290', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=['*'], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['203.0.113.77'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['203.0.113.77'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='MODIFYING', sync_time='2024-05-28T13:00:56.982948Z', tenant_id=1, tenant_name='default', title='f20d9b3a-8716-4664-aff7-80ddf3014290', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/48/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[]) May 28 13:00:57 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ec671006-1eab-4e6d-a131-37a72a714c20 tempest-ShareRulesTest-1530341375 None] --- [PATCH] https://127.0.0.1:40443/api/viewpolicies/48/: Done May 28 13:00:57 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-ec671006-1eab-4e6d-a131-37a72a714c20 tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f20d9b3a-8716-4664-aff7-80ddf3014290" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:00:57 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-ec671006-1eab-4e6d-a131-37a72a714c20 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f20d9b3a-8716-4664-aff7-80ddf3014290" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:00:58 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-ec671006-1eab-4e6d-a131-37a72a714c20 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f20d9b3a-8716-4664-aff7-80ddf3014290" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.067s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:00:58 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-ec671006-1eab-4e6d-a131-37a72a714c20 tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f20d9b3a-8716-4664-aff7-80ddf3014290" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:00:58 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-ec671006-1eab-4e6d-a131-37a72a714c20 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f20d9b3a-8716-4664-aff7-80ddf3014290" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:00:58 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-ec671006-1eab-4e6d-a131-37a72a714c20 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f20d9b3a-8716-4664-aff7-80ddf3014290" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:00:58 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-ec671006-1eab-4e6d-a131-37a72a714c20 tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f20d9b3a-8716-4664-aff7-80ddf3014290" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:00:58 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-ec671006-1eab-4e6d-a131-37a72a714c20 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f20d9b3a-8716-4664-aff7-80ddf3014290" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:00:58 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-914df302-1a94-49cd-951e-378d1ac5e45a tempest-ShareTypeAvailabilityZonesTest-364532124 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:00:58 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-914df302-1a94-49cd-951e-378d1ac5e45a tempest-ShareTypeAvailabilityZonesTest-364532124 None] [Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=0, created='2024-05-28T13:00:46.065473Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='005fae1a-ea9f-4aed-a9c5-bffcb8eaf9d2', id=46, internal=False, is_s3_default_policy=False, name='1d36626a-c0bd-47a1-a990-d50f95cbf99c', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=[], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['*'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['*'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T13:00:46.441308Z', tenant_id=1, tenant_name='default', title='1d36626a-c0bd-47a1-a990-d50f95cbf99c', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/46/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[])] May 28 13:00:58 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-914df302-1a94-49cd-951e-378d1ac5e45a tempest-ShareTypeAvailabilityZonesTest-364532124 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 13:00:58 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-914df302-1a94-49cd-951e-378d1ac5e45a tempest-ShareTypeAvailabilityZonesTest-364532124 None] >>> [DELETE] https://127.0.0.1:40443/api/viewpolicies/46/ May 28 13:00:58 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-ec671006-1eab-4e6d-a131-37a72a714c20 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f20d9b3a-8716-4664-aff7-80ddf3014290" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.007s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:00:58 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [-] Expecting reply to msg c277be9de0554f2dbf9b522268672f1b in queue reply_37f4cbd1dd094961a22b8a65f222c327 May 28 13:00:58 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-ec671006-1eab-4e6d-a131-37a72a714c20 tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f20d9b3a-8716-4664-aff7-80ddf3014290" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:00:58 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-ec671006-1eab-4e6d-a131-37a72a714c20 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f20d9b3a-8716-4664-aff7-80ddf3014290" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:00:58 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-ec671006-1eab-4e6d-a131-37a72a714c20 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f20d9b3a-8716-4664-aff7-80ddf3014290" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.004s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:00:58 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-ec671006-1eab-4e6d-a131-37a72a714c20 tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f20d9b3a-8716-4664-aff7-80ddf3014290" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:00:58 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-ec671006-1eab-4e6d-a131-37a72a714c20 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f20d9b3a-8716-4664-aff7-80ddf3014290" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:00:58 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [-] Received RPC response for msg c277be9de0554f2dbf9b522268672f1b May 28 13:00:58 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-ec671006-1eab-4e6d-a131-37a72a714c20 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f20d9b3a-8716-4664-aff7-80ddf3014290" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.056s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:00:58 l75lg1-v1 manila-share[98474]: INFO manila.share.access [None req-ec671006-1eab-4e6d-a131-37a72a714c20 tempest-ShareRulesTest-1530341375 None] Access rules were successfully modified for share instance f20d9b3a-8716-4664-aff7-80ddf3014290 belonging to share 415b1daa-22c2-48a3-873e-80762e65a747. May 28 13:00:58 l75lg1-v1 nova-compute[83654]: DEBUG oslo_concurrency.lockutils [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=83654) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:00:58 l75lg1-v1 nova-compute[83654]: DEBUG oslo_concurrency.lockutils [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=83654) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:00:58 l75lg1-v1 nova-compute[83654]: DEBUG oslo_concurrency.lockutils [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=83654) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:00:58 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.resource_tracker [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Auditing locally available compute resources for l75lg1-v1 (node: l75lg1-v1) {{(pid=83654) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}} May 28 13:00:58 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-4b1433a4-5916-43e4-81f7-044d5eb631f4 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] GET http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/share-access-rules?share_id=415b1daa-22c2-48a3-873e-80762e65a747 May 28 13:00:58 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-4b1433a4-5916-43e4-81f7-044d5eb631f4 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:58 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-4b1433a4-5916-43e4-81f7-044d5eb631f4 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:58 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.resource_tracker [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Hypervisor/Node resource view: name=l75lg1-v1 free_ram=9927MB free_disk=15.564102172851562GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_01_1", "address": "0000:00:01.1", "product_id": "7010", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7010", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7000", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7000", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "0100", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_0100", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_09_0", "address": "0000:00:09.0", "product_id": "1001", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1001", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "293a", "vendor_id": "8086", "numa_node": null, "label": "label_8086_293a", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_2", "address": "0000:00:07.2", "product_id": "2936", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2936", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "1237", "vendor_id": "8086", "numa_node": null, "label": "label_8086_1237", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "2935", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2935", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "2934", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2934", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_05_0", "address": "0000:00:05.0", "product_id": "1000", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1000", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "1000", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1000", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_06_0", "address": "0000:00:06.0", "product_id": "2668", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2668", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "1000", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1000", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0a_0", "address": "0000:00:0a.0", "product_id": "1002", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1002", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_3", "address": "0000:00:01.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_08_0", "address": "0000:00:08.0", "product_id": "1003", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1003", "dev_type": "type-PCI"}] {{(pid=83654) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}} May 28 13:00:58 l75lg1-v1 nova-compute[83654]: DEBUG oslo_concurrency.lockutils [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=83654) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:00:58 l75lg1-v1 nova-compute[83654]: DEBUG oslo_concurrency.lockutils [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=83654) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:00:58 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Expecting reply to msg 3d670f701e0b4ab18c58a42ec155a704 in queue reply_37f4cbd1dd094961a22b8a65f222c327 May 28 13:00:58 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [-] Received RPC response for msg 3d670f701e0b4ab18c58a42ec155a704 May 28 13:00:58 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.lock.api [None req-4b1433a4-5916-43e4-81f7-044d5eb631f4 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Searching for locks by: {'resource_id': 'eebb2fbe-ccfe-4057-986c-639ddd3ccbad', 'resource_action': 'show', 'resource_type': 'access_rule'} {{(pid=98329) get_all /opt/stack/manila/manila/lock/api.py:112}} May 28 13:00:58 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-4b1433a4-5916-43e4-81f7-044d5eb631f4 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/share-access-rules?share_id=415b1daa-22c2-48a3-873e-80762e65a747 returned with HTTP 200 May 28 13:00:58 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1011/1984] 10.27.203.238 () {64 vars in 1467 bytes} [Tue May 28 13:00:58 2024] GET /share/v2/a4f3887fa28c457390f5b66615564430/share-access-rules?share_id=415b1daa-22c2-48a3-873e-80762e65a747 => generated 280 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:00:58 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-376f6a4f-c915-416a-af0c-bd96192dd711 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] DELETE http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/shares/415b1daa-22c2-48a3-873e-80762e65a747 May 28 13:00:58 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-376f6a4f-c915-416a-af0c-bd96192dd711 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:58 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-376f6a4f-c915-416a-af0c-bd96192dd711 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Calling method 'ShareMixin.delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:58 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.v1.shares [None req-376f6a4f-c915-416a-af0c-bd96192dd711 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Delete share with id: 415b1daa-22c2-48a3-873e-80762e65a747 May 28 13:00:58 l75lg1-v1 dstat.sh[49771]: 28-05 13:00:58| 5 1 93 1 0|5697M 1748M 278M 7902M| 20k 1695B| 0 812k| 0 106 |4502 7674 |1.74 1.25 1.08|2.0 1.0 2.0| 0 0 | 0 2048M| 29 362 0 30 2 May 28 13:00:58 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-376f6a4f-c915-416a-af0c-bd96192dd711 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/shares/415b1daa-22c2-48a3-873e-80762e65a747 returned with HTTP 202 May 28 13:00:58 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 974/1985] 10.27.203.238 () {64 vars in 1454 bytes} [Tue May 28 13:00:58 2024] DELETE /share/v2/a4f3887fa28c457390f5b66615564430/shares/415b1daa-22c2-48a3-873e-80762e65a747 => generated 0 bytes in 137 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 13:00:58 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bd7f0e79-6ba7-4b97-a4f2-b303489b4237 tempest-ShareTransferNegativeTest-884271560 None] <<< [DELETE] https://127.0.0.1:40443/api/viewpolicies/39/ May 28 13:00:58 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bd7f0e79-6ba7-4b97-a4f2-b303489b4237 tempest-ShareTransferNegativeTest-884271560 None] --- [DELETE] https://127.0.0.1:40443/api/viewpolicies/39/: Done May 28 13:00:58 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-c575a146-2ade-4331-a0af-a2d03ce36dc2 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] GET http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/shares/415b1daa-22c2-48a3-873e-80762e65a747 May 28 13:00:58 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-c575a146-2ade-4331-a0af-a2d03ce36dc2 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:58 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-c575a146-2ade-4331-a0af-a2d03ce36dc2 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:58 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-c575a146-2ade-4331-a0af-a2d03ce36dc2 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/shares/415b1daa-22c2-48a3-873e-80762e65a747 returned with HTTP 200 May 28 13:00:58 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1012/1986] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:00:58 2024] GET /share/v2/a4f3887fa28c457390f5b66615564430/shares/415b1daa-22c2-48a3-873e-80762e65a747 => generated 1315 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:00:58 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-376f6a4f-c915-416a-af0c-bd96192dd711 tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f20d9b3a-8716-4664-aff7-80ddf3014290" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:00:58 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-376f6a4f-c915-416a-af0c-bd96192dd711 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f20d9b3a-8716-4664-aff7-80ddf3014290" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:00:58 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-376f6a4f-c915-416a-af0c-bd96192dd711 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f20d9b3a-8716-4664-aff7-80ddf3014290" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.074s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:00:58 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-376f6a4f-c915-416a-af0c-bd96192dd711 tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f20d9b3a-8716-4664-aff7-80ddf3014290" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:00:58 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-376f6a4f-c915-416a-af0c-bd96192dd711 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f20d9b3a-8716-4664-aff7-80ddf3014290" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:00:58 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-376f6a4f-c915-416a-af0c-bd96192dd711 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f20d9b3a-8716-4664-aff7-80ddf3014290" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:00:58 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-376f6a4f-c915-416a-af0c-bd96192dd711 tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f20d9b3a-8716-4664-aff7-80ddf3014290" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:00:58 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-376f6a4f-c915-416a-af0c-bd96192dd711 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f20d9b3a-8716-4664-aff7-80ddf3014290" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:00:58 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-bd7f0e79-6ba7-4b97-a4f2-b303489b4237 tempest-ShareTransferNegativeTest-884271560 None] Created reservations ['2cd25bda-2de5-454b-a05c-a8c6fba6e0b7', '5f80119b-64cc-4510-b8b1-efeabf93675f', '1b121173-6e22-42f3-94ac-1cb63dc903c8', '6bf04384-b86c-4bd7-bbce-8c089772f3a4'] {{(pid=98474) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 13:00:58 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-bd7f0e79-6ba7-4b97-a4f2-b303489b4237 tempest-ShareTransferNegativeTest-884271560 None] Committed reservations ['2cd25bda-2de5-454b-a05c-a8c6fba6e0b7', '5f80119b-64cc-4510-b8b1-efeabf93675f', '1b121173-6e22-42f3-94ac-1cb63dc903c8', '6bf04384-b86c-4bd7-bbce-8c089772f3a4'] {{(pid=98474) commit /opt/stack/manila/manila/quota.py:1063}} May 28 13:00:58 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-376f6a4f-c915-416a-af0c-bd96192dd711 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f20d9b3a-8716-4664-aff7-80ddf3014290" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.074s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:00:58 l75lg1-v1 manila-share[98474]: DEBUG manila.share.access [None req-376f6a4f-c915-416a-af0c-bd96192dd711 tempest-ShareRulesTest-1530341375 None] Updating access rules for share instance f20d9b3a-8716-4664-aff7-80ddf3014290 belonging to share 415b1daa-22c2-48a3-873e-80762e65a747. {{(pid=98474) update_access_rules /opt/stack/manila/manila/share/access.py:298}} May 28 13:00:58 l75lg1-v1 manila-share[98474]: INFO manila.share.manager [None req-bd7f0e79-6ba7-4b97-a4f2-b303489b4237 tempest-ShareTransferNegativeTest-884271560 None] Share instance e89b90ae-d644-4b77-81a0-3d997b90fad0: deleted successfully. May 28 13:00:58 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-376f6a4f-c915-416a-af0c-bd96192dd711 tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f20d9b3a-8716-4664-aff7-80ddf3014290" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:00:58 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-376f6a4f-c915-416a-af0c-bd96192dd711 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f20d9b3a-8716-4664-aff7-80ddf3014290" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:00:58 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Expecting reply to msg 30eb363a0200426e92436600a9d28a9d in queue reply_37f4cbd1dd094961a22b8a65f222c327 May 28 13:00:58 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [-] Received RPC response for msg 30eb363a0200426e92436600a9d28a9d May 28 13:00:58 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-376f6a4f-c915-416a-af0c-bd96192dd711 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f20d9b3a-8716-4664-aff7-80ddf3014290" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.049s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:00:58 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-376f6a4f-c915-416a-af0c-bd96192dd711 tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f20d9b3a-8716-4664-aff7-80ddf3014290" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:00:58 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-376f6a4f-c915-416a-af0c-bd96192dd711 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f20d9b3a-8716-4664-aff7-80ddf3014290" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:00:58 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-376f6a4f-c915-416a-af0c-bd96192dd711 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f20d9b3a-8716-4664-aff7-80ddf3014290" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.015s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:00:58 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-376f6a4f-c915-416a-af0c-bd96192dd711 tempest-ShareRulesTest-1530341375 None] changing access on None May 28 13:00:58 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-376f6a4f-c915-416a-af0c-bd96192dd711 tempest-ShareRulesTest-1530341375 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:00:58 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-376f6a4f-c915-416a-af0c-bd96192dd711 tempest-ShareRulesTest-1530341375 None] {'allow_redirects': True, May 28 13:00:58 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-376f6a4f-c915-416a-af0c-bd96192dd711 tempest-ShareRulesTest-1530341375 None] 'params': {'name': 'f20d9b3a-8716-4664-aff7-80ddf3014290'}} May 28 13:00:59 l75lg1-v1 devstack@placement-api.service[78202]: DEBUG placement.requestlog [req-926249c2-cc31-4244-8b3d-7157a8491ddb req-5e703ccb-6cf0-4718-a5cf-0ae6baaed36a None None] Starting request: 10.27.203.238 "GET /placement/resource_providers/ef90d7d1-0808-4a15-ad77-f9a7391af2f4/allocations" {{(pid=78202) __call__ /opt/stack/placement/placement/requestlog.py:55}} May 28 13:00:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d505d57-d503-41ac-a795-cabff2f7601a service manila] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-5d505d57-d503-41ac-a795-cabff2f7601a service manila] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:00:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d505d57-d503-41ac-a795-cabff2f7601a service manila] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:59 l75lg1-v1 dstat.sh[49771]: 28-05 13:00:59| 6 1 90 3 0|5697M 1748M 278M 7902M| 14k 736B| 0 1244k| 0 160 |4198 6833 |1.74 1.25 1.08|4.0 1.0 0| 0 0 | 0 2048M| 29 363 0 31 2 May 28 13:00:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69af915-56fd-4ccf-b5ee-676ee4157dc9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3fe870f285d4169bd917382dd02d7b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'manager', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69af915-56fd-4ccf-b5ee-676ee4157dc9 service placement] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69af915-56fd-4ccf-b5ee-676ee4157dc9 service placement] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69af915-56fd-4ccf-b5ee-676ee4157dc9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-a69af915-56fd-4ccf-b5ee-676ee4157dc9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:00:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69af915-56fd-4ccf-b5ee-676ee4157dc9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69af915-56fd-4ccf-b5ee-676ee4157dc9 service placement] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:59 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1473/2974] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 13:00:59 2024] GET /identity/v3/auth/tokens => generated 4060 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 13:00:59 l75lg1-v1 devstack@placement-api.service[78202]: INFO placement.requestlog [req-926249c2-cc31-4244-8b3d-7157a8491ddb req-5e703ccb-6cf0-4718-a5cf-0ae6baaed36a service placement] 10.27.203.238 "GET /placement/resource_providers/ef90d7d1-0808-4a15-ad77-f9a7391af2f4/allocations" status: 200 len: 54 microversion: 1.0 May 28 13:00:59 l75lg1-v1 devstack@placement-api.service[78202]: [pid: 78202|app: 0|req: 26/51] 10.27.203.238 () {62 vars in 1480 bytes} [Tue May 28 13:00:59 2024] GET /placement/resource_providers/ef90d7d1-0808-4a15-ad77-f9a7391af2f4/allocations => generated 54 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 223 bytes (1 switches on core 0) May 28 13:00:59 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.resource_tracker [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Total usable vcpus: 10, total allocated vcpus: 0 {{(pid=83654) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}} May 28 13:00:59 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.resource_tracker [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Final resource view: name=l75lg1-v1 phys_ram=16000MB used_ram=512MB phys_disk=28GB used_disk=0GB total_vcpus=10 used_vcpus=0 pci_stats=[] {{(pid=83654) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}} May 28 13:00:59 l75lg1-v1 devstack@placement-api.service[78201]: DEBUG placement.requestlog [req-926249c2-cc31-4244-8b3d-7157a8491ddb req-80e5a116-4416-4adb-ab2a-be03b302deef None None] Starting request: 10.27.203.238 "GET /placement/resource_providers?in_tree=ef90d7d1-0808-4a15-ad77-f9a7391af2f4" {{(pid=78201) __call__ /opt/stack/placement/placement/requestlog.py:55}} May 28 13:00:59 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-376f6a4f-c915-416a-af0c-bd96192dd711 tempest-ShareRulesTest-1530341375 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:00:59 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-376f6a4f-c915-416a-af0c-bd96192dd711 tempest-ShareRulesTest-1530341375 None] [Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=1, created='2024-05-28T13:00:50.357495Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='1099a621-1733-438b-a032-2bf134301842', id=48, internal=False, is_s3_default_policy=False, name='f20d9b3a-8716-4664-aff7-80ddf3014290', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=['*'], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['203.0.113.77'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['203.0.113.77'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T13:00:57.790544Z', tenant_id=1, tenant_name='default', title='f20d9b3a-8716-4664-aff7-80ddf3014290', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/48/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[])] May 28 13:00:59 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-376f6a4f-c915-416a-af0c-bd96192dd711 tempest-ShareRulesTest-1530341375 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 13:00:59 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-376f6a4f-c915-416a-af0c-bd96192dd711 tempest-ShareRulesTest-1530341375 None] changing access on /manila/manila-f20d9b3a-8716-4664-aff7-80ddf3014290. Rules: {'nfs_read_write': [], 'nfs_read_only': []} May 28 13:00:59 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-376f6a4f-c915-416a-af0c-bd96192dd711 tempest-ShareRulesTest-1530341375 None] >>> [PATCH] https://127.0.0.1:40443/api/viewpolicies/48/ May 28 13:00:59 l75lg1-v1 devstack@placement-api.service[78201]: INFO placement.requestlog [req-926249c2-cc31-4244-8b3d-7157a8491ddb req-80e5a116-4416-4adb-ab2a-be03b302deef service placement] 10.27.203.238 "GET /placement/resource_providers?in_tree=ef90d7d1-0808-4a15-ad77-f9a7391af2f4" status: 200 len: 858 microversion: 1.14 May 28 13:00:59 l75lg1-v1 devstack@placement-api.service[78201]: [pid: 78201|app: 0|req: 26/52] 10.27.203.238 () {64 vars in 1466 bytes} [Tue May 28 13:00:59 2024] GET /placement/resource_providers?in_tree=ef90d7d1-0808-4a15-ad77-f9a7391af2f4 => generated 858 bytes in 16 msecs (HTTP/1.1 200) 6 headers in 225 bytes (1 switches on core 0) May 28 13:00:59 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-376f6a4f-c915-416a-af0c-bd96192dd711 tempest-ShareRulesTest-1530341375 None] {'data': '{"name": "f20d9b3a-8716-4664-aff7-80ddf3014290", "nfs_no_squash": ' May 28 13:00:59 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-376f6a4f-c915-416a-af0c-bd96192dd711 tempest-ShareRulesTest-1530341375 None] '["*"], "nfs_root_squash": ["*"], "nfs_read_write": [], ' May 28 13:00:59 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-376f6a4f-c915-416a-af0c-bd96192dd711 tempest-ShareRulesTest-1530341375 None] '"nfs_read_only": []}', May 28 13:00:59 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-376f6a4f-c915-416a-af0c-bd96192dd711 tempest-ShareRulesTest-1530341375 None] 'params': None} May 28 13:00:59 l75lg1-v1 nova-compute[83654]: DEBUG nova.scheduler.client.report [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Refreshing inventories for resource provider ef90d7d1-0808-4a15-ad77-f9a7391af2f4 {{(pid=83654) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}} May 28 13:00:59 l75lg1-v1 devstack@placement-api.service[78202]: DEBUG placement.requestlog [req-926249c2-cc31-4244-8b3d-7157a8491ddb req-5ad840ff-2d5d-4c37-bf2e-ae7a14f33abd None None] Starting request: 10.27.203.238 "GET /placement/resource_providers/ef90d7d1-0808-4a15-ad77-f9a7391af2f4/inventories" {{(pid=78202) __call__ /opt/stack/placement/placement/requestlog.py:55}} May 28 13:00:59 l75lg1-v1 devstack@placement-api.service[78202]: INFO placement.requestlog [req-926249c2-cc31-4244-8b3d-7157a8491ddb req-5ad840ff-2d5d-4c37-bf2e-ae7a14f33abd service placement] 10.27.203.238 "GET /placement/resource_providers/ef90d7d1-0808-4a15-ad77-f9a7391af2f4/inventories" status: 200 len: 398 microversion: 1.0 May 28 13:00:59 l75lg1-v1 devstack@placement-api.service[78202]: [pid: 78202|app: 0|req: 27/53] 10.27.203.238 () {62 vars in 1480 bytes} [Tue May 28 13:00:59 2024] GET /placement/resource_providers/ef90d7d1-0808-4a15-ad77-f9a7391af2f4/inventories => generated 398 bytes in 12 msecs (HTTP/1.1 200) 6 headers in 224 bytes (1 switches on core 0) May 28 13:00:59 l75lg1-v1 nova-compute[83654]: DEBUG nova.scheduler.client.report [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Updating ProviderTree inventory for provider ef90d7d1-0808-4a15-ad77-f9a7391af2f4 from _refresh_and_get_inventory using data: {'VCPU': {'total': 10, 'reserved': 0, 'min_unit': 1, 'max_unit': 10, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16000, 'reserved': 512, 'min_unit': 1, 'max_unit': 16000, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 28, 'reserved': 0, 'min_unit': 1, 'max_unit': 28, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=83654) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}} May 28 13:00:59 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.provider_tree [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Updating inventory in ProviderTree for provider ef90d7d1-0808-4a15-ad77-f9a7391af2f4 with inventory: {'VCPU': {'total': 10, 'reserved': 0, 'min_unit': 1, 'max_unit': 10, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16000, 'reserved': 512, 'min_unit': 1, 'max_unit': 16000, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 28, 'reserved': 0, 'min_unit': 1, 'max_unit': 28, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=83654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}} May 28 13:00:59 l75lg1-v1 devstack@placement-api.service[78201]: DEBUG placement.requestlog [req-926249c2-cc31-4244-8b3d-7157a8491ddb req-c6cb0d1d-e428-4d76-a9fa-2f127605916d None None] Starting request: 10.27.203.238 "GET /placement/resource_providers/ef90d7d1-0808-4a15-ad77-f9a7391af2f4/aggregates" {{(pid=78201) __call__ /opt/stack/placement/placement/requestlog.py:55}} May 28 13:00:59 l75lg1-v1 devstack@placement-api.service[78201]: INFO placement.requestlog [req-926249c2-cc31-4244-8b3d-7157a8491ddb req-c6cb0d1d-e428-4d76-a9fa-2f127605916d service placement] 10.27.203.238 "GET /placement/resource_providers/ef90d7d1-0808-4a15-ad77-f9a7391af2f4/aggregates" status: 200 len: 53 microversion: 1.19 May 28 13:00:59 l75lg1-v1 devstack@placement-api.service[78201]: [pid: 78201|app: 0|req: 27/54] 10.27.203.238 () {64 vars in 1521 bytes} [Tue May 28 13:00:59 2024] GET /placement/resource_providers/ef90d7d1-0808-4a15-ad77-f9a7391af2f4/aggregates => generated 53 bytes in 9 msecs (HTTP/1.1 200) 8 headers in 295 bytes (1 switches on core 0) May 28 13:00:59 l75lg1-v1 nova-compute[83654]: DEBUG nova.scheduler.client.report [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Refreshing aggregate associations for resource provider ef90d7d1-0808-4a15-ad77-f9a7391af2f4, aggregates: None {{(pid=83654) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}} May 28 13:00:59 l75lg1-v1 devstack@placement-api.service[78202]: DEBUG placement.requestlog [req-926249c2-cc31-4244-8b3d-7157a8491ddb req-13596432-f002-4a0b-a954-faa962bfb6fe None None] Starting request: 10.27.203.238 "GET /placement/resource_providers/ef90d7d1-0808-4a15-ad77-f9a7391af2f4/traits" {{(pid=78202) __call__ /opt/stack/placement/placement/requestlog.py:55}} May 28 13:00:59 l75lg1-v1 devstack@placement-api.service[78202]: INFO placement.requestlog [req-926249c2-cc31-4244-8b3d-7157a8491ddb req-13596432-f002-4a0b-a954-faa962bfb6fe service placement] 10.27.203.238 "GET /placement/resource_providers/ef90d7d1-0808-4a15-ad77-f9a7391af2f4/traits" status: 200 len: 1471 microversion: 1.6 May 28 13:00:59 l75lg1-v1 devstack@placement-api.service[78202]: [pid: 78202|app: 0|req: 28/55] 10.27.203.238 () {64 vars in 1508 bytes} [Tue May 28 13:00:59 2024] GET /placement/resource_providers/ef90d7d1-0808-4a15-ad77-f9a7391af2f4/traits => generated 1471 bytes in 19 msecs (HTTP/1.1 200) 6 headers in 225 bytes (1 switches on core 0) May 28 13:00:59 l75lg1-v1 nova-compute[83654]: DEBUG nova.scheduler.client.report [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Refreshing trait associations for resource provider ef90d7d1-0808-4a15-ad77-f9a7391af2f4, traits: COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_LAN9118,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NODE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSSE3,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_IDE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VIOMMU_MODEL_SMMUV3,COMPUTE_STORAGE_BUS_FDC {{(pid=83654) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}} May 28 13:00:59 l75lg1-v1 devstack@placement-api.service[78201]: DEBUG placement.requestlog [req-926249c2-cc31-4244-8b3d-7157a8491ddb req-239e09b4-586a-4e7a-97e7-228fa2c08ed2 None None] Starting request: 10.27.203.238 "GET /placement/resource_providers/ef90d7d1-0808-4a15-ad77-f9a7391af2f4/allocations" {{(pid=78201) __call__ /opt/stack/placement/placement/requestlog.py:55}} May 28 13:00:59 l75lg1-v1 devstack@placement-api.service[78201]: INFO placement.requestlog [req-926249c2-cc31-4244-8b3d-7157a8491ddb req-239e09b4-586a-4e7a-97e7-228fa2c08ed2 service placement] 10.27.203.238 "GET /placement/resource_providers/ef90d7d1-0808-4a15-ad77-f9a7391af2f4/allocations" status: 200 len: 54 microversion: 1.0 May 28 13:00:59 l75lg1-v1 devstack@placement-api.service[78201]: [pid: 78201|app: 0|req: 28/56] 10.27.203.238 () {62 vars in 1480 bytes} [Tue May 28 13:00:59 2024] GET /placement/resource_providers/ef90d7d1-0808-4a15-ad77-f9a7391af2f4/allocations => generated 54 bytes in 11 msecs (HTTP/1.1 200) 6 headers in 223 bytes (1 switches on core 0) May 28 13:00:59 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.provider_tree [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Inventory has not changed in ProviderTree for provider: ef90d7d1-0808-4a15-ad77-f9a7391af2f4 {{(pid=83654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} May 28 13:00:59 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Expecting reply to msg 66275e658dbe4a17b2acc284039a1cc8 in queue reply_37f4cbd1dd094961a22b8a65f222c327 May 28 13:00:59 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [-] Received RPC response for msg 66275e658dbe4a17b2acc284039a1cc8 May 28 13:00:59 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-495fbb25-2936-4e91-abc2-9b18e8ae3a4e tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] GET http://10.27.203.238/share/v2/cac556dc39a14bbdbdbabfc80672fb1f/shares/bd070603-3332-4a76-a743-411df92ace16 May 28 13:00:59 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-495fbb25-2936-4e91-abc2-9b18e8ae3a4e tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:59 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-495fbb25-2936-4e91-abc2-9b18e8ae3a4e tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:59 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-495fbb25-2936-4e91-abc2-9b18e8ae3a4e tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] HTTP exception thrown: The resource could not be found. May 28 13:00:59 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-495fbb25-2936-4e91-abc2-9b18e8ae3a4e tempest-ShareTransferNegativeTest-884271560 tempest-ShareTransferNegativeTest-884271560-project-member] http://10.27.203.238/share/v2/cac556dc39a14bbdbdbabfc80672fb1f/shares/bd070603-3332-4a76-a743-411df92ace16 returned with HTTP 404 May 28 13:00:59 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 975/1987] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:00:59 2024] GET /share/v2/cac556dc39a14bbdbdbabfc80672fb1f/shares/bd070603-3332-4a76-a743-411df92ace16 => generated 78 bytes in 11 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 13:00:59 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-e3990492-7f99-4bf3-9cbe-0704ee53d4e2 tempest-ShareTransferNegativeTest-1910579163 tempest-ShareTransferNegativeTest-1910579163-project-admin] DELETE http://10.27.203.238/share/v2/b26e2f4af8614f3ea1f0aba07abd852c/types/7d4af55a-ed87-4690-a9e6-1a8ea4a42df2 May 28 13:00:59 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-e3990492-7f99-4bf3-9cbe-0704ee53d4e2 tempest-ShareTransferNegativeTest-1910579163 tempest-ShareTransferNegativeTest-1910579163-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:59 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-e3990492-7f99-4bf3-9cbe-0704ee53d4e2 tempest-ShareTransferNegativeTest-1910579163 tempest-ShareTransferNegativeTest-1910579163-project-admin] Calling method 'ShareTypesController._delete' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:59 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-e3990492-7f99-4bf3-9cbe-0704ee53d4e2 tempest-ShareTransferNegativeTest-1910579163 tempest-ShareTransferNegativeTest-1910579163-project-admin] http://10.27.203.238/share/v2/b26e2f4af8614f3ea1f0aba07abd852c/types/7d4af55a-ed87-4690-a9e6-1a8ea4a42df2 returned with HTTP 202 May 28 13:00:59 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1013/1988] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:00:59 2024] DELETE /share/v2/b26e2f4af8614f3ea1f0aba07abd852c/types/7d4af55a-ed87-4690-a9e6-1a8ea4a42df2 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 13:00:59 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-de7fe34b-71e6-4f72-ba55-040fa60bd3ab tempest-ShareTransferNegativeTest-1910579163 tempest-ShareTransferNegativeTest-1910579163-project-admin] GET http://10.27.203.238/share/v2/b26e2f4af8614f3ea1f0aba07abd852c/types/7d4af55a-ed87-4690-a9e6-1a8ea4a42df2 May 28 13:00:59 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-de7fe34b-71e6-4f72-ba55-040fa60bd3ab tempest-ShareTransferNegativeTest-1910579163 tempest-ShareTransferNegativeTest-1910579163-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:59 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-de7fe34b-71e6-4f72-ba55-040fa60bd3ab tempest-ShareTransferNegativeTest-1910579163 tempest-ShareTransferNegativeTest-1910579163-project-admin] Calling method 'ShareTypesController.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:59 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-de7fe34b-71e6-4f72-ba55-040fa60bd3ab tempest-ShareTransferNegativeTest-1910579163 tempest-ShareTransferNegativeTest-1910579163-project-admin] HTTP exception thrown: Share type not found. May 28 13:00:59 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-de7fe34b-71e6-4f72-ba55-040fa60bd3ab tempest-ShareTransferNegativeTest-1910579163 tempest-ShareTransferNegativeTest-1910579163-project-admin] http://10.27.203.238/share/v2/b26e2f4af8614f3ea1f0aba07abd852c/types/7d4af55a-ed87-4690-a9e6-1a8ea4a42df2 returned with HTTP 404 May 28 13:00:59 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 976/1989] 10.27.203.238 () {64 vars in 1448 bytes} [Tue May 28 13:00:59 2024] GET /share/v2/b26e2f4af8614f3ea1f0aba07abd852c/types/7d4af55a-ed87-4690-a9e6-1a8ea4a42df2 => generated 67 bytes in 10 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 13:00:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11efd01d-5b78-4c55-8cfa-006d8df25dd2 service manila] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:59 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-914df302-1a94-49cd-951e-378d1ac5e45a tempest-ShareTypeAvailabilityZonesTest-364532124 None] <<< [DELETE] https://127.0.0.1:40443/api/viewpolicies/46/ May 28 13:00:59 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-914df302-1a94-49cd-951e-378d1ac5e45a tempest-ShareTypeAvailabilityZonesTest-364532124 None] --- [DELETE] https://127.0.0.1:40443/api/viewpolicies/46/: Done May 28 13:00:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-11efd01d-5b78-4c55-8cfa-006d8df25dd2 service manila] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:00:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11efd01d-5b78-4c55-8cfa-006d8df25dd2 service manila] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c716e7f3-ad11-4e28-9f83-64f694dc0b6e None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c716e7f3-ad11-4e28-9f83-64f694dc0b6e None admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c716e7f3-ad11-4e28-9f83-64f694dc0b6e None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c716e7f3-ad11-4e28-9f83-64f694dc0b6e None admin] PATH_INFO: `/v3/users/692b6e726f024058993a2054338212cc` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c716e7f3-ad11-4e28-9f83-64f694dc0b6e None admin] RBAC: Authorizing `identity:delete_user(user_id=692b6e726f024058993a2054338212cc)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c716e7f3-ad11-4e28-9f83-64f694dc0b6e None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-c716e7f3-ad11-4e28-9f83-64f694dc0b6e None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '692b6e726f024058993a2054338212cc', 'request_id': 'req-c716e7f3-ad11-4e28-9f83-64f694dc0b6e'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-c716e7f3-ad11-4e28-9f83-64f694dc0b6e None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '692b6e726f024058993a2054338212cc', 'request_id': 'req-c716e7f3-ad11-4e28-9f83-64f694dc0b6e'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-c716e7f3-ad11-4e28-9f83-64f694dc0b6e None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '692b6e726f024058993a2054338212cc', 'request_id': 'req-c716e7f3-ad11-4e28-9f83-64f694dc0b6e'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-c716e7f3-ad11-4e28-9f83-64f694dc0b6e None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '692b6e726f024058993a2054338212cc', 'request_id': 'req-c716e7f3-ad11-4e28-9f83-64f694dc0b6e'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:59 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-914df302-1a94-49cd-951e-378d1ac5e45a tempest-ShareTypeAvailabilityZonesTest-364532124 None] Created reservations ['00da8e26-63c8-419a-a076-dbf8356a71d0', '36b7c249-64e2-466f-88b2-43bb2e4c449a', '09150835-bfd4-4a74-9655-698a46a84171', 'dc0ced7d-b37e-4bcc-96c1-3e0c4ced14fe'] {{(pid=98474) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 13:00:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-c716e7f3-ad11-4e28-9f83-64f694dc0b6e None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '692b6e726f024058993a2054338212cc', 'request_id': 'req-c716e7f3-ad11-4e28-9f83-64f694dc0b6e'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:59 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1502/2975] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 13:00:59 2024] DELETE /identity/v3/users/692b6e726f024058993a2054338212cc => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:00:59 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-914df302-1a94-49cd-951e-378d1ac5e45a tempest-ShareTypeAvailabilityZonesTest-364532124 None] Committed reservations ['00da8e26-63c8-419a-a076-dbf8356a71d0', '36b7c249-64e2-466f-88b2-43bb2e4c449a', '09150835-bfd4-4a74-9655-698a46a84171', 'dc0ced7d-b37e-4bcc-96c1-3e0c4ced14fe'] {{(pid=98474) commit /opt/stack/manila/manila/quota.py:1063}} May 28 13:00:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69af915-56fd-4ccf-b5ee-676ee4157dc9 service placement] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69af915-56fd-4ccf-b5ee-676ee4157dc9 service placement] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:59 l75lg1-v1 manila-share[98474]: INFO manila.share.manager [None req-914df302-1a94-49cd-951e-378d1ac5e45a tempest-ShareTypeAvailabilityZonesTest-364532124 None] Share instance 1d36626a-c0bd-47a1-a990-d50f95cbf99c: deleted successfully. May 28 13:00:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12517acb-b513-4c01-9652-f623feff0ebb None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12517acb-b513-4c01-9652-f623feff0ebb None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12517acb-b513-4c01-9652-f623feff0ebb None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12517acb-b513-4c01-9652-f623feff0ebb None admin] PATH_INFO: `/v3/users/f5d442b2e2004e5c81ae90b7692a94ad` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12517acb-b513-4c01-9652-f623feff0ebb None admin] RBAC: Authorizing `identity:delete_user(user_id=f5d442b2e2004e5c81ae90b7692a94ad)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12517acb-b513-4c01-9652-f623feff0ebb None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:59 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-3371534a-e5e8-45c8-8749-3a08d6a793fc tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] GET http://10.27.203.238/share/v2/284d76edec3144579d6fb3f6dbc0dd4e/shares/433f546f-3297-46a0-b412-18630103d191 May 28 13:00:59 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-3371534a-e5e8-45c8-8749-3a08d6a793fc tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:59 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-3371534a-e5e8-45c8-8749-3a08d6a793fc tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:59 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-3371534a-e5e8-45c8-8749-3a08d6a793fc tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] HTTP exception thrown: The resource could not be found. May 28 13:00:59 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-3371534a-e5e8-45c8-8749-3a08d6a793fc tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] http://10.27.203.238/share/v2/284d76edec3144579d6fb3f6dbc0dd4e/shares/433f546f-3297-46a0-b412-18630103d191 returned with HTTP 404 May 28 13:00:59 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1014/1990] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:00:59 2024] GET /share/v2/284d76edec3144579d6fb3f6dbc0dd4e/shares/433f546f-3297-46a0-b412-18630103d191 => generated 78 bytes in 14 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 13:00:59 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-7d599bc5-fe0d-4738-a56a-546729b69bf2 tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] GET http://10.27.203.238/share/v2/284d76edec3144579d6fb3f6dbc0dd4e/share-replicas/detail?share_id=da80429c-1281-4450-a386-ed0e9d82a3ff May 28 13:00:59 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-7d599bc5-fe0d-4738-a56a-546729b69bf2 tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:59 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-7d599bc5-fe0d-4738-a56a-546729b69bf2 tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:59 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-7d599bc5-fe0d-4738-a56a-546729b69bf2 tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] http://10.27.203.238/share/v2/284d76edec3144579d6fb3f6dbc0dd4e/share-replicas/detail?share_id=da80429c-1281-4450-a386-ed0e9d82a3ff returned with HTTP 200 May 28 13:00:59 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 977/1991] 10.27.203.238 () {64 vars in 1476 bytes} [Tue May 28 13:00:59 2024] GET /share/v2/284d76edec3144579d6fb3f6dbc0dd4e/share-replicas/detail?share_id=da80429c-1281-4450-a386-ed0e9d82a3ff => generated 22 bytes in 12 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:00:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-12517acb-b513-4c01-9652-f623feff0ebb None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5d442b2e2004e5c81ae90b7692a94ad', 'request_id': 'req-12517acb-b513-4c01-9652-f623feff0ebb'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-12517acb-b513-4c01-9652-f623feff0ebb None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5d442b2e2004e5c81ae90b7692a94ad', 'request_id': 'req-12517acb-b513-4c01-9652-f623feff0ebb'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:59 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-a7b29572-6529-4a7c-b1fa-57b384c3fb7a tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] DELETE http://10.27.203.238/share/v2/284d76edec3144579d6fb3f6dbc0dd4e/shares/da80429c-1281-4450-a386-ed0e9d82a3ff May 28 13:00:59 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-a7b29572-6529-4a7c-b1fa-57b384c3fb7a tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:59 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-a7b29572-6529-4a7c-b1fa-57b384c3fb7a tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] Calling method 'ShareMixin.delete' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:59 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.v1.shares [None req-a7b29572-6529-4a7c-b1fa-57b384c3fb7a tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] Delete share with id: da80429c-1281-4450-a386-ed0e9d82a3ff May 28 13:00:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-12517acb-b513-4c01-9652-f623feff0ebb None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5d442b2e2004e5c81ae90b7692a94ad', 'request_id': 'req-12517acb-b513-4c01-9652-f623feff0ebb'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-12517acb-b513-4c01-9652-f623feff0ebb None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5d442b2e2004e5c81ae90b7692a94ad', 'request_id': 'req-12517acb-b513-4c01-9652-f623feff0ebb'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-12517acb-b513-4c01-9652-f623feff0ebb None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5d442b2e2004e5c81ae90b7692a94ad', 'request_id': 'req-12517acb-b513-4c01-9652-f623feff0ebb'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:59 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1474/2976] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 13:00:59 2024] DELETE /identity/v3/users/f5d442b2e2004e5c81ae90b7692a94ad => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:00:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c716e7f3-ad11-4e28-9f83-64f694dc0b6e None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-c716e7f3-ad11-4e28-9f83-64f694dc0b6e None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:00:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c716e7f3-ad11-4e28-9f83-64f694dc0b6e None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:00:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b5704e-02b4-476e-9491-4abb8e7eedf9 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:00:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b5704e-02b4-476e-9491-4abb8e7eedf9 None admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b5704e-02b4-476e-9491-4abb8e7eedf9 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b5704e-02b4-476e-9491-4abb8e7eedf9 None admin] PATH_INFO: `/v3/users/16f4189b208748b8aa156ef28ced43cc` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b5704e-02b4-476e-9491-4abb8e7eedf9 None admin] RBAC: Authorizing `identity:delete_user(user_id=16f4189b208748b8aa156ef28ced43cc)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:00:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b5704e-02b4-476e-9491-4abb8e7eedf9 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:00:59 l75lg1-v1 nova-compute[83654]: DEBUG nova.scheduler.client.report [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Inventory has not changed for provider ef90d7d1-0808-4a15-ad77-f9a7391af2f4 based on inventory data: {'VCPU': {'total': 10, 'reserved': 0, 'min_unit': 1, 'max_unit': 10, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16000, 'reserved': 512, 'min_unit': 1, 'max_unit': 16000, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 28, 'reserved': 0, 'min_unit': 1, 'max_unit': 28, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=83654) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}} May 28 13:00:59 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.resource_tracker [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Compute_service record updated for l75lg1-v1:l75lg1-v1 {{(pid=83654) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}} May 28 13:00:59 l75lg1-v1 nova-compute[83654]: DEBUG oslo_concurrency.lockutils [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.706s {{(pid=83654) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:00:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-25b5704e-02b4-476e-9491-4abb8e7eedf9 None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16f4189b208748b8aa156ef28ced43cc', 'request_id': 'req-25b5704e-02b4-476e-9491-4abb8e7eedf9'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:59 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-a7b29572-6529-4a7c-b1fa-57b384c3fb7a tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] http://10.27.203.238/share/v2/284d76edec3144579d6fb3f6dbc0dd4e/shares/da80429c-1281-4450-a386-ed0e9d82a3ff returned with HTTP 202 May 28 13:00:59 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1015/1992] 10.27.203.238 () {64 vars in 1454 bytes} [Tue May 28 13:00:59 2024] DELETE /share/v2/284d76edec3144579d6fb3f6dbc0dd4e/shares/da80429c-1281-4450-a386-ed0e9d82a3ff => generated 0 bytes in 136 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 13:00:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-25b5704e-02b4-476e-9491-4abb8e7eedf9 None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16f4189b208748b8aa156ef28ced43cc', 'request_id': 'req-25b5704e-02b4-476e-9491-4abb8e7eedf9'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:59 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-f6ba2bdf-21f9-4843-b176-d2efd35a2048 tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] GET http://10.27.203.238/share/v2/284d76edec3144579d6fb3f6dbc0dd4e/shares/da80429c-1281-4450-a386-ed0e9d82a3ff May 28 13:00:59 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-f6ba2bdf-21f9-4843-b176-d2efd35a2048 tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:00:59 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-f6ba2bdf-21f9-4843-b176-d2efd35a2048 tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:00:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-25b5704e-02b4-476e-9491-4abb8e7eedf9 None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16f4189b208748b8aa156ef28ced43cc', 'request_id': 'req-25b5704e-02b4-476e-9491-4abb8e7eedf9'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-25b5704e-02b4-476e-9491-4abb8e7eedf9 None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16f4189b208748b8aa156ef28ced43cc', 'request_id': 'req-25b5704e-02b4-476e-9491-4abb8e7eedf9'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-25b5704e-02b4-476e-9491-4abb8e7eedf9 None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16f4189b208748b8aa156ef28ced43cc', 'request_id': 'req-25b5704e-02b4-476e-9491-4abb8e7eedf9'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:00:59 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1503/2977] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 13:00:59 2024] DELETE /identity/v3/users/16f4189b208748b8aa156ef28ced43cc => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:00:59 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-f6ba2bdf-21f9-4843-b176-d2efd35a2048 tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] http://10.27.203.238/share/v2/284d76edec3144579d6fb3f6dbc0dd4e/shares/da80429c-1281-4450-a386-ed0e9d82a3ff returned with HTTP 200 May 28 13:00:59 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 978/1993] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:00:59 2024] GET /share/v2/284d76edec3144579d6fb3f6dbc0dd4e/shares/da80429c-1281-4450-a386-ed0e9d82a3ff => generated 1316 bytes in 28 msecs (HTTP/1.1 200) 6 headers in 232 bytes (2 switches on core 0) May 28 13:00:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9057e31b-6922-428e-911c-965745fb6d42 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:00:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9057e31b-6922-428e-911c-965745fb6d42 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:00:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9057e31b-6922-428e-911c-965745fb6d42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:00:59 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-9057e31b-6922-428e-911c-965745fb6d42 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 13:00:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-9057e31b-6922-428e-911c-965745fb6d42 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 13:00:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-9057e31b-6922-428e-911c-965745fb6d42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:00:59 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1475/2978] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 13:00:59 2024] POST /identity/v3/auth/tokens => generated 2960 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 13:00:59 l75lg1-v1 neutron-server[77618]: DEBUG neutron.wsgi [-] (77618) accepted ('10.27.203.238', 60910) {{(pid=77618) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 13:00:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b5704e-02b4-476e-9491-4abb8e7eedf9 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:00:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-25b5704e-02b4-476e-9491-4abb8e7eedf9 None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:00:59 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-a7b29572-6529-4a7c-b1fa-57b384c3fb7a tempest-ShareTypeAvailabilityZonesTest-364532124 None] Acquiring lock "locked_access_rules_operation_by_share_instance_946d9bf7-603c-4faa-8dbe-2cf88c9c8291" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:00:59 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-a7b29572-6529-4a7c-b1fa-57b384c3fb7a tempest-ShareTypeAvailabilityZonesTest-364532124 None] Lock "locked_access_rules_operation_by_share_instance_946d9bf7-603c-4faa-8dbe-2cf88c9c8291" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:00:59 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-a7b29572-6529-4a7c-b1fa-57b384c3fb7a tempest-ShareTypeAvailabilityZonesTest-364532124 None] Lock "locked_access_rules_operation_by_share_instance_946d9bf7-603c-4faa-8dbe-2cf88c9c8291" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.004s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:00:59 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-a7b29572-6529-4a7c-b1fa-57b384c3fb7a tempest-ShareTypeAvailabilityZonesTest-364532124 None] Acquiring lock "locked_access_rules_operation_by_share_instance_946d9bf7-603c-4faa-8dbe-2cf88c9c8291" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:00:59 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-a7b29572-6529-4a7c-b1fa-57b384c3fb7a tempest-ShareTypeAvailabilityZonesTest-364532124 None] Lock "locked_access_rules_operation_by_share_instance_946d9bf7-603c-4faa-8dbe-2cf88c9c8291" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:00:59 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-a7b29572-6529-4a7c-b1fa-57b384c3fb7a tempest-ShareTypeAvailabilityZonesTest-364532124 None] Lock "locked_access_rules_operation_by_share_instance_946d9bf7-603c-4faa-8dbe-2cf88c9c8291" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:00:59 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-a7b29572-6529-4a7c-b1fa-57b384c3fb7a tempest-ShareTypeAvailabilityZonesTest-364532124 None] Acquiring lock "locked_access_rules_operation_by_share_instance_946d9bf7-603c-4faa-8dbe-2cf88c9c8291" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:00:59 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-a7b29572-6529-4a7c-b1fa-57b384c3fb7a tempest-ShareTypeAvailabilityZonesTest-364532124 None] Lock "locked_access_rules_operation_by_share_instance_946d9bf7-603c-4faa-8dbe-2cf88c9c8291" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:00:59 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-a7b29572-6529-4a7c-b1fa-57b384c3fb7a tempest-ShareTypeAvailabilityZonesTest-364532124 None] Lock "locked_access_rules_operation_by_share_instance_946d9bf7-603c-4faa-8dbe-2cf88c9c8291" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:00:59 l75lg1-v1 manila-share[98474]: DEBUG manila.share.access [None req-a7b29572-6529-4a7c-b1fa-57b384c3fb7a tempest-ShareTypeAvailabilityZonesTest-364532124 None] All access rules have been synced for share instance 946d9bf7-603c-4faa-8dbe-2cf88c9c8291 belonging to share da80429c-1281-4450-a386-ed0e9d82a3ff. {{(pid=98474) update_access_rules /opt/stack/manila/manila/share/access.py:304}} May 28 13:00:59 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-a7b29572-6529-4a7c-b1fa-57b384c3fb7a tempest-ShareTypeAvailabilityZonesTest-364532124 None] deleting '/manila/manila-946d9bf7-603c-4faa-8dbe-2cf88c9c8291' May 28 13:00:59 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a7b29572-6529-4a7c-b1fa-57b384c3fb7a tempest-ShareTypeAvailabilityZonesTest-364532124 None] >>> [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/ May 28 13:00:59 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a7b29572-6529-4a7c-b1fa-57b384c3fb7a tempest-ShareTypeAvailabilityZonesTest-364532124 None] {'data': '{"path": "/manila/manila-946d9bf7-603c-4faa-8dbe-2cf88c9c8291"}', May 28 13:00:59 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a7b29572-6529-4a7c-b1fa-57b384c3fb7a tempest-ShareTypeAvailabilityZonesTest-364532124 None] 'params': None} May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b5704e-02b4-476e-9491-4abb8e7eedf9 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2158943-afb1-45bf-8375-33435c32a896 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef17047035e4b518fd5360a01f2da1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2158943-afb1-45bf-8375-33435c32a896 service neutron] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2158943-afb1-45bf-8375-33435c32a896 service neutron] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2158943-afb1-45bf-8375-33435c32a896 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2158943-afb1-45bf-8375-33435c32a896 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2158943-afb1-45bf-8375-33435c32a896 service neutron] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1504/2979] 10.27.203.238 () {64 vars in 1432 bytes} [Tue May 28 13:00:59 2024] GET /identity/v3/auth/tokens => generated 2960 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 28 13:01:00 l75lg1-v1 neutron-server[77618]: INFO neutron.wsgi [None req-7bbed064-8f4f-4e39-a01a-56a12ca0c817 None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=c7a348e5c74641978595dc43c2dcb08a&name=default HTTP/1.1" status: 200 len: 216 time: 0.0759819 May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9057e31b-6922-428e-911c-965745fb6d42 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-9057e31b-6922-428e-911c-965745fb6d42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9057e31b-6922-428e-911c-965745fb6d42 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ed0f83-83f3-4e58-a648-51fc45b22a58 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ed0f83-83f3-4e58-a648-51fc45b22a58 None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ed0f83-83f3-4e58-a648-51fc45b22a58 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ed0f83-83f3-4e58-a648-51fc45b22a58 None admin] PATH_INFO: `/v3/projects/c7a348e5c74641978595dc43c2dcb08a` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ed0f83-83f3-4e58-a648-51fc45b22a58 None admin] RBAC: Authorizing `identity:delete_project(project_id=c7a348e5c74641978595dc43c2dcb08a)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ed0f83-83f3-4e58-a648-51fc45b22a58 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:00 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a7b29572-6529-4a7c-b1fa-57b384c3fb7a tempest-ShareTypeAvailabilityZonesTest-364532124 None] <<< [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/ May 28 13:01:00 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a7b29572-6529-4a7c-b1fa-57b384c3fb7a tempest-ShareTypeAvailabilityZonesTest-364532124 None] 'OK' May 28 13:01:00 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a7b29572-6529-4a7c-b1fa-57b384c3fb7a tempest-ShareTypeAvailabilityZonesTest-364532124 None] --- [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/: Done May 28 13:01:00 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a7b29572-6529-4a7c-b1fa-57b384c3fb7a tempest-ShareTypeAvailabilityZonesTest-364532124 None] >>> [GET] https://127.0.0.1:40443/api/views/ May 28 13:01:00 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a7b29572-6529-4a7c-b1fa-57b384c3fb7a tempest-ShareTypeAvailabilityZonesTest-364532124 None] {'allow_redirects': True, May 28 13:01:00 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a7b29572-6529-4a7c-b1fa-57b384c3fb7a tempest-ShareTypeAvailabilityZonesTest-364532124 None] 'params': {'name': '946d9bf7-603c-4faa-8dbe-2cf88c9c8291'}} May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-d0ed0f83-83f3-4e58-a648-51fc45b22a58 None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7a348e5c74641978595dc43c2dcb08a', 'request_id': 'req-d0ed0f83-83f3-4e58-a648-51fc45b22a58'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-d0ed0f83-83f3-4e58-a648-51fc45b22a58 None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7a348e5c74641978595dc43c2dcb08a', 'request_id': 'req-d0ed0f83-83f3-4e58-a648-51fc45b22a58'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-d0ed0f83-83f3-4e58-a648-51fc45b22a58 None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7a348e5c74641978595dc43c2dcb08a', 'request_id': 'req-d0ed0f83-83f3-4e58-a648-51fc45b22a58'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-d0ed0f83-83f3-4e58-a648-51fc45b22a58 None admin] The token cache is being invalidate because project c7a348e5c74641978595dc43c2dcb08a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-d0ed0f83-83f3-4e58-a648-51fc45b22a58 None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-d0ed0f83-83f3-4e58-a648-51fc45b22a58 None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1476/2980] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 13:01:00 2024] DELETE /identity/v3/projects/c7a348e5c74641978595dc43c2dcb08a => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:01:00 l75lg1-v1 neutron-server[77619]: DEBUG neutron.wsgi [-] (77619) accepted ('10.27.203.238', 60914) {{(pid=77619) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 13:01:00 l75lg1-v1 neutron-server[77619]: INFO neutron.wsgi [None req-13e0cb04-e455-4e3e-b451-7d904357e85d None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=cac556dc39a14bbdbdbabfc80672fb1f&name=default HTTP/1.1" status: 200 len: 216 time: 0.0094593 May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2158943-afb1-45bf-8375-33435c32a896 service neutron] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2158943-afb1-45bf-8375-33435c32a896 service neutron] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f290d69-2136-43c4-99c2-626fd92d4b87 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f290d69-2136-43c4-99c2-626fd92d4b87 None admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f290d69-2136-43c4-99c2-626fd92d4b87 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f290d69-2136-43c4-99c2-626fd92d4b87 None admin] PATH_INFO: `/v3/projects/cac556dc39a14bbdbdbabfc80672fb1f` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f290d69-2136-43c4-99c2-626fd92d4b87 None admin] RBAC: Authorizing `identity:delete_project(project_id=cac556dc39a14bbdbdbabfc80672fb1f)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f290d69-2136-43c4-99c2-626fd92d4b87 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-0f290d69-2136-43c4-99c2-626fd92d4b87 None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cac556dc39a14bbdbdbabfc80672fb1f', 'request_id': 'req-0f290d69-2136-43c4-99c2-626fd92d4b87'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-0f290d69-2136-43c4-99c2-626fd92d4b87 None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cac556dc39a14bbdbdbabfc80672fb1f', 'request_id': 'req-0f290d69-2136-43c4-99c2-626fd92d4b87'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-0f290d69-2136-43c4-99c2-626fd92d4b87 None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cac556dc39a14bbdbdbabfc80672fb1f', 'request_id': 'req-0f290d69-2136-43c4-99c2-626fd92d4b87'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:00 l75lg1-v1 dstat.sh[49771]: 28-05 13:01:00| 13 1 83 3 0|5696M 1748M 278M 7902M| 21k 2746B| 0 1996k| 0 311 |7652 13k|1.74 1.25 1.08|1.0 3.0 0| 0 0 | 0 2048M| 29 362 0 29 2 May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-0f290d69-2136-43c4-99c2-626fd92d4b87 None admin] The token cache is being invalidate because project cac556dc39a14bbdbdbabfc80672fb1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-0f290d69-2136-43c4-99c2-626fd92d4b87 None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-0f290d69-2136-43c4-99c2-626fd92d4b87 None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1505/2981] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 13:01:00 2024] DELETE /identity/v3/projects/cac556dc39a14bbdbdbabfc80672fb1f => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:01:00 l75lg1-v1 neutron-server[77619]: DEBUG neutron.wsgi [-] (77619) accepted ('10.27.203.238', 49800) {{(pid=77619) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 13:01:00 l75lg1-v1 neutron-server[77619]: INFO neutron.wsgi [None req-b49714a8-7af4-45d1-9677-6ccdc28f3f71 None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=b26e2f4af8614f3ea1f0aba07abd852c&name=default HTTP/1.1" status: 200 len: 216 time: 0.0083559 May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ed0f83-83f3-4e58-a648-51fc45b22a58 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-d0ed0f83-83f3-4e58-a648-51fc45b22a58 None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ed0f83-83f3-4e58-a648-51fc45b22a58 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37c5725-b25b-48f3-86ba-389947dfb4c6 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37c5725-b25b-48f3-86ba-389947dfb4c6 None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37c5725-b25b-48f3-86ba-389947dfb4c6 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37c5725-b25b-48f3-86ba-389947dfb4c6 None admin] PATH_INFO: `/v3/projects/b26e2f4af8614f3ea1f0aba07abd852c` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37c5725-b25b-48f3-86ba-389947dfb4c6 None admin] RBAC: Authorizing `identity:delete_project(project_id=b26e2f4af8614f3ea1f0aba07abd852c)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37c5725-b25b-48f3-86ba-389947dfb4c6 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:00 l75lg1-v1 neutron-server[77618]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.HashRingHealthCheckPeriodics.touch_hash_ring_nodes' {{(pid=77618) _process_scheduled /opt/stack/data/venv/lib/python3.10/site-packages/futurist/periodics.py:638}} May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-d37c5725-b25b-48f3-86ba-389947dfb4c6 None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b26e2f4af8614f3ea1f0aba07abd852c', 'request_id': 'req-d37c5725-b25b-48f3-86ba-389947dfb4c6'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-d37c5725-b25b-48f3-86ba-389947dfb4c6 None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b26e2f4af8614f3ea1f0aba07abd852c', 'request_id': 'req-d37c5725-b25b-48f3-86ba-389947dfb4c6'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-d37c5725-b25b-48f3-86ba-389947dfb4c6 None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b26e2f4af8614f3ea1f0aba07abd852c', 'request_id': 'req-d37c5725-b25b-48f3-86ba-389947dfb4c6'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-d37c5725-b25b-48f3-86ba-389947dfb4c6 None admin] The token cache is being invalidate because project b26e2f4af8614f3ea1f0aba07abd852c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-d37c5725-b25b-48f3-86ba-389947dfb4c6 None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-d37c5725-b25b-48f3-86ba-389947dfb4c6 None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1477/2982] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 13:01:00 2024] DELETE /identity/v3/projects/b26e2f4af8614f3ea1f0aba07abd852c => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b2eed6-66d0-417c-9197-334ce2efe349 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b2eed6-66d0-417c-9197-334ce2efe349 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b2eed6-66d0-417c-9197-334ce2efe349 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-f89937ad-7d6a-4471-9fe8-b954ea3c3b7e tempest-ShareRulesNegativeTest-930400775 tempest-ShareRulesNegativeTest-930400775-project-member] GET http://10.27.203.238/share/v2/329a14ab984146feb9f91e467ab4e3b5/snapshots/98f3b924-cebf-46a4-9429-7f55792a0941 May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-f89937ad-7d6a-4471-9fe8-b954ea3c3b7e tempest-ShareRulesNegativeTest-930400775 tempest-ShareRulesNegativeTest-930400775-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-f89937ad-7d6a-4471-9fe8-b954ea3c3b7e tempest-ShareRulesNegativeTest-930400775 tempest-ShareRulesNegativeTest-930400775-project-member] Calling method 'ShareSnapshotMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-f9b2eed6-66d0-417c-9197-334ce2efe349 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-f9b2eed6-66d0-417c-9197-334ce2efe349 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-f9b2eed6-66d0-417c-9197-334ce2efe349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1506/2983] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 13:01:00 2024] POST /identity/v3/auth/tokens => generated 312 bytes in 18 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea8efe1-75a3-413c-a82a-32ac9017dea1 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea8efe1-75a3-413c-a82a-32ac9017dea1 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea8efe1-75a3-413c-a82a-32ac9017dea1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-6ea8efe1-75a3-413c-a82a-32ac9017dea1 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-f89937ad-7d6a-4471-9fe8-b954ea3c3b7e tempest-ShareRulesNegativeTest-930400775 tempest-ShareRulesNegativeTest-930400775-project-member] http://10.27.203.238/share/v2/329a14ab984146feb9f91e467ab4e3b5/snapshots/98f3b924-cebf-46a4-9429-7f55792a0941 returned with HTTP 200 May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1016/1994] 10.27.203.238 () {64 vars in 1460 bytes} [Tue May 28 13:01:00 2024] GET /share/v2/329a14ab984146feb9f91e467ab4e3b5/snapshots/98f3b924-cebf-46a4-9429-7f55792a0941 => generated 723 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-6ea8efe1-75a3-413c-a82a-32ac9017dea1 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-6ea8efe1-75a3-413c-a82a-32ac9017dea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-61198afa-c7be-4525-9c31-c181379d9798 tempest-ShareRulesNegativeTest-930400775 tempest-ShareRulesNegativeTest-930400775-project-member] POST http://10.27.203.238/share/v1/329a14ab984146feb9f91e467ab4e3b5/shares/98f3b924-cebf-46a4-9429-7f55792a0941/action May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-61198afa-c7be-4525-9c31-c181379d9798 tempest-ShareRulesNegativeTest-930400775 tempest-ShareRulesNegativeTest-930400775-project-member] Action body: b'{"os-allow_access": {"access_type": "ip", "access_to": "0.0.0.0", "access_level": null}}' {{(pid=98330) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-61198afa-c7be-4525-9c31-c181379d9798 tempest-ShareRulesNegativeTest-930400775 tempest-ShareRulesNegativeTest-930400775-project-member] Action: 'action', calling method: ShareController.allow_access, body: {"os-allow_access": {"access_type": "ip", "access_to": "0.0.0.0", "access_level": null}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault [None req-61198afa-c7be-4525-9c31-c181379d9798 tempest-ShareRulesNegativeTest-930400775 tempest-ShareRulesNegativeTest-930400775-project-member] Caught error: Resource could not be found.: manila.exception.NotFound: Resource could not be found. May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault Traceback (most recent call last): May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/api/middleware/fault.py", line 76, in __call__ May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return req.get_response(self.application) May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/request.py", line 1313, in send May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault status, headers, app_iter = self.call_application( May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/request.py", line 1278, in call_application May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault app_iter = application(self.environ, start_response) May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 129, in __call__ May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault resp = self.call_func(req, *args, **kw) May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 193, in call_func May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return self.func(req, *args, **kwargs) May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_middleware/base.py", line 124, in __call__ May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault response = req.get_response(self.application) May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/request.py", line 1313, in send May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault status, headers, app_iter = self.call_application( May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/request.py", line 1278, in call_application May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault app_iter = application(self.environ, start_response) May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 143, in __call__ May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return resp(environ, start_response) May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 129, in __call__ May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault resp = self.call_func(req, *args, **kw) May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 193, in call_func May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return self.func(req, *args, **kwargs) May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/osprofiler/web.py", line 111, in __call__ May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return request.get_response(self.application) May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/request.py", line 1313, in send May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault status, headers, app_iter = self.call_application( May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/request.py", line 1278, in call_application May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault app_iter = application(self.environ, start_response) May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 129, in __call__ May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault resp = self.call_func(req, *args, **kw) May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 193, in call_func May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return self.func(req, *args, **kwargs) May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py", line 340, in __call__ May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault response = req.get_response(self._app) May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/request.py", line 1313, in send May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault status, headers, app_iter = self.call_application( May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/request.py", line 1278, in call_application May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault app_iter = application(self.environ, start_response) May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 143, in __call__ May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return resp(environ, start_response) May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 143, in __call__ May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return resp(environ, start_response) May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/routes/middleware.py", line 153, in __call__ May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault response = self.app(environ, start_response) May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 143, in __call__ May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return resp(environ, start_response) May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 129, in __call__ May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault resp = self.call_func(req, *args, **kw) May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 193, in call_func May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return self.func(req, *args, **kwargs) May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/api/openstack/wsgi.py", line 764, in __call__ May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return self._process_stack(request, action, action_args, May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/api/openstack/wsgi.py", line 829, in _process_stack May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault action_result = self.dispatch(meth, request, action_args) May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/api/openstack/wsgi.py", line 924, in dispatch May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return method(req=request, **action_args) May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/api/v1/shares.py", line 777, in allow_access May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return self._allow_access(req, id, body) May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/api/openstack/wsgi.py", line 1160, in wrapper May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return f(self, req, *args, **kwargs) May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/api/v1/shares.py", line 529, in _allow_access May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault share = self.share_api.get(context, id) May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/share/api.py", line 2211, in get May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault rv = self.db.share_get(context, share_id) May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/db/api.py", line 404, in share_get May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return IMPL.share_get(context, share_id, **kwargs) May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/db/sqlalchemy/api.py", line 166, in wrapper May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return f(*args, **kwargs) May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/enginefacade.py", line 998, in wrapper May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return fn(*args, **kwargs) May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/db/sqlalchemy/api.py", line 2367, in share_get May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return _share_get(context, share_id, **kwargs) May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/db/sqlalchemy/api.py", line 2378, in _share_get May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault raise exception.NotFound() May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault manila.exception.NotFound: Resource could not be found. May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.middleware.fault [None req-61198afa-c7be-4525-9c31-c181379d9798 tempest-ShareRulesNegativeTest-930400775 tempest-ShareRulesNegativeTest-930400775-project-member] http://10.27.203.238/share/v1/329a14ab984146feb9f91e467ab4e3b5/shares/98f3b924-cebf-46a4-9429-7f55792a0941/action returned with HTTP 404 May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 979/1995] 10.27.203.238 () {64 vars in 1450 bytes} [Tue May 28 13:01:00 2024] POST /share/v1/329a14ab984146feb9f91e467ab4e3b5/shares/98f3b924-cebf-46a4-9429-7f55792a0941/action => generated 84 bytes in 11 msecs (HTTP/1.1 404) 6 headers in 236 bytes (1 switches on core 0) May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-b981f673-ac69-4c0f-9ce1-4a7812ab7ade tempest-ShareRulesNegativeTest-930400775 tempest-ShareRulesNegativeTest-930400775-project-member] POST http://10.27.203.238/share/v2/329a14ab984146feb9f91e467ab4e3b5/shares/98f3b924-cebf-46a4-9429-7f55792a0941/action May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-b981f673-ac69-4c0f-9ce1-4a7812ab7ade tempest-ShareRulesNegativeTest-930400775 tempest-ShareRulesNegativeTest-930400775-project-member] Action body: b'{"allow_access": {"access_type": "ip", "access_to": "0.0.0.0", "access_level": null}}' {{(pid=98329) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-b981f673-ac69-4c0f-9ce1-4a7812ab7ade tempest-ShareRulesNegativeTest-930400775 tempest-ShareRulesNegativeTest-930400775-project-member] Action: 'action', calling method: ShareController.allow_access, body: {"allow_access": {"access_type": "ip", "access_to": "0.0.0.0", "access_level": null}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault [None req-b981f673-ac69-4c0f-9ce1-4a7812ab7ade tempest-ShareRulesNegativeTest-930400775 tempest-ShareRulesNegativeTest-930400775-project-member] Caught error: Resource could not be found.: manila.exception.NotFound: Resource could not be found. May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault Traceback (most recent call last): May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/api/middleware/fault.py", line 76, in __call__ May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault return req.get_response(self.application) May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/request.py", line 1313, in send May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault status, headers, app_iter = self.call_application( May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/request.py", line 1278, in call_application May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault app_iter = application(self.environ, start_response) May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 129, in __call__ May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault resp = self.call_func(req, *args, **kw) May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 193, in call_func May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault return self.func(req, *args, **kwargs) May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_middleware/base.py", line 124, in __call__ May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault response = req.get_response(self.application) May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/request.py", line 1313, in send May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault status, headers, app_iter = self.call_application( May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/request.py", line 1278, in call_application May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault app_iter = application(self.environ, start_response) May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 143, in __call__ May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault return resp(environ, start_response) May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 129, in __call__ May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault resp = self.call_func(req, *args, **kw) May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 193, in call_func May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault return self.func(req, *args, **kwargs) May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/osprofiler/web.py", line 111, in __call__ May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault return request.get_response(self.application) May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/request.py", line 1313, in send May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault status, headers, app_iter = self.call_application( May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/request.py", line 1278, in call_application May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault app_iter = application(self.environ, start_response) May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 129, in __call__ May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault resp = self.call_func(req, *args, **kw) May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 193, in call_func May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault return self.func(req, *args, **kwargs) May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py", line 340, in __call__ May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault response = req.get_response(self._app) May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/request.py", line 1313, in send May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault status, headers, app_iter = self.call_application( May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/request.py", line 1278, in call_application May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault app_iter = application(self.environ, start_response) May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 143, in __call__ May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault return resp(environ, start_response) May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 143, in __call__ May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault return resp(environ, start_response) May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/routes/middleware.py", line 153, in __call__ May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault response = self.app(environ, start_response) May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 143, in __call__ May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault return resp(environ, start_response) May 28 13:01:00 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a7b29572-6529-4a7c-b1fa-57b384c3fb7a tempest-ShareTypeAvailabilityZonesTest-364532124 None] <<< [GET] https://127.0.0.1:40443/api/views/ May 28 13:01:00 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a7b29572-6529-4a7c-b1fa-57b384c3fb7a tempest-ShareTypeAvailabilityZonesTest-364532124 None] [Bunch(abac_tags=[], abe_max_depth=None, abe_protocols=[], alias='', allow_anonymous_access=False, allow_s3_anonymous_access=False, auto_commit='0d', bucket='', bucket_creators=[], bucket_creators_groups=[], bucket_owner=None, bulk_permission_update_progress=None, bulk_permission_update_state=None, cluster='loop75-kfs', cluster_id=1, created='2024-05-28T13:00:42.880677Z', enabled=True, files_retention_mode='NONE', guid='f572bdb3-4b85-4d7e-91da-53af8011e5e8', id=44, ignore_oos=False, internal=False, is_remote=False, is_seamless=False, logical_capacity=0, max_retention_period=None, min_retention_period=None, name='946d9bf7-603c-4faa-8dbe-2cf88c9c8291', nfs_interop_flags='BOTH_NFS3_AND_NFS4_INTEROP_DISABLED', path='/manila/manila-946d9bf7-603c-4faa-8dbe-2cf88c9c8291', physical_capacity=0, policy='946d9bf7-603c-4faa-8dbe-2cf88c9c8291', policy_id=45, protocols=['NFS'], qos_policy=None, qos_policy_id=None, s3_locks=False, s3_locks_retention_mode='NONE', s3_locks_retention_period='', s3_unverified_lookup=False, s3_versioning=False, select_for_live_monitoring=False, share='', share_acl=Bunch(acl=[], enabled=False), sync='SYNCED', sync_time='2024-05-28T13:00:43.176101Z', tenant_id=1, tenant_name='default', title='/manila/manila-946d9bf7-603c-4faa-8dbe-2cf88c9c8291', url='https://127.0.0.1:40443/api/views/44/')] May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 129, in __call__ May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault resp = self.call_func(req, *args, **kw) May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 193, in call_func May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault return self.func(req, *args, **kwargs) May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/api/openstack/wsgi.py", line 764, in __call__ May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault return self._process_stack(request, action, action_args, May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/api/openstack/wsgi.py", line 829, in _process_stack May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault action_result = self.dispatch(meth, request, action_args) May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/api/openstack/wsgi.py", line 924, in dispatch May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault return method(req=request, **action_args) May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/api/openstack/wsgi.py", line 1066, in version_select May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault return func.func(self, *args, **kwargs) May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/api/v2/shares.py", line 495, in allow_access May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault return self._allow_access(*args, **kwargs) May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/api/openstack/wsgi.py", line 1160, in wrapper May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault return f(self, req, *args, **kwargs) May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/api/v1/shares.py", line 529, in _allow_access May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault share = self.share_api.get(context, id) May 28 13:01:00 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a7b29572-6529-4a7c-b1fa-57b384c3fb7a tempest-ShareTypeAvailabilityZonesTest-364532124 None] --- [GET] https://127.0.0.1:40443/api/views/: Done May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/share/api.py", line 2211, in get May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault rv = self.db.share_get(context, share_id) May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/db/api.py", line 404, in share_get May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault return IMPL.share_get(context, share_id, **kwargs) May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/db/sqlalchemy/api.py", line 166, in wrapper May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault return f(*args, **kwargs) May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/enginefacade.py", line 998, in wrapper May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault return fn(*args, **kwargs) May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/db/sqlalchemy/api.py", line 2367, in share_get May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault return _share_get(context, share_id, **kwargs) May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/db/sqlalchemy/api.py", line 2378, in _share_get May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault raise exception.NotFound() May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault manila.exception.NotFound: Resource could not be found. May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.middleware.fault [None req-b981f673-ac69-4c0f-9ce1-4a7812ab7ade tempest-ShareRulesNegativeTest-930400775 tempest-ShareRulesNegativeTest-930400775-project-member] http://10.27.203.238/share/v2/329a14ab984146feb9f91e467ab4e3b5/shares/98f3b924-cebf-46a4-9429-7f55792a0941/action returned with HTTP 404 May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1017/1996] 10.27.203.238 () {66 vars in 1493 bytes} [Tue May 28 13:01:00 2024] POST /share/v2/329a14ab984146feb9f91e467ab4e3b5/shares/98f3b924-cebf-46a4-9429-7f55792a0941/action => generated 84 bytes in 12 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 13:01:00 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a7b29572-6529-4a7c-b1fa-57b384c3fb7a tempest-ShareTypeAvailabilityZonesTest-364532124 None] >>> [DELETE] https://127.0.0.1:40443/api/views/44/ May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1478/2984] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 13:01:00 2024] POST /identity/v3/auth/tokens => generated 2960 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-a259993f-fcd7-478b-9e6f-9c743eb04a32 tempest-ShareRulesNegativeTest-930400775 tempest-ShareRulesNegativeTest-930400775-project-member] POST http://10.27.203.238/share/v1/329a14ab984146feb9f91e467ab4e3b5/shares/623ccf6c-1398-4ab6-9f67-73e600565f38/action May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-a259993f-fcd7-478b-9e6f-9c743eb04a32 tempest-ShareRulesNegativeTest-930400775 tempest-ShareRulesNegativeTest-930400775-project-member] Action body: b'{"os-allow_access": {"access_type": "wrong_type", "access_to": "1.2.3.4", "access_level": null}}' {{(pid=98330) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-a259993f-fcd7-478b-9e6f-9c743eb04a32 tempest-ShareRulesNegativeTest-930400775 tempest-ShareRulesNegativeTest-930400775-project-member] Action: 'action', calling method: ShareController.allow_access, body: {"os-allow_access": {"access_type": "wrong_type", "access_to": "1.2.3.4", "access_level": null}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b2eed6-66d0-417c-9197-334ce2efe349 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b2eed6-66d0-417c-9197-334ce2efe349 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c270461c-236c-4c04-a918-233125fdfd9e None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c270461c-236c-4c04-a918-233125fdfd9e None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c270461c-236c-4c04-a918-233125fdfd9e None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c270461c-236c-4c04-a918-233125fdfd9e None admin] PATH_INFO: `/v3/domains` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c270461c-236c-4c04-a918-233125fdfd9e None admin] RBAC: Adding query filter params (name=Default) {{(pid=51267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c270461c-236c-4c04-a918-233125fdfd9e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c270461c-236c-4c04-a918-233125fdfd9e None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-a259993f-fcd7-478b-9e6f-9c743eb04a32 tempest-ShareRulesNegativeTest-930400775 tempest-ShareRulesNegativeTest-930400775-project-member] HTTP exception thrown: Only 'ip', 'user' or 'cert' access types are supported. May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-a259993f-fcd7-478b-9e6f-9c743eb04a32 tempest-ShareRulesNegativeTest-930400775 tempest-ShareRulesNegativeTest-930400775-project-member] http://10.27.203.238/share/v1/329a14ab984146feb9f91e467ab4e3b5/shares/623ccf6c-1398-4ab6-9f67-73e600565f38/action returned with HTTP 400 May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 980/1997] 10.27.203.238 () {64 vars in 1450 bytes} [Tue May 28 13:01:00 2024] POST /share/v1/329a14ab984146feb9f91e467ab4e3b5/shares/623ccf6c-1398-4ab6-9f67-73e600565f38/action => generated 99 bytes in 26 msecs (HTTP/1.1 400) 6 headers in 238 bytes (1 switches on core 0) May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1507/2985] 10.27.203.238 () {62 vars in 1220 bytes} [Tue May 28 13:01:00 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea8efe1-75a3-413c-a82a-32ac9017dea1 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-3dc64405-3ed6-4a23-8846-6a6dad2ebf36 tempest-ShareRulesNegativeTest-930400775 tempest-ShareRulesNegativeTest-930400775-project-member] POST http://10.27.203.238/share/v2/329a14ab984146feb9f91e467ab4e3b5/shares/623ccf6c-1398-4ab6-9f67-73e600565f38/action May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-3dc64405-3ed6-4a23-8846-6a6dad2ebf36 tempest-ShareRulesNegativeTest-930400775 tempest-ShareRulesNegativeTest-930400775-project-member] Action body: b'{"allow_access": {"access_type": "wrong_type", "access_to": "1.2.3.4", "access_level": null}}' {{(pid=98329) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-3dc64405-3ed6-4a23-8846-6a6dad2ebf36 tempest-ShareRulesNegativeTest-930400775 tempest-ShareRulesNegativeTest-930400775-project-member] Action: 'action', calling method: ShareController.allow_access, body: {"allow_access": {"access_type": "wrong_type", "access_to": "1.2.3.4", "access_level": null}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea8efe1-75a3-413c-a82a-32ac9017dea1 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c3f3aa-a5e5-4845-8c19-577b4c8edb94 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c3f3aa-a5e5-4845-8c19-577b4c8edb94 None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c3f3aa-a5e5-4845-8c19-577b4c8edb94 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c3f3aa-a5e5-4845-8c19-577b4c8edb94 None admin] PATH_INFO: `/v3/projects` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c3f3aa-a5e5-4845-8c19-577b4c8edb94 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c3f3aa-a5e5-4845-8c19-577b4c8edb94 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-3dc64405-3ed6-4a23-8846-6a6dad2ebf36 tempest-ShareRulesNegativeTest-930400775 tempest-ShareRulesNegativeTest-930400775-project-member] HTTP exception thrown: Only 'ip', 'user', 'cert' or 'cephx' access types are supported. May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-3dc64405-3ed6-4a23-8846-6a6dad2ebf36 tempest-ShareRulesNegativeTest-930400775 tempest-ShareRulesNegativeTest-930400775-project-member] http://10.27.203.238/share/v2/329a14ab984146feb9f91e467ab4e3b5/shares/623ccf6c-1398-4ab6-9f67-73e600565f38/action returned with HTTP 400 May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1018/1998] 10.27.203.238 () {66 vars in 1493 bytes} [Tue May 28 13:01:00 2024] POST /share/v2/329a14ab984146feb9f91e467ab4e3b5/shares/623ccf6c-1398-4ab6-9f67-73e600565f38/action => generated 108 bytes in 27 msecs (HTTP/1.1 400) 6 headers in 240 bytes (1 switches on core 0) May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-f7a19fa3-4209-44a6-a042-e401b4266158 tempest-ShareRulesNegativeTest-930400775 tempest-ShareRulesNegativeTest-930400775-project-member] POST http://10.27.203.238/share/v1/329a14ab984146feb9f91e467ab4e3b5/shares/623ccf6c-1398-4ab6-9f67-73e600565f38/action May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-f7a19fa3-4209-44a6-a042-e401b4266158 tempest-ShareRulesNegativeTest-930400775 tempest-ShareRulesNegativeTest-930400775-project-member] Action body: b'{"os-deny_access": {"access_id": "wrong_rule_id"}}' {{(pid=98330) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-f7a19fa3-4209-44a6-a042-e401b4266158 tempest-ShareRulesNegativeTest-930400775 tempest-ShareRulesNegativeTest-930400775-project-member] Action: 'action', calling method: ShareController.deny_access, body: {"os-deny_access": {"access_id": "wrong_rule_id"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.lock.api [None req-f7a19fa3-4209-44a6-a042-e401b4266158 tempest-ShareRulesNegativeTest-930400775 tempest-ShareRulesNegativeTest-930400775-project-member] Searching for locks by: {'resource_id': 'wrong_rule_id', 'resource_action': 'delete'} {{(pid=98330) get_all /opt/stack/manila/manila/lock/api.py:112}} May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1479/2986] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 13:01:00 2024] POST /identity/v3/projects => generated 363 bytes in 35 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c270461c-236c-4c04-a918-233125fdfd9e None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c270461c-236c-4c04-a918-233125fdfd9e None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-f7a19fa3-4209-44a6-a042-e401b4266158 tempest-ShareRulesNegativeTest-930400775 tempest-ShareRulesNegativeTest-930400775-project-member] HTTP exception thrown: Resource could not be found. May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-f7a19fa3-4209-44a6-a042-e401b4266158 tempest-ShareRulesNegativeTest-930400775 tempest-ShareRulesNegativeTest-930400775-project-member] http://10.27.203.238/share/v1/329a14ab984146feb9f91e467ab4e3b5/shares/623ccf6c-1398-4ab6-9f67-73e600565f38/action returned with HTTP 404 May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 981/1999] 10.27.203.238 () {64 vars in 1450 bytes} [Tue May 28 13:01:00 2024] POST /share/v1/329a14ab984146feb9f91e467ab4e3b5/shares/623ccf6c-1398-4ab6-9f67-73e600565f38/action => generated 74 bytes in 33 msecs (HTTP/1.1 404) 6 headers in 236 bytes (1 switches on core 0) May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39a5420-c357-4d5c-a961-306e3ee41fed None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39a5420-c357-4d5c-a961-306e3ee41fed None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-a9d72856-ff16-48df-8a55-68886aca5cde tempest-ShareRulesNegativeTest-930400775 tempest-ShareRulesNegativeTest-930400775-project-member] POST http://10.27.203.238/share/v2/329a14ab984146feb9f91e467ab4e3b5/shares/623ccf6c-1398-4ab6-9f67-73e600565f38/action May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39a5420-c357-4d5c-a961-306e3ee41fed None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-a9d72856-ff16-48df-8a55-68886aca5cde tempest-ShareRulesNegativeTest-930400775 tempest-ShareRulesNegativeTest-930400775-project-member] Action body: b'{"deny_access": {"access_id": "wrong_rule_id"}}' {{(pid=98329) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-a9d72856-ff16-48df-8a55-68886aca5cde tempest-ShareRulesNegativeTest-930400775 tempest-ShareRulesNegativeTest-930400775-project-member] Action: 'action', calling method: ShareController.deny_access, body: {"deny_access": {"access_id": "wrong_rule_id"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39a5420-c357-4d5c-a961-306e3ee41fed None admin] PATH_INFO: `/v3/users` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39a5420-c357-4d5c-a961-306e3ee41fed None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.lock.api [None req-a9d72856-ff16-48df-8a55-68886aca5cde tempest-ShareRulesNegativeTest-930400775 tempest-ShareRulesNegativeTest-930400775-project-member] Searching for locks by: {'resource_id': 'wrong_rule_id', 'resource_action': 'delete'} {{(pid=98329) get_all /opt/stack/manila/manila/lock/api.py:112}} May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39a5420-c357-4d5c-a961-306e3ee41fed None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-e39a5420-c357-4d5c-a961-306e3ee41fed None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-a9d72856-ff16-48df-8a55-68886aca5cde tempest-ShareRulesNegativeTest-930400775 tempest-ShareRulesNegativeTest-930400775-project-member] HTTP exception thrown: Resource could not be found. May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-a9d72856-ff16-48df-8a55-68886aca5cde tempest-ShareRulesNegativeTest-930400775 tempest-ShareRulesNegativeTest-930400775-project-member] http://10.27.203.238/share/v2/329a14ab984146feb9f91e467ab4e3b5/shares/623ccf6c-1398-4ab6-9f67-73e600565f38/action returned with HTTP 404 May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1019/2000] 10.27.203.238 () {66 vars in 1493 bytes} [Tue May 28 13:01:00 2024] POST /share/v2/329a14ab984146feb9f91e467ab4e3b5/shares/623ccf6c-1398-4ab6-9f67-73e600565f38/action => generated 74 bytes in 32 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1508/2987] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 13:01:00 2024] POST /identity/v3/users => generated 290 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c3f3aa-a5e5-4845-8c19-577b4c8edb94 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39a5420-c357-4d5c-a961-306e3ee41fed None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-e39a5420-c357-4d5c-a961-306e3ee41fed None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c3f3aa-a5e5-4845-8c19-577b4c8edb94 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb077c5-5262-4c77-9105-3d1bed634153 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb077c5-5262-4c77-9105-3d1bed634153 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb077c5-5262-4c77-9105-3d1bed634153 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb077c5-5262-4c77-9105-3d1bed634153 None admin] PATH_INFO: `/v3/roles` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb077c5-5262-4c77-9105-3d1bed634153 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb077c5-5262-4c77-9105-3d1bed634153 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1480/2988] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 13:01:00 2024] GET /identity/v3/roles => generated 1680 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb077c5-5262-4c77-9105-3d1bed634153 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb077c5-5262-4c77-9105-3d1bed634153 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa0a2a6-74b7-4377-acaa-91cb4c43d90b None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa0a2a6-74b7-4377-acaa-91cb4c43d90b None admin] REQUEST_METHOD: `PUT` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa0a2a6-74b7-4377-acaa-91cb4c43d90b None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa0a2a6-74b7-4377-acaa-91cb4c43d90b None admin] PATH_INFO: `/v3/projects/0af6f8e0aeed4f27b075e08f2bc713aa/users/2422ad23c6a747059ebfca647c24c460/roles/44620cad10ae407c90c91e2c296adb04` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa0a2a6-74b7-4377-acaa-91cb4c43d90b None admin] RBAC: Authorizing `identity:create_grant(project_id=0af6f8e0aeed4f27b075e08f2bc713aa, user_id=2422ad23c6a747059ebfca647c24c460, role_id=44620cad10ae407c90c91e2c296adb04)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa0a2a6-74b7-4377-acaa-91cb4c43d90b None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39a5420-c357-4d5c-a961-306e3ee41fed None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81302a91-d128-4a99-84c1-f8854d763694 tempest-ShareRulesNegativeTest-1738210631 tempest-ShareRulesNegativeTest-1738210631-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffcac1016e3c4ee3a3ad1b48da439b19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011748bb7e2247e88228bd066607700e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81302a91-d128-4a99-84c1-f8854d763694 tempest-ShareRulesNegativeTest-1738210631 tempest-ShareRulesNegativeTest-1738210631-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81302a91-d128-4a99-84c1-f8854d763694 tempest-ShareRulesNegativeTest-1738210631 tempest-ShareRulesNegativeTest-1738210631-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81302a91-d128-4a99-84c1-f8854d763694 tempest-ShareRulesNegativeTest-1738210631 tempest-ShareRulesNegativeTest-1738210631-project-admin] PATH_INFO: `/v3/users/5000ae7b72ab4d8aad66382d4e873caf` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1481/2989] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 13:01:00 2024] PUT /identity/v3/projects/0af6f8e0aeed4f27b075e08f2bc713aa/users/2422ad23c6a747059ebfca647c24c460/roles/44620cad10ae407c90c91e2c296adb04 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81302a91-d128-4a99-84c1-f8854d763694 tempest-ShareRulesNegativeTest-1738210631 tempest-ShareRulesNegativeTest-1738210631-project-admin] RBAC: Authorizing `identity:delete_user(user_id=5000ae7b72ab4d8aad66382d4e873caf)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81302a91-d128-4a99-84c1-f8854d763694 tempest-ShareRulesNegativeTest-1738210631 tempest-ShareRulesNegativeTest-1738210631-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01134716-fc59-4a38-9604-cf48f82eb13a None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01134716-fc59-4a38-9604-cf48f82eb13a None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01134716-fc59-4a38-9604-cf48f82eb13a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-81302a91-d128-4a99-84c1-f8854d763694 tempest-ShareRulesNegativeTest-1738210631 tempest-ShareRulesNegativeTest-1738210631-project-admin] Could not find user: 5000ae7b72ab4d8aad66382d4e873caf.: keystone.exception.UserNotFound: Could not find user: 5000ae7b72ab4d8aad66382d4e873caf. May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 5000ae7b72ab4d8aad66382d4e873caf. May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1509/2990] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:01:00 2024] DELETE /identity/v3/users/5000ae7b72ab4d8aad66382d4e873caf => generated 110 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81302a91-d128-4a99-84c1-f8854d763694 tempest-ShareRulesNegativeTest-1738210631 tempest-ShareRulesNegativeTest-1738210631-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81302a91-d128-4a99-84c1-f8854d763694 tempest-ShareRulesNegativeTest-1738210631 tempest-ShareRulesNegativeTest-1738210631-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-01134716-fc59-4a38-9604-cf48f82eb13a None None] Truncating password to algorithm specific maximum length 72 characters. May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-01134716-fc59-4a38-9604-cf48f82eb13a None None] MFA Rules not processed for user `2422ad23c6a747059ebfca647c24c460`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-01134716-fc59-4a38-9604-cf48f82eb13a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf947cc-59ce-4479-9dda-9790e2c352e0 tempest-ShareRulesNegativeTest-1738210631 tempest-ShareRulesNegativeTest-1738210631-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffcac1016e3c4ee3a3ad1b48da439b19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011748bb7e2247e88228bd066607700e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf947cc-59ce-4479-9dda-9790e2c352e0 tempest-ShareRulesNegativeTest-1738210631 tempest-ShareRulesNegativeTest-1738210631-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf947cc-59ce-4479-9dda-9790e2c352e0 tempest-ShareRulesNegativeTest-1738210631 tempest-ShareRulesNegativeTest-1738210631-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf947cc-59ce-4479-9dda-9790e2c352e0 tempest-ShareRulesNegativeTest-1738210631 tempest-ShareRulesNegativeTest-1738210631-project-admin] PATH_INFO: `/v3/users/3fc09c87f69946d2bf009e72ac589cd4` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1482/2991] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 13:01:00 2024] POST /identity/v3/auth/tokens => generated 3934 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01134716-fc59-4a38-9604-cf48f82eb13a None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf947cc-59ce-4479-9dda-9790e2c352e0 tempest-ShareRulesNegativeTest-1738210631 tempest-ShareRulesNegativeTest-1738210631-project-admin] RBAC: Authorizing `identity:delete_user(user_id=3fc09c87f69946d2bf009e72ac589cd4)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf947cc-59ce-4479-9dda-9790e2c352e0 tempest-ShareRulesNegativeTest-1738210631 tempest-ShareRulesNegativeTest-1738210631-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-5bf947cc-59ce-4479-9dda-9790e2c352e0 tempest-ShareRulesNegativeTest-1738210631 tempest-ShareRulesNegativeTest-1738210631-project-admin] Could not find user: 3fc09c87f69946d2bf009e72ac589cd4.: keystone.exception.UserNotFound: Could not find user: 3fc09c87f69946d2bf009e72ac589cd4. May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 3fc09c87f69946d2bf009e72ac589cd4. May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1510/2992] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:01:00 2024] DELETE /identity/v3/users/3fc09c87f69946d2bf009e72ac589cd4 => generated 110 bytes in 82 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf947cc-59ce-4479-9dda-9790e2c352e0 tempest-ShareRulesNegativeTest-1738210631 tempest-ShareRulesNegativeTest-1738210631-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf947cc-59ce-4479-9dda-9790e2c352e0 tempest-ShareRulesNegativeTest-1738210631 tempest-ShareRulesNegativeTest-1738210631-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a2af92-9bf1-4f48-81c6-2ff600a8e836 tempest-ShareRulesNegativeTest-1738210631 tempest-ShareRulesNegativeTest-1738210631-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffcac1016e3c4ee3a3ad1b48da439b19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011748bb7e2247e88228bd066607700e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a2af92-9bf1-4f48-81c6-2ff600a8e836 tempest-ShareRulesNegativeTest-1738210631 tempest-ShareRulesNegativeTest-1738210631-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a2af92-9bf1-4f48-81c6-2ff600a8e836 tempest-ShareRulesNegativeTest-1738210631 tempest-ShareRulesNegativeTest-1738210631-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a2af92-9bf1-4f48-81c6-2ff600a8e836 tempest-ShareRulesNegativeTest-1738210631 tempest-ShareRulesNegativeTest-1738210631-project-admin] PATH_INFO: `/v3/users/6533c69a593a4e35a8693da46fbd9f3b` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01134716-fc59-4a38-9604-cf48f82eb13a None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ad1664-6abd-4c24-9d64-f23d7775273c None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a2af92-9bf1-4f48-81c6-2ff600a8e836 tempest-ShareRulesNegativeTest-1738210631 tempest-ShareRulesNegativeTest-1738210631-project-admin] RBAC: Authorizing `identity:delete_user(user_id=6533c69a593a4e35a8693da46fbd9f3b)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ad1664-6abd-4c24-9d64-f23d7775273c None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ad1664-6abd-4c24-9d64-f23d7775273c None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ad1664-6abd-4c24-9d64-f23d7775273c None admin] PATH_INFO: `/v3/projects` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a2af92-9bf1-4f48-81c6-2ff600a8e836 tempest-ShareRulesNegativeTest-1738210631 tempest-ShareRulesNegativeTest-1738210631-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ad1664-6abd-4c24-9d64-f23d7775273c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ad1664-6abd-4c24-9d64-f23d7775273c None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-f9a2af92-9bf1-4f48-81c6-2ff600a8e836 tempest-ShareRulesNegativeTest-1738210631 tempest-ShareRulesNegativeTest-1738210631-project-admin] Could not find user: 6533c69a593a4e35a8693da46fbd9f3b.: keystone.exception.UserNotFound: Could not find user: 6533c69a593a4e35a8693da46fbd9f3b. May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 6533c69a593a4e35a8693da46fbd9f3b. May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1511/2993] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:01:00 2024] DELETE /identity/v3/users/6533c69a593a4e35a8693da46fbd9f3b => generated 110 bytes in 24 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a2af92-9bf1-4f48-81c6-2ff600a8e836 tempest-ShareRulesNegativeTest-1738210631 tempest-ShareRulesNegativeTest-1738210631-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a2af92-9bf1-4f48-81c6-2ff600a8e836 tempest-ShareRulesNegativeTest-1738210631 tempest-ShareRulesNegativeTest-1738210631-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b922d26-ab4f-4ccb-859a-0a1ce3502975 tempest-ShareRulesNegativeTest-1738210631 tempest-ShareRulesNegativeTest-1738210631-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffcac1016e3c4ee3a3ad1b48da439b19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011748bb7e2247e88228bd066607700e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b922d26-ab4f-4ccb-859a-0a1ce3502975 tempest-ShareRulesNegativeTest-1738210631 tempest-ShareRulesNegativeTest-1738210631-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b922d26-ab4f-4ccb-859a-0a1ce3502975 tempest-ShareRulesNegativeTest-1738210631 tempest-ShareRulesNegativeTest-1738210631-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b922d26-ab4f-4ccb-859a-0a1ce3502975 tempest-ShareRulesNegativeTest-1738210631 tempest-ShareRulesNegativeTest-1738210631-project-admin] PATH_INFO: `/v3/users/929590f760014a429cece4b4e674f84e` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b922d26-ab4f-4ccb-859a-0a1ce3502975 tempest-ShareRulesNegativeTest-1738210631 tempest-ShareRulesNegativeTest-1738210631-project-admin] RBAC: Authorizing `identity:delete_user(user_id=929590f760014a429cece4b4e674f84e)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b922d26-ab4f-4ccb-859a-0a1ce3502975 tempest-ShareRulesNegativeTest-1738210631 tempest-ShareRulesNegativeTest-1738210631-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1483/2994] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 13:01:00 2024] POST /identity/v3/projects => generated 365 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ad1664-6abd-4c24-9d64-f23d7775273c None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ad1664-6abd-4c24-9d64-f23d7775273c None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bb47a2-f5ec-4568-99d2-bdbbb79c599d None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bb47a2-f5ec-4568-99d2-bdbbb79c599d None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bb47a2-f5ec-4568-99d2-bdbbb79c599d None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bb47a2-f5ec-4568-99d2-bdbbb79c599d None admin] PATH_INFO: `/v3/users` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bb47a2-f5ec-4568-99d2-bdbbb79c599d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bb47a2-f5ec-4568-99d2-bdbbb79c599d None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-e2bb47a2-f5ec-4568-99d2-bdbbb79c599d None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-1b922d26-ab4f-4ccb-859a-0a1ce3502975 tempest-ShareRulesNegativeTest-1738210631 tempest-ShareRulesNegativeTest-1738210631-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '929590f760014a429cece4b4e674f84e', 'request_id': 'req-1b922d26-ab4f-4ccb-859a-0a1ce3502975'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-1b922d26-ab4f-4ccb-859a-0a1ce3502975 tempest-ShareRulesNegativeTest-1738210631 tempest-ShareRulesNegativeTest-1738210631-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '929590f760014a429cece4b4e674f84e', 'request_id': 'req-1b922d26-ab4f-4ccb-859a-0a1ce3502975'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-1b922d26-ab4f-4ccb-859a-0a1ce3502975 tempest-ShareRulesNegativeTest-1738210631 tempest-ShareRulesNegativeTest-1738210631-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '929590f760014a429cece4b4e674f84e', 'request_id': 'req-1b922d26-ab4f-4ccb-859a-0a1ce3502975'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-1b922d26-ab4f-4ccb-859a-0a1ce3502975 tempest-ShareRulesNegativeTest-1738210631 tempest-ShareRulesNegativeTest-1738210631-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '929590f760014a429cece4b4e674f84e', 'request_id': 'req-1b922d26-ab4f-4ccb-859a-0a1ce3502975'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1484/2995] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 13:01:00 2024] POST /identity/v3/users => generated 291 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bb47a2-f5ec-4568-99d2-bdbbb79c599d None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-e2bb47a2-f5ec-4568-99d2-bdbbb79c599d None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:01:00 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-1b922d26-ab4f-4ccb-859a-0a1ce3502975 tempest-ShareRulesNegativeTest-1738210631 tempest-ShareRulesNegativeTest-1738210631-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '929590f760014a429cece4b4e674f84e', 'request_id': 'req-1b922d26-ab4f-4ccb-859a-0a1ce3502975'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bb47a2-f5ec-4568-99d2-bdbbb79c599d None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1512/2996] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:01:00 2024] DELETE /identity/v3/users/929590f760014a429cece4b4e674f84e => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-b6208dee-0ea9-470b-81c4-deddd7bd6a6f tempest-ShareRulesNegativeTest-930400775 tempest-ShareRulesNegativeTest-930400775-project-member] DELETE http://10.27.203.238/share/v2/329a14ab984146feb9f91e467ab4e3b5/snapshots/98f3b924-cebf-46a4-9429-7f55792a0941 May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-b6208dee-0ea9-470b-81c4-deddd7bd6a6f tempest-ShareRulesNegativeTest-930400775 tempest-ShareRulesNegativeTest-930400775-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-b6208dee-0ea9-470b-81c4-deddd7bd6a6f tempest-ShareRulesNegativeTest-930400775 tempest-ShareRulesNegativeTest-930400775-project-member] Calling method 'ShareSnapshotMixin.delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.v1.share_snapshots [None req-b6208dee-0ea9-470b-81c4-deddd7bd6a6f tempest-ShareRulesNegativeTest-930400775 tempest-ShareRulesNegativeTest-930400775-project-member] Delete snapshot with id: 98f3b924-cebf-46a4-9429-7f55792a0941 May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92278a09-f286-4352-aa92-d86422c2a611 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92278a09-f286-4352-aa92-d86422c2a611 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92278a09-f286-4352-aa92-d86422c2a611 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92278a09-f286-4352-aa92-d86422c2a611 None admin] PATH_INFO: `/v3/roles` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92278a09-f286-4352-aa92-d86422c2a611 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92278a09-f286-4352-aa92-d86422c2a611 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1485/2997] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 13:01:00 2024] GET /identity/v3/roles => generated 1680 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b922d26-ab4f-4ccb-859a-0a1ce3502975 tempest-ShareRulesNegativeTest-1738210631 tempest-ShareRulesNegativeTest-1738210631-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b922d26-ab4f-4ccb-859a-0a1ce3502975 tempest-ShareRulesNegativeTest-1738210631 tempest-ShareRulesNegativeTest-1738210631-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abf4895-a215-4aa0-a009-cb66a10b9c7e None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abf4895-a215-4aa0-a009-cb66a10b9c7e None admin] REQUEST_METHOD: `PUT` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abf4895-a215-4aa0-a009-cb66a10b9c7e None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abf4895-a215-4aa0-a009-cb66a10b9c7e None admin] PATH_INFO: `/v3/projects/91d671681dc346be86fefe8a8c75be74/users/a770e44d062141cd8ffc9a9233887135/roles/44620cad10ae407c90c91e2c296adb04` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abf4895-a215-4aa0-a009-cb66a10b9c7e None admin] RBAC: Authorizing `identity:create_grant(project_id=91d671681dc346be86fefe8a8c75be74, user_id=a770e44d062141cd8ffc9a9233887135, role_id=44620cad10ae407c90c91e2c296adb04)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abf4895-a215-4aa0-a009-cb66a10b9c7e None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1513/2998] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 13:01:00 2024] PUT /identity/v3/projects/91d671681dc346be86fefe8a8c75be74/users/a770e44d062141cd8ffc9a9233887135/roles/44620cad10ae407c90c91e2c296adb04 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06e9d39-19f9-4b59-8ab9-98e945c7f25d None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06e9d39-19f9-4b59-8ab9-98e945c7f25d None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06e9d39-19f9-4b59-8ab9-98e945c7f25d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-b6208dee-0ea9-470b-81c4-deddd7bd6a6f tempest-ShareRulesNegativeTest-930400775 tempest-ShareRulesNegativeTest-930400775-project-member] http://10.27.203.238/share/v2/329a14ab984146feb9f91e467ab4e3b5/snapshots/98f3b924-cebf-46a4-9429-7f55792a0941 returned with HTTP 202 May 28 13:01:00 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 982/2001] 10.27.203.238 () {64 vars in 1463 bytes} [Tue May 28 13:01:00 2024] DELETE /share/v2/329a14ab984146feb9f91e467ab4e3b5/snapshots/98f3b924-cebf-46a4-9429-7f55792a0941 => generated 0 bytes in 111 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 13:01:00 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-c06e9d39-19f9-4b59-8ab9-98e945c7f25d None None] Truncating password to algorithm specific maximum length 72 characters. May 28 13:01:01 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-8baf2e7c-bd54-4ca7-8b4c-1a190565edbc tempest-ShareRulesNegativeTest-930400775 tempest-ShareRulesNegativeTest-930400775-project-member] GET http://10.27.203.238/share/v2/329a14ab984146feb9f91e467ab4e3b5/snapshots/98f3b924-cebf-46a4-9429-7f55792a0941 May 28 13:01:01 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-8baf2e7c-bd54-4ca7-8b4c-1a190565edbc tempest-ShareRulesNegativeTest-930400775 tempest-ShareRulesNegativeTest-930400775-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:01 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-8baf2e7c-bd54-4ca7-8b4c-1a190565edbc tempest-ShareRulesNegativeTest-930400775 tempest-ShareRulesNegativeTest-930400775-project-member] Calling method 'ShareSnapshotMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-c06e9d39-19f9-4b59-8ab9-98e945c7f25d None None] MFA Rules not processed for user `a770e44d062141cd8ffc9a9233887135`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 13:01:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-c06e9d39-19f9-4b59-8ab9-98e945c7f25d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:01:01 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-8baf2e7c-bd54-4ca7-8b4c-1a190565edbc tempest-ShareRulesNegativeTest-930400775 tempest-ShareRulesNegativeTest-930400775-project-member] http://10.27.203.238/share/v2/329a14ab984146feb9f91e467ab4e3b5/snapshots/98f3b924-cebf-46a4-9429-7f55792a0941 returned with HTTP 200 May 28 13:01:01 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1020/2002] 10.27.203.238 () {64 vars in 1460 bytes} [Tue May 28 13:01:00 2024] GET /share/v2/329a14ab984146feb9f91e467ab4e3b5/snapshots/98f3b924-cebf-46a4-9429-7f55792a0941 => generated 722 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:01:01 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1486/2999] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 13:01:00 2024] POST /identity/v3/auth/tokens => generated 3936 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 13:01:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abf4895-a215-4aa0-a009-cb66a10b9c7e None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:01 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b6208dee-0ea9-470b-81c4-deddd7bd6a6f tempest-ShareRulesNegativeTest-930400775 None] >>> [GET] https://127.0.0.1:40443/api/snapshots/ May 28 13:01:01 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b6208dee-0ea9-470b-81c4-deddd7bd6a6f tempest-ShareRulesNegativeTest-930400775 None] {'allow_redirects': True, May 28 13:01:01 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b6208dee-0ea9-470b-81c4-deddd7bd6a6f tempest-ShareRulesNegativeTest-930400775 None] 'params': {'name': 'share-snapshot-851bfc5e-de6d-4c8a-8ed3-1d93e02d4dc5'}} May 28 13:01:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abf4895-a215-4aa0-a009-cb66a10b9c7e None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9cc5ae-1673-4bfd-8ca4-f6895dd5f543 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9cc5ae-1673-4bfd-8ca4-f6895dd5f543 None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9cc5ae-1673-4bfd-8ca4-f6895dd5f543 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9cc5ae-1673-4bfd-8ca4-f6895dd5f543 None admin] PATH_INFO: `/v3/projects` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9cc5ae-1673-4bfd-8ca4-f6895dd5f543 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9cc5ae-1673-4bfd-8ca4-f6895dd5f543 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:01 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1514/3000] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 13:01:01 2024] POST /identity/v3/projects => generated 365 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 13:01:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06e9d39-19f9-4b59-8ab9-98e945c7f25d None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06e9d39-19f9-4b59-8ab9-98e945c7f25d None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b32d09d-099c-4860-99a9-b7d2db0a1dd4 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b32d09d-099c-4860-99a9-b7d2db0a1dd4 None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b32d09d-099c-4860-99a9-b7d2db0a1dd4 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b32d09d-099c-4860-99a9-b7d2db0a1dd4 None admin] PATH_INFO: `/v3/users` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b32d09d-099c-4860-99a9-b7d2db0a1dd4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b32d09d-099c-4860-99a9-b7d2db0a1dd4 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:01 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-3b32d09d-099c-4860-99a9-b7d2db0a1dd4 None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 13:01:01 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-376f6a4f-c915-416a-af0c-bd96192dd711 tempest-ShareRulesTest-1530341375 None] <<< [PATCH] https://127.0.0.1:40443/api/viewpolicies/48/ May 28 13:01:01 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-376f6a4f-c915-416a-af0c-bd96192dd711 tempest-ShareRulesTest-1530341375 None] Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=1, created='2024-05-28T13:00:50.357495Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='1099a621-1733-438b-a032-2bf134301842', id=48, internal=False, is_s3_default_policy=False, name='f20d9b3a-8716-4664-aff7-80ddf3014290', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=['*'], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=[], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=[], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='MODIFYING', sync_time='2024-05-28T13:01:00.552068Z', tenant_id=1, tenant_name='default', title='f20d9b3a-8716-4664-aff7-80ddf3014290', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/48/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[]) May 28 13:01:01 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-376f6a4f-c915-416a-af0c-bd96192dd711 tempest-ShareRulesTest-1530341375 None] --- [PATCH] https://127.0.0.1:40443/api/viewpolicies/48/: Done May 28 13:01:01 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-376f6a4f-c915-416a-af0c-bd96192dd711 tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f20d9b3a-8716-4664-aff7-80ddf3014290" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:01:01 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-376f6a4f-c915-416a-af0c-bd96192dd711 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f20d9b3a-8716-4664-aff7-80ddf3014290" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:01:01 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1487/3001] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 13:01:01 2024] POST /identity/v3/users => generated 290 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 13:01:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9cc5ae-1673-4bfd-8ca4-f6895dd5f543 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9cc5ae-1673-4bfd-8ca4-f6895dd5f543 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086e75c2-47bb-40b6-ba32-f0cbb8ff2e65 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086e75c2-47bb-40b6-ba32-f0cbb8ff2e65 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086e75c2-47bb-40b6-ba32-f0cbb8ff2e65 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086e75c2-47bb-40b6-ba32-f0cbb8ff2e65 None admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086e75c2-47bb-40b6-ba32-f0cbb8ff2e65 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086e75c2-47bb-40b6-ba32-f0cbb8ff2e65 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:01 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-376f6a4f-c915-416a-af0c-bd96192dd711 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f20d9b3a-8716-4664-aff7-80ddf3014290" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.034s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:01:01 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-376f6a4f-c915-416a-af0c-bd96192dd711 tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f20d9b3a-8716-4664-aff7-80ddf3014290" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:01:01 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-376f6a4f-c915-416a-af0c-bd96192dd711 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f20d9b3a-8716-4664-aff7-80ddf3014290" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:01:01 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1515/3002] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 13:01:01 2024] GET /identity/v3/roles => generated 1680 bytes in 19 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 13:01:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b32d09d-099c-4860-99a9-b7d2db0a1dd4 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b32d09d-099c-4860-99a9-b7d2db0a1dd4 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2457e599-e9ef-42d2-93a1-cb8b6da39daf None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2457e599-e9ef-42d2-93a1-cb8b6da39daf None admin] REQUEST_METHOD: `PUT` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2457e599-e9ef-42d2-93a1-cb8b6da39daf None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2457e599-e9ef-42d2-93a1-cb8b6da39daf None admin] PATH_INFO: `/v3/projects/40625c7a855049188adc00ac1e323af7/users/5c78e998d7a8438b924c38bb84168488/roles/e7989893488f483baa107be56668c4f8` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:01 l75lg1-v1 dstat.sh[49771]: 28-05 13:01:01| 18 2 77 2 0|5696M 1747M 278M 7903M| 18k 10k| 0 2215k| 0 317 |9912 18k|1.74 1.25 1.08|2.0 1.0 0| 0 0 | 0 2048M| 29 362 0 30 2 May 28 13:01:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2457e599-e9ef-42d2-93a1-cb8b6da39daf None admin] RBAC: Authorizing `identity:create_grant(project_id=40625c7a855049188adc00ac1e323af7, user_id=5c78e998d7a8438b924c38bb84168488, role_id=e7989893488f483baa107be56668c4f8)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2457e599-e9ef-42d2-93a1-cb8b6da39daf None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:01 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-376f6a4f-c915-416a-af0c-bd96192dd711 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f20d9b3a-8716-4664-aff7-80ddf3014290" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.034s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:01:01 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-376f6a4f-c915-416a-af0c-bd96192dd711 tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f20d9b3a-8716-4664-aff7-80ddf3014290" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:01:01 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-376f6a4f-c915-416a-af0c-bd96192dd711 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f20d9b3a-8716-4664-aff7-80ddf3014290" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:01:01 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-376f6a4f-c915-416a-af0c-bd96192dd711 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f20d9b3a-8716-4664-aff7-80ddf3014290" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:01:01 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-376f6a4f-c915-416a-af0c-bd96192dd711 tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f20d9b3a-8716-4664-aff7-80ddf3014290" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:01:01 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-376f6a4f-c915-416a-af0c-bd96192dd711 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f20d9b3a-8716-4664-aff7-80ddf3014290" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:01:01 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-376f6a4f-c915-416a-af0c-bd96192dd711 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f20d9b3a-8716-4664-aff7-80ddf3014290" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:01:01 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-376f6a4f-c915-416a-af0c-bd96192dd711 tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f20d9b3a-8716-4664-aff7-80ddf3014290" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:01:01 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-376f6a4f-c915-416a-af0c-bd96192dd711 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f20d9b3a-8716-4664-aff7-80ddf3014290" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:01:01 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1488/3003] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 13:01:01 2024] PUT /identity/v3/projects/40625c7a855049188adc00ac1e323af7/users/5c78e998d7a8438b924c38bb84168488/roles/e7989893488f483baa107be56668c4f8 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:01:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086e75c2-47bb-40b6-ba32-f0cbb8ff2e65 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086e75c2-47bb-40b6-ba32-f0cbb8ff2e65 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd43550e-c845-438d-8003-1896852e4073 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd43550e-c845-438d-8003-1896852e4073 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd43550e-c845-438d-8003-1896852e4073 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd43550e-c845-438d-8003-1896852e4073 None admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd43550e-c845-438d-8003-1896852e4073 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd43550e-c845-438d-8003-1896852e4073 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:01 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-376f6a4f-c915-416a-af0c-bd96192dd711 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f20d9b3a-8716-4664-aff7-80ddf3014290" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.053s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:01:01 l75lg1-v1 manila-share[98474]: INFO manila.share.access [None req-376f6a4f-c915-416a-af0c-bd96192dd711 tempest-ShareRulesTest-1530341375 None] Access rules were successfully modified for share instance f20d9b3a-8716-4664-aff7-80ddf3014290 belonging to share 415b1daa-22c2-48a3-873e-80762e65a747. May 28 13:01:01 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-376f6a4f-c915-416a-af0c-bd96192dd711 tempest-ShareRulesTest-1530341375 None] deleting '/manila/manila-f20d9b3a-8716-4664-aff7-80ddf3014290' May 28 13:01:01 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-376f6a4f-c915-416a-af0c-bd96192dd711 tempest-ShareRulesTest-1530341375 None] >>> [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/ May 28 13:01:01 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-376f6a4f-c915-416a-af0c-bd96192dd711 tempest-ShareRulesTest-1530341375 None] {'data': '{"path": "/manila/manila-f20d9b3a-8716-4664-aff7-80ddf3014290"}', May 28 13:01:01 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-376f6a4f-c915-416a-af0c-bd96192dd711 tempest-ShareRulesTest-1530341375 None] 'params': None} May 28 13:01:01 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1516/3004] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 13:01:01 2024] GET /identity/v3/roles => generated 1680 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 13:01:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2457e599-e9ef-42d2-93a1-cb8b6da39daf None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2457e599-e9ef-42d2-93a1-cb8b6da39daf None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322cca13-3ddf-4555-8fd1-a30321d22c9f None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322cca13-3ddf-4555-8fd1-a30321d22c9f None admin] REQUEST_METHOD: `PUT` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322cca13-3ddf-4555-8fd1-a30321d22c9f None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322cca13-3ddf-4555-8fd1-a30321d22c9f None admin] PATH_INFO: `/v3/projects/40625c7a855049188adc00ac1e323af7/users/5c78e998d7a8438b924c38bb84168488/roles/e7989893488f483baa107be56668c4f8` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322cca13-3ddf-4555-8fd1-a30321d22c9f None admin] RBAC: Authorizing `identity:create_grant(project_id=40625c7a855049188adc00ac1e323af7, user_id=5c78e998d7a8438b924c38bb84168488, role_id=e7989893488f483baa107be56668c4f8)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322cca13-3ddf-4555-8fd1-a30321d22c9f None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:01 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1489/3005] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 13:01:01 2024] PUT /identity/v3/projects/40625c7a855049188adc00ac1e323af7/users/5c78e998d7a8438b924c38bb84168488/roles/e7989893488f483baa107be56668c4f8 => generated 0 bytes in 19 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:01:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d4f492-63cf-42ea-873a-866bddaa39bc None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d4f492-63cf-42ea-873a-866bddaa39bc None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d4f492-63cf-42ea-873a-866bddaa39bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:01 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-b1d4f492-63cf-42ea-873a-866bddaa39bc None None] Truncating password to algorithm specific maximum length 72 characters. May 28 13:01:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-b1d4f492-63cf-42ea-873a-866bddaa39bc None None] MFA Rules not processed for user `5c78e998d7a8438b924c38bb84168488`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 13:01:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-b1d4f492-63cf-42ea-873a-866bddaa39bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:01:01 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-176b5f92-5dd9-4d54-8fc2-82c1e3ff7aaf tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] GET http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/shares/415b1daa-22c2-48a3-873e-80762e65a747 May 28 13:01:01 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-176b5f92-5dd9-4d54-8fc2-82c1e3ff7aaf tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:01 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-176b5f92-5dd9-4d54-8fc2-82c1e3ff7aaf tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:01 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-376f6a4f-c915-416a-af0c-bd96192dd711 tempest-ShareRulesTest-1530341375 None] <<< [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/ May 28 13:01:01 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-376f6a4f-c915-416a-af0c-bd96192dd711 tempest-ShareRulesTest-1530341375 None] 'OK' May 28 13:01:01 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-376f6a4f-c915-416a-af0c-bd96192dd711 tempest-ShareRulesTest-1530341375 None] --- [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/: Done May 28 13:01:01 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-376f6a4f-c915-416a-af0c-bd96192dd711 tempest-ShareRulesTest-1530341375 None] >>> [GET] https://127.0.0.1:40443/api/views/ May 28 13:01:01 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-376f6a4f-c915-416a-af0c-bd96192dd711 tempest-ShareRulesTest-1530341375 None] {'allow_redirects': True, May 28 13:01:01 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-376f6a4f-c915-416a-af0c-bd96192dd711 tempest-ShareRulesTest-1530341375 None] 'params': {'name': 'f20d9b3a-8716-4664-aff7-80ddf3014290'}} May 28 13:01:01 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-176b5f92-5dd9-4d54-8fc2-82c1e3ff7aaf tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/shares/415b1daa-22c2-48a3-873e-80762e65a747 returned with HTTP 200 May 28 13:01:01 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 983/2003] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:01:01 2024] GET /share/v2/a4f3887fa28c457390f5b66615564430/shares/415b1daa-22c2-48a3-873e-80762e65a747 => generated 1315 bytes in 29 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:01:01 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1517/3006] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 13:01:01 2024] POST /identity/v3/auth/tokens => generated 4059 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 13:01:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322cca13-3ddf-4555-8fd1-a30321d22c9f None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322cca13-3ddf-4555-8fd1-a30321d22c9f None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef0837b-5138-4156-86a1-edf21931356b tempest-SharesNFSTest-1858044304 tempest-SharesNFSTest-1858044304-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c78e998d7a8438b924c38bb84168488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40625c7a855049188adc00ac1e323af7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef0837b-5138-4156-86a1-edf21931356b tempest-SharesNFSTest-1858044304 tempest-SharesNFSTest-1858044304-project-admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef0837b-5138-4156-86a1-edf21931356b tempest-SharesNFSTest-1858044304 tempest-SharesNFSTest-1858044304-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef0837b-5138-4156-86a1-edf21931356b tempest-SharesNFSTest-1858044304 tempest-SharesNFSTest-1858044304-project-admin] PATH_INFO: `/v3/domains` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef0837b-5138-4156-86a1-edf21931356b tempest-SharesNFSTest-1858044304 tempest-SharesNFSTest-1858044304-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 13:01:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef0837b-5138-4156-86a1-edf21931356b tempest-SharesNFSTest-1858044304 tempest-SharesNFSTest-1858044304-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef0837b-5138-4156-86a1-edf21931356b tempest-SharesNFSTest-1858044304 tempest-SharesNFSTest-1858044304-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:01 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1490/3007] 10.27.203.238 () {62 vars in 1241 bytes} [Tue May 28 13:01:01 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 13:01:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d4f492-63cf-42ea-873a-866bddaa39bc None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d4f492-63cf-42ea-873a-866bddaa39bc None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1941545-bbd1-4acd-b2c7-d9bdeddf875e tempest-SharesNFSTest-1858044304 tempest-SharesNFSTest-1858044304-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c78e998d7a8438b924c38bb84168488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40625c7a855049188adc00ac1e323af7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1941545-bbd1-4acd-b2c7-d9bdeddf875e tempest-SharesNFSTest-1858044304 tempest-SharesNFSTest-1858044304-project-admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1941545-bbd1-4acd-b2c7-d9bdeddf875e tempest-SharesNFSTest-1858044304 tempest-SharesNFSTest-1858044304-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1941545-bbd1-4acd-b2c7-d9bdeddf875e tempest-SharesNFSTest-1858044304 tempest-SharesNFSTest-1858044304-project-admin] PATH_INFO: `/v3/users` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1941545-bbd1-4acd-b2c7-d9bdeddf875e tempest-SharesNFSTest-1858044304 tempest-SharesNFSTest-1858044304-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1941545-bbd1-4acd-b2c7-d9bdeddf875e tempest-SharesNFSTest-1858044304 tempest-SharesNFSTest-1858044304-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:01 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-e1941545-bbd1-4acd-b2c7-d9bdeddf875e tempest-SharesNFSTest-1858044304 tempest-SharesNFSTest-1858044304-project-admin] Truncating password to algorithm specific maximum length 72 characters. May 28 13:01:01 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1518/3008] 10.27.203.238 () {64 vars in 1232 bytes} [Tue May 28 13:01:01 2024] POST /identity/v3/users => generated 433 bytes in 36 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 13:01:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef0837b-5138-4156-86a1-edf21931356b tempest-SharesNFSTest-1858044304 tempest-SharesNFSTest-1858044304-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef0837b-5138-4156-86a1-edf21931356b tempest-SharesNFSTest-1858044304 tempest-SharesNFSTest-1858044304-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c17b227-5881-4735-a185-907e4e57e4e5 tempest-SharesNFSTest-1858044304 tempest-SharesNFSTest-1858044304-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c78e998d7a8438b924c38bb84168488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40625c7a855049188adc00ac1e323af7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c17b227-5881-4735-a185-907e4e57e4e5 tempest-SharesNFSTest-1858044304 tempest-SharesNFSTest-1858044304-project-admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c17b227-5881-4735-a185-907e4e57e4e5 tempest-SharesNFSTest-1858044304 tempest-SharesNFSTest-1858044304-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c17b227-5881-4735-a185-907e4e57e4e5 tempest-SharesNFSTest-1858044304 tempest-SharesNFSTest-1858044304-project-admin] PATH_INFO: `/v3/roles` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c17b227-5881-4735-a185-907e4e57e4e5 tempest-SharesNFSTest-1858044304 tempest-SharesNFSTest-1858044304-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c17b227-5881-4735-a185-907e4e57e4e5 tempest-SharesNFSTest-1858044304 tempest-SharesNFSTest-1858044304-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:01 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1491/3009] 10.27.203.238 () {62 vars in 1210 bytes} [Tue May 28 13:01:01 2024] GET /identity/v3/roles => generated 1680 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 13:01:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1941545-bbd1-4acd-b2c7-d9bdeddf875e tempest-SharesNFSTest-1858044304 tempest-SharesNFSTest-1858044304-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1941545-bbd1-4acd-b2c7-d9bdeddf875e tempest-SharesNFSTest-1858044304 tempest-SharesNFSTest-1858044304-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f4cd21-78c9-4d42-bb52-6b70c81b16eb tempest-SharesNFSTest-1858044304 tempest-SharesNFSTest-1858044304-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c78e998d7a8438b924c38bb84168488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40625c7a855049188adc00ac1e323af7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f4cd21-78c9-4d42-bb52-6b70c81b16eb tempest-SharesNFSTest-1858044304 tempest-SharesNFSTest-1858044304-project-admin] REQUEST_METHOD: `PUT` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f4cd21-78c9-4d42-bb52-6b70c81b16eb tempest-SharesNFSTest-1858044304 tempest-SharesNFSTest-1858044304-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f4cd21-78c9-4d42-bb52-6b70c81b16eb tempest-SharesNFSTest-1858044304 tempest-SharesNFSTest-1858044304-project-admin] PATH_INFO: `/v3/projects/40625c7a855049188adc00ac1e323af7/users/1753431784bd4ea68bf59da03f4b6d7a/roles/44620cad10ae407c90c91e2c296adb04` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f4cd21-78c9-4d42-bb52-6b70c81b16eb tempest-SharesNFSTest-1858044304 tempest-SharesNFSTest-1858044304-project-admin] RBAC: Authorizing `identity:create_grant(project_id=40625c7a855049188adc00ac1e323af7, user_id=1753431784bd4ea68bf59da03f4b6d7a, role_id=44620cad10ae407c90c91e2c296adb04)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f4cd21-78c9-4d42-bb52-6b70c81b16eb tempest-SharesNFSTest-1858044304 tempest-SharesNFSTest-1858044304-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:01 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1519/3010] 10.27.203.238 () {64 vars in 1571 bytes} [Tue May 28 13:01:01 2024] PUT /identity/v3/projects/40625c7a855049188adc00ac1e323af7/users/1753431784bd4ea68bf59da03f4b6d7a/roles/44620cad10ae407c90c91e2c296adb04 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:01:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c17b227-5881-4735-a185-907e4e57e4e5 tempest-SharesNFSTest-1858044304 tempest-SharesNFSTest-1858044304-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-7c17b227-5881-4735-a185-907e4e57e4e5 tempest-SharesNFSTest-1858044304 tempest-SharesNFSTest-1858044304-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:01:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c17b227-5881-4735-a185-907e4e57e4e5 tempest-SharesNFSTest-1858044304 tempest-SharesNFSTest-1858044304-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:01 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b6208dee-0ea9-470b-81c4-deddd7bd6a6f tempest-ShareRulesNegativeTest-930400775 None] <<< [GET] https://127.0.0.1:40443/api/snapshots/ May 28 13:01:01 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b6208dee-0ea9-470b-81c4-deddd7bd6a6f tempest-ShareRulesNegativeTest-930400775 None] [Bunch(access_path='/.vast_all_snapshots/1000000012_share-snapshot-851bfc5e-de6d-4c8a-8ed3-1d93e02d4dc5', aggr_phys_estimation=0, cluster='loop75-kfs', created='2024-05-28T13:00:54.738011Z', eta_sec=30819898736.35028, expiration_time='3001-01-19T07:59:58Z', guid='7b97bfe3-80c8-4591-be53-9f24487682eb', id=13, indestructible=False, locked=False, name='share-snapshot-851bfc5e-de6d-4c8a-8ed3-1d93e02d4dc5', path='/manila/manila-e0a28587-55d6-44c6-8c73-249d5047f95e/', policy=None, policy_id=None, protection_policy_id=None, state='SUCCEED', tenant_id=1, tenant_name='default', title='share-snapshot-851bfc5e-de6d-4c8a-8ed3-1d93e02d4dc5(/manila/manila-e0a28587-55d6-44c6-8c73-249d5047f95e/)', type='local', unique_phys_estimation=0, url='https://127.0.0.1:40443/api/snapshots/13/')] May 28 13:01:01 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b6208dee-0ea9-470b-81c4-deddd7bd6a6f tempest-ShareRulesNegativeTest-930400775 None] --- [GET] https://127.0.0.1:40443/api/snapshots/: Done May 28 13:01:01 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b6208dee-0ea9-470b-81c4-deddd7bd6a6f tempest-ShareRulesNegativeTest-930400775 None] >>> [DELETE] https://127.0.0.1:40443/api/snapshots/13/ May 28 13:01:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb00f951-dbe7-4cc8-805d-b93bf8620097 service manila] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f110cf6300f049c897d0aab63218d1e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb00f951-dbe7-4cc8-805d-b93bf8620097 service manila] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb00f951-dbe7-4cc8-805d-b93bf8620097 service manila] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb00f951-dbe7-4cc8-805d-b93bf8620097 service manila] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb00f951-dbe7-4cc8-805d-b93bf8620097 service manila] RBAC: Authorizing `identity:validate_token()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:01 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb00f951-dbe7-4cc8-805d-b93bf8620097 service manila] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:01 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1492/3011] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 13:01:01 2024] GET /identity/v3/auth/tokens => generated 4059 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 13:01:01 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-088118e6-3679-47e5-a3d3-917fb497cd7d tempest-SharesNFSTest-1858044304 tempest-SharesNFSTest-1858044304-project-admin] POST http://10.27.203.238/share/v2/40625c7a855049188adc00ac1e323af7/types May 28 13:01:01 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-088118e6-3679-47e5-a3d3-917fb497cd7d tempest-SharesNFSTest-1858044304 tempest-SharesNFSTest-1858044304-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share_type": {"name": "tempest-typeshare-type-54465769", "extra_specs": {"driver_handles_share_servers": "False"}, "share_type_access:is_public": true}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:01:01 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-088118e6-3679-47e5-a3d3-917fb497cd7d tempest-SharesNFSTest-1858044304 tempest-SharesNFSTest-1858044304-project-admin] http://10.27.203.238/share/v2/40625c7a855049188adc00ac1e323af7/types returned with HTTP 200 May 28 13:01:01 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1021/2004] 10.27.203.238 () {66 vars in 1359 bytes} [Tue May 28 13:01:01 2024] POST /share/v2/40625c7a855049188adc00ac1e323af7/types => generated 619 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:01:01 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-8ef9f09a-b06d-41b8-a918-43ad3f761a99 tempest-SharesNFSTest-1858044304 tempest-SharesNFSTest-1858044304-project-admin] POST http://10.27.203.238/share/v2/40625c7a855049188adc00ac1e323af7/types May 28 13:01:01 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-8ef9f09a-b06d-41b8-a918-43ad3f761a99 tempest-SharesNFSTest-1858044304 tempest-SharesNFSTest-1858044304-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share_type": {"name": "tempest-typeshare-type-1319571281", "extra_specs": {"driver_handles_share_servers": "False", "snapshot_support": true}, "share_type_access:is_public": true}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:01:01 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-8ef9f09a-b06d-41b8-a918-43ad3f761a99 tempest-SharesNFSTest-1858044304 tempest-SharesNFSTest-1858044304-project-admin] http://10.27.203.238/share/v2/40625c7a855049188adc00ac1e323af7/types returned with HTTP 200 May 28 13:01:01 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 984/2005] 10.27.203.238 () {66 vars in 1359 bytes} [Tue May 28 13:01:01 2024] POST /share/v2/40625c7a855049188adc00ac1e323af7/types => generated 679 bytes in 29 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:01:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f4cd21-78c9-4d42-bb52-6b70c81b16eb tempest-SharesNFSTest-1858044304 tempest-SharesNFSTest-1858044304-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f4cd21-78c9-4d42-bb52-6b70c81b16eb tempest-SharesNFSTest-1858044304 tempest-SharesNFSTest-1858044304-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6e10f9-f116-42eb-a279-6ecf50ebb923 service manila] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f110cf6300f049c897d0aab63218d1e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6e10f9-f116-42eb-a279-6ecf50ebb923 service manila] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6e10f9-f116-42eb-a279-6ecf50ebb923 service manila] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6e10f9-f116-42eb-a279-6ecf50ebb923 service manila] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-6c6e10f9-f116-42eb-a279-6ecf50ebb923 service manila] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:01:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6e10f9-f116-42eb-a279-6ecf50ebb923 service manila] RBAC: Authorizing `identity:validate_token()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:01 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6e10f9-f116-42eb-a279-6ecf50ebb923 service manila] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:01 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1520/3012] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 13:01:01 2024] GET /identity/v3/auth/tokens => generated 3934 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 13:01:01 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-2b20789d-29d9-4855-bc6c-e2ea0bc3fcb3 tempest-SharesNFSTest-667257547 tempest-SharesNFSTest-667257547-project-member] POST http://10.27.203.238/share/v2/0af6f8e0aeed4f27b075e08f2bc713aa/shares May 28 13:01:01 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-2b20789d-29d9-4855-bc6c-e2ea0bc3fcb3 tempest-SharesNFSTest-667257547 tempest-SharesNFSTest-667257547-project-member] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share": {"share_proto": "nfs", "description": "Tempest's share", "snapshot_id": null, "name": "tempest-tempest-created-share-756234766", "size": 1, "metadata": {}, "is_public": false, "share_type": "243c4676-ce4e-459a-8f50-f726c4b0d7ee"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:01:01 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.v1.shares [None req-2b20789d-29d9-4855-bc6c-e2ea0bc3fcb3 tempest-SharesNFSTest-667257547 tempest-SharesNFSTest-667257547-project-member] Create NFS share of 1 GB May 28 13:01:01 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-376f6a4f-c915-416a-af0c-bd96192dd711 tempest-ShareRulesTest-1530341375 None] <<< [GET] https://127.0.0.1:40443/api/views/ May 28 13:01:01 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-376f6a4f-c915-416a-af0c-bd96192dd711 tempest-ShareRulesTest-1530341375 None] [Bunch(abac_tags=[], abe_max_depth=None, abe_protocols=[], alias='', allow_anonymous_access=False, allow_s3_anonymous_access=False, auto_commit='0d', bucket='', bucket_creators=[], bucket_creators_groups=[], bucket_owner=None, bulk_permission_update_progress=None, bulk_permission_update_state=None, cluster='loop75-kfs', cluster_id=1, created='2024-05-28T13:00:53.357897Z', enabled=True, files_retention_mode='NONE', guid='e48712f1-60b3-442b-97b9-5c81050d337d', id=47, ignore_oos=False, internal=False, is_remote=False, is_seamless=False, logical_capacity=0, max_retention_period=None, min_retention_period=None, name='f20d9b3a-8716-4664-aff7-80ddf3014290', nfs_interop_flags='BOTH_NFS3_AND_NFS4_INTEROP_DISABLED', path='/manila/manila-f20d9b3a-8716-4664-aff7-80ddf3014290', physical_capacity=0, policy='f20d9b3a-8716-4664-aff7-80ddf3014290', policy_id=48, protocols=['NFS'], qos_policy=None, qos_policy_id=None, s3_locks=False, s3_locks_retention_mode='NONE', s3_locks_retention_period='', s3_unverified_lookup=False, s3_versioning=False, select_for_live_monitoring=False, share='', share_acl=Bunch(acl=[], enabled=False), sync='SYNCED', sync_time='2024-05-28T13:00:53.627908Z', tenant_id=1, tenant_name='default', title='/manila/manila-f20d9b3a-8716-4664-aff7-80ddf3014290', url='https://127.0.0.1:40443/api/views/47/')] May 28 13:01:01 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-376f6a4f-c915-416a-af0c-bd96192dd711 tempest-ShareRulesTest-1530341375 None] --- [GET] https://127.0.0.1:40443/api/views/: Done May 28 13:01:01 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-376f6a4f-c915-416a-af0c-bd96192dd711 tempest-ShareRulesTest-1530341375 None] >>> [DELETE] https://127.0.0.1:40443/api/views/47/ May 28 13:01:01 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.quota [None req-2b20789d-29d9-4855-bc6c-e2ea0bc3fcb3 tempest-SharesNFSTest-667257547 tempest-SharesNFSTest-667257547-project-member] Created reservations ['d6aa8bdc-5cd6-4b45-8bdd-4e28dc65d273', '6597d8d1-0f09-45d0-b68f-9d5eaad548cc', '6447c395-2435-478a-8a1c-843fe827ecb2', '48288303-45cc-4b5d-be21-0b8f2911720d'] {{(pid=98329) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 13:01:01 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.quota [None req-2b20789d-29d9-4855-bc6c-e2ea0bc3fcb3 tempest-SharesNFSTest-667257547 tempest-SharesNFSTest-667257547-project-member] Committed reservations ['d6aa8bdc-5cd6-4b45-8bdd-4e28dc65d273', '6597d8d1-0f09-45d0-b68f-9d5eaad548cc', '6447c395-2435-478a-8a1c-843fe827ecb2', '48288303-45cc-4b5d-be21-0b8f2911720d'] {{(pid=98329) commit /opt/stack/manila/manila/quota.py:1063}} May 28 13:01:02 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-2b20789d-29d9-4855-bc6c-e2ea0bc3fcb3 tempest-SharesNFSTest-667257547 tempest-SharesNFSTest-667257547-project-member] http://10.27.203.238/share/v2/0af6f8e0aeed4f27b075e08f2bc713aa/shares returned with HTTP 200 May 28 13:01:02 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1022/2006] 10.27.203.238 () {66 vars in 1362 bytes} [Tue May 28 13:01:01 2024] POST /share/v2/0af6f8e0aeed4f27b075e08f2bc713aa/shares => generated 1312 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:01:02 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.host_manager [None req-2b20789d-29d9-4855-bc6c-e2ea0bc3fcb3 tempest-SharesNFSTest-667257547 None] Share service is down. (host: l75lg1-v1@generic2). May 28 13:01:02 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.host_manager [None req-2b20789d-29d9-4855-bc6c-e2ea0bc3fcb3 tempest-SharesNFSTest-667257547 None] Share service is down. (host: l75lg1-v1@generic1). May 28 13:01:02 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-2b20789d-29d9-4855-bc6c-e2ea0bc3fcb3 tempest-SharesNFSTest-667257547 None] Starting with 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:80}} May 28 13:01:02 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-2b20789d-29d9-4855-bc6c-e2ea0bc3fcb3 tempest-SharesNFSTest-667257547 None] Filter OnlyHostFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:01:02 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-2b20789d-29d9-4855-bc6c-e2ea0bc3fcb3 tempest-SharesNFSTest-667257547 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:01:02 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.capacity [None req-2b20789d-29d9-4855-bc6c-e2ea0bc3fcb3 tempest-SharesNFSTest-667257547 None] Space information for share creation on host l75lg1-v1@vast#vast (requested / avail): 1/2080 {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/capacity.py:83}} May 28 13:01:02 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-2b20789d-29d9-4855-bc6c-e2ea0bc3fcb3 tempest-SharesNFSTest-667257547 None] Filter CapacityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:01:02 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-2b20789d-29d9-4855-bc6c-e2ea0bc3fcb3 tempest-SharesNFSTest-667257547 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:01:02 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-2b20789d-29d9-4855-bc6c-e2ea0bc3fcb3 tempest-SharesNFSTest-667257547 None] Driver Filter: Checking host 'l75lg1-v1@vast#vast' {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:37}} May 28 13:01:02 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-2b20789d-29d9-4855-bc6c-e2ea0bc3fcb3 tempest-SharesNFSTest-667257547 None] Filter function not set :: passing host. {{(pid=98327) _check_filter_function /opt/stack/manila/manila/scheduler/filters/driver.py:53}} May 28 13:01:02 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-2b20789d-29d9-4855-bc6c-e2ea0bc3fcb3 tempest-SharesNFSTest-667257547 None] Result: True {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:40}} May 28 13:01:02 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-2b20789d-29d9-4855-bc6c-e2ea0bc3fcb3 tempest-SharesNFSTest-667257547 None] Done checking host 'l75lg1-v1@vast#vast' {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:41}} May 28 13:01:02 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-2b20789d-29d9-4855-bc6c-e2ea0bc3fcb3 tempest-SharesNFSTest-667257547 None] Filter DriverFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:01:02 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-2b20789d-29d9-4855-bc6c-e2ea0bc3fcb3 tempest-SharesNFSTest-667257547 None] Filter ShareReplicationFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:01:02 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-2b20789d-29d9-4855-bc6c-e2ea0bc3fcb3 tempest-SharesNFSTest-667257547 None] Filter CreateFromSnapshotFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:01:02 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-5d47ea63-b44a-4739-a6fb-7977dcdb9dcc tempest-SharesNFSTest-667257547 tempest-SharesNFSTest-667257547-project-member] GET http://10.27.203.238/share/v2/0af6f8e0aeed4f27b075e08f2bc713aa/shares/7a762332-0877-462f-941a-6581abbf784b May 28 13:01:02 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-5d47ea63-b44a-4739-a6fb-7977dcdb9dcc tempest-SharesNFSTest-667257547 tempest-SharesNFSTest-667257547-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:02 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-2b20789d-29d9-4855-bc6c-e2ea0bc3fcb3 tempest-SharesNFSTest-667257547 None] Filter AffinityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:01:02 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-5d47ea63-b44a-4739-a6fb-7977dcdb9dcc tempest-SharesNFSTest-667257547 tempest-SharesNFSTest-667257547-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:02 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-2b20789d-29d9-4855-bc6c-e2ea0bc3fcb3 tempest-SharesNFSTest-667257547 None] Filter AntiAffinityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:01:02 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.drivers.filter [None req-2b20789d-29d9-4855-bc6c-e2ea0bc3fcb3 tempest-SharesNFSTest-667257547 None] Filtered share [host: 'l75lg1-v1@vast#vast', free_capacity_gb: 2080.6277076322585, pools: None] {{(pid=98327) _schedule_share /opt/stack/manila/manila/scheduler/drivers/filter.py:268}} May 28 13:01:02 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-2b20789d-29d9-4855-bc6c-e2ea0bc3fcb3 tempest-SharesNFSTest-667257547 None] Checking host 'l75lg1-v1@vast#vast' {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:46}} May 28 13:01:02 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.weighers.goodness [None req-2b20789d-29d9-4855-bc6c-e2ea0bc3fcb3 tempest-SharesNFSTest-667257547 None] Goodness function not set :: defaulting to minimal goodness rating of 0. May 28 13:01:02 l75lg1-v1 manila-scheduler[98327]: INFO manila.scheduler.weighers.goodness [None req-2b20789d-29d9-4855-bc6c-e2ea0bc3fcb3 tempest-SharesNFSTest-667257547 None] Goodness function result for host l75lg1-v1@vast#vast: 0. May 28 13:01:02 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-2b20789d-29d9-4855-bc6c-e2ea0bc3fcb3 tempest-SharesNFSTest-667257547 None] Goodness: 0 {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:48}} May 28 13:01:02 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-2b20789d-29d9-4855-bc6c-e2ea0bc3fcb3 tempest-SharesNFSTest-667257547 None] Done checking host 'l75lg1-v1@vast#vast' {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:49}} May 28 13:01:02 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.drivers.filter [None req-2b20789d-29d9-4855-bc6c-e2ea0bc3fcb3 tempest-SharesNFSTest-667257547 None] Choosing for share: WeighedHost [host: l75lg1-v1@vast#vast, weight: 0.0] {{(pid=98327) _schedule_share /opt/stack/manila/manila/scheduler/drivers/filter.py:274}} May 28 13:01:02 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-5d47ea63-b44a-4739-a6fb-7977dcdb9dcc tempest-SharesNFSTest-667257547 tempest-SharesNFSTest-667257547-project-member] http://10.27.203.238/share/v2/0af6f8e0aeed4f27b075e08f2bc713aa/shares/7a762332-0877-462f-941a-6581abbf784b returned with HTTP 200 May 28 13:01:02 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 985/2007] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:01:02 2024] GET /share/v2/0af6f8e0aeed4f27b075e08f2bc713aa/shares/7a762332-0877-462f-941a-6581abbf784b => generated 1312 bytes in 24 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:01:02 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2b20789d-29d9-4855-bc6c-e2ea0bc3fcb3 tempest-SharesNFSTest-667257547 None] >>> [GET] https://127.0.0.1:40443/api/vippools/ May 28 13:01:02 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2b20789d-29d9-4855-bc6c-e2ea0bc3fcb3 tempest-SharesNFSTest-667257547 None] {'allow_redirects': True, 'params': {'name': 'vippool-1'}} May 28 13:01:02 l75lg1-v1 dstat.sh[49771]: 28-05 13:01:02| 10 1 85 3 0|5698M 1746M 278M 7903M| 23k 3747B| 0 2673k| 0 349 |7292 12k|1.84 1.28 1.09|2.0 1.0 1.0| 0 0 | 0 2048M| 29 363 0 30 2 May 28 13:01:02 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2b20789d-29d9-4855-bc6c-e2ea0bc3fcb3 tempest-SharesNFSTest-667257547 None] <<< [GET] https://127.0.0.1:40443/api/vippools/ May 28 13:01:02 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2b20789d-29d9-4855-bc6c-e2ea0bc3fcb3 tempest-SharesNFSTest-667257547 None] [Bunch(active_cnode_ids=[], active_interfaces=4, cluster='loop75-kfs', cluster_id=1, cnode_ids=[], cnodes=[], domain_name='vippool-1', enable_l3=False, enable_weighted_balancing=False, enabled=True, end_ip='172.21.75.4', guid='f2abaede-b397-413a-8faa-3aeead6d3b28', gw_ip='', gw_ipv6='', id=2, ip_ranges=[['172.21.75.1', '172.21.75.4']], name='vippool-1', peer_asn=0, port_membership='ALL', ranges_summary='172.21.75.[1-4]', role='PROTOCOLS', start_ip='172.21.75.1', subnet_cidr=16, subnet_cidr_ipv6=None, sync='SYNCED', sync_time='2024-05-28T12:50:09.644123Z', tenant_id=1, tenant_name='default', title='172.21.75.1 - 172.21.75.4', url='https://127.0.0.1:40443/api/vippools/2/', vast_asn=0, vlan=0, vms_preferred=False)] May 28 13:01:02 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2b20789d-29d9-4855-bc6c-e2ea0bc3fcb3 tempest-SharesNFSTest-667257547 None] --- [GET] https://127.0.0.1:40443/api/vippools/: Done May 28 13:01:02 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2b20789d-29d9-4855-bc6c-e2ea0bc3fcb3 tempest-SharesNFSTest-667257547 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:01:02 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2b20789d-29d9-4855-bc6c-e2ea0bc3fcb3 tempest-SharesNFSTest-667257547 None] {'allow_redirects': True, May 28 13:01:02 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2b20789d-29d9-4855-bc6c-e2ea0bc3fcb3 tempest-SharesNFSTest-667257547 None] 'params': {'name': 'd935f840-e1e2-4366-85e1-9cee599842b6'}} May 28 13:01:02 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a7b29572-6529-4a7c-b1fa-57b384c3fb7a tempest-ShareTypeAvailabilityZonesTest-364532124 None] <<< [DELETE] https://127.0.0.1:40443/api/views/44/ May 28 13:01:02 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a7b29572-6529-4a7c-b1fa-57b384c3fb7a tempest-ShareTypeAvailabilityZonesTest-364532124 None] --- [DELETE] https://127.0.0.1:40443/api/views/44/: Done May 28 13:01:02 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a7b29572-6529-4a7c-b1fa-57b384c3fb7a tempest-ShareTypeAvailabilityZonesTest-364532124 None] >>> [GET] https://127.0.0.1:40443/api/quotas/ May 28 13:01:02 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a7b29572-6529-4a7c-b1fa-57b384c3fb7a tempest-ShareTypeAvailabilityZonesTest-364532124 None] {'allow_redirects': True, May 28 13:01:02 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a7b29572-6529-4a7c-b1fa-57b384c3fb7a tempest-ShareTypeAvailabilityZonesTest-364532124 None] 'params': {'name': '946d9bf7-603c-4faa-8dbe-2cf88c9c8291'}} May 28 13:01:02 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b6208dee-0ea9-470b-81c4-deddd7bd6a6f tempest-ShareRulesNegativeTest-930400775 None] <<< [DELETE] https://127.0.0.1:40443/api/snapshots/13/ May 28 13:01:02 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b6208dee-0ea9-470b-81c4-deddd7bd6a6f tempest-ShareRulesNegativeTest-930400775 None] --- [DELETE] https://127.0.0.1:40443/api/snapshots/13/: Done May 28 13:01:02 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-1644751a-a6aa-46cb-b9b4-a64cba370acb tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] GET http://10.27.203.238/share/v2/284d76edec3144579d6fb3f6dbc0dd4e/shares/da80429c-1281-4450-a386-ed0e9d82a3ff May 28 13:01:02 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-1644751a-a6aa-46cb-b9b4-a64cba370acb tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:02 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-1644751a-a6aa-46cb-b9b4-a64cba370acb tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:02 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-1644751a-a6aa-46cb-b9b4-a64cba370acb tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] http://10.27.203.238/share/v2/284d76edec3144579d6fb3f6dbc0dd4e/shares/da80429c-1281-4450-a386-ed0e9d82a3ff returned with HTTP 200 May 28 13:01:02 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1023/2008] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:01:02 2024] GET /share/v2/284d76edec3144579d6fb3f6dbc0dd4e/shares/da80429c-1281-4450-a386-ed0e9d82a3ff => generated 1316 bytes in 26 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:01:02 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a7b29572-6529-4a7c-b1fa-57b384c3fb7a tempest-ShareTypeAvailabilityZonesTest-364532124 None] <<< [GET] https://127.0.0.1:40443/api/quotas/ May 28 13:01:02 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a7b29572-6529-4a7c-b1fa-57b384c3fb7a tempest-ShareTypeAvailabilityZonesTest-364532124 None] [Bunch(cluster='loop75-kfs', cluster_id=1, default_email=None, default_group_quota=None, default_user_quota=None, enable_alarms=True, enable_email_providers=True, grace_period=None, guid='399ae783-a3a0-4a28-9824-9659f1da5759', hard_limit=1073741824, hard_limit_inodes=None, id=42, internal=False, is_user_quota=False, last_user_quotas_update=None, name='946d9bf7-603c-4faa-8dbe-2cf88c9c8291', num_blocked_users=0, num_exceeded_users=0, path='/manila/manila-946d9bf7-603c-4faa-8dbe-2cf88c9c8291', percent_capacity=0, percent_inodes=None, pretty_grace_period=None, pretty_grace_period_expiration=None, pretty_state='OK (Calculating)', soft_limit=None, soft_limit_inodes=None, state='OK', sync_state='Calculating', system_id=42, tenant_id=1, tenant_name='default', time_to_block=None, title='946d9bf7-603c-4faa-8dbe-2cf88c9c8291', url='https://127.0.0.1:40443/api/quotas/42/', used_capacity=0, used_capacity_tb=0.0, used_effective_capacity=0, used_effective_capacity_tb=0.0, used_inodes=0, used_limited_capacity=0)] May 28 13:01:02 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a7b29572-6529-4a7c-b1fa-57b384c3fb7a tempest-ShareTypeAvailabilityZonesTest-364532124 None] --- [GET] https://127.0.0.1:40443/api/quotas/: Done May 28 13:01:02 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a7b29572-6529-4a7c-b1fa-57b384c3fb7a tempest-ShareTypeAvailabilityZonesTest-364532124 None] >>> [DELETE] https://127.0.0.1:40443/api/quotas/42/ May 28 13:01:02 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2b20789d-29d9-4855-bc6c-e2ea0bc3fcb3 tempest-SharesNFSTest-667257547 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:01:02 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2b20789d-29d9-4855-bc6c-e2ea0bc3fcb3 tempest-SharesNFSTest-667257547 None] [] May 28 13:01:02 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2b20789d-29d9-4855-bc6c-e2ea0bc3fcb3 tempest-SharesNFSTest-667257547 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 13:01:02 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2b20789d-29d9-4855-bc6c-e2ea0bc3fcb3 tempest-SharesNFSTest-667257547 None] >>> [POST] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:01:02 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2b20789d-29d9-4855-bc6c-e2ea0bc3fcb3 tempest-SharesNFSTest-667257547 None] {'data': '{"name": "d935f840-e1e2-4366-85e1-9cee599842b6"}', May 28 13:01:02 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2b20789d-29d9-4855-bc6c-e2ea0bc3fcb3 tempest-SharesNFSTest-667257547 None] 'json': None, May 28 13:01:02 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2b20789d-29d9-4855-bc6c-e2ea0bc3fcb3 tempest-SharesNFSTest-667257547 None] 'params': None} May 28 13:01:03 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-b6208dee-0ea9-470b-81c4-deddd7bd6a6f tempest-ShareRulesNegativeTest-930400775 None] Created reservations ['03eaaeba-7d55-4b6c-9a49-fc0a773104b0', 'f99d736e-9515-42c3-bc1b-e6f5de8ac59f', '5b0763b7-52c8-4293-b51d-d0934581809e', 'cedeb3d4-3ffa-4e07-a919-a1c23133f7e1'] {{(pid=98474) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 13:01:03 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-b6208dee-0ea9-470b-81c4-deddd7bd6a6f tempest-ShareRulesNegativeTest-930400775 None] Committed reservations ['03eaaeba-7d55-4b6c-9a49-fc0a773104b0', 'f99d736e-9515-42c3-bc1b-e6f5de8ac59f', '5b0763b7-52c8-4293-b51d-d0934581809e', 'cedeb3d4-3ffa-4e07-a919-a1c23133f7e1'] {{(pid=98474) commit /opt/stack/manila/manila/quota.py:1063}} May 28 13:01:03 l75lg1-v1 dstat.sh[49771]: 28-05 13:01:03| 2 0 95 2 0|5698M 1746M 278M 7903M| 18k 2954B| 0 2196k| 0 169 |3190 5068 |1.84 1.28 1.09|1.0 1.0 0| 0 0 | 0 2048M| 29 363 0 30 2 May 28 13:01:03 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-376f6a4f-c915-416a-af0c-bd96192dd711 tempest-ShareRulesTest-1530341375 None] <<< [DELETE] https://127.0.0.1:40443/api/views/47/ May 28 13:01:03 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-376f6a4f-c915-416a-af0c-bd96192dd711 tempest-ShareRulesTest-1530341375 None] --- [DELETE] https://127.0.0.1:40443/api/views/47/: Done May 28 13:01:03 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-376f6a4f-c915-416a-af0c-bd96192dd711 tempest-ShareRulesTest-1530341375 None] >>> [GET] https://127.0.0.1:40443/api/quotas/ May 28 13:01:03 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-376f6a4f-c915-416a-af0c-bd96192dd711 tempest-ShareRulesTest-1530341375 None] {'allow_redirects': True, May 28 13:01:03 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-376f6a4f-c915-416a-af0c-bd96192dd711 tempest-ShareRulesTest-1530341375 None] 'params': {'name': 'f20d9b3a-8716-4664-aff7-80ddf3014290'}} May 28 13:01:04 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2b20789d-29d9-4855-bc6c-e2ea0bc3fcb3 tempest-SharesNFSTest-667257547 None] <<< [POST] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:01:04 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2b20789d-29d9-4855-bc6c-e2ea0bc3fcb3 tempest-SharesNFSTest-667257547 None] Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=0, created='2024-05-28T13:01:03.579454Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='f5dc5bb3-94a0-46a4-91de-808829f9b9a9', id=49, internal=False, is_s3_default_policy=False, name='d935f840-e1e2-4366-85e1-9cee599842b6', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=[], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['*'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['*'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T13:01:03.940297Z', tenant_id=1, tenant_name='default', title='d935f840-e1e2-4366-85e1-9cee599842b6', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/49/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[]) May 28 13:01:04 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2b20789d-29d9-4855-bc6c-e2ea0bc3fcb3 tempest-SharesNFSTest-667257547 None] --- [POST] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 13:01:04 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2b20789d-29d9-4855-bc6c-e2ea0bc3fcb3 tempest-SharesNFSTest-667257547 None] >>> [GET] https://127.0.0.1:40443/api/quotas/ May 28 13:01:04 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2b20789d-29d9-4855-bc6c-e2ea0bc3fcb3 tempest-SharesNFSTest-667257547 None] {'allow_redirects': True, May 28 13:01:04 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2b20789d-29d9-4855-bc6c-e2ea0bc3fcb3 tempest-SharesNFSTest-667257547 None] 'params': {'name': 'd935f840-e1e2-4366-85e1-9cee599842b6'}} May 28 13:01:04 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-6100bca3-0776-48c6-9146-06ef9a2a4c2e tempest-ShareRulesNegativeTest-930400775 tempest-ShareRulesNegativeTest-930400775-project-member] GET http://10.27.203.238/share/v2/329a14ab984146feb9f91e467ab4e3b5/snapshots/98f3b924-cebf-46a4-9429-7f55792a0941 May 28 13:01:04 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-6100bca3-0776-48c6-9146-06ef9a2a4c2e tempest-ShareRulesNegativeTest-930400775 tempest-ShareRulesNegativeTest-930400775-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:04 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-6100bca3-0776-48c6-9146-06ef9a2a4c2e tempest-ShareRulesNegativeTest-930400775 tempest-ShareRulesNegativeTest-930400775-project-member] Calling method 'ShareSnapshotMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:04 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-6100bca3-0776-48c6-9146-06ef9a2a4c2e tempest-ShareRulesNegativeTest-930400775 tempest-ShareRulesNegativeTest-930400775-project-member] HTTP exception thrown: The resource could not be found. May 28 13:01:04 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-6100bca3-0776-48c6-9146-06ef9a2a4c2e tempest-ShareRulesNegativeTest-930400775 tempest-ShareRulesNegativeTest-930400775-project-member] http://10.27.203.238/share/v2/329a14ab984146feb9f91e467ab4e3b5/snapshots/98f3b924-cebf-46a4-9429-7f55792a0941 returned with HTTP 404 May 28 13:01:04 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 986/2009] 10.27.203.238 () {64 vars in 1460 bytes} [Tue May 28 13:01:04 2024] GET /share/v2/329a14ab984146feb9f91e467ab4e3b5/snapshots/98f3b924-cebf-46a4-9429-7f55792a0941 => generated 78 bytes in 14 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 13:01:04 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-eecdddca-ed2a-4f12-ad2d-50d37d841045 tempest-ShareRulesNegativeTest-930400775 tempest-ShareRulesNegativeTest-930400775-project-member] GET http://10.27.203.238/share/v2/329a14ab984146feb9f91e467ab4e3b5/share-replicas/detail?share_id=623ccf6c-1398-4ab6-9f67-73e600565f38 May 28 13:01:04 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-eecdddca-ed2a-4f12-ad2d-50d37d841045 tempest-ShareRulesNegativeTest-930400775 tempest-ShareRulesNegativeTest-930400775-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:04 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-eecdddca-ed2a-4f12-ad2d-50d37d841045 tempest-ShareRulesNegativeTest-930400775 tempest-ShareRulesNegativeTest-930400775-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:04 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-eecdddca-ed2a-4f12-ad2d-50d37d841045 tempest-ShareRulesNegativeTest-930400775 tempest-ShareRulesNegativeTest-930400775-project-member] http://10.27.203.238/share/v2/329a14ab984146feb9f91e467ab4e3b5/share-replicas/detail?share_id=623ccf6c-1398-4ab6-9f67-73e600565f38 returned with HTTP 200 May 28 13:01:04 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1024/2010] 10.27.203.238 () {64 vars in 1476 bytes} [Tue May 28 13:01:04 2024] GET /share/v2/329a14ab984146feb9f91e467ab4e3b5/share-replicas/detail?share_id=623ccf6c-1398-4ab6-9f67-73e600565f38 => generated 22 bytes in 14 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:01:04 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-ac3e66df-c9d2-4bb7-b906-b126c2362742 tempest-ShareRulesNegativeTest-930400775 tempest-ShareRulesNegativeTest-930400775-project-member] DELETE http://10.27.203.238/share/v2/329a14ab984146feb9f91e467ab4e3b5/shares/623ccf6c-1398-4ab6-9f67-73e600565f38 May 28 13:01:04 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-ac3e66df-c9d2-4bb7-b906-b126c2362742 tempest-ShareRulesNegativeTest-930400775 tempest-ShareRulesNegativeTest-930400775-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:04 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-ac3e66df-c9d2-4bb7-b906-b126c2362742 tempest-ShareRulesNegativeTest-930400775 tempest-ShareRulesNegativeTest-930400775-project-member] Calling method 'ShareMixin.delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:04 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.v1.shares [None req-ac3e66df-c9d2-4bb7-b906-b126c2362742 tempest-ShareRulesNegativeTest-930400775 tempest-ShareRulesNegativeTest-930400775-project-member] Delete share with id: 623ccf6c-1398-4ab6-9f67-73e600565f38 May 28 13:01:04 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-ac3e66df-c9d2-4bb7-b906-b126c2362742 tempest-ShareRulesNegativeTest-930400775 tempest-ShareRulesNegativeTest-930400775-project-member] http://10.27.203.238/share/v2/329a14ab984146feb9f91e467ab4e3b5/shares/623ccf6c-1398-4ab6-9f67-73e600565f38 returned with HTTP 202 May 28 13:01:04 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 987/2011] 10.27.203.238 () {64 vars in 1454 bytes} [Tue May 28 13:01:04 2024] DELETE /share/v2/329a14ab984146feb9f91e467ab4e3b5/shares/623ccf6c-1398-4ab6-9f67-73e600565f38 => generated 0 bytes in 142 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 13:01:04 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-3cf12a11-03ea-4fe4-a684-b9ce36ad5b15 tempest-ShareRulesNegativeTest-930400775 tempest-ShareRulesNegativeTest-930400775-project-member] GET http://10.27.203.238/share/v2/329a14ab984146feb9f91e467ab4e3b5/shares/623ccf6c-1398-4ab6-9f67-73e600565f38 May 28 13:01:04 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-3cf12a11-03ea-4fe4-a684-b9ce36ad5b15 tempest-ShareRulesNegativeTest-930400775 tempest-ShareRulesNegativeTest-930400775-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:04 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-3cf12a11-03ea-4fe4-a684-b9ce36ad5b15 tempest-ShareRulesNegativeTest-930400775 tempest-ShareRulesNegativeTest-930400775-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:04 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-3cf12a11-03ea-4fe4-a684-b9ce36ad5b15 tempest-ShareRulesNegativeTest-930400775 tempest-ShareRulesNegativeTest-930400775-project-member] http://10.27.203.238/share/v2/329a14ab984146feb9f91e467ab4e3b5/shares/623ccf6c-1398-4ab6-9f67-73e600565f38 returned with HTTP 200 May 28 13:01:04 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1025/2012] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:01:04 2024] GET /share/v2/329a14ab984146feb9f91e467ab4e3b5/shares/623ccf6c-1398-4ab6-9f67-73e600565f38 => generated 1314 bytes in 27 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:01:04 l75lg1-v1 dstat.sh[49771]: 28-05 13:01:04| 3 0 95 1 0|5698M 1746M 278M 7903M| 17k 1508B| 0 1024k| 0 81.0 |2228 3772 |1.84 1.28 1.09|2.0 1.0 0| 0 0 | 0 2048M| 29 364 0 31 2 May 28 13:01:04 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-ac3e66df-c9d2-4bb7-b906-b126c2362742 tempest-ShareRulesNegativeTest-930400775 None] Acquiring lock "locked_access_rules_operation_by_share_instance_e0a28587-55d6-44c6-8c73-249d5047f95e" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:01:04 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-ac3e66df-c9d2-4bb7-b906-b126c2362742 tempest-ShareRulesNegativeTest-930400775 None] Lock "locked_access_rules_operation_by_share_instance_e0a28587-55d6-44c6-8c73-249d5047f95e" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:01:04 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-ac3e66df-c9d2-4bb7-b906-b126c2362742 tempest-ShareRulesNegativeTest-930400775 None] Lock "locked_access_rules_operation_by_share_instance_e0a28587-55d6-44c6-8c73-249d5047f95e" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:01:04 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-ac3e66df-c9d2-4bb7-b906-b126c2362742 tempest-ShareRulesNegativeTest-930400775 None] Acquiring lock "locked_access_rules_operation_by_share_instance_e0a28587-55d6-44c6-8c73-249d5047f95e" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:01:04 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-ac3e66df-c9d2-4bb7-b906-b126c2362742 tempest-ShareRulesNegativeTest-930400775 None] Lock "locked_access_rules_operation_by_share_instance_e0a28587-55d6-44c6-8c73-249d5047f95e" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:01:04 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-ac3e66df-c9d2-4bb7-b906-b126c2362742 tempest-ShareRulesNegativeTest-930400775 None] Lock "locked_access_rules_operation_by_share_instance_e0a28587-55d6-44c6-8c73-249d5047f95e" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:01:04 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-ac3e66df-c9d2-4bb7-b906-b126c2362742 tempest-ShareRulesNegativeTest-930400775 None] Acquiring lock "locked_access_rules_operation_by_share_instance_e0a28587-55d6-44c6-8c73-249d5047f95e" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:01:04 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-ac3e66df-c9d2-4bb7-b906-b126c2362742 tempest-ShareRulesNegativeTest-930400775 None] Lock "locked_access_rules_operation_by_share_instance_e0a28587-55d6-44c6-8c73-249d5047f95e" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:01:04 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-ac3e66df-c9d2-4bb7-b906-b126c2362742 tempest-ShareRulesNegativeTest-930400775 None] Lock "locked_access_rules_operation_by_share_instance_e0a28587-55d6-44c6-8c73-249d5047f95e" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:01:04 l75lg1-v1 manila-share[98474]: DEBUG manila.share.access [None req-ac3e66df-c9d2-4bb7-b906-b126c2362742 tempest-ShareRulesNegativeTest-930400775 None] All access rules have been synced for share instance e0a28587-55d6-44c6-8c73-249d5047f95e belonging to share 623ccf6c-1398-4ab6-9f67-73e600565f38. {{(pid=98474) update_access_rules /opt/stack/manila/manila/share/access.py:304}} May 28 13:01:04 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-ac3e66df-c9d2-4bb7-b906-b126c2362742 tempest-ShareRulesNegativeTest-930400775 None] deleting '/manila/manila-e0a28587-55d6-44c6-8c73-249d5047f95e' May 28 13:01:04 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ac3e66df-c9d2-4bb7-b906-b126c2362742 tempest-ShareRulesNegativeTest-930400775 None] >>> [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/ May 28 13:01:04 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ac3e66df-c9d2-4bb7-b906-b126c2362742 tempest-ShareRulesNegativeTest-930400775 None] {'data': '{"path": "/manila/manila-e0a28587-55d6-44c6-8c73-249d5047f95e"}', May 28 13:01:04 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ac3e66df-c9d2-4bb7-b906-b126c2362742 tempest-ShareRulesNegativeTest-930400775 None] 'params': None} May 28 13:01:04 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2b20789d-29d9-4855-bc6c-e2ea0bc3fcb3 tempest-SharesNFSTest-667257547 None] <<< [GET] https://127.0.0.1:40443/api/quotas/ May 28 13:01:04 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2b20789d-29d9-4855-bc6c-e2ea0bc3fcb3 tempest-SharesNFSTest-667257547 None] [] May 28 13:01:04 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2b20789d-29d9-4855-bc6c-e2ea0bc3fcb3 tempest-SharesNFSTest-667257547 None] --- [GET] https://127.0.0.1:40443/api/quotas/: Done May 28 13:01:04 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2b20789d-29d9-4855-bc6c-e2ea0bc3fcb3 tempest-SharesNFSTest-667257547 None] >>> [POST] https://127.0.0.1:40443/api/quotas/ May 28 13:01:04 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2b20789d-29d9-4855-bc6c-e2ea0bc3fcb3 tempest-SharesNFSTest-667257547 None] {'data': '{"name": "d935f840-e1e2-4366-85e1-9cee599842b6", "path": ' May 28 13:01:04 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2b20789d-29d9-4855-bc6c-e2ea0bc3fcb3 tempest-SharesNFSTest-667257547 None] '"/manila/manila-d935f840-e1e2-4366-85e1-9cee599842b6", "create_dir": ' May 28 13:01:04 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2b20789d-29d9-4855-bc6c-e2ea0bc3fcb3 tempest-SharesNFSTest-667257547 None] 'true, "hard_limit": 1073741824}', May 28 13:01:04 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2b20789d-29d9-4855-bc6c-e2ea0bc3fcb3 tempest-SharesNFSTest-667257547 None] 'json': None, May 28 13:01:04 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2b20789d-29d9-4855-bc6c-e2ea0bc3fcb3 tempest-SharesNFSTest-667257547 None] 'params': None} May 28 13:01:04 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ac3e66df-c9d2-4bb7-b906-b126c2362742 tempest-ShareRulesNegativeTest-930400775 None] <<< [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/ May 28 13:01:04 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ac3e66df-c9d2-4bb7-b906-b126c2362742 tempest-ShareRulesNegativeTest-930400775 None] 'OK' May 28 13:01:04 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ac3e66df-c9d2-4bb7-b906-b126c2362742 tempest-ShareRulesNegativeTest-930400775 None] --- [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/: Done May 28 13:01:04 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ac3e66df-c9d2-4bb7-b906-b126c2362742 tempest-ShareRulesNegativeTest-930400775 None] >>> [GET] https://127.0.0.1:40443/api/views/ May 28 13:01:04 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ac3e66df-c9d2-4bb7-b906-b126c2362742 tempest-ShareRulesNegativeTest-930400775 None] {'allow_redirects': True, May 28 13:01:04 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ac3e66df-c9d2-4bb7-b906-b126c2362742 tempest-ShareRulesNegativeTest-930400775 None] 'params': {'name': 'e0a28587-55d6-44c6-8c73-249d5047f95e'}} May 28 13:01:04 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-ce95cb74-2d91-4571-9b71-1b8d94f89d5d tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] GET http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/shares/415b1daa-22c2-48a3-873e-80762e65a747 May 28 13:01:04 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-ce95cb74-2d91-4571-9b71-1b8d94f89d5d tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:04 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-ce95cb74-2d91-4571-9b71-1b8d94f89d5d tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:04 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-ce95cb74-2d91-4571-9b71-1b8d94f89d5d tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/shares/415b1daa-22c2-48a3-873e-80762e65a747 returned with HTTP 200 May 28 13:01:04 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 988/2013] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:01:04 2024] GET /share/v2/a4f3887fa28c457390f5b66615564430/shares/415b1daa-22c2-48a3-873e-80762e65a747 => generated 1315 bytes in 27 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:01:04 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-376f6a4f-c915-416a-af0c-bd96192dd711 tempest-ShareRulesTest-1530341375 None] <<< [GET] https://127.0.0.1:40443/api/quotas/ May 28 13:01:04 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-376f6a4f-c915-416a-af0c-bd96192dd711 tempest-ShareRulesTest-1530341375 None] [Bunch(cluster='loop75-kfs', cluster_id=1, default_email=None, default_group_quota=None, default_user_quota=None, enable_alarms=True, enable_email_providers=True, grace_period=None, guid='888d62ee-28d1-4a7f-8a91-d67f243b5982', hard_limit=1073741824, hard_limit_inodes=None, id=45, internal=False, is_user_quota=False, last_user_quotas_update=None, name='f20d9b3a-8716-4664-aff7-80ddf3014290', num_blocked_users=0, num_exceeded_users=0, path='/manila/manila-f20d9b3a-8716-4664-aff7-80ddf3014290', percent_capacity=0, percent_inodes=None, pretty_grace_period=None, pretty_grace_period_expiration=None, pretty_state='OK (CREATED)', soft_limit=None, soft_limit_inodes=None, state='OK', sync_state='CREATED', system_id=45, tenant_id=1, tenant_name='default', time_to_block=None, title='f20d9b3a-8716-4664-aff7-80ddf3014290', url='https://127.0.0.1:40443/api/quotas/45/', used_capacity=0, used_capacity_tb=0.0, used_effective_capacity=0, used_effective_capacity_tb=0.0, used_inodes=0, used_limited_capacity=0)] May 28 13:01:04 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-376f6a4f-c915-416a-af0c-bd96192dd711 tempest-ShareRulesTest-1530341375 None] --- [GET] https://127.0.0.1:40443/api/quotas/: Done May 28 13:01:04 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-376f6a4f-c915-416a-af0c-bd96192dd711 tempest-ShareRulesTest-1530341375 None] >>> [DELETE] https://127.0.0.1:40443/api/quotas/45/ May 28 13:01:05 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ac3e66df-c9d2-4bb7-b906-b126c2362742 tempest-ShareRulesNegativeTest-930400775 None] <<< [GET] https://127.0.0.1:40443/api/views/ May 28 13:01:05 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ac3e66df-c9d2-4bb7-b906-b126c2362742 tempest-ShareRulesNegativeTest-930400775 None] [Bunch(abac_tags=[], abe_max_depth=None, abe_protocols=[], alias='', allow_anonymous_access=False, allow_s3_anonymous_access=False, auto_commit='0d', bucket='', bucket_creators=[], bucket_creators_groups=[], bucket_owner=None, bulk_permission_update_progress=None, bulk_permission_update_state=None, cluster='loop75-kfs', cluster_id=1, created='2024-05-28T13:00:52.047642Z', enabled=True, files_retention_mode='NONE', guid='9de010c1-040b-481a-a326-33fc03c88505', id=46, ignore_oos=False, internal=False, is_remote=False, is_seamless=False, logical_capacity=0, max_retention_period=None, min_retention_period=None, name='e0a28587-55d6-44c6-8c73-249d5047f95e', nfs_interop_flags='BOTH_NFS3_AND_NFS4_INTEROP_DISABLED', path='/manila/manila-e0a28587-55d6-44c6-8c73-249d5047f95e', physical_capacity=0, policy='e0a28587-55d6-44c6-8c73-249d5047f95e', policy_id=47, protocols=['NFS'], qos_policy=None, qos_policy_id=None, s3_locks=False, s3_locks_retention_mode='NONE', s3_locks_retention_period='', s3_unverified_lookup=False, s3_versioning=False, select_for_live_monitoring=False, share='', share_acl=Bunch(acl=[], enabled=False), sync='SYNCED', sync_time='2024-05-28T13:00:52.355580Z', tenant_id=1, tenant_name='default', title='/manila/manila-e0a28587-55d6-44c6-8c73-249d5047f95e', url='https://127.0.0.1:40443/api/views/46/')] May 28 13:01:05 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ac3e66df-c9d2-4bb7-b906-b126c2362742 tempest-ShareRulesNegativeTest-930400775 None] --- [GET] https://127.0.0.1:40443/api/views/: Done May 28 13:01:05 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ac3e66df-c9d2-4bb7-b906-b126c2362742 tempest-ShareRulesNegativeTest-930400775 None] >>> [DELETE] https://127.0.0.1:40443/api/views/46/ May 28 13:01:05 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-8d473786-6071-4ff8-8b8b-40ff2500e897 tempest-SharesNFSTest-667257547 tempest-SharesNFSTest-667257547-project-member] GET http://10.27.203.238/share/v2/0af6f8e0aeed4f27b075e08f2bc713aa/shares/7a762332-0877-462f-941a-6581abbf784b May 28 13:01:05 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-8d473786-6071-4ff8-8b8b-40ff2500e897 tempest-SharesNFSTest-667257547 tempest-SharesNFSTest-667257547-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:05 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-8d473786-6071-4ff8-8b8b-40ff2500e897 tempest-SharesNFSTest-667257547 tempest-SharesNFSTest-667257547-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:05 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2b20789d-29d9-4855-bc6c-e2ea0bc3fcb3 tempest-SharesNFSTest-667257547 None] <<< [POST] https://127.0.0.1:40443/api/quotas/ May 28 13:01:05 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2b20789d-29d9-4855-bc6c-e2ea0bc3fcb3 tempest-SharesNFSTest-667257547 None] Bunch(cluster='loop75-kfs', cluster_id=1, default_email=None, default_group_quota=None, default_user_quota=None, enable_alarms=True, enable_email_providers=True, grace_period=None, group_quotas=[], guid='ca6b8fa3-9f51-4d09-873e-7c7703e6d8cc', hard_limit=1073741824, hard_limit_inodes=None, id=46, internal=False, is_user_quota=False, last_user_quotas_update=None, name='d935f840-e1e2-4366-85e1-9cee599842b6', num_blocked_users=0, num_exceeded_users=0, path='/manila/manila-d935f840-e1e2-4366-85e1-9cee599842b6', percent_capacity=0, percent_inodes=None, pretty_grace_period=None, pretty_grace_period_expiration=None, pretty_state='OK (CREATED)', soft_limit=None, soft_limit_inodes=None, state='OK', sync_state='CREATED', system_id=46, tenant_id=1, tenant_name='default', time_to_block=None, title='d935f840-e1e2-4366-85e1-9cee599842b6', url='https://127.0.0.1:40443/api/quotas/46/', used_capacity=0, used_capacity_tb=0.0, used_effective_capacity=0, used_effective_capacity_tb=0.0, used_inodes=0, used_limited_capacity=0, user_quotas=[]) May 28 13:01:05 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2b20789d-29d9-4855-bc6c-e2ea0bc3fcb3 tempest-SharesNFSTest-667257547 None] --- [POST] https://127.0.0.1:40443/api/quotas/: Done May 28 13:01:05 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2b20789d-29d9-4855-bc6c-e2ea0bc3fcb3 tempest-SharesNFSTest-667257547 None] >>> [GET] https://127.0.0.1:40443/api/views/ May 28 13:01:05 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2b20789d-29d9-4855-bc6c-e2ea0bc3fcb3 tempest-SharesNFSTest-667257547 None] {'allow_redirects': True, May 28 13:01:05 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2b20789d-29d9-4855-bc6c-e2ea0bc3fcb3 tempest-SharesNFSTest-667257547 None] 'params': {'name': 'd935f840-e1e2-4366-85e1-9cee599842b6'}} May 28 13:01:05 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-8d473786-6071-4ff8-8b8b-40ff2500e897 tempest-SharesNFSTest-667257547 tempest-SharesNFSTest-667257547-project-member] http://10.27.203.238/share/v2/0af6f8e0aeed4f27b075e08f2bc713aa/shares/7a762332-0877-462f-941a-6581abbf784b returned with HTTP 200 May 28 13:01:05 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1026/2014] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:01:05 2024] GET /share/v2/0af6f8e0aeed4f27b075e08f2bc713aa/shares/7a762332-0877-462f-941a-6581abbf784b => generated 1314 bytes in 28 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:01:05 l75lg1-v1 dstat.sh[49771]: 28-05 13:01:05| 2 0 96 0 0|5698M 1745M 278M 7903M| 30k 5602B| 0 651k| 0 46.9 |2294 3528 |1.84 1.28 1.09|1.0 1.0 0| 0 0 | 0 2048M| 29 363 0 31 2 May 28 13:01:05 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2b20789d-29d9-4855-bc6c-e2ea0bc3fcb3 tempest-SharesNFSTest-667257547 None] <<< [GET] https://127.0.0.1:40443/api/views/ May 28 13:01:05 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2b20789d-29d9-4855-bc6c-e2ea0bc3fcb3 tempest-SharesNFSTest-667257547 None] [] May 28 13:01:05 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2b20789d-29d9-4855-bc6c-e2ea0bc3fcb3 tempest-SharesNFSTest-667257547 None] --- [GET] https://127.0.0.1:40443/api/views/: Done May 28 13:01:05 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2b20789d-29d9-4855-bc6c-e2ea0bc3fcb3 tempest-SharesNFSTest-667257547 None] >>> [POST] https://127.0.0.1:40443/api/views/ May 28 13:01:05 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2b20789d-29d9-4855-bc6c-e2ea0bc3fcb3 tempest-SharesNFSTest-667257547 None] {'data': '{"name": "d935f840-e1e2-4366-85e1-9cee599842b6", "path": ' May 28 13:01:05 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2b20789d-29d9-4855-bc6c-e2ea0bc3fcb3 tempest-SharesNFSTest-667257547 None] '"/manila/manila-d935f840-e1e2-4366-85e1-9cee599842b6", "policy_id": ' May 28 13:01:05 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2b20789d-29d9-4855-bc6c-e2ea0bc3fcb3 tempest-SharesNFSTest-667257547 None] '49, "create_dir": true, "protocols": ["NFS"]}', May 28 13:01:05 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2b20789d-29d9-4855-bc6c-e2ea0bc3fcb3 tempest-SharesNFSTest-667257547 None] 'json': None, May 28 13:01:05 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2b20789d-29d9-4855-bc6c-e2ea0bc3fcb3 tempest-SharesNFSTest-667257547 None] 'params': None} May 28 13:01:05 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-9a047ab9-feef-4c9e-8e4f-678ca5cfd1b8 tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] GET http://10.27.203.238/share/v2/284d76edec3144579d6fb3f6dbc0dd4e/shares/da80429c-1281-4450-a386-ed0e9d82a3ff May 28 13:01:05 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-9a047ab9-feef-4c9e-8e4f-678ca5cfd1b8 tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:05 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-9a047ab9-feef-4c9e-8e4f-678ca5cfd1b8 tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:05 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-9a047ab9-feef-4c9e-8e4f-678ca5cfd1b8 tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] http://10.27.203.238/share/v2/284d76edec3144579d6fb3f6dbc0dd4e/shares/da80429c-1281-4450-a386-ed0e9d82a3ff returned with HTTP 200 May 28 13:01:05 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 989/2015] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:01:05 2024] GET /share/v2/284d76edec3144579d6fb3f6dbc0dd4e/shares/da80429c-1281-4450-a386-ed0e9d82a3ff => generated 1316 bytes in 26 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:01:06 l75lg1-v1 dstat.sh[49771]: 28-05 13:01:06| 1 0 98 1 0|5698M 1745M 278M 7903M| 22k 1180B| 0 449k| 0 36.0 |1905 2869 |1.84 1.28 1.09|2.0 0 0| 0 0 | 0 2048M| 29 363 0 31 2 May 28 13:01:06 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a7b29572-6529-4a7c-b1fa-57b384c3fb7a tempest-ShareTypeAvailabilityZonesTest-364532124 None] <<< [DELETE] https://127.0.0.1:40443/api/quotas/42/ May 28 13:01:06 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a7b29572-6529-4a7c-b1fa-57b384c3fb7a tempest-ShareTypeAvailabilityZonesTest-364532124 None] --- [DELETE] https://127.0.0.1:40443/api/quotas/42/: Done May 28 13:01:06 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a7b29572-6529-4a7c-b1fa-57b384c3fb7a tempest-ShareTypeAvailabilityZonesTest-364532124 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:01:06 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a7b29572-6529-4a7c-b1fa-57b384c3fb7a tempest-ShareTypeAvailabilityZonesTest-364532124 None] {'allow_redirects': True, May 28 13:01:06 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a7b29572-6529-4a7c-b1fa-57b384c3fb7a tempest-ShareTypeAvailabilityZonesTest-364532124 None] 'params': {'name': '946d9bf7-603c-4faa-8dbe-2cf88c9c8291'}} May 28 13:01:06 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2b20789d-29d9-4855-bc6c-e2ea0bc3fcb3 tempest-SharesNFSTest-667257547 None] <<< [POST] https://127.0.0.1:40443/api/views/ May 28 13:01:06 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2b20789d-29d9-4855-bc6c-e2ea0bc3fcb3 tempest-SharesNFSTest-667257547 None] Bunch(abac_tags=[], abe_max_depth=None, abe_protocols=[], alias='', allow_anonymous_access=False, allow_s3_anonymous_access=False, auto_commit='0d', bucket='', bucket_creators=[], bucket_creators_groups=[], bucket_owner=None, bulk_permission_update_progress=None, bulk_permission_update_state=None, cluster='loop75-kfs', cluster_id=1, created='2024-05-28T13:01:06.317967Z', enabled=True, files_retention_mode='NONE', guid='f1f7a301-a0dc-499c-bc1c-871bb834882a', id=48, ignore_oos=False, internal=False, is_remote=False, is_seamless=False, logical_capacity=0, max_retention_period=None, min_retention_period=None, name='d935f840-e1e2-4366-85e1-9cee599842b6', nfs_interop_flags='BOTH_NFS3_AND_NFS4_INTEROP_DISABLED', path='/manila/manila-d935f840-e1e2-4366-85e1-9cee599842b6', physical_capacity=0, policy='d935f840-e1e2-4366-85e1-9cee599842b6', policy_id=49, protocols=['NFS'], qos_policy=None, qos_policy_id=None, s3_locks=False, s3_locks_retention_mode='NONE', s3_locks_retention_period='', s3_object_ownership_rule='ObjectWriter', s3_unverified_lookup=False, s3_versioning=False, select_for_live_monitoring=False, share='', share_acl=Bunch(acl=[], enabled=False), sync='SYNCED', sync_time='2024-05-28T13:01:06.616425Z', tenant_id=1, tenant_name='default', title='/manila/manila-d935f840-e1e2-4366-85e1-9cee599842b6', url='https://127.0.0.1:40443/api/views/48/') May 28 13:01:06 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2b20789d-29d9-4855-bc6c-e2ea0bc3fcb3 tempest-SharesNFSTest-667257547 None] --- [POST] https://127.0.0.1:40443/api/views/: Done May 28 13:01:06 l75lg1-v1 manila-share[98474]: INFO manila.share.manager [None req-2b20789d-29d9-4855-bc6c-e2ea0bc3fcb3 tempest-SharesNFSTest-667257547 None] Share instance d935f840-e1e2-4366-85e1-9cee599842b6 created successfully. May 28 13:01:06 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a7b29572-6529-4a7c-b1fa-57b384c3fb7a tempest-ShareTypeAvailabilityZonesTest-364532124 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:01:06 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a7b29572-6529-4a7c-b1fa-57b384c3fb7a tempest-ShareTypeAvailabilityZonesTest-364532124 None] [Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=0, created='2024-05-28T13:00:39.443803Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='1ca71fd1-116f-4fdc-94d0-9f70de97877e', id=45, internal=False, is_s3_default_policy=False, name='946d9bf7-603c-4faa-8dbe-2cf88c9c8291', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=[], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['*'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['*'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T13:00:39.819542Z', tenant_id=1, tenant_name='default', title='946d9bf7-603c-4faa-8dbe-2cf88c9c8291', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/45/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[])] May 28 13:01:06 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a7b29572-6529-4a7c-b1fa-57b384c3fb7a tempest-ShareTypeAvailabilityZonesTest-364532124 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 13:01:06 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a7b29572-6529-4a7c-b1fa-57b384c3fb7a tempest-ShareTypeAvailabilityZonesTest-364532124 None] >>> [DELETE] https://127.0.0.1:40443/api/viewpolicies/45/ May 28 13:01:07 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ac3e66df-c9d2-4bb7-b906-b126c2362742 tempest-ShareRulesNegativeTest-930400775 None] <<< [DELETE] https://127.0.0.1:40443/api/views/46/ May 28 13:01:07 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ac3e66df-c9d2-4bb7-b906-b126c2362742 tempest-ShareRulesNegativeTest-930400775 None] --- [DELETE] https://127.0.0.1:40443/api/views/46/: Done May 28 13:01:07 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ac3e66df-c9d2-4bb7-b906-b126c2362742 tempest-ShareRulesNegativeTest-930400775 None] >>> [GET] https://127.0.0.1:40443/api/quotas/ May 28 13:01:07 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ac3e66df-c9d2-4bb7-b906-b126c2362742 tempest-ShareRulesNegativeTest-930400775 None] {'allow_redirects': True, May 28 13:01:07 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ac3e66df-c9d2-4bb7-b906-b126c2362742 tempest-ShareRulesNegativeTest-930400775 None] 'params': {'name': 'e0a28587-55d6-44c6-8c73-249d5047f95e'}} May 28 13:01:07 l75lg1-v1 dstat.sh[49771]: 28-05 13:01:07| 1 1 97 1 0|5698M 1745M 278M 7903M| 29k 2124B| 0 735k| 0 71.9 |2236 3353 |1.69 1.26 1.08|1.0 1.0 0| 0 0 | 0 2048M| 29 363 0 31 2 May 28 13:01:07 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-08ea25d3-446b-4261-ada3-28ef66236e6f tempest-ShareRulesNegativeTest-930400775 tempest-ShareRulesNegativeTest-930400775-project-member] GET http://10.27.203.238/share/v2/329a14ab984146feb9f91e467ab4e3b5/shares/623ccf6c-1398-4ab6-9f67-73e600565f38 May 28 13:01:07 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-08ea25d3-446b-4261-ada3-28ef66236e6f tempest-ShareRulesNegativeTest-930400775 tempest-ShareRulesNegativeTest-930400775-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:07 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-08ea25d3-446b-4261-ada3-28ef66236e6f tempest-ShareRulesNegativeTest-930400775 tempest-ShareRulesNegativeTest-930400775-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:07 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-08ea25d3-446b-4261-ada3-28ef66236e6f tempest-ShareRulesNegativeTest-930400775 tempest-ShareRulesNegativeTest-930400775-project-member] http://10.27.203.238/share/v2/329a14ab984146feb9f91e467ab4e3b5/shares/623ccf6c-1398-4ab6-9f67-73e600565f38 returned with HTTP 200 May 28 13:01:07 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1027/2016] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:01:07 2024] GET /share/v2/329a14ab984146feb9f91e467ab4e3b5/shares/623ccf6c-1398-4ab6-9f67-73e600565f38 => generated 1314 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:01:07 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ac3e66df-c9d2-4bb7-b906-b126c2362742 tempest-ShareRulesNegativeTest-930400775 None] <<< [GET] https://127.0.0.1:40443/api/quotas/ May 28 13:01:07 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ac3e66df-c9d2-4bb7-b906-b126c2362742 tempest-ShareRulesNegativeTest-930400775 None] [Bunch(cluster='loop75-kfs', cluster_id=1, default_email=None, default_group_quota=None, default_user_quota=None, enable_alarms=True, enable_email_providers=True, grace_period=None, guid='5372c080-8289-4d14-9a86-ebfe36c78208', hard_limit=1073741824, hard_limit_inodes=None, id=44, internal=False, is_user_quota=False, last_user_quotas_update=None, name='e0a28587-55d6-44c6-8c73-249d5047f95e', num_blocked_users=0, num_exceeded_users=0, path='/manila/manila-e0a28587-55d6-44c6-8c73-249d5047f95e', percent_capacity=0, percent_inodes=None, pretty_grace_period=None, pretty_grace_period_expiration=None, pretty_state='OK (CREATED)', soft_limit=None, soft_limit_inodes=None, state='OK', sync_state='CREATED', system_id=44, tenant_id=1, tenant_name='default', time_to_block=None, title='e0a28587-55d6-44c6-8c73-249d5047f95e', url='https://127.0.0.1:40443/api/quotas/44/', used_capacity=0, used_capacity_tb=0.0, used_effective_capacity=0, used_effective_capacity_tb=0.0, used_inodes=0, used_limited_capacity=0)] May 28 13:01:07 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ac3e66df-c9d2-4bb7-b906-b126c2362742 tempest-ShareRulesNegativeTest-930400775 None] --- [GET] https://127.0.0.1:40443/api/quotas/: Done May 28 13:01:07 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ac3e66df-c9d2-4bb7-b906-b126c2362742 tempest-ShareRulesNegativeTest-930400775 None] >>> [DELETE] https://127.0.0.1:40443/api/quotas/44/ May 28 13:01:07 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-deb33012-83a9-4d5e-b561-5eaa993017c6 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] GET http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/shares/415b1daa-22c2-48a3-873e-80762e65a747 May 28 13:01:07 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-deb33012-83a9-4d5e-b561-5eaa993017c6 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:07 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-deb33012-83a9-4d5e-b561-5eaa993017c6 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:07 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-deb33012-83a9-4d5e-b561-5eaa993017c6 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/shares/415b1daa-22c2-48a3-873e-80762e65a747 returned with HTTP 200 May 28 13:01:07 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 990/2017] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:01:07 2024] GET /share/v2/a4f3887fa28c457390f5b66615564430/shares/415b1daa-22c2-48a3-873e-80762e65a747 => generated 1315 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:01:08 l75lg1-v1 nova-conductor[83648]: DEBUG dbcounter [-] [83648] Writing DB stats nova_cell1:SELECT=2,nova_cell1:UPDATE=1 {{(pid=83648) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:01:08 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-cb55a54f-6ac4-4ba1-b4fa-b1a96bf8503a tempest-SharesNFSTest-667257547 tempest-SharesNFSTest-667257547-project-member] GET http://10.27.203.238/share/v2/0af6f8e0aeed4f27b075e08f2bc713aa/shares/7a762332-0877-462f-941a-6581abbf784b May 28 13:01:08 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-cb55a54f-6ac4-4ba1-b4fa-b1a96bf8503a tempest-SharesNFSTest-667257547 tempest-SharesNFSTest-667257547-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:08 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-cb55a54f-6ac4-4ba1-b4fa-b1a96bf8503a tempest-SharesNFSTest-667257547 tempest-SharesNFSTest-667257547-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:08 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-cb55a54f-6ac4-4ba1-b4fa-b1a96bf8503a tempest-SharesNFSTest-667257547 tempest-SharesNFSTest-667257547-project-member] http://10.27.203.238/share/v2/0af6f8e0aeed4f27b075e08f2bc713aa/shares/7a762332-0877-462f-941a-6581abbf784b returned with HTTP 200 May 28 13:01:08 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1028/2018] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:01:08 2024] GET /share/v2/0af6f8e0aeed4f27b075e08f2bc713aa/shares/7a762332-0877-462f-941a-6581abbf784b => generated 1317 bytes in 26 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:01:08 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-bef6f3a0-ee3c-4e01-961a-7eeb654ff32f tempest-SharesNFSTest-667257547 tempest-SharesNFSTest-667257547-project-member] POST http://10.27.203.238/share/v2/0af6f8e0aeed4f27b075e08f2bc713aa/snapshots May 28 13:01:08 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-bef6f3a0-ee3c-4e01-961a-7eeb654ff32f tempest-SharesNFSTest-667257547 tempest-SharesNFSTest-667257547-project-member] Action: 'create', calling method: ShareSnapshotMixin.create, body: {"snapshot": {"name": "tempest-tempest-created-share-snap-1885147509", "force": false, "description": "Tempest's snapshot", "share_id": "7a762332-0877-462f-941a-6581abbf784b"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:01:08 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.v1.share_snapshots [None req-bef6f3a0-ee3c-4e01-961a-7eeb654ff32f tempest-SharesNFSTest-667257547 tempest-SharesNFSTest-667257547-project-member] Create snapshot from share 7a762332-0877-462f-941a-6581abbf784b May 28 13:01:08 l75lg1-v1 dstat.sh[49771]: 28-05 13:01:08| 3 1 93 3 0|5698M 1745M 278M 7903M| 22k 655B| 0 5010k| 0 359 |2998 4781 |1.69 1.26 1.08|2.0 1.0 2.0| 0 0 | 0 2048M| 29 364 0 30 2 May 28 13:01:08 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.quota [None req-bef6f3a0-ee3c-4e01-961a-7eeb654ff32f tempest-SharesNFSTest-667257547 tempest-SharesNFSTest-667257547-project-member] Created reservations ['2e2f81b5-c56b-4c94-bad8-d6d3746dd189', '73201823-b0d1-4bca-bcd0-516275f4fcef', '0409dc21-62c0-4039-b46f-25836582f3fc', '53c5a0cd-cf00-4f5c-9a4d-3a9f00cae45f'] {{(pid=98330) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 13:01:08 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a7b29572-6529-4a7c-b1fa-57b384c3fb7a tempest-ShareTypeAvailabilityZonesTest-364532124 None] <<< [DELETE] https://127.0.0.1:40443/api/viewpolicies/45/ May 28 13:01:08 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a7b29572-6529-4a7c-b1fa-57b384c3fb7a tempest-ShareTypeAvailabilityZonesTest-364532124 None] --- [DELETE] https://127.0.0.1:40443/api/viewpolicies/45/: Done May 28 13:01:08 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.quota [None req-bef6f3a0-ee3c-4e01-961a-7eeb654ff32f tempest-SharesNFSTest-667257547 tempest-SharesNFSTest-667257547-project-member] Committed reservations ['2e2f81b5-c56b-4c94-bad8-d6d3746dd189', '73201823-b0d1-4bca-bcd0-516275f4fcef', '0409dc21-62c0-4039-b46f-25836582f3fc', '53c5a0cd-cf00-4f5c-9a4d-3a9f00cae45f'] {{(pid=98330) commit /opt/stack/manila/manila/quota.py:1063}} May 28 13:01:08 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-bef6f3a0-ee3c-4e01-961a-7eeb654ff32f tempest-SharesNFSTest-667257547 tempest-SharesNFSTest-667257547-project-member] http://10.27.203.238/share/v2/0af6f8e0aeed4f27b075e08f2bc713aa/snapshots returned with HTTP 202 May 28 13:01:08 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 991/2019] 10.27.203.238 () {66 vars in 1371 bytes} [Tue May 28 13:01:08 2024] POST /share/v2/0af6f8e0aeed4f27b075e08f2bc713aa/snapshots => generated 723 bytes in 204 msecs (HTTP/1.1 202) 6 headers in 237 bytes (1 switches on core 0) May 28 13:01:08 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-b95f7e30-0e14-41e4-9f01-9df04b818c14 tempest-SharesNFSTest-667257547 tempest-SharesNFSTest-667257547-project-member] GET http://10.27.203.238/share/v2/0af6f8e0aeed4f27b075e08f2bc713aa/snapshots/bff3b07e-650b-4bc1-8c88-fcd101dd0295 May 28 13:01:08 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-b95f7e30-0e14-41e4-9f01-9df04b818c14 tempest-SharesNFSTest-667257547 tempest-SharesNFSTest-667257547-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:08 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-b95f7e30-0e14-41e4-9f01-9df04b818c14 tempest-SharesNFSTest-667257547 tempest-SharesNFSTest-667257547-project-member] Calling method 'ShareSnapshotMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:08 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-b95f7e30-0e14-41e4-9f01-9df04b818c14 tempest-SharesNFSTest-667257547 tempest-SharesNFSTest-667257547-project-member] http://10.27.203.238/share/v2/0af6f8e0aeed4f27b075e08f2bc713aa/snapshots/bff3b07e-650b-4bc1-8c88-fcd101dd0295 returned with HTTP 200 May 28 13:01:08 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1029/2020] 10.27.203.238 () {64 vars in 1460 bytes} [Tue May 28 13:01:08 2024] GET /share/v2/0af6f8e0aeed4f27b075e08f2bc713aa/snapshots/bff3b07e-650b-4bc1-8c88-fcd101dd0295 => generated 723 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:01:08 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bef6f3a0-ee3c-4e01-961a-7eeb654ff32f tempest-SharesNFSTest-667257547 None] >>> [POST] https://127.0.0.1:40443/api/snapshots/ May 28 13:01:08 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bef6f3a0-ee3c-4e01-961a-7eeb654ff32f tempest-SharesNFSTest-667257547 None] {'data': '{"path": "/manila/manila-d935f840-e1e2-4366-85e1-9cee599842b6", ' May 28 13:01:08 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bef6f3a0-ee3c-4e01-961a-7eeb654ff32f tempest-SharesNFSTest-667257547 None] '"name": "share-snapshot-1e52452e-8541-435c-86af-51a474395f43"}', May 28 13:01:08 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bef6f3a0-ee3c-4e01-961a-7eeb654ff32f tempest-SharesNFSTest-667257547 None] 'json': None, May 28 13:01:08 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bef6f3a0-ee3c-4e01-961a-7eeb654ff32f tempest-SharesNFSTest-667257547 None] 'params': None} May 28 13:01:08 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-a7b29572-6529-4a7c-b1fa-57b384c3fb7a tempest-ShareTypeAvailabilityZonesTest-364532124 None] Created reservations ['50f65bc6-8035-4029-971b-f70205f2f16e', 'fe0bb578-30e5-4978-911f-fc50eca2b49c', 'a6e3cf0f-ddbb-4809-b65d-751b6da40fff', 'a8d2682e-05c0-4f4f-aa7b-dc8815efea42'] {{(pid=98474) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 13:01:08 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-a7b29572-6529-4a7c-b1fa-57b384c3fb7a tempest-ShareTypeAvailabilityZonesTest-364532124 None] Committed reservations ['50f65bc6-8035-4029-971b-f70205f2f16e', 'fe0bb578-30e5-4978-911f-fc50eca2b49c', 'a6e3cf0f-ddbb-4809-b65d-751b6da40fff', 'a8d2682e-05c0-4f4f-aa7b-dc8815efea42'] {{(pid=98474) commit /opt/stack/manila/manila/quota.py:1063}} May 28 13:01:08 l75lg1-v1 manila-share[98474]: INFO manila.share.manager [None req-a7b29572-6529-4a7c-b1fa-57b384c3fb7a tempest-ShareTypeAvailabilityZonesTest-364532124 None] Share instance 946d9bf7-603c-4faa-8dbe-2cf88c9c8291: deleted successfully. May 28 13:01:08 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-376f6a4f-c915-416a-af0c-bd96192dd711 tempest-ShareRulesTest-1530341375 None] <<< [DELETE] https://127.0.0.1:40443/api/quotas/45/ May 28 13:01:08 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-376f6a4f-c915-416a-af0c-bd96192dd711 tempest-ShareRulesTest-1530341375 None] --- [DELETE] https://127.0.0.1:40443/api/quotas/45/: Done May 28 13:01:08 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-376f6a4f-c915-416a-af0c-bd96192dd711 tempest-ShareRulesTest-1530341375 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:01:08 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-376f6a4f-c915-416a-af0c-bd96192dd711 tempest-ShareRulesTest-1530341375 None] {'allow_redirects': True, May 28 13:01:08 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-376f6a4f-c915-416a-af0c-bd96192dd711 tempest-ShareRulesTest-1530341375 None] 'params': {'name': 'f20d9b3a-8716-4664-aff7-80ddf3014290'}} May 28 13:01:08 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-49f466b0-06f9-4d29-b764-1063c034aa2d tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] GET http://10.27.203.238/share/v2/284d76edec3144579d6fb3f6dbc0dd4e/shares/da80429c-1281-4450-a386-ed0e9d82a3ff May 28 13:01:08 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-49f466b0-06f9-4d29-b764-1063c034aa2d tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:08 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-49f466b0-06f9-4d29-b764-1063c034aa2d tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:09 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-49f466b0-06f9-4d29-b764-1063c034aa2d tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] HTTP exception thrown: The resource could not be found. May 28 13:01:09 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-49f466b0-06f9-4d29-b764-1063c034aa2d tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] http://10.27.203.238/share/v2/284d76edec3144579d6fb3f6dbc0dd4e/shares/da80429c-1281-4450-a386-ed0e9d82a3ff returned with HTTP 404 May 28 13:01:09 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 992/2021] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:01:08 2024] GET /share/v2/284d76edec3144579d6fb3f6dbc0dd4e/shares/da80429c-1281-4450-a386-ed0e9d82a3ff => generated 78 bytes in 11 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 13:01:09 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-1bbe19a8-6bb1-4654-b70d-7337a2a7aebd tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] PUT http://10.27.203.238/share/v2/bb20757ddd604868aff8ad38db5def87/types/7d2ea8e8-bada-4826-a8a8-53b4e9ff301f/extra_specs/availability_zones May 28 13:01:09 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-1bbe19a8-6bb1-4654-b70d-7337a2a7aebd tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] Action: 'update', calling method: ShareTypeExtraSpecsController.update, body: {"availability_zones": "nova"} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:01:09 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-1bbe19a8-6bb1-4654-b70d-7337a2a7aebd tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] http://10.27.203.238/share/v2/bb20757ddd604868aff8ad38db5def87/types/7d2ea8e8-bada-4826-a8a8-53b4e9ff301f/extra_specs/availability_zones returned with HTTP 200 May 28 13:01:09 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1030/2022] 10.27.203.238 () {66 vars in 1561 bytes} [Tue May 28 13:01:09 2024] PUT /share/v2/bb20757ddd604868aff8ad38db5def87/types/7d2ea8e8-bada-4826-a8a8-53b4e9ff301f/extra_specs/availability_zones => generated 30 bytes in 26 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:01:09 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-2d2370b4-77d0-4b0f-869a-8a9c9aadeace tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] POST http://10.27.203.238/share/v2/284d76edec3144579d6fb3f6dbc0dd4e/share-groups May 28 13:01:09 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-2d2370b4-77d0-4b0f-869a-8a9c9aadeace tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share_group": {"share_group_type_id": "c604fd71-5623-4f48-9a0f-e0b31cc7405a", "share_types": ["7d2ea8e8-bada-4826-a8a8-53b4e9ff301f"], "availability_zone": "nova"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:01:09 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.quota [None req-2d2370b4-77d0-4b0f-869a-8a9c9aadeace tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] Created reservations ['bf142a13-107d-4b61-bc99-1419f31a39e7'] {{(pid=98330) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 13:01:09 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.quota [None req-2d2370b4-77d0-4b0f-869a-8a9c9aadeace tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] Committed reservations ['bf142a13-107d-4b61-bc99-1419f31a39e7'] {{(pid=98330) commit /opt/stack/manila/manila/quota.py:1063}} May 28 13:01:09 l75lg1-v1 manila-scheduler[98327]: INFO manila.scheduler.drivers.filter [None req-2d2370b4-77d0-4b0f-869a-8a9c9aadeace tempest-ShareTypeAvailabilityZonesTest-364532124 None] Scheduling share group 3709d784-520f-4a6d-ba6f-ad3e9307f7a2. May 28 13:01:09 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-2d2370b4-77d0-4b0f-869a-8a9c9aadeace tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] http://10.27.203.238/share/v2/284d76edec3144579d6fb3f6dbc0dd4e/share-groups returned with HTTP 202 May 28 13:01:09 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 993/2023] 10.27.203.238 () {66 vars in 1380 bytes} [Tue May 28 13:01:09 2024] POST /share/v2/284d76edec3144579d6fb3f6dbc0dd4e/share-groups => generated 774 bytes in 187 msecs (HTTP/1.1 202) 6 headers in 237 bytes (1 switches on core 0) May 28 13:01:09 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-3aa4a55b-8c6d-4fa4-bd3d-6efc107d0f83 tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] GET http://10.27.203.238/share/v2/284d76edec3144579d6fb3f6dbc0dd4e/share-groups/3709d784-520f-4a6d-ba6f-ad3e9307f7a2 May 28 13:01:09 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-3aa4a55b-8c6d-4fa4-bd3d-6efc107d0f83 tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:09 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-3aa4a55b-8c6d-4fa4-bd3d-6efc107d0f83 tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:09 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.host_manager [None req-2d2370b4-77d0-4b0f-869a-8a9c9aadeace tempest-ShareTypeAvailabilityZonesTest-364532124 None] Share service is down. (host: l75lg1-v1@generic2). May 28 13:01:09 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.host_manager [None req-2d2370b4-77d0-4b0f-869a-8a9c9aadeace tempest-ShareTypeAvailabilityZonesTest-364532124 None] Share service is down. (host: l75lg1-v1@generic1). May 28 13:01:09 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-2d2370b4-77d0-4b0f-869a-8a9c9aadeace tempest-ShareTypeAvailabilityZonesTest-364532124 None] Starting with 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:80}} May 28 13:01:09 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-2d2370b4-77d0-4b0f-869a-8a9c9aadeace tempest-ShareTypeAvailabilityZonesTest-364532124 None] Filter OnlyHostFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:01:09 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-2d2370b4-77d0-4b0f-869a-8a9c9aadeace tempest-ShareTypeAvailabilityZonesTest-364532124 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:01:09 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.capacity [None req-2d2370b4-77d0-4b0f-869a-8a9c9aadeace tempest-ShareTypeAvailabilityZonesTest-364532124 None] Space information for share creation on host l75lg1-v1@vast#vast (requested / avail): 0/2079 {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/capacity.py:83}} May 28 13:01:09 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-2d2370b4-77d0-4b0f-869a-8a9c9aadeace tempest-ShareTypeAvailabilityZonesTest-364532124 None] Filter CapacityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:01:09 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-2d2370b4-77d0-4b0f-869a-8a9c9aadeace tempest-ShareTypeAvailabilityZonesTest-364532124 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:01:09 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-2d2370b4-77d0-4b0f-869a-8a9c9aadeace tempest-ShareTypeAvailabilityZonesTest-364532124 None] Driver Filter: Checking host 'l75lg1-v1@vast#vast' {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:37}} May 28 13:01:09 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-2d2370b4-77d0-4b0f-869a-8a9c9aadeace tempest-ShareTypeAvailabilityZonesTest-364532124 None] Filter function not set :: passing host. {{(pid=98327) _check_filter_function /opt/stack/manila/manila/scheduler/filters/driver.py:53}} May 28 13:01:09 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-2d2370b4-77d0-4b0f-869a-8a9c9aadeace tempest-ShareTypeAvailabilityZonesTest-364532124 None] Result: True {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:40}} May 28 13:01:09 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-2d2370b4-77d0-4b0f-869a-8a9c9aadeace tempest-ShareTypeAvailabilityZonesTest-364532124 None] Done checking host 'l75lg1-v1@vast#vast' {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:41}} May 28 13:01:09 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-2d2370b4-77d0-4b0f-869a-8a9c9aadeace tempest-ShareTypeAvailabilityZonesTest-364532124 None] Filter DriverFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:01:09 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-2d2370b4-77d0-4b0f-869a-8a9c9aadeace tempest-ShareTypeAvailabilityZonesTest-364532124 None] Filter ShareReplicationFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:01:09 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-2d2370b4-77d0-4b0f-869a-8a9c9aadeace tempest-ShareTypeAvailabilityZonesTest-364532124 None] Filter CreateFromSnapshotFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:01:09 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-2d2370b4-77d0-4b0f-869a-8a9c9aadeace tempest-ShareTypeAvailabilityZonesTest-364532124 None] Filter AffinityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:01:09 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-2d2370b4-77d0-4b0f-869a-8a9c9aadeace tempest-ShareTypeAvailabilityZonesTest-364532124 None] Filter AntiAffinityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:01:09 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.drivers.filter [None req-2d2370b4-77d0-4b0f-869a-8a9c9aadeace tempest-ShareTypeAvailabilityZonesTest-364532124 None] Filtered [host: 'l75lg1-v1@vast#vast', free_capacity_gb: 2079.6277076322585, pools: None] {{(pid=98327) _get_weighted_hosts_for_share_type /opt/stack/manila/manila/scheduler/drivers/filter.py:439}} May 28 13:01:09 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-2d2370b4-77d0-4b0f-869a-8a9c9aadeace tempest-ShareTypeAvailabilityZonesTest-364532124 None] Checking host 'l75lg1-v1@vast#vast' {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:46}} May 28 13:01:09 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.weighers.goodness [None req-2d2370b4-77d0-4b0f-869a-8a9c9aadeace tempest-ShareTypeAvailabilityZonesTest-364532124 None] Goodness function not set :: defaulting to minimal goodness rating of 0. May 28 13:01:09 l75lg1-v1 manila-scheduler[98327]: INFO manila.scheduler.weighers.goodness [None req-2d2370b4-77d0-4b0f-869a-8a9c9aadeace tempest-ShareTypeAvailabilityZonesTest-364532124 None] Goodness function result for host l75lg1-v1@vast#vast: 0. May 28 13:01:09 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-2d2370b4-77d0-4b0f-869a-8a9c9aadeace tempest-ShareTypeAvailabilityZonesTest-364532124 None] Goodness: 0 {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:48}} May 28 13:01:09 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-2d2370b4-77d0-4b0f-869a-8a9c9aadeace tempest-ShareTypeAvailabilityZonesTest-364532124 None] Done checking host 'l75lg1-v1@vast#vast' {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:49}} May 28 13:01:09 l75lg1-v1 dstat.sh[49771]: 28-05 13:01:09| 5 1 90 3 0|5698M 1745M 278M 7903M| 24k 9373B| 0 1456k| 0 229 |4456 7523 |1.69 1.26 1.08|3.0 1.0 0| 0 0 | 0 2048M| 29 364 0 30 2 May 28 13:01:09 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.host_manager [None req-2d2370b4-77d0-4b0f-869a-8a9c9aadeace tempest-ShareTypeAvailabilityZonesTest-364532124 None] Share service is down. (host: l75lg1-v1@generic2). May 28 13:01:09 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.host_manager [None req-2d2370b4-77d0-4b0f-869a-8a9c9aadeace tempest-ShareTypeAvailabilityZonesTest-364532124 None] Share service is down. (host: l75lg1-v1@generic1). May 28 13:01:09 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-2d2370b4-77d0-4b0f-869a-8a9c9aadeace tempest-ShareTypeAvailabilityZonesTest-364532124 None] Starting with 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:80}} May 28 13:01:09 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-2d2370b4-77d0-4b0f-869a-8a9c9aadeace tempest-ShareTypeAvailabilityZonesTest-364532124 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:01:09 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-2d2370b4-77d0-4b0f-869a-8a9c9aadeace tempest-ShareTypeAvailabilityZonesTest-364532124 None] Filter ConsistentSnapshotFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:01:09 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.drivers.filter [None req-2d2370b4-77d0-4b0f-869a-8a9c9aadeace tempest-ShareTypeAvailabilityZonesTest-364532124 None] Filtered [host: 'l75lg1-v1@vast#vast', free_capacity_gb: 2079.6277076322585, pools: None] {{(pid=98327) _get_weighted_hosts_for_share_group_type /opt/stack/manila/manila/scheduler/drivers/filter.py:474}} May 28 13:01:09 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-2d2370b4-77d0-4b0f-869a-8a9c9aadeace tempest-ShareTypeAvailabilityZonesTest-364532124 None] Checking host 'l75lg1-v1@vast#vast' {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:46}} May 28 13:01:09 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.weighers.goodness [None req-2d2370b4-77d0-4b0f-869a-8a9c9aadeace tempest-ShareTypeAvailabilityZonesTest-364532124 None] Goodness function not set :: defaulting to minimal goodness rating of 0. May 28 13:01:09 l75lg1-v1 manila-scheduler[98327]: INFO manila.scheduler.weighers.goodness [None req-2d2370b4-77d0-4b0f-869a-8a9c9aadeace tempest-ShareTypeAvailabilityZonesTest-364532124 None] Goodness function result for host l75lg1-v1@vast#vast: 0. May 28 13:01:09 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-2d2370b4-77d0-4b0f-869a-8a9c9aadeace tempest-ShareTypeAvailabilityZonesTest-364532124 None] Goodness: 0 {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:48}} May 28 13:01:09 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-2d2370b4-77d0-4b0f-869a-8a9c9aadeace tempest-ShareTypeAvailabilityZonesTest-364532124 None] Done checking host 'l75lg1-v1@vast#vast' {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:49}} May 28 13:01:09 l75lg1-v1 manila-scheduler[98327]: INFO manila.scheduler.drivers.filter [None req-2d2370b4-77d0-4b0f-869a-8a9c9aadeace tempest-ShareTypeAvailabilityZonesTest-364532124 None] Chose host l75lg1-v1@vast#vast for create_share_group 3709d784-520f-4a6d-ba6f-ad3e9307f7a2. May 28 13:01:09 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-3aa4a55b-8c6d-4fa4-bd3d-6efc107d0f83 tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] http://10.27.203.238/share/v2/284d76edec3144579d6fb3f6dbc0dd4e/share-groups/3709d784-520f-4a6d-ba6f-ad3e9307f7a2 returned with HTTP 200 May 28 13:01:09 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1031/2024] 10.27.203.238 () {64 vars in 1469 bytes} [Tue May 28 13:01:09 2024] GET /share/v2/284d76edec3144579d6fb3f6dbc0dd4e/share-groups/3709d784-520f-4a6d-ba6f-ad3e9307f7a2 => generated 774 bytes in 28 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:01:09 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-376f6a4f-c915-416a-af0c-bd96192dd711 tempest-ShareRulesTest-1530341375 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:01:09 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-376f6a4f-c915-416a-af0c-bd96192dd711 tempest-ShareRulesTest-1530341375 None] [Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=0, created='2024-05-28T13:00:50.357495Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='1099a621-1733-438b-a032-2bf134301842', id=48, internal=False, is_s3_default_policy=False, name='f20d9b3a-8716-4664-aff7-80ddf3014290', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=['*'], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=[], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=[], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T13:01:01.013028Z', tenant_id=1, tenant_name='default', title='f20d9b3a-8716-4664-aff7-80ddf3014290', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/48/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[])] May 28 13:01:09 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-376f6a4f-c915-416a-af0c-bd96192dd711 tempest-ShareRulesTest-1530341375 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 13:01:09 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-376f6a4f-c915-416a-af0c-bd96192dd711 tempest-ShareRulesTest-1530341375 None] >>> [DELETE] https://127.0.0.1:40443/api/viewpolicies/48/ May 28 13:01:09 l75lg1-v1 devstack@placement-api.service[78202]: DEBUG dbcounter [-] [78202] Writing DB stats placement:SELECT=8 {{(pid=78202) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:01:09 l75lg1-v1 manila-share[98474]: INFO manila.share.manager [None req-2d2370b4-77d0-4b0f-869a-8a9c9aadeace tempest-ShareTypeAvailabilityZonesTest-364532124 None] Share group 3709d784-520f-4a6d-ba6f-ad3e9307f7a2: creating May 28 13:01:09 l75lg1-v1 manila-share[98474]: DEBUG manila.share.driver [None req-2d2370b4-77d0-4b0f-869a-8a9c9aadeace tempest-ShareTypeAvailabilityZonesTest-364532124 None] Created a Share Group with ID: 3709d784-520f-4a6d-ba6f-ad3e9307f7a2. {{(pid=98474) create_share_group /opt/stack/manila/manila/share/driver.py:1416}} May 28 13:01:09 l75lg1-v1 devstack@placement-api.service[78201]: DEBUG dbcounter [-] [78201] Writing DB stats placement:SELECT=6 {{(pid=78201) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:01:09 l75lg1-v1 manila-share[98474]: INFO manila.share.manager [None req-2d2370b4-77d0-4b0f-869a-8a9c9aadeace tempest-ShareTypeAvailabilityZonesTest-364532124 None] Share group 3709d784-520f-4a6d-ba6f-ad3e9307f7a2: created successfully May 28 13:01:09 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ac3e66df-c9d2-4bb7-b906-b126c2362742 tempest-ShareRulesNegativeTest-930400775 None] <<< [DELETE] https://127.0.0.1:40443/api/quotas/44/ May 28 13:01:09 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ac3e66df-c9d2-4bb7-b906-b126c2362742 tempest-ShareRulesNegativeTest-930400775 None] --- [DELETE] https://127.0.0.1:40443/api/quotas/44/: Done May 28 13:01:09 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ac3e66df-c9d2-4bb7-b906-b126c2362742 tempest-ShareRulesNegativeTest-930400775 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:01:09 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ac3e66df-c9d2-4bb7-b906-b126c2362742 tempest-ShareRulesNegativeTest-930400775 None] {'allow_redirects': True, May 28 13:01:09 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ac3e66df-c9d2-4bb7-b906-b126c2362742 tempest-ShareRulesNegativeTest-930400775 None] 'params': {'name': 'e0a28587-55d6-44c6-8c73-249d5047f95e'}} May 28 13:01:09 l75lg1-v1 nova-conductor[83647]: DEBUG dbcounter [-] [83647] Writing DB stats nova_cell1:SELECT=2 {{(pid=83647) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:01:10 l75lg1-v1 nova-conductor[83648]: DEBUG dbcounter [-] [83648] Writing DB stats nova_cell1:SELECT=3 {{(pid=83648) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:01:10 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ac3e66df-c9d2-4bb7-b906-b126c2362742 tempest-ShareRulesNegativeTest-930400775 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:01:10 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ac3e66df-c9d2-4bb7-b906-b126c2362742 tempest-ShareRulesNegativeTest-930400775 None] [Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=0, created='2024-05-28T13:00:49.397495Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='50b7ba16-b07b-48e1-9e62-ee344100e7dc', id=47, internal=False, is_s3_default_policy=False, name='e0a28587-55d6-44c6-8c73-249d5047f95e', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=[], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['*'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['*'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T13:00:49.703457Z', tenant_id=1, tenant_name='default', title='e0a28587-55d6-44c6-8c73-249d5047f95e', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/47/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[])] May 28 13:01:10 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ac3e66df-c9d2-4bb7-b906-b126c2362742 tempest-ShareRulesNegativeTest-930400775 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 13:01:10 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ac3e66df-c9d2-4bb7-b906-b126c2362742 tempest-ShareRulesNegativeTest-930400775 None] >>> [DELETE] https://127.0.0.1:40443/api/viewpolicies/47/ May 28 13:01:10 l75lg1-v1 dstat.sh[49771]: 28-05 13:01:10| 2 1 96 2 0|5698M 1745M 278M 7903M| 18k 2110B| 0 6561k| 0 764 |2856 4430 |1.69 1.26 1.08|2.0 0 0| 0 0 | 0 2048M| 29 363 0 30 2 May 28 13:01:10 l75lg1-v1 neutron-server[77619]: DEBUG dbcounter [-] [77619] Writing DB stats neutron:SELECT=2 {{(pid=77619) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:01:10 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-c271cd5e-3137-4abf-b5be-dfb2a2e08d7c tempest-ShareRulesNegativeTest-930400775 tempest-ShareRulesNegativeTest-930400775-project-member] GET http://10.27.203.238/share/v2/329a14ab984146feb9f91e467ab4e3b5/shares/623ccf6c-1398-4ab6-9f67-73e600565f38 May 28 13:01:10 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-c271cd5e-3137-4abf-b5be-dfb2a2e08d7c tempest-ShareRulesNegativeTest-930400775 tempest-ShareRulesNegativeTest-930400775-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:10 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-c271cd5e-3137-4abf-b5be-dfb2a2e08d7c tempest-ShareRulesNegativeTest-930400775 tempest-ShareRulesNegativeTest-930400775-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:10 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-c271cd5e-3137-4abf-b5be-dfb2a2e08d7c tempest-ShareRulesNegativeTest-930400775 tempest-ShareRulesNegativeTest-930400775-project-member] http://10.27.203.238/share/v2/329a14ab984146feb9f91e467ab4e3b5/shares/623ccf6c-1398-4ab6-9f67-73e600565f38 returned with HTTP 200 May 28 13:01:10 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 994/2025] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:01:10 2024] GET /share/v2/329a14ab984146feb9f91e467ab4e3b5/shares/623ccf6c-1398-4ab6-9f67-73e600565f38 => generated 1314 bytes in 28 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:01:10 l75lg1-v1 neutron-server[77618]: DEBUG dbcounter [-] [77618] Writing DB stats neutron:UPDATE=1 {{(pid=77618) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:01:10 l75lg1-v1 neutron-server[77618]: DEBUG dbcounter [-] [77618] Writing DB stats neutron:SELECT=2 {{(pid=77618) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:01:10 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-a4cc453a-8e2c-4a3d-bf83-7595f137b7a7 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] GET http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/shares/415b1daa-22c2-48a3-873e-80762e65a747 May 28 13:01:10 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-a4cc453a-8e2c-4a3d-bf83-7595f137b7a7 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:10 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-a4cc453a-8e2c-4a3d-bf83-7595f137b7a7 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:10 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-a4cc453a-8e2c-4a3d-bf83-7595f137b7a7 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/shares/415b1daa-22c2-48a3-873e-80762e65a747 returned with HTTP 200 May 28 13:01:10 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1032/2026] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:01:10 2024] GET /share/v2/a4f3887fa28c457390f5b66615564430/shares/415b1daa-22c2-48a3-873e-80762e65a747 => generated 1315 bytes in 26 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:01:10 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-376f6a4f-c915-416a-af0c-bd96192dd711 tempest-ShareRulesTest-1530341375 None] <<< [DELETE] https://127.0.0.1:40443/api/viewpolicies/48/ May 28 13:01:10 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-376f6a4f-c915-416a-af0c-bd96192dd711 tempest-ShareRulesTest-1530341375 None] --- [DELETE] https://127.0.0.1:40443/api/viewpolicies/48/: Done May 28 13:01:11 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-376f6a4f-c915-416a-af0c-bd96192dd711 tempest-ShareRulesTest-1530341375 None] Created reservations ['be634663-9f7b-4a6b-a644-3d1dac9899fd', '9653780e-ffdb-47d0-95f3-24a36313b03e', '5ab48d05-689c-499b-b8ed-8283fb0454c5', '449b6a67-caa6-452d-8418-f0df6c4fd0bf'] {{(pid=98474) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 13:01:11 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-376f6a4f-c915-416a-af0c-bd96192dd711 tempest-ShareRulesTest-1530341375 None] Committed reservations ['be634663-9f7b-4a6b-a644-3d1dac9899fd', '9653780e-ffdb-47d0-95f3-24a36313b03e', '5ab48d05-689c-499b-b8ed-8283fb0454c5', '449b6a67-caa6-452d-8418-f0df6c4fd0bf'] {{(pid=98474) commit /opt/stack/manila/manila/quota.py:1063}} May 28 13:01:11 l75lg1-v1 manila-share[98474]: INFO manila.share.manager [None req-376f6a4f-c915-416a-af0c-bd96192dd711 tempest-ShareRulesTest-1530341375 None] Share instance f20d9b3a-8716-4664-aff7-80ddf3014290: deleted successfully. May 28 13:01:11 l75lg1-v1 cinder-scheduler[85128]: DEBUG dbcounter [-] [85128] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=85128) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:01:11 l75lg1-v1 dstat.sh[49771]: 28-05 13:01:11| 3 0 94 2 0|5698M 1745M 278M 7903M| 15k 238B| 0 1248k| 0 163 |3053 4910 |1.69 1.26 1.08|1.0 1.0 0| 0 0 | 0 2048M| 29 363 0 30 2 May 28 13:01:11 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bef6f3a0-ee3c-4e01-961a-7eeb654ff32f tempest-SharesNFSTest-667257547 None] <<< [POST] https://127.0.0.1:40443/api/snapshots/ May 28 13:01:11 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bef6f3a0-ee3c-4e01-961a-7eeb654ff32f tempest-SharesNFSTest-667257547 None] Bunch(access_path='/.vast_all_snapshots/1000000013_share-snapshot-1e52452e-8541-435c-86af-51a474395f43', aggr_phys_estimation=0, cluster='loop75-kfs', created='2024-05-28T13:01:08.819421Z', eta_sec=30819898726.75673, expiration_time='3001-01-19T07:59:58Z', guid='a0e5bc69-5df1-45e1-9b94-c7686d1baf67', id=14, indestructible=False, locked=False, name='share-snapshot-1e52452e-8541-435c-86af-51a474395f43', path='/manila/manila-d935f840-e1e2-4366-85e1-9cee599842b6/', policy=None, policy_id=None, protection_policy_id=None, state='SUCCEED', tenant_id=1, tenant_name='default', title='share-snapshot-1e52452e-8541-435c-86af-51a474395f43(/manila/manila-d935f840-e1e2-4366-85e1-9cee599842b6/)', type='local', unique_phys_estimation=0, url='https://127.0.0.1:40443/api/snapshots/14/') May 28 13:01:11 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bef6f3a0-ee3c-4e01-961a-7eeb654ff32f tempest-SharesNFSTest-667257547 None] --- [POST] https://127.0.0.1:40443/api/snapshots/: Done May 28 13:01:11 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-4d56806b-a487-4625-9ed6-2f08badaabcb tempest-SharesNFSTest-667257547 tempest-SharesNFSTest-667257547-project-member] GET http://10.27.203.238/share/v2/0af6f8e0aeed4f27b075e08f2bc713aa/snapshots/bff3b07e-650b-4bc1-8c88-fcd101dd0295 May 28 13:01:11 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-4d56806b-a487-4625-9ed6-2f08badaabcb tempest-SharesNFSTest-667257547 tempest-SharesNFSTest-667257547-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:11 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-4d56806b-a487-4625-9ed6-2f08badaabcb tempest-SharesNFSTest-667257547 tempest-SharesNFSTest-667257547-project-member] Calling method 'ShareSnapshotMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:11 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-4d56806b-a487-4625-9ed6-2f08badaabcb tempest-SharesNFSTest-667257547 tempest-SharesNFSTest-667257547-project-member] http://10.27.203.238/share/v2/0af6f8e0aeed4f27b075e08f2bc713aa/snapshots/bff3b07e-650b-4bc1-8c88-fcd101dd0295 returned with HTTP 200 May 28 13:01:11 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 995/2027] 10.27.203.238 () {64 vars in 1460 bytes} [Tue May 28 13:01:11 2024] GET /share/v2/0af6f8e0aeed4f27b075e08f2bc713aa/snapshots/bff3b07e-650b-4bc1-8c88-fcd101dd0295 => generated 724 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:01:11 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-154096e0-207d-4a49-9df8-74e29b3402eb tempest-SharesNFSTest-667257547 tempest-SharesNFSTest-667257547-project-member] DELETE http://10.27.203.238/share/v1/0af6f8e0aeed4f27b075e08f2bc713aa/snapshots/bff3b07e-650b-4bc1-8c88-fcd101dd0295 May 28 13:01:11 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-154096e0-207d-4a49-9df8-74e29b3402eb tempest-SharesNFSTest-667257547 tempest-SharesNFSTest-667257547-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:11 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-154096e0-207d-4a49-9df8-74e29b3402eb tempest-SharesNFSTest-667257547 tempest-SharesNFSTest-667257547-project-member] Calling method 'ShareSnapshotMixin.delete' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:11 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.v1.share_snapshots [None req-154096e0-207d-4a49-9df8-74e29b3402eb tempest-SharesNFSTest-667257547 tempest-SharesNFSTest-667257547-project-member] Delete snapshot with id: bff3b07e-650b-4bc1-8c88-fcd101dd0295 May 28 13:01:11 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-154096e0-207d-4a49-9df8-74e29b3402eb tempest-SharesNFSTest-667257547 tempest-SharesNFSTest-667257547-project-member] http://10.27.203.238/share/v1/0af6f8e0aeed4f27b075e08f2bc713aa/snapshots/bff3b07e-650b-4bc1-8c88-fcd101dd0295 returned with HTTP 202 May 28 13:01:11 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1033/2028] 10.27.203.238 () {62 vars in 1420 bytes} [Tue May 28 13:01:11 2024] DELETE /share/v1/0af6f8e0aeed4f27b075e08f2bc713aa/snapshots/bff3b07e-650b-4bc1-8c88-fcd101dd0295 => generated 0 bytes in 99 msecs (HTTP/1.1 202) 6 headers in 242 bytes (1 switches on core 0) May 28 13:01:11 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-f32ade73-840a-4f5e-b9e1-6ca0157e7c80 tempest-SharesNFSTest-667257547 tempest-SharesNFSTest-667257547-project-member] GET http://10.27.203.238/share/v1/0af6f8e0aeed4f27b075e08f2bc713aa/snapshots/bff3b07e-650b-4bc1-8c88-fcd101dd0295 May 28 13:01:11 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-f32ade73-840a-4f5e-b9e1-6ca0157e7c80 tempest-SharesNFSTest-667257547 tempest-SharesNFSTest-667257547-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:11 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-f32ade73-840a-4f5e-b9e1-6ca0157e7c80 tempest-SharesNFSTest-667257547 tempest-SharesNFSTest-667257547-project-member] Calling method 'ShareSnapshotMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:11 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-f32ade73-840a-4f5e-b9e1-6ca0157e7c80 tempest-SharesNFSTest-667257547 tempest-SharesNFSTest-667257547-project-member] http://10.27.203.238/share/v1/0af6f8e0aeed4f27b075e08f2bc713aa/snapshots/bff3b07e-650b-4bc1-8c88-fcd101dd0295 returned with HTTP 200 May 28 13:01:11 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 996/2029] 10.27.203.238 () {62 vars in 1417 bytes} [Tue May 28 13:01:11 2024] GET /share/v1/0af6f8e0aeed4f27b075e08f2bc713aa/snapshots/bff3b07e-650b-4bc1-8c88-fcd101dd0295 => generated 610 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:01:11 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-154096e0-207d-4a49-9df8-74e29b3402eb tempest-SharesNFSTest-667257547 None] >>> [GET] https://127.0.0.1:40443/api/snapshots/ May 28 13:01:11 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-154096e0-207d-4a49-9df8-74e29b3402eb tempest-SharesNFSTest-667257547 None] {'allow_redirects': True, May 28 13:01:11 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-154096e0-207d-4a49-9df8-74e29b3402eb tempest-SharesNFSTest-667257547 None] 'params': {'name': 'share-snapshot-1e52452e-8541-435c-86af-51a474395f43'}} May 28 13:01:11 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.periodic_task [None req-e3486ff9-a95e-41bc-8901-df75aedbeaad None None] Running periodic task DataManager.create_backup_continue {{(pid=98318) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 13:01:11 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.periodic_task [None req-e3486ff9-a95e-41bc-8901-df75aedbeaad None None] Running periodic task DataManager.restore_backup_continue {{(pid=98318) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 13:01:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG dbcounter [-] [51266] Writing DB stats keystone:SELECT=253,keystone:DELETE=24,keystone:INSERT=14 {{(pid=51266) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:01:11 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ac3e66df-c9d2-4bb7-b906-b126c2362742 tempest-ShareRulesNegativeTest-930400775 None] <<< [DELETE] https://127.0.0.1:40443/api/viewpolicies/47/ May 28 13:01:11 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ac3e66df-c9d2-4bb7-b906-b126c2362742 tempest-ShareRulesNegativeTest-930400775 None] --- [DELETE] https://127.0.0.1:40443/api/viewpolicies/47/: Done May 28 13:01:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG dbcounter [-] [51267] Writing DB stats keystone:SELECT=231,keystone:DELETE=37,keystone:INSERT=13 {{(pid=51267) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:01:11 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-ac3e66df-c9d2-4bb7-b906-b126c2362742 tempest-ShareRulesNegativeTest-930400775 None] Created reservations ['8c7740b9-b019-497f-9ae8-325c3b47b8f9', 'df419ce6-45da-4ef4-8920-9acc7ee0bb44', '204cae15-78ac-4e9c-b72f-717d0c5c8093', '7f79a071-ae72-42f8-914d-8e98117036ee'] {{(pid=98474) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 13:01:11 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-ac3e66df-c9d2-4bb7-b906-b126c2362742 tempest-ShareRulesNegativeTest-930400775 None] Committed reservations ['8c7740b9-b019-497f-9ae8-325c3b47b8f9', 'df419ce6-45da-4ef4-8920-9acc7ee0bb44', '204cae15-78ac-4e9c-b72f-717d0c5c8093', '7f79a071-ae72-42f8-914d-8e98117036ee'] {{(pid=98474) commit /opt/stack/manila/manila/quota.py:1063}} May 28 13:01:11 l75lg1-v1 manila-share[98474]: INFO manila.share.manager [None req-ac3e66df-c9d2-4bb7-b906-b126c2362742 tempest-ShareRulesNegativeTest-930400775 None] Share instance e0a28587-55d6-44c6-8c73-249d5047f95e: deleted successfully. May 28 13:01:11 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-154096e0-207d-4a49-9df8-74e29b3402eb tempest-SharesNFSTest-667257547 None] <<< [GET] https://127.0.0.1:40443/api/snapshots/ May 28 13:01:11 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-154096e0-207d-4a49-9df8-74e29b3402eb tempest-SharesNFSTest-667257547 None] [Bunch(access_path='/.vast_all_snapshots/1000000013_share-snapshot-1e52452e-8541-435c-86af-51a474395f43', aggr_phys_estimation=0, cluster='loop75-kfs', created='2024-05-28T13:01:08.819421Z', eta_sec=30819898726.04168, expiration_time='3001-01-19T07:59:58Z', guid='a0e5bc69-5df1-45e1-9b94-c7686d1baf67', id=14, indestructible=False, locked=False, name='share-snapshot-1e52452e-8541-435c-86af-51a474395f43', path='/manila/manila-d935f840-e1e2-4366-85e1-9cee599842b6/', policy=None, policy_id=None, protection_policy_id=None, state='SUCCEED', tenant_id=1, tenant_name='default', title='share-snapshot-1e52452e-8541-435c-86af-51a474395f43(/manila/manila-d935f840-e1e2-4366-85e1-9cee599842b6/)', type='local', unique_phys_estimation=0, url='https://127.0.0.1:40443/api/snapshots/14/')] May 28 13:01:11 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-154096e0-207d-4a49-9df8-74e29b3402eb tempest-SharesNFSTest-667257547 None] --- [GET] https://127.0.0.1:40443/api/snapshots/: Done May 28 13:01:11 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-154096e0-207d-4a49-9df8-74e29b3402eb tempest-SharesNFSTest-667257547 None] >>> [DELETE] https://127.0.0.1:40443/api/snapshots/14/ May 28 13:01:12 l75lg1-v1 dstat.sh[49771]: 28-05 13:01:12| 5 0 92 2 0|5698M 1745M 278M 7903M| 18k 1538B| 0 1264k| 0 196 |4089 6749 |1.56 1.24 1.08|2.0 1.0 0| 0 0 | 0 2048M| 29 363 0 30 2 May 28 13:01:12 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-12c291e5-4167-415f-a2ae-66f6e93cdd33 tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] GET http://10.27.203.238/share/v2/284d76edec3144579d6fb3f6dbc0dd4e/share-groups/3709d784-520f-4a6d-ba6f-ad3e9307f7a2 May 28 13:01:12 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-12c291e5-4167-415f-a2ae-66f6e93cdd33 tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:12 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-12c291e5-4167-415f-a2ae-66f6e93cdd33 tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:12 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-12c291e5-4167-415f-a2ae-66f6e93cdd33 tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] http://10.27.203.238/share/v2/284d76edec3144579d6fb3f6dbc0dd4e/share-groups/3709d784-520f-4a6d-ba6f-ad3e9307f7a2 returned with HTTP 200 May 28 13:01:12 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1034/2030] 10.27.203.238 () {64 vars in 1469 bytes} [Tue May 28 13:01:12 2024] GET /share/v2/284d76edec3144579d6fb3f6dbc0dd4e/share-groups/3709d784-520f-4a6d-ba6f-ad3e9307f7a2 => generated 792 bytes in 14 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:01:12 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-e24fd7db-a436-4b5b-83d1-c5c772e8f6cd tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] GET http://10.27.203.238/share/v2/284d76edec3144579d6fb3f6dbc0dd4e/share-groups/3709d784-520f-4a6d-ba6f-ad3e9307f7a2 May 28 13:01:12 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-e24fd7db-a436-4b5b-83d1-c5c772e8f6cd tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:12 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-e24fd7db-a436-4b5b-83d1-c5c772e8f6cd tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:12 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-e24fd7db-a436-4b5b-83d1-c5c772e8f6cd tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] http://10.27.203.238/share/v2/284d76edec3144579d6fb3f6dbc0dd4e/share-groups/3709d784-520f-4a6d-ba6f-ad3e9307f7a2 returned with HTTP 200 May 28 13:01:12 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 997/2031] 10.27.203.238 () {64 vars in 1469 bytes} [Tue May 28 13:01:12 2024] GET /share/v2/284d76edec3144579d6fb3f6dbc0dd4e/share-groups/3709d784-520f-4a6d-ba6f-ad3e9307f7a2 => generated 792 bytes in 16 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:01:12 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-e04c5cca-be17-4408-9e35-8e66dad58539 tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] DELETE http://10.27.203.238/share/v2/284d76edec3144579d6fb3f6dbc0dd4e/share-groups/3709d784-520f-4a6d-ba6f-ad3e9307f7a2 May 28 13:01:12 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-e04c5cca-be17-4408-9e35-8e66dad58539 tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:12 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-e04c5cca-be17-4408-9e35-8e66dad58539 tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:12 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.v2.share_groups [None req-e04c5cca-be17-4408-9e35-8e66dad58539 tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] Delete share group with id: 3709d784-520f-4a6d-ba6f-ad3e9307f7a2 May 28 13:01:12 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.quota [None req-e04c5cca-be17-4408-9e35-8e66dad58539 tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] Created reservations ['175a6a48-57b9-4314-a1c0-d07ad35a300c'] {{(pid=98329) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 13:01:12 l75lg1-v1 manila-share[98474]: INFO manila.share.manager [None req-e04c5cca-be17-4408-9e35-8e66dad58539 tempest-ShareTypeAvailabilityZonesTest-364532124 None] Share group 3709d784-520f-4a6d-ba6f-ad3e9307f7a2: deleting May 28 13:01:12 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.quota [None req-e04c5cca-be17-4408-9e35-8e66dad58539 tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] Committed reservations ['175a6a48-57b9-4314-a1c0-d07ad35a300c'] {{(pid=98329) commit /opt/stack/manila/manila/quota.py:1063}} May 28 13:01:12 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-e04c5cca-be17-4408-9e35-8e66dad58539 tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] http://10.27.203.238/share/v2/284d76edec3144579d6fb3f6dbc0dd4e/share-groups/3709d784-520f-4a6d-ba6f-ad3e9307f7a2 returned with HTTP 202 May 28 13:01:12 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1035/2032] 10.27.203.238 () {64 vars in 1472 bytes} [Tue May 28 13:01:12 2024] DELETE /share/v2/284d76edec3144579d6fb3f6dbc0dd4e/share-groups/3709d784-520f-4a6d-ba6f-ad3e9307f7a2 => generated 0 bytes in 86 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 13:01:12 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-41799817-2294-452f-b363-851d43f4b62c tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] GET http://10.27.203.238/share/v2/284d76edec3144579d6fb3f6dbc0dd4e/share-groups/3709d784-520f-4a6d-ba6f-ad3e9307f7a2 May 28 13:01:12 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-41799817-2294-452f-b363-851d43f4b62c tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:12 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-41799817-2294-452f-b363-851d43f4b62c tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:12 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-41799817-2294-452f-b363-851d43f4b62c tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] http://10.27.203.238/share/v2/284d76edec3144579d6fb3f6dbc0dd4e/share-groups/3709d784-520f-4a6d-ba6f-ad3e9307f7a2 returned with HTTP 200 May 28 13:01:12 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 998/2033] 10.27.203.238 () {64 vars in 1469 bytes} [Tue May 28 13:01:12 2024] GET /share/v2/284d76edec3144579d6fb3f6dbc0dd4e/share-groups/3709d784-520f-4a6d-ba6f-ad3e9307f7a2 => generated 791 bytes in 12 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:01:12 l75lg1-v1 manila-share[98474]: INFO manila.share.manager [None req-e04c5cca-be17-4408-9e35-8e66dad58539 tempest-ShareTypeAvailabilityZonesTest-364532124 None] Share group 3709d784-520f-4a6d-ba6f-ad3e9307f7a2: deleted successfully May 28 13:01:12 l75lg1-v1 cinder-volume[85846]: DEBUG dbcounter [-] [85846] Writing DB stats cinder:SELECT=1 {{(pid=85846) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:01:12 l75lg1-v1 cinder-volume[85846]: DEBUG dbcounter [-] [85846] Writing DB stats cinder:UPDATE=1 {{(pid=85846) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:01:13 l75lg1-v1 dstat.sh[49771]: 28-05 13:01:13| 2 0 96 1 0|5698M 1745M 278M 7903M| 14k 0 | 0 1076k| 0 113 |2638 4359 |1.56 1.24 1.08|1.0 1.0 0| 0 0 | 0 2048M| 29 363 0 30 2 May 28 13:01:13 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-154096e0-207d-4a49-9df8-74e29b3402eb tempest-SharesNFSTest-667257547 None] <<< [DELETE] https://127.0.0.1:40443/api/snapshots/14/ May 28 13:01:13 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-154096e0-207d-4a49-9df8-74e29b3402eb tempest-SharesNFSTest-667257547 None] --- [DELETE] https://127.0.0.1:40443/api/snapshots/14/: Done May 28 13:01:13 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-918bf351-ed4a-4655-b098-4ad38d9eb290 tempest-ShareRulesNegativeTest-930400775 tempest-ShareRulesNegativeTest-930400775-project-member] GET http://10.27.203.238/share/v2/329a14ab984146feb9f91e467ab4e3b5/shares/623ccf6c-1398-4ab6-9f67-73e600565f38 May 28 13:01:13 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-918bf351-ed4a-4655-b098-4ad38d9eb290 tempest-ShareRulesNegativeTest-930400775 tempest-ShareRulesNegativeTest-930400775-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:13 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-918bf351-ed4a-4655-b098-4ad38d9eb290 tempest-ShareRulesNegativeTest-930400775 tempest-ShareRulesNegativeTest-930400775-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:13 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-918bf351-ed4a-4655-b098-4ad38d9eb290 tempest-ShareRulesNegativeTest-930400775 tempest-ShareRulesNegativeTest-930400775-project-member] HTTP exception thrown: The resource could not be found. May 28 13:01:13 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-918bf351-ed4a-4655-b098-4ad38d9eb290 tempest-ShareRulesNegativeTest-930400775 tempest-ShareRulesNegativeTest-930400775-project-member] http://10.27.203.238/share/v2/329a14ab984146feb9f91e467ab4e3b5/shares/623ccf6c-1398-4ab6-9f67-73e600565f38 returned with HTTP 404 May 28 13:01:13 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1036/2034] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:01:13 2024] GET /share/v2/329a14ab984146feb9f91e467ab4e3b5/shares/623ccf6c-1398-4ab6-9f67-73e600565f38 => generated 78 bytes in 12 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 13:01:13 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-fca4ecc9-2c7c-488a-a1e5-b32d0ac3feda tempest-ShareRulesNegativeTest-1738210631 tempest-ShareRulesNegativeTest-1738210631-project-admin] DELETE http://10.27.203.238/share/v2/011748bb7e2247e88228bd066607700e/types/014d638f-6718-47b3-a401-a453a3d85ba9 May 28 13:01:13 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-fca4ecc9-2c7c-488a-a1e5-b32d0ac3feda tempest-ShareRulesNegativeTest-1738210631 tempest-ShareRulesNegativeTest-1738210631-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:13 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-fca4ecc9-2c7c-488a-a1e5-b32d0ac3feda tempest-ShareRulesNegativeTest-1738210631 tempest-ShareRulesNegativeTest-1738210631-project-admin] Calling method 'ShareTypesController._delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:13 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-154096e0-207d-4a49-9df8-74e29b3402eb tempest-SharesNFSTest-667257547 None] Created reservations ['942a6118-5bac-4d0d-bd28-2193d9a548b8', '43eff639-4600-4bb0-81be-87e3411cab46', '71ab3e64-4a50-4e1c-bd30-210b8a3da6e0', '2f55d03c-7556-4170-829c-093e0b7a7b18'] {{(pid=98474) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 13:01:13 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-fca4ecc9-2c7c-488a-a1e5-b32d0ac3feda tempest-ShareRulesNegativeTest-1738210631 tempest-ShareRulesNegativeTest-1738210631-project-admin] http://10.27.203.238/share/v2/011748bb7e2247e88228bd066607700e/types/014d638f-6718-47b3-a401-a453a3d85ba9 returned with HTTP 202 May 28 13:01:13 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 999/2035] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:01:13 2024] DELETE /share/v2/011748bb7e2247e88228bd066607700e/types/014d638f-6718-47b3-a401-a453a3d85ba9 => generated 0 bytes in 68 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 13:01:13 l75lg1-v1 neutron-server[77623]: DEBUG dbcounter [-] [77623] Writing DB stats neutron:SELECT=2 {{(pid=77623) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:01:13 l75lg1-v1 neutron-server[77623]: DEBUG dbcounter [-] [77623] Writing DB stats neutron:SELECT=1 {{(pid=77623) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:01:13 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-f834dd38-eb5c-4d79-83cd-f3e979b1822c tempest-ShareRulesNegativeTest-1738210631 tempest-ShareRulesNegativeTest-1738210631-project-admin] GET http://10.27.203.238/share/v2/011748bb7e2247e88228bd066607700e/types/014d638f-6718-47b3-a401-a453a3d85ba9 May 28 13:01:13 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-f834dd38-eb5c-4d79-83cd-f3e979b1822c tempest-ShareRulesNegativeTest-1738210631 tempest-ShareRulesNegativeTest-1738210631-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:13 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-f834dd38-eb5c-4d79-83cd-f3e979b1822c tempest-ShareRulesNegativeTest-1738210631 tempest-ShareRulesNegativeTest-1738210631-project-admin] Calling method 'ShareTypesController.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:13 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-f834dd38-eb5c-4d79-83cd-f3e979b1822c tempest-ShareRulesNegativeTest-1738210631 tempest-ShareRulesNegativeTest-1738210631-project-admin] HTTP exception thrown: Share type not found. May 28 13:01:13 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-f834dd38-eb5c-4d79-83cd-f3e979b1822c tempest-ShareRulesNegativeTest-1738210631 tempest-ShareRulesNegativeTest-1738210631-project-admin] http://10.27.203.238/share/v2/011748bb7e2247e88228bd066607700e/types/014d638f-6718-47b3-a401-a453a3d85ba9 returned with HTTP 404 May 28 13:01:13 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1037/2036] 10.27.203.238 () {64 vars in 1448 bytes} [Tue May 28 13:01:13 2024] GET /share/v2/011748bb7e2247e88228bd066607700e/types/014d638f-6718-47b3-a401-a453a3d85ba9 => generated 67 bytes in 12 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 13:01:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb00f951-dbe7-4cc8-805d-b93bf8620097 service manila] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-fb00f951-dbe7-4cc8-805d-b93bf8620097 service manila] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:01:13 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-154096e0-207d-4a49-9df8-74e29b3402eb tempest-SharesNFSTest-667257547 None] Committed reservations ['942a6118-5bac-4d0d-bd28-2193d9a548b8', '43eff639-4600-4bb0-81be-87e3411cab46', '71ab3e64-4a50-4e1c-bd30-210b8a3da6e0', '2f55d03c-7556-4170-829c-093e0b7a7b18'] {{(pid=98474) commit /opt/stack/manila/manila/quota.py:1063}} May 28 13:01:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb00f951-dbe7-4cc8-805d-b93bf8620097 service manila] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509b5f67-7cb6-4f97-b624-3691f4f12f7f None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509b5f67-7cb6-4f97-b624-3691f4f12f7f None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509b5f67-7cb6-4f97-b624-3691f4f12f7f None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509b5f67-7cb6-4f97-b624-3691f4f12f7f None admin] PATH_INFO: `/v3/users/2fa39ddec14b4264baadbcad8beeaa18` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509b5f67-7cb6-4f97-b624-3691f4f12f7f None admin] RBAC: Authorizing `identity:delete_user(user_id=2fa39ddec14b4264baadbcad8beeaa18)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509b5f67-7cb6-4f97-b624-3691f4f12f7f None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-509b5f67-7cb6-4f97-b624-3691f4f12f7f None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2fa39ddec14b4264baadbcad8beeaa18', 'request_id': 'req-509b5f67-7cb6-4f97-b624-3691f4f12f7f'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-509b5f67-7cb6-4f97-b624-3691f4f12f7f None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2fa39ddec14b4264baadbcad8beeaa18', 'request_id': 'req-509b5f67-7cb6-4f97-b624-3691f4f12f7f'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-509b5f67-7cb6-4f97-b624-3691f4f12f7f None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2fa39ddec14b4264baadbcad8beeaa18', 'request_id': 'req-509b5f67-7cb6-4f97-b624-3691f4f12f7f'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-509b5f67-7cb6-4f97-b624-3691f4f12f7f None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2fa39ddec14b4264baadbcad8beeaa18', 'request_id': 'req-509b5f67-7cb6-4f97-b624-3691f4f12f7f'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-509b5f67-7cb6-4f97-b624-3691f4f12f7f None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2fa39ddec14b4264baadbcad8beeaa18', 'request_id': 'req-509b5f67-7cb6-4f97-b624-3691f4f12f7f'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:13 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1493/3013] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 13:01:13 2024] DELETE /identity/v3/users/2fa39ddec14b4264baadbcad8beeaa18 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:01:13 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-fd1c6c0e-c8e9-4f2c-8edc-9bea1bc4bc50 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] GET http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/shares/415b1daa-22c2-48a3-873e-80762e65a747 May 28 13:01:13 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-fd1c6c0e-c8e9-4f2c-8edc-9bea1bc4bc50 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:13 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-fd1c6c0e-c8e9-4f2c-8edc-9bea1bc4bc50 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6e10f9-f116-42eb-a279-6ecf50ebb923 service manila] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6e10f9-f116-42eb-a279-6ecf50ebb923 service manila] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:13 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-fd1c6c0e-c8e9-4f2c-8edc-9bea1bc4bc50 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] HTTP exception thrown: The resource could not be found. May 28 13:01:13 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-fd1c6c0e-c8e9-4f2c-8edc-9bea1bc4bc50 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/shares/415b1daa-22c2-48a3-873e-80762e65a747 returned with HTTP 404 May 28 13:01:13 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1000/2037] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:01:13 2024] GET /share/v2/a4f3887fa28c457390f5b66615564430/shares/415b1daa-22c2-48a3-873e-80762e65a747 => generated 78 bytes in 12 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 13:01:13 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-03c515ab-94bb-44b1-9269-2f8cb5e915fe tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] GET http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/share-access-rules?share_id=415b1daa-22c2-48a3-873e-80762e65a747 May 28 13:01:13 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-03c515ab-94bb-44b1-9269-2f8cb5e915fe tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:13 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-03c515ab-94bb-44b1-9269-2f8cb5e915fe tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:13 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-03c515ab-94bb-44b1-9269-2f8cb5e915fe tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] HTTP exception thrown: Share 415b1daa-22c2-48a3-873e-80762e65a747 not found. May 28 13:01:13 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-03c515ab-94bb-44b1-9269-2f8cb5e915fe tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/share-access-rules?share_id=415b1daa-22c2-48a3-873e-80762e65a747 returned with HTTP 400 May 28 13:01:13 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1038/2038] 10.27.203.238 () {64 vars in 1467 bytes} [Tue May 28 13:01:13 2024] GET /share/v2/a4f3887fa28c457390f5b66615564430/share-access-rules?share_id=415b1daa-22c2-48a3-873e-80762e65a747 => generated 97 bytes in 12 msecs (HTTP/1.1 400) 6 headers in 239 bytes (1 switches on core 0) May 28 13:01:13 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-e9709f89-cda1-4335-8385-dd167edf0c22 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] POST http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/shares/b330db31-7766-443d-9c19-26fe349665aa/action May 28 13:01:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc8d124-abe5-483a-99b1-1c38c9dc6426 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc8d124-abe5-483a-99b1-1c38c9dc6426 None admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc8d124-abe5-483a-99b1-1c38c9dc6426 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc8d124-abe5-483a-99b1-1c38c9dc6426 None admin] PATH_INFO: `/v3/users/3dbabbbe168342768f75a3028aaecc36` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:13 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-e9709f89-cda1-4335-8385-dd167edf0c22 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Action body: b'{"allow_access": {"access_type": "ip", "access_to": "203.0.113.77", "access_level": "rw", "lock_visibility": true, "lock_deletion": true}}' {{(pid=98330) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 13:01:13 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-e9709f89-cda1-4335-8385-dd167edf0c22 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Action: 'action', calling method: ShareController.allow_access, body: {"allow_access": {"access_type": "ip", "access_to": "203.0.113.77", "access_level": "rw", "lock_visibility": true, "lock_deletion": true}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:01:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc8d124-abe5-483a-99b1-1c38c9dc6426 None admin] RBAC: Authorizing `identity:delete_user(user_id=3dbabbbe168342768f75a3028aaecc36)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc8d124-abe5-483a-99b1-1c38c9dc6426 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-7fc8d124-abe5-483a-99b1-1c38c9dc6426 None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3dbabbbe168342768f75a3028aaecc36', 'request_id': 'req-7fc8d124-abe5-483a-99b1-1c38c9dc6426'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-7fc8d124-abe5-483a-99b1-1c38c9dc6426 None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3dbabbbe168342768f75a3028aaecc36', 'request_id': 'req-7fc8d124-abe5-483a-99b1-1c38c9dc6426'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:13 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-e9709f89-cda1-4335-8385-dd167edf0c22 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:01:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-7fc8d124-abe5-483a-99b1-1c38c9dc6426 None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3dbabbbe168342768f75a3028aaecc36', 'request_id': 'req-7fc8d124-abe5-483a-99b1-1c38c9dc6426'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-7fc8d124-abe5-483a-99b1-1c38c9dc6426 None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3dbabbbe168342768f75a3028aaecc36', 'request_id': 'req-7fc8d124-abe5-483a-99b1-1c38c9dc6426'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:13 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-e9709f89-cda1-4335-8385-dd167edf0c22 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:01:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-7fc8d124-abe5-483a-99b1-1c38c9dc6426 None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3dbabbbe168342768f75a3028aaecc36', 'request_id': 'req-7fc8d124-abe5-483a-99b1-1c38c9dc6426'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:13 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1521/3014] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 13:01:13 2024] DELETE /identity/v3/users/3dbabbbe168342768f75a3028aaecc36 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:01:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509b5f67-7cb6-4f97-b624-3691f4f12f7f None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-509b5f67-7cb6-4f97-b624-3691f4f12f7f None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:01:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509b5f67-7cb6-4f97-b624-3691f4f12f7f None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:13 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-e9709f89-cda1-4335-8385-dd167edf0c22 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.049s {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:01:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43b3c3b-a93e-439b-95e9-b6450bb66fd6 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43b3c3b-a93e-439b-95e9-b6450bb66fd6 None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43b3c3b-a93e-439b-95e9-b6450bb66fd6 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43b3c3b-a93e-439b-95e9-b6450bb66fd6 None admin] PATH_INFO: `/v3/users/ffcac1016e3c4ee3a3ad1b48da439b19` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43b3c3b-a93e-439b-95e9-b6450bb66fd6 None admin] RBAC: Authorizing `identity:delete_user(user_id=ffcac1016e3c4ee3a3ad1b48da439b19)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43b3c3b-a93e-439b-95e9-b6450bb66fd6 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:13 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-e9709f89-cda1-4335-8385-dd167edf0c22 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/shares/b330db31-7766-443d-9c19-26fe349665aa/action returned with HTTP 200 May 28 13:01:13 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1001/2039] 10.27.203.238 () {66 vars in 1494 bytes} [Tue May 28 13:01:13 2024] POST /share/v2/a4f3887fa28c457390f5b66615564430/shares/b330db31-7766-443d-9c19-26fe349665aa/action => generated 310 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:01:13 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-623cf3e2-065c-42a8-8959-12cc39d557a4 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] GET http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/share-access-rules?share_id=b330db31-7766-443d-9c19-26fe349665aa May 28 13:01:13 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-623cf3e2-065c-42a8-8959-12cc39d557a4 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:13 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-623cf3e2-065c-42a8-8959-12cc39d557a4 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-e43b3c3b-a93e-439b-95e9-b6450bb66fd6 None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ffcac1016e3c4ee3a3ad1b48da439b19', 'request_id': 'req-e43b3c3b-a93e-439b-95e9-b6450bb66fd6'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-e43b3c3b-a93e-439b-95e9-b6450bb66fd6 None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ffcac1016e3c4ee3a3ad1b48da439b19', 'request_id': 'req-e43b3c3b-a93e-439b-95e9-b6450bb66fd6'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-e43b3c3b-a93e-439b-95e9-b6450bb66fd6 None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ffcac1016e3c4ee3a3ad1b48da439b19', 'request_id': 'req-e43b3c3b-a93e-439b-95e9-b6450bb66fd6'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-e43b3c3b-a93e-439b-95e9-b6450bb66fd6 None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ffcac1016e3c4ee3a3ad1b48da439b19', 'request_id': 'req-e43b3c3b-a93e-439b-95e9-b6450bb66fd6'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-e43b3c3b-a93e-439b-95e9-b6450bb66fd6 None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ffcac1016e3c4ee3a3ad1b48da439b19', 'request_id': 'req-e43b3c3b-a93e-439b-95e9-b6450bb66fd6'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:13 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.lock.api [None req-623cf3e2-065c-42a8-8959-12cc39d557a4 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Searching for locks by: {'resource_id': 'ec5b7eb4-7b80-4c81-8a14-0fc3a95397f5', 'resource_action': 'show', 'resource_type': 'access_rule'} {{(pid=98329) get_all /opt/stack/manila/manila/lock/api.py:112}} May 28 13:01:13 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-623cf3e2-065c-42a8-8959-12cc39d557a4 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/share-access-rules?share_id=b330db31-7766-443d-9c19-26fe349665aa returned with HTTP 200 May 28 13:01:13 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1039/2040] 10.27.203.238 () {64 vars in 1467 bytes} [Tue May 28 13:01:13 2024] GET /share/v2/a4f3887fa28c457390f5b66615564430/share-access-rules?share_id=b330db31-7766-443d-9c19-26fe349665aa => generated 265 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:01:13 l75lg1-v1 manila-share[98474]: DEBUG manila.share.manager [None req-e9709f89-cda1-4335-8385-dd167edf0c22 tempest-ShareRulesTest-1530341375 None] Received request to update access for share instance f7e47502-a0f7-44de-953d-b7b5697ae0b2. {{(pid=98474) update_access_for_instances /opt/stack/manila/manila/share/manager.py:4353}} May 28 13:01:13 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1494/3015] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 13:01:13 2024] DELETE /identity/v3/users/ffcac1016e3c4ee3a3ad1b48da439b19 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:01:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5fa280-e17d-453a-a950-318e43d258c9 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5fa280-e17d-453a-a950-318e43d258c9 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5fa280-e17d-453a-a950-318e43d258c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:13 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-e9709f89-cda1-4335-8385-dd167edf0c22 tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:01:13 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-e9709f89-cda1-4335-8385-dd167edf0c22 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:01:13 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-e9709f89-cda1-4335-8385-dd167edf0c22 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:01:13 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-e9709f89-cda1-4335-8385-dd167edf0c22 tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:01:13 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-1e5fa280-e17d-453a-a950-318e43d258c9 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 13:01:13 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-e9709f89-cda1-4335-8385-dd167edf0c22 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:01:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-1e5fa280-e17d-453a-a950-318e43d258c9 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 13:01:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-1e5fa280-e17d-453a-a950-318e43d258c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:01:13 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1522/3016] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 13:01:13 2024] POST /identity/v3/auth/tokens => generated 2960 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 13:01:13 l75lg1-v1 neutron-server[77619]: DEBUG neutron.wsgi [-] (77619) accepted ('10.27.203.238', 55086) {{(pid=77619) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 13:01:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43b3c3b-a93e-439b-95e9-b6450bb66fd6 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-e43b3c3b-a93e-439b-95e9-b6450bb66fd6 None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:01:13 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-e9709f89-cda1-4335-8385-dd167edf0c22 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.056s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:01:13 l75lg1-v1 manila-share[98474]: DEBUG manila.share.access [None req-e9709f89-cda1-4335-8385-dd167edf0c22 tempest-ShareRulesTest-1530341375 None] Updating access rules for share instance f7e47502-a0f7-44de-953d-b7b5697ae0b2 belonging to share b330db31-7766-443d-9c19-26fe349665aa. {{(pid=98474) update_access_rules /opt/stack/manila/manila/share/access.py:298}} May 28 13:01:13 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-e9709f89-cda1-4335-8385-dd167edf0c22 tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:01:13 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-e9709f89-cda1-4335-8385-dd167edf0c22 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:01:13 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-e9709f89-cda1-4335-8385-dd167edf0c22 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.007s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:01:13 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-e9709f89-cda1-4335-8385-dd167edf0c22 tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:01:13 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-e9709f89-cda1-4335-8385-dd167edf0c22 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:01:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43b3c3b-a93e-439b-95e9-b6450bb66fd6 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b1a933-c894-4308-b717-54a32ceaf25f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef17047035e4b518fd5360a01f2da1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b1a933-c894-4308-b717-54a32ceaf25f service neutron] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b1a933-c894-4308-b717-54a32ceaf25f service neutron] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b1a933-c894-4308-b717-54a32ceaf25f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:13 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-e9709f89-cda1-4335-8385-dd167edf0c22 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.014s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:01:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b1a933-c894-4308-b717-54a32ceaf25f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:13 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-e9709f89-cda1-4335-8385-dd167edf0c22 tempest-ShareRulesTest-1530341375 None] changing access on None May 28 13:01:13 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e9709f89-cda1-4335-8385-dd167edf0c22 tempest-ShareRulesTest-1530341375 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:01:13 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e9709f89-cda1-4335-8385-dd167edf0c22 tempest-ShareRulesTest-1530341375 None] {'allow_redirects': True, May 28 13:01:13 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e9709f89-cda1-4335-8385-dd167edf0c22 tempest-ShareRulesTest-1530341375 None] 'params': {'name': 'f7e47502-a0f7-44de-953d-b7b5697ae0b2'}} May 28 13:01:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b1a933-c894-4308-b717-54a32ceaf25f service neutron] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:13 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1495/3017] 10.27.203.238 () {64 vars in 1432 bytes} [Tue May 28 13:01:13 2024] GET /identity/v3/auth/tokens => generated 2960 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 28 13:01:13 l75lg1-v1 neutron-server[77619]: INFO neutron.wsgi [None req-93950739-add9-4474-82fe-be1054b7d6a2 None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=329a14ab984146feb9f91e467ab4e3b5&name=default HTTP/1.1" status: 200 len: 216 time: 0.0775762 May 28 13:01:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5fa280-e17d-453a-a950-318e43d258c9 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-1e5fa280-e17d-453a-a950-318e43d258c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:01:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5fa280-e17d-453a-a950-318e43d258c9 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a8a1ed-059a-48a4-819b-32ad10160cca None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a8a1ed-059a-48a4-819b-32ad10160cca None admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a8a1ed-059a-48a4-819b-32ad10160cca None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a8a1ed-059a-48a4-819b-32ad10160cca None admin] PATH_INFO: `/v3/projects/329a14ab984146feb9f91e467ab4e3b5` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a8a1ed-059a-48a4-819b-32ad10160cca None admin] RBAC: Authorizing `identity:delete_project(project_id=329a14ab984146feb9f91e467ab4e3b5)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a8a1ed-059a-48a4-819b-32ad10160cca None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-05a8a1ed-059a-48a4-819b-32ad10160cca None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '329a14ab984146feb9f91e467ab4e3b5', 'request_id': 'req-05a8a1ed-059a-48a4-819b-32ad10160cca'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-05a8a1ed-059a-48a4-819b-32ad10160cca None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '329a14ab984146feb9f91e467ab4e3b5', 'request_id': 'req-05a8a1ed-059a-48a4-819b-32ad10160cca'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-05a8a1ed-059a-48a4-819b-32ad10160cca None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '329a14ab984146feb9f91e467ab4e3b5', 'request_id': 'req-05a8a1ed-059a-48a4-819b-32ad10160cca'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:14 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-05a8a1ed-059a-48a4-819b-32ad10160cca None admin] The token cache is being invalidate because project 329a14ab984146feb9f91e467ab4e3b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 13:01:14 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-05a8a1ed-059a-48a4-819b-32ad10160cca None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:14 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-05a8a1ed-059a-48a4-819b-32ad10160cca None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:14 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1523/3018] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 13:01:13 2024] DELETE /identity/v3/projects/329a14ab984146feb9f91e467ab4e3b5 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:01:14 l75lg1-v1 neutron-server[77619]: DEBUG neutron.wsgi [-] (77619) accepted ('10.27.203.238', 55096) {{(pid=77619) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 13:01:14 l75lg1-v1 neutron-server[77619]: INFO neutron.wsgi [None req-23fe81e0-bdcf-4057-b93e-fbb998a7a16e None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=23657740d87e423db1788bcc1fd1a8bf&name=default HTTP/1.1" status: 200 len: 216 time: 0.0088000 May 28 13:01:14 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b1a933-c894-4308-b717-54a32ceaf25f service neutron] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:14 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b1a933-c894-4308-b717-54a32ceaf25f service neutron] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:14 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbe9b85-a1c3-4702-a160-b482a7d69051 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:14 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbe9b85-a1c3-4702-a160-b482a7d69051 None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:14 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbe9b85-a1c3-4702-a160-b482a7d69051 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:14 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbe9b85-a1c3-4702-a160-b482a7d69051 None admin] PATH_INFO: `/v3/projects/23657740d87e423db1788bcc1fd1a8bf` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:14 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbe9b85-a1c3-4702-a160-b482a7d69051 None admin] RBAC: Authorizing `identity:delete_project(project_id=23657740d87e423db1788bcc1fd1a8bf)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:14 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbe9b85-a1c3-4702-a160-b482a7d69051 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:14 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-6dbe9b85-a1c3-4702-a160-b482a7d69051 None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23657740d87e423db1788bcc1fd1a8bf', 'request_id': 'req-6dbe9b85-a1c3-4702-a160-b482a7d69051'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:14 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-6dbe9b85-a1c3-4702-a160-b482a7d69051 None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23657740d87e423db1788bcc1fd1a8bf', 'request_id': 'req-6dbe9b85-a1c3-4702-a160-b482a7d69051'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:14 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-6dbe9b85-a1c3-4702-a160-b482a7d69051 None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23657740d87e423db1788bcc1fd1a8bf', 'request_id': 'req-6dbe9b85-a1c3-4702-a160-b482a7d69051'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:14 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-6dbe9b85-a1c3-4702-a160-b482a7d69051 None admin] The token cache is being invalidate because project 23657740d87e423db1788bcc1fd1a8bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 13:01:14 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-6dbe9b85-a1c3-4702-a160-b482a7d69051 None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:14 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-6dbe9b85-a1c3-4702-a160-b482a7d69051 None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:14 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1496/3019] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 13:01:14 2024] DELETE /identity/v3/projects/23657740d87e423db1788bcc1fd1a8bf => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:01:14 l75lg1-v1 neutron-server[77619]: DEBUG neutron.wsgi [-] (77619) accepted ('10.27.203.238', 55100) {{(pid=77619) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 13:01:14 l75lg1-v1 neutron-server[77619]: INFO neutron.wsgi [None req-4dc035d8-bd0e-4142-b7b6-c0bf43398aeb None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=011748bb7e2247e88228bd066607700e&name=default HTTP/1.1" status: 200 len: 216 time: 0.0100532 May 28 13:01:14 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a8a1ed-059a-48a4-819b-32ad10160cca None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:14 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-05a8a1ed-059a-48a4-819b-32ad10160cca None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:01:14 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a8a1ed-059a-48a4-819b-32ad10160cca None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:14 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66712c28-e3cd-4161-ab99-530892c451d3 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:14 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66712c28-e3cd-4161-ab99-530892c451d3 None admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:14 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66712c28-e3cd-4161-ab99-530892c451d3 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:14 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66712c28-e3cd-4161-ab99-530892c451d3 None admin] PATH_INFO: `/v3/projects/011748bb7e2247e88228bd066607700e` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:14 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66712c28-e3cd-4161-ab99-530892c451d3 None admin] RBAC: Authorizing `identity:delete_project(project_id=011748bb7e2247e88228bd066607700e)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:14 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66712c28-e3cd-4161-ab99-530892c451d3 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:14 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-66712c28-e3cd-4161-ab99-530892c451d3 None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '011748bb7e2247e88228bd066607700e', 'request_id': 'req-66712c28-e3cd-4161-ab99-530892c451d3'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:14 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-66712c28-e3cd-4161-ab99-530892c451d3 None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '011748bb7e2247e88228bd066607700e', 'request_id': 'req-66712c28-e3cd-4161-ab99-530892c451d3'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:14 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-66712c28-e3cd-4161-ab99-530892c451d3 None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '011748bb7e2247e88228bd066607700e', 'request_id': 'req-66712c28-e3cd-4161-ab99-530892c451d3'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:14 l75lg1-v1 dstat.sh[49771]: 28-05 13:01:14| 13 1 81 3 0|5698M 1745M 278M 7904M| 15k 5845B| 0 2312k| 0 371 |8081 14k|1.56 1.24 1.08|2.0 1.0 0| 0 0 | 0 2048M| 29 364 0 33 2 May 28 13:01:14 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-66712c28-e3cd-4161-ab99-530892c451d3 None admin] The token cache is being invalidate because project 011748bb7e2247e88228bd066607700e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 13:01:14 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-66712c28-e3cd-4161-ab99-530892c451d3 None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:14 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-66712c28-e3cd-4161-ab99-530892c451d3 None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:14 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1524/3020] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 13:01:14 2024] DELETE /identity/v3/projects/011748bb7e2247e88228bd066607700e => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:01:14 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b777a5f-35d5-4e36-abe9-0a55c0879a32 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:14 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b777a5f-35d5-4e36-abe9-0a55c0879a32 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:14 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b777a5f-35d5-4e36-abe9-0a55c0879a32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:14 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-9b777a5f-35d5-4e36-abe9-0a55c0879a32 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 13:01:14 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-9b777a5f-35d5-4e36-abe9-0a55c0879a32 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 13:01:14 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-9b777a5f-35d5-4e36-abe9-0a55c0879a32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:01:14 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1497/3021] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 13:01:14 2024] POST /identity/v3/auth/tokens => generated 312 bytes in 20 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 28 13:01:14 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf67cfdd-f981-4c39-ba8e-b03967c991f0 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:14 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf67cfdd-f981-4c39-ba8e-b03967c991f0 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:14 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf67cfdd-f981-4c39-ba8e-b03967c991f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:14 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-bf67cfdd-f981-4c39-ba8e-b03967c991f0 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 13:01:14 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-bf67cfdd-f981-4c39-ba8e-b03967c991f0 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 13:01:14 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-bf67cfdd-f981-4c39-ba8e-b03967c991f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:01:14 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1525/3022] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 13:01:14 2024] POST /identity/v3/auth/tokens => generated 2960 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 13:01:14 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b777a5f-35d5-4e36-abe9-0a55c0879a32 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:14 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b777a5f-35d5-4e36-abe9-0a55c0879a32 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:14 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb88b36b-bf1c-457b-b979-dc72823f0999 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:14 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb88b36b-bf1c-457b-b979-dc72823f0999 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:14 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb88b36b-bf1c-457b-b979-dc72823f0999 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:14 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb88b36b-bf1c-457b-b979-dc72823f0999 None admin] PATH_INFO: `/v3/domains` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:14 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb88b36b-bf1c-457b-b979-dc72823f0999 None admin] RBAC: Adding query filter params (name=Default) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 13:01:14 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb88b36b-bf1c-457b-b979-dc72823f0999 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:14 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb88b36b-bf1c-457b-b979-dc72823f0999 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:14 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1498/3023] 10.27.203.238 () {62 vars in 1220 bytes} [Tue May 28 13:01:14 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 13:01:14 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf67cfdd-f981-4c39-ba8e-b03967c991f0 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:14 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf67cfdd-f981-4c39-ba8e-b03967c991f0 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:14 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c03c60c-0c67-4381-9afa-5b50aa6d05a3 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:14 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c03c60c-0c67-4381-9afa-5b50aa6d05a3 None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:14 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c03c60c-0c67-4381-9afa-5b50aa6d05a3 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:14 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c03c60c-0c67-4381-9afa-5b50aa6d05a3 None admin] PATH_INFO: `/v3/projects` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:14 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c03c60c-0c67-4381-9afa-5b50aa6d05a3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:14 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c03c60c-0c67-4381-9afa-5b50aa6d05a3 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:14 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1526/3024] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 13:01:14 2024] POST /identity/v3/projects => generated 401 bytes in 36 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 13:01:14 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb88b36b-bf1c-457b-b979-dc72823f0999 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:14 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb88b36b-bf1c-457b-b979-dc72823f0999 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:14 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b6f8fa-5d23-4a40-ba9e-9152f78b0ccd None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:14 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b6f8fa-5d23-4a40-ba9e-9152f78b0ccd None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:14 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b6f8fa-5d23-4a40-ba9e-9152f78b0ccd None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:14 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b6f8fa-5d23-4a40-ba9e-9152f78b0ccd None admin] PATH_INFO: `/v3/users` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:14 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b6f8fa-5d23-4a40-ba9e-9152f78b0ccd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:14 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b6f8fa-5d23-4a40-ba9e-9152f78b0ccd None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:14 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-16b6f8fa-5d23-4a40-ba9e-9152f78b0ccd None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 13:01:14 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1499/3025] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 13:01:14 2024] POST /identity/v3/users => generated 309 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 13:01:14 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c03c60c-0c67-4381-9afa-5b50aa6d05a3 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:14 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c03c60c-0c67-4381-9afa-5b50aa6d05a3 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:14 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918c3b55-6458-403b-bd21-514646b7699d None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:14 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918c3b55-6458-403b-bd21-514646b7699d None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:14 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918c3b55-6458-403b-bd21-514646b7699d None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:14 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918c3b55-6458-403b-bd21-514646b7699d None admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:14 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918c3b55-6458-403b-bd21-514646b7699d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:14 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918c3b55-6458-403b-bd21-514646b7699d None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:14 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1527/3026] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 13:01:14 2024] GET /identity/v3/roles => generated 1680 bytes in 17 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 13:01:14 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b6f8fa-5d23-4a40-ba9e-9152f78b0ccd None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:14 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b6f8fa-5d23-4a40-ba9e-9152f78b0ccd None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:14 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc265747-1688-46df-a1f3-21809c0ce6ad None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:14 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e9709f89-cda1-4335-8385-dd167edf0c22 tempest-ShareRulesTest-1530341375 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:01:14 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc265747-1688-46df-a1f3-21809c0ce6ad None admin] REQUEST_METHOD: `PUT` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:14 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc265747-1688-46df-a1f3-21809c0ce6ad None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:14 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc265747-1688-46df-a1f3-21809c0ce6ad None admin] PATH_INFO: `/v3/projects/603a67a7ef1243358ab6945c5eb752a4/users/ea25742cabb3412c941df36314d63211/roles/44620cad10ae407c90c91e2c296adb04` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:14 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e9709f89-cda1-4335-8385-dd167edf0c22 tempest-ShareRulesTest-1530341375 None] [Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=1, created='2024-05-28T12:59:53.824250Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='0fa84ccd-850f-48fa-a965-23e5abe31188', id=38, internal=False, is_s3_default_policy=False, name='f7e47502-a0f7-44de-953d-b7b5697ae0b2', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=[], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['*'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['*'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T12:59:54.246720Z', tenant_id=1, tenant_name='default', title='f7e47502-a0f7-44de-953d-b7b5697ae0b2', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/38/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[])] May 28 13:01:14 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e9709f89-cda1-4335-8385-dd167edf0c22 tempest-ShareRulesTest-1530341375 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 13:01:14 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-e9709f89-cda1-4335-8385-dd167edf0c22 tempest-ShareRulesTest-1530341375 None] changing access on /manila/manila-f7e47502-a0f7-44de-953d-b7b5697ae0b2. Rules: {'nfs_read_write': ['203.0.113.77'], 'nfs_read_only': []} May 28 13:01:14 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e9709f89-cda1-4335-8385-dd167edf0c22 tempest-ShareRulesTest-1530341375 None] >>> [PATCH] https://127.0.0.1:40443/api/viewpolicies/38/ May 28 13:01:14 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e9709f89-cda1-4335-8385-dd167edf0c22 tempest-ShareRulesTest-1530341375 None] {'data': '{"name": "f7e47502-a0f7-44de-953d-b7b5697ae0b2", "nfs_no_squash": ' May 28 13:01:14 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e9709f89-cda1-4335-8385-dd167edf0c22 tempest-ShareRulesTest-1530341375 None] '["*"], "nfs_root_squash": ["*"], "nfs_read_write": ["203.0.113.77"], ' May 28 13:01:14 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e9709f89-cda1-4335-8385-dd167edf0c22 tempest-ShareRulesTest-1530341375 None] '"nfs_read_only": []}', May 28 13:01:14 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e9709f89-cda1-4335-8385-dd167edf0c22 tempest-ShareRulesTest-1530341375 None] 'params': None} May 28 13:01:14 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc265747-1688-46df-a1f3-21809c0ce6ad None admin] RBAC: Authorizing `identity:create_grant(project_id=603a67a7ef1243358ab6945c5eb752a4, user_id=ea25742cabb3412c941df36314d63211, role_id=44620cad10ae407c90c91e2c296adb04)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:14 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc265747-1688-46df-a1f3-21809c0ce6ad None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:14 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1500/3027] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 13:01:14 2024] PUT /identity/v3/projects/603a67a7ef1243358ab6945c5eb752a4/users/ea25742cabb3412c941df36314d63211/roles/44620cad10ae407c90c91e2c296adb04 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:01:14 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8e0437-773a-423d-86ae-0e45452b7486 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:14 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8e0437-773a-423d-86ae-0e45452b7486 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:14 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8e0437-773a-423d-86ae-0e45452b7486 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:14 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-4e8e0437-773a-423d-86ae-0e45452b7486 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 13:01:14 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-4e8e0437-773a-423d-86ae-0e45452b7486 None None] MFA Rules not processed for user `ea25742cabb3412c941df36314d63211`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 13:01:14 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-4e8e0437-773a-423d-86ae-0e45452b7486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:01:14 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1528/3028] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 13:01:14 2024] POST /identity/v3/auth/tokens => generated 3972 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 13:01:14 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc265747-1688-46df-a1f3-21809c0ce6ad None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:14 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-eca22f9c-953e-43a7-8dc6-d17cac6b9ee7 tempest-SharesNFSTest-667257547 tempest-SharesNFSTest-667257547-project-member] GET http://10.27.203.238/share/v1/0af6f8e0aeed4f27b075e08f2bc713aa/snapshots/bff3b07e-650b-4bc1-8c88-fcd101dd0295 May 28 13:01:14 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-eca22f9c-953e-43a7-8dc6-d17cac6b9ee7 tempest-SharesNFSTest-667257547 tempest-SharesNFSTest-667257547-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:14 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-eca22f9c-953e-43a7-8dc6-d17cac6b9ee7 tempest-SharesNFSTest-667257547 tempest-SharesNFSTest-667257547-project-member] Calling method 'ShareSnapshotMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:14 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-eca22f9c-953e-43a7-8dc6-d17cac6b9ee7 tempest-SharesNFSTest-667257547 tempest-SharesNFSTest-667257547-project-member] HTTP exception thrown: The resource could not be found. May 28 13:01:14 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-eca22f9c-953e-43a7-8dc6-d17cac6b9ee7 tempest-SharesNFSTest-667257547 tempest-SharesNFSTest-667257547-project-member] http://10.27.203.238/share/v1/0af6f8e0aeed4f27b075e08f2bc713aa/snapshots/bff3b07e-650b-4bc1-8c88-fcd101dd0295 returned with HTTP 404 May 28 13:01:14 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1002/2041] 10.27.203.238 () {62 vars in 1417 bytes} [Tue May 28 13:01:14 2024] GET /share/v1/0af6f8e0aeed4f27b075e08f2bc713aa/snapshots/bff3b07e-650b-4bc1-8c88-fcd101dd0295 => generated 78 bytes in 14 msecs (HTTP/1.1 404) 6 headers in 236 bytes (1 switches on core 0) May 28 13:01:14 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-db0926e6-9576-4f19-b628-692f5848a0bb tempest-SharesNFSTest-667257547 tempest-SharesNFSTest-667257547-project-member] GET http://10.27.203.238/share/v1/0af6f8e0aeed4f27b075e08f2bc713aa/snapshots/bff3b07e-650b-4bc1-8c88-fcd101dd0295 May 28 13:01:14 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-db0926e6-9576-4f19-b628-692f5848a0bb tempest-SharesNFSTest-667257547 tempest-SharesNFSTest-667257547-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:14 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-db0926e6-9576-4f19-b628-692f5848a0bb tempest-SharesNFSTest-667257547 tempest-SharesNFSTest-667257547-project-member] Calling method 'ShareSnapshotMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:14 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc265747-1688-46df-a1f3-21809c0ce6ad None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:14 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16486e97-656c-435a-9ab7-a1064f12ff8b None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:14 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16486e97-656c-435a-9ab7-a1064f12ff8b None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:14 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16486e97-656c-435a-9ab7-a1064f12ff8b None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:14 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16486e97-656c-435a-9ab7-a1064f12ff8b None admin] PATH_INFO: `/v3/projects` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:14 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16486e97-656c-435a-9ab7-a1064f12ff8b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:14 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16486e97-656c-435a-9ab7-a1064f12ff8b None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:14 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-db0926e6-9576-4f19-b628-692f5848a0bb tempest-SharesNFSTest-667257547 tempest-SharesNFSTest-667257547-project-member] HTTP exception thrown: The resource could not be found. May 28 13:01:14 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-db0926e6-9576-4f19-b628-692f5848a0bb tempest-SharesNFSTest-667257547 tempest-SharesNFSTest-667257547-project-member] http://10.27.203.238/share/v1/0af6f8e0aeed4f27b075e08f2bc713aa/snapshots/bff3b07e-650b-4bc1-8c88-fcd101dd0295 returned with HTTP 404 May 28 13:01:14 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1040/2042] 10.27.203.238 () {62 vars in 1417 bytes} [Tue May 28 13:01:14 2024] GET /share/v1/0af6f8e0aeed4f27b075e08f2bc713aa/snapshots/bff3b07e-650b-4bc1-8c88-fcd101dd0295 => generated 78 bytes in 21 msecs (HTTP/1.1 404) 6 headers in 236 bytes (1 switches on core 0) May 28 13:01:14 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-c8410030-3920-40e1-9f07-b04a43574f96 tempest-SharesNFSTest-667257547 tempest-SharesNFSTest-667257547-project-member] GET http://10.27.203.238/share/v2/0af6f8e0aeed4f27b075e08f2bc713aa/share-replicas/detail?share_id=7a762332-0877-462f-941a-6581abbf784b May 28 13:01:14 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-c8410030-3920-40e1-9f07-b04a43574f96 tempest-SharesNFSTest-667257547 tempest-SharesNFSTest-667257547-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:14 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-c8410030-3920-40e1-9f07-b04a43574f96 tempest-SharesNFSTest-667257547 tempest-SharesNFSTest-667257547-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:14 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-c8410030-3920-40e1-9f07-b04a43574f96 tempest-SharesNFSTest-667257547 tempest-SharesNFSTest-667257547-project-member] http://10.27.203.238/share/v2/0af6f8e0aeed4f27b075e08f2bc713aa/share-replicas/detail?share_id=7a762332-0877-462f-941a-6581abbf784b returned with HTTP 200 May 28 13:01:14 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1003/2043] 10.27.203.238 () {64 vars in 1476 bytes} [Tue May 28 13:01:14 2024] GET /share/v2/0af6f8e0aeed4f27b075e08f2bc713aa/share-replicas/detail?share_id=7a762332-0877-462f-941a-6581abbf784b => generated 22 bytes in 13 msecs (HTTP/1.1 200) 6 headers in 230 bytes (2 switches on core 0) May 28 13:01:14 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-9242ab9c-98af-4bf4-ab2d-7a757be81a4f tempest-SharesNFSTest-667257547 tempest-SharesNFSTest-667257547-project-member] DELETE http://10.27.203.238/share/v2/0af6f8e0aeed4f27b075e08f2bc713aa/shares/7a762332-0877-462f-941a-6581abbf784b May 28 13:01:14 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-9242ab9c-98af-4bf4-ab2d-7a757be81a4f tempest-SharesNFSTest-667257547 tempest-SharesNFSTest-667257547-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:14 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-9242ab9c-98af-4bf4-ab2d-7a757be81a4f tempest-SharesNFSTest-667257547 tempest-SharesNFSTest-667257547-project-member] Calling method 'ShareMixin.delete' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:14 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1501/3029] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 13:01:14 2024] POST /identity/v3/projects => generated 403 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 13:01:14 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.v1.shares [None req-9242ab9c-98af-4bf4-ab2d-7a757be81a4f tempest-SharesNFSTest-667257547 tempest-SharesNFSTest-667257547-project-member] Delete share with id: 7a762332-0877-462f-941a-6581abbf784b May 28 13:01:14 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8e0437-773a-423d-86ae-0e45452b7486 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:14 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8e0437-773a-423d-86ae-0e45452b7486 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:14 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156f96ad-f3ca-4ccb-817c-0cbcd9c6bdac None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:14 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156f96ad-f3ca-4ccb-817c-0cbcd9c6bdac None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:14 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156f96ad-f3ca-4ccb-817c-0cbcd9c6bdac None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:14 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156f96ad-f3ca-4ccb-817c-0cbcd9c6bdac None admin] PATH_INFO: `/v3/users` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:14 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156f96ad-f3ca-4ccb-817c-0cbcd9c6bdac None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:14 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156f96ad-f3ca-4ccb-817c-0cbcd9c6bdac None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:14 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-156f96ad-f3ca-4ccb-817c-0cbcd9c6bdac None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 13:01:14 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1529/3030] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 13:01:14 2024] POST /identity/v3/users => generated 310 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 13:01:14 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16486e97-656c-435a-9ab7-a1064f12ff8b None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:14 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16486e97-656c-435a-9ab7-a1064f12ff8b None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:14 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a354684-b295-4a7a-913d-8fd8e3cca89c None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:14 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a354684-b295-4a7a-913d-8fd8e3cca89c None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:14 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a354684-b295-4a7a-913d-8fd8e3cca89c None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:14 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a354684-b295-4a7a-913d-8fd8e3cca89c None admin] PATH_INFO: `/v3/roles` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:14 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a354684-b295-4a7a-913d-8fd8e3cca89c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:14 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a354684-b295-4a7a-913d-8fd8e3cca89c None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:14 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1502/3031] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 13:01:14 2024] GET /identity/v3/roles => generated 1680 bytes in 19 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 13:01:14 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156f96ad-f3ca-4ccb-817c-0cbcd9c6bdac None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:14 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156f96ad-f3ca-4ccb-817c-0cbcd9c6bdac None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:14 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379fe46e-7b41-4736-84b8-ac659d30adfa None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:14 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379fe46e-7b41-4736-84b8-ac659d30adfa None admin] REQUEST_METHOD: `PUT` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:14 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379fe46e-7b41-4736-84b8-ac659d30adfa None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:14 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379fe46e-7b41-4736-84b8-ac659d30adfa None admin] PATH_INFO: `/v3/projects/17eeabfb1fed41e98ca946a84f94faae/users/14c1660e980b457cba80417b5c8e77ba/roles/44620cad10ae407c90c91e2c296adb04` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:14 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379fe46e-7b41-4736-84b8-ac659d30adfa None admin] RBAC: Authorizing `identity:create_grant(project_id=17eeabfb1fed41e98ca946a84f94faae, user_id=14c1660e980b457cba80417b5c8e77ba, role_id=44620cad10ae407c90c91e2c296adb04)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:14 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379fe46e-7b41-4736-84b8-ac659d30adfa None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:14 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1530/3032] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 13:01:14 2024] PUT /identity/v3/projects/17eeabfb1fed41e98ca946a84f94faae/users/14c1660e980b457cba80417b5c8e77ba/roles/44620cad10ae407c90c91e2c296adb04 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:01:14 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebd6bf1-fc8b-41b0-8441-497fd43046ec None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:14 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebd6bf1-fc8b-41b0-8441-497fd43046ec None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:14 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebd6bf1-fc8b-41b0-8441-497fd43046ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:14 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-9242ab9c-98af-4bf4-ab2d-7a757be81a4f tempest-SharesNFSTest-667257547 tempest-SharesNFSTest-667257547-project-member] http://10.27.203.238/share/v2/0af6f8e0aeed4f27b075e08f2bc713aa/shares/7a762332-0877-462f-941a-6581abbf784b returned with HTTP 202 May 28 13:01:14 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1041/2044] 10.27.203.238 () {64 vars in 1454 bytes} [Tue May 28 13:01:14 2024] DELETE /share/v2/0af6f8e0aeed4f27b075e08f2bc713aa/shares/7a762332-0877-462f-941a-6581abbf784b => generated 0 bytes in 153 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 13:01:14 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-8ebd6bf1-fc8b-41b0-8441-497fd43046ec None None] Truncating password to algorithm specific maximum length 72 characters. May 28 13:01:14 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-f6163793-e58d-47d4-b54c-c255bb361b39 tempest-SharesNFSTest-667257547 tempest-SharesNFSTest-667257547-project-member] GET http://10.27.203.238/share/v2/0af6f8e0aeed4f27b075e08f2bc713aa/shares/7a762332-0877-462f-941a-6581abbf784b May 28 13:01:14 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-f6163793-e58d-47d4-b54c-c255bb361b39 tempest-SharesNFSTest-667257547 tempest-SharesNFSTest-667257547-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:14 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-f6163793-e58d-47d4-b54c-c255bb361b39 tempest-SharesNFSTest-667257547 tempest-SharesNFSTest-667257547-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:14 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-8ebd6bf1-fc8b-41b0-8441-497fd43046ec None None] MFA Rules not processed for user `14c1660e980b457cba80417b5c8e77ba`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 13:01:14 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-8ebd6bf1-fc8b-41b0-8441-497fd43046ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:01:14 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-f6163793-e58d-47d4-b54c-c255bb361b39 tempest-SharesNFSTest-667257547 tempest-SharesNFSTest-667257547-project-member] http://10.27.203.238/share/v2/0af6f8e0aeed4f27b075e08f2bc713aa/shares/7a762332-0877-462f-941a-6581abbf784b returned with HTTP 200 May 28 13:01:14 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1004/2045] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:01:14 2024] GET /share/v2/0af6f8e0aeed4f27b075e08f2bc713aa/shares/7a762332-0877-462f-941a-6581abbf784b => generated 1316 bytes in 25 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:01:14 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-9242ab9c-98af-4bf4-ab2d-7a757be81a4f tempest-SharesNFSTest-667257547 None] Acquiring lock "locked_access_rules_operation_by_share_instance_d935f840-e1e2-4366-85e1-9cee599842b6" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:01:14 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-9242ab9c-98af-4bf4-ab2d-7a757be81a4f tempest-SharesNFSTest-667257547 None] Lock "locked_access_rules_operation_by_share_instance_d935f840-e1e2-4366-85e1-9cee599842b6" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:01:14 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-9242ab9c-98af-4bf4-ab2d-7a757be81a4f tempest-SharesNFSTest-667257547 None] Lock "locked_access_rules_operation_by_share_instance_d935f840-e1e2-4366-85e1-9cee599842b6" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:01:14 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-9242ab9c-98af-4bf4-ab2d-7a757be81a4f tempest-SharesNFSTest-667257547 None] Acquiring lock "locked_access_rules_operation_by_share_instance_d935f840-e1e2-4366-85e1-9cee599842b6" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:01:14 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-9242ab9c-98af-4bf4-ab2d-7a757be81a4f tempest-SharesNFSTest-667257547 None] Lock "locked_access_rules_operation_by_share_instance_d935f840-e1e2-4366-85e1-9cee599842b6" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:01:14 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-9242ab9c-98af-4bf4-ab2d-7a757be81a4f tempest-SharesNFSTest-667257547 None] Lock "locked_access_rules_operation_by_share_instance_d935f840-e1e2-4366-85e1-9cee599842b6" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:01:14 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-9242ab9c-98af-4bf4-ab2d-7a757be81a4f tempest-SharesNFSTest-667257547 None] Acquiring lock "locked_access_rules_operation_by_share_instance_d935f840-e1e2-4366-85e1-9cee599842b6" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:01:14 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-9242ab9c-98af-4bf4-ab2d-7a757be81a4f tempest-SharesNFSTest-667257547 None] Lock "locked_access_rules_operation_by_share_instance_d935f840-e1e2-4366-85e1-9cee599842b6" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:01:14 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1503/3033] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 13:01:14 2024] POST /identity/v3/auth/tokens => generated 3974 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 13:01:14 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379fe46e-7b41-4736-84b8-ac659d30adfa None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:14 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-9242ab9c-98af-4bf4-ab2d-7a757be81a4f tempest-SharesNFSTest-667257547 None] Lock "locked_access_rules_operation_by_share_instance_d935f840-e1e2-4366-85e1-9cee599842b6" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.004s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:01:14 l75lg1-v1 manila-share[98474]: DEBUG manila.share.access [None req-9242ab9c-98af-4bf4-ab2d-7a757be81a4f tempest-SharesNFSTest-667257547 None] All access rules have been synced for share instance d935f840-e1e2-4366-85e1-9cee599842b6 belonging to share 7a762332-0877-462f-941a-6581abbf784b. {{(pid=98474) update_access_rules /opt/stack/manila/manila/share/access.py:304}} May 28 13:01:14 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-9242ab9c-98af-4bf4-ab2d-7a757be81a4f tempest-SharesNFSTest-667257547 None] deleting '/manila/manila-d935f840-e1e2-4366-85e1-9cee599842b6' May 28 13:01:14 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9242ab9c-98af-4bf4-ab2d-7a757be81a4f tempest-SharesNFSTest-667257547 None] >>> [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/ May 28 13:01:14 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9242ab9c-98af-4bf4-ab2d-7a757be81a4f tempest-SharesNFSTest-667257547 None] {'data': '{"path": "/manila/manila-d935f840-e1e2-4366-85e1-9cee599842b6"}', May 28 13:01:14 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9242ab9c-98af-4bf4-ab2d-7a757be81a4f tempest-SharesNFSTest-667257547 None] 'params': None} May 28 13:01:14 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379fe46e-7b41-4736-84b8-ac659d30adfa None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:14 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c4beb8-8eaf-4777-a81e-2044180f3a43 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:14 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c4beb8-8eaf-4777-a81e-2044180f3a43 None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:14 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c4beb8-8eaf-4777-a81e-2044180f3a43 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:14 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c4beb8-8eaf-4777-a81e-2044180f3a43 None admin] PATH_INFO: `/v3/projects` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:14 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c4beb8-8eaf-4777-a81e-2044180f3a43 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:14 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c4beb8-8eaf-4777-a81e-2044180f3a43 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:14 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1531/3034] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 13:01:14 2024] POST /identity/v3/projects => generated 401 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 13:01:14 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebd6bf1-fc8b-41b0-8441-497fd43046ec None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:14 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebd6bf1-fc8b-41b0-8441-497fd43046ec None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:14 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9242ab9c-98af-4bf4-ab2d-7a757be81a4f tempest-SharesNFSTest-667257547 None] <<< [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/ May 28 13:01:14 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9242ab9c-98af-4bf4-ab2d-7a757be81a4f tempest-SharesNFSTest-667257547 None] 'OK' May 28 13:01:14 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9242ab9c-98af-4bf4-ab2d-7a757be81a4f tempest-SharesNFSTest-667257547 None] --- [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/: Done May 28 13:01:14 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9242ab9c-98af-4bf4-ab2d-7a757be81a4f tempest-SharesNFSTest-667257547 None] >>> [GET] https://127.0.0.1:40443/api/views/ May 28 13:01:14 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9242ab9c-98af-4bf4-ab2d-7a757be81a4f tempest-SharesNFSTest-667257547 None] {'allow_redirects': True, May 28 13:01:14 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9242ab9c-98af-4bf4-ab2d-7a757be81a4f tempest-SharesNFSTest-667257547 None] 'params': {'name': 'd935f840-e1e2-4366-85e1-9cee599842b6'}} May 28 13:01:14 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e215aad1-e26b-450e-9cf5-1ec4c3f83188 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:14 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e215aad1-e26b-450e-9cf5-1ec4c3f83188 None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:14 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e215aad1-e26b-450e-9cf5-1ec4c3f83188 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:14 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e215aad1-e26b-450e-9cf5-1ec4c3f83188 None admin] PATH_INFO: `/v3/users` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:14 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e215aad1-e26b-450e-9cf5-1ec4c3f83188 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:14 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e215aad1-e26b-450e-9cf5-1ec4c3f83188 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:14 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-e215aad1-e26b-450e-9cf5-1ec4c3f83188 None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1504/3035] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 13:01:14 2024] POST /identity/v3/users => generated 308 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c4beb8-8eaf-4777-a81e-2044180f3a43 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c4beb8-8eaf-4777-a81e-2044180f3a43 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46662ba-88fd-43e8-ab92-3856402dd98f None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46662ba-88fd-43e8-ab92-3856402dd98f None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46662ba-88fd-43e8-ab92-3856402dd98f None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46662ba-88fd-43e8-ab92-3856402dd98f None admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46662ba-88fd-43e8-ab92-3856402dd98f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46662ba-88fd-43e8-ab92-3856402dd98f None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1532/3036] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 13:01:15 2024] GET /identity/v3/roles => generated 1680 bytes in 16 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e215aad1-e26b-450e-9cf5-1ec4c3f83188 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e215aad1-e26b-450e-9cf5-1ec4c3f83188 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64394fd5-e8d0-4edb-bcf7-ca923dbe1324 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64394fd5-e8d0-4edb-bcf7-ca923dbe1324 None admin] REQUEST_METHOD: `PUT` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64394fd5-e8d0-4edb-bcf7-ca923dbe1324 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64394fd5-e8d0-4edb-bcf7-ca923dbe1324 None admin] PATH_INFO: `/v3/projects/6d4b9bca9e684dff84056664ca08e79a/users/c70807ce6f2644f78048b654fd985745/roles/e7989893488f483baa107be56668c4f8` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64394fd5-e8d0-4edb-bcf7-ca923dbe1324 None admin] RBAC: Authorizing `identity:create_grant(project_id=6d4b9bca9e684dff84056664ca08e79a, user_id=c70807ce6f2644f78048b654fd985745, role_id=e7989893488f483baa107be56668c4f8)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64394fd5-e8d0-4edb-bcf7-ca923dbe1324 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1505/3037] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 13:01:15 2024] PUT /identity/v3/projects/6d4b9bca9e684dff84056664ca08e79a/users/c70807ce6f2644f78048b654fd985745/roles/e7989893488f483baa107be56668c4f8 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46662ba-88fd-43e8-ab92-3856402dd98f None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46662ba-88fd-43e8-ab92-3856402dd98f None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca56e4df-ae6e-4d38-9c89-6a6cf05aea3c None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca56e4df-ae6e-4d38-9c89-6a6cf05aea3c None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca56e4df-ae6e-4d38-9c89-6a6cf05aea3c None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca56e4df-ae6e-4d38-9c89-6a6cf05aea3c None admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca56e4df-ae6e-4d38-9c89-6a6cf05aea3c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca56e4df-ae6e-4d38-9c89-6a6cf05aea3c None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1533/3038] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 13:01:15 2024] GET /identity/v3/roles => generated 1680 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64394fd5-e8d0-4edb-bcf7-ca923dbe1324 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64394fd5-e8d0-4edb-bcf7-ca923dbe1324 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c0ffbe-9eb3-4682-ad91-313d13c67e28 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c0ffbe-9eb3-4682-ad91-313d13c67e28 None admin] REQUEST_METHOD: `PUT` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c0ffbe-9eb3-4682-ad91-313d13c67e28 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c0ffbe-9eb3-4682-ad91-313d13c67e28 None admin] PATH_INFO: `/v3/projects/6d4b9bca9e684dff84056664ca08e79a/users/c70807ce6f2644f78048b654fd985745/roles/e7989893488f483baa107be56668c4f8` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c0ffbe-9eb3-4682-ad91-313d13c67e28 None admin] RBAC: Authorizing `identity:create_grant(project_id=6d4b9bca9e684dff84056664ca08e79a, user_id=c70807ce6f2644f78048b654fd985745, role_id=e7989893488f483baa107be56668c4f8)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c0ffbe-9eb3-4682-ad91-313d13c67e28 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1506/3039] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 13:01:15 2024] PUT /identity/v3/projects/6d4b9bca9e684dff84056664ca08e79a/users/c70807ce6f2644f78048b654fd985745/roles/e7989893488f483baa107be56668c4f8 => generated 0 bytes in 17 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a458a5ef-337a-4c50-8b56-273728d2fcf2 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a458a5ef-337a-4c50-8b56-273728d2fcf2 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a458a5ef-337a-4c50-8b56-273728d2fcf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-a458a5ef-337a-4c50-8b56-273728d2fcf2 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-a458a5ef-337a-4c50-8b56-273728d2fcf2 None None] MFA Rules not processed for user `c70807ce6f2644f78048b654fd985745`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-a458a5ef-337a-4c50-8b56-273728d2fcf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1534/3040] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 13:01:15 2024] POST /identity/v3/auth/tokens => generated 4095 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c0ffbe-9eb3-4682-ad91-313d13c67e28 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c0ffbe-9eb3-4682-ad91-313d13c67e28 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165ae14f-f1f0-47b1-b57b-bd7320510dd3 tempest-ShareUserRulesForNFSNegativeTest-346766616 tempest-ShareUserRulesForNFSNegativeTest-346766616-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c70807ce6f2644f78048b654fd985745', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d4b9bca9e684dff84056664ca08e79a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165ae14f-f1f0-47b1-b57b-bd7320510dd3 tempest-ShareUserRulesForNFSNegativeTest-346766616 tempest-ShareUserRulesForNFSNegativeTest-346766616-project-admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165ae14f-f1f0-47b1-b57b-bd7320510dd3 tempest-ShareUserRulesForNFSNegativeTest-346766616 tempest-ShareUserRulesForNFSNegativeTest-346766616-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165ae14f-f1f0-47b1-b57b-bd7320510dd3 tempest-ShareUserRulesForNFSNegativeTest-346766616 tempest-ShareUserRulesForNFSNegativeTest-346766616-project-admin] PATH_INFO: `/v3/domains` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165ae14f-f1f0-47b1-b57b-bd7320510dd3 tempest-ShareUserRulesForNFSNegativeTest-346766616 tempest-ShareUserRulesForNFSNegativeTest-346766616-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165ae14f-f1f0-47b1-b57b-bd7320510dd3 tempest-ShareUserRulesForNFSNegativeTest-346766616 tempest-ShareUserRulesForNFSNegativeTest-346766616-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165ae14f-f1f0-47b1-b57b-bd7320510dd3 tempest-ShareUserRulesForNFSNegativeTest-346766616 tempest-ShareUserRulesForNFSNegativeTest-346766616-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1507/3041] 10.27.203.238 () {62 vars in 1241 bytes} [Tue May 28 13:01:15 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a458a5ef-337a-4c50-8b56-273728d2fcf2 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:15 l75lg1-v1 dstat.sh[49771]: 28-05 13:01:15| 13 2 83 2 0|5699M 1743M 278M 7904M| 21k 2606B| 0 2616k| 0 288 |7907 13k|1.56 1.24 1.08|2.0 1.0 0| 0 0 | 0 2048M| 29 364 0 33 2 May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a458a5ef-337a-4c50-8b56-273728d2fcf2 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eb3491-ec07-442f-826d-188ad0e17c98 tempest-ShareUserRulesForNFSNegativeTest-346766616 tempest-ShareUserRulesForNFSNegativeTest-346766616-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c70807ce6f2644f78048b654fd985745', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d4b9bca9e684dff84056664ca08e79a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eb3491-ec07-442f-826d-188ad0e17c98 tempest-ShareUserRulesForNFSNegativeTest-346766616 tempest-ShareUserRulesForNFSNegativeTest-346766616-project-admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eb3491-ec07-442f-826d-188ad0e17c98 tempest-ShareUserRulesForNFSNegativeTest-346766616 tempest-ShareUserRulesForNFSNegativeTest-346766616-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eb3491-ec07-442f-826d-188ad0e17c98 tempest-ShareUserRulesForNFSNegativeTest-346766616 tempest-ShareUserRulesForNFSNegativeTest-346766616-project-admin] PATH_INFO: `/v3/users` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8eb3491-ec07-442f-826d-188ad0e17c98 tempest-ShareUserRulesForNFSNegativeTest-346766616 tempest-ShareUserRulesForNFSNegativeTest-346766616-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8eb3491-ec07-442f-826d-188ad0e17c98 tempest-ShareUserRulesForNFSNegativeTest-346766616 tempest-ShareUserRulesForNFSNegativeTest-346766616-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-c8eb3491-ec07-442f-826d-188ad0e17c98 tempest-ShareUserRulesForNFSNegativeTest-346766616 tempest-ShareUserRulesForNFSNegativeTest-346766616-project-admin] Truncating password to algorithm specific maximum length 72 characters. May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1535/3042] 10.27.203.238 () {64 vars in 1232 bytes} [Tue May 28 13:01:15 2024] POST /identity/v3/users => generated 433 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165ae14f-f1f0-47b1-b57b-bd7320510dd3 tempest-ShareUserRulesForNFSNegativeTest-346766616 tempest-ShareUserRulesForNFSNegativeTest-346766616-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165ae14f-f1f0-47b1-b57b-bd7320510dd3 tempest-ShareUserRulesForNFSNegativeTest-346766616 tempest-ShareUserRulesForNFSNegativeTest-346766616-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d85b55-b51f-483b-92ad-957b463ed90d tempest-ShareUserRulesForNFSNegativeTest-346766616 tempest-ShareUserRulesForNFSNegativeTest-346766616-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c70807ce6f2644f78048b654fd985745', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d4b9bca9e684dff84056664ca08e79a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d85b55-b51f-483b-92ad-957b463ed90d tempest-ShareUserRulesForNFSNegativeTest-346766616 tempest-ShareUserRulesForNFSNegativeTest-346766616-project-admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d85b55-b51f-483b-92ad-957b463ed90d tempest-ShareUserRulesForNFSNegativeTest-346766616 tempest-ShareUserRulesForNFSNegativeTest-346766616-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d85b55-b51f-483b-92ad-957b463ed90d tempest-ShareUserRulesForNFSNegativeTest-346766616 tempest-ShareUserRulesForNFSNegativeTest-346766616-project-admin] PATH_INFO: `/v3/roles` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d85b55-b51f-483b-92ad-957b463ed90d tempest-ShareUserRulesForNFSNegativeTest-346766616 tempest-ShareUserRulesForNFSNegativeTest-346766616-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d85b55-b51f-483b-92ad-957b463ed90d tempest-ShareUserRulesForNFSNegativeTest-346766616 tempest-ShareUserRulesForNFSNegativeTest-346766616-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1508/3043] 10.27.203.238 () {62 vars in 1210 bytes} [Tue May 28 13:01:15 2024] GET /identity/v3/roles => generated 1680 bytes in 16 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eb3491-ec07-442f-826d-188ad0e17c98 tempest-ShareUserRulesForNFSNegativeTest-346766616 tempest-ShareUserRulesForNFSNegativeTest-346766616-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eb3491-ec07-442f-826d-188ad0e17c98 tempest-ShareUserRulesForNFSNegativeTest-346766616 tempest-ShareUserRulesForNFSNegativeTest-346766616-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10d4d77-6a4f-4ba4-b3ce-79abdb72f4d5 tempest-ShareUserRulesForNFSNegativeTest-346766616 tempest-ShareUserRulesForNFSNegativeTest-346766616-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c70807ce6f2644f78048b654fd985745', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d4b9bca9e684dff84056664ca08e79a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10d4d77-6a4f-4ba4-b3ce-79abdb72f4d5 tempest-ShareUserRulesForNFSNegativeTest-346766616 tempest-ShareUserRulesForNFSNegativeTest-346766616-project-admin] REQUEST_METHOD: `PUT` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10d4d77-6a4f-4ba4-b3ce-79abdb72f4d5 tempest-ShareUserRulesForNFSNegativeTest-346766616 tempest-ShareUserRulesForNFSNegativeTest-346766616-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10d4d77-6a4f-4ba4-b3ce-79abdb72f4d5 tempest-ShareUserRulesForNFSNegativeTest-346766616 tempest-ShareUserRulesForNFSNegativeTest-346766616-project-admin] PATH_INFO: `/v3/projects/6d4b9bca9e684dff84056664ca08e79a/users/7ad2c2df894f4bca82e33623064ce809/roles/44620cad10ae407c90c91e2c296adb04` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10d4d77-6a4f-4ba4-b3ce-79abdb72f4d5 tempest-ShareUserRulesForNFSNegativeTest-346766616 tempest-ShareUserRulesForNFSNegativeTest-346766616-project-admin] RBAC: Authorizing `identity:create_grant(project_id=6d4b9bca9e684dff84056664ca08e79a, user_id=7ad2c2df894f4bca82e33623064ce809, role_id=44620cad10ae407c90c91e2c296adb04)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10d4d77-6a4f-4ba4-b3ce-79abdb72f4d5 tempest-ShareUserRulesForNFSNegativeTest-346766616 tempest-ShareUserRulesForNFSNegativeTest-346766616-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1536/3044] 10.27.203.238 () {64 vars in 1571 bytes} [Tue May 28 13:01:15 2024] PUT /identity/v3/projects/6d4b9bca9e684dff84056664ca08e79a/users/7ad2c2df894f4bca82e33623064ce809/roles/44620cad10ae407c90c91e2c296adb04 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d85b55-b51f-483b-92ad-957b463ed90d tempest-ShareUserRulesForNFSNegativeTest-346766616 tempest-ShareUserRulesForNFSNegativeTest-346766616-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d85b55-b51f-483b-92ad-957b463ed90d tempest-ShareUserRulesForNFSNegativeTest-346766616 tempest-ShareUserRulesForNFSNegativeTest-346766616-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797bd01a-803f-42ff-9db2-5c1cd297ee44 tempest-ShareUserRulesForNFSNegativeTest-346766616 tempest-ShareUserRulesForNFSNegativeTest-346766616-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c70807ce6f2644f78048b654fd985745', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d4b9bca9e684dff84056664ca08e79a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797bd01a-803f-42ff-9db2-5c1cd297ee44 tempest-ShareUserRulesForNFSNegativeTest-346766616 tempest-ShareUserRulesForNFSNegativeTest-346766616-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797bd01a-803f-42ff-9db2-5c1cd297ee44 tempest-ShareUserRulesForNFSNegativeTest-346766616 tempest-ShareUserRulesForNFSNegativeTest-346766616-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797bd01a-803f-42ff-9db2-5c1cd297ee44 tempest-ShareUserRulesForNFSNegativeTest-346766616 tempest-ShareUserRulesForNFSNegativeTest-346766616-project-admin] PATH_INFO: `/v3/users/5000ae7b72ab4d8aad66382d4e873caf` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797bd01a-803f-42ff-9db2-5c1cd297ee44 tempest-ShareUserRulesForNFSNegativeTest-346766616 tempest-ShareUserRulesForNFSNegativeTest-346766616-project-admin] RBAC: Authorizing `identity:delete_user(user_id=5000ae7b72ab4d8aad66382d4e873caf)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797bd01a-803f-42ff-9db2-5c1cd297ee44 tempest-ShareUserRulesForNFSNegativeTest-346766616 tempest-ShareUserRulesForNFSNegativeTest-346766616-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:15 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-2e5b045b-a1bc-4da7-8946-8cfc0c172b99 tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] GET http://10.27.203.238/share/v2/284d76edec3144579d6fb3f6dbc0dd4e/share-groups/3709d784-520f-4a6d-ba6f-ad3e9307f7a2 May 28 13:01:15 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-2e5b045b-a1bc-4da7-8946-8cfc0c172b99 tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:15 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-2e5b045b-a1bc-4da7-8946-8cfc0c172b99 tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-797bd01a-803f-42ff-9db2-5c1cd297ee44 tempest-ShareUserRulesForNFSNegativeTest-346766616 tempest-ShareUserRulesForNFSNegativeTest-346766616-project-admin] Could not find user: 5000ae7b72ab4d8aad66382d4e873caf.: keystone.exception.UserNotFound: Could not find user: 5000ae7b72ab4d8aad66382d4e873caf. May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 5000ae7b72ab4d8aad66382d4e873caf. May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1509/3045] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:01:15 2024] DELETE /identity/v3/users/5000ae7b72ab4d8aad66382d4e873caf => generated 110 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10d4d77-6a4f-4ba4-b3ce-79abdb72f4d5 tempest-ShareUserRulesForNFSNegativeTest-346766616 tempest-ShareUserRulesForNFSNegativeTest-346766616-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:15 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-2e5b045b-a1bc-4da7-8946-8cfc0c172b99 tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] HTTP exception thrown: Share group 3709d784-520f-4a6d-ba6f-ad3e9307f7a2 not found. May 28 13:01:15 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-2e5b045b-a1bc-4da7-8946-8cfc0c172b99 tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] http://10.27.203.238/share/v2/284d76edec3144579d6fb3f6dbc0dd4e/share-groups/3709d784-520f-4a6d-ba6f-ad3e9307f7a2 returned with HTTP 404 May 28 13:01:15 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1042/2046] 10.27.203.238 () {64 vars in 1469 bytes} [Tue May 28 13:01:15 2024] GET /share/v2/284d76edec3144579d6fb3f6dbc0dd4e/share-groups/3709d784-520f-4a6d-ba6f-ad3e9307f7a2 => generated 105 bytes in 11 msecs (HTTP/1.1 404) 6 headers in 238 bytes (1 switches on core 0) May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10d4d77-6a4f-4ba4-b3ce-79abdb72f4d5 tempest-ShareUserRulesForNFSNegativeTest-346766616 tempest-ShareUserRulesForNFSNegativeTest-346766616-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b6cafd-16f2-44f4-8b83-c1e7e986ed40 tempest-ShareUserRulesForNFSNegativeTest-346766616 tempest-ShareUserRulesForNFSNegativeTest-346766616-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c70807ce6f2644f78048b654fd985745', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d4b9bca9e684dff84056664ca08e79a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b6cafd-16f2-44f4-8b83-c1e7e986ed40 tempest-ShareUserRulesForNFSNegativeTest-346766616 tempest-ShareUserRulesForNFSNegativeTest-346766616-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b6cafd-16f2-44f4-8b83-c1e7e986ed40 tempest-ShareUserRulesForNFSNegativeTest-346766616 tempest-ShareUserRulesForNFSNegativeTest-346766616-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b6cafd-16f2-44f4-8b83-c1e7e986ed40 tempest-ShareUserRulesForNFSNegativeTest-346766616 tempest-ShareUserRulesForNFSNegativeTest-346766616-project-admin] PATH_INFO: `/v3/users/3fc09c87f69946d2bf009e72ac589cd4` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:15 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-8ff31873-a044-4c31-a5d3-38413043f0c5 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] PUT http://10.27.203.238/share/v2/bb20757ddd604868aff8ad38db5def87/types/7d2ea8e8-bada-4826-a8a8-53b4e9ff301f/extra_specs/availability_zones May 28 13:01:15 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-8ff31873-a044-4c31-a5d3-38413043f0c5 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] Action: 'update', calling method: ShareTypeExtraSpecsController.update, body: {"availability_zones": "nova"} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b6cafd-16f2-44f4-8b83-c1e7e986ed40 tempest-ShareUserRulesForNFSNegativeTest-346766616 tempest-ShareUserRulesForNFSNegativeTest-346766616-project-admin] RBAC: Authorizing `identity:delete_user(user_id=3fc09c87f69946d2bf009e72ac589cd4)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b6cafd-16f2-44f4-8b83-c1e7e986ed40 tempest-ShareUserRulesForNFSNegativeTest-346766616 tempest-ShareUserRulesForNFSNegativeTest-346766616-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:15 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-8ff31873-a044-4c31-a5d3-38413043f0c5 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] http://10.27.203.238/share/v2/bb20757ddd604868aff8ad38db5def87/types/7d2ea8e8-bada-4826-a8a8-53b4e9ff301f/extra_specs/availability_zones returned with HTTP 200 May 28 13:01:15 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1005/2047] 10.27.203.238 () {66 vars in 1561 bytes} [Tue May 28 13:01:15 2024] PUT /share/v2/bb20757ddd604868aff8ad38db5def87/types/7d2ea8e8-bada-4826-a8a8-53b4e9ff301f/extra_specs/availability_zones => generated 30 bytes in 14 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-59b6cafd-16f2-44f4-8b83-c1e7e986ed40 tempest-ShareUserRulesForNFSNegativeTest-346766616 tempest-ShareUserRulesForNFSNegativeTest-346766616-project-admin] Could not find user: 3fc09c87f69946d2bf009e72ac589cd4.: keystone.exception.UserNotFound: Could not find user: 3fc09c87f69946d2bf009e72ac589cd4. May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:01:15 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-4c67f440-1c6d-4b70-9410-6f8a9a50911d tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] POST http://10.27.203.238/share/v2/284d76edec3144579d6fb3f6dbc0dd4e/share-groups May 28 13:01:15 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-4c67f440-1c6d-4b70-9410-6f8a9a50911d tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share_group": {"share_group_type_id": "c604fd71-5623-4f48-9a0f-e0b31cc7405a", "share_types": ["7d2ea8e8-bada-4826-a8a8-53b4e9ff301f"]}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 3fc09c87f69946d2bf009e72ac589cd4. May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1537/3046] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:01:15 2024] DELETE /identity/v3/users/3fc09c87f69946d2bf009e72ac589cd4 => generated 110 bytes in 24 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797bd01a-803f-42ff-9db2-5c1cd297ee44 tempest-ShareUserRulesForNFSNegativeTest-346766616 tempest-ShareUserRulesForNFSNegativeTest-346766616-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797bd01a-803f-42ff-9db2-5c1cd297ee44 tempest-ShareUserRulesForNFSNegativeTest-346766616 tempest-ShareUserRulesForNFSNegativeTest-346766616-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:15 l75lg1-v1 neutron-server[77623]: DEBUG neutron.db.agents_db [None req-fe40ce8c-640e-4db7-a17a-6e8888cce266 None None] Agent healthcheck: found 0 active agents {{(pid=77623) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:319}} May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654dd73c-7d17-4ef8-99bd-479edfdfc4f6 tempest-ShareUserRulesForNFSNegativeTest-346766616 tempest-ShareUserRulesForNFSNegativeTest-346766616-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c70807ce6f2644f78048b654fd985745', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d4b9bca9e684dff84056664ca08e79a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654dd73c-7d17-4ef8-99bd-479edfdfc4f6 tempest-ShareUserRulesForNFSNegativeTest-346766616 tempest-ShareUserRulesForNFSNegativeTest-346766616-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654dd73c-7d17-4ef8-99bd-479edfdfc4f6 tempest-ShareUserRulesForNFSNegativeTest-346766616 tempest-ShareUserRulesForNFSNegativeTest-346766616-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654dd73c-7d17-4ef8-99bd-479edfdfc4f6 tempest-ShareUserRulesForNFSNegativeTest-346766616 tempest-ShareUserRulesForNFSNegativeTest-346766616-project-admin] PATH_INFO: `/v3/users/6533c69a593a4e35a8693da46fbd9f3b` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654dd73c-7d17-4ef8-99bd-479edfdfc4f6 tempest-ShareUserRulesForNFSNegativeTest-346766616 tempest-ShareUserRulesForNFSNegativeTest-346766616-project-admin] RBAC: Authorizing `identity:delete_user(user_id=6533c69a593a4e35a8693da46fbd9f3b)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654dd73c-7d17-4ef8-99bd-479edfdfc4f6 tempest-ShareUserRulesForNFSNegativeTest-346766616 tempest-ShareUserRulesForNFSNegativeTest-346766616-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-654dd73c-7d17-4ef8-99bd-479edfdfc4f6 tempest-ShareUserRulesForNFSNegativeTest-346766616 tempest-ShareUserRulesForNFSNegativeTest-346766616-project-admin] Could not find user: 6533c69a593a4e35a8693da46fbd9f3b.: keystone.exception.UserNotFound: Could not find user: 6533c69a593a4e35a8693da46fbd9f3b. May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 6533c69a593a4e35a8693da46fbd9f3b. May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1510/3047] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:01:15 2024] DELETE /identity/v3/users/6533c69a593a4e35a8693da46fbd9f3b => generated 110 bytes in 25 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b6cafd-16f2-44f4-8b83-c1e7e986ed40 tempest-ShareUserRulesForNFSNegativeTest-346766616 tempest-ShareUserRulesForNFSNegativeTest-346766616-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b6cafd-16f2-44f4-8b83-c1e7e986ed40 tempest-ShareUserRulesForNFSNegativeTest-346766616 tempest-ShareUserRulesForNFSNegativeTest-346766616-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dbe04d-8198-414f-a64d-b098a279033b tempest-ShareUserRulesForNFSNegativeTest-346766616 tempest-ShareUserRulesForNFSNegativeTest-346766616-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c70807ce6f2644f78048b654fd985745', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d4b9bca9e684dff84056664ca08e79a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dbe04d-8198-414f-a64d-b098a279033b tempest-ShareUserRulesForNFSNegativeTest-346766616 tempest-ShareUserRulesForNFSNegativeTest-346766616-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dbe04d-8198-414f-a64d-b098a279033b tempest-ShareUserRulesForNFSNegativeTest-346766616 tempest-ShareUserRulesForNFSNegativeTest-346766616-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dbe04d-8198-414f-a64d-b098a279033b tempest-ShareUserRulesForNFSNegativeTest-346766616 tempest-ShareUserRulesForNFSNegativeTest-346766616-project-admin] PATH_INFO: `/v3/users/929590f760014a429cece4b4e674f84e` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dbe04d-8198-414f-a64d-b098a279033b tempest-ShareUserRulesForNFSNegativeTest-346766616 tempest-ShareUserRulesForNFSNegativeTest-346766616-project-admin] RBAC: Authorizing `identity:delete_user(user_id=929590f760014a429cece4b4e674f84e)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dbe04d-8198-414f-a64d-b098a279033b tempest-ShareUserRulesForNFSNegativeTest-346766616 tempest-ShareUserRulesForNFSNegativeTest-346766616-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-86dbe04d-8198-414f-a64d-b098a279033b tempest-ShareUserRulesForNFSNegativeTest-346766616 tempest-ShareUserRulesForNFSNegativeTest-346766616-project-admin] Could not find user: 929590f760014a429cece4b4e674f84e.: keystone.exception.UserNotFound: Could not find user: 929590f760014a429cece4b4e674f84e. May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 929590f760014a429cece4b4e674f84e. May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1538/3048] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:01:15 2024] DELETE /identity/v3/users/929590f760014a429cece4b4e674f84e => generated 110 bytes in 22 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654dd73c-7d17-4ef8-99bd-479edfdfc4f6 tempest-ShareUserRulesForNFSNegativeTest-346766616 tempest-ShareUserRulesForNFSNegativeTest-346766616-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:15 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.quota [None req-4c67f440-1c6d-4b70-9410-6f8a9a50911d tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] Created reservations ['be3865b4-e8fc-4a62-9b0f-716d4bf414e2'] {{(pid=98329) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654dd73c-7d17-4ef8-99bd-479edfdfc4f6 tempest-ShareUserRulesForNFSNegativeTest-346766616 tempest-ShareUserRulesForNFSNegativeTest-346766616-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b61224f-ed9d-4f3e-a29f-dd2068d64ea2 tempest-ShareUserRulesForNFSNegativeTest-346766616 tempest-ShareUserRulesForNFSNegativeTest-346766616-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c70807ce6f2644f78048b654fd985745', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d4b9bca9e684dff84056664ca08e79a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b61224f-ed9d-4f3e-a29f-dd2068d64ea2 tempest-ShareUserRulesForNFSNegativeTest-346766616 tempest-ShareUserRulesForNFSNegativeTest-346766616-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b61224f-ed9d-4f3e-a29f-dd2068d64ea2 tempest-ShareUserRulesForNFSNegativeTest-346766616 tempest-ShareUserRulesForNFSNegativeTest-346766616-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b61224f-ed9d-4f3e-a29f-dd2068d64ea2 tempest-ShareUserRulesForNFSNegativeTest-346766616 tempest-ShareUserRulesForNFSNegativeTest-346766616-project-admin] PATH_INFO: `/v3/users/7ad2c2df894f4bca82e33623064ce809` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b61224f-ed9d-4f3e-a29f-dd2068d64ea2 tempest-ShareUserRulesForNFSNegativeTest-346766616 tempest-ShareUserRulesForNFSNegativeTest-346766616-project-admin] RBAC: Authorizing `identity:delete_user(user_id=7ad2c2df894f4bca82e33623064ce809)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b61224f-ed9d-4f3e-a29f-dd2068d64ea2 tempest-ShareUserRulesForNFSNegativeTest-346766616 tempest-ShareUserRulesForNFSNegativeTest-346766616-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:15 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.quota [None req-4c67f440-1c6d-4b70-9410-6f8a9a50911d tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] Committed reservations ['be3865b4-e8fc-4a62-9b0f-716d4bf414e2'] {{(pid=98329) commit /opt/stack/manila/manila/quota.py:1063}} May 28 13:01:15 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-4c67f440-1c6d-4b70-9410-6f8a9a50911d tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] http://10.27.203.238/share/v2/284d76edec3144579d6fb3f6dbc0dd4e/share-groups returned with HTTP 202 May 28 13:01:15 l75lg1-v1 manila-scheduler[98327]: INFO manila.scheduler.drivers.filter [None req-4c67f440-1c6d-4b70-9410-6f8a9a50911d tempest-ShareTypeAvailabilityZonesTest-364532124 None] Scheduling share group b9df9a2d-571e-4658-a435-c01428312fc4. May 28 13:01:15 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1043/2048] 10.27.203.238 () {66 vars in 1380 bytes} [Tue May 28 13:01:15 2024] POST /share/v2/284d76edec3144579d6fb3f6dbc0dd4e/share-groups => generated 772 bytes in 102 msecs (HTTP/1.1 202) 6 headers in 237 bytes (1 switches on core 0) May 28 13:01:15 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-3d183f16-4c68-4f9b-806f-7807b0587800 tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] GET http://10.27.203.238/share/v2/284d76edec3144579d6fb3f6dbc0dd4e/share-groups/b9df9a2d-571e-4658-a435-c01428312fc4 May 28 13:01:15 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-3d183f16-4c68-4f9b-806f-7807b0587800 tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:15 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-3d183f16-4c68-4f9b-806f-7807b0587800 tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:15 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.host_manager [None req-4c67f440-1c6d-4b70-9410-6f8a9a50911d tempest-ShareTypeAvailabilityZonesTest-364532124 None] Share service is down. (host: l75lg1-v1@generic2). May 28 13:01:15 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.host_manager [None req-4c67f440-1c6d-4b70-9410-6f8a9a50911d tempest-ShareTypeAvailabilityZonesTest-364532124 None] Share service is down. (host: l75lg1-v1@generic1). May 28 13:01:15 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-4c67f440-1c6d-4b70-9410-6f8a9a50911d tempest-ShareTypeAvailabilityZonesTest-364532124 None] Starting with 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:80}} May 28 13:01:15 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-4c67f440-1c6d-4b70-9410-6f8a9a50911d tempest-ShareTypeAvailabilityZonesTest-364532124 None] Filter OnlyHostFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:01:15 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-4c67f440-1c6d-4b70-9410-6f8a9a50911d tempest-ShareTypeAvailabilityZonesTest-364532124 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:01:15 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.capacity [None req-4c67f440-1c6d-4b70-9410-6f8a9a50911d tempest-ShareTypeAvailabilityZonesTest-364532124 None] Space information for share creation on host l75lg1-v1@vast#vast (requested / avail): 0/2079 {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/capacity.py:83}} May 28 13:01:15 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-4c67f440-1c6d-4b70-9410-6f8a9a50911d tempest-ShareTypeAvailabilityZonesTest-364532124 None] Filter CapacityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:01:15 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-4c67f440-1c6d-4b70-9410-6f8a9a50911d tempest-ShareTypeAvailabilityZonesTest-364532124 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:01:15 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-4c67f440-1c6d-4b70-9410-6f8a9a50911d tempest-ShareTypeAvailabilityZonesTest-364532124 None] Driver Filter: Checking host 'l75lg1-v1@vast#vast' {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:37}} May 28 13:01:15 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-4c67f440-1c6d-4b70-9410-6f8a9a50911d tempest-ShareTypeAvailabilityZonesTest-364532124 None] Filter function not set :: passing host. {{(pid=98327) _check_filter_function /opt/stack/manila/manila/scheduler/filters/driver.py:53}} May 28 13:01:15 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-4c67f440-1c6d-4b70-9410-6f8a9a50911d tempest-ShareTypeAvailabilityZonesTest-364532124 None] Result: True {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:40}} May 28 13:01:15 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-4c67f440-1c6d-4b70-9410-6f8a9a50911d tempest-ShareTypeAvailabilityZonesTest-364532124 None] Done checking host 'l75lg1-v1@vast#vast' {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:41}} May 28 13:01:15 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-4c67f440-1c6d-4b70-9410-6f8a9a50911d tempest-ShareTypeAvailabilityZonesTest-364532124 None] Filter DriverFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:01:15 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-4c67f440-1c6d-4b70-9410-6f8a9a50911d tempest-ShareTypeAvailabilityZonesTest-364532124 None] Filter ShareReplicationFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:01:15 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-4c67f440-1c6d-4b70-9410-6f8a9a50911d tempest-ShareTypeAvailabilityZonesTest-364532124 None] Filter CreateFromSnapshotFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:01:15 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-4c67f440-1c6d-4b70-9410-6f8a9a50911d tempest-ShareTypeAvailabilityZonesTest-364532124 None] Filter AffinityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:01:15 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-4c67f440-1c6d-4b70-9410-6f8a9a50911d tempest-ShareTypeAvailabilityZonesTest-364532124 None] Filter AntiAffinityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:01:15 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.drivers.filter [None req-4c67f440-1c6d-4b70-9410-6f8a9a50911d tempest-ShareTypeAvailabilityZonesTest-364532124 None] Filtered [host: 'l75lg1-v1@vast#vast', free_capacity_gb: 2079.6277076322585, pools: None] {{(pid=98327) _get_weighted_hosts_for_share_type /opt/stack/manila/manila/scheduler/drivers/filter.py:439}} May 28 13:01:15 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-4c67f440-1c6d-4b70-9410-6f8a9a50911d tempest-ShareTypeAvailabilityZonesTest-364532124 None] Checking host 'l75lg1-v1@vast#vast' {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:46}} May 28 13:01:15 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.weighers.goodness [None req-4c67f440-1c6d-4b70-9410-6f8a9a50911d tempest-ShareTypeAvailabilityZonesTest-364532124 None] Goodness function not set :: defaulting to minimal goodness rating of 0. May 28 13:01:15 l75lg1-v1 manila-scheduler[98327]: INFO manila.scheduler.weighers.goodness [None req-4c67f440-1c6d-4b70-9410-6f8a9a50911d tempest-ShareTypeAvailabilityZonesTest-364532124 None] Goodness function result for host l75lg1-v1@vast#vast: 0. May 28 13:01:15 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-4c67f440-1c6d-4b70-9410-6f8a9a50911d tempest-ShareTypeAvailabilityZonesTest-364532124 None] Goodness: 0 {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:48}} May 28 13:01:15 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-4c67f440-1c6d-4b70-9410-6f8a9a50911d tempest-ShareTypeAvailabilityZonesTest-364532124 None] Done checking host 'l75lg1-v1@vast#vast' {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:49}} May 28 13:01:15 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-3d183f16-4c68-4f9b-806f-7807b0587800 tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] http://10.27.203.238/share/v2/284d76edec3144579d6fb3f6dbc0dd4e/share-groups/b9df9a2d-571e-4658-a435-c01428312fc4 returned with HTTP 200 May 28 13:01:15 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1006/2049] 10.27.203.238 () {64 vars in 1469 bytes} [Tue May 28 13:01:15 2024] GET /share/v2/284d76edec3144579d6fb3f6dbc0dd4e/share-groups/b9df9a2d-571e-4658-a435-c01428312fc4 => generated 772 bytes in 13 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-0b61224f-ed9d-4f3e-a29f-dd2068d64ea2 tempest-ShareUserRulesForNFSNegativeTest-346766616 tempest-ShareUserRulesForNFSNegativeTest-346766616-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ad2c2df894f4bca82e33623064ce809', 'request_id': 'req-0b61224f-ed9d-4f3e-a29f-dd2068d64ea2'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-0b61224f-ed9d-4f3e-a29f-dd2068d64ea2 tempest-ShareUserRulesForNFSNegativeTest-346766616 tempest-ShareUserRulesForNFSNegativeTest-346766616-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ad2c2df894f4bca82e33623064ce809', 'request_id': 'req-0b61224f-ed9d-4f3e-a29f-dd2068d64ea2'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:15 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.host_manager [None req-4c67f440-1c6d-4b70-9410-6f8a9a50911d tempest-ShareTypeAvailabilityZonesTest-364532124 None] Share service is down. (host: l75lg1-v1@generic2). May 28 13:01:15 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.host_manager [None req-4c67f440-1c6d-4b70-9410-6f8a9a50911d tempest-ShareTypeAvailabilityZonesTest-364532124 None] Share service is down. (host: l75lg1-v1@generic1). May 28 13:01:15 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-4c67f440-1c6d-4b70-9410-6f8a9a50911d tempest-ShareTypeAvailabilityZonesTest-364532124 None] Starting with 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:80}} May 28 13:01:15 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-4c67f440-1c6d-4b70-9410-6f8a9a50911d tempest-ShareTypeAvailabilityZonesTest-364532124 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:01:15 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-4c67f440-1c6d-4b70-9410-6f8a9a50911d tempest-ShareTypeAvailabilityZonesTest-364532124 None] Filter ConsistentSnapshotFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:01:15 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.drivers.filter [None req-4c67f440-1c6d-4b70-9410-6f8a9a50911d tempest-ShareTypeAvailabilityZonesTest-364532124 None] Filtered [host: 'l75lg1-v1@vast#vast', free_capacity_gb: 2079.6277076322585, pools: None] {{(pid=98327) _get_weighted_hosts_for_share_group_type /opt/stack/manila/manila/scheduler/drivers/filter.py:474}} May 28 13:01:15 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-4c67f440-1c6d-4b70-9410-6f8a9a50911d tempest-ShareTypeAvailabilityZonesTest-364532124 None] Checking host 'l75lg1-v1@vast#vast' {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:46}} May 28 13:01:15 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.weighers.goodness [None req-4c67f440-1c6d-4b70-9410-6f8a9a50911d tempest-ShareTypeAvailabilityZonesTest-364532124 None] Goodness function not set :: defaulting to minimal goodness rating of 0. May 28 13:01:15 l75lg1-v1 manila-scheduler[98327]: INFO manila.scheduler.weighers.goodness [None req-4c67f440-1c6d-4b70-9410-6f8a9a50911d tempest-ShareTypeAvailabilityZonesTest-364532124 None] Goodness function result for host l75lg1-v1@vast#vast: 0. May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-0b61224f-ed9d-4f3e-a29f-dd2068d64ea2 tempest-ShareUserRulesForNFSNegativeTest-346766616 tempest-ShareUserRulesForNFSNegativeTest-346766616-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ad2c2df894f4bca82e33623064ce809', 'request_id': 'req-0b61224f-ed9d-4f3e-a29f-dd2068d64ea2'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:15 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-4c67f440-1c6d-4b70-9410-6f8a9a50911d tempest-ShareTypeAvailabilityZonesTest-364532124 None] Goodness: 0 {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:48}} May 28 13:01:15 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-4c67f440-1c6d-4b70-9410-6f8a9a50911d tempest-ShareTypeAvailabilityZonesTest-364532124 None] Done checking host 'l75lg1-v1@vast#vast' {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:49}} May 28 13:01:15 l75lg1-v1 manila-scheduler[98327]: INFO manila.scheduler.drivers.filter [None req-4c67f440-1c6d-4b70-9410-6f8a9a50911d tempest-ShareTypeAvailabilityZonesTest-364532124 None] Chose host l75lg1-v1@vast#vast for create_share_group b9df9a2d-571e-4658-a435-c01428312fc4. May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-0b61224f-ed9d-4f3e-a29f-dd2068d64ea2 tempest-ShareUserRulesForNFSNegativeTest-346766616 tempest-ShareUserRulesForNFSNegativeTest-346766616-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ad2c2df894f4bca82e33623064ce809', 'request_id': 'req-0b61224f-ed9d-4f3e-a29f-dd2068d64ea2'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-0b61224f-ed9d-4f3e-a29f-dd2068d64ea2 tempest-ShareUserRulesForNFSNegativeTest-346766616 tempest-ShareUserRulesForNFSNegativeTest-346766616-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ad2c2df894f4bca82e33623064ce809', 'request_id': 'req-0b61224f-ed9d-4f3e-a29f-dd2068d64ea2'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1511/3049] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:01:15 2024] DELETE /identity/v3/users/7ad2c2df894f4bca82e33623064ce809 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dbe04d-8198-414f-a64d-b098a279033b tempest-ShareUserRulesForNFSNegativeTest-346766616 tempest-ShareUserRulesForNFSNegativeTest-346766616-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:15 l75lg1-v1 manila-share[98474]: INFO manila.share.manager [None req-4c67f440-1c6d-4b70-9410-6f8a9a50911d tempest-ShareTypeAvailabilityZonesTest-364532124 None] Share group b9df9a2d-571e-4658-a435-c01428312fc4: creating May 28 13:01:15 l75lg1-v1 manila-share[98474]: DEBUG manila.share.driver [None req-4c67f440-1c6d-4b70-9410-6f8a9a50911d tempest-ShareTypeAvailabilityZonesTest-364532124 None] Created a Share Group with ID: b9df9a2d-571e-4658-a435-c01428312fc4. {{(pid=98474) create_share_group /opt/stack/manila/manila/share/driver.py:1416}} May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-86dbe04d-8198-414f-a64d-b098a279033b tempest-ShareUserRulesForNFSNegativeTest-346766616 tempest-ShareUserRulesForNFSNegativeTest-346766616-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:01:15 l75lg1-v1 manila-share[98474]: INFO manila.share.manager [None req-4c67f440-1c6d-4b70-9410-6f8a9a50911d tempest-ShareTypeAvailabilityZonesTest-364532124 None] Share group b9df9a2d-571e-4658-a435-c01428312fc4: created successfully May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dbe04d-8198-414f-a64d-b098a279033b tempest-ShareUserRulesForNFSNegativeTest-346766616 tempest-ShareUserRulesForNFSNegativeTest-346766616-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fd49c5-921c-47b7-bd7d-47bb4b0ada46 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fd49c5-921c-47b7-bd7d-47bb4b0ada46 None admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fd49c5-921c-47b7-bd7d-47bb4b0ada46 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fd49c5-921c-47b7-bd7d-47bb4b0ada46 None admin] PATH_INFO: `/v3/users/ea25742cabb3412c941df36314d63211` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:15 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9242ab9c-98af-4bf4-ab2d-7a757be81a4f tempest-SharesNFSTest-667257547 None] <<< [GET] https://127.0.0.1:40443/api/views/ May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fd49c5-921c-47b7-bd7d-47bb4b0ada46 None admin] RBAC: Authorizing `identity:delete_user(user_id=ea25742cabb3412c941df36314d63211)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:15 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9242ab9c-98af-4bf4-ab2d-7a757be81a4f tempest-SharesNFSTest-667257547 None] [Bunch(abac_tags=[], abe_max_depth=None, abe_protocols=[], alias='', allow_anonymous_access=False, allow_s3_anonymous_access=False, auto_commit='0d', bucket='', bucket_creators=[], bucket_creators_groups=[], bucket_owner=None, bulk_permission_update_progress=None, bulk_permission_update_state=None, cluster='loop75-kfs', cluster_id=1, created='2024-05-28T13:01:06.317967Z', enabled=True, files_retention_mode='NONE', guid='f1f7a301-a0dc-499c-bc1c-871bb834882a', id=48, ignore_oos=False, internal=False, is_remote=False, is_seamless=False, logical_capacity=0, max_retention_period='0d', min_retention_period='0d', name='d935f840-e1e2-4366-85e1-9cee599842b6', nfs_interop_flags='BOTH_NFS3_AND_NFS4_INTEROP_DISABLED', path='/manila/manila-d935f840-e1e2-4366-85e1-9cee599842b6', physical_capacity=0, policy='d935f840-e1e2-4366-85e1-9cee599842b6', policy_id=49, protocols=['NFS'], qos_policy=None, qos_policy_id=None, s3_locks=False, s3_locks_retention_mode='NONE', s3_locks_retention_period='', s3_unverified_lookup=False, s3_versioning=False, select_for_live_monitoring=False, share='', share_acl=Bunch(acl=[], enabled=False), sync='SYNCED', sync_time='2024-05-28T13:01:08.505599Z', tenant_id=1, tenant_name='default', title='/manila/manila-d935f840-e1e2-4366-85e1-9cee599842b6', url='https://127.0.0.1:40443/api/views/48/')] May 28 13:01:15 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9242ab9c-98af-4bf4-ab2d-7a757be81a4f tempest-SharesNFSTest-667257547 None] --- [GET] https://127.0.0.1:40443/api/views/: Done May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fd49c5-921c-47b7-bd7d-47bb4b0ada46 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:15 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9242ab9c-98af-4bf4-ab2d-7a757be81a4f tempest-SharesNFSTest-667257547 None] >>> [DELETE] https://127.0.0.1:40443/api/views/48/ May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-f2fd49c5-921c-47b7-bd7d-47bb4b0ada46 None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea25742cabb3412c941df36314d63211', 'request_id': 'req-f2fd49c5-921c-47b7-bd7d-47bb4b0ada46'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-f2fd49c5-921c-47b7-bd7d-47bb4b0ada46 None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea25742cabb3412c941df36314d63211', 'request_id': 'req-f2fd49c5-921c-47b7-bd7d-47bb4b0ada46'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-f2fd49c5-921c-47b7-bd7d-47bb4b0ada46 None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea25742cabb3412c941df36314d63211', 'request_id': 'req-f2fd49c5-921c-47b7-bd7d-47bb4b0ada46'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-f2fd49c5-921c-47b7-bd7d-47bb4b0ada46 None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea25742cabb3412c941df36314d63211', 'request_id': 'req-f2fd49c5-921c-47b7-bd7d-47bb4b0ada46'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-f2fd49c5-921c-47b7-bd7d-47bb4b0ada46 None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea25742cabb3412c941df36314d63211', 'request_id': 'req-f2fd49c5-921c-47b7-bd7d-47bb4b0ada46'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1539/3050] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 13:01:15 2024] DELETE /identity/v3/users/ea25742cabb3412c941df36314d63211 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b61224f-ed9d-4f3e-a29f-dd2068d64ea2 tempest-ShareUserRulesForNFSNegativeTest-346766616 tempest-ShareUserRulesForNFSNegativeTest-346766616-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b61224f-ed9d-4f3e-a29f-dd2068d64ea2 tempest-ShareUserRulesForNFSNegativeTest-346766616 tempest-ShareUserRulesForNFSNegativeTest-346766616-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba93e51-1882-40c4-a8b7-238ee4d997df None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba93e51-1882-40c4-a8b7-238ee4d997df None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba93e51-1882-40c4-a8b7-238ee4d997df None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba93e51-1882-40c4-a8b7-238ee4d997df None admin] PATH_INFO: `/v3/users/14c1660e980b457cba80417b5c8e77ba` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba93e51-1882-40c4-a8b7-238ee4d997df None admin] RBAC: Authorizing `identity:delete_user(user_id=14c1660e980b457cba80417b5c8e77ba)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba93e51-1882-40c4-a8b7-238ee4d997df None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-5ba93e51-1882-40c4-a8b7-238ee4d997df None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14c1660e980b457cba80417b5c8e77ba', 'request_id': 'req-5ba93e51-1882-40c4-a8b7-238ee4d997df'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-5ba93e51-1882-40c4-a8b7-238ee4d997df None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14c1660e980b457cba80417b5c8e77ba', 'request_id': 'req-5ba93e51-1882-40c4-a8b7-238ee4d997df'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-5ba93e51-1882-40c4-a8b7-238ee4d997df None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14c1660e980b457cba80417b5c8e77ba', 'request_id': 'req-5ba93e51-1882-40c4-a8b7-238ee4d997df'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-5ba93e51-1882-40c4-a8b7-238ee4d997df None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14c1660e980b457cba80417b5c8e77ba', 'request_id': 'req-5ba93e51-1882-40c4-a8b7-238ee4d997df'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-5ba93e51-1882-40c4-a8b7-238ee4d997df None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14c1660e980b457cba80417b5c8e77ba', 'request_id': 'req-5ba93e51-1882-40c4-a8b7-238ee4d997df'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1512/3051] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 13:01:15 2024] DELETE /identity/v3/users/14c1660e980b457cba80417b5c8e77ba => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fd49c5-921c-47b7-bd7d-47bb4b0ada46 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-f2fd49c5-921c-47b7-bd7d-47bb4b0ada46 None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fd49c5-921c-47b7-bd7d-47bb4b0ada46 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b87701-76ef-4c54-8a45-65b66df41929 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b87701-76ef-4c54-8a45-65b66df41929 None admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b87701-76ef-4c54-8a45-65b66df41929 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b87701-76ef-4c54-8a45-65b66df41929 None admin] PATH_INFO: `/v3/users/c70807ce6f2644f78048b654fd985745` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b87701-76ef-4c54-8a45-65b66df41929 None admin] RBAC: Authorizing `identity:delete_user(user_id=c70807ce6f2644f78048b654fd985745)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b87701-76ef-4c54-8a45-65b66df41929 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-01b87701-76ef-4c54-8a45-65b66df41929 None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c70807ce6f2644f78048b654fd985745', 'request_id': 'req-01b87701-76ef-4c54-8a45-65b66df41929'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-01b87701-76ef-4c54-8a45-65b66df41929 None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c70807ce6f2644f78048b654fd985745', 'request_id': 'req-01b87701-76ef-4c54-8a45-65b66df41929'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-01b87701-76ef-4c54-8a45-65b66df41929 None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c70807ce6f2644f78048b654fd985745', 'request_id': 'req-01b87701-76ef-4c54-8a45-65b66df41929'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-01b87701-76ef-4c54-8a45-65b66df41929 None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c70807ce6f2644f78048b654fd985745', 'request_id': 'req-01b87701-76ef-4c54-8a45-65b66df41929'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-01b87701-76ef-4c54-8a45-65b66df41929 None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c70807ce6f2644f78048b654fd985745', 'request_id': 'req-01b87701-76ef-4c54-8a45-65b66df41929'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1540/3052] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 13:01:15 2024] DELETE /identity/v3/users/c70807ce6f2644f78048b654fd985745 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac6527d-c5da-4b78-83f0-54b7082a5be5 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac6527d-c5da-4b78-83f0-54b7082a5be5 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:15 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac6527d-c5da-4b78-83f0-54b7082a5be5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:16 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-aac6527d-c5da-4b78-83f0-54b7082a5be5 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 13:01:16 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-aac6527d-c5da-4b78-83f0-54b7082a5be5 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 13:01:16 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-aac6527d-c5da-4b78-83f0-54b7082a5be5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:01:16 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1513/3053] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 13:01:15 2024] POST /identity/v3/auth/tokens => generated 2960 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 13:01:16 l75lg1-v1 neutron-server[77618]: DEBUG neutron.wsgi [-] (77618) accepted ('10.27.203.238', 55106) {{(pid=77618) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 13:01:16 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b87701-76ef-4c54-8a45-65b66df41929 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:16 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-01b87701-76ef-4c54-8a45-65b66df41929 None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:01:16 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b87701-76ef-4c54-8a45-65b66df41929 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:16 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d529ae-7189-49bf-bf6f-b0047e80739b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef17047035e4b518fd5360a01f2da1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:16 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d529ae-7189-49bf-bf6f-b0047e80739b service neutron] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:16 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d529ae-7189-49bf-bf6f-b0047e80739b service neutron] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:16 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d529ae-7189-49bf-bf6f-b0047e80739b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:16 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d529ae-7189-49bf-bf6f-b0047e80739b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:16 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d529ae-7189-49bf-bf6f-b0047e80739b service neutron] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:16 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1541/3054] 10.27.203.238 () {64 vars in 1432 bytes} [Tue May 28 13:01:16 2024] GET /identity/v3/auth/tokens => generated 2960 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 28 13:01:16 l75lg1-v1 neutron-server[77618]: INFO neutron.wsgi [None req-39ea5b5a-53f0-41a8-835a-840c525ca697 None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=603a67a7ef1243358ab6945c5eb752a4&name=default HTTP/1.1" status: 200 len: 216 time: 0.0706193 May 28 13:01:16 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac6527d-c5da-4b78-83f0-54b7082a5be5 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:16 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-aac6527d-c5da-4b78-83f0-54b7082a5be5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:01:16 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac6527d-c5da-4b78-83f0-54b7082a5be5 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:16 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff483d6d-081b-4bb6-b7dd-5555e9ccc5ca None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:16 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff483d6d-081b-4bb6-b7dd-5555e9ccc5ca None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:16 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff483d6d-081b-4bb6-b7dd-5555e9ccc5ca None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:16 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff483d6d-081b-4bb6-b7dd-5555e9ccc5ca None admin] PATH_INFO: `/v3/projects/603a67a7ef1243358ab6945c5eb752a4` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:16 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff483d6d-081b-4bb6-b7dd-5555e9ccc5ca None admin] RBAC: Authorizing `identity:delete_project(project_id=603a67a7ef1243358ab6945c5eb752a4)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:16 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff483d6d-081b-4bb6-b7dd-5555e9ccc5ca None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:16 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-ff483d6d-081b-4bb6-b7dd-5555e9ccc5ca None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '603a67a7ef1243358ab6945c5eb752a4', 'request_id': 'req-ff483d6d-081b-4bb6-b7dd-5555e9ccc5ca'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:16 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-ff483d6d-081b-4bb6-b7dd-5555e9ccc5ca None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '603a67a7ef1243358ab6945c5eb752a4', 'request_id': 'req-ff483d6d-081b-4bb6-b7dd-5555e9ccc5ca'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:16 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-ff483d6d-081b-4bb6-b7dd-5555e9ccc5ca None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '603a67a7ef1243358ab6945c5eb752a4', 'request_id': 'req-ff483d6d-081b-4bb6-b7dd-5555e9ccc5ca'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:16 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-ff483d6d-081b-4bb6-b7dd-5555e9ccc5ca None admin] The token cache is being invalidate because project 603a67a7ef1243358ab6945c5eb752a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 13:01:16 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-ff483d6d-081b-4bb6-b7dd-5555e9ccc5ca None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:16 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-ff483d6d-081b-4bb6-b7dd-5555e9ccc5ca None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:16 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1514/3055] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 13:01:16 2024] DELETE /identity/v3/projects/603a67a7ef1243358ab6945c5eb752a4 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:01:16 l75lg1-v1 neutron-server[77618]: DEBUG neutron.wsgi [-] (77618) accepted ('10.27.203.238', 55112) {{(pid=77618) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 13:01:16 l75lg1-v1 neutron-server[77618]: INFO neutron.wsgi [None req-63a05e6a-aa70-4e30-9f3c-445ec7dba142 None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=6d4b9bca9e684dff84056664ca08e79a&name=default HTTP/1.1" status: 200 len: 216 time: 0.0083709 May 28 13:01:16 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d529ae-7189-49bf-bf6f-b0047e80739b service neutron] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:16 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d529ae-7189-49bf-bf6f-b0047e80739b service neutron] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:16 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150fd254-0d39-4433-b065-ce0565d9fc41 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:16 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150fd254-0d39-4433-b065-ce0565d9fc41 None admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:16 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150fd254-0d39-4433-b065-ce0565d9fc41 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:16 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150fd254-0d39-4433-b065-ce0565d9fc41 None admin] PATH_INFO: `/v3/projects/6d4b9bca9e684dff84056664ca08e79a` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:16 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150fd254-0d39-4433-b065-ce0565d9fc41 None admin] RBAC: Authorizing `identity:delete_project(project_id=6d4b9bca9e684dff84056664ca08e79a)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:16 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150fd254-0d39-4433-b065-ce0565d9fc41 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:16 l75lg1-v1 dstat.sh[49771]: 28-05 13:01:16| 10 2 84 3 0|5699M 1743M 278M 7905M| 12k 3980B| 0 2637k| 0 381 |8841 16k|1.56 1.24 1.08|2.0 1.0 0| 0 0 | 0 2048M| 29 364 0 36 2 May 28 13:01:16 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-150fd254-0d39-4433-b065-ce0565d9fc41 None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d4b9bca9e684dff84056664ca08e79a', 'request_id': 'req-150fd254-0d39-4433-b065-ce0565d9fc41'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:16 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-150fd254-0d39-4433-b065-ce0565d9fc41 None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d4b9bca9e684dff84056664ca08e79a', 'request_id': 'req-150fd254-0d39-4433-b065-ce0565d9fc41'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:16 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-150fd254-0d39-4433-b065-ce0565d9fc41 None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d4b9bca9e684dff84056664ca08e79a', 'request_id': 'req-150fd254-0d39-4433-b065-ce0565d9fc41'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:16 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-150fd254-0d39-4433-b065-ce0565d9fc41 None admin] The token cache is being invalidate because project 6d4b9bca9e684dff84056664ca08e79a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 13:01:16 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-150fd254-0d39-4433-b065-ce0565d9fc41 None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:16 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-150fd254-0d39-4433-b065-ce0565d9fc41 None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:16 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1542/3056] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 13:01:16 2024] DELETE /identity/v3/projects/6d4b9bca9e684dff84056664ca08e79a => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:01:16 l75lg1-v1 neutron-server[77618]: DEBUG neutron.wsgi [-] (77618) accepted ('10.27.203.238', 55116) {{(pid=77618) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 13:01:16 l75lg1-v1 neutron-server[77618]: INFO neutron.wsgi [None req-ed49abc4-f6d3-4653-b3ad-210aea6ea421 None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=17eeabfb1fed41e98ca946a84f94faae&name=default HTTP/1.1" status: 200 len: 216 time: 0.0082500 May 28 13:01:16 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff483d6d-081b-4bb6-b7dd-5555e9ccc5ca None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:16 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-ff483d6d-081b-4bb6-b7dd-5555e9ccc5ca None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:01:16 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff483d6d-081b-4bb6-b7dd-5555e9ccc5ca None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:16 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54b14c4-5ba7-401b-91d1-8fee915636ef None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:16 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54b14c4-5ba7-401b-91d1-8fee915636ef None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:16 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54b14c4-5ba7-401b-91d1-8fee915636ef None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:16 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54b14c4-5ba7-401b-91d1-8fee915636ef None admin] PATH_INFO: `/v3/projects/17eeabfb1fed41e98ca946a84f94faae` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:16 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54b14c4-5ba7-401b-91d1-8fee915636ef None admin] RBAC: Authorizing `identity:delete_project(project_id=17eeabfb1fed41e98ca946a84f94faae)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:16 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54b14c4-5ba7-401b-91d1-8fee915636ef None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:16 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-c54b14c4-5ba7-401b-91d1-8fee915636ef None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17eeabfb1fed41e98ca946a84f94faae', 'request_id': 'req-c54b14c4-5ba7-401b-91d1-8fee915636ef'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:16 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-c54b14c4-5ba7-401b-91d1-8fee915636ef None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17eeabfb1fed41e98ca946a84f94faae', 'request_id': 'req-c54b14c4-5ba7-401b-91d1-8fee915636ef'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:16 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e9709f89-cda1-4335-8385-dd167edf0c22 tempest-ShareRulesTest-1530341375 None] <<< [PATCH] https://127.0.0.1:40443/api/viewpolicies/38/ May 28 13:01:16 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e9709f89-cda1-4335-8385-dd167edf0c22 tempest-ShareRulesTest-1530341375 None] Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=1, created='2024-05-28T12:59:53.824250Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='0fa84ccd-850f-48fa-a965-23e5abe31188', id=38, internal=False, is_s3_default_policy=False, name='f7e47502-a0f7-44de-953d-b7b5697ae0b2', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=['*'], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['203.0.113.77'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['203.0.113.77'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='MODIFYING', sync_time='2024-05-28T13:01:15.715883Z', tenant_id=1, tenant_name='default', title='f7e47502-a0f7-44de-953d-b7b5697ae0b2', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/38/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[]) May 28 13:01:16 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e9709f89-cda1-4335-8385-dd167edf0c22 tempest-ShareRulesTest-1530341375 None] --- [PATCH] https://127.0.0.1:40443/api/viewpolicies/38/: Done May 28 13:01:16 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-e9709f89-cda1-4335-8385-dd167edf0c22 tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:01:16 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-e9709f89-cda1-4335-8385-dd167edf0c22 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:01:16 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-c54b14c4-5ba7-401b-91d1-8fee915636ef None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17eeabfb1fed41e98ca946a84f94faae', 'request_id': 'req-c54b14c4-5ba7-401b-91d1-8fee915636ef'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:16 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-c54b14c4-5ba7-401b-91d1-8fee915636ef None admin] The token cache is being invalidate because project 17eeabfb1fed41e98ca946a84f94faae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 13:01:16 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-c54b14c4-5ba7-401b-91d1-8fee915636ef None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:16 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-c54b14c4-5ba7-401b-91d1-8fee915636ef None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:16 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1515/3057] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 13:01:16 2024] DELETE /identity/v3/projects/17eeabfb1fed41e98ca946a84f94faae => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:01:16 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a62cb6a-2759-4d4d-ab5e-35b7311d399a None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:16 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a62cb6a-2759-4d4d-ab5e-35b7311d399a None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:16 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a62cb6a-2759-4d4d-ab5e-35b7311d399a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:16 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-5a62cb6a-2759-4d4d-ab5e-35b7311d399a None None] Truncating password to algorithm specific maximum length 72 characters. May 28 13:01:16 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-5a62cb6a-2759-4d4d-ab5e-35b7311d399a None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 13:01:16 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-5a62cb6a-2759-4d4d-ab5e-35b7311d399a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:01:16 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1543/3058] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 13:01:16 2024] POST /identity/v3/auth/tokens => generated 312 bytes in 24 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 28 13:01:16 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bf3b8a-043b-4188-84f0-dacd43e4c782 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:16 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bf3b8a-043b-4188-84f0-dacd43e4c782 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:16 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bf3b8a-043b-4188-84f0-dacd43e4c782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:16 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-c2bf3b8a-043b-4188-84f0-dacd43e4c782 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 13:01:16 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-c2bf3b8a-043b-4188-84f0-dacd43e4c782 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 13:01:16 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-c2bf3b8a-043b-4188-84f0-dacd43e4c782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:01:16 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-e9709f89-cda1-4335-8385-dd167edf0c22 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.092s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:01:16 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-e9709f89-cda1-4335-8385-dd167edf0c22 tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:01:16 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-e9709f89-cda1-4335-8385-dd167edf0c22 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:01:16 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-e9709f89-cda1-4335-8385-dd167edf0c22 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:01:16 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-e9709f89-cda1-4335-8385-dd167edf0c22 tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:01:16 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-e9709f89-cda1-4335-8385-dd167edf0c22 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:01:16 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-e9709f89-cda1-4335-8385-dd167edf0c22 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:01:16 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-e9709f89-cda1-4335-8385-dd167edf0c22 tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:01:16 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-e9709f89-cda1-4335-8385-dd167edf0c22 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:01:16 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1516/3059] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 13:01:16 2024] POST /identity/v3/auth/tokens => generated 2960 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 13:01:16 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-e9709f89-cda1-4335-8385-dd167edf0c22 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:01:16 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-e9709f89-cda1-4335-8385-dd167edf0c22 tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:01:16 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-e9709f89-cda1-4335-8385-dd167edf0c22 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:01:16 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a62cb6a-2759-4d4d-ab5e-35b7311d399a None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:16 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a62cb6a-2759-4d4d-ab5e-35b7311d399a None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:16 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1c8c48-9eb1-412a-aeaf-37cdfd0bb3c7 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:16 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1c8c48-9eb1-412a-aeaf-37cdfd0bb3c7 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:16 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1c8c48-9eb1-412a-aeaf-37cdfd0bb3c7 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:16 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1c8c48-9eb1-412a-aeaf-37cdfd0bb3c7 None admin] PATH_INFO: `/v3/domains` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:16 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1c8c48-9eb1-412a-aeaf-37cdfd0bb3c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=51267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 13:01:16 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1c8c48-9eb1-412a-aeaf-37cdfd0bb3c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:16 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1c8c48-9eb1-412a-aeaf-37cdfd0bb3c7 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:16 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1544/3060] 10.27.203.238 () {62 vars in 1220 bytes} [Tue May 28 13:01:16 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 13:01:16 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bf3b8a-043b-4188-84f0-dacd43e4c782 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:16 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bf3b8a-043b-4188-84f0-dacd43e4c782 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:16 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5faad1-861c-4354-a4a1-4933ae153cc1 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:16 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5faad1-861c-4354-a4a1-4933ae153cc1 None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:16 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5faad1-861c-4354-a4a1-4933ae153cc1 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:16 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5faad1-861c-4354-a4a1-4933ae153cc1 None admin] PATH_INFO: `/v3/projects` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:16 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5faad1-861c-4354-a4a1-4933ae153cc1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:16 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5faad1-861c-4354-a4a1-4933ae153cc1 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:16 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-e9709f89-cda1-4335-8385-dd167edf0c22 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.049s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:01:16 l75lg1-v1 manila-share[98474]: INFO manila.share.access [None req-e9709f89-cda1-4335-8385-dd167edf0c22 tempest-ShareRulesTest-1530341375 None] Access rules were successfully modified for share instance f7e47502-a0f7-44de-953d-b7b5697ae0b2 belonging to share b330db31-7766-443d-9c19-26fe349665aa. May 28 13:01:16 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1517/3061] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 13:01:16 2024] POST /identity/v3/projects => generated 377 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 13:01:16 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1c8c48-9eb1-412a-aeaf-37cdfd0bb3c7 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:16 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1c8c48-9eb1-412a-aeaf-37cdfd0bb3c7 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:16 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b869b37f-7787-45c0-b730-76ae12de6933 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:16 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b869b37f-7787-45c0-b730-76ae12de6933 None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:16 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b869b37f-7787-45c0-b730-76ae12de6933 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:16 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b869b37f-7787-45c0-b730-76ae12de6933 None admin] PATH_INFO: `/v3/users` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:16 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b869b37f-7787-45c0-b730-76ae12de6933 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:16 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b869b37f-7787-45c0-b730-76ae12de6933 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:16 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-b869b37f-7787-45c0-b730-76ae12de6933 None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 13:01:16 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1545/3062] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 13:01:16 2024] POST /identity/v3/users => generated 297 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 13:01:16 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5faad1-861c-4354-a4a1-4933ae153cc1 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:16 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5faad1-861c-4354-a4a1-4933ae153cc1 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:16 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d530b6d-3d17-4cd0-8815-cd22b06a5543 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:16 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d530b6d-3d17-4cd0-8815-cd22b06a5543 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:16 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d530b6d-3d17-4cd0-8815-cd22b06a5543 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:16 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d530b6d-3d17-4cd0-8815-cd22b06a5543 None admin] PATH_INFO: `/v3/roles` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:16 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d530b6d-3d17-4cd0-8815-cd22b06a5543 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:16 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d530b6d-3d17-4cd0-8815-cd22b06a5543 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:16 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1518/3063] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 13:01:16 2024] GET /identity/v3/roles => generated 1680 bytes in 18 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 13:01:16 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b869b37f-7787-45c0-b730-76ae12de6933 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:16 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b869b37f-7787-45c0-b730-76ae12de6933 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:16 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a86c3b5-74ed-4712-a935-24bb6ba3715e None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:16 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a86c3b5-74ed-4712-a935-24bb6ba3715e None admin] REQUEST_METHOD: `PUT` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:16 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a86c3b5-74ed-4712-a935-24bb6ba3715e None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:16 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a86c3b5-74ed-4712-a935-24bb6ba3715e None admin] PATH_INFO: `/v3/projects/f7d59a5c883f4f699e4078430c78ad8d/users/963acda0ce4849bfa566898a3e080b4b/roles/44620cad10ae407c90c91e2c296adb04` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:16 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-2c8797bb-b828-4402-b57b-561fbbb0e515 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] GET http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/share-access-rules?share_id=b330db31-7766-443d-9c19-26fe349665aa May 28 13:01:16 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-2c8797bb-b828-4402-b57b-561fbbb0e515 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:16 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-2c8797bb-b828-4402-b57b-561fbbb0e515 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:16 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a86c3b5-74ed-4712-a935-24bb6ba3715e None admin] RBAC: Authorizing `identity:create_grant(project_id=f7d59a5c883f4f699e4078430c78ad8d, user_id=963acda0ce4849bfa566898a3e080b4b, role_id=44620cad10ae407c90c91e2c296adb04)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:16 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a86c3b5-74ed-4712-a935-24bb6ba3715e None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:16 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1546/3064] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 13:01:16 2024] PUT /identity/v3/projects/f7d59a5c883f4f699e4078430c78ad8d/users/963acda0ce4849bfa566898a3e080b4b/roles/44620cad10ae407c90c91e2c296adb04 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:01:16 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1359a9f-20c8-4a74-b8c7-edfeab3dfdac None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:16 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1359a9f-20c8-4a74-b8c7-edfeab3dfdac None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:16 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1359a9f-20c8-4a74-b8c7-edfeab3dfdac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:16 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.lock.api [None req-2c8797bb-b828-4402-b57b-561fbbb0e515 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Searching for locks by: {'resource_id': 'ec5b7eb4-7b80-4c81-8a14-0fc3a95397f5', 'resource_action': 'show', 'resource_type': 'access_rule'} {{(pid=98329) get_all /opt/stack/manila/manila/lock/api.py:112}} May 28 13:01:16 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-b1359a9f-20c8-4a74-b8c7-edfeab3dfdac None None] Truncating password to algorithm specific maximum length 72 characters. May 28 13:01:16 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-2c8797bb-b828-4402-b57b-561fbbb0e515 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/share-access-rules?share_id=b330db31-7766-443d-9c19-26fe349665aa returned with HTTP 200 May 28 13:01:16 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1044/2050] 10.27.203.238 () {64 vars in 1467 bytes} [Tue May 28 13:01:16 2024] GET /share/v2/a4f3887fa28c457390f5b66615564430/share-access-rules?share_id=b330db31-7766-443d-9c19-26fe349665aa => generated 280 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:01:16 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-b1359a9f-20c8-4a74-b8c7-edfeab3dfdac None None] MFA Rules not processed for user `963acda0ce4849bfa566898a3e080b4b`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 13:01:16 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-b1359a9f-20c8-4a74-b8c7-edfeab3dfdac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:01:16 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-0667e4bb-7ea7-4904-a9e4-6bb97486e4cb tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] POST http://10.27.203.238/share/v2/f353f66e6e00471aa584ea2e39c0ab0e/shares/b330db31-7766-443d-9c19-26fe349665aa/action May 28 13:01:16 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-0667e4bb-7ea7-4904-a9e4-6bb97486e4cb tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] Action body: b'{"deny_access": {"access_id": "ec5b7eb4-7b80-4c81-8a14-0fc3a95397f5", "unrestrict": true}}' {{(pid=98330) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 13:01:16 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-0667e4bb-7ea7-4904-a9e4-6bb97486e4cb tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] Action: 'action', calling method: ShareController.deny_access, body: {"deny_access": {"access_id": "ec5b7eb4-7b80-4c81-8a14-0fc3a95397f5", "unrestrict": true}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:01:16 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.lock.api [None req-0667e4bb-7ea7-4904-a9e4-6bb97486e4cb tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] Searching for locks by: {'resource_id': 'ec5b7eb4-7b80-4c81-8a14-0fc3a95397f5', 'resource_action': 'delete'} {{(pid=98330) get_all /opt/stack/manila/manila/lock/api.py:112}} May 28 13:01:16 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1519/3065] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 13:01:16 2024] POST /identity/v3/auth/tokens => generated 3948 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 13:01:16 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a86c3b5-74ed-4712-a935-24bb6ba3715e None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:16 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-0667e4bb-7ea7-4904-a9e4-6bb97486e4cb tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:01:16 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-0667e4bb-7ea7-4904-a9e4-6bb97486e4cb tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:01:16 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a86c3b5-74ed-4712-a935-24bb6ba3715e None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:16 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe1c0bb-6d30-48d8-accd-c90f7bca63a2 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:16 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe1c0bb-6d30-48d8-accd-c90f7bca63a2 None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:16 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe1c0bb-6d30-48d8-accd-c90f7bca63a2 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:16 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe1c0bb-6d30-48d8-accd-c90f7bca63a2 None admin] PATH_INFO: `/v3/projects` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:16 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe1c0bb-6d30-48d8-accd-c90f7bca63a2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:16 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe1c0bb-6d30-48d8-accd-c90f7bca63a2 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:16 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-0667e4bb-7ea7-4904-a9e4-6bb97486e4cb tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.044s {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:01:16 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-0667e4bb-7ea7-4904-a9e4-6bb97486e4cb tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:01:16 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-0667e4bb-7ea7-4904-a9e4-6bb97486e4cb tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:01:16 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1547/3066] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 13:01:16 2024] POST /identity/v3/projects => generated 379 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 13:01:16 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1359a9f-20c8-4a74-b8c7-edfeab3dfdac None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:16 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1359a9f-20c8-4a74-b8c7-edfeab3dfdac None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:16 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae5a1dc-1fbf-4ad1-94fe-a6a6390840ff None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:16 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae5a1dc-1fbf-4ad1-94fe-a6a6390840ff None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:16 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae5a1dc-1fbf-4ad1-94fe-a6a6390840ff None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:16 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae5a1dc-1fbf-4ad1-94fe-a6a6390840ff None admin] PATH_INFO: `/v3/users` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:16 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae5a1dc-1fbf-4ad1-94fe-a6a6390840ff None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:16 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae5a1dc-1fbf-4ad1-94fe-a6a6390840ff None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:16 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-fae5a1dc-1fbf-4ad1-94fe-a6a6390840ff None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 13:01:17 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1520/3067] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 13:01:16 2024] POST /identity/v3/users => generated 298 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 13:01:17 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-0667e4bb-7ea7-4904-a9e4-6bb97486e4cb tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.069s {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:01:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe1c0bb-6d30-48d8-accd-c90f7bca63a2 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:17 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-0667e4bb-7ea7-4904-a9e4-6bb97486e4cb tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] http://10.27.203.238/share/v2/f353f66e6e00471aa584ea2e39c0ab0e/shares/b330db31-7766-443d-9c19-26fe349665aa/action returned with HTTP 202 May 28 13:01:17 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1007/2051] 10.27.203.238 () {66 vars in 1493 bytes} [Tue May 28 13:01:16 2024] POST /share/v2/f353f66e6e00471aa584ea2e39c0ab0e/shares/b330db31-7766-443d-9c19-26fe349665aa/action => generated 0 bytes in 193 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 13:01:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe1c0bb-6d30-48d8-accd-c90f7bca63a2 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d31ed8-dd1f-4f63-a048-05c63df9f7d6 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d31ed8-dd1f-4f63-a048-05c63df9f7d6 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d31ed8-dd1f-4f63-a048-05c63df9f7d6 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d31ed8-dd1f-4f63-a048-05c63df9f7d6 None admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:17 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-3bfe18e7-773f-454d-bc5c-07500862f5d2 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] GET http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/share-access-rules?share_id=b330db31-7766-443d-9c19-26fe349665aa May 28 13:01:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d31ed8-dd1f-4f63-a048-05c63df9f7d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:17 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-3bfe18e7-773f-454d-bc5c-07500862f5d2 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:17 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-3bfe18e7-773f-454d-bc5c-07500862f5d2 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d31ed8-dd1f-4f63-a048-05c63df9f7d6 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:17 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1548/3068] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 13:01:17 2024] GET /identity/v3/roles => generated 1680 bytes in 17 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 13:01:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae5a1dc-1fbf-4ad1-94fe-a6a6390840ff None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:17 l75lg1-v1 manila-share[98474]: DEBUG manila.share.manager [None req-0667e4bb-7ea7-4904-a9e4-6bb97486e4cb tempest-ShareRulesTest-2015086173 None] Received request to update access for share instance f7e47502-a0f7-44de-953d-b7b5697ae0b2. {{(pid=98474) update_access_for_instances /opt/stack/manila/manila/share/manager.py:4353}} May 28 13:01:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae5a1dc-1fbf-4ad1-94fe-a6a6390840ff None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daee7e6-415d-4ba4-a76b-c55c62a9f0e0 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daee7e6-415d-4ba4-a76b-c55c62a9f0e0 None admin] REQUEST_METHOD: `PUT` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daee7e6-415d-4ba4-a76b-c55c62a9f0e0 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daee7e6-415d-4ba4-a76b-c55c62a9f0e0 None admin] PATH_INFO: `/v3/projects/5386046a212345589b65f0a1a9d526a7/users/50791c693a7f4dd0ac09df2447b5637f/roles/44620cad10ae407c90c91e2c296adb04` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daee7e6-415d-4ba4-a76b-c55c62a9f0e0 None admin] RBAC: Authorizing `identity:create_grant(project_id=5386046a212345589b65f0a1a9d526a7, user_id=50791c693a7f4dd0ac09df2447b5637f, role_id=44620cad10ae407c90c91e2c296adb04)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daee7e6-415d-4ba4-a76b-c55c62a9f0e0 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:17 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.lock.api [None req-3bfe18e7-773f-454d-bc5c-07500862f5d2 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Searching for locks by: {'resource_id': 'ec5b7eb4-7b80-4c81-8a14-0fc3a95397f5', 'resource_action': 'show', 'resource_type': 'access_rule'} {{(pid=98329) get_all /opt/stack/manila/manila/lock/api.py:112}} May 28 13:01:17 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-0667e4bb-7ea7-4904-a9e4-6bb97486e4cb tempest-ShareRulesTest-2015086173 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:01:17 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-0667e4bb-7ea7-4904-a9e4-6bb97486e4cb tempest-ShareRulesTest-2015086173 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:01:17 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-3bfe18e7-773f-454d-bc5c-07500862f5d2 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/share-access-rules?share_id=b330db31-7766-443d-9c19-26fe349665aa returned with HTTP 200 May 28 13:01:17 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1045/2052] 10.27.203.238 () {64 vars in 1467 bytes} [Tue May 28 13:01:17 2024] GET /share/v2/a4f3887fa28c457390f5b66615564430/share-access-rules?share_id=b330db31-7766-443d-9c19-26fe349665aa => generated 288 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:01:17 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-0667e4bb-7ea7-4904-a9e4-6bb97486e4cb tempest-ShareRulesTest-2015086173 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:01:17 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-0667e4bb-7ea7-4904-a9e4-6bb97486e4cb tempest-ShareRulesTest-2015086173 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:01:17 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-0667e4bb-7ea7-4904-a9e4-6bb97486e4cb tempest-ShareRulesTest-2015086173 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:01:17 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1521/3069] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 13:01:17 2024] PUT /identity/v3/projects/5386046a212345589b65f0a1a9d526a7/users/50791c693a7f4dd0ac09df2447b5637f/roles/44620cad10ae407c90c91e2c296adb04 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:01:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3e3f43-587b-4352-be59-2404c5e07929 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3e3f43-587b-4352-be59-2404c5e07929 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3e3f43-587b-4352-be59-2404c5e07929 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:17 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-9b3e3f43-587b-4352-be59-2404c5e07929 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 13:01:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-9b3e3f43-587b-4352-be59-2404c5e07929 None None] MFA Rules not processed for user `50791c693a7f4dd0ac09df2447b5637f`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 13:01:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-9b3e3f43-587b-4352-be59-2404c5e07929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:01:17 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-0667e4bb-7ea7-4904-a9e4-6bb97486e4cb tempest-ShareRulesTest-2015086173 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.055s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:01:17 l75lg1-v1 manila-share[98474]: DEBUG manila.share.access [None req-0667e4bb-7ea7-4904-a9e4-6bb97486e4cb tempest-ShareRulesTest-2015086173 None] Updating access rules for share instance f7e47502-a0f7-44de-953d-b7b5697ae0b2 belonging to share b330db31-7766-443d-9c19-26fe349665aa. {{(pid=98474) update_access_rules /opt/stack/manila/manila/share/access.py:298}} May 28 13:01:17 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-0667e4bb-7ea7-4904-a9e4-6bb97486e4cb tempest-ShareRulesTest-2015086173 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:01:17 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-0667e4bb-7ea7-4904-a9e4-6bb97486e4cb tempest-ShareRulesTest-2015086173 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:01:17 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-0667e4bb-7ea7-4904-a9e4-6bb97486e4cb tempest-ShareRulesTest-2015086173 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.007s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:01:17 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1549/3070] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 13:01:17 2024] POST /identity/v3/auth/tokens => generated 3950 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 13:01:17 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-0667e4bb-7ea7-4904-a9e4-6bb97486e4cb tempest-ShareRulesTest-2015086173 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:01:17 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-0667e4bb-7ea7-4904-a9e4-6bb97486e4cb tempest-ShareRulesTest-2015086173 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:01:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daee7e6-415d-4ba4-a76b-c55c62a9f0e0 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:17 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-0667e4bb-7ea7-4904-a9e4-6bb97486e4cb tempest-ShareRulesTest-2015086173 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.016s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:01:17 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-0667e4bb-7ea7-4904-a9e4-6bb97486e4cb tempest-ShareRulesTest-2015086173 None] changing access on None May 28 13:01:17 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0667e4bb-7ea7-4904-a9e4-6bb97486e4cb tempest-ShareRulesTest-2015086173 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:01:17 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0667e4bb-7ea7-4904-a9e4-6bb97486e4cb tempest-ShareRulesTest-2015086173 None] {'allow_redirects': True, May 28 13:01:17 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0667e4bb-7ea7-4904-a9e4-6bb97486e4cb tempest-ShareRulesTest-2015086173 None] 'params': {'name': 'f7e47502-a0f7-44de-953d-b7b5697ae0b2'}} May 28 13:01:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daee7e6-415d-4ba4-a76b-c55c62a9f0e0 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0141157-946a-4526-8762-90b526c4071f None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0141157-946a-4526-8762-90b526c4071f None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0141157-946a-4526-8762-90b526c4071f None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0141157-946a-4526-8762-90b526c4071f None admin] PATH_INFO: `/v3/projects` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0141157-946a-4526-8762-90b526c4071f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0141157-946a-4526-8762-90b526c4071f None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:17 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1522/3071] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 13:01:17 2024] POST /identity/v3/projects => generated 377 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 13:01:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3e3f43-587b-4352-be59-2404c5e07929 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3e3f43-587b-4352-be59-2404c5e07929 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0314a1d-07f9-4fce-ab93-d6735608ae2c None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0314a1d-07f9-4fce-ab93-d6735608ae2c None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0314a1d-07f9-4fce-ab93-d6735608ae2c None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0314a1d-07f9-4fce-ab93-d6735608ae2c None admin] PATH_INFO: `/v3/users` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0314a1d-07f9-4fce-ab93-d6735608ae2c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0314a1d-07f9-4fce-ab93-d6735608ae2c None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:17 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-f0314a1d-07f9-4fce-ab93-d6735608ae2c None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 13:01:17 l75lg1-v1 dstat.sh[49771]: 28-05 13:01:17| 14 2 78 6 0|5699M 1742M 278M 7905M| 14k 2334B| 0 6354k| 0 588 |9435 16k|1.51 1.23 1.08|2.0 1.0 0| 0 0 | 0 2048M| 29 364 0 37 2 May 28 13:01:17 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1550/3072] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 13:01:17 2024] POST /identity/v3/users => generated 296 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 13:01:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0141157-946a-4526-8762-90b526c4071f None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0141157-946a-4526-8762-90b526c4071f None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452f9204-3307-40d7-823e-058987fbc506 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452f9204-3307-40d7-823e-058987fbc506 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452f9204-3307-40d7-823e-058987fbc506 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452f9204-3307-40d7-823e-058987fbc506 None admin] PATH_INFO: `/v3/roles` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452f9204-3307-40d7-823e-058987fbc506 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452f9204-3307-40d7-823e-058987fbc506 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:17 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1523/3073] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 13:01:17 2024] GET /identity/v3/roles => generated 1680 bytes in 19 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 13:01:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0314a1d-07f9-4fce-ab93-d6735608ae2c None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0314a1d-07f9-4fce-ab93-d6735608ae2c None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ca60f9-1d11-40a9-916c-05a0da69641e None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ca60f9-1d11-40a9-916c-05a0da69641e None admin] REQUEST_METHOD: `PUT` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ca60f9-1d11-40a9-916c-05a0da69641e None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ca60f9-1d11-40a9-916c-05a0da69641e None admin] PATH_INFO: `/v3/projects/d920199a0bc342fd8f081923701e198c/users/940148b13d07445e8512baadc6d7fa72/roles/e7989893488f483baa107be56668c4f8` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ca60f9-1d11-40a9-916c-05a0da69641e None admin] RBAC: Authorizing `identity:create_grant(project_id=d920199a0bc342fd8f081923701e198c, user_id=940148b13d07445e8512baadc6d7fa72, role_id=e7989893488f483baa107be56668c4f8)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ca60f9-1d11-40a9-916c-05a0da69641e None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:17 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1551/3074] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 13:01:17 2024] PUT /identity/v3/projects/d920199a0bc342fd8f081923701e198c/users/940148b13d07445e8512baadc6d7fa72/roles/e7989893488f483baa107be56668c4f8 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:01:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452f9204-3307-40d7-823e-058987fbc506 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452f9204-3307-40d7-823e-058987fbc506 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f170c28e-246a-485b-91cf-091c54b129e3 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f170c28e-246a-485b-91cf-091c54b129e3 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f170c28e-246a-485b-91cf-091c54b129e3 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f170c28e-246a-485b-91cf-091c54b129e3 None admin] PATH_INFO: `/v3/roles` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f170c28e-246a-485b-91cf-091c54b129e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f170c28e-246a-485b-91cf-091c54b129e3 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:17 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1524/3075] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 13:01:17 2024] GET /identity/v3/roles => generated 1680 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 13:01:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ca60f9-1d11-40a9-916c-05a0da69641e None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ca60f9-1d11-40a9-916c-05a0da69641e None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484a4834-a02f-4cdd-b963-8e15a139d6c2 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484a4834-a02f-4cdd-b963-8e15a139d6c2 None admin] REQUEST_METHOD: `PUT` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484a4834-a02f-4cdd-b963-8e15a139d6c2 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484a4834-a02f-4cdd-b963-8e15a139d6c2 None admin] PATH_INFO: `/v3/projects/d920199a0bc342fd8f081923701e198c/users/940148b13d07445e8512baadc6d7fa72/roles/e7989893488f483baa107be56668c4f8` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484a4834-a02f-4cdd-b963-8e15a139d6c2 None admin] RBAC: Authorizing `identity:create_grant(project_id=d920199a0bc342fd8f081923701e198c, user_id=940148b13d07445e8512baadc6d7fa72, role_id=e7989893488f483baa107be56668c4f8)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484a4834-a02f-4cdd-b963-8e15a139d6c2 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:17 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1552/3076] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 13:01:17 2024] PUT /identity/v3/projects/d920199a0bc342fd8f081923701e198c/users/940148b13d07445e8512baadc6d7fa72/roles/e7989893488f483baa107be56668c4f8 => generated 0 bytes in 17 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:01:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088a4c31-2f05-4a81-908a-1db8b45d15c2 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088a4c31-2f05-4a81-908a-1db8b45d15c2 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088a4c31-2f05-4a81-908a-1db8b45d15c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:17 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-088a4c31-2f05-4a81-908a-1db8b45d15c2 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 13:01:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-088a4c31-2f05-4a81-908a-1db8b45d15c2 None None] MFA Rules not processed for user `940148b13d07445e8512baadc6d7fa72`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 13:01:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-088a4c31-2f05-4a81-908a-1db8b45d15c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:01:17 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1525/3077] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 13:01:17 2024] POST /identity/v3/auth/tokens => generated 4071 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 13:01:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484a4834-a02f-4cdd-b963-8e15a139d6c2 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:17 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0667e4bb-7ea7-4904-a9e4-6bb97486e4cb tempest-ShareRulesTest-2015086173 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:01:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484a4834-a02f-4cdd-b963-8e15a139d6c2 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:17 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0667e4bb-7ea7-4904-a9e4-6bb97486e4cb tempest-ShareRulesTest-2015086173 None] [Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=1, created='2024-05-28T12:59:53.824250Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='0fa84ccd-850f-48fa-a965-23e5abe31188', id=38, internal=False, is_s3_default_policy=False, name='f7e47502-a0f7-44de-953d-b7b5697ae0b2', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=['*'], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['203.0.113.77'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['203.0.113.77'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T13:01:16.385687Z', tenant_id=1, tenant_name='default', title='f7e47502-a0f7-44de-953d-b7b5697ae0b2', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/38/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[])] May 28 13:01:17 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0667e4bb-7ea7-4904-a9e4-6bb97486e4cb tempest-ShareRulesTest-2015086173 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 13:01:17 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-0667e4bb-7ea7-4904-a9e4-6bb97486e4cb tempest-ShareRulesTest-2015086173 None] changing access on /manila/manila-f7e47502-a0f7-44de-953d-b7b5697ae0b2. Rules: {'nfs_read_write': [], 'nfs_read_only': []} May 28 13:01:17 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0667e4bb-7ea7-4904-a9e4-6bb97486e4cb tempest-ShareRulesTest-2015086173 None] >>> [PATCH] https://127.0.0.1:40443/api/viewpolicies/38/ May 28 13:01:17 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0667e4bb-7ea7-4904-a9e4-6bb97486e4cb tempest-ShareRulesTest-2015086173 None] {'data': '{"name": "f7e47502-a0f7-44de-953d-b7b5697ae0b2", "nfs_no_squash": ' May 28 13:01:17 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0667e4bb-7ea7-4904-a9e4-6bb97486e4cb tempest-ShareRulesTest-2015086173 None] '["*"], "nfs_root_squash": ["*"], "nfs_read_write": [], ' May 28 13:01:17 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0667e4bb-7ea7-4904-a9e4-6bb97486e4cb tempest-ShareRulesTest-2015086173 None] '"nfs_read_only": []}', May 28 13:01:17 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0667e4bb-7ea7-4904-a9e4-6bb97486e4cb tempest-ShareRulesTest-2015086173 None] 'params': None} May 28 13:01:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4334bac2-20fe-414a-b845-696262efd52d tempest-SecurityServicesTest-925215740 tempest-SecurityServicesTest-925215740-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '940148b13d07445e8512baadc6d7fa72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd920199a0bc342fd8f081923701e198c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4334bac2-20fe-414a-b845-696262efd52d tempest-SecurityServicesTest-925215740 tempest-SecurityServicesTest-925215740-project-admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4334bac2-20fe-414a-b845-696262efd52d tempest-SecurityServicesTest-925215740 tempest-SecurityServicesTest-925215740-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4334bac2-20fe-414a-b845-696262efd52d tempest-SecurityServicesTest-925215740 tempest-SecurityServicesTest-925215740-project-admin] PATH_INFO: `/v3/domains` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4334bac2-20fe-414a-b845-696262efd52d tempest-SecurityServicesTest-925215740 tempest-SecurityServicesTest-925215740-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=51267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 13:01:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4334bac2-20fe-414a-b845-696262efd52d tempest-SecurityServicesTest-925215740 tempest-SecurityServicesTest-925215740-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4334bac2-20fe-414a-b845-696262efd52d tempest-SecurityServicesTest-925215740 tempest-SecurityServicesTest-925215740-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:17 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1553/3078] 10.27.203.238 () {62 vars in 1241 bytes} [Tue May 28 13:01:17 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 13:01:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088a4c31-2f05-4a81-908a-1db8b45d15c2 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088a4c31-2f05-4a81-908a-1db8b45d15c2 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda9325d-6b73-40fb-9a34-9c61d94ddca1 tempest-SecurityServicesTest-925215740 tempest-SecurityServicesTest-925215740-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '940148b13d07445e8512baadc6d7fa72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd920199a0bc342fd8f081923701e198c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda9325d-6b73-40fb-9a34-9c61d94ddca1 tempest-SecurityServicesTest-925215740 tempest-SecurityServicesTest-925215740-project-admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda9325d-6b73-40fb-9a34-9c61d94ddca1 tempest-SecurityServicesTest-925215740 tempest-SecurityServicesTest-925215740-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda9325d-6b73-40fb-9a34-9c61d94ddca1 tempest-SecurityServicesTest-925215740 tempest-SecurityServicesTest-925215740-project-admin] PATH_INFO: `/v3/users` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda9325d-6b73-40fb-9a34-9c61d94ddca1 tempest-SecurityServicesTest-925215740 tempest-SecurityServicesTest-925215740-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda9325d-6b73-40fb-9a34-9c61d94ddca1 tempest-SecurityServicesTest-925215740 tempest-SecurityServicesTest-925215740-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:17 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-cda9325d-6b73-40fb-9a34-9c61d94ddca1 tempest-SecurityServicesTest-925215740 tempest-SecurityServicesTest-925215740-project-admin] Truncating password to algorithm specific maximum length 72 characters. May 28 13:01:17 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1526/3079] 10.27.203.238 () {64 vars in 1232 bytes} [Tue May 28 13:01:17 2024] POST /identity/v3/users => generated 433 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 13:01:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4334bac2-20fe-414a-b845-696262efd52d tempest-SecurityServicesTest-925215740 tempest-SecurityServicesTest-925215740-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4334bac2-20fe-414a-b845-696262efd52d tempest-SecurityServicesTest-925215740 tempest-SecurityServicesTest-925215740-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbf006d-b480-4fa3-8ccd-103fa62c69c6 tempest-SecurityServicesTest-925215740 tempest-SecurityServicesTest-925215740-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '940148b13d07445e8512baadc6d7fa72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd920199a0bc342fd8f081923701e198c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbf006d-b480-4fa3-8ccd-103fa62c69c6 tempest-SecurityServicesTest-925215740 tempest-SecurityServicesTest-925215740-project-admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbf006d-b480-4fa3-8ccd-103fa62c69c6 tempest-SecurityServicesTest-925215740 tempest-SecurityServicesTest-925215740-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbf006d-b480-4fa3-8ccd-103fa62c69c6 tempest-SecurityServicesTest-925215740 tempest-SecurityServicesTest-925215740-project-admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbf006d-b480-4fa3-8ccd-103fa62c69c6 tempest-SecurityServicesTest-925215740 tempest-SecurityServicesTest-925215740-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbf006d-b480-4fa3-8ccd-103fa62c69c6 tempest-SecurityServicesTest-925215740 tempest-SecurityServicesTest-925215740-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:17 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1554/3080] 10.27.203.238 () {62 vars in 1210 bytes} [Tue May 28 13:01:17 2024] GET /identity/v3/roles => generated 1680 bytes in 16 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 13:01:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda9325d-6b73-40fb-9a34-9c61d94ddca1 tempest-SecurityServicesTest-925215740 tempest-SecurityServicesTest-925215740-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda9325d-6b73-40fb-9a34-9c61d94ddca1 tempest-SecurityServicesTest-925215740 tempest-SecurityServicesTest-925215740-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db35833a-aff5-4f45-a115-c3f9784b17e1 tempest-SecurityServicesTest-925215740 tempest-SecurityServicesTest-925215740-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '940148b13d07445e8512baadc6d7fa72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd920199a0bc342fd8f081923701e198c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db35833a-aff5-4f45-a115-c3f9784b17e1 tempest-SecurityServicesTest-925215740 tempest-SecurityServicesTest-925215740-project-admin] REQUEST_METHOD: `PUT` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db35833a-aff5-4f45-a115-c3f9784b17e1 tempest-SecurityServicesTest-925215740 tempest-SecurityServicesTest-925215740-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db35833a-aff5-4f45-a115-c3f9784b17e1 tempest-SecurityServicesTest-925215740 tempest-SecurityServicesTest-925215740-project-admin] PATH_INFO: `/v3/projects/d920199a0bc342fd8f081923701e198c/users/43487099e439456094fb5cfc0ae825c5/roles/44620cad10ae407c90c91e2c296adb04` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db35833a-aff5-4f45-a115-c3f9784b17e1 tempest-SecurityServicesTest-925215740 tempest-SecurityServicesTest-925215740-project-admin] RBAC: Authorizing `identity:create_grant(project_id=d920199a0bc342fd8f081923701e198c, user_id=43487099e439456094fb5cfc0ae825c5, role_id=44620cad10ae407c90c91e2c296adb04)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db35833a-aff5-4f45-a115-c3f9784b17e1 tempest-SecurityServicesTest-925215740 tempest-SecurityServicesTest-925215740-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:17 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1527/3081] 10.27.203.238 () {64 vars in 1571 bytes} [Tue May 28 13:01:17 2024] PUT /identity/v3/projects/d920199a0bc342fd8f081923701e198c/users/43487099e439456094fb5cfc0ae825c5/roles/44620cad10ae407c90c91e2c296adb04 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:01:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbf006d-b480-4fa3-8ccd-103fa62c69c6 tempest-SecurityServicesTest-925215740 tempest-SecurityServicesTest-925215740-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-5bbf006d-b480-4fa3-8ccd-103fa62c69c6 tempest-SecurityServicesTest-925215740 tempest-SecurityServicesTest-925215740-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:01:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbf006d-b480-4fa3-8ccd-103fa62c69c6 tempest-SecurityServicesTest-925215740 tempest-SecurityServicesTest-925215740-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb16c61-07af-45d4-824e-b1b92b192e6f service manila] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f110cf6300f049c897d0aab63218d1e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb16c61-07af-45d4-824e-b1b92b192e6f service manila] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb16c61-07af-45d4-824e-b1b92b192e6f service manila] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb16c61-07af-45d4-824e-b1b92b192e6f service manila] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb16c61-07af-45d4-824e-b1b92b192e6f service manila] RBAC: Authorizing `identity:validate_token()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:17 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb16c61-07af-45d4-824e-b1b92b192e6f service manila] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:17 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1555/3082] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 13:01:17 2024] GET /identity/v3/auth/tokens => generated 4071 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 13:01:17 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-b983f2ae-547c-4938-9179-5c0b7725b444 tempest-SecurityServicesTest-925215740 tempest-SecurityServicesTest-925215740-project-admin] POST http://10.27.203.238/share/v2/d920199a0bc342fd8f081923701e198c/types May 28 13:01:17 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-b983f2ae-547c-4938-9179-5c0b7725b444 tempest-SecurityServicesTest-925215740 tempest-SecurityServicesTest-925215740-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share_type": {"name": "tempest-typeshare-type-164423049", "extra_specs": {"driver_handles_share_servers": "False"}, "share_type_access:is_public": true}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:01:17 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9242ab9c-98af-4bf4-ab2d-7a757be81a4f tempest-SharesNFSTest-667257547 None] <<< [DELETE] https://127.0.0.1:40443/api/views/48/ May 28 13:01:17 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9242ab9c-98af-4bf4-ab2d-7a757be81a4f tempest-SharesNFSTest-667257547 None] --- [DELETE] https://127.0.0.1:40443/api/views/48/: Done May 28 13:01:17 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9242ab9c-98af-4bf4-ab2d-7a757be81a4f tempest-SharesNFSTest-667257547 None] >>> [GET] https://127.0.0.1:40443/api/quotas/ May 28 13:01:17 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9242ab9c-98af-4bf4-ab2d-7a757be81a4f tempest-SharesNFSTest-667257547 None] {'allow_redirects': True, May 28 13:01:17 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9242ab9c-98af-4bf4-ab2d-7a757be81a4f tempest-SharesNFSTest-667257547 None] 'params': {'name': 'd935f840-e1e2-4366-85e1-9cee599842b6'}} May 28 13:01:17 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-b983f2ae-547c-4938-9179-5c0b7725b444 tempest-SecurityServicesTest-925215740 tempest-SecurityServicesTest-925215740-project-admin] http://10.27.203.238/share/v2/d920199a0bc342fd8f081923701e198c/types returned with HTTP 200 May 28 13:01:17 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1008/2053] 10.27.203.238 () {66 vars in 1359 bytes} [Tue May 28 13:01:17 2024] POST /share/v2/d920199a0bc342fd8f081923701e198c/types => generated 621 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:01:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db35833a-aff5-4f45-a115-c3f9784b17e1 tempest-SecurityServicesTest-925215740 tempest-SecurityServicesTest-925215740-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-db35833a-aff5-4f45-a115-c3f9784b17e1 tempest-SecurityServicesTest-925215740 tempest-SecurityServicesTest-925215740-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:01:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db35833a-aff5-4f45-a115-c3f9784b17e1 tempest-SecurityServicesTest-925215740 tempest-SecurityServicesTest-925215740-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1542409d-b61e-452b-a02c-1ddfe0c6f3d5 service manila] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f110cf6300f049c897d0aab63218d1e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1542409d-b61e-452b-a02c-1ddfe0c6f3d5 service manila] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1542409d-b61e-452b-a02c-1ddfe0c6f3d5 service manila] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1542409d-b61e-452b-a02c-1ddfe0c6f3d5 service manila] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1542409d-b61e-452b-a02c-1ddfe0c6f3d5 service manila] RBAC: Authorizing `identity:validate_token()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:17 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1542409d-b61e-452b-a02c-1ddfe0c6f3d5 service manila] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:17 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1528/3083] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 13:01:17 2024] GET /identity/v3/auth/tokens => generated 3948 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 13:01:17 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-c2e81fa6-d95e-46a2-a06f-598c8aefc4df tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] POST http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services May 28 13:01:17 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-c2e81fa6-d95e-46a2-a06f-598c8aefc4df tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Action: 'create', calling method: SecurityServiceController.create, body: {"security_service": {"type": "ldap", "name": "ss_ldap", "dns_ip": "1.1.1.1", "server": "fake_server_1", "domain": "fake_domain_1", "user": "fake_user", "password": "***", "ou": "}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:01:17 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-c34e22f3-18f6-4d2d-8b07-a1b3e1b45de9 tempest-SharesNFSTest-667257547 tempest-SharesNFSTest-667257547-project-member] GET http://10.27.203.238/share/v2/0af6f8e0aeed4f27b075e08f2bc713aa/shares/7a762332-0877-462f-941a-6581abbf784b May 28 13:01:17 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-c34e22f3-18f6-4d2d-8b07-a1b3e1b45de9 tempest-SharesNFSTest-667257547 tempest-SharesNFSTest-667257547-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:17 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-c34e22f3-18f6-4d2d-8b07-a1b3e1b45de9 tempest-SharesNFSTest-667257547 tempest-SharesNFSTest-667257547-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:17 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-c2e81fa6-d95e-46a2-a06f-598c8aefc4df tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services returned with HTTP 200 May 28 13:01:17 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1046/2054] 10.27.203.238 () {64 vars in 1352 bytes} [Tue May 28 13:01:17 2024] POST /share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services => generated 371 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:01:17 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-57904625-9a25-4091-ac80-066a69c6f0bc tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] POST http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services May 28 13:01:17 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-57904625-9a25-4091-ac80-066a69c6f0bc tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Action: 'create', calling method: SecurityServiceController.create, body: {"security_service": {"type": "kerberos", "name": "ss_kerberos", "dns_ip": "2.2.2.2", "server": "fake_server_2", "domain": "fake_domain_2", "user": "test_user", "password": "***", "ou": "}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:01:17 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-c34e22f3-18f6-4d2d-8b07-a1b3e1b45de9 tempest-SharesNFSTest-667257547 tempest-SharesNFSTest-667257547-project-member] http://10.27.203.238/share/v2/0af6f8e0aeed4f27b075e08f2bc713aa/shares/7a762332-0877-462f-941a-6581abbf784b returned with HTTP 200 May 28 13:01:17 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1009/2055] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:01:17 2024] GET /share/v2/0af6f8e0aeed4f27b075e08f2bc713aa/shares/7a762332-0877-462f-941a-6581abbf784b => generated 1316 bytes in 24 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:01:17 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-57904625-9a25-4091-ac80-066a69c6f0bc tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services returned with HTTP 200 May 28 13:01:17 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1047/2056] 10.27.203.238 () {64 vars in 1352 bytes} [Tue May 28 13:01:17 2024] POST /share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services => generated 379 bytes in 15 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:01:17 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-9b565c28-0e17-462f-af42-3e62934e8dd5 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] POST http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services May 28 13:01:17 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-9b565c28-0e17-462f-af42-3e62934e8dd5 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Action: 'create', calling method: SecurityServiceController.create, body: {"security_service": {"type": "ldap", "name": "tempest-ss-name-810764761", "description": "tempest-ss-desc-1400722624", "dns_ip": "203.0.113.184", "server": "203.0.113.255", "domain": "tempest-ss-domain-466313031", "user": "tempest-ss-user-2105876070", "password": "***"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:01:17 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-9b565c28-0e17-462f-af42-3e62934e8dd5 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services returned with HTTP 200 May 28 13:01:17 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1010/2057] 10.27.203.238 () {64 vars in 1352 bytes} [Tue May 28 13:01:17 2024] POST /share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services => generated 476 bytes in 19 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:01:17 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-0bf521a7-18d6-401d-92f8-f24438f36eba tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] DELETE http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/d8d65f17-f0c0-438e-b4b4-5dfa58eadacd May 28 13:01:17 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-0bf521a7-18d6-401d-92f8-f24438f36eba tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:17 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-0bf521a7-18d6-401d-92f8-f24438f36eba tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Calling method 'SecurityServiceController.delete' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:17 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.v1.security_service [None req-0bf521a7-18d6-401d-92f8-f24438f36eba tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Delete security service with id: d8d65f17-f0c0-438e-b4b4-5dfa58eadacd May 28 13:01:17 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-0bf521a7-18d6-401d-92f8-f24438f36eba tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/d8d65f17-f0c0-438e-b4b4-5dfa58eadacd returned with HTTP 202 May 28 13:01:17 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1048/2058] 10.27.203.238 () {62 vars in 1444 bytes} [Tue May 28 13:01:17 2024] DELETE /share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/d8d65f17-f0c0-438e-b4b4-5dfa58eadacd => generated 0 bytes in 23 msecs (HTTP/1.1 202) 6 headers in 242 bytes (1 switches on core 0) May 28 13:01:17 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-90e5fbc6-7940-46ad-83f0-8b227e81506e tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] POST http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services May 28 13:01:17 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-90e5fbc6-7940-46ad-83f0-8b227e81506e tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Action: 'create', calling method: SecurityServiceController.create, body: {"security_service": {"type": "kerberos", "name": "tempest-ss-name-810764761", "description": "tempest-ss-desc-1400722624", "dns_ip": "203.0.113.184", "server": "203.0.113.255", "domain": "tempest-ss-domain-466313031", "user": "tempest-ss-user-2105876070", "password": "***"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:01:17 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-90e5fbc6-7940-46ad-83f0-8b227e81506e tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services returned with HTTP 200 May 28 13:01:17 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1011/2059] 10.27.203.238 () {64 vars in 1352 bytes} [Tue May 28 13:01:17 2024] POST /share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services => generated 480 bytes in 18 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:01:17 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-40d764cf-1096-4c41-8107-90d844878e3d tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] DELETE http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/2f711211-b75e-4632-83ea-80ebf3825421 May 28 13:01:17 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-40d764cf-1096-4c41-8107-90d844878e3d tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:17 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-40d764cf-1096-4c41-8107-90d844878e3d tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Calling method 'SecurityServiceController.delete' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:17 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.v1.security_service [None req-40d764cf-1096-4c41-8107-90d844878e3d tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Delete security service with id: 2f711211-b75e-4632-83ea-80ebf3825421 May 28 13:01:17 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-40d764cf-1096-4c41-8107-90d844878e3d tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/2f711211-b75e-4632-83ea-80ebf3825421 returned with HTTP 202 May 28 13:01:17 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1049/2060] 10.27.203.238 () {62 vars in 1444 bytes} [Tue May 28 13:01:17 2024] DELETE /share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/2f711211-b75e-4632-83ea-80ebf3825421 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 6 headers in 242 bytes (1 switches on core 0) May 28 13:01:17 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-ea87dd9a-e56b-4b99-b305-3dcdb575ca7e tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] POST http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services May 28 13:01:17 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-ea87dd9a-e56b-4b99-b305-3dcdb575ca7e tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Action: 'create', calling method: SecurityServiceController.create, body: {"security_service": {"type": "active_directory", "name": "tempest-ss-name-810764761", "description": "tempest-ss-desc-1400722624", "dns_ip": "203.0.113.184", "server": "203.0.113.255", "domain": "tempest-ss-domain-466313031", "user": "tempest-ss-user-2105876070", "password": "***"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:01:17 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-ea87dd9a-e56b-4b99-b305-3dcdb575ca7e tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services returned with HTTP 200 May 28 13:01:17 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1012/2061] 10.27.203.238 () {64 vars in 1352 bytes} [Tue May 28 13:01:17 2024] POST /share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services => generated 488 bytes in 15 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:01:17 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-47b15034-31bd-4876-8c96-90c60d15324c tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] DELETE http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/b5c77b4d-337e-4b2b-b887-c8e5f1df1076 May 28 13:01:17 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-47b15034-31bd-4876-8c96-90c60d15324c tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:17 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-47b15034-31bd-4876-8c96-90c60d15324c tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Calling method 'SecurityServiceController.delete' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:17 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.v1.security_service [None req-47b15034-31bd-4876-8c96-90c60d15324c tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Delete security service with id: b5c77b4d-337e-4b2b-b887-c8e5f1df1076 May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-47b15034-31bd-4876-8c96-90c60d15324c tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/b5c77b4d-337e-4b2b-b887-c8e5f1df1076 returned with HTTP 202 May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1050/2062] 10.27.203.238 () {62 vars in 1444 bytes} [Tue May 28 13:01:17 2024] DELETE /share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/b5c77b4d-337e-4b2b-b887-c8e5f1df1076 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 6 headers in 242 bytes (1 switches on core 0) May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-c9d42f2c-152e-4d2c-a2ce-a6201d9045e1 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] DELETE http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/b5c77b4d-337e-4b2b-b887-c8e5f1df1076 May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-c9d42f2c-152e-4d2c-a2ce-a6201d9045e1 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-c9d42f2c-152e-4d2c-a2ce-a6201d9045e1 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Calling method 'SecurityServiceController.delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.v1.security_service [None req-c9d42f2c-152e-4d2c-a2ce-a6201d9045e1 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Delete security service with id: b5c77b4d-337e-4b2b-b887-c8e5f1df1076 May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-c9d42f2c-152e-4d2c-a2ce-a6201d9045e1 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] HTTP exception thrown: The resource could not be found. May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-c9d42f2c-152e-4d2c-a2ce-a6201d9045e1 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/b5c77b4d-337e-4b2b-b887-c8e5f1df1076 returned with HTTP 404 May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1013/2063] 10.27.203.238 () {62 vars in 1444 bytes} [Tue May 28 13:01:18 2024] DELETE /share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/b5c77b4d-337e-4b2b-b887-c8e5f1df1076 => generated 78 bytes in 9 msecs (HTTP/1.1 404) 6 headers in 236 bytes (1 switches on core 0) May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-0d71c7bf-fb6f-4a44-b596-26a82b98b7b2 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] DELETE http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/2f711211-b75e-4632-83ea-80ebf3825421 May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-0d71c7bf-fb6f-4a44-b596-26a82b98b7b2 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-0d71c7bf-fb6f-4a44-b596-26a82b98b7b2 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Calling method 'SecurityServiceController.delete' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.v1.security_service [None req-0d71c7bf-fb6f-4a44-b596-26a82b98b7b2 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Delete security service with id: 2f711211-b75e-4632-83ea-80ebf3825421 May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-0d71c7bf-fb6f-4a44-b596-26a82b98b7b2 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] HTTP exception thrown: The resource could not be found. May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-0d71c7bf-fb6f-4a44-b596-26a82b98b7b2 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/2f711211-b75e-4632-83ea-80ebf3825421 returned with HTTP 404 May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1051/2064] 10.27.203.238 () {62 vars in 1444 bytes} [Tue May 28 13:01:18 2024] DELETE /share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/2f711211-b75e-4632-83ea-80ebf3825421 => generated 78 bytes in 7 msecs (HTTP/1.1 404) 6 headers in 236 bytes (1 switches on core 0) May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-b03bdc2c-f34c-4106-b6a4-723082cf325d tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] DELETE http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/d8d65f17-f0c0-438e-b4b4-5dfa58eadacd May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-b03bdc2c-f34c-4106-b6a4-723082cf325d tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-b03bdc2c-f34c-4106-b6a4-723082cf325d tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Calling method 'SecurityServiceController.delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.v1.security_service [None req-b03bdc2c-f34c-4106-b6a4-723082cf325d tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Delete security service with id: d8d65f17-f0c0-438e-b4b4-5dfa58eadacd May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-b03bdc2c-f34c-4106-b6a4-723082cf325d tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] HTTP exception thrown: The resource could not be found. May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-b03bdc2c-f34c-4106-b6a4-723082cf325d tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/d8d65f17-f0c0-438e-b4b4-5dfa58eadacd returned with HTTP 404 May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1014/2065] 10.27.203.238 () {62 vars in 1444 bytes} [Tue May 28 13:01:18 2024] DELETE /share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/d8d65f17-f0c0-438e-b4b4-5dfa58eadacd => generated 78 bytes in 8 msecs (HTTP/1.1 404) 6 headers in 236 bytes (1 switches on core 0) May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-bf4343a0-fb81-483f-8adc-ddc3d55e0d73 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] DELETE http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/f3b7048c-983e-4e9d-a06e-80d341c7c2b3 May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-bf4343a0-fb81-483f-8adc-ddc3d55e0d73 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-bf4343a0-fb81-483f-8adc-ddc3d55e0d73 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Calling method 'SecurityServiceController.delete' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.v1.security_service [None req-bf4343a0-fb81-483f-8adc-ddc3d55e0d73 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Delete security service with id: f3b7048c-983e-4e9d-a06e-80d341c7c2b3 May 28 13:01:18 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9242ab9c-98af-4bf4-ab2d-7a757be81a4f tempest-SharesNFSTest-667257547 None] <<< [GET] https://127.0.0.1:40443/api/quotas/ May 28 13:01:18 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9242ab9c-98af-4bf4-ab2d-7a757be81a4f tempest-SharesNFSTest-667257547 None] [Bunch(cluster='loop75-kfs', cluster_id=1, default_email=None, default_group_quota=None, default_user_quota=None, enable_alarms=True, enable_email_providers=True, grace_period=None, guid='ca6b8fa3-9f51-4d09-873e-7c7703e6d8cc', hard_limit=1073741824, hard_limit_inodes=None, id=46, internal=False, is_user_quota=False, last_user_quotas_update=None, name='d935f840-e1e2-4366-85e1-9cee599842b6', num_blocked_users=0, num_exceeded_users=0, path='/manila/manila-d935f840-e1e2-4366-85e1-9cee599842b6', percent_capacity=0, percent_inodes=None, pretty_grace_period=None, pretty_grace_period_expiration=None, pretty_state='OK (Calculating)', soft_limit=None, soft_limit_inodes=None, state='OK', sync_state='Calculating', system_id=46, tenant_id=1, tenant_name='default', time_to_block=None, title='d935f840-e1e2-4366-85e1-9cee599842b6', url='https://127.0.0.1:40443/api/quotas/46/', used_capacity=0, used_capacity_tb=0.0, used_effective_capacity=0, used_effective_capacity_tb=0.0, used_inodes=0, used_limited_capacity=0)] May 28 13:01:18 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9242ab9c-98af-4bf4-ab2d-7a757be81a4f tempest-SharesNFSTest-667257547 None] --- [GET] https://127.0.0.1:40443/api/quotas/: Done May 28 13:01:18 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9242ab9c-98af-4bf4-ab2d-7a757be81a4f tempest-SharesNFSTest-667257547 None] >>> [DELETE] https://127.0.0.1:40443/api/quotas/46/ May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-bf4343a0-fb81-483f-8adc-ddc3d55e0d73 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/f3b7048c-983e-4e9d-a06e-80d341c7c2b3 returned with HTTP 202 May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1052/2066] 10.27.203.238 () {62 vars in 1444 bytes} [Tue May 28 13:01:18 2024] DELETE /share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/f3b7048c-983e-4e9d-a06e-80d341c7c2b3 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 6 headers in 242 bytes (1 switches on core 0) May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-1c64003d-d27c-4fff-8504-98e700e0620c tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] GET http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/f3b7048c-983e-4e9d-a06e-80d341c7c2b3 May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-1c64003d-d27c-4fff-8504-98e700e0620c tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-1c64003d-d27c-4fff-8504-98e700e0620c tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Calling method 'SecurityServiceController.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-1c64003d-d27c-4fff-8504-98e700e0620c tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] HTTP exception thrown: The resource could not be found. May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-1c64003d-d27c-4fff-8504-98e700e0620c tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/f3b7048c-983e-4e9d-a06e-80d341c7c2b3 returned with HTTP 404 May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1015/2067] 10.27.203.238 () {62 vars in 1441 bytes} [Tue May 28 13:01:18 2024] GET /share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/f3b7048c-983e-4e9d-a06e-80d341c7c2b3 => generated 78 bytes in 10 msecs (HTTP/1.1 404) 6 headers in 236 bytes (1 switches on core 0) May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-f5c8686c-4ee9-4b50-b47b-e3c3ad5f4094 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] DELETE http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/43892c8b-f2f3-4939-857b-fe426e6ed48e May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-f5c8686c-4ee9-4b50-b47b-e3c3ad5f4094 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-f5c8686c-4ee9-4b50-b47b-e3c3ad5f4094 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Calling method 'SecurityServiceController.delete' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.v1.security_service [None req-f5c8686c-4ee9-4b50-b47b-e3c3ad5f4094 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Delete security service with id: 43892c8b-f2f3-4939-857b-fe426e6ed48e May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-f5c8686c-4ee9-4b50-b47b-e3c3ad5f4094 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/43892c8b-f2f3-4939-857b-fe426e6ed48e returned with HTTP 202 May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1053/2068] 10.27.203.238 () {62 vars in 1444 bytes} [Tue May 28 13:01:18 2024] DELETE /share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/43892c8b-f2f3-4939-857b-fe426e6ed48e => generated 0 bytes in 30 msecs (HTTP/1.1 202) 6 headers in 242 bytes (1 switches on core 0) May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-93727ecf-1c79-49f8-940d-968cf37eb82d tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] GET http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/43892c8b-f2f3-4939-857b-fe426e6ed48e May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-93727ecf-1c79-49f8-940d-968cf37eb82d tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-93727ecf-1c79-49f8-940d-968cf37eb82d tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Calling method 'SecurityServiceController.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-93727ecf-1c79-49f8-940d-968cf37eb82d tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] HTTP exception thrown: The resource could not be found. May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-93727ecf-1c79-49f8-940d-968cf37eb82d tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/43892c8b-f2f3-4939-857b-fe426e6ed48e returned with HTTP 404 May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1016/2069] 10.27.203.238 () {62 vars in 1441 bytes} [Tue May 28 13:01:18 2024] GET /share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/43892c8b-f2f3-4939-857b-fe426e6ed48e => generated 78 bytes in 9 msecs (HTTP/1.1 404) 6 headers in 236 bytes (1 switches on core 0) May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-69c2c317-bba5-4387-a8f8-e497184805c0 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] POST http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-69c2c317-bba5-4387-a8f8-e497184805c0 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Action: 'create', calling method: SecurityServiceController.create, body: {"security_service": {"type": "ldap", "name": "ss_ldap", "dns_ip": "1.1.1.1", "server": "fake_server_1", "domain": "fake_domain_1", "user": "fake_user", "password": "***", "ou": "}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-69c2c317-bba5-4387-a8f8-e497184805c0 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services returned with HTTP 200 May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1054/2070] 10.27.203.238 () {64 vars in 1352 bytes} [Tue May 28 13:01:18 2024] POST /share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services => generated 371 bytes in 15 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-3c49a4e9-d1fc-43dd-96bc-037a346786ff tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] POST http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-3c49a4e9-d1fc-43dd-96bc-037a346786ff tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Action: 'create', calling method: SecurityServiceController.create, body: {"security_service": {"type": "kerberos", "name": "ss_kerberos", "dns_ip": "2.2.2.2", "server": "fake_server_2", "domain": "fake_domain_2", "user": "test_user", "password": "***", "ou": "}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-3c49a4e9-d1fc-43dd-96bc-037a346786ff tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services returned with HTTP 200 May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1017/2071] 10.27.203.238 () {64 vars in 1352 bytes} [Tue May 28 13:01:18 2024] POST /share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services => generated 379 bytes in 16 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-59820441-96a3-439d-8d65-2ef7ad87520a tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] DELETE http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/f9d91bec-c9b3-48a1-b27c-0af09105a21f May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-59820441-96a3-439d-8d65-2ef7ad87520a tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-59820441-96a3-439d-8d65-2ef7ad87520a tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Calling method 'SecurityServiceController.delete' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.v1.security_service [None req-59820441-96a3-439d-8d65-2ef7ad87520a tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Delete security service with id: f9d91bec-c9b3-48a1-b27c-0af09105a21f May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-59820441-96a3-439d-8d65-2ef7ad87520a tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/f9d91bec-c9b3-48a1-b27c-0af09105a21f returned with HTTP 202 May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1055/2072] 10.27.203.238 () {62 vars in 1444 bytes} [Tue May 28 13:01:18 2024] DELETE /share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/f9d91bec-c9b3-48a1-b27c-0af09105a21f => generated 0 bytes in 25 msecs (HTTP/1.1 202) 6 headers in 242 bytes (1 switches on core 0) May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-e2f6b34b-5167-40a2-9e88-5a769cd06507 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] GET http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/f9d91bec-c9b3-48a1-b27c-0af09105a21f May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-e2f6b34b-5167-40a2-9e88-5a769cd06507 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-e2f6b34b-5167-40a2-9e88-5a769cd06507 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Calling method 'SecurityServiceController.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-e2f6b34b-5167-40a2-9e88-5a769cd06507 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] HTTP exception thrown: The resource could not be found. May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-e2f6b34b-5167-40a2-9e88-5a769cd06507 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/f9d91bec-c9b3-48a1-b27c-0af09105a21f returned with HTTP 404 May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1018/2073] 10.27.203.238 () {62 vars in 1441 bytes} [Tue May 28 13:01:18 2024] GET /share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/f9d91bec-c9b3-48a1-b27c-0af09105a21f => generated 78 bytes in 8 msecs (HTTP/1.1 404) 6 headers in 236 bytes (1 switches on core 0) May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-2399a3e5-02f2-43b0-94d5-3f125c973677 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] DELETE http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/cc449d32-e3c6-4985-a5ba-e1e3ad995fe7 May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-2399a3e5-02f2-43b0-94d5-3f125c973677 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-2399a3e5-02f2-43b0-94d5-3f125c973677 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Calling method 'SecurityServiceController.delete' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.v1.security_service [None req-2399a3e5-02f2-43b0-94d5-3f125c973677 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Delete security service with id: cc449d32-e3c6-4985-a5ba-e1e3ad995fe7 May 28 13:01:18 l75lg1-v1 dstat.sh[49771]: 28-05 13:01:18| 9 2 85 4 0|5699M 1741M 278M 7905M| 17k 10k| 0 3752k| 0 362 |8003 13k|1.51 1.23 1.08|1.0 1.0 2.0| 0 0 | 0 2048M| 29 364 0 37 2 May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-2399a3e5-02f2-43b0-94d5-3f125c973677 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/cc449d32-e3c6-4985-a5ba-e1e3ad995fe7 returned with HTTP 202 May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1056/2074] 10.27.203.238 () {62 vars in 1444 bytes} [Tue May 28 13:01:18 2024] DELETE /share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/cc449d32-e3c6-4985-a5ba-e1e3ad995fe7 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 6 headers in 242 bytes (1 switches on core 0) May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-3cabfd5a-306b-447e-bdf4-9f272f3cb613 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] GET http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/cc449d32-e3c6-4985-a5ba-e1e3ad995fe7 May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-3cabfd5a-306b-447e-bdf4-9f272f3cb613 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-3cabfd5a-306b-447e-bdf4-9f272f3cb613 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Calling method 'SecurityServiceController.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-3cabfd5a-306b-447e-bdf4-9f272f3cb613 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] HTTP exception thrown: The resource could not be found. May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-3cabfd5a-306b-447e-bdf4-9f272f3cb613 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/cc449d32-e3c6-4985-a5ba-e1e3ad995fe7 returned with HTTP 404 May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1019/2075] 10.27.203.238 () {62 vars in 1441 bytes} [Tue May 28 13:01:18 2024] GET /share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/cc449d32-e3c6-4985-a5ba-e1e3ad995fe7 => generated 78 bytes in 9 msecs (HTTP/1.1 404) 6 headers in 236 bytes (1 switches on core 0) May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-b40a2aa5-26ce-48b1-89c7-b522ece025f7 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] POST http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-b40a2aa5-26ce-48b1-89c7-b522ece025f7 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Action: 'create', calling method: SecurityServiceController.create, body: {"security_service": {"type": "ldap", "name": "ss_ldap", "dns_ip": "1.1.1.1", "server": "fake_server_1", "domain": "fake_domain_1", "user": "fake_user", "password": "***", "ou": "}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-b40a2aa5-26ce-48b1-89c7-b522ece025f7 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services returned with HTTP 200 May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1057/2076] 10.27.203.238 () {64 vars in 1352 bytes} [Tue May 28 13:01:18 2024] POST /share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services => generated 371 bytes in 31 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-8529a106-44e2-4611-8c38-06300579f082 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] POST http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-8529a106-44e2-4611-8c38-06300579f082 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Action: 'create', calling method: SecurityServiceController.create, body: {"security_service": {"type": "kerberos", "name": "ss_kerberos", "dns_ip": "2.2.2.2", "server": "fake_server_2", "domain": "fake_domain_2", "user": "test_user", "password": "***", "ou": "}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-8529a106-44e2-4611-8c38-06300579f082 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services returned with HTTP 200 May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1020/2077] 10.27.203.238 () {64 vars in 1352 bytes} [Tue May 28 13:01:18 2024] POST /share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services => generated 379 bytes in 24 msecs (HTTP/1.1 200) 6 headers in 230 bytes (2 switches on core 0) May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-cf0df19a-ec8e-4457-bca9-1772aa252a35 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] POST http://10.27.203.238/share/v2/f7d59a5c883f4f699e4078430c78ad8d/security-services May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-cf0df19a-ec8e-4457-bca9-1772aa252a35 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Action: 'create', calling method: SecurityServiceController.create, body: {"security_service": {"type": "ldap", "name": "tempest-ss-name-1906724802", "description": "tempest-ss-desc-1950193518", "dns_ip": "203.0.113.156", "server": "203.0.113.173", "domain": "tempest-ss-domain-16629396", "user": "tempest-ss-user-1312370528", "password": "***"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-cf0df19a-ec8e-4457-bca9-1772aa252a35 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] http://10.27.203.238/share/v2/f7d59a5c883f4f699e4078430c78ad8d/security-services returned with HTTP 200 May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1058/2078] 10.27.203.238 () {66 vars in 1395 bytes} [Tue May 28 13:01:18 2024] POST /share/v2/f7d59a5c883f4f699e4078430c78ad8d/security-services => generated 476 bytes in 20 msecs (HTTP/1.1 200) 6 headers in 231 bytes (2 switches on core 0) May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-c61f24e5-bf1e-43fb-ac4d-813ac8e6b69a tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] GET http://10.27.203.238/share/v2/f7d59a5c883f4f699e4078430c78ad8d/security-services/6a96a9aa-e60f-4077-ac44-051f3670a569 May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-c61f24e5-bf1e-43fb-ac4d-813ac8e6b69a tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-c61f24e5-bf1e-43fb-ac4d-813ac8e6b69a tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Calling method 'SecurityServiceController.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-c61f24e5-bf1e-43fb-ac4d-813ac8e6b69a tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] http://10.27.203.238/share/v2/f7d59a5c883f4f699e4078430c78ad8d/security-services/6a96a9aa-e60f-4077-ac44-051f3670a569 returned with HTTP 200 May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1021/2079] 10.27.203.238 () {64 vars in 1484 bytes} [Tue May 28 13:01:18 2024] GET /share/v2/f7d59a5c883f4f699e4078430c78ad8d/security-services/6a96a9aa-e60f-4077-ac44-051f3670a569 => generated 476 bytes in 10 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-96026eda-e197-4e36-afaa-741bcb38f046 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] DELETE http://10.27.203.238/share/v2/f7d59a5c883f4f699e4078430c78ad8d/security-services/6a96a9aa-e60f-4077-ac44-051f3670a569 May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-96026eda-e197-4e36-afaa-741bcb38f046 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-96026eda-e197-4e36-afaa-741bcb38f046 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Calling method 'SecurityServiceController.delete' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.v1.security_service [None req-96026eda-e197-4e36-afaa-741bcb38f046 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Delete security service with id: 6a96a9aa-e60f-4077-ac44-051f3670a569 May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-96026eda-e197-4e36-afaa-741bcb38f046 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] http://10.27.203.238/share/v2/f7d59a5c883f4f699e4078430c78ad8d/security-services/6a96a9aa-e60f-4077-ac44-051f3670a569 returned with HTTP 202 May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1059/2080] 10.27.203.238 () {64 vars in 1487 bytes} [Tue May 28 13:01:18 2024] DELETE /share/v2/f7d59a5c883f4f699e4078430c78ad8d/security-services/6a96a9aa-e60f-4077-ac44-051f3670a569 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-52716baf-cda0-409f-bc2a-fc2690bd91d2 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] GET http://10.27.203.238/share/v2/f7d59a5c883f4f699e4078430c78ad8d/security-services/6a96a9aa-e60f-4077-ac44-051f3670a569 May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-52716baf-cda0-409f-bc2a-fc2690bd91d2 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-52716baf-cda0-409f-bc2a-fc2690bd91d2 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Calling method 'SecurityServiceController.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-52716baf-cda0-409f-bc2a-fc2690bd91d2 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] HTTP exception thrown: The resource could not be found. May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-52716baf-cda0-409f-bc2a-fc2690bd91d2 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] http://10.27.203.238/share/v2/f7d59a5c883f4f699e4078430c78ad8d/security-services/6a96a9aa-e60f-4077-ac44-051f3670a569 returned with HTTP 404 May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1022/2081] 10.27.203.238 () {64 vars in 1484 bytes} [Tue May 28 13:01:18 2024] GET /share/v2/f7d59a5c883f4f699e4078430c78ad8d/security-services/6a96a9aa-e60f-4077-ac44-051f3670a569 => generated 78 bytes in 8 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-3a1d4c25-b862-4e28-9047-39fe325b2431 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] DELETE http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/94a9dbda-db4f-4dc5-8713-8f4ddccf8e3f May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-3a1d4c25-b862-4e28-9047-39fe325b2431 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-3a1d4c25-b862-4e28-9047-39fe325b2431 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Calling method 'SecurityServiceController.delete' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.v1.security_service [None req-3a1d4c25-b862-4e28-9047-39fe325b2431 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Delete security service with id: 94a9dbda-db4f-4dc5-8713-8f4ddccf8e3f May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-3a1d4c25-b862-4e28-9047-39fe325b2431 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/94a9dbda-db4f-4dc5-8713-8f4ddccf8e3f returned with HTTP 202 May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1060/2082] 10.27.203.238 () {62 vars in 1444 bytes} [Tue May 28 13:01:18 2024] DELETE /share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/94a9dbda-db4f-4dc5-8713-8f4ddccf8e3f => generated 0 bytes in 24 msecs (HTTP/1.1 202) 6 headers in 242 bytes (1 switches on core 0) May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-d18014fc-2b49-4c4b-a345-3ee5fdbaa419 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] GET http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/94a9dbda-db4f-4dc5-8713-8f4ddccf8e3f May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-d18014fc-2b49-4c4b-a345-3ee5fdbaa419 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-d18014fc-2b49-4c4b-a345-3ee5fdbaa419 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Calling method 'SecurityServiceController.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-d18014fc-2b49-4c4b-a345-3ee5fdbaa419 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] HTTP exception thrown: The resource could not be found. May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-d18014fc-2b49-4c4b-a345-3ee5fdbaa419 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/94a9dbda-db4f-4dc5-8713-8f4ddccf8e3f returned with HTTP 404 May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1023/2083] 10.27.203.238 () {62 vars in 1441 bytes} [Tue May 28 13:01:18 2024] GET /share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/94a9dbda-db4f-4dc5-8713-8f4ddccf8e3f => generated 78 bytes in 8 msecs (HTTP/1.1 404) 6 headers in 236 bytes (1 switches on core 0) May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-5d399370-2f47-43de-bea7-b9f64455904d tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] DELETE http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/28eb8f18-4376-4e83-9f73-cd0214e79aa7 May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-5d399370-2f47-43de-bea7-b9f64455904d tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-5d399370-2f47-43de-bea7-b9f64455904d tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Calling method 'SecurityServiceController.delete' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.v1.security_service [None req-5d399370-2f47-43de-bea7-b9f64455904d tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Delete security service with id: 28eb8f18-4376-4e83-9f73-cd0214e79aa7 May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-5d399370-2f47-43de-bea7-b9f64455904d tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/28eb8f18-4376-4e83-9f73-cd0214e79aa7 returned with HTTP 202 May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1061/2084] 10.27.203.238 () {62 vars in 1444 bytes} [Tue May 28 13:01:18 2024] DELETE /share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/28eb8f18-4376-4e83-9f73-cd0214e79aa7 => generated 0 bytes in 21 msecs (HTTP/1.1 202) 6 headers in 242 bytes (1 switches on core 0) May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-4bc41635-12ed-4445-aee3-ed819750d497 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] GET http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/28eb8f18-4376-4e83-9f73-cd0214e79aa7 May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-4bc41635-12ed-4445-aee3-ed819750d497 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-4bc41635-12ed-4445-aee3-ed819750d497 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Calling method 'SecurityServiceController.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-4bc41635-12ed-4445-aee3-ed819750d497 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] HTTP exception thrown: The resource could not be found. May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-4bc41635-12ed-4445-aee3-ed819750d497 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/28eb8f18-4376-4e83-9f73-cd0214e79aa7 returned with HTTP 404 May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1024/2085] 10.27.203.238 () {62 vars in 1441 bytes} [Tue May 28 13:01:18 2024] GET /share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/28eb8f18-4376-4e83-9f73-cd0214e79aa7 => generated 78 bytes in 11 msecs (HTTP/1.1 404) 6 headers in 236 bytes (1 switches on core 0) May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-647e2546-cb16-458e-b4ff-a92b7ed2f3f6 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] POST http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-647e2546-cb16-458e-b4ff-a92b7ed2f3f6 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Action: 'create', calling method: SecurityServiceController.create, body: {"security_service": {"type": "ldap", "name": "ss_ldap", "dns_ip": "1.1.1.1", "server": "fake_server_1", "domain": "fake_domain_1", "user": "fake_user", "password": "***", "ou": "}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-647e2546-cb16-458e-b4ff-a92b7ed2f3f6 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services returned with HTTP 200 May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1062/2086] 10.27.203.238 () {64 vars in 1352 bytes} [Tue May 28 13:01:18 2024] POST /share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services => generated 371 bytes in 20 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-85098743-d95d-496a-911e-0bc18eeb5a13 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] POST http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-85098743-d95d-496a-911e-0bc18eeb5a13 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Action: 'create', calling method: SecurityServiceController.create, body: {"security_service": {"type": "kerberos", "name": "ss_kerberos", "dns_ip": "2.2.2.2", "server": "fake_server_2", "domain": "fake_domain_2", "user": "test_user", "password": "***", "ou": "}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-85098743-d95d-496a-911e-0bc18eeb5a13 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services returned with HTTP 200 May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1025/2087] 10.27.203.238 () {64 vars in 1352 bytes} [Tue May 28 13:01:18 2024] POST /share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services => generated 379 bytes in 17 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-25fc2f90-2efc-40ba-b906-399bd4b3198e tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] POST http://10.27.203.238/share/v2/f7d59a5c883f4f699e4078430c78ad8d/security-services May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-25fc2f90-2efc-40ba-b906-399bd4b3198e tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Action: 'create', calling method: SecurityServiceController.create, body: {"security_service": {"type": "ldap", "name": "tempest-ss-name-945673241", "description": "tempest-ss-desc-1645367394", "dns_ip": "203.0.113.63", "server": "203.0.113.15", "domain": "tempest-ss-domain-1861299312", "user": "tempest-ss-user-1233674777", "password": "***", "ou": "}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-25fc2f90-2efc-40ba-b906-399bd4b3198e tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] http://10.27.203.238/share/v2/f7d59a5c883f4f699e4078430c78ad8d/security-services returned with HTTP 200 May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1063/2088] 10.27.203.238 () {66 vars in 1395 bytes} [Tue May 28 13:01:18 2024] POST /share/v2/f7d59a5c883f4f699e4078430c78ad8d/security-services => generated 507 bytes in 19 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-a022b704-787a-4dbd-8e8c-0f86d6e7456c tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] GET http://10.27.203.238/share/v2/f7d59a5c883f4f699e4078430c78ad8d/security-services/a0c43900-8b3d-471d-9023-d64a6d566a9e May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-a022b704-787a-4dbd-8e8c-0f86d6e7456c tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-a022b704-787a-4dbd-8e8c-0f86d6e7456c tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Calling method 'SecurityServiceController.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-a022b704-787a-4dbd-8e8c-0f86d6e7456c tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] http://10.27.203.238/share/v2/f7d59a5c883f4f699e4078430c78ad8d/security-services/a0c43900-8b3d-471d-9023-d64a6d566a9e returned with HTTP 200 May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1026/2089] 10.27.203.238 () {64 vars in 1484 bytes} [Tue May 28 13:01:18 2024] GET /share/v2/f7d59a5c883f4f699e4078430c78ad8d/security-services/a0c43900-8b3d-471d-9023-d64a6d566a9e => generated 507 bytes in 9 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-160d4f12-5b6e-410e-bb25-3ee98683ec3b tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] GET http://10.27.203.238/share/v2/284d76edec3144579d6fb3f6dbc0dd4e/share-groups/b9df9a2d-571e-4658-a435-c01428312fc4 May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-160d4f12-5b6e-410e-bb25-3ee98683ec3b tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-160d4f12-5b6e-410e-bb25-3ee98683ec3b tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-9264b9d8-0bd1-4f89-916c-ac11fd42f3b3 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] DELETE http://10.27.203.238/share/v2/f7d59a5c883f4f699e4078430c78ad8d/security-services/a0c43900-8b3d-471d-9023-d64a6d566a9e May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-9264b9d8-0bd1-4f89-916c-ac11fd42f3b3 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-9264b9d8-0bd1-4f89-916c-ac11fd42f3b3 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Calling method 'SecurityServiceController.delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.v1.security_service [None req-9264b9d8-0bd1-4f89-916c-ac11fd42f3b3 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Delete security service with id: a0c43900-8b3d-471d-9023-d64a6d566a9e May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-160d4f12-5b6e-410e-bb25-3ee98683ec3b tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] http://10.27.203.238/share/v2/284d76edec3144579d6fb3f6dbc0dd4e/share-groups/b9df9a2d-571e-4658-a435-c01428312fc4 returned with HTTP 200 May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1064/2090] 10.27.203.238 () {64 vars in 1469 bytes} [Tue May 28 13:01:18 2024] GET /share/v2/284d76edec3144579d6fb3f6dbc0dd4e/share-groups/b9df9a2d-571e-4658-a435-c01428312fc4 => generated 792 bytes in 13 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-1a0d33d9-b0af-48aa-8d6d-ac436b00c3bb tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] GET http://10.27.203.238/share/v2/284d76edec3144579d6fb3f6dbc0dd4e/share-groups/b9df9a2d-571e-4658-a435-c01428312fc4 May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-1a0d33d9-b0af-48aa-8d6d-ac436b00c3bb tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-1a0d33d9-b0af-48aa-8d6d-ac436b00c3bb tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-1a0d33d9-b0af-48aa-8d6d-ac436b00c3bb tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] http://10.27.203.238/share/v2/284d76edec3144579d6fb3f6dbc0dd4e/share-groups/b9df9a2d-571e-4658-a435-c01428312fc4 returned with HTTP 200 May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1065/2091] 10.27.203.238 () {64 vars in 1469 bytes} [Tue May 28 13:01:18 2024] GET /share/v2/284d76edec3144579d6fb3f6dbc0dd4e/share-groups/b9df9a2d-571e-4658-a435-c01428312fc4 => generated 792 bytes in 11 msecs (HTTP/1.1 200) 6 headers in 231 bytes (2 switches on core 0) May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-9264b9d8-0bd1-4f89-916c-ac11fd42f3b3 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] http://10.27.203.238/share/v2/f7d59a5c883f4f699e4078430c78ad8d/security-services/a0c43900-8b3d-471d-9023-d64a6d566a9e returned with HTTP 202 May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1027/2092] 10.27.203.238 () {64 vars in 1487 bytes} [Tue May 28 13:01:18 2024] DELETE /share/v2/f7d59a5c883f4f699e4078430c78ad8d/security-services/a0c43900-8b3d-471d-9023-d64a6d566a9e => generated 0 bytes in 26 msecs (HTTP/1.1 202) 6 headers in 243 bytes (2 switches on core 0) May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-13e93b32-a6fa-4702-954d-94f998ca60c3 tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] DELETE http://10.27.203.238/share/v2/284d76edec3144579d6fb3f6dbc0dd4e/share-groups/b9df9a2d-571e-4658-a435-c01428312fc4 May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-13e93b32-a6fa-4702-954d-94f998ca60c3 tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-13e93b32-a6fa-4702-954d-94f998ca60c3 tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.v2.share_groups [None req-13e93b32-a6fa-4702-954d-94f998ca60c3 tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] Delete share group with id: b9df9a2d-571e-4658-a435-c01428312fc4 May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-fd1190ab-6f8a-41f9-bd63-4e5affa6af11 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] GET http://10.27.203.238/share/v2/f7d59a5c883f4f699e4078430c78ad8d/security-services/a0c43900-8b3d-471d-9023-d64a6d566a9e May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-fd1190ab-6f8a-41f9-bd63-4e5affa6af11 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-fd1190ab-6f8a-41f9-bd63-4e5affa6af11 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Calling method 'SecurityServiceController.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-fd1190ab-6f8a-41f9-bd63-4e5affa6af11 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] HTTP exception thrown: The resource could not be found. May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-fd1190ab-6f8a-41f9-bd63-4e5affa6af11 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] http://10.27.203.238/share/v2/f7d59a5c883f4f699e4078430c78ad8d/security-services/a0c43900-8b3d-471d-9023-d64a6d566a9e returned with HTTP 404 May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1028/2093] 10.27.203.238 () {64 vars in 1484 bytes} [Tue May 28 13:01:18 2024] GET /share/v2/f7d59a5c883f4f699e4078430c78ad8d/security-services/a0c43900-8b3d-471d-9023-d64a6d566a9e => generated 78 bytes in 8 msecs (HTTP/1.1 404) 6 headers in 237 bytes (2 switches on core 0) May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-d72f8d4a-fa56-425e-9e47-f83322e35fd3 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] DELETE http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/1f2ceadb-0238-4633-a7c5-0649049f0d1e May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-d72f8d4a-fa56-425e-9e47-f83322e35fd3 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-d72f8d4a-fa56-425e-9e47-f83322e35fd3 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Calling method 'SecurityServiceController.delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.v1.security_service [None req-d72f8d4a-fa56-425e-9e47-f83322e35fd3 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Delete security service with id: 1f2ceadb-0238-4633-a7c5-0649049f0d1e May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-d72f8d4a-fa56-425e-9e47-f83322e35fd3 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/1f2ceadb-0238-4633-a7c5-0649049f0d1e returned with HTTP 202 May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1029/2094] 10.27.203.238 () {62 vars in 1444 bytes} [Tue May 28 13:01:18 2024] DELETE /share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/1f2ceadb-0238-4633-a7c5-0649049f0d1e => generated 0 bytes in 28 msecs (HTTP/1.1 202) 6 headers in 242 bytes (1 switches on core 0) May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-1cb2d77c-1b40-4906-8343-a93727f28977 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] GET http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/1f2ceadb-0238-4633-a7c5-0649049f0d1e May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-1cb2d77c-1b40-4906-8343-a93727f28977 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-1cb2d77c-1b40-4906-8343-a93727f28977 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Calling method 'SecurityServiceController.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-1cb2d77c-1b40-4906-8343-a93727f28977 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] HTTP exception thrown: The resource could not be found. May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-1cb2d77c-1b40-4906-8343-a93727f28977 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/1f2ceadb-0238-4633-a7c5-0649049f0d1e returned with HTTP 404 May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1030/2095] 10.27.203.238 () {62 vars in 1441 bytes} [Tue May 28 13:01:18 2024] GET /share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/1f2ceadb-0238-4633-a7c5-0649049f0d1e => generated 78 bytes in 8 msecs (HTTP/1.1 404) 6 headers in 236 bytes (2 switches on core 0) May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-9572a2b6-6fb1-4709-afdc-0e2ced62d24a tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] DELETE http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/d0df43dd-1d35-46b7-bfac-a47ce71f75f8 May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-9572a2b6-6fb1-4709-afdc-0e2ced62d24a tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-9572a2b6-6fb1-4709-afdc-0e2ced62d24a tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Calling method 'SecurityServiceController.delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.v1.security_service [None req-9572a2b6-6fb1-4709-afdc-0e2ced62d24a tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Delete security service with id: d0df43dd-1d35-46b7-bfac-a47ce71f75f8 May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.quota [None req-13e93b32-a6fa-4702-954d-94f998ca60c3 tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] Created reservations ['3868fc12-ef15-4acb-9d7c-b1d0c405d480'] {{(pid=98329) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 13:01:18 l75lg1-v1 manila-share[98474]: INFO manila.share.manager [None req-13e93b32-a6fa-4702-954d-94f998ca60c3 tempest-ShareTypeAvailabilityZonesTest-364532124 None] Share group b9df9a2d-571e-4658-a435-c01428312fc4: deleting May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-9572a2b6-6fb1-4709-afdc-0e2ced62d24a tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/d0df43dd-1d35-46b7-bfac-a47ce71f75f8 returned with HTTP 202 May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1031/2096] 10.27.203.238 () {62 vars in 1444 bytes} [Tue May 28 13:01:18 2024] DELETE /share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/d0df43dd-1d35-46b7-bfac-a47ce71f75f8 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 6 headers in 242 bytes (1 switches on core 0) May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.quota [None req-13e93b32-a6fa-4702-954d-94f998ca60c3 tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] Committed reservations ['3868fc12-ef15-4acb-9d7c-b1d0c405d480'] {{(pid=98329) commit /opt/stack/manila/manila/quota.py:1063}} May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-13e93b32-a6fa-4702-954d-94f998ca60c3 tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] http://10.27.203.238/share/v2/284d76edec3144579d6fb3f6dbc0dd4e/share-groups/b9df9a2d-571e-4658-a435-c01428312fc4 returned with HTTP 202 May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-22215f55-e93d-41f9-a953-599a2d681dd6 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] GET http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/d0df43dd-1d35-46b7-bfac-a47ce71f75f8 May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-22215f55-e93d-41f9-a953-599a2d681dd6 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1066/2097] 10.27.203.238 () {64 vars in 1472 bytes} [Tue May 28 13:01:18 2024] DELETE /share/v2/284d76edec3144579d6fb3f6dbc0dd4e/share-groups/b9df9a2d-571e-4658-a435-c01428312fc4 => generated 0 bytes in 86 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-22215f55-e93d-41f9-a953-599a2d681dd6 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Calling method 'SecurityServiceController.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-22215f55-e93d-41f9-a953-599a2d681dd6 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] HTTP exception thrown: The resource could not be found. May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-22215f55-e93d-41f9-a953-599a2d681dd6 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/d0df43dd-1d35-46b7-bfac-a47ce71f75f8 returned with HTTP 404 May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1032/2098] 10.27.203.238 () {62 vars in 1441 bytes} [Tue May 28 13:01:18 2024] GET /share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/d0df43dd-1d35-46b7-bfac-a47ce71f75f8 => generated 78 bytes in 7 msecs (HTTP/1.1 404) 6 headers in 236 bytes (2 switches on core 0) May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-0d8eb169-71db-453a-b8ff-f0f6d9e88e9a tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] GET http://10.27.203.238/share/v2/284d76edec3144579d6fb3f6dbc0dd4e/share-groups/b9df9a2d-571e-4658-a435-c01428312fc4 May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-0d8eb169-71db-453a-b8ff-f0f6d9e88e9a tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-0d8eb169-71db-453a-b8ff-f0f6d9e88e9a tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:18 l75lg1-v1 manila-share[98474]: INFO manila.share.manager [None req-13e93b32-a6fa-4702-954d-94f998ca60c3 tempest-ShareTypeAvailabilityZonesTest-364532124 None] Share group b9df9a2d-571e-4658-a435-c01428312fc4: deleted successfully May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-31d466f5-c887-4604-b6b5-e20e23d0554c tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] POST http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-31d466f5-c887-4604-b6b5-e20e23d0554c tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Action: 'create', calling method: SecurityServiceController.create, body: {"security_service": {"type": "ldap", "name": "ss_ldap", "dns_ip": "1.1.1.1", "server": "fake_server_1", "domain": "fake_domain_1", "user": "fake_user", "password": "***", "ou": "}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-0d8eb169-71db-453a-b8ff-f0f6d9e88e9a tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] HTTP exception thrown: Share group b9df9a2d-571e-4658-a435-c01428312fc4 not found. May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-0d8eb169-71db-453a-b8ff-f0f6d9e88e9a tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] http://10.27.203.238/share/v2/284d76edec3144579d6fb3f6dbc0dd4e/share-groups/b9df9a2d-571e-4658-a435-c01428312fc4 returned with HTTP 404 May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1067/2099] 10.27.203.238 () {64 vars in 1469 bytes} [Tue May 28 13:01:18 2024] GET /share/v2/284d76edec3144579d6fb3f6dbc0dd4e/share-groups/b9df9a2d-571e-4658-a435-c01428312fc4 => generated 105 bytes in 11 msecs (HTTP/1.1 404) 6 headers in 238 bytes (2 switches on core 0) May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-e3d28f59-ac2a-44de-8663-c4f3d208389f tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] PUT http://10.27.203.238/share/v2/bb20757ddd604868aff8ad38db5def87/types/7d2ea8e8-bada-4826-a8a8-53b4e9ff301f/extra_specs/availability_zones May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-e3d28f59-ac2a-44de-8663-c4f3d208389f tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] Action: 'update', calling method: ShareTypeExtraSpecsController.update, body: {"availability_zones": "nova"} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-31d466f5-c887-4604-b6b5-e20e23d0554c tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services returned with HTTP 200 May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1033/2100] 10.27.203.238 () {64 vars in 1352 bytes} [Tue May 28 13:01:18 2024] POST /share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services => generated 371 bytes in 15 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-2a2c883d-7186-498c-983b-03629270459c tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] POST http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-2a2c883d-7186-498c-983b-03629270459c tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Action: 'create', calling method: SecurityServiceController.create, body: {"security_service": {"type": "kerberos", "name": "ss_kerberos", "dns_ip": "2.2.2.2", "server": "fake_server_2", "domain": "fake_domain_2", "user": "test_user", "password": "***", "ou": "}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-e3d28f59-ac2a-44de-8663-c4f3d208389f tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] http://10.27.203.238/share/v2/bb20757ddd604868aff8ad38db5def87/types/7d2ea8e8-bada-4826-a8a8-53b4e9ff301f/extra_specs/availability_zones returned with HTTP 200 May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1068/2101] 10.27.203.238 () {66 vars in 1561 bytes} [Tue May 28 13:01:18 2024] PUT /share/v2/bb20757ddd604868aff8ad38db5def87/types/7d2ea8e8-bada-4826-a8a8-53b4e9ff301f/extra_specs/availability_zones => generated 30 bytes in 14 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-781dd131-377a-4e51-8a5e-dc1635ea4ec4 tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] POST http://10.27.203.238/share/v2/284d76edec3144579d6fb3f6dbc0dd4e/shares May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-781dd131-377a-4e51-8a5e-dc1635ea4ec4 tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share": {"share_proto": "nfs", "description": "Tempest's share", "snapshot_id": null, "name": "tempest-tempest-created-share-231222967", "size": 1, "metadata": {}, "is_public": false, "availability_zone": "nova", "share_type": "7d2ea8e8-bada-4826-a8a8-53b4e9ff301f"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.v1.shares [None req-781dd131-377a-4e51-8a5e-dc1635ea4ec4 tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] Create NFS share of 1 GB May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-2a2c883d-7186-498c-983b-03629270459c tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services returned with HTTP 200 May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1034/2102] 10.27.203.238 () {64 vars in 1352 bytes} [Tue May 28 13:01:18 2024] POST /share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services => generated 379 bytes in 15 msecs (HTTP/1.1 200) 6 headers in 230 bytes (2 switches on core 0) May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-c57f6d86-8145-470b-9017-487021f3d9d4 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] POST http://10.27.203.238/share/v2/f7d59a5c883f4f699e4078430c78ad8d/security-services May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-c57f6d86-8145-470b-9017-487021f3d9d4 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Action: 'create', calling method: SecurityServiceController.create, body: {"security_service": {"type": "ldap", "name": "tempest-ss-name-247045418", "description": "tempest-ss-desc-4443101", "dns_ip": "203.0.113.6", "server": "203.0.113.237", "domain": "tempest-ss-domain-667851515", "user": "tempest-ss-user-1308826867", "password": "***", "ou": "}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-c57f6d86-8145-470b-9017-487021f3d9d4 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] http://10.27.203.238/share/v2/f7d59a5c883f4f699e4078430c78ad8d/security-services returned with HTTP 200 May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1035/2103] 10.27.203.238 () {66 vars in 1395 bytes} [Tue May 28 13:01:18 2024] POST /share/v2/f7d59a5c883f4f699e4078430c78ad8d/security-services => generated 527 bytes in 15 msecs (HTTP/1.1 200) 6 headers in 231 bytes (2 switches on core 0) May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-933b5116-bcd6-4f61-97d9-96449b0c191e tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] GET http://10.27.203.238/share/v2/f7d59a5c883f4f699e4078430c78ad8d/security-services/b83f295f-7e92-42a1-bf4f-0ba3671c5da1 May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-933b5116-bcd6-4f61-97d9-96449b0c191e tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-933b5116-bcd6-4f61-97d9-96449b0c191e tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Calling method 'SecurityServiceController.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-933b5116-bcd6-4f61-97d9-96449b0c191e tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] http://10.27.203.238/share/v2/f7d59a5c883f4f699e4078430c78ad8d/security-services/b83f295f-7e92-42a1-bf4f-0ba3671c5da1 returned with HTTP 200 May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1036/2104] 10.27.203.238 () {64 vars in 1484 bytes} [Tue May 28 13:01:18 2024] GET /share/v2/f7d59a5c883f4f699e4078430c78ad8d/security-services/b83f295f-7e92-42a1-bf4f-0ba3671c5da1 => generated 527 bytes in 9 msecs (HTTP/1.1 200) 6 headers in 231 bytes (2 switches on core 0) May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-a0d9380f-d20a-4f26-bbc9-36c7c6606a12 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] DELETE http://10.27.203.238/share/v2/f7d59a5c883f4f699e4078430c78ad8d/security-services/b83f295f-7e92-42a1-bf4f-0ba3671c5da1 May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-a0d9380f-d20a-4f26-bbc9-36c7c6606a12 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-a0d9380f-d20a-4f26-bbc9-36c7c6606a12 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Calling method 'SecurityServiceController.delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.v1.security_service [None req-a0d9380f-d20a-4f26-bbc9-36c7c6606a12 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Delete security service with id: b83f295f-7e92-42a1-bf4f-0ba3671c5da1 May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-a0d9380f-d20a-4f26-bbc9-36c7c6606a12 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] http://10.27.203.238/share/v2/f7d59a5c883f4f699e4078430c78ad8d/security-services/b83f295f-7e92-42a1-bf4f-0ba3671c5da1 returned with HTTP 202 May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1037/2105] 10.27.203.238 () {64 vars in 1487 bytes} [Tue May 28 13:01:18 2024] DELETE /share/v2/f7d59a5c883f4f699e4078430c78ad8d/security-services/b83f295f-7e92-42a1-bf4f-0ba3671c5da1 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 6 headers in 243 bytes (2 switches on core 0) May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-a9ad1471-0f2f-46b6-a596-9d7305ba937e tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] GET http://10.27.203.238/share/v2/f7d59a5c883f4f699e4078430c78ad8d/security-services/b83f295f-7e92-42a1-bf4f-0ba3671c5da1 May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.quota [None req-781dd131-377a-4e51-8a5e-dc1635ea4ec4 tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] Created reservations ['3e1b8ec2-4a60-4a00-b7ef-df256ff27842', '0be49327-359c-4ec7-b601-768780292062', '4fe6410b-6d23-434b-855c-fd17fd6dd1e8', '28963ffe-ee77-461c-ace5-925e3cfe855b'] {{(pid=98329) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-a9ad1471-0f2f-46b6-a596-9d7305ba937e tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-a9ad1471-0f2f-46b6-a596-9d7305ba937e tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Calling method 'SecurityServiceController.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-a9ad1471-0f2f-46b6-a596-9d7305ba937e tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] HTTP exception thrown: The resource could not be found. May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-a9ad1471-0f2f-46b6-a596-9d7305ba937e tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] http://10.27.203.238/share/v2/f7d59a5c883f4f699e4078430c78ad8d/security-services/b83f295f-7e92-42a1-bf4f-0ba3671c5da1 returned with HTTP 404 May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1038/2106] 10.27.203.238 () {64 vars in 1484 bytes} [Tue May 28 13:01:18 2024] GET /share/v2/f7d59a5c883f4f699e4078430c78ad8d/security-services/b83f295f-7e92-42a1-bf4f-0ba3671c5da1 => generated 78 bytes in 8 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-946f76ea-5d6f-48cd-a319-c67e748e3e3a tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] DELETE http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/8cf2b52d-97ea-4016-b85f-f1de8eed7d95 May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-946f76ea-5d6f-48cd-a319-c67e748e3e3a tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-946f76ea-5d6f-48cd-a319-c67e748e3e3a tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Calling method 'SecurityServiceController.delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.v1.security_service [None req-946f76ea-5d6f-48cd-a319-c67e748e3e3a tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Delete security service with id: 8cf2b52d-97ea-4016-b85f-f1de8eed7d95 May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-946f76ea-5d6f-48cd-a319-c67e748e3e3a tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/8cf2b52d-97ea-4016-b85f-f1de8eed7d95 returned with HTTP 202 May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1039/2107] 10.27.203.238 () {62 vars in 1444 bytes} [Tue May 28 13:01:18 2024] DELETE /share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/8cf2b52d-97ea-4016-b85f-f1de8eed7d95 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 6 headers in 242 bytes (2 switches on core 0) May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-ffc911a2-3b7e-4cfa-a854-62ec9160da22 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] GET http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/8cf2b52d-97ea-4016-b85f-f1de8eed7d95 May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-ffc911a2-3b7e-4cfa-a854-62ec9160da22 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-ffc911a2-3b7e-4cfa-a854-62ec9160da22 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Calling method 'SecurityServiceController.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-ffc911a2-3b7e-4cfa-a854-62ec9160da22 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] HTTP exception thrown: The resource could not be found. May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-ffc911a2-3b7e-4cfa-a854-62ec9160da22 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/8cf2b52d-97ea-4016-b85f-f1de8eed7d95 returned with HTTP 404 May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1040/2108] 10.27.203.238 () {62 vars in 1441 bytes} [Tue May 28 13:01:18 2024] GET /share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/8cf2b52d-97ea-4016-b85f-f1de8eed7d95 => generated 78 bytes in 8 msecs (HTTP/1.1 404) 6 headers in 236 bytes (1 switches on core 0) May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-324686dd-f569-4517-bcf1-198b73d2f00e tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] DELETE http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/17985be6-8494-4d8d-9d36-ca7ec5ee7c8a May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-324686dd-f569-4517-bcf1-198b73d2f00e tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-324686dd-f569-4517-bcf1-198b73d2f00e tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Calling method 'SecurityServiceController.delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.v1.security_service [None req-324686dd-f569-4517-bcf1-198b73d2f00e tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Delete security service with id: 17985be6-8494-4d8d-9d36-ca7ec5ee7c8a May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.quota [None req-781dd131-377a-4e51-8a5e-dc1635ea4ec4 tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] Committed reservations ['3e1b8ec2-4a60-4a00-b7ef-df256ff27842', '0be49327-359c-4ec7-b601-768780292062', '4fe6410b-6d23-434b-855c-fd17fd6dd1e8', '28963ffe-ee77-461c-ace5-925e3cfe855b'] {{(pid=98329) commit /opt/stack/manila/manila/quota.py:1063}} May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-324686dd-f569-4517-bcf1-198b73d2f00e tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/17985be6-8494-4d8d-9d36-ca7ec5ee7c8a returned with HTTP 202 May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1041/2109] 10.27.203.238 () {62 vars in 1444 bytes} [Tue May 28 13:01:18 2024] DELETE /share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/17985be6-8494-4d8d-9d36-ca7ec5ee7c8a => generated 0 bytes in 26 msecs (HTTP/1.1 202) 6 headers in 242 bytes (2 switches on core 0) May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-96a2633d-de2d-45e4-ad49-052abd90f813 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] GET http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/17985be6-8494-4d8d-9d36-ca7ec5ee7c8a May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-96a2633d-de2d-45e4-ad49-052abd90f813 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-96a2633d-de2d-45e4-ad49-052abd90f813 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Calling method 'SecurityServiceController.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-96a2633d-de2d-45e4-ad49-052abd90f813 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] HTTP exception thrown: The resource could not be found. May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-96a2633d-de2d-45e4-ad49-052abd90f813 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/17985be6-8494-4d8d-9d36-ca7ec5ee7c8a returned with HTTP 404 May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1042/2110] 10.27.203.238 () {62 vars in 1441 bytes} [Tue May 28 13:01:18 2024] GET /share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/17985be6-8494-4d8d-9d36-ca7ec5ee7c8a => generated 78 bytes in 8 msecs (HTTP/1.1 404) 6 headers in 236 bytes (1 switches on core 0) May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-97c5258c-b6b6-4b12-af94-36c4c567024d tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] POST http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-97c5258c-b6b6-4b12-af94-36c4c567024d tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Action: 'create', calling method: SecurityServiceController.create, body: {"security_service": {"type": "ldap", "name": "ss_ldap", "dns_ip": "1.1.1.1", "server": "fake_server_1", "domain": "fake_domain_1", "user": "fake_user", "password": "***", "ou": "}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-97c5258c-b6b6-4b12-af94-36c4c567024d tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services returned with HTTP 200 May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1043/2111] 10.27.203.238 () {64 vars in 1352 bytes} [Tue May 28 13:01:18 2024] POST /share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services => generated 371 bytes in 18 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-73e1bb86-961e-4792-b7e8-6d084e4b0b5f tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] POST http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-73e1bb86-961e-4792-b7e8-6d084e4b0b5f tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Action: 'create', calling method: SecurityServiceController.create, body: {"security_service": {"type": "kerberos", "name": "ss_kerberos", "dns_ip": "2.2.2.2", "server": "fake_server_2", "domain": "fake_domain_2", "user": "test_user", "password": "***", "ou": "}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:01:18 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.host_manager [None req-781dd131-377a-4e51-8a5e-dc1635ea4ec4 tempest-ShareTypeAvailabilityZonesTest-364532124 None] Share service is down. (host: l75lg1-v1@generic2). May 28 13:01:18 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.host_manager [None req-781dd131-377a-4e51-8a5e-dc1635ea4ec4 tempest-ShareTypeAvailabilityZonesTest-364532124 None] Share service is down. (host: l75lg1-v1@generic1). May 28 13:01:18 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-781dd131-377a-4e51-8a5e-dc1635ea4ec4 tempest-ShareTypeAvailabilityZonesTest-364532124 None] Starting with 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:80}} May 28 13:01:18 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-781dd131-377a-4e51-8a5e-dc1635ea4ec4 tempest-ShareTypeAvailabilityZonesTest-364532124 None] Filter OnlyHostFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:01:18 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-781dd131-377a-4e51-8a5e-dc1635ea4ec4 tempest-ShareTypeAvailabilityZonesTest-364532124 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:01:18 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.capacity [None req-781dd131-377a-4e51-8a5e-dc1635ea4ec4 tempest-ShareTypeAvailabilityZonesTest-364532124 None] Space information for share creation on host l75lg1-v1@vast#vast (requested / avail): 1/2079 {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/capacity.py:83}} May 28 13:01:18 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-781dd131-377a-4e51-8a5e-dc1635ea4ec4 tempest-ShareTypeAvailabilityZonesTest-364532124 None] Filter CapacityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:01:18 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-781dd131-377a-4e51-8a5e-dc1635ea4ec4 tempest-ShareTypeAvailabilityZonesTest-364532124 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-73e1bb86-961e-4792-b7e8-6d084e4b0b5f tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services returned with HTTP 200 May 28 13:01:18 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-781dd131-377a-4e51-8a5e-dc1635ea4ec4 tempest-ShareTypeAvailabilityZonesTest-364532124 None] Driver Filter: Checking host 'l75lg1-v1@vast#vast' {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:37}} May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1044/2112] 10.27.203.238 () {64 vars in 1352 bytes} [Tue May 28 13:01:18 2024] POST /share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services => generated 379 bytes in 20 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:01:18 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-781dd131-377a-4e51-8a5e-dc1635ea4ec4 tempest-ShareTypeAvailabilityZonesTest-364532124 None] Filter function not set :: passing host. {{(pid=98327) _check_filter_function /opt/stack/manila/manila/scheduler/filters/driver.py:53}} May 28 13:01:18 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-781dd131-377a-4e51-8a5e-dc1635ea4ec4 tempest-ShareTypeAvailabilityZonesTest-364532124 None] Result: True {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:40}} May 28 13:01:18 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-781dd131-377a-4e51-8a5e-dc1635ea4ec4 tempest-ShareTypeAvailabilityZonesTest-364532124 None] Done checking host 'l75lg1-v1@vast#vast' {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:41}} May 28 13:01:18 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-781dd131-377a-4e51-8a5e-dc1635ea4ec4 tempest-ShareTypeAvailabilityZonesTest-364532124 None] Filter DriverFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:01:18 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-781dd131-377a-4e51-8a5e-dc1635ea4ec4 tempest-ShareTypeAvailabilityZonesTest-364532124 None] Filter ShareReplicationFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:01:18 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-781dd131-377a-4e51-8a5e-dc1635ea4ec4 tempest-ShareTypeAvailabilityZonesTest-364532124 None] Filter CreateFromSnapshotFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-781dd131-377a-4e51-8a5e-dc1635ea4ec4 tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] http://10.27.203.238/share/v2/284d76edec3144579d6fb3f6dbc0dd4e/shares returned with HTTP 200 May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1069/2113] 10.27.203.238 () {66 vars in 1362 bytes} [Tue May 28 13:01:18 2024] POST /share/v2/284d76edec3144579d6fb3f6dbc0dd4e/shares => generated 1313 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 232 bytes (2 switches on core 0) May 28 13:01:18 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-781dd131-377a-4e51-8a5e-dc1635ea4ec4 tempest-ShareTypeAvailabilityZonesTest-364532124 None] Filter AffinityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:01:18 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-781dd131-377a-4e51-8a5e-dc1635ea4ec4 tempest-ShareTypeAvailabilityZonesTest-364532124 None] Filter AntiAffinityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:01:18 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.drivers.filter [None req-781dd131-377a-4e51-8a5e-dc1635ea4ec4 tempest-ShareTypeAvailabilityZonesTest-364532124 None] Filtered share [host: 'l75lg1-v1@vast#vast', free_capacity_gb: 2079.6277076322585, pools: None] {{(pid=98327) _schedule_share /opt/stack/manila/manila/scheduler/drivers/filter.py:268}} May 28 13:01:18 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-781dd131-377a-4e51-8a5e-dc1635ea4ec4 tempest-ShareTypeAvailabilityZonesTest-364532124 None] Checking host 'l75lg1-v1@vast#vast' {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:46}} May 28 13:01:18 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.weighers.goodness [None req-781dd131-377a-4e51-8a5e-dc1635ea4ec4 tempest-ShareTypeAvailabilityZonesTest-364532124 None] Goodness function not set :: defaulting to minimal goodness rating of 0. May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-f041c9c9-128c-41a6-8500-69dc829c017b tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] GET http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services May 28 13:01:18 l75lg1-v1 manila-scheduler[98327]: INFO manila.scheduler.weighers.goodness [None req-781dd131-377a-4e51-8a5e-dc1635ea4ec4 tempest-ShareTypeAvailabilityZonesTest-364532124 None] Goodness function result for host l75lg1-v1@vast#vast: 0. May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-f041c9c9-128c-41a6-8500-69dc829c017b tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-f041c9c9-128c-41a6-8500-69dc829c017b tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Calling method 'SecurityServiceController.index' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:18 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-781dd131-377a-4e51-8a5e-dc1635ea4ec4 tempest-ShareTypeAvailabilityZonesTest-364532124 None] Goodness: 0 {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:48}} May 28 13:01:18 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-781dd131-377a-4e51-8a5e-dc1635ea4ec4 tempest-ShareTypeAvailabilityZonesTest-364532124 None] Done checking host 'l75lg1-v1@vast#vast' {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:49}} May 28 13:01:18 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.drivers.filter [None req-781dd131-377a-4e51-8a5e-dc1635ea4ec4 tempest-ShareTypeAvailabilityZonesTest-364532124 None] Choosing for share: WeighedHost [host: l75lg1-v1@vast#vast, weight: 0.0] {{(pid=98327) _schedule_share /opt/stack/manila/manila/scheduler/drivers/filter.py:274}} May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-1fdf2f23-7bf6-4ff2-a0e5-63e2d54bf961 tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] GET http://10.27.203.238/share/v2/284d76edec3144579d6fb3f6dbc0dd4e/shares/553b74f3-3a9b-40ad-b4b1-d5648684cbf4 May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-1fdf2f23-7bf6-4ff2-a0e5-63e2d54bf961 tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-1fdf2f23-7bf6-4ff2-a0e5-63e2d54bf961 tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.common [None req-f041c9c9-128c-41a6-8500-69dc829c017b tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Removing options '' from query {{(pid=98330) remove_invalid_options /opt/stack/manila/manila/api/common.py:441}} May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-f041c9c9-128c-41a6-8500-69dc829c017b tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services returned with HTTP 200 May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1045/2114] 10.27.203.238 () {62 vars in 1330 bytes} [Tue May 28 13:01:18 2024] GET /share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services => generated 231 bytes in 10 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-5f279634-f99f-4da9-84d0-b09785ac1514 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] DELETE http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/18e40ae0-da02-43c1-8043-77fd6a11b04e May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-5f279634-f99f-4da9-84d0-b09785ac1514 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-5f279634-f99f-4da9-84d0-b09785ac1514 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Calling method 'SecurityServiceController.delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.v1.security_service [None req-5f279634-f99f-4da9-84d0-b09785ac1514 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Delete security service with id: 18e40ae0-da02-43c1-8043-77fd6a11b04e May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-1fdf2f23-7bf6-4ff2-a0e5-63e2d54bf961 tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] http://10.27.203.238/share/v2/284d76edec3144579d6fb3f6dbc0dd4e/shares/553b74f3-3a9b-40ad-b4b1-d5648684cbf4 returned with HTTP 200 May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1070/2115] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:01:18 2024] GET /share/v2/284d76edec3144579d6fb3f6dbc0dd4e/shares/553b74f3-3a9b-40ad-b4b1-d5648684cbf4 => generated 1313 bytes in 28 msecs (HTTP/1.1 200) 6 headers in 232 bytes (2 switches on core 0) May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-5f279634-f99f-4da9-84d0-b09785ac1514 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/18e40ae0-da02-43c1-8043-77fd6a11b04e returned with HTTP 202 May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1046/2116] 10.27.203.238 () {62 vars in 1444 bytes} [Tue May 28 13:01:18 2024] DELETE /share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/18e40ae0-da02-43c1-8043-77fd6a11b04e => generated 0 bytes in 27 msecs (HTTP/1.1 202) 6 headers in 242 bytes (2 switches on core 0) May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-fd73e817-5a03-4724-93f5-9b7b68b132f7 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] GET http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/18e40ae0-da02-43c1-8043-77fd6a11b04e May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-fd73e817-5a03-4724-93f5-9b7b68b132f7 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-fd73e817-5a03-4724-93f5-9b7b68b132f7 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Calling method 'SecurityServiceController.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-fd73e817-5a03-4724-93f5-9b7b68b132f7 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] HTTP exception thrown: The resource could not be found. May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-fd73e817-5a03-4724-93f5-9b7b68b132f7 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/18e40ae0-da02-43c1-8043-77fd6a11b04e returned with HTTP 404 May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1071/2117] 10.27.203.238 () {62 vars in 1441 bytes} [Tue May 28 13:01:18 2024] GET /share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/18e40ae0-da02-43c1-8043-77fd6a11b04e => generated 78 bytes in 9 msecs (HTTP/1.1 404) 6 headers in 236 bytes (1 switches on core 0) May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-ae1f63b5-0c5b-48d4-bfee-e8ba5cfc7c60 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] DELETE http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/e854dd41-1859-4f9c-bbd0-e63098a207d6 May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-ae1f63b5-0c5b-48d4-bfee-e8ba5cfc7c60 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-ae1f63b5-0c5b-48d4-bfee-e8ba5cfc7c60 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Calling method 'SecurityServiceController.delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:18 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.v1.security_service [None req-ae1f63b5-0c5b-48d4-bfee-e8ba5cfc7c60 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Delete security service with id: e854dd41-1859-4f9c-bbd0-e63098a207d6 May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-ae1f63b5-0c5b-48d4-bfee-e8ba5cfc7c60 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/e854dd41-1859-4f9c-bbd0-e63098a207d6 returned with HTTP 202 May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1047/2118] 10.27.203.238 () {62 vars in 1444 bytes} [Tue May 28 13:01:18 2024] DELETE /share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/e854dd41-1859-4f9c-bbd0-e63098a207d6 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 6 headers in 242 bytes (1 switches on core 0) May 28 13:01:19 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-781dd131-377a-4e51-8a5e-dc1635ea4ec4 tempest-ShareTypeAvailabilityZonesTest-364532124 None] >>> [GET] https://127.0.0.1:40443/api/vippools/ May 28 13:01:19 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-781dd131-377a-4e51-8a5e-dc1635ea4ec4 tempest-ShareTypeAvailabilityZonesTest-364532124 None] {'allow_redirects': True, 'params': {'name': 'vippool-1'}} May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-887b6d10-87f9-4d40-b795-198a703cbcc5 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] GET http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/e854dd41-1859-4f9c-bbd0-e63098a207d6 May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-887b6d10-87f9-4d40-b795-198a703cbcc5 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-887b6d10-87f9-4d40-b795-198a703cbcc5 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Calling method 'SecurityServiceController.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-887b6d10-87f9-4d40-b795-198a703cbcc5 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] HTTP exception thrown: The resource could not be found. May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-887b6d10-87f9-4d40-b795-198a703cbcc5 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/e854dd41-1859-4f9c-bbd0-e63098a207d6 returned with HTTP 404 May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1072/2119] 10.27.203.238 () {62 vars in 1441 bytes} [Tue May 28 13:01:19 2024] GET /share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/e854dd41-1859-4f9c-bbd0-e63098a207d6 => generated 78 bytes in 9 msecs (HTTP/1.1 404) 6 headers in 236 bytes (1 switches on core 0) May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-25545ad4-fd2a-4f67-8f20-846a8789b2f2 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] POST http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-25545ad4-fd2a-4f67-8f20-846a8789b2f2 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Action: 'create', calling method: SecurityServiceController.create, body: {"security_service": {"type": "ldap", "name": "ss_ldap", "dns_ip": "1.1.1.1", "server": "fake_server_1", "domain": "fake_domain_1", "user": "fake_user", "password": "***", "ou": "}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-25545ad4-fd2a-4f67-8f20-846a8789b2f2 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services returned with HTTP 200 May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1048/2120] 10.27.203.238 () {64 vars in 1352 bytes} [Tue May 28 13:01:19 2024] POST /share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services => generated 371 bytes in 19 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-b4d48e8d-5b04-4a2c-bdcd-a80e3e804e7b tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] POST http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-b4d48e8d-5b04-4a2c-bdcd-a80e3e804e7b tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Action: 'create', calling method: SecurityServiceController.create, body: {"security_service": {"type": "kerberos", "name": "ss_kerberos", "dns_ip": "2.2.2.2", "server": "fake_server_2", "domain": "fake_domain_2", "user": "test_user", "password": "***", "ou": "}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-b4d48e8d-5b04-4a2c-bdcd-a80e3e804e7b tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services returned with HTTP 200 May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1073/2121] 10.27.203.238 () {64 vars in 1352 bytes} [Tue May 28 13:01:19 2024] POST /share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services => generated 379 bytes in 20 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-8dcf6fe0-d819-451e-8d86-5df50d88bbab tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] GET http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/detail?name=ss_ldap&type=ldap&user=fake_user&server=fake_server_1&dns_ip=1.1.1.1&domain=fake_domain_1 May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-8dcf6fe0-d819-451e-8d86-5df50d88bbab tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-8dcf6fe0-d819-451e-8d86-5df50d88bbab tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Calling method 'SecurityServiceController.detail' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.common [None req-8dcf6fe0-d819-451e-8d86-5df50d88bbab tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Removing options '' from query {{(pid=98330) remove_invalid_options /opt/stack/manila/manila/api/common.py:441}} May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-8dcf6fe0-d819-451e-8d86-5df50d88bbab tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/detail?name=ss_ldap&type=ldap&user=fake_user&server=fake_server_1&dns_ip=1.1.1.1&domain=fake_domain_1 returned with HTTP 200 May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1049/2122] 10.27.203.238 () {62 vars in 1540 bytes} [Tue May 28 13:01:19 2024] GET /share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/detail?name=ss_ldap&type=ldap&user=fake_user&server=fake_server_1&dns_ip=1.1.1.1&domain=fake_domain_1 => generated 396 bytes in 13 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-fb41cf66-659a-493f-a690-2bd069b67ee9 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] DELETE http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/45aa6810-0da7-4ee3-85ae-16f81be1f791 May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-fb41cf66-659a-493f-a690-2bd069b67ee9 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-fb41cf66-659a-493f-a690-2bd069b67ee9 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Calling method 'SecurityServiceController.delete' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.v1.security_service [None req-fb41cf66-659a-493f-a690-2bd069b67ee9 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Delete security service with id: 45aa6810-0da7-4ee3-85ae-16f81be1f791 May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-fb41cf66-659a-493f-a690-2bd069b67ee9 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/45aa6810-0da7-4ee3-85ae-16f81be1f791 returned with HTTP 202 May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1074/2123] 10.27.203.238 () {62 vars in 1444 bytes} [Tue May 28 13:01:19 2024] DELETE /share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/45aa6810-0da7-4ee3-85ae-16f81be1f791 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 6 headers in 242 bytes (1 switches on core 0) May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-d8627a51-9d42-4582-a4b4-cc6a9a681418 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] GET http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/45aa6810-0da7-4ee3-85ae-16f81be1f791 May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-d8627a51-9d42-4582-a4b4-cc6a9a681418 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-d8627a51-9d42-4582-a4b4-cc6a9a681418 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Calling method 'SecurityServiceController.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-d8627a51-9d42-4582-a4b4-cc6a9a681418 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] HTTP exception thrown: The resource could not be found. May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-d8627a51-9d42-4582-a4b4-cc6a9a681418 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/45aa6810-0da7-4ee3-85ae-16f81be1f791 returned with HTTP 404 May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1050/2124] 10.27.203.238 () {62 vars in 1441 bytes} [Tue May 28 13:01:19 2024] GET /share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/45aa6810-0da7-4ee3-85ae-16f81be1f791 => generated 78 bytes in 9 msecs (HTTP/1.1 404) 6 headers in 236 bytes (1 switches on core 0) May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-1e96222c-a64c-4d5d-9583-9297cb7fd4bf tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] DELETE http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/cb687e99-d906-4966-80d4-485fe2d6fd1e May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-1e96222c-a64c-4d5d-9583-9297cb7fd4bf tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-1e96222c-a64c-4d5d-9583-9297cb7fd4bf tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Calling method 'SecurityServiceController.delete' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.v1.security_service [None req-1e96222c-a64c-4d5d-9583-9297cb7fd4bf tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Delete security service with id: cb687e99-d906-4966-80d4-485fe2d6fd1e May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-1e96222c-a64c-4d5d-9583-9297cb7fd4bf tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/cb687e99-d906-4966-80d4-485fe2d6fd1e returned with HTTP 202 May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1075/2125] 10.27.203.238 () {62 vars in 1444 bytes} [Tue May 28 13:01:19 2024] DELETE /share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/cb687e99-d906-4966-80d4-485fe2d6fd1e => generated 0 bytes in 24 msecs (HTTP/1.1 202) 6 headers in 242 bytes (1 switches on core 0) May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-c23dde14-ce46-48b0-a4c1-b8c266c2ad78 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] GET http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/cb687e99-d906-4966-80d4-485fe2d6fd1e May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-c23dde14-ce46-48b0-a4c1-b8c266c2ad78 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-c23dde14-ce46-48b0-a4c1-b8c266c2ad78 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Calling method 'SecurityServiceController.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-c23dde14-ce46-48b0-a4c1-b8c266c2ad78 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] HTTP exception thrown: The resource could not be found. May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-c23dde14-ce46-48b0-a4c1-b8c266c2ad78 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/cb687e99-d906-4966-80d4-485fe2d6fd1e returned with HTTP 404 May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1051/2126] 10.27.203.238 () {62 vars in 1441 bytes} [Tue May 28 13:01:19 2024] GET /share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/cb687e99-d906-4966-80d4-485fe2d6fd1e => generated 78 bytes in 8 msecs (HTTP/1.1 404) 6 headers in 236 bytes (1 switches on core 0) May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-f5516d17-ca25-49b4-9058-a757304744f8 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] POST http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-f5516d17-ca25-49b4-9058-a757304744f8 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Action: 'create', calling method: SecurityServiceController.create, body: {"security_service": {"type": "ldap", "name": "ss_ldap", "dns_ip": "1.1.1.1", "server": "fake_server_1", "domain": "fake_domain_1", "user": "fake_user", "password": "***", "ou": "}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-f5516d17-ca25-49b4-9058-a757304744f8 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services returned with HTTP 200 May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1076/2127] 10.27.203.238 () {64 vars in 1352 bytes} [Tue May 28 13:01:19 2024] POST /share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services => generated 371 bytes in 15 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-f687c5fc-eb93-4d23-b569-3a04efb4f824 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] POST http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-f687c5fc-eb93-4d23-b569-3a04efb4f824 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Action: 'create', calling method: SecurityServiceController.create, body: {"security_service": {"type": "kerberos", "name": "ss_kerberos", "dns_ip": "2.2.2.2", "server": "fake_server_2", "domain": "fake_domain_2", "user": "test_user", "password": "***", "ou": "}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-f687c5fc-eb93-4d23-b569-3a04efb4f824 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services returned with HTTP 200 May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1052/2128] 10.27.203.238 () {64 vars in 1352 bytes} [Tue May 28 13:01:19 2024] POST /share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services => generated 379 bytes in 18 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-27b83335-81e8-41dc-a8bd-cec2ae51330f tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] GET http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services?fake_opt=some_value May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-27b83335-81e8-41dc-a8bd-cec2ae51330f tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-27b83335-81e8-41dc-a8bd-cec2ae51330f tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Calling method 'SecurityServiceController.index' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.common [None req-27b83335-81e8-41dc-a8bd-cec2ae51330f tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Removing options 'fake_opt' from query {{(pid=98329) remove_invalid_options /opt/stack/manila/manila/api/common.py:441}} May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-27b83335-81e8-41dc-a8bd-cec2ae51330f tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services?fake_opt=some_value returned with HTTP 200 May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1077/2129] 10.27.203.238 () {62 vars in 1369 bytes} [Tue May 28 13:01:19 2024] GET /share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services?fake_opt=some_value => generated 231 bytes in 9 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-2004bcd0-6e77-4f29-8b85-9d202c445901 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] DELETE http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/e15e94ec-afac-43f3-8e0f-b6a737abe4be May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-2004bcd0-6e77-4f29-8b85-9d202c445901 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-2004bcd0-6e77-4f29-8b85-9d202c445901 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Calling method 'SecurityServiceController.delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.v1.security_service [None req-2004bcd0-6e77-4f29-8b85-9d202c445901 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Delete security service with id: e15e94ec-afac-43f3-8e0f-b6a737abe4be May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-2004bcd0-6e77-4f29-8b85-9d202c445901 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/e15e94ec-afac-43f3-8e0f-b6a737abe4be returned with HTTP 202 May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1053/2130] 10.27.203.238 () {62 vars in 1444 bytes} [Tue May 28 13:01:19 2024] DELETE /share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/e15e94ec-afac-43f3-8e0f-b6a737abe4be => generated 0 bytes in 26 msecs (HTTP/1.1 202) 6 headers in 242 bytes (1 switches on core 0) May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-2d3d1976-91e9-4207-a8e9-e497bf8e6cf4 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] GET http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/e15e94ec-afac-43f3-8e0f-b6a737abe4be May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-2d3d1976-91e9-4207-a8e9-e497bf8e6cf4 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-2d3d1976-91e9-4207-a8e9-e497bf8e6cf4 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Calling method 'SecurityServiceController.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:19 l75lg1-v1 dstat.sh[49771]: 28-05 13:01:19| 12 2 80 5 0|5700M 1740M 278M 7906M| 18k 21k| 0 4211k| 0 593 |9634 16k|1.51 1.23 1.08|4.0 2.0 0| 0 0 | 0 2048M| 29 364 0 37 2 May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-2d3d1976-91e9-4207-a8e9-e497bf8e6cf4 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] HTTP exception thrown: The resource could not be found. May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-2d3d1976-91e9-4207-a8e9-e497bf8e6cf4 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/e15e94ec-afac-43f3-8e0f-b6a737abe4be returned with HTTP 404 May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1078/2131] 10.27.203.238 () {62 vars in 1441 bytes} [Tue May 28 13:01:19 2024] GET /share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/e15e94ec-afac-43f3-8e0f-b6a737abe4be => generated 78 bytes in 8 msecs (HTTP/1.1 404) 6 headers in 236 bytes (1 switches on core 0) May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-3a0c3d22-d984-42f0-8822-59ac0432ce75 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] DELETE http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/befd0334-1770-4039-ae51-9c4b0a4bff20 May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-3a0c3d22-d984-42f0-8822-59ac0432ce75 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-3a0c3d22-d984-42f0-8822-59ac0432ce75 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Calling method 'SecurityServiceController.delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.v1.security_service [None req-3a0c3d22-d984-42f0-8822-59ac0432ce75 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Delete security service with id: befd0334-1770-4039-ae51-9c4b0a4bff20 May 28 13:01:19 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0667e4bb-7ea7-4904-a9e4-6bb97486e4cb tempest-ShareRulesTest-2015086173 None] <<< [PATCH] https://127.0.0.1:40443/api/viewpolicies/38/ May 28 13:01:19 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0667e4bb-7ea7-4904-a9e4-6bb97486e4cb tempest-ShareRulesTest-2015086173 None] Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=1, created='2024-05-28T12:59:53.824250Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='0fa84ccd-850f-48fa-a965-23e5abe31188', id=38, internal=False, is_s3_default_policy=False, name='f7e47502-a0f7-44de-953d-b7b5697ae0b2', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=['*'], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=[], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=[], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='MODIFYING', sync_time='2024-05-28T13:01:18.676903Z', tenant_id=1, tenant_name='default', title='f7e47502-a0f7-44de-953d-b7b5697ae0b2', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/38/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[]) May 28 13:01:19 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0667e4bb-7ea7-4904-a9e4-6bb97486e4cb tempest-ShareRulesTest-2015086173 None] --- [PATCH] https://127.0.0.1:40443/api/viewpolicies/38/: Done May 28 13:01:19 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-0667e4bb-7ea7-4904-a9e4-6bb97486e4cb tempest-ShareRulesTest-2015086173 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:01:19 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-0667e4bb-7ea7-4904-a9e4-6bb97486e4cb tempest-ShareRulesTest-2015086173 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:01:19 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-781dd131-377a-4e51-8a5e-dc1635ea4ec4 tempest-ShareTypeAvailabilityZonesTest-364532124 None] <<< [GET] https://127.0.0.1:40443/api/vippools/ May 28 13:01:19 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-781dd131-377a-4e51-8a5e-dc1635ea4ec4 tempest-ShareTypeAvailabilityZonesTest-364532124 None] [Bunch(active_cnode_ids=[], active_interfaces=4, cluster='loop75-kfs', cluster_id=1, cnode_ids=[], cnodes=[], domain_name='vippool-1', enable_l3=False, enable_weighted_balancing=False, enabled=True, end_ip='172.21.75.4', guid='f2abaede-b397-413a-8faa-3aeead6d3b28', gw_ip='', gw_ipv6='', id=2, ip_ranges=[['172.21.75.1', '172.21.75.4']], name='vippool-1', peer_asn=0, port_membership='ALL', ranges_summary='172.21.75.[1-4]', role='PROTOCOLS', start_ip='172.21.75.1', subnet_cidr=16, subnet_cidr_ipv6=None, sync='SYNCED', sync_time='2024-05-28T12:50:09.644123Z', tenant_id=1, tenant_name='default', title='172.21.75.1 - 172.21.75.4', url='https://127.0.0.1:40443/api/vippools/2/', vast_asn=0, vlan=0, vms_preferred=False)] May 28 13:01:19 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-781dd131-377a-4e51-8a5e-dc1635ea4ec4 tempest-ShareTypeAvailabilityZonesTest-364532124 None] --- [GET] https://127.0.0.1:40443/api/vippools/: Done May 28 13:01:19 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-781dd131-377a-4e51-8a5e-dc1635ea4ec4 tempest-ShareTypeAvailabilityZonesTest-364532124 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:01:19 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-781dd131-377a-4e51-8a5e-dc1635ea4ec4 tempest-ShareTypeAvailabilityZonesTest-364532124 None] {'allow_redirects': True, May 28 13:01:19 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-781dd131-377a-4e51-8a5e-dc1635ea4ec4 tempest-ShareTypeAvailabilityZonesTest-364532124 None] 'params': {'name': '62476a26-faf7-4184-83e5-45ec72b91d6e'}} May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-3a0c3d22-d984-42f0-8822-59ac0432ce75 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/befd0334-1770-4039-ae51-9c4b0a4bff20 returned with HTTP 202 May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1054/2132] 10.27.203.238 () {62 vars in 1444 bytes} [Tue May 28 13:01:19 2024] DELETE /share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/befd0334-1770-4039-ae51-9c4b0a4bff20 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 6 headers in 242 bytes (1 switches on core 0) May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-40aa2166-0ee9-4d66-b6ef-6ebfbe83a2ed tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] GET http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/befd0334-1770-4039-ae51-9c4b0a4bff20 May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-40aa2166-0ee9-4d66-b6ef-6ebfbe83a2ed tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-40aa2166-0ee9-4d66-b6ef-6ebfbe83a2ed tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Calling method 'SecurityServiceController.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-40aa2166-0ee9-4d66-b6ef-6ebfbe83a2ed tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] HTTP exception thrown: The resource could not be found. May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-40aa2166-0ee9-4d66-b6ef-6ebfbe83a2ed tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/befd0334-1770-4039-ae51-9c4b0a4bff20 returned with HTTP 404 May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1079/2133] 10.27.203.238 () {62 vars in 1441 bytes} [Tue May 28 13:01:19 2024] GET /share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/befd0334-1770-4039-ae51-9c4b0a4bff20 => generated 78 bytes in 8 msecs (HTTP/1.1 404) 6 headers in 236 bytes (1 switches on core 0) May 28 13:01:19 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-0667e4bb-7ea7-4904-a9e4-6bb97486e4cb tempest-ShareRulesTest-2015086173 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.040s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:01:19 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-0667e4bb-7ea7-4904-a9e4-6bb97486e4cb tempest-ShareRulesTest-2015086173 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:01:19 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-0667e4bb-7ea7-4904-a9e4-6bb97486e4cb tempest-ShareRulesTest-2015086173 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-c55d5209-4f46-407f-a12e-ef69a4c8a01c tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] POST http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-c55d5209-4f46-407f-a12e-ef69a4c8a01c tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Action: 'create', calling method: SecurityServiceController.create, body: {"security_service": {"type": "ldap", "name": "ss_ldap", "dns_ip": "1.1.1.1", "server": "fake_server_1", "domain": "fake_domain_1", "user": "fake_user", "password": "***", "ou": "}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-c55d5209-4f46-407f-a12e-ef69a4c8a01c tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services returned with HTTP 200 May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1055/2134] 10.27.203.238 () {64 vars in 1352 bytes} [Tue May 28 13:01:19 2024] POST /share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services => generated 371 bytes in 29 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-1227b189-7c12-4704-9c06-abf8fc989d25 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] POST http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-1227b189-7c12-4704-9c06-abf8fc989d25 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Action: 'create', calling method: SecurityServiceController.create, body: {"security_service": {"type": "kerberos", "name": "ss_kerberos", "dns_ip": "2.2.2.2", "server": "fake_server_2", "domain": "fake_domain_2", "user": "test_user", "password": "***", "ou": "}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:01:19 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-0667e4bb-7ea7-4904-a9e4-6bb97486e4cb tempest-ShareRulesTest-2015086173 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.050s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:01:19 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-0667e4bb-7ea7-4904-a9e4-6bb97486e4cb tempest-ShareRulesTest-2015086173 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:01:19 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-0667e4bb-7ea7-4904-a9e4-6bb97486e4cb tempest-ShareRulesTest-2015086173 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:01:19 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-0667e4bb-7ea7-4904-a9e4-6bb97486e4cb tempest-ShareRulesTest-2015086173 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:01:19 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-0667e4bb-7ea7-4904-a9e4-6bb97486e4cb tempest-ShareRulesTest-2015086173 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-1227b189-7c12-4704-9c06-abf8fc989d25 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services returned with HTTP 200 May 28 13:01:19 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-0667e4bb-7ea7-4904-a9e4-6bb97486e4cb tempest-ShareRulesTest-2015086173 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1080/2135] 10.27.203.238 () {64 vars in 1352 bytes} [Tue May 28 13:01:19 2024] POST /share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services => generated 379 bytes in 21 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:01:19 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-0667e4bb-7ea7-4904-a9e4-6bb97486e4cb tempest-ShareRulesTest-2015086173 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:01:19 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-0667e4bb-7ea7-4904-a9e4-6bb97486e4cb tempest-ShareRulesTest-2015086173 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:01:19 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-0667e4bb-7ea7-4904-a9e4-6bb97486e4cb tempest-ShareRulesTest-2015086173 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-aa2bc435-70db-4ca6-b36b-cd4e7d147beb tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] DELETE http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/8ba6e51e-4952-4940-841d-5d33b149b3b2 May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-aa2bc435-70db-4ca6-b36b-cd4e7d147beb tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-aa2bc435-70db-4ca6-b36b-cd4e7d147beb tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Calling method 'SecurityServiceController.delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.v1.security_service [None req-aa2bc435-70db-4ca6-b36b-cd4e7d147beb tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Delete security service with id: 8ba6e51e-4952-4940-841d-5d33b149b3b2 May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-aa2bc435-70db-4ca6-b36b-cd4e7d147beb tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/8ba6e51e-4952-4940-841d-5d33b149b3b2 returned with HTTP 202 May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1056/2136] 10.27.203.238 () {62 vars in 1444 bytes} [Tue May 28 13:01:19 2024] DELETE /share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/8ba6e51e-4952-4940-841d-5d33b149b3b2 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 6 headers in 242 bytes (1 switches on core 0) May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-126eb533-f6aa-4504-b03a-e884c6fd79be tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] GET http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/8ba6e51e-4952-4940-841d-5d33b149b3b2 May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-126eb533-f6aa-4504-b03a-e884c6fd79be tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-126eb533-f6aa-4504-b03a-e884c6fd79be tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Calling method 'SecurityServiceController.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-126eb533-f6aa-4504-b03a-e884c6fd79be tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] HTTP exception thrown: The resource could not be found. May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-126eb533-f6aa-4504-b03a-e884c6fd79be tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/8ba6e51e-4952-4940-841d-5d33b149b3b2 returned with HTTP 404 May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1081/2137] 10.27.203.238 () {62 vars in 1441 bytes} [Tue May 28 13:01:19 2024] GET /share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/8ba6e51e-4952-4940-841d-5d33b149b3b2 => generated 78 bytes in 9 msecs (HTTP/1.1 404) 6 headers in 236 bytes (1 switches on core 0) May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-e5c530ed-c9ee-49b6-ab74-18812cc4caec tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] DELETE http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/a0484775-ed0e-4bb6-94a6-52330c4dde3d May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-e5c530ed-c9ee-49b6-ab74-18812cc4caec tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-e5c530ed-c9ee-49b6-ab74-18812cc4caec tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Calling method 'SecurityServiceController.delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:19 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-0667e4bb-7ea7-4904-a9e4-6bb97486e4cb tempest-ShareRulesTest-2015086173 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.041s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.v1.security_service [None req-e5c530ed-c9ee-49b6-ab74-18812cc4caec tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Delete security service with id: a0484775-ed0e-4bb6-94a6-52330c4dde3d May 28 13:01:19 l75lg1-v1 manila-share[98474]: INFO manila.share.access [None req-0667e4bb-7ea7-4904-a9e4-6bb97486e4cb tempest-ShareRulesTest-2015086173 None] Access rules were successfully modified for share instance f7e47502-a0f7-44de-953d-b7b5697ae0b2 belonging to share b330db31-7766-443d-9c19-26fe349665aa. May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-e5c530ed-c9ee-49b6-ab74-18812cc4caec tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/a0484775-ed0e-4bb6-94a6-52330c4dde3d returned with HTTP 202 May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1057/2138] 10.27.203.238 () {62 vars in 1444 bytes} [Tue May 28 13:01:19 2024] DELETE /share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/a0484775-ed0e-4bb6-94a6-52330c4dde3d => generated 0 bytes in 23 msecs (HTTP/1.1 202) 6 headers in 242 bytes (1 switches on core 0) May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-a1237bb4-9026-496c-b9a0-598aebbced9e tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] GET http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/a0484775-ed0e-4bb6-94a6-52330c4dde3d May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-a1237bb4-9026-496c-b9a0-598aebbced9e tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-a1237bb4-9026-496c-b9a0-598aebbced9e tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Calling method 'SecurityServiceController.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-a1237bb4-9026-496c-b9a0-598aebbced9e tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] HTTP exception thrown: The resource could not be found. May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-a1237bb4-9026-496c-b9a0-598aebbced9e tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/a0484775-ed0e-4bb6-94a6-52330c4dde3d returned with HTTP 404 May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1082/2139] 10.27.203.238 () {62 vars in 1441 bytes} [Tue May 28 13:01:19 2024] GET /share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/a0484775-ed0e-4bb6-94a6-52330c4dde3d => generated 78 bytes in 8 msecs (HTTP/1.1 404) 6 headers in 236 bytes (1 switches on core 0) May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-7c65c2a1-822d-4bd4-9413-aa95576d1dd6 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] POST http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-7c65c2a1-822d-4bd4-9413-aa95576d1dd6 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Action: 'create', calling method: SecurityServiceController.create, body: {"security_service": {"type": "ldap", "name": "ss_ldap", "dns_ip": "1.1.1.1", "server": "fake_server_1", "domain": "fake_domain_1", "user": "fake_user", "password": "***", "ou": "}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-7c65c2a1-822d-4bd4-9413-aa95576d1dd6 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services returned with HTTP 200 May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1058/2140] 10.27.203.238 () {64 vars in 1352 bytes} [Tue May 28 13:01:19 2024] POST /share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services => generated 371 bytes in 16 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-9df65215-49b7-45fa-a6b3-0a11f4191ee0 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] POST http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-9df65215-49b7-45fa-a6b3-0a11f4191ee0 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Action: 'create', calling method: SecurityServiceController.create, body: {"security_service": {"type": "kerberos", "name": "ss_kerberos", "dns_ip": "2.2.2.2", "server": "fake_server_2", "domain": "fake_domain_2", "user": "test_user", "password": "***", "ou": "}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-9df65215-49b7-45fa-a6b3-0a11f4191ee0 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services returned with HTTP 200 May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1083/2141] 10.27.203.238 () {64 vars in 1352 bytes} [Tue May 28 13:01:19 2024] POST /share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services => generated 379 bytes in 19 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-2fb62f27-52c7-437f-b57c-8497a3b646dd tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] GET http://10.27.203.238/share/v2/f7d59a5c883f4f699e4078430c78ad8d/security-services/detail May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-2fb62f27-52c7-437f-b57c-8497a3b646dd tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-2fb62f27-52c7-437f-b57c-8497a3b646dd tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Calling method 'SecurityServiceController.detail' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.common [None req-2fb62f27-52c7-437f-b57c-8497a3b646dd tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Removing options '' from query {{(pid=98330) remove_invalid_options /opt/stack/manila/manila/api/common.py:441}} May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-2fb62f27-52c7-437f-b57c-8497a3b646dd tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] http://10.27.203.238/share/v2/f7d59a5c883f4f699e4078430c78ad8d/security-services/detail returned with HTTP 200 May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1059/2142] 10.27.203.238 () {64 vars in 1394 bytes} [Tue May 28 13:01:19 2024] GET /share/v2/f7d59a5c883f4f699e4078430c78ad8d/security-services/detail => generated 777 bytes in 17 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-846aff4c-4a87-4caf-af19-82a695fcd54a tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] DELETE http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/56202bc2-d77b-4f20-890a-be968afcd90c May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-846aff4c-4a87-4caf-af19-82a695fcd54a tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-846aff4c-4a87-4caf-af19-82a695fcd54a tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Calling method 'SecurityServiceController.delete' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.v1.security_service [None req-846aff4c-4a87-4caf-af19-82a695fcd54a tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Delete security service with id: 56202bc2-d77b-4f20-890a-be968afcd90c May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-846aff4c-4a87-4caf-af19-82a695fcd54a tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/56202bc2-d77b-4f20-890a-be968afcd90c returned with HTTP 202 May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1084/2143] 10.27.203.238 () {62 vars in 1444 bytes} [Tue May 28 13:01:19 2024] DELETE /share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/56202bc2-d77b-4f20-890a-be968afcd90c => generated 0 bytes in 43 msecs (HTTP/1.1 202) 6 headers in 242 bytes (1 switches on core 0) May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-5169a210-4115-40c8-8330-f572f7be1730 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] GET http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/56202bc2-d77b-4f20-890a-be968afcd90c May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-5169a210-4115-40c8-8330-f572f7be1730 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-5169a210-4115-40c8-8330-f572f7be1730 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Calling method 'SecurityServiceController.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-5169a210-4115-40c8-8330-f572f7be1730 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] HTTP exception thrown: The resource could not be found. May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-5169a210-4115-40c8-8330-f572f7be1730 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/56202bc2-d77b-4f20-890a-be968afcd90c returned with HTTP 404 May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1060/2144] 10.27.203.238 () {62 vars in 1441 bytes} [Tue May 28 13:01:19 2024] GET /share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/56202bc2-d77b-4f20-890a-be968afcd90c => generated 78 bytes in 8 msecs (HTTP/1.1 404) 6 headers in 236 bytes (1 switches on core 0) May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-9a809bad-2489-45c6-bf7d-d85d3bfdaf26 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] DELETE http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/039acb15-626d-45b4-8b8a-e9855cc5a73b May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-9a809bad-2489-45c6-bf7d-d85d3bfdaf26 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-9a809bad-2489-45c6-bf7d-d85d3bfdaf26 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Calling method 'SecurityServiceController.delete' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.v1.security_service [None req-9a809bad-2489-45c6-bf7d-d85d3bfdaf26 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Delete security service with id: 039acb15-626d-45b4-8b8a-e9855cc5a73b May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-9a809bad-2489-45c6-bf7d-d85d3bfdaf26 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/039acb15-626d-45b4-8b8a-e9855cc5a73b returned with HTTP 202 May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1085/2145] 10.27.203.238 () {62 vars in 1444 bytes} [Tue May 28 13:01:19 2024] DELETE /share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/039acb15-626d-45b4-8b8a-e9855cc5a73b => generated 0 bytes in 32 msecs (HTTP/1.1 202) 6 headers in 242 bytes (1 switches on core 0) May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-d4daa771-b6f3-4ee8-9207-d4d09a026a88 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] GET http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/039acb15-626d-45b4-8b8a-e9855cc5a73b May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-d4daa771-b6f3-4ee8-9207-d4d09a026a88 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-d4daa771-b6f3-4ee8-9207-d4d09a026a88 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Calling method 'SecurityServiceController.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-d4daa771-b6f3-4ee8-9207-d4d09a026a88 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] HTTP exception thrown: The resource could not be found. May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-d4daa771-b6f3-4ee8-9207-d4d09a026a88 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/039acb15-626d-45b4-8b8a-e9855cc5a73b returned with HTTP 404 May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1061/2146] 10.27.203.238 () {62 vars in 1441 bytes} [Tue May 28 13:01:19 2024] GET /share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/039acb15-626d-45b4-8b8a-e9855cc5a73b => generated 78 bytes in 8 msecs (HTTP/1.1 404) 6 headers in 236 bytes (1 switches on core 0) May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-866bf752-2e24-4c65-bdfd-8e1228994503 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] POST http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-866bf752-2e24-4c65-bdfd-8e1228994503 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Action: 'create', calling method: SecurityServiceController.create, body: {"security_service": {"type": "ldap", "name": "ss_ldap", "dns_ip": "1.1.1.1", "server": "fake_server_1", "domain": "fake_domain_1", "user": "fake_user", "password": "***", "ou": "}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-866bf752-2e24-4c65-bdfd-8e1228994503 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services returned with HTTP 200 May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1086/2147] 10.27.203.238 () {64 vars in 1352 bytes} [Tue May 28 13:01:19 2024] POST /share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services => generated 371 bytes in 22 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-0871be26-ada2-4f93-b503-373a433910aa tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] POST http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-0871be26-ada2-4f93-b503-373a433910aa tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Action: 'create', calling method: SecurityServiceController.create, body: {"security_service": {"type": "kerberos", "name": "ss_kerberos", "dns_ip": "2.2.2.2", "server": "fake_server_2", "domain": "fake_domain_2", "user": "test_user", "password": "***", "ou": "}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-0871be26-ada2-4f93-b503-373a433910aa tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services returned with HTTP 200 May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1062/2148] 10.27.203.238 () {64 vars in 1352 bytes} [Tue May 28 13:01:19 2024] POST /share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services => generated 379 bytes in 13 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-27ad6680-de05-4eb6-9c12-567425f8856e tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] GET http://10.27.203.238/share/v2/f7d59a5c883f4f699e4078430c78ad8d/security-services/detail May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-27ad6680-de05-4eb6-9c12-567425f8856e tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-27ad6680-de05-4eb6-9c12-567425f8856e tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Calling method 'SecurityServiceController.detail' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.common [None req-27ad6680-de05-4eb6-9c12-567425f8856e tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Removing options '' from query {{(pid=98329) remove_invalid_options /opt/stack/manila/manila/api/common.py:441}} May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-27ad6680-de05-4eb6-9c12-567425f8856e tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] http://10.27.203.238/share/v2/f7d59a5c883f4f699e4078430c78ad8d/security-services/detail returned with HTTP 200 May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1087/2149] 10.27.203.238 () {64 vars in 1394 bytes} [Tue May 28 13:01:19 2024] GET /share/v2/f7d59a5c883f4f699e4078430c78ad8d/security-services/detail => generated 825 bytes in 16 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-98fad119-d47d-414d-a4e3-4be807f4ab81 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] DELETE http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/89393cfb-a865-4101-8e6b-e3cbaada5604 May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-98fad119-d47d-414d-a4e3-4be807f4ab81 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-98fad119-d47d-414d-a4e3-4be807f4ab81 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Calling method 'SecurityServiceController.delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.v1.security_service [None req-98fad119-d47d-414d-a4e3-4be807f4ab81 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Delete security service with id: 89393cfb-a865-4101-8e6b-e3cbaada5604 May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-98fad119-d47d-414d-a4e3-4be807f4ab81 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/89393cfb-a865-4101-8e6b-e3cbaada5604 returned with HTTP 202 May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1063/2150] 10.27.203.238 () {62 vars in 1444 bytes} [Tue May 28 13:01:19 2024] DELETE /share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/89393cfb-a865-4101-8e6b-e3cbaada5604 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 6 headers in 242 bytes (1 switches on core 0) May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-7a173b44-4a56-450c-b040-94d3ecebb8aa tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] GET http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/89393cfb-a865-4101-8e6b-e3cbaada5604 May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-7a173b44-4a56-450c-b040-94d3ecebb8aa tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-7a173b44-4a56-450c-b040-94d3ecebb8aa tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Calling method 'SecurityServiceController.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-7a173b44-4a56-450c-b040-94d3ecebb8aa tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] HTTP exception thrown: The resource could not be found. May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-7a173b44-4a56-450c-b040-94d3ecebb8aa tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/89393cfb-a865-4101-8e6b-e3cbaada5604 returned with HTTP 404 May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1088/2151] 10.27.203.238 () {62 vars in 1441 bytes} [Tue May 28 13:01:19 2024] GET /share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/89393cfb-a865-4101-8e6b-e3cbaada5604 => generated 78 bytes in 8 msecs (HTTP/1.1 404) 6 headers in 236 bytes (1 switches on core 0) May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-2690c281-e65f-4368-a869-7bd6a70dfd33 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] DELETE http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/0708fb84-55b7-4fb7-9091-a2877524d072 May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-2690c281-e65f-4368-a869-7bd6a70dfd33 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-2690c281-e65f-4368-a869-7bd6a70dfd33 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Calling method 'SecurityServiceController.delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.v1.security_service [None req-2690c281-e65f-4368-a869-7bd6a70dfd33 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Delete security service with id: 0708fb84-55b7-4fb7-9091-a2877524d072 May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-2690c281-e65f-4368-a869-7bd6a70dfd33 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/0708fb84-55b7-4fb7-9091-a2877524d072 returned with HTTP 202 May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1064/2152] 10.27.203.238 () {62 vars in 1444 bytes} [Tue May 28 13:01:19 2024] DELETE /share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/0708fb84-55b7-4fb7-9091-a2877524d072 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 6 headers in 242 bytes (1 switches on core 0) May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-60c97f7c-999e-490a-9c77-1a6e18121f98 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] GET http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/0708fb84-55b7-4fb7-9091-a2877524d072 May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-60c97f7c-999e-490a-9c77-1a6e18121f98 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-60c97f7c-999e-490a-9c77-1a6e18121f98 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Calling method 'SecurityServiceController.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-60c97f7c-999e-490a-9c77-1a6e18121f98 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] HTTP exception thrown: The resource could not be found. May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-60c97f7c-999e-490a-9c77-1a6e18121f98 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/0708fb84-55b7-4fb7-9091-a2877524d072 returned with HTTP 404 May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1089/2153] 10.27.203.238 () {62 vars in 1441 bytes} [Tue May 28 13:01:19 2024] GET /share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/0708fb84-55b7-4fb7-9091-a2877524d072 => generated 78 bytes in 8 msecs (HTTP/1.1 404) 6 headers in 236 bytes (1 switches on core 0) May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-8dc7dc32-dac0-4d1c-9bff-0072e594f5aa tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] POST http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-8dc7dc32-dac0-4d1c-9bff-0072e594f5aa tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Action: 'create', calling method: SecurityServiceController.create, body: {"security_service": {"type": "ldap", "name": "ss_ldap", "dns_ip": "1.1.1.1", "server": "fake_server_1", "domain": "fake_domain_1", "user": "fake_user", "password": "***", "ou": "}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-8dc7dc32-dac0-4d1c-9bff-0072e594f5aa tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services returned with HTTP 200 May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1065/2154] 10.27.203.238 () {64 vars in 1352 bytes} [Tue May 28 13:01:19 2024] POST /share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services => generated 371 bytes in 16 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-12c54f59-5849-4b2e-9796-fd314cae47a7 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] POST http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-12c54f59-5849-4b2e-9796-fd314cae47a7 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Action: 'create', calling method: SecurityServiceController.create, body: {"security_service": {"type": "kerberos", "name": "ss_kerberos", "dns_ip": "2.2.2.2", "server": "fake_server_2", "domain": "fake_domain_2", "user": "test_user", "password": "***", "ou": "}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-12c54f59-5849-4b2e-9796-fd314cae47a7 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services returned with HTTP 200 May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1090/2155] 10.27.203.238 () {64 vars in 1352 bytes} [Tue May 28 13:01:19 2024] POST /share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services => generated 379 bytes in 18 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:01:19 l75lg1-v1 nova-conductor[83647]: DEBUG dbcounter [-] [83647] Writing DB stats nova_cell1:SELECT=4,nova_cell1:UPDATE=3 {{(pid=83647) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-92714f31-d1ec-4cdb-91de-fa20be1f57ae tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] GET http://10.27.203.238/share/v2/f7d59a5c883f4f699e4078430c78ad8d/security-services/detail May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-92714f31-d1ec-4cdb-91de-fa20be1f57ae tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-92714f31-d1ec-4cdb-91de-fa20be1f57ae tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Calling method 'SecurityServiceController.detail' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.common [None req-92714f31-d1ec-4cdb-91de-fa20be1f57ae tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Removing options '' from query {{(pid=98330) remove_invalid_options /opt/stack/manila/manila/api/common.py:441}} May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-92714f31-d1ec-4cdb-91de-fa20be1f57ae tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] http://10.27.203.238/share/v2/f7d59a5c883f4f699e4078430c78ad8d/security-services/detail returned with HTTP 200 May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1066/2156] 10.27.203.238 () {64 vars in 1394 bytes} [Tue May 28 13:01:19 2024] GET /share/v2/f7d59a5c883f4f699e4078430c78ad8d/security-services/detail => generated 875 bytes in 17 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-ee1d5f7c-67d1-4da4-8cac-51f25c589884 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] DELETE http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/264d38a2-c2a4-4bc5-bde6-e8ac7d44bbbf May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-ee1d5f7c-67d1-4da4-8cac-51f25c589884 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-ee1d5f7c-67d1-4da4-8cac-51f25c589884 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Calling method 'SecurityServiceController.delete' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.v1.security_service [None req-ee1d5f7c-67d1-4da4-8cac-51f25c589884 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Delete security service with id: 264d38a2-c2a4-4bc5-bde6-e8ac7d44bbbf May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-ee1d5f7c-67d1-4da4-8cac-51f25c589884 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/264d38a2-c2a4-4bc5-bde6-e8ac7d44bbbf returned with HTTP 202 May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1091/2157] 10.27.203.238 () {62 vars in 1444 bytes} [Tue May 28 13:01:19 2024] DELETE /share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/264d38a2-c2a4-4bc5-bde6-e8ac7d44bbbf => generated 0 bytes in 34 msecs (HTTP/1.1 202) 6 headers in 242 bytes (1 switches on core 0) May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-994daf6b-6f42-47ec-9886-f8028a83ed7f tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] GET http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/264d38a2-c2a4-4bc5-bde6-e8ac7d44bbbf May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-994daf6b-6f42-47ec-9886-f8028a83ed7f tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-994daf6b-6f42-47ec-9886-f8028a83ed7f tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Calling method 'SecurityServiceController.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-994daf6b-6f42-47ec-9886-f8028a83ed7f tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] HTTP exception thrown: The resource could not be found. May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-994daf6b-6f42-47ec-9886-f8028a83ed7f tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/264d38a2-c2a4-4bc5-bde6-e8ac7d44bbbf returned with HTTP 404 May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1067/2158] 10.27.203.238 () {62 vars in 1441 bytes} [Tue May 28 13:01:19 2024] GET /share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/264d38a2-c2a4-4bc5-bde6-e8ac7d44bbbf => generated 78 bytes in 8 msecs (HTTP/1.1 404) 6 headers in 236 bytes (1 switches on core 0) May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-0d8148d5-aeb8-4c02-af9e-c08256c1bebd tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] DELETE http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/7f8028d0-05e6-4698-be05-244e8d77a254 May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-0d8148d5-aeb8-4c02-af9e-c08256c1bebd tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-0d8148d5-aeb8-4c02-af9e-c08256c1bebd tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Calling method 'SecurityServiceController.delete' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.v1.security_service [None req-0d8148d5-aeb8-4c02-af9e-c08256c1bebd tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Delete security service with id: 7f8028d0-05e6-4698-be05-244e8d77a254 May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-0d8148d5-aeb8-4c02-af9e-c08256c1bebd tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/7f8028d0-05e6-4698-be05-244e8d77a254 returned with HTTP 202 May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1092/2159] 10.27.203.238 () {62 vars in 1444 bytes} [Tue May 28 13:01:19 2024] DELETE /share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/7f8028d0-05e6-4698-be05-244e8d77a254 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 6 headers in 242 bytes (1 switches on core 0) May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-f4167764-1ee3-47ce-b138-b1d8ad18ed6f tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] GET http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/7f8028d0-05e6-4698-be05-244e8d77a254 May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-f4167764-1ee3-47ce-b138-b1d8ad18ed6f tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-f4167764-1ee3-47ce-b138-b1d8ad18ed6f tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Calling method 'SecurityServiceController.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-f4167764-1ee3-47ce-b138-b1d8ad18ed6f tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] HTTP exception thrown: The resource could not be found. May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-f4167764-1ee3-47ce-b138-b1d8ad18ed6f tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/7f8028d0-05e6-4698-be05-244e8d77a254 returned with HTTP 404 May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1068/2160] 10.27.203.238 () {62 vars in 1441 bytes} [Tue May 28 13:01:19 2024] GET /share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/7f8028d0-05e6-4698-be05-244e8d77a254 => generated 78 bytes in 8 msecs (HTTP/1.1 404) 6 headers in 236 bytes (1 switches on core 0) May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-97e1b2f0-50ca-4133-809a-3f2db7c6e8fb tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] POST http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-97e1b2f0-50ca-4133-809a-3f2db7c6e8fb tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Action: 'create', calling method: SecurityServiceController.create, body: {"security_service": {"type": "ldap", "name": "ss_ldap", "dns_ip": "1.1.1.1", "server": "fake_server_1", "domain": "fake_domain_1", "user": "fake_user", "password": "***", "ou": "}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:01:19 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-781dd131-377a-4e51-8a5e-dc1635ea4ec4 tempest-ShareTypeAvailabilityZonesTest-364532124 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:01:19 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-781dd131-377a-4e51-8a5e-dc1635ea4ec4 tempest-ShareTypeAvailabilityZonesTest-364532124 None] [] May 28 13:01:19 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-781dd131-377a-4e51-8a5e-dc1635ea4ec4 tempest-ShareTypeAvailabilityZonesTest-364532124 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-97e1b2f0-50ca-4133-809a-3f2db7c6e8fb tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services returned with HTTP 200 May 28 13:01:19 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-781dd131-377a-4e51-8a5e-dc1635ea4ec4 tempest-ShareTypeAvailabilityZonesTest-364532124 None] >>> [POST] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:01:19 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-781dd131-377a-4e51-8a5e-dc1635ea4ec4 tempest-ShareTypeAvailabilityZonesTest-364532124 None] {'data': '{"name": "62476a26-faf7-4184-83e5-45ec72b91d6e"}', May 28 13:01:19 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-781dd131-377a-4e51-8a5e-dc1635ea4ec4 tempest-ShareTypeAvailabilityZonesTest-364532124 None] 'json': None, May 28 13:01:19 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-781dd131-377a-4e51-8a5e-dc1635ea4ec4 tempest-ShareTypeAvailabilityZonesTest-364532124 None] 'params': None} May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1093/2161] 10.27.203.238 () {64 vars in 1352 bytes} [Tue May 28 13:01:19 2024] POST /share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services => generated 371 bytes in 15 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-2bf965e5-0d8a-44db-a953-a0e3660e4f72 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] POST http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-2bf965e5-0d8a-44db-a953-a0e3660e4f72 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Action: 'create', calling method: SecurityServiceController.create, body: {"security_service": {"type": "kerberos", "name": "ss_kerberos", "dns_ip": "2.2.2.2", "server": "fake_server_2", "domain": "fake_domain_2", "user": "test_user", "password": "***", "ou": "}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-2bf965e5-0d8a-44db-a953-a0e3660e4f72 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services returned with HTTP 200 May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1069/2162] 10.27.203.238 () {64 vars in 1352 bytes} [Tue May 28 13:01:19 2024] POST /share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services => generated 379 bytes in 18 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:01:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb16c61-07af-45d4-824e-b1b92b192e6f service manila] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-8fb16c61-07af-45d4-824e-b1b92b192e6f service manila] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:01:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb16c61-07af-45d4-824e-b1b92b192e6f service manila] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cf96bb-1e04-422f-8cf9-82f30de4bc61 service manila] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f110cf6300f049c897d0aab63218d1e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cf96bb-1e04-422f-8cf9-82f30de4bc61 service manila] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cf96bb-1e04-422f-8cf9-82f30de4bc61 service manila] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cf96bb-1e04-422f-8cf9-82f30de4bc61 service manila] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cf96bb-1e04-422f-8cf9-82f30de4bc61 service manila] RBAC: Authorizing `identity:validate_token()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cf96bb-1e04-422f-8cf9-82f30de4bc61 service manila] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:19 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1556/3084] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 13:01:19 2024] GET /identity/v3/auth/tokens => generated 3950 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-b160f18e-883f-45cf-9581-022bf6656dc8 tempest-SecurityServicesTest-1715849470 tempest-SecurityServicesTest-1715849470-project-member] POST http://10.27.203.238/share/v2/5386046a212345589b65f0a1a9d526a7/security-services May 28 13:01:19 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-b160f18e-883f-45cf-9581-022bf6656dc8 tempest-SecurityServicesTest-1715849470 tempest-SecurityServicesTest-1715849470-project-member] Action: 'create', calling method: SecurityServiceController.create, body: {"security_service": {"type": "ldap", "name": "tempest-ss-name-1684333533", "description": "tempest-ss-desc-627647615", "dns_ip": "203.0.113.72", "server": "203.0.113.213", "domain": "tempest-ss-domain-1894510413", "user": "tempest-ss-user-170624612", "password": "***"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:01:20 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-b160f18e-883f-45cf-9581-022bf6656dc8 tempest-SecurityServicesTest-1715849470 tempest-SecurityServicesTest-1715849470-project-member] http://10.27.203.238/share/v2/5386046a212345589b65f0a1a9d526a7/security-services returned with HTTP 200 May 28 13:01:20 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1094/2163] 10.27.203.238 () {66 vars in 1395 bytes} [Tue May 28 13:01:19 2024] POST /share/v2/5386046a212345589b65f0a1a9d526a7/security-services => generated 512 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:01:20 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-68786910-091b-459e-952a-0f5fa4fae24e tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] GET http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services?all_tenants=1 May 28 13:01:20 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-68786910-091b-459e-952a-0f5fa4fae24e tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:20 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-68786910-091b-459e-952a-0f5fa4fae24e tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Calling method 'SecurityServiceController.index' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:20 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.common [None req-68786910-091b-459e-952a-0f5fa4fae24e tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Removing options '' from query {{(pid=98330) remove_invalid_options /opt/stack/manila/manila/api/common.py:441}} May 28 13:01:20 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-68786910-091b-459e-952a-0f5fa4fae24e tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services?all_tenants=1 returned with HTTP 200 May 28 13:01:20 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1070/2164] 10.27.203.238 () {62 vars in 1357 bytes} [Tue May 28 13:01:20 2024] GET /share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services?all_tenants=1 => generated 231 bytes in 9 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:01:20 l75lg1-v1 nova-conductor[83648]: DEBUG dbcounter [-] [83648] Writing DB stats nova_cell1:SELECT=1 {{(pid=83648) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:01:20 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-3cf01e71-1956-47db-b801-807ab10f756d tempest-SecurityServicesTest-1715849470 tempest-SecurityServicesTest-1715849470-project-member] DELETE http://10.27.203.238/share/v2/5386046a212345589b65f0a1a9d526a7/security-services/7c81e9d5-b038-4f2b-ae02-3d8224eb2967 May 28 13:01:20 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-3cf01e71-1956-47db-b801-807ab10f756d tempest-SecurityServicesTest-1715849470 tempest-SecurityServicesTest-1715849470-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:20 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-3cf01e71-1956-47db-b801-807ab10f756d tempest-SecurityServicesTest-1715849470 tempest-SecurityServicesTest-1715849470-project-member] Calling method 'SecurityServiceController.delete' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:20 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.v1.security_service [None req-3cf01e71-1956-47db-b801-807ab10f756d tempest-SecurityServicesTest-1715849470 tempest-SecurityServicesTest-1715849470-project-member] Delete security service with id: 7c81e9d5-b038-4f2b-ae02-3d8224eb2967 May 28 13:01:20 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-3cf01e71-1956-47db-b801-807ab10f756d tempest-SecurityServicesTest-1715849470 tempest-SecurityServicesTest-1715849470-project-member] http://10.27.203.238/share/v2/5386046a212345589b65f0a1a9d526a7/security-services/7c81e9d5-b038-4f2b-ae02-3d8224eb2967 returned with HTTP 202 May 28 13:01:20 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1095/2165] 10.27.203.238 () {64 vars in 1487 bytes} [Tue May 28 13:01:20 2024] DELETE /share/v2/5386046a212345589b65f0a1a9d526a7/security-services/7c81e9d5-b038-4f2b-ae02-3d8224eb2967 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 13:01:20 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-eeb3cec1-3b29-4111-b5ec-05cc0a61b1dc tempest-SecurityServicesTest-1715849470 tempest-SecurityServicesTest-1715849470-project-member] GET http://10.27.203.238/share/v2/5386046a212345589b65f0a1a9d526a7/security-services/7c81e9d5-b038-4f2b-ae02-3d8224eb2967 May 28 13:01:20 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-eeb3cec1-3b29-4111-b5ec-05cc0a61b1dc tempest-SecurityServicesTest-1715849470 tempest-SecurityServicesTest-1715849470-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:20 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-eeb3cec1-3b29-4111-b5ec-05cc0a61b1dc tempest-SecurityServicesTest-1715849470 tempest-SecurityServicesTest-1715849470-project-member] Calling method 'SecurityServiceController.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:20 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-eeb3cec1-3b29-4111-b5ec-05cc0a61b1dc tempest-SecurityServicesTest-1715849470 tempest-SecurityServicesTest-1715849470-project-member] HTTP exception thrown: The resource could not be found. May 28 13:01:20 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-eeb3cec1-3b29-4111-b5ec-05cc0a61b1dc tempest-SecurityServicesTest-1715849470 tempest-SecurityServicesTest-1715849470-project-member] http://10.27.203.238/share/v2/5386046a212345589b65f0a1a9d526a7/security-services/7c81e9d5-b038-4f2b-ae02-3d8224eb2967 returned with HTTP 404 May 28 13:01:20 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1071/2166] 10.27.203.238 () {64 vars in 1484 bytes} [Tue May 28 13:01:20 2024] GET /share/v2/5386046a212345589b65f0a1a9d526a7/security-services/7c81e9d5-b038-4f2b-ae02-3d8224eb2967 => generated 78 bytes in 13 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 13:01:20 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-efa93070-8108-4d48-a3b0-d1548e94d2b0 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] DELETE http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/1a03b359-9971-41cf-b3d5-0f827b48ae1d May 28 13:01:20 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-efa93070-8108-4d48-a3b0-d1548e94d2b0 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:20 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-efa93070-8108-4d48-a3b0-d1548e94d2b0 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Calling method 'SecurityServiceController.delete' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:20 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.v1.security_service [None req-efa93070-8108-4d48-a3b0-d1548e94d2b0 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Delete security service with id: 1a03b359-9971-41cf-b3d5-0f827b48ae1d May 28 13:01:20 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-e24d8129-6fa1-429b-8ee3-b707588d4db4 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] GET http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/share-access-rules?share_id=b330db31-7766-443d-9c19-26fe349665aa May 28 13:01:20 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-e24d8129-6fa1-429b-8ee3-b707588d4db4 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:20 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-e24d8129-6fa1-429b-8ee3-b707588d4db4 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:20 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-e24d8129-6fa1-429b-8ee3-b707588d4db4 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/share-access-rules?share_id=b330db31-7766-443d-9c19-26fe349665aa returned with HTTP 200 May 28 13:01:20 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1072/2167] 10.27.203.238 () {64 vars in 1467 bytes} [Tue May 28 13:01:20 2024] GET /share/v2/a4f3887fa28c457390f5b66615564430/share-access-rules?share_id=b330db31-7766-443d-9c19-26fe349665aa => generated 19 bytes in 29 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:01:20 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-efa93070-8108-4d48-a3b0-d1548e94d2b0 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/1a03b359-9971-41cf-b3d5-0f827b48ae1d returned with HTTP 202 May 28 13:01:20 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1096/2168] 10.27.203.238 () {62 vars in 1444 bytes} [Tue May 28 13:01:20 2024] DELETE /share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/1a03b359-9971-41cf-b3d5-0f827b48ae1d => generated 0 bytes in 35 msecs (HTTP/1.1 202) 6 headers in 242 bytes (2 switches on core 0) May 28 13:01:20 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-2703849c-6946-432c-919f-7a658dae8600 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] POST http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/shares/b330db31-7766-443d-9c19-26fe349665aa/action May 28 13:01:20 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-660004e8-dd5a-4557-8569-57968ed1ed83 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] GET http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/1a03b359-9971-41cf-b3d5-0f827b48ae1d May 28 13:01:20 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-2703849c-6946-432c-919f-7a658dae8600 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Action body: b'{"allow_access": {"access_type": "ip", "access_to": "203.0.113.77", "access_level": "rw", "lock_visibility": true}}' {{(pid=98330) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 13:01:20 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-660004e8-dd5a-4557-8569-57968ed1ed83 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:20 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-2703849c-6946-432c-919f-7a658dae8600 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Action: 'action', calling method: ShareController.allow_access, body: {"allow_access": {"access_type": "ip", "access_to": "203.0.113.77", "access_level": "rw", "lock_visibility": true}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:01:20 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-660004e8-dd5a-4557-8569-57968ed1ed83 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Calling method 'SecurityServiceController.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:20 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-660004e8-dd5a-4557-8569-57968ed1ed83 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] HTTP exception thrown: The resource could not be found. May 28 13:01:20 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-660004e8-dd5a-4557-8569-57968ed1ed83 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/1a03b359-9971-41cf-b3d5-0f827b48ae1d returned with HTTP 404 May 28 13:01:20 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1097/2169] 10.27.203.238 () {62 vars in 1441 bytes} [Tue May 28 13:01:20 2024] GET /share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/1a03b359-9971-41cf-b3d5-0f827b48ae1d => generated 78 bytes in 8 msecs (HTTP/1.1 404) 6 headers in 236 bytes (2 switches on core 0) May 28 13:01:20 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-6789b2e5-164f-4161-b948-29d4c3625173 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] DELETE http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/9cde5579-97ff-46e7-8618-c64fa92c0cf2 May 28 13:01:20 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-6789b2e5-164f-4161-b948-29d4c3625173 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:20 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-6789b2e5-164f-4161-b948-29d4c3625173 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Calling method 'SecurityServiceController.delete' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:20 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.v1.security_service [None req-6789b2e5-164f-4161-b948-29d4c3625173 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Delete security service with id: 9cde5579-97ff-46e7-8618-c64fa92c0cf2 May 28 13:01:20 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-6789b2e5-164f-4161-b948-29d4c3625173 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/9cde5579-97ff-46e7-8618-c64fa92c0cf2 returned with HTTP 202 May 28 13:01:20 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1098/2170] 10.27.203.238 () {62 vars in 1444 bytes} [Tue May 28 13:01:20 2024] DELETE /share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/9cde5579-97ff-46e7-8618-c64fa92c0cf2 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 6 headers in 242 bytes (1 switches on core 0) May 28 13:01:20 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-7d1507d9-8c7a-4798-9dca-c312b2ec72f3 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] GET http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/9cde5579-97ff-46e7-8618-c64fa92c0cf2 May 28 13:01:20 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-7d1507d9-8c7a-4798-9dca-c312b2ec72f3 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:20 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-7d1507d9-8c7a-4798-9dca-c312b2ec72f3 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Calling method 'SecurityServiceController.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:20 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-7d1507d9-8c7a-4798-9dca-c312b2ec72f3 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] HTTP exception thrown: The resource could not be found. May 28 13:01:20 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-7d1507d9-8c7a-4798-9dca-c312b2ec72f3 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/9cde5579-97ff-46e7-8618-c64fa92c0cf2 returned with HTTP 404 May 28 13:01:20 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1099/2171] 10.27.203.238 () {62 vars in 1441 bytes} [Tue May 28 13:01:20 2024] GET /share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/9cde5579-97ff-46e7-8618-c64fa92c0cf2 => generated 78 bytes in 8 msecs (HTTP/1.1 404) 6 headers in 236 bytes (2 switches on core 0) May 28 13:01:20 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-446c733c-1afe-4fc6-aee8-5c3724d14d38 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] POST http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services May 28 13:01:20 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-446c733c-1afe-4fc6-aee8-5c3724d14d38 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Action: 'create', calling method: SecurityServiceController.create, body: {"security_service": {"type": "ldap", "name": "ss_ldap", "dns_ip": "1.1.1.1", "server": "fake_server_1", "domain": "fake_domain_1", "user": "fake_user", "password": "***", "ou": "}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:01:20 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-2703849c-6946-432c-919f-7a658dae8600 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:01:20 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-2703849c-6946-432c-919f-7a658dae8600 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:01:20 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-446c733c-1afe-4fc6-aee8-5c3724d14d38 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services returned with HTTP 200 May 28 13:01:20 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1100/2172] 10.27.203.238 () {64 vars in 1352 bytes} [Tue May 28 13:01:20 2024] POST /share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services => generated 371 bytes in 17 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:01:20 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-15b8ea14-ec4b-4471-a12e-b380d53debae tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] POST http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services May 28 13:01:20 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-15b8ea14-ec4b-4471-a12e-b380d53debae tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Action: 'create', calling method: SecurityServiceController.create, body: {"security_service": {"type": "kerberos", "name": "ss_kerberos", "dns_ip": "2.2.2.2", "server": "fake_server_2", "domain": "fake_domain_2", "user": "test_user", "password": "***", "ou": "}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:01:20 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-15b8ea14-ec4b-4471-a12e-b380d53debae tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services returned with HTTP 200 May 28 13:01:20 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1101/2173] 10.27.203.238 () {64 vars in 1352 bytes} [Tue May 28 13:01:20 2024] POST /share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services => generated 379 bytes in 15 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:01:20 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-64dabcd2-7f29-4c11-ad50-1c90a871aee0 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] POST http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services May 28 13:01:20 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-64dabcd2-7f29-4c11-ad50-1c90a871aee0 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Action: 'create', calling method: SecurityServiceController.create, body: {"security_service": {"type": "ldap", "name": "tempest-ss-name-993208030", "description": "tempest-ss-desc-1073194536", "dns_ip": "203.0.113.154", "server": "203.0.113.95", "domain": "tempest-ss-domain-42504834", "user": "tempest-ss-user-499796154", "password": "***"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:01:20 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-2703849c-6946-432c-919f-7a658dae8600 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.039s {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:01:20 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-64dabcd2-7f29-4c11-ad50-1c90a871aee0 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services returned with HTTP 200 May 28 13:01:20 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1102/2174] 10.27.203.238 () {64 vars in 1352 bytes} [Tue May 28 13:01:20 2024] POST /share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services => generated 473 bytes in 22 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:01:20 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-ae2f83d6-245d-47f1-a26e-06e4dc3497af tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] PUT http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/ed101eb7-b7d6-4553-916d-5f67bf5eaf8e May 28 13:01:20 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-ae2f83d6-245d-47f1-a26e-06e4dc3497af tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Action: 'update', calling method: SecurityServiceController.update, body: {"security_service": {"name": "tempest-ss-name-51220647", "description": "tempest-ss-desc-514109526", "dns_ip": "203.0.113.192", "server": "203.0.113.2", "domain": "tempest-ss-domain-567980087", "user": "tempest-ss-user-1660784469", "password": "***"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:01:20 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-2703849c-6946-432c-919f-7a658dae8600 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/shares/b330db31-7766-443d-9c19-26fe349665aa/action returned with HTTP 200 May 28 13:01:20 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1073/2175] 10.27.203.238 () {66 vars in 1494 bytes} [Tue May 28 13:01:20 2024] POST /share/v2/a4f3887fa28c457390f5b66615564430/shares/b330db31-7766-443d-9c19-26fe349665aa/action => generated 310 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:01:20 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-f383f776-be47-4787-941d-fb4c7a7f00de tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] GET http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/share-access-rules?share_id=b330db31-7766-443d-9c19-26fe349665aa May 28 13:01:20 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-f383f776-be47-4787-941d-fb4c7a7f00de tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:20 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-f383f776-be47-4787-941d-fb4c7a7f00de tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:20 l75lg1-v1 manila-share[98474]: DEBUG manila.share.manager [None req-2703849c-6946-432c-919f-7a658dae8600 tempest-ShareRulesTest-1530341375 None] Received request to update access for share instance f7e47502-a0f7-44de-953d-b7b5697ae0b2. {{(pid=98474) update_access_for_instances /opt/stack/manila/manila/share/manager.py:4353}} May 28 13:01:20 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-ae2f83d6-245d-47f1-a26e-06e4dc3497af tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/ed101eb7-b7d6-4553-916d-5f67bf5eaf8e returned with HTTP 200 May 28 13:01:20 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1103/2176] 10.27.203.238 () {64 vars in 1462 bytes} [Tue May 28 13:01:20 2024] PUT /share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/ed101eb7-b7d6-4553-916d-5f67bf5eaf8e => generated 495 bytes in 27 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:01:20 l75lg1-v1 dstat.sh[49771]: 28-05 13:01:20| 11 2 82 5 0|5700M 1740M 278M 7906M| 15k 22k| 0 4154k| 0 544 |9140 15k|1.51 1.23 1.08|3.0 1.0 0| 0 0 | 0 2048M| 29 365 0 37 2 May 28 13:01:20 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-c05b5249-9554-45e8-a1f5-71e496c51635 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] GET http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/ed101eb7-b7d6-4553-916d-5f67bf5eaf8e May 28 13:01:20 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-c05b5249-9554-45e8-a1f5-71e496c51635 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:20 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-c05b5249-9554-45e8-a1f5-71e496c51635 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Calling method 'SecurityServiceController.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:20 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-2703849c-6946-432c-919f-7a658dae8600 tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:01:20 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-2703849c-6946-432c-919f-7a658dae8600 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:01:20 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-c05b5249-9554-45e8-a1f5-71e496c51635 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/ed101eb7-b7d6-4553-916d-5f67bf5eaf8e returned with HTTP 200 May 28 13:01:20 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1104/2177] 10.27.203.238 () {62 vars in 1441 bytes} [Tue May 28 13:01:20 2024] GET /share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/ed101eb7-b7d6-4553-916d-5f67bf5eaf8e => generated 495 bytes in 8 msecs (HTTP/1.1 200) 6 headers in 230 bytes (2 switches on core 0) May 28 13:01:20 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-2703849c-6946-432c-919f-7a658dae8600 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.004s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:01:20 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-2703849c-6946-432c-919f-7a658dae8600 tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:01:20 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-2703849c-6946-432c-919f-7a658dae8600 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:01:20 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-dcf8a506-35c0-47c2-bde9-dda836045e0e tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] PUT http://10.27.203.238/share/v2/f7d59a5c883f4f699e4078430c78ad8d/security-services/ed101eb7-b7d6-4553-916d-5f67bf5eaf8e May 28 13:01:20 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-dcf8a506-35c0-47c2-bde9-dda836045e0e tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Action: 'update', calling method: SecurityServiceController.update, body: {"security_service": {"name": "tempest-ss-name-1791005525", "description": "tempest-ss-desc-2131436101", "dns_ip": "203.0.113.109", "server": "203.0.113.44", "domain": "tempest-ss-domain-1517681806", "user": "tempest-ss-user-77137513", "password": "***", "ou": "}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:01:20 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.lock.api [None req-f383f776-be47-4787-941d-fb4c7a7f00de tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Searching for locks by: {'resource_id': 'dca77461-e33f-4c3b-80d1-35fc9e78f7d0', 'resource_action': 'show', 'resource_type': 'access_rule'} {{(pid=98330) get_all /opt/stack/manila/manila/lock/api.py:112}} May 28 13:01:20 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-f383f776-be47-4787-941d-fb4c7a7f00de tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/share-access-rules?share_id=b330db31-7766-443d-9c19-26fe349665aa returned with HTTP 200 May 28 13:01:20 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1074/2178] 10.27.203.238 () {64 vars in 1467 bytes} [Tue May 28 13:01:20 2024] GET /share/v2/a4f3887fa28c457390f5b66615564430/share-access-rules?share_id=b330db31-7766-443d-9c19-26fe349665aa => generated 265 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:01:20 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-dcf8a506-35c0-47c2-bde9-dda836045e0e tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] http://10.27.203.238/share/v2/f7d59a5c883f4f699e4078430c78ad8d/security-services/ed101eb7-b7d6-4553-916d-5f67bf5eaf8e returned with HTTP 200 May 28 13:01:20 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1105/2179] 10.27.203.238 () {66 vars in 1505 bytes} [Tue May 28 13:01:20 2024] PUT /share/v2/f7d59a5c883f4f699e4078430c78ad8d/security-services/ed101eb7-b7d6-4553-916d-5f67bf5eaf8e => generated 556 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:01:20 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-b9a5667a-3e9d-40fa-b5e5-6cae0cf64a7f tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] GET http://10.27.203.238/share/v2/f7d59a5c883f4f699e4078430c78ad8d/security-services/ed101eb7-b7d6-4553-916d-5f67bf5eaf8e May 28 13:01:20 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-b9a5667a-3e9d-40fa-b5e5-6cae0cf64a7f tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:20 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-b9a5667a-3e9d-40fa-b5e5-6cae0cf64a7f tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Calling method 'SecurityServiceController.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:20 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-b9a5667a-3e9d-40fa-b5e5-6cae0cf64a7f tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] http://10.27.203.238/share/v2/f7d59a5c883f4f699e4078430c78ad8d/security-services/ed101eb7-b7d6-4553-916d-5f67bf5eaf8e returned with HTTP 200 May 28 13:01:20 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1075/2180] 10.27.203.238 () {64 vars in 1484 bytes} [Tue May 28 13:01:20 2024] GET /share/v2/f7d59a5c883f4f699e4078430c78ad8d/security-services/ed101eb7-b7d6-4553-916d-5f67bf5eaf8e => generated 556 bytes in 10 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:01:20 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-7cf0123f-3ae4-470b-8b8c-4c0edc8f87e2 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] DELETE http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/ed101eb7-b7d6-4553-916d-5f67bf5eaf8e May 28 13:01:20 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-7cf0123f-3ae4-470b-8b8c-4c0edc8f87e2 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:20 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-7cf0123f-3ae4-470b-8b8c-4c0edc8f87e2 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Calling method 'SecurityServiceController.delete' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:20 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.v1.security_service [None req-7cf0123f-3ae4-470b-8b8c-4c0edc8f87e2 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Delete security service with id: ed101eb7-b7d6-4553-916d-5f67bf5eaf8e May 28 13:01:20 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-2703849c-6946-432c-919f-7a658dae8600 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.071s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:01:20 l75lg1-v1 manila-share[98474]: DEBUG manila.share.access [None req-2703849c-6946-432c-919f-7a658dae8600 tempest-ShareRulesTest-1530341375 None] Updating access rules for share instance f7e47502-a0f7-44de-953d-b7b5697ae0b2 belonging to share b330db31-7766-443d-9c19-26fe349665aa. {{(pid=98474) update_access_rules /opt/stack/manila/manila/share/access.py:298}} May 28 13:01:20 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-2703849c-6946-432c-919f-7a658dae8600 tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:01:20 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-2703849c-6946-432c-919f-7a658dae8600 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:01:20 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-7cf0123f-3ae4-470b-8b8c-4c0edc8f87e2 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/ed101eb7-b7d6-4553-916d-5f67bf5eaf8e returned with HTTP 202 May 28 13:01:20 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1106/2181] 10.27.203.238 () {62 vars in 1444 bytes} [Tue May 28 13:01:20 2024] DELETE /share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/ed101eb7-b7d6-4553-916d-5f67bf5eaf8e => generated 0 bytes in 28 msecs (HTTP/1.1 202) 6 headers in 242 bytes (1 switches on core 0) May 28 13:01:20 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-0f2068e4-df75-4493-b547-c29cc55cbcdd tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] GET http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/ed101eb7-b7d6-4553-916d-5f67bf5eaf8e May 28 13:01:20 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-0f2068e4-df75-4493-b547-c29cc55cbcdd tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:20 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-0f2068e4-df75-4493-b547-c29cc55cbcdd tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Calling method 'SecurityServiceController.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:20 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-2703849c-6946-432c-919f-7a658dae8600 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.010s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:01:20 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-2703849c-6946-432c-919f-7a658dae8600 tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:01:20 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-2703849c-6946-432c-919f-7a658dae8600 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:01:20 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-0f2068e4-df75-4493-b547-c29cc55cbcdd tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] HTTP exception thrown: The resource could not be found. May 28 13:01:20 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-0f2068e4-df75-4493-b547-c29cc55cbcdd tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/ed101eb7-b7d6-4553-916d-5f67bf5eaf8e returned with HTTP 404 May 28 13:01:20 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1076/2182] 10.27.203.238 () {62 vars in 1441 bytes} [Tue May 28 13:01:20 2024] GET /share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/ed101eb7-b7d6-4553-916d-5f67bf5eaf8e => generated 78 bytes in 12 msecs (HTTP/1.1 404) 6 headers in 236 bytes (1 switches on core 0) May 28 13:01:20 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-ce672f23-57c3-4f8a-98ba-e0f551faabaa tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] DELETE http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/68687d56-7ca0-4ced-9417-3646221aa221 May 28 13:01:20 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-ce672f23-57c3-4f8a-98ba-e0f551faabaa tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:20 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-ce672f23-57c3-4f8a-98ba-e0f551faabaa tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Calling method 'SecurityServiceController.delete' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:20 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.v1.security_service [None req-ce672f23-57c3-4f8a-98ba-e0f551faabaa tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Delete security service with id: 68687d56-7ca0-4ced-9417-3646221aa221 May 28 13:01:20 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-2703849c-6946-432c-919f-7a658dae8600 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.015s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:01:20 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-2703849c-6946-432c-919f-7a658dae8600 tempest-ShareRulesTest-1530341375 None] changing access on None May 28 13:01:20 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2703849c-6946-432c-919f-7a658dae8600 tempest-ShareRulesTest-1530341375 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:01:20 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2703849c-6946-432c-919f-7a658dae8600 tempest-ShareRulesTest-1530341375 None] {'allow_redirects': True, May 28 13:01:20 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2703849c-6946-432c-919f-7a658dae8600 tempest-ShareRulesTest-1530341375 None] 'params': {'name': 'f7e47502-a0f7-44de-953d-b7b5697ae0b2'}} May 28 13:01:20 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-ce672f23-57c3-4f8a-98ba-e0f551faabaa tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/68687d56-7ca0-4ced-9417-3646221aa221 returned with HTTP 202 May 28 13:01:20 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1107/2183] 10.27.203.238 () {62 vars in 1444 bytes} [Tue May 28 13:01:20 2024] DELETE /share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/68687d56-7ca0-4ced-9417-3646221aa221 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 6 headers in 242 bytes (1 switches on core 0) May 28 13:01:20 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-5da18d53-a62b-4140-96e0-66be57272213 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] GET http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/68687d56-7ca0-4ced-9417-3646221aa221 May 28 13:01:20 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-5da18d53-a62b-4140-96e0-66be57272213 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:20 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-5da18d53-a62b-4140-96e0-66be57272213 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Calling method 'SecurityServiceController.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:20 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-5da18d53-a62b-4140-96e0-66be57272213 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] HTTP exception thrown: The resource could not be found. May 28 13:01:20 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-5da18d53-a62b-4140-96e0-66be57272213 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/68687d56-7ca0-4ced-9417-3646221aa221 returned with HTTP 404 May 28 13:01:20 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1077/2184] 10.27.203.238 () {62 vars in 1441 bytes} [Tue May 28 13:01:20 2024] GET /share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/68687d56-7ca0-4ced-9417-3646221aa221 => generated 78 bytes in 12 msecs (HTTP/1.1 404) 6 headers in 236 bytes (1 switches on core 0) May 28 13:01:20 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-a80d8b83-820f-4479-bcbc-b758f6972b82 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] DELETE http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/4f31ca1b-ee57-4854-807d-ac81f64bc4d0 May 28 13:01:20 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-a80d8b83-820f-4479-bcbc-b758f6972b82 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:20 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-a80d8b83-820f-4479-bcbc-b758f6972b82 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Calling method 'SecurityServiceController.delete' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:20 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.v1.security_service [None req-a80d8b83-820f-4479-bcbc-b758f6972b82 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Delete security service with id: 4f31ca1b-ee57-4854-807d-ac81f64bc4d0 May 28 13:01:20 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-a80d8b83-820f-4479-bcbc-b758f6972b82 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/4f31ca1b-ee57-4854-807d-ac81f64bc4d0 returned with HTTP 202 May 28 13:01:20 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1108/2185] 10.27.203.238 () {62 vars in 1444 bytes} [Tue May 28 13:01:20 2024] DELETE /share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/4f31ca1b-ee57-4854-807d-ac81f64bc4d0 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 6 headers in 242 bytes (1 switches on core 0) May 28 13:01:20 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-01b27b65-f957-4c2a-a8e6-e1d6ffbea013 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] GET http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/4f31ca1b-ee57-4854-807d-ac81f64bc4d0 May 28 13:01:20 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-01b27b65-f957-4c2a-a8e6-e1d6ffbea013 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:20 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-01b27b65-f957-4c2a-a8e6-e1d6ffbea013 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] Calling method 'SecurityServiceController.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:20 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-01b27b65-f957-4c2a-a8e6-e1d6ffbea013 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] HTTP exception thrown: The resource could not be found. May 28 13:01:20 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-01b27b65-f957-4c2a-a8e6-e1d6ffbea013 tempest-SecurityServicesTest-898968317 tempest-SecurityServicesTest-898968317-project-member] http://10.27.203.238/share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/4f31ca1b-ee57-4854-807d-ac81f64bc4d0 returned with HTTP 404 May 28 13:01:20 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1078/2186] 10.27.203.238 () {62 vars in 1441 bytes} [Tue May 28 13:01:20 2024] GET /share/v1/f7d59a5c883f4f699e4078430c78ad8d/security-services/4f31ca1b-ee57-4854-807d-ac81f64bc4d0 => generated 78 bytes in 13 msecs (HTTP/1.1 404) 6 headers in 236 bytes (1 switches on core 0) May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1542409d-b61e-452b-a02c-1ddfe0c6f3d5 service manila] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1542409d-b61e-452b-a02c-1ddfe0c6f3d5 service manila] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7515ffb5-5db0-4181-bea1-1cac1d787101 tempest-SecurityServicesTest-925215740 tempest-SecurityServicesTest-925215740-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '940148b13d07445e8512baadc6d7fa72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd920199a0bc342fd8f081923701e198c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7515ffb5-5db0-4181-bea1-1cac1d787101 tempest-SecurityServicesTest-925215740 tempest-SecurityServicesTest-925215740-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7515ffb5-5db0-4181-bea1-1cac1d787101 tempest-SecurityServicesTest-925215740 tempest-SecurityServicesTest-925215740-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7515ffb5-5db0-4181-bea1-1cac1d787101 tempest-SecurityServicesTest-925215740 tempest-SecurityServicesTest-925215740-project-admin] PATH_INFO: `/v3/users/5000ae7b72ab4d8aad66382d4e873caf` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7515ffb5-5db0-4181-bea1-1cac1d787101 tempest-SecurityServicesTest-925215740 tempest-SecurityServicesTest-925215740-project-admin] RBAC: Authorizing `identity:delete_user(user_id=5000ae7b72ab4d8aad66382d4e873caf)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7515ffb5-5db0-4181-bea1-1cac1d787101 tempest-SecurityServicesTest-925215740 tempest-SecurityServicesTest-925215740-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-7515ffb5-5db0-4181-bea1-1cac1d787101 tempest-SecurityServicesTest-925215740 tempest-SecurityServicesTest-925215740-project-admin] Could not find user: 5000ae7b72ab4d8aad66382d4e873caf.: keystone.exception.UserNotFound: Could not find user: 5000ae7b72ab4d8aad66382d4e873caf. May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 5000ae7b72ab4d8aad66382d4e873caf. May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1529/3085] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:01:20 2024] DELETE /identity/v3/users/5000ae7b72ab4d8aad66382d4e873caf => generated 110 bytes in 26 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cf96bb-1e04-422f-8cf9-82f30de4bc61 service manila] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cf96bb-1e04-422f-8cf9-82f30de4bc61 service manila] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df32bd94-fb6c-4209-8c38-9c20c908a620 tempest-SecurityServicesTest-925215740 tempest-SecurityServicesTest-925215740-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '940148b13d07445e8512baadc6d7fa72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd920199a0bc342fd8f081923701e198c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df32bd94-fb6c-4209-8c38-9c20c908a620 tempest-SecurityServicesTest-925215740 tempest-SecurityServicesTest-925215740-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df32bd94-fb6c-4209-8c38-9c20c908a620 tempest-SecurityServicesTest-925215740 tempest-SecurityServicesTest-925215740-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df32bd94-fb6c-4209-8c38-9c20c908a620 tempest-SecurityServicesTest-925215740 tempest-SecurityServicesTest-925215740-project-admin] PATH_INFO: `/v3/users/3fc09c87f69946d2bf009e72ac589cd4` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df32bd94-fb6c-4209-8c38-9c20c908a620 tempest-SecurityServicesTest-925215740 tempest-SecurityServicesTest-925215740-project-admin] RBAC: Authorizing `identity:delete_user(user_id=3fc09c87f69946d2bf009e72ac589cd4)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df32bd94-fb6c-4209-8c38-9c20c908a620 tempest-SecurityServicesTest-925215740 tempest-SecurityServicesTest-925215740-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-df32bd94-fb6c-4209-8c38-9c20c908a620 tempest-SecurityServicesTest-925215740 tempest-SecurityServicesTest-925215740-project-admin] Could not find user: 3fc09c87f69946d2bf009e72ac589cd4.: keystone.exception.UserNotFound: Could not find user: 3fc09c87f69946d2bf009e72ac589cd4. May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 3fc09c87f69946d2bf009e72ac589cd4. May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1557/3086] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:01:20 2024] DELETE /identity/v3/users/3fc09c87f69946d2bf009e72ac589cd4 => generated 110 bytes in 25 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7515ffb5-5db0-4181-bea1-1cac1d787101 tempest-SecurityServicesTest-925215740 tempest-SecurityServicesTest-925215740-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7515ffb5-5db0-4181-bea1-1cac1d787101 tempest-SecurityServicesTest-925215740 tempest-SecurityServicesTest-925215740-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae1cba1-76b9-49fa-b723-a97124dbd08a tempest-SecurityServicesTest-925215740 tempest-SecurityServicesTest-925215740-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '940148b13d07445e8512baadc6d7fa72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd920199a0bc342fd8f081923701e198c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae1cba1-76b9-49fa-b723-a97124dbd08a tempest-SecurityServicesTest-925215740 tempest-SecurityServicesTest-925215740-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae1cba1-76b9-49fa-b723-a97124dbd08a tempest-SecurityServicesTest-925215740 tempest-SecurityServicesTest-925215740-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae1cba1-76b9-49fa-b723-a97124dbd08a tempest-SecurityServicesTest-925215740 tempest-SecurityServicesTest-925215740-project-admin] PATH_INFO: `/v3/users/6533c69a593a4e35a8693da46fbd9f3b` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae1cba1-76b9-49fa-b723-a97124dbd08a tempest-SecurityServicesTest-925215740 tempest-SecurityServicesTest-925215740-project-admin] RBAC: Authorizing `identity:delete_user(user_id=6533c69a593a4e35a8693da46fbd9f3b)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae1cba1-76b9-49fa-b723-a97124dbd08a tempest-SecurityServicesTest-925215740 tempest-SecurityServicesTest-925215740-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-4ae1cba1-76b9-49fa-b723-a97124dbd08a tempest-SecurityServicesTest-925215740 tempest-SecurityServicesTest-925215740-project-admin] Could not find user: 6533c69a593a4e35a8693da46fbd9f3b.: keystone.exception.UserNotFound: Could not find user: 6533c69a593a4e35a8693da46fbd9f3b. May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 6533c69a593a4e35a8693da46fbd9f3b. May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1530/3087] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:01:20 2024] DELETE /identity/v3/users/6533c69a593a4e35a8693da46fbd9f3b => generated 110 bytes in 24 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df32bd94-fb6c-4209-8c38-9c20c908a620 tempest-SecurityServicesTest-925215740 tempest-SecurityServicesTest-925215740-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df32bd94-fb6c-4209-8c38-9c20c908a620 tempest-SecurityServicesTest-925215740 tempest-SecurityServicesTest-925215740-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7adcc0-a679-4048-9bc4-1730e43318e2 tempest-SecurityServicesTest-925215740 tempest-SecurityServicesTest-925215740-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '940148b13d07445e8512baadc6d7fa72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd920199a0bc342fd8f081923701e198c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7adcc0-a679-4048-9bc4-1730e43318e2 tempest-SecurityServicesTest-925215740 tempest-SecurityServicesTest-925215740-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7adcc0-a679-4048-9bc4-1730e43318e2 tempest-SecurityServicesTest-925215740 tempest-SecurityServicesTest-925215740-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7adcc0-a679-4048-9bc4-1730e43318e2 tempest-SecurityServicesTest-925215740 tempest-SecurityServicesTest-925215740-project-admin] PATH_INFO: `/v3/users/929590f760014a429cece4b4e674f84e` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7adcc0-a679-4048-9bc4-1730e43318e2 tempest-SecurityServicesTest-925215740 tempest-SecurityServicesTest-925215740-project-admin] RBAC: Authorizing `identity:delete_user(user_id=929590f760014a429cece4b4e674f84e)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7adcc0-a679-4048-9bc4-1730e43318e2 tempest-SecurityServicesTest-925215740 tempest-SecurityServicesTest-925215740-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-ea7adcc0-a679-4048-9bc4-1730e43318e2 tempest-SecurityServicesTest-925215740 tempest-SecurityServicesTest-925215740-project-admin] Could not find user: 929590f760014a429cece4b4e674f84e.: keystone.exception.UserNotFound: Could not find user: 929590f760014a429cece4b4e674f84e. May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 929590f760014a429cece4b4e674f84e. May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1558/3088] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:01:20 2024] DELETE /identity/v3/users/929590f760014a429cece4b4e674f84e => generated 110 bytes in 23 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae1cba1-76b9-49fa-b723-a97124dbd08a tempest-SecurityServicesTest-925215740 tempest-SecurityServicesTest-925215740-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae1cba1-76b9-49fa-b723-a97124dbd08a tempest-SecurityServicesTest-925215740 tempest-SecurityServicesTest-925215740-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a0473f-1cd8-43a6-b268-2bac8e503cd8 tempest-SecurityServicesTest-925215740 tempest-SecurityServicesTest-925215740-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '940148b13d07445e8512baadc6d7fa72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd920199a0bc342fd8f081923701e198c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a0473f-1cd8-43a6-b268-2bac8e503cd8 tempest-SecurityServicesTest-925215740 tempest-SecurityServicesTest-925215740-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a0473f-1cd8-43a6-b268-2bac8e503cd8 tempest-SecurityServicesTest-925215740 tempest-SecurityServicesTest-925215740-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a0473f-1cd8-43a6-b268-2bac8e503cd8 tempest-SecurityServicesTest-925215740 tempest-SecurityServicesTest-925215740-project-admin] PATH_INFO: `/v3/users/7ad2c2df894f4bca82e33623064ce809` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a0473f-1cd8-43a6-b268-2bac8e503cd8 tempest-SecurityServicesTest-925215740 tempest-SecurityServicesTest-925215740-project-admin] RBAC: Authorizing `identity:delete_user(user_id=7ad2c2df894f4bca82e33623064ce809)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a0473f-1cd8-43a6-b268-2bac8e503cd8 tempest-SecurityServicesTest-925215740 tempest-SecurityServicesTest-925215740-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-16a0473f-1cd8-43a6-b268-2bac8e503cd8 tempest-SecurityServicesTest-925215740 tempest-SecurityServicesTest-925215740-project-admin] Could not find user: 7ad2c2df894f4bca82e33623064ce809.: keystone.exception.UserNotFound: Could not find user: 7ad2c2df894f4bca82e33623064ce809. May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 7ad2c2df894f4bca82e33623064ce809. May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1531/3089] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:01:20 2024] DELETE /identity/v3/users/7ad2c2df894f4bca82e33623064ce809 => generated 110 bytes in 25 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7adcc0-a679-4048-9bc4-1730e43318e2 tempest-SecurityServicesTest-925215740 tempest-SecurityServicesTest-925215740-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7adcc0-a679-4048-9bc4-1730e43318e2 tempest-SecurityServicesTest-925215740 tempest-SecurityServicesTest-925215740-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8375793a-98ca-4891-b909-6eade95d8f86 tempest-SecurityServicesTest-925215740 tempest-SecurityServicesTest-925215740-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '940148b13d07445e8512baadc6d7fa72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd920199a0bc342fd8f081923701e198c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8375793a-98ca-4891-b909-6eade95d8f86 tempest-SecurityServicesTest-925215740 tempest-SecurityServicesTest-925215740-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8375793a-98ca-4891-b909-6eade95d8f86 tempest-SecurityServicesTest-925215740 tempest-SecurityServicesTest-925215740-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8375793a-98ca-4891-b909-6eade95d8f86 tempest-SecurityServicesTest-925215740 tempest-SecurityServicesTest-925215740-project-admin] PATH_INFO: `/v3/users/43487099e439456094fb5cfc0ae825c5` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8375793a-98ca-4891-b909-6eade95d8f86 tempest-SecurityServicesTest-925215740 tempest-SecurityServicesTest-925215740-project-admin] RBAC: Authorizing `identity:delete_user(user_id=43487099e439456094fb5cfc0ae825c5)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8375793a-98ca-4891-b909-6eade95d8f86 tempest-SecurityServicesTest-925215740 tempest-SecurityServicesTest-925215740-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:20 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-781dd131-377a-4e51-8a5e-dc1635ea4ec4 tempest-ShareTypeAvailabilityZonesTest-364532124 None] <<< [POST] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:01:20 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-781dd131-377a-4e51-8a5e-dc1635ea4ec4 tempest-ShareTypeAvailabilityZonesTest-364532124 None] Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=0, created='2024-05-28T13:01:20.233558Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='0eeff5ee-7891-44ed-97d2-abb78004f837', id=50, internal=False, is_s3_default_policy=False, name='62476a26-faf7-4184-83e5-45ec72b91d6e', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=[], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['*'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['*'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T13:01:20.558698Z', tenant_id=1, tenant_name='default', title='62476a26-faf7-4184-83e5-45ec72b91d6e', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/50/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[]) May 28 13:01:20 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-781dd131-377a-4e51-8a5e-dc1635ea4ec4 tempest-ShareTypeAvailabilityZonesTest-364532124 None] --- [POST] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 13:01:20 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-781dd131-377a-4e51-8a5e-dc1635ea4ec4 tempest-ShareTypeAvailabilityZonesTest-364532124 None] >>> [GET] https://127.0.0.1:40443/api/quotas/ May 28 13:01:20 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-781dd131-377a-4e51-8a5e-dc1635ea4ec4 tempest-ShareTypeAvailabilityZonesTest-364532124 None] {'allow_redirects': True, May 28 13:01:20 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-781dd131-377a-4e51-8a5e-dc1635ea4ec4 tempest-ShareTypeAvailabilityZonesTest-364532124 None] 'params': {'name': '62476a26-faf7-4184-83e5-45ec72b91d6e'}} May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-8375793a-98ca-4891-b909-6eade95d8f86 tempest-SecurityServicesTest-925215740 tempest-SecurityServicesTest-925215740-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43487099e439456094fb5cfc0ae825c5', 'request_id': 'req-8375793a-98ca-4891-b909-6eade95d8f86'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-8375793a-98ca-4891-b909-6eade95d8f86 tempest-SecurityServicesTest-925215740 tempest-SecurityServicesTest-925215740-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43487099e439456094fb5cfc0ae825c5', 'request_id': 'req-8375793a-98ca-4891-b909-6eade95d8f86'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-8375793a-98ca-4891-b909-6eade95d8f86 tempest-SecurityServicesTest-925215740 tempest-SecurityServicesTest-925215740-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43487099e439456094fb5cfc0ae825c5', 'request_id': 'req-8375793a-98ca-4891-b909-6eade95d8f86'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-8375793a-98ca-4891-b909-6eade95d8f86 tempest-SecurityServicesTest-925215740 tempest-SecurityServicesTest-925215740-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43487099e439456094fb5cfc0ae825c5', 'request_id': 'req-8375793a-98ca-4891-b909-6eade95d8f86'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-8375793a-98ca-4891-b909-6eade95d8f86 tempest-SecurityServicesTest-925215740 tempest-SecurityServicesTest-925215740-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43487099e439456094fb5cfc0ae825c5', 'request_id': 'req-8375793a-98ca-4891-b909-6eade95d8f86'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1559/3090] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:01:20 2024] DELETE /identity/v3/users/43487099e439456094fb5cfc0ae825c5 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:01:20 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-34f25278-3206-4065-a656-a7252d7f2def tempest-SecurityServicesTest-925215740 tempest-SecurityServicesTest-925215740-project-admin] DELETE http://10.27.203.238/share/v2/d920199a0bc342fd8f081923701e198c/types/f7fe95dc-08aa-4a42-a742-7386b4474715 May 28 13:01:20 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-34f25278-3206-4065-a656-a7252d7f2def tempest-SecurityServicesTest-925215740 tempest-SecurityServicesTest-925215740-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:20 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-34f25278-3206-4065-a656-a7252d7f2def tempest-SecurityServicesTest-925215740 tempest-SecurityServicesTest-925215740-project-admin] Calling method 'ShareTypesController._delete' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:20 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2703849c-6946-432c-919f-7a658dae8600 tempest-ShareRulesTest-1530341375 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:01:20 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2703849c-6946-432c-919f-7a658dae8600 tempest-ShareRulesTest-1530341375 None] [Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=1, created='2024-05-28T12:59:53.824250Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='0fa84ccd-850f-48fa-a965-23e5abe31188', id=38, internal=False, is_s3_default_policy=False, name='f7e47502-a0f7-44de-953d-b7b5697ae0b2', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=['*'], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=[], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=[], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T13:01:19.112992Z', tenant_id=1, tenant_name='default', title='f7e47502-a0f7-44de-953d-b7b5697ae0b2', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/38/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[])] May 28 13:01:20 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2703849c-6946-432c-919f-7a658dae8600 tempest-ShareRulesTest-1530341375 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 13:01:20 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-2703849c-6946-432c-919f-7a658dae8600 tempest-ShareRulesTest-1530341375 None] changing access on /manila/manila-f7e47502-a0f7-44de-953d-b7b5697ae0b2. Rules: {'nfs_read_write': ['203.0.113.77'], 'nfs_read_only': []} May 28 13:01:20 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2703849c-6946-432c-919f-7a658dae8600 tempest-ShareRulesTest-1530341375 None] >>> [PATCH] https://127.0.0.1:40443/api/viewpolicies/38/ May 28 13:01:20 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2703849c-6946-432c-919f-7a658dae8600 tempest-ShareRulesTest-1530341375 None] {'data': '{"name": "f7e47502-a0f7-44de-953d-b7b5697ae0b2", "nfs_no_squash": ' May 28 13:01:20 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2703849c-6946-432c-919f-7a658dae8600 tempest-ShareRulesTest-1530341375 None] '["*"], "nfs_root_squash": ["*"], "nfs_read_write": ["203.0.113.77"], ' May 28 13:01:20 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2703849c-6946-432c-919f-7a658dae8600 tempest-ShareRulesTest-1530341375 None] '"nfs_read_only": []}', May 28 13:01:20 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2703849c-6946-432c-919f-7a658dae8600 tempest-ShareRulesTest-1530341375 None] 'params': None} May 28 13:01:20 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-34f25278-3206-4065-a656-a7252d7f2def tempest-SecurityServicesTest-925215740 tempest-SecurityServicesTest-925215740-project-admin] http://10.27.203.238/share/v2/d920199a0bc342fd8f081923701e198c/types/f7fe95dc-08aa-4a42-a742-7386b4474715 returned with HTTP 202 May 28 13:01:20 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1109/2187] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:01:20 2024] DELETE /share/v2/d920199a0bc342fd8f081923701e198c/types/f7fe95dc-08aa-4a42-a742-7386b4474715 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 13:01:20 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-93863c5e-388a-4c4c-8915-a388bd9231ef tempest-SecurityServicesTest-925215740 tempest-SecurityServicesTest-925215740-project-admin] GET http://10.27.203.238/share/v2/d920199a0bc342fd8f081923701e198c/types/f7fe95dc-08aa-4a42-a742-7386b4474715 May 28 13:01:20 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-93863c5e-388a-4c4c-8915-a388bd9231ef tempest-SecurityServicesTest-925215740 tempest-SecurityServicesTest-925215740-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:20 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-93863c5e-388a-4c4c-8915-a388bd9231ef tempest-SecurityServicesTest-925215740 tempest-SecurityServicesTest-925215740-project-admin] Calling method 'ShareTypesController.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:20 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-93863c5e-388a-4c4c-8915-a388bd9231ef tempest-SecurityServicesTest-925215740 tempest-SecurityServicesTest-925215740-project-admin] HTTP exception thrown: Share type not found. May 28 13:01:20 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-93863c5e-388a-4c4c-8915-a388bd9231ef tempest-SecurityServicesTest-925215740 tempest-SecurityServicesTest-925215740-project-admin] http://10.27.203.238/share/v2/d920199a0bc342fd8f081923701e198c/types/f7fe95dc-08aa-4a42-a742-7386b4474715 returned with HTTP 404 May 28 13:01:20 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1079/2188] 10.27.203.238 () {64 vars in 1448 bytes} [Tue May 28 13:01:20 2024] GET /share/v2/d920199a0bc342fd8f081923701e198c/types/f7fe95dc-08aa-4a42-a742-7386b4474715 => generated 67 bytes in 14 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a0473f-1cd8-43a6-b268-2bac8e503cd8 tempest-SecurityServicesTest-925215740 tempest-SecurityServicesTest-925215740-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-16a0473f-1cd8-43a6-b268-2bac8e503cd8 tempest-SecurityServicesTest-925215740 tempest-SecurityServicesTest-925215740-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a0473f-1cd8-43a6-b268-2bac8e503cd8 tempest-SecurityServicesTest-925215740 tempest-SecurityServicesTest-925215740-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999464d4-04ee-4b32-9e70-605d4ffc9340 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999464d4-04ee-4b32-9e70-605d4ffc9340 None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999464d4-04ee-4b32-9e70-605d4ffc9340 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999464d4-04ee-4b32-9e70-605d4ffc9340 None admin] PATH_INFO: `/v3/users/963acda0ce4849bfa566898a3e080b4b` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999464d4-04ee-4b32-9e70-605d4ffc9340 None admin] RBAC: Authorizing `identity:delete_user(user_id=963acda0ce4849bfa566898a3e080b4b)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999464d4-04ee-4b32-9e70-605d4ffc9340 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-999464d4-04ee-4b32-9e70-605d4ffc9340 None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '963acda0ce4849bfa566898a3e080b4b', 'request_id': 'req-999464d4-04ee-4b32-9e70-605d4ffc9340'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-999464d4-04ee-4b32-9e70-605d4ffc9340 None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '963acda0ce4849bfa566898a3e080b4b', 'request_id': 'req-999464d4-04ee-4b32-9e70-605d4ffc9340'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-999464d4-04ee-4b32-9e70-605d4ffc9340 None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '963acda0ce4849bfa566898a3e080b4b', 'request_id': 'req-999464d4-04ee-4b32-9e70-605d4ffc9340'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-999464d4-04ee-4b32-9e70-605d4ffc9340 None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '963acda0ce4849bfa566898a3e080b4b', 'request_id': 'req-999464d4-04ee-4b32-9e70-605d4ffc9340'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-999464d4-04ee-4b32-9e70-605d4ffc9340 None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '963acda0ce4849bfa566898a3e080b4b', 'request_id': 'req-999464d4-04ee-4b32-9e70-605d4ffc9340'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1532/3091] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 13:01:20 2024] DELETE /identity/v3/users/963acda0ce4849bfa566898a3e080b4b => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:01:20 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-6c16dc35-aa5f-4cd0-82de-87a74b0b0334 tempest-SharesNFSTest-667257547 tempest-SharesNFSTest-667257547-project-member] GET http://10.27.203.238/share/v2/0af6f8e0aeed4f27b075e08f2bc713aa/shares/7a762332-0877-462f-941a-6581abbf784b May 28 13:01:20 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-6c16dc35-aa5f-4cd0-82de-87a74b0b0334 tempest-SharesNFSTest-667257547 tempest-SharesNFSTest-667257547-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:20 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-6c16dc35-aa5f-4cd0-82de-87a74b0b0334 tempest-SharesNFSTest-667257547 tempest-SharesNFSTest-667257547-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8375793a-98ca-4891-b909-6eade95d8f86 tempest-SecurityServicesTest-925215740 tempest-SecurityServicesTest-925215740-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8375793a-98ca-4891-b909-6eade95d8f86 tempest-SecurityServicesTest-925215740 tempest-SecurityServicesTest-925215740-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:20 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-6c16dc35-aa5f-4cd0-82de-87a74b0b0334 tempest-SharesNFSTest-667257547 tempest-SharesNFSTest-667257547-project-member] http://10.27.203.238/share/v2/0af6f8e0aeed4f27b075e08f2bc713aa/shares/7a762332-0877-462f-941a-6581abbf784b returned with HTTP 200 May 28 13:01:20 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1110/2189] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:01:20 2024] GET /share/v2/0af6f8e0aeed4f27b075e08f2bc713aa/shares/7a762332-0877-462f-941a-6581abbf784b => generated 1316 bytes in 25 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8af753-1c29-4c55-af4e-1a1735f4058d None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8af753-1c29-4c55-af4e-1a1735f4058d None admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8af753-1c29-4c55-af4e-1a1735f4058d None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8af753-1c29-4c55-af4e-1a1735f4058d None admin] PATH_INFO: `/v3/users/50791c693a7f4dd0ac09df2447b5637f` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:20 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-781dd131-377a-4e51-8a5e-dc1635ea4ec4 tempest-ShareTypeAvailabilityZonesTest-364532124 None] <<< [GET] https://127.0.0.1:40443/api/quotas/ May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8af753-1c29-4c55-af4e-1a1735f4058d None admin] RBAC: Authorizing `identity:delete_user(user_id=50791c693a7f4dd0ac09df2447b5637f)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:20 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-781dd131-377a-4e51-8a5e-dc1635ea4ec4 tempest-ShareTypeAvailabilityZonesTest-364532124 None] [] May 28 13:01:20 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-781dd131-377a-4e51-8a5e-dc1635ea4ec4 tempest-ShareTypeAvailabilityZonesTest-364532124 None] --- [GET] https://127.0.0.1:40443/api/quotas/: Done May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8af753-1c29-4c55-af4e-1a1735f4058d None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:20 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-781dd131-377a-4e51-8a5e-dc1635ea4ec4 tempest-ShareTypeAvailabilityZonesTest-364532124 None] >>> [POST] https://127.0.0.1:40443/api/quotas/ May 28 13:01:20 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-781dd131-377a-4e51-8a5e-dc1635ea4ec4 tempest-ShareTypeAvailabilityZonesTest-364532124 None] {'data': '{"name": "62476a26-faf7-4184-83e5-45ec72b91d6e", "path": ' May 28 13:01:20 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-781dd131-377a-4e51-8a5e-dc1635ea4ec4 tempest-ShareTypeAvailabilityZonesTest-364532124 None] '"/manila/manila-62476a26-faf7-4184-83e5-45ec72b91d6e", "create_dir": ' May 28 13:01:20 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-781dd131-377a-4e51-8a5e-dc1635ea4ec4 tempest-ShareTypeAvailabilityZonesTest-364532124 None] 'true, "hard_limit": 1073741824}', May 28 13:01:20 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-781dd131-377a-4e51-8a5e-dc1635ea4ec4 tempest-ShareTypeAvailabilityZonesTest-364532124 None] 'json': None, May 28 13:01:20 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-781dd131-377a-4e51-8a5e-dc1635ea4ec4 tempest-ShareTypeAvailabilityZonesTest-364532124 None] 'params': None} May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-ed8af753-1c29-4c55-af4e-1a1735f4058d None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50791c693a7f4dd0ac09df2447b5637f', 'request_id': 'req-ed8af753-1c29-4c55-af4e-1a1735f4058d'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-ed8af753-1c29-4c55-af4e-1a1735f4058d None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50791c693a7f4dd0ac09df2447b5637f', 'request_id': 'req-ed8af753-1c29-4c55-af4e-1a1735f4058d'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-ed8af753-1c29-4c55-af4e-1a1735f4058d None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50791c693a7f4dd0ac09df2447b5637f', 'request_id': 'req-ed8af753-1c29-4c55-af4e-1a1735f4058d'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-ed8af753-1c29-4c55-af4e-1a1735f4058d None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50791c693a7f4dd0ac09df2447b5637f', 'request_id': 'req-ed8af753-1c29-4c55-af4e-1a1735f4058d'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-ed8af753-1c29-4c55-af4e-1a1735f4058d None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50791c693a7f4dd0ac09df2447b5637f', 'request_id': 'req-ed8af753-1c29-4c55-af4e-1a1735f4058d'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:21 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1560/3092] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 13:01:20 2024] DELETE /identity/v3/users/50791c693a7f4dd0ac09df2447b5637f => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:01:21 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999464d4-04ee-4b32-9e70-605d4ffc9340 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:21 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-999464d4-04ee-4b32-9e70-605d4ffc9340 None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:01:21 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999464d4-04ee-4b32-9e70-605d4ffc9340 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:21 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037661c9-32ef-429f-accf-72eacd5f0ed0 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:21 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037661c9-32ef-429f-accf-72eacd5f0ed0 None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:21 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037661c9-32ef-429f-accf-72eacd5f0ed0 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:21 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037661c9-32ef-429f-accf-72eacd5f0ed0 None admin] PATH_INFO: `/v3/users/940148b13d07445e8512baadc6d7fa72` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:21 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037661c9-32ef-429f-accf-72eacd5f0ed0 None admin] RBAC: Authorizing `identity:delete_user(user_id=940148b13d07445e8512baadc6d7fa72)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:21 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037661c9-32ef-429f-accf-72eacd5f0ed0 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:21 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-037661c9-32ef-429f-accf-72eacd5f0ed0 None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '940148b13d07445e8512baadc6d7fa72', 'request_id': 'req-037661c9-32ef-429f-accf-72eacd5f0ed0'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:21 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-037661c9-32ef-429f-accf-72eacd5f0ed0 None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '940148b13d07445e8512baadc6d7fa72', 'request_id': 'req-037661c9-32ef-429f-accf-72eacd5f0ed0'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:21 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-037661c9-32ef-429f-accf-72eacd5f0ed0 None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '940148b13d07445e8512baadc6d7fa72', 'request_id': 'req-037661c9-32ef-429f-accf-72eacd5f0ed0'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:21 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-037661c9-32ef-429f-accf-72eacd5f0ed0 None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '940148b13d07445e8512baadc6d7fa72', 'request_id': 'req-037661c9-32ef-429f-accf-72eacd5f0ed0'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:21 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-037661c9-32ef-429f-accf-72eacd5f0ed0 None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '940148b13d07445e8512baadc6d7fa72', 'request_id': 'req-037661c9-32ef-429f-accf-72eacd5f0ed0'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:21 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1533/3093] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 13:01:21 2024] DELETE /identity/v3/users/940148b13d07445e8512baadc6d7fa72 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:01:21 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd172a4-7cbf-4dbd-8b6a-9347acc03930 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:21 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd172a4-7cbf-4dbd-8b6a-9347acc03930 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:21 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd172a4-7cbf-4dbd-8b6a-9347acc03930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:21 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-bdd172a4-7cbf-4dbd-8b6a-9347acc03930 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 13:01:21 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-bdd172a4-7cbf-4dbd-8b6a-9347acc03930 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 13:01:21 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-bdd172a4-7cbf-4dbd-8b6a-9347acc03930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:01:21 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1561/3094] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 13:01:21 2024] POST /identity/v3/auth/tokens => generated 2960 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 13:01:21 l75lg1-v1 neutron-server[77619]: DEBUG neutron.wsgi [-] (77619) accepted ('10.27.203.238', 41732) {{(pid=77619) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 13:01:21 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037661c9-32ef-429f-accf-72eacd5f0ed0 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:21 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-037661c9-32ef-429f-accf-72eacd5f0ed0 None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:01:21 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037661c9-32ef-429f-accf-72eacd5f0ed0 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:21 l75lg1-v1 dstat.sh[49771]: 28-05 13:01:21| 10 2 84 3 0|5701M 1739M 278M 7907M| 14k 7358B| 0 2775k| 0 350 |8435 14k|1.51 1.23 1.08|2.0 1.0 0| 0 0 | 0 2048M| 29 366 0 38 2 May 28 13:01:21 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf565e32-4812-4f2b-8a4c-3d07f997fdc7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef17047035e4b518fd5360a01f2da1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:21 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf565e32-4812-4f2b-8a4c-3d07f997fdc7 service neutron] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:21 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf565e32-4812-4f2b-8a4c-3d07f997fdc7 service neutron] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:21 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf565e32-4812-4f2b-8a4c-3d07f997fdc7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:21 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf565e32-4812-4f2b-8a4c-3d07f997fdc7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:21 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf565e32-4812-4f2b-8a4c-3d07f997fdc7 service neutron] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:21 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1534/3095] 10.27.203.238 () {64 vars in 1432 bytes} [Tue May 28 13:01:21 2024] GET /identity/v3/auth/tokens => generated 2960 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 28 13:01:21 l75lg1-v1 neutron-server[77619]: INFO neutron.wsgi [None req-b18074c6-1553-46bd-b073-c3e612aaa174 None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=f7d59a5c883f4f699e4078430c78ad8d&name=default HTTP/1.1" status: 200 len: 216 time: 0.0803967 May 28 13:01:21 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd172a4-7cbf-4dbd-8b6a-9347acc03930 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:21 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-bdd172a4-7cbf-4dbd-8b6a-9347acc03930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:01:21 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd172a4-7cbf-4dbd-8b6a-9347acc03930 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:21 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fe89ca-3939-4498-971b-0f900c135c81 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:21 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fe89ca-3939-4498-971b-0f900c135c81 None admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:21 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fe89ca-3939-4498-971b-0f900c135c81 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:21 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fe89ca-3939-4498-971b-0f900c135c81 None admin] PATH_INFO: `/v3/projects/f7d59a5c883f4f699e4078430c78ad8d` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:21 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fe89ca-3939-4498-971b-0f900c135c81 None admin] RBAC: Authorizing `identity:delete_project(project_id=f7d59a5c883f4f699e4078430c78ad8d)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:21 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fe89ca-3939-4498-971b-0f900c135c81 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:21 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9242ab9c-98af-4bf4-ab2d-7a757be81a4f tempest-SharesNFSTest-667257547 None] <<< [DELETE] https://127.0.0.1:40443/api/quotas/46/ May 28 13:01:21 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9242ab9c-98af-4bf4-ab2d-7a757be81a4f tempest-SharesNFSTest-667257547 None] --- [DELETE] https://127.0.0.1:40443/api/quotas/46/: Done May 28 13:01:21 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9242ab9c-98af-4bf4-ab2d-7a757be81a4f tempest-SharesNFSTest-667257547 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:01:21 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9242ab9c-98af-4bf4-ab2d-7a757be81a4f tempest-SharesNFSTest-667257547 None] {'allow_redirects': True, May 28 13:01:21 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9242ab9c-98af-4bf4-ab2d-7a757be81a4f tempest-SharesNFSTest-667257547 None] 'params': {'name': 'd935f840-e1e2-4366-85e1-9cee599842b6'}} May 28 13:01:21 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-f4fe89ca-3939-4498-971b-0f900c135c81 None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7d59a5c883f4f699e4078430c78ad8d', 'request_id': 'req-f4fe89ca-3939-4498-971b-0f900c135c81'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:21 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-f4fe89ca-3939-4498-971b-0f900c135c81 None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7d59a5c883f4f699e4078430c78ad8d', 'request_id': 'req-f4fe89ca-3939-4498-971b-0f900c135c81'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:21 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-f4fe89ca-3939-4498-971b-0f900c135c81 None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7d59a5c883f4f699e4078430c78ad8d', 'request_id': 'req-f4fe89ca-3939-4498-971b-0f900c135c81'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:21 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-f4fe89ca-3939-4498-971b-0f900c135c81 None admin] The token cache is being invalidate because project f7d59a5c883f4f699e4078430c78ad8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 13:01:21 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-f4fe89ca-3939-4498-971b-0f900c135c81 None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:21 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-f4fe89ca-3939-4498-971b-0f900c135c81 None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:21 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1562/3096] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 13:01:21 2024] DELETE /identity/v3/projects/f7d59a5c883f4f699e4078430c78ad8d => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:01:21 l75lg1-v1 neutron-server[77618]: DEBUG neutron.wsgi [-] (77618) accepted ('10.27.203.238', 41734) {{(pid=77618) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 13:01:21 l75lg1-v1 neutron-server[77618]: INFO neutron.wsgi [None req-1d8db5fe-b4e6-42fc-b8a5-20b31a23f9bb None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=5386046a212345589b65f0a1a9d526a7&name=default HTTP/1.1" status: 200 len: 216 time: 0.0090659 May 28 13:01:21 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf565e32-4812-4f2b-8a4c-3d07f997fdc7 service neutron] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:21 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf565e32-4812-4f2b-8a4c-3d07f997fdc7 service neutron] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:21 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dd8715-b864-42f3-af60-371cf67207d4 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:21 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dd8715-b864-42f3-af60-371cf67207d4 None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:21 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dd8715-b864-42f3-af60-371cf67207d4 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:21 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dd8715-b864-42f3-af60-371cf67207d4 None admin] PATH_INFO: `/v3/projects/5386046a212345589b65f0a1a9d526a7` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:21 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dd8715-b864-42f3-af60-371cf67207d4 None admin] RBAC: Authorizing `identity:delete_project(project_id=5386046a212345589b65f0a1a9d526a7)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:21 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dd8715-b864-42f3-af60-371cf67207d4 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:21 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-43dd8715-b864-42f3-af60-371cf67207d4 None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5386046a212345589b65f0a1a9d526a7', 'request_id': 'req-43dd8715-b864-42f3-af60-371cf67207d4'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:21 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-43dd8715-b864-42f3-af60-371cf67207d4 None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5386046a212345589b65f0a1a9d526a7', 'request_id': 'req-43dd8715-b864-42f3-af60-371cf67207d4'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:21 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-43dd8715-b864-42f3-af60-371cf67207d4 None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5386046a212345589b65f0a1a9d526a7', 'request_id': 'req-43dd8715-b864-42f3-af60-371cf67207d4'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:21 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-43dd8715-b864-42f3-af60-371cf67207d4 None admin] The token cache is being invalidate because project 5386046a212345589b65f0a1a9d526a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 13:01:21 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-43dd8715-b864-42f3-af60-371cf67207d4 None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:21 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-43dd8715-b864-42f3-af60-371cf67207d4 None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:21 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1535/3097] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 13:01:21 2024] DELETE /identity/v3/projects/5386046a212345589b65f0a1a9d526a7 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:01:21 l75lg1-v1 neutron-server[77619]: DEBUG neutron.wsgi [-] (77619) accepted ('10.27.203.238', 41748) {{(pid=77619) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 13:01:21 l75lg1-v1 neutron-server[77619]: INFO neutron.wsgi [None req-369a5eab-f1de-4111-ac45-2c8fa380dde8 None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=d920199a0bc342fd8f081923701e198c&name=default HTTP/1.1" status: 200 len: 216 time: 0.0092807 May 28 13:01:21 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fe89ca-3939-4498-971b-0f900c135c81 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:21 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-f4fe89ca-3939-4498-971b-0f900c135c81 None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:01:21 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fe89ca-3939-4498-971b-0f900c135c81 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:21 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec61981-ad12-423b-8bb1-6484c2e2b948 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:21 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec61981-ad12-423b-8bb1-6484c2e2b948 None admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:21 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec61981-ad12-423b-8bb1-6484c2e2b948 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:21 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec61981-ad12-423b-8bb1-6484c2e2b948 None admin] PATH_INFO: `/v3/projects/d920199a0bc342fd8f081923701e198c` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:21 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec61981-ad12-423b-8bb1-6484c2e2b948 None admin] RBAC: Authorizing `identity:delete_project(project_id=d920199a0bc342fd8f081923701e198c)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:21 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec61981-ad12-423b-8bb1-6484c2e2b948 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:21 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9242ab9c-98af-4bf4-ab2d-7a757be81a4f tempest-SharesNFSTest-667257547 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:01:21 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9242ab9c-98af-4bf4-ab2d-7a757be81a4f tempest-SharesNFSTest-667257547 None] [Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=0, created='2024-05-28T13:01:03.579454Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='f5dc5bb3-94a0-46a4-91de-808829f9b9a9', id=49, internal=False, is_s3_default_policy=False, name='d935f840-e1e2-4366-85e1-9cee599842b6', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=[], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['*'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['*'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T13:01:03.940297Z', tenant_id=1, tenant_name='default', title='d935f840-e1e2-4366-85e1-9cee599842b6', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/49/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[])] May 28 13:01:21 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9242ab9c-98af-4bf4-ab2d-7a757be81a4f tempest-SharesNFSTest-667257547 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 13:01:21 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9242ab9c-98af-4bf4-ab2d-7a757be81a4f tempest-SharesNFSTest-667257547 None] >>> [DELETE] https://127.0.0.1:40443/api/viewpolicies/49/ May 28 13:01:21 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-2ec61981-ad12-423b-8bb1-6484c2e2b948 None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd920199a0bc342fd8f081923701e198c', 'request_id': 'req-2ec61981-ad12-423b-8bb1-6484c2e2b948'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:21 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-2ec61981-ad12-423b-8bb1-6484c2e2b948 None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd920199a0bc342fd8f081923701e198c', 'request_id': 'req-2ec61981-ad12-423b-8bb1-6484c2e2b948'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:21 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-2ec61981-ad12-423b-8bb1-6484c2e2b948 None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd920199a0bc342fd8f081923701e198c', 'request_id': 'req-2ec61981-ad12-423b-8bb1-6484c2e2b948'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:21 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-2ec61981-ad12-423b-8bb1-6484c2e2b948 None admin] The token cache is being invalidate because project d920199a0bc342fd8f081923701e198c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 13:01:21 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-2ec61981-ad12-423b-8bb1-6484c2e2b948 None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:21 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-2ec61981-ad12-423b-8bb1-6484c2e2b948 None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:21 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1563/3098] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 13:01:21 2024] DELETE /identity/v3/projects/d920199a0bc342fd8f081923701e198c => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:01:21 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056e2e32-dadf-43ce-b688-bacc759ac141 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:21 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056e2e32-dadf-43ce-b688-bacc759ac141 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:21 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056e2e32-dadf-43ce-b688-bacc759ac141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:21 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-056e2e32-dadf-43ce-b688-bacc759ac141 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 13:01:21 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-056e2e32-dadf-43ce-b688-bacc759ac141 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 13:01:21 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-056e2e32-dadf-43ce-b688-bacc759ac141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:01:21 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1536/3099] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 13:01:21 2024] POST /identity/v3/auth/tokens => generated 312 bytes in 20 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 28 13:01:21 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fa7321-79a1-415d-9edf-fddf4acb08b8 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:21 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fa7321-79a1-415d-9edf-fddf4acb08b8 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:21 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fa7321-79a1-415d-9edf-fddf4acb08b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:21 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-a3fa7321-79a1-415d-9edf-fddf4acb08b8 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 13:01:21 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-a3fa7321-79a1-415d-9edf-fddf4acb08b8 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 13:01:21 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-a3fa7321-79a1-415d-9edf-fddf4acb08b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:01:21 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1564/3100] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 13:01:21 2024] POST /identity/v3/auth/tokens => generated 2960 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 13:01:21 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056e2e32-dadf-43ce-b688-bacc759ac141 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:21 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056e2e32-dadf-43ce-b688-bacc759ac141 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:21 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01133f36-718d-4cd9-9b28-74355c69d377 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:21 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01133f36-718d-4cd9-9b28-74355c69d377 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:21 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01133f36-718d-4cd9-9b28-74355c69d377 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:21 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01133f36-718d-4cd9-9b28-74355c69d377 None admin] PATH_INFO: `/v3/domains` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:21 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01133f36-718d-4cd9-9b28-74355c69d377 None admin] RBAC: Adding query filter params (name=Default) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 13:01:21 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01133f36-718d-4cd9-9b28-74355c69d377 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:21 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01133f36-718d-4cd9-9b28-74355c69d377 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:21 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1537/3101] 10.27.203.238 () {62 vars in 1220 bytes} [Tue May 28 13:01:21 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 13:01:21 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fa7321-79a1-415d-9edf-fddf4acb08b8 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:21 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fa7321-79a1-415d-9edf-fddf4acb08b8 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:21 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ae41ce-742a-424b-a0da-0a5273f386bf None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:21 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ae41ce-742a-424b-a0da-0a5273f386bf None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:21 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ae41ce-742a-424b-a0da-0a5273f386bf None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:21 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ae41ce-742a-424b-a0da-0a5273f386bf None admin] PATH_INFO: `/v3/projects` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:21 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ae41ce-742a-424b-a0da-0a5273f386bf None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:21 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ae41ce-742a-424b-a0da-0a5273f386bf None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:21 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1565/3102] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 13:01:21 2024] POST /identity/v3/projects => generated 397 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 13:01:21 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01133f36-718d-4cd9-9b28-74355c69d377 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:21 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01133f36-718d-4cd9-9b28-74355c69d377 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:21 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-0183a5fb-e406-4393-8614-bb24f5f2043a tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] GET http://10.27.203.238/share/v2/284d76edec3144579d6fb3f6dbc0dd4e/shares/553b74f3-3a9b-40ad-b4b1-d5648684cbf4 May 28 13:01:21 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-0183a5fb-e406-4393-8614-bb24f5f2043a tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:21 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-0183a5fb-e406-4393-8614-bb24f5f2043a tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:21 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-781dd131-377a-4e51-8a5e-dc1635ea4ec4 tempest-ShareTypeAvailabilityZonesTest-364532124 None] <<< [POST] https://127.0.0.1:40443/api/quotas/ May 28 13:01:21 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-781dd131-377a-4e51-8a5e-dc1635ea4ec4 tempest-ShareTypeAvailabilityZonesTest-364532124 None] Bunch(cluster='loop75-kfs', cluster_id=1, default_email=None, default_group_quota=None, default_user_quota=None, enable_alarms=True, enable_email_providers=True, grace_period=None, group_quotas=[], guid='72d06e3e-2c79-450e-b533-2c13d2ea0ceb', hard_limit=1073741824, hard_limit_inodes=None, id=47, internal=False, is_user_quota=False, last_user_quotas_update=None, name='62476a26-faf7-4184-83e5-45ec72b91d6e', num_blocked_users=0, num_exceeded_users=0, path='/manila/manila-62476a26-faf7-4184-83e5-45ec72b91d6e', percent_capacity=0, percent_inodes=None, pretty_grace_period=None, pretty_grace_period_expiration=None, pretty_state='OK (CREATED)', soft_limit=None, soft_limit_inodes=None, state='OK', sync_state='CREATED', system_id=47, tenant_id=1, tenant_name='default', time_to_block=None, title='62476a26-faf7-4184-83e5-45ec72b91d6e', url='https://127.0.0.1:40443/api/quotas/47/', used_capacity=0, used_capacity_tb=0.0, used_effective_capacity=0, used_effective_capacity_tb=0.0, used_inodes=0, used_limited_capacity=0, user_quotas=[]) May 28 13:01:21 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-781dd131-377a-4e51-8a5e-dc1635ea4ec4 tempest-ShareTypeAvailabilityZonesTest-364532124 None] --- [POST] https://127.0.0.1:40443/api/quotas/: Done May 28 13:01:21 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-781dd131-377a-4e51-8a5e-dc1635ea4ec4 tempest-ShareTypeAvailabilityZonesTest-364532124 None] >>> [GET] https://127.0.0.1:40443/api/views/ May 28 13:01:21 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-781dd131-377a-4e51-8a5e-dc1635ea4ec4 tempest-ShareTypeAvailabilityZonesTest-364532124 None] {'allow_redirects': True, May 28 13:01:21 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-781dd131-377a-4e51-8a5e-dc1635ea4ec4 tempest-ShareTypeAvailabilityZonesTest-364532124 None] 'params': {'name': '62476a26-faf7-4184-83e5-45ec72b91d6e'}} May 28 13:01:21 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9c971b-4199-44d4-902e-bea559829e73 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:21 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9c971b-4199-44d4-902e-bea559829e73 None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:21 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9c971b-4199-44d4-902e-bea559829e73 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:21 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9c971b-4199-44d4-902e-bea559829e73 None admin] PATH_INFO: `/v3/users` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:21 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9c971b-4199-44d4-902e-bea559829e73 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:21 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9c971b-4199-44d4-902e-bea559829e73 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:21 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-0183a5fb-e406-4393-8614-bb24f5f2043a tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] http://10.27.203.238/share/v2/284d76edec3144579d6fb3f6dbc0dd4e/shares/553b74f3-3a9b-40ad-b4b1-d5648684cbf4 returned with HTTP 200 May 28 13:01:21 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1080/2190] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:01:21 2024] GET /share/v2/284d76edec3144579d6fb3f6dbc0dd4e/shares/553b74f3-3a9b-40ad-b4b1-d5648684cbf4 => generated 1313 bytes in 26 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:01:21 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-cd9c971b-4199-44d4-902e-bea559829e73 None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 13:01:22 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1538/3103] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 13:01:21 2024] POST /identity/v3/users => generated 307 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 13:01:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ae41ce-742a-424b-a0da-0a5273f386bf None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ae41ce-742a-424b-a0da-0a5273f386bf None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d145893-8ced-4e70-9c6c-c6732433a226 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d145893-8ced-4e70-9c6c-c6732433a226 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d145893-8ced-4e70-9c6c-c6732433a226 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d145893-8ced-4e70-9c6c-c6732433a226 None admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d145893-8ced-4e70-9c6c-c6732433a226 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d145893-8ced-4e70-9c6c-c6732433a226 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:22 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1566/3104] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 13:01:22 2024] GET /identity/v3/roles => generated 1680 bytes in 17 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 13:01:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9c971b-4199-44d4-902e-bea559829e73 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9c971b-4199-44d4-902e-bea559829e73 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138fa8da-e98d-47b1-8b43-cad82525e76a None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138fa8da-e98d-47b1-8b43-cad82525e76a None admin] REQUEST_METHOD: `PUT` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138fa8da-e98d-47b1-8b43-cad82525e76a None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138fa8da-e98d-47b1-8b43-cad82525e76a None admin] PATH_INFO: `/v3/projects/f96e397cc60642c39058e772b0083a08/users/221107a0cded4051a330d4fb9e0e032d/roles/44620cad10ae407c90c91e2c296adb04` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138fa8da-e98d-47b1-8b43-cad82525e76a None admin] RBAC: Authorizing `identity:create_grant(project_id=f96e397cc60642c39058e772b0083a08, user_id=221107a0cded4051a330d4fb9e0e032d, role_id=44620cad10ae407c90c91e2c296adb04)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138fa8da-e98d-47b1-8b43-cad82525e76a None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:22 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1539/3105] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 13:01:22 2024] PUT /identity/v3/projects/f96e397cc60642c39058e772b0083a08/users/221107a0cded4051a330d4fb9e0e032d/roles/44620cad10ae407c90c91e2c296adb04 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:01:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe757fe-d38d-4c26-ba27-8d53a09e1d49 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe757fe-d38d-4c26-ba27-8d53a09e1d49 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe757fe-d38d-4c26-ba27-8d53a09e1d49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:22 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-afe757fe-d38d-4c26-ba27-8d53a09e1d49 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 13:01:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-afe757fe-d38d-4c26-ba27-8d53a09e1d49 None None] MFA Rules not processed for user `221107a0cded4051a330d4fb9e0e032d`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 13:01:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-afe757fe-d38d-4c26-ba27-8d53a09e1d49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:01:22 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1567/3106] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 13:01:22 2024] POST /identity/v3/auth/tokens => generated 3968 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 13:01:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138fa8da-e98d-47b1-8b43-cad82525e76a None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138fa8da-e98d-47b1-8b43-cad82525e76a None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25583ea7-7719-46ee-abb4-007dd1f33e3a None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25583ea7-7719-46ee-abb4-007dd1f33e3a None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25583ea7-7719-46ee-abb4-007dd1f33e3a None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25583ea7-7719-46ee-abb4-007dd1f33e3a None admin] PATH_INFO: `/v3/projects` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25583ea7-7719-46ee-abb4-007dd1f33e3a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25583ea7-7719-46ee-abb4-007dd1f33e3a None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:22 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1540/3107] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 13:01:22 2024] POST /identity/v3/projects => generated 397 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 13:01:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe757fe-d38d-4c26-ba27-8d53a09e1d49 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe757fe-d38d-4c26-ba27-8d53a09e1d49 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:22 l75lg1-v1 dstat.sh[49771]: 28-05 13:01:22| 9 2 81 8 0|5702M 1737M 278M 7907M| 18k 2126B| 0 10M| 0 838 |8661 14k|1.47 1.23 1.08|3.0 1.0 0| 0 0 | 0 2048M| 29 364 0 41 2 May 28 13:01:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcc18df-0c09-4802-b7a6-2bb1249bc9de None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcc18df-0c09-4802-b7a6-2bb1249bc9de None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcc18df-0c09-4802-b7a6-2bb1249bc9de None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcc18df-0c09-4802-b7a6-2bb1249bc9de None admin] PATH_INFO: `/v3/users` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcc18df-0c09-4802-b7a6-2bb1249bc9de None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcc18df-0c09-4802-b7a6-2bb1249bc9de None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:22 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-8dcc18df-0c09-4802-b7a6-2bb1249bc9de None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 13:01:22 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1568/3108] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 13:01:22 2024] POST /identity/v3/users => generated 307 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 13:01:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25583ea7-7719-46ee-abb4-007dd1f33e3a None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25583ea7-7719-46ee-abb4-007dd1f33e3a None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ea82f0-e902-4f42-8891-97e206ef383f None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ea82f0-e902-4f42-8891-97e206ef383f None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ea82f0-e902-4f42-8891-97e206ef383f None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ea82f0-e902-4f42-8891-97e206ef383f None admin] PATH_INFO: `/v3/roles` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ea82f0-e902-4f42-8891-97e206ef383f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ea82f0-e902-4f42-8891-97e206ef383f None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:22 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1541/3109] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 13:01:22 2024] GET /identity/v3/roles => generated 1680 bytes in 17 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 13:01:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcc18df-0c09-4802-b7a6-2bb1249bc9de None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcc18df-0c09-4802-b7a6-2bb1249bc9de None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeaaf8d-df9a-42b5-9e7a-0c707008e1c7 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeaaf8d-df9a-42b5-9e7a-0c707008e1c7 None admin] REQUEST_METHOD: `PUT` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeaaf8d-df9a-42b5-9e7a-0c707008e1c7 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeaaf8d-df9a-42b5-9e7a-0c707008e1c7 None admin] PATH_INFO: `/v3/projects/c4990572c2804aff8644d3fd0a3d1e10/users/2f1e297bf40641ea9c891dedaabbabf0/roles/44620cad10ae407c90c91e2c296adb04` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adeaaf8d-df9a-42b5-9e7a-0c707008e1c7 None admin] RBAC: Authorizing `identity:create_grant(project_id=c4990572c2804aff8644d3fd0a3d1e10, user_id=2f1e297bf40641ea9c891dedaabbabf0, role_id=44620cad10ae407c90c91e2c296adb04)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adeaaf8d-df9a-42b5-9e7a-0c707008e1c7 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:22 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1569/3110] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 13:01:22 2024] PUT /identity/v3/projects/c4990572c2804aff8644d3fd0a3d1e10/users/2f1e297bf40641ea9c891dedaabbabf0/roles/44620cad10ae407c90c91e2c296adb04 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:01:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cd060e-4ca8-4785-94ff-f7a210d2e624 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cd060e-4ca8-4785-94ff-f7a210d2e624 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cd060e-4ca8-4785-94ff-f7a210d2e624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:22 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-781dd131-377a-4e51-8a5e-dc1635ea4ec4 tempest-ShareTypeAvailabilityZonesTest-364532124 None] <<< [GET] https://127.0.0.1:40443/api/views/ May 28 13:01:22 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-781dd131-377a-4e51-8a5e-dc1635ea4ec4 tempest-ShareTypeAvailabilityZonesTest-364532124 None] [] May 28 13:01:22 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-781dd131-377a-4e51-8a5e-dc1635ea4ec4 tempest-ShareTypeAvailabilityZonesTest-364532124 None] --- [GET] https://127.0.0.1:40443/api/views/: Done May 28 13:01:22 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-781dd131-377a-4e51-8a5e-dc1635ea4ec4 tempest-ShareTypeAvailabilityZonesTest-364532124 None] >>> [POST] https://127.0.0.1:40443/api/views/ May 28 13:01:22 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-781dd131-377a-4e51-8a5e-dc1635ea4ec4 tempest-ShareTypeAvailabilityZonesTest-364532124 None] {'data': '{"name": "62476a26-faf7-4184-83e5-45ec72b91d6e", "path": ' May 28 13:01:22 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-781dd131-377a-4e51-8a5e-dc1635ea4ec4 tempest-ShareTypeAvailabilityZonesTest-364532124 None] '"/manila/manila-62476a26-faf7-4184-83e5-45ec72b91d6e", "policy_id": ' May 28 13:01:22 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-781dd131-377a-4e51-8a5e-dc1635ea4ec4 tempest-ShareTypeAvailabilityZonesTest-364532124 None] '50, "create_dir": true, "protocols": ["NFS"]}', May 28 13:01:22 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-781dd131-377a-4e51-8a5e-dc1635ea4ec4 tempest-ShareTypeAvailabilityZonesTest-364532124 None] 'json': None, May 28 13:01:22 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-781dd131-377a-4e51-8a5e-dc1635ea4ec4 tempest-ShareTypeAvailabilityZonesTest-364532124 None] 'params': None} May 28 13:01:22 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-e1cd060e-4ca8-4785-94ff-f7a210d2e624 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 13:01:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-e1cd060e-4ca8-4785-94ff-f7a210d2e624 None None] MFA Rules not processed for user `2f1e297bf40641ea9c891dedaabbabf0`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 13:01:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-e1cd060e-4ca8-4785-94ff-f7a210d2e624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:01:22 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1542/3111] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 13:01:22 2024] POST /identity/v3/auth/tokens => generated 3968 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 13:01:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeaaf8d-df9a-42b5-9e7a-0c707008e1c7 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeaaf8d-df9a-42b5-9e7a-0c707008e1c7 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079a4a69-04ba-4b56-8e42-3eff56147bb8 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079a4a69-04ba-4b56-8e42-3eff56147bb8 None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079a4a69-04ba-4b56-8e42-3eff56147bb8 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079a4a69-04ba-4b56-8e42-3eff56147bb8 None admin] PATH_INFO: `/v3/projects` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079a4a69-04ba-4b56-8e42-3eff56147bb8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079a4a69-04ba-4b56-8e42-3eff56147bb8 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:22 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1570/3112] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 13:01:22 2024] POST /identity/v3/projects => generated 397 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 13:01:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cd060e-4ca8-4785-94ff-f7a210d2e624 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cd060e-4ca8-4785-94ff-f7a210d2e624 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9931ce9-16a8-4406-b561-5c1cec081a01 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9931ce9-16a8-4406-b561-5c1cec081a01 None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9931ce9-16a8-4406-b561-5c1cec081a01 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9931ce9-16a8-4406-b561-5c1cec081a01 None admin] PATH_INFO: `/v3/users` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9931ce9-16a8-4406-b561-5c1cec081a01 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9931ce9-16a8-4406-b561-5c1cec081a01 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:22 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-e9931ce9-16a8-4406-b561-5c1cec081a01 None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 13:01:22 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1543/3113] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 13:01:22 2024] POST /identity/v3/users => generated 306 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 13:01:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079a4a69-04ba-4b56-8e42-3eff56147bb8 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079a4a69-04ba-4b56-8e42-3eff56147bb8 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dc13dd-f043-4305-a896-cb6d655418e7 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dc13dd-f043-4305-a896-cb6d655418e7 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dc13dd-f043-4305-a896-cb6d655418e7 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dc13dd-f043-4305-a896-cb6d655418e7 None admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dc13dd-f043-4305-a896-cb6d655418e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dc13dd-f043-4305-a896-cb6d655418e7 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:22 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1571/3114] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 13:01:22 2024] GET /identity/v3/roles => generated 1680 bytes in 16 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 13:01:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9931ce9-16a8-4406-b561-5c1cec081a01 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9931ce9-16a8-4406-b561-5c1cec081a01 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5c08de-73d9-44a3-8941-b032512edf36 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5c08de-73d9-44a3-8941-b032512edf36 None admin] REQUEST_METHOD: `PUT` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5c08de-73d9-44a3-8941-b032512edf36 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5c08de-73d9-44a3-8941-b032512edf36 None admin] PATH_INFO: `/v3/projects/17b281e6ecbf4c31a51fc8f70aa64a76/users/4bbed46a0e0e4976b09b8784aac745c5/roles/e7989893488f483baa107be56668c4f8` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5c08de-73d9-44a3-8941-b032512edf36 None admin] RBAC: Authorizing `identity:create_grant(project_id=17b281e6ecbf4c31a51fc8f70aa64a76, user_id=4bbed46a0e0e4976b09b8784aac745c5, role_id=e7989893488f483baa107be56668c4f8)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5c08de-73d9-44a3-8941-b032512edf36 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:22 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1544/3115] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 13:01:22 2024] PUT /identity/v3/projects/17b281e6ecbf4c31a51fc8f70aa64a76/users/4bbed46a0e0e4976b09b8784aac745c5/roles/e7989893488f483baa107be56668c4f8 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:01:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dc13dd-f043-4305-a896-cb6d655418e7 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dc13dd-f043-4305-a896-cb6d655418e7 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:22 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2703849c-6946-432c-919f-7a658dae8600 tempest-ShareRulesTest-1530341375 None] <<< [PATCH] https://127.0.0.1:40443/api/viewpolicies/38/ May 28 13:01:22 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2703849c-6946-432c-919f-7a658dae8600 tempest-ShareRulesTest-1530341375 None] Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=1, created='2024-05-28T12:59:53.824250Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='0fa84ccd-850f-48fa-a965-23e5abe31188', id=38, internal=False, is_s3_default_policy=False, name='f7e47502-a0f7-44de-953d-b7b5697ae0b2', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=['*'], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['203.0.113.77'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['203.0.113.77'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='MODIFYING', sync_time='2024-05-28T13:01:22.022648Z', tenant_id=1, tenant_name='default', title='f7e47502-a0f7-44de-953d-b7b5697ae0b2', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/38/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[]) May 28 13:01:22 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2703849c-6946-432c-919f-7a658dae8600 tempest-ShareRulesTest-1530341375 None] --- [PATCH] https://127.0.0.1:40443/api/viewpolicies/38/: Done May 28 13:01:22 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-2703849c-6946-432c-919f-7a658dae8600 tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:01:22 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-2703849c-6946-432c-919f-7a658dae8600 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:01:22 l75lg1-v1 manila-share[98474]: DEBUG dbcounter [-] [98474] Writing DB stats manila:SELECT=1367,manila:UPDATE=156,manila:INSERT=58 {{(pid=98474) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:01:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142b73e1-34d3-42e8-a45e-54706f545013 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142b73e1-34d3-42e8-a45e-54706f545013 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142b73e1-34d3-42e8-a45e-54706f545013 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142b73e1-34d3-42e8-a45e-54706f545013 None admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142b73e1-34d3-42e8-a45e-54706f545013 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142b73e1-34d3-42e8-a45e-54706f545013 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:22 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1572/3116] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 13:01:22 2024] GET /identity/v3/roles => generated 1680 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 13:01:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5c08de-73d9-44a3-8941-b032512edf36 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5c08de-73d9-44a3-8941-b032512edf36 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff95ec5-8ad5-40fa-9f9b-e94acaf8611a None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff95ec5-8ad5-40fa-9f9b-e94acaf8611a None admin] REQUEST_METHOD: `PUT` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff95ec5-8ad5-40fa-9f9b-e94acaf8611a None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff95ec5-8ad5-40fa-9f9b-e94acaf8611a None admin] PATH_INFO: `/v3/projects/17b281e6ecbf4c31a51fc8f70aa64a76/users/4bbed46a0e0e4976b09b8784aac745c5/roles/e7989893488f483baa107be56668c4f8` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff95ec5-8ad5-40fa-9f9b-e94acaf8611a None admin] RBAC: Authorizing `identity:create_grant(project_id=17b281e6ecbf4c31a51fc8f70aa64a76, user_id=4bbed46a0e0e4976b09b8784aac745c5, role_id=e7989893488f483baa107be56668c4f8)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff95ec5-8ad5-40fa-9f9b-e94acaf8611a None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:22 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1545/3117] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 13:01:22 2024] PUT /identity/v3/projects/17b281e6ecbf4c31a51fc8f70aa64a76/users/4bbed46a0e0e4976b09b8784aac745c5/roles/e7989893488f483baa107be56668c4f8 => generated 0 bytes in 18 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:01:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e319383-2de1-4d1f-95c3-7fd2e8f719e5 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e319383-2de1-4d1f-95c3-7fd2e8f719e5 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e319383-2de1-4d1f-95c3-7fd2e8f719e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:22 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-2703849c-6946-432c-919f-7a658dae8600 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.077s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:01:22 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-2703849c-6946-432c-919f-7a658dae8600 tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:01:22 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-2703849c-6946-432c-919f-7a658dae8600 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:01:22 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-2703849c-6946-432c-919f-7a658dae8600 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:01:22 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-2703849c-6946-432c-919f-7a658dae8600 tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:01:22 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-2703849c-6946-432c-919f-7a658dae8600 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:01:22 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-2703849c-6946-432c-919f-7a658dae8600 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.004s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:01:22 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-2703849c-6946-432c-919f-7a658dae8600 tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:01:22 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-2703849c-6946-432c-919f-7a658dae8600 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:01:22 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-2703849c-6946-432c-919f-7a658dae8600 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.004s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:01:22 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-2703849c-6946-432c-919f-7a658dae8600 tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:01:22 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-2703849c-6946-432c-919f-7a658dae8600 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:01:22 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-5e319383-2de1-4d1f-95c3-7fd2e8f719e5 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 13:01:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-5e319383-2de1-4d1f-95c3-7fd2e8f719e5 None None] MFA Rules not processed for user `4bbed46a0e0e4976b09b8784aac745c5`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 13:01:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-5e319383-2de1-4d1f-95c3-7fd2e8f719e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:01:22 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-2703849c-6946-432c-919f-7a658dae8600 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.058s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:01:22 l75lg1-v1 manila-share[98474]: INFO manila.share.access [None req-2703849c-6946-432c-919f-7a658dae8600 tempest-ShareRulesTest-1530341375 None] Access rules were successfully modified for share instance f7e47502-a0f7-44de-953d-b7b5697ae0b2 belonging to share b330db31-7766-443d-9c19-26fe349665aa. May 28 13:01:22 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1573/3118] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 13:01:22 2024] POST /identity/v3/auth/tokens => generated 4091 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 13:01:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff95ec5-8ad5-40fa-9f9b-e94acaf8611a None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff95ec5-8ad5-40fa-9f9b-e94acaf8611a None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1928403d-f8aa-46e1-a3dd-eade250a9c14 tempest-SecServicesMappingNegativeTest-337249595 tempest-SecServicesMappingNegativeTest-337249595-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bbed46a0e0e4976b09b8784aac745c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17b281e6ecbf4c31a51fc8f70aa64a76', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1928403d-f8aa-46e1-a3dd-eade250a9c14 tempest-SecServicesMappingNegativeTest-337249595 tempest-SecServicesMappingNegativeTest-337249595-project-admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1928403d-f8aa-46e1-a3dd-eade250a9c14 tempest-SecServicesMappingNegativeTest-337249595 tempest-SecServicesMappingNegativeTest-337249595-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1928403d-f8aa-46e1-a3dd-eade250a9c14 tempest-SecServicesMappingNegativeTest-337249595 tempest-SecServicesMappingNegativeTest-337249595-project-admin] PATH_INFO: `/v3/domains` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1928403d-f8aa-46e1-a3dd-eade250a9c14 tempest-SecServicesMappingNegativeTest-337249595 tempest-SecServicesMappingNegativeTest-337249595-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 13:01:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1928403d-f8aa-46e1-a3dd-eade250a9c14 tempest-SecServicesMappingNegativeTest-337249595 tempest-SecServicesMappingNegativeTest-337249595-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1928403d-f8aa-46e1-a3dd-eade250a9c14 tempest-SecServicesMappingNegativeTest-337249595 tempest-SecServicesMappingNegativeTest-337249595-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:22 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1546/3119] 10.27.203.238 () {62 vars in 1241 bytes} [Tue May 28 13:01:22 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 13:01:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e319383-2de1-4d1f-95c3-7fd2e8f719e5 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e319383-2de1-4d1f-95c3-7fd2e8f719e5 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d4ca6d-1bf6-41f5-a94d-255e67a22b4e tempest-SecServicesMappingNegativeTest-337249595 tempest-SecServicesMappingNegativeTest-337249595-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bbed46a0e0e4976b09b8784aac745c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17b281e6ecbf4c31a51fc8f70aa64a76', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d4ca6d-1bf6-41f5-a94d-255e67a22b4e tempest-SecServicesMappingNegativeTest-337249595 tempest-SecServicesMappingNegativeTest-337249595-project-admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d4ca6d-1bf6-41f5-a94d-255e67a22b4e tempest-SecServicesMappingNegativeTest-337249595 tempest-SecServicesMappingNegativeTest-337249595-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d4ca6d-1bf6-41f5-a94d-255e67a22b4e tempest-SecServicesMappingNegativeTest-337249595 tempest-SecServicesMappingNegativeTest-337249595-project-admin] PATH_INFO: `/v3/users` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d4ca6d-1bf6-41f5-a94d-255e67a22b4e tempest-SecServicesMappingNegativeTest-337249595 tempest-SecServicesMappingNegativeTest-337249595-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d4ca6d-1bf6-41f5-a94d-255e67a22b4e tempest-SecServicesMappingNegativeTest-337249595 tempest-SecServicesMappingNegativeTest-337249595-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:22 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-c4d4ca6d-1bf6-41f5-a94d-255e67a22b4e tempest-SecServicesMappingNegativeTest-337249595 tempest-SecServicesMappingNegativeTest-337249595-project-admin] Truncating password to algorithm specific maximum length 72 characters. May 28 13:01:22 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1574/3120] 10.27.203.238 () {64 vars in 1232 bytes} [Tue May 28 13:01:22 2024] POST /identity/v3/users => generated 435 bytes in 32 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 13:01:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1928403d-f8aa-46e1-a3dd-eade250a9c14 tempest-SecServicesMappingNegativeTest-337249595 tempest-SecServicesMappingNegativeTest-337249595-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1928403d-f8aa-46e1-a3dd-eade250a9c14 tempest-SecServicesMappingNegativeTest-337249595 tempest-SecServicesMappingNegativeTest-337249595-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0925ba-8a97-46bc-8251-2226b803c2e0 tempest-SecServicesMappingNegativeTest-337249595 tempest-SecServicesMappingNegativeTest-337249595-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bbed46a0e0e4976b09b8784aac745c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17b281e6ecbf4c31a51fc8f70aa64a76', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0925ba-8a97-46bc-8251-2226b803c2e0 tempest-SecServicesMappingNegativeTest-337249595 tempest-SecServicesMappingNegativeTest-337249595-project-admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0925ba-8a97-46bc-8251-2226b803c2e0 tempest-SecServicesMappingNegativeTest-337249595 tempest-SecServicesMappingNegativeTest-337249595-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0925ba-8a97-46bc-8251-2226b803c2e0 tempest-SecServicesMappingNegativeTest-337249595 tempest-SecServicesMappingNegativeTest-337249595-project-admin] PATH_INFO: `/v3/roles` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0925ba-8a97-46bc-8251-2226b803c2e0 tempest-SecServicesMappingNegativeTest-337249595 tempest-SecServicesMappingNegativeTest-337249595-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0925ba-8a97-46bc-8251-2226b803c2e0 tempest-SecServicesMappingNegativeTest-337249595 tempest-SecServicesMappingNegativeTest-337249595-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:22 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1547/3121] 10.27.203.238 () {62 vars in 1210 bytes} [Tue May 28 13:01:22 2024] GET /identity/v3/roles => generated 1680 bytes in 16 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 13:01:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d4ca6d-1bf6-41f5-a94d-255e67a22b4e tempest-SecServicesMappingNegativeTest-337249595 tempest-SecServicesMappingNegativeTest-337249595-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d4ca6d-1bf6-41f5-a94d-255e67a22b4e tempest-SecServicesMappingNegativeTest-337249595 tempest-SecServicesMappingNegativeTest-337249595-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba035382-0318-4383-a98e-053819a8a701 tempest-SecServicesMappingNegativeTest-337249595 tempest-SecServicesMappingNegativeTest-337249595-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bbed46a0e0e4976b09b8784aac745c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17b281e6ecbf4c31a51fc8f70aa64a76', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba035382-0318-4383-a98e-053819a8a701 tempest-SecServicesMappingNegativeTest-337249595 tempest-SecServicesMappingNegativeTest-337249595-project-admin] REQUEST_METHOD: `PUT` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba035382-0318-4383-a98e-053819a8a701 tempest-SecServicesMappingNegativeTest-337249595 tempest-SecServicesMappingNegativeTest-337249595-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba035382-0318-4383-a98e-053819a8a701 tempest-SecServicesMappingNegativeTest-337249595 tempest-SecServicesMappingNegativeTest-337249595-project-admin] PATH_INFO: `/v3/projects/17b281e6ecbf4c31a51fc8f70aa64a76/users/450d0e4972ca4250966ec637211a08fd/roles/44620cad10ae407c90c91e2c296adb04` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba035382-0318-4383-a98e-053819a8a701 tempest-SecServicesMappingNegativeTest-337249595 tempest-SecServicesMappingNegativeTest-337249595-project-admin] RBAC: Authorizing `identity:create_grant(project_id=17b281e6ecbf4c31a51fc8f70aa64a76, user_id=450d0e4972ca4250966ec637211a08fd, role_id=44620cad10ae407c90c91e2c296adb04)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:22 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba035382-0318-4383-a98e-053819a8a701 tempest-SecServicesMappingNegativeTest-337249595 tempest-SecServicesMappingNegativeTest-337249595-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:22 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1575/3122] 10.27.203.238 () {64 vars in 1571 bytes} [Tue May 28 13:01:22 2024] PUT /identity/v3/projects/17b281e6ecbf4c31a51fc8f70aa64a76/users/450d0e4972ca4250966ec637211a08fd/roles/44620cad10ae407c90c91e2c296adb04 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:01:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0925ba-8a97-46bc-8251-2226b803c2e0 tempest-SecServicesMappingNegativeTest-337249595 tempest-SecServicesMappingNegativeTest-337249595-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-9c0925ba-8a97-46bc-8251-2226b803c2e0 tempest-SecServicesMappingNegativeTest-337249595 tempest-SecServicesMappingNegativeTest-337249595-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:01:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0925ba-8a97-46bc-8251-2226b803c2e0 tempest-SecServicesMappingNegativeTest-337249595 tempest-SecServicesMappingNegativeTest-337249595-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b21dbc-e009-474d-89a9-9656af9c75bf service manila] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f110cf6300f049c897d0aab63218d1e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b21dbc-e009-474d-89a9-9656af9c75bf service manila] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b21dbc-e009-474d-89a9-9656af9c75bf service manila] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:22 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b21dbc-e009-474d-89a9-9656af9c75bf service manila] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:23 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b21dbc-e009-474d-89a9-9656af9c75bf service manila] RBAC: Authorizing `identity:validate_token()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:23 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b21dbc-e009-474d-89a9-9656af9c75bf service manila] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:23 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1548/3123] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 13:01:22 2024] GET /identity/v3/auth/tokens => generated 3968 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-d2c6bed6-f908-43d7-a63c-b3f34cdd581b tempest-SecServicesMappingNegativeTest-270309837 tempest-SecServicesMappingNegativeTest-270309837-project-member] POST http://10.27.203.238/share/v1/f96e397cc60642c39058e772b0083a08/share-networks May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-d2c6bed6-f908-43d7-a63c-b3f34cdd581b tempest-SecServicesMappingNegativeTest-270309837 tempest-SecServicesMappingNegativeTest-270309837-project-member] Action: 'create', calling method: ShareNetworkController.create, body: {"share_network": {}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.quota [None req-d2c6bed6-f908-43d7-a63c-b3f34cdd581b tempest-SecServicesMappingNegativeTest-270309837 tempest-SecServicesMappingNegativeTest-270309837-project-member] Created reservations ['948b63f8-24ff-4a1e-b206-3147173e5d27'] {{(pid=98329) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.quota [None req-d2c6bed6-f908-43d7-a63c-b3f34cdd581b tempest-SecServicesMappingNegativeTest-270309837 tempest-SecServicesMappingNegativeTest-270309837-project-member] Committed reservations ['948b63f8-24ff-4a1e-b206-3147173e5d27'] {{(pid=98329) commit /opt/stack/manila/manila/quota.py:1063}} May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-d2c6bed6-f908-43d7-a63c-b3f34cdd581b tempest-SecServicesMappingNegativeTest-270309837 tempest-SecServicesMappingNegativeTest-270309837-project-member] http://10.27.203.238/share/v1/f96e397cc60642c39058e772b0083a08/share-networks returned with HTTP 200 May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1111/2191] 10.27.203.238 () {64 vars in 1342 bytes} [Tue May 28 13:01:22 2024] POST /share/v1/f96e397cc60642c39058e772b0083a08/share-networks => generated 367 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-07781ffb-7ef2-480a-8d16-84818c3ff59f tempest-SecServicesMappingNegativeTest-270309837 tempest-SecServicesMappingNegativeTest-270309837-project-member] POST http://10.27.203.238/share/v1/f96e397cc60642c39058e772b0083a08/security-services May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-07781ffb-7ef2-480a-8d16-84818c3ff59f tempest-SecServicesMappingNegativeTest-270309837 tempest-SecServicesMappingNegativeTest-270309837-project-member] Action: 'create', calling method: SecurityServiceController.create, body: {"security_service": {"type": "ldap"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-07781ffb-7ef2-480a-8d16-84818c3ff59f tempest-SecServicesMappingNegativeTest-270309837 tempest-SecServicesMappingNegativeTest-270309837-project-member] http://10.27.203.238/share/v1/f96e397cc60642c39058e772b0083a08/security-services returned with HTTP 200 May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1081/2192] 10.27.203.238 () {64 vars in 1351 bytes} [Tue May 28 13:01:23 2024] POST /share/v1/f96e397cc60642c39058e772b0083a08/security-services => generated 330 bytes in 14 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:01:23 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba035382-0318-4383-a98e-053819a8a701 tempest-SecServicesMappingNegativeTest-337249595 tempest-SecServicesMappingNegativeTest-337249595-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:23 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-ba035382-0318-4383-a98e-053819a8a701 tempest-SecServicesMappingNegativeTest-337249595 tempest-SecServicesMappingNegativeTest-337249595-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:01:23 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba035382-0318-4383-a98e-053819a8a701 tempest-SecServicesMappingNegativeTest-337249595 tempest-SecServicesMappingNegativeTest-337249595-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:23 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2af5bde-7892-45b5-88ea-192737b6ac84 service manila] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f110cf6300f049c897d0aab63218d1e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:23 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2af5bde-7892-45b5-88ea-192737b6ac84 service manila] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:23 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2af5bde-7892-45b5-88ea-192737b6ac84 service manila] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:23 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2af5bde-7892-45b5-88ea-192737b6ac84 service manila] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:23 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2af5bde-7892-45b5-88ea-192737b6ac84 service manila] RBAC: Authorizing `identity:validate_token()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:23 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2af5bde-7892-45b5-88ea-192737b6ac84 service manila] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:23 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1576/3124] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 13:01:23 2024] GET /identity/v3/auth/tokens => generated 4091 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-f85e20bd-0d6a-44a5-903a-045a35c85880 tempest-SecServicesMappingNegativeTest-337249595 tempest-SecServicesMappingNegativeTest-337249595-project-admin] POST http://10.27.203.238/share/v2/17b281e6ecbf4c31a51fc8f70aa64a76/types May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-f85e20bd-0d6a-44a5-903a-045a35c85880 tempest-SecServicesMappingNegativeTest-337249595 tempest-SecServicesMappingNegativeTest-337249595-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share_type": {"name": "tempest-typeshare-type-1159083287", "extra_specs": {"driver_handles_share_servers": "False"}, "share_type_access:is_public": true}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:01:23 l75lg1-v1 dstat.sh[49771]: 28-05 13:01:23| 11 1 84 3 0|5702M 1736M 278M 7908M| 13k 1006B| 0 2629k| 0 280 |8067 14k|1.47 1.23 1.08|2.0 1.0 0| 0 0 | 0 2048M| 29 364 0 40 2 May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-f85e20bd-0d6a-44a5-903a-045a35c85880 tempest-SecServicesMappingNegativeTest-337249595 tempest-SecServicesMappingNegativeTest-337249595-project-admin] http://10.27.203.238/share/v2/17b281e6ecbf4c31a51fc8f70aa64a76/types returned with HTTP 200 May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1112/2193] 10.27.203.238 () {66 vars in 1359 bytes} [Tue May 28 13:01:23 2024] POST /share/v2/17b281e6ecbf4c31a51fc8f70aa64a76/types => generated 623 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-eff05948-5bb1-4f1a-a62a-261c0eafebe4 tempest-SecServicesMappingNegativeTest-270309837 tempest-SecServicesMappingNegativeTest-270309837-project-member] POST http://10.27.203.238/share/v1/f96e397cc60642c39058e772b0083a08/share-networks/5b452e14-5361-4a33-b1fb-4da94322322a/action May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-eff05948-5bb1-4f1a-a62a-261c0eafebe4 tempest-SecServicesMappingNegativeTest-270309837 tempest-SecServicesMappingNegativeTest-270309837-project-member] Action body: b'{"add_security_service": {"security_service_id": ""}}' {{(pid=98330) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-eff05948-5bb1-4f1a-a62a-261c0eafebe4 tempest-SecServicesMappingNegativeTest-270309837 tempest-SecServicesMappingNegativeTest-270309837-project-member] Action: 'action', calling method: ShareNetworkController.add_security_service, body: {"add_security_service": {"security_service_id": ""}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-56c26768-d915-44af-9e16-fd69cce5298b tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] GET http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/share-access-rules?share_id=b330db31-7766-443d-9c19-26fe349665aa May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-56c26768-d915-44af-9e16-fd69cce5298b tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-56c26768-d915-44af-9e16-fd69cce5298b tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault [None req-eff05948-5bb1-4f1a-a62a-261c0eafebe4 tempest-SecServicesMappingNegativeTest-270309837 tempest-SecServicesMappingNegativeTest-270309837-project-member] Caught error: Security service could not be found.: manila.exception.SecurityServiceNotFound: Security service could not be found. May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault Traceback (most recent call last): May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/api/middleware/fault.py", line 76, in __call__ May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return req.get_response(self.application) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/request.py", line 1313, in send May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault status, headers, app_iter = self.call_application( May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/request.py", line 1278, in call_application May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault app_iter = application(self.environ, start_response) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 129, in __call__ May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault resp = self.call_func(req, *args, **kw) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 193, in call_func May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return self.func(req, *args, **kwargs) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_middleware/base.py", line 124, in __call__ May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault response = req.get_response(self.application) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/request.py", line 1313, in send May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault status, headers, app_iter = self.call_application( May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/request.py", line 1278, in call_application May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault app_iter = application(self.environ, start_response) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 143, in __call__ May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return resp(environ, start_response) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 129, in __call__ May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault resp = self.call_func(req, *args, **kw) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 193, in call_func May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return self.func(req, *args, **kwargs) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/osprofiler/web.py", line 111, in __call__ May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return request.get_response(self.application) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/request.py", line 1313, in send May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault status, headers, app_iter = self.call_application( May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/request.py", line 1278, in call_application May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault app_iter = application(self.environ, start_response) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 129, in __call__ May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault resp = self.call_func(req, *args, **kw) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 193, in call_func May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return self.func(req, *args, **kwargs) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py", line 340, in __call__ May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault response = req.get_response(self._app) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/request.py", line 1313, in send May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault status, headers, app_iter = self.call_application( May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/request.py", line 1278, in call_application May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault app_iter = application(self.environ, start_response) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 143, in __call__ May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return resp(environ, start_response) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 143, in __call__ May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return resp(environ, start_response) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/routes/middleware.py", line 153, in __call__ May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault response = self.app(environ, start_response) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 143, in __call__ May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return resp(environ, start_response) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 129, in __call__ May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault resp = self.call_func(req, *args, **kw) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 193, in call_func May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return self.func(req, *args, **kwargs) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/api/openstack/wsgi.py", line 764, in __call__ May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return self._process_stack(request, action, action_args, May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/api/openstack/wsgi.py", line 829, in _process_stack May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault action_result = self.dispatch(meth, request, action_args) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/api/openstack/wsgi.py", line 924, in dispatch May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return method(req=request, **action_args) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/api/v2/share_networks.py", line 444, in add_security_service May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault security_service = db_api.security_service_get( May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/db/api.py", line 909, in security_service_get May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return IMPL.security_service_get(context, id, **kwargs) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/db/sqlalchemy/api.py", line 166, in wrapper May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return f(*args, **kwargs) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/enginefacade.py", line 998, in wrapper May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return fn(*args, **kwargs) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/db/sqlalchemy/api.py", line 4723, in security_service_get May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return _security_service_get(context, id, **kwargs) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/db/sqlalchemy/api.py", line 166, in wrapper May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return f(*args, **kwargs) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/db/sqlalchemy/api.py", line 4733, in _security_service_get May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault raise exception.SecurityServiceNotFound(security_service_id=id) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault manila.exception.SecurityServiceNotFound: Security service could not be found. May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.middleware.fault [None req-eff05948-5bb1-4f1a-a62a-261c0eafebe4 tempest-SecServicesMappingNegativeTest-270309837 tempest-SecServicesMappingNegativeTest-270309837-project-member] http://10.27.203.238/share/v1/f96e397cc60642c39058e772b0083a08/share-networks/5b452e14-5361-4a33-b1fb-4da94322322a/action returned with HTTP 404 May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1082/2194] 10.27.203.238 () {64 vars in 1474 bytes} [Tue May 28 13:01:23 2024] POST /share/v1/f96e397cc60642c39058e772b0083a08/share-networks/5b452e14-5361-4a33-b1fb-4da94322322a/action => generated 108 bytes in 37 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-bf3e41e9-14db-43ad-a404-e943787f382a tempest-SecServicesMappingNegativeTest-270309837 tempest-SecServicesMappingNegativeTest-270309837-project-member] POST http://10.27.203.238/share/v1/f96e397cc60642c39058e772b0083a08/share-networks/5b452e14-5361-4a33-b1fb-4da94322322a/action May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-bf3e41e9-14db-43ad-a404-e943787f382a tempest-SecServicesMappingNegativeTest-270309837 tempest-SecServicesMappingNegativeTest-270309837-project-member] Action body: b'{"add_security_service": {"security_service_id": "wrong_ss_id"}}' {{(pid=98330) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-bf3e41e9-14db-43ad-a404-e943787f382a tempest-SecServicesMappingNegativeTest-270309837 tempest-SecServicesMappingNegativeTest-270309837-project-member] Action: 'action', calling method: ShareNetworkController.add_security_service, body: {"add_security_service": {"security_service_id": "wrong_ss_id"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.lock.api [None req-56c26768-d915-44af-9e16-fd69cce5298b tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Searching for locks by: {'resource_id': 'dca77461-e33f-4c3b-80d1-35fc9e78f7d0', 'resource_action': 'show', 'resource_type': 'access_rule'} {{(pid=98329) get_all /opt/stack/manila/manila/lock/api.py:112}} May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-56c26768-d915-44af-9e16-fd69cce5298b tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/share-access-rules?share_id=b330db31-7766-443d-9c19-26fe349665aa returned with HTTP 200 May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1113/2195] 10.27.203.238 () {64 vars in 1467 bytes} [Tue May 28 13:01:23 2024] GET /share/v2/a4f3887fa28c457390f5b66615564430/share-access-rules?share_id=b330db31-7766-443d-9c19-26fe349665aa => generated 280 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:01:23 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-781dd131-377a-4e51-8a5e-dc1635ea4ec4 tempest-ShareTypeAvailabilityZonesTest-364532124 None] <<< [POST] https://127.0.0.1:40443/api/views/ May 28 13:01:23 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-781dd131-377a-4e51-8a5e-dc1635ea4ec4 tempest-ShareTypeAvailabilityZonesTest-364532124 None] Bunch(abac_tags=[], abe_max_depth=None, abe_protocols=[], alias='', allow_anonymous_access=False, allow_s3_anonymous_access=False, auto_commit='0d', bucket='', bucket_creators=[], bucket_creators_groups=[], bucket_owner=None, bulk_permission_update_progress=None, bulk_permission_update_state=None, cluster='loop75-kfs', cluster_id=1, created='2024-05-28T13:01:22.991246Z', enabled=True, files_retention_mode='NONE', guid='6965dc69-c05b-4bac-a2ad-9828764cced4', id=49, ignore_oos=False, internal=False, is_remote=False, is_seamless=False, logical_capacity=0, max_retention_period=None, min_retention_period=None, name='62476a26-faf7-4184-83e5-45ec72b91d6e', nfs_interop_flags='BOTH_NFS3_AND_NFS4_INTEROP_DISABLED', path='/manila/manila-62476a26-faf7-4184-83e5-45ec72b91d6e', physical_capacity=0, policy='62476a26-faf7-4184-83e5-45ec72b91d6e', policy_id=50, protocols=['NFS'], qos_policy=None, qos_policy_id=None, s3_locks=False, s3_locks_retention_mode='NONE', s3_locks_retention_period='', s3_object_ownership_rule='ObjectWriter', s3_unverified_lookup=False, s3_versioning=False, select_for_live_monitoring=False, share='', share_acl=Bunch(acl=[], enabled=False), sync='SYNCED', sync_time='2024-05-28T13:01:23.255375Z', tenant_id=1, tenant_name='default', title='/manila/manila-62476a26-faf7-4184-83e5-45ec72b91d6e', url='https://127.0.0.1:40443/api/views/49/') May 28 13:01:23 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-781dd131-377a-4e51-8a5e-dc1635ea4ec4 tempest-ShareTypeAvailabilityZonesTest-364532124 None] --- [POST] https://127.0.0.1:40443/api/views/: Done May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-d4f9550b-ab5e-4baa-9ef9-7b6af8448d3d tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] GET http://10.27.203.238/share/v2/f353f66e6e00471aa584ea2e39c0ab0e/share-access-rules?share_id=b330db31-7766-443d-9c19-26fe349665aa May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-d4f9550b-ab5e-4baa-9ef9-7b6af8448d3d tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-d4f9550b-ab5e-4baa-9ef9-7b6af8448d3d tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault [None req-bf3e41e9-14db-43ad-a404-e943787f382a tempest-SecServicesMappingNegativeTest-270309837 tempest-SecServicesMappingNegativeTest-270309837-project-member] Caught error: Security service wrong_ss_id could not be found.: manila.exception.SecurityServiceNotFound: Security service wrong_ss_id could not be found. May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault Traceback (most recent call last): May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/api/middleware/fault.py", line 76, in __call__ May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return req.get_response(self.application) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/request.py", line 1313, in send May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault status, headers, app_iter = self.call_application( May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/request.py", line 1278, in call_application May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault app_iter = application(self.environ, start_response) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 129, in __call__ May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault resp = self.call_func(req, *args, **kw) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 193, in call_func May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return self.func(req, *args, **kwargs) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_middleware/base.py", line 124, in __call__ May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault response = req.get_response(self.application) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/request.py", line 1313, in send May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault status, headers, app_iter = self.call_application( May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/request.py", line 1278, in call_application May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault app_iter = application(self.environ, start_response) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 143, in __call__ May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return resp(environ, start_response) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 129, in __call__ May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault resp = self.call_func(req, *args, **kw) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 193, in call_func May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return self.func(req, *args, **kwargs) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/osprofiler/web.py", line 111, in __call__ May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return request.get_response(self.application) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/request.py", line 1313, in send May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault status, headers, app_iter = self.call_application( May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/request.py", line 1278, in call_application May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault app_iter = application(self.environ, start_response) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 129, in __call__ May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault resp = self.call_func(req, *args, **kw) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 193, in call_func May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return self.func(req, *args, **kwargs) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py", line 340, in __call__ May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault response = req.get_response(self._app) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/request.py", line 1313, in send May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault status, headers, app_iter = self.call_application( May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/request.py", line 1278, in call_application May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault app_iter = application(self.environ, start_response) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 143, in __call__ May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return resp(environ, start_response) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 143, in __call__ May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return resp(environ, start_response) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/routes/middleware.py", line 153, in __call__ May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault response = self.app(environ, start_response) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 143, in __call__ May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return resp(environ, start_response) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 129, in __call__ May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault resp = self.call_func(req, *args, **kw) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 193, in call_func May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return self.func(req, *args, **kwargs) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/api/openstack/wsgi.py", line 764, in __call__ May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return self._process_stack(request, action, action_args, May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/api/openstack/wsgi.py", line 829, in _process_stack May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault action_result = self.dispatch(meth, request, action_args) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/api/openstack/wsgi.py", line 924, in dispatch May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return method(req=request, **action_args) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/api/v2/share_networks.py", line 444, in add_security_service May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault security_service = db_api.security_service_get( May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/db/api.py", line 909, in security_service_get May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return IMPL.security_service_get(context, id, **kwargs) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/db/sqlalchemy/api.py", line 166, in wrapper May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return f(*args, **kwargs) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/enginefacade.py", line 998, in wrapper May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return fn(*args, **kwargs) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/db/sqlalchemy/api.py", line 4723, in security_service_get May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return _security_service_get(context, id, **kwargs) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/db/sqlalchemy/api.py", line 166, in wrapper May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return f(*args, **kwargs) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/db/sqlalchemy/api.py", line 4733, in _security_service_get May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault raise exception.SecurityServiceNotFound(security_service_id=id) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault manila.exception.SecurityServiceNotFound: Security service wrong_ss_id could not be found. May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.middleware.fault [None req-bf3e41e9-14db-43ad-a404-e943787f382a tempest-SecServicesMappingNegativeTest-270309837 tempest-SecServicesMappingNegativeTest-270309837-project-member] http://10.27.203.238/share/v1/f96e397cc60642c39058e772b0083a08/share-networks/5b452e14-5361-4a33-b1fb-4da94322322a/action returned with HTTP 404 May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1083/2196] 10.27.203.238 () {64 vars in 1474 bytes} [Tue May 28 13:01:23 2024] POST /share/v1/f96e397cc60642c39058e772b0083a08/share-networks/5b452e14-5361-4a33-b1fb-4da94322322a/action => generated 119 bytes in 33 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-d5cfe5b2-142b-4c2a-8eb8-205494233189 tempest-SecServicesMappingNegativeTest-270309837 tempest-SecServicesMappingNegativeTest-270309837-project-member] POST http://10.27.203.238/share/v1/f96e397cc60642c39058e772b0083a08/share-networks/wrong_sn_id/action May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-d5cfe5b2-142b-4c2a-8eb8-205494233189 tempest-SecServicesMappingNegativeTest-270309837 tempest-SecServicesMappingNegativeTest-270309837-project-member] Action body: b'{"add_security_service": {"security_service_id": "a4832822-c619-425f-9f65-aa280194cd7d"}}' {{(pid=98330) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-d5cfe5b2-142b-4c2a-8eb8-205494233189 tempest-SecServicesMappingNegativeTest-270309837 tempest-SecServicesMappingNegativeTest-270309837-project-member] Action: 'action', calling method: ShareNetworkController.add_security_service, body: {"add_security_service": {"security_service_id": "a4832822-c619-425f-9f65-aa280194cd7d"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault [None req-d5cfe5b2-142b-4c2a-8eb8-205494233189 tempest-SecServicesMappingNegativeTest-270309837 tempest-SecServicesMappingNegativeTest-270309837-project-member] Caught error: Share network wrong_sn_id could not be found.: manila.exception.ShareNetworkNotFound: Share network wrong_sn_id could not be found. May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault Traceback (most recent call last): May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/api/middleware/fault.py", line 76, in __call__ May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return req.get_response(self.application) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/request.py", line 1313, in send May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault status, headers, app_iter = self.call_application( May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/request.py", line 1278, in call_application May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault app_iter = application(self.environ, start_response) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 129, in __call__ May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault resp = self.call_func(req, *args, **kw) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 193, in call_func May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return self.func(req, *args, **kwargs) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_middleware/base.py", line 124, in __call__ May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault response = req.get_response(self.application) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/request.py", line 1313, in send May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault status, headers, app_iter = self.call_application( May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/request.py", line 1278, in call_application May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault app_iter = application(self.environ, start_response) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 143, in __call__ May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return resp(environ, start_response) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 129, in __call__ May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault resp = self.call_func(req, *args, **kw) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 193, in call_func May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return self.func(req, *args, **kwargs) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/osprofiler/web.py", line 111, in __call__ May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return request.get_response(self.application) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/request.py", line 1313, in send May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault status, headers, app_iter = self.call_application( May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/request.py", line 1278, in call_application May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault app_iter = application(self.environ, start_response) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 129, in __call__ May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault resp = self.call_func(req, *args, **kw) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 193, in call_func May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return self.func(req, *args, **kwargs) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py", line 340, in __call__ May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault response = req.get_response(self._app) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/request.py", line 1313, in send May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault status, headers, app_iter = self.call_application( May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/request.py", line 1278, in call_application May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault app_iter = application(self.environ, start_response) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 143, in __call__ May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return resp(environ, start_response) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 143, in __call__ May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return resp(environ, start_response) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/routes/middleware.py", line 153, in __call__ May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault response = self.app(environ, start_response) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 143, in __call__ May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return resp(environ, start_response) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 129, in __call__ May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault resp = self.call_func(req, *args, **kw) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 193, in call_func May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return self.func(req, *args, **kwargs) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/api/openstack/wsgi.py", line 764, in __call__ May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return self._process_stack(request, action, action_args, May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/api/openstack/wsgi.py", line 829, in _process_stack May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault action_result = self.dispatch(meth, request, action_args) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/api/openstack/wsgi.py", line 924, in dispatch May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return method(req=request, **action_args) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/api/v2/share_networks.py", line 438, in add_security_service May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault share_network = db_api.share_network_get(context, id) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/db/api.py", line 1038, in share_network_get May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return IMPL.share_network_get(context, id) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/db/sqlalchemy/api.py", line 166, in wrapper May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return f(*args, **kwargs) May 28 13:01:23 l75lg1-v1 manila-share[98474]: INFO manila.share.manager [None req-781dd131-377a-4e51-8a5e-dc1635ea4ec4 tempest-ShareTypeAvailabilityZonesTest-364532124 None] Share instance 62476a26-faf7-4184-83e5-45ec72b91d6e created successfully. May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/enginefacade.py", line 998, in wrapper May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return fn(*args, **kwargs) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/db/sqlalchemy/api.py", line 4810, in share_network_get May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return _share_network_get(context, id) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/db/sqlalchemy/api.py", line 166, in wrapper May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return f(*args, **kwargs) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/db/sqlalchemy/api.py", line 4817, in _share_network_get May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault raise exception.ShareNetworkNotFound(share_network_id=id) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault manila.exception.ShareNetworkNotFound: Share network wrong_sn_id could not be found. May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.middleware.fault [None req-d5cfe5b2-142b-4c2a-8eb8-205494233189 tempest-SecServicesMappingNegativeTest-270309837 tempest-SecServicesMappingNegativeTest-270309837-project-member] http://10.27.203.238/share/v1/f96e397cc60642c39058e772b0083a08/share-networks/wrong_sn_id/action returned with HTTP 404 May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1084/2197] 10.27.203.238 () {64 vars in 1399 bytes} [Tue May 28 13:01:23 2024] POST /share/v1/f96e397cc60642c39058e772b0083a08/share-networks/wrong_sn_id/action => generated 113 bytes in 18 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1085/2198] 10.27.203.238 () {64 vars in 1363 bytes} [Tue May 28 13:01:23 2024] POST /share/v1/f96e397cc60642c39058e772b0083a08/share-networks/action => generated 112 bytes in 3 msecs (HTTP/1.1 404) 3 headers in 98 bytes (1 switches on core 0) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.lock.api [None req-d4f9550b-ab5e-4baa-9ef9-7b6af8448d3d tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] Searching for locks by: {'resource_id': 'dca77461-e33f-4c3b-80d1-35fc9e78f7d0', 'resource_action': 'show', 'resource_type': 'access_rule'} {{(pid=98329) get_all /opt/stack/manila/manila/lock/api.py:112}} May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-d4f9550b-ab5e-4baa-9ef9-7b6af8448d3d tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] http://10.27.203.238/share/v2/f353f66e6e00471aa584ea2e39c0ab0e/share-access-rules?share_id=b330db31-7766-443d-9c19-26fe349665aa returned with HTTP 200 May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1114/2199] 10.27.203.238 () {64 vars in 1467 bytes} [Tue May 28 13:01:23 2024] GET /share/v2/f353f66e6e00471aa584ea2e39c0ab0e/share-access-rules?share_id=b330db31-7766-443d-9c19-26fe349665aa => generated 280 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-c7a5347c-1006-4205-b84c-145a69f9801b tempest-SecServicesMappingNegativeTest-270309837 tempest-SecServicesMappingNegativeTest-270309837-project-member] POST http://10.27.203.238/share/v1/f96e397cc60642c39058e772b0083a08/share-networks/5b452e14-5361-4a33-b1fb-4da94322322a/action May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-c7a5347c-1006-4205-b84c-145a69f9801b tempest-SecServicesMappingNegativeTest-270309837 tempest-SecServicesMappingNegativeTest-270309837-project-member] Action body: b'{"add_security_service": {"security_service_id": "a4832822-c619-425f-9f65-aa280194cd7d"}}' {{(pid=98330) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-c7a5347c-1006-4205-b84c-145a69f9801b tempest-SecServicesMappingNegativeTest-270309837 tempest-SecServicesMappingNegativeTest-270309837-project-member] Action: 'action', calling method: ShareNetworkController.add_security_service, body: {"add_security_service": {"security_service_id": "a4832822-c619-425f-9f65-aa280194cd7d"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-fb7bb11b-5238-408d-ae0a-8254b1ceff2f tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] POST http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/shares/b330db31-7766-443d-9c19-26fe349665aa/action May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-fb7bb11b-5238-408d-ae0a-8254b1ceff2f tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Action body: b'{"deny_access": {"access_id": "dca77461-e33f-4c3b-80d1-35fc9e78f7d0"}}' {{(pid=98329) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-fb7bb11b-5238-408d-ae0a-8254b1ceff2f tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Action: 'action', calling method: ShareController.deny_access, body: {"deny_access": {"access_id": "dca77461-e33f-4c3b-80d1-35fc9e78f7d0"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.lock.api [None req-fb7bb11b-5238-408d-ae0a-8254b1ceff2f tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Searching for locks by: {'resource_id': 'dca77461-e33f-4c3b-80d1-35fc9e78f7d0', 'resource_action': 'delete'} {{(pid=98329) get_all /opt/stack/manila/manila/lock/api.py:112}} May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-c7a5347c-1006-4205-b84c-145a69f9801b tempest-SecServicesMappingNegativeTest-270309837 tempest-SecServicesMappingNegativeTest-270309837-project-member] http://10.27.203.238/share/v1/f96e397cc60642c39058e772b0083a08/share-networks/5b452e14-5361-4a33-b1fb-4da94322322a/action returned with HTTP 200 May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1086/2200] 10.27.203.238 () {64 vars in 1474 bytes} [Tue May 28 13:01:23 2024] POST /share/v1/f96e397cc60642c39058e772b0083a08/share-networks/5b452e14-5361-4a33-b1fb-4da94322322a/action => generated 367 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 230 bytes (2 switches on core 0) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-cc2cf751-e7d8-443c-ba59-d6741a2db5cf tempest-SecServicesMappingNegativeTest-270309837 tempest-SecServicesMappingNegativeTest-270309837-project-member] POST http://10.27.203.238/share/v1/f96e397cc60642c39058e772b0083a08/share-networks/5b452e14-5361-4a33-b1fb-4da94322322a/action May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-cc2cf751-e7d8-443c-ba59-d6741a2db5cf tempest-SecServicesMappingNegativeTest-270309837 tempest-SecServicesMappingNegativeTest-270309837-project-member] Action body: b'{"add_security_service": {"security_service_id": "a4832822-c619-425f-9f65-aa280194cd7d"}}' {{(pid=98330) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-cc2cf751-e7d8-443c-ba59-d6741a2db5cf tempest-SecServicesMappingNegativeTest-270309837 tempest-SecServicesMappingNegativeTest-270309837-project-member] Action: 'action', calling method: ShareNetworkController.add_security_service, body: {"add_security_service": {"security_service_id": "a4832822-c619-425f-9f65-aa280194cd7d"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98329]: DEBUG oslo_concurrency.lockutils [None req-fb7bb11b-5238-408d-ae0a-8254b1ceff2f tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98329) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98329]: DEBUG oslo_concurrency.lockutils [None req-fb7bb11b-5238-408d-ae0a-8254b1ceff2f tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98329) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-cc2cf751-e7d8-443c-ba59-d6741a2db5cf tempest-SecServicesMappingNegativeTest-270309837 tempest-SecServicesMappingNegativeTest-270309837-project-member] HTTP exception thrown: Invalid security service: Cannot add security service to share network. Security service with 'ldap' type already added to '5b452e14-5361-4a33-b1fb-4da94322322a' share network May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-cc2cf751-e7d8-443c-ba59-d6741a2db5cf tempest-SecServicesMappingNegativeTest-270309837 tempest-SecServicesMappingNegativeTest-270309837-project-member] http://10.27.203.238/share/v1/f96e397cc60642c39058e772b0083a08/share-networks/5b452e14-5361-4a33-b1fb-4da94322322a/action returned with HTTP 409 May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1087/2201] 10.27.203.238 () {64 vars in 1474 bytes} [Tue May 28 13:01:23 2024] POST /share/v1/f96e397cc60642c39058e772b0083a08/share-networks/5b452e14-5361-4a33-b1fb-4da94322322a/action => generated 227 bytes in 28 msecs (HTTP/1.1 409) 6 headers in 236 bytes (2 switches on core 0) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-2a3bb726-bc1f-4348-8923-0ba856f092de tempest-SecServicesMappingNegativeTest-270309837 tempest-SecServicesMappingNegativeTest-270309837-project-member] POST http://10.27.203.238/share/v1/f96e397cc60642c39058e772b0083a08/share-networks/5b452e14-5361-4a33-b1fb-4da94322322a/action May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-2a3bb726-bc1f-4348-8923-0ba856f092de tempest-SecServicesMappingNegativeTest-270309837 tempest-SecServicesMappingNegativeTest-270309837-project-member] Action body: b'{"remove_security_service": {"security_service_id": "wrong_id"}}' {{(pid=98330) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-2a3bb726-bc1f-4348-8923-0ba856f092de tempest-SecServicesMappingNegativeTest-270309837 tempest-SecServicesMappingNegativeTest-270309837-project-member] Action: 'action', calling method: ShareNetworkController.remove_security_service, body: {"remove_security_service": {"security_service_id": "wrong_id"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98329]: DEBUG oslo_concurrency.lockutils [None req-fb7bb11b-5238-408d-ae0a-8254b1ceff2f tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.038s {{(pid=98329) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98329]: DEBUG oslo_concurrency.lockutils [None req-fb7bb11b-5238-408d-ae0a-8254b1ceff2f tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98329) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98329]: DEBUG oslo_concurrency.lockutils [None req-fb7bb11b-5238-408d-ae0a-8254b1ceff2f tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98329) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:01:23 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9242ab9c-98af-4bf4-ab2d-7a757be81a4f tempest-SharesNFSTest-667257547 None] <<< [DELETE] https://127.0.0.1:40443/api/viewpolicies/49/ May 28 13:01:23 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9242ab9c-98af-4bf4-ab2d-7a757be81a4f tempest-SharesNFSTest-667257547 None] --- [DELETE] https://127.0.0.1:40443/api/viewpolicies/49/: Done May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-2a3bb726-bc1f-4348-8923-0ba856f092de tempest-SecServicesMappingNegativeTest-270309837 tempest-SecServicesMappingNegativeTest-270309837-project-member] HTTP exception thrown: Security service wrong_id could not be found. May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-2a3bb726-bc1f-4348-8923-0ba856f092de tempest-SecServicesMappingNegativeTest-270309837 tempest-SecServicesMappingNegativeTest-270309837-project-member] http://10.27.203.238/share/v1/f96e397cc60642c39058e772b0083a08/share-networks/5b452e14-5361-4a33-b1fb-4da94322322a/action returned with HTTP 404 May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1088/2202] 10.27.203.238 () {64 vars in 1474 bytes} [Tue May 28 13:01:23 2024] POST /share/v1/f96e397cc60642c39058e772b0083a08/share-networks/5b452e14-5361-4a33-b1fb-4da94322322a/action => generated 91 bytes in 51 msecs (HTTP/1.1 404) 6 headers in 236 bytes (1 switches on core 0) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-89947d6f-b1c3-4191-90f9-099bdeb7e61b tempest-SecServicesMappingNegativeTest-270309837 tempest-SecServicesMappingNegativeTest-270309837-project-member] POST http://10.27.203.238/share/v1/f96e397cc60642c39058e772b0083a08/share-networks/wrong_id/action May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-89947d6f-b1c3-4191-90f9-099bdeb7e61b tempest-SecServicesMappingNegativeTest-270309837 tempest-SecServicesMappingNegativeTest-270309837-project-member] Action body: b'{"remove_security_service": {"security_service_id": "wrong_id"}}' {{(pid=98330) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-89947d6f-b1c3-4191-90f9-099bdeb7e61b tempest-SecServicesMappingNegativeTest-270309837 tempest-SecServicesMappingNegativeTest-270309837-project-member] Action: 'action', calling method: ShareNetworkController.remove_security_service, body: {"remove_security_service": {"security_service_id": "wrong_id"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault [None req-89947d6f-b1c3-4191-90f9-099bdeb7e61b tempest-SecServicesMappingNegativeTest-270309837 tempest-SecServicesMappingNegativeTest-270309837-project-member] Caught error: Share network wrong_id could not be found.: manila.exception.ShareNetworkNotFound: Share network wrong_id could not be found. May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault Traceback (most recent call last): May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/api/middleware/fault.py", line 76, in __call__ May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return req.get_response(self.application) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/request.py", line 1313, in send May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault status, headers, app_iter = self.call_application( May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/request.py", line 1278, in call_application May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault app_iter = application(self.environ, start_response) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 129, in __call__ May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault resp = self.call_func(req, *args, **kw) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 193, in call_func May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return self.func(req, *args, **kwargs) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_middleware/base.py", line 124, in __call__ May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault response = req.get_response(self.application) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/request.py", line 1313, in send May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault status, headers, app_iter = self.call_application( May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/request.py", line 1278, in call_application May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault app_iter = application(self.environ, start_response) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 143, in __call__ May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return resp(environ, start_response) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 129, in __call__ May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault resp = self.call_func(req, *args, **kw) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 193, in call_func May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return self.func(req, *args, **kwargs) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/osprofiler/web.py", line 111, in __call__ May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return request.get_response(self.application) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/request.py", line 1313, in send May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault status, headers, app_iter = self.call_application( May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/request.py", line 1278, in call_application May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault app_iter = application(self.environ, start_response) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 129, in __call__ May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault resp = self.call_func(req, *args, **kw) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 193, in call_func May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return self.func(req, *args, **kwargs) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py", line 340, in __call__ May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault response = req.get_response(self._app) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/request.py", line 1313, in send May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault status, headers, app_iter = self.call_application( May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/request.py", line 1278, in call_application May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault app_iter = application(self.environ, start_response) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 143, in __call__ May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return resp(environ, start_response) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 143, in __call__ May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return resp(environ, start_response) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/routes/middleware.py", line 153, in __call__ May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault response = self.app(environ, start_response) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 143, in __call__ May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return resp(environ, start_response) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 129, in __call__ May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault resp = self.call_func(req, *args, **kw) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 193, in call_func May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return self.func(req, *args, **kwargs) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/api/openstack/wsgi.py", line 764, in __call__ May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return self._process_stack(request, action, action_args, May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/api/openstack/wsgi.py", line 829, in _process_stack May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault action_result = self.dispatch(meth, request, action_args) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/api/openstack/wsgi.py", line 924, in dispatch May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return method(req=request, **action_args) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/api/v2/share_networks.py", line 486, in remove_security_service May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault share_network = db_api.share_network_get(context, id) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/db/api.py", line 1038, in share_network_get May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return IMPL.share_network_get(context, id) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/db/sqlalchemy/api.py", line 166, in wrapper May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return f(*args, **kwargs) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/enginefacade.py", line 998, in wrapper May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return fn(*args, **kwargs) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/db/sqlalchemy/api.py", line 4810, in share_network_get May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return _share_network_get(context, id) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/db/sqlalchemy/api.py", line 166, in wrapper May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return f(*args, **kwargs) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/db/sqlalchemy/api.py", line 4817, in _share_network_get May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault raise exception.ShareNetworkNotFound(share_network_id=id) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault manila.exception.ShareNetworkNotFound: Share network wrong_id could not be found. May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.middleware.fault [None req-89947d6f-b1c3-4191-90f9-099bdeb7e61b tempest-SecServicesMappingNegativeTest-270309837 tempest-SecServicesMappingNegativeTest-270309837-project-member] http://10.27.203.238/share/v1/f96e397cc60642c39058e772b0083a08/share-networks/wrong_id/action returned with HTTP 404 May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1089/2203] 10.27.203.238 () {64 vars in 1390 bytes} [Tue May 28 13:01:23 2024] POST /share/v1/f96e397cc60642c39058e772b0083a08/share-networks/wrong_id/action => generated 110 bytes in 24 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98329]: DEBUG oslo_concurrency.lockutils [None req-fb7bb11b-5238-408d-ae0a-8254b1ceff2f tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.054s {{(pid=98329) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-fb7bb11b-5238-408d-ae0a-8254b1ceff2f tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/shares/b330db31-7766-443d-9c19-26fe349665aa/action returned with HTTP 202 May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1115/2204] 10.27.203.238 () {66 vars in 1493 bytes} [Tue May 28 13:01:23 2024] POST /share/v2/a4f3887fa28c457390f5b66615564430/shares/b330db31-7766-443d-9c19-26fe349665aa/action => generated 0 bytes in 169 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-dd475682-f1d5-4836-9012-0765a25b6792 tempest-SecServicesMappingNegativeTest-270309837 tempest-SecServicesMappingNegativeTest-270309837-project-member] POST http://10.27.203.238/share/v1/f96e397cc60642c39058e772b0083a08/share-networks/wrong_id/action May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-dd475682-f1d5-4836-9012-0765a25b6792 tempest-SecServicesMappingNegativeTest-270309837 tempest-SecServicesMappingNegativeTest-270309837-project-member] Action body: b'{"remove_security_service": {"security_service_id": "a4832822-c619-425f-9f65-aa280194cd7d"}}' {{(pid=98330) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-dd475682-f1d5-4836-9012-0765a25b6792 tempest-SecServicesMappingNegativeTest-270309837 tempest-SecServicesMappingNegativeTest-270309837-project-member] Action: 'action', calling method: ShareNetworkController.remove_security_service, body: {"remove_security_service": {"security_service_id": "a4832822-c619-425f-9f65-aa280194cd7d"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-a2008dc5-a840-4745-9e24-139478cf30d8 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] GET http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/share-access-rules?share_id=b330db31-7766-443d-9c19-26fe349665aa May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-a2008dc5-a840-4745-9e24-139478cf30d8 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-a2008dc5-a840-4745-9e24-139478cf30d8 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault [None req-dd475682-f1d5-4836-9012-0765a25b6792 tempest-SecServicesMappingNegativeTest-270309837 tempest-SecServicesMappingNegativeTest-270309837-project-member] Caught error: Share network wrong_id could not be found.: manila.exception.ShareNetworkNotFound: Share network wrong_id could not be found. May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault Traceback (most recent call last): May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/api/middleware/fault.py", line 76, in __call__ May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return req.get_response(self.application) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/request.py", line 1313, in send May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault status, headers, app_iter = self.call_application( May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/request.py", line 1278, in call_application May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault app_iter = application(self.environ, start_response) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 129, in __call__ May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault resp = self.call_func(req, *args, **kw) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 193, in call_func May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return self.func(req, *args, **kwargs) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_middleware/base.py", line 124, in __call__ May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault response = req.get_response(self.application) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/request.py", line 1313, in send May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault status, headers, app_iter = self.call_application( May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/request.py", line 1278, in call_application May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault app_iter = application(self.environ, start_response) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 143, in __call__ May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return resp(environ, start_response) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 129, in __call__ May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault resp = self.call_func(req, *args, **kw) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 193, in call_func May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return self.func(req, *args, **kwargs) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/osprofiler/web.py", line 111, in __call__ May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return request.get_response(self.application) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/request.py", line 1313, in send May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault status, headers, app_iter = self.call_application( May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/request.py", line 1278, in call_application May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault app_iter = application(self.environ, start_response) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 129, in __call__ May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault resp = self.call_func(req, *args, **kw) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 193, in call_func May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return self.func(req, *args, **kwargs) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py", line 340, in __call__ May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault response = req.get_response(self._app) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/request.py", line 1313, in send May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault status, headers, app_iter = self.call_application( May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/request.py", line 1278, in call_application May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault app_iter = application(self.environ, start_response) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 143, in __call__ May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return resp(environ, start_response) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 143, in __call__ May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return resp(environ, start_response) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/routes/middleware.py", line 153, in __call__ May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault response = self.app(environ, start_response) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 143, in __call__ May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return resp(environ, start_response) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 129, in __call__ May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault resp = self.call_func(req, *args, **kw) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 193, in call_func May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return self.func(req, *args, **kwargs) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/api/openstack/wsgi.py", line 764, in __call__ May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return self._process_stack(request, action, action_args, May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/api/openstack/wsgi.py", line 829, in _process_stack May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault action_result = self.dispatch(meth, request, action_args) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/api/openstack/wsgi.py", line 924, in dispatch May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return method(req=request, **action_args) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/api/v2/share_networks.py", line 486, in remove_security_service May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault share_network = db_api.share_network_get(context, id) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/db/api.py", line 1038, in share_network_get May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return IMPL.share_network_get(context, id) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/db/sqlalchemy/api.py", line 166, in wrapper May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return f(*args, **kwargs) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/enginefacade.py", line 998, in wrapper May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return fn(*args, **kwargs) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/db/sqlalchemy/api.py", line 4810, in share_network_get May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return _share_network_get(context, id) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/db/sqlalchemy/api.py", line 166, in wrapper May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return f(*args, **kwargs) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/db/sqlalchemy/api.py", line 4817, in _share_network_get May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault raise exception.ShareNetworkNotFound(share_network_id=id) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault manila.exception.ShareNetworkNotFound: Share network wrong_id could not be found. May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.middleware.fault [None req-dd475682-f1d5-4836-9012-0765a25b6792 tempest-SecServicesMappingNegativeTest-270309837 tempest-SecServicesMappingNegativeTest-270309837-project-member] http://10.27.203.238/share/v1/f96e397cc60642c39058e772b0083a08/share-networks/wrong_id/action returned with HTTP 404 May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1090/2205] 10.27.203.238 () {64 vars in 1390 bytes} [Tue May 28 13:01:23 2024] POST /share/v1/f96e397cc60642c39058e772b0083a08/share-networks/wrong_id/action => generated 110 bytes in 17 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-34de94df-b6ec-437d-a926-f8aafdd2c6b2 tempest-SecServicesMappingNegativeTest-270309837 tempest-SecServicesMappingNegativeTest-270309837-project-member] GET http://10.27.203.238/share/v1/f96e397cc60642c39058e772b0083a08/security-services?share_network_id=wrong_id May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-34de94df-b6ec-437d-a926-f8aafdd2c6b2 tempest-SecServicesMappingNegativeTest-270309837 tempest-SecServicesMappingNegativeTest-270309837-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-34de94df-b6ec-437d-a926-f8aafdd2c6b2 tempest-SecServicesMappingNegativeTest-270309837 tempest-SecServicesMappingNegativeTest-270309837-project-member] Calling method 'SecurityServiceController.index' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:23 l75lg1-v1 manila-share[98474]: DEBUG manila.share.manager [None req-fb7bb11b-5238-408d-ae0a-8254b1ceff2f tempest-ShareRulesTest-1530341375 None] Received request to update access for share instance f7e47502-a0f7-44de-953d-b7b5697ae0b2. {{(pid=98474) update_access_for_instances /opt/stack/manila/manila/share/manager.py:4353}} May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault [None req-34de94df-b6ec-437d-a926-f8aafdd2c6b2 tempest-SecServicesMappingNegativeTest-270309837 tempest-SecServicesMappingNegativeTest-270309837-project-member] Caught error: Share network wrong_id could not be found.: manila.exception.ShareNetworkNotFound: Share network wrong_id could not be found. May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault Traceback (most recent call last): May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/api/middleware/fault.py", line 76, in __call__ May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return req.get_response(self.application) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/request.py", line 1313, in send May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault status, headers, app_iter = self.call_application( May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/request.py", line 1278, in call_application May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault app_iter = application(self.environ, start_response) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 129, in __call__ May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault resp = self.call_func(req, *args, **kw) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 193, in call_func May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return self.func(req, *args, **kwargs) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_middleware/base.py", line 124, in __call__ May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault response = req.get_response(self.application) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/request.py", line 1313, in send May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault status, headers, app_iter = self.call_application( May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/request.py", line 1278, in call_application May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault app_iter = application(self.environ, start_response) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 143, in __call__ May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return resp(environ, start_response) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 129, in __call__ May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault resp = self.call_func(req, *args, **kw) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 193, in call_func May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return self.func(req, *args, **kwargs) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/osprofiler/web.py", line 111, in __call__ May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return request.get_response(self.application) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/request.py", line 1313, in send May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault status, headers, app_iter = self.call_application( May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/request.py", line 1278, in call_application May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault app_iter = application(self.environ, start_response) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 129, in __call__ May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault resp = self.call_func(req, *args, **kw) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 193, in call_func May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return self.func(req, *args, **kwargs) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py", line 340, in __call__ May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault response = req.get_response(self._app) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/request.py", line 1313, in send May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault status, headers, app_iter = self.call_application( May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/request.py", line 1278, in call_application May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault app_iter = application(self.environ, start_response) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 143, in __call__ May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return resp(environ, start_response) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 143, in __call__ May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return resp(environ, start_response) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/routes/middleware.py", line 153, in __call__ May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault response = self.app(environ, start_response) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 143, in __call__ May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return resp(environ, start_response) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 129, in __call__ May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault resp = self.call_func(req, *args, **kw) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 193, in call_func May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return self.func(req, *args, **kwargs) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/api/openstack/wsgi.py", line 764, in __call__ May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return self._process_stack(request, action, action_args, May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/api/openstack/wsgi.py", line 829, in _process_stack May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault action_result = self.dispatch(meth, request, action_args) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/api/openstack/wsgi.py", line 924, in dispatch May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return method(req=request, **action_args) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/api/v1/security_service.py", line 85, in index May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return self._get_security_services(req, is_detail=False) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/api/v1/security_service.py", line 107, in _get_security_services May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault share_nw = db.share_network_get(context, May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/db/api.py", line 1038, in share_network_get May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return IMPL.share_network_get(context, id) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/db/sqlalchemy/api.py", line 166, in wrapper May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return f(*args, **kwargs) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/enginefacade.py", line 998, in wrapper May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return fn(*args, **kwargs) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/db/sqlalchemy/api.py", line 4810, in share_network_get May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return _share_network_get(context, id) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/db/sqlalchemy/api.py", line 166, in wrapper May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return f(*args, **kwargs) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/db/sqlalchemy/api.py", line 4817, in _share_network_get May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault raise exception.ShareNetworkNotFound(share_network_id=id) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault manila.exception.ShareNetworkNotFound: Share network wrong_id could not be found. May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.middleware.fault [None req-34de94df-b6ec-437d-a926-f8aafdd2c6b2 tempest-SecServicesMappingNegativeTest-270309837 tempest-SecServicesMappingNegativeTest-270309837-project-member] http://10.27.203.238/share/v1/f96e397cc60642c39058e772b0083a08/security-services?share_network_id=wrong_id returned with HTTP 404 May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1091/2206] 10.27.203.238 () {62 vars in 1381 bytes} [Tue May 28 13:01:23 2024] GET /share/v1/f96e397cc60642c39058e772b0083a08/security-services?share_network_id=wrong_id => generated 110 bytes in 18 msecs (HTTP/1.1 404) 6 headers in 237 bytes (2 switches on core 0) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-1af4109f-d35b-4221-b105-2687f08db300 tempest-SecServicesMappingNegativeTest-270309837 tempest-SecServicesMappingNegativeTest-270309837-project-member] POST http://10.27.203.238/share/v1/f96e397cc60642c39058e772b0083a08/share-networks May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-1af4109f-d35b-4221-b105-2687f08db300 tempest-SecServicesMappingNegativeTest-270309837 tempest-SecServicesMappingNegativeTest-270309837-project-member] Action: 'create', calling method: ShareNetworkController.create, body: {"share_network": {"name": "tempest-sn-name-2076703677", "description": "tempest-sn-desc-660288301", "neutron_net_id": "tempest-net-id-320988679", "neutron_subnet_id": "tempest-subnet-id-1383117556"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.lock.api [None req-a2008dc5-a840-4745-9e24-139478cf30d8 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Searching for locks by: {'resource_id': 'dca77461-e33f-4c3b-80d1-35fc9e78f7d0', 'resource_action': 'show', 'resource_type': 'access_rule'} {{(pid=98329) get_all /opt/stack/manila/manila/lock/api.py:112}} May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-a2008dc5-a840-4745-9e24-139478cf30d8 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/share-access-rules?share_id=b330db31-7766-443d-9c19-26fe349665aa returned with HTTP 200 May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1116/2207] 10.27.203.238 () {64 vars in 1467 bytes} [Tue May 28 13:01:23 2024] GET /share/v2/a4f3887fa28c457390f5b66615564430/share-access-rules?share_id=b330db31-7766-443d-9c19-26fe349665aa => generated 288 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:01:23 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-fb7bb11b-5238-408d-ae0a-8254b1ceff2f tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:01:23 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-fb7bb11b-5238-408d-ae0a-8254b1ceff2f tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:01:23 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-fb7bb11b-5238-408d-ae0a-8254b1ceff2f tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.005s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:01:23 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-fb7bb11b-5238-408d-ae0a-8254b1ceff2f tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:01:23 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-fb7bb11b-5238-408d-ae0a-8254b1ceff2f tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.quota [None req-1af4109f-d35b-4221-b105-2687f08db300 tempest-SecServicesMappingNegativeTest-270309837 tempest-SecServicesMappingNegativeTest-270309837-project-member] Created reservations ['8b838d20-0897-4f6f-b4b9-f6a47c0566ac'] {{(pid=98330) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 13:01:23 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-9242ab9c-98af-4bf4-ab2d-7a757be81a4f tempest-SharesNFSTest-667257547 None] Created reservations ['f9390add-23de-4cbf-8996-4df94651cad4', '47a3bd8b-c3c3-4258-b018-b099bf4a7133', '532fc06c-3ac7-4a47-ba43-e1fb61c1739f', '49b6a97a-ffaa-4b11-a33f-2a41bdb09230'] {{(pid=98474) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 13:01:23 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-fb7bb11b-5238-408d-ae0a-8254b1ceff2f tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.083s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:01:23 l75lg1-v1 manila-share[98474]: DEBUG manila.share.access [None req-fb7bb11b-5238-408d-ae0a-8254b1ceff2f tempest-ShareRulesTest-1530341375 None] Updating access rules for share instance f7e47502-a0f7-44de-953d-b7b5697ae0b2 belonging to share b330db31-7766-443d-9c19-26fe349665aa. {{(pid=98474) update_access_rules /opt/stack/manila/manila/share/access.py:298}} May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.quota [None req-1af4109f-d35b-4221-b105-2687f08db300 tempest-SecServicesMappingNegativeTest-270309837 tempest-SecServicesMappingNegativeTest-270309837-project-member] Committed reservations ['8b838d20-0897-4f6f-b4b9-f6a47c0566ac'] {{(pid=98330) commit /opt/stack/manila/manila/quota.py:1063}} May 28 13:01:23 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-fb7bb11b-5238-408d-ae0a-8254b1ceff2f tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:01:23 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-fb7bb11b-5238-408d-ae0a-8254b1ceff2f tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-1af4109f-d35b-4221-b105-2687f08db300 tempest-SecServicesMappingNegativeTest-270309837 tempest-SecServicesMappingNegativeTest-270309837-project-member] http://10.27.203.238/share/v1/f96e397cc60642c39058e772b0083a08/share-networks returned with HTTP 200 May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1092/2208] 10.27.203.238 () {64 vars in 1343 bytes} [Tue May 28 13:01:23 2024] POST /share/v1/f96e397cc60642c39058e772b0083a08/share-networks => generated 462 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:01:23 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-fb7bb11b-5238-408d-ae0a-8254b1ceff2f tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.008s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:01:23 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-fb7bb11b-5238-408d-ae0a-8254b1ceff2f tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:01:23 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-fb7bb11b-5238-408d-ae0a-8254b1ceff2f tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-2dcc2448-38ca-44a9-873f-9ad4646d1626 tempest-SecServicesMappingNegativeTest-270309837 tempest-SecServicesMappingNegativeTest-270309837-project-member] POST http://10.27.203.238/share/v1/f96e397cc60642c39058e772b0083a08/security-services May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-2dcc2448-38ca-44a9-873f-9ad4646d1626 tempest-SecServicesMappingNegativeTest-270309837 tempest-SecServicesMappingNegativeTest-270309837-project-member] Action: 'create', calling method: SecurityServiceController.create, body: {"security_service": {"type": "ldap", "name": "tempest-ss-name-1879776833", "description": "tempest-ss-desc-52399469", "dns_ip": "203.0.113.80", "server": "203.0.113.53", "domain": "tempest-ss-domain-2122890311", "user": "tempest-ss-user-307805308", "password": "***"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:01:23 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-9242ab9c-98af-4bf4-ab2d-7a757be81a4f tempest-SharesNFSTest-667257547 None] Committed reservations ['f9390add-23de-4cbf-8996-4df94651cad4', '47a3bd8b-c3c3-4258-b018-b099bf4a7133', '532fc06c-3ac7-4a47-ba43-e1fb61c1739f', '49b6a97a-ffaa-4b11-a33f-2a41bdb09230'] {{(pid=98474) commit /opt/stack/manila/manila/quota.py:1063}} May 28 13:01:23 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-fb7bb11b-5238-408d-ae0a-8254b1ceff2f tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.014s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:01:23 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-fb7bb11b-5238-408d-ae0a-8254b1ceff2f tempest-ShareRulesTest-1530341375 None] changing access on None May 28 13:01:23 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-fb7bb11b-5238-408d-ae0a-8254b1ceff2f tempest-ShareRulesTest-1530341375 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:01:23 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-fb7bb11b-5238-408d-ae0a-8254b1ceff2f tempest-ShareRulesTest-1530341375 None] {'allow_redirects': True, May 28 13:01:23 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-fb7bb11b-5238-408d-ae0a-8254b1ceff2f tempest-ShareRulesTest-1530341375 None] 'params': {'name': 'f7e47502-a0f7-44de-953d-b7b5697ae0b2'}} May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-2dcc2448-38ca-44a9-873f-9ad4646d1626 tempest-SecServicesMappingNegativeTest-270309837 tempest-SecServicesMappingNegativeTest-270309837-project-member] http://10.27.203.238/share/v1/f96e397cc60642c39058e772b0083a08/security-services returned with HTTP 200 May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1117/2209] 10.27.203.238 () {64 vars in 1352 bytes} [Tue May 28 13:01:23 2024] POST /share/v1/f96e397cc60642c39058e772b0083a08/security-services => generated 473 bytes in 20 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:01:23 l75lg1-v1 manila-share[98474]: INFO manila.share.manager [None req-9242ab9c-98af-4bf4-ab2d-7a757be81a4f tempest-SharesNFSTest-667257547 None] Share instance d935f840-e1e2-4366-85e1-9cee599842b6: deleted successfully. May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-256f256a-8b0d-42e6-8514-6e38d6ebaa54 tempest-SecServicesMappingNegativeTest-270309837 tempest-SecServicesMappingNegativeTest-270309837-project-member] POST http://10.27.203.238/share/v1/f96e397cc60642c39058e772b0083a08/share-networks/ce9f8973-c118-4bdb-bc35-9385e3287f3a/action May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-256f256a-8b0d-42e6-8514-6e38d6ebaa54 tempest-SecServicesMappingNegativeTest-270309837 tempest-SecServicesMappingNegativeTest-270309837-project-member] Action body: b'{"add_security_service": {"security_service_id": "75a8d123-4d04-40c7-97b6-88a771997cd8"}}' {{(pid=98330) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-256f256a-8b0d-42e6-8514-6e38d6ebaa54 tempest-SecServicesMappingNegativeTest-270309837 tempest-SecServicesMappingNegativeTest-270309837-project-member] Action: 'action', calling method: ShareNetworkController.add_security_service, body: {"add_security_service": {"security_service_id": "75a8d123-4d04-40c7-97b6-88a771997cd8"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-256f256a-8b0d-42e6-8514-6e38d6ebaa54 tempest-SecServicesMappingNegativeTest-270309837 tempest-SecServicesMappingNegativeTest-270309837-project-member] http://10.27.203.238/share/v1/f96e397cc60642c39058e772b0083a08/share-networks/ce9f8973-c118-4bdb-bc35-9385e3287f3a/action returned with HTTP 200 May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1093/2210] 10.27.203.238 () {64 vars in 1474 bytes} [Tue May 28 13:01:23 2024] POST /share/v1/f96e397cc60642c39058e772b0083a08/share-networks/ce9f8973-c118-4bdb-bc35-9385e3287f3a/action => generated 462 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-9a69eac1-3ec9-44c5-a3a9-fcbbc2a95c3f tempest-SecServicesMappingNegativeTest-270309837 tempest-SecServicesMappingNegativeTest-270309837-project-member] DELETE http://10.27.203.238/share/v1/f96e397cc60642c39058e772b0083a08/security-services/75a8d123-4d04-40c7-97b6-88a771997cd8 May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-9a69eac1-3ec9-44c5-a3a9-fcbbc2a95c3f tempest-SecServicesMappingNegativeTest-270309837 tempest-SecServicesMappingNegativeTest-270309837-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-9a69eac1-3ec9-44c5-a3a9-fcbbc2a95c3f tempest-SecServicesMappingNegativeTest-270309837 tempest-SecServicesMappingNegativeTest-270309837-project-member] Calling method 'SecurityServiceController.delete' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.v1.security_service [None req-9a69eac1-3ec9-44c5-a3a9-fcbbc2a95c3f tempest-SecServicesMappingNegativeTest-270309837 tempest-SecServicesMappingNegativeTest-270309837-project-member] Delete security service with id: 75a8d123-4d04-40c7-97b6-88a771997cd8 May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-9a69eac1-3ec9-44c5-a3a9-fcbbc2a95c3f tempest-SecServicesMappingNegativeTest-270309837 tempest-SecServicesMappingNegativeTest-270309837-project-member] HTTP exception thrown: Cannot delete security service. It is assigned to share network(s) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-9a69eac1-3ec9-44c5-a3a9-fcbbc2a95c3f tempest-SecServicesMappingNegativeTest-270309837 tempest-SecServicesMappingNegativeTest-270309837-project-member] http://10.27.203.238/share/v1/f96e397cc60642c39058e772b0083a08/security-services/75a8d123-4d04-40c7-97b6-88a771997cd8 returned with HTTP 403 May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1118/2211] 10.27.203.238 () {62 vars in 1444 bytes} [Tue May 28 13:01:23 2024] DELETE /share/v1/f96e397cc60642c39058e772b0083a08/security-services/75a8d123-4d04-40c7-97b6-88a771997cd8 => generated 109 bytes in 20 msecs (HTTP/1.1 403) 6 headers in 237 bytes (1 switches on core 0) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-1d8755ed-288a-4003-a8f4-1f7826775c0e tempest-SecServicesMappingNegativeTest-270309837 tempest-SecServicesMappingNegativeTest-270309837-project-member] POST http://10.27.203.238/share/v1/f96e397cc60642c39058e772b0083a08/share-networks/ce9f8973-c118-4bdb-bc35-9385e3287f3a/action May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-1d8755ed-288a-4003-a8f4-1f7826775c0e tempest-SecServicesMappingNegativeTest-270309837 tempest-SecServicesMappingNegativeTest-270309837-project-member] Action body: b'{"remove_security_service": {"security_service_id": "75a8d123-4d04-40c7-97b6-88a771997cd8"}}' {{(pid=98330) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-1d8755ed-288a-4003-a8f4-1f7826775c0e tempest-SecServicesMappingNegativeTest-270309837 tempest-SecServicesMappingNegativeTest-270309837-project-member] Action: 'action', calling method: ShareNetworkController.remove_security_service, body: {"remove_security_service": {"security_service_id": "75a8d123-4d04-40c7-97b6-88a771997cd8"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-1d8755ed-288a-4003-a8f4-1f7826775c0e tempest-SecServicesMappingNegativeTest-270309837 tempest-SecServicesMappingNegativeTest-270309837-project-member] http://10.27.203.238/share/v1/f96e397cc60642c39058e772b0083a08/share-networks/ce9f8973-c118-4bdb-bc35-9385e3287f3a/action returned with HTTP 200 May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1094/2212] 10.27.203.238 () {64 vars in 1474 bytes} [Tue May 28 13:01:23 2024] POST /share/v1/f96e397cc60642c39058e772b0083a08/share-networks/ce9f8973-c118-4bdb-bc35-9385e3287f3a/action => generated 462 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-ce9425aa-1f2a-4f9e-a138-4a418161e0e3 tempest-SharesNFSTest-667257547 tempest-SharesNFSTest-667257547-project-member] GET http://10.27.203.238/share/v2/0af6f8e0aeed4f27b075e08f2bc713aa/shares/7a762332-0877-462f-941a-6581abbf784b May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-f0aec459-eaa0-4af7-a5af-970e9f16afe2 tempest-SecServicesMappingNegativeTest-270309837 tempest-SecServicesMappingNegativeTest-270309837-project-member] DELETE http://10.27.203.238/share/v1/f96e397cc60642c39058e772b0083a08/security-services/75a8d123-4d04-40c7-97b6-88a771997cd8 May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-ce9425aa-1f2a-4f9e-a138-4a418161e0e3 tempest-SharesNFSTest-667257547 tempest-SharesNFSTest-667257547-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-f0aec459-eaa0-4af7-a5af-970e9f16afe2 tempest-SecServicesMappingNegativeTest-270309837 tempest-SecServicesMappingNegativeTest-270309837-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-ce9425aa-1f2a-4f9e-a138-4a418161e0e3 tempest-SharesNFSTest-667257547 tempest-SharesNFSTest-667257547-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-f0aec459-eaa0-4af7-a5af-970e9f16afe2 tempest-SecServicesMappingNegativeTest-270309837 tempest-SecServicesMappingNegativeTest-270309837-project-member] Calling method 'SecurityServiceController.delete' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.v1.security_service [None req-f0aec459-eaa0-4af7-a5af-970e9f16afe2 tempest-SecServicesMappingNegativeTest-270309837 tempest-SecServicesMappingNegativeTest-270309837-project-member] Delete security service with id: 75a8d123-4d04-40c7-97b6-88a771997cd8 May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-ce9425aa-1f2a-4f9e-a138-4a418161e0e3 tempest-SharesNFSTest-667257547 tempest-SharesNFSTest-667257547-project-member] HTTP exception thrown: The resource could not be found. May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-ce9425aa-1f2a-4f9e-a138-4a418161e0e3 tempest-SharesNFSTest-667257547 tempest-SharesNFSTest-667257547-project-member] http://10.27.203.238/share/v2/0af6f8e0aeed4f27b075e08f2bc713aa/shares/7a762332-0877-462f-941a-6581abbf784b returned with HTTP 404 May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1095/2213] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:01:23 2024] GET /share/v2/0af6f8e0aeed4f27b075e08f2bc713aa/shares/7a762332-0877-462f-941a-6581abbf784b => generated 78 bytes in 12 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-f2974713-b860-4ae7-acdf-09cdc48c06f2 tempest-SharesNFSTest-1858044304 tempest-SharesNFSTest-1858044304-project-admin] DELETE http://10.27.203.238/share/v2/40625c7a855049188adc00ac1e323af7/types/243c4676-ce4e-459a-8f50-f726c4b0d7ee May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-f2974713-b860-4ae7-acdf-09cdc48c06f2 tempest-SharesNFSTest-1858044304 tempest-SharesNFSTest-1858044304-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-f2974713-b860-4ae7-acdf-09cdc48c06f2 tempest-SharesNFSTest-1858044304 tempest-SharesNFSTest-1858044304-project-admin] Calling method 'ShareTypesController._delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-f0aec459-eaa0-4af7-a5af-970e9f16afe2 tempest-SecServicesMappingNegativeTest-270309837 tempest-SecServicesMappingNegativeTest-270309837-project-member] http://10.27.203.238/share/v1/f96e397cc60642c39058e772b0083a08/security-services/75a8d123-4d04-40c7-97b6-88a771997cd8 returned with HTTP 202 May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1119/2214] 10.27.203.238 () {62 vars in 1444 bytes} [Tue May 28 13:01:23 2024] DELETE /share/v1/f96e397cc60642c39058e772b0083a08/security-services/75a8d123-4d04-40c7-97b6-88a771997cd8 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 6 headers in 242 bytes (1 switches on core 0) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-35a2a5b7-637d-4699-ae3e-800fbb3b15e0 tempest-SecServicesMappingNegativeTest-270309837 tempest-SecServicesMappingNegativeTest-270309837-project-member] GET http://10.27.203.238/share/v1/f96e397cc60642c39058e772b0083a08/security-services/75a8d123-4d04-40c7-97b6-88a771997cd8 May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-35a2a5b7-637d-4699-ae3e-800fbb3b15e0 tempest-SecServicesMappingNegativeTest-270309837 tempest-SecServicesMappingNegativeTest-270309837-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-35a2a5b7-637d-4699-ae3e-800fbb3b15e0 tempest-SecServicesMappingNegativeTest-270309837 tempest-SecServicesMappingNegativeTest-270309837-project-member] Calling method 'SecurityServiceController.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-35a2a5b7-637d-4699-ae3e-800fbb3b15e0 tempest-SecServicesMappingNegativeTest-270309837 tempest-SecServicesMappingNegativeTest-270309837-project-member] HTTP exception thrown: The resource could not be found. May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-35a2a5b7-637d-4699-ae3e-800fbb3b15e0 tempest-SecServicesMappingNegativeTest-270309837 tempest-SecServicesMappingNegativeTest-270309837-project-member] http://10.27.203.238/share/v1/f96e397cc60642c39058e772b0083a08/security-services/75a8d123-4d04-40c7-97b6-88a771997cd8 returned with HTTP 404 May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1120/2215] 10.27.203.238 () {62 vars in 1441 bytes} [Tue May 28 13:01:23 2024] GET /share/v1/f96e397cc60642c39058e772b0083a08/security-services/75a8d123-4d04-40c7-97b6-88a771997cd8 => generated 78 bytes in 9 msecs (HTTP/1.1 404) 6 headers in 236 bytes (2 switches on core 0) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-63ebc210-5935-4e49-9f4b-a33b3f448931 tempest-SecServicesMappingNegativeTest-270309837 tempest-SecServicesMappingNegativeTest-270309837-project-member] DELETE http://10.27.203.238/share/v1/f96e397cc60642c39058e772b0083a08/share-networks/ce9f8973-c118-4bdb-bc35-9385e3287f3a May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-63ebc210-5935-4e49-9f4b-a33b3f448931 tempest-SecServicesMappingNegativeTest-270309837 tempest-SecServicesMappingNegativeTest-270309837-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-63ebc210-5935-4e49-9f4b-a33b3f448931 tempest-SecServicesMappingNegativeTest-270309837 tempest-SecServicesMappingNegativeTest-270309837-project-member] Calling method 'ShareNetworkController.delete' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-f2974713-b860-4ae7-acdf-09cdc48c06f2 tempest-SharesNFSTest-1858044304 tempest-SharesNFSTest-1858044304-project-admin] http://10.27.203.238/share/v2/40625c7a855049188adc00ac1e323af7/types/243c4676-ce4e-459a-8f50-f726c4b0d7ee returned with HTTP 202 May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1096/2216] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:01:23 2024] DELETE /share/v2/40625c7a855049188adc00ac1e323af7/types/243c4676-ce4e-459a-8f50-f726c4b0d7ee => generated 0 bytes in 52 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-0ae044e4-99d0-4c67-bad9-44e95bbb73d7 tempest-SharesNFSTest-1858044304 tempest-SharesNFSTest-1858044304-project-admin] GET http://10.27.203.238/share/v2/40625c7a855049188adc00ac1e323af7/types/243c4676-ce4e-459a-8f50-f726c4b0d7ee May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-0ae044e4-99d0-4c67-bad9-44e95bbb73d7 tempest-SharesNFSTest-1858044304 tempest-SharesNFSTest-1858044304-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-0ae044e4-99d0-4c67-bad9-44e95bbb73d7 tempest-SharesNFSTest-1858044304 tempest-SharesNFSTest-1858044304-project-admin] Calling method 'ShareTypesController.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-0ae044e4-99d0-4c67-bad9-44e95bbb73d7 tempest-SharesNFSTest-1858044304 tempest-SharesNFSTest-1858044304-project-admin] HTTP exception thrown: Share type not found. May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-0ae044e4-99d0-4c67-bad9-44e95bbb73d7 tempest-SharesNFSTest-1858044304 tempest-SharesNFSTest-1858044304-project-admin] http://10.27.203.238/share/v2/40625c7a855049188adc00ac1e323af7/types/243c4676-ce4e-459a-8f50-f726c4b0d7ee returned with HTTP 404 May 28 13:01:23 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1097/2217] 10.27.203.238 () {64 vars in 1448 bytes} [Tue May 28 13:01:23 2024] GET /share/v2/40625c7a855049188adc00ac1e323af7/types/243c4676-ce4e-459a-8f50-f726c4b0d7ee => generated 67 bytes in 10 msecs (HTTP/1.1 404) 6 headers in 237 bytes (2 switches on core 0) May 28 13:01:24 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-ff6e841f-ba7b-449c-a783-b92c78fb92db tempest-SharesNFSTest-667257547 tempest-SharesNFSTest-667257547-project-member] POST http://10.27.203.238/share/v2/0af6f8e0aeed4f27b075e08f2bc713aa/shares May 28 13:01:24 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-ff6e841f-ba7b-449c-a783-b92c78fb92db tempest-SharesNFSTest-667257547 tempest-SharesNFSTest-667257547-project-member] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share": {"share_proto": "nfs", "description": "Tempest's share", "snapshot_id": null, "name": "tempest-tempest-created-share-430948550", "size": 1, "metadata": {}, "is_public": false, "share_type": "8129f187-256c-46ff-ae6b-e17fed07af1a"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:01:24 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.v1.shares [None req-ff6e841f-ba7b-449c-a783-b92c78fb92db tempest-SharesNFSTest-667257547 tempest-SharesNFSTest-667257547-project-member] Create NFS share of 1 GB May 28 13:01:24 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.quota [None req-63ebc210-5935-4e49-9f4b-a33b3f448931 tempest-SecServicesMappingNegativeTest-270309837 tempest-SecServicesMappingNegativeTest-270309837-project-member] Created reservations ['d4f22567-1274-4223-ad2c-d915e8a7d4b6'] {{(pid=98329) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 13:01:24 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.quota [None req-ff6e841f-ba7b-449c-a783-b92c78fb92db tempest-SharesNFSTest-667257547 tempest-SharesNFSTest-667257547-project-member] Created reservations ['f873f105-2277-457b-9006-58a5b443ea7b', '8a100ee5-ca41-4958-a474-042a3683db86', '8c244219-0e02-4bcc-942c-25da151fe7b2', '31233032-2ff7-4354-9f73-418cdeba60a8'] {{(pid=98330) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 13:01:24 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-fb7bb11b-5238-408d-ae0a-8254b1ceff2f tempest-ShareRulesTest-1530341375 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:01:24 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-fb7bb11b-5238-408d-ae0a-8254b1ceff2f tempest-ShareRulesTest-1530341375 None] [Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=1, created='2024-05-28T12:59:53.824250Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='0fa84ccd-850f-48fa-a965-23e5abe31188', id=38, internal=False, is_s3_default_policy=False, name='f7e47502-a0f7-44de-953d-b7b5697ae0b2', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=['*'], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['203.0.113.77'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['203.0.113.77'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T13:01:22.463682Z', tenant_id=1, tenant_name='default', title='f7e47502-a0f7-44de-953d-b7b5697ae0b2', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/38/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[])] May 28 13:01:24 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-fb7bb11b-5238-408d-ae0a-8254b1ceff2f tempest-ShareRulesTest-1530341375 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 13:01:24 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-fb7bb11b-5238-408d-ae0a-8254b1ceff2f tempest-ShareRulesTest-1530341375 None] changing access on /manila/manila-f7e47502-a0f7-44de-953d-b7b5697ae0b2. Rules: {'nfs_read_write': [], 'nfs_read_only': []} May 28 13:01:24 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-fb7bb11b-5238-408d-ae0a-8254b1ceff2f tempest-ShareRulesTest-1530341375 None] >>> [PATCH] https://127.0.0.1:40443/api/viewpolicies/38/ May 28 13:01:24 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-fb7bb11b-5238-408d-ae0a-8254b1ceff2f tempest-ShareRulesTest-1530341375 None] {'data': '{"name": "f7e47502-a0f7-44de-953d-b7b5697ae0b2", "nfs_no_squash": ' May 28 13:01:24 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-fb7bb11b-5238-408d-ae0a-8254b1ceff2f tempest-ShareRulesTest-1530341375 None] '["*"], "nfs_root_squash": ["*"], "nfs_read_write": [], ' May 28 13:01:24 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-fb7bb11b-5238-408d-ae0a-8254b1ceff2f tempest-ShareRulesTest-1530341375 None] '"nfs_read_only": []}', May 28 13:01:24 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-fb7bb11b-5238-408d-ae0a-8254b1ceff2f tempest-ShareRulesTest-1530341375 None] 'params': None} May 28 13:01:24 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.quota [None req-63ebc210-5935-4e49-9f4b-a33b3f448931 tempest-SecServicesMappingNegativeTest-270309837 tempest-SecServicesMappingNegativeTest-270309837-project-member] Committed reservations ['d4f22567-1274-4223-ad2c-d915e8a7d4b6'] {{(pid=98329) commit /opt/stack/manila/manila/quota.py:1063}} May 28 13:01:24 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-63ebc210-5935-4e49-9f4b-a33b3f448931 tempest-SecServicesMappingNegativeTest-270309837 tempest-SecServicesMappingNegativeTest-270309837-project-member] http://10.27.203.238/share/v1/f96e397cc60642c39058e772b0083a08/share-networks/ce9f8973-c118-4bdb-bc35-9385e3287f3a returned with HTTP 202 May 28 13:01:24 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1121/2218] 10.27.203.238 () {62 vars in 1435 bytes} [Tue May 28 13:01:23 2024] DELETE /share/v1/f96e397cc60642c39058e772b0083a08/share-networks/ce9f8973-c118-4bdb-bc35-9385e3287f3a => generated 0 bytes in 132 msecs (HTTP/1.1 202) 6 headers in 242 bytes (1 switches on core 0) May 28 13:01:24 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-13bf963c-8908-443d-a8f1-ff76e4b8546a tempest-SecServicesMappingNegativeTest-270309837 tempest-SecServicesMappingNegativeTest-270309837-project-member] GET http://10.27.203.238/share/v1/f96e397cc60642c39058e772b0083a08/share-networks/ce9f8973-c118-4bdb-bc35-9385e3287f3a May 28 13:01:24 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-13bf963c-8908-443d-a8f1-ff76e4b8546a tempest-SecServicesMappingNegativeTest-270309837 tempest-SecServicesMappingNegativeTest-270309837-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:24 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-13bf963c-8908-443d-a8f1-ff76e4b8546a tempest-SecServicesMappingNegativeTest-270309837 tempest-SecServicesMappingNegativeTest-270309837-project-member] Calling method 'ShareNetworkController.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:24 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-13bf963c-8908-443d-a8f1-ff76e4b8546a tempest-SecServicesMappingNegativeTest-270309837 tempest-SecServicesMappingNegativeTest-270309837-project-member] HTTP exception thrown: Share network ce9f8973-c118-4bdb-bc35-9385e3287f3a could not be found. May 28 13:01:24 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-13bf963c-8908-443d-a8f1-ff76e4b8546a tempest-SecServicesMappingNegativeTest-270309837 tempest-SecServicesMappingNegativeTest-270309837-project-member] http://10.27.203.238/share/v1/f96e397cc60642c39058e772b0083a08/share-networks/ce9f8973-c118-4bdb-bc35-9385e3287f3a returned with HTTP 404 May 28 13:01:24 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1122/2219] 10.27.203.238 () {62 vars in 1432 bytes} [Tue May 28 13:01:24 2024] GET /share/v1/f96e397cc60642c39058e772b0083a08/share-networks/ce9f8973-c118-4bdb-bc35-9385e3287f3a => generated 116 bytes in 20 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 13:01:24 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-acb20f2c-9905-460e-8b59-57f369361633 tempest-SecServicesMappingNegativeTest-270309837 tempest-SecServicesMappingNegativeTest-270309837-project-member] POST http://10.27.203.238/share/v1/f96e397cc60642c39058e772b0083a08/share-networks May 28 13:01:24 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-acb20f2c-9905-460e-8b59-57f369361633 tempest-SecServicesMappingNegativeTest-270309837 tempest-SecServicesMappingNegativeTest-270309837-project-member] Action: 'create', calling method: ShareNetworkController.create, body: {"share_network": {"name": "tempest-sn-name-317170987", "description": "tempest-sn-desc-745265682", "neutron_net_id": "tempest-net-id-677355265", "neutron_subnet_id": "tempest-subnet-id-1550317484"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:01:24 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.quota [None req-ff6e841f-ba7b-449c-a783-b92c78fb92db tempest-SharesNFSTest-667257547 tempest-SharesNFSTest-667257547-project-member] Committed reservations ['f873f105-2277-457b-9006-58a5b443ea7b', '8a100ee5-ca41-4958-a474-042a3683db86', '8c244219-0e02-4bcc-942c-25da151fe7b2', '31233032-2ff7-4354-9f73-418cdeba60a8'] {{(pid=98330) commit /opt/stack/manila/manila/quota.py:1063}} May 28 13:01:24 l75lg1-v1 neutron-server[77619]: DEBUG dbcounter [-] [77619] Writing DB stats neutron:SELECT=2 {{(pid=77619) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:01:24 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.quota [None req-acb20f2c-9905-460e-8b59-57f369361633 tempest-SecServicesMappingNegativeTest-270309837 tempest-SecServicesMappingNegativeTest-270309837-project-member] Created reservations ['de2f2037-d775-496c-9d3e-574143ac2151'] {{(pid=98329) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 13:01:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "_check_child_processes" by "neutron.agent.linux.external_process.ProcessMonitor._check_child_processes" {{(pid=76818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:01:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_concurrency.lockutils [-] Lock "_check_child_processes" acquired by "neutron.agent.linux.external_process.ProcessMonitor._check_child_processes" :: waited 0.001s {{(pid=76818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:01:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_concurrency.lockutils [-] Lock "_check_child_processes" "released" by "neutron.agent.linux.external_process.ProcessMonitor._check_child_processes" :: held 0.001s {{(pid=76818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:01:24 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.host_manager [None req-ff6e841f-ba7b-449c-a783-b92c78fb92db tempest-SharesNFSTest-667257547 None] Share service is down. (host: l75lg1-v1@generic2). May 28 13:01:24 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.host_manager [None req-ff6e841f-ba7b-449c-a783-b92c78fb92db tempest-SharesNFSTest-667257547 None] Share service is down. (host: l75lg1-v1@generic1). May 28 13:01:24 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-ff6e841f-ba7b-449c-a783-b92c78fb92db tempest-SharesNFSTest-667257547 None] Starting with 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:80}} May 28 13:01:24 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-ff6e841f-ba7b-449c-a783-b92c78fb92db tempest-SharesNFSTest-667257547 None] Filter OnlyHostFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:01:24 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-ff6e841f-ba7b-449c-a783-b92c78fb92db tempest-SharesNFSTest-667257547 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:01:24 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.capacity [None req-ff6e841f-ba7b-449c-a783-b92c78fb92db tempest-SharesNFSTest-667257547 None] Space information for share creation on host l75lg1-v1@vast#vast (requested / avail): 1/2078 {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/capacity.py:83}} May 28 13:01:24 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-ff6e841f-ba7b-449c-a783-b92c78fb92db tempest-SharesNFSTest-667257547 None] Filter CapacityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:01:24 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-ff6e841f-ba7b-449c-a783-b92c78fb92db tempest-SharesNFSTest-667257547 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:01:24 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-ff6e841f-ba7b-449c-a783-b92c78fb92db tempest-SharesNFSTest-667257547 None] Driver Filter: Checking host 'l75lg1-v1@vast#vast' {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:37}} May 28 13:01:24 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-ff6e841f-ba7b-449c-a783-b92c78fb92db tempest-SharesNFSTest-667257547 None] Filter function not set :: passing host. {{(pid=98327) _check_filter_function /opt/stack/manila/manila/scheduler/filters/driver.py:53}} May 28 13:01:24 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-ff6e841f-ba7b-449c-a783-b92c78fb92db tempest-SharesNFSTest-667257547 None] Result: True {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:40}} May 28 13:01:24 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-ff6e841f-ba7b-449c-a783-b92c78fb92db tempest-SharesNFSTest-667257547 None] Done checking host 'l75lg1-v1@vast#vast' {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:41}} May 28 13:01:24 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-ff6e841f-ba7b-449c-a783-b92c78fb92db tempest-SharesNFSTest-667257547 None] Filter DriverFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:01:24 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-ff6e841f-ba7b-449c-a783-b92c78fb92db tempest-SharesNFSTest-667257547 None] Filter ShareReplicationFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:01:24 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-ff6e841f-ba7b-449c-a783-b92c78fb92db tempest-SharesNFSTest-667257547 None] Filter CreateFromSnapshotFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:01:24 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-ff6e841f-ba7b-449c-a783-b92c78fb92db tempest-SharesNFSTest-667257547 None] Filter AffinityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:01:24 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-ff6e841f-ba7b-449c-a783-b92c78fb92db tempest-SharesNFSTest-667257547 None] Filter AntiAffinityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:01:24 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.drivers.filter [None req-ff6e841f-ba7b-449c-a783-b92c78fb92db tempest-SharesNFSTest-667257547 None] Filtered share [host: 'l75lg1-v1@vast#vast', free_capacity_gb: 2078.6277076322585, pools: None] {{(pid=98327) _schedule_share /opt/stack/manila/manila/scheduler/drivers/filter.py:268}} May 28 13:01:24 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-ff6e841f-ba7b-449c-a783-b92c78fb92db tempest-SharesNFSTest-667257547 None] Checking host 'l75lg1-v1@vast#vast' {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:46}} May 28 13:01:24 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.weighers.goodness [None req-ff6e841f-ba7b-449c-a783-b92c78fb92db tempest-SharesNFSTest-667257547 None] Goodness function not set :: defaulting to minimal goodness rating of 0. May 28 13:01:24 l75lg1-v1 manila-scheduler[98327]: INFO manila.scheduler.weighers.goodness [None req-ff6e841f-ba7b-449c-a783-b92c78fb92db tempest-SharesNFSTest-667257547 None] Goodness function result for host l75lg1-v1@vast#vast: 0. May 28 13:01:24 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-ff6e841f-ba7b-449c-a783-b92c78fb92db tempest-SharesNFSTest-667257547 None] Goodness: 0 {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:48}} May 28 13:01:24 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-ff6e841f-ba7b-449c-a783-b92c78fb92db tempest-SharesNFSTest-667257547 None] Done checking host 'l75lg1-v1@vast#vast' {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:49}} May 28 13:01:24 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.drivers.filter [None req-ff6e841f-ba7b-449c-a783-b92c78fb92db tempest-SharesNFSTest-667257547 None] Choosing for share: WeighedHost [host: l75lg1-v1@vast#vast, weight: 0.0] {{(pid=98327) _schedule_share /opt/stack/manila/manila/scheduler/drivers/filter.py:274}} May 28 13:01:24 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-ff6e841f-ba7b-449c-a783-b92c78fb92db tempest-SharesNFSTest-667257547 tempest-SharesNFSTest-667257547-project-member] http://10.27.203.238/share/v2/0af6f8e0aeed4f27b075e08f2bc713aa/shares returned with HTTP 200 May 28 13:01:24 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1098/2220] 10.27.203.238 () {66 vars in 1362 bytes} [Tue May 28 13:01:23 2024] POST /share/v2/0af6f8e0aeed4f27b075e08f2bc713aa/shares => generated 1309 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:01:24 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-9ab5d318-c384-4a7f-91e4-f499ac40a49a tempest-SharesNFSTest-667257547 tempest-SharesNFSTest-667257547-project-member] GET http://10.27.203.238/share/v2/0af6f8e0aeed4f27b075e08f2bc713aa/shares/b40e9810-7e36-4abf-afca-87c742ad83b1 May 28 13:01:24 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-9ab5d318-c384-4a7f-91e4-f499ac40a49a tempest-SharesNFSTest-667257547 tempest-SharesNFSTest-667257547-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:24 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-9ab5d318-c384-4a7f-91e4-f499ac40a49a tempest-SharesNFSTest-667257547 tempest-SharesNFSTest-667257547-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:24 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.quota [None req-acb20f2c-9905-460e-8b59-57f369361633 tempest-SecServicesMappingNegativeTest-270309837 tempest-SecServicesMappingNegativeTest-270309837-project-member] Committed reservations ['de2f2037-d775-496c-9d3e-574143ac2151'] {{(pid=98329) commit /opt/stack/manila/manila/quota.py:1063}} May 28 13:01:24 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-acb20f2c-9905-460e-8b59-57f369361633 tempest-SecServicesMappingNegativeTest-270309837 tempest-SecServicesMappingNegativeTest-270309837-project-member] http://10.27.203.238/share/v1/f96e397cc60642c39058e772b0083a08/share-networks returned with HTTP 200 May 28 13:01:24 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1123/2221] 10.27.203.238 () {64 vars in 1343 bytes} [Tue May 28 13:01:24 2024] POST /share/v1/f96e397cc60642c39058e772b0083a08/share-networks => generated 461 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:01:24 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-49ca20a6-14f3-4e2c-9d4b-df1048673b77 tempest-SecServicesMappingNegativeTest-270309837 tempest-SecServicesMappingNegativeTest-270309837-project-member] POST http://10.27.203.238/share/v1/f96e397cc60642c39058e772b0083a08/security-services May 28 13:01:24 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-9ab5d318-c384-4a7f-91e4-f499ac40a49a tempest-SharesNFSTest-667257547 tempest-SharesNFSTest-667257547-project-member] http://10.27.203.238/share/v2/0af6f8e0aeed4f27b075e08f2bc713aa/shares/b40e9810-7e36-4abf-afca-87c742ad83b1 returned with HTTP 200 May 28 13:01:24 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-49ca20a6-14f3-4e2c-9d4b-df1048673b77 tempest-SecServicesMappingNegativeTest-270309837 tempest-SecServicesMappingNegativeTest-270309837-project-member] Action: 'create', calling method: SecurityServiceController.create, body: {"security_service": {"type": "ldap", "name": "tempest-ss-name-1720855772", "description": "tempest-ss-desc-260496320", "dns_ip": "203.0.113.96", "server": "203.0.113.177", "domain": "tempest-ss-domain-1017696164", "user": "tempest-ss-user-401553649", "password": "***"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:01:24 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1099/2222] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:01:24 2024] GET /share/v2/0af6f8e0aeed4f27b075e08f2bc713aa/shares/b40e9810-7e36-4abf-afca-87c742ad83b1 => generated 1309 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:01:24 l75lg1-v1 dstat.sh[49771]: 28-05 13:01:24| 18 2 75 5 0|5702M 1735M 278M 7909M| 19k 25k| 0 3355k| 0 523 |9270 17k|1.47 1.23 1.08|4.0 3.0 0| 0 0 | 0 2048M| 29 364 0 40 3 May 28 13:01:24 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-49ca20a6-14f3-4e2c-9d4b-df1048673b77 tempest-SecServicesMappingNegativeTest-270309837 tempest-SecServicesMappingNegativeTest-270309837-project-member] http://10.27.203.238/share/v1/f96e397cc60642c39058e772b0083a08/security-services returned with HTTP 200 May 28 13:01:24 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1124/2223] 10.27.203.238 () {64 vars in 1352 bytes} [Tue May 28 13:01:24 2024] POST /share/v1/f96e397cc60642c39058e772b0083a08/security-services => generated 474 bytes in 23 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:01:24 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-a40bf494-0af1-42d5-be16-1fa09f4656b5 tempest-SecServicesMappingNegativeTest-270309837 tempest-SecServicesMappingNegativeTest-270309837-project-member] POST http://10.27.203.238/share/v1/f96e397cc60642c39058e772b0083a08/security-services May 28 13:01:24 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-a40bf494-0af1-42d5-be16-1fa09f4656b5 tempest-SecServicesMappingNegativeTest-270309837 tempest-SecServicesMappingNegativeTest-270309837-project-member] Action: 'create', calling method: SecurityServiceController.create, body: {"security_service": {"type": "ldap", "name": "tempest-ss-name-1947766629", "description": "tempest-ss-desc-1174047609", "dns_ip": "203.0.113.131", "server": "203.0.113.5", "domain": "tempest-ss-domain-490493690", "user": "tempest-ss-user-650068353", "password": "***"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:01:24 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-a40bf494-0af1-42d5-be16-1fa09f4656b5 tempest-SecServicesMappingNegativeTest-270309837 tempest-SecServicesMappingNegativeTest-270309837-project-member] http://10.27.203.238/share/v1/f96e397cc60642c39058e772b0083a08/security-services returned with HTTP 200 May 28 13:01:24 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1100/2224] 10.27.203.238 () {64 vars in 1352 bytes} [Tue May 28 13:01:24 2024] POST /share/v1/f96e397cc60642c39058e772b0083a08/security-services => generated 474 bytes in 20 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:01:24 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-2089e2b5-0067-4fca-ad3b-2e2aacb1ebad tempest-SecServicesMappingNegativeTest-270309837 tempest-SecServicesMappingNegativeTest-270309837-project-member] POST http://10.27.203.238/share/v1/f96e397cc60642c39058e772b0083a08/share-networks/6ecc26b7-15d0-475d-9768-7267abc58439/action May 28 13:01:24 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-2089e2b5-0067-4fca-ad3b-2e2aacb1ebad tempest-SecServicesMappingNegativeTest-270309837 tempest-SecServicesMappingNegativeTest-270309837-project-member] Action body: b'{"add_security_service": {"security_service_id": "ed84e9c2-1eff-476d-be52-d16db827f362"}}' {{(pid=98329) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 13:01:24 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-2089e2b5-0067-4fca-ad3b-2e2aacb1ebad tempest-SecServicesMappingNegativeTest-270309837 tempest-SecServicesMappingNegativeTest-270309837-project-member] Action: 'action', calling method: ShareNetworkController.add_security_service, body: {"add_security_service": {"security_service_id": "ed84e9c2-1eff-476d-be52-d16db827f362"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:01:24 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ff6e841f-ba7b-449c-a783-b92c78fb92db tempest-SharesNFSTest-667257547 None] >>> [GET] https://127.0.0.1:40443/api/vippools/ May 28 13:01:24 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ff6e841f-ba7b-449c-a783-b92c78fb92db tempest-SharesNFSTest-667257547 None] {'allow_redirects': True, 'params': {'name': 'vippool-1'}} May 28 13:01:24 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-2089e2b5-0067-4fca-ad3b-2e2aacb1ebad tempest-SecServicesMappingNegativeTest-270309837 tempest-SecServicesMappingNegativeTest-270309837-project-member] http://10.27.203.238/share/v1/f96e397cc60642c39058e772b0083a08/share-networks/6ecc26b7-15d0-475d-9768-7267abc58439/action returned with HTTP 200 May 28 13:01:24 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1125/2225] 10.27.203.238 () {64 vars in 1474 bytes} [Tue May 28 13:01:24 2024] POST /share/v1/f96e397cc60642c39058e772b0083a08/share-networks/6ecc26b7-15d0-475d-9768-7267abc58439/action => generated 461 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:01:24 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-7463de4d-0a9a-4f75-9779-ed4c5a20d65e tempest-SecServicesMappingNegativeTest-270309837 tempest-SecServicesMappingNegativeTest-270309837-project-member] POST http://10.27.203.238/share/v1/f96e397cc60642c39058e772b0083a08/share-networks/6ecc26b7-15d0-475d-9768-7267abc58439/action May 28 13:01:24 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-7463de4d-0a9a-4f75-9779-ed4c5a20d65e tempest-SecServicesMappingNegativeTest-270309837 tempest-SecServicesMappingNegativeTest-270309837-project-member] Action body: b'{"add_security_service": {"security_service_id": "5e2d7def-ca30-4004-bfdc-6778595bb405"}}' {{(pid=98330) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 13:01:24 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-7463de4d-0a9a-4f75-9779-ed4c5a20d65e tempest-SecServicesMappingNegativeTest-270309837 tempest-SecServicesMappingNegativeTest-270309837-project-member] Action: 'action', calling method: ShareNetworkController.add_security_service, body: {"add_security_service": {"security_service_id": "5e2d7def-ca30-4004-bfdc-6778595bb405"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:01:24 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-7463de4d-0a9a-4f75-9779-ed4c5a20d65e tempest-SecServicesMappingNegativeTest-270309837 tempest-SecServicesMappingNegativeTest-270309837-project-member] HTTP exception thrown: Invalid security service: Cannot add security service to share network. Security service with 'ldap' type already added to '6ecc26b7-15d0-475d-9768-7267abc58439' share network May 28 13:01:24 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-7463de4d-0a9a-4f75-9779-ed4c5a20d65e tempest-SecServicesMappingNegativeTest-270309837 tempest-SecServicesMappingNegativeTest-270309837-project-member] http://10.27.203.238/share/v1/f96e397cc60642c39058e772b0083a08/share-networks/6ecc26b7-15d0-475d-9768-7267abc58439/action returned with HTTP 409 May 28 13:01:24 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1101/2226] 10.27.203.238 () {64 vars in 1474 bytes} [Tue May 28 13:01:24 2024] POST /share/v1/f96e397cc60642c39058e772b0083a08/share-networks/6ecc26b7-15d0-475d-9768-7267abc58439/action => generated 227 bytes in 30 msecs (HTTP/1.1 409) 6 headers in 236 bytes (1 switches on core 0) May 28 13:01:24 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-4e1f2a79-9def-421c-ab93-9049263bd31e tempest-SecServicesMappingNegativeTest-270309837 tempest-SecServicesMappingNegativeTest-270309837-project-member] DELETE http://10.27.203.238/share/v1/f96e397cc60642c39058e772b0083a08/security-services/5e2d7def-ca30-4004-bfdc-6778595bb405 May 28 13:01:24 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-4e1f2a79-9def-421c-ab93-9049263bd31e tempest-SecServicesMappingNegativeTest-270309837 tempest-SecServicesMappingNegativeTest-270309837-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:24 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-4e1f2a79-9def-421c-ab93-9049263bd31e tempest-SecServicesMappingNegativeTest-270309837 tempest-SecServicesMappingNegativeTest-270309837-project-member] Calling method 'SecurityServiceController.delete' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:24 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.v1.security_service [None req-4e1f2a79-9def-421c-ab93-9049263bd31e tempest-SecServicesMappingNegativeTest-270309837 tempest-SecServicesMappingNegativeTest-270309837-project-member] Delete security service with id: 5e2d7def-ca30-4004-bfdc-6778595bb405 May 28 13:01:24 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-4e1f2a79-9def-421c-ab93-9049263bd31e tempest-SecServicesMappingNegativeTest-270309837 tempest-SecServicesMappingNegativeTest-270309837-project-member] http://10.27.203.238/share/v1/f96e397cc60642c39058e772b0083a08/security-services/5e2d7def-ca30-4004-bfdc-6778595bb405 returned with HTTP 202 May 28 13:01:24 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1126/2227] 10.27.203.238 () {62 vars in 1444 bytes} [Tue May 28 13:01:24 2024] DELETE /share/v1/f96e397cc60642c39058e772b0083a08/security-services/5e2d7def-ca30-4004-bfdc-6778595bb405 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 6 headers in 242 bytes (1 switches on core 0) May 28 13:01:24 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-767ef2f9-95f8-48fd-9f99-c0472295edb1 tempest-SecServicesMappingNegativeTest-270309837 tempest-SecServicesMappingNegativeTest-270309837-project-member] GET http://10.27.203.238/share/v1/f96e397cc60642c39058e772b0083a08/security-services/5e2d7def-ca30-4004-bfdc-6778595bb405 May 28 13:01:24 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-767ef2f9-95f8-48fd-9f99-c0472295edb1 tempest-SecServicesMappingNegativeTest-270309837 tempest-SecServicesMappingNegativeTest-270309837-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:24 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-767ef2f9-95f8-48fd-9f99-c0472295edb1 tempest-SecServicesMappingNegativeTest-270309837 tempest-SecServicesMappingNegativeTest-270309837-project-member] Calling method 'SecurityServiceController.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:24 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-767ef2f9-95f8-48fd-9f99-c0472295edb1 tempest-SecServicesMappingNegativeTest-270309837 tempest-SecServicesMappingNegativeTest-270309837-project-member] HTTP exception thrown: The resource could not be found. May 28 13:01:24 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-767ef2f9-95f8-48fd-9f99-c0472295edb1 tempest-SecServicesMappingNegativeTest-270309837 tempest-SecServicesMappingNegativeTest-270309837-project-member] http://10.27.203.238/share/v1/f96e397cc60642c39058e772b0083a08/security-services/5e2d7def-ca30-4004-bfdc-6778595bb405 returned with HTTP 404 May 28 13:01:24 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1102/2228] 10.27.203.238 () {62 vars in 1441 bytes} [Tue May 28 13:01:24 2024] GET /share/v1/f96e397cc60642c39058e772b0083a08/security-services/5e2d7def-ca30-4004-bfdc-6778595bb405 => generated 78 bytes in 12 msecs (HTTP/1.1 404) 6 headers in 236 bytes (1 switches on core 0) May 28 13:01:24 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-2383935d-6cb2-43f6-b732-b0e6e5864b9b tempest-SecServicesMappingNegativeTest-270309837 tempest-SecServicesMappingNegativeTest-270309837-project-member] DELETE http://10.27.203.238/share/v1/f96e397cc60642c39058e772b0083a08/security-services/ed84e9c2-1eff-476d-be52-d16db827f362 May 28 13:01:24 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-2383935d-6cb2-43f6-b732-b0e6e5864b9b tempest-SecServicesMappingNegativeTest-270309837 tempest-SecServicesMappingNegativeTest-270309837-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:24 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-2383935d-6cb2-43f6-b732-b0e6e5864b9b tempest-SecServicesMappingNegativeTest-270309837 tempest-SecServicesMappingNegativeTest-270309837-project-member] Calling method 'SecurityServiceController.delete' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:24 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.v1.security_service [None req-2383935d-6cb2-43f6-b732-b0e6e5864b9b tempest-SecServicesMappingNegativeTest-270309837 tempest-SecServicesMappingNegativeTest-270309837-project-member] Delete security service with id: ed84e9c2-1eff-476d-be52-d16db827f362 May 28 13:01:24 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-2383935d-6cb2-43f6-b732-b0e6e5864b9b tempest-SecServicesMappingNegativeTest-270309837 tempest-SecServicesMappingNegativeTest-270309837-project-member] HTTP exception thrown: Cannot delete security service. It is assigned to share network(s) May 28 13:01:24 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-2383935d-6cb2-43f6-b732-b0e6e5864b9b tempest-SecServicesMappingNegativeTest-270309837 tempest-SecServicesMappingNegativeTest-270309837-project-member] http://10.27.203.238/share/v1/f96e397cc60642c39058e772b0083a08/security-services/ed84e9c2-1eff-476d-be52-d16db827f362 returned with HTTP 403 May 28 13:01:24 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1127/2229] 10.27.203.238 () {62 vars in 1444 bytes} [Tue May 28 13:01:24 2024] DELETE /share/v1/f96e397cc60642c39058e772b0083a08/security-services/ed84e9c2-1eff-476d-be52-d16db827f362 => generated 109 bytes in 18 msecs (HTTP/1.1 403) 6 headers in 237 bytes (1 switches on core 0) May 28 13:01:24 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-f5e17d1c-2498-4514-aefd-8613d1b03b14 tempest-SecServicesMappingNegativeTest-270309837 tempest-SecServicesMappingNegativeTest-270309837-project-member] DELETE http://10.27.203.238/share/v1/f96e397cc60642c39058e772b0083a08/share-networks/6ecc26b7-15d0-475d-9768-7267abc58439 May 28 13:01:24 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-f5e17d1c-2498-4514-aefd-8613d1b03b14 tempest-SecServicesMappingNegativeTest-270309837 tempest-SecServicesMappingNegativeTest-270309837-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:24 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-f5e17d1c-2498-4514-aefd-8613d1b03b14 tempest-SecServicesMappingNegativeTest-270309837 tempest-SecServicesMappingNegativeTest-270309837-project-member] Calling method 'ShareNetworkController.delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:24 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.quota [None req-f5e17d1c-2498-4514-aefd-8613d1b03b14 tempest-SecServicesMappingNegativeTest-270309837 tempest-SecServicesMappingNegativeTest-270309837-project-member] Created reservations ['5eee2a60-cb32-4dec-b37e-9dbc10cba39a'] {{(pid=98330) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 13:01:24 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.quota [None req-f5e17d1c-2498-4514-aefd-8613d1b03b14 tempest-SecServicesMappingNegativeTest-270309837 tempest-SecServicesMappingNegativeTest-270309837-project-member] Committed reservations ['5eee2a60-cb32-4dec-b37e-9dbc10cba39a'] {{(pid=98330) commit /opt/stack/manila/manila/quota.py:1063}} May 28 13:01:24 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-f5e17d1c-2498-4514-aefd-8613d1b03b14 tempest-SecServicesMappingNegativeTest-270309837 tempest-SecServicesMappingNegativeTest-270309837-project-member] http://10.27.203.238/share/v1/f96e397cc60642c39058e772b0083a08/share-networks/6ecc26b7-15d0-475d-9768-7267abc58439 returned with HTTP 202 May 28 13:01:24 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1103/2230] 10.27.203.238 () {62 vars in 1435 bytes} [Tue May 28 13:01:24 2024] DELETE /share/v1/f96e397cc60642c39058e772b0083a08/share-networks/6ecc26b7-15d0-475d-9768-7267abc58439 => generated 0 bytes in 165 msecs (HTTP/1.1 202) 6 headers in 242 bytes (1 switches on core 0) May 28 13:01:24 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-742a50df-891d-4c8b-a0cc-c1b51787431c tempest-SecServicesMappingNegativeTest-270309837 tempest-SecServicesMappingNegativeTest-270309837-project-member] GET http://10.27.203.238/share/v1/f96e397cc60642c39058e772b0083a08/share-networks/6ecc26b7-15d0-475d-9768-7267abc58439 May 28 13:01:24 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-742a50df-891d-4c8b-a0cc-c1b51787431c tempest-SecServicesMappingNegativeTest-270309837 tempest-SecServicesMappingNegativeTest-270309837-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:24 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-742a50df-891d-4c8b-a0cc-c1b51787431c tempest-SecServicesMappingNegativeTest-270309837 tempest-SecServicesMappingNegativeTest-270309837-project-member] Calling method 'ShareNetworkController.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:24 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-742a50df-891d-4c8b-a0cc-c1b51787431c tempest-SecServicesMappingNegativeTest-270309837 tempest-SecServicesMappingNegativeTest-270309837-project-member] HTTP exception thrown: Share network 6ecc26b7-15d0-475d-9768-7267abc58439 could not be found. May 28 13:01:24 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-742a50df-891d-4c8b-a0cc-c1b51787431c tempest-SecServicesMappingNegativeTest-270309837 tempest-SecServicesMappingNegativeTest-270309837-project-member] http://10.27.203.238/share/v1/f96e397cc60642c39058e772b0083a08/share-networks/6ecc26b7-15d0-475d-9768-7267abc58439 returned with HTTP 404 May 28 13:01:24 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1128/2231] 10.27.203.238 () {62 vars in 1432 bytes} [Tue May 28 13:01:24 2024] GET /share/v1/f96e397cc60642c39058e772b0083a08/share-networks/6ecc26b7-15d0-475d-9768-7267abc58439 => generated 116 bytes in 21 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b21dbc-e009-474d-89a9-9656af9c75bf service manila] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b21dbc-e009-474d-89a9-9656af9c75bf service manila] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabff9b3-35c8-4383-b239-928bf15d5064 tempest-SecServicesMappingNegativeTest-337249595 tempest-SecServicesMappingNegativeTest-337249595-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bbed46a0e0e4976b09b8784aac745c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17b281e6ecbf4c31a51fc8f70aa64a76', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabff9b3-35c8-4383-b239-928bf15d5064 tempest-SecServicesMappingNegativeTest-337249595 tempest-SecServicesMappingNegativeTest-337249595-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabff9b3-35c8-4383-b239-928bf15d5064 tempest-SecServicesMappingNegativeTest-337249595 tempest-SecServicesMappingNegativeTest-337249595-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabff9b3-35c8-4383-b239-928bf15d5064 tempest-SecServicesMappingNegativeTest-337249595 tempest-SecServicesMappingNegativeTest-337249595-project-admin] PATH_INFO: `/v3/users/5000ae7b72ab4d8aad66382d4e873caf` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabff9b3-35c8-4383-b239-928bf15d5064 tempest-SecServicesMappingNegativeTest-337249595 tempest-SecServicesMappingNegativeTest-337249595-project-admin] RBAC: Authorizing `identity:delete_user(user_id=5000ae7b72ab4d8aad66382d4e873caf)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabff9b3-35c8-4383-b239-928bf15d5064 tempest-SecServicesMappingNegativeTest-337249595 tempest-SecServicesMappingNegativeTest-337249595-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-cabff9b3-35c8-4383-b239-928bf15d5064 tempest-SecServicesMappingNegativeTest-337249595 tempest-SecServicesMappingNegativeTest-337249595-project-admin] Could not find user: 5000ae7b72ab4d8aad66382d4e873caf.: keystone.exception.UserNotFound: Could not find user: 5000ae7b72ab4d8aad66382d4e873caf. May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 5000ae7b72ab4d8aad66382d4e873caf. May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1549/3125] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:01:24 2024] DELETE /identity/v3/users/5000ae7b72ab4d8aad66382d4e873caf => generated 110 bytes in 26 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2af5bde-7892-45b5-88ea-192737b6ac84 service manila] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2af5bde-7892-45b5-88ea-192737b6ac84 service manila] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a33184-8a27-43df-9396-be84db2baf5d tempest-SecServicesMappingNegativeTest-337249595 tempest-SecServicesMappingNegativeTest-337249595-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bbed46a0e0e4976b09b8784aac745c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17b281e6ecbf4c31a51fc8f70aa64a76', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a33184-8a27-43df-9396-be84db2baf5d tempest-SecServicesMappingNegativeTest-337249595 tempest-SecServicesMappingNegativeTest-337249595-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a33184-8a27-43df-9396-be84db2baf5d tempest-SecServicesMappingNegativeTest-337249595 tempest-SecServicesMappingNegativeTest-337249595-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a33184-8a27-43df-9396-be84db2baf5d tempest-SecServicesMappingNegativeTest-337249595 tempest-SecServicesMappingNegativeTest-337249595-project-admin] PATH_INFO: `/v3/users/3fc09c87f69946d2bf009e72ac589cd4` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a33184-8a27-43df-9396-be84db2baf5d tempest-SecServicesMappingNegativeTest-337249595 tempest-SecServicesMappingNegativeTest-337249595-project-admin] RBAC: Authorizing `identity:delete_user(user_id=3fc09c87f69946d2bf009e72ac589cd4)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a33184-8a27-43df-9396-be84db2baf5d tempest-SecServicesMappingNegativeTest-337249595 tempest-SecServicesMappingNegativeTest-337249595-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-f9a33184-8a27-43df-9396-be84db2baf5d tempest-SecServicesMappingNegativeTest-337249595 tempest-SecServicesMappingNegativeTest-337249595-project-admin] Could not find user: 3fc09c87f69946d2bf009e72ac589cd4.: keystone.exception.UserNotFound: Could not find user: 3fc09c87f69946d2bf009e72ac589cd4. May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 3fc09c87f69946d2bf009e72ac589cd4. May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1577/3126] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:01:24 2024] DELETE /identity/v3/users/3fc09c87f69946d2bf009e72ac589cd4 => generated 110 bytes in 24 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabff9b3-35c8-4383-b239-928bf15d5064 tempest-SecServicesMappingNegativeTest-337249595 tempest-SecServicesMappingNegativeTest-337249595-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabff9b3-35c8-4383-b239-928bf15d5064 tempest-SecServicesMappingNegativeTest-337249595 tempest-SecServicesMappingNegativeTest-337249595-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5157cae5-aa14-4f8e-ae00-af7add7e110a tempest-SecServicesMappingNegativeTest-337249595 tempest-SecServicesMappingNegativeTest-337249595-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bbed46a0e0e4976b09b8784aac745c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17b281e6ecbf4c31a51fc8f70aa64a76', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5157cae5-aa14-4f8e-ae00-af7add7e110a tempest-SecServicesMappingNegativeTest-337249595 tempest-SecServicesMappingNegativeTest-337249595-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5157cae5-aa14-4f8e-ae00-af7add7e110a tempest-SecServicesMappingNegativeTest-337249595 tempest-SecServicesMappingNegativeTest-337249595-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5157cae5-aa14-4f8e-ae00-af7add7e110a tempest-SecServicesMappingNegativeTest-337249595 tempest-SecServicesMappingNegativeTest-337249595-project-admin] PATH_INFO: `/v3/users/6533c69a593a4e35a8693da46fbd9f3b` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5157cae5-aa14-4f8e-ae00-af7add7e110a tempest-SecServicesMappingNegativeTest-337249595 tempest-SecServicesMappingNegativeTest-337249595-project-admin] RBAC: Authorizing `identity:delete_user(user_id=6533c69a593a4e35a8693da46fbd9f3b)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5157cae5-aa14-4f8e-ae00-af7add7e110a tempest-SecServicesMappingNegativeTest-337249595 tempest-SecServicesMappingNegativeTest-337249595-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-5157cae5-aa14-4f8e-ae00-af7add7e110a tempest-SecServicesMappingNegativeTest-337249595 tempest-SecServicesMappingNegativeTest-337249595-project-admin] Could not find user: 6533c69a593a4e35a8693da46fbd9f3b.: keystone.exception.UserNotFound: Could not find user: 6533c69a593a4e35a8693da46fbd9f3b. May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 6533c69a593a4e35a8693da46fbd9f3b. May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1550/3127] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:01:24 2024] DELETE /identity/v3/users/6533c69a593a4e35a8693da46fbd9f3b => generated 110 bytes in 25 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a33184-8a27-43df-9396-be84db2baf5d tempest-SecServicesMappingNegativeTest-337249595 tempest-SecServicesMappingNegativeTest-337249595-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a33184-8a27-43df-9396-be84db2baf5d tempest-SecServicesMappingNegativeTest-337249595 tempest-SecServicesMappingNegativeTest-337249595-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9a86ea-a585-4a71-8266-f6abedc65ab4 tempest-SecServicesMappingNegativeTest-337249595 tempest-SecServicesMappingNegativeTest-337249595-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bbed46a0e0e4976b09b8784aac745c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17b281e6ecbf4c31a51fc8f70aa64a76', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9a86ea-a585-4a71-8266-f6abedc65ab4 tempest-SecServicesMappingNegativeTest-337249595 tempest-SecServicesMappingNegativeTest-337249595-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9a86ea-a585-4a71-8266-f6abedc65ab4 tempest-SecServicesMappingNegativeTest-337249595 tempest-SecServicesMappingNegativeTest-337249595-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9a86ea-a585-4a71-8266-f6abedc65ab4 tempest-SecServicesMappingNegativeTest-337249595 tempest-SecServicesMappingNegativeTest-337249595-project-admin] PATH_INFO: `/v3/users/929590f760014a429cece4b4e674f84e` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9a86ea-a585-4a71-8266-f6abedc65ab4 tempest-SecServicesMappingNegativeTest-337249595 tempest-SecServicesMappingNegativeTest-337249595-project-admin] RBAC: Authorizing `identity:delete_user(user_id=929590f760014a429cece4b4e674f84e)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9a86ea-a585-4a71-8266-f6abedc65ab4 tempest-SecServicesMappingNegativeTest-337249595 tempest-SecServicesMappingNegativeTest-337249595-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-bd9a86ea-a585-4a71-8266-f6abedc65ab4 tempest-SecServicesMappingNegativeTest-337249595 tempest-SecServicesMappingNegativeTest-337249595-project-admin] Could not find user: 929590f760014a429cece4b4e674f84e.: keystone.exception.UserNotFound: Could not find user: 929590f760014a429cece4b4e674f84e. May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 929590f760014a429cece4b4e674f84e. May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1578/3128] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:01:24 2024] DELETE /identity/v3/users/929590f760014a429cece4b4e674f84e => generated 110 bytes in 26 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5157cae5-aa14-4f8e-ae00-af7add7e110a tempest-SecServicesMappingNegativeTest-337249595 tempest-SecServicesMappingNegativeTest-337249595-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5157cae5-aa14-4f8e-ae00-af7add7e110a tempest-SecServicesMappingNegativeTest-337249595 tempest-SecServicesMappingNegativeTest-337249595-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdac75f-b115-4ebb-bc7d-9e1e24a535b7 tempest-SecServicesMappingNegativeTest-337249595 tempest-SecServicesMappingNegativeTest-337249595-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bbed46a0e0e4976b09b8784aac745c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17b281e6ecbf4c31a51fc8f70aa64a76', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdac75f-b115-4ebb-bc7d-9e1e24a535b7 tempest-SecServicesMappingNegativeTest-337249595 tempest-SecServicesMappingNegativeTest-337249595-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdac75f-b115-4ebb-bc7d-9e1e24a535b7 tempest-SecServicesMappingNegativeTest-337249595 tempest-SecServicesMappingNegativeTest-337249595-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdac75f-b115-4ebb-bc7d-9e1e24a535b7 tempest-SecServicesMappingNegativeTest-337249595 tempest-SecServicesMappingNegativeTest-337249595-project-admin] PATH_INFO: `/v3/users/7ad2c2df894f4bca82e33623064ce809` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdac75f-b115-4ebb-bc7d-9e1e24a535b7 tempest-SecServicesMappingNegativeTest-337249595 tempest-SecServicesMappingNegativeTest-337249595-project-admin] RBAC: Authorizing `identity:delete_user(user_id=7ad2c2df894f4bca82e33623064ce809)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdac75f-b115-4ebb-bc7d-9e1e24a535b7 tempest-SecServicesMappingNegativeTest-337249595 tempest-SecServicesMappingNegativeTest-337249595-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-5fdac75f-b115-4ebb-bc7d-9e1e24a535b7 tempest-SecServicesMappingNegativeTest-337249595 tempest-SecServicesMappingNegativeTest-337249595-project-admin] Could not find user: 7ad2c2df894f4bca82e33623064ce809.: keystone.exception.UserNotFound: Could not find user: 7ad2c2df894f4bca82e33623064ce809. May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 7ad2c2df894f4bca82e33623064ce809. May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1551/3129] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:01:24 2024] DELETE /identity/v3/users/7ad2c2df894f4bca82e33623064ce809 => generated 110 bytes in 24 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9a86ea-a585-4a71-8266-f6abedc65ab4 tempest-SecServicesMappingNegativeTest-337249595 tempest-SecServicesMappingNegativeTest-337249595-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9a86ea-a585-4a71-8266-f6abedc65ab4 tempest-SecServicesMappingNegativeTest-337249595 tempest-SecServicesMappingNegativeTest-337249595-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934794f4-f304-4025-ae98-71ddba9a85b3 tempest-SecServicesMappingNegativeTest-337249595 tempest-SecServicesMappingNegativeTest-337249595-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bbed46a0e0e4976b09b8784aac745c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17b281e6ecbf4c31a51fc8f70aa64a76', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934794f4-f304-4025-ae98-71ddba9a85b3 tempest-SecServicesMappingNegativeTest-337249595 tempest-SecServicesMappingNegativeTest-337249595-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934794f4-f304-4025-ae98-71ddba9a85b3 tempest-SecServicesMappingNegativeTest-337249595 tempest-SecServicesMappingNegativeTest-337249595-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934794f4-f304-4025-ae98-71ddba9a85b3 tempest-SecServicesMappingNegativeTest-337249595 tempest-SecServicesMappingNegativeTest-337249595-project-admin] PATH_INFO: `/v3/users/43487099e439456094fb5cfc0ae825c5` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934794f4-f304-4025-ae98-71ddba9a85b3 tempest-SecServicesMappingNegativeTest-337249595 tempest-SecServicesMappingNegativeTest-337249595-project-admin] RBAC: Authorizing `identity:delete_user(user_id=43487099e439456094fb5cfc0ae825c5)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934794f4-f304-4025-ae98-71ddba9a85b3 tempest-SecServicesMappingNegativeTest-337249595 tempest-SecServicesMappingNegativeTest-337249595-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-934794f4-f304-4025-ae98-71ddba9a85b3 tempest-SecServicesMappingNegativeTest-337249595 tempest-SecServicesMappingNegativeTest-337249595-project-admin] Could not find user: 43487099e439456094fb5cfc0ae825c5.: keystone.exception.UserNotFound: Could not find user: 43487099e439456094fb5cfc0ae825c5. May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 43487099e439456094fb5cfc0ae825c5. May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1579/3130] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:01:24 2024] DELETE /identity/v3/users/43487099e439456094fb5cfc0ae825c5 => generated 110 bytes in 25 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdac75f-b115-4ebb-bc7d-9e1e24a535b7 tempest-SecServicesMappingNegativeTest-337249595 tempest-SecServicesMappingNegativeTest-337249595-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdac75f-b115-4ebb-bc7d-9e1e24a535b7 tempest-SecServicesMappingNegativeTest-337249595 tempest-SecServicesMappingNegativeTest-337249595-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30567096-6675-4c0e-9177-1f813e1c6912 tempest-SecServicesMappingNegativeTest-337249595 tempest-SecServicesMappingNegativeTest-337249595-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bbed46a0e0e4976b09b8784aac745c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17b281e6ecbf4c31a51fc8f70aa64a76', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30567096-6675-4c0e-9177-1f813e1c6912 tempest-SecServicesMappingNegativeTest-337249595 tempest-SecServicesMappingNegativeTest-337249595-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30567096-6675-4c0e-9177-1f813e1c6912 tempest-SecServicesMappingNegativeTest-337249595 tempest-SecServicesMappingNegativeTest-337249595-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30567096-6675-4c0e-9177-1f813e1c6912 tempest-SecServicesMappingNegativeTest-337249595 tempest-SecServicesMappingNegativeTest-337249595-project-admin] PATH_INFO: `/v3/users/450d0e4972ca4250966ec637211a08fd` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30567096-6675-4c0e-9177-1f813e1c6912 tempest-SecServicesMappingNegativeTest-337249595 tempest-SecServicesMappingNegativeTest-337249595-project-admin] RBAC: Authorizing `identity:delete_user(user_id=450d0e4972ca4250966ec637211a08fd)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30567096-6675-4c0e-9177-1f813e1c6912 tempest-SecServicesMappingNegativeTest-337249595 tempest-SecServicesMappingNegativeTest-337249595-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-30567096-6675-4c0e-9177-1f813e1c6912 tempest-SecServicesMappingNegativeTest-337249595 tempest-SecServicesMappingNegativeTest-337249595-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '450d0e4972ca4250966ec637211a08fd', 'request_id': 'req-30567096-6675-4c0e-9177-1f813e1c6912'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-30567096-6675-4c0e-9177-1f813e1c6912 tempest-SecServicesMappingNegativeTest-337249595 tempest-SecServicesMappingNegativeTest-337249595-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '450d0e4972ca4250966ec637211a08fd', 'request_id': 'req-30567096-6675-4c0e-9177-1f813e1c6912'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-30567096-6675-4c0e-9177-1f813e1c6912 tempest-SecServicesMappingNegativeTest-337249595 tempest-SecServicesMappingNegativeTest-337249595-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '450d0e4972ca4250966ec637211a08fd', 'request_id': 'req-30567096-6675-4c0e-9177-1f813e1c6912'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-30567096-6675-4c0e-9177-1f813e1c6912 tempest-SecServicesMappingNegativeTest-337249595 tempest-SecServicesMappingNegativeTest-337249595-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '450d0e4972ca4250966ec637211a08fd', 'request_id': 'req-30567096-6675-4c0e-9177-1f813e1c6912'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-30567096-6675-4c0e-9177-1f813e1c6912 tempest-SecServicesMappingNegativeTest-337249595 tempest-SecServicesMappingNegativeTest-337249595-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '450d0e4972ca4250966ec637211a08fd', 'request_id': 'req-30567096-6675-4c0e-9177-1f813e1c6912'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:24 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1552/3131] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:01:24 2024] DELETE /identity/v3/users/450d0e4972ca4250966ec637211a08fd => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:01:24 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-3a885db6-5e44-439a-ac4c-0b3868588e39 tempest-SecServicesMappingNegativeTest-337249595 tempest-SecServicesMappingNegativeTest-337249595-project-admin] DELETE http://10.27.203.238/share/v2/17b281e6ecbf4c31a51fc8f70aa64a76/types/603e4418-669c-41bb-9557-f4fdaec74e8b May 28 13:01:24 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-3a885db6-5e44-439a-ac4c-0b3868588e39 tempest-SecServicesMappingNegativeTest-337249595 tempest-SecServicesMappingNegativeTest-337249595-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:24 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-3a885db6-5e44-439a-ac4c-0b3868588e39 tempest-SecServicesMappingNegativeTest-337249595 tempest-SecServicesMappingNegativeTest-337249595-project-admin] Calling method 'ShareTypesController._delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:24 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ff6e841f-ba7b-449c-a783-b92c78fb92db tempest-SharesNFSTest-667257547 None] <<< [GET] https://127.0.0.1:40443/api/vippools/ May 28 13:01:24 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ff6e841f-ba7b-449c-a783-b92c78fb92db tempest-SharesNFSTest-667257547 None] [Bunch(active_cnode_ids=[], active_interfaces=4, cluster='loop75-kfs', cluster_id=1, cnode_ids=[], cnodes=[], domain_name='vippool-1', enable_l3=False, enable_weighted_balancing=False, enabled=True, end_ip='172.21.75.4', guid='f2abaede-b397-413a-8faa-3aeead6d3b28', gw_ip='', gw_ipv6='', id=2, ip_ranges=[['172.21.75.1', '172.21.75.4']], name='vippool-1', peer_asn=0, port_membership='ALL', ranges_summary='172.21.75.[1-4]', role='PROTOCOLS', start_ip='172.21.75.1', subnet_cidr=16, subnet_cidr_ipv6=None, sync='SYNCED', sync_time='2024-05-28T12:50:09.644123Z', tenant_id=1, tenant_name='default', title='172.21.75.1 - 172.21.75.4', url='https://127.0.0.1:40443/api/vippools/2/', vast_asn=0, vlan=0, vms_preferred=False)] May 28 13:01:24 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ff6e841f-ba7b-449c-a783-b92c78fb92db tempest-SharesNFSTest-667257547 None] --- [GET] https://127.0.0.1:40443/api/vippools/: Done May 28 13:01:24 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ff6e841f-ba7b-449c-a783-b92c78fb92db tempest-SharesNFSTest-667257547 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:01:24 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ff6e841f-ba7b-449c-a783-b92c78fb92db tempest-SharesNFSTest-667257547 None] {'allow_redirects': True, May 28 13:01:24 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ff6e841f-ba7b-449c-a783-b92c78fb92db tempest-SharesNFSTest-667257547 None] 'params': {'name': '55a40e09-c80d-48da-95b1-a670d27b1414'}} May 28 13:01:24 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-3a885db6-5e44-439a-ac4c-0b3868588e39 tempest-SecServicesMappingNegativeTest-337249595 tempest-SecServicesMappingNegativeTest-337249595-project-admin] http://10.27.203.238/share/v2/17b281e6ecbf4c31a51fc8f70aa64a76/types/603e4418-669c-41bb-9557-f4fdaec74e8b returned with HTTP 202 May 28 13:01:24 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1104/2232] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:01:24 2024] DELETE /share/v2/17b281e6ecbf4c31a51fc8f70aa64a76/types/603e4418-669c-41bb-9557-f4fdaec74e8b => generated 0 bytes in 43 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 13:01:24 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-001de32b-54c3-4089-bd62-0e7ed626111b tempest-SecServicesMappingNegativeTest-337249595 tempest-SecServicesMappingNegativeTest-337249595-project-admin] GET http://10.27.203.238/share/v2/17b281e6ecbf4c31a51fc8f70aa64a76/types/603e4418-669c-41bb-9557-f4fdaec74e8b May 28 13:01:24 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-001de32b-54c3-4089-bd62-0e7ed626111b tempest-SecServicesMappingNegativeTest-337249595 tempest-SecServicesMappingNegativeTest-337249595-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:24 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-001de32b-54c3-4089-bd62-0e7ed626111b tempest-SecServicesMappingNegativeTest-337249595 tempest-SecServicesMappingNegativeTest-337249595-project-admin] Calling method 'ShareTypesController.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:24 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-001de32b-54c3-4089-bd62-0e7ed626111b tempest-SecServicesMappingNegativeTest-337249595 tempest-SecServicesMappingNegativeTest-337249595-project-admin] HTTP exception thrown: Share type not found. May 28 13:01:24 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-001de32b-54c3-4089-bd62-0e7ed626111b tempest-SecServicesMappingNegativeTest-337249595 tempest-SecServicesMappingNegativeTest-337249595-project-admin] http://10.27.203.238/share/v2/17b281e6ecbf4c31a51fc8f70aa64a76/types/603e4418-669c-41bb-9557-f4fdaec74e8b returned with HTTP 404 May 28 13:01:24 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1129/2233] 10.27.203.238 () {64 vars in 1448 bytes} [Tue May 28 13:01:24 2024] GET /share/v2/17b281e6ecbf4c31a51fc8f70aa64a76/types/603e4418-669c-41bb-9557-f4fdaec74e8b => generated 67 bytes in 10 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 13:01:24 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-d61b322a-d655-4427-b57d-c69841e95885 tempest-SecServicesMappingNegativeTest-270309837 tempest-SecServicesMappingNegativeTest-270309837-project-member] DELETE http://10.27.203.238/share/v1/f96e397cc60642c39058e772b0083a08/security-services/a4832822-c619-425f-9f65-aa280194cd7d May 28 13:01:24 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-d61b322a-d655-4427-b57d-c69841e95885 tempest-SecServicesMappingNegativeTest-270309837 tempest-SecServicesMappingNegativeTest-270309837-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:24 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-d61b322a-d655-4427-b57d-c69841e95885 tempest-SecServicesMappingNegativeTest-270309837 tempest-SecServicesMappingNegativeTest-270309837-project-member] Calling method 'SecurityServiceController.delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:24 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.v1.security_service [None req-d61b322a-d655-4427-b57d-c69841e95885 tempest-SecServicesMappingNegativeTest-270309837 tempest-SecServicesMappingNegativeTest-270309837-project-member] Delete security service with id: a4832822-c619-425f-9f65-aa280194cd7d May 28 13:01:24 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-d61b322a-d655-4427-b57d-c69841e95885 tempest-SecServicesMappingNegativeTest-270309837 tempest-SecServicesMappingNegativeTest-270309837-project-member] HTTP exception thrown: Cannot delete security service. It is assigned to share network(s) May 28 13:01:24 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-d61b322a-d655-4427-b57d-c69841e95885 tempest-SecServicesMappingNegativeTest-270309837 tempest-SecServicesMappingNegativeTest-270309837-project-member] http://10.27.203.238/share/v1/f96e397cc60642c39058e772b0083a08/security-services/a4832822-c619-425f-9f65-aa280194cd7d returned with HTTP 403 May 28 13:01:24 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1105/2234] 10.27.203.238 () {62 vars in 1444 bytes} [Tue May 28 13:01:24 2024] DELETE /share/v1/f96e397cc60642c39058e772b0083a08/security-services/a4832822-c619-425f-9f65-aa280194cd7d => generated 109 bytes in 17 msecs (HTTP/1.1 403) 6 headers in 237 bytes (1 switches on core 0) May 28 13:01:24 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-cfe7e210-403a-4b2d-9de6-56b091ced6c1 tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] GET http://10.27.203.238/share/v2/284d76edec3144579d6fb3f6dbc0dd4e/shares/553b74f3-3a9b-40ad-b4b1-d5648684cbf4 May 28 13:01:24 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-cfe7e210-403a-4b2d-9de6-56b091ced6c1 tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:24 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-cfe7e210-403a-4b2d-9de6-56b091ced6c1 tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:24 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-49ce478e-6c54-4a98-b8e6-0e6cea020940 tempest-SecServicesMappingNegativeTest-270309837 tempest-SecServicesMappingNegativeTest-270309837-project-member] DELETE http://10.27.203.238/share/v1/f96e397cc60642c39058e772b0083a08/share-networks/5b452e14-5361-4a33-b1fb-4da94322322a May 28 13:01:24 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-49ce478e-6c54-4a98-b8e6-0e6cea020940 tempest-SecServicesMappingNegativeTest-270309837 tempest-SecServicesMappingNegativeTest-270309837-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:24 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-49ce478e-6c54-4a98-b8e6-0e6cea020940 tempest-SecServicesMappingNegativeTest-270309837 tempest-SecServicesMappingNegativeTest-270309837-project-member] Calling method 'ShareNetworkController.delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:25 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-cfe7e210-403a-4b2d-9de6-56b091ced6c1 tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] http://10.27.203.238/share/v2/284d76edec3144579d6fb3f6dbc0dd4e/shares/553b74f3-3a9b-40ad-b4b1-d5648684cbf4 returned with HTTP 200 May 28 13:01:25 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1130/2235] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:01:24 2024] GET /share/v2/284d76edec3144579d6fb3f6dbc0dd4e/shares/553b74f3-3a9b-40ad-b4b1-d5648684cbf4 => generated 1316 bytes in 27 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:01:25 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-bb21e306-8f98-4956-9834-f9d315348260 tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] GET http://10.27.203.238/share/v2/284d76edec3144579d6fb3f6dbc0dd4e/shares/553b74f3-3a9b-40ad-b4b1-d5648684cbf4 May 28 13:01:25 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-bb21e306-8f98-4956-9834-f9d315348260 tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:25 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-bb21e306-8f98-4956-9834-f9d315348260 tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:25 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-bb21e306-8f98-4956-9834-f9d315348260 tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] http://10.27.203.238/share/v2/284d76edec3144579d6fb3f6dbc0dd4e/shares/553b74f3-3a9b-40ad-b4b1-d5648684cbf4 returned with HTTP 200 May 28 13:01:25 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1131/2236] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:01:25 2024] GET /share/v2/284d76edec3144579d6fb3f6dbc0dd4e/shares/553b74f3-3a9b-40ad-b4b1-d5648684cbf4 => generated 1316 bytes in 27 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:01:25 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-731d6719-cfc9-4d54-96ee-b2efa0d2214c tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] GET http://10.27.203.238/share/v2/284d76edec3144579d6fb3f6dbc0dd4e/share-replicas/detail?share_id=553b74f3-3a9b-40ad-b4b1-d5648684cbf4 May 28 13:01:25 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-731d6719-cfc9-4d54-96ee-b2efa0d2214c tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:25 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-731d6719-cfc9-4d54-96ee-b2efa0d2214c tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:25 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-731d6719-cfc9-4d54-96ee-b2efa0d2214c tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] http://10.27.203.238/share/v2/284d76edec3144579d6fb3f6dbc0dd4e/share-replicas/detail?share_id=553b74f3-3a9b-40ad-b4b1-d5648684cbf4 returned with HTTP 200 May 28 13:01:25 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1132/2237] 10.27.203.238 () {64 vars in 1476 bytes} [Tue May 28 13:01:25 2024] GET /share/v2/284d76edec3144579d6fb3f6dbc0dd4e/share-replicas/detail?share_id=553b74f3-3a9b-40ad-b4b1-d5648684cbf4 => generated 22 bytes in 14 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:01:25 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-ae348258-c7a9-4c41-94a5-aa565c59e244 tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] DELETE http://10.27.203.238/share/v2/284d76edec3144579d6fb3f6dbc0dd4e/shares/553b74f3-3a9b-40ad-b4b1-d5648684cbf4 May 28 13:01:25 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-ae348258-c7a9-4c41-94a5-aa565c59e244 tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:25 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-ae348258-c7a9-4c41-94a5-aa565c59e244 tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] Calling method 'ShareMixin.delete' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:25 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.v1.shares [None req-ae348258-c7a9-4c41-94a5-aa565c59e244 tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] Delete share with id: 553b74f3-3a9b-40ad-b4b1-d5648684cbf4 May 28 13:01:25 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.quota [None req-49ce478e-6c54-4a98-b8e6-0e6cea020940 tempest-SecServicesMappingNegativeTest-270309837 tempest-SecServicesMappingNegativeTest-270309837-project-member] Created reservations ['dec9b49f-6cae-4f67-bfdb-a48208fa2dd0'] {{(pid=98330) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 13:01:25 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.quota [None req-49ce478e-6c54-4a98-b8e6-0e6cea020940 tempest-SecServicesMappingNegativeTest-270309837 tempest-SecServicesMappingNegativeTest-270309837-project-member] Committed reservations ['dec9b49f-6cae-4f67-bfdb-a48208fa2dd0'] {{(pid=98330) commit /opt/stack/manila/manila/quota.py:1063}} May 28 13:01:25 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-49ce478e-6c54-4a98-b8e6-0e6cea020940 tempest-SecServicesMappingNegativeTest-270309837 tempest-SecServicesMappingNegativeTest-270309837-project-member] http://10.27.203.238/share/v1/f96e397cc60642c39058e772b0083a08/share-networks/5b452e14-5361-4a33-b1fb-4da94322322a returned with HTTP 202 May 28 13:01:25 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1106/2238] 10.27.203.238 () {62 vars in 1435 bytes} [Tue May 28 13:01:24 2024] DELETE /share/v1/f96e397cc60642c39058e772b0083a08/share-networks/5b452e14-5361-4a33-b1fb-4da94322322a => generated 0 bytes in 146 msecs (HTTP/1.1 202) 6 headers in 242 bytes (1 switches on core 0) May 28 13:01:25 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-747feb94-efb3-4d26-8e99-5802439c8278 tempest-SecServicesMappingNegativeTest-270309837 tempest-SecServicesMappingNegativeTest-270309837-project-member] GET http://10.27.203.238/share/v1/f96e397cc60642c39058e772b0083a08/share-networks/5b452e14-5361-4a33-b1fb-4da94322322a May 28 13:01:25 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-747feb94-efb3-4d26-8e99-5802439c8278 tempest-SecServicesMappingNegativeTest-270309837 tempest-SecServicesMappingNegativeTest-270309837-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:25 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-747feb94-efb3-4d26-8e99-5802439c8278 tempest-SecServicesMappingNegativeTest-270309837 tempest-SecServicesMappingNegativeTest-270309837-project-member] Calling method 'ShareNetworkController.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:25 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-747feb94-efb3-4d26-8e99-5802439c8278 tempest-SecServicesMappingNegativeTest-270309837 tempest-SecServicesMappingNegativeTest-270309837-project-member] HTTP exception thrown: Share network 5b452e14-5361-4a33-b1fb-4da94322322a could not be found. May 28 13:01:25 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-747feb94-efb3-4d26-8e99-5802439c8278 tempest-SecServicesMappingNegativeTest-270309837 tempest-SecServicesMappingNegativeTest-270309837-project-member] http://10.27.203.238/share/v1/f96e397cc60642c39058e772b0083a08/share-networks/5b452e14-5361-4a33-b1fb-4da94322322a returned with HTTP 404 May 28 13:01:25 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1107/2239] 10.27.203.238 () {62 vars in 1432 bytes} [Tue May 28 13:01:25 2024] GET /share/v1/f96e397cc60642c39058e772b0083a08/share-networks/5b452e14-5361-4a33-b1fb-4da94322322a => generated 116 bytes in 20 msecs (HTTP/1.1 404) 6 headers in 237 bytes (2 switches on core 0) May 28 13:01:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934794f4-f304-4025-ae98-71ddba9a85b3 tempest-SecServicesMappingNegativeTest-337249595 tempest-SecServicesMappingNegativeTest-337249595-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-934794f4-f304-4025-ae98-71ddba9a85b3 tempest-SecServicesMappingNegativeTest-337249595 tempest-SecServicesMappingNegativeTest-337249595-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:01:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934794f4-f304-4025-ae98-71ddba9a85b3 tempest-SecServicesMappingNegativeTest-337249595 tempest-SecServicesMappingNegativeTest-337249595-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:25 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-ae348258-c7a9-4c41-94a5-aa565c59e244 tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] http://10.27.203.238/share/v2/284d76edec3144579d6fb3f6dbc0dd4e/shares/553b74f3-3a9b-40ad-b4b1-d5648684cbf4 returned with HTTP 202 May 28 13:01:25 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1133/2240] 10.27.203.238 () {64 vars in 1454 bytes} [Tue May 28 13:01:25 2024] DELETE /share/v2/284d76edec3144579d6fb3f6dbc0dd4e/shares/553b74f3-3a9b-40ad-b4b1-d5648684cbf4 => generated 0 bytes in 134 msecs (HTTP/1.1 202) 6 headers in 243 bytes (2 switches on core 0) May 28 13:01:25 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-df449e39-7248-41fe-a39c-76d0db97e360 tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] GET http://10.27.203.238/share/v2/284d76edec3144579d6fb3f6dbc0dd4e/shares/553b74f3-3a9b-40ad-b4b1-d5648684cbf4 May 28 13:01:25 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-df449e39-7248-41fe-a39c-76d0db97e360 tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:25 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-df449e39-7248-41fe-a39c-76d0db97e360 tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f523404d-c779-4382-bd2d-79b985366508 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f523404d-c779-4382-bd2d-79b985366508 None admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f523404d-c779-4382-bd2d-79b985366508 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f523404d-c779-4382-bd2d-79b985366508 None admin] PATH_INFO: `/v3/users/221107a0cded4051a330d4fb9e0e032d` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f523404d-c779-4382-bd2d-79b985366508 None admin] RBAC: Authorizing `identity:delete_user(user_id=221107a0cded4051a330d4fb9e0e032d)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f523404d-c779-4382-bd2d-79b985366508 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:25 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-df449e39-7248-41fe-a39c-76d0db97e360 tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] http://10.27.203.238/share/v2/284d76edec3144579d6fb3f6dbc0dd4e/shares/553b74f3-3a9b-40ad-b4b1-d5648684cbf4 returned with HTTP 200 May 28 13:01:25 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1108/2241] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:01:25 2024] GET /share/v2/284d76edec3144579d6fb3f6dbc0dd4e/shares/553b74f3-3a9b-40ad-b4b1-d5648684cbf4 => generated 1315 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:01:25 l75lg1-v1 dstat.sh[49771]: 28-05 13:01:25| 14 1 81 4 0|5703M 1734M 278M 7909M| 15k 5738B| 0 13M| 0 1291 |8269 14k|1.47 1.23 1.08|4.0 1.0 0| 0 0 | 0 2048M| 29 364 0 40 2 May 28 13:01:25 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-ae348258-c7a9-4c41-94a5-aa565c59e244 tempest-ShareTypeAvailabilityZonesTest-364532124 None] Acquiring lock "locked_access_rules_operation_by_share_instance_62476a26-faf7-4184-83e5-45ec72b91d6e" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:01:25 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-ae348258-c7a9-4c41-94a5-aa565c59e244 tempest-ShareTypeAvailabilityZonesTest-364532124 None] Lock "locked_access_rules_operation_by_share_instance_62476a26-faf7-4184-83e5-45ec72b91d6e" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:01:25 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ff6e841f-ba7b-449c-a783-b92c78fb92db tempest-SharesNFSTest-667257547 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:01:25 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ff6e841f-ba7b-449c-a783-b92c78fb92db tempest-SharesNFSTest-667257547 None] [] May 28 13:01:25 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ff6e841f-ba7b-449c-a783-b92c78fb92db tempest-SharesNFSTest-667257547 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 13:01:25 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ff6e841f-ba7b-449c-a783-b92c78fb92db tempest-SharesNFSTest-667257547 None] >>> [POST] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:01:25 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ff6e841f-ba7b-449c-a783-b92c78fb92db tempest-SharesNFSTest-667257547 None] {'data': '{"name": "55a40e09-c80d-48da-95b1-a670d27b1414"}', May 28 13:01:25 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ff6e841f-ba7b-449c-a783-b92c78fb92db tempest-SharesNFSTest-667257547 None] 'json': None, May 28 13:01:25 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ff6e841f-ba7b-449c-a783-b92c78fb92db tempest-SharesNFSTest-667257547 None] 'params': None} May 28 13:01:25 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-ae348258-c7a9-4c41-94a5-aa565c59e244 tempest-ShareTypeAvailabilityZonesTest-364532124 None] Lock "locked_access_rules_operation_by_share_instance_62476a26-faf7-4184-83e5-45ec72b91d6e" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.016s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:01:25 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-ae348258-c7a9-4c41-94a5-aa565c59e244 tempest-ShareTypeAvailabilityZonesTest-364532124 None] Acquiring lock "locked_access_rules_operation_by_share_instance_62476a26-faf7-4184-83e5-45ec72b91d6e" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:01:25 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-ae348258-c7a9-4c41-94a5-aa565c59e244 tempest-ShareTypeAvailabilityZonesTest-364532124 None] Lock "locked_access_rules_operation_by_share_instance_62476a26-faf7-4184-83e5-45ec72b91d6e" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:01:25 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-ae348258-c7a9-4c41-94a5-aa565c59e244 tempest-ShareTypeAvailabilityZonesTest-364532124 None] Lock "locked_access_rules_operation_by_share_instance_62476a26-faf7-4184-83e5-45ec72b91d6e" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.004s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:01:25 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-ae348258-c7a9-4c41-94a5-aa565c59e244 tempest-ShareTypeAvailabilityZonesTest-364532124 None] Acquiring lock "locked_access_rules_operation_by_share_instance_62476a26-faf7-4184-83e5-45ec72b91d6e" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:01:25 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-ae348258-c7a9-4c41-94a5-aa565c59e244 tempest-ShareTypeAvailabilityZonesTest-364532124 None] Lock "locked_access_rules_operation_by_share_instance_62476a26-faf7-4184-83e5-45ec72b91d6e" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:01:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-f523404d-c779-4382-bd2d-79b985366508 None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '221107a0cded4051a330d4fb9e0e032d', 'request_id': 'req-f523404d-c779-4382-bd2d-79b985366508'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:25 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-ae348258-c7a9-4c41-94a5-aa565c59e244 tempest-ShareTypeAvailabilityZonesTest-364532124 None] Lock "locked_access_rules_operation_by_share_instance_62476a26-faf7-4184-83e5-45ec72b91d6e" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:01:25 l75lg1-v1 manila-share[98474]: DEBUG manila.share.access [None req-ae348258-c7a9-4c41-94a5-aa565c59e244 tempest-ShareTypeAvailabilityZonesTest-364532124 None] All access rules have been synced for share instance 62476a26-faf7-4184-83e5-45ec72b91d6e belonging to share 553b74f3-3a9b-40ad-b4b1-d5648684cbf4. {{(pid=98474) update_access_rules /opt/stack/manila/manila/share/access.py:304}} May 28 13:01:25 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-ae348258-c7a9-4c41-94a5-aa565c59e244 tempest-ShareTypeAvailabilityZonesTest-364532124 None] deleting '/manila/manila-62476a26-faf7-4184-83e5-45ec72b91d6e' May 28 13:01:25 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ae348258-c7a9-4c41-94a5-aa565c59e244 tempest-ShareTypeAvailabilityZonesTest-364532124 None] >>> [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/ May 28 13:01:25 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ae348258-c7a9-4c41-94a5-aa565c59e244 tempest-ShareTypeAvailabilityZonesTest-364532124 None] {'data': '{"path": "/manila/manila-62476a26-faf7-4184-83e5-45ec72b91d6e"}', May 28 13:01:25 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ae348258-c7a9-4c41-94a5-aa565c59e244 tempest-ShareTypeAvailabilityZonesTest-364532124 None] 'params': None} May 28 13:01:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-f523404d-c779-4382-bd2d-79b985366508 None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '221107a0cded4051a330d4fb9e0e032d', 'request_id': 'req-f523404d-c779-4382-bd2d-79b985366508'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-f523404d-c779-4382-bd2d-79b985366508 None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '221107a0cded4051a330d4fb9e0e032d', 'request_id': 'req-f523404d-c779-4382-bd2d-79b985366508'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-f523404d-c779-4382-bd2d-79b985366508 None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '221107a0cded4051a330d4fb9e0e032d', 'request_id': 'req-f523404d-c779-4382-bd2d-79b985366508'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-f523404d-c779-4382-bd2d-79b985366508 None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '221107a0cded4051a330d4fb9e0e032d', 'request_id': 'req-f523404d-c779-4382-bd2d-79b985366508'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:25 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1580/3132] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 13:01:25 2024] DELETE /identity/v3/users/221107a0cded4051a330d4fb9e0e032d => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:01:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30567096-6675-4c0e-9177-1f813e1c6912 tempest-SecServicesMappingNegativeTest-337249595 tempest-SecServicesMappingNegativeTest-337249595-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30567096-6675-4c0e-9177-1f813e1c6912 tempest-SecServicesMappingNegativeTest-337249595 tempest-SecServicesMappingNegativeTest-337249595-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:25 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ae348258-c7a9-4c41-94a5-aa565c59e244 tempest-ShareTypeAvailabilityZonesTest-364532124 None] <<< [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/ May 28 13:01:25 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ae348258-c7a9-4c41-94a5-aa565c59e244 tempest-ShareTypeAvailabilityZonesTest-364532124 None] 'OK' May 28 13:01:25 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ae348258-c7a9-4c41-94a5-aa565c59e244 tempest-ShareTypeAvailabilityZonesTest-364532124 None] --- [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/: Done May 28 13:01:25 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ae348258-c7a9-4c41-94a5-aa565c59e244 tempest-ShareTypeAvailabilityZonesTest-364532124 None] >>> [GET] https://127.0.0.1:40443/api/views/ May 28 13:01:25 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ae348258-c7a9-4c41-94a5-aa565c59e244 tempest-ShareTypeAvailabilityZonesTest-364532124 None] {'allow_redirects': True, May 28 13:01:25 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ae348258-c7a9-4c41-94a5-aa565c59e244 tempest-ShareTypeAvailabilityZonesTest-364532124 None] 'params': {'name': '62476a26-faf7-4184-83e5-45ec72b91d6e'}} May 28 13:01:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fab57d-2d18-43c2-8bad-78a786636ef4 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fab57d-2d18-43c2-8bad-78a786636ef4 None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fab57d-2d18-43c2-8bad-78a786636ef4 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fab57d-2d18-43c2-8bad-78a786636ef4 None admin] PATH_INFO: `/v3/users/2f1e297bf40641ea9c891dedaabbabf0` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fab57d-2d18-43c2-8bad-78a786636ef4 None admin] RBAC: Authorizing `identity:delete_user(user_id=2f1e297bf40641ea9c891dedaabbabf0)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fab57d-2d18-43c2-8bad-78a786636ef4 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:25 l75lg1-v1 neutron-server[77623]: DEBUG dbcounter [-] [77623] Writing DB stats neutron:SELECT=1 {{(pid=77623) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:01:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-e7fab57d-2d18-43c2-8bad-78a786636ef4 None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f1e297bf40641ea9c891dedaabbabf0', 'request_id': 'req-e7fab57d-2d18-43c2-8bad-78a786636ef4'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-e7fab57d-2d18-43c2-8bad-78a786636ef4 None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f1e297bf40641ea9c891dedaabbabf0', 'request_id': 'req-e7fab57d-2d18-43c2-8bad-78a786636ef4'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-e7fab57d-2d18-43c2-8bad-78a786636ef4 None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f1e297bf40641ea9c891dedaabbabf0', 'request_id': 'req-e7fab57d-2d18-43c2-8bad-78a786636ef4'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-e7fab57d-2d18-43c2-8bad-78a786636ef4 None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f1e297bf40641ea9c891dedaabbabf0', 'request_id': 'req-e7fab57d-2d18-43c2-8bad-78a786636ef4'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-e7fab57d-2d18-43c2-8bad-78a786636ef4 None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f1e297bf40641ea9c891dedaabbabf0', 'request_id': 'req-e7fab57d-2d18-43c2-8bad-78a786636ef4'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:25 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1553/3133] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 13:01:25 2024] DELETE /identity/v3/users/2f1e297bf40641ea9c891dedaabbabf0 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:01:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f523404d-c779-4382-bd2d-79b985366508 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-f523404d-c779-4382-bd2d-79b985366508 None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:01:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f523404d-c779-4382-bd2d-79b985366508 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91251b97-c9e6-47cc-8a9f-c050f534b1c9 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91251b97-c9e6-47cc-8a9f-c050f534b1c9 None admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91251b97-c9e6-47cc-8a9f-c050f534b1c9 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91251b97-c9e6-47cc-8a9f-c050f534b1c9 None admin] PATH_INFO: `/v3/users/4bbed46a0e0e4976b09b8784aac745c5` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91251b97-c9e6-47cc-8a9f-c050f534b1c9 None admin] RBAC: Authorizing `identity:delete_user(user_id=4bbed46a0e0e4976b09b8784aac745c5)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91251b97-c9e6-47cc-8a9f-c050f534b1c9 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-91251b97-c9e6-47cc-8a9f-c050f534b1c9 None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4bbed46a0e0e4976b09b8784aac745c5', 'request_id': 'req-91251b97-c9e6-47cc-8a9f-c050f534b1c9'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-91251b97-c9e6-47cc-8a9f-c050f534b1c9 None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4bbed46a0e0e4976b09b8784aac745c5', 'request_id': 'req-91251b97-c9e6-47cc-8a9f-c050f534b1c9'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-91251b97-c9e6-47cc-8a9f-c050f534b1c9 None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4bbed46a0e0e4976b09b8784aac745c5', 'request_id': 'req-91251b97-c9e6-47cc-8a9f-c050f534b1c9'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-91251b97-c9e6-47cc-8a9f-c050f534b1c9 None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4bbed46a0e0e4976b09b8784aac745c5', 'request_id': 'req-91251b97-c9e6-47cc-8a9f-c050f534b1c9'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-91251b97-c9e6-47cc-8a9f-c050f534b1c9 None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4bbed46a0e0e4976b09b8784aac745c5', 'request_id': 'req-91251b97-c9e6-47cc-8a9f-c050f534b1c9'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:25 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1581/3134] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 13:01:25 2024] DELETE /identity/v3/users/4bbed46a0e0e4976b09b8784aac745c5 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:01:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d5eaf1-9813-48ad-b81a-8a2ded187e56 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d5eaf1-9813-48ad-b81a-8a2ded187e56 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d5eaf1-9813-48ad-b81a-8a2ded187e56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:25 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-20d5eaf1-9813-48ad-b81a-8a2ded187e56 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 13:01:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-20d5eaf1-9813-48ad-b81a-8a2ded187e56 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 13:01:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-20d5eaf1-9813-48ad-b81a-8a2ded187e56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:01:25 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_service.periodic_task [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85846) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 13:01:25 l75lg1-v1 cinder-volume[85846]: DEBUG cinder.volume.drivers.lvm [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] Updating volume stats {{(pid=85846) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}} May 28 13:01:25 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:390}} May 28 13:01:25 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1554/3135] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 13:01:25 2024] POST /identity/v3/auth/tokens => generated 2960 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 13:01:25 l75lg1-v1 neutron-server[77619]: DEBUG neutron.wsgi [-] (77619) accepted ('10.27.203.238', 41750) {{(pid=77619) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 13:01:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91251b97-c9e6-47cc-8a9f-c050f534b1c9 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-91251b97-c9e6-47cc-8a9f-c050f534b1c9 None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:01:25 l75lg1-v1 sudo[99101]: vastdata : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 May 28 13:01:25 l75lg1-v1 sudo[99101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) May 28 13:01:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91251b97-c9e6-47cc-8a9f-c050f534b1c9 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba6b364-c93a-4e87-a51e-bb78419ef463 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef17047035e4b518fd5360a01f2da1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba6b364-c93a-4e87-a51e-bb78419ef463 service neutron] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba6b364-c93a-4e87-a51e-bb78419ef463 service neutron] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba6b364-c93a-4e87-a51e-bb78419ef463 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba6b364-c93a-4e87-a51e-bb78419ef463 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba6b364-c93a-4e87-a51e-bb78419ef463 service neutron] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:25 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1582/3136] 10.27.203.238 () {64 vars in 1432 bytes} [Tue May 28 13:01:25 2024] GET /identity/v3/auth/tokens => generated 2960 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 28 13:01:25 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ae348258-c7a9-4c41-94a5-aa565c59e244 tempest-ShareTypeAvailabilityZonesTest-364532124 None] <<< [GET] https://127.0.0.1:40443/api/views/ May 28 13:01:25 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ae348258-c7a9-4c41-94a5-aa565c59e244 tempest-ShareTypeAvailabilityZonesTest-364532124 None] [Bunch(abac_tags=[], abe_max_depth=None, abe_protocols=[], alias='', allow_anonymous_access=False, allow_s3_anonymous_access=False, auto_commit='0d', bucket='', bucket_creators=[], bucket_creators_groups=[], bucket_owner=None, bulk_permission_update_progress=None, bulk_permission_update_state=None, cluster='loop75-kfs', cluster_id=1, created='2024-05-28T13:01:22.991246Z', enabled=True, files_retention_mode='NONE', guid='6965dc69-c05b-4bac-a2ad-9828764cced4', id=49, ignore_oos=False, internal=False, is_remote=False, is_seamless=False, logical_capacity=0, max_retention_period=None, min_retention_period=None, name='62476a26-faf7-4184-83e5-45ec72b91d6e', nfs_interop_flags='BOTH_NFS3_AND_NFS4_INTEROP_DISABLED', path='/manila/manila-62476a26-faf7-4184-83e5-45ec72b91d6e', physical_capacity=0, policy='62476a26-faf7-4184-83e5-45ec72b91d6e', policy_id=50, protocols=['NFS'], qos_policy=None, qos_policy_id=None, s3_locks=False, s3_locks_retention_mode='NONE', s3_locks_retention_period='', s3_unverified_lookup=False, s3_versioning=False, select_for_live_monitoring=False, share='', share_acl=Bunch(acl=[], enabled=False), sync='SYNCED', sync_time='2024-05-28T13:01:23.255375Z', tenant_id=1, tenant_name='default', title='/manila/manila-62476a26-faf7-4184-83e5-45ec72b91d6e', url='https://127.0.0.1:40443/api/views/49/')] May 28 13:01:25 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ae348258-c7a9-4c41-94a5-aa565c59e244 tempest-ShareTypeAvailabilityZonesTest-364532124 None] --- [GET] https://127.0.0.1:40443/api/views/: Done May 28 13:01:25 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ae348258-c7a9-4c41-94a5-aa565c59e244 tempest-ShareTypeAvailabilityZonesTest-364532124 None] >>> [DELETE] https://127.0.0.1:40443/api/views/49/ May 28 13:01:25 l75lg1-v1 neutron-server[77619]: INFO neutron.wsgi [None req-eee85dd8-6f5e-48a8-9295-ad85bdfdc037 None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=17b281e6ecbf4c31a51fc8f70aa64a76&name=default HTTP/1.1" status: 200 len: 216 time: 0.0811508 May 28 13:01:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d5eaf1-9813-48ad-b81a-8a2ded187e56 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-20d5eaf1-9813-48ad-b81a-8a2ded187e56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:01:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d5eaf1-9813-48ad-b81a-8a2ded187e56 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc6448e-a7b6-43a4-872f-0f46fca3cbea None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc6448e-a7b6-43a4-872f-0f46fca3cbea None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc6448e-a7b6-43a4-872f-0f46fca3cbea None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc6448e-a7b6-43a4-872f-0f46fca3cbea None admin] PATH_INFO: `/v3/projects/17b281e6ecbf4c31a51fc8f70aa64a76` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc6448e-a7b6-43a4-872f-0f46fca3cbea None admin] RBAC: Authorizing `identity:delete_project(project_id=17b281e6ecbf4c31a51fc8f70aa64a76)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc6448e-a7b6-43a4-872f-0f46fca3cbea None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-dfc6448e-a7b6-43a4-872f-0f46fca3cbea None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17b281e6ecbf4c31a51fc8f70aa64a76', 'request_id': 'req-dfc6448e-a7b6-43a4-872f-0f46fca3cbea'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-dfc6448e-a7b6-43a4-872f-0f46fca3cbea None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17b281e6ecbf4c31a51fc8f70aa64a76', 'request_id': 'req-dfc6448e-a7b6-43a4-872f-0f46fca3cbea'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-dfc6448e-a7b6-43a4-872f-0f46fca3cbea None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17b281e6ecbf4c31a51fc8f70aa64a76', 'request_id': 'req-dfc6448e-a7b6-43a4-872f-0f46fca3cbea'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-dfc6448e-a7b6-43a4-872f-0f46fca3cbea None admin] The token cache is being invalidate because project 17b281e6ecbf4c31a51fc8f70aa64a76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 13:01:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-dfc6448e-a7b6-43a4-872f-0f46fca3cbea None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:25 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-dfc6448e-a7b6-43a4-872f-0f46fca3cbea None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:25 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1555/3137] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 13:01:25 2024] DELETE /identity/v3/projects/17b281e6ecbf4c31a51fc8f70aa64a76 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:01:25 l75lg1-v1 neutron-server[77618]: DEBUG neutron.wsgi [-] (77618) accepted ('10.27.203.238', 41762) {{(pid=77618) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 13:01:25 l75lg1-v1 neutron-server[77618]: INFO neutron.wsgi [None req-583bb84e-b949-4239-ad54-e185d2fca3dc None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=f96e397cc60642c39058e772b0083a08&name=default HTTP/1.1" status: 200 len: 216 time: 0.0089693 May 28 13:01:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba6b364-c93a-4e87-a51e-bb78419ef463 service neutron] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba6b364-c93a-4e87-a51e-bb78419ef463 service neutron] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826ad284-39d5-46cd-b77a-3bdb0ba457ca None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826ad284-39d5-46cd-b77a-3bdb0ba457ca None admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826ad284-39d5-46cd-b77a-3bdb0ba457ca None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826ad284-39d5-46cd-b77a-3bdb0ba457ca None admin] PATH_INFO: `/v3/projects/f96e397cc60642c39058e772b0083a08` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826ad284-39d5-46cd-b77a-3bdb0ba457ca None admin] RBAC: Authorizing `identity:delete_project(project_id=f96e397cc60642c39058e772b0083a08)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:25 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826ad284-39d5-46cd-b77a-3bdb0ba457ca None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-826ad284-39d5-46cd-b77a-3bdb0ba457ca None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f96e397cc60642c39058e772b0083a08', 'request_id': 'req-826ad284-39d5-46cd-b77a-3bdb0ba457ca'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-826ad284-39d5-46cd-b77a-3bdb0ba457ca None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f96e397cc60642c39058e772b0083a08', 'request_id': 'req-826ad284-39d5-46cd-b77a-3bdb0ba457ca'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-826ad284-39d5-46cd-b77a-3bdb0ba457ca None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f96e397cc60642c39058e772b0083a08', 'request_id': 'req-826ad284-39d5-46cd-b77a-3bdb0ba457ca'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-826ad284-39d5-46cd-b77a-3bdb0ba457ca None admin] The token cache is being invalidate because project f96e397cc60642c39058e772b0083a08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 13:01:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-826ad284-39d5-46cd-b77a-3bdb0ba457ca None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-826ad284-39d5-46cd-b77a-3bdb0ba457ca None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:26 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1583/3138] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 13:01:25 2024] DELETE /identity/v3/projects/f96e397cc60642c39058e772b0083a08 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:01:26 l75lg1-v1 neutron-server[77618]: DEBUG neutron.wsgi [-] (77618) accepted ('10.27.203.238', 41778) {{(pid=77618) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 13:01:26 l75lg1-v1 neutron-server[77618]: INFO neutron.wsgi [None req-94c7fd82-bce1-495b-84cc-37737590a8f8 None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=c4990572c2804aff8644d3fd0a3d1e10&name=default HTTP/1.1" status: 200 len: 216 time: 0.0086324 May 28 13:01:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc6448e-a7b6-43a4-872f-0f46fca3cbea None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-dfc6448e-a7b6-43a4-872f-0f46fca3cbea None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:01:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc6448e-a7b6-43a4-872f-0f46fca3cbea None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b716b5-d697-4f43-ad66-4f768162230f None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b716b5-d697-4f43-ad66-4f768162230f None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b716b5-d697-4f43-ad66-4f768162230f None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b716b5-d697-4f43-ad66-4f768162230f None admin] PATH_INFO: `/v3/projects/c4990572c2804aff8644d3fd0a3d1e10` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b716b5-d697-4f43-ad66-4f768162230f None admin] RBAC: Authorizing `identity:delete_project(project_id=c4990572c2804aff8644d3fd0a3d1e10)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b716b5-d697-4f43-ad66-4f768162230f None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-31b716b5-d697-4f43-ad66-4f768162230f None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4990572c2804aff8644d3fd0a3d1e10', 'request_id': 'req-31b716b5-d697-4f43-ad66-4f768162230f'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-31b716b5-d697-4f43-ad66-4f768162230f None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4990572c2804aff8644d3fd0a3d1e10', 'request_id': 'req-31b716b5-d697-4f43-ad66-4f768162230f'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:26 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ff6e841f-ba7b-449c-a783-b92c78fb92db tempest-SharesNFSTest-667257547 None] <<< [POST] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:01:26 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ff6e841f-ba7b-449c-a783-b92c78fb92db tempest-SharesNFSTest-667257547 None] Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=0, created='2024-05-28T13:01:25.650399Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='6f9e1b32-76c4-4fbb-84ae-5a22e57b93f1', id=51, internal=False, is_s3_default_policy=False, name='55a40e09-c80d-48da-95b1-a670d27b1414', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=[], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['*'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['*'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T13:01:26.101743Z', tenant_id=1, tenant_name='default', title='55a40e09-c80d-48da-95b1-a670d27b1414', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/51/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[]) May 28 13:01:26 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ff6e841f-ba7b-449c-a783-b92c78fb92db tempest-SharesNFSTest-667257547 None] --- [POST] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 13:01:26 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ff6e841f-ba7b-449c-a783-b92c78fb92db tempest-SharesNFSTest-667257547 None] >>> [GET] https://127.0.0.1:40443/api/quotas/ May 28 13:01:26 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ff6e841f-ba7b-449c-a783-b92c78fb92db tempest-SharesNFSTest-667257547 None] {'allow_redirects': True, May 28 13:01:26 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ff6e841f-ba7b-449c-a783-b92c78fb92db tempest-SharesNFSTest-667257547 None] 'params': {'name': '55a40e09-c80d-48da-95b1-a670d27b1414'}} May 28 13:01:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-31b716b5-d697-4f43-ad66-4f768162230f None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4990572c2804aff8644d3fd0a3d1e10', 'request_id': 'req-31b716b5-d697-4f43-ad66-4f768162230f'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-31b716b5-d697-4f43-ad66-4f768162230f None admin] The token cache is being invalidate because project c4990572c2804aff8644d3fd0a3d1e10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 13:01:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-31b716b5-d697-4f43-ad66-4f768162230f None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-31b716b5-d697-4f43-ad66-4f768162230f None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:26 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1556/3139] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 13:01:26 2024] DELETE /identity/v3/projects/c4990572c2804aff8644d3fd0a3d1e10 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:01:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cf73e6-17c2-4c04-ac73-24b8191dfc65 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cf73e6-17c2-4c04-ac73-24b8191dfc65 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cf73e6-17c2-4c04-ac73-24b8191dfc65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:26 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-e1cf73e6-17c2-4c04-ac73-24b8191dfc65 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 13:01:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-e1cf73e6-17c2-4c04-ac73-24b8191dfc65 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 13:01:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-e1cf73e6-17c2-4c04-ac73-24b8191dfc65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:01:26 l75lg1-v1 dstat.sh[49771]: 28-05 13:01:26| 13 2 78 6 0|5725M 1711M 278M 7910M| 17k 4816B| 256k 7886k|2.00 699 |8156 14k|1.47 1.23 1.08|6.0 1.0 3.0| 0 0 | 0 2048M| 29 364 0 43 2 May 28 13:01:26 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1584/3140] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 13:01:26 2024] POST /identity/v3/auth/tokens => generated 312 bytes in 22 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 28 13:01:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411a4b47-e51c-4ab4-a2bc-b4c63bfaaf5b None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411a4b47-e51c-4ab4-a2bc-b4c63bfaaf5b None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411a4b47-e51c-4ab4-a2bc-b4c63bfaaf5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:26 l75lg1-v1 sudo[99101]: pam_unix(sudo:session): session closed for user root May 28 13:01:26 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.529s {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:428}} May 28 13:01:26 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:390}} May 28 13:01:26 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-411a4b47-e51c-4ab4-a2bc-b4c63bfaaf5b None None] Truncating password to algorithm specific maximum length 72 characters. May 28 13:01:26 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-fb7bb11b-5238-408d-ae0a-8254b1ceff2f tempest-ShareRulesTest-1530341375 None] <<< [PATCH] https://127.0.0.1:40443/api/viewpolicies/38/ May 28 13:01:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-411a4b47-e51c-4ab4-a2bc-b4c63bfaaf5b None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 13:01:26 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-fb7bb11b-5238-408d-ae0a-8254b1ceff2f tempest-ShareRulesTest-1530341375 None] Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=1, created='2024-05-28T12:59:53.824250Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='0fa84ccd-850f-48fa-a965-23e5abe31188', id=38, internal=False, is_s3_default_policy=False, name='f7e47502-a0f7-44de-953d-b7b5697ae0b2', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=['*'], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=[], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=[], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='MODIFYING', sync_time='2024-05-28T13:01:25.278684Z', tenant_id=1, tenant_name='default', title='f7e47502-a0f7-44de-953d-b7b5697ae0b2', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/38/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[]) May 28 13:01:26 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-fb7bb11b-5238-408d-ae0a-8254b1ceff2f tempest-ShareRulesTest-1530341375 None] --- [PATCH] https://127.0.0.1:40443/api/viewpolicies/38/: Done May 28 13:01:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-411a4b47-e51c-4ab4-a2bc-b4c63bfaaf5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:01:26 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-fb7bb11b-5238-408d-ae0a-8254b1ceff2f tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:01:26 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-fb7bb11b-5238-408d-ae0a-8254b1ceff2f tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:01:26 l75lg1-v1 sudo[99104]: vastdata : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 May 28 13:01:26 l75lg1-v1 sudo[99104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) May 28 13:01:26 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1557/3141] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 13:01:26 2024] POST /identity/v3/auth/tokens => generated 2960 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 13:01:26 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-fb7bb11b-5238-408d-ae0a-8254b1ceff2f tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.030s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:01:26 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-fb7bb11b-5238-408d-ae0a-8254b1ceff2f tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:01:26 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-fb7bb11b-5238-408d-ae0a-8254b1ceff2f tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:01:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cf73e6-17c2-4c04-ac73-24b8191dfc65 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cf73e6-17c2-4c04-ac73-24b8191dfc65 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e561ac0c-fb32-4c40-bfa1-97829d2029e3 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e561ac0c-fb32-4c40-bfa1-97829d2029e3 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e561ac0c-fb32-4c40-bfa1-97829d2029e3 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e561ac0c-fb32-4c40-bfa1-97829d2029e3 None admin] PATH_INFO: `/v3/domains` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e561ac0c-fb32-4c40-bfa1-97829d2029e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=51267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 13:01:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e561ac0c-fb32-4c40-bfa1-97829d2029e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e561ac0c-fb32-4c40-bfa1-97829d2029e3 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:26 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1585/3142] 10.27.203.238 () {62 vars in 1220 bytes} [Tue May 28 13:01:26 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 13:01:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411a4b47-e51c-4ab4-a2bc-b4c63bfaaf5b None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411a4b47-e51c-4ab4-a2bc-b4c63bfaaf5b None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:26 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-fb7bb11b-5238-408d-ae0a-8254b1ceff2f tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.034s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:01:26 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-fb7bb11b-5238-408d-ae0a-8254b1ceff2f tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:01:26 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-fb7bb11b-5238-408d-ae0a-8254b1ceff2f tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:01:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45da4593-511a-439a-8a34-729547fb1e88 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45da4593-511a-439a-8a34-729547fb1e88 None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45da4593-511a-439a-8a34-729547fb1e88 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45da4593-511a-439a-8a34-729547fb1e88 None admin] PATH_INFO: `/v3/projects` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45da4593-511a-439a-8a34-729547fb1e88 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:26 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-fb7bb11b-5238-408d-ae0a-8254b1ceff2f tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.004s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:01:26 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-fb7bb11b-5238-408d-ae0a-8254b1ceff2f tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:01:26 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-fb7bb11b-5238-408d-ae0a-8254b1ceff2f tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:01:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45da4593-511a-439a-8a34-729547fb1e88 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:26 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-fb7bb11b-5238-408d-ae0a-8254b1ceff2f tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:01:26 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-fb7bb11b-5238-408d-ae0a-8254b1ceff2f tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:01:26 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-fb7bb11b-5238-408d-ae0a-8254b1ceff2f tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:01:26 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1558/3143] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 13:01:26 2024] POST /identity/v3/projects => generated 371 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 13:01:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e561ac0c-fb32-4c40-bfa1-97829d2029e3 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e561ac0c-fb32-4c40-bfa1-97829d2029e3 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:26 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-fb7bb11b-5238-408d-ae0a-8254b1ceff2f tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.037s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:01:26 l75lg1-v1 manila-share[98474]: INFO manila.share.access [None req-fb7bb11b-5238-408d-ae0a-8254b1ceff2f tempest-ShareRulesTest-1530341375 None] Access rules were successfully modified for share instance f7e47502-a0f7-44de-953d-b7b5697ae0b2 belonging to share b330db31-7766-443d-9c19-26fe349665aa. May 28 13:01:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bc92ee-a752-410f-a30f-77fbad340ad9 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bc92ee-a752-410f-a30f-77fbad340ad9 None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bc92ee-a752-410f-a30f-77fbad340ad9 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bc92ee-a752-410f-a30f-77fbad340ad9 None admin] PATH_INFO: `/v3/users` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bc92ee-a752-410f-a30f-77fbad340ad9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bc92ee-a752-410f-a30f-77fbad340ad9 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:26 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-52bc92ee-a752-410f-a30f-77fbad340ad9 None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 13:01:26 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1586/3144] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 13:01:26 2024] POST /identity/v3/users => generated 294 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 13:01:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45da4593-511a-439a-8a34-729547fb1e88 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45da4593-511a-439a-8a34-729547fb1e88 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5082498-674c-4eb9-9323-5468ba8afa77 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5082498-674c-4eb9-9323-5468ba8afa77 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5082498-674c-4eb9-9323-5468ba8afa77 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5082498-674c-4eb9-9323-5468ba8afa77 None admin] PATH_INFO: `/v3/roles` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5082498-674c-4eb9-9323-5468ba8afa77 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5082498-674c-4eb9-9323-5468ba8afa77 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:26 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1559/3145] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 13:01:26 2024] GET /identity/v3/roles => generated 1680 bytes in 18 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 13:01:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bc92ee-a752-410f-a30f-77fbad340ad9 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bc92ee-a752-410f-a30f-77fbad340ad9 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2667f0f9-c272-45a5-9e5f-f168f75876fa None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2667f0f9-c272-45a5-9e5f-f168f75876fa None admin] REQUEST_METHOD: `PUT` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2667f0f9-c272-45a5-9e5f-f168f75876fa None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2667f0f9-c272-45a5-9e5f-f168f75876fa None admin] PATH_INFO: `/v3/projects/bece16f41fc44d55bf7bc45c2adaaed5/users/ed7d4361167043f38be1e05c82d83f1c/roles/44620cad10ae407c90c91e2c296adb04` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2667f0f9-c272-45a5-9e5f-f168f75876fa None admin] RBAC: Authorizing `identity:create_grant(project_id=bece16f41fc44d55bf7bc45c2adaaed5, user_id=ed7d4361167043f38be1e05c82d83f1c, role_id=44620cad10ae407c90c91e2c296adb04)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2667f0f9-c272-45a5-9e5f-f168f75876fa None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:26 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1587/3146] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 13:01:26 2024] PUT /identity/v3/projects/bece16f41fc44d55bf7bc45c2adaaed5/users/ed7d4361167043f38be1e05c82d83f1c/roles/44620cad10ae407c90c91e2c296adb04 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:01:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24da60b-5210-4cc7-acbe-cb23aa7cfa06 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24da60b-5210-4cc7-acbe-cb23aa7cfa06 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24da60b-5210-4cc7-acbe-cb23aa7cfa06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:26 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-d24da60b-5210-4cc7-acbe-cb23aa7cfa06 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 13:01:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-d24da60b-5210-4cc7-acbe-cb23aa7cfa06 None None] MFA Rules not processed for user `ed7d4361167043f38be1e05c82d83f1c`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 13:01:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-d24da60b-5210-4cc7-acbe-cb23aa7cfa06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:01:26 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1560/3147] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 13:01:26 2024] POST /identity/v3/auth/tokens => generated 3942 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 13:01:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2667f0f9-c272-45a5-9e5f-f168f75876fa None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2667f0f9-c272-45a5-9e5f-f168f75876fa None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87ba5f9-04ef-4fe3-ac40-06fa56edf8ef None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87ba5f9-04ef-4fe3-ac40-06fa56edf8ef None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87ba5f9-04ef-4fe3-ac40-06fa56edf8ef None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87ba5f9-04ef-4fe3-ac40-06fa56edf8ef None admin] PATH_INFO: `/v3/projects` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87ba5f9-04ef-4fe3-ac40-06fa56edf8ef None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87ba5f9-04ef-4fe3-ac40-06fa56edf8ef None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:26 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-49f1f61d-779a-4176-a723-81d460eca578 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] GET http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/share-access-rules?share_id=b330db31-7766-443d-9c19-26fe349665aa May 28 13:01:26 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-49f1f61d-779a-4176-a723-81d460eca578 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:26 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-49f1f61d-779a-4176-a723-81d460eca578 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:26 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1588/3148] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 13:01:26 2024] POST /identity/v3/projects => generated 373 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 13:01:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24da60b-5210-4cc7-acbe-cb23aa7cfa06 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24da60b-5210-4cc7-acbe-cb23aa7cfa06 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:26 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-49f1f61d-779a-4176-a723-81d460eca578 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/share-access-rules?share_id=b330db31-7766-443d-9c19-26fe349665aa returned with HTTP 200 May 28 13:01:26 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1134/2242] 10.27.203.238 () {64 vars in 1467 bytes} [Tue May 28 13:01:26 2024] GET /share/v2/a4f3887fa28c457390f5b66615564430/share-access-rules?share_id=b330db31-7766-443d-9c19-26fe349665aa => generated 19 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:01:26 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-cd563bca-39b7-465c-8326-3f00978098a9 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] POST http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/shares/b330db31-7766-443d-9c19-26fe349665aa/action May 28 13:01:26 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-cd563bca-39b7-465c-8326-3f00978098a9 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Action body: b'{"allow_access": {"access_type": "ip", "access_to": "203.0.113.77", "access_level": "rw"}}' {{(pid=98330) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 13:01:26 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-cd563bca-39b7-465c-8326-3f00978098a9 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Action: 'action', calling method: ShareController.allow_access, body: {"allow_access": {"access_type": "ip", "access_to": "203.0.113.77", "access_level": "rw"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:01:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6949f6ac-0d7a-4646-8dfb-f3f2fd6eedcc None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6949f6ac-0d7a-4646-8dfb-f3f2fd6eedcc None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6949f6ac-0d7a-4646-8dfb-f3f2fd6eedcc None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6949f6ac-0d7a-4646-8dfb-f3f2fd6eedcc None admin] PATH_INFO: `/v3/users` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6949f6ac-0d7a-4646-8dfb-f3f2fd6eedcc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6949f6ac-0d7a-4646-8dfb-f3f2fd6eedcc None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:26 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-6949f6ac-0d7a-4646-8dfb-f3f2fd6eedcc None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 13:01:26 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1561/3149] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 13:01:26 2024] POST /identity/v3/users => generated 295 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 13:01:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87ba5f9-04ef-4fe3-ac40-06fa56edf8ef None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87ba5f9-04ef-4fe3-ac40-06fa56edf8ef None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a96f47-a7c1-4c8f-9fe9-3d330fe346f5 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a96f47-a7c1-4c8f-9fe9-3d330fe346f5 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a96f47-a7c1-4c8f-9fe9-3d330fe346f5 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a96f47-a7c1-4c8f-9fe9-3d330fe346f5 None admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a96f47-a7c1-4c8f-9fe9-3d330fe346f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a96f47-a7c1-4c8f-9fe9-3d330fe346f5 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:26 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1589/3150] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 13:01:26 2024] GET /identity/v3/roles => generated 1680 bytes in 19 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 13:01:26 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-cd563bca-39b7-465c-8326-3f00978098a9 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:01:26 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-cd563bca-39b7-465c-8326-3f00978098a9 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:01:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6949f6ac-0d7a-4646-8dfb-f3f2fd6eedcc None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6949f6ac-0d7a-4646-8dfb-f3f2fd6eedcc None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e2471e-0f66-4aee-8e97-11e37896d6a9 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e2471e-0f66-4aee-8e97-11e37896d6a9 None admin] REQUEST_METHOD: `PUT` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e2471e-0f66-4aee-8e97-11e37896d6a9 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e2471e-0f66-4aee-8e97-11e37896d6a9 None admin] PATH_INFO: `/v3/projects/6570d95ff9704ae6a746d0fdc1bcfded/users/c63c17000aaa4286bcf00a2e6c714c55/roles/44620cad10ae407c90c91e2c296adb04` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:26 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ff6e841f-ba7b-449c-a783-b92c78fb92db tempest-SharesNFSTest-667257547 None] <<< [GET] https://127.0.0.1:40443/api/quotas/ May 28 13:01:26 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ff6e841f-ba7b-449c-a783-b92c78fb92db tempest-SharesNFSTest-667257547 None] [] May 28 13:01:26 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ff6e841f-ba7b-449c-a783-b92c78fb92db tempest-SharesNFSTest-667257547 None] --- [GET] https://127.0.0.1:40443/api/quotas/: Done May 28 13:01:26 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ff6e841f-ba7b-449c-a783-b92c78fb92db tempest-SharesNFSTest-667257547 None] >>> [POST] https://127.0.0.1:40443/api/quotas/ May 28 13:01:26 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ff6e841f-ba7b-449c-a783-b92c78fb92db tempest-SharesNFSTest-667257547 None] {'data': '{"name": "55a40e09-c80d-48da-95b1-a670d27b1414", "path": ' May 28 13:01:26 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ff6e841f-ba7b-449c-a783-b92c78fb92db tempest-SharesNFSTest-667257547 None] '"/manila/manila-55a40e09-c80d-48da-95b1-a670d27b1414", "create_dir": ' May 28 13:01:26 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ff6e841f-ba7b-449c-a783-b92c78fb92db tempest-SharesNFSTest-667257547 None] 'true, "hard_limit": 1073741824}', May 28 13:01:26 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ff6e841f-ba7b-449c-a783-b92c78fb92db tempest-SharesNFSTest-667257547 None] 'json': None, May 28 13:01:26 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ff6e841f-ba7b-449c-a783-b92c78fb92db tempest-SharesNFSTest-667257547 None] 'params': None} May 28 13:01:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e2471e-0f66-4aee-8e97-11e37896d6a9 None admin] RBAC: Authorizing `identity:create_grant(project_id=6570d95ff9704ae6a746d0fdc1bcfded, user_id=c63c17000aaa4286bcf00a2e6c714c55, role_id=44620cad10ae407c90c91e2c296adb04)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e2471e-0f66-4aee-8e97-11e37896d6a9 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:26 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1562/3151] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 13:01:26 2024] PUT /identity/v3/projects/6570d95ff9704ae6a746d0fdc1bcfded/users/c63c17000aaa4286bcf00a2e6c714c55/roles/44620cad10ae407c90c91e2c296adb04 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:01:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cf2a8a-b8ab-40c7-8d13-e049745949fe None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cf2a8a-b8ab-40c7-8d13-e049745949fe None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cf2a8a-b8ab-40c7-8d13-e049745949fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:26 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-cd563bca-39b7-465c-8326-3f00978098a9 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.053s {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:01:26 l75lg1-v1 sudo[99104]: pam_unix(sudo:session): session closed for user root May 28 13:01:26 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.537s {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:428}} May 28 13:01:26 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:390}} May 28 13:01:26 l75lg1-v1 devstack@m-api.service[98330]: DEBUG dbcounter [-] [98330] Writing DB stats manila:SELECT=1201,manila:INSERT=124,manila:UPDATE=190 {{(pid=98330) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:01:26 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-b3cf2a8a-b8ab-40c7-8d13-e049745949fe None None] Truncating password to algorithm specific maximum length 72 characters. May 28 13:01:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-b3cf2a8a-b8ab-40c7-8d13-e049745949fe None None] MFA Rules not processed for user `c63c17000aaa4286bcf00a2e6c714c55`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 13:01:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-b3cf2a8a-b8ab-40c7-8d13-e049745949fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:01:26 l75lg1-v1 sudo[99153]: vastdata : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool May 28 13:01:26 l75lg1-v1 sudo[99153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) May 28 13:01:26 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-cd563bca-39b7-465c-8326-3f00978098a9 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/shares/b330db31-7766-443d-9c19-26fe349665aa/action returned with HTTP 200 May 28 13:01:26 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1109/2243] 10.27.203.238 () {66 vars in 1493 bytes} [Tue May 28 13:01:26 2024] POST /share/v2/a4f3887fa28c457390f5b66615564430/shares/b330db31-7766-443d-9c19-26fe349665aa/action => generated 218 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:01:26 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-ebb52295-9bad-4035-8d07-de8953ab1eb6 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] POST http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/shares/b330db31-7766-443d-9c19-26fe349665aa/action May 28 13:01:26 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-ebb52295-9bad-4035-8d07-de8953ab1eb6 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Action body: b'{"access_list": null}' {{(pid=98329) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 13:01:26 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-ebb52295-9bad-4035-8d07-de8953ab1eb6 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Action: 'action', calling method: ShareController.access_list, body: {"access_list": null} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:01:26 l75lg1-v1 devstack@m-api.service[98329]: DEBUG dbcounter [-] [98329] Writing DB stats manila:SELECT=1216,manila:INSERT=149,manila:UPDATE=190 {{(pid=98329) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:01:26 l75lg1-v1 manila-share[98474]: DEBUG manila.share.manager [None req-cd563bca-39b7-465c-8326-3f00978098a9 tempest-ShareRulesTest-1530341375 None] Received request to update access for share instance f7e47502-a0f7-44de-953d-b7b5697ae0b2. {{(pid=98474) update_access_for_instances /opt/stack/manila/manila/share/manager.py:4353}} May 28 13:01:26 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1590/3152] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 13:01:26 2024] POST /identity/v3/auth/tokens => generated 3944 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 13:01:26 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-cd563bca-39b7-465c-8326-3f00978098a9 tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:01:26 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-cd563bca-39b7-465c-8326-3f00978098a9 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:01:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e2471e-0f66-4aee-8e97-11e37896d6a9 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:26 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-cd563bca-39b7-465c-8326-3f00978098a9 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:01:26 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-cd563bca-39b7-465c-8326-3f00978098a9 tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:01:26 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-cd563bca-39b7-465c-8326-3f00978098a9 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:01:26 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-ebb52295-9bad-4035-8d07-de8953ab1eb6 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/shares/b330db31-7766-443d-9c19-26fe349665aa/action returned with HTTP 200 May 28 13:01:26 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1135/2244] 10.27.203.238 () {66 vars in 1493 bytes} [Tue May 28 13:01:26 2024] POST /share/v2/a4f3887fa28c457390f5b66615564430/shares/b330db31-7766-443d-9c19-26fe349665aa/action => generated 173 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:01:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e2471e-0f66-4aee-8e97-11e37896d6a9 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ca9be4-7f34-4573-afe7-2f06c7958d24 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ca9be4-7f34-4573-afe7-2f06c7958d24 None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ca9be4-7f34-4573-afe7-2f06c7958d24 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ca9be4-7f34-4573-afe7-2f06c7958d24 None admin] PATH_INFO: `/v3/projects` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ca9be4-7f34-4573-afe7-2f06c7958d24 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:26 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ca9be4-7f34-4573-afe7-2f06c7958d24 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:26 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1563/3153] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 13:01:26 2024] POST /identity/v3/projects => generated 371 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 13:01:26 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-cd563bca-39b7-465c-8326-3f00978098a9 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.059s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:01:26 l75lg1-v1 manila-share[98474]: DEBUG manila.share.access [None req-cd563bca-39b7-465c-8326-3f00978098a9 tempest-ShareRulesTest-1530341375 None] Updating access rules for share instance f7e47502-a0f7-44de-953d-b7b5697ae0b2 belonging to share b330db31-7766-443d-9c19-26fe349665aa. {{(pid=98474) update_access_rules /opt/stack/manila/manila/share/access.py:298}} May 28 13:01:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cf2a8a-b8ab-40c7-8d13-e049745949fe None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cf2a8a-b8ab-40c7-8d13-e049745949fe None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:26 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-cd563bca-39b7-465c-8326-3f00978098a9 tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:01:26 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-cd563bca-39b7-465c-8326-3f00978098a9 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:01:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a84bb13-ef95-4f42-b572-80b9f1f2e330 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a84bb13-ef95-4f42-b572-80b9f1f2e330 None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a84bb13-ef95-4f42-b572-80b9f1f2e330 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a84bb13-ef95-4f42-b572-80b9f1f2e330 None admin] PATH_INFO: `/v3/users` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a84bb13-ef95-4f42-b572-80b9f1f2e330 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:26 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a84bb13-ef95-4f42-b572-80b9f1f2e330 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:26 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-cd563bca-39b7-465c-8326-3f00978098a9 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.007s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:01:26 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-cd563bca-39b7-465c-8326-3f00978098a9 tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:01:26 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-cd563bca-39b7-465c-8326-3f00978098a9 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:01:26 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-1a84bb13-ef95-4f42-b572-80b9f1f2e330 None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 13:01:26 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-cd563bca-39b7-465c-8326-3f00978098a9 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.016s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:01:26 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-cd563bca-39b7-465c-8326-3f00978098a9 tempest-ShareRulesTest-1530341375 None] changing access on None May 28 13:01:26 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-cd563bca-39b7-465c-8326-3f00978098a9 tempest-ShareRulesTest-1530341375 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:01:26 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-cd563bca-39b7-465c-8326-3f00978098a9 tempest-ShareRulesTest-1530341375 None] {'allow_redirects': True, May 28 13:01:26 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-cd563bca-39b7-465c-8326-3f00978098a9 tempest-ShareRulesTest-1530341375 None] 'params': {'name': 'f7e47502-a0f7-44de-953d-b7b5697ae0b2'}} May 28 13:01:26 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1591/3154] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 13:01:26 2024] POST /identity/v3/users => generated 293 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 13:01:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ca9be4-7f34-4573-afe7-2f06c7958d24 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ca9be4-7f34-4573-afe7-2f06c7958d24 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c1a43f-bfef-4249-b290-d502d2a46218 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c1a43f-bfef-4249-b290-d502d2a46218 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c1a43f-bfef-4249-b290-d502d2a46218 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c1a43f-bfef-4249-b290-d502d2a46218 None admin] PATH_INFO: `/v3/roles` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c1a43f-bfef-4249-b290-d502d2a46218 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c1a43f-bfef-4249-b290-d502d2a46218 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:27 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1564/3155] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 13:01:26 2024] GET /identity/v3/roles => generated 1680 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 13:01:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a84bb13-ef95-4f42-b572-80b9f1f2e330 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a84bb13-ef95-4f42-b572-80b9f1f2e330 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d715fcf-2b9d-436a-a512-f09472a7fe13 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d715fcf-2b9d-436a-a512-f09472a7fe13 None admin] REQUEST_METHOD: `PUT` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d715fcf-2b9d-436a-a512-f09472a7fe13 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d715fcf-2b9d-436a-a512-f09472a7fe13 None admin] PATH_INFO: `/v3/projects/d1537648c20c411f91d5a0afa8167810/users/18e2f070539c4a5b976f7acfade6058d/roles/e7989893488f483baa107be56668c4f8` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d715fcf-2b9d-436a-a512-f09472a7fe13 None admin] RBAC: Authorizing `identity:create_grant(project_id=d1537648c20c411f91d5a0afa8167810, user_id=18e2f070539c4a5b976f7acfade6058d, role_id=e7989893488f483baa107be56668c4f8)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d715fcf-2b9d-436a-a512-f09472a7fe13 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:27 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1592/3156] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 13:01:27 2024] PUT /identity/v3/projects/d1537648c20c411f91d5a0afa8167810/users/18e2f070539c4a5b976f7acfade6058d/roles/e7989893488f483baa107be56668c4f8 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:01:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c1a43f-bfef-4249-b290-d502d2a46218 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c1a43f-bfef-4249-b290-d502d2a46218 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bc653b-cf8b-4130-88f7-0e05e7832347 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bc653b-cf8b-4130-88f7-0e05e7832347 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bc653b-cf8b-4130-88f7-0e05e7832347 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bc653b-cf8b-4130-88f7-0e05e7832347 None admin] PATH_INFO: `/v3/roles` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bc653b-cf8b-4130-88f7-0e05e7832347 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bc653b-cf8b-4130-88f7-0e05e7832347 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:27 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1565/3157] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 13:01:27 2024] GET /identity/v3/roles => generated 1680 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 13:01:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d715fcf-2b9d-436a-a512-f09472a7fe13 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d715fcf-2b9d-436a-a512-f09472a7fe13 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17259dd-19ab-4834-9781-52ae9894f3e3 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17259dd-19ab-4834-9781-52ae9894f3e3 None admin] REQUEST_METHOD: `PUT` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17259dd-19ab-4834-9781-52ae9894f3e3 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17259dd-19ab-4834-9781-52ae9894f3e3 None admin] PATH_INFO: `/v3/projects/d1537648c20c411f91d5a0afa8167810/users/18e2f070539c4a5b976f7acfade6058d/roles/e7989893488f483baa107be56668c4f8` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17259dd-19ab-4834-9781-52ae9894f3e3 None admin] RBAC: Authorizing `identity:create_grant(project_id=d1537648c20c411f91d5a0afa8167810, user_id=18e2f070539c4a5b976f7acfade6058d, role_id=e7989893488f483baa107be56668c4f8)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17259dd-19ab-4834-9781-52ae9894f3e3 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:27 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1593/3158] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 13:01:27 2024] PUT /identity/v3/projects/d1537648c20c411f91d5a0afa8167810/users/18e2f070539c4a5b976f7acfade6058d/roles/e7989893488f483baa107be56668c4f8 => generated 0 bytes in 18 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:01:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dada035-fdaf-4c4a-a399-2d0b323a1dee None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dada035-fdaf-4c4a-a399-2d0b323a1dee None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dada035-fdaf-4c4a-a399-2d0b323a1dee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:27 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-0dada035-fdaf-4c4a-a399-2d0b323a1dee None None] Truncating password to algorithm specific maximum length 72 characters. May 28 13:01:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-0dada035-fdaf-4c4a-a399-2d0b323a1dee None None] MFA Rules not processed for user `18e2f070539c4a5b976f7acfade6058d`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 13:01:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-0dada035-fdaf-4c4a-a399-2d0b323a1dee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:01:27 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1566/3159] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 13:01:27 2024] POST /identity/v3/auth/tokens => generated 4065 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 13:01:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17259dd-19ab-4834-9781-52ae9894f3e3 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17259dd-19ab-4834-9781-52ae9894f3e3 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd05af46-9568-47d0-a3ec-6b1a3ac413e9 tempest-ShareTransferTest-121988270 tempest-ShareTransferTest-121988270-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18e2f070539c4a5b976f7acfade6058d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1537648c20c411f91d5a0afa8167810', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd05af46-9568-47d0-a3ec-6b1a3ac413e9 tempest-ShareTransferTest-121988270 tempest-ShareTransferTest-121988270-project-admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd05af46-9568-47d0-a3ec-6b1a3ac413e9 tempest-ShareTransferTest-121988270 tempest-ShareTransferTest-121988270-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd05af46-9568-47d0-a3ec-6b1a3ac413e9 tempest-ShareTransferTest-121988270 tempest-ShareTransferTest-121988270-project-admin] PATH_INFO: `/v3/domains` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd05af46-9568-47d0-a3ec-6b1a3ac413e9 tempest-ShareTransferTest-121988270 tempest-ShareTransferTest-121988270-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=51267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 13:01:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd05af46-9568-47d0-a3ec-6b1a3ac413e9 tempest-ShareTransferTest-121988270 tempest-ShareTransferTest-121988270-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd05af46-9568-47d0-a3ec-6b1a3ac413e9 tempest-ShareTransferTest-121988270 tempest-ShareTransferTest-121988270-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:27 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1594/3160] 10.27.203.238 () {62 vars in 1241 bytes} [Tue May 28 13:01:27 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 13:01:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dada035-fdaf-4c4a-a399-2d0b323a1dee None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dada035-fdaf-4c4a-a399-2d0b323a1dee None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:27 l75lg1-v1 dstat.sh[49771]: 28-05 13:01:27| 25 4 69 2 0|5728M 1708M 278M 7910M| 12k 7016B| 640k 2245k|5.00 286 |9925 17k|1.51 1.24 1.08|6.0 0 52| 0 0 | 0 2048M| 29 364 0 41 2 May 28 13:01:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee4e19a-ea06-48b8-ae0f-7fe09881f3f4 tempest-ShareTransferTest-121988270 tempest-ShareTransferTest-121988270-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18e2f070539c4a5b976f7acfade6058d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1537648c20c411f91d5a0afa8167810', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee4e19a-ea06-48b8-ae0f-7fe09881f3f4 tempest-ShareTransferTest-121988270 tempest-ShareTransferTest-121988270-project-admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee4e19a-ea06-48b8-ae0f-7fe09881f3f4 tempest-ShareTransferTest-121988270 tempest-ShareTransferTest-121988270-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee4e19a-ea06-48b8-ae0f-7fe09881f3f4 tempest-ShareTransferTest-121988270 tempest-ShareTransferTest-121988270-project-admin] PATH_INFO: `/v3/users` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:27 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-aa37d928-d022-44dc-b86d-e1e51ea005ad tempest-SharesNFSTest-667257547 tempest-SharesNFSTest-667257547-project-member] GET http://10.27.203.238/share/v2/0af6f8e0aeed4f27b075e08f2bc713aa/shares/b40e9810-7e36-4abf-afca-87c742ad83b1 May 28 13:01:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee4e19a-ea06-48b8-ae0f-7fe09881f3f4 tempest-ShareTransferTest-121988270 tempest-ShareTransferTest-121988270-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:27 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-aa37d928-d022-44dc-b86d-e1e51ea005ad tempest-SharesNFSTest-667257547 tempest-SharesNFSTest-667257547-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:27 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-aa37d928-d022-44dc-b86d-e1e51ea005ad tempest-SharesNFSTest-667257547 tempest-SharesNFSTest-667257547-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee4e19a-ea06-48b8-ae0f-7fe09881f3f4 tempest-ShareTransferTest-121988270 tempest-ShareTransferTest-121988270-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:27 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-1ee4e19a-ea06-48b8-ae0f-7fe09881f3f4 tempest-ShareTransferTest-121988270 tempest-ShareTransferTest-121988270-project-admin] Truncating password to algorithm specific maximum length 72 characters. May 28 13:01:27 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-aa37d928-d022-44dc-b86d-e1e51ea005ad tempest-SharesNFSTest-667257547 tempest-SharesNFSTest-667257547-project-member] http://10.27.203.238/share/v2/0af6f8e0aeed4f27b075e08f2bc713aa/shares/b40e9810-7e36-4abf-afca-87c742ad83b1 returned with HTTP 200 May 28 13:01:27 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1110/2245] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:01:27 2024] GET /share/v2/0af6f8e0aeed4f27b075e08f2bc713aa/shares/b40e9810-7e36-4abf-afca-87c742ad83b1 => generated 1311 bytes in 28 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:01:27 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1567/3161] 10.27.203.238 () {64 vars in 1232 bytes} [Tue May 28 13:01:27 2024] POST /identity/v3/users => generated 431 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 13:01:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd05af46-9568-47d0-a3ec-6b1a3ac413e9 tempest-ShareTransferTest-121988270 tempest-ShareTransferTest-121988270-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd05af46-9568-47d0-a3ec-6b1a3ac413e9 tempest-ShareTransferTest-121988270 tempest-ShareTransferTest-121988270-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b31d346-2d3b-4d43-bab5-7e44611c8085 tempest-ShareTransferTest-121988270 tempest-ShareTransferTest-121988270-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18e2f070539c4a5b976f7acfade6058d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1537648c20c411f91d5a0afa8167810', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b31d346-2d3b-4d43-bab5-7e44611c8085 tempest-ShareTransferTest-121988270 tempest-ShareTransferTest-121988270-project-admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b31d346-2d3b-4d43-bab5-7e44611c8085 tempest-ShareTransferTest-121988270 tempest-ShareTransferTest-121988270-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b31d346-2d3b-4d43-bab5-7e44611c8085 tempest-ShareTransferTest-121988270 tempest-ShareTransferTest-121988270-project-admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b31d346-2d3b-4d43-bab5-7e44611c8085 tempest-ShareTransferTest-121988270 tempest-ShareTransferTest-121988270-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b31d346-2d3b-4d43-bab5-7e44611c8085 tempest-ShareTransferTest-121988270 tempest-ShareTransferTest-121988270-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:27 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1595/3162] 10.27.203.238 () {62 vars in 1210 bytes} [Tue May 28 13:01:27 2024] GET /identity/v3/roles => generated 1680 bytes in 16 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 13:01:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee4e19a-ea06-48b8-ae0f-7fe09881f3f4 tempest-ShareTransferTest-121988270 tempest-ShareTransferTest-121988270-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee4e19a-ea06-48b8-ae0f-7fe09881f3f4 tempest-ShareTransferTest-121988270 tempest-ShareTransferTest-121988270-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:27 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-cd563bca-39b7-465c-8326-3f00978098a9 tempest-ShareRulesTest-1530341375 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:01:27 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-cd563bca-39b7-465c-8326-3f00978098a9 tempest-ShareRulesTest-1530341375 None] [Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=1, created='2024-05-28T12:59:53.824250Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='0fa84ccd-850f-48fa-a965-23e5abe31188', id=38, internal=False, is_s3_default_policy=False, name='f7e47502-a0f7-44de-953d-b7b5697ae0b2', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=['*'], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=[], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=[], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T13:01:26.118904Z', tenant_id=1, tenant_name='default', title='f7e47502-a0f7-44de-953d-b7b5697ae0b2', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/38/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[])] May 28 13:01:27 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-cd563bca-39b7-465c-8326-3f00978098a9 tempest-ShareRulesTest-1530341375 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 13:01:27 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-cd563bca-39b7-465c-8326-3f00978098a9 tempest-ShareRulesTest-1530341375 None] changing access on /manila/manila-f7e47502-a0f7-44de-953d-b7b5697ae0b2. Rules: {'nfs_read_write': ['203.0.113.77'], 'nfs_read_only': []} May 28 13:01:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842d4b11-5491-4b5d-a731-36ff92e45933 tempest-ShareTransferTest-121988270 tempest-ShareTransferTest-121988270-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18e2f070539c4a5b976f7acfade6058d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1537648c20c411f91d5a0afa8167810', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:27 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-cd563bca-39b7-465c-8326-3f00978098a9 tempest-ShareRulesTest-1530341375 None] >>> [PATCH] https://127.0.0.1:40443/api/viewpolicies/38/ May 28 13:01:27 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-cd563bca-39b7-465c-8326-3f00978098a9 tempest-ShareRulesTest-1530341375 None] {'data': '{"name": "f7e47502-a0f7-44de-953d-b7b5697ae0b2", "nfs_no_squash": ' May 28 13:01:27 l75lg1-v1 sudo[99153]: pam_unix(sudo:session): session closed for user root May 28 13:01:27 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-cd563bca-39b7-465c-8326-3f00978098a9 tempest-ShareRulesTest-1530341375 None] '["*"], "nfs_root_squash": ["*"], "nfs_read_write": ["203.0.113.77"], ' May 28 13:01:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842d4b11-5491-4b5d-a731-36ff92e45933 tempest-ShareTransferTest-121988270 tempest-ShareTransferTest-121988270-project-admin] REQUEST_METHOD: `PUT` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:27 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-cd563bca-39b7-465c-8326-3f00978098a9 tempest-ShareRulesTest-1530341375 None] '"nfs_read_only": []}', May 28 13:01:27 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-cd563bca-39b7-465c-8326-3f00978098a9 tempest-ShareRulesTest-1530341375 None] 'params': None} May 28 13:01:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842d4b11-5491-4b5d-a731-36ff92e45933 tempest-ShareTransferTest-121988270 tempest-ShareTransferTest-121988270-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842d4b11-5491-4b5d-a731-36ff92e45933 tempest-ShareTransferTest-121988270 tempest-ShareTransferTest-121988270-project-admin] PATH_INFO: `/v3/projects/d1537648c20c411f91d5a0afa8167810/users/d76fc4c11efc4cff97005a3ab0385c58/roles/44620cad10ae407c90c91e2c296adb04` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:27 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.516s {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:428}} May 28 13:01:27 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:390}} May 28 13:01:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842d4b11-5491-4b5d-a731-36ff92e45933 tempest-ShareTransferTest-121988270 tempest-ShareTransferTest-121988270-project-admin] RBAC: Authorizing `identity:create_grant(project_id=d1537648c20c411f91d5a0afa8167810, user_id=d76fc4c11efc4cff97005a3ab0385c58, role_id=44620cad10ae407c90c91e2c296adb04)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842d4b11-5491-4b5d-a731-36ff92e45933 tempest-ShareTransferTest-121988270 tempest-ShareTransferTest-121988270-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:27 l75lg1-v1 sudo[99156]: vastdata : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 May 28 13:01:27 l75lg1-v1 sudo[99156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) May 28 13:01:27 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1568/3163] 10.27.203.238 () {64 vars in 1571 bytes} [Tue May 28 13:01:27 2024] PUT /identity/v3/projects/d1537648c20c411f91d5a0afa8167810/users/d76fc4c11efc4cff97005a3ab0385c58/roles/44620cad10ae407c90c91e2c296adb04 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:01:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b31d346-2d3b-4d43-bab5-7e44611c8085 tempest-ShareTransferTest-121988270 tempest-ShareTransferTest-121988270-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-3b31d346-2d3b-4d43-bab5-7e44611c8085 tempest-ShareTransferTest-121988270 tempest-ShareTransferTest-121988270-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:01:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b31d346-2d3b-4d43-bab5-7e44611c8085 tempest-ShareTransferTest-121988270 tempest-ShareTransferTest-121988270-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6ed51c-07d6-4d82-9358-8e331af26f0e service manila] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f110cf6300f049c897d0aab63218d1e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6ed51c-07d6-4d82-9358-8e331af26f0e service manila] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6ed51c-07d6-4d82-9358-8e331af26f0e service manila] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6ed51c-07d6-4d82-9358-8e331af26f0e service manila] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6ed51c-07d6-4d82-9358-8e331af26f0e service manila] RBAC: Authorizing `identity:validate_token()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:27 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6ed51c-07d6-4d82-9358-8e331af26f0e service manila] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:27 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1596/3164] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 13:01:27 2024] GET /identity/v3/auth/tokens => generated 4065 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 13:01:27 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-65dbf554-5598-4605-a984-e44670a7af27 tempest-ShareTransferTest-121988270 tempest-ShareTransferTest-121988270-project-admin] POST http://10.27.203.238/share/v2/d1537648c20c411f91d5a0afa8167810/types May 28 13:01:27 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-65dbf554-5598-4605-a984-e44670a7af27 tempest-ShareTransferTest-121988270 tempest-ShareTransferTest-121988270-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share_type": {"name": "tempest-typeshare-type-1102724636", "extra_specs": {"driver_handles_share_servers": "False"}, "share_type_access:is_public": true}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:01:27 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-65dbf554-5598-4605-a984-e44670a7af27 tempest-ShareTransferTest-121988270 tempest-ShareTransferTest-121988270-project-admin] http://10.27.203.238/share/v2/d1537648c20c411f91d5a0afa8167810/types returned with HTTP 200 May 28 13:01:27 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1136/2246] 10.27.203.238 () {66 vars in 1359 bytes} [Tue May 28 13:01:27 2024] POST /share/v2/d1537648c20c411f91d5a0afa8167810/types => generated 623 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:01:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842d4b11-5491-4b5d-a731-36ff92e45933 tempest-ShareTransferTest-121988270 tempest-ShareTransferTest-121988270-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-842d4b11-5491-4b5d-a731-36ff92e45933 tempest-ShareTransferTest-121988270 tempest-ShareTransferTest-121988270-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:01:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842d4b11-5491-4b5d-a731-36ff92e45933 tempest-ShareTransferTest-121988270 tempest-ShareTransferTest-121988270-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14e38d8-c2d1-4320-ade4-a1eecb3bce53 service manila] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f110cf6300f049c897d0aab63218d1e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14e38d8-c2d1-4320-ade4-a1eecb3bce53 service manila] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14e38d8-c2d1-4320-ade4-a1eecb3bce53 service manila] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14e38d8-c2d1-4320-ade4-a1eecb3bce53 service manila] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14e38d8-c2d1-4320-ade4-a1eecb3bce53 service manila] RBAC: Authorizing `identity:validate_token()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:27 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14e38d8-c2d1-4320-ade4-a1eecb3bce53 service manila] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:27 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1569/3165] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 13:01:27 2024] GET /identity/v3/auth/tokens => generated 3942 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 13:01:27 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-145d487c-abbe-487d-b838-c2215f33b9e8 tempest-ShareTransferTest-320553121 tempest-ShareTransferTest-320553121-project-member] POST http://10.27.203.238/share/v2/bece16f41fc44d55bf7bc45c2adaaed5/shares May 28 13:01:27 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-145d487c-abbe-487d-b838-c2215f33b9e8 tempest-ShareTransferTest-320553121 tempest-ShareTransferTest-320553121-project-member] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share": {"share_proto": "nfs", "description": "Tempest's share", "snapshot_id": null, "name": "tempest-tempest-share-name-1905595194", "size": 1, "metadata": {}, "is_public": false, "share_type": "a09b56f4-f387-46cd-bf2b-e2ebf52c35df"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:01:27 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.v1.shares [None req-145d487c-abbe-487d-b838-c2215f33b9e8 tempest-ShareTransferTest-320553121 tempest-ShareTransferTest-320553121-project-member] Create NFS share of 1 GB May 28 13:01:27 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.quota [None req-145d487c-abbe-487d-b838-c2215f33b9e8 tempest-ShareTransferTest-320553121 tempest-ShareTransferTest-320553121-project-member] Created reservations ['2e3f5442-65a4-4d13-bbfd-8d3aa99cf07d', 'c247afab-5c26-4e1c-b195-7de3c0a61e82', '69bebdf3-1a2f-42b9-9bad-83e5e52e7ce5', '0921c95a-921b-4432-b3e9-43c0b683c0af'] {{(pid=98330) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 13:01:27 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.quota [None req-145d487c-abbe-487d-b838-c2215f33b9e8 tempest-ShareTransferTest-320553121 tempest-ShareTransferTest-320553121-project-member] Committed reservations ['2e3f5442-65a4-4d13-bbfd-8d3aa99cf07d', 'c247afab-5c26-4e1c-b195-7de3c0a61e82', '69bebdf3-1a2f-42b9-9bad-83e5e52e7ce5', '0921c95a-921b-4432-b3e9-43c0b683c0af'] {{(pid=98330) commit /opt/stack/manila/manila/quota.py:1063}} May 28 13:01:27 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.host_manager [None req-145d487c-abbe-487d-b838-c2215f33b9e8 tempest-ShareTransferTest-320553121 None] Share service is down. (host: l75lg1-v1@generic2). May 28 13:01:27 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.host_manager [None req-145d487c-abbe-487d-b838-c2215f33b9e8 tempest-ShareTransferTest-320553121 None] Share service is down. (host: l75lg1-v1@generic1). May 28 13:01:27 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-145d487c-abbe-487d-b838-c2215f33b9e8 tempest-ShareTransferTest-320553121 None] Starting with 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:80}} May 28 13:01:27 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-145d487c-abbe-487d-b838-c2215f33b9e8 tempest-ShareTransferTest-320553121 None] Filter OnlyHostFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:01:27 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-145d487c-abbe-487d-b838-c2215f33b9e8 tempest-ShareTransferTest-320553121 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:01:27 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.capacity [None req-145d487c-abbe-487d-b838-c2215f33b9e8 tempest-ShareTransferTest-320553121 None] Space information for share creation on host l75lg1-v1@vast#vast (requested / avail): 1/2077 {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/capacity.py:83}} May 28 13:01:27 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-145d487c-abbe-487d-b838-c2215f33b9e8 tempest-ShareTransferTest-320553121 None] Filter CapacityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:01:27 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-145d487c-abbe-487d-b838-c2215f33b9e8 tempest-ShareTransferTest-320553121 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:01:27 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-145d487c-abbe-487d-b838-c2215f33b9e8 tempest-ShareTransferTest-320553121 None] Driver Filter: Checking host 'l75lg1-v1@vast#vast' {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:37}} May 28 13:01:27 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-145d487c-abbe-487d-b838-c2215f33b9e8 tempest-ShareTransferTest-320553121 None] Filter function not set :: passing host. {{(pid=98327) _check_filter_function /opt/stack/manila/manila/scheduler/filters/driver.py:53}} May 28 13:01:27 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-145d487c-abbe-487d-b838-c2215f33b9e8 tempest-ShareTransferTest-320553121 None] Result: True {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:40}} May 28 13:01:27 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-145d487c-abbe-487d-b838-c2215f33b9e8 tempest-ShareTransferTest-320553121 None] Done checking host 'l75lg1-v1@vast#vast' {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:41}} May 28 13:01:27 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-145d487c-abbe-487d-b838-c2215f33b9e8 tempest-ShareTransferTest-320553121 None] Filter DriverFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:01:27 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-145d487c-abbe-487d-b838-c2215f33b9e8 tempest-ShareTransferTest-320553121 None] Filter ShareReplicationFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:01:27 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-145d487c-abbe-487d-b838-c2215f33b9e8 tempest-ShareTransferTest-320553121 None] Filter CreateFromSnapshotFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:01:27 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-145d487c-abbe-487d-b838-c2215f33b9e8 tempest-ShareTransferTest-320553121 None] Filter AffinityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:01:27 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-145d487c-abbe-487d-b838-c2215f33b9e8 tempest-ShareTransferTest-320553121 None] Filter AntiAffinityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:01:27 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.drivers.filter [None req-145d487c-abbe-487d-b838-c2215f33b9e8 tempest-ShareTransferTest-320553121 None] Filtered share [host: 'l75lg1-v1@vast#vast', free_capacity_gb: 2077.6277076322585, pools: None] {{(pid=98327) _schedule_share /opt/stack/manila/manila/scheduler/drivers/filter.py:268}} May 28 13:01:27 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-145d487c-abbe-487d-b838-c2215f33b9e8 tempest-ShareTransferTest-320553121 None] Checking host 'l75lg1-v1@vast#vast' {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:46}} May 28 13:01:27 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.weighers.goodness [None req-145d487c-abbe-487d-b838-c2215f33b9e8 tempest-ShareTransferTest-320553121 None] Goodness function not set :: defaulting to minimal goodness rating of 0. May 28 13:01:27 l75lg1-v1 manila-scheduler[98327]: INFO manila.scheduler.weighers.goodness [None req-145d487c-abbe-487d-b838-c2215f33b9e8 tempest-ShareTransferTest-320553121 None] Goodness function result for host l75lg1-v1@vast#vast: 0. May 28 13:01:27 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-145d487c-abbe-487d-b838-c2215f33b9e8 tempest-ShareTransferTest-320553121 None] Goodness: 0 {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:48}} May 28 13:01:27 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-145d487c-abbe-487d-b838-c2215f33b9e8 tempest-ShareTransferTest-320553121 None] Done checking host 'l75lg1-v1@vast#vast' {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:49}} May 28 13:01:27 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.drivers.filter [None req-145d487c-abbe-487d-b838-c2215f33b9e8 tempest-ShareTransferTest-320553121 None] Choosing for share: WeighedHost [host: l75lg1-v1@vast#vast, weight: 0.0] {{(pid=98327) _schedule_share /opt/stack/manila/manila/scheduler/drivers/filter.py:274}} May 28 13:01:27 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-145d487c-abbe-487d-b838-c2215f33b9e8 tempest-ShareTransferTest-320553121 tempest-ShareTransferTest-320553121-project-member] http://10.27.203.238/share/v2/bece16f41fc44d55bf7bc45c2adaaed5/shares returned with HTTP 200 May 28 13:01:27 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1111/2247] 10.27.203.238 () {66 vars in 1362 bytes} [Tue May 28 13:01:27 2024] POST /share/v2/bece16f41fc44d55bf7bc45c2adaaed5/shares => generated 1311 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:01:27 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-68dc892f-c1d6-4d5c-a817-b4fd527087d4 tempest-ShareTransferTest-320553121 tempest-ShareTransferTest-320553121-project-member] GET http://10.27.203.238/share/v2/bece16f41fc44d55bf7bc45c2adaaed5/shares/3e8f600a-428f-49ef-9c9b-ce57939ca004 May 28 13:01:27 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-68dc892f-c1d6-4d5c-a817-b4fd527087d4 tempest-ShareTransferTest-320553121 tempest-ShareTransferTest-320553121-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:27 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ff6e841f-ba7b-449c-a783-b92c78fb92db tempest-SharesNFSTest-667257547 None] <<< [POST] https://127.0.0.1:40443/api/quotas/ May 28 13:01:27 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ff6e841f-ba7b-449c-a783-b92c78fb92db tempest-SharesNFSTest-667257547 None] Bunch(cluster='loop75-kfs', cluster_id=1, default_email=None, default_group_quota=None, default_user_quota=None, enable_alarms=True, enable_email_providers=True, grace_period=None, group_quotas=[], guid='093553e4-28fc-49bf-92b6-8eebc68f582e', hard_limit=1073741824, hard_limit_inodes=None, id=48, internal=False, is_user_quota=False, last_user_quotas_update=None, name='55a40e09-c80d-48da-95b1-a670d27b1414', num_blocked_users=0, num_exceeded_users=0, path='/manila/manila-55a40e09-c80d-48da-95b1-a670d27b1414', percent_capacity=0, percent_inodes=None, pretty_grace_period=None, pretty_grace_period_expiration=None, pretty_state='OK (CREATED)', soft_limit=None, soft_limit_inodes=None, state='OK', sync_state='CREATED', system_id=48, tenant_id=1, tenant_name='default', time_to_block=None, title='55a40e09-c80d-48da-95b1-a670d27b1414', url='https://127.0.0.1:40443/api/quotas/48/', used_capacity=0, used_capacity_tb=0.0, used_effective_capacity=0, used_effective_capacity_tb=0.0, used_inodes=0, used_limited_capacity=0, user_quotas=[]) May 28 13:01:27 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-68dc892f-c1d6-4d5c-a817-b4fd527087d4 tempest-ShareTransferTest-320553121 tempest-ShareTransferTest-320553121-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:27 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ff6e841f-ba7b-449c-a783-b92c78fb92db tempest-SharesNFSTest-667257547 None] --- [POST] https://127.0.0.1:40443/api/quotas/: Done May 28 13:01:27 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ff6e841f-ba7b-449c-a783-b92c78fb92db tempest-SharesNFSTest-667257547 None] >>> [GET] https://127.0.0.1:40443/api/views/ May 28 13:01:27 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ff6e841f-ba7b-449c-a783-b92c78fb92db tempest-SharesNFSTest-667257547 None] {'allow_redirects': True, May 28 13:01:27 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ff6e841f-ba7b-449c-a783-b92c78fb92db tempest-SharesNFSTest-667257547 None] 'params': {'name': '55a40e09-c80d-48da-95b1-a670d27b1414'}} May 28 13:01:27 l75lg1-v1 sudo[99156]: pam_unix(sudo:session): session closed for user root May 28 13:01:27 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.489s {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:428}} May 28 13:01:27 l75lg1-v1 cinder-volume[85846]: DEBUG cinder.manager [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] Notifying Schedulers of capabilities ... {{(pid=85846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 28 13:01:27 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.scheduler.host_manager [None req-2c190569-8f29-4b9c-b413-1baa0f4a0198 None None] Received volume service update from l75lg1-v1@lvmdriver-1: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:l75lg1-v1:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up', 'allocated_capacity_gb': 0, 'cacheable': True}], 'shared_targets': False, 'sparse_copy_volume': True, 'filter_function': None, 'goodness_function': None} {{(pid=85128) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:628}} May 28 13:01:27 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-68dc892f-c1d6-4d5c-a817-b4fd527087d4 tempest-ShareTransferTest-320553121 tempest-ShareTransferTest-320553121-project-member] http://10.27.203.238/share/v2/bece16f41fc44d55bf7bc45c2adaaed5/shares/3e8f600a-428f-49ef-9c9b-ce57939ca004 returned with HTTP 200 May 28 13:01:27 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1137/2248] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:01:27 2024] GET /share/v2/bece16f41fc44d55bf7bc45c2adaaed5/shares/3e8f600a-428f-49ef-9c9b-ce57939ca004 => generated 1311 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:01:27 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-145d487c-abbe-487d-b838-c2215f33b9e8 tempest-ShareTransferTest-320553121 None] >>> [GET] https://127.0.0.1:40443/api/vippools/ May 28 13:01:27 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-145d487c-abbe-487d-b838-c2215f33b9e8 tempest-ShareTransferTest-320553121 None] {'allow_redirects': True, 'params': {'name': 'vippool-1'}} May 28 13:01:27 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ae348258-c7a9-4c41-94a5-aa565c59e244 tempest-ShareTypeAvailabilityZonesTest-364532124 None] <<< [DELETE] https://127.0.0.1:40443/api/views/49/ May 28 13:01:27 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ae348258-c7a9-4c41-94a5-aa565c59e244 tempest-ShareTypeAvailabilityZonesTest-364532124 None] --- [DELETE] https://127.0.0.1:40443/api/views/49/: Done May 28 13:01:27 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ae348258-c7a9-4c41-94a5-aa565c59e244 tempest-ShareTypeAvailabilityZonesTest-364532124 None] >>> [GET] https://127.0.0.1:40443/api/quotas/ May 28 13:01:27 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ae348258-c7a9-4c41-94a5-aa565c59e244 tempest-ShareTypeAvailabilityZonesTest-364532124 None] {'allow_redirects': True, May 28 13:01:27 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ae348258-c7a9-4c41-94a5-aa565c59e244 tempest-ShareTypeAvailabilityZonesTest-364532124 None] 'params': {'name': '62476a26-faf7-4184-83e5-45ec72b91d6e'}} May 28 13:01:28 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ff6e841f-ba7b-449c-a783-b92c78fb92db tempest-SharesNFSTest-667257547 None] <<< [GET] https://127.0.0.1:40443/api/views/ May 28 13:01:28 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ff6e841f-ba7b-449c-a783-b92c78fb92db tempest-SharesNFSTest-667257547 None] [] May 28 13:01:28 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ff6e841f-ba7b-449c-a783-b92c78fb92db tempest-SharesNFSTest-667257547 None] --- [GET] https://127.0.0.1:40443/api/views/: Done May 28 13:01:28 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ff6e841f-ba7b-449c-a783-b92c78fb92db tempest-SharesNFSTest-667257547 None] >>> [POST] https://127.0.0.1:40443/api/views/ May 28 13:01:28 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ff6e841f-ba7b-449c-a783-b92c78fb92db tempest-SharesNFSTest-667257547 None] {'data': '{"name": "55a40e09-c80d-48da-95b1-a670d27b1414", "path": ' May 28 13:01:28 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ff6e841f-ba7b-449c-a783-b92c78fb92db tempest-SharesNFSTest-667257547 None] '"/manila/manila-55a40e09-c80d-48da-95b1-a670d27b1414", "policy_id": ' May 28 13:01:28 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ff6e841f-ba7b-449c-a783-b92c78fb92db tempest-SharesNFSTest-667257547 None] '51, "create_dir": true, "protocols": ["NFS"]}', May 28 13:01:28 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ff6e841f-ba7b-449c-a783-b92c78fb92db tempest-SharesNFSTest-667257547 None] 'json': None, May 28 13:01:28 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ff6e841f-ba7b-449c-a783-b92c78fb92db tempest-SharesNFSTest-667257547 None] 'params': None} May 28 13:01:28 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-145d487c-abbe-487d-b838-c2215f33b9e8 tempest-ShareTransferTest-320553121 None] <<< [GET] https://127.0.0.1:40443/api/vippools/ May 28 13:01:28 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-145d487c-abbe-487d-b838-c2215f33b9e8 tempest-ShareTransferTest-320553121 None] [Bunch(active_cnode_ids=[], active_interfaces=4, cluster='loop75-kfs', cluster_id=1, cnode_ids=[], cnodes=[], domain_name='vippool-1', enable_l3=False, enable_weighted_balancing=False, enabled=True, end_ip='172.21.75.4', guid='f2abaede-b397-413a-8faa-3aeead6d3b28', gw_ip='', gw_ipv6='', id=2, ip_ranges=[['172.21.75.1', '172.21.75.4']], name='vippool-1', peer_asn=0, port_membership='ALL', ranges_summary='172.21.75.[1-4]', role='PROTOCOLS', start_ip='172.21.75.1', subnet_cidr=16, subnet_cidr_ipv6=None, sync='SYNCED', sync_time='2024-05-28T12:50:09.644123Z', tenant_id=1, tenant_name='default', title='172.21.75.1 - 172.21.75.4', url='https://127.0.0.1:40443/api/vippools/2/', vast_asn=0, vlan=0, vms_preferred=False)] May 28 13:01:28 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-145d487c-abbe-487d-b838-c2215f33b9e8 tempest-ShareTransferTest-320553121 None] --- [GET] https://127.0.0.1:40443/api/vippools/: Done May 28 13:01:28 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-145d487c-abbe-487d-b838-c2215f33b9e8 tempest-ShareTransferTest-320553121 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:01:28 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-145d487c-abbe-487d-b838-c2215f33b9e8 tempest-ShareTransferTest-320553121 None] {'allow_redirects': True, May 28 13:01:28 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-145d487c-abbe-487d-b838-c2215f33b9e8 tempest-ShareTransferTest-320553121 None] 'params': {'name': '8b23337a-8316-428a-8f0b-4c29a85c8409'}} May 28 13:01:28 l75lg1-v1 dstat.sh[49771]: 28-05 13:01:28| 12 2 84 2 0|5703M 1733M 278M 7910M| 17k 4970B| 256k 2540k|2.00 218 |6062 9659 |1.51 1.24 1.08|1.0 1.0 11| 0 0 | 0 2048M| 29 363 0 41 2 May 28 13:01:28 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-5efde801-688e-4640-b77e-7033e3a86b10 tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] GET http://10.27.203.238/share/v2/284d76edec3144579d6fb3f6dbc0dd4e/shares/553b74f3-3a9b-40ad-b4b1-d5648684cbf4 May 28 13:01:28 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-5efde801-688e-4640-b77e-7033e3a86b10 tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:28 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-5efde801-688e-4640-b77e-7033e3a86b10 tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:28 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-5efde801-688e-4640-b77e-7033e3a86b10 tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] http://10.27.203.238/share/v2/284d76edec3144579d6fb3f6dbc0dd4e/shares/553b74f3-3a9b-40ad-b4b1-d5648684cbf4 returned with HTTP 200 May 28 13:01:28 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1112/2249] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:01:28 2024] GET /share/v2/284d76edec3144579d6fb3f6dbc0dd4e/shares/553b74f3-3a9b-40ad-b4b1-d5648684cbf4 => generated 1315 bytes in 25 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:01:28 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ae348258-c7a9-4c41-94a5-aa565c59e244 tempest-ShareTypeAvailabilityZonesTest-364532124 None] <<< [GET] https://127.0.0.1:40443/api/quotas/ May 28 13:01:28 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ae348258-c7a9-4c41-94a5-aa565c59e244 tempest-ShareTypeAvailabilityZonesTest-364532124 None] [Bunch(cluster='loop75-kfs', cluster_id=1, default_email=None, default_group_quota=None, default_user_quota=None, enable_alarms=True, enable_email_providers=True, grace_period=None, guid='72d06e3e-2c79-450e-b533-2c13d2ea0ceb', hard_limit=1073741824, hard_limit_inodes=None, id=47, internal=False, is_user_quota=False, last_user_quotas_update=None, name='62476a26-faf7-4184-83e5-45ec72b91d6e', num_blocked_users=0, num_exceeded_users=0, path='/manila/manila-62476a26-faf7-4184-83e5-45ec72b91d6e', percent_capacity=0, percent_inodes=None, pretty_grace_period=None, pretty_grace_period_expiration=None, pretty_state='OK (CREATED)', soft_limit=None, soft_limit_inodes=None, state='OK', sync_state='CREATED', system_id=47, tenant_id=1, tenant_name='default', time_to_block=None, title='62476a26-faf7-4184-83e5-45ec72b91d6e', url='https://127.0.0.1:40443/api/quotas/47/', used_capacity=0, used_capacity_tb=0.0, used_effective_capacity=0, used_effective_capacity_tb=0.0, used_inodes=0, used_limited_capacity=0)] May 28 13:01:28 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ae348258-c7a9-4c41-94a5-aa565c59e244 tempest-ShareTypeAvailabilityZonesTest-364532124 None] --- [GET] https://127.0.0.1:40443/api/quotas/: Done May 28 13:01:28 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ae348258-c7a9-4c41-94a5-aa565c59e244 tempest-ShareTypeAvailabilityZonesTest-364532124 None] >>> [DELETE] https://127.0.0.1:40443/api/quotas/47/ May 28 13:01:28 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-145d487c-abbe-487d-b838-c2215f33b9e8 tempest-ShareTransferTest-320553121 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:01:28 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-145d487c-abbe-487d-b838-c2215f33b9e8 tempest-ShareTransferTest-320553121 None] [] May 28 13:01:28 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-145d487c-abbe-487d-b838-c2215f33b9e8 tempest-ShareTransferTest-320553121 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 13:01:28 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-145d487c-abbe-487d-b838-c2215f33b9e8 tempest-ShareTransferTest-320553121 None] >>> [POST] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:01:28 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-145d487c-abbe-487d-b838-c2215f33b9e8 tempest-ShareTransferTest-320553121 None] {'data': '{"name": "8b23337a-8316-428a-8f0b-4c29a85c8409"}', May 28 13:01:28 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-145d487c-abbe-487d-b838-c2215f33b9e8 tempest-ShareTransferTest-320553121 None] 'json': None, May 28 13:01:28 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-145d487c-abbe-487d-b838-c2215f33b9e8 tempest-ShareTransferTest-320553121 None] 'params': None} May 28 13:01:29 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-cd563bca-39b7-465c-8326-3f00978098a9 tempest-ShareRulesTest-1530341375 None] <<< [PATCH] https://127.0.0.1:40443/api/viewpolicies/38/ May 28 13:01:29 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-cd563bca-39b7-465c-8326-3f00978098a9 tempest-ShareRulesTest-1530341375 None] Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=1, created='2024-05-28T12:59:53.824250Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='0fa84ccd-850f-48fa-a965-23e5abe31188', id=38, internal=False, is_s3_default_policy=False, name='f7e47502-a0f7-44de-953d-b7b5697ae0b2', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=['*'], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['203.0.113.77'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['203.0.113.77'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='MODIFYING', sync_time='2024-05-28T13:01:28.452430Z', tenant_id=1, tenant_name='default', title='f7e47502-a0f7-44de-953d-b7b5697ae0b2', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/38/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[]) May 28 13:01:29 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-cd563bca-39b7-465c-8326-3f00978098a9 tempest-ShareRulesTest-1530341375 None] --- [PATCH] https://127.0.0.1:40443/api/viewpolicies/38/: Done May 28 13:01:29 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-cd563bca-39b7-465c-8326-3f00978098a9 tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:01:29 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-cd563bca-39b7-465c-8326-3f00978098a9 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:01:29 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-cd563bca-39b7-465c-8326-3f00978098a9 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.064s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:01:29 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-cd563bca-39b7-465c-8326-3f00978098a9 tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:01:29 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-cd563bca-39b7-465c-8326-3f00978098a9 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:01:29 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-cd563bca-39b7-465c-8326-3f00978098a9 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:01:29 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-cd563bca-39b7-465c-8326-3f00978098a9 tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:01:29 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-cd563bca-39b7-465c-8326-3f00978098a9 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:01:29 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-cd563bca-39b7-465c-8326-3f00978098a9 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:01:29 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-cd563bca-39b7-465c-8326-3f00978098a9 tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:01:29 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-cd563bca-39b7-465c-8326-3f00978098a9 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:01:29 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-cd563bca-39b7-465c-8326-3f00978098a9 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:01:29 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-cd563bca-39b7-465c-8326-3f00978098a9 tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:01:29 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-cd563bca-39b7-465c-8326-3f00978098a9 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:01:29 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-cd563bca-39b7-465c-8326-3f00978098a9 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.043s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:01:29 l75lg1-v1 manila-share[98474]: INFO manila.share.access [None req-cd563bca-39b7-465c-8326-3f00978098a9 tempest-ShareRulesTest-1530341375 None] Access rules were successfully modified for share instance f7e47502-a0f7-44de-953d-b7b5697ae0b2 belonging to share b330db31-7766-443d-9c19-26fe349665aa. May 28 13:01:29 l75lg1-v1 dstat.sh[49771]: 28-05 13:01:29| 2 0 96 1 0|5703M 1733M 278M 7910M| 20k 1720B| 0 1164k| 0 99.0 |2483 3864 |1.51 1.24 1.08| 0 1.0 0| 0 0 | 0 2048M| 29 363 0 37 2 May 28 13:01:29 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ff6e841f-ba7b-449c-a783-b92c78fb92db tempest-SharesNFSTest-667257547 None] <<< [POST] https://127.0.0.1:40443/api/views/ May 28 13:01:29 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ff6e841f-ba7b-449c-a783-b92c78fb92db tempest-SharesNFSTest-667257547 None] Bunch(abac_tags=[], abe_max_depth=None, abe_protocols=[], alias='', allow_anonymous_access=False, allow_s3_anonymous_access=False, auto_commit='0d', bucket='', bucket_creators=[], bucket_creators_groups=[], bucket_owner=None, bulk_permission_update_progress=None, bulk_permission_update_state=None, cluster='loop75-kfs', cluster_id=1, created='2024-05-28T13:01:28.979379Z', enabled=True, files_retention_mode='NONE', guid='241d1ba9-99ed-4502-ad71-38e7b9269671', id=50, ignore_oos=False, internal=False, is_remote=False, is_seamless=False, logical_capacity=0, max_retention_period=None, min_retention_period=None, name='55a40e09-c80d-48da-95b1-a670d27b1414', nfs_interop_flags='BOTH_NFS3_AND_NFS4_INTEROP_DISABLED', path='/manila/manila-55a40e09-c80d-48da-95b1-a670d27b1414', physical_capacity=0, policy='55a40e09-c80d-48da-95b1-a670d27b1414', policy_id=51, protocols=['NFS'], qos_policy=None, qos_policy_id=None, s3_locks=False, s3_locks_retention_mode='NONE', s3_locks_retention_period='', s3_object_ownership_rule='ObjectWriter', s3_unverified_lookup=False, s3_versioning=False, select_for_live_monitoring=False, share='', share_acl=Bunch(acl=[], enabled=False), sync='SYNCED', sync_time='2024-05-28T13:01:29.314557Z', tenant_id=1, tenant_name='default', title='/manila/manila-55a40e09-c80d-48da-95b1-a670d27b1414', url='https://127.0.0.1:40443/api/views/50/') May 28 13:01:29 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ff6e841f-ba7b-449c-a783-b92c78fb92db tempest-SharesNFSTest-667257547 None] --- [POST] https://127.0.0.1:40443/api/views/: Done May 28 13:01:29 l75lg1-v1 manila-share[98474]: INFO manila.share.manager [None req-ff6e841f-ba7b-449c-a783-b92c78fb92db tempest-SharesNFSTest-667257547 None] Share instance 55a40e09-c80d-48da-95b1-a670d27b1414 created successfully. May 28 13:01:29 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-145d487c-abbe-487d-b838-c2215f33b9e8 tempest-ShareTransferTest-320553121 None] <<< [POST] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:01:29 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-145d487c-abbe-487d-b838-c2215f33b9e8 tempest-ShareTransferTest-320553121 None] Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=0, created='2024-05-28T13:01:29.038608Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='db9ac8a9-808f-4bcb-9f18-a660fbbc086f', id=52, internal=False, is_s3_default_policy=False, name='8b23337a-8316-428a-8f0b-4c29a85c8409', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=[], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['*'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['*'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T13:01:29.391116Z', tenant_id=1, tenant_name='default', title='8b23337a-8316-428a-8f0b-4c29a85c8409', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/52/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[]) May 28 13:01:29 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-145d487c-abbe-487d-b838-c2215f33b9e8 tempest-ShareTransferTest-320553121 None] --- [POST] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 13:01:29 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-145d487c-abbe-487d-b838-c2215f33b9e8 tempest-ShareTransferTest-320553121 None] >>> [GET] https://127.0.0.1:40443/api/quotas/ May 28 13:01:29 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-145d487c-abbe-487d-b838-c2215f33b9e8 tempest-ShareTransferTest-320553121 None] {'allow_redirects': True, May 28 13:01:29 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-145d487c-abbe-487d-b838-c2215f33b9e8 tempest-ShareTransferTest-320553121 None] 'params': {'name': '8b23337a-8316-428a-8f0b-4c29a85c8409'}} May 28 13:01:29 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-86424f80-0144-4367-8014-10b683ab4150 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] POST http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/shares/b330db31-7766-443d-9c19-26fe349665aa/action May 28 13:01:29 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-86424f80-0144-4367-8014-10b683ab4150 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Action body: b'{"access_list": null}' {{(pid=98329) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 13:01:29 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-86424f80-0144-4367-8014-10b683ab4150 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Action: 'action', calling method: ShareController.access_list, body: {"access_list": null} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:01:29 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-86424f80-0144-4367-8014-10b683ab4150 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/shares/b330db31-7766-443d-9c19-26fe349665aa/action returned with HTTP 200 May 28 13:01:29 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1138/2250] 10.27.203.238 () {66 vars in 1493 bytes} [Tue May 28 13:01:29 2024] POST /share/v2/a4f3887fa28c457390f5b66615564430/shares/b330db31-7766-443d-9c19-26fe349665aa/action => generated 176 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 231 bytes (2 switches on core 0) May 28 13:01:29 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-d7bcfc16-98a5-4479-aef9-bed8176ebbb7 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] POST http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/shares/b330db31-7766-443d-9c19-26fe349665aa/action May 28 13:01:29 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-d7bcfc16-98a5-4479-aef9-bed8176ebbb7 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Action body: b'{"access_list": null}' {{(pid=98330) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 13:01:29 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-d7bcfc16-98a5-4479-aef9-bed8176ebbb7 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Action: 'action', calling method: ShareController.access_list, body: {"access_list": null} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:01:30 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-d7bcfc16-98a5-4479-aef9-bed8176ebbb7 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/shares/b330db31-7766-443d-9c19-26fe349665aa/action returned with HTTP 200 May 28 13:01:30 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1113/2251] 10.27.203.238 () {66 vars in 1493 bytes} [Tue May 28 13:01:29 2024] POST /share/v2/a4f3887fa28c457390f5b66615564430/shares/b330db31-7766-443d-9c19-26fe349665aa/action => generated 176 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:01:30 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-456ac9cc-688e-4efb-a974-d1aa6ffcebe9 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] POST http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/shares/b330db31-7766-443d-9c19-26fe349665aa/action May 28 13:01:30 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-456ac9cc-688e-4efb-a974-d1aa6ffcebe9 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Action body: b'{"deny_access": {"access_id": "3c84ef61-955c-4607-882f-0633c69e0759"}}' {{(pid=98329) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 13:01:30 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-456ac9cc-688e-4efb-a974-d1aa6ffcebe9 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Action: 'action', calling method: ShareController.deny_access, body: {"deny_access": {"access_id": "3c84ef61-955c-4607-882f-0633c69e0759"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:01:30 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.lock.api [None req-456ac9cc-688e-4efb-a974-d1aa6ffcebe9 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Searching for locks by: {'resource_id': '3c84ef61-955c-4607-882f-0633c69e0759', 'resource_action': 'delete'} {{(pid=98329) get_all /opt/stack/manila/manila/lock/api.py:112}} May 28 13:01:30 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-145d487c-abbe-487d-b838-c2215f33b9e8 tempest-ShareTransferTest-320553121 None] <<< [GET] https://127.0.0.1:40443/api/quotas/ May 28 13:01:30 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-145d487c-abbe-487d-b838-c2215f33b9e8 tempest-ShareTransferTest-320553121 None] [] May 28 13:01:30 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-145d487c-abbe-487d-b838-c2215f33b9e8 tempest-ShareTransferTest-320553121 None] --- [GET] https://127.0.0.1:40443/api/quotas/: Done May 28 13:01:30 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-145d487c-abbe-487d-b838-c2215f33b9e8 tempest-ShareTransferTest-320553121 None] >>> [POST] https://127.0.0.1:40443/api/quotas/ May 28 13:01:30 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-145d487c-abbe-487d-b838-c2215f33b9e8 tempest-ShareTransferTest-320553121 None] {'data': '{"name": "8b23337a-8316-428a-8f0b-4c29a85c8409", "path": ' May 28 13:01:30 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-145d487c-abbe-487d-b838-c2215f33b9e8 tempest-ShareTransferTest-320553121 None] '"/manila/manila-8b23337a-8316-428a-8f0b-4c29a85c8409", "create_dir": ' May 28 13:01:30 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-145d487c-abbe-487d-b838-c2215f33b9e8 tempest-ShareTransferTest-320553121 None] 'true, "hard_limit": 1073741824}', May 28 13:01:30 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-145d487c-abbe-487d-b838-c2215f33b9e8 tempest-ShareTransferTest-320553121 None] 'json': None, May 28 13:01:30 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-145d487c-abbe-487d-b838-c2215f33b9e8 tempest-ShareTransferTest-320553121 None] 'params': None} May 28 13:01:30 l75lg1-v1 devstack@m-api.service[98329]: DEBUG oslo_concurrency.lockutils [None req-456ac9cc-688e-4efb-a974-d1aa6ffcebe9 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98329) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:01:30 l75lg1-v1 devstack@m-api.service[98329]: DEBUG oslo_concurrency.lockutils [None req-456ac9cc-688e-4efb-a974-d1aa6ffcebe9 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98329) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:01:30 l75lg1-v1 devstack@m-api.service[98329]: DEBUG oslo_concurrency.lockutils [None req-456ac9cc-688e-4efb-a974-d1aa6ffcebe9 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.063s {{(pid=98329) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:01:30 l75lg1-v1 devstack@m-api.service[98329]: DEBUG oslo_concurrency.lockutils [None req-456ac9cc-688e-4efb-a974-d1aa6ffcebe9 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98329) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:01:30 l75lg1-v1 devstack@m-api.service[98329]: DEBUG oslo_concurrency.lockutils [None req-456ac9cc-688e-4efb-a974-d1aa6ffcebe9 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98329) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:01:30 l75lg1-v1 devstack@m-api.service[98329]: DEBUG oslo_concurrency.lockutils [None req-456ac9cc-688e-4efb-a974-d1aa6ffcebe9 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.059s {{(pid=98329) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:01:30 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-456ac9cc-688e-4efb-a974-d1aa6ffcebe9 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/shares/b330db31-7766-443d-9c19-26fe349665aa/action returned with HTTP 202 May 28 13:01:30 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1139/2252] 10.27.203.238 () {66 vars in 1493 bytes} [Tue May 28 13:01:30 2024] POST /share/v2/a4f3887fa28c457390f5b66615564430/shares/b330db31-7766-443d-9c19-26fe349665aa/action => generated 0 bytes in 205 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 13:01:30 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-71481425-6066-4c29-a242-232e3a008c1b tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] GET http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/share-access-rules?share_id=b330db31-7766-443d-9c19-26fe349665aa May 28 13:01:30 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-71481425-6066-4c29-a242-232e3a008c1b tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:30 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-71481425-6066-4c29-a242-232e3a008c1b tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:30 l75lg1-v1 dstat.sh[49771]: 28-05 13:01:30| 4 1 93 2 0|5703M 1733M 278M 7910M| 17k 1735B| 0 1017k| 0 128 |3414 5822 |1.51 1.24 1.08|3.0 1.0 0| 0 0 | 0 2048M| 29 364 0 37 2 May 28 13:01:30 l75lg1-v1 manila-share[98474]: DEBUG manila.share.manager [None req-456ac9cc-688e-4efb-a974-d1aa6ffcebe9 tempest-ShareRulesTest-1530341375 None] Received request to update access for share instance f7e47502-a0f7-44de-953d-b7b5697ae0b2. {{(pid=98474) update_access_for_instances /opt/stack/manila/manila/share/manager.py:4353}} May 28 13:01:30 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.lock.api [None req-71481425-6066-4c29-a242-232e3a008c1b tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Searching for locks by: {'resource_id': '3c84ef61-955c-4607-882f-0633c69e0759', 'resource_action': 'show', 'resource_type': 'access_rule'} {{(pid=98330) get_all /opt/stack/manila/manila/lock/api.py:112}} May 28 13:01:30 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-456ac9cc-688e-4efb-a974-d1aa6ffcebe9 tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:01:30 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-456ac9cc-688e-4efb-a974-d1aa6ffcebe9 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:01:30 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-71481425-6066-4c29-a242-232e3a008c1b tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/share-access-rules?share_id=b330db31-7766-443d-9c19-26fe349665aa returned with HTTP 200 May 28 13:01:30 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1114/2253] 10.27.203.238 () {64 vars in 1467 bytes} [Tue May 28 13:01:30 2024] GET /share/v2/a4f3887fa28c457390f5b66615564430/share-access-rules?share_id=b330db31-7766-443d-9c19-26fe349665aa => generated 288 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:01:30 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-456ac9cc-688e-4efb-a974-d1aa6ffcebe9 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:01:30 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-456ac9cc-688e-4efb-a974-d1aa6ffcebe9 tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:01:30 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-456ac9cc-688e-4efb-a974-d1aa6ffcebe9 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:01:30 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-61a79a6b-41de-4f25-b195-329937dd4468 tempest-SharesNFSTest-667257547 tempest-SharesNFSTest-667257547-project-member] GET http://10.27.203.238/share/v2/0af6f8e0aeed4f27b075e08f2bc713aa/shares/b40e9810-7e36-4abf-afca-87c742ad83b1 May 28 13:01:30 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-61a79a6b-41de-4f25-b195-329937dd4468 tempest-SharesNFSTest-667257547 tempest-SharesNFSTest-667257547-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:30 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-61a79a6b-41de-4f25-b195-329937dd4468 tempest-SharesNFSTest-667257547 tempest-SharesNFSTest-667257547-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:30 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-61a79a6b-41de-4f25-b195-329937dd4468 tempest-SharesNFSTest-667257547 tempest-SharesNFSTest-667257547-project-member] http://10.27.203.238/share/v2/0af6f8e0aeed4f27b075e08f2bc713aa/shares/b40e9810-7e36-4abf-afca-87c742ad83b1 returned with HTTP 200 May 28 13:01:30 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1140/2254] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:01:30 2024] GET /share/v2/0af6f8e0aeed4f27b075e08f2bc713aa/shares/b40e9810-7e36-4abf-afca-87c742ad83b1 => generated 1314 bytes in 27 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:01:30 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-9fe4c006-7ade-445a-93ea-bf9c30165d14 tempest-SharesNFSTest-667257547 tempest-SharesNFSTest-667257547-project-member] GET http://10.27.203.238/share/v2/0af6f8e0aeed4f27b075e08f2bc713aa/shares/b40e9810-7e36-4abf-afca-87c742ad83b1 May 28 13:01:30 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-9fe4c006-7ade-445a-93ea-bf9c30165d14 tempest-SharesNFSTest-667257547 tempest-SharesNFSTest-667257547-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:30 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-9fe4c006-7ade-445a-93ea-bf9c30165d14 tempest-SharesNFSTest-667257547 tempest-SharesNFSTest-667257547-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:30 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-9fe4c006-7ade-445a-93ea-bf9c30165d14 tempest-SharesNFSTest-667257547 tempest-SharesNFSTest-667257547-project-member] http://10.27.203.238/share/v2/0af6f8e0aeed4f27b075e08f2bc713aa/shares/b40e9810-7e36-4abf-afca-87c742ad83b1 returned with HTTP 200 May 28 13:01:30 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1115/2255] 10.27.203.238 () {64 vars in 1450 bytes} [Tue May 28 13:01:30 2024] GET /share/v2/0af6f8e0aeed4f27b075e08f2bc713aa/shares/b40e9810-7e36-4abf-afca-87c742ad83b1 => generated 960 bytes in 24 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:01:30 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-456ac9cc-688e-4efb-a974-d1aa6ffcebe9 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.058s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:01:30 l75lg1-v1 manila-share[98474]: DEBUG manila.share.access [None req-456ac9cc-688e-4efb-a974-d1aa6ffcebe9 tempest-ShareRulesTest-1530341375 None] Updating access rules for share instance f7e47502-a0f7-44de-953d-b7b5697ae0b2 belonging to share b330db31-7766-443d-9c19-26fe349665aa. {{(pid=98474) update_access_rules /opt/stack/manila/manila/share/access.py:298}} May 28 13:01:30 l75lg1-v1 neutron-server[77618]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.HashRingHealthCheckPeriodics.touch_hash_ring_nodes' {{(pid=77618) _process_scheduled /opt/stack/data/venv/lib/python3.10/site-packages/futurist/periodics.py:638}} May 28 13:01:30 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-1320920e-75f8-4b5f-81e6-c22e4ef7d4d5 tempest-SharesNFSTest-667257547 tempest-SharesNFSTest-667257547-project-member] GET http://10.27.203.238/share/v2/0af6f8e0aeed4f27b075e08f2bc713aa/shares/b40e9810-7e36-4abf-afca-87c742ad83b1 May 28 13:01:30 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-1320920e-75f8-4b5f-81e6-c22e4ef7d4d5 tempest-SharesNFSTest-667257547 tempest-SharesNFSTest-667257547-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:30 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-1320920e-75f8-4b5f-81e6-c22e4ef7d4d5 tempest-SharesNFSTest-667257547 tempest-SharesNFSTest-667257547-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:30 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-456ac9cc-688e-4efb-a974-d1aa6ffcebe9 tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:01:30 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-456ac9cc-688e-4efb-a974-d1aa6ffcebe9 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:01:30 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-1320920e-75f8-4b5f-81e6-c22e4ef7d4d5 tempest-SharesNFSTest-667257547 tempest-SharesNFSTest-667257547-project-member] http://10.27.203.238/share/v2/0af6f8e0aeed4f27b075e08f2bc713aa/shares/b40e9810-7e36-4abf-afca-87c742ad83b1 returned with HTTP 200 May 28 13:01:30 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1141/2256] 10.27.203.238 () {64 vars in 1450 bytes} [Tue May 28 13:01:30 2024] GET /share/v2/0af6f8e0aeed4f27b075e08f2bc713aa/shares/b40e9810-7e36-4abf-afca-87c742ad83b1 => generated 987 bytes in 25 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:01:30 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-456ac9cc-688e-4efb-a974-d1aa6ffcebe9 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.007s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:01:30 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-456ac9cc-688e-4efb-a974-d1aa6ffcebe9 tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:01:30 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-456ac9cc-688e-4efb-a974-d1aa6ffcebe9 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:01:30 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-21564fc5-b45f-43a1-aebe-d2d0030cb5d9 tempest-SharesNFSTest-667257547 tempest-SharesNFSTest-667257547-project-member] GET http://10.27.203.238/share/v2/0af6f8e0aeed4f27b075e08f2bc713aa/shares/b40e9810-7e36-4abf-afca-87c742ad83b1 May 28 13:01:30 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-21564fc5-b45f-43a1-aebe-d2d0030cb5d9 tempest-SharesNFSTest-667257547 tempest-SharesNFSTest-667257547-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:30 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-21564fc5-b45f-43a1-aebe-d2d0030cb5d9 tempest-SharesNFSTest-667257547 tempest-SharesNFSTest-667257547-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:30 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-456ac9cc-688e-4efb-a974-d1aa6ffcebe9 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.017s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:01:30 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-456ac9cc-688e-4efb-a974-d1aa6ffcebe9 tempest-ShareRulesTest-1530341375 None] changing access on None May 28 13:01:30 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-456ac9cc-688e-4efb-a974-d1aa6ffcebe9 tempest-ShareRulesTest-1530341375 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:01:30 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-456ac9cc-688e-4efb-a974-d1aa6ffcebe9 tempest-ShareRulesTest-1530341375 None] {'allow_redirects': True, May 28 13:01:30 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-456ac9cc-688e-4efb-a974-d1aa6ffcebe9 tempest-ShareRulesTest-1530341375 None] 'params': {'name': 'f7e47502-a0f7-44de-953d-b7b5697ae0b2'}} May 28 13:01:30 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-21564fc5-b45f-43a1-aebe-d2d0030cb5d9 tempest-SharesNFSTest-667257547 tempest-SharesNFSTest-667257547-project-member] http://10.27.203.238/share/v2/0af6f8e0aeed4f27b075e08f2bc713aa/shares/b40e9810-7e36-4abf-afca-87c742ad83b1 returned with HTTP 200 May 28 13:01:30 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1116/2257] 10.27.203.238 () {64 vars in 1450 bytes} [Tue May 28 13:01:30 2024] GET /share/v2/0af6f8e0aeed4f27b075e08f2bc713aa/shares/b40e9810-7e36-4abf-afca-87c742ad83b1 => generated 891 bytes in 24 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:01:30 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-d160fb9f-d13a-463a-8cc4-051252e5c51b tempest-SharesNFSTest-667257547 tempest-SharesNFSTest-667257547-project-member] DELETE http://10.27.203.238/share/v2/0af6f8e0aeed4f27b075e08f2bc713aa/shares/b40e9810-7e36-4abf-afca-87c742ad83b1 May 28 13:01:30 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-d160fb9f-d13a-463a-8cc4-051252e5c51b tempest-SharesNFSTest-667257547 tempest-SharesNFSTest-667257547-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:30 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-d160fb9f-d13a-463a-8cc4-051252e5c51b tempest-SharesNFSTest-667257547 tempest-SharesNFSTest-667257547-project-member] Calling method 'ShareMixin.delete' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:30 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.v1.shares [None req-d160fb9f-d13a-463a-8cc4-051252e5c51b tempest-SharesNFSTest-667257547 tempest-SharesNFSTest-667257547-project-member] Delete share with id: b40e9810-7e36-4abf-afca-87c742ad83b1 May 28 13:01:30 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-d160fb9f-d13a-463a-8cc4-051252e5c51b tempest-SharesNFSTest-667257547 tempest-SharesNFSTest-667257547-project-member] http://10.27.203.238/share/v2/0af6f8e0aeed4f27b075e08f2bc713aa/shares/b40e9810-7e36-4abf-afca-87c742ad83b1 returned with HTTP 202 May 28 13:01:30 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1142/2258] 10.27.203.238 () {64 vars in 1454 bytes} [Tue May 28 13:01:30 2024] DELETE /share/v2/0af6f8e0aeed4f27b075e08f2bc713aa/shares/b40e9810-7e36-4abf-afca-87c742ad83b1 => generated 0 bytes in 128 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 13:01:30 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-665b45e0-f073-4d19-9c4c-cbb5ca597194 tempest-SharesNFSTest-667257547 tempest-SharesNFSTest-667257547-project-member] GET http://10.27.203.238/share/v2/0af6f8e0aeed4f27b075e08f2bc713aa/shares/b40e9810-7e36-4abf-afca-87c742ad83b1 May 28 13:01:30 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-665b45e0-f073-4d19-9c4c-cbb5ca597194 tempest-SharesNFSTest-667257547 tempest-SharesNFSTest-667257547-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:30 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-665b45e0-f073-4d19-9c4c-cbb5ca597194 tempest-SharesNFSTest-667257547 tempest-SharesNFSTest-667257547-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:30 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-665b45e0-f073-4d19-9c4c-cbb5ca597194 tempest-SharesNFSTest-667257547 tempest-SharesNFSTest-667257547-project-member] http://10.27.203.238/share/v2/0af6f8e0aeed4f27b075e08f2bc713aa/shares/b40e9810-7e36-4abf-afca-87c742ad83b1 returned with HTTP 200 May 28 13:01:30 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1117/2259] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:01:30 2024] GET /share/v2/0af6f8e0aeed4f27b075e08f2bc713aa/shares/b40e9810-7e36-4abf-afca-87c742ad83b1 => generated 1313 bytes in 29 msecs (HTTP/1.1 200) 6 headers in 232 bytes (2 switches on core 0) May 28 13:01:30 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-d160fb9f-d13a-463a-8cc4-051252e5c51b tempest-SharesNFSTest-667257547 None] Acquiring lock "locked_access_rules_operation_by_share_instance_55a40e09-c80d-48da-95b1-a670d27b1414" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:01:30 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-d160fb9f-d13a-463a-8cc4-051252e5c51b tempest-SharesNFSTest-667257547 None] Lock "locked_access_rules_operation_by_share_instance_55a40e09-c80d-48da-95b1-a670d27b1414" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:01:30 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-d160fb9f-d13a-463a-8cc4-051252e5c51b tempest-SharesNFSTest-667257547 None] Lock "locked_access_rules_operation_by_share_instance_55a40e09-c80d-48da-95b1-a670d27b1414" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:01:30 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-d160fb9f-d13a-463a-8cc4-051252e5c51b tempest-SharesNFSTest-667257547 None] Acquiring lock "locked_access_rules_operation_by_share_instance_55a40e09-c80d-48da-95b1-a670d27b1414" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:01:30 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-d160fb9f-d13a-463a-8cc4-051252e5c51b tempest-SharesNFSTest-667257547 None] Lock "locked_access_rules_operation_by_share_instance_55a40e09-c80d-48da-95b1-a670d27b1414" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:01:30 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-d160fb9f-d13a-463a-8cc4-051252e5c51b tempest-SharesNFSTest-667257547 None] Lock "locked_access_rules_operation_by_share_instance_55a40e09-c80d-48da-95b1-a670d27b1414" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:01:30 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-d160fb9f-d13a-463a-8cc4-051252e5c51b tempest-SharesNFSTest-667257547 None] Acquiring lock "locked_access_rules_operation_by_share_instance_55a40e09-c80d-48da-95b1-a670d27b1414" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:01:30 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-d160fb9f-d13a-463a-8cc4-051252e5c51b tempest-SharesNFSTest-667257547 None] Lock "locked_access_rules_operation_by_share_instance_55a40e09-c80d-48da-95b1-a670d27b1414" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:01:30 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-d160fb9f-d13a-463a-8cc4-051252e5c51b tempest-SharesNFSTest-667257547 None] Lock "locked_access_rules_operation_by_share_instance_55a40e09-c80d-48da-95b1-a670d27b1414" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:01:30 l75lg1-v1 manila-share[98474]: DEBUG manila.share.access [None req-d160fb9f-d13a-463a-8cc4-051252e5c51b tempest-SharesNFSTest-667257547 None] All access rules have been synced for share instance 55a40e09-c80d-48da-95b1-a670d27b1414 belonging to share b40e9810-7e36-4abf-afca-87c742ad83b1. {{(pid=98474) update_access_rules /opt/stack/manila/manila/share/access.py:304}} May 28 13:01:30 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-d160fb9f-d13a-463a-8cc4-051252e5c51b tempest-SharesNFSTest-667257547 None] deleting '/manila/manila-55a40e09-c80d-48da-95b1-a670d27b1414' May 28 13:01:30 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d160fb9f-d13a-463a-8cc4-051252e5c51b tempest-SharesNFSTest-667257547 None] >>> [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/ May 28 13:01:30 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d160fb9f-d13a-463a-8cc4-051252e5c51b tempest-SharesNFSTest-667257547 None] {'data': '{"path": "/manila/manila-55a40e09-c80d-48da-95b1-a670d27b1414"}', May 28 13:01:30 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d160fb9f-d13a-463a-8cc4-051252e5c51b tempest-SharesNFSTest-667257547 None] 'params': None} May 28 13:01:30 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d160fb9f-d13a-463a-8cc4-051252e5c51b tempest-SharesNFSTest-667257547 None] <<< [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/ May 28 13:01:30 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d160fb9f-d13a-463a-8cc4-051252e5c51b tempest-SharesNFSTest-667257547 None] 'OK' May 28 13:01:30 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d160fb9f-d13a-463a-8cc4-051252e5c51b tempest-SharesNFSTest-667257547 None] --- [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/: Done May 28 13:01:30 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d160fb9f-d13a-463a-8cc4-051252e5c51b tempest-SharesNFSTest-667257547 None] >>> [GET] https://127.0.0.1:40443/api/views/ May 28 13:01:30 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d160fb9f-d13a-463a-8cc4-051252e5c51b tempest-SharesNFSTest-667257547 None] {'allow_redirects': True, May 28 13:01:30 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d160fb9f-d13a-463a-8cc4-051252e5c51b tempest-SharesNFSTest-667257547 None] 'params': {'name': '55a40e09-c80d-48da-95b1-a670d27b1414'}} May 28 13:01:30 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-456ac9cc-688e-4efb-a974-d1aa6ffcebe9 tempest-ShareRulesTest-1530341375 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:01:30 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-456ac9cc-688e-4efb-a974-d1aa6ffcebe9 tempest-ShareRulesTest-1530341375 None] [Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=1, created='2024-05-28T12:59:53.824250Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='0fa84ccd-850f-48fa-a965-23e5abe31188', id=38, internal=False, is_s3_default_policy=False, name='f7e47502-a0f7-44de-953d-b7b5697ae0b2', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=['*'], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['203.0.113.77'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['203.0.113.77'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T13:01:28.878226Z', tenant_id=1, tenant_name='default', title='f7e47502-a0f7-44de-953d-b7b5697ae0b2', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/38/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[])] May 28 13:01:30 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-456ac9cc-688e-4efb-a974-d1aa6ffcebe9 tempest-ShareRulesTest-1530341375 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 13:01:30 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-456ac9cc-688e-4efb-a974-d1aa6ffcebe9 tempest-ShareRulesTest-1530341375 None] changing access on /manila/manila-f7e47502-a0f7-44de-953d-b7b5697ae0b2. Rules: {'nfs_read_write': [], 'nfs_read_only': []} May 28 13:01:30 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-456ac9cc-688e-4efb-a974-d1aa6ffcebe9 tempest-ShareRulesTest-1530341375 None] >>> [PATCH] https://127.0.0.1:40443/api/viewpolicies/38/ May 28 13:01:30 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-456ac9cc-688e-4efb-a974-d1aa6ffcebe9 tempest-ShareRulesTest-1530341375 None] {'data': '{"name": "f7e47502-a0f7-44de-953d-b7b5697ae0b2", "nfs_no_squash": ' May 28 13:01:30 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-456ac9cc-688e-4efb-a974-d1aa6ffcebe9 tempest-ShareRulesTest-1530341375 None] '["*"], "nfs_root_squash": ["*"], "nfs_read_write": [], ' May 28 13:01:30 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-456ac9cc-688e-4efb-a974-d1aa6ffcebe9 tempest-ShareRulesTest-1530341375 None] '"nfs_read_only": []}', May 28 13:01:30 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-456ac9cc-688e-4efb-a974-d1aa6ffcebe9 tempest-ShareRulesTest-1530341375 None] 'params': None} May 28 13:01:30 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-9b3aa177-cb90-4ccb-8978-31df2df9bef6 tempest-ShareTransferTest-320553121 tempest-ShareTransferTest-320553121-project-member] GET http://10.27.203.238/share/v2/bece16f41fc44d55bf7bc45c2adaaed5/shares/3e8f600a-428f-49ef-9c9b-ce57939ca004 May 28 13:01:30 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-9b3aa177-cb90-4ccb-8978-31df2df9bef6 tempest-ShareTransferTest-320553121 tempest-ShareTransferTest-320553121-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:30 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-9b3aa177-cb90-4ccb-8978-31df2df9bef6 tempest-ShareTransferTest-320553121 tempest-ShareTransferTest-320553121-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:30 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-145d487c-abbe-487d-b838-c2215f33b9e8 tempest-ShareTransferTest-320553121 None] <<< [POST] https://127.0.0.1:40443/api/quotas/ May 28 13:01:30 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-145d487c-abbe-487d-b838-c2215f33b9e8 tempest-ShareTransferTest-320553121 None] Bunch(cluster='loop75-kfs', cluster_id=1, default_email=None, default_group_quota=None, default_user_quota=None, enable_alarms=True, enable_email_providers=True, grace_period=None, group_quotas=[], guid='b84370c7-d353-4939-8d73-f8d028705b22', hard_limit=1073741824, hard_limit_inodes=None, id=49, internal=False, is_user_quota=False, last_user_quotas_update=None, name='8b23337a-8316-428a-8f0b-4c29a85c8409', num_blocked_users=0, num_exceeded_users=0, path='/manila/manila-8b23337a-8316-428a-8f0b-4c29a85c8409', percent_capacity=0, percent_inodes=None, pretty_grace_period=None, pretty_grace_period_expiration=None, pretty_state='OK (CREATED)', soft_limit=None, soft_limit_inodes=None, state='OK', sync_state='CREATED', system_id=49, tenant_id=1, tenant_name='default', time_to_block=None, title='8b23337a-8316-428a-8f0b-4c29a85c8409', url='https://127.0.0.1:40443/api/quotas/49/', used_capacity=0, used_capacity_tb=0.0, used_effective_capacity=0, used_effective_capacity_tb=0.0, used_inodes=0, used_limited_capacity=0, user_quotas=[]) May 28 13:01:30 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-145d487c-abbe-487d-b838-c2215f33b9e8 tempest-ShareTransferTest-320553121 None] --- [POST] https://127.0.0.1:40443/api/quotas/: Done May 28 13:01:30 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-145d487c-abbe-487d-b838-c2215f33b9e8 tempest-ShareTransferTest-320553121 None] >>> [GET] https://127.0.0.1:40443/api/views/ May 28 13:01:30 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-145d487c-abbe-487d-b838-c2215f33b9e8 tempest-ShareTransferTest-320553121 None] {'allow_redirects': True, May 28 13:01:30 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-145d487c-abbe-487d-b838-c2215f33b9e8 tempest-ShareTransferTest-320553121 None] 'params': {'name': '8b23337a-8316-428a-8f0b-4c29a85c8409'}} May 28 13:01:30 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-9b3aa177-cb90-4ccb-8978-31df2df9bef6 tempest-ShareTransferTest-320553121 tempest-ShareTransferTest-320553121-project-member] http://10.27.203.238/share/v2/bece16f41fc44d55bf7bc45c2adaaed5/shares/3e8f600a-428f-49ef-9c9b-ce57939ca004 returned with HTTP 200 May 28 13:01:30 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1143/2260] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:01:30 2024] GET /share/v2/bece16f41fc44d55bf7bc45c2adaaed5/shares/3e8f600a-428f-49ef-9c9b-ce57939ca004 => generated 1313 bytes in 26 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:01:31 l75lg1-v1 dstat.sh[49771]: 28-05 13:01:31| 6 0 91 1 0|5704M 1732M 278M 7910M| 15k 3916B| 0 1087k| 0 95.9 |3661 5819 |1.51 1.24 1.08|2.0 1.0 0| 0 0 | 0 2048M| 29 363 0 36 2 May 28 13:01:31 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-d4161fd7-1a0f-40c5-aaf4-c19549e7caa3 tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] GET http://10.27.203.238/share/v2/284d76edec3144579d6fb3f6dbc0dd4e/shares/553b74f3-3a9b-40ad-b4b1-d5648684cbf4 May 28 13:01:31 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-d4161fd7-1a0f-40c5-aaf4-c19549e7caa3 tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:31 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-d4161fd7-1a0f-40c5-aaf4-c19549e7caa3 tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:31 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-d4161fd7-1a0f-40c5-aaf4-c19549e7caa3 tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] http://10.27.203.238/share/v2/284d76edec3144579d6fb3f6dbc0dd4e/shares/553b74f3-3a9b-40ad-b4b1-d5648684cbf4 returned with HTTP 200 May 28 13:01:31 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1118/2261] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:01:31 2024] GET /share/v2/284d76edec3144579d6fb3f6dbc0dd4e/shares/553b74f3-3a9b-40ad-b4b1-d5648684cbf4 => generated 1315 bytes in 26 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:01:31 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d160fb9f-d13a-463a-8cc4-051252e5c51b tempest-SharesNFSTest-667257547 None] <<< [GET] https://127.0.0.1:40443/api/views/ May 28 13:01:31 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d160fb9f-d13a-463a-8cc4-051252e5c51b tempest-SharesNFSTest-667257547 None] [Bunch(abac_tags=[], abe_max_depth=None, abe_protocols=[], alias='', allow_anonymous_access=False, allow_s3_anonymous_access=False, auto_commit='0d', bucket='', bucket_creators=[], bucket_creators_groups=[], bucket_owner=None, bulk_permission_update_progress=None, bulk_permission_update_state=None, cluster='loop75-kfs', cluster_id=1, created='2024-05-28T13:01:28.979379Z', enabled=True, files_retention_mode='NONE', guid='241d1ba9-99ed-4502-ad71-38e7b9269671', id=50, ignore_oos=False, internal=False, is_remote=False, is_seamless=False, logical_capacity=0, max_retention_period=None, min_retention_period=None, name='55a40e09-c80d-48da-95b1-a670d27b1414', nfs_interop_flags='BOTH_NFS3_AND_NFS4_INTEROP_DISABLED', path='/manila/manila-55a40e09-c80d-48da-95b1-a670d27b1414', physical_capacity=0, policy='55a40e09-c80d-48da-95b1-a670d27b1414', policy_id=51, protocols=['NFS'], qos_policy=None, qos_policy_id=None, s3_locks=False, s3_locks_retention_mode='NONE', s3_locks_retention_period='', s3_unverified_lookup=False, s3_versioning=False, select_for_live_monitoring=False, share='', share_acl=Bunch(acl=[], enabled=False), sync='SYNCED', sync_time='2024-05-28T13:01:29.314557Z', tenant_id=1, tenant_name='default', title='/manila/manila-55a40e09-c80d-48da-95b1-a670d27b1414', url='https://127.0.0.1:40443/api/views/50/')] May 28 13:01:31 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d160fb9f-d13a-463a-8cc4-051252e5c51b tempest-SharesNFSTest-667257547 None] --- [GET] https://127.0.0.1:40443/api/views/: Done May 28 13:01:31 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d160fb9f-d13a-463a-8cc4-051252e5c51b tempest-SharesNFSTest-667257547 None] >>> [DELETE] https://127.0.0.1:40443/api/views/50/ May 28 13:01:31 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-145d487c-abbe-487d-b838-c2215f33b9e8 tempest-ShareTransferTest-320553121 None] <<< [GET] https://127.0.0.1:40443/api/views/ May 28 13:01:31 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-145d487c-abbe-487d-b838-c2215f33b9e8 tempest-ShareTransferTest-320553121 None] [] May 28 13:01:31 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-145d487c-abbe-487d-b838-c2215f33b9e8 tempest-ShareTransferTest-320553121 None] --- [GET] https://127.0.0.1:40443/api/views/: Done May 28 13:01:31 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-145d487c-abbe-487d-b838-c2215f33b9e8 tempest-ShareTransferTest-320553121 None] >>> [POST] https://127.0.0.1:40443/api/views/ May 28 13:01:31 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-145d487c-abbe-487d-b838-c2215f33b9e8 tempest-ShareTransferTest-320553121 None] {'data': '{"name": "8b23337a-8316-428a-8f0b-4c29a85c8409", "path": ' May 28 13:01:31 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-145d487c-abbe-487d-b838-c2215f33b9e8 tempest-ShareTransferTest-320553121 None] '"/manila/manila-8b23337a-8316-428a-8f0b-4c29a85c8409", "policy_id": ' May 28 13:01:31 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-145d487c-abbe-487d-b838-c2215f33b9e8 tempest-ShareTransferTest-320553121 None] '52, "create_dir": true, "protocols": ["NFS"]}', May 28 13:01:31 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-145d487c-abbe-487d-b838-c2215f33b9e8 tempest-ShareTransferTest-320553121 None] 'json': None, May 28 13:01:31 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-145d487c-abbe-487d-b838-c2215f33b9e8 tempest-ShareTransferTest-320553121 None] 'params': None} May 28 13:01:31 l75lg1-v1 neutron-server[77619]: DEBUG dbcounter [-] [77619] Writing DB stats neutron:SELECT=3 {{(pid=77619) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:01:31 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ae348258-c7a9-4c41-94a5-aa565c59e244 tempest-ShareTypeAvailabilityZonesTest-364532124 None] <<< [DELETE] https://127.0.0.1:40443/api/quotas/47/ May 28 13:01:31 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ae348258-c7a9-4c41-94a5-aa565c59e244 tempest-ShareTypeAvailabilityZonesTest-364532124 None] --- [DELETE] https://127.0.0.1:40443/api/quotas/47/: Done May 28 13:01:31 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ae348258-c7a9-4c41-94a5-aa565c59e244 tempest-ShareTypeAvailabilityZonesTest-364532124 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:01:31 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ae348258-c7a9-4c41-94a5-aa565c59e244 tempest-ShareTypeAvailabilityZonesTest-364532124 None] {'allow_redirects': True, May 28 13:01:31 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ae348258-c7a9-4c41-94a5-aa565c59e244 tempest-ShareTypeAvailabilityZonesTest-364532124 None] 'params': {'name': '62476a26-faf7-4184-83e5-45ec72b91d6e'}} May 28 13:01:32 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ae348258-c7a9-4c41-94a5-aa565c59e244 tempest-ShareTypeAvailabilityZonesTest-364532124 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:01:32 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ae348258-c7a9-4c41-94a5-aa565c59e244 tempest-ShareTypeAvailabilityZonesTest-364532124 None] [Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=0, created='2024-05-28T13:01:20.233558Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='0eeff5ee-7891-44ed-97d2-abb78004f837', id=50, internal=False, is_s3_default_policy=False, name='62476a26-faf7-4184-83e5-45ec72b91d6e', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=[], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['*'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['*'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T13:01:20.558698Z', tenant_id=1, tenant_name='default', title='62476a26-faf7-4184-83e5-45ec72b91d6e', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/50/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[])] May 28 13:01:32 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ae348258-c7a9-4c41-94a5-aa565c59e244 tempest-ShareTypeAvailabilityZonesTest-364532124 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 13:01:32 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ae348258-c7a9-4c41-94a5-aa565c59e244 tempest-ShareTypeAvailabilityZonesTest-364532124 None] >>> [DELETE] https://127.0.0.1:40443/api/viewpolicies/50/ May 28 13:01:32 l75lg1-v1 dstat.sh[49771]: 28-05 13:01:32| 1 1 96 1 0|5703M 1732M 278M 7910M| 19k 2976B| 0 1008k| 0 113 |2522 3850 |1.39 1.22 1.08|2.0 1.0 0| 0 0 | 0 2048M| 29 363 0 36 2 May 28 13:01:32 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-145d487c-abbe-487d-b838-c2215f33b9e8 tempest-ShareTransferTest-320553121 None] <<< [POST] https://127.0.0.1:40443/api/views/ May 28 13:01:32 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-145d487c-abbe-487d-b838-c2215f33b9e8 tempest-ShareTransferTest-320553121 None] Bunch(abac_tags=[], abe_max_depth=None, abe_protocols=[], alias='', allow_anonymous_access=False, allow_s3_anonymous_access=False, auto_commit='0d', bucket='', bucket_creators=[], bucket_creators_groups=[], bucket_owner=None, bulk_permission_update_progress=None, bulk_permission_update_state=None, cluster='loop75-kfs', cluster_id=1, created='2024-05-28T13:01:31.984260Z', enabled=True, files_retention_mode='NONE', guid='7ff778ed-69c7-4853-9348-cd244d05811a', id=51, ignore_oos=False, internal=False, is_remote=False, is_seamless=False, logical_capacity=0, max_retention_period=None, min_retention_period=None, name='8b23337a-8316-428a-8f0b-4c29a85c8409', nfs_interop_flags='BOTH_NFS3_AND_NFS4_INTEROP_DISABLED', path='/manila/manila-8b23337a-8316-428a-8f0b-4c29a85c8409', physical_capacity=0, policy='8b23337a-8316-428a-8f0b-4c29a85c8409', policy_id=52, protocols=['NFS'], qos_policy=None, qos_policy_id=None, s3_locks=False, s3_locks_retention_mode='NONE', s3_locks_retention_period='', s3_object_ownership_rule='ObjectWriter', s3_unverified_lookup=False, s3_versioning=False, select_for_live_monitoring=False, share='', share_acl=Bunch(acl=[], enabled=False), sync='SYNCED', sync_time='2024-05-28T13:01:32.279722Z', tenant_id=1, tenant_name='default', title='/manila/manila-8b23337a-8316-428a-8f0b-4c29a85c8409', url='https://127.0.0.1:40443/api/views/51/') May 28 13:01:32 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-145d487c-abbe-487d-b838-c2215f33b9e8 tempest-ShareTransferTest-320553121 None] --- [POST] https://127.0.0.1:40443/api/views/: Done May 28 13:01:32 l75lg1-v1 manila-share[98474]: INFO manila.share.manager [None req-145d487c-abbe-487d-b838-c2215f33b9e8 tempest-ShareTransferTest-320553121 None] Share instance 8b23337a-8316-428a-8f0b-4c29a85c8409 created successfully. May 28 13:01:32 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-456ac9cc-688e-4efb-a974-d1aa6ffcebe9 tempest-ShareRulesTest-1530341375 None] <<< [PATCH] https://127.0.0.1:40443/api/viewpolicies/38/ May 28 13:01:32 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-456ac9cc-688e-4efb-a974-d1aa6ffcebe9 tempest-ShareRulesTest-1530341375 None] Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=1, created='2024-05-28T12:59:53.824250Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='0fa84ccd-850f-48fa-a965-23e5abe31188', id=38, internal=False, is_s3_default_policy=False, name='f7e47502-a0f7-44de-953d-b7b5697ae0b2', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=['*'], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=[], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=[], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='MODIFYING', sync_time='2024-05-28T13:01:32.115607Z', tenant_id=1, tenant_name='default', title='f7e47502-a0f7-44de-953d-b7b5697ae0b2', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/38/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[]) May 28 13:01:32 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-456ac9cc-688e-4efb-a974-d1aa6ffcebe9 tempest-ShareRulesTest-1530341375 None] --- [PATCH] https://127.0.0.1:40443/api/viewpolicies/38/: Done May 28 13:01:32 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-456ac9cc-688e-4efb-a974-d1aa6ffcebe9 tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:01:32 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-456ac9cc-688e-4efb-a974-d1aa6ffcebe9 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:01:32 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-456ac9cc-688e-4efb-a974-d1aa6ffcebe9 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.030s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:01:32 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-456ac9cc-688e-4efb-a974-d1aa6ffcebe9 tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:01:32 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-456ac9cc-688e-4efb-a974-d1aa6ffcebe9 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:01:32 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-456ac9cc-688e-4efb-a974-d1aa6ffcebe9 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.028s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:01:32 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-456ac9cc-688e-4efb-a974-d1aa6ffcebe9 tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:01:32 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-456ac9cc-688e-4efb-a974-d1aa6ffcebe9 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:01:32 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-456ac9cc-688e-4efb-a974-d1aa6ffcebe9 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:01:32 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-456ac9cc-688e-4efb-a974-d1aa6ffcebe9 tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:01:32 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-456ac9cc-688e-4efb-a974-d1aa6ffcebe9 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:01:32 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-456ac9cc-688e-4efb-a974-d1aa6ffcebe9 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:01:32 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-456ac9cc-688e-4efb-a974-d1aa6ffcebe9 tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:01:32 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-456ac9cc-688e-4efb-a974-d1aa6ffcebe9 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:01:32 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-456ac9cc-688e-4efb-a974-d1aa6ffcebe9 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.037s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:01:32 l75lg1-v1 manila-share[98474]: INFO manila.share.access [None req-456ac9cc-688e-4efb-a974-d1aa6ffcebe9 tempest-ShareRulesTest-1530341375 None] Access rules were successfully modified for share instance f7e47502-a0f7-44de-953d-b7b5697ae0b2 belonging to share b330db31-7766-443d-9c19-26fe349665aa. May 28 13:01:33 l75lg1-v1 dstat.sh[49771]: 28-05 13:01:33| 2 0 96 2 0|5703M 1732M 278M 7910M| 17k 132B| 0 1032k| 0 116 |2774 4489 |1.39 1.22 1.08|1.0 1.0 0| 0 0 | 0 2048M| 29 363 0 35 2 May 28 13:01:33 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-8c85365e-df92-4927-9ac4-62a40800ca4d tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] GET http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/share-access-rules?share_id=b330db31-7766-443d-9c19-26fe349665aa May 28 13:01:33 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-8c85365e-df92-4927-9ac4-62a40800ca4d tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:33 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-8c85365e-df92-4927-9ac4-62a40800ca4d tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:33 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-8c85365e-df92-4927-9ac4-62a40800ca4d tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/share-access-rules?share_id=b330db31-7766-443d-9c19-26fe349665aa returned with HTTP 200 May 28 13:01:33 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1144/2262] 10.27.203.238 () {64 vars in 1467 bytes} [Tue May 28 13:01:33 2024] GET /share/v2/a4f3887fa28c457390f5b66615564430/share-access-rules?share_id=b330db31-7766-443d-9c19-26fe349665aa => generated 19 bytes in 30 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:01:33 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-9bedb6c0-82f4-4946-8b15-a40811d4e3ad tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] POST http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/shares/b330db31-7766-443d-9c19-26fe349665aa/action May 28 13:01:33 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-9bedb6c0-82f4-4946-8b15-a40811d4e3ad tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Action body: b'{"allow_access": {"access_type": "ip", "access_to": "203.0.113.77", "access_level": "rw"}}' {{(pid=98330) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 13:01:33 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-9bedb6c0-82f4-4946-8b15-a40811d4e3ad tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Action: 'action', calling method: ShareController.allow_access, body: {"allow_access": {"access_type": "ip", "access_to": "203.0.113.77", "access_level": "rw"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:01:33 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-9bedb6c0-82f4-4946-8b15-a40811d4e3ad tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:01:33 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-9bedb6c0-82f4-4946-8b15-a40811d4e3ad tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:01:33 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-9bedb6c0-82f4-4946-8b15-a40811d4e3ad tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.044s {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:01:33 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-9bedb6c0-82f4-4946-8b15-a40811d4e3ad tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/shares/b330db31-7766-443d-9c19-26fe349665aa/action returned with HTTP 200 May 28 13:01:33 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1119/2263] 10.27.203.238 () {66 vars in 1493 bytes} [Tue May 28 13:01:33 2024] POST /share/v2/a4f3887fa28c457390f5b66615564430/shares/b330db31-7766-443d-9c19-26fe349665aa/action => generated 230 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:01:33 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-1b91db21-93b6-4f7c-b85a-f9cd201c71bd tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] POST http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/shares/b330db31-7766-443d-9c19-26fe349665aa/action May 28 13:01:33 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-1b91db21-93b6-4f7c-b85a-f9cd201c71bd tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Action body: b'{"access_list": null}' {{(pid=98329) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 13:01:33 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-1b91db21-93b6-4f7c-b85a-f9cd201c71bd tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Action: 'action', calling method: ShareController.access_list, body: {"access_list": null} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:01:33 l75lg1-v1 manila-share[98474]: DEBUG manila.share.manager [None req-9bedb6c0-82f4-4946-8b15-a40811d4e3ad tempest-ShareRulesTest-1530341375 None] Received request to update access for share instance f7e47502-a0f7-44de-953d-b7b5697ae0b2. {{(pid=98474) update_access_for_instances /opt/stack/manila/manila/share/manager.py:4353}} May 28 13:01:33 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d160fb9f-d13a-463a-8cc4-051252e5c51b tempest-SharesNFSTest-667257547 None] <<< [DELETE] https://127.0.0.1:40443/api/views/50/ May 28 13:01:33 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d160fb9f-d13a-463a-8cc4-051252e5c51b tempest-SharesNFSTest-667257547 None] --- [DELETE] https://127.0.0.1:40443/api/views/50/: Done May 28 13:01:33 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d160fb9f-d13a-463a-8cc4-051252e5c51b tempest-SharesNFSTest-667257547 None] >>> [GET] https://127.0.0.1:40443/api/quotas/ May 28 13:01:33 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d160fb9f-d13a-463a-8cc4-051252e5c51b tempest-SharesNFSTest-667257547 None] {'allow_redirects': True, May 28 13:01:33 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d160fb9f-d13a-463a-8cc4-051252e5c51b tempest-SharesNFSTest-667257547 None] 'params': {'name': '55a40e09-c80d-48da-95b1-a670d27b1414'}} May 28 13:01:33 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-9bedb6c0-82f4-4946-8b15-a40811d4e3ad tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:01:33 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-9bedb6c0-82f4-4946-8b15-a40811d4e3ad tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:01:33 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-9bedb6c0-82f4-4946-8b15-a40811d4e3ad tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:01:33 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-9bedb6c0-82f4-4946-8b15-a40811d4e3ad tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:01:33 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-9bedb6c0-82f4-4946-8b15-a40811d4e3ad tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:01:33 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-1b91db21-93b6-4f7c-b85a-f9cd201c71bd tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/shares/b330db31-7766-443d-9c19-26fe349665aa/action returned with HTTP 200 May 28 13:01:33 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1145/2264] 10.27.203.238 () {66 vars in 1493 bytes} [Tue May 28 13:01:33 2024] POST /share/v2/a4f3887fa28c457390f5b66615564430/shares/b330db31-7766-443d-9c19-26fe349665aa/action => generated 185 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:01:33 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-9bedb6c0-82f4-4946-8b15-a40811d4e3ad tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.062s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:01:33 l75lg1-v1 manila-share[98474]: DEBUG manila.share.access [None req-9bedb6c0-82f4-4946-8b15-a40811d4e3ad tempest-ShareRulesTest-1530341375 None] Updating access rules for share instance f7e47502-a0f7-44de-953d-b7b5697ae0b2 belonging to share b330db31-7766-443d-9c19-26fe349665aa. {{(pid=98474) update_access_rules /opt/stack/manila/manila/share/access.py:298}} May 28 13:01:33 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-9bedb6c0-82f4-4946-8b15-a40811d4e3ad tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:01:33 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-9bedb6c0-82f4-4946-8b15-a40811d4e3ad tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:01:33 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-eac83acf-7456-4008-8b07-7c7658ca0130 tempest-SharesNFSTest-667257547 tempest-SharesNFSTest-667257547-project-member] GET http://10.27.203.238/share/v2/0af6f8e0aeed4f27b075e08f2bc713aa/shares/b40e9810-7e36-4abf-afca-87c742ad83b1 May 28 13:01:33 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-eac83acf-7456-4008-8b07-7c7658ca0130 tempest-SharesNFSTest-667257547 tempest-SharesNFSTest-667257547-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:33 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-eac83acf-7456-4008-8b07-7c7658ca0130 tempest-SharesNFSTest-667257547 tempest-SharesNFSTest-667257547-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:33 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-9bedb6c0-82f4-4946-8b15-a40811d4e3ad tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.007s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:01:33 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-9bedb6c0-82f4-4946-8b15-a40811d4e3ad tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:01:33 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-9bedb6c0-82f4-4946-8b15-a40811d4e3ad tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:01:33 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-9bedb6c0-82f4-4946-8b15-a40811d4e3ad tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.014s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:01:33 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-9bedb6c0-82f4-4946-8b15-a40811d4e3ad tempest-ShareRulesTest-1530341375 None] changing access on None May 28 13:01:33 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9bedb6c0-82f4-4946-8b15-a40811d4e3ad tempest-ShareRulesTest-1530341375 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:01:33 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9bedb6c0-82f4-4946-8b15-a40811d4e3ad tempest-ShareRulesTest-1530341375 None] {'allow_redirects': True, May 28 13:01:33 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9bedb6c0-82f4-4946-8b15-a40811d4e3ad tempest-ShareRulesTest-1530341375 None] 'params': {'name': 'f7e47502-a0f7-44de-953d-b7b5697ae0b2'}} May 28 13:01:33 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-eac83acf-7456-4008-8b07-7c7658ca0130 tempest-SharesNFSTest-667257547 tempest-SharesNFSTest-667257547-project-member] http://10.27.203.238/share/v2/0af6f8e0aeed4f27b075e08f2bc713aa/shares/b40e9810-7e36-4abf-afca-87c742ad83b1 returned with HTTP 200 May 28 13:01:33 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1120/2265] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:01:33 2024] GET /share/v2/0af6f8e0aeed4f27b075e08f2bc713aa/shares/b40e9810-7e36-4abf-afca-87c742ad83b1 => generated 1313 bytes in 29 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:01:33 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ae348258-c7a9-4c41-94a5-aa565c59e244 tempest-ShareTypeAvailabilityZonesTest-364532124 None] <<< [DELETE] https://127.0.0.1:40443/api/viewpolicies/50/ May 28 13:01:33 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ae348258-c7a9-4c41-94a5-aa565c59e244 tempest-ShareTypeAvailabilityZonesTest-364532124 None] --- [DELETE] https://127.0.0.1:40443/api/viewpolicies/50/: Done May 28 13:01:33 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d160fb9f-d13a-463a-8cc4-051252e5c51b tempest-SharesNFSTest-667257547 None] <<< [GET] https://127.0.0.1:40443/api/quotas/ May 28 13:01:33 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d160fb9f-d13a-463a-8cc4-051252e5c51b tempest-SharesNFSTest-667257547 None] [Bunch(cluster='loop75-kfs', cluster_id=1, default_email=None, default_group_quota=None, default_user_quota=None, enable_alarms=True, enable_email_providers=True, grace_period=None, guid='093553e4-28fc-49bf-92b6-8eebc68f582e', hard_limit=1073741824, hard_limit_inodes=None, id=48, internal=False, is_user_quota=False, last_user_quotas_update=None, name='55a40e09-c80d-48da-95b1-a670d27b1414', num_blocked_users=0, num_exceeded_users=0, path='/manila/manila-55a40e09-c80d-48da-95b1-a670d27b1414', percent_capacity=0, percent_inodes=None, pretty_grace_period=None, pretty_grace_period_expiration=None, pretty_state='OK (CREATED)', soft_limit=None, soft_limit_inodes=None, state='OK', sync_state='CREATED', system_id=48, tenant_id=1, tenant_name='default', time_to_block=None, title='55a40e09-c80d-48da-95b1-a670d27b1414', url='https://127.0.0.1:40443/api/quotas/48/', used_capacity=0, used_capacity_tb=0.0, used_effective_capacity=0, used_effective_capacity_tb=0.0, used_inodes=0, used_limited_capacity=0)] May 28 13:01:33 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d160fb9f-d13a-463a-8cc4-051252e5c51b tempest-SharesNFSTest-667257547 None] --- [GET] https://127.0.0.1:40443/api/quotas/: Done May 28 13:01:33 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d160fb9f-d13a-463a-8cc4-051252e5c51b tempest-SharesNFSTest-667257547 None] >>> [DELETE] https://127.0.0.1:40443/api/quotas/48/ May 28 13:01:33 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-ae348258-c7a9-4c41-94a5-aa565c59e244 tempest-ShareTypeAvailabilityZonesTest-364532124 None] Created reservations ['503a48a6-6958-4391-aeab-edbf8900abc0', 'a8be14c2-e9c8-42eb-9182-2eaf4eaf516d', '3619a9c8-3939-4b5e-9188-cd183c3c1c82', '1eb2ecc5-cae6-4d20-96a9-dda0476955ff'] {{(pid=98474) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 13:01:33 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-ae348258-c7a9-4c41-94a5-aa565c59e244 tempest-ShareTypeAvailabilityZonesTest-364532124 None] Committed reservations ['503a48a6-6958-4391-aeab-edbf8900abc0', 'a8be14c2-e9c8-42eb-9182-2eaf4eaf516d', '3619a9c8-3939-4b5e-9188-cd183c3c1c82', '1eb2ecc5-cae6-4d20-96a9-dda0476955ff'] {{(pid=98474) commit /opt/stack/manila/manila/quota.py:1063}} May 28 13:01:33 l75lg1-v1 manila-share[98474]: INFO manila.share.manager [None req-ae348258-c7a9-4c41-94a5-aa565c59e244 tempest-ShareTypeAvailabilityZonesTest-364532124 None] Share instance 62476a26-faf7-4184-83e5-45ec72b91d6e: deleted successfully. May 28 13:01:33 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-81ad0843-e0ee-4706-bc54-cea65a9efafe tempest-ShareTransferTest-320553121 tempest-ShareTransferTest-320553121-project-member] GET http://10.27.203.238/share/v2/bece16f41fc44d55bf7bc45c2adaaed5/shares/3e8f600a-428f-49ef-9c9b-ce57939ca004 May 28 13:01:33 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-81ad0843-e0ee-4706-bc54-cea65a9efafe tempest-ShareTransferTest-320553121 tempest-ShareTransferTest-320553121-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:33 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-81ad0843-e0ee-4706-bc54-cea65a9efafe tempest-ShareTransferTest-320553121 tempest-ShareTransferTest-320553121-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:33 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-81ad0843-e0ee-4706-bc54-cea65a9efafe tempest-ShareTransferTest-320553121 tempest-ShareTransferTest-320553121-project-member] http://10.27.203.238/share/v2/bece16f41fc44d55bf7bc45c2adaaed5/shares/3e8f600a-428f-49ef-9c9b-ce57939ca004 returned with HTTP 200 May 28 13:01:33 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1146/2266] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:01:33 2024] GET /share/v2/bece16f41fc44d55bf7bc45c2adaaed5/shares/3e8f600a-428f-49ef-9c9b-ce57939ca004 => generated 1316 bytes in 25 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:01:33 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-eeb7eb00-bd11-4356-8626-f0dd08f32d1e tempest-ShareTransferTest-320553121 tempest-ShareTransferTest-320553121-project-member] POST http://10.27.203.238/share/v2/bece16f41fc44d55bf7bc45c2adaaed5/share-transfers May 28 13:01:33 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-eeb7eb00-bd11-4356-8626-f0dd08f32d1e tempest-ShareTransferTest-320553121 tempest-ShareTransferTest-320553121-project-member] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"transfer": {"share_id": "3e8f600a-428f-49ef-9c9b-ce57939ca004", "name": "tempest-tempest-created-share-transfer-1355650704"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:01:33 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.v2.share_transfer [None req-eeb7eb00-bd11-4356-8626-f0dd08f32d1e tempest-ShareTransferTest-320553121 tempest-ShareTransferTest-320553121-project-member] Creating new share transfer {'transfer': {'share_id': '3e8f600a-428f-49ef-9c9b-ce57939ca004', 'name': 'tempest-tempest-created-share-transfer-1355650704'}} {{(pid=98330) create /opt/stack/manila/manila/api/v2/share_transfer.py:104}} May 28 13:01:33 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.v2.share_transfer [None req-eeb7eb00-bd11-4356-8626-f0dd08f32d1e tempest-ShareTransferTest-320553121 tempest-ShareTransferTest-320553121-project-member] Creating transfer of share 3e8f600a-428f-49ef-9c9b-ce57939ca004 {{(pid=98330) create /opt/stack/manila/manila/api/v2/share_transfer.py:125}} May 28 13:01:33 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.transfer.api [None req-eeb7eb00-bd11-4356-8626-f0dd08f32d1e tempest-ShareTransferTest-320553121 tempest-ShareTransferTest-320553121-project-member] Generating transfer record for share 3e8f600a-428f-49ef-9c9b-ce57939ca004 {{(pid=98330) create /opt/stack/manila/manila/transfer/api.py:162}} May 28 13:01:33 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9bedb6c0-82f4-4946-8b15-a40811d4e3ad tempest-ShareRulesTest-1530341375 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:01:33 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9bedb6c0-82f4-4946-8b15-a40811d4e3ad tempest-ShareRulesTest-1530341375 None] [Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=1, created='2024-05-28T12:59:53.824250Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='0fa84ccd-850f-48fa-a965-23e5abe31188', id=38, internal=False, is_s3_default_policy=False, name='f7e47502-a0f7-44de-953d-b7b5697ae0b2', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=['*'], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=[], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=[], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T13:01:32.542523Z', tenant_id=1, tenant_name='default', title='f7e47502-a0f7-44de-953d-b7b5697ae0b2', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/38/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[])] May 28 13:01:33 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9bedb6c0-82f4-4946-8b15-a40811d4e3ad tempest-ShareRulesTest-1530341375 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 13:01:33 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-9bedb6c0-82f4-4946-8b15-a40811d4e3ad tempest-ShareRulesTest-1530341375 None] changing access on /manila/manila-f7e47502-a0f7-44de-953d-b7b5697ae0b2. Rules: {'nfs_read_write': ['203.0.113.77'], 'nfs_read_only': []} May 28 13:01:33 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9bedb6c0-82f4-4946-8b15-a40811d4e3ad tempest-ShareRulesTest-1530341375 None] >>> [PATCH] https://127.0.0.1:40443/api/viewpolicies/38/ May 28 13:01:33 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9bedb6c0-82f4-4946-8b15-a40811d4e3ad tempest-ShareRulesTest-1530341375 None] {'data': '{"name": "f7e47502-a0f7-44de-953d-b7b5697ae0b2", "nfs_no_squash": ' May 28 13:01:33 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9bedb6c0-82f4-4946-8b15-a40811d4e3ad tempest-ShareRulesTest-1530341375 None] '["*"], "nfs_root_squash": ["*"], "nfs_read_write": ["203.0.113.77"], ' May 28 13:01:33 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9bedb6c0-82f4-4946-8b15-a40811d4e3ad tempest-ShareRulesTest-1530341375 None] '"nfs_read_only": []}', May 28 13:01:33 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9bedb6c0-82f4-4946-8b15-a40811d4e3ad tempest-ShareRulesTest-1530341375 None] 'params': None} May 28 13:01:33 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-eeb7eb00-bd11-4356-8626-f0dd08f32d1e tempest-ShareTransferTest-320553121 tempest-ShareTransferTest-320553121-project-member] http://10.27.203.238/share/v2/bece16f41fc44d55bf7bc45c2adaaed5/share-transfers returned with HTTP 202 May 28 13:01:34 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1121/2267] 10.27.203.238 () {66 vars in 1389 bytes} [Tue May 28 13:01:33 2024] POST /share/v2/bece16f41fc44d55bf7bc45c2adaaed5/share-transfers => generated 728 bytes in 111 msecs (HTTP/1.1 202) 6 headers in 237 bytes (1 switches on core 0) May 28 13:01:34 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-2f057f1a-1126-43d3-823e-601fb925e70a tempest-ShareTransferTest-320553121 tempest-ShareTransferTest-320553121-project-member] GET http://10.27.203.238/share/v1/bece16f41fc44d55bf7bc45c2adaaed5/shares/3e8f600a-428f-49ef-9c9b-ce57939ca004 May 28 13:01:34 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-2f057f1a-1126-43d3-823e-601fb925e70a tempest-ShareTransferTest-320553121 tempest-ShareTransferTest-320553121-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:34 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-2f057f1a-1126-43d3-823e-601fb925e70a tempest-ShareTransferTest-320553121 tempest-ShareTransferTest-320553121-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:34 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-2f057f1a-1126-43d3-823e-601fb925e70a tempest-ShareTransferTest-320553121 tempest-ShareTransferTest-320553121-project-member] http://10.27.203.238/share/v1/bece16f41fc44d55bf7bc45c2adaaed5/shares/3e8f600a-428f-49ef-9c9b-ce57939ca004 returned with HTTP 200 May 28 13:01:34 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1147/2268] 10.27.203.238 () {62 vars in 1408 bytes} [Tue May 28 13:01:34 2024] GET /share/v1/bece16f41fc44d55bf7bc45c2adaaed5/shares/3e8f600a-428f-49ef-9c9b-ce57939ca004 => generated 905 bytes in 26 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:01:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6ed51c-07d6-4d82-9358-8e331af26f0e service manila] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6ed51c-07d6-4d82-9358-8e331af26f0e service manila] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a163c659-a611-4688-a795-6fb01b24279d service manila] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f110cf6300f049c897d0aab63218d1e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a163c659-a611-4688-a795-6fb01b24279d service manila] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a163c659-a611-4688-a795-6fb01b24279d service manila] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a163c659-a611-4688-a795-6fb01b24279d service manila] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a163c659-a611-4688-a795-6fb01b24279d service manila] RBAC: Authorizing `identity:validate_token()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a163c659-a611-4688-a795-6fb01b24279d service manila] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:34 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1597/3166] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 13:01:34 2024] GET /identity/v3/auth/tokens => generated 3944 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 13:01:34 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-b64b5b2f-6808-4470-ab18-be0498dcd3ba tempest-ShareTransferTest-1224887522 tempest-ShareTransferTest-1224887522-project-member] POST http://10.27.203.238/share/v2/6570d95ff9704ae6a746d0fdc1bcfded/share-transfers/97a6490c-4644-4fb0-83d9-719ee935ae27/accept May 28 13:01:34 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-b64b5b2f-6808-4470-ab18-be0498dcd3ba tempest-ShareTransferTest-1224887522 tempest-ShareTransferTest-1224887522-project-member] Action: 'accept', calling method: Controller.__getattribute__..version_select, body: {"accept": {"auth_key": "86b242ca3b9bf71a", "clear_access_rules": false}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:01:34 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.v2.share_transfer [None req-b64b5b2f-6808-4470-ab18-be0498dcd3ba tempest-ShareTransferTest-1224887522 tempest-ShareTransferTest-1224887522-project-member] Accepting share transfer 97a6490c-4644-4fb0-83d9-719ee935ae27 {{(pid=98330) accept /opt/stack/manila/manila/api/v2/share_transfer.py:143}} May 28 13:01:34 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.v2.share_transfer [None req-b64b5b2f-6808-4470-ab18-be0498dcd3ba tempest-ShareTransferTest-1224887522 tempest-ShareTransferTest-1224887522-project-member] Accepting transfer 97a6490c-4644-4fb0-83d9-719ee935ae27 {{(pid=98330) accept /opt/stack/manila/manila/api/v2/share_transfer.py:167}} May 28 13:01:34 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.quota [None req-b64b5b2f-6808-4470-ab18-be0498dcd3ba tempest-ShareTransferTest-1224887522 tempest-ShareTransferTest-1224887522-project-member] Created reservations ['595793df-bdbe-4e3e-bf20-0ec89c2bb124', '3125faf1-84f2-4981-a38c-8aa5e6848c49'] {{(pid=98330) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 13:01:34 l75lg1-v1 devstack@m-api.service[98330]: WARNING manila.db.sqlalchemy.api [None req-b64b5b2f-6808-4470-ab18-be0498dcd3ba tempest-ShareTransferTest-1224887522 tempest-ShareTransferTest-1224887522-project-member] Change will make usage less than 0 for the following resources: ['shares', 'gigabytes'] May 28 13:01:34 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.quota [None req-b64b5b2f-6808-4470-ab18-be0498dcd3ba tempest-ShareTransferTest-1224887522 tempest-ShareTransferTest-1224887522-project-member] Created reservations ['cd43046f-2222-42d8-9940-8266b5005109', '80a6397c-0675-4345-b8eb-2523d415f0d1'] {{(pid=98330) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 13:01:34 l75lg1-v1 devstack@m-api.service[98330]: INFO oslo_messaging._drivers.amqpdriver [None req-b64b5b2f-6808-4470-ab18-be0498dcd3ba tempest-ShareTransferTest-1224887522 tempest-ShareTransferTest-1224887522-project-member] Expecting reply to msg 645d0f996cb640078fac8a86a70c408a in queue reply_cde4727073384bdbbe2d3acaf79ae8a7 May 28 13:01:34 l75lg1-v1 dstat.sh[49771]: 28-05 13:01:34| 8 1 87 2 0|5703M 1732M 278M 7910M| 17k 5688B| 0 1644k| 0 234 |5488 8925 |1.39 1.22 1.08|2.0 1.0 0| 0 0 | 0 2048M| 29 364 0 35 2 May 28 13:01:34 l75lg1-v1 manila-share[98474]: INFO manila.share.manager [None req-b64b5b2f-6808-4470-ab18-be0498dcd3ba tempest-ShareTransferTest-1224887522 None] Share 3e8f600a-428f-49ef-9c9b-ce57939ca004 has transfer from bece16f41fc44d55bf7bc45c2adaaed5 to 6570d95ff9704ae6a746d0fdc1bcfded completed successfully. May 28 13:01:34 l75lg1-v1 devstack@m-api.service[98330]: INFO oslo_messaging._drivers.amqpdriver [-] Received RPC response for msg 645d0f996cb640078fac8a86a70c408a May 28 13:01:34 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-784506e9-220a-4bd4-8da8-2a98e726af31 tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] GET http://10.27.203.238/share/v2/284d76edec3144579d6fb3f6dbc0dd4e/shares/553b74f3-3a9b-40ad-b4b1-d5648684cbf4 May 28 13:01:34 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-784506e9-220a-4bd4-8da8-2a98e726af31 tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:34 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-784506e9-220a-4bd4-8da8-2a98e726af31 tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:34 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-784506e9-220a-4bd4-8da8-2a98e726af31 tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] HTTP exception thrown: The resource could not be found. May 28 13:01:34 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-784506e9-220a-4bd4-8da8-2a98e726af31 tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] http://10.27.203.238/share/v2/284d76edec3144579d6fb3f6dbc0dd4e/shares/553b74f3-3a9b-40ad-b4b1-d5648684cbf4 returned with HTTP 404 May 28 13:01:34 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1148/2269] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:01:34 2024] GET /share/v2/284d76edec3144579d6fb3f6dbc0dd4e/shares/553b74f3-3a9b-40ad-b4b1-d5648684cbf4 => generated 78 bytes in 11 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 13:01:34 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-3455cbba-253d-4b23-8cdc-c96c9f4b605c tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] PUT http://10.27.203.238/share/v2/bb20757ddd604868aff8ad38db5def87/types/7d2ea8e8-bada-4826-a8a8-53b4e9ff301f/extra_specs/availability_zones May 28 13:01:34 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-3455cbba-253d-4b23-8cdc-c96c9f4b605c tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] Action: 'update', calling method: ShareTypeExtraSpecsController.update, body: {"availability_zones": "nova"} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:01:34 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-3455cbba-253d-4b23-8cdc-c96c9f4b605c tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] http://10.27.203.238/share/v2/bb20757ddd604868aff8ad38db5def87/types/7d2ea8e8-bada-4826-a8a8-53b4e9ff301f/extra_specs/availability_zones returned with HTTP 200 May 28 13:01:34 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1149/2270] 10.27.203.238 () {66 vars in 1561 bytes} [Tue May 28 13:01:34 2024] PUT /share/v2/bb20757ddd604868aff8ad38db5def87/types/7d2ea8e8-bada-4826-a8a8-53b4e9ff301f/extra_specs/availability_zones => generated 30 bytes in 22 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:01:34 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-572287b8-8150-4cb9-941b-231bd65a9ed8 tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] POST http://10.27.203.238/share/v2/284d76edec3144579d6fb3f6dbc0dd4e/shares May 28 13:01:34 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-572287b8-8150-4cb9-941b-231bd65a9ed8 tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share": {"share_proto": "nfs", "description": "Tempest's share", "snapshot_id": null, "name": "tempest-tempest-created-share-1858543495", "size": 1, "metadata": {}, "is_public": false, "share_type": "7d2ea8e8-bada-4826-a8a8-53b4e9ff301f"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:01:34 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.v1.shares [None req-572287b8-8150-4cb9-941b-231bd65a9ed8 tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] Create NFS share of 1 GB May 28 13:01:34 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.quota [None req-572287b8-8150-4cb9-941b-231bd65a9ed8 tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] Created reservations ['bcaad450-c822-432d-9a86-e8fa3f89b396', '98e70171-6510-4b0c-bdbc-2b54db892571', 'b63c3197-2551-4991-b447-eb7f65135907', 'eab9c61a-c5b2-4cdc-b2d2-95eae35c1efa'] {{(pid=98329) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 13:01:34 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.quota [None req-572287b8-8150-4cb9-941b-231bd65a9ed8 tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] Committed reservations ['bcaad450-c822-432d-9a86-e8fa3f89b396', '98e70171-6510-4b0c-bdbc-2b54db892571', 'b63c3197-2551-4991-b447-eb7f65135907', 'eab9c61a-c5b2-4cdc-b2d2-95eae35c1efa'] {{(pid=98329) commit /opt/stack/manila/manila/quota.py:1063}} May 28 13:01:34 l75lg1-v1 manila-scheduler[98327]: DEBUG dbcounter [-] [98327] Writing DB stats manila:SELECT=139,manila:UPDATE=18,manila:INSERT=1 {{(pid=98327) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:01:34 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.host_manager [None req-572287b8-8150-4cb9-941b-231bd65a9ed8 tempest-ShareTypeAvailabilityZonesTest-364532124 None] Share service is down. (host: l75lg1-v1@generic2). May 28 13:01:34 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.host_manager [None req-572287b8-8150-4cb9-941b-231bd65a9ed8 tempest-ShareTypeAvailabilityZonesTest-364532124 None] Share service is down. (host: l75lg1-v1@generic1). May 28 13:01:34 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-572287b8-8150-4cb9-941b-231bd65a9ed8 tempest-ShareTypeAvailabilityZonesTest-364532124 None] Starting with 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:80}} May 28 13:01:34 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-572287b8-8150-4cb9-941b-231bd65a9ed8 tempest-ShareTypeAvailabilityZonesTest-364532124 None] Filter OnlyHostFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:01:34 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-572287b8-8150-4cb9-941b-231bd65a9ed8 tempest-ShareTypeAvailabilityZonesTest-364532124 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:01:34 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.capacity [None req-572287b8-8150-4cb9-941b-231bd65a9ed8 tempest-ShareTypeAvailabilityZonesTest-364532124 None] Space information for share creation on host l75lg1-v1@vast#vast (requested / avail): 1/2076 {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/capacity.py:83}} May 28 13:01:34 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-572287b8-8150-4cb9-941b-231bd65a9ed8 tempest-ShareTypeAvailabilityZonesTest-364532124 None] Filter CapacityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:01:34 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-572287b8-8150-4cb9-941b-231bd65a9ed8 tempest-ShareTypeAvailabilityZonesTest-364532124 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:01:34 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-572287b8-8150-4cb9-941b-231bd65a9ed8 tempest-ShareTypeAvailabilityZonesTest-364532124 None] Driver Filter: Checking host 'l75lg1-v1@vast#vast' {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:37}} May 28 13:01:34 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-572287b8-8150-4cb9-941b-231bd65a9ed8 tempest-ShareTypeAvailabilityZonesTest-364532124 None] Filter function not set :: passing host. {{(pid=98327) _check_filter_function /opt/stack/manila/manila/scheduler/filters/driver.py:53}} May 28 13:01:34 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-572287b8-8150-4cb9-941b-231bd65a9ed8 tempest-ShareTypeAvailabilityZonesTest-364532124 None] Result: True {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:40}} May 28 13:01:34 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-572287b8-8150-4cb9-941b-231bd65a9ed8 tempest-ShareTypeAvailabilityZonesTest-364532124 None] Done checking host 'l75lg1-v1@vast#vast' {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:41}} May 28 13:01:34 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-572287b8-8150-4cb9-941b-231bd65a9ed8 tempest-ShareTypeAvailabilityZonesTest-364532124 None] Filter DriverFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:01:34 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-572287b8-8150-4cb9-941b-231bd65a9ed8 tempest-ShareTypeAvailabilityZonesTest-364532124 None] Filter ShareReplicationFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:01:34 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-572287b8-8150-4cb9-941b-231bd65a9ed8 tempest-ShareTypeAvailabilityZonesTest-364532124 None] Filter CreateFromSnapshotFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:01:34 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-572287b8-8150-4cb9-941b-231bd65a9ed8 tempest-ShareTypeAvailabilityZonesTest-364532124 None] Filter AffinityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:01:34 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-572287b8-8150-4cb9-941b-231bd65a9ed8 tempest-ShareTypeAvailabilityZonesTest-364532124 None] Filter AntiAffinityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:01:34 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.drivers.filter [None req-572287b8-8150-4cb9-941b-231bd65a9ed8 tempest-ShareTypeAvailabilityZonesTest-364532124 None] Filtered share [host: 'l75lg1-v1@vast#vast', free_capacity_gb: 2076.6277076322585, pools: None] {{(pid=98327) _schedule_share /opt/stack/manila/manila/scheduler/drivers/filter.py:268}} May 28 13:01:34 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-572287b8-8150-4cb9-941b-231bd65a9ed8 tempest-ShareTypeAvailabilityZonesTest-364532124 None] Checking host 'l75lg1-v1@vast#vast' {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:46}} May 28 13:01:34 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.weighers.goodness [None req-572287b8-8150-4cb9-941b-231bd65a9ed8 tempest-ShareTypeAvailabilityZonesTest-364532124 None] Goodness function not set :: defaulting to minimal goodness rating of 0. May 28 13:01:34 l75lg1-v1 manila-scheduler[98327]: INFO manila.scheduler.weighers.goodness [None req-572287b8-8150-4cb9-941b-231bd65a9ed8 tempest-ShareTypeAvailabilityZonesTest-364532124 None] Goodness function result for host l75lg1-v1@vast#vast: 0. May 28 13:01:34 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-572287b8-8150-4cb9-941b-231bd65a9ed8 tempest-ShareTypeAvailabilityZonesTest-364532124 None] Goodness: 0 {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:48}} May 28 13:01:34 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-572287b8-8150-4cb9-941b-231bd65a9ed8 tempest-ShareTypeAvailabilityZonesTest-364532124 None] Done checking host 'l75lg1-v1@vast#vast' {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:49}} May 28 13:01:34 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.drivers.filter [None req-572287b8-8150-4cb9-941b-231bd65a9ed8 tempest-ShareTypeAvailabilityZonesTest-364532124 None] Choosing for share: WeighedHost [host: l75lg1-v1@vast#vast, weight: 0.0] {{(pid=98327) _schedule_share /opt/stack/manila/manila/scheduler/drivers/filter.py:274}} May 28 13:01:34 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-572287b8-8150-4cb9-941b-231bd65a9ed8 tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] http://10.27.203.238/share/v2/284d76edec3144579d6fb3f6dbc0dd4e/shares returned with HTTP 200 May 28 13:01:34 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1150/2271] 10.27.203.238 () {66 vars in 1362 bytes} [Tue May 28 13:01:34 2024] POST /share/v2/284d76edec3144579d6fb3f6dbc0dd4e/shares => generated 1312 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:01:34 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-27139ebe-c2c5-4d97-9591-9d31226292e8 tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] GET http://10.27.203.238/share/v2/284d76edec3144579d6fb3f6dbc0dd4e/shares/31a95cfc-8903-4626-a21e-78ef575c96ed May 28 13:01:34 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-27139ebe-c2c5-4d97-9591-9d31226292e8 tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:34 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-27139ebe-c2c5-4d97-9591-9d31226292e8 tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:34 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-27139ebe-c2c5-4d97-9591-9d31226292e8 tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] http://10.27.203.238/share/v2/284d76edec3144579d6fb3f6dbc0dd4e/shares/31a95cfc-8903-4626-a21e-78ef575c96ed returned with HTTP 200 May 28 13:01:34 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1151/2272] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:01:34 2024] GET /share/v2/284d76edec3144579d6fb3f6dbc0dd4e/shares/31a95cfc-8903-4626-a21e-78ef575c96ed => generated 1312 bytes in 24 msecs (HTTP/1.1 200) 6 headers in 232 bytes (2 switches on core 0) May 28 13:01:34 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-572287b8-8150-4cb9-941b-231bd65a9ed8 tempest-ShareTypeAvailabilityZonesTest-364532124 None] >>> [GET] https://127.0.0.1:40443/api/vippools/ May 28 13:01:34 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-572287b8-8150-4cb9-941b-231bd65a9ed8 tempest-ShareTypeAvailabilityZonesTest-364532124 None] {'allow_redirects': True, 'params': {'name': 'vippool-1'}} May 28 13:01:34 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.quota [None req-b64b5b2f-6808-4470-ab18-be0498dcd3ba tempest-ShareTransferTest-1224887522 tempest-ShareTransferTest-1224887522-project-member] Committed reservations ['595793df-bdbe-4e3e-bf20-0ec89c2bb124', '3125faf1-84f2-4981-a38c-8aa5e6848c49'] {{(pid=98330) commit /opt/stack/manila/manila/quota.py:1063}} May 28 13:01:34 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.quota [None req-b64b5b2f-6808-4470-ab18-be0498dcd3ba tempest-ShareTransferTest-1224887522 tempest-ShareTransferTest-1224887522-project-member] Committed reservations ['cd43046f-2222-42d8-9940-8266b5005109', '80a6397c-0675-4345-b8eb-2523d415f0d1'] {{(pid=98330) commit /opt/stack/manila/manila/quota.py:1063}} May 28 13:01:34 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.transfer.api [None req-b64b5b2f-6808-4470-ab18-be0498dcd3ba tempest-ShareTransferTest-1224887522 tempest-ShareTransferTest-1224887522-project-member] share 3e8f600a-428f-49ef-9c9b-ce57939ca004 has been transferred. May 28 13:01:34 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-b64b5b2f-6808-4470-ab18-be0498dcd3ba tempest-ShareTransferTest-1224887522 tempest-ShareTransferTest-1224887522-project-member] http://10.27.203.238/share/v2/6570d95ff9704ae6a746d0fdc1bcfded/share-transfers/97a6490c-4644-4fb0-83d9-719ee935ae27/accept returned with HTTP 202 May 28 13:01:34 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1122/2273] 10.27.203.238 () {66 vars in 1520 bytes} [Tue May 28 13:01:34 2024] POST /share/v2/6570d95ff9704ae6a746d0fdc1bcfded/share-transfers/97a6490c-4644-4fb0-83d9-719ee935ae27/accept => generated 0 bytes in 809 msecs (HTTP/1.1 202) 6 headers in 235 bytes (1 switches on core 0) May 28 13:01:34 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-d64fbabb-2afc-4f99-b835-ce8c5fb29616 tempest-ShareTransferTest-1224887522 tempest-ShareTransferTest-1224887522-project-member] GET http://10.27.203.238/share/v1/6570d95ff9704ae6a746d0fdc1bcfded/shares/3e8f600a-428f-49ef-9c9b-ce57939ca004 May 28 13:01:34 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-d64fbabb-2afc-4f99-b835-ce8c5fb29616 tempest-ShareTransferTest-1224887522 tempest-ShareTransferTest-1224887522-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:34 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-d64fbabb-2afc-4f99-b835-ce8c5fb29616 tempest-ShareTransferTest-1224887522 tempest-ShareTransferTest-1224887522-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:34 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-d64fbabb-2afc-4f99-b835-ce8c5fb29616 tempest-ShareTransferTest-1224887522 tempest-ShareTransferTest-1224887522-project-member] http://10.27.203.238/share/v1/6570d95ff9704ae6a746d0fdc1bcfded/shares/3e8f600a-428f-49ef-9c9b-ce57939ca004 returned with HTTP 200 May 28 13:01:34 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1152/2274] 10.27.203.238 () {62 vars in 1408 bytes} [Tue May 28 13:01:34 2024] GET /share/v1/6570d95ff9704ae6a746d0fdc1bcfded/shares/3e8f600a-428f-49ef-9c9b-ce57939ca004 => generated 962 bytes in 25 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:01:34 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-6a967557-a816-41ba-b309-8f9fa418f0a8 tempest-ShareTransferTest-1224887522 tempest-ShareTransferTest-1224887522-project-member] GET http://10.27.203.238/share/v2/6570d95ff9704ae6a746d0fdc1bcfded/shares/detail May 28 13:01:34 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-6a967557-a816-41ba-b309-8f9fa418f0a8 tempest-ShareTransferTest-1224887522 tempest-ShareTransferTest-1224887522-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:34 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-6a967557-a816-41ba-b309-8f9fa418f0a8 tempest-ShareTransferTest-1224887522 tempest-ShareTransferTest-1224887522-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:34 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.common [None req-6a967557-a816-41ba-b309-8f9fa418f0a8 tempest-ShareTransferTest-1224887522 tempest-ShareTransferTest-1224887522-project-member] Removing options '' from query {{(pid=98330) remove_invalid_options /opt/stack/manila/manila/api/common.py:441}} May 28 13:01:34 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.share.api [None req-6a967557-a816-41ba-b309-8f9fa418f0a8 tempest-ShareTransferTest-1224887522 tempest-ShareTransferTest-1224887522-project-member] Searching for shares by: {} {{(pid=98330) _get_all /opt/stack/manila/manila/share/api.py:2235}} May 28 13:01:34 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-6a967557-a816-41ba-b309-8f9fa418f0a8 tempest-ShareTransferTest-1224887522 tempest-ShareTransferTest-1224887522-project-member] http://10.27.203.238/share/v2/6570d95ff9704ae6a746d0fdc1bcfded/shares/detail returned with HTTP 200 May 28 13:01:34 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1123/2275] 10.27.203.238 () {64 vars in 1361 bytes} [Tue May 28 13:01:34 2024] GET /share/v2/6570d95ff9704ae6a746d0fdc1bcfded/shares/detail => generated 1319 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:01:34 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-bcc05c98-648e-4146-8d10-45b973733306 tempest-ShareTransferTest-1224887522 tempest-ShareTransferTest-1224887522-project-member] DELETE http://10.27.203.238/share/v2/6570d95ff9704ae6a746d0fdc1bcfded/shares/3e8f600a-428f-49ef-9c9b-ce57939ca004 May 28 13:01:34 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-bcc05c98-648e-4146-8d10-45b973733306 tempest-ShareTransferTest-1224887522 tempest-ShareTransferTest-1224887522-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:34 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-bcc05c98-648e-4146-8d10-45b973733306 tempest-ShareTransferTest-1224887522 tempest-ShareTransferTest-1224887522-project-member] Calling method 'ShareMixin.delete' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:34 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.v1.shares [None req-bcc05c98-648e-4146-8d10-45b973733306 tempest-ShareTransferTest-1224887522 tempest-ShareTransferTest-1224887522-project-member] Delete share with id: 3e8f600a-428f-49ef-9c9b-ce57939ca004 May 28 13:01:35 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-bcc05c98-648e-4146-8d10-45b973733306 tempest-ShareTransferTest-1224887522 tempest-ShareTransferTest-1224887522-project-member] http://10.27.203.238/share/v2/6570d95ff9704ae6a746d0fdc1bcfded/shares/3e8f600a-428f-49ef-9c9b-ce57939ca004 returned with HTTP 202 May 28 13:01:35 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1153/2276] 10.27.203.238 () {64 vars in 1454 bytes} [Tue May 28 13:01:34 2024] DELETE /share/v2/6570d95ff9704ae6a746d0fdc1bcfded/shares/3e8f600a-428f-49ef-9c9b-ce57939ca004 => generated 0 bytes in 121 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 13:01:35 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-f573f666-d1bc-45fd-af33-7fc53638d727 tempest-ShareTransferTest-1224887522 tempest-ShareTransferTest-1224887522-project-member] GET http://10.27.203.238/share/v2/6570d95ff9704ae6a746d0fdc1bcfded/shares/3e8f600a-428f-49ef-9c9b-ce57939ca004 May 28 13:01:35 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-f573f666-d1bc-45fd-af33-7fc53638d727 tempest-ShareTransferTest-1224887522 tempest-ShareTransferTest-1224887522-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:35 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-f573f666-d1bc-45fd-af33-7fc53638d727 tempest-ShareTransferTest-1224887522 tempest-ShareTransferTest-1224887522-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:35 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-f573f666-d1bc-45fd-af33-7fc53638d727 tempest-ShareTransferTest-1224887522 tempest-ShareTransferTest-1224887522-project-member] http://10.27.203.238/share/v2/6570d95ff9704ae6a746d0fdc1bcfded/shares/3e8f600a-428f-49ef-9c9b-ce57939ca004 returned with HTTP 200 May 28 13:01:35 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1124/2277] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:01:35 2024] GET /share/v2/6570d95ff9704ae6a746d0fdc1bcfded/shares/3e8f600a-428f-49ef-9c9b-ce57939ca004 => generated 1315 bytes in 25 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:01:35 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-bcc05c98-648e-4146-8d10-45b973733306 tempest-ShareTransferTest-1224887522 None] Acquiring lock "locked_access_rules_operation_by_share_instance_8b23337a-8316-428a-8f0b-4c29a85c8409" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:01:35 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-bcc05c98-648e-4146-8d10-45b973733306 tempest-ShareTransferTest-1224887522 None] Lock "locked_access_rules_operation_by_share_instance_8b23337a-8316-428a-8f0b-4c29a85c8409" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:01:35 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-bcc05c98-648e-4146-8d10-45b973733306 tempest-ShareTransferTest-1224887522 None] Lock "locked_access_rules_operation_by_share_instance_8b23337a-8316-428a-8f0b-4c29a85c8409" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:01:35 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-bcc05c98-648e-4146-8d10-45b973733306 tempest-ShareTransferTest-1224887522 None] Acquiring lock "locked_access_rules_operation_by_share_instance_8b23337a-8316-428a-8f0b-4c29a85c8409" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:01:35 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-bcc05c98-648e-4146-8d10-45b973733306 tempest-ShareTransferTest-1224887522 None] Lock "locked_access_rules_operation_by_share_instance_8b23337a-8316-428a-8f0b-4c29a85c8409" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:01:35 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-bcc05c98-648e-4146-8d10-45b973733306 tempest-ShareTransferTest-1224887522 None] Lock "locked_access_rules_operation_by_share_instance_8b23337a-8316-428a-8f0b-4c29a85c8409" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:01:35 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-bcc05c98-648e-4146-8d10-45b973733306 tempest-ShareTransferTest-1224887522 None] Acquiring lock "locked_access_rules_operation_by_share_instance_8b23337a-8316-428a-8f0b-4c29a85c8409" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:01:35 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-bcc05c98-648e-4146-8d10-45b973733306 tempest-ShareTransferTest-1224887522 None] Lock "locked_access_rules_operation_by_share_instance_8b23337a-8316-428a-8f0b-4c29a85c8409" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:01:35 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-bcc05c98-648e-4146-8d10-45b973733306 tempest-ShareTransferTest-1224887522 None] Lock "locked_access_rules_operation_by_share_instance_8b23337a-8316-428a-8f0b-4c29a85c8409" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:01:35 l75lg1-v1 manila-share[98474]: DEBUG manila.share.access [None req-bcc05c98-648e-4146-8d10-45b973733306 tempest-ShareTransferTest-1224887522 None] All access rules have been synced for share instance 8b23337a-8316-428a-8f0b-4c29a85c8409 belonging to share 3e8f600a-428f-49ef-9c9b-ce57939ca004. {{(pid=98474) update_access_rules /opt/stack/manila/manila/share/access.py:304}} May 28 13:01:35 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-bcc05c98-648e-4146-8d10-45b973733306 tempest-ShareTransferTest-1224887522 None] deleting '/manila/manila-8b23337a-8316-428a-8f0b-4c29a85c8409' May 28 13:01:35 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bcc05c98-648e-4146-8d10-45b973733306 tempest-ShareTransferTest-1224887522 None] >>> [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/ May 28 13:01:35 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bcc05c98-648e-4146-8d10-45b973733306 tempest-ShareTransferTest-1224887522 None] {'data': '{"path": "/manila/manila-8b23337a-8316-428a-8f0b-4c29a85c8409"}', May 28 13:01:35 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bcc05c98-648e-4146-8d10-45b973733306 tempest-ShareTransferTest-1224887522 None] 'params': None} May 28 13:01:35 l75lg1-v1 dstat.sh[49771]: 28-05 13:01:35| 9 1 83 6 0|5703M 1732M 278M 7911M| 14k 5687B| 0 6580k| 0 564 |6127 10k|1.39 1.22 1.08|1.0 1.0 0| 0 0 | 0 2048M| 29 363 0 32 2 May 28 13:01:35 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-572287b8-8150-4cb9-941b-231bd65a9ed8 tempest-ShareTypeAvailabilityZonesTest-364532124 None] <<< [GET] https://127.0.0.1:40443/api/vippools/ May 28 13:01:35 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-572287b8-8150-4cb9-941b-231bd65a9ed8 tempest-ShareTypeAvailabilityZonesTest-364532124 None] [Bunch(active_cnode_ids=[], active_interfaces=4, cluster='loop75-kfs', cluster_id=1, cnode_ids=[], cnodes=[], domain_name='vippool-1', enable_l3=False, enable_weighted_balancing=False, enabled=True, end_ip='172.21.75.4', guid='f2abaede-b397-413a-8faa-3aeead6d3b28', gw_ip='', gw_ipv6='', id=2, ip_ranges=[['172.21.75.1', '172.21.75.4']], name='vippool-1', peer_asn=0, port_membership='ALL', ranges_summary='172.21.75.[1-4]', role='PROTOCOLS', start_ip='172.21.75.1', subnet_cidr=16, subnet_cidr_ipv6=None, sync='SYNCED', sync_time='2024-05-28T12:50:09.644123Z', tenant_id=1, tenant_name='default', title='172.21.75.1 - 172.21.75.4', url='https://127.0.0.1:40443/api/vippools/2/', vast_asn=0, vlan=0, vms_preferred=False)] May 28 13:01:35 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-572287b8-8150-4cb9-941b-231bd65a9ed8 tempest-ShareTypeAvailabilityZonesTest-364532124 None] --- [GET] https://127.0.0.1:40443/api/vippools/: Done May 28 13:01:35 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-572287b8-8150-4cb9-941b-231bd65a9ed8 tempest-ShareTypeAvailabilityZonesTest-364532124 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:01:35 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-572287b8-8150-4cb9-941b-231bd65a9ed8 tempest-ShareTypeAvailabilityZonesTest-364532124 None] {'allow_redirects': True, May 28 13:01:35 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-572287b8-8150-4cb9-941b-231bd65a9ed8 tempest-ShareTypeAvailabilityZonesTest-364532124 None] 'params': {'name': '8e79dd09-ae5d-4631-a50f-7d8a06d71f8f'}} May 28 13:01:35 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bcc05c98-648e-4146-8d10-45b973733306 tempest-ShareTransferTest-1224887522 None] <<< [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/ May 28 13:01:35 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bcc05c98-648e-4146-8d10-45b973733306 tempest-ShareTransferTest-1224887522 None] 'OK' May 28 13:01:35 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bcc05c98-648e-4146-8d10-45b973733306 tempest-ShareTransferTest-1224887522 None] --- [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/: Done May 28 13:01:35 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bcc05c98-648e-4146-8d10-45b973733306 tempest-ShareTransferTest-1224887522 None] >>> [GET] https://127.0.0.1:40443/api/views/ May 28 13:01:35 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bcc05c98-648e-4146-8d10-45b973733306 tempest-ShareTransferTest-1224887522 None] {'allow_redirects': True, May 28 13:01:35 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bcc05c98-648e-4146-8d10-45b973733306 tempest-ShareTransferTest-1224887522 None] 'params': {'name': '8b23337a-8316-428a-8f0b-4c29a85c8409'}} May 28 13:01:35 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-572287b8-8150-4cb9-941b-231bd65a9ed8 tempest-ShareTypeAvailabilityZonesTest-364532124 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:01:35 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-572287b8-8150-4cb9-941b-231bd65a9ed8 tempest-ShareTypeAvailabilityZonesTest-364532124 None] [] May 28 13:01:35 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-572287b8-8150-4cb9-941b-231bd65a9ed8 tempest-ShareTypeAvailabilityZonesTest-364532124 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 13:01:35 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-572287b8-8150-4cb9-941b-231bd65a9ed8 tempest-ShareTypeAvailabilityZonesTest-364532124 None] >>> [POST] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:01:35 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-572287b8-8150-4cb9-941b-231bd65a9ed8 tempest-ShareTypeAvailabilityZonesTest-364532124 None] {'data': '{"name": "8e79dd09-ae5d-4631-a50f-7d8a06d71f8f"}', May 28 13:01:35 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-572287b8-8150-4cb9-941b-231bd65a9ed8 tempest-ShareTypeAvailabilityZonesTest-364532124 None] 'json': None, May 28 13:01:35 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-572287b8-8150-4cb9-941b-231bd65a9ed8 tempest-ShareTypeAvailabilityZonesTest-364532124 None] 'params': None} May 28 13:01:35 l75lg1-v1 neutron-server[77619]: DEBUG dbcounter [-] [77619] Writing DB stats neutron:SELECT=1 {{(pid=77619) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:01:35 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9bedb6c0-82f4-4946-8b15-a40811d4e3ad tempest-ShareRulesTest-1530341375 None] <<< [PATCH] https://127.0.0.1:40443/api/viewpolicies/38/ May 28 13:01:35 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9bedb6c0-82f4-4946-8b15-a40811d4e3ad tempest-ShareRulesTest-1530341375 None] Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=1, created='2024-05-28T12:59:53.824250Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='0fa84ccd-850f-48fa-a965-23e5abe31188', id=38, internal=False, is_s3_default_policy=False, name='f7e47502-a0f7-44de-953d-b7b5697ae0b2', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=['*'], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['203.0.113.77'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['203.0.113.77'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='MODIFYING', sync_time='2024-05-28T13:01:35.289468Z', tenant_id=1, tenant_name='default', title='f7e47502-a0f7-44de-953d-b7b5697ae0b2', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/38/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[]) May 28 13:01:35 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9bedb6c0-82f4-4946-8b15-a40811d4e3ad tempest-ShareRulesTest-1530341375 None] --- [PATCH] https://127.0.0.1:40443/api/viewpolicies/38/: Done May 28 13:01:35 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-9bedb6c0-82f4-4946-8b15-a40811d4e3ad tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:01:35 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-9bedb6c0-82f4-4946-8b15-a40811d4e3ad tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:01:35 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-9bedb6c0-82f4-4946-8b15-a40811d4e3ad tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.053s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:01:35 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-9bedb6c0-82f4-4946-8b15-a40811d4e3ad tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:01:35 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-9bedb6c0-82f4-4946-8b15-a40811d4e3ad tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:01:35 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-9bedb6c0-82f4-4946-8b15-a40811d4e3ad tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:01:35 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-9bedb6c0-82f4-4946-8b15-a40811d4e3ad tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:01:35 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-9bedb6c0-82f4-4946-8b15-a40811d4e3ad tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:01:35 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-9bedb6c0-82f4-4946-8b15-a40811d4e3ad tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.004s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:01:35 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-9bedb6c0-82f4-4946-8b15-a40811d4e3ad tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:01:35 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-9bedb6c0-82f4-4946-8b15-a40811d4e3ad tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:01:35 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-9bedb6c0-82f4-4946-8b15-a40811d4e3ad tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:01:35 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-9bedb6c0-82f4-4946-8b15-a40811d4e3ad tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:01:35 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-9bedb6c0-82f4-4946-8b15-a40811d4e3ad tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:01:35 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bcc05c98-648e-4146-8d10-45b973733306 tempest-ShareTransferTest-1224887522 None] <<< [GET] https://127.0.0.1:40443/api/views/ May 28 13:01:35 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bcc05c98-648e-4146-8d10-45b973733306 tempest-ShareTransferTest-1224887522 None] [Bunch(abac_tags=[], abe_max_depth=None, abe_protocols=[], alias='', allow_anonymous_access=False, allow_s3_anonymous_access=False, auto_commit='0d', bucket='', bucket_creators=[], bucket_creators_groups=[], bucket_owner=None, bulk_permission_update_progress=None, bulk_permission_update_state=None, cluster='loop75-kfs', cluster_id=1, created='2024-05-28T13:01:31.984260Z', enabled=True, files_retention_mode='NONE', guid='7ff778ed-69c7-4853-9348-cd244d05811a', id=51, ignore_oos=False, internal=False, is_remote=False, is_seamless=False, logical_capacity=0, max_retention_period=None, min_retention_period=None, name='8b23337a-8316-428a-8f0b-4c29a85c8409', nfs_interop_flags='BOTH_NFS3_AND_NFS4_INTEROP_DISABLED', path='/manila/manila-8b23337a-8316-428a-8f0b-4c29a85c8409', physical_capacity=0, policy='8b23337a-8316-428a-8f0b-4c29a85c8409', policy_id=52, protocols=['NFS'], qos_policy=None, qos_policy_id=None, s3_locks=False, s3_locks_retention_mode='NONE', s3_locks_retention_period='', s3_unverified_lookup=False, s3_versioning=False, select_for_live_monitoring=False, share='', share_acl=Bunch(acl=[], enabled=False), sync='SYNCED', sync_time='2024-05-28T13:01:32.279722Z', tenant_id=1, tenant_name='default', title='/manila/manila-8b23337a-8316-428a-8f0b-4c29a85c8409', url='https://127.0.0.1:40443/api/views/51/')] May 28 13:01:35 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bcc05c98-648e-4146-8d10-45b973733306 tempest-ShareTransferTest-1224887522 None] --- [GET] https://127.0.0.1:40443/api/views/: Done May 28 13:01:35 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bcc05c98-648e-4146-8d10-45b973733306 tempest-ShareTransferTest-1224887522 None] >>> [DELETE] https://127.0.0.1:40443/api/views/51/ May 28 13:01:35 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-9bedb6c0-82f4-4946-8b15-a40811d4e3ad tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.049s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:01:35 l75lg1-v1 manila-share[98474]: INFO manila.share.access [None req-9bedb6c0-82f4-4946-8b15-a40811d4e3ad tempest-ShareRulesTest-1530341375 None] Access rules were successfully modified for share instance f7e47502-a0f7-44de-953d-b7b5697ae0b2 belonging to share b330db31-7766-443d-9c19-26fe349665aa. May 28 13:01:36 l75lg1-v1 dstat.sh[49771]: 28-05 13:01:36| 2 1 97 1 0|5703M 1732M 278M 7911M| 16k 2883B| 0 601k| 0 68.1 |2423 3916 |1.39 1.22 1.08|1.0 1.0 0| 0 0 | 0 2048M| 29 363 0 32 2 May 28 13:01:36 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-89095e77-d22f-4651-81b2-0e5eb0c737ab tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] POST http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/shares/b330db31-7766-443d-9c19-26fe349665aa/action May 28 13:01:36 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-89095e77-d22f-4651-81b2-0e5eb0c737ab tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Action body: b'{"access_list": null}' {{(pid=98329) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 13:01:36 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-89095e77-d22f-4651-81b2-0e5eb0c737ab tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Action: 'action', calling method: ShareController.access_list, body: {"access_list": null} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:01:36 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-89095e77-d22f-4651-81b2-0e5eb0c737ab tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/shares/b330db31-7766-443d-9c19-26fe349665aa/action returned with HTTP 200 May 28 13:01:36 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1154/2278] 10.27.203.238 () {66 vars in 1493 bytes} [Tue May 28 13:01:36 2024] POST /share/v2/a4f3887fa28c457390f5b66615564430/shares/b330db31-7766-443d-9c19-26fe349665aa/action => generated 176 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:01:36 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-cc00607f-59f2-4e09-a6d5-43e50996abe7 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] POST http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/shares/b330db31-7766-443d-9c19-26fe349665aa/action May 28 13:01:36 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-cc00607f-59f2-4e09-a6d5-43e50996abe7 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Action body: b'{"access_list": null}' {{(pid=98330) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 13:01:36 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-cc00607f-59f2-4e09-a6d5-43e50996abe7 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Action: 'action', calling method: ShareController.access_list, body: {"access_list": null} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:01:36 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-572287b8-8150-4cb9-941b-231bd65a9ed8 tempest-ShareTypeAvailabilityZonesTest-364532124 None] <<< [POST] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:01:36 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-572287b8-8150-4cb9-941b-231bd65a9ed8 tempest-ShareTypeAvailabilityZonesTest-364532124 None] Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=0, created='2024-05-28T13:01:36.161104Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='31687c19-19a3-4cad-9dad-a562c964a940', id=53, internal=False, is_s3_default_policy=False, name='8e79dd09-ae5d-4631-a50f-7d8a06d71f8f', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=[], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['*'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['*'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T13:01:36.476638Z', tenant_id=1, tenant_name='default', title='8e79dd09-ae5d-4631-a50f-7d8a06d71f8f', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/53/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[]) May 28 13:01:36 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-572287b8-8150-4cb9-941b-231bd65a9ed8 tempest-ShareTypeAvailabilityZonesTest-364532124 None] --- [POST] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 13:01:36 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-572287b8-8150-4cb9-941b-231bd65a9ed8 tempest-ShareTypeAvailabilityZonesTest-364532124 None] >>> [GET] https://127.0.0.1:40443/api/quotas/ May 28 13:01:36 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-572287b8-8150-4cb9-941b-231bd65a9ed8 tempest-ShareTypeAvailabilityZonesTest-364532124 None] {'allow_redirects': True, May 28 13:01:36 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-572287b8-8150-4cb9-941b-231bd65a9ed8 tempest-ShareTypeAvailabilityZonesTest-364532124 None] 'params': {'name': '8e79dd09-ae5d-4631-a50f-7d8a06d71f8f'}} May 28 13:01:36 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-cc00607f-59f2-4e09-a6d5-43e50996abe7 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/shares/b330db31-7766-443d-9c19-26fe349665aa/action returned with HTTP 200 May 28 13:01:36 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1125/2279] 10.27.203.238 () {66 vars in 1493 bytes} [Tue May 28 13:01:36 2024] POST /share/v2/a4f3887fa28c457390f5b66615564430/shares/b330db31-7766-443d-9c19-26fe349665aa/action => generated 176 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:01:36 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-1744462f-d511-481a-997d-8f3ba47e4479 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] POST http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/shares/b330db31-7766-443d-9c19-26fe349665aa/action May 28 13:01:36 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-1744462f-d511-481a-997d-8f3ba47e4479 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Action body: b'{"deny_access": {"access_id": "13a64ea1-8973-462c-b597-9d06ac8ca8b2"}}' {{(pid=98329) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 13:01:36 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-1744462f-d511-481a-997d-8f3ba47e4479 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Action: 'action', calling method: ShareController.deny_access, body: {"deny_access": {"access_id": "13a64ea1-8973-462c-b597-9d06ac8ca8b2"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:01:36 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.lock.api [None req-1744462f-d511-481a-997d-8f3ba47e4479 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Searching for locks by: {'resource_id': '13a64ea1-8973-462c-b597-9d06ac8ca8b2', 'resource_action': 'delete'} {{(pid=98329) get_all /opt/stack/manila/manila/lock/api.py:112}} May 28 13:01:36 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-181e48c9-fa15-4b56-8181-c98ddb2e84d3 tempest-SharesNFSTest-667257547 tempest-SharesNFSTest-667257547-project-member] GET http://10.27.203.238/share/v2/0af6f8e0aeed4f27b075e08f2bc713aa/shares/b40e9810-7e36-4abf-afca-87c742ad83b1 May 28 13:01:36 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-181e48c9-fa15-4b56-8181-c98ddb2e84d3 tempest-SharesNFSTest-667257547 tempest-SharesNFSTest-667257547-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:36 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-181e48c9-fa15-4b56-8181-c98ddb2e84d3 tempest-SharesNFSTest-667257547 tempest-SharesNFSTest-667257547-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:36 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-181e48c9-fa15-4b56-8181-c98ddb2e84d3 tempest-SharesNFSTest-667257547 tempest-SharesNFSTest-667257547-project-member] http://10.27.203.238/share/v2/0af6f8e0aeed4f27b075e08f2bc713aa/shares/b40e9810-7e36-4abf-afca-87c742ad83b1 returned with HTTP 200 May 28 13:01:36 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1126/2280] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:01:36 2024] GET /share/v2/0af6f8e0aeed4f27b075e08f2bc713aa/shares/b40e9810-7e36-4abf-afca-87c742ad83b1 => generated 1313 bytes in 23 msecs (HTTP/1.1 200) 6 headers in 232 bytes (2 switches on core 0) May 28 13:01:36 l75lg1-v1 devstack@m-api.service[98329]: DEBUG oslo_concurrency.lockutils [None req-1744462f-d511-481a-997d-8f3ba47e4479 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98329) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:01:36 l75lg1-v1 devstack@m-api.service[98329]: DEBUG oslo_concurrency.lockutils [None req-1744462f-d511-481a-997d-8f3ba47e4479 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98329) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:01:36 l75lg1-v1 devstack@m-api.service[98329]: DEBUG oslo_concurrency.lockutils [None req-1744462f-d511-481a-997d-8f3ba47e4479 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.040s {{(pid=98329) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:01:36 l75lg1-v1 devstack@m-api.service[98329]: DEBUG oslo_concurrency.lockutils [None req-1744462f-d511-481a-997d-8f3ba47e4479 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98329) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:01:36 l75lg1-v1 devstack@m-api.service[98329]: DEBUG oslo_concurrency.lockutils [None req-1744462f-d511-481a-997d-8f3ba47e4479 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98329) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:01:36 l75lg1-v1 devstack@m-api.service[98329]: DEBUG oslo_concurrency.lockutils [None req-1744462f-d511-481a-997d-8f3ba47e4479 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.054s {{(pid=98329) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:01:36 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-1744462f-d511-481a-997d-8f3ba47e4479 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/shares/b330db31-7766-443d-9c19-26fe349665aa/action returned with HTTP 202 May 28 13:01:36 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1155/2281] 10.27.203.238 () {66 vars in 1493 bytes} [Tue May 28 13:01:36 2024] POST /share/v2/a4f3887fa28c457390f5b66615564430/shares/b330db31-7766-443d-9c19-26fe349665aa/action => generated 0 bytes in 169 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 13:01:36 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-8ddf03d1-0d6c-4167-8748-e447e9be8f56 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] GET http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/share-access-rules?share_id=b330db31-7766-443d-9c19-26fe349665aa May 28 13:01:36 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-8ddf03d1-0d6c-4167-8748-e447e9be8f56 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:36 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-8ddf03d1-0d6c-4167-8748-e447e9be8f56 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:36 l75lg1-v1 manila-share[98474]: DEBUG manila.share.manager [None req-1744462f-d511-481a-997d-8f3ba47e4479 tempest-ShareRulesTest-1530341375 None] Received request to update access for share instance f7e47502-a0f7-44de-953d-b7b5697ae0b2. {{(pid=98474) update_access_for_instances /opt/stack/manila/manila/share/manager.py:4353}} May 28 13:01:36 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-1744462f-d511-481a-997d-8f3ba47e4479 tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:01:36 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-1744462f-d511-481a-997d-8f3ba47e4479 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:01:36 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.lock.api [None req-8ddf03d1-0d6c-4167-8748-e447e9be8f56 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Searching for locks by: {'resource_id': '13a64ea1-8973-462c-b597-9d06ac8ca8b2', 'resource_action': 'show', 'resource_type': 'access_rule'} {{(pid=98330) get_all /opt/stack/manila/manila/lock/api.py:112}} May 28 13:01:36 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-1744462f-d511-481a-997d-8f3ba47e4479 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:01:36 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-1744462f-d511-481a-997d-8f3ba47e4479 tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:01:36 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-1744462f-d511-481a-997d-8f3ba47e4479 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:01:36 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-8ddf03d1-0d6c-4167-8748-e447e9be8f56 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/share-access-rules?share_id=b330db31-7766-443d-9c19-26fe349665aa returned with HTTP 200 May 28 13:01:36 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1127/2282] 10.27.203.238 () {64 vars in 1467 bytes} [Tue May 28 13:01:36 2024] GET /share/v2/a4f3887fa28c457390f5b66615564430/share-access-rules?share_id=b330db31-7766-443d-9c19-26fe349665aa => generated 288 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:01:36 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-1744462f-d511-481a-997d-8f3ba47e4479 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.051s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:01:36 l75lg1-v1 manila-share[98474]: DEBUG manila.share.access [None req-1744462f-d511-481a-997d-8f3ba47e4479 tempest-ShareRulesTest-1530341375 None] Updating access rules for share instance f7e47502-a0f7-44de-953d-b7b5697ae0b2 belonging to share b330db31-7766-443d-9c19-26fe349665aa. {{(pid=98474) update_access_rules /opt/stack/manila/manila/share/access.py:298}} May 28 13:01:36 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-572287b8-8150-4cb9-941b-231bd65a9ed8 tempest-ShareTypeAvailabilityZonesTest-364532124 None] <<< [GET] https://127.0.0.1:40443/api/quotas/ May 28 13:01:36 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-572287b8-8150-4cb9-941b-231bd65a9ed8 tempest-ShareTypeAvailabilityZonesTest-364532124 None] [] May 28 13:01:36 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-572287b8-8150-4cb9-941b-231bd65a9ed8 tempest-ShareTypeAvailabilityZonesTest-364532124 None] --- [GET] https://127.0.0.1:40443/api/quotas/: Done May 28 13:01:36 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-572287b8-8150-4cb9-941b-231bd65a9ed8 tempest-ShareTypeAvailabilityZonesTest-364532124 None] >>> [POST] https://127.0.0.1:40443/api/quotas/ May 28 13:01:36 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-572287b8-8150-4cb9-941b-231bd65a9ed8 tempest-ShareTypeAvailabilityZonesTest-364532124 None] {'data': '{"name": "8e79dd09-ae5d-4631-a50f-7d8a06d71f8f", "path": ' May 28 13:01:36 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-572287b8-8150-4cb9-941b-231bd65a9ed8 tempest-ShareTypeAvailabilityZonesTest-364532124 None] '"/manila/manila-8e79dd09-ae5d-4631-a50f-7d8a06d71f8f", "create_dir": ' May 28 13:01:36 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-572287b8-8150-4cb9-941b-231bd65a9ed8 tempest-ShareTypeAvailabilityZonesTest-364532124 None] 'true, "hard_limit": 1073741824}', May 28 13:01:36 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-572287b8-8150-4cb9-941b-231bd65a9ed8 tempest-ShareTypeAvailabilityZonesTest-364532124 None] 'json': None, May 28 13:01:36 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-572287b8-8150-4cb9-941b-231bd65a9ed8 tempest-ShareTypeAvailabilityZonesTest-364532124 None] 'params': None} May 28 13:01:36 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-1744462f-d511-481a-997d-8f3ba47e4479 tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:01:36 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-1744462f-d511-481a-997d-8f3ba47e4479 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:01:36 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-1744462f-d511-481a-997d-8f3ba47e4479 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.007s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:01:36 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-1744462f-d511-481a-997d-8f3ba47e4479 tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:01:36 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-1744462f-d511-481a-997d-8f3ba47e4479 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:01:36 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-1744462f-d511-481a-997d-8f3ba47e4479 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.016s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:01:36 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-1744462f-d511-481a-997d-8f3ba47e4479 tempest-ShareRulesTest-1530341375 None] changing access on None May 28 13:01:36 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1744462f-d511-481a-997d-8f3ba47e4479 tempest-ShareRulesTest-1530341375 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:01:36 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1744462f-d511-481a-997d-8f3ba47e4479 tempest-ShareRulesTest-1530341375 None] {'allow_redirects': True, May 28 13:01:36 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1744462f-d511-481a-997d-8f3ba47e4479 tempest-ShareRulesTest-1530341375 None] 'params': {'name': 'f7e47502-a0f7-44de-953d-b7b5697ae0b2'}} May 28 13:01:37 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d160fb9f-d13a-463a-8cc4-051252e5c51b tempest-SharesNFSTest-667257547 None] <<< [DELETE] https://127.0.0.1:40443/api/quotas/48/ May 28 13:01:37 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d160fb9f-d13a-463a-8cc4-051252e5c51b tempest-SharesNFSTest-667257547 None] --- [DELETE] https://127.0.0.1:40443/api/quotas/48/: Done May 28 13:01:37 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d160fb9f-d13a-463a-8cc4-051252e5c51b tempest-SharesNFSTest-667257547 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:01:37 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d160fb9f-d13a-463a-8cc4-051252e5c51b tempest-SharesNFSTest-667257547 None] {'allow_redirects': True, May 28 13:01:37 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d160fb9f-d13a-463a-8cc4-051252e5c51b tempest-SharesNFSTest-667257547 None] 'params': {'name': '55a40e09-c80d-48da-95b1-a670d27b1414'}} May 28 13:01:37 l75lg1-v1 dstat.sh[49771]: 28-05 13:01:37| 5 1 93 1 0|5704M 1732M 278M 7911M| 17k 3079B| 0 900k| 0 97.0 |3527 5603 |1.28 1.20 1.07|1.0 1.0 0| 0 0 | 0 2048M| 29 363 0 32 2 May 28 13:01:37 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d160fb9f-d13a-463a-8cc4-051252e5c51b tempest-SharesNFSTest-667257547 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:01:37 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d160fb9f-d13a-463a-8cc4-051252e5c51b tempest-SharesNFSTest-667257547 None] [Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=0, created='2024-05-28T13:01:25.650399Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='6f9e1b32-76c4-4fbb-84ae-5a22e57b93f1', id=51, internal=False, is_s3_default_policy=False, name='55a40e09-c80d-48da-95b1-a670d27b1414', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=[], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['*'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['*'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T13:01:26.101743Z', tenant_id=1, tenant_name='default', title='55a40e09-c80d-48da-95b1-a670d27b1414', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/51/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[])] May 28 13:01:37 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d160fb9f-d13a-463a-8cc4-051252e5c51b tempest-SharesNFSTest-667257547 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 13:01:37 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d160fb9f-d13a-463a-8cc4-051252e5c51b tempest-SharesNFSTest-667257547 None] >>> [DELETE] https://127.0.0.1:40443/api/viewpolicies/51/ May 28 13:01:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG dbcounter [-] [51266] Writing DB stats keystone:SELECT=805,keystone:DELETE=122,keystone:INSERT=54 {{(pid=51266) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:01:37 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1744462f-d511-481a-997d-8f3ba47e4479 tempest-ShareRulesTest-1530341375 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:01:37 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1744462f-d511-481a-997d-8f3ba47e4479 tempest-ShareRulesTest-1530341375 None] [Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=1, created='2024-05-28T12:59:53.824250Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='0fa84ccd-850f-48fa-a965-23e5abe31188', id=38, internal=False, is_s3_default_policy=False, name='f7e47502-a0f7-44de-953d-b7b5697ae0b2', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=['*'], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['203.0.113.77'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['203.0.113.77'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T13:01:35.729345Z', tenant_id=1, tenant_name='default', title='f7e47502-a0f7-44de-953d-b7b5697ae0b2', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/38/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[])] May 28 13:01:37 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1744462f-d511-481a-997d-8f3ba47e4479 tempest-ShareRulesTest-1530341375 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 13:01:37 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-1744462f-d511-481a-997d-8f3ba47e4479 tempest-ShareRulesTest-1530341375 None] changing access on /manila/manila-f7e47502-a0f7-44de-953d-b7b5697ae0b2. Rules: {'nfs_read_write': [], 'nfs_read_only': []} May 28 13:01:37 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1744462f-d511-481a-997d-8f3ba47e4479 tempest-ShareRulesTest-1530341375 None] >>> [PATCH] https://127.0.0.1:40443/api/viewpolicies/38/ May 28 13:01:37 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1744462f-d511-481a-997d-8f3ba47e4479 tempest-ShareRulesTest-1530341375 None] {'data': '{"name": "f7e47502-a0f7-44de-953d-b7b5697ae0b2", "nfs_no_squash": ' May 28 13:01:37 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1744462f-d511-481a-997d-8f3ba47e4479 tempest-ShareRulesTest-1530341375 None] '["*"], "nfs_root_squash": ["*"], "nfs_read_write": [], ' May 28 13:01:37 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1744462f-d511-481a-997d-8f3ba47e4479 tempest-ShareRulesTest-1530341375 None] '"nfs_read_only": []}', May 28 13:01:37 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1744462f-d511-481a-997d-8f3ba47e4479 tempest-ShareRulesTest-1530341375 None] 'params': None} May 28 13:01:37 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-a3db3676-3daf-4235-8ef9-0209f11363e0 tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] GET http://10.27.203.238/share/v2/284d76edec3144579d6fb3f6dbc0dd4e/shares/31a95cfc-8903-4626-a21e-78ef575c96ed May 28 13:01:37 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-a3db3676-3daf-4235-8ef9-0209f11363e0 tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:37 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-a3db3676-3daf-4235-8ef9-0209f11363e0 tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:37 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-572287b8-8150-4cb9-941b-231bd65a9ed8 tempest-ShareTypeAvailabilityZonesTest-364532124 None] <<< [POST] https://127.0.0.1:40443/api/quotas/ May 28 13:01:37 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-572287b8-8150-4cb9-941b-231bd65a9ed8 tempest-ShareTypeAvailabilityZonesTest-364532124 None] Bunch(cluster='loop75-kfs', cluster_id=1, default_email=None, default_group_quota=None, default_user_quota=None, enable_alarms=True, enable_email_providers=True, grace_period=None, group_quotas=[], guid='3c65beac-6dfd-4f2b-a173-4c47e3a6983d', hard_limit=1073741824, hard_limit_inodes=None, id=50, internal=False, is_user_quota=False, last_user_quotas_update=None, name='8e79dd09-ae5d-4631-a50f-7d8a06d71f8f', num_blocked_users=0, num_exceeded_users=0, path='/manila/manila-8e79dd09-ae5d-4631-a50f-7d8a06d71f8f', percent_capacity=0, percent_inodes=None, pretty_grace_period=None, pretty_grace_period_expiration=None, pretty_state='OK (CREATED)', soft_limit=None, soft_limit_inodes=None, state='OK', sync_state='CREATED', system_id=50, tenant_id=1, tenant_name='default', time_to_block=None, title='8e79dd09-ae5d-4631-a50f-7d8a06d71f8f', url='https://127.0.0.1:40443/api/quotas/50/', used_capacity=0, used_capacity_tb=0.0, used_effective_capacity=0, used_effective_capacity_tb=0.0, used_inodes=0, used_limited_capacity=0, user_quotas=[]) May 28 13:01:37 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-572287b8-8150-4cb9-941b-231bd65a9ed8 tempest-ShareTypeAvailabilityZonesTest-364532124 None] --- [POST] https://127.0.0.1:40443/api/quotas/: Done May 28 13:01:37 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-572287b8-8150-4cb9-941b-231bd65a9ed8 tempest-ShareTypeAvailabilityZonesTest-364532124 None] >>> [GET] https://127.0.0.1:40443/api/views/ May 28 13:01:37 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-572287b8-8150-4cb9-941b-231bd65a9ed8 tempest-ShareTypeAvailabilityZonesTest-364532124 None] {'allow_redirects': True, May 28 13:01:37 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-572287b8-8150-4cb9-941b-231bd65a9ed8 tempest-ShareTypeAvailabilityZonesTest-364532124 None] 'params': {'name': '8e79dd09-ae5d-4631-a50f-7d8a06d71f8f'}} May 28 13:01:37 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-a3db3676-3daf-4235-8ef9-0209f11363e0 tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] http://10.27.203.238/share/v2/284d76edec3144579d6fb3f6dbc0dd4e/shares/31a95cfc-8903-4626-a21e-78ef575c96ed returned with HTTP 200 May 28 13:01:37 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1156/2283] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:01:37 2024] GET /share/v2/284d76edec3144579d6fb3f6dbc0dd4e/shares/31a95cfc-8903-4626-a21e-78ef575c96ed => generated 1314 bytes in 23 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:01:37 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bcc05c98-648e-4146-8d10-45b973733306 tempest-ShareTransferTest-1224887522 None] <<< [DELETE] https://127.0.0.1:40443/api/views/51/ May 28 13:01:37 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bcc05c98-648e-4146-8d10-45b973733306 tempest-ShareTransferTest-1224887522 None] --- [DELETE] https://127.0.0.1:40443/api/views/51/: Done May 28 13:01:37 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bcc05c98-648e-4146-8d10-45b973733306 tempest-ShareTransferTest-1224887522 None] >>> [GET] https://127.0.0.1:40443/api/quotas/ May 28 13:01:37 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bcc05c98-648e-4146-8d10-45b973733306 tempest-ShareTransferTest-1224887522 None] {'allow_redirects': True, May 28 13:01:37 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bcc05c98-648e-4146-8d10-45b973733306 tempest-ShareTransferTest-1224887522 None] 'params': {'name': '8b23337a-8316-428a-8f0b-4c29a85c8409'}} May 28 13:01:38 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-219c806b-c49b-456d-80e3-8523cb7a0e0a tempest-ShareTransferTest-1224887522 tempest-ShareTransferTest-1224887522-project-member] GET http://10.27.203.238/share/v2/6570d95ff9704ae6a746d0fdc1bcfded/shares/3e8f600a-428f-49ef-9c9b-ce57939ca004 May 28 13:01:38 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-219c806b-c49b-456d-80e3-8523cb7a0e0a tempest-ShareTransferTest-1224887522 tempest-ShareTransferTest-1224887522-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:38 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-219c806b-c49b-456d-80e3-8523cb7a0e0a tempest-ShareTransferTest-1224887522 tempest-ShareTransferTest-1224887522-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:38 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-219c806b-c49b-456d-80e3-8523cb7a0e0a tempest-ShareTransferTest-1224887522 tempest-ShareTransferTest-1224887522-project-member] http://10.27.203.238/share/v2/6570d95ff9704ae6a746d0fdc1bcfded/shares/3e8f600a-428f-49ef-9c9b-ce57939ca004 returned with HTTP 200 May 28 13:01:38 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1128/2284] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:01:38 2024] GET /share/v2/6570d95ff9704ae6a746d0fdc1bcfded/shares/3e8f600a-428f-49ef-9c9b-ce57939ca004 => generated 1315 bytes in 25 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:01:38 l75lg1-v1 dstat.sh[49771]: 28-05 13:01:38| 1 0 98 0 0|5704M 1731M 278M 7911M| 18k 3013B| 0 504k| 0 47.0 |2080 3079 |1.28 1.20 1.07|1.0 1.0 2.0| 0 0 | 0 2048M| 29 363 0 32 2 May 28 13:01:38 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-572287b8-8150-4cb9-941b-231bd65a9ed8 tempest-ShareTypeAvailabilityZonesTest-364532124 None] <<< [GET] https://127.0.0.1:40443/api/views/ May 28 13:01:38 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-572287b8-8150-4cb9-941b-231bd65a9ed8 tempest-ShareTypeAvailabilityZonesTest-364532124 None] [] May 28 13:01:38 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-572287b8-8150-4cb9-941b-231bd65a9ed8 tempest-ShareTypeAvailabilityZonesTest-364532124 None] --- [GET] https://127.0.0.1:40443/api/views/: Done May 28 13:01:38 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-572287b8-8150-4cb9-941b-231bd65a9ed8 tempest-ShareTypeAvailabilityZonesTest-364532124 None] >>> [POST] https://127.0.0.1:40443/api/views/ May 28 13:01:38 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-572287b8-8150-4cb9-941b-231bd65a9ed8 tempest-ShareTypeAvailabilityZonesTest-364532124 None] {'data': '{"name": "8e79dd09-ae5d-4631-a50f-7d8a06d71f8f", "path": ' May 28 13:01:38 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-572287b8-8150-4cb9-941b-231bd65a9ed8 tempest-ShareTypeAvailabilityZonesTest-364532124 None] '"/manila/manila-8e79dd09-ae5d-4631-a50f-7d8a06d71f8f", "policy_id": ' May 28 13:01:38 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-572287b8-8150-4cb9-941b-231bd65a9ed8 tempest-ShareTypeAvailabilityZonesTest-364532124 None] '53, "create_dir": true, "protocols": ["NFS"]}', May 28 13:01:38 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-572287b8-8150-4cb9-941b-231bd65a9ed8 tempest-ShareTypeAvailabilityZonesTest-364532124 None] 'json': None, May 28 13:01:38 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-572287b8-8150-4cb9-941b-231bd65a9ed8 tempest-ShareTypeAvailabilityZonesTest-364532124 None] 'params': None} May 28 13:01:38 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bcc05c98-648e-4146-8d10-45b973733306 tempest-ShareTransferTest-1224887522 None] <<< [GET] https://127.0.0.1:40443/api/quotas/ May 28 13:01:38 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bcc05c98-648e-4146-8d10-45b973733306 tempest-ShareTransferTest-1224887522 None] [Bunch(cluster='loop75-kfs', cluster_id=1, default_email=None, default_group_quota=None, default_user_quota=None, enable_alarms=True, enable_email_providers=True, grace_period=None, guid='b84370c7-d353-4939-8d73-f8d028705b22', hard_limit=1073741824, hard_limit_inodes=None, id=49, internal=False, is_user_quota=False, last_user_quotas_update=None, name='8b23337a-8316-428a-8f0b-4c29a85c8409', num_blocked_users=0, num_exceeded_users=0, path='/manila/manila-8b23337a-8316-428a-8f0b-4c29a85c8409', percent_capacity=0, percent_inodes=None, pretty_grace_period=None, pretty_grace_period_expiration=None, pretty_state='OK (CREATED)', soft_limit=None, soft_limit_inodes=None, state='OK', sync_state='CREATED', system_id=49, tenant_id=1, tenant_name='default', time_to_block=None, title='8b23337a-8316-428a-8f0b-4c29a85c8409', url='https://127.0.0.1:40443/api/quotas/49/', used_capacity=0, used_capacity_tb=0.0, used_effective_capacity=0, used_effective_capacity_tb=0.0, used_inodes=0, used_limited_capacity=0)] May 28 13:01:38 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bcc05c98-648e-4146-8d10-45b973733306 tempest-ShareTransferTest-1224887522 None] --- [GET] https://127.0.0.1:40443/api/quotas/: Done May 28 13:01:38 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bcc05c98-648e-4146-8d10-45b973733306 tempest-ShareTransferTest-1224887522 None] >>> [DELETE] https://127.0.0.1:40443/api/quotas/49/ May 28 13:01:39 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d160fb9f-d13a-463a-8cc4-051252e5c51b tempest-SharesNFSTest-667257547 None] <<< [DELETE] https://127.0.0.1:40443/api/viewpolicies/51/ May 28 13:01:39 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d160fb9f-d13a-463a-8cc4-051252e5c51b tempest-SharesNFSTest-667257547 None] --- [DELETE] https://127.0.0.1:40443/api/viewpolicies/51/: Done May 28 13:01:39 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-d160fb9f-d13a-463a-8cc4-051252e5c51b tempest-SharesNFSTest-667257547 None] Created reservations ['8ceeaad5-bcdc-4e6c-800d-6fe5197122e6', '4cde26a9-7d7e-4770-8586-3def55b57794', '9df9b016-6d1a-4915-b637-9b62c4e93d16', '698c6d3a-395b-496b-89f8-f7fafcc513d2'] {{(pid=98474) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 13:01:39 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-d160fb9f-d13a-463a-8cc4-051252e5c51b tempest-SharesNFSTest-667257547 None] Committed reservations ['8ceeaad5-bcdc-4e6c-800d-6fe5197122e6', '4cde26a9-7d7e-4770-8586-3def55b57794', '9df9b016-6d1a-4915-b637-9b62c4e93d16', '698c6d3a-395b-496b-89f8-f7fafcc513d2'] {{(pid=98474) commit /opt/stack/manila/manila/quota.py:1063}} May 28 13:01:39 l75lg1-v1 dstat.sh[49771]: 28-05 13:01:39| 2 0 97 1 0|5704M 1731M 278M 7911M| 18k 1726B| 0 656k| 0 59.0 |2032 3247 |1.28 1.20 1.07| 0 1.0 1.0| 0 0 | 0 2048M| 29 363 0 32 2 May 28 13:01:39 l75lg1-v1 manila-share[98474]: INFO manila.share.manager [None req-d160fb9f-d13a-463a-8cc4-051252e5c51b tempest-SharesNFSTest-667257547 None] Share instance 55a40e09-c80d-48da-95b1-a670d27b1414: deleted successfully. May 28 13:01:39 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-572287b8-8150-4cb9-941b-231bd65a9ed8 tempest-ShareTypeAvailabilityZonesTest-364532124 None] <<< [POST] https://127.0.0.1:40443/api/views/ May 28 13:01:39 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-572287b8-8150-4cb9-941b-231bd65a9ed8 tempest-ShareTypeAvailabilityZonesTest-364532124 None] Bunch(abac_tags=[], abe_max_depth=None, abe_protocols=[], alias='', allow_anonymous_access=False, allow_s3_anonymous_access=False, auto_commit='0d', bucket='', bucket_creators=[], bucket_creators_groups=[], bucket_owner=None, bulk_permission_update_progress=None, bulk_permission_update_state=None, cluster='loop75-kfs', cluster_id=1, created='2024-05-28T13:01:38.976154Z', enabled=True, files_retention_mode='NONE', guid='53725551-2ebc-4be5-bb62-042ee65a69a6', id=52, ignore_oos=False, internal=False, is_remote=False, is_seamless=False, logical_capacity=0, max_retention_period=None, min_retention_period=None, name='8e79dd09-ae5d-4631-a50f-7d8a06d71f8f', nfs_interop_flags='BOTH_NFS3_AND_NFS4_INTEROP_DISABLED', path='/manila/manila-8e79dd09-ae5d-4631-a50f-7d8a06d71f8f', physical_capacity=0, policy='8e79dd09-ae5d-4631-a50f-7d8a06d71f8f', policy_id=53, protocols=['NFS'], qos_policy=None, qos_policy_id=None, s3_locks=False, s3_locks_retention_mode='NONE', s3_locks_retention_period='', s3_object_ownership_rule='ObjectWriter', s3_unverified_lookup=False, s3_versioning=False, select_for_live_monitoring=False, share='', share_acl=Bunch(acl=[], enabled=False), sync='SYNCED', sync_time='2024-05-28T13:01:39.237106Z', tenant_id=1, tenant_name='default', title='/manila/manila-8e79dd09-ae5d-4631-a50f-7d8a06d71f8f', url='https://127.0.0.1:40443/api/views/52/') May 28 13:01:39 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-572287b8-8150-4cb9-941b-231bd65a9ed8 tempest-ShareTypeAvailabilityZonesTest-364532124 None] --- [POST] https://127.0.0.1:40443/api/views/: Done May 28 13:01:39 l75lg1-v1 manila-share[98474]: INFO manila.share.manager [None req-572287b8-8150-4cb9-941b-231bd65a9ed8 tempest-ShareTypeAvailabilityZonesTest-364532124 None] Share instance 8e79dd09-ae5d-4631-a50f-7d8a06d71f8f created successfully. May 28 13:01:39 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1744462f-d511-481a-997d-8f3ba47e4479 tempest-ShareRulesTest-1530341375 None] <<< [PATCH] https://127.0.0.1:40443/api/viewpolicies/38/ May 28 13:01:39 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1744462f-d511-481a-997d-8f3ba47e4479 tempest-ShareRulesTest-1530341375 None] Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=1, created='2024-05-28T12:59:53.824250Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='0fa84ccd-850f-48fa-a965-23e5abe31188', id=38, internal=False, is_s3_default_policy=False, name='f7e47502-a0f7-44de-953d-b7b5697ae0b2', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=['*'], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=[], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=[], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='MODIFYING', sync_time='2024-05-28T13:01:38.977559Z', tenant_id=1, tenant_name='default', title='f7e47502-a0f7-44de-953d-b7b5697ae0b2', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/38/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[]) May 28 13:01:39 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1744462f-d511-481a-997d-8f3ba47e4479 tempest-ShareRulesTest-1530341375 None] --- [PATCH] https://127.0.0.1:40443/api/viewpolicies/38/: Done May 28 13:01:39 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-1744462f-d511-481a-997d-8f3ba47e4479 tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:01:39 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-1744462f-d511-481a-997d-8f3ba47e4479 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:01:39 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-1744462f-d511-481a-997d-8f3ba47e4479 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.031s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:01:39 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-1744462f-d511-481a-997d-8f3ba47e4479 tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:01:39 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-1744462f-d511-481a-997d-8f3ba47e4479 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:01:39 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-1744462f-d511-481a-997d-8f3ba47e4479 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.026s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:01:39 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-1744462f-d511-481a-997d-8f3ba47e4479 tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:01:39 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-1744462f-d511-481a-997d-8f3ba47e4479 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:01:39 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-1744462f-d511-481a-997d-8f3ba47e4479 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:01:39 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-1744462f-d511-481a-997d-8f3ba47e4479 tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:01:39 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-1744462f-d511-481a-997d-8f3ba47e4479 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:01:39 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-1744462f-d511-481a-997d-8f3ba47e4479 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:01:39 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-1744462f-d511-481a-997d-8f3ba47e4479 tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:01:39 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-1744462f-d511-481a-997d-8f3ba47e4479 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:01:39 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-6b97cba2-62a8-4450-badd-9a47ce16a0b1 tempest-SharesNFSTest-667257547 tempest-SharesNFSTest-667257547-project-member] GET http://10.27.203.238/share/v2/0af6f8e0aeed4f27b075e08f2bc713aa/shares/b40e9810-7e36-4abf-afca-87c742ad83b1 May 28 13:01:39 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-6b97cba2-62a8-4450-badd-9a47ce16a0b1 tempest-SharesNFSTest-667257547 tempest-SharesNFSTest-667257547-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:39 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-6b97cba2-62a8-4450-badd-9a47ce16a0b1 tempest-SharesNFSTest-667257547 tempest-SharesNFSTest-667257547-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:39 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-6b97cba2-62a8-4450-badd-9a47ce16a0b1 tempest-SharesNFSTest-667257547 tempest-SharesNFSTest-667257547-project-member] HTTP exception thrown: The resource could not be found. May 28 13:01:39 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-6b97cba2-62a8-4450-badd-9a47ce16a0b1 tempest-SharesNFSTest-667257547 tempest-SharesNFSTest-667257547-project-member] http://10.27.203.238/share/v2/0af6f8e0aeed4f27b075e08f2bc713aa/shares/b40e9810-7e36-4abf-afca-87c742ad83b1 returned with HTTP 404 May 28 13:01:39 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1157/2285] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:01:39 2024] GET /share/v2/0af6f8e0aeed4f27b075e08f2bc713aa/shares/b40e9810-7e36-4abf-afca-87c742ad83b1 => generated 78 bytes in 12 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 13:01:39 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-2471b84a-31ae-4f46-8f78-5c42e4f70bba tempest-SharesNFSTest-667257547 tempest-SharesNFSTest-667257547-project-member] GET http://10.27.203.238/share/v2/0af6f8e0aeed4f27b075e08f2bc713aa/shares/b40e9810-7e36-4abf-afca-87c742ad83b1 May 28 13:01:39 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-2471b84a-31ae-4f46-8f78-5c42e4f70bba tempest-SharesNFSTest-667257547 tempest-SharesNFSTest-667257547-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:39 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-2471b84a-31ae-4f46-8f78-5c42e4f70bba tempest-SharesNFSTest-667257547 tempest-SharesNFSTest-667257547-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:39 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-2471b84a-31ae-4f46-8f78-5c42e4f70bba tempest-SharesNFSTest-667257547 tempest-SharesNFSTest-667257547-project-member] HTTP exception thrown: The resource could not be found. May 28 13:01:39 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-2471b84a-31ae-4f46-8f78-5c42e4f70bba tempest-SharesNFSTest-667257547 tempest-SharesNFSTest-667257547-project-member] http://10.27.203.238/share/v2/0af6f8e0aeed4f27b075e08f2bc713aa/shares/b40e9810-7e36-4abf-afca-87c742ad83b1 returned with HTTP 404 May 28 13:01:39 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1129/2286] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:01:39 2024] GET /share/v2/0af6f8e0aeed4f27b075e08f2bc713aa/shares/b40e9810-7e36-4abf-afca-87c742ad83b1 => generated 78 bytes in 11 msecs (HTTP/1.1 404) 6 headers in 237 bytes (2 switches on core 0) May 28 13:01:39 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-1744462f-d511-481a-997d-8f3ba47e4479 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.039s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:01:39 l75lg1-v1 manila-share[98474]: INFO manila.share.access [None req-1744462f-d511-481a-997d-8f3ba47e4479 tempest-ShareRulesTest-1530341375 None] Access rules were successfully modified for share instance f7e47502-a0f7-44de-953d-b7b5697ae0b2 belonging to share b330db31-7766-443d-9c19-26fe349665aa. May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14e38d8-c2d1-4320-ade4-a1eecb3bce53 service manila] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-e14e38d8-c2d1-4320-ade4-a1eecb3bce53 service manila] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14e38d8-c2d1-4320-ade4-a1eecb3bce53 service manila] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6259a529-c2dc-40ff-aa02-88240790aba0 tempest-SharesNFSTest-1858044304 tempest-SharesNFSTest-1858044304-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c78e998d7a8438b924c38bb84168488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40625c7a855049188adc00ac1e323af7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6259a529-c2dc-40ff-aa02-88240790aba0 tempest-SharesNFSTest-1858044304 tempest-SharesNFSTest-1858044304-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6259a529-c2dc-40ff-aa02-88240790aba0 tempest-SharesNFSTest-1858044304 tempest-SharesNFSTest-1858044304-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6259a529-c2dc-40ff-aa02-88240790aba0 tempest-SharesNFSTest-1858044304 tempest-SharesNFSTest-1858044304-project-admin] PATH_INFO: `/v3/users/b9078b0601ac4efa93bdcc390f3d1208` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6259a529-c2dc-40ff-aa02-88240790aba0 tempest-SharesNFSTest-1858044304 tempest-SharesNFSTest-1858044304-project-admin] RBAC: Authorizing `identity:delete_user(user_id=b9078b0601ac4efa93bdcc390f3d1208)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6259a529-c2dc-40ff-aa02-88240790aba0 tempest-SharesNFSTest-1858044304 tempest-SharesNFSTest-1858044304-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-6259a529-c2dc-40ff-aa02-88240790aba0 tempest-SharesNFSTest-1858044304 tempest-SharesNFSTest-1858044304-project-admin] Could not find user: b9078b0601ac4efa93bdcc390f3d1208.: keystone.exception.UserNotFound: Could not find user: b9078b0601ac4efa93bdcc390f3d1208. May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: b9078b0601ac4efa93bdcc390f3d1208. May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1570/3167] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:01:39 2024] DELETE /identity/v3/users/b9078b0601ac4efa93bdcc390f3d1208 => generated 110 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a163c659-a611-4688-a795-6fb01b24279d service manila] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a163c659-a611-4688-a795-6fb01b24279d service manila] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfbb7cb-6068-429f-b04e-f38ab6a0a9bc tempest-SharesNFSTest-1858044304 tempest-SharesNFSTest-1858044304-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c78e998d7a8438b924c38bb84168488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40625c7a855049188adc00ac1e323af7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfbb7cb-6068-429f-b04e-f38ab6a0a9bc tempest-SharesNFSTest-1858044304 tempest-SharesNFSTest-1858044304-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfbb7cb-6068-429f-b04e-f38ab6a0a9bc tempest-SharesNFSTest-1858044304 tempest-SharesNFSTest-1858044304-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfbb7cb-6068-429f-b04e-f38ab6a0a9bc tempest-SharesNFSTest-1858044304 tempest-SharesNFSTest-1858044304-project-admin] PATH_INFO: `/v3/users/567edee5a37f498e8a3f54a933728377` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfbb7cb-6068-429f-b04e-f38ab6a0a9bc tempest-SharesNFSTest-1858044304 tempest-SharesNFSTest-1858044304-project-admin] RBAC: Authorizing `identity:delete_user(user_id=567edee5a37f498e8a3f54a933728377)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfbb7cb-6068-429f-b04e-f38ab6a0a9bc tempest-SharesNFSTest-1858044304 tempest-SharesNFSTest-1858044304-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-9dfbb7cb-6068-429f-b04e-f38ab6a0a9bc tempest-SharesNFSTest-1858044304 tempest-SharesNFSTest-1858044304-project-admin] Could not find user: 567edee5a37f498e8a3f54a933728377.: keystone.exception.UserNotFound: Could not find user: 567edee5a37f498e8a3f54a933728377. May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 567edee5a37f498e8a3f54a933728377. May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1598/3168] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:01:39 2024] DELETE /identity/v3/users/567edee5a37f498e8a3f54a933728377 => generated 110 bytes in 27 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6259a529-c2dc-40ff-aa02-88240790aba0 tempest-SharesNFSTest-1858044304 tempest-SharesNFSTest-1858044304-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6259a529-c2dc-40ff-aa02-88240790aba0 tempest-SharesNFSTest-1858044304 tempest-SharesNFSTest-1858044304-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e254fb00-e5c5-4036-a13b-929ea1a6f055 tempest-SharesNFSTest-1858044304 tempest-SharesNFSTest-1858044304-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c78e998d7a8438b924c38bb84168488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40625c7a855049188adc00ac1e323af7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e254fb00-e5c5-4036-a13b-929ea1a6f055 tempest-SharesNFSTest-1858044304 tempest-SharesNFSTest-1858044304-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e254fb00-e5c5-4036-a13b-929ea1a6f055 tempest-SharesNFSTest-1858044304 tempest-SharesNFSTest-1858044304-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e254fb00-e5c5-4036-a13b-929ea1a6f055 tempest-SharesNFSTest-1858044304 tempest-SharesNFSTest-1858044304-project-admin] PATH_INFO: `/v3/users/e1f712aac7e94e429048f60f92a8a736` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e254fb00-e5c5-4036-a13b-929ea1a6f055 tempest-SharesNFSTest-1858044304 tempest-SharesNFSTest-1858044304-project-admin] RBAC: Authorizing `identity:delete_user(user_id=e1f712aac7e94e429048f60f92a8a736)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e254fb00-e5c5-4036-a13b-929ea1a6f055 tempest-SharesNFSTest-1858044304 tempest-SharesNFSTest-1858044304-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-e254fb00-e5c5-4036-a13b-929ea1a6f055 tempest-SharesNFSTest-1858044304 tempest-SharesNFSTest-1858044304-project-admin] Could not find user: e1f712aac7e94e429048f60f92a8a736.: keystone.exception.UserNotFound: Could not find user: e1f712aac7e94e429048f60f92a8a736. May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: e1f712aac7e94e429048f60f92a8a736. May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1571/3169] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:01:39 2024] DELETE /identity/v3/users/e1f712aac7e94e429048f60f92a8a736 => generated 110 bytes in 25 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfbb7cb-6068-429f-b04e-f38ab6a0a9bc tempest-SharesNFSTest-1858044304 tempest-SharesNFSTest-1858044304-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfbb7cb-6068-429f-b04e-f38ab6a0a9bc tempest-SharesNFSTest-1858044304 tempest-SharesNFSTest-1858044304-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f184b76f-6c9f-493c-bf1a-a8f7bf6bcac4 tempest-SharesNFSTest-1858044304 tempest-SharesNFSTest-1858044304-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c78e998d7a8438b924c38bb84168488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40625c7a855049188adc00ac1e323af7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:39 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-a9f5d5b6-7fd6-4bd4-aea2-044b735dc658 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] GET http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/share-access-rules?share_id=b330db31-7766-443d-9c19-26fe349665aa May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f184b76f-6c9f-493c-bf1a-a8f7bf6bcac4 tempest-SharesNFSTest-1858044304 tempest-SharesNFSTest-1858044304-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f184b76f-6c9f-493c-bf1a-a8f7bf6bcac4 tempest-SharesNFSTest-1858044304 tempest-SharesNFSTest-1858044304-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:39 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-a9f5d5b6-7fd6-4bd4-aea2-044b735dc658 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f184b76f-6c9f-493c-bf1a-a8f7bf6bcac4 tempest-SharesNFSTest-1858044304 tempest-SharesNFSTest-1858044304-project-admin] PATH_INFO: `/v3/users/9d3788d7291b4ee389136f181e35a26b` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:39 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-a9f5d5b6-7fd6-4bd4-aea2-044b735dc658 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f184b76f-6c9f-493c-bf1a-a8f7bf6bcac4 tempest-SharesNFSTest-1858044304 tempest-SharesNFSTest-1858044304-project-admin] RBAC: Authorizing `identity:delete_user(user_id=9d3788d7291b4ee389136f181e35a26b)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f184b76f-6c9f-493c-bf1a-a8f7bf6bcac4 tempest-SharesNFSTest-1858044304 tempest-SharesNFSTest-1858044304-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-f184b76f-6c9f-493c-bf1a-a8f7bf6bcac4 tempest-SharesNFSTest-1858044304 tempest-SharesNFSTest-1858044304-project-admin] Could not find user: 9d3788d7291b4ee389136f181e35a26b.: keystone.exception.UserNotFound: Could not find user: 9d3788d7291b4ee389136f181e35a26b. May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 9d3788d7291b4ee389136f181e35a26b. May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1599/3170] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:01:39 2024] DELETE /identity/v3/users/9d3788d7291b4ee389136f181e35a26b => generated 110 bytes in 24 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e254fb00-e5c5-4036-a13b-929ea1a6f055 tempest-SharesNFSTest-1858044304 tempest-SharesNFSTest-1858044304-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e254fb00-e5c5-4036-a13b-929ea1a6f055 tempest-SharesNFSTest-1858044304 tempest-SharesNFSTest-1858044304-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:39 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-a9f5d5b6-7fd6-4bd4-aea2-044b735dc658 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/share-access-rules?share_id=b330db31-7766-443d-9c19-26fe349665aa returned with HTTP 200 May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f834a322-0676-4b85-bed2-718a492b1f56 tempest-SharesNFSTest-1858044304 tempest-SharesNFSTest-1858044304-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c78e998d7a8438b924c38bb84168488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40625c7a855049188adc00ac1e323af7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:39 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1158/2287] 10.27.203.238 () {64 vars in 1467 bytes} [Tue May 28 13:01:39 2024] GET /share/v2/a4f3887fa28c457390f5b66615564430/share-access-rules?share_id=b330db31-7766-443d-9c19-26fe349665aa => generated 19 bytes in 31 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f834a322-0676-4b85-bed2-718a492b1f56 tempest-SharesNFSTest-1858044304 tempest-SharesNFSTest-1858044304-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f834a322-0676-4b85-bed2-718a492b1f56 tempest-SharesNFSTest-1858044304 tempest-SharesNFSTest-1858044304-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f834a322-0676-4b85-bed2-718a492b1f56 tempest-SharesNFSTest-1858044304 tempest-SharesNFSTest-1858044304-project-admin] PATH_INFO: `/v3/users/2eb81a384d764f8cb6d0d7e830959013` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:39 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-cb4b1d6d-1351-45ad-9ce4-c09b25f52f46 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] POST http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/shares/b330db31-7766-443d-9c19-26fe349665aa/action May 28 13:01:39 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-cb4b1d6d-1351-45ad-9ce4-c09b25f52f46 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Action body: b'{"allow_access": {"access_type": "ip", "access_to": "203.0.113.77", "access_level": "rw", "metadata": {"key1": "v1", "key2": "v2"}}}' {{(pid=98330) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 13:01:39 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-cb4b1d6d-1351-45ad-9ce4-c09b25f52f46 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Action: 'action', calling method: ShareController.allow_access, body: {"allow_access": {"access_type": "ip", "access_to": "203.0.113.77", "access_level": "rw", "metadata": {"key1": "v1", "key2": "v2"}}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f834a322-0676-4b85-bed2-718a492b1f56 tempest-SharesNFSTest-1858044304 tempest-SharesNFSTest-1858044304-project-admin] RBAC: Authorizing `identity:delete_user(user_id=2eb81a384d764f8cb6d0d7e830959013)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f834a322-0676-4b85-bed2-718a492b1f56 tempest-SharesNFSTest-1858044304 tempest-SharesNFSTest-1858044304-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-f834a322-0676-4b85-bed2-718a492b1f56 tempest-SharesNFSTest-1858044304 tempest-SharesNFSTest-1858044304-project-admin] Could not find user: 2eb81a384d764f8cb6d0d7e830959013.: keystone.exception.UserNotFound: Could not find user: 2eb81a384d764f8cb6d0d7e830959013. May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 2eb81a384d764f8cb6d0d7e830959013. May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1572/3171] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:01:39 2024] DELETE /identity/v3/users/2eb81a384d764f8cb6d0d7e830959013 => generated 110 bytes in 25 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f184b76f-6c9f-493c-bf1a-a8f7bf6bcac4 tempest-SharesNFSTest-1858044304 tempest-SharesNFSTest-1858044304-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f184b76f-6c9f-493c-bf1a-a8f7bf6bcac4 tempest-SharesNFSTest-1858044304 tempest-SharesNFSTest-1858044304-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d315c59-e7d2-49ce-8fec-8a715fd410c8 tempest-SharesNFSTest-1858044304 tempest-SharesNFSTest-1858044304-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c78e998d7a8438b924c38bb84168488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40625c7a855049188adc00ac1e323af7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d315c59-e7d2-49ce-8fec-8a715fd410c8 tempest-SharesNFSTest-1858044304 tempest-SharesNFSTest-1858044304-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d315c59-e7d2-49ce-8fec-8a715fd410c8 tempest-SharesNFSTest-1858044304 tempest-SharesNFSTest-1858044304-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d315c59-e7d2-49ce-8fec-8a715fd410c8 tempest-SharesNFSTest-1858044304 tempest-SharesNFSTest-1858044304-project-admin] PATH_INFO: `/v3/users/0f30b8ae74474de0b34a7f48f86a312e` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d315c59-e7d2-49ce-8fec-8a715fd410c8 tempest-SharesNFSTest-1858044304 tempest-SharesNFSTest-1858044304-project-admin] RBAC: Authorizing `identity:delete_user(user_id=0f30b8ae74474de0b34a7f48f86a312e)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d315c59-e7d2-49ce-8fec-8a715fd410c8 tempest-SharesNFSTest-1858044304 tempest-SharesNFSTest-1858044304-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-8d315c59-e7d2-49ce-8fec-8a715fd410c8 tempest-SharesNFSTest-1858044304 tempest-SharesNFSTest-1858044304-project-admin] Could not find user: 0f30b8ae74474de0b34a7f48f86a312e.: keystone.exception.UserNotFound: Could not find user: 0f30b8ae74474de0b34a7f48f86a312e. May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 0f30b8ae74474de0b34a7f48f86a312e. May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1600/3172] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:01:39 2024] DELETE /identity/v3/users/0f30b8ae74474de0b34a7f48f86a312e => generated 110 bytes in 25 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f834a322-0676-4b85-bed2-718a492b1f56 tempest-SharesNFSTest-1858044304 tempest-SharesNFSTest-1858044304-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f834a322-0676-4b85-bed2-718a492b1f56 tempest-SharesNFSTest-1858044304 tempest-SharesNFSTest-1858044304-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3488f7a-3083-4110-9cf0-24ba414ba576 tempest-SharesNFSTest-1858044304 tempest-SharesNFSTest-1858044304-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c78e998d7a8438b924c38bb84168488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40625c7a855049188adc00ac1e323af7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3488f7a-3083-4110-9cf0-24ba414ba576 tempest-SharesNFSTest-1858044304 tempest-SharesNFSTest-1858044304-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3488f7a-3083-4110-9cf0-24ba414ba576 tempest-SharesNFSTest-1858044304 tempest-SharesNFSTest-1858044304-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3488f7a-3083-4110-9cf0-24ba414ba576 tempest-SharesNFSTest-1858044304 tempest-SharesNFSTest-1858044304-project-admin] PATH_INFO: `/v3/users/7013a62752274b85851c128bd3c241f3` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3488f7a-3083-4110-9cf0-24ba414ba576 tempest-SharesNFSTest-1858044304 tempest-SharesNFSTest-1858044304-project-admin] RBAC: Authorizing `identity:delete_user(user_id=7013a62752274b85851c128bd3c241f3)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3488f7a-3083-4110-9cf0-24ba414ba576 tempest-SharesNFSTest-1858044304 tempest-SharesNFSTest-1858044304-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-d3488f7a-3083-4110-9cf0-24ba414ba576 tempest-SharesNFSTest-1858044304 tempest-SharesNFSTest-1858044304-project-admin] Could not find user: 7013a62752274b85851c128bd3c241f3.: keystone.exception.UserNotFound: Could not find user: 7013a62752274b85851c128bd3c241f3. May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 7013a62752274b85851c128bd3c241f3. May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1573/3173] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:01:39 2024] DELETE /identity/v3/users/7013a62752274b85851c128bd3c241f3 => generated 110 bytes in 23 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d315c59-e7d2-49ce-8fec-8a715fd410c8 tempest-SharesNFSTest-1858044304 tempest-SharesNFSTest-1858044304-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:39 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-cb4b1d6d-1351-45ad-9ce4-c09b25f52f46 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:01:39 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-cb4b1d6d-1351-45ad-9ce4-c09b25f52f46 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d315c59-e7d2-49ce-8fec-8a715fd410c8 tempest-SharesNFSTest-1858044304 tempest-SharesNFSTest-1858044304-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa6b874-decb-4665-9b1c-7df5a60b790e tempest-SharesNFSTest-1858044304 tempest-SharesNFSTest-1858044304-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c78e998d7a8438b924c38bb84168488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40625c7a855049188adc00ac1e323af7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa6b874-decb-4665-9b1c-7df5a60b790e tempest-SharesNFSTest-1858044304 tempest-SharesNFSTest-1858044304-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa6b874-decb-4665-9b1c-7df5a60b790e tempest-SharesNFSTest-1858044304 tempest-SharesNFSTest-1858044304-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa6b874-decb-4665-9b1c-7df5a60b790e tempest-SharesNFSTest-1858044304 tempest-SharesNFSTest-1858044304-project-admin] PATH_INFO: `/v3/users/dacf9ff99e1c456cb98dc54de91b36a3` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa6b874-decb-4665-9b1c-7df5a60b790e tempest-SharesNFSTest-1858044304 tempest-SharesNFSTest-1858044304-project-admin] RBAC: Authorizing `identity:delete_user(user_id=dacf9ff99e1c456cb98dc54de91b36a3)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa6b874-decb-4665-9b1c-7df5a60b790e tempest-SharesNFSTest-1858044304 tempest-SharesNFSTest-1858044304-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-8fa6b874-decb-4665-9b1c-7df5a60b790e tempest-SharesNFSTest-1858044304 tempest-SharesNFSTest-1858044304-project-admin] Could not find user: dacf9ff99e1c456cb98dc54de91b36a3.: keystone.exception.UserNotFound: Could not find user: dacf9ff99e1c456cb98dc54de91b36a3. May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: dacf9ff99e1c456cb98dc54de91b36a3. May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1601/3174] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:01:39 2024] DELETE /identity/v3/users/dacf9ff99e1c456cb98dc54de91b36a3 => generated 110 bytes in 25 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3488f7a-3083-4110-9cf0-24ba414ba576 tempest-SharesNFSTest-1858044304 tempest-SharesNFSTest-1858044304-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3488f7a-3083-4110-9cf0-24ba414ba576 tempest-SharesNFSTest-1858044304 tempest-SharesNFSTest-1858044304-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6220ddf-d2dd-47ee-824a-c4330df8a348 tempest-SharesNFSTest-1858044304 tempest-SharesNFSTest-1858044304-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c78e998d7a8438b924c38bb84168488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40625c7a855049188adc00ac1e323af7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6220ddf-d2dd-47ee-824a-c4330df8a348 tempest-SharesNFSTest-1858044304 tempest-SharesNFSTest-1858044304-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6220ddf-d2dd-47ee-824a-c4330df8a348 tempest-SharesNFSTest-1858044304 tempest-SharesNFSTest-1858044304-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6220ddf-d2dd-47ee-824a-c4330df8a348 tempest-SharesNFSTest-1858044304 tempest-SharesNFSTest-1858044304-project-admin] PATH_INFO: `/v3/users/b31873af346a4deca6e4f761309cbf30` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6220ddf-d2dd-47ee-824a-c4330df8a348 tempest-SharesNFSTest-1858044304 tempest-SharesNFSTest-1858044304-project-admin] RBAC: Authorizing `identity:delete_user(user_id=b31873af346a4deca6e4f761309cbf30)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6220ddf-d2dd-47ee-824a-c4330df8a348 tempest-SharesNFSTest-1858044304 tempest-SharesNFSTest-1858044304-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-b6220ddf-d2dd-47ee-824a-c4330df8a348 tempest-SharesNFSTest-1858044304 tempest-SharesNFSTest-1858044304-project-admin] Could not find user: b31873af346a4deca6e4f761309cbf30.: keystone.exception.UserNotFound: Could not find user: b31873af346a4deca6e4f761309cbf30. May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:01:39 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-cb4b1d6d-1351-45ad-9ce4-c09b25f52f46 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.049s {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: b31873af346a4deca6e4f761309cbf30. May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1574/3175] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:01:39 2024] DELETE /identity/v3/users/b31873af346a4deca6e4f761309cbf30 => generated 110 bytes in 23 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:01:39 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-cb4b1d6d-1351-45ad-9ce4-c09b25f52f46 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/shares/b330db31-7766-443d-9c19-26fe349665aa/action returned with HTTP 200 May 28 13:01:39 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1130/2288] 10.27.203.238 () {66 vars in 1494 bytes} [Tue May 28 13:01:39 2024] POST /share/v2/a4f3887fa28c457390f5b66615564430/shares/b330db31-7766-443d-9c19-26fe349665aa/action => generated 336 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa6b874-decb-4665-9b1c-7df5a60b790e tempest-SharesNFSTest-1858044304 tempest-SharesNFSTest-1858044304-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa6b874-decb-4665-9b1c-7df5a60b790e tempest-SharesNFSTest-1858044304 tempest-SharesNFSTest-1858044304-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8142ac89-5c58-486c-8ce9-64db5b057c9a tempest-SharesNFSTest-1858044304 tempest-SharesNFSTest-1858044304-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c78e998d7a8438b924c38bb84168488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40625c7a855049188adc00ac1e323af7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:39 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-59cdb5cc-75a0-4f60-9beb-ec404c2b92d4 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] GET http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/share-access-rules?share_id=b330db31-7766-443d-9c19-26fe349665aa May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8142ac89-5c58-486c-8ce9-64db5b057c9a tempest-SharesNFSTest-1858044304 tempest-SharesNFSTest-1858044304-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8142ac89-5c58-486c-8ce9-64db5b057c9a tempest-SharesNFSTest-1858044304 tempest-SharesNFSTest-1858044304-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8142ac89-5c58-486c-8ce9-64db5b057c9a tempest-SharesNFSTest-1858044304 tempest-SharesNFSTest-1858044304-project-admin] PATH_INFO: `/v3/users/1753431784bd4ea68bf59da03f4b6d7a` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:39 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-59cdb5cc-75a0-4f60-9beb-ec404c2b92d4 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:39 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-59cdb5cc-75a0-4f60-9beb-ec404c2b92d4 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8142ac89-5c58-486c-8ce9-64db5b057c9a tempest-SharesNFSTest-1858044304 tempest-SharesNFSTest-1858044304-project-admin] RBAC: Authorizing `identity:delete_user(user_id=1753431784bd4ea68bf59da03f4b6d7a)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8142ac89-5c58-486c-8ce9-64db5b057c9a tempest-SharesNFSTest-1858044304 tempest-SharesNFSTest-1858044304-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:39 l75lg1-v1 manila-share[98474]: DEBUG manila.share.manager [None req-cb4b1d6d-1351-45ad-9ce4-c09b25f52f46 tempest-ShareRulesTest-1530341375 None] Received request to update access for share instance f7e47502-a0f7-44de-953d-b7b5697ae0b2. {{(pid=98474) update_access_for_instances /opt/stack/manila/manila/share/manager.py:4353}} May 28 13:01:39 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-cb4b1d6d-1351-45ad-9ce4-c09b25f52f46 tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:01:39 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-cb4b1d6d-1351-45ad-9ce4-c09b25f52f46 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:01:39 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.lock.api [None req-59cdb5cc-75a0-4f60-9beb-ec404c2b92d4 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Searching for locks by: {'resource_id': '6944eff2-e480-4713-8b27-1213fe6945dd', 'resource_action': 'show', 'resource_type': 'access_rule'} {{(pid=98329) get_all /opt/stack/manila/manila/lock/api.py:112}} May 28 13:01:40 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-cb4b1d6d-1351-45ad-9ce4-c09b25f52f46 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:01:40 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-cb4b1d6d-1351-45ad-9ce4-c09b25f52f46 tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:01:40 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-cb4b1d6d-1351-45ad-9ce4-c09b25f52f46 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:01:40 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-59cdb5cc-75a0-4f60-9beb-ec404c2b92d4 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/share-access-rules?share_id=b330db31-7766-443d-9c19-26fe349665aa returned with HTTP 200 May 28 13:01:40 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1159/2289] 10.27.203.238 () {64 vars in 1467 bytes} [Tue May 28 13:01:39 2024] GET /share/v2/a4f3887fa28c457390f5b66615564430/share-access-rules?share_id=b330db31-7766-443d-9c19-26fe349665aa => generated 291 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:01:40 l75lg1-v1 nova-conductor[83648]: DEBUG dbcounter [-] [83648] Writing DB stats nova_cell1:SELECT=2 {{(pid=83648) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:01:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-8142ac89-5c58-486c-8ce9-64db5b057c9a tempest-SharesNFSTest-1858044304 tempest-SharesNFSTest-1858044304-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1753431784bd4ea68bf59da03f4b6d7a', 'request_id': 'req-8142ac89-5c58-486c-8ce9-64db5b057c9a'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-8142ac89-5c58-486c-8ce9-64db5b057c9a tempest-SharesNFSTest-1858044304 tempest-SharesNFSTest-1858044304-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1753431784bd4ea68bf59da03f4b6d7a', 'request_id': 'req-8142ac89-5c58-486c-8ce9-64db5b057c9a'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-8142ac89-5c58-486c-8ce9-64db5b057c9a tempest-SharesNFSTest-1858044304 tempest-SharesNFSTest-1858044304-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1753431784bd4ea68bf59da03f4b6d7a', 'request_id': 'req-8142ac89-5c58-486c-8ce9-64db5b057c9a'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-8142ac89-5c58-486c-8ce9-64db5b057c9a tempest-SharesNFSTest-1858044304 tempest-SharesNFSTest-1858044304-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1753431784bd4ea68bf59da03f4b6d7a', 'request_id': 'req-8142ac89-5c58-486c-8ce9-64db5b057c9a'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-8142ac89-5c58-486c-8ce9-64db5b057c9a tempest-SharesNFSTest-1858044304 tempest-SharesNFSTest-1858044304-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1753431784bd4ea68bf59da03f4b6d7a', 'request_id': 'req-8142ac89-5c58-486c-8ce9-64db5b057c9a'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:40 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1602/3176] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:01:39 2024] DELETE /identity/v3/users/1753431784bd4ea68bf59da03f4b6d7a => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:01:40 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-6a3deb55-9960-48c1-b985-cacc3552d9be tempest-SharesNFSTest-667257547 tempest-SharesNFSTest-667257547-project-member] GET http://10.27.203.238/share/v2/0af6f8e0aeed4f27b075e08f2bc713aa/share-replicas/detail?share_id=b40e9810-7e36-4abf-afca-87c742ad83b1 May 28 13:01:40 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-6a3deb55-9960-48c1-b985-cacc3552d9be tempest-SharesNFSTest-667257547 tempest-SharesNFSTest-667257547-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:40 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-6a3deb55-9960-48c1-b985-cacc3552d9be tempest-SharesNFSTest-667257547 tempest-SharesNFSTest-667257547-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:40 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-cb4b1d6d-1351-45ad-9ce4-c09b25f52f46 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.101s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:01:40 l75lg1-v1 manila-share[98474]: DEBUG manila.share.access [None req-cb4b1d6d-1351-45ad-9ce4-c09b25f52f46 tempest-ShareRulesTest-1530341375 None] Updating access rules for share instance f7e47502-a0f7-44de-953d-b7b5697ae0b2 belonging to share b330db31-7766-443d-9c19-26fe349665aa. {{(pid=98474) update_access_rules /opt/stack/manila/manila/share/access.py:298}} May 28 13:01:40 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-6a3deb55-9960-48c1-b985-cacc3552d9be tempest-SharesNFSTest-667257547 tempest-SharesNFSTest-667257547-project-member] http://10.27.203.238/share/v2/0af6f8e0aeed4f27b075e08f2bc713aa/share-replicas/detail?share_id=b40e9810-7e36-4abf-afca-87c742ad83b1 returned with HTTP 200 May 28 13:01:40 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1131/2290] 10.27.203.238 () {64 vars in 1476 bytes} [Tue May 28 13:01:40 2024] GET /share/v2/0af6f8e0aeed4f27b075e08f2bc713aa/share-replicas/detail?share_id=b40e9810-7e36-4abf-afca-87c742ad83b1 => generated 22 bytes in 13 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:01:40 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-ac763673-0c77-4b2b-ba8a-abb0d5ac3448 tempest-SharesNFSTest-667257547 tempest-SharesNFSTest-667257547-project-member] DELETE http://10.27.203.238/share/v2/0af6f8e0aeed4f27b075e08f2bc713aa/shares/b40e9810-7e36-4abf-afca-87c742ad83b1 May 28 13:01:40 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-ac763673-0c77-4b2b-ba8a-abb0d5ac3448 tempest-SharesNFSTest-667257547 tempest-SharesNFSTest-667257547-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:40 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-ac763673-0c77-4b2b-ba8a-abb0d5ac3448 tempest-SharesNFSTest-667257547 tempest-SharesNFSTest-667257547-project-member] Calling method 'ShareMixin.delete' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:40 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.v1.shares [None req-ac763673-0c77-4b2b-ba8a-abb0d5ac3448 tempest-SharesNFSTest-667257547 tempest-SharesNFSTest-667257547-project-member] Delete share with id: b40e9810-7e36-4abf-afca-87c742ad83b1 May 28 13:01:40 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-ac763673-0c77-4b2b-ba8a-abb0d5ac3448 tempest-SharesNFSTest-667257547 tempest-SharesNFSTest-667257547-project-member] HTTP exception thrown: The resource could not be found. May 28 13:01:40 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-ac763673-0c77-4b2b-ba8a-abb0d5ac3448 tempest-SharesNFSTest-667257547 tempest-SharesNFSTest-667257547-project-member] http://10.27.203.238/share/v2/0af6f8e0aeed4f27b075e08f2bc713aa/shares/b40e9810-7e36-4abf-afca-87c742ad83b1 returned with HTTP 404 May 28 13:01:40 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1160/2291] 10.27.203.238 () {64 vars in 1454 bytes} [Tue May 28 13:01:40 2024] DELETE /share/v2/0af6f8e0aeed4f27b075e08f2bc713aa/shares/b40e9810-7e36-4abf-afca-87c742ad83b1 => generated 78 bytes in 12 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 13:01:40 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-cb4b1d6d-1351-45ad-9ce4-c09b25f52f46 tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:01:40 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-cb4b1d6d-1351-45ad-9ce4-c09b25f52f46 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:01:40 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-47e701ba-56ea-4ee9-93f7-9aa48ca5e7cb tempest-SharesNFSTest-667257547 tempest-SharesNFSTest-667257547-project-member] DELETE http://10.27.203.238/share/v2/0af6f8e0aeed4f27b075e08f2bc713aa/snapshots/bff3b07e-650b-4bc1-8c88-fcd101dd0295 May 28 13:01:40 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-47e701ba-56ea-4ee9-93f7-9aa48ca5e7cb tempest-SharesNFSTest-667257547 tempest-SharesNFSTest-667257547-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:40 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-47e701ba-56ea-4ee9-93f7-9aa48ca5e7cb tempest-SharesNFSTest-667257547 tempest-SharesNFSTest-667257547-project-member] Calling method 'ShareSnapshotMixin.delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:40 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.v1.share_snapshots [None req-47e701ba-56ea-4ee9-93f7-9aa48ca5e7cb tempest-SharesNFSTest-667257547 tempest-SharesNFSTest-667257547-project-member] Delete snapshot with id: bff3b07e-650b-4bc1-8c88-fcd101dd0295 May 28 13:01:40 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-cb4b1d6d-1351-45ad-9ce4-c09b25f52f46 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.007s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:01:40 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-cb4b1d6d-1351-45ad-9ce4-c09b25f52f46 tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:01:40 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-cb4b1d6d-1351-45ad-9ce4-c09b25f52f46 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:01:40 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-47e701ba-56ea-4ee9-93f7-9aa48ca5e7cb tempest-SharesNFSTest-667257547 tempest-SharesNFSTest-667257547-project-member] HTTP exception thrown: The resource could not be found. May 28 13:01:40 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-47e701ba-56ea-4ee9-93f7-9aa48ca5e7cb tempest-SharesNFSTest-667257547 tempest-SharesNFSTest-667257547-project-member] http://10.27.203.238/share/v2/0af6f8e0aeed4f27b075e08f2bc713aa/snapshots/bff3b07e-650b-4bc1-8c88-fcd101dd0295 returned with HTTP 404 May 28 13:01:40 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1132/2292] 10.27.203.238 () {64 vars in 1463 bytes} [Tue May 28 13:01:40 2024] DELETE /share/v2/0af6f8e0aeed4f27b075e08f2bc713aa/snapshots/bff3b07e-650b-4bc1-8c88-fcd101dd0295 => generated 78 bytes in 19 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 13:01:40 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-cb4b1d6d-1351-45ad-9ce4-c09b25f52f46 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.017s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:01:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-cb4b1d6d-1351-45ad-9ce4-c09b25f52f46 tempest-ShareRulesTest-1530341375 None] changing access on None May 28 13:01:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-cb4b1d6d-1351-45ad-9ce4-c09b25f52f46 tempest-ShareRulesTest-1530341375 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:01:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-cb4b1d6d-1351-45ad-9ce4-c09b25f52f46 tempest-ShareRulesTest-1530341375 None] {'allow_redirects': True, May 28 13:01:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-cb4b1d6d-1351-45ad-9ce4-c09b25f52f46 tempest-ShareRulesTest-1530341375 None] 'params': {'name': 'f7e47502-a0f7-44de-953d-b7b5697ae0b2'}} May 28 13:01:40 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-0a75a23d-d443-42e5-ac36-a783ea20ba1e tempest-SharesNFSTest-1858044304 tempest-SharesNFSTest-1858044304-project-admin] DELETE http://10.27.203.238/share/v2/40625c7a855049188adc00ac1e323af7/types/8129f187-256c-46ff-ae6b-e17fed07af1a May 28 13:01:40 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-0a75a23d-d443-42e5-ac36-a783ea20ba1e tempest-SharesNFSTest-1858044304 tempest-SharesNFSTest-1858044304-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:40 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-0a75a23d-d443-42e5-ac36-a783ea20ba1e tempest-SharesNFSTest-1858044304 tempest-SharesNFSTest-1858044304-project-admin] Calling method 'ShareTypesController._delete' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:40 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-0a75a23d-d443-42e5-ac36-a783ea20ba1e tempest-SharesNFSTest-1858044304 tempest-SharesNFSTest-1858044304-project-admin] http://10.27.203.238/share/v2/40625c7a855049188adc00ac1e323af7/types/8129f187-256c-46ff-ae6b-e17fed07af1a returned with HTTP 202 May 28 13:01:40 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1161/2293] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:01:40 2024] DELETE /share/v2/40625c7a855049188adc00ac1e323af7/types/8129f187-256c-46ff-ae6b-e17fed07af1a => generated 0 bytes in 53 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 13:01:40 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-b1db4ccb-bfe3-48db-b44a-7dfac7a55702 tempest-SharesNFSTest-1858044304 tempest-SharesNFSTest-1858044304-project-admin] GET http://10.27.203.238/share/v2/40625c7a855049188adc00ac1e323af7/types/8129f187-256c-46ff-ae6b-e17fed07af1a May 28 13:01:40 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-b1db4ccb-bfe3-48db-b44a-7dfac7a55702 tempest-SharesNFSTest-1858044304 tempest-SharesNFSTest-1858044304-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:40 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-b1db4ccb-bfe3-48db-b44a-7dfac7a55702 tempest-SharesNFSTest-1858044304 tempest-SharesNFSTest-1858044304-project-admin] Calling method 'ShareTypesController.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:40 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-b1db4ccb-bfe3-48db-b44a-7dfac7a55702 tempest-SharesNFSTest-1858044304 tempest-SharesNFSTest-1858044304-project-admin] HTTP exception thrown: Share type not found. May 28 13:01:40 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-b1db4ccb-bfe3-48db-b44a-7dfac7a55702 tempest-SharesNFSTest-1858044304 tempest-SharesNFSTest-1858044304-project-admin] http://10.27.203.238/share/v2/40625c7a855049188adc00ac1e323af7/types/8129f187-256c-46ff-ae6b-e17fed07af1a returned with HTTP 404 May 28 13:01:40 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1133/2294] 10.27.203.238 () {64 vars in 1448 bytes} [Tue May 28 13:01:40 2024] GET /share/v2/40625c7a855049188adc00ac1e323af7/types/8129f187-256c-46ff-ae6b-e17fed07af1a => generated 67 bytes in 11 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 13:01:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6220ddf-d2dd-47ee-824a-c4330df8a348 tempest-SharesNFSTest-1858044304 tempest-SharesNFSTest-1858044304-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-b6220ddf-d2dd-47ee-824a-c4330df8a348 tempest-SharesNFSTest-1858044304 tempest-SharesNFSTest-1858044304-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:01:40 l75lg1-v1 dstat.sh[49771]: 28-05 13:01:40| 11 2 83 3 0|5704M 1731M 278M 7912M| 16k 9157B| 0 8877k| 0 998 |6958 13k|1.28 1.20 1.07|3.0 0 0| 0 0 | 0 2048M| 29 364 0 34 2 May 28 13:01:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6220ddf-d2dd-47ee-824a-c4330df8a348 tempest-SharesNFSTest-1858044304 tempest-SharesNFSTest-1858044304-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc70146-d8e5-449d-9d31-bfc50a472a69 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc70146-d8e5-449d-9d31-bfc50a472a69 None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc70146-d8e5-449d-9d31-bfc50a472a69 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc70146-d8e5-449d-9d31-bfc50a472a69 None admin] PATH_INFO: `/v3/users/2422ad23c6a747059ebfca647c24c460` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc70146-d8e5-449d-9d31-bfc50a472a69 None admin] RBAC: Authorizing `identity:delete_user(user_id=2422ad23c6a747059ebfca647c24c460)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc70146-d8e5-449d-9d31-bfc50a472a69 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-1dc70146-d8e5-449d-9d31-bfc50a472a69 None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2422ad23c6a747059ebfca647c24c460', 'request_id': 'req-1dc70146-d8e5-449d-9d31-bfc50a472a69'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-1dc70146-d8e5-449d-9d31-bfc50a472a69 None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2422ad23c6a747059ebfca647c24c460', 'request_id': 'req-1dc70146-d8e5-449d-9d31-bfc50a472a69'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-1dc70146-d8e5-449d-9d31-bfc50a472a69 None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2422ad23c6a747059ebfca647c24c460', 'request_id': 'req-1dc70146-d8e5-449d-9d31-bfc50a472a69'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-1dc70146-d8e5-449d-9d31-bfc50a472a69 None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2422ad23c6a747059ebfca647c24c460', 'request_id': 'req-1dc70146-d8e5-449d-9d31-bfc50a472a69'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-1dc70146-d8e5-449d-9d31-bfc50a472a69 None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2422ad23c6a747059ebfca647c24c460', 'request_id': 'req-1dc70146-d8e5-449d-9d31-bfc50a472a69'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:40 l75lg1-v1 neutron-server[77618]: DEBUG dbcounter [-] [77618] Writing DB stats neutron:SELECT=4,neutron:UPDATE=1 {{(pid=77618) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:01:40 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1575/3177] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 13:01:40 2024] DELETE /identity/v3/users/2422ad23c6a747059ebfca647c24c460 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:01:40 l75lg1-v1 neutron-server[77623]: DEBUG dbcounter [-] [77623] Writing DB stats neutron:DELETE=1 {{(pid=77623) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:01:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8142ac89-5c58-486c-8ce9-64db5b057c9a tempest-SharesNFSTest-1858044304 tempest-SharesNFSTest-1858044304-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:40 l75lg1-v1 neutron-server[77618]: DEBUG dbcounter [-] [77618] Writing DB stats neutron:SELECT=3 {{(pid=77618) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:01:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8142ac89-5c58-486c-8ce9-64db5b057c9a tempest-SharesNFSTest-1858044304 tempest-SharesNFSTest-1858044304-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae5840a-4e30-437e-a61a-f4479072b666 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae5840a-4e30-437e-a61a-f4479072b666 None admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae5840a-4e30-437e-a61a-f4479072b666 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae5840a-4e30-437e-a61a-f4479072b666 None admin] PATH_INFO: `/v3/users/a770e44d062141cd8ffc9a9233887135` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae5840a-4e30-437e-a61a-f4479072b666 None admin] RBAC: Authorizing `identity:delete_user(user_id=a770e44d062141cd8ffc9a9233887135)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae5840a-4e30-437e-a61a-f4479072b666 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-aae5840a-4e30-437e-a61a-f4479072b666 None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a770e44d062141cd8ffc9a9233887135', 'request_id': 'req-aae5840a-4e30-437e-a61a-f4479072b666'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-aae5840a-4e30-437e-a61a-f4479072b666 None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a770e44d062141cd8ffc9a9233887135', 'request_id': 'req-aae5840a-4e30-437e-a61a-f4479072b666'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-aae5840a-4e30-437e-a61a-f4479072b666 None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a770e44d062141cd8ffc9a9233887135', 'request_id': 'req-aae5840a-4e30-437e-a61a-f4479072b666'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-aae5840a-4e30-437e-a61a-f4479072b666 None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a770e44d062141cd8ffc9a9233887135', 'request_id': 'req-aae5840a-4e30-437e-a61a-f4479072b666'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-aae5840a-4e30-437e-a61a-f4479072b666 None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a770e44d062141cd8ffc9a9233887135', 'request_id': 'req-aae5840a-4e30-437e-a61a-f4479072b666'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-cb4b1d6d-1351-45ad-9ce4-c09b25f52f46 tempest-ShareRulesTest-1530341375 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:01:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-cb4b1d6d-1351-45ad-9ce4-c09b25f52f46 tempest-ShareRulesTest-1530341375 None] [Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=1, created='2024-05-28T12:59:53.824250Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='0fa84ccd-850f-48fa-a965-23e5abe31188', id=38, internal=False, is_s3_default_policy=False, name='f7e47502-a0f7-44de-953d-b7b5697ae0b2', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=['*'], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=[], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=[], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T13:01:39.426967Z', tenant_id=1, tenant_name='default', title='f7e47502-a0f7-44de-953d-b7b5697ae0b2', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/38/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[])] May 28 13:01:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-cb4b1d6d-1351-45ad-9ce4-c09b25f52f46 tempest-ShareRulesTest-1530341375 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 13:01:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-cb4b1d6d-1351-45ad-9ce4-c09b25f52f46 tempest-ShareRulesTest-1530341375 None] changing access on /manila/manila-f7e47502-a0f7-44de-953d-b7b5697ae0b2. Rules: {'nfs_read_write': ['203.0.113.77'], 'nfs_read_only': []} May 28 13:01:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-cb4b1d6d-1351-45ad-9ce4-c09b25f52f46 tempest-ShareRulesTest-1530341375 None] >>> [PATCH] https://127.0.0.1:40443/api/viewpolicies/38/ May 28 13:01:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-cb4b1d6d-1351-45ad-9ce4-c09b25f52f46 tempest-ShareRulesTest-1530341375 None] {'data': '{"name": "f7e47502-a0f7-44de-953d-b7b5697ae0b2", "nfs_no_squash": ' May 28 13:01:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-cb4b1d6d-1351-45ad-9ce4-c09b25f52f46 tempest-ShareRulesTest-1530341375 None] '["*"], "nfs_root_squash": ["*"], "nfs_read_write": ["203.0.113.77"], ' May 28 13:01:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-cb4b1d6d-1351-45ad-9ce4-c09b25f52f46 tempest-ShareRulesTest-1530341375 None] '"nfs_read_only": []}', May 28 13:01:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-cb4b1d6d-1351-45ad-9ce4-c09b25f52f46 tempest-ShareRulesTest-1530341375 None] 'params': None} May 28 13:01:40 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1603/3178] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 13:01:40 2024] DELETE /identity/v3/users/a770e44d062141cd8ffc9a9233887135 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:01:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc70146-d8e5-449d-9d31-bfc50a472a69 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-1dc70146-d8e5-449d-9d31-bfc50a472a69 None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:01:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc70146-d8e5-449d-9d31-bfc50a472a69 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7da6f4-a439-43e8-8d3d-322c6d04f265 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7da6f4-a439-43e8-8d3d-322c6d04f265 None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7da6f4-a439-43e8-8d3d-322c6d04f265 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7da6f4-a439-43e8-8d3d-322c6d04f265 None admin] PATH_INFO: `/v3/users/5c78e998d7a8438b924c38bb84168488` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7da6f4-a439-43e8-8d3d-322c6d04f265 None admin] RBAC: Authorizing `identity:delete_user(user_id=5c78e998d7a8438b924c38bb84168488)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7da6f4-a439-43e8-8d3d-322c6d04f265 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-af7da6f4-a439-43e8-8d3d-322c6d04f265 None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c78e998d7a8438b924c38bb84168488', 'request_id': 'req-af7da6f4-a439-43e8-8d3d-322c6d04f265'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-af7da6f4-a439-43e8-8d3d-322c6d04f265 None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c78e998d7a8438b924c38bb84168488', 'request_id': 'req-af7da6f4-a439-43e8-8d3d-322c6d04f265'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-af7da6f4-a439-43e8-8d3d-322c6d04f265 None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c78e998d7a8438b924c38bb84168488', 'request_id': 'req-af7da6f4-a439-43e8-8d3d-322c6d04f265'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-af7da6f4-a439-43e8-8d3d-322c6d04f265 None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c78e998d7a8438b924c38bb84168488', 'request_id': 'req-af7da6f4-a439-43e8-8d3d-322c6d04f265'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-af7da6f4-a439-43e8-8d3d-322c6d04f265 None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c78e998d7a8438b924c38bb84168488', 'request_id': 'req-af7da6f4-a439-43e8-8d3d-322c6d04f265'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:40 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1576/3179] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 13:01:40 2024] DELETE /identity/v3/users/5c78e998d7a8438b924c38bb84168488 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:01:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504bff75-1de5-4eb5-aed3-c59c9a7d33a8 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504bff75-1de5-4eb5-aed3-c59c9a7d33a8 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504bff75-1de5-4eb5-aed3-c59c9a7d33a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:40 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-504bff75-1de5-4eb5-aed3-c59c9a7d33a8 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 13:01:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-504bff75-1de5-4eb5-aed3-c59c9a7d33a8 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 13:01:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-504bff75-1de5-4eb5-aed3-c59c9a7d33a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:01:40 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1604/3180] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 13:01:40 2024] POST /identity/v3/auth/tokens => generated 2960 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 13:01:40 l75lg1-v1 neutron-server[77618]: DEBUG neutron.wsgi [-] (77618) accepted ('10.27.203.238', 34268) {{(pid=77618) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 13:01:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7da6f4-a439-43e8-8d3d-322c6d04f265 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-af7da6f4-a439-43e8-8d3d-322c6d04f265 None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:01:40 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-c53d1be8-b147-46d1-b9b3-95773c29c068 tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] GET http://10.27.203.238/share/v2/284d76edec3144579d6fb3f6dbc0dd4e/shares/31a95cfc-8903-4626-a21e-78ef575c96ed May 28 13:01:40 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-c53d1be8-b147-46d1-b9b3-95773c29c068 tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:40 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-c53d1be8-b147-46d1-b9b3-95773c29c068 tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7da6f4-a439-43e8-8d3d-322c6d04f265 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c3625f-b5d5-4c72-b287-e221c97816ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef17047035e4b518fd5360a01f2da1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c3625f-b5d5-4c72-b287-e221c97816ed service neutron] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c3625f-b5d5-4c72-b287-e221c97816ed service neutron] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c3625f-b5d5-4c72-b287-e221c97816ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c3625f-b5d5-4c72-b287-e221c97816ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c3625f-b5d5-4c72-b287-e221c97816ed service neutron] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:40 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1577/3181] 10.27.203.238 () {64 vars in 1432 bytes} [Tue May 28 13:01:40 2024] GET /identity/v3/auth/tokens => generated 2960 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 28 13:01:40 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-c53d1be8-b147-46d1-b9b3-95773c29c068 tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] http://10.27.203.238/share/v2/284d76edec3144579d6fb3f6dbc0dd4e/shares/31a95cfc-8903-4626-a21e-78ef575c96ed returned with HTTP 200 May 28 13:01:40 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1162/2295] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:01:40 2024] GET /share/v2/284d76edec3144579d6fb3f6dbc0dd4e/shares/31a95cfc-8903-4626-a21e-78ef575c96ed => generated 1317 bytes in 31 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:01:40 l75lg1-v1 neutron-server[77618]: INFO neutron.wsgi [None req-d8eb8ff8-2315-4aa8-b674-eae437f2d43e None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=91d671681dc346be86fefe8a8c75be74&name=default HTTP/1.1" status: 200 len: 216 time: 0.0766428 May 28 13:01:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504bff75-1de5-4eb5-aed3-c59c9a7d33a8 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-504bff75-1de5-4eb5-aed3-c59c9a7d33a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:01:40 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-760ad233-2ffc-454e-b082-a3584b72e346 tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] GET http://10.27.203.238/share/v2/284d76edec3144579d6fb3f6dbc0dd4e/shares/31a95cfc-8903-4626-a21e-78ef575c96ed May 28 13:01:40 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-760ad233-2ffc-454e-b082-a3584b72e346 tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:40 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-760ad233-2ffc-454e-b082-a3584b72e346 tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504bff75-1de5-4eb5-aed3-c59c9a7d33a8 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4379a8f-1c56-4833-8c79-6cf9d180d44d None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4379a8f-1c56-4833-8c79-6cf9d180d44d None admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4379a8f-1c56-4833-8c79-6cf9d180d44d None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4379a8f-1c56-4833-8c79-6cf9d180d44d None admin] PATH_INFO: `/v3/projects/91d671681dc346be86fefe8a8c75be74` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4379a8f-1c56-4833-8c79-6cf9d180d44d None admin] RBAC: Authorizing `identity:delete_project(project_id=91d671681dc346be86fefe8a8c75be74)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4379a8f-1c56-4833-8c79-6cf9d180d44d None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:40 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-760ad233-2ffc-454e-b082-a3584b72e346 tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] http://10.27.203.238/share/v2/284d76edec3144579d6fb3f6dbc0dd4e/shares/31a95cfc-8903-4626-a21e-78ef575c96ed returned with HTTP 200 May 28 13:01:40 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1134/2296] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:01:40 2024] GET /share/v2/284d76edec3144579d6fb3f6dbc0dd4e/shares/31a95cfc-8903-4626-a21e-78ef575c96ed => generated 1317 bytes in 31 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:01:40 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-e674221d-d435-48b2-ade6-eaaea8708f2c tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] GET http://10.27.203.238/share/v2/284d76edec3144579d6fb3f6dbc0dd4e/share-replicas/detail?share_id=31a95cfc-8903-4626-a21e-78ef575c96ed May 28 13:01:40 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-e674221d-d435-48b2-ade6-eaaea8708f2c tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:40 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-e674221d-d435-48b2-ade6-eaaea8708f2c tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:40 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-e674221d-d435-48b2-ade6-eaaea8708f2c tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] http://10.27.203.238/share/v2/284d76edec3144579d6fb3f6dbc0dd4e/share-replicas/detail?share_id=31a95cfc-8903-4626-a21e-78ef575c96ed returned with HTTP 200 May 28 13:01:40 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1163/2297] 10.27.203.238 () {64 vars in 1476 bytes} [Tue May 28 13:01:40 2024] GET /share/v2/284d76edec3144579d6fb3f6dbc0dd4e/share-replicas/detail?share_id=31a95cfc-8903-4626-a21e-78ef575c96ed => generated 22 bytes in 14 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:01:40 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-43577da0-e839-41a1-9f0d-32d626930298 tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] DELETE http://10.27.203.238/share/v2/284d76edec3144579d6fb3f6dbc0dd4e/shares/31a95cfc-8903-4626-a21e-78ef575c96ed May 28 13:01:40 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-43577da0-e839-41a1-9f0d-32d626930298 tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:40 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-43577da0-e839-41a1-9f0d-32d626930298 tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] Calling method 'ShareMixin.delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:40 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.v1.shares [None req-43577da0-e839-41a1-9f0d-32d626930298 tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] Delete share with id: 31a95cfc-8903-4626-a21e-78ef575c96ed May 28 13:01:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-b4379a8f-1c56-4833-8c79-6cf9d180d44d None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91d671681dc346be86fefe8a8c75be74', 'request_id': 'req-b4379a8f-1c56-4833-8c79-6cf9d180d44d'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-b4379a8f-1c56-4833-8c79-6cf9d180d44d None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91d671681dc346be86fefe8a8c75be74', 'request_id': 'req-b4379a8f-1c56-4833-8c79-6cf9d180d44d'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-b4379a8f-1c56-4833-8c79-6cf9d180d44d None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91d671681dc346be86fefe8a8c75be74', 'request_id': 'req-b4379a8f-1c56-4833-8c79-6cf9d180d44d'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-b4379a8f-1c56-4833-8c79-6cf9d180d44d None admin] The token cache is being invalidate because project 91d671681dc346be86fefe8a8c75be74 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 13:01:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-b4379a8f-1c56-4833-8c79-6cf9d180d44d None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-b4379a8f-1c56-4833-8c79-6cf9d180d44d None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:40 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1605/3182] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 13:01:40 2024] DELETE /identity/v3/projects/91d671681dc346be86fefe8a8c75be74 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:01:40 l75lg1-v1 neutron-server[77619]: DEBUG neutron.wsgi [-] (77619) accepted ('10.27.203.238', 34282) {{(pid=77619) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 13:01:40 l75lg1-v1 neutron-server[77619]: INFO neutron.wsgi [None req-d321688f-6396-484e-a85f-2ec6c507bfec None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=40625c7a855049188adc00ac1e323af7&name=default HTTP/1.1" status: 200 len: 216 time: 0.0095823 May 28 13:01:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c3625f-b5d5-4c72-b287-e221c97816ed service neutron] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c3625f-b5d5-4c72-b287-e221c97816ed service neutron] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c8f401-d969-43f0-be99-cb0312676f7f None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c8f401-d969-43f0-be99-cb0312676f7f None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c8f401-d969-43f0-be99-cb0312676f7f None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c8f401-d969-43f0-be99-cb0312676f7f None admin] PATH_INFO: `/v3/projects/40625c7a855049188adc00ac1e323af7` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c8f401-d969-43f0-be99-cb0312676f7f None admin] RBAC: Authorizing `identity:delete_project(project_id=40625c7a855049188adc00ac1e323af7)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c8f401-d969-43f0-be99-cb0312676f7f None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:40 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-43577da0-e839-41a1-9f0d-32d626930298 tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] http://10.27.203.238/share/v2/284d76edec3144579d6fb3f6dbc0dd4e/shares/31a95cfc-8903-4626-a21e-78ef575c96ed returned with HTTP 202 May 28 13:01:40 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1135/2298] 10.27.203.238 () {64 vars in 1454 bytes} [Tue May 28 13:01:40 2024] DELETE /share/v2/284d76edec3144579d6fb3f6dbc0dd4e/shares/31a95cfc-8903-4626-a21e-78ef575c96ed => generated 0 bytes in 139 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 13:01:40 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-8421e5e7-f449-4022-893f-594aa4f28eed tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] GET http://10.27.203.238/share/v2/284d76edec3144579d6fb3f6dbc0dd4e/shares/31a95cfc-8903-4626-a21e-78ef575c96ed May 28 13:01:40 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-8421e5e7-f449-4022-893f-594aa4f28eed tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:40 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-8421e5e7-f449-4022-893f-594aa4f28eed tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-b3c8f401-d969-43f0-be99-cb0312676f7f None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40625c7a855049188adc00ac1e323af7', 'request_id': 'req-b3c8f401-d969-43f0-be99-cb0312676f7f'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-b3c8f401-d969-43f0-be99-cb0312676f7f None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40625c7a855049188adc00ac1e323af7', 'request_id': 'req-b3c8f401-d969-43f0-be99-cb0312676f7f'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:40 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-8421e5e7-f449-4022-893f-594aa4f28eed tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] http://10.27.203.238/share/v2/284d76edec3144579d6fb3f6dbc0dd4e/shares/31a95cfc-8903-4626-a21e-78ef575c96ed returned with HTTP 200 May 28 13:01:40 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1164/2299] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:01:40 2024] GET /share/v2/284d76edec3144579d6fb3f6dbc0dd4e/shares/31a95cfc-8903-4626-a21e-78ef575c96ed => generated 1316 bytes in 29 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:01:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-b3c8f401-d969-43f0-be99-cb0312676f7f None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40625c7a855049188adc00ac1e323af7', 'request_id': 'req-b3c8f401-d969-43f0-be99-cb0312676f7f'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-b3c8f401-d969-43f0-be99-cb0312676f7f None admin] The token cache is being invalidate because project 40625c7a855049188adc00ac1e323af7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 13:01:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-b3c8f401-d969-43f0-be99-cb0312676f7f None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-b3c8f401-d969-43f0-be99-cb0312676f7f None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:40 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1578/3183] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 13:01:40 2024] DELETE /identity/v3/projects/40625c7a855049188adc00ac1e323af7 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:01:40 l75lg1-v1 neutron-server[77619]: DEBUG neutron.wsgi [-] (77619) accepted ('10.27.203.238', 34288) {{(pid=77619) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 13:01:40 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-43577da0-e839-41a1-9f0d-32d626930298 tempest-ShareTypeAvailabilityZonesTest-364532124 None] Acquiring lock "locked_access_rules_operation_by_share_instance_8e79dd09-ae5d-4631-a50f-7d8a06d71f8f" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:01:40 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-43577da0-e839-41a1-9f0d-32d626930298 tempest-ShareTypeAvailabilityZonesTest-364532124 None] Lock "locked_access_rules_operation_by_share_instance_8e79dd09-ae5d-4631-a50f-7d8a06d71f8f" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:01:40 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-43577da0-e839-41a1-9f0d-32d626930298 tempest-ShareTypeAvailabilityZonesTest-364532124 None] Lock "locked_access_rules_operation_by_share_instance_8e79dd09-ae5d-4631-a50f-7d8a06d71f8f" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.004s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:01:40 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-43577da0-e839-41a1-9f0d-32d626930298 tempest-ShareTypeAvailabilityZonesTest-364532124 None] Acquiring lock "locked_access_rules_operation_by_share_instance_8e79dd09-ae5d-4631-a50f-7d8a06d71f8f" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:01:40 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-43577da0-e839-41a1-9f0d-32d626930298 tempest-ShareTypeAvailabilityZonesTest-364532124 None] Lock "locked_access_rules_operation_by_share_instance_8e79dd09-ae5d-4631-a50f-7d8a06d71f8f" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:01:40 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-43577da0-e839-41a1-9f0d-32d626930298 tempest-ShareTypeAvailabilityZonesTest-364532124 None] Lock "locked_access_rules_operation_by_share_instance_8e79dd09-ae5d-4631-a50f-7d8a06d71f8f" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.004s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:01:40 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-43577da0-e839-41a1-9f0d-32d626930298 tempest-ShareTypeAvailabilityZonesTest-364532124 None] Acquiring lock "locked_access_rules_operation_by_share_instance_8e79dd09-ae5d-4631-a50f-7d8a06d71f8f" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:01:40 l75lg1-v1 neutron-server[77619]: INFO neutron.wsgi [None req-fbef79d7-c99b-43e5-ac3f-a44a6240da4b None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=0af6f8e0aeed4f27b075e08f2bc713aa&name=default HTTP/1.1" status: 200 len: 216 time: 0.0092218 May 28 13:01:40 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-43577da0-e839-41a1-9f0d-32d626930298 tempest-ShareTypeAvailabilityZonesTest-364532124 None] Lock "locked_access_rules_operation_by_share_instance_8e79dd09-ae5d-4631-a50f-7d8a06d71f8f" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:01:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4379a8f-1c56-4833-8c79-6cf9d180d44d None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:40 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-43577da0-e839-41a1-9f0d-32d626930298 tempest-ShareTypeAvailabilityZonesTest-364532124 None] Lock "locked_access_rules_operation_by_share_instance_8e79dd09-ae5d-4631-a50f-7d8a06d71f8f" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.004s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:01:41 l75lg1-v1 manila-share[98474]: DEBUG manila.share.access [None req-43577da0-e839-41a1-9f0d-32d626930298 tempest-ShareTypeAvailabilityZonesTest-364532124 None] All access rules have been synced for share instance 8e79dd09-ae5d-4631-a50f-7d8a06d71f8f belonging to share 31a95cfc-8903-4626-a21e-78ef575c96ed. {{(pid=98474) update_access_rules /opt/stack/manila/manila/share/access.py:304}} May 28 13:01:41 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-43577da0-e839-41a1-9f0d-32d626930298 tempest-ShareTypeAvailabilityZonesTest-364532124 None] deleting '/manila/manila-8e79dd09-ae5d-4631-a50f-7d8a06d71f8f' May 28 13:01:41 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-43577da0-e839-41a1-9f0d-32d626930298 tempest-ShareTypeAvailabilityZonesTest-364532124 None] >>> [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/ May 28 13:01:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-b4379a8f-1c56-4833-8c79-6cf9d180d44d None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:01:41 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-43577da0-e839-41a1-9f0d-32d626930298 tempest-ShareTypeAvailabilityZonesTest-364532124 None] {'data': '{"path": "/manila/manila-8e79dd09-ae5d-4631-a50f-7d8a06d71f8f"}', May 28 13:01:41 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-43577da0-e839-41a1-9f0d-32d626930298 tempest-ShareTypeAvailabilityZonesTest-364532124 None] 'params': None} May 28 13:01:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4379a8f-1c56-4833-8c79-6cf9d180d44d None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb608e09-1547-4cd8-bfd2-45cfb7775551 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb608e09-1547-4cd8-bfd2-45cfb7775551 None admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb608e09-1547-4cd8-bfd2-45cfb7775551 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb608e09-1547-4cd8-bfd2-45cfb7775551 None admin] PATH_INFO: `/v3/projects/0af6f8e0aeed4f27b075e08f2bc713aa` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb608e09-1547-4cd8-bfd2-45cfb7775551 None admin] RBAC: Authorizing `identity:delete_project(project_id=0af6f8e0aeed4f27b075e08f2bc713aa)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb608e09-1547-4cd8-bfd2-45cfb7775551 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-eb608e09-1547-4cd8-bfd2-45cfb7775551 None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0af6f8e0aeed4f27b075e08f2bc713aa', 'request_id': 'req-eb608e09-1547-4cd8-bfd2-45cfb7775551'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-eb608e09-1547-4cd8-bfd2-45cfb7775551 None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0af6f8e0aeed4f27b075e08f2bc713aa', 'request_id': 'req-eb608e09-1547-4cd8-bfd2-45cfb7775551'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:41 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-e562550e-8e54-47d3-80d6-a1e83c12ba41 tempest-ShareTransferTest-1224887522 tempest-ShareTransferTest-1224887522-project-member] GET http://10.27.203.238/share/v2/6570d95ff9704ae6a746d0fdc1bcfded/shares/3e8f600a-428f-49ef-9c9b-ce57939ca004 May 28 13:01:41 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-e562550e-8e54-47d3-80d6-a1e83c12ba41 tempest-ShareTransferTest-1224887522 tempest-ShareTransferTest-1224887522-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:41 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-e562550e-8e54-47d3-80d6-a1e83c12ba41 tempest-ShareTransferTest-1224887522 tempest-ShareTransferTest-1224887522-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-eb608e09-1547-4cd8-bfd2-45cfb7775551 None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0af6f8e0aeed4f27b075e08f2bc713aa', 'request_id': 'req-eb608e09-1547-4cd8-bfd2-45cfb7775551'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:41 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-43577da0-e839-41a1-9f0d-32d626930298 tempest-ShareTypeAvailabilityZonesTest-364532124 None] <<< [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/ May 28 13:01:41 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-43577da0-e839-41a1-9f0d-32d626930298 tempest-ShareTypeAvailabilityZonesTest-364532124 None] 'OK' May 28 13:01:41 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-43577da0-e839-41a1-9f0d-32d626930298 tempest-ShareTypeAvailabilityZonesTest-364532124 None] --- [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/: Done May 28 13:01:41 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-43577da0-e839-41a1-9f0d-32d626930298 tempest-ShareTypeAvailabilityZonesTest-364532124 None] >>> [GET] https://127.0.0.1:40443/api/views/ May 28 13:01:41 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-43577da0-e839-41a1-9f0d-32d626930298 tempest-ShareTypeAvailabilityZonesTest-364532124 None] {'allow_redirects': True, May 28 13:01:41 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-43577da0-e839-41a1-9f0d-32d626930298 tempest-ShareTypeAvailabilityZonesTest-364532124 None] 'params': {'name': '8e79dd09-ae5d-4631-a50f-7d8a06d71f8f'}} May 28 13:01:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-eb608e09-1547-4cd8-bfd2-45cfb7775551 None admin] The token cache is being invalidate because project 0af6f8e0aeed4f27b075e08f2bc713aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 13:01:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-eb608e09-1547-4cd8-bfd2-45cfb7775551 None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-eb608e09-1547-4cd8-bfd2-45cfb7775551 None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:41 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1606/3184] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 13:01:40 2024] DELETE /identity/v3/projects/0af6f8e0aeed4f27b075e08f2bc713aa => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:01:41 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-e562550e-8e54-47d3-80d6-a1e83c12ba41 tempest-ShareTransferTest-1224887522 tempest-ShareTransferTest-1224887522-project-member] http://10.27.203.238/share/v2/6570d95ff9704ae6a746d0fdc1bcfded/shares/3e8f600a-428f-49ef-9c9b-ce57939ca004 returned with HTTP 200 May 28 13:01:41 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1136/2300] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:01:41 2024] GET /share/v2/6570d95ff9704ae6a746d0fdc1bcfded/shares/3e8f600a-428f-49ef-9c9b-ce57939ca004 => generated 1315 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:01:41 l75lg1-v1 dstat.sh[49771]: 28-05 13:01:41| 13 2 82 3 0|5704M 1731M 278M 7912M| 16k 3048B| 0 2017k| 0 297 |7509 13k|1.28 1.20 1.07|3.0 1.0 0| 0 0 | 0 2048M| 29 363 0 37 2 May 28 13:01:41 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-43577da0-e839-41a1-9f0d-32d626930298 tempest-ShareTypeAvailabilityZonesTest-364532124 None] <<< [GET] https://127.0.0.1:40443/api/views/ May 28 13:01:41 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-43577da0-e839-41a1-9f0d-32d626930298 tempest-ShareTypeAvailabilityZonesTest-364532124 None] [Bunch(abac_tags=[], abe_max_depth=None, abe_protocols=[], alias='', allow_anonymous_access=False, allow_s3_anonymous_access=False, auto_commit='0d', bucket='', bucket_creators=[], bucket_creators_groups=[], bucket_owner=None, bulk_permission_update_progress=None, bulk_permission_update_state=None, cluster='loop75-kfs', cluster_id=1, created='2024-05-28T13:01:38.976154Z', enabled=True, files_retention_mode='NONE', guid='53725551-2ebc-4be5-bb62-042ee65a69a6', id=52, ignore_oos=False, internal=False, is_remote=False, is_seamless=False, logical_capacity=0, max_retention_period=None, min_retention_period=None, name='8e79dd09-ae5d-4631-a50f-7d8a06d71f8f', nfs_interop_flags='BOTH_NFS3_AND_NFS4_INTEROP_DISABLED', path='/manila/manila-8e79dd09-ae5d-4631-a50f-7d8a06d71f8f', physical_capacity=0, policy='8e79dd09-ae5d-4631-a50f-7d8a06d71f8f', policy_id=53, protocols=['NFS'], qos_policy=None, qos_policy_id=None, s3_locks=False, s3_locks_retention_mode='NONE', s3_locks_retention_period='', s3_unverified_lookup=False, s3_versioning=False, select_for_live_monitoring=False, share='', share_acl=Bunch(acl=[], enabled=False), sync='SYNCED', sync_time='2024-05-28T13:01:39.237106Z', tenant_id=1, tenant_name='default', title='/manila/manila-8e79dd09-ae5d-4631-a50f-7d8a06d71f8f', url='https://127.0.0.1:40443/api/views/52/')] May 28 13:01:41 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-43577da0-e839-41a1-9f0d-32d626930298 tempest-ShareTypeAvailabilityZonesTest-364532124 None] --- [GET] https://127.0.0.1:40443/api/views/: Done May 28 13:01:41 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-43577da0-e839-41a1-9f0d-32d626930298 tempest-ShareTypeAvailabilityZonesTest-364532124 None] >>> [DELETE] https://127.0.0.1:40443/api/views/52/ May 28 13:01:41 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bcc05c98-648e-4146-8d10-45b973733306 tempest-ShareTransferTest-1224887522 None] <<< [DELETE] https://127.0.0.1:40443/api/quotas/49/ May 28 13:01:41 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bcc05c98-648e-4146-8d10-45b973733306 tempest-ShareTransferTest-1224887522 None] --- [DELETE] https://127.0.0.1:40443/api/quotas/49/: Done May 28 13:01:41 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bcc05c98-648e-4146-8d10-45b973733306 tempest-ShareTransferTest-1224887522 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:01:41 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bcc05c98-648e-4146-8d10-45b973733306 tempest-ShareTransferTest-1224887522 None] {'allow_redirects': True, May 28 13:01:41 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bcc05c98-648e-4146-8d10-45b973733306 tempest-ShareTransferTest-1224887522 None] 'params': {'name': '8b23337a-8316-428a-8f0b-4c29a85c8409'}} May 28 13:01:42 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bcc05c98-648e-4146-8d10-45b973733306 tempest-ShareTransferTest-1224887522 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:01:42 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bcc05c98-648e-4146-8d10-45b973733306 tempest-ShareTransferTest-1224887522 None] [Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=0, created='2024-05-28T13:01:29.038608Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='db9ac8a9-808f-4bcb-9f18-a660fbbc086f', id=52, internal=False, is_s3_default_policy=False, name='8b23337a-8316-428a-8f0b-4c29a85c8409', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=[], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['*'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['*'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T13:01:29.391116Z', tenant_id=1, tenant_name='default', title='8b23337a-8316-428a-8f0b-4c29a85c8409', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/52/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[])] May 28 13:01:42 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bcc05c98-648e-4146-8d10-45b973733306 tempest-ShareTransferTest-1224887522 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 13:01:42 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bcc05c98-648e-4146-8d10-45b973733306 tempest-ShareTransferTest-1224887522 None] >>> [DELETE] https://127.0.0.1:40443/api/viewpolicies/52/ May 28 13:01:42 l75lg1-v1 dstat.sh[49771]: 28-05 13:01:42| 3 0 95 1 0|5633M 1801M 278M 7912M| 20k 2039B| 0 934k| 0 90.1 |2431 3840 |1.18 1.18 1.07|1.0 1.0 0| 0 0 | 0 2048M| 29 363 0 37 2 May 28 13:01:42 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-cb4b1d6d-1351-45ad-9ce4-c09b25f52f46 tempest-ShareRulesTest-1530341375 None] <<< [PATCH] https://127.0.0.1:40443/api/viewpolicies/38/ May 28 13:01:42 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-cb4b1d6d-1351-45ad-9ce4-c09b25f52f46 tempest-ShareRulesTest-1530341375 None] Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=1, created='2024-05-28T12:59:53.824250Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='0fa84ccd-850f-48fa-a965-23e5abe31188', id=38, internal=False, is_s3_default_policy=False, name='f7e47502-a0f7-44de-953d-b7b5697ae0b2', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=['*'], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['203.0.113.77'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['203.0.113.77'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='MODIFYING', sync_time='2024-05-28T13:01:41.725054Z', tenant_id=1, tenant_name='default', title='f7e47502-a0f7-44de-953d-b7b5697ae0b2', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/38/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[]) May 28 13:01:42 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-cb4b1d6d-1351-45ad-9ce4-c09b25f52f46 tempest-ShareRulesTest-1530341375 None] --- [PATCH] https://127.0.0.1:40443/api/viewpolicies/38/: Done May 28 13:01:42 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-cb4b1d6d-1351-45ad-9ce4-c09b25f52f46 tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:01:42 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-cb4b1d6d-1351-45ad-9ce4-c09b25f52f46 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:01:42 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-cb4b1d6d-1351-45ad-9ce4-c09b25f52f46 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.075s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:01:42 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-cb4b1d6d-1351-45ad-9ce4-c09b25f52f46 tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:01:42 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-cb4b1d6d-1351-45ad-9ce4-c09b25f52f46 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:01:42 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-cb4b1d6d-1351-45ad-9ce4-c09b25f52f46 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:01:42 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-cb4b1d6d-1351-45ad-9ce4-c09b25f52f46 tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:01:42 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-cb4b1d6d-1351-45ad-9ce4-c09b25f52f46 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:01:42 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-cb4b1d6d-1351-45ad-9ce4-c09b25f52f46 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.004s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:01:42 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-cb4b1d6d-1351-45ad-9ce4-c09b25f52f46 tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:01:42 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-cb4b1d6d-1351-45ad-9ce4-c09b25f52f46 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:01:42 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-cb4b1d6d-1351-45ad-9ce4-c09b25f52f46 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:01:42 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-cb4b1d6d-1351-45ad-9ce4-c09b25f52f46 tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:01:42 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-cb4b1d6d-1351-45ad-9ce4-c09b25f52f46 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:01:42 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-cb4b1d6d-1351-45ad-9ce4-c09b25f52f46 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.048s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:01:42 l75lg1-v1 manila-share[98474]: INFO manila.share.access [None req-cb4b1d6d-1351-45ad-9ce4-c09b25f52f46 tempest-ShareRulesTest-1530341375 None] Access rules were successfully modified for share instance f7e47502-a0f7-44de-953d-b7b5697ae0b2 belonging to share b330db31-7766-443d-9c19-26fe349665aa. May 28 13:01:43 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-a4c08f99-1d68-45dc-85c5-1f4068c83fbd tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] GET http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/share-access-rules?share_id=b330db31-7766-443d-9c19-26fe349665aa May 28 13:01:43 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-a4c08f99-1d68-45dc-85c5-1f4068c83fbd tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:43 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-a4c08f99-1d68-45dc-85c5-1f4068c83fbd tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:43 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.lock.api [None req-a4c08f99-1d68-45dc-85c5-1f4068c83fbd tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Searching for locks by: {'resource_id': '6944eff2-e480-4713-8b27-1213fe6945dd', 'resource_action': 'show', 'resource_type': 'access_rule'} {{(pid=98329) get_all /opt/stack/manila/manila/lock/api.py:112}} May 28 13:01:43 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-a4c08f99-1d68-45dc-85c5-1f4068c83fbd tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/share-access-rules?share_id=b330db31-7766-443d-9c19-26fe349665aa returned with HTTP 200 May 28 13:01:43 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1165/2301] 10.27.203.238 () {64 vars in 1467 bytes} [Tue May 28 13:01:43 2024] GET /share/v2/a4f3887fa28c457390f5b66615564430/share-access-rules?share_id=b330db31-7766-443d-9c19-26fe349665aa => generated 306 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:01:43 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-f6297409-6ead-4618-8534-6628a5a01ae2 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] GET http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/share-access-rules?share_id=b330db31-7766-443d-9c19-26fe349665aa May 28 13:01:43 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-f6297409-6ead-4618-8534-6628a5a01ae2 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:43 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-f6297409-6ead-4618-8534-6628a5a01ae2 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:43 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.lock.api [None req-f6297409-6ead-4618-8534-6628a5a01ae2 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Searching for locks by: {'resource_id': '6944eff2-e480-4713-8b27-1213fe6945dd', 'resource_action': 'show', 'resource_type': 'access_rule'} {{(pid=98330) get_all /opt/stack/manila/manila/lock/api.py:112}} May 28 13:01:43 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-f6297409-6ead-4618-8534-6628a5a01ae2 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/share-access-rules?share_id=b330db31-7766-443d-9c19-26fe349665aa returned with HTTP 200 May 28 13:01:43 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1137/2302] 10.27.203.238 () {64 vars in 1467 bytes} [Tue May 28 13:01:43 2024] GET /share/v2/a4f3887fa28c457390f5b66615564430/share-access-rules?share_id=b330db31-7766-443d-9c19-26fe349665aa => generated 306 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:01:43 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-7ab5a6e2-6047-4089-9481-e7f477151ef6 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] POST http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/shares/b330db31-7766-443d-9c19-26fe349665aa/action May 28 13:01:43 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-7ab5a6e2-6047-4089-9481-e7f477151ef6 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Action body: b'{"deny_access": {"access_id": "6944eff2-e480-4713-8b27-1213fe6945dd"}}' {{(pid=98329) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 13:01:43 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-7ab5a6e2-6047-4089-9481-e7f477151ef6 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Action: 'action', calling method: ShareController.deny_access, body: {"deny_access": {"access_id": "6944eff2-e480-4713-8b27-1213fe6945dd"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:01:43 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.lock.api [None req-7ab5a6e2-6047-4089-9481-e7f477151ef6 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Searching for locks by: {'resource_id': '6944eff2-e480-4713-8b27-1213fe6945dd', 'resource_action': 'delete'} {{(pid=98329) get_all /opt/stack/manila/manila/lock/api.py:112}} May 28 13:01:43 l75lg1-v1 devstack@m-api.service[98329]: DEBUG oslo_concurrency.lockutils [None req-7ab5a6e2-6047-4089-9481-e7f477151ef6 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98329) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:01:43 l75lg1-v1 devstack@m-api.service[98329]: DEBUG oslo_concurrency.lockutils [None req-7ab5a6e2-6047-4089-9481-e7f477151ef6 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98329) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:01:43 l75lg1-v1 devstack@m-api.service[98329]: DEBUG oslo_concurrency.lockutils [None req-7ab5a6e2-6047-4089-9481-e7f477151ef6 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.038s {{(pid=98329) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:01:43 l75lg1-v1 devstack@m-api.service[98329]: DEBUG oslo_concurrency.lockutils [None req-7ab5a6e2-6047-4089-9481-e7f477151ef6 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98329) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:01:43 l75lg1-v1 devstack@m-api.service[98329]: DEBUG oslo_concurrency.lockutils [None req-7ab5a6e2-6047-4089-9481-e7f477151ef6 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98329) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:01:43 l75lg1-v1 dstat.sh[49771]: 28-05 13:01:43| 4 1 94 1 0|5634M 1801M 278M 7912M| 13k 66B| 0 864k| 0 105 |2992 5018 |1.18 1.18 1.07|2.0 2.0 0| 0 0 | 0 2048M| 29 364 0 36 2 May 28 13:01:43 l75lg1-v1 devstack@m-api.service[98329]: DEBUG oslo_concurrency.lockutils [None req-7ab5a6e2-6047-4089-9481-e7f477151ef6 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.078s {{(pid=98329) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:01:43 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-7ab5a6e2-6047-4089-9481-e7f477151ef6 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/shares/b330db31-7766-443d-9c19-26fe349665aa/action returned with HTTP 202 May 28 13:01:43 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1166/2303] 10.27.203.238 () {66 vars in 1493 bytes} [Tue May 28 13:01:43 2024] POST /share/v2/a4f3887fa28c457390f5b66615564430/shares/b330db31-7766-443d-9c19-26fe349665aa/action => generated 0 bytes in 200 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 13:01:43 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-f407d80d-34e5-4fbf-b1b3-e8e7b15c8917 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] GET http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/share-access-rules?share_id=b330db31-7766-443d-9c19-26fe349665aa May 28 13:01:43 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-f407d80d-34e5-4fbf-b1b3-e8e7b15c8917 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:43 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-f407d80d-34e5-4fbf-b1b3-e8e7b15c8917 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:43 l75lg1-v1 manila-share[98474]: DEBUG manila.share.manager [None req-7ab5a6e2-6047-4089-9481-e7f477151ef6 tempest-ShareRulesTest-1530341375 None] Received request to update access for share instance f7e47502-a0f7-44de-953d-b7b5697ae0b2. {{(pid=98474) update_access_for_instances /opt/stack/manila/manila/share/manager.py:4353}} May 28 13:01:43 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-7ab5a6e2-6047-4089-9481-e7f477151ef6 tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:01:43 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-7ab5a6e2-6047-4089-9481-e7f477151ef6 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:01:43 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.lock.api [None req-f407d80d-34e5-4fbf-b1b3-e8e7b15c8917 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Searching for locks by: {'resource_id': '6944eff2-e480-4713-8b27-1213fe6945dd', 'resource_action': 'show', 'resource_type': 'access_rule'} {{(pid=98330) get_all /opt/stack/manila/manila/lock/api.py:112}} May 28 13:01:43 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-7ab5a6e2-6047-4089-9481-e7f477151ef6 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.004s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:01:43 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-7ab5a6e2-6047-4089-9481-e7f477151ef6 tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:01:43 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-7ab5a6e2-6047-4089-9481-e7f477151ef6 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:01:43 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-f407d80d-34e5-4fbf-b1b3-e8e7b15c8917 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/share-access-rules?share_id=b330db31-7766-443d-9c19-26fe349665aa returned with HTTP 200 May 28 13:01:43 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1138/2304] 10.27.203.238 () {64 vars in 1467 bytes} [Tue May 28 13:01:43 2024] GET /share/v2/a4f3887fa28c457390f5b66615564430/share-access-rules?share_id=b330db31-7766-443d-9c19-26fe349665aa => generated 314 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:01:43 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-7ab5a6e2-6047-4089-9481-e7f477151ef6 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.083s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:01:43 l75lg1-v1 manila-share[98474]: DEBUG manila.share.access [None req-7ab5a6e2-6047-4089-9481-e7f477151ef6 tempest-ShareRulesTest-1530341375 None] Updating access rules for share instance f7e47502-a0f7-44de-953d-b7b5697ae0b2 belonging to share b330db31-7766-443d-9c19-26fe349665aa. {{(pid=98474) update_access_rules /opt/stack/manila/manila/share/access.py:298}} May 28 13:01:43 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-7ab5a6e2-6047-4089-9481-e7f477151ef6 tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:01:43 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-7ab5a6e2-6047-4089-9481-e7f477151ef6 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:01:43 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-7ab5a6e2-6047-4089-9481-e7f477151ef6 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.009s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:01:43 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-7ab5a6e2-6047-4089-9481-e7f477151ef6 tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:01:43 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-7ab5a6e2-6047-4089-9481-e7f477151ef6 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:01:43 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-7ab5a6e2-6047-4089-9481-e7f477151ef6 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.022s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:01:43 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-7ab5a6e2-6047-4089-9481-e7f477151ef6 tempest-ShareRulesTest-1530341375 None] changing access on None May 28 13:01:43 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-7ab5a6e2-6047-4089-9481-e7f477151ef6 tempest-ShareRulesTest-1530341375 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:01:43 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-7ab5a6e2-6047-4089-9481-e7f477151ef6 tempest-ShareRulesTest-1530341375 None] {'allow_redirects': True, May 28 13:01:43 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-7ab5a6e2-6047-4089-9481-e7f477151ef6 tempest-ShareRulesTest-1530341375 None] 'params': {'name': 'f7e47502-a0f7-44de-953d-b7b5697ae0b2'}} May 28 13:01:43 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bcc05c98-648e-4146-8d10-45b973733306 tempest-ShareTransferTest-1224887522 None] <<< [DELETE] https://127.0.0.1:40443/api/viewpolicies/52/ May 28 13:01:43 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bcc05c98-648e-4146-8d10-45b973733306 tempest-ShareTransferTest-1224887522 None] --- [DELETE] https://127.0.0.1:40443/api/viewpolicies/52/: Done May 28 13:01:43 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-7ab5a6e2-6047-4089-9481-e7f477151ef6 tempest-ShareRulesTest-1530341375 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:01:43 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-7ab5a6e2-6047-4089-9481-e7f477151ef6 tempest-ShareRulesTest-1530341375 None] [Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=1, created='2024-05-28T12:59:53.824250Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='0fa84ccd-850f-48fa-a965-23e5abe31188', id=38, internal=False, is_s3_default_policy=False, name='f7e47502-a0f7-44de-953d-b7b5697ae0b2', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=['*'], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['203.0.113.77'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['203.0.113.77'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T13:01:42.251068Z', tenant_id=1, tenant_name='default', title='f7e47502-a0f7-44de-953d-b7b5697ae0b2', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/38/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[])] May 28 13:01:43 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-7ab5a6e2-6047-4089-9481-e7f477151ef6 tempest-ShareRulesTest-1530341375 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 13:01:43 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-7ab5a6e2-6047-4089-9481-e7f477151ef6 tempest-ShareRulesTest-1530341375 None] changing access on /manila/manila-f7e47502-a0f7-44de-953d-b7b5697ae0b2. Rules: {'nfs_read_write': [], 'nfs_read_only': []} May 28 13:01:43 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-7ab5a6e2-6047-4089-9481-e7f477151ef6 tempest-ShareRulesTest-1530341375 None] >>> [PATCH] https://127.0.0.1:40443/api/viewpolicies/38/ May 28 13:01:43 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-7ab5a6e2-6047-4089-9481-e7f477151ef6 tempest-ShareRulesTest-1530341375 None] {'data': '{"name": "f7e47502-a0f7-44de-953d-b7b5697ae0b2", "nfs_no_squash": ' May 28 13:01:43 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-7ab5a6e2-6047-4089-9481-e7f477151ef6 tempest-ShareRulesTest-1530341375 None] '["*"], "nfs_root_squash": ["*"], "nfs_read_write": [], ' May 28 13:01:43 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-7ab5a6e2-6047-4089-9481-e7f477151ef6 tempest-ShareRulesTest-1530341375 None] '"nfs_read_only": []}', May 28 13:01:43 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-7ab5a6e2-6047-4089-9481-e7f477151ef6 tempest-ShareRulesTest-1530341375 None] 'params': None} May 28 13:01:43 l75lg1-v1 manila-share[98474]: DEBUG manila.db.sqlalchemy.api [None req-bcc05c98-648e-4146-8d10-45b973733306 tempest-ShareTransferTest-1224887522 None] quota_usages out of sync, updating. project_id: 6570d95ff9704ae6a746d0fdc1bcfded, user_id: None, share_type_id: a09b56f4-f387-46cd-bf2b-e2ebf52c35df, resource: gigabytes, tracked usage: 0, actual usage: 1 {{(pid=98474) _quota_reserve /opt/stack/manila/manila/db/sqlalchemy/api.py:1281}} May 28 13:01:43 l75lg1-v1 manila-share[98474]: DEBUG manila.db.sqlalchemy.api [None req-bcc05c98-648e-4146-8d10-45b973733306 tempest-ShareTransferTest-1224887522 None] quota_usages out of sync, updating. project_id: 6570d95ff9704ae6a746d0fdc1bcfded, user_id: None, share_type_id: a09b56f4-f387-46cd-bf2b-e2ebf52c35df, resource: shares, tracked usage: 0, actual usage: 1 {{(pid=98474) _quota_reserve /opt/stack/manila/manila/db/sqlalchemy/api.py:1281}} May 28 13:01:43 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-43577da0-e839-41a1-9f0d-32d626930298 tempest-ShareTypeAvailabilityZonesTest-364532124 None] <<< [DELETE] https://127.0.0.1:40443/api/views/52/ May 28 13:01:43 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-43577da0-e839-41a1-9f0d-32d626930298 tempest-ShareTypeAvailabilityZonesTest-364532124 None] --- [DELETE] https://127.0.0.1:40443/api/views/52/: Done May 28 13:01:43 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-43577da0-e839-41a1-9f0d-32d626930298 tempest-ShareTypeAvailabilityZonesTest-364532124 None] >>> [GET] https://127.0.0.1:40443/api/quotas/ May 28 13:01:43 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-43577da0-e839-41a1-9f0d-32d626930298 tempest-ShareTypeAvailabilityZonesTest-364532124 None] {'allow_redirects': True, May 28 13:01:43 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-43577da0-e839-41a1-9f0d-32d626930298 tempest-ShareTypeAvailabilityZonesTest-364532124 None] 'params': {'name': '8e79dd09-ae5d-4631-a50f-7d8a06d71f8f'}} May 28 13:01:43 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-bcc05c98-648e-4146-8d10-45b973733306 tempest-ShareTransferTest-1224887522 None] Created reservations ['47bde520-e49f-4568-af60-2cb58b603be8', 'd1b50ff9-26a5-4144-9879-b5d2532e821c', '93056bac-e98d-4d1e-ae79-1ff461e7460c', '59f97cdd-f64f-4fae-ac66-888ec966269a'] {{(pid=98474) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 13:01:43 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-d1914239-0318-4f13-b3cb-e2205082130d tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] GET http://10.27.203.238/share/v2/284d76edec3144579d6fb3f6dbc0dd4e/shares/31a95cfc-8903-4626-a21e-78ef575c96ed May 28 13:01:43 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-d1914239-0318-4f13-b3cb-e2205082130d tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:43 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-d1914239-0318-4f13-b3cb-e2205082130d tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:43 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-bcc05c98-648e-4146-8d10-45b973733306 tempest-ShareTransferTest-1224887522 None] Committed reservations ['47bde520-e49f-4568-af60-2cb58b603be8', 'd1b50ff9-26a5-4144-9879-b5d2532e821c', '93056bac-e98d-4d1e-ae79-1ff461e7460c', '59f97cdd-f64f-4fae-ac66-888ec966269a'] {{(pid=98474) commit /opt/stack/manila/manila/quota.py:1063}} May 28 13:01:43 l75lg1-v1 manila-share[98474]: INFO manila.share.manager [None req-bcc05c98-648e-4146-8d10-45b973733306 tempest-ShareTransferTest-1224887522 None] Share instance 8b23337a-8316-428a-8f0b-4c29a85c8409: deleted successfully. May 28 13:01:43 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-d1914239-0318-4f13-b3cb-e2205082130d tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] http://10.27.203.238/share/v2/284d76edec3144579d6fb3f6dbc0dd4e/shares/31a95cfc-8903-4626-a21e-78ef575c96ed returned with HTTP 200 May 28 13:01:43 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1167/2305] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:01:43 2024] GET /share/v2/284d76edec3144579d6fb3f6dbc0dd4e/shares/31a95cfc-8903-4626-a21e-78ef575c96ed => generated 1316 bytes in 27 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:01:44 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-960d1dbb-3095-4efe-86b2-72ff9b6dcdc9 tempest-ShareTransferTest-1224887522 tempest-ShareTransferTest-1224887522-project-member] GET http://10.27.203.238/share/v2/6570d95ff9704ae6a746d0fdc1bcfded/shares/3e8f600a-428f-49ef-9c9b-ce57939ca004 May 28 13:01:44 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-960d1dbb-3095-4efe-86b2-72ff9b6dcdc9 tempest-ShareTransferTest-1224887522 tempest-ShareTransferTest-1224887522-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:44 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-960d1dbb-3095-4efe-86b2-72ff9b6dcdc9 tempest-ShareTransferTest-1224887522 tempest-ShareTransferTest-1224887522-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:44 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-960d1dbb-3095-4efe-86b2-72ff9b6dcdc9 tempest-ShareTransferTest-1224887522 tempest-ShareTransferTest-1224887522-project-member] HTTP exception thrown: The resource could not be found. May 28 13:01:44 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-960d1dbb-3095-4efe-86b2-72ff9b6dcdc9 tempest-ShareTransferTest-1224887522 tempest-ShareTransferTest-1224887522-project-member] http://10.27.203.238/share/v2/6570d95ff9704ae6a746d0fdc1bcfded/shares/3e8f600a-428f-49ef-9c9b-ce57939ca004 returned with HTTP 404 May 28 13:01:44 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1139/2306] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:01:44 2024] GET /share/v2/6570d95ff9704ae6a746d0fdc1bcfded/shares/3e8f600a-428f-49ef-9c9b-ce57939ca004 => generated 78 bytes in 11 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 13:01:44 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-e2e5707c-fca2-4a0b-a498-cd94e1c8eddb tempest-ShareTransferTest-320553121 tempest-ShareTransferTest-320553121-project-member] POST http://10.27.203.238/share/v2/bece16f41fc44d55bf7bc45c2adaaed5/shares May 28 13:01:44 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-e2e5707c-fca2-4a0b-a498-cd94e1c8eddb tempest-ShareTransferTest-320553121 tempest-ShareTransferTest-320553121-project-member] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share": {"share_proto": "nfs", "description": "Tempest's share", "snapshot_id": null, "name": "tempest-tempest-share-name-1262959588", "size": 1, "metadata": {}, "is_public": false, "share_type": "a09b56f4-f387-46cd-bf2b-e2ebf52c35df"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:01:44 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.v1.shares [None req-e2e5707c-fca2-4a0b-a498-cd94e1c8eddb tempest-ShareTransferTest-320553121 tempest-ShareTransferTest-320553121-project-member] Create NFS share of 1 GB May 28 13:01:44 l75lg1-v1 dstat.sh[49771]: 28-05 13:01:44| 6 1 88 4 0|5634M 1800M 278M 7912M| 14k 6939B| 0 6114k| 0 528 |4774 8338 |1.18 1.18 1.07|2.0 1.0 0| 0 0 | 0 2048M| 29 364 0 36 2 May 28 13:01:44 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-43577da0-e839-41a1-9f0d-32d626930298 tempest-ShareTypeAvailabilityZonesTest-364532124 None] <<< [GET] https://127.0.0.1:40443/api/quotas/ May 28 13:01:44 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-43577da0-e839-41a1-9f0d-32d626930298 tempest-ShareTypeAvailabilityZonesTest-364532124 None] [Bunch(cluster='loop75-kfs', cluster_id=1, default_email=None, default_group_quota=None, default_user_quota=None, enable_alarms=True, enable_email_providers=True, grace_period=None, guid='3c65beac-6dfd-4f2b-a173-4c47e3a6983d', hard_limit=1073741824, hard_limit_inodes=None, id=50, internal=False, is_user_quota=False, last_user_quotas_update=None, name='8e79dd09-ae5d-4631-a50f-7d8a06d71f8f', num_blocked_users=0, num_exceeded_users=0, path='/manila/manila-8e79dd09-ae5d-4631-a50f-7d8a06d71f8f', percent_capacity=0, percent_inodes=None, pretty_grace_period=None, pretty_grace_period_expiration=None, pretty_state='OK (Calculating)', soft_limit=None, soft_limit_inodes=None, state='OK', sync_state='Calculating', system_id=50, tenant_id=1, tenant_name='default', time_to_block=None, title='8e79dd09-ae5d-4631-a50f-7d8a06d71f8f', url='https://127.0.0.1:40443/api/quotas/50/', used_capacity=0, used_capacity_tb=0.0, used_effective_capacity=0, used_effective_capacity_tb=0.0, used_inodes=0, used_limited_capacity=0)] May 28 13:01:44 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-43577da0-e839-41a1-9f0d-32d626930298 tempest-ShareTypeAvailabilityZonesTest-364532124 None] --- [GET] https://127.0.0.1:40443/api/quotas/: Done May 28 13:01:44 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-43577da0-e839-41a1-9f0d-32d626930298 tempest-ShareTypeAvailabilityZonesTest-364532124 None] >>> [DELETE] https://127.0.0.1:40443/api/quotas/50/ May 28 13:01:44 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.quota [None req-e2e5707c-fca2-4a0b-a498-cd94e1c8eddb tempest-ShareTransferTest-320553121 tempest-ShareTransferTest-320553121-project-member] Created reservations ['3da5e10e-ed19-4066-ab42-aa90db6b4a2e', '2a54268f-c1bb-444b-bcd5-6e0ff7e1f549', '5af960ba-ce8f-4fcf-bf02-9aa5251cd607', '88d1b890-34e5-43ed-820b-f1de71aee756'] {{(pid=98329) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 13:01:44 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.quota [None req-e2e5707c-fca2-4a0b-a498-cd94e1c8eddb tempest-ShareTransferTest-320553121 tempest-ShareTransferTest-320553121-project-member] Committed reservations ['3da5e10e-ed19-4066-ab42-aa90db6b4a2e', '2a54268f-c1bb-444b-bcd5-6e0ff7e1f549', '5af960ba-ce8f-4fcf-bf02-9aa5251cd607', '88d1b890-34e5-43ed-820b-f1de71aee756'] {{(pid=98329) commit /opt/stack/manila/manila/quota.py:1063}} May 28 13:01:44 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.host_manager [None req-e2e5707c-fca2-4a0b-a498-cd94e1c8eddb tempest-ShareTransferTest-320553121 None] Share service is down. (host: l75lg1-v1@generic2). May 28 13:01:44 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.host_manager [None req-e2e5707c-fca2-4a0b-a498-cd94e1c8eddb tempest-ShareTransferTest-320553121 None] Share service is down. (host: l75lg1-v1@generic1). May 28 13:01:44 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-e2e5707c-fca2-4a0b-a498-cd94e1c8eddb tempest-ShareTransferTest-320553121 None] Starting with 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:80}} May 28 13:01:44 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-e2e5707c-fca2-4a0b-a498-cd94e1c8eddb tempest-ShareTransferTest-320553121 None] Filter OnlyHostFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:01:44 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-e2e5707c-fca2-4a0b-a498-cd94e1c8eddb tempest-ShareTransferTest-320553121 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:01:44 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.capacity [None req-e2e5707c-fca2-4a0b-a498-cd94e1c8eddb tempest-ShareTransferTest-320553121 None] Space information for share creation on host l75lg1-v1@vast#vast (requested / avail): 1/2075 {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/capacity.py:83}} May 28 13:01:44 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-e2e5707c-fca2-4a0b-a498-cd94e1c8eddb tempest-ShareTransferTest-320553121 None] Filter CapacityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:01:44 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-e2e5707c-fca2-4a0b-a498-cd94e1c8eddb tempest-ShareTransferTest-320553121 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:01:44 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-e2e5707c-fca2-4a0b-a498-cd94e1c8eddb tempest-ShareTransferTest-320553121 None] Driver Filter: Checking host 'l75lg1-v1@vast#vast' {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:37}} May 28 13:01:44 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-e2e5707c-fca2-4a0b-a498-cd94e1c8eddb tempest-ShareTransferTest-320553121 None] Filter function not set :: passing host. {{(pid=98327) _check_filter_function /opt/stack/manila/manila/scheduler/filters/driver.py:53}} May 28 13:01:44 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-e2e5707c-fca2-4a0b-a498-cd94e1c8eddb tempest-ShareTransferTest-320553121 None] Result: True {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:40}} May 28 13:01:44 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-e2e5707c-fca2-4a0b-a498-cd94e1c8eddb tempest-ShareTransferTest-320553121 None] Done checking host 'l75lg1-v1@vast#vast' {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:41}} May 28 13:01:44 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-e2e5707c-fca2-4a0b-a498-cd94e1c8eddb tempest-ShareTransferTest-320553121 None] Filter DriverFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:01:44 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-e2e5707c-fca2-4a0b-a498-cd94e1c8eddb tempest-ShareTransferTest-320553121 None] Filter ShareReplicationFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:01:44 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-e2e5707c-fca2-4a0b-a498-cd94e1c8eddb tempest-ShareTransferTest-320553121 None] Filter CreateFromSnapshotFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:01:44 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-e2e5707c-fca2-4a0b-a498-cd94e1c8eddb tempest-ShareTransferTest-320553121 None] Filter AffinityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:01:44 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-e2e5707c-fca2-4a0b-a498-cd94e1c8eddb tempest-ShareTransferTest-320553121 None] Filter AntiAffinityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:01:44 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.drivers.filter [None req-e2e5707c-fca2-4a0b-a498-cd94e1c8eddb tempest-ShareTransferTest-320553121 None] Filtered share [host: 'l75lg1-v1@vast#vast', free_capacity_gb: 2075.6277076322585, pools: None] {{(pid=98327) _schedule_share /opt/stack/manila/manila/scheduler/drivers/filter.py:268}} May 28 13:01:44 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-e2e5707c-fca2-4a0b-a498-cd94e1c8eddb tempest-ShareTransferTest-320553121 None] Checking host 'l75lg1-v1@vast#vast' {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:46}} May 28 13:01:44 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.weighers.goodness [None req-e2e5707c-fca2-4a0b-a498-cd94e1c8eddb tempest-ShareTransferTest-320553121 None] Goodness function not set :: defaulting to minimal goodness rating of 0. May 28 13:01:44 l75lg1-v1 manila-scheduler[98327]: INFO manila.scheduler.weighers.goodness [None req-e2e5707c-fca2-4a0b-a498-cd94e1c8eddb tempest-ShareTransferTest-320553121 None] Goodness function result for host l75lg1-v1@vast#vast: 0. May 28 13:01:44 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-e2e5707c-fca2-4a0b-a498-cd94e1c8eddb tempest-ShareTransferTest-320553121 None] Goodness: 0 {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:48}} May 28 13:01:44 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-e2e5707c-fca2-4a0b-a498-cd94e1c8eddb tempest-ShareTransferTest-320553121 None] Done checking host 'l75lg1-v1@vast#vast' {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:49}} May 28 13:01:44 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.drivers.filter [None req-e2e5707c-fca2-4a0b-a498-cd94e1c8eddb tempest-ShareTransferTest-320553121 None] Choosing for share: WeighedHost [host: l75lg1-v1@vast#vast, weight: 0.0] {{(pid=98327) _schedule_share /opt/stack/manila/manila/scheduler/drivers/filter.py:274}} May 28 13:01:44 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-e2e5707c-fca2-4a0b-a498-cd94e1c8eddb tempest-ShareTransferTest-320553121 tempest-ShareTransferTest-320553121-project-member] http://10.27.203.238/share/v2/bece16f41fc44d55bf7bc45c2adaaed5/shares returned with HTTP 200 May 28 13:01:44 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1168/2307] 10.27.203.238 () {66 vars in 1362 bytes} [Tue May 28 13:01:44 2024] POST /share/v2/bece16f41fc44d55bf7bc45c2adaaed5/shares => generated 1311 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:01:44 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-604ae012-d6ab-475d-b30a-25b3b92ae226 tempest-ShareTransferTest-320553121 tempest-ShareTransferTest-320553121-project-member] GET http://10.27.203.238/share/v2/bece16f41fc44d55bf7bc45c2adaaed5/shares/de6cdc3c-7cf5-437f-acad-57530196bb54 May 28 13:01:44 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-604ae012-d6ab-475d-b30a-25b3b92ae226 tempest-ShareTransferTest-320553121 tempest-ShareTransferTest-320553121-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:44 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-604ae012-d6ab-475d-b30a-25b3b92ae226 tempest-ShareTransferTest-320553121 tempest-ShareTransferTest-320553121-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:44 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-604ae012-d6ab-475d-b30a-25b3b92ae226 tempest-ShareTransferTest-320553121 tempest-ShareTransferTest-320553121-project-member] http://10.27.203.238/share/v2/bece16f41fc44d55bf7bc45c2adaaed5/shares/de6cdc3c-7cf5-437f-acad-57530196bb54 returned with HTTP 200 May 28 13:01:44 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1140/2308] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:01:44 2024] GET /share/v2/bece16f41fc44d55bf7bc45c2adaaed5/shares/de6cdc3c-7cf5-437f-acad-57530196bb54 => generated 1311 bytes in 25 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:01:44 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e2e5707c-fca2-4a0b-a498-cd94e1c8eddb tempest-ShareTransferTest-320553121 None] >>> [GET] https://127.0.0.1:40443/api/vippools/ May 28 13:01:44 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e2e5707c-fca2-4a0b-a498-cd94e1c8eddb tempest-ShareTransferTest-320553121 None] {'allow_redirects': True, 'params': {'name': 'vippool-1'}} May 28 13:01:44 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e2e5707c-fca2-4a0b-a498-cd94e1c8eddb tempest-ShareTransferTest-320553121 None] <<< [GET] https://127.0.0.1:40443/api/vippools/ May 28 13:01:44 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e2e5707c-fca2-4a0b-a498-cd94e1c8eddb tempest-ShareTransferTest-320553121 None] [Bunch(active_cnode_ids=[], active_interfaces=4, cluster='loop75-kfs', cluster_id=1, cnode_ids=[], cnodes=[], domain_name='vippool-1', enable_l3=False, enable_weighted_balancing=False, enabled=True, end_ip='172.21.75.4', guid='f2abaede-b397-413a-8faa-3aeead6d3b28', gw_ip='', gw_ipv6='', id=2, ip_ranges=[['172.21.75.1', '172.21.75.4']], name='vippool-1', peer_asn=0, port_membership='ALL', ranges_summary='172.21.75.[1-4]', role='PROTOCOLS', start_ip='172.21.75.1', subnet_cidr=16, subnet_cidr_ipv6=None, sync='SYNCED', sync_time='2024-05-28T12:50:09.644123Z', tenant_id=1, tenant_name='default', title='172.21.75.1 - 172.21.75.4', url='https://127.0.0.1:40443/api/vippools/2/', vast_asn=0, vlan=0, vms_preferred=False)] May 28 13:01:44 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e2e5707c-fca2-4a0b-a498-cd94e1c8eddb tempest-ShareTransferTest-320553121 None] --- [GET] https://127.0.0.1:40443/api/vippools/: Done May 28 13:01:44 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e2e5707c-fca2-4a0b-a498-cd94e1c8eddb tempest-ShareTransferTest-320553121 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:01:44 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e2e5707c-fca2-4a0b-a498-cd94e1c8eddb tempest-ShareTransferTest-320553121 None] {'allow_redirects': True, May 28 13:01:44 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e2e5707c-fca2-4a0b-a498-cd94e1c8eddb tempest-ShareTransferTest-320553121 None] 'params': {'name': 'c9f751bd-bfa5-491d-9739-47b922a557d3'}} May 28 13:01:45 l75lg1-v1 dstat.sh[49771]: 28-05 13:01:45| 4 0 94 1 0|5634M 1800M 278M 7912M| 22k 2145B| 0 1430k| 0 148 |3366 5500 |1.18 1.18 1.07| 0 1.0 0| 0 0 | 0 2048M| 29 363 0 32 2 May 28 13:01:45 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e2e5707c-fca2-4a0b-a498-cd94e1c8eddb tempest-ShareTransferTest-320553121 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:01:45 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e2e5707c-fca2-4a0b-a498-cd94e1c8eddb tempest-ShareTransferTest-320553121 None] [] May 28 13:01:45 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e2e5707c-fca2-4a0b-a498-cd94e1c8eddb tempest-ShareTransferTest-320553121 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 13:01:45 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e2e5707c-fca2-4a0b-a498-cd94e1c8eddb tempest-ShareTransferTest-320553121 None] >>> [POST] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:01:45 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e2e5707c-fca2-4a0b-a498-cd94e1c8eddb tempest-ShareTransferTest-320553121 None] {'data': '{"name": "c9f751bd-bfa5-491d-9739-47b922a557d3"}', May 28 13:01:45 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e2e5707c-fca2-4a0b-a498-cd94e1c8eddb tempest-ShareTransferTest-320553121 None] 'json': None, May 28 13:01:45 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e2e5707c-fca2-4a0b-a498-cd94e1c8eddb tempest-ShareTransferTest-320553121 None] 'params': None} May 28 13:01:45 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-7ab5a6e2-6047-4089-9481-e7f477151ef6 tempest-ShareRulesTest-1530341375 None] <<< [PATCH] https://127.0.0.1:40443/api/viewpolicies/38/ May 28 13:01:45 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-7ab5a6e2-6047-4089-9481-e7f477151ef6 tempest-ShareRulesTest-1530341375 None] Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=1, created='2024-05-28T12:59:53.824250Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='0fa84ccd-850f-48fa-a965-23e5abe31188', id=38, internal=False, is_s3_default_policy=False, name='f7e47502-a0f7-44de-953d-b7b5697ae0b2', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=['*'], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=[], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=[], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='MODIFYING', sync_time='2024-05-28T13:01:45.353815Z', tenant_id=1, tenant_name='default', title='f7e47502-a0f7-44de-953d-b7b5697ae0b2', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/38/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[]) May 28 13:01:45 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-7ab5a6e2-6047-4089-9481-e7f477151ef6 tempest-ShareRulesTest-1530341375 None] --- [PATCH] https://127.0.0.1:40443/api/viewpolicies/38/: Done May 28 13:01:45 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-7ab5a6e2-6047-4089-9481-e7f477151ef6 tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:01:45 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-7ab5a6e2-6047-4089-9481-e7f477151ef6 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:01:45 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-7ab5a6e2-6047-4089-9481-e7f477151ef6 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.037s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:01:45 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-7ab5a6e2-6047-4089-9481-e7f477151ef6 tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:01:45 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-7ab5a6e2-6047-4089-9481-e7f477151ef6 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:01:46 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-7ab5a6e2-6047-4089-9481-e7f477151ef6 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.033s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:01:46 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-7ab5a6e2-6047-4089-9481-e7f477151ef6 tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:01:46 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-7ab5a6e2-6047-4089-9481-e7f477151ef6 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:01:46 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-7ab5a6e2-6047-4089-9481-e7f477151ef6 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.004s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:01:46 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-7ab5a6e2-6047-4089-9481-e7f477151ef6 tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:01:46 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-7ab5a6e2-6047-4089-9481-e7f477151ef6 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:01:46 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-7ab5a6e2-6047-4089-9481-e7f477151ef6 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:01:46 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-7ab5a6e2-6047-4089-9481-e7f477151ef6 tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:01:46 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-7ab5a6e2-6047-4089-9481-e7f477151ef6 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:01:46 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-7ab5a6e2-6047-4089-9481-e7f477151ef6 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.039s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:01:46 l75lg1-v1 manila-share[98474]: INFO manila.share.access [None req-7ab5a6e2-6047-4089-9481-e7f477151ef6 tempest-ShareRulesTest-1530341375 None] Access rules were successfully modified for share instance f7e47502-a0f7-44de-953d-b7b5697ae0b2 belonging to share b330db31-7766-443d-9c19-26fe349665aa. May 28 13:01:46 l75lg1-v1 dstat.sh[49771]: 28-05 13:01:46| 2 0 97 1 0|5634M 1800M 278M 7912M| 18k 894B| 0 580k| 0 70.0 |2310 3692 |1.18 1.18 1.07|1.0 1.0 0| 0 0 | 0 2048M| 29 363 0 32 2 May 28 13:01:46 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e2e5707c-fca2-4a0b-a498-cd94e1c8eddb tempest-ShareTransferTest-320553121 None] <<< [POST] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:01:46 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e2e5707c-fca2-4a0b-a498-cd94e1c8eddb tempest-ShareTransferTest-320553121 None] Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=0, created='2024-05-28T13:01:45.776774Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='dbddafd3-0cdb-44d5-95ff-a4e14557ab42', id=54, internal=False, is_s3_default_policy=False, name='c9f751bd-bfa5-491d-9739-47b922a557d3', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=[], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['*'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['*'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T13:01:46.207521Z', tenant_id=1, tenant_name='default', title='c9f751bd-bfa5-491d-9739-47b922a557d3', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/54/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[]) May 28 13:01:46 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e2e5707c-fca2-4a0b-a498-cd94e1c8eddb tempest-ShareTransferTest-320553121 None] --- [POST] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 13:01:46 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e2e5707c-fca2-4a0b-a498-cd94e1c8eddb tempest-ShareTransferTest-320553121 None] >>> [GET] https://127.0.0.1:40443/api/quotas/ May 28 13:01:46 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e2e5707c-fca2-4a0b-a498-cd94e1c8eddb tempest-ShareTransferTest-320553121 None] {'allow_redirects': True, May 28 13:01:46 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e2e5707c-fca2-4a0b-a498-cd94e1c8eddb tempest-ShareTransferTest-320553121 None] 'params': {'name': 'c9f751bd-bfa5-491d-9739-47b922a557d3'}} May 28 13:01:46 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-f5f85a9e-6ff3-43e8-831b-3d0fbcf05036 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] GET http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/share-access-rules?share_id=b330db31-7766-443d-9c19-26fe349665aa May 28 13:01:46 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-f5f85a9e-6ff3-43e8-831b-3d0fbcf05036 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:46 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-f5f85a9e-6ff3-43e8-831b-3d0fbcf05036 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:46 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-f5f85a9e-6ff3-43e8-831b-3d0fbcf05036 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/share-access-rules?share_id=b330db31-7766-443d-9c19-26fe349665aa returned with HTTP 200 May 28 13:01:46 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1169/2309] 10.27.203.238 () {64 vars in 1467 bytes} [Tue May 28 13:01:46 2024] GET /share/v2/a4f3887fa28c457390f5b66615564430/share-access-rules?share_id=b330db31-7766-443d-9c19-26fe349665aa => generated 19 bytes in 30 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:01:46 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-5325926a-61a4-4806-ae0b-71e3bf09ff11 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] POST http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/shares/b330db31-7766-443d-9c19-26fe349665aa/action May 28 13:01:46 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-5325926a-61a4-4806-ae0b-71e3bf09ff11 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Action body: b'{"allow_access": {"access_type": "ip", "access_to": "203.0.113.77", "access_level": "rw", "metadata": {"key1": "v1", "key2": "v2"}}}' {{(pid=98330) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 13:01:46 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-5325926a-61a4-4806-ae0b-71e3bf09ff11 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Action: 'action', calling method: ShareController.allow_access, body: {"allow_access": {"access_type": "ip", "access_to": "203.0.113.77", "access_level": "rw", "metadata": {"key1": "v1", "key2": "v2"}}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:01:46 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-5325926a-61a4-4806-ae0b-71e3bf09ff11 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:01:46 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-5325926a-61a4-4806-ae0b-71e3bf09ff11 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:01:46 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-5325926a-61a4-4806-ae0b-71e3bf09ff11 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.041s {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:01:46 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-5325926a-61a4-4806-ae0b-71e3bf09ff11 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/shares/b330db31-7766-443d-9c19-26fe349665aa/action returned with HTTP 200 May 28 13:01:46 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1141/2310] 10.27.203.238 () {66 vars in 1494 bytes} [Tue May 28 13:01:46 2024] POST /share/v2/a4f3887fa28c457390f5b66615564430/shares/b330db31-7766-443d-9c19-26fe349665aa/action => generated 336 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:01:46 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-fab257a6-96b6-4e8e-b0ea-a11d4d4f3c71 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] GET http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/share-access-rules?share_id=b330db31-7766-443d-9c19-26fe349665aa May 28 13:01:46 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-fab257a6-96b6-4e8e-b0ea-a11d4d4f3c71 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:46 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-fab257a6-96b6-4e8e-b0ea-a11d4d4f3c71 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:46 l75lg1-v1 manila-share[98474]: DEBUG manila.share.manager [None req-5325926a-61a4-4806-ae0b-71e3bf09ff11 tempest-ShareRulesTest-1530341375 None] Received request to update access for share instance f7e47502-a0f7-44de-953d-b7b5697ae0b2. {{(pid=98474) update_access_for_instances /opt/stack/manila/manila/share/manager.py:4353}} May 28 13:01:46 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e2e5707c-fca2-4a0b-a498-cd94e1c8eddb tempest-ShareTransferTest-320553121 None] <<< [GET] https://127.0.0.1:40443/api/quotas/ May 28 13:01:46 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e2e5707c-fca2-4a0b-a498-cd94e1c8eddb tempest-ShareTransferTest-320553121 None] [] May 28 13:01:46 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e2e5707c-fca2-4a0b-a498-cd94e1c8eddb tempest-ShareTransferTest-320553121 None] --- [GET] https://127.0.0.1:40443/api/quotas/: Done May 28 13:01:46 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e2e5707c-fca2-4a0b-a498-cd94e1c8eddb tempest-ShareTransferTest-320553121 None] >>> [POST] https://127.0.0.1:40443/api/quotas/ May 28 13:01:46 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.lock.api [None req-fab257a6-96b6-4e8e-b0ea-a11d4d4f3c71 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Searching for locks by: {'resource_id': 'c0e098e0-a68e-4800-a92d-0f7e07def6f6', 'resource_action': 'show', 'resource_type': 'access_rule'} {{(pid=98329) get_all /opt/stack/manila/manila/lock/api.py:112}} May 28 13:01:46 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e2e5707c-fca2-4a0b-a498-cd94e1c8eddb tempest-ShareTransferTest-320553121 None] {'data': '{"name": "c9f751bd-bfa5-491d-9739-47b922a557d3", "path": ' May 28 13:01:46 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e2e5707c-fca2-4a0b-a498-cd94e1c8eddb tempest-ShareTransferTest-320553121 None] '"/manila/manila-c9f751bd-bfa5-491d-9739-47b922a557d3", "create_dir": ' May 28 13:01:46 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e2e5707c-fca2-4a0b-a498-cd94e1c8eddb tempest-ShareTransferTest-320553121 None] 'true, "hard_limit": 1073741824}', May 28 13:01:46 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e2e5707c-fca2-4a0b-a498-cd94e1c8eddb tempest-ShareTransferTest-320553121 None] 'json': None, May 28 13:01:46 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e2e5707c-fca2-4a0b-a498-cd94e1c8eddb tempest-ShareTransferTest-320553121 None] 'params': None} May 28 13:01:46 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-5325926a-61a4-4806-ae0b-71e3bf09ff11 tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:01:46 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-5325926a-61a4-4806-ae0b-71e3bf09ff11 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:01:46 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-fab257a6-96b6-4e8e-b0ea-a11d4d4f3c71 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/share-access-rules?share_id=b330db31-7766-443d-9c19-26fe349665aa returned with HTTP 200 May 28 13:01:46 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1170/2311] 10.27.203.238 () {64 vars in 1467 bytes} [Tue May 28 13:01:46 2024] GET /share/v2/a4f3887fa28c457390f5b66615564430/share-access-rules?share_id=b330db31-7766-443d-9c19-26fe349665aa => generated 291 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:01:46 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-5325926a-61a4-4806-ae0b-71e3bf09ff11 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:01:46 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-5325926a-61a4-4806-ae0b-71e3bf09ff11 tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:01:46 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-5325926a-61a4-4806-ae0b-71e3bf09ff11 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:01:46 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-5325926a-61a4-4806-ae0b-71e3bf09ff11 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.059s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:01:46 l75lg1-v1 manila-share[98474]: DEBUG manila.share.access [None req-5325926a-61a4-4806-ae0b-71e3bf09ff11 tempest-ShareRulesTest-1530341375 None] Updating access rules for share instance f7e47502-a0f7-44de-953d-b7b5697ae0b2 belonging to share b330db31-7766-443d-9c19-26fe349665aa. {{(pid=98474) update_access_rules /opt/stack/manila/manila/share/access.py:298}} May 28 13:01:46 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-5325926a-61a4-4806-ae0b-71e3bf09ff11 tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:01:46 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-5325926a-61a4-4806-ae0b-71e3bf09ff11 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:01:46 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-5325926a-61a4-4806-ae0b-71e3bf09ff11 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.007s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:01:46 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-5325926a-61a4-4806-ae0b-71e3bf09ff11 tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:01:46 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-5325926a-61a4-4806-ae0b-71e3bf09ff11 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:01:46 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-5325926a-61a4-4806-ae0b-71e3bf09ff11 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.018s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:01:46 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-5325926a-61a4-4806-ae0b-71e3bf09ff11 tempest-ShareRulesTest-1530341375 None] changing access on None May 28 13:01:46 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-5325926a-61a4-4806-ae0b-71e3bf09ff11 tempest-ShareRulesTest-1530341375 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:01:46 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-5325926a-61a4-4806-ae0b-71e3bf09ff11 tempest-ShareRulesTest-1530341375 None] {'allow_redirects': True, May 28 13:01:46 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-5325926a-61a4-4806-ae0b-71e3bf09ff11 tempest-ShareRulesTest-1530341375 None] 'params': {'name': 'f7e47502-a0f7-44de-953d-b7b5697ae0b2'}} May 28 13:01:46 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-c12dc784-438d-43f5-9fb6-8730cea324e3 tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] GET http://10.27.203.238/share/v2/284d76edec3144579d6fb3f6dbc0dd4e/shares/31a95cfc-8903-4626-a21e-78ef575c96ed May 28 13:01:46 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-c12dc784-438d-43f5-9fb6-8730cea324e3 tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:46 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-c12dc784-438d-43f5-9fb6-8730cea324e3 tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:47 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-c12dc784-438d-43f5-9fb6-8730cea324e3 tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] http://10.27.203.238/share/v2/284d76edec3144579d6fb3f6dbc0dd4e/shares/31a95cfc-8903-4626-a21e-78ef575c96ed returned with HTTP 200 May 28 13:01:47 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1142/2312] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:01:46 2024] GET /share/v2/284d76edec3144579d6fb3f6dbc0dd4e/shares/31a95cfc-8903-4626-a21e-78ef575c96ed => generated 1316 bytes in 25 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:01:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-5325926a-61a4-4806-ae0b-71e3bf09ff11 tempest-ShareRulesTest-1530341375 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:01:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-5325926a-61a4-4806-ae0b-71e3bf09ff11 tempest-ShareRulesTest-1530341375 None] [Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=1, created='2024-05-28T12:59:53.824250Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='0fa84ccd-850f-48fa-a965-23e5abe31188', id=38, internal=False, is_s3_default_policy=False, name='f7e47502-a0f7-44de-953d-b7b5697ae0b2', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=['*'], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=[], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=[], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T13:01:45.778179Z', tenant_id=1, tenant_name='default', title='f7e47502-a0f7-44de-953d-b7b5697ae0b2', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/38/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[])] May 28 13:01:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-5325926a-61a4-4806-ae0b-71e3bf09ff11 tempest-ShareRulesTest-1530341375 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 13:01:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-5325926a-61a4-4806-ae0b-71e3bf09ff11 tempest-ShareRulesTest-1530341375 None] changing access on /manila/manila-f7e47502-a0f7-44de-953d-b7b5697ae0b2. Rules: {'nfs_read_write': ['203.0.113.77'], 'nfs_read_only': []} May 28 13:01:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-5325926a-61a4-4806-ae0b-71e3bf09ff11 tempest-ShareRulesTest-1530341375 None] >>> [PATCH] https://127.0.0.1:40443/api/viewpolicies/38/ May 28 13:01:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-5325926a-61a4-4806-ae0b-71e3bf09ff11 tempest-ShareRulesTest-1530341375 None] {'data': '{"name": "f7e47502-a0f7-44de-953d-b7b5697ae0b2", "nfs_no_squash": ' May 28 13:01:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-5325926a-61a4-4806-ae0b-71e3bf09ff11 tempest-ShareRulesTest-1530341375 None] '["*"], "nfs_root_squash": ["*"], "nfs_read_write": ["203.0.113.77"], ' May 28 13:01:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-5325926a-61a4-4806-ae0b-71e3bf09ff11 tempest-ShareRulesTest-1530341375 None] '"nfs_read_only": []}', May 28 13:01:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-5325926a-61a4-4806-ae0b-71e3bf09ff11 tempest-ShareRulesTest-1530341375 None] 'params': None} May 28 13:01:47 l75lg1-v1 dstat.sh[49771]: 28-05 13:01:47| 4 0 94 1 0|5634M 1800M 278M 7912M| 16k 6033B| 0 732k| 0 82.0 |3081 5043 |1.08 1.16 1.06|3.0 0 0| 0 0 | 0 2048M| 29 363 0 29 2 May 28 13:01:47 l75lg1-v1 manila-share[98474]: DEBUG oslo_service.periodic_task [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] Running periodic task ShareManager._publish_service_capabilities {{(pid=98474) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 13:01:47 l75lg1-v1 manila-share[98474]: DEBUG manila.manager [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] Notifying Schedulers of capabilities ... {{(pid=98474) _publish_service_capabilities /opt/stack/manila/manila/manager.py:172}} May 28 13:01:47 l75lg1-v1 manila-share[98474]: DEBUG oslo_service.periodic_task [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] Running periodic task ShareManager.migration_driver_continue {{(pid=98474) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 13:01:47 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.host_manager [None req-bba7c1c5-163d-42c3-ba68-91abbcd3e684 None None] Received share service update from l75lg1-v1@vast: {'share_backend_name': 'vast', 'driver_handles_share_servers': False, 'vendor_name': 'VAST STORAGE', 'driver_version': '1.0', 'storage_protocol': 'NFS', 'total_capacity_gb': 2083.02392578125, 'free_capacity_gb': 2082.605696829967, 'reserved_percentage': 0, 'reserved_snapshot_percentage': 0, 'reserved_share_extend_percentage': 0, 'qos': False, 'pools': None, 'snapshot_support': True, 'create_share_from_snapshot_support': False, 'revert_to_snapshot_support': False, 'mount_snapshot_support': False, 'replication_domain': None, 'filter_function': None, 'goodness_function': None, 'security_service_update_support': False, 'network_allocation_update_support': False, 'share_server_multiple_subnet_support': False, 'mount_point_name_support': False, 'data_reduction': 5.29, 'provisioned_capacity_gb': 0.41822895128279924, 'share_group_stats': {'consistent_snapshot_support': None}, 'ipv4_support': True, 'ipv6_support': False} {{(pid=98327) update_service_capabilities /opt/stack/manila/manila/scheduler/host_manager.py:632}} May 28 13:01:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e2e5707c-fca2-4a0b-a498-cd94e1c8eddb tempest-ShareTransferTest-320553121 None] <<< [POST] https://127.0.0.1:40443/api/quotas/ May 28 13:01:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e2e5707c-fca2-4a0b-a498-cd94e1c8eddb tempest-ShareTransferTest-320553121 None] Bunch(cluster='loop75-kfs', cluster_id=1, default_email=None, default_group_quota=None, default_user_quota=None, enable_alarms=True, enable_email_providers=True, grace_period=None, group_quotas=[], guid='014f5473-dec7-497f-9faf-ca80e43f5202', hard_limit=1073741824, hard_limit_inodes=None, id=51, internal=False, is_user_quota=False, last_user_quotas_update=None, name='c9f751bd-bfa5-491d-9739-47b922a557d3', num_blocked_users=0, num_exceeded_users=0, path='/manila/manila-c9f751bd-bfa5-491d-9739-47b922a557d3', percent_capacity=0, percent_inodes=None, pretty_grace_period=None, pretty_grace_period_expiration=None, pretty_state='OK (CREATED)', soft_limit=None, soft_limit_inodes=None, state='OK', sync_state='CREATED', system_id=51, tenant_id=1, tenant_name='default', time_to_block=None, title='c9f751bd-bfa5-491d-9739-47b922a557d3', url='https://127.0.0.1:40443/api/quotas/51/', used_capacity=0, used_capacity_tb=0.0, used_effective_capacity=0, used_effective_capacity_tb=0.0, used_inodes=0, used_limited_capacity=0, user_quotas=[]) May 28 13:01:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e2e5707c-fca2-4a0b-a498-cd94e1c8eddb tempest-ShareTransferTest-320553121 None] --- [POST] https://127.0.0.1:40443/api/quotas/: Done May 28 13:01:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e2e5707c-fca2-4a0b-a498-cd94e1c8eddb tempest-ShareTransferTest-320553121 None] >>> [GET] https://127.0.0.1:40443/api/views/ May 28 13:01:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e2e5707c-fca2-4a0b-a498-cd94e1c8eddb tempest-ShareTransferTest-320553121 None] {'allow_redirects': True, May 28 13:01:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e2e5707c-fca2-4a0b-a498-cd94e1c8eddb tempest-ShareTransferTest-320553121 None] 'params': {'name': 'c9f751bd-bfa5-491d-9739-47b922a557d3'}} May 28 13:01:47 l75lg1-v1 manila-share[98474]: DEBUG oslo_service.periodic_task [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] Running periodic task ShareManager.periodic_share_replica_update {{(pid=98474) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 13:01:47 l75lg1-v1 manila-share[98474]: DEBUG manila.share.manager [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] Updating status of share replica instances. {{(pid=98474) periodic_share_replica_update /opt/stack/manila/manila/share/manager.py:2752}} May 28 13:01:47 l75lg1-v1 manila-share[98474]: DEBUG oslo_service.periodic_task [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] Running periodic task ShareManager.do_deferred_share_deletion {{(pid=98474) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 13:01:47 l75lg1-v1 manila-share[98474]: DEBUG manila.share.manager [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] Checking for shares in 'deferred_deleting' status to process their deletion. {{(pid=98474) do_deferred_share_deletion /opt/stack/manila/manila/share/manager.py:3663}} May 28 13:01:47 l75lg1-v1 manila-share[98474]: DEBUG oslo_service.periodic_task [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] Running periodic task ShareManager.delete_expired_transfers {{(pid=98474) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 13:01:47 l75lg1-v1 manila-share[98474]: INFO manila.share.manager [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] Checking for expired transfers. May 28 13:01:47 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-9b592337-318f-46c6-88d5-fa86b78762e2 tempest-ShareTransferTest-320553121 tempest-ShareTransferTest-320553121-project-member] GET http://10.27.203.238/share/v2/bece16f41fc44d55bf7bc45c2adaaed5/shares/de6cdc3c-7cf5-437f-acad-57530196bb54 May 28 13:01:47 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-9b592337-318f-46c6-88d5-fa86b78762e2 tempest-ShareTransferTest-320553121 tempest-ShareTransferTest-320553121-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:47 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-9b592337-318f-46c6-88d5-fa86b78762e2 tempest-ShareTransferTest-320553121 tempest-ShareTransferTest-320553121-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:47 l75lg1-v1 manila-share[98474]: DEBUG oslo_service.periodic_task [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] Running periodic task ShareManager.do_deferred_snapshot_deletion {{(pid=98474) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 13:01:47 l75lg1-v1 manila-share[98474]: DEBUG manila.share.manager [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] Checking for snapshots in 'deferred_deleting' status to process their deletion. {{(pid=98474) do_deferred_snapshot_deletion /opt/stack/manila/manila/share/manager.py:3980}} May 28 13:01:47 l75lg1-v1 manila-share[98474]: DEBUG oslo_service.periodic_task [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] Running periodic task ShareManager.periodic_share_replica_snapshot_update {{(pid=98474) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 13:01:47 l75lg1-v1 manila-share[98474]: DEBUG manila.share.manager [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] Updating status of share replica snapshots. {{(pid=98474) periodic_share_replica_snapshot_update /opt/stack/manila/manila/share/manager.py:4213}} May 28 13:01:47 l75lg1-v1 manila-share[98474]: DEBUG oslo_service.periodic_task [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] Running periodic task ShareManager._report_driver_status {{(pid=98474) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 13:01:47 l75lg1-v1 manila-share[98474]: INFO manila.share.manager [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] Updating share status May 28 13:01:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] >>> [GET] https://127.0.0.1:40443/api/monitors/ad_hoc_query/ May 28 13:01:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] {'allow_redirects': True, May 28 13:01:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] 'params': {'object_type': 'cluster', May 28 13:01:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] 'prop_list': ['Capacity,drr', May 28 13:01:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] 'Capacity,logical_space', May 28 13:01:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] 'Capacity,logical_space_in_use', May 28 13:01:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] 'Capacity,physical_space', May 28 13:01:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] 'Capacity,physical_space_in_use'], May 28 13:01:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] 'time_frame': '1m'}} May 28 13:01:47 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-9b592337-318f-46c6-88d5-fa86b78762e2 tempest-ShareTransferTest-320553121 tempest-ShareTransferTest-320553121-project-member] http://10.27.203.238/share/v2/bece16f41fc44d55bf7bc45c2adaaed5/shares/de6cdc3c-7cf5-437f-acad-57530196bb54 returned with HTTP 200 May 28 13:01:47 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1171/2313] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:01:47 2024] GET /share/v2/bece16f41fc44d55bf7bc45c2adaaed5/shares/de6cdc3c-7cf5-437f-acad-57530196bb54 => generated 1313 bytes in 24 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:01:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] <<< [GET] https://127.0.0.1:40443/api/monitors/ad_hoc_query/ May 28 13:01:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] Bunch(data=[['2024-05-28T13:01:41Z', 1, 471992327.0, 2223930.0, 5.29, 711246584217.0, 2236629909504.0], ['2024-05-28T13:01:30Z', 1, 471877639.0, 2223930.0, 5.29, 711246584217.0, 2236629909504.0], ['2024-05-28T13:01:20Z', 1, 454486023.0, 2223930.0, 5.29, 711246584217.0, 2236629909504.0], ['2024-05-28T13:01:10Z', 1, 454395911.0, 2223930.0, 5.29, 711246584217.0, 2236629909504.0], ['2024-05-28T13:01:00Z', 1, 454248455.0, 2223930.0, 5.29, 711246584217.0, 2236629909504.0], ['2024-05-28T13:00:50Z', 1, 454133767.0, 2223930.0, 5.29, 711246584217.0, 2236629909504.0]], granularity=None, object_ids=[1], prop_list=['timestamp', 'object_id', 'Capacity,logical_space_in_use', 'Capacity,physical_space_in_use', 'Capacity,drr', 'Capacity,physical_space', 'Capacity,logical_space']) May 28 13:01:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] --- [GET] https://127.0.0.1:40443/api/monitors/ad_hoc_query/: Done May 28 13:01:47 l75lg1-v1 manila-share[98474]: DEBUG manila.share.driver [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] Updating share stats. {{(pid=98474) _update_share_stats /opt/stack/manila/manila/share/driver.py:1326}} May 28 13:01:47 l75lg1-v1 manila-share[98474]: DEBUG oslo_service.periodic_task [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] Running periodic task ShareManager._execute_periodic_hook {{(pid=98474) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 13:01:47 l75lg1-v1 manila-share[98474]: DEBUG oslo_service.periodic_task [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] Running periodic task ShareManager.create_backup_continue {{(pid=98474) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 13:01:47 l75lg1-v1 manila-share[98474]: DEBUG oslo_service.periodic_task [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] Running periodic task ShareManager.restore_backup_continue {{(pid=98474) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 13:01:47 l75lg1-v1 manila-share[98474]: DEBUG oslo_service.periodic_task [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] Running periodic task ShareManager.periodic_share_status_update {{(pid=98474) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 13:01:47 l75lg1-v1 manila-share[98474]: DEBUG manila.share.manager [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] Updating status of share instances. {{(pid=98474) periodic_share_status_update /opt/stack/manila/manila/share/manager.py:5475}} May 28 13:01:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-43577da0-e839-41a1-9f0d-32d626930298 tempest-ShareTypeAvailabilityZonesTest-364532124 None] <<< [DELETE] https://127.0.0.1:40443/api/quotas/50/ May 28 13:01:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-43577da0-e839-41a1-9f0d-32d626930298 tempest-ShareTypeAvailabilityZonesTest-364532124 None] --- [DELETE] https://127.0.0.1:40443/api/quotas/50/: Done May 28 13:01:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-43577da0-e839-41a1-9f0d-32d626930298 tempest-ShareTypeAvailabilityZonesTest-364532124 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:01:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-43577da0-e839-41a1-9f0d-32d626930298 tempest-ShareTypeAvailabilityZonesTest-364532124 None] {'allow_redirects': True, May 28 13:01:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-43577da0-e839-41a1-9f0d-32d626930298 tempest-ShareTypeAvailabilityZonesTest-364532124 None] 'params': {'name': '8e79dd09-ae5d-4631-a50f-7d8a06d71f8f'}} May 28 13:01:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e2e5707c-fca2-4a0b-a498-cd94e1c8eddb tempest-ShareTransferTest-320553121 None] <<< [GET] https://127.0.0.1:40443/api/views/ May 28 13:01:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e2e5707c-fca2-4a0b-a498-cd94e1c8eddb tempest-ShareTransferTest-320553121 None] [] May 28 13:01:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e2e5707c-fca2-4a0b-a498-cd94e1c8eddb tempest-ShareTransferTest-320553121 None] --- [GET] https://127.0.0.1:40443/api/views/: Done May 28 13:01:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e2e5707c-fca2-4a0b-a498-cd94e1c8eddb tempest-ShareTransferTest-320553121 None] >>> [POST] https://127.0.0.1:40443/api/views/ May 28 13:01:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e2e5707c-fca2-4a0b-a498-cd94e1c8eddb tempest-ShareTransferTest-320553121 None] {'data': '{"name": "c9f751bd-bfa5-491d-9739-47b922a557d3", "path": ' May 28 13:01:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e2e5707c-fca2-4a0b-a498-cd94e1c8eddb tempest-ShareTransferTest-320553121 None] '"/manila/manila-c9f751bd-bfa5-491d-9739-47b922a557d3", "policy_id": ' May 28 13:01:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e2e5707c-fca2-4a0b-a498-cd94e1c8eddb tempest-ShareTransferTest-320553121 None] '54, "create_dir": true, "protocols": ["NFS"]}', May 28 13:01:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e2e5707c-fca2-4a0b-a498-cd94e1c8eddb tempest-ShareTransferTest-320553121 None] 'json': None, May 28 13:01:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e2e5707c-fca2-4a0b-a498-cd94e1c8eddb tempest-ShareTransferTest-320553121 None] 'params': None} May 28 13:01:48 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-43577da0-e839-41a1-9f0d-32d626930298 tempest-ShareTypeAvailabilityZonesTest-364532124 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:01:48 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-43577da0-e839-41a1-9f0d-32d626930298 tempest-ShareTypeAvailabilityZonesTest-364532124 None] [Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=0, created='2024-05-28T13:01:36.161104Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='31687c19-19a3-4cad-9dad-a562c964a940', id=53, internal=False, is_s3_default_policy=False, name='8e79dd09-ae5d-4631-a50f-7d8a06d71f8f', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=[], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['*'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['*'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T13:01:36.476638Z', tenant_id=1, tenant_name='default', title='8e79dd09-ae5d-4631-a50f-7d8a06d71f8f', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/53/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[])] May 28 13:01:48 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-43577da0-e839-41a1-9f0d-32d626930298 tempest-ShareTypeAvailabilityZonesTest-364532124 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 13:01:48 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-43577da0-e839-41a1-9f0d-32d626930298 tempest-ShareTypeAvailabilityZonesTest-364532124 None] >>> [DELETE] https://127.0.0.1:40443/api/viewpolicies/53/ May 28 13:01:48 l75lg1-v1 dstat.sh[49771]: 28-05 13:01:48| 3 1 97 0 0|5634M 1800M 278M 7912M| 17k 4053B| 0 456k| 0 29.0 |2087 3148 |1.08 1.16 1.06|1.0 1.0 2.0| 0 0 | 0 2048M| 29 363 0 29 2 May 28 13:01:48 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e2e5707c-fca2-4a0b-a498-cd94e1c8eddb tempest-ShareTransferTest-320553121 None] <<< [POST] https://127.0.0.1:40443/api/views/ May 28 13:01:48 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e2e5707c-fca2-4a0b-a498-cd94e1c8eddb tempest-ShareTransferTest-320553121 None] Bunch(abac_tags=[], abe_max_depth=None, abe_protocols=[], alias='', allow_anonymous_access=False, allow_s3_anonymous_access=False, auto_commit='0d', bucket='', bucket_creators=[], bucket_creators_groups=[], bucket_owner=None, bulk_permission_update_progress=None, bulk_permission_update_state=None, cluster='loop75-kfs', cluster_id=1, created='2024-05-28T13:01:48.478991Z', enabled=True, files_retention_mode='NONE', guid='c7fd3975-6dcf-4ffb-a4f1-bcebae9548b0', id=53, ignore_oos=False, internal=False, is_remote=False, is_seamless=False, logical_capacity=0, max_retention_period=None, min_retention_period=None, name='c9f751bd-bfa5-491d-9739-47b922a557d3', nfs_interop_flags='BOTH_NFS3_AND_NFS4_INTEROP_DISABLED', path='/manila/manila-c9f751bd-bfa5-491d-9739-47b922a557d3', physical_capacity=0, policy='c9f751bd-bfa5-491d-9739-47b922a557d3', policy_id=54, protocols=['NFS'], qos_policy=None, qos_policy_id=None, s3_locks=False, s3_locks_retention_mode='NONE', s3_locks_retention_period='', s3_object_ownership_rule='ObjectWriter', s3_unverified_lookup=False, s3_versioning=False, select_for_live_monitoring=False, share='', share_acl=Bunch(acl=[], enabled=False), sync='SYNCED', sync_time='2024-05-28T13:01:48.772520Z', tenant_id=1, tenant_name='default', title='/manila/manila-c9f751bd-bfa5-491d-9739-47b922a557d3', url='https://127.0.0.1:40443/api/views/53/') May 28 13:01:48 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-e2e5707c-fca2-4a0b-a498-cd94e1c8eddb tempest-ShareTransferTest-320553121 None] --- [POST] https://127.0.0.1:40443/api/views/: Done May 28 13:01:48 l75lg1-v1 manila-share[98474]: INFO manila.share.manager [None req-e2e5707c-fca2-4a0b-a498-cd94e1c8eddb tempest-ShareTransferTest-320553121 None] Share instance c9f751bd-bfa5-491d-9739-47b922a557d3 created successfully. May 28 13:01:49 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-5325926a-61a4-4806-ae0b-71e3bf09ff11 tempest-ShareRulesTest-1530341375 None] <<< [PATCH] https://127.0.0.1:40443/api/viewpolicies/38/ May 28 13:01:49 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-5325926a-61a4-4806-ae0b-71e3bf09ff11 tempest-ShareRulesTest-1530341375 None] Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=1, created='2024-05-28T12:59:53.824250Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='0fa84ccd-850f-48fa-a965-23e5abe31188', id=38, internal=False, is_s3_default_policy=False, name='f7e47502-a0f7-44de-953d-b7b5697ae0b2', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=['*'], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['203.0.113.77'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['203.0.113.77'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='MODIFYING', sync_time='2024-05-28T13:01:48.293595Z', tenant_id=1, tenant_name='default', title='f7e47502-a0f7-44de-953d-b7b5697ae0b2', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/38/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[]) May 28 13:01:49 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-5325926a-61a4-4806-ae0b-71e3bf09ff11 tempest-ShareRulesTest-1530341375 None] --- [PATCH] https://127.0.0.1:40443/api/viewpolicies/38/: Done May 28 13:01:49 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-5325926a-61a4-4806-ae0b-71e3bf09ff11 tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:01:49 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-5325926a-61a4-4806-ae0b-71e3bf09ff11 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:01:49 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-5325926a-61a4-4806-ae0b-71e3bf09ff11 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.060s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:01:49 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-5325926a-61a4-4806-ae0b-71e3bf09ff11 tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:01:49 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-5325926a-61a4-4806-ae0b-71e3bf09ff11 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:01:49 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-5325926a-61a4-4806-ae0b-71e3bf09ff11 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:01:49 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-5325926a-61a4-4806-ae0b-71e3bf09ff11 tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:01:49 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-5325926a-61a4-4806-ae0b-71e3bf09ff11 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:01:49 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-5325926a-61a4-4806-ae0b-71e3bf09ff11 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:01:49 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-5325926a-61a4-4806-ae0b-71e3bf09ff11 tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:01:49 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-5325926a-61a4-4806-ae0b-71e3bf09ff11 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:01:49 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-5325926a-61a4-4806-ae0b-71e3bf09ff11 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:01:49 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-5325926a-61a4-4806-ae0b-71e3bf09ff11 tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:01:49 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-5325926a-61a4-4806-ae0b-71e3bf09ff11 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:01:49 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-5325926a-61a4-4806-ae0b-71e3bf09ff11 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.044s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:01:49 l75lg1-v1 manila-share[98474]: INFO manila.share.access [None req-5325926a-61a4-4806-ae0b-71e3bf09ff11 tempest-ShareRulesTest-1530341375 None] Access rules were successfully modified for share instance f7e47502-a0f7-44de-953d-b7b5697ae0b2 belonging to share b330db31-7766-443d-9c19-26fe349665aa. May 28 13:01:49 l75lg1-v1 dstat.sh[49771]: 28-05 13:01:49| 2 0 97 1 0|5634M 1800M 278M 7912M| 19k 132B| 0 824k| 0 92.0 |2388 4007 |1.08 1.16 1.06|1.0 1.0 0| 0 0 | 0 2048M| 29 363 0 29 2 May 28 13:01:49 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-43577da0-e839-41a1-9f0d-32d626930298 tempest-ShareTypeAvailabilityZonesTest-364532124 None] <<< [DELETE] https://127.0.0.1:40443/api/viewpolicies/53/ May 28 13:01:49 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-43577da0-e839-41a1-9f0d-32d626930298 tempest-ShareTypeAvailabilityZonesTest-364532124 None] --- [DELETE] https://127.0.0.1:40443/api/viewpolicies/53/: Done May 28 13:01:49 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-77797956-c930-473e-97d4-0e67a165854a tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] GET http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/share-access-rules?share_id=b330db31-7766-443d-9c19-26fe349665aa May 28 13:01:49 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-77797956-c930-473e-97d4-0e67a165854a tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:49 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-77797956-c930-473e-97d4-0e67a165854a tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:49 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.lock.api [None req-77797956-c930-473e-97d4-0e67a165854a tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Searching for locks by: {'resource_id': 'c0e098e0-a68e-4800-a92d-0f7e07def6f6', 'resource_action': 'show', 'resource_type': 'access_rule'} {{(pid=98330) get_all /opt/stack/manila/manila/lock/api.py:112}} May 28 13:01:49 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-77797956-c930-473e-97d4-0e67a165854a tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/share-access-rules?share_id=b330db31-7766-443d-9c19-26fe349665aa returned with HTTP 200 May 28 13:01:49 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1143/2314] 10.27.203.238 () {64 vars in 1467 bytes} [Tue May 28 13:01:49 2024] GET /share/v2/a4f3887fa28c457390f5b66615564430/share-access-rules?share_id=b330db31-7766-443d-9c19-26fe349665aa => generated 306 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:01:49 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-4fa42f4b-fdf0-4f8d-ac7c-52ea57e7c28a tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] GET http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/share-access-rules?share_id=b330db31-7766-443d-9c19-26fe349665aa May 28 13:01:49 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-4fa42f4b-fdf0-4f8d-ac7c-52ea57e7c28a tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:49 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-4fa42f4b-fdf0-4f8d-ac7c-52ea57e7c28a tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:49 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-43577da0-e839-41a1-9f0d-32d626930298 tempest-ShareTypeAvailabilityZonesTest-364532124 None] Created reservations ['83fe3c22-9bef-4893-b24c-eb10c56405cf', 'f293b64b-dcc7-4578-ae7c-ffe20dc10291', 'a9d4671c-e0f6-4ec6-963f-52f6b52ad835', '2d1ab401-ae4f-4280-8973-16818bce07f2'] {{(pid=98474) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 13:01:49 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-43577da0-e839-41a1-9f0d-32d626930298 tempest-ShareTypeAvailabilityZonesTest-364532124 None] Committed reservations ['83fe3c22-9bef-4893-b24c-eb10c56405cf', 'f293b64b-dcc7-4578-ae7c-ffe20dc10291', 'a9d4671c-e0f6-4ec6-963f-52f6b52ad835', '2d1ab401-ae4f-4280-8973-16818bce07f2'] {{(pid=98474) commit /opt/stack/manila/manila/quota.py:1063}} May 28 13:01:49 l75lg1-v1 manila-share[98474]: INFO manila.share.manager [None req-43577da0-e839-41a1-9f0d-32d626930298 tempest-ShareTypeAvailabilityZonesTest-364532124 None] Share instance 8e79dd09-ae5d-4631-a50f-7d8a06d71f8f: deleted successfully. May 28 13:01:49 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.lock.api [None req-4fa42f4b-fdf0-4f8d-ac7c-52ea57e7c28a tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Searching for locks by: {'resource_id': 'c0e098e0-a68e-4800-a92d-0f7e07def6f6', 'resource_action': 'show', 'resource_type': 'access_rule'} {{(pid=98329) get_all /opt/stack/manila/manila/lock/api.py:112}} May 28 13:01:49 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-4fa42f4b-fdf0-4f8d-ac7c-52ea57e7c28a tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/share-access-rules?share_id=b330db31-7766-443d-9c19-26fe349665aa returned with HTTP 200 May 28 13:01:49 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1172/2315] 10.27.203.238 () {64 vars in 1467 bytes} [Tue May 28 13:01:49 2024] GET /share/v2/a4f3887fa28c457390f5b66615564430/share-access-rules?share_id=b330db31-7766-443d-9c19-26fe349665aa => generated 306 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:01:49 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-4628cb72-2b87-44dd-b633-8a0333123fb7 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] POST http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/shares/b330db31-7766-443d-9c19-26fe349665aa/action May 28 13:01:49 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-4628cb72-2b87-44dd-b633-8a0333123fb7 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Action body: b'{"deny_access": {"access_id": "c0e098e0-a68e-4800-a92d-0f7e07def6f6"}}' {{(pid=98330) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 13:01:49 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-4628cb72-2b87-44dd-b633-8a0333123fb7 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Action: 'action', calling method: ShareController.deny_access, body: {"deny_access": {"access_id": "c0e098e0-a68e-4800-a92d-0f7e07def6f6"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:01:49 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.lock.api [None req-4628cb72-2b87-44dd-b633-8a0333123fb7 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Searching for locks by: {'resource_id': 'c0e098e0-a68e-4800-a92d-0f7e07def6f6', 'resource_action': 'delete'} {{(pid=98330) get_all /opt/stack/manila/manila/lock/api.py:112}} May 28 13:01:49 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-4628cb72-2b87-44dd-b633-8a0333123fb7 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:01:49 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-4628cb72-2b87-44dd-b633-8a0333123fb7 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:01:49 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-4628cb72-2b87-44dd-b633-8a0333123fb7 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.041s {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:01:49 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-4628cb72-2b87-44dd-b633-8a0333123fb7 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:01:49 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-4628cb72-2b87-44dd-b633-8a0333123fb7 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:01:49 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-4628cb72-2b87-44dd-b633-8a0333123fb7 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.071s {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:01:49 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-4628cb72-2b87-44dd-b633-8a0333123fb7 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/shares/b330db31-7766-443d-9c19-26fe349665aa/action returned with HTTP 202 May 28 13:01:49 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1144/2316] 10.27.203.238 () {66 vars in 1493 bytes} [Tue May 28 13:01:49 2024] POST /share/v2/a4f3887fa28c457390f5b66615564430/shares/b330db31-7766-443d-9c19-26fe349665aa/action => generated 0 bytes in 198 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 13:01:49 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-ced146d1-f772-4eb9-a5e3-223ff6bf88b7 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] GET http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/share-access-rules?share_id=b330db31-7766-443d-9c19-26fe349665aa May 28 13:01:49 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-ced146d1-f772-4eb9-a5e3-223ff6bf88b7 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:49 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-ced146d1-f772-4eb9-a5e3-223ff6bf88b7 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:49 l75lg1-v1 manila-share[98474]: DEBUG manila.share.manager [None req-4628cb72-2b87-44dd-b633-8a0333123fb7 tempest-ShareRulesTest-1530341375 None] Received request to update access for share instance f7e47502-a0f7-44de-953d-b7b5697ae0b2. {{(pid=98474) update_access_for_instances /opt/stack/manila/manila/share/manager.py:4353}} May 28 13:01:49 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-4628cb72-2b87-44dd-b633-8a0333123fb7 tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:01:49 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-4628cb72-2b87-44dd-b633-8a0333123fb7 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:01:49 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.lock.api [None req-ced146d1-f772-4eb9-a5e3-223ff6bf88b7 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Searching for locks by: {'resource_id': 'c0e098e0-a68e-4800-a92d-0f7e07def6f6', 'resource_action': 'show', 'resource_type': 'access_rule'} {{(pid=98329) get_all /opt/stack/manila/manila/lock/api.py:112}} May 28 13:01:49 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-4628cb72-2b87-44dd-b633-8a0333123fb7 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:01:49 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-4628cb72-2b87-44dd-b633-8a0333123fb7 tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:01:49 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-4628cb72-2b87-44dd-b633-8a0333123fb7 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:01:49 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-ced146d1-f772-4eb9-a5e3-223ff6bf88b7 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/share-access-rules?share_id=b330db31-7766-443d-9c19-26fe349665aa returned with HTTP 200 May 28 13:01:49 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1173/2317] 10.27.203.238 () {64 vars in 1467 bytes} [Tue May 28 13:01:49 2024] GET /share/v2/a4f3887fa28c457390f5b66615564430/share-access-rules?share_id=b330db31-7766-443d-9c19-26fe349665aa => generated 314 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:01:50 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-4628cb72-2b87-44dd-b633-8a0333123fb7 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.062s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:01:50 l75lg1-v1 manila-share[98474]: DEBUG manila.share.access [None req-4628cb72-2b87-44dd-b633-8a0333123fb7 tempest-ShareRulesTest-1530341375 None] Updating access rules for share instance f7e47502-a0f7-44de-953d-b7b5697ae0b2 belonging to share b330db31-7766-443d-9c19-26fe349665aa. {{(pid=98474) update_access_rules /opt/stack/manila/manila/share/access.py:298}} May 28 13:01:50 l75lg1-v1 nova-conductor[83648]: DEBUG dbcounter [-] [83648] Writing DB stats nova_cell1:SELECT=1 {{(pid=83648) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:01:50 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-640ed4ac-9e48-4ead-ab38-7b15e78b324e tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] GET http://10.27.203.238/share/v2/284d76edec3144579d6fb3f6dbc0dd4e/shares/31a95cfc-8903-4626-a21e-78ef575c96ed May 28 13:01:50 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-640ed4ac-9e48-4ead-ab38-7b15e78b324e tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:50 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-4628cb72-2b87-44dd-b633-8a0333123fb7 tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:01:50 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-640ed4ac-9e48-4ead-ab38-7b15e78b324e tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:50 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-4628cb72-2b87-44dd-b633-8a0333123fb7 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:01:50 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-640ed4ac-9e48-4ead-ab38-7b15e78b324e tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] HTTP exception thrown: The resource could not be found. May 28 13:01:50 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-640ed4ac-9e48-4ead-ab38-7b15e78b324e tempest-ShareTypeAvailabilityZonesTest-364532124 tempest-ShareTypeAvailabilityZonesTest-364532124-project-member] http://10.27.203.238/share/v2/284d76edec3144579d6fb3f6dbc0dd4e/shares/31a95cfc-8903-4626-a21e-78ef575c96ed returned with HTTP 404 May 28 13:01:50 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1145/2318] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:01:50 2024] GET /share/v2/284d76edec3144579d6fb3f6dbc0dd4e/shares/31a95cfc-8903-4626-a21e-78ef575c96ed => generated 78 bytes in 12 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 13:01:50 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-4628cb72-2b87-44dd-b633-8a0333123fb7 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.008s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:01:50 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-4628cb72-2b87-44dd-b633-8a0333123fb7 tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:01:50 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-4628cb72-2b87-44dd-b633-8a0333123fb7 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c8f401-d969-43f0-be99-cb0312676f7f None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-b3c8f401-d969-43f0-be99-cb0312676f7f None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:01:50 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-4628cb72-2b87-44dd-b633-8a0333123fb7 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.020s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:01:50 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-4628cb72-2b87-44dd-b633-8a0333123fb7 tempest-ShareRulesTest-1530341375 None] changing access on None May 28 13:01:50 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-4628cb72-2b87-44dd-b633-8a0333123fb7 tempest-ShareRulesTest-1530341375 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:01:50 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-4628cb72-2b87-44dd-b633-8a0333123fb7 tempest-ShareRulesTest-1530341375 None] {'allow_redirects': True, May 28 13:01:50 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-4628cb72-2b87-44dd-b633-8a0333123fb7 tempest-ShareRulesTest-1530341375 None] 'params': {'name': 'f7e47502-a0f7-44de-953d-b7b5697ae0b2'}} May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c8f401-d969-43f0-be99-cb0312676f7f None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417c5fa8-18dd-4aa4-9626-a3072a009f44 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56313694cffb4df8b0b20f48edb02368', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb20757ddd604868aff8ad38db5def87', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417c5fa8-18dd-4aa4-9626-a3072a009f44 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417c5fa8-18dd-4aa4-9626-a3072a009f44 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417c5fa8-18dd-4aa4-9626-a3072a009f44 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] PATH_INFO: `/v3/users/14783f4fbce14880b4db4a628827607e` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417c5fa8-18dd-4aa4-9626-a3072a009f44 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] RBAC: Authorizing `identity:delete_user(user_id=14783f4fbce14880b4db4a628827607e)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417c5fa8-18dd-4aa4-9626-a3072a009f44 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-417c5fa8-18dd-4aa4-9626-a3072a009f44 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] Could not find user: 14783f4fbce14880b4db4a628827607e.: keystone.exception.UserNotFound: Could not find user: 14783f4fbce14880b4db4a628827607e. May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 14783f4fbce14880b4db4a628827607e. May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1579/3185] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:01:50 2024] DELETE /identity/v3/users/14783f4fbce14880b4db4a628827607e => generated 110 bytes in 112 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb608e09-1547-4cd8-bfd2-45cfb7775551 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-eb608e09-1547-4cd8-bfd2-45cfb7775551 None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb608e09-1547-4cd8-bfd2-45cfb7775551 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becf6aff-697f-4ea5-9146-9682ea94318f tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56313694cffb4df8b0b20f48edb02368', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb20757ddd604868aff8ad38db5def87', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becf6aff-697f-4ea5-9146-9682ea94318f tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becf6aff-697f-4ea5-9146-9682ea94318f tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becf6aff-697f-4ea5-9146-9682ea94318f tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] PATH_INFO: `/v3/users/9eca355145fd413390b5efe7a0d95465` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becf6aff-697f-4ea5-9146-9682ea94318f tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] RBAC: Authorizing `identity:delete_user(user_id=9eca355145fd413390b5efe7a0d95465)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becf6aff-697f-4ea5-9146-9682ea94318f tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-becf6aff-697f-4ea5-9146-9682ea94318f tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] Could not find user: 9eca355145fd413390b5efe7a0d95465.: keystone.exception.UserNotFound: Could not find user: 9eca355145fd413390b5efe7a0d95465. May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 9eca355145fd413390b5efe7a0d95465. May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1607/3186] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:01:50 2024] DELETE /identity/v3/users/9eca355145fd413390b5efe7a0d95465 => generated 110 bytes in 30 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417c5fa8-18dd-4aa4-9626-a3072a009f44 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417c5fa8-18dd-4aa4-9626-a3072a009f44 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3398494f-fabd-4223-af2e-88093e9bb430 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56313694cffb4df8b0b20f48edb02368', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb20757ddd604868aff8ad38db5def87', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3398494f-fabd-4223-af2e-88093e9bb430 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3398494f-fabd-4223-af2e-88093e9bb430 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3398494f-fabd-4223-af2e-88093e9bb430 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] PATH_INFO: `/v3/users/91ab54ee09854b549923fb7671247f5c` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3398494f-fabd-4223-af2e-88093e9bb430 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] RBAC: Authorizing `identity:delete_user(user_id=91ab54ee09854b549923fb7671247f5c)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3398494f-fabd-4223-af2e-88093e9bb430 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-3398494f-fabd-4223-af2e-88093e9bb430 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] Could not find user: 91ab54ee09854b549923fb7671247f5c.: keystone.exception.UserNotFound: Could not find user: 91ab54ee09854b549923fb7671247f5c. May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 91ab54ee09854b549923fb7671247f5c. May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1580/3187] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:01:50 2024] DELETE /identity/v3/users/91ab54ee09854b549923fb7671247f5c => generated 110 bytes in 32 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becf6aff-697f-4ea5-9146-9682ea94318f tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becf6aff-697f-4ea5-9146-9682ea94318f tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fbcc82-8c5d-4147-8d38-320d324b3af3 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56313694cffb4df8b0b20f48edb02368', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb20757ddd604868aff8ad38db5def87', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fbcc82-8c5d-4147-8d38-320d324b3af3 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fbcc82-8c5d-4147-8d38-320d324b3af3 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fbcc82-8c5d-4147-8d38-320d324b3af3 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] PATH_INFO: `/v3/users/2889a927897c49bd92a0d1cfdf27e7f5` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fbcc82-8c5d-4147-8d38-320d324b3af3 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] RBAC: Authorizing `identity:delete_user(user_id=2889a927897c49bd92a0d1cfdf27e7f5)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fbcc82-8c5d-4147-8d38-320d324b3af3 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:50 l75lg1-v1 dstat.sh[49771]: 28-05 13:01:50| 9 1 88 1 0|5634M 1800M 278M 7913M| 15k 4683B| 0 1284k| 0 173 |5143 8938 |1.08 1.16 1.06|3.0 1.0 0| 0 0 | 0 2048M| 29 364 0 30 2 May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-f5fbcc82-8c5d-4147-8d38-320d324b3af3 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] Could not find user: 2889a927897c49bd92a0d1cfdf27e7f5.: keystone.exception.UserNotFound: Could not find user: 2889a927897c49bd92a0d1cfdf27e7f5. May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 2889a927897c49bd92a0d1cfdf27e7f5. May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1608/3188] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:01:50 2024] DELETE /identity/v3/users/2889a927897c49bd92a0d1cfdf27e7f5 => generated 110 bytes in 23 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3398494f-fabd-4223-af2e-88093e9bb430 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3398494f-fabd-4223-af2e-88093e9bb430 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb156090-7ec0-4090-8d00-9c086ea38abf tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56313694cffb4df8b0b20f48edb02368', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb20757ddd604868aff8ad38db5def87', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb156090-7ec0-4090-8d00-9c086ea38abf tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb156090-7ec0-4090-8d00-9c086ea38abf tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb156090-7ec0-4090-8d00-9c086ea38abf tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] PATH_INFO: `/v3/users/bd43e5d1c359462d807b6e8a8581fa73` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb156090-7ec0-4090-8d00-9c086ea38abf tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] RBAC: Authorizing `identity:delete_user(user_id=bd43e5d1c359462d807b6e8a8581fa73)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb156090-7ec0-4090-8d00-9c086ea38abf tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-fb156090-7ec0-4090-8d00-9c086ea38abf tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] Could not find user: bd43e5d1c359462d807b6e8a8581fa73.: keystone.exception.UserNotFound: Could not find user: bd43e5d1c359462d807b6e8a8581fa73. May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: bd43e5d1c359462d807b6e8a8581fa73. May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1581/3189] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:01:50 2024] DELETE /identity/v3/users/bd43e5d1c359462d807b6e8a8581fa73 => generated 110 bytes in 32 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fbcc82-8c5d-4147-8d38-320d324b3af3 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fbcc82-8c5d-4147-8d38-320d324b3af3 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd666b2-f61a-49e3-ada4-b5df7935797b tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56313694cffb4df8b0b20f48edb02368', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb20757ddd604868aff8ad38db5def87', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd666b2-f61a-49e3-ada4-b5df7935797b tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd666b2-f61a-49e3-ada4-b5df7935797b tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd666b2-f61a-49e3-ada4-b5df7935797b tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] PATH_INFO: `/v3/users/18c7667276334e98bdd11d2b9d1875cc` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd666b2-f61a-49e3-ada4-b5df7935797b tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] RBAC: Authorizing `identity:delete_user(user_id=18c7667276334e98bdd11d2b9d1875cc)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd666b2-f61a-49e3-ada4-b5df7935797b tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-2cd666b2-f61a-49e3-ada4-b5df7935797b tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] Could not find user: 18c7667276334e98bdd11d2b9d1875cc.: keystone.exception.UserNotFound: Could not find user: 18c7667276334e98bdd11d2b9d1875cc. May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 18c7667276334e98bdd11d2b9d1875cc. May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1609/3190] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:01:50 2024] DELETE /identity/v3/users/18c7667276334e98bdd11d2b9d1875cc => generated 110 bytes in 23 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb156090-7ec0-4090-8d00-9c086ea38abf tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb156090-7ec0-4090-8d00-9c086ea38abf tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966ac585-651c-426a-990c-341e697e5dfd tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56313694cffb4df8b0b20f48edb02368', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb20757ddd604868aff8ad38db5def87', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966ac585-651c-426a-990c-341e697e5dfd tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966ac585-651c-426a-990c-341e697e5dfd tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966ac585-651c-426a-990c-341e697e5dfd tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] PATH_INFO: `/v3/users/db0396a316ea4c5697d47df053fccbe4` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966ac585-651c-426a-990c-341e697e5dfd tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] RBAC: Authorizing `identity:delete_user(user_id=db0396a316ea4c5697d47df053fccbe4)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966ac585-651c-426a-990c-341e697e5dfd tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-966ac585-651c-426a-990c-341e697e5dfd tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] Could not find user: db0396a316ea4c5697d47df053fccbe4.: keystone.exception.UserNotFound: Could not find user: db0396a316ea4c5697d47df053fccbe4. May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: db0396a316ea4c5697d47df053fccbe4. May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1582/3191] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:01:50 2024] DELETE /identity/v3/users/db0396a316ea4c5697d47df053fccbe4 => generated 110 bytes in 32 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd666b2-f61a-49e3-ada4-b5df7935797b tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd666b2-f61a-49e3-ada4-b5df7935797b tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9695316-7fc3-4fca-99f5-a0bbce6637e1 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56313694cffb4df8b0b20f48edb02368', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb20757ddd604868aff8ad38db5def87', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9695316-7fc3-4fca-99f5-a0bbce6637e1 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9695316-7fc3-4fca-99f5-a0bbce6637e1 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9695316-7fc3-4fca-99f5-a0bbce6637e1 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] PATH_INFO: `/v3/users/8408bca6708d4e57b4e6ae91fa7eb8e3` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9695316-7fc3-4fca-99f5-a0bbce6637e1 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] RBAC: Authorizing `identity:delete_user(user_id=8408bca6708d4e57b4e6ae91fa7eb8e3)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9695316-7fc3-4fca-99f5-a0bbce6637e1 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-e9695316-7fc3-4fca-99f5-a0bbce6637e1 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] Could not find user: 8408bca6708d4e57b4e6ae91fa7eb8e3.: keystone.exception.UserNotFound: Could not find user: 8408bca6708d4e57b4e6ae91fa7eb8e3. May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 8408bca6708d4e57b4e6ae91fa7eb8e3. May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1610/3192] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:01:50 2024] DELETE /identity/v3/users/8408bca6708d4e57b4e6ae91fa7eb8e3 => generated 110 bytes in 24 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966ac585-651c-426a-990c-341e697e5dfd tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966ac585-651c-426a-990c-341e697e5dfd tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628b95f4-56df-442e-8664-fe725d61963b tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56313694cffb4df8b0b20f48edb02368', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb20757ddd604868aff8ad38db5def87', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628b95f4-56df-442e-8664-fe725d61963b tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628b95f4-56df-442e-8664-fe725d61963b tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628b95f4-56df-442e-8664-fe725d61963b tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] PATH_INFO: `/v3/users/e593bd019bc24f30b8b269cbdd2e3494` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628b95f4-56df-442e-8664-fe725d61963b tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] RBAC: Authorizing `identity:delete_user(user_id=e593bd019bc24f30b8b269cbdd2e3494)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628b95f4-56df-442e-8664-fe725d61963b tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-628b95f4-56df-442e-8664-fe725d61963b tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] Could not find user: e593bd019bc24f30b8b269cbdd2e3494.: keystone.exception.UserNotFound: Could not find user: e593bd019bc24f30b8b269cbdd2e3494. May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: e593bd019bc24f30b8b269cbdd2e3494. May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1583/3193] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:01:50 2024] DELETE /identity/v3/users/e593bd019bc24f30b8b269cbdd2e3494 => generated 110 bytes in 32 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9695316-7fc3-4fca-99f5-a0bbce6637e1 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9695316-7fc3-4fca-99f5-a0bbce6637e1 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:50 l75lg1-v1 neutron-server[77623]: DEBUG dbcounter [-] [77623] Writing DB stats neutron:SELECT=2 {{(pid=77623) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:01:50 l75lg1-v1 neutron-server[77623]: DEBUG dbcounter [-] [77623] Writing DB stats neutron:SELECT=1 {{(pid=77623) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bd795f-ad38-4fa1-951f-7058c924a6db tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56313694cffb4df8b0b20f48edb02368', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb20757ddd604868aff8ad38db5def87', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bd795f-ad38-4fa1-951f-7058c924a6db tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bd795f-ad38-4fa1-951f-7058c924a6db tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bd795f-ad38-4fa1-951f-7058c924a6db tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] PATH_INFO: `/v3/users/eb30733c944e480eb147435ead450b9c` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bd795f-ad38-4fa1-951f-7058c924a6db tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] RBAC: Authorizing `identity:delete_user(user_id=eb30733c944e480eb147435ead450b9c)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bd795f-ad38-4fa1-951f-7058c924a6db tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-f7bd795f-ad38-4fa1-951f-7058c924a6db tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb30733c944e480eb147435ead450b9c', 'request_id': 'req-f7bd795f-ad38-4fa1-951f-7058c924a6db'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-f7bd795f-ad38-4fa1-951f-7058c924a6db tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb30733c944e480eb147435ead450b9c', 'request_id': 'req-f7bd795f-ad38-4fa1-951f-7058c924a6db'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-f7bd795f-ad38-4fa1-951f-7058c924a6db tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb30733c944e480eb147435ead450b9c', 'request_id': 'req-f7bd795f-ad38-4fa1-951f-7058c924a6db'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:50 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-795f2b39-4607-44f8-b135-8531f6a5fa4e tempest-ShareTransferTest-320553121 tempest-ShareTransferTest-320553121-project-member] GET http://10.27.203.238/share/v2/bece16f41fc44d55bf7bc45c2adaaed5/shares/de6cdc3c-7cf5-437f-acad-57530196bb54 May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-f7bd795f-ad38-4fa1-951f-7058c924a6db tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb30733c944e480eb147435ead450b9c', 'request_id': 'req-f7bd795f-ad38-4fa1-951f-7058c924a6db'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:50 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-795f2b39-4607-44f8-b135-8531f6a5fa4e tempest-ShareTransferTest-320553121 tempest-ShareTransferTest-320553121-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:50 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-795f2b39-4607-44f8-b135-8531f6a5fa4e tempest-ShareTransferTest-320553121 tempest-ShareTransferTest-320553121-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-f7bd795f-ad38-4fa1-951f-7058c924a6db tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb30733c944e480eb147435ead450b9c', 'request_id': 'req-f7bd795f-ad38-4fa1-951f-7058c924a6db'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:50 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-795f2b39-4607-44f8-b135-8531f6a5fa4e tempest-ShareTransferTest-320553121 tempest-ShareTransferTest-320553121-project-member] http://10.27.203.238/share/v2/bece16f41fc44d55bf7bc45c2adaaed5/shares/de6cdc3c-7cf5-437f-acad-57530196bb54 returned with HTTP 200 May 28 13:01:50 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1174/2319] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:01:50 2024] GET /share/v2/bece16f41fc44d55bf7bc45c2adaaed5/shares/de6cdc3c-7cf5-437f-acad-57530196bb54 => generated 1316 bytes in 25 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1611/3194] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:01:50 2024] DELETE /identity/v3/users/eb30733c944e480eb147435ead450b9c => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:01:50 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-b3bace20-4723-4cc8-8ee8-8c96336bcf49 tempest-ShareTransferTest-320553121 tempest-ShareTransferTest-320553121-project-member] POST http://10.27.203.238/share/v2/bece16f41fc44d55bf7bc45c2adaaed5/share-transfers May 28 13:01:50 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-b3bace20-4723-4cc8-8ee8-8c96336bcf49 tempest-ShareTransferTest-320553121 tempest-ShareTransferTest-320553121-project-member] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"transfer": {"share_id": "de6cdc3c-7cf5-437f-acad-57530196bb54", "name": "tempest_share_transfer"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:01:50 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-c3f55f28-4968-465f-80fc-47a14ff8e64c tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] DELETE http://10.27.203.238/share/v2/bb20757ddd604868aff8ad38db5def87/share-group-types/c604fd71-5623-4f48-9a0f-e0b31cc7405a May 28 13:01:50 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-c3f55f28-4968-465f-80fc-47a14ff8e64c tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:50 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.v2.share_transfer [None req-b3bace20-4723-4cc8-8ee8-8c96336bcf49 tempest-ShareTransferTest-320553121 tempest-ShareTransferTest-320553121-project-member] Creating new share transfer {'transfer': {'share_id': 'de6cdc3c-7cf5-437f-acad-57530196bb54', 'name': 'tempest_share_transfer'}} {{(pid=98330) create /opt/stack/manila/manila/api/v2/share_transfer.py:104}} May 28 13:01:50 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-c3f55f28-4968-465f-80fc-47a14ff8e64c tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:50 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.v2.share_transfer [None req-b3bace20-4723-4cc8-8ee8-8c96336bcf49 tempest-ShareTransferTest-320553121 tempest-ShareTransferTest-320553121-project-member] Creating transfer of share de6cdc3c-7cf5-437f-acad-57530196bb54 {{(pid=98330) create /opt/stack/manila/manila/api/v2/share_transfer.py:125}} May 28 13:01:50 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.transfer.api [None req-b3bace20-4723-4cc8-8ee8-8c96336bcf49 tempest-ShareTransferTest-320553121 tempest-ShareTransferTest-320553121-project-member] Generating transfer record for share de6cdc3c-7cf5-437f-acad-57530196bb54 {{(pid=98330) create /opt/stack/manila/manila/transfer/api.py:162}} May 28 13:01:50 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-c3f55f28-4968-465f-80fc-47a14ff8e64c tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] http://10.27.203.238/share/v2/bb20757ddd604868aff8ad38db5def87/share-group-types/c604fd71-5623-4f48-9a0f-e0b31cc7405a returned with HTTP 204 May 28 13:01:50 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1175/2320] 10.27.203.238 () {64 vars in 1487 bytes} [Tue May 28 13:01:50 2024] DELETE /share/v2/bb20757ddd604868aff8ad38db5def87/share-group-types/c604fd71-5623-4f48-9a0f-e0b31cc7405a => generated 0 bytes in 57 msecs (HTTP/1.1 204) 6 headers in 245 bytes (2 switches on core 0) May 28 13:01:50 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-b9a39382-1c49-416e-8634-eb9361acb977 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] GET http://10.27.203.238/share/v2/bb20757ddd604868aff8ad38db5def87/share-group-types/c604fd71-5623-4f48-9a0f-e0b31cc7405a May 28 13:01:50 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-b9a39382-1c49-416e-8634-eb9361acb977 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:50 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-b9a39382-1c49-416e-8634-eb9361acb977 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:50 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-b3bace20-4723-4cc8-8ee8-8c96336bcf49 tempest-ShareTransferTest-320553121 tempest-ShareTransferTest-320553121-project-member] http://10.27.203.238/share/v2/bece16f41fc44d55bf7bc45c2adaaed5/share-transfers returned with HTTP 202 May 28 13:01:50 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1146/2321] 10.27.203.238 () {66 vars in 1389 bytes} [Tue May 28 13:01:50 2024] POST /share/v2/bece16f41fc44d55bf7bc45c2adaaed5/share-transfers => generated 701 bytes in 71 msecs (HTTP/1.1 202) 6 headers in 237 bytes (1 switches on core 0) May 28 13:01:50 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-b9a39382-1c49-416e-8634-eb9361acb977 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] HTTP exception thrown: Share group type with id c604fd71-5623-4f48-9a0f-e0b31cc7405a not found. May 28 13:01:50 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-b9a39382-1c49-416e-8634-eb9361acb977 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] http://10.27.203.238/share/v2/bb20757ddd604868aff8ad38db5def87/share-group-types/c604fd71-5623-4f48-9a0f-e0b31cc7405a returned with HTTP 404 May 28 13:01:50 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1176/2322] 10.27.203.238 () {64 vars in 1484 bytes} [Tue May 28 13:01:50 2024] GET /share/v2/bb20757ddd604868aff8ad38db5def87/share-group-types/c604fd71-5623-4f48-9a0f-e0b31cc7405a => generated 118 bytes in 11 msecs (HTTP/1.1 404) 6 headers in 238 bytes (2 switches on core 0) May 28 13:01:50 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-b1a12c7e-3609-4bb0-b54f-447e0467ab84 tempest-ShareTransferTest-320553121 tempest-ShareTransferTest-320553121-project-member] GET http://10.27.203.238/share/v1/bece16f41fc44d55bf7bc45c2adaaed5/shares/de6cdc3c-7cf5-437f-acad-57530196bb54 May 28 13:01:50 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-b1a12c7e-3609-4bb0-b54f-447e0467ab84 tempest-ShareTransferTest-320553121 tempest-ShareTransferTest-320553121-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:50 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-b1a12c7e-3609-4bb0-b54f-447e0467ab84 tempest-ShareTransferTest-320553121 tempest-ShareTransferTest-320553121-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:50 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-bac1982c-34a2-4616-8172-ed92fc670333 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] DELETE http://10.27.203.238/share/v2/bb20757ddd604868aff8ad38db5def87/types/7d2ea8e8-bada-4826-a8a8-53b4e9ff301f May 28 13:01:50 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-bac1982c-34a2-4616-8172-ed92fc670333 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:50 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-bac1982c-34a2-4616-8172-ed92fc670333 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] Calling method 'ShareTypesController._delete' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:50 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 13:01:50 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-b1a12c7e-3609-4bb0-b54f-447e0467ab84 tempest-ShareTransferTest-320553121 tempest-ShareTransferTest-320553121-project-member] http://10.27.203.238/share/v1/bece16f41fc44d55bf7bc45c2adaaed5/shares/de6cdc3c-7cf5-437f-acad-57530196bb54 returned with HTTP 200 May 28 13:01:50 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1147/2323] 10.27.203.238 () {62 vars in 1408 bytes} [Tue May 28 13:01:50 2024] GET /share/v1/bece16f41fc44d55bf7bc45c2adaaed5/shares/de6cdc3c-7cf5-437f-acad-57530196bb54 => generated 905 bytes in 27 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:01:50 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-78b50e50-9e5d-4ea8-8e28-274f66a2b1df tempest-ShareTransferTest-320553121 tempest-ShareTransferTest-320553121-project-member] GET http://10.27.203.238/share/v2/bece16f41fc44d55bf7bc45c2adaaed5/share-transfers/05c2ffef-23aa-4e08-8f97-7d95300e1969 May 28 13:01:50 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-78b50e50-9e5d-4ea8-8e28-274f66a2b1df tempest-ShareTransferTest-320553121 tempest-ShareTransferTest-320553121-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:50 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-78b50e50-9e5d-4ea8-8e28-274f66a2b1df tempest-ShareTransferTest-320553121 tempest-ShareTransferTest-320553121-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:50 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-78b50e50-9e5d-4ea8-8e28-274f66a2b1df tempest-ShareTransferTest-320553121 tempest-ShareTransferTest-320553121-project-member] http://10.27.203.238/share/v2/bece16f41fc44d55bf7bc45c2adaaed5/share-transfers/05c2ffef-23aa-4e08-8f97-7d95300e1969 returned with HTTP 200 May 28 13:01:50 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1148/2324] 10.27.203.238 () {64 vars in 1478 bytes} [Tue May 28 13:01:50 2024] GET /share/v2/bece16f41fc44d55bf7bc45c2adaaed5/share-transfers/05c2ffef-23aa-4e08-8f97-7d95300e1969 => generated 669 bytes in 9 msecs (HTTP/1.1 200) 6 headers in 231 bytes (2 switches on core 0) May 28 13:01:50 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-b90298ee-87d6-4dc0-97f0-48fceef9f4e3 tempest-ShareTransferTest-320553121 tempest-ShareTransferTest-320553121-project-member] DELETE http://10.27.203.238/share/v2/bece16f41fc44d55bf7bc45c2adaaed5/share-transfers/05c2ffef-23aa-4e08-8f97-7d95300e1969 May 28 13:01:50 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-b90298ee-87d6-4dc0-97f0-48fceef9f4e3 tempest-ShareTransferTest-320553121 tempest-ShareTransferTest-320553121-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:50 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-b90298ee-87d6-4dc0-97f0-48fceef9f4e3 tempest-ShareTransferTest-320553121 tempest-ShareTransferTest-320553121-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:50 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.v2.share_transfer [None req-b90298ee-87d6-4dc0-97f0-48fceef9f4e3 tempest-ShareTransferTest-320553121 tempest-ShareTransferTest-320553121-project-member] Delete transfer with id: 05c2ffef-23aa-4e08-8f97-7d95300e1969 {{(pid=98330) delete /opt/stack/manila/manila/api/v2/share_transfer.py:193}} May 28 13:01:50 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-bac1982c-34a2-4616-8172-ed92fc670333 tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] http://10.27.203.238/share/v2/bb20757ddd604868aff8ad38db5def87/types/7d2ea8e8-bada-4826-a8a8-53b4e9ff301f returned with HTTP 202 May 28 13:01:50 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1177/2325] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:01:50 2024] DELETE /share/v2/bb20757ddd604868aff8ad38db5def87/types/7d2ea8e8-bada-4826-a8a8-53b4e9ff301f => generated 0 bytes in 47 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 13:01:50 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-97c16e38-bda2-430e-a339-09b16799116e tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] GET http://10.27.203.238/share/v2/bb20757ddd604868aff8ad38db5def87/types/7d2ea8e8-bada-4826-a8a8-53b4e9ff301f May 28 13:01:50 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-97c16e38-bda2-430e-a339-09b16799116e tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:50 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-97c16e38-bda2-430e-a339-09b16799116e tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] Calling method 'ShareTypesController.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:50 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-97c16e38-bda2-430e-a339-09b16799116e tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] HTTP exception thrown: Share type not found. May 28 13:01:50 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-97c16e38-bda2-430e-a339-09b16799116e tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] http://10.27.203.238/share/v2/bb20757ddd604868aff8ad38db5def87/types/7d2ea8e8-bada-4826-a8a8-53b4e9ff301f returned with HTTP 404 May 28 13:01:50 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1178/2326] 10.27.203.238 () {64 vars in 1448 bytes} [Tue May 28 13:01:50 2024] GET /share/v2/bb20757ddd604868aff8ad38db5def87/types/7d2ea8e8-bada-4826-a8a8-53b4e9ff301f => generated 67 bytes in 10 msecs (HTTP/1.1 404) 6 headers in 237 bytes (2 switches on core 0) May 28 13:01:50 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-4628cb72-2b87-44dd-b633-8a0333123fb7 tempest-ShareRulesTest-1530341375 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:01:50 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-4628cb72-2b87-44dd-b633-8a0333123fb7 tempest-ShareRulesTest-1530341375 None] [Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=1, created='2024-05-28T12:59:53.824250Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='0fa84ccd-850f-48fa-a965-23e5abe31188', id=38, internal=False, is_s3_default_policy=False, name='f7e47502-a0f7-44de-953d-b7b5697ae0b2', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=['*'], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['203.0.113.77'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['203.0.113.77'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T13:01:48.944351Z', tenant_id=1, tenant_name='default', title='f7e47502-a0f7-44de-953d-b7b5697ae0b2', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/38/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[])] May 28 13:01:50 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-4628cb72-2b87-44dd-b633-8a0333123fb7 tempest-ShareRulesTest-1530341375 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 13:01:50 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-4628cb72-2b87-44dd-b633-8a0333123fb7 tempest-ShareRulesTest-1530341375 None] changing access on /manila/manila-f7e47502-a0f7-44de-953d-b7b5697ae0b2. Rules: {'nfs_read_write': [], 'nfs_read_only': []} May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628b95f4-56df-442e-8664-fe725d61963b tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:50 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-4628cb72-2b87-44dd-b633-8a0333123fb7 tempest-ShareRulesTest-1530341375 None] >>> [PATCH] https://127.0.0.1:40443/api/viewpolicies/38/ May 28 13:01:50 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-4628cb72-2b87-44dd-b633-8a0333123fb7 tempest-ShareRulesTest-1530341375 None] {'data': '{"name": "f7e47502-a0f7-44de-953d-b7b5697ae0b2", "nfs_no_squash": ' May 28 13:01:50 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-4628cb72-2b87-44dd-b633-8a0333123fb7 tempest-ShareRulesTest-1530341375 None] '["*"], "nfs_root_squash": ["*"], "nfs_read_write": [], ' May 28 13:01:50 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-4628cb72-2b87-44dd-b633-8a0333123fb7 tempest-ShareRulesTest-1530341375 None] '"nfs_read_only": []}', May 28 13:01:50 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-4628cb72-2b87-44dd-b633-8a0333123fb7 tempest-ShareRulesTest-1530341375 None] 'params': None} May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-628b95f4-56df-442e-8664-fe725d61963b tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628b95f4-56df-442e-8664-fe725d61963b tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:50 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.transfer.api [None req-b90298ee-87d6-4dc0-97f0-48fceef9f4e3 tempest-ShareTransferTest-320553121 tempest-ShareTransferTest-320553121-project-member] Transfer 05c2ffef-23aa-4e08-8f97-7d95300e1969 has been deleted successful. May 28 13:01:50 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-b90298ee-87d6-4dc0-97f0-48fceef9f4e3 tempest-ShareTransferTest-320553121 tempest-ShareTransferTest-320553121-project-member] http://10.27.203.238/share/v2/bece16f41fc44d55bf7bc45c2adaaed5/share-transfers/05c2ffef-23aa-4e08-8f97-7d95300e1969 returned with HTTP 200 May 28 13:01:50 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1149/2327] 10.27.203.238 () {64 vars in 1481 bytes} [Tue May 28 13:01:50 2024] DELETE /share/v2/bece16f41fc44d55bf7bc45c2adaaed5/share-transfers/05c2ffef-23aa-4e08-8f97-7d95300e1969 => generated 0 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 237 bytes (1 switches on core 0) May 28 13:01:50 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-82df030b-8a7d-42d4-88fa-ff168f72b04b tempest-ShareTransferTest-320553121 tempest-ShareTransferTest-320553121-project-member] GET http://10.27.203.238/share/v1/bece16f41fc44d55bf7bc45c2adaaed5/shares/de6cdc3c-7cf5-437f-acad-57530196bb54 May 28 13:01:50 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-82df030b-8a7d-42d4-88fa-ff168f72b04b tempest-ShareTransferTest-320553121 tempest-ShareTransferTest-320553121-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:50 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-82df030b-8a7d-42d4-88fa-ff168f72b04b tempest-ShareTransferTest-320553121 tempest-ShareTransferTest-320553121-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45203c3c-41cf-4b00-8e89-e9c4b1228017 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45203c3c-41cf-4b00-8e89-e9c4b1228017 None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45203c3c-41cf-4b00-8e89-e9c4b1228017 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45203c3c-41cf-4b00-8e89-e9c4b1228017 None admin] PATH_INFO: `/v3/users/0dd83bef5ade4133b0c60f813dd626cb` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45203c3c-41cf-4b00-8e89-e9c4b1228017 None admin] RBAC: Authorizing `identity:delete_user(user_id=0dd83bef5ade4133b0c60f813dd626cb)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45203c3c-41cf-4b00-8e89-e9c4b1228017 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:50 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-82df030b-8a7d-42d4-88fa-ff168f72b04b tempest-ShareTransferTest-320553121 tempest-ShareTransferTest-320553121-project-member] http://10.27.203.238/share/v1/bece16f41fc44d55bf7bc45c2adaaed5/shares/de6cdc3c-7cf5-437f-acad-57530196bb54 returned with HTTP 200 May 28 13:01:50 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1179/2328] 10.27.203.238 () {62 vars in 1408 bytes} [Tue May 28 13:01:50 2024] GET /share/v1/bece16f41fc44d55bf7bc45c2adaaed5/shares/de6cdc3c-7cf5-437f-acad-57530196bb54 => generated 962 bytes in 28 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:01:50 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-8c502f68-ee60-44a0-a4f4-f39c586064f7 tempest-ShareTransferTest-320553121 tempest-ShareTransferTest-320553121-project-member] GET http://10.27.203.238/share/v2/bece16f41fc44d55bf7bc45c2adaaed5/share-transfers May 28 13:01:50 l75lg1-v1 neutron-server[77618]: DEBUG dbcounter [-] [77618] Writing DB stats neutron:SELECT=1 {{(pid=77618) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:01:50 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-8c502f68-ee60-44a0-a4f4-f39c586064f7 tempest-ShareTransferTest-320553121 tempest-ShareTransferTest-320553121-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:50 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-8c502f68-ee60-44a0-a4f4-f39c586064f7 tempest-ShareTransferTest-320553121 tempest-ShareTransferTest-320553121-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:50 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.v2.share_transfer [None req-8c502f68-ee60-44a0-a4f4-f39c586064f7 tempest-ShareTransferTest-320553121 tempest-ShareTransferTest-320553121-project-member] Listing share transfers. {{(pid=98330) _get_transfers /opt/stack/manila/manila/api/v2/share_transfer.py:83}} May 28 13:01:50 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-8c502f68-ee60-44a0-a4f4-f39c586064f7 tempest-ShareTransferTest-320553121 tempest-ShareTransferTest-320553121-project-member] http://10.27.203.238/share/v2/bece16f41fc44d55bf7bc45c2adaaed5/share-transfers returned with HTTP 200 May 28 13:01:50 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1150/2329] 10.27.203.238 () {64 vars in 1367 bytes} [Tue May 28 13:01:50 2024] GET /share/v2/bece16f41fc44d55bf7bc45c2adaaed5/share-transfers => generated 17 bytes in 12 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:01:50 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-beb7a0d9-5a17-4320-b313-26821b56e674 tempest-ShareTransferTest-320553121 tempest-ShareTransferTest-320553121-project-member] GET http://10.27.203.238/share/v2/bece16f41fc44d55bf7bc45c2adaaed5/share-replicas/detail?share_id=de6cdc3c-7cf5-437f-acad-57530196bb54 May 28 13:01:50 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-beb7a0d9-5a17-4320-b313-26821b56e674 tempest-ShareTransferTest-320553121 tempest-ShareTransferTest-320553121-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:50 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-beb7a0d9-5a17-4320-b313-26821b56e674 tempest-ShareTransferTest-320553121 tempest-ShareTransferTest-320553121-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-45203c3c-41cf-4b00-8e89-e9c4b1228017 None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0dd83bef5ade4133b0c60f813dd626cb', 'request_id': 'req-45203c3c-41cf-4b00-8e89-e9c4b1228017'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-45203c3c-41cf-4b00-8e89-e9c4b1228017 None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0dd83bef5ade4133b0c60f813dd626cb', 'request_id': 'req-45203c3c-41cf-4b00-8e89-e9c4b1228017'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:50 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-beb7a0d9-5a17-4320-b313-26821b56e674 tempest-ShareTransferTest-320553121 tempest-ShareTransferTest-320553121-project-member] http://10.27.203.238/share/v2/bece16f41fc44d55bf7bc45c2adaaed5/share-replicas/detail?share_id=de6cdc3c-7cf5-437f-acad-57530196bb54 returned with HTTP 200 May 28 13:01:50 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1180/2330] 10.27.203.238 () {64 vars in 1476 bytes} [Tue May 28 13:01:50 2024] GET /share/v2/bece16f41fc44d55bf7bc45c2adaaed5/share-replicas/detail?share_id=de6cdc3c-7cf5-437f-acad-57530196bb54 => generated 22 bytes in 14 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-45203c3c-41cf-4b00-8e89-e9c4b1228017 None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0dd83bef5ade4133b0c60f813dd626cb', 'request_id': 'req-45203c3c-41cf-4b00-8e89-e9c4b1228017'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:50 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-21d485fc-6edd-43f7-b475-852d15bdb669 tempest-ShareTransferTest-320553121 tempest-ShareTransferTest-320553121-project-member] DELETE http://10.27.203.238/share/v2/bece16f41fc44d55bf7bc45c2adaaed5/shares/de6cdc3c-7cf5-437f-acad-57530196bb54 May 28 13:01:50 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-21d485fc-6edd-43f7-b475-852d15bdb669 tempest-ShareTransferTest-320553121 tempest-ShareTransferTest-320553121-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:50 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-21d485fc-6edd-43f7-b475-852d15bdb669 tempest-ShareTransferTest-320553121 tempest-ShareTransferTest-320553121-project-member] Calling method 'ShareMixin.delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:50 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.v1.shares [None req-21d485fc-6edd-43f7-b475-852d15bdb669 tempest-ShareTransferTest-320553121 tempest-ShareTransferTest-320553121-project-member] Delete share with id: de6cdc3c-7cf5-437f-acad-57530196bb54 May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-45203c3c-41cf-4b00-8e89-e9c4b1228017 None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0dd83bef5ade4133b0c60f813dd626cb', 'request_id': 'req-45203c3c-41cf-4b00-8e89-e9c4b1228017'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-45203c3c-41cf-4b00-8e89-e9c4b1228017 None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0dd83bef5ade4133b0c60f813dd626cb', 'request_id': 'req-45203c3c-41cf-4b00-8e89-e9c4b1228017'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1584/3195] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 13:01:50 2024] DELETE /identity/v3/users/0dd83bef5ade4133b0c60f813dd626cb => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bd795f-ad38-4fa1-951f-7058c924a6db tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bd795f-ad38-4fa1-951f-7058c924a6db tempest-ShareTypeAvailabilityZonesTest-1384344375 tempest-ShareTypeAvailabilityZonesTest-1384344375-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5a3422-f6af-4840-9910-fe29f9809464 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5a3422-f6af-4840-9910-fe29f9809464 None admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5a3422-f6af-4840-9910-fe29f9809464 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5a3422-f6af-4840-9910-fe29f9809464 None admin] PATH_INFO: `/v3/users/4aa0df52df4847d09e8d886a65400804` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5a3422-f6af-4840-9910-fe29f9809464 None admin] RBAC: Authorizing `identity:delete_user(user_id=4aa0df52df4847d09e8d886a65400804)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5a3422-f6af-4840-9910-fe29f9809464 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-ab5a3422-f6af-4840-9910-fe29f9809464 None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4aa0df52df4847d09e8d886a65400804', 'request_id': 'req-ab5a3422-f6af-4840-9910-fe29f9809464'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-ab5a3422-f6af-4840-9910-fe29f9809464 None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4aa0df52df4847d09e8d886a65400804', 'request_id': 'req-ab5a3422-f6af-4840-9910-fe29f9809464'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-ab5a3422-f6af-4840-9910-fe29f9809464 None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4aa0df52df4847d09e8d886a65400804', 'request_id': 'req-ab5a3422-f6af-4840-9910-fe29f9809464'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-ab5a3422-f6af-4840-9910-fe29f9809464 None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4aa0df52df4847d09e8d886a65400804', 'request_id': 'req-ab5a3422-f6af-4840-9910-fe29f9809464'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:50 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-21d485fc-6edd-43f7-b475-852d15bdb669 tempest-ShareTransferTest-320553121 tempest-ShareTransferTest-320553121-project-member] http://10.27.203.238/share/v2/bece16f41fc44d55bf7bc45c2adaaed5/shares/de6cdc3c-7cf5-437f-acad-57530196bb54 returned with HTTP 202 May 28 13:01:50 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1151/2331] 10.27.203.238 () {64 vars in 1454 bytes} [Tue May 28 13:01:50 2024] DELETE /share/v2/bece16f41fc44d55bf7bc45c2adaaed5/shares/de6cdc3c-7cf5-437f-acad-57530196bb54 => generated 0 bytes in 140 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 13:01:50 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-f0d9b7d2-d98c-47d3-b8b9-cb1704137c65 tempest-ShareTransferTest-320553121 tempest-ShareTransferTest-320553121-project-member] GET http://10.27.203.238/share/v2/bece16f41fc44d55bf7bc45c2adaaed5/shares/de6cdc3c-7cf5-437f-acad-57530196bb54 May 28 13:01:50 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-f0d9b7d2-d98c-47d3-b8b9-cb1704137c65 tempest-ShareTransferTest-320553121 tempest-ShareTransferTest-320553121-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:50 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-f0d9b7d2-d98c-47d3-b8b9-cb1704137c65 tempest-ShareTransferTest-320553121 tempest-ShareTransferTest-320553121-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-ab5a3422-f6af-4840-9910-fe29f9809464 None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4aa0df52df4847d09e8d886a65400804', 'request_id': 'req-ab5a3422-f6af-4840-9910-fe29f9809464'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1612/3196] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 13:01:50 2024] DELETE /identity/v3/users/4aa0df52df4847d09e8d886a65400804 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45203c3c-41cf-4b00-8e89-e9c4b1228017 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-45203c3c-41cf-4b00-8e89-e9c4b1228017 None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:01:50 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-f0d9b7d2-d98c-47d3-b8b9-cb1704137c65 tempest-ShareTransferTest-320553121 tempest-ShareTransferTest-320553121-project-member] http://10.27.203.238/share/v2/bece16f41fc44d55bf7bc45c2adaaed5/shares/de6cdc3c-7cf5-437f-acad-57530196bb54 returned with HTTP 200 May 28 13:01:50 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1181/2332] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:01:50 2024] GET /share/v2/bece16f41fc44d55bf7bc45c2adaaed5/shares/de6cdc3c-7cf5-437f-acad-57530196bb54 => generated 1315 bytes in 29 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45203c3c-41cf-4b00-8e89-e9c4b1228017 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54710842-0fcc-4214-8700-adc28d655a11 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54710842-0fcc-4214-8700-adc28d655a11 None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54710842-0fcc-4214-8700-adc28d655a11 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54710842-0fcc-4214-8700-adc28d655a11 None admin] PATH_INFO: `/v3/users/56313694cffb4df8b0b20f48edb02368` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54710842-0fcc-4214-8700-adc28d655a11 None admin] RBAC: Authorizing `identity:delete_user(user_id=56313694cffb4df8b0b20f48edb02368)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:50 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54710842-0fcc-4214-8700-adc28d655a11 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:50 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-21d485fc-6edd-43f7-b475-852d15bdb669 tempest-ShareTransferTest-320553121 None] Acquiring lock "locked_access_rules_operation_by_share_instance_c9f751bd-bfa5-491d-9739-47b922a557d3" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:01:50 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-21d485fc-6edd-43f7-b475-852d15bdb669 tempest-ShareTransferTest-320553121 None] Lock "locked_access_rules_operation_by_share_instance_c9f751bd-bfa5-491d-9739-47b922a557d3" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:01:50 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-21d485fc-6edd-43f7-b475-852d15bdb669 tempest-ShareTransferTest-320553121 None] Lock "locked_access_rules_operation_by_share_instance_c9f751bd-bfa5-491d-9739-47b922a557d3" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:01:50 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-21d485fc-6edd-43f7-b475-852d15bdb669 tempest-ShareTransferTest-320553121 None] Acquiring lock "locked_access_rules_operation_by_share_instance_c9f751bd-bfa5-491d-9739-47b922a557d3" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:01:50 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-21d485fc-6edd-43f7-b475-852d15bdb669 tempest-ShareTransferTest-320553121 None] Lock "locked_access_rules_operation_by_share_instance_c9f751bd-bfa5-491d-9739-47b922a557d3" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:01:50 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-21d485fc-6edd-43f7-b475-852d15bdb669 tempest-ShareTransferTest-320553121 None] Lock "locked_access_rules_operation_by_share_instance_c9f751bd-bfa5-491d-9739-47b922a557d3" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:01:50 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-21d485fc-6edd-43f7-b475-852d15bdb669 tempest-ShareTransferTest-320553121 None] Acquiring lock "locked_access_rules_operation_by_share_instance_c9f751bd-bfa5-491d-9739-47b922a557d3" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:01:50 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-21d485fc-6edd-43f7-b475-852d15bdb669 tempest-ShareTransferTest-320553121 None] Lock "locked_access_rules_operation_by_share_instance_c9f751bd-bfa5-491d-9739-47b922a557d3" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:01:50 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-21d485fc-6edd-43f7-b475-852d15bdb669 tempest-ShareTransferTest-320553121 None] Lock "locked_access_rules_operation_by_share_instance_c9f751bd-bfa5-491d-9739-47b922a557d3" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:01:50 l75lg1-v1 manila-share[98474]: DEBUG manila.share.access [None req-21d485fc-6edd-43f7-b475-852d15bdb669 tempest-ShareTransferTest-320553121 None] All access rules have been synced for share instance c9f751bd-bfa5-491d-9739-47b922a557d3 belonging to share de6cdc3c-7cf5-437f-acad-57530196bb54. {{(pid=98474) update_access_rules /opt/stack/manila/manila/share/access.py:304}} May 28 13:01:50 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-21d485fc-6edd-43f7-b475-852d15bdb669 tempest-ShareTransferTest-320553121 None] deleting '/manila/manila-c9f751bd-bfa5-491d-9739-47b922a557d3' May 28 13:01:50 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-21d485fc-6edd-43f7-b475-852d15bdb669 tempest-ShareTransferTest-320553121 None] >>> [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/ May 28 13:01:50 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-21d485fc-6edd-43f7-b475-852d15bdb669 tempest-ShareTransferTest-320553121 None] {'data': '{"path": "/manila/manila-c9f751bd-bfa5-491d-9739-47b922a557d3"}', May 28 13:01:50 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-21d485fc-6edd-43f7-b475-852d15bdb669 tempest-ShareTransferTest-320553121 None] 'params': None} May 28 13:01:50 l75lg1-v1 neutron-server[77619]: DEBUG dbcounter [-] [77619] Writing DB stats neutron:SELECT=2 {{(pid=77619) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:01:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-54710842-0fcc-4214-8700-adc28d655a11 None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56313694cffb4df8b0b20f48edb02368', 'request_id': 'req-54710842-0fcc-4214-8700-adc28d655a11'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-54710842-0fcc-4214-8700-adc28d655a11 None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56313694cffb4df8b0b20f48edb02368', 'request_id': 'req-54710842-0fcc-4214-8700-adc28d655a11'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-54710842-0fcc-4214-8700-adc28d655a11 None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56313694cffb4df8b0b20f48edb02368', 'request_id': 'req-54710842-0fcc-4214-8700-adc28d655a11'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-54710842-0fcc-4214-8700-adc28d655a11 None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56313694cffb4df8b0b20f48edb02368', 'request_id': 'req-54710842-0fcc-4214-8700-adc28d655a11'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-54710842-0fcc-4214-8700-adc28d655a11 None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56313694cffb4df8b0b20f48edb02368', 'request_id': 'req-54710842-0fcc-4214-8700-adc28d655a11'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:51 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1585/3197] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 13:01:50 2024] DELETE /identity/v3/users/56313694cffb4df8b0b20f48edb02368 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:01:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b816cfa-a0ca-46b4-ac55-2f0597f0940a None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b816cfa-a0ca-46b4-ac55-2f0597f0940a None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b816cfa-a0ca-46b4-ac55-2f0597f0940a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:51 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-9b816cfa-a0ca-46b4-ac55-2f0597f0940a None None] Truncating password to algorithm specific maximum length 72 characters. May 28 13:01:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-9b816cfa-a0ca-46b4-ac55-2f0597f0940a None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 13:01:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-9b816cfa-a0ca-46b4-ac55-2f0597f0940a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:01:51 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-21d485fc-6edd-43f7-b475-852d15bdb669 tempest-ShareTransferTest-320553121 None] <<< [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/ May 28 13:01:51 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-21d485fc-6edd-43f7-b475-852d15bdb669 tempest-ShareTransferTest-320553121 None] 'OK' May 28 13:01:51 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-21d485fc-6edd-43f7-b475-852d15bdb669 tempest-ShareTransferTest-320553121 None] --- [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/: Done May 28 13:01:51 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-21d485fc-6edd-43f7-b475-852d15bdb669 tempest-ShareTransferTest-320553121 None] >>> [GET] https://127.0.0.1:40443/api/views/ May 28 13:01:51 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-21d485fc-6edd-43f7-b475-852d15bdb669 tempest-ShareTransferTest-320553121 None] {'allow_redirects': True, May 28 13:01:51 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-21d485fc-6edd-43f7-b475-852d15bdb669 tempest-ShareTransferTest-320553121 None] 'params': {'name': 'c9f751bd-bfa5-491d-9739-47b922a557d3'}} May 28 13:01:51 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1613/3198] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 13:01:51 2024] POST /identity/v3/auth/tokens => generated 2960 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 13:01:51 l75lg1-v1 neutron-server[77619]: DEBUG neutron.wsgi [-] (77619) accepted ('10.27.203.238', 42692) {{(pid=77619) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 13:01:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54710842-0fcc-4214-8700-adc28d655a11 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-54710842-0fcc-4214-8700-adc28d655a11 None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:01:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54710842-0fcc-4214-8700-adc28d655a11 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea1b6a6-dfa1-4f14-b738-af33325f4426 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef17047035e4b518fd5360a01f2da1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea1b6a6-dfa1-4f14-b738-af33325f4426 service neutron] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea1b6a6-dfa1-4f14-b738-af33325f4426 service neutron] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea1b6a6-dfa1-4f14-b738-af33325f4426 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea1b6a6-dfa1-4f14-b738-af33325f4426 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea1b6a6-dfa1-4f14-b738-af33325f4426 service neutron] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:51 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1586/3199] 10.27.203.238 () {64 vars in 1432 bytes} [Tue May 28 13:01:51 2024] GET /identity/v3/auth/tokens => generated 2960 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 28 13:01:51 l75lg1-v1 neutron-server[77619]: INFO neutron.wsgi [None req-4433f110-4b70-4965-9d34-13c948e1f9df None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=bb20757ddd604868aff8ad38db5def87&name=default HTTP/1.1" status: 200 len: 216 time: 0.0745232 May 28 13:01:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b816cfa-a0ca-46b4-ac55-2f0597f0940a None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-9b816cfa-a0ca-46b4-ac55-2f0597f0940a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:01:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b816cfa-a0ca-46b4-ac55-2f0597f0940a None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f0c66d-0ca4-49eb-87c4-e1158c79bd18 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f0c66d-0ca4-49eb-87c4-e1158c79bd18 None admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f0c66d-0ca4-49eb-87c4-e1158c79bd18 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f0c66d-0ca4-49eb-87c4-e1158c79bd18 None admin] PATH_INFO: `/v3/projects/bb20757ddd604868aff8ad38db5def87` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f0c66d-0ca4-49eb-87c4-e1158c79bd18 None admin] RBAC: Authorizing `identity:delete_project(project_id=bb20757ddd604868aff8ad38db5def87)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f0c66d-0ca4-49eb-87c4-e1158c79bd18 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-69f0c66d-0ca4-49eb-87c4-e1158c79bd18 None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb20757ddd604868aff8ad38db5def87', 'request_id': 'req-69f0c66d-0ca4-49eb-87c4-e1158c79bd18'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-69f0c66d-0ca4-49eb-87c4-e1158c79bd18 None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb20757ddd604868aff8ad38db5def87', 'request_id': 'req-69f0c66d-0ca4-49eb-87c4-e1158c79bd18'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:51 l75lg1-v1 dstat.sh[49771]: 28-05 13:01:51| 14 1 80 3 0|5634M 1799M 278M 7913M| 16k 2512B| 0 2204k| 0 330 |8780 15k|1.08 1.16 1.06|2.0 1.0 0| 0 0 | 0 2048M| 29 364 0 30 2 May 28 13:01:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-69f0c66d-0ca4-49eb-87c4-e1158c79bd18 None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb20757ddd604868aff8ad38db5def87', 'request_id': 'req-69f0c66d-0ca4-49eb-87c4-e1158c79bd18'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-69f0c66d-0ca4-49eb-87c4-e1158c79bd18 None admin] The token cache is being invalidate because project bb20757ddd604868aff8ad38db5def87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 13:01:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-69f0c66d-0ca4-49eb-87c4-e1158c79bd18 None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-69f0c66d-0ca4-49eb-87c4-e1158c79bd18 None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:51 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1614/3200] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 13:01:51 2024] DELETE /identity/v3/projects/bb20757ddd604868aff8ad38db5def87 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:01:51 l75lg1-v1 neutron-server[77619]: DEBUG neutron.wsgi [-] (77619) accepted ('10.27.203.238', 42704) {{(pid=77619) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 13:01:51 l75lg1-v1 neutron-server[77619]: INFO neutron.wsgi [None req-9e48741f-dddb-4087-8a7b-85f83eb9c987 None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=284d76edec3144579d6fb3f6dbc0dd4e&name=default HTTP/1.1" status: 200 len: 216 time: 0.0085387 May 28 13:01:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea1b6a6-dfa1-4f14-b738-af33325f4426 service neutron] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea1b6a6-dfa1-4f14-b738-af33325f4426 service neutron] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bffba4d-56de-4cee-b9b6-b23bb640e9dc None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bffba4d-56de-4cee-b9b6-b23bb640e9dc None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bffba4d-56de-4cee-b9b6-b23bb640e9dc None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bffba4d-56de-4cee-b9b6-b23bb640e9dc None admin] PATH_INFO: `/v3/projects/284d76edec3144579d6fb3f6dbc0dd4e` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bffba4d-56de-4cee-b9b6-b23bb640e9dc None admin] RBAC: Authorizing `identity:delete_project(project_id=284d76edec3144579d6fb3f6dbc0dd4e)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bffba4d-56de-4cee-b9b6-b23bb640e9dc None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-4bffba4d-56de-4cee-b9b6-b23bb640e9dc None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '284d76edec3144579d6fb3f6dbc0dd4e', 'request_id': 'req-4bffba4d-56de-4cee-b9b6-b23bb640e9dc'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-4bffba4d-56de-4cee-b9b6-b23bb640e9dc None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '284d76edec3144579d6fb3f6dbc0dd4e', 'request_id': 'req-4bffba4d-56de-4cee-b9b6-b23bb640e9dc'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-4bffba4d-56de-4cee-b9b6-b23bb640e9dc None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '284d76edec3144579d6fb3f6dbc0dd4e', 'request_id': 'req-4bffba4d-56de-4cee-b9b6-b23bb640e9dc'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-4bffba4d-56de-4cee-b9b6-b23bb640e9dc None admin] The token cache is being invalidate because project 284d76edec3144579d6fb3f6dbc0dd4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 13:01:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-4bffba4d-56de-4cee-b9b6-b23bb640e9dc None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-4bffba4d-56de-4cee-b9b6-b23bb640e9dc None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:51 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1587/3201] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 13:01:51 2024] DELETE /identity/v3/projects/284d76edec3144579d6fb3f6dbc0dd4e => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:01:51 l75lg1-v1 neutron-server[77619]: DEBUG neutron.wsgi [-] (77619) accepted ('10.27.203.238', 42716) {{(pid=77619) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 13:01:51 l75lg1-v1 neutron-server[77619]: INFO neutron.wsgi [None req-14d3547a-b979-4715-bc42-d0bca9071c4a None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=7631375e6ec649fc94b5cca62d03ea51&name=default HTTP/1.1" status: 200 len: 216 time: 0.0093758 May 28 13:01:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f0c66d-0ca4-49eb-87c4-e1158c79bd18 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-69f0c66d-0ca4-49eb-87c4-e1158c79bd18 None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:01:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f0c66d-0ca4-49eb-87c4-e1158c79bd18 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fb642a-c50f-4712-bebc-7527da3bf836 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fb642a-c50f-4712-bebc-7527da3bf836 None admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fb642a-c50f-4712-bebc-7527da3bf836 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fb642a-c50f-4712-bebc-7527da3bf836 None admin] PATH_INFO: `/v3/projects/7631375e6ec649fc94b5cca62d03ea51` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fb642a-c50f-4712-bebc-7527da3bf836 None admin] RBAC: Authorizing `identity:delete_project(project_id=7631375e6ec649fc94b5cca62d03ea51)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fb642a-c50f-4712-bebc-7527da3bf836 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-e7fb642a-c50f-4712-bebc-7527da3bf836 None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7631375e6ec649fc94b5cca62d03ea51', 'request_id': 'req-e7fb642a-c50f-4712-bebc-7527da3bf836'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-e7fb642a-c50f-4712-bebc-7527da3bf836 None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7631375e6ec649fc94b5cca62d03ea51', 'request_id': 'req-e7fb642a-c50f-4712-bebc-7527da3bf836'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-e7fb642a-c50f-4712-bebc-7527da3bf836 None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7631375e6ec649fc94b5cca62d03ea51', 'request_id': 'req-e7fb642a-c50f-4712-bebc-7527da3bf836'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-e7fb642a-c50f-4712-bebc-7527da3bf836 None admin] The token cache is being invalidate because project 7631375e6ec649fc94b5cca62d03ea51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 13:01:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-e7fb642a-c50f-4712-bebc-7527da3bf836 None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-e7fb642a-c50f-4712-bebc-7527da3bf836 None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:01:51 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1615/3202] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 13:01:51 2024] DELETE /identity/v3/projects/7631375e6ec649fc94b5cca62d03ea51 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:01:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eabb48-5990-4726-ae65-12215b314e72 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eabb48-5990-4726-ae65-12215b314e72 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eabb48-5990-4726-ae65-12215b314e72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:51 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-04eabb48-5990-4726-ae65-12215b314e72 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 13:01:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-04eabb48-5990-4726-ae65-12215b314e72 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 13:01:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-04eabb48-5990-4726-ae65-12215b314e72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:01:51 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1588/3203] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 13:01:51 2024] POST /identity/v3/auth/tokens => generated 312 bytes in 20 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 28 13:01:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dbae9e-d6f7-42d8-9521-55bfc0a8556a None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dbae9e-d6f7-42d8-9521-55bfc0a8556a None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dbae9e-d6f7-42d8-9521-55bfc0a8556a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:51 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-10dbae9e-d6f7-42d8-9521-55bfc0a8556a None None] Truncating password to algorithm specific maximum length 72 characters. May 28 13:01:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-10dbae9e-d6f7-42d8-9521-55bfc0a8556a None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 13:01:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-10dbae9e-d6f7-42d8-9521-55bfc0a8556a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:01:51 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 13:01:51 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1616/3204] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 13:01:51 2024] POST /identity/v3/auth/tokens => generated 2960 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 13:01:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04eabb48-5990-4726-ae65-12215b314e72 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04eabb48-5990-4726-ae65-12215b314e72 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b1871b-e651-469e-a606-75023a75085f None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b1871b-e651-469e-a606-75023a75085f None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b1871b-e651-469e-a606-75023a75085f None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b1871b-e651-469e-a606-75023a75085f None admin] PATH_INFO: `/v3/domains` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b1871b-e651-469e-a606-75023a75085f None admin] RBAC: Adding query filter params (name=Default) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 13:01:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b1871b-e651-469e-a606-75023a75085f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b1871b-e651-469e-a606-75023a75085f None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:51 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1589/3205] 10.27.203.238 () {62 vars in 1220 bytes} [Tue May 28 13:01:51 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 13:01:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dbae9e-d6f7-42d8-9521-55bfc0a8556a None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dbae9e-d6f7-42d8-9521-55bfc0a8556a None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e04c19-8a13-4666-8dfa-7615b87821be None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e04c19-8a13-4666-8dfa-7615b87821be None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e04c19-8a13-4666-8dfa-7615b87821be None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e04c19-8a13-4666-8dfa-7615b87821be None admin] PATH_INFO: `/v3/projects` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e04c19-8a13-4666-8dfa-7615b87821be None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e04c19-8a13-4666-8dfa-7615b87821be None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:51 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1617/3206] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 13:01:51 2024] POST /identity/v3/projects => generated 371 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 13:01:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b1871b-e651-469e-a606-75023a75085f None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b1871b-e651-469e-a606-75023a75085f None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c599ec-08b7-428b-9671-a4b5972d0ad7 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c599ec-08b7-428b-9671-a4b5972d0ad7 None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c599ec-08b7-428b-9671-a4b5972d0ad7 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c599ec-08b7-428b-9671-a4b5972d0ad7 None admin] PATH_INFO: `/v3/users` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c599ec-08b7-428b-9671-a4b5972d0ad7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c599ec-08b7-428b-9671-a4b5972d0ad7 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:51 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-33c599ec-08b7-428b-9671-a4b5972d0ad7 None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 13:01:51 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1590/3207] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 13:01:51 2024] POST /identity/v3/users => generated 294 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 13:01:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e04c19-8a13-4666-8dfa-7615b87821be None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e04c19-8a13-4666-8dfa-7615b87821be None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41a2a83-c7a8-487d-9c3d-15c247092e5f None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41a2a83-c7a8-487d-9c3d-15c247092e5f None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41a2a83-c7a8-487d-9c3d-15c247092e5f None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41a2a83-c7a8-487d-9c3d-15c247092e5f None admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41a2a83-c7a8-487d-9c3d-15c247092e5f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41a2a83-c7a8-487d-9c3d-15c247092e5f None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:51 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1618/3208] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 13:01:51 2024] GET /identity/v3/roles => generated 1680 bytes in 16 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 13:01:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c599ec-08b7-428b-9671-a4b5972d0ad7 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c599ec-08b7-428b-9671-a4b5972d0ad7 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0c2b7c-fee9-427b-bdea-44925c6e6e7d None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0c2b7c-fee9-427b-bdea-44925c6e6e7d None admin] REQUEST_METHOD: `PUT` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0c2b7c-fee9-427b-bdea-44925c6e6e7d None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0c2b7c-fee9-427b-bdea-44925c6e6e7d None admin] PATH_INFO: `/v3/projects/6035b1be773e417b80fb3d9ea83eac8d/users/c4a7d9cd21ad4b60b960c58a5e4c5ea1/roles/44620cad10ae407c90c91e2c296adb04` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:51 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-21d485fc-6edd-43f7-b475-852d15bdb669 tempest-ShareTransferTest-320553121 None] <<< [GET] https://127.0.0.1:40443/api/views/ May 28 13:01:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0c2b7c-fee9-427b-bdea-44925c6e6e7d None admin] RBAC: Authorizing `identity:create_grant(project_id=6035b1be773e417b80fb3d9ea83eac8d, user_id=c4a7d9cd21ad4b60b960c58a5e4c5ea1, role_id=44620cad10ae407c90c91e2c296adb04)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:51 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-21d485fc-6edd-43f7-b475-852d15bdb669 tempest-ShareTransferTest-320553121 None] [Bunch(abac_tags=[], abe_max_depth=None, abe_protocols=[], alias='', allow_anonymous_access=False, allow_s3_anonymous_access=False, auto_commit='0d', bucket='', bucket_creators=[], bucket_creators_groups=[], bucket_owner=None, bulk_permission_update_progress=None, bulk_permission_update_state=None, cluster='loop75-kfs', cluster_id=1, created='2024-05-28T13:01:48.478991Z', enabled=True, files_retention_mode='NONE', guid='c7fd3975-6dcf-4ffb-a4f1-bcebae9548b0', id=53, ignore_oos=False, internal=False, is_remote=False, is_seamless=False, logical_capacity=0, max_retention_period=None, min_retention_period=None, name='c9f751bd-bfa5-491d-9739-47b922a557d3', nfs_interop_flags='BOTH_NFS3_AND_NFS4_INTEROP_DISABLED', path='/manila/manila-c9f751bd-bfa5-491d-9739-47b922a557d3', physical_capacity=0, policy='c9f751bd-bfa5-491d-9739-47b922a557d3', policy_id=54, protocols=['NFS'], qos_policy=None, qos_policy_id=None, s3_locks=False, s3_locks_retention_mode='NONE', s3_locks_retention_period='', s3_unverified_lookup=False, s3_versioning=False, select_for_live_monitoring=False, share='', share_acl=Bunch(acl=[], enabled=False), sync='SYNCED', sync_time='2024-05-28T13:01:48.772520Z', tenant_id=1, tenant_name='default', title='/manila/manila-c9f751bd-bfa5-491d-9739-47b922a557d3', url='https://127.0.0.1:40443/api/views/53/')] May 28 13:01:51 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-21d485fc-6edd-43f7-b475-852d15bdb669 tempest-ShareTransferTest-320553121 None] --- [GET] https://127.0.0.1:40443/api/views/: Done May 28 13:01:51 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-21d485fc-6edd-43f7-b475-852d15bdb669 tempest-ShareTransferTest-320553121 None] >>> [DELETE] https://127.0.0.1:40443/api/views/53/ May 28 13:01:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0c2b7c-fee9-427b-bdea-44925c6e6e7d None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:51 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1591/3209] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 13:01:51 2024] PUT /identity/v3/projects/6035b1be773e417b80fb3d9ea83eac8d/users/c4a7d9cd21ad4b60b960c58a5e4c5ea1/roles/44620cad10ae407c90c91e2c296adb04 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:01:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b61c48e-bb7e-44e2-a788-c045fdc26eda None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b61c48e-bb7e-44e2-a788-c045fdc26eda None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b61c48e-bb7e-44e2-a788-c045fdc26eda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:51 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-5b61c48e-bb7e-44e2-a788-c045fdc26eda None None] Truncating password to algorithm specific maximum length 72 characters. May 28 13:01:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-5b61c48e-bb7e-44e2-a788-c045fdc26eda None None] MFA Rules not processed for user `c4a7d9cd21ad4b60b960c58a5e4c5ea1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 13:01:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-5b61c48e-bb7e-44e2-a788-c045fdc26eda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:01:51 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1619/3210] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 13:01:51 2024] POST /identity/v3/auth/tokens => generated 3942 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 13:01:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0c2b7c-fee9-427b-bdea-44925c6e6e7d None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0c2b7c-fee9-427b-bdea-44925c6e6e7d None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71703346-ccc1-48f8-9f8b-0114fb5e0d20 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71703346-ccc1-48f8-9f8b-0114fb5e0d20 None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71703346-ccc1-48f8-9f8b-0114fb5e0d20 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71703346-ccc1-48f8-9f8b-0114fb5e0d20 None admin] PATH_INFO: `/v3/projects` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71703346-ccc1-48f8-9f8b-0114fb5e0d20 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71703346-ccc1-48f8-9f8b-0114fb5e0d20 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:51 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1592/3211] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 13:01:51 2024] POST /identity/v3/projects => generated 369 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 13:01:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b61c48e-bb7e-44e2-a788-c045fdc26eda None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b61c48e-bb7e-44e2-a788-c045fdc26eda None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f930d7-66ce-4b30-b32e-7c19963dbcc4 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f930d7-66ce-4b30-b32e-7c19963dbcc4 None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f930d7-66ce-4b30-b32e-7c19963dbcc4 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f930d7-66ce-4b30-b32e-7c19963dbcc4 None admin] PATH_INFO: `/v3/users` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f930d7-66ce-4b30-b32e-7c19963dbcc4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:51 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f930d7-66ce-4b30-b32e-7c19963dbcc4 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:51 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-c7f930d7-66ce-4b30-b32e-7c19963dbcc4 None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 13:01:51 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1620/3212] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 13:01:51 2024] POST /identity/v3/users => generated 293 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 13:01:51 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71703346-ccc1-48f8-9f8b-0114fb5e0d20 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71703346-ccc1-48f8-9f8b-0114fb5e0d20 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8441af11-7fa7-41f4-b59f-0e92f2910123 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8441af11-7fa7-41f4-b59f-0e92f2910123 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8441af11-7fa7-41f4-b59f-0e92f2910123 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8441af11-7fa7-41f4-b59f-0e92f2910123 None admin] PATH_INFO: `/v3/roles` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8441af11-7fa7-41f4-b59f-0e92f2910123 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8441af11-7fa7-41f4-b59f-0e92f2910123 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:52 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1593/3213] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 13:01:51 2024] GET /identity/v3/roles => generated 1680 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 13:01:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f930d7-66ce-4b30-b32e-7c19963dbcc4 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f930d7-66ce-4b30-b32e-7c19963dbcc4 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cfa861-8dbd-4b22-9743-681161c89d8c None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cfa861-8dbd-4b22-9743-681161c89d8c None admin] REQUEST_METHOD: `PUT` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cfa861-8dbd-4b22-9743-681161c89d8c None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cfa861-8dbd-4b22-9743-681161c89d8c None admin] PATH_INFO: `/v3/projects/5ffad3f9524c441b92bd477a4b904347/users/fc2e4f2c8de242e09b81f6c349f818df/roles/44620cad10ae407c90c91e2c296adb04` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cfa861-8dbd-4b22-9743-681161c89d8c None admin] RBAC: Authorizing `identity:create_grant(project_id=5ffad3f9524c441b92bd477a4b904347, user_id=fc2e4f2c8de242e09b81f6c349f818df, role_id=44620cad10ae407c90c91e2c296adb04)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cfa861-8dbd-4b22-9743-681161c89d8c None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:52 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1621/3214] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 13:01:52 2024] PUT /identity/v3/projects/5ffad3f9524c441b92bd477a4b904347/users/fc2e4f2c8de242e09b81f6c349f818df/roles/44620cad10ae407c90c91e2c296adb04 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:01:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b7072d-ae31-42ca-ab4a-9f4a77a01668 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b7072d-ae31-42ca-ab4a-9f4a77a01668 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b7072d-ae31-42ca-ab4a-9f4a77a01668 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:52 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-e9b7072d-ae31-42ca-ab4a-9f4a77a01668 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 13:01:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-e9b7072d-ae31-42ca-ab4a-9f4a77a01668 None None] MFA Rules not processed for user `fc2e4f2c8de242e09b81f6c349f818df`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 13:01:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-e9b7072d-ae31-42ca-ab4a-9f4a77a01668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:01:52 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1594/3215] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 13:01:52 2024] POST /identity/v3/auth/tokens => generated 3940 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 13:01:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cfa861-8dbd-4b22-9743-681161c89d8c None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cfa861-8dbd-4b22-9743-681161c89d8c None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675d4af5-19bc-41ea-912f-0f94b2fe87df None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675d4af5-19bc-41ea-912f-0f94b2fe87df None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675d4af5-19bc-41ea-912f-0f94b2fe87df None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675d4af5-19bc-41ea-912f-0f94b2fe87df None admin] PATH_INFO: `/v3/projects` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675d4af5-19bc-41ea-912f-0f94b2fe87df None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675d4af5-19bc-41ea-912f-0f94b2fe87df None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:52 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1622/3216] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 13:01:52 2024] POST /identity/v3/projects => generated 369 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 13:01:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b7072d-ae31-42ca-ab4a-9f4a77a01668 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b7072d-ae31-42ca-ab4a-9f4a77a01668 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eeeffa-84bc-4627-a5eb-a3a4b01b82bd None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eeeffa-84bc-4627-a5eb-a3a4b01b82bd None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eeeffa-84bc-4627-a5eb-a3a4b01b82bd None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eeeffa-84bc-4627-a5eb-a3a4b01b82bd None admin] PATH_INFO: `/v3/users` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91eeeffa-84bc-4627-a5eb-a3a4b01b82bd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91eeeffa-84bc-4627-a5eb-a3a4b01b82bd None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:52 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-91eeeffa-84bc-4627-a5eb-a3a4b01b82bd None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 13:01:52 l75lg1-v1 dstat.sh[49771]: 28-05 13:01:52| 9 1 86 3 0|5634M 1799M 278M 7913M| 15k 1114B| 0 2324k| 0 293 |7825 13k|1.16 1.17 1.07| 0 1.0 0| 0 0 | 0 2048M| 29 364 0 32 2 May 28 13:01:52 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1595/3217] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 13:01:52 2024] POST /identity/v3/users => generated 292 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 13:01:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675d4af5-19bc-41ea-912f-0f94b2fe87df None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675d4af5-19bc-41ea-912f-0f94b2fe87df None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd6daab-5e18-4d85-b8cf-9d5497400c1b None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd6daab-5e18-4d85-b8cf-9d5497400c1b None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd6daab-5e18-4d85-b8cf-9d5497400c1b None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd6daab-5e18-4d85-b8cf-9d5497400c1b None admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd6daab-5e18-4d85-b8cf-9d5497400c1b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd6daab-5e18-4d85-b8cf-9d5497400c1b None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:52 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1623/3218] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 13:01:52 2024] GET /identity/v3/roles => generated 1680 bytes in 17 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 13:01:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eeeffa-84bc-4627-a5eb-a3a4b01b82bd None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eeeffa-84bc-4627-a5eb-a3a4b01b82bd None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6759e8-4b27-4dc8-baef-bff9778a05b1 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6759e8-4b27-4dc8-baef-bff9778a05b1 None admin] REQUEST_METHOD: `PUT` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6759e8-4b27-4dc8-baef-bff9778a05b1 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6759e8-4b27-4dc8-baef-bff9778a05b1 None admin] PATH_INFO: `/v3/projects/bff0d77ff4df42cb942ff6e8fe5d9115/users/f72a7fdfdc5841c5a56e1602f6e4c8b4/roles/e7989893488f483baa107be56668c4f8` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6759e8-4b27-4dc8-baef-bff9778a05b1 None admin] RBAC: Authorizing `identity:create_grant(project_id=bff0d77ff4df42cb942ff6e8fe5d9115, user_id=f72a7fdfdc5841c5a56e1602f6e4c8b4, role_id=e7989893488f483baa107be56668c4f8)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6759e8-4b27-4dc8-baef-bff9778a05b1 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:52 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1596/3219] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 13:01:52 2024] PUT /identity/v3/projects/bff0d77ff4df42cb942ff6e8fe5d9115/users/f72a7fdfdc5841c5a56e1602f6e4c8b4/roles/e7989893488f483baa107be56668c4f8 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:01:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd6daab-5e18-4d85-b8cf-9d5497400c1b None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd6daab-5e18-4d85-b8cf-9d5497400c1b None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e80155-da0e-4c1e-8b1b-b528bdb8b652 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e80155-da0e-4c1e-8b1b-b528bdb8b652 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e80155-da0e-4c1e-8b1b-b528bdb8b652 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e80155-da0e-4c1e-8b1b-b528bdb8b652 None admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e80155-da0e-4c1e-8b1b-b528bdb8b652 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e80155-da0e-4c1e-8b1b-b528bdb8b652 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:52 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1624/3220] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 13:01:52 2024] GET /identity/v3/roles => generated 1680 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 13:01:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6759e8-4b27-4dc8-baef-bff9778a05b1 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6759e8-4b27-4dc8-baef-bff9778a05b1 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b5596b-e648-4aef-b0d4-622bfe93f4e3 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b5596b-e648-4aef-b0d4-622bfe93f4e3 None admin] REQUEST_METHOD: `PUT` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b5596b-e648-4aef-b0d4-622bfe93f4e3 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b5596b-e648-4aef-b0d4-622bfe93f4e3 None admin] PATH_INFO: `/v3/projects/bff0d77ff4df42cb942ff6e8fe5d9115/users/f72a7fdfdc5841c5a56e1602f6e4c8b4/roles/e7989893488f483baa107be56668c4f8` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b5596b-e648-4aef-b0d4-622bfe93f4e3 None admin] RBAC: Authorizing `identity:create_grant(project_id=bff0d77ff4df42cb942ff6e8fe5d9115, user_id=f72a7fdfdc5841c5a56e1602f6e4c8b4, role_id=e7989893488f483baa107be56668c4f8)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b5596b-e648-4aef-b0d4-622bfe93f4e3 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:52 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1597/3221] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 13:01:52 2024] PUT /identity/v3/projects/bff0d77ff4df42cb942ff6e8fe5d9115/users/f72a7fdfdc5841c5a56e1602f6e4c8b4/roles/e7989893488f483baa107be56668c4f8 => generated 0 bytes in 18 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:01:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08313b26-3856-4422-a5ed-57278c1143b1 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08313b26-3856-4422-a5ed-57278c1143b1 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08313b26-3856-4422-a5ed-57278c1143b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:52 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-08313b26-3856-4422-a5ed-57278c1143b1 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 13:01:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-08313b26-3856-4422-a5ed-57278c1143b1 None None] MFA Rules not processed for user `f72a7fdfdc5841c5a56e1602f6e4c8b4`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 13:01:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-08313b26-3856-4422-a5ed-57278c1143b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:01:52 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-4628cb72-2b87-44dd-b633-8a0333123fb7 tempest-ShareRulesTest-1530341375 None] <<< [PATCH] https://127.0.0.1:40443/api/viewpolicies/38/ May 28 13:01:52 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-4628cb72-2b87-44dd-b633-8a0333123fb7 tempest-ShareRulesTest-1530341375 None] Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=1, created='2024-05-28T12:59:53.824250Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='0fa84ccd-850f-48fa-a965-23e5abe31188', id=38, internal=False, is_s3_default_policy=False, name='f7e47502-a0f7-44de-953d-b7b5697ae0b2', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=['*'], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=[], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=[], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='MODIFYING', sync_time='2024-05-28T13:01:51.880022Z', tenant_id=1, tenant_name='default', title='f7e47502-a0f7-44de-953d-b7b5697ae0b2', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/38/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[]) May 28 13:01:52 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-4628cb72-2b87-44dd-b633-8a0333123fb7 tempest-ShareRulesTest-1530341375 None] --- [PATCH] https://127.0.0.1:40443/api/viewpolicies/38/: Done May 28 13:01:52 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-4628cb72-2b87-44dd-b633-8a0333123fb7 tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:01:52 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-4628cb72-2b87-44dd-b633-8a0333123fb7 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:01:52 l75lg1-v1 neutron-server[77623]: DEBUG neutron.db.agents_db [None req-fe40ce8c-640e-4db7-a17a-6e8888cce266 None None] Agent healthcheck: found 0 active agents {{(pid=77623) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:319}} May 28 13:01:52 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1625/3222] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 13:01:52 2024] POST /identity/v3/auth/tokens => generated 4063 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 13:01:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b5596b-e648-4aef-b0d4-622bfe93f4e3 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b5596b-e648-4aef-b0d4-622bfe93f4e3 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7876ef-1ed5-447b-88b1-2d64d4380fbd tempest-SharesRenameTest-200895555 tempest-SharesRenameTest-200895555-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72a7fdfdc5841c5a56e1602f6e4c8b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bff0d77ff4df42cb942ff6e8fe5d9115', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:52 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-4628cb72-2b87-44dd-b633-8a0333123fb7 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.034s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:01:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7876ef-1ed5-447b-88b1-2d64d4380fbd tempest-SharesRenameTest-200895555 tempest-SharesRenameTest-200895555-project-admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:52 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-4628cb72-2b87-44dd-b633-8a0333123fb7 tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:01:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7876ef-1ed5-447b-88b1-2d64d4380fbd tempest-SharesRenameTest-200895555 tempest-SharesRenameTest-200895555-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7876ef-1ed5-447b-88b1-2d64d4380fbd tempest-SharesRenameTest-200895555 tempest-SharesRenameTest-200895555-project-admin] PATH_INFO: `/v3/domains` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:52 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-4628cb72-2b87-44dd-b633-8a0333123fb7 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:01:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7876ef-1ed5-447b-88b1-2d64d4380fbd tempest-SharesRenameTest-200895555 tempest-SharesRenameTest-200895555-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 13:01:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7876ef-1ed5-447b-88b1-2d64d4380fbd tempest-SharesRenameTest-200895555 tempest-SharesRenameTest-200895555-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7876ef-1ed5-447b-88b1-2d64d4380fbd tempest-SharesRenameTest-200895555 tempest-SharesRenameTest-200895555-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:52 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1598/3223] 10.27.203.238 () {62 vars in 1241 bytes} [Tue May 28 13:01:52 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 13:01:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08313b26-3856-4422-a5ed-57278c1143b1 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08313b26-3856-4422-a5ed-57278c1143b1 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b926b2d-99a4-4603-9d1b-97298452167a tempest-SharesRenameTest-200895555 tempest-SharesRenameTest-200895555-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72a7fdfdc5841c5a56e1602f6e4c8b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bff0d77ff4df42cb942ff6e8fe5d9115', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b926b2d-99a4-4603-9d1b-97298452167a tempest-SharesRenameTest-200895555 tempest-SharesRenameTest-200895555-project-admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b926b2d-99a4-4603-9d1b-97298452167a tempest-SharesRenameTest-200895555 tempest-SharesRenameTest-200895555-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b926b2d-99a4-4603-9d1b-97298452167a tempest-SharesRenameTest-200895555 tempest-SharesRenameTest-200895555-project-admin] PATH_INFO: `/v3/users` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b926b2d-99a4-4603-9d1b-97298452167a tempest-SharesRenameTest-200895555 tempest-SharesRenameTest-200895555-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b926b2d-99a4-4603-9d1b-97298452167a tempest-SharesRenameTest-200895555 tempest-SharesRenameTest-200895555-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:52 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-3b926b2d-99a4-4603-9d1b-97298452167a tempest-SharesRenameTest-200895555 tempest-SharesRenameTest-200895555-project-admin] Truncating password to algorithm specific maximum length 72 characters. May 28 13:01:52 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-4628cb72-2b87-44dd-b633-8a0333123fb7 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.027s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:01:52 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-4628cb72-2b87-44dd-b633-8a0333123fb7 tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:01:52 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-4628cb72-2b87-44dd-b633-8a0333123fb7 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:01:52 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-4628cb72-2b87-44dd-b633-8a0333123fb7 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:01:52 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-4628cb72-2b87-44dd-b633-8a0333123fb7 tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:01:52 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-4628cb72-2b87-44dd-b633-8a0333123fb7 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:01:52 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-4628cb72-2b87-44dd-b633-8a0333123fb7 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:01:52 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-4628cb72-2b87-44dd-b633-8a0333123fb7 tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:01:52 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-4628cb72-2b87-44dd-b633-8a0333123fb7 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:01:52 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1626/3224] 10.27.203.238 () {64 vars in 1232 bytes} [Tue May 28 13:01:52 2024] POST /identity/v3/users => generated 433 bytes in 31 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 13:01:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7876ef-1ed5-447b-88b1-2d64d4380fbd tempest-SharesRenameTest-200895555 tempest-SharesRenameTest-200895555-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7876ef-1ed5-447b-88b1-2d64d4380fbd tempest-SharesRenameTest-200895555 tempest-SharesRenameTest-200895555-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9483beda-3e4f-40fc-8bb5-4dd26ba78e52 tempest-SharesRenameTest-200895555 tempest-SharesRenameTest-200895555-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72a7fdfdc5841c5a56e1602f6e4c8b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bff0d77ff4df42cb942ff6e8fe5d9115', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9483beda-3e4f-40fc-8bb5-4dd26ba78e52 tempest-SharesRenameTest-200895555 tempest-SharesRenameTest-200895555-project-admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9483beda-3e4f-40fc-8bb5-4dd26ba78e52 tempest-SharesRenameTest-200895555 tempest-SharesRenameTest-200895555-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9483beda-3e4f-40fc-8bb5-4dd26ba78e52 tempest-SharesRenameTest-200895555 tempest-SharesRenameTest-200895555-project-admin] PATH_INFO: `/v3/roles` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9483beda-3e4f-40fc-8bb5-4dd26ba78e52 tempest-SharesRenameTest-200895555 tempest-SharesRenameTest-200895555-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9483beda-3e4f-40fc-8bb5-4dd26ba78e52 tempest-SharesRenameTest-200895555 tempest-SharesRenameTest-200895555-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:52 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1599/3225] 10.27.203.238 () {62 vars in 1210 bytes} [Tue May 28 13:01:52 2024] GET /identity/v3/roles => generated 1680 bytes in 16 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 13:01:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b926b2d-99a4-4603-9d1b-97298452167a tempest-SharesRenameTest-200895555 tempest-SharesRenameTest-200895555-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b926b2d-99a4-4603-9d1b-97298452167a tempest-SharesRenameTest-200895555 tempest-SharesRenameTest-200895555-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e5a9f2-c6cc-44ee-a300-0445d92bfac0 tempest-SharesRenameTest-200895555 tempest-SharesRenameTest-200895555-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72a7fdfdc5841c5a56e1602f6e4c8b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bff0d77ff4df42cb942ff6e8fe5d9115', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e5a9f2-c6cc-44ee-a300-0445d92bfac0 tempest-SharesRenameTest-200895555 tempest-SharesRenameTest-200895555-project-admin] REQUEST_METHOD: `PUT` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e5a9f2-c6cc-44ee-a300-0445d92bfac0 tempest-SharesRenameTest-200895555 tempest-SharesRenameTest-200895555-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e5a9f2-c6cc-44ee-a300-0445d92bfac0 tempest-SharesRenameTest-200895555 tempest-SharesRenameTest-200895555-project-admin] PATH_INFO: `/v3/projects/bff0d77ff4df42cb942ff6e8fe5d9115/users/56ab342d938748f096b808a9b567c8a6/roles/44620cad10ae407c90c91e2c296adb04` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:52 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-4628cb72-2b87-44dd-b633-8a0333123fb7 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.040s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:01:52 l75lg1-v1 manila-share[98474]: INFO manila.share.access [None req-4628cb72-2b87-44dd-b633-8a0333123fb7 tempest-ShareRulesTest-1530341375 None] Access rules were successfully modified for share instance f7e47502-a0f7-44de-953d-b7b5697ae0b2 belonging to share b330db31-7766-443d-9c19-26fe349665aa. May 28 13:01:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e5a9f2-c6cc-44ee-a300-0445d92bfac0 tempest-SharesRenameTest-200895555 tempest-SharesRenameTest-200895555-project-admin] RBAC: Authorizing `identity:create_grant(project_id=bff0d77ff4df42cb942ff6e8fe5d9115, user_id=56ab342d938748f096b808a9b567c8a6, role_id=44620cad10ae407c90c91e2c296adb04)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e5a9f2-c6cc-44ee-a300-0445d92bfac0 tempest-SharesRenameTest-200895555 tempest-SharesRenameTest-200895555-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:52 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 13:01:52 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.manager [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=83654) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10545}} May 28 13:01:52 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1627/3226] 10.27.203.238 () {64 vars in 1571 bytes} [Tue May 28 13:01:52 2024] PUT /identity/v3/projects/bff0d77ff4df42cb942ff6e8fe5d9115/users/56ab342d938748f096b808a9b567c8a6/roles/44620cad10ae407c90c91e2c296adb04 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:01:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9483beda-3e4f-40fc-8bb5-4dd26ba78e52 tempest-SharesRenameTest-200895555 tempest-SharesRenameTest-200895555-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-9483beda-3e4f-40fc-8bb5-4dd26ba78e52 tempest-SharesRenameTest-200895555 tempest-SharesRenameTest-200895555-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:01:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9483beda-3e4f-40fc-8bb5-4dd26ba78e52 tempest-SharesRenameTest-200895555 tempest-SharesRenameTest-200895555-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a216d4-8c43-48a7-bc88-aa36447700cc service manila] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f110cf6300f049c897d0aab63218d1e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a216d4-8c43-48a7-bc88-aa36447700cc service manila] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a216d4-8c43-48a7-bc88-aa36447700cc service manila] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a216d4-8c43-48a7-bc88-aa36447700cc service manila] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a216d4-8c43-48a7-bc88-aa36447700cc service manila] RBAC: Authorizing `identity:validate_token()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:52 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a216d4-8c43-48a7-bc88-aa36447700cc service manila] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:52 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1600/3227] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 13:01:52 2024] GET /identity/v3/auth/tokens => generated 4063 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 13:01:52 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-6a004749-a287-4c7c-bfa0-c7657565bc21 tempest-SharesRenameTest-200895555 tempest-SharesRenameTest-200895555-project-admin] POST http://10.27.203.238/share/v2/bff0d77ff4df42cb942ff6e8fe5d9115/types May 28 13:01:52 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-6a004749-a287-4c7c-bfa0-c7657565bc21 tempest-SharesRenameTest-200895555 tempest-SharesRenameTest-200895555-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share_type": {"name": "tempest-typeshare-type-1768920283", "extra_specs": {"driver_handles_share_servers": "False", "snapshot_support": true}, "share_type_access:is_public": true}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:01:52 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-6a004749-a287-4c7c-bfa0-c7657565bc21 tempest-SharesRenameTest-200895555 tempest-SharesRenameTest-200895555-project-admin] http://10.27.203.238/share/v2/bff0d77ff4df42cb942ff6e8fe5d9115/types returned with HTTP 200 May 28 13:01:52 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1152/2333] 10.27.203.238 () {66 vars in 1359 bytes} [Tue May 28 13:01:52 2024] POST /share/v2/bff0d77ff4df42cb942ff6e8fe5d9115/types => generated 679 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:01:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e5a9f2-c6cc-44ee-a300-0445d92bfac0 tempest-SharesRenameTest-200895555 tempest-SharesRenameTest-200895555-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-c1e5a9f2-c6cc-44ee-a300-0445d92bfac0 tempest-SharesRenameTest-200895555 tempest-SharesRenameTest-200895555-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:01:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e5a9f2-c6cc-44ee-a300-0445d92bfac0 tempest-SharesRenameTest-200895555 tempest-SharesRenameTest-200895555-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba1a4bc-5157-4d06-a204-53cee158216e service manila] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f110cf6300f049c897d0aab63218d1e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba1a4bc-5157-4d06-a204-53cee158216e service manila] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba1a4bc-5157-4d06-a204-53cee158216e service manila] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba1a4bc-5157-4d06-a204-53cee158216e service manila] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba1a4bc-5157-4d06-a204-53cee158216e service manila] RBAC: Authorizing `identity:validate_token()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:52 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba1a4bc-5157-4d06-a204-53cee158216e service manila] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:52 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1628/3228] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 13:01:52 2024] GET /identity/v3/auth/tokens => generated 3942 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 13:01:52 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-8e1a599e-ac98-4b75-93fa-f5951a42c9b3 tempest-SharesRenameTest-1796622866 tempest-SharesRenameTest-1796622866-project-member] POST http://10.27.203.238/share/v2/6035b1be773e417b80fb3d9ea83eac8d/shares May 28 13:01:52 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-8e1a599e-ac98-4b75-93fa-f5951a42c9b3 tempest-SharesRenameTest-1796622866 tempest-SharesRenameTest-1796622866-project-member] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share": {"share_proto": "nfs", "description": "tempest-tempest-share-description-1024583039", "snapshot_id": null, "name": "tempest-tempest-share-name-742731061", "size": 1, "metadata": {}, "is_public": false, "share_type": "edb9ffb1-50f8-46f1-9bf4-c99b86d46e3e"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:01:52 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.v1.shares [None req-8e1a599e-ac98-4b75-93fa-f5951a42c9b3 tempest-SharesRenameTest-1796622866 tempest-SharesRenameTest-1796622866-project-member] Create NFS share of 1 GB May 28 13:01:52 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.quota [None req-8e1a599e-ac98-4b75-93fa-f5951a42c9b3 tempest-SharesRenameTest-1796622866 tempest-SharesRenameTest-1796622866-project-member] Created reservations ['6cd4e5c8-33f4-48a6-8d36-439affa312a5', '3a8795a1-c1db-466a-a70c-b93a9a78e73a', '389a8254-c224-488c-a19b-a7adc7f06ce8', '5f448dc7-218c-48be-9408-1fe96954d15e'] {{(pid=98329) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 13:01:52 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.quota [None req-8e1a599e-ac98-4b75-93fa-f5951a42c9b3 tempest-SharesRenameTest-1796622866 tempest-SharesRenameTest-1796622866-project-member] Committed reservations ['6cd4e5c8-33f4-48a6-8d36-439affa312a5', '3a8795a1-c1db-466a-a70c-b93a9a78e73a', '389a8254-c224-488c-a19b-a7adc7f06ce8', '5f448dc7-218c-48be-9408-1fe96954d15e'] {{(pid=98329) commit /opt/stack/manila/manila/quota.py:1063}} May 28 13:01:52 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-9843956c-c147-4381-a76c-15ab61a2fa0c tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] GET http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/share-access-rules?share_id=b330db31-7766-443d-9c19-26fe349665aa May 28 13:01:52 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-9843956c-c147-4381-a76c-15ab61a2fa0c tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:52 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-9843956c-c147-4381-a76c-15ab61a2fa0c tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:52 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-9843956c-c147-4381-a76c-15ab61a2fa0c tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/share-access-rules?share_id=b330db31-7766-443d-9c19-26fe349665aa returned with HTTP 200 May 28 13:01:52 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1153/2334] 10.27.203.238 () {64 vars in 1467 bytes} [Tue May 28 13:01:52 2024] GET /share/v2/a4f3887fa28c457390f5b66615564430/share-access-rules?share_id=b330db31-7766-443d-9c19-26fe349665aa => generated 19 bytes in 28 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:01:52 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-7a2a9c44-bed0-4d97-965e-13951f891c94 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] POST http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/shares/b330db31-7766-443d-9c19-26fe349665aa/action May 28 13:01:52 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-7a2a9c44-bed0-4d97-965e-13951f891c94 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Action body: b'{"allow_access": {"access_type": "ip", "access_to": "203.0.113.77", "access_level": "rw", "lock_visibility": true, "lock_deletion": true}}' {{(pid=98330) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 13:01:52 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-7a2a9c44-bed0-4d97-965e-13951f891c94 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Action: 'action', calling method: ShareController.allow_access, body: {"allow_access": {"access_type": "ip", "access_to": "203.0.113.77", "access_level": "rw", "lock_visibility": true, "lock_deletion": true}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:01:52 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.host_manager [None req-8e1a599e-ac98-4b75-93fa-f5951a42c9b3 tempest-SharesRenameTest-1796622866 None] Share service is down. (host: l75lg1-v1@generic2). May 28 13:01:52 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.host_manager [None req-8e1a599e-ac98-4b75-93fa-f5951a42c9b3 tempest-SharesRenameTest-1796622866 None] Share service is down. (host: l75lg1-v1@generic1). May 28 13:01:52 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-8e1a599e-ac98-4b75-93fa-f5951a42c9b3 tempest-SharesRenameTest-1796622866 None] Starting with 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:80}} May 28 13:01:52 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-8e1a599e-ac98-4b75-93fa-f5951a42c9b3 tempest-SharesRenameTest-1796622866 None] Filter OnlyHostFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:01:52 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-8e1a599e-ac98-4b75-93fa-f5951a42c9b3 tempest-SharesRenameTest-1796622866 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:01:52 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.capacity [None req-8e1a599e-ac98-4b75-93fa-f5951a42c9b3 tempest-SharesRenameTest-1796622866 None] Space information for share creation on host l75lg1-v1@vast#vast (requested / avail): 1/2082 {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/capacity.py:83}} May 28 13:01:52 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-8e1a599e-ac98-4b75-93fa-f5951a42c9b3 tempest-SharesRenameTest-1796622866 None] Filter CapacityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:01:52 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-8e1a599e-ac98-4b75-93fa-f5951a42c9b3 tempest-SharesRenameTest-1796622866 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:01:52 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-8e1a599e-ac98-4b75-93fa-f5951a42c9b3 tempest-SharesRenameTest-1796622866 None] Driver Filter: Checking host 'l75lg1-v1@vast#vast' {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:37}} May 28 13:01:52 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-8e1a599e-ac98-4b75-93fa-f5951a42c9b3 tempest-SharesRenameTest-1796622866 None] Filter function not set :: passing host. {{(pid=98327) _check_filter_function /opt/stack/manila/manila/scheduler/filters/driver.py:53}} May 28 13:01:53 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-8e1a599e-ac98-4b75-93fa-f5951a42c9b3 tempest-SharesRenameTest-1796622866 None] Result: True {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:40}} May 28 13:01:53 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-8e1a599e-ac98-4b75-93fa-f5951a42c9b3 tempest-SharesRenameTest-1796622866 None] Done checking host 'l75lg1-v1@vast#vast' {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:41}} May 28 13:01:53 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-8e1a599e-ac98-4b75-93fa-f5951a42c9b3 tempest-SharesRenameTest-1796622866 None] Filter DriverFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:01:53 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-8e1a599e-ac98-4b75-93fa-f5951a42c9b3 tempest-SharesRenameTest-1796622866 None] Filter ShareReplicationFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:01:53 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-8e1a599e-ac98-4b75-93fa-f5951a42c9b3 tempest-SharesRenameTest-1796622866 None] Filter CreateFromSnapshotFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:01:53 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-8e1a599e-ac98-4b75-93fa-f5951a42c9b3 tempest-SharesRenameTest-1796622866 None] Filter AffinityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:01:53 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-8e1a599e-ac98-4b75-93fa-f5951a42c9b3 tempest-SharesRenameTest-1796622866 None] Filter AntiAffinityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:01:53 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.drivers.filter [None req-8e1a599e-ac98-4b75-93fa-f5951a42c9b3 tempest-SharesRenameTest-1796622866 None] Filtered share [host: 'l75lg1-v1@vast#vast', free_capacity_gb: 2082.605696829967, pools: None] {{(pid=98327) _schedule_share /opt/stack/manila/manila/scheduler/drivers/filter.py:268}} May 28 13:01:53 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-8e1a599e-ac98-4b75-93fa-f5951a42c9b3 tempest-SharesRenameTest-1796622866 None] Checking host 'l75lg1-v1@vast#vast' {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:46}} May 28 13:01:53 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.weighers.goodness [None req-8e1a599e-ac98-4b75-93fa-f5951a42c9b3 tempest-SharesRenameTest-1796622866 None] Goodness function not set :: defaulting to minimal goodness rating of 0. May 28 13:01:53 l75lg1-v1 manila-scheduler[98327]: INFO manila.scheduler.weighers.goodness [None req-8e1a599e-ac98-4b75-93fa-f5951a42c9b3 tempest-SharesRenameTest-1796622866 None] Goodness function result for host l75lg1-v1@vast#vast: 0. May 28 13:01:53 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-8e1a599e-ac98-4b75-93fa-f5951a42c9b3 tempest-SharesRenameTest-1796622866 None] Goodness: 0 {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:48}} May 28 13:01:53 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-8e1a599e-ac98-4b75-93fa-f5951a42c9b3 tempest-SharesRenameTest-1796622866 None] Done checking host 'l75lg1-v1@vast#vast' {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:49}} May 28 13:01:53 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.drivers.filter [None req-8e1a599e-ac98-4b75-93fa-f5951a42c9b3 tempest-SharesRenameTest-1796622866 None] Choosing for share: WeighedHost [host: l75lg1-v1@vast#vast, weight: 0.0] {{(pid=98327) _schedule_share /opt/stack/manila/manila/scheduler/drivers/filter.py:274}} May 28 13:01:53 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-8e1a599e-ac98-4b75-93fa-f5951a42c9b3 tempest-SharesRenameTest-1796622866 tempest-SharesRenameTest-1796622866-project-member] http://10.27.203.238/share/v2/6035b1be773e417b80fb3d9ea83eac8d/shares returned with HTTP 200 May 28 13:01:53 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1182/2335] 10.27.203.238 () {66 vars in 1362 bytes} [Tue May 28 13:01:52 2024] POST /share/v2/6035b1be773e417b80fb3d9ea83eac8d/shares => generated 1338 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:01:53 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-90925d8d-18c0-44e1-a64c-80e083d679b1 tempest-SharesRenameTest-1796622866 tempest-SharesRenameTest-1796622866-project-member] GET http://10.27.203.238/share/v2/6035b1be773e417b80fb3d9ea83eac8d/shares/e02829cb-d0c9-478e-80fa-e4ec0bf3843c May 28 13:01:53 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-90925d8d-18c0-44e1-a64c-80e083d679b1 tempest-SharesRenameTest-1796622866 tempest-SharesRenameTest-1796622866-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:53 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-90925d8d-18c0-44e1-a64c-80e083d679b1 tempest-SharesRenameTest-1796622866 tempest-SharesRenameTest-1796622866-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:53 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-90925d8d-18c0-44e1-a64c-80e083d679b1 tempest-SharesRenameTest-1796622866 tempest-SharesRenameTest-1796622866-project-member] http://10.27.203.238/share/v2/6035b1be773e417b80fb3d9ea83eac8d/shares/e02829cb-d0c9-478e-80fa-e4ec0bf3843c returned with HTTP 200 May 28 13:01:53 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1183/2336] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:01:53 2024] GET /share/v2/6035b1be773e417b80fb3d9ea83eac8d/shares/e02829cb-d0c9-478e-80fa-e4ec0bf3843c => generated 1338 bytes in 25 msecs (HTTP/1.1 200) 6 headers in 232 bytes (2 switches on core 0) May 28 13:01:53 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-7a2a9c44-bed0-4d97-965e-13951f891c94 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:01:53 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-7a2a9c44-bed0-4d97-965e-13951f891c94 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:01:53 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-7a2a9c44-bed0-4d97-965e-13951f891c94 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.040s {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:01:53 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8e1a599e-ac98-4b75-93fa-f5951a42c9b3 tempest-SharesRenameTest-1796622866 None] >>> [GET] https://127.0.0.1:40443/api/vippools/ May 28 13:01:53 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8e1a599e-ac98-4b75-93fa-f5951a42c9b3 tempest-SharesRenameTest-1796622866 None] {'allow_redirects': True, 'params': {'name': 'vippool-1'}} May 28 13:01:53 l75lg1-v1 manila-share[98474]: DEBUG manila.share.manager [None req-7a2a9c44-bed0-4d97-965e-13951f891c94 tempest-ShareRulesTest-1530341375 None] Received request to update access for share instance f7e47502-a0f7-44de-953d-b7b5697ae0b2. {{(pid=98474) update_access_for_instances /opt/stack/manila/manila/share/manager.py:4353}} May 28 13:01:53 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-7a2a9c44-bed0-4d97-965e-13951f891c94 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/shares/b330db31-7766-443d-9c19-26fe349665aa/action returned with HTTP 200 May 28 13:01:53 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1154/2337] 10.27.203.238 () {66 vars in 1494 bytes} [Tue May 28 13:01:52 2024] POST /share/v2/a4f3887fa28c457390f5b66615564430/shares/b330db31-7766-443d-9c19-26fe349665aa/action => generated 310 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 231 bytes (2 switches on core 0) May 28 13:01:53 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-cae3d6ad-101c-4741-b946-11f925a79e3f tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] GET http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/share-access-rules?share_id=b330db31-7766-443d-9c19-26fe349665aa May 28 13:01:53 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-cae3d6ad-101c-4741-b946-11f925a79e3f tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:53 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-cae3d6ad-101c-4741-b946-11f925a79e3f tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:53 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-7a2a9c44-bed0-4d97-965e-13951f891c94 tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:01:53 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-7a2a9c44-bed0-4d97-965e-13951f891c94 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:01:53 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-7a2a9c44-bed0-4d97-965e-13951f891c94 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:01:53 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-7a2a9c44-bed0-4d97-965e-13951f891c94 tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:01:53 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-7a2a9c44-bed0-4d97-965e-13951f891c94 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:01:53 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.lock.api [None req-cae3d6ad-101c-4741-b946-11f925a79e3f tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Searching for locks by: {'resource_id': 'cc327232-e1ea-4c2c-b7c7-a8aabe39c6b3', 'resource_action': 'show', 'resource_type': 'access_rule'} {{(pid=98329) get_all /opt/stack/manila/manila/lock/api.py:112}} May 28 13:01:53 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-cae3d6ad-101c-4741-b946-11f925a79e3f tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/share-access-rules?share_id=b330db31-7766-443d-9c19-26fe349665aa returned with HTTP 200 May 28 13:01:53 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1184/2338] 10.27.203.238 () {64 vars in 1467 bytes} [Tue May 28 13:01:53 2024] GET /share/v2/a4f3887fa28c457390f5b66615564430/share-access-rules?share_id=b330db31-7766-443d-9c19-26fe349665aa => generated 265 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:01:53 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-7a2a9c44-bed0-4d97-965e-13951f891c94 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.053s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:01:53 l75lg1-v1 manila-share[98474]: DEBUG manila.share.access [None req-7a2a9c44-bed0-4d97-965e-13951f891c94 tempest-ShareRulesTest-1530341375 None] Updating access rules for share instance f7e47502-a0f7-44de-953d-b7b5697ae0b2 belonging to share b330db31-7766-443d-9c19-26fe349665aa. {{(pid=98474) update_access_rules /opt/stack/manila/manila/share/access.py:298}} May 28 13:01:53 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-7a2a9c44-bed0-4d97-965e-13951f891c94 tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:01:53 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-7a2a9c44-bed0-4d97-965e-13951f891c94 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:01:53 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-7a2a9c44-bed0-4d97-965e-13951f891c94 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.007s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:01:53 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-7a2a9c44-bed0-4d97-965e-13951f891c94 tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:01:53 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-7a2a9c44-bed0-4d97-965e-13951f891c94 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:01:53 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-7a2a9c44-bed0-4d97-965e-13951f891c94 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.013s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:01:53 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-7a2a9c44-bed0-4d97-965e-13951f891c94 tempest-ShareRulesTest-1530341375 None] changing access on None May 28 13:01:53 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-7a2a9c44-bed0-4d97-965e-13951f891c94 tempest-ShareRulesTest-1530341375 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:01:53 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-7a2a9c44-bed0-4d97-965e-13951f891c94 tempest-ShareRulesTest-1530341375 None] {'allow_redirects': True, May 28 13:01:53 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-7a2a9c44-bed0-4d97-965e-13951f891c94 tempest-ShareRulesTest-1530341375 None] 'params': {'name': 'f7e47502-a0f7-44de-953d-b7b5697ae0b2'}} May 28 13:01:53 l75lg1-v1 dstat.sh[49771]: 28-05 13:01:53| 13 1 81 4 0|5635M 1797M 278M 7914M| 16k 3615B| 0 2968k| 0 394 |8131 14k|1.16 1.17 1.07|2.0 1.0 0| 0 0 | 0 2048M| 29 363 0 32 2 May 28 13:01:53 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-7a2a9c44-bed0-4d97-965e-13951f891c94 tempest-ShareRulesTest-1530341375 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:01:53 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-7a2a9c44-bed0-4d97-965e-13951f891c94 tempest-ShareRulesTest-1530341375 None] [Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=1, created='2024-05-28T12:59:53.824250Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='0fa84ccd-850f-48fa-a965-23e5abe31188', id=38, internal=False, is_s3_default_policy=False, name='f7e47502-a0f7-44de-953d-b7b5697ae0b2', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=['*'], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=[], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=[], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T13:01:52.321714Z', tenant_id=1, tenant_name='default', title='f7e47502-a0f7-44de-953d-b7b5697ae0b2', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/38/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[])] May 28 13:01:53 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-7a2a9c44-bed0-4d97-965e-13951f891c94 tempest-ShareRulesTest-1530341375 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 13:01:53 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-7a2a9c44-bed0-4d97-965e-13951f891c94 tempest-ShareRulesTest-1530341375 None] changing access on /manila/manila-f7e47502-a0f7-44de-953d-b7b5697ae0b2. Rules: {'nfs_read_write': ['203.0.113.77'], 'nfs_read_only': []} May 28 13:01:53 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-7a2a9c44-bed0-4d97-965e-13951f891c94 tempest-ShareRulesTest-1530341375 None] >>> [PATCH] https://127.0.0.1:40443/api/viewpolicies/38/ May 28 13:01:53 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-7a2a9c44-bed0-4d97-965e-13951f891c94 tempest-ShareRulesTest-1530341375 None] {'data': '{"name": "f7e47502-a0f7-44de-953d-b7b5697ae0b2", "nfs_no_squash": ' May 28 13:01:53 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-7a2a9c44-bed0-4d97-965e-13951f891c94 tempest-ShareRulesTest-1530341375 None] '["*"], "nfs_root_squash": ["*"], "nfs_read_write": ["203.0.113.77"], ' May 28 13:01:53 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-7a2a9c44-bed0-4d97-965e-13951f891c94 tempest-ShareRulesTest-1530341375 None] '"nfs_read_only": []}', May 28 13:01:53 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-7a2a9c44-bed0-4d97-965e-13951f891c94 tempest-ShareRulesTest-1530341375 None] 'params': None} May 28 13:01:53 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 13:01:53 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 13:01:53 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8e1a599e-ac98-4b75-93fa-f5951a42c9b3 tempest-SharesRenameTest-1796622866 None] <<< [GET] https://127.0.0.1:40443/api/vippools/ May 28 13:01:53 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8e1a599e-ac98-4b75-93fa-f5951a42c9b3 tempest-SharesRenameTest-1796622866 None] [Bunch(active_cnode_ids=[], active_interfaces=4, cluster='loop75-kfs', cluster_id=1, cnode_ids=[], cnodes=[], domain_name='vippool-1', enable_l3=False, enable_weighted_balancing=False, enabled=True, end_ip='172.21.75.4', guid='f2abaede-b397-413a-8faa-3aeead6d3b28', gw_ip='', gw_ipv6='', id=2, ip_ranges=[['172.21.75.1', '172.21.75.4']], name='vippool-1', peer_asn=0, port_membership='ALL', ranges_summary='172.21.75.[1-4]', role='PROTOCOLS', start_ip='172.21.75.1', subnet_cidr=16, subnet_cidr_ipv6=None, sync='SYNCED', sync_time='2024-05-28T12:50:09.644123Z', tenant_id=1, tenant_name='default', title='172.21.75.1 - 172.21.75.4', url='https://127.0.0.1:40443/api/vippools/2/', vast_asn=0, vlan=0, vms_preferred=False)] May 28 13:01:53 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8e1a599e-ac98-4b75-93fa-f5951a42c9b3 tempest-SharesRenameTest-1796622866 None] --- [GET] https://127.0.0.1:40443/api/vippools/: Done May 28 13:01:53 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8e1a599e-ac98-4b75-93fa-f5951a42c9b3 tempest-SharesRenameTest-1796622866 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:01:53 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8e1a599e-ac98-4b75-93fa-f5951a42c9b3 tempest-SharesRenameTest-1796622866 None] {'allow_redirects': True, May 28 13:01:53 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8e1a599e-ac98-4b75-93fa-f5951a42c9b3 tempest-SharesRenameTest-1796622866 None] 'params': {'name': '37860c08-1995-417c-b284-dd741fb36e15'}} May 28 13:01:53 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-21d485fc-6edd-43f7-b475-852d15bdb669 tempest-ShareTransferTest-320553121 None] <<< [DELETE] https://127.0.0.1:40443/api/views/53/ May 28 13:01:53 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-21d485fc-6edd-43f7-b475-852d15bdb669 tempest-ShareTransferTest-320553121 None] --- [DELETE] https://127.0.0.1:40443/api/views/53/: Done May 28 13:01:53 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-21d485fc-6edd-43f7-b475-852d15bdb669 tempest-ShareTransferTest-320553121 None] >>> [GET] https://127.0.0.1:40443/api/quotas/ May 28 13:01:53 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-21d485fc-6edd-43f7-b475-852d15bdb669 tempest-ShareTransferTest-320553121 None] {'allow_redirects': True, May 28 13:01:53 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-21d485fc-6edd-43f7-b475-852d15bdb669 tempest-ShareTransferTest-320553121 None] 'params': {'name': 'c9f751bd-bfa5-491d-9739-47b922a557d3'}} May 28 13:01:53 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-9243b13b-2c2d-4f26-8fcd-d7db7a301d83 tempest-ShareTransferTest-320553121 tempest-ShareTransferTest-320553121-project-member] GET http://10.27.203.238/share/v2/bece16f41fc44d55bf7bc45c2adaaed5/shares/de6cdc3c-7cf5-437f-acad-57530196bb54 May 28 13:01:53 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-9243b13b-2c2d-4f26-8fcd-d7db7a301d83 tempest-ShareTransferTest-320553121 tempest-ShareTransferTest-320553121-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:53 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-9243b13b-2c2d-4f26-8fcd-d7db7a301d83 tempest-ShareTransferTest-320553121 tempest-ShareTransferTest-320553121-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:53 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-9243b13b-2c2d-4f26-8fcd-d7db7a301d83 tempest-ShareTransferTest-320553121 tempest-ShareTransferTest-320553121-project-member] http://10.27.203.238/share/v2/bece16f41fc44d55bf7bc45c2adaaed5/shares/de6cdc3c-7cf5-437f-acad-57530196bb54 returned with HTTP 200 May 28 13:01:53 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1155/2339] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:01:53 2024] GET /share/v2/bece16f41fc44d55bf7bc45c2adaaed5/shares/de6cdc3c-7cf5-437f-acad-57530196bb54 => generated 1315 bytes in 26 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:01:53 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8e1a599e-ac98-4b75-93fa-f5951a42c9b3 tempest-SharesRenameTest-1796622866 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:01:53 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8e1a599e-ac98-4b75-93fa-f5951a42c9b3 tempest-SharesRenameTest-1796622866 None] [] May 28 13:01:53 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8e1a599e-ac98-4b75-93fa-f5951a42c9b3 tempest-SharesRenameTest-1796622866 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 13:01:53 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8e1a599e-ac98-4b75-93fa-f5951a42c9b3 tempest-SharesRenameTest-1796622866 None] >>> [POST] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:01:53 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8e1a599e-ac98-4b75-93fa-f5951a42c9b3 tempest-SharesRenameTest-1796622866 None] {'data': '{"name": "37860c08-1995-417c-b284-dd741fb36e15"}', May 28 13:01:53 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8e1a599e-ac98-4b75-93fa-f5951a42c9b3 tempest-SharesRenameTest-1796622866 None] 'json': None, May 28 13:01:53 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8e1a599e-ac98-4b75-93fa-f5951a42c9b3 tempest-SharesRenameTest-1796622866 None] 'params': None} May 28 13:01:54 l75lg1-v1 dstat.sh[49771]: 28-05 13:01:54| 1 0 94 4 0|5635M 1797M 278M 7914M| 19k 3836B| 0 6669k| 0 482 |3409 5225 |1.16 1.17 1.07|1.0 1.0 0| 0 0 | 0 2048M| 29 363 0 32 2 May 28 13:01:54 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-21d485fc-6edd-43f7-b475-852d15bdb669 tempest-ShareTransferTest-320553121 None] <<< [GET] https://127.0.0.1:40443/api/quotas/ May 28 13:01:54 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-21d485fc-6edd-43f7-b475-852d15bdb669 tempest-ShareTransferTest-320553121 None] [Bunch(cluster='loop75-kfs', cluster_id=1, default_email=None, default_group_quota=None, default_user_quota=None, enable_alarms=True, enable_email_providers=True, grace_period=None, guid='014f5473-dec7-497f-9faf-ca80e43f5202', hard_limit=1073741824, hard_limit_inodes=None, id=51, internal=False, is_user_quota=False, last_user_quotas_update=None, name='c9f751bd-bfa5-491d-9739-47b922a557d3', num_blocked_users=0, num_exceeded_users=0, path='/manila/manila-c9f751bd-bfa5-491d-9739-47b922a557d3', percent_capacity=0, percent_inodes=None, pretty_grace_period=None, pretty_grace_period_expiration=None, pretty_state='OK (CREATED)', soft_limit=None, soft_limit_inodes=None, state='OK', sync_state='CREATED', system_id=51, tenant_id=1, tenant_name='default', time_to_block=None, title='c9f751bd-bfa5-491d-9739-47b922a557d3', url='https://127.0.0.1:40443/api/quotas/51/', used_capacity=0, used_capacity_tb=0.0, used_effective_capacity=0, used_effective_capacity_tb=0.0, used_inodes=0, used_limited_capacity=0)] May 28 13:01:54 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-21d485fc-6edd-43f7-b475-852d15bdb669 tempest-ShareTransferTest-320553121 None] --- [GET] https://127.0.0.1:40443/api/quotas/: Done May 28 13:01:54 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-21d485fc-6edd-43f7-b475-852d15bdb669 tempest-ShareTransferTest-320553121 None] >>> [DELETE] https://127.0.0.1:40443/api/quotas/51/ May 28 13:01:54 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8e1a599e-ac98-4b75-93fa-f5951a42c9b3 tempest-SharesRenameTest-1796622866 None] <<< [POST] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:01:54 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8e1a599e-ac98-4b75-93fa-f5951a42c9b3 tempest-SharesRenameTest-1796622866 None] Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=0, created='2024-05-28T13:01:54.553833Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='072fe17e-3b08-4d54-9857-08077f2b6bed', id=55, internal=False, is_s3_default_policy=False, name='37860c08-1995-417c-b284-dd741fb36e15', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=[], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['*'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['*'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T13:01:54.864801Z', tenant_id=1, tenant_name='default', title='37860c08-1995-417c-b284-dd741fb36e15', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/55/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[]) May 28 13:01:54 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8e1a599e-ac98-4b75-93fa-f5951a42c9b3 tempest-SharesRenameTest-1796622866 None] --- [POST] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 13:01:54 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8e1a599e-ac98-4b75-93fa-f5951a42c9b3 tempest-SharesRenameTest-1796622866 None] >>> [GET] https://127.0.0.1:40443/api/quotas/ May 28 13:01:54 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8e1a599e-ac98-4b75-93fa-f5951a42c9b3 tempest-SharesRenameTest-1796622866 None] {'allow_redirects': True, May 28 13:01:54 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8e1a599e-ac98-4b75-93fa-f5951a42c9b3 tempest-SharesRenameTest-1796622866 None] 'params': {'name': '37860c08-1995-417c-b284-dd741fb36e15'}} May 28 13:01:55 l75lg1-v1 dstat.sh[49771]: 28-05 13:01:55| 1 0 98 0 0|5635M 1797M 278M 7914M| 18k 1390B| 0 900k| 0 34.0 |1759 2858 |1.16 1.17 1.07|1.0 1.0 0| 0 0 | 0 2048M| 29 363 0 32 2 May 28 13:01:55 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8e1a599e-ac98-4b75-93fa-f5951a42c9b3 tempest-SharesRenameTest-1796622866 None] <<< [GET] https://127.0.0.1:40443/api/quotas/ May 28 13:01:55 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8e1a599e-ac98-4b75-93fa-f5951a42c9b3 tempest-SharesRenameTest-1796622866 None] [] May 28 13:01:55 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8e1a599e-ac98-4b75-93fa-f5951a42c9b3 tempest-SharesRenameTest-1796622866 None] --- [GET] https://127.0.0.1:40443/api/quotas/: Done May 28 13:01:55 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8e1a599e-ac98-4b75-93fa-f5951a42c9b3 tempest-SharesRenameTest-1796622866 None] >>> [POST] https://127.0.0.1:40443/api/quotas/ May 28 13:01:55 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8e1a599e-ac98-4b75-93fa-f5951a42c9b3 tempest-SharesRenameTest-1796622866 None] {'data': '{"name": "37860c08-1995-417c-b284-dd741fb36e15", "path": ' May 28 13:01:55 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8e1a599e-ac98-4b75-93fa-f5951a42c9b3 tempest-SharesRenameTest-1796622866 None] '"/manila/manila-37860c08-1995-417c-b284-dd741fb36e15", "create_dir": ' May 28 13:01:55 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8e1a599e-ac98-4b75-93fa-f5951a42c9b3 tempest-SharesRenameTest-1796622866 None] 'true, "hard_limit": 1073741824}', May 28 13:01:55 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8e1a599e-ac98-4b75-93fa-f5951a42c9b3 tempest-SharesRenameTest-1796622866 None] 'json': None, May 28 13:01:55 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8e1a599e-ac98-4b75-93fa-f5951a42c9b3 tempest-SharesRenameTest-1796622866 None] 'params': None} May 28 13:01:55 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-7a2a9c44-bed0-4d97-965e-13951f891c94 tempest-ShareRulesTest-1530341375 None] <<< [PATCH] https://127.0.0.1:40443/api/viewpolicies/38/ May 28 13:01:55 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-7a2a9c44-bed0-4d97-965e-13951f891c94 tempest-ShareRulesTest-1530341375 None] Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=1, created='2024-05-28T12:59:53.824250Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='0fa84ccd-850f-48fa-a965-23e5abe31188', id=38, internal=False, is_s3_default_policy=False, name='f7e47502-a0f7-44de-953d-b7b5697ae0b2', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=['*'], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['203.0.113.77'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['203.0.113.77'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='MODIFYING', sync_time='2024-05-28T13:01:54.736706Z', tenant_id=1, tenant_name='default', title='f7e47502-a0f7-44de-953d-b7b5697ae0b2', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/38/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[]) May 28 13:01:55 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-7a2a9c44-bed0-4d97-965e-13951f891c94 tempest-ShareRulesTest-1530341375 None] --- [PATCH] https://127.0.0.1:40443/api/viewpolicies/38/: Done May 28 13:01:55 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-7a2a9c44-bed0-4d97-965e-13951f891c94 tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:01:55 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-7a2a9c44-bed0-4d97-965e-13951f891c94 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:01:55 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 13:01:55 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-7a2a9c44-bed0-4d97-965e-13951f891c94 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.097s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:01:55 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-7a2a9c44-bed0-4d97-965e-13951f891c94 tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:01:55 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-7a2a9c44-bed0-4d97-965e-13951f891c94 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:01:55 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-7a2a9c44-bed0-4d97-965e-13951f891c94 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:01:55 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-7a2a9c44-bed0-4d97-965e-13951f891c94 tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:01:55 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-7a2a9c44-bed0-4d97-965e-13951f891c94 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:01:55 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-7a2a9c44-bed0-4d97-965e-13951f891c94 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:01:55 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-7a2a9c44-bed0-4d97-965e-13951f891c94 tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:01:55 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-7a2a9c44-bed0-4d97-965e-13951f891c94 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:01:55 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-7a2a9c44-bed0-4d97-965e-13951f891c94 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:01:55 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-7a2a9c44-bed0-4d97-965e-13951f891c94 tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:01:55 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-7a2a9c44-bed0-4d97-965e-13951f891c94 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:01:55 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-7a2a9c44-bed0-4d97-965e-13951f891c94 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.041s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:01:55 l75lg1-v1 manila-share[98474]: INFO manila.share.access [None req-7a2a9c44-bed0-4d97-965e-13951f891c94 tempest-ShareRulesTest-1530341375 None] Access rules were successfully modified for share instance f7e47502-a0f7-44de-953d-b7b5697ae0b2 belonging to share b330db31-7766-443d-9c19-26fe349665aa. May 28 13:01:56 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-6645c3f9-b73c-47a3-b8af-d0f49257c173 tempest-SharesRenameTest-1796622866 tempest-SharesRenameTest-1796622866-project-member] GET http://10.27.203.238/share/v2/6035b1be773e417b80fb3d9ea83eac8d/shares/e02829cb-d0c9-478e-80fa-e4ec0bf3843c May 28 13:01:56 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-6645c3f9-b73c-47a3-b8af-d0f49257c173 tempest-SharesRenameTest-1796622866 tempest-SharesRenameTest-1796622866-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:56 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-6645c3f9-b73c-47a3-b8af-d0f49257c173 tempest-SharesRenameTest-1796622866 tempest-SharesRenameTest-1796622866-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:56 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-6645c3f9-b73c-47a3-b8af-d0f49257c173 tempest-SharesRenameTest-1796622866 tempest-SharesRenameTest-1796622866-project-member] http://10.27.203.238/share/v2/6035b1be773e417b80fb3d9ea83eac8d/shares/e02829cb-d0c9-478e-80fa-e4ec0bf3843c returned with HTTP 200 May 28 13:01:56 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1185/2340] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:01:56 2024] GET /share/v2/6035b1be773e417b80fb3d9ea83eac8d/shares/e02829cb-d0c9-478e-80fa-e4ec0bf3843c => generated 1340 bytes in 26 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:01:56 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8e1a599e-ac98-4b75-93fa-f5951a42c9b3 tempest-SharesRenameTest-1796622866 None] <<< [POST] https://127.0.0.1:40443/api/quotas/ May 28 13:01:56 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8e1a599e-ac98-4b75-93fa-f5951a42c9b3 tempest-SharesRenameTest-1796622866 None] Bunch(cluster='loop75-kfs', cluster_id=1, default_email=None, default_group_quota=None, default_user_quota=None, enable_alarms=True, enable_email_providers=True, grace_period=None, group_quotas=[], guid='6301b751-d818-4414-9a1a-29ca5918ca3f', hard_limit=1073741824, hard_limit_inodes=None, id=52, internal=False, is_user_quota=False, last_user_quotas_update=None, name='37860c08-1995-417c-b284-dd741fb36e15', num_blocked_users=0, num_exceeded_users=0, path='/manila/manila-37860c08-1995-417c-b284-dd741fb36e15', percent_capacity=0, percent_inodes=None, pretty_grace_period=None, pretty_grace_period_expiration=None, pretty_state='OK (CREATED)', soft_limit=None, soft_limit_inodes=None, state='OK', sync_state='CREATED', system_id=52, tenant_id=1, tenant_name='default', time_to_block=None, title='37860c08-1995-417c-b284-dd741fb36e15', url='https://127.0.0.1:40443/api/quotas/52/', used_capacity=0, used_capacity_tb=0.0, used_effective_capacity=0, used_effective_capacity_tb=0.0, used_inodes=0, used_limited_capacity=0, user_quotas=[]) May 28 13:01:56 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8e1a599e-ac98-4b75-93fa-f5951a42c9b3 tempest-SharesRenameTest-1796622866 None] --- [POST] https://127.0.0.1:40443/api/quotas/: Done May 28 13:01:56 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8e1a599e-ac98-4b75-93fa-f5951a42c9b3 tempest-SharesRenameTest-1796622866 None] >>> [GET] https://127.0.0.1:40443/api/views/ May 28 13:01:56 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8e1a599e-ac98-4b75-93fa-f5951a42c9b3 tempest-SharesRenameTest-1796622866 None] {'allow_redirects': True, May 28 13:01:56 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8e1a599e-ac98-4b75-93fa-f5951a42c9b3 tempest-SharesRenameTest-1796622866 None] 'params': {'name': '37860c08-1995-417c-b284-dd741fb36e15'}} May 28 13:01:56 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-31aca090-5f9c-43ef-b94d-7fb0fca1b2e8 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] GET http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/share-access-rules?share_id=b330db31-7766-443d-9c19-26fe349665aa May 28 13:01:56 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-31aca090-5f9c-43ef-b94d-7fb0fca1b2e8 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:56 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-31aca090-5f9c-43ef-b94d-7fb0fca1b2e8 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:56 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.lock.api [None req-31aca090-5f9c-43ef-b94d-7fb0fca1b2e8 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Searching for locks by: {'resource_id': 'cc327232-e1ea-4c2c-b7c7-a8aabe39c6b3', 'resource_action': 'show', 'resource_type': 'access_rule'} {{(pid=98330) get_all /opt/stack/manila/manila/lock/api.py:112}} May 28 13:01:56 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-31aca090-5f9c-43ef-b94d-7fb0fca1b2e8 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/share-access-rules?share_id=b330db31-7766-443d-9c19-26fe349665aa returned with HTTP 200 May 28 13:01:56 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1156/2341] 10.27.203.238 () {64 vars in 1467 bytes} [Tue May 28 13:01:56 2024] GET /share/v2/a4f3887fa28c457390f5b66615564430/share-access-rules?share_id=b330db31-7766-443d-9c19-26fe349665aa => generated 280 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:01:56 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-be1e7ac9-71ab-41f4-ae27-4a821b8ed66d tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] GET http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/share-access-rules?share_id=b330db31-7766-443d-9c19-26fe349665aa May 28 13:01:56 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-be1e7ac9-71ab-41f4-ae27-4a821b8ed66d tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:56 l75lg1-v1 dstat.sh[49771]: 28-05 13:01:56| 3 1 96 1 0|5636M 1797M 278M 7914M| 19k 1734B| 0 6961k| 0 743 |2693 4255 |1.16 1.17 1.07|2.0 1.0 0| 0 0 | 0 2048M| 29 364 0 32 2 May 28 13:01:56 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-be1e7ac9-71ab-41f4-ae27-4a821b8ed66d tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:56 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.lock.api [None req-be1e7ac9-71ab-41f4-ae27-4a821b8ed66d tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Searching for locks by: {'resource_id': 'cc327232-e1ea-4c2c-b7c7-a8aabe39c6b3', 'resource_action': 'show', 'resource_type': 'access_rule'} {{(pid=98329) get_all /opt/stack/manila/manila/lock/api.py:112}} May 28 13:01:56 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-be1e7ac9-71ab-41f4-ae27-4a821b8ed66d tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/share-access-rules?share_id=b330db31-7766-443d-9c19-26fe349665aa returned with HTTP 200 May 28 13:01:56 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1186/2342] 10.27.203.238 () {64 vars in 1467 bytes} [Tue May 28 13:01:56 2024] GET /share/v2/a4f3887fa28c457390f5b66615564430/share-access-rules?share_id=b330db31-7766-443d-9c19-26fe349665aa => generated 280 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:01:56 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3a7268-b7d5-44f9-92e3-f74bb9e38790 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:56 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3a7268-b7d5-44f9-92e3-f74bb9e38790 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:56 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3a7268-b7d5-44f9-92e3-f74bb9e38790 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:56 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-9e3a7268-b7d5-44f9-92e3-f74bb9e38790 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 13:01:56 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-9e3a7268-b7d5-44f9-92e3-f74bb9e38790 None None] MFA Rules not processed for user `cdf8594f55cb448e9b2312d051486331`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 13:01:56 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-9e3a7268-b7d5-44f9-92e3-f74bb9e38790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:01:56 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1601/3229] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 13:01:56 2024] POST /identity/v3/auth/tokens => generated 3947 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 13:01:56 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba1a4bc-5157-4d06-a204-53cee158216e service manila] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:01:56 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba1a4bc-5157-4d06-a204-53cee158216e service manila] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:01:56 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d012b4be-88bf-4b9e-ba12-3b6fd4a7440a service manila] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f110cf6300f049c897d0aab63218d1e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:01:56 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d012b4be-88bf-4b9e-ba12-3b6fd4a7440a service manila] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:01:56 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d012b4be-88bf-4b9e-ba12-3b6fd4a7440a service manila] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:01:56 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d012b4be-88bf-4b9e-ba12-3b6fd4a7440a service manila] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:01:56 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d012b4be-88bf-4b9e-ba12-3b6fd4a7440a service manila] RBAC: Authorizing `identity:validate_token()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:01:56 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d012b4be-88bf-4b9e-ba12-3b6fd4a7440a service manila] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:01:56 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1629/3230] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 13:01:56 2024] GET /identity/v3/auth/tokens => generated 3947 bytes in 17 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 13:01:56 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-e1a6aeb5-81c4-4085-b494-606d015a9691 tempest-ShareRulesTest-1530341375 tempest-manila_a4f3887fa28c457390f5b66615564430-579326759] GET http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/share-access-rules?share_id=b330db31-7766-443d-9c19-26fe349665aa May 28 13:01:56 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-e1a6aeb5-81c4-4085-b494-606d015a9691 tempest-ShareRulesTest-1530341375 tempest-manila_a4f3887fa28c457390f5b66615564430-579326759] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:56 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-e1a6aeb5-81c4-4085-b494-606d015a9691 tempest-ShareRulesTest-1530341375 tempest-manila_a4f3887fa28c457390f5b66615564430-579326759] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:56 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.lock.api [None req-e1a6aeb5-81c4-4085-b494-606d015a9691 tempest-ShareRulesTest-1530341375 tempest-manila_a4f3887fa28c457390f5b66615564430-579326759] Searching for locks by: {'resource_id': 'cc327232-e1ea-4c2c-b7c7-a8aabe39c6b3', 'resource_action': 'show', 'resource_type': 'access_rule'} {{(pid=98330) get_all /opt/stack/manila/manila/lock/api.py:112}} May 28 13:01:56 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.policy [None req-e1a6aeb5-81c4-4085-b494-606d015a9691 tempest-ShareRulesTest-1530341375 tempest-manila_a4f3887fa28c457390f5b66615564430-579326759] Policy check for resource_lock:bypass_locked_show_action failed with credentials {'is_admin': False, 'user_id': 'cdf8594f55cb448e9b2312d051486331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4f3887fa28c457390f5b66615564430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98330) authorize /opt/stack/manila/manila/policy.py:208}} May 28 13:01:56 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-e1a6aeb5-81c4-4085-b494-606d015a9691 tempest-ShareRulesTest-1530341375 tempest-manila_a4f3887fa28c457390f5b66615564430-579326759] http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/share-access-rules?share_id=b330db31-7766-443d-9c19-26fe349665aa returned with HTTP 200 May 28 13:01:56 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1157/2343] 10.27.203.238 () {64 vars in 1467 bytes} [Tue May 28 13:01:56 2024] GET /share/v2/a4f3887fa28c457390f5b66615564430/share-access-rules?share_id=b330db31-7766-443d-9c19-26fe349665aa => generated 278 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:01:56 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-c0d3d390-48ff-472e-99a2-b2c9be61c2e6 tempest-ShareRulesTest-1530341375 tempest-manila_a4f3887fa28c457390f5b66615564430-579326759] GET http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/share-access-rules?share_id=b330db31-7766-443d-9c19-26fe349665aa May 28 13:01:56 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-c0d3d390-48ff-472e-99a2-b2c9be61c2e6 tempest-ShareRulesTest-1530341375 tempest-manila_a4f3887fa28c457390f5b66615564430-579326759] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:56 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-c0d3d390-48ff-472e-99a2-b2c9be61c2e6 tempest-ShareRulesTest-1530341375 tempest-manila_a4f3887fa28c457390f5b66615564430-579326759] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:56 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.lock.api [None req-c0d3d390-48ff-472e-99a2-b2c9be61c2e6 tempest-ShareRulesTest-1530341375 tempest-manila_a4f3887fa28c457390f5b66615564430-579326759] Searching for locks by: {'resource_id': 'cc327232-e1ea-4c2c-b7c7-a8aabe39c6b3', 'resource_action': 'show', 'resource_type': 'access_rule'} {{(pid=98329) get_all /opt/stack/manila/manila/lock/api.py:112}} May 28 13:01:56 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.policy [None req-c0d3d390-48ff-472e-99a2-b2c9be61c2e6 tempest-ShareRulesTest-1530341375 tempest-manila_a4f3887fa28c457390f5b66615564430-579326759] Policy check for resource_lock:bypass_locked_show_action failed with credentials {'is_admin': False, 'user_id': 'cdf8594f55cb448e9b2312d051486331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4f3887fa28c457390f5b66615564430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98329) authorize /opt/stack/manila/manila/policy.py:208}} May 28 13:01:56 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-c0d3d390-48ff-472e-99a2-b2c9be61c2e6 tempest-ShareRulesTest-1530341375 tempest-manila_a4f3887fa28c457390f5b66615564430-579326759] http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/share-access-rules?share_id=b330db31-7766-443d-9c19-26fe349665aa returned with HTTP 200 May 28 13:01:56 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1187/2344] 10.27.203.238 () {64 vars in 1467 bytes} [Tue May 28 13:01:56 2024] GET /share/v2/a4f3887fa28c457390f5b66615564430/share-access-rules?share_id=b330db31-7766-443d-9c19-26fe349665aa => generated 278 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:01:56 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-c92f4bf9-d3f9-4f37-9488-42078804d911 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] POST http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/shares/b330db31-7766-443d-9c19-26fe349665aa/action May 28 13:01:56 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-c92f4bf9-d3f9-4f37-9488-42078804d911 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Action body: b'{"deny_access": {"access_id": "cc327232-e1ea-4c2c-b7c7-a8aabe39c6b3", "unrestrict": true}}' {{(pid=98330) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 13:01:56 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-c92f4bf9-d3f9-4f37-9488-42078804d911 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Action: 'action', calling method: ShareController.deny_access, body: {"deny_access": {"access_id": "cc327232-e1ea-4c2c-b7c7-a8aabe39c6b3", "unrestrict": true}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:01:56 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.lock.api [None req-c92f4bf9-d3f9-4f37-9488-42078804d911 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Searching for locks by: {'resource_id': 'cc327232-e1ea-4c2c-b7c7-a8aabe39c6b3', 'resource_action': 'delete'} {{(pid=98330) get_all /opt/stack/manila/manila/lock/api.py:112}} May 28 13:01:56 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-c92f4bf9-d3f9-4f37-9488-42078804d911 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:01:56 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-c92f4bf9-d3f9-4f37-9488-42078804d911 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:01:56 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 13:01:56 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.manager [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Starting heal instance info cache {{(pid=83654) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}} May 28 13:01:56 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.manager [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Rebuilding the list of instances to heal {{(pid=83654) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9930}} May 28 13:01:56 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Expecting reply to msg ff3e6641f0b1429685b367cea0e9e44e in queue reply_37f4cbd1dd094961a22b8a65f222c327 May 28 13:01:56 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [-] Received RPC response for msg ff3e6641f0b1429685b367cea0e9e44e May 28 13:01:56 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-c92f4bf9-d3f9-4f37-9488-42078804d911 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.040s {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:01:56 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-c92f4bf9-d3f9-4f37-9488-42078804d911 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:01:56 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-c92f4bf9-d3f9-4f37-9488-42078804d911 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:01:56 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-c92f4bf9-d3f9-4f37-9488-42078804d911 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.070s {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:01:56 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-c92f4bf9-d3f9-4f37-9488-42078804d911 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/shares/b330db31-7766-443d-9c19-26fe349665aa/action returned with HTTP 202 May 28 13:01:56 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1158/2345] 10.27.203.238 () {66 vars in 1493 bytes} [Tue May 28 13:01:56 2024] POST /share/v2/a4f3887fa28c457390f5b66615564430/shares/b330db31-7766-443d-9c19-26fe349665aa/action => generated 0 bytes in 187 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 13:01:56 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-ec32155c-8432-4f00-98f9-3cdd2c65f6b7 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] GET http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/share-access-rules?share_id=b330db31-7766-443d-9c19-26fe349665aa May 28 13:01:56 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-ec32155c-8432-4f00-98f9-3cdd2c65f6b7 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:56 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-ec32155c-8432-4f00-98f9-3cdd2c65f6b7 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:56 l75lg1-v1 manila-share[98474]: DEBUG manila.share.manager [None req-c92f4bf9-d3f9-4f37-9488-42078804d911 tempest-ShareRulesTest-1530341375 None] Received request to update access for share instance f7e47502-a0f7-44de-953d-b7b5697ae0b2. {{(pid=98474) update_access_for_instances /opt/stack/manila/manila/share/manager.py:4353}} May 28 13:01:56 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c92f4bf9-d3f9-4f37-9488-42078804d911 tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:01:56 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c92f4bf9-d3f9-4f37-9488-42078804d911 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:01:56 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.lock.api [None req-ec32155c-8432-4f00-98f9-3cdd2c65f6b7 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Searching for locks by: {'resource_id': 'cc327232-e1ea-4c2c-b7c7-a8aabe39c6b3', 'resource_action': 'show', 'resource_type': 'access_rule'} {{(pid=98329) get_all /opt/stack/manila/manila/lock/api.py:112}} May 28 13:01:56 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c92f4bf9-d3f9-4f37-9488-42078804d911 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:01:56 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c92f4bf9-d3f9-4f37-9488-42078804d911 tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:01:56 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c92f4bf9-d3f9-4f37-9488-42078804d911 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:01:56 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-ec32155c-8432-4f00-98f9-3cdd2c65f6b7 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/share-access-rules?share_id=b330db31-7766-443d-9c19-26fe349665aa returned with HTTP 200 May 28 13:01:56 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1188/2346] 10.27.203.238 () {64 vars in 1467 bytes} [Tue May 28 13:01:56 2024] GET /share/v2/a4f3887fa28c457390f5b66615564430/share-access-rules?share_id=b330db31-7766-443d-9c19-26fe349665aa => generated 288 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 231 bytes (2 switches on core 0) May 28 13:01:56 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c92f4bf9-d3f9-4f37-9488-42078804d911 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.056s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:01:56 l75lg1-v1 manila-share[98474]: DEBUG manila.share.access [None req-c92f4bf9-d3f9-4f37-9488-42078804d911 tempest-ShareRulesTest-1530341375 None] Updating access rules for share instance f7e47502-a0f7-44de-953d-b7b5697ae0b2 belonging to share b330db31-7766-443d-9c19-26fe349665aa. {{(pid=98474) update_access_rules /opt/stack/manila/manila/share/access.py:298}} May 28 13:01:56 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8e1a599e-ac98-4b75-93fa-f5951a42c9b3 tempest-SharesRenameTest-1796622866 None] <<< [GET] https://127.0.0.1:40443/api/views/ May 28 13:01:56 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8e1a599e-ac98-4b75-93fa-f5951a42c9b3 tempest-SharesRenameTest-1796622866 None] [] May 28 13:01:56 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8e1a599e-ac98-4b75-93fa-f5951a42c9b3 tempest-SharesRenameTest-1796622866 None] --- [GET] https://127.0.0.1:40443/api/views/: Done May 28 13:01:56 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8e1a599e-ac98-4b75-93fa-f5951a42c9b3 tempest-SharesRenameTest-1796622866 None] >>> [POST] https://127.0.0.1:40443/api/views/ May 28 13:01:56 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8e1a599e-ac98-4b75-93fa-f5951a42c9b3 tempest-SharesRenameTest-1796622866 None] {'data': '{"name": "37860c08-1995-417c-b284-dd741fb36e15", "path": ' May 28 13:01:56 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8e1a599e-ac98-4b75-93fa-f5951a42c9b3 tempest-SharesRenameTest-1796622866 None] '"/manila/manila-37860c08-1995-417c-b284-dd741fb36e15", "policy_id": ' May 28 13:01:56 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8e1a599e-ac98-4b75-93fa-f5951a42c9b3 tempest-SharesRenameTest-1796622866 None] '55, "create_dir": true, "protocols": ["NFS"]}', May 28 13:01:56 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8e1a599e-ac98-4b75-93fa-f5951a42c9b3 tempest-SharesRenameTest-1796622866 None] 'json': None, May 28 13:01:56 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8e1a599e-ac98-4b75-93fa-f5951a42c9b3 tempest-SharesRenameTest-1796622866 None] 'params': None} May 28 13:01:56 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c92f4bf9-d3f9-4f37-9488-42078804d911 tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:01:56 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c92f4bf9-d3f9-4f37-9488-42078804d911 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:01:56 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c92f4bf9-d3f9-4f37-9488-42078804d911 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.007s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:01:56 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c92f4bf9-d3f9-4f37-9488-42078804d911 tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:01:56 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c92f4bf9-d3f9-4f37-9488-42078804d911 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:01:56 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c92f4bf9-d3f9-4f37-9488-42078804d911 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.014s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:01:56 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-c92f4bf9-d3f9-4f37-9488-42078804d911 tempest-ShareRulesTest-1530341375 None] changing access on None May 28 13:01:56 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c92f4bf9-d3f9-4f37-9488-42078804d911 tempest-ShareRulesTest-1530341375 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:01:56 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c92f4bf9-d3f9-4f37-9488-42078804d911 tempest-ShareRulesTest-1530341375 None] {'allow_redirects': True, May 28 13:01:56 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c92f4bf9-d3f9-4f37-9488-42078804d911 tempest-ShareRulesTest-1530341375 None] 'params': {'name': 'f7e47502-a0f7-44de-953d-b7b5697ae0b2'}} May 28 13:01:56 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-43aa0336-1839-4b02-89fc-03db6d39f9c7 tempest-ShareTransferTest-320553121 tempest-ShareTransferTest-320553121-project-member] GET http://10.27.203.238/share/v2/bece16f41fc44d55bf7bc45c2adaaed5/shares/de6cdc3c-7cf5-437f-acad-57530196bb54 May 28 13:01:56 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-43aa0336-1839-4b02-89fc-03db6d39f9c7 tempest-ShareTransferTest-320553121 tempest-ShareTransferTest-320553121-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:56 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-43aa0336-1839-4b02-89fc-03db6d39f9c7 tempest-ShareTransferTest-320553121 tempest-ShareTransferTest-320553121-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:56 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-43aa0336-1839-4b02-89fc-03db6d39f9c7 tempest-ShareTransferTest-320553121 tempest-ShareTransferTest-320553121-project-member] http://10.27.203.238/share/v2/bece16f41fc44d55bf7bc45c2adaaed5/shares/de6cdc3c-7cf5-437f-acad-57530196bb54 returned with HTTP 200 May 28 13:01:56 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1159/2347] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:01:56 2024] GET /share/v2/bece16f41fc44d55bf7bc45c2adaaed5/shares/de6cdc3c-7cf5-437f-acad-57530196bb54 => generated 1315 bytes in 23 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:01:57 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.manager [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Didn't find any instances for network info cache update. {{(pid=83654) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10012}} May 28 13:01:57 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c92f4bf9-d3f9-4f37-9488-42078804d911 tempest-ShareRulesTest-1530341375 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:01:57 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c92f4bf9-d3f9-4f37-9488-42078804d911 tempest-ShareRulesTest-1530341375 None] [Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=1, created='2024-05-28T12:59:53.824250Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='0fa84ccd-850f-48fa-a965-23e5abe31188', id=38, internal=False, is_s3_default_policy=False, name='f7e47502-a0f7-44de-953d-b7b5697ae0b2', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=['*'], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['203.0.113.77'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['203.0.113.77'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T13:01:55.403209Z', tenant_id=1, tenant_name='default', title='f7e47502-a0f7-44de-953d-b7b5697ae0b2', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/38/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[])] May 28 13:01:57 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c92f4bf9-d3f9-4f37-9488-42078804d911 tempest-ShareRulesTest-1530341375 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 13:01:57 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-c92f4bf9-d3f9-4f37-9488-42078804d911 tempest-ShareRulesTest-1530341375 None] changing access on /manila/manila-f7e47502-a0f7-44de-953d-b7b5697ae0b2. Rules: {'nfs_read_write': [], 'nfs_read_only': []} May 28 13:01:57 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c92f4bf9-d3f9-4f37-9488-42078804d911 tempest-ShareRulesTest-1530341375 None] >>> [PATCH] https://127.0.0.1:40443/api/viewpolicies/38/ May 28 13:01:57 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c92f4bf9-d3f9-4f37-9488-42078804d911 tempest-ShareRulesTest-1530341375 None] {'data': '{"name": "f7e47502-a0f7-44de-953d-b7b5697ae0b2", "nfs_no_squash": ' May 28 13:01:57 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c92f4bf9-d3f9-4f37-9488-42078804d911 tempest-ShareRulesTest-1530341375 None] '["*"], "nfs_root_squash": ["*"], "nfs_read_write": [], ' May 28 13:01:57 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c92f4bf9-d3f9-4f37-9488-42078804d911 tempest-ShareRulesTest-1530341375 None] '"nfs_read_only": []}', May 28 13:01:57 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c92f4bf9-d3f9-4f37-9488-42078804d911 tempest-ShareRulesTest-1530341375 None] 'params': None} May 28 13:01:57 l75lg1-v1 dstat.sh[49771]: 28-05 13:01:57| 7 1 90 1 0|5636M 1797M 278M 7914M| 14k 2599B| 0 1315k| 0 116 |4275 6778 |1.06 1.15 1.06|2.0 1.0 0| 0 0 | 0 2048M| 29 363 0 32 2 May 28 13:01:57 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8e1a599e-ac98-4b75-93fa-f5951a42c9b3 tempest-SharesRenameTest-1796622866 None] <<< [POST] https://127.0.0.1:40443/api/views/ May 28 13:01:57 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8e1a599e-ac98-4b75-93fa-f5951a42c9b3 tempest-SharesRenameTest-1796622866 None] Bunch(abac_tags=[], abe_max_depth=None, abe_protocols=[], alias='', allow_anonymous_access=False, allow_s3_anonymous_access=False, auto_commit='0d', bucket='', bucket_creators=[], bucket_creators_groups=[], bucket_owner=None, bulk_permission_update_progress=None, bulk_permission_update_state=None, cluster='loop75-kfs', cluster_id=1, created='2024-05-28T13:01:57.186515Z', enabled=True, files_retention_mode='NONE', guid='dab3afba-f6b8-4a4f-8585-9b00590a415e', id=54, ignore_oos=False, internal=False, is_remote=False, is_seamless=False, logical_capacity=0, max_retention_period=None, min_retention_period=None, name='37860c08-1995-417c-b284-dd741fb36e15', nfs_interop_flags='BOTH_NFS3_AND_NFS4_INTEROP_DISABLED', path='/manila/manila-37860c08-1995-417c-b284-dd741fb36e15', physical_capacity=0, policy='37860c08-1995-417c-b284-dd741fb36e15', policy_id=55, protocols=['NFS'], qos_policy=None, qos_policy_id=None, s3_locks=False, s3_locks_retention_mode='NONE', s3_locks_retention_period='', s3_object_ownership_rule='ObjectWriter', s3_unverified_lookup=False, s3_versioning=False, select_for_live_monitoring=False, share='', share_acl=Bunch(acl=[], enabled=False), sync='SYNCED', sync_time='2024-05-28T13:01:57.455290Z', tenant_id=1, tenant_name='default', title='/manila/manila-37860c08-1995-417c-b284-dd741fb36e15', url='https://127.0.0.1:40443/api/views/54/') May 28 13:01:57 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8e1a599e-ac98-4b75-93fa-f5951a42c9b3 tempest-SharesRenameTest-1796622866 None] --- [POST] https://127.0.0.1:40443/api/views/: Done May 28 13:01:57 l75lg1-v1 manila-share[98474]: INFO manila.share.manager [None req-8e1a599e-ac98-4b75-93fa-f5951a42c9b3 tempest-SharesRenameTest-1796622866 None] Share instance 37860c08-1995-417c-b284-dd741fb36e15 created successfully. May 28 13:01:57 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-21d485fc-6edd-43f7-b475-852d15bdb669 tempest-ShareTransferTest-320553121 None] <<< [DELETE] https://127.0.0.1:40443/api/quotas/51/ May 28 13:01:57 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-21d485fc-6edd-43f7-b475-852d15bdb669 tempest-ShareTransferTest-320553121 None] --- [DELETE] https://127.0.0.1:40443/api/quotas/51/: Done May 28 13:01:57 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-21d485fc-6edd-43f7-b475-852d15bdb669 tempest-ShareTransferTest-320553121 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:01:57 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-21d485fc-6edd-43f7-b475-852d15bdb669 tempest-ShareTransferTest-320553121 None] {'allow_redirects': True, May 28 13:01:57 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-21d485fc-6edd-43f7-b475-852d15bdb669 tempest-ShareTransferTest-320553121 None] 'params': {'name': 'c9f751bd-bfa5-491d-9739-47b922a557d3'}} May 28 13:01:58 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-21d485fc-6edd-43f7-b475-852d15bdb669 tempest-ShareTransferTest-320553121 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:01:58 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-21d485fc-6edd-43f7-b475-852d15bdb669 tempest-ShareTransferTest-320553121 None] [Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=0, created='2024-05-28T13:01:45.776774Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='dbddafd3-0cdb-44d5-95ff-a4e14557ab42', id=54, internal=False, is_s3_default_policy=False, name='c9f751bd-bfa5-491d-9739-47b922a557d3', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=[], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['*'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['*'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T13:01:46.207521Z', tenant_id=1, tenant_name='default', title='c9f751bd-bfa5-491d-9739-47b922a557d3', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/54/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[])] May 28 13:01:58 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-21d485fc-6edd-43f7-b475-852d15bdb669 tempest-ShareTransferTest-320553121 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 13:01:58 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-21d485fc-6edd-43f7-b475-852d15bdb669 tempest-ShareTransferTest-320553121 None] >>> [DELETE] https://127.0.0.1:40443/api/viewpolicies/54/ May 28 13:01:58 l75lg1-v1 dstat.sh[49771]: 28-05 13:01:58| 1 0 98 0 0|5636M 1796M 278M 7914M| 14k 1629B| 0 472k| 0 55.0 |2030 3418 |1.06 1.15 1.06| 0 1.0 2.0| 0 0 | 0 2048M| 29 363 0 32 2 May 28 13:01:58 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c92f4bf9-d3f9-4f37-9488-42078804d911 tempest-ShareRulesTest-1530341375 None] <<< [PATCH] https://127.0.0.1:40443/api/viewpolicies/38/ May 28 13:01:58 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c92f4bf9-d3f9-4f37-9488-42078804d911 tempest-ShareRulesTest-1530341375 None] Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=1, created='2024-05-28T12:59:53.824250Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='0fa84ccd-850f-48fa-a965-23e5abe31188', id=38, internal=False, is_s3_default_policy=False, name='f7e47502-a0f7-44de-953d-b7b5697ae0b2', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=['*'], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=[], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=[], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='MODIFYING', sync_time='2024-05-28T13:01:58.284343Z', tenant_id=1, tenant_name='default', title='f7e47502-a0f7-44de-953d-b7b5697ae0b2', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/38/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[]) May 28 13:01:58 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c92f4bf9-d3f9-4f37-9488-42078804d911 tempest-ShareRulesTest-1530341375 None] --- [PATCH] https://127.0.0.1:40443/api/viewpolicies/38/: Done May 28 13:01:58 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c92f4bf9-d3f9-4f37-9488-42078804d911 tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:01:58 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c92f4bf9-d3f9-4f37-9488-42078804d911 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:01:58 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c92f4bf9-d3f9-4f37-9488-42078804d911 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.030s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:01:58 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c92f4bf9-d3f9-4f37-9488-42078804d911 tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:01:58 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c92f4bf9-d3f9-4f37-9488-42078804d911 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:01:58 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c92f4bf9-d3f9-4f37-9488-42078804d911 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.028s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:01:58 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c92f4bf9-d3f9-4f37-9488-42078804d911 tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:01:58 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c92f4bf9-d3f9-4f37-9488-42078804d911 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:01:58 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c92f4bf9-d3f9-4f37-9488-42078804d911 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:01:58 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c92f4bf9-d3f9-4f37-9488-42078804d911 tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:01:58 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c92f4bf9-d3f9-4f37-9488-42078804d911 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:01:58 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c92f4bf9-d3f9-4f37-9488-42078804d911 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:01:58 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c92f4bf9-d3f9-4f37-9488-42078804d911 tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:01:58 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c92f4bf9-d3f9-4f37-9488-42078804d911 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:01:58 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c92f4bf9-d3f9-4f37-9488-42078804d911 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.033s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:01:58 l75lg1-v1 manila-share[98474]: INFO manila.share.access [None req-c92f4bf9-d3f9-4f37-9488-42078804d911 tempest-ShareRulesTest-1530341375 None] Access rules were successfully modified for share instance f7e47502-a0f7-44de-953d-b7b5697ae0b2 belonging to share b330db31-7766-443d-9c19-26fe349665aa. May 28 13:01:59 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-404b8353-1c25-47c2-a850-371b3b2c947f tempest-SharesRenameTest-1796622866 tempest-SharesRenameTest-1796622866-project-member] GET http://10.27.203.238/share/v2/6035b1be773e417b80fb3d9ea83eac8d/shares/e02829cb-d0c9-478e-80fa-e4ec0bf3843c May 28 13:01:59 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-404b8353-1c25-47c2-a850-371b3b2c947f tempest-SharesRenameTest-1796622866 tempest-SharesRenameTest-1796622866-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:59 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-404b8353-1c25-47c2-a850-371b3b2c947f tempest-SharesRenameTest-1796622866 tempest-SharesRenameTest-1796622866-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:59 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-404b8353-1c25-47c2-a850-371b3b2c947f tempest-SharesRenameTest-1796622866 tempest-SharesRenameTest-1796622866-project-member] http://10.27.203.238/share/v2/6035b1be773e417b80fb3d9ea83eac8d/shares/e02829cb-d0c9-478e-80fa-e4ec0bf3843c returned with HTTP 200 May 28 13:01:59 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1189/2348] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:01:59 2024] GET /share/v2/6035b1be773e417b80fb3d9ea83eac8d/shares/e02829cb-d0c9-478e-80fa-e4ec0bf3843c => generated 1343 bytes in 25 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:01:59 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-20f469b5-342d-4d61-abba-dafe597fd85d tempest-SharesRenameTest-1796622866 tempest-SharesRenameTest-1796622866-project-member] POST http://10.27.203.238/share/v2/6035b1be773e417b80fb3d9ea83eac8d/snapshots May 28 13:01:59 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-20f469b5-342d-4d61-abba-dafe597fd85d tempest-SharesRenameTest-1796622866 tempest-SharesRenameTest-1796622866-project-member] Action: 'create', calling method: ShareSnapshotMixin.create, body: {"snapshot": {"name": "tempest-tempest-snapshot-name-2132095113", "force": false, "description": "tempest-tempest-snapshot-description-436866883", "share_id": "e02829cb-d0c9-478e-80fa-e4ec0bf3843c"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:01:59 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.v1.share_snapshots [None req-20f469b5-342d-4d61-abba-dafe597fd85d tempest-SharesRenameTest-1796622866 tempest-SharesRenameTest-1796622866-project-member] Create snapshot from share e02829cb-d0c9-478e-80fa-e4ec0bf3843c May 28 13:01:59 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.quota [None req-20f469b5-342d-4d61-abba-dafe597fd85d tempest-SharesRenameTest-1796622866 tempest-SharesRenameTest-1796622866-project-member] Created reservations ['4eecb37a-7567-4028-a3f4-723792caf023', '67b70216-b314-4780-8540-db9a6b356e1b', '68126161-1aa8-46b9-9bc2-812919d4563c', '88073fbf-2aa1-4a69-9a3d-f439cae295bb'] {{(pid=98330) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 13:01:59 l75lg1-v1 dstat.sh[49771]: 28-05 13:01:59| 3 1 95 1 0|5636M 1796M 278M 7914M| 15k 66B| 0 704k| 0 92.0 |2780 4779 |1.06 1.15 1.06|2.0 1.0 0| 0 0 | 0 2048M| 29 364 0 31 2 May 28 13:01:59 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.quota [None req-20f469b5-342d-4d61-abba-dafe597fd85d tempest-SharesRenameTest-1796622866 tempest-SharesRenameTest-1796622866-project-member] Committed reservations ['4eecb37a-7567-4028-a3f4-723792caf023', '67b70216-b314-4780-8540-db9a6b356e1b', '68126161-1aa8-46b9-9bc2-812919d4563c', '88073fbf-2aa1-4a69-9a3d-f439cae295bb'] {{(pid=98330) commit /opt/stack/manila/manila/quota.py:1063}} May 28 13:01:59 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-20f469b5-342d-4d61-abba-dafe597fd85d tempest-SharesRenameTest-1796622866 tempest-SharesRenameTest-1796622866-project-member] http://10.27.203.238/share/v2/6035b1be773e417b80fb3d9ea83eac8d/snapshots returned with HTTP 202 May 28 13:01:59 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1160/2349] 10.27.203.238 () {66 vars in 1371 bytes} [Tue May 28 13:01:59 2024] POST /share/v2/6035b1be773e417b80fb3d9ea83eac8d/snapshots => generated 746 bytes in 185 msecs (HTTP/1.1 202) 6 headers in 237 bytes (1 switches on core 0) May 28 13:01:59 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-8a775ecc-b049-437a-bf56-af6df4d59271 tempest-SharesRenameTest-1796622866 tempest-SharesRenameTest-1796622866-project-member] GET http://10.27.203.238/share/v2/6035b1be773e417b80fb3d9ea83eac8d/snapshots/7f6343fb-a88d-41ce-91e4-695cc9943965 May 28 13:01:59 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-8a775ecc-b049-437a-bf56-af6df4d59271 tempest-SharesRenameTest-1796622866 tempest-SharesRenameTest-1796622866-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:59 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-8a775ecc-b049-437a-bf56-af6df4d59271 tempest-SharesRenameTest-1796622866 tempest-SharesRenameTest-1796622866-project-member] Calling method 'ShareSnapshotMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:59 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-8a775ecc-b049-437a-bf56-af6df4d59271 tempest-SharesRenameTest-1796622866 tempest-SharesRenameTest-1796622866-project-member] http://10.27.203.238/share/v2/6035b1be773e417b80fb3d9ea83eac8d/snapshots/7f6343fb-a88d-41ce-91e4-695cc9943965 returned with HTTP 200 May 28 13:01:59 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1190/2350] 10.27.203.238 () {64 vars in 1460 bytes} [Tue May 28 13:01:59 2024] GET /share/v2/6035b1be773e417b80fb3d9ea83eac8d/snapshots/7f6343fb-a88d-41ce-91e4-695cc9943965 => generated 746 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:01:59 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-20f469b5-342d-4d61-abba-dafe597fd85d tempest-SharesRenameTest-1796622866 None] >>> [POST] https://127.0.0.1:40443/api/snapshots/ May 28 13:01:59 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-20f469b5-342d-4d61-abba-dafe597fd85d tempest-SharesRenameTest-1796622866 None] {'data': '{"path": "/manila/manila-37860c08-1995-417c-b284-dd741fb36e15", ' May 28 13:01:59 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-20f469b5-342d-4d61-abba-dafe597fd85d tempest-SharesRenameTest-1796622866 None] '"name": "share-snapshot-269cccf8-ac79-425b-bc35-247722bb985f"}', May 28 13:01:59 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-20f469b5-342d-4d61-abba-dafe597fd85d tempest-SharesRenameTest-1796622866 None] 'json': None, May 28 13:01:59 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-20f469b5-342d-4d61-abba-dafe597fd85d tempest-SharesRenameTest-1796622866 None] 'params': None} May 28 13:01:59 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 13:01:59 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager.update_available_resource {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 13:01:59 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Expecting reply to msg e7776560369849c4a47a7968161c6b67 in queue reply_37f4cbd1dd094961a22b8a65f222c327 May 28 13:01:59 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [-] Received RPC response for msg e7776560369849c4a47a7968161c6b67 May 28 13:01:59 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-c90d839d-3651-4162-9ccc-77ec16b81947 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] GET http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/share-access-rules?share_id=b330db31-7766-443d-9c19-26fe349665aa May 28 13:01:59 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-c90d839d-3651-4162-9ccc-77ec16b81947 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:59 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-c90d839d-3651-4162-9ccc-77ec16b81947 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:59 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-c90d839d-3651-4162-9ccc-77ec16b81947 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/share-access-rules?share_id=b330db31-7766-443d-9c19-26fe349665aa returned with HTTP 200 May 28 13:01:59 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1161/2351] 10.27.203.238 () {64 vars in 1467 bytes} [Tue May 28 13:01:59 2024] GET /share/v2/a4f3887fa28c457390f5b66615564430/share-access-rules?share_id=b330db31-7766-443d-9c19-26fe349665aa => generated 19 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:01:59 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-3c0fadcd-a191-4f3e-a178-8ad72219b0ba tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] POST http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/shares/b330db31-7766-443d-9c19-26fe349665aa/action May 28 13:01:59 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-3c0fadcd-a191-4f3e-a178-8ad72219b0ba tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Action body: b'{"allow_access": {"access_type": "ip", "access_to": "203.0.113.77", "access_level": "rw", "lock_deletion": true}}' {{(pid=98329) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 13:01:59 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-3c0fadcd-a191-4f3e-a178-8ad72219b0ba tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Action: 'action', calling method: ShareController.allow_access, body: {"allow_access": {"access_type": "ip", "access_to": "203.0.113.77", "access_level": "rw", "lock_deletion": true}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:01:59 l75lg1-v1 nova-conductor[83647]: DEBUG dbcounter [-] [83647] Writing DB stats nova_cell1:SELECT=3,nova_cell1:UPDATE=3 {{(pid=83647) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:01:59 l75lg1-v1 devstack@m-api.service[98329]: DEBUG oslo_concurrency.lockutils [None req-3c0fadcd-a191-4f3e-a178-8ad72219b0ba tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98329) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:01:59 l75lg1-v1 devstack@m-api.service[98329]: DEBUG oslo_concurrency.lockutils [None req-3c0fadcd-a191-4f3e-a178-8ad72219b0ba tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98329) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:01:59 l75lg1-v1 devstack@m-api.service[98329]: DEBUG oslo_concurrency.lockutils [None req-3c0fadcd-a191-4f3e-a178-8ad72219b0ba tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.043s {{(pid=98329) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:01:59 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-3c0fadcd-a191-4f3e-a178-8ad72219b0ba tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/shares/b330db31-7766-443d-9c19-26fe349665aa/action returned with HTTP 200 May 28 13:01:59 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1191/2352] 10.27.203.238 () {66 vars in 1494 bytes} [Tue May 28 13:01:59 2024] POST /share/v2/a4f3887fa28c457390f5b66615564430/shares/b330db31-7766-443d-9c19-26fe349665aa/action => generated 310 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:01:59 l75lg1-v1 manila-share[98474]: DEBUG manila.share.manager [None req-3c0fadcd-a191-4f3e-a178-8ad72219b0ba tempest-ShareRulesTest-1530341375 None] Received request to update access for share instance f7e47502-a0f7-44de-953d-b7b5697ae0b2. {{(pid=98474) update_access_for_instances /opt/stack/manila/manila/share/manager.py:4353}} May 28 13:01:59 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-9ad47f29-6ab8-41c6-9d20-f0d8f6ecd4df tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] GET http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/share-access-rules?share_id=b330db31-7766-443d-9c19-26fe349665aa May 28 13:01:59 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-9ad47f29-6ab8-41c6-9d20-f0d8f6ecd4df tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:01:59 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-9ad47f29-6ab8-41c6-9d20-f0d8f6ecd4df tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:01:59 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-3c0fadcd-a191-4f3e-a178-8ad72219b0ba tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:01:59 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-3c0fadcd-a191-4f3e-a178-8ad72219b0ba tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:01:59 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-3c0fadcd-a191-4f3e-a178-8ad72219b0ba tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.004s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:01:59 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-3c0fadcd-a191-4f3e-a178-8ad72219b0ba tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:01:59 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-3c0fadcd-a191-4f3e-a178-8ad72219b0ba tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:01:59 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.lock.api [None req-9ad47f29-6ab8-41c6-9d20-f0d8f6ecd4df tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Searching for locks by: {'resource_id': 'bf5a6ef1-dd71-47e3-9483-fe26b535e3ca', 'resource_action': 'show', 'resource_type': 'access_rule'} {{(pid=98330) get_all /opt/stack/manila/manila/lock/api.py:112}} May 28 13:01:59 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-9ad47f29-6ab8-41c6-9d20-f0d8f6ecd4df tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/share-access-rules?share_id=b330db31-7766-443d-9c19-26fe349665aa returned with HTTP 200 May 28 13:01:59 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1162/2353] 10.27.203.238 () {64 vars in 1467 bytes} [Tue May 28 13:01:59 2024] GET /share/v2/a4f3887fa28c457390f5b66615564430/share-access-rules?share_id=b330db31-7766-443d-9c19-26fe349665aa => generated 265 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:02:00 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-d352645e-cd30-429d-820d-3bee9884e28a tempest-ShareTransferTest-320553121 tempest-ShareTransferTest-320553121-project-member] GET http://10.27.203.238/share/v2/bece16f41fc44d55bf7bc45c2adaaed5/shares/de6cdc3c-7cf5-437f-acad-57530196bb54 May 28 13:02:00 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-d352645e-cd30-429d-820d-3bee9884e28a tempest-ShareTransferTest-320553121 tempest-ShareTransferTest-320553121-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:02:00 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-d352645e-cd30-429d-820d-3bee9884e28a tempest-ShareTransferTest-320553121 tempest-ShareTransferTest-320553121-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:02:00 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-d352645e-cd30-429d-820d-3bee9884e28a tempest-ShareTransferTest-320553121 tempest-ShareTransferTest-320553121-project-member] http://10.27.203.238/share/v2/bece16f41fc44d55bf7bc45c2adaaed5/shares/de6cdc3c-7cf5-437f-acad-57530196bb54 returned with HTTP 200 May 28 13:02:00 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1192/2354] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:01:59 2024] GET /share/v2/bece16f41fc44d55bf7bc45c2adaaed5/shares/de6cdc3c-7cf5-437f-acad-57530196bb54 => generated 1315 bytes in 24 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:02:00 l75lg1-v1 nova-conductor[83648]: DEBUG dbcounter [-] [83648] Writing DB stats nova_cell1:SELECT=1 {{(pid=83648) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:02:00 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-3c0fadcd-a191-4f3e-a178-8ad72219b0ba tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.138s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:02:00 l75lg1-v1 manila-share[98474]: DEBUG manila.share.access [None req-3c0fadcd-a191-4f3e-a178-8ad72219b0ba tempest-ShareRulesTest-1530341375 None] Updating access rules for share instance f7e47502-a0f7-44de-953d-b7b5697ae0b2 belonging to share b330db31-7766-443d-9c19-26fe349665aa. {{(pid=98474) update_access_rules /opt/stack/manila/manila/share/access.py:298}} May 28 13:02:00 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-3c0fadcd-a191-4f3e-a178-8ad72219b0ba tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:02:00 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-3c0fadcd-a191-4f3e-a178-8ad72219b0ba tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:02:00 l75lg1-v1 nova-compute[83654]: DEBUG oslo_concurrency.lockutils [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=83654) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:02:00 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-3c0fadcd-a191-4f3e-a178-8ad72219b0ba tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.008s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:02:00 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-3c0fadcd-a191-4f3e-a178-8ad72219b0ba tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:02:00 l75lg1-v1 nova-compute[83654]: DEBUG oslo_concurrency.lockutils [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=83654) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:02:00 l75lg1-v1 nova-compute[83654]: DEBUG oslo_concurrency.lockutils [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=83654) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:02:00 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-3c0fadcd-a191-4f3e-a178-8ad72219b0ba tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:02:00 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.resource_tracker [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Auditing locally available compute resources for l75lg1-v1 (node: l75lg1-v1) {{(pid=83654) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}} May 28 13:02:00 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-3c0fadcd-a191-4f3e-a178-8ad72219b0ba tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.017s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:02:00 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-3c0fadcd-a191-4f3e-a178-8ad72219b0ba tempest-ShareRulesTest-1530341375 None] changing access on None May 28 13:02:00 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-3c0fadcd-a191-4f3e-a178-8ad72219b0ba tempest-ShareRulesTest-1530341375 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:02:00 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-3c0fadcd-a191-4f3e-a178-8ad72219b0ba tempest-ShareRulesTest-1530341375 None] {'allow_redirects': True, May 28 13:02:00 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-3c0fadcd-a191-4f3e-a178-8ad72219b0ba tempest-ShareRulesTest-1530341375 None] 'params': {'name': 'f7e47502-a0f7-44de-953d-b7b5697ae0b2'}} May 28 13:02:00 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.resource_tracker [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Hypervisor/Node resource view: name=l75lg1-v1 free_ram=9987MB free_disk=15.559566497802734GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_01_1", "address": "0000:00:01.1", "product_id": "7010", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7010", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7000", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7000", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "0100", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_0100", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_09_0", "address": "0000:00:09.0", "product_id": "1001", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1001", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "293a", "vendor_id": "8086", "numa_node": null, "label": "label_8086_293a", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_2", "address": "0000:00:07.2", "product_id": "2936", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2936", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "1237", "vendor_id": "8086", "numa_node": null, "label": "label_8086_1237", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "2935", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2935", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "2934", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2934", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_05_0", "address": "0000:00:05.0", "product_id": "1000", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1000", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "1000", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1000", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_06_0", "address": "0000:00:06.0", "product_id": "2668", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2668", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "1000", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1000", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0a_0", "address": "0000:00:0a.0", "product_id": "1002", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1002", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_3", "address": "0000:00:01.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_08_0", "address": "0000:00:08.0", "product_id": "1003", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1003", "dev_type": "type-PCI"}] {{(pid=83654) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}} May 28 13:02:00 l75lg1-v1 nova-compute[83654]: DEBUG oslo_concurrency.lockutils [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=83654) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:02:00 l75lg1-v1 nova-compute[83654]: DEBUG oslo_concurrency.lockutils [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=83654) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:02:00 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Expecting reply to msg f78ce8293a584271b930fa1fa56075cb in queue reply_37f4cbd1dd094961a22b8a65f222c327 May 28 13:02:00 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [-] Received RPC response for msg f78ce8293a584271b930fa1fa56075cb May 28 13:02:00 l75lg1-v1 dstat.sh[49771]: 28-05 13:02:00| 8 1 89 2 0|5636M 1796M 278M 7914M| 10k 5222B| 0 1212k| 0 155 |5383 8762 |1.06 1.15 1.06|1.0 1.0 0| 0 0 | 0 2048M| 29 363 0 31 2 May 28 13:02:00 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-21d485fc-6edd-43f7-b475-852d15bdb669 tempest-ShareTransferTest-320553121 None] <<< [DELETE] https://127.0.0.1:40443/api/viewpolicies/54/ May 28 13:02:00 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-21d485fc-6edd-43f7-b475-852d15bdb669 tempest-ShareTransferTest-320553121 None] --- [DELETE] https://127.0.0.1:40443/api/viewpolicies/54/: Done May 28 13:02:00 l75lg1-v1 neutron-server[77618]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.HashRingHealthCheckPeriodics.touch_hash_ring_nodes' {{(pid=77618) _process_scheduled /opt/stack/data/venv/lib/python3.10/site-packages/futurist/periodics.py:638}} May 28 13:02:00 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-21d485fc-6edd-43f7-b475-852d15bdb669 tempest-ShareTransferTest-320553121 None] Created reservations ['f44c4a4a-c2bd-4221-9382-7f54b239f867', '66dbf350-c7cd-4107-b490-76d8dddc79b9', 'c8ea2998-3181-41af-90f9-49204774690d', 'ca8e2423-7b19-4654-95e7-db536e8b3860'] {{(pid=98474) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 13:02:00 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-21d485fc-6edd-43f7-b475-852d15bdb669 tempest-ShareTransferTest-320553121 None] Committed reservations ['f44c4a4a-c2bd-4221-9382-7f54b239f867', '66dbf350-c7cd-4107-b490-76d8dddc79b9', 'c8ea2998-3181-41af-90f9-49204774690d', 'ca8e2423-7b19-4654-95e7-db536e8b3860'] {{(pid=98474) commit /opt/stack/manila/manila/quota.py:1063}} May 28 13:02:00 l75lg1-v1 manila-share[98474]: INFO manila.share.manager [None req-21d485fc-6edd-43f7-b475-852d15bdb669 tempest-ShareTransferTest-320553121 None] Share instance c9f751bd-bfa5-491d-9739-47b922a557d3: deleted successfully. May 28 13:02:00 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-3c0fadcd-a191-4f3e-a178-8ad72219b0ba tempest-ShareRulesTest-1530341375 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:02:00 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-3c0fadcd-a191-4f3e-a178-8ad72219b0ba tempest-ShareRulesTest-1530341375 None] [Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=1, created='2024-05-28T12:59:53.824250Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='0fa84ccd-850f-48fa-a965-23e5abe31188', id=38, internal=False, is_s3_default_policy=False, name='f7e47502-a0f7-44de-953d-b7b5697ae0b2', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=['*'], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=[], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=[], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T13:01:58.694289Z', tenant_id=1, tenant_name='default', title='f7e47502-a0f7-44de-953d-b7b5697ae0b2', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/38/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[])] May 28 13:02:00 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-3c0fadcd-a191-4f3e-a178-8ad72219b0ba tempest-ShareRulesTest-1530341375 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 13:02:00 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-3c0fadcd-a191-4f3e-a178-8ad72219b0ba tempest-ShareRulesTest-1530341375 None] changing access on /manila/manila-f7e47502-a0f7-44de-953d-b7b5697ae0b2. Rules: {'nfs_read_write': ['203.0.113.77'], 'nfs_read_only': []} May 28 13:02:00 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-3c0fadcd-a191-4f3e-a178-8ad72219b0ba tempest-ShareRulesTest-1530341375 None] >>> [PATCH] https://127.0.0.1:40443/api/viewpolicies/38/ May 28 13:02:00 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-3c0fadcd-a191-4f3e-a178-8ad72219b0ba tempest-ShareRulesTest-1530341375 None] {'data': '{"name": "f7e47502-a0f7-44de-953d-b7b5697ae0b2", "nfs_no_squash": ' May 28 13:02:00 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-3c0fadcd-a191-4f3e-a178-8ad72219b0ba tempest-ShareRulesTest-1530341375 None] '["*"], "nfs_root_squash": ["*"], "nfs_read_write": ["203.0.113.77"], ' May 28 13:02:00 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-3c0fadcd-a191-4f3e-a178-8ad72219b0ba tempest-ShareRulesTest-1530341375 None] '"nfs_read_only": []}', May 28 13:02:00 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-3c0fadcd-a191-4f3e-a178-8ad72219b0ba tempest-ShareRulesTest-1530341375 None] 'params': None} May 28 13:02:00 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Expecting reply to msg 2414116a8a8745d3b56d386945447272 in queue reply_37f4cbd1dd094961a22b8a65f222c327 May 28 13:02:00 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [-] Received RPC response for msg 2414116a8a8745d3b56d386945447272 May 28 13:02:01 l75lg1-v1 devstack@placement-api.service[78202]: DEBUG placement.requestlog [req-860b9ac7-6aa6-4808-9c1a-d80b072ea538 req-7d44c69e-655a-4622-94e2-6529cb2403a8 None None] Starting request: 10.27.203.238 "GET /placement/resource_providers/ef90d7d1-0808-4a15-ad77-f9a7391af2f4/allocations" {{(pid=78202) __call__ /opt/stack/placement/placement/requestlog.py:55}} May 28 13:02:01 l75lg1-v1 devstack@placement-api.service[78202]: INFO placement.requestlog [req-860b9ac7-6aa6-4808-9c1a-d80b072ea538 req-7d44c69e-655a-4622-94e2-6529cb2403a8 service placement] 10.27.203.238 "GET /placement/resource_providers/ef90d7d1-0808-4a15-ad77-f9a7391af2f4/allocations" status: 200 len: 54 microversion: 1.0 May 28 13:02:01 l75lg1-v1 devstack@placement-api.service[78202]: [pid: 78202|app: 0|req: 29/57] 10.27.203.238 () {62 vars in 1480 bytes} [Tue May 28 13:02:01 2024] GET /placement/resource_providers/ef90d7d1-0808-4a15-ad77-f9a7391af2f4/allocations => generated 54 bytes in 13 msecs (HTTP/1.1 200) 6 headers in 223 bytes (1 switches on core 0) May 28 13:02:01 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.resource_tracker [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Total usable vcpus: 10, total allocated vcpus: 0 {{(pid=83654) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}} May 28 13:02:01 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.resource_tracker [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Final resource view: name=l75lg1-v1 phys_ram=16000MB used_ram=512MB phys_disk=28GB used_disk=0GB total_vcpus=10 used_vcpus=0 pci_stats=[] {{(pid=83654) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}} May 28 13:02:01 l75lg1-v1 devstack@placement-api.service[78201]: DEBUG placement.requestlog [req-860b9ac7-6aa6-4808-9c1a-d80b072ea538 req-18568da6-fb47-465b-ae32-5c884bce5967 None None] Starting request: 10.27.203.238 "GET /placement/resource_providers/ef90d7d1-0808-4a15-ad77-f9a7391af2f4/allocations" {{(pid=78201) __call__ /opt/stack/placement/placement/requestlog.py:55}} May 28 13:02:01 l75lg1-v1 devstack@placement-api.service[78201]: INFO placement.requestlog [req-860b9ac7-6aa6-4808-9c1a-d80b072ea538 req-18568da6-fb47-465b-ae32-5c884bce5967 service placement] 10.27.203.238 "GET /placement/resource_providers/ef90d7d1-0808-4a15-ad77-f9a7391af2f4/allocations" status: 200 len: 54 microversion: 1.0 May 28 13:02:01 l75lg1-v1 devstack@placement-api.service[78201]: [pid: 78201|app: 0|req: 29/58] 10.27.203.238 () {62 vars in 1480 bytes} [Tue May 28 13:02:01 2024] GET /placement/resource_providers/ef90d7d1-0808-4a15-ad77-f9a7391af2f4/allocations => generated 54 bytes in 12 msecs (HTTP/1.1 200) 6 headers in 223 bytes (1 switches on core 0) May 28 13:02:01 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.provider_tree [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Inventory has not changed in ProviderTree for provider: ef90d7d1-0808-4a15-ad77-f9a7391af2f4 {{(pid=83654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} May 28 13:02:01 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Expecting reply to msg 48424c4b15ad4afc8e3569fff8e5b015 in queue reply_37f4cbd1dd094961a22b8a65f222c327 May 28 13:02:01 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [-] Received RPC response for msg 48424c4b15ad4afc8e3569fff8e5b015 May 28 13:02:01 l75lg1-v1 dstat.sh[49771]: 28-05 13:02:01| 2 0 96 1 0|5636M 1795M 278M 7914M| 14k 1234B| 0 858k| 0 112 |3009 4683 |1.06 1.15 1.06|2.0 1.0 0| 0 0 | 0 2048M| 29 363 0 33 2 May 28 13:02:01 l75lg1-v1 neutron-server[77619]: DEBUG dbcounter [-] [77619] Writing DB stats neutron:SELECT=2 {{(pid=77619) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:02:01 l75lg1-v1 neutron-server[77619]: DEBUG dbcounter [-] [77619] Writing DB stats neutron:SELECT=1 {{(pid=77619) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:02:01 l75lg1-v1 nova-compute[83654]: DEBUG nova.scheduler.client.report [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Inventory has not changed for provider ef90d7d1-0808-4a15-ad77-f9a7391af2f4 based on inventory data: {'VCPU': {'total': 10, 'reserved': 0, 'min_unit': 1, 'max_unit': 10, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16000, 'reserved': 512, 'min_unit': 1, 'max_unit': 16000, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 28, 'reserved': 0, 'min_unit': 1, 'max_unit': 28, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=83654) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}} May 28 13:02:01 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.resource_tracker [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Compute_service record updated for l75lg1-v1:l75lg1-v1 {{(pid=83654) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}} May 28 13:02:01 l75lg1-v1 nova-compute[83654]: DEBUG oslo_concurrency.lockutils [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.556s {{(pid=83654) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:02:01 l75lg1-v1 manila-data[98318]: DEBUG dbcounter [-] [98318] Writing DB stats manila:SELECT=30,manila:UPDATE=7 {{(pid=98318) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:02:02 l75lg1-v1 dstat.sh[49771]: 28-05 13:02:02| 1 0 98 1 0|5636M 1795M 278M 7914M| 14k 0 | 0 749k| 0 80.1 |2326 3680 |0.98 1.13 1.05| 0 1.0 0| 0 0 | 0 2048M| 29 363 0 29 2 May 28 13:02:02 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-392f2082-fbe4-46f0-8f05-f47173af12da tempest-SharesRenameTest-1796622866 tempest-SharesRenameTest-1796622866-project-member] GET http://10.27.203.238/share/v2/6035b1be773e417b80fb3d9ea83eac8d/snapshots/7f6343fb-a88d-41ce-91e4-695cc9943965 May 28 13:02:02 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-392f2082-fbe4-46f0-8f05-f47173af12da tempest-SharesRenameTest-1796622866 tempest-SharesRenameTest-1796622866-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:02:02 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-392f2082-fbe4-46f0-8f05-f47173af12da tempest-SharesRenameTest-1796622866 tempest-SharesRenameTest-1796622866-project-member] Calling method 'ShareSnapshotMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:02:02 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-392f2082-fbe4-46f0-8f05-f47173af12da tempest-SharesRenameTest-1796622866 tempest-SharesRenameTest-1796622866-project-member] http://10.27.203.238/share/v2/6035b1be773e417b80fb3d9ea83eac8d/snapshots/7f6343fb-a88d-41ce-91e4-695cc9943965 returned with HTTP 200 May 28 13:02:02 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1163/2355] 10.27.203.238 () {64 vars in 1460 bytes} [Tue May 28 13:02:02 2024] GET /share/v2/6035b1be773e417b80fb3d9ea83eac8d/snapshots/7f6343fb-a88d-41ce-91e4-695cc9943965 => generated 746 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:02:02 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-3c0fadcd-a191-4f3e-a178-8ad72219b0ba tempest-ShareRulesTest-1530341375 None] <<< [PATCH] https://127.0.0.1:40443/api/viewpolicies/38/ May 28 13:02:02 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-3c0fadcd-a191-4f3e-a178-8ad72219b0ba tempest-ShareRulesTest-1530341375 None] Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=1, created='2024-05-28T12:59:53.824250Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='0fa84ccd-850f-48fa-a965-23e5abe31188', id=38, internal=False, is_s3_default_policy=False, name='f7e47502-a0f7-44de-953d-b7b5697ae0b2', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=['*'], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['203.0.113.77'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['203.0.113.77'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='MODIFYING', sync_time='2024-05-28T13:02:01.816826Z', tenant_id=1, tenant_name='default', title='f7e47502-a0f7-44de-953d-b7b5697ae0b2', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/38/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[]) May 28 13:02:02 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-3c0fadcd-a191-4f3e-a178-8ad72219b0ba tempest-ShareRulesTest-1530341375 None] --- [PATCH] https://127.0.0.1:40443/api/viewpolicies/38/: Done May 28 13:02:02 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-3c0fadcd-a191-4f3e-a178-8ad72219b0ba tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:02:02 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-3c0fadcd-a191-4f3e-a178-8ad72219b0ba tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:02:02 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-3c0fadcd-a191-4f3e-a178-8ad72219b0ba tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.060s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:02:02 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-3c0fadcd-a191-4f3e-a178-8ad72219b0ba tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:02:02 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-3c0fadcd-a191-4f3e-a178-8ad72219b0ba tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:02:02 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-3c0fadcd-a191-4f3e-a178-8ad72219b0ba tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:02:02 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-3c0fadcd-a191-4f3e-a178-8ad72219b0ba tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:02:02 l75lg1-v1 neutron-server[77623]: DEBUG dbcounter [-] [77623] Writing DB stats neutron:SELECT=1 {{(pid=77623) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:02:02 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-3c0fadcd-a191-4f3e-a178-8ad72219b0ba tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:02:02 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-3c0fadcd-a191-4f3e-a178-8ad72219b0ba tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:02:02 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-3c0fadcd-a191-4f3e-a178-8ad72219b0ba tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:02:02 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-3c0fadcd-a191-4f3e-a178-8ad72219b0ba tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:02:02 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-3c0fadcd-a191-4f3e-a178-8ad72219b0ba tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:02:02 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-3c0fadcd-a191-4f3e-a178-8ad72219b0ba tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:02:02 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-3c0fadcd-a191-4f3e-a178-8ad72219b0ba tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:02:02 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-3c0fadcd-a191-4f3e-a178-8ad72219b0ba tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.052s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:02:02 l75lg1-v1 manila-share[98474]: INFO manila.share.access [None req-3c0fadcd-a191-4f3e-a178-8ad72219b0ba tempest-ShareRulesTest-1530341375 None] Access rules were successfully modified for share instance f7e47502-a0f7-44de-953d-b7b5697ae0b2 belonging to share b330db31-7766-443d-9c19-26fe349665aa. May 28 13:02:02 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-20f469b5-342d-4d61-abba-dafe597fd85d tempest-SharesRenameTest-1796622866 None] <<< [POST] https://127.0.0.1:40443/api/snapshots/ May 28 13:02:02 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-20f469b5-342d-4d61-abba-dafe597fd85d tempest-SharesRenameTest-1796622866 None] Bunch(access_path='/.vast_all_snapshots/1000000014_share-snapshot-269cccf8-ac79-425b-bc35-247722bb985f', aggr_phys_estimation=0, cluster='loop75-kfs', created='2024-05-28T13:02:00.014597Z', eta_sec=30819898675.493355, expiration_time='3001-01-19T07:59:58Z', guid='33be009d-be38-4ff2-ab90-d7677509810c', id=15, indestructible=False, locked=False, name='share-snapshot-269cccf8-ac79-425b-bc35-247722bb985f', path='/manila/manila-37860c08-1995-417c-b284-dd741fb36e15/', policy=None, policy_id=None, protection_policy_id=None, state='SUCCEED', tenant_id=1, tenant_name='default', title='share-snapshot-269cccf8-ac79-425b-bc35-247722bb985f(/manila/manila-37860c08-1995-417c-b284-dd741fb36e15/)', type='local', unique_phys_estimation=0, url='https://127.0.0.1:40443/api/snapshots/15/') May 28 13:02:02 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-20f469b5-342d-4d61-abba-dafe597fd85d tempest-SharesRenameTest-1796622866 None] --- [POST] https://127.0.0.1:40443/api/snapshots/: Done May 28 13:02:02 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-3df6f354-1f7d-4122-94c2-13088b5c6917 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] GET http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/share-access-rules?share_id=b330db31-7766-443d-9c19-26fe349665aa May 28 13:02:02 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-3df6f354-1f7d-4122-94c2-13088b5c6917 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:02:02 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-3df6f354-1f7d-4122-94c2-13088b5c6917 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:02:02 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.lock.api [None req-3df6f354-1f7d-4122-94c2-13088b5c6917 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Searching for locks by: {'resource_id': 'bf5a6ef1-dd71-47e3-9483-fe26b535e3ca', 'resource_action': 'show', 'resource_type': 'access_rule'} {{(pid=98329) get_all /opt/stack/manila/manila/lock/api.py:112}} May 28 13:02:02 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-3df6f354-1f7d-4122-94c2-13088b5c6917 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/share-access-rules?share_id=b330db31-7766-443d-9c19-26fe349665aa returned with HTTP 200 May 28 13:02:02 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1193/2356] 10.27.203.238 () {64 vars in 1467 bytes} [Tue May 28 13:02:02 2024] GET /share/v2/a4f3887fa28c457390f5b66615564430/share-access-rules?share_id=b330db31-7766-443d-9c19-26fe349665aa => generated 280 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:02:03 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-6887424c-7be1-469e-abdc-cb6902314a3d tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] GET http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/share-access-rules?share_id=b330db31-7766-443d-9c19-26fe349665aa May 28 13:02:03 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-6887424c-7be1-469e-abdc-cb6902314a3d tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:02:03 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-6887424c-7be1-469e-abdc-cb6902314a3d tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:02:03 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-a75efad3-4dcf-431e-af8f-72e82796745e tempest-ShareTransferTest-320553121 tempest-ShareTransferTest-320553121-project-member] GET http://10.27.203.238/share/v2/bece16f41fc44d55bf7bc45c2adaaed5/shares/de6cdc3c-7cf5-437f-acad-57530196bb54 May 28 13:02:03 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-a75efad3-4dcf-431e-af8f-72e82796745e tempest-ShareTransferTest-320553121 tempest-ShareTransferTest-320553121-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:02:03 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-a75efad3-4dcf-431e-af8f-72e82796745e tempest-ShareTransferTest-320553121 tempest-ShareTransferTest-320553121-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:02:03 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-a75efad3-4dcf-431e-af8f-72e82796745e tempest-ShareTransferTest-320553121 tempest-ShareTransferTest-320553121-project-member] HTTP exception thrown: The resource could not be found. May 28 13:02:03 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-a75efad3-4dcf-431e-af8f-72e82796745e tempest-ShareTransferTest-320553121 tempest-ShareTransferTest-320553121-project-member] http://10.27.203.238/share/v2/bece16f41fc44d55bf7bc45c2adaaed5/shares/de6cdc3c-7cf5-437f-acad-57530196bb54 returned with HTTP 404 May 28 13:02:03 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1194/2357] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:02:03 2024] GET /share/v2/bece16f41fc44d55bf7bc45c2adaaed5/shares/de6cdc3c-7cf5-437f-acad-57530196bb54 => generated 78 bytes in 10 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 13:02:03 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.lock.api [None req-6887424c-7be1-469e-abdc-cb6902314a3d tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Searching for locks by: {'resource_id': 'bf5a6ef1-dd71-47e3-9483-fe26b535e3ca', 'resource_action': 'show', 'resource_type': 'access_rule'} {{(pid=98330) get_all /opt/stack/manila/manila/lock/api.py:112}} May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3a7268-b7d5-44f9-92e3-f74bb9e38790 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-9e3a7268-b7d5-44f9-92e3-f74bb9e38790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:02:03 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-6887424c-7be1-469e-abdc-cb6902314a3d tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/share-access-rules?share_id=b330db31-7766-443d-9c19-26fe349665aa returned with HTTP 200 May 28 13:02:03 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1164/2358] 10.27.203.238 () {64 vars in 1467 bytes} [Tue May 28 13:02:03 2024] GET /share/v2/a4f3887fa28c457390f5b66615564430/share-access-rules?share_id=b330db31-7766-443d-9c19-26fe349665aa => generated 280 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:02:03 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-7364adee-b715-43d5-a7d4-b4b793348e43 tempest-ShareRulesTest-1530341375 tempest-manila_a4f3887fa28c457390f5b66615564430-579326759] GET http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/share-access-rules?share_id=b330db31-7766-443d-9c19-26fe349665aa May 28 13:02:03 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-7364adee-b715-43d5-a7d4-b4b793348e43 tempest-ShareRulesTest-1530341375 tempest-manila_a4f3887fa28c457390f5b66615564430-579326759] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:02:03 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-7364adee-b715-43d5-a7d4-b4b793348e43 tempest-ShareRulesTest-1530341375 tempest-manila_a4f3887fa28c457390f5b66615564430-579326759] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:02:03 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.lock.api [None req-7364adee-b715-43d5-a7d4-b4b793348e43 tempest-ShareRulesTest-1530341375 tempest-manila_a4f3887fa28c457390f5b66615564430-579326759] Searching for locks by: {'resource_id': 'bf5a6ef1-dd71-47e3-9483-fe26b535e3ca', 'resource_action': 'show', 'resource_type': 'access_rule'} {{(pid=98329) get_all /opt/stack/manila/manila/lock/api.py:112}} May 28 13:02:03 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-7364adee-b715-43d5-a7d4-b4b793348e43 tempest-ShareRulesTest-1530341375 tempest-manila_a4f3887fa28c457390f5b66615564430-579326759] http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/share-access-rules?share_id=b330db31-7766-443d-9c19-26fe349665aa returned with HTTP 200 May 28 13:02:03 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1195/2359] 10.27.203.238 () {64 vars in 1467 bytes} [Tue May 28 13:02:03 2024] GET /share/v2/a4f3887fa28c457390f5b66615564430/share-access-rules?share_id=b330db31-7766-443d-9c19-26fe349665aa => generated 280 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3a7268-b7d5-44f9-92e3-f74bb9e38790 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20f4dd2-bf39-4630-b6ae-e00accda13e8 tempest-ShareTransferTest-121988270 tempest-ShareTransferTest-121988270-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18e2f070539c4a5b976f7acfade6058d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1537648c20c411f91d5a0afa8167810', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:03 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-3d3f510c-ac8b-4a17-97fd-b6cab82adb6f tempest-ShareRulesTest-1530341375 tempest-manila_a4f3887fa28c457390f5b66615564430-579326759] GET http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/share-access-rules?share_id=b330db31-7766-443d-9c19-26fe349665aa May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20f4dd2-bf39-4630-b6ae-e00accda13e8 tempest-ShareTransferTest-121988270 tempest-ShareTransferTest-121988270-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20f4dd2-bf39-4630-b6ae-e00accda13e8 tempest-ShareTransferTest-121988270 tempest-ShareTransferTest-121988270-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:03 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-3d3f510c-ac8b-4a17-97fd-b6cab82adb6f tempest-ShareRulesTest-1530341375 tempest-manila_a4f3887fa28c457390f5b66615564430-579326759] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20f4dd2-bf39-4630-b6ae-e00accda13e8 tempest-ShareTransferTest-121988270 tempest-ShareTransferTest-121988270-project-admin] PATH_INFO: `/v3/users/5000ae7b72ab4d8aad66382d4e873caf` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:03 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-3d3f510c-ac8b-4a17-97fd-b6cab82adb6f tempest-ShareRulesTest-1530341375 tempest-manila_a4f3887fa28c457390f5b66615564430-579326759] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20f4dd2-bf39-4630-b6ae-e00accda13e8 tempest-ShareTransferTest-121988270 tempest-ShareTransferTest-121988270-project-admin] RBAC: Authorizing `identity:delete_user(user_id=5000ae7b72ab4d8aad66382d4e873caf)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20f4dd2-bf39-4630-b6ae-e00accda13e8 tempest-ShareTransferTest-121988270 tempest-ShareTransferTest-121988270-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-e20f4dd2-bf39-4630-b6ae-e00accda13e8 tempest-ShareTransferTest-121988270 tempest-ShareTransferTest-121988270-project-admin] Could not find user: 5000ae7b72ab4d8aad66382d4e873caf.: keystone.exception.UserNotFound: Could not find user: 5000ae7b72ab4d8aad66382d4e873caf. May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 5000ae7b72ab4d8aad66382d4e873caf. May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1602/3231] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:02:03 2024] DELETE /identity/v3/users/5000ae7b72ab4d8aad66382d4e873caf => generated 110 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d012b4be-88bf-4b9e-ba12-3b6fd4a7440a service manila] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d012b4be-88bf-4b9e-ba12-3b6fd4a7440a service manila] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9838422c-2b7a-4b02-865c-653138c33288 tempest-ShareTransferTest-121988270 tempest-ShareTransferTest-121988270-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18e2f070539c4a5b976f7acfade6058d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1537648c20c411f91d5a0afa8167810', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9838422c-2b7a-4b02-865c-653138c33288 tempest-ShareTransferTest-121988270 tempest-ShareTransferTest-121988270-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9838422c-2b7a-4b02-865c-653138c33288 tempest-ShareTransferTest-121988270 tempest-ShareTransferTest-121988270-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9838422c-2b7a-4b02-865c-653138c33288 tempest-ShareTransferTest-121988270 tempest-ShareTransferTest-121988270-project-admin] PATH_INFO: `/v3/users/3fc09c87f69946d2bf009e72ac589cd4` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9838422c-2b7a-4b02-865c-653138c33288 tempest-ShareTransferTest-121988270 tempest-ShareTransferTest-121988270-project-admin] RBAC: Authorizing `identity:delete_user(user_id=3fc09c87f69946d2bf009e72ac589cd4)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9838422c-2b7a-4b02-865c-653138c33288 tempest-ShareTransferTest-121988270 tempest-ShareTransferTest-121988270-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-9838422c-2b7a-4b02-865c-653138c33288 tempest-ShareTransferTest-121988270 tempest-ShareTransferTest-121988270-project-admin] Could not find user: 3fc09c87f69946d2bf009e72ac589cd4.: keystone.exception.UserNotFound: Could not find user: 3fc09c87f69946d2bf009e72ac589cd4. May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 3fc09c87f69946d2bf009e72ac589cd4. May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1630/3232] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:02:03 2024] DELETE /identity/v3/users/3fc09c87f69946d2bf009e72ac589cd4 => generated 110 bytes in 24 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:02:03 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.lock.api [None req-3d3f510c-ac8b-4a17-97fd-b6cab82adb6f tempest-ShareRulesTest-1530341375 tempest-manila_a4f3887fa28c457390f5b66615564430-579326759] Searching for locks by: {'resource_id': 'bf5a6ef1-dd71-47e3-9483-fe26b535e3ca', 'resource_action': 'show', 'resource_type': 'access_rule'} {{(pid=98330) get_all /opt/stack/manila/manila/lock/api.py:112}} May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20f4dd2-bf39-4630-b6ae-e00accda13e8 tempest-ShareTransferTest-121988270 tempest-ShareTransferTest-121988270-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20f4dd2-bf39-4630-b6ae-e00accda13e8 tempest-ShareTransferTest-121988270 tempest-ShareTransferTest-121988270-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:03 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-3d3f510c-ac8b-4a17-97fd-b6cab82adb6f tempest-ShareRulesTest-1530341375 tempest-manila_a4f3887fa28c457390f5b66615564430-579326759] http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/share-access-rules?share_id=b330db31-7766-443d-9c19-26fe349665aa returned with HTTP 200 May 28 13:02:03 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1165/2360] 10.27.203.238 () {64 vars in 1467 bytes} [Tue May 28 13:02:03 2024] GET /share/v2/a4f3887fa28c457390f5b66615564430/share-access-rules?share_id=b330db31-7766-443d-9c19-26fe349665aa => generated 280 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64723958-3a22-44c2-913a-9ada0973b6b8 tempest-ShareTransferTest-121988270 tempest-ShareTransferTest-121988270-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18e2f070539c4a5b976f7acfade6058d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1537648c20c411f91d5a0afa8167810', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64723958-3a22-44c2-913a-9ada0973b6b8 tempest-ShareTransferTest-121988270 tempest-ShareTransferTest-121988270-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64723958-3a22-44c2-913a-9ada0973b6b8 tempest-ShareTransferTest-121988270 tempest-ShareTransferTest-121988270-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64723958-3a22-44c2-913a-9ada0973b6b8 tempest-ShareTransferTest-121988270 tempest-ShareTransferTest-121988270-project-admin] PATH_INFO: `/v3/users/6533c69a593a4e35a8693da46fbd9f3b` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:03 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-f6365897-3469-4c98-a12f-1e36274e58e6 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] POST http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/shares/b330db31-7766-443d-9c19-26fe349665aa/action May 28 13:02:03 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-f6365897-3469-4c98-a12f-1e36274e58e6 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Action body: b'{"deny_access": {"access_id": "bf5a6ef1-dd71-47e3-9483-fe26b535e3ca", "unrestrict": true}}' {{(pid=98329) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 13:02:03 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-f6365897-3469-4c98-a12f-1e36274e58e6 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Action: 'action', calling method: ShareController.deny_access, body: {"deny_access": {"access_id": "bf5a6ef1-dd71-47e3-9483-fe26b535e3ca", "unrestrict": true}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:02:03 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.lock.api [None req-f6365897-3469-4c98-a12f-1e36274e58e6 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Searching for locks by: {'resource_id': 'bf5a6ef1-dd71-47e3-9483-fe26b535e3ca', 'resource_action': 'delete'} {{(pid=98329) get_all /opt/stack/manila/manila/lock/api.py:112}} May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64723958-3a22-44c2-913a-9ada0973b6b8 tempest-ShareTransferTest-121988270 tempest-ShareTransferTest-121988270-project-admin] RBAC: Authorizing `identity:delete_user(user_id=6533c69a593a4e35a8693da46fbd9f3b)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64723958-3a22-44c2-913a-9ada0973b6b8 tempest-ShareTransferTest-121988270 tempest-ShareTransferTest-121988270-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-64723958-3a22-44c2-913a-9ada0973b6b8 tempest-ShareTransferTest-121988270 tempest-ShareTransferTest-121988270-project-admin] Could not find user: 6533c69a593a4e35a8693da46fbd9f3b.: keystone.exception.UserNotFound: Could not find user: 6533c69a593a4e35a8693da46fbd9f3b. May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 6533c69a593a4e35a8693da46fbd9f3b. May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1603/3233] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:02:03 2024] DELETE /identity/v3/users/6533c69a593a4e35a8693da46fbd9f3b => generated 110 bytes in 23 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9838422c-2b7a-4b02-865c-653138c33288 tempest-ShareTransferTest-121988270 tempest-ShareTransferTest-121988270-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9838422c-2b7a-4b02-865c-653138c33288 tempest-ShareTransferTest-121988270 tempest-ShareTransferTest-121988270-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698e0e2a-a760-4ad2-954e-a63b9da8d86b tempest-ShareTransferTest-121988270 tempest-ShareTransferTest-121988270-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18e2f070539c4a5b976f7acfade6058d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1537648c20c411f91d5a0afa8167810', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698e0e2a-a760-4ad2-954e-a63b9da8d86b tempest-ShareTransferTest-121988270 tempest-ShareTransferTest-121988270-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698e0e2a-a760-4ad2-954e-a63b9da8d86b tempest-ShareTransferTest-121988270 tempest-ShareTransferTest-121988270-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698e0e2a-a760-4ad2-954e-a63b9da8d86b tempest-ShareTransferTest-121988270 tempest-ShareTransferTest-121988270-project-admin] PATH_INFO: `/v3/users/929590f760014a429cece4b4e674f84e` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698e0e2a-a760-4ad2-954e-a63b9da8d86b tempest-ShareTransferTest-121988270 tempest-ShareTransferTest-121988270-project-admin] RBAC: Authorizing `identity:delete_user(user_id=929590f760014a429cece4b4e674f84e)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698e0e2a-a760-4ad2-954e-a63b9da8d86b tempest-ShareTransferTest-121988270 tempest-ShareTransferTest-121988270-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-698e0e2a-a760-4ad2-954e-a63b9da8d86b tempest-ShareTransferTest-121988270 tempest-ShareTransferTest-121988270-project-admin] Could not find user: 929590f760014a429cece4b4e674f84e.: keystone.exception.UserNotFound: Could not find user: 929590f760014a429cece4b4e674f84e. May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 929590f760014a429cece4b4e674f84e. May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1631/3234] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:02:03 2024] DELETE /identity/v3/users/929590f760014a429cece4b4e674f84e => generated 110 bytes in 25 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64723958-3a22-44c2-913a-9ada0973b6b8 tempest-ShareTransferTest-121988270 tempest-ShareTransferTest-121988270-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64723958-3a22-44c2-913a-9ada0973b6b8 tempest-ShareTransferTest-121988270 tempest-ShareTransferTest-121988270-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8471f2-b5af-4ad6-bc1e-eb0d134208ae tempest-ShareTransferTest-121988270 tempest-ShareTransferTest-121988270-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18e2f070539c4a5b976f7acfade6058d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1537648c20c411f91d5a0afa8167810', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8471f2-b5af-4ad6-bc1e-eb0d134208ae tempest-ShareTransferTest-121988270 tempest-ShareTransferTest-121988270-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8471f2-b5af-4ad6-bc1e-eb0d134208ae tempest-ShareTransferTest-121988270 tempest-ShareTransferTest-121988270-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8471f2-b5af-4ad6-bc1e-eb0d134208ae tempest-ShareTransferTest-121988270 tempest-ShareTransferTest-121988270-project-admin] PATH_INFO: `/v3/users/7ad2c2df894f4bca82e33623064ce809` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8471f2-b5af-4ad6-bc1e-eb0d134208ae tempest-ShareTransferTest-121988270 tempest-ShareTransferTest-121988270-project-admin] RBAC: Authorizing `identity:delete_user(user_id=7ad2c2df894f4bca82e33623064ce809)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8471f2-b5af-4ad6-bc1e-eb0d134208ae tempest-ShareTransferTest-121988270 tempest-ShareTransferTest-121988270-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-ba8471f2-b5af-4ad6-bc1e-eb0d134208ae tempest-ShareTransferTest-121988270 tempest-ShareTransferTest-121988270-project-admin] Could not find user: 7ad2c2df894f4bca82e33623064ce809.: keystone.exception.UserNotFound: Could not find user: 7ad2c2df894f4bca82e33623064ce809. May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 7ad2c2df894f4bca82e33623064ce809. May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1604/3235] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:02:03 2024] DELETE /identity/v3/users/7ad2c2df894f4bca82e33623064ce809 => generated 110 bytes in 24 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698e0e2a-a760-4ad2-954e-a63b9da8d86b tempest-ShareTransferTest-121988270 tempest-ShareTransferTest-121988270-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698e0e2a-a760-4ad2-954e-a63b9da8d86b tempest-ShareTransferTest-121988270 tempest-ShareTransferTest-121988270-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2a9eea-bc94-4aad-bea2-450dc4d3a3dc tempest-ShareTransferTest-121988270 tempest-ShareTransferTest-121988270-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18e2f070539c4a5b976f7acfade6058d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1537648c20c411f91d5a0afa8167810', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2a9eea-bc94-4aad-bea2-450dc4d3a3dc tempest-ShareTransferTest-121988270 tempest-ShareTransferTest-121988270-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2a9eea-bc94-4aad-bea2-450dc4d3a3dc tempest-ShareTransferTest-121988270 tempest-ShareTransferTest-121988270-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2a9eea-bc94-4aad-bea2-450dc4d3a3dc tempest-ShareTransferTest-121988270 tempest-ShareTransferTest-121988270-project-admin] PATH_INFO: `/v3/users/43487099e439456094fb5cfc0ae825c5` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:03 l75lg1-v1 devstack@m-api.service[98329]: DEBUG oslo_concurrency.lockutils [None req-f6365897-3469-4c98-a12f-1e36274e58e6 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98329) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:02:03 l75lg1-v1 devstack@m-api.service[98329]: DEBUG oslo_concurrency.lockutils [None req-f6365897-3469-4c98-a12f-1e36274e58e6 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98329) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2a9eea-bc94-4aad-bea2-450dc4d3a3dc tempest-ShareTransferTest-121988270 tempest-ShareTransferTest-121988270-project-admin] RBAC: Authorizing `identity:delete_user(user_id=43487099e439456094fb5cfc0ae825c5)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2a9eea-bc94-4aad-bea2-450dc4d3a3dc tempest-ShareTransferTest-121988270 tempest-ShareTransferTest-121988270-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:03 l75lg1-v1 dstat.sh[49771]: 28-05 13:02:03| 8 1 90 2 0|5636M 1795M 278M 7915M| 15k 5382B| 0 1008k| 0 135 |4607 7752 |0.98 1.13 1.05|2.0 1.0 0| 0 0 | 0 2048M| 29 365 0 30 2 May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-ba2a9eea-bc94-4aad-bea2-450dc4d3a3dc tempest-ShareTransferTest-121988270 tempest-ShareTransferTest-121988270-project-admin] Could not find user: 43487099e439456094fb5cfc0ae825c5.: keystone.exception.UserNotFound: Could not find user: 43487099e439456094fb5cfc0ae825c5. May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 43487099e439456094fb5cfc0ae825c5. May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1632/3236] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:02:03 2024] DELETE /identity/v3/users/43487099e439456094fb5cfc0ae825c5 => generated 110 bytes in 30 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8471f2-b5af-4ad6-bc1e-eb0d134208ae tempest-ShareTransferTest-121988270 tempest-ShareTransferTest-121988270-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8471f2-b5af-4ad6-bc1e-eb0d134208ae tempest-ShareTransferTest-121988270 tempest-ShareTransferTest-121988270-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6763b5-7ab6-4e65-81d5-c78285912347 tempest-ShareTransferTest-121988270 tempest-ShareTransferTest-121988270-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18e2f070539c4a5b976f7acfade6058d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1537648c20c411f91d5a0afa8167810', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6763b5-7ab6-4e65-81d5-c78285912347 tempest-ShareTransferTest-121988270 tempest-ShareTransferTest-121988270-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6763b5-7ab6-4e65-81d5-c78285912347 tempest-ShareTransferTest-121988270 tempest-ShareTransferTest-121988270-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6763b5-7ab6-4e65-81d5-c78285912347 tempest-ShareTransferTest-121988270 tempest-ShareTransferTest-121988270-project-admin] PATH_INFO: `/v3/users/450d0e4972ca4250966ec637211a08fd` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6763b5-7ab6-4e65-81d5-c78285912347 tempest-ShareTransferTest-121988270 tempest-ShareTransferTest-121988270-project-admin] RBAC: Authorizing `identity:delete_user(user_id=450d0e4972ca4250966ec637211a08fd)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6763b5-7ab6-4e65-81d5-c78285912347 tempest-ShareTransferTest-121988270 tempest-ShareTransferTest-121988270-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-5d6763b5-7ab6-4e65-81d5-c78285912347 tempest-ShareTransferTest-121988270 tempest-ShareTransferTest-121988270-project-admin] Could not find user: 450d0e4972ca4250966ec637211a08fd.: keystone.exception.UserNotFound: Could not find user: 450d0e4972ca4250966ec637211a08fd. May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 450d0e4972ca4250966ec637211a08fd. May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1605/3237] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:02:03 2024] DELETE /identity/v3/users/450d0e4972ca4250966ec637211a08fd => generated 110 bytes in 24 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2a9eea-bc94-4aad-bea2-450dc4d3a3dc tempest-ShareTransferTest-121988270 tempest-ShareTransferTest-121988270-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:03 l75lg1-v1 devstack@m-api.service[98329]: DEBUG oslo_concurrency.lockutils [None req-f6365897-3469-4c98-a12f-1e36274e58e6 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.051s {{(pid=98329) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:02:03 l75lg1-v1 devstack@m-api.service[98329]: DEBUG oslo_concurrency.lockutils [None req-f6365897-3469-4c98-a12f-1e36274e58e6 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98329) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:02:03 l75lg1-v1 devstack@m-api.service[98329]: DEBUG oslo_concurrency.lockutils [None req-f6365897-3469-4c98-a12f-1e36274e58e6 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98329) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2a9eea-bc94-4aad-bea2-450dc4d3a3dc tempest-ShareTransferTest-121988270 tempest-ShareTransferTest-121988270-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85bf5d4-4db5-4a0b-9cca-3bf3ff75783e tempest-ShareTransferTest-121988270 tempest-ShareTransferTest-121988270-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18e2f070539c4a5b976f7acfade6058d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1537648c20c411f91d5a0afa8167810', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85bf5d4-4db5-4a0b-9cca-3bf3ff75783e tempest-ShareTransferTest-121988270 tempest-ShareTransferTest-121988270-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85bf5d4-4db5-4a0b-9cca-3bf3ff75783e tempest-ShareTransferTest-121988270 tempest-ShareTransferTest-121988270-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85bf5d4-4db5-4a0b-9cca-3bf3ff75783e tempest-ShareTransferTest-121988270 tempest-ShareTransferTest-121988270-project-admin] PATH_INFO: `/v3/users/d76fc4c11efc4cff97005a3ab0385c58` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85bf5d4-4db5-4a0b-9cca-3bf3ff75783e tempest-ShareTransferTest-121988270 tempest-ShareTransferTest-121988270-project-admin] RBAC: Authorizing `identity:delete_user(user_id=d76fc4c11efc4cff97005a3ab0385c58)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85bf5d4-4db5-4a0b-9cca-3bf3ff75783e tempest-ShareTransferTest-121988270 tempest-ShareTransferTest-121988270-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:03 l75lg1-v1 devstack@m-api.service[98329]: DEBUG oslo_concurrency.lockutils [None req-f6365897-3469-4c98-a12f-1e36274e58e6 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.057s {{(pid=98329) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:02:03 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-f6365897-3469-4c98-a12f-1e36274e58e6 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/shares/b330db31-7766-443d-9c19-26fe349665aa/action returned with HTTP 202 May 28 13:02:03 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1196/2361] 10.27.203.238 () {66 vars in 1493 bytes} [Tue May 28 13:02:03 2024] POST /share/v2/a4f3887fa28c457390f5b66615564430/shares/b330db31-7766-443d-9c19-26fe349665aa/action => generated 0 bytes in 195 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-a85bf5d4-4db5-4a0b-9cca-3bf3ff75783e tempest-ShareTransferTest-121988270 tempest-ShareTransferTest-121988270-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd76fc4c11efc4cff97005a3ab0385c58', 'request_id': 'req-a85bf5d4-4db5-4a0b-9cca-3bf3ff75783e'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:03 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-7d6a79c9-434f-464a-a887-c69abe2e88f6 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] GET http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/share-access-rules?share_id=b330db31-7766-443d-9c19-26fe349665aa May 28 13:02:03 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-7d6a79c9-434f-464a-a887-c69abe2e88f6 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:02:03 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-7d6a79c9-434f-464a-a887-c69abe2e88f6 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-a85bf5d4-4db5-4a0b-9cca-3bf3ff75783e tempest-ShareTransferTest-121988270 tempest-ShareTransferTest-121988270-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd76fc4c11efc4cff97005a3ab0385c58', 'request_id': 'req-a85bf5d4-4db5-4a0b-9cca-3bf3ff75783e'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-a85bf5d4-4db5-4a0b-9cca-3bf3ff75783e tempest-ShareTransferTest-121988270 tempest-ShareTransferTest-121988270-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd76fc4c11efc4cff97005a3ab0385c58', 'request_id': 'req-a85bf5d4-4db5-4a0b-9cca-3bf3ff75783e'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-a85bf5d4-4db5-4a0b-9cca-3bf3ff75783e tempest-ShareTransferTest-121988270 tempest-ShareTransferTest-121988270-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd76fc4c11efc4cff97005a3ab0385c58', 'request_id': 'req-a85bf5d4-4db5-4a0b-9cca-3bf3ff75783e'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:03 l75lg1-v1 manila-share[98474]: DEBUG manila.share.manager [None req-f6365897-3469-4c98-a12f-1e36274e58e6 tempest-ShareRulesTest-1530341375 None] Received request to update access for share instance f7e47502-a0f7-44de-953d-b7b5697ae0b2. {{(pid=98474) update_access_for_instances /opt/stack/manila/manila/share/manager.py:4353}} May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-a85bf5d4-4db5-4a0b-9cca-3bf3ff75783e tempest-ShareTransferTest-121988270 tempest-ShareTransferTest-121988270-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd76fc4c11efc4cff97005a3ab0385c58', 'request_id': 'req-a85bf5d4-4db5-4a0b-9cca-3bf3ff75783e'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:03 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.lock.api [None req-7d6a79c9-434f-464a-a887-c69abe2e88f6 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Searching for locks by: {'resource_id': 'bf5a6ef1-dd71-47e3-9483-fe26b535e3ca', 'resource_action': 'show', 'resource_type': 'access_rule'} {{(pid=98330) get_all /opt/stack/manila/manila/lock/api.py:112}} May 28 13:02:03 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-7d6a79c9-434f-464a-a887-c69abe2e88f6 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/share-access-rules?share_id=b330db31-7766-443d-9c19-26fe349665aa returned with HTTP 200 May 28 13:02:03 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-f6365897-3469-4c98-a12f-1e36274e58e6 tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:02:03 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1166/2362] 10.27.203.238 () {64 vars in 1467 bytes} [Tue May 28 13:02:03 2024] GET /share/v2/a4f3887fa28c457390f5b66615564430/share-access-rules?share_id=b330db31-7766-443d-9c19-26fe349665aa => generated 288 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:02:03 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-f6365897-3469-4c98-a12f-1e36274e58e6 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1633/3238] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:02:03 2024] DELETE /identity/v3/users/d76fc4c11efc4cff97005a3ab0385c58 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:02:03 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-f6365897-3469-4c98-a12f-1e36274e58e6 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:02:03 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-f6365897-3469-4c98-a12f-1e36274e58e6 tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:02:03 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-f6365897-3469-4c98-a12f-1e36274e58e6 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:02:03 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-37177c96-d2b8-4a61-83b5-2246b335b119 tempest-ShareTransferTest-320553121 tempest-ShareTransferTest-320553121-project-member] GET http://10.27.203.238/share/v2/bece16f41fc44d55bf7bc45c2adaaed5/share-replicas/detail?share_id=3e8f600a-428f-49ef-9c9b-ce57939ca004 May 28 13:02:03 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-37177c96-d2b8-4a61-83b5-2246b335b119 tempest-ShareTransferTest-320553121 tempest-ShareTransferTest-320553121-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:02:03 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-37177c96-d2b8-4a61-83b5-2246b335b119 tempest-ShareTransferTest-320553121 tempest-ShareTransferTest-320553121-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:02:03 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-37177c96-d2b8-4a61-83b5-2246b335b119 tempest-ShareTransferTest-320553121 tempest-ShareTransferTest-320553121-project-member] http://10.27.203.238/share/v2/bece16f41fc44d55bf7bc45c2adaaed5/share-replicas/detail?share_id=3e8f600a-428f-49ef-9c9b-ce57939ca004 returned with HTTP 200 May 28 13:02:03 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1197/2363] 10.27.203.238 () {64 vars in 1476 bytes} [Tue May 28 13:02:03 2024] GET /share/v2/bece16f41fc44d55bf7bc45c2adaaed5/share-replicas/detail?share_id=3e8f600a-428f-49ef-9c9b-ce57939ca004 => generated 22 bytes in 12 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:02:03 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-08ef21dd-3fcd-4556-86f5-d4a6374c5f45 tempest-ShareTransferTest-320553121 tempest-ShareTransferTest-320553121-project-member] DELETE http://10.27.203.238/share/v2/bece16f41fc44d55bf7bc45c2adaaed5/shares/3e8f600a-428f-49ef-9c9b-ce57939ca004 May 28 13:02:03 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-08ef21dd-3fcd-4556-86f5-d4a6374c5f45 tempest-ShareTransferTest-320553121 tempest-ShareTransferTest-320553121-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:02:03 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-08ef21dd-3fcd-4556-86f5-d4a6374c5f45 tempest-ShareTransferTest-320553121 tempest-ShareTransferTest-320553121-project-member] Calling method 'ShareMixin.delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:02:03 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.v1.shares [None req-08ef21dd-3fcd-4556-86f5-d4a6374c5f45 tempest-ShareTransferTest-320553121 tempest-ShareTransferTest-320553121-project-member] Delete share with id: 3e8f600a-428f-49ef-9c9b-ce57939ca004 May 28 13:02:03 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-08ef21dd-3fcd-4556-86f5-d4a6374c5f45 tempest-ShareTransferTest-320553121 tempest-ShareTransferTest-320553121-project-member] HTTP exception thrown: The resource could not be found. May 28 13:02:03 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-08ef21dd-3fcd-4556-86f5-d4a6374c5f45 tempest-ShareTransferTest-320553121 tempest-ShareTransferTest-320553121-project-member] http://10.27.203.238/share/v2/bece16f41fc44d55bf7bc45c2adaaed5/shares/3e8f600a-428f-49ef-9c9b-ce57939ca004 returned with HTTP 404 May 28 13:02:03 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1167/2364] 10.27.203.238 () {64 vars in 1454 bytes} [Tue May 28 13:02:03 2024] DELETE /share/v2/bece16f41fc44d55bf7bc45c2adaaed5/shares/3e8f600a-428f-49ef-9c9b-ce57939ca004 => generated 78 bytes in 11 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 13:02:03 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-1eeeb039-c903-4bf4-89ea-4f96469db310 tempest-ShareTransferTest-121988270 tempest-ShareTransferTest-121988270-project-admin] DELETE http://10.27.203.238/share/v2/d1537648c20c411f91d5a0afa8167810/types/a09b56f4-f387-46cd-bf2b-e2ebf52c35df May 28 13:02:03 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-1eeeb039-c903-4bf4-89ea-4f96469db310 tempest-ShareTransferTest-121988270 tempest-ShareTransferTest-121988270-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:02:03 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-1eeeb039-c903-4bf4-89ea-4f96469db310 tempest-ShareTransferTest-121988270 tempest-ShareTransferTest-121988270-project-admin] Calling method 'ShareTypesController._delete' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:02:03 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-f6365897-3469-4c98-a12f-1e36274e58e6 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.057s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:02:03 l75lg1-v1 manila-share[98474]: DEBUG manila.share.access [None req-f6365897-3469-4c98-a12f-1e36274e58e6 tempest-ShareRulesTest-1530341375 None] Updating access rules for share instance f7e47502-a0f7-44de-953d-b7b5697ae0b2 belonging to share b330db31-7766-443d-9c19-26fe349665aa. {{(pid=98474) update_access_rules /opt/stack/manila/manila/share/access.py:298}} May 28 13:02:03 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-f6365897-3469-4c98-a12f-1e36274e58e6 tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:02:03 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-f6365897-3469-4c98-a12f-1e36274e58e6 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:02:03 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-f6365897-3469-4c98-a12f-1e36274e58e6 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.007s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:02:03 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-f6365897-3469-4c98-a12f-1e36274e58e6 tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:02:03 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-f6365897-3469-4c98-a12f-1e36274e58e6 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:02:03 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-1eeeb039-c903-4bf4-89ea-4f96469db310 tempest-ShareTransferTest-121988270 tempest-ShareTransferTest-121988270-project-admin] http://10.27.203.238/share/v2/d1537648c20c411f91d5a0afa8167810/types/a09b56f4-f387-46cd-bf2b-e2ebf52c35df returned with HTTP 202 May 28 13:02:03 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1198/2365] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:02:03 2024] DELETE /share/v2/d1537648c20c411f91d5a0afa8167810/types/a09b56f4-f387-46cd-bf2b-e2ebf52c35df => generated 0 bytes in 69 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 13:02:03 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-f6365897-3469-4c98-a12f-1e36274e58e6 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.014s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:02:03 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-f6365897-3469-4c98-a12f-1e36274e58e6 tempest-ShareRulesTest-1530341375 None] changing access on None May 28 13:02:03 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f6365897-3469-4c98-a12f-1e36274e58e6 tempest-ShareRulesTest-1530341375 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:02:03 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f6365897-3469-4c98-a12f-1e36274e58e6 tempest-ShareRulesTest-1530341375 None] {'allow_redirects': True, May 28 13:02:03 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f6365897-3469-4c98-a12f-1e36274e58e6 tempest-ShareRulesTest-1530341375 None] 'params': {'name': 'f7e47502-a0f7-44de-953d-b7b5697ae0b2'}} May 28 13:02:03 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-6b72f2c5-b992-4c9a-bcef-98b3f52a4684 tempest-ShareTransferTest-121988270 tempest-ShareTransferTest-121988270-project-admin] GET http://10.27.203.238/share/v2/d1537648c20c411f91d5a0afa8167810/types/a09b56f4-f387-46cd-bf2b-e2ebf52c35df May 28 13:02:03 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-6b72f2c5-b992-4c9a-bcef-98b3f52a4684 tempest-ShareTransferTest-121988270 tempest-ShareTransferTest-121988270-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:02:03 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-6b72f2c5-b992-4c9a-bcef-98b3f52a4684 tempest-ShareTransferTest-121988270 tempest-ShareTransferTest-121988270-project-admin] Calling method 'ShareTypesController.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:02:03 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-6b72f2c5-b992-4c9a-bcef-98b3f52a4684 tempest-ShareTransferTest-121988270 tempest-ShareTransferTest-121988270-project-admin] HTTP exception thrown: Share type not found. May 28 13:02:03 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-6b72f2c5-b992-4c9a-bcef-98b3f52a4684 tempest-ShareTransferTest-121988270 tempest-ShareTransferTest-121988270-project-admin] http://10.27.203.238/share/v2/d1537648c20c411f91d5a0afa8167810/types/a09b56f4-f387-46cd-bf2b-e2ebf52c35df returned with HTTP 404 May 28 13:02:03 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1168/2366] 10.27.203.238 () {64 vars in 1448 bytes} [Tue May 28 13:02:03 2024] GET /share/v2/d1537648c20c411f91d5a0afa8167810/types/a09b56f4-f387-46cd-bf2b-e2ebf52c35df => generated 67 bytes in 10 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6763b5-7ab6-4e65-81d5-c78285912347 tempest-ShareTransferTest-121988270 tempest-ShareTransferTest-121988270-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-5d6763b5-7ab6-4e65-81d5-c78285912347 tempest-ShareTransferTest-121988270 tempest-ShareTransferTest-121988270-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6763b5-7ab6-4e65-81d5-c78285912347 tempest-ShareTransferTest-121988270 tempest-ShareTransferTest-121988270-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ea89d2-020b-4102-aef7-4b262fece7be None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ea89d2-020b-4102-aef7-4b262fece7be None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ea89d2-020b-4102-aef7-4b262fece7be None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ea89d2-020b-4102-aef7-4b262fece7be None admin] PATH_INFO: `/v3/users/ed7d4361167043f38be1e05c82d83f1c` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ea89d2-020b-4102-aef7-4b262fece7be None admin] RBAC: Authorizing `identity:delete_user(user_id=ed7d4361167043f38be1e05c82d83f1c)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ea89d2-020b-4102-aef7-4b262fece7be None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-54ea89d2-020b-4102-aef7-4b262fece7be None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed7d4361167043f38be1e05c82d83f1c', 'request_id': 'req-54ea89d2-020b-4102-aef7-4b262fece7be'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-54ea89d2-020b-4102-aef7-4b262fece7be None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed7d4361167043f38be1e05c82d83f1c', 'request_id': 'req-54ea89d2-020b-4102-aef7-4b262fece7be'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-54ea89d2-020b-4102-aef7-4b262fece7be None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed7d4361167043f38be1e05c82d83f1c', 'request_id': 'req-54ea89d2-020b-4102-aef7-4b262fece7be'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-54ea89d2-020b-4102-aef7-4b262fece7be None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed7d4361167043f38be1e05c82d83f1c', 'request_id': 'req-54ea89d2-020b-4102-aef7-4b262fece7be'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-54ea89d2-020b-4102-aef7-4b262fece7be None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed7d4361167043f38be1e05c82d83f1c', 'request_id': 'req-54ea89d2-020b-4102-aef7-4b262fece7be'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1606/3239] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 13:02:03 2024] DELETE /identity/v3/users/ed7d4361167043f38be1e05c82d83f1c => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85bf5d4-4db5-4a0b-9cca-3bf3ff75783e tempest-ShareTransferTest-121988270 tempest-ShareTransferTest-121988270-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85bf5d4-4db5-4a0b-9cca-3bf3ff75783e tempest-ShareTransferTest-121988270 tempest-ShareTransferTest-121988270-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5978bd88-b577-4048-bbcc-80e3b23f7eb8 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5978bd88-b577-4048-bbcc-80e3b23f7eb8 None admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5978bd88-b577-4048-bbcc-80e3b23f7eb8 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5978bd88-b577-4048-bbcc-80e3b23f7eb8 None admin] PATH_INFO: `/v3/users/c63c17000aaa4286bcf00a2e6c714c55` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5978bd88-b577-4048-bbcc-80e3b23f7eb8 None admin] RBAC: Authorizing `identity:delete_user(user_id=c63c17000aaa4286bcf00a2e6c714c55)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5978bd88-b577-4048-bbcc-80e3b23f7eb8 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-5978bd88-b577-4048-bbcc-80e3b23f7eb8 None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c63c17000aaa4286bcf00a2e6c714c55', 'request_id': 'req-5978bd88-b577-4048-bbcc-80e3b23f7eb8'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-5978bd88-b577-4048-bbcc-80e3b23f7eb8 None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c63c17000aaa4286bcf00a2e6c714c55', 'request_id': 'req-5978bd88-b577-4048-bbcc-80e3b23f7eb8'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-5978bd88-b577-4048-bbcc-80e3b23f7eb8 None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c63c17000aaa4286bcf00a2e6c714c55', 'request_id': 'req-5978bd88-b577-4048-bbcc-80e3b23f7eb8'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-5978bd88-b577-4048-bbcc-80e3b23f7eb8 None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c63c17000aaa4286bcf00a2e6c714c55', 'request_id': 'req-5978bd88-b577-4048-bbcc-80e3b23f7eb8'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-5978bd88-b577-4048-bbcc-80e3b23f7eb8 None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c63c17000aaa4286bcf00a2e6c714c55', 'request_id': 'req-5978bd88-b577-4048-bbcc-80e3b23f7eb8'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1634/3240] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 13:02:03 2024] DELETE /identity/v3/users/c63c17000aaa4286bcf00a2e6c714c55 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ea89d2-020b-4102-aef7-4b262fece7be None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-54ea89d2-020b-4102-aef7-4b262fece7be None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ea89d2-020b-4102-aef7-4b262fece7be None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:03 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f6365897-3469-4c98-a12f-1e36274e58e6 tempest-ShareRulesTest-1530341375 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:02:03 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f6365897-3469-4c98-a12f-1e36274e58e6 tempest-ShareRulesTest-1530341375 None] [Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=1, created='2024-05-28T12:59:53.824250Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='0fa84ccd-850f-48fa-a965-23e5abe31188', id=38, internal=False, is_s3_default_policy=False, name='f7e47502-a0f7-44de-953d-b7b5697ae0b2', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=['*'], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['203.0.113.77'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['203.0.113.77'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T13:02:02.250606Z', tenant_id=1, tenant_name='default', title='f7e47502-a0f7-44de-953d-b7b5697ae0b2', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/38/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[])] May 28 13:02:03 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f6365897-3469-4c98-a12f-1e36274e58e6 tempest-ShareRulesTest-1530341375 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 13:02:03 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-f6365897-3469-4c98-a12f-1e36274e58e6 tempest-ShareRulesTest-1530341375 None] changing access on /manila/manila-f7e47502-a0f7-44de-953d-b7b5697ae0b2. Rules: {'nfs_read_write': [], 'nfs_read_only': []} May 28 13:02:03 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f6365897-3469-4c98-a12f-1e36274e58e6 tempest-ShareRulesTest-1530341375 None] >>> [PATCH] https://127.0.0.1:40443/api/viewpolicies/38/ May 28 13:02:03 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f6365897-3469-4c98-a12f-1e36274e58e6 tempest-ShareRulesTest-1530341375 None] {'data': '{"name": "f7e47502-a0f7-44de-953d-b7b5697ae0b2", "nfs_no_squash": ' May 28 13:02:03 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f6365897-3469-4c98-a12f-1e36274e58e6 tempest-ShareRulesTest-1530341375 None] '["*"], "nfs_root_squash": ["*"], "nfs_read_write": [], ' May 28 13:02:03 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f6365897-3469-4c98-a12f-1e36274e58e6 tempest-ShareRulesTest-1530341375 None] '"nfs_read_only": []}', May 28 13:02:03 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f6365897-3469-4c98-a12f-1e36274e58e6 tempest-ShareRulesTest-1530341375 None] 'params': None} May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62000426-39cd-4674-a4e1-5ccd6208efef None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62000426-39cd-4674-a4e1-5ccd6208efef None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62000426-39cd-4674-a4e1-5ccd6208efef None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62000426-39cd-4674-a4e1-5ccd6208efef None admin] PATH_INFO: `/v3/users/18e2f070539c4a5b976f7acfade6058d` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62000426-39cd-4674-a4e1-5ccd6208efef None admin] RBAC: Authorizing `identity:delete_user(user_id=18e2f070539c4a5b976f7acfade6058d)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62000426-39cd-4674-a4e1-5ccd6208efef None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-62000426-39cd-4674-a4e1-5ccd6208efef None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18e2f070539c4a5b976f7acfade6058d', 'request_id': 'req-62000426-39cd-4674-a4e1-5ccd6208efef'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-62000426-39cd-4674-a4e1-5ccd6208efef None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18e2f070539c4a5b976f7acfade6058d', 'request_id': 'req-62000426-39cd-4674-a4e1-5ccd6208efef'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-62000426-39cd-4674-a4e1-5ccd6208efef None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18e2f070539c4a5b976f7acfade6058d', 'request_id': 'req-62000426-39cd-4674-a4e1-5ccd6208efef'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-62000426-39cd-4674-a4e1-5ccd6208efef None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18e2f070539c4a5b976f7acfade6058d', 'request_id': 'req-62000426-39cd-4674-a4e1-5ccd6208efef'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-62000426-39cd-4674-a4e1-5ccd6208efef None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18e2f070539c4a5b976f7acfade6058d', 'request_id': 'req-62000426-39cd-4674-a4e1-5ccd6208efef'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1607/3241] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 13:02:03 2024] DELETE /identity/v3/users/18e2f070539c4a5b976f7acfade6058d => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e22df0-5b6b-429c-ba48-26998b5ef340 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e22df0-5b6b-429c-ba48-26998b5ef340 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e22df0-5b6b-429c-ba48-26998b5ef340 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-77e22df0-5b6b-429c-ba48-26998b5ef340 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-77e22df0-5b6b-429c-ba48-26998b5ef340 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-77e22df0-5b6b-429c-ba48-26998b5ef340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1635/3242] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 13:02:03 2024] POST /identity/v3/auth/tokens => generated 2960 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 13:02:03 l75lg1-v1 neutron-server[77618]: DEBUG neutron.wsgi [-] (77618) accepted ('10.27.203.238', 44848) {{(pid=77618) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62000426-39cd-4674-a4e1-5ccd6208efef None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:03 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-62000426-39cd-4674-a4e1-5ccd6208efef None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:02:04 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62000426-39cd-4674-a4e1-5ccd6208efef None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:04 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bcfaca-870f-4f43-933f-4ef6c00dd8af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef17047035e4b518fd5360a01f2da1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:04 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bcfaca-870f-4f43-933f-4ef6c00dd8af service neutron] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:04 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bcfaca-870f-4f43-933f-4ef6c00dd8af service neutron] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:04 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bcfaca-870f-4f43-933f-4ef6c00dd8af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:04 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bcfaca-870f-4f43-933f-4ef6c00dd8af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:04 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bcfaca-870f-4f43-933f-4ef6c00dd8af service neutron] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:04 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1608/3243] 10.27.203.238 () {64 vars in 1432 bytes} [Tue May 28 13:02:03 2024] GET /identity/v3/auth/tokens => generated 2960 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 28 13:02:04 l75lg1-v1 neutron-server[77618]: INFO neutron.wsgi [None req-0b5c193d-7bda-4809-a02a-9fac0b0d5079 None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=d1537648c20c411f91d5a0afa8167810&name=default HTTP/1.1" status: 200 len: 216 time: 0.0731103 May 28 13:02:04 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e22df0-5b6b-429c-ba48-26998b5ef340 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:04 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-77e22df0-5b6b-429c-ba48-26998b5ef340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:02:04 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e22df0-5b6b-429c-ba48-26998b5ef340 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:04 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251d0bf2-64a9-4465-88c6-ec6e52f7e016 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:04 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251d0bf2-64a9-4465-88c6-ec6e52f7e016 None admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:04 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251d0bf2-64a9-4465-88c6-ec6e52f7e016 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:04 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251d0bf2-64a9-4465-88c6-ec6e52f7e016 None admin] PATH_INFO: `/v3/projects/d1537648c20c411f91d5a0afa8167810` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:04 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251d0bf2-64a9-4465-88c6-ec6e52f7e016 None admin] RBAC: Authorizing `identity:delete_project(project_id=d1537648c20c411f91d5a0afa8167810)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:04 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251d0bf2-64a9-4465-88c6-ec6e52f7e016 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:04 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-251d0bf2-64a9-4465-88c6-ec6e52f7e016 None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1537648c20c411f91d5a0afa8167810', 'request_id': 'req-251d0bf2-64a9-4465-88c6-ec6e52f7e016'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:04 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-251d0bf2-64a9-4465-88c6-ec6e52f7e016 None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1537648c20c411f91d5a0afa8167810', 'request_id': 'req-251d0bf2-64a9-4465-88c6-ec6e52f7e016'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:04 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-251d0bf2-64a9-4465-88c6-ec6e52f7e016 None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1537648c20c411f91d5a0afa8167810', 'request_id': 'req-251d0bf2-64a9-4465-88c6-ec6e52f7e016'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:04 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-251d0bf2-64a9-4465-88c6-ec6e52f7e016 None admin] The token cache is being invalidate because project d1537648c20c411f91d5a0afa8167810 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 13:02:04 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-251d0bf2-64a9-4465-88c6-ec6e52f7e016 None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:04 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-251d0bf2-64a9-4465-88c6-ec6e52f7e016 None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:04 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1636/3244] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 13:02:04 2024] DELETE /identity/v3/projects/d1537648c20c411f91d5a0afa8167810 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:02:04 l75lg1-v1 neutron-server[77619]: DEBUG neutron.wsgi [-] (77619) accepted ('10.27.203.238', 44856) {{(pid=77619) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 13:02:04 l75lg1-v1 neutron-server[77619]: INFO neutron.wsgi [None req-d931ed16-9a31-49b2-8245-cfd6c9181e8c None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=6570d95ff9704ae6a746d0fdc1bcfded&name=default HTTP/1.1" status: 200 len: 216 time: 0.0086076 May 28 13:02:04 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bcfaca-870f-4f43-933f-4ef6c00dd8af service neutron] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:04 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bcfaca-870f-4f43-933f-4ef6c00dd8af service neutron] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:04 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5979bf0-07ef-48a5-b6f4-b52879613f07 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:04 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5979bf0-07ef-48a5-b6f4-b52879613f07 None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:04 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5979bf0-07ef-48a5-b6f4-b52879613f07 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:04 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5979bf0-07ef-48a5-b6f4-b52879613f07 None admin] PATH_INFO: `/v3/projects/6570d95ff9704ae6a746d0fdc1bcfded` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:04 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5979bf0-07ef-48a5-b6f4-b52879613f07 None admin] RBAC: Authorizing `identity:delete_project(project_id=6570d95ff9704ae6a746d0fdc1bcfded)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:04 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5979bf0-07ef-48a5-b6f4-b52879613f07 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:04 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-b5979bf0-07ef-48a5-b6f4-b52879613f07 None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6570d95ff9704ae6a746d0fdc1bcfded', 'request_id': 'req-b5979bf0-07ef-48a5-b6f4-b52879613f07'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:04 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-b5979bf0-07ef-48a5-b6f4-b52879613f07 None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6570d95ff9704ae6a746d0fdc1bcfded', 'request_id': 'req-b5979bf0-07ef-48a5-b6f4-b52879613f07'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:04 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-b5979bf0-07ef-48a5-b6f4-b52879613f07 None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6570d95ff9704ae6a746d0fdc1bcfded', 'request_id': 'req-b5979bf0-07ef-48a5-b6f4-b52879613f07'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:04 l75lg1-v1 dstat.sh[49771]: 28-05 13:02:04| 11 1 84 3 0|5636M 1795M 278M 7915M| 12k 1660B| 0 2024k| 0 324 |7835 14k|0.98 1.13 1.05|3.0 0 0| 0 0 | 0 2048M| 29 364 0 33 2 May 28 13:02:04 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-b5979bf0-07ef-48a5-b6f4-b52879613f07 None admin] The token cache is being invalidate because project 6570d95ff9704ae6a746d0fdc1bcfded was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 13:02:04 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-b5979bf0-07ef-48a5-b6f4-b52879613f07 None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:04 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-b5979bf0-07ef-48a5-b6f4-b52879613f07 None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:04 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1609/3245] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 13:02:04 2024] DELETE /identity/v3/projects/6570d95ff9704ae6a746d0fdc1bcfded => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:02:04 l75lg1-v1 neutron-server[77619]: DEBUG neutron.wsgi [-] (77619) accepted ('10.27.203.238', 44862) {{(pid=77619) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 13:02:04 l75lg1-v1 neutron-server[77619]: INFO neutron.wsgi [None req-fe15ddce-5dc4-4e3a-b7de-2b047828eea3 None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=bece16f41fc44d55bf7bc45c2adaaed5&name=default HTTP/1.1" status: 200 len: 216 time: 0.0084209 May 28 13:02:04 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251d0bf2-64a9-4465-88c6-ec6e52f7e016 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:04 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-251d0bf2-64a9-4465-88c6-ec6e52f7e016 None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:02:04 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251d0bf2-64a9-4465-88c6-ec6e52f7e016 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:04 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac74de9-f8a5-4b86-99f4-e8d2dabebb98 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:04 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac74de9-f8a5-4b86-99f4-e8d2dabebb98 None admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:04 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac74de9-f8a5-4b86-99f4-e8d2dabebb98 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:04 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac74de9-f8a5-4b86-99f4-e8d2dabebb98 None admin] PATH_INFO: `/v3/projects/bece16f41fc44d55bf7bc45c2adaaed5` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:04 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac74de9-f8a5-4b86-99f4-e8d2dabebb98 None admin] RBAC: Authorizing `identity:delete_project(project_id=bece16f41fc44d55bf7bc45c2adaaed5)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:04 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac74de9-f8a5-4b86-99f4-e8d2dabebb98 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:04 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-cac74de9-f8a5-4b86-99f4-e8d2dabebb98 None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bece16f41fc44d55bf7bc45c2adaaed5', 'request_id': 'req-cac74de9-f8a5-4b86-99f4-e8d2dabebb98'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:04 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-cac74de9-f8a5-4b86-99f4-e8d2dabebb98 None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bece16f41fc44d55bf7bc45c2adaaed5', 'request_id': 'req-cac74de9-f8a5-4b86-99f4-e8d2dabebb98'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:04 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-cac74de9-f8a5-4b86-99f4-e8d2dabebb98 None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bece16f41fc44d55bf7bc45c2adaaed5', 'request_id': 'req-cac74de9-f8a5-4b86-99f4-e8d2dabebb98'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:04 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-cac74de9-f8a5-4b86-99f4-e8d2dabebb98 None admin] The token cache is being invalidate because project bece16f41fc44d55bf7bc45c2adaaed5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 13:02:04 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-cac74de9-f8a5-4b86-99f4-e8d2dabebb98 None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:04 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-cac74de9-f8a5-4b86-99f4-e8d2dabebb98 None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:04 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1637/3246] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 13:02:04 2024] DELETE /identity/v3/projects/bece16f41fc44d55bf7bc45c2adaaed5 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:02:04 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c77bbc-0de2-4a5b-bc72-65f2f9253933 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:04 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c77bbc-0de2-4a5b-bc72-65f2f9253933 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:04 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c77bbc-0de2-4a5b-bc72-65f2f9253933 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:04 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-a9c77bbc-0de2-4a5b-bc72-65f2f9253933 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 13:02:04 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-a9c77bbc-0de2-4a5b-bc72-65f2f9253933 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 13:02:04 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-a9c77bbc-0de2-4a5b-bc72-65f2f9253933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:02:04 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1610/3247] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 13:02:04 2024] POST /identity/v3/auth/tokens => generated 312 bytes in 19 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 28 13:02:04 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e4efc8-e530-4dd5-9103-ffb3e6aa6c6f None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:04 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e4efc8-e530-4dd5-9103-ffb3e6aa6c6f None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:04 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e4efc8-e530-4dd5-9103-ffb3e6aa6c6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:04 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-87e4efc8-e530-4dd5-9103-ffb3e6aa6c6f None None] Truncating password to algorithm specific maximum length 72 characters. May 28 13:02:04 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-87e4efc8-e530-4dd5-9103-ffb3e6aa6c6f None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 13:02:04 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-87e4efc8-e530-4dd5-9103-ffb3e6aa6c6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:02:04 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1638/3248] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 13:02:04 2024] POST /identity/v3/auth/tokens => generated 2960 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 13:02:04 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c77bbc-0de2-4a5b-bc72-65f2f9253933 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:04 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c77bbc-0de2-4a5b-bc72-65f2f9253933 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:04 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd191319-febc-4746-9f64-20bc0545a378 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:04 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd191319-febc-4746-9f64-20bc0545a378 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:04 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd191319-febc-4746-9f64-20bc0545a378 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:04 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd191319-febc-4746-9f64-20bc0545a378 None admin] PATH_INFO: `/v3/domains` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:04 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd191319-febc-4746-9f64-20bc0545a378 None admin] RBAC: Adding query filter params (name=Default) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 13:02:04 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd191319-febc-4746-9f64-20bc0545a378 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:04 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd191319-febc-4746-9f64-20bc0545a378 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:04 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1611/3249] 10.27.203.238 () {62 vars in 1220 bytes} [Tue May 28 13:02:04 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 13:02:04 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e4efc8-e530-4dd5-9103-ffb3e6aa6c6f None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:04 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e4efc8-e530-4dd5-9103-ffb3e6aa6c6f None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:04 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485898d0-80b6-4b00-95e6-6545ef2e6dbd None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:04 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485898d0-80b6-4b00-95e6-6545ef2e6dbd None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:04 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485898d0-80b6-4b00-95e6-6545ef2e6dbd None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:04 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485898d0-80b6-4b00-95e6-6545ef2e6dbd None admin] PATH_INFO: `/v3/projects` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:04 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485898d0-80b6-4b00-95e6-6545ef2e6dbd None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:04 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485898d0-80b6-4b00-95e6-6545ef2e6dbd None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:04 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1639/3250] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 13:02:04 2024] POST /identity/v3/projects => generated 389 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 13:02:04 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd191319-febc-4746-9f64-20bc0545a378 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:04 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd191319-febc-4746-9f64-20bc0545a378 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:04 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74949bf1-63eb-4ee5-b2ac-f0ea50a37fcc None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:04 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74949bf1-63eb-4ee5-b2ac-f0ea50a37fcc None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:04 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74949bf1-63eb-4ee5-b2ac-f0ea50a37fcc None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:04 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74949bf1-63eb-4ee5-b2ac-f0ea50a37fcc None admin] PATH_INFO: `/v3/users` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:04 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74949bf1-63eb-4ee5-b2ac-f0ea50a37fcc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:04 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74949bf1-63eb-4ee5-b2ac-f0ea50a37fcc None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:04 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-74949bf1-63eb-4ee5-b2ac-f0ea50a37fcc None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 13:02:04 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1612/3251] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 13:02:04 2024] POST /identity/v3/users => generated 303 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 13:02:04 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485898d0-80b6-4b00-95e6-6545ef2e6dbd None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:04 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485898d0-80b6-4b00-95e6-6545ef2e6dbd None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:04 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f47a0bc-7e3f-4a5b-b32b-ddcd0d2fa3cf None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:04 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f47a0bc-7e3f-4a5b-b32b-ddcd0d2fa3cf None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:04 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f47a0bc-7e3f-4a5b-b32b-ddcd0d2fa3cf None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:04 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f47a0bc-7e3f-4a5b-b32b-ddcd0d2fa3cf None admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:04 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f47a0bc-7e3f-4a5b-b32b-ddcd0d2fa3cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:04 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f47a0bc-7e3f-4a5b-b32b-ddcd0d2fa3cf None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:04 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1640/3252] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 13:02:04 2024] GET /identity/v3/roles => generated 1680 bytes in 17 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 13:02:04 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74949bf1-63eb-4ee5-b2ac-f0ea50a37fcc None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:04 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74949bf1-63eb-4ee5-b2ac-f0ea50a37fcc None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:04 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeae4b0a-3fd5-4134-a87d-2442540e53b2 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:04 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeae4b0a-3fd5-4134-a87d-2442540e53b2 None admin] REQUEST_METHOD: `PUT` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:04 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeae4b0a-3fd5-4134-a87d-2442540e53b2 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:04 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeae4b0a-3fd5-4134-a87d-2442540e53b2 None admin] PATH_INFO: `/v3/projects/e0a7371d578542ecbb1cfaa96bd52e2d/users/cb7b1fac48f54f4c8c2b7997d17766e5/roles/44620cad10ae407c90c91e2c296adb04` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:04 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeae4b0a-3fd5-4134-a87d-2442540e53b2 None admin] RBAC: Authorizing `identity:create_grant(project_id=e0a7371d578542ecbb1cfaa96bd52e2d, user_id=cb7b1fac48f54f4c8c2b7997d17766e5, role_id=44620cad10ae407c90c91e2c296adb04)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:04 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeae4b0a-3fd5-4134-a87d-2442540e53b2 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:04 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1613/3253] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 13:02:04 2024] PUT /identity/v3/projects/e0a7371d578542ecbb1cfaa96bd52e2d/users/cb7b1fac48f54f4c8c2b7997d17766e5/roles/44620cad10ae407c90c91e2c296adb04 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:02:04 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbea97c5-b4b0-488a-a0e1-cc591b7799d4 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:04 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbea97c5-b4b0-488a-a0e1-cc591b7799d4 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:04 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbea97c5-b4b0-488a-a0e1-cc591b7799d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:04 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-cbea97c5-b4b0-488a-a0e1-cc591b7799d4 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 13:02:04 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-cbea97c5-b4b0-488a-a0e1-cc591b7799d4 None None] MFA Rules not processed for user `cb7b1fac48f54f4c8c2b7997d17766e5`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 13:02:04 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-cbea97c5-b4b0-488a-a0e1-cc591b7799d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:02:04 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1641/3254] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 13:02:04 2024] POST /identity/v3/auth/tokens => generated 3960 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 13:02:04 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeae4b0a-3fd5-4134-a87d-2442540e53b2 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:04 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeae4b0a-3fd5-4134-a87d-2442540e53b2 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:04 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec555113-166a-477f-b247-cb8141e1e7eb None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:04 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec555113-166a-477f-b247-cb8141e1e7eb None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:04 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec555113-166a-477f-b247-cb8141e1e7eb None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:04 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec555113-166a-477f-b247-cb8141e1e7eb None admin] PATH_INFO: `/v3/projects` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:04 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec555113-166a-477f-b247-cb8141e1e7eb None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:04 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec555113-166a-477f-b247-cb8141e1e7eb None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:04 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1614/3255] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 13:02:04 2024] POST /identity/v3/projects => generated 389 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 13:02:04 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbea97c5-b4b0-488a-a0e1-cc591b7799d4 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:04 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbea97c5-b4b0-488a-a0e1-cc591b7799d4 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:04 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89379839-95eb-41dc-adf5-a906c7e0af29 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:04 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89379839-95eb-41dc-adf5-a906c7e0af29 None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:04 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89379839-95eb-41dc-adf5-a906c7e0af29 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:04 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89379839-95eb-41dc-adf5-a906c7e0af29 None admin] PATH_INFO: `/v3/users` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:04 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89379839-95eb-41dc-adf5-a906c7e0af29 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:04 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89379839-95eb-41dc-adf5-a906c7e0af29 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:04 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-89379839-95eb-41dc-adf5-a906c7e0af29 None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 13:02:04 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1642/3256] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 13:02:04 2024] POST /identity/v3/users => generated 303 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 13:02:04 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec555113-166a-477f-b247-cb8141e1e7eb None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:04 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec555113-166a-477f-b247-cb8141e1e7eb None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:04 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27db9651-2731-4334-8fb3-c4228e4b6195 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:04 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27db9651-2731-4334-8fb3-c4228e4b6195 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:04 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27db9651-2731-4334-8fb3-c4228e4b6195 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:04 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27db9651-2731-4334-8fb3-c4228e4b6195 None admin] PATH_INFO: `/v3/roles` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:04 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27db9651-2731-4334-8fb3-c4228e4b6195 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:04 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27db9651-2731-4334-8fb3-c4228e4b6195 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:04 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1615/3257] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 13:02:04 2024] GET /identity/v3/roles => generated 1680 bytes in 18 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 13:02:04 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89379839-95eb-41dc-adf5-a906c7e0af29 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:04 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89379839-95eb-41dc-adf5-a906c7e0af29 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:04 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb45226-7838-4331-9b26-8e486fce8a03 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:04 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb45226-7838-4331-9b26-8e486fce8a03 None admin] REQUEST_METHOD: `PUT` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:04 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb45226-7838-4331-9b26-8e486fce8a03 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:04 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb45226-7838-4331-9b26-8e486fce8a03 None admin] PATH_INFO: `/v3/projects/22c7818b42ca4634a84be7d1496c4ea6/users/e9e4f639c478441e9bb680279dcb3a2c/roles/44620cad10ae407c90c91e2c296adb04` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:04 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb45226-7838-4331-9b26-8e486fce8a03 None admin] RBAC: Authorizing `identity:create_grant(project_id=22c7818b42ca4634a84be7d1496c4ea6, user_id=e9e4f639c478441e9bb680279dcb3a2c, role_id=44620cad10ae407c90c91e2c296adb04)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:04 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb45226-7838-4331-9b26-8e486fce8a03 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:04 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1643/3258] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 13:02:04 2024] PUT /identity/v3/projects/22c7818b42ca4634a84be7d1496c4ea6/users/e9e4f639c478441e9bb680279dcb3a2c/roles/44620cad10ae407c90c91e2c296adb04 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:02:04 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb1ee1f-98bf-4a9c-b197-a3ef002df1d5 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:04 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb1ee1f-98bf-4a9c-b197-a3ef002df1d5 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:04 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb1ee1f-98bf-4a9c-b197-a3ef002df1d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:04 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-2fb1ee1f-98bf-4a9c-b197-a3ef002df1d5 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 13:02:04 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-2fb1ee1f-98bf-4a9c-b197-a3ef002df1d5 None None] MFA Rules not processed for user `e9e4f639c478441e9bb680279dcb3a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-2fb1ee1f-98bf-4a9c-b197-a3ef002df1d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1616/3259] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 13:02:04 2024] POST /identity/v3/auth/tokens => generated 3960 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb45226-7838-4331-9b26-8e486fce8a03 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb45226-7838-4331-9b26-8e486fce8a03 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c278ce7-f2a2-4aa3-ba71-964fae50550f None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c278ce7-f2a2-4aa3-ba71-964fae50550f None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c278ce7-f2a2-4aa3-ba71-964fae50550f None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c278ce7-f2a2-4aa3-ba71-964fae50550f None admin] PATH_INFO: `/v3/projects` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c278ce7-f2a2-4aa3-ba71-964fae50550f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c278ce7-f2a2-4aa3-ba71-964fae50550f None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1644/3260] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 13:02:05 2024] POST /identity/v3/projects => generated 389 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb1ee1f-98bf-4a9c-b197-a3ef002df1d5 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb1ee1f-98bf-4a9c-b197-a3ef002df1d5 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3a52e3-55cd-47dc-ba1f-6511b4cff82e None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3a52e3-55cd-47dc-ba1f-6511b4cff82e None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3a52e3-55cd-47dc-ba1f-6511b4cff82e None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3a52e3-55cd-47dc-ba1f-6511b4cff82e None admin] PATH_INFO: `/v3/users` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3a52e3-55cd-47dc-ba1f-6511b4cff82e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3a52e3-55cd-47dc-ba1f-6511b4cff82e None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-9f3a52e3-55cd-47dc-ba1f-6511b4cff82e None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1617/3261] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 13:02:05 2024] POST /identity/v3/users => generated 302 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c278ce7-f2a2-4aa3-ba71-964fae50550f None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c278ce7-f2a2-4aa3-ba71-964fae50550f None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1422315-6bfd-4e43-91e2-fd21c7e8cfc3 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1422315-6bfd-4e43-91e2-fd21c7e8cfc3 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1422315-6bfd-4e43-91e2-fd21c7e8cfc3 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1422315-6bfd-4e43-91e2-fd21c7e8cfc3 None admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1422315-6bfd-4e43-91e2-fd21c7e8cfc3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1422315-6bfd-4e43-91e2-fd21c7e8cfc3 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1645/3262] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 13:02:05 2024] GET /identity/v3/roles => generated 1680 bytes in 18 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3a52e3-55cd-47dc-ba1f-6511b4cff82e None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3a52e3-55cd-47dc-ba1f-6511b4cff82e None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93686428-2945-4c5e-bbeb-6ab5bf9e9c38 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93686428-2945-4c5e-bbeb-6ab5bf9e9c38 None admin] REQUEST_METHOD: `PUT` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93686428-2945-4c5e-bbeb-6ab5bf9e9c38 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93686428-2945-4c5e-bbeb-6ab5bf9e9c38 None admin] PATH_INFO: `/v3/projects/5a50842c7ef74c318ec157a9ebe9442d/users/079378e32ac0477782d6aabcc57ba323/roles/e7989893488f483baa107be56668c4f8` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93686428-2945-4c5e-bbeb-6ab5bf9e9c38 None admin] RBAC: Authorizing `identity:create_grant(project_id=5a50842c7ef74c318ec157a9ebe9442d, user_id=079378e32ac0477782d6aabcc57ba323, role_id=e7989893488f483baa107be56668c4f8)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93686428-2945-4c5e-bbeb-6ab5bf9e9c38 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1618/3263] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 13:02:05 2024] PUT /identity/v3/projects/5a50842c7ef74c318ec157a9ebe9442d/users/079378e32ac0477782d6aabcc57ba323/roles/e7989893488f483baa107be56668c4f8 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1422315-6bfd-4e43-91e2-fd21c7e8cfc3 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:05 l75lg1-v1 dstat.sh[49771]: 28-05 13:02:05| 9 2 86 4 0|5636M 1794M 278M 7916M| 11k 0 | 0 2843k| 0 293 |6925 12k|0.98 1.13 1.05|2.0 1.0 0| 0 0 | 0 2048M| 29 364 0 34 2 May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1422315-6bfd-4e43-91e2-fd21c7e8cfc3 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6773b340-30ce-41b4-a5a2-4fba447a6757 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6773b340-30ce-41b4-a5a2-4fba447a6757 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6773b340-30ce-41b4-a5a2-4fba447a6757 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6773b340-30ce-41b4-a5a2-4fba447a6757 None admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6773b340-30ce-41b4-a5a2-4fba447a6757 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6773b340-30ce-41b4-a5a2-4fba447a6757 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1646/3264] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 13:02:05 2024] GET /identity/v3/roles => generated 1680 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93686428-2945-4c5e-bbeb-6ab5bf9e9c38 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93686428-2945-4c5e-bbeb-6ab5bf9e9c38 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7673c4-50cb-4b0a-af13-b67bfd7515c9 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7673c4-50cb-4b0a-af13-b67bfd7515c9 None admin] REQUEST_METHOD: `PUT` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7673c4-50cb-4b0a-af13-b67bfd7515c9 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7673c4-50cb-4b0a-af13-b67bfd7515c9 None admin] PATH_INFO: `/v3/projects/5a50842c7ef74c318ec157a9ebe9442d/users/079378e32ac0477782d6aabcc57ba323/roles/e7989893488f483baa107be56668c4f8` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7673c4-50cb-4b0a-af13-b67bfd7515c9 None admin] RBAC: Authorizing `identity:create_grant(project_id=5a50842c7ef74c318ec157a9ebe9442d, user_id=079378e32ac0477782d6aabcc57ba323, role_id=e7989893488f483baa107be56668c4f8)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7673c4-50cb-4b0a-af13-b67bfd7515c9 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1619/3265] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 13:02:05 2024] PUT /identity/v3/projects/5a50842c7ef74c318ec157a9ebe9442d/users/079378e32ac0477782d6aabcc57ba323/roles/e7989893488f483baa107be56668c4f8 => generated 0 bytes in 19 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aeb2b9-f6df-4b2f-bac8-1687fb466980 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aeb2b9-f6df-4b2f-bac8-1687fb466980 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aeb2b9-f6df-4b2f-bac8-1687fb466980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-c7aeb2b9-f6df-4b2f-bac8-1687fb466980 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-c7aeb2b9-f6df-4b2f-bac8-1687fb466980 None None] MFA Rules not processed for user `079378e32ac0477782d6aabcc57ba323`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-c7aeb2b9-f6df-4b2f-bac8-1687fb466980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:02:05 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-8baca4bb-85ac-4592-8618-18aebe2d0baa tempest-SharesRenameTest-1796622866 tempest-SharesRenameTest-1796622866-project-member] GET http://10.27.203.238/share/v2/6035b1be773e417b80fb3d9ea83eac8d/snapshots/7f6343fb-a88d-41ce-91e4-695cc9943965 May 28 13:02:05 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-8baca4bb-85ac-4592-8618-18aebe2d0baa tempest-SharesRenameTest-1796622866 tempest-SharesRenameTest-1796622866-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:02:05 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-8baca4bb-85ac-4592-8618-18aebe2d0baa tempest-SharesRenameTest-1796622866 tempest-SharesRenameTest-1796622866-project-member] Calling method 'ShareSnapshotMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1647/3266] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 13:02:05 2024] POST /identity/v3/auth/tokens => generated 4083 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7673c4-50cb-4b0a-af13-b67bfd7515c9 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7673c4-50cb-4b0a-af13-b67bfd7515c9 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010df76a-60d1-492c-a780-230d6b9fb7ec tempest-SharesAPIOnlyNegativeTest-1950465614 tempest-SharesAPIOnlyNegativeTest-1950465614-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079378e32ac0477782d6aabcc57ba323', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a50842c7ef74c318ec157a9ebe9442d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010df76a-60d1-492c-a780-230d6b9fb7ec tempest-SharesAPIOnlyNegativeTest-1950465614 tempest-SharesAPIOnlyNegativeTest-1950465614-project-admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010df76a-60d1-492c-a780-230d6b9fb7ec tempest-SharesAPIOnlyNegativeTest-1950465614 tempest-SharesAPIOnlyNegativeTest-1950465614-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010df76a-60d1-492c-a780-230d6b9fb7ec tempest-SharesAPIOnlyNegativeTest-1950465614 tempest-SharesAPIOnlyNegativeTest-1950465614-project-admin] PATH_INFO: `/v3/domains` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010df76a-60d1-492c-a780-230d6b9fb7ec tempest-SharesAPIOnlyNegativeTest-1950465614 tempest-SharesAPIOnlyNegativeTest-1950465614-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010df76a-60d1-492c-a780-230d6b9fb7ec tempest-SharesAPIOnlyNegativeTest-1950465614 tempest-SharesAPIOnlyNegativeTest-1950465614-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010df76a-60d1-492c-a780-230d6b9fb7ec tempest-SharesAPIOnlyNegativeTest-1950465614 tempest-SharesAPIOnlyNegativeTest-1950465614-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1620/3267] 10.27.203.238 () {62 vars in 1241 bytes} [Tue May 28 13:02:05 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aeb2b9-f6df-4b2f-bac8-1687fb466980 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:05 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-8baca4bb-85ac-4592-8618-18aebe2d0baa tempest-SharesRenameTest-1796622866 tempest-SharesRenameTest-1796622866-project-member] http://10.27.203.238/share/v2/6035b1be773e417b80fb3d9ea83eac8d/snapshots/7f6343fb-a88d-41ce-91e4-695cc9943965 returned with HTTP 200 May 28 13:02:05 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1199/2367] 10.27.203.238 () {64 vars in 1460 bytes} [Tue May 28 13:02:05 2024] GET /share/v2/6035b1be773e417b80fb3d9ea83eac8d/snapshots/7f6343fb-a88d-41ce-91e4-695cc9943965 => generated 747 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aeb2b9-f6df-4b2f-bac8-1687fb466980 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb06272-7be1-412c-8742-c82fc059cc7d tempest-SharesAPIOnlyNegativeTest-1950465614 tempest-SharesAPIOnlyNegativeTest-1950465614-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079378e32ac0477782d6aabcc57ba323', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a50842c7ef74c318ec157a9ebe9442d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb06272-7be1-412c-8742-c82fc059cc7d tempest-SharesAPIOnlyNegativeTest-1950465614 tempest-SharesAPIOnlyNegativeTest-1950465614-project-admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb06272-7be1-412c-8742-c82fc059cc7d tempest-SharesAPIOnlyNegativeTest-1950465614 tempest-SharesAPIOnlyNegativeTest-1950465614-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb06272-7be1-412c-8742-c82fc059cc7d tempest-SharesAPIOnlyNegativeTest-1950465614 tempest-SharesAPIOnlyNegativeTest-1950465614-project-admin] PATH_INFO: `/v3/users` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:05 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-ccb80579-44f6-4b91-83d8-661510a3a7cc tempest-SharesRenameTest-1796622866 tempest-SharesRenameTest-1796622866-project-member] GET http://10.27.203.238/share/v1/6035b1be773e417b80fb3d9ea83eac8d/snapshots/7f6343fb-a88d-41ce-91e4-695cc9943965 May 28 13:02:05 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-ccb80579-44f6-4b91-83d8-661510a3a7cc tempest-SharesRenameTest-1796622866 tempest-SharesRenameTest-1796622866-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:02:05 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-ccb80579-44f6-4b91-83d8-661510a3a7cc tempest-SharesRenameTest-1796622866 tempest-SharesRenameTest-1796622866-project-member] Calling method 'ShareSnapshotMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb06272-7be1-412c-8742-c82fc059cc7d tempest-SharesAPIOnlyNegativeTest-1950465614 tempest-SharesAPIOnlyNegativeTest-1950465614-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb06272-7be1-412c-8742-c82fc059cc7d tempest-SharesAPIOnlyNegativeTest-1950465614 tempest-SharesAPIOnlyNegativeTest-1950465614-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-9eb06272-7be1-412c-8742-c82fc059cc7d tempest-SharesAPIOnlyNegativeTest-1950465614 tempest-SharesAPIOnlyNegativeTest-1950465614-project-admin] Truncating password to algorithm specific maximum length 72 characters. May 28 13:02:05 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-ccb80579-44f6-4b91-83d8-661510a3a7cc tempest-SharesRenameTest-1796622866 tempest-SharesRenameTest-1796622866-project-member] http://10.27.203.238/share/v1/6035b1be773e417b80fb3d9ea83eac8d/snapshots/7f6343fb-a88d-41ce-91e4-695cc9943965 returned with HTTP 200 May 28 13:02:05 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1169/2368] 10.27.203.238 () {62 vars in 1417 bytes} [Tue May 28 13:02:05 2024] GET /share/v1/6035b1be773e417b80fb3d9ea83eac8d/snapshots/7f6343fb-a88d-41ce-91e4-695cc9943965 => generated 634 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:02:05 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-a314968e-7cec-492b-aa10-4b42a8cbe0aa tempest-SharesRenameTest-1796622866 tempest-SharesRenameTest-1796622866-project-member] PUT http://10.27.203.238/share/v1/6035b1be773e417b80fb3d9ea83eac8d/snapshots/7f6343fb-a88d-41ce-91e4-695cc9943965 May 28 13:02:05 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-a314968e-7cec-492b-aa10-4b42a8cbe0aa tempest-SharesRenameTest-1796622866 tempest-SharesRenameTest-1796622866-project-member] Action: 'update', calling method: ShareSnapshotMixin.update, body: {"snapshot": {"display_name": "tempest-tempest-new-name-for-snapshot-941711270", "display_description": "tempest-tempest-new-description-for-snapshot-57135131"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1648/3268] 10.27.203.238 () {64 vars in 1232 bytes} [Tue May 28 13:02:05 2024] POST /identity/v3/users => generated 435 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010df76a-60d1-492c-a780-230d6b9fb7ec tempest-SharesAPIOnlyNegativeTest-1950465614 tempest-SharesAPIOnlyNegativeTest-1950465614-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010df76a-60d1-492c-a780-230d6b9fb7ec tempest-SharesAPIOnlyNegativeTest-1950465614 tempest-SharesAPIOnlyNegativeTest-1950465614-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a361740-714b-4a4d-8476-74ad90fa4d88 tempest-SharesAPIOnlyNegativeTest-1950465614 tempest-SharesAPIOnlyNegativeTest-1950465614-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079378e32ac0477782d6aabcc57ba323', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a50842c7ef74c318ec157a9ebe9442d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a361740-714b-4a4d-8476-74ad90fa4d88 tempest-SharesAPIOnlyNegativeTest-1950465614 tempest-SharesAPIOnlyNegativeTest-1950465614-project-admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a361740-714b-4a4d-8476-74ad90fa4d88 tempest-SharesAPIOnlyNegativeTest-1950465614 tempest-SharesAPIOnlyNegativeTest-1950465614-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a361740-714b-4a4d-8476-74ad90fa4d88 tempest-SharesAPIOnlyNegativeTest-1950465614 tempest-SharesAPIOnlyNegativeTest-1950465614-project-admin] PATH_INFO: `/v3/roles` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a361740-714b-4a4d-8476-74ad90fa4d88 tempest-SharesAPIOnlyNegativeTest-1950465614 tempest-SharesAPIOnlyNegativeTest-1950465614-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a361740-714b-4a4d-8476-74ad90fa4d88 tempest-SharesAPIOnlyNegativeTest-1950465614 tempest-SharesAPIOnlyNegativeTest-1950465614-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1621/3269] 10.27.203.238 () {62 vars in 1210 bytes} [Tue May 28 13:02:05 2024] GET /identity/v3/roles => generated 1680 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb06272-7be1-412c-8742-c82fc059cc7d tempest-SharesAPIOnlyNegativeTest-1950465614 tempest-SharesAPIOnlyNegativeTest-1950465614-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb06272-7be1-412c-8742-c82fc059cc7d tempest-SharesAPIOnlyNegativeTest-1950465614 tempest-SharesAPIOnlyNegativeTest-1950465614-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd67f80-3982-43f1-aa45-305d0d8dfa69 tempest-SharesAPIOnlyNegativeTest-1950465614 tempest-SharesAPIOnlyNegativeTest-1950465614-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079378e32ac0477782d6aabcc57ba323', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a50842c7ef74c318ec157a9ebe9442d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd67f80-3982-43f1-aa45-305d0d8dfa69 tempest-SharesAPIOnlyNegativeTest-1950465614 tempest-SharesAPIOnlyNegativeTest-1950465614-project-admin] REQUEST_METHOD: `PUT` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd67f80-3982-43f1-aa45-305d0d8dfa69 tempest-SharesAPIOnlyNegativeTest-1950465614 tempest-SharesAPIOnlyNegativeTest-1950465614-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd67f80-3982-43f1-aa45-305d0d8dfa69 tempest-SharesAPIOnlyNegativeTest-1950465614 tempest-SharesAPIOnlyNegativeTest-1950465614-project-admin] PATH_INFO: `/v3/projects/5a50842c7ef74c318ec157a9ebe9442d/users/2180c425dfa340e79633dd5319b4cd4c/roles/44620cad10ae407c90c91e2c296adb04` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd67f80-3982-43f1-aa45-305d0d8dfa69 tempest-SharesAPIOnlyNegativeTest-1950465614 tempest-SharesAPIOnlyNegativeTest-1950465614-project-admin] RBAC: Authorizing `identity:create_grant(project_id=5a50842c7ef74c318ec157a9ebe9442d, user_id=2180c425dfa340e79633dd5319b4cd4c, role_id=44620cad10ae407c90c91e2c296adb04)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd67f80-3982-43f1-aa45-305d0d8dfa69 tempest-SharesAPIOnlyNegativeTest-1950465614 tempest-SharesAPIOnlyNegativeTest-1950465614-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1649/3270] 10.27.203.238 () {64 vars in 1571 bytes} [Tue May 28 13:02:05 2024] PUT /identity/v3/projects/5a50842c7ef74c318ec157a9ebe9442d/users/2180c425dfa340e79633dd5319b4cd4c/roles/44620cad10ae407c90c91e2c296adb04 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:02:05 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-a314968e-7cec-492b-aa10-4b42a8cbe0aa tempest-SharesRenameTest-1796622866 tempest-SharesRenameTest-1796622866-project-member] http://10.27.203.238/share/v1/6035b1be773e417b80fb3d9ea83eac8d/snapshots/7f6343fb-a88d-41ce-91e4-695cc9943965 returned with HTTP 200 May 28 13:02:05 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1200/2369] 10.27.203.238 () {64 vars in 1438 bytes} [Tue May 28 13:02:05 2024] PUT /share/v1/6035b1be773e417b80fb3d9ea83eac8d/snapshots/7f6343fb-a88d-41ce-91e4-695cc9943965 => generated 648 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:02:05 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-e51402a4-d4bb-4e37-abc3-4d3d76c6c407 tempest-SharesRenameTest-1796622866 tempest-SharesRenameTest-1796622866-project-member] GET http://10.27.203.238/share/v1/6035b1be773e417b80fb3d9ea83eac8d/snapshots/7f6343fb-a88d-41ce-91e4-695cc9943965 May 28 13:02:05 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-e51402a4-d4bb-4e37-abc3-4d3d76c6c407 tempest-SharesRenameTest-1796622866 tempest-SharesRenameTest-1796622866-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:02:05 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-e51402a4-d4bb-4e37-abc3-4d3d76c6c407 tempest-SharesRenameTest-1796622866 tempest-SharesRenameTest-1796622866-project-member] Calling method 'ShareSnapshotMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a361740-714b-4a4d-8476-74ad90fa4d88 tempest-SharesAPIOnlyNegativeTest-1950465614 tempest-SharesAPIOnlyNegativeTest-1950465614-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-2a361740-714b-4a4d-8476-74ad90fa4d88 tempest-SharesAPIOnlyNegativeTest-1950465614 tempest-SharesAPIOnlyNegativeTest-1950465614-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:02:05 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-e51402a4-d4bb-4e37-abc3-4d3d76c6c407 tempest-SharesRenameTest-1796622866 tempest-SharesRenameTest-1796622866-project-member] http://10.27.203.238/share/v1/6035b1be773e417b80fb3d9ea83eac8d/snapshots/7f6343fb-a88d-41ce-91e4-695cc9943965 returned with HTTP 200 May 28 13:02:05 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1170/2370] 10.27.203.238 () {62 vars in 1417 bytes} [Tue May 28 13:02:05 2024] GET /share/v1/6035b1be773e417b80fb3d9ea83eac8d/snapshots/7f6343fb-a88d-41ce-91e4-695cc9943965 => generated 648 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:02:05 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-00d67aa7-d7e2-46c4-b250-44899bf61c8a tempest-SharesRenameTest-1796622866 tempest-SharesRenameTest-1796622866-project-member] GET http://10.27.203.238/share/v1/6035b1be773e417b80fb3d9ea83eac8d/shares/e02829cb-d0c9-478e-80fa-e4ec0bf3843c May 28 13:02:05 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-00d67aa7-d7e2-46c4-b250-44899bf61c8a tempest-SharesRenameTest-1796622866 tempest-SharesRenameTest-1796622866-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:02:05 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-00d67aa7-d7e2-46c4-b250-44899bf61c8a tempest-SharesRenameTest-1796622866 tempest-SharesRenameTest-1796622866-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a361740-714b-4a4d-8476-74ad90fa4d88 tempest-SharesAPIOnlyNegativeTest-1950465614 tempest-SharesAPIOnlyNegativeTest-1950465614-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:05 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-00d67aa7-d7e2-46c4-b250-44899bf61c8a tempest-SharesRenameTest-1796622866 tempest-SharesRenameTest-1796622866-project-member] http://10.27.203.238/share/v1/6035b1be773e417b80fb3d9ea83eac8d/shares/e02829cb-d0c9-478e-80fa-e4ec0bf3843c returned with HTTP 200 May 28 13:02:05 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1171/2371] 10.27.203.238 () {62 vars in 1408 bytes} [Tue May 28 13:02:05 2024] GET /share/v1/6035b1be773e417b80fb3d9ea83eac8d/shares/e02829cb-d0c9-478e-80fa-e4ec0bf3843c => generated 990 bytes in 25 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:02:05 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-79039823-5aac-4d87-ac4d-b35fe5bddff1 tempest-SharesRenameTest-1796622866 tempest-SharesRenameTest-1796622866-project-member] PUT http://10.27.203.238/share/v1/6035b1be773e417b80fb3d9ea83eac8d/shares/e02829cb-d0c9-478e-80fa-e4ec0bf3843c May 28 13:02:05 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-79039823-5aac-4d87-ac4d-b35fe5bddff1 tempest-SharesRenameTest-1796622866 tempest-SharesRenameTest-1796622866-project-member] Action: 'update', calling method: ShareMixin.update, body: {"share": {"display_name": "tempest-tempest-new-name-1043256971", "display_description": "tempest-tempest-new-description-113786179"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839a2399-6778-45de-89d8-077f51f296a0 service manila] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f110cf6300f049c897d0aab63218d1e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839a2399-6778-45de-89d8-077f51f296a0 service manila] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839a2399-6778-45de-89d8-077f51f296a0 service manila] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839a2399-6778-45de-89d8-077f51f296a0 service manila] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:05 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-79039823-5aac-4d87-ac4d-b35fe5bddff1 tempest-SharesRenameTest-1796622866 tempest-SharesRenameTest-1796622866-project-member] http://10.27.203.238/share/v1/6035b1be773e417b80fb3d9ea83eac8d/shares/e02829cb-d0c9-478e-80fa-e4ec0bf3843c returned with HTTP 200 May 28 13:02:05 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1172/2372] 10.27.203.238 () {64 vars in 1429 bytes} [Tue May 28 13:02:05 2024] PUT /share/v1/6035b1be773e417b80fb3d9ea83eac8d/shares/e02829cb-d0c9-478e-80fa-e4ec0bf3843c => generated 986 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839a2399-6778-45de-89d8-077f51f296a0 service manila] RBAC: Authorizing `identity:validate_token()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:05 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-a1bb4fe9-8a1d-4b0d-ba20-a675c705500d tempest-SharesRenameTest-1796622866 tempest-SharesRenameTest-1796622866-project-member] GET http://10.27.203.238/share/v1/6035b1be773e417b80fb3d9ea83eac8d/shares/e02829cb-d0c9-478e-80fa-e4ec0bf3843c May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839a2399-6778-45de-89d8-077f51f296a0 service manila] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:05 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-a1bb4fe9-8a1d-4b0d-ba20-a675c705500d tempest-SharesRenameTest-1796622866 tempest-SharesRenameTest-1796622866-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:02:05 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-a1bb4fe9-8a1d-4b0d-ba20-a675c705500d tempest-SharesRenameTest-1796622866 tempest-SharesRenameTest-1796622866-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1622/3271] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 13:02:05 2024] GET /identity/v3/auth/tokens => generated 4083 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 13:02:05 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-bff4a399-566f-4c23-8920-a3ec69be305b tempest-SharesAPIOnlyNegativeTest-1950465614 tempest-SharesAPIOnlyNegativeTest-1950465614-project-admin] POST http://10.27.203.238/share/v2/5a50842c7ef74c318ec157a9ebe9442d/types May 28 13:02:05 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-bff4a399-566f-4c23-8920-a3ec69be305b tempest-SharesAPIOnlyNegativeTest-1950465614 tempest-SharesAPIOnlyNegativeTest-1950465614-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share_type": {"name": "tempest-typeshare-type-1798211951", "extra_specs": {"driver_handles_share_servers": "False"}, "share_type_access:is_public": true}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:02:05 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-a1bb4fe9-8a1d-4b0d-ba20-a675c705500d tempest-SharesRenameTest-1796622866 tempest-SharesRenameTest-1796622866-project-member] http://10.27.203.238/share/v1/6035b1be773e417b80fb3d9ea83eac8d/shares/e02829cb-d0c9-478e-80fa-e4ec0bf3843c returned with HTTP 200 May 28 13:02:05 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1173/2373] 10.27.203.238 () {62 vars in 1408 bytes} [Tue May 28 13:02:05 2024] GET /share/v1/6035b1be773e417b80fb3d9ea83eac8d/shares/e02829cb-d0c9-478e-80fa-e4ec0bf3843c => generated 986 bytes in 24 msecs (HTTP/1.1 200) 6 headers in 230 bytes (2 switches on core 0) May 28 13:02:05 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-bff4a399-566f-4c23-8920-a3ec69be305b tempest-SharesAPIOnlyNegativeTest-1950465614 tempest-SharesAPIOnlyNegativeTest-1950465614-project-admin] http://10.27.203.238/share/v2/5a50842c7ef74c318ec157a9ebe9442d/types returned with HTTP 200 May 28 13:02:05 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1201/2374] 10.27.203.238 () {66 vars in 1359 bytes} [Tue May 28 13:02:05 2024] POST /share/v2/5a50842c7ef74c318ec157a9ebe9442d/types => generated 623 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd67f80-3982-43f1-aa45-305d0d8dfa69 tempest-SharesAPIOnlyNegativeTest-1950465614 tempest-SharesAPIOnlyNegativeTest-1950465614-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-0cd67f80-3982-43f1-aa45-305d0d8dfa69 tempest-SharesAPIOnlyNegativeTest-1950465614 tempest-SharesAPIOnlyNegativeTest-1950465614-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:02:05 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-2e39e32f-b6d8-4d00-aa25-497f9b5c4cd0 tempest-SharesAPIOnlyNegativeTest-1950465614 tempest-SharesAPIOnlyNegativeTest-1950465614-project-admin] POST http://10.27.203.238/share/v2/5a50842c7ef74c318ec157a9ebe9442d/types May 28 13:02:05 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-2e39e32f-b6d8-4d00-aa25-497f9b5c4cd0 tempest-SharesAPIOnlyNegativeTest-1950465614 tempest-SharesAPIOnlyNegativeTest-1950465614-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share_type": {"name": "tempest-typeshare-type-894128287", "extra_specs": {"driver_handles_share_servers": "False", "provisioning:max_share_size": 5, "provisioning:min_share_size": 2}, "share_type_access:is_public": true}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:02:05 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-2e39e32f-b6d8-4d00-aa25-497f9b5c4cd0 tempest-SharesAPIOnlyNegativeTest-1950465614 tempest-SharesAPIOnlyNegativeTest-1950465614-project-admin] http://10.27.203.238/share/v2/5a50842c7ef74c318ec157a9ebe9442d/types returned with HTTP 200 May 28 13:02:05 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1174/2375] 10.27.203.238 () {66 vars in 1359 bytes} [Tue May 28 13:02:05 2024] POST /share/v2/5a50842c7ef74c318ec157a9ebe9442d/types => generated 765 bytes in 22 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839a2399-6778-45de-89d8-077f51f296a0 service manila] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839a2399-6778-45de-89d8-077f51f296a0 service manila] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79091762-3287-478d-83b8-58e6ade51279 service manila] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f110cf6300f049c897d0aab63218d1e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79091762-3287-478d-83b8-58e6ade51279 service manila] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79091762-3287-478d-83b8-58e6ade51279 service manila] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79091762-3287-478d-83b8-58e6ade51279 service manila] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd67f80-3982-43f1-aa45-305d0d8dfa69 tempest-SharesAPIOnlyNegativeTest-1950465614 tempest-SharesAPIOnlyNegativeTest-1950465614-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff0574d-5d60-40f3-9114-7f55b507006e tempest-SharesRenameTest-200895555 tempest-SharesRenameTest-200895555-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72a7fdfdc5841c5a56e1602f6e4c8b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bff0d77ff4df42cb942ff6e8fe5d9115', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff0574d-5d60-40f3-9114-7f55b507006e tempest-SharesRenameTest-200895555 tempest-SharesRenameTest-200895555-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff0574d-5d60-40f3-9114-7f55b507006e tempest-SharesRenameTest-200895555 tempest-SharesRenameTest-200895555-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff0574d-5d60-40f3-9114-7f55b507006e tempest-SharesRenameTest-200895555 tempest-SharesRenameTest-200895555-project-admin] PATH_INFO: `/v3/users/14783f4fbce14880b4db4a628827607e` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff0574d-5d60-40f3-9114-7f55b507006e tempest-SharesRenameTest-200895555 tempest-SharesRenameTest-200895555-project-admin] RBAC: Authorizing `identity:delete_user(user_id=14783f4fbce14880b4db4a628827607e)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff0574d-5d60-40f3-9114-7f55b507006e tempest-SharesRenameTest-200895555 tempest-SharesRenameTest-200895555-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-3ff0574d-5d60-40f3-9114-7f55b507006e tempest-SharesRenameTest-200895555 tempest-SharesRenameTest-200895555-project-admin] Could not find user: 14783f4fbce14880b4db4a628827607e.: keystone.exception.UserNotFound: Could not find user: 14783f4fbce14880b4db4a628827607e. May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 14783f4fbce14880b4db4a628827607e. May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1650/3272] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:02:05 2024] DELETE /identity/v3/users/14783f4fbce14880b4db4a628827607e => generated 110 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff0574d-5d60-40f3-9114-7f55b507006e tempest-SharesRenameTest-200895555 tempest-SharesRenameTest-200895555-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff0574d-5d60-40f3-9114-7f55b507006e tempest-SharesRenameTest-200895555 tempest-SharesRenameTest-200895555-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79091762-3287-478d-83b8-58e6ade51279 service manila] RBAC: Authorizing `identity:validate_token()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6742d6-69b7-48b6-8dfb-253d7250842e tempest-SharesRenameTest-200895555 tempest-SharesRenameTest-200895555-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72a7fdfdc5841c5a56e1602f6e4c8b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bff0d77ff4df42cb942ff6e8fe5d9115', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6742d6-69b7-48b6-8dfb-253d7250842e tempest-SharesRenameTest-200895555 tempest-SharesRenameTest-200895555-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6742d6-69b7-48b6-8dfb-253d7250842e tempest-SharesRenameTest-200895555 tempest-SharesRenameTest-200895555-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6742d6-69b7-48b6-8dfb-253d7250842e tempest-SharesRenameTest-200895555 tempest-SharesRenameTest-200895555-project-admin] PATH_INFO: `/v3/users/9eca355145fd413390b5efe7a0d95465` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79091762-3287-478d-83b8-58e6ade51279 service manila] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1623/3273] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 13:02:05 2024] GET /identity/v3/auth/tokens => generated 3960 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6742d6-69b7-48b6-8dfb-253d7250842e tempest-SharesRenameTest-200895555 tempest-SharesRenameTest-200895555-project-admin] RBAC: Authorizing `identity:delete_user(user_id=9eca355145fd413390b5efe7a0d95465)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6742d6-69b7-48b6-8dfb-253d7250842e tempest-SharesRenameTest-200895555 tempest-SharesRenameTest-200895555-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:05 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-986e2227-874e-443f-bbcc-b25932eb21e8 tempest-SharesAPIOnlyNegativeTest-1940122175 tempest-SharesAPIOnlyNegativeTest-1940122175-project-member] POST http://10.27.203.238/share/v2/e0a7371d578542ecbb1cfaa96bd52e2d/shares May 28 13:02:05 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-986e2227-874e-443f-bbcc-b25932eb21e8 tempest-SharesAPIOnlyNegativeTest-1940122175 tempest-SharesAPIOnlyNegativeTest-1940122175-project-member] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share": {"share_proto": "nfs", "description": "tempest-tempest-created-share-desc-1359274613", "snapshot_id": null, "name": "tempest-tempest-created-share-1323346826", "size": 1, "metadata": {}, "is_public": false, "availability_zone": "fake_az", "share_type": "1a2d01e9-8868-4620-87f7-689fe7e830b5"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:02:05 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.v1.shares [None req-986e2227-874e-443f-bbcc-b25932eb21e8 tempest-SharesAPIOnlyNegativeTest-1940122175 tempest-SharesAPIOnlyNegativeTest-1940122175-project-member] Create NFS share of 1 GB May 28 13:02:05 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-986e2227-874e-443f-bbcc-b25932eb21e8 tempest-SharesAPIOnlyNegativeTest-1940122175 tempest-SharesAPIOnlyNegativeTest-1940122175-project-member] HTTP exception thrown: Availability zone fake_az could not be found. May 28 13:02:05 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-986e2227-874e-443f-bbcc-b25932eb21e8 tempest-SharesAPIOnlyNegativeTest-1940122175 tempest-SharesAPIOnlyNegativeTest-1940122175-project-member] http://10.27.203.238/share/v2/e0a7371d578542ecbb1cfaa96bd52e2d/shares returned with HTTP 404 May 28 13:02:05 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1202/2376] 10.27.203.238 () {66 vars in 1362 bytes} [Tue May 28 13:02:05 2024] POST /share/v2/e0a7371d578542ecbb1cfaa96bd52e2d/shares => generated 91 bytes in 68 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-3d6742d6-69b7-48b6-8dfb-253d7250842e tempest-SharesRenameTest-200895555 tempest-SharesRenameTest-200895555-project-admin] Could not find user: 9eca355145fd413390b5efe7a0d95465.: keystone.exception.UserNotFound: Could not find user: 9eca355145fd413390b5efe7a0d95465. May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 9eca355145fd413390b5efe7a0d95465. May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 13:02:05 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f6365897-3469-4c98-a12f-1e36274e58e6 tempest-ShareRulesTest-1530341375 None] <<< [PATCH] https://127.0.0.1:40443/api/viewpolicies/38/ May 28 13:02:05 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f6365897-3469-4c98-a12f-1e36274e58e6 tempest-ShareRulesTest-1530341375 None] Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=1, created='2024-05-28T12:59:53.824250Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='0fa84ccd-850f-48fa-a965-23e5abe31188', id=38, internal=False, is_s3_default_policy=False, name='f7e47502-a0f7-44de-953d-b7b5697ae0b2', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=['*'], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=[], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=[], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='MODIFYING', sync_time='2024-05-28T13:02:05.028152Z', tenant_id=1, tenant_name='default', title='f7e47502-a0f7-44de-953d-b7b5697ae0b2', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/38/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[]) May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1651/3274] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:02:05 2024] DELETE /identity/v3/users/9eca355145fd413390b5efe7a0d95465 => generated 110 bytes in 25 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:02:05 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f6365897-3469-4c98-a12f-1e36274e58e6 tempest-ShareRulesTest-1530341375 None] --- [PATCH] https://127.0.0.1:40443/api/viewpolicies/38/: Done May 28 13:02:05 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-f6365897-3469-4c98-a12f-1e36274e58e6 tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:02:05 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-f6365897-3469-4c98-a12f-1e36274e58e6 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79091762-3287-478d-83b8-58e6ade51279 service manila] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:05 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-cc3436cf-94a5-4b65-98a1-17d5413ac316 tempest-SharesAPIOnlyNegativeTest-1940122175 tempest-SharesAPIOnlyNegativeTest-1940122175-project-member] POST http://10.27.203.238/share/v2/e0a7371d578542ecbb1cfaa96bd52e2d/shares May 28 13:02:05 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-cc3436cf-94a5-4b65-98a1-17d5413ac316 tempest-SharesAPIOnlyNegativeTest-1940122175 tempest-SharesAPIOnlyNegativeTest-1940122175-project-member] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share": {"share_proto": "nfs", "description": "Tempest's share", "snapshot_id": null, "name": "tempest-tempest-created-share-1336917892", "size": 6, "metadata": {}, "is_public": false, "share_type": "e98b1a36-0af8-498a-bc78-b3c859a45504"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79091762-3287-478d-83b8-58e6ade51279 service manila] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:05 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.v1.shares [None req-cc3436cf-94a5-4b65-98a1-17d5413ac316 tempest-SharesAPIOnlyNegativeTest-1940122175 tempest-SharesAPIOnlyNegativeTest-1940122175-project-member] Create NFS share of 6 GB May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3276d5-1c85-4e9e-8314-963301861e29 tempest-SharesRenameTest-200895555 tempest-SharesRenameTest-200895555-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72a7fdfdc5841c5a56e1602f6e4c8b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bff0d77ff4df42cb942ff6e8fe5d9115', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3276d5-1c85-4e9e-8314-963301861e29 tempest-SharesRenameTest-200895555 tempest-SharesRenameTest-200895555-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3276d5-1c85-4e9e-8314-963301861e29 tempest-SharesRenameTest-200895555 tempest-SharesRenameTest-200895555-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3276d5-1c85-4e9e-8314-963301861e29 tempest-SharesRenameTest-200895555 tempest-SharesRenameTest-200895555-project-admin] PATH_INFO: `/v3/users/91ab54ee09854b549923fb7671247f5c` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:05 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-cc3436cf-94a5-4b65-98a1-17d5413ac316 tempest-SharesAPIOnlyNegativeTest-1940122175 tempest-SharesAPIOnlyNegativeTest-1940122175-project-member] http://10.27.203.238/share/v2/e0a7371d578542ecbb1cfaa96bd52e2d/shares returned with HTTP 400 May 28 13:02:05 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1175/2377] 10.27.203.238 () {66 vars in 1362 bytes} [Tue May 28 13:02:05 2024] POST /share/v2/e0a7371d578542ecbb1cfaa96bd52e2d/shares => generated 196 bytes in 12 msecs (HTTP/1.1 400) 6 headers in 240 bytes (1 switches on core 0) May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3276d5-1c85-4e9e-8314-963301861e29 tempest-SharesRenameTest-200895555 tempest-SharesRenameTest-200895555-project-admin] RBAC: Authorizing `identity:delete_user(user_id=91ab54ee09854b549923fb7671247f5c)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3276d5-1c85-4e9e-8314-963301861e29 tempest-SharesRenameTest-200895555 tempest-SharesRenameTest-200895555-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:05 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-562293e2-c392-4a83-9ee8-f4f604ecc19b tempest-SharesAPIOnlyNegativeTest-1940122175 tempest-SharesAPIOnlyNegativeTest-1940122175-project-member] POST http://10.27.203.238/share/v2/e0a7371d578542ecbb1cfaa96bd52e2d/shares May 28 13:02:05 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-562293e2-c392-4a83-9ee8-f4f604ecc19b tempest-SharesAPIOnlyNegativeTest-1940122175 tempest-SharesAPIOnlyNegativeTest-1940122175-project-member] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share": {"share_proto": "nfs", "description": "Tempest's share", "snapshot_id": null, "name": "tempest-tempest-created-share-1838652130", "size": 1, "metadata": {}, "is_public": false, "share_type": "e98b1a36-0af8-498a-bc78-b3c859a45504"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:02:05 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.v1.shares [None req-562293e2-c392-4a83-9ee8-f4f604ecc19b tempest-SharesAPIOnlyNegativeTest-1940122175 tempest-SharesAPIOnlyNegativeTest-1940122175-project-member] Create NFS share of 1 GB May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-cb3276d5-1c85-4e9e-8314-963301861e29 tempest-SharesRenameTest-200895555 tempest-SharesRenameTest-200895555-project-admin] Could not find user: 91ab54ee09854b549923fb7671247f5c.: keystone.exception.UserNotFound: Could not find user: 91ab54ee09854b549923fb7671247f5c. May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:02:05 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-562293e2-c392-4a83-9ee8-f4f604ecc19b tempest-SharesAPIOnlyNegativeTest-1940122175 tempest-SharesAPIOnlyNegativeTest-1940122175-project-member] http://10.27.203.238/share/v2/e0a7371d578542ecbb1cfaa96bd52e2d/shares returned with HTTP 400 May 28 13:02:05 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1203/2378] 10.27.203.238 () {66 vars in 1362 bytes} [Tue May 28 13:02:05 2024] POST /share/v2/e0a7371d578542ecbb1cfaa96bd52e2d/shares => generated 192 bytes in 13 msecs (HTTP/1.1 400) 6 headers in 240 bytes (1 switches on core 0) May 28 13:02:05 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-f6365897-3469-4c98-a12f-1e36274e58e6 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.029s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:02:05 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-f6365897-3469-4c98-a12f-1e36274e58e6 tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:02:05 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-f6365897-3469-4c98-a12f-1e36274e58e6 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 91ab54ee09854b549923fb7671247f5c. May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1624/3275] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:02:05 2024] DELETE /identity/v3/users/91ab54ee09854b549923fb7671247f5c => generated 110 bytes in 30 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6742d6-69b7-48b6-8dfb-253d7250842e tempest-SharesRenameTest-200895555 tempest-SharesRenameTest-200895555-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6742d6-69b7-48b6-8dfb-253d7250842e tempest-SharesRenameTest-200895555 tempest-SharesRenameTest-200895555-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:05 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-2848b703-b4cf-443a-b03e-a21e2447b9e1 tempest-SharesAPIOnlyNegativeTest-1940122175 tempest-SharesAPIOnlyNegativeTest-1940122175-project-member] POST http://10.27.203.238/share/v1/e0a7371d578542ecbb1cfaa96bd52e2d/shares May 28 13:02:05 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-2848b703-b4cf-443a-b03e-a21e2447b9e1 tempest-SharesAPIOnlyNegativeTest-1940122175 tempest-SharesAPIOnlyNegativeTest-1940122175-project-member] Action: 'create', calling method: ShareMixin.create, body: {"share": {"share_proto": "nonexistent_protocol", "description": "tempest-tempest-created-share-desc-2115408695", "snapshot_id": null, "name": "tempest-tempest-created-share-1987047659", "size": 1, "metadata": {}, "is_public": false, "share_type": "1a2d01e9-8868-4620-87f7-689fe7e830b5"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:02:05 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.v1.shares [None req-2848b703-b4cf-443a-b03e-a21e2447b9e1 tempest-SharesAPIOnlyNegativeTest-1940122175 tempest-SharesAPIOnlyNegativeTest-1940122175-project-member] Create NONEXISTENT_PROTOCOL share of 1 GB May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0372ab4a-856a-4aa4-8e14-0e1e5b97d1a4 tempest-SharesRenameTest-200895555 tempest-SharesRenameTest-200895555-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72a7fdfdc5841c5a56e1602f6e4c8b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bff0d77ff4df42cb942ff6e8fe5d9115', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0372ab4a-856a-4aa4-8e14-0e1e5b97d1a4 tempest-SharesRenameTest-200895555 tempest-SharesRenameTest-200895555-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0372ab4a-856a-4aa4-8e14-0e1e5b97d1a4 tempest-SharesRenameTest-200895555 tempest-SharesRenameTest-200895555-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0372ab4a-856a-4aa4-8e14-0e1e5b97d1a4 tempest-SharesRenameTest-200895555 tempest-SharesRenameTest-200895555-project-admin] PATH_INFO: `/v3/users/2889a927897c49bd92a0d1cfdf27e7f5` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:05 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-2848b703-b4cf-443a-b03e-a21e2447b9e1 tempest-SharesAPIOnlyNegativeTest-1940122175 tempest-SharesAPIOnlyNegativeTest-1940122175-project-member] http://10.27.203.238/share/v1/e0a7371d578542ecbb1cfaa96bd52e2d/shares returned with HTTP 400 May 28 13:02:05 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1176/2379] 10.27.203.238 () {64 vars in 1319 bytes} [Tue May 28 13:02:05 2024] POST /share/v1/e0a7371d578542ecbb1cfaa96bd52e2d/shares => generated 198 bytes in 11 msecs (HTTP/1.1 400) 6 headers in 239 bytes (1 switches on core 0) May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0372ab4a-856a-4aa4-8e14-0e1e5b97d1a4 tempest-SharesRenameTest-200895555 tempest-SharesRenameTest-200895555-project-admin] RBAC: Authorizing `identity:delete_user(user_id=2889a927897c49bd92a0d1cfdf27e7f5)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0372ab4a-856a-4aa4-8e14-0e1e5b97d1a4 tempest-SharesRenameTest-200895555 tempest-SharesRenameTest-200895555-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:05 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-98835116-76f9-43e6-851f-d73c6a16a299 tempest-SharesAPIOnlyNegativeTest-1940122175 tempest-SharesAPIOnlyNegativeTest-1940122175-project-member] POST http://10.27.203.238/share/v1/e0a7371d578542ecbb1cfaa96bd52e2d/shares May 28 13:02:05 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-98835116-76f9-43e6-851f-d73c6a16a299 tempest-SharesAPIOnlyNegativeTest-1940122175 tempest-SharesAPIOnlyNegativeTest-1940122175-project-member] Action: 'create', calling method: ShareMixin.create, body: {"share": {"share_proto": "nfs", "description": "tempest-tempest-created-share-desc-724119674", "snapshot_id": null, "name": "tempest-tempest-created-share-844243446", "size": "#$%", "metadata": {}, "is_public": false, "share_type": "1a2d01e9-8868-4620-87f7-689fe7e830b5"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:02:05 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.v1.shares [None req-98835116-76f9-43e6-851f-d73c6a16a299 tempest-SharesAPIOnlyNegativeTest-1940122175 tempest-SharesAPIOnlyNegativeTest-1940122175-project-member] Create NFS share of #$% GB May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-0372ab4a-856a-4aa4-8e14-0e1e5b97d1a4 tempest-SharesRenameTest-200895555 tempest-SharesRenameTest-200895555-project-admin] Could not find user: 2889a927897c49bd92a0d1cfdf27e7f5.: keystone.exception.UserNotFound: Could not find user: 2889a927897c49bd92a0d1cfdf27e7f5. May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 2889a927897c49bd92a0d1cfdf27e7f5. May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1652/3276] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:02:05 2024] DELETE /identity/v3/users/2889a927897c49bd92a0d1cfdf27e7f5 => generated 110 bytes in 25 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:02:05 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-f6365897-3469-4c98-a12f-1e36274e58e6 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.030s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:02:05 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-f6365897-3469-4c98-a12f-1e36274e58e6 tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:02:05 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-f6365897-3469-4c98-a12f-1e36274e58e6 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3276d5-1c85-4e9e-8314-963301861e29 tempest-SharesRenameTest-200895555 tempest-SharesRenameTest-200895555-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:05 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-98835116-76f9-43e6-851f-d73c6a16a299 tempest-SharesAPIOnlyNegativeTest-1940122175 tempest-SharesAPIOnlyNegativeTest-1940122175-project-member] http://10.27.203.238/share/v1/e0a7371d578542ecbb1cfaa96bd52e2d/shares returned with HTTP 400 May 28 13:02:05 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-f6365897-3469-4c98-a12f-1e36274e58e6 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:02:05 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-f6365897-3469-4c98-a12f-1e36274e58e6 tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:02:05 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-f6365897-3469-4c98-a12f-1e36274e58e6 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:02:05 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1204/2380] 10.27.203.238 () {64 vars in 1319 bytes} [Tue May 28 13:02:05 2024] POST /share/v1/e0a7371d578542ecbb1cfaa96bd52e2d/shares => generated 123 bytes in 14 msecs (HTTP/1.1 400) 6 headers in 239 bytes (1 switches on core 0) May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3276d5-1c85-4e9e-8314-963301861e29 tempest-SharesRenameTest-200895555 tempest-SharesRenameTest-200895555-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:05 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-f6365897-3469-4c98-a12f-1e36274e58e6 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:02:05 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-f6365897-3469-4c98-a12f-1e36274e58e6 tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:02:05 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-f6365897-3469-4c98-a12f-1e36274e58e6 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed16e61-e28d-490d-9913-3db180adb933 tempest-SharesRenameTest-200895555 tempest-SharesRenameTest-200895555-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72a7fdfdc5841c5a56e1602f6e4c8b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bff0d77ff4df42cb942ff6e8fe5d9115', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed16e61-e28d-490d-9913-3db180adb933 tempest-SharesRenameTest-200895555 tempest-SharesRenameTest-200895555-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed16e61-e28d-490d-9913-3db180adb933 tempest-SharesRenameTest-200895555 tempest-SharesRenameTest-200895555-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed16e61-e28d-490d-9913-3db180adb933 tempest-SharesRenameTest-200895555 tempest-SharesRenameTest-200895555-project-admin] PATH_INFO: `/v3/users/bd43e5d1c359462d807b6e8a8581fa73` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:05 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-c85c21f5-b468-47f7-9fe0-a71c16d99f49 tempest-SharesAPIOnlyNegativeTest-1940122175 tempest-SharesAPIOnlyNegativeTest-1940122175-project-member] POST http://10.27.203.238/share/v1/e0a7371d578542ecbb1cfaa96bd52e2d/shares May 28 13:02:05 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-c85c21f5-b468-47f7-9fe0-a71c16d99f49 tempest-SharesAPIOnlyNegativeTest-1940122175 tempest-SharesAPIOnlyNegativeTest-1940122175-project-member] Action: 'create', calling method: ShareMixin.create, body: {"share": {"share_proto": "nfs", "description": "tempest-tempest-created-share-desc-255602160", "snapshot_id": null, "name": "tempest-tempest-created-share-1511396323", "size": "", "metadata": {}, "is_public": false, "share_type": "1a2d01e9-8868-4620-87f7-689fe7e830b5"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:02:05 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.v1.shares [None req-c85c21f5-b468-47f7-9fe0-a71c16d99f49 tempest-SharesAPIOnlyNegativeTest-1940122175 tempest-SharesAPIOnlyNegativeTest-1940122175-project-member] Create NFS share of GB May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed16e61-e28d-490d-9913-3db180adb933 tempest-SharesRenameTest-200895555 tempest-SharesRenameTest-200895555-project-admin] RBAC: Authorizing `identity:delete_user(user_id=bd43e5d1c359462d807b6e8a8581fa73)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed16e61-e28d-490d-9913-3db180adb933 tempest-SharesRenameTest-200895555 tempest-SharesRenameTest-200895555-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:05 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-c85c21f5-b468-47f7-9fe0-a71c16d99f49 tempest-SharesAPIOnlyNegativeTest-1940122175 tempest-SharesAPIOnlyNegativeTest-1940122175-project-member] http://10.27.203.238/share/v1/e0a7371d578542ecbb1cfaa96bd52e2d/shares returned with HTTP 400 May 28 13:02:05 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1177/2381] 10.27.203.238 () {64 vars in 1319 bytes} [Tue May 28 13:02:05 2024] POST /share/v1/e0a7371d578542ecbb1cfaa96bd52e2d/shares => generated 120 bytes in 11 msecs (HTTP/1.1 400) 6 headers in 239 bytes (1 switches on core 0) May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-2ed16e61-e28d-490d-9913-3db180adb933 tempest-SharesRenameTest-200895555 tempest-SharesRenameTest-200895555-project-admin] Could not find user: bd43e5d1c359462d807b6e8a8581fa73.: keystone.exception.UserNotFound: Could not find user: bd43e5d1c359462d807b6e8a8581fa73. May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: bd43e5d1c359462d807b6e8a8581fa73. May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1625/3277] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:02:05 2024] DELETE /identity/v3/users/bd43e5d1c359462d807b6e8a8581fa73 => generated 110 bytes in 26 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:02:05 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-56977d11-5f2f-4bc8-9bf4-76c70016f22b tempest-SharesAPIOnlyNegativeTest-1940122175 tempest-SharesAPIOnlyNegativeTest-1940122175-project-member] POST http://10.27.203.238/share/v1/e0a7371d578542ecbb1cfaa96bd52e2d/shares May 28 13:02:05 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-56977d11-5f2f-4bc8-9bf4-76c70016f22b tempest-SharesAPIOnlyNegativeTest-1940122175 tempest-SharesAPIOnlyNegativeTest-1940122175-project-member] Action: 'create', calling method: ShareMixin.create, body: {"share": {"share_proto": "nfs", "description": "tempest-tempest-created-share-desc-1159470277", "snapshot_id": null, "name": "tempest-tempest-created-share-1572179046", "size": 1, "metadata": {}, "is_public": "truebar", "share_type": "1a2d01e9-8868-4620-87f7-689fe7e830b5"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:02:05 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-56977d11-5f2f-4bc8-9bf4-76c70016f22b tempest-SharesAPIOnlyNegativeTest-1940122175 tempest-SharesAPIOnlyNegativeTest-1940122175-project-member] http://10.27.203.238/share/v1/e0a7371d578542ecbb1cfaa96bd52e2d/shares returned with HTTP 400 May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0372ab4a-856a-4aa4-8e14-0e1e5b97d1a4 tempest-SharesRenameTest-200895555 tempest-SharesRenameTest-200895555-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:05 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1205/2382] 10.27.203.238 () {64 vars in 1319 bytes} [Tue May 28 13:02:05 2024] POST /share/v1/e0a7371d578542ecbb1cfaa96bd52e2d/shares => generated 168 bytes in 7 msecs (HTTP/1.1 400) 6 headers in 239 bytes (1 switches on core 0) May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0372ab4a-856a-4aa4-8e14-0e1e5b97d1a4 tempest-SharesRenameTest-200895555 tempest-SharesRenameTest-200895555-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:05 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-85474a41-8361-4f06-9262-161650dcb0c1 tempest-SharesAPIOnlyNegativeTest-1940122175 tempest-SharesAPIOnlyNegativeTest-1940122175-project-member] POST http://10.27.203.238/share/v1/e0a7371d578542ecbb1cfaa96bd52e2d/shares May 28 13:02:05 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-85474a41-8361-4f06-9262-161650dcb0c1 tempest-SharesAPIOnlyNegativeTest-1940122175 tempest-SharesAPIOnlyNegativeTest-1940122175-project-member] Action: 'create', calling method: ShareMixin.create, body: {"share": {"share_proto": "nfs", "description": "tempest-tempest-created-share-desc-1895352677", "snapshot_id": null, "name": "tempest-tempest-created-share-1947715628", "size": 0, "metadata": {}, "is_public": false, "share_type": "1a2d01e9-8868-4620-87f7-689fe7e830b5"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7e327b-c1c4-4f31-9dd0-a7b7f6d75339 tempest-SharesRenameTest-200895555 tempest-SharesRenameTest-200895555-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72a7fdfdc5841c5a56e1602f6e4c8b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bff0d77ff4df42cb942ff6e8fe5d9115', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7e327b-c1c4-4f31-9dd0-a7b7f6d75339 tempest-SharesRenameTest-200895555 tempest-SharesRenameTest-200895555-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7e327b-c1c4-4f31-9dd0-a7b7f6d75339 tempest-SharesRenameTest-200895555 tempest-SharesRenameTest-200895555-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7e327b-c1c4-4f31-9dd0-a7b7f6d75339 tempest-SharesRenameTest-200895555 tempest-SharesRenameTest-200895555-project-admin] PATH_INFO: `/v3/users/18c7667276334e98bdd11d2b9d1875cc` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:05 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.v1.shares [None req-85474a41-8361-4f06-9262-161650dcb0c1 tempest-SharesAPIOnlyNegativeTest-1940122175 tempest-SharesAPIOnlyNegativeTest-1940122175-project-member] Create NFS share of 0 GB May 28 13:02:05 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-85474a41-8361-4f06-9262-161650dcb0c1 tempest-SharesAPIOnlyNegativeTest-1940122175 tempest-SharesAPIOnlyNegativeTest-1940122175-project-member] http://10.27.203.238/share/v1/e0a7371d578542ecbb1cfaa96bd52e2d/shares returned with HTTP 400 May 28 13:02:05 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1178/2383] 10.27.203.238 () {64 vars in 1319 bytes} [Tue May 28 13:02:05 2024] POST /share/v1/e0a7371d578542ecbb1cfaa96bd52e2d/shares => generated 121 bytes in 11 msecs (HTTP/1.1 400) 6 headers in 239 bytes (1 switches on core 0) May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7e327b-c1c4-4f31-9dd0-a7b7f6d75339 tempest-SharesRenameTest-200895555 tempest-SharesRenameTest-200895555-project-admin] RBAC: Authorizing `identity:delete_user(user_id=18c7667276334e98bdd11d2b9d1875cc)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:05 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-f6365897-3469-4c98-a12f-1e36274e58e6 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.040s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7e327b-c1c4-4f31-9dd0-a7b7f6d75339 tempest-SharesRenameTest-200895555 tempest-SharesRenameTest-200895555-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:05 l75lg1-v1 manila-share[98474]: INFO manila.share.access [None req-f6365897-3469-4c98-a12f-1e36274e58e6 tempest-ShareRulesTest-1530341375 None] Access rules were successfully modified for share instance f7e47502-a0f7-44de-953d-b7b5697ae0b2 belonging to share b330db31-7766-443d-9c19-26fe349665aa. May 28 13:02:05 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-93c6482f-987b-4e4a-a8f5-79276e13e8a0 tempest-SharesAPIOnlyNegativeTest-1940122175 tempest-SharesAPIOnlyNegativeTest-1940122175-project-member] POST http://10.27.203.238/share/v1/e0a7371d578542ecbb1cfaa96bd52e2d/snapshots May 28 13:02:05 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-93c6482f-987b-4e4a-a8f5-79276e13e8a0 tempest-SharesAPIOnlyNegativeTest-1940122175 tempest-SharesAPIOnlyNegativeTest-1940122175-project-member] Action: 'create', calling method: ShareSnapshotMixin.create, body: {"snapshot": {"name": "tempest-tempest-created-share-snap-1282659508", "force": false, "description": "tempest-tempest-created-share-snap-desc-1075118089", "share_id": "wrong_share_id"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-5f7e327b-c1c4-4f31-9dd0-a7b7f6d75339 tempest-SharesRenameTest-200895555 tempest-SharesRenameTest-200895555-project-admin] Could not find user: 18c7667276334e98bdd11d2b9d1875cc.: keystone.exception.UserNotFound: Could not find user: 18c7667276334e98bdd11d2b9d1875cc. May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 18c7667276334e98bdd11d2b9d1875cc. May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1653/3278] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:02:05 2024] DELETE /identity/v3/users/18c7667276334e98bdd11d2b9d1875cc => generated 110 bytes in 27 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed16e61-e28d-490d-9913-3db180adb933 tempest-SharesRenameTest-200895555 tempest-SharesRenameTest-200895555-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:05 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault [None req-93c6482f-987b-4e4a-a8f5-79276e13e8a0 tempest-SharesAPIOnlyNegativeTest-1940122175 tempest-SharesAPIOnlyNegativeTest-1940122175-project-member] Caught error: Resource could not be found.: manila.exception.NotFound: Resource could not be found. May 28 13:02:05 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault Traceback (most recent call last): May 28 13:02:05 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/api/middleware/fault.py", line 76, in __call__ May 28 13:02:05 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault return req.get_response(self.application) May 28 13:02:05 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/request.py", line 1313, in send May 28 13:02:05 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault status, headers, app_iter = self.call_application( May 28 13:02:05 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/request.py", line 1278, in call_application May 28 13:02:05 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault app_iter = application(self.environ, start_response) May 28 13:02:05 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 129, in __call__ May 28 13:02:05 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault resp = self.call_func(req, *args, **kw) May 28 13:02:05 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 193, in call_func May 28 13:02:05 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault return self.func(req, *args, **kwargs) May 28 13:02:05 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_middleware/base.py", line 124, in __call__ May 28 13:02:05 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault response = req.get_response(self.application) May 28 13:02:05 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/request.py", line 1313, in send May 28 13:02:05 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault status, headers, app_iter = self.call_application( May 28 13:02:05 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/request.py", line 1278, in call_application May 28 13:02:05 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault app_iter = application(self.environ, start_response) May 28 13:02:05 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 143, in __call__ May 28 13:02:05 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault return resp(environ, start_response) May 28 13:02:05 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 129, in __call__ May 28 13:02:05 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault resp = self.call_func(req, *args, **kw) May 28 13:02:05 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 193, in call_func May 28 13:02:05 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault return self.func(req, *args, **kwargs) May 28 13:02:05 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/osprofiler/web.py", line 111, in __call__ May 28 13:02:05 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault return request.get_response(self.application) May 28 13:02:05 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/request.py", line 1313, in send May 28 13:02:05 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault status, headers, app_iter = self.call_application( May 28 13:02:05 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/request.py", line 1278, in call_application May 28 13:02:05 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault app_iter = application(self.environ, start_response) May 28 13:02:05 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 129, in __call__ May 28 13:02:05 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault resp = self.call_func(req, *args, **kw) May 28 13:02:05 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 193, in call_func May 28 13:02:05 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault return self.func(req, *args, **kwargs) May 28 13:02:05 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py", line 340, in __call__ May 28 13:02:05 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault response = req.get_response(self._app) May 28 13:02:05 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/request.py", line 1313, in send May 28 13:02:05 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault status, headers, app_iter = self.call_application( May 28 13:02:05 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/request.py", line 1278, in call_application May 28 13:02:05 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault app_iter = application(self.environ, start_response) May 28 13:02:05 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 143, in __call__ May 28 13:02:05 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault return resp(environ, start_response) May 28 13:02:05 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 143, in __call__ May 28 13:02:05 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault return resp(environ, start_response) May 28 13:02:05 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/routes/middleware.py", line 153, in __call__ May 28 13:02:05 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault response = self.app(environ, start_response) May 28 13:02:05 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 143, in __call__ May 28 13:02:05 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault return resp(environ, start_response) May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed16e61-e28d-490d-9913-3db180adb933 tempest-SharesRenameTest-200895555 tempest-SharesRenameTest-200895555-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:05 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 129, in __call__ May 28 13:02:05 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault resp = self.call_func(req, *args, **kw) May 28 13:02:05 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 193, in call_func May 28 13:02:05 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault return self.func(req, *args, **kwargs) May 28 13:02:05 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/api/openstack/wsgi.py", line 764, in __call__ May 28 13:02:05 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault return self._process_stack(request, action, action_args, May 28 13:02:05 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/api/openstack/wsgi.py", line 829, in _process_stack May 28 13:02:05 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault action_result = self.dispatch(meth, request, action_args) May 28 13:02:05 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/api/openstack/wsgi.py", line 924, in dispatch May 28 13:02:05 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault return method(req=request, **action_args) May 28 13:02:05 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/api/v1/share_snapshots.py", line 218, in create May 28 13:02:05 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault share = self.share_api.get(context, share_id) May 28 13:02:05 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/share/api.py", line 2211, in get May 28 13:02:05 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault rv = self.db.share_get(context, share_id) May 28 13:02:05 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/db/api.py", line 404, in share_get May 28 13:02:05 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault return IMPL.share_get(context, share_id, **kwargs) May 28 13:02:05 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/db/sqlalchemy/api.py", line 166, in wrapper May 28 13:02:05 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault return f(*args, **kwargs) May 28 13:02:05 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/enginefacade.py", line 998, in wrapper May 28 13:02:05 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault return fn(*args, **kwargs) May 28 13:02:05 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/db/sqlalchemy/api.py", line 2367, in share_get May 28 13:02:05 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault return _share_get(context, share_id, **kwargs) May 28 13:02:05 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/db/sqlalchemy/api.py", line 2378, in _share_get May 28 13:02:05 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault raise exception.NotFound() May 28 13:02:05 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault manila.exception.NotFound: Resource could not be found. May 28 13:02:05 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault May 28 13:02:05 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.middleware.fault [None req-93c6482f-987b-4e4a-a8f5-79276e13e8a0 tempest-SharesAPIOnlyNegativeTest-1940122175 tempest-SharesAPIOnlyNegativeTest-1940122175-project-member] http://10.27.203.238/share/v1/e0a7371d578542ecbb1cfaa96bd52e2d/snapshots returned with HTTP 404 May 28 13:02:05 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1206/2384] 10.27.203.238 () {64 vars in 1328 bytes} [Tue May 28 13:02:05 2024] POST /share/v1/e0a7371d578542ecbb1cfaa96bd52e2d/snapshots => generated 84 bytes in 12 msecs (HTTP/1.1 404) 6 headers in 236 bytes (1 switches on core 0) May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842708b7-2303-46a9-85c5-0aae1fbcc929 tempest-SharesRenameTest-200895555 tempest-SharesRenameTest-200895555-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72a7fdfdc5841c5a56e1602f6e4c8b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bff0d77ff4df42cb942ff6e8fe5d9115', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842708b7-2303-46a9-85c5-0aae1fbcc929 tempest-SharesRenameTest-200895555 tempest-SharesRenameTest-200895555-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842708b7-2303-46a9-85c5-0aae1fbcc929 tempest-SharesRenameTest-200895555 tempest-SharesRenameTest-200895555-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842708b7-2303-46a9-85c5-0aae1fbcc929 tempest-SharesRenameTest-200895555 tempest-SharesRenameTest-200895555-project-admin] PATH_INFO: `/v3/users/db0396a316ea4c5697d47df053fccbe4` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:05 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-e1503c4a-891b-4429-9f47-1d90e722ba00 tempest-SharesAPIOnlyNegativeTest-1940122175 tempest-SharesAPIOnlyNegativeTest-1940122175-project-member] DELETE http://10.27.203.238/share/v1/e0a7371d578542ecbb1cfaa96bd52e2d/shares/wrong_share_id May 28 13:02:05 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-e1503c4a-891b-4429-9f47-1d90e722ba00 tempest-SharesAPIOnlyNegativeTest-1940122175 tempest-SharesAPIOnlyNegativeTest-1940122175-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:02:05 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-e1503c4a-891b-4429-9f47-1d90e722ba00 tempest-SharesAPIOnlyNegativeTest-1940122175 tempest-SharesAPIOnlyNegativeTest-1940122175-project-member] Calling method 'ShareMixin.delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:02:05 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.v1.shares [None req-e1503c4a-891b-4429-9f47-1d90e722ba00 tempest-SharesAPIOnlyNegativeTest-1940122175 tempest-SharesAPIOnlyNegativeTest-1940122175-project-member] Delete share with id: wrong_share_id May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842708b7-2303-46a9-85c5-0aae1fbcc929 tempest-SharesRenameTest-200895555 tempest-SharesRenameTest-200895555-project-admin] RBAC: Authorizing `identity:delete_user(user_id=db0396a316ea4c5697d47df053fccbe4)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842708b7-2303-46a9-85c5-0aae1fbcc929 tempest-SharesRenameTest-200895555 tempest-SharesRenameTest-200895555-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:05 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-e1503c4a-891b-4429-9f47-1d90e722ba00 tempest-SharesAPIOnlyNegativeTest-1940122175 tempest-SharesAPIOnlyNegativeTest-1940122175-project-member] HTTP exception thrown: The resource could not be found. May 28 13:02:05 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-e1503c4a-891b-4429-9f47-1d90e722ba00 tempest-SharesAPIOnlyNegativeTest-1940122175 tempest-SharesAPIOnlyNegativeTest-1940122175-project-member] http://10.27.203.238/share/v1/e0a7371d578542ecbb1cfaa96bd52e2d/shares/wrong_share_id returned with HTTP 404 May 28 13:02:05 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1179/2385] 10.27.203.238 () {62 vars in 1345 bytes} [Tue May 28 13:02:05 2024] DELETE /share/v1/e0a7371d578542ecbb1cfaa96bd52e2d/shares/wrong_share_id => generated 78 bytes in 12 msecs (HTTP/1.1 404) 6 headers in 236 bytes (1 switches on core 0) May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-842708b7-2303-46a9-85c5-0aae1fbcc929 tempest-SharesRenameTest-200895555 tempest-SharesRenameTest-200895555-project-admin] Could not find user: db0396a316ea4c5697d47df053fccbe4.: keystone.exception.UserNotFound: Could not find user: db0396a316ea4c5697d47df053fccbe4. May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: db0396a316ea4c5697d47df053fccbe4. May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1626/3279] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:02:05 2024] DELETE /identity/v3/users/db0396a316ea4c5697d47df053fccbe4 => generated 110 bytes in 25 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:02:05 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1207/2386] 10.27.203.238 () {62 vars in 1303 bytes} [Tue May 28 13:02:05 2024] DELETE /share/v1/e0a7371d578542ecbb1cfaa96bd52e2d/shares/ => generated 112 bytes in 3 msecs (HTTP/1.1 404) 3 headers in 98 bytes (1 switches on core 0) May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7e327b-c1c4-4f31-9dd0-a7b7f6d75339 tempest-SharesRenameTest-200895555 tempest-SharesRenameTest-200895555-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7e327b-c1c4-4f31-9dd0-a7b7f6d75339 tempest-SharesRenameTest-200895555 tempest-SharesRenameTest-200895555-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:05 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-e4dad3db-f4cc-4a15-bf40-bf8ef9b08ef0 tempest-SharesAPIOnlyNegativeTest-1940122175 tempest-SharesAPIOnlyNegativeTest-1940122175-project-member] DELETE http://10.27.203.238/share/v1/e0a7371d578542ecbb1cfaa96bd52e2d/snapshots/wrong_share_id May 28 13:02:05 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-e4dad3db-f4cc-4a15-bf40-bf8ef9b08ef0 tempest-SharesAPIOnlyNegativeTest-1940122175 tempest-SharesAPIOnlyNegativeTest-1940122175-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:02:05 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-e4dad3db-f4cc-4a15-bf40-bf8ef9b08ef0 tempest-SharesAPIOnlyNegativeTest-1940122175 tempest-SharesAPIOnlyNegativeTest-1940122175-project-member] Calling method 'ShareSnapshotMixin.delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:02:05 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.v1.share_snapshots [None req-e4dad3db-f4cc-4a15-bf40-bf8ef9b08ef0 tempest-SharesAPIOnlyNegativeTest-1940122175 tempest-SharesAPIOnlyNegativeTest-1940122175-project-member] Delete snapshot with id: wrong_share_id May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b781444-1b5a-4bd5-9378-cebd91516245 tempest-SharesRenameTest-200895555 tempest-SharesRenameTest-200895555-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72a7fdfdc5841c5a56e1602f6e4c8b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bff0d77ff4df42cb942ff6e8fe5d9115', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b781444-1b5a-4bd5-9378-cebd91516245 tempest-SharesRenameTest-200895555 tempest-SharesRenameTest-200895555-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b781444-1b5a-4bd5-9378-cebd91516245 tempest-SharesRenameTest-200895555 tempest-SharesRenameTest-200895555-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b781444-1b5a-4bd5-9378-cebd91516245 tempest-SharesRenameTest-200895555 tempest-SharesRenameTest-200895555-project-admin] PATH_INFO: `/v3/users/8408bca6708d4e57b4e6ae91fa7eb8e3` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b781444-1b5a-4bd5-9378-cebd91516245 tempest-SharesRenameTest-200895555 tempest-SharesRenameTest-200895555-project-admin] RBAC: Authorizing `identity:delete_user(user_id=8408bca6708d4e57b4e6ae91fa7eb8e3)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b781444-1b5a-4bd5-9378-cebd91516245 tempest-SharesRenameTest-200895555 tempest-SharesRenameTest-200895555-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:05 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-e4dad3db-f4cc-4a15-bf40-bf8ef9b08ef0 tempest-SharesAPIOnlyNegativeTest-1940122175 tempest-SharesAPIOnlyNegativeTest-1940122175-project-member] HTTP exception thrown: The resource could not be found. May 28 13:02:05 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-e4dad3db-f4cc-4a15-bf40-bf8ef9b08ef0 tempest-SharesAPIOnlyNegativeTest-1940122175 tempest-SharesAPIOnlyNegativeTest-1940122175-project-member] http://10.27.203.238/share/v1/e0a7371d578542ecbb1cfaa96bd52e2d/snapshots/wrong_share_id returned with HTTP 404 May 28 13:02:05 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1180/2387] 10.27.203.238 () {62 vars in 1354 bytes} [Tue May 28 13:02:05 2024] DELETE /share/v1/e0a7371d578542ecbb1cfaa96bd52e2d/snapshots/wrong_share_id => generated 78 bytes in 17 msecs (HTTP/1.1 404) 6 headers in 236 bytes (1 switches on core 0) May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-9b781444-1b5a-4bd5-9378-cebd91516245 tempest-SharesRenameTest-200895555 tempest-SharesRenameTest-200895555-project-admin] Could not find user: 8408bca6708d4e57b4e6ae91fa7eb8e3.: keystone.exception.UserNotFound: Could not find user: 8408bca6708d4e57b4e6ae91fa7eb8e3. May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 8408bca6708d4e57b4e6ae91fa7eb8e3. May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1654/3280] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:02:05 2024] DELETE /identity/v3/users/8408bca6708d4e57b4e6ae91fa7eb8e3 => generated 110 bytes in 24 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:02:05 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-20a1154d-874a-44c9-a949-a970230c6a27 tempest-SharesAPIOnlyNegativeTest-1940122175 tempest-SharesAPIOnlyNegativeTest-1940122175-project-member] GET http://10.27.203.238/share/v1/e0a7371d578542ecbb1cfaa96bd52e2d/shares/wrong_share_id May 28 13:02:05 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-20a1154d-874a-44c9-a949-a970230c6a27 tempest-SharesAPIOnlyNegativeTest-1940122175 tempest-SharesAPIOnlyNegativeTest-1940122175-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:02:05 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-20a1154d-874a-44c9-a949-a970230c6a27 tempest-SharesAPIOnlyNegativeTest-1940122175 tempest-SharesAPIOnlyNegativeTest-1940122175-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842708b7-2303-46a9-85c5-0aae1fbcc929 tempest-SharesRenameTest-200895555 tempest-SharesRenameTest-200895555-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842708b7-2303-46a9-85c5-0aae1fbcc929 tempest-SharesRenameTest-200895555 tempest-SharesRenameTest-200895555-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:05 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-20a1154d-874a-44c9-a949-a970230c6a27 tempest-SharesAPIOnlyNegativeTest-1940122175 tempest-SharesAPIOnlyNegativeTest-1940122175-project-member] HTTP exception thrown: The resource could not be found. May 28 13:02:05 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-20a1154d-874a-44c9-a949-a970230c6a27 tempest-SharesAPIOnlyNegativeTest-1940122175 tempest-SharesAPIOnlyNegativeTest-1940122175-project-member] http://10.27.203.238/share/v1/e0a7371d578542ecbb1cfaa96bd52e2d/shares/wrong_share_id returned with HTTP 404 May 28 13:02:05 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1208/2388] 10.27.203.238 () {62 vars in 1342 bytes} [Tue May 28 13:02:05 2024] GET /share/v1/e0a7371d578542ecbb1cfaa96bd52e2d/shares/wrong_share_id => generated 78 bytes in 11 msecs (HTTP/1.1 404) 6 headers in 236 bytes (1 switches on core 0) May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2ed7f9-28a9-490e-8a75-129ab191306c tempest-SharesRenameTest-200895555 tempest-SharesRenameTest-200895555-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72a7fdfdc5841c5a56e1602f6e4c8b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bff0d77ff4df42cb942ff6e8fe5d9115', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2ed7f9-28a9-490e-8a75-129ab191306c tempest-SharesRenameTest-200895555 tempest-SharesRenameTest-200895555-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2ed7f9-28a9-490e-8a75-129ab191306c tempest-SharesRenameTest-200895555 tempest-SharesRenameTest-200895555-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:05 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2ed7f9-28a9-490e-8a75-129ab191306c tempest-SharesRenameTest-200895555 tempest-SharesRenameTest-200895555-project-admin] PATH_INFO: `/v3/users/e593bd019bc24f30b8b269cbdd2e3494` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:06 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1181/2389] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 13:02:06 2024] GET /share/v1/e0a7371d578542ecbb1cfaa96bd52e2d/shares/ => generated 112 bytes in 3 msecs (HTTP/1.1 404) 3 headers in 98 bytes (1 switches on core 0) May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2ed7f9-28a9-490e-8a75-129ab191306c tempest-SharesRenameTest-200895555 tempest-SharesRenameTest-200895555-project-admin] RBAC: Authorizing `identity:delete_user(user_id=e593bd019bc24f30b8b269cbdd2e3494)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2ed7f9-28a9-490e-8a75-129ab191306c tempest-SharesRenameTest-200895555 tempest-SharesRenameTest-200895555-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:06 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-dd65fb2a-76f8-4c7e-a22e-54140ae652bb tempest-SharesAPIOnlyNegativeTest-1940122175 tempest-SharesAPIOnlyNegativeTest-1940122175-project-member] GET http://10.27.203.238/share/v1/e0a7371d578542ecbb1cfaa96bd52e2d/shares?share_server_id=12345 May 28 13:02:06 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-dd65fb2a-76f8-4c7e-a22e-54140ae652bb tempest-SharesAPIOnlyNegativeTest-1940122175 tempest-SharesAPIOnlyNegativeTest-1940122175-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:02:06 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-dd65fb2a-76f8-4c7e-a22e-54140ae652bb tempest-SharesAPIOnlyNegativeTest-1940122175 tempest-SharesAPIOnlyNegativeTest-1940122175-project-member] Calling method 'ShareMixin.index' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:02:06 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.common [None req-dd65fb2a-76f8-4c7e-a22e-54140ae652bb tempest-SharesAPIOnlyNegativeTest-1940122175 tempest-SharesAPIOnlyNegativeTest-1940122175-project-member] Removing options '' from query {{(pid=98329) remove_invalid_options /opt/stack/manila/manila/api/common.py:441}} May 28 13:02:06 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.share.api [None req-dd65fb2a-76f8-4c7e-a22e-54140ae652bb tempest-SharesAPIOnlyNegativeTest-1940122175 tempest-SharesAPIOnlyNegativeTest-1940122175-project-member] Searching for shares by: {'share_server_id': '12345'} {{(pid=98329) _get_all /opt/stack/manila/manila/share/api.py:2235}} May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-5c2ed7f9-28a9-490e-8a75-129ab191306c tempest-SharesRenameTest-200895555 tempest-SharesRenameTest-200895555-project-admin] Could not find user: e593bd019bc24f30b8b269cbdd2e3494.: keystone.exception.UserNotFound: Could not find user: e593bd019bc24f30b8b269cbdd2e3494. May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: e593bd019bc24f30b8b269cbdd2e3494. May 28 13:02:06 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.policy [None req-dd65fb2a-76f8-4c7e-a22e-54140ae652bb tempest-SharesAPIOnlyNegativeTest-1940122175 tempest-SharesAPIOnlyNegativeTest-1940122175-project-member] Policy check for share:list_by_share_server_id failed with credentials {'is_admin': False, 'user_id': 'cb7b1fac48f54f4c8c2b7997d17766e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a7371d578542ecbb1cfaa96bd52e2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98329) authorize /opt/stack/manila/manila/policy.py:208}} May 28 13:02:06 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-dd65fb2a-76f8-4c7e-a22e-54140ae652bb tempest-SharesAPIOnlyNegativeTest-1940122175 tempest-SharesAPIOnlyNegativeTest-1940122175-project-member] http://10.27.203.238/share/v1/e0a7371d578542ecbb1cfaa96bd52e2d/shares?share_server_id=12345 returned with HTTP 403 May 28 13:02:06 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1209/2390] 10.27.203.238 () {62 vars in 1340 bytes} [Tue May 28 13:02:06 2024] GET /share/v1/e0a7371d578542ecbb1cfaa96bd52e2d/shares?share_server_id=12345 => generated 110 bytes in 8 msecs (HTTP/1.1 403) 6 headers in 237 bytes (1 switches on core 0) May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1627/3281] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:02:05 2024] DELETE /identity/v3/users/e593bd019bc24f30b8b269cbdd2e3494 => generated 110 bytes in 24 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b781444-1b5a-4bd5-9378-cebd91516245 tempest-SharesRenameTest-200895555 tempest-SharesRenameTest-200895555-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b781444-1b5a-4bd5-9378-cebd91516245 tempest-SharesRenameTest-200895555 tempest-SharesRenameTest-200895555-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:06 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-3d0f6ee1-5e16-4ccc-89ae-55b2ad4a030e tempest-SharesAPIOnlyNegativeTest-1940122175 tempest-SharesAPIOnlyNegativeTest-1940122175-project-member] GET http://10.27.203.238/share/v2/e0a7371d578542ecbb1cfaa96bd52e2d/shares?host=fake_host May 28 13:02:06 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-3d0f6ee1-5e16-4ccc-89ae-55b2ad4a030e tempest-SharesAPIOnlyNegativeTest-1940122175 tempest-SharesAPIOnlyNegativeTest-1940122175-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:02:06 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-3d0f6ee1-5e16-4ccc-89ae-55b2ad4a030e tempest-SharesAPIOnlyNegativeTest-1940122175 tempest-SharesAPIOnlyNegativeTest-1940122175-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ad03fd-51e8-45f4-a64c-1528e34c3fc5 tempest-SharesRenameTest-200895555 tempest-SharesRenameTest-200895555-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72a7fdfdc5841c5a56e1602f6e4c8b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bff0d77ff4df42cb942ff6e8fe5d9115', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ad03fd-51e8-45f4-a64c-1528e34c3fc5 tempest-SharesRenameTest-200895555 tempest-SharesRenameTest-200895555-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ad03fd-51e8-45f4-a64c-1528e34c3fc5 tempest-SharesRenameTest-200895555 tempest-SharesRenameTest-200895555-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ad03fd-51e8-45f4-a64c-1528e34c3fc5 tempest-SharesRenameTest-200895555 tempest-SharesRenameTest-200895555-project-admin] PATH_INFO: `/v3/users/eb30733c944e480eb147435ead450b9c` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:06 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.common [None req-3d0f6ee1-5e16-4ccc-89ae-55b2ad4a030e tempest-SharesAPIOnlyNegativeTest-1940122175 tempest-SharesAPIOnlyNegativeTest-1940122175-project-member] Removing options '' from query {{(pid=98330) remove_invalid_options /opt/stack/manila/manila/api/common.py:441}} May 28 13:02:06 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.share.api [None req-3d0f6ee1-5e16-4ccc-89ae-55b2ad4a030e tempest-SharesAPIOnlyNegativeTest-1940122175 tempest-SharesAPIOnlyNegativeTest-1940122175-project-member] Searching for shares by: {'host': 'fake_host'} {{(pid=98330) _get_all /opt/stack/manila/manila/share/api.py:2235}} May 28 13:02:06 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.policy [None req-3d0f6ee1-5e16-4ccc-89ae-55b2ad4a030e tempest-SharesAPIOnlyNegativeTest-1940122175 tempest-SharesAPIOnlyNegativeTest-1940122175-project-member] Policy check for share:list_by_host failed with credentials {'is_admin': False, 'user_id': 'cb7b1fac48f54f4c8c2b7997d17766e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a7371d578542ecbb1cfaa96bd52e2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98330) authorize /opt/stack/manila/manila/policy.py:208}} May 28 13:02:06 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-3d0f6ee1-5e16-4ccc-89ae-55b2ad4a030e tempest-SharesAPIOnlyNegativeTest-1940122175 tempest-SharesAPIOnlyNegativeTest-1940122175-project-member] http://10.27.203.238/share/v2/e0a7371d578542ecbb1cfaa96bd52e2d/shares?host=fake_host returned with HTTP 403 May 28 13:02:06 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1182/2391] 10.27.203.238 () {64 vars in 1369 bytes} [Tue May 28 13:02:06 2024] GET /share/v2/e0a7371d578542ecbb1cfaa96bd52e2d/shares?host=fake_host => generated 99 bytes in 10 msecs (HTTP/1.1 403) 6 headers in 237 bytes (1 switches on core 0) May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ad03fd-51e8-45f4-a64c-1528e34c3fc5 tempest-SharesRenameTest-200895555 tempest-SharesRenameTest-200895555-project-admin] RBAC: Authorizing `identity:delete_user(user_id=eb30733c944e480eb147435ead450b9c)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ad03fd-51e8-45f4-a64c-1528e34c3fc5 tempest-SharesRenameTest-200895555 tempest-SharesRenameTest-200895555-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:06 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-e77fa564-f636-4f15-a166-409b37f78f26 tempest-SharesAPIOnlyNegativeTest-1940122175 tempest-SharesAPIOnlyNegativeTest-1940122175-project-member] GET http://10.27.203.238/share/v1/e0a7371d578542ecbb1cfaa96bd52e2d/shares/detail?share_server_id=fake_share_server_id May 28 13:02:06 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-e77fa564-f636-4f15-a166-409b37f78f26 tempest-SharesAPIOnlyNegativeTest-1940122175 tempest-SharesAPIOnlyNegativeTest-1940122175-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:02:06 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-e77fa564-f636-4f15-a166-409b37f78f26 tempest-SharesAPIOnlyNegativeTest-1940122175 tempest-SharesAPIOnlyNegativeTest-1940122175-project-member] Calling method 'ShareMixin.detail' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:02:06 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.common [None req-e77fa564-f636-4f15-a166-409b37f78f26 tempest-SharesAPIOnlyNegativeTest-1940122175 tempest-SharesAPIOnlyNegativeTest-1940122175-project-member] Removing options '' from query {{(pid=98329) remove_invalid_options /opt/stack/manila/manila/api/common.py:441}} May 28 13:02:06 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.share.api [None req-e77fa564-f636-4f15-a166-409b37f78f26 tempest-SharesAPIOnlyNegativeTest-1940122175 tempest-SharesAPIOnlyNegativeTest-1940122175-project-member] Searching for shares by: {'share_server_id': 'fake_share_server_id'} {{(pid=98329) _get_all /opt/stack/manila/manila/share/api.py:2235}} May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-89ad03fd-51e8-45f4-a64c-1528e34c3fc5 tempest-SharesRenameTest-200895555 tempest-SharesRenameTest-200895555-project-admin] Could not find user: eb30733c944e480eb147435ead450b9c.: keystone.exception.UserNotFound: Could not find user: eb30733c944e480eb147435ead450b9c. May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: eb30733c944e480eb147435ead450b9c. May 28 13:02:06 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.policy [None req-e77fa564-f636-4f15-a166-409b37f78f26 tempest-SharesAPIOnlyNegativeTest-1940122175 tempest-SharesAPIOnlyNegativeTest-1940122175-project-member] Policy check for share:list_by_share_server_id failed with credentials {'is_admin': False, 'user_id': 'cb7b1fac48f54f4c8c2b7997d17766e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a7371d578542ecbb1cfaa96bd52e2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98329) authorize /opt/stack/manila/manila/policy.py:208}} May 28 13:02:06 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-e77fa564-f636-4f15-a166-409b37f78f26 tempest-SharesAPIOnlyNegativeTest-1940122175 tempest-SharesAPIOnlyNegativeTest-1940122175-project-member] http://10.27.203.238/share/v1/e0a7371d578542ecbb1cfaa96bd52e2d/shares/detail?share_server_id=fake_share_server_id returned with HTTP 403 May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1655/3282] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:02:06 2024] DELETE /identity/v3/users/eb30733c944e480eb147435ead450b9c => generated 110 bytes in 24 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:02:06 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1210/2392] 10.27.203.238 () {62 vars in 1391 bytes} [Tue May 28 13:02:06 2024] GET /share/v1/e0a7371d578542ecbb1cfaa96bd52e2d/shares/detail?share_server_id=fake_share_server_id => generated 110 bytes in 11 msecs (HTTP/1.1 403) 6 headers in 237 bytes (1 switches on core 0) May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2ed7f9-28a9-490e-8a75-129ab191306c tempest-SharesRenameTest-200895555 tempest-SharesRenameTest-200895555-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2ed7f9-28a9-490e-8a75-129ab191306c tempest-SharesRenameTest-200895555 tempest-SharesRenameTest-200895555-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:06 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-158c3202-946b-494f-87f9-fd50b20cd34b tempest-SharesAPIOnlyNegativeTest-1940122175 tempest-SharesAPIOnlyNegativeTest-1940122175-project-member] POST http://10.27.203.238/share/v1/e0a7371d578542ecbb1cfaa96bd52e2d/os-share-manage May 28 13:02:06 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-158c3202-946b-494f-87f9-fd50b20cd34b tempest-SharesAPIOnlyNegativeTest-1940122175 tempest-SharesAPIOnlyNegativeTest-1940122175-project-member] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share": {"export_path": "/export/path", "service_host": "fake-host", "protocol": "nfs", "share_type": "fake-type", "name": null, "description": null}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:02:06 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.policy [None req-158c3202-946b-494f-87f9-fd50b20cd34b tempest-SharesAPIOnlyNegativeTest-1940122175 tempest-SharesAPIOnlyNegativeTest-1940122175-project-member] Policy check for share:manage failed with credentials {'is_admin': False, 'user_id': 'cb7b1fac48f54f4c8c2b7997d17766e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a7371d578542ecbb1cfaa96bd52e2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98330) authorize /opt/stack/manila/manila/policy.py:208}} May 28 13:02:06 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-158c3202-946b-494f-87f9-fd50b20cd34b tempest-SharesAPIOnlyNegativeTest-1940122175 tempest-SharesAPIOnlyNegativeTest-1940122175-project-member] HTTP exception thrown: Access was denied to this resource. May 28 13:02:06 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-158c3202-946b-494f-87f9-fd50b20cd34b tempest-SharesAPIOnlyNegativeTest-1940122175 tempest-SharesAPIOnlyNegativeTest-1940122175-project-member] http://10.27.203.238/share/v1/e0a7371d578542ecbb1cfaa96bd52e2d/os-share-manage returned with HTTP 403 May 28 13:02:06 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1183/2393] 10.27.203.238 () {64 vars in 1346 bytes} [Tue May 28 13:02:06 2024] POST /share/v1/e0a7371d578542ecbb1cfaa96bd52e2d/os-share-manage => generated 78 bytes in 6 msecs (HTTP/1.1 403) 6 headers in 236 bytes (1 switches on core 0) May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0919d6-accf-4efd-afbc-b05deb4a58ab tempest-SharesRenameTest-200895555 tempest-SharesRenameTest-200895555-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72a7fdfdc5841c5a56e1602f6e4c8b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bff0d77ff4df42cb942ff6e8fe5d9115', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0919d6-accf-4efd-afbc-b05deb4a58ab tempest-SharesRenameTest-200895555 tempest-SharesRenameTest-200895555-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0919d6-accf-4efd-afbc-b05deb4a58ab tempest-SharesRenameTest-200895555 tempest-SharesRenameTest-200895555-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0919d6-accf-4efd-afbc-b05deb4a58ab tempest-SharesRenameTest-200895555 tempest-SharesRenameTest-200895555-project-admin] PATH_INFO: `/v3/users/56ab342d938748f096b808a9b567c8a6` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0919d6-accf-4efd-afbc-b05deb4a58ab tempest-SharesRenameTest-200895555 tempest-SharesRenameTest-200895555-project-admin] RBAC: Authorizing `identity:delete_user(user_id=56ab342d938748f096b808a9b567c8a6)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0919d6-accf-4efd-afbc-b05deb4a58ab tempest-SharesRenameTest-200895555 tempest-SharesRenameTest-200895555-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:06 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-1f4737d4-de83-44d3-b128-52e1add9ec1b tempest-SharesAPIOnlyNegativeTest-1940122175 tempest-SharesAPIOnlyNegativeTest-1940122175-project-member] POST http://10.27.203.238/share/v1/e0a7371d578542ecbb1cfaa96bd52e2d/os-share-unmanage/fake-id/unmanage May 28 13:02:06 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-1f4737d4-de83-44d3-b128-52e1add9ec1b tempest-SharesAPIOnlyNegativeTest-1940122175 tempest-SharesAPIOnlyNegativeTest-1940122175-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:02:06 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-1f4737d4-de83-44d3-b128-52e1add9ec1b tempest-SharesAPIOnlyNegativeTest-1940122175 tempest-SharesAPIOnlyNegativeTest-1940122175-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:02:06 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.policy [None req-1f4737d4-de83-44d3-b128-52e1add9ec1b tempest-SharesAPIOnlyNegativeTest-1940122175 tempest-SharesAPIOnlyNegativeTest-1940122175-project-member] Policy check for share:unmanage failed with credentials {'is_admin': False, 'user_id': 'cb7b1fac48f54f4c8c2b7997d17766e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a7371d578542ecbb1cfaa96bd52e2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98329) authorize /opt/stack/manila/manila/policy.py:208}} May 28 13:02:06 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-1f4737d4-de83-44d3-b128-52e1add9ec1b tempest-SharesAPIOnlyNegativeTest-1940122175 tempest-SharesAPIOnlyNegativeTest-1940122175-project-member] HTTP exception thrown: Access was denied to this resource. May 28 13:02:06 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-1f4737d4-de83-44d3-b128-52e1add9ec1b tempest-SharesAPIOnlyNegativeTest-1940122175 tempest-SharesAPIOnlyNegativeTest-1940122175-project-member] http://10.27.203.238/share/v1/e0a7371d578542ecbb1cfaa96bd52e2d/os-share-unmanage/fake-id/unmanage returned with HTTP 403 May 28 13:02:06 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1211/2394] 10.27.203.238 () {64 vars in 1401 bytes} [Tue May 28 13:02:06 2024] POST /share/v1/e0a7371d578542ecbb1cfaa96bd52e2d/os-share-unmanage/fake-id/unmanage => generated 78 bytes in 5 msecs (HTTP/1.1 403) 6 headers in 236 bytes (1 switches on core 0) May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ad03fd-51e8-45f4-a64c-1528e34c3fc5 tempest-SharesRenameTest-200895555 tempest-SharesRenameTest-200895555-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ad03fd-51e8-45f4-a64c-1528e34c3fc5 tempest-SharesRenameTest-200895555 tempest-SharesRenameTest-200895555-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6663eb3-caaa-4031-b7b1-65534ccdefc3 tempest-SharesAPIOnlyNegativeTest-1950465614 tempest-SharesAPIOnlyNegativeTest-1950465614-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079378e32ac0477782d6aabcc57ba323', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a50842c7ef74c318ec157a9ebe9442d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6663eb3-caaa-4031-b7b1-65534ccdefc3 tempest-SharesAPIOnlyNegativeTest-1950465614 tempest-SharesAPIOnlyNegativeTest-1950465614-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6663eb3-caaa-4031-b7b1-65534ccdefc3 tempest-SharesAPIOnlyNegativeTest-1950465614 tempest-SharesAPIOnlyNegativeTest-1950465614-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6663eb3-caaa-4031-b7b1-65534ccdefc3 tempest-SharesAPIOnlyNegativeTest-1950465614 tempest-SharesAPIOnlyNegativeTest-1950465614-project-admin] PATH_INFO: `/v3/users/5000ae7b72ab4d8aad66382d4e873caf` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6663eb3-caaa-4031-b7b1-65534ccdefc3 tempest-SharesAPIOnlyNegativeTest-1950465614 tempest-SharesAPIOnlyNegativeTest-1950465614-project-admin] RBAC: Authorizing `identity:delete_user(user_id=5000ae7b72ab4d8aad66382d4e873caf)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6663eb3-caaa-4031-b7b1-65534ccdefc3 tempest-SharesAPIOnlyNegativeTest-1950465614 tempest-SharesAPIOnlyNegativeTest-1950465614-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-a6663eb3-caaa-4031-b7b1-65534ccdefc3 tempest-SharesAPIOnlyNegativeTest-1950465614 tempest-SharesAPIOnlyNegativeTest-1950465614-project-admin] Could not find user: 5000ae7b72ab4d8aad66382d4e873caf.: keystone.exception.UserNotFound: Could not find user: 5000ae7b72ab4d8aad66382d4e873caf. May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 5000ae7b72ab4d8aad66382d4e873caf. May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1656/3283] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:02:06 2024] DELETE /identity/v3/users/5000ae7b72ab4d8aad66382d4e873caf => generated 110 bytes in 27 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6663eb3-caaa-4031-b7b1-65534ccdefc3 tempest-SharesAPIOnlyNegativeTest-1950465614 tempest-SharesAPIOnlyNegativeTest-1950465614-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6663eb3-caaa-4031-b7b1-65534ccdefc3 tempest-SharesAPIOnlyNegativeTest-1950465614 tempest-SharesAPIOnlyNegativeTest-1950465614-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-ba0919d6-accf-4efd-afbc-b05deb4a58ab tempest-SharesRenameTest-200895555 tempest-SharesRenameTest-200895555-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56ab342d938748f096b808a9b567c8a6', 'request_id': 'req-ba0919d6-accf-4efd-afbc-b05deb4a58ab'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-ba0919d6-accf-4efd-afbc-b05deb4a58ab tempest-SharesRenameTest-200895555 tempest-SharesRenameTest-200895555-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56ab342d938748f096b808a9b567c8a6', 'request_id': 'req-ba0919d6-accf-4efd-afbc-b05deb4a58ab'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-ba0919d6-accf-4efd-afbc-b05deb4a58ab tempest-SharesRenameTest-200895555 tempest-SharesRenameTest-200895555-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56ab342d938748f096b808a9b567c8a6', 'request_id': 'req-ba0919d6-accf-4efd-afbc-b05deb4a58ab'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-ba0919d6-accf-4efd-afbc-b05deb4a58ab tempest-SharesRenameTest-200895555 tempest-SharesRenameTest-200895555-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56ab342d938748f096b808a9b567c8a6', 'request_id': 'req-ba0919d6-accf-4efd-afbc-b05deb4a58ab'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-ba0919d6-accf-4efd-afbc-b05deb4a58ab tempest-SharesRenameTest-200895555 tempest-SharesRenameTest-200895555-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56ab342d938748f096b808a9b567c8a6', 'request_id': 'req-ba0919d6-accf-4efd-afbc-b05deb4a58ab'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6713569f-7008-42fa-a79d-b32db6fa85c1 tempest-SharesAPIOnlyNegativeTest-1950465614 tempest-SharesAPIOnlyNegativeTest-1950465614-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079378e32ac0477782d6aabcc57ba323', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a50842c7ef74c318ec157a9ebe9442d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6713569f-7008-42fa-a79d-b32db6fa85c1 tempest-SharesAPIOnlyNegativeTest-1950465614 tempest-SharesAPIOnlyNegativeTest-1950465614-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6713569f-7008-42fa-a79d-b32db6fa85c1 tempest-SharesAPIOnlyNegativeTest-1950465614 tempest-SharesAPIOnlyNegativeTest-1950465614-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6713569f-7008-42fa-a79d-b32db6fa85c1 tempest-SharesAPIOnlyNegativeTest-1950465614 tempest-SharesAPIOnlyNegativeTest-1950465614-project-admin] PATH_INFO: `/v3/users/3fc09c87f69946d2bf009e72ac589cd4` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1628/3284] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:02:06 2024] DELETE /identity/v3/users/56ab342d938748f096b808a9b567c8a6 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6713569f-7008-42fa-a79d-b32db6fa85c1 tempest-SharesAPIOnlyNegativeTest-1950465614 tempest-SharesAPIOnlyNegativeTest-1950465614-project-admin] RBAC: Authorizing `identity:delete_user(user_id=3fc09c87f69946d2bf009e72ac589cd4)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6713569f-7008-42fa-a79d-b32db6fa85c1 tempest-SharesAPIOnlyNegativeTest-1950465614 tempest-SharesAPIOnlyNegativeTest-1950465614-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:06 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-456606ee-0aac-4531-afba-33972086a8e2 tempest-SharesRenameTest-1796622866 tempest-SharesRenameTest-1796622866-project-member] DELETE http://10.27.203.238/share/v2/6035b1be773e417b80fb3d9ea83eac8d/snapshots/7f6343fb-a88d-41ce-91e4-695cc9943965 May 28 13:02:06 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-456606ee-0aac-4531-afba-33972086a8e2 tempest-SharesRenameTest-1796622866 tempest-SharesRenameTest-1796622866-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:02:06 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-456606ee-0aac-4531-afba-33972086a8e2 tempest-SharesRenameTest-1796622866 tempest-SharesRenameTest-1796622866-project-member] Calling method 'ShareSnapshotMixin.delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:02:06 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.v1.share_snapshots [None req-456606ee-0aac-4531-afba-33972086a8e2 tempest-SharesRenameTest-1796622866 tempest-SharesRenameTest-1796622866-project-member] Delete snapshot with id: 7f6343fb-a88d-41ce-91e4-695cc9943965 May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-6713569f-7008-42fa-a79d-b32db6fa85c1 tempest-SharesAPIOnlyNegativeTest-1950465614 tempest-SharesAPIOnlyNegativeTest-1950465614-project-admin] Could not find user: 3fc09c87f69946d2bf009e72ac589cd4.: keystone.exception.UserNotFound: Could not find user: 3fc09c87f69946d2bf009e72ac589cd4. May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 3fc09c87f69946d2bf009e72ac589cd4. May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1657/3285] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:02:06 2024] DELETE /identity/v3/users/3fc09c87f69946d2bf009e72ac589cd4 => generated 110 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0919d6-accf-4efd-afbc-b05deb4a58ab tempest-SharesRenameTest-200895555 tempest-SharesRenameTest-200895555-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-ba0919d6-accf-4efd-afbc-b05deb4a58ab tempest-SharesRenameTest-200895555 tempest-SharesRenameTest-200895555-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0919d6-accf-4efd-afbc-b05deb4a58ab tempest-SharesRenameTest-200895555 tempest-SharesRenameTest-200895555-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc9b2de-b0d4-4ae1-bdeb-5629b98afce7 tempest-SharesAPIOnlyNegativeTest-1950465614 tempest-SharesAPIOnlyNegativeTest-1950465614-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079378e32ac0477782d6aabcc57ba323', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a50842c7ef74c318ec157a9ebe9442d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc9b2de-b0d4-4ae1-bdeb-5629b98afce7 tempest-SharesAPIOnlyNegativeTest-1950465614 tempest-SharesAPIOnlyNegativeTest-1950465614-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc9b2de-b0d4-4ae1-bdeb-5629b98afce7 tempest-SharesAPIOnlyNegativeTest-1950465614 tempest-SharesAPIOnlyNegativeTest-1950465614-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc9b2de-b0d4-4ae1-bdeb-5629b98afce7 tempest-SharesAPIOnlyNegativeTest-1950465614 tempest-SharesAPIOnlyNegativeTest-1950465614-project-admin] PATH_INFO: `/v3/users/6533c69a593a4e35a8693da46fbd9f3b` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc9b2de-b0d4-4ae1-bdeb-5629b98afce7 tempest-SharesAPIOnlyNegativeTest-1950465614 tempest-SharesAPIOnlyNegativeTest-1950465614-project-admin] RBAC: Authorizing `identity:delete_user(user_id=6533c69a593a4e35a8693da46fbd9f3b)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc9b2de-b0d4-4ae1-bdeb-5629b98afce7 tempest-SharesAPIOnlyNegativeTest-1950465614 tempest-SharesAPIOnlyNegativeTest-1950465614-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-2dc9b2de-b0d4-4ae1-bdeb-5629b98afce7 tempest-SharesAPIOnlyNegativeTest-1950465614 tempest-SharesAPIOnlyNegativeTest-1950465614-project-admin] Could not find user: 6533c69a593a4e35a8693da46fbd9f3b.: keystone.exception.UserNotFound: Could not find user: 6533c69a593a4e35a8693da46fbd9f3b. May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 6533c69a593a4e35a8693da46fbd9f3b. May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1629/3286] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:02:06 2024] DELETE /identity/v3/users/6533c69a593a4e35a8693da46fbd9f3b => generated 110 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6713569f-7008-42fa-a79d-b32db6fa85c1 tempest-SharesAPIOnlyNegativeTest-1950465614 tempest-SharesAPIOnlyNegativeTest-1950465614-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6713569f-7008-42fa-a79d-b32db6fa85c1 tempest-SharesAPIOnlyNegativeTest-1950465614 tempest-SharesAPIOnlyNegativeTest-1950465614-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02716e3-6ccd-4df3-97b3-2e43322f8608 tempest-SharesAPIOnlyNegativeTest-1950465614 tempest-SharesAPIOnlyNegativeTest-1950465614-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079378e32ac0477782d6aabcc57ba323', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a50842c7ef74c318ec157a9ebe9442d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:06 l75lg1-v1 dstat.sh[49771]: 28-05 13:02:06| 19 2 73 5 0|5637M 1792M 278M 7917M| 20k 26k| 0 7350k| 0 602 | 11k 20k|0.98 1.13 1.05|2.0 2.0 0| 0 0 | 0 2048M| 29 365 0 36 2 May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02716e3-6ccd-4df3-97b3-2e43322f8608 tempest-SharesAPIOnlyNegativeTest-1950465614 tempest-SharesAPIOnlyNegativeTest-1950465614-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02716e3-6ccd-4df3-97b3-2e43322f8608 tempest-SharesAPIOnlyNegativeTest-1950465614 tempest-SharesAPIOnlyNegativeTest-1950465614-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:06 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-456606ee-0aac-4531-afba-33972086a8e2 tempest-SharesRenameTest-1796622866 tempest-SharesRenameTest-1796622866-project-member] http://10.27.203.238/share/v2/6035b1be773e417b80fb3d9ea83eac8d/snapshots/7f6343fb-a88d-41ce-91e4-695cc9943965 returned with HTTP 202 May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02716e3-6ccd-4df3-97b3-2e43322f8608 tempest-SharesAPIOnlyNegativeTest-1950465614 tempest-SharesAPIOnlyNegativeTest-1950465614-project-admin] PATH_INFO: `/v3/users/929590f760014a429cece4b4e674f84e` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:06 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1184/2395] 10.27.203.238 () {64 vars in 1463 bytes} [Tue May 28 13:02:06 2024] DELETE /share/v2/6035b1be773e417b80fb3d9ea83eac8d/snapshots/7f6343fb-a88d-41ce-91e4-695cc9943965 => generated 0 bytes in 100 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 13:02:06 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-1635d481-d710-426e-a68c-d72352d08d29 tempest-SharesRenameTest-1796622866 tempest-SharesRenameTest-1796622866-project-member] GET http://10.27.203.238/share/v2/6035b1be773e417b80fb3d9ea83eac8d/snapshots/7f6343fb-a88d-41ce-91e4-695cc9943965 May 28 13:02:06 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-1635d481-d710-426e-a68c-d72352d08d29 tempest-SharesRenameTest-1796622866 tempest-SharesRenameTest-1796622866-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02716e3-6ccd-4df3-97b3-2e43322f8608 tempest-SharesAPIOnlyNegativeTest-1950465614 tempest-SharesAPIOnlyNegativeTest-1950465614-project-admin] RBAC: Authorizing `identity:delete_user(user_id=929590f760014a429cece4b4e674f84e)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:06 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-1635d481-d710-426e-a68c-d72352d08d29 tempest-SharesRenameTest-1796622866 tempest-SharesRenameTest-1796622866-project-member] Calling method 'ShareSnapshotMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02716e3-6ccd-4df3-97b3-2e43322f8608 tempest-SharesAPIOnlyNegativeTest-1950465614 tempest-SharesAPIOnlyNegativeTest-1950465614-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-d02716e3-6ccd-4df3-97b3-2e43322f8608 tempest-SharesAPIOnlyNegativeTest-1950465614 tempest-SharesAPIOnlyNegativeTest-1950465614-project-admin] Could not find user: 929590f760014a429cece4b4e674f84e.: keystone.exception.UserNotFound: Could not find user: 929590f760014a429cece4b4e674f84e. May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 929590f760014a429cece4b4e674f84e. May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1658/3287] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:02:06 2024] DELETE /identity/v3/users/929590f760014a429cece4b4e674f84e => generated 110 bytes in 27 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc9b2de-b0d4-4ae1-bdeb-5629b98afce7 tempest-SharesAPIOnlyNegativeTest-1950465614 tempest-SharesAPIOnlyNegativeTest-1950465614-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc9b2de-b0d4-4ae1-bdeb-5629b98afce7 tempest-SharesAPIOnlyNegativeTest-1950465614 tempest-SharesAPIOnlyNegativeTest-1950465614-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51fc49d-4217-4857-971f-ab985365054b tempest-SharesAPIOnlyNegativeTest-1950465614 tempest-SharesAPIOnlyNegativeTest-1950465614-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079378e32ac0477782d6aabcc57ba323', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a50842c7ef74c318ec157a9ebe9442d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51fc49d-4217-4857-971f-ab985365054b tempest-SharesAPIOnlyNegativeTest-1950465614 tempest-SharesAPIOnlyNegativeTest-1950465614-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51fc49d-4217-4857-971f-ab985365054b tempest-SharesAPIOnlyNegativeTest-1950465614 tempest-SharesAPIOnlyNegativeTest-1950465614-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51fc49d-4217-4857-971f-ab985365054b tempest-SharesAPIOnlyNegativeTest-1950465614 tempest-SharesAPIOnlyNegativeTest-1950465614-project-admin] PATH_INFO: `/v3/users/7ad2c2df894f4bca82e33623064ce809` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51fc49d-4217-4857-971f-ab985365054b tempest-SharesAPIOnlyNegativeTest-1950465614 tempest-SharesAPIOnlyNegativeTest-1950465614-project-admin] RBAC: Authorizing `identity:delete_user(user_id=7ad2c2df894f4bca82e33623064ce809)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51fc49d-4217-4857-971f-ab985365054b tempest-SharesAPIOnlyNegativeTest-1950465614 tempest-SharesAPIOnlyNegativeTest-1950465614-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:06 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-1635d481-d710-426e-a68c-d72352d08d29 tempest-SharesRenameTest-1796622866 tempest-SharesRenameTest-1796622866-project-member] http://10.27.203.238/share/v2/6035b1be773e417b80fb3d9ea83eac8d/snapshots/7f6343fb-a88d-41ce-91e4-695cc9943965 returned with HTTP 200 May 28 13:02:06 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1212/2396] 10.27.203.238 () {64 vars in 1460 bytes} [Tue May 28 13:02:06 2024] GET /share/v2/6035b1be773e417b80fb3d9ea83eac8d/snapshots/7f6343fb-a88d-41ce-91e4-695cc9943965 => generated 760 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-d51fc49d-4217-4857-971f-ab985365054b tempest-SharesAPIOnlyNegativeTest-1950465614 tempest-SharesAPIOnlyNegativeTest-1950465614-project-admin] Could not find user: 7ad2c2df894f4bca82e33623064ce809.: keystone.exception.UserNotFound: Could not find user: 7ad2c2df894f4bca82e33623064ce809. May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 7ad2c2df894f4bca82e33623064ce809. May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1630/3288] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:02:06 2024] DELETE /identity/v3/users/7ad2c2df894f4bca82e33623064ce809 => generated 110 bytes in 25 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02716e3-6ccd-4df3-97b3-2e43322f8608 tempest-SharesAPIOnlyNegativeTest-1950465614 tempest-SharesAPIOnlyNegativeTest-1950465614-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02716e3-6ccd-4df3-97b3-2e43322f8608 tempest-SharesAPIOnlyNegativeTest-1950465614 tempest-SharesAPIOnlyNegativeTest-1950465614-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce5506b-432e-4cfd-9b89-133d26efa947 tempest-SharesAPIOnlyNegativeTest-1950465614 tempest-SharesAPIOnlyNegativeTest-1950465614-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079378e32ac0477782d6aabcc57ba323', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a50842c7ef74c318ec157a9ebe9442d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce5506b-432e-4cfd-9b89-133d26efa947 tempest-SharesAPIOnlyNegativeTest-1950465614 tempest-SharesAPIOnlyNegativeTest-1950465614-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce5506b-432e-4cfd-9b89-133d26efa947 tempest-SharesAPIOnlyNegativeTest-1950465614 tempest-SharesAPIOnlyNegativeTest-1950465614-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce5506b-432e-4cfd-9b89-133d26efa947 tempest-SharesAPIOnlyNegativeTest-1950465614 tempest-SharesAPIOnlyNegativeTest-1950465614-project-admin] PATH_INFO: `/v3/users/43487099e439456094fb5cfc0ae825c5` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce5506b-432e-4cfd-9b89-133d26efa947 tempest-SharesAPIOnlyNegativeTest-1950465614 tempest-SharesAPIOnlyNegativeTest-1950465614-project-admin] RBAC: Authorizing `identity:delete_user(user_id=43487099e439456094fb5cfc0ae825c5)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce5506b-432e-4cfd-9b89-133d26efa947 tempest-SharesAPIOnlyNegativeTest-1950465614 tempest-SharesAPIOnlyNegativeTest-1950465614-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-4ce5506b-432e-4cfd-9b89-133d26efa947 tempest-SharesAPIOnlyNegativeTest-1950465614 tempest-SharesAPIOnlyNegativeTest-1950465614-project-admin] Could not find user: 43487099e439456094fb5cfc0ae825c5.: keystone.exception.UserNotFound: Could not find user: 43487099e439456094fb5cfc0ae825c5. May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 43487099e439456094fb5cfc0ae825c5. May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1659/3289] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:02:06 2024] DELETE /identity/v3/users/43487099e439456094fb5cfc0ae825c5 => generated 110 bytes in 23 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51fc49d-4217-4857-971f-ab985365054b tempest-SharesAPIOnlyNegativeTest-1950465614 tempest-SharesAPIOnlyNegativeTest-1950465614-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51fc49d-4217-4857-971f-ab985365054b tempest-SharesAPIOnlyNegativeTest-1950465614 tempest-SharesAPIOnlyNegativeTest-1950465614-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:06 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-456606ee-0aac-4531-afba-33972086a8e2 tempest-SharesRenameTest-1796622866 None] >>> [GET] https://127.0.0.1:40443/api/snapshots/ May 28 13:02:06 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-456606ee-0aac-4531-afba-33972086a8e2 tempest-SharesRenameTest-1796622866 None] {'allow_redirects': True, May 28 13:02:06 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-456606ee-0aac-4531-afba-33972086a8e2 tempest-SharesRenameTest-1796622866 None] 'params': {'name': 'share-snapshot-269cccf8-ac79-425b-bc35-247722bb985f'}} May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f09bb0-b889-46af-aa12-49547bd06860 tempest-SharesAPIOnlyNegativeTest-1950465614 tempest-SharesAPIOnlyNegativeTest-1950465614-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079378e32ac0477782d6aabcc57ba323', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a50842c7ef74c318ec157a9ebe9442d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f09bb0-b889-46af-aa12-49547bd06860 tempest-SharesAPIOnlyNegativeTest-1950465614 tempest-SharesAPIOnlyNegativeTest-1950465614-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f09bb0-b889-46af-aa12-49547bd06860 tempest-SharesAPIOnlyNegativeTest-1950465614 tempest-SharesAPIOnlyNegativeTest-1950465614-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f09bb0-b889-46af-aa12-49547bd06860 tempest-SharesAPIOnlyNegativeTest-1950465614 tempest-SharesAPIOnlyNegativeTest-1950465614-project-admin] PATH_INFO: `/v3/users/450d0e4972ca4250966ec637211a08fd` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f09bb0-b889-46af-aa12-49547bd06860 tempest-SharesAPIOnlyNegativeTest-1950465614 tempest-SharesAPIOnlyNegativeTest-1950465614-project-admin] RBAC: Authorizing `identity:delete_user(user_id=450d0e4972ca4250966ec637211a08fd)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f09bb0-b889-46af-aa12-49547bd06860 tempest-SharesAPIOnlyNegativeTest-1950465614 tempest-SharesAPIOnlyNegativeTest-1950465614-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-e9f09bb0-b889-46af-aa12-49547bd06860 tempest-SharesAPIOnlyNegativeTest-1950465614 tempest-SharesAPIOnlyNegativeTest-1950465614-project-admin] Could not find user: 450d0e4972ca4250966ec637211a08fd.: keystone.exception.UserNotFound: Could not find user: 450d0e4972ca4250966ec637211a08fd. May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 450d0e4972ca4250966ec637211a08fd. May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1631/3290] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:02:06 2024] DELETE /identity/v3/users/450d0e4972ca4250966ec637211a08fd => generated 110 bytes in 25 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce5506b-432e-4cfd-9b89-133d26efa947 tempest-SharesAPIOnlyNegativeTest-1950465614 tempest-SharesAPIOnlyNegativeTest-1950465614-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce5506b-432e-4cfd-9b89-133d26efa947 tempest-SharesAPIOnlyNegativeTest-1950465614 tempest-SharesAPIOnlyNegativeTest-1950465614-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2701c4f-5a3c-4f2e-aaf9-f5268e0604b3 tempest-SharesAPIOnlyNegativeTest-1950465614 tempest-SharesAPIOnlyNegativeTest-1950465614-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079378e32ac0477782d6aabcc57ba323', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a50842c7ef74c318ec157a9ebe9442d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2701c4f-5a3c-4f2e-aaf9-f5268e0604b3 tempest-SharesAPIOnlyNegativeTest-1950465614 tempest-SharesAPIOnlyNegativeTest-1950465614-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2701c4f-5a3c-4f2e-aaf9-f5268e0604b3 tempest-SharesAPIOnlyNegativeTest-1950465614 tempest-SharesAPIOnlyNegativeTest-1950465614-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2701c4f-5a3c-4f2e-aaf9-f5268e0604b3 tempest-SharesAPIOnlyNegativeTest-1950465614 tempest-SharesAPIOnlyNegativeTest-1950465614-project-admin] PATH_INFO: `/v3/users/d76fc4c11efc4cff97005a3ab0385c58` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2701c4f-5a3c-4f2e-aaf9-f5268e0604b3 tempest-SharesAPIOnlyNegativeTest-1950465614 tempest-SharesAPIOnlyNegativeTest-1950465614-project-admin] RBAC: Authorizing `identity:delete_user(user_id=d76fc4c11efc4cff97005a3ab0385c58)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2701c4f-5a3c-4f2e-aaf9-f5268e0604b3 tempest-SharesAPIOnlyNegativeTest-1950465614 tempest-SharesAPIOnlyNegativeTest-1950465614-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-f2701c4f-5a3c-4f2e-aaf9-f5268e0604b3 tempest-SharesAPIOnlyNegativeTest-1950465614 tempest-SharesAPIOnlyNegativeTest-1950465614-project-admin] Could not find user: d76fc4c11efc4cff97005a3ab0385c58.: keystone.exception.UserNotFound: Could not find user: d76fc4c11efc4cff97005a3ab0385c58. May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: d76fc4c11efc4cff97005a3ab0385c58. May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1660/3291] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:02:06 2024] DELETE /identity/v3/users/d76fc4c11efc4cff97005a3ab0385c58 => generated 110 bytes in 23 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f09bb0-b889-46af-aa12-49547bd06860 tempest-SharesAPIOnlyNegativeTest-1950465614 tempest-SharesAPIOnlyNegativeTest-1950465614-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f09bb0-b889-46af-aa12-49547bd06860 tempest-SharesAPIOnlyNegativeTest-1950465614 tempest-SharesAPIOnlyNegativeTest-1950465614-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de512c6-78ea-4e4c-8185-f94e061a345b tempest-SharesAPIOnlyNegativeTest-1950465614 tempest-SharesAPIOnlyNegativeTest-1950465614-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079378e32ac0477782d6aabcc57ba323', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a50842c7ef74c318ec157a9ebe9442d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de512c6-78ea-4e4c-8185-f94e061a345b tempest-SharesAPIOnlyNegativeTest-1950465614 tempest-SharesAPIOnlyNegativeTest-1950465614-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de512c6-78ea-4e4c-8185-f94e061a345b tempest-SharesAPIOnlyNegativeTest-1950465614 tempest-SharesAPIOnlyNegativeTest-1950465614-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de512c6-78ea-4e4c-8185-f94e061a345b tempest-SharesAPIOnlyNegativeTest-1950465614 tempest-SharesAPIOnlyNegativeTest-1950465614-project-admin] PATH_INFO: `/v3/users/2180c425dfa340e79633dd5319b4cd4c` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de512c6-78ea-4e4c-8185-f94e061a345b tempest-SharesAPIOnlyNegativeTest-1950465614 tempest-SharesAPIOnlyNegativeTest-1950465614-project-admin] RBAC: Authorizing `identity:delete_user(user_id=2180c425dfa340e79633dd5319b4cd4c)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de512c6-78ea-4e4c-8185-f94e061a345b tempest-SharesAPIOnlyNegativeTest-1950465614 tempest-SharesAPIOnlyNegativeTest-1950465614-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:06 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-a3cacd27-38ff-4157-9c57-b2d366836fb5 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] GET http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/share-access-rules?share_id=b330db31-7766-443d-9c19-26fe349665aa May 28 13:02:06 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-a3cacd27-38ff-4157-9c57-b2d366836fb5 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:02:06 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-a3cacd27-38ff-4157-9c57-b2d366836fb5 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-4de512c6-78ea-4e4c-8185-f94e061a345b tempest-SharesAPIOnlyNegativeTest-1950465614 tempest-SharesAPIOnlyNegativeTest-1950465614-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2180c425dfa340e79633dd5319b4cd4c', 'request_id': 'req-4de512c6-78ea-4e4c-8185-f94e061a345b'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-4de512c6-78ea-4e4c-8185-f94e061a345b tempest-SharesAPIOnlyNegativeTest-1950465614 tempest-SharesAPIOnlyNegativeTest-1950465614-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2180c425dfa340e79633dd5319b4cd4c', 'request_id': 'req-4de512c6-78ea-4e4c-8185-f94e061a345b'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:06 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-a3cacd27-38ff-4157-9c57-b2d366836fb5 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/share-access-rules?share_id=b330db31-7766-443d-9c19-26fe349665aa returned with HTTP 200 May 28 13:02:06 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1185/2397] 10.27.203.238 () {64 vars in 1467 bytes} [Tue May 28 13:02:06 2024] GET /share/v2/a4f3887fa28c457390f5b66615564430/share-access-rules?share_id=b330db31-7766-443d-9c19-26fe349665aa => generated 19 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-4de512c6-78ea-4e4c-8185-f94e061a345b tempest-SharesAPIOnlyNegativeTest-1950465614 tempest-SharesAPIOnlyNegativeTest-1950465614-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2180c425dfa340e79633dd5319b4cd4c', 'request_id': 'req-4de512c6-78ea-4e4c-8185-f94e061a345b'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-4de512c6-78ea-4e4c-8185-f94e061a345b tempest-SharesAPIOnlyNegativeTest-1950465614 tempest-SharesAPIOnlyNegativeTest-1950465614-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2180c425dfa340e79633dd5319b4cd4c', 'request_id': 'req-4de512c6-78ea-4e4c-8185-f94e061a345b'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-4de512c6-78ea-4e4c-8185-f94e061a345b tempest-SharesAPIOnlyNegativeTest-1950465614 tempest-SharesAPIOnlyNegativeTest-1950465614-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2180c425dfa340e79633dd5319b4cd4c', 'request_id': 'req-4de512c6-78ea-4e4c-8185-f94e061a345b'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:06 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-b6e0fa39-9417-45ee-a0fb-19970a72b63f tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] POST http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/shares/b330db31-7766-443d-9c19-26fe349665aa/action May 28 13:02:06 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-b6e0fa39-9417-45ee-a0fb-19970a72b63f tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Action body: b'{"allow_access": {"access_type": "ip", "access_to": "203.0.113.77", "access_level": "rw", "lock_visibility": true, "lock_deletion": true}}' {{(pid=98329) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 13:02:06 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-b6e0fa39-9417-45ee-a0fb-19970a72b63f tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Action: 'action', calling method: ShareController.allow_access, body: {"allow_access": {"access_type": "ip", "access_to": "203.0.113.77", "access_level": "rw", "lock_visibility": true, "lock_deletion": true}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1632/3292] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:02:06 2024] DELETE /identity/v3/users/2180c425dfa340e79633dd5319b4cd4c => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:02:06 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-0c57fccf-8166-4bde-bc51-5720c48c55e1 tempest-SharesAPIOnlyNegativeTest-1950465614 tempest-SharesAPIOnlyNegativeTest-1950465614-project-admin] DELETE http://10.27.203.238/share/v2/5a50842c7ef74c318ec157a9ebe9442d/types/e98b1a36-0af8-498a-bc78-b3c859a45504 May 28 13:02:06 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-0c57fccf-8166-4bde-bc51-5720c48c55e1 tempest-SharesAPIOnlyNegativeTest-1950465614 tempest-SharesAPIOnlyNegativeTest-1950465614-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:02:06 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-0c57fccf-8166-4bde-bc51-5720c48c55e1 tempest-SharesAPIOnlyNegativeTest-1950465614 tempest-SharesAPIOnlyNegativeTest-1950465614-project-admin] Calling method 'ShareTypesController._delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:02:06 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-0c57fccf-8166-4bde-bc51-5720c48c55e1 tempest-SharesAPIOnlyNegativeTest-1950465614 tempest-SharesAPIOnlyNegativeTest-1950465614-project-admin] http://10.27.203.238/share/v2/5a50842c7ef74c318ec157a9ebe9442d/types/e98b1a36-0af8-498a-bc78-b3c859a45504 returned with HTTP 202 May 28 13:02:06 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1186/2398] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:02:06 2024] DELETE /share/v2/5a50842c7ef74c318ec157a9ebe9442d/types/e98b1a36-0af8-498a-bc78-b3c859a45504 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 13:02:06 l75lg1-v1 devstack@m-api.service[98329]: DEBUG oslo_concurrency.lockutils [None req-b6e0fa39-9417-45ee-a0fb-19970a72b63f tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98329) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:02:06 l75lg1-v1 devstack@m-api.service[98329]: DEBUG oslo_concurrency.lockutils [None req-b6e0fa39-9417-45ee-a0fb-19970a72b63f tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98329) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:02:06 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-fe9aafbb-2b1d-46de-8826-78394dd989e6 tempest-SharesAPIOnlyNegativeTest-1950465614 tempest-SharesAPIOnlyNegativeTest-1950465614-project-admin] GET http://10.27.203.238/share/v2/5a50842c7ef74c318ec157a9ebe9442d/types/e98b1a36-0af8-498a-bc78-b3c859a45504 May 28 13:02:06 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-fe9aafbb-2b1d-46de-8826-78394dd989e6 tempest-SharesAPIOnlyNegativeTest-1950465614 tempest-SharesAPIOnlyNegativeTest-1950465614-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:02:06 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-fe9aafbb-2b1d-46de-8826-78394dd989e6 tempest-SharesAPIOnlyNegativeTest-1950465614 tempest-SharesAPIOnlyNegativeTest-1950465614-project-admin] Calling method 'ShareTypesController.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:02:06 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-fe9aafbb-2b1d-46de-8826-78394dd989e6 tempest-SharesAPIOnlyNegativeTest-1950465614 tempest-SharesAPIOnlyNegativeTest-1950465614-project-admin] HTTP exception thrown: Share type not found. May 28 13:02:06 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-fe9aafbb-2b1d-46de-8826-78394dd989e6 tempest-SharesAPIOnlyNegativeTest-1950465614 tempest-SharesAPIOnlyNegativeTest-1950465614-project-admin] http://10.27.203.238/share/v2/5a50842c7ef74c318ec157a9ebe9442d/types/e98b1a36-0af8-498a-bc78-b3c859a45504 returned with HTTP 404 May 28 13:02:06 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1187/2399] 10.27.203.238 () {64 vars in 1448 bytes} [Tue May 28 13:02:06 2024] GET /share/v2/5a50842c7ef74c318ec157a9ebe9442d/types/e98b1a36-0af8-498a-bc78-b3c859a45504 => generated 67 bytes in 9 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 13:02:06 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-daf0b492-579b-415e-bf15-372f9c6341cc tempest-SharesAPIOnlyNegativeTest-1950465614 tempest-SharesAPIOnlyNegativeTest-1950465614-project-admin] DELETE http://10.27.203.238/share/v2/5a50842c7ef74c318ec157a9ebe9442d/types/1a2d01e9-8868-4620-87f7-689fe7e830b5 May 28 13:02:06 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-daf0b492-579b-415e-bf15-372f9c6341cc tempest-SharesAPIOnlyNegativeTest-1950465614 tempest-SharesAPIOnlyNegativeTest-1950465614-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:02:06 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-daf0b492-579b-415e-bf15-372f9c6341cc tempest-SharesAPIOnlyNegativeTest-1950465614 tempest-SharesAPIOnlyNegativeTest-1950465614-project-admin] Calling method 'ShareTypesController._delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:02:06 l75lg1-v1 devstack@m-api.service[98329]: DEBUG oslo_concurrency.lockutils [None req-b6e0fa39-9417-45ee-a0fb-19970a72b63f tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.042s {{(pid=98329) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:02:06 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-daf0b492-579b-415e-bf15-372f9c6341cc tempest-SharesAPIOnlyNegativeTest-1950465614 tempest-SharesAPIOnlyNegativeTest-1950465614-project-admin] http://10.27.203.238/share/v2/5a50842c7ef74c318ec157a9ebe9442d/types/1a2d01e9-8868-4620-87f7-689fe7e830b5 returned with HTTP 202 May 28 13:02:06 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1188/2400] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:02:06 2024] DELETE /share/v2/5a50842c7ef74c318ec157a9ebe9442d/types/1a2d01e9-8868-4620-87f7-689fe7e830b5 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 6 headers in 243 bytes (2 switches on core 0) May 28 13:02:06 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-832c2d3f-d9ea-4902-9298-bd112f595db6 tempest-SharesAPIOnlyNegativeTest-1950465614 tempest-SharesAPIOnlyNegativeTest-1950465614-project-admin] GET http://10.27.203.238/share/v2/5a50842c7ef74c318ec157a9ebe9442d/types/1a2d01e9-8868-4620-87f7-689fe7e830b5 May 28 13:02:06 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-832c2d3f-d9ea-4902-9298-bd112f595db6 tempest-SharesAPIOnlyNegativeTest-1950465614 tempest-SharesAPIOnlyNegativeTest-1950465614-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:02:06 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-832c2d3f-d9ea-4902-9298-bd112f595db6 tempest-SharesAPIOnlyNegativeTest-1950465614 tempest-SharesAPIOnlyNegativeTest-1950465614-project-admin] Calling method 'ShareTypesController.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:02:06 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-832c2d3f-d9ea-4902-9298-bd112f595db6 tempest-SharesAPIOnlyNegativeTest-1950465614 tempest-SharesAPIOnlyNegativeTest-1950465614-project-admin] HTTP exception thrown: Share type not found. May 28 13:02:06 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-832c2d3f-d9ea-4902-9298-bd112f595db6 tempest-SharesAPIOnlyNegativeTest-1950465614 tempest-SharesAPIOnlyNegativeTest-1950465614-project-admin] http://10.27.203.238/share/v2/5a50842c7ef74c318ec157a9ebe9442d/types/1a2d01e9-8868-4620-87f7-689fe7e830b5 returned with HTTP 404 May 28 13:02:06 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1189/2401] 10.27.203.238 () {64 vars in 1448 bytes} [Tue May 28 13:02:06 2024] GET /share/v2/5a50842c7ef74c318ec157a9ebe9442d/types/1a2d01e9-8868-4620-87f7-689fe7e830b5 => generated 67 bytes in 10 msecs (HTTP/1.1 404) 6 headers in 237 bytes (2 switches on core 0) May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2701c4f-5a3c-4f2e-aaf9-f5268e0604b3 tempest-SharesAPIOnlyNegativeTest-1950465614 tempest-SharesAPIOnlyNegativeTest-1950465614-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-f2701c4f-5a3c-4f2e-aaf9-f5268e0604b3 tempest-SharesAPIOnlyNegativeTest-1950465614 tempest-SharesAPIOnlyNegativeTest-1950465614-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:02:06 l75lg1-v1 manila-share[98474]: DEBUG manila.share.manager [None req-b6e0fa39-9417-45ee-a0fb-19970a72b63f tempest-ShareRulesTest-1530341375 None] Received request to update access for share instance f7e47502-a0f7-44de-953d-b7b5697ae0b2. {{(pid=98474) update_access_for_instances /opt/stack/manila/manila/share/manager.py:4353}} May 28 13:02:06 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-b6e0fa39-9417-45ee-a0fb-19970a72b63f tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/shares/b330db31-7766-443d-9c19-26fe349665aa/action returned with HTTP 200 May 28 13:02:06 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1213/2402] 10.27.203.238 () {66 vars in 1494 bytes} [Tue May 28 13:02:06 2024] POST /share/v2/a4f3887fa28c457390f5b66615564430/shares/b330db31-7766-443d-9c19-26fe349665aa/action => generated 310 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:02:06 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-0de4b7ea-fae5-4108-be5e-bbe0ebbfd79f tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] GET http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/share-access-rules?share_id=b330db31-7766-443d-9c19-26fe349665aa May 28 13:02:06 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-0de4b7ea-fae5-4108-be5e-bbe0ebbfd79f tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:02:06 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-0de4b7ea-fae5-4108-be5e-bbe0ebbfd79f tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:02:06 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-b6e0fa39-9417-45ee-a0fb-19970a72b63f tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:02:06 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-b6e0fa39-9417-45ee-a0fb-19970a72b63f tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2701c4f-5a3c-4f2e-aaf9-f5268e0604b3 tempest-SharesAPIOnlyNegativeTest-1950465614 tempest-SharesAPIOnlyNegativeTest-1950465614-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:06 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-b6e0fa39-9417-45ee-a0fb-19970a72b63f tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.004s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:02:06 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-b6e0fa39-9417-45ee-a0fb-19970a72b63f tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:02:06 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-b6e0fa39-9417-45ee-a0fb-19970a72b63f tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f64621-4f5d-4b61-902c-3e684e5097c7 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f64621-4f5d-4b61-902c-3e684e5097c7 None admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f64621-4f5d-4b61-902c-3e684e5097c7 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f64621-4f5d-4b61-902c-3e684e5097c7 None admin] PATH_INFO: `/v3/users/cb7b1fac48f54f4c8c2b7997d17766e5` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f64621-4f5d-4b61-902c-3e684e5097c7 None admin] RBAC: Authorizing `identity:delete_user(user_id=cb7b1fac48f54f4c8c2b7997d17766e5)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f64621-4f5d-4b61-902c-3e684e5097c7 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:06 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.lock.api [None req-0de4b7ea-fae5-4108-be5e-bbe0ebbfd79f tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Searching for locks by: {'resource_id': 'b2fe4ffa-cd6d-441e-b1ee-a7e8b63ccf87', 'resource_action': 'show', 'resource_type': 'access_rule'} {{(pid=98330) get_all /opt/stack/manila/manila/lock/api.py:112}} May 28 13:02:06 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-0de4b7ea-fae5-4108-be5e-bbe0ebbfd79f tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/share-access-rules?share_id=b330db31-7766-443d-9c19-26fe349665aa returned with HTTP 200 May 28 13:02:06 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1190/2403] 10.27.203.238 () {64 vars in 1467 bytes} [Tue May 28 13:02:06 2024] GET /share/v2/a4f3887fa28c457390f5b66615564430/share-access-rules?share_id=b330db31-7766-443d-9c19-26fe349665aa => generated 265 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:02:06 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-456606ee-0aac-4531-afba-33972086a8e2 tempest-SharesRenameTest-1796622866 None] <<< [GET] https://127.0.0.1:40443/api/snapshots/ May 28 13:02:06 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-456606ee-0aac-4531-afba-33972086a8e2 tempest-SharesRenameTest-1796622866 None] [Bunch(access_path='/.vast_all_snapshots/1000000014_share-snapshot-269cccf8-ac79-425b-bc35-247722bb985f', aggr_phys_estimation=0, cluster='loop75-kfs', created='2024-05-28T13:02:00.014597Z', eta_sec=30819898671.364243, expiration_time='3001-01-19T07:59:58Z', guid='33be009d-be38-4ff2-ab90-d7677509810c', id=15, indestructible=False, locked=False, name='share-snapshot-269cccf8-ac79-425b-bc35-247722bb985f', path='/manila/manila-37860c08-1995-417c-b284-dd741fb36e15/', policy=None, policy_id=None, protection_policy_id=None, state='SUCCEED', tenant_id=1, tenant_name='default', title='share-snapshot-269cccf8-ac79-425b-bc35-247722bb985f(/manila/manila-37860c08-1995-417c-b284-dd741fb36e15/)', type='local', unique_phys_estimation=0, url='https://127.0.0.1:40443/api/snapshots/15/')] May 28 13:02:06 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-456606ee-0aac-4531-afba-33972086a8e2 tempest-SharesRenameTest-1796622866 None] --- [GET] https://127.0.0.1:40443/api/snapshots/: Done May 28 13:02:06 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-456606ee-0aac-4531-afba-33972086a8e2 tempest-SharesRenameTest-1796622866 None] >>> [DELETE] https://127.0.0.1:40443/api/snapshots/15/ May 28 13:02:06 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-b6e0fa39-9417-45ee-a0fb-19970a72b63f tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.061s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:02:06 l75lg1-v1 manila-share[98474]: DEBUG manila.share.access [None req-b6e0fa39-9417-45ee-a0fb-19970a72b63f tempest-ShareRulesTest-1530341375 None] Updating access rules for share instance f7e47502-a0f7-44de-953d-b7b5697ae0b2 belonging to share b330db31-7766-443d-9c19-26fe349665aa. {{(pid=98474) update_access_rules /opt/stack/manila/manila/share/access.py:298}} May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-91f64621-4f5d-4b61-902c-3e684e5097c7 None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb7b1fac48f54f4c8c2b7997d17766e5', 'request_id': 'req-91f64621-4f5d-4b61-902c-3e684e5097c7'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:06 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-b6e0fa39-9417-45ee-a0fb-19970a72b63f tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:02:06 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-b6e0fa39-9417-45ee-a0fb-19970a72b63f tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-91f64621-4f5d-4b61-902c-3e684e5097c7 None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb7b1fac48f54f4c8c2b7997d17766e5', 'request_id': 'req-91f64621-4f5d-4b61-902c-3e684e5097c7'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-91f64621-4f5d-4b61-902c-3e684e5097c7 None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb7b1fac48f54f4c8c2b7997d17766e5', 'request_id': 'req-91f64621-4f5d-4b61-902c-3e684e5097c7'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-91f64621-4f5d-4b61-902c-3e684e5097c7 None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb7b1fac48f54f4c8c2b7997d17766e5', 'request_id': 'req-91f64621-4f5d-4b61-902c-3e684e5097c7'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:06 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-b6e0fa39-9417-45ee-a0fb-19970a72b63f tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.007s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:02:06 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-b6e0fa39-9417-45ee-a0fb-19970a72b63f tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:02:06 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-b6e0fa39-9417-45ee-a0fb-19970a72b63f tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-91f64621-4f5d-4b61-902c-3e684e5097c7 None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb7b1fac48f54f4c8c2b7997d17766e5', 'request_id': 'req-91f64621-4f5d-4b61-902c-3e684e5097c7'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:06 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-b6e0fa39-9417-45ee-a0fb-19970a72b63f tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.014s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:02:06 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-b6e0fa39-9417-45ee-a0fb-19970a72b63f tempest-ShareRulesTest-1530341375 None] changing access on None May 28 13:02:06 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b6e0fa39-9417-45ee-a0fb-19970a72b63f tempest-ShareRulesTest-1530341375 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:02:06 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b6e0fa39-9417-45ee-a0fb-19970a72b63f tempest-ShareRulesTest-1530341375 None] {'allow_redirects': True, May 28 13:02:06 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b6e0fa39-9417-45ee-a0fb-19970a72b63f tempest-ShareRulesTest-1530341375 None] 'params': {'name': 'f7e47502-a0f7-44de-953d-b7b5697ae0b2'}} May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1661/3293] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 13:02:06 2024] DELETE /identity/v3/users/cb7b1fac48f54f4c8c2b7997d17766e5 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de512c6-78ea-4e4c-8185-f94e061a345b tempest-SharesAPIOnlyNegativeTest-1950465614 tempest-SharesAPIOnlyNegativeTest-1950465614-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de512c6-78ea-4e4c-8185-f94e061a345b tempest-SharesAPIOnlyNegativeTest-1950465614 tempest-SharesAPIOnlyNegativeTest-1950465614-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224e3e21-9c21-4214-ae81-efbb3728af82 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224e3e21-9c21-4214-ae81-efbb3728af82 None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224e3e21-9c21-4214-ae81-efbb3728af82 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224e3e21-9c21-4214-ae81-efbb3728af82 None admin] PATH_INFO: `/v3/users/e9e4f639c478441e9bb680279dcb3a2c` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224e3e21-9c21-4214-ae81-efbb3728af82 None admin] RBAC: Authorizing `identity:delete_user(user_id=e9e4f639c478441e9bb680279dcb3a2c)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224e3e21-9c21-4214-ae81-efbb3728af82 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-224e3e21-9c21-4214-ae81-efbb3728af82 None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9e4f639c478441e9bb680279dcb3a2c', 'request_id': 'req-224e3e21-9c21-4214-ae81-efbb3728af82'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-224e3e21-9c21-4214-ae81-efbb3728af82 None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9e4f639c478441e9bb680279dcb3a2c', 'request_id': 'req-224e3e21-9c21-4214-ae81-efbb3728af82'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-224e3e21-9c21-4214-ae81-efbb3728af82 None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9e4f639c478441e9bb680279dcb3a2c', 'request_id': 'req-224e3e21-9c21-4214-ae81-efbb3728af82'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-224e3e21-9c21-4214-ae81-efbb3728af82 None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9e4f639c478441e9bb680279dcb3a2c', 'request_id': 'req-224e3e21-9c21-4214-ae81-efbb3728af82'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-224e3e21-9c21-4214-ae81-efbb3728af82 None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9e4f639c478441e9bb680279dcb3a2c', 'request_id': 'req-224e3e21-9c21-4214-ae81-efbb3728af82'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1633/3294] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 13:02:06 2024] DELETE /identity/v3/users/e9e4f639c478441e9bb680279dcb3a2c => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f64621-4f5d-4b61-902c-3e684e5097c7 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-91f64621-4f5d-4b61-902c-3e684e5097c7 None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f64621-4f5d-4b61-902c-3e684e5097c7 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63539273-0a35-4d80-8797-794445f62e29 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63539273-0a35-4d80-8797-794445f62e29 None admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63539273-0a35-4d80-8797-794445f62e29 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63539273-0a35-4d80-8797-794445f62e29 None admin] PATH_INFO: `/v3/users/079378e32ac0477782d6aabcc57ba323` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63539273-0a35-4d80-8797-794445f62e29 None admin] RBAC: Authorizing `identity:delete_user(user_id=079378e32ac0477782d6aabcc57ba323)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63539273-0a35-4d80-8797-794445f62e29 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-63539273-0a35-4d80-8797-794445f62e29 None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '079378e32ac0477782d6aabcc57ba323', 'request_id': 'req-63539273-0a35-4d80-8797-794445f62e29'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-63539273-0a35-4d80-8797-794445f62e29 None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '079378e32ac0477782d6aabcc57ba323', 'request_id': 'req-63539273-0a35-4d80-8797-794445f62e29'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-63539273-0a35-4d80-8797-794445f62e29 None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '079378e32ac0477782d6aabcc57ba323', 'request_id': 'req-63539273-0a35-4d80-8797-794445f62e29'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-63539273-0a35-4d80-8797-794445f62e29 None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '079378e32ac0477782d6aabcc57ba323', 'request_id': 'req-63539273-0a35-4d80-8797-794445f62e29'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-63539273-0a35-4d80-8797-794445f62e29 None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '079378e32ac0477782d6aabcc57ba323', 'request_id': 'req-63539273-0a35-4d80-8797-794445f62e29'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1662/3295] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 13:02:06 2024] DELETE /identity/v3/users/079378e32ac0477782d6aabcc57ba323 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11482772-518b-49ee-bc4b-a86e5f40c388 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11482772-518b-49ee-bc4b-a86e5f40c388 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11482772-518b-49ee-bc4b-a86e5f40c388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-11482772-518b-49ee-bc4b-a86e5f40c388 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-11482772-518b-49ee-bc4b-a86e5f40c388 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-11482772-518b-49ee-bc4b-a86e5f40c388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1634/3296] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 13:02:06 2024] POST /identity/v3/auth/tokens => generated 2960 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 13:02:06 l75lg1-v1 neutron-server[77618]: DEBUG neutron.wsgi [-] (77618) accepted ('10.27.203.238', 44870) {{(pid=77618) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63539273-0a35-4d80-8797-794445f62e29 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:06 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-63539273-0a35-4d80-8797-794445f62e29 None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:02:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63539273-0a35-4d80-8797-794445f62e29 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:07 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b6e0fa39-9417-45ee-a0fb-19970a72b63f tempest-ShareRulesTest-1530341375 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:02:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2b6cc2-9a1d-45c1-9a82-7706e8aa5d69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef17047035e4b518fd5360a01f2da1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2b6cc2-9a1d-45c1-9a82-7706e8aa5d69 service neutron] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:07 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b6e0fa39-9417-45ee-a0fb-19970a72b63f tempest-ShareRulesTest-1530341375 None] [Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=1, created='2024-05-28T12:59:53.824250Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='0fa84ccd-850f-48fa-a965-23e5abe31188', id=38, internal=False, is_s3_default_policy=False, name='f7e47502-a0f7-44de-953d-b7b5697ae0b2', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=['*'], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=[], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=[], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T13:02:05.695486Z', tenant_id=1, tenant_name='default', title='f7e47502-a0f7-44de-953d-b7b5697ae0b2', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/38/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[])] May 28 13:02:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2b6cc2-9a1d-45c1-9a82-7706e8aa5d69 service neutron] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2b6cc2-9a1d-45c1-9a82-7706e8aa5d69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:07 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b6e0fa39-9417-45ee-a0fb-19970a72b63f tempest-ShareRulesTest-1530341375 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 13:02:07 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-b6e0fa39-9417-45ee-a0fb-19970a72b63f tempest-ShareRulesTest-1530341375 None] changing access on /manila/manila-f7e47502-a0f7-44de-953d-b7b5697ae0b2. Rules: {'nfs_read_write': ['203.0.113.77'], 'nfs_read_only': []} May 28 13:02:07 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b6e0fa39-9417-45ee-a0fb-19970a72b63f tempest-ShareRulesTest-1530341375 None] >>> [PATCH] https://127.0.0.1:40443/api/viewpolicies/38/ May 28 13:02:07 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b6e0fa39-9417-45ee-a0fb-19970a72b63f tempest-ShareRulesTest-1530341375 None] {'data': '{"name": "f7e47502-a0f7-44de-953d-b7b5697ae0b2", "nfs_no_squash": ' May 28 13:02:07 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b6e0fa39-9417-45ee-a0fb-19970a72b63f tempest-ShareRulesTest-1530341375 None] '["*"], "nfs_root_squash": ["*"], "nfs_read_write": ["203.0.113.77"], ' May 28 13:02:07 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b6e0fa39-9417-45ee-a0fb-19970a72b63f tempest-ShareRulesTest-1530341375 None] '"nfs_read_only": []}', May 28 13:02:07 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b6e0fa39-9417-45ee-a0fb-19970a72b63f tempest-ShareRulesTest-1530341375 None] 'params': None} May 28 13:02:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2b6cc2-9a1d-45c1-9a82-7706e8aa5d69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2b6cc2-9a1d-45c1-9a82-7706e8aa5d69 service neutron] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:07 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1663/3297] 10.27.203.238 () {64 vars in 1432 bytes} [Tue May 28 13:02:06 2024] GET /identity/v3/auth/tokens => generated 2960 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 28 13:02:07 l75lg1-v1 neutron-server[77618]: INFO neutron.wsgi [None req-ae1b46c6-fad7-41ae-8b13-4dbdb0397b5c None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=22c7818b42ca4634a84be7d1496c4ea6&name=default HTTP/1.1" status: 200 len: 216 time: 0.0726640 May 28 13:02:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11482772-518b-49ee-bc4b-a86e5f40c388 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-11482772-518b-49ee-bc4b-a86e5f40c388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:02:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11482772-518b-49ee-bc4b-a86e5f40c388 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6373517d-59cb-40d2-a835-619f468090d7 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6373517d-59cb-40d2-a835-619f468090d7 None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6373517d-59cb-40d2-a835-619f468090d7 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6373517d-59cb-40d2-a835-619f468090d7 None admin] PATH_INFO: `/v3/projects/22c7818b42ca4634a84be7d1496c4ea6` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6373517d-59cb-40d2-a835-619f468090d7 None admin] RBAC: Authorizing `identity:delete_project(project_id=22c7818b42ca4634a84be7d1496c4ea6)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6373517d-59cb-40d2-a835-619f468090d7 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-6373517d-59cb-40d2-a835-619f468090d7 None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22c7818b42ca4634a84be7d1496c4ea6', 'request_id': 'req-6373517d-59cb-40d2-a835-619f468090d7'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-6373517d-59cb-40d2-a835-619f468090d7 None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22c7818b42ca4634a84be7d1496c4ea6', 'request_id': 'req-6373517d-59cb-40d2-a835-619f468090d7'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-6373517d-59cb-40d2-a835-619f468090d7 None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22c7818b42ca4634a84be7d1496c4ea6', 'request_id': 'req-6373517d-59cb-40d2-a835-619f468090d7'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-6373517d-59cb-40d2-a835-619f468090d7 None admin] The token cache is being invalidate because project 22c7818b42ca4634a84be7d1496c4ea6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 13:02:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-6373517d-59cb-40d2-a835-619f468090d7 None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-6373517d-59cb-40d2-a835-619f468090d7 None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:07 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1635/3298] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 13:02:07 2024] DELETE /identity/v3/projects/22c7818b42ca4634a84be7d1496c4ea6 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:02:07 l75lg1-v1 neutron-server[77618]: DEBUG neutron.wsgi [-] (77618) accepted ('10.27.203.238', 44880) {{(pid=77618) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 13:02:07 l75lg1-v1 neutron-server[77618]: INFO neutron.wsgi [None req-610c616f-88cc-4385-a1d2-075b2dd2ccd5 None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=e0a7371d578542ecbb1cfaa96bd52e2d&name=default HTTP/1.1" status: 200 len: 216 time: 0.0081339 May 28 13:02:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2b6cc2-9a1d-45c1-9a82-7706e8aa5d69 service neutron] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2b6cc2-9a1d-45c1-9a82-7706e8aa5d69 service neutron] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edeaf9ff-5853-4f82-8a0f-38d96b581059 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeaf9ff-5853-4f82-8a0f-38d96b581059 None admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeaf9ff-5853-4f82-8a0f-38d96b581059 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeaf9ff-5853-4f82-8a0f-38d96b581059 None admin] PATH_INFO: `/v3/projects/e0a7371d578542ecbb1cfaa96bd52e2d` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edeaf9ff-5853-4f82-8a0f-38d96b581059 None admin] RBAC: Authorizing `identity:delete_project(project_id=e0a7371d578542ecbb1cfaa96bd52e2d)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edeaf9ff-5853-4f82-8a0f-38d96b581059 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-edeaf9ff-5853-4f82-8a0f-38d96b581059 None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0a7371d578542ecbb1cfaa96bd52e2d', 'request_id': 'req-edeaf9ff-5853-4f82-8a0f-38d96b581059'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-edeaf9ff-5853-4f82-8a0f-38d96b581059 None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0a7371d578542ecbb1cfaa96bd52e2d', 'request_id': 'req-edeaf9ff-5853-4f82-8a0f-38d96b581059'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-edeaf9ff-5853-4f82-8a0f-38d96b581059 None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0a7371d578542ecbb1cfaa96bd52e2d', 'request_id': 'req-edeaf9ff-5853-4f82-8a0f-38d96b581059'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-edeaf9ff-5853-4f82-8a0f-38d96b581059 None admin] The token cache is being invalidate because project e0a7371d578542ecbb1cfaa96bd52e2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 13:02:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-edeaf9ff-5853-4f82-8a0f-38d96b581059 None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-edeaf9ff-5853-4f82-8a0f-38d96b581059 None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:07 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1664/3299] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 13:02:07 2024] DELETE /identity/v3/projects/e0a7371d578542ecbb1cfaa96bd52e2d => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:02:07 l75lg1-v1 dstat.sh[49771]: 28-05 13:02:07| 14 2 81 3 0|5637M 1791M 278M 7918M| 13k 6451B| 0 2268k| 0 360 |9610 16k|0.98 1.13 1.05|2.0 1.0 0| 0 0 | 0 2048M| 29 364 0 38 2 May 28 13:02:07 l75lg1-v1 neutron-server[77618]: DEBUG neutron.wsgi [-] (77618) accepted ('10.27.203.238', 44894) {{(pid=77618) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 13:02:07 l75lg1-v1 neutron-server[77618]: INFO neutron.wsgi [None req-1c4cdb7f-2138-4152-8ffc-abc41e84a494 None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=5a50842c7ef74c318ec157a9ebe9442d&name=default HTTP/1.1" status: 200 len: 216 time: 0.0084953 May 28 13:02:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6373517d-59cb-40d2-a835-619f468090d7 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-6373517d-59cb-40d2-a835-619f468090d7 None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:02:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6373517d-59cb-40d2-a835-619f468090d7 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba56c70-d579-4837-a4c5-e134cb49992e None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba56c70-d579-4837-a4c5-e134cb49992e None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba56c70-d579-4837-a4c5-e134cb49992e None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba56c70-d579-4837-a4c5-e134cb49992e None admin] PATH_INFO: `/v3/projects/5a50842c7ef74c318ec157a9ebe9442d` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba56c70-d579-4837-a4c5-e134cb49992e None admin] RBAC: Authorizing `identity:delete_project(project_id=5a50842c7ef74c318ec157a9ebe9442d)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba56c70-d579-4837-a4c5-e134cb49992e None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-6ba56c70-d579-4837-a4c5-e134cb49992e None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a50842c7ef74c318ec157a9ebe9442d', 'request_id': 'req-6ba56c70-d579-4837-a4c5-e134cb49992e'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-6ba56c70-d579-4837-a4c5-e134cb49992e None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a50842c7ef74c318ec157a9ebe9442d', 'request_id': 'req-6ba56c70-d579-4837-a4c5-e134cb49992e'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-6ba56c70-d579-4837-a4c5-e134cb49992e None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a50842c7ef74c318ec157a9ebe9442d', 'request_id': 'req-6ba56c70-d579-4837-a4c5-e134cb49992e'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-6ba56c70-d579-4837-a4c5-e134cb49992e None admin] The token cache is being invalidate because project 5a50842c7ef74c318ec157a9ebe9442d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 13:02:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-6ba56c70-d579-4837-a4c5-e134cb49992e None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-6ba56c70-d579-4837-a4c5-e134cb49992e None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:07 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1636/3300] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 13:02:07 2024] DELETE /identity/v3/projects/5a50842c7ef74c318ec157a9ebe9442d => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:02:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3aae05-a61f-4e0a-82b4-b8bf29969f90 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3aae05-a61f-4e0a-82b4-b8bf29969f90 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3aae05-a61f-4e0a-82b4-b8bf29969f90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:07 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-0a3aae05-a61f-4e0a-82b4-b8bf29969f90 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 13:02:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-0a3aae05-a61f-4e0a-82b4-b8bf29969f90 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 13:02:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-0a3aae05-a61f-4e0a-82b4-b8bf29969f90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:02:07 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1665/3301] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 13:02:07 2024] POST /identity/v3/auth/tokens => generated 312 bytes in 20 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 28 13:02:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d213c7d3-5cef-437f-808d-0eefeaede575 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d213c7d3-5cef-437f-808d-0eefeaede575 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d213c7d3-5cef-437f-808d-0eefeaede575 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:07 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-d213c7d3-5cef-437f-808d-0eefeaede575 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 13:02:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-d213c7d3-5cef-437f-808d-0eefeaede575 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 13:02:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-d213c7d3-5cef-437f-808d-0eefeaede575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:02:07 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1637/3302] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 13:02:07 2024] POST /identity/v3/auth/tokens => generated 2960 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 13:02:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3aae05-a61f-4e0a-82b4-b8bf29969f90 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3aae05-a61f-4e0a-82b4-b8bf29969f90 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f0115d-07aa-4496-84aa-2a08499c90dd None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f0115d-07aa-4496-84aa-2a08499c90dd None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f0115d-07aa-4496-84aa-2a08499c90dd None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f0115d-07aa-4496-84aa-2a08499c90dd None admin] PATH_INFO: `/v3/domains` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f0115d-07aa-4496-84aa-2a08499c90dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=51267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 13:02:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f0115d-07aa-4496-84aa-2a08499c90dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f0115d-07aa-4496-84aa-2a08499c90dd None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:07 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1666/3303] 10.27.203.238 () {62 vars in 1220 bytes} [Tue May 28 13:02:07 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 13:02:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d213c7d3-5cef-437f-808d-0eefeaede575 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d213c7d3-5cef-437f-808d-0eefeaede575 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe8e378-1eff-4050-b37d-fc1155573869 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe8e378-1eff-4050-b37d-fc1155573869 None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe8e378-1eff-4050-b37d-fc1155573869 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe8e378-1eff-4050-b37d-fc1155573869 None admin] PATH_INFO: `/v3/projects` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe8e378-1eff-4050-b37d-fc1155573869 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe8e378-1eff-4050-b37d-fc1155573869 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:07 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1638/3304] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 13:02:07 2024] POST /identity/v3/projects => generated 405 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 13:02:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f0115d-07aa-4496-84aa-2a08499c90dd None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f0115d-07aa-4496-84aa-2a08499c90dd None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad38faa5-d0ef-431f-86f3-e6090bbf07c8 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad38faa5-d0ef-431f-86f3-e6090bbf07c8 None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad38faa5-d0ef-431f-86f3-e6090bbf07c8 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad38faa5-d0ef-431f-86f3-e6090bbf07c8 None admin] PATH_INFO: `/v3/users` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad38faa5-d0ef-431f-86f3-e6090bbf07c8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad38faa5-d0ef-431f-86f3-e6090bbf07c8 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:07 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-ad38faa5-d0ef-431f-86f3-e6090bbf07c8 None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 13:02:07 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1667/3305] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 13:02:07 2024] POST /identity/v3/users => generated 311 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 13:02:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe8e378-1eff-4050-b37d-fc1155573869 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe8e378-1eff-4050-b37d-fc1155573869 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb7bfef-5d5e-44b4-a71d-7ec5cbb8695e None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb7bfef-5d5e-44b4-a71d-7ec5cbb8695e None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb7bfef-5d5e-44b4-a71d-7ec5cbb8695e None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb7bfef-5d5e-44b4-a71d-7ec5cbb8695e None admin] PATH_INFO: `/v3/roles` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb7bfef-5d5e-44b4-a71d-7ec5cbb8695e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb7bfef-5d5e-44b4-a71d-7ec5cbb8695e None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:07 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1639/3306] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 13:02:07 2024] GET /identity/v3/roles => generated 1680 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 13:02:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad38faa5-d0ef-431f-86f3-e6090bbf07c8 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad38faa5-d0ef-431f-86f3-e6090bbf07c8 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d819799d-8a0b-4dd9-9311-409dd086db37 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d819799d-8a0b-4dd9-9311-409dd086db37 None admin] REQUEST_METHOD: `PUT` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d819799d-8a0b-4dd9-9311-409dd086db37 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d819799d-8a0b-4dd9-9311-409dd086db37 None admin] PATH_INFO: `/v3/projects/b00df7df3db14cce99343fc7f6ffd796/users/fe150a2857cc4ed1a4b19bc996c70bff/roles/44620cad10ae407c90c91e2c296adb04` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d819799d-8a0b-4dd9-9311-409dd086db37 None admin] RBAC: Authorizing `identity:create_grant(project_id=b00df7df3db14cce99343fc7f6ffd796, user_id=fe150a2857cc4ed1a4b19bc996c70bff, role_id=44620cad10ae407c90c91e2c296adb04)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d819799d-8a0b-4dd9-9311-409dd086db37 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:07 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1668/3307] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 13:02:07 2024] PUT /identity/v3/projects/b00df7df3db14cce99343fc7f6ffd796/users/fe150a2857cc4ed1a4b19bc996c70bff/roles/44620cad10ae407c90c91e2c296adb04 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:02:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09071276-5b92-4ac3-934c-2c54e43a0ac4 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09071276-5b92-4ac3-934c-2c54e43a0ac4 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09071276-5b92-4ac3-934c-2c54e43a0ac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:07 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-09071276-5b92-4ac3-934c-2c54e43a0ac4 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 13:02:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-09071276-5b92-4ac3-934c-2c54e43a0ac4 None None] MFA Rules not processed for user `fe150a2857cc4ed1a4b19bc996c70bff`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 13:02:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-09071276-5b92-4ac3-934c-2c54e43a0ac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:02:07 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1640/3308] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 13:02:07 2024] POST /identity/v3/auth/tokens => generated 3976 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 13:02:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d819799d-8a0b-4dd9-9311-409dd086db37 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d819799d-8a0b-4dd9-9311-409dd086db37 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e085a4c0-5c65-48a1-a9eb-d27c20430b05 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e085a4c0-5c65-48a1-a9eb-d27c20430b05 None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e085a4c0-5c65-48a1-a9eb-d27c20430b05 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e085a4c0-5c65-48a1-a9eb-d27c20430b05 None admin] PATH_INFO: `/v3/projects` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e085a4c0-5c65-48a1-a9eb-d27c20430b05 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e085a4c0-5c65-48a1-a9eb-d27c20430b05 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:07 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1669/3309] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 13:02:07 2024] POST /identity/v3/projects => generated 405 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 13:02:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09071276-5b92-4ac3-934c-2c54e43a0ac4 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09071276-5b92-4ac3-934c-2c54e43a0ac4 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f8d46d-7ebd-476a-8163-45553e91bbf0 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f8d46d-7ebd-476a-8163-45553e91bbf0 None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f8d46d-7ebd-476a-8163-45553e91bbf0 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f8d46d-7ebd-476a-8163-45553e91bbf0 None admin] PATH_INFO: `/v3/users` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f8d46d-7ebd-476a-8163-45553e91bbf0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f8d46d-7ebd-476a-8163-45553e91bbf0 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:07 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-b2f8d46d-7ebd-476a-8163-45553e91bbf0 None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 13:02:07 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1641/3310] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 13:02:07 2024] POST /identity/v3/users => generated 311 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 13:02:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e085a4c0-5c65-48a1-a9eb-d27c20430b05 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e085a4c0-5c65-48a1-a9eb-d27c20430b05 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd480b1-945d-4a2c-afa1-7adb45dddd8f None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd480b1-945d-4a2c-afa1-7adb45dddd8f None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd480b1-945d-4a2c-afa1-7adb45dddd8f None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd480b1-945d-4a2c-afa1-7adb45dddd8f None admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd480b1-945d-4a2c-afa1-7adb45dddd8f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd480b1-945d-4a2c-afa1-7adb45dddd8f None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:07 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1670/3311] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 13:02:07 2024] GET /identity/v3/roles => generated 1680 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 13:02:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f8d46d-7ebd-476a-8163-45553e91bbf0 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f8d46d-7ebd-476a-8163-45553e91bbf0 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9464b26-674a-4cbf-a2d7-6f8533fd3cf0 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9464b26-674a-4cbf-a2d7-6f8533fd3cf0 None admin] REQUEST_METHOD: `PUT` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9464b26-674a-4cbf-a2d7-6f8533fd3cf0 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9464b26-674a-4cbf-a2d7-6f8533fd3cf0 None admin] PATH_INFO: `/v3/projects/ded8bc00b1304a8e9cdbd5ef76eeaae8/users/d665b4918b364dfc8ed49e35b7728d62/roles/44620cad10ae407c90c91e2c296adb04` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9464b26-674a-4cbf-a2d7-6f8533fd3cf0 None admin] RBAC: Authorizing `identity:create_grant(project_id=ded8bc00b1304a8e9cdbd5ef76eeaae8, user_id=d665b4918b364dfc8ed49e35b7728d62, role_id=44620cad10ae407c90c91e2c296adb04)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:07 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9464b26-674a-4cbf-a2d7-6f8533fd3cf0 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:07 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-456606ee-0aac-4531-afba-33972086a8e2 tempest-SharesRenameTest-1796622866 None] <<< [DELETE] https://127.0.0.1:40443/api/snapshots/15/ May 28 13:02:07 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-456606ee-0aac-4531-afba-33972086a8e2 tempest-SharesRenameTest-1796622866 None] --- [DELETE] https://127.0.0.1:40443/api/snapshots/15/: Done May 28 13:02:07 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1642/3312] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 13:02:07 2024] PUT /identity/v3/projects/ded8bc00b1304a8e9cdbd5ef76eeaae8/users/d665b4918b364dfc8ed49e35b7728d62/roles/44620cad10ae407c90c91e2c296adb04 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:02:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4a60da-8130-402b-b059-f7dd8589a07e None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4a60da-8130-402b-b059-f7dd8589a07e None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4a60da-8130-402b-b059-f7dd8589a07e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:07 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-8d4a60da-8130-402b-b059-f7dd8589a07e None None] Truncating password to algorithm specific maximum length 72 characters. May 28 13:02:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-8d4a60da-8130-402b-b059-f7dd8589a07e None None] MFA Rules not processed for user `d665b4918b364dfc8ed49e35b7728d62`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 13:02:07 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-8d4a60da-8130-402b-b059-f7dd8589a07e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:02:08 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-456606ee-0aac-4531-afba-33972086a8e2 tempest-SharesRenameTest-1796622866 None] Created reservations ['f62d3aea-c5be-4dd7-8a91-aea92480e916', '9b507441-73b5-40aa-9930-69947be5d4b2', 'bbcebe79-459f-4e4c-bbe7-e6d61599a6a9', '9b23524f-e76c-413e-b0e1-5f1b75e8271a'] {{(pid=98474) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 13:02:08 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1671/3313] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 13:02:07 2024] POST /identity/v3/auth/tokens => generated 3976 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 13:02:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9464b26-674a-4cbf-a2d7-6f8533fd3cf0 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:08 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-456606ee-0aac-4531-afba-33972086a8e2 tempest-SharesRenameTest-1796622866 None] Committed reservations ['f62d3aea-c5be-4dd7-8a91-aea92480e916', '9b507441-73b5-40aa-9930-69947be5d4b2', 'bbcebe79-459f-4e4c-bbe7-e6d61599a6a9', '9b23524f-e76c-413e-b0e1-5f1b75e8271a'] {{(pid=98474) commit /opt/stack/manila/manila/quota.py:1063}} May 28 13:02:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9464b26-674a-4cbf-a2d7-6f8533fd3cf0 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d11973a-fe5a-4c2f-b618-e87c5eb1fba7 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d11973a-fe5a-4c2f-b618-e87c5eb1fba7 None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d11973a-fe5a-4c2f-b618-e87c5eb1fba7 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d11973a-fe5a-4c2f-b618-e87c5eb1fba7 None admin] PATH_INFO: `/v3/projects` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d11973a-fe5a-4c2f-b618-e87c5eb1fba7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d11973a-fe5a-4c2f-b618-e87c5eb1fba7 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:08 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1643/3314] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 13:02:08 2024] POST /identity/v3/projects => generated 405 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 13:02:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4a60da-8130-402b-b059-f7dd8589a07e None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4a60da-8130-402b-b059-f7dd8589a07e None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c637b75d-1e12-4891-b9c4-c5af19b68337 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c637b75d-1e12-4891-b9c4-c5af19b68337 None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c637b75d-1e12-4891-b9c4-c5af19b68337 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c637b75d-1e12-4891-b9c4-c5af19b68337 None admin] PATH_INFO: `/v3/users` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c637b75d-1e12-4891-b9c4-c5af19b68337 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c637b75d-1e12-4891-b9c4-c5af19b68337 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:08 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-c637b75d-1e12-4891-b9c4-c5af19b68337 None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 13:02:08 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1672/3315] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 13:02:08 2024] POST /identity/v3/users => generated 310 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 13:02:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d11973a-fe5a-4c2f-b618-e87c5eb1fba7 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d11973a-fe5a-4c2f-b618-e87c5eb1fba7 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7954547c-eb29-4fa2-a167-26da0f8f9bb5 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7954547c-eb29-4fa2-a167-26da0f8f9bb5 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7954547c-eb29-4fa2-a167-26da0f8f9bb5 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7954547c-eb29-4fa2-a167-26da0f8f9bb5 None admin] PATH_INFO: `/v3/roles` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7954547c-eb29-4fa2-a167-26da0f8f9bb5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7954547c-eb29-4fa2-a167-26da0f8f9bb5 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:08 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1644/3316] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 13:02:08 2024] GET /identity/v3/roles => generated 1680 bytes in 19 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 13:02:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c637b75d-1e12-4891-b9c4-c5af19b68337 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c637b75d-1e12-4891-b9c4-c5af19b68337 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7871dc8c-b6bf-4d11-b374-307cfa0f927d None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7871dc8c-b6bf-4d11-b374-307cfa0f927d None admin] REQUEST_METHOD: `PUT` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7871dc8c-b6bf-4d11-b374-307cfa0f927d None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7871dc8c-b6bf-4d11-b374-307cfa0f927d None admin] PATH_INFO: `/v3/projects/fb57334a24554a788ef7508e78b0d664/users/376994db8e664651b0e2019c32e48f36/roles/e7989893488f483baa107be56668c4f8` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7871dc8c-b6bf-4d11-b374-307cfa0f927d None admin] RBAC: Authorizing `identity:create_grant(project_id=fb57334a24554a788ef7508e78b0d664, user_id=376994db8e664651b0e2019c32e48f36, role_id=e7989893488f483baa107be56668c4f8)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7871dc8c-b6bf-4d11-b374-307cfa0f927d None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:08 l75lg1-v1 dstat.sh[49771]: 28-05 13:02:08| 10 1 85 3 0|5639M 1789M 278M 7918M| 11k 66B| 0 2132k| 0 285 |7651 13k|0.98 1.13 1.05|1.0 1.0 2.0| 0 0 | 0 2048M| 29 364 0 39 2 May 28 13:02:08 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1673/3317] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 13:02:08 2024] PUT /identity/v3/projects/fb57334a24554a788ef7508e78b0d664/users/376994db8e664651b0e2019c32e48f36/roles/e7989893488f483baa107be56668c4f8 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:02:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7954547c-eb29-4fa2-a167-26da0f8f9bb5 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7954547c-eb29-4fa2-a167-26da0f8f9bb5 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8810cfac-4a74-4286-b1f3-919dab71f0ae None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8810cfac-4a74-4286-b1f3-919dab71f0ae None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8810cfac-4a74-4286-b1f3-919dab71f0ae None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8810cfac-4a74-4286-b1f3-919dab71f0ae None admin] PATH_INFO: `/v3/roles` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8810cfac-4a74-4286-b1f3-919dab71f0ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8810cfac-4a74-4286-b1f3-919dab71f0ae None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:08 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1645/3318] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 13:02:08 2024] GET /identity/v3/roles => generated 1680 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 13:02:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7871dc8c-b6bf-4d11-b374-307cfa0f927d None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7871dc8c-b6bf-4d11-b374-307cfa0f927d None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d74ee42-8015-457d-bd58-6c75ba94e90f None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d74ee42-8015-457d-bd58-6c75ba94e90f None admin] REQUEST_METHOD: `PUT` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d74ee42-8015-457d-bd58-6c75ba94e90f None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d74ee42-8015-457d-bd58-6c75ba94e90f None admin] PATH_INFO: `/v3/projects/fb57334a24554a788ef7508e78b0d664/users/376994db8e664651b0e2019c32e48f36/roles/e7989893488f483baa107be56668c4f8` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d74ee42-8015-457d-bd58-6c75ba94e90f None admin] RBAC: Authorizing `identity:create_grant(project_id=fb57334a24554a788ef7508e78b0d664, user_id=376994db8e664651b0e2019c32e48f36, role_id=e7989893488f483baa107be56668c4f8)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d74ee42-8015-457d-bd58-6c75ba94e90f None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:08 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1674/3319] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 13:02:08 2024] PUT /identity/v3/projects/fb57334a24554a788ef7508e78b0d664/users/376994db8e664651b0e2019c32e48f36/roles/e7989893488f483baa107be56668c4f8 => generated 0 bytes in 21 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:02:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37590076-1e92-473c-9f57-3790cbb8d728 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37590076-1e92-473c-9f57-3790cbb8d728 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37590076-1e92-473c-9f57-3790cbb8d728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:08 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-37590076-1e92-473c-9f57-3790cbb8d728 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 13:02:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-37590076-1e92-473c-9f57-3790cbb8d728 None None] MFA Rules not processed for user `376994db8e664651b0e2019c32e48f36`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 13:02:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-37590076-1e92-473c-9f57-3790cbb8d728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:02:08 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1646/3320] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 13:02:08 2024] POST /identity/v3/auth/tokens => generated 4099 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 13:02:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d74ee42-8015-457d-bd58-6c75ba94e90f None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d74ee42-8015-457d-bd58-6c75ba94e90f None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293992a5-2f22-4688-8b07-88a1353798ff tempest-ShareSnapshotMetadataNegativeTest-1690283503 tempest-ShareSnapshotMetadataNegativeTest-1690283503-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '376994db8e664651b0e2019c32e48f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57334a24554a788ef7508e78b0d664', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293992a5-2f22-4688-8b07-88a1353798ff tempest-ShareSnapshotMetadataNegativeTest-1690283503 tempest-ShareSnapshotMetadataNegativeTest-1690283503-project-admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293992a5-2f22-4688-8b07-88a1353798ff tempest-ShareSnapshotMetadataNegativeTest-1690283503 tempest-ShareSnapshotMetadataNegativeTest-1690283503-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293992a5-2f22-4688-8b07-88a1353798ff tempest-ShareSnapshotMetadataNegativeTest-1690283503 tempest-ShareSnapshotMetadataNegativeTest-1690283503-project-admin] PATH_INFO: `/v3/domains` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293992a5-2f22-4688-8b07-88a1353798ff tempest-ShareSnapshotMetadataNegativeTest-1690283503 tempest-ShareSnapshotMetadataNegativeTest-1690283503-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=51267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 13:02:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293992a5-2f22-4688-8b07-88a1353798ff tempest-ShareSnapshotMetadataNegativeTest-1690283503 tempest-ShareSnapshotMetadataNegativeTest-1690283503-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293992a5-2f22-4688-8b07-88a1353798ff tempest-ShareSnapshotMetadataNegativeTest-1690283503 tempest-ShareSnapshotMetadataNegativeTest-1690283503-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:08 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1675/3321] 10.27.203.238 () {62 vars in 1241 bytes} [Tue May 28 13:02:08 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 13:02:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37590076-1e92-473c-9f57-3790cbb8d728 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37590076-1e92-473c-9f57-3790cbb8d728 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0bb696-2d0c-4363-a58a-a04ad21cd710 tempest-ShareSnapshotMetadataNegativeTest-1690283503 tempest-ShareSnapshotMetadataNegativeTest-1690283503-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '376994db8e664651b0e2019c32e48f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57334a24554a788ef7508e78b0d664', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0bb696-2d0c-4363-a58a-a04ad21cd710 tempest-ShareSnapshotMetadataNegativeTest-1690283503 tempest-ShareSnapshotMetadataNegativeTest-1690283503-project-admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0bb696-2d0c-4363-a58a-a04ad21cd710 tempest-ShareSnapshotMetadataNegativeTest-1690283503 tempest-ShareSnapshotMetadataNegativeTest-1690283503-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0bb696-2d0c-4363-a58a-a04ad21cd710 tempest-ShareSnapshotMetadataNegativeTest-1690283503 tempest-ShareSnapshotMetadataNegativeTest-1690283503-project-admin] PATH_INFO: `/v3/users` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0bb696-2d0c-4363-a58a-a04ad21cd710 tempest-ShareSnapshotMetadataNegativeTest-1690283503 tempest-ShareSnapshotMetadataNegativeTest-1690283503-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0bb696-2d0c-4363-a58a-a04ad21cd710 tempest-ShareSnapshotMetadataNegativeTest-1690283503 tempest-ShareSnapshotMetadataNegativeTest-1690283503-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:08 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-4e0bb696-2d0c-4363-a58a-a04ad21cd710 tempest-ShareSnapshotMetadataNegativeTest-1690283503 tempest-ShareSnapshotMetadataNegativeTest-1690283503-project-admin] Truncating password to algorithm specific maximum length 72 characters. May 28 13:02:08 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1647/3322] 10.27.203.238 () {64 vars in 1232 bytes} [Tue May 28 13:02:08 2024] POST /identity/v3/users => generated 433 bytes in 35 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 13:02:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293992a5-2f22-4688-8b07-88a1353798ff tempest-ShareSnapshotMetadataNegativeTest-1690283503 tempest-ShareSnapshotMetadataNegativeTest-1690283503-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293992a5-2f22-4688-8b07-88a1353798ff tempest-ShareSnapshotMetadataNegativeTest-1690283503 tempest-ShareSnapshotMetadataNegativeTest-1690283503-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c420f89d-ac0f-439a-880e-97053192c68b tempest-ShareSnapshotMetadataNegativeTest-1690283503 tempest-ShareSnapshotMetadataNegativeTest-1690283503-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '376994db8e664651b0e2019c32e48f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57334a24554a788ef7508e78b0d664', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c420f89d-ac0f-439a-880e-97053192c68b tempest-ShareSnapshotMetadataNegativeTest-1690283503 tempest-ShareSnapshotMetadataNegativeTest-1690283503-project-admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c420f89d-ac0f-439a-880e-97053192c68b tempest-ShareSnapshotMetadataNegativeTest-1690283503 tempest-ShareSnapshotMetadataNegativeTest-1690283503-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c420f89d-ac0f-439a-880e-97053192c68b tempest-ShareSnapshotMetadataNegativeTest-1690283503 tempest-ShareSnapshotMetadataNegativeTest-1690283503-project-admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c420f89d-ac0f-439a-880e-97053192c68b tempest-ShareSnapshotMetadataNegativeTest-1690283503 tempest-ShareSnapshotMetadataNegativeTest-1690283503-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c420f89d-ac0f-439a-880e-97053192c68b tempest-ShareSnapshotMetadataNegativeTest-1690283503 tempest-ShareSnapshotMetadataNegativeTest-1690283503-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:08 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1676/3323] 10.27.203.238 () {62 vars in 1210 bytes} [Tue May 28 13:02:08 2024] GET /identity/v3/roles => generated 1680 bytes in 17 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 13:02:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0bb696-2d0c-4363-a58a-a04ad21cd710 tempest-ShareSnapshotMetadataNegativeTest-1690283503 tempest-ShareSnapshotMetadataNegativeTest-1690283503-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0bb696-2d0c-4363-a58a-a04ad21cd710 tempest-ShareSnapshotMetadataNegativeTest-1690283503 tempest-ShareSnapshotMetadataNegativeTest-1690283503-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc1cdd9-98ba-4bc4-a03e-5633e0cd6237 tempest-ShareSnapshotMetadataNegativeTest-1690283503 tempest-ShareSnapshotMetadataNegativeTest-1690283503-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '376994db8e664651b0e2019c32e48f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57334a24554a788ef7508e78b0d664', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc1cdd9-98ba-4bc4-a03e-5633e0cd6237 tempest-ShareSnapshotMetadataNegativeTest-1690283503 tempest-ShareSnapshotMetadataNegativeTest-1690283503-project-admin] REQUEST_METHOD: `PUT` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc1cdd9-98ba-4bc4-a03e-5633e0cd6237 tempest-ShareSnapshotMetadataNegativeTest-1690283503 tempest-ShareSnapshotMetadataNegativeTest-1690283503-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc1cdd9-98ba-4bc4-a03e-5633e0cd6237 tempest-ShareSnapshotMetadataNegativeTest-1690283503 tempest-ShareSnapshotMetadataNegativeTest-1690283503-project-admin] PATH_INFO: `/v3/projects/fb57334a24554a788ef7508e78b0d664/users/df40dca89a8343239f2a0f80b681621f/roles/44620cad10ae407c90c91e2c296adb04` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc1cdd9-98ba-4bc4-a03e-5633e0cd6237 tempest-ShareSnapshotMetadataNegativeTest-1690283503 tempest-ShareSnapshotMetadataNegativeTest-1690283503-project-admin] RBAC: Authorizing `identity:create_grant(project_id=fb57334a24554a788ef7508e78b0d664, user_id=df40dca89a8343239f2a0f80b681621f, role_id=44620cad10ae407c90c91e2c296adb04)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc1cdd9-98ba-4bc4-a03e-5633e0cd6237 tempest-ShareSnapshotMetadataNegativeTest-1690283503 tempest-ShareSnapshotMetadataNegativeTest-1690283503-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:08 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1648/3324] 10.27.203.238 () {64 vars in 1571 bytes} [Tue May 28 13:02:08 2024] PUT /identity/v3/projects/fb57334a24554a788ef7508e78b0d664/users/df40dca89a8343239f2a0f80b681621f/roles/44620cad10ae407c90c91e2c296adb04 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:02:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c420f89d-ac0f-439a-880e-97053192c68b tempest-ShareSnapshotMetadataNegativeTest-1690283503 tempest-ShareSnapshotMetadataNegativeTest-1690283503-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-c420f89d-ac0f-439a-880e-97053192c68b tempest-ShareSnapshotMetadataNegativeTest-1690283503 tempest-ShareSnapshotMetadataNegativeTest-1690283503-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:02:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c420f89d-ac0f-439a-880e-97053192c68b tempest-ShareSnapshotMetadataNegativeTest-1690283503 tempest-ShareSnapshotMetadataNegativeTest-1690283503-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e2d981-83f3-40bf-ac14-cc67c9bfe346 service manila] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f110cf6300f049c897d0aab63218d1e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e2d981-83f3-40bf-ac14-cc67c9bfe346 service manila] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e2d981-83f3-40bf-ac14-cc67c9bfe346 service manila] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e2d981-83f3-40bf-ac14-cc67c9bfe346 service manila] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e2d981-83f3-40bf-ac14-cc67c9bfe346 service manila] RBAC: Authorizing `identity:validate_token()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:08 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e2d981-83f3-40bf-ac14-cc67c9bfe346 service manila] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:08 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1677/3325] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 13:02:08 2024] GET /identity/v3/auth/tokens => generated 4099 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 13:02:08 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-0b27d208-275b-49fc-ae5b-39b511447051 tempest-ShareSnapshotMetadataNegativeTest-1690283503 tempest-ShareSnapshotMetadataNegativeTest-1690283503-project-admin] POST http://10.27.203.238/share/v2/fb57334a24554a788ef7508e78b0d664/types May 28 13:02:08 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-0b27d208-275b-49fc-ae5b-39b511447051 tempest-ShareSnapshotMetadataNegativeTest-1690283503 tempest-ShareSnapshotMetadataNegativeTest-1690283503-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share_type": {"name": "tempest-typeshare-type-1473039127", "extra_specs": {"driver_handles_share_servers": "False", "snapshot_support": true}, "share_type_access:is_public": true}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:02:08 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-0b27d208-275b-49fc-ae5b-39b511447051 tempest-ShareSnapshotMetadataNegativeTest-1690283503 tempest-ShareSnapshotMetadataNegativeTest-1690283503-project-admin] http://10.27.203.238/share/v2/fb57334a24554a788ef7508e78b0d664/types returned with HTTP 200 May 28 13:02:08 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1214/2404] 10.27.203.238 () {66 vars in 1359 bytes} [Tue May 28 13:02:08 2024] POST /share/v2/fb57334a24554a788ef7508e78b0d664/types => generated 679 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:02:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc1cdd9-98ba-4bc4-a03e-5633e0cd6237 tempest-ShareSnapshotMetadataNegativeTest-1690283503 tempest-ShareSnapshotMetadataNegativeTest-1690283503-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-dfc1cdd9-98ba-4bc4-a03e-5633e0cd6237 tempest-ShareSnapshotMetadataNegativeTest-1690283503 tempest-ShareSnapshotMetadataNegativeTest-1690283503-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:02:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc1cdd9-98ba-4bc4-a03e-5633e0cd6237 tempest-ShareSnapshotMetadataNegativeTest-1690283503 tempest-ShareSnapshotMetadataNegativeTest-1690283503-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa75c6a-8c6e-4b55-a94c-203c2cce1d04 service manila] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f110cf6300f049c897d0aab63218d1e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa75c6a-8c6e-4b55-a94c-203c2cce1d04 service manila] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa75c6a-8c6e-4b55-a94c-203c2cce1d04 service manila] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa75c6a-8c6e-4b55-a94c-203c2cce1d04 service manila] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa75c6a-8c6e-4b55-a94c-203c2cce1d04 service manila] RBAC: Authorizing `identity:validate_token()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:08 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa75c6a-8c6e-4b55-a94c-203c2cce1d04 service manila] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:08 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1649/3326] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 13:02:08 2024] GET /identity/v3/auth/tokens => generated 3976 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 13:02:08 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-447a5d29-baac-4a1a-b819-7473f7d2adbb tempest-ShareSnapshotMetadataNegativeTest-1199544441 tempest-ShareSnapshotMetadataNegativeTest-1199544441-project-member] POST http://10.27.203.238/share/v2/b00df7df3db14cce99343fc7f6ffd796/shares May 28 13:02:08 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-447a5d29-baac-4a1a-b819-7473f7d2adbb tempest-ShareSnapshotMetadataNegativeTest-1199544441 tempest-ShareSnapshotMetadataNegativeTest-1199544441-project-member] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share": {"share_proto": "nfs", "description": "tempest-tempest-share-description-223296053", "snapshot_id": null, "name": "tempest-tempest-share-name-1338061803", "size": 1, "metadata": {"foo_key_share_1": "foo_value_share_1", "bar_key_share_1": "foo_value_share_1"}, "is_public": false, "share_type": "7108e75e-c350-4f09-a603-af820cfc30f1"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:02:08 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.v1.shares [None req-447a5d29-baac-4a1a-b819-7473f7d2adbb tempest-ShareSnapshotMetadataNegativeTest-1199544441 tempest-ShareSnapshotMetadataNegativeTest-1199544441-project-member] Create NFS share of 1 GB May 28 13:02:08 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.quota [None req-447a5d29-baac-4a1a-b819-7473f7d2adbb tempest-ShareSnapshotMetadataNegativeTest-1199544441 tempest-ShareSnapshotMetadataNegativeTest-1199544441-project-member] Created reservations ['72ac820a-137a-4047-bc26-5c63f693c63d', '0b7cb1d2-09d7-45b5-ac6f-7a0cbddfac58', '5eb585d5-9449-4105-87fa-d19a349b11df', 'd5f85f7a-9c92-49b8-bb12-bd091dfa6d75'] {{(pid=98330) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 13:02:08 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.quota [None req-447a5d29-baac-4a1a-b819-7473f7d2adbb tempest-ShareSnapshotMetadataNegativeTest-1199544441 tempest-ShareSnapshotMetadataNegativeTest-1199544441-project-member] Committed reservations ['72ac820a-137a-4047-bc26-5c63f693c63d', '0b7cb1d2-09d7-45b5-ac6f-7a0cbddfac58', '5eb585d5-9449-4105-87fa-d19a349b11df', 'd5f85f7a-9c92-49b8-bb12-bd091dfa6d75'] {{(pid=98330) commit /opt/stack/manila/manila/quota.py:1063}} May 28 13:02:08 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.host_manager [None req-447a5d29-baac-4a1a-b819-7473f7d2adbb tempest-ShareSnapshotMetadataNegativeTest-1199544441 None] Share service is down. (host: l75lg1-v1@generic2). May 28 13:02:08 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.host_manager [None req-447a5d29-baac-4a1a-b819-7473f7d2adbb tempest-ShareSnapshotMetadataNegativeTest-1199544441 None] Share service is down. (host: l75lg1-v1@generic1). May 28 13:02:08 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-447a5d29-baac-4a1a-b819-7473f7d2adbb tempest-ShareSnapshotMetadataNegativeTest-1199544441 None] Starting with 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:80}} May 28 13:02:08 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-447a5d29-baac-4a1a-b819-7473f7d2adbb tempest-ShareSnapshotMetadataNegativeTest-1199544441 None] Filter OnlyHostFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:02:08 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-447a5d29-baac-4a1a-b819-7473f7d2adbb tempest-ShareSnapshotMetadataNegativeTest-1199544441 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:02:08 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.capacity [None req-447a5d29-baac-4a1a-b819-7473f7d2adbb tempest-ShareSnapshotMetadataNegativeTest-1199544441 None] Space information for share creation on host l75lg1-v1@vast#vast (requested / avail): 1/2081 {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/capacity.py:83}} May 28 13:02:08 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-447a5d29-baac-4a1a-b819-7473f7d2adbb tempest-ShareSnapshotMetadataNegativeTest-1199544441 None] Filter CapacityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:02:08 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-447a5d29-baac-4a1a-b819-7473f7d2adbb tempest-ShareSnapshotMetadataNegativeTest-1199544441 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:02:08 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-447a5d29-baac-4a1a-b819-7473f7d2adbb tempest-ShareSnapshotMetadataNegativeTest-1199544441 None] Driver Filter: Checking host 'l75lg1-v1@vast#vast' {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:37}} May 28 13:02:08 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-447a5d29-baac-4a1a-b819-7473f7d2adbb tempest-ShareSnapshotMetadataNegativeTest-1199544441 None] Filter function not set :: passing host. {{(pid=98327) _check_filter_function /opt/stack/manila/manila/scheduler/filters/driver.py:53}} May 28 13:02:08 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-447a5d29-baac-4a1a-b819-7473f7d2adbb tempest-ShareSnapshotMetadataNegativeTest-1199544441 None] Result: True {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:40}} May 28 13:02:08 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-447a5d29-baac-4a1a-b819-7473f7d2adbb tempest-ShareSnapshotMetadataNegativeTest-1199544441 None] Done checking host 'l75lg1-v1@vast#vast' {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:41}} May 28 13:02:08 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-447a5d29-baac-4a1a-b819-7473f7d2adbb tempest-ShareSnapshotMetadataNegativeTest-1199544441 None] Filter DriverFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:02:08 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-447a5d29-baac-4a1a-b819-7473f7d2adbb tempest-ShareSnapshotMetadataNegativeTest-1199544441 None] Filter ShareReplicationFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:02:08 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-447a5d29-baac-4a1a-b819-7473f7d2adbb tempest-ShareSnapshotMetadataNegativeTest-1199544441 None] Filter CreateFromSnapshotFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:02:08 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-447a5d29-baac-4a1a-b819-7473f7d2adbb tempest-ShareSnapshotMetadataNegativeTest-1199544441 None] Filter AffinityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:02:08 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-447a5d29-baac-4a1a-b819-7473f7d2adbb tempest-ShareSnapshotMetadataNegativeTest-1199544441 None] Filter AntiAffinityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:02:08 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-447a5d29-baac-4a1a-b819-7473f7d2adbb tempest-ShareSnapshotMetadataNegativeTest-1199544441 tempest-ShareSnapshotMetadataNegativeTest-1199544441-project-member] http://10.27.203.238/share/v2/b00df7df3db14cce99343fc7f6ffd796/shares returned with HTTP 200 May 28 13:02:08 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.drivers.filter [None req-447a5d29-baac-4a1a-b819-7473f7d2adbb tempest-ShareSnapshotMetadataNegativeTest-1199544441 None] Filtered share [host: 'l75lg1-v1@vast#vast', free_capacity_gb: 2081.605696829967, pools: None] {{(pid=98327) _schedule_share /opt/stack/manila/manila/scheduler/drivers/filter.py:268}} May 28 13:02:08 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1191/2405] 10.27.203.238 () {66 vars in 1362 bytes} [Tue May 28 13:02:08 2024] POST /share/v2/b00df7df3db14cce99343fc7f6ffd796/shares => generated 1416 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:02:08 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-447a5d29-baac-4a1a-b819-7473f7d2adbb tempest-ShareSnapshotMetadataNegativeTest-1199544441 None] Checking host 'l75lg1-v1@vast#vast' {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:46}} May 28 13:02:08 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.weighers.goodness [None req-447a5d29-baac-4a1a-b819-7473f7d2adbb tempest-ShareSnapshotMetadataNegativeTest-1199544441 None] Goodness function not set :: defaulting to minimal goodness rating of 0. May 28 13:02:08 l75lg1-v1 manila-scheduler[98327]: INFO manila.scheduler.weighers.goodness [None req-447a5d29-baac-4a1a-b819-7473f7d2adbb tempest-ShareSnapshotMetadataNegativeTest-1199544441 None] Goodness function result for host l75lg1-v1@vast#vast: 0. May 28 13:02:08 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-447a5d29-baac-4a1a-b819-7473f7d2adbb tempest-ShareSnapshotMetadataNegativeTest-1199544441 None] Goodness: 0 {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:48}} May 28 13:02:08 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-447a5d29-baac-4a1a-b819-7473f7d2adbb tempest-ShareSnapshotMetadataNegativeTest-1199544441 None] Done checking host 'l75lg1-v1@vast#vast' {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:49}} May 28 13:02:08 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.drivers.filter [None req-447a5d29-baac-4a1a-b819-7473f7d2adbb tempest-ShareSnapshotMetadataNegativeTest-1199544441 None] Choosing for share: WeighedHost [host: l75lg1-v1@vast#vast, weight: 0.0] {{(pid=98327) _schedule_share /opt/stack/manila/manila/scheduler/drivers/filter.py:274}} May 28 13:02:08 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-ce53bbdb-8d59-4f4d-891d-ec92c928369a tempest-ShareSnapshotMetadataNegativeTest-1199544441 tempest-ShareSnapshotMetadataNegativeTest-1199544441-project-member] GET http://10.27.203.238/share/v2/b00df7df3db14cce99343fc7f6ffd796/shares/1f5b6f0f-f341-4964-a2fa-9c4a26198f95 May 28 13:02:08 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-ce53bbdb-8d59-4f4d-891d-ec92c928369a tempest-ShareSnapshotMetadataNegativeTest-1199544441 tempest-ShareSnapshotMetadataNegativeTest-1199544441-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:02:08 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-ce53bbdb-8d59-4f4d-891d-ec92c928369a tempest-ShareSnapshotMetadataNegativeTest-1199544441 tempest-ShareSnapshotMetadataNegativeTest-1199544441-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:02:09 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-ce53bbdb-8d59-4f4d-891d-ec92c928369a tempest-ShareSnapshotMetadataNegativeTest-1199544441 tempest-ShareSnapshotMetadataNegativeTest-1199544441-project-member] http://10.27.203.238/share/v2/b00df7df3db14cce99343fc7f6ffd796/shares/1f5b6f0f-f341-4964-a2fa-9c4a26198f95 returned with HTTP 200 May 28 13:02:09 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1215/2406] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:02:08 2024] GET /share/v2/b00df7df3db14cce99343fc7f6ffd796/shares/1f5b6f0f-f341-4964-a2fa-9c4a26198f95 => generated 1416 bytes in 29 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:02:09 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b6e0fa39-9417-45ee-a0fb-19970a72b63f tempest-ShareRulesTest-1530341375 None] <<< [PATCH] https://127.0.0.1:40443/api/viewpolicies/38/ May 28 13:02:09 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b6e0fa39-9417-45ee-a0fb-19970a72b63f tempest-ShareRulesTest-1530341375 None] Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=1, created='2024-05-28T12:59:53.824250Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='0fa84ccd-850f-48fa-a965-23e5abe31188', id=38, internal=False, is_s3_default_policy=False, name='f7e47502-a0f7-44de-953d-b7b5697ae0b2', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=['*'], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['203.0.113.77'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['203.0.113.77'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='MODIFYING', sync_time='2024-05-28T13:02:08.230005Z', tenant_id=1, tenant_name='default', title='f7e47502-a0f7-44de-953d-b7b5697ae0b2', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/38/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[]) May 28 13:02:09 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b6e0fa39-9417-45ee-a0fb-19970a72b63f tempest-ShareRulesTest-1530341375 None] --- [PATCH] https://127.0.0.1:40443/api/viewpolicies/38/: Done May 28 13:02:09 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-b6e0fa39-9417-45ee-a0fb-19970a72b63f tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:02:09 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-b6e0fa39-9417-45ee-a0fb-19970a72b63f tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:02:09 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-447a5d29-baac-4a1a-b819-7473f7d2adbb tempest-ShareSnapshotMetadataNegativeTest-1199544441 None] >>> [GET] https://127.0.0.1:40443/api/vippools/ May 28 13:02:09 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-447a5d29-baac-4a1a-b819-7473f7d2adbb tempest-ShareSnapshotMetadataNegativeTest-1199544441 None] {'allow_redirects': True, 'params': {'name': 'vippool-1'}} May 28 13:02:09 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-b6e0fa39-9417-45ee-a0fb-19970a72b63f tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.073s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:02:09 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-b6e0fa39-9417-45ee-a0fb-19970a72b63f tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:02:09 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-b6e0fa39-9417-45ee-a0fb-19970a72b63f tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:02:09 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-b6e0fa39-9417-45ee-a0fb-19970a72b63f tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:02:09 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-b6e0fa39-9417-45ee-a0fb-19970a72b63f tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:02:09 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-b6e0fa39-9417-45ee-a0fb-19970a72b63f tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:02:09 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-b6e0fa39-9417-45ee-a0fb-19970a72b63f tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:02:09 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-b6e0fa39-9417-45ee-a0fb-19970a72b63f tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:02:09 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-b6e0fa39-9417-45ee-a0fb-19970a72b63f tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:02:09 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-b6e0fa39-9417-45ee-a0fb-19970a72b63f tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:02:09 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-b6e0fa39-9417-45ee-a0fb-19970a72b63f tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:02:09 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-b6e0fa39-9417-45ee-a0fb-19970a72b63f tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:02:09 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-b6e0fa39-9417-45ee-a0fb-19970a72b63f tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.041s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:02:09 l75lg1-v1 manila-share[98474]: INFO manila.share.access [None req-b6e0fa39-9417-45ee-a0fb-19970a72b63f tempest-ShareRulesTest-1530341375 None] Access rules were successfully modified for share instance f7e47502-a0f7-44de-953d-b7b5697ae0b2 belonging to share b330db31-7766-443d-9c19-26fe349665aa. May 28 13:02:09 l75lg1-v1 dstat.sh[49771]: 28-05 13:02:09| 9 1 85 3 0|5639M 1788M 278M 7918M| 16k 885B| 0 2250k| 0 301 |7123 12k|0.98 1.13 1.05|2.0 1.0 0| 0 0 | 0 2048M| 29 363 0 39 2 May 28 13:02:09 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-1858ce9b-707a-4483-9a26-4296e9fe9ba4 tempest-SharesRenameTest-1796622866 tempest-SharesRenameTest-1796622866-project-member] GET http://10.27.203.238/share/v2/6035b1be773e417b80fb3d9ea83eac8d/snapshots/7f6343fb-a88d-41ce-91e4-695cc9943965 May 28 13:02:09 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-1858ce9b-707a-4483-9a26-4296e9fe9ba4 tempest-SharesRenameTest-1796622866 tempest-SharesRenameTest-1796622866-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:02:09 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-1858ce9b-707a-4483-9a26-4296e9fe9ba4 tempest-SharesRenameTest-1796622866 tempest-SharesRenameTest-1796622866-project-member] Calling method 'ShareSnapshotMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:02:09 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-1858ce9b-707a-4483-9a26-4296e9fe9ba4 tempest-SharesRenameTest-1796622866 tempest-SharesRenameTest-1796622866-project-member] HTTP exception thrown: The resource could not be found. May 28 13:02:09 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-1858ce9b-707a-4483-9a26-4296e9fe9ba4 tempest-SharesRenameTest-1796622866 tempest-SharesRenameTest-1796622866-project-member] http://10.27.203.238/share/v2/6035b1be773e417b80fb3d9ea83eac8d/snapshots/7f6343fb-a88d-41ce-91e4-695cc9943965 returned with HTTP 404 May 28 13:02:09 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1192/2407] 10.27.203.238 () {64 vars in 1460 bytes} [Tue May 28 13:02:09 2024] GET /share/v2/6035b1be773e417b80fb3d9ea83eac8d/snapshots/7f6343fb-a88d-41ce-91e4-695cc9943965 => generated 78 bytes in 15 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 13:02:09 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-488351b7-5094-40c0-aee9-fa4c71c3b496 tempest-SharesRenameTest-1796622866 tempest-SharesRenameTest-1796622866-project-member] GET http://10.27.203.238/share/v2/6035b1be773e417b80fb3d9ea83eac8d/share-replicas/detail?share_id=e02829cb-d0c9-478e-80fa-e4ec0bf3843c May 28 13:02:09 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-488351b7-5094-40c0-aee9-fa4c71c3b496 tempest-SharesRenameTest-1796622866 tempest-SharesRenameTest-1796622866-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:02:09 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-488351b7-5094-40c0-aee9-fa4c71c3b496 tempest-SharesRenameTest-1796622866 tempest-SharesRenameTest-1796622866-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:02:09 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-488351b7-5094-40c0-aee9-fa4c71c3b496 tempest-SharesRenameTest-1796622866 tempest-SharesRenameTest-1796622866-project-member] http://10.27.203.238/share/v2/6035b1be773e417b80fb3d9ea83eac8d/share-replicas/detail?share_id=e02829cb-d0c9-478e-80fa-e4ec0bf3843c returned with HTTP 200 May 28 13:02:09 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1216/2408] 10.27.203.238 () {64 vars in 1476 bytes} [Tue May 28 13:02:09 2024] GET /share/v2/6035b1be773e417b80fb3d9ea83eac8d/share-replicas/detail?share_id=e02829cb-d0c9-478e-80fa-e4ec0bf3843c => generated 22 bytes in 13 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:02:09 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-fe856cb8-57dd-4a20-862f-6a305051d799 tempest-SharesRenameTest-1796622866 tempest-SharesRenameTest-1796622866-project-member] DELETE http://10.27.203.238/share/v2/6035b1be773e417b80fb3d9ea83eac8d/shares/e02829cb-d0c9-478e-80fa-e4ec0bf3843c May 28 13:02:09 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-fe856cb8-57dd-4a20-862f-6a305051d799 tempest-SharesRenameTest-1796622866 tempest-SharesRenameTest-1796622866-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:02:09 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-fe856cb8-57dd-4a20-862f-6a305051d799 tempest-SharesRenameTest-1796622866 tempest-SharesRenameTest-1796622866-project-member] Calling method 'ShareMixin.delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:02:09 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.v1.shares [None req-fe856cb8-57dd-4a20-862f-6a305051d799 tempest-SharesRenameTest-1796622866 tempest-SharesRenameTest-1796622866-project-member] Delete share with id: e02829cb-d0c9-478e-80fa-e4ec0bf3843c May 28 13:02:09 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-447a5d29-baac-4a1a-b819-7473f7d2adbb tempest-ShareSnapshotMetadataNegativeTest-1199544441 None] <<< [GET] https://127.0.0.1:40443/api/vippools/ May 28 13:02:09 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-447a5d29-baac-4a1a-b819-7473f7d2adbb tempest-ShareSnapshotMetadataNegativeTest-1199544441 None] [Bunch(active_cnode_ids=[], active_interfaces=4, cluster='loop75-kfs', cluster_id=1, cnode_ids=[], cnodes=[], domain_name='vippool-1', enable_l3=False, enable_weighted_balancing=False, enabled=True, end_ip='172.21.75.4', guid='f2abaede-b397-413a-8faa-3aeead6d3b28', gw_ip='', gw_ipv6='', id=2, ip_ranges=[['172.21.75.1', '172.21.75.4']], name='vippool-1', peer_asn=0, port_membership='ALL', ranges_summary='172.21.75.[1-4]', role='PROTOCOLS', start_ip='172.21.75.1', subnet_cidr=16, subnet_cidr_ipv6=None, sync='SYNCED', sync_time='2024-05-28T12:50:09.644123Z', tenant_id=1, tenant_name='default', title='172.21.75.1 - 172.21.75.4', url='https://127.0.0.1:40443/api/vippools/2/', vast_asn=0, vlan=0, vms_preferred=False)] May 28 13:02:09 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-447a5d29-baac-4a1a-b819-7473f7d2adbb tempest-ShareSnapshotMetadataNegativeTest-1199544441 None] --- [GET] https://127.0.0.1:40443/api/vippools/: Done May 28 13:02:09 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-447a5d29-baac-4a1a-b819-7473f7d2adbb tempest-ShareSnapshotMetadataNegativeTest-1199544441 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:02:09 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-447a5d29-baac-4a1a-b819-7473f7d2adbb tempest-ShareSnapshotMetadataNegativeTest-1199544441 None] {'allow_redirects': True, May 28 13:02:09 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-447a5d29-baac-4a1a-b819-7473f7d2adbb tempest-ShareSnapshotMetadataNegativeTest-1199544441 None] 'params': {'name': 'f49db035-ea92-4df4-9284-1e5ce7e3fd79'}} May 28 13:02:09 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-fe856cb8-57dd-4a20-862f-6a305051d799 tempest-SharesRenameTest-1796622866 tempest-SharesRenameTest-1796622866-project-member] http://10.27.203.238/share/v2/6035b1be773e417b80fb3d9ea83eac8d/shares/e02829cb-d0c9-478e-80fa-e4ec0bf3843c returned with HTTP 202 May 28 13:02:09 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1193/2409] 10.27.203.238 () {64 vars in 1454 bytes} [Tue May 28 13:02:09 2024] DELETE /share/v2/6035b1be773e417b80fb3d9ea83eac8d/shares/e02829cb-d0c9-478e-80fa-e4ec0bf3843c => generated 0 bytes in 131 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 13:02:09 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-52c5f659-9621-4dda-88db-fa9f360fdadc tempest-SharesRenameTest-1796622866 tempest-SharesRenameTest-1796622866-project-member] GET http://10.27.203.238/share/v2/6035b1be773e417b80fb3d9ea83eac8d/shares/e02829cb-d0c9-478e-80fa-e4ec0bf3843c May 28 13:02:09 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-52c5f659-9621-4dda-88db-fa9f360fdadc tempest-SharesRenameTest-1796622866 tempest-SharesRenameTest-1796622866-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:02:09 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-52c5f659-9621-4dda-88db-fa9f360fdadc tempest-SharesRenameTest-1796622866 tempest-SharesRenameTest-1796622866-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:02:09 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-52c5f659-9621-4dda-88db-fa9f360fdadc tempest-SharesRenameTest-1796622866 tempest-SharesRenameTest-1796622866-project-member] http://10.27.203.238/share/v2/6035b1be773e417b80fb3d9ea83eac8d/shares/e02829cb-d0c9-478e-80fa-e4ec0bf3843c returned with HTTP 200 May 28 13:02:09 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1217/2410] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:02:09 2024] GET /share/v2/6035b1be773e417b80fb3d9ea83eac8d/shares/e02829cb-d0c9-478e-80fa-e4ec0bf3843c => generated 1338 bytes in 26 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:02:09 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-fe856cb8-57dd-4a20-862f-6a305051d799 tempest-SharesRenameTest-1796622866 None] Acquiring lock "locked_access_rules_operation_by_share_instance_37860c08-1995-417c-b284-dd741fb36e15" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:02:09 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-fe856cb8-57dd-4a20-862f-6a305051d799 tempest-SharesRenameTest-1796622866 None] Lock "locked_access_rules_operation_by_share_instance_37860c08-1995-417c-b284-dd741fb36e15" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:02:09 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-fe856cb8-57dd-4a20-862f-6a305051d799 tempest-SharesRenameTest-1796622866 None] Lock "locked_access_rules_operation_by_share_instance_37860c08-1995-417c-b284-dd741fb36e15" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:02:09 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-fe856cb8-57dd-4a20-862f-6a305051d799 tempest-SharesRenameTest-1796622866 None] Acquiring lock "locked_access_rules_operation_by_share_instance_37860c08-1995-417c-b284-dd741fb36e15" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:02:09 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-fe856cb8-57dd-4a20-862f-6a305051d799 tempest-SharesRenameTest-1796622866 None] Lock "locked_access_rules_operation_by_share_instance_37860c08-1995-417c-b284-dd741fb36e15" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:02:09 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-fe856cb8-57dd-4a20-862f-6a305051d799 tempest-SharesRenameTest-1796622866 None] Lock "locked_access_rules_operation_by_share_instance_37860c08-1995-417c-b284-dd741fb36e15" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:02:09 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-fe856cb8-57dd-4a20-862f-6a305051d799 tempest-SharesRenameTest-1796622866 None] Acquiring lock "locked_access_rules_operation_by_share_instance_37860c08-1995-417c-b284-dd741fb36e15" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:02:09 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-fe856cb8-57dd-4a20-862f-6a305051d799 tempest-SharesRenameTest-1796622866 None] Lock "locked_access_rules_operation_by_share_instance_37860c08-1995-417c-b284-dd741fb36e15" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:02:09 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-fe856cb8-57dd-4a20-862f-6a305051d799 tempest-SharesRenameTest-1796622866 None] Lock "locked_access_rules_operation_by_share_instance_37860c08-1995-417c-b284-dd741fb36e15" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:02:09 l75lg1-v1 manila-share[98474]: DEBUG manila.share.access [None req-fe856cb8-57dd-4a20-862f-6a305051d799 tempest-SharesRenameTest-1796622866 None] All access rules have been synced for share instance 37860c08-1995-417c-b284-dd741fb36e15 belonging to share e02829cb-d0c9-478e-80fa-e4ec0bf3843c. {{(pid=98474) update_access_rules /opt/stack/manila/manila/share/access.py:304}} May 28 13:02:09 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-fe856cb8-57dd-4a20-862f-6a305051d799 tempest-SharesRenameTest-1796622866 None] deleting '/manila/manila-37860c08-1995-417c-b284-dd741fb36e15' May 28 13:02:09 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-fe856cb8-57dd-4a20-862f-6a305051d799 tempest-SharesRenameTest-1796622866 None] >>> [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/ May 28 13:02:09 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-fe856cb8-57dd-4a20-862f-6a305051d799 tempest-SharesRenameTest-1796622866 None] {'data': '{"path": "/manila/manila-37860c08-1995-417c-b284-dd741fb36e15"}', May 28 13:02:09 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-fe856cb8-57dd-4a20-862f-6a305051d799 tempest-SharesRenameTest-1796622866 None] 'params': None} May 28 13:02:09 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-fe856cb8-57dd-4a20-862f-6a305051d799 tempest-SharesRenameTest-1796622866 None] <<< [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/ May 28 13:02:09 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-fe856cb8-57dd-4a20-862f-6a305051d799 tempest-SharesRenameTest-1796622866 None] 'OK' May 28 13:02:09 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-fe856cb8-57dd-4a20-862f-6a305051d799 tempest-SharesRenameTest-1796622866 None] --- [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/: Done May 28 13:02:09 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-fe856cb8-57dd-4a20-862f-6a305051d799 tempest-SharesRenameTest-1796622866 None] >>> [GET] https://127.0.0.1:40443/api/views/ May 28 13:02:09 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-fe856cb8-57dd-4a20-862f-6a305051d799 tempest-SharesRenameTest-1796622866 None] {'allow_redirects': True, May 28 13:02:09 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-fe856cb8-57dd-4a20-862f-6a305051d799 tempest-SharesRenameTest-1796622866 None] 'params': {'name': '37860c08-1995-417c-b284-dd741fb36e15'}} May 28 13:02:09 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-7c1ba563-b796-4eec-aad9-243ee2dc287b tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] GET http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/share-access-rules?share_id=b330db31-7766-443d-9c19-26fe349665aa May 28 13:02:09 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-7c1ba563-b796-4eec-aad9-243ee2dc287b tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:02:09 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-7c1ba563-b796-4eec-aad9-243ee2dc287b tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:02:09 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.lock.api [None req-7c1ba563-b796-4eec-aad9-243ee2dc287b tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Searching for locks by: {'resource_id': 'b2fe4ffa-cd6d-441e-b1ee-a7e8b63ccf87', 'resource_action': 'show', 'resource_type': 'access_rule'} {{(pid=98330) get_all /opt/stack/manila/manila/lock/api.py:112}} May 28 13:02:09 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-7c1ba563-b796-4eec-aad9-243ee2dc287b tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/share-access-rules?share_id=b330db31-7766-443d-9c19-26fe349665aa returned with HTTP 200 May 28 13:02:09 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1194/2411] 10.27.203.238 () {64 vars in 1467 bytes} [Tue May 28 13:02:09 2024] GET /share/v2/a4f3887fa28c457390f5b66615564430/share-access-rules?share_id=b330db31-7766-443d-9c19-26fe349665aa => generated 280 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:02:09 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-4dc4f13d-a165-4e03-b8b9-6983ace5f0ab tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] GET http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/share-access-rules?share_id=b330db31-7766-443d-9c19-26fe349665aa May 28 13:02:09 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-4dc4f13d-a165-4e03-b8b9-6983ace5f0ab tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:02:09 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-4dc4f13d-a165-4e03-b8b9-6983ace5f0ab tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:02:09 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.lock.api [None req-4dc4f13d-a165-4e03-b8b9-6983ace5f0ab tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Searching for locks by: {'resource_id': 'b2fe4ffa-cd6d-441e-b1ee-a7e8b63ccf87', 'resource_action': 'show', 'resource_type': 'access_rule'} {{(pid=98329) get_all /opt/stack/manila/manila/lock/api.py:112}} May 28 13:02:09 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-4dc4f13d-a165-4e03-b8b9-6983ace5f0ab tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/share-access-rules?share_id=b330db31-7766-443d-9c19-26fe349665aa returned with HTTP 200 May 28 13:02:09 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1218/2412] 10.27.203.238 () {64 vars in 1467 bytes} [Tue May 28 13:02:09 2024] GET /share/v2/a4f3887fa28c457390f5b66615564430/share-access-rules?share_id=b330db31-7766-443d-9c19-26fe349665aa => generated 280 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:02:09 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-8210e491-e6c9-4a00-b566-639ba8d126e5 tempest-ShareRulesTest-1530341375 tempest-manila_a4f3887fa28c457390f5b66615564430-579326759] GET http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/share-access-rules?share_id=b330db31-7766-443d-9c19-26fe349665aa May 28 13:02:09 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-8210e491-e6c9-4a00-b566-639ba8d126e5 tempest-ShareRulesTest-1530341375 tempest-manila_a4f3887fa28c457390f5b66615564430-579326759] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:02:09 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-8210e491-e6c9-4a00-b566-639ba8d126e5 tempest-ShareRulesTest-1530341375 tempest-manila_a4f3887fa28c457390f5b66615564430-579326759] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:02:09 l75lg1-v1 nova-conductor[83647]: DEBUG dbcounter [-] [83647] Writing DB stats nova_cell1:SELECT=3,nova_cell1:UPDATE=2 {{(pid=83647) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:02:09 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.lock.api [None req-8210e491-e6c9-4a00-b566-639ba8d126e5 tempest-ShareRulesTest-1530341375 tempest-manila_a4f3887fa28c457390f5b66615564430-579326759] Searching for locks by: {'resource_id': 'b2fe4ffa-cd6d-441e-b1ee-a7e8b63ccf87', 'resource_action': 'show', 'resource_type': 'access_rule'} {{(pid=98330) get_all /opt/stack/manila/manila/lock/api.py:112}} May 28 13:02:09 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.policy [None req-8210e491-e6c9-4a00-b566-639ba8d126e5 tempest-ShareRulesTest-1530341375 tempest-manila_a4f3887fa28c457390f5b66615564430-579326759] Policy check for resource_lock:bypass_locked_show_action failed with credentials {'is_admin': False, 'user_id': 'cdf8594f55cb448e9b2312d051486331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4f3887fa28c457390f5b66615564430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98330) authorize /opt/stack/manila/manila/policy.py:208}} May 28 13:02:09 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-8210e491-e6c9-4a00-b566-639ba8d126e5 tempest-ShareRulesTest-1530341375 tempest-manila_a4f3887fa28c457390f5b66615564430-579326759] http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/share-access-rules?share_id=b330db31-7766-443d-9c19-26fe349665aa returned with HTTP 200 May 28 13:02:09 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1195/2413] 10.27.203.238 () {64 vars in 1467 bytes} [Tue May 28 13:02:09 2024] GET /share/v2/a4f3887fa28c457390f5b66615564430/share-access-rules?share_id=b330db31-7766-443d-9c19-26fe349665aa => generated 278 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:02:09 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-31b1875c-1bc2-42e5-9289-bde04e06940c tempest-ShareRulesTest-1530341375 tempest-manila_a4f3887fa28c457390f5b66615564430-579326759] GET http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/share-access-rules?share_id=b330db31-7766-443d-9c19-26fe349665aa May 28 13:02:09 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-31b1875c-1bc2-42e5-9289-bde04e06940c tempest-ShareRulesTest-1530341375 tempest-manila_a4f3887fa28c457390f5b66615564430-579326759] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:02:09 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-31b1875c-1bc2-42e5-9289-bde04e06940c tempest-ShareRulesTest-1530341375 tempest-manila_a4f3887fa28c457390f5b66615564430-579326759] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:02:09 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.lock.api [None req-31b1875c-1bc2-42e5-9289-bde04e06940c tempest-ShareRulesTest-1530341375 tempest-manila_a4f3887fa28c457390f5b66615564430-579326759] Searching for locks by: {'resource_id': 'b2fe4ffa-cd6d-441e-b1ee-a7e8b63ccf87', 'resource_action': 'show', 'resource_type': 'access_rule'} {{(pid=98329) get_all /opt/stack/manila/manila/lock/api.py:112}} May 28 13:02:09 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.policy [None req-31b1875c-1bc2-42e5-9289-bde04e06940c tempest-ShareRulesTest-1530341375 tempest-manila_a4f3887fa28c457390f5b66615564430-579326759] Policy check for resource_lock:bypass_locked_show_action failed with credentials {'is_admin': False, 'user_id': 'cdf8594f55cb448e9b2312d051486331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4f3887fa28c457390f5b66615564430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98329) authorize /opt/stack/manila/manila/policy.py:208}} May 28 13:02:09 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-31b1875c-1bc2-42e5-9289-bde04e06940c tempest-ShareRulesTest-1530341375 tempest-manila_a4f3887fa28c457390f5b66615564430-579326759] http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/share-access-rules?share_id=b330db31-7766-443d-9c19-26fe349665aa returned with HTTP 200 May 28 13:02:09 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1219/2414] 10.27.203.238 () {64 vars in 1467 bytes} [Tue May 28 13:02:09 2024] GET /share/v2/a4f3887fa28c457390f5b66615564430/share-access-rules?share_id=b330db31-7766-443d-9c19-26fe349665aa => generated 278 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:02:09 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-07530bda-59f7-48bd-b1fa-4a9f91311ad9 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] POST http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/shares/b330db31-7766-443d-9c19-26fe349665aa/action May 28 13:02:09 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-07530bda-59f7-48bd-b1fa-4a9f91311ad9 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Action body: b'{"deny_access": {"access_id": "b2fe4ffa-cd6d-441e-b1ee-a7e8b63ccf87", "unrestrict": true}}' {{(pid=98330) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 13:02:09 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-07530bda-59f7-48bd-b1fa-4a9f91311ad9 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Action: 'action', calling method: ShareController.deny_access, body: {"deny_access": {"access_id": "b2fe4ffa-cd6d-441e-b1ee-a7e8b63ccf87", "unrestrict": true}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:02:09 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.lock.api [None req-07530bda-59f7-48bd-b1fa-4a9f91311ad9 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Searching for locks by: {'resource_id': 'b2fe4ffa-cd6d-441e-b1ee-a7e8b63ccf87', 'resource_action': 'delete'} {{(pid=98330) get_all /opt/stack/manila/manila/lock/api.py:112}} May 28 13:02:09 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-07530bda-59f7-48bd-b1fa-4a9f91311ad9 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:02:09 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-07530bda-59f7-48bd-b1fa-4a9f91311ad9 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:02:09 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-07530bda-59f7-48bd-b1fa-4a9f91311ad9 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.036s {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:02:09 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-07530bda-59f7-48bd-b1fa-4a9f91311ad9 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:02:09 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-07530bda-59f7-48bd-b1fa-4a9f91311ad9 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:02:09 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-447a5d29-baac-4a1a-b819-7473f7d2adbb tempest-ShareSnapshotMetadataNegativeTest-1199544441 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:02:09 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-447a5d29-baac-4a1a-b819-7473f7d2adbb tempest-ShareSnapshotMetadataNegativeTest-1199544441 None] [] May 28 13:02:09 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-447a5d29-baac-4a1a-b819-7473f7d2adbb tempest-ShareSnapshotMetadataNegativeTest-1199544441 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 13:02:09 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-447a5d29-baac-4a1a-b819-7473f7d2adbb tempest-ShareSnapshotMetadataNegativeTest-1199544441 None] >>> [POST] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:02:09 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-447a5d29-baac-4a1a-b819-7473f7d2adbb tempest-ShareSnapshotMetadataNegativeTest-1199544441 None] {'data': '{"name": "f49db035-ea92-4df4-9284-1e5ce7e3fd79"}', May 28 13:02:09 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-447a5d29-baac-4a1a-b819-7473f7d2adbb tempest-ShareSnapshotMetadataNegativeTest-1199544441 None] 'json': None, May 28 13:02:09 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-447a5d29-baac-4a1a-b819-7473f7d2adbb tempest-ShareSnapshotMetadataNegativeTest-1199544441 None] 'params': None} May 28 13:02:10 l75lg1-v1 devstack@m-api.service[98330]: DEBUG oslo_concurrency.lockutils [None req-07530bda-59f7-48bd-b1fa-4a9f91311ad9 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.055s {{(pid=98330) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:02:10 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-07530bda-59f7-48bd-b1fa-4a9f91311ad9 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/shares/b330db31-7766-443d-9c19-26fe349665aa/action returned with HTTP 202 May 28 13:02:10 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1196/2415] 10.27.203.238 () {66 vars in 1493 bytes} [Tue May 28 13:02:09 2024] POST /share/v2/a4f3887fa28c457390f5b66615564430/shares/b330db31-7766-443d-9c19-26fe349665aa/action => generated 0 bytes in 169 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 13:02:10 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-97a1e56f-60a5-4975-a7d4-5a6229463775 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] GET http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/share-access-rules?share_id=b330db31-7766-443d-9c19-26fe349665aa May 28 13:02:10 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-97a1e56f-60a5-4975-a7d4-5a6229463775 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:02:10 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-97a1e56f-60a5-4975-a7d4-5a6229463775 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:02:10 l75lg1-v1 manila-share[98474]: DEBUG manila.share.manager [None req-07530bda-59f7-48bd-b1fa-4a9f91311ad9 tempest-ShareRulesTest-1530341375 None] Received request to update access for share instance f7e47502-a0f7-44de-953d-b7b5697ae0b2. {{(pid=98474) update_access_for_instances /opt/stack/manila/manila/share/manager.py:4353}} May 28 13:02:10 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.lock.api [None req-97a1e56f-60a5-4975-a7d4-5a6229463775 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Searching for locks by: {'resource_id': 'b2fe4ffa-cd6d-441e-b1ee-a7e8b63ccf87', 'resource_action': 'show', 'resource_type': 'access_rule'} {{(pid=98329) get_all /opt/stack/manila/manila/lock/api.py:112}} May 28 13:02:10 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-07530bda-59f7-48bd-b1fa-4a9f91311ad9 tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:02:10 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-07530bda-59f7-48bd-b1fa-4a9f91311ad9 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:02:10 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-07530bda-59f7-48bd-b1fa-4a9f91311ad9 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:02:10 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-07530bda-59f7-48bd-b1fa-4a9f91311ad9 tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:02:10 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-07530bda-59f7-48bd-b1fa-4a9f91311ad9 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:02:10 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-97a1e56f-60a5-4975-a7d4-5a6229463775 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/share-access-rules?share_id=b330db31-7766-443d-9c19-26fe349665aa returned with HTTP 200 May 28 13:02:10 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1220/2416] 10.27.203.238 () {64 vars in 1467 bytes} [Tue May 28 13:02:10 2024] GET /share/v2/a4f3887fa28c457390f5b66615564430/share-access-rules?share_id=b330db31-7766-443d-9c19-26fe349665aa => generated 288 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:02:10 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-07530bda-59f7-48bd-b1fa-4a9f91311ad9 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.052s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:02:10 l75lg1-v1 manila-share[98474]: DEBUG manila.share.access [None req-07530bda-59f7-48bd-b1fa-4a9f91311ad9 tempest-ShareRulesTest-1530341375 None] Updating access rules for share instance f7e47502-a0f7-44de-953d-b7b5697ae0b2 belonging to share b330db31-7766-443d-9c19-26fe349665aa. {{(pid=98474) update_access_rules /opt/stack/manila/manila/share/access.py:298}} May 28 13:02:10 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-07530bda-59f7-48bd-b1fa-4a9f91311ad9 tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:02:10 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-07530bda-59f7-48bd-b1fa-4a9f91311ad9 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:02:10 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-07530bda-59f7-48bd-b1fa-4a9f91311ad9 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.007s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:02:10 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-07530bda-59f7-48bd-b1fa-4a9f91311ad9 tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:02:10 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-07530bda-59f7-48bd-b1fa-4a9f91311ad9 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:02:10 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-07530bda-59f7-48bd-b1fa-4a9f91311ad9 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.014s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:02:10 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-07530bda-59f7-48bd-b1fa-4a9f91311ad9 tempest-ShareRulesTest-1530341375 None] changing access on None May 28 13:02:10 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-07530bda-59f7-48bd-b1fa-4a9f91311ad9 tempest-ShareRulesTest-1530341375 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:02:10 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-07530bda-59f7-48bd-b1fa-4a9f91311ad9 tempest-ShareRulesTest-1530341375 None] {'allow_redirects': True, May 28 13:02:10 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-07530bda-59f7-48bd-b1fa-4a9f91311ad9 tempest-ShareRulesTest-1530341375 None] 'params': {'name': 'f7e47502-a0f7-44de-953d-b7b5697ae0b2'}} May 28 13:02:10 l75lg1-v1 nova-conductor[83648]: DEBUG dbcounter [-] [83648] Writing DB stats nova_cell1:SELECT=3 {{(pid=83648) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:02:10 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-fe856cb8-57dd-4a20-862f-6a305051d799 tempest-SharesRenameTest-1796622866 None] <<< [GET] https://127.0.0.1:40443/api/views/ May 28 13:02:10 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-fe856cb8-57dd-4a20-862f-6a305051d799 tempest-SharesRenameTest-1796622866 None] [Bunch(abac_tags=[], abe_max_depth=None, abe_protocols=[], alias='', allow_anonymous_access=False, allow_s3_anonymous_access=False, auto_commit='0d', bucket='', bucket_creators=[], bucket_creators_groups=[], bucket_owner=None, bulk_permission_update_progress=None, bulk_permission_update_state=None, cluster='loop75-kfs', cluster_id=1, created='2024-05-28T13:01:57.186515Z', enabled=True, files_retention_mode='NONE', guid='dab3afba-f6b8-4a4f-8585-9b00590a415e', id=54, ignore_oos=False, internal=False, is_remote=False, is_seamless=False, logical_capacity=0, max_retention_period='0d', min_retention_period='0d', name='37860c08-1995-417c-b284-dd741fb36e15', nfs_interop_flags='BOTH_NFS3_AND_NFS4_INTEROP_DISABLED', path='/manila/manila-37860c08-1995-417c-b284-dd741fb36e15', physical_capacity=0, policy='37860c08-1995-417c-b284-dd741fb36e15', policy_id=55, protocols=['NFS'], qos_policy=None, qos_policy_id=None, s3_locks=False, s3_locks_retention_mode='NONE', s3_locks_retention_period='', s3_unverified_lookup=False, s3_versioning=False, select_for_live_monitoring=False, share='', share_acl=Bunch(acl=[], enabled=False), sync='SYNCED', sync_time='2024-05-28T13:02:08.568720Z', tenant_id=1, tenant_name='default', title='/manila/manila-37860c08-1995-417c-b284-dd741fb36e15', url='https://127.0.0.1:40443/api/views/54/')] May 28 13:02:10 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-fe856cb8-57dd-4a20-862f-6a305051d799 tempest-SharesRenameTest-1796622866 None] --- [GET] https://127.0.0.1:40443/api/views/: Done May 28 13:02:10 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-fe856cb8-57dd-4a20-862f-6a305051d799 tempest-SharesRenameTest-1796622866 None] >>> [DELETE] https://127.0.0.1:40443/api/views/54/ May 28 13:02:10 l75lg1-v1 dstat.sh[49771]: 28-05 13:02:10| 9 1 88 1 0|5640M 1787M 278M 7918M| 17k 5335B| 0 2601k| 0 187 |4878 8193 |0.98 1.13 1.05|1.0 1.0 0| 0 0 | 0 2048M| 29 363 0 40 2 May 28 13:02:10 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-07530bda-59f7-48bd-b1fa-4a9f91311ad9 tempest-ShareRulesTest-1530341375 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:02:10 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-07530bda-59f7-48bd-b1fa-4a9f91311ad9 tempest-ShareRulesTest-1530341375 None] [Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=1, created='2024-05-28T12:59:53.824250Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='0fa84ccd-850f-48fa-a965-23e5abe31188', id=38, internal=False, is_s3_default_policy=False, name='f7e47502-a0f7-44de-953d-b7b5697ae0b2', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=['*'], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['203.0.113.77'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['203.0.113.77'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T13:02:08.938351Z', tenant_id=1, tenant_name='default', title='f7e47502-a0f7-44de-953d-b7b5697ae0b2', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/38/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[])] May 28 13:02:10 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-07530bda-59f7-48bd-b1fa-4a9f91311ad9 tempest-ShareRulesTest-1530341375 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 13:02:10 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-07530bda-59f7-48bd-b1fa-4a9f91311ad9 tempest-ShareRulesTest-1530341375 None] changing access on /manila/manila-f7e47502-a0f7-44de-953d-b7b5697ae0b2. Rules: {'nfs_read_write': [], 'nfs_read_only': []} May 28 13:02:10 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-07530bda-59f7-48bd-b1fa-4a9f91311ad9 tempest-ShareRulesTest-1530341375 None] >>> [PATCH] https://127.0.0.1:40443/api/viewpolicies/38/ May 28 13:02:10 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-07530bda-59f7-48bd-b1fa-4a9f91311ad9 tempest-ShareRulesTest-1530341375 None] {'data': '{"name": "f7e47502-a0f7-44de-953d-b7b5697ae0b2", "nfs_no_squash": ' May 28 13:02:10 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-07530bda-59f7-48bd-b1fa-4a9f91311ad9 tempest-ShareRulesTest-1530341375 None] '["*"], "nfs_root_squash": ["*"], "nfs_read_write": [], ' May 28 13:02:10 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-07530bda-59f7-48bd-b1fa-4a9f91311ad9 tempest-ShareRulesTest-1530341375 None] '"nfs_read_only": []}', May 28 13:02:10 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-07530bda-59f7-48bd-b1fa-4a9f91311ad9 tempest-ShareRulesTest-1530341375 None] 'params': None} May 28 13:02:10 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-447a5d29-baac-4a1a-b819-7473f7d2adbb tempest-ShareSnapshotMetadataNegativeTest-1199544441 None] <<< [POST] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:02:10 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-447a5d29-baac-4a1a-b819-7473f7d2adbb tempest-ShareSnapshotMetadataNegativeTest-1199544441 None] Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=0, created='2024-05-28T13:02:10.345627Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='2e4287f2-d176-4472-bea7-d2d1de38270a', id=56, internal=False, is_s3_default_policy=False, name='f49db035-ea92-4df4-9284-1e5ce7e3fd79', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=[], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['*'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['*'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T13:02:10.683681Z', tenant_id=1, tenant_name='default', title='f49db035-ea92-4df4-9284-1e5ce7e3fd79', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/56/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[]) May 28 13:02:10 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-447a5d29-baac-4a1a-b819-7473f7d2adbb tempest-ShareSnapshotMetadataNegativeTest-1199544441 None] --- [POST] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 13:02:10 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-447a5d29-baac-4a1a-b819-7473f7d2adbb tempest-ShareSnapshotMetadataNegativeTest-1199544441 None] >>> [GET] https://127.0.0.1:40443/api/quotas/ May 28 13:02:10 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-447a5d29-baac-4a1a-b819-7473f7d2adbb tempest-ShareSnapshotMetadataNegativeTest-1199544441 None] {'allow_redirects': True, May 28 13:02:10 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-447a5d29-baac-4a1a-b819-7473f7d2adbb tempest-ShareSnapshotMetadataNegativeTest-1199544441 None] 'params': {'name': 'f49db035-ea92-4df4-9284-1e5ce7e3fd79'}} May 28 13:02:11 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-447a5d29-baac-4a1a-b819-7473f7d2adbb tempest-ShareSnapshotMetadataNegativeTest-1199544441 None] <<< [GET] https://127.0.0.1:40443/api/quotas/ May 28 13:02:11 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-447a5d29-baac-4a1a-b819-7473f7d2adbb tempest-ShareSnapshotMetadataNegativeTest-1199544441 None] [] May 28 13:02:11 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-447a5d29-baac-4a1a-b819-7473f7d2adbb tempest-ShareSnapshotMetadataNegativeTest-1199544441 None] --- [GET] https://127.0.0.1:40443/api/quotas/: Done May 28 13:02:11 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-447a5d29-baac-4a1a-b819-7473f7d2adbb tempest-ShareSnapshotMetadataNegativeTest-1199544441 None] >>> [POST] https://127.0.0.1:40443/api/quotas/ May 28 13:02:11 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-447a5d29-baac-4a1a-b819-7473f7d2adbb tempest-ShareSnapshotMetadataNegativeTest-1199544441 None] {'data': '{"name": "f49db035-ea92-4df4-9284-1e5ce7e3fd79", "path": ' May 28 13:02:11 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-447a5d29-baac-4a1a-b819-7473f7d2adbb tempest-ShareSnapshotMetadataNegativeTest-1199544441 None] '"/manila/manila-f49db035-ea92-4df4-9284-1e5ce7e3fd79", "create_dir": ' May 28 13:02:11 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-447a5d29-baac-4a1a-b819-7473f7d2adbb tempest-ShareSnapshotMetadataNegativeTest-1199544441 None] 'true, "hard_limit": 1073741824}', May 28 13:02:11 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-447a5d29-baac-4a1a-b819-7473f7d2adbb tempest-ShareSnapshotMetadataNegativeTest-1199544441 None] 'json': None, May 28 13:02:11 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-447a5d29-baac-4a1a-b819-7473f7d2adbb tempest-ShareSnapshotMetadataNegativeTest-1199544441 None] 'params': None} May 28 13:02:11 l75lg1-v1 devstack@placement-api.service[78202]: DEBUG dbcounter [-] [78202] Writing DB stats placement:SELECT=2 {{(pid=78202) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:02:11 l75lg1-v1 devstack@placement-api.service[78201]: DEBUG dbcounter [-] [78201] Writing DB stats placement:SELECT=2 {{(pid=78201) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:02:11 l75lg1-v1 dstat.sh[49771]: 28-05 13:02:11| 1 0 93 5 0|5640M 1787M 278M 7919M| 15k 2656B| 0 15M| 0 1242 |2980 4713 |0.98 1.13 1.05|1.0 2.0 0| 0 0 | 0 2048M| 29 363 0 40 2 May 28 13:02:11 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.periodic_task [None req-e3486ff9-a95e-41bc-8901-df75aedbeaad None None] Running periodic task DataManager.create_backup_continue {{(pid=98318) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 13:02:11 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.periodic_task [None req-e3486ff9-a95e-41bc-8901-df75aedbeaad None None] Running periodic task DataManager.restore_backup_continue {{(pid=98318) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 13:02:12 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-b85938ec-fd59-43d3-a5e9-9d401ab6fdab tempest-ShareSnapshotMetadataNegativeTest-1199544441 tempest-ShareSnapshotMetadataNegativeTest-1199544441-project-member] GET http://10.27.203.238/share/v2/b00df7df3db14cce99343fc7f6ffd796/shares/1f5b6f0f-f341-4964-a2fa-9c4a26198f95 May 28 13:02:12 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-b85938ec-fd59-43d3-a5e9-9d401ab6fdab tempest-ShareSnapshotMetadataNegativeTest-1199544441 tempest-ShareSnapshotMetadataNegativeTest-1199544441-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:02:12 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-b85938ec-fd59-43d3-a5e9-9d401ab6fdab tempest-ShareSnapshotMetadataNegativeTest-1199544441 tempest-ShareSnapshotMetadataNegativeTest-1199544441-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:02:12 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-b85938ec-fd59-43d3-a5e9-9d401ab6fdab tempest-ShareSnapshotMetadataNegativeTest-1199544441 tempest-ShareSnapshotMetadataNegativeTest-1199544441-project-member] http://10.27.203.238/share/v2/b00df7df3db14cce99343fc7f6ffd796/shares/1f5b6f0f-f341-4964-a2fa-9c4a26198f95 returned with HTTP 200 May 28 13:02:12 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1197/2417] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:02:12 2024] GET /share/v2/b00df7df3db14cce99343fc7f6ffd796/shares/1f5b6f0f-f341-4964-a2fa-9c4a26198f95 => generated 1418 bytes in 25 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:02:12 l75lg1-v1 dstat.sh[49771]: 28-05 13:02:12| 2 0 97 1 0|5640M 1787M 278M 7919M| 13k 0 | 0 444k| 0 50.0 |2278 3678 |0.98 1.13 1.05|1.0 1.0 0| 0 0 | 0 2048M| 29 363 0 40 2 May 28 13:02:12 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-447a5d29-baac-4a1a-b819-7473f7d2adbb tempest-ShareSnapshotMetadataNegativeTest-1199544441 None] <<< [POST] https://127.0.0.1:40443/api/quotas/ May 28 13:02:12 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-447a5d29-baac-4a1a-b819-7473f7d2adbb tempest-ShareSnapshotMetadataNegativeTest-1199544441 None] Bunch(cluster='loop75-kfs', cluster_id=1, default_email=None, default_group_quota=None, default_user_quota=None, enable_alarms=True, enable_email_providers=True, grace_period=None, group_quotas=[], guid='70e6ce4c-05a8-41bc-b0a8-05002db0a6b5', hard_limit=1073741824, hard_limit_inodes=None, id=53, internal=False, is_user_quota=False, last_user_quotas_update=None, name='f49db035-ea92-4df4-9284-1e5ce7e3fd79', num_blocked_users=0, num_exceeded_users=0, path='/manila/manila-f49db035-ea92-4df4-9284-1e5ce7e3fd79', percent_capacity=0, percent_inodes=None, pretty_grace_period=None, pretty_grace_period_expiration=None, pretty_state='OK (CREATED)', soft_limit=None, soft_limit_inodes=None, state='OK', sync_state='CREATED', system_id=53, tenant_id=1, tenant_name='default', time_to_block=None, title='f49db035-ea92-4df4-9284-1e5ce7e3fd79', url='https://127.0.0.1:40443/api/quotas/53/', used_capacity=0, used_capacity_tb=0.0, used_effective_capacity=0, used_effective_capacity_tb=0.0, used_inodes=0, used_limited_capacity=0, user_quotas=[]) May 28 13:02:12 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-447a5d29-baac-4a1a-b819-7473f7d2adbb tempest-ShareSnapshotMetadataNegativeTest-1199544441 None] --- [POST] https://127.0.0.1:40443/api/quotas/: Done May 28 13:02:12 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-447a5d29-baac-4a1a-b819-7473f7d2adbb tempest-ShareSnapshotMetadataNegativeTest-1199544441 None] >>> [GET] https://127.0.0.1:40443/api/views/ May 28 13:02:12 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-447a5d29-baac-4a1a-b819-7473f7d2adbb tempest-ShareSnapshotMetadataNegativeTest-1199544441 None] {'allow_redirects': True, May 28 13:02:12 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-447a5d29-baac-4a1a-b819-7473f7d2adbb tempest-ShareSnapshotMetadataNegativeTest-1199544441 None] 'params': {'name': 'f49db035-ea92-4df4-9284-1e5ce7e3fd79'}} May 28 13:02:12 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-fe856cb8-57dd-4a20-862f-6a305051d799 tempest-SharesRenameTest-1796622866 None] <<< [DELETE] https://127.0.0.1:40443/api/views/54/ May 28 13:02:12 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-fe856cb8-57dd-4a20-862f-6a305051d799 tempest-SharesRenameTest-1796622866 None] --- [DELETE] https://127.0.0.1:40443/api/views/54/: Done May 28 13:02:12 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-fe856cb8-57dd-4a20-862f-6a305051d799 tempest-SharesRenameTest-1796622866 None] >>> [GET] https://127.0.0.1:40443/api/quotas/ May 28 13:02:12 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-fe856cb8-57dd-4a20-862f-6a305051d799 tempest-SharesRenameTest-1796622866 None] {'allow_redirects': True, May 28 13:02:12 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-fe856cb8-57dd-4a20-862f-6a305051d799 tempest-SharesRenameTest-1796622866 None] 'params': {'name': '37860c08-1995-417c-b284-dd741fb36e15'}} May 28 13:02:12 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-21b26ad7-a608-4ee8-b42d-247b80ce1a42 tempest-SharesRenameTest-1796622866 tempest-SharesRenameTest-1796622866-project-member] GET http://10.27.203.238/share/v2/6035b1be773e417b80fb3d9ea83eac8d/shares/e02829cb-d0c9-478e-80fa-e4ec0bf3843c May 28 13:02:12 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-21b26ad7-a608-4ee8-b42d-247b80ce1a42 tempest-SharesRenameTest-1796622866 tempest-SharesRenameTest-1796622866-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:02:12 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-21b26ad7-a608-4ee8-b42d-247b80ce1a42 tempest-SharesRenameTest-1796622866 tempest-SharesRenameTest-1796622866-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:02:12 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-447a5d29-baac-4a1a-b819-7473f7d2adbb tempest-ShareSnapshotMetadataNegativeTest-1199544441 None] <<< [GET] https://127.0.0.1:40443/api/views/ May 28 13:02:12 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-447a5d29-baac-4a1a-b819-7473f7d2adbb tempest-ShareSnapshotMetadataNegativeTest-1199544441 None] [] May 28 13:02:12 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-447a5d29-baac-4a1a-b819-7473f7d2adbb tempest-ShareSnapshotMetadataNegativeTest-1199544441 None] --- [GET] https://127.0.0.1:40443/api/views/: Done May 28 13:02:12 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-447a5d29-baac-4a1a-b819-7473f7d2adbb tempest-ShareSnapshotMetadataNegativeTest-1199544441 None] >>> [POST] https://127.0.0.1:40443/api/views/ May 28 13:02:12 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-447a5d29-baac-4a1a-b819-7473f7d2adbb tempest-ShareSnapshotMetadataNegativeTest-1199544441 None] {'data': '{"name": "f49db035-ea92-4df4-9284-1e5ce7e3fd79", "path": ' May 28 13:02:12 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-447a5d29-baac-4a1a-b819-7473f7d2adbb tempest-ShareSnapshotMetadataNegativeTest-1199544441 None] '"/manila/manila-f49db035-ea92-4df4-9284-1e5ce7e3fd79", "policy_id": ' May 28 13:02:12 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-447a5d29-baac-4a1a-b819-7473f7d2adbb tempest-ShareSnapshotMetadataNegativeTest-1199544441 None] '56, "create_dir": true, "protocols": ["NFS"]}', May 28 13:02:12 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-447a5d29-baac-4a1a-b819-7473f7d2adbb tempest-ShareSnapshotMetadataNegativeTest-1199544441 None] 'json': None, May 28 13:02:12 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-447a5d29-baac-4a1a-b819-7473f7d2adbb tempest-ShareSnapshotMetadataNegativeTest-1199544441 None] 'params': None} May 28 13:02:12 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-21b26ad7-a608-4ee8-b42d-247b80ce1a42 tempest-SharesRenameTest-1796622866 tempest-SharesRenameTest-1796622866-project-member] http://10.27.203.238/share/v2/6035b1be773e417b80fb3d9ea83eac8d/shares/e02829cb-d0c9-478e-80fa-e4ec0bf3843c returned with HTTP 200 May 28 13:02:12 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1221/2418] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:02:12 2024] GET /share/v2/6035b1be773e417b80fb3d9ea83eac8d/shares/e02829cb-d0c9-478e-80fa-e4ec0bf3843c => generated 1338 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:02:12 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-07530bda-59f7-48bd-b1fa-4a9f91311ad9 tempest-ShareRulesTest-1530341375 None] <<< [PATCH] https://127.0.0.1:40443/api/viewpolicies/38/ May 28 13:02:12 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-07530bda-59f7-48bd-b1fa-4a9f91311ad9 tempest-ShareRulesTest-1530341375 None] Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=1, created='2024-05-28T12:59:53.824250Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='0fa84ccd-850f-48fa-a965-23e5abe31188', id=38, internal=False, is_s3_default_policy=False, name='f7e47502-a0f7-44de-953d-b7b5697ae0b2', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=['*'], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=[], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=[], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='MODIFYING', sync_time='2024-05-28T13:02:11.844508Z', tenant_id=1, tenant_name='default', title='f7e47502-a0f7-44de-953d-b7b5697ae0b2', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/38/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[]) May 28 13:02:12 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-07530bda-59f7-48bd-b1fa-4a9f91311ad9 tempest-ShareRulesTest-1530341375 None] --- [PATCH] https://127.0.0.1:40443/api/viewpolicies/38/: Done May 28 13:02:12 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-07530bda-59f7-48bd-b1fa-4a9f91311ad9 tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:02:12 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-07530bda-59f7-48bd-b1fa-4a9f91311ad9 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:02:12 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-07530bda-59f7-48bd-b1fa-4a9f91311ad9 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.029s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:02:12 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-07530bda-59f7-48bd-b1fa-4a9f91311ad9 tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:02:12 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-07530bda-59f7-48bd-b1fa-4a9f91311ad9 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:02:12 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-07530bda-59f7-48bd-b1fa-4a9f91311ad9 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.031s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:02:12 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-07530bda-59f7-48bd-b1fa-4a9f91311ad9 tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:02:12 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-07530bda-59f7-48bd-b1fa-4a9f91311ad9 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:02:12 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-07530bda-59f7-48bd-b1fa-4a9f91311ad9 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:02:12 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-07530bda-59f7-48bd-b1fa-4a9f91311ad9 tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:02:12 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-07530bda-59f7-48bd-b1fa-4a9f91311ad9 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:02:12 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-07530bda-59f7-48bd-b1fa-4a9f91311ad9 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:02:12 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-07530bda-59f7-48bd-b1fa-4a9f91311ad9 tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:02:12 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-07530bda-59f7-48bd-b1fa-4a9f91311ad9 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:02:12 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-07530bda-59f7-48bd-b1fa-4a9f91311ad9 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.043s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:02:12 l75lg1-v1 manila-share[98474]: INFO manila.share.access [None req-07530bda-59f7-48bd-b1fa-4a9f91311ad9 tempest-ShareRulesTest-1530341375 None] Access rules were successfully modified for share instance f7e47502-a0f7-44de-953d-b7b5697ae0b2 belonging to share b330db31-7766-443d-9c19-26fe349665aa. May 28 13:02:12 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-fe856cb8-57dd-4a20-862f-6a305051d799 tempest-SharesRenameTest-1796622866 None] <<< [GET] https://127.0.0.1:40443/api/quotas/ May 28 13:02:12 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-fe856cb8-57dd-4a20-862f-6a305051d799 tempest-SharesRenameTest-1796622866 None] [Bunch(cluster='loop75-kfs', cluster_id=1, default_email=None, default_group_quota=None, default_user_quota=None, enable_alarms=True, enable_email_providers=True, grace_period=None, guid='6301b751-d818-4414-9a1a-29ca5918ca3f', hard_limit=1073741824, hard_limit_inodes=None, id=52, internal=False, is_user_quota=False, last_user_quotas_update=None, name='37860c08-1995-417c-b284-dd741fb36e15', num_blocked_users=0, num_exceeded_users=0, path='/manila/manila-37860c08-1995-417c-b284-dd741fb36e15', percent_capacity=0, percent_inodes=None, pretty_grace_period=None, pretty_grace_period_expiration=None, pretty_state='OK', soft_limit=None, soft_limit_inodes=None, state='OK', sync_state='SYNCHRONIZED', system_id=52, tenant_id=1, tenant_name='default', time_to_block=None, title='37860c08-1995-417c-b284-dd741fb36e15', url='https://127.0.0.1:40443/api/quotas/52/', used_capacity=0, used_capacity_tb=0.0, used_effective_capacity=0, used_effective_capacity_tb=0.0, used_inodes=1, used_limited_capacity=0)] May 28 13:02:12 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-fe856cb8-57dd-4a20-862f-6a305051d799 tempest-SharesRenameTest-1796622866 None] --- [GET] https://127.0.0.1:40443/api/quotas/: Done May 28 13:02:12 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-fe856cb8-57dd-4a20-862f-6a305051d799 tempest-SharesRenameTest-1796622866 None] >>> [DELETE] https://127.0.0.1:40443/api/quotas/52/ May 28 13:02:13 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-afa22d04-ac2f-4745-88ab-742e40d2df6f tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] GET http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/share-access-rules?share_id=b330db31-7766-443d-9c19-26fe349665aa May 28 13:02:13 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-afa22d04-ac2f-4745-88ab-742e40d2df6f tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:02:13 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-afa22d04-ac2f-4745-88ab-742e40d2df6f tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:02:13 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-afa22d04-ac2f-4745-88ab-742e40d2df6f tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/share-access-rules?share_id=b330db31-7766-443d-9c19-26fe349665aa returned with HTTP 200 May 28 13:02:13 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1198/2419] 10.27.203.238 () {64 vars in 1467 bytes} [Tue May 28 13:02:13 2024] GET /share/v2/a4f3887fa28c457390f5b66615564430/share-access-rules?share_id=b330db31-7766-443d-9c19-26fe349665aa => generated 19 bytes in 28 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:02:13 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-324c4220-69c0-4547-bbb1-e29a2e4b5a41 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] POST http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/shares/b330db31-7766-443d-9c19-26fe349665aa/action May 28 13:02:13 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-324c4220-69c0-4547-bbb1-e29a2e4b5a41 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Action body: b'{"allow_access": {"access_type": "ip", "access_to": "203.0.113.77", "access_level": "rw", "lock_deletion": true}}' {{(pid=98329) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 13:02:13 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-324c4220-69c0-4547-bbb1-e29a2e4b5a41 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Action: 'action', calling method: ShareController.allow_access, body: {"allow_access": {"access_type": "ip", "access_to": "203.0.113.77", "access_level": "rw", "lock_deletion": true}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:02:13 l75lg1-v1 devstack@m-api.service[98329]: DEBUG oslo_concurrency.lockutils [None req-324c4220-69c0-4547-bbb1-e29a2e4b5a41 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98329) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:02:13 l75lg1-v1 devstack@m-api.service[98329]: DEBUG oslo_concurrency.lockutils [None req-324c4220-69c0-4547-bbb1-e29a2e4b5a41 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98329) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:02:13 l75lg1-v1 devstack@m-api.service[98329]: DEBUG oslo_concurrency.lockutils [None req-324c4220-69c0-4547-bbb1-e29a2e4b5a41 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.044s {{(pid=98329) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:02:13 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-324c4220-69c0-4547-bbb1-e29a2e4b5a41 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/shares/b330db31-7766-443d-9c19-26fe349665aa/action returned with HTTP 200 May 28 13:02:13 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1222/2420] 10.27.203.238 () {66 vars in 1494 bytes} [Tue May 28 13:02:13 2024] POST /share/v2/a4f3887fa28c457390f5b66615564430/shares/b330db31-7766-443d-9c19-26fe349665aa/action => generated 310 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:02:13 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-27446cbd-ce00-4293-8cbc-4b4ad84792e8 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] GET http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/share-access-rules?share_id=b330db31-7766-443d-9c19-26fe349665aa May 28 13:02:13 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-27446cbd-ce00-4293-8cbc-4b4ad84792e8 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:02:13 l75lg1-v1 manila-share[98474]: DEBUG manila.share.manager [None req-324c4220-69c0-4547-bbb1-e29a2e4b5a41 tempest-ShareRulesTest-1530341375 None] Received request to update access for share instance f7e47502-a0f7-44de-953d-b7b5697ae0b2. {{(pid=98474) update_access_for_instances /opt/stack/manila/manila/share/manager.py:4353}} May 28 13:02:13 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-27446cbd-ce00-4293-8cbc-4b4ad84792e8 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:02:13 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-324c4220-69c0-4547-bbb1-e29a2e4b5a41 tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:02:13 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-324c4220-69c0-4547-bbb1-e29a2e4b5a41 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:02:13 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-324c4220-69c0-4547-bbb1-e29a2e4b5a41 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:02:13 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-324c4220-69c0-4547-bbb1-e29a2e4b5a41 tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:02:13 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-324c4220-69c0-4547-bbb1-e29a2e4b5a41 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:02:13 l75lg1-v1 dstat.sh[49771]: 28-05 13:02:13| 6 1 91 1 0|5640M 1787M 278M 7919M| 17k 6510B| 0 796k| 0 115 |3541 5670 |0.98 1.13 1.05|4.0 1.0 0| 0 0 | 0 2048M| 29 364 0 40 2 May 28 13:02:13 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.lock.api [None req-27446cbd-ce00-4293-8cbc-4b4ad84792e8 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Searching for locks by: {'resource_id': 'e375b962-40a2-4bc9-ab8d-12ca8470f1ba', 'resource_action': 'show', 'resource_type': 'access_rule'} {{(pid=98330) get_all /opt/stack/manila/manila/lock/api.py:112}} May 28 13:02:13 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-27446cbd-ce00-4293-8cbc-4b4ad84792e8 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/share-access-rules?share_id=b330db31-7766-443d-9c19-26fe349665aa returned with HTTP 200 May 28 13:02:13 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1199/2421] 10.27.203.238 () {64 vars in 1467 bytes} [Tue May 28 13:02:13 2024] GET /share/v2/a4f3887fa28c457390f5b66615564430/share-access-rules?share_id=b330db31-7766-443d-9c19-26fe349665aa => generated 265 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:02:13 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-324c4220-69c0-4547-bbb1-e29a2e4b5a41 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.051s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:02:13 l75lg1-v1 manila-share[98474]: DEBUG manila.share.access [None req-324c4220-69c0-4547-bbb1-e29a2e4b5a41 tempest-ShareRulesTest-1530341375 None] Updating access rules for share instance f7e47502-a0f7-44de-953d-b7b5697ae0b2 belonging to share b330db31-7766-443d-9c19-26fe349665aa. {{(pid=98474) update_access_rules /opt/stack/manila/manila/share/access.py:298}} May 28 13:02:13 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-324c4220-69c0-4547-bbb1-e29a2e4b5a41 tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:02:13 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-324c4220-69c0-4547-bbb1-e29a2e4b5a41 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:02:13 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-324c4220-69c0-4547-bbb1-e29a2e4b5a41 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.007s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:02:13 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-324c4220-69c0-4547-bbb1-e29a2e4b5a41 tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:02:13 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-324c4220-69c0-4547-bbb1-e29a2e4b5a41 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:02:13 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-324c4220-69c0-4547-bbb1-e29a2e4b5a41 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.013s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:02:13 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-324c4220-69c0-4547-bbb1-e29a2e4b5a41 tempest-ShareRulesTest-1530341375 None] changing access on None May 28 13:02:13 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-324c4220-69c0-4547-bbb1-e29a2e4b5a41 tempest-ShareRulesTest-1530341375 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:02:13 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-324c4220-69c0-4547-bbb1-e29a2e4b5a41 tempest-ShareRulesTest-1530341375 None] {'allow_redirects': True, May 28 13:02:13 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-324c4220-69c0-4547-bbb1-e29a2e4b5a41 tempest-ShareRulesTest-1530341375 None] 'params': {'name': 'f7e47502-a0f7-44de-953d-b7b5697ae0b2'}} May 28 13:02:13 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-324c4220-69c0-4547-bbb1-e29a2e4b5a41 tempest-ShareRulesTest-1530341375 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:02:13 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-324c4220-69c0-4547-bbb1-e29a2e4b5a41 tempest-ShareRulesTest-1530341375 None] [Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=1, created='2024-05-28T12:59:53.824250Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='0fa84ccd-850f-48fa-a965-23e5abe31188', id=38, internal=False, is_s3_default_policy=False, name='f7e47502-a0f7-44de-953d-b7b5697ae0b2', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=['*'], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=[], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=[], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T13:02:12.617921Z', tenant_id=1, tenant_name='default', title='f7e47502-a0f7-44de-953d-b7b5697ae0b2', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/38/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[])] May 28 13:02:13 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-324c4220-69c0-4547-bbb1-e29a2e4b5a41 tempest-ShareRulesTest-1530341375 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 13:02:13 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-324c4220-69c0-4547-bbb1-e29a2e4b5a41 tempest-ShareRulesTest-1530341375 None] changing access on /manila/manila-f7e47502-a0f7-44de-953d-b7b5697ae0b2. Rules: {'nfs_read_write': ['203.0.113.77'], 'nfs_read_only': []} May 28 13:02:13 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-324c4220-69c0-4547-bbb1-e29a2e4b5a41 tempest-ShareRulesTest-1530341375 None] >>> [PATCH] https://127.0.0.1:40443/api/viewpolicies/38/ May 28 13:02:13 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-324c4220-69c0-4547-bbb1-e29a2e4b5a41 tempest-ShareRulesTest-1530341375 None] {'data': '{"name": "f7e47502-a0f7-44de-953d-b7b5697ae0b2", "nfs_no_squash": ' May 28 13:02:13 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-324c4220-69c0-4547-bbb1-e29a2e4b5a41 tempest-ShareRulesTest-1530341375 None] '["*"], "nfs_root_squash": ["*"], "nfs_read_write": ["203.0.113.77"], ' May 28 13:02:13 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-324c4220-69c0-4547-bbb1-e29a2e4b5a41 tempest-ShareRulesTest-1530341375 None] '"nfs_read_only": []}', May 28 13:02:13 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-324c4220-69c0-4547-bbb1-e29a2e4b5a41 tempest-ShareRulesTest-1530341375 None] 'params': None} May 28 13:02:13 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-447a5d29-baac-4a1a-b819-7473f7d2adbb tempest-ShareSnapshotMetadataNegativeTest-1199544441 None] <<< [POST] https://127.0.0.1:40443/api/views/ May 28 13:02:13 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-447a5d29-baac-4a1a-b819-7473f7d2adbb tempest-ShareSnapshotMetadataNegativeTest-1199544441 None] Bunch(abac_tags=[], abe_max_depth=None, abe_protocols=[], alias='', allow_anonymous_access=False, allow_s3_anonymous_access=False, auto_commit='0d', bucket='', bucket_creators=[], bucket_creators_groups=[], bucket_owner=None, bulk_permission_update_progress=None, bulk_permission_update_state=None, cluster='loop75-kfs', cluster_id=1, created='2024-05-28T13:02:13.325126Z', enabled=True, files_retention_mode='NONE', guid='62b7e952-df39-4d07-8bcd-ef583d85cf5b', id=55, ignore_oos=False, internal=False, is_remote=False, is_seamless=False, logical_capacity=0, max_retention_period=None, min_retention_period=None, name='f49db035-ea92-4df4-9284-1e5ce7e3fd79', nfs_interop_flags='BOTH_NFS3_AND_NFS4_INTEROP_DISABLED', path='/manila/manila-f49db035-ea92-4df4-9284-1e5ce7e3fd79', physical_capacity=0, policy='f49db035-ea92-4df4-9284-1e5ce7e3fd79', policy_id=56, protocols=['NFS'], qos_policy=None, qos_policy_id=None, s3_locks=False, s3_locks_retention_mode='NONE', s3_locks_retention_period='', s3_object_ownership_rule='ObjectWriter', s3_unverified_lookup=False, s3_versioning=False, select_for_live_monitoring=False, share='', share_acl=Bunch(acl=[], enabled=False), sync='SYNCED', sync_time='2024-05-28T13:02:13.596644Z', tenant_id=1, tenant_name='default', title='/manila/manila-f49db035-ea92-4df4-9284-1e5ce7e3fd79', url='https://127.0.0.1:40443/api/views/55/') May 28 13:02:13 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-447a5d29-baac-4a1a-b819-7473f7d2adbb tempest-ShareSnapshotMetadataNegativeTest-1199544441 None] --- [POST] https://127.0.0.1:40443/api/views/: Done May 28 13:02:13 l75lg1-v1 manila-share[98474]: INFO manila.share.manager [None req-447a5d29-baac-4a1a-b819-7473f7d2adbb tempest-ShareSnapshotMetadataNegativeTest-1199544441 None] Share instance f49db035-ea92-4df4-9284-1e5ce7e3fd79 created successfully. May 28 13:02:14 l75lg1-v1 neutron-server[77619]: DEBUG dbcounter [-] [77619] Writing DB stats neutron:SELECT=1 {{(pid=77619) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:02:14 l75lg1-v1 dstat.sh[49771]: 28-05 13:02:14| 2 0 96 0 0|5640M 1787M 278M 7919M| 13k 1731B| 0 591k| 0 76.9 |2465 4132 |0.98 1.13 1.05|1.0 1.0 0| 0 0 | 0 2048M| 29 363 0 40 2 May 28 13:02:14 l75lg1-v1 neutron-server[77619]: DEBUG dbcounter [-] [77619] Writing DB stats neutron:SELECT=1 {{(pid=77619) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:02:15 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-2aed4ff3-927b-475f-938d-5ef067aea6fe tempest-ShareSnapshotMetadataNegativeTest-1199544441 tempest-ShareSnapshotMetadataNegativeTest-1199544441-project-member] GET http://10.27.203.238/share/v2/b00df7df3db14cce99343fc7f6ffd796/shares/1f5b6f0f-f341-4964-a2fa-9c4a26198f95 May 28 13:02:15 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-2aed4ff3-927b-475f-938d-5ef067aea6fe tempest-ShareSnapshotMetadataNegativeTest-1199544441 tempest-ShareSnapshotMetadataNegativeTest-1199544441-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:02:15 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-2aed4ff3-927b-475f-938d-5ef067aea6fe tempest-ShareSnapshotMetadataNegativeTest-1199544441 tempest-ShareSnapshotMetadataNegativeTest-1199544441-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:02:15 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-2aed4ff3-927b-475f-938d-5ef067aea6fe tempest-ShareSnapshotMetadataNegativeTest-1199544441 tempest-ShareSnapshotMetadataNegativeTest-1199544441-project-member] http://10.27.203.238/share/v2/b00df7df3db14cce99343fc7f6ffd796/shares/1f5b6f0f-f341-4964-a2fa-9c4a26198f95 returned with HTTP 200 May 28 13:02:15 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1223/2422] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:02:15 2024] GET /share/v2/b00df7df3db14cce99343fc7f6ffd796/shares/1f5b6f0f-f341-4964-a2fa-9c4a26198f95 => generated 1421 bytes in 25 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:02:15 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-0a422a19-a116-4abe-8270-a5216fb03ccd tempest-ShareSnapshotMetadataNegativeTest-1199544441 tempest-ShareSnapshotMetadataNegativeTest-1199544441-project-member] POST http://10.27.203.238/share/v2/b00df7df3db14cce99343fc7f6ffd796/snapshots May 28 13:02:15 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-0a422a19-a116-4abe-8270-a5216fb03ccd tempest-ShareSnapshotMetadataNegativeTest-1199544441 tempest-ShareSnapshotMetadataNegativeTest-1199544441-project-member] Action: 'create', calling method: ShareSnapshotMixin.create, body: {"snapshot": {"name": "tempest-tempest-snapshot-name-837798685", "force": false, "description": "tempest-tempest-snapshot-description-2014796559", "share_id": "1f5b6f0f-f341-4964-a2fa-9c4a26198f95"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:02:15 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.v1.share_snapshots [None req-0a422a19-a116-4abe-8270-a5216fb03ccd tempest-ShareSnapshotMetadataNegativeTest-1199544441 tempest-ShareSnapshotMetadataNegativeTest-1199544441-project-member] Create snapshot from share 1f5b6f0f-f341-4964-a2fa-9c4a26198f95 May 28 13:02:15 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.quota [None req-0a422a19-a116-4abe-8270-a5216fb03ccd tempest-ShareSnapshotMetadataNegativeTest-1199544441 tempest-ShareSnapshotMetadataNegativeTest-1199544441-project-member] Created reservations ['aac3f319-fc77-46fb-81ec-9e017843fe66', '84517b57-295d-439b-b911-5adf904ea8c8', 'cfcd5e1d-599a-49c5-876b-8aea41ee84c6', '662bff51-3f66-428b-a8b4-2622a29d8d0e'] {{(pid=98330) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 13:02:15 l75lg1-v1 dstat.sh[49771]: 28-05 13:02:15| 3 0 96 1 0|5640M 1787M 278M 7919M|9664B 0 | 0 669k| 0 101 |2416 4217 |0.98 1.13 1.05|2.0 1.0 0| 0 0 | 0 2048M| 29 364 0 40 2 May 28 13:02:15 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-fe856cb8-57dd-4a20-862f-6a305051d799 tempest-SharesRenameTest-1796622866 None] <<< [DELETE] https://127.0.0.1:40443/api/quotas/52/ May 28 13:02:15 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-fe856cb8-57dd-4a20-862f-6a305051d799 tempest-SharesRenameTest-1796622866 None] --- [DELETE] https://127.0.0.1:40443/api/quotas/52/: Done May 28 13:02:15 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-fe856cb8-57dd-4a20-862f-6a305051d799 tempest-SharesRenameTest-1796622866 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:02:15 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-fe856cb8-57dd-4a20-862f-6a305051d799 tempest-SharesRenameTest-1796622866 None] {'allow_redirects': True, May 28 13:02:15 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-fe856cb8-57dd-4a20-862f-6a305051d799 tempest-SharesRenameTest-1796622866 None] 'params': {'name': '37860c08-1995-417c-b284-dd741fb36e15'}} May 28 13:02:15 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.quota [None req-0a422a19-a116-4abe-8270-a5216fb03ccd tempest-ShareSnapshotMetadataNegativeTest-1199544441 tempest-ShareSnapshotMetadataNegativeTest-1199544441-project-member] Committed reservations ['aac3f319-fc77-46fb-81ec-9e017843fe66', '84517b57-295d-439b-b911-5adf904ea8c8', 'cfcd5e1d-599a-49c5-876b-8aea41ee84c6', '662bff51-3f66-428b-a8b4-2622a29d8d0e'] {{(pid=98330) commit /opt/stack/manila/manila/quota.py:1063}} May 28 13:02:15 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-0a422a19-a116-4abe-8270-a5216fb03ccd tempest-ShareSnapshotMetadataNegativeTest-1199544441 tempest-ShareSnapshotMetadataNegativeTest-1199544441-project-member] http://10.27.203.238/share/v2/b00df7df3db14cce99343fc7f6ffd796/snapshots returned with HTTP 202 May 28 13:02:15 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1200/2423] 10.27.203.238 () {66 vars in 1371 bytes} [Tue May 28 13:02:15 2024] POST /share/v2/b00df7df3db14cce99343fc7f6ffd796/snapshots => generated 746 bytes in 182 msecs (HTTP/1.1 202) 6 headers in 237 bytes (2 switches on core 0) May 28 13:02:15 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-1da43f17-5221-41fd-8033-4ae0f4ad6f54 tempest-ShareSnapshotMetadataNegativeTest-1199544441 tempest-ShareSnapshotMetadataNegativeTest-1199544441-project-member] GET http://10.27.203.238/share/v2/b00df7df3db14cce99343fc7f6ffd796/snapshots/36312f3e-0719-4e74-b65e-57fb01533bab May 28 13:02:15 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-1da43f17-5221-41fd-8033-4ae0f4ad6f54 tempest-ShareSnapshotMetadataNegativeTest-1199544441 tempest-ShareSnapshotMetadataNegativeTest-1199544441-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:02:15 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-1da43f17-5221-41fd-8033-4ae0f4ad6f54 tempest-ShareSnapshotMetadataNegativeTest-1199544441 tempest-ShareSnapshotMetadataNegativeTest-1199544441-project-member] Calling method 'ShareSnapshotMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:02:15 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-1da43f17-5221-41fd-8033-4ae0f4ad6f54 tempest-ShareSnapshotMetadataNegativeTest-1199544441 tempest-ShareSnapshotMetadataNegativeTest-1199544441-project-member] http://10.27.203.238/share/v2/b00df7df3db14cce99343fc7f6ffd796/snapshots/36312f3e-0719-4e74-b65e-57fb01533bab returned with HTTP 200 May 28 13:02:15 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1224/2424] 10.27.203.238 () {64 vars in 1460 bytes} [Tue May 28 13:02:15 2024] GET /share/v2/b00df7df3db14cce99343fc7f6ffd796/snapshots/36312f3e-0719-4e74-b65e-57fb01533bab => generated 746 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:02:15 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0a422a19-a116-4abe-8270-a5216fb03ccd tempest-ShareSnapshotMetadataNegativeTest-1199544441 None] >>> [POST] https://127.0.0.1:40443/api/snapshots/ May 28 13:02:15 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0a422a19-a116-4abe-8270-a5216fb03ccd tempest-ShareSnapshotMetadataNegativeTest-1199544441 None] {'data': '{"path": "/manila/manila-f49db035-ea92-4df4-9284-1e5ce7e3fd79", ' May 28 13:02:15 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0a422a19-a116-4abe-8270-a5216fb03ccd tempest-ShareSnapshotMetadataNegativeTest-1199544441 None] '"name": "share-snapshot-b6960986-632d-4860-aa43-93a418c568db"}', May 28 13:02:15 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0a422a19-a116-4abe-8270-a5216fb03ccd tempest-ShareSnapshotMetadataNegativeTest-1199544441 None] 'json': None, May 28 13:02:15 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0a422a19-a116-4abe-8270-a5216fb03ccd tempest-ShareSnapshotMetadataNegativeTest-1199544441 None] 'params': None} May 28 13:02:15 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-324c4220-69c0-4547-bbb1-e29a2e4b5a41 tempest-ShareRulesTest-1530341375 None] <<< [PATCH] https://127.0.0.1:40443/api/viewpolicies/38/ May 28 13:02:15 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-324c4220-69c0-4547-bbb1-e29a2e4b5a41 tempest-ShareRulesTest-1530341375 None] Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=1, created='2024-05-28T12:59:53.824250Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='0fa84ccd-850f-48fa-a965-23e5abe31188', id=38, internal=False, is_s3_default_policy=False, name='f7e47502-a0f7-44de-953d-b7b5697ae0b2', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=['*'], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['203.0.113.77'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['203.0.113.77'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='MODIFYING', sync_time='2024-05-28T13:02:14.824557Z', tenant_id=1, tenant_name='default', title='f7e47502-a0f7-44de-953d-b7b5697ae0b2', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/38/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[]) May 28 13:02:15 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-324c4220-69c0-4547-bbb1-e29a2e4b5a41 tempest-ShareRulesTest-1530341375 None] --- [PATCH] https://127.0.0.1:40443/api/viewpolicies/38/: Done May 28 13:02:15 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-324c4220-69c0-4547-bbb1-e29a2e4b5a41 tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:02:15 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-324c4220-69c0-4547-bbb1-e29a2e4b5a41 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:02:15 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-324c4220-69c0-4547-bbb1-e29a2e4b5a41 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.055s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:02:15 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-324c4220-69c0-4547-bbb1-e29a2e4b5a41 tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:02:15 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-324c4220-69c0-4547-bbb1-e29a2e4b5a41 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:02:15 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-324c4220-69c0-4547-bbb1-e29a2e4b5a41 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:02:15 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-324c4220-69c0-4547-bbb1-e29a2e4b5a41 tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:02:15 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-324c4220-69c0-4547-bbb1-e29a2e4b5a41 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:02:15 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-324c4220-69c0-4547-bbb1-e29a2e4b5a41 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:02:15 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-324c4220-69c0-4547-bbb1-e29a2e4b5a41 tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:02:15 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-324c4220-69c0-4547-bbb1-e29a2e4b5a41 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:02:15 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-324c4220-69c0-4547-bbb1-e29a2e4b5a41 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:02:15 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-324c4220-69c0-4547-bbb1-e29a2e4b5a41 tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:02:15 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-324c4220-69c0-4547-bbb1-e29a2e4b5a41 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:02:15 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-324c4220-69c0-4547-bbb1-e29a2e4b5a41 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.040s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:02:15 l75lg1-v1 manila-share[98474]: INFO manila.share.access [None req-324c4220-69c0-4547-bbb1-e29a2e4b5a41 tempest-ShareRulesTest-1530341375 None] Access rules were successfully modified for share instance f7e47502-a0f7-44de-953d-b7b5697ae0b2 belonging to share b330db31-7766-443d-9c19-26fe349665aa. May 28 13:02:15 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-fe856cb8-57dd-4a20-862f-6a305051d799 tempest-SharesRenameTest-1796622866 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:02:15 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-fe856cb8-57dd-4a20-862f-6a305051d799 tempest-SharesRenameTest-1796622866 None] [Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=0, created='2024-05-28T13:01:54.553833Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='072fe17e-3b08-4d54-9857-08077f2b6bed', id=55, internal=False, is_s3_default_policy=False, name='37860c08-1995-417c-b284-dd741fb36e15', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=[], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['*'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['*'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T13:01:54.864801Z', tenant_id=1, tenant_name='default', title='37860c08-1995-417c-b284-dd741fb36e15', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/55/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[])] May 28 13:02:15 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-fe856cb8-57dd-4a20-862f-6a305051d799 tempest-SharesRenameTest-1796622866 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 13:02:15 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-fe856cb8-57dd-4a20-862f-6a305051d799 tempest-SharesRenameTest-1796622866 None] >>> [DELETE] https://127.0.0.1:40443/api/viewpolicies/55/ May 28 13:02:15 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-68abc236-6447-4be5-84fc-7249828ccd9d tempest-SharesRenameTest-1796622866 tempest-SharesRenameTest-1796622866-project-member] GET http://10.27.203.238/share/v2/6035b1be773e417b80fb3d9ea83eac8d/shares/e02829cb-d0c9-478e-80fa-e4ec0bf3843c May 28 13:02:15 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-68abc236-6447-4be5-84fc-7249828ccd9d tempest-SharesRenameTest-1796622866 tempest-SharesRenameTest-1796622866-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:02:15 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-68abc236-6447-4be5-84fc-7249828ccd9d tempest-SharesRenameTest-1796622866 tempest-SharesRenameTest-1796622866-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:02:15 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-68abc236-6447-4be5-84fc-7249828ccd9d tempest-SharesRenameTest-1796622866 tempest-SharesRenameTest-1796622866-project-member] http://10.27.203.238/share/v2/6035b1be773e417b80fb3d9ea83eac8d/shares/e02829cb-d0c9-478e-80fa-e4ec0bf3843c returned with HTTP 200 May 28 13:02:15 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1201/2425] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:02:15 2024] GET /share/v2/6035b1be773e417b80fb3d9ea83eac8d/shares/e02829cb-d0c9-478e-80fa-e4ec0bf3843c => generated 1338 bytes in 25 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:02:16 l75lg1-v1 dstat.sh[49771]: 28-05 13:02:16| 3 1 96 1 0|5640M 1787M 278M 7919M| 18k 2405B| 0 788k| 0 89.0 |2952 4757 |0.98 1.13 1.05|1.0 1.0 0| 0 0 | 0 2048M| 29 363 0 37 2 May 28 13:02:16 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-651171ce-b7cf-49ea-bf46-5cde2c801586 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] GET http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/share-access-rules?share_id=b330db31-7766-443d-9c19-26fe349665aa May 28 13:02:16 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-651171ce-b7cf-49ea-bf46-5cde2c801586 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:02:16 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-651171ce-b7cf-49ea-bf46-5cde2c801586 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:02:16 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.lock.api [None req-651171ce-b7cf-49ea-bf46-5cde2c801586 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Searching for locks by: {'resource_id': 'e375b962-40a2-4bc9-ab8d-12ca8470f1ba', 'resource_action': 'show', 'resource_type': 'access_rule'} {{(pid=98329) get_all /opt/stack/manila/manila/lock/api.py:112}} May 28 13:02:16 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-651171ce-b7cf-49ea-bf46-5cde2c801586 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/share-access-rules?share_id=b330db31-7766-443d-9c19-26fe349665aa returned with HTTP 200 May 28 13:02:16 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1225/2426] 10.27.203.238 () {64 vars in 1467 bytes} [Tue May 28 13:02:16 2024] GET /share/v2/a4f3887fa28c457390f5b66615564430/share-access-rules?share_id=b330db31-7766-443d-9c19-26fe349665aa => generated 280 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:02:16 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-41765e75-388c-4c49-a78e-e412435635ca tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] GET http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/share-access-rules?share_id=b330db31-7766-443d-9c19-26fe349665aa May 28 13:02:16 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-41765e75-388c-4c49-a78e-e412435635ca tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:02:16 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-41765e75-388c-4c49-a78e-e412435635ca tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:02:16 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.lock.api [None req-41765e75-388c-4c49-a78e-e412435635ca tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Searching for locks by: {'resource_id': 'e375b962-40a2-4bc9-ab8d-12ca8470f1ba', 'resource_action': 'show', 'resource_type': 'access_rule'} {{(pid=98330) get_all /opt/stack/manila/manila/lock/api.py:112}} May 28 13:02:16 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-41765e75-388c-4c49-a78e-e412435635ca tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/share-access-rules?share_id=b330db31-7766-443d-9c19-26fe349665aa returned with HTTP 200 May 28 13:02:16 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1202/2427] 10.27.203.238 () {64 vars in 1467 bytes} [Tue May 28 13:02:16 2024] GET /share/v2/a4f3887fa28c457390f5b66615564430/share-access-rules?share_id=b330db31-7766-443d-9c19-26fe349665aa => generated 280 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:02:16 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-1291fd35-103e-4f8d-9a96-e1e785db20e4 tempest-ShareRulesTest-1530341375 tempest-manila_a4f3887fa28c457390f5b66615564430-579326759] GET http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/share-access-rules?share_id=b330db31-7766-443d-9c19-26fe349665aa May 28 13:02:16 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-1291fd35-103e-4f8d-9a96-e1e785db20e4 tempest-ShareRulesTest-1530341375 tempest-manila_a4f3887fa28c457390f5b66615564430-579326759] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:02:16 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-1291fd35-103e-4f8d-9a96-e1e785db20e4 tempest-ShareRulesTest-1530341375 tempest-manila_a4f3887fa28c457390f5b66615564430-579326759] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:02:16 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.lock.api [None req-1291fd35-103e-4f8d-9a96-e1e785db20e4 tempest-ShareRulesTest-1530341375 tempest-manila_a4f3887fa28c457390f5b66615564430-579326759] Searching for locks by: {'resource_id': 'e375b962-40a2-4bc9-ab8d-12ca8470f1ba', 'resource_action': 'show', 'resource_type': 'access_rule'} {{(pid=98329) get_all /opt/stack/manila/manila/lock/api.py:112}} May 28 13:02:16 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-1291fd35-103e-4f8d-9a96-e1e785db20e4 tempest-ShareRulesTest-1530341375 tempest-manila_a4f3887fa28c457390f5b66615564430-579326759] http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/share-access-rules?share_id=b330db31-7766-443d-9c19-26fe349665aa returned with HTTP 200 May 28 13:02:16 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1226/2428] 10.27.203.238 () {64 vars in 1467 bytes} [Tue May 28 13:02:16 2024] GET /share/v2/a4f3887fa28c457390f5b66615564430/share-access-rules?share_id=b330db31-7766-443d-9c19-26fe349665aa => generated 280 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:02:16 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-df474db4-1844-4bf6-aaeb-ba577f2824f6 tempest-ShareRulesTest-1530341375 tempest-manila_a4f3887fa28c457390f5b66615564430-579326759] GET http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/share-access-rules?share_id=b330db31-7766-443d-9c19-26fe349665aa May 28 13:02:16 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-df474db4-1844-4bf6-aaeb-ba577f2824f6 tempest-ShareRulesTest-1530341375 tempest-manila_a4f3887fa28c457390f5b66615564430-579326759] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:02:16 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-df474db4-1844-4bf6-aaeb-ba577f2824f6 tempest-ShareRulesTest-1530341375 tempest-manila_a4f3887fa28c457390f5b66615564430-579326759] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:02:16 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.lock.api [None req-df474db4-1844-4bf6-aaeb-ba577f2824f6 tempest-ShareRulesTest-1530341375 tempest-manila_a4f3887fa28c457390f5b66615564430-579326759] Searching for locks by: {'resource_id': 'e375b962-40a2-4bc9-ab8d-12ca8470f1ba', 'resource_action': 'show', 'resource_type': 'access_rule'} {{(pid=98330) get_all /opt/stack/manila/manila/lock/api.py:112}} May 28 13:02:16 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-df474db4-1844-4bf6-aaeb-ba577f2824f6 tempest-ShareRulesTest-1530341375 tempest-manila_a4f3887fa28c457390f5b66615564430-579326759] http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/share-access-rules?share_id=b330db31-7766-443d-9c19-26fe349665aa returned with HTTP 200 May 28 13:02:16 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1203/2429] 10.27.203.238 () {64 vars in 1467 bytes} [Tue May 28 13:02:16 2024] GET /share/v2/a4f3887fa28c457390f5b66615564430/share-access-rules?share_id=b330db31-7766-443d-9c19-26fe349665aa => generated 280 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:02:16 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-f780631c-f49d-4fa0-9946-63f2d95845b9 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] POST http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/shares/b330db31-7766-443d-9c19-26fe349665aa/action May 28 13:02:16 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-f780631c-f49d-4fa0-9946-63f2d95845b9 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Action body: b'{"deny_access": {"access_id": "e375b962-40a2-4bc9-ab8d-12ca8470f1ba", "unrestrict": true}}' {{(pid=98329) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 13:02:16 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-f780631c-f49d-4fa0-9946-63f2d95845b9 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Action: 'action', calling method: ShareController.deny_access, body: {"deny_access": {"access_id": "e375b962-40a2-4bc9-ab8d-12ca8470f1ba", "unrestrict": true}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:02:16 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.lock.api [None req-f780631c-f49d-4fa0-9946-63f2d95845b9 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Searching for locks by: {'resource_id': 'e375b962-40a2-4bc9-ab8d-12ca8470f1ba', 'resource_action': 'delete'} {{(pid=98329) get_all /opt/stack/manila/manila/lock/api.py:112}} May 28 13:02:16 l75lg1-v1 devstack@m-api.service[98329]: DEBUG oslo_concurrency.lockutils [None req-f780631c-f49d-4fa0-9946-63f2d95845b9 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98329) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:02:16 l75lg1-v1 devstack@m-api.service[98329]: DEBUG oslo_concurrency.lockutils [None req-f780631c-f49d-4fa0-9946-63f2d95845b9 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98329) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:02:16 l75lg1-v1 devstack@m-api.service[98329]: DEBUG oslo_concurrency.lockutils [None req-f780631c-f49d-4fa0-9946-63f2d95845b9 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.048s {{(pid=98329) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:02:16 l75lg1-v1 devstack@m-api.service[98329]: DEBUG oslo_concurrency.lockutils [None req-f780631c-f49d-4fa0-9946-63f2d95845b9 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98329) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:02:16 l75lg1-v1 devstack@m-api.service[98329]: DEBUG oslo_concurrency.lockutils [None req-f780631c-f49d-4fa0-9946-63f2d95845b9 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98329) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:02:16 l75lg1-v1 devstack@m-api.service[98329]: DEBUG oslo_concurrency.lockutils [None req-f780631c-f49d-4fa0-9946-63f2d95845b9 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.052s {{(pid=98329) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:02:16 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-f780631c-f49d-4fa0-9946-63f2d95845b9 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/shares/b330db31-7766-443d-9c19-26fe349665aa/action returned with HTTP 202 May 28 13:02:16 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1227/2430] 10.27.203.238 () {66 vars in 1493 bytes} [Tue May 28 13:02:16 2024] POST /share/v2/a4f3887fa28c457390f5b66615564430/shares/b330db31-7766-443d-9c19-26fe349665aa/action => generated 0 bytes in 182 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 13:02:16 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-d0949a03-d40c-4756-8194-12dfa3665e83 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] GET http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/share-access-rules?share_id=b330db31-7766-443d-9c19-26fe349665aa May 28 13:02:16 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-d0949a03-d40c-4756-8194-12dfa3665e83 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:02:16 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-d0949a03-d40c-4756-8194-12dfa3665e83 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:02:16 l75lg1-v1 manila-share[98474]: DEBUG manila.share.manager [None req-f780631c-f49d-4fa0-9946-63f2d95845b9 tempest-ShareRulesTest-1530341375 None] Received request to update access for share instance f7e47502-a0f7-44de-953d-b7b5697ae0b2. {{(pid=98474) update_access_for_instances /opt/stack/manila/manila/share/manager.py:4353}} May 28 13:02:16 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.lock.api [None req-d0949a03-d40c-4756-8194-12dfa3665e83 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Searching for locks by: {'resource_id': 'e375b962-40a2-4bc9-ab8d-12ca8470f1ba', 'resource_action': 'show', 'resource_type': 'access_rule'} {{(pid=98330) get_all /opt/stack/manila/manila/lock/api.py:112}} May 28 13:02:16 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-d0949a03-d40c-4756-8194-12dfa3665e83 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/share-access-rules?share_id=b330db31-7766-443d-9c19-26fe349665aa returned with HTTP 200 May 28 13:02:16 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-f780631c-f49d-4fa0-9946-63f2d95845b9 tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:02:16 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1204/2431] 10.27.203.238 () {64 vars in 1467 bytes} [Tue May 28 13:02:16 2024] GET /share/v2/a4f3887fa28c457390f5b66615564430/share-access-rules?share_id=b330db31-7766-443d-9c19-26fe349665aa => generated 288 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:02:16 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-f780631c-f49d-4fa0-9946-63f2d95845b9 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:02:16 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-f780631c-f49d-4fa0-9946-63f2d95845b9 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:02:16 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-f780631c-f49d-4fa0-9946-63f2d95845b9 tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:02:16 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-f780631c-f49d-4fa0-9946-63f2d95845b9 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:02:16 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-f780631c-f49d-4fa0-9946-63f2d95845b9 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.051s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:02:16 l75lg1-v1 manila-share[98474]: DEBUG manila.share.access [None req-f780631c-f49d-4fa0-9946-63f2d95845b9 tempest-ShareRulesTest-1530341375 None] Updating access rules for share instance f7e47502-a0f7-44de-953d-b7b5697ae0b2 belonging to share b330db31-7766-443d-9c19-26fe349665aa. {{(pid=98474) update_access_rules /opt/stack/manila/manila/share/access.py:298}} May 28 13:02:16 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-f780631c-f49d-4fa0-9946-63f2d95845b9 tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:02:16 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-f780631c-f49d-4fa0-9946-63f2d95845b9 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:02:16 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-f780631c-f49d-4fa0-9946-63f2d95845b9 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.007s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:02:16 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-f780631c-f49d-4fa0-9946-63f2d95845b9 tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:02:16 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-f780631c-f49d-4fa0-9946-63f2d95845b9 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:02:16 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-f780631c-f49d-4fa0-9946-63f2d95845b9 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.017s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:02:16 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-f780631c-f49d-4fa0-9946-63f2d95845b9 tempest-ShareRulesTest-1530341375 None] changing access on None May 28 13:02:16 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f780631c-f49d-4fa0-9946-63f2d95845b9 tempest-ShareRulesTest-1530341375 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:02:16 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f780631c-f49d-4fa0-9946-63f2d95845b9 tempest-ShareRulesTest-1530341375 None] {'allow_redirects': True, May 28 13:02:16 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f780631c-f49d-4fa0-9946-63f2d95845b9 tempest-ShareRulesTest-1530341375 None] 'params': {'name': 'f7e47502-a0f7-44de-953d-b7b5697ae0b2'}} May 28 13:02:17 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-fe856cb8-57dd-4a20-862f-6a305051d799 tempest-SharesRenameTest-1796622866 None] <<< [DELETE] https://127.0.0.1:40443/api/viewpolicies/55/ May 28 13:02:17 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-fe856cb8-57dd-4a20-862f-6a305051d799 tempest-SharesRenameTest-1796622866 None] --- [DELETE] https://127.0.0.1:40443/api/viewpolicies/55/: Done May 28 13:02:17 l75lg1-v1 neutron-server[77618]: DEBUG dbcounter [-] [77618] Writing DB stats neutron:SELECT=2 {{(pid=77618) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:02:17 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-fe856cb8-57dd-4a20-862f-6a305051d799 tempest-SharesRenameTest-1796622866 None] Created reservations ['67b522a0-f796-4e62-8bc1-d5fcef0566f7', 'd311ebc5-1f3f-4028-a336-ef6420e483f1', 'ccaa49de-ce24-4d91-96fd-765381703ad9', '7af84be1-c46b-4bbc-9c83-c5dc2523d00a'] {{(pid=98474) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 13:02:17 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-fe856cb8-57dd-4a20-862f-6a305051d799 tempest-SharesRenameTest-1796622866 None] Committed reservations ['67b522a0-f796-4e62-8bc1-d5fcef0566f7', 'd311ebc5-1f3f-4028-a336-ef6420e483f1', 'ccaa49de-ce24-4d91-96fd-765381703ad9', '7af84be1-c46b-4bbc-9c83-c5dc2523d00a'] {{(pid=98474) commit /opt/stack/manila/manila/quota.py:1063}} May 28 13:02:17 l75lg1-v1 manila-share[98474]: INFO manila.share.manager [None req-fe856cb8-57dd-4a20-862f-6a305051d799 tempest-SharesRenameTest-1796622866 None] Share instance 37860c08-1995-417c-b284-dd741fb36e15: deleted successfully. May 28 13:02:17 l75lg1-v1 dstat.sh[49771]: 28-05 13:02:17| 7 1 90 1 0|5641M 1786M 278M 7919M| 12k 908B| 0 1052k| 0 154 |4365 6983 |1.14 1.16 1.06| 0 1.0 0| 0 0 | 0 2048M| 29 363 0 37 2 May 28 13:02:17 l75lg1-v1 neutron-server[77618]: DEBUG dbcounter [-] [77618] Writing DB stats neutron:UPDATE=1,neutron:SELECT=3 {{(pid=77618) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:02:17 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f780631c-f49d-4fa0-9946-63f2d95845b9 tempest-ShareRulesTest-1530341375 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:02:17 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f780631c-f49d-4fa0-9946-63f2d95845b9 tempest-ShareRulesTest-1530341375 None] [Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=1, created='2024-05-28T12:59:53.824250Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='0fa84ccd-850f-48fa-a965-23e5abe31188', id=38, internal=False, is_s3_default_policy=False, name='f7e47502-a0f7-44de-953d-b7b5697ae0b2', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=['*'], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['203.0.113.77'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['203.0.113.77'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T13:02:15.251757Z', tenant_id=1, tenant_name='default', title='f7e47502-a0f7-44de-953d-b7b5697ae0b2', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/38/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[])] May 28 13:02:17 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f780631c-f49d-4fa0-9946-63f2d95845b9 tempest-ShareRulesTest-1530341375 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 13:02:17 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-f780631c-f49d-4fa0-9946-63f2d95845b9 tempest-ShareRulesTest-1530341375 None] changing access on /manila/manila-f7e47502-a0f7-44de-953d-b7b5697ae0b2. Rules: {'nfs_read_write': [], 'nfs_read_only': []} May 28 13:02:17 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f780631c-f49d-4fa0-9946-63f2d95845b9 tempest-ShareRulesTest-1530341375 None] >>> [PATCH] https://127.0.0.1:40443/api/viewpolicies/38/ May 28 13:02:17 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f780631c-f49d-4fa0-9946-63f2d95845b9 tempest-ShareRulesTest-1530341375 None] {'data': '{"name": "f7e47502-a0f7-44de-953d-b7b5697ae0b2", "nfs_no_squash": ' May 28 13:02:17 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f780631c-f49d-4fa0-9946-63f2d95845b9 tempest-ShareRulesTest-1530341375 None] '["*"], "nfs_root_squash": ["*"], "nfs_read_write": [], ' May 28 13:02:17 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f780631c-f49d-4fa0-9946-63f2d95845b9 tempest-ShareRulesTest-1530341375 None] '"nfs_read_only": []}', May 28 13:02:17 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f780631c-f49d-4fa0-9946-63f2d95845b9 tempest-ShareRulesTest-1530341375 None] 'params': None} May 28 13:02:17 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0a422a19-a116-4abe-8270-a5216fb03ccd tempest-ShareSnapshotMetadataNegativeTest-1199544441 None] <<< [POST] https://127.0.0.1:40443/api/snapshots/ May 28 13:02:17 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0a422a19-a116-4abe-8270-a5216fb03ccd tempest-ShareSnapshotMetadataNegativeTest-1199544441 None] Bunch(access_path='/.vast_all_snapshots/1000000015_share-snapshot-b6960986-632d-4860-aa43-93a418c568db', aggr_phys_estimation=0, cluster='loop75-kfs', created='2024-05-28T13:02:15.674084Z', eta_sec=30819898660.43013, expiration_time='3001-01-19T07:59:58Z', guid='075a349c-446e-4368-a6c1-0fa01a67a445', id=16, indestructible=False, locked=False, name='share-snapshot-b6960986-632d-4860-aa43-93a418c568db', path='/manila/manila-f49db035-ea92-4df4-9284-1e5ce7e3fd79/', policy=None, policy_id=None, protection_policy_id=None, state='SUCCEED', tenant_id=1, tenant_name='default', title='share-snapshot-b6960986-632d-4860-aa43-93a418c568db(/manila/manila-f49db035-ea92-4df4-9284-1e5ce7e3fd79/)', type='local', unique_phys_estimation=0, url='https://127.0.0.1:40443/api/snapshots/16/') May 28 13:02:17 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-0a422a19-a116-4abe-8270-a5216fb03ccd tempest-ShareSnapshotMetadataNegativeTest-1199544441 None] --- [POST] https://127.0.0.1:40443/api/snapshots/: Done May 28 13:02:18 l75lg1-v1 dstat.sh[49771]: 28-05 13:02:18| 1 0 98 1 0|5642M 1785M 278M 7919M| 25k 1057B| 0 588k| 0 66.0 |2486 3832 |1.14 1.16 1.06|1.0 1.0 2.0| 0 0 | 0 2048M| 29 363 0 33 2 May 28 13:02:18 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-0f46082f-368b-4651-9748-31e60fd42dfe tempest-ShareSnapshotMetadataNegativeTest-1199544441 tempest-ShareSnapshotMetadataNegativeTest-1199544441-project-member] GET http://10.27.203.238/share/v2/b00df7df3db14cce99343fc7f6ffd796/snapshots/36312f3e-0719-4e74-b65e-57fb01533bab May 28 13:02:18 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-0f46082f-368b-4651-9748-31e60fd42dfe tempest-ShareSnapshotMetadataNegativeTest-1199544441 tempest-ShareSnapshotMetadataNegativeTest-1199544441-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:02:18 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-0f46082f-368b-4651-9748-31e60fd42dfe tempest-ShareSnapshotMetadataNegativeTest-1199544441 tempest-ShareSnapshotMetadataNegativeTest-1199544441-project-member] Calling method 'ShareSnapshotMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:02:18 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-0f46082f-368b-4651-9748-31e60fd42dfe tempest-ShareSnapshotMetadataNegativeTest-1199544441 tempest-ShareSnapshotMetadataNegativeTest-1199544441-project-member] http://10.27.203.238/share/v2/b00df7df3db14cce99343fc7f6ffd796/snapshots/36312f3e-0719-4e74-b65e-57fb01533bab returned with HTTP 200 May 28 13:02:18 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1228/2432] 10.27.203.238 () {64 vars in 1460 bytes} [Tue May 28 13:02:18 2024] GET /share/v2/b00df7df3db14cce99343fc7f6ffd796/snapshots/36312f3e-0719-4e74-b65e-57fb01533bab => generated 747 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:02:18 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-a19fdfcf-7c52-427c-a41d-695886359055 tempest-ShareSnapshotMetadataNegativeTest-1199544441 tempest-ShareSnapshotMetadataNegativeTest-1199544441-project-member] DELETE http://10.27.203.238/share/v2/b00df7df3db14cce99343fc7f6ffd796/snapshots/36312f3e-0719-4e74-b65e-57fb01533bab/metadata/wrong_key May 28 13:02:18 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-a19fdfcf-7c52-427c-a41d-695886359055 tempest-ShareSnapshotMetadataNegativeTest-1199544441 tempest-ShareSnapshotMetadataNegativeTest-1199544441-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:02:18 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-a19fdfcf-7c52-427c-a41d-695886359055 tempest-ShareSnapshotMetadataNegativeTest-1199544441 tempest-ShareSnapshotMetadataNegativeTest-1199544441-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:02:18 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault [None req-a19fdfcf-7c52-427c-a41d-695886359055 tempest-ShareSnapshotMetadataNegativeTest-1199544441 tempest-ShareSnapshotMetadataNegativeTest-1199544441-project-member] Caught error: Metadata item is not found.: manila.exception.MetadataItemNotFound: Metadata item is not found. May 28 13:02:18 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault Traceback (most recent call last): May 28 13:02:18 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/api/middleware/fault.py", line 76, in __call__ May 28 13:02:18 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return req.get_response(self.application) May 28 13:02:18 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/request.py", line 1313, in send May 28 13:02:18 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault status, headers, app_iter = self.call_application( May 28 13:02:18 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/request.py", line 1278, in call_application May 28 13:02:18 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault app_iter = application(self.environ, start_response) May 28 13:02:18 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 129, in __call__ May 28 13:02:18 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault resp = self.call_func(req, *args, **kw) May 28 13:02:18 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 193, in call_func May 28 13:02:18 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return self.func(req, *args, **kwargs) May 28 13:02:18 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_middleware/base.py", line 124, in __call__ May 28 13:02:18 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault response = req.get_response(self.application) May 28 13:02:18 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/request.py", line 1313, in send May 28 13:02:18 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault status, headers, app_iter = self.call_application( May 28 13:02:18 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/request.py", line 1278, in call_application May 28 13:02:18 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault app_iter = application(self.environ, start_response) May 28 13:02:18 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 143, in __call__ May 28 13:02:18 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return resp(environ, start_response) May 28 13:02:18 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 129, in __call__ May 28 13:02:18 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault resp = self.call_func(req, *args, **kw) May 28 13:02:18 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 193, in call_func May 28 13:02:18 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return self.func(req, *args, **kwargs) May 28 13:02:18 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/osprofiler/web.py", line 111, in __call__ May 28 13:02:18 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return request.get_response(self.application) May 28 13:02:18 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/request.py", line 1313, in send May 28 13:02:18 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault status, headers, app_iter = self.call_application( May 28 13:02:18 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/request.py", line 1278, in call_application May 28 13:02:18 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault app_iter = application(self.environ, start_response) May 28 13:02:18 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 129, in __call__ May 28 13:02:18 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault resp = self.call_func(req, *args, **kw) May 28 13:02:18 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 193, in call_func May 28 13:02:18 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return self.func(req, *args, **kwargs) May 28 13:02:18 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py", line 340, in __call__ May 28 13:02:18 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault response = req.get_response(self._app) May 28 13:02:18 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/request.py", line 1313, in send May 28 13:02:18 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault status, headers, app_iter = self.call_application( May 28 13:02:18 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/request.py", line 1278, in call_application May 28 13:02:18 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault app_iter = application(self.environ, start_response) May 28 13:02:18 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 143, in __call__ May 28 13:02:18 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return resp(environ, start_response) May 28 13:02:18 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 143, in __call__ May 28 13:02:18 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return resp(environ, start_response) May 28 13:02:18 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/routes/middleware.py", line 153, in __call__ May 28 13:02:18 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault response = self.app(environ, start_response) May 28 13:02:18 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 143, in __call__ May 28 13:02:18 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return resp(environ, start_response) May 28 13:02:18 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 129, in __call__ May 28 13:02:18 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault resp = self.call_func(req, *args, **kw) May 28 13:02:18 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 193, in call_func May 28 13:02:18 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return self.func(req, *args, **kwargs) May 28 13:02:18 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/api/openstack/wsgi.py", line 764, in __call__ May 28 13:02:18 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return self._process_stack(request, action, action_args, May 28 13:02:18 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/api/openstack/wsgi.py", line 829, in _process_stack May 28 13:02:18 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault action_result = self.dispatch(meth, request, action_args) May 28 13:02:18 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/api/openstack/wsgi.py", line 924, in dispatch May 28 13:02:18 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return method(req=request, **action_args) May 28 13:02:18 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/api/openstack/wsgi.py", line 1066, in version_select May 28 13:02:18 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return func.func(self, *args, **kwargs) May 28 13:02:18 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/api/openstack/wsgi.py", line 1160, in wrapper May 28 13:02:18 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return f(self, req, *args, **kwargs) May 28 13:02:18 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/api/v2/share_snapshots.py", line 386, in delete_metadata May 28 13:02:18 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return self._delete_metadata(req, resource_id, key) May 28 13:02:18 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/api/v2/metadata.py", line 241, in _delete_metadata May 28 13:02:18 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault get_metadata_item_method(context, resource_id, key) May 28 13:02:18 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/db/api.py", line 867, in share_snapshot_metadata_get_item May 28 13:02:18 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return IMPL.share_snapshot_metadata_get_item(context, May 28 13:02:18 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/enginefacade.py", line 998, in wrapper May 28 13:02:18 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return fn(*args, **kwargs) May 28 13:02:18 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/db/sqlalchemy/api.py", line 3779, in share_snapshot_metadata_get_item May 28 13:02:18 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault row = _share_snapshot_metadata_get_item(context, share_snapshot_id, key) May 28 13:02:18 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/db/sqlalchemy/api.py", line 3810, in _share_snapshot_metadata_get_item May 28 13:02:18 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault raise exception.MetadataItemNotFound May 28 13:02:18 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault manila.exception.MetadataItemNotFound: Metadata item is not found. May 28 13:02:18 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault May 28 13:02:18 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.middleware.fault [None req-a19fdfcf-7c52-427c-a41d-695886359055 tempest-ShareSnapshotMetadataNegativeTest-1199544441 tempest-ShareSnapshotMetadataNegativeTest-1199544441-project-member] http://10.27.203.238/share/v2/b00df7df3db14cce99343fc7f6ffd796/snapshots/36312f3e-0719-4e74-b65e-57fb01533bab/metadata/wrong_key returned with HTTP 404 May 28 13:02:18 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1205/2433] 10.27.203.238 () {64 vars in 1520 bytes} [Tue May 28 13:02:18 2024] DELETE /share/v2/b00df7df3db14cce99343fc7f6ffd796/snapshots/36312f3e-0719-4e74-b65e-57fb01533bab/metadata/wrong_key => generated 95 bytes in 45 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 13:02:18 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-513f9fff-0a7f-4983-890c-26e4b2254ad2 tempest-ShareSnapshotMetadataNegativeTest-1199544441 tempest-ShareSnapshotMetadataNegativeTest-1199544441-project-member] POST http://10.27.203.238/share/v2/b00df7df3db14cce99343fc7f6ffd796/snapshots/wrong_snapshot_id/metadata May 28 13:02:18 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-513f9fff-0a7f-4983-890c-26e4b2254ad2 tempest-ShareSnapshotMetadataNegativeTest-1199544441 tempest-ShareSnapshotMetadataNegativeTest-1199544441-project-member] Action: 'create_metadata', calling method: Controller.__getattribute__..version_select, body: {"metadata": {"key1": "value1", "key2": "value2"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:02:18 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-513f9fff-0a7f-4983-890c-26e4b2254ad2 tempest-ShareSnapshotMetadataNegativeTest-1199544441 tempest-ShareSnapshotMetadataNegativeTest-1199544441-project-member] HTTP exception thrown: Share_snapshot not found. May 28 13:02:18 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-513f9fff-0a7f-4983-890c-26e4b2254ad2 tempest-ShareSnapshotMetadataNegativeTest-1199544441 tempest-ShareSnapshotMetadataNegativeTest-1199544441-project-member] http://10.27.203.238/share/v2/b00df7df3db14cce99343fc7f6ffd796/snapshots/wrong_snapshot_id/metadata returned with HTTP 404 May 28 13:02:18 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1229/2434] 10.27.203.238 () {66 vars in 1451 bytes} [Tue May 28 13:02:18 2024] POST /share/v2/b00df7df3db14cce99343fc7f6ffd796/snapshots/wrong_snapshot_id/metadata => generated 71 bytes in 19 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 13:02:18 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-38d9a63d-9404-41a0-a3fb-33e84694843c tempest-ShareSnapshotMetadataNegativeTest-1199544441 tempest-ShareSnapshotMetadataNegativeTest-1199544441-project-member] POST http://10.27.203.238/share/v2/b00df7df3db14cce99343fc7f6ffd796/snapshots/36312f3e-0719-4e74-b65e-57fb01533bab/metadata May 28 13:02:18 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-38d9a63d-9404-41a0-a3fb-33e84694843c tempest-ShareSnapshotMetadataNegativeTest-1199544441 tempest-ShareSnapshotMetadataNegativeTest-1199544441-project-member] Action: 'create_metadata', calling method: Controller.__getattribute__..version_select, body: {"metadata": {"": "value"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:02:18 l75lg1-v1 devstack@m-api.service[98330]: WARNING manila.api.common [None req-38d9a63d-9404-41a0-a3fb-33e84694843c tempest-ShareSnapshotMetadataNegativeTest-1199544441 tempest-ShareSnapshotMetadataNegativeTest-1199544441-project-member] Metadata property key is blank. May 28 13:02:18 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-38d9a63d-9404-41a0-a3fb-33e84694843c tempest-ShareSnapshotMetadataNegativeTest-1199544441 tempest-ShareSnapshotMetadataNegativeTest-1199544441-project-member] HTTP exception thrown: Metadata property key is blank. May 28 13:02:18 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-38d9a63d-9404-41a0-a3fb-33e84694843c tempest-ShareSnapshotMetadataNegativeTest-1199544441 tempest-ShareSnapshotMetadataNegativeTest-1199544441-project-member] http://10.27.203.238/share/v2/b00df7df3db14cce99343fc7f6ffd796/snapshots/36312f3e-0719-4e74-b65e-57fb01533bab/metadata returned with HTTP 400 May 28 13:02:18 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1206/2435] 10.27.203.238 () {66 vars in 1508 bytes} [Tue May 28 13:02:18 2024] POST /share/v2/b00df7df3db14cce99343fc7f6ffd796/snapshots/36312f3e-0719-4e74-b65e-57fb01533bab/metadata => generated 75 bytes in 6 msecs (HTTP/1.1 400) 6 headers in 239 bytes (1 switches on core 0) May 28 13:02:18 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-607237fa-a161-494c-b3ad-e351b4fcfbb9 tempest-ShareSnapshotMetadataNegativeTest-1199544441 tempest-ShareSnapshotMetadataNegativeTest-1199544441-project-member] POST http://10.27.203.238/share/v2/b00df7df3db14cce99343fc7f6ffd796/snapshots/36312f3e-0719-4e74-b65e-57fb01533bab/metadata May 28 13:02:18 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-607237fa-a161-494c-b3ad-e351b4fcfbb9 tempest-ShareSnapshotMetadataNegativeTest-1199544441 tempest-ShareSnapshotMetadataNegativeTest-1199544441-project-member] Action: 'create_metadata', calling method: Controller.__getattribute__..version_select, body: {"metadata": {"xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx": "value"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:02:18 l75lg1-v1 devstack@m-api.service[98329]: WARNING manila.api.common [None req-607237fa-a161-494c-b3ad-e351b4fcfbb9 tempest-ShareSnapshotMetadataNegativeTest-1199544441 tempest-ShareSnapshotMetadataNegativeTest-1199544441-project-member] Metadata property key is greater than 255 characters. May 28 13:02:18 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-607237fa-a161-494c-b3ad-e351b4fcfbb9 tempest-ShareSnapshotMetadataNegativeTest-1199544441 tempest-ShareSnapshotMetadataNegativeTest-1199544441-project-member] HTTP exception thrown: Metadata property key is greater than 255 characters. May 28 13:02:18 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-607237fa-a161-494c-b3ad-e351b4fcfbb9 tempest-ShareSnapshotMetadataNegativeTest-1199544441 tempest-ShareSnapshotMetadataNegativeTest-1199544441-project-member] http://10.27.203.238/share/v2/b00df7df3db14cce99343fc7f6ffd796/snapshots/36312f3e-0719-4e74-b65e-57fb01533bab/metadata returned with HTTP 400 May 28 13:02:18 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1230/2436] 10.27.203.238 () {66 vars in 1509 bytes} [Tue May 28 13:02:18 2024] POST /share/v2/b00df7df3db14cce99343fc7f6ffd796/snapshots/36312f3e-0719-4e74-b65e-57fb01533bab/metadata => generated 97 bytes in 7 msecs (HTTP/1.1 400) 6 headers in 239 bytes (1 switches on core 0) May 28 13:02:18 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-541f838d-84bf-4898-8148-0bde91e50cf6 tempest-ShareSnapshotMetadataNegativeTest-1199544441 tempest-ShareSnapshotMetadataNegativeTest-1199544441-project-member] POST http://10.27.203.238/share/v2/b00df7df3db14cce99343fc7f6ffd796/snapshots/36312f3e-0719-4e74-b65e-57fb01533bab/metadata May 28 13:02:18 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-541f838d-84bf-4898-8148-0bde91e50cf6 tempest-ShareSnapshotMetadataNegativeTest-1199544441 tempest-ShareSnapshotMetadataNegativeTest-1199544441-project-member] Action: 'create_metadata', calling method: Controller.__getattribute__..version_select, body: {"metadata": {"key": "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:02:18 l75lg1-v1 devstack@m-api.service[98330]: WARNING manila.api.common [None req-541f838d-84bf-4898-8148-0bde91e50cf6 tempest-ShareSnapshotMetadataNegativeTest-1199544441 tempest-ShareSnapshotMetadataNegativeTest-1199544441-project-member] Metadata property value is greater than 1023 characters. May 28 13:02:18 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-541f838d-84bf-4898-8148-0bde91e50cf6 tempest-ShareSnapshotMetadataNegativeTest-1199544441 tempest-ShareSnapshotMetadataNegativeTest-1199544441-project-member] HTTP exception thrown: Metadata property value is greater than 1023 characters. May 28 13:02:18 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-541f838d-84bf-4898-8148-0bde91e50cf6 tempest-ShareSnapshotMetadataNegativeTest-1199544441 tempest-ShareSnapshotMetadataNegativeTest-1199544441-project-member] http://10.27.203.238/share/v2/b00df7df3db14cce99343fc7f6ffd796/snapshots/36312f3e-0719-4e74-b65e-57fb01533bab/metadata returned with HTTP 400 May 28 13:02:18 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1207/2437] 10.27.203.238 () {66 vars in 1510 bytes} [Tue May 28 13:02:18 2024] POST /share/v2/b00df7df3db14cce99343fc7f6ffd796/snapshots/36312f3e-0719-4e74-b65e-57fb01533bab/metadata => generated 100 bytes in 6 msecs (HTTP/1.1 400) 6 headers in 240 bytes (1 switches on core 0) May 28 13:02:18 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-759c1976-ebc8-49fb-9056-839ac11c8850 tempest-ShareSnapshotMetadataNegativeTest-1199544441 tempest-ShareSnapshotMetadataNegativeTest-1199544441-project-member] PUT http://10.27.203.238/share/v2/b00df7df3db14cce99343fc7f6ffd796/snapshots/36312f3e-0719-4e74-b65e-57fb01533bab/metadata May 28 13:02:18 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-759c1976-ebc8-49fb-9056-839ac11c8850 tempest-ShareSnapshotMetadataNegativeTest-1199544441 tempest-ShareSnapshotMetadataNegativeTest-1199544441-project-member] Action: 'update_all_metadata', calling method: Controller.__getattribute__..version_select, body: {"metadata": {"": "value"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:02:18 l75lg1-v1 devstack@m-api.service[98329]: WARNING manila.api.common [None req-759c1976-ebc8-49fb-9056-839ac11c8850 tempest-ShareSnapshotMetadataNegativeTest-1199544441 tempest-ShareSnapshotMetadataNegativeTest-1199544441-project-member] Metadata property key is blank. May 28 13:02:18 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-759c1976-ebc8-49fb-9056-839ac11c8850 tempest-ShareSnapshotMetadataNegativeTest-1199544441 tempest-ShareSnapshotMetadataNegativeTest-1199544441-project-member] HTTP exception thrown: Metadata property key is blank. May 28 13:02:18 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-759c1976-ebc8-49fb-9056-839ac11c8850 tempest-ShareSnapshotMetadataNegativeTest-1199544441 tempest-ShareSnapshotMetadataNegativeTest-1199544441-project-member] http://10.27.203.238/share/v2/b00df7df3db14cce99343fc7f6ffd796/snapshots/36312f3e-0719-4e74-b65e-57fb01533bab/metadata returned with HTTP 400 May 28 13:02:18 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1231/2438] 10.27.203.238 () {66 vars in 1507 bytes} [Tue May 28 13:02:18 2024] PUT /share/v2/b00df7df3db14cce99343fc7f6ffd796/snapshots/36312f3e-0719-4e74-b65e-57fb01533bab/metadata => generated 75 bytes in 6 msecs (HTTP/1.1 400) 6 headers in 239 bytes (1 switches on core 0) May 28 13:02:18 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-e8fc0994-1386-4c69-9ba4-785cb81246c8 tempest-ShareSnapshotMetadataNegativeTest-1199544441 tempest-ShareSnapshotMetadataNegativeTest-1199544441-project-member] PUT http://10.27.203.238/share/v2/b00df7df3db14cce99343fc7f6ffd796/snapshots/36312f3e-0719-4e74-b65e-57fb01533bab/metadata May 28 13:02:18 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-e8fc0994-1386-4c69-9ba4-785cb81246c8 tempest-ShareSnapshotMetadataNegativeTest-1199544441 tempest-ShareSnapshotMetadataNegativeTest-1199544441-project-member] Action: 'update_all_metadata', calling method: Controller.__getattribute__..version_select, body: {"metadata": {"xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx": "value"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:02:18 l75lg1-v1 devstack@m-api.service[98330]: WARNING manila.api.common [None req-e8fc0994-1386-4c69-9ba4-785cb81246c8 tempest-ShareSnapshotMetadataNegativeTest-1199544441 tempest-ShareSnapshotMetadataNegativeTest-1199544441-project-member] Metadata property key is greater than 255 characters. May 28 13:02:18 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-e8fc0994-1386-4c69-9ba4-785cb81246c8 tempest-ShareSnapshotMetadataNegativeTest-1199544441 tempest-ShareSnapshotMetadataNegativeTest-1199544441-project-member] HTTP exception thrown: Metadata property key is greater than 255 characters. May 28 13:02:18 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-e8fc0994-1386-4c69-9ba4-785cb81246c8 tempest-ShareSnapshotMetadataNegativeTest-1199544441 tempest-ShareSnapshotMetadataNegativeTest-1199544441-project-member] http://10.27.203.238/share/v2/b00df7df3db14cce99343fc7f6ffd796/snapshots/36312f3e-0719-4e74-b65e-57fb01533bab/metadata returned with HTTP 400 May 28 13:02:18 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1208/2439] 10.27.203.238 () {66 vars in 1508 bytes} [Tue May 28 13:02:18 2024] PUT /share/v2/b00df7df3db14cce99343fc7f6ffd796/snapshots/36312f3e-0719-4e74-b65e-57fb01533bab/metadata => generated 97 bytes in 6 msecs (HTTP/1.1 400) 6 headers in 239 bytes (1 switches on core 0) May 28 13:02:18 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-99363dcb-1611-4cdf-ab52-b3780cb0fd28 tempest-ShareSnapshotMetadataNegativeTest-1199544441 tempest-ShareSnapshotMetadataNegativeTest-1199544441-project-member] PUT http://10.27.203.238/share/v2/b00df7df3db14cce99343fc7f6ffd796/snapshots/36312f3e-0719-4e74-b65e-57fb01533bab/metadata May 28 13:02:18 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-99363dcb-1611-4cdf-ab52-b3780cb0fd28 tempest-ShareSnapshotMetadataNegativeTest-1199544441 tempest-ShareSnapshotMetadataNegativeTest-1199544441-project-member] Action: 'update_all_metadata', calling method: Controller.__getattribute__..version_select, body: {"metadata": {"key": "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:02:18 l75lg1-v1 devstack@m-api.service[98329]: WARNING manila.api.common [None req-99363dcb-1611-4cdf-ab52-b3780cb0fd28 tempest-ShareSnapshotMetadataNegativeTest-1199544441 tempest-ShareSnapshotMetadataNegativeTest-1199544441-project-member] Metadata property value is greater than 1023 characters. May 28 13:02:18 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-99363dcb-1611-4cdf-ab52-b3780cb0fd28 tempest-ShareSnapshotMetadataNegativeTest-1199544441 tempest-ShareSnapshotMetadataNegativeTest-1199544441-project-member] HTTP exception thrown: Metadata property value is greater than 1023 characters. May 28 13:02:18 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-99363dcb-1611-4cdf-ab52-b3780cb0fd28 tempest-ShareSnapshotMetadataNegativeTest-1199544441 tempest-ShareSnapshotMetadataNegativeTest-1199544441-project-member] http://10.27.203.238/share/v2/b00df7df3db14cce99343fc7f6ffd796/snapshots/36312f3e-0719-4e74-b65e-57fb01533bab/metadata returned with HTTP 400 May 28 13:02:18 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1232/2440] 10.27.203.238 () {66 vars in 1509 bytes} [Tue May 28 13:02:18 2024] PUT /share/v2/b00df7df3db14cce99343fc7f6ffd796/snapshots/36312f3e-0719-4e74-b65e-57fb01533bab/metadata => generated 100 bytes in 6 msecs (HTTP/1.1 400) 6 headers in 240 bytes (1 switches on core 0) May 28 13:02:18 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-6386313d-1314-42db-82d3-be6fbe21bff0 tempest-ShareSnapshotMetadataNegativeTest-1199544441 tempest-ShareSnapshotMetadataNegativeTest-1199544441-project-member] PUT http://10.27.203.238/share/v2/b00df7df3db14cce99343fc7f6ffd796/snapshots/wrong_snapshot_id/metadata May 28 13:02:18 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-6386313d-1314-42db-82d3-be6fbe21bff0 tempest-ShareSnapshotMetadataNegativeTest-1199544441 tempest-ShareSnapshotMetadataNegativeTest-1199544441-project-member] Action: 'update_all_metadata', calling method: Controller.__getattribute__..version_select, body: {"metadata": {"key1": "value1", "key2": "value2"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:02:18 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-6386313d-1314-42db-82d3-be6fbe21bff0 tempest-ShareSnapshotMetadataNegativeTest-1199544441 tempest-ShareSnapshotMetadataNegativeTest-1199544441-project-member] HTTP exception thrown: Share_snapshot not found. May 28 13:02:18 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-6386313d-1314-42db-82d3-be6fbe21bff0 tempest-ShareSnapshotMetadataNegativeTest-1199544441 tempest-ShareSnapshotMetadataNegativeTest-1199544441-project-member] http://10.27.203.238/share/v2/b00df7df3db14cce99343fc7f6ffd796/snapshots/wrong_snapshot_id/metadata returned with HTTP 404 May 28 13:02:18 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1209/2441] 10.27.203.238 () {66 vars in 1450 bytes} [Tue May 28 13:02:18 2024] PUT /share/v2/b00df7df3db14cce99343fc7f6ffd796/snapshots/wrong_snapshot_id/metadata => generated 71 bytes in 15 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e2d981-83f3-40bf-ac14-cc67c9bfe346 service manila] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e2d981-83f3-40bf-ac14-cc67c9bfe346 service manila] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0428a298-9eee-4198-b02d-e2d2f614c5e2 tempest-ShareSnapshotMetadataNegativeTest-1690283503 tempest-ShareSnapshotMetadataNegativeTest-1690283503-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '376994db8e664651b0e2019c32e48f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57334a24554a788ef7508e78b0d664', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0428a298-9eee-4198-b02d-e2d2f614c5e2 tempest-ShareSnapshotMetadataNegativeTest-1690283503 tempest-ShareSnapshotMetadataNegativeTest-1690283503-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0428a298-9eee-4198-b02d-e2d2f614c5e2 tempest-ShareSnapshotMetadataNegativeTest-1690283503 tempest-ShareSnapshotMetadataNegativeTest-1690283503-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0428a298-9eee-4198-b02d-e2d2f614c5e2 tempest-ShareSnapshotMetadataNegativeTest-1690283503 tempest-ShareSnapshotMetadataNegativeTest-1690283503-project-admin] PATH_INFO: `/v3/users/5000ae7b72ab4d8aad66382d4e873caf` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG dbcounter [-] [51267] Writing DB stats keystone:SELECT=1606,keystone:DELETE=241,keystone:INSERT=98 {{(pid=51267) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0428a298-9eee-4198-b02d-e2d2f614c5e2 tempest-ShareSnapshotMetadataNegativeTest-1690283503 tempest-ShareSnapshotMetadataNegativeTest-1690283503-project-admin] RBAC: Authorizing `identity:delete_user(user_id=5000ae7b72ab4d8aad66382d4e873caf)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0428a298-9eee-4198-b02d-e2d2f614c5e2 tempest-ShareSnapshotMetadataNegativeTest-1690283503 tempest-ShareSnapshotMetadataNegativeTest-1690283503-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-0428a298-9eee-4198-b02d-e2d2f614c5e2 tempest-ShareSnapshotMetadataNegativeTest-1690283503 tempest-ShareSnapshotMetadataNegativeTest-1690283503-project-admin] Could not find user: 5000ae7b72ab4d8aad66382d4e873caf.: keystone.exception.UserNotFound: Could not find user: 5000ae7b72ab4d8aad66382d4e873caf. May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 5000ae7b72ab4d8aad66382d4e873caf. May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1678/3327] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:02:18 2024] DELETE /identity/v3/users/5000ae7b72ab4d8aad66382d4e873caf => generated 110 bytes in 25 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa75c6a-8c6e-4b55-a94c-203c2cce1d04 service manila] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa75c6a-8c6e-4b55-a94c-203c2cce1d04 service manila] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7006e21d-e4be-40ee-ad4e-caed4d558b4b tempest-ShareSnapshotMetadataNegativeTest-1690283503 tempest-ShareSnapshotMetadataNegativeTest-1690283503-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '376994db8e664651b0e2019c32e48f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57334a24554a788ef7508e78b0d664', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7006e21d-e4be-40ee-ad4e-caed4d558b4b tempest-ShareSnapshotMetadataNegativeTest-1690283503 tempest-ShareSnapshotMetadataNegativeTest-1690283503-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7006e21d-e4be-40ee-ad4e-caed4d558b4b tempest-ShareSnapshotMetadataNegativeTest-1690283503 tempest-ShareSnapshotMetadataNegativeTest-1690283503-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7006e21d-e4be-40ee-ad4e-caed4d558b4b tempest-ShareSnapshotMetadataNegativeTest-1690283503 tempest-ShareSnapshotMetadataNegativeTest-1690283503-project-admin] PATH_INFO: `/v3/users/3fc09c87f69946d2bf009e72ac589cd4` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7006e21d-e4be-40ee-ad4e-caed4d558b4b tempest-ShareSnapshotMetadataNegativeTest-1690283503 tempest-ShareSnapshotMetadataNegativeTest-1690283503-project-admin] RBAC: Authorizing `identity:delete_user(user_id=3fc09c87f69946d2bf009e72ac589cd4)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7006e21d-e4be-40ee-ad4e-caed4d558b4b tempest-ShareSnapshotMetadataNegativeTest-1690283503 tempest-ShareSnapshotMetadataNegativeTest-1690283503-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-7006e21d-e4be-40ee-ad4e-caed4d558b4b tempest-ShareSnapshotMetadataNegativeTest-1690283503 tempest-ShareSnapshotMetadataNegativeTest-1690283503-project-admin] Could not find user: 3fc09c87f69946d2bf009e72ac589cd4.: keystone.exception.UserNotFound: Could not find user: 3fc09c87f69946d2bf009e72ac589cd4. May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 3fc09c87f69946d2bf009e72ac589cd4. May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1650/3328] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:02:18 2024] DELETE /identity/v3/users/3fc09c87f69946d2bf009e72ac589cd4 => generated 110 bytes in 25 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0428a298-9eee-4198-b02d-e2d2f614c5e2 tempest-ShareSnapshotMetadataNegativeTest-1690283503 tempest-ShareSnapshotMetadataNegativeTest-1690283503-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0428a298-9eee-4198-b02d-e2d2f614c5e2 tempest-ShareSnapshotMetadataNegativeTest-1690283503 tempest-ShareSnapshotMetadataNegativeTest-1690283503-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9c627a-12eb-4497-8dfd-3d450846ab2f tempest-ShareSnapshotMetadataNegativeTest-1690283503 tempest-ShareSnapshotMetadataNegativeTest-1690283503-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '376994db8e664651b0e2019c32e48f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57334a24554a788ef7508e78b0d664', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9c627a-12eb-4497-8dfd-3d450846ab2f tempest-ShareSnapshotMetadataNegativeTest-1690283503 tempest-ShareSnapshotMetadataNegativeTest-1690283503-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9c627a-12eb-4497-8dfd-3d450846ab2f tempest-ShareSnapshotMetadataNegativeTest-1690283503 tempest-ShareSnapshotMetadataNegativeTest-1690283503-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9c627a-12eb-4497-8dfd-3d450846ab2f tempest-ShareSnapshotMetadataNegativeTest-1690283503 tempest-ShareSnapshotMetadataNegativeTest-1690283503-project-admin] PATH_INFO: `/v3/users/6533c69a593a4e35a8693da46fbd9f3b` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9c627a-12eb-4497-8dfd-3d450846ab2f tempest-ShareSnapshotMetadataNegativeTest-1690283503 tempest-ShareSnapshotMetadataNegativeTest-1690283503-project-admin] RBAC: Authorizing `identity:delete_user(user_id=6533c69a593a4e35a8693da46fbd9f3b)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9c627a-12eb-4497-8dfd-3d450846ab2f tempest-ShareSnapshotMetadataNegativeTest-1690283503 tempest-ShareSnapshotMetadataNegativeTest-1690283503-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-cf9c627a-12eb-4497-8dfd-3d450846ab2f tempest-ShareSnapshotMetadataNegativeTest-1690283503 tempest-ShareSnapshotMetadataNegativeTest-1690283503-project-admin] Could not find user: 6533c69a593a4e35a8693da46fbd9f3b.: keystone.exception.UserNotFound: Could not find user: 6533c69a593a4e35a8693da46fbd9f3b. May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 6533c69a593a4e35a8693da46fbd9f3b. May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1679/3329] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:02:18 2024] DELETE /identity/v3/users/6533c69a593a4e35a8693da46fbd9f3b => generated 110 bytes in 24 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7006e21d-e4be-40ee-ad4e-caed4d558b4b tempest-ShareSnapshotMetadataNegativeTest-1690283503 tempest-ShareSnapshotMetadataNegativeTest-1690283503-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7006e21d-e4be-40ee-ad4e-caed4d558b4b tempest-ShareSnapshotMetadataNegativeTest-1690283503 tempest-ShareSnapshotMetadataNegativeTest-1690283503-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00dde33-58f6-4f7f-a7f8-d334656df3f7 tempest-ShareSnapshotMetadataNegativeTest-1690283503 tempest-ShareSnapshotMetadataNegativeTest-1690283503-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '376994db8e664651b0e2019c32e48f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57334a24554a788ef7508e78b0d664', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00dde33-58f6-4f7f-a7f8-d334656df3f7 tempest-ShareSnapshotMetadataNegativeTest-1690283503 tempest-ShareSnapshotMetadataNegativeTest-1690283503-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00dde33-58f6-4f7f-a7f8-d334656df3f7 tempest-ShareSnapshotMetadataNegativeTest-1690283503 tempest-ShareSnapshotMetadataNegativeTest-1690283503-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00dde33-58f6-4f7f-a7f8-d334656df3f7 tempest-ShareSnapshotMetadataNegativeTest-1690283503 tempest-ShareSnapshotMetadataNegativeTest-1690283503-project-admin] PATH_INFO: `/v3/users/929590f760014a429cece4b4e674f84e` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00dde33-58f6-4f7f-a7f8-d334656df3f7 tempest-ShareSnapshotMetadataNegativeTest-1690283503 tempest-ShareSnapshotMetadataNegativeTest-1690283503-project-admin] RBAC: Authorizing `identity:delete_user(user_id=929590f760014a429cece4b4e674f84e)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00dde33-58f6-4f7f-a7f8-d334656df3f7 tempest-ShareSnapshotMetadataNegativeTest-1690283503 tempest-ShareSnapshotMetadataNegativeTest-1690283503-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-f00dde33-58f6-4f7f-a7f8-d334656df3f7 tempest-ShareSnapshotMetadataNegativeTest-1690283503 tempest-ShareSnapshotMetadataNegativeTest-1690283503-project-admin] Could not find user: 929590f760014a429cece4b4e674f84e.: keystone.exception.UserNotFound: Could not find user: 929590f760014a429cece4b4e674f84e. May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 929590f760014a429cece4b4e674f84e. May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1651/3330] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:02:18 2024] DELETE /identity/v3/users/929590f760014a429cece4b4e674f84e => generated 110 bytes in 24 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9c627a-12eb-4497-8dfd-3d450846ab2f tempest-ShareSnapshotMetadataNegativeTest-1690283503 tempest-ShareSnapshotMetadataNegativeTest-1690283503-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9c627a-12eb-4497-8dfd-3d450846ab2f tempest-ShareSnapshotMetadataNegativeTest-1690283503 tempest-ShareSnapshotMetadataNegativeTest-1690283503-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae6bcc1-5da6-4fc2-b48a-8343fcf90c99 tempest-ShareSnapshotMetadataNegativeTest-1690283503 tempest-ShareSnapshotMetadataNegativeTest-1690283503-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '376994db8e664651b0e2019c32e48f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57334a24554a788ef7508e78b0d664', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae6bcc1-5da6-4fc2-b48a-8343fcf90c99 tempest-ShareSnapshotMetadataNegativeTest-1690283503 tempest-ShareSnapshotMetadataNegativeTest-1690283503-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae6bcc1-5da6-4fc2-b48a-8343fcf90c99 tempest-ShareSnapshotMetadataNegativeTest-1690283503 tempest-ShareSnapshotMetadataNegativeTest-1690283503-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae6bcc1-5da6-4fc2-b48a-8343fcf90c99 tempest-ShareSnapshotMetadataNegativeTest-1690283503 tempest-ShareSnapshotMetadataNegativeTest-1690283503-project-admin] PATH_INFO: `/v3/users/7ad2c2df894f4bca82e33623064ce809` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae6bcc1-5da6-4fc2-b48a-8343fcf90c99 tempest-ShareSnapshotMetadataNegativeTest-1690283503 tempest-ShareSnapshotMetadataNegativeTest-1690283503-project-admin] RBAC: Authorizing `identity:delete_user(user_id=7ad2c2df894f4bca82e33623064ce809)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae6bcc1-5da6-4fc2-b48a-8343fcf90c99 tempest-ShareSnapshotMetadataNegativeTest-1690283503 tempest-ShareSnapshotMetadataNegativeTest-1690283503-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-4ae6bcc1-5da6-4fc2-b48a-8343fcf90c99 tempest-ShareSnapshotMetadataNegativeTest-1690283503 tempest-ShareSnapshotMetadataNegativeTest-1690283503-project-admin] Could not find user: 7ad2c2df894f4bca82e33623064ce809.: keystone.exception.UserNotFound: Could not find user: 7ad2c2df894f4bca82e33623064ce809. May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 7ad2c2df894f4bca82e33623064ce809. May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1680/3331] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:02:18 2024] DELETE /identity/v3/users/7ad2c2df894f4bca82e33623064ce809 => generated 110 bytes in 25 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00dde33-58f6-4f7f-a7f8-d334656df3f7 tempest-ShareSnapshotMetadataNegativeTest-1690283503 tempest-ShareSnapshotMetadataNegativeTest-1690283503-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00dde33-58f6-4f7f-a7f8-d334656df3f7 tempest-ShareSnapshotMetadataNegativeTest-1690283503 tempest-ShareSnapshotMetadataNegativeTest-1690283503-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c960da7-9036-4921-88ef-47a6906d00d7 tempest-ShareSnapshotMetadataNegativeTest-1690283503 tempest-ShareSnapshotMetadataNegativeTest-1690283503-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '376994db8e664651b0e2019c32e48f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57334a24554a788ef7508e78b0d664', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c960da7-9036-4921-88ef-47a6906d00d7 tempest-ShareSnapshotMetadataNegativeTest-1690283503 tempest-ShareSnapshotMetadataNegativeTest-1690283503-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c960da7-9036-4921-88ef-47a6906d00d7 tempest-ShareSnapshotMetadataNegativeTest-1690283503 tempest-ShareSnapshotMetadataNegativeTest-1690283503-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c960da7-9036-4921-88ef-47a6906d00d7 tempest-ShareSnapshotMetadataNegativeTest-1690283503 tempest-ShareSnapshotMetadataNegativeTest-1690283503-project-admin] PATH_INFO: `/v3/users/43487099e439456094fb5cfc0ae825c5` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c960da7-9036-4921-88ef-47a6906d00d7 tempest-ShareSnapshotMetadataNegativeTest-1690283503 tempest-ShareSnapshotMetadataNegativeTest-1690283503-project-admin] RBAC: Authorizing `identity:delete_user(user_id=43487099e439456094fb5cfc0ae825c5)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c960da7-9036-4921-88ef-47a6906d00d7 tempest-ShareSnapshotMetadataNegativeTest-1690283503 tempest-ShareSnapshotMetadataNegativeTest-1690283503-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-6c960da7-9036-4921-88ef-47a6906d00d7 tempest-ShareSnapshotMetadataNegativeTest-1690283503 tempest-ShareSnapshotMetadataNegativeTest-1690283503-project-admin] Could not find user: 43487099e439456094fb5cfc0ae825c5.: keystone.exception.UserNotFound: Could not find user: 43487099e439456094fb5cfc0ae825c5. May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 43487099e439456094fb5cfc0ae825c5. May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1652/3332] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:02:18 2024] DELETE /identity/v3/users/43487099e439456094fb5cfc0ae825c5 => generated 110 bytes in 24 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae6bcc1-5da6-4fc2-b48a-8343fcf90c99 tempest-ShareSnapshotMetadataNegativeTest-1690283503 tempest-ShareSnapshotMetadataNegativeTest-1690283503-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae6bcc1-5da6-4fc2-b48a-8343fcf90c99 tempest-ShareSnapshotMetadataNegativeTest-1690283503 tempest-ShareSnapshotMetadataNegativeTest-1690283503-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9e3313-a211-4c15-bd4f-e9ad900a7257 tempest-ShareSnapshotMetadataNegativeTest-1690283503 tempest-ShareSnapshotMetadataNegativeTest-1690283503-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '376994db8e664651b0e2019c32e48f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57334a24554a788ef7508e78b0d664', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9e3313-a211-4c15-bd4f-e9ad900a7257 tempest-ShareSnapshotMetadataNegativeTest-1690283503 tempest-ShareSnapshotMetadataNegativeTest-1690283503-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9e3313-a211-4c15-bd4f-e9ad900a7257 tempest-ShareSnapshotMetadataNegativeTest-1690283503 tempest-ShareSnapshotMetadataNegativeTest-1690283503-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9e3313-a211-4c15-bd4f-e9ad900a7257 tempest-ShareSnapshotMetadataNegativeTest-1690283503 tempest-ShareSnapshotMetadataNegativeTest-1690283503-project-admin] PATH_INFO: `/v3/users/450d0e4972ca4250966ec637211a08fd` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9e3313-a211-4c15-bd4f-e9ad900a7257 tempest-ShareSnapshotMetadataNegativeTest-1690283503 tempest-ShareSnapshotMetadataNegativeTest-1690283503-project-admin] RBAC: Authorizing `identity:delete_user(user_id=450d0e4972ca4250966ec637211a08fd)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9e3313-a211-4c15-bd4f-e9ad900a7257 tempest-ShareSnapshotMetadataNegativeTest-1690283503 tempest-ShareSnapshotMetadataNegativeTest-1690283503-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-fb9e3313-a211-4c15-bd4f-e9ad900a7257 tempest-ShareSnapshotMetadataNegativeTest-1690283503 tempest-ShareSnapshotMetadataNegativeTest-1690283503-project-admin] Could not find user: 450d0e4972ca4250966ec637211a08fd.: keystone.exception.UserNotFound: Could not find user: 450d0e4972ca4250966ec637211a08fd. May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 450d0e4972ca4250966ec637211a08fd. May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1681/3333] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:02:18 2024] DELETE /identity/v3/users/450d0e4972ca4250966ec637211a08fd => generated 110 bytes in 23 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c960da7-9036-4921-88ef-47a6906d00d7 tempest-ShareSnapshotMetadataNegativeTest-1690283503 tempest-ShareSnapshotMetadataNegativeTest-1690283503-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c960da7-9036-4921-88ef-47a6906d00d7 tempest-ShareSnapshotMetadataNegativeTest-1690283503 tempest-ShareSnapshotMetadataNegativeTest-1690283503-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51aa1b6-a615-4a48-98fd-8f0ffb95b3cd tempest-ShareSnapshotMetadataNegativeTest-1690283503 tempest-ShareSnapshotMetadataNegativeTest-1690283503-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '376994db8e664651b0e2019c32e48f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57334a24554a788ef7508e78b0d664', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51aa1b6-a615-4a48-98fd-8f0ffb95b3cd tempest-ShareSnapshotMetadataNegativeTest-1690283503 tempest-ShareSnapshotMetadataNegativeTest-1690283503-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51aa1b6-a615-4a48-98fd-8f0ffb95b3cd tempest-ShareSnapshotMetadataNegativeTest-1690283503 tempest-ShareSnapshotMetadataNegativeTest-1690283503-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51aa1b6-a615-4a48-98fd-8f0ffb95b3cd tempest-ShareSnapshotMetadataNegativeTest-1690283503 tempest-ShareSnapshotMetadataNegativeTest-1690283503-project-admin] PATH_INFO: `/v3/users/d76fc4c11efc4cff97005a3ab0385c58` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51aa1b6-a615-4a48-98fd-8f0ffb95b3cd tempest-ShareSnapshotMetadataNegativeTest-1690283503 tempest-ShareSnapshotMetadataNegativeTest-1690283503-project-admin] RBAC: Authorizing `identity:delete_user(user_id=d76fc4c11efc4cff97005a3ab0385c58)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51aa1b6-a615-4a48-98fd-8f0ffb95b3cd tempest-ShareSnapshotMetadataNegativeTest-1690283503 tempest-ShareSnapshotMetadataNegativeTest-1690283503-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-b51aa1b6-a615-4a48-98fd-8f0ffb95b3cd tempest-ShareSnapshotMetadataNegativeTest-1690283503 tempest-ShareSnapshotMetadataNegativeTest-1690283503-project-admin] Could not find user: d76fc4c11efc4cff97005a3ab0385c58.: keystone.exception.UserNotFound: Could not find user: d76fc4c11efc4cff97005a3ab0385c58. May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: d76fc4c11efc4cff97005a3ab0385c58. May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1653/3334] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:02:18 2024] DELETE /identity/v3/users/d76fc4c11efc4cff97005a3ab0385c58 => generated 110 bytes in 24 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9e3313-a211-4c15-bd4f-e9ad900a7257 tempest-ShareSnapshotMetadataNegativeTest-1690283503 tempest-ShareSnapshotMetadataNegativeTest-1690283503-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9e3313-a211-4c15-bd4f-e9ad900a7257 tempest-ShareSnapshotMetadataNegativeTest-1690283503 tempest-ShareSnapshotMetadataNegativeTest-1690283503-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a6a927-d9cc-4e01-8b73-ef40f58e39ec tempest-ShareSnapshotMetadataNegativeTest-1690283503 tempest-ShareSnapshotMetadataNegativeTest-1690283503-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '376994db8e664651b0e2019c32e48f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57334a24554a788ef7508e78b0d664', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a6a927-d9cc-4e01-8b73-ef40f58e39ec tempest-ShareSnapshotMetadataNegativeTest-1690283503 tempest-ShareSnapshotMetadataNegativeTest-1690283503-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a6a927-d9cc-4e01-8b73-ef40f58e39ec tempest-ShareSnapshotMetadataNegativeTest-1690283503 tempest-ShareSnapshotMetadataNegativeTest-1690283503-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a6a927-d9cc-4e01-8b73-ef40f58e39ec tempest-ShareSnapshotMetadataNegativeTest-1690283503 tempest-ShareSnapshotMetadataNegativeTest-1690283503-project-admin] PATH_INFO: `/v3/users/2180c425dfa340e79633dd5319b4cd4c` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a6a927-d9cc-4e01-8b73-ef40f58e39ec tempest-ShareSnapshotMetadataNegativeTest-1690283503 tempest-ShareSnapshotMetadataNegativeTest-1690283503-project-admin] RBAC: Authorizing `identity:delete_user(user_id=2180c425dfa340e79633dd5319b4cd4c)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a6a927-d9cc-4e01-8b73-ef40f58e39ec tempest-ShareSnapshotMetadataNegativeTest-1690283503 tempest-ShareSnapshotMetadataNegativeTest-1690283503-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-41a6a927-d9cc-4e01-8b73-ef40f58e39ec tempest-ShareSnapshotMetadataNegativeTest-1690283503 tempest-ShareSnapshotMetadataNegativeTest-1690283503-project-admin] Could not find user: 2180c425dfa340e79633dd5319b4cd4c.: keystone.exception.UserNotFound: Could not find user: 2180c425dfa340e79633dd5319b4cd4c. May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 2180c425dfa340e79633dd5319b4cd4c. May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1682/3335] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:02:18 2024] DELETE /identity/v3/users/2180c425dfa340e79633dd5319b4cd4c => generated 110 bytes in 22 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51aa1b6-a615-4a48-98fd-8f0ffb95b3cd tempest-ShareSnapshotMetadataNegativeTest-1690283503 tempest-ShareSnapshotMetadataNegativeTest-1690283503-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51aa1b6-a615-4a48-98fd-8f0ffb95b3cd tempest-ShareSnapshotMetadataNegativeTest-1690283503 tempest-ShareSnapshotMetadataNegativeTest-1690283503-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067f1ef2-bd49-4fb5-90c3-419193d16620 tempest-ShareSnapshotMetadataNegativeTest-1690283503 tempest-ShareSnapshotMetadataNegativeTest-1690283503-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '376994db8e664651b0e2019c32e48f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57334a24554a788ef7508e78b0d664', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067f1ef2-bd49-4fb5-90c3-419193d16620 tempest-ShareSnapshotMetadataNegativeTest-1690283503 tempest-ShareSnapshotMetadataNegativeTest-1690283503-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067f1ef2-bd49-4fb5-90c3-419193d16620 tempest-ShareSnapshotMetadataNegativeTest-1690283503 tempest-ShareSnapshotMetadataNegativeTest-1690283503-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067f1ef2-bd49-4fb5-90c3-419193d16620 tempest-ShareSnapshotMetadataNegativeTest-1690283503 tempest-ShareSnapshotMetadataNegativeTest-1690283503-project-admin] PATH_INFO: `/v3/users/df40dca89a8343239f2a0f80b681621f` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067f1ef2-bd49-4fb5-90c3-419193d16620 tempest-ShareSnapshotMetadataNegativeTest-1690283503 tempest-ShareSnapshotMetadataNegativeTest-1690283503-project-admin] RBAC: Authorizing `identity:delete_user(user_id=df40dca89a8343239f2a0f80b681621f)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067f1ef2-bd49-4fb5-90c3-419193d16620 tempest-ShareSnapshotMetadataNegativeTest-1690283503 tempest-ShareSnapshotMetadataNegativeTest-1690283503-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:18 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-9b69cc6d-35ba-4878-bc17-c3248e484b92 tempest-SharesRenameTest-1796622866 tempest-SharesRenameTest-1796622866-project-member] GET http://10.27.203.238/share/v2/6035b1be773e417b80fb3d9ea83eac8d/shares/e02829cb-d0c9-478e-80fa-e4ec0bf3843c May 28 13:02:18 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-9b69cc6d-35ba-4878-bc17-c3248e484b92 tempest-SharesRenameTest-1796622866 tempest-SharesRenameTest-1796622866-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:02:18 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-9b69cc6d-35ba-4878-bc17-c3248e484b92 tempest-SharesRenameTest-1796622866 tempest-SharesRenameTest-1796622866-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-067f1ef2-bd49-4fb5-90c3-419193d16620 tempest-ShareSnapshotMetadataNegativeTest-1690283503 tempest-ShareSnapshotMetadataNegativeTest-1690283503-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df40dca89a8343239f2a0f80b681621f', 'request_id': 'req-067f1ef2-bd49-4fb5-90c3-419193d16620'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-067f1ef2-bd49-4fb5-90c3-419193d16620 tempest-ShareSnapshotMetadataNegativeTest-1690283503 tempest-ShareSnapshotMetadataNegativeTest-1690283503-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df40dca89a8343239f2a0f80b681621f', 'request_id': 'req-067f1ef2-bd49-4fb5-90c3-419193d16620'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:18 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-9b69cc6d-35ba-4878-bc17-c3248e484b92 tempest-SharesRenameTest-1796622866 tempest-SharesRenameTest-1796622866-project-member] HTTP exception thrown: The resource could not be found. May 28 13:02:18 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-9b69cc6d-35ba-4878-bc17-c3248e484b92 tempest-SharesRenameTest-1796622866 tempest-SharesRenameTest-1796622866-project-member] http://10.27.203.238/share/v2/6035b1be773e417b80fb3d9ea83eac8d/shares/e02829cb-d0c9-478e-80fa-e4ec0bf3843c returned with HTTP 404 May 28 13:02:18 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1233/2442] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:02:18 2024] GET /share/v2/6035b1be773e417b80fb3d9ea83eac8d/shares/e02829cb-d0c9-478e-80fa-e4ec0bf3843c => generated 78 bytes in 12 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 13:02:18 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-ae1a3e4c-594b-42f7-929a-936a52cde1e1 tempest-SharesRenameTest-200895555 tempest-SharesRenameTest-200895555-project-admin] DELETE http://10.27.203.238/share/v2/bff0d77ff4df42cb942ff6e8fe5d9115/types/edb9ffb1-50f8-46f1-9bf4-c99b86d46e3e May 28 13:02:18 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-ae1a3e4c-594b-42f7-929a-936a52cde1e1 tempest-SharesRenameTest-200895555 tempest-SharesRenameTest-200895555-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:02:18 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-ae1a3e4c-594b-42f7-929a-936a52cde1e1 tempest-SharesRenameTest-200895555 tempest-SharesRenameTest-200895555-project-admin] Calling method 'ShareTypesController._delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-067f1ef2-bd49-4fb5-90c3-419193d16620 tempest-ShareSnapshotMetadataNegativeTest-1690283503 tempest-ShareSnapshotMetadataNegativeTest-1690283503-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df40dca89a8343239f2a0f80b681621f', 'request_id': 'req-067f1ef2-bd49-4fb5-90c3-419193d16620'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-067f1ef2-bd49-4fb5-90c3-419193d16620 tempest-ShareSnapshotMetadataNegativeTest-1690283503 tempest-ShareSnapshotMetadataNegativeTest-1690283503-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df40dca89a8343239f2a0f80b681621f', 'request_id': 'req-067f1ef2-bd49-4fb5-90c3-419193d16620'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-067f1ef2-bd49-4fb5-90c3-419193d16620 tempest-ShareSnapshotMetadataNegativeTest-1690283503 tempest-ShareSnapshotMetadataNegativeTest-1690283503-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df40dca89a8343239f2a0f80b681621f', 'request_id': 'req-067f1ef2-bd49-4fb5-90c3-419193d16620'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1654/3336] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:02:18 2024] DELETE /identity/v3/users/df40dca89a8343239f2a0f80b681621f => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:02:18 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-234d6aa8-c62f-48b2-bf1a-f97d22230994 tempest-ShareSnapshotMetadataNegativeTest-1199544441 tempest-ShareSnapshotMetadataNegativeTest-1199544441-project-member] DELETE http://10.27.203.238/share/v2/b00df7df3db14cce99343fc7f6ffd796/snapshots/36312f3e-0719-4e74-b65e-57fb01533bab May 28 13:02:18 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-234d6aa8-c62f-48b2-bf1a-f97d22230994 tempest-ShareSnapshotMetadataNegativeTest-1199544441 tempest-ShareSnapshotMetadataNegativeTest-1199544441-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:02:18 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-234d6aa8-c62f-48b2-bf1a-f97d22230994 tempest-ShareSnapshotMetadataNegativeTest-1199544441 tempest-ShareSnapshotMetadataNegativeTest-1199544441-project-member] Calling method 'ShareSnapshotMixin.delete' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:02:18 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.v1.share_snapshots [None req-234d6aa8-c62f-48b2-bf1a-f97d22230994 tempest-ShareSnapshotMetadataNegativeTest-1199544441 tempest-ShareSnapshotMetadataNegativeTest-1199544441-project-member] Delete snapshot with id: 36312f3e-0719-4e74-b65e-57fb01533bab May 28 13:02:18 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-ae1a3e4c-594b-42f7-929a-936a52cde1e1 tempest-SharesRenameTest-200895555 tempest-SharesRenameTest-200895555-project-admin] http://10.27.203.238/share/v2/bff0d77ff4df42cb942ff6e8fe5d9115/types/edb9ffb1-50f8-46f1-9bf4-c99b86d46e3e returned with HTTP 202 May 28 13:02:18 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1210/2443] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:02:18 2024] DELETE /share/v2/bff0d77ff4df42cb942ff6e8fe5d9115/types/edb9ffb1-50f8-46f1-9bf4-c99b86d46e3e => generated 0 bytes in 53 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 13:02:18 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-09a76abd-e061-4349-a462-60537aa13e46 tempest-SharesRenameTest-200895555 tempest-SharesRenameTest-200895555-project-admin] GET http://10.27.203.238/share/v2/bff0d77ff4df42cb942ff6e8fe5d9115/types/edb9ffb1-50f8-46f1-9bf4-c99b86d46e3e May 28 13:02:18 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-09a76abd-e061-4349-a462-60537aa13e46 tempest-SharesRenameTest-200895555 tempest-SharesRenameTest-200895555-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:02:18 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-09a76abd-e061-4349-a462-60537aa13e46 tempest-SharesRenameTest-200895555 tempest-SharesRenameTest-200895555-project-admin] Calling method 'ShareTypesController.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:02:18 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-09a76abd-e061-4349-a462-60537aa13e46 tempest-SharesRenameTest-200895555 tempest-SharesRenameTest-200895555-project-admin] HTTP exception thrown: Share type not found. May 28 13:02:18 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-09a76abd-e061-4349-a462-60537aa13e46 tempest-SharesRenameTest-200895555 tempest-SharesRenameTest-200895555-project-admin] http://10.27.203.238/share/v2/bff0d77ff4df42cb942ff6e8fe5d9115/types/edb9ffb1-50f8-46f1-9bf4-c99b86d46e3e returned with HTTP 404 May 28 13:02:18 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1211/2444] 10.27.203.238 () {64 vars in 1448 bytes} [Tue May 28 13:02:18 2024] GET /share/v2/bff0d77ff4df42cb942ff6e8fe5d9115/types/edb9ffb1-50f8-46f1-9bf4-c99b86d46e3e => generated 67 bytes in 10 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a6a927-d9cc-4e01-8b73-ef40f58e39ec tempest-ShareSnapshotMetadataNegativeTest-1690283503 tempest-ShareSnapshotMetadataNegativeTest-1690283503-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-41a6a927-d9cc-4e01-8b73-ef40f58e39ec tempest-ShareSnapshotMetadataNegativeTest-1690283503 tempest-ShareSnapshotMetadataNegativeTest-1690283503-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a6a927-d9cc-4e01-8b73-ef40f58e39ec tempest-ShareSnapshotMetadataNegativeTest-1690283503 tempest-ShareSnapshotMetadataNegativeTest-1690283503-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:18 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-234d6aa8-c62f-48b2-bf1a-f97d22230994 tempest-ShareSnapshotMetadataNegativeTest-1199544441 tempest-ShareSnapshotMetadataNegativeTest-1199544441-project-member] http://10.27.203.238/share/v2/b00df7df3db14cce99343fc7f6ffd796/snapshots/36312f3e-0719-4e74-b65e-57fb01533bab returned with HTTP 202 May 28 13:02:18 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1234/2445] 10.27.203.238 () {64 vars in 1463 bytes} [Tue May 28 13:02:18 2024] DELETE /share/v2/b00df7df3db14cce99343fc7f6ffd796/snapshots/36312f3e-0719-4e74-b65e-57fb01533bab => generated 0 bytes in 89 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 13:02:18 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-fedd8556-24ce-4740-b773-599d005364c6 tempest-ShareSnapshotMetadataNegativeTest-1199544441 tempest-ShareSnapshotMetadataNegativeTest-1199544441-project-member] GET http://10.27.203.238/share/v2/b00df7df3db14cce99343fc7f6ffd796/snapshots/36312f3e-0719-4e74-b65e-57fb01533bab May 28 13:02:18 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-fedd8556-24ce-4740-b773-599d005364c6 tempest-ShareSnapshotMetadataNegativeTest-1199544441 tempest-ShareSnapshotMetadataNegativeTest-1199544441-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:02:18 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-fedd8556-24ce-4740-b773-599d005364c6 tempest-ShareSnapshotMetadataNegativeTest-1199544441 tempest-ShareSnapshotMetadataNegativeTest-1199544441-project-member] Calling method 'ShareSnapshotMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1430e5b-77f3-46c4-9999-617f5c6a854c None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1430e5b-77f3-46c4-9999-617f5c6a854c None admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1430e5b-77f3-46c4-9999-617f5c6a854c None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1430e5b-77f3-46c4-9999-617f5c6a854c None admin] PATH_INFO: `/v3/users/c4a7d9cd21ad4b60b960c58a5e4c5ea1` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1430e5b-77f3-46c4-9999-617f5c6a854c None admin] RBAC: Authorizing `identity:delete_user(user_id=c4a7d9cd21ad4b60b960c58a5e4c5ea1)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1430e5b-77f3-46c4-9999-617f5c6a854c None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:18 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-fedd8556-24ce-4740-b773-599d005364c6 tempest-ShareSnapshotMetadataNegativeTest-1199544441 tempest-ShareSnapshotMetadataNegativeTest-1199544441-project-member] http://10.27.203.238/share/v2/b00df7df3db14cce99343fc7f6ffd796/snapshots/36312f3e-0719-4e74-b65e-57fb01533bab returned with HTTP 200 May 28 13:02:18 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1212/2446] 10.27.203.238 () {64 vars in 1460 bytes} [Tue May 28 13:02:18 2024] GET /share/v2/b00df7df3db14cce99343fc7f6ffd796/snapshots/36312f3e-0719-4e74-b65e-57fb01533bab => generated 746 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-f1430e5b-77f3-46c4-9999-617f5c6a854c None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4a7d9cd21ad4b60b960c58a5e4c5ea1', 'request_id': 'req-f1430e5b-77f3-46c4-9999-617f5c6a854c'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-f1430e5b-77f3-46c4-9999-617f5c6a854c None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4a7d9cd21ad4b60b960c58a5e4c5ea1', 'request_id': 'req-f1430e5b-77f3-46c4-9999-617f5c6a854c'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-f1430e5b-77f3-46c4-9999-617f5c6a854c None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4a7d9cd21ad4b60b960c58a5e4c5ea1', 'request_id': 'req-f1430e5b-77f3-46c4-9999-617f5c6a854c'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-f1430e5b-77f3-46c4-9999-617f5c6a854c None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4a7d9cd21ad4b60b960c58a5e4c5ea1', 'request_id': 'req-f1430e5b-77f3-46c4-9999-617f5c6a854c'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-f1430e5b-77f3-46c4-9999-617f5c6a854c None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4a7d9cd21ad4b60b960c58a5e4c5ea1', 'request_id': 'req-f1430e5b-77f3-46c4-9999-617f5c6a854c'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:18 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-234d6aa8-c62f-48b2-bf1a-f97d22230994 tempest-ShareSnapshotMetadataNegativeTest-1199544441 None] >>> [GET] https://127.0.0.1:40443/api/snapshots/ May 28 13:02:18 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-234d6aa8-c62f-48b2-bf1a-f97d22230994 tempest-ShareSnapshotMetadataNegativeTest-1199544441 None] {'allow_redirects': True, May 28 13:02:18 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-234d6aa8-c62f-48b2-bf1a-f97d22230994 tempest-ShareSnapshotMetadataNegativeTest-1199544441 None] 'params': {'name': 'share-snapshot-b6960986-632d-4860-aa43-93a418c568db'}} May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1683/3337] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 13:02:18 2024] DELETE /identity/v3/users/c4a7d9cd21ad4b60b960c58a5e4c5ea1 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067f1ef2-bd49-4fb5-90c3-419193d16620 tempest-ShareSnapshotMetadataNegativeTest-1690283503 tempest-ShareSnapshotMetadataNegativeTest-1690283503-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:18 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067f1ef2-bd49-4fb5-90c3-419193d16620 tempest-ShareSnapshotMetadataNegativeTest-1690283503 tempest-ShareSnapshotMetadataNegativeTest-1690283503-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256a4642-b80b-44bf-ad1f-1291e63f3ef3 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256a4642-b80b-44bf-ad1f-1291e63f3ef3 None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256a4642-b80b-44bf-ad1f-1291e63f3ef3 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256a4642-b80b-44bf-ad1f-1291e63f3ef3 None admin] PATH_INFO: `/v3/users/fc2e4f2c8de242e09b81f6c349f818df` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256a4642-b80b-44bf-ad1f-1291e63f3ef3 None admin] RBAC: Authorizing `identity:delete_user(user_id=fc2e4f2c8de242e09b81f6c349f818df)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256a4642-b80b-44bf-ad1f-1291e63f3ef3 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:19 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f780631c-f49d-4fa0-9946-63f2d95845b9 tempest-ShareRulesTest-1530341375 None] <<< [PATCH] https://127.0.0.1:40443/api/viewpolicies/38/ May 28 13:02:19 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f780631c-f49d-4fa0-9946-63f2d95845b9 tempest-ShareRulesTest-1530341375 None] Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=1, created='2024-05-28T12:59:53.824250Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='0fa84ccd-850f-48fa-a965-23e5abe31188', id=38, internal=False, is_s3_default_policy=False, name='f7e47502-a0f7-44de-953d-b7b5697ae0b2', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=['*'], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=[], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=[], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='MODIFYING', sync_time='2024-05-28T13:02:18.517335Z', tenant_id=1, tenant_name='default', title='f7e47502-a0f7-44de-953d-b7b5697ae0b2', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/38/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[]) May 28 13:02:19 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f780631c-f49d-4fa0-9946-63f2d95845b9 tempest-ShareRulesTest-1530341375 None] --- [PATCH] https://127.0.0.1:40443/api/viewpolicies/38/: Done May 28 13:02:19 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-f780631c-f49d-4fa0-9946-63f2d95845b9 tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:02:19 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-f780631c-f49d-4fa0-9946-63f2d95845b9 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-256a4642-b80b-44bf-ad1f-1291e63f3ef3 None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc2e4f2c8de242e09b81f6c349f818df', 'request_id': 'req-256a4642-b80b-44bf-ad1f-1291e63f3ef3'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-256a4642-b80b-44bf-ad1f-1291e63f3ef3 None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc2e4f2c8de242e09b81f6c349f818df', 'request_id': 'req-256a4642-b80b-44bf-ad1f-1291e63f3ef3'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-256a4642-b80b-44bf-ad1f-1291e63f3ef3 None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc2e4f2c8de242e09b81f6c349f818df', 'request_id': 'req-256a4642-b80b-44bf-ad1f-1291e63f3ef3'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-256a4642-b80b-44bf-ad1f-1291e63f3ef3 None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc2e4f2c8de242e09b81f6c349f818df', 'request_id': 'req-256a4642-b80b-44bf-ad1f-1291e63f3ef3'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-256a4642-b80b-44bf-ad1f-1291e63f3ef3 None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc2e4f2c8de242e09b81f6c349f818df', 'request_id': 'req-256a4642-b80b-44bf-ad1f-1291e63f3ef3'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:19 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-f780631c-f49d-4fa0-9946-63f2d95845b9 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.030s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:02:19 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-f780631c-f49d-4fa0-9946-63f2d95845b9 tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:02:19 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-f780631c-f49d-4fa0-9946-63f2d95845b9 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1655/3338] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 13:02:18 2024] DELETE /identity/v3/users/fc2e4f2c8de242e09b81f6c349f818df => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1430e5b-77f3-46c4-9999-617f5c6a854c None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-f1430e5b-77f3-46c4-9999-617f5c6a854c None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1430e5b-77f3-46c4-9999-617f5c6a854c None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:19 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-f780631c-f49d-4fa0-9946-63f2d95845b9 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.035s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:02:19 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-f780631c-f49d-4fa0-9946-63f2d95845b9 tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:02:19 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-f780631c-f49d-4fa0-9946-63f2d95845b9 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:02:19 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-f780631c-f49d-4fa0-9946-63f2d95845b9 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:02:19 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-f780631c-f49d-4fa0-9946-63f2d95845b9 tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:02:19 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-f780631c-f49d-4fa0-9946-63f2d95845b9 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1d329d-8113-4c25-b421-d7a86d90cde8 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1d329d-8113-4c25-b421-d7a86d90cde8 None admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1d329d-8113-4c25-b421-d7a86d90cde8 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:19 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-f780631c-f49d-4fa0-9946-63f2d95845b9 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1d329d-8113-4c25-b421-d7a86d90cde8 None admin] PATH_INFO: `/v3/users/f72a7fdfdc5841c5a56e1602f6e4c8b4` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:19 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-f780631c-f49d-4fa0-9946-63f2d95845b9 tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:02:19 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-f780631c-f49d-4fa0-9946-63f2d95845b9 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1d329d-8113-4c25-b421-d7a86d90cde8 None admin] RBAC: Authorizing `identity:delete_user(user_id=f72a7fdfdc5841c5a56e1602f6e4c8b4)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1d329d-8113-4c25-b421-d7a86d90cde8 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:19 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-f780631c-f49d-4fa0-9946-63f2d95845b9 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.040s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:02:19 l75lg1-v1 manila-share[98474]: INFO manila.share.access [None req-f780631c-f49d-4fa0-9946-63f2d95845b9 tempest-ShareRulesTest-1530341375 None] Access rules were successfully modified for share instance f7e47502-a0f7-44de-953d-b7b5697ae0b2 belonging to share b330db31-7766-443d-9c19-26fe349665aa. May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-8d1d329d-8113-4c25-b421-d7a86d90cde8 None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f72a7fdfdc5841c5a56e1602f6e4c8b4', 'request_id': 'req-8d1d329d-8113-4c25-b421-d7a86d90cde8'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-8d1d329d-8113-4c25-b421-d7a86d90cde8 None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f72a7fdfdc5841c5a56e1602f6e4c8b4', 'request_id': 'req-8d1d329d-8113-4c25-b421-d7a86d90cde8'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-8d1d329d-8113-4c25-b421-d7a86d90cde8 None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f72a7fdfdc5841c5a56e1602f6e4c8b4', 'request_id': 'req-8d1d329d-8113-4c25-b421-d7a86d90cde8'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-8d1d329d-8113-4c25-b421-d7a86d90cde8 None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f72a7fdfdc5841c5a56e1602f6e4c8b4', 'request_id': 'req-8d1d329d-8113-4c25-b421-d7a86d90cde8'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-8d1d329d-8113-4c25-b421-d7a86d90cde8 None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f72a7fdfdc5841c5a56e1602f6e4c8b4', 'request_id': 'req-8d1d329d-8113-4c25-b421-d7a86d90cde8'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1684/3339] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 13:02:19 2024] DELETE /identity/v3/users/f72a7fdfdc5841c5a56e1602f6e4c8b4 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2b7b2e-78ed-4cf5-a92a-a646a0a4187a None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2b7b2e-78ed-4cf5-a92a-a646a0a4187a None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2b7b2e-78ed-4cf5-a92a-a646a0a4187a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-cc2b7b2e-78ed-4cf5-a92a-a646a0a4187a None None] Truncating password to algorithm specific maximum length 72 characters. May 28 13:02:19 l75lg1-v1 dstat.sh[49771]: 28-05 13:02:19| 13 1 83 2 0|5642M 1784M 278M 7920M| 20k 13k| 0 1684k| 0 263 |8128 14k|1.14 1.16 1.06|3.0 0 0| 0 0 | 0 2048M| 29 364 0 34 2 May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-cc2b7b2e-78ed-4cf5-a92a-a646a0a4187a None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-cc2b7b2e-78ed-4cf5-a92a-a646a0a4187a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1656/3340] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 13:02:19 2024] POST /identity/v3/auth/tokens => generated 2960 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 13:02:19 l75lg1-v1 neutron-server[77619]: DEBUG neutron.wsgi [-] (77619) accepted ('10.27.203.238', 42466) {{(pid=77619) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1d329d-8113-4c25-b421-d7a86d90cde8 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-8d1d329d-8113-4c25-b421-d7a86d90cde8 None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:02:19 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-234d6aa8-c62f-48b2-bf1a-f97d22230994 tempest-ShareSnapshotMetadataNegativeTest-1199544441 None] <<< [GET] https://127.0.0.1:40443/api/snapshots/ May 28 13:02:19 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-234d6aa8-c62f-48b2-bf1a-f97d22230994 tempest-ShareSnapshotMetadataNegativeTest-1199544441 None] [Bunch(access_path='/.vast_all_snapshots/1000000015_share-snapshot-b6960986-632d-4860-aa43-93a418c568db', aggr_phys_estimation=0, cluster='loop75-kfs', created='2024-05-28T13:02:15.674084Z', eta_sec=30819898658.71233, expiration_time='3001-01-19T07:59:58Z', guid='075a349c-446e-4368-a6c1-0fa01a67a445', id=16, indestructible=False, locked=False, name='share-snapshot-b6960986-632d-4860-aa43-93a418c568db', path='/manila/manila-f49db035-ea92-4df4-9284-1e5ce7e3fd79/', policy=None, policy_id=None, protection_policy_id=None, state='SUCCEED', tenant_id=1, tenant_name='default', title='share-snapshot-b6960986-632d-4860-aa43-93a418c568db(/manila/manila-f49db035-ea92-4df4-9284-1e5ce7e3fd79/)', type='local', unique_phys_estimation=0, url='https://127.0.0.1:40443/api/snapshots/16/')] May 28 13:02:19 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-234d6aa8-c62f-48b2-bf1a-f97d22230994 tempest-ShareSnapshotMetadataNegativeTest-1199544441 None] --- [GET] https://127.0.0.1:40443/api/snapshots/: Done May 28 13:02:19 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-234d6aa8-c62f-48b2-bf1a-f97d22230994 tempest-ShareSnapshotMetadataNegativeTest-1199544441 None] >>> [DELETE] https://127.0.0.1:40443/api/snapshots/16/ May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1d329d-8113-4c25-b421-d7a86d90cde8 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e946fc-df42-4a0e-a5bd-e271fc6a582f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef17047035e4b518fd5360a01f2da1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e946fc-df42-4a0e-a5bd-e271fc6a582f service neutron] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e946fc-df42-4a0e-a5bd-e271fc6a582f service neutron] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e946fc-df42-4a0e-a5bd-e271fc6a582f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e946fc-df42-4a0e-a5bd-e271fc6a582f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e946fc-df42-4a0e-a5bd-e271fc6a582f service neutron] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1685/3341] 10.27.203.238 () {64 vars in 1432 bytes} [Tue May 28 13:02:19 2024] GET /identity/v3/auth/tokens => generated 2960 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 28 13:02:19 l75lg1-v1 neutron-server[77619]: INFO neutron.wsgi [None req-e2492c5c-95da-49ae-adec-a12f4ce37718 None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=bff0d77ff4df42cb942ff6e8fe5d9115&name=default HTTP/1.1" status: 200 len: 216 time: 0.0700853 May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2b7b2e-78ed-4cf5-a92a-a646a0a4187a None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-cc2b7b2e-78ed-4cf5-a92a-a646a0a4187a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2b7b2e-78ed-4cf5-a92a-a646a0a4187a None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95643dd-d78e-4231-90dc-977c0bd574d5 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95643dd-d78e-4231-90dc-977c0bd574d5 None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95643dd-d78e-4231-90dc-977c0bd574d5 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95643dd-d78e-4231-90dc-977c0bd574d5 None admin] PATH_INFO: `/v3/projects/bff0d77ff4df42cb942ff6e8fe5d9115` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95643dd-d78e-4231-90dc-977c0bd574d5 None admin] RBAC: Authorizing `identity:delete_project(project_id=bff0d77ff4df42cb942ff6e8fe5d9115)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95643dd-d78e-4231-90dc-977c0bd574d5 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-e95643dd-d78e-4231-90dc-977c0bd574d5 None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bff0d77ff4df42cb942ff6e8fe5d9115', 'request_id': 'req-e95643dd-d78e-4231-90dc-977c0bd574d5'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-e95643dd-d78e-4231-90dc-977c0bd574d5 None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bff0d77ff4df42cb942ff6e8fe5d9115', 'request_id': 'req-e95643dd-d78e-4231-90dc-977c0bd574d5'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-e95643dd-d78e-4231-90dc-977c0bd574d5 None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bff0d77ff4df42cb942ff6e8fe5d9115', 'request_id': 'req-e95643dd-d78e-4231-90dc-977c0bd574d5'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-e95643dd-d78e-4231-90dc-977c0bd574d5 None admin] The token cache is being invalidate because project bff0d77ff4df42cb942ff6e8fe5d9115 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-e95643dd-d78e-4231-90dc-977c0bd574d5 None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-e95643dd-d78e-4231-90dc-977c0bd574d5 None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1657/3342] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 13:02:19 2024] DELETE /identity/v3/projects/bff0d77ff4df42cb942ff6e8fe5d9115 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:02:19 l75lg1-v1 neutron-server[77618]: DEBUG neutron.wsgi [-] (77618) accepted ('10.27.203.238', 42468) {{(pid=77618) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 13:02:19 l75lg1-v1 neutron-server[77618]: INFO neutron.wsgi [None req-9c051d55-b032-4ea1-b452-5a82958a4225 None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=6035b1be773e417b80fb3d9ea83eac8d&name=default HTTP/1.1" status: 200 len: 216 time: 0.0083292 May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e946fc-df42-4a0e-a5bd-e271fc6a582f service neutron] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e946fc-df42-4a0e-a5bd-e271fc6a582f service neutron] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018e877d-7978-49a9-8609-d5de62d39a78 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018e877d-7978-49a9-8609-d5de62d39a78 None admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018e877d-7978-49a9-8609-d5de62d39a78 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018e877d-7978-49a9-8609-d5de62d39a78 None admin] PATH_INFO: `/v3/projects/6035b1be773e417b80fb3d9ea83eac8d` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018e877d-7978-49a9-8609-d5de62d39a78 None admin] RBAC: Authorizing `identity:delete_project(project_id=6035b1be773e417b80fb3d9ea83eac8d)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018e877d-7978-49a9-8609-d5de62d39a78 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-018e877d-7978-49a9-8609-d5de62d39a78 None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6035b1be773e417b80fb3d9ea83eac8d', 'request_id': 'req-018e877d-7978-49a9-8609-d5de62d39a78'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-018e877d-7978-49a9-8609-d5de62d39a78 None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6035b1be773e417b80fb3d9ea83eac8d', 'request_id': 'req-018e877d-7978-49a9-8609-d5de62d39a78'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-018e877d-7978-49a9-8609-d5de62d39a78 None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6035b1be773e417b80fb3d9ea83eac8d', 'request_id': 'req-018e877d-7978-49a9-8609-d5de62d39a78'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-018e877d-7978-49a9-8609-d5de62d39a78 None admin] The token cache is being invalidate because project 6035b1be773e417b80fb3d9ea83eac8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-018e877d-7978-49a9-8609-d5de62d39a78 None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-018e877d-7978-49a9-8609-d5de62d39a78 None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1686/3343] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 13:02:19 2024] DELETE /identity/v3/projects/6035b1be773e417b80fb3d9ea83eac8d => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:02:19 l75lg1-v1 neutron-server[77618]: DEBUG neutron.wsgi [-] (77618) accepted ('10.27.203.238', 42482) {{(pid=77618) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 13:02:19 l75lg1-v1 neutron-server[77618]: INFO neutron.wsgi [None req-ef907b31-3dc0-4f26-bf67-990e49bdf13e None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=5ffad3f9524c441b92bd477a4b904347&name=default HTTP/1.1" status: 200 len: 216 time: 0.0080564 May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95643dd-d78e-4231-90dc-977c0bd574d5 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-e95643dd-d78e-4231-90dc-977c0bd574d5 None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95643dd-d78e-4231-90dc-977c0bd574d5 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0201f891-9000-4412-b69f-233640512008 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0201f891-9000-4412-b69f-233640512008 None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0201f891-9000-4412-b69f-233640512008 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0201f891-9000-4412-b69f-233640512008 None admin] PATH_INFO: `/v3/projects/5ffad3f9524c441b92bd477a4b904347` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0201f891-9000-4412-b69f-233640512008 None admin] RBAC: Authorizing `identity:delete_project(project_id=5ffad3f9524c441b92bd477a4b904347)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0201f891-9000-4412-b69f-233640512008 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-0201f891-9000-4412-b69f-233640512008 None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ffad3f9524c441b92bd477a4b904347', 'request_id': 'req-0201f891-9000-4412-b69f-233640512008'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-0201f891-9000-4412-b69f-233640512008 None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ffad3f9524c441b92bd477a4b904347', 'request_id': 'req-0201f891-9000-4412-b69f-233640512008'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-0201f891-9000-4412-b69f-233640512008 None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ffad3f9524c441b92bd477a4b904347', 'request_id': 'req-0201f891-9000-4412-b69f-233640512008'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-0201f891-9000-4412-b69f-233640512008 None admin] The token cache is being invalidate because project 5ffad3f9524c441b92bd477a4b904347 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-0201f891-9000-4412-b69f-233640512008 None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-0201f891-9000-4412-b69f-233640512008 None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1658/3344] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 13:02:19 2024] DELETE /identity/v3/projects/5ffad3f9524c441b92bd477a4b904347 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79c86f0-42d3-4fee-b089-f0d263b1c2d7 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79c86f0-42d3-4fee-b089-f0d263b1c2d7 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79c86f0-42d3-4fee-b089-f0d263b1c2d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-b79c86f0-42d3-4fee-b089-f0d263b1c2d7 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-b79c86f0-42d3-4fee-b089-f0d263b1c2d7 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-b79c86f0-42d3-4fee-b089-f0d263b1c2d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1687/3345] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 13:02:19 2024] POST /identity/v3/auth/tokens => generated 312 bytes in 19 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 28 13:02:19 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-43a8d988-3780-4348-b264-adb767c9ee23 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] GET http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/share-access-rules?share_id=b330db31-7766-443d-9c19-26fe349665aa May 28 13:02:19 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-43a8d988-3780-4348-b264-adb767c9ee23 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:02:19 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-43a8d988-3780-4348-b264-adb767c9ee23 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:02:19 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-43a8d988-3780-4348-b264-adb767c9ee23 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/share-access-rules?share_id=b330db31-7766-443d-9c19-26fe349665aa returned with HTTP 200 May 28 13:02:19 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1235/2447] 10.27.203.238 () {64 vars in 1467 bytes} [Tue May 28 13:02:19 2024] GET /share/v2/a4f3887fa28c457390f5b66615564430/share-access-rules?share_id=b330db31-7766-443d-9c19-26fe349665aa => generated 19 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0201f891-9000-4412-b69f-233640512008 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-0201f891-9000-4412-b69f-233640512008 None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9dcc9b-afa1-40b7-8cc7-c40b77222ed2 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9dcc9b-afa1-40b7-8cc7-c40b77222ed2 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9dcc9b-afa1-40b7-8cc7-c40b77222ed2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-4c9dcc9b-afa1-40b7-8cc7-c40b77222ed2 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-4c9dcc9b-afa1-40b7-8cc7-c40b77222ed2 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-4c9dcc9b-afa1-40b7-8cc7-c40b77222ed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:02:19 l75lg1-v1 nova-conductor[83647]: DEBUG dbcounter [-] [83647] Writing DB stats nova_cell1:SELECT=2,nova_cell1:UPDATE=1 {{(pid=83647) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1688/3346] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 13:02:19 2024] POST /identity/v3/auth/tokens => generated 2960 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0201f891-9000-4412-b69f-233640512008 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9dcc9b-afa1-40b7-8cc7-c40b77222ed2 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e34e616-2dd3-4e7e-a205-eeec35c6fbc3 tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91af4223eb404925980daea7f7bde321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f353f66e6e00471aa584ea2e39c0ab0e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e34e616-2dd3-4e7e-a205-eeec35c6fbc3 tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e34e616-2dd3-4e7e-a205-eeec35c6fbc3 tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e34e616-2dd3-4e7e-a205-eeec35c6fbc3 tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] PATH_INFO: `/v3/users/8688f80695814f34bfb56342c4e54028` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9dcc9b-afa1-40b7-8cc7-c40b77222ed2 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9f498a-4553-48bd-a3ba-b2e28348b874 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e34e616-2dd3-4e7e-a205-eeec35c6fbc3 tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] RBAC: Authorizing `identity:delete_user(user_id=8688f80695814f34bfb56342c4e54028)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9f498a-4553-48bd-a3ba-b2e28348b874 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9f498a-4553-48bd-a3ba-b2e28348b874 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9f498a-4553-48bd-a3ba-b2e28348b874 None admin] PATH_INFO: `/v3/domains` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e34e616-2dd3-4e7e-a205-eeec35c6fbc3 tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9f498a-4553-48bd-a3ba-b2e28348b874 None admin] RBAC: Adding query filter params (name=Default) {{(pid=51267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9f498a-4553-48bd-a3ba-b2e28348b874 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9f498a-4553-48bd-a3ba-b2e28348b874 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-2e34e616-2dd3-4e7e-a205-eeec35c6fbc3 tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] Could not find user: 8688f80695814f34bfb56342c4e54028.: keystone.exception.UserNotFound: Could not find user: 8688f80695814f34bfb56342c4e54028. May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 8688f80695814f34bfb56342c4e54028. May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1659/3347] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:02:19 2024] DELETE /identity/v3/users/8688f80695814f34bfb56342c4e54028 => generated 110 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1689/3348] 10.27.203.238 () {62 vars in 1220 bytes} [Tue May 28 13:02:19 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e34e616-2dd3-4e7e-a205-eeec35c6fbc3 tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9f498a-4553-48bd-a3ba-b2e28348b874 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e34e616-2dd3-4e7e-a205-eeec35c6fbc3 tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9f498a-4553-48bd-a3ba-b2e28348b874 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1594fe90-a465-467c-a943-760dc2033159 tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91af4223eb404925980daea7f7bde321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f353f66e6e00471aa584ea2e39c0ab0e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1594fe90-a465-467c-a943-760dc2033159 tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1594fe90-a465-467c-a943-760dc2033159 tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1594fe90-a465-467c-a943-760dc2033159 tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] PATH_INFO: `/v3/users/108a25e436e9452a9a865957dcea1fc5` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36147ba-0200-4c56-92e9-c89764d3c5ce None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36147ba-0200-4c56-92e9-c89764d3c5ce None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36147ba-0200-4c56-92e9-c89764d3c5ce None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36147ba-0200-4c56-92e9-c89764d3c5ce None admin] PATH_INFO: `/v3/projects` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36147ba-0200-4c56-92e9-c89764d3c5ce None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36147ba-0200-4c56-92e9-c89764d3c5ce None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1594fe90-a465-467c-a943-760dc2033159 tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] RBAC: Authorizing `identity:delete_user(user_id=108a25e436e9452a9a865957dcea1fc5)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1594fe90-a465-467c-a943-760dc2033159 tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-1594fe90-a465-467c-a943-760dc2033159 tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] Could not find user: 108a25e436e9452a9a865957dcea1fc5.: keystone.exception.UserNotFound: Could not find user: 108a25e436e9452a9a865957dcea1fc5. May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 108a25e436e9452a9a865957dcea1fc5. May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1660/3349] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:02:19 2024] DELETE /identity/v3/users/108a25e436e9452a9a865957dcea1fc5 => generated 110 bytes in 23 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1594fe90-a465-467c-a943-760dc2033159 tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1594fe90-a465-467c-a943-760dc2033159 tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f98576-6b7f-4919-84fb-a82c47c7b962 tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91af4223eb404925980daea7f7bde321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f353f66e6e00471aa584ea2e39c0ab0e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f98576-6b7f-4919-84fb-a82c47c7b962 tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f98576-6b7f-4919-84fb-a82c47c7b962 tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f98576-6b7f-4919-84fb-a82c47c7b962 tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] PATH_INFO: `/v3/users/5ae5cb1db3504baaba1df93dc154a004` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1690/3350] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 13:02:19 2024] POST /identity/v3/projects => generated 375 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f98576-6b7f-4919-84fb-a82c47c7b962 tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] RBAC: Authorizing `identity:delete_user(user_id=5ae5cb1db3504baaba1df93dc154a004)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f98576-6b7f-4919-84fb-a82c47c7b962 tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36147ba-0200-4c56-92e9-c89764d3c5ce None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-38f98576-6b7f-4919-84fb-a82c47c7b962 tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] Could not find user: 5ae5cb1db3504baaba1df93dc154a004.: keystone.exception.UserNotFound: Could not find user: 5ae5cb1db3504baaba1df93dc154a004. May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 5ae5cb1db3504baaba1df93dc154a004. May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1661/3351] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:02:19 2024] DELETE /identity/v3/users/5ae5cb1db3504baaba1df93dc154a004 => generated 110 bytes in 23 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f98576-6b7f-4919-84fb-a82c47c7b962 tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f98576-6b7f-4919-84fb-a82c47c7b962 tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36147ba-0200-4c56-92e9-c89764d3c5ce None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30a5a77-149c-47b2-963b-c3b28bec5571 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30a5a77-149c-47b2-963b-c3b28bec5571 None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30a5a77-149c-47b2-963b-c3b28bec5571 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30a5a77-149c-47b2-963b-c3b28bec5571 None admin] PATH_INFO: `/v3/users` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30a5a77-149c-47b2-963b-c3b28bec5571 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30a5a77-149c-47b2-963b-c3b28bec5571 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-a30a5a77-149c-47b2-963b-c3b28bec5571 None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1691/3352] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 13:02:19 2024] POST /identity/v3/users => generated 296 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec91bc3-c7a0-4ff2-ba0d-ebad0d9f7eec tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91af4223eb404925980daea7f7bde321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f353f66e6e00471aa584ea2e39c0ab0e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec91bc3-c7a0-4ff2-ba0d-ebad0d9f7eec tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec91bc3-c7a0-4ff2-ba0d-ebad0d9f7eec tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec91bc3-c7a0-4ff2-ba0d-ebad0d9f7eec tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] PATH_INFO: `/v3/users/c2ac6ca3ea5a4ae498df6d12bb7caadc` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30a5a77-149c-47b2-963b-c3b28bec5571 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30a5a77-149c-47b2-963b-c3b28bec5571 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec91bc3-c7a0-4ff2-ba0d-ebad0d9f7eec tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] RBAC: Authorizing `identity:delete_user(user_id=c2ac6ca3ea5a4ae498df6d12bb7caadc)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec91bc3-c7a0-4ff2-ba0d-ebad0d9f7eec tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65a77fb-3d37-47ea-9b4e-1b3671c6a2dd None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65a77fb-3d37-47ea-9b4e-1b3671c6a2dd None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65a77fb-3d37-47ea-9b4e-1b3671c6a2dd None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65a77fb-3d37-47ea-9b4e-1b3671c6a2dd None admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65a77fb-3d37-47ea-9b4e-1b3671c6a2dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65a77fb-3d37-47ea-9b4e-1b3671c6a2dd None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-eec91bc3-c7a0-4ff2-ba0d-ebad0d9f7eec tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] Could not find user: c2ac6ca3ea5a4ae498df6d12bb7caadc.: keystone.exception.UserNotFound: Could not find user: c2ac6ca3ea5a4ae498df6d12bb7caadc. May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: c2ac6ca3ea5a4ae498df6d12bb7caadc. May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1662/3353] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:02:19 2024] DELETE /identity/v3/users/c2ac6ca3ea5a4ae498df6d12bb7caadc => generated 110 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1692/3354] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 13:02:19 2024] GET /identity/v3/roles => generated 1680 bytes in 15 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec91bc3-c7a0-4ff2-ba0d-ebad0d9f7eec tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65a77fb-3d37-47ea-9b4e-1b3671c6a2dd None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec91bc3-c7a0-4ff2-ba0d-ebad0d9f7eec tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65a77fb-3d37-47ea-9b4e-1b3671c6a2dd None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb82e159-0501-47bf-8a8e-29a914f9d8b2 tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91af4223eb404925980daea7f7bde321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f353f66e6e00471aa584ea2e39c0ab0e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb82e159-0501-47bf-8a8e-29a914f9d8b2 tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb82e159-0501-47bf-8a8e-29a914f9d8b2 tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4a6da5-e610-499a-8161-ea6ce5b795b5 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb82e159-0501-47bf-8a8e-29a914f9d8b2 tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] PATH_INFO: `/v3/users/f89f851af36d480ab7d10d3506c60899` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4a6da5-e610-499a-8161-ea6ce5b795b5 None admin] REQUEST_METHOD: `PUT` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4a6da5-e610-499a-8161-ea6ce5b795b5 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4a6da5-e610-499a-8161-ea6ce5b795b5 None admin] PATH_INFO: `/v3/projects/d1d71dc9f23c4c6a8e146d99ad65ebb2/users/48f962e7e06c4cb5b4304e96f10ea343/roles/44620cad10ae407c90c91e2c296adb04` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb82e159-0501-47bf-8a8e-29a914f9d8b2 tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] RBAC: Authorizing `identity:delete_user(user_id=f89f851af36d480ab7d10d3506c60899)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb82e159-0501-47bf-8a8e-29a914f9d8b2 tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4a6da5-e610-499a-8161-ea6ce5b795b5 None admin] RBAC: Authorizing `identity:create_grant(project_id=d1d71dc9f23c4c6a8e146d99ad65ebb2, user_id=48f962e7e06c4cb5b4304e96f10ea343, role_id=44620cad10ae407c90c91e2c296adb04)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4a6da5-e610-499a-8161-ea6ce5b795b5 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-fb82e159-0501-47bf-8a8e-29a914f9d8b2 tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] Could not find user: f89f851af36d480ab7d10d3506c60899.: keystone.exception.UserNotFound: Could not find user: f89f851af36d480ab7d10d3506c60899. May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: f89f851af36d480ab7d10d3506c60899. May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1663/3355] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:02:19 2024] DELETE /identity/v3/users/f89f851af36d480ab7d10d3506c60899 => generated 110 bytes in 24 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb82e159-0501-47bf-8a8e-29a914f9d8b2 tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb82e159-0501-47bf-8a8e-29a914f9d8b2 tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1693/3356] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 13:02:19 2024] PUT /identity/v3/projects/d1d71dc9f23c4c6a8e146d99ad65ebb2/users/48f962e7e06c4cb5b4304e96f10ea343/roles/44620cad10ae407c90c91e2c296adb04 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe14285e-014c-43a4-a59c-bb475bd4db0f None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe14285e-014c-43a4-a59c-bb475bd4db0f None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe14285e-014c-43a4-a59c-bb475bd4db0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-fe14285e-014c-43a4-a59c-bb475bd4db0f None None] Truncating password to algorithm specific maximum length 72 characters. May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-fe14285e-014c-43a4-a59c-bb475bd4db0f None None] MFA Rules not processed for user `48f962e7e06c4cb5b4304e96f10ea343`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 13:02:19 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-fe14285e-014c-43a4-a59c-bb475bd4db0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb651e29-dc94-4bb0-ba04-2bcbdd907cdf tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91af4223eb404925980daea7f7bde321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f353f66e6e00471aa584ea2e39c0ab0e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb651e29-dc94-4bb0-ba04-2bcbdd907cdf tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb651e29-dc94-4bb0-ba04-2bcbdd907cdf tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb651e29-dc94-4bb0-ba04-2bcbdd907cdf tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] PATH_INFO: `/v3/users/6886717a9cfb42a0a4142a0b982570ee` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb651e29-dc94-4bb0-ba04-2bcbdd907cdf tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] RBAC: Authorizing `identity:delete_user(user_id=6886717a9cfb42a0a4142a0b982570ee)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb651e29-dc94-4bb0-ba04-2bcbdd907cdf tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-fb651e29-dc94-4bb0-ba04-2bcbdd907cdf tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] Could not find user: 6886717a9cfb42a0a4142a0b982570ee.: keystone.exception.UserNotFound: Could not find user: 6886717a9cfb42a0a4142a0b982570ee. May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 6886717a9cfb42a0a4142a0b982570ee. May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1664/3357] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:02:19 2024] DELETE /identity/v3/users/6886717a9cfb42a0a4142a0b982570ee => generated 110 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb651e29-dc94-4bb0-ba04-2bcbdd907cdf tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb651e29-dc94-4bb0-ba04-2bcbdd907cdf tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebcac50-307d-4c4b-97a9-d5bf646a0fac tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91af4223eb404925980daea7f7bde321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f353f66e6e00471aa584ea2e39c0ab0e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebcac50-307d-4c4b-97a9-d5bf646a0fac tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebcac50-307d-4c4b-97a9-d5bf646a0fac tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebcac50-307d-4c4b-97a9-d5bf646a0fac tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] PATH_INFO: `/v3/users/b523155e680a4a14acd4f3a4295a8d26` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:20 l75lg1-v1 nova-conductor[83648]: DEBUG dbcounter [-] [83648] Writing DB stats nova_cell1:SELECT=2 {{(pid=83648) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1694/3358] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 13:02:19 2024] POST /identity/v3/auth/tokens => generated 3946 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebcac50-307d-4c4b-97a9-d5bf646a0fac tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] RBAC: Authorizing `identity:delete_user(user_id=b523155e680a4a14acd4f3a4295a8d26)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebcac50-307d-4c4b-97a9-d5bf646a0fac tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe14285e-014c-43a4-a59c-bb475bd4db0f None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-9ebcac50-307d-4c4b-97a9-d5bf646a0fac tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] Could not find user: b523155e680a4a14acd4f3a4295a8d26.: keystone.exception.UserNotFound: Could not find user: b523155e680a4a14acd4f3a4295a8d26. May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: b523155e680a4a14acd4f3a4295a8d26. May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1665/3359] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:02:20 2024] DELETE /identity/v3/users/b523155e680a4a14acd4f3a4295a8d26 => generated 110 bytes in 32 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebcac50-307d-4c4b-97a9-d5bf646a0fac tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebcac50-307d-4c4b-97a9-d5bf646a0fac tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222fa51c-3177-4b1a-8e88-369f67391717 tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91af4223eb404925980daea7f7bde321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f353f66e6e00471aa584ea2e39c0ab0e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222fa51c-3177-4b1a-8e88-369f67391717 tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222fa51c-3177-4b1a-8e88-369f67391717 tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222fa51c-3177-4b1a-8e88-369f67391717 tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] PATH_INFO: `/v3/users/756070dd0b274fd8835b10a8fbe293d9` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222fa51c-3177-4b1a-8e88-369f67391717 tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] RBAC: Authorizing `identity:delete_user(user_id=756070dd0b274fd8835b10a8fbe293d9)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222fa51c-3177-4b1a-8e88-369f67391717 tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe14285e-014c-43a4-a59c-bb475bd4db0f None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53911172-299c-4875-a6b0-d59c8955ba2f None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53911172-299c-4875-a6b0-d59c8955ba2f None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53911172-299c-4875-a6b0-d59c8955ba2f None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53911172-299c-4875-a6b0-d59c8955ba2f None admin] PATH_INFO: `/v3/projects` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53911172-299c-4875-a6b0-d59c8955ba2f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53911172-299c-4875-a6b0-d59c8955ba2f None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1695/3360] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 13:02:20 2024] POST /identity/v3/projects => generated 375 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53911172-299c-4875-a6b0-d59c8955ba2f None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-222fa51c-3177-4b1a-8e88-369f67391717 tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '756070dd0b274fd8835b10a8fbe293d9', 'request_id': 'req-222fa51c-3177-4b1a-8e88-369f67391717'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-222fa51c-3177-4b1a-8e88-369f67391717 tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '756070dd0b274fd8835b10a8fbe293d9', 'request_id': 'req-222fa51c-3177-4b1a-8e88-369f67391717'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-222fa51c-3177-4b1a-8e88-369f67391717 tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '756070dd0b274fd8835b10a8fbe293d9', 'request_id': 'req-222fa51c-3177-4b1a-8e88-369f67391717'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53911172-299c-4875-a6b0-d59c8955ba2f None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-222fa51c-3177-4b1a-8e88-369f67391717 tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '756070dd0b274fd8835b10a8fbe293d9', 'request_id': 'req-222fa51c-3177-4b1a-8e88-369f67391717'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-222fa51c-3177-4b1a-8e88-369f67391717 tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '756070dd0b274fd8835b10a8fbe293d9', 'request_id': 'req-222fa51c-3177-4b1a-8e88-369f67391717'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1666/3361] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:02:20 2024] DELETE /identity/v3/users/756070dd0b274fd8835b10a8fbe293d9 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222fa51c-3177-4b1a-8e88-369f67391717 tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-222fa51c-3177-4b1a-8e88-369f67391717 tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89285b1a-19f6-48a7-8b90-bc3960e654c3 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89285b1a-19f6-48a7-8b90-bc3960e654c3 None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89285b1a-19f6-48a7-8b90-bc3960e654c3 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89285b1a-19f6-48a7-8b90-bc3960e654c3 None admin] PATH_INFO: `/v3/users` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89285b1a-19f6-48a7-8b90-bc3960e654c3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89285b1a-19f6-48a7-8b90-bc3960e654c3 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-89285b1a-19f6-48a7-8b90-bc3960e654c3 None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1696/3362] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 13:02:20 2024] POST /identity/v3/users => generated 296 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89285b1a-19f6-48a7-8b90-bc3960e654c3 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-89285b1a-19f6-48a7-8b90-bc3960e654c3 None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89285b1a-19f6-48a7-8b90-bc3960e654c3 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222fa51c-3177-4b1a-8e88-369f67391717 tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08021f6-262b-4cd4-b7b3-0b64d8d16146 tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91af4223eb404925980daea7f7bde321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f353f66e6e00471aa584ea2e39c0ab0e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08021f6-262b-4cd4-b7b3-0b64d8d16146 tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08021f6-262b-4cd4-b7b3-0b64d8d16146 tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08021f6-262b-4cd4-b7b3-0b64d8d16146 tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] PATH_INFO: `/v3/users/cdf8594f55cb448e9b2312d051486331` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08021f6-262b-4cd4-b7b3-0b64d8d16146 tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] RBAC: Authorizing `identity:delete_user(user_id=cdf8594f55cb448e9b2312d051486331)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08021f6-262b-4cd4-b7b3-0b64d8d16146 tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60ffc78-a1a7-4101-980b-d115c60c4276 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60ffc78-a1a7-4101-980b-d115c60c4276 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60ffc78-a1a7-4101-980b-d115c60c4276 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60ffc78-a1a7-4101-980b-d115c60c4276 None admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60ffc78-a1a7-4101-980b-d115c60c4276 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60ffc78-a1a7-4101-980b-d115c60c4276 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1697/3363] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 13:02:20 2024] GET /identity/v3/roles => generated 1680 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60ffc78-a1a7-4101-980b-d115c60c4276 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60ffc78-a1a7-4101-980b-d115c60c4276 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0e750d-b1c2-452c-9d04-16310c61db85 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0e750d-b1c2-452c-9d04-16310c61db85 None admin] REQUEST_METHOD: `PUT` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0e750d-b1c2-452c-9d04-16310c61db85 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0e750d-b1c2-452c-9d04-16310c61db85 None admin] PATH_INFO: `/v3/projects/28e72ec38bf64ac2b199b23160dbeac5/users/f2898eb3fa17430d922ce1ac6a74e451/roles/44620cad10ae407c90c91e2c296adb04` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:20 l75lg1-v1 dstat.sh[49771]: 28-05 13:02:20| 15 1 80 3 0|5641M 1784M 278M 7921M| 12k 3778B| 0 2144k| 0 293 | 10k 18k|1.14 1.16 1.06|1.0 2.0 0| 0 0 | 0 2048M| 29 365 0 37 2 May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0e750d-b1c2-452c-9d04-16310c61db85 None admin] RBAC: Authorizing `identity:create_grant(project_id=28e72ec38bf64ac2b199b23160dbeac5, user_id=f2898eb3fa17430d922ce1ac6a74e451, role_id=44620cad10ae407c90c91e2c296adb04)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0e750d-b1c2-452c-9d04-16310c61db85 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-c08021f6-262b-4cd4-b7b3-0b64d8d16146 tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cdf8594f55cb448e9b2312d051486331', 'request_id': 'req-c08021f6-262b-4cd4-b7b3-0b64d8d16146'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-c08021f6-262b-4cd4-b7b3-0b64d8d16146 tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cdf8594f55cb448e9b2312d051486331', 'request_id': 'req-c08021f6-262b-4cd4-b7b3-0b64d8d16146'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-c08021f6-262b-4cd4-b7b3-0b64d8d16146 tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cdf8594f55cb448e9b2312d051486331', 'request_id': 'req-c08021f6-262b-4cd4-b7b3-0b64d8d16146'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-c08021f6-262b-4cd4-b7b3-0b64d8d16146 tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cdf8594f55cb448e9b2312d051486331', 'request_id': 'req-c08021f6-262b-4cd4-b7b3-0b64d8d16146'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-c08021f6-262b-4cd4-b7b3-0b64d8d16146 tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cdf8594f55cb448e9b2312d051486331', 'request_id': 'req-c08021f6-262b-4cd4-b7b3-0b64d8d16146'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1698/3364] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 13:02:20 2024] PUT /identity/v3/projects/28e72ec38bf64ac2b199b23160dbeac5/users/f2898eb3fa17430d922ce1ac6a74e451/roles/44620cad10ae407c90c91e2c296adb04 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1667/3365] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:02:20 2024] DELETE /identity/v3/users/cdf8594f55cb448e9b2312d051486331 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab1fc48-c11a-479d-8c22-cfa71d9a8391 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab1fc48-c11a-479d-8c22-cfa71d9a8391 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab1fc48-c11a-479d-8c22-cfa71d9a8391 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:20 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-012a7fc5-b24f-4a93-ab4c-0a0741b0fe28 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] GET http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/share-replicas/detail?share_id=415b1daa-22c2-48a3-873e-80762e65a747 May 28 13:02:20 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-012a7fc5-b24f-4a93-ab4c-0a0741b0fe28 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:02:20 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-012a7fc5-b24f-4a93-ab4c-0a0741b0fe28 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-aab1fc48-c11a-479d-8c22-cfa71d9a8391 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 13:02:20 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-012a7fc5-b24f-4a93-ab4c-0a0741b0fe28 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/share-replicas/detail?share_id=415b1daa-22c2-48a3-873e-80762e65a747 returned with HTTP 200 May 28 13:02:20 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1213/2448] 10.27.203.238 () {64 vars in 1476 bytes} [Tue May 28 13:02:20 2024] GET /share/v2/a4f3887fa28c457390f5b66615564430/share-replicas/detail?share_id=415b1daa-22c2-48a3-873e-80762e65a747 => generated 22 bytes in 13 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:02:20 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-94442d47-a6ca-4905-ab66-9a95654cfbb3 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] DELETE http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/shares/415b1daa-22c2-48a3-873e-80762e65a747 May 28 13:02:20 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-94442d47-a6ca-4905-ab66-9a95654cfbb3 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:02:20 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-94442d47-a6ca-4905-ab66-9a95654cfbb3 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Calling method 'ShareMixin.delete' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-aab1fc48-c11a-479d-8c22-cfa71d9a8391 None None] MFA Rules not processed for user `f2898eb3fa17430d922ce1ac6a74e451`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 13:02:20 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.v1.shares [None req-94442d47-a6ca-4905-ab66-9a95654cfbb3 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Delete share with id: 415b1daa-22c2-48a3-873e-80762e65a747 May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-aab1fc48-c11a-479d-8c22-cfa71d9a8391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:02:20 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-94442d47-a6ca-4905-ab66-9a95654cfbb3 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] HTTP exception thrown: The resource could not be found. May 28 13:02:20 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-94442d47-a6ca-4905-ab66-9a95654cfbb3 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/shares/415b1daa-22c2-48a3-873e-80762e65a747 returned with HTTP 404 May 28 13:02:20 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1236/2449] 10.27.203.238 () {64 vars in 1454 bytes} [Tue May 28 13:02:20 2024] DELETE /share/v2/a4f3887fa28c457390f5b66615564430/shares/415b1daa-22c2-48a3-873e-80762e65a747 => generated 78 bytes in 12 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 13:02:20 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-24e443e8-5573-4330-8a05-c09a2f7c6944 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] GET http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/share-replicas/detail?share_id=f4283c2a-3835-416e-9703-f5745babbf5c May 28 13:02:20 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-24e443e8-5573-4330-8a05-c09a2f7c6944 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:02:20 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-24e443e8-5573-4330-8a05-c09a2f7c6944 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:02:20 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-24e443e8-5573-4330-8a05-c09a2f7c6944 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/share-replicas/detail?share_id=f4283c2a-3835-416e-9703-f5745babbf5c returned with HTTP 200 May 28 13:02:20 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1214/2450] 10.27.203.238 () {64 vars in 1476 bytes} [Tue May 28 13:02:20 2024] GET /share/v2/a4f3887fa28c457390f5b66615564430/share-replicas/detail?share_id=f4283c2a-3835-416e-9703-f5745babbf5c => generated 22 bytes in 13 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:02:20 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-6554b480-80e8-4e3d-a809-89498273e70d tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] DELETE http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/shares/f4283c2a-3835-416e-9703-f5745babbf5c May 28 13:02:20 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-6554b480-80e8-4e3d-a809-89498273e70d tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:02:20 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-6554b480-80e8-4e3d-a809-89498273e70d tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Calling method 'ShareMixin.delete' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:02:20 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.v1.shares [None req-6554b480-80e8-4e3d-a809-89498273e70d tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Delete share with id: f4283c2a-3835-416e-9703-f5745babbf5c May 28 13:02:20 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-6554b480-80e8-4e3d-a809-89498273e70d tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] HTTP exception thrown: The resource could not be found. May 28 13:02:20 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-6554b480-80e8-4e3d-a809-89498273e70d tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/shares/f4283c2a-3835-416e-9703-f5745babbf5c returned with HTTP 404 May 28 13:02:20 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1237/2451] 10.27.203.238 () {64 vars in 1454 bytes} [Tue May 28 13:02:20 2024] DELETE /share/v2/a4f3887fa28c457390f5b66615564430/shares/f4283c2a-3835-416e-9703-f5745babbf5c => generated 78 bytes in 12 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 13:02:20 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-90a24ada-9de0-42f3-b4db-bae3a37ae008 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] GET http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/share-replicas/detail?share_id=510f7bcd-a0ee-49a6-8093-2640036f2ca3 May 28 13:02:20 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-90a24ada-9de0-42f3-b4db-bae3a37ae008 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:02:20 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-90a24ada-9de0-42f3-b4db-bae3a37ae008 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1699/3366] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 13:02:20 2024] POST /identity/v3/auth/tokens => generated 3946 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08021f6-262b-4cd4-b7b3-0b64d8d16146 tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-c08021f6-262b-4cd4-b7b3-0b64d8d16146 tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:02:20 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-90a24ada-9de0-42f3-b4db-bae3a37ae008 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/share-replicas/detail?share_id=510f7bcd-a0ee-49a6-8093-2640036f2ca3 returned with HTTP 200 May 28 13:02:20 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1215/2452] 10.27.203.238 () {64 vars in 1476 bytes} [Tue May 28 13:02:20 2024] GET /share/v2/a4f3887fa28c457390f5b66615564430/share-replicas/detail?share_id=510f7bcd-a0ee-49a6-8093-2640036f2ca3 => generated 22 bytes in 12 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:02:20 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-84fd2846-663b-4409-89a3-9d77cc06f6d6 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] DELETE http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/shares/510f7bcd-a0ee-49a6-8093-2640036f2ca3 May 28 13:02:20 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-84fd2846-663b-4409-89a3-9d77cc06f6d6 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:02:20 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-84fd2846-663b-4409-89a3-9d77cc06f6d6 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Calling method 'ShareMixin.delete' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:02:20 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.v1.shares [None req-84fd2846-663b-4409-89a3-9d77cc06f6d6 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Delete share with id: 510f7bcd-a0ee-49a6-8093-2640036f2ca3 May 28 13:02:20 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-84fd2846-663b-4409-89a3-9d77cc06f6d6 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] HTTP exception thrown: The resource could not be found. May 28 13:02:20 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-84fd2846-663b-4409-89a3-9d77cc06f6d6 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/shares/510f7bcd-a0ee-49a6-8093-2640036f2ca3 returned with HTTP 404 May 28 13:02:20 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1238/2453] 10.27.203.238 () {64 vars in 1454 bytes} [Tue May 28 13:02:20 2024] DELETE /share/v2/a4f3887fa28c457390f5b66615564430/shares/510f7bcd-a0ee-49a6-8093-2640036f2ca3 => generated 78 bytes in 11 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 13:02:20 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-d4467ce3-4d94-4106-9fc0-247d0d7f8e96 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] GET http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/share-replicas/detail?share_id=b330db31-7766-443d-9c19-26fe349665aa May 28 13:02:20 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-d4467ce3-4d94-4106-9fc0-247d0d7f8e96 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:02:20 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-d4467ce3-4d94-4106-9fc0-247d0d7f8e96 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08021f6-262b-4cd4-b7b3-0b64d8d16146 tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:20 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-d4467ce3-4d94-4106-9fc0-247d0d7f8e96 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/share-replicas/detail?share_id=b330db31-7766-443d-9c19-26fe349665aa returned with HTTP 200 May 28 13:02:20 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1216/2454] 10.27.203.238 () {64 vars in 1476 bytes} [Tue May 28 13:02:20 2024] GET /share/v2/a4f3887fa28c457390f5b66615564430/share-replicas/detail?share_id=b330db31-7766-443d-9c19-26fe349665aa => generated 22 bytes in 13 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66447d2f-624b-4f98-9060-2b1318174def None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66447d2f-624b-4f98-9060-2b1318174def None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66447d2f-624b-4f98-9060-2b1318174def None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66447d2f-624b-4f98-9060-2b1318174def None admin] PATH_INFO: `/v3/projects` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66447d2f-624b-4f98-9060-2b1318174def None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:20 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-ff25f21e-23a0-4894-a240-f4b3f1647793 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] DELETE http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/shares/b330db31-7766-443d-9c19-26fe349665aa May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66447d2f-624b-4f98-9060-2b1318174def None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:20 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-ff25f21e-23a0-4894-a240-f4b3f1647793 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:02:20 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-ff25f21e-23a0-4894-a240-f4b3f1647793 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Calling method 'ShareMixin.delete' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:02:20 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.v1.shares [None req-ff25f21e-23a0-4894-a240-f4b3f1647793 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Delete share with id: b330db31-7766-443d-9c19-26fe349665aa May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1668/3367] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 13:02:20 2024] POST /identity/v3/projects => generated 373 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab1fc48-c11a-479d-8c22-cfa71d9a8391 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab1fc48-c11a-479d-8c22-cfa71d9a8391 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee787ae-7309-4b64-b103-69e279ad5418 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee787ae-7309-4b64-b103-69e279ad5418 None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee787ae-7309-4b64-b103-69e279ad5418 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee787ae-7309-4b64-b103-69e279ad5418 None admin] PATH_INFO: `/v3/users` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee787ae-7309-4b64-b103-69e279ad5418 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee787ae-7309-4b64-b103-69e279ad5418 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-fee787ae-7309-4b64-b103-69e279ad5418 None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1700/3368] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 13:02:20 2024] POST /identity/v3/users => generated 294 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66447d2f-624b-4f98-9060-2b1318174def None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66447d2f-624b-4f98-9060-2b1318174def None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5a20fc-5140-422d-bf19-764d27880561 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5a20fc-5140-422d-bf19-764d27880561 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5a20fc-5140-422d-bf19-764d27880561 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5a20fc-5140-422d-bf19-764d27880561 None admin] PATH_INFO: `/v3/roles` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5a20fc-5140-422d-bf19-764d27880561 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5a20fc-5140-422d-bf19-764d27880561 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1669/3369] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 13:02:20 2024] GET /identity/v3/roles => generated 1680 bytes in 16 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee787ae-7309-4b64-b103-69e279ad5418 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee787ae-7309-4b64-b103-69e279ad5418 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab84308-0cb5-4d34-9f2c-2d23594ef893 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab84308-0cb5-4d34-9f2c-2d23594ef893 None admin] REQUEST_METHOD: `PUT` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab84308-0cb5-4d34-9f2c-2d23594ef893 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab84308-0cb5-4d34-9f2c-2d23594ef893 None admin] PATH_INFO: `/v3/projects/adcbdea5704e4efc898c24b2b0a492a5/users/8979d27306d441e385a31f56e8668ee3/roles/e7989893488f483baa107be56668c4f8` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:20 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-ff25f21e-23a0-4894-a240-f4b3f1647793 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/shares/b330db31-7766-443d-9c19-26fe349665aa returned with HTTP 202 May 28 13:02:20 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1239/2455] 10.27.203.238 () {64 vars in 1454 bytes} [Tue May 28 13:02:20 2024] DELETE /share/v2/a4f3887fa28c457390f5b66615564430/shares/b330db31-7766-443d-9c19-26fe349665aa => generated 0 bytes in 136 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 13:02:20 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-b132e48f-91b8-45cb-bed9-7ffe552054a8 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] GET http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/shares/b330db31-7766-443d-9c19-26fe349665aa May 28 13:02:20 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-b132e48f-91b8-45cb-bed9-7ffe552054a8 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:02:20 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-b132e48f-91b8-45cb-bed9-7ffe552054a8 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab84308-0cb5-4d34-9f2c-2d23594ef893 None admin] RBAC: Authorizing `identity:create_grant(project_id=adcbdea5704e4efc898c24b2b0a492a5, user_id=8979d27306d441e385a31f56e8668ee3, role_id=e7989893488f483baa107be56668c4f8)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab84308-0cb5-4d34-9f2c-2d23594ef893 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:20 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-b132e48f-91b8-45cb-bed9-7ffe552054a8 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/shares/b330db31-7766-443d-9c19-26fe349665aa returned with HTTP 200 May 28 13:02:20 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1217/2456] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:02:20 2024] GET /share/v2/a4f3887fa28c457390f5b66615564430/shares/b330db31-7766-443d-9c19-26fe349665aa => generated 1315 bytes in 28 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1701/3370] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 13:02:20 2024] PUT /identity/v3/projects/adcbdea5704e4efc898c24b2b0a492a5/users/8979d27306d441e385a31f56e8668ee3/roles/e7989893488f483baa107be56668c4f8 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5a20fc-5140-422d-bf19-764d27880561 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5a20fc-5140-422d-bf19-764d27880561 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:20 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-234d6aa8-c62f-48b2-bf1a-f97d22230994 tempest-ShareSnapshotMetadataNegativeTest-1199544441 None] <<< [DELETE] https://127.0.0.1:40443/api/snapshots/16/ May 28 13:02:20 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-234d6aa8-c62f-48b2-bf1a-f97d22230994 tempest-ShareSnapshotMetadataNegativeTest-1199544441 None] --- [DELETE] https://127.0.0.1:40443/api/snapshots/16/: Done May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2f8d2e-9031-441a-9e45-0cfcd414fc2d None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2f8d2e-9031-441a-9e45-0cfcd414fc2d None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2f8d2e-9031-441a-9e45-0cfcd414fc2d None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2f8d2e-9031-441a-9e45-0cfcd414fc2d None admin] PATH_INFO: `/v3/roles` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2f8d2e-9031-441a-9e45-0cfcd414fc2d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2f8d2e-9031-441a-9e45-0cfcd414fc2d None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1670/3371] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 13:02:20 2024] GET /identity/v3/roles => generated 1680 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 13:02:20 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-ff25f21e-23a0-4894-a240-f4b3f1647793 tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:02:20 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-ff25f21e-23a0-4894-a240-f4b3f1647793 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab84308-0cb5-4d34-9f2c-2d23594ef893 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:20 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-ff25f21e-23a0-4894-a240-f4b3f1647793 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.006s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab84308-0cb5-4d34-9f2c-2d23594ef893 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:20 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-ff25f21e-23a0-4894-a240-f4b3f1647793 tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:02:20 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-ff25f21e-23a0-4894-a240-f4b3f1647793 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52051b47-4e6d-4924-85a7-97fe93f35546 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52051b47-4e6d-4924-85a7-97fe93f35546 None admin] REQUEST_METHOD: `PUT` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52051b47-4e6d-4924-85a7-97fe93f35546 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52051b47-4e6d-4924-85a7-97fe93f35546 None admin] PATH_INFO: `/v3/projects/adcbdea5704e4efc898c24b2b0a492a5/users/8979d27306d441e385a31f56e8668ee3/roles/e7989893488f483baa107be56668c4f8` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52051b47-4e6d-4924-85a7-97fe93f35546 None admin] RBAC: Authorizing `identity:create_grant(project_id=adcbdea5704e4efc898c24b2b0a492a5, user_id=8979d27306d441e385a31f56e8668ee3, role_id=e7989893488f483baa107be56668c4f8)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52051b47-4e6d-4924-85a7-97fe93f35546 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:20 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-ff25f21e-23a0-4894-a240-f4b3f1647793 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.009s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:02:20 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-ff25f21e-23a0-4894-a240-f4b3f1647793 tempest-ShareRulesTest-1530341375 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:02:20 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-ff25f21e-23a0-4894-a240-f4b3f1647793 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1702/3372] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 13:02:20 2024] PUT /identity/v3/projects/adcbdea5704e4efc898c24b2b0a492a5/users/8979d27306d441e385a31f56e8668ee3/roles/e7989893488f483baa107be56668c4f8 => generated 0 bytes in 20 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de93199c-ffe5-4236-a5c1-7151eb04a425 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de93199c-ffe5-4236-a5c1-7151eb04a425 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de93199c-ffe5-4236-a5c1-7151eb04a425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:20 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-ff25f21e-23a0-4894-a240-f4b3f1647793 tempest-ShareRulesTest-1530341375 None] Lock "locked_access_rules_operation_by_share_instance_f7e47502-a0f7-44de-953d-b7b5697ae0b2" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.014s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:02:20 l75lg1-v1 manila-share[98474]: DEBUG manila.share.access [None req-ff25f21e-23a0-4894-a240-f4b3f1647793 tempest-ShareRulesTest-1530341375 None] All access rules have been synced for share instance f7e47502-a0f7-44de-953d-b7b5697ae0b2 belonging to share b330db31-7766-443d-9c19-26fe349665aa. {{(pid=98474) update_access_rules /opt/stack/manila/manila/share/access.py:304}} May 28 13:02:20 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-ff25f21e-23a0-4894-a240-f4b3f1647793 tempest-ShareRulesTest-1530341375 None] deleting '/manila/manila-f7e47502-a0f7-44de-953d-b7b5697ae0b2' May 28 13:02:20 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ff25f21e-23a0-4894-a240-f4b3f1647793 tempest-ShareRulesTest-1530341375 None] >>> [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/ May 28 13:02:20 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ff25f21e-23a0-4894-a240-f4b3f1647793 tempest-ShareRulesTest-1530341375 None] {'data': '{"path": "/manila/manila-f7e47502-a0f7-44de-953d-b7b5697ae0b2"}', May 28 13:02:20 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ff25f21e-23a0-4894-a240-f4b3f1647793 tempest-ShareRulesTest-1530341375 None] 'params': None} May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-de93199c-ffe5-4236-a5c1-7151eb04a425 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-de93199c-ffe5-4236-a5c1-7151eb04a425 None None] MFA Rules not processed for user `8979d27306d441e385a31f56e8668ee3`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-de93199c-ffe5-4236-a5c1-7151eb04a425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:02:20 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-234d6aa8-c62f-48b2-bf1a-f97d22230994 tempest-ShareSnapshotMetadataNegativeTest-1199544441 None] Created reservations ['982534b9-e042-4cb8-bbd7-f4d4779b8e33', '0a6260d1-545a-4413-a84c-6f84ed1cdf41', 'e125c1a7-902d-4781-af43-f26a15281452', 'f8470cb9-13e2-4626-8b6a-6e408050b320'] {{(pid=98474) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1671/3373] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 13:02:20 2024] POST /identity/v3/auth/tokens => generated 4067 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 13:02:20 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ff25f21e-23a0-4894-a240-f4b3f1647793 tempest-ShareRulesTest-1530341375 None] <<< [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/ May 28 13:02:20 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ff25f21e-23a0-4894-a240-f4b3f1647793 tempest-ShareRulesTest-1530341375 None] 'OK' May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52051b47-4e6d-4924-85a7-97fe93f35546 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:20 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ff25f21e-23a0-4894-a240-f4b3f1647793 tempest-ShareRulesTest-1530341375 None] --- [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/: Done May 28 13:02:20 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ff25f21e-23a0-4894-a240-f4b3f1647793 tempest-ShareRulesTest-1530341375 None] >>> [GET] https://127.0.0.1:40443/api/views/ May 28 13:02:20 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ff25f21e-23a0-4894-a240-f4b3f1647793 tempest-ShareRulesTest-1530341375 None] {'allow_redirects': True, May 28 13:02:20 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ff25f21e-23a0-4894-a240-f4b3f1647793 tempest-ShareRulesTest-1530341375 None] 'params': {'name': 'f7e47502-a0f7-44de-953d-b7b5697ae0b2'}} May 28 13:02:20 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-234d6aa8-c62f-48b2-bf1a-f97d22230994 tempest-ShareSnapshotMetadataNegativeTest-1199544441 None] Committed reservations ['982534b9-e042-4cb8-bbd7-f4d4779b8e33', '0a6260d1-545a-4413-a84c-6f84ed1cdf41', 'e125c1a7-902d-4781-af43-f26a15281452', 'f8470cb9-13e2-4626-8b6a-6e408050b320'] {{(pid=98474) commit /opt/stack/manila/manila/quota.py:1063}} May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52051b47-4e6d-4924-85a7-97fe93f35546 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f9c437-d33b-474b-95ba-dcfcf934b842 tempest-SharesNegativeTest-322550032 tempest-SharesNegativeTest-322550032-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8979d27306d441e385a31f56e8668ee3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adcbdea5704e4efc898c24b2b0a492a5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f9c437-d33b-474b-95ba-dcfcf934b842 tempest-SharesNegativeTest-322550032 tempest-SharesNegativeTest-322550032-project-admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f9c437-d33b-474b-95ba-dcfcf934b842 tempest-SharesNegativeTest-322550032 tempest-SharesNegativeTest-322550032-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f9c437-d33b-474b-95ba-dcfcf934b842 tempest-SharesNegativeTest-322550032 tempest-SharesNegativeTest-322550032-project-admin] PATH_INFO: `/v3/domains` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f9c437-d33b-474b-95ba-dcfcf934b842 tempest-SharesNegativeTest-322550032 tempest-SharesNegativeTest-322550032-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=51267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f9c437-d33b-474b-95ba-dcfcf934b842 tempest-SharesNegativeTest-322550032 tempest-SharesNegativeTest-322550032-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f9c437-d33b-474b-95ba-dcfcf934b842 tempest-SharesNegativeTest-322550032 tempest-SharesNegativeTest-322550032-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1703/3374] 10.27.203.238 () {62 vars in 1241 bytes} [Tue May 28 13:02:20 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de93199c-ffe5-4236-a5c1-7151eb04a425 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de93199c-ffe5-4236-a5c1-7151eb04a425 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086dd1f3-b911-4787-a3a5-4e1946431f7a tempest-SharesNegativeTest-322550032 tempest-SharesNegativeTest-322550032-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8979d27306d441e385a31f56e8668ee3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adcbdea5704e4efc898c24b2b0a492a5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086dd1f3-b911-4787-a3a5-4e1946431f7a tempest-SharesNegativeTest-322550032 tempest-SharesNegativeTest-322550032-project-admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086dd1f3-b911-4787-a3a5-4e1946431f7a tempest-SharesNegativeTest-322550032 tempest-SharesNegativeTest-322550032-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086dd1f3-b911-4787-a3a5-4e1946431f7a tempest-SharesNegativeTest-322550032 tempest-SharesNegativeTest-322550032-project-admin] PATH_INFO: `/v3/users` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086dd1f3-b911-4787-a3a5-4e1946431f7a tempest-SharesNegativeTest-322550032 tempest-SharesNegativeTest-322550032-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086dd1f3-b911-4787-a3a5-4e1946431f7a tempest-SharesNegativeTest-322550032 tempest-SharesNegativeTest-322550032-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-086dd1f3-b911-4787-a3a5-4e1946431f7a tempest-SharesNegativeTest-322550032 tempest-SharesNegativeTest-322550032-project-admin] Truncating password to algorithm specific maximum length 72 characters. May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1672/3375] 10.27.203.238 () {64 vars in 1232 bytes} [Tue May 28 13:02:20 2024] POST /identity/v3/users => generated 433 bytes in 33 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f9c437-d33b-474b-95ba-dcfcf934b842 tempest-SharesNegativeTest-322550032 tempest-SharesNegativeTest-322550032-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f9c437-d33b-474b-95ba-dcfcf934b842 tempest-SharesNegativeTest-322550032 tempest-SharesNegativeTest-322550032-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f208ade-5f5d-45c7-bac9-9fe77d790420 tempest-SharesNegativeTest-322550032 tempest-SharesNegativeTest-322550032-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8979d27306d441e385a31f56e8668ee3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adcbdea5704e4efc898c24b2b0a492a5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f208ade-5f5d-45c7-bac9-9fe77d790420 tempest-SharesNegativeTest-322550032 tempest-SharesNegativeTest-322550032-project-admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f208ade-5f5d-45c7-bac9-9fe77d790420 tempest-SharesNegativeTest-322550032 tempest-SharesNegativeTest-322550032-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f208ade-5f5d-45c7-bac9-9fe77d790420 tempest-SharesNegativeTest-322550032 tempest-SharesNegativeTest-322550032-project-admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f208ade-5f5d-45c7-bac9-9fe77d790420 tempest-SharesNegativeTest-322550032 tempest-SharesNegativeTest-322550032-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f208ade-5f5d-45c7-bac9-9fe77d790420 tempest-SharesNegativeTest-322550032 tempest-SharesNegativeTest-322550032-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1704/3376] 10.27.203.238 () {62 vars in 1210 bytes} [Tue May 28 13:02:20 2024] GET /identity/v3/roles => generated 1680 bytes in 17 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086dd1f3-b911-4787-a3a5-4e1946431f7a tempest-SharesNegativeTest-322550032 tempest-SharesNegativeTest-322550032-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086dd1f3-b911-4787-a3a5-4e1946431f7a tempest-SharesNegativeTest-322550032 tempest-SharesNegativeTest-322550032-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c99569f-47cb-49a3-88ce-5edfe8475fdc tempest-SharesNegativeTest-322550032 tempest-SharesNegativeTest-322550032-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8979d27306d441e385a31f56e8668ee3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adcbdea5704e4efc898c24b2b0a492a5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c99569f-47cb-49a3-88ce-5edfe8475fdc tempest-SharesNegativeTest-322550032 tempest-SharesNegativeTest-322550032-project-admin] REQUEST_METHOD: `PUT` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c99569f-47cb-49a3-88ce-5edfe8475fdc tempest-SharesNegativeTest-322550032 tempest-SharesNegativeTest-322550032-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c99569f-47cb-49a3-88ce-5edfe8475fdc tempest-SharesNegativeTest-322550032 tempest-SharesNegativeTest-322550032-project-admin] PATH_INFO: `/v3/projects/adcbdea5704e4efc898c24b2b0a492a5/users/38cff7899375474db18ec516c437d291/roles/44620cad10ae407c90c91e2c296adb04` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c99569f-47cb-49a3-88ce-5edfe8475fdc tempest-SharesNegativeTest-322550032 tempest-SharesNegativeTest-322550032-project-admin] RBAC: Authorizing `identity:create_grant(project_id=adcbdea5704e4efc898c24b2b0a492a5, user_id=38cff7899375474db18ec516c437d291, role_id=44620cad10ae407c90c91e2c296adb04)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c99569f-47cb-49a3-88ce-5edfe8475fdc tempest-SharesNegativeTest-322550032 tempest-SharesNegativeTest-322550032-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1673/3377] 10.27.203.238 () {64 vars in 1571 bytes} [Tue May 28 13:02:20 2024] PUT /identity/v3/projects/adcbdea5704e4efc898c24b2b0a492a5/users/38cff7899375474db18ec516c437d291/roles/44620cad10ae407c90c91e2c296adb04 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f208ade-5f5d-45c7-bac9-9fe77d790420 tempest-SharesNegativeTest-322550032 tempest-SharesNegativeTest-322550032-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-4f208ade-5f5d-45c7-bac9-9fe77d790420 tempest-SharesNegativeTest-322550032 tempest-SharesNegativeTest-322550032-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f208ade-5f5d-45c7-bac9-9fe77d790420 tempest-SharesNegativeTest-322550032 tempest-SharesNegativeTest-322550032-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cb44f3-4188-479a-85e3-3abd9dd5c592 service manila] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f110cf6300f049c897d0aab63218d1e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cb44f3-4188-479a-85e3-3abd9dd5c592 service manila] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cb44f3-4188-479a-85e3-3abd9dd5c592 service manila] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cb44f3-4188-479a-85e3-3abd9dd5c592 service manila] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cb44f3-4188-479a-85e3-3abd9dd5c592 service manila] RBAC: Authorizing `identity:validate_token()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cb44f3-4188-479a-85e3-3abd9dd5c592 service manila] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:20 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1705/3378] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 13:02:20 2024] GET /identity/v3/auth/tokens => generated 4067 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 13:02:21 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-2266a742-12df-4a49-be4b-40267716a29f tempest-SharesNegativeTest-322550032 tempest-SharesNegativeTest-322550032-project-admin] POST http://10.27.203.238/share/v2/adcbdea5704e4efc898c24b2b0a492a5/types May 28 13:02:21 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-2266a742-12df-4a49-be4b-40267716a29f tempest-SharesNegativeTest-322550032 tempest-SharesNegativeTest-322550032-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share_type": {"name": "tempest-typeshare-type-503589991", "extra_specs": {"driver_handles_share_servers": "False", "snapshot_support": true}, "share_type_access:is_public": true}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:02:21 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-2266a742-12df-4a49-be4b-40267716a29f tempest-SharesNegativeTest-322550032 tempest-SharesNegativeTest-322550032-project-admin] http://10.27.203.238/share/v2/adcbdea5704e4efc898c24b2b0a492a5/types returned with HTTP 200 May 28 13:02:21 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1240/2457] 10.27.203.238 () {66 vars in 1359 bytes} [Tue May 28 13:02:20 2024] POST /share/v2/adcbdea5704e4efc898c24b2b0a492a5/types => generated 677 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:02:21 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c99569f-47cb-49a3-88ce-5edfe8475fdc tempest-SharesNegativeTest-322550032 tempest-SharesNegativeTest-322550032-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:21 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-1c99569f-47cb-49a3-88ce-5edfe8475fdc tempest-SharesNegativeTest-322550032 tempest-SharesNegativeTest-322550032-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:02:21 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c99569f-47cb-49a3-88ce-5edfe8475fdc tempest-SharesNegativeTest-322550032 tempest-SharesNegativeTest-322550032-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:21 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437261c2-2f85-4b88-8b63-df16418104ad service manila] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f110cf6300f049c897d0aab63218d1e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:21 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437261c2-2f85-4b88-8b63-df16418104ad service manila] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:21 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437261c2-2f85-4b88-8b63-df16418104ad service manila] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:21 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437261c2-2f85-4b88-8b63-df16418104ad service manila] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:21 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-437261c2-2f85-4b88-8b63-df16418104ad service manila] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:02:21 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437261c2-2f85-4b88-8b63-df16418104ad service manila] RBAC: Authorizing `identity:validate_token()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:21 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437261c2-2f85-4b88-8b63-df16418104ad service manila] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:21 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1674/3379] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 13:02:21 2024] GET /identity/v3/auth/tokens => generated 3946 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 13:02:21 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-2534ea41-3b4a-4f36-933f-88120c8884bd tempest-SharesNegativeTest-1014773059 tempest-SharesNegativeTest-1014773059-project-member] POST http://10.27.203.238/share/v2/d1d71dc9f23c4c6a8e146d99ad65ebb2/shares May 28 13:02:21 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-2534ea41-3b4a-4f36-933f-88120c8884bd tempest-SharesNegativeTest-1014773059 tempest-SharesNegativeTest-1014773059-project-member] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share": {"share_proto": "nfs", "description": "Tempest's share", "snapshot_id": null, "name": "tempest-tempest-created-share-248186399", "size": 1, "metadata": {}, "is_public": false, "share_type": "1dad7e5a-3224-4d69-bbdc-00db9760f3aa"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:02:21 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.v1.shares [None req-2534ea41-3b4a-4f36-933f-88120c8884bd tempest-SharesNegativeTest-1014773059 tempest-SharesNegativeTest-1014773059-project-member] Create NFS share of 1 GB May 28 13:02:21 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.quota [None req-2534ea41-3b4a-4f36-933f-88120c8884bd tempest-SharesNegativeTest-1014773059 tempest-SharesNegativeTest-1014773059-project-member] Created reservations ['64e3b2b5-7612-4bfb-a031-cf702e332968', 'dbf998dc-d2f8-4603-b6ec-f9af427d904f', '6fac26f1-69b1-40f3-9d0b-e7060fc11de2', 'a3633ed4-79fb-4805-bddb-0d41a0e9f44f'] {{(pid=98330) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 13:02:21 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.quota [None req-2534ea41-3b4a-4f36-933f-88120c8884bd tempest-SharesNegativeTest-1014773059 tempest-SharesNegativeTest-1014773059-project-member] Committed reservations ['64e3b2b5-7612-4bfb-a031-cf702e332968', 'dbf998dc-d2f8-4603-b6ec-f9af427d904f', '6fac26f1-69b1-40f3-9d0b-e7060fc11de2', 'a3633ed4-79fb-4805-bddb-0d41a0e9f44f'] {{(pid=98330) commit /opt/stack/manila/manila/quota.py:1063}} May 28 13:02:21 l75lg1-v1 dstat.sh[49771]: 28-05 13:02:21| 14 1 81 2 0|5642M 1783M 278M 7921M| 13k 4940B| 0 2692k| 0 377 |9279 16k|1.14 1.16 1.06|2.0 1.0 0| 0 0 | 0 2048M| 29 364 0 38 2 May 28 13:02:21 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.host_manager [None req-2534ea41-3b4a-4f36-933f-88120c8884bd tempest-SharesNegativeTest-1014773059 None] Share service is down. (host: l75lg1-v1@generic2). May 28 13:02:21 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.host_manager [None req-2534ea41-3b4a-4f36-933f-88120c8884bd tempest-SharesNegativeTest-1014773059 None] Share service is down. (host: l75lg1-v1@generic1). May 28 13:02:21 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-2534ea41-3b4a-4f36-933f-88120c8884bd tempest-SharesNegativeTest-1014773059 None] Starting with 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:80}} May 28 13:02:21 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-2534ea41-3b4a-4f36-933f-88120c8884bd tempest-SharesNegativeTest-1014773059 None] Filter OnlyHostFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:02:21 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-2534ea41-3b4a-4f36-933f-88120c8884bd tempest-SharesNegativeTest-1014773059 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:02:21 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.capacity [None req-2534ea41-3b4a-4f36-933f-88120c8884bd tempest-SharesNegativeTest-1014773059 None] Space information for share creation on host l75lg1-v1@vast#vast (requested / avail): 1/2080 {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/capacity.py:83}} May 28 13:02:21 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-2534ea41-3b4a-4f36-933f-88120c8884bd tempest-SharesNegativeTest-1014773059 None] Filter CapacityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:02:21 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-2534ea41-3b4a-4f36-933f-88120c8884bd tempest-SharesNegativeTest-1014773059 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:02:21 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-2534ea41-3b4a-4f36-933f-88120c8884bd tempest-SharesNegativeTest-1014773059 None] Driver Filter: Checking host 'l75lg1-v1@vast#vast' {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:37}} May 28 13:02:21 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-2534ea41-3b4a-4f36-933f-88120c8884bd tempest-SharesNegativeTest-1014773059 None] Filter function not set :: passing host. {{(pid=98327) _check_filter_function /opt/stack/manila/manila/scheduler/filters/driver.py:53}} May 28 13:02:21 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-2534ea41-3b4a-4f36-933f-88120c8884bd tempest-SharesNegativeTest-1014773059 None] Result: True {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:40}} May 28 13:02:21 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-2534ea41-3b4a-4f36-933f-88120c8884bd tempest-SharesNegativeTest-1014773059 None] Done checking host 'l75lg1-v1@vast#vast' {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:41}} May 28 13:02:21 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-2534ea41-3b4a-4f36-933f-88120c8884bd tempest-SharesNegativeTest-1014773059 None] Filter DriverFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:02:21 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-2534ea41-3b4a-4f36-933f-88120c8884bd tempest-SharesNegativeTest-1014773059 None] Filter ShareReplicationFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:02:21 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-2534ea41-3b4a-4f36-933f-88120c8884bd tempest-SharesNegativeTest-1014773059 None] Filter CreateFromSnapshotFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:02:21 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-2534ea41-3b4a-4f36-933f-88120c8884bd tempest-SharesNegativeTest-1014773059 tempest-SharesNegativeTest-1014773059-project-member] http://10.27.203.238/share/v2/d1d71dc9f23c4c6a8e146d99ad65ebb2/shares returned with HTTP 200 May 28 13:02:21 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-2534ea41-3b4a-4f36-933f-88120c8884bd tempest-SharesNegativeTest-1014773059 None] Filter AffinityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:02:21 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1218/2458] 10.27.203.238 () {66 vars in 1362 bytes} [Tue May 28 13:02:21 2024] POST /share/v2/d1d71dc9f23c4c6a8e146d99ad65ebb2/shares => generated 1310 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:02:21 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-2534ea41-3b4a-4f36-933f-88120c8884bd tempest-SharesNegativeTest-1014773059 None] Filter AntiAffinityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:02:21 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.drivers.filter [None req-2534ea41-3b4a-4f36-933f-88120c8884bd tempest-SharesNegativeTest-1014773059 None] Filtered share [host: 'l75lg1-v1@vast#vast', free_capacity_gb: 2080.605696829967, pools: None] {{(pid=98327) _schedule_share /opt/stack/manila/manila/scheduler/drivers/filter.py:268}} May 28 13:02:21 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-2534ea41-3b4a-4f36-933f-88120c8884bd tempest-SharesNegativeTest-1014773059 None] Checking host 'l75lg1-v1@vast#vast' {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:46}} May 28 13:02:21 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.weighers.goodness [None req-2534ea41-3b4a-4f36-933f-88120c8884bd tempest-SharesNegativeTest-1014773059 None] Goodness function not set :: defaulting to minimal goodness rating of 0. May 28 13:02:21 l75lg1-v1 manila-scheduler[98327]: INFO manila.scheduler.weighers.goodness [None req-2534ea41-3b4a-4f36-933f-88120c8884bd tempest-SharesNegativeTest-1014773059 None] Goodness function result for host l75lg1-v1@vast#vast: 0. May 28 13:02:21 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-2534ea41-3b4a-4f36-933f-88120c8884bd tempest-SharesNegativeTest-1014773059 None] Goodness: 0 {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:48}} May 28 13:02:21 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-2534ea41-3b4a-4f36-933f-88120c8884bd tempest-SharesNegativeTest-1014773059 None] Done checking host 'l75lg1-v1@vast#vast' {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:49}} May 28 13:02:21 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.drivers.filter [None req-2534ea41-3b4a-4f36-933f-88120c8884bd tempest-SharesNegativeTest-1014773059 None] Choosing for share: WeighedHost [host: l75lg1-v1@vast#vast, weight: 0.0] {{(pid=98327) _schedule_share /opt/stack/manila/manila/scheduler/drivers/filter.py:274}} May 28 13:02:21 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-5d6246a7-5a8a-4613-becc-80d7b0b90677 tempest-SharesNegativeTest-1014773059 tempest-SharesNegativeTest-1014773059-project-member] GET http://10.27.203.238/share/v2/d1d71dc9f23c4c6a8e146d99ad65ebb2/shares/b05a8999-f1ac-4887-a675-3c2ca8e9cece May 28 13:02:21 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-5d6246a7-5a8a-4613-becc-80d7b0b90677 tempest-SharesNegativeTest-1014773059 tempest-SharesNegativeTest-1014773059-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:02:21 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-5d6246a7-5a8a-4613-becc-80d7b0b90677 tempest-SharesNegativeTest-1014773059 tempest-SharesNegativeTest-1014773059-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:02:21 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ff25f21e-23a0-4894-a240-f4b3f1647793 tempest-ShareRulesTest-1530341375 None] <<< [GET] https://127.0.0.1:40443/api/views/ May 28 13:02:21 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ff25f21e-23a0-4894-a240-f4b3f1647793 tempest-ShareRulesTest-1530341375 None] [Bunch(abac_tags=[], abe_max_depth=None, abe_protocols=[], alias='', allow_anonymous_access=False, allow_s3_anonymous_access=False, auto_commit='0d', bucket='', bucket_creators=[], bucket_creators_groups=[], bucket_owner=None, bulk_permission_update_progress=None, bulk_permission_update_state=None, cluster='loop75-kfs', cluster_id=1, created='2024-05-28T12:59:56.829066Z', enabled=True, files_retention_mode='NONE', guid='0cdeeb19-099f-47c9-896b-f45929d9cc4f', id=37, ignore_oos=False, internal=False, is_remote=False, is_seamless=False, logical_capacity=0, max_retention_period='0d', min_retention_period='0d', name='f7e47502-a0f7-44de-953d-b7b5697ae0b2', nfs_interop_flags='BOTH_NFS3_AND_NFS4_INTEROP_DISABLED', path='/manila/manila-f7e47502-a0f7-44de-953d-b7b5697ae0b2', physical_capacity=0, policy='f7e47502-a0f7-44de-953d-b7b5697ae0b2', policy_id=38, protocols=['NFS'], qos_policy=None, qos_policy_id=None, s3_locks=False, s3_locks_retention_mode='NONE', s3_locks_retention_period='', s3_unverified_lookup=False, s3_versioning=False, select_for_live_monitoring=False, share='', share_acl=Bunch(acl=[], enabled=False), sync='SYNCED', sync_time='2024-05-28T13:02:08.568717Z', tenant_id=1, tenant_name='default', title='/manila/manila-f7e47502-a0f7-44de-953d-b7b5697ae0b2', url='https://127.0.0.1:40443/api/views/37/')] May 28 13:02:21 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ff25f21e-23a0-4894-a240-f4b3f1647793 tempest-ShareRulesTest-1530341375 None] --- [GET] https://127.0.0.1:40443/api/views/: Done May 28 13:02:21 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ff25f21e-23a0-4894-a240-f4b3f1647793 tempest-ShareRulesTest-1530341375 None] >>> [DELETE] https://127.0.0.1:40443/api/views/37/ May 28 13:02:21 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-5d6246a7-5a8a-4613-becc-80d7b0b90677 tempest-SharesNegativeTest-1014773059 tempest-SharesNegativeTest-1014773059-project-member] http://10.27.203.238/share/v2/d1d71dc9f23c4c6a8e146d99ad65ebb2/shares/b05a8999-f1ac-4887-a675-3c2ca8e9cece returned with HTTP 200 May 28 13:02:21 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1241/2459] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:02:21 2024] GET /share/v2/d1d71dc9f23c4c6a8e146d99ad65ebb2/shares/b05a8999-f1ac-4887-a675-3c2ca8e9cece => generated 1310 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:02:21 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2534ea41-3b4a-4f36-933f-88120c8884bd tempest-SharesNegativeTest-1014773059 None] >>> [GET] https://127.0.0.1:40443/api/vippools/ May 28 13:02:21 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2534ea41-3b4a-4f36-933f-88120c8884bd tempest-SharesNegativeTest-1014773059 None] {'allow_redirects': True, 'params': {'name': 'vippool-1'}} May 28 13:02:21 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-71b7d736-8b1c-4003-af4c-04a3ecba2811 tempest-ShareSnapshotMetadataNegativeTest-1199544441 tempest-ShareSnapshotMetadataNegativeTest-1199544441-project-member] GET http://10.27.203.238/share/v2/b00df7df3db14cce99343fc7f6ffd796/snapshots/36312f3e-0719-4e74-b65e-57fb01533bab May 28 13:02:21 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-71b7d736-8b1c-4003-af4c-04a3ecba2811 tempest-ShareSnapshotMetadataNegativeTest-1199544441 tempest-ShareSnapshotMetadataNegativeTest-1199544441-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:02:21 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-71b7d736-8b1c-4003-af4c-04a3ecba2811 tempest-ShareSnapshotMetadataNegativeTest-1199544441 tempest-ShareSnapshotMetadataNegativeTest-1199544441-project-member] Calling method 'ShareSnapshotMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:02:22 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2534ea41-3b4a-4f36-933f-88120c8884bd tempest-SharesNegativeTest-1014773059 None] <<< [GET] https://127.0.0.1:40443/api/vippools/ May 28 13:02:22 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2534ea41-3b4a-4f36-933f-88120c8884bd tempest-SharesNegativeTest-1014773059 None] [Bunch(active_cnode_ids=[], active_interfaces=4, cluster='loop75-kfs', cluster_id=1, cnode_ids=[], cnodes=[], domain_name='vippool-1', enable_l3=False, enable_weighted_balancing=False, enabled=True, end_ip='172.21.75.4', guid='f2abaede-b397-413a-8faa-3aeead6d3b28', gw_ip='', gw_ipv6='', id=2, ip_ranges=[['172.21.75.1', '172.21.75.4']], name='vippool-1', peer_asn=0, port_membership='ALL', ranges_summary='172.21.75.[1-4]', role='PROTOCOLS', start_ip='172.21.75.1', subnet_cidr=16, subnet_cidr_ipv6=None, sync='SYNCED', sync_time='2024-05-28T12:50:09.644123Z', tenant_id=1, tenant_name='default', title='172.21.75.1 - 172.21.75.4', url='https://127.0.0.1:40443/api/vippools/2/', vast_asn=0, vlan=0, vms_preferred=False)] May 28 13:02:22 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2534ea41-3b4a-4f36-933f-88120c8884bd tempest-SharesNegativeTest-1014773059 None] --- [GET] https://127.0.0.1:40443/api/vippools/: Done May 28 13:02:22 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2534ea41-3b4a-4f36-933f-88120c8884bd tempest-SharesNegativeTest-1014773059 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:02:22 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2534ea41-3b4a-4f36-933f-88120c8884bd tempest-SharesNegativeTest-1014773059 None] {'allow_redirects': True, May 28 13:02:22 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2534ea41-3b4a-4f36-933f-88120c8884bd tempest-SharesNegativeTest-1014773059 None] 'params': {'name': '27c3f247-5cdb-4bb3-9479-7b3253f9df42'}} May 28 13:02:22 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-71b7d736-8b1c-4003-af4c-04a3ecba2811 tempest-ShareSnapshotMetadataNegativeTest-1199544441 tempest-ShareSnapshotMetadataNegativeTest-1199544441-project-member] HTTP exception thrown: The resource could not be found. May 28 13:02:22 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-71b7d736-8b1c-4003-af4c-04a3ecba2811 tempest-ShareSnapshotMetadataNegativeTest-1199544441 tempest-ShareSnapshotMetadataNegativeTest-1199544441-project-member] http://10.27.203.238/share/v2/b00df7df3db14cce99343fc7f6ffd796/snapshots/36312f3e-0719-4e74-b65e-57fb01533bab returned with HTTP 404 May 28 13:02:22 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1219/2460] 10.27.203.238 () {64 vars in 1460 bytes} [Tue May 28 13:02:21 2024] GET /share/v2/b00df7df3db14cce99343fc7f6ffd796/snapshots/36312f3e-0719-4e74-b65e-57fb01533bab => generated 78 bytes in 236 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 13:02:22 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-0319afd8-e54d-476f-9cc8-5c4799e7e73a tempest-ShareSnapshotMetadataNegativeTest-1199544441 tempest-ShareSnapshotMetadataNegativeTest-1199544441-project-member] GET http://10.27.203.238/share/v2/b00df7df3db14cce99343fc7f6ffd796/share-replicas/detail?share_id=1f5b6f0f-f341-4964-a2fa-9c4a26198f95 May 28 13:02:22 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-0319afd8-e54d-476f-9cc8-5c4799e7e73a tempest-ShareSnapshotMetadataNegativeTest-1199544441 tempest-ShareSnapshotMetadataNegativeTest-1199544441-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:02:22 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-0319afd8-e54d-476f-9cc8-5c4799e7e73a tempest-ShareSnapshotMetadataNegativeTest-1199544441 tempest-ShareSnapshotMetadataNegativeTest-1199544441-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:02:22 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-0319afd8-e54d-476f-9cc8-5c4799e7e73a tempest-ShareSnapshotMetadataNegativeTest-1199544441 tempest-ShareSnapshotMetadataNegativeTest-1199544441-project-member] http://10.27.203.238/share/v2/b00df7df3db14cce99343fc7f6ffd796/share-replicas/detail?share_id=1f5b6f0f-f341-4964-a2fa-9c4a26198f95 returned with HTTP 200 May 28 13:02:22 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1242/2461] 10.27.203.238 () {64 vars in 1476 bytes} [Tue May 28 13:02:22 2024] GET /share/v2/b00df7df3db14cce99343fc7f6ffd796/share-replicas/detail?share_id=1f5b6f0f-f341-4964-a2fa-9c4a26198f95 => generated 22 bytes in 13 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:02:22 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-8a0cf0b1-beee-4dd4-b33f-336d3231f70d tempest-ShareSnapshotMetadataNegativeTest-1199544441 tempest-ShareSnapshotMetadataNegativeTest-1199544441-project-member] DELETE http://10.27.203.238/share/v2/b00df7df3db14cce99343fc7f6ffd796/shares/1f5b6f0f-f341-4964-a2fa-9c4a26198f95 May 28 13:02:22 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-8a0cf0b1-beee-4dd4-b33f-336d3231f70d tempest-ShareSnapshotMetadataNegativeTest-1199544441 tempest-ShareSnapshotMetadataNegativeTest-1199544441-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:02:22 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-8a0cf0b1-beee-4dd4-b33f-336d3231f70d tempest-ShareSnapshotMetadataNegativeTest-1199544441 tempest-ShareSnapshotMetadataNegativeTest-1199544441-project-member] Calling method 'ShareMixin.delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:02:22 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.v1.shares [None req-8a0cf0b1-beee-4dd4-b33f-336d3231f70d tempest-ShareSnapshotMetadataNegativeTest-1199544441 tempest-ShareSnapshotMetadataNegativeTest-1199544441-project-member] Delete share with id: 1f5b6f0f-f341-4964-a2fa-9c4a26198f95 May 28 13:02:22 l75lg1-v1 dstat.sh[49771]: 28-05 13:02:22| 6 0 89 4 0|5643M 1782M 278M 7921M| 18k 1962B| 0 6088k| 0 470 |4318 6872 |1.13 1.16 1.06|2.0 1.0 0| 0 0 | 0 2048M| 29 364 0 34 2 May 28 13:02:22 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2534ea41-3b4a-4f36-933f-88120c8884bd tempest-SharesNegativeTest-1014773059 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:02:22 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2534ea41-3b4a-4f36-933f-88120c8884bd tempest-SharesNegativeTest-1014773059 None] [] May 28 13:02:22 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2534ea41-3b4a-4f36-933f-88120c8884bd tempest-SharesNegativeTest-1014773059 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 13:02:22 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2534ea41-3b4a-4f36-933f-88120c8884bd tempest-SharesNegativeTest-1014773059 None] >>> [POST] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:02:22 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2534ea41-3b4a-4f36-933f-88120c8884bd tempest-SharesNegativeTest-1014773059 None] {'data': '{"name": "27c3f247-5cdb-4bb3-9479-7b3253f9df42"}', May 28 13:02:22 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2534ea41-3b4a-4f36-933f-88120c8884bd tempest-SharesNegativeTest-1014773059 None] 'json': None, May 28 13:02:22 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2534ea41-3b4a-4f36-933f-88120c8884bd tempest-SharesNegativeTest-1014773059 None] 'params': None} May 28 13:02:22 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-8a0cf0b1-beee-4dd4-b33f-336d3231f70d tempest-ShareSnapshotMetadataNegativeTest-1199544441 tempest-ShareSnapshotMetadataNegativeTest-1199544441-project-member] http://10.27.203.238/share/v2/b00df7df3db14cce99343fc7f6ffd796/shares/1f5b6f0f-f341-4964-a2fa-9c4a26198f95 returned with HTTP 202 May 28 13:02:22 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1220/2462] 10.27.203.238 () {64 vars in 1454 bytes} [Tue May 28 13:02:22 2024] DELETE /share/v2/b00df7df3db14cce99343fc7f6ffd796/shares/1f5b6f0f-f341-4964-a2fa-9c4a26198f95 => generated 0 bytes in 135 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 13:02:22 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-8b024465-c0f1-4bf2-a4b0-3e4599749bc4 tempest-ShareSnapshotMetadataNegativeTest-1199544441 tempest-ShareSnapshotMetadataNegativeTest-1199544441-project-member] GET http://10.27.203.238/share/v2/b00df7df3db14cce99343fc7f6ffd796/shares/1f5b6f0f-f341-4964-a2fa-9c4a26198f95 May 28 13:02:22 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-8b024465-c0f1-4bf2-a4b0-3e4599749bc4 tempest-ShareSnapshotMetadataNegativeTest-1199544441 tempest-ShareSnapshotMetadataNegativeTest-1199544441-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:02:22 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-8b024465-c0f1-4bf2-a4b0-3e4599749bc4 tempest-ShareSnapshotMetadataNegativeTest-1199544441 tempest-ShareSnapshotMetadataNegativeTest-1199544441-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:02:22 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-8b024465-c0f1-4bf2-a4b0-3e4599749bc4 tempest-ShareSnapshotMetadataNegativeTest-1199544441 tempest-ShareSnapshotMetadataNegativeTest-1199544441-project-member] http://10.27.203.238/share/v2/b00df7df3db14cce99343fc7f6ffd796/shares/1f5b6f0f-f341-4964-a2fa-9c4a26198f95 returned with HTTP 200 May 28 13:02:22 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1243/2463] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:02:22 2024] GET /share/v2/b00df7df3db14cce99343fc7f6ffd796/shares/1f5b6f0f-f341-4964-a2fa-9c4a26198f95 => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:02:22 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-8a0cf0b1-beee-4dd4-b33f-336d3231f70d tempest-ShareSnapshotMetadataNegativeTest-1199544441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f49db035-ea92-4df4-9284-1e5ce7e3fd79" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:02:22 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-8a0cf0b1-beee-4dd4-b33f-336d3231f70d tempest-ShareSnapshotMetadataNegativeTest-1199544441 None] Lock "locked_access_rules_operation_by_share_instance_f49db035-ea92-4df4-9284-1e5ce7e3fd79" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:02:22 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-8a0cf0b1-beee-4dd4-b33f-336d3231f70d tempest-ShareSnapshotMetadataNegativeTest-1199544441 None] Lock "locked_access_rules_operation_by_share_instance_f49db035-ea92-4df4-9284-1e5ce7e3fd79" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.007s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:02:22 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-8a0cf0b1-beee-4dd4-b33f-336d3231f70d tempest-ShareSnapshotMetadataNegativeTest-1199544441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f49db035-ea92-4df4-9284-1e5ce7e3fd79" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:02:22 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-8a0cf0b1-beee-4dd4-b33f-336d3231f70d tempest-ShareSnapshotMetadataNegativeTest-1199544441 None] Lock "locked_access_rules_operation_by_share_instance_f49db035-ea92-4df4-9284-1e5ce7e3fd79" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:02:22 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-8a0cf0b1-beee-4dd4-b33f-336d3231f70d tempest-ShareSnapshotMetadataNegativeTest-1199544441 None] Lock "locked_access_rules_operation_by_share_instance_f49db035-ea92-4df4-9284-1e5ce7e3fd79" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:02:22 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-8a0cf0b1-beee-4dd4-b33f-336d3231f70d tempest-ShareSnapshotMetadataNegativeTest-1199544441 None] Acquiring lock "locked_access_rules_operation_by_share_instance_f49db035-ea92-4df4-9284-1e5ce7e3fd79" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:02:22 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-8a0cf0b1-beee-4dd4-b33f-336d3231f70d tempest-ShareSnapshotMetadataNegativeTest-1199544441 None] Lock "locked_access_rules_operation_by_share_instance_f49db035-ea92-4df4-9284-1e5ce7e3fd79" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:02:22 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-8a0cf0b1-beee-4dd4-b33f-336d3231f70d tempest-ShareSnapshotMetadataNegativeTest-1199544441 None] Lock "locked_access_rules_operation_by_share_instance_f49db035-ea92-4df4-9284-1e5ce7e3fd79" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.004s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:02:22 l75lg1-v1 manila-share[98474]: DEBUG manila.share.access [None req-8a0cf0b1-beee-4dd4-b33f-336d3231f70d tempest-ShareSnapshotMetadataNegativeTest-1199544441 None] All access rules have been synced for share instance f49db035-ea92-4df4-9284-1e5ce7e3fd79 belonging to share 1f5b6f0f-f341-4964-a2fa-9c4a26198f95. {{(pid=98474) update_access_rules /opt/stack/manila/manila/share/access.py:304}} May 28 13:02:22 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-8a0cf0b1-beee-4dd4-b33f-336d3231f70d tempest-ShareSnapshotMetadataNegativeTest-1199544441 None] deleting '/manila/manila-f49db035-ea92-4df4-9284-1e5ce7e3fd79' May 28 13:02:22 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8a0cf0b1-beee-4dd4-b33f-336d3231f70d tempest-ShareSnapshotMetadataNegativeTest-1199544441 None] >>> [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/ May 28 13:02:22 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8a0cf0b1-beee-4dd4-b33f-336d3231f70d tempest-ShareSnapshotMetadataNegativeTest-1199544441 None] {'data': '{"path": "/manila/manila-f49db035-ea92-4df4-9284-1e5ce7e3fd79"}', May 28 13:02:22 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8a0cf0b1-beee-4dd4-b33f-336d3231f70d tempest-ShareSnapshotMetadataNegativeTest-1199544441 None] 'params': None} May 28 13:02:22 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8a0cf0b1-beee-4dd4-b33f-336d3231f70d tempest-ShareSnapshotMetadataNegativeTest-1199544441 None] <<< [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/ May 28 13:02:22 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8a0cf0b1-beee-4dd4-b33f-336d3231f70d tempest-ShareSnapshotMetadataNegativeTest-1199544441 None] 'OK' May 28 13:02:22 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8a0cf0b1-beee-4dd4-b33f-336d3231f70d tempest-ShareSnapshotMetadataNegativeTest-1199544441 None] --- [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/: Done May 28 13:02:22 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8a0cf0b1-beee-4dd4-b33f-336d3231f70d tempest-ShareSnapshotMetadataNegativeTest-1199544441 None] >>> [GET] https://127.0.0.1:40443/api/views/ May 28 13:02:22 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8a0cf0b1-beee-4dd4-b33f-336d3231f70d tempest-ShareSnapshotMetadataNegativeTest-1199544441 None] {'allow_redirects': True, May 28 13:02:22 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8a0cf0b1-beee-4dd4-b33f-336d3231f70d tempest-ShareSnapshotMetadataNegativeTest-1199544441 None] 'params': {'name': 'f49db035-ea92-4df4-9284-1e5ce7e3fd79'}} May 28 13:02:23 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ff25f21e-23a0-4894-a240-f4b3f1647793 tempest-ShareRulesTest-1530341375 None] <<< [DELETE] https://127.0.0.1:40443/api/views/37/ May 28 13:02:23 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ff25f21e-23a0-4894-a240-f4b3f1647793 tempest-ShareRulesTest-1530341375 None] --- [DELETE] https://127.0.0.1:40443/api/views/37/: Done May 28 13:02:23 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ff25f21e-23a0-4894-a240-f4b3f1647793 tempest-ShareRulesTest-1530341375 None] >>> [GET] https://127.0.0.1:40443/api/quotas/ May 28 13:02:23 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ff25f21e-23a0-4894-a240-f4b3f1647793 tempest-ShareRulesTest-1530341375 None] {'allow_redirects': True, May 28 13:02:23 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ff25f21e-23a0-4894-a240-f4b3f1647793 tempest-ShareRulesTest-1530341375 None] 'params': {'name': 'f7e47502-a0f7-44de-953d-b7b5697ae0b2'}} May 28 13:02:23 l75lg1-v1 dstat.sh[49771]: 28-05 13:02:23| 2 0 96 1 0|5642M 1782M 278M 7921M| 25k 2918B| 0 728k| 0 62.0 |2690 4207 |1.13 1.16 1.06|1.0 1.0 0| 0 0 | 0 2048M| 29 363 0 34 2 May 28 13:02:23 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2534ea41-3b4a-4f36-933f-88120c8884bd tempest-SharesNegativeTest-1014773059 None] <<< [POST] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:02:23 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2534ea41-3b4a-4f36-933f-88120c8884bd tempest-SharesNegativeTest-1014773059 None] Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=0, created='2024-05-28T13:02:22.864749Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='cdad681d-e016-4f58-acf8-b1db8417ffd7', id=57, internal=False, is_s3_default_policy=False, name='27c3f247-5cdb-4bb3-9479-7b3253f9df42', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=[], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['*'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['*'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T13:02:23.196386Z', tenant_id=1, tenant_name='default', title='27c3f247-5cdb-4bb3-9479-7b3253f9df42', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/57/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[]) May 28 13:02:23 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2534ea41-3b4a-4f36-933f-88120c8884bd tempest-SharesNegativeTest-1014773059 None] --- [POST] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 13:02:23 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2534ea41-3b4a-4f36-933f-88120c8884bd tempest-SharesNegativeTest-1014773059 None] >>> [GET] https://127.0.0.1:40443/api/quotas/ May 28 13:02:23 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2534ea41-3b4a-4f36-933f-88120c8884bd tempest-SharesNegativeTest-1014773059 None] {'allow_redirects': True, May 28 13:02:23 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2534ea41-3b4a-4f36-933f-88120c8884bd tempest-SharesNegativeTest-1014773059 None] 'params': {'name': '27c3f247-5cdb-4bb3-9479-7b3253f9df42'}} May 28 13:02:23 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8a0cf0b1-beee-4dd4-b33f-336d3231f70d tempest-ShareSnapshotMetadataNegativeTest-1199544441 None] <<< [GET] https://127.0.0.1:40443/api/views/ May 28 13:02:23 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8a0cf0b1-beee-4dd4-b33f-336d3231f70d tempest-ShareSnapshotMetadataNegativeTest-1199544441 None] [Bunch(abac_tags=[], abe_max_depth=None, abe_protocols=[], alias='', allow_anonymous_access=False, allow_s3_anonymous_access=False, auto_commit='0d', bucket='', bucket_creators=[], bucket_creators_groups=[], bucket_owner=None, bulk_permission_update_progress=None, bulk_permission_update_state=None, cluster='loop75-kfs', cluster_id=1, created='2024-05-28T13:02:13.325126Z', enabled=True, files_retention_mode='NONE', guid='62b7e952-df39-4d07-8bcd-ef583d85cf5b', id=55, ignore_oos=False, internal=False, is_remote=False, is_seamless=False, logical_capacity=0, max_retention_period=None, min_retention_period=None, name='f49db035-ea92-4df4-9284-1e5ce7e3fd79', nfs_interop_flags='BOTH_NFS3_AND_NFS4_INTEROP_DISABLED', path='/manila/manila-f49db035-ea92-4df4-9284-1e5ce7e3fd79', physical_capacity=0, policy='f49db035-ea92-4df4-9284-1e5ce7e3fd79', policy_id=56, protocols=['NFS'], qos_policy=None, qos_policy_id=None, s3_locks=False, s3_locks_retention_mode='NONE', s3_locks_retention_period='', s3_unverified_lookup=False, s3_versioning=False, select_for_live_monitoring=False, share='', share_acl=Bunch(acl=[], enabled=False), sync='SYNCED', sync_time='2024-05-28T13:02:13.596644Z', tenant_id=1, tenant_name='default', title='/manila/manila-f49db035-ea92-4df4-9284-1e5ce7e3fd79', url='https://127.0.0.1:40443/api/views/55/')] May 28 13:02:23 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8a0cf0b1-beee-4dd4-b33f-336d3231f70d tempest-ShareSnapshotMetadataNegativeTest-1199544441 None] --- [GET] https://127.0.0.1:40443/api/views/: Done May 28 13:02:23 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8a0cf0b1-beee-4dd4-b33f-336d3231f70d tempest-ShareSnapshotMetadataNegativeTest-1199544441 None] >>> [DELETE] https://127.0.0.1:40443/api/views/55/ May 28 13:02:23 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2534ea41-3b4a-4f36-933f-88120c8884bd tempest-SharesNegativeTest-1014773059 None] <<< [GET] https://127.0.0.1:40443/api/quotas/ May 28 13:02:23 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2534ea41-3b4a-4f36-933f-88120c8884bd tempest-SharesNegativeTest-1014773059 None] [] May 28 13:02:23 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2534ea41-3b4a-4f36-933f-88120c8884bd tempest-SharesNegativeTest-1014773059 None] --- [GET] https://127.0.0.1:40443/api/quotas/: Done May 28 13:02:23 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2534ea41-3b4a-4f36-933f-88120c8884bd tempest-SharesNegativeTest-1014773059 None] >>> [POST] https://127.0.0.1:40443/api/quotas/ May 28 13:02:23 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2534ea41-3b4a-4f36-933f-88120c8884bd tempest-SharesNegativeTest-1014773059 None] {'data': '{"name": "27c3f247-5cdb-4bb3-9479-7b3253f9df42", "path": ' May 28 13:02:23 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2534ea41-3b4a-4f36-933f-88120c8884bd tempest-SharesNegativeTest-1014773059 None] '"/manila/manila-27c3f247-5cdb-4bb3-9479-7b3253f9df42", "create_dir": ' May 28 13:02:23 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2534ea41-3b4a-4f36-933f-88120c8884bd tempest-SharesNegativeTest-1014773059 None] 'true, "hard_limit": 1073741824}', May 28 13:02:23 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2534ea41-3b4a-4f36-933f-88120c8884bd tempest-SharesNegativeTest-1014773059 None] 'json': None, May 28 13:02:23 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2534ea41-3b4a-4f36-933f-88120c8884bd tempest-SharesNegativeTest-1014773059 None] 'params': None} May 28 13:02:23 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-7397380d-2139-4a18-af34-39ac544d83d7 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] GET http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/shares/b330db31-7766-443d-9c19-26fe349665aa May 28 13:02:23 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-7397380d-2139-4a18-af34-39ac544d83d7 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:02:23 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-7397380d-2139-4a18-af34-39ac544d83d7 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:02:23 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-7397380d-2139-4a18-af34-39ac544d83d7 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/shares/b330db31-7766-443d-9c19-26fe349665aa returned with HTTP 200 May 28 13:02:23 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1221/2464] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:02:23 2024] GET /share/v2/a4f3887fa28c457390f5b66615564430/shares/b330db31-7766-443d-9c19-26fe349665aa => generated 1315 bytes in 24 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:02:23 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ff25f21e-23a0-4894-a240-f4b3f1647793 tempest-ShareRulesTest-1530341375 None] <<< [GET] https://127.0.0.1:40443/api/quotas/ May 28 13:02:23 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ff25f21e-23a0-4894-a240-f4b3f1647793 tempest-ShareRulesTest-1530341375 None] [Bunch(cluster='loop75-kfs', cluster_id=1, default_email=None, default_group_quota=None, default_user_quota=None, enable_alarms=True, enable_email_providers=True, grace_period=None, guid='c6775eb2-8344-4d82-bcab-9184e22461fd', hard_limit=1073741824, hard_limit_inodes=None, id=35, internal=False, is_user_quota=False, last_user_quotas_update=None, name='f7e47502-a0f7-44de-953d-b7b5697ae0b2', num_blocked_users=0, num_exceeded_users=0, path='/manila/manila-f7e47502-a0f7-44de-953d-b7b5697ae0b2', percent_capacity=0, percent_inodes=None, pretty_grace_period=None, pretty_grace_period_expiration=None, pretty_state='OK', soft_limit=None, soft_limit_inodes=None, state='OK', sync_state='SYNCHRONIZED', system_id=35, tenant_id=1, tenant_name='default', time_to_block=None, title='f7e47502-a0f7-44de-953d-b7b5697ae0b2', url='https://127.0.0.1:40443/api/quotas/35/', used_capacity=0, used_capacity_tb=0.0, used_effective_capacity=0, used_effective_capacity_tb=0.0, used_inodes=1, used_limited_capacity=0)] May 28 13:02:23 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ff25f21e-23a0-4894-a240-f4b3f1647793 tempest-ShareRulesTest-1530341375 None] --- [GET] https://127.0.0.1:40443/api/quotas/: Done May 28 13:02:23 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ff25f21e-23a0-4894-a240-f4b3f1647793 tempest-ShareRulesTest-1530341375 None] >>> [DELETE] https://127.0.0.1:40443/api/quotas/35/ May 28 13:02:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "_check_child_processes" by "neutron.agent.linux.external_process.ProcessMonitor._check_child_processes" {{(pid=76818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:02:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_concurrency.lockutils [-] Lock "_check_child_processes" acquired by "neutron.agent.linux.external_process.ProcessMonitor._check_child_processes" :: waited 0.000s {{(pid=76818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:02:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_concurrency.lockutils [-] Lock "_check_child_processes" "released" by "neutron.agent.linux.external_process.ProcessMonitor._check_child_processes" :: held 0.001s {{(pid=76818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:02:24 l75lg1-v1 dstat.sh[49771]: 28-05 13:02:24| 1 0 98 0 0|5643M 1782M 278M 7921M| 16k 2866B| 0 408k| 0 31.0 |1821 2800 |1.13 1.16 1.06|2.0 0 0| 0 0 | 0 2048M| 29 363 0 34 2 May 28 13:02:24 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2534ea41-3b4a-4f36-933f-88120c8884bd tempest-SharesNegativeTest-1014773059 None] <<< [POST] https://127.0.0.1:40443/api/quotas/ May 28 13:02:24 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2534ea41-3b4a-4f36-933f-88120c8884bd tempest-SharesNegativeTest-1014773059 None] Bunch(cluster='loop75-kfs', cluster_id=1, default_email=None, default_group_quota=None, default_user_quota=None, enable_alarms=True, enable_email_providers=True, grace_period=None, group_quotas=[], guid='50667d66-b8eb-4a97-8db4-2611f79486c0', hard_limit=1073741824, hard_limit_inodes=None, id=54, internal=False, is_user_quota=False, last_user_quotas_update=None, name='27c3f247-5cdb-4bb3-9479-7b3253f9df42', num_blocked_users=0, num_exceeded_users=0, path='/manila/manila-27c3f247-5cdb-4bb3-9479-7b3253f9df42', percent_capacity=0, percent_inodes=None, pretty_grace_period=None, pretty_grace_period_expiration=None, pretty_state='OK (CREATED)', soft_limit=None, soft_limit_inodes=None, state='OK', sync_state='CREATED', system_id=54, tenant_id=1, tenant_name='default', time_to_block=None, title='27c3f247-5cdb-4bb3-9479-7b3253f9df42', url='https://127.0.0.1:40443/api/quotas/54/', used_capacity=0, used_capacity_tb=0.0, used_effective_capacity=0, used_effective_capacity_tb=0.0, used_inodes=0, used_limited_capacity=0, user_quotas=[]) May 28 13:02:24 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2534ea41-3b4a-4f36-933f-88120c8884bd tempest-SharesNegativeTest-1014773059 None] --- [POST] https://127.0.0.1:40443/api/quotas/: Done May 28 13:02:24 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2534ea41-3b4a-4f36-933f-88120c8884bd tempest-SharesNegativeTest-1014773059 None] >>> [GET] https://127.0.0.1:40443/api/views/ May 28 13:02:24 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2534ea41-3b4a-4f36-933f-88120c8884bd tempest-SharesNegativeTest-1014773059 None] {'allow_redirects': True, May 28 13:02:24 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2534ea41-3b4a-4f36-933f-88120c8884bd tempest-SharesNegativeTest-1014773059 None] 'params': {'name': '27c3f247-5cdb-4bb3-9479-7b3253f9df42'}} May 28 13:02:24 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-3efb6608-817f-46d4-ab58-2b2d5221d7c4 tempest-SharesNegativeTest-1014773059 tempest-SharesNegativeTest-1014773059-project-member] GET http://10.27.203.238/share/v2/d1d71dc9f23c4c6a8e146d99ad65ebb2/shares/b05a8999-f1ac-4887-a675-3c2ca8e9cece May 28 13:02:24 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-3efb6608-817f-46d4-ab58-2b2d5221d7c4 tempest-SharesNegativeTest-1014773059 tempest-SharesNegativeTest-1014773059-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:02:24 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-3efb6608-817f-46d4-ab58-2b2d5221d7c4 tempest-SharesNegativeTest-1014773059 tempest-SharesNegativeTest-1014773059-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:02:24 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-3efb6608-817f-46d4-ab58-2b2d5221d7c4 tempest-SharesNegativeTest-1014773059 tempest-SharesNegativeTest-1014773059-project-member] http://10.27.203.238/share/v2/d1d71dc9f23c4c6a8e146d99ad65ebb2/shares/b05a8999-f1ac-4887-a675-3c2ca8e9cece returned with HTTP 200 May 28 13:02:24 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1244/2465] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:02:24 2024] GET /share/v2/d1d71dc9f23c4c6a8e146d99ad65ebb2/shares/b05a8999-f1ac-4887-a675-3c2ca8e9cece => generated 1312 bytes in 27 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:02:25 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2534ea41-3b4a-4f36-933f-88120c8884bd tempest-SharesNegativeTest-1014773059 None] <<< [GET] https://127.0.0.1:40443/api/views/ May 28 13:02:25 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2534ea41-3b4a-4f36-933f-88120c8884bd tempest-SharesNegativeTest-1014773059 None] [] May 28 13:02:25 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2534ea41-3b4a-4f36-933f-88120c8884bd tempest-SharesNegativeTest-1014773059 None] --- [GET] https://127.0.0.1:40443/api/views/: Done May 28 13:02:25 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2534ea41-3b4a-4f36-933f-88120c8884bd tempest-SharesNegativeTest-1014773059 None] >>> [POST] https://127.0.0.1:40443/api/views/ May 28 13:02:25 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2534ea41-3b4a-4f36-933f-88120c8884bd tempest-SharesNegativeTest-1014773059 None] {'data': '{"name": "27c3f247-5cdb-4bb3-9479-7b3253f9df42", "path": ' May 28 13:02:25 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2534ea41-3b4a-4f36-933f-88120c8884bd tempest-SharesNegativeTest-1014773059 None] '"/manila/manila-27c3f247-5cdb-4bb3-9479-7b3253f9df42", "policy_id": ' May 28 13:02:25 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2534ea41-3b4a-4f36-933f-88120c8884bd tempest-SharesNegativeTest-1014773059 None] '57, "create_dir": true, "protocols": ["NFS"]}', May 28 13:02:25 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2534ea41-3b4a-4f36-933f-88120c8884bd tempest-SharesNegativeTest-1014773059 None] 'json': None, May 28 13:02:25 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2534ea41-3b4a-4f36-933f-88120c8884bd tempest-SharesNegativeTest-1014773059 None] 'params': None} May 28 13:02:25 l75lg1-v1 dstat.sh[49771]: 28-05 13:02:25| 1 0 98 0 0|5643M 1782M 278M 7921M| 15k 1847B| 0 360k| 0 24.0 |1732 2688 |1.13 1.16 1.06|2.0 0 0| 0 0 | 0 2048M| 29 363 0 34 2 May 28 13:02:25 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-62220d70-62e4-4faa-94f4-75407ed0c40a tempest-ShareSnapshotMetadataNegativeTest-1199544441 tempest-ShareSnapshotMetadataNegativeTest-1199544441-project-member] GET http://10.27.203.238/share/v2/b00df7df3db14cce99343fc7f6ffd796/shares/1f5b6f0f-f341-4964-a2fa-9c4a26198f95 May 28 13:02:25 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-62220d70-62e4-4faa-94f4-75407ed0c40a tempest-ShareSnapshotMetadataNegativeTest-1199544441 tempest-ShareSnapshotMetadataNegativeTest-1199544441-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:02:25 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-62220d70-62e4-4faa-94f4-75407ed0c40a tempest-ShareSnapshotMetadataNegativeTest-1199544441 tempest-ShareSnapshotMetadataNegativeTest-1199544441-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:02:25 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-62220d70-62e4-4faa-94f4-75407ed0c40a tempest-ShareSnapshotMetadataNegativeTest-1199544441 tempest-ShareSnapshotMetadataNegativeTest-1199544441-project-member] http://10.27.203.238/share/v2/b00df7df3db14cce99343fc7f6ffd796/shares/1f5b6f0f-f341-4964-a2fa-9c4a26198f95 returned with HTTP 200 May 28 13:02:25 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1222/2466] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:02:25 2024] GET /share/v2/b00df7df3db14cce99343fc7f6ffd796/shares/1f5b6f0f-f341-4964-a2fa-9c4a26198f95 => generated 1420 bytes in 24 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:02:25 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8a0cf0b1-beee-4dd4-b33f-336d3231f70d tempest-ShareSnapshotMetadataNegativeTest-1199544441 None] <<< [DELETE] https://127.0.0.1:40443/api/views/55/ May 28 13:02:25 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8a0cf0b1-beee-4dd4-b33f-336d3231f70d tempest-ShareSnapshotMetadataNegativeTest-1199544441 None] --- [DELETE] https://127.0.0.1:40443/api/views/55/: Done May 28 13:02:25 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8a0cf0b1-beee-4dd4-b33f-336d3231f70d tempest-ShareSnapshotMetadataNegativeTest-1199544441 None] >>> [GET] https://127.0.0.1:40443/api/quotas/ May 28 13:02:25 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8a0cf0b1-beee-4dd4-b33f-336d3231f70d tempest-ShareSnapshotMetadataNegativeTest-1199544441 None] {'allow_redirects': True, May 28 13:02:25 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8a0cf0b1-beee-4dd4-b33f-336d3231f70d tempest-ShareSnapshotMetadataNegativeTest-1199544441 None] 'params': {'name': 'f49db035-ea92-4df4-9284-1e5ce7e3fd79'}} May 28 13:02:25 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_service.periodic_task [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85846) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 13:02:25 l75lg1-v1 cinder-volume[85846]: DEBUG cinder.volume.drivers.lvm [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] Updating volume stats {{(pid=85846) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}} May 28 13:02:25 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:390}} May 28 13:02:25 l75lg1-v1 sudo[99178]: vastdata : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 May 28 13:02:25 l75lg1-v1 sudo[99178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) May 28 13:02:25 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2534ea41-3b4a-4f36-933f-88120c8884bd tempest-SharesNegativeTest-1014773059 None] <<< [POST] https://127.0.0.1:40443/api/views/ May 28 13:02:25 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2534ea41-3b4a-4f36-933f-88120c8884bd tempest-SharesNegativeTest-1014773059 None] Bunch(abac_tags=[], abe_max_depth=None, abe_protocols=[], alias='', allow_anonymous_access=False, allow_s3_anonymous_access=False, auto_commit='0d', bucket='', bucket_creators=[], bucket_creators_groups=[], bucket_owner=None, bulk_permission_update_progress=None, bulk_permission_update_state=None, cluster='loop75-kfs', cluster_id=1, created='2024-05-28T13:02:25.582311Z', enabled=True, files_retention_mode='NONE', guid='a07b9398-cabb-4d9a-8083-604c973fa2ea', id=56, ignore_oos=False, internal=False, is_remote=False, is_seamless=False, logical_capacity=0, max_retention_period=None, min_retention_period=None, name='27c3f247-5cdb-4bb3-9479-7b3253f9df42', nfs_interop_flags='BOTH_NFS3_AND_NFS4_INTEROP_DISABLED', path='/manila/manila-27c3f247-5cdb-4bb3-9479-7b3253f9df42', physical_capacity=0, policy='27c3f247-5cdb-4bb3-9479-7b3253f9df42', policy_id=57, protocols=['NFS'], qos_policy=None, qos_policy_id=None, s3_locks=False, s3_locks_retention_mode='NONE', s3_locks_retention_period='', s3_object_ownership_rule='ObjectWriter', s3_unverified_lookup=False, s3_versioning=False, select_for_live_monitoring=False, share='', share_acl=Bunch(acl=[], enabled=False), sync='SYNCED', sync_time='2024-05-28T13:02:25.915707Z', tenant_id=1, tenant_name='default', title='/manila/manila-27c3f247-5cdb-4bb3-9479-7b3253f9df42', url='https://127.0.0.1:40443/api/views/56/') May 28 13:02:25 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-2534ea41-3b4a-4f36-933f-88120c8884bd tempest-SharesNegativeTest-1014773059 None] --- [POST] https://127.0.0.1:40443/api/views/: Done May 28 13:02:25 l75lg1-v1 manila-share[98474]: DEBUG dbcounter [-] [98474] Writing DB stats manila:SELECT=2044,manila:UPDATE=187,manila:INSERT=45 {{(pid=98474) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:02:26 l75lg1-v1 manila-share[98474]: INFO manila.share.manager [None req-2534ea41-3b4a-4f36-933f-88120c8884bd tempest-SharesNegativeTest-1014773059 None] Share instance 27c3f247-5cdb-4bb3-9479-7b3253f9df42 created successfully. May 28 13:02:26 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8a0cf0b1-beee-4dd4-b33f-336d3231f70d tempest-ShareSnapshotMetadataNegativeTest-1199544441 None] <<< [GET] https://127.0.0.1:40443/api/quotas/ May 28 13:02:26 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8a0cf0b1-beee-4dd4-b33f-336d3231f70d tempest-ShareSnapshotMetadataNegativeTest-1199544441 None] [Bunch(cluster='loop75-kfs', cluster_id=1, default_email=None, default_group_quota=None, default_user_quota=None, enable_alarms=True, enable_email_providers=True, grace_period=None, guid='70e6ce4c-05a8-41bc-b0a8-05002db0a6b5', hard_limit=1073741824, hard_limit_inodes=None, id=53, internal=False, is_user_quota=False, last_user_quotas_update=None, name='f49db035-ea92-4df4-9284-1e5ce7e3fd79', num_blocked_users=0, num_exceeded_users=0, path='/manila/manila-f49db035-ea92-4df4-9284-1e5ce7e3fd79', percent_capacity=0, percent_inodes=None, pretty_grace_period=None, pretty_grace_period_expiration=None, pretty_state='OK (CREATED)', soft_limit=None, soft_limit_inodes=None, state='OK', sync_state='CREATED', system_id=53, tenant_id=1, tenant_name='default', time_to_block=None, title='f49db035-ea92-4df4-9284-1e5ce7e3fd79', url='https://127.0.0.1:40443/api/quotas/53/', used_capacity=0, used_capacity_tb=0.0, used_effective_capacity=0, used_effective_capacity_tb=0.0, used_inodes=0, used_limited_capacity=0)] May 28 13:02:26 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8a0cf0b1-beee-4dd4-b33f-336d3231f70d tempest-ShareSnapshotMetadataNegativeTest-1199544441 None] --- [GET] https://127.0.0.1:40443/api/quotas/: Done May 28 13:02:26 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8a0cf0b1-beee-4dd4-b33f-336d3231f70d tempest-ShareSnapshotMetadataNegativeTest-1199544441 None] >>> [DELETE] https://127.0.0.1:40443/api/quotas/53/ May 28 13:02:26 l75lg1-v1 sudo[99178]: pam_unix(sudo:session): session closed for user root May 28 13:02:26 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.459s {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:428}} May 28 13:02:26 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:390}} May 28 13:02:26 l75lg1-v1 sudo[99181]: vastdata : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 May 28 13:02:26 l75lg1-v1 sudo[99181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) May 28 13:02:26 l75lg1-v1 dstat.sh[49771]: 28-05 13:02:26| 5 1 93 1 0|5646M 1779M 278M 7921M| 22k 1391B| 256k 540k|2.00 64.0 |2546 3674 |1.13 1.16 1.06|2.0 1.0 5.0| 0 0 | 0 2048M| 29 363 0 34 2 May 28 13:02:26 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ff25f21e-23a0-4894-a240-f4b3f1647793 tempest-ShareRulesTest-1530341375 None] <<< [DELETE] https://127.0.0.1:40443/api/quotas/35/ May 28 13:02:26 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ff25f21e-23a0-4894-a240-f4b3f1647793 tempest-ShareRulesTest-1530341375 None] --- [DELETE] https://127.0.0.1:40443/api/quotas/35/: Done May 28 13:02:26 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ff25f21e-23a0-4894-a240-f4b3f1647793 tempest-ShareRulesTest-1530341375 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:02:26 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ff25f21e-23a0-4894-a240-f4b3f1647793 tempest-ShareRulesTest-1530341375 None] {'allow_redirects': True, May 28 13:02:26 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ff25f21e-23a0-4894-a240-f4b3f1647793 tempest-ShareRulesTest-1530341375 None] 'params': {'name': 'f7e47502-a0f7-44de-953d-b7b5697ae0b2'}} May 28 13:02:26 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-ad1f901d-7d31-4a0b-b7b6-7606bacbef0e tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] GET http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/shares/b330db31-7766-443d-9c19-26fe349665aa May 28 13:02:26 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-ad1f901d-7d31-4a0b-b7b6-7606bacbef0e tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:02:26 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-ad1f901d-7d31-4a0b-b7b6-7606bacbef0e tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:02:26 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-ad1f901d-7d31-4a0b-b7b6-7606bacbef0e tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/shares/b330db31-7766-443d-9c19-26fe349665aa returned with HTTP 200 May 28 13:02:26 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1245/2467] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:02:26 2024] GET /share/v2/a4f3887fa28c457390f5b66615564430/shares/b330db31-7766-443d-9c19-26fe349665aa => generated 1315 bytes in 31 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:02:26 l75lg1-v1 sudo[99181]: pam_unix(sudo:session): session closed for user root May 28 13:02:26 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.469s {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:428}} May 28 13:02:26 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:390}} May 28 13:02:26 l75lg1-v1 sudo[99184]: vastdata : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool May 28 13:02:26 l75lg1-v1 sudo[99184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) May 28 13:02:26 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ff25f21e-23a0-4894-a240-f4b3f1647793 tempest-ShareRulesTest-1530341375 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:02:26 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ff25f21e-23a0-4894-a240-f4b3f1647793 tempest-ShareRulesTest-1530341375 None] [Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=0, created='2024-05-28T12:59:53.824250Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='0fa84ccd-850f-48fa-a965-23e5abe31188', id=38, internal=False, is_s3_default_policy=False, name='f7e47502-a0f7-44de-953d-b7b5697ae0b2', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=['*'], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=[], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=[], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T13:02:18.942814Z', tenant_id=1, tenant_name='default', title='f7e47502-a0f7-44de-953d-b7b5697ae0b2', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/38/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[])] May 28 13:02:26 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ff25f21e-23a0-4894-a240-f4b3f1647793 tempest-ShareRulesTest-1530341375 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 13:02:26 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ff25f21e-23a0-4894-a240-f4b3f1647793 tempest-ShareRulesTest-1530341375 None] >>> [DELETE] https://127.0.0.1:40443/api/viewpolicies/38/ May 28 13:02:27 l75lg1-v1 sudo[99184]: pam_unix(sudo:session): session closed for user root May 28 13:02:27 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.467s {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:428}} May 28 13:02:27 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:390}} May 28 13:02:27 l75lg1-v1 sudo[99233]: vastdata : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 May 28 13:02:27 l75lg1-v1 sudo[99233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) May 28 13:02:27 l75lg1-v1 dstat.sh[49771]: 28-05 13:02:27| 11 3 86 0 0|5647M 1778M 278M 7921M| 21k 1390B| 640k 308k|5.00 23.0 |3366 4925 |1.12 1.15 1.06|2.0 1.0 52| 0 0 | 0 2048M| 29 363 0 35 2 May 28 13:02:27 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-ff0f8f23-5851-449c-9c11-ae9f819727da tempest-SharesNegativeTest-1014773059 tempest-SharesNegativeTest-1014773059-project-member] GET http://10.27.203.238/share/v2/d1d71dc9f23c4c6a8e146d99ad65ebb2/shares/b05a8999-f1ac-4887-a675-3c2ca8e9cece May 28 13:02:27 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-ff0f8f23-5851-449c-9c11-ae9f819727da tempest-SharesNegativeTest-1014773059 tempest-SharesNegativeTest-1014773059-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:02:27 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-ff0f8f23-5851-449c-9c11-ae9f819727da tempest-SharesNegativeTest-1014773059 tempest-SharesNegativeTest-1014773059-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:02:27 l75lg1-v1 devstack@m-api.service[98330]: DEBUG dbcounter [-] [98330] Writing DB stats manila:SELECT=1038,manila:INSERT=83,manila:UPDATE=80 {{(pid=98330) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:02:27 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-ff0f8f23-5851-449c-9c11-ae9f819727da tempest-SharesNegativeTest-1014773059 tempest-SharesNegativeTest-1014773059-project-member] http://10.27.203.238/share/v2/d1d71dc9f23c4c6a8e146d99ad65ebb2/shares/b05a8999-f1ac-4887-a675-3c2ca8e9cece returned with HTTP 200 May 28 13:02:27 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1223/2468] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:02:27 2024] GET /share/v2/d1d71dc9f23c4c6a8e146d99ad65ebb2/shares/b05a8999-f1ac-4887-a675-3c2ca8e9cece => generated 1315 bytes in 27 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:02:27 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-42da0038-d60b-44c3-af1c-fb115a626b57 tempest-SharesNegativeTest-1014773059 tempest-SharesNegativeTest-1014773059-project-member] POST http://10.27.203.238/share/v2/d1d71dc9f23c4c6a8e146d99ad65ebb2/snapshots May 28 13:02:27 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-42da0038-d60b-44c3-af1c-fb115a626b57 tempest-SharesNegativeTest-1014773059 tempest-SharesNegativeTest-1014773059-project-member] Action: 'create', calling method: ShareSnapshotMixin.create, body: {"snapshot": {"name": "tempest-tempest-created-share-snap-1523679502", "force": false, "description": "Tempest's snapshot", "share_id": "b05a8999-f1ac-4887-a675-3c2ca8e9cece"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:02:27 l75lg1-v1 devstack@m-api.service[98329]: DEBUG dbcounter [-] [98329] Writing DB stats manila:SELECT=945,manila:INSERT=42,manila:UPDATE=63 {{(pid=98329) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:02:27 l75lg1-v1 neutron-server[77623]: DEBUG dbcounter [-] [77623] Writing DB stats neutron:SELECT=2 {{(pid=77623) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:02:27 l75lg1-v1 neutron-server[77623]: DEBUG dbcounter [-] [77623] Writing DB stats neutron:SELECT=1 {{(pid=77623) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:02:27 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.v1.share_snapshots [None req-42da0038-d60b-44c3-af1c-fb115a626b57 tempest-SharesNegativeTest-1014773059 tempest-SharesNegativeTest-1014773059-project-member] Create snapshot from share b05a8999-f1ac-4887-a675-3c2ca8e9cece May 28 13:02:27 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.quota [None req-42da0038-d60b-44c3-af1c-fb115a626b57 tempest-SharesNegativeTest-1014773059 tempest-SharesNegativeTest-1014773059-project-member] Created reservations ['cc86a457-9c75-491a-bd7a-d9cd214541dc', '45f4b1b4-e7d3-4a2b-bc02-3fe3033140cf', '6c64770d-0925-438d-ac4b-b46893d855a3', '47cec291-a9db-4106-862f-abaa1585da00'] {{(pid=98329) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 13:02:27 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.quota [None req-42da0038-d60b-44c3-af1c-fb115a626b57 tempest-SharesNegativeTest-1014773059 tempest-SharesNegativeTest-1014773059-project-member] Committed reservations ['cc86a457-9c75-491a-bd7a-d9cd214541dc', '45f4b1b4-e7d3-4a2b-bc02-3fe3033140cf', '6c64770d-0925-438d-ac4b-b46893d855a3', '47cec291-a9db-4106-862f-abaa1585da00'] {{(pid=98329) commit /opt/stack/manila/manila/quota.py:1063}} May 28 13:02:27 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-42da0038-d60b-44c3-af1c-fb115a626b57 tempest-SharesNegativeTest-1014773059 tempest-SharesNegativeTest-1014773059-project-member] http://10.27.203.238/share/v2/d1d71dc9f23c4c6a8e146d99ad65ebb2/snapshots returned with HTTP 202 May 28 13:02:27 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1246/2469] 10.27.203.238 () {66 vars in 1371 bytes} [Tue May 28 13:02:27 2024] POST /share/v2/d1d71dc9f23c4c6a8e146d99ad65ebb2/snapshots => generated 723 bytes in 187 msecs (HTTP/1.1 202) 6 headers in 237 bytes (1 switches on core 0) May 28 13:02:27 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-d39ccbbe-cb45-47d8-96ea-18d80c5b7ef1 tempest-SharesNegativeTest-1014773059 tempest-SharesNegativeTest-1014773059-project-member] GET http://10.27.203.238/share/v2/d1d71dc9f23c4c6a8e146d99ad65ebb2/snapshots/79b46976-8aab-4859-b7c0-b71cf76c2cc2 May 28 13:02:27 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-d39ccbbe-cb45-47d8-96ea-18d80c5b7ef1 tempest-SharesNegativeTest-1014773059 tempest-SharesNegativeTest-1014773059-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:02:27 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-d39ccbbe-cb45-47d8-96ea-18d80c5b7ef1 tempest-SharesNegativeTest-1014773059 tempest-SharesNegativeTest-1014773059-project-member] Calling method 'ShareSnapshotMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:02:27 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-d39ccbbe-cb45-47d8-96ea-18d80c5b7ef1 tempest-SharesNegativeTest-1014773059 tempest-SharesNegativeTest-1014773059-project-member] http://10.27.203.238/share/v2/d1d71dc9f23c4c6a8e146d99ad65ebb2/snapshots/79b46976-8aab-4859-b7c0-b71cf76c2cc2 returned with HTTP 200 May 28 13:02:27 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1224/2470] 10.27.203.238 () {64 vars in 1460 bytes} [Tue May 28 13:02:27 2024] GET /share/v2/d1d71dc9f23c4c6a8e146d99ad65ebb2/snapshots/79b46976-8aab-4859-b7c0-b71cf76c2cc2 => generated 723 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:02:27 l75lg1-v1 sudo[99233]: pam_unix(sudo:session): session closed for user root May 28 13:02:27 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.501s {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:428}} May 28 13:02:27 l75lg1-v1 cinder-volume[85846]: DEBUG cinder.manager [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] Notifying Schedulers of capabilities ... {{(pid=85846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 28 13:02:27 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.scheduler.host_manager [None req-1dc76891-7d2c-448a-a1ca-8048ce603244 None None] Received volume service update from l75lg1-v1@lvmdriver-1: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:l75lg1-v1:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up', 'allocated_capacity_gb': 0, 'cacheable': True}], 'shared_targets': False, 'sparse_copy_volume': True, 'filter_function': None, 'goodness_function': None} {{(pid=85128) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:628}} May 28 13:02:27 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-42da0038-d60b-44c3-af1c-fb115a626b57 tempest-SharesNegativeTest-1014773059 None] >>> [POST] https://127.0.0.1:40443/api/snapshots/ May 28 13:02:27 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-42da0038-d60b-44c3-af1c-fb115a626b57 tempest-SharesNegativeTest-1014773059 None] {'data': '{"path": "/manila/manila-27c3f247-5cdb-4bb3-9479-7b3253f9df42", ' May 28 13:02:27 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-42da0038-d60b-44c3-af1c-fb115a626b57 tempest-SharesNegativeTest-1014773059 None] '"name": "share-snapshot-9552655b-8df3-477b-913a-f9d1bef42b62"}', May 28 13:02:27 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-42da0038-d60b-44c3-af1c-fb115a626b57 tempest-SharesNegativeTest-1014773059 None] 'json': None, May 28 13:02:27 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-42da0038-d60b-44c3-af1c-fb115a626b57 tempest-SharesNegativeTest-1014773059 None] 'params': None} May 28 13:02:28 l75lg1-v1 dstat.sh[49771]: 28-05 13:02:28| 7 1 91 1 0|5644M 1781M 278M 7921M| 16k 798B| 256k 860k|2.00 124 |3511 5286 |1.12 1.15 1.06|2.0 0 9.0| 0 0 | 0 2048M| 29 363 0 30 2 May 28 13:02:28 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-f2d57f01-b00d-4a02-abac-903275c46306 tempest-ShareSnapshotMetadataNegativeTest-1199544441 tempest-ShareSnapshotMetadataNegativeTest-1199544441-project-member] GET http://10.27.203.238/share/v2/b00df7df3db14cce99343fc7f6ffd796/shares/1f5b6f0f-f341-4964-a2fa-9c4a26198f95 May 28 13:02:28 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-f2d57f01-b00d-4a02-abac-903275c46306 tempest-ShareSnapshotMetadataNegativeTest-1199544441 tempest-ShareSnapshotMetadataNegativeTest-1199544441-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:02:28 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-f2d57f01-b00d-4a02-abac-903275c46306 tempest-ShareSnapshotMetadataNegativeTest-1199544441 tempest-ShareSnapshotMetadataNegativeTest-1199544441-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:02:28 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-f2d57f01-b00d-4a02-abac-903275c46306 tempest-ShareSnapshotMetadataNegativeTest-1199544441 tempest-ShareSnapshotMetadataNegativeTest-1199544441-project-member] http://10.27.203.238/share/v2/b00df7df3db14cce99343fc7f6ffd796/shares/1f5b6f0f-f341-4964-a2fa-9c4a26198f95 returned with HTTP 200 May 28 13:02:28 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1247/2471] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:02:28 2024] GET /share/v2/b00df7df3db14cce99343fc7f6ffd796/shares/1f5b6f0f-f341-4964-a2fa-9c4a26198f95 => generated 1420 bytes in 25 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:02:28 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ff25f21e-23a0-4894-a240-f4b3f1647793 tempest-ShareRulesTest-1530341375 None] <<< [DELETE] https://127.0.0.1:40443/api/viewpolicies/38/ May 28 13:02:28 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ff25f21e-23a0-4894-a240-f4b3f1647793 tempest-ShareRulesTest-1530341375 None] --- [DELETE] https://127.0.0.1:40443/api/viewpolicies/38/: Done May 28 13:02:28 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-ff25f21e-23a0-4894-a240-f4b3f1647793 tempest-ShareRulesTest-1530341375 None] Created reservations ['c2a02e24-422a-4c1e-9a6a-46f4582fdcad', 'c0c71e9d-6c4d-4631-918d-e5e2ee15a623', '481e3248-e842-46a6-8694-6419f2462895', 'ee691605-988d-4c95-943e-1933dcdd4d45'] {{(pid=98474) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 13:02:28 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-ff25f21e-23a0-4894-a240-f4b3f1647793 tempest-ShareRulesTest-1530341375 None] Committed reservations ['c2a02e24-422a-4c1e-9a6a-46f4582fdcad', 'c0c71e9d-6c4d-4631-918d-e5e2ee15a623', '481e3248-e842-46a6-8694-6419f2462895', 'ee691605-988d-4c95-943e-1933dcdd4d45'] {{(pid=98474) commit /opt/stack/manila/manila/quota.py:1063}} May 28 13:02:28 l75lg1-v1 manila-share[98474]: INFO manila.share.manager [None req-ff25f21e-23a0-4894-a240-f4b3f1647793 tempest-ShareRulesTest-1530341375 None] Share instance f7e47502-a0f7-44de-953d-b7b5697ae0b2: deleted successfully. May 28 13:02:29 l75lg1-v1 dstat.sh[49771]: 28-05 13:02:29| 2 0 96 1 0|5644M 1781M 278M 7921M| 19k 66B| 0 800k| 0 106 |2568 4048 |1.12 1.15 1.06|1.0 0 0| 0 0 | 0 2048M| 29 363 0 30 2 May 28 13:02:29 l75lg1-v1 neutron-server[77619]: DEBUG dbcounter [-] [77619] Writing DB stats neutron:SELECT=1 {{(pid=77619) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:02:29 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8a0cf0b1-beee-4dd4-b33f-336d3231f70d tempest-ShareSnapshotMetadataNegativeTest-1199544441 None] <<< [DELETE] https://127.0.0.1:40443/api/quotas/53/ May 28 13:02:29 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8a0cf0b1-beee-4dd4-b33f-336d3231f70d tempest-ShareSnapshotMetadataNegativeTest-1199544441 None] --- [DELETE] https://127.0.0.1:40443/api/quotas/53/: Done May 28 13:02:29 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8a0cf0b1-beee-4dd4-b33f-336d3231f70d tempest-ShareSnapshotMetadataNegativeTest-1199544441 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:02:29 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8a0cf0b1-beee-4dd4-b33f-336d3231f70d tempest-ShareSnapshotMetadataNegativeTest-1199544441 None] {'allow_redirects': True, May 28 13:02:29 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8a0cf0b1-beee-4dd4-b33f-336d3231f70d tempest-ShareSnapshotMetadataNegativeTest-1199544441 None] 'params': {'name': 'f49db035-ea92-4df4-9284-1e5ce7e3fd79'}} May 28 13:02:29 l75lg1-v1 neutron-server[77618]: DEBUG dbcounter [-] [77618] Writing DB stats neutron:SELECT=1 {{(pid=77618) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:02:29 l75lg1-v1 neutron-server[77623]: DEBUG neutron.db.agents_db [None req-fe40ce8c-640e-4db7-a17a-6e8888cce266 None None] Agent healthcheck: found 0 active agents {{(pid=77623) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:319}} May 28 13:02:29 l75lg1-v1 neutron-server[77618]: DEBUG dbcounter [-] [77618] Writing DB stats neutron:SELECT=1 {{(pid=77618) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:02:29 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-a44327bb-9ec2-4783-934b-c7192ca49f10 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] GET http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/shares/b330db31-7766-443d-9c19-26fe349665aa May 28 13:02:29 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-a44327bb-9ec2-4783-934b-c7192ca49f10 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:02:29 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-a44327bb-9ec2-4783-934b-c7192ca49f10 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:02:29 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-a44327bb-9ec2-4783-934b-c7192ca49f10 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] HTTP exception thrown: The resource could not be found. May 28 13:02:29 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-a44327bb-9ec2-4783-934b-c7192ca49f10 tempest-ShareRulesTest-1530341375 tempest-ShareRulesTest-1530341375-project-member] http://10.27.203.238/share/v2/a4f3887fa28c457390f5b66615564430/shares/b330db31-7766-443d-9c19-26fe349665aa returned with HTTP 404 May 28 13:02:29 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1225/2472] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:02:29 2024] GET /share/v2/a4f3887fa28c457390f5b66615564430/shares/b330db31-7766-443d-9c19-26fe349665aa => generated 78 bytes in 12 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 13:02:29 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-a467e14b-aeba-4700-98ad-568aef77a1ba tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] DELETE http://10.27.203.238/share/v2/f353f66e6e00471aa584ea2e39c0ab0e/types/1749967d-80e1-4d76-8cac-122e8902d0cd May 28 13:02:29 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-a467e14b-aeba-4700-98ad-568aef77a1ba tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:02:29 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-a467e14b-aeba-4700-98ad-568aef77a1ba tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] Calling method 'ShareTypesController._delete' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:02:29 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-a467e14b-aeba-4700-98ad-568aef77a1ba tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] http://10.27.203.238/share/v2/f353f66e6e00471aa584ea2e39c0ab0e/types/1749967d-80e1-4d76-8cac-122e8902d0cd returned with HTTP 202 May 28 13:02:29 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1248/2473] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:02:29 2024] DELETE /share/v2/f353f66e6e00471aa584ea2e39c0ab0e/types/1749967d-80e1-4d76-8cac-122e8902d0cd => generated 0 bytes in 57 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 13:02:29 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-0208e9b4-3a30-4eaa-8320-ac202a5928e6 tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] GET http://10.27.203.238/share/v2/f353f66e6e00471aa584ea2e39c0ab0e/types/1749967d-80e1-4d76-8cac-122e8902d0cd May 28 13:02:29 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-0208e9b4-3a30-4eaa-8320-ac202a5928e6 tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:02:29 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-0208e9b4-3a30-4eaa-8320-ac202a5928e6 tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] Calling method 'ShareTypesController.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:02:29 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-0208e9b4-3a30-4eaa-8320-ac202a5928e6 tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] HTTP exception thrown: Share type not found. May 28 13:02:29 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-0208e9b4-3a30-4eaa-8320-ac202a5928e6 tempest-ShareRulesTest-2015086173 tempest-ShareRulesTest-2015086173-project-admin] http://10.27.203.238/share/v2/f353f66e6e00471aa584ea2e39c0ab0e/types/1749967d-80e1-4d76-8cac-122e8902d0cd returned with HTTP 404 May 28 13:02:29 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1226/2474] 10.27.203.238 () {64 vars in 1448 bytes} [Tue May 28 13:02:29 2024] GET /share/v2/f353f66e6e00471aa584ea2e39c0ab0e/types/1749967d-80e1-4d76-8cac-122e8902d0cd => generated 67 bytes in 11 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 13:02:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cb44f3-4188-479a-85e3-3abd9dd5c592 service manila] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-70cb44f3-4188-479a-85e3-3abd9dd5c592 service manila] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:02:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cb44f3-4188-479a-85e3-3abd9dd5c592 service manila] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c57c002-99f5-46c1-b2f2-3d472e95c2d1 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c57c002-99f5-46c1-b2f2-3d472e95c2d1 None admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c57c002-99f5-46c1-b2f2-3d472e95c2d1 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c57c002-99f5-46c1-b2f2-3d472e95c2d1 None admin] PATH_INFO: `/v3/users/c153f63532ba4a37a0dea611e7cd28fc` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c57c002-99f5-46c1-b2f2-3d472e95c2d1 None admin] RBAC: Authorizing `identity:delete_user(user_id=c153f63532ba4a37a0dea611e7cd28fc)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c57c002-99f5-46c1-b2f2-3d472e95c2d1 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:29 l75lg1-v1 nova-conductor[83647]: DEBUG dbcounter [-] [83647] Writing DB stats nova_cell1:SELECT=1,nova_cell1:UPDATE=1 {{(pid=83647) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:02:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-7c57c002-99f5-46c1-b2f2-3d472e95c2d1 None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c153f63532ba4a37a0dea611e7cd28fc', 'request_id': 'req-7c57c002-99f5-46c1-b2f2-3d472e95c2d1'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-7c57c002-99f5-46c1-b2f2-3d472e95c2d1 None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c153f63532ba4a37a0dea611e7cd28fc', 'request_id': 'req-7c57c002-99f5-46c1-b2f2-3d472e95c2d1'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-7c57c002-99f5-46c1-b2f2-3d472e95c2d1 None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c153f63532ba4a37a0dea611e7cd28fc', 'request_id': 'req-7c57c002-99f5-46c1-b2f2-3d472e95c2d1'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-7c57c002-99f5-46c1-b2f2-3d472e95c2d1 None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c153f63532ba4a37a0dea611e7cd28fc', 'request_id': 'req-7c57c002-99f5-46c1-b2f2-3d472e95c2d1'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:29 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-7c57c002-99f5-46c1-b2f2-3d472e95c2d1 None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c153f63532ba4a37a0dea611e7cd28fc', 'request_id': 'req-7c57c002-99f5-46c1-b2f2-3d472e95c2d1'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:29 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1706/3380] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 13:02:29 2024] DELETE /identity/v3/users/c153f63532ba4a37a0dea611e7cd28fc => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:02:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437261c2-2f85-4b88-8b63-df16418104ad service manila] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437261c2-2f85-4b88-8b63-df16418104ad service manila] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ae3c64-f55a-45d5-a3d2-eaf7cb09caba None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ae3c64-f55a-45d5-a3d2-eaf7cb09caba None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ae3c64-f55a-45d5-a3d2-eaf7cb09caba None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ae3c64-f55a-45d5-a3d2-eaf7cb09caba None admin] PATH_INFO: `/v3/users/3e37f1dedc43413abaedb9537451a247` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ae3c64-f55a-45d5-a3d2-eaf7cb09caba None admin] RBAC: Authorizing `identity:delete_user(user_id=3e37f1dedc43413abaedb9537451a247)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ae3c64-f55a-45d5-a3d2-eaf7cb09caba None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:29 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8a0cf0b1-beee-4dd4-b33f-336d3231f70d tempest-ShareSnapshotMetadataNegativeTest-1199544441 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:02:29 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8a0cf0b1-beee-4dd4-b33f-336d3231f70d tempest-ShareSnapshotMetadataNegativeTest-1199544441 None] [Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=0, created='2024-05-28T13:02:10.345627Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='2e4287f2-d176-4472-bea7-d2d1de38270a', id=56, internal=False, is_s3_default_policy=False, name='f49db035-ea92-4df4-9284-1e5ce7e3fd79', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=[], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['*'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['*'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T13:02:10.683681Z', tenant_id=1, tenant_name='default', title='f49db035-ea92-4df4-9284-1e5ce7e3fd79', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/56/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[])] May 28 13:02:29 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8a0cf0b1-beee-4dd4-b33f-336d3231f70d tempest-ShareSnapshotMetadataNegativeTest-1199544441 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 13:02:29 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8a0cf0b1-beee-4dd4-b33f-336d3231f70d tempest-ShareSnapshotMetadataNegativeTest-1199544441 None] >>> [DELETE] https://127.0.0.1:40443/api/viewpolicies/56/ May 28 13:02:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-c4ae3c64-f55a-45d5-a3d2-eaf7cb09caba None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e37f1dedc43413abaedb9537451a247', 'request_id': 'req-c4ae3c64-f55a-45d5-a3d2-eaf7cb09caba'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-c4ae3c64-f55a-45d5-a3d2-eaf7cb09caba None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e37f1dedc43413abaedb9537451a247', 'request_id': 'req-c4ae3c64-f55a-45d5-a3d2-eaf7cb09caba'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-c4ae3c64-f55a-45d5-a3d2-eaf7cb09caba None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e37f1dedc43413abaedb9537451a247', 'request_id': 'req-c4ae3c64-f55a-45d5-a3d2-eaf7cb09caba'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-c4ae3c64-f55a-45d5-a3d2-eaf7cb09caba None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e37f1dedc43413abaedb9537451a247', 'request_id': 'req-c4ae3c64-f55a-45d5-a3d2-eaf7cb09caba'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:29 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-c4ae3c64-f55a-45d5-a3d2-eaf7cb09caba None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e37f1dedc43413abaedb9537451a247', 'request_id': 'req-c4ae3c64-f55a-45d5-a3d2-eaf7cb09caba'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:30 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1675/3381] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 13:02:29 2024] DELETE /identity/v3/users/3e37f1dedc43413abaedb9537451a247 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:02:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c57c002-99f5-46c1-b2f2-3d472e95c2d1 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-7c57c002-99f5-46c1-b2f2-3d472e95c2d1 None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:02:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c57c002-99f5-46c1-b2f2-3d472e95c2d1 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:30 l75lg1-v1 nova-conductor[83648]: DEBUG dbcounter [-] [83648] Writing DB stats nova_cell1:SELECT=1 {{(pid=83648) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:02:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892c72a2-77d9-4e05-a5fc-a14000e3857f None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892c72a2-77d9-4e05-a5fc-a14000e3857f None admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892c72a2-77d9-4e05-a5fc-a14000e3857f None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892c72a2-77d9-4e05-a5fc-a14000e3857f None admin] PATH_INFO: `/v3/users/91af4223eb404925980daea7f7bde321` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892c72a2-77d9-4e05-a5fc-a14000e3857f None admin] RBAC: Authorizing `identity:delete_user(user_id=91af4223eb404925980daea7f7bde321)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892c72a2-77d9-4e05-a5fc-a14000e3857f None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-892c72a2-77d9-4e05-a5fc-a14000e3857f None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91af4223eb404925980daea7f7bde321', 'request_id': 'req-892c72a2-77d9-4e05-a5fc-a14000e3857f'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-892c72a2-77d9-4e05-a5fc-a14000e3857f None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91af4223eb404925980daea7f7bde321', 'request_id': 'req-892c72a2-77d9-4e05-a5fc-a14000e3857f'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-892c72a2-77d9-4e05-a5fc-a14000e3857f None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91af4223eb404925980daea7f7bde321', 'request_id': 'req-892c72a2-77d9-4e05-a5fc-a14000e3857f'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-892c72a2-77d9-4e05-a5fc-a14000e3857f None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91af4223eb404925980daea7f7bde321', 'request_id': 'req-892c72a2-77d9-4e05-a5fc-a14000e3857f'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-892c72a2-77d9-4e05-a5fc-a14000e3857f None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91af4223eb404925980daea7f7bde321', 'request_id': 'req-892c72a2-77d9-4e05-a5fc-a14000e3857f'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:30 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1707/3382] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 13:02:30 2024] DELETE /identity/v3/users/91af4223eb404925980daea7f7bde321 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:02:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eec503-175e-4efd-895d-efaa593b9641 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eec503-175e-4efd-895d-efaa593b9641 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eec503-175e-4efd-895d-efaa593b9641 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:30 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-f5eec503-175e-4efd-895d-efaa593b9641 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 13:02:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-f5eec503-175e-4efd-895d-efaa593b9641 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 13:02:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-f5eec503-175e-4efd-895d-efaa593b9641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:02:30 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1676/3383] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 13:02:30 2024] POST /identity/v3/auth/tokens => generated 2960 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 13:02:30 l75lg1-v1 neutron-server[77618]: DEBUG neutron.wsgi [-] (77618) accepted ('10.27.203.238', 53306) {{(pid=77618) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 13:02:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892c72a2-77d9-4e05-a5fc-a14000e3857f None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-892c72a2-77d9-4e05-a5fc-a14000e3857f None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:02:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892c72a2-77d9-4e05-a5fc-a14000e3857f None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e724110-0edf-4c28-8fca-8400f58cfffc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef17047035e4b518fd5360a01f2da1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e724110-0edf-4c28-8fca-8400f58cfffc service neutron] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e724110-0edf-4c28-8fca-8400f58cfffc service neutron] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e724110-0edf-4c28-8fca-8400f58cfffc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e724110-0edf-4c28-8fca-8400f58cfffc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e724110-0edf-4c28-8fca-8400f58cfffc service neutron] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:30 l75lg1-v1 dstat.sh[49771]: 28-05 13:02:30| 6 1 91 2 0|5644M 1780M 278M 7921M| 22k 1457B| 0 1420k| 0 231 |5341 8805 |1.12 1.15 1.06|2.0 0 0| 0 0 | 0 2048M| 29 366 0 30 2 May 28 13:02:30 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1708/3384] 10.27.203.238 () {64 vars in 1432 bytes} [Tue May 28 13:02:30 2024] GET /identity/v3/auth/tokens => generated 2960 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 28 13:02:30 l75lg1-v1 neutron-server[77618]: INFO neutron.wsgi [None req-d0fec923-cc34-4398-b10a-0289f8ad6f95 None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=f353f66e6e00471aa584ea2e39c0ab0e&name=default HTTP/1.1" status: 200 len: 216 time: 0.0732231 May 28 13:02:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5eec503-175e-4efd-895d-efaa593b9641 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-f5eec503-175e-4efd-895d-efaa593b9641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:02:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5eec503-175e-4efd-895d-efaa593b9641 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35b5e47-1e71-49bc-834e-65294b83863f None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35b5e47-1e71-49bc-834e-65294b83863f None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35b5e47-1e71-49bc-834e-65294b83863f None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35b5e47-1e71-49bc-834e-65294b83863f None admin] PATH_INFO: `/v3/projects/f353f66e6e00471aa584ea2e39c0ab0e` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35b5e47-1e71-49bc-834e-65294b83863f None admin] RBAC: Authorizing `identity:delete_project(project_id=f353f66e6e00471aa584ea2e39c0ab0e)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35b5e47-1e71-49bc-834e-65294b83863f None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-c35b5e47-1e71-49bc-834e-65294b83863f None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f353f66e6e00471aa584ea2e39c0ab0e', 'request_id': 'req-c35b5e47-1e71-49bc-834e-65294b83863f'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-c35b5e47-1e71-49bc-834e-65294b83863f None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f353f66e6e00471aa584ea2e39c0ab0e', 'request_id': 'req-c35b5e47-1e71-49bc-834e-65294b83863f'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-c35b5e47-1e71-49bc-834e-65294b83863f None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f353f66e6e00471aa584ea2e39c0ab0e', 'request_id': 'req-c35b5e47-1e71-49bc-834e-65294b83863f'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-c35b5e47-1e71-49bc-834e-65294b83863f None admin] The token cache is being invalidate because project f353f66e6e00471aa584ea2e39c0ab0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 13:02:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-c35b5e47-1e71-49bc-834e-65294b83863f None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-c35b5e47-1e71-49bc-834e-65294b83863f None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:30 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1677/3385] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 13:02:30 2024] DELETE /identity/v3/projects/f353f66e6e00471aa584ea2e39c0ab0e => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:02:30 l75lg1-v1 neutron-server[77619]: DEBUG neutron.wsgi [-] (77619) accepted ('10.27.203.238', 46440) {{(pid=77619) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 13:02:30 l75lg1-v1 neutron-server[77618]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.HashRingHealthCheckPeriodics.touch_hash_ring_nodes' {{(pid=77618) _process_scheduled /opt/stack/data/venv/lib/python3.10/site-packages/futurist/periodics.py:638}} May 28 13:02:30 l75lg1-v1 neutron-server[77619]: INFO neutron.wsgi [None req-51ae3fb0-57d1-45be-b150-1bdb1aa54c9d None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=fc1d7dd820ad45ef972127f6f0f4980e&name=default HTTP/1.1" status: 200 len: 216 time: 0.0087554 May 28 13:02:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e724110-0edf-4c28-8fca-8400f58cfffc service neutron] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e724110-0edf-4c28-8fca-8400f58cfffc service neutron] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f8a46b-bac7-4bc0-b4e9-9d782f944fa4 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f8a46b-bac7-4bc0-b4e9-9d782f944fa4 None admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f8a46b-bac7-4bc0-b4e9-9d782f944fa4 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f8a46b-bac7-4bc0-b4e9-9d782f944fa4 None admin] PATH_INFO: `/v3/projects/fc1d7dd820ad45ef972127f6f0f4980e` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f8a46b-bac7-4bc0-b4e9-9d782f944fa4 None admin] RBAC: Authorizing `identity:delete_project(project_id=fc1d7dd820ad45ef972127f6f0f4980e)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f8a46b-bac7-4bc0-b4e9-9d782f944fa4 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-59f8a46b-bac7-4bc0-b4e9-9d782f944fa4 None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc1d7dd820ad45ef972127f6f0f4980e', 'request_id': 'req-59f8a46b-bac7-4bc0-b4e9-9d782f944fa4'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-59f8a46b-bac7-4bc0-b4e9-9d782f944fa4 None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc1d7dd820ad45ef972127f6f0f4980e', 'request_id': 'req-59f8a46b-bac7-4bc0-b4e9-9d782f944fa4'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-59f8a46b-bac7-4bc0-b4e9-9d782f944fa4 None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc1d7dd820ad45ef972127f6f0f4980e', 'request_id': 'req-59f8a46b-bac7-4bc0-b4e9-9d782f944fa4'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-59f8a46b-bac7-4bc0-b4e9-9d782f944fa4 None admin] The token cache is being invalidate because project fc1d7dd820ad45ef972127f6f0f4980e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 13:02:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-59f8a46b-bac7-4bc0-b4e9-9d782f944fa4 None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-59f8a46b-bac7-4bc0-b4e9-9d782f944fa4 None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:30 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1709/3386] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 13:02:30 2024] DELETE /identity/v3/projects/fc1d7dd820ad45ef972127f6f0f4980e => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:02:30 l75lg1-v1 neutron-server[77619]: DEBUG neutron.wsgi [-] (77619) accepted ('10.27.203.238', 46456) {{(pid=77619) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 13:02:30 l75lg1-v1 neutron-server[77619]: INFO neutron.wsgi [None req-878cd1d8-d578-4209-bf82-bd547a4598a0 None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=a4f3887fa28c457390f5b66615564430&name=default HTTP/1.1" status: 200 len: 216 time: 0.0085905 May 28 13:02:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35b5e47-1e71-49bc-834e-65294b83863f None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-c35b5e47-1e71-49bc-834e-65294b83863f None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:02:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35b5e47-1e71-49bc-834e-65294b83863f None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6d1f20-4bc2-4059-9d29-d7c2f9992ea9 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6d1f20-4bc2-4059-9d29-d7c2f9992ea9 None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6d1f20-4bc2-4059-9d29-d7c2f9992ea9 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6d1f20-4bc2-4059-9d29-d7c2f9992ea9 None admin] PATH_INFO: `/v3/projects/a4f3887fa28c457390f5b66615564430` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6d1f20-4bc2-4059-9d29-d7c2f9992ea9 None admin] RBAC: Authorizing `identity:delete_project(project_id=a4f3887fa28c457390f5b66615564430)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6d1f20-4bc2-4059-9d29-d7c2f9992ea9 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-ec6d1f20-4bc2-4059-9d29-d7c2f9992ea9 None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4f3887fa28c457390f5b66615564430', 'request_id': 'req-ec6d1f20-4bc2-4059-9d29-d7c2f9992ea9'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-ec6d1f20-4bc2-4059-9d29-d7c2f9992ea9 None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4f3887fa28c457390f5b66615564430', 'request_id': 'req-ec6d1f20-4bc2-4059-9d29-d7c2f9992ea9'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-ec6d1f20-4bc2-4059-9d29-d7c2f9992ea9 None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4f3887fa28c457390f5b66615564430', 'request_id': 'req-ec6d1f20-4bc2-4059-9d29-d7c2f9992ea9'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-ec6d1f20-4bc2-4059-9d29-d7c2f9992ea9 None admin] The token cache is being invalidate because project a4f3887fa28c457390f5b66615564430 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 13:02:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-ec6d1f20-4bc2-4059-9d29-d7c2f9992ea9 None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-ec6d1f20-4bc2-4059-9d29-d7c2f9992ea9 None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:30 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1678/3387] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 13:02:30 2024] DELETE /identity/v3/projects/a4f3887fa28c457390f5b66615564430 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:02:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa55a12b-f070-4117-b83b-f6f27d3d81b8 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa55a12b-f070-4117-b83b-f6f27d3d81b8 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa55a12b-f070-4117-b83b-f6f27d3d81b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:30 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-aa55a12b-f070-4117-b83b-f6f27d3d81b8 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 13:02:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-aa55a12b-f070-4117-b83b-f6f27d3d81b8 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 13:02:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-aa55a12b-f070-4117-b83b-f6f27d3d81b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:02:30 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1710/3388] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 13:02:30 2024] POST /identity/v3/auth/tokens => generated 312 bytes in 20 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 28 13:02:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf4e02b-3f50-45d0-8edb-3acdfbca0a00 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf4e02b-3f50-45d0-8edb-3acdfbca0a00 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf4e02b-3f50-45d0-8edb-3acdfbca0a00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:30 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-4cf4e02b-3f50-45d0-8edb-3acdfbca0a00 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 13:02:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-4cf4e02b-3f50-45d0-8edb-3acdfbca0a00 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 13:02:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-4cf4e02b-3f50-45d0-8edb-3acdfbca0a00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:02:30 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-03fb80f7-6b9a-435a-82ad-055f9898d4ca tempest-SharesNegativeTest-1014773059 tempest-SharesNegativeTest-1014773059-project-member] GET http://10.27.203.238/share/v2/d1d71dc9f23c4c6a8e146d99ad65ebb2/snapshots/79b46976-8aab-4859-b7c0-b71cf76c2cc2 May 28 13:02:30 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-03fb80f7-6b9a-435a-82ad-055f9898d4ca tempest-SharesNegativeTest-1014773059 tempest-SharesNegativeTest-1014773059-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:02:30 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-03fb80f7-6b9a-435a-82ad-055f9898d4ca tempest-SharesNegativeTest-1014773059 tempest-SharesNegativeTest-1014773059-project-member] Calling method 'ShareSnapshotMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:02:30 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1679/3389] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 13:02:30 2024] POST /identity/v3/auth/tokens => generated 2960 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 13:02:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa55a12b-f070-4117-b83b-f6f27d3d81b8 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa55a12b-f070-4117-b83b-f6f27d3d81b8 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312714e2-818e-476c-9928-6341fa59e9fe None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312714e2-818e-476c-9928-6341fa59e9fe None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312714e2-818e-476c-9928-6341fa59e9fe None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312714e2-818e-476c-9928-6341fa59e9fe None admin] PATH_INFO: `/v3/domains` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312714e2-818e-476c-9928-6341fa59e9fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=51267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 13:02:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312714e2-818e-476c-9928-6341fa59e9fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312714e2-818e-476c-9928-6341fa59e9fe None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:30 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1711/3390] 10.27.203.238 () {62 vars in 1220 bytes} [Tue May 28 13:02:30 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 13:02:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf4e02b-3f50-45d0-8edb-3acdfbca0a00 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:30 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-03fb80f7-6b9a-435a-82ad-055f9898d4ca tempest-SharesNegativeTest-1014773059 tempest-SharesNegativeTest-1014773059-project-member] http://10.27.203.238/share/v2/d1d71dc9f23c4c6a8e146d99ad65ebb2/snapshots/79b46976-8aab-4859-b7c0-b71cf76c2cc2 returned with HTTP 200 May 28 13:02:30 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1249/2475] 10.27.203.238 () {64 vars in 1460 bytes} [Tue May 28 13:02:30 2024] GET /share/v2/d1d71dc9f23c4c6a8e146d99ad65ebb2/snapshots/79b46976-8aab-4859-b7c0-b71cf76c2cc2 => generated 723 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:02:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf4e02b-3f50-45d0-8edb-3acdfbca0a00 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f515023c-0305-4657-908c-d230a8dc5aaf None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f515023c-0305-4657-908c-d230a8dc5aaf None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f515023c-0305-4657-908c-d230a8dc5aaf None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f515023c-0305-4657-908c-d230a8dc5aaf None admin] PATH_INFO: `/v3/projects` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f515023c-0305-4657-908c-d230a8dc5aaf None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f515023c-0305-4657-908c-d230a8dc5aaf None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:30 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1680/3391] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 13:02:30 2024] POST /identity/v3/projects => generated 395 bytes in 32 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 13:02:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312714e2-818e-476c-9928-6341fa59e9fe None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312714e2-818e-476c-9928-6341fa59e9fe None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f845f8-7e87-4065-9848-23ee9db0a4bf None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f845f8-7e87-4065-9848-23ee9db0a4bf None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f845f8-7e87-4065-9848-23ee9db0a4bf None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f845f8-7e87-4065-9848-23ee9db0a4bf None admin] PATH_INFO: `/v3/users` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f845f8-7e87-4065-9848-23ee9db0a4bf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f845f8-7e87-4065-9848-23ee9db0a4bf None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:30 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-d0f845f8-7e87-4065-9848-23ee9db0a4bf None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 13:02:30 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1712/3392] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 13:02:30 2024] POST /identity/v3/users => generated 306 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 13:02:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f515023c-0305-4657-908c-d230a8dc5aaf None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f515023c-0305-4657-908c-d230a8dc5aaf None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668a2ff1-5675-4ab0-af35-b6c215f7979d None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668a2ff1-5675-4ab0-af35-b6c215f7979d None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668a2ff1-5675-4ab0-af35-b6c215f7979d None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668a2ff1-5675-4ab0-af35-b6c215f7979d None admin] PATH_INFO: `/v3/roles` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668a2ff1-5675-4ab0-af35-b6c215f7979d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668a2ff1-5675-4ab0-af35-b6c215f7979d None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:30 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1681/3393] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 13:02:30 2024] GET /identity/v3/roles => generated 1680 bytes in 16 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 13:02:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f845f8-7e87-4065-9848-23ee9db0a4bf None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f845f8-7e87-4065-9848-23ee9db0a4bf None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc119ac-806f-40f0-81f9-254cec4f4e92 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc119ac-806f-40f0-81f9-254cec4f4e92 None admin] REQUEST_METHOD: `PUT` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc119ac-806f-40f0-81f9-254cec4f4e92 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc119ac-806f-40f0-81f9-254cec4f4e92 None admin] PATH_INFO: `/v3/projects/8395275cc0594abf835d1c8fc8f8b886/users/e0671958a4a14bc087111379d482ae30/roles/44620cad10ae407c90c91e2c296adb04` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc119ac-806f-40f0-81f9-254cec4f4e92 None admin] RBAC: Authorizing `identity:create_grant(project_id=8395275cc0594abf835d1c8fc8f8b886, user_id=e0671958a4a14bc087111379d482ae30, role_id=44620cad10ae407c90c91e2c296adb04)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc119ac-806f-40f0-81f9-254cec4f4e92 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:30 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1713/3394] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 13:02:30 2024] PUT /identity/v3/projects/8395275cc0594abf835d1c8fc8f8b886/users/e0671958a4a14bc087111379d482ae30/roles/44620cad10ae407c90c91e2c296adb04 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:02:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d65318a-37c0-4840-83ce-f433909a3433 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d65318a-37c0-4840-83ce-f433909a3433 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d65318a-37c0-4840-83ce-f433909a3433 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:30 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-5d65318a-37c0-4840-83ce-f433909a3433 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 13:02:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-5d65318a-37c0-4840-83ce-f433909a3433 None None] MFA Rules not processed for user `e0671958a4a14bc087111379d482ae30`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 13:02:30 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-5d65318a-37c0-4840-83ce-f433909a3433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:02:30 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1682/3395] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 13:02:30 2024] POST /identity/v3/auth/tokens => generated 3966 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 13:02:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc119ac-806f-40f0-81f9-254cec4f4e92 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-6bc119ac-806f-40f0-81f9-254cec4f4e92 None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:02:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc119ac-806f-40f0-81f9-254cec4f4e92 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d265d14-48b4-44d9-ae56-7fb410afb92a service manila] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f110cf6300f049c897d0aab63218d1e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d265d14-48b4-44d9-ae56-7fb410afb92a service manila] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d265d14-48b4-44d9-ae56-7fb410afb92a service manila] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d265d14-48b4-44d9-ae56-7fb410afb92a service manila] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d265d14-48b4-44d9-ae56-7fb410afb92a service manila] RBAC: Authorizing `identity:validate_token()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:30 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d265d14-48b4-44d9-ae56-7fb410afb92a service manila] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:30 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1714/3396] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 13:02:30 2024] GET /identity/v3/auth/tokens => generated 3966 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 13:02:30 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-c42a5a2a-3958-49c5-8157-4f7421ef6337 tempest-ShareRulesAPIOnlyNegativeTest-392477154 tempest-ShareRulesAPIOnlyNegativeTest-392477154-project-member] POST http://10.27.203.238/share/v1/8395275cc0594abf835d1c8fc8f8b886/shares/wrong_share_id/action May 28 13:02:30 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-c42a5a2a-3958-49c5-8157-4f7421ef6337 tempest-ShareRulesAPIOnlyNegativeTest-392477154 tempest-ShareRulesAPIOnlyNegativeTest-392477154-project-member] Action body: b'{"os-allow_access": {"access_type": "ip", "access_to": "0.0.0.0", "access_level": null}}' {{(pid=98330) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 13:02:30 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-c42a5a2a-3958-49c5-8157-4f7421ef6337 tempest-ShareRulesAPIOnlyNegativeTest-392477154 tempest-ShareRulesAPIOnlyNegativeTest-392477154-project-member] Action: 'action', calling method: ShareController.allow_access, body: {"os-allow_access": {"access_type": "ip", "access_to": "0.0.0.0", "access_level": null}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:02:30 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault [None req-c42a5a2a-3958-49c5-8157-4f7421ef6337 tempest-ShareRulesAPIOnlyNegativeTest-392477154 tempest-ShareRulesAPIOnlyNegativeTest-392477154-project-member] Caught error: Resource could not be found.: manila.exception.NotFound: Resource could not be found. May 28 13:02:30 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault Traceback (most recent call last): May 28 13:02:30 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/api/middleware/fault.py", line 76, in __call__ May 28 13:02:30 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return req.get_response(self.application) May 28 13:02:30 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/request.py", line 1313, in send May 28 13:02:30 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault status, headers, app_iter = self.call_application( May 28 13:02:30 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/request.py", line 1278, in call_application May 28 13:02:30 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault app_iter = application(self.environ, start_response) May 28 13:02:30 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 129, in __call__ May 28 13:02:30 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault resp = self.call_func(req, *args, **kw) May 28 13:02:30 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 193, in call_func May 28 13:02:30 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return self.func(req, *args, **kwargs) May 28 13:02:30 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_middleware/base.py", line 124, in __call__ May 28 13:02:30 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault response = req.get_response(self.application) May 28 13:02:30 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/request.py", line 1313, in send May 28 13:02:30 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault status, headers, app_iter = self.call_application( May 28 13:02:30 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/request.py", line 1278, in call_application May 28 13:02:30 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault app_iter = application(self.environ, start_response) May 28 13:02:30 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 143, in __call__ May 28 13:02:30 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return resp(environ, start_response) May 28 13:02:30 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 129, in __call__ May 28 13:02:30 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault resp = self.call_func(req, *args, **kw) May 28 13:02:30 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 193, in call_func May 28 13:02:30 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return self.func(req, *args, **kwargs) May 28 13:02:30 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/osprofiler/web.py", line 111, in __call__ May 28 13:02:30 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return request.get_response(self.application) May 28 13:02:30 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/request.py", line 1313, in send May 28 13:02:30 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault status, headers, app_iter = self.call_application( May 28 13:02:30 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/request.py", line 1278, in call_application May 28 13:02:30 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault app_iter = application(self.environ, start_response) May 28 13:02:30 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 129, in __call__ May 28 13:02:30 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault resp = self.call_func(req, *args, **kw) May 28 13:02:30 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 193, in call_func May 28 13:02:30 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return self.func(req, *args, **kwargs) May 28 13:02:30 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py", line 340, in __call__ May 28 13:02:30 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault response = req.get_response(self._app) May 28 13:02:30 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/request.py", line 1313, in send May 28 13:02:30 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault status, headers, app_iter = self.call_application( May 28 13:02:30 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/request.py", line 1278, in call_application May 28 13:02:30 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault app_iter = application(self.environ, start_response) May 28 13:02:30 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 143, in __call__ May 28 13:02:30 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return resp(environ, start_response) May 28 13:02:30 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 143, in __call__ May 28 13:02:30 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return resp(environ, start_response) May 28 13:02:30 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/routes/middleware.py", line 153, in __call__ May 28 13:02:30 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault response = self.app(environ, start_response) May 28 13:02:30 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 143, in __call__ May 28 13:02:30 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return resp(environ, start_response) May 28 13:02:30 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 129, in __call__ May 28 13:02:30 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault resp = self.call_func(req, *args, **kw) May 28 13:02:30 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 193, in call_func May 28 13:02:30 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return self.func(req, *args, **kwargs) May 28 13:02:30 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/api/openstack/wsgi.py", line 764, in __call__ May 28 13:02:30 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return self._process_stack(request, action, action_args, May 28 13:02:30 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/api/openstack/wsgi.py", line 829, in _process_stack May 28 13:02:30 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault action_result = self.dispatch(meth, request, action_args) May 28 13:02:30 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/api/openstack/wsgi.py", line 924, in dispatch May 28 13:02:30 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return method(req=request, **action_args) May 28 13:02:30 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/api/v1/shares.py", line 777, in allow_access May 28 13:02:30 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return self._allow_access(req, id, body) May 28 13:02:30 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/api/openstack/wsgi.py", line 1160, in wrapper May 28 13:02:30 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return f(self, req, *args, **kwargs) May 28 13:02:30 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/api/v1/shares.py", line 529, in _allow_access May 28 13:02:30 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault share = self.share_api.get(context, id) May 28 13:02:30 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/share/api.py", line 2211, in get May 28 13:02:30 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault rv = self.db.share_get(context, share_id) May 28 13:02:30 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/db/api.py", line 404, in share_get May 28 13:02:30 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return IMPL.share_get(context, share_id, **kwargs) May 28 13:02:30 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/db/sqlalchemy/api.py", line 166, in wrapper May 28 13:02:30 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return f(*args, **kwargs) May 28 13:02:30 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/enginefacade.py", line 998, in wrapper May 28 13:02:30 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return fn(*args, **kwargs) May 28 13:02:30 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/db/sqlalchemy/api.py", line 2367, in share_get May 28 13:02:30 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault return _share_get(context, share_id, **kwargs) May 28 13:02:30 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/db/sqlalchemy/api.py", line 2378, in _share_get May 28 13:02:30 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault raise exception.NotFound() May 28 13:02:30 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault manila.exception.NotFound: Resource could not be found. May 28 13:02:30 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.middleware.fault May 28 13:02:30 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.middleware.fault [None req-c42a5a2a-3958-49c5-8157-4f7421ef6337 tempest-ShareRulesAPIOnlyNegativeTest-392477154 tempest-ShareRulesAPIOnlyNegativeTest-392477154-project-member] http://10.27.203.238/share/v1/8395275cc0594abf835d1c8fc8f8b886/shares/wrong_share_id/action returned with HTTP 404 May 28 13:02:30 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1227/2476] 10.27.203.238 () {64 vars in 1384 bytes} [Tue May 28 13:02:30 2024] POST /share/v1/8395275cc0594abf835d1c8fc8f8b886/shares/wrong_share_id/action => generated 84 bytes in 74 msecs (HTTP/1.1 404) 6 headers in 236 bytes (1 switches on core 0) May 28 13:02:30 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-a99ac7a9-5619-4ede-a7f5-52811e2fc9b7 tempest-ShareRulesAPIOnlyNegativeTest-392477154 tempest-ShareRulesAPIOnlyNegativeTest-392477154-project-member] POST http://10.27.203.238/share/v2/8395275cc0594abf835d1c8fc8f8b886/shares/wrong_share_id/action May 28 13:02:30 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-a99ac7a9-5619-4ede-a7f5-52811e2fc9b7 tempest-ShareRulesAPIOnlyNegativeTest-392477154 tempest-ShareRulesAPIOnlyNegativeTest-392477154-project-member] Action body: b'{"allow_access": {"access_type": "ip", "access_to": "0.0.0.0", "access_level": null}}' {{(pid=98329) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 13:02:30 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-a99ac7a9-5619-4ede-a7f5-52811e2fc9b7 tempest-ShareRulesAPIOnlyNegativeTest-392477154 tempest-ShareRulesAPIOnlyNegativeTest-392477154-project-member] Action: 'action', calling method: ShareController.allow_access, body: {"allow_access": {"access_type": "ip", "access_to": "0.0.0.0", "access_level": null}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:02:30 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault [None req-a99ac7a9-5619-4ede-a7f5-52811e2fc9b7 tempest-ShareRulesAPIOnlyNegativeTest-392477154 tempest-ShareRulesAPIOnlyNegativeTest-392477154-project-member] Caught error: Resource could not be found.: manila.exception.NotFound: Resource could not be found. May 28 13:02:30 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault Traceback (most recent call last): May 28 13:02:30 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/api/middleware/fault.py", line 76, in __call__ May 28 13:02:30 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault return req.get_response(self.application) May 28 13:02:30 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/request.py", line 1313, in send May 28 13:02:30 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault status, headers, app_iter = self.call_application( May 28 13:02:30 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/request.py", line 1278, in call_application May 28 13:02:30 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault app_iter = application(self.environ, start_response) May 28 13:02:30 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 129, in __call__ May 28 13:02:30 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault resp = self.call_func(req, *args, **kw) May 28 13:02:30 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 193, in call_func May 28 13:02:30 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault return self.func(req, *args, **kwargs) May 28 13:02:30 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_middleware/base.py", line 124, in __call__ May 28 13:02:30 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault response = req.get_response(self.application) May 28 13:02:30 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/request.py", line 1313, in send May 28 13:02:30 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault status, headers, app_iter = self.call_application( May 28 13:02:30 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/request.py", line 1278, in call_application May 28 13:02:30 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault app_iter = application(self.environ, start_response) May 28 13:02:30 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 143, in __call__ May 28 13:02:30 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault return resp(environ, start_response) May 28 13:02:30 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 129, in __call__ May 28 13:02:30 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault resp = self.call_func(req, *args, **kw) May 28 13:02:30 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 193, in call_func May 28 13:02:30 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault return self.func(req, *args, **kwargs) May 28 13:02:30 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/osprofiler/web.py", line 111, in __call__ May 28 13:02:30 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault return request.get_response(self.application) May 28 13:02:30 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/request.py", line 1313, in send May 28 13:02:30 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault status, headers, app_iter = self.call_application( May 28 13:02:30 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/request.py", line 1278, in call_application May 28 13:02:30 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault app_iter = application(self.environ, start_response) May 28 13:02:30 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 129, in __call__ May 28 13:02:30 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault resp = self.call_func(req, *args, **kw) May 28 13:02:30 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 193, in call_func May 28 13:02:30 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault return self.func(req, *args, **kwargs) May 28 13:02:30 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py", line 340, in __call__ May 28 13:02:30 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault response = req.get_response(self._app) May 28 13:02:30 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/request.py", line 1313, in send May 28 13:02:30 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault status, headers, app_iter = self.call_application( May 28 13:02:30 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/request.py", line 1278, in call_application May 28 13:02:30 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault app_iter = application(self.environ, start_response) May 28 13:02:30 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 143, in __call__ May 28 13:02:30 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault return resp(environ, start_response) May 28 13:02:30 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 143, in __call__ May 28 13:02:30 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault return resp(environ, start_response) May 28 13:02:30 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/routes/middleware.py", line 153, in __call__ May 28 13:02:30 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault response = self.app(environ, start_response) May 28 13:02:30 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 143, in __call__ May 28 13:02:30 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault return resp(environ, start_response) May 28 13:02:30 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 129, in __call__ May 28 13:02:30 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault resp = self.call_func(req, *args, **kw) May 28 13:02:30 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/webob/dec.py", line 193, in call_func May 28 13:02:30 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault return self.func(req, *args, **kwargs) May 28 13:02:30 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/api/openstack/wsgi.py", line 764, in __call__ May 28 13:02:30 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault return self._process_stack(request, action, action_args, May 28 13:02:30 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/api/openstack/wsgi.py", line 829, in _process_stack May 28 13:02:30 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault action_result = self.dispatch(meth, request, action_args) May 28 13:02:30 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/api/openstack/wsgi.py", line 924, in dispatch May 28 13:02:30 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault return method(req=request, **action_args) May 28 13:02:30 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/api/openstack/wsgi.py", line 1066, in version_select May 28 13:02:30 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault return func.func(self, *args, **kwargs) May 28 13:02:30 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/api/v2/shares.py", line 495, in allow_access May 28 13:02:30 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault return self._allow_access(*args, **kwargs) May 28 13:02:30 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/api/openstack/wsgi.py", line 1160, in wrapper May 28 13:02:30 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault return f(self, req, *args, **kwargs) May 28 13:02:30 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/api/v1/shares.py", line 529, in _allow_access May 28 13:02:30 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault share = self.share_api.get(context, id) May 28 13:02:30 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/share/api.py", line 2211, in get May 28 13:02:30 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault rv = self.db.share_get(context, share_id) May 28 13:02:30 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/db/api.py", line 404, in share_get May 28 13:02:30 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault return IMPL.share_get(context, share_id, **kwargs) May 28 13:02:30 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/db/sqlalchemy/api.py", line 166, in wrapper May 28 13:02:30 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault return f(*args, **kwargs) May 28 13:02:30 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/enginefacade.py", line 998, in wrapper May 28 13:02:30 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault return fn(*args, **kwargs) May 28 13:02:30 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/db/sqlalchemy/api.py", line 2367, in share_get May 28 13:02:30 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault return _share_get(context, share_id, **kwargs) May 28 13:02:30 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault File "/opt/stack/manila/manila/db/sqlalchemy/api.py", line 2378, in _share_get May 28 13:02:30 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault raise exception.NotFound() May 28 13:02:30 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault manila.exception.NotFound: Resource could not be found. May 28 13:02:30 l75lg1-v1 devstack@m-api.service[98329]: ERROR manila.api.middleware.fault May 28 13:02:30 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.middleware.fault [None req-a99ac7a9-5619-4ede-a7f5-52811e2fc9b7 tempest-ShareRulesAPIOnlyNegativeTest-392477154 tempest-ShareRulesAPIOnlyNegativeTest-392477154-project-member] http://10.27.203.238/share/v2/8395275cc0594abf835d1c8fc8f8b886/shares/wrong_share_id/action returned with HTTP 404 May 28 13:02:30 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1250/2477] 10.27.203.238 () {66 vars in 1427 bytes} [Tue May 28 13:02:30 2024] POST /share/v2/8395275cc0594abf835d1c8fc8f8b886/shares/wrong_share_id/action => generated 84 bytes in 16 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 13:02:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d65318a-37c0-4840-83ce-f433909a3433 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d65318a-37c0-4840-83ce-f433909a3433 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06330313-a73c-4d9d-a7f9-d56ac0b982f6 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06330313-a73c-4d9d-a7f9-d56ac0b982f6 None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06330313-a73c-4d9d-a7f9-d56ac0b982f6 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06330313-a73c-4d9d-a7f9-d56ac0b982f6 None admin] PATH_INFO: `/v3/users/e0671958a4a14bc087111379d482ae30` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06330313-a73c-4d9d-a7f9-d56ac0b982f6 None admin] RBAC: Authorizing `identity:delete_user(user_id=e0671958a4a14bc087111379d482ae30)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06330313-a73c-4d9d-a7f9-d56ac0b982f6 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-06330313-a73c-4d9d-a7f9-d56ac0b982f6 None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0671958a4a14bc087111379d482ae30', 'request_id': 'req-06330313-a73c-4d9d-a7f9-d56ac0b982f6'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-06330313-a73c-4d9d-a7f9-d56ac0b982f6 None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0671958a4a14bc087111379d482ae30', 'request_id': 'req-06330313-a73c-4d9d-a7f9-d56ac0b982f6'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-06330313-a73c-4d9d-a7f9-d56ac0b982f6 None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0671958a4a14bc087111379d482ae30', 'request_id': 'req-06330313-a73c-4d9d-a7f9-d56ac0b982f6'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-06330313-a73c-4d9d-a7f9-d56ac0b982f6 None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0671958a4a14bc087111379d482ae30', 'request_id': 'req-06330313-a73c-4d9d-a7f9-d56ac0b982f6'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-06330313-a73c-4d9d-a7f9-d56ac0b982f6 None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0671958a4a14bc087111379d482ae30', 'request_id': 'req-06330313-a73c-4d9d-a7f9-d56ac0b982f6'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:31 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1683/3397] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 13:02:31 2024] DELETE /identity/v3/users/e0671958a4a14bc087111379d482ae30 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:02:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e11b14-09cf-480f-8a63-0cf0cc938788 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e11b14-09cf-480f-8a63-0cf0cc938788 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e11b14-09cf-480f-8a63-0cf0cc938788 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:31 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-81e11b14-09cf-480f-8a63-0cf0cc938788 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 13:02:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-81e11b14-09cf-480f-8a63-0cf0cc938788 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 13:02:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-81e11b14-09cf-480f-8a63-0cf0cc938788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:02:31 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-42da0038-d60b-44c3-af1c-fb115a626b57 tempest-SharesNegativeTest-1014773059 None] <<< [POST] https://127.0.0.1:40443/api/snapshots/ May 28 13:02:31 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-42da0038-d60b-44c3-af1c-fb115a626b57 tempest-SharesNegativeTest-1014773059 None] Bunch(access_path='/.vast_all_snapshots/1000000016_share-snapshot-9552655b-8df3-477b-913a-f9d1bef42b62', aggr_phys_estimation=0, cluster='loop75-kfs', created='2024-05-28T13:02:28.356145Z', eta_sec=30819898646.85436, expiration_time='3001-01-19T07:59:58Z', guid='36a0a02f-9da1-411a-a4d9-f680af4d4a99', id=17, indestructible=False, locked=False, name='share-snapshot-9552655b-8df3-477b-913a-f9d1bef42b62', path='/manila/manila-27c3f247-5cdb-4bb3-9479-7b3253f9df42/', policy=None, policy_id=None, protection_policy_id=None, state='SUCCEED', tenant_id=1, tenant_name='default', title='share-snapshot-9552655b-8df3-477b-913a-f9d1bef42b62(/manila/manila-27c3f247-5cdb-4bb3-9479-7b3253f9df42/)', type='local', unique_phys_estimation=0, url='https://127.0.0.1:40443/api/snapshots/17/') May 28 13:02:31 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-42da0038-d60b-44c3-af1c-fb115a626b57 tempest-SharesNegativeTest-1014773059 None] --- [POST] https://127.0.0.1:40443/api/snapshots/: Done May 28 13:02:31 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1715/3398] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 13:02:31 2024] POST /identity/v3/auth/tokens => generated 2960 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 13:02:31 l75lg1-v1 neutron-server[77618]: DEBUG neutron.wsgi [-] (77618) accepted ('10.27.203.238', 46468) {{(pid=77618) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 13:02:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06330313-a73c-4d9d-a7f9-d56ac0b982f6 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-06330313-a73c-4d9d-a7f9-d56ac0b982f6 None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:02:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06330313-a73c-4d9d-a7f9-d56ac0b982f6 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8d10cf-38c5-4ef8-b79e-ed656402f3fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef17047035e4b518fd5360a01f2da1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8d10cf-38c5-4ef8-b79e-ed656402f3fe service neutron] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8d10cf-38c5-4ef8-b79e-ed656402f3fe service neutron] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8d10cf-38c5-4ef8-b79e-ed656402f3fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8d10cf-38c5-4ef8-b79e-ed656402f3fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8d10cf-38c5-4ef8-b79e-ed656402f3fe service neutron] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:31 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1684/3399] 10.27.203.238 () {64 vars in 1432 bytes} [Tue May 28 13:02:31 2024] GET /identity/v3/auth/tokens => generated 2960 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 28 13:02:31 l75lg1-v1 neutron-server[77618]: INFO neutron.wsgi [None req-3a4610b9-17c3-47e2-b9f2-a9d9c8eb9fab None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=8395275cc0594abf835d1c8fc8f8b886&name=default HTTP/1.1" status: 200 len: 216 time: 0.0724649 May 28 13:02:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e11b14-09cf-480f-8a63-0cf0cc938788 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-81e11b14-09cf-480f-8a63-0cf0cc938788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:02:31 l75lg1-v1 dstat.sh[49771]: 28-05 13:02:31| 10 1 85 1 0|5644M 1780M 278M 7922M| 18k 2694B| 0 1660k| 0 240 |7739 13k|1.12 1.15 1.06|1.0 0 0| 0 0 | 0 2048M| 29 364 0 35 2 May 28 13:02:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e11b14-09cf-480f-8a63-0cf0cc938788 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05cff7c-444c-4bc1-92e2-a42f92c20be7 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05cff7c-444c-4bc1-92e2-a42f92c20be7 None admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05cff7c-444c-4bc1-92e2-a42f92c20be7 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05cff7c-444c-4bc1-92e2-a42f92c20be7 None admin] PATH_INFO: `/v3/projects/8395275cc0594abf835d1c8fc8f8b886` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05cff7c-444c-4bc1-92e2-a42f92c20be7 None admin] RBAC: Authorizing `identity:delete_project(project_id=8395275cc0594abf835d1c8fc8f8b886)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05cff7c-444c-4bc1-92e2-a42f92c20be7 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-a05cff7c-444c-4bc1-92e2-a42f92c20be7 None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8395275cc0594abf835d1c8fc8f8b886', 'request_id': 'req-a05cff7c-444c-4bc1-92e2-a42f92c20be7'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-a05cff7c-444c-4bc1-92e2-a42f92c20be7 None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8395275cc0594abf835d1c8fc8f8b886', 'request_id': 'req-a05cff7c-444c-4bc1-92e2-a42f92c20be7'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-a05cff7c-444c-4bc1-92e2-a42f92c20be7 None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8395275cc0594abf835d1c8fc8f8b886', 'request_id': 'req-a05cff7c-444c-4bc1-92e2-a42f92c20be7'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-a05cff7c-444c-4bc1-92e2-a42f92c20be7 None admin] The token cache is being invalidate because project 8395275cc0594abf835d1c8fc8f8b886 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 13:02:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-a05cff7c-444c-4bc1-92e2-a42f92c20be7 None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-a05cff7c-444c-4bc1-92e2-a42f92c20be7 None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:31 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1716/3400] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 13:02:31 2024] DELETE /identity/v3/projects/8395275cc0594abf835d1c8fc8f8b886 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:02:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecaf909-0f06-4e40-8d9b-f9d08ac0de97 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecaf909-0f06-4e40-8d9b-f9d08ac0de97 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecaf909-0f06-4e40-8d9b-f9d08ac0de97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:31 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-cecaf909-0f06-4e40-8d9b-f9d08ac0de97 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 13:02:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-cecaf909-0f06-4e40-8d9b-f9d08ac0de97 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 13:02:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-cecaf909-0f06-4e40-8d9b-f9d08ac0de97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:02:31 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1685/3401] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 13:02:31 2024] POST /identity/v3/auth/tokens => generated 312 bytes in 19 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 28 13:02:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f4f311-f47e-4c70-94af-d35dfcfbda58 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f4f311-f47e-4c70-94af-d35dfcfbda58 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f4f311-f47e-4c70-94af-d35dfcfbda58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:31 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-c7f4f311-f47e-4c70-94af-d35dfcfbda58 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 13:02:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-c7f4f311-f47e-4c70-94af-d35dfcfbda58 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 13:02:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-c7f4f311-f47e-4c70-94af-d35dfcfbda58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:02:31 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1717/3402] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 13:02:31 2024] POST /identity/v3/auth/tokens => generated 2960 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 13:02:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecaf909-0f06-4e40-8d9b-f9d08ac0de97 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecaf909-0f06-4e40-8d9b-f9d08ac0de97 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9d5198-67ac-484f-ab51-90a50258dfe6 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9d5198-67ac-484f-ab51-90a50258dfe6 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9d5198-67ac-484f-ab51-90a50258dfe6 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9d5198-67ac-484f-ab51-90a50258dfe6 None admin] PATH_INFO: `/v3/domains` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9d5198-67ac-484f-ab51-90a50258dfe6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 13:02:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9d5198-67ac-484f-ab51-90a50258dfe6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9d5198-67ac-484f-ab51-90a50258dfe6 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:31 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1686/3403] 10.27.203.238 () {62 vars in 1220 bytes} [Tue May 28 13:02:31 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 13:02:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f4f311-f47e-4c70-94af-d35dfcfbda58 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f4f311-f47e-4c70-94af-d35dfcfbda58 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:31 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-6368ed47-f412-497e-b6ba-0c1376094831 tempest-ShareSnapshotMetadataNegativeTest-1199544441 tempest-ShareSnapshotMetadataNegativeTest-1199544441-project-member] GET http://10.27.203.238/share/v2/b00df7df3db14cce99343fc7f6ffd796/shares/1f5b6f0f-f341-4964-a2fa-9c4a26198f95 May 28 13:02:31 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-6368ed47-f412-497e-b6ba-0c1376094831 tempest-ShareSnapshotMetadataNegativeTest-1199544441 tempest-ShareSnapshotMetadataNegativeTest-1199544441-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:02:31 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-6368ed47-f412-497e-b6ba-0c1376094831 tempest-ShareSnapshotMetadataNegativeTest-1199544441 tempest-ShareSnapshotMetadataNegativeTest-1199544441-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:02:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66e987d-4a16-4a88-9522-107ed89875a6 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66e987d-4a16-4a88-9522-107ed89875a6 None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66e987d-4a16-4a88-9522-107ed89875a6 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66e987d-4a16-4a88-9522-107ed89875a6 None admin] PATH_INFO: `/v3/projects` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66e987d-4a16-4a88-9522-107ed89875a6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66e987d-4a16-4a88-9522-107ed89875a6 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:31 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-6368ed47-f412-497e-b6ba-0c1376094831 tempest-ShareSnapshotMetadataNegativeTest-1199544441 tempest-ShareSnapshotMetadataNegativeTest-1199544441-project-member] http://10.27.203.238/share/v2/b00df7df3db14cce99343fc7f6ffd796/shares/1f5b6f0f-f341-4964-a2fa-9c4a26198f95 returned with HTTP 200 May 28 13:02:31 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1228/2478] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:02:31 2024] GET /share/v2/b00df7df3db14cce99343fc7f6ffd796/shares/1f5b6f0f-f341-4964-a2fa-9c4a26198f95 => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:02:31 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1718/3404] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 13:02:31 2024] POST /identity/v3/projects => generated 385 bytes in 34 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 13:02:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9d5198-67ac-484f-ab51-90a50258dfe6 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9d5198-67ac-484f-ab51-90a50258dfe6 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daa60a6-5f4f-409e-9e62-da2f9ec47975 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daa60a6-5f4f-409e-9e62-da2f9ec47975 None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daa60a6-5f4f-409e-9e62-da2f9ec47975 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daa60a6-5f4f-409e-9e62-da2f9ec47975 None admin] PATH_INFO: `/v3/users` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2daa60a6-5f4f-409e-9e62-da2f9ec47975 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2daa60a6-5f4f-409e-9e62-da2f9ec47975 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:31 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-2daa60a6-5f4f-409e-9e62-da2f9ec47975 None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 13:02:31 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8a0cf0b1-beee-4dd4-b33f-336d3231f70d tempest-ShareSnapshotMetadataNegativeTest-1199544441 None] <<< [DELETE] https://127.0.0.1:40443/api/viewpolicies/56/ May 28 13:02:31 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8a0cf0b1-beee-4dd4-b33f-336d3231f70d tempest-ShareSnapshotMetadataNegativeTest-1199544441 None] --- [DELETE] https://127.0.0.1:40443/api/viewpolicies/56/: Done May 28 13:02:31 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1687/3405] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 13:02:31 2024] POST /identity/v3/users => generated 301 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 13:02:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66e987d-4a16-4a88-9522-107ed89875a6 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66e987d-4a16-4a88-9522-107ed89875a6 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04541312-f632-4ca0-9cdd-9446d1c314e1 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04541312-f632-4ca0-9cdd-9446d1c314e1 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04541312-f632-4ca0-9cdd-9446d1c314e1 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04541312-f632-4ca0-9cdd-9446d1c314e1 None admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04541312-f632-4ca0-9cdd-9446d1c314e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04541312-f632-4ca0-9cdd-9446d1c314e1 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:31 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1719/3406] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 13:02:31 2024] GET /identity/v3/roles => generated 1680 bytes in 18 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 13:02:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daa60a6-5f4f-409e-9e62-da2f9ec47975 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daa60a6-5f4f-409e-9e62-da2f9ec47975 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6452f6a-9934-4e28-8cca-dc401f25c05f None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6452f6a-9934-4e28-8cca-dc401f25c05f None admin] REQUEST_METHOD: `PUT` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6452f6a-9934-4e28-8cca-dc401f25c05f None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6452f6a-9934-4e28-8cca-dc401f25c05f None admin] PATH_INFO: `/v3/projects/73ff30a3b10d4ca099fc7022b36d49d9/users/c8a21d958df34c999582f2c925e1553b/roles/44620cad10ae407c90c91e2c296adb04` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6452f6a-9934-4e28-8cca-dc401f25c05f None admin] RBAC: Authorizing `identity:create_grant(project_id=73ff30a3b10d4ca099fc7022b36d49d9, user_id=c8a21d958df34c999582f2c925e1553b, role_id=44620cad10ae407c90c91e2c296adb04)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6452f6a-9934-4e28-8cca-dc401f25c05f None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:31 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1688/3407] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 13:02:31 2024] PUT /identity/v3/projects/73ff30a3b10d4ca099fc7022b36d49d9/users/c8a21d958df34c999582f2c925e1553b/roles/44620cad10ae407c90c91e2c296adb04 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:02:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d261d98-65e2-4f59-9da5-4d9d1db5d0f1 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d261d98-65e2-4f59-9da5-4d9d1db5d0f1 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d261d98-65e2-4f59-9da5-4d9d1db5d0f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:31 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-8d261d98-65e2-4f59-9da5-4d9d1db5d0f1 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 13:02:31 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-8a0cf0b1-beee-4dd4-b33f-336d3231f70d tempest-ShareSnapshotMetadataNegativeTest-1199544441 None] Created reservations ['a800555c-07ae-49e0-a6ec-fa400bb79749', 'e3ea7dc1-5c7b-42d4-bfbb-846aefae530c', '26990ca0-148e-432a-ae15-92ba6c5935a9', '703b1909-dfa6-42e2-aa02-ff226bdc554a'] {{(pid=98474) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 13:02:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-8d261d98-65e2-4f59-9da5-4d9d1db5d0f1 None None] MFA Rules not processed for user `c8a21d958df34c999582f2c925e1553b`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 13:02:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-8d261d98-65e2-4f59-9da5-4d9d1db5d0f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:02:31 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-8a0cf0b1-beee-4dd4-b33f-336d3231f70d tempest-ShareSnapshotMetadataNegativeTest-1199544441 None] Committed reservations ['a800555c-07ae-49e0-a6ec-fa400bb79749', 'e3ea7dc1-5c7b-42d4-bfbb-846aefae530c', '26990ca0-148e-432a-ae15-92ba6c5935a9', '703b1909-dfa6-42e2-aa02-ff226bdc554a'] {{(pid=98474) commit /opt/stack/manila/manila/quota.py:1063}} May 28 13:02:31 l75lg1-v1 manila-share[98474]: INFO manila.share.manager [None req-8a0cf0b1-beee-4dd4-b33f-336d3231f70d tempest-ShareSnapshotMetadataNegativeTest-1199544441 None] Share instance f49db035-ea92-4df4-9284-1e5ce7e3fd79: deleted successfully. May 28 13:02:31 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1720/3408] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 13:02:31 2024] POST /identity/v3/auth/tokens => generated 3956 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 13:02:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6452f6a-9934-4e28-8cca-dc401f25c05f None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6452f6a-9934-4e28-8cca-dc401f25c05f None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac20bbf-76ae-49f3-a921-20ab75a053a5 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac20bbf-76ae-49f3-a921-20ab75a053a5 None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac20bbf-76ae-49f3-a921-20ab75a053a5 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac20bbf-76ae-49f3-a921-20ab75a053a5 None admin] PATH_INFO: `/v3/projects` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac20bbf-76ae-49f3-a921-20ab75a053a5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac20bbf-76ae-49f3-a921-20ab75a053a5 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:31 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1689/3409] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 13:02:31 2024] POST /identity/v3/projects => generated 385 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 13:02:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d261d98-65e2-4f59-9da5-4d9d1db5d0f1 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d261d98-65e2-4f59-9da5-4d9d1db5d0f1 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a14529-511f-42ff-9ff6-f637af9cf80b None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a14529-511f-42ff-9ff6-f637af9cf80b None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a14529-511f-42ff-9ff6-f637af9cf80b None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a14529-511f-42ff-9ff6-f637af9cf80b None admin] PATH_INFO: `/v3/users` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a14529-511f-42ff-9ff6-f637af9cf80b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a14529-511f-42ff-9ff6-f637af9cf80b None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:31 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-83a14529-511f-42ff-9ff6-f637af9cf80b None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 13:02:31 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1721/3410] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 13:02:31 2024] POST /identity/v3/users => generated 301 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 13:02:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac20bbf-76ae-49f3-a921-20ab75a053a5 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac20bbf-76ae-49f3-a921-20ab75a053a5 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8159c275-00df-4aaf-9307-bc95f7be20b5 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8159c275-00df-4aaf-9307-bc95f7be20b5 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8159c275-00df-4aaf-9307-bc95f7be20b5 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8159c275-00df-4aaf-9307-bc95f7be20b5 None admin] PATH_INFO: `/v3/roles` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8159c275-00df-4aaf-9307-bc95f7be20b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8159c275-00df-4aaf-9307-bc95f7be20b5 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:31 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1690/3411] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 13:02:31 2024] GET /identity/v3/roles => generated 1680 bytes in 18 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 13:02:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a14529-511f-42ff-9ff6-f637af9cf80b None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a14529-511f-42ff-9ff6-f637af9cf80b None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b94ae9-ad7e-40c2-a9dd-6d0cfe96dd94 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b94ae9-ad7e-40c2-a9dd-6d0cfe96dd94 None admin] REQUEST_METHOD: `PUT` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b94ae9-ad7e-40c2-a9dd-6d0cfe96dd94 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b94ae9-ad7e-40c2-a9dd-6d0cfe96dd94 None admin] PATH_INFO: `/v3/projects/bb9d3f847ef244849afe15c9d1149867/users/3c09fdf36d9042198c4ec86ecc0be134/roles/44620cad10ae407c90c91e2c296adb04` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b94ae9-ad7e-40c2-a9dd-6d0cfe96dd94 None admin] RBAC: Authorizing `identity:create_grant(project_id=bb9d3f847ef244849afe15c9d1149867, user_id=3c09fdf36d9042198c4ec86ecc0be134, role_id=44620cad10ae407c90c91e2c296adb04)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b94ae9-ad7e-40c2-a9dd-6d0cfe96dd94 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:31 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1722/3412] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 13:02:31 2024] PUT /identity/v3/projects/bb9d3f847ef244849afe15c9d1149867/users/3c09fdf36d9042198c4ec86ecc0be134/roles/44620cad10ae407c90c91e2c296adb04 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:02:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d50ab26-ad8b-4a25-9b83-ac055f8ed61a None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d50ab26-ad8b-4a25-9b83-ac055f8ed61a None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d50ab26-ad8b-4a25-9b83-ac055f8ed61a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:31 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-9d50ab26-ad8b-4a25-9b83-ac055f8ed61a None None] Truncating password to algorithm specific maximum length 72 characters. May 28 13:02:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-9d50ab26-ad8b-4a25-9b83-ac055f8ed61a None None] MFA Rules not processed for user `3c09fdf36d9042198c4ec86ecc0be134`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 13:02:31 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-9d50ab26-ad8b-4a25-9b83-ac055f8ed61a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:02:31 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1691/3413] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 13:02:31 2024] POST /identity/v3/auth/tokens => generated 3956 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 13:02:31 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b94ae9-ad7e-40c2-a9dd-6d0cfe96dd94 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b94ae9-ad7e-40c2-a9dd-6d0cfe96dd94 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4585c88f-f23a-4849-b0b1-d33eece633f3 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4585c88f-f23a-4849-b0b1-d33eece633f3 None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4585c88f-f23a-4849-b0b1-d33eece633f3 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4585c88f-f23a-4849-b0b1-d33eece633f3 None admin] PATH_INFO: `/v3/projects` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4585c88f-f23a-4849-b0b1-d33eece633f3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4585c88f-f23a-4849-b0b1-d33eece633f3 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:32 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1723/3414] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 13:02:31 2024] POST /identity/v3/projects => generated 385 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 13:02:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d50ab26-ad8b-4a25-9b83-ac055f8ed61a None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d50ab26-ad8b-4a25-9b83-ac055f8ed61a None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e36f52-622f-48d4-a826-b15dfc924eda None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e36f52-622f-48d4-a826-b15dfc924eda None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e36f52-622f-48d4-a826-b15dfc924eda None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e36f52-622f-48d4-a826-b15dfc924eda None admin] PATH_INFO: `/v3/users` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e36f52-622f-48d4-a826-b15dfc924eda None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e36f52-622f-48d4-a826-b15dfc924eda None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:32 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-d5e36f52-622f-48d4-a826-b15dfc924eda None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 13:02:32 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1692/3415] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 13:02:32 2024] POST /identity/v3/users => generated 300 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 13:02:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4585c88f-f23a-4849-b0b1-d33eece633f3 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4585c88f-f23a-4849-b0b1-d33eece633f3 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21291b81-760c-450e-a679-921ffa5c2e62 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21291b81-760c-450e-a679-921ffa5c2e62 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21291b81-760c-450e-a679-921ffa5c2e62 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21291b81-760c-450e-a679-921ffa5c2e62 None admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21291b81-760c-450e-a679-921ffa5c2e62 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21291b81-760c-450e-a679-921ffa5c2e62 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:32 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1724/3416] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 13:02:32 2024] GET /identity/v3/roles => generated 1680 bytes in 18 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 13:02:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e36f52-622f-48d4-a826-b15dfc924eda None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e36f52-622f-48d4-a826-b15dfc924eda None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280646bd-aa51-4e37-b7f9-c59cb2937767 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280646bd-aa51-4e37-b7f9-c59cb2937767 None admin] REQUEST_METHOD: `PUT` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280646bd-aa51-4e37-b7f9-c59cb2937767 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280646bd-aa51-4e37-b7f9-c59cb2937767 None admin] PATH_INFO: `/v3/projects/f14455b44db646599c72bb78e8be787f/users/2bc97f1360f84c76a04d2e216cf7488c/roles/e7989893488f483baa107be56668c4f8` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280646bd-aa51-4e37-b7f9-c59cb2937767 None admin] RBAC: Authorizing `identity:create_grant(project_id=f14455b44db646599c72bb78e8be787f, user_id=2bc97f1360f84c76a04d2e216cf7488c, role_id=e7989893488f483baa107be56668c4f8)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280646bd-aa51-4e37-b7f9-c59cb2937767 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:32 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1693/3417] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 13:02:32 2024] PUT /identity/v3/projects/f14455b44db646599c72bb78e8be787f/users/2bc97f1360f84c76a04d2e216cf7488c/roles/e7989893488f483baa107be56668c4f8 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:02:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21291b81-760c-450e-a679-921ffa5c2e62 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21291b81-760c-450e-a679-921ffa5c2e62 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576cae46-dcca-4e99-b973-85ed2d622c2f None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576cae46-dcca-4e99-b973-85ed2d622c2f None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576cae46-dcca-4e99-b973-85ed2d622c2f None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576cae46-dcca-4e99-b973-85ed2d622c2f None admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576cae46-dcca-4e99-b973-85ed2d622c2f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576cae46-dcca-4e99-b973-85ed2d622c2f None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:32 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1725/3418] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 13:02:32 2024] GET /identity/v3/roles => generated 1680 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 13:02:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280646bd-aa51-4e37-b7f9-c59cb2937767 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280646bd-aa51-4e37-b7f9-c59cb2937767 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76eb89d-f11a-4b64-806c-39defa45631c None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76eb89d-f11a-4b64-806c-39defa45631c None admin] REQUEST_METHOD: `PUT` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76eb89d-f11a-4b64-806c-39defa45631c None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76eb89d-f11a-4b64-806c-39defa45631c None admin] PATH_INFO: `/v3/projects/f14455b44db646599c72bb78e8be787f/users/2bc97f1360f84c76a04d2e216cf7488c/roles/e7989893488f483baa107be56668c4f8` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76eb89d-f11a-4b64-806c-39defa45631c None admin] RBAC: Authorizing `identity:create_grant(project_id=f14455b44db646599c72bb78e8be787f, user_id=2bc97f1360f84c76a04d2e216cf7488c, role_id=e7989893488f483baa107be56668c4f8)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76eb89d-f11a-4b64-806c-39defa45631c None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:32 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1694/3419] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 13:02:32 2024] PUT /identity/v3/projects/f14455b44db646599c72bb78e8be787f/users/2bc97f1360f84c76a04d2e216cf7488c/roles/e7989893488f483baa107be56668c4f8 => generated 0 bytes in 19 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:02:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75f6375-4684-49e1-9c74-06b7ff8b272c None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75f6375-4684-49e1-9c74-06b7ff8b272c None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75f6375-4684-49e1-9c74-06b7ff8b272c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:32 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-d75f6375-4684-49e1-9c74-06b7ff8b272c None None] Truncating password to algorithm specific maximum length 72 characters. May 28 13:02:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-d75f6375-4684-49e1-9c74-06b7ff8b272c None None] MFA Rules not processed for user `2bc97f1360f84c76a04d2e216cf7488c`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 13:02:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-d75f6375-4684-49e1-9c74-06b7ff8b272c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:02:32 l75lg1-v1 dstat.sh[49771]: 28-05 13:02:32| 11 1 83 3 0|5645M 1779M 278M 7922M| 16k 582B| 0 10M| 0 1114 |8134 14k|1.03 1.13 1.06|2.0 0 0| 0 0 | 0 2048M| 29 364 0 35 2 May 28 13:02:32 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1726/3420] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 13:02:32 2024] POST /identity/v3/auth/tokens => generated 4079 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 13:02:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76eb89d-f11a-4b64-806c-39defa45631c None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76eb89d-f11a-4b64-806c-39defa45631c None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1f691b-41aa-4b47-96a4-1b301f45757d tempest-ShareNetworkSubnetsTest-2034479954 tempest-ShareNetworkSubnetsTest-2034479954-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bc97f1360f84c76a04d2e216cf7488c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f14455b44db646599c72bb78e8be787f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1f691b-41aa-4b47-96a4-1b301f45757d tempest-ShareNetworkSubnetsTest-2034479954 tempest-ShareNetworkSubnetsTest-2034479954-project-admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1f691b-41aa-4b47-96a4-1b301f45757d tempest-ShareNetworkSubnetsTest-2034479954 tempest-ShareNetworkSubnetsTest-2034479954-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1f691b-41aa-4b47-96a4-1b301f45757d tempest-ShareNetworkSubnetsTest-2034479954 tempest-ShareNetworkSubnetsTest-2034479954-project-admin] PATH_INFO: `/v3/domains` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1f691b-41aa-4b47-96a4-1b301f45757d tempest-ShareNetworkSubnetsTest-2034479954 tempest-ShareNetworkSubnetsTest-2034479954-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 13:02:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1f691b-41aa-4b47-96a4-1b301f45757d tempest-ShareNetworkSubnetsTest-2034479954 tempest-ShareNetworkSubnetsTest-2034479954-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1f691b-41aa-4b47-96a4-1b301f45757d tempest-ShareNetworkSubnetsTest-2034479954 tempest-ShareNetworkSubnetsTest-2034479954-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:32 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1695/3421] 10.27.203.238 () {62 vars in 1241 bytes} [Tue May 28 13:02:32 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 13:02:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75f6375-4684-49e1-9c74-06b7ff8b272c None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75f6375-4684-49e1-9c74-06b7ff8b272c None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db61622e-5dfb-44fc-93cf-7ccdec22b612 tempest-ShareNetworkSubnetsTest-2034479954 tempest-ShareNetworkSubnetsTest-2034479954-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bc97f1360f84c76a04d2e216cf7488c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f14455b44db646599c72bb78e8be787f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db61622e-5dfb-44fc-93cf-7ccdec22b612 tempest-ShareNetworkSubnetsTest-2034479954 tempest-ShareNetworkSubnetsTest-2034479954-project-admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db61622e-5dfb-44fc-93cf-7ccdec22b612 tempest-ShareNetworkSubnetsTest-2034479954 tempest-ShareNetworkSubnetsTest-2034479954-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db61622e-5dfb-44fc-93cf-7ccdec22b612 tempest-ShareNetworkSubnetsTest-2034479954 tempest-ShareNetworkSubnetsTest-2034479954-project-admin] PATH_INFO: `/v3/users` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db61622e-5dfb-44fc-93cf-7ccdec22b612 tempest-ShareNetworkSubnetsTest-2034479954 tempest-ShareNetworkSubnetsTest-2034479954-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db61622e-5dfb-44fc-93cf-7ccdec22b612 tempest-ShareNetworkSubnetsTest-2034479954 tempest-ShareNetworkSubnetsTest-2034479954-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:32 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-db61622e-5dfb-44fc-93cf-7ccdec22b612 tempest-ShareNetworkSubnetsTest-2034479954 tempest-ShareNetworkSubnetsTest-2034479954-project-admin] Truncating password to algorithm specific maximum length 72 characters. May 28 13:02:32 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1727/3422] 10.27.203.238 () {64 vars in 1232 bytes} [Tue May 28 13:02:32 2024] POST /identity/v3/users => generated 431 bytes in 35 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 13:02:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1f691b-41aa-4b47-96a4-1b301f45757d tempest-ShareNetworkSubnetsTest-2034479954 tempest-ShareNetworkSubnetsTest-2034479954-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1f691b-41aa-4b47-96a4-1b301f45757d tempest-ShareNetworkSubnetsTest-2034479954 tempest-ShareNetworkSubnetsTest-2034479954-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cb981f-5396-485b-a001-d4a3c34feb9d tempest-ShareNetworkSubnetsTest-2034479954 tempest-ShareNetworkSubnetsTest-2034479954-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bc97f1360f84c76a04d2e216cf7488c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f14455b44db646599c72bb78e8be787f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cb981f-5396-485b-a001-d4a3c34feb9d tempest-ShareNetworkSubnetsTest-2034479954 tempest-ShareNetworkSubnetsTest-2034479954-project-admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cb981f-5396-485b-a001-d4a3c34feb9d tempest-ShareNetworkSubnetsTest-2034479954 tempest-ShareNetworkSubnetsTest-2034479954-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cb981f-5396-485b-a001-d4a3c34feb9d tempest-ShareNetworkSubnetsTest-2034479954 tempest-ShareNetworkSubnetsTest-2034479954-project-admin] PATH_INFO: `/v3/roles` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cb981f-5396-485b-a001-d4a3c34feb9d tempest-ShareNetworkSubnetsTest-2034479954 tempest-ShareNetworkSubnetsTest-2034479954-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cb981f-5396-485b-a001-d4a3c34feb9d tempest-ShareNetworkSubnetsTest-2034479954 tempest-ShareNetworkSubnetsTest-2034479954-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:32 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1696/3423] 10.27.203.238 () {62 vars in 1210 bytes} [Tue May 28 13:02:32 2024] GET /identity/v3/roles => generated 1680 bytes in 16 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 13:02:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db61622e-5dfb-44fc-93cf-7ccdec22b612 tempest-ShareNetworkSubnetsTest-2034479954 tempest-ShareNetworkSubnetsTest-2034479954-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db61622e-5dfb-44fc-93cf-7ccdec22b612 tempest-ShareNetworkSubnetsTest-2034479954 tempest-ShareNetworkSubnetsTest-2034479954-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23992953-5368-40a4-9d6d-f0489b9b8de8 tempest-ShareNetworkSubnetsTest-2034479954 tempest-ShareNetworkSubnetsTest-2034479954-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bc97f1360f84c76a04d2e216cf7488c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f14455b44db646599c72bb78e8be787f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23992953-5368-40a4-9d6d-f0489b9b8de8 tempest-ShareNetworkSubnetsTest-2034479954 tempest-ShareNetworkSubnetsTest-2034479954-project-admin] REQUEST_METHOD: `PUT` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23992953-5368-40a4-9d6d-f0489b9b8de8 tempest-ShareNetworkSubnetsTest-2034479954 tempest-ShareNetworkSubnetsTest-2034479954-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23992953-5368-40a4-9d6d-f0489b9b8de8 tempest-ShareNetworkSubnetsTest-2034479954 tempest-ShareNetworkSubnetsTest-2034479954-project-admin] PATH_INFO: `/v3/projects/f14455b44db646599c72bb78e8be787f/users/a3784840ad6a4156929be55026b39776/roles/44620cad10ae407c90c91e2c296adb04` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23992953-5368-40a4-9d6d-f0489b9b8de8 tempest-ShareNetworkSubnetsTest-2034479954 tempest-ShareNetworkSubnetsTest-2034479954-project-admin] RBAC: Authorizing `identity:create_grant(project_id=f14455b44db646599c72bb78e8be787f, user_id=a3784840ad6a4156929be55026b39776, role_id=44620cad10ae407c90c91e2c296adb04)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23992953-5368-40a4-9d6d-f0489b9b8de8 tempest-ShareNetworkSubnetsTest-2034479954 tempest-ShareNetworkSubnetsTest-2034479954-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:32 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1728/3424] 10.27.203.238 () {64 vars in 1571 bytes} [Tue May 28 13:02:32 2024] PUT /identity/v3/projects/f14455b44db646599c72bb78e8be787f/users/a3784840ad6a4156929be55026b39776/roles/44620cad10ae407c90c91e2c296adb04 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:02:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cb981f-5396-485b-a001-d4a3c34feb9d tempest-ShareNetworkSubnetsTest-2034479954 tempest-ShareNetworkSubnetsTest-2034479954-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-92cb981f-5396-485b-a001-d4a3c34feb9d tempest-ShareNetworkSubnetsTest-2034479954 tempest-ShareNetworkSubnetsTest-2034479954-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:02:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cb981f-5396-485b-a001-d4a3c34feb9d tempest-ShareNetworkSubnetsTest-2034479954 tempest-ShareNetworkSubnetsTest-2034479954-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3fb719-97b8-4480-a1c7-1726e29bde25 service manila] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f110cf6300f049c897d0aab63218d1e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3fb719-97b8-4480-a1c7-1726e29bde25 service manila] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3fb719-97b8-4480-a1c7-1726e29bde25 service manila] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3fb719-97b8-4480-a1c7-1726e29bde25 service manila] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3fb719-97b8-4480-a1c7-1726e29bde25 service manila] RBAC: Authorizing `identity:validate_token()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:32 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3fb719-97b8-4480-a1c7-1726e29bde25 service manila] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:32 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1697/3425] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 13:02:32 2024] GET /identity/v3/auth/tokens => generated 4079 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 13:02:32 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-db751196-6484-46c4-8f25-3c71d8a04579 tempest-ShareNetworkSubnetsTest-2034479954 tempest-ShareNetworkSubnetsTest-2034479954-project-admin] POST http://10.27.203.238/share/v2/f14455b44db646599c72bb78e8be787f/types May 28 13:02:32 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-db751196-6484-46c4-8f25-3c71d8a04579 tempest-ShareNetworkSubnetsTest-2034479954 tempest-ShareNetworkSubnetsTest-2034479954-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share_type": {"name": "tempest-typeshare-type-15445784", "extra_specs": {"driver_handles_share_servers": false}, "share_type_access:is_public": true}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:02:32 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-db751196-6484-46c4-8f25-3c71d8a04579 tempest-ShareNetworkSubnetsTest-2034479954 tempest-ShareNetworkSubnetsTest-2034479954-project-admin] http://10.27.203.238/share/v2/f14455b44db646599c72bb78e8be787f/types returned with HTTP 200 May 28 13:02:32 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1251/2479] 10.27.203.238 () {66 vars in 1359 bytes} [Tue May 28 13:02:32 2024] POST /share/v2/f14455b44db646599c72bb78e8be787f/types => generated 615 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:02:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23992953-5368-40a4-9d6d-f0489b9b8de8 tempest-ShareNetworkSubnetsTest-2034479954 tempest-ShareNetworkSubnetsTest-2034479954-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-23992953-5368-40a4-9d6d-f0489b9b8de8 tempest-ShareNetworkSubnetsTest-2034479954 tempest-ShareNetworkSubnetsTest-2034479954-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:02:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23992953-5368-40a4-9d6d-f0489b9b8de8 tempest-ShareNetworkSubnetsTest-2034479954 tempest-ShareNetworkSubnetsTest-2034479954-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dafead-6824-4650-9078-8178f433aae5 service manila] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f110cf6300f049c897d0aab63218d1e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dafead-6824-4650-9078-8178f433aae5 service manila] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dafead-6824-4650-9078-8178f433aae5 service manila] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dafead-6824-4650-9078-8178f433aae5 service manila] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dafead-6824-4650-9078-8178f433aae5 service manila] RBAC: Authorizing `identity:validate_token()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:32 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dafead-6824-4650-9078-8178f433aae5 service manila] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:32 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1729/3426] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 13:02:32 2024] GET /identity/v3/auth/tokens => generated 3956 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 13:02:32 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-2aef7586-6dc5-498e-9c29-9369dd678be0 tempest-ShareNetworkSubnetsTest-2134524932 tempest-ShareNetworkSubnetsTest-2134524932-project-member] POST http://10.27.203.238/share/v1/73ff30a3b10d4ca099fc7022b36d49d9/share-networks May 28 13:02:32 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-2aef7586-6dc5-498e-9c29-9369dd678be0 tempest-ShareNetworkSubnetsTest-2134524932 tempest-ShareNetworkSubnetsTest-2134524932-project-member] Action: 'create', calling method: ShareNetworkController.create, body: {"share_network": {}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:02:32 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.quota [None req-2aef7586-6dc5-498e-9c29-9369dd678be0 tempest-ShareNetworkSubnetsTest-2134524932 tempest-ShareNetworkSubnetsTest-2134524932-project-member] Created reservations ['2df7fe75-d0f2-4884-8e88-be0bf21f5ba1'] {{(pid=98330) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 13:02:32 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.quota [None req-2aef7586-6dc5-498e-9c29-9369dd678be0 tempest-ShareNetworkSubnetsTest-2134524932 tempest-ShareNetworkSubnetsTest-2134524932-project-member] Committed reservations ['2df7fe75-d0f2-4884-8e88-be0bf21f5ba1'] {{(pid=98330) commit /opt/stack/manila/manila/quota.py:1063}} May 28 13:02:32 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-2aef7586-6dc5-498e-9c29-9369dd678be0 tempest-ShareNetworkSubnetsTest-2134524932 tempest-ShareNetworkSubnetsTest-2134524932-project-member] http://10.27.203.238/share/v1/73ff30a3b10d4ca099fc7022b36d49d9/share-networks returned with HTTP 200 May 28 13:02:32 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1229/2480] 10.27.203.238 () {64 vars in 1342 bytes} [Tue May 28 13:02:32 2024] POST /share/v1/73ff30a3b10d4ca099fc7022b36d49d9/share-networks => generated 367 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:02:32 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-6ac4d173-a488-4777-8e21-e0eaf42fba20 tempest-ShareNetworkSubnetsTest-2134524932 tempest-ShareNetworkSubnetsTest-2134524932-project-member] POST http://10.27.203.238/share/v2/73ff30a3b10d4ca099fc7022b36d49d9/share-networks May 28 13:02:32 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-6ac4d173-a488-4777-8e21-e0eaf42fba20 tempest-ShareNetworkSubnetsTest-2134524932 tempest-ShareNetworkSubnetsTest-2134524932-project-member] Action: 'create', calling method: ShareNetworkController.create, body: {"share_network": {}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:02:32 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.quota [None req-6ac4d173-a488-4777-8e21-e0eaf42fba20 tempest-ShareNetworkSubnetsTest-2134524932 tempest-ShareNetworkSubnetsTest-2134524932-project-member] Created reservations ['41a9dbf5-b4a6-4d75-8eb3-f3e58f8ccbb1'] {{(pid=98329) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 13:02:32 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.quota [None req-6ac4d173-a488-4777-8e21-e0eaf42fba20 tempest-ShareNetworkSubnetsTest-2134524932 tempest-ShareNetworkSubnetsTest-2134524932-project-member] Committed reservations ['41a9dbf5-b4a6-4d75-8eb3-f3e58f8ccbb1'] {{(pid=98329) commit /opt/stack/manila/manila/quota.py:1063}} May 28 13:02:32 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-6ac4d173-a488-4777-8e21-e0eaf42fba20 tempest-ShareNetworkSubnetsTest-2134524932 tempest-ShareNetworkSubnetsTest-2134524932-project-member] http://10.27.203.238/share/v2/73ff30a3b10d4ca099fc7022b36d49d9/share-networks returned with HTTP 200 May 28 13:02:32 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1252/2481] 10.27.203.238 () {66 vars in 1385 bytes} [Tue May 28 13:02:32 2024] POST /share/v2/73ff30a3b10d4ca099fc7022b36d49d9/share-networks => generated 662 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:02:32 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-6c30b2d2-3c16-4973-b010-0d30d4aa1f81 tempest-ShareNetworkSubnetsTest-2134524932 tempest-ShareNetworkSubnetsTest-2134524932-project-member] GET http://10.27.203.238/share/v2/73ff30a3b10d4ca099fc7022b36d49d9/share-networks/f2b09030-fe17-40bc-a650-6d0977354531 May 28 13:02:32 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-6c30b2d2-3c16-4973-b010-0d30d4aa1f81 tempest-ShareNetworkSubnetsTest-2134524932 tempest-ShareNetworkSubnetsTest-2134524932-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:02:32 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-6c30b2d2-3c16-4973-b010-0d30d4aa1f81 tempest-ShareNetworkSubnetsTest-2134524932 tempest-ShareNetworkSubnetsTest-2134524932-project-member] Calling method 'ShareNetworkController.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:02:32 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-6c30b2d2-3c16-4973-b010-0d30d4aa1f81 tempest-ShareNetworkSubnetsTest-2134524932 tempest-ShareNetworkSubnetsTest-2134524932-project-member] http://10.27.203.238/share/v2/73ff30a3b10d4ca099fc7022b36d49d9/share-networks/f2b09030-fe17-40bc-a650-6d0977354531 returned with HTTP 200 May 28 13:02:32 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1230/2482] 10.27.203.238 () {64 vars in 1475 bytes} [Tue May 28 13:02:32 2024] GET /share/v2/73ff30a3b10d4ca099fc7022b36d49d9/share-networks/f2b09030-fe17-40bc-a650-6d0977354531 => generated 662 bytes in 26 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:02:32 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-f2f24f22-b21c-4cb0-b5b6-17a9a3b0be96 tempest-ShareNetworkSubnetsTest-2134524932 tempest-ShareNetworkSubnetsTest-2134524932-project-member] GET http://10.27.203.238/share/v2/73ff30a3b10d4ca099fc7022b36d49d9/availability-zones May 28 13:02:32 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-f2f24f22-b21c-4cb0-b5b6-17a9a3b0be96 tempest-ShareNetworkSubnetsTest-2134524932 tempest-ShareNetworkSubnetsTest-2134524932-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:02:32 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-f2f24f22-b21c-4cb0-b5b6-17a9a3b0be96 tempest-ShareNetworkSubnetsTest-2134524932 tempest-ShareNetworkSubnetsTest-2134524932-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:02:32 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-f2f24f22-b21c-4cb0-b5b6-17a9a3b0be96 tempest-ShareNetworkSubnetsTest-2134524932 tempest-ShareNetworkSubnetsTest-2134524932-project-member] http://10.27.203.238/share/v2/73ff30a3b10d4ca099fc7022b36d49d9/availability-zones returned with HTTP 200 May 28 13:02:32 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1253/2483] 10.27.203.238 () {64 vars in 1376 bytes} [Tue May 28 13:02:32 2024] GET /share/v2/73ff30a3b10d4ca099fc7022b36d49d9/availability-zones => generated 152 bytes in 9 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:02:32 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-5aae7b78-3d01-4aee-a109-0811a7995dd6 tempest-ShareNetworkSubnetsTest-2134524932 tempest-ShareNetworkSubnetsTest-2134524932-project-member] POST http://10.27.203.238/share/v2/73ff30a3b10d4ca099fc7022b36d49d9/share-networks/f2b09030-fe17-40bc-a650-6d0977354531/subnets May 28 13:02:32 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-5aae7b78-3d01-4aee-a109-0811a7995dd6 tempest-ShareNetworkSubnetsTest-2134524932 tempest-ShareNetworkSubnetsTest-2134524932-project-member] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share-network-subnet": {"share_network_id": "f2b09030-fe17-40bc-a650-6d0977354531", "availability_zone": "nova", "neutron_net_id": "tempest-net-id-1299072248", "neutron_subnet_id": "tempest-subnet-id-143901938"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:02:32 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-5aae7b78-3d01-4aee-a109-0811a7995dd6 tempest-ShareNetworkSubnetsTest-2134524932 tempest-ShareNetworkSubnetsTest-2134524932-project-member] http://10.27.203.238/share/v2/73ff30a3b10d4ca099fc7022b36d49d9/share-networks/f2b09030-fe17-40bc-a650-6d0977354531/subnets returned with HTTP 200 May 28 13:02:32 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1231/2484] 10.27.203.238 () {66 vars in 1521 bytes} [Tue May 28 13:02:32 2024] POST /share/v2/73ff30a3b10d4ca099fc7022b36d49d9/share-networks/f2b09030-fe17-40bc-a650-6d0977354531/subnets => generated 479 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:02:32 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-28759b18-74bb-4d0f-a0ad-4a18ea9b9a10 tempest-ShareNetworkSubnetsTest-2134524932 tempest-ShareNetworkSubnetsTest-2134524932-project-member] DELETE http://10.27.203.238/share/v2/73ff30a3b10d4ca099fc7022b36d49d9/share-networks/f2b09030-fe17-40bc-a650-6d0977354531/subnets/f58a73f4-cc67-4a70-beca-6b27e59314ca May 28 13:02:32 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-28759b18-74bb-4d0f-a0ad-4a18ea9b9a10 tempest-ShareNetworkSubnetsTest-2134524932 tempest-ShareNetworkSubnetsTest-2134524932-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:02:32 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-28759b18-74bb-4d0f-a0ad-4a18ea9b9a10 tempest-ShareNetworkSubnetsTest-2134524932 tempest-ShareNetworkSubnetsTest-2134524932-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:02:33 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-28759b18-74bb-4d0f-a0ad-4a18ea9b9a10 tempest-ShareNetworkSubnetsTest-2134524932 tempest-ShareNetworkSubnetsTest-2134524932-project-member] http://10.27.203.238/share/v2/73ff30a3b10d4ca099fc7022b36d49d9/share-networks/f2b09030-fe17-40bc-a650-6d0977354531/subnets/f58a73f4-cc67-4a70-beca-6b27e59314ca returned with HTTP 202 May 28 13:02:33 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1254/2485] 10.27.203.238 () {64 vars in 1613 bytes} [Tue May 28 13:02:32 2024] DELETE /share/v2/73ff30a3b10d4ca099fc7022b36d49d9/share-networks/f2b09030-fe17-40bc-a650-6d0977354531/subnets/f58a73f4-cc67-4a70-beca-6b27e59314ca => generated 0 bytes in 57 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 13:02:33 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-05f3fd15-577b-434a-bed1-c81bc2eb6c4e tempest-ShareNetworkSubnetsTest-2134524932 tempest-ShareNetworkSubnetsTest-2134524932-project-member] DELETE http://10.27.203.238/share/v2/73ff30a3b10d4ca099fc7022b36d49d9/share-networks/f2b09030-fe17-40bc-a650-6d0977354531/subnets/f58a73f4-cc67-4a70-beca-6b27e59314ca May 28 13:02:33 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-05f3fd15-577b-434a-bed1-c81bc2eb6c4e tempest-ShareNetworkSubnetsTest-2134524932 tempest-ShareNetworkSubnetsTest-2134524932-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:02:33 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-05f3fd15-577b-434a-bed1-c81bc2eb6c4e tempest-ShareNetworkSubnetsTest-2134524932 tempest-ShareNetworkSubnetsTest-2134524932-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:02:33 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-05f3fd15-577b-434a-bed1-c81bc2eb6c4e tempest-ShareNetworkSubnetsTest-2134524932 tempest-ShareNetworkSubnetsTest-2134524932-project-member] HTTP exception thrown: Share network subnet f58a73f4-cc67-4a70-beca-6b27e59314ca could not be found. May 28 13:02:33 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-05f3fd15-577b-434a-bed1-c81bc2eb6c4e tempest-ShareNetworkSubnetsTest-2134524932 tempest-ShareNetworkSubnetsTest-2134524932-project-member] http://10.27.203.238/share/v2/73ff30a3b10d4ca099fc7022b36d49d9/share-networks/f2b09030-fe17-40bc-a650-6d0977354531/subnets/f58a73f4-cc67-4a70-beca-6b27e59314ca returned with HTTP 404 May 28 13:02:33 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1232/2486] 10.27.203.238 () {64 vars in 1613 bytes} [Tue May 28 13:02:33 2024] DELETE /share/v2/73ff30a3b10d4ca099fc7022b36d49d9/share-networks/f2b09030-fe17-40bc-a650-6d0977354531/subnets/f58a73f4-cc67-4a70-beca-6b27e59314ca => generated 123 bytes in 33 msecs (HTTP/1.1 404) 6 headers in 238 bytes (1 switches on core 0) May 28 13:02:33 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-73ae5493-5682-4d06-a118-2b0d2622f4a7 tempest-ShareNetworkSubnetsTest-2134524932 tempest-ShareNetworkSubnetsTest-2134524932-project-member] DELETE http://10.27.203.238/share/v1/73ff30a3b10d4ca099fc7022b36d49d9/share-networks/1d8a811f-5d5f-4914-b287-63011c2b61cb May 28 13:02:33 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-73ae5493-5682-4d06-a118-2b0d2622f4a7 tempest-ShareNetworkSubnetsTest-2134524932 tempest-ShareNetworkSubnetsTest-2134524932-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:02:33 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-73ae5493-5682-4d06-a118-2b0d2622f4a7 tempest-ShareNetworkSubnetsTest-2134524932 tempest-ShareNetworkSubnetsTest-2134524932-project-member] Calling method 'ShareNetworkController.delete' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:02:33 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.quota [None req-73ae5493-5682-4d06-a118-2b0d2622f4a7 tempest-ShareNetworkSubnetsTest-2134524932 tempest-ShareNetworkSubnetsTest-2134524932-project-member] Created reservations ['bb8840b2-2983-4f05-b50b-a8893ef83fc9'] {{(pid=98329) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 13:02:33 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.quota [None req-73ae5493-5682-4d06-a118-2b0d2622f4a7 tempest-ShareNetworkSubnetsTest-2134524932 tempest-ShareNetworkSubnetsTest-2134524932-project-member] Committed reservations ['bb8840b2-2983-4f05-b50b-a8893ef83fc9'] {{(pid=98329) commit /opt/stack/manila/manila/quota.py:1063}} May 28 13:02:33 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-73ae5493-5682-4d06-a118-2b0d2622f4a7 tempest-ShareNetworkSubnetsTest-2134524932 tempest-ShareNetworkSubnetsTest-2134524932-project-member] http://10.27.203.238/share/v1/73ff30a3b10d4ca099fc7022b36d49d9/share-networks/1d8a811f-5d5f-4914-b287-63011c2b61cb returned with HTTP 202 May 28 13:02:33 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1255/2487] 10.27.203.238 () {62 vars in 1435 bytes} [Tue May 28 13:02:33 2024] DELETE /share/v1/73ff30a3b10d4ca099fc7022b36d49d9/share-networks/1d8a811f-5d5f-4914-b287-63011c2b61cb => generated 0 bytes in 114 msecs (HTTP/1.1 202) 6 headers in 242 bytes (1 switches on core 0) May 28 13:02:33 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-500cfd18-6538-48ff-b801-88c7f8b13bb8 tempest-ShareNetworkSubnetsTest-2134524932 tempest-ShareNetworkSubnetsTest-2134524932-project-member] GET http://10.27.203.238/share/v1/73ff30a3b10d4ca099fc7022b36d49d9/share-networks/1d8a811f-5d5f-4914-b287-63011c2b61cb May 28 13:02:33 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-500cfd18-6538-48ff-b801-88c7f8b13bb8 tempest-ShareNetworkSubnetsTest-2134524932 tempest-ShareNetworkSubnetsTest-2134524932-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:02:33 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-500cfd18-6538-48ff-b801-88c7f8b13bb8 tempest-ShareNetworkSubnetsTest-2134524932 tempest-ShareNetworkSubnetsTest-2134524932-project-member] Calling method 'ShareNetworkController.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:02:33 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-500cfd18-6538-48ff-b801-88c7f8b13bb8 tempest-ShareNetworkSubnetsTest-2134524932 tempest-ShareNetworkSubnetsTest-2134524932-project-member] HTTP exception thrown: Share network 1d8a811f-5d5f-4914-b287-63011c2b61cb could not be found. May 28 13:02:33 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-500cfd18-6538-48ff-b801-88c7f8b13bb8 tempest-ShareNetworkSubnetsTest-2134524932 tempest-ShareNetworkSubnetsTest-2134524932-project-member] http://10.27.203.238/share/v1/73ff30a3b10d4ca099fc7022b36d49d9/share-networks/1d8a811f-5d5f-4914-b287-63011c2b61cb returned with HTTP 404 May 28 13:02:33 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1233/2488] 10.27.203.238 () {62 vars in 1432 bytes} [Tue May 28 13:02:33 2024] GET /share/v1/73ff30a3b10d4ca099fc7022b36d49d9/share-networks/1d8a811f-5d5f-4914-b287-63011c2b61cb => generated 116 bytes in 17 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 13:02:33 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-4f791f34-a29a-4d12-97f1-2b0ef1fd8b98 tempest-ShareNetworkSubnetsTest-2134524932 tempest-ShareNetworkSubnetsTest-2134524932-project-member] POST http://10.27.203.238/share/v1/73ff30a3b10d4ca099fc7022b36d49d9/share-networks May 28 13:02:33 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-4f791f34-a29a-4d12-97f1-2b0ef1fd8b98 tempest-ShareNetworkSubnetsTest-2134524932 tempest-ShareNetworkSubnetsTest-2134524932-project-member] Action: 'create', calling method: ShareNetworkController.create, body: {"share_network": {}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:02:33 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.quota [None req-4f791f34-a29a-4d12-97f1-2b0ef1fd8b98 tempest-ShareNetworkSubnetsTest-2134524932 tempest-ShareNetworkSubnetsTest-2134524932-project-member] Created reservations ['4ebb78f5-ec82-40df-9dc1-b33865d96d86'] {{(pid=98329) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 13:02:33 l75lg1-v1 dstat.sh[49771]: 28-05 13:02:33| 9 1 86 3 0|5645M 1779M 278M 7922M| 17k 8027B| 0 2711k| 0 397 |7135 12k|1.03 1.13 1.06|3.0 1.0 0| 0 0 | 0 2048M| 29 364 0 35 2 May 28 13:02:33 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.quota [None req-4f791f34-a29a-4d12-97f1-2b0ef1fd8b98 tempest-ShareNetworkSubnetsTest-2134524932 tempest-ShareNetworkSubnetsTest-2134524932-project-member] Committed reservations ['4ebb78f5-ec82-40df-9dc1-b33865d96d86'] {{(pid=98329) commit /opt/stack/manila/manila/quota.py:1063}} May 28 13:02:33 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-4f791f34-a29a-4d12-97f1-2b0ef1fd8b98 tempest-ShareNetworkSubnetsTest-2134524932 tempest-ShareNetworkSubnetsTest-2134524932-project-member] http://10.27.203.238/share/v1/73ff30a3b10d4ca099fc7022b36d49d9/share-networks returned with HTTP 200 May 28 13:02:33 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1256/2489] 10.27.203.238 () {64 vars in 1342 bytes} [Tue May 28 13:02:33 2024] POST /share/v1/73ff30a3b10d4ca099fc7022b36d49d9/share-networks => generated 367 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:02:33 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-0360867c-841b-469e-b16a-6a3341ec13a3 tempest-ShareNetworkSubnetsTest-2134524932 tempest-ShareNetworkSubnetsTest-2134524932-project-member] GET http://10.27.203.238/share/v2/73ff30a3b10d4ca099fc7022b36d49d9/availability-zones May 28 13:02:33 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-0360867c-841b-469e-b16a-6a3341ec13a3 tempest-ShareNetworkSubnetsTest-2134524932 tempest-ShareNetworkSubnetsTest-2134524932-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:02:33 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-0360867c-841b-469e-b16a-6a3341ec13a3 tempest-ShareNetworkSubnetsTest-2134524932 tempest-ShareNetworkSubnetsTest-2134524932-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:02:33 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-0360867c-841b-469e-b16a-6a3341ec13a3 tempest-ShareNetworkSubnetsTest-2134524932 tempest-ShareNetworkSubnetsTest-2134524932-project-member] http://10.27.203.238/share/v2/73ff30a3b10d4ca099fc7022b36d49d9/availability-zones returned with HTTP 200 May 28 13:02:33 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1234/2490] 10.27.203.238 () {64 vars in 1376 bytes} [Tue May 28 13:02:33 2024] GET /share/v2/73ff30a3b10d4ca099fc7022b36d49d9/availability-zones => generated 152 bytes in 9 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:02:33 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-dd596793-50e4-4471-ab24-5ae694f448d4 tempest-ShareNetworkSubnetsTest-2134524932 tempest-ShareNetworkSubnetsTest-2134524932-project-member] POST http://10.27.203.238/share/v2/73ff30a3b10d4ca099fc7022b36d49d9/share-networks/8d423adf-b3a1-43ef-b895-1454de3d36c2/subnets May 28 13:02:33 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-dd596793-50e4-4471-ab24-5ae694f448d4 tempest-ShareNetworkSubnetsTest-2134524932 tempest-ShareNetworkSubnetsTest-2134524932-project-member] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share-network-subnet": {"share_network_id": "8d423adf-b3a1-43ef-b895-1454de3d36c2", "availability_zone": "nova", "neutron_net_id": "tempest-net-id-1973052653", "neutron_subnet_id": "tempest-subnet-id-330835446"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:02:33 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-dd596793-50e4-4471-ab24-5ae694f448d4 tempest-ShareNetworkSubnetsTest-2134524932 tempest-ShareNetworkSubnetsTest-2134524932-project-member] http://10.27.203.238/share/v2/73ff30a3b10d4ca099fc7022b36d49d9/share-networks/8d423adf-b3a1-43ef-b895-1454de3d36c2/subnets returned with HTTP 200 May 28 13:02:33 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1257/2491] 10.27.203.238 () {66 vars in 1521 bytes} [Tue May 28 13:02:33 2024] POST /share/v2/73ff30a3b10d4ca099fc7022b36d49d9/share-networks/8d423adf-b3a1-43ef-b895-1454de3d36c2/subnets => generated 479 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:02:33 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-418c7e21-da4a-4f07-8839-436820756688 tempest-ShareNetworkSubnetsTest-2134524932 tempest-ShareNetworkSubnetsTest-2134524932-project-member] GET http://10.27.203.238/share/v2/73ff30a3b10d4ca099fc7022b36d49d9/share-networks/8d423adf-b3a1-43ef-b895-1454de3d36c2/subnets/d6a643c8-2589-4958-a36e-c137425eb80b May 28 13:02:33 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-418c7e21-da4a-4f07-8839-436820756688 tempest-ShareNetworkSubnetsTest-2134524932 tempest-ShareNetworkSubnetsTest-2134524932-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:02:33 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-418c7e21-da4a-4f07-8839-436820756688 tempest-ShareNetworkSubnetsTest-2134524932 tempest-ShareNetworkSubnetsTest-2134524932-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:02:33 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-418c7e21-da4a-4f07-8839-436820756688 tempest-ShareNetworkSubnetsTest-2134524932 tempest-ShareNetworkSubnetsTest-2134524932-project-member] http://10.27.203.238/share/v2/73ff30a3b10d4ca099fc7022b36d49d9/share-networks/8d423adf-b3a1-43ef-b895-1454de3d36c2/subnets/d6a643c8-2589-4958-a36e-c137425eb80b returned with HTTP 200 May 28 13:02:33 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1235/2492] 10.27.203.238 () {64 vars in 1610 bytes} [Tue May 28 13:02:33 2024] GET /share/v2/73ff30a3b10d4ca099fc7022b36d49d9/share-networks/8d423adf-b3a1-43ef-b895-1454de3d36c2/subnets/d6a643c8-2589-4958-a36e-c137425eb80b => generated 479 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:02:33 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-ca175d1d-1d00-4f8a-99f0-b2df7a3a892c tempest-ShareNetworkSubnetsTest-2134524932 tempest-ShareNetworkSubnetsTest-2134524932-project-member] DELETE http://10.27.203.238/share/v2/73ff30a3b10d4ca099fc7022b36d49d9/share-networks/8d423adf-b3a1-43ef-b895-1454de3d36c2/subnets/d6a643c8-2589-4958-a36e-c137425eb80b May 28 13:02:33 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-ca175d1d-1d00-4f8a-99f0-b2df7a3a892c tempest-ShareNetworkSubnetsTest-2134524932 tempest-ShareNetworkSubnetsTest-2134524932-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:02:33 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-ca175d1d-1d00-4f8a-99f0-b2df7a3a892c tempest-ShareNetworkSubnetsTest-2134524932 tempest-ShareNetworkSubnetsTest-2134524932-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:02:33 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-ca175d1d-1d00-4f8a-99f0-b2df7a3a892c tempest-ShareNetworkSubnetsTest-2134524932 tempest-ShareNetworkSubnetsTest-2134524932-project-member] http://10.27.203.238/share/v2/73ff30a3b10d4ca099fc7022b36d49d9/share-networks/8d423adf-b3a1-43ef-b895-1454de3d36c2/subnets/d6a643c8-2589-4958-a36e-c137425eb80b returned with HTTP 202 May 28 13:02:33 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1258/2493] 10.27.203.238 () {64 vars in 1613 bytes} [Tue May 28 13:02:33 2024] DELETE /share/v2/73ff30a3b10d4ca099fc7022b36d49d9/share-networks/8d423adf-b3a1-43ef-b895-1454de3d36c2/subnets/d6a643c8-2589-4958-a36e-c137425eb80b => generated 0 bytes in 80 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 13:02:33 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-688db957-6a48-46a4-9a1a-d7c1a8093706 tempest-ShareNetworkSubnetsTest-2134524932 tempest-ShareNetworkSubnetsTest-2134524932-project-member] DELETE http://10.27.203.238/share/v2/73ff30a3b10d4ca099fc7022b36d49d9/share-networks/8d423adf-b3a1-43ef-b895-1454de3d36c2/subnets/d6a643c8-2589-4958-a36e-c137425eb80b May 28 13:02:33 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-688db957-6a48-46a4-9a1a-d7c1a8093706 tempest-ShareNetworkSubnetsTest-2134524932 tempest-ShareNetworkSubnetsTest-2134524932-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:02:33 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-688db957-6a48-46a4-9a1a-d7c1a8093706 tempest-ShareNetworkSubnetsTest-2134524932 tempest-ShareNetworkSubnetsTest-2134524932-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:02:33 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-688db957-6a48-46a4-9a1a-d7c1a8093706 tempest-ShareNetworkSubnetsTest-2134524932 tempest-ShareNetworkSubnetsTest-2134524932-project-member] HTTP exception thrown: Share network subnet d6a643c8-2589-4958-a36e-c137425eb80b could not be found. May 28 13:02:33 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-688db957-6a48-46a4-9a1a-d7c1a8093706 tempest-ShareNetworkSubnetsTest-2134524932 tempest-ShareNetworkSubnetsTest-2134524932-project-member] http://10.27.203.238/share/v2/73ff30a3b10d4ca099fc7022b36d49d9/share-networks/8d423adf-b3a1-43ef-b895-1454de3d36c2/subnets/d6a643c8-2589-4958-a36e-c137425eb80b returned with HTTP 404 May 28 13:02:33 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1236/2494] 10.27.203.238 () {64 vars in 1613 bytes} [Tue May 28 13:02:33 2024] DELETE /share/v2/73ff30a3b10d4ca099fc7022b36d49d9/share-networks/8d423adf-b3a1-43ef-b895-1454de3d36c2/subnets/d6a643c8-2589-4958-a36e-c137425eb80b => generated 123 bytes in 34 msecs (HTTP/1.1 404) 6 headers in 238 bytes (1 switches on core 0) May 28 13:02:33 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-91ab0ec3-a23b-4264-bd3e-0c749eed06bf tempest-ShareNetworkSubnetsTest-2134524932 tempest-ShareNetworkSubnetsTest-2134524932-project-member] DELETE http://10.27.203.238/share/v1/73ff30a3b10d4ca099fc7022b36d49d9/share-networks/8d423adf-b3a1-43ef-b895-1454de3d36c2 May 28 13:02:33 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-91ab0ec3-a23b-4264-bd3e-0c749eed06bf tempest-ShareNetworkSubnetsTest-2134524932 tempest-ShareNetworkSubnetsTest-2134524932-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:02:33 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-91ab0ec3-a23b-4264-bd3e-0c749eed06bf tempest-ShareNetworkSubnetsTest-2134524932 tempest-ShareNetworkSubnetsTest-2134524932-project-member] Calling method 'ShareNetworkController.delete' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:02:33 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-ffd1bf5c-b659-479a-a474-84efa9a385da tempest-SharesNegativeTest-1014773059 tempest-SharesNegativeTest-1014773059-project-member] GET http://10.27.203.238/share/v2/d1d71dc9f23c4c6a8e146d99ad65ebb2/snapshots/79b46976-8aab-4859-b7c0-b71cf76c2cc2 May 28 13:02:33 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-ffd1bf5c-b659-479a-a474-84efa9a385da tempest-SharesNegativeTest-1014773059 tempest-SharesNegativeTest-1014773059-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:02:33 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-ffd1bf5c-b659-479a-a474-84efa9a385da tempest-SharesNegativeTest-1014773059 tempest-SharesNegativeTest-1014773059-project-member] Calling method 'ShareSnapshotMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:02:33 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.quota [None req-91ab0ec3-a23b-4264-bd3e-0c749eed06bf tempest-ShareNetworkSubnetsTest-2134524932 tempest-ShareNetworkSubnetsTest-2134524932-project-member] Created reservations ['c1eec78f-5594-4e62-af92-b4b67939afed'] {{(pid=98329) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 13:02:33 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-ffd1bf5c-b659-479a-a474-84efa9a385da tempest-SharesNegativeTest-1014773059 tempest-SharesNegativeTest-1014773059-project-member] http://10.27.203.238/share/v2/d1d71dc9f23c4c6a8e146d99ad65ebb2/snapshots/79b46976-8aab-4859-b7c0-b71cf76c2cc2 returned with HTTP 200 May 28 13:02:33 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1237/2495] 10.27.203.238 () {64 vars in 1460 bytes} [Tue May 28 13:02:33 2024] GET /share/v2/d1d71dc9f23c4c6a8e146d99ad65ebb2/snapshots/79b46976-8aab-4859-b7c0-b71cf76c2cc2 => generated 724 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:02:33 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-fb345555-5eca-4f14-bca1-da91eb9903db tempest-SharesNegativeTest-1014773059 tempest-SharesNegativeTest-1014773059-project-member] DELETE http://10.27.203.238/share/v1/d1d71dc9f23c4c6a8e146d99ad65ebb2/shares/b05a8999-f1ac-4887-a675-3c2ca8e9cece May 28 13:02:33 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-fb345555-5eca-4f14-bca1-da91eb9903db tempest-SharesNegativeTest-1014773059 tempest-SharesNegativeTest-1014773059-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:02:33 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-fb345555-5eca-4f14-bca1-da91eb9903db tempest-SharesNegativeTest-1014773059 tempest-SharesNegativeTest-1014773059-project-member] Calling method 'ShareMixin.delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:02:33 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.v1.shares [None req-fb345555-5eca-4f14-bca1-da91eb9903db tempest-SharesNegativeTest-1014773059 tempest-SharesNegativeTest-1014773059-project-member] Delete share with id: b05a8999-f1ac-4887-a675-3c2ca8e9cece May 28 13:02:33 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.quota [None req-91ab0ec3-a23b-4264-bd3e-0c749eed06bf tempest-ShareNetworkSubnetsTest-2134524932 tempest-ShareNetworkSubnetsTest-2134524932-project-member] Committed reservations ['c1eec78f-5594-4e62-af92-b4b67939afed'] {{(pid=98329) commit /opt/stack/manila/manila/quota.py:1063}} May 28 13:02:33 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-91ab0ec3-a23b-4264-bd3e-0c749eed06bf tempest-ShareNetworkSubnetsTest-2134524932 tempest-ShareNetworkSubnetsTest-2134524932-project-member] http://10.27.203.238/share/v1/73ff30a3b10d4ca099fc7022b36d49d9/share-networks/8d423adf-b3a1-43ef-b895-1454de3d36c2 returned with HTTP 202 May 28 13:02:33 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1259/2496] 10.27.203.238 () {62 vars in 1435 bytes} [Tue May 28 13:02:33 2024] DELETE /share/v1/73ff30a3b10d4ca099fc7022b36d49d9/share-networks/8d423adf-b3a1-43ef-b895-1454de3d36c2 => generated 0 bytes in 160 msecs (HTTP/1.1 202) 6 headers in 242 bytes (1 switches on core 0) May 28 13:02:33 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-a1a6634b-9250-44a7-a6aa-1a47f81e28ee tempest-ShareNetworkSubnetsTest-2134524932 tempest-ShareNetworkSubnetsTest-2134524932-project-member] GET http://10.27.203.238/share/v1/73ff30a3b10d4ca099fc7022b36d49d9/share-networks/8d423adf-b3a1-43ef-b895-1454de3d36c2 May 28 13:02:33 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-a1a6634b-9250-44a7-a6aa-1a47f81e28ee tempest-ShareNetworkSubnetsTest-2134524932 tempest-ShareNetworkSubnetsTest-2134524932-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:02:33 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-a1a6634b-9250-44a7-a6aa-1a47f81e28ee tempest-ShareNetworkSubnetsTest-2134524932 tempest-ShareNetworkSubnetsTest-2134524932-project-member] Calling method 'ShareNetworkController.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:02:33 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-a1a6634b-9250-44a7-a6aa-1a47f81e28ee tempest-ShareNetworkSubnetsTest-2134524932 tempest-ShareNetworkSubnetsTest-2134524932-project-member] HTTP exception thrown: Share network 8d423adf-b3a1-43ef-b895-1454de3d36c2 could not be found. May 28 13:02:33 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-a1a6634b-9250-44a7-a6aa-1a47f81e28ee tempest-ShareNetworkSubnetsTest-2134524932 tempest-ShareNetworkSubnetsTest-2134524932-project-member] http://10.27.203.238/share/v1/73ff30a3b10d4ca099fc7022b36d49d9/share-networks/8d423adf-b3a1-43ef-b895-1454de3d36c2 returned with HTTP 404 May 28 13:02:33 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1260/2497] 10.27.203.238 () {62 vars in 1432 bytes} [Tue May 28 13:02:33 2024] GET /share/v1/73ff30a3b10d4ca099fc7022b36d49d9/share-networks/8d423adf-b3a1-43ef-b895-1454de3d36c2 => generated 116 bytes in 17 msecs (HTTP/1.1 404) 6 headers in 237 bytes (2 switches on core 0) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3fb719-97b8-4480-a1c7-1726e29bde25 service manila] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3fb719-97b8-4480-a1c7-1726e29bde25 service manila] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352525c2-bce7-440f-8c43-ed9a0782a6d9 tempest-ShareNetworkSubnetsTest-2034479954 tempest-ShareNetworkSubnetsTest-2034479954-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bc97f1360f84c76a04d2e216cf7488c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f14455b44db646599c72bb78e8be787f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352525c2-bce7-440f-8c43-ed9a0782a6d9 tempest-ShareNetworkSubnetsTest-2034479954 tempest-ShareNetworkSubnetsTest-2034479954-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352525c2-bce7-440f-8c43-ed9a0782a6d9 tempest-ShareNetworkSubnetsTest-2034479954 tempest-ShareNetworkSubnetsTest-2034479954-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352525c2-bce7-440f-8c43-ed9a0782a6d9 tempest-ShareNetworkSubnetsTest-2034479954 tempest-ShareNetworkSubnetsTest-2034479954-project-admin] PATH_INFO: `/v3/users/8688f80695814f34bfb56342c4e54028` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352525c2-bce7-440f-8c43-ed9a0782a6d9 tempest-ShareNetworkSubnetsTest-2034479954 tempest-ShareNetworkSubnetsTest-2034479954-project-admin] RBAC: Authorizing `identity:delete_user(user_id=8688f80695814f34bfb56342c4e54028)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352525c2-bce7-440f-8c43-ed9a0782a6d9 tempest-ShareNetworkSubnetsTest-2034479954 tempest-ShareNetworkSubnetsTest-2034479954-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-352525c2-bce7-440f-8c43-ed9a0782a6d9 tempest-ShareNetworkSubnetsTest-2034479954 tempest-ShareNetworkSubnetsTest-2034479954-project-admin] Could not find user: 8688f80695814f34bfb56342c4e54028.: keystone.exception.UserNotFound: Could not find user: 8688f80695814f34bfb56342c4e54028. May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 8688f80695814f34bfb56342c4e54028. May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1698/3427] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:02:33 2024] DELETE /identity/v3/users/8688f80695814f34bfb56342c4e54028 => generated 110 bytes in 26 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dafead-6824-4650-9078-8178f433aae5 service manila] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dafead-6824-4650-9078-8178f433aae5 service manila] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ab6a3b-e595-4b81-8a8c-fbc2e7b7b6c3 tempest-ShareNetworkSubnetsTest-2034479954 tempest-ShareNetworkSubnetsTest-2034479954-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bc97f1360f84c76a04d2e216cf7488c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f14455b44db646599c72bb78e8be787f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ab6a3b-e595-4b81-8a8c-fbc2e7b7b6c3 tempest-ShareNetworkSubnetsTest-2034479954 tempest-ShareNetworkSubnetsTest-2034479954-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ab6a3b-e595-4b81-8a8c-fbc2e7b7b6c3 tempest-ShareNetworkSubnetsTest-2034479954 tempest-ShareNetworkSubnetsTest-2034479954-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ab6a3b-e595-4b81-8a8c-fbc2e7b7b6c3 tempest-ShareNetworkSubnetsTest-2034479954 tempest-ShareNetworkSubnetsTest-2034479954-project-admin] PATH_INFO: `/v3/users/108a25e436e9452a9a865957dcea1fc5` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ab6a3b-e595-4b81-8a8c-fbc2e7b7b6c3 tempest-ShareNetworkSubnetsTest-2034479954 tempest-ShareNetworkSubnetsTest-2034479954-project-admin] RBAC: Authorizing `identity:delete_user(user_id=108a25e436e9452a9a865957dcea1fc5)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ab6a3b-e595-4b81-8a8c-fbc2e7b7b6c3 tempest-ShareNetworkSubnetsTest-2034479954 tempest-ShareNetworkSubnetsTest-2034479954-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-90ab6a3b-e595-4b81-8a8c-fbc2e7b7b6c3 tempest-ShareNetworkSubnetsTest-2034479954 tempest-ShareNetworkSubnetsTest-2034479954-project-admin] Could not find user: 108a25e436e9452a9a865957dcea1fc5.: keystone.exception.UserNotFound: Could not find user: 108a25e436e9452a9a865957dcea1fc5. May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 108a25e436e9452a9a865957dcea1fc5. May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1730/3428] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:02:33 2024] DELETE /identity/v3/users/108a25e436e9452a9a865957dcea1fc5 => generated 110 bytes in 24 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:02:33 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-fb345555-5eca-4f14-bca1-da91eb9903db tempest-SharesNegativeTest-1014773059 tempest-SharesNegativeTest-1014773059-project-member] HTTP exception thrown: Invalid share: Share still has 1 dependent snapshots. May 28 13:02:33 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-fb345555-5eca-4f14-bca1-da91eb9903db tempest-SharesNegativeTest-1014773059 tempest-SharesNegativeTest-1014773059-project-member] http://10.27.203.238/share/v1/d1d71dc9f23c4c6a8e146d99ad65ebb2/shares/b05a8999-f1ac-4887-a675-3c2ca8e9cece returned with HTTP 403 May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352525c2-bce7-440f-8c43-ed9a0782a6d9 tempest-ShareNetworkSubnetsTest-2034479954 tempest-ShareNetworkSubnetsTest-2034479954-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:33 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1238/2498] 10.27.203.238 () {62 vars in 1411 bytes} [Tue May 28 13:02:33 2024] DELETE /share/v1/d1d71dc9f23c4c6a8e146d99ad65ebb2/shares/b05a8999-f1ac-4887-a675-3c2ca8e9cece => generated 96 bytes in 91 msecs (HTTP/1.1 403) 6 headers in 236 bytes (1 switches on core 0) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352525c2-bce7-440f-8c43-ed9a0782a6d9 tempest-ShareNetworkSubnetsTest-2034479954 tempest-ShareNetworkSubnetsTest-2034479954-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ab6a3b-e595-4b81-8a8c-fbc2e7b7b6c3 tempest-ShareNetworkSubnetsTest-2034479954 tempest-ShareNetworkSubnetsTest-2034479954-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7297c983-d7eb-4b4a-94b2-14cd1d28a9be tempest-ShareNetworkSubnetsTest-2034479954 tempest-ShareNetworkSubnetsTest-2034479954-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bc97f1360f84c76a04d2e216cf7488c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f14455b44db646599c72bb78e8be787f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7297c983-d7eb-4b4a-94b2-14cd1d28a9be tempest-ShareNetworkSubnetsTest-2034479954 tempest-ShareNetworkSubnetsTest-2034479954-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7297c983-d7eb-4b4a-94b2-14cd1d28a9be tempest-ShareNetworkSubnetsTest-2034479954 tempest-ShareNetworkSubnetsTest-2034479954-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7297c983-d7eb-4b4a-94b2-14cd1d28a9be tempest-ShareNetworkSubnetsTest-2034479954 tempest-ShareNetworkSubnetsTest-2034479954-project-admin] PATH_INFO: `/v3/users/5ae5cb1db3504baaba1df93dc154a004` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-90ab6a3b-e595-4b81-8a8c-fbc2e7b7b6c3 tempest-ShareNetworkSubnetsTest-2034479954 tempest-ShareNetworkSubnetsTest-2034479954-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7297c983-d7eb-4b4a-94b2-14cd1d28a9be tempest-ShareNetworkSubnetsTest-2034479954 tempest-ShareNetworkSubnetsTest-2034479954-project-admin] RBAC: Authorizing `identity:delete_user(user_id=5ae5cb1db3504baaba1df93dc154a004)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7297c983-d7eb-4b4a-94b2-14cd1d28a9be tempest-ShareNetworkSubnetsTest-2034479954 tempest-ShareNetworkSubnetsTest-2034479954-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-7297c983-d7eb-4b4a-94b2-14cd1d28a9be tempest-ShareNetworkSubnetsTest-2034479954 tempest-ShareNetworkSubnetsTest-2034479954-project-admin] Could not find user: 5ae5cb1db3504baaba1df93dc154a004.: keystone.exception.UserNotFound: Could not find user: 5ae5cb1db3504baaba1df93dc154a004. May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 5ae5cb1db3504baaba1df93dc154a004. May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1699/3429] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:02:33 2024] DELETE /identity/v3/users/5ae5cb1db3504baaba1df93dc154a004 => generated 110 bytes in 24 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7297c983-d7eb-4b4a-94b2-14cd1d28a9be tempest-ShareNetworkSubnetsTest-2034479954 tempest-ShareNetworkSubnetsTest-2034479954-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7297c983-d7eb-4b4a-94b2-14cd1d28a9be tempest-ShareNetworkSubnetsTest-2034479954 tempest-ShareNetworkSubnetsTest-2034479954-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542ee797-9882-45ac-a934-33da3cc01d9e tempest-ShareNetworkSubnetsTest-2034479954 tempest-ShareNetworkSubnetsTest-2034479954-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bc97f1360f84c76a04d2e216cf7488c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f14455b44db646599c72bb78e8be787f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542ee797-9882-45ac-a934-33da3cc01d9e tempest-ShareNetworkSubnetsTest-2034479954 tempest-ShareNetworkSubnetsTest-2034479954-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542ee797-9882-45ac-a934-33da3cc01d9e tempest-ShareNetworkSubnetsTest-2034479954 tempest-ShareNetworkSubnetsTest-2034479954-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542ee797-9882-45ac-a934-33da3cc01d9e tempest-ShareNetworkSubnetsTest-2034479954 tempest-ShareNetworkSubnetsTest-2034479954-project-admin] PATH_INFO: `/v3/users/c2ac6ca3ea5a4ae498df6d12bb7caadc` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542ee797-9882-45ac-a934-33da3cc01d9e tempest-ShareNetworkSubnetsTest-2034479954 tempest-ShareNetworkSubnetsTest-2034479954-project-admin] RBAC: Authorizing `identity:delete_user(user_id=c2ac6ca3ea5a4ae498df6d12bb7caadc)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542ee797-9882-45ac-a934-33da3cc01d9e tempest-ShareNetworkSubnetsTest-2034479954 tempest-ShareNetworkSubnetsTest-2034479954-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-542ee797-9882-45ac-a934-33da3cc01d9e tempest-ShareNetworkSubnetsTest-2034479954 tempest-ShareNetworkSubnetsTest-2034479954-project-admin] Could not find user: c2ac6ca3ea5a4ae498df6d12bb7caadc.: keystone.exception.UserNotFound: Could not find user: c2ac6ca3ea5a4ae498df6d12bb7caadc. May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: c2ac6ca3ea5a4ae498df6d12bb7caadc. May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1700/3430] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:02:33 2024] DELETE /identity/v3/users/c2ac6ca3ea5a4ae498df6d12bb7caadc => generated 110 bytes in 24 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542ee797-9882-45ac-a934-33da3cc01d9e tempest-ShareNetworkSubnetsTest-2034479954 tempest-ShareNetworkSubnetsTest-2034479954-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542ee797-9882-45ac-a934-33da3cc01d9e tempest-ShareNetworkSubnetsTest-2034479954 tempest-ShareNetworkSubnetsTest-2034479954-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ab6a3b-e595-4b81-8a8c-fbc2e7b7b6c3 tempest-ShareNetworkSubnetsTest-2034479954 tempest-ShareNetworkSubnetsTest-2034479954-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f5dc3e-0d39-4065-ad29-3d838d0fd149 tempest-ShareNetworkSubnetsTest-2034479954 tempest-ShareNetworkSubnetsTest-2034479954-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bc97f1360f84c76a04d2e216cf7488c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f14455b44db646599c72bb78e8be787f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f5dc3e-0d39-4065-ad29-3d838d0fd149 tempest-ShareNetworkSubnetsTest-2034479954 tempest-ShareNetworkSubnetsTest-2034479954-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f5dc3e-0d39-4065-ad29-3d838d0fd149 tempest-ShareNetworkSubnetsTest-2034479954 tempest-ShareNetworkSubnetsTest-2034479954-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f5dc3e-0d39-4065-ad29-3d838d0fd149 tempest-ShareNetworkSubnetsTest-2034479954 tempest-ShareNetworkSubnetsTest-2034479954-project-admin] PATH_INFO: `/v3/users/f89f851af36d480ab7d10d3506c60899` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edbe4b9-b122-455d-9f49-8984df6edb80 tempest-SharesNegativeTest-322550032 tempest-SharesNegativeTest-322550032-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8979d27306d441e385a31f56e8668ee3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adcbdea5704e4efc898c24b2b0a492a5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edbe4b9-b122-455d-9f49-8984df6edb80 tempest-SharesNegativeTest-322550032 tempest-SharesNegativeTest-322550032-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edbe4b9-b122-455d-9f49-8984df6edb80 tempest-SharesNegativeTest-322550032 tempest-SharesNegativeTest-322550032-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edbe4b9-b122-455d-9f49-8984df6edb80 tempest-SharesNegativeTest-322550032 tempest-SharesNegativeTest-322550032-project-admin] PATH_INFO: `/v3/users/14783f4fbce14880b4db4a628827607e` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f5dc3e-0d39-4065-ad29-3d838d0fd149 tempest-ShareNetworkSubnetsTest-2034479954 tempest-ShareNetworkSubnetsTest-2034479954-project-admin] RBAC: Authorizing `identity:delete_user(user_id=f89f851af36d480ab7d10d3506c60899)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edbe4b9-b122-455d-9f49-8984df6edb80 tempest-SharesNegativeTest-322550032 tempest-SharesNegativeTest-322550032-project-admin] RBAC: Authorizing `identity:delete_user(user_id=14783f4fbce14880b4db4a628827607e)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f5dc3e-0d39-4065-ad29-3d838d0fd149 tempest-ShareNetworkSubnetsTest-2034479954 tempest-ShareNetworkSubnetsTest-2034479954-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edbe4b9-b122-455d-9f49-8984df6edb80 tempest-SharesNegativeTest-322550032 tempest-SharesNegativeTest-322550032-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-a9f5dc3e-0d39-4065-ad29-3d838d0fd149 tempest-ShareNetworkSubnetsTest-2034479954 tempest-ShareNetworkSubnetsTest-2034479954-project-admin] Could not find user: f89f851af36d480ab7d10d3506c60899.: keystone.exception.UserNotFound: Could not find user: f89f851af36d480ab7d10d3506c60899. May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: f89f851af36d480ab7d10d3506c60899. May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-0edbe4b9-b122-455d-9f49-8984df6edb80 tempest-SharesNegativeTest-322550032 tempest-SharesNegativeTest-322550032-project-admin] Could not find user: 14783f4fbce14880b4db4a628827607e.: keystone.exception.UserNotFound: Could not find user: 14783f4fbce14880b4db4a628827607e. May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 14783f4fbce14880b4db4a628827607e. May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1701/3431] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:02:33 2024] DELETE /identity/v3/users/f89f851af36d480ab7d10d3506c60899 => generated 110 bytes in 24 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1731/3432] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:02:33 2024] DELETE /identity/v3/users/14783f4fbce14880b4db4a628827607e => generated 110 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f5dc3e-0d39-4065-ad29-3d838d0fd149 tempest-ShareNetworkSubnetsTest-2034479954 tempest-ShareNetworkSubnetsTest-2034479954-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edbe4b9-b122-455d-9f49-8984df6edb80 tempest-SharesNegativeTest-322550032 tempest-SharesNegativeTest-322550032-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f5dc3e-0d39-4065-ad29-3d838d0fd149 tempest-ShareNetworkSubnetsTest-2034479954 tempest-ShareNetworkSubnetsTest-2034479954-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edbe4b9-b122-455d-9f49-8984df6edb80 tempest-SharesNegativeTest-322550032 tempest-SharesNegativeTest-322550032-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d33895c-0edf-48b4-b72a-7183e78b5620 tempest-ShareNetworkSubnetsTest-2034479954 tempest-ShareNetworkSubnetsTest-2034479954-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bc97f1360f84c76a04d2e216cf7488c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f14455b44db646599c72bb78e8be787f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d33895c-0edf-48b4-b72a-7183e78b5620 tempest-ShareNetworkSubnetsTest-2034479954 tempest-ShareNetworkSubnetsTest-2034479954-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d33895c-0edf-48b4-b72a-7183e78b5620 tempest-ShareNetworkSubnetsTest-2034479954 tempest-ShareNetworkSubnetsTest-2034479954-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d33895c-0edf-48b4-b72a-7183e78b5620 tempest-ShareNetworkSubnetsTest-2034479954 tempest-ShareNetworkSubnetsTest-2034479954-project-admin] PATH_INFO: `/v3/users/6886717a9cfb42a0a4142a0b982570ee` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c498e1a3-7905-409d-aa69-2c521206e560 tempest-SharesNegativeTest-322550032 tempest-SharesNegativeTest-322550032-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8979d27306d441e385a31f56e8668ee3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adcbdea5704e4efc898c24b2b0a492a5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c498e1a3-7905-409d-aa69-2c521206e560 tempest-SharesNegativeTest-322550032 tempest-SharesNegativeTest-322550032-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c498e1a3-7905-409d-aa69-2c521206e560 tempest-SharesNegativeTest-322550032 tempest-SharesNegativeTest-322550032-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c498e1a3-7905-409d-aa69-2c521206e560 tempest-SharesNegativeTest-322550032 tempest-SharesNegativeTest-322550032-project-admin] PATH_INFO: `/v3/users/9eca355145fd413390b5efe7a0d95465` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d33895c-0edf-48b4-b72a-7183e78b5620 tempest-ShareNetworkSubnetsTest-2034479954 tempest-ShareNetworkSubnetsTest-2034479954-project-admin] RBAC: Authorizing `identity:delete_user(user_id=6886717a9cfb42a0a4142a0b982570ee)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d33895c-0edf-48b4-b72a-7183e78b5620 tempest-ShareNetworkSubnetsTest-2034479954 tempest-ShareNetworkSubnetsTest-2034479954-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c498e1a3-7905-409d-aa69-2c521206e560 tempest-SharesNegativeTest-322550032 tempest-SharesNegativeTest-322550032-project-admin] RBAC: Authorizing `identity:delete_user(user_id=9eca355145fd413390b5efe7a0d95465)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c498e1a3-7905-409d-aa69-2c521206e560 tempest-SharesNegativeTest-322550032 tempest-SharesNegativeTest-322550032-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-2d33895c-0edf-48b4-b72a-7183e78b5620 tempest-ShareNetworkSubnetsTest-2034479954 tempest-ShareNetworkSubnetsTest-2034479954-project-admin] Could not find user: 6886717a9cfb42a0a4142a0b982570ee.: keystone.exception.UserNotFound: Could not find user: 6886717a9cfb42a0a4142a0b982570ee. May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 6886717a9cfb42a0a4142a0b982570ee. May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-c498e1a3-7905-409d-aa69-2c521206e560 tempest-SharesNegativeTest-322550032 tempest-SharesNegativeTest-322550032-project-admin] Could not find user: 9eca355145fd413390b5efe7a0d95465.: keystone.exception.UserNotFound: Could not find user: 9eca355145fd413390b5efe7a0d95465. May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 9eca355145fd413390b5efe7a0d95465. May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1702/3433] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:02:33 2024] DELETE /identity/v3/users/6886717a9cfb42a0a4142a0b982570ee => generated 110 bytes in 22 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1732/3434] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:02:33 2024] DELETE /identity/v3/users/9eca355145fd413390b5efe7a0d95465 => generated 110 bytes in 22 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d33895c-0edf-48b4-b72a-7183e78b5620 tempest-ShareNetworkSubnetsTest-2034479954 tempest-ShareNetworkSubnetsTest-2034479954-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c498e1a3-7905-409d-aa69-2c521206e560 tempest-SharesNegativeTest-322550032 tempest-SharesNegativeTest-322550032-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d33895c-0edf-48b4-b72a-7183e78b5620 tempest-ShareNetworkSubnetsTest-2034479954 tempest-ShareNetworkSubnetsTest-2034479954-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c498e1a3-7905-409d-aa69-2c521206e560 tempest-SharesNegativeTest-322550032 tempest-SharesNegativeTest-322550032-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc887c1-1bff-4bed-9648-9cd0bef85f79 tempest-ShareNetworkSubnetsTest-2034479954 tempest-ShareNetworkSubnetsTest-2034479954-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bc97f1360f84c76a04d2e216cf7488c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f14455b44db646599c72bb78e8be787f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc887c1-1bff-4bed-9648-9cd0bef85f79 tempest-ShareNetworkSubnetsTest-2034479954 tempest-ShareNetworkSubnetsTest-2034479954-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc887c1-1bff-4bed-9648-9cd0bef85f79 tempest-ShareNetworkSubnetsTest-2034479954 tempest-ShareNetworkSubnetsTest-2034479954-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc887c1-1bff-4bed-9648-9cd0bef85f79 tempest-ShareNetworkSubnetsTest-2034479954 tempest-ShareNetworkSubnetsTest-2034479954-project-admin] PATH_INFO: `/v3/users/b523155e680a4a14acd4f3a4295a8d26` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e269927-daed-440c-98a6-fdeed8255efb tempest-SharesNegativeTest-322550032 tempest-SharesNegativeTest-322550032-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8979d27306d441e385a31f56e8668ee3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adcbdea5704e4efc898c24b2b0a492a5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e269927-daed-440c-98a6-fdeed8255efb tempest-SharesNegativeTest-322550032 tempest-SharesNegativeTest-322550032-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e269927-daed-440c-98a6-fdeed8255efb tempest-SharesNegativeTest-322550032 tempest-SharesNegativeTest-322550032-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e269927-daed-440c-98a6-fdeed8255efb tempest-SharesNegativeTest-322550032 tempest-SharesNegativeTest-322550032-project-admin] PATH_INFO: `/v3/users/91ab54ee09854b549923fb7671247f5c` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc887c1-1bff-4bed-9648-9cd0bef85f79 tempest-ShareNetworkSubnetsTest-2034479954 tempest-ShareNetworkSubnetsTest-2034479954-project-admin] RBAC: Authorizing `identity:delete_user(user_id=b523155e680a4a14acd4f3a4295a8d26)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc887c1-1bff-4bed-9648-9cd0bef85f79 tempest-ShareNetworkSubnetsTest-2034479954 tempest-ShareNetworkSubnetsTest-2034479954-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e269927-daed-440c-98a6-fdeed8255efb tempest-SharesNegativeTest-322550032 tempest-SharesNegativeTest-322550032-project-admin] RBAC: Authorizing `identity:delete_user(user_id=91ab54ee09854b549923fb7671247f5c)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e269927-daed-440c-98a6-fdeed8255efb tempest-SharesNegativeTest-322550032 tempest-SharesNegativeTest-322550032-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-8fc887c1-1bff-4bed-9648-9cd0bef85f79 tempest-ShareNetworkSubnetsTest-2034479954 tempest-ShareNetworkSubnetsTest-2034479954-project-admin] Could not find user: b523155e680a4a14acd4f3a4295a8d26.: keystone.exception.UserNotFound: Could not find user: b523155e680a4a14acd4f3a4295a8d26. May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: b523155e680a4a14acd4f3a4295a8d26. May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-8e269927-daed-440c-98a6-fdeed8255efb tempest-SharesNegativeTest-322550032 tempest-SharesNegativeTest-322550032-project-admin] Could not find user: 91ab54ee09854b549923fb7671247f5c.: keystone.exception.UserNotFound: Could not find user: 91ab54ee09854b549923fb7671247f5c. May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 91ab54ee09854b549923fb7671247f5c. May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1703/3435] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:02:33 2024] DELETE /identity/v3/users/b523155e680a4a14acd4f3a4295a8d26 => generated 110 bytes in 22 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1733/3436] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:02:33 2024] DELETE /identity/v3/users/91ab54ee09854b549923fb7671247f5c => generated 110 bytes in 22 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc887c1-1bff-4bed-9648-9cd0bef85f79 tempest-ShareNetworkSubnetsTest-2034479954 tempest-ShareNetworkSubnetsTest-2034479954-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e269927-daed-440c-98a6-fdeed8255efb tempest-SharesNegativeTest-322550032 tempest-SharesNegativeTest-322550032-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc887c1-1bff-4bed-9648-9cd0bef85f79 tempest-ShareNetworkSubnetsTest-2034479954 tempest-ShareNetworkSubnetsTest-2034479954-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e269927-daed-440c-98a6-fdeed8255efb tempest-SharesNegativeTest-322550032 tempest-SharesNegativeTest-322550032-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4386f77e-c46a-4ef7-8809-8cf709f3b233 tempest-ShareNetworkSubnetsTest-2034479954 tempest-ShareNetworkSubnetsTest-2034479954-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bc97f1360f84c76a04d2e216cf7488c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f14455b44db646599c72bb78e8be787f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4386f77e-c46a-4ef7-8809-8cf709f3b233 tempest-ShareNetworkSubnetsTest-2034479954 tempest-ShareNetworkSubnetsTest-2034479954-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4386f77e-c46a-4ef7-8809-8cf709f3b233 tempest-ShareNetworkSubnetsTest-2034479954 tempest-ShareNetworkSubnetsTest-2034479954-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4386f77e-c46a-4ef7-8809-8cf709f3b233 tempest-ShareNetworkSubnetsTest-2034479954 tempest-ShareNetworkSubnetsTest-2034479954-project-admin] PATH_INFO: `/v3/users/756070dd0b274fd8835b10a8fbe293d9` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11448656-1527-4b70-a2a2-d3964fb0cc9f tempest-SharesNegativeTest-322550032 tempest-SharesNegativeTest-322550032-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8979d27306d441e385a31f56e8668ee3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adcbdea5704e4efc898c24b2b0a492a5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11448656-1527-4b70-a2a2-d3964fb0cc9f tempest-SharesNegativeTest-322550032 tempest-SharesNegativeTest-322550032-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11448656-1527-4b70-a2a2-d3964fb0cc9f tempest-SharesNegativeTest-322550032 tempest-SharesNegativeTest-322550032-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11448656-1527-4b70-a2a2-d3964fb0cc9f tempest-SharesNegativeTest-322550032 tempest-SharesNegativeTest-322550032-project-admin] PATH_INFO: `/v3/users/2889a927897c49bd92a0d1cfdf27e7f5` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4386f77e-c46a-4ef7-8809-8cf709f3b233 tempest-ShareNetworkSubnetsTest-2034479954 tempest-ShareNetworkSubnetsTest-2034479954-project-admin] RBAC: Authorizing `identity:delete_user(user_id=756070dd0b274fd8835b10a8fbe293d9)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4386f77e-c46a-4ef7-8809-8cf709f3b233 tempest-ShareNetworkSubnetsTest-2034479954 tempest-ShareNetworkSubnetsTest-2034479954-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11448656-1527-4b70-a2a2-d3964fb0cc9f tempest-SharesNegativeTest-322550032 tempest-SharesNegativeTest-322550032-project-admin] RBAC: Authorizing `identity:delete_user(user_id=2889a927897c49bd92a0d1cfdf27e7f5)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11448656-1527-4b70-a2a2-d3964fb0cc9f tempest-SharesNegativeTest-322550032 tempest-SharesNegativeTest-322550032-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-4386f77e-c46a-4ef7-8809-8cf709f3b233 tempest-ShareNetworkSubnetsTest-2034479954 tempest-ShareNetworkSubnetsTest-2034479954-project-admin] Could not find user: 756070dd0b274fd8835b10a8fbe293d9.: keystone.exception.UserNotFound: Could not find user: 756070dd0b274fd8835b10a8fbe293d9. May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 756070dd0b274fd8835b10a8fbe293d9. May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1704/3437] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:02:33 2024] DELETE /identity/v3/users/756070dd0b274fd8835b10a8fbe293d9 => generated 110 bytes in 23 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-11448656-1527-4b70-a2a2-d3964fb0cc9f tempest-SharesNegativeTest-322550032 tempest-SharesNegativeTest-322550032-project-admin] Could not find user: 2889a927897c49bd92a0d1cfdf27e7f5.: keystone.exception.UserNotFound: Could not find user: 2889a927897c49bd92a0d1cfdf27e7f5. May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 2889a927897c49bd92a0d1cfdf27e7f5. May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1734/3438] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:02:33 2024] DELETE /identity/v3/users/2889a927897c49bd92a0d1cfdf27e7f5 => generated 110 bytes in 22 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4386f77e-c46a-4ef7-8809-8cf709f3b233 tempest-ShareNetworkSubnetsTest-2034479954 tempest-ShareNetworkSubnetsTest-2034479954-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11448656-1527-4b70-a2a2-d3964fb0cc9f tempest-SharesNegativeTest-322550032 tempest-SharesNegativeTest-322550032-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4386f77e-c46a-4ef7-8809-8cf709f3b233 tempest-ShareNetworkSubnetsTest-2034479954 tempest-ShareNetworkSubnetsTest-2034479954-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11448656-1527-4b70-a2a2-d3964fb0cc9f tempest-SharesNegativeTest-322550032 tempest-SharesNegativeTest-322550032-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92948f04-d67f-4daa-bbee-86d56dd755cf tempest-ShareNetworkSubnetsTest-2034479954 tempest-ShareNetworkSubnetsTest-2034479954-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bc97f1360f84c76a04d2e216cf7488c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f14455b44db646599c72bb78e8be787f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92948f04-d67f-4daa-bbee-86d56dd755cf tempest-ShareNetworkSubnetsTest-2034479954 tempest-ShareNetworkSubnetsTest-2034479954-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92948f04-d67f-4daa-bbee-86d56dd755cf tempest-ShareNetworkSubnetsTest-2034479954 tempest-ShareNetworkSubnetsTest-2034479954-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92948f04-d67f-4daa-bbee-86d56dd755cf tempest-ShareNetworkSubnetsTest-2034479954 tempest-ShareNetworkSubnetsTest-2034479954-project-admin] PATH_INFO: `/v3/users/cdf8594f55cb448e9b2312d051486331` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e6ad0d-3cb9-4c6a-a83f-4b3386720369 tempest-SharesNegativeTest-322550032 tempest-SharesNegativeTest-322550032-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8979d27306d441e385a31f56e8668ee3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adcbdea5704e4efc898c24b2b0a492a5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e6ad0d-3cb9-4c6a-a83f-4b3386720369 tempest-SharesNegativeTest-322550032 tempest-SharesNegativeTest-322550032-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e6ad0d-3cb9-4c6a-a83f-4b3386720369 tempest-SharesNegativeTest-322550032 tempest-SharesNegativeTest-322550032-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e6ad0d-3cb9-4c6a-a83f-4b3386720369 tempest-SharesNegativeTest-322550032 tempest-SharesNegativeTest-322550032-project-admin] PATH_INFO: `/v3/users/bd43e5d1c359462d807b6e8a8581fa73` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92948f04-d67f-4daa-bbee-86d56dd755cf tempest-ShareNetworkSubnetsTest-2034479954 tempest-ShareNetworkSubnetsTest-2034479954-project-admin] RBAC: Authorizing `identity:delete_user(user_id=cdf8594f55cb448e9b2312d051486331)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92948f04-d67f-4daa-bbee-86d56dd755cf tempest-ShareNetworkSubnetsTest-2034479954 tempest-ShareNetworkSubnetsTest-2034479954-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e6ad0d-3cb9-4c6a-a83f-4b3386720369 tempest-SharesNegativeTest-322550032 tempest-SharesNegativeTest-322550032-project-admin] RBAC: Authorizing `identity:delete_user(user_id=bd43e5d1c359462d807b6e8a8581fa73)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e6ad0d-3cb9-4c6a-a83f-4b3386720369 tempest-SharesNegativeTest-322550032 tempest-SharesNegativeTest-322550032-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-92948f04-d67f-4daa-bbee-86d56dd755cf tempest-ShareNetworkSubnetsTest-2034479954 tempest-ShareNetworkSubnetsTest-2034479954-project-admin] Could not find user: cdf8594f55cb448e9b2312d051486331.: keystone.exception.UserNotFound: Could not find user: cdf8594f55cb448e9b2312d051486331. May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cdf8594f55cb448e9b2312d051486331. May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1705/3439] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:02:33 2024] DELETE /identity/v3/users/cdf8594f55cb448e9b2312d051486331 => generated 110 bytes in 23 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-e7e6ad0d-3cb9-4c6a-a83f-4b3386720369 tempest-SharesNegativeTest-322550032 tempest-SharesNegativeTest-322550032-project-admin] Could not find user: bd43e5d1c359462d807b6e8a8581fa73.: keystone.exception.UserNotFound: Could not find user: bd43e5d1c359462d807b6e8a8581fa73. May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: bd43e5d1c359462d807b6e8a8581fa73. May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1735/3440] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:02:33 2024] DELETE /identity/v3/users/bd43e5d1c359462d807b6e8a8581fa73 => generated 110 bytes in 24 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92948f04-d67f-4daa-bbee-86d56dd755cf tempest-ShareNetworkSubnetsTest-2034479954 tempest-ShareNetworkSubnetsTest-2034479954-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e6ad0d-3cb9-4c6a-a83f-4b3386720369 tempest-SharesNegativeTest-322550032 tempest-SharesNegativeTest-322550032-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92948f04-d67f-4daa-bbee-86d56dd755cf tempest-ShareNetworkSubnetsTest-2034479954 tempest-ShareNetworkSubnetsTest-2034479954-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e6ad0d-3cb9-4c6a-a83f-4b3386720369 tempest-SharesNegativeTest-322550032 tempest-SharesNegativeTest-322550032-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b04aeb-bd51-41c4-8b49-8f774f4011e8 tempest-ShareNetworkSubnetsTest-2034479954 tempest-ShareNetworkSubnetsTest-2034479954-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bc97f1360f84c76a04d2e216cf7488c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f14455b44db646599c72bb78e8be787f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b04aeb-bd51-41c4-8b49-8f774f4011e8 tempest-ShareNetworkSubnetsTest-2034479954 tempest-ShareNetworkSubnetsTest-2034479954-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b04aeb-bd51-41c4-8b49-8f774f4011e8 tempest-ShareNetworkSubnetsTest-2034479954 tempest-ShareNetworkSubnetsTest-2034479954-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b04aeb-bd51-41c4-8b49-8f774f4011e8 tempest-ShareNetworkSubnetsTest-2034479954 tempest-ShareNetworkSubnetsTest-2034479954-project-admin] PATH_INFO: `/v3/users/a3784840ad6a4156929be55026b39776` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b04aeb-bd51-41c4-8b49-8f774f4011e8 tempest-ShareNetworkSubnetsTest-2034479954 tempest-ShareNetworkSubnetsTest-2034479954-project-admin] RBAC: Authorizing `identity:delete_user(user_id=a3784840ad6a4156929be55026b39776)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b87693-035d-4416-90f9-3e2ff6be6441 tempest-SharesNegativeTest-322550032 tempest-SharesNegativeTest-322550032-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8979d27306d441e385a31f56e8668ee3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adcbdea5704e4efc898c24b2b0a492a5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b04aeb-bd51-41c4-8b49-8f774f4011e8 tempest-ShareNetworkSubnetsTest-2034479954 tempest-ShareNetworkSubnetsTest-2034479954-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b87693-035d-4416-90f9-3e2ff6be6441 tempest-SharesNegativeTest-322550032 tempest-SharesNegativeTest-322550032-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b87693-035d-4416-90f9-3e2ff6be6441 tempest-SharesNegativeTest-322550032 tempest-SharesNegativeTest-322550032-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b87693-035d-4416-90f9-3e2ff6be6441 tempest-SharesNegativeTest-322550032 tempest-SharesNegativeTest-322550032-project-admin] PATH_INFO: `/v3/users/18c7667276334e98bdd11d2b9d1875cc` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b87693-035d-4416-90f9-3e2ff6be6441 tempest-SharesNegativeTest-322550032 tempest-SharesNegativeTest-322550032-project-admin] RBAC: Authorizing `identity:delete_user(user_id=18c7667276334e98bdd11d2b9d1875cc)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b87693-035d-4416-90f9-3e2ff6be6441 tempest-SharesNegativeTest-322550032 tempest-SharesNegativeTest-322550032-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-e0b87693-035d-4416-90f9-3e2ff6be6441 tempest-SharesNegativeTest-322550032 tempest-SharesNegativeTest-322550032-project-admin] Could not find user: 18c7667276334e98bdd11d2b9d1875cc.: keystone.exception.UserNotFound: Could not find user: 18c7667276334e98bdd11d2b9d1875cc. May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 18c7667276334e98bdd11d2b9d1875cc. May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1736/3441] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:02:33 2024] DELETE /identity/v3/users/18c7667276334e98bdd11d2b9d1875cc => generated 110 bytes in 24 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b87693-035d-4416-90f9-3e2ff6be6441 tempest-SharesNegativeTest-322550032 tempest-SharesNegativeTest-322550032-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b87693-035d-4416-90f9-3e2ff6be6441 tempest-SharesNegativeTest-322550032 tempest-SharesNegativeTest-322550032-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0723d561-a403-4fa3-a694-34b28305727b tempest-SharesNegativeTest-322550032 tempest-SharesNegativeTest-322550032-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8979d27306d441e385a31f56e8668ee3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adcbdea5704e4efc898c24b2b0a492a5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0723d561-a403-4fa3-a694-34b28305727b tempest-SharesNegativeTest-322550032 tempest-SharesNegativeTest-322550032-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0723d561-a403-4fa3-a694-34b28305727b tempest-SharesNegativeTest-322550032 tempest-SharesNegativeTest-322550032-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0723d561-a403-4fa3-a694-34b28305727b tempest-SharesNegativeTest-322550032 tempest-SharesNegativeTest-322550032-project-admin] PATH_INFO: `/v3/users/db0396a316ea4c5697d47df053fccbe4` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0723d561-a403-4fa3-a694-34b28305727b tempest-SharesNegativeTest-322550032 tempest-SharesNegativeTest-322550032-project-admin] RBAC: Authorizing `identity:delete_user(user_id=db0396a316ea4c5697d47df053fccbe4)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0723d561-a403-4fa3-a694-34b28305727b tempest-SharesNegativeTest-322550032 tempest-SharesNegativeTest-322550032-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-0723d561-a403-4fa3-a694-34b28305727b tempest-SharesNegativeTest-322550032 tempest-SharesNegativeTest-322550032-project-admin] Could not find user: db0396a316ea4c5697d47df053fccbe4.: keystone.exception.UserNotFound: Could not find user: db0396a316ea4c5697d47df053fccbe4. May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: db0396a316ea4c5697d47df053fccbe4. May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1737/3442] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:02:34 2024] DELETE /identity/v3/users/db0396a316ea4c5697d47df053fccbe4 => generated 110 bytes in 24 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0723d561-a403-4fa3-a694-34b28305727b tempest-SharesNegativeTest-322550032 tempest-SharesNegativeTest-322550032-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0723d561-a403-4fa3-a694-34b28305727b tempest-SharesNegativeTest-322550032 tempest-SharesNegativeTest-322550032-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-82b04aeb-bd51-41c4-8b49-8f774f4011e8 tempest-ShareNetworkSubnetsTest-2034479954 tempest-ShareNetworkSubnetsTest-2034479954-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3784840ad6a4156929be55026b39776', 'request_id': 'req-82b04aeb-bd51-41c4-8b49-8f774f4011e8'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-82b04aeb-bd51-41c4-8b49-8f774f4011e8 tempest-ShareNetworkSubnetsTest-2034479954 tempest-ShareNetworkSubnetsTest-2034479954-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3784840ad6a4156929be55026b39776', 'request_id': 'req-82b04aeb-bd51-41c4-8b49-8f774f4011e8'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-82b04aeb-bd51-41c4-8b49-8f774f4011e8 tempest-ShareNetworkSubnetsTest-2034479954 tempest-ShareNetworkSubnetsTest-2034479954-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3784840ad6a4156929be55026b39776', 'request_id': 'req-82b04aeb-bd51-41c4-8b49-8f774f4011e8'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-82b04aeb-bd51-41c4-8b49-8f774f4011e8 tempest-ShareNetworkSubnetsTest-2034479954 tempest-ShareNetworkSubnetsTest-2034479954-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3784840ad6a4156929be55026b39776', 'request_id': 'req-82b04aeb-bd51-41c4-8b49-8f774f4011e8'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-82b04aeb-bd51-41c4-8b49-8f774f4011e8 tempest-ShareNetworkSubnetsTest-2034479954 tempest-ShareNetworkSubnetsTest-2034479954-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3784840ad6a4156929be55026b39776', 'request_id': 'req-82b04aeb-bd51-41c4-8b49-8f774f4011e8'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1706/3443] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:02:33 2024] DELETE /identity/v3/users/a3784840ad6a4156929be55026b39776 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:02:34 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-e753239a-5218-49a6-bab8-cf7412c670f8 tempest-ShareNetworkSubnetsTest-2034479954 tempest-ShareNetworkSubnetsTest-2034479954-project-admin] DELETE http://10.27.203.238/share/v2/f14455b44db646599c72bb78e8be787f/types/ba9f84ba-7089-432b-9e87-dbef90237fef May 28 13:02:34 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-e753239a-5218-49a6-bab8-cf7412c670f8 tempest-ShareNetworkSubnetsTest-2034479954 tempest-ShareNetworkSubnetsTest-2034479954-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:02:34 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-e753239a-5218-49a6-bab8-cf7412c670f8 tempest-ShareNetworkSubnetsTest-2034479954 tempest-ShareNetworkSubnetsTest-2034479954-project-admin] Calling method 'ShareTypesController._delete' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5dd891-effa-46b4-aeca-642c6f7d4573 tempest-SharesNegativeTest-322550032 tempest-SharesNegativeTest-322550032-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8979d27306d441e385a31f56e8668ee3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adcbdea5704e4efc898c24b2b0a492a5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5dd891-effa-46b4-aeca-642c6f7d4573 tempest-SharesNegativeTest-322550032 tempest-SharesNegativeTest-322550032-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5dd891-effa-46b4-aeca-642c6f7d4573 tempest-SharesNegativeTest-322550032 tempest-SharesNegativeTest-322550032-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5dd891-effa-46b4-aeca-642c6f7d4573 tempest-SharesNegativeTest-322550032 tempest-SharesNegativeTest-322550032-project-admin] PATH_INFO: `/v3/users/8408bca6708d4e57b4e6ae91fa7eb8e3` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5dd891-effa-46b4-aeca-642c6f7d4573 tempest-SharesNegativeTest-322550032 tempest-SharesNegativeTest-322550032-project-admin] RBAC: Authorizing `identity:delete_user(user_id=8408bca6708d4e57b4e6ae91fa7eb8e3)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5dd891-effa-46b4-aeca-642c6f7d4573 tempest-SharesNegativeTest-322550032 tempest-SharesNegativeTest-322550032-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-1d5dd891-effa-46b4-aeca-642c6f7d4573 tempest-SharesNegativeTest-322550032 tempest-SharesNegativeTest-322550032-project-admin] Could not find user: 8408bca6708d4e57b4e6ae91fa7eb8e3.: keystone.exception.UserNotFound: Could not find user: 8408bca6708d4e57b4e6ae91fa7eb8e3. May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 8408bca6708d4e57b4e6ae91fa7eb8e3. May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1738/3444] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:02:34 2024] DELETE /identity/v3/users/8408bca6708d4e57b4e6ae91fa7eb8e3 => generated 110 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b04aeb-bd51-41c4-8b49-8f774f4011e8 tempest-ShareNetworkSubnetsTest-2034479954 tempest-ShareNetworkSubnetsTest-2034479954-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-82b04aeb-bd51-41c4-8b49-8f774f4011e8 tempest-ShareNetworkSubnetsTest-2034479954 tempest-ShareNetworkSubnetsTest-2034479954-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:02:34 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-e753239a-5218-49a6-bab8-cf7412c670f8 tempest-ShareNetworkSubnetsTest-2034479954 tempest-ShareNetworkSubnetsTest-2034479954-project-admin] http://10.27.203.238/share/v2/f14455b44db646599c72bb78e8be787f/types/ba9f84ba-7089-432b-9e87-dbef90237fef returned with HTTP 202 May 28 13:02:34 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1261/2499] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:02:34 2024] DELETE /share/v2/f14455b44db646599c72bb78e8be787f/types/ba9f84ba-7089-432b-9e87-dbef90237fef => generated 0 bytes in 35 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 13:02:34 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-0354d341-9ff6-4a8d-a4ec-93bca76e366a tempest-ShareNetworkSubnetsTest-2034479954 tempest-ShareNetworkSubnetsTest-2034479954-project-admin] GET http://10.27.203.238/share/v2/f14455b44db646599c72bb78e8be787f/types/ba9f84ba-7089-432b-9e87-dbef90237fef May 28 13:02:34 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-0354d341-9ff6-4a8d-a4ec-93bca76e366a tempest-ShareNetworkSubnetsTest-2034479954 tempest-ShareNetworkSubnetsTest-2034479954-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:02:34 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-0354d341-9ff6-4a8d-a4ec-93bca76e366a tempest-ShareNetworkSubnetsTest-2034479954 tempest-ShareNetworkSubnetsTest-2034479954-project-admin] Calling method 'ShareTypesController.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:02:34 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-0354d341-9ff6-4a8d-a4ec-93bca76e366a tempest-ShareNetworkSubnetsTest-2034479954 tempest-ShareNetworkSubnetsTest-2034479954-project-admin] HTTP exception thrown: Share type not found. May 28 13:02:34 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-0354d341-9ff6-4a8d-a4ec-93bca76e366a tempest-ShareNetworkSubnetsTest-2034479954 tempest-ShareNetworkSubnetsTest-2034479954-project-admin] http://10.27.203.238/share/v2/f14455b44db646599c72bb78e8be787f/types/ba9f84ba-7089-432b-9e87-dbef90237fef returned with HTTP 404 May 28 13:02:34 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1239/2500] 10.27.203.238 () {64 vars in 1448 bytes} [Tue May 28 13:02:34 2024] GET /share/v2/f14455b44db646599c72bb78e8be787f/types/ba9f84ba-7089-432b-9e87-dbef90237fef => generated 67 bytes in 10 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5dd891-effa-46b4-aeca-642c6f7d4573 tempest-SharesNegativeTest-322550032 tempest-SharesNegativeTest-322550032-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-1d5dd891-effa-46b4-aeca-642c6f7d4573 tempest-SharesNegativeTest-322550032 tempest-SharesNegativeTest-322550032-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b04aeb-bd51-41c4-8b49-8f774f4011e8 tempest-ShareNetworkSubnetsTest-2034479954 tempest-ShareNetworkSubnetsTest-2034479954-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5dd891-effa-46b4-aeca-642c6f7d4573 tempest-SharesNegativeTest-322550032 tempest-SharesNegativeTest-322550032-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33c439c-ba39-4eee-aeed-ba04aa7d331f tempest-SharesNegativeTest-322550032 tempest-SharesNegativeTest-322550032-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8979d27306d441e385a31f56e8668ee3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adcbdea5704e4efc898c24b2b0a492a5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33c439c-ba39-4eee-aeed-ba04aa7d331f tempest-SharesNegativeTest-322550032 tempest-SharesNegativeTest-322550032-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33c439c-ba39-4eee-aeed-ba04aa7d331f tempest-SharesNegativeTest-322550032 tempest-SharesNegativeTest-322550032-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33c439c-ba39-4eee-aeed-ba04aa7d331f tempest-SharesNegativeTest-322550032 tempest-SharesNegativeTest-322550032-project-admin] PATH_INFO: `/v3/users/e593bd019bc24f30b8b269cbdd2e3494` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33c439c-ba39-4eee-aeed-ba04aa7d331f tempest-SharesNegativeTest-322550032 tempest-SharesNegativeTest-322550032-project-admin] RBAC: Authorizing `identity:delete_user(user_id=e593bd019bc24f30b8b269cbdd2e3494)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33c439c-ba39-4eee-aeed-ba04aa7d331f tempest-SharesNegativeTest-322550032 tempest-SharesNegativeTest-322550032-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-b33c439c-ba39-4eee-aeed-ba04aa7d331f tempest-SharesNegativeTest-322550032 tempest-SharesNegativeTest-322550032-project-admin] Could not find user: e593bd019bc24f30b8b269cbdd2e3494.: keystone.exception.UserNotFound: Could not find user: e593bd019bc24f30b8b269cbdd2e3494. May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: e593bd019bc24f30b8b269cbdd2e3494. May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1707/3445] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:02:34 2024] DELETE /identity/v3/users/e593bd019bc24f30b8b269cbdd2e3494 => generated 110 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33c439c-ba39-4eee-aeed-ba04aa7d331f tempest-SharesNegativeTest-322550032 tempest-SharesNegativeTest-322550032-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33c439c-ba39-4eee-aeed-ba04aa7d331f tempest-SharesNegativeTest-322550032 tempest-SharesNegativeTest-322550032-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05f14fa-9f52-4514-b1df-c56619ec9b11 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05f14fa-9f52-4514-b1df-c56619ec9b11 None admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05f14fa-9f52-4514-b1df-c56619ec9b11 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05f14fa-9f52-4514-b1df-c56619ec9b11 None admin] PATH_INFO: `/v3/users/c8a21d958df34c999582f2c925e1553b` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05f14fa-9f52-4514-b1df-c56619ec9b11 None admin] RBAC: Authorizing `identity:delete_user(user_id=c8a21d958df34c999582f2c925e1553b)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e27fe9-dde3-4d70-a20a-f81224e0aac7 tempest-SharesNegativeTest-322550032 tempest-SharesNegativeTest-322550032-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8979d27306d441e385a31f56e8668ee3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adcbdea5704e4efc898c24b2b0a492a5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e27fe9-dde3-4d70-a20a-f81224e0aac7 tempest-SharesNegativeTest-322550032 tempest-SharesNegativeTest-322550032-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e27fe9-dde3-4d70-a20a-f81224e0aac7 tempest-SharesNegativeTest-322550032 tempest-SharesNegativeTest-322550032-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05f14fa-9f52-4514-b1df-c56619ec9b11 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e27fe9-dde3-4d70-a20a-f81224e0aac7 tempest-SharesNegativeTest-322550032 tempest-SharesNegativeTest-322550032-project-admin] PATH_INFO: `/v3/users/eb30733c944e480eb147435ead450b9c` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e27fe9-dde3-4d70-a20a-f81224e0aac7 tempest-SharesNegativeTest-322550032 tempest-SharesNegativeTest-322550032-project-admin] RBAC: Authorizing `identity:delete_user(user_id=eb30733c944e480eb147435ead450b9c)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e27fe9-dde3-4d70-a20a-f81224e0aac7 tempest-SharesNegativeTest-322550032 tempest-SharesNegativeTest-322550032-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-d1e27fe9-dde3-4d70-a20a-f81224e0aac7 tempest-SharesNegativeTest-322550032 tempest-SharesNegativeTest-322550032-project-admin] Could not find user: eb30733c944e480eb147435ead450b9c.: keystone.exception.UserNotFound: Could not find user: eb30733c944e480eb147435ead450b9c. May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: eb30733c944e480eb147435ead450b9c. May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1708/3446] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:02:34 2024] DELETE /identity/v3/users/eb30733c944e480eb147435ead450b9c => generated 110 bytes in 22 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e27fe9-dde3-4d70-a20a-f81224e0aac7 tempest-SharesNegativeTest-322550032 tempest-SharesNegativeTest-322550032-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e27fe9-dde3-4d70-a20a-f81224e0aac7 tempest-SharesNegativeTest-322550032 tempest-SharesNegativeTest-322550032-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff10025-9e10-418f-a53d-769ce0db96fa tempest-SharesNegativeTest-322550032 tempest-SharesNegativeTest-322550032-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8979d27306d441e385a31f56e8668ee3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adcbdea5704e4efc898c24b2b0a492a5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff10025-9e10-418f-a53d-769ce0db96fa tempest-SharesNegativeTest-322550032 tempest-SharesNegativeTest-322550032-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff10025-9e10-418f-a53d-769ce0db96fa tempest-SharesNegativeTest-322550032 tempest-SharesNegativeTest-322550032-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff10025-9e10-418f-a53d-769ce0db96fa tempest-SharesNegativeTest-322550032 tempest-SharesNegativeTest-322550032-project-admin] PATH_INFO: `/v3/users/56ab342d938748f096b808a9b567c8a6` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff10025-9e10-418f-a53d-769ce0db96fa tempest-SharesNegativeTest-322550032 tempest-SharesNegativeTest-322550032-project-admin] RBAC: Authorizing `identity:delete_user(user_id=56ab342d938748f096b808a9b567c8a6)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff10025-9e10-418f-a53d-769ce0db96fa tempest-SharesNegativeTest-322550032 tempest-SharesNegativeTest-322550032-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-bff10025-9e10-418f-a53d-769ce0db96fa tempest-SharesNegativeTest-322550032 tempest-SharesNegativeTest-322550032-project-admin] Could not find user: 56ab342d938748f096b808a9b567c8a6.: keystone.exception.UserNotFound: Could not find user: 56ab342d938748f096b808a9b567c8a6. May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 56ab342d938748f096b808a9b567c8a6. May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1709/3447] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:02:34 2024] DELETE /identity/v3/users/56ab342d938748f096b808a9b567c8a6 => generated 110 bytes in 26 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:02:34 l75lg1-v1 dstat.sh[49771]: 28-05 13:02:34| 14 2 77 6 0|5644M 1778M 278M 7923M| 14k 7113B| 0 8868k| 0 751 | 10k 19k|1.03 1.13 1.06|3.0 1.0 0| 0 0 | 0 2048M| 29 365 0 37 2 May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-f05f14fa-9f52-4514-b1df-c56619ec9b11 None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8a21d958df34c999582f2c925e1553b', 'request_id': 'req-f05f14fa-9f52-4514-b1df-c56619ec9b11'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff10025-9e10-418f-a53d-769ce0db96fa tempest-SharesNegativeTest-322550032 tempest-SharesNegativeTest-322550032-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff10025-9e10-418f-a53d-769ce0db96fa tempest-SharesNegativeTest-322550032 tempest-SharesNegativeTest-322550032-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-f05f14fa-9f52-4514-b1df-c56619ec9b11 None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8a21d958df34c999582f2c925e1553b', 'request_id': 'req-f05f14fa-9f52-4514-b1df-c56619ec9b11'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-f05f14fa-9f52-4514-b1df-c56619ec9b11 None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8a21d958df34c999582f2c925e1553b', 'request_id': 'req-f05f14fa-9f52-4514-b1df-c56619ec9b11'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-f05f14fa-9f52-4514-b1df-c56619ec9b11 None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8a21d958df34c999582f2c925e1553b', 'request_id': 'req-f05f14fa-9f52-4514-b1df-c56619ec9b11'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-f05f14fa-9f52-4514-b1df-c56619ec9b11 None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8a21d958df34c999582f2c925e1553b', 'request_id': 'req-f05f14fa-9f52-4514-b1df-c56619ec9b11'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1739/3448] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 13:02:34 2024] DELETE /identity/v3/users/c8a21d958df34c999582f2c925e1553b => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05f14fa-9f52-4514-b1df-c56619ec9b11 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-f05f14fa-9f52-4514-b1df-c56619ec9b11 None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b327264-837e-484b-b58d-8306f827970e tempest-SharesNegativeTest-322550032 tempest-SharesNegativeTest-322550032-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8979d27306d441e385a31f56e8668ee3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adcbdea5704e4efc898c24b2b0a492a5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b327264-837e-484b-b58d-8306f827970e tempest-SharesNegativeTest-322550032 tempest-SharesNegativeTest-322550032-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b327264-837e-484b-b58d-8306f827970e tempest-SharesNegativeTest-322550032 tempest-SharesNegativeTest-322550032-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b327264-837e-484b-b58d-8306f827970e tempest-SharesNegativeTest-322550032 tempest-SharesNegativeTest-322550032-project-admin] PATH_INFO: `/v3/users/38cff7899375474db18ec516c437d291` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b327264-837e-484b-b58d-8306f827970e tempest-SharesNegativeTest-322550032 tempest-SharesNegativeTest-322550032-project-admin] RBAC: Authorizing `identity:delete_user(user_id=38cff7899375474db18ec516c437d291)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b327264-837e-484b-b58d-8306f827970e tempest-SharesNegativeTest-322550032 tempest-SharesNegativeTest-322550032-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05f14fa-9f52-4514-b1df-c56619ec9b11 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0cca35-3df4-48ef-87ac-f4ac0a4a8523 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0cca35-3df4-48ef-87ac-f4ac0a4a8523 None admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0cca35-3df4-48ef-87ac-f4ac0a4a8523 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0cca35-3df4-48ef-87ac-f4ac0a4a8523 None admin] PATH_INFO: `/v3/users/3c09fdf36d9042198c4ec86ecc0be134` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0cca35-3df4-48ef-87ac-f4ac0a4a8523 None admin] RBAC: Authorizing `identity:delete_user(user_id=3c09fdf36d9042198c4ec86ecc0be134)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0cca35-3df4-48ef-87ac-f4ac0a4a8523 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-3b327264-837e-484b-b58d-8306f827970e tempest-SharesNegativeTest-322550032 tempest-SharesNegativeTest-322550032-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38cff7899375474db18ec516c437d291', 'request_id': 'req-3b327264-837e-484b-b58d-8306f827970e'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-3b327264-837e-484b-b58d-8306f827970e tempest-SharesNegativeTest-322550032 tempest-SharesNegativeTest-322550032-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38cff7899375474db18ec516c437d291', 'request_id': 'req-3b327264-837e-484b-b58d-8306f827970e'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-3b327264-837e-484b-b58d-8306f827970e tempest-SharesNegativeTest-322550032 tempest-SharesNegativeTest-322550032-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38cff7899375474db18ec516c437d291', 'request_id': 'req-3b327264-837e-484b-b58d-8306f827970e'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-3b327264-837e-484b-b58d-8306f827970e tempest-SharesNegativeTest-322550032 tempest-SharesNegativeTest-322550032-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38cff7899375474db18ec516c437d291', 'request_id': 'req-3b327264-837e-484b-b58d-8306f827970e'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-3b327264-837e-484b-b58d-8306f827970e tempest-SharesNegativeTest-322550032 tempest-SharesNegativeTest-322550032-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38cff7899375474db18ec516c437d291', 'request_id': 'req-3b327264-837e-484b-b58d-8306f827970e'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1710/3449] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:02:34 2024] DELETE /identity/v3/users/38cff7899375474db18ec516c437d291 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-ba0cca35-3df4-48ef-87ac-f4ac0a4a8523 None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c09fdf36d9042198c4ec86ecc0be134', 'request_id': 'req-ba0cca35-3df4-48ef-87ac-f4ac0a4a8523'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:34 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-3b60b747-732c-4529-8570-712815d79201 tempest-SharesNegativeTest-1014773059 tempest-SharesNegativeTest-1014773059-project-member] DELETE http://10.27.203.238/share/v2/d1d71dc9f23c4c6a8e146d99ad65ebb2/snapshots/79b46976-8aab-4859-b7c0-b71cf76c2cc2 May 28 13:02:34 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-3b60b747-732c-4529-8570-712815d79201 tempest-SharesNegativeTest-1014773059 tempest-SharesNegativeTest-1014773059-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:02:34 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-3b60b747-732c-4529-8570-712815d79201 tempest-SharesNegativeTest-1014773059 tempest-SharesNegativeTest-1014773059-project-member] Calling method 'ShareSnapshotMixin.delete' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:02:34 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.v1.share_snapshots [None req-3b60b747-732c-4529-8570-712815d79201 tempest-SharesNegativeTest-1014773059 tempest-SharesNegativeTest-1014773059-project-member] Delete snapshot with id: 79b46976-8aab-4859-b7c0-b71cf76c2cc2 May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-ba0cca35-3df4-48ef-87ac-f4ac0a4a8523 None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c09fdf36d9042198c4ec86ecc0be134', 'request_id': 'req-ba0cca35-3df4-48ef-87ac-f4ac0a4a8523'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-ba0cca35-3df4-48ef-87ac-f4ac0a4a8523 None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c09fdf36d9042198c4ec86ecc0be134', 'request_id': 'req-ba0cca35-3df4-48ef-87ac-f4ac0a4a8523'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-ba0cca35-3df4-48ef-87ac-f4ac0a4a8523 None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c09fdf36d9042198c4ec86ecc0be134', 'request_id': 'req-ba0cca35-3df4-48ef-87ac-f4ac0a4a8523'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-ba0cca35-3df4-48ef-87ac-f4ac0a4a8523 None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c09fdf36d9042198c4ec86ecc0be134', 'request_id': 'req-ba0cca35-3df4-48ef-87ac-f4ac0a4a8523'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1740/3450] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 13:02:34 2024] DELETE /identity/v3/users/3c09fdf36d9042198c4ec86ecc0be134 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b327264-837e-484b-b58d-8306f827970e tempest-SharesNegativeTest-322550032 tempest-SharesNegativeTest-322550032-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-3b327264-837e-484b-b58d-8306f827970e tempest-SharesNegativeTest-322550032 tempest-SharesNegativeTest-322550032-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b327264-837e-484b-b58d-8306f827970e tempest-SharesNegativeTest-322550032 tempest-SharesNegativeTest-322550032-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:34 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-f447d80c-d457-4b61-8127-d3c6677069e4 tempest-ShareSnapshotMetadataNegativeTest-1199544441 tempest-ShareSnapshotMetadataNegativeTest-1199544441-project-member] GET http://10.27.203.238/share/v2/b00df7df3db14cce99343fc7f6ffd796/shares/1f5b6f0f-f341-4964-a2fa-9c4a26198f95 May 28 13:02:34 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-f447d80c-d457-4b61-8127-d3c6677069e4 tempest-ShareSnapshotMetadataNegativeTest-1199544441 tempest-ShareSnapshotMetadataNegativeTest-1199544441-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:02:34 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-f447d80c-d457-4b61-8127-d3c6677069e4 tempest-ShareSnapshotMetadataNegativeTest-1199544441 tempest-ShareSnapshotMetadataNegativeTest-1199544441-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:02:34 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-f447d80c-d457-4b61-8127-d3c6677069e4 tempest-ShareSnapshotMetadataNegativeTest-1199544441 tempest-ShareSnapshotMetadataNegativeTest-1199544441-project-member] HTTP exception thrown: The resource could not be found. May 28 13:02:34 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-f447d80c-d457-4b61-8127-d3c6677069e4 tempest-ShareSnapshotMetadataNegativeTest-1199544441 tempest-ShareSnapshotMetadataNegativeTest-1199544441-project-member] http://10.27.203.238/share/v2/b00df7df3db14cce99343fc7f6ffd796/shares/1f5b6f0f-f341-4964-a2fa-9c4a26198f95 returned with HTTP 404 May 28 13:02:34 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1240/2501] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:02:34 2024] GET /share/v2/b00df7df3db14cce99343fc7f6ffd796/shares/1f5b6f0f-f341-4964-a2fa-9c4a26198f95 => generated 78 bytes in 13 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812ef2fa-7c9e-4bdb-90da-7d2d9723e366 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812ef2fa-7c9e-4bdb-90da-7d2d9723e366 None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812ef2fa-7c9e-4bdb-90da-7d2d9723e366 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812ef2fa-7c9e-4bdb-90da-7d2d9723e366 None admin] PATH_INFO: `/v3/users/2bc97f1360f84c76a04d2e216cf7488c` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812ef2fa-7c9e-4bdb-90da-7d2d9723e366 None admin] RBAC: Authorizing `identity:delete_user(user_id=2bc97f1360f84c76a04d2e216cf7488c)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812ef2fa-7c9e-4bdb-90da-7d2d9723e366 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:34 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-ac9a9875-5e2d-42ca-a40c-5320ae33940e tempest-ShareSnapshotMetadataNegativeTest-1690283503 tempest-ShareSnapshotMetadataNegativeTest-1690283503-project-admin] DELETE http://10.27.203.238/share/v2/fb57334a24554a788ef7508e78b0d664/types/7108e75e-c350-4f09-a603-af820cfc30f1 May 28 13:02:34 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-ac9a9875-5e2d-42ca-a40c-5320ae33940e tempest-ShareSnapshotMetadataNegativeTest-1690283503 tempest-ShareSnapshotMetadataNegativeTest-1690283503-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:02:34 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-ac9a9875-5e2d-42ca-a40c-5320ae33940e tempest-ShareSnapshotMetadataNegativeTest-1690283503 tempest-ShareSnapshotMetadataNegativeTest-1690283503-project-admin] Calling method 'ShareTypesController._delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:02:34 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-3b60b747-732c-4529-8570-712815d79201 tempest-SharesNegativeTest-1014773059 tempest-SharesNegativeTest-1014773059-project-member] http://10.27.203.238/share/v2/d1d71dc9f23c4c6a8e146d99ad65ebb2/snapshots/79b46976-8aab-4859-b7c0-b71cf76c2cc2 returned with HTTP 202 May 28 13:02:34 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1262/2502] 10.27.203.238 () {64 vars in 1463 bytes} [Tue May 28 13:02:34 2024] DELETE /share/v2/d1d71dc9f23c4c6a8e146d99ad65ebb2/snapshots/79b46976-8aab-4859-b7c0-b71cf76c2cc2 => generated 0 bytes in 103 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 13:02:34 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-ab6d4fb2-65f7-463b-8c17-f9f8d01e201c tempest-SharesNegativeTest-1014773059 tempest-SharesNegativeTest-1014773059-project-member] GET http://10.27.203.238/share/v2/d1d71dc9f23c4c6a8e146d99ad65ebb2/snapshots/79b46976-8aab-4859-b7c0-b71cf76c2cc2 May 28 13:02:34 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-ab6d4fb2-65f7-463b-8c17-f9f8d01e201c tempest-SharesNegativeTest-1014773059 tempest-SharesNegativeTest-1014773059-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:02:34 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-ab6d4fb2-65f7-463b-8c17-f9f8d01e201c tempest-SharesNegativeTest-1014773059 tempest-SharesNegativeTest-1014773059-project-member] Calling method 'ShareSnapshotMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:02:34 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-ab6d4fb2-65f7-463b-8c17-f9f8d01e201c tempest-SharesNegativeTest-1014773059 tempest-SharesNegativeTest-1014773059-project-member] http://10.27.203.238/share/v2/d1d71dc9f23c4c6a8e146d99ad65ebb2/snapshots/79b46976-8aab-4859-b7c0-b71cf76c2cc2 returned with HTTP 200 May 28 13:02:34 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1263/2503] 10.27.203.238 () {64 vars in 1460 bytes} [Tue May 28 13:02:34 2024] GET /share/v2/d1d71dc9f23c4c6a8e146d99ad65ebb2/snapshots/79b46976-8aab-4859-b7c0-b71cf76c2cc2 => generated 723 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:02:34 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-ac9a9875-5e2d-42ca-a40c-5320ae33940e tempest-ShareSnapshotMetadataNegativeTest-1690283503 tempest-ShareSnapshotMetadataNegativeTest-1690283503-project-admin] http://10.27.203.238/share/v2/fb57334a24554a788ef7508e78b0d664/types/7108e75e-c350-4f09-a603-af820cfc30f1 returned with HTTP 202 May 28 13:02:34 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1241/2504] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:02:34 2024] DELETE /share/v2/fb57334a24554a788ef7508e78b0d664/types/7108e75e-c350-4f09-a603-af820cfc30f1 => generated 0 bytes in 68 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-812ef2fa-7c9e-4bdb-90da-7d2d9723e366 None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2bc97f1360f84c76a04d2e216cf7488c', 'request_id': 'req-812ef2fa-7c9e-4bdb-90da-7d2d9723e366'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-812ef2fa-7c9e-4bdb-90da-7d2d9723e366 None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2bc97f1360f84c76a04d2e216cf7488c', 'request_id': 'req-812ef2fa-7c9e-4bdb-90da-7d2d9723e366'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:34 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-64a273d6-7cff-40f8-be29-ac993dbd5785 tempest-ShareSnapshotMetadataNegativeTest-1690283503 tempest-ShareSnapshotMetadataNegativeTest-1690283503-project-admin] GET http://10.27.203.238/share/v2/fb57334a24554a788ef7508e78b0d664/types/7108e75e-c350-4f09-a603-af820cfc30f1 May 28 13:02:34 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-64a273d6-7cff-40f8-be29-ac993dbd5785 tempest-ShareSnapshotMetadataNegativeTest-1690283503 tempest-ShareSnapshotMetadataNegativeTest-1690283503-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:02:34 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-64a273d6-7cff-40f8-be29-ac993dbd5785 tempest-ShareSnapshotMetadataNegativeTest-1690283503 tempest-ShareSnapshotMetadataNegativeTest-1690283503-project-admin] Calling method 'ShareTypesController.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-812ef2fa-7c9e-4bdb-90da-7d2d9723e366 None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2bc97f1360f84c76a04d2e216cf7488c', 'request_id': 'req-812ef2fa-7c9e-4bdb-90da-7d2d9723e366'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:34 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-64a273d6-7cff-40f8-be29-ac993dbd5785 tempest-ShareSnapshotMetadataNegativeTest-1690283503 tempest-ShareSnapshotMetadataNegativeTest-1690283503-project-admin] HTTP exception thrown: Share type not found. May 28 13:02:34 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-64a273d6-7cff-40f8-be29-ac993dbd5785 tempest-ShareSnapshotMetadataNegativeTest-1690283503 tempest-ShareSnapshotMetadataNegativeTest-1690283503-project-admin] http://10.27.203.238/share/v2/fb57334a24554a788ef7508e78b0d664/types/7108e75e-c350-4f09-a603-af820cfc30f1 returned with HTTP 404 May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-812ef2fa-7c9e-4bdb-90da-7d2d9723e366 None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2bc97f1360f84c76a04d2e216cf7488c', 'request_id': 'req-812ef2fa-7c9e-4bdb-90da-7d2d9723e366'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:34 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1264/2505] 10.27.203.238 () {64 vars in 1448 bytes} [Tue May 28 13:02:34 2024] GET /share/v2/fb57334a24554a788ef7508e78b0d664/types/7108e75e-c350-4f09-a603-af820cfc30f1 => generated 67 bytes in 11 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-812ef2fa-7c9e-4bdb-90da-7d2d9723e366 None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2bc97f1360f84c76a04d2e216cf7488c', 'request_id': 'req-812ef2fa-7c9e-4bdb-90da-7d2d9723e366'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0cca35-3df4-48ef-87ac-f4ac0a4a8523 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:34 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-3b60b747-732c-4529-8570-712815d79201 tempest-SharesNegativeTest-1014773059 None] >>> [GET] https://127.0.0.1:40443/api/snapshots/ May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-ba0cca35-3df4-48ef-87ac-f4ac0a4a8523 None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:02:34 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-3b60b747-732c-4529-8570-712815d79201 tempest-SharesNegativeTest-1014773059 None] {'allow_redirects': True, May 28 13:02:34 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-3b60b747-732c-4529-8570-712815d79201 tempest-SharesNegativeTest-1014773059 None] 'params': {'name': 'share-snapshot-9552655b-8df3-477b-913a-f9d1bef42b62'}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0cca35-3df4-48ef-87ac-f4ac0a4a8523 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1711/3451] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 13:02:34 2024] DELETE /identity/v3/users/2bc97f1360f84c76a04d2e216cf7488c => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c61938-0164-4680-88b7-3252d512d7e4 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c61938-0164-4680-88b7-3252d512d7e4 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c61938-0164-4680-88b7-3252d512d7e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-a5c61938-0164-4680-88b7-3252d512d7e4 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-a5c61938-0164-4680-88b7-3252d512d7e4 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-a5c61938-0164-4680-88b7-3252d512d7e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c593f691-dbeb-424d-a76f-7b2d10f19c4b None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c593f691-dbeb-424d-a76f-7b2d10f19c4b None admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c593f691-dbeb-424d-a76f-7b2d10f19c4b None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c593f691-dbeb-424d-a76f-7b2d10f19c4b None admin] PATH_INFO: `/v3/users/fe150a2857cc4ed1a4b19bc996c70bff` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c593f691-dbeb-424d-a76f-7b2d10f19c4b None admin] RBAC: Authorizing `identity:delete_user(user_id=fe150a2857cc4ed1a4b19bc996c70bff)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c593f691-dbeb-424d-a76f-7b2d10f19c4b None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1712/3452] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 13:02:34 2024] POST /identity/v3/auth/tokens => generated 2960 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 13:02:34 l75lg1-v1 neutron-server[77618]: DEBUG neutron.wsgi [-] (77618) accepted ('10.27.203.238', 46474) {{(pid=77618) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c61938-0164-4680-88b7-3252d512d7e4 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-a5c61938-0164-4680-88b7-3252d512d7e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-c593f691-dbeb-424d-a76f-7b2d10f19c4b None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe150a2857cc4ed1a4b19bc996c70bff', 'request_id': 'req-c593f691-dbeb-424d-a76f-7b2d10f19c4b'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-c593f691-dbeb-424d-a76f-7b2d10f19c4b None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe150a2857cc4ed1a4b19bc996c70bff', 'request_id': 'req-c593f691-dbeb-424d-a76f-7b2d10f19c4b'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-c593f691-dbeb-424d-a76f-7b2d10f19c4b None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe150a2857cc4ed1a4b19bc996c70bff', 'request_id': 'req-c593f691-dbeb-424d-a76f-7b2d10f19c4b'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-c593f691-dbeb-424d-a76f-7b2d10f19c4b None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe150a2857cc4ed1a4b19bc996c70bff', 'request_id': 'req-c593f691-dbeb-424d-a76f-7b2d10f19c4b'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c61938-0164-4680-88b7-3252d512d7e4 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-c593f691-dbeb-424d-a76f-7b2d10f19c4b None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe150a2857cc4ed1a4b19bc996c70bff', 'request_id': 'req-c593f691-dbeb-424d-a76f-7b2d10f19c4b'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1741/3453] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 13:02:34 2024] DELETE /identity/v3/users/fe150a2857cc4ed1a4b19bc996c70bff => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c593f691-dbeb-424d-a76f-7b2d10f19c4b None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-c593f691-dbeb-424d-a76f-7b2d10f19c4b None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1545b09-8118-45a9-821b-85132a580e2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef17047035e4b518fd5360a01f2da1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1545b09-8118-45a9-821b-85132a580e2f service neutron] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1545b09-8118-45a9-821b-85132a580e2f service neutron] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1545b09-8118-45a9-821b-85132a580e2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-b1545b09-8118-45a9-821b-85132a580e2f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c593f691-dbeb-424d-a76f-7b2d10f19c4b None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7ed50a-4bdb-4b9d-afc4-613c0cb169cd None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7ed50a-4bdb-4b9d-afc4-613c0cb169cd None admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7ed50a-4bdb-4b9d-afc4-613c0cb169cd None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7ed50a-4bdb-4b9d-afc4-613c0cb169cd None admin] PATH_INFO: `/v3/users/d665b4918b364dfc8ed49e35b7728d62` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7ed50a-4bdb-4b9d-afc4-613c0cb169cd None admin] RBAC: Authorizing `identity:delete_user(user_id=d665b4918b364dfc8ed49e35b7728d62)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7ed50a-4bdb-4b9d-afc4-613c0cb169cd None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1545b09-8118-45a9-821b-85132a580e2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1545b09-8118-45a9-821b-85132a580e2f service neutron] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1713/3454] 10.27.203.238 () {64 vars in 1432 bytes} [Tue May 28 13:02:34 2024] GET /identity/v3/auth/tokens => generated 2960 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 28 13:02:34 l75lg1-v1 neutron-server[77618]: INFO neutron.wsgi [None req-3d5a04e3-7443-48fe-9ecc-8b6c952eae7d None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=f14455b44db646599c72bb78e8be787f&name=default HTTP/1.1" status: 200 len: 216 time: 0.1331136 May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1545b09-8118-45a9-821b-85132a580e2f service neutron] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-b1545b09-8118-45a9-821b-85132a580e2f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-ba7ed50a-4bdb-4b9d-afc4-613c0cb169cd None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd665b4918b364dfc8ed49e35b7728d62', 'request_id': 'req-ba7ed50a-4bdb-4b9d-afc4-613c0cb169cd'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1545b09-8118-45a9-821b-85132a580e2f service neutron] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-ba7ed50a-4bdb-4b9d-afc4-613c0cb169cd None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd665b4918b364dfc8ed49e35b7728d62', 'request_id': 'req-ba7ed50a-4bdb-4b9d-afc4-613c0cb169cd'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-ba7ed50a-4bdb-4b9d-afc4-613c0cb169cd None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd665b4918b364dfc8ed49e35b7728d62', 'request_id': 'req-ba7ed50a-4bdb-4b9d-afc4-613c0cb169cd'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-ba7ed50a-4bdb-4b9d-afc4-613c0cb169cd None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd665b4918b364dfc8ed49e35b7728d62', 'request_id': 'req-ba7ed50a-4bdb-4b9d-afc4-613c0cb169cd'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-ba7ed50a-4bdb-4b9d-afc4-613c0cb169cd None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd665b4918b364dfc8ed49e35b7728d62', 'request_id': 'req-ba7ed50a-4bdb-4b9d-afc4-613c0cb169cd'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01870f72-1d1c-4b8e-be92-a957c87280ce None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01870f72-1d1c-4b8e-be92-a957c87280ce None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01870f72-1d1c-4b8e-be92-a957c87280ce None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01870f72-1d1c-4b8e-be92-a957c87280ce None admin] PATH_INFO: `/v3/projects/f14455b44db646599c72bb78e8be787f` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01870f72-1d1c-4b8e-be92-a957c87280ce None admin] RBAC: Authorizing `identity:delete_project(project_id=f14455b44db646599c72bb78e8be787f)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01870f72-1d1c-4b8e-be92-a957c87280ce None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1742/3455] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 13:02:34 2024] DELETE /identity/v3/users/d665b4918b364dfc8ed49e35b7728d62 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7ed50a-4bdb-4b9d-afc4-613c0cb169cd None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-ba7ed50a-4bdb-4b9d-afc4-613c0cb169cd None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7ed50a-4bdb-4b9d-afc4-613c0cb169cd None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-01870f72-1d1c-4b8e-be92-a957c87280ce None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f14455b44db646599c72bb78e8be787f', 'request_id': 'req-01870f72-1d1c-4b8e-be92-a957c87280ce'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-01870f72-1d1c-4b8e-be92-a957c87280ce None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f14455b44db646599c72bb78e8be787f', 'request_id': 'req-01870f72-1d1c-4b8e-be92-a957c87280ce'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-01870f72-1d1c-4b8e-be92-a957c87280ce None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f14455b44db646599c72bb78e8be787f', 'request_id': 'req-01870f72-1d1c-4b8e-be92-a957c87280ce'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cad5719-11be-412a-891f-49796331cfbe None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cad5719-11be-412a-891f-49796331cfbe None admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cad5719-11be-412a-891f-49796331cfbe None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cad5719-11be-412a-891f-49796331cfbe None admin] PATH_INFO: `/v3/users/376994db8e664651b0e2019c32e48f36` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cad5719-11be-412a-891f-49796331cfbe None admin] RBAC: Authorizing `identity:delete_user(user_id=376994db8e664651b0e2019c32e48f36)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cad5719-11be-412a-891f-49796331cfbe None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-01870f72-1d1c-4b8e-be92-a957c87280ce None admin] The token cache is being invalidate because project f14455b44db646599c72bb78e8be787f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-01870f72-1d1c-4b8e-be92-a957c87280ce None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-01870f72-1d1c-4b8e-be92-a957c87280ce None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1714/3456] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 13:02:34 2024] DELETE /identity/v3/projects/f14455b44db646599c72bb78e8be787f => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:02:34 l75lg1-v1 neutron-server[77619]: DEBUG neutron.wsgi [-] (77619) accepted ('10.27.203.238', 46490) {{(pid=77619) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 13:02:34 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-3b60b747-732c-4529-8570-712815d79201 tempest-SharesNegativeTest-1014773059 None] <<< [GET] https://127.0.0.1:40443/api/snapshots/ May 28 13:02:34 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-3b60b747-732c-4529-8570-712815d79201 tempest-SharesNegativeTest-1014773059 None] [Bunch(access_path='/.vast_all_snapshots/1000000016_share-snapshot-9552655b-8df3-477b-913a-f9d1bef42b62', aggr_phys_estimation=0, cluster='loop75-kfs', created='2024-05-28T13:02:28.356145Z', eta_sec=30819898643.124107, expiration_time='3001-01-19T07:59:58Z', guid='36a0a02f-9da1-411a-a4d9-f680af4d4a99', id=17, indestructible=False, locked=False, name='share-snapshot-9552655b-8df3-477b-913a-f9d1bef42b62', path='/manila/manila-27c3f247-5cdb-4bb3-9479-7b3253f9df42/', policy=None, policy_id=None, protection_policy_id=None, state='SUCCEED', tenant_id=1, tenant_name='default', title='share-snapshot-9552655b-8df3-477b-913a-f9d1bef42b62(/manila/manila-27c3f247-5cdb-4bb3-9479-7b3253f9df42/)', type='local', unique_phys_estimation=0, url='https://127.0.0.1:40443/api/snapshots/17/')] May 28 13:02:34 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-3b60b747-732c-4529-8570-712815d79201 tempest-SharesNegativeTest-1014773059 None] --- [GET] https://127.0.0.1:40443/api/snapshots/: Done May 28 13:02:34 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-3b60b747-732c-4529-8570-712815d79201 tempest-SharesNegativeTest-1014773059 None] >>> [DELETE] https://127.0.0.1:40443/api/snapshots/17/ May 28 13:02:34 l75lg1-v1 neutron-server[77619]: INFO neutron.wsgi [None req-41f9ba45-5b3c-4e8e-8ab5-ed1ad7e65bbe None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=bb9d3f847ef244849afe15c9d1149867&name=default HTTP/1.1" status: 200 len: 216 time: 0.0096231 May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01870f72-1d1c-4b8e-be92-a957c87280ce None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-01870f72-1d1c-4b8e-be92-a957c87280ce None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01870f72-1d1c-4b8e-be92-a957c87280ce None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab6bd3c-4161-4d72-92cd-7a1f54357f87 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab6bd3c-4161-4d72-92cd-7a1f54357f87 None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab6bd3c-4161-4d72-92cd-7a1f54357f87 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab6bd3c-4161-4d72-92cd-7a1f54357f87 None admin] PATH_INFO: `/v3/projects/bb9d3f847ef244849afe15c9d1149867` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab6bd3c-4161-4d72-92cd-7a1f54357f87 None admin] RBAC: Authorizing `identity:delete_project(project_id=bb9d3f847ef244849afe15c9d1149867)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab6bd3c-4161-4d72-92cd-7a1f54357f87 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-7cad5719-11be-412a-891f-49796331cfbe None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '376994db8e664651b0e2019c32e48f36', 'request_id': 'req-7cad5719-11be-412a-891f-49796331cfbe'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-7cad5719-11be-412a-891f-49796331cfbe None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '376994db8e664651b0e2019c32e48f36', 'request_id': 'req-7cad5719-11be-412a-891f-49796331cfbe'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-7cad5719-11be-412a-891f-49796331cfbe None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '376994db8e664651b0e2019c32e48f36', 'request_id': 'req-7cad5719-11be-412a-891f-49796331cfbe'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-7cad5719-11be-412a-891f-49796331cfbe None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '376994db8e664651b0e2019c32e48f36', 'request_id': 'req-7cad5719-11be-412a-891f-49796331cfbe'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-7cad5719-11be-412a-891f-49796331cfbe None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '376994db8e664651b0e2019c32e48f36', 'request_id': 'req-7cad5719-11be-412a-891f-49796331cfbe'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-3ab6bd3c-4161-4d72-92cd-7a1f54357f87 None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb9d3f847ef244849afe15c9d1149867', 'request_id': 'req-3ab6bd3c-4161-4d72-92cd-7a1f54357f87'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-3ab6bd3c-4161-4d72-92cd-7a1f54357f87 None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb9d3f847ef244849afe15c9d1149867', 'request_id': 'req-3ab6bd3c-4161-4d72-92cd-7a1f54357f87'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1743/3457] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 13:02:34 2024] DELETE /identity/v3/users/376994db8e664651b0e2019c32e48f36 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275fef1f-b06c-4ff8-b3cf-ba7b6449025b None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275fef1f-b06c-4ff8-b3cf-ba7b6449025b None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275fef1f-b06c-4ff8-b3cf-ba7b6449025b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-275fef1f-b06c-4ff8-b3cf-ba7b6449025b None None] Truncating password to algorithm specific maximum length 72 characters. May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-275fef1f-b06c-4ff8-b3cf-ba7b6449025b None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-275fef1f-b06c-4ff8-b3cf-ba7b6449025b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-3ab6bd3c-4161-4d72-92cd-7a1f54357f87 None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb9d3f847ef244849afe15c9d1149867', 'request_id': 'req-3ab6bd3c-4161-4d72-92cd-7a1f54357f87'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-3ab6bd3c-4161-4d72-92cd-7a1f54357f87 None admin] The token cache is being invalidate because project bb9d3f847ef244849afe15c9d1149867 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-3ab6bd3c-4161-4d72-92cd-7a1f54357f87 None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-3ab6bd3c-4161-4d72-92cd-7a1f54357f87 None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1715/3458] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 13:02:34 2024] DELETE /identity/v3/projects/bb9d3f847ef244849afe15c9d1149867 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:02:34 l75lg1-v1 neutron-server[77619]: DEBUG neutron.wsgi [-] (77619) accepted ('10.27.203.238', 46498) {{(pid=77619) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 13:02:34 l75lg1-v1 neutron-server[77619]: INFO neutron.wsgi [None req-b7ea4765-c419-47ec-9e5e-101377aaa23d None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=73ff30a3b10d4ca099fc7022b36d49d9&name=default HTTP/1.1" status: 200 len: 216 time: 0.0087976 May 28 13:02:34 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab6bd3c-4161-4d72-92cd-7a1f54357f87 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1744/3459] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 13:02:34 2024] POST /identity/v3/auth/tokens => generated 2960 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-3ab6bd3c-4161-4d72-92cd-7a1f54357f87 None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:02:35 l75lg1-v1 neutron-server[77619]: DEBUG neutron.wsgi [-] (77619) accepted ('10.27.203.238', 46512) {{(pid=77619) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275fef1f-b06c-4ff8-b3cf-ba7b6449025b None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-275fef1f-b06c-4ff8-b3cf-ba7b6449025b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab6bd3c-4161-4d72-92cd-7a1f54357f87 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42f7e9f-4511-4132-ba36-24a56ee039d4 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42f7e9f-4511-4132-ba36-24a56ee039d4 None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42f7e9f-4511-4132-ba36-24a56ee039d4 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42f7e9f-4511-4132-ba36-24a56ee039d4 None admin] PATH_INFO: `/v3/projects/73ff30a3b10d4ca099fc7022b36d49d9` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42f7e9f-4511-4132-ba36-24a56ee039d4 None admin] RBAC: Authorizing `identity:delete_project(project_id=73ff30a3b10d4ca099fc7022b36d49d9)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42f7e9f-4511-4132-ba36-24a56ee039d4 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275fef1f-b06c-4ff8-b3cf-ba7b6449025b None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccebab70-6c6b-494b-a067-264ff437ee1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef17047035e4b518fd5360a01f2da1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccebab70-6c6b-494b-a067-264ff437ee1a service neutron] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccebab70-6c6b-494b-a067-264ff437ee1a service neutron] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccebab70-6c6b-494b-a067-264ff437ee1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccebab70-6c6b-494b-a067-264ff437ee1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccebab70-6c6b-494b-a067-264ff437ee1a service neutron] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1745/3460] 10.27.203.238 () {64 vars in 1432 bytes} [Tue May 28 13:02:35 2024] GET /identity/v3/auth/tokens => generated 2960 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 28 13:02:35 l75lg1-v1 neutron-server[77619]: INFO neutron.wsgi [None req-12d29f97-c9b1-4e41-ae60-c019aed74d26 None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=b00df7df3db14cce99343fc7f6ffd796&name=default HTTP/1.1" status: 200 len: 216 time: 0.0762739 May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccebab70-6c6b-494b-a067-264ff437ee1a service neutron] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-ccebab70-6c6b-494b-a067-264ff437ee1a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-e42f7e9f-4511-4132-ba36-24a56ee039d4 None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73ff30a3b10d4ca099fc7022b36d49d9', 'request_id': 'req-e42f7e9f-4511-4132-ba36-24a56ee039d4'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-e42f7e9f-4511-4132-ba36-24a56ee039d4 None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73ff30a3b10d4ca099fc7022b36d49d9', 'request_id': 'req-e42f7e9f-4511-4132-ba36-24a56ee039d4'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccebab70-6c6b-494b-a067-264ff437ee1a service neutron] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-e42f7e9f-4511-4132-ba36-24a56ee039d4 None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73ff30a3b10d4ca099fc7022b36d49d9', 'request_id': 'req-e42f7e9f-4511-4132-ba36-24a56ee039d4'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-e42f7e9f-4511-4132-ba36-24a56ee039d4 None admin] The token cache is being invalidate because project 73ff30a3b10d4ca099fc7022b36d49d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-e42f7e9f-4511-4132-ba36-24a56ee039d4 None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-e42f7e9f-4511-4132-ba36-24a56ee039d4 None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1716/3461] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 13:02:34 2024] DELETE /identity/v3/projects/73ff30a3b10d4ca099fc7022b36d49d9 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c30de09-0dc3-42ca-afff-ef17d7c8f09d None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c30de09-0dc3-42ca-afff-ef17d7c8f09d None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c30de09-0dc3-42ca-afff-ef17d7c8f09d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76b2660-f18c-4703-9f57-e0e56f770959 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76b2660-f18c-4703-9f57-e0e56f770959 None admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76b2660-f18c-4703-9f57-e0e56f770959 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76b2660-f18c-4703-9f57-e0e56f770959 None admin] PATH_INFO: `/v3/projects/b00df7df3db14cce99343fc7f6ffd796` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76b2660-f18c-4703-9f57-e0e56f770959 None admin] RBAC: Authorizing `identity:delete_project(project_id=b00df7df3db14cce99343fc7f6ffd796)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76b2660-f18c-4703-9f57-e0e56f770959 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-8c30de09-0dc3-42ca-afff-ef17d7c8f09d None None] Truncating password to algorithm specific maximum length 72 characters. May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-8c30de09-0dc3-42ca-afff-ef17d7c8f09d None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-8c30de09-0dc3-42ca-afff-ef17d7c8f09d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1717/3462] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 13:02:35 2024] POST /identity/v3/auth/tokens => generated 312 bytes in 18 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26217274-3279-4667-9bb7-b5868dbc3a1c None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26217274-3279-4667-9bb7-b5868dbc3a1c None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26217274-3279-4667-9bb7-b5868dbc3a1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-26217274-3279-4667-9bb7-b5868dbc3a1c None None] Truncating password to algorithm specific maximum length 72 characters. May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-26217274-3279-4667-9bb7-b5868dbc3a1c None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-26217274-3279-4667-9bb7-b5868dbc3a1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1718/3463] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 13:02:35 2024] POST /identity/v3/auth/tokens => generated 2960 bytes in 20 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26217274-3279-4667-9bb7-b5868dbc3a1c None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26217274-3279-4667-9bb7-b5868dbc3a1c None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-d76b2660-f18c-4703-9f57-e0e56f770959 None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b00df7df3db14cce99343fc7f6ffd796', 'request_id': 'req-d76b2660-f18c-4703-9f57-e0e56f770959'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-d76b2660-f18c-4703-9f57-e0e56f770959 None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b00df7df3db14cce99343fc7f6ffd796', 'request_id': 'req-d76b2660-f18c-4703-9f57-e0e56f770959'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-d76b2660-f18c-4703-9f57-e0e56f770959 None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b00df7df3db14cce99343fc7f6ffd796', 'request_id': 'req-d76b2660-f18c-4703-9f57-e0e56f770959'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df85ffc-7830-4cec-bcbd-10593d433b75 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df85ffc-7830-4cec-bcbd-10593d433b75 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df85ffc-7830-4cec-bcbd-10593d433b75 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df85ffc-7830-4cec-bcbd-10593d433b75 None admin] PATH_INFO: `/v3/domains` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df85ffc-7830-4cec-bcbd-10593d433b75 None admin] RBAC: Adding query filter params (name=Default) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df85ffc-7830-4cec-bcbd-10593d433b75 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df85ffc-7830-4cec-bcbd-10593d433b75 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-d76b2660-f18c-4703-9f57-e0e56f770959 None admin] The token cache is being invalidate because project b00df7df3db14cce99343fc7f6ffd796 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-d76b2660-f18c-4703-9f57-e0e56f770959 None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-d76b2660-f18c-4703-9f57-e0e56f770959 None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1746/3464] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 13:02:35 2024] DELETE /identity/v3/projects/b00df7df3db14cce99343fc7f6ffd796 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 28 13:02:35 l75lg1-v1 neutron-server[77619]: DEBUG neutron.wsgi [-] (77619) accepted ('10.27.203.238', 46526) {{(pid=77619) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1719/3465] 10.27.203.238 () {62 vars in 1220 bytes} [Tue May 28 13:02:35 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76b2660-f18c-4703-9f57-e0e56f770959 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-d76b2660-f18c-4703-9f57-e0e56f770959 None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:02:35 l75lg1-v1 neutron-server[77619]: INFO neutron.wsgi [None req-201aee45-40af-4b26-80b3-cdcf640b1db8 None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=ded8bc00b1304a8e9cdbd5ef76eeaae8&name=default HTTP/1.1" status: 200 len: 216 time: 0.0087636 May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df85ffc-7830-4cec-bcbd-10593d433b75 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-6df85ffc-7830-4cec-bcbd-10593d433b75 None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76b2660-f18c-4703-9f57-e0e56f770959 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72907257-4993-430b-8c64-18431c6dcc76 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72907257-4993-430b-8c64-18431c6dcc76 None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72907257-4993-430b-8c64-18431c6dcc76 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72907257-4993-430b-8c64-18431c6dcc76 None admin] PATH_INFO: `/v3/projects` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72907257-4993-430b-8c64-18431c6dcc76 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72907257-4993-430b-8c64-18431c6dcc76 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df85ffc-7830-4cec-bcbd-10593d433b75 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103f9244-06c9-43c5-829f-fe4c3f13770b None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103f9244-06c9-43c5-829f-fe4c3f13770b None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103f9244-06c9-43c5-829f-fe4c3f13770b None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103f9244-06c9-43c5-829f-fe4c3f13770b None admin] PATH_INFO: `/v3/projects/ded8bc00b1304a8e9cdbd5ef76eeaae8` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103f9244-06c9-43c5-829f-fe4c3f13770b None admin] RBAC: Authorizing `identity:delete_project(project_id=ded8bc00b1304a8e9cdbd5ef76eeaae8)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103f9244-06c9-43c5-829f-fe4c3f13770b None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:35 l75lg1-v1 dstat.sh[49771]: 28-05 13:02:35| 18 3 75 4 0|5644M 1777M 278M 7924M| 17k 1404B| 0 3163k| 0 476 | 12k 22k|1.03 1.13 1.06|2.0 1.0 0| 0 0 | 0 2048M| 29 365 0 43 2 May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1747/3466] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 13:02:35 2024] POST /identity/v3/projects => generated 389 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72907257-4993-430b-8c64-18431c6dcc76 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-103f9244-06c9-43c5-829f-fe4c3f13770b None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ded8bc00b1304a8e9cdbd5ef76eeaae8', 'request_id': 'req-103f9244-06c9-43c5-829f-fe4c3f13770b'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-103f9244-06c9-43c5-829f-fe4c3f13770b None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ded8bc00b1304a8e9cdbd5ef76eeaae8', 'request_id': 'req-103f9244-06c9-43c5-829f-fe4c3f13770b'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72907257-4993-430b-8c64-18431c6dcc76 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-103f9244-06c9-43c5-829f-fe4c3f13770b None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ded8bc00b1304a8e9cdbd5ef76eeaae8', 'request_id': 'req-103f9244-06c9-43c5-829f-fe4c3f13770b'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fc93bf-247d-4a26-abe5-cf6aede06253 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fc93bf-247d-4a26-abe5-cf6aede06253 None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fc93bf-247d-4a26-abe5-cf6aede06253 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fc93bf-247d-4a26-abe5-cf6aede06253 None admin] PATH_INFO: `/v3/users` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fc93bf-247d-4a26-abe5-cf6aede06253 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fc93bf-247d-4a26-abe5-cf6aede06253 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-68fc93bf-247d-4a26-abe5-cf6aede06253 None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-103f9244-06c9-43c5-829f-fe4c3f13770b None admin] The token cache is being invalidate because project ded8bc00b1304a8e9cdbd5ef76eeaae8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-103f9244-06c9-43c5-829f-fe4c3f13770b None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-103f9244-06c9-43c5-829f-fe4c3f13770b None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1720/3467] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 13:02:35 2024] DELETE /identity/v3/projects/ded8bc00b1304a8e9cdbd5ef76eeaae8 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:02:35 l75lg1-v1 neutron-server[77619]: DEBUG neutron.wsgi [-] (77619) accepted ('10.27.203.238', 46540) {{(pid=77619) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 13:02:35 l75lg1-v1 neutron-server[77619]: INFO neutron.wsgi [None req-6e91323d-feb9-4a89-97b0-b3dd31a7042a None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=fb57334a24554a788ef7508e78b0d664&name=default HTTP/1.1" status: 200 len: 216 time: 0.0084026 May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103f9244-06c9-43c5-829f-fe4c3f13770b None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-103f9244-06c9-43c5-829f-fe4c3f13770b None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103f9244-06c9-43c5-829f-fe4c3f13770b None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18013eb-47a9-423e-b88b-f66c577a5ceb None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18013eb-47a9-423e-b88b-f66c577a5ceb None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18013eb-47a9-423e-b88b-f66c577a5ceb None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18013eb-47a9-423e-b88b-f66c577a5ceb None admin] PATH_INFO: `/v3/projects/fb57334a24554a788ef7508e78b0d664` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18013eb-47a9-423e-b88b-f66c577a5ceb None admin] RBAC: Authorizing `identity:delete_project(project_id=fb57334a24554a788ef7508e78b0d664)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18013eb-47a9-423e-b88b-f66c577a5ceb None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1748/3468] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 13:02:35 2024] POST /identity/v3/users => generated 303 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fc93bf-247d-4a26-abe5-cf6aede06253 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-68fc93bf-247d-4a26-abe5-cf6aede06253 None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fc93bf-247d-4a26-abe5-cf6aede06253 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c8d272-eae6-4448-ac38-c722ec9502c4 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c8d272-eae6-4448-ac38-c722ec9502c4 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c8d272-eae6-4448-ac38-c722ec9502c4 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c8d272-eae6-4448-ac38-c722ec9502c4 None admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c8d272-eae6-4448-ac38-c722ec9502c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c8d272-eae6-4448-ac38-c722ec9502c4 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1749/3469] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 13:02:35 2024] GET /identity/v3/roles => generated 1680 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c8d272-eae6-4448-ac38-c722ec9502c4 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c8d272-eae6-4448-ac38-c722ec9502c4 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-f18013eb-47a9-423e-b88b-f66c577a5ceb None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb57334a24554a788ef7508e78b0d664', 'request_id': 'req-f18013eb-47a9-423e-b88b-f66c577a5ceb'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-f18013eb-47a9-423e-b88b-f66c577a5ceb None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb57334a24554a788ef7508e78b0d664', 'request_id': 'req-f18013eb-47a9-423e-b88b-f66c577a5ceb'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae673ade-0e7f-47e0-9391-c56cd4faae0b None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae673ade-0e7f-47e0-9391-c56cd4faae0b None admin] REQUEST_METHOD: `PUT` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae673ade-0e7f-47e0-9391-c56cd4faae0b None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae673ade-0e7f-47e0-9391-c56cd4faae0b None admin] PATH_INFO: `/v3/projects/2b4510239ee64b778ccf03533fdcdc5a/users/d20ca92d1c8b4dc7bc575b87ba11f2a7/roles/44620cad10ae407c90c91e2c296adb04` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-f18013eb-47a9-423e-b88b-f66c577a5ceb None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb57334a24554a788ef7508e78b0d664', 'request_id': 'req-f18013eb-47a9-423e-b88b-f66c577a5ceb'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae673ade-0e7f-47e0-9391-c56cd4faae0b None admin] RBAC: Authorizing `identity:create_grant(project_id=2b4510239ee64b778ccf03533fdcdc5a, user_id=d20ca92d1c8b4dc7bc575b87ba11f2a7, role_id=44620cad10ae407c90c91e2c296adb04)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-f18013eb-47a9-423e-b88b-f66c577a5ceb None admin] The token cache is being invalidate because project fb57334a24554a788ef7508e78b0d664 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-f18013eb-47a9-423e-b88b-f66c577a5ceb None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-f18013eb-47a9-423e-b88b-f66c577a5ceb None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae673ade-0e7f-47e0-9391-c56cd4faae0b None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1721/3470] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 13:02:35 2024] DELETE /identity/v3/projects/fb57334a24554a788ef7508e78b0d664 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1750/3471] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 13:02:35 2024] PUT /identity/v3/projects/2b4510239ee64b778ccf03533fdcdc5a/users/d20ca92d1c8b4dc7bc575b87ba11f2a7/roles/44620cad10ae407c90c91e2c296adb04 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6748864-c7a4-42b8-aa92-aea95c2a1eb8 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6748864-c7a4-42b8-aa92-aea95c2a1eb8 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6748864-c7a4-42b8-aa92-aea95c2a1eb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-b6748864-c7a4-42b8-aa92-aea95c2a1eb8 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-b6748864-c7a4-42b8-aa92-aea95c2a1eb8 None None] MFA Rules not processed for user `d20ca92d1c8b4dc7bc575b87ba11f2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-b6748864-c7a4-42b8-aa92-aea95c2a1eb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1722/3472] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 13:02:35 2024] POST /identity/v3/auth/tokens => generated 3960 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae673ade-0e7f-47e0-9391-c56cd4faae0b None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-ae673ade-0e7f-47e0-9391-c56cd4faae0b None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae673ade-0e7f-47e0-9391-c56cd4faae0b None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d0dd26-0987-41e2-b6bf-5049c2462e27 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d0dd26-0987-41e2-b6bf-5049c2462e27 None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d0dd26-0987-41e2-b6bf-5049c2462e27 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d0dd26-0987-41e2-b6bf-5049c2462e27 None admin] PATH_INFO: `/v3/projects` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d0dd26-0987-41e2-b6bf-5049c2462e27 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d0dd26-0987-41e2-b6bf-5049c2462e27 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1751/3473] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 13:02:35 2024] POST /identity/v3/projects => generated 387 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6748864-c7a4-42b8-aa92-aea95c2a1eb8 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6748864-c7a4-42b8-aa92-aea95c2a1eb8 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7479ad-7a83-4c13-9623-dcbb6bfbee94 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7479ad-7a83-4c13-9623-dcbb6bfbee94 None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7479ad-7a83-4c13-9623-dcbb6bfbee94 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7479ad-7a83-4c13-9623-dcbb6bfbee94 None admin] PATH_INFO: `/v3/users` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7479ad-7a83-4c13-9623-dcbb6bfbee94 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7479ad-7a83-4c13-9623-dcbb6bfbee94 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-7a7479ad-7a83-4c13-9623-dcbb6bfbee94 None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1723/3474] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 13:02:35 2024] POST /identity/v3/users => generated 302 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d0dd26-0987-41e2-b6bf-5049c2462e27 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d0dd26-0987-41e2-b6bf-5049c2462e27 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f77f02-dc9d-49ae-b94e-eb820e5d8f8f None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f77f02-dc9d-49ae-b94e-eb820e5d8f8f None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f77f02-dc9d-49ae-b94e-eb820e5d8f8f None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f77f02-dc9d-49ae-b94e-eb820e5d8f8f None admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f77f02-dc9d-49ae-b94e-eb820e5d8f8f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f77f02-dc9d-49ae-b94e-eb820e5d8f8f None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1752/3475] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 13:02:35 2024] GET /identity/v3/roles => generated 1680 bytes in 19 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7479ad-7a83-4c13-9623-dcbb6bfbee94 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7479ad-7a83-4c13-9623-dcbb6bfbee94 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03441776-4ff6-4962-8099-0ca5b34c70eb None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03441776-4ff6-4962-8099-0ca5b34c70eb None admin] REQUEST_METHOD: `PUT` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03441776-4ff6-4962-8099-0ca5b34c70eb None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03441776-4ff6-4962-8099-0ca5b34c70eb None admin] PATH_INFO: `/v3/projects/334e02349e304e69848e5297657e42a9/users/def78076773a4672b3298749d1ecef4b/roles/44620cad10ae407c90c91e2c296adb04` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03441776-4ff6-4962-8099-0ca5b34c70eb None admin] RBAC: Authorizing `identity:create_grant(project_id=334e02349e304e69848e5297657e42a9, user_id=def78076773a4672b3298749d1ecef4b, role_id=44620cad10ae407c90c91e2c296adb04)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03441776-4ff6-4962-8099-0ca5b34c70eb None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1724/3476] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 13:02:35 2024] PUT /identity/v3/projects/334e02349e304e69848e5297657e42a9/users/def78076773a4672b3298749d1ecef4b/roles/44620cad10ae407c90c91e2c296adb04 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f045d6-aa88-4f6a-8c2b-d475cdeca474 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f045d6-aa88-4f6a-8c2b-d475cdeca474 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f045d6-aa88-4f6a-8c2b-d475cdeca474 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-c5f045d6-aa88-4f6a-8c2b-d475cdeca474 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-c5f045d6-aa88-4f6a-8c2b-d475cdeca474 None None] MFA Rules not processed for user `def78076773a4672b3298749d1ecef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-c5f045d6-aa88-4f6a-8c2b-d475cdeca474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1753/3477] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 13:02:35 2024] POST /identity/v3/auth/tokens => generated 3958 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03441776-4ff6-4962-8099-0ca5b34c70eb None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03441776-4ff6-4962-8099-0ca5b34c70eb None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083f2e26-59d2-4169-8cf7-c6eb9191e4b2 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083f2e26-59d2-4169-8cf7-c6eb9191e4b2 None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083f2e26-59d2-4169-8cf7-c6eb9191e4b2 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083f2e26-59d2-4169-8cf7-c6eb9191e4b2 None admin] PATH_INFO: `/v3/projects` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083f2e26-59d2-4169-8cf7-c6eb9191e4b2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083f2e26-59d2-4169-8cf7-c6eb9191e4b2 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1725/3478] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 13:02:35 2024] POST /identity/v3/projects => generated 385 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f045d6-aa88-4f6a-8c2b-d475cdeca474 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f045d6-aa88-4f6a-8c2b-d475cdeca474 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b15bc2-99d9-45cc-921d-500ad0675f0b None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b15bc2-99d9-45cc-921d-500ad0675f0b None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b15bc2-99d9-45cc-921d-500ad0675f0b None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b15bc2-99d9-45cc-921d-500ad0675f0b None admin] PATH_INFO: `/v3/users` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b15bc2-99d9-45cc-921d-500ad0675f0b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b15bc2-99d9-45cc-921d-500ad0675f0b None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-e9b15bc2-99d9-45cc-921d-500ad0675f0b None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1754/3479] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 13:02:35 2024] POST /identity/v3/users => generated 300 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083f2e26-59d2-4169-8cf7-c6eb9191e4b2 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083f2e26-59d2-4169-8cf7-c6eb9191e4b2 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fc19b3-c197-499b-8df4-74fa903c6dbb None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fc19b3-c197-499b-8df4-74fa903c6dbb None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fc19b3-c197-499b-8df4-74fa903c6dbb None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fc19b3-c197-499b-8df4-74fa903c6dbb None admin] PATH_INFO: `/v3/roles` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fc19b3-c197-499b-8df4-74fa903c6dbb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fc19b3-c197-499b-8df4-74fa903c6dbb None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1726/3480] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 13:02:35 2024] GET /identity/v3/roles => generated 1680 bytes in 18 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b15bc2-99d9-45cc-921d-500ad0675f0b None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b15bc2-99d9-45cc-921d-500ad0675f0b None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef330df-8110-44db-9c48-b4da9399c034 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef330df-8110-44db-9c48-b4da9399c034 None admin] REQUEST_METHOD: `PUT` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef330df-8110-44db-9c48-b4da9399c034 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef330df-8110-44db-9c48-b4da9399c034 None admin] PATH_INFO: `/v3/projects/c48d21d9f59840ffa7b0169aaac01da7/users/4598171c386c4a6fb583671b4f73048d/roles/e7989893488f483baa107be56668c4f8` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:35 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef330df-8110-44db-9c48-b4da9399c034 None admin] RBAC: Authorizing `identity:create_grant(project_id=c48d21d9f59840ffa7b0169aaac01da7, user_id=4598171c386c4a6fb583671b4f73048d, role_id=e7989893488f483baa107be56668c4f8)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef330df-8110-44db-9c48-b4da9399c034 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:36 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1755/3481] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 13:02:35 2024] PUT /identity/v3/projects/c48d21d9f59840ffa7b0169aaac01da7/users/4598171c386c4a6fb583671b4f73048d/roles/e7989893488f483baa107be56668c4f8 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:02:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fc19b3-c197-499b-8df4-74fa903c6dbb None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fc19b3-c197-499b-8df4-74fa903c6dbb None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d7e82f-bf57-43bc-b10e-71e80e9eaef1 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d7e82f-bf57-43bc-b10e-71e80e9eaef1 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d7e82f-bf57-43bc-b10e-71e80e9eaef1 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d7e82f-bf57-43bc-b10e-71e80e9eaef1 None admin] PATH_INFO: `/v3/roles` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d7e82f-bf57-43bc-b10e-71e80e9eaef1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d7e82f-bf57-43bc-b10e-71e80e9eaef1 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:36 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1727/3482] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 13:02:36 2024] GET /identity/v3/roles => generated 1680 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 13:02:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef330df-8110-44db-9c48-b4da9399c034 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef330df-8110-44db-9c48-b4da9399c034 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8528db-f0d2-4b98-a444-dc8b3ab113fd None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8528db-f0d2-4b98-a444-dc8b3ab113fd None admin] REQUEST_METHOD: `PUT` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8528db-f0d2-4b98-a444-dc8b3ab113fd None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8528db-f0d2-4b98-a444-dc8b3ab113fd None admin] PATH_INFO: `/v3/projects/c48d21d9f59840ffa7b0169aaac01da7/users/4598171c386c4a6fb583671b4f73048d/roles/e7989893488f483baa107be56668c4f8` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8528db-f0d2-4b98-a444-dc8b3ab113fd None admin] RBAC: Authorizing `identity:create_grant(project_id=c48d21d9f59840ffa7b0169aaac01da7, user_id=4598171c386c4a6fb583671b4f73048d, role_id=e7989893488f483baa107be56668c4f8)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8528db-f0d2-4b98-a444-dc8b3ab113fd None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:36 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1756/3483] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 13:02:36 2024] PUT /identity/v3/projects/c48d21d9f59840ffa7b0169aaac01da7/users/4598171c386c4a6fb583671b4f73048d/roles/e7989893488f483baa107be56668c4f8 => generated 0 bytes in 17 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:02:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19a1d2c-07bc-4a5b-84f7-3f7cabbb34a6 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19a1d2c-07bc-4a5b-84f7-3f7cabbb34a6 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19a1d2c-07bc-4a5b-84f7-3f7cabbb34a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:36 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-f19a1d2c-07bc-4a5b-84f7-3f7cabbb34a6 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 13:02:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-f19a1d2c-07bc-4a5b-84f7-3f7cabbb34a6 None None] MFA Rules not processed for user `4598171c386c4a6fb583671b4f73048d`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 13:02:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-f19a1d2c-07bc-4a5b-84f7-3f7cabbb34a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:02:36 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-3b60b747-732c-4529-8570-712815d79201 tempest-SharesNegativeTest-1014773059 None] <<< [DELETE] https://127.0.0.1:40443/api/snapshots/17/ May 28 13:02:36 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-3b60b747-732c-4529-8570-712815d79201 tempest-SharesNegativeTest-1014773059 None] --- [DELETE] https://127.0.0.1:40443/api/snapshots/17/: Done May 28 13:02:36 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1728/3484] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 13:02:36 2024] POST /identity/v3/auth/tokens => generated 4079 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 13:02:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8528db-f0d2-4b98-a444-dc8b3ab113fd None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8528db-f0d2-4b98-a444-dc8b3ab113fd None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e7ee9f-4ac4-420c-ab6a-2ec767d1f277 tempest-ShareNetworksNegativeTest-78679599 tempest-ShareNetworksNegativeTest-78679599-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4598171c386c4a6fb583671b4f73048d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c48d21d9f59840ffa7b0169aaac01da7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e7ee9f-4ac4-420c-ab6a-2ec767d1f277 tempest-ShareNetworksNegativeTest-78679599 tempest-ShareNetworksNegativeTest-78679599-project-admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e7ee9f-4ac4-420c-ab6a-2ec767d1f277 tempest-ShareNetworksNegativeTest-78679599 tempest-ShareNetworksNegativeTest-78679599-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e7ee9f-4ac4-420c-ab6a-2ec767d1f277 tempest-ShareNetworksNegativeTest-78679599 tempest-ShareNetworksNegativeTest-78679599-project-admin] PATH_INFO: `/v3/domains` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e7ee9f-4ac4-420c-ab6a-2ec767d1f277 tempest-ShareNetworksNegativeTest-78679599 tempest-ShareNetworksNegativeTest-78679599-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=51267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 13:02:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e7ee9f-4ac4-420c-ab6a-2ec767d1f277 tempest-ShareNetworksNegativeTest-78679599 tempest-ShareNetworksNegativeTest-78679599-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e7ee9f-4ac4-420c-ab6a-2ec767d1f277 tempest-ShareNetworksNegativeTest-78679599 tempest-ShareNetworksNegativeTest-78679599-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:36 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1757/3485] 10.27.203.238 () {62 vars in 1241 bytes} [Tue May 28 13:02:36 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 13:02:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19a1d2c-07bc-4a5b-84f7-3f7cabbb34a6 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19a1d2c-07bc-4a5b-84f7-3f7cabbb34a6 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c819574-39ff-4bac-a6a8-64060ceafb58 tempest-ShareNetworksNegativeTest-78679599 tempest-ShareNetworksNegativeTest-78679599-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4598171c386c4a6fb583671b4f73048d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c48d21d9f59840ffa7b0169aaac01da7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c819574-39ff-4bac-a6a8-64060ceafb58 tempest-ShareNetworksNegativeTest-78679599 tempest-ShareNetworksNegativeTest-78679599-project-admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c819574-39ff-4bac-a6a8-64060ceafb58 tempest-ShareNetworksNegativeTest-78679599 tempest-ShareNetworksNegativeTest-78679599-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c819574-39ff-4bac-a6a8-64060ceafb58 tempest-ShareNetworksNegativeTest-78679599 tempest-ShareNetworksNegativeTest-78679599-project-admin] PATH_INFO: `/v3/users` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c819574-39ff-4bac-a6a8-64060ceafb58 tempest-ShareNetworksNegativeTest-78679599 tempest-ShareNetworksNegativeTest-78679599-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c819574-39ff-4bac-a6a8-64060ceafb58 tempest-ShareNetworksNegativeTest-78679599 tempest-ShareNetworksNegativeTest-78679599-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:36 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-0c819574-39ff-4bac-a6a8-64060ceafb58 tempest-ShareNetworksNegativeTest-78679599 tempest-ShareNetworksNegativeTest-78679599-project-admin] Truncating password to algorithm specific maximum length 72 characters. May 28 13:02:36 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-3b60b747-732c-4529-8570-712815d79201 tempest-SharesNegativeTest-1014773059 None] Created reservations ['0fb6f886-817b-4285-9ba2-866418d67820', '1bb35b66-705c-4de8-8334-0e736794e537', 'b352e1d0-aad8-4c73-824a-62305aec21aa', '389d5355-c003-4cae-af85-eeeb935e5ed8'] {{(pid=98474) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 13:02:36 l75lg1-v1 dstat.sh[49771]: 28-05 13:02:36| 13 1 82 3 0|5574M 1848M 278M 7924M| 17k 615B| 0 2358k| 0 278 |8220 15k|1.03 1.13 1.06|3.0 1.0 0| 0 0 | 0 2048M| 29 364 0 44 2 May 28 13:02:36 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1729/3486] 10.27.203.238 () {64 vars in 1232 bytes} [Tue May 28 13:02:36 2024] POST /identity/v3/users => generated 433 bytes in 36 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 13:02:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e7ee9f-4ac4-420c-ab6a-2ec767d1f277 tempest-ShareNetworksNegativeTest-78679599 tempest-ShareNetworksNegativeTest-78679599-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e7ee9f-4ac4-420c-ab6a-2ec767d1f277 tempest-ShareNetworksNegativeTest-78679599 tempest-ShareNetworksNegativeTest-78679599-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34593f9c-478c-4f6b-9634-1fff44d946e9 tempest-ShareNetworksNegativeTest-78679599 tempest-ShareNetworksNegativeTest-78679599-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4598171c386c4a6fb583671b4f73048d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c48d21d9f59840ffa7b0169aaac01da7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34593f9c-478c-4f6b-9634-1fff44d946e9 tempest-ShareNetworksNegativeTest-78679599 tempest-ShareNetworksNegativeTest-78679599-project-admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34593f9c-478c-4f6b-9634-1fff44d946e9 tempest-ShareNetworksNegativeTest-78679599 tempest-ShareNetworksNegativeTest-78679599-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34593f9c-478c-4f6b-9634-1fff44d946e9 tempest-ShareNetworksNegativeTest-78679599 tempest-ShareNetworksNegativeTest-78679599-project-admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34593f9c-478c-4f6b-9634-1fff44d946e9 tempest-ShareNetworksNegativeTest-78679599 tempest-ShareNetworksNegativeTest-78679599-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34593f9c-478c-4f6b-9634-1fff44d946e9 tempest-ShareNetworksNegativeTest-78679599 tempest-ShareNetworksNegativeTest-78679599-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:36 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1758/3487] 10.27.203.238 () {62 vars in 1210 bytes} [Tue May 28 13:02:36 2024] GET /identity/v3/roles => generated 1680 bytes in 16 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 13:02:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c819574-39ff-4bac-a6a8-64060ceafb58 tempest-ShareNetworksNegativeTest-78679599 tempest-ShareNetworksNegativeTest-78679599-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c819574-39ff-4bac-a6a8-64060ceafb58 tempest-ShareNetworksNegativeTest-78679599 tempest-ShareNetworksNegativeTest-78679599-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821a8c08-0777-4a57-95b9-3c890f3bc960 tempest-ShareNetworksNegativeTest-78679599 tempest-ShareNetworksNegativeTest-78679599-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4598171c386c4a6fb583671b4f73048d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c48d21d9f59840ffa7b0169aaac01da7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821a8c08-0777-4a57-95b9-3c890f3bc960 tempest-ShareNetworksNegativeTest-78679599 tempest-ShareNetworksNegativeTest-78679599-project-admin] REQUEST_METHOD: `PUT` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821a8c08-0777-4a57-95b9-3c890f3bc960 tempest-ShareNetworksNegativeTest-78679599 tempest-ShareNetworksNegativeTest-78679599-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821a8c08-0777-4a57-95b9-3c890f3bc960 tempest-ShareNetworksNegativeTest-78679599 tempest-ShareNetworksNegativeTest-78679599-project-admin] PATH_INFO: `/v3/projects/c48d21d9f59840ffa7b0169aaac01da7/users/93bc07dfcf2c4861981da16395bddbc0/roles/44620cad10ae407c90c91e2c296adb04` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:36 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-3b60b747-732c-4529-8570-712815d79201 tempest-SharesNegativeTest-1014773059 None] Committed reservations ['0fb6f886-817b-4285-9ba2-866418d67820', '1bb35b66-705c-4de8-8334-0e736794e537', 'b352e1d0-aad8-4c73-824a-62305aec21aa', '389d5355-c003-4cae-af85-eeeb935e5ed8'] {{(pid=98474) commit /opt/stack/manila/manila/quota.py:1063}} May 28 13:02:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821a8c08-0777-4a57-95b9-3c890f3bc960 tempest-ShareNetworksNegativeTest-78679599 tempest-ShareNetworksNegativeTest-78679599-project-admin] RBAC: Authorizing `identity:create_grant(project_id=c48d21d9f59840ffa7b0169aaac01da7, user_id=93bc07dfcf2c4861981da16395bddbc0, role_id=44620cad10ae407c90c91e2c296adb04)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821a8c08-0777-4a57-95b9-3c890f3bc960 tempest-ShareNetworksNegativeTest-78679599 tempest-ShareNetworksNegativeTest-78679599-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:36 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1730/3488] 10.27.203.238 () {64 vars in 1571 bytes} [Tue May 28 13:02:36 2024] PUT /identity/v3/projects/c48d21d9f59840ffa7b0169aaac01da7/users/93bc07dfcf2c4861981da16395bddbc0/roles/44620cad10ae407c90c91e2c296adb04 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:02:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34593f9c-478c-4f6b-9634-1fff44d946e9 tempest-ShareNetworksNegativeTest-78679599 tempest-ShareNetworksNegativeTest-78679599-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-34593f9c-478c-4f6b-9634-1fff44d946e9 tempest-ShareNetworksNegativeTest-78679599 tempest-ShareNetworksNegativeTest-78679599-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:02:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34593f9c-478c-4f6b-9634-1fff44d946e9 tempest-ShareNetworksNegativeTest-78679599 tempest-ShareNetworksNegativeTest-78679599-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30eed30-3b33-465a-8c0d-a31579047b3f service manila] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f110cf6300f049c897d0aab63218d1e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30eed30-3b33-465a-8c0d-a31579047b3f service manila] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30eed30-3b33-465a-8c0d-a31579047b3f service manila] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30eed30-3b33-465a-8c0d-a31579047b3f service manila] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30eed30-3b33-465a-8c0d-a31579047b3f service manila] RBAC: Authorizing `identity:validate_token()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:36 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30eed30-3b33-465a-8c0d-a31579047b3f service manila] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:36 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1759/3489] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 13:02:36 2024] GET /identity/v3/auth/tokens => generated 4079 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 13:02:36 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-1288aefe-7c90-4711-9aa9-3e5019eb0b4a tempest-ShareNetworksNegativeTest-78679599 tempest-ShareNetworksNegativeTest-78679599-project-admin] POST http://10.27.203.238/share/v2/c48d21d9f59840ffa7b0169aaac01da7/types May 28 13:02:36 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-1288aefe-7c90-4711-9aa9-3e5019eb0b4a tempest-ShareNetworksNegativeTest-78679599 tempest-ShareNetworksNegativeTest-78679599-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share_type": {"name": "tempest-typeshare-type-1613813711", "extra_specs": {"driver_handles_share_servers": "False"}, "share_type_access:is_public": true}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:02:36 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-1288aefe-7c90-4711-9aa9-3e5019eb0b4a tempest-ShareNetworksNegativeTest-78679599 tempest-ShareNetworksNegativeTest-78679599-project-admin] http://10.27.203.238/share/v2/c48d21d9f59840ffa7b0169aaac01da7/types returned with HTTP 200 May 28 13:02:36 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1242/2506] 10.27.203.238 () {66 vars in 1359 bytes} [Tue May 28 13:02:36 2024] POST /share/v2/c48d21d9f59840ffa7b0169aaac01da7/types => generated 623 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:02:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821a8c08-0777-4a57-95b9-3c890f3bc960 tempest-ShareNetworksNegativeTest-78679599 tempest-ShareNetworksNegativeTest-78679599-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-821a8c08-0777-4a57-95b9-3c890f3bc960 tempest-ShareNetworksNegativeTest-78679599 tempest-ShareNetworksNegativeTest-78679599-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:02:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821a8c08-0777-4a57-95b9-3c890f3bc960 tempest-ShareNetworksNegativeTest-78679599 tempest-ShareNetworksNegativeTest-78679599-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f192453a-d633-48d7-8ab2-31d9c9687d06 service manila] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f110cf6300f049c897d0aab63218d1e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f192453a-d633-48d7-8ab2-31d9c9687d06 service manila] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f192453a-d633-48d7-8ab2-31d9c9687d06 service manila] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f192453a-d633-48d7-8ab2-31d9c9687d06 service manila] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f192453a-d633-48d7-8ab2-31d9c9687d06 service manila] RBAC: Authorizing `identity:validate_token()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:36 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f192453a-d633-48d7-8ab2-31d9c9687d06 service manila] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:36 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1731/3490] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 13:02:36 2024] GET /identity/v3/auth/tokens => generated 3960 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 13:02:36 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-66f279b8-d2a1-42d0-8c4f-dc05bc23e522 tempest-ShareNetworksNegativeTest-1968817504 tempest-ShareNetworksNegativeTest-1968817504-project-member] POST http://10.27.203.238/share/v1/2b4510239ee64b778ccf03533fdcdc5a/share-networks May 28 13:02:36 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-66f279b8-d2a1-42d0-8c4f-dc05bc23e522 tempest-ShareNetworksNegativeTest-1968817504 tempest-ShareNetworksNegativeTest-1968817504-project-member] Action: 'create', calling method: ShareNetworkController.create, body: {"share_network": {}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:02:36 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.quota [None req-66f279b8-d2a1-42d0-8c4f-dc05bc23e522 tempest-ShareNetworksNegativeTest-1968817504 tempest-ShareNetworksNegativeTest-1968817504-project-member] Created reservations ['09899070-9ddb-4f89-828d-2966990580f7'] {{(pid=98329) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 13:02:36 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.quota [None req-66f279b8-d2a1-42d0-8c4f-dc05bc23e522 tempest-ShareNetworksNegativeTest-1968817504 tempest-ShareNetworksNegativeTest-1968817504-project-member] Committed reservations ['09899070-9ddb-4f89-828d-2966990580f7'] {{(pid=98329) commit /opt/stack/manila/manila/quota.py:1063}} May 28 13:02:36 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-66f279b8-d2a1-42d0-8c4f-dc05bc23e522 tempest-ShareNetworksNegativeTest-1968817504 tempest-ShareNetworksNegativeTest-1968817504-project-member] http://10.27.203.238/share/v1/2b4510239ee64b778ccf03533fdcdc5a/share-networks returned with HTTP 200 May 28 13:02:36 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1265/2507] 10.27.203.238 () {64 vars in 1342 bytes} [Tue May 28 13:02:36 2024] POST /share/v1/2b4510239ee64b778ccf03533fdcdc5a/share-networks => generated 367 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:02:36 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-3b493cd8-3eca-4074-83fc-bdf62c9000de tempest-ShareNetworksNegativeTest-1968817504 tempest-ShareNetworksNegativeTest-1968817504-project-member] POST http://10.27.203.238/share/v2/2b4510239ee64b778ccf03533fdcdc5a/share-networks/98c007fd-b8cd-4af0-ab3a-1db9bfc9163d/action May 28 13:02:36 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-3b493cd8-3eca-4074-83fc-bdf62c9000de tempest-ShareNetworksNegativeTest-1968817504 tempest-ShareNetworksNegativeTest-1968817504-project-member] Action body: b'{"share_network_subnet_create_check": {"neutron_net_id": null, "neutron_subnet_id": null, "availability_zone": "non-existent-az", "reset": false}}' {{(pid=98330) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 13:02:36 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-3b493cd8-3eca-4074-83fc-bdf62c9000de tempest-ShareNetworksNegativeTest-1968817504 tempest-ShareNetworksNegativeTest-1968817504-project-member] Action: 'action', calling method: Controller.__getattribute__..version_select, body: {"share_network_subnet_create_check": {"neutron_net_id": null, "neutron_subnet_id": null, "availability_zone": "non-existent-az", "reset": false}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:02:36 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-3b493cd8-3eca-4074-83fc-bdf62c9000de tempest-ShareNetworksNegativeTest-1968817504 tempest-ShareNetworksNegativeTest-1968817504-project-member] HTTP exception thrown: The provided availability zone non-existent-az does not exist. May 28 13:02:36 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-3b493cd8-3eca-4074-83fc-bdf62c9000de tempest-ShareNetworksNegativeTest-1968817504 tempest-ShareNetworksNegativeTest-1968817504-project-member] http://10.27.203.238/share/v2/2b4510239ee64b778ccf03533fdcdc5a/share-networks/98c007fd-b8cd-4af0-ab3a-1db9bfc9163d/action returned with HTTP 400 May 28 13:02:36 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1243/2508] 10.27.203.238 () {68 vars in 1566 bytes} [Tue May 28 13:02:36 2024] POST /share/v2/2b4510239ee64b778ccf03533fdcdc5a/share-networks/98c007fd-b8cd-4af0-ab3a-1db9bfc9163d/action => generated 106 bytes in 29 msecs (HTTP/1.1 400) 7 headers in 283 bytes (1 switches on core 0) May 28 13:02:36 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-71b9b6ec-37fe-4b52-a06d-2685e69a3d87 tempest-ShareNetworksNegativeTest-1968817504 tempest-ShareNetworksNegativeTest-1968817504-project-member] DELETE http://10.27.203.238/share/v1/2b4510239ee64b778ccf03533fdcdc5a/share-networks/98c007fd-b8cd-4af0-ab3a-1db9bfc9163d May 28 13:02:36 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-71b9b6ec-37fe-4b52-a06d-2685e69a3d87 tempest-ShareNetworksNegativeTest-1968817504 tempest-ShareNetworksNegativeTest-1968817504-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:02:36 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-71b9b6ec-37fe-4b52-a06d-2685e69a3d87 tempest-ShareNetworksNegativeTest-1968817504 tempest-ShareNetworksNegativeTest-1968817504-project-member] Calling method 'ShareNetworkController.delete' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:02:36 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.quota [None req-71b9b6ec-37fe-4b52-a06d-2685e69a3d87 tempest-ShareNetworksNegativeTest-1968817504 tempest-ShareNetworksNegativeTest-1968817504-project-member] Created reservations ['0ca87674-379f-497f-8237-168bef866bd3'] {{(pid=98329) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 13:02:36 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.quota [None req-71b9b6ec-37fe-4b52-a06d-2685e69a3d87 tempest-ShareNetworksNegativeTest-1968817504 tempest-ShareNetworksNegativeTest-1968817504-project-member] Committed reservations ['0ca87674-379f-497f-8237-168bef866bd3'] {{(pid=98329) commit /opt/stack/manila/manila/quota.py:1063}} May 28 13:02:36 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-71b9b6ec-37fe-4b52-a06d-2685e69a3d87 tempest-ShareNetworksNegativeTest-1968817504 tempest-ShareNetworksNegativeTest-1968817504-project-member] http://10.27.203.238/share/v1/2b4510239ee64b778ccf03533fdcdc5a/share-networks/98c007fd-b8cd-4af0-ab3a-1db9bfc9163d returned with HTTP 202 May 28 13:02:36 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1266/2509] 10.27.203.238 () {62 vars in 1435 bytes} [Tue May 28 13:02:36 2024] DELETE /share/v1/2b4510239ee64b778ccf03533fdcdc5a/share-networks/98c007fd-b8cd-4af0-ab3a-1db9bfc9163d => generated 0 bytes in 128 msecs (HTTP/1.1 202) 6 headers in 242 bytes (1 switches on core 0) May 28 13:02:36 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-bd6eeb11-0eed-4bbb-b24f-82870d9df477 tempest-ShareNetworksNegativeTest-1968817504 tempest-ShareNetworksNegativeTest-1968817504-project-member] GET http://10.27.203.238/share/v1/2b4510239ee64b778ccf03533fdcdc5a/share-networks/98c007fd-b8cd-4af0-ab3a-1db9bfc9163d May 28 13:02:36 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-bd6eeb11-0eed-4bbb-b24f-82870d9df477 tempest-ShareNetworksNegativeTest-1968817504 tempest-ShareNetworksNegativeTest-1968817504-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:02:36 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-bd6eeb11-0eed-4bbb-b24f-82870d9df477 tempest-ShareNetworksNegativeTest-1968817504 tempest-ShareNetworksNegativeTest-1968817504-project-member] Calling method 'ShareNetworkController.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:02:36 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-bd6eeb11-0eed-4bbb-b24f-82870d9df477 tempest-ShareNetworksNegativeTest-1968817504 tempest-ShareNetworksNegativeTest-1968817504-project-member] HTTP exception thrown: Share network 98c007fd-b8cd-4af0-ab3a-1db9bfc9163d could not be found. May 28 13:02:36 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-bd6eeb11-0eed-4bbb-b24f-82870d9df477 tempest-ShareNetworksNegativeTest-1968817504 tempest-ShareNetworksNegativeTest-1968817504-project-member] http://10.27.203.238/share/v1/2b4510239ee64b778ccf03533fdcdc5a/share-networks/98c007fd-b8cd-4af0-ab3a-1db9bfc9163d returned with HTTP 404 May 28 13:02:36 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1244/2510] 10.27.203.238 () {62 vars in 1432 bytes} [Tue May 28 13:02:36 2024] GET /share/v1/2b4510239ee64b778ccf03533fdcdc5a/share-networks/98c007fd-b8cd-4af0-ab3a-1db9bfc9163d => generated 116 bytes in 17 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 13:02:36 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-df03f910-a8bb-459e-80d6-001c3e947995 tempest-ShareNetworksNegativeTest-1968817504 tempest-ShareNetworksNegativeTest-1968817504-project-member] POST http://10.27.203.238/share/v2/2b4510239ee64b778ccf03533fdcdc5a/share-networks/fake_inexistent_id/action May 28 13:02:36 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-df03f910-a8bb-459e-80d6-001c3e947995 tempest-ShareNetworksNegativeTest-1968817504 tempest-ShareNetworksNegativeTest-1968817504-project-member] Action body: b'{"share_network_subnet_create_check": {"neutron_net_id": "tempest-net-id-1412072896", "neutron_subnet_id": "tempest-subnet-id-1271867798", "availability_zone": null, "reset": false}}' {{(pid=98329) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 13:02:36 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-df03f910-a8bb-459e-80d6-001c3e947995 tempest-ShareNetworksNegativeTest-1968817504 tempest-ShareNetworksNegativeTest-1968817504-project-member] Action: 'action', calling method: Controller.__getattribute__..version_select, body: {"share_network_subnet_create_check": {"neutron_net_id": "tempest-net-id-1412072896", "neutron_subnet_id": "tempest-subnet-id-1271867798", "availability_zone": null, "reset": false}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:02:36 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-df03f910-a8bb-459e-80d6-001c3e947995 tempest-ShareNetworksNegativeTest-1968817504 tempest-ShareNetworksNegativeTest-1968817504-project-member] HTTP exception thrown: Share network fake_inexistent_id could not be found. May 28 13:02:36 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-df03f910-a8bb-459e-80d6-001c3e947995 tempest-ShareNetworksNegativeTest-1968817504 tempest-ShareNetworksNegativeTest-1968817504-project-member] http://10.27.203.238/share/v2/2b4510239ee64b778ccf03533fdcdc5a/share-networks/fake_inexistent_id/action returned with HTTP 404 May 28 13:02:36 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1267/2511] 10.27.203.238 () {68 vars in 1512 bytes} [Tue May 28 13:02:36 2024] POST /share/v2/2b4510239ee64b778ccf03533fdcdc5a/share-networks/fake_inexistent_id/action => generated 98 bytes in 18 msecs (HTTP/1.1 404) 7 headers in 280 bytes (1 switches on core 0) May 28 13:02:36 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-e6166f00-b3a8-4538-a05a-dfc126f7732c tempest-ShareNetworksNegativeTest-1968817504 tempest-ShareNetworksNegativeTest-1968817504-project-member] POST http://10.27.203.238/share/v2/2b4510239ee64b778ccf03533fdcdc5a/share-networks May 28 13:02:36 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-e6166f00-b3a8-4538-a05a-dfc126f7732c tempest-ShareNetworksNegativeTest-1968817504 tempest-ShareNetworksNegativeTest-1968817504-project-member] Action: 'create', calling method: ShareNetworkController.create, body: {"share_network": {"availability_zone": "inexistent-availability-zone"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:02:36 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-e6166f00-b3a8-4538-a05a-dfc126f7732c tempest-ShareNetworksNegativeTest-1968817504 tempest-ShareNetworksNegativeTest-1968817504-project-member] HTTP exception thrown: The provided availability zone inexistent-availability-zone does not exist. May 28 13:02:36 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-e6166f00-b3a8-4538-a05a-dfc126f7732c tempest-ShareNetworksNegativeTest-1968817504 tempest-ShareNetworksNegativeTest-1968817504-project-member] http://10.27.203.238/share/v2/2b4510239ee64b778ccf03533fdcdc5a/share-networks returned with HTTP 400 May 28 13:02:36 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1245/2512] 10.27.203.238 () {66 vars in 1385 bytes} [Tue May 28 13:02:36 2024] POST /share/v2/2b4510239ee64b778ccf03533fdcdc5a/share-networks => generated 119 bytes in 8 msecs (HTTP/1.1 400) 6 headers in 240 bytes (1 switches on core 0) May 28 13:02:36 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-2d6f4ca4-00f4-42cd-b53c-a9ed9e324beb tempest-ShareNetworksNegativeTest-1968817504 tempest-ShareNetworksNegativeTest-1968817504-project-member] POST http://10.27.203.238/share/v1/2b4510239ee64b778ccf03533fdcdc5a/share-networks May 28 13:02:36 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-2d6f4ca4-00f4-42cd-b53c-a9ed9e324beb tempest-ShareNetworksNegativeTest-1968817504 tempest-ShareNetworksNegativeTest-1968817504-project-member] Action: 'create', calling method: ShareNetworkController.create, body: {"share_network": {}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:02:36 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.quota [None req-2d6f4ca4-00f4-42cd-b53c-a9ed9e324beb tempest-ShareNetworksNegativeTest-1968817504 tempest-ShareNetworksNegativeTest-1968817504-project-member] Created reservations ['97372e1d-e205-4b38-8794-b3b33cbe3e0e'] {{(pid=98329) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 13:02:37 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.quota [None req-2d6f4ca4-00f4-42cd-b53c-a9ed9e324beb tempest-ShareNetworksNegativeTest-1968817504 tempest-ShareNetworksNegativeTest-1968817504-project-member] Committed reservations ['97372e1d-e205-4b38-8794-b3b33cbe3e0e'] {{(pid=98329) commit /opt/stack/manila/manila/quota.py:1063}} May 28 13:02:37 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-2d6f4ca4-00f4-42cd-b53c-a9ed9e324beb tempest-ShareNetworksNegativeTest-1968817504 tempest-ShareNetworksNegativeTest-1968817504-project-member] http://10.27.203.238/share/v1/2b4510239ee64b778ccf03533fdcdc5a/share-networks returned with HTTP 200 May 28 13:02:37 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1268/2513] 10.27.203.238 () {64 vars in 1342 bytes} [Tue May 28 13:02:36 2024] POST /share/v1/2b4510239ee64b778ccf03533fdcdc5a/share-networks => generated 367 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:02:37 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-6c3bf909-4fd6-43d8-b266-b87d1c75f720 tempest-ShareNetworksNegativeTest-1968817504 tempest-ShareNetworksNegativeTest-1968817504-project-member] GET http://10.27.203.238/share/v2/2b4510239ee64b778ccf03533fdcdc5a/availability-zones May 28 13:02:37 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-6c3bf909-4fd6-43d8-b266-b87d1c75f720 tempest-ShareNetworksNegativeTest-1968817504 tempest-ShareNetworksNegativeTest-1968817504-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:02:37 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-6c3bf909-4fd6-43d8-b266-b87d1c75f720 tempest-ShareNetworksNegativeTest-1968817504 tempest-ShareNetworksNegativeTest-1968817504-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:02:37 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-6c3bf909-4fd6-43d8-b266-b87d1c75f720 tempest-ShareNetworksNegativeTest-1968817504 tempest-ShareNetworksNegativeTest-1968817504-project-member] http://10.27.203.238/share/v2/2b4510239ee64b778ccf03533fdcdc5a/availability-zones returned with HTTP 200 May 28 13:02:37 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1246/2514] 10.27.203.238 () {64 vars in 1376 bytes} [Tue May 28 13:02:37 2024] GET /share/v2/2b4510239ee64b778ccf03533fdcdc5a/availability-zones => generated 152 bytes in 8 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:02:37 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-d9dd8164-ec10-434d-841b-00b23896f2d4 tempest-ShareNetworksNegativeTest-1968817504 tempest-ShareNetworksNegativeTest-1968817504-project-member] POST http://10.27.203.238/share/v2/2b4510239ee64b778ccf03533fdcdc5a/share-networks/a93b1c12-4c62-4f60-831f-c52bcdcd3049/subnets May 28 13:02:37 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-d9dd8164-ec10-434d-841b-00b23896f2d4 tempest-ShareNetworksNegativeTest-1968817504 tempest-ShareNetworksNegativeTest-1968817504-project-member] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share-network-subnet": {"share_network_id": "a93b1c12-4c62-4f60-831f-c52bcdcd3049", "availability_zone": "nova", "neutron_net_id": "tempest-net-id-334344392", "neutron_subnet_id": "tempest-subnet-id-102177952"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:02:37 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-d9dd8164-ec10-434d-841b-00b23896f2d4 tempest-ShareNetworksNegativeTest-1968817504 tempest-ShareNetworksNegativeTest-1968817504-project-member] http://10.27.203.238/share/v2/2b4510239ee64b778ccf03533fdcdc5a/share-networks/a93b1c12-4c62-4f60-831f-c52bcdcd3049/subnets returned with HTTP 200 May 28 13:02:37 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1269/2515] 10.27.203.238 () {66 vars in 1521 bytes} [Tue May 28 13:02:37 2024] POST /share/v2/2b4510239ee64b778ccf03533fdcdc5a/share-networks/a93b1c12-4c62-4f60-831f-c52bcdcd3049/subnets => generated 478 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:02:37 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-51767989-b6b5-4120-b521-96d25743a878 tempest-ShareNetworksNegativeTest-1968817504 tempest-ShareNetworksNegativeTest-1968817504-project-member] DELETE http://10.27.203.238/share/v1/2b4510239ee64b778ccf03533fdcdc5a/share-networks/a93b1c12-4c62-4f60-831f-c52bcdcd3049 May 28 13:02:37 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-51767989-b6b5-4120-b521-96d25743a878 tempest-ShareNetworksNegativeTest-1968817504 tempest-ShareNetworksNegativeTest-1968817504-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:02:37 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-51767989-b6b5-4120-b521-96d25743a878 tempest-ShareNetworksNegativeTest-1968817504 tempest-ShareNetworksNegativeTest-1968817504-project-member] Calling method 'ShareNetworkController.delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:02:37 l75lg1-v1 devstack@m-api.service[98330]: ERROR manila.api.v2.share_networks [None req-51767989-b6b5-4120-b521-96d25743a878 tempest-ShareNetworksNegativeTest-1968817504 tempest-ShareNetworksNegativeTest-1968817504-project-member] The share network a93b1c12-4c62-4f60-831f-c52bcdcd3049 has more than one subnet attached. Please remove the subnets untill you have one or no subnets remaining. May 28 13:02:37 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-51767989-b6b5-4120-b521-96d25743a878 tempest-ShareNetworksNegativeTest-1968817504 tempest-ShareNetworksNegativeTest-1968817504-project-member] HTTP exception thrown: The share network a93b1c12-4c62-4f60-831f-c52bcdcd3049 has more than one subnet attached. Please remove the subnets untill you have one or no subnets remaining. May 28 13:02:37 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-51767989-b6b5-4120-b521-96d25743a878 tempest-ShareNetworksNegativeTest-1968817504 tempest-ShareNetworksNegativeTest-1968817504-project-member] http://10.27.203.238/share/v1/2b4510239ee64b778ccf03533fdcdc5a/share-networks/a93b1c12-4c62-4f60-831f-c52bcdcd3049 returned with HTTP 409 May 28 13:02:37 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1247/2516] 10.27.203.238 () {62 vars in 1435 bytes} [Tue May 28 13:02:37 2024] DELETE /share/v1/2b4510239ee64b778ccf03533fdcdc5a/share-networks/a93b1c12-4c62-4f60-831f-c52bcdcd3049 => generated 212 bytes in 39 msecs (HTTP/1.1 409) 6 headers in 236 bytes (1 switches on core 0) May 28 13:02:37 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-7ab15a7a-9442-4800-a5f4-87958332ead3 tempest-ShareNetworksNegativeTest-1968817504 tempest-ShareNetworksNegativeTest-1968817504-project-member] DELETE http://10.27.203.238/share/v2/2b4510239ee64b778ccf03533fdcdc5a/share-networks/a93b1c12-4c62-4f60-831f-c52bcdcd3049/subnets/36bcc6a1-4240-4366-aa1f-4926b16ae3f8 May 28 13:02:37 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-7ab15a7a-9442-4800-a5f4-87958332ead3 tempest-ShareNetworksNegativeTest-1968817504 tempest-ShareNetworksNegativeTest-1968817504-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:02:37 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-7ab15a7a-9442-4800-a5f4-87958332ead3 tempest-ShareNetworksNegativeTest-1968817504 tempest-ShareNetworksNegativeTest-1968817504-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:02:37 l75lg1-v1 dstat.sh[49771]: 28-05 13:02:37| 8 1 86 4 0|5574M 1847M 278M 7924M| 19k 5022B| 0 2093k| 0 294 |6414 11k|1.03 1.13 1.06|2.0 1.0 0| 0 0 | 0 2048M| 29 364 0 44 2 May 28 13:02:37 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-7ab15a7a-9442-4800-a5f4-87958332ead3 tempest-ShareNetworksNegativeTest-1968817504 tempest-ShareNetworksNegativeTest-1968817504-project-member] http://10.27.203.238/share/v2/2b4510239ee64b778ccf03533fdcdc5a/share-networks/a93b1c12-4c62-4f60-831f-c52bcdcd3049/subnets/36bcc6a1-4240-4366-aa1f-4926b16ae3f8 returned with HTTP 202 May 28 13:02:37 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1270/2517] 10.27.203.238 () {64 vars in 1613 bytes} [Tue May 28 13:02:37 2024] DELETE /share/v2/2b4510239ee64b778ccf03533fdcdc5a/share-networks/a93b1c12-4c62-4f60-831f-c52bcdcd3049/subnets/36bcc6a1-4240-4366-aa1f-4926b16ae3f8 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 13:02:37 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-1f7c244e-816d-4c99-ae27-1352bd3840ae tempest-ShareNetworksNegativeTest-1968817504 tempest-ShareNetworksNegativeTest-1968817504-project-member] GET http://10.27.203.238/share/v2/2b4510239ee64b778ccf03533fdcdc5a/share-networks/a93b1c12-4c62-4f60-831f-c52bcdcd3049 May 28 13:02:37 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-1f7c244e-816d-4c99-ae27-1352bd3840ae tempest-ShareNetworksNegativeTest-1968817504 tempest-ShareNetworksNegativeTest-1968817504-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:02:37 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-1f7c244e-816d-4c99-ae27-1352bd3840ae tempest-ShareNetworksNegativeTest-1968817504 tempest-ShareNetworksNegativeTest-1968817504-project-member] Calling method 'ShareNetworkController.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:02:37 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-1f7c244e-816d-4c99-ae27-1352bd3840ae tempest-ShareNetworksNegativeTest-1968817504 tempest-ShareNetworksNegativeTest-1968817504-project-member] http://10.27.203.238/share/v2/2b4510239ee64b778ccf03533fdcdc5a/share-networks/a93b1c12-4c62-4f60-831f-c52bcdcd3049 returned with HTTP 200 May 28 13:02:37 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1248/2518] 10.27.203.238 () {64 vars in 1475 bytes} [Tue May 28 13:02:37 2024] GET /share/v2/2b4510239ee64b778ccf03533fdcdc5a/share-networks/a93b1c12-4c62-4f60-831f-c52bcdcd3049 => generated 662 bytes in 28 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:02:37 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-c2f45790-1d01-405b-a794-82d31e6ca53a tempest-ShareNetworksNegativeTest-1968817504 tempest-ShareNetworksNegativeTest-1968817504-project-member] DELETE http://10.27.203.238/share/v2/2b4510239ee64b778ccf03533fdcdc5a/share-networks/a93b1c12-4c62-4f60-831f-c52bcdcd3049/subnets/36bcc6a1-4240-4366-aa1f-4926b16ae3f8 May 28 13:02:37 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-c2f45790-1d01-405b-a794-82d31e6ca53a tempest-ShareNetworksNegativeTest-1968817504 tempest-ShareNetworksNegativeTest-1968817504-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:02:37 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-c2f45790-1d01-405b-a794-82d31e6ca53a tempest-ShareNetworksNegativeTest-1968817504 tempest-ShareNetworksNegativeTest-1968817504-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:02:37 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-c2f45790-1d01-405b-a794-82d31e6ca53a tempest-ShareNetworksNegativeTest-1968817504 tempest-ShareNetworksNegativeTest-1968817504-project-member] HTTP exception thrown: Share network subnet 36bcc6a1-4240-4366-aa1f-4926b16ae3f8 could not be found. May 28 13:02:37 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-c2f45790-1d01-405b-a794-82d31e6ca53a tempest-ShareNetworksNegativeTest-1968817504 tempest-ShareNetworksNegativeTest-1968817504-project-member] http://10.27.203.238/share/v2/2b4510239ee64b778ccf03533fdcdc5a/share-networks/a93b1c12-4c62-4f60-831f-c52bcdcd3049/subnets/36bcc6a1-4240-4366-aa1f-4926b16ae3f8 returned with HTTP 404 May 28 13:02:37 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1271/2519] 10.27.203.238 () {64 vars in 1613 bytes} [Tue May 28 13:02:37 2024] DELETE /share/v2/2b4510239ee64b778ccf03533fdcdc5a/share-networks/a93b1c12-4c62-4f60-831f-c52bcdcd3049/subnets/36bcc6a1-4240-4366-aa1f-4926b16ae3f8 => generated 123 bytes in 32 msecs (HTTP/1.1 404) 6 headers in 238 bytes (1 switches on core 0) May 28 13:02:37 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-50696f17-3856-4625-a937-c5252194b7ae tempest-ShareNetworksNegativeTest-1968817504 tempest-ShareNetworksNegativeTest-1968817504-project-member] DELETE http://10.27.203.238/share/v1/2b4510239ee64b778ccf03533fdcdc5a/share-networks/a93b1c12-4c62-4f60-831f-c52bcdcd3049 May 28 13:02:37 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-50696f17-3856-4625-a937-c5252194b7ae tempest-ShareNetworksNegativeTest-1968817504 tempest-ShareNetworksNegativeTest-1968817504-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:02:37 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-50696f17-3856-4625-a937-c5252194b7ae tempest-ShareNetworksNegativeTest-1968817504 tempest-ShareNetworksNegativeTest-1968817504-project-member] Calling method 'ShareNetworkController.delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:02:37 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.quota [None req-50696f17-3856-4625-a937-c5252194b7ae tempest-ShareNetworksNegativeTest-1968817504 tempest-ShareNetworksNegativeTest-1968817504-project-member] Created reservations ['6a8e0a5c-7994-426b-9e2c-784ac601c9a8'] {{(pid=98330) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 13:02:37 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.quota [None req-50696f17-3856-4625-a937-c5252194b7ae tempest-ShareNetworksNegativeTest-1968817504 tempest-ShareNetworksNegativeTest-1968817504-project-member] Committed reservations ['6a8e0a5c-7994-426b-9e2c-784ac601c9a8'] {{(pid=98330) commit /opt/stack/manila/manila/quota.py:1063}} May 28 13:02:37 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-50696f17-3856-4625-a937-c5252194b7ae tempest-ShareNetworksNegativeTest-1968817504 tempest-ShareNetworksNegativeTest-1968817504-project-member] http://10.27.203.238/share/v1/2b4510239ee64b778ccf03533fdcdc5a/share-networks/a93b1c12-4c62-4f60-831f-c52bcdcd3049 returned with HTTP 202 May 28 13:02:37 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1249/2520] 10.27.203.238 () {62 vars in 1435 bytes} [Tue May 28 13:02:37 2024] DELETE /share/v1/2b4510239ee64b778ccf03533fdcdc5a/share-networks/a93b1c12-4c62-4f60-831f-c52bcdcd3049 => generated 0 bytes in 139 msecs (HTTP/1.1 202) 6 headers in 242 bytes (1 switches on core 0) May 28 13:02:37 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-5961c39c-dfbe-4662-9b36-b37b8e661efe tempest-ShareNetworksNegativeTest-1968817504 tempest-ShareNetworksNegativeTest-1968817504-project-member] GET http://10.27.203.238/share/v1/2b4510239ee64b778ccf03533fdcdc5a/share-networks/a93b1c12-4c62-4f60-831f-c52bcdcd3049 May 28 13:02:37 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-5961c39c-dfbe-4662-9b36-b37b8e661efe tempest-ShareNetworksNegativeTest-1968817504 tempest-ShareNetworksNegativeTest-1968817504-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:02:37 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-5961c39c-dfbe-4662-9b36-b37b8e661efe tempest-ShareNetworksNegativeTest-1968817504 tempest-ShareNetworksNegativeTest-1968817504-project-member] Calling method 'ShareNetworkController.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:02:37 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-5961c39c-dfbe-4662-9b36-b37b8e661efe tempest-ShareNetworksNegativeTest-1968817504 tempest-ShareNetworksNegativeTest-1968817504-project-member] HTTP exception thrown: Share network a93b1c12-4c62-4f60-831f-c52bcdcd3049 could not be found. May 28 13:02:37 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-5961c39c-dfbe-4662-9b36-b37b8e661efe tempest-ShareNetworksNegativeTest-1968817504 tempest-ShareNetworksNegativeTest-1968817504-project-member] http://10.27.203.238/share/v1/2b4510239ee64b778ccf03533fdcdc5a/share-networks/a93b1c12-4c62-4f60-831f-c52bcdcd3049 returned with HTTP 404 May 28 13:02:37 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1272/2521] 10.27.203.238 () {62 vars in 1432 bytes} [Tue May 28 13:02:37 2024] GET /share/v1/2b4510239ee64b778ccf03533fdcdc5a/share-networks/a93b1c12-4c62-4f60-831f-c52bcdcd3049 => generated 116 bytes in 27 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 13:02:37 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-61515a61-eff3-4bd2-9d95-7ba39dc4b710 tempest-ShareNetworksNegativeTest-1968817504 tempest-ShareNetworksNegativeTest-1968817504-project-member] GET http://10.27.203.238/share/v2/2b4510239ee64b778ccf03533fdcdc5a/share-networks/detail?name~=fake_not_exist&description~=fake_not_exist May 28 13:02:37 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-61515a61-eff3-4bd2-9d95-7ba39dc4b710 tempest-ShareNetworksNegativeTest-1968817504 tempest-ShareNetworksNegativeTest-1968817504-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:02:37 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-61515a61-eff3-4bd2-9d95-7ba39dc4b710 tempest-ShareNetworksNegativeTest-1968817504 tempest-ShareNetworksNegativeTest-1968817504-project-member] Calling method 'ShareNetworkController.detail' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:02:37 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-61515a61-eff3-4bd2-9d95-7ba39dc4b710 tempest-ShareNetworksNegativeTest-1968817504 tempest-ShareNetworksNegativeTest-1968817504-project-member] http://10.27.203.238/share/v2/2b4510239ee64b778ccf03533fdcdc5a/share-networks/detail?name~=fake_not_exist&description~=fake_not_exist returned with HTTP 200 May 28 13:02:37 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1250/2522] 10.27.203.238 () {64 vars in 1482 bytes} [Tue May 28 13:02:37 2024] GET /share/v2/2b4510239ee64b778ccf03533fdcdc5a/share-networks/detail?name~=fake_not_exist&description~=fake_not_exist => generated 22 bytes in 19 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:02:37 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-9515e11e-d4d3-4934-9a9a-3623b17cce93 tempest-ShareNetworksNegativeTest-1968817504 tempest-ShareNetworksNegativeTest-1968817504-project-member] DELETE http://10.27.203.238/share/v1/2b4510239ee64b778ccf03533fdcdc5a/share-networks/wrong_id May 28 13:02:37 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-9515e11e-d4d3-4934-9a9a-3623b17cce93 tempest-ShareNetworksNegativeTest-1968817504 tempest-ShareNetworksNegativeTest-1968817504-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:02:37 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-9515e11e-d4d3-4934-9a9a-3623b17cce93 tempest-ShareNetworksNegativeTest-1968817504 tempest-ShareNetworksNegativeTest-1968817504-project-member] Calling method 'ShareNetworkController.delete' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:02:37 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-9515e11e-d4d3-4934-9a9a-3623b17cce93 tempest-ShareNetworksNegativeTest-1968817504 tempest-ShareNetworksNegativeTest-1968817504-project-member] HTTP exception thrown: Share network wrong_id could not be found. May 28 13:02:37 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-9515e11e-d4d3-4934-9a9a-3623b17cce93 tempest-ShareNetworksNegativeTest-1968817504 tempest-ShareNetworksNegativeTest-1968817504-project-member] http://10.27.203.238/share/v1/2b4510239ee64b778ccf03533fdcdc5a/share-networks/wrong_id returned with HTTP 404 May 28 13:02:37 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1273/2523] 10.27.203.238 () {62 vars in 1351 bytes} [Tue May 28 13:02:37 2024] DELETE /share/v1/2b4510239ee64b778ccf03533fdcdc5a/share-networks/wrong_id => generated 88 bytes in 17 msecs (HTTP/1.1 404) 6 headers in 236 bytes (1 switches on core 0) May 28 13:02:37 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-9c6129cb-318a-4a90-afc7-b5bf83a36151 tempest-SharesNegativeTest-1014773059 tempest-SharesNegativeTest-1014773059-project-member] GET http://10.27.203.238/share/v2/d1d71dc9f23c4c6a8e146d99ad65ebb2/snapshots/79b46976-8aab-4859-b7c0-b71cf76c2cc2 May 28 13:02:37 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-9c6129cb-318a-4a90-afc7-b5bf83a36151 tempest-SharesNegativeTest-1014773059 tempest-SharesNegativeTest-1014773059-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:02:37 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-9c6129cb-318a-4a90-afc7-b5bf83a36151 tempest-SharesNegativeTest-1014773059 tempest-SharesNegativeTest-1014773059-project-member] Calling method 'ShareSnapshotMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:02:37 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1274/2524] 10.27.203.238 () {62 vars in 1327 bytes} [Tue May 28 13:02:37 2024] DELETE /share/v1/2b4510239ee64b778ccf03533fdcdc5a/share-networks/ => generated 112 bytes in 3 msecs (HTTP/1.1 404) 3 headers in 98 bytes (1 switches on core 0) May 28 13:02:37 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-9c6129cb-318a-4a90-afc7-b5bf83a36151 tempest-SharesNegativeTest-1014773059 tempest-SharesNegativeTest-1014773059-project-member] HTTP exception thrown: The resource could not be found. May 28 13:02:37 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-9c6129cb-318a-4a90-afc7-b5bf83a36151 tempest-SharesNegativeTest-1014773059 tempest-SharesNegativeTest-1014773059-project-member] http://10.27.203.238/share/v2/d1d71dc9f23c4c6a8e146d99ad65ebb2/snapshots/79b46976-8aab-4859-b7c0-b71cf76c2cc2 returned with HTTP 404 May 28 13:02:37 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1251/2525] 10.27.203.238 () {64 vars in 1460 bytes} [Tue May 28 13:02:37 2024] GET /share/v2/d1d71dc9f23c4c6a8e146d99ad65ebb2/snapshots/79b46976-8aab-4859-b7c0-b71cf76c2cc2 => generated 78 bytes in 14 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 13:02:37 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-3495c0c3-d5c2-4427-92c7-9f359ef1cb2e tempest-ShareNetworksNegativeTest-1968817504 tempest-ShareNetworksNegativeTest-1968817504-project-member] POST http://10.27.203.238/share/v1/2b4510239ee64b778ccf03533fdcdc5a/share-networks May 28 13:02:37 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-3495c0c3-d5c2-4427-92c7-9f359ef1cb2e tempest-ShareNetworksNegativeTest-1968817504 tempest-ShareNetworksNegativeTest-1968817504-project-member] Action: 'create', calling method: ShareNetworkController.create, body: {"share_network": {"name": "tempest-sn-name-2050191793", "description": "tempest-sn-desc-57376326", "neutron_net_id": "tempest-net-id-1736704965", "neutron_subnet_id": "tempest-subnet-id-897191599"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:02:37 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-e445556b-78c7-4b4a-9515-7b7605920c19 tempest-SharesNegativeTest-1014773059 tempest-SharesNegativeTest-1014773059-project-member] GET http://10.27.203.238/share/v2/d1d71dc9f23c4c6a8e146d99ad65ebb2/share-replicas/detail?share_id=b05a8999-f1ac-4887-a675-3c2ca8e9cece May 28 13:02:37 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-e445556b-78c7-4b4a-9515-7b7605920c19 tempest-SharesNegativeTest-1014773059 tempest-SharesNegativeTest-1014773059-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:02:37 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-e445556b-78c7-4b4a-9515-7b7605920c19 tempest-SharesNegativeTest-1014773059 tempest-SharesNegativeTest-1014773059-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:02:37 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-e445556b-78c7-4b4a-9515-7b7605920c19 tempest-SharesNegativeTest-1014773059 tempest-SharesNegativeTest-1014773059-project-member] http://10.27.203.238/share/v2/d1d71dc9f23c4c6a8e146d99ad65ebb2/share-replicas/detail?share_id=b05a8999-f1ac-4887-a675-3c2ca8e9cece returned with HTTP 200 May 28 13:02:37 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1252/2526] 10.27.203.238 () {64 vars in 1476 bytes} [Tue May 28 13:02:37 2024] GET /share/v2/d1d71dc9f23c4c6a8e146d99ad65ebb2/share-replicas/detail?share_id=b05a8999-f1ac-4887-a675-3c2ca8e9cece => generated 22 bytes in 12 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:02:37 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-93b28755-7e81-4995-8892-12b84a143ba4 tempest-SharesNegativeTest-1014773059 tempest-SharesNegativeTest-1014773059-project-member] DELETE http://10.27.203.238/share/v2/d1d71dc9f23c4c6a8e146d99ad65ebb2/shares/b05a8999-f1ac-4887-a675-3c2ca8e9cece May 28 13:02:37 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-93b28755-7e81-4995-8892-12b84a143ba4 tempest-SharesNegativeTest-1014773059 tempest-SharesNegativeTest-1014773059-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:02:37 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-93b28755-7e81-4995-8892-12b84a143ba4 tempest-SharesNegativeTest-1014773059 tempest-SharesNegativeTest-1014773059-project-member] Calling method 'ShareMixin.delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:02:37 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.v1.shares [None req-93b28755-7e81-4995-8892-12b84a143ba4 tempest-SharesNegativeTest-1014773059 tempest-SharesNegativeTest-1014773059-project-member] Delete share with id: b05a8999-f1ac-4887-a675-3c2ca8e9cece May 28 13:02:37 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.quota [None req-3495c0c3-d5c2-4427-92c7-9f359ef1cb2e tempest-ShareNetworksNegativeTest-1968817504 tempest-ShareNetworksNegativeTest-1968817504-project-member] Created reservations ['94be1bac-2296-4467-a698-1b977627c932'] {{(pid=98329) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 13:02:37 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.quota [None req-3495c0c3-d5c2-4427-92c7-9f359ef1cb2e tempest-ShareNetworksNegativeTest-1968817504 tempest-ShareNetworksNegativeTest-1968817504-project-member] Committed reservations ['94be1bac-2296-4467-a698-1b977627c932'] {{(pid=98329) commit /opt/stack/manila/manila/quota.py:1063}} May 28 13:02:37 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-93b28755-7e81-4995-8892-12b84a143ba4 tempest-SharesNegativeTest-1014773059 tempest-SharesNegativeTest-1014773059-project-member] http://10.27.203.238/share/v2/d1d71dc9f23c4c6a8e146d99ad65ebb2/shares/b05a8999-f1ac-4887-a675-3c2ca8e9cece returned with HTTP 202 May 28 13:02:37 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1253/2527] 10.27.203.238 () {64 vars in 1454 bytes} [Tue May 28 13:02:37 2024] DELETE /share/v2/d1d71dc9f23c4c6a8e146d99ad65ebb2/shares/b05a8999-f1ac-4887-a675-3c2ca8e9cece => generated 0 bytes in 119 msecs (HTTP/1.1 202) 6 headers in 243 bytes (2 switches on core 0) May 28 13:02:37 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-3495c0c3-d5c2-4427-92c7-9f359ef1cb2e tempest-ShareNetworksNegativeTest-1968817504 tempest-ShareNetworksNegativeTest-1968817504-project-member] http://10.27.203.238/share/v1/2b4510239ee64b778ccf03533fdcdc5a/share-networks returned with HTTP 200 May 28 13:02:37 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1275/2528] 10.27.203.238 () {64 vars in 1343 bytes} [Tue May 28 13:02:37 2024] POST /share/v1/2b4510239ee64b778ccf03533fdcdc5a/share-networks => generated 461 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 230 bytes (2 switches on core 0) May 28 13:02:37 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-4d7b5ab8-e6db-4064-b129-c5712d064c3c tempest-SharesNegativeTest-1014773059 tempest-SharesNegativeTest-1014773059-project-member] GET http://10.27.203.238/share/v2/d1d71dc9f23c4c6a8e146d99ad65ebb2/shares/b05a8999-f1ac-4887-a675-3c2ca8e9cece May 28 13:02:37 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-4d7b5ab8-e6db-4064-b129-c5712d064c3c tempest-SharesNegativeTest-1014773059 tempest-SharesNegativeTest-1014773059-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:02:37 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-4d7b5ab8-e6db-4064-b129-c5712d064c3c tempest-SharesNegativeTest-1014773059 tempest-SharesNegativeTest-1014773059-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:02:37 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-1e79fc2c-25ce-43eb-a354-f2c8964a861c tempest-ShareNetworksNegativeTest-1968817504 tempest-ShareNetworksNegativeTest-1968817504-project-member] DELETE http://10.27.203.238/share/v1/2b4510239ee64b778ccf03533fdcdc5a/share-networks/3ca14220-3b53-4f48-bcf5-64d3c6b927c8 May 28 13:02:37 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-1e79fc2c-25ce-43eb-a354-f2c8964a861c tempest-ShareNetworksNegativeTest-1968817504 tempest-ShareNetworksNegativeTest-1968817504-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:02:37 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-1e79fc2c-25ce-43eb-a354-f2c8964a861c tempest-ShareNetworksNegativeTest-1968817504 tempest-ShareNetworksNegativeTest-1968817504-project-member] Calling method 'ShareNetworkController.delete' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:02:37 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-4d7b5ab8-e6db-4064-b129-c5712d064c3c tempest-SharesNegativeTest-1014773059 tempest-SharesNegativeTest-1014773059-project-member] http://10.27.203.238/share/v2/d1d71dc9f23c4c6a8e146d99ad65ebb2/shares/b05a8999-f1ac-4887-a675-3c2ca8e9cece returned with HTTP 200 May 28 13:02:37 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1254/2529] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:02:37 2024] GET /share/v2/d1d71dc9f23c4c6a8e146d99ad65ebb2/shares/b05a8999-f1ac-4887-a675-3c2ca8e9cece => generated 1314 bytes in 24 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:02:37 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-93b28755-7e81-4995-8892-12b84a143ba4 tempest-SharesNegativeTest-1014773059 None] Acquiring lock "locked_access_rules_operation_by_share_instance_27c3f247-5cdb-4bb3-9479-7b3253f9df42" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:02:37 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-93b28755-7e81-4995-8892-12b84a143ba4 tempest-SharesNegativeTest-1014773059 None] Lock "locked_access_rules_operation_by_share_instance_27c3f247-5cdb-4bb3-9479-7b3253f9df42" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:02:37 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-93b28755-7e81-4995-8892-12b84a143ba4 tempest-SharesNegativeTest-1014773059 None] Lock "locked_access_rules_operation_by_share_instance_27c3f247-5cdb-4bb3-9479-7b3253f9df42" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:02:37 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-93b28755-7e81-4995-8892-12b84a143ba4 tempest-SharesNegativeTest-1014773059 None] Acquiring lock "locked_access_rules_operation_by_share_instance_27c3f247-5cdb-4bb3-9479-7b3253f9df42" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:02:37 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-93b28755-7e81-4995-8892-12b84a143ba4 tempest-SharesNegativeTest-1014773059 None] Lock "locked_access_rules_operation_by_share_instance_27c3f247-5cdb-4bb3-9479-7b3253f9df42" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:02:37 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-93b28755-7e81-4995-8892-12b84a143ba4 tempest-SharesNegativeTest-1014773059 None] Lock "locked_access_rules_operation_by_share_instance_27c3f247-5cdb-4bb3-9479-7b3253f9df42" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:02:37 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-93b28755-7e81-4995-8892-12b84a143ba4 tempest-SharesNegativeTest-1014773059 None] Acquiring lock "locked_access_rules_operation_by_share_instance_27c3f247-5cdb-4bb3-9479-7b3253f9df42" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:02:37 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-93b28755-7e81-4995-8892-12b84a143ba4 tempest-SharesNegativeTest-1014773059 None] Lock "locked_access_rules_operation_by_share_instance_27c3f247-5cdb-4bb3-9479-7b3253f9df42" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:02:37 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-93b28755-7e81-4995-8892-12b84a143ba4 tempest-SharesNegativeTest-1014773059 None] Lock "locked_access_rules_operation_by_share_instance_27c3f247-5cdb-4bb3-9479-7b3253f9df42" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:02:37 l75lg1-v1 manila-share[98474]: DEBUG manila.share.access [None req-93b28755-7e81-4995-8892-12b84a143ba4 tempest-SharesNegativeTest-1014773059 None] All access rules have been synced for share instance 27c3f247-5cdb-4bb3-9479-7b3253f9df42 belonging to share b05a8999-f1ac-4887-a675-3c2ca8e9cece. {{(pid=98474) update_access_rules /opt/stack/manila/manila/share/access.py:304}} May 28 13:02:37 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-93b28755-7e81-4995-8892-12b84a143ba4 tempest-SharesNegativeTest-1014773059 None] deleting '/manila/manila-27c3f247-5cdb-4bb3-9479-7b3253f9df42' May 28 13:02:37 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-93b28755-7e81-4995-8892-12b84a143ba4 tempest-SharesNegativeTest-1014773059 None] >>> [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/ May 28 13:02:37 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-93b28755-7e81-4995-8892-12b84a143ba4 tempest-SharesNegativeTest-1014773059 None] {'data': '{"path": "/manila/manila-27c3f247-5cdb-4bb3-9479-7b3253f9df42"}', May 28 13:02:37 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-93b28755-7e81-4995-8892-12b84a143ba4 tempest-SharesNegativeTest-1014773059 None] 'params': None} May 28 13:02:37 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.quota [None req-1e79fc2c-25ce-43eb-a354-f2c8964a861c tempest-ShareNetworksNegativeTest-1968817504 tempest-ShareNetworksNegativeTest-1968817504-project-member] Created reservations ['609c8bc0-402f-4eb2-8d50-58974e86fd1c'] {{(pid=98329) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 13:02:37 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.quota [None req-1e79fc2c-25ce-43eb-a354-f2c8964a861c tempest-ShareNetworksNegativeTest-1968817504 tempest-ShareNetworksNegativeTest-1968817504-project-member] Committed reservations ['609c8bc0-402f-4eb2-8d50-58974e86fd1c'] {{(pid=98329) commit /opt/stack/manila/manila/quota.py:1063}} May 28 13:02:37 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-1e79fc2c-25ce-43eb-a354-f2c8964a861c tempest-ShareNetworksNegativeTest-1968817504 tempest-ShareNetworksNegativeTest-1968817504-project-member] http://10.27.203.238/share/v1/2b4510239ee64b778ccf03533fdcdc5a/share-networks/3ca14220-3b53-4f48-bcf5-64d3c6b927c8 returned with HTTP 202 May 28 13:02:37 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1276/2530] 10.27.203.238 () {62 vars in 1435 bytes} [Tue May 28 13:02:37 2024] DELETE /share/v1/2b4510239ee64b778ccf03533fdcdc5a/share-networks/3ca14220-3b53-4f48-bcf5-64d3c6b927c8 => generated 0 bytes in 118 msecs (HTTP/1.1 202) 6 headers in 242 bytes (2 switches on core 0) May 28 13:02:37 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-c35ef0df-826b-4193-a8e2-730fd2787d28 tempest-ShareNetworksNegativeTest-1968817504 tempest-ShareNetworksNegativeTest-1968817504-project-member] GET http://10.27.203.238/share/v1/2b4510239ee64b778ccf03533fdcdc5a/security-services/3ca14220-3b53-4f48-bcf5-64d3c6b927c8 May 28 13:02:37 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-c35ef0df-826b-4193-a8e2-730fd2787d28 tempest-ShareNetworksNegativeTest-1968817504 tempest-ShareNetworksNegativeTest-1968817504-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:02:37 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-c35ef0df-826b-4193-a8e2-730fd2787d28 tempest-ShareNetworksNegativeTest-1968817504 tempest-ShareNetworksNegativeTest-1968817504-project-member] Calling method 'SecurityServiceController.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:02:37 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-c35ef0df-826b-4193-a8e2-730fd2787d28 tempest-ShareNetworksNegativeTest-1968817504 tempest-ShareNetworksNegativeTest-1968817504-project-member] HTTP exception thrown: The resource could not be found. May 28 13:02:37 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-c35ef0df-826b-4193-a8e2-730fd2787d28 tempest-ShareNetworksNegativeTest-1968817504 tempest-ShareNetworksNegativeTest-1968817504-project-member] http://10.27.203.238/share/v1/2b4510239ee64b778ccf03533fdcdc5a/security-services/3ca14220-3b53-4f48-bcf5-64d3c6b927c8 returned with HTTP 404 May 28 13:02:37 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1255/2531] 10.27.203.238 () {62 vars in 1441 bytes} [Tue May 28 13:02:37 2024] GET /share/v1/2b4510239ee64b778ccf03533fdcdc5a/security-services/3ca14220-3b53-4f48-bcf5-64d3c6b927c8 => generated 78 bytes in 8 msecs (HTTP/1.1 404) 6 headers in 236 bytes (1 switches on core 0) May 28 13:02:37 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-c549ccf9-12de-493c-8eae-bc9cb4514c39 tempest-ShareNetworksNegativeTest-1968817504 tempest-ShareNetworksNegativeTest-1968817504-project-member] DELETE http://10.27.203.238/share/v1/2b4510239ee64b778ccf03533fdcdc5a/share-networks/3ca14220-3b53-4f48-bcf5-64d3c6b927c8 May 28 13:02:37 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-c549ccf9-12de-493c-8eae-bc9cb4514c39 tempest-ShareNetworksNegativeTest-1968817504 tempest-ShareNetworksNegativeTest-1968817504-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:02:37 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-c549ccf9-12de-493c-8eae-bc9cb4514c39 tempest-ShareNetworksNegativeTest-1968817504 tempest-ShareNetworksNegativeTest-1968817504-project-member] Calling method 'ShareNetworkController.delete' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:02:37 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-c549ccf9-12de-493c-8eae-bc9cb4514c39 tempest-ShareNetworksNegativeTest-1968817504 tempest-ShareNetworksNegativeTest-1968817504-project-member] HTTP exception thrown: Share network 3ca14220-3b53-4f48-bcf5-64d3c6b927c8 could not be found. May 28 13:02:37 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-c549ccf9-12de-493c-8eae-bc9cb4514c39 tempest-ShareNetworksNegativeTest-1968817504 tempest-ShareNetworksNegativeTest-1968817504-project-member] http://10.27.203.238/share/v1/2b4510239ee64b778ccf03533fdcdc5a/share-networks/3ca14220-3b53-4f48-bcf5-64d3c6b927c8 returned with HTTP 404 May 28 13:02:37 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1277/2532] 10.27.203.238 () {62 vars in 1435 bytes} [Tue May 28 13:02:37 2024] DELETE /share/v1/2b4510239ee64b778ccf03533fdcdc5a/share-networks/3ca14220-3b53-4f48-bcf5-64d3c6b927c8 => generated 116 bytes in 18 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 13:02:37 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-aacd7857-e963-474d-8175-fb4ee3402e55 tempest-ShareNetworksNegativeTest-1968817504 tempest-ShareNetworksNegativeTest-1968817504-project-member] GET http://10.27.203.238/share/v1/2b4510239ee64b778ccf03533fdcdc5a/share-networks/wrong_id May 28 13:02:37 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-aacd7857-e963-474d-8175-fb4ee3402e55 tempest-ShareNetworksNegativeTest-1968817504 tempest-ShareNetworksNegativeTest-1968817504-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:02:37 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-aacd7857-e963-474d-8175-fb4ee3402e55 tempest-ShareNetworksNegativeTest-1968817504 tempest-ShareNetworksNegativeTest-1968817504-project-member] Calling method 'ShareNetworkController.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:02:37 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-93b28755-7e81-4995-8892-12b84a143ba4 tempest-SharesNegativeTest-1014773059 None] <<< [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/ May 28 13:02:37 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-93b28755-7e81-4995-8892-12b84a143ba4 tempest-SharesNegativeTest-1014773059 None] 'OK' May 28 13:02:37 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-93b28755-7e81-4995-8892-12b84a143ba4 tempest-SharesNegativeTest-1014773059 None] --- [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/: Done May 28 13:02:37 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-93b28755-7e81-4995-8892-12b84a143ba4 tempest-SharesNegativeTest-1014773059 None] >>> [GET] https://127.0.0.1:40443/api/views/ May 28 13:02:37 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-93b28755-7e81-4995-8892-12b84a143ba4 tempest-SharesNegativeTest-1014773059 None] {'allow_redirects': True, May 28 13:02:37 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-93b28755-7e81-4995-8892-12b84a143ba4 tempest-SharesNegativeTest-1014773059 None] 'params': {'name': '27c3f247-5cdb-4bb3-9479-7b3253f9df42'}} May 28 13:02:37 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-aacd7857-e963-474d-8175-fb4ee3402e55 tempest-ShareNetworksNegativeTest-1968817504 tempest-ShareNetworksNegativeTest-1968817504-project-member] HTTP exception thrown: Share network wrong_id could not be found. May 28 13:02:37 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-aacd7857-e963-474d-8175-fb4ee3402e55 tempest-ShareNetworksNegativeTest-1968817504 tempest-ShareNetworksNegativeTest-1968817504-project-member] http://10.27.203.238/share/v1/2b4510239ee64b778ccf03533fdcdc5a/share-networks/wrong_id returned with HTTP 404 May 28 13:02:37 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1256/2533] 10.27.203.238 () {62 vars in 1348 bytes} [Tue May 28 13:02:37 2024] GET /share/v1/2b4510239ee64b778ccf03533fdcdc5a/share-networks/wrong_id => generated 88 bytes in 17 msecs (HTTP/1.1 404) 6 headers in 236 bytes (1 switches on core 0) May 28 13:02:37 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1278/2534] 10.27.203.238 () {62 vars in 1324 bytes} [Tue May 28 13:02:37 2024] GET /share/v1/2b4510239ee64b778ccf03533fdcdc5a/share-networks/ => generated 112 bytes in 3 msecs (HTTP/1.1 404) 3 headers in 98 bytes (1 switches on core 0) May 28 13:02:37 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-9a6f4eaf-4fbf-4305-8637-84f6cd85f673 tempest-ShareNetworksNegativeTest-1968817504 tempest-ShareNetworksNegativeTest-1968817504-project-member] GET http://10.27.203.238/share/v1/2b4510239ee64b778ccf03533fdcdc5a/share-networks/detail?created_before=2014-10-23T08%3A31%3A58.000000 May 28 13:02:37 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-9a6f4eaf-4fbf-4305-8637-84f6cd85f673 tempest-ShareNetworksNegativeTest-1968817504 tempest-ShareNetworksNegativeTest-1968817504-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:02:37 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-9a6f4eaf-4fbf-4305-8637-84f6cd85f673 tempest-ShareNetworksNegativeTest-1968817504 tempest-ShareNetworksNegativeTest-1968817504-project-member] Calling method 'ShareNetworkController.detail' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:02:37 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-9a6f4eaf-4fbf-4305-8637-84f6cd85f673 tempest-ShareNetworksNegativeTest-1968817504 tempest-ShareNetworksNegativeTest-1968817504-project-member] HTTP exception thrown: 2014-10-23T08:31:58.000000 is not in yyyy-mm-dd format. May 28 13:02:37 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-9a6f4eaf-4fbf-4305-8637-84f6cd85f673 tempest-ShareNetworksNegativeTest-1968817504 tempest-ShareNetworksNegativeTest-1968817504-project-member] http://10.27.203.238/share/v1/2b4510239ee64b778ccf03533fdcdc5a/share-networks/detail?created_before=2014-10-23T08%3A31%3A58.000000 returned with HTTP 400 May 28 13:02:37 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1257/2535] 10.27.203.238 () {62 vars in 1433 bytes} [Tue May 28 13:02:37 2024] GET /share/v1/2b4510239ee64b778ccf03533fdcdc5a/share-networks/detail?created_before=2014-10-23T08%3A31%3A58.000000 => generated 99 bytes in 7 msecs (HTTP/1.1 400) 6 headers in 238 bytes (1 switches on core 0) May 28 13:02:37 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-d19ac70d-8415-48a7-a954-cb3e0de229ac tempest-ShareNetworksNegativeTest-1968817504 tempest-ShareNetworksNegativeTest-1968817504-project-member] GET http://10.27.203.238/share/v1/2b4510239ee64b778ccf03533fdcdc5a/share-networks/detail?created_since=2014-10-23T08%3A31%3A58.000000 May 28 13:02:37 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-d19ac70d-8415-48a7-a954-cb3e0de229ac tempest-ShareNetworksNegativeTest-1968817504 tempest-ShareNetworksNegativeTest-1968817504-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:02:37 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-d19ac70d-8415-48a7-a954-cb3e0de229ac tempest-ShareNetworksNegativeTest-1968817504 tempest-ShareNetworksNegativeTest-1968817504-project-member] Calling method 'ShareNetworkController.detail' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:02:37 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-d19ac70d-8415-48a7-a954-cb3e0de229ac tempest-ShareNetworksNegativeTest-1968817504 tempest-ShareNetworksNegativeTest-1968817504-project-member] HTTP exception thrown: 2014-10-23T08:31:58.000000 is not in yyyy-mm-dd format. May 28 13:02:37 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-d19ac70d-8415-48a7-a954-cb3e0de229ac tempest-ShareNetworksNegativeTest-1968817504 tempest-ShareNetworksNegativeTest-1968817504-project-member] http://10.27.203.238/share/v1/2b4510239ee64b778ccf03533fdcdc5a/share-networks/detail?created_since=2014-10-23T08%3A31%3A58.000000 returned with HTTP 400 May 28 13:02:37 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1279/2536] 10.27.203.238 () {62 vars in 1431 bytes} [Tue May 28 13:02:37 2024] GET /share/v1/2b4510239ee64b778ccf03533fdcdc5a/share-networks/detail?created_since=2014-10-23T08%3A31%3A58.000000 => generated 99 bytes in 6 msecs (HTTP/1.1 400) 6 headers in 238 bytes (1 switches on core 0) May 28 13:02:37 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-a5238980-817c-43e4-867a-63fbfb257fa2 tempest-ShareNetworksNegativeTest-1968817504 tempest-ShareNetworksNegativeTest-1968817504-project-member] PUT http://10.27.203.238/share/v1/2b4510239ee64b778ccf03533fdcdc5a/share-networks/wrong_id May 28 13:02:37 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-a5238980-817c-43e4-867a-63fbfb257fa2 tempest-ShareNetworksNegativeTest-1968817504 tempest-ShareNetworksNegativeTest-1968817504-project-member] Action: 'update', calling method: ShareNetworkController.update, body: {"share_network": {"name": "name"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:02:37 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-a5238980-817c-43e4-867a-63fbfb257fa2 tempest-ShareNetworksNegativeTest-1968817504 tempest-ShareNetworksNegativeTest-1968817504-project-member] HTTP exception thrown: Share network wrong_id could not be found. May 28 13:02:37 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-a5238980-817c-43e4-867a-63fbfb257fa2 tempest-ShareNetworksNegativeTest-1968817504 tempest-ShareNetworksNegativeTest-1968817504-project-member] http://10.27.203.238/share/v1/2b4510239ee64b778ccf03533fdcdc5a/share-networks/wrong_id returned with HTTP 404 May 28 13:02:37 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1258/2537] 10.27.203.238 () {64 vars in 1368 bytes} [Tue May 28 13:02:37 2024] PUT /share/v1/2b4510239ee64b778ccf03533fdcdc5a/share-networks/wrong_id => generated 88 bytes in 17 msecs (HTTP/1.1 404) 6 headers in 236 bytes (1 switches on core 0) May 28 13:02:37 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1280/2538] 10.27.203.238 () {64 vars in 1344 bytes} [Tue May 28 13:02:37 2024] PUT /share/v1/2b4510239ee64b778ccf03533fdcdc5a/share-networks/ => generated 112 bytes in 3 msecs (HTTP/1.1 404) 3 headers in 98 bytes (1 switches on core 0) May 28 13:02:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30eed30-3b33-465a-8c0d-a31579047b3f service manila] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30eed30-3b33-465a-8c0d-a31579047b3f service manila] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a31f8c-6550-44c4-bc5a-968b1b8f9cfd tempest-ShareNetworksNegativeTest-78679599 tempest-ShareNetworksNegativeTest-78679599-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4598171c386c4a6fb583671b4f73048d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c48d21d9f59840ffa7b0169aaac01da7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a31f8c-6550-44c4-bc5a-968b1b8f9cfd tempest-ShareNetworksNegativeTest-78679599 tempest-ShareNetworksNegativeTest-78679599-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a31f8c-6550-44c4-bc5a-968b1b8f9cfd tempest-ShareNetworksNegativeTest-78679599 tempest-ShareNetworksNegativeTest-78679599-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a31f8c-6550-44c4-bc5a-968b1b8f9cfd tempest-ShareNetworksNegativeTest-78679599 tempest-ShareNetworksNegativeTest-78679599-project-admin] PATH_INFO: `/v3/users/8688f80695814f34bfb56342c4e54028` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a31f8c-6550-44c4-bc5a-968b1b8f9cfd tempest-ShareNetworksNegativeTest-78679599 tempest-ShareNetworksNegativeTest-78679599-project-admin] RBAC: Authorizing `identity:delete_user(user_id=8688f80695814f34bfb56342c4e54028)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a31f8c-6550-44c4-bc5a-968b1b8f9cfd tempest-ShareNetworksNegativeTest-78679599 tempest-ShareNetworksNegativeTest-78679599-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:37 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-15a31f8c-6550-44c4-bc5a-968b1b8f9cfd tempest-ShareNetworksNegativeTest-78679599 tempest-ShareNetworksNegativeTest-78679599-project-admin] Could not find user: 8688f80695814f34bfb56342c4e54028.: keystone.exception.UserNotFound: Could not find user: 8688f80695814f34bfb56342c4e54028. May 28 13:02:37 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:02:37 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:02:37 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:02:37 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:02:37 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:02:37 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:02:37 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:02:37 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:02:37 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:02:37 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:02:37 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:02:37 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:02:37 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:02:37 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:37 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:37 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:37 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:37 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:37 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:37 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:02:37 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:02:37 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:37 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:37 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:37 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:37 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:37 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:37 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:02:37 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:02:37 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:02:37 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:02:37 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:02:37 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 13:02:37 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:02:37 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 13:02:37 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:02:37 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:02:37 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:02:37 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 13:02:37 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:02:37 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 13:02:37 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:02:37 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:02:37 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:02:37 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:02:37 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:02:37 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:02:37 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 8688f80695814f34bfb56342c4e54028. May 28 13:02:37 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 13:02:37 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1760/3491] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:02:37 2024] DELETE /identity/v3/users/8688f80695814f34bfb56342c4e54028 => generated 110 bytes in 23 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:02:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f192453a-d633-48d7-8ab2-31d9c9687d06 service manila] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f192453a-d633-48d7-8ab2-31d9c9687d06 service manila] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9edb283-ce38-4b4c-a218-001dbc7859a6 tempest-ShareNetworksNegativeTest-78679599 tempest-ShareNetworksNegativeTest-78679599-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4598171c386c4a6fb583671b4f73048d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c48d21d9f59840ffa7b0169aaac01da7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9edb283-ce38-4b4c-a218-001dbc7859a6 tempest-ShareNetworksNegativeTest-78679599 tempest-ShareNetworksNegativeTest-78679599-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9edb283-ce38-4b4c-a218-001dbc7859a6 tempest-ShareNetworksNegativeTest-78679599 tempest-ShareNetworksNegativeTest-78679599-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9edb283-ce38-4b4c-a218-001dbc7859a6 tempest-ShareNetworksNegativeTest-78679599 tempest-ShareNetworksNegativeTest-78679599-project-admin] PATH_INFO: `/v3/users/108a25e436e9452a9a865957dcea1fc5` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG dbcounter [-] [51266] Writing DB stats keystone:SELECT=1791,keystone:DELETE=278,keystone:INSERT=87 {{(pid=51266) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:02:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9edb283-ce38-4b4c-a218-001dbc7859a6 tempest-ShareNetworksNegativeTest-78679599 tempest-ShareNetworksNegativeTest-78679599-project-admin] RBAC: Authorizing `identity:delete_user(user_id=108a25e436e9452a9a865957dcea1fc5)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:37 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9edb283-ce38-4b4c-a218-001dbc7859a6 tempest-ShareNetworksNegativeTest-78679599 tempest-ShareNetworksNegativeTest-78679599-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:37 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-f9edb283-ce38-4b4c-a218-001dbc7859a6 tempest-ShareNetworksNegativeTest-78679599 tempest-ShareNetworksNegativeTest-78679599-project-admin] Could not find user: 108a25e436e9452a9a865957dcea1fc5.: keystone.exception.UserNotFound: Could not find user: 108a25e436e9452a9a865957dcea1fc5. May 28 13:02:37 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:02:37 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:02:37 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:02:37 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:02:37 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:02:37 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:02:37 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:02:37 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:02:37 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:02:37 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:02:37 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:02:37 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:02:37 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:02:37 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:37 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:37 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:37 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:37 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:37 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:37 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:02:37 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:02:37 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:37 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:37 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:37 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:37 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:37 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:37 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:02:37 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:02:37 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:02:37 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:02:37 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:02:37 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 13:02:37 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:02:37 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 13:02:37 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:02:37 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:02:37 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:02:37 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 13:02:37 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:02:37 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 13:02:37 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:02:37 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:02:37 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:02:37 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:02:37 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:02:37 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:02:37 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 108a25e436e9452a9a865957dcea1fc5. May 28 13:02:37 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 13:02:37 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1732/3492] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:02:37 2024] DELETE /identity/v3/users/108a25e436e9452a9a865957dcea1fc5 => generated 110 bytes in 26 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:02:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a31f8c-6550-44c4-bc5a-968b1b8f9cfd tempest-ShareNetworksNegativeTest-78679599 tempest-ShareNetworksNegativeTest-78679599-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a31f8c-6550-44c4-bc5a-968b1b8f9cfd tempest-ShareNetworksNegativeTest-78679599 tempest-ShareNetworksNegativeTest-78679599-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c48df1b-1064-4ba2-8a42-bc7174a47167 tempest-ShareNetworksNegativeTest-78679599 tempest-ShareNetworksNegativeTest-78679599-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4598171c386c4a6fb583671b4f73048d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c48d21d9f59840ffa7b0169aaac01da7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c48df1b-1064-4ba2-8a42-bc7174a47167 tempest-ShareNetworksNegativeTest-78679599 tempest-ShareNetworksNegativeTest-78679599-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c48df1b-1064-4ba2-8a42-bc7174a47167 tempest-ShareNetworksNegativeTest-78679599 tempest-ShareNetworksNegativeTest-78679599-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c48df1b-1064-4ba2-8a42-bc7174a47167 tempest-ShareNetworksNegativeTest-78679599 tempest-ShareNetworksNegativeTest-78679599-project-admin] PATH_INFO: `/v3/users/5ae5cb1db3504baaba1df93dc154a004` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c48df1b-1064-4ba2-8a42-bc7174a47167 tempest-ShareNetworksNegativeTest-78679599 tempest-ShareNetworksNegativeTest-78679599-project-admin] RBAC: Authorizing `identity:delete_user(user_id=5ae5cb1db3504baaba1df93dc154a004)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:37 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c48df1b-1064-4ba2-8a42-bc7174a47167 tempest-ShareNetworksNegativeTest-78679599 tempest-ShareNetworksNegativeTest-78679599-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-8c48df1b-1064-4ba2-8a42-bc7174a47167 tempest-ShareNetworksNegativeTest-78679599 tempest-ShareNetworksNegativeTest-78679599-project-admin] Could not find user: 5ae5cb1db3504baaba1df93dc154a004.: keystone.exception.UserNotFound: Could not find user: 5ae5cb1db3504baaba1df93dc154a004. May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 5ae5cb1db3504baaba1df93dc154a004. May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1761/3493] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:02:37 2024] DELETE /identity/v3/users/5ae5cb1db3504baaba1df93dc154a004 => generated 110 bytes in 23 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9edb283-ce38-4b4c-a218-001dbc7859a6 tempest-ShareNetworksNegativeTest-78679599 tempest-ShareNetworksNegativeTest-78679599-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9edb283-ce38-4b4c-a218-001dbc7859a6 tempest-ShareNetworksNegativeTest-78679599 tempest-ShareNetworksNegativeTest-78679599-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1414739e-7e80-492f-974e-2c801f7eafb4 tempest-ShareNetworksNegativeTest-78679599 tempest-ShareNetworksNegativeTest-78679599-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4598171c386c4a6fb583671b4f73048d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c48d21d9f59840ffa7b0169aaac01da7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1414739e-7e80-492f-974e-2c801f7eafb4 tempest-ShareNetworksNegativeTest-78679599 tempest-ShareNetworksNegativeTest-78679599-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1414739e-7e80-492f-974e-2c801f7eafb4 tempest-ShareNetworksNegativeTest-78679599 tempest-ShareNetworksNegativeTest-78679599-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1414739e-7e80-492f-974e-2c801f7eafb4 tempest-ShareNetworksNegativeTest-78679599 tempest-ShareNetworksNegativeTest-78679599-project-admin] PATH_INFO: `/v3/users/c2ac6ca3ea5a4ae498df6d12bb7caadc` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1414739e-7e80-492f-974e-2c801f7eafb4 tempest-ShareNetworksNegativeTest-78679599 tempest-ShareNetworksNegativeTest-78679599-project-admin] RBAC: Authorizing `identity:delete_user(user_id=c2ac6ca3ea5a4ae498df6d12bb7caadc)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1414739e-7e80-492f-974e-2c801f7eafb4 tempest-ShareNetworksNegativeTest-78679599 tempest-ShareNetworksNegativeTest-78679599-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-1414739e-7e80-492f-974e-2c801f7eafb4 tempest-ShareNetworksNegativeTest-78679599 tempest-ShareNetworksNegativeTest-78679599-project-admin] Could not find user: c2ac6ca3ea5a4ae498df6d12bb7caadc.: keystone.exception.UserNotFound: Could not find user: c2ac6ca3ea5a4ae498df6d12bb7caadc. May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: c2ac6ca3ea5a4ae498df6d12bb7caadc. May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1733/3494] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:02:38 2024] DELETE /identity/v3/users/c2ac6ca3ea5a4ae498df6d12bb7caadc => generated 110 bytes in 27 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c48df1b-1064-4ba2-8a42-bc7174a47167 tempest-ShareNetworksNegativeTest-78679599 tempest-ShareNetworksNegativeTest-78679599-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c48df1b-1064-4ba2-8a42-bc7174a47167 tempest-ShareNetworksNegativeTest-78679599 tempest-ShareNetworksNegativeTest-78679599-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab44c92-1f35-40a6-843b-5f256c2b1b65 tempest-ShareNetworksNegativeTest-78679599 tempest-ShareNetworksNegativeTest-78679599-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4598171c386c4a6fb583671b4f73048d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c48d21d9f59840ffa7b0169aaac01da7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab44c92-1f35-40a6-843b-5f256c2b1b65 tempest-ShareNetworksNegativeTest-78679599 tempest-ShareNetworksNegativeTest-78679599-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab44c92-1f35-40a6-843b-5f256c2b1b65 tempest-ShareNetworksNegativeTest-78679599 tempest-ShareNetworksNegativeTest-78679599-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab44c92-1f35-40a6-843b-5f256c2b1b65 tempest-ShareNetworksNegativeTest-78679599 tempest-ShareNetworksNegativeTest-78679599-project-admin] PATH_INFO: `/v3/users/f89f851af36d480ab7d10d3506c60899` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab44c92-1f35-40a6-843b-5f256c2b1b65 tempest-ShareNetworksNegativeTest-78679599 tempest-ShareNetworksNegativeTest-78679599-project-admin] RBAC: Authorizing `identity:delete_user(user_id=f89f851af36d480ab7d10d3506c60899)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab44c92-1f35-40a6-843b-5f256c2b1b65 tempest-ShareNetworksNegativeTest-78679599 tempest-ShareNetworksNegativeTest-78679599-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-4ab44c92-1f35-40a6-843b-5f256c2b1b65 tempest-ShareNetworksNegativeTest-78679599 tempest-ShareNetworksNegativeTest-78679599-project-admin] Could not find user: f89f851af36d480ab7d10d3506c60899.: keystone.exception.UserNotFound: Could not find user: f89f851af36d480ab7d10d3506c60899. May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: f89f851af36d480ab7d10d3506c60899. May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1762/3495] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:02:38 2024] DELETE /identity/v3/users/f89f851af36d480ab7d10d3506c60899 => generated 110 bytes in 24 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1414739e-7e80-492f-974e-2c801f7eafb4 tempest-ShareNetworksNegativeTest-78679599 tempest-ShareNetworksNegativeTest-78679599-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1414739e-7e80-492f-974e-2c801f7eafb4 tempest-ShareNetworksNegativeTest-78679599 tempest-ShareNetworksNegativeTest-78679599-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293084c4-9504-4263-99cd-8051aae2a40b tempest-ShareNetworksNegativeTest-78679599 tempest-ShareNetworksNegativeTest-78679599-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4598171c386c4a6fb583671b4f73048d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c48d21d9f59840ffa7b0169aaac01da7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293084c4-9504-4263-99cd-8051aae2a40b tempest-ShareNetworksNegativeTest-78679599 tempest-ShareNetworksNegativeTest-78679599-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293084c4-9504-4263-99cd-8051aae2a40b tempest-ShareNetworksNegativeTest-78679599 tempest-ShareNetworksNegativeTest-78679599-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293084c4-9504-4263-99cd-8051aae2a40b tempest-ShareNetworksNegativeTest-78679599 tempest-ShareNetworksNegativeTest-78679599-project-admin] PATH_INFO: `/v3/users/6886717a9cfb42a0a4142a0b982570ee` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293084c4-9504-4263-99cd-8051aae2a40b tempest-ShareNetworksNegativeTest-78679599 tempest-ShareNetworksNegativeTest-78679599-project-admin] RBAC: Authorizing `identity:delete_user(user_id=6886717a9cfb42a0a4142a0b982570ee)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293084c4-9504-4263-99cd-8051aae2a40b tempest-ShareNetworksNegativeTest-78679599 tempest-ShareNetworksNegativeTest-78679599-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-293084c4-9504-4263-99cd-8051aae2a40b tempest-ShareNetworksNegativeTest-78679599 tempest-ShareNetworksNegativeTest-78679599-project-admin] Could not find user: 6886717a9cfb42a0a4142a0b982570ee.: keystone.exception.UserNotFound: Could not find user: 6886717a9cfb42a0a4142a0b982570ee. May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 6886717a9cfb42a0a4142a0b982570ee. May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1734/3496] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:02:38 2024] DELETE /identity/v3/users/6886717a9cfb42a0a4142a0b982570ee => generated 110 bytes in 24 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab44c92-1f35-40a6-843b-5f256c2b1b65 tempest-ShareNetworksNegativeTest-78679599 tempest-ShareNetworksNegativeTest-78679599-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab44c92-1f35-40a6-843b-5f256c2b1b65 tempest-ShareNetworksNegativeTest-78679599 tempest-ShareNetworksNegativeTest-78679599-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef59f7c-31c4-4db1-8a69-7df157bd128f tempest-ShareNetworksNegativeTest-78679599 tempest-ShareNetworksNegativeTest-78679599-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4598171c386c4a6fb583671b4f73048d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c48d21d9f59840ffa7b0169aaac01da7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef59f7c-31c4-4db1-8a69-7df157bd128f tempest-ShareNetworksNegativeTest-78679599 tempest-ShareNetworksNegativeTest-78679599-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef59f7c-31c4-4db1-8a69-7df157bd128f tempest-ShareNetworksNegativeTest-78679599 tempest-ShareNetworksNegativeTest-78679599-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef59f7c-31c4-4db1-8a69-7df157bd128f tempest-ShareNetworksNegativeTest-78679599 tempest-ShareNetworksNegativeTest-78679599-project-admin] PATH_INFO: `/v3/users/b523155e680a4a14acd4f3a4295a8d26` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef59f7c-31c4-4db1-8a69-7df157bd128f tempest-ShareNetworksNegativeTest-78679599 tempest-ShareNetworksNegativeTest-78679599-project-admin] RBAC: Authorizing `identity:delete_user(user_id=b523155e680a4a14acd4f3a4295a8d26)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef59f7c-31c4-4db1-8a69-7df157bd128f tempest-ShareNetworksNegativeTest-78679599 tempest-ShareNetworksNegativeTest-78679599-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-8ef59f7c-31c4-4db1-8a69-7df157bd128f tempest-ShareNetworksNegativeTest-78679599 tempest-ShareNetworksNegativeTest-78679599-project-admin] Could not find user: b523155e680a4a14acd4f3a4295a8d26.: keystone.exception.UserNotFound: Could not find user: b523155e680a4a14acd4f3a4295a8d26. May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: b523155e680a4a14acd4f3a4295a8d26. May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1763/3497] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:02:38 2024] DELETE /identity/v3/users/b523155e680a4a14acd4f3a4295a8d26 => generated 110 bytes in 23 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293084c4-9504-4263-99cd-8051aae2a40b tempest-ShareNetworksNegativeTest-78679599 tempest-ShareNetworksNegativeTest-78679599-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293084c4-9504-4263-99cd-8051aae2a40b tempest-ShareNetworksNegativeTest-78679599 tempest-ShareNetworksNegativeTest-78679599-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cb6e91-c71b-4bdf-a1fa-0d22dd38e8fe tempest-ShareNetworksNegativeTest-78679599 tempest-ShareNetworksNegativeTest-78679599-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4598171c386c4a6fb583671b4f73048d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c48d21d9f59840ffa7b0169aaac01da7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cb6e91-c71b-4bdf-a1fa-0d22dd38e8fe tempest-ShareNetworksNegativeTest-78679599 tempest-ShareNetworksNegativeTest-78679599-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cb6e91-c71b-4bdf-a1fa-0d22dd38e8fe tempest-ShareNetworksNegativeTest-78679599 tempest-ShareNetworksNegativeTest-78679599-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cb6e91-c71b-4bdf-a1fa-0d22dd38e8fe tempest-ShareNetworksNegativeTest-78679599 tempest-ShareNetworksNegativeTest-78679599-project-admin] PATH_INFO: `/v3/users/756070dd0b274fd8835b10a8fbe293d9` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cb6e91-c71b-4bdf-a1fa-0d22dd38e8fe tempest-ShareNetworksNegativeTest-78679599 tempest-ShareNetworksNegativeTest-78679599-project-admin] RBAC: Authorizing `identity:delete_user(user_id=756070dd0b274fd8835b10a8fbe293d9)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cb6e91-c71b-4bdf-a1fa-0d22dd38e8fe tempest-ShareNetworksNegativeTest-78679599 tempest-ShareNetworksNegativeTest-78679599-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-e5cb6e91-c71b-4bdf-a1fa-0d22dd38e8fe tempest-ShareNetworksNegativeTest-78679599 tempest-ShareNetworksNegativeTest-78679599-project-admin] Could not find user: 756070dd0b274fd8835b10a8fbe293d9.: keystone.exception.UserNotFound: Could not find user: 756070dd0b274fd8835b10a8fbe293d9. May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 756070dd0b274fd8835b10a8fbe293d9. May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1735/3498] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:02:38 2024] DELETE /identity/v3/users/756070dd0b274fd8835b10a8fbe293d9 => generated 110 bytes in 24 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef59f7c-31c4-4db1-8a69-7df157bd128f tempest-ShareNetworksNegativeTest-78679599 tempest-ShareNetworksNegativeTest-78679599-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef59f7c-31c4-4db1-8a69-7df157bd128f tempest-ShareNetworksNegativeTest-78679599 tempest-ShareNetworksNegativeTest-78679599-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b912bcf-0fbf-4c9b-a893-c47b4b5bb0e0 tempest-ShareNetworksNegativeTest-78679599 tempest-ShareNetworksNegativeTest-78679599-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4598171c386c4a6fb583671b4f73048d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c48d21d9f59840ffa7b0169aaac01da7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b912bcf-0fbf-4c9b-a893-c47b4b5bb0e0 tempest-ShareNetworksNegativeTest-78679599 tempest-ShareNetworksNegativeTest-78679599-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b912bcf-0fbf-4c9b-a893-c47b4b5bb0e0 tempest-ShareNetworksNegativeTest-78679599 tempest-ShareNetworksNegativeTest-78679599-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b912bcf-0fbf-4c9b-a893-c47b4b5bb0e0 tempest-ShareNetworksNegativeTest-78679599 tempest-ShareNetworksNegativeTest-78679599-project-admin] PATH_INFO: `/v3/users/cdf8594f55cb448e9b2312d051486331` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b912bcf-0fbf-4c9b-a893-c47b4b5bb0e0 tempest-ShareNetworksNegativeTest-78679599 tempest-ShareNetworksNegativeTest-78679599-project-admin] RBAC: Authorizing `identity:delete_user(user_id=cdf8594f55cb448e9b2312d051486331)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b912bcf-0fbf-4c9b-a893-c47b4b5bb0e0 tempest-ShareNetworksNegativeTest-78679599 tempest-ShareNetworksNegativeTest-78679599-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-2b912bcf-0fbf-4c9b-a893-c47b4b5bb0e0 tempest-ShareNetworksNegativeTest-78679599 tempest-ShareNetworksNegativeTest-78679599-project-admin] Could not find user: cdf8594f55cb448e9b2312d051486331.: keystone.exception.UserNotFound: Could not find user: cdf8594f55cb448e9b2312d051486331. May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cdf8594f55cb448e9b2312d051486331. May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1764/3499] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:02:38 2024] DELETE /identity/v3/users/cdf8594f55cb448e9b2312d051486331 => generated 110 bytes in 23 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cb6e91-c71b-4bdf-a1fa-0d22dd38e8fe tempest-ShareNetworksNegativeTest-78679599 tempest-ShareNetworksNegativeTest-78679599-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cb6e91-c71b-4bdf-a1fa-0d22dd38e8fe tempest-ShareNetworksNegativeTest-78679599 tempest-ShareNetworksNegativeTest-78679599-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8275f5d5-4fd0-4b50-a43b-515e5658e68f tempest-ShareNetworksNegativeTest-78679599 tempest-ShareNetworksNegativeTest-78679599-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4598171c386c4a6fb583671b4f73048d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c48d21d9f59840ffa7b0169aaac01da7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8275f5d5-4fd0-4b50-a43b-515e5658e68f tempest-ShareNetworksNegativeTest-78679599 tempest-ShareNetworksNegativeTest-78679599-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8275f5d5-4fd0-4b50-a43b-515e5658e68f tempest-ShareNetworksNegativeTest-78679599 tempest-ShareNetworksNegativeTest-78679599-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8275f5d5-4fd0-4b50-a43b-515e5658e68f tempest-ShareNetworksNegativeTest-78679599 tempest-ShareNetworksNegativeTest-78679599-project-admin] PATH_INFO: `/v3/users/a3784840ad6a4156929be55026b39776` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8275f5d5-4fd0-4b50-a43b-515e5658e68f tempest-ShareNetworksNegativeTest-78679599 tempest-ShareNetworksNegativeTest-78679599-project-admin] RBAC: Authorizing `identity:delete_user(user_id=a3784840ad6a4156929be55026b39776)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8275f5d5-4fd0-4b50-a43b-515e5658e68f tempest-ShareNetworksNegativeTest-78679599 tempest-ShareNetworksNegativeTest-78679599-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-8275f5d5-4fd0-4b50-a43b-515e5658e68f tempest-ShareNetworksNegativeTest-78679599 tempest-ShareNetworksNegativeTest-78679599-project-admin] Could not find user: a3784840ad6a4156929be55026b39776.: keystone.exception.UserNotFound: Could not find user: a3784840ad6a4156929be55026b39776. May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: a3784840ad6a4156929be55026b39776. May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1736/3500] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:02:38 2024] DELETE /identity/v3/users/a3784840ad6a4156929be55026b39776 => generated 110 bytes in 23 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b912bcf-0fbf-4c9b-a893-c47b4b5bb0e0 tempest-ShareNetworksNegativeTest-78679599 tempest-ShareNetworksNegativeTest-78679599-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b912bcf-0fbf-4c9b-a893-c47b4b5bb0e0 tempest-ShareNetworksNegativeTest-78679599 tempest-ShareNetworksNegativeTest-78679599-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44499956-84f0-4244-8540-1864d34ae356 tempest-ShareNetworksNegativeTest-78679599 tempest-ShareNetworksNegativeTest-78679599-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4598171c386c4a6fb583671b4f73048d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c48d21d9f59840ffa7b0169aaac01da7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44499956-84f0-4244-8540-1864d34ae356 tempest-ShareNetworksNegativeTest-78679599 tempest-ShareNetworksNegativeTest-78679599-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44499956-84f0-4244-8540-1864d34ae356 tempest-ShareNetworksNegativeTest-78679599 tempest-ShareNetworksNegativeTest-78679599-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44499956-84f0-4244-8540-1864d34ae356 tempest-ShareNetworksNegativeTest-78679599 tempest-ShareNetworksNegativeTest-78679599-project-admin] PATH_INFO: `/v3/users/93bc07dfcf2c4861981da16395bddbc0` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44499956-84f0-4244-8540-1864d34ae356 tempest-ShareNetworksNegativeTest-78679599 tempest-ShareNetworksNegativeTest-78679599-project-admin] RBAC: Authorizing `identity:delete_user(user_id=93bc07dfcf2c4861981da16395bddbc0)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44499956-84f0-4244-8540-1864d34ae356 tempest-ShareNetworksNegativeTest-78679599 tempest-ShareNetworksNegativeTest-78679599-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:38 l75lg1-v1 dstat.sh[49771]: 28-05 13:02:38| 12 2 83 3 0|5575M 1846M 278M 7925M| 20k 22k| 0 2208k| 0 286 |7850 13k|1.03 1.13 1.06|2.0 1.0 2.0| 0 0 | 0 2048M| 29 364 0 47 2 May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-44499956-84f0-4244-8540-1864d34ae356 tempest-ShareNetworksNegativeTest-78679599 tempest-ShareNetworksNegativeTest-78679599-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93bc07dfcf2c4861981da16395bddbc0', 'request_id': 'req-44499956-84f0-4244-8540-1864d34ae356'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-44499956-84f0-4244-8540-1864d34ae356 tempest-ShareNetworksNegativeTest-78679599 tempest-ShareNetworksNegativeTest-78679599-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93bc07dfcf2c4861981da16395bddbc0', 'request_id': 'req-44499956-84f0-4244-8540-1864d34ae356'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-44499956-84f0-4244-8540-1864d34ae356 tempest-ShareNetworksNegativeTest-78679599 tempest-ShareNetworksNegativeTest-78679599-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93bc07dfcf2c4861981da16395bddbc0', 'request_id': 'req-44499956-84f0-4244-8540-1864d34ae356'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-44499956-84f0-4244-8540-1864d34ae356 tempest-ShareNetworksNegativeTest-78679599 tempest-ShareNetworksNegativeTest-78679599-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93bc07dfcf2c4861981da16395bddbc0', 'request_id': 'req-44499956-84f0-4244-8540-1864d34ae356'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-44499956-84f0-4244-8540-1864d34ae356 tempest-ShareNetworksNegativeTest-78679599 tempest-ShareNetworksNegativeTest-78679599-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93bc07dfcf2c4861981da16395bddbc0', 'request_id': 'req-44499956-84f0-4244-8540-1864d34ae356'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1765/3501] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:02:38 2024] DELETE /identity/v3/users/93bc07dfcf2c4861981da16395bddbc0 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:02:38 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-326860c9-8553-49cd-ac02-c0cad005c82f tempest-ShareNetworksNegativeTest-78679599 tempest-ShareNetworksNegativeTest-78679599-project-admin] DELETE http://10.27.203.238/share/v2/c48d21d9f59840ffa7b0169aaac01da7/types/5a11620b-8a2e-4bb0-9f88-5eea29b79c1c May 28 13:02:38 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-326860c9-8553-49cd-ac02-c0cad005c82f tempest-ShareNetworksNegativeTest-78679599 tempest-ShareNetworksNegativeTest-78679599-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:02:38 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-326860c9-8553-49cd-ac02-c0cad005c82f tempest-ShareNetworksNegativeTest-78679599 tempest-ShareNetworksNegativeTest-78679599-project-admin] Calling method 'ShareTypesController._delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:02:38 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-326860c9-8553-49cd-ac02-c0cad005c82f tempest-ShareNetworksNegativeTest-78679599 tempest-ShareNetworksNegativeTest-78679599-project-admin] http://10.27.203.238/share/v2/c48d21d9f59840ffa7b0169aaac01da7/types/5a11620b-8a2e-4bb0-9f88-5eea29b79c1c returned with HTTP 202 May 28 13:02:38 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1259/2539] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:02:38 2024] DELETE /share/v2/c48d21d9f59840ffa7b0169aaac01da7/types/5a11620b-8a2e-4bb0-9f88-5eea29b79c1c => generated 0 bytes in 75 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 13:02:38 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-a4af82a2-f133-41dc-bf5f-a246aebf9f37 tempest-ShareNetworksNegativeTest-78679599 tempest-ShareNetworksNegativeTest-78679599-project-admin] GET http://10.27.203.238/share/v2/c48d21d9f59840ffa7b0169aaac01da7/types/5a11620b-8a2e-4bb0-9f88-5eea29b79c1c May 28 13:02:38 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-a4af82a2-f133-41dc-bf5f-a246aebf9f37 tempest-ShareNetworksNegativeTest-78679599 tempest-ShareNetworksNegativeTest-78679599-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:02:38 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-a4af82a2-f133-41dc-bf5f-a246aebf9f37 tempest-ShareNetworksNegativeTest-78679599 tempest-ShareNetworksNegativeTest-78679599-project-admin] Calling method 'ShareTypesController.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:02:38 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-a4af82a2-f133-41dc-bf5f-a246aebf9f37 tempest-ShareNetworksNegativeTest-78679599 tempest-ShareNetworksNegativeTest-78679599-project-admin] HTTP exception thrown: Share type not found. May 28 13:02:38 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-a4af82a2-f133-41dc-bf5f-a246aebf9f37 tempest-ShareNetworksNegativeTest-78679599 tempest-ShareNetworksNegativeTest-78679599-project-admin] http://10.27.203.238/share/v2/c48d21d9f59840ffa7b0169aaac01da7/types/5a11620b-8a2e-4bb0-9f88-5eea29b79c1c returned with HTTP 404 May 28 13:02:38 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1281/2540] 10.27.203.238 () {64 vars in 1448 bytes} [Tue May 28 13:02:38 2024] GET /share/v2/c48d21d9f59840ffa7b0169aaac01da7/types/5a11620b-8a2e-4bb0-9f88-5eea29b79c1c => generated 67 bytes in 10 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8275f5d5-4fd0-4b50-a43b-515e5658e68f tempest-ShareNetworksNegativeTest-78679599 tempest-ShareNetworksNegativeTest-78679599-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-8275f5d5-4fd0-4b50-a43b-515e5658e68f tempest-ShareNetworksNegativeTest-78679599 tempest-ShareNetworksNegativeTest-78679599-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:02:38 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-93b28755-7e81-4995-8892-12b84a143ba4 tempest-SharesNegativeTest-1014773059 None] <<< [GET] https://127.0.0.1:40443/api/views/ May 28 13:02:38 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-93b28755-7e81-4995-8892-12b84a143ba4 tempest-SharesNegativeTest-1014773059 None] [Bunch(abac_tags=[], abe_max_depth=None, abe_protocols=[], alias='', allow_anonymous_access=False, allow_s3_anonymous_access=False, auto_commit='0d', bucket='', bucket_creators=[], bucket_creators_groups=[], bucket_owner=None, bulk_permission_update_progress=None, bulk_permission_update_state=None, cluster='loop75-kfs', cluster_id=1, created='2024-05-28T13:02:25.582311Z', enabled=True, files_retention_mode='NONE', guid='a07b9398-cabb-4d9a-8083-604c973fa2ea', id=56, ignore_oos=False, internal=False, is_remote=False, is_seamless=False, logical_capacity=0, max_retention_period=None, min_retention_period=None, name='27c3f247-5cdb-4bb3-9479-7b3253f9df42', nfs_interop_flags='BOTH_NFS3_AND_NFS4_INTEROP_DISABLED', path='/manila/manila-27c3f247-5cdb-4bb3-9479-7b3253f9df42', physical_capacity=0, policy='27c3f247-5cdb-4bb3-9479-7b3253f9df42', policy_id=57, protocols=['NFS'], qos_policy=None, qos_policy_id=None, s3_locks=False, s3_locks_retention_mode='NONE', s3_locks_retention_period='', s3_unverified_lookup=False, s3_versioning=False, select_for_live_monitoring=False, share='', share_acl=Bunch(acl=[], enabled=False), sync='SYNCED', sync_time='2024-05-28T13:02:25.915707Z', tenant_id=1, tenant_name='default', title='/manila/manila-27c3f247-5cdb-4bb3-9479-7b3253f9df42', url='https://127.0.0.1:40443/api/views/56/')] May 28 13:02:38 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-93b28755-7e81-4995-8892-12b84a143ba4 tempest-SharesNegativeTest-1014773059 None] --- [GET] https://127.0.0.1:40443/api/views/: Done May 28 13:02:38 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-93b28755-7e81-4995-8892-12b84a143ba4 tempest-SharesNegativeTest-1014773059 None] >>> [DELETE] https://127.0.0.1:40443/api/views/56/ May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8275f5d5-4fd0-4b50-a43b-515e5658e68f tempest-ShareNetworksNegativeTest-78679599 tempest-ShareNetworksNegativeTest-78679599-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0d0276-20a1-4a90-8b36-754ea2890b6d None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0d0276-20a1-4a90-8b36-754ea2890b6d None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0d0276-20a1-4a90-8b36-754ea2890b6d None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0d0276-20a1-4a90-8b36-754ea2890b6d None admin] PATH_INFO: `/v3/users/d20ca92d1c8b4dc7bc575b87ba11f2a7` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0d0276-20a1-4a90-8b36-754ea2890b6d None admin] RBAC: Authorizing `identity:delete_user(user_id=d20ca92d1c8b4dc7bc575b87ba11f2a7)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0d0276-20a1-4a90-8b36-754ea2890b6d None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-6b0d0276-20a1-4a90-8b36-754ea2890b6d None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd20ca92d1c8b4dc7bc575b87ba11f2a7', 'request_id': 'req-6b0d0276-20a1-4a90-8b36-754ea2890b6d'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-6b0d0276-20a1-4a90-8b36-754ea2890b6d None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd20ca92d1c8b4dc7bc575b87ba11f2a7', 'request_id': 'req-6b0d0276-20a1-4a90-8b36-754ea2890b6d'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-6b0d0276-20a1-4a90-8b36-754ea2890b6d None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd20ca92d1c8b4dc7bc575b87ba11f2a7', 'request_id': 'req-6b0d0276-20a1-4a90-8b36-754ea2890b6d'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-6b0d0276-20a1-4a90-8b36-754ea2890b6d None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd20ca92d1c8b4dc7bc575b87ba11f2a7', 'request_id': 'req-6b0d0276-20a1-4a90-8b36-754ea2890b6d'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-6b0d0276-20a1-4a90-8b36-754ea2890b6d None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd20ca92d1c8b4dc7bc575b87ba11f2a7', 'request_id': 'req-6b0d0276-20a1-4a90-8b36-754ea2890b6d'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1737/3502] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 13:02:38 2024] DELETE /identity/v3/users/d20ca92d1c8b4dc7bc575b87ba11f2a7 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44499956-84f0-4244-8540-1864d34ae356 tempest-ShareNetworksNegativeTest-78679599 tempest-ShareNetworksNegativeTest-78679599-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44499956-84f0-4244-8540-1864d34ae356 tempest-ShareNetworksNegativeTest-78679599 tempest-ShareNetworksNegativeTest-78679599-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a37ada8-877e-4350-baf8-91a530c967ef None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a37ada8-877e-4350-baf8-91a530c967ef None admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a37ada8-877e-4350-baf8-91a530c967ef None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a37ada8-877e-4350-baf8-91a530c967ef None admin] PATH_INFO: `/v3/users/def78076773a4672b3298749d1ecef4b` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a37ada8-877e-4350-baf8-91a530c967ef None admin] RBAC: Authorizing `identity:delete_user(user_id=def78076773a4672b3298749d1ecef4b)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a37ada8-877e-4350-baf8-91a530c967ef None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-3a37ada8-877e-4350-baf8-91a530c967ef None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'def78076773a4672b3298749d1ecef4b', 'request_id': 'req-3a37ada8-877e-4350-baf8-91a530c967ef'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-3a37ada8-877e-4350-baf8-91a530c967ef None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'def78076773a4672b3298749d1ecef4b', 'request_id': 'req-3a37ada8-877e-4350-baf8-91a530c967ef'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-3a37ada8-877e-4350-baf8-91a530c967ef None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'def78076773a4672b3298749d1ecef4b', 'request_id': 'req-3a37ada8-877e-4350-baf8-91a530c967ef'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-3a37ada8-877e-4350-baf8-91a530c967ef None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'def78076773a4672b3298749d1ecef4b', 'request_id': 'req-3a37ada8-877e-4350-baf8-91a530c967ef'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-3a37ada8-877e-4350-baf8-91a530c967ef None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'def78076773a4672b3298749d1ecef4b', 'request_id': 'req-3a37ada8-877e-4350-baf8-91a530c967ef'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1766/3503] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 13:02:38 2024] DELETE /identity/v3/users/def78076773a4672b3298749d1ecef4b => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0d0276-20a1-4a90-8b36-754ea2890b6d None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-6b0d0276-20a1-4a90-8b36-754ea2890b6d None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0d0276-20a1-4a90-8b36-754ea2890b6d None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07c4b4d-0f75-4ab9-8295-58d1292c0a7f None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07c4b4d-0f75-4ab9-8295-58d1292c0a7f None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07c4b4d-0f75-4ab9-8295-58d1292c0a7f None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07c4b4d-0f75-4ab9-8295-58d1292c0a7f None admin] PATH_INFO: `/v3/users/4598171c386c4a6fb583671b4f73048d` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07c4b4d-0f75-4ab9-8295-58d1292c0a7f None admin] RBAC: Authorizing `identity:delete_user(user_id=4598171c386c4a6fb583671b4f73048d)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07c4b4d-0f75-4ab9-8295-58d1292c0a7f None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-b07c4b4d-0f75-4ab9-8295-58d1292c0a7f None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4598171c386c4a6fb583671b4f73048d', 'request_id': 'req-b07c4b4d-0f75-4ab9-8295-58d1292c0a7f'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-b07c4b4d-0f75-4ab9-8295-58d1292c0a7f None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4598171c386c4a6fb583671b4f73048d', 'request_id': 'req-b07c4b4d-0f75-4ab9-8295-58d1292c0a7f'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-b07c4b4d-0f75-4ab9-8295-58d1292c0a7f None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4598171c386c4a6fb583671b4f73048d', 'request_id': 'req-b07c4b4d-0f75-4ab9-8295-58d1292c0a7f'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-b07c4b4d-0f75-4ab9-8295-58d1292c0a7f None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4598171c386c4a6fb583671b4f73048d', 'request_id': 'req-b07c4b4d-0f75-4ab9-8295-58d1292c0a7f'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-b07c4b4d-0f75-4ab9-8295-58d1292c0a7f None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4598171c386c4a6fb583671b4f73048d', 'request_id': 'req-b07c4b4d-0f75-4ab9-8295-58d1292c0a7f'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1738/3504] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 13:02:38 2024] DELETE /identity/v3/users/4598171c386c4a6fb583671b4f73048d => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52126db9-fa2a-4d95-8037-6d13620aef57 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52126db9-fa2a-4d95-8037-6d13620aef57 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52126db9-fa2a-4d95-8037-6d13620aef57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-52126db9-fa2a-4d95-8037-6d13620aef57 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-52126db9-fa2a-4d95-8037-6d13620aef57 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-52126db9-fa2a-4d95-8037-6d13620aef57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1767/3505] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 13:02:38 2024] POST /identity/v3/auth/tokens => generated 2960 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 13:02:38 l75lg1-v1 neutron-server[77619]: DEBUG neutron.wsgi [-] (77619) accepted ('10.27.203.238', 46546) {{(pid=77619) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07c4b4d-0f75-4ab9-8295-58d1292c0a7f None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:38 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-b07c4b4d-0f75-4ab9-8295-58d1292c0a7f None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:02:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07c4b4d-0f75-4ab9-8295-58d1292c0a7f None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600d1dfc-c0b8-4043-8d8a-17b5676f4cee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef17047035e4b518fd5360a01f2da1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600d1dfc-c0b8-4043-8d8a-17b5676f4cee service neutron] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600d1dfc-c0b8-4043-8d8a-17b5676f4cee service neutron] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600d1dfc-c0b8-4043-8d8a-17b5676f4cee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600d1dfc-c0b8-4043-8d8a-17b5676f4cee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600d1dfc-c0b8-4043-8d8a-17b5676f4cee service neutron] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:39 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1739/3506] 10.27.203.238 () {64 vars in 1432 bytes} [Tue May 28 13:02:38 2024] GET /identity/v3/auth/tokens => generated 2960 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 28 13:02:39 l75lg1-v1 neutron-server[77619]: INFO neutron.wsgi [None req-c72a1c9c-4e96-4f79-9668-68c4e7ce494a None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=334e02349e304e69848e5297657e42a9&name=default HTTP/1.1" status: 200 len: 216 time: 0.0699034 May 28 13:02:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52126db9-fa2a-4d95-8037-6d13620aef57 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-52126db9-fa2a-4d95-8037-6d13620aef57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:02:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52126db9-fa2a-4d95-8037-6d13620aef57 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9235142-f142-48b3-9ef6-9ce5104f6f09 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9235142-f142-48b3-9ef6-9ce5104f6f09 None admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9235142-f142-48b3-9ef6-9ce5104f6f09 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9235142-f142-48b3-9ef6-9ce5104f6f09 None admin] PATH_INFO: `/v3/projects/334e02349e304e69848e5297657e42a9` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9235142-f142-48b3-9ef6-9ce5104f6f09 None admin] RBAC: Authorizing `identity:delete_project(project_id=334e02349e304e69848e5297657e42a9)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9235142-f142-48b3-9ef6-9ce5104f6f09 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-f9235142-f142-48b3-9ef6-9ce5104f6f09 None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '334e02349e304e69848e5297657e42a9', 'request_id': 'req-f9235142-f142-48b3-9ef6-9ce5104f6f09'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-f9235142-f142-48b3-9ef6-9ce5104f6f09 None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '334e02349e304e69848e5297657e42a9', 'request_id': 'req-f9235142-f142-48b3-9ef6-9ce5104f6f09'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-f9235142-f142-48b3-9ef6-9ce5104f6f09 None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '334e02349e304e69848e5297657e42a9', 'request_id': 'req-f9235142-f142-48b3-9ef6-9ce5104f6f09'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-f9235142-f142-48b3-9ef6-9ce5104f6f09 None admin] The token cache is being invalidate because project 334e02349e304e69848e5297657e42a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 13:02:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-f9235142-f142-48b3-9ef6-9ce5104f6f09 None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-f9235142-f142-48b3-9ef6-9ce5104f6f09 None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:39 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1768/3507] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 13:02:39 2024] DELETE /identity/v3/projects/334e02349e304e69848e5297657e42a9 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:02:39 l75lg1-v1 neutron-server[77619]: DEBUG neutron.wsgi [-] (77619) accepted ('10.27.203.238', 46562) {{(pid=77619) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 13:02:39 l75lg1-v1 neutron-server[77619]: INFO neutron.wsgi [None req-2b747dd4-d08c-4454-b32a-c9db53309249 None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=c48d21d9f59840ffa7b0169aaac01da7&name=default HTTP/1.1" status: 200 len: 216 time: 0.0092571 May 28 13:02:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600d1dfc-c0b8-4043-8d8a-17b5676f4cee service neutron] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600d1dfc-c0b8-4043-8d8a-17b5676f4cee service neutron] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f805d01d-6558-4341-a40c-0e7303e65792 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f805d01d-6558-4341-a40c-0e7303e65792 None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f805d01d-6558-4341-a40c-0e7303e65792 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f805d01d-6558-4341-a40c-0e7303e65792 None admin] PATH_INFO: `/v3/projects/c48d21d9f59840ffa7b0169aaac01da7` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f805d01d-6558-4341-a40c-0e7303e65792 None admin] RBAC: Authorizing `identity:delete_project(project_id=c48d21d9f59840ffa7b0169aaac01da7)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f805d01d-6558-4341-a40c-0e7303e65792 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-f805d01d-6558-4341-a40c-0e7303e65792 None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c48d21d9f59840ffa7b0169aaac01da7', 'request_id': 'req-f805d01d-6558-4341-a40c-0e7303e65792'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-f805d01d-6558-4341-a40c-0e7303e65792 None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c48d21d9f59840ffa7b0169aaac01da7', 'request_id': 'req-f805d01d-6558-4341-a40c-0e7303e65792'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-f805d01d-6558-4341-a40c-0e7303e65792 None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c48d21d9f59840ffa7b0169aaac01da7', 'request_id': 'req-f805d01d-6558-4341-a40c-0e7303e65792'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:39 l75lg1-v1 dstat.sh[49771]: 28-05 13:02:39| 8 1 84 7 0|5575M 1846M 278M 7925M| 22k 646B| 0 8507k| 0 760 |7957 14k|1.03 1.13 1.06|2.0 1.0 0| 0 0 | 0 2048M| 29 364 0 50 2 May 28 13:02:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-f805d01d-6558-4341-a40c-0e7303e65792 None admin] The token cache is being invalidate because project c48d21d9f59840ffa7b0169aaac01da7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 13:02:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-f805d01d-6558-4341-a40c-0e7303e65792 None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-f805d01d-6558-4341-a40c-0e7303e65792 None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:39 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1740/3508] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 13:02:39 2024] DELETE /identity/v3/projects/c48d21d9f59840ffa7b0169aaac01da7 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 28 13:02:39 l75lg1-v1 neutron-server[77619]: DEBUG neutron.wsgi [-] (77619) accepted ('10.27.203.238', 46572) {{(pid=77619) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 13:02:39 l75lg1-v1 neutron-server[77619]: INFO neutron.wsgi [None req-6a220e26-ce48-4533-8f13-c2d47250b43f None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=2b4510239ee64b778ccf03533fdcdc5a&name=default HTTP/1.1" status: 200 len: 216 time: 0.0082340 May 28 13:02:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9235142-f142-48b3-9ef6-9ce5104f6f09 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-f9235142-f142-48b3-9ef6-9ce5104f6f09 None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:02:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9235142-f142-48b3-9ef6-9ce5104f6f09 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c93e83c-6ded-468c-80e4-fd535548b185 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c93e83c-6ded-468c-80e4-fd535548b185 None admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c93e83c-6ded-468c-80e4-fd535548b185 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c93e83c-6ded-468c-80e4-fd535548b185 None admin] PATH_INFO: `/v3/projects/2b4510239ee64b778ccf03533fdcdc5a` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c93e83c-6ded-468c-80e4-fd535548b185 None admin] RBAC: Authorizing `identity:delete_project(project_id=2b4510239ee64b778ccf03533fdcdc5a)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c93e83c-6ded-468c-80e4-fd535548b185 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-6c93e83c-6ded-468c-80e4-fd535548b185 None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b4510239ee64b778ccf03533fdcdc5a', 'request_id': 'req-6c93e83c-6ded-468c-80e4-fd535548b185'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-6c93e83c-6ded-468c-80e4-fd535548b185 None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b4510239ee64b778ccf03533fdcdc5a', 'request_id': 'req-6c93e83c-6ded-468c-80e4-fd535548b185'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-6c93e83c-6ded-468c-80e4-fd535548b185 None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b4510239ee64b778ccf03533fdcdc5a', 'request_id': 'req-6c93e83c-6ded-468c-80e4-fd535548b185'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-6c93e83c-6ded-468c-80e4-fd535548b185 None admin] The token cache is being invalidate because project 2b4510239ee64b778ccf03533fdcdc5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 13:02:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-6c93e83c-6ded-468c-80e4-fd535548b185 None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-6c93e83c-6ded-468c-80e4-fd535548b185 None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:39 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1769/3509] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 13:02:39 2024] DELETE /identity/v3/projects/2b4510239ee64b778ccf03533fdcdc5a => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:02:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b148d0b-7ff8-4f04-8005-e791b0e09144 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b148d0b-7ff8-4f04-8005-e791b0e09144 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b148d0b-7ff8-4f04-8005-e791b0e09144 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:39 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-4b148d0b-7ff8-4f04-8005-e791b0e09144 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 13:02:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-4b148d0b-7ff8-4f04-8005-e791b0e09144 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 13:02:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-4b148d0b-7ff8-4f04-8005-e791b0e09144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:02:39 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1741/3510] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 13:02:39 2024] POST /identity/v3/auth/tokens => generated 312 bytes in 19 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 28 13:02:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f63b26-3fdb-4a85-847d-de88fe37f5d5 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f63b26-3fdb-4a85-847d-de88fe37f5d5 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f63b26-3fdb-4a85-847d-de88fe37f5d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:39 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-53f63b26-3fdb-4a85-847d-de88fe37f5d5 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 13:02:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-53f63b26-3fdb-4a85-847d-de88fe37f5d5 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 13:02:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-53f63b26-3fdb-4a85-847d-de88fe37f5d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:02:39 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1770/3511] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 13:02:39 2024] POST /identity/v3/auth/tokens => generated 2960 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 13:02:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b148d0b-7ff8-4f04-8005-e791b0e09144 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b148d0b-7ff8-4f04-8005-e791b0e09144 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca949b4-6afd-4f4c-b332-e933f7bf3765 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca949b4-6afd-4f4c-b332-e933f7bf3765 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca949b4-6afd-4f4c-b332-e933f7bf3765 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca949b4-6afd-4f4c-b332-e933f7bf3765 None admin] PATH_INFO: `/v3/domains` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca949b4-6afd-4f4c-b332-e933f7bf3765 None admin] RBAC: Adding query filter params (name=Default) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 13:02:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca949b4-6afd-4f4c-b332-e933f7bf3765 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca949b4-6afd-4f4c-b332-e933f7bf3765 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:39 l75lg1-v1 neutron-server[77623]: DEBUG dbcounter [-] [77623] Writing DB stats neutron:SELECT=1 {{(pid=77623) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:02:39 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1742/3512] 10.27.203.238 () {62 vars in 1220 bytes} [Tue May 28 13:02:39 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 28 13:02:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f63b26-3fdb-4a85-847d-de88fe37f5d5 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f63b26-3fdb-4a85-847d-de88fe37f5d5 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f089a573-c39f-404f-a83e-7862a7854671 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f089a573-c39f-404f-a83e-7862a7854671 None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f089a573-c39f-404f-a83e-7862a7854671 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f089a573-c39f-404f-a83e-7862a7854671 None admin] PATH_INFO: `/v3/projects` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f089a573-c39f-404f-a83e-7862a7854671 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f089a573-c39f-404f-a83e-7862a7854671 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:39 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1771/3513] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 13:02:39 2024] POST /identity/v3/projects => generated 413 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 13:02:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca949b4-6afd-4f4c-b332-e933f7bf3765 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca949b4-6afd-4f4c-b332-e933f7bf3765 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bd8ad0-8463-4e6e-a211-bfcea05d3d73 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bd8ad0-8463-4e6e-a211-bfcea05d3d73 None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bd8ad0-8463-4e6e-a211-bfcea05d3d73 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bd8ad0-8463-4e6e-a211-bfcea05d3d73 None admin] PATH_INFO: `/v3/users` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bd8ad0-8463-4e6e-a211-bfcea05d3d73 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bd8ad0-8463-4e6e-a211-bfcea05d3d73 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:39 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-45bd8ad0-8463-4e6e-a211-bfcea05d3d73 None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 13:02:39 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1743/3514] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 13:02:39 2024] POST /identity/v3/users => generated 315 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 13:02:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f089a573-c39f-404f-a83e-7862a7854671 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f089a573-c39f-404f-a83e-7862a7854671 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95ba6a9-ccc9-4dc5-8b34-e72389ff38c5 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95ba6a9-ccc9-4dc5-8b34-e72389ff38c5 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95ba6a9-ccc9-4dc5-8b34-e72389ff38c5 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95ba6a9-ccc9-4dc5-8b34-e72389ff38c5 None admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95ba6a9-ccc9-4dc5-8b34-e72389ff38c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95ba6a9-ccc9-4dc5-8b34-e72389ff38c5 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:39 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1772/3515] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 13:02:39 2024] GET /identity/v3/roles => generated 1680 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 13:02:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bd8ad0-8463-4e6e-a211-bfcea05d3d73 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bd8ad0-8463-4e6e-a211-bfcea05d3d73 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30eea067-46aa-491a-9b02-73f61c6fb6ba None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eea067-46aa-491a-9b02-73f61c6fb6ba None admin] REQUEST_METHOD: `PUT` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eea067-46aa-491a-9b02-73f61c6fb6ba None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eea067-46aa-491a-9b02-73f61c6fb6ba None admin] PATH_INFO: `/v3/projects/4266cff201a043eabcc031a57a78388c/users/d61d494df0874012aea5132018a73aa0/roles/44620cad10ae407c90c91e2c296adb04` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30eea067-46aa-491a-9b02-73f61c6fb6ba None admin] RBAC: Authorizing `identity:create_grant(project_id=4266cff201a043eabcc031a57a78388c, user_id=d61d494df0874012aea5132018a73aa0, role_id=44620cad10ae407c90c91e2c296adb04)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30eea067-46aa-491a-9b02-73f61c6fb6ba None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:39 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1744/3516] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 13:02:39 2024] PUT /identity/v3/projects/4266cff201a043eabcc031a57a78388c/users/d61d494df0874012aea5132018a73aa0/roles/44620cad10ae407c90c91e2c296adb04 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:02:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e531aedc-17ca-46d1-9adc-385dde6290ae None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e531aedc-17ca-46d1-9adc-385dde6290ae None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e531aedc-17ca-46d1-9adc-385dde6290ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:39 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-e531aedc-17ca-46d1-9adc-385dde6290ae None None] Truncating password to algorithm specific maximum length 72 characters. May 28 13:02:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-e531aedc-17ca-46d1-9adc-385dde6290ae None None] MFA Rules not processed for user `d61d494df0874012aea5132018a73aa0`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 13:02:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-e531aedc-17ca-46d1-9adc-385dde6290ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:02:39 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1773/3517] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 13:02:39 2024] POST /identity/v3/auth/tokens => generated 3984 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 28 13:02:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30eea067-46aa-491a-9b02-73f61c6fb6ba None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30eea067-46aa-491a-9b02-73f61c6fb6ba None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169cdd50-7622-48ad-8c09-624e73770a6f None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169cdd50-7622-48ad-8c09-624e73770a6f None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169cdd50-7622-48ad-8c09-624e73770a6f None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169cdd50-7622-48ad-8c09-624e73770a6f None admin] PATH_INFO: `/v3/projects` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169cdd50-7622-48ad-8c09-624e73770a6f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169cdd50-7622-48ad-8c09-624e73770a6f None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:39 l75lg1-v1 nova-conductor[83647]: DEBUG dbcounter [-] [83647] Writing DB stats nova_cell1:SELECT=1,nova_cell1:UPDATE=1 {{(pid=83647) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:02:39 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1745/3518] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 13:02:39 2024] POST /identity/v3/projects => generated 415 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 13:02:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e531aedc-17ca-46d1-9adc-385dde6290ae None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e531aedc-17ca-46d1-9adc-385dde6290ae None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ea9123-0e76-41c0-a3ce-c9e2cb96376b None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ea9123-0e76-41c0-a3ce-c9e2cb96376b None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ea9123-0e76-41c0-a3ce-c9e2cb96376b None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ea9123-0e76-41c0-a3ce-c9e2cb96376b None admin] PATH_INFO: `/v3/users` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ea9123-0e76-41c0-a3ce-c9e2cb96376b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ea9123-0e76-41c0-a3ce-c9e2cb96376b None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:39 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-52ea9123-0e76-41c0-a3ce-c9e2cb96376b None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 13:02:39 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1774/3519] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 13:02:39 2024] POST /identity/v3/users => generated 316 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 13:02:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169cdd50-7622-48ad-8c09-624e73770a6f None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169cdd50-7622-48ad-8c09-624e73770a6f None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eab9e3b-6b16-472a-93e7-9beeef490339 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eab9e3b-6b16-472a-93e7-9beeef490339 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eab9e3b-6b16-472a-93e7-9beeef490339 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eab9e3b-6b16-472a-93e7-9beeef490339 None admin] PATH_INFO: `/v3/roles` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eab9e3b-6b16-472a-93e7-9beeef490339 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eab9e3b-6b16-472a-93e7-9beeef490339 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:39 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1746/3520] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 13:02:39 2024] GET /identity/v3/roles => generated 1680 bytes in 18 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 13:02:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ea9123-0e76-41c0-a3ce-c9e2cb96376b None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ea9123-0e76-41c0-a3ce-c9e2cb96376b None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6f6661-6e98-491f-8b95-1063d755b2c1 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6f6661-6e98-491f-8b95-1063d755b2c1 None admin] REQUEST_METHOD: `PUT` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6f6661-6e98-491f-8b95-1063d755b2c1 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6f6661-6e98-491f-8b95-1063d755b2c1 None admin] PATH_INFO: `/v3/projects/02fec8b603b24425bf193bcba4106168/users/914bf7fa11c14878bbbc055aebc9cb8f/roles/44620cad10ae407c90c91e2c296adb04` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6f6661-6e98-491f-8b95-1063d755b2c1 None admin] RBAC: Authorizing `identity:create_grant(project_id=02fec8b603b24425bf193bcba4106168, user_id=914bf7fa11c14878bbbc055aebc9cb8f, role_id=44620cad10ae407c90c91e2c296adb04)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:39 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6f6661-6e98-491f-8b95-1063d755b2c1 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:39 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1775/3521] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 13:02:39 2024] PUT /identity/v3/projects/02fec8b603b24425bf193bcba4106168/users/914bf7fa11c14878bbbc055aebc9cb8f/roles/44620cad10ae407c90c91e2c296adb04 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:02:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c4f1c8-7dcc-4f2a-89ea-70400b61af85 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c4f1c8-7dcc-4f2a-89ea-70400b61af85 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c4f1c8-7dcc-4f2a-89ea-70400b61af85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:39 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-31c4f1c8-7dcc-4f2a-89ea-70400b61af85 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 13:02:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-31c4f1c8-7dcc-4f2a-89ea-70400b61af85 None None] MFA Rules not processed for user `914bf7fa11c14878bbbc055aebc9cb8f`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 13:02:39 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-31c4f1c8-7dcc-4f2a-89ea-70400b61af85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:02:40 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1747/3522] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 13:02:39 2024] POST /identity/v3/auth/tokens => generated 3986 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 13:02:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6f6661-6e98-491f-8b95-1063d755b2c1 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:40 l75lg1-v1 nova-conductor[83648]: DEBUG dbcounter [-] [83648] Writing DB stats nova_cell1:SELECT=1 {{(pid=83648) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:02:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6f6661-6e98-491f-8b95-1063d755b2c1 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec146cc-9172-41b3-9b91-5dca7fe700ce None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec146cc-9172-41b3-9b91-5dca7fe700ce None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec146cc-9172-41b3-9b91-5dca7fe700ce None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec146cc-9172-41b3-9b91-5dca7fe700ce None admin] PATH_INFO: `/v3/projects` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec146cc-9172-41b3-9b91-5dca7fe700ce None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec146cc-9172-41b3-9b91-5dca7fe700ce None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:40 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1776/3523] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 13:02:40 2024] POST /identity/v3/projects => generated 413 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 13:02:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c4f1c8-7dcc-4f2a-89ea-70400b61af85 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c4f1c8-7dcc-4f2a-89ea-70400b61af85 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96662fb0-c2db-4fb6-a205-6b62fb9b3ac5 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96662fb0-c2db-4fb6-a205-6b62fb9b3ac5 None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96662fb0-c2db-4fb6-a205-6b62fb9b3ac5 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96662fb0-c2db-4fb6-a205-6b62fb9b3ac5 None admin] PATH_INFO: `/v3/users` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96662fb0-c2db-4fb6-a205-6b62fb9b3ac5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96662fb0-c2db-4fb6-a205-6b62fb9b3ac5 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:40 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-96662fb0-c2db-4fb6-a205-6b62fb9b3ac5 None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 13:02:40 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1748/3524] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 13:02:40 2024] POST /identity/v3/users => generated 314 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 13:02:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec146cc-9172-41b3-9b91-5dca7fe700ce None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec146cc-9172-41b3-9b91-5dca7fe700ce None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68b92bd-7a33-4c2c-91d9-c9ba21841dc8 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68b92bd-7a33-4c2c-91d9-c9ba21841dc8 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68b92bd-7a33-4c2c-91d9-c9ba21841dc8 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68b92bd-7a33-4c2c-91d9-c9ba21841dc8 None admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68b92bd-7a33-4c2c-91d9-c9ba21841dc8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68b92bd-7a33-4c2c-91d9-c9ba21841dc8 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:40 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1777/3525] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 13:02:40 2024] GET /identity/v3/roles => generated 1680 bytes in 17 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 13:02:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96662fb0-c2db-4fb6-a205-6b62fb9b3ac5 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96662fb0-c2db-4fb6-a205-6b62fb9b3ac5 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f097710-72e5-45dc-a559-8daad8e7f848 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f097710-72e5-45dc-a559-8daad8e7f848 None admin] REQUEST_METHOD: `PUT` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f097710-72e5-45dc-a559-8daad8e7f848 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f097710-72e5-45dc-a559-8daad8e7f848 None admin] PATH_INFO: `/v3/projects/43703497123d4491a4fb4a4f947c8631/users/501878a769a948fe8dd877fefc2e1e4c/roles/e7989893488f483baa107be56668c4f8` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f097710-72e5-45dc-a559-8daad8e7f848 None admin] RBAC: Authorizing `identity:create_grant(project_id=43703497123d4491a4fb4a4f947c8631, user_id=501878a769a948fe8dd877fefc2e1e4c, role_id=e7989893488f483baa107be56668c4f8)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f097710-72e5-45dc-a559-8daad8e7f848 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:40 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1749/3526] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 13:02:40 2024] PUT /identity/v3/projects/43703497123d4491a4fb4a4f947c8631/users/501878a769a948fe8dd877fefc2e1e4c/roles/e7989893488f483baa107be56668c4f8 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:02:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68b92bd-7a33-4c2c-91d9-c9ba21841dc8 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68b92bd-7a33-4c2c-91d9-c9ba21841dc8 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0454e77-a1bb-45b0-9897-250fb397742d None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0454e77-a1bb-45b0-9897-250fb397742d None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0454e77-a1bb-45b0-9897-250fb397742d None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0454e77-a1bb-45b0-9897-250fb397742d None admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0454e77-a1bb-45b0-9897-250fb397742d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0454e77-a1bb-45b0-9897-250fb397742d None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:40 l75lg1-v1 dstat.sh[49771]: 28-05 13:02:40| 10 1 86 2 0|5575M 1845M 278M 7926M| 14k 0 | 0 1706k| 0 252 |7700 13k|1.03 1.13 1.06|3.0 0 0| 0 0 | 0 2048M| 29 364 0 49 2 May 28 13:02:40 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1778/3527] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 13:02:40 2024] GET /identity/v3/roles => generated 1680 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 13:02:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f097710-72e5-45dc-a559-8daad8e7f848 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f097710-72e5-45dc-a559-8daad8e7f848 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17fdde3-7ce1-466f-aac3-e89723860008 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17fdde3-7ce1-466f-aac3-e89723860008 None admin] REQUEST_METHOD: `PUT` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17fdde3-7ce1-466f-aac3-e89723860008 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17fdde3-7ce1-466f-aac3-e89723860008 None admin] PATH_INFO: `/v3/projects/43703497123d4491a4fb4a4f947c8631/users/501878a769a948fe8dd877fefc2e1e4c/roles/e7989893488f483baa107be56668c4f8` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17fdde3-7ce1-466f-aac3-e89723860008 None admin] RBAC: Authorizing `identity:create_grant(project_id=43703497123d4491a4fb4a4f947c8631, user_id=501878a769a948fe8dd877fefc2e1e4c, role_id=e7989893488f483baa107be56668c4f8)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17fdde3-7ce1-466f-aac3-e89723860008 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:40 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1750/3528] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 13:02:40 2024] PUT /identity/v3/projects/43703497123d4491a4fb4a4f947c8631/users/501878a769a948fe8dd877fefc2e1e4c/roles/e7989893488f483baa107be56668c4f8 => generated 0 bytes in 19 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:02:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496cb0c7-dcf2-48cb-a45a-cdb9cf2ad97f None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496cb0c7-dcf2-48cb-a45a-cdb9cf2ad97f None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496cb0c7-dcf2-48cb-a45a-cdb9cf2ad97f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:40 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-496cb0c7-dcf2-48cb-a45a-cdb9cf2ad97f None None] Truncating password to algorithm specific maximum length 72 characters. May 28 13:02:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-496cb0c7-dcf2-48cb-a45a-cdb9cf2ad97f None None] MFA Rules not processed for user `501878a769a948fe8dd877fefc2e1e4c`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 13:02:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-496cb0c7-dcf2-48cb-a45a-cdb9cf2ad97f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:02:40 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1779/3529] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 13:02:40 2024] POST /identity/v3/auth/tokens => generated 4107 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 13:02:40 l75lg1-v1 neutron-server[77618]: DEBUG dbcounter [-] [77618] Writing DB stats neutron:SELECT=1 {{(pid=77618) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:02:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17fdde3-7ce1-466f-aac3-e89723860008 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17fdde3-7ce1-466f-aac3-e89723860008 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea552df-ec52-4678-8d59-526d4150d9a8 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '501878a769a948fe8dd877fefc2e1e4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43703497123d4491a4fb4a4f947c8631', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea552df-ec52-4678-8d59-526d4150d9a8 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea552df-ec52-4678-8d59-526d4150d9a8 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea552df-ec52-4678-8d59-526d4150d9a8 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] PATH_INFO: `/v3/domains` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea552df-ec52-4678-8d59-526d4150d9a8 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 13:02:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea552df-ec52-4678-8d59-526d4150d9a8 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea552df-ec52-4678-8d59-526d4150d9a8 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:40 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1751/3530] 10.27.203.238 () {62 vars in 1241 bytes} [Tue May 28 13:02:40 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 13:02:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496cb0c7-dcf2-48cb-a45a-cdb9cf2ad97f None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496cb0c7-dcf2-48cb-a45a-cdb9cf2ad97f None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df403747-e9aa-4640-8a4a-3acf94a3b79c tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '501878a769a948fe8dd877fefc2e1e4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43703497123d4491a4fb4a4f947c8631', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df403747-e9aa-4640-8a4a-3acf94a3b79c tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df403747-e9aa-4640-8a4a-3acf94a3b79c tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df403747-e9aa-4640-8a4a-3acf94a3b79c tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] PATH_INFO: `/v3/users` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df403747-e9aa-4640-8a4a-3acf94a3b79c tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df403747-e9aa-4640-8a4a-3acf94a3b79c tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:40 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-df403747-e9aa-4640-8a4a-3acf94a3b79c tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] Truncating password to algorithm specific maximum length 72 characters. May 28 13:02:40 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1780/3531] 10.27.203.238 () {64 vars in 1232 bytes} [Tue May 28 13:02:40 2024] POST /identity/v3/users => generated 435 bytes in 31 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 13:02:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea552df-ec52-4678-8d59-526d4150d9a8 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea552df-ec52-4678-8d59-526d4150d9a8 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbcccf3-4862-4861-8192-56d7aa22cfc8 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '501878a769a948fe8dd877fefc2e1e4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43703497123d4491a4fb4a4f947c8631', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbcccf3-4862-4861-8192-56d7aa22cfc8 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbcccf3-4862-4861-8192-56d7aa22cfc8 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbcccf3-4862-4861-8192-56d7aa22cfc8 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] PATH_INFO: `/v3/roles` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbcccf3-4862-4861-8192-56d7aa22cfc8 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbcccf3-4862-4861-8192-56d7aa22cfc8 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:40 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1752/3532] 10.27.203.238 () {62 vars in 1210 bytes} [Tue May 28 13:02:40 2024] GET /identity/v3/roles => generated 1680 bytes in 17 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 13:02:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df403747-e9aa-4640-8a4a-3acf94a3b79c tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df403747-e9aa-4640-8a4a-3acf94a3b79c tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22d3c4d-8a3a-4a41-934d-c65264e5bb2d tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '501878a769a948fe8dd877fefc2e1e4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43703497123d4491a4fb4a4f947c8631', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22d3c4d-8a3a-4a41-934d-c65264e5bb2d tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] REQUEST_METHOD: `PUT` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22d3c4d-8a3a-4a41-934d-c65264e5bb2d tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22d3c4d-8a3a-4a41-934d-c65264e5bb2d tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] PATH_INFO: `/v3/projects/43703497123d4491a4fb4a4f947c8631/users/080fdf25a1154b6db0ae228e1c05b6b2/roles/44620cad10ae407c90c91e2c296adb04` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22d3c4d-8a3a-4a41-934d-c65264e5bb2d tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] RBAC: Authorizing `identity:create_grant(project_id=43703497123d4491a4fb4a4f947c8631, user_id=080fdf25a1154b6db0ae228e1c05b6b2, role_id=44620cad10ae407c90c91e2c296adb04)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:40 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22d3c4d-8a3a-4a41-934d-c65264e5bb2d tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:40 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1781/3533] 10.27.203.238 () {64 vars in 1571 bytes} [Tue May 28 13:02:40 2024] PUT /identity/v3/projects/43703497123d4491a4fb4a4f947c8631/users/080fdf25a1154b6db0ae228e1c05b6b2/roles/44620cad10ae407c90c91e2c296adb04 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:02:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-93b28755-7e81-4995-8892-12b84a143ba4 tempest-SharesNegativeTest-1014773059 None] <<< [DELETE] https://127.0.0.1:40443/api/views/56/ May 28 13:02:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-93b28755-7e81-4995-8892-12b84a143ba4 tempest-SharesNegativeTest-1014773059 None] --- [DELETE] https://127.0.0.1:40443/api/views/56/: Done May 28 13:02:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-93b28755-7e81-4995-8892-12b84a143ba4 tempest-SharesNegativeTest-1014773059 None] >>> [GET] https://127.0.0.1:40443/api/quotas/ May 28 13:02:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-93b28755-7e81-4995-8892-12b84a143ba4 tempest-SharesNegativeTest-1014773059 None] {'allow_redirects': True, May 28 13:02:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-93b28755-7e81-4995-8892-12b84a143ba4 tempest-SharesNegativeTest-1014773059 None] 'params': {'name': '27c3f247-5cdb-4bb3-9479-7b3253f9df42'}} May 28 13:02:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbcccf3-4862-4861-8192-56d7aa22cfc8 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-4bbcccf3-4862-4861-8192-56d7aa22cfc8 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:02:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbcccf3-4862-4861-8192-56d7aa22cfc8 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1108110-3456-400b-8d19-980836e5c523 service manila] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f110cf6300f049c897d0aab63218d1e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1108110-3456-400b-8d19-980836e5c523 service manila] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1108110-3456-400b-8d19-980836e5c523 service manila] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1108110-3456-400b-8d19-980836e5c523 service manila] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1108110-3456-400b-8d19-980836e5c523 service manila] RBAC: Authorizing `identity:validate_token()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:40 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1108110-3456-400b-8d19-980836e5c523 service manila] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:40 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1753/3534] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 13:02:40 2024] GET /identity/v3/auth/tokens => generated 4107 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 13:02:40 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-6c54a3a7-d7fc-46e8-8f4d-71a89d3777e4 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] POST http://10.27.203.238/share/v2/43703497123d4491a4fb4a4f947c8631/types May 28 13:02:40 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-6c54a3a7-d7fc-46e8-8f4d-71a89d3777e4 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share_type": {"name": "tempest-typeshare-type-1159998864", "extra_specs": {"driver_handles_share_servers": "False"}, "share_type_access:is_public": true}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:02:40 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-6c54a3a7-d7fc-46e8-8f4d-71a89d3777e4 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] http://10.27.203.238/share/v2/43703497123d4491a4fb4a4f947c8631/types returned with HTTP 200 May 28 13:02:40 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1260/2541] 10.27.203.238 () {66 vars in 1359 bytes} [Tue May 28 13:02:40 2024] POST /share/v2/43703497123d4491a4fb4a4f947c8631/types => generated 623 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:02:40 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-ba942be6-8daa-4adf-a103-6e0978950c97 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] POST http://10.27.203.238/share/v2/43703497123d4491a4fb4a4f947c8631/share-group-types May 28 13:02:40 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-ba942be6-8daa-4adf-a103-6e0978950c97 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share_group_type": {"name": "tempest-unique_sgtype_name-47909505", "share_types": ["925a8783-fd97-4b29-8518-65f1e1ff98cd"]}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:02:40 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-ba942be6-8daa-4adf-a103-6e0978950c97 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] http://10.27.203.238/share/v2/43703497123d4491a4fb4a4f947c8631/share-group-types returned with HTTP 200 May 28 13:02:40 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1282/2542] 10.27.203.238 () {66 vars in 1395 bytes} [Tue May 28 13:02:40 2024] POST /share/v2/43703497123d4491a4fb4a4f947c8631/share-group-types => generated 231 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:02:40 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-f1de6577-b11f-452f-8b3d-68c865dd5dea tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] GET http://10.27.203.238/share/v2/43703497123d4491a4fb4a4f947c8631/services May 28 13:02:40 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-f1de6577-b11f-452f-8b3d-68c865dd5dea tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:02:40 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-f1de6577-b11f-452f-8b3d-68c865dd5dea tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:02:40 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-f1de6577-b11f-452f-8b3d-68c865dd5dea tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] http://10.27.203.238/share/v2/43703497123d4491a4fb4a4f947c8631/services returned with HTTP 200 May 28 13:02:40 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1261/2543] 10.27.203.238 () {64 vars in 1346 bytes} [Tue May 28 13:02:40 2024] GET /share/v2/43703497123d4491a4fb4a4f947c8631/services => generated 945 bytes in 16 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:02:40 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-bff1bc35-71a6-4b8b-85ca-aba7cb746fab tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] GET http://10.27.203.238/share/v2/43703497123d4491a4fb4a4f947c8631/scheduler-stats/pools/detail?share_type=925a8783-fd97-4b29-8518-65f1e1ff98cd May 28 13:02:40 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-bff1bc35-71a6-4b8b-85ca-aba7cb746fab tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:02:40 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-bff1bc35-71a6-4b8b-85ca-aba7cb746fab tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:02:40 l75lg1-v1 devstack@m-api.service[98329]: INFO oslo_messaging._drivers.amqpdriver [None req-bff1bc35-71a6-4b8b-85ca-aba7cb746fab tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] Expecting reply to msg 20f8aab022854939b031cc7b3d29c0aa in queue reply_351c50596b2348218ab8657bb9280c03 May 28 13:02:40 l75lg1-v1 devstack@m-api.service[98329]: INFO oslo_messaging._drivers.amqpdriver [-] Received RPC response for msg 20f8aab022854939b031cc7b3d29c0aa May 28 13:02:40 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-979e5ab7-c719-4bfa-a4a2-9087d33f13d1 tempest-SharesNegativeTest-1014773059 tempest-SharesNegativeTest-1014773059-project-member] GET http://10.27.203.238/share/v2/d1d71dc9f23c4c6a8e146d99ad65ebb2/shares/b05a8999-f1ac-4887-a675-3c2ca8e9cece May 28 13:02:40 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-979e5ab7-c719-4bfa-a4a2-9087d33f13d1 tempest-SharesNegativeTest-1014773059 tempest-SharesNegativeTest-1014773059-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:02:40 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-979e5ab7-c719-4bfa-a4a2-9087d33f13d1 tempest-SharesNegativeTest-1014773059 tempest-SharesNegativeTest-1014773059-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:02:40 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-979e5ab7-c719-4bfa-a4a2-9087d33f13d1 tempest-SharesNegativeTest-1014773059 tempest-SharesNegativeTest-1014773059-project-member] http://10.27.203.238/share/v2/d1d71dc9f23c4c6a8e146d99ad65ebb2/shares/b05a8999-f1ac-4887-a675-3c2ca8e9cece returned with HTTP 200 May 28 13:02:40 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1262/2544] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:02:40 2024] GET /share/v2/d1d71dc9f23c4c6a8e146d99ad65ebb2/shares/b05a8999-f1ac-4887-a675-3c2ca8e9cece => generated 1314 bytes in 27 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:02:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-93b28755-7e81-4995-8892-12b84a143ba4 tempest-SharesNegativeTest-1014773059 None] <<< [GET] https://127.0.0.1:40443/api/quotas/ May 28 13:02:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-93b28755-7e81-4995-8892-12b84a143ba4 tempest-SharesNegativeTest-1014773059 None] [Bunch(cluster='loop75-kfs', cluster_id=1, default_email=None, default_group_quota=None, default_user_quota=None, enable_alarms=True, enable_email_providers=True, grace_period=None, guid='50667d66-b8eb-4a97-8db4-2611f79486c0', hard_limit=1073741824, hard_limit_inodes=None, id=54, internal=False, is_user_quota=False, last_user_quotas_update=None, name='27c3f247-5cdb-4bb3-9479-7b3253f9df42', num_blocked_users=0, num_exceeded_users=0, path='/manila/manila-27c3f247-5cdb-4bb3-9479-7b3253f9df42', percent_capacity=0, percent_inodes=None, pretty_grace_period=None, pretty_grace_period_expiration=None, pretty_state='OK (CREATED)', soft_limit=None, soft_limit_inodes=None, state='OK', sync_state='CREATED', system_id=54, tenant_id=1, tenant_name='default', time_to_block=None, title='27c3f247-5cdb-4bb3-9479-7b3253f9df42', url='https://127.0.0.1:40443/api/quotas/54/', used_capacity=0, used_capacity_tb=0.0, used_effective_capacity=0, used_effective_capacity_tb=0.0, used_inodes=0, used_limited_capacity=0)] May 28 13:02:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-93b28755-7e81-4995-8892-12b84a143ba4 tempest-SharesNegativeTest-1014773059 None] --- [GET] https://127.0.0.1:40443/api/quotas/: Done May 28 13:02:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-93b28755-7e81-4995-8892-12b84a143ba4 tempest-SharesNegativeTest-1014773059 None] >>> [DELETE] https://127.0.0.1:40443/api/quotas/54/ May 28 13:02:41 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-bff1bc35-71a6-4b8b-85ca-aba7cb746fab tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] http://10.27.203.238/share/v2/43703497123d4491a4fb4a4f947c8631/scheduler-stats/pools/detail?share_type=925a8783-fd97-4b29-8518-65f1e1ff98cd returned with HTTP 200 May 28 13:02:41 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1283/2545] 10.27.203.238 () {64 vars in 1501 bytes} [Tue May 28 13:02:40 2024] GET /share/v2/43703497123d4491a4fb4a4f947c8631/scheduler-stats/pools/detail?share_type=925a8783-fd97-4b29-8518-65f1e1ff98cd => generated 1086 bytes in 513 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:02:41 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-56437e60-33d6-4ea0-8bec-ff77e8ac64e9 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] GET http://10.27.203.238/share/v2/43703497123d4491a4fb4a4f947c8631/services May 28 13:02:41 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-56437e60-33d6-4ea0-8bec-ff77e8ac64e9 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:02:41 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-56437e60-33d6-4ea0-8bec-ff77e8ac64e9 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:02:41 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-56437e60-33d6-4ea0-8bec-ff77e8ac64e9 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] http://10.27.203.238/share/v2/43703497123d4491a4fb4a4f947c8631/services returned with HTTP 200 May 28 13:02:41 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1263/2546] 10.27.203.238 () {64 vars in 1346 bytes} [Tue May 28 13:02:41 2024] GET /share/v2/43703497123d4491a4fb4a4f947c8631/services => generated 945 bytes in 16 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:02:41 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-4061cd03-5bb3-4854-ac30-0b9385bfe829 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] POST http://10.27.203.238/share/v2/43703497123d4491a4fb4a4f947c8631/types May 28 13:02:41 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-4061cd03-5bb3-4854-ac30-0b9385bfe829 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share_type": {"name": "tempest-share_type_invalid_az_spec-283472923", "extra_specs": {"driver_handles_share_servers": "False", "availability_zones": "az1, az2, az 3, "}, "share_type_access:is_public": true}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:02:41 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-4061cd03-5bb3-4854-ac30-0b9385bfe829 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] http://10.27.203.238/share/v2/43703497123d4491a4fb4a4f947c8631/types returned with HTTP 400 May 28 13:02:41 l75lg1-v1 dstat.sh[49771]: 28-05 13:02:41| 6 1 92 1 0|5575M 1845M 278M 7926M| 16k 1887B| 0 3141k| 0 124 |4831 7991 |1.03 1.13 1.06|1.0 0 0| 0 0 | 0 2048M| 29 364 0 49 2 May 28 13:02:41 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1284/2547] 10.27.203.238 () {66 vars in 1359 bytes} [Tue May 28 13:02:41 2024] POST /share/v2/43703497123d4491a4fb4a4f947c8631/types => generated 95 bytes in 7 msecs (HTTP/1.1 400) 6 headers in 239 bytes (1 switches on core 0) May 28 13:02:41 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-e11ba21c-4e42-465b-a36d-48e762a8e6f8 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] POST http://10.27.203.238/share/v2/43703497123d4491a4fb4a4f947c8631/types May 28 13:02:41 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-e11ba21c-4e42-465b-a36d-48e762a8e6f8 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share_type": {"name": "tempest-share_type_invalid_az_spec-290787573", "extra_specs": {"driver_handles_share_servers": "False", "availability_zones": "az1,,az 3"}, "share_type_access:is_public": true}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:02:41 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-e11ba21c-4e42-465b-a36d-48e762a8e6f8 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] http://10.27.203.238/share/v2/43703497123d4491a4fb4a4f947c8631/types returned with HTTP 400 May 28 13:02:41 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1264/2548] 10.27.203.238 () {66 vars in 1359 bytes} [Tue May 28 13:02:41 2024] POST /share/v2/43703497123d4491a4fb4a4f947c8631/types => generated 95 bytes in 6 msecs (HTTP/1.1 400) 6 headers in 239 bytes (1 switches on core 0) May 28 13:02:41 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-4fa2b833-0058-474a-bc5c-e6fa0995ac59 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] POST http://10.27.203.238/share/v2/43703497123d4491a4fb4a4f947c8631/types May 28 13:02:41 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-4fa2b833-0058-474a-bc5c-e6fa0995ac59 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share_type": {"name": "tempest-share_type_invalid_az_spec-836811259", "extra_specs": {"driver_handles_share_servers": "False", "availability_zones": ",az2, az 3"}, "share_type_access:is_public": true}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:02:41 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-4fa2b833-0058-474a-bc5c-e6fa0995ac59 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] http://10.27.203.238/share/v2/43703497123d4491a4fb4a4f947c8631/types returned with HTTP 400 May 28 13:02:41 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1285/2549] 10.27.203.238 () {66 vars in 1359 bytes} [Tue May 28 13:02:41 2024] POST /share/v2/43703497123d4491a4fb4a4f947c8631/types => generated 95 bytes in 7 msecs (HTTP/1.1 400) 6 headers in 239 bytes (1 switches on core 0) May 28 13:02:41 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-f3aecfa4-610b-491e-b782-78a11b1abd07 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] PUT http://10.27.203.238/share/v2/43703497123d4491a4fb4a4f947c8631/types/925a8783-fd97-4b29-8518-65f1e1ff98cd/extra_specs/availability_zones May 28 13:02:41 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-f3aecfa4-610b-491e-b782-78a11b1abd07 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] Action: 'update', calling method: ShareTypeExtraSpecsController.update, body: {"availability_zones": "nova"} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:02:41 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-f3aecfa4-610b-491e-b782-78a11b1abd07 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] http://10.27.203.238/share/v2/43703497123d4491a4fb4a4f947c8631/types/925a8783-fd97-4b29-8518-65f1e1ff98cd/extra_specs/availability_zones returned with HTTP 200 May 28 13:02:41 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1265/2550] 10.27.203.238 () {66 vars in 1561 bytes} [Tue May 28 13:02:41 2024] PUT /share/v2/43703497123d4491a4fb4a4f947c8631/types/925a8783-fd97-4b29-8518-65f1e1ff98cd/extra_specs/availability_zones => generated 30 bytes in 26 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:02:41 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-8eaa2ee3-56b0-41c3-a361-e5cb32847802 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] POST http://10.27.203.238/share/v2/43703497123d4491a4fb4a4f947c8631/types May 28 13:02:41 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-8eaa2ee3-56b0-41c3-a361-e5cb32847802 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share_type": {"name": "tempest-support_any_az_share_type-564716500", "extra_specs": {"driver_handles_share_servers": "False"}, "share_type_access:is_public": true}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:02:41 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-8eaa2ee3-56b0-41c3-a361-e5cb32847802 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] http://10.27.203.238/share/v2/43703497123d4491a4fb4a4f947c8631/types returned with HTTP 200 May 28 13:02:41 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1286/2551] 10.27.203.238 () {66 vars in 1359 bytes} [Tue May 28 13:02:41 2024] POST /share/v2/43703497123d4491a4fb4a4f947c8631/types => generated 643 bytes in 24 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:02:41 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-4efac396-0eba-4337-bb18-8a779048d3c8 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] GET http://10.27.203.238/share/v2/43703497123d4491a4fb4a4f947c8631/types?extra_specs=%7B%27availability_zones%27%3A+%27az_that_doesnt_exist%27%7D May 28 13:02:41 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-4efac396-0eba-4337-bb18-8a779048d3c8 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:02:41 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-4efac396-0eba-4337-bb18-8a779048d3c8 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] Calling method 'ShareTypesController.index' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:02:41 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.share.share_types [None req-4efac396-0eba-4337-bb18-8a779048d3c8 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] Searching by: {'availability_zones': ['az_that_doesnt_exist']} {{(pid=98330) get_all_types /opt/stack/manila/manila/share/share_types.py:146}} May 28 13:02:41 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-4efac396-0eba-4337-bb18-8a779048d3c8 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] http://10.27.203.238/share/v2/43703497123d4491a4fb4a4f947c8631/types?extra_specs=%7B%27availability_zones%27%3A+%27az_that_doesnt_exist%27%7D returned with HTTP 200 May 28 13:02:41 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1266/2552] 10.27.203.238 () {64 vars in 1482 bytes} [Tue May 28 13:02:41 2024] GET /share/v2/43703497123d4491a4fb4a4f947c8631/types?extra_specs=%7B%27availability_zones%27%3A+%27az_that_doesnt_exist%27%7D => generated 2923 bytes in 15 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:02:41 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-c49c46fe-ed8c-4c0c-a5a5-8c6ba06b1877 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] DELETE http://10.27.203.238/share/v2/43703497123d4491a4fb4a4f947c8631/types/d63f62ab-dc47-4e8a-9ba0-8b2cccecf2e6 May 28 13:02:41 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-c49c46fe-ed8c-4c0c-a5a5-8c6ba06b1877 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:02:41 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-c49c46fe-ed8c-4c0c-a5a5-8c6ba06b1877 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] Calling method 'ShareTypesController._delete' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:02:41 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-c49c46fe-ed8c-4c0c-a5a5-8c6ba06b1877 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] http://10.27.203.238/share/v2/43703497123d4491a4fb4a4f947c8631/types/d63f62ab-dc47-4e8a-9ba0-8b2cccecf2e6 returned with HTTP 202 May 28 13:02:41 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1287/2553] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:02:41 2024] DELETE /share/v2/43703497123d4491a4fb4a4f947c8631/types/d63f62ab-dc47-4e8a-9ba0-8b2cccecf2e6 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 13:02:41 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-6dde8900-be46-4631-8293-176374b79bd0 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] GET http://10.27.203.238/share/v2/43703497123d4491a4fb4a4f947c8631/types/d63f62ab-dc47-4e8a-9ba0-8b2cccecf2e6 May 28 13:02:41 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-6dde8900-be46-4631-8293-176374b79bd0 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:02:41 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-6dde8900-be46-4631-8293-176374b79bd0 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] Calling method 'ShareTypesController.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:02:41 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-6dde8900-be46-4631-8293-176374b79bd0 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] HTTP exception thrown: Share type not found. May 28 13:02:41 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-6dde8900-be46-4631-8293-176374b79bd0 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] http://10.27.203.238/share/v2/43703497123d4491a4fb4a4f947c8631/types/d63f62ab-dc47-4e8a-9ba0-8b2cccecf2e6 returned with HTTP 404 May 28 13:02:41 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1267/2554] 10.27.203.238 () {64 vars in 1448 bytes} [Tue May 28 13:02:41 2024] GET /share/v2/43703497123d4491a4fb4a4f947c8631/types/d63f62ab-dc47-4e8a-9ba0-8b2cccecf2e6 => generated 67 bytes in 11 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 13:02:41 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-97d5a248-f1a4-44a9-92e9-5f3e5642082a tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] PUT http://10.27.203.238/share/v2/43703497123d4491a4fb4a4f947c8631/types/925a8783-fd97-4b29-8518-65f1e1ff98cd/extra_specs/availability_zones May 28 13:02:41 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-97d5a248-f1a4-44a9-92e9-5f3e5642082a tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] Action: 'update', calling method: ShareTypeExtraSpecsController.update, body: {"availability_zones": "az_that_doesnt_exist"} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:02:41 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-97d5a248-f1a4-44a9-92e9-5f3e5642082a tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] http://10.27.203.238/share/v2/43703497123d4491a4fb4a4f947c8631/types/925a8783-fd97-4b29-8518-65f1e1ff98cd/extra_specs/availability_zones returned with HTTP 200 May 28 13:02:41 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1288/2555] 10.27.203.238 () {66 vars in 1561 bytes} [Tue May 28 13:02:41 2024] PUT /share/v2/43703497123d4491a4fb4a4f947c8631/types/925a8783-fd97-4b29-8518-65f1e1ff98cd/extra_specs/availability_zones => generated 46 bytes in 24 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22d3c4d-8a3a-4a41-934d-c65264e5bb2d tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22d3c4d-8a3a-4a41-934d-c65264e5bb2d tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce965e27-64c4-41e2-92b9-a979d228eb2d service manila] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f110cf6300f049c897d0aab63218d1e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce965e27-64c4-41e2-92b9-a979d228eb2d service manila] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce965e27-64c4-41e2-92b9-a979d228eb2d service manila] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce965e27-64c4-41e2-92b9-a979d228eb2d service manila] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce965e27-64c4-41e2-92b9-a979d228eb2d service manila] RBAC: Authorizing `identity:validate_token()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce965e27-64c4-41e2-92b9-a979d228eb2d service manila] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1782/3535] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 13:02:41 2024] GET /identity/v3/auth/tokens => generated 3984 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 13:02:41 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-5170dbdc-e861-4cd8-8d42-03d36b7ac0a8 tempest-ShareTypeAvailabilityZonesNegativeTest-278662929 tempest-ShareTypeAvailabilityZonesNegativeTest-278662929-project-member] POST http://10.27.203.238/share/v2/4266cff201a043eabcc031a57a78388c/share-groups May 28 13:02:41 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-5170dbdc-e861-4cd8-8d42-03d36b7ac0a8 tempest-ShareTypeAvailabilityZonesNegativeTest-278662929 tempest-ShareTypeAvailabilityZonesNegativeTest-278662929-project-member] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share_group": {"share_group_type_id": "d9024459-7baa-4368-8b94-f8784627e28b", "share_types": ["925a8783-fd97-4b29-8518-65f1e1ff98cd"], "availability_zone": "nova"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:02:41 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-5170dbdc-e861-4cd8-8d42-03d36b7ac0a8 tempest-ShareTypeAvailabilityZonesNegativeTest-278662929 tempest-ShareTypeAvailabilityZonesNegativeTest-278662929-project-member] HTTP exception thrown: Invalid input received: Share group cannot be created since the following share types are not supported within the availability zone 'nova': (tempest-typeshare-type-1159998864 (ID: 925a8783-fd97-4b29-8518-65f1e1ff98cd)). May 28 13:02:41 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-5170dbdc-e861-4cd8-8d42-03d36b7ac0a8 tempest-ShareTypeAvailabilityZonesNegativeTest-278662929 tempest-ShareTypeAvailabilityZonesNegativeTest-278662929-project-member] http://10.27.203.238/share/v2/4266cff201a043eabcc031a57a78388c/share-groups returned with HTTP 400 May 28 13:02:41 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1268/2556] 10.27.203.238 () {66 vars in 1380 bytes} [Tue May 28 13:02:41 2024] POST /share/v2/4266cff201a043eabcc031a57a78388c/share-groups => generated 264 bytes in 85 msecs (HTTP/1.1 400) 6 headers in 240 bytes (1 switches on core 0) May 28 13:02:41 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-c7050382-adaa-44af-958b-9c9e25cdfc63 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] PUT http://10.27.203.238/share/v2/43703497123d4491a4fb4a4f947c8631/types/925a8783-fd97-4b29-8518-65f1e1ff98cd/extra_specs/availability_zones May 28 13:02:41 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-c7050382-adaa-44af-958b-9c9e25cdfc63 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] Action: 'update', calling method: ShareTypeExtraSpecsController.update, body: {"availability_zones": "az_that_doesnt_exist"} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:02:41 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-c7050382-adaa-44af-958b-9c9e25cdfc63 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] http://10.27.203.238/share/v2/43703497123d4491a4fb4a4f947c8631/types/925a8783-fd97-4b29-8518-65f1e1ff98cd/extra_specs/availability_zones returned with HTTP 200 May 28 13:02:41 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1289/2557] 10.27.203.238 () {66 vars in 1561 bytes} [Tue May 28 13:02:41 2024] PUT /share/v2/43703497123d4491a4fb4a4f947c8631/types/925a8783-fd97-4b29-8518-65f1e1ff98cd/extra_specs/availability_zones => generated 46 bytes in 18 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:02:41 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-4362e3b9-db58-403a-b531-e80737aa7b03 tempest-ShareTypeAvailabilityZonesNegativeTest-278662929 tempest-ShareTypeAvailabilityZonesNegativeTest-278662929-project-member] POST http://10.27.203.238/share/v2/4266cff201a043eabcc031a57a78388c/shares May 28 13:02:41 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-4362e3b9-db58-403a-b531-e80737aa7b03 tempest-ShareTypeAvailabilityZonesNegativeTest-278662929 tempest-ShareTypeAvailabilityZonesNegativeTest-278662929-project-member] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share": {"share_proto": "nfs", "description": "Tempest's share", "snapshot_id": null, "name": "tempest-tempest-created-share-1605951474", "size": 1, "metadata": {}, "is_public": false, "availability_zone": "nova", "share_type": "925a8783-fd97-4b29-8518-65f1e1ff98cd"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:02:41 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.v1.shares [None req-4362e3b9-db58-403a-b531-e80737aa7b03 tempest-ShareTypeAvailabilityZonesNegativeTest-278662929 tempest-ShareTypeAvailabilityZonesNegativeTest-278662929-project-member] Create NFS share of 1 GB May 28 13:02:41 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-4362e3b9-db58-403a-b531-e80737aa7b03 tempest-ShareTypeAvailabilityZonesNegativeTest-278662929 tempest-ShareTypeAvailabilityZonesNegativeTest-278662929-project-member] HTTP exception thrown: Share type 925a8783-fd97-4b29-8518-65f1e1ff98cd is not supported within the availability zone chosen nova. May 28 13:02:41 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-4362e3b9-db58-403a-b531-e80737aa7b03 tempest-ShareTypeAvailabilityZonesNegativeTest-278662929 tempest-ShareTypeAvailabilityZonesNegativeTest-278662929-project-member] http://10.27.203.238/share/v2/4266cff201a043eabcc031a57a78388c/shares returned with HTTP 400 May 28 13:02:41 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1269/2558] 10.27.203.238 () {66 vars in 1362 bytes} [Tue May 28 13:02:41 2024] POST /share/v2/4266cff201a043eabcc031a57a78388c/shares => generated 150 bytes in 17 msecs (HTTP/1.1 400) 6 headers in 240 bytes (1 switches on core 0) May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1108110-3456-400b-8d19-980836e5c523 service manila] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1108110-3456-400b-8d19-980836e5c523 service manila] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4ef8fd-4268-47fd-af23-013776c9d893 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '501878a769a948fe8dd877fefc2e1e4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43703497123d4491a4fb4a4f947c8631', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4ef8fd-4268-47fd-af23-013776c9d893 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4ef8fd-4268-47fd-af23-013776c9d893 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4ef8fd-4268-47fd-af23-013776c9d893 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] PATH_INFO: `/v3/users/8688f80695814f34bfb56342c4e54028` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4ef8fd-4268-47fd-af23-013776c9d893 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] RBAC: Authorizing `identity:delete_user(user_id=8688f80695814f34bfb56342c4e54028)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4ef8fd-4268-47fd-af23-013776c9d893 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-0a4ef8fd-4268-47fd-af23-013776c9d893 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] Could not find user: 8688f80695814f34bfb56342c4e54028.: keystone.exception.UserNotFound: Could not find user: 8688f80695814f34bfb56342c4e54028. May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 8688f80695814f34bfb56342c4e54028. May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1754/3536] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:02:41 2024] DELETE /identity/v3/users/8688f80695814f34bfb56342c4e54028 => generated 110 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce965e27-64c4-41e2-92b9-a979d228eb2d service manila] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce965e27-64c4-41e2-92b9-a979d228eb2d service manila] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3f713e-22cf-413e-93a6-c73a3c4617e4 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '501878a769a948fe8dd877fefc2e1e4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43703497123d4491a4fb4a4f947c8631', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3f713e-22cf-413e-93a6-c73a3c4617e4 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3f713e-22cf-413e-93a6-c73a3c4617e4 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3f713e-22cf-413e-93a6-c73a3c4617e4 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] PATH_INFO: `/v3/users/108a25e436e9452a9a865957dcea1fc5` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3f713e-22cf-413e-93a6-c73a3c4617e4 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] RBAC: Authorizing `identity:delete_user(user_id=108a25e436e9452a9a865957dcea1fc5)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3f713e-22cf-413e-93a6-c73a3c4617e4 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-0d3f713e-22cf-413e-93a6-c73a3c4617e4 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] Could not find user: 108a25e436e9452a9a865957dcea1fc5.: keystone.exception.UserNotFound: Could not find user: 108a25e436e9452a9a865957dcea1fc5. May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 108a25e436e9452a9a865957dcea1fc5. May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1783/3537] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:02:41 2024] DELETE /identity/v3/users/108a25e436e9452a9a865957dcea1fc5 => generated 110 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4ef8fd-4268-47fd-af23-013776c9d893 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4ef8fd-4268-47fd-af23-013776c9d893 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb1f064-87d5-4a0d-aa4d-08c4d09324e2 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '501878a769a948fe8dd877fefc2e1e4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43703497123d4491a4fb4a4f947c8631', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb1f064-87d5-4a0d-aa4d-08c4d09324e2 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb1f064-87d5-4a0d-aa4d-08c4d09324e2 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb1f064-87d5-4a0d-aa4d-08c4d09324e2 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] PATH_INFO: `/v3/users/5ae5cb1db3504baaba1df93dc154a004` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb1f064-87d5-4a0d-aa4d-08c4d09324e2 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] RBAC: Authorizing `identity:delete_user(user_id=5ae5cb1db3504baaba1df93dc154a004)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb1f064-87d5-4a0d-aa4d-08c4d09324e2 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-deb1f064-87d5-4a0d-aa4d-08c4d09324e2 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] Could not find user: 5ae5cb1db3504baaba1df93dc154a004.: keystone.exception.UserNotFound: Could not find user: 5ae5cb1db3504baaba1df93dc154a004. May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 5ae5cb1db3504baaba1df93dc154a004. May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1755/3538] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:02:41 2024] DELETE /identity/v3/users/5ae5cb1db3504baaba1df93dc154a004 => generated 110 bytes in 29 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3f713e-22cf-413e-93a6-c73a3c4617e4 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3f713e-22cf-413e-93a6-c73a3c4617e4 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d314087-0758-41fb-b93a-fa75d8f1b98f tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '501878a769a948fe8dd877fefc2e1e4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43703497123d4491a4fb4a4f947c8631', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d314087-0758-41fb-b93a-fa75d8f1b98f tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d314087-0758-41fb-b93a-fa75d8f1b98f tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d314087-0758-41fb-b93a-fa75d8f1b98f tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] PATH_INFO: `/v3/users/c2ac6ca3ea5a4ae498df6d12bb7caadc` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d314087-0758-41fb-b93a-fa75d8f1b98f tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] RBAC: Authorizing `identity:delete_user(user_id=c2ac6ca3ea5a4ae498df6d12bb7caadc)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d314087-0758-41fb-b93a-fa75d8f1b98f tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-7d314087-0758-41fb-b93a-fa75d8f1b98f tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] Could not find user: c2ac6ca3ea5a4ae498df6d12bb7caadc.: keystone.exception.UserNotFound: Could not find user: c2ac6ca3ea5a4ae498df6d12bb7caadc. May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: c2ac6ca3ea5a4ae498df6d12bb7caadc. May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1784/3539] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:02:41 2024] DELETE /identity/v3/users/c2ac6ca3ea5a4ae498df6d12bb7caadc => generated 110 bytes in 30 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb1f064-87d5-4a0d-aa4d-08c4d09324e2 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb1f064-87d5-4a0d-aa4d-08c4d09324e2 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d41ecb-502d-42a4-b4f5-caac238035ff tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '501878a769a948fe8dd877fefc2e1e4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43703497123d4491a4fb4a4f947c8631', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d41ecb-502d-42a4-b4f5-caac238035ff tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d41ecb-502d-42a4-b4f5-caac238035ff tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d41ecb-502d-42a4-b4f5-caac238035ff tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] PATH_INFO: `/v3/users/f89f851af36d480ab7d10d3506c60899` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d41ecb-502d-42a4-b4f5-caac238035ff tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] RBAC: Authorizing `identity:delete_user(user_id=f89f851af36d480ab7d10d3506c60899)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d41ecb-502d-42a4-b4f5-caac238035ff tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-d5d41ecb-502d-42a4-b4f5-caac238035ff tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] Could not find user: f89f851af36d480ab7d10d3506c60899.: keystone.exception.UserNotFound: Could not find user: f89f851af36d480ab7d10d3506c60899. May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: f89f851af36d480ab7d10d3506c60899. May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1756/3540] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:02:41 2024] DELETE /identity/v3/users/f89f851af36d480ab7d10d3506c60899 => generated 110 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d314087-0758-41fb-b93a-fa75d8f1b98f tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d314087-0758-41fb-b93a-fa75d8f1b98f tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e55b468-bfb2-4b3f-91b8-47a8b794ec01 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '501878a769a948fe8dd877fefc2e1e4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43703497123d4491a4fb4a4f947c8631', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e55b468-bfb2-4b3f-91b8-47a8b794ec01 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e55b468-bfb2-4b3f-91b8-47a8b794ec01 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e55b468-bfb2-4b3f-91b8-47a8b794ec01 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] PATH_INFO: `/v3/users/6886717a9cfb42a0a4142a0b982570ee` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e55b468-bfb2-4b3f-91b8-47a8b794ec01 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] RBAC: Authorizing `identity:delete_user(user_id=6886717a9cfb42a0a4142a0b982570ee)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e55b468-bfb2-4b3f-91b8-47a8b794ec01 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-7e55b468-bfb2-4b3f-91b8-47a8b794ec01 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] Could not find user: 6886717a9cfb42a0a4142a0b982570ee.: keystone.exception.UserNotFound: Could not find user: 6886717a9cfb42a0a4142a0b982570ee. May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 6886717a9cfb42a0a4142a0b982570ee. May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1785/3541] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:02:41 2024] DELETE /identity/v3/users/6886717a9cfb42a0a4142a0b982570ee => generated 110 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d41ecb-502d-42a4-b4f5-caac238035ff tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d41ecb-502d-42a4-b4f5-caac238035ff tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296017cb-980f-4ff2-98b3-2410b4bce7f6 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '501878a769a948fe8dd877fefc2e1e4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43703497123d4491a4fb4a4f947c8631', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296017cb-980f-4ff2-98b3-2410b4bce7f6 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296017cb-980f-4ff2-98b3-2410b4bce7f6 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296017cb-980f-4ff2-98b3-2410b4bce7f6 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] PATH_INFO: `/v3/users/b523155e680a4a14acd4f3a4295a8d26` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296017cb-980f-4ff2-98b3-2410b4bce7f6 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] RBAC: Authorizing `identity:delete_user(user_id=b523155e680a4a14acd4f3a4295a8d26)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296017cb-980f-4ff2-98b3-2410b4bce7f6 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-296017cb-980f-4ff2-98b3-2410b4bce7f6 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] Could not find user: b523155e680a4a14acd4f3a4295a8d26.: keystone.exception.UserNotFound: Could not find user: b523155e680a4a14acd4f3a4295a8d26. May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: b523155e680a4a14acd4f3a4295a8d26. May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1757/3542] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:02:41 2024] DELETE /identity/v3/users/b523155e680a4a14acd4f3a4295a8d26 => generated 110 bytes in 26 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e55b468-bfb2-4b3f-91b8-47a8b794ec01 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e55b468-bfb2-4b3f-91b8-47a8b794ec01 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d13693a-5c45-4fb3-b492-14c865cf2820 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '501878a769a948fe8dd877fefc2e1e4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43703497123d4491a4fb4a4f947c8631', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d13693a-5c45-4fb3-b492-14c865cf2820 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d13693a-5c45-4fb3-b492-14c865cf2820 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d13693a-5c45-4fb3-b492-14c865cf2820 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] PATH_INFO: `/v3/users/756070dd0b274fd8835b10a8fbe293d9` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d13693a-5c45-4fb3-b492-14c865cf2820 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] RBAC: Authorizing `identity:delete_user(user_id=756070dd0b274fd8835b10a8fbe293d9)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d13693a-5c45-4fb3-b492-14c865cf2820 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-8d13693a-5c45-4fb3-b492-14c865cf2820 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] Could not find user: 756070dd0b274fd8835b10a8fbe293d9.: keystone.exception.UserNotFound: Could not find user: 756070dd0b274fd8835b10a8fbe293d9. May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 756070dd0b274fd8835b10a8fbe293d9. May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1786/3543] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:02:41 2024] DELETE /identity/v3/users/756070dd0b274fd8835b10a8fbe293d9 => generated 110 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:02:41 l75lg1-v1 nova-scheduler[81196]: DEBUG dbcounter [-] [81196] Writing DB stats nova_cell0:SELECT=1,nova_cell0:UPDATE=1 {{(pid=81196) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296017cb-980f-4ff2-98b3-2410b4bce7f6 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296017cb-980f-4ff2-98b3-2410b4bce7f6 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88417171-4896-49f5-96cf-e2c01b19e6d6 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '501878a769a948fe8dd877fefc2e1e4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43703497123d4491a4fb4a4f947c8631', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88417171-4896-49f5-96cf-e2c01b19e6d6 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88417171-4896-49f5-96cf-e2c01b19e6d6 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88417171-4896-49f5-96cf-e2c01b19e6d6 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] PATH_INFO: `/v3/users/cdf8594f55cb448e9b2312d051486331` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88417171-4896-49f5-96cf-e2c01b19e6d6 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] RBAC: Authorizing `identity:delete_user(user_id=cdf8594f55cb448e9b2312d051486331)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88417171-4896-49f5-96cf-e2c01b19e6d6 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-88417171-4896-49f5-96cf-e2c01b19e6d6 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] Could not find user: cdf8594f55cb448e9b2312d051486331.: keystone.exception.UserNotFound: Could not find user: cdf8594f55cb448e9b2312d051486331. May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cdf8594f55cb448e9b2312d051486331. May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1758/3544] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:02:41 2024] DELETE /identity/v3/users/cdf8594f55cb448e9b2312d051486331 => generated 110 bytes in 27 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d13693a-5c45-4fb3-b492-14c865cf2820 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d13693a-5c45-4fb3-b492-14c865cf2820 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebb4758-7408-47a0-a58c-75f311523f00 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '501878a769a948fe8dd877fefc2e1e4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43703497123d4491a4fb4a4f947c8631', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebb4758-7408-47a0-a58c-75f311523f00 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebb4758-7408-47a0-a58c-75f311523f00 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebb4758-7408-47a0-a58c-75f311523f00 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] PATH_INFO: `/v3/users/a3784840ad6a4156929be55026b39776` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:41 l75lg1-v1 nova-scheduler[81194]: DEBUG dbcounter [-] [81194] Writing DB stats nova_cell0:SELECT=1 {{(pid=81194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebb4758-7408-47a0-a58c-75f311523f00 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] RBAC: Authorizing `identity:delete_user(user_id=a3784840ad6a4156929be55026b39776)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebb4758-7408-47a0-a58c-75f311523f00 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-6ebb4758-7408-47a0-a58c-75f311523f00 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] Could not find user: a3784840ad6a4156929be55026b39776.: keystone.exception.UserNotFound: Could not find user: a3784840ad6a4156929be55026b39776. May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: a3784840ad6a4156929be55026b39776. May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1787/3545] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:02:41 2024] DELETE /identity/v3/users/a3784840ad6a4156929be55026b39776 => generated 110 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88417171-4896-49f5-96cf-e2c01b19e6d6 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88417171-4896-49f5-96cf-e2c01b19e6d6 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d590e6af-9bd9-4689-be00-377a3938cbe5 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '501878a769a948fe8dd877fefc2e1e4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43703497123d4491a4fb4a4f947c8631', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d590e6af-9bd9-4689-be00-377a3938cbe5 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d590e6af-9bd9-4689-be00-377a3938cbe5 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d590e6af-9bd9-4689-be00-377a3938cbe5 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] PATH_INFO: `/v3/users/93bc07dfcf2c4861981da16395bddbc0` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d590e6af-9bd9-4689-be00-377a3938cbe5 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] RBAC: Authorizing `identity:delete_user(user_id=93bc07dfcf2c4861981da16395bddbc0)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d590e6af-9bd9-4689-be00-377a3938cbe5 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-d590e6af-9bd9-4689-be00-377a3938cbe5 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] Could not find user: 93bc07dfcf2c4861981da16395bddbc0.: keystone.exception.UserNotFound: Could not find user: 93bc07dfcf2c4861981da16395bddbc0. May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 93bc07dfcf2c4861981da16395bddbc0. May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1759/3546] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:02:41 2024] DELETE /identity/v3/users/93bc07dfcf2c4861981da16395bddbc0 => generated 110 bytes in 30 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebb4758-7408-47a0-a58c-75f311523f00 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebb4758-7408-47a0-a58c-75f311523f00 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da156dd-fa41-4c30-aa4c-d2d80729453e tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '501878a769a948fe8dd877fefc2e1e4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43703497123d4491a4fb4a4f947c8631', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da156dd-fa41-4c30-aa4c-d2d80729453e tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da156dd-fa41-4c30-aa4c-d2d80729453e tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da156dd-fa41-4c30-aa4c-d2d80729453e tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] PATH_INFO: `/v3/users/080fdf25a1154b6db0ae228e1c05b6b2` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da156dd-fa41-4c30-aa4c-d2d80729453e tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] RBAC: Authorizing `identity:delete_user(user_id=080fdf25a1154b6db0ae228e1c05b6b2)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:41 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da156dd-fa41-4c30-aa4c-d2d80729453e tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:42 l75lg1-v1 manila-scheduler[98327]: DEBUG dbcounter [-] [98327] Writing DB stats manila:SELECT=74,manila:UPDATE=11 {{(pid=98327) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:02:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-8da156dd-fa41-4c30-aa4c-d2d80729453e tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '080fdf25a1154b6db0ae228e1c05b6b2', 'request_id': 'req-8da156dd-fa41-4c30-aa4c-d2d80729453e'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-8da156dd-fa41-4c30-aa4c-d2d80729453e tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '080fdf25a1154b6db0ae228e1c05b6b2', 'request_id': 'req-8da156dd-fa41-4c30-aa4c-d2d80729453e'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-8da156dd-fa41-4c30-aa4c-d2d80729453e tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '080fdf25a1154b6db0ae228e1c05b6b2', 'request_id': 'req-8da156dd-fa41-4c30-aa4c-d2d80729453e'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-8da156dd-fa41-4c30-aa4c-d2d80729453e tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '080fdf25a1154b6db0ae228e1c05b6b2', 'request_id': 'req-8da156dd-fa41-4c30-aa4c-d2d80729453e'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-8da156dd-fa41-4c30-aa4c-d2d80729453e tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '080fdf25a1154b6db0ae228e1c05b6b2', 'request_id': 'req-8da156dd-fa41-4c30-aa4c-d2d80729453e'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:42 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1788/3547] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:02:41 2024] DELETE /identity/v3/users/080fdf25a1154b6db0ae228e1c05b6b2 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:02:42 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-de541ac8-ec8f-42ce-aa52-2bd1e7cfd4e8 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] DELETE http://10.27.203.238/share/v2/43703497123d4491a4fb4a4f947c8631/share-group-types/d9024459-7baa-4368-8b94-f8784627e28b May 28 13:02:42 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-de541ac8-ec8f-42ce-aa52-2bd1e7cfd4e8 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:02:42 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-de541ac8-ec8f-42ce-aa52-2bd1e7cfd4e8 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:02:42 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-de541ac8-ec8f-42ce-aa52-2bd1e7cfd4e8 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] http://10.27.203.238/share/v2/43703497123d4491a4fb4a4f947c8631/share-group-types/d9024459-7baa-4368-8b94-f8784627e28b returned with HTTP 204 May 28 13:02:42 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1290/2559] 10.27.203.238 () {64 vars in 1487 bytes} [Tue May 28 13:02:42 2024] DELETE /share/v2/43703497123d4491a4fb4a4f947c8631/share-group-types/d9024459-7baa-4368-8b94-f8784627e28b => generated 0 bytes in 38 msecs (HTTP/1.1 204) 6 headers in 245 bytes (1 switches on core 0) May 28 13:02:42 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-5548066b-a774-49b0-b06a-6e89f2307454 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] GET http://10.27.203.238/share/v2/43703497123d4491a4fb4a4f947c8631/share-group-types/d9024459-7baa-4368-8b94-f8784627e28b May 28 13:02:42 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-5548066b-a774-49b0-b06a-6e89f2307454 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:02:42 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-5548066b-a774-49b0-b06a-6e89f2307454 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:02:42 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-5548066b-a774-49b0-b06a-6e89f2307454 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] HTTP exception thrown: Share group type with id d9024459-7baa-4368-8b94-f8784627e28b not found. May 28 13:02:42 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-5548066b-a774-49b0-b06a-6e89f2307454 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] http://10.27.203.238/share/v2/43703497123d4491a4fb4a4f947c8631/share-group-types/d9024459-7baa-4368-8b94-f8784627e28b returned with HTTP 404 May 28 13:02:42 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1270/2560] 10.27.203.238 () {64 vars in 1484 bytes} [Tue May 28 13:02:42 2024] GET /share/v2/43703497123d4491a4fb4a4f947c8631/share-group-types/d9024459-7baa-4368-8b94-f8784627e28b => generated 118 bytes in 29 msecs (HTTP/1.1 404) 6 headers in 238 bytes (1 switches on core 0) May 28 13:02:42 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-c4a36f13-27e9-4bb0-8863-1566cf1fc2b2 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] DELETE http://10.27.203.238/share/v2/43703497123d4491a4fb4a4f947c8631/types/925a8783-fd97-4b29-8518-65f1e1ff98cd May 28 13:02:42 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-c4a36f13-27e9-4bb0-8863-1566cf1fc2b2 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:02:42 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-c4a36f13-27e9-4bb0-8863-1566cf1fc2b2 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] Calling method 'ShareTypesController._delete' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:02:42 l75lg1-v1 dstat.sh[49771]: 28-05 13:02:42| 10 2 85 2 0|5576M 1843M 278M 7926M| 13k 9800B| 0 11M| 0 1030 |7313 13k|1.11 1.15 1.06|1.0 1.0 0| 0 0 | 0 2048M| 29 364 0 46 2 May 28 13:02:42 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-c4a36f13-27e9-4bb0-8863-1566cf1fc2b2 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] http://10.27.203.238/share/v2/43703497123d4491a4fb4a4f947c8631/types/925a8783-fd97-4b29-8518-65f1e1ff98cd returned with HTTP 202 May 28 13:02:42 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1291/2561] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:02:42 2024] DELETE /share/v2/43703497123d4491a4fb4a4f947c8631/types/925a8783-fd97-4b29-8518-65f1e1ff98cd => generated 0 bytes in 47 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 13:02:42 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-865d582c-ae3c-4d5c-a4e6-f96892087d56 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] GET http://10.27.203.238/share/v2/43703497123d4491a4fb4a4f947c8631/types/925a8783-fd97-4b29-8518-65f1e1ff98cd May 28 13:02:42 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-865d582c-ae3c-4d5c-a4e6-f96892087d56 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:02:42 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-865d582c-ae3c-4d5c-a4e6-f96892087d56 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] Calling method 'ShareTypesController.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:02:42 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-865d582c-ae3c-4d5c-a4e6-f96892087d56 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] HTTP exception thrown: Share type not found. May 28 13:02:42 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-865d582c-ae3c-4d5c-a4e6-f96892087d56 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] http://10.27.203.238/share/v2/43703497123d4491a4fb4a4f947c8631/types/925a8783-fd97-4b29-8518-65f1e1ff98cd returned with HTTP 404 May 28 13:02:42 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1271/2562] 10.27.203.238 () {64 vars in 1448 bytes} [Tue May 28 13:02:42 2024] GET /share/v2/43703497123d4491a4fb4a4f947c8631/types/925a8783-fd97-4b29-8518-65f1e1ff98cd => generated 67 bytes in 12 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 13:02:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d590e6af-9bd9-4689-be00-377a3938cbe5 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-d590e6af-9bd9-4689-be00-377a3938cbe5 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:02:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d590e6af-9bd9-4689-be00-377a3938cbe5 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9a5691-f240-4ea6-b5b6-f1b8aff9fb33 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9a5691-f240-4ea6-b5b6-f1b8aff9fb33 None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9a5691-f240-4ea6-b5b6-f1b8aff9fb33 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9a5691-f240-4ea6-b5b6-f1b8aff9fb33 None admin] PATH_INFO: `/v3/users/d61d494df0874012aea5132018a73aa0` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9a5691-f240-4ea6-b5b6-f1b8aff9fb33 None admin] RBAC: Authorizing `identity:delete_user(user_id=d61d494df0874012aea5132018a73aa0)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9a5691-f240-4ea6-b5b6-f1b8aff9fb33 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-aa9a5691-f240-4ea6-b5b6-f1b8aff9fb33 None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd61d494df0874012aea5132018a73aa0', 'request_id': 'req-aa9a5691-f240-4ea6-b5b6-f1b8aff9fb33'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-aa9a5691-f240-4ea6-b5b6-f1b8aff9fb33 None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd61d494df0874012aea5132018a73aa0', 'request_id': 'req-aa9a5691-f240-4ea6-b5b6-f1b8aff9fb33'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-aa9a5691-f240-4ea6-b5b6-f1b8aff9fb33 None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd61d494df0874012aea5132018a73aa0', 'request_id': 'req-aa9a5691-f240-4ea6-b5b6-f1b8aff9fb33'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-aa9a5691-f240-4ea6-b5b6-f1b8aff9fb33 None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd61d494df0874012aea5132018a73aa0', 'request_id': 'req-aa9a5691-f240-4ea6-b5b6-f1b8aff9fb33'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-aa9a5691-f240-4ea6-b5b6-f1b8aff9fb33 None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd61d494df0874012aea5132018a73aa0', 'request_id': 'req-aa9a5691-f240-4ea6-b5b6-f1b8aff9fb33'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:42 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1760/3548] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 13:02:42 2024] DELETE /identity/v3/users/d61d494df0874012aea5132018a73aa0 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:02:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da156dd-fa41-4c30-aa4c-d2d80729453e tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da156dd-fa41-4c30-aa4c-d2d80729453e tempest-ShareTypeAvailabilityZonesNegativeTest-484126458 tempest-ShareTypeAvailabilityZonesNegativeTest-484126458-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca642e7-11cc-403a-a4ae-fbc5eb30684a None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca642e7-11cc-403a-a4ae-fbc5eb30684a None admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca642e7-11cc-403a-a4ae-fbc5eb30684a None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca642e7-11cc-403a-a4ae-fbc5eb30684a None admin] PATH_INFO: `/v3/users/914bf7fa11c14878bbbc055aebc9cb8f` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca642e7-11cc-403a-a4ae-fbc5eb30684a None admin] RBAC: Authorizing `identity:delete_user(user_id=914bf7fa11c14878bbbc055aebc9cb8f)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca642e7-11cc-403a-a4ae-fbc5eb30684a None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-1ca642e7-11cc-403a-a4ae-fbc5eb30684a None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '914bf7fa11c14878bbbc055aebc9cb8f', 'request_id': 'req-1ca642e7-11cc-403a-a4ae-fbc5eb30684a'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-1ca642e7-11cc-403a-a4ae-fbc5eb30684a None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '914bf7fa11c14878bbbc055aebc9cb8f', 'request_id': 'req-1ca642e7-11cc-403a-a4ae-fbc5eb30684a'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-1ca642e7-11cc-403a-a4ae-fbc5eb30684a None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '914bf7fa11c14878bbbc055aebc9cb8f', 'request_id': 'req-1ca642e7-11cc-403a-a4ae-fbc5eb30684a'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-1ca642e7-11cc-403a-a4ae-fbc5eb30684a None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '914bf7fa11c14878bbbc055aebc9cb8f', 'request_id': 'req-1ca642e7-11cc-403a-a4ae-fbc5eb30684a'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-1ca642e7-11cc-403a-a4ae-fbc5eb30684a None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '914bf7fa11c14878bbbc055aebc9cb8f', 'request_id': 'req-1ca642e7-11cc-403a-a4ae-fbc5eb30684a'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:42 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1789/3549] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 13:02:42 2024] DELETE /identity/v3/users/914bf7fa11c14878bbbc055aebc9cb8f => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:02:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9a5691-f240-4ea6-b5b6-f1b8aff9fb33 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-aa9a5691-f240-4ea6-b5b6-f1b8aff9fb33 None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:02:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9a5691-f240-4ea6-b5b6-f1b8aff9fb33 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbd9c83-a83c-428d-801d-0deca4e2feb1 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbd9c83-a83c-428d-801d-0deca4e2feb1 None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbd9c83-a83c-428d-801d-0deca4e2feb1 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbd9c83-a83c-428d-801d-0deca4e2feb1 None admin] PATH_INFO: `/v3/users/501878a769a948fe8dd877fefc2e1e4c` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbd9c83-a83c-428d-801d-0deca4e2feb1 None admin] RBAC: Authorizing `identity:delete_user(user_id=501878a769a948fe8dd877fefc2e1e4c)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbd9c83-a83c-428d-801d-0deca4e2feb1 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-9bbd9c83-a83c-428d-801d-0deca4e2feb1 None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '501878a769a948fe8dd877fefc2e1e4c', 'request_id': 'req-9bbd9c83-a83c-428d-801d-0deca4e2feb1'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-9bbd9c83-a83c-428d-801d-0deca4e2feb1 None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '501878a769a948fe8dd877fefc2e1e4c', 'request_id': 'req-9bbd9c83-a83c-428d-801d-0deca4e2feb1'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-9bbd9c83-a83c-428d-801d-0deca4e2feb1 None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '501878a769a948fe8dd877fefc2e1e4c', 'request_id': 'req-9bbd9c83-a83c-428d-801d-0deca4e2feb1'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-9bbd9c83-a83c-428d-801d-0deca4e2feb1 None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '501878a769a948fe8dd877fefc2e1e4c', 'request_id': 'req-9bbd9c83-a83c-428d-801d-0deca4e2feb1'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-9bbd9c83-a83c-428d-801d-0deca4e2feb1 None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '501878a769a948fe8dd877fefc2e1e4c', 'request_id': 'req-9bbd9c83-a83c-428d-801d-0deca4e2feb1'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:42 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1761/3550] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 13:02:42 2024] DELETE /identity/v3/users/501878a769a948fe8dd877fefc2e1e4c => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:02:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37d5ed1-bfe8-4c39-b8e6-ae91e8afe27c None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37d5ed1-bfe8-4c39-b8e6-ae91e8afe27c None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37d5ed1-bfe8-4c39-b8e6-ae91e8afe27c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:42 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-c37d5ed1-bfe8-4c39-b8e6-ae91e8afe27c None None] Truncating password to algorithm specific maximum length 72 characters. May 28 13:02:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-c37d5ed1-bfe8-4c39-b8e6-ae91e8afe27c None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 13:02:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-c37d5ed1-bfe8-4c39-b8e6-ae91e8afe27c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:02:42 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1790/3551] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 13:02:42 2024] POST /identity/v3/auth/tokens => generated 2960 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 13:02:42 l75lg1-v1 neutron-server[77618]: DEBUG neutron.wsgi [-] (77618) accepted ('10.27.203.238', 60376) {{(pid=77618) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 13:02:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbd9c83-a83c-428d-801d-0deca4e2feb1 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-9bbd9c83-a83c-428d-801d-0deca4e2feb1 None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:02:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbd9c83-a83c-428d-801d-0deca4e2feb1 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db3d25f-1482-40e3-9134-2626495ea9f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef17047035e4b518fd5360a01f2da1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db3d25f-1482-40e3-9134-2626495ea9f9 service neutron] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db3d25f-1482-40e3-9134-2626495ea9f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db3d25f-1482-40e3-9134-2626495ea9f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db3d25f-1482-40e3-9134-2626495ea9f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db3d25f-1482-40e3-9134-2626495ea9f9 service neutron] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:42 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1762/3552] 10.27.203.238 () {64 vars in 1432 bytes} [Tue May 28 13:02:42 2024] GET /identity/v3/auth/tokens => generated 2960 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 28 13:02:42 l75lg1-v1 neutron-server[77618]: INFO neutron.wsgi [None req-a4314c09-1061-483f-aab8-850da594a121 None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=4266cff201a043eabcc031a57a78388c&name=default HTTP/1.1" status: 200 len: 216 time: 0.0740886 May 28 13:02:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37d5ed1-bfe8-4c39-b8e6-ae91e8afe27c None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-c37d5ed1-bfe8-4c39-b8e6-ae91e8afe27c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:02:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37d5ed1-bfe8-4c39-b8e6-ae91e8afe27c None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99cbb7a-9a4c-4f04-95ad-abfb3cf5ee02 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99cbb7a-9a4c-4f04-95ad-abfb3cf5ee02 None admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99cbb7a-9a4c-4f04-95ad-abfb3cf5ee02 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99cbb7a-9a4c-4f04-95ad-abfb3cf5ee02 None admin] PATH_INFO: `/v3/projects/4266cff201a043eabcc031a57a78388c` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99cbb7a-9a4c-4f04-95ad-abfb3cf5ee02 None admin] RBAC: Authorizing `identity:delete_project(project_id=4266cff201a043eabcc031a57a78388c)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99cbb7a-9a4c-4f04-95ad-abfb3cf5ee02 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-c99cbb7a-9a4c-4f04-95ad-abfb3cf5ee02 None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4266cff201a043eabcc031a57a78388c', 'request_id': 'req-c99cbb7a-9a4c-4f04-95ad-abfb3cf5ee02'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-c99cbb7a-9a4c-4f04-95ad-abfb3cf5ee02 None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4266cff201a043eabcc031a57a78388c', 'request_id': 'req-c99cbb7a-9a4c-4f04-95ad-abfb3cf5ee02'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-c99cbb7a-9a4c-4f04-95ad-abfb3cf5ee02 None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4266cff201a043eabcc031a57a78388c', 'request_id': 'req-c99cbb7a-9a4c-4f04-95ad-abfb3cf5ee02'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-c99cbb7a-9a4c-4f04-95ad-abfb3cf5ee02 None admin] The token cache is being invalidate because project 4266cff201a043eabcc031a57a78388c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 13:02:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-c99cbb7a-9a4c-4f04-95ad-abfb3cf5ee02 None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:42 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-c99cbb7a-9a4c-4f04-95ad-abfb3cf5ee02 None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:42 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1791/3553] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 13:02:42 2024] DELETE /identity/v3/projects/4266cff201a043eabcc031a57a78388c => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:02:42 l75lg1-v1 neutron-server[77619]: DEBUG neutron.wsgi [-] (77619) accepted ('10.27.203.238', 60382) {{(pid=77619) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 13:02:42 l75lg1-v1 neutron-server[77619]: INFO neutron.wsgi [None req-895ac980-6ed1-4ab7-9fd6-a3309a8d9e43 None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=43703497123d4491a4fb4a4f947c8631&name=default HTTP/1.1" status: 200 len: 216 time: 0.0089228 May 28 13:02:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db3d25f-1482-40e3-9134-2626495ea9f9 service neutron] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db3d25f-1482-40e3-9134-2626495ea9f9 service neutron] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dde9c2f-cbbe-4f15-8c6a-11d7b474d316 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dde9c2f-cbbe-4f15-8c6a-11d7b474d316 None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dde9c2f-cbbe-4f15-8c6a-11d7b474d316 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dde9c2f-cbbe-4f15-8c6a-11d7b474d316 None admin] PATH_INFO: `/v3/projects/43703497123d4491a4fb4a4f947c8631` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dde9c2f-cbbe-4f15-8c6a-11d7b474d316 None admin] RBAC: Authorizing `identity:delete_project(project_id=43703497123d4491a4fb4a4f947c8631)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:42 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dde9c2f-cbbe-4f15-8c6a-11d7b474d316 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-8dde9c2f-cbbe-4f15-8c6a-11d7b474d316 None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43703497123d4491a4fb4a4f947c8631', 'request_id': 'req-8dde9c2f-cbbe-4f15-8c6a-11d7b474d316'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-8dde9c2f-cbbe-4f15-8c6a-11d7b474d316 None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43703497123d4491a4fb4a4f947c8631', 'request_id': 'req-8dde9c2f-cbbe-4f15-8c6a-11d7b474d316'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-8dde9c2f-cbbe-4f15-8c6a-11d7b474d316 None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43703497123d4491a4fb4a4f947c8631', 'request_id': 'req-8dde9c2f-cbbe-4f15-8c6a-11d7b474d316'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-8dde9c2f-cbbe-4f15-8c6a-11d7b474d316 None admin] The token cache is being invalidate because project 43703497123d4491a4fb4a4f947c8631 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 13:02:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-8dde9c2f-cbbe-4f15-8c6a-11d7b474d316 None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-8dde9c2f-cbbe-4f15-8c6a-11d7b474d316 None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:43 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1763/3554] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 13:02:42 2024] DELETE /identity/v3/projects/43703497123d4491a4fb4a4f947c8631 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:02:43 l75lg1-v1 neutron-server[77618]: DEBUG neutron.wsgi [-] (77618) accepted ('10.27.203.238', 60386) {{(pid=77618) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 13:02:43 l75lg1-v1 neutron-server[77618]: INFO neutron.wsgi [None req-7763b77a-d324-49b5-b7eb-7b7c1ea303a9 None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=02fec8b603b24425bf193bcba4106168&name=default HTTP/1.1" status: 200 len: 216 time: 0.0086620 May 28 13:02:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99cbb7a-9a4c-4f04-95ad-abfb3cf5ee02 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-c99cbb7a-9a4c-4f04-95ad-abfb3cf5ee02 None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:02:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99cbb7a-9a4c-4f04-95ad-abfb3cf5ee02 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00f743e-7e55-4e78-b2fb-fd702abc0153 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00f743e-7e55-4e78-b2fb-fd702abc0153 None admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00f743e-7e55-4e78-b2fb-fd702abc0153 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00f743e-7e55-4e78-b2fb-fd702abc0153 None admin] PATH_INFO: `/v3/projects/02fec8b603b24425bf193bcba4106168` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00f743e-7e55-4e78-b2fb-fd702abc0153 None admin] RBAC: Authorizing `identity:delete_project(project_id=02fec8b603b24425bf193bcba4106168)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00f743e-7e55-4e78-b2fb-fd702abc0153 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-a00f743e-7e55-4e78-b2fb-fd702abc0153 None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02fec8b603b24425bf193bcba4106168', 'request_id': 'req-a00f743e-7e55-4e78-b2fb-fd702abc0153'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-a00f743e-7e55-4e78-b2fb-fd702abc0153 None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02fec8b603b24425bf193bcba4106168', 'request_id': 'req-a00f743e-7e55-4e78-b2fb-fd702abc0153'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-a00f743e-7e55-4e78-b2fb-fd702abc0153 None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02fec8b603b24425bf193bcba4106168', 'request_id': 'req-a00f743e-7e55-4e78-b2fb-fd702abc0153'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-a00f743e-7e55-4e78-b2fb-fd702abc0153 None admin] The token cache is being invalidate because project 02fec8b603b24425bf193bcba4106168 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 13:02:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-a00f743e-7e55-4e78-b2fb-fd702abc0153 None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-a00f743e-7e55-4e78-b2fb-fd702abc0153 None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:43 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1792/3555] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 13:02:43 2024] DELETE /identity/v3/projects/02fec8b603b24425bf193bcba4106168 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:02:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e1975c-4c79-4ec4-b5be-5c2d8b831c9c None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e1975c-4c79-4ec4-b5be-5c2d8b831c9c None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e1975c-4c79-4ec4-b5be-5c2d8b831c9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:43 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-f1e1975c-4c79-4ec4-b5be-5c2d8b831c9c None None] Truncating password to algorithm specific maximum length 72 characters. May 28 13:02:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-f1e1975c-4c79-4ec4-b5be-5c2d8b831c9c None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 13:02:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-f1e1975c-4c79-4ec4-b5be-5c2d8b831c9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:02:43 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1764/3556] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 13:02:43 2024] POST /identity/v3/auth/tokens => generated 312 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 28 13:02:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9cec5d-300d-4d6d-a441-6da1d065f2da None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9cec5d-300d-4d6d-a441-6da1d065f2da None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9cec5d-300d-4d6d-a441-6da1d065f2da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:43 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-7b9cec5d-300d-4d6d-a441-6da1d065f2da None None] Truncating password to algorithm specific maximum length 72 characters. May 28 13:02:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-7b9cec5d-300d-4d6d-a441-6da1d065f2da None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 13:02:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-7b9cec5d-300d-4d6d-a441-6da1d065f2da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:02:43 l75lg1-v1 dstat.sh[49771]: 28-05 13:02:43| 9 1 86 3 0|5576M 1843M 278M 7927M| 17k 0 | 0 2048k| 0 303 |7071 13k|1.11 1.15 1.06|2.0 0 0| 0 0 | 0 2048M| 29 364 0 49 2 May 28 13:02:43 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1793/3557] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 13:02:43 2024] POST /identity/v3/auth/tokens => generated 2960 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 13:02:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e1975c-4c79-4ec4-b5be-5c2d8b831c9c None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e1975c-4c79-4ec4-b5be-5c2d8b831c9c None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd7875d-b19e-463b-882d-1d9c323fcce5 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd7875d-b19e-463b-882d-1d9c323fcce5 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd7875d-b19e-463b-882d-1d9c323fcce5 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd7875d-b19e-463b-882d-1d9c323fcce5 None admin] PATH_INFO: `/v3/domains` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd7875d-b19e-463b-882d-1d9c323fcce5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 13:02:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd7875d-b19e-463b-882d-1d9c323fcce5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd7875d-b19e-463b-882d-1d9c323fcce5 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:43 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1765/3558] 10.27.203.238 () {62 vars in 1220 bytes} [Tue May 28 13:02:43 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 13:02:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9cec5d-300d-4d6d-a441-6da1d065f2da None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9cec5d-300d-4d6d-a441-6da1d065f2da None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a8dd6e-395c-497c-bd67-639a9b398506 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a8dd6e-395c-497c-bd67-639a9b398506 None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a8dd6e-395c-497c-bd67-639a9b398506 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a8dd6e-395c-497c-bd67-639a9b398506 None admin] PATH_INFO: `/v3/projects` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a8dd6e-395c-497c-bd67-639a9b398506 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a8dd6e-395c-497c-bd67-639a9b398506 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:43 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1794/3559] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 13:02:43 2024] POST /identity/v3/projects => generated 383 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 13:02:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd7875d-b19e-463b-882d-1d9c323fcce5 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd7875d-b19e-463b-882d-1d9c323fcce5 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36710e39-7875-4ea6-9123-29db6c5908a2 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36710e39-7875-4ea6-9123-29db6c5908a2 None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36710e39-7875-4ea6-9123-29db6c5908a2 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36710e39-7875-4ea6-9123-29db6c5908a2 None admin] PATH_INFO: `/v3/users` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36710e39-7875-4ea6-9123-29db6c5908a2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36710e39-7875-4ea6-9123-29db6c5908a2 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:43 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-36710e39-7875-4ea6-9123-29db6c5908a2 None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 13:02:43 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1766/3560] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 13:02:43 2024] POST /identity/v3/users => generated 300 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 13:02:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a8dd6e-395c-497c-bd67-639a9b398506 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a8dd6e-395c-497c-bd67-639a9b398506 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcfce2e-630d-436b-96f3-e4789d7e0af1 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcfce2e-630d-436b-96f3-e4789d7e0af1 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcfce2e-630d-436b-96f3-e4789d7e0af1 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcfce2e-630d-436b-96f3-e4789d7e0af1 None admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcfce2e-630d-436b-96f3-e4789d7e0af1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcfce2e-630d-436b-96f3-e4789d7e0af1 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:43 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1795/3561] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 13:02:43 2024] GET /identity/v3/roles => generated 1680 bytes in 17 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 13:02:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36710e39-7875-4ea6-9123-29db6c5908a2 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36710e39-7875-4ea6-9123-29db6c5908a2 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2b7518-ff21-47d2-9bb8-653017777463 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2b7518-ff21-47d2-9bb8-653017777463 None admin] REQUEST_METHOD: `PUT` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2b7518-ff21-47d2-9bb8-653017777463 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2b7518-ff21-47d2-9bb8-653017777463 None admin] PATH_INFO: `/v3/projects/0318b2a2d76949c2ae43b7340f2d5ac4/users/f519318388444dbda4f966a4ee761159/roles/44620cad10ae407c90c91e2c296adb04` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2b7518-ff21-47d2-9bb8-653017777463 None admin] RBAC: Authorizing `identity:create_grant(project_id=0318b2a2d76949c2ae43b7340f2d5ac4, user_id=f519318388444dbda4f966a4ee761159, role_id=44620cad10ae407c90c91e2c296adb04)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2b7518-ff21-47d2-9bb8-653017777463 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:43 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1767/3562] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 13:02:43 2024] PUT /identity/v3/projects/0318b2a2d76949c2ae43b7340f2d5ac4/users/f519318388444dbda4f966a4ee761159/roles/44620cad10ae407c90c91e2c296adb04 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:02:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62df37d4-f7f4-4c14-9ce6-40d80cd53fab None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62df37d4-f7f4-4c14-9ce6-40d80cd53fab None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62df37d4-f7f4-4c14-9ce6-40d80cd53fab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:43 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-62df37d4-f7f4-4c14-9ce6-40d80cd53fab None None] Truncating password to algorithm specific maximum length 72 characters. May 28 13:02:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-62df37d4-f7f4-4c14-9ce6-40d80cd53fab None None] MFA Rules not processed for user `f519318388444dbda4f966a4ee761159`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 13:02:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-62df37d4-f7f4-4c14-9ce6-40d80cd53fab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:02:43 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1796/3563] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 13:02:43 2024] POST /identity/v3/auth/tokens => generated 3954 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 13:02:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2b7518-ff21-47d2-9bb8-653017777463 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2b7518-ff21-47d2-9bb8-653017777463 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8f3438-09ed-4f39-947f-ce80f0e3ce5c None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8f3438-09ed-4f39-947f-ce80f0e3ce5c None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8f3438-09ed-4f39-947f-ce80f0e3ce5c None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8f3438-09ed-4f39-947f-ce80f0e3ce5c None admin] PATH_INFO: `/v3/projects` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8f3438-09ed-4f39-947f-ce80f0e3ce5c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8f3438-09ed-4f39-947f-ce80f0e3ce5c None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:43 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1768/3564] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 13:02:43 2024] POST /identity/v3/projects => generated 383 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 13:02:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62df37d4-f7f4-4c14-9ce6-40d80cd53fab None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62df37d4-f7f4-4c14-9ce6-40d80cd53fab None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9663f2-b322-43c6-9b77-6996cf2747de None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9663f2-b322-43c6-9b77-6996cf2747de None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9663f2-b322-43c6-9b77-6996cf2747de None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9663f2-b322-43c6-9b77-6996cf2747de None admin] PATH_INFO: `/v3/users` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9663f2-b322-43c6-9b77-6996cf2747de None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9663f2-b322-43c6-9b77-6996cf2747de None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:43 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-5b9663f2-b322-43c6-9b77-6996cf2747de None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 13:02:43 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1797/3565] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 13:02:43 2024] POST /identity/v3/users => generated 300 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 13:02:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8f3438-09ed-4f39-947f-ce80f0e3ce5c None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8f3438-09ed-4f39-947f-ce80f0e3ce5c None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9639fd4-1cf5-4b9e-bd55-7a7e20d5c2cd None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9639fd4-1cf5-4b9e-bd55-7a7e20d5c2cd None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9639fd4-1cf5-4b9e-bd55-7a7e20d5c2cd None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9639fd4-1cf5-4b9e-bd55-7a7e20d5c2cd None admin] PATH_INFO: `/v3/roles` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9639fd4-1cf5-4b9e-bd55-7a7e20d5c2cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9639fd4-1cf5-4b9e-bd55-7a7e20d5c2cd None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:43 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1769/3566] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 13:02:43 2024] GET /identity/v3/roles => generated 1680 bytes in 18 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 13:02:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9663f2-b322-43c6-9b77-6996cf2747de None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9663f2-b322-43c6-9b77-6996cf2747de None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd6646a-187f-4d72-b339-cf9aadcf7138 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd6646a-187f-4d72-b339-cf9aadcf7138 None admin] REQUEST_METHOD: `PUT` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd6646a-187f-4d72-b339-cf9aadcf7138 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd6646a-187f-4d72-b339-cf9aadcf7138 None admin] PATH_INFO: `/v3/projects/da363610750345d090f9ba7b3356d45b/users/1db7447fa6d342758dd01a5de6bf25c2/roles/44620cad10ae407c90c91e2c296adb04` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd6646a-187f-4d72-b339-cf9aadcf7138 None admin] RBAC: Authorizing `identity:create_grant(project_id=da363610750345d090f9ba7b3356d45b, user_id=1db7447fa6d342758dd01a5de6bf25c2, role_id=44620cad10ae407c90c91e2c296adb04)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd6646a-187f-4d72-b339-cf9aadcf7138 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:43 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1798/3567] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 13:02:43 2024] PUT /identity/v3/projects/da363610750345d090f9ba7b3356d45b/users/1db7447fa6d342758dd01a5de6bf25c2/roles/44620cad10ae407c90c91e2c296adb04 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:02:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f578a07-977b-4d04-b2ca-9f1211f17182 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f578a07-977b-4d04-b2ca-9f1211f17182 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f578a07-977b-4d04-b2ca-9f1211f17182 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:43 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-2f578a07-977b-4d04-b2ca-9f1211f17182 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 13:02:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-2f578a07-977b-4d04-b2ca-9f1211f17182 None None] MFA Rules not processed for user `1db7447fa6d342758dd01a5de6bf25c2`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 13:02:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-2f578a07-977b-4d04-b2ca-9f1211f17182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:02:43 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-16d9049c-80fd-4c83-b1c7-4dfab3f0c621 tempest-SharesNegativeTest-1014773059 tempest-SharesNegativeTest-1014773059-project-member] GET http://10.27.203.238/share/v2/d1d71dc9f23c4c6a8e146d99ad65ebb2/shares/b05a8999-f1ac-4887-a675-3c2ca8e9cece May 28 13:02:43 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-16d9049c-80fd-4c83-b1c7-4dfab3f0c621 tempest-SharesNegativeTest-1014773059 tempest-SharesNegativeTest-1014773059-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:02:43 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-16d9049c-80fd-4c83-b1c7-4dfab3f0c621 tempest-SharesNegativeTest-1014773059 tempest-SharesNegativeTest-1014773059-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:02:43 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-16d9049c-80fd-4c83-b1c7-4dfab3f0c621 tempest-SharesNegativeTest-1014773059 tempest-SharesNegativeTest-1014773059-project-member] http://10.27.203.238/share/v2/d1d71dc9f23c4c6a8e146d99ad65ebb2/shares/b05a8999-f1ac-4887-a675-3c2ca8e9cece returned with HTTP 200 May 28 13:02:43 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1292/2563] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:02:43 2024] GET /share/v2/d1d71dc9f23c4c6a8e146d99ad65ebb2/shares/b05a8999-f1ac-4887-a675-3c2ca8e9cece => generated 1314 bytes in 28 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:02:43 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1770/3568] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 13:02:43 2024] POST /identity/v3/auth/tokens => generated 3954 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 13:02:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd6646a-187f-4d72-b339-cf9aadcf7138 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd6646a-187f-4d72-b339-cf9aadcf7138 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02a1b38-6681-417d-b002-28c18617e008 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02a1b38-6681-417d-b002-28c18617e008 None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02a1b38-6681-417d-b002-28c18617e008 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02a1b38-6681-417d-b002-28c18617e008 None admin] PATH_INFO: `/v3/projects` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02a1b38-6681-417d-b002-28c18617e008 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02a1b38-6681-417d-b002-28c18617e008 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:43 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1799/3569] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 13:02:43 2024] POST /identity/v3/projects => generated 381 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 13:02:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f578a07-977b-4d04-b2ca-9f1211f17182 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f578a07-977b-4d04-b2ca-9f1211f17182 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e370ea93-7b89-434a-914c-26cc40c41381 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e370ea93-7b89-434a-914c-26cc40c41381 None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e370ea93-7b89-434a-914c-26cc40c41381 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e370ea93-7b89-434a-914c-26cc40c41381 None admin] PATH_INFO: `/v3/users` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e370ea93-7b89-434a-914c-26cc40c41381 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e370ea93-7b89-434a-914c-26cc40c41381 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:43 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-e370ea93-7b89-434a-914c-26cc40c41381 None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 13:02:43 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1771/3570] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 13:02:43 2024] POST /identity/v3/users => generated 298 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 13:02:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02a1b38-6681-417d-b002-28c18617e008 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02a1b38-6681-417d-b002-28c18617e008 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae771a5-b611-4ba0-b88f-fdc21194124e None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae771a5-b611-4ba0-b88f-fdc21194124e None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae771a5-b611-4ba0-b88f-fdc21194124e None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae771a5-b611-4ba0-b88f-fdc21194124e None admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae771a5-b611-4ba0-b88f-fdc21194124e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae771a5-b611-4ba0-b88f-fdc21194124e None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:43 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1800/3571] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 13:02:43 2024] GET /identity/v3/roles => generated 1680 bytes in 17 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 13:02:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e370ea93-7b89-434a-914c-26cc40c41381 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e370ea93-7b89-434a-914c-26cc40c41381 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f67e4e-8fbf-4ecc-86a6-c81952ac600c None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f67e4e-8fbf-4ecc-86a6-c81952ac600c None admin] REQUEST_METHOD: `PUT` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f67e4e-8fbf-4ecc-86a6-c81952ac600c None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f67e4e-8fbf-4ecc-86a6-c81952ac600c None admin] PATH_INFO: `/v3/projects/df10044903af4bd59cdae616bef24539/users/da10f5550791458c84e2bcb8b8df0db9/roles/e7989893488f483baa107be56668c4f8` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f67e4e-8fbf-4ecc-86a6-c81952ac600c None admin] RBAC: Authorizing `identity:create_grant(project_id=df10044903af4bd59cdae616bef24539, user_id=da10f5550791458c84e2bcb8b8df0db9, role_id=e7989893488f483baa107be56668c4f8)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:43 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f67e4e-8fbf-4ecc-86a6-c81952ac600c None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:43 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1772/3572] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 13:02:43 2024] PUT /identity/v3/projects/df10044903af4bd59cdae616bef24539/users/da10f5550791458c84e2bcb8b8df0db9/roles/e7989893488f483baa107be56668c4f8 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:02:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae771a5-b611-4ba0-b88f-fdc21194124e None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:43 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae771a5-b611-4ba0-b88f-fdc21194124e None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a53fed-12e7-4c64-8e51-d1759a6b650f None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a53fed-12e7-4c64-8e51-d1759a6b650f None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a53fed-12e7-4c64-8e51-d1759a6b650f None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a53fed-12e7-4c64-8e51-d1759a6b650f None admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a53fed-12e7-4c64-8e51-d1759a6b650f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a53fed-12e7-4c64-8e51-d1759a6b650f None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1801/3573] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 13:02:43 2024] GET /identity/v3/roles => generated 1680 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f67e4e-8fbf-4ecc-86a6-c81952ac600c None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f67e4e-8fbf-4ecc-86a6-c81952ac600c None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeddf17-270f-444b-b1d9-8302234ca5b3 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeddf17-270f-444b-b1d9-8302234ca5b3 None admin] REQUEST_METHOD: `PUT` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeddf17-270f-444b-b1d9-8302234ca5b3 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeddf17-270f-444b-b1d9-8302234ca5b3 None admin] PATH_INFO: `/v3/projects/df10044903af4bd59cdae616bef24539/users/da10f5550791458c84e2bcb8b8df0db9/roles/e7989893488f483baa107be56668c4f8` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddeddf17-270f-444b-b1d9-8302234ca5b3 None admin] RBAC: Authorizing `identity:create_grant(project_id=df10044903af4bd59cdae616bef24539, user_id=da10f5550791458c84e2bcb8b8df0db9, role_id=e7989893488f483baa107be56668c4f8)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddeddf17-270f-444b-b1d9-8302234ca5b3 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1773/3574] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 13:02:44 2024] PUT /identity/v3/projects/df10044903af4bd59cdae616bef24539/users/da10f5550791458c84e2bcb8b8df0db9/roles/e7989893488f483baa107be56668c4f8 => generated 0 bytes in 18 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73674d11-7ef0-4cb1-874b-5893ecdc9935 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73674d11-7ef0-4cb1-874b-5893ecdc9935 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73674d11-7ef0-4cb1-874b-5893ecdc9935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-73674d11-7ef0-4cb1-874b-5893ecdc9935 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 13:02:44 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-93b28755-7e81-4995-8892-12b84a143ba4 tempest-SharesNegativeTest-1014773059 None] <<< [DELETE] https://127.0.0.1:40443/api/quotas/54/ May 28 13:02:44 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-93b28755-7e81-4995-8892-12b84a143ba4 tempest-SharesNegativeTest-1014773059 None] --- [DELETE] https://127.0.0.1:40443/api/quotas/54/: Done May 28 13:02:44 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-93b28755-7e81-4995-8892-12b84a143ba4 tempest-SharesNegativeTest-1014773059 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:02:44 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-93b28755-7e81-4995-8892-12b84a143ba4 tempest-SharesNegativeTest-1014773059 None] {'allow_redirects': True, May 28 13:02:44 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-93b28755-7e81-4995-8892-12b84a143ba4 tempest-SharesNegativeTest-1014773059 None] 'params': {'name': '27c3f247-5cdb-4bb3-9479-7b3253f9df42'}} May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-73674d11-7ef0-4cb1-874b-5893ecdc9935 None None] MFA Rules not processed for user `da10f5550791458c84e2bcb8b8df0db9`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-73674d11-7ef0-4cb1-874b-5893ecdc9935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1802/3575] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 13:02:44 2024] POST /identity/v3/auth/tokens => generated 4075 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeddf17-270f-444b-b1d9-8302234ca5b3 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeddf17-270f-444b-b1d9-8302234ca5b3 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2683c2-90be-47b8-98b5-66c0fb14b94d tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da10f5550791458c84e2bcb8b8df0db9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df10044903af4bd59cdae616bef24539', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2683c2-90be-47b8-98b5-66c0fb14b94d tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2683c2-90be-47b8-98b5-66c0fb14b94d tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2683c2-90be-47b8-98b5-66c0fb14b94d tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] PATH_INFO: `/v3/domains` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2683c2-90be-47b8-98b5-66c0fb14b94d tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2683c2-90be-47b8-98b5-66c0fb14b94d tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2683c2-90be-47b8-98b5-66c0fb14b94d tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1774/3576] 10.27.203.238 () {62 vars in 1241 bytes} [Tue May 28 13:02:44 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73674d11-7ef0-4cb1-874b-5893ecdc9935 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73674d11-7ef0-4cb1-874b-5893ecdc9935 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1435a238-a43c-4911-94e7-f60b4154eca3 tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da10f5550791458c84e2bcb8b8df0db9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df10044903af4bd59cdae616bef24539', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1435a238-a43c-4911-94e7-f60b4154eca3 tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1435a238-a43c-4911-94e7-f60b4154eca3 tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1435a238-a43c-4911-94e7-f60b4154eca3 tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] PATH_INFO: `/v3/users` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1435a238-a43c-4911-94e7-f60b4154eca3 tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1435a238-a43c-4911-94e7-f60b4154eca3 tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-1435a238-a43c-4911-94e7-f60b4154eca3 tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] Truncating password to algorithm specific maximum length 72 characters. May 28 13:02:44 l75lg1-v1 dstat.sh[49771]: 28-05 13:02:44| 10 1 86 2 0|5577M 1842M 278M 7927M| 12k 762B| 0 1816k| 0 209 |7025 12k|1.11 1.15 1.06|2.0 1.0 1.0| 0 0 | 0 2048M| 29 364 0 49 2 May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1803/3577] 10.27.203.238 () {64 vars in 1232 bytes} [Tue May 28 13:02:44 2024] POST /identity/v3/users => generated 433 bytes in 32 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2683c2-90be-47b8-98b5-66c0fb14b94d tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2683c2-90be-47b8-98b5-66c0fb14b94d tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f93aad1-ea80-4d6c-a2f4-8d99fd8bfd8b tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da10f5550791458c84e2bcb8b8df0db9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df10044903af4bd59cdae616bef24539', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f93aad1-ea80-4d6c-a2f4-8d99fd8bfd8b tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f93aad1-ea80-4d6c-a2f4-8d99fd8bfd8b tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f93aad1-ea80-4d6c-a2f4-8d99fd8bfd8b tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] PATH_INFO: `/v3/roles` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f93aad1-ea80-4d6c-a2f4-8d99fd8bfd8b tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f93aad1-ea80-4d6c-a2f4-8d99fd8bfd8b tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1775/3578] 10.27.203.238 () {62 vars in 1210 bytes} [Tue May 28 13:02:44 2024] GET /identity/v3/roles => generated 1680 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1435a238-a43c-4911-94e7-f60b4154eca3 tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1435a238-a43c-4911-94e7-f60b4154eca3 tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abeebc9-1707-438e-ae83-32e81e6c4c11 tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da10f5550791458c84e2bcb8b8df0db9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df10044903af4bd59cdae616bef24539', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abeebc9-1707-438e-ae83-32e81e6c4c11 tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] REQUEST_METHOD: `PUT` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abeebc9-1707-438e-ae83-32e81e6c4c11 tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abeebc9-1707-438e-ae83-32e81e6c4c11 tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] PATH_INFO: `/v3/projects/df10044903af4bd59cdae616bef24539/users/80737d9a590d4944acb593a5812e9c87/roles/44620cad10ae407c90c91e2c296adb04` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abeebc9-1707-438e-ae83-32e81e6c4c11 tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] RBAC: Authorizing `identity:create_grant(project_id=df10044903af4bd59cdae616bef24539, user_id=80737d9a590d4944acb593a5812e9c87, role_id=44620cad10ae407c90c91e2c296adb04)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abeebc9-1707-438e-ae83-32e81e6c4c11 tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1804/3579] 10.27.203.238 () {64 vars in 1571 bytes} [Tue May 28 13:02:44 2024] PUT /identity/v3/projects/df10044903af4bd59cdae616bef24539/users/80737d9a590d4944acb593a5812e9c87/roles/44620cad10ae407c90c91e2c296adb04 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f93aad1-ea80-4d6c-a2f4-8d99fd8bfd8b tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-2f93aad1-ea80-4d6c-a2f4-8d99fd8bfd8b tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f93aad1-ea80-4d6c-a2f4-8d99fd8bfd8b tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5342d908-779f-4365-a571-70979540d05c service manila] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f110cf6300f049c897d0aab63218d1e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5342d908-779f-4365-a571-70979540d05c service manila] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5342d908-779f-4365-a571-70979540d05c service manila] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5342d908-779f-4365-a571-70979540d05c service manila] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5342d908-779f-4365-a571-70979540d05c service manila] RBAC: Authorizing `identity:validate_token()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5342d908-779f-4365-a571-70979540d05c service manila] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1776/3580] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 13:02:44 2024] GET /identity/v3/auth/tokens => generated 4075 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 13:02:44 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-ec9422be-feec-4588-b9a2-b338140d0e54 tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] POST http://10.27.203.238/share/v2/df10044903af4bd59cdae616bef24539/types May 28 13:02:44 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-ec9422be-feec-4588-b9a2-b338140d0e54 tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share_type": {"name": "tempest-typeshare-type-482162715", "extra_specs": {"driver_handles_share_servers": "False"}, "share_type_access:is_public": true}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:02:44 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-ec9422be-feec-4588-b9a2-b338140d0e54 tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] http://10.27.203.238/share/v2/df10044903af4bd59cdae616bef24539/types returned with HTTP 200 May 28 13:02:44 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1272/2564] 10.27.203.238 () {66 vars in 1359 bytes} [Tue May 28 13:02:44 2024] POST /share/v2/df10044903af4bd59cdae616bef24539/types => generated 621 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:02:44 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-21e8f874-0fad-4e94-811c-ceb55d60f1ba tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] POST http://10.27.203.238/share/v2/df10044903af4bd59cdae616bef24539/types May 28 13:02:44 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-21e8f874-0fad-4e94-811c-ceb55d60f1ba tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share_type": {"name": "tempest-typeshare-type-1809135997", "extra_specs": {"driver_handles_share_servers": "False"}, "share_type_access:is_public": true}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:02:44 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-21e8f874-0fad-4e94-811c-ceb55d60f1ba tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] http://10.27.203.238/share/v2/df10044903af4bd59cdae616bef24539/types returned with HTTP 200 May 28 13:02:44 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1293/2565] 10.27.203.238 () {66 vars in 1359 bytes} [Tue May 28 13:02:44 2024] POST /share/v2/df10044903af4bd59cdae616bef24539/types => generated 623 bytes in 26 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:02:44 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-3ac90530-ed14-4e22-af0b-7d88f35f892e tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] PUT http://10.27.203.238/share/v2/df10044903af4bd59cdae616bef24539/types/f26a0e21-b494-484a-b56b-1e38f1e3a86b May 28 13:02:44 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-3ac90530-ed14-4e22-af0b-7d88f35f892e tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] Action: 'update', calling method: Controller.__getattribute__..version_select, body: {"share_type": {"name": ""}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:02:44 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-3ac90530-ed14-4e22-af0b-7d88f35f892e tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] HTTP exception thrown: Share type name cannot be empty. May 28 13:02:44 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-3ac90530-ed14-4e22-af0b-7d88f35f892e tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] http://10.27.203.238/share/v2/df10044903af4bd59cdae616bef24539/types/f26a0e21-b494-484a-b56b-1e38f1e3a86b returned with HTTP 400 May 28 13:02:44 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1273/2566] 10.27.203.238 () {66 vars in 1468 bytes} [Tue May 28 13:02:44 2024] PUT /share/v2/df10044903af4bd59cdae616bef24539/types/f26a0e21-b494-484a-b56b-1e38f1e3a86b => generated 76 bytes in 6 msecs (HTTP/1.1 400) 6 headers in 239 bytes (1 switches on core 0) May 28 13:02:44 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-7446e009-a054-4d2e-bf73-1451da46066f tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] PUT http://10.27.203.238/share/v2/df10044903af4bd59cdae616bef24539/types/f26a0e21-b494-484a-b56b-1e38f1e3a86b May 28 13:02:44 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-7446e009-a054-4d2e-bf73-1451da46066f tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] Action: 'update', calling method: Controller.__getattribute__..version_select, body: {"share_type": {"name": ""}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:02:44 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-7446e009-a054-4d2e-bf73-1451da46066f tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] HTTP exception thrown: Share type name cannot be empty. May 28 13:02:44 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-7446e009-a054-4d2e-bf73-1451da46066f tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] http://10.27.203.238/share/v2/df10044903af4bd59cdae616bef24539/types/f26a0e21-b494-484a-b56b-1e38f1e3a86b returned with HTTP 400 May 28 13:02:44 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1294/2567] 10.27.203.238 () {66 vars in 1468 bytes} [Tue May 28 13:02:44 2024] PUT /share/v2/df10044903af4bd59cdae616bef24539/types/f26a0e21-b494-484a-b56b-1e38f1e3a86b => generated 76 bytes in 10 msecs (HTTP/1.1 400) 6 headers in 239 bytes (1 switches on core 0) May 28 13:02:44 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-3f91d4db-b02e-48f9-835a-b1ada04c3c97 tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] PUT http://10.27.203.238/share/v2/df10044903af4bd59cdae616bef24539/types/f26a0e21-b494-484a-b56b-1e38f1e3a86b May 28 13:02:44 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-3f91d4db-b02e-48f9-835a-b1ada04c3c97 tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] Action: 'update', calling method: Controller.__getattribute__..version_select, body: {"share_type": {"share_type_access:is_public": "not_bool"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:02:44 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-3f91d4db-b02e-48f9-835a-b1ada04c3c97 tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] HTTP exception thrown: share_type_access:is_public has a non-boolean value. May 28 13:02:44 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-3f91d4db-b02e-48f9-835a-b1ada04c3c97 tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] http://10.27.203.238/share/v2/df10044903af4bd59cdae616bef24539/types/f26a0e21-b494-484a-b56b-1e38f1e3a86b returned with HTTP 400 May 28 13:02:44 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1274/2568] 10.27.203.238 () {66 vars in 1468 bytes} [Tue May 28 13:02:44 2024] PUT /share/v2/df10044903af4bd59cdae616bef24539/types/f26a0e21-b494-484a-b56b-1e38f1e3a86b => generated 96 bytes in 6 msecs (HTTP/1.1 400) 6 headers in 239 bytes (1 switches on core 0) May 28 13:02:44 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-e12626f6-c281-4553-9122-88dee9e05257 tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] PUT http://10.27.203.238/share/v2/df10044903af4bd59cdae616bef24539/types/f26a0e21-b494-484a-b56b-1e38f1e3a86b May 28 13:02:44 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-e12626f6-c281-4553-9122-88dee9e05257 tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] Action: 'update', calling method: Controller.__getattribute__..version_select, body: {"share_type": {"share_type_access:is_public": "not_bool"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:02:44 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-e12626f6-c281-4553-9122-88dee9e05257 tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] HTTP exception thrown: share_type_access:is_public has a non-boolean value. May 28 13:02:44 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-e12626f6-c281-4553-9122-88dee9e05257 tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] http://10.27.203.238/share/v2/df10044903af4bd59cdae616bef24539/types/f26a0e21-b494-484a-b56b-1e38f1e3a86b returned with HTTP 400 May 28 13:02:44 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1295/2569] 10.27.203.238 () {66 vars in 1468 bytes} [Tue May 28 13:02:44 2024] PUT /share/v2/df10044903af4bd59cdae616bef24539/types/f26a0e21-b494-484a-b56b-1e38f1e3a86b => generated 96 bytes in 9 msecs (HTTP/1.1 400) 6 headers in 239 bytes (1 switches on core 0) May 28 13:02:44 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-0f9a44ee-07b4-404f-bfb2-dfd6e874145e tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] PUT http://10.27.203.238/share/v2/df10044903af4bd59cdae616bef24539/types/f26a0e21-b494-484a-b56b-1e38f1e3a86b May 28 13:02:44 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-0f9a44ee-07b4-404f-bfb2-dfd6e874145e tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] Action: 'update', calling method: Controller.__getattribute__..version_select, body: {"share_type": {"description": "qhzCIUNAakTYsmblhZAtdyvthCCBVDBRaGWNRmkrIArszFiQKZFEgnBXBGYQSOaLkTVVnusXMTTfCDVUSmsZZSUkBrEICiwMmVpLIaSCYWOHoZMagdZyDmLcNIHgyMmayygptreVKwuGvGxgXGOzWcKuvegPXGgeItZxBkkdaKRhDAeSHTScnTpZICYcBWnasGfGLoRnugAMGkyTxgGGHRWOZNZbEpEOCTWWGGyQwVAgRuVpncxFUyNkABnCRZdH"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:02:44 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-0f9a44ee-07b4-404f-bfb2-dfd6e874145e tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] HTTP exception thrown: Share type description cannot be greater than 255 characters in length. May 28 13:02:44 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-0f9a44ee-07b4-404f-bfb2-dfd6e874145e tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] http://10.27.203.238/share/v2/df10044903af4bd59cdae616bef24539/types/f26a0e21-b494-484a-b56b-1e38f1e3a86b returned with HTTP 400 May 28 13:02:44 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1275/2570] 10.27.203.238 () {66 vars in 1469 bytes} [Tue May 28 13:02:44 2024] PUT /share/v2/df10044903af4bd59cdae616bef24539/types/f26a0e21-b494-484a-b56b-1e38f1e3a86b => generated 115 bytes in 6 msecs (HTTP/1.1 400) 6 headers in 240 bytes (1 switches on core 0) May 28 13:02:44 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-3b775560-931b-48d8-8340-0f49d6ccfd70 tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] PUT http://10.27.203.238/share/v2/df10044903af4bd59cdae616bef24539/types/f26a0e21-b494-484a-b56b-1e38f1e3a86b May 28 13:02:44 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-3b775560-931b-48d8-8340-0f49d6ccfd70 tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] Action: 'update', calling method: Controller.__getattribute__..version_select, body: {"share_type": {"description": "rgnripWmZkggEVCNTprBaHoltmOmDtUWucqXRsNHzvmgUMWcugSKeRZrMAnwBQKFccnNekHqsTGIlAKwYySoFysQtgsFKuxlHkVULmRnOrQUeaEuLhCoEZPQSHPuTnDHigFdGrtglLBAebxapNGfbGwzDOuREKEQLXEfmiGLCMfecPKaCRRKZslLNcxlKFKMIMeqbbgadCpvpIBmEgEiptvVvidsqIClucDWSDkbTInfxBfxGgYQSzbCEGKlZRFg"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:02:44 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-3b775560-931b-48d8-8340-0f49d6ccfd70 tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] HTTP exception thrown: Share type description cannot be greater than 255 characters in length. May 28 13:02:44 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-3b775560-931b-48d8-8340-0f49d6ccfd70 tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] http://10.27.203.238/share/v2/df10044903af4bd59cdae616bef24539/types/f26a0e21-b494-484a-b56b-1e38f1e3a86b returned with HTTP 400 May 28 13:02:44 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1296/2571] 10.27.203.238 () {66 vars in 1469 bytes} [Tue May 28 13:02:44 2024] PUT /share/v2/df10044903af4bd59cdae616bef24539/types/f26a0e21-b494-484a-b56b-1e38f1e3a86b => generated 115 bytes in 9 msecs (HTTP/1.1 400) 6 headers in 240 bytes (1 switches on core 0) May 28 13:02:44 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-ec15ad58-8758-4cc8-90f2-7020b03b43e8 tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] PUT http://10.27.203.238/share/v2/df10044903af4bd59cdae616bef24539/types/3b106a62-eb87-446a-a43b-678d704b8a12 May 28 13:02:44 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-ec15ad58-8758-4cc8-90f2-7020b03b43e8 tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] Action: 'update', calling method: Controller.__getattribute__..version_select, body: {"share_type": {"name": "tempest-typeshare-type-482162715"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:02:44 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-ec15ad58-8758-4cc8-90f2-7020b03b43e8 tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] HTTP exception thrown: Share Type tempest-typeshare-type-482162715 already exists. May 28 13:02:44 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-ec15ad58-8758-4cc8-90f2-7020b03b43e8 tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] http://10.27.203.238/share/v2/df10044903af4bd59cdae616bef24539/types/3b106a62-eb87-446a-a43b-678d704b8a12 returned with HTTP 409 May 28 13:02:44 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1276/2572] 10.27.203.238 () {66 vars in 1468 bytes} [Tue May 28 13:02:44 2024] PUT /share/v2/df10044903af4bd59cdae616bef24539/types/3b106a62-eb87-446a-a43b-678d704b8a12 => generated 111 bytes in 15 msecs (HTTP/1.1 409) 6 headers in 237 bytes (1 switches on core 0) May 28 13:02:44 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-93b28755-7e81-4995-8892-12b84a143ba4 tempest-SharesNegativeTest-1014773059 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:02:44 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-93b28755-7e81-4995-8892-12b84a143ba4 tempest-SharesNegativeTest-1014773059 None] [Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=0, created='2024-05-28T13:02:22.864749Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='cdad681d-e016-4f58-acf8-b1db8417ffd7', id=57, internal=False, is_s3_default_policy=False, name='27c3f247-5cdb-4bb3-9479-7b3253f9df42', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=[], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['*'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['*'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T13:02:23.196386Z', tenant_id=1, tenant_name='default', title='27c3f247-5cdb-4bb3-9479-7b3253f9df42', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/57/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[])] May 28 13:02:44 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-93b28755-7e81-4995-8892-12b84a143ba4 tempest-SharesNegativeTest-1014773059 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 13:02:44 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-93b28755-7e81-4995-8892-12b84a143ba4 tempest-SharesNegativeTest-1014773059 None] >>> [DELETE] https://127.0.0.1:40443/api/viewpolicies/57/ May 28 13:02:44 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-79701570-6a22-4f73-8530-14d5b3dd0fec tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] PUT http://10.27.203.238/share/v2/df10044903af4bd59cdae616bef24539/types/3b106a62-eb87-446a-a43b-678d704b8a12 May 28 13:02:44 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-79701570-6a22-4f73-8530-14d5b3dd0fec tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] Action: 'update', calling method: Controller.__getattribute__..version_select, body: {"share_type": {"name": "tempest-typeshare-type-482162715"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:02:44 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-79701570-6a22-4f73-8530-14d5b3dd0fec tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] HTTP exception thrown: Share Type tempest-typeshare-type-482162715 already exists. May 28 13:02:44 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-79701570-6a22-4f73-8530-14d5b3dd0fec tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] http://10.27.203.238/share/v2/df10044903af4bd59cdae616bef24539/types/3b106a62-eb87-446a-a43b-678d704b8a12 returned with HTTP 409 May 28 13:02:44 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1297/2573] 10.27.203.238 () {66 vars in 1468 bytes} [Tue May 28 13:02:44 2024] PUT /share/v2/df10044903af4bd59cdae616bef24539/types/3b106a62-eb87-446a-a43b-678d704b8a12 => generated 111 bytes in 21 msecs (HTTP/1.1 409) 6 headers in 237 bytes (1 switches on core 0) May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abeebc9-1707-438e-ae83-32e81e6c4c11 tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-1abeebc9-1707-438e-ae83-32e81e6c4c11 tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abeebc9-1707-438e-ae83-32e81e6c4c11 tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794fb238-5ce4-446c-ac74-45e5064d3f49 service manila] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f110cf6300f049c897d0aab63218d1e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794fb238-5ce4-446c-ac74-45e5064d3f49 service manila] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794fb238-5ce4-446c-ac74-45e5064d3f49 service manila] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794fb238-5ce4-446c-ac74-45e5064d3f49 service manila] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794fb238-5ce4-446c-ac74-45e5064d3f49 service manila] RBAC: Authorizing `identity:validate_token()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794fb238-5ce4-446c-ac74-45e5064d3f49 service manila] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1805/3581] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 13:02:44 2024] GET /identity/v3/auth/tokens => generated 3954 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 13:02:44 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-fd8934a7-1a58-448b-9c00-9b828adc4841 tempest-ShareTypesNegativeTest-1822649406 tempest-ShareTypesNegativeTest-1822649406-project-member] POST http://10.27.203.238/share/v1/0318b2a2d76949c2ae43b7340f2d5ac4/types/f26a0e21-b494-484a-b56b-1e38f1e3a86b/action May 28 13:02:44 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-fd8934a7-1a58-448b-9c00-9b828adc4841 tempest-ShareTypesNegativeTest-1822649406 tempest-ShareTypesNegativeTest-1822649406-project-member] Action body: b'{"addProjectAccess": {"project": "0318b2a2d76949c2ae43b7340f2d5ac4"}}' {{(pid=98330) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 13:02:44 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-fd8934a7-1a58-448b-9c00-9b828adc4841 tempest-ShareTypesNegativeTest-1822649406 tempest-ShareTypesNegativeTest-1822649406-project-member] Action: 'action', calling method: ShareTypesController._add_project_access, body: {"addProjectAccess": {"project": "0318b2a2d76949c2ae43b7340f2d5ac4"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:02:44 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.policy [None req-fd8934a7-1a58-448b-9c00-9b828adc4841 tempest-ShareTypesNegativeTest-1822649406 tempest-ShareTypesNegativeTest-1822649406-project-member] Policy check for share_type:add_project_access failed with credentials {'is_admin': False, 'user_id': 'f519318388444dbda4f966a4ee761159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0318b2a2d76949c2ae43b7340f2d5ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98330) authorize /opt/stack/manila/manila/policy.py:208}} May 28 13:02:44 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-fd8934a7-1a58-448b-9c00-9b828adc4841 tempest-ShareTypesNegativeTest-1822649406 tempest-ShareTypesNegativeTest-1822649406-project-member] HTTP exception thrown: Access was denied to this resource. May 28 13:02:44 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-fd8934a7-1a58-448b-9c00-9b828adc4841 tempest-ShareTypesNegativeTest-1822649406 tempest-ShareTypesNegativeTest-1822649406-project-member] http://10.27.203.238/share/v1/0318b2a2d76949c2ae43b7340f2d5ac4/types/f26a0e21-b494-484a-b56b-1e38f1e3a86b/action returned with HTTP 403 May 28 13:02:44 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1277/2574] 10.27.203.238 () {64 vars in 1447 bytes} [Tue May 28 13:02:44 2024] POST /share/v1/0318b2a2d76949c2ae43b7340f2d5ac4/types/f26a0e21-b494-484a-b56b-1e38f1e3a86b/action => generated 78 bytes in 78 msecs (HTTP/1.1 403) 6 headers in 236 bytes (1 switches on core 0) May 28 13:02:44 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-95f98564-e575-49b8-a760-8edd04d586a5 tempest-ShareTypesNegativeTest-1822649406 tempest-ShareTypesNegativeTest-1822649406-project-member] POST http://10.27.203.238/share/v1/0318b2a2d76949c2ae43b7340f2d5ac4/types May 28 13:02:44 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-95f98564-e575-49b8-a760-8edd04d586a5 tempest-ShareTypesNegativeTest-1822649406 tempest-ShareTypesNegativeTest-1822649406-project-member] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share_type": {"name": "tempest-used_user_creds-765157854", "extra_specs": {"driver_handles_share_servers": "False"}, "os-share-type-access:is_public": true}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:02:44 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.policy [None req-95f98564-e575-49b8-a760-8edd04d586a5 tempest-ShareTypesNegativeTest-1822649406 tempest-ShareTypesNegativeTest-1822649406-project-member] Policy check for share_type:create failed with credentials {'is_admin': False, 'user_id': 'f519318388444dbda4f966a4ee761159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0318b2a2d76949c2ae43b7340f2d5ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98329) authorize /opt/stack/manila/manila/policy.py:208}} May 28 13:02:44 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-95f98564-e575-49b8-a760-8edd04d586a5 tempest-ShareTypesNegativeTest-1822649406 tempest-ShareTypesNegativeTest-1822649406-project-member] HTTP exception thrown: Access was denied to this resource. May 28 13:02:44 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-95f98564-e575-49b8-a760-8edd04d586a5 tempest-ShareTypesNegativeTest-1822649406 tempest-ShareTypesNegativeTest-1822649406-project-member] http://10.27.203.238/share/v1/0318b2a2d76949c2ae43b7340f2d5ac4/types returned with HTTP 403 May 28 13:02:44 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1298/2575] 10.27.203.238 () {64 vars in 1316 bytes} [Tue May 28 13:02:44 2024] POST /share/v1/0318b2a2d76949c2ae43b7340f2d5ac4/types => generated 78 bytes in 6 msecs (HTTP/1.1 403) 6 headers in 236 bytes (1 switches on core 0) May 28 13:02:44 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-03ef271b-036e-4412-8a82-61a3ea599742 tempest-ShareTypesNegativeTest-1822649406 tempest-ShareTypesNegativeTest-1822649406-project-member] DELETE http://10.27.203.238/share/v1/0318b2a2d76949c2ae43b7340f2d5ac4/types/f26a0e21-b494-484a-b56b-1e38f1e3a86b May 28 13:02:44 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-03ef271b-036e-4412-8a82-61a3ea599742 tempest-ShareTypesNegativeTest-1822649406 tempest-ShareTypesNegativeTest-1822649406-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:02:44 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-03ef271b-036e-4412-8a82-61a3ea599742 tempest-ShareTypesNegativeTest-1822649406 tempest-ShareTypesNegativeTest-1822649406-project-member] Calling method 'ShareTypesController._delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:02:44 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.policy [None req-03ef271b-036e-4412-8a82-61a3ea599742 tempest-ShareTypesNegativeTest-1822649406 tempest-ShareTypesNegativeTest-1822649406-project-member] Policy check for share_type:delete failed with credentials {'is_admin': False, 'user_id': 'f519318388444dbda4f966a4ee761159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0318b2a2d76949c2ae43b7340f2d5ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98330) authorize /opt/stack/manila/manila/policy.py:208}} May 28 13:02:44 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-03ef271b-036e-4412-8a82-61a3ea599742 tempest-ShareTypesNegativeTest-1822649406 tempest-ShareTypesNegativeTest-1822649406-project-member] HTTP exception thrown: Access was denied to this resource. May 28 13:02:44 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-03ef271b-036e-4412-8a82-61a3ea599742 tempest-ShareTypesNegativeTest-1822649406 tempest-ShareTypesNegativeTest-1822649406-project-member] http://10.27.203.238/share/v1/0318b2a2d76949c2ae43b7340f2d5ac4/types/f26a0e21-b494-484a-b56b-1e38f1e3a86b returned with HTTP 403 May 28 13:02:44 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1278/2576] 10.27.203.238 () {62 vars in 1408 bytes} [Tue May 28 13:02:44 2024] DELETE /share/v1/0318b2a2d76949c2ae43b7340f2d5ac4/types/f26a0e21-b494-484a-b56b-1e38f1e3a86b => generated 78 bytes in 7 msecs (HTTP/1.1 403) 6 headers in 236 bytes (1 switches on core 0) May 28 13:02:44 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-459e2ebb-dc94-44c4-823f-4f3e19fdcc3f tempest-ShareTypesNegativeTest-1822649406 tempest-ShareTypesNegativeTest-1822649406-project-member] POST http://10.27.203.238/share/v1/0318b2a2d76949c2ae43b7340f2d5ac4/types/f26a0e21-b494-484a-b56b-1e38f1e3a86b/action May 28 13:02:44 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-459e2ebb-dc94-44c4-823f-4f3e19fdcc3f tempest-ShareTypesNegativeTest-1822649406 tempest-ShareTypesNegativeTest-1822649406-project-member] Action body: b'{"removeProjectAccess": {"project": "0318b2a2d76949c2ae43b7340f2d5ac4"}}' {{(pid=98329) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 13:02:44 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-459e2ebb-dc94-44c4-823f-4f3e19fdcc3f tempest-ShareTypesNegativeTest-1822649406 tempest-ShareTypesNegativeTest-1822649406-project-member] Action: 'action', calling method: ShareTypesController._remove_project_access, body: {"removeProjectAccess": {"project": "0318b2a2d76949c2ae43b7340f2d5ac4"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:02:44 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.policy [None req-459e2ebb-dc94-44c4-823f-4f3e19fdcc3f tempest-ShareTypesNegativeTest-1822649406 tempest-ShareTypesNegativeTest-1822649406-project-member] Policy check for share_type:remove_project_access failed with credentials {'is_admin': False, 'user_id': 'f519318388444dbda4f966a4ee761159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0318b2a2d76949c2ae43b7340f2d5ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98329) authorize /opt/stack/manila/manila/policy.py:208}} May 28 13:02:44 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-459e2ebb-dc94-44c4-823f-4f3e19fdcc3f tempest-ShareTypesNegativeTest-1822649406 tempest-ShareTypesNegativeTest-1822649406-project-member] HTTP exception thrown: Access was denied to this resource. May 28 13:02:44 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-459e2ebb-dc94-44c4-823f-4f3e19fdcc3f tempest-ShareTypesNegativeTest-1822649406 tempest-ShareTypesNegativeTest-1822649406-project-member] http://10.27.203.238/share/v1/0318b2a2d76949c2ae43b7340f2d5ac4/types/f26a0e21-b494-484a-b56b-1e38f1e3a86b/action returned with HTTP 403 May 28 13:02:44 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1299/2577] 10.27.203.238 () {64 vars in 1447 bytes} [Tue May 28 13:02:44 2024] POST /share/v1/0318b2a2d76949c2ae43b7340f2d5ac4/types/f26a0e21-b494-484a-b56b-1e38f1e3a86b/action => generated 78 bytes in 8 msecs (HTTP/1.1 403) 6 headers in 236 bytes (1 switches on core 0) May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5342d908-779f-4365-a571-70979540d05c service manila] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5342d908-779f-4365-a571-70979540d05c service manila] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f728a00-280a-4c2f-8d8b-bc453d826046 tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da10f5550791458c84e2bcb8b8df0db9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df10044903af4bd59cdae616bef24539', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f728a00-280a-4c2f-8d8b-bc453d826046 tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f728a00-280a-4c2f-8d8b-bc453d826046 tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f728a00-280a-4c2f-8d8b-bc453d826046 tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] PATH_INFO: `/v3/users/8688f80695814f34bfb56342c4e54028` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f728a00-280a-4c2f-8d8b-bc453d826046 tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] RBAC: Authorizing `identity:delete_user(user_id=8688f80695814f34bfb56342c4e54028)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f728a00-280a-4c2f-8d8b-bc453d826046 tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-9f728a00-280a-4c2f-8d8b-bc453d826046 tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] Could not find user: 8688f80695814f34bfb56342c4e54028.: keystone.exception.UserNotFound: Could not find user: 8688f80695814f34bfb56342c4e54028. May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 8688f80695814f34bfb56342c4e54028. May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1777/3582] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:02:44 2024] DELETE /identity/v3/users/8688f80695814f34bfb56342c4e54028 => generated 110 bytes in 24 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794fb238-5ce4-446c-ac74-45e5064d3f49 service manila] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794fb238-5ce4-446c-ac74-45e5064d3f49 service manila] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1a671b-4a49-488a-9c33-586bb4608a8c tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da10f5550791458c84e2bcb8b8df0db9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df10044903af4bd59cdae616bef24539', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1a671b-4a49-488a-9c33-586bb4608a8c tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1a671b-4a49-488a-9c33-586bb4608a8c tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1a671b-4a49-488a-9c33-586bb4608a8c tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] PATH_INFO: `/v3/users/108a25e436e9452a9a865957dcea1fc5` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1a671b-4a49-488a-9c33-586bb4608a8c tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] RBAC: Authorizing `identity:delete_user(user_id=108a25e436e9452a9a865957dcea1fc5)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1a671b-4a49-488a-9c33-586bb4608a8c tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-ae1a671b-4a49-488a-9c33-586bb4608a8c tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] Could not find user: 108a25e436e9452a9a865957dcea1fc5.: keystone.exception.UserNotFound: Could not find user: 108a25e436e9452a9a865957dcea1fc5. May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 108a25e436e9452a9a865957dcea1fc5. May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1806/3583] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:02:44 2024] DELETE /identity/v3/users/108a25e436e9452a9a865957dcea1fc5 => generated 110 bytes in 29 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f728a00-280a-4c2f-8d8b-bc453d826046 tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f728a00-280a-4c2f-8d8b-bc453d826046 tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e84403-3a2a-41b7-a18f-73db6b57bc36 tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da10f5550791458c84e2bcb8b8df0db9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df10044903af4bd59cdae616bef24539', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e84403-3a2a-41b7-a18f-73db6b57bc36 tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e84403-3a2a-41b7-a18f-73db6b57bc36 tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e84403-3a2a-41b7-a18f-73db6b57bc36 tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] PATH_INFO: `/v3/users/5ae5cb1db3504baaba1df93dc154a004` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e84403-3a2a-41b7-a18f-73db6b57bc36 tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] RBAC: Authorizing `identity:delete_user(user_id=5ae5cb1db3504baaba1df93dc154a004)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e84403-3a2a-41b7-a18f-73db6b57bc36 tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-37e84403-3a2a-41b7-a18f-73db6b57bc36 tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] Could not find user: 5ae5cb1db3504baaba1df93dc154a004.: keystone.exception.UserNotFound: Could not find user: 5ae5cb1db3504baaba1df93dc154a004. May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 5ae5cb1db3504baaba1df93dc154a004. May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1778/3584] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:02:44 2024] DELETE /identity/v3/users/5ae5cb1db3504baaba1df93dc154a004 => generated 110 bytes in 25 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1a671b-4a49-488a-9c33-586bb4608a8c tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1a671b-4a49-488a-9c33-586bb4608a8c tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476feed2-4952-4448-9b59-e2007b0dbf90 tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da10f5550791458c84e2bcb8b8df0db9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df10044903af4bd59cdae616bef24539', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476feed2-4952-4448-9b59-e2007b0dbf90 tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476feed2-4952-4448-9b59-e2007b0dbf90 tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476feed2-4952-4448-9b59-e2007b0dbf90 tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] PATH_INFO: `/v3/users/c2ac6ca3ea5a4ae498df6d12bb7caadc` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476feed2-4952-4448-9b59-e2007b0dbf90 tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] RBAC: Authorizing `identity:delete_user(user_id=c2ac6ca3ea5a4ae498df6d12bb7caadc)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476feed2-4952-4448-9b59-e2007b0dbf90 tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-476feed2-4952-4448-9b59-e2007b0dbf90 tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] Could not find user: c2ac6ca3ea5a4ae498df6d12bb7caadc.: keystone.exception.UserNotFound: Could not find user: c2ac6ca3ea5a4ae498df6d12bb7caadc. May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: c2ac6ca3ea5a4ae498df6d12bb7caadc. May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1807/3585] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:02:44 2024] DELETE /identity/v3/users/c2ac6ca3ea5a4ae498df6d12bb7caadc => generated 110 bytes in 28 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e84403-3a2a-41b7-a18f-73db6b57bc36 tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e84403-3a2a-41b7-a18f-73db6b57bc36 tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a82377-653a-4233-a960-fcdf91e11b0e tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da10f5550791458c84e2bcb8b8df0db9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df10044903af4bd59cdae616bef24539', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a82377-653a-4233-a960-fcdf91e11b0e tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a82377-653a-4233-a960-fcdf91e11b0e tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a82377-653a-4233-a960-fcdf91e11b0e tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] PATH_INFO: `/v3/users/f89f851af36d480ab7d10d3506c60899` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a82377-653a-4233-a960-fcdf91e11b0e tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] RBAC: Authorizing `identity:delete_user(user_id=f89f851af36d480ab7d10d3506c60899)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a82377-653a-4233-a960-fcdf91e11b0e tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-57a82377-653a-4233-a960-fcdf91e11b0e tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] Could not find user: f89f851af36d480ab7d10d3506c60899.: keystone.exception.UserNotFound: Could not find user: f89f851af36d480ab7d10d3506c60899. May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: f89f851af36d480ab7d10d3506c60899. May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1779/3586] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:02:44 2024] DELETE /identity/v3/users/f89f851af36d480ab7d10d3506c60899 => generated 110 bytes in 25 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476feed2-4952-4448-9b59-e2007b0dbf90 tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476feed2-4952-4448-9b59-e2007b0dbf90 tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434c161b-e50c-47f6-aa33-6a9b07634d9d tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da10f5550791458c84e2bcb8b8df0db9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df10044903af4bd59cdae616bef24539', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434c161b-e50c-47f6-aa33-6a9b07634d9d tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434c161b-e50c-47f6-aa33-6a9b07634d9d tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434c161b-e50c-47f6-aa33-6a9b07634d9d tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] PATH_INFO: `/v3/users/6886717a9cfb42a0a4142a0b982570ee` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434c161b-e50c-47f6-aa33-6a9b07634d9d tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] RBAC: Authorizing `identity:delete_user(user_id=6886717a9cfb42a0a4142a0b982570ee)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:44 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434c161b-e50c-47f6-aa33-6a9b07634d9d tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-434c161b-e50c-47f6-aa33-6a9b07634d9d tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] Could not find user: 6886717a9cfb42a0a4142a0b982570ee.: keystone.exception.UserNotFound: Could not find user: 6886717a9cfb42a0a4142a0b982570ee. May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 6886717a9cfb42a0a4142a0b982570ee. May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1808/3587] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:02:44 2024] DELETE /identity/v3/users/6886717a9cfb42a0a4142a0b982570ee => generated 110 bytes in 28 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a82377-653a-4233-a960-fcdf91e11b0e tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a82377-653a-4233-a960-fcdf91e11b0e tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5b3a0e-5135-4875-9c29-d202935e0a88 tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da10f5550791458c84e2bcb8b8df0db9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df10044903af4bd59cdae616bef24539', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5b3a0e-5135-4875-9c29-d202935e0a88 tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5b3a0e-5135-4875-9c29-d202935e0a88 tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5b3a0e-5135-4875-9c29-d202935e0a88 tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] PATH_INFO: `/v3/users/b523155e680a4a14acd4f3a4295a8d26` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5b3a0e-5135-4875-9c29-d202935e0a88 tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] RBAC: Authorizing `identity:delete_user(user_id=b523155e680a4a14acd4f3a4295a8d26)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5b3a0e-5135-4875-9c29-d202935e0a88 tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-5c5b3a0e-5135-4875-9c29-d202935e0a88 tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] Could not find user: b523155e680a4a14acd4f3a4295a8d26.: keystone.exception.UserNotFound: Could not find user: b523155e680a4a14acd4f3a4295a8d26. May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: b523155e680a4a14acd4f3a4295a8d26. May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1780/3588] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:02:45 2024] DELETE /identity/v3/users/b523155e680a4a14acd4f3a4295a8d26 => generated 110 bytes in 27 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434c161b-e50c-47f6-aa33-6a9b07634d9d tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434c161b-e50c-47f6-aa33-6a9b07634d9d tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94718bea-9a1a-42fb-8575-93d10f191696 tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da10f5550791458c84e2bcb8b8df0db9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df10044903af4bd59cdae616bef24539', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94718bea-9a1a-42fb-8575-93d10f191696 tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94718bea-9a1a-42fb-8575-93d10f191696 tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94718bea-9a1a-42fb-8575-93d10f191696 tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] PATH_INFO: `/v3/users/756070dd0b274fd8835b10a8fbe293d9` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94718bea-9a1a-42fb-8575-93d10f191696 tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] RBAC: Authorizing `identity:delete_user(user_id=756070dd0b274fd8835b10a8fbe293d9)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94718bea-9a1a-42fb-8575-93d10f191696 tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-94718bea-9a1a-42fb-8575-93d10f191696 tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] Could not find user: 756070dd0b274fd8835b10a8fbe293d9.: keystone.exception.UserNotFound: Could not find user: 756070dd0b274fd8835b10a8fbe293d9. May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 756070dd0b274fd8835b10a8fbe293d9. May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1809/3589] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:02:45 2024] DELETE /identity/v3/users/756070dd0b274fd8835b10a8fbe293d9 => generated 110 bytes in 26 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5b3a0e-5135-4875-9c29-d202935e0a88 tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5b3a0e-5135-4875-9c29-d202935e0a88 tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3996407-968c-4773-aba3-5fca94c95f47 tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da10f5550791458c84e2bcb8b8df0db9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df10044903af4bd59cdae616bef24539', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3996407-968c-4773-aba3-5fca94c95f47 tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3996407-968c-4773-aba3-5fca94c95f47 tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3996407-968c-4773-aba3-5fca94c95f47 tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] PATH_INFO: `/v3/users/cdf8594f55cb448e9b2312d051486331` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3996407-968c-4773-aba3-5fca94c95f47 tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] RBAC: Authorizing `identity:delete_user(user_id=cdf8594f55cb448e9b2312d051486331)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3996407-968c-4773-aba3-5fca94c95f47 tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-c3996407-968c-4773-aba3-5fca94c95f47 tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] Could not find user: cdf8594f55cb448e9b2312d051486331.: keystone.exception.UserNotFound: Could not find user: cdf8594f55cb448e9b2312d051486331. May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cdf8594f55cb448e9b2312d051486331. May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1781/3590] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:02:45 2024] DELETE /identity/v3/users/cdf8594f55cb448e9b2312d051486331 => generated 110 bytes in 27 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94718bea-9a1a-42fb-8575-93d10f191696 tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94718bea-9a1a-42fb-8575-93d10f191696 tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2527ca0-8870-45f6-a8f6-dc5f0e500f89 tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da10f5550791458c84e2bcb8b8df0db9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df10044903af4bd59cdae616bef24539', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2527ca0-8870-45f6-a8f6-dc5f0e500f89 tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2527ca0-8870-45f6-a8f6-dc5f0e500f89 tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2527ca0-8870-45f6-a8f6-dc5f0e500f89 tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] PATH_INFO: `/v3/users/a3784840ad6a4156929be55026b39776` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2527ca0-8870-45f6-a8f6-dc5f0e500f89 tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] RBAC: Authorizing `identity:delete_user(user_id=a3784840ad6a4156929be55026b39776)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2527ca0-8870-45f6-a8f6-dc5f0e500f89 tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-e2527ca0-8870-45f6-a8f6-dc5f0e500f89 tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] Could not find user: a3784840ad6a4156929be55026b39776.: keystone.exception.UserNotFound: Could not find user: a3784840ad6a4156929be55026b39776. May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: a3784840ad6a4156929be55026b39776. May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1810/3591] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:02:45 2024] DELETE /identity/v3/users/a3784840ad6a4156929be55026b39776 => generated 110 bytes in 26 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3996407-968c-4773-aba3-5fca94c95f47 tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3996407-968c-4773-aba3-5fca94c95f47 tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123798b5-48cf-4bc3-81e3-56375fae8968 tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da10f5550791458c84e2bcb8b8df0db9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df10044903af4bd59cdae616bef24539', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123798b5-48cf-4bc3-81e3-56375fae8968 tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123798b5-48cf-4bc3-81e3-56375fae8968 tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123798b5-48cf-4bc3-81e3-56375fae8968 tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] PATH_INFO: `/v3/users/93bc07dfcf2c4861981da16395bddbc0` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123798b5-48cf-4bc3-81e3-56375fae8968 tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] RBAC: Authorizing `identity:delete_user(user_id=93bc07dfcf2c4861981da16395bddbc0)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123798b5-48cf-4bc3-81e3-56375fae8968 tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-123798b5-48cf-4bc3-81e3-56375fae8968 tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] Could not find user: 93bc07dfcf2c4861981da16395bddbc0.: keystone.exception.UserNotFound: Could not find user: 93bc07dfcf2c4861981da16395bddbc0. May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 93bc07dfcf2c4861981da16395bddbc0. May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1782/3592] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:02:45 2024] DELETE /identity/v3/users/93bc07dfcf2c4861981da16395bddbc0 => generated 110 bytes in 26 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2527ca0-8870-45f6-a8f6-dc5f0e500f89 tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2527ca0-8870-45f6-a8f6-dc5f0e500f89 tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aeddb88-02b3-4b85-ba50-846bd55a31a1 tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da10f5550791458c84e2bcb8b8df0db9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df10044903af4bd59cdae616bef24539', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeddb88-02b3-4b85-ba50-846bd55a31a1 tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeddb88-02b3-4b85-ba50-846bd55a31a1 tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeddb88-02b3-4b85-ba50-846bd55a31a1 tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] PATH_INFO: `/v3/users/080fdf25a1154b6db0ae228e1c05b6b2` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aeddb88-02b3-4b85-ba50-846bd55a31a1 tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] RBAC: Authorizing `identity:delete_user(user_id=080fdf25a1154b6db0ae228e1c05b6b2)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aeddb88-02b3-4b85-ba50-846bd55a31a1 tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-9aeddb88-02b3-4b85-ba50-846bd55a31a1 tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] Could not find user: 080fdf25a1154b6db0ae228e1c05b6b2.: keystone.exception.UserNotFound: Could not find user: 080fdf25a1154b6db0ae228e1c05b6b2. May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 080fdf25a1154b6db0ae228e1c05b6b2. May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1811/3593] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:02:45 2024] DELETE /identity/v3/users/080fdf25a1154b6db0ae228e1c05b6b2 => generated 110 bytes in 24 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123798b5-48cf-4bc3-81e3-56375fae8968 tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123798b5-48cf-4bc3-81e3-56375fae8968 tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427007fd-625b-4da9-b247-69e4d099834e tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da10f5550791458c84e2bcb8b8df0db9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df10044903af4bd59cdae616bef24539', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427007fd-625b-4da9-b247-69e4d099834e tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427007fd-625b-4da9-b247-69e4d099834e tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427007fd-625b-4da9-b247-69e4d099834e tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] PATH_INFO: `/v3/users/80737d9a590d4944acb593a5812e9c87` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427007fd-625b-4da9-b247-69e4d099834e tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] RBAC: Authorizing `identity:delete_user(user_id=80737d9a590d4944acb593a5812e9c87)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427007fd-625b-4da9-b247-69e4d099834e tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:45 l75lg1-v1 dstat.sh[49771]: 28-05 13:02:45| 10 2 84 4 0|5577M 1841M 278M 7928M| 18k 15k| 0 6090k| 0 467 |7706 15k|1.11 1.15 1.06|1.0 1.0 1.0| 0 0 | 0 2048M| 29 364 0 49 2 May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-427007fd-625b-4da9-b247-69e4d099834e tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80737d9a590d4944acb593a5812e9c87', 'request_id': 'req-427007fd-625b-4da9-b247-69e4d099834e'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-427007fd-625b-4da9-b247-69e4d099834e tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80737d9a590d4944acb593a5812e9c87', 'request_id': 'req-427007fd-625b-4da9-b247-69e4d099834e'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-427007fd-625b-4da9-b247-69e4d099834e tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80737d9a590d4944acb593a5812e9c87', 'request_id': 'req-427007fd-625b-4da9-b247-69e4d099834e'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-427007fd-625b-4da9-b247-69e4d099834e tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80737d9a590d4944acb593a5812e9c87', 'request_id': 'req-427007fd-625b-4da9-b247-69e4d099834e'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-427007fd-625b-4da9-b247-69e4d099834e tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80737d9a590d4944acb593a5812e9c87', 'request_id': 'req-427007fd-625b-4da9-b247-69e4d099834e'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1783/3594] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:02:45 2024] DELETE /identity/v3/users/80737d9a590d4944acb593a5812e9c87 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:02:45 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-d1b6aa00-9479-4f58-96e9-8e83cd27ee61 tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] DELETE http://10.27.203.238/share/v2/df10044903af4bd59cdae616bef24539/types/3b106a62-eb87-446a-a43b-678d704b8a12 May 28 13:02:45 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-d1b6aa00-9479-4f58-96e9-8e83cd27ee61 tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:02:45 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-d1b6aa00-9479-4f58-96e9-8e83cd27ee61 tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] Calling method 'ShareTypesController._delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:02:45 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-d1b6aa00-9479-4f58-96e9-8e83cd27ee61 tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] http://10.27.203.238/share/v2/df10044903af4bd59cdae616bef24539/types/3b106a62-eb87-446a-a43b-678d704b8a12 returned with HTTP 202 May 28 13:02:45 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1279/2578] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:02:45 2024] DELETE /share/v2/df10044903af4bd59cdae616bef24539/types/3b106a62-eb87-446a-a43b-678d704b8a12 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 13:02:45 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-f89e029b-a1dc-4375-a205-2582c441b929 tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] GET http://10.27.203.238/share/v2/df10044903af4bd59cdae616bef24539/types/3b106a62-eb87-446a-a43b-678d704b8a12 May 28 13:02:45 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-f89e029b-a1dc-4375-a205-2582c441b929 tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:02:45 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-f89e029b-a1dc-4375-a205-2582c441b929 tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] Calling method 'ShareTypesController.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:02:45 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-f89e029b-a1dc-4375-a205-2582c441b929 tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] HTTP exception thrown: Share type not found. May 28 13:02:45 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-f89e029b-a1dc-4375-a205-2582c441b929 tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] http://10.27.203.238/share/v2/df10044903af4bd59cdae616bef24539/types/3b106a62-eb87-446a-a43b-678d704b8a12 returned with HTTP 404 May 28 13:02:45 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1300/2579] 10.27.203.238 () {64 vars in 1448 bytes} [Tue May 28 13:02:45 2024] GET /share/v2/df10044903af4bd59cdae616bef24539/types/3b106a62-eb87-446a-a43b-678d704b8a12 => generated 67 bytes in 10 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 13:02:45 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-0005adf1-ad2c-4e8a-9846-cd62287bd4aa tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] DELETE http://10.27.203.238/share/v2/df10044903af4bd59cdae616bef24539/types/f26a0e21-b494-484a-b56b-1e38f1e3a86b May 28 13:02:45 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-0005adf1-ad2c-4e8a-9846-cd62287bd4aa tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:02:45 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-0005adf1-ad2c-4e8a-9846-cd62287bd4aa tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] Calling method 'ShareTypesController._delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:02:45 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-0005adf1-ad2c-4e8a-9846-cd62287bd4aa tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] http://10.27.203.238/share/v2/df10044903af4bd59cdae616bef24539/types/f26a0e21-b494-484a-b56b-1e38f1e3a86b returned with HTTP 202 May 28 13:02:45 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1280/2580] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:02:45 2024] DELETE /share/v2/df10044903af4bd59cdae616bef24539/types/f26a0e21-b494-484a-b56b-1e38f1e3a86b => generated 0 bytes in 34 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 13:02:45 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-643e2c45-0903-4682-a48d-1509cad9353f tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] GET http://10.27.203.238/share/v2/df10044903af4bd59cdae616bef24539/types/f26a0e21-b494-484a-b56b-1e38f1e3a86b May 28 13:02:45 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-643e2c45-0903-4682-a48d-1509cad9353f tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:02:45 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-643e2c45-0903-4682-a48d-1509cad9353f tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] Calling method 'ShareTypesController.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:02:45 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-643e2c45-0903-4682-a48d-1509cad9353f tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] HTTP exception thrown: Share type not found. May 28 13:02:45 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-643e2c45-0903-4682-a48d-1509cad9353f tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] http://10.27.203.238/share/v2/df10044903af4bd59cdae616bef24539/types/f26a0e21-b494-484a-b56b-1e38f1e3a86b returned with HTTP 404 May 28 13:02:45 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1301/2581] 10.27.203.238 () {64 vars in 1448 bytes} [Tue May 28 13:02:45 2024] GET /share/v2/df10044903af4bd59cdae616bef24539/types/f26a0e21-b494-484a-b56b-1e38f1e3a86b => generated 67 bytes in 10 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aeddb88-02b3-4b85-ba50-846bd55a31a1 tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-9aeddb88-02b3-4b85-ba50-846bd55a31a1 tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aeddb88-02b3-4b85-ba50-846bd55a31a1 tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f19fd7-0a05-407e-b096-62b69dc30d4f None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f19fd7-0a05-407e-b096-62b69dc30d4f None admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f19fd7-0a05-407e-b096-62b69dc30d4f None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f19fd7-0a05-407e-b096-62b69dc30d4f None admin] PATH_INFO: `/v3/users/f519318388444dbda4f966a4ee761159` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f19fd7-0a05-407e-b096-62b69dc30d4f None admin] RBAC: Authorizing `identity:delete_user(user_id=f519318388444dbda4f966a4ee761159)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f19fd7-0a05-407e-b096-62b69dc30d4f None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-92f19fd7-0a05-407e-b096-62b69dc30d4f None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f519318388444dbda4f966a4ee761159', 'request_id': 'req-92f19fd7-0a05-407e-b096-62b69dc30d4f'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-92f19fd7-0a05-407e-b096-62b69dc30d4f None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f519318388444dbda4f966a4ee761159', 'request_id': 'req-92f19fd7-0a05-407e-b096-62b69dc30d4f'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-92f19fd7-0a05-407e-b096-62b69dc30d4f None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f519318388444dbda4f966a4ee761159', 'request_id': 'req-92f19fd7-0a05-407e-b096-62b69dc30d4f'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-92f19fd7-0a05-407e-b096-62b69dc30d4f None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f519318388444dbda4f966a4ee761159', 'request_id': 'req-92f19fd7-0a05-407e-b096-62b69dc30d4f'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-92f19fd7-0a05-407e-b096-62b69dc30d4f None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f519318388444dbda4f966a4ee761159', 'request_id': 'req-92f19fd7-0a05-407e-b096-62b69dc30d4f'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1812/3595] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 13:02:45 2024] DELETE /identity/v3/users/f519318388444dbda4f966a4ee761159 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427007fd-625b-4da9-b247-69e4d099834e tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427007fd-625b-4da9-b247-69e4d099834e tempest-ShareTypesNegativeTest-860268397 tempest-ShareTypesNegativeTest-860268397-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636e5c84-3efc-47f6-81bc-c991e8da4708 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636e5c84-3efc-47f6-81bc-c991e8da4708 None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636e5c84-3efc-47f6-81bc-c991e8da4708 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636e5c84-3efc-47f6-81bc-c991e8da4708 None admin] PATH_INFO: `/v3/users/1db7447fa6d342758dd01a5de6bf25c2` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636e5c84-3efc-47f6-81bc-c991e8da4708 None admin] RBAC: Authorizing `identity:delete_user(user_id=1db7447fa6d342758dd01a5de6bf25c2)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636e5c84-3efc-47f6-81bc-c991e8da4708 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-636e5c84-3efc-47f6-81bc-c991e8da4708 None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1db7447fa6d342758dd01a5de6bf25c2', 'request_id': 'req-636e5c84-3efc-47f6-81bc-c991e8da4708'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-636e5c84-3efc-47f6-81bc-c991e8da4708 None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1db7447fa6d342758dd01a5de6bf25c2', 'request_id': 'req-636e5c84-3efc-47f6-81bc-c991e8da4708'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-636e5c84-3efc-47f6-81bc-c991e8da4708 None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1db7447fa6d342758dd01a5de6bf25c2', 'request_id': 'req-636e5c84-3efc-47f6-81bc-c991e8da4708'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-636e5c84-3efc-47f6-81bc-c991e8da4708 None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1db7447fa6d342758dd01a5de6bf25c2', 'request_id': 'req-636e5c84-3efc-47f6-81bc-c991e8da4708'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-636e5c84-3efc-47f6-81bc-c991e8da4708 None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1db7447fa6d342758dd01a5de6bf25c2', 'request_id': 'req-636e5c84-3efc-47f6-81bc-c991e8da4708'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1784/3596] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 13:02:45 2024] DELETE /identity/v3/users/1db7447fa6d342758dd01a5de6bf25c2 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f19fd7-0a05-407e-b096-62b69dc30d4f None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-92f19fd7-0a05-407e-b096-62b69dc30d4f None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f19fd7-0a05-407e-b096-62b69dc30d4f None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9778a2cf-54ef-46c9-93f2-fe357ed55c7f None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9778a2cf-54ef-46c9-93f2-fe357ed55c7f None admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9778a2cf-54ef-46c9-93f2-fe357ed55c7f None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9778a2cf-54ef-46c9-93f2-fe357ed55c7f None admin] PATH_INFO: `/v3/users/da10f5550791458c84e2bcb8b8df0db9` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9778a2cf-54ef-46c9-93f2-fe357ed55c7f None admin] RBAC: Authorizing `identity:delete_user(user_id=da10f5550791458c84e2bcb8b8df0db9)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9778a2cf-54ef-46c9-93f2-fe357ed55c7f None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-9778a2cf-54ef-46c9-93f2-fe357ed55c7f None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da10f5550791458c84e2bcb8b8df0db9', 'request_id': 'req-9778a2cf-54ef-46c9-93f2-fe357ed55c7f'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-9778a2cf-54ef-46c9-93f2-fe357ed55c7f None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da10f5550791458c84e2bcb8b8df0db9', 'request_id': 'req-9778a2cf-54ef-46c9-93f2-fe357ed55c7f'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-9778a2cf-54ef-46c9-93f2-fe357ed55c7f None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da10f5550791458c84e2bcb8b8df0db9', 'request_id': 'req-9778a2cf-54ef-46c9-93f2-fe357ed55c7f'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-9778a2cf-54ef-46c9-93f2-fe357ed55c7f None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da10f5550791458c84e2bcb8b8df0db9', 'request_id': 'req-9778a2cf-54ef-46c9-93f2-fe357ed55c7f'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-9778a2cf-54ef-46c9-93f2-fe357ed55c7f None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da10f5550791458c84e2bcb8b8df0db9', 'request_id': 'req-9778a2cf-54ef-46c9-93f2-fe357ed55c7f'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1813/3597] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 13:02:45 2024] DELETE /identity/v3/users/da10f5550791458c84e2bcb8b8df0db9 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f610905-de44-4795-9361-88e3fd3a4d59 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f610905-de44-4795-9361-88e3fd3a4d59 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f610905-de44-4795-9361-88e3fd3a4d59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-7f610905-de44-4795-9361-88e3fd3a4d59 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-7f610905-de44-4795-9361-88e3fd3a4d59 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-7f610905-de44-4795-9361-88e3fd3a4d59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1785/3598] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 13:02:45 2024] POST /identity/v3/auth/tokens => generated 2960 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 13:02:45 l75lg1-v1 neutron-server[77618]: DEBUG neutron.wsgi [-] (77618) accepted ('10.27.203.238', 60396) {{(pid=77618) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9778a2cf-54ef-46c9-93f2-fe357ed55c7f None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-9778a2cf-54ef-46c9-93f2-fe357ed55c7f None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9778a2cf-54ef-46c9-93f2-fe357ed55c7f None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cb32ca-de9b-42ed-a5a6-3c9883bea324 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef17047035e4b518fd5360a01f2da1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cb32ca-de9b-42ed-a5a6-3c9883bea324 service neutron] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cb32ca-de9b-42ed-a5a6-3c9883bea324 service neutron] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cb32ca-de9b-42ed-a5a6-3c9883bea324 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cb32ca-de9b-42ed-a5a6-3c9883bea324 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cb32ca-de9b-42ed-a5a6-3c9883bea324 service neutron] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1814/3599] 10.27.203.238 () {64 vars in 1432 bytes} [Tue May 28 13:02:45 2024] GET /identity/v3/auth/tokens => generated 2960 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 28 13:02:45 l75lg1-v1 neutron-server[77618]: INFO neutron.wsgi [None req-281e2085-948c-4fb0-bd81-74942dff9907 None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=0318b2a2d76949c2ae43b7340f2d5ac4&name=default HTTP/1.1" status: 200 len: 216 time: 0.0699637 May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f610905-de44-4795-9361-88e3fd3a4d59 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-7f610905-de44-4795-9361-88e3fd3a4d59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f610905-de44-4795-9361-88e3fd3a4d59 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833cd945-0195-4c5c-ad50-38ac14689d6f None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833cd945-0195-4c5c-ad50-38ac14689d6f None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833cd945-0195-4c5c-ad50-38ac14689d6f None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833cd945-0195-4c5c-ad50-38ac14689d6f None admin] PATH_INFO: `/v3/projects/0318b2a2d76949c2ae43b7340f2d5ac4` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833cd945-0195-4c5c-ad50-38ac14689d6f None admin] RBAC: Authorizing `identity:delete_project(project_id=0318b2a2d76949c2ae43b7340f2d5ac4)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833cd945-0195-4c5c-ad50-38ac14689d6f None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-833cd945-0195-4c5c-ad50-38ac14689d6f None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0318b2a2d76949c2ae43b7340f2d5ac4', 'request_id': 'req-833cd945-0195-4c5c-ad50-38ac14689d6f'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-833cd945-0195-4c5c-ad50-38ac14689d6f None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0318b2a2d76949c2ae43b7340f2d5ac4', 'request_id': 'req-833cd945-0195-4c5c-ad50-38ac14689d6f'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-833cd945-0195-4c5c-ad50-38ac14689d6f None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0318b2a2d76949c2ae43b7340f2d5ac4', 'request_id': 'req-833cd945-0195-4c5c-ad50-38ac14689d6f'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-833cd945-0195-4c5c-ad50-38ac14689d6f None admin] The token cache is being invalidate because project 0318b2a2d76949c2ae43b7340f2d5ac4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-833cd945-0195-4c5c-ad50-38ac14689d6f None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-833cd945-0195-4c5c-ad50-38ac14689d6f None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1786/3600] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 13:02:45 2024] DELETE /identity/v3/projects/0318b2a2d76949c2ae43b7340f2d5ac4 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:02:45 l75lg1-v1 neutron-server[77618]: DEBUG neutron.wsgi [-] (77618) accepted ('10.27.203.238', 60408) {{(pid=77618) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 13:02:45 l75lg1-v1 neutron-server[77618]: INFO neutron.wsgi [None req-36277ba5-99bb-403c-92f2-a6086c2e56e8 None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=df10044903af4bd59cdae616bef24539&name=default HTTP/1.1" status: 200 len: 216 time: 0.0090842 May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cb32ca-de9b-42ed-a5a6-3c9883bea324 service neutron] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cb32ca-de9b-42ed-a5a6-3c9883bea324 service neutron] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192d1bf9-c4fa-4bb4-b14c-92d8266016c8 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192d1bf9-c4fa-4bb4-b14c-92d8266016c8 None admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192d1bf9-c4fa-4bb4-b14c-92d8266016c8 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192d1bf9-c4fa-4bb4-b14c-92d8266016c8 None admin] PATH_INFO: `/v3/projects/df10044903af4bd59cdae616bef24539` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192d1bf9-c4fa-4bb4-b14c-92d8266016c8 None admin] RBAC: Authorizing `identity:delete_project(project_id=df10044903af4bd59cdae616bef24539)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192d1bf9-c4fa-4bb4-b14c-92d8266016c8 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-192d1bf9-c4fa-4bb4-b14c-92d8266016c8 None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df10044903af4bd59cdae616bef24539', 'request_id': 'req-192d1bf9-c4fa-4bb4-b14c-92d8266016c8'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-192d1bf9-c4fa-4bb4-b14c-92d8266016c8 None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df10044903af4bd59cdae616bef24539', 'request_id': 'req-192d1bf9-c4fa-4bb4-b14c-92d8266016c8'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-192d1bf9-c4fa-4bb4-b14c-92d8266016c8 None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df10044903af4bd59cdae616bef24539', 'request_id': 'req-192d1bf9-c4fa-4bb4-b14c-92d8266016c8'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-192d1bf9-c4fa-4bb4-b14c-92d8266016c8 None admin] The token cache is being invalidate because project df10044903af4bd59cdae616bef24539 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-192d1bf9-c4fa-4bb4-b14c-92d8266016c8 None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-192d1bf9-c4fa-4bb4-b14c-92d8266016c8 None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1815/3601] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 13:02:45 2024] DELETE /identity/v3/projects/df10044903af4bd59cdae616bef24539 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:02:46 l75lg1-v1 neutron-server[77618]: DEBUG neutron.wsgi [-] (77618) accepted ('10.27.203.238', 60422) {{(pid=77618) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 13:02:46 l75lg1-v1 neutron-server[77618]: INFO neutron.wsgi [None req-4d456747-e48a-4c0f-9e8d-8d66938a44c6 None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=da363610750345d090f9ba7b3356d45b&name=default HTTP/1.1" status: 200 len: 216 time: 0.0082560 May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833cd945-0195-4c5c-ad50-38ac14689d6f None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-833cd945-0195-4c5c-ad50-38ac14689d6f None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833cd945-0195-4c5c-ad50-38ac14689d6f None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ec5ef9-c560-47c5-84a2-a5ce39009662 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ec5ef9-c560-47c5-84a2-a5ce39009662 None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ec5ef9-c560-47c5-84a2-a5ce39009662 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ec5ef9-c560-47c5-84a2-a5ce39009662 None admin] PATH_INFO: `/v3/projects/da363610750345d090f9ba7b3356d45b` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ec5ef9-c560-47c5-84a2-a5ce39009662 None admin] RBAC: Authorizing `identity:delete_project(project_id=da363610750345d090f9ba7b3356d45b)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ec5ef9-c560-47c5-84a2-a5ce39009662 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-95ec5ef9-c560-47c5-84a2-a5ce39009662 None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da363610750345d090f9ba7b3356d45b', 'request_id': 'req-95ec5ef9-c560-47c5-84a2-a5ce39009662'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-95ec5ef9-c560-47c5-84a2-a5ce39009662 None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da363610750345d090f9ba7b3356d45b', 'request_id': 'req-95ec5ef9-c560-47c5-84a2-a5ce39009662'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-95ec5ef9-c560-47c5-84a2-a5ce39009662 None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da363610750345d090f9ba7b3356d45b', 'request_id': 'req-95ec5ef9-c560-47c5-84a2-a5ce39009662'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-95ec5ef9-c560-47c5-84a2-a5ce39009662 None admin] The token cache is being invalidate because project da363610750345d090f9ba7b3356d45b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-95ec5ef9-c560-47c5-84a2-a5ce39009662 None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-95ec5ef9-c560-47c5-84a2-a5ce39009662 None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1787/3602] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 13:02:46 2024] DELETE /identity/v3/projects/da363610750345d090f9ba7b3356d45b => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa31f6e-6c7d-4386-aac0-74ca8462ffe3 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa31f6e-6c7d-4386-aac0-74ca8462ffe3 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa31f6e-6c7d-4386-aac0-74ca8462ffe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-3fa31f6e-6c7d-4386-aac0-74ca8462ffe3 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-3fa31f6e-6c7d-4386-aac0-74ca8462ffe3 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-3fa31f6e-6c7d-4386-aac0-74ca8462ffe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1816/3603] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 13:02:46 2024] POST /identity/v3/auth/tokens => generated 312 bytes in 20 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2121c031-f8b8-4857-8106-d73f0dac6e21 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2121c031-f8b8-4857-8106-d73f0dac6e21 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2121c031-f8b8-4857-8106-d73f0dac6e21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-2121c031-f8b8-4857-8106-d73f0dac6e21 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-2121c031-f8b8-4857-8106-d73f0dac6e21 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-2121c031-f8b8-4857-8106-d73f0dac6e21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:02:46 l75lg1-v1 dstat.sh[49771]: 28-05 13:02:46| 9 1 87 2 0|5577M 1840M 278M 7928M| 19k 172B| 0 1802k| 0 304 |7802 14k|1.11 1.15 1.06|2.0 0 0| 0 0 | 0 2048M| 29 364 0 52 2 May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1788/3604] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 13:02:46 2024] POST /identity/v3/auth/tokens => generated 2960 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa31f6e-6c7d-4386-aac0-74ca8462ffe3 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa31f6e-6c7d-4386-aac0-74ca8462ffe3 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:46 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-93b28755-7e81-4995-8892-12b84a143ba4 tempest-SharesNegativeTest-1014773059 None] <<< [DELETE] https://127.0.0.1:40443/api/viewpolicies/57/ May 28 13:02:46 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-93b28755-7e81-4995-8892-12b84a143ba4 tempest-SharesNegativeTest-1014773059 None] --- [DELETE] https://127.0.0.1:40443/api/viewpolicies/57/: Done May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696f0c04-387d-42d6-a273-4f26cd36627f None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696f0c04-387d-42d6-a273-4f26cd36627f None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696f0c04-387d-42d6-a273-4f26cd36627f None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696f0c04-387d-42d6-a273-4f26cd36627f None admin] PATH_INFO: `/v3/domains` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696f0c04-387d-42d6-a273-4f26cd36627f None admin] RBAC: Adding query filter params (name=Default) {{(pid=51267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696f0c04-387d-42d6-a273-4f26cd36627f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696f0c04-387d-42d6-a273-4f26cd36627f None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1817/3605] 10.27.203.238 () {62 vars in 1220 bytes} [Tue May 28 13:02:46 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2121c031-f8b8-4857-8106-d73f0dac6e21 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2121c031-f8b8-4857-8106-d73f0dac6e21 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343d1144-2c02-4bdb-925e-b1d5b8e09d62 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343d1144-2c02-4bdb-925e-b1d5b8e09d62 None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343d1144-2c02-4bdb-925e-b1d5b8e09d62 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343d1144-2c02-4bdb-925e-b1d5b8e09d62 None admin] PATH_INFO: `/v3/projects` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343d1144-2c02-4bdb-925e-b1d5b8e09d62 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343d1144-2c02-4bdb-925e-b1d5b8e09d62 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1789/3606] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 13:02:46 2024] POST /identity/v3/projects => generated 371 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696f0c04-387d-42d6-a273-4f26cd36627f None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696f0c04-387d-42d6-a273-4f26cd36627f None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b30075-6670-429c-b5e6-09efc9f59099 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b30075-6670-429c-b5e6-09efc9f59099 None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b30075-6670-429c-b5e6-09efc9f59099 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b30075-6670-429c-b5e6-09efc9f59099 None admin] PATH_INFO: `/v3/users` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b30075-6670-429c-b5e6-09efc9f59099 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b30075-6670-429c-b5e6-09efc9f59099 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-b9b30075-6670-429c-b5e6-09efc9f59099 None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1818/3607] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 13:02:46 2024] POST /identity/v3/users => generated 294 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343d1144-2c02-4bdb-925e-b1d5b8e09d62 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343d1144-2c02-4bdb-925e-b1d5b8e09d62 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dac285-3384-4d7a-afe5-1ff0c1e43493 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dac285-3384-4d7a-afe5-1ff0c1e43493 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dac285-3384-4d7a-afe5-1ff0c1e43493 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dac285-3384-4d7a-afe5-1ff0c1e43493 None admin] PATH_INFO: `/v3/roles` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dac285-3384-4d7a-afe5-1ff0c1e43493 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dac285-3384-4d7a-afe5-1ff0c1e43493 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:46 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-93b28755-7e81-4995-8892-12b84a143ba4 tempest-SharesNegativeTest-1014773059 None] Created reservations ['3de7ade3-6e09-4bea-8d64-9bc37b57b414', '11188dde-fd2d-4e7f-b3eb-3d2909f8823a', 'a54266c6-ae65-4ea6-ac2d-45a2ee81df02', '703d1b57-ed75-40fc-80bd-1ca8bd92acc1'] {{(pid=98474) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1790/3608] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 13:02:46 2024] GET /identity/v3/roles => generated 1680 bytes in 17 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b30075-6670-429c-b5e6-09efc9f59099 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b30075-6670-429c-b5e6-09efc9f59099 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832dc77d-a363-4dce-8813-02fa8341debc None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832dc77d-a363-4dce-8813-02fa8341debc None admin] REQUEST_METHOD: `PUT` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832dc77d-a363-4dce-8813-02fa8341debc None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832dc77d-a363-4dce-8813-02fa8341debc None admin] PATH_INFO: `/v3/projects/718814c61c8c40e7bf78dd9d84d3b1f1/users/403da4ed21a14ebba08f20d5f408f84e/roles/44620cad10ae407c90c91e2c296adb04` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:46 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-93b28755-7e81-4995-8892-12b84a143ba4 tempest-SharesNegativeTest-1014773059 None] Committed reservations ['3de7ade3-6e09-4bea-8d64-9bc37b57b414', '11188dde-fd2d-4e7f-b3eb-3d2909f8823a', 'a54266c6-ae65-4ea6-ac2d-45a2ee81df02', '703d1b57-ed75-40fc-80bd-1ca8bd92acc1'] {{(pid=98474) commit /opt/stack/manila/manila/quota.py:1063}} May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832dc77d-a363-4dce-8813-02fa8341debc None admin] RBAC: Authorizing `identity:create_grant(project_id=718814c61c8c40e7bf78dd9d84d3b1f1, user_id=403da4ed21a14ebba08f20d5f408f84e, role_id=44620cad10ae407c90c91e2c296adb04)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832dc77d-a363-4dce-8813-02fa8341debc None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:46 l75lg1-v1 manila-share[98474]: INFO manila.share.manager [None req-93b28755-7e81-4995-8892-12b84a143ba4 tempest-SharesNegativeTest-1014773059 None] Share instance 27c3f247-5cdb-4bb3-9479-7b3253f9df42: deleted successfully. May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1819/3609] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 13:02:46 2024] PUT /identity/v3/projects/718814c61c8c40e7bf78dd9d84d3b1f1/users/403da4ed21a14ebba08f20d5f408f84e/roles/44620cad10ae407c90c91e2c296adb04 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0fd8da-aef3-46aa-8d73-794f3eca5c74 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0fd8da-aef3-46aa-8d73-794f3eca5c74 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0fd8da-aef3-46aa-8d73-794f3eca5c74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-9b0fd8da-aef3-46aa-8d73-794f3eca5c74 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-9b0fd8da-aef3-46aa-8d73-794f3eca5c74 None None] MFA Rules not processed for user `403da4ed21a14ebba08f20d5f408f84e`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-9b0fd8da-aef3-46aa-8d73-794f3eca5c74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1791/3610] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 13:02:46 2024] POST /identity/v3/auth/tokens => generated 3942 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832dc77d-a363-4dce-8813-02fa8341debc None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832dc77d-a363-4dce-8813-02fa8341debc None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6581c311-cd18-48a1-b9b0-bdef6bc543ed None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6581c311-cd18-48a1-b9b0-bdef6bc543ed None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6581c311-cd18-48a1-b9b0-bdef6bc543ed None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6581c311-cd18-48a1-b9b0-bdef6bc543ed None admin] PATH_INFO: `/v3/projects` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6581c311-cd18-48a1-b9b0-bdef6bc543ed None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6581c311-cd18-48a1-b9b0-bdef6bc543ed None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1820/3611] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 13:02:46 2024] POST /identity/v3/projects => generated 371 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0fd8da-aef3-46aa-8d73-794f3eca5c74 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0fd8da-aef3-46aa-8d73-794f3eca5c74 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2cd9c3-8b0c-4338-876b-7e6e94788076 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2cd9c3-8b0c-4338-876b-7e6e94788076 None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2cd9c3-8b0c-4338-876b-7e6e94788076 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2cd9c3-8b0c-4338-876b-7e6e94788076 None admin] PATH_INFO: `/v3/users` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2cd9c3-8b0c-4338-876b-7e6e94788076 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2cd9c3-8b0c-4338-876b-7e6e94788076 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-5e2cd9c3-8b0c-4338-876b-7e6e94788076 None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1792/3612] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 13:02:46 2024] POST /identity/v3/users => generated 294 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6581c311-cd18-48a1-b9b0-bdef6bc543ed None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6581c311-cd18-48a1-b9b0-bdef6bc543ed None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d399afc2-3d9b-4949-acb4-1a53b7d1ad56 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d399afc2-3d9b-4949-acb4-1a53b7d1ad56 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d399afc2-3d9b-4949-acb4-1a53b7d1ad56 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d399afc2-3d9b-4949-acb4-1a53b7d1ad56 None admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d399afc2-3d9b-4949-acb4-1a53b7d1ad56 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d399afc2-3d9b-4949-acb4-1a53b7d1ad56 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1821/3613] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 13:02:46 2024] GET /identity/v3/roles => generated 1680 bytes in 18 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2cd9c3-8b0c-4338-876b-7e6e94788076 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2cd9c3-8b0c-4338-876b-7e6e94788076 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83c21f0-d5f5-4170-9cca-4753f0d44ba4 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83c21f0-d5f5-4170-9cca-4753f0d44ba4 None admin] REQUEST_METHOD: `PUT` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83c21f0-d5f5-4170-9cca-4753f0d44ba4 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83c21f0-d5f5-4170-9cca-4753f0d44ba4 None admin] PATH_INFO: `/v3/projects/d076429c6ca54823a296f55e6c5b9c2d/users/b2451a1c4da4401f82f93054bcab5f09/roles/44620cad10ae407c90c91e2c296adb04` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83c21f0-d5f5-4170-9cca-4753f0d44ba4 None admin] RBAC: Authorizing `identity:create_grant(project_id=d076429c6ca54823a296f55e6c5b9c2d, user_id=b2451a1c4da4401f82f93054bcab5f09, role_id=44620cad10ae407c90c91e2c296adb04)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83c21f0-d5f5-4170-9cca-4753f0d44ba4 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1793/3614] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 13:02:46 2024] PUT /identity/v3/projects/d076429c6ca54823a296f55e6c5b9c2d/users/b2451a1c4da4401f82f93054bcab5f09/roles/44620cad10ae407c90c91e2c296adb04 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0520a4c1-5a44-4045-999b-6f24d0ce7862 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0520a4c1-5a44-4045-999b-6f24d0ce7862 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0520a4c1-5a44-4045-999b-6f24d0ce7862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-0520a4c1-5a44-4045-999b-6f24d0ce7862 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-0520a4c1-5a44-4045-999b-6f24d0ce7862 None None] MFA Rules not processed for user `b2451a1c4da4401f82f93054bcab5f09`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-0520a4c1-5a44-4045-999b-6f24d0ce7862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1822/3615] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 13:02:46 2024] POST /identity/v3/auth/tokens => generated 3942 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83c21f0-d5f5-4170-9cca-4753f0d44ba4 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:46 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-13d1a57b-60c3-4fee-b8cd-710474d632d9 tempest-SharesNegativeTest-1014773059 tempest-SharesNegativeTest-1014773059-project-member] GET http://10.27.203.238/share/v2/d1d71dc9f23c4c6a8e146d99ad65ebb2/shares/b05a8999-f1ac-4887-a675-3c2ca8e9cece May 28 13:02:46 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-13d1a57b-60c3-4fee-b8cd-710474d632d9 tempest-SharesNegativeTest-1014773059 tempest-SharesNegativeTest-1014773059-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:02:46 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-13d1a57b-60c3-4fee-b8cd-710474d632d9 tempest-SharesNegativeTest-1014773059 tempest-SharesNegativeTest-1014773059-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:02:46 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-13d1a57b-60c3-4fee-b8cd-710474d632d9 tempest-SharesNegativeTest-1014773059 tempest-SharesNegativeTest-1014773059-project-member] HTTP exception thrown: The resource could not be found. May 28 13:02:46 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-13d1a57b-60c3-4fee-b8cd-710474d632d9 tempest-SharesNegativeTest-1014773059 tempest-SharesNegativeTest-1014773059-project-member] http://10.27.203.238/share/v2/d1d71dc9f23c4c6a8e146d99ad65ebb2/shares/b05a8999-f1ac-4887-a675-3c2ca8e9cece returned with HTTP 404 May 28 13:02:46 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1281/2582] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:02:46 2024] GET /share/v2/d1d71dc9f23c4c6a8e146d99ad65ebb2/shares/b05a8999-f1ac-4887-a675-3c2ca8e9cece => generated 78 bytes in 12 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 13:02:46 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-28214fd5-bc5f-4887-b947-0abb2f520731 tempest-SharesNegativeTest-322550032 tempest-SharesNegativeTest-322550032-project-admin] DELETE http://10.27.203.238/share/v2/adcbdea5704e4efc898c24b2b0a492a5/types/1dad7e5a-3224-4d69-bbdc-00db9760f3aa May 28 13:02:46 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-28214fd5-bc5f-4887-b947-0abb2f520731 tempest-SharesNegativeTest-322550032 tempest-SharesNegativeTest-322550032-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:02:46 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-28214fd5-bc5f-4887-b947-0abb2f520731 tempest-SharesNegativeTest-322550032 tempest-SharesNegativeTest-322550032-project-admin] Calling method 'ShareTypesController._delete' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83c21f0-d5f5-4170-9cca-4753f0d44ba4 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfec441-6044-4383-bc2f-fe5e37fc9080 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfec441-6044-4383-bc2f-fe5e37fc9080 None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfec441-6044-4383-bc2f-fe5e37fc9080 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfec441-6044-4383-bc2f-fe5e37fc9080 None admin] PATH_INFO: `/v3/projects` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfec441-6044-4383-bc2f-fe5e37fc9080 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfec441-6044-4383-bc2f-fe5e37fc9080 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:46 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-28214fd5-bc5f-4887-b947-0abb2f520731 tempest-SharesNegativeTest-322550032 tempest-SharesNegativeTest-322550032-project-admin] http://10.27.203.238/share/v2/adcbdea5704e4efc898c24b2b0a492a5/types/1dad7e5a-3224-4d69-bbdc-00db9760f3aa returned with HTTP 202 May 28 13:02:46 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1302/2583] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:02:46 2024] DELETE /share/v2/adcbdea5704e4efc898c24b2b0a492a5/types/1dad7e5a-3224-4d69-bbdc-00db9760f3aa => generated 0 bytes in 50 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1794/3616] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 13:02:46 2024] POST /identity/v3/projects => generated 373 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0520a4c1-5a44-4045-999b-6f24d0ce7862 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:46 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-cebe35db-2811-466d-911a-2349ab28a350 tempest-SharesNegativeTest-322550032 tempest-SharesNegativeTest-322550032-project-admin] GET http://10.27.203.238/share/v2/adcbdea5704e4efc898c24b2b0a492a5/types/1dad7e5a-3224-4d69-bbdc-00db9760f3aa May 28 13:02:46 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-cebe35db-2811-466d-911a-2349ab28a350 tempest-SharesNegativeTest-322550032 tempest-SharesNegativeTest-322550032-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:02:46 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-cebe35db-2811-466d-911a-2349ab28a350 tempest-SharesNegativeTest-322550032 tempest-SharesNegativeTest-322550032-project-admin] Calling method 'ShareTypesController.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0520a4c1-5a44-4045-999b-6f24d0ce7862 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:46 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-cebe35db-2811-466d-911a-2349ab28a350 tempest-SharesNegativeTest-322550032 tempest-SharesNegativeTest-322550032-project-admin] HTTP exception thrown: Share type not found. May 28 13:02:46 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-cebe35db-2811-466d-911a-2349ab28a350 tempest-SharesNegativeTest-322550032 tempest-SharesNegativeTest-322550032-project-admin] http://10.27.203.238/share/v2/adcbdea5704e4efc898c24b2b0a492a5/types/1dad7e5a-3224-4d69-bbdc-00db9760f3aa returned with HTTP 404 May 28 13:02:46 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1282/2584] 10.27.203.238 () {64 vars in 1448 bytes} [Tue May 28 13:02:46 2024] GET /share/v2/adcbdea5704e4efc898c24b2b0a492a5/types/1dad7e5a-3224-4d69-bbdc-00db9760f3aa => generated 67 bytes in 11 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfec441-6044-4383-bc2f-fe5e37fc9080 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-5cfec441-6044-4383-bc2f-fe5e37fc9080 None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26ac3e8-f23a-417f-8f1d-2351d6cbe2e2 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26ac3e8-f23a-417f-8f1d-2351d6cbe2e2 None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26ac3e8-f23a-417f-8f1d-2351d6cbe2e2 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26ac3e8-f23a-417f-8f1d-2351d6cbe2e2 None admin] PATH_INFO: `/v3/users` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26ac3e8-f23a-417f-8f1d-2351d6cbe2e2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26ac3e8-f23a-417f-8f1d-2351d6cbe2e2 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-e26ac3e8-f23a-417f-8f1d-2351d6cbe2e2 None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfec441-6044-4383-bc2f-fe5e37fc9080 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc515603-d032-429e-8c98-17b6725ba3aa None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc515603-d032-429e-8c98-17b6725ba3aa None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc515603-d032-429e-8c98-17b6725ba3aa None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc515603-d032-429e-8c98-17b6725ba3aa None admin] PATH_INFO: `/v3/users/48f962e7e06c4cb5b4304e96f10ea343` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc515603-d032-429e-8c98-17b6725ba3aa None admin] RBAC: Authorizing `identity:delete_user(user_id=48f962e7e06c4cb5b4304e96f10ea343)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc515603-d032-429e-8c98-17b6725ba3aa None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1823/3617] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 13:02:46 2024] POST /identity/v3/users => generated 294 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26ac3e8-f23a-417f-8f1d-2351d6cbe2e2 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26ac3e8-f23a-417f-8f1d-2351d6cbe2e2 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0569a03-5455-49f4-932a-bbd6a13f50d0 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0569a03-5455-49f4-932a-bbd6a13f50d0 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0569a03-5455-49f4-932a-bbd6a13f50d0 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0569a03-5455-49f4-932a-bbd6a13f50d0 None admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0569a03-5455-49f4-932a-bbd6a13f50d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0569a03-5455-49f4-932a-bbd6a13f50d0 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1824/3618] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 13:02:46 2024] GET /identity/v3/roles => generated 1680 bytes in 19 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0569a03-5455-49f4-932a-bbd6a13f50d0 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0569a03-5455-49f4-932a-bbd6a13f50d0 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ff9e3c-da7b-4ffe-8685-1d3071a2e6d9 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ff9e3c-da7b-4ffe-8685-1d3071a2e6d9 None admin] REQUEST_METHOD: `PUT` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ff9e3c-da7b-4ffe-8685-1d3071a2e6d9 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ff9e3c-da7b-4ffe-8685-1d3071a2e6d9 None admin] PATH_INFO: `/v3/projects/633b6f74527b48408dad0eedac73931e/users/297c7d9ded9e4385b8d12b4e03a77bd5/roles/e7989893488f483baa107be56668c4f8` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ff9e3c-da7b-4ffe-8685-1d3071a2e6d9 None admin] RBAC: Authorizing `identity:create_grant(project_id=633b6f74527b48408dad0eedac73931e, user_id=297c7d9ded9e4385b8d12b4e03a77bd5, role_id=e7989893488f483baa107be56668c4f8)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ff9e3c-da7b-4ffe-8685-1d3071a2e6d9 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-fc515603-d032-429e-8c98-17b6725ba3aa None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48f962e7e06c4cb5b4304e96f10ea343', 'request_id': 'req-fc515603-d032-429e-8c98-17b6725ba3aa'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-fc515603-d032-429e-8c98-17b6725ba3aa None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48f962e7e06c4cb5b4304e96f10ea343', 'request_id': 'req-fc515603-d032-429e-8c98-17b6725ba3aa'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-fc515603-d032-429e-8c98-17b6725ba3aa None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48f962e7e06c4cb5b4304e96f10ea343', 'request_id': 'req-fc515603-d032-429e-8c98-17b6725ba3aa'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-fc515603-d032-429e-8c98-17b6725ba3aa None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48f962e7e06c4cb5b4304e96f10ea343', 'request_id': 'req-fc515603-d032-429e-8c98-17b6725ba3aa'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-fc515603-d032-429e-8c98-17b6725ba3aa None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48f962e7e06c4cb5b4304e96f10ea343', 'request_id': 'req-fc515603-d032-429e-8c98-17b6725ba3aa'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1825/3619] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 13:02:46 2024] PUT /identity/v3/projects/633b6f74527b48408dad0eedac73931e/users/297c7d9ded9e4385b8d12b4e03a77bd5/roles/e7989893488f483baa107be56668c4f8 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ff9e3c-da7b-4ffe-8685-1d3071a2e6d9 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-a9ff9e3c-da7b-4ffe-8685-1d3071a2e6d9 None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:02:46 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1795/3620] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 13:02:46 2024] DELETE /identity/v3/users/48f962e7e06c4cb5b4304e96f10ea343 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:02:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc515603-d032-429e-8c98-17b6725ba3aa None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-fc515603-d032-429e-8c98-17b6725ba3aa None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:02:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ff9e3c-da7b-4ffe-8685-1d3071a2e6d9 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc515603-d032-429e-8c98-17b6725ba3aa None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d40454-659f-4632-9dae-ef44cfead334 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d40454-659f-4632-9dae-ef44cfead334 None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d40454-659f-4632-9dae-ef44cfead334 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d40454-659f-4632-9dae-ef44cfead334 None admin] PATH_INFO: `/v3/users/f2898eb3fa17430d922ce1ac6a74e451` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d40454-659f-4632-9dae-ef44cfead334 None admin] RBAC: Authorizing `identity:delete_user(user_id=f2898eb3fa17430d922ce1ac6a74e451)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d40454-659f-4632-9dae-ef44cfead334 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d8e696-ee28-4ec3-b517-5e25af54debd None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d8e696-ee28-4ec3-b517-5e25af54debd None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d8e696-ee28-4ec3-b517-5e25af54debd None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d8e696-ee28-4ec3-b517-5e25af54debd None admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d8e696-ee28-4ec3-b517-5e25af54debd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d8e696-ee28-4ec3-b517-5e25af54debd None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:47 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1826/3621] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 13:02:46 2024] GET /identity/v3/roles => generated 1680 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 13:02:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d8e696-ee28-4ec3-b517-5e25af54debd None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d8e696-ee28-4ec3-b517-5e25af54debd None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf0f9ae-40f5-46d0-b747-881e6a09f7d1 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf0f9ae-40f5-46d0-b747-881e6a09f7d1 None admin] REQUEST_METHOD: `PUT` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf0f9ae-40f5-46d0-b747-881e6a09f7d1 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf0f9ae-40f5-46d0-b747-881e6a09f7d1 None admin] PATH_INFO: `/v3/projects/633b6f74527b48408dad0eedac73931e/users/297c7d9ded9e4385b8d12b4e03a77bd5/roles/e7989893488f483baa107be56668c4f8` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf0f9ae-40f5-46d0-b747-881e6a09f7d1 None admin] RBAC: Authorizing `identity:create_grant(project_id=633b6f74527b48408dad0eedac73931e, user_id=297c7d9ded9e4385b8d12b4e03a77bd5, role_id=e7989893488f483baa107be56668c4f8)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf0f9ae-40f5-46d0-b747-881e6a09f7d1 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:47 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1827/3622] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 13:02:47 2024] PUT /identity/v3/projects/633b6f74527b48408dad0eedac73931e/users/297c7d9ded9e4385b8d12b4e03a77bd5/roles/e7989893488f483baa107be56668c4f8 => generated 0 bytes in 18 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 28 13:02:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37bc5e7-2255-4b7c-8dcc-8ee208548505 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37bc5e7-2255-4b7c-8dcc-8ee208548505 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37bc5e7-2255-4b7c-8dcc-8ee208548505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-08d40454-659f-4632-9dae-ef44cfead334 None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2898eb3fa17430d922ce1ac6a74e451', 'request_id': 'req-08d40454-659f-4632-9dae-ef44cfead334'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-08d40454-659f-4632-9dae-ef44cfead334 None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2898eb3fa17430d922ce1ac6a74e451', 'request_id': 'req-08d40454-659f-4632-9dae-ef44cfead334'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:47 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-a37bc5e7-2255-4b7c-8dcc-8ee208548505 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 13:02:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-08d40454-659f-4632-9dae-ef44cfead334 None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2898eb3fa17430d922ce1ac6a74e451', 'request_id': 'req-08d40454-659f-4632-9dae-ef44cfead334'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-a37bc5e7-2255-4b7c-8dcc-8ee208548505 None None] MFA Rules not processed for user `297c7d9ded9e4385b8d12b4e03a77bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 13:02:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-08d40454-659f-4632-9dae-ef44cfead334 None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2898eb3fa17430d922ce1ac6a74e451', 'request_id': 'req-08d40454-659f-4632-9dae-ef44cfead334'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-a37bc5e7-2255-4b7c-8dcc-8ee208548505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:02:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-08d40454-659f-4632-9dae-ef44cfead334 None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2898eb3fa17430d922ce1ac6a74e451', 'request_id': 'req-08d40454-659f-4632-9dae-ef44cfead334'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:47 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1796/3623] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 13:02:46 2024] DELETE /identity/v3/users/f2898eb3fa17430d922ce1ac6a74e451 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 28 13:02:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d40454-659f-4632-9dae-ef44cfead334 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-08d40454-659f-4632-9dae-ef44cfead334 None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:02:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d40454-659f-4632-9dae-ef44cfead334 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:47 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1828/3624] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 13:02:47 2024] POST /identity/v3/auth/tokens => generated 4067 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 13:02:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013f3ca5-5aae-40e4-bfbf-0d4706a0a9f9 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013f3ca5-5aae-40e4-bfbf-0d4706a0a9f9 None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37bc5e7-2255-4b7c-8dcc-8ee208548505 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013f3ca5-5aae-40e4-bfbf-0d4706a0a9f9 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013f3ca5-5aae-40e4-bfbf-0d4706a0a9f9 None admin] PATH_INFO: `/v3/users/8979d27306d441e385a31f56e8668ee3` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013f3ca5-5aae-40e4-bfbf-0d4706a0a9f9 None admin] RBAC: Authorizing `identity:delete_user(user_id=8979d27306d441e385a31f56e8668ee3)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013f3ca5-5aae-40e4-bfbf-0d4706a0a9f9 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37bc5e7-2255-4b7c-8dcc-8ee208548505 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fab78f-f761-40e1-a75f-c58cf1f88a0b tempest-SharesActionsTest-2125642311 tempest-SharesActionsTest-2125642311-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297c7d9ded9e4385b8d12b4e03a77bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '633b6f74527b48408dad0eedac73931e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fab78f-f761-40e1-a75f-c58cf1f88a0b tempest-SharesActionsTest-2125642311 tempest-SharesActionsTest-2125642311-project-admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fab78f-f761-40e1-a75f-c58cf1f88a0b tempest-SharesActionsTest-2125642311 tempest-SharesActionsTest-2125642311-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fab78f-f761-40e1-a75f-c58cf1f88a0b tempest-SharesActionsTest-2125642311 tempest-SharesActionsTest-2125642311-project-admin] PATH_INFO: `/v3/domains` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fab78f-f761-40e1-a75f-c58cf1f88a0b tempest-SharesActionsTest-2125642311 tempest-SharesActionsTest-2125642311-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=51267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 13:02:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fab78f-f761-40e1-a75f-c58cf1f88a0b tempest-SharesActionsTest-2125642311 tempest-SharesActionsTest-2125642311-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fab78f-f761-40e1-a75f-c58cf1f88a0b tempest-SharesActionsTest-2125642311 tempest-SharesActionsTest-2125642311-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:47 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1829/3625] 10.27.203.238 () {62 vars in 1241 bytes} [Tue May 28 13:02:47 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 13:02:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-013f3ca5-5aae-40e4-bfbf-0d4706a0a9f9 None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8979d27306d441e385a31f56e8668ee3', 'request_id': 'req-013f3ca5-5aae-40e4-bfbf-0d4706a0a9f9'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-013f3ca5-5aae-40e4-bfbf-0d4706a0a9f9 None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8979d27306d441e385a31f56e8668ee3', 'request_id': 'req-013f3ca5-5aae-40e4-bfbf-0d4706a0a9f9'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fab78f-f761-40e1-a75f-c58cf1f88a0b tempest-SharesActionsTest-2125642311 tempest-SharesActionsTest-2125642311-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fab78f-f761-40e1-a75f-c58cf1f88a0b tempest-SharesActionsTest-2125642311 tempest-SharesActionsTest-2125642311-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-013f3ca5-5aae-40e4-bfbf-0d4706a0a9f9 None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8979d27306d441e385a31f56e8668ee3', 'request_id': 'req-013f3ca5-5aae-40e4-bfbf-0d4706a0a9f9'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-013f3ca5-5aae-40e4-bfbf-0d4706a0a9f9 None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8979d27306d441e385a31f56e8668ee3', 'request_id': 'req-013f3ca5-5aae-40e4-bfbf-0d4706a0a9f9'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-013f3ca5-5aae-40e4-bfbf-0d4706a0a9f9 None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8979d27306d441e385a31f56e8668ee3', 'request_id': 'req-013f3ca5-5aae-40e4-bfbf-0d4706a0a9f9'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:47 l75lg1-v1 dstat.sh[49771]: 28-05 13:02:47| 14 2 80 3 0|5577M 1840M 278M 7928M| 14k 66B| 0 2539k| 0 371 |9766 17k|1.18 1.16 1.07|2.0 1.0 0| 0 0 | 0 2048M| 29 365 0 52 2 May 28 13:02:47 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1797/3626] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 13:02:47 2024] DELETE /identity/v3/users/8979d27306d441e385a31f56e8668ee3 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 28 13:02:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660e48c4-a05f-4df6-b67f-6a3511e18bc8 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660e48c4-a05f-4df6-b67f-6a3511e18bc8 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660e48c4-a05f-4df6-b67f-6a3511e18bc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:47 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-660e48c4-a05f-4df6-b67f-6a3511e18bc8 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 13:02:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73847c16-2120-4e13-8153-89cd4a04a6c4 tempest-SharesActionsTest-2125642311 tempest-SharesActionsTest-2125642311-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297c7d9ded9e4385b8d12b4e03a77bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '633b6f74527b48408dad0eedac73931e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73847c16-2120-4e13-8153-89cd4a04a6c4 tempest-SharesActionsTest-2125642311 tempest-SharesActionsTest-2125642311-project-admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73847c16-2120-4e13-8153-89cd4a04a6c4 tempest-SharesActionsTest-2125642311 tempest-SharesActionsTest-2125642311-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73847c16-2120-4e13-8153-89cd4a04a6c4 tempest-SharesActionsTest-2125642311 tempest-SharesActionsTest-2125642311-project-admin] PATH_INFO: `/v3/users` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73847c16-2120-4e13-8153-89cd4a04a6c4 tempest-SharesActionsTest-2125642311 tempest-SharesActionsTest-2125642311-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-660e48c4-a05f-4df6-b67f-6a3511e18bc8 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 13:02:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73847c16-2120-4e13-8153-89cd4a04a6c4 tempest-SharesActionsTest-2125642311 tempest-SharesActionsTest-2125642311-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-660e48c4-a05f-4df6-b67f-6a3511e18bc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:02:47 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-73847c16-2120-4e13-8153-89cd4a04a6c4 tempest-SharesActionsTest-2125642311 tempest-SharesActionsTest-2125642311-project-admin] Truncating password to algorithm specific maximum length 72 characters. May 28 13:02:47 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1830/3627] 10.27.203.238 () {64 vars in 1232 bytes} [Tue May 28 13:02:47 2024] POST /identity/v3/users => generated 433 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 28 13:02:47 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1798/3628] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 13:02:47 2024] POST /identity/v3/auth/tokens => generated 2960 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 28 13:02:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73847c16-2120-4e13-8153-89cd4a04a6c4 tempest-SharesActionsTest-2125642311 tempest-SharesActionsTest-2125642311-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:47 l75lg1-v1 neutron-server[77619]: DEBUG neutron.wsgi [-] (77619) accepted ('10.27.203.238', 60432) {{(pid=77619) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 13:02:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-73847c16-2120-4e13-8153-89cd4a04a6c4 tempest-SharesActionsTest-2125642311 tempest-SharesActionsTest-2125642311-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:02:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660e48c4-a05f-4df6-b67f-6a3511e18bc8 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-660e48c4-a05f-4df6-b67f-6a3511e18bc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:02:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73847c16-2120-4e13-8153-89cd4a04a6c4 tempest-SharesActionsTest-2125642311 tempest-SharesActionsTest-2125642311-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660e48c4-a05f-4df6-b67f-6a3511e18bc8 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6358d6c-eac8-4bf2-b6e1-eca64d8e91cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef17047035e4b518fd5360a01f2da1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6358d6c-eac8-4bf2-b6e1-eca64d8e91cf service neutron] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6358d6c-eac8-4bf2-b6e1-eca64d8e91cf service neutron] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6358d6c-eac8-4bf2-b6e1-eca64d8e91cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93630f7-bfe6-4862-9e39-0b2dbd6b1b75 tempest-SharesActionsTest-2125642311 tempest-SharesActionsTest-2125642311-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297c7d9ded9e4385b8d12b4e03a77bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '633b6f74527b48408dad0eedac73931e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93630f7-bfe6-4862-9e39-0b2dbd6b1b75 tempest-SharesActionsTest-2125642311 tempest-SharesActionsTest-2125642311-project-admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93630f7-bfe6-4862-9e39-0b2dbd6b1b75 tempest-SharesActionsTest-2125642311 tempest-SharesActionsTest-2125642311-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93630f7-bfe6-4862-9e39-0b2dbd6b1b75 tempest-SharesActionsTest-2125642311 tempest-SharesActionsTest-2125642311-project-admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93630f7-bfe6-4862-9e39-0b2dbd6b1b75 tempest-SharesActionsTest-2125642311 tempest-SharesActionsTest-2125642311-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6358d6c-eac8-4bf2-b6e1-eca64d8e91cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93630f7-bfe6-4862-9e39-0b2dbd6b1b75 tempest-SharesActionsTest-2125642311 tempest-SharesActionsTest-2125642311-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:47 l75lg1-v1 manila-share[98474]: DEBUG oslo_service.periodic_task [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] Running periodic task ShareManager._publish_service_capabilities {{(pid=98474) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 13:02:47 l75lg1-v1 manila-share[98474]: DEBUG manila.manager [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] Notifying Schedulers of capabilities ... {{(pid=98474) _publish_service_capabilities /opt/stack/manila/manila/manager.py:172}} May 28 13:02:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6358d6c-eac8-4bf2-b6e1-eca64d8e91cf service neutron] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:47 l75lg1-v1 manila-share[98474]: DEBUG oslo_service.periodic_task [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] Running periodic task ShareManager.migration_driver_continue {{(pid=98474) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 13:02:47 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.host_manager [None req-5bb3156f-8232-44b7-a870-a3c456679083 None None] Received share service update from l75lg1-v1@vast: {'share_backend_name': 'vast', 'driver_handles_share_servers': False, 'vendor_name': 'VAST STORAGE', 'driver_version': '1.0', 'storage_protocol': 'NFS', 'total_capacity_gb': 2083.02392578125, 'free_capacity_gb': 2082.6009807521477, 'reserved_percentage': 0, 'reserved_snapshot_percentage': 0, 'reserved_share_extend_percentage': 0, 'qos': False, 'pools': None, 'snapshot_support': True, 'create_share_from_snapshot_support': False, 'revert_to_snapshot_support': False, 'mount_snapshot_support': False, 'replication_domain': None, 'filter_function': None, 'goodness_function': None, 'security_service_update_support': False, 'network_allocation_update_support': False, 'share_server_multiple_subnet_support': False, 'mount_point_name_support': False, 'data_reduction': 5.29, 'provisioned_capacity_gb': 0.42294502910226583, 'share_group_stats': {'consistent_snapshot_support': None}, 'ipv4_support': True, 'ipv6_support': False} {{(pid=98327) update_service_capabilities /opt/stack/manila/manila/scheduler/host_manager.py:632}} May 28 13:02:47 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1799/3629] 10.27.203.238 () {64 vars in 1432 bytes} [Tue May 28 13:02:47 2024] GET /identity/v3/auth/tokens => generated 2960 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 28 13:02:47 l75lg1-v1 manila-share[98474]: DEBUG oslo_service.periodic_task [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] Running periodic task ShareManager.do_deferred_share_deletion {{(pid=98474) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 13:02:47 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1831/3630] 10.27.203.238 () {62 vars in 1210 bytes} [Tue May 28 13:02:47 2024] GET /identity/v3/roles => generated 1680 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 13:02:47 l75lg1-v1 manila-share[98474]: DEBUG manila.share.manager [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] Checking for shares in 'deferred_deleting' status to process their deletion. {{(pid=98474) do_deferred_share_deletion /opt/stack/manila/manila/share/manager.py:3663}} May 28 13:02:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6358d6c-eac8-4bf2-b6e1-eca64d8e91cf service neutron] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6358d6c-eac8-4bf2-b6e1-eca64d8e91cf service neutron] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:47 l75lg1-v1 neutron-server[77619]: INFO neutron.wsgi [None req-5aa95ae4-f42d-43b4-a77d-29139b0c7785 None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=28e72ec38bf64ac2b199b23160dbeac5&name=default HTTP/1.1" status: 200 len: 216 time: 0.0717227 May 28 13:02:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93630f7-bfe6-4862-9e39-0b2dbd6b1b75 tempest-SharesActionsTest-2125642311 tempest-SharesActionsTest-2125642311-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00c40cd-fb63-44bf-a735-dacb5addf031 tempest-SharesActionsTest-2125642311 tempest-SharesActionsTest-2125642311-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297c7d9ded9e4385b8d12b4e03a77bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '633b6f74527b48408dad0eedac73931e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00c40cd-fb63-44bf-a735-dacb5addf031 tempest-SharesActionsTest-2125642311 tempest-SharesActionsTest-2125642311-project-admin] REQUEST_METHOD: `PUT` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00c40cd-fb63-44bf-a735-dacb5addf031 tempest-SharesActionsTest-2125642311 tempest-SharesActionsTest-2125642311-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00c40cd-fb63-44bf-a735-dacb5addf031 tempest-SharesActionsTest-2125642311 tempest-SharesActionsTest-2125642311-project-admin] PATH_INFO: `/v3/projects/633b6f74527b48408dad0eedac73931e/users/0db23a1570c14747b7d0cfd63c25831d/roles/44620cad10ae407c90c91e2c296adb04` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-b93630f7-bfe6-4862-9e39-0b2dbd6b1b75 tempest-SharesActionsTest-2125642311 tempest-SharesActionsTest-2125642311-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:02:47 l75lg1-v1 manila-share[98474]: DEBUG oslo_service.periodic_task [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] Running periodic task ShareManager.do_deferred_snapshot_deletion {{(pid=98474) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 13:02:47 l75lg1-v1 manila-share[98474]: DEBUG manila.share.manager [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] Checking for snapshots in 'deferred_deleting' status to process their deletion. {{(pid=98474) do_deferred_snapshot_deletion /opt/stack/manila/manila/share/manager.py:3980}} May 28 13:02:47 l75lg1-v1 manila-share[98474]: DEBUG oslo_service.periodic_task [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] Running periodic task ShareManager._report_driver_status {{(pid=98474) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 13:02:47 l75lg1-v1 manila-share[98474]: INFO manila.share.manager [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] Updating share status May 28 13:02:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] >>> [GET] https://127.0.0.1:40443/api/monitors/ad_hoc_query/ May 28 13:02:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] {'allow_redirects': True, May 28 13:02:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] 'params': {'object_type': 'cluster', May 28 13:02:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] 'prop_list': ['Capacity,drr', May 28 13:02:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] 'Capacity,logical_space', May 28 13:02:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] 'Capacity,logical_space_in_use', May 28 13:02:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] 'Capacity,physical_space', May 28 13:02:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] 'Capacity,physical_space_in_use'], May 28 13:02:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] 'time_frame': '1m'}} May 28 13:02:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00c40cd-fb63-44bf-a735-dacb5addf031 tempest-SharesActionsTest-2125642311 tempest-SharesActionsTest-2125642311-project-admin] RBAC: Authorizing `identity:create_grant(project_id=633b6f74527b48408dad0eedac73931e, user_id=0db23a1570c14747b7d0cfd63c25831d, role_id=44620cad10ae407c90c91e2c296adb04)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93630f7-bfe6-4862-9e39-0b2dbd6b1b75 tempest-SharesActionsTest-2125642311 tempest-SharesActionsTest-2125642311-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00c40cd-fb63-44bf-a735-dacb5addf031 tempest-SharesActionsTest-2125642311 tempest-SharesActionsTest-2125642311-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d627ca-6f39-4d0f-ac05-17aac6e5afd0 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d627ca-6f39-4d0f-ac05-17aac6e5afd0 None admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d627ca-6f39-4d0f-ac05-17aac6e5afd0 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d627ca-6f39-4d0f-ac05-17aac6e5afd0 None admin] PATH_INFO: `/v3/projects/28e72ec38bf64ac2b199b23160dbeac5` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d627ca-6f39-4d0f-ac05-17aac6e5afd0 None admin] RBAC: Authorizing `identity:delete_project(project_id=28e72ec38bf64ac2b199b23160dbeac5)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d627ca-6f39-4d0f-ac05-17aac6e5afd0 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:47 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1800/3631] 10.27.203.238 () {64 vars in 1571 bytes} [Tue May 28 13:02:47 2024] PUT /identity/v3/projects/633b6f74527b48408dad0eedac73931e/users/0db23a1570c14747b7d0cfd63c25831d/roles/44620cad10ae407c90c91e2c296adb04 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:02:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00c40cd-fb63-44bf-a735-dacb5addf031 tempest-SharesActionsTest-2125642311 tempest-SharesActionsTest-2125642311-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-a00c40cd-fb63-44bf-a735-dacb5addf031 tempest-SharesActionsTest-2125642311 tempest-SharesActionsTest-2125642311-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:02:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-a2d627ca-6f39-4d0f-ac05-17aac6e5afd0 None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28e72ec38bf64ac2b199b23160dbeac5', 'request_id': 'req-a2d627ca-6f39-4d0f-ac05-17aac6e5afd0'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00c40cd-fb63-44bf-a735-dacb5addf031 tempest-SharesActionsTest-2125642311 tempest-SharesActionsTest-2125642311-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-a2d627ca-6f39-4d0f-ac05-17aac6e5afd0 None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28e72ec38bf64ac2b199b23160dbeac5', 'request_id': 'req-a2d627ca-6f39-4d0f-ac05-17aac6e5afd0'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-a2d627ca-6f39-4d0f-ac05-17aac6e5afd0 None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28e72ec38bf64ac2b199b23160dbeac5', 'request_id': 'req-a2d627ca-6f39-4d0f-ac05-17aac6e5afd0'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-a2d627ca-6f39-4d0f-ac05-17aac6e5afd0 None admin] The token cache is being invalidate because project 28e72ec38bf64ac2b199b23160dbeac5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 13:02:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-a2d627ca-6f39-4d0f-ac05-17aac6e5afd0 None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-a2d627ca-6f39-4d0f-ac05-17aac6e5afd0 None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:47 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1832/3632] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 13:02:47 2024] DELETE /identity/v3/projects/28e72ec38bf64ac2b199b23160dbeac5 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:02:47 l75lg1-v1 neutron-server[77619]: DEBUG neutron.wsgi [-] (77619) accepted ('10.27.203.238', 60440) {{(pid=77619) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 13:02:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] <<< [GET] https://127.0.0.1:40443/api/monitors/ad_hoc_query/ May 28 13:02:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ae429c-6d8f-48e0-abfd-d88458354ad1 service manila] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f110cf6300f049c897d0aab63218d1e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ae429c-6d8f-48e0-abfd-d88458354ad1 service manila] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ae429c-6d8f-48e0-abfd-d88458354ad1 service manila] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ae429c-6d8f-48e0-abfd-d88458354ad1 service manila] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] Bunch(data=[['2024-05-28T13:02:42Z', 1, 409577479.0, 2223930.0, 5.29, 711246584217.0, 2236629909504.0], ['2024-05-28T13:02:31Z', 1, 409446407.0, 2223930.0, 5.29, 711246584217.0, 2236629909504.0], ['2024-05-28T13:02:20Z', 1, 405276679.0, 2223930.0, 5.29, 711246584217.0, 2236629909504.0], ['2024-05-28T13:02:11Z', 1, 405194759.0, 2223930.0, 5.29, 711246584217.0, 2236629909504.0], ['2024-05-28T13:02:00Z', 1, 405080071.0, 2223930.0, 5.29, 711246584217.0, 2236629909504.0], ['2024-05-28T13:01:50Z', 1, 404989959.0, 2223930.0, 5.29, 711246584217.0, 2236629909504.0]], granularity=None, object_ids=[1], prop_list=['timestamp', 'object_id', 'Capacity,logical_space_in_use', 'Capacity,physical_space_in_use', 'Capacity,drr', 'Capacity,physical_space', 'Capacity,logical_space']) May 28 13:02:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] --- [GET] https://127.0.0.1:40443/api/monitors/ad_hoc_query/: Done May 28 13:02:47 l75lg1-v1 manila-share[98474]: DEBUG manila.share.driver [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] Updating share stats. {{(pid=98474) _update_share_stats /opt/stack/manila/manila/share/driver.py:1326}} May 28 13:02:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-76ae429c-6d8f-48e0-abfd-d88458354ad1 service manila] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:02:47 l75lg1-v1 neutron-server[77619]: INFO neutron.wsgi [None req-2106544f-23af-4a7f-ab07-4de638772845 None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=adcbdea5704e4efc898c24b2b0a492a5&name=default HTTP/1.1" status: 200 len: 216 time: 0.0094061 May 28 13:02:47 l75lg1-v1 manila-share[98474]: DEBUG oslo_service.periodic_task [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] Running periodic task ShareManager.create_backup_continue {{(pid=98474) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 13:02:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d627ca-6f39-4d0f-ac05-17aac6e5afd0 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-a2d627ca-6f39-4d0f-ac05-17aac6e5afd0 None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:02:47 l75lg1-v1 manila-share[98474]: DEBUG oslo_service.periodic_task [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] Running periodic task ShareManager.restore_backup_continue {{(pid=98474) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 13:02:47 l75lg1-v1 manila-share[98474]: DEBUG oslo_service.periodic_task [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] Running periodic task ShareManager.periodic_share_status_update {{(pid=98474) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 13:02:47 l75lg1-v1 manila-share[98474]: DEBUG manila.share.manager [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] Updating status of share instances. {{(pid=98474) periodic_share_status_update /opt/stack/manila/manila/share/manager.py:5475}} May 28 13:02:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ae429c-6d8f-48e0-abfd-d88458354ad1 service manila] RBAC: Authorizing `identity:validate_token()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d627ca-6f39-4d0f-ac05-17aac6e5afd0 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ae429c-6d8f-48e0-abfd-d88458354ad1 service manila] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:47 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1801/3633] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 13:02:47 2024] GET /identity/v3/auth/tokens => generated 4067 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 13:02:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeed287-4e16-4c5b-bbba-e80dfbe3e6e3 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeed287-4e16-4c5b-bbba-e80dfbe3e6e3 None admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeed287-4e16-4c5b-bbba-e80dfbe3e6e3 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeed287-4e16-4c5b-bbba-e80dfbe3e6e3 None admin] PATH_INFO: `/v3/projects/adcbdea5704e4efc898c24b2b0a492a5` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfeed287-4e16-4c5b-bbba-e80dfbe3e6e3 None admin] RBAC: Authorizing `identity:delete_project(project_id=adcbdea5704e4efc898c24b2b0a492a5)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfeed287-4e16-4c5b-bbba-e80dfbe3e6e3 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:47 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-70eefc71-6d87-4ef4-9e4f-b01a2cd67b49 tempest-SharesActionsTest-2125642311 tempest-SharesActionsTest-2125642311-project-admin] POST http://10.27.203.238/share/v2/633b6f74527b48408dad0eedac73931e/types May 28 13:02:47 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-70eefc71-6d87-4ef4-9e4f-b01a2cd67b49 tempest-SharesActionsTest-2125642311 tempest-SharesActionsTest-2125642311-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share_type": {"name": "tempest-typeshare-type-905538935", "extra_specs": {"driver_handles_share_servers": "False", "snapshot_support": true}, "share_type_access:is_public": true}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:02:47 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-70eefc71-6d87-4ef4-9e4f-b01a2cd67b49 tempest-SharesActionsTest-2125642311 tempest-SharesActionsTest-2125642311-project-admin] http://10.27.203.238/share/v2/633b6f74527b48408dad0eedac73931e/types returned with HTTP 200 May 28 13:02:47 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1303/2585] 10.27.203.238 () {66 vars in 1359 bytes} [Tue May 28 13:02:47 2024] POST /share/v2/633b6f74527b48408dad0eedac73931e/types => generated 677 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:02:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ae429c-6d8f-48e0-abfd-d88458354ad1 service manila] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-76ae429c-6d8f-48e0-abfd-d88458354ad1 service manila] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:02:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ae429c-6d8f-48e0-abfd-d88458354ad1 service manila] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-bfeed287-4e16-4c5b-bbba-e80dfbe3e6e3 None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'adcbdea5704e4efc898c24b2b0a492a5', 'request_id': 'req-bfeed287-4e16-4c5b-bbba-e80dfbe3e6e3'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-bfeed287-4e16-4c5b-bbba-e80dfbe3e6e3 None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'adcbdea5704e4efc898c24b2b0a492a5', 'request_id': 'req-bfeed287-4e16-4c5b-bbba-e80dfbe3e6e3'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-bfeed287-4e16-4c5b-bbba-e80dfbe3e6e3 None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'adcbdea5704e4efc898c24b2b0a492a5', 'request_id': 'req-bfeed287-4e16-4c5b-bbba-e80dfbe3e6e3'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-bfeed287-4e16-4c5b-bbba-e80dfbe3e6e3 None admin] The token cache is being invalidate because project adcbdea5704e4efc898c24b2b0a492a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 13:02:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-bfeed287-4e16-4c5b-bbba-e80dfbe3e6e3 None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-bfeed287-4e16-4c5b-bbba-e80dfbe3e6e3 None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:47 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1833/3634] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 13:02:47 2024] DELETE /identity/v3/projects/adcbdea5704e4efc898c24b2b0a492a5 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:02:47 l75lg1-v1 neutron-server[77619]: DEBUG neutron.wsgi [-] (77619) accepted ('10.27.203.238', 60442) {{(pid=77619) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 13:02:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e911560-ebec-4059-b745-ac399eee3eca service manila] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f110cf6300f049c897d0aab63218d1e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e911560-ebec-4059-b745-ac399eee3eca service manila] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e911560-ebec-4059-b745-ac399eee3eca service manila] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e911560-ebec-4059-b745-ac399eee3eca service manila] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-9e911560-ebec-4059-b745-ac399eee3eca service manila] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:02:47 l75lg1-v1 neutron-server[77619]: INFO neutron.wsgi [None req-30eb3384-7ea1-49e2-9545-a6fa859346e5 None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=d1d71dc9f23c4c6a8e146d99ad65ebb2&name=default HTTP/1.1" status: 200 len: 216 time: 0.0115037 May 28 13:02:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeed287-4e16-4c5b-bbba-e80dfbe3e6e3 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:02:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-bfeed287-4e16-4c5b-bbba-e80dfbe3e6e3 None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:02:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeed287-4e16-4c5b-bbba-e80dfbe3e6e3 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:02:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3a93b4-c7a8-4403-b6c9-688e0137dc2c None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:02:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3a93b4-c7a8-4403-b6c9-688e0137dc2c None admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:02:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3a93b4-c7a8-4403-b6c9-688e0137dc2c None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:02:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3a93b4-c7a8-4403-b6c9-688e0137dc2c None admin] PATH_INFO: `/v3/projects/d1d71dc9f23c4c6a8e146d99ad65ebb2` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:02:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3a93b4-c7a8-4403-b6c9-688e0137dc2c None admin] RBAC: Authorizing `identity:delete_project(project_id=d1d71dc9f23c4c6a8e146d99ad65ebb2)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e911560-ebec-4059-b745-ac399eee3eca service manila] RBAC: Authorizing `identity:validate_token()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:02:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3a93b4-c7a8-4403-b6c9-688e0137dc2c None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:47 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e911560-ebec-4059-b745-ac399eee3eca service manila] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:02:47 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1802/3635] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 13:02:47 2024] GET /identity/v3/auth/tokens => generated 3942 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 28 13:02:47 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-936b2f20-d3d8-4c99-9cdd-3cee19dcf9ff tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] POST http://10.27.203.238/share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares May 28 13:02:47 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-936b2f20-d3d8-4c99-9cdd-3cee19dcf9ff tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share": {"share_proto": "nfs", "description": "tempest-tempest-share-description-344942892", "snapshot_id": null, "name": "tempest-tempest-share-name-1367132874", "size": 1, "metadata": {"foo_key_share_1": "foo_value_share_1", "bar_key_share_1": "foo_value_share_1"}, "is_public": false, "share_type": "49315d96-de20-4c8a-ac49-f57e8d1b1e18"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:02:47 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.v1.shares [None req-936b2f20-d3d8-4c99-9cdd-3cee19dcf9ff tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Create NFS share of 1 GB May 28 13:02:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-7c3a93b4-c7a8-4403-b6c9-688e0137dc2c None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1d71dc9f23c4c6a8e146d99ad65ebb2', 'request_id': 'req-7c3a93b4-c7a8-4403-b6c9-688e0137dc2c'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-7c3a93b4-c7a8-4403-b6c9-688e0137dc2c None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1d71dc9f23c4c6a8e146d99ad65ebb2', 'request_id': 'req-7c3a93b4-c7a8-4403-b6c9-688e0137dc2c'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-7c3a93b4-c7a8-4403-b6c9-688e0137dc2c None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1d71dc9f23c4c6a8e146d99ad65ebb2', 'request_id': 'req-7c3a93b4-c7a8-4403-b6c9-688e0137dc2c'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-7c3a93b4-c7a8-4403-b6c9-688e0137dc2c None admin] The token cache is being invalidate because project d1d71dc9f23c4c6a8e146d99ad65ebb2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 13:02:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-7c3a93b4-c7a8-4403-b6c9-688e0137dc2c None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:47 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-7c3a93b4-c7a8-4403-b6c9-688e0137dc2c None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:02:47 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1834/3636] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 13:02:47 2024] DELETE /identity/v3/projects/d1d71dc9f23c4c6a8e146d99ad65ebb2 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:02:47 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.quota [None req-936b2f20-d3d8-4c99-9cdd-3cee19dcf9ff tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Created reservations ['35dd63c1-049e-47cc-aaf5-356efd0745fe', 'b08669ac-1769-4f20-a476-43fcce3c1fce', '02efcad6-8671-4781-aa82-66afe3d23485', 'af79e38a-2c4e-49a5-993e-44108d700d56'] {{(pid=98330) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 13:02:47 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.quota [None req-936b2f20-d3d8-4c99-9cdd-3cee19dcf9ff tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Committed reservations ['35dd63c1-049e-47cc-aaf5-356efd0745fe', 'b08669ac-1769-4f20-a476-43fcce3c1fce', '02efcad6-8671-4781-aa82-66afe3d23485', 'af79e38a-2c4e-49a5-993e-44108d700d56'] {{(pid=98330) commit /opt/stack/manila/manila/quota.py:1063}} May 28 13:02:47 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.host_manager [None req-936b2f20-d3d8-4c99-9cdd-3cee19dcf9ff tempest-SharesActionsTest-682704550 None] Share service is down. (host: l75lg1-v1@generic2). May 28 13:02:47 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.host_manager [None req-936b2f20-d3d8-4c99-9cdd-3cee19dcf9ff tempest-SharesActionsTest-682704550 None] Share service is down. (host: l75lg1-v1@generic1). May 28 13:02:47 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-936b2f20-d3d8-4c99-9cdd-3cee19dcf9ff tempest-SharesActionsTest-682704550 None] Starting with 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:80}} May 28 13:02:47 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-936b2f20-d3d8-4c99-9cdd-3cee19dcf9ff tempest-SharesActionsTest-682704550 None] Filter OnlyHostFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:02:47 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-936b2f20-d3d8-4c99-9cdd-3cee19dcf9ff tempest-SharesActionsTest-682704550 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:02:47 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.capacity [None req-936b2f20-d3d8-4c99-9cdd-3cee19dcf9ff tempest-SharesActionsTest-682704550 None] Space information for share creation on host l75lg1-v1@vast#vast (requested / avail): 1/2082 {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/capacity.py:83}} May 28 13:02:47 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-936b2f20-d3d8-4c99-9cdd-3cee19dcf9ff tempest-SharesActionsTest-682704550 None] Filter CapacityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:02:47 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-936b2f20-d3d8-4c99-9cdd-3cee19dcf9ff tempest-SharesActionsTest-682704550 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:02:47 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-936b2f20-d3d8-4c99-9cdd-3cee19dcf9ff tempest-SharesActionsTest-682704550 None] Driver Filter: Checking host 'l75lg1-v1@vast#vast' {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:37}} May 28 13:02:47 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-936b2f20-d3d8-4c99-9cdd-3cee19dcf9ff tempest-SharesActionsTest-682704550 None] Filter function not set :: passing host. {{(pid=98327) _check_filter_function /opt/stack/manila/manila/scheduler/filters/driver.py:53}} May 28 13:02:47 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-936b2f20-d3d8-4c99-9cdd-3cee19dcf9ff tempest-SharesActionsTest-682704550 None] Result: True {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:40}} May 28 13:02:47 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-936b2f20-d3d8-4c99-9cdd-3cee19dcf9ff tempest-SharesActionsTest-682704550 None] Done checking host 'l75lg1-v1@vast#vast' {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:41}} May 28 13:02:47 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-936b2f20-d3d8-4c99-9cdd-3cee19dcf9ff tempest-SharesActionsTest-682704550 None] Filter DriverFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:02:47 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-936b2f20-d3d8-4c99-9cdd-3cee19dcf9ff tempest-SharesActionsTest-682704550 None] Filter ShareReplicationFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:02:47 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-936b2f20-d3d8-4c99-9cdd-3cee19dcf9ff tempest-SharesActionsTest-682704550 None] Filter CreateFromSnapshotFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:02:47 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-936b2f20-d3d8-4c99-9cdd-3cee19dcf9ff tempest-SharesActionsTest-682704550 None] Filter AffinityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:02:47 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-936b2f20-d3d8-4c99-9cdd-3cee19dcf9ff tempest-SharesActionsTest-682704550 None] Filter AntiAffinityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:02:47 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.drivers.filter [None req-936b2f20-d3d8-4c99-9cdd-3cee19dcf9ff tempest-SharesActionsTest-682704550 None] Filtered share [host: 'l75lg1-v1@vast#vast', free_capacity_gb: 2082.6009807521477, pools: None] {{(pid=98327) _schedule_share /opt/stack/manila/manila/scheduler/drivers/filter.py:268}} May 28 13:02:47 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-936b2f20-d3d8-4c99-9cdd-3cee19dcf9ff tempest-SharesActionsTest-682704550 None] Checking host 'l75lg1-v1@vast#vast' {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:46}} May 28 13:02:47 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-936b2f20-d3d8-4c99-9cdd-3cee19dcf9ff tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] http://10.27.203.238/share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares returned with HTTP 200 May 28 13:02:47 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.weighers.goodness [None req-936b2f20-d3d8-4c99-9cdd-3cee19dcf9ff tempest-SharesActionsTest-682704550 None] Goodness function not set :: defaulting to minimal goodness rating of 0. May 28 13:02:47 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1283/2586] 10.27.203.238 () {66 vars in 1362 bytes} [Tue May 28 13:02:47 2024] POST /share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares => generated 1414 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:02:47 l75lg1-v1 manila-scheduler[98327]: INFO manila.scheduler.weighers.goodness [None req-936b2f20-d3d8-4c99-9cdd-3cee19dcf9ff tempest-SharesActionsTest-682704550 None] Goodness function result for host l75lg1-v1@vast#vast: 0. May 28 13:02:47 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-936b2f20-d3d8-4c99-9cdd-3cee19dcf9ff tempest-SharesActionsTest-682704550 None] Goodness: 0 {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:48}} May 28 13:02:47 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-936b2f20-d3d8-4c99-9cdd-3cee19dcf9ff tempest-SharesActionsTest-682704550 None] Done checking host 'l75lg1-v1@vast#vast' {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:49}} May 28 13:02:47 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.drivers.filter [None req-936b2f20-d3d8-4c99-9cdd-3cee19dcf9ff tempest-SharesActionsTest-682704550 None] Choosing for share: WeighedHost [host: l75lg1-v1@vast#vast, weight: 0.0] {{(pid=98327) _schedule_share /opt/stack/manila/manila/scheduler/drivers/filter.py:274}} May 28 13:02:47 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-cbac018d-f880-40ca-84ec-8a50e3ba16f0 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] GET http://10.27.203.238/share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/f4d62492-698d-44ff-a5f4-f6b156775dbd May 28 13:02:47 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-cbac018d-f880-40ca-84ec-8a50e3ba16f0 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:02:47 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-cbac018d-f880-40ca-84ec-8a50e3ba16f0 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:02:47 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-cbac018d-f880-40ca-84ec-8a50e3ba16f0 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] http://10.27.203.238/share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/f4d62492-698d-44ff-a5f4-f6b156775dbd returned with HTTP 200 May 28 13:02:47 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1304/2587] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:02:47 2024] GET /share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/f4d62492-698d-44ff-a5f4-f6b156775dbd => generated 1414 bytes in 31 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:02:48 l75lg1-v1 nova-conductor[83229]: DEBUG dbcounter [-] [83229] Writing DB stats nova_cell0:SELECT=1,nova_cell0:UPDATE=1 {{(pid=83229) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:02:48 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-936b2f20-d3d8-4c99-9cdd-3cee19dcf9ff tempest-SharesActionsTest-682704550 None] >>> [GET] https://127.0.0.1:40443/api/vippools/ May 28 13:02:48 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-936b2f20-d3d8-4c99-9cdd-3cee19dcf9ff tempest-SharesActionsTest-682704550 None] {'allow_redirects': True, 'params': {'name': 'vippool-1'}} May 28 13:02:48 l75lg1-v1 nova-conductor[83233]: DEBUG dbcounter [-] [83233] Writing DB stats nova_cell0:SELECT=1 {{(pid=83233) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:02:48 l75lg1-v1 dstat.sh[49771]: 28-05 13:02:48| 16 2 80 2 0|5506M 1911M 278M 7929M| 14k 1569B| 0 2341k| 0 340 |8460 15k|1.18 1.16 1.07|1.0 0 2.0| 0 0 | 0 2048M| 29 363 0 55 2 May 28 13:02:48 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-936b2f20-d3d8-4c99-9cdd-3cee19dcf9ff tempest-SharesActionsTest-682704550 None] <<< [GET] https://127.0.0.1:40443/api/vippools/ May 28 13:02:48 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-936b2f20-d3d8-4c99-9cdd-3cee19dcf9ff tempest-SharesActionsTest-682704550 None] [Bunch(active_cnode_ids=[], active_interfaces=4, cluster='loop75-kfs', cluster_id=1, cnode_ids=[], cnodes=[], domain_name='vippool-1', enable_l3=False, enable_weighted_balancing=False, enabled=True, end_ip='172.21.75.4', guid='f2abaede-b397-413a-8faa-3aeead6d3b28', gw_ip='', gw_ipv6='', id=2, ip_ranges=[['172.21.75.1', '172.21.75.4']], name='vippool-1', peer_asn=0, port_membership='ALL', ranges_summary='172.21.75.[1-4]', role='PROTOCOLS', start_ip='172.21.75.1', subnet_cidr=16, subnet_cidr_ipv6=None, sync='SYNCED', sync_time='2024-05-28T12:50:09.644123Z', tenant_id=1, tenant_name='default', title='172.21.75.1 - 172.21.75.4', url='https://127.0.0.1:40443/api/vippools/2/', vast_asn=0, vlan=0, vms_preferred=False)] May 28 13:02:48 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-936b2f20-d3d8-4c99-9cdd-3cee19dcf9ff tempest-SharesActionsTest-682704550 None] --- [GET] https://127.0.0.1:40443/api/vippools/: Done May 28 13:02:48 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-936b2f20-d3d8-4c99-9cdd-3cee19dcf9ff tempest-SharesActionsTest-682704550 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:02:48 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-936b2f20-d3d8-4c99-9cdd-3cee19dcf9ff tempest-SharesActionsTest-682704550 None] {'allow_redirects': True, May 28 13:02:48 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-936b2f20-d3d8-4c99-9cdd-3cee19dcf9ff tempest-SharesActionsTest-682704550 None] 'params': {'name': '4e3de968-00b8-414a-b562-a9b4001115dd'}} May 28 13:02:48 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-936b2f20-d3d8-4c99-9cdd-3cee19dcf9ff tempest-SharesActionsTest-682704550 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:02:48 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-936b2f20-d3d8-4c99-9cdd-3cee19dcf9ff tempest-SharesActionsTest-682704550 None] [] May 28 13:02:48 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-936b2f20-d3d8-4c99-9cdd-3cee19dcf9ff tempest-SharesActionsTest-682704550 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 13:02:48 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-936b2f20-d3d8-4c99-9cdd-3cee19dcf9ff tempest-SharesActionsTest-682704550 None] >>> [POST] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:02:48 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-936b2f20-d3d8-4c99-9cdd-3cee19dcf9ff tempest-SharesActionsTest-682704550 None] {'data': '{"name": "4e3de968-00b8-414a-b562-a9b4001115dd"}', May 28 13:02:48 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-936b2f20-d3d8-4c99-9cdd-3cee19dcf9ff tempest-SharesActionsTest-682704550 None] 'json': None, May 28 13:02:48 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-936b2f20-d3d8-4c99-9cdd-3cee19dcf9ff tempest-SharesActionsTest-682704550 None] 'params': None} May 28 13:02:49 l75lg1-v1 dstat.sh[49771]: 28-05 13:02:49| 1 0 98 1 0|5506M 1911M 278M 7929M| 24k 1737B| 0 968k| 0 65.0 |1966 2902 |1.18 1.16 1.07|1.0 0 0| 0 0 | 0 2048M| 29 363 0 55 2 May 28 13:02:49 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-936b2f20-d3d8-4c99-9cdd-3cee19dcf9ff tempest-SharesActionsTest-682704550 None] <<< [POST] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:02:49 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-936b2f20-d3d8-4c99-9cdd-3cee19dcf9ff tempest-SharesActionsTest-682704550 None] Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=0, created='2024-05-28T13:02:49.220352Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='6d77d519-0f5e-4734-9d9a-0b7c040b16ba', id=58, internal=False, is_s3_default_policy=False, name='4e3de968-00b8-414a-b562-a9b4001115dd', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=[], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['*'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['*'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T13:02:49.548295Z', tenant_id=1, tenant_name='default', title='4e3de968-00b8-414a-b562-a9b4001115dd', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/58/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[]) May 28 13:02:49 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-936b2f20-d3d8-4c99-9cdd-3cee19dcf9ff tempest-SharesActionsTest-682704550 None] --- [POST] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 13:02:49 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-936b2f20-d3d8-4c99-9cdd-3cee19dcf9ff tempest-SharesActionsTest-682704550 None] >>> [GET] https://127.0.0.1:40443/api/quotas/ May 28 13:02:49 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-936b2f20-d3d8-4c99-9cdd-3cee19dcf9ff tempest-SharesActionsTest-682704550 None] {'allow_redirects': True, May 28 13:02:49 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-936b2f20-d3d8-4c99-9cdd-3cee19dcf9ff tempest-SharesActionsTest-682704550 None] 'params': {'name': '4e3de968-00b8-414a-b562-a9b4001115dd'}} May 28 13:02:49 l75lg1-v1 nova-conductor[83647]: DEBUG dbcounter [-] [83647] Writing DB stats nova_cell1:SELECT=1,nova_cell1:UPDATE=1 {{(pid=83647) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:02:50 l75lg1-v1 nova-conductor[83648]: DEBUG dbcounter [-] [83648] Writing DB stats nova_cell1:SELECT=1 {{(pid=83648) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:02:50 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-936b2f20-d3d8-4c99-9cdd-3cee19dcf9ff tempest-SharesActionsTest-682704550 None] <<< [GET] https://127.0.0.1:40443/api/quotas/ May 28 13:02:50 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-936b2f20-d3d8-4c99-9cdd-3cee19dcf9ff tempest-SharesActionsTest-682704550 None] [] May 28 13:02:50 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-936b2f20-d3d8-4c99-9cdd-3cee19dcf9ff tempest-SharesActionsTest-682704550 None] --- [GET] https://127.0.0.1:40443/api/quotas/: Done May 28 13:02:50 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-936b2f20-d3d8-4c99-9cdd-3cee19dcf9ff tempest-SharesActionsTest-682704550 None] >>> [POST] https://127.0.0.1:40443/api/quotas/ May 28 13:02:50 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-936b2f20-d3d8-4c99-9cdd-3cee19dcf9ff tempest-SharesActionsTest-682704550 None] {'data': '{"name": "4e3de968-00b8-414a-b562-a9b4001115dd", "path": ' May 28 13:02:50 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-936b2f20-d3d8-4c99-9cdd-3cee19dcf9ff tempest-SharesActionsTest-682704550 None] '"/manila/manila-4e3de968-00b8-414a-b562-a9b4001115dd", "create_dir": ' May 28 13:02:50 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-936b2f20-d3d8-4c99-9cdd-3cee19dcf9ff tempest-SharesActionsTest-682704550 None] 'true, "hard_limit": 1073741824}', May 28 13:02:50 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-936b2f20-d3d8-4c99-9cdd-3cee19dcf9ff tempest-SharesActionsTest-682704550 None] 'json': None, May 28 13:02:50 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-936b2f20-d3d8-4c99-9cdd-3cee19dcf9ff tempest-SharesActionsTest-682704550 None] 'params': None} May 28 13:02:50 l75lg1-v1 dstat.sh[49771]: 28-05 13:02:50| 1 0 98 1 0|5506M 1911M 278M 7929M| 19k 1667B| 0 1087k| 0 92.9 |2047 3249 |1.18 1.16 1.07| 0 0 0| 0 0 | 0 2048M| 29 363 0 55 2 May 28 13:02:50 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-936b2f20-d3d8-4c99-9cdd-3cee19dcf9ff tempest-SharesActionsTest-682704550 None] <<< [POST] https://127.0.0.1:40443/api/quotas/ May 28 13:02:50 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-936b2f20-d3d8-4c99-9cdd-3cee19dcf9ff tempest-SharesActionsTest-682704550 None] Bunch(cluster='loop75-kfs', cluster_id=1, default_email=None, default_group_quota=None, default_user_quota=None, enable_alarms=True, enable_email_providers=True, grace_period=None, group_quotas=[], guid='70832072-1955-4a61-836f-71fd20a1e749', hard_limit=1073741824, hard_limit_inodes=None, id=55, internal=False, is_user_quota=False, last_user_quotas_update=None, name='4e3de968-00b8-414a-b562-a9b4001115dd', num_blocked_users=0, num_exceeded_users=0, path='/manila/manila-4e3de968-00b8-414a-b562-a9b4001115dd', percent_capacity=0, percent_inodes=None, pretty_grace_period=None, pretty_grace_period_expiration=None, pretty_state='OK (CREATED)', soft_limit=None, soft_limit_inodes=None, state='OK', sync_state='CREATED', system_id=55, tenant_id=1, tenant_name='default', time_to_block=None, title='4e3de968-00b8-414a-b562-a9b4001115dd', url='https://127.0.0.1:40443/api/quotas/55/', used_capacity=0, used_capacity_tb=0.0, used_effective_capacity=0, used_effective_capacity_tb=0.0, used_inodes=0, used_limited_capacity=0, user_quotas=[]) May 28 13:02:50 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-936b2f20-d3d8-4c99-9cdd-3cee19dcf9ff tempest-SharesActionsTest-682704550 None] --- [POST] https://127.0.0.1:40443/api/quotas/: Done May 28 13:02:50 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-936b2f20-d3d8-4c99-9cdd-3cee19dcf9ff tempest-SharesActionsTest-682704550 None] >>> [GET] https://127.0.0.1:40443/api/views/ May 28 13:02:50 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-936b2f20-d3d8-4c99-9cdd-3cee19dcf9ff tempest-SharesActionsTest-682704550 None] {'allow_redirects': True, May 28 13:02:50 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-936b2f20-d3d8-4c99-9cdd-3cee19dcf9ff tempest-SharesActionsTest-682704550 None] 'params': {'name': '4e3de968-00b8-414a-b562-a9b4001115dd'}} May 28 13:02:50 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-f87e1130-3d94-49a9-bde5-efc911163954 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] GET http://10.27.203.238/share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/f4d62492-698d-44ff-a5f4-f6b156775dbd May 28 13:02:50 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-f87e1130-3d94-49a9-bde5-efc911163954 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:02:50 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-f87e1130-3d94-49a9-bde5-efc911163954 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:02:50 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-f87e1130-3d94-49a9-bde5-efc911163954 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] http://10.27.203.238/share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/f4d62492-698d-44ff-a5f4-f6b156775dbd returned with HTTP 200 May 28 13:02:50 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1284/2588] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:02:50 2024] GET /share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/f4d62492-698d-44ff-a5f4-f6b156775dbd => generated 1416 bytes in 27 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:02:51 l75lg1-v1 dstat.sh[49771]: 28-05 13:02:51| 1 0 96 2 0|5506M 1911M 278M 7929M| 16k 736B| 0 4148k| 0 294 |2642 4099 |1.18 1.16 1.07|1.0 0 0| 0 0 | 0 2048M| 29 363 0 54 2 May 28 13:02:51 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-936b2f20-d3d8-4c99-9cdd-3cee19dcf9ff tempest-SharesActionsTest-682704550 None] <<< [GET] https://127.0.0.1:40443/api/views/ May 28 13:02:51 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-936b2f20-d3d8-4c99-9cdd-3cee19dcf9ff tempest-SharesActionsTest-682704550 None] [] May 28 13:02:51 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-936b2f20-d3d8-4c99-9cdd-3cee19dcf9ff tempest-SharesActionsTest-682704550 None] --- [GET] https://127.0.0.1:40443/api/views/: Done May 28 13:02:51 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-936b2f20-d3d8-4c99-9cdd-3cee19dcf9ff tempest-SharesActionsTest-682704550 None] >>> [POST] https://127.0.0.1:40443/api/views/ May 28 13:02:51 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-936b2f20-d3d8-4c99-9cdd-3cee19dcf9ff tempest-SharesActionsTest-682704550 None] {'data': '{"name": "4e3de968-00b8-414a-b562-a9b4001115dd", "path": ' May 28 13:02:51 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-936b2f20-d3d8-4c99-9cdd-3cee19dcf9ff tempest-SharesActionsTest-682704550 None] '"/manila/manila-4e3de968-00b8-414a-b562-a9b4001115dd", "policy_id": ' May 28 13:02:51 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-936b2f20-d3d8-4c99-9cdd-3cee19dcf9ff tempest-SharesActionsTest-682704550 None] '58, "create_dir": true, "protocols": ["NFS"]}', May 28 13:02:51 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-936b2f20-d3d8-4c99-9cdd-3cee19dcf9ff tempest-SharesActionsTest-682704550 None] 'json': None, May 28 13:02:51 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-936b2f20-d3d8-4c99-9cdd-3cee19dcf9ff tempest-SharesActionsTest-682704550 None] 'params': None} May 28 13:02:52 l75lg1-v1 dstat.sh[49771]: 28-05 13:02:52| 1 0 98 0 0|5506M 1911M 278M 7929M| 13k 940B| 0 228k| 0 41.0 |2119 3431 |1.08 1.14 1.06|1.0 0 0| 0 0 | 0 2048M| 29 363 0 54 2 May 28 13:02:52 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-936b2f20-d3d8-4c99-9cdd-3cee19dcf9ff tempest-SharesActionsTest-682704550 None] <<< [POST] https://127.0.0.1:40443/api/views/ May 28 13:02:52 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-936b2f20-d3d8-4c99-9cdd-3cee19dcf9ff tempest-SharesActionsTest-682704550 None] Bunch(abac_tags=[], abe_max_depth=None, abe_protocols=[], alias='', allow_anonymous_access=False, allow_s3_anonymous_access=False, auto_commit='0d', bucket='', bucket_creators=[], bucket_creators_groups=[], bucket_owner=None, bulk_permission_update_progress=None, bulk_permission_update_state=None, cluster='loop75-kfs', cluster_id=1, created='2024-05-28T13:02:51.993158Z', enabled=True, files_retention_mode='NONE', guid='703fe4f1-bf9d-43d5-96ef-af187cbba849', id=57, ignore_oos=False, internal=False, is_remote=False, is_seamless=False, logical_capacity=0, max_retention_period=None, min_retention_period=None, name='4e3de968-00b8-414a-b562-a9b4001115dd', nfs_interop_flags='BOTH_NFS3_AND_NFS4_INTEROP_DISABLED', path='/manila/manila-4e3de968-00b8-414a-b562-a9b4001115dd', physical_capacity=0, policy='4e3de968-00b8-414a-b562-a9b4001115dd', policy_id=58, protocols=['NFS'], qos_policy=None, qos_policy_id=None, s3_locks=False, s3_locks_retention_mode='NONE', s3_locks_retention_period='', s3_object_ownership_rule='ObjectWriter', s3_unverified_lookup=False, s3_versioning=False, select_for_live_monitoring=False, share='', share_acl=Bunch(acl=[], enabled=False), sync='SYNCED', sync_time='2024-05-28T13:02:52.315832Z', tenant_id=1, tenant_name='default', title='/manila/manila-4e3de968-00b8-414a-b562-a9b4001115dd', url='https://127.0.0.1:40443/api/views/57/') May 28 13:02:52 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-936b2f20-d3d8-4c99-9cdd-3cee19dcf9ff tempest-SharesActionsTest-682704550 None] --- [POST] https://127.0.0.1:40443/api/views/: Done May 28 13:02:52 l75lg1-v1 manila-share[98474]: INFO manila.share.manager [None req-936b2f20-d3d8-4c99-9cdd-3cee19dcf9ff tempest-SharesActionsTest-682704550 None] Share instance 4e3de968-00b8-414a-b562-a9b4001115dd created successfully. May 28 13:02:52 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 13:02:52 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 13:02:52 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 13:02:52 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.manager [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=83654) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10545}} May 28 13:02:53 l75lg1-v1 neutron-server[77618]: DEBUG dbcounter [-] [77618] Writing DB stats neutron:SELECT=4,neutron:UPDATE=1 {{(pid=77618) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:02:53 l75lg1-v1 dstat.sh[49771]: 28-05 13:02:53| 1 0 98 1 0|5506M 1911M 278M 7929M| 22k 132B| 0 488k| 0 69.0 |2133 3340 |1.08 1.14 1.06| 0 0 0| 0 0 | 0 2048M| 29 361 0 50 4 May 28 13:02:53 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 13:02:53 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-8ed6232f-6e60-422d-a5c9-d914e21ea0c8 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] GET http://10.27.203.238/share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/f4d62492-698d-44ff-a5f4-f6b156775dbd May 28 13:02:53 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-8ed6232f-6e60-422d-a5c9-d914e21ea0c8 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:02:53 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-8ed6232f-6e60-422d-a5c9-d914e21ea0c8 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:02:54 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-8ed6232f-6e60-422d-a5c9-d914e21ea0c8 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] http://10.27.203.238/share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/f4d62492-698d-44ff-a5f4-f6b156775dbd returned with HTTP 200 May 28 13:02:54 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1305/2589] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:02:53 2024] GET /share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/f4d62492-698d-44ff-a5f4-f6b156775dbd => generated 1419 bytes in 25 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:02:54 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-291d66cd-515e-4b2e-bf36-48593a9dff76 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] POST http://10.27.203.238/share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/snapshots May 28 13:02:54 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-291d66cd-515e-4b2e-bf36-48593a9dff76 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Action: 'create', calling method: ShareSnapshotMixin.create, body: {"snapshot": {"name": "tempest-tempest-snapshot-name-917194267", "force": false, "description": "tempest-tempest-snapshot-description-854300103", "share_id": "f4d62492-698d-44ff-a5f4-f6b156775dbd"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:02:54 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.v1.share_snapshots [None req-291d66cd-515e-4b2e-bf36-48593a9dff76 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Create snapshot from share f4d62492-698d-44ff-a5f4-f6b156775dbd May 28 13:02:54 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.quota [None req-291d66cd-515e-4b2e-bf36-48593a9dff76 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Created reservations ['3140a956-4d98-4737-9623-4477faff1612', '871a2497-1f3e-4887-86a2-225014cd34f7', '2205280f-389b-4a83-a2eb-1eb76848ec8e', '3d032070-acd2-4272-83d4-344fbe7b9d01'] {{(pid=98330) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 13:02:54 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.quota [None req-291d66cd-515e-4b2e-bf36-48593a9dff76 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Committed reservations ['3140a956-4d98-4737-9623-4477faff1612', '871a2497-1f3e-4887-86a2-225014cd34f7', '2205280f-389b-4a83-a2eb-1eb76848ec8e', '3d032070-acd2-4272-83d4-344fbe7b9d01'] {{(pid=98330) commit /opt/stack/manila/manila/quota.py:1063}} May 28 13:02:54 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-291d66cd-515e-4b2e-bf36-48593a9dff76 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] http://10.27.203.238/share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/snapshots returned with HTTP 202 May 28 13:02:54 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1285/2590] 10.27.203.238 () {66 vars in 1371 bytes} [Tue May 28 13:02:54 2024] POST /share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/snapshots => generated 745 bytes in 200 msecs (HTTP/1.1 202) 6 headers in 237 bytes (1 switches on core 0) May 28 13:02:54 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-2df67f86-1411-4bae-aa6c-5452bda7f618 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] GET http://10.27.203.238/share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/snapshots/cff0744c-aefe-421e-b8b7-055f24614a39 May 28 13:02:54 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-2df67f86-1411-4bae-aa6c-5452bda7f618 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:02:54 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-2df67f86-1411-4bae-aa6c-5452bda7f618 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Calling method 'ShareSnapshotMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:02:54 l75lg1-v1 dstat.sh[49771]: 28-05 13:02:54| 3 0 96 1 0|5506M 1911M 278M 7929M| 14k 0 | 0 612k| 0 89.0 |2689 4498 |1.08 1.14 1.06|4.0 0 0| 0 0 | 0 2048M| 29 362 0 50 4 May 28 13:02:54 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-2df67f86-1411-4bae-aa6c-5452bda7f618 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] http://10.27.203.238/share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/snapshots/cff0744c-aefe-421e-b8b7-055f24614a39 returned with HTTP 200 May 28 13:02:54 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1306/2591] 10.27.203.238 () {64 vars in 1460 bytes} [Tue May 28 13:02:54 2024] GET /share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/snapshots/cff0744c-aefe-421e-b8b7-055f24614a39 => generated 745 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:02:54 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-291d66cd-515e-4b2e-bf36-48593a9dff76 tempest-SharesActionsTest-682704550 None] >>> [POST] https://127.0.0.1:40443/api/snapshots/ May 28 13:02:54 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-291d66cd-515e-4b2e-bf36-48593a9dff76 tempest-SharesActionsTest-682704550 None] {'data': '{"path": "/manila/manila-4e3de968-00b8-414a-b562-a9b4001115dd", ' May 28 13:02:54 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-291d66cd-515e-4b2e-bf36-48593a9dff76 tempest-SharesActionsTest-682704550 None] '"name": "share-snapshot-a247d85c-9634-4c76-9ca5-380c819d8195"}', May 28 13:02:54 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-291d66cd-515e-4b2e-bf36-48593a9dff76 tempest-SharesActionsTest-682704550 None] 'json': None, May 28 13:02:54 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-291d66cd-515e-4b2e-bf36-48593a9dff76 tempest-SharesActionsTest-682704550 None] 'params': None} May 28 13:02:54 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 13:02:55 l75lg1-v1 dstat.sh[49771]: 28-05 13:02:55| 1 0 98 0 0|5506M 1911M 278M 7929M| 11k 908B| 0 368k| 0 26.0 |1624 2790 |1.08 1.14 1.06|1.0 0 0| 0 0 | 0 2048M| 29 361 0 50 4 May 28 13:02:55 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 13:02:56 l75lg1-v1 neutron-server[77618]: DEBUG dbcounter [-] [77618] Writing DB stats neutron:SELECT=4 {{(pid=77618) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:02:56 l75lg1-v1 dstat.sh[49771]: 28-05 13:02:56| 0 0 99 0 0|5506M 1911M 278M 7929M| 18k 172B| 0 320k| 0 23.0 |1559 2351 |1.08 1.14 1.06|1.0 0 0| 0 0 | 0 2048M| 29 361 0 50 4 May 28 13:02:56 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 13:02:56 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.manager [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Starting heal instance info cache {{(pid=83654) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}} May 28 13:02:56 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.manager [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Rebuilding the list of instances to heal {{(pid=83654) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9930}} May 28 13:02:56 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Expecting reply to msg 06badfce1c5f4991b4eecb9dca084d83 in queue reply_37f4cbd1dd094961a22b8a65f222c327 May 28 13:02:56 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [-] Received RPC response for msg 06badfce1c5f4991b4eecb9dca084d83 May 28 13:02:56 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-291d66cd-515e-4b2e-bf36-48593a9dff76 tempest-SharesActionsTest-682704550 None] <<< [POST] https://127.0.0.1:40443/api/snapshots/ May 28 13:02:56 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-291d66cd-515e-4b2e-bf36-48593a9dff76 tempest-SharesActionsTest-682704550 None] Bunch(access_path='/.vast_all_snapshots/1000000017_share-snapshot-a247d85c-9634-4c76-9ca5-380c819d8195', aggr_phys_estimation=0, cluster='loop75-kfs', created='2024-05-28T13:02:54.662355Z', eta_sec=30819898621.247448, expiration_time='3001-01-19T07:59:58Z', guid='f4e87a74-84ff-4c32-a56f-7e32918e696f', id=18, indestructible=False, locked=False, name='share-snapshot-a247d85c-9634-4c76-9ca5-380c819d8195', path='/manila/manila-4e3de968-00b8-414a-b562-a9b4001115dd/', policy=None, policy_id=None, protection_policy_id=None, state='SUCCEED', tenant_id=1, tenant_name='default', title='share-snapshot-a247d85c-9634-4c76-9ca5-380c819d8195(/manila/manila-4e3de968-00b8-414a-b562-a9b4001115dd/)', type='local', unique_phys_estimation=0, url='https://127.0.0.1:40443/api/snapshots/18/') May 28 13:02:56 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-291d66cd-515e-4b2e-bf36-48593a9dff76 tempest-SharesActionsTest-682704550 None] --- [POST] https://127.0.0.1:40443/api/snapshots/: Done May 28 13:02:57 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.manager [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Didn't find any instances for network info cache update. {{(pid=83654) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10012}} May 28 13:02:57 l75lg1-v1 dstat.sh[49771]: 28-05 13:02:57| 1 0 98 0 0|5506M 1911M 278M 7929M| 16k 66B| 0 412k| 0 39.0 |2086 3185 |1.00 1.12 1.06|1.0 0 0| 0 0 | 0 2048M| 29 361 0 50 4 May 28 13:02:57 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-b5f16ce8-022c-4e20-981a-aa06f3a58c47 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] GET http://10.27.203.238/share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/snapshots/cff0744c-aefe-421e-b8b7-055f24614a39 May 28 13:02:57 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-b5f16ce8-022c-4e20-981a-aa06f3a58c47 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:02:57 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-b5f16ce8-022c-4e20-981a-aa06f3a58c47 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Calling method 'ShareSnapshotMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:02:57 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-b5f16ce8-022c-4e20-981a-aa06f3a58c47 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] http://10.27.203.238/share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/snapshots/cff0744c-aefe-421e-b8b7-055f24614a39 returned with HTTP 200 May 28 13:02:57 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1286/2592] 10.27.203.238 () {64 vars in 1460 bytes} [Tue May 28 13:02:57 2024] GET /share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/snapshots/cff0744c-aefe-421e-b8b7-055f24614a39 => generated 746 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:02:57 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-b0859949-0575-4548-848f-3c9345e0dcd1 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] POST http://10.27.203.238/share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares May 28 13:02:57 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-b0859949-0575-4548-848f-3c9345e0dcd1 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share": {"share_proto": "nfs", "description": "Tempest's share", "snapshot_id": null, "name": "tempest-tempest-created-share-861204018", "size": 1, "metadata": {}, "is_public": false, "share_type": "49315d96-de20-4c8a-ac49-f57e8d1b1e18"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:02:57 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.v1.shares [None req-b0859949-0575-4548-848f-3c9345e0dcd1 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Create NFS share of 1 GB May 28 13:02:57 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.quota [None req-b0859949-0575-4548-848f-3c9345e0dcd1 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Created reservations ['ae42bc0b-5821-48b9-aeac-53fa15ad2a4a', 'f3f9678a-e088-4839-b833-759d54a0478f', 'a95bd2a9-2886-4f11-90c8-c7bbb5165d33', '016a7c62-c36c-4250-8356-9e3da3953ff8'] {{(pid=98329) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 13:02:57 l75lg1-v1 neutron-server[77619]: DEBUG dbcounter [-] [77619] Writing DB stats neutron:SELECT=6 {{(pid=77619) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:02:57 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.quota [None req-b0859949-0575-4548-848f-3c9345e0dcd1 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Committed reservations ['ae42bc0b-5821-48b9-aeac-53fa15ad2a4a', 'f3f9678a-e088-4839-b833-759d54a0478f', 'a95bd2a9-2886-4f11-90c8-c7bbb5165d33', '016a7c62-c36c-4250-8356-9e3da3953ff8'] {{(pid=98329) commit /opt/stack/manila/manila/quota.py:1063}} May 28 13:02:57 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.host_manager [None req-b0859949-0575-4548-848f-3c9345e0dcd1 tempest-SharesActionsTest-682704550 None] Share service is down. (host: l75lg1-v1@generic2). May 28 13:02:57 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.host_manager [None req-b0859949-0575-4548-848f-3c9345e0dcd1 tempest-SharesActionsTest-682704550 None] Share service is down. (host: l75lg1-v1@generic1). May 28 13:02:57 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-b0859949-0575-4548-848f-3c9345e0dcd1 tempest-SharesActionsTest-682704550 None] Starting with 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:80}} May 28 13:02:57 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-b0859949-0575-4548-848f-3c9345e0dcd1 tempest-SharesActionsTest-682704550 None] Filter OnlyHostFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:02:57 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-b0859949-0575-4548-848f-3c9345e0dcd1 tempest-SharesActionsTest-682704550 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:02:57 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.capacity [None req-b0859949-0575-4548-848f-3c9345e0dcd1 tempest-SharesActionsTest-682704550 None] Space information for share creation on host l75lg1-v1@vast#vast (requested / avail): 1/2081 {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/capacity.py:83}} May 28 13:02:57 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-b0859949-0575-4548-848f-3c9345e0dcd1 tempest-SharesActionsTest-682704550 None] Filter CapacityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:02:57 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-b0859949-0575-4548-848f-3c9345e0dcd1 tempest-SharesActionsTest-682704550 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:02:57 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-b0859949-0575-4548-848f-3c9345e0dcd1 tempest-SharesActionsTest-682704550 None] Driver Filter: Checking host 'l75lg1-v1@vast#vast' {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:37}} May 28 13:02:57 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-b0859949-0575-4548-848f-3c9345e0dcd1 tempest-SharesActionsTest-682704550 None] Filter function not set :: passing host. {{(pid=98327) _check_filter_function /opt/stack/manila/manila/scheduler/filters/driver.py:53}} May 28 13:02:57 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-b0859949-0575-4548-848f-3c9345e0dcd1 tempest-SharesActionsTest-682704550 None] Result: True {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:40}} May 28 13:02:57 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-b0859949-0575-4548-848f-3c9345e0dcd1 tempest-SharesActionsTest-682704550 None] Done checking host 'l75lg1-v1@vast#vast' {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:41}} May 28 13:02:57 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-b0859949-0575-4548-848f-3c9345e0dcd1 tempest-SharesActionsTest-682704550 None] Filter DriverFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:02:57 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-b0859949-0575-4548-848f-3c9345e0dcd1 tempest-SharesActionsTest-682704550 None] Filter ShareReplicationFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:02:57 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-b0859949-0575-4548-848f-3c9345e0dcd1 tempest-SharesActionsTest-682704550 None] Filter CreateFromSnapshotFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:02:57 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-b0859949-0575-4548-848f-3c9345e0dcd1 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] http://10.27.203.238/share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares returned with HTTP 200 May 28 13:02:57 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-b0859949-0575-4548-848f-3c9345e0dcd1 tempest-SharesActionsTest-682704550 None] Filter AffinityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:02:57 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1307/2593] 10.27.203.238 () {66 vars in 1362 bytes} [Tue May 28 13:02:57 2024] POST /share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares => generated 1310 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:02:57 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-b0859949-0575-4548-848f-3c9345e0dcd1 tempest-SharesActionsTest-682704550 None] Filter AntiAffinityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:02:57 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.drivers.filter [None req-b0859949-0575-4548-848f-3c9345e0dcd1 tempest-SharesActionsTest-682704550 None] Filtered share [host: 'l75lg1-v1@vast#vast', free_capacity_gb: 2081.6009807521477, pools: None] {{(pid=98327) _schedule_share /opt/stack/manila/manila/scheduler/drivers/filter.py:268}} May 28 13:02:57 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-b0859949-0575-4548-848f-3c9345e0dcd1 tempest-SharesActionsTest-682704550 None] Checking host 'l75lg1-v1@vast#vast' {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:46}} May 28 13:02:57 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.weighers.goodness [None req-b0859949-0575-4548-848f-3c9345e0dcd1 tempest-SharesActionsTest-682704550 None] Goodness function not set :: defaulting to minimal goodness rating of 0. May 28 13:02:57 l75lg1-v1 manila-scheduler[98327]: INFO manila.scheduler.weighers.goodness [None req-b0859949-0575-4548-848f-3c9345e0dcd1 tempest-SharesActionsTest-682704550 None] Goodness function result for host l75lg1-v1@vast#vast: 0. May 28 13:02:57 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-b0859949-0575-4548-848f-3c9345e0dcd1 tempest-SharesActionsTest-682704550 None] Goodness: 0 {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:48}} May 28 13:02:57 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-b0859949-0575-4548-848f-3c9345e0dcd1 tempest-SharesActionsTest-682704550 None] Done checking host 'l75lg1-v1@vast#vast' {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:49}} May 28 13:02:57 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.drivers.filter [None req-b0859949-0575-4548-848f-3c9345e0dcd1 tempest-SharesActionsTest-682704550 None] Choosing for share: WeighedHost [host: l75lg1-v1@vast#vast, weight: 0.0] {{(pid=98327) _schedule_share /opt/stack/manila/manila/scheduler/drivers/filter.py:274}} May 28 13:02:57 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-298baf9f-0e4b-42e3-a01d-1db8748fe917 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] GET http://10.27.203.238/share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/19b885a7-cbdd-49e1-baf9-d755f4a5d279 May 28 13:02:57 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-298baf9f-0e4b-42e3-a01d-1db8748fe917 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:02:57 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-298baf9f-0e4b-42e3-a01d-1db8748fe917 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:02:57 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-298baf9f-0e4b-42e3-a01d-1db8748fe917 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] http://10.27.203.238/share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/19b885a7-cbdd-49e1-baf9-d755f4a5d279 returned with HTTP 200 May 28 13:02:57 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1287/2594] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:02:57 2024] GET /share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/19b885a7-cbdd-49e1-baf9-d755f4a5d279 => generated 1310 bytes in 25 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:02:57 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b0859949-0575-4548-848f-3c9345e0dcd1 tempest-SharesActionsTest-682704550 None] >>> [GET] https://127.0.0.1:40443/api/vippools/ May 28 13:02:57 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b0859949-0575-4548-848f-3c9345e0dcd1 tempest-SharesActionsTest-682704550 None] {'allow_redirects': True, 'params': {'name': 'vippool-1'}} May 28 13:02:57 l75lg1-v1 neutron-server[77619]: DEBUG dbcounter [-] [77619] Writing DB stats neutron:SELECT=8 {{(pid=77619) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:02:57 l75lg1-v1 devstack@keystone.service[51266]: DEBUG dbcounter [-] [51266] Writing DB stats keystone:SELECT=780,keystone:DELETE=118,keystone:INSERT=40 {{(pid=51266) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:02:57 l75lg1-v1 devstack@keystone.service[51267]: DEBUG dbcounter [-] [51267] Writing DB stats keystone:SELECT=1687,keystone:DELETE=234,keystone:INSERT=100 {{(pid=51267) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:02:58 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [-] Expecting reply to msg 3dea343dda3d4d5b91c8718ce6ef82f0 in queue reply_37f4cbd1dd094961a22b8a65f222c327 May 28 13:02:58 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [-] Received RPC response for msg 3dea343dda3d4d5b91c8718ce6ef82f0 May 28 13:02:58 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b0859949-0575-4548-848f-3c9345e0dcd1 tempest-SharesActionsTest-682704550 None] <<< [GET] https://127.0.0.1:40443/api/vippools/ May 28 13:02:58 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b0859949-0575-4548-848f-3c9345e0dcd1 tempest-SharesActionsTest-682704550 None] [Bunch(active_cnode_ids=[], active_interfaces=4, cluster='loop75-kfs', cluster_id=1, cnode_ids=[], cnodes=[], domain_name='vippool-1', enable_l3=False, enable_weighted_balancing=False, enabled=True, end_ip='172.21.75.4', guid='f2abaede-b397-413a-8faa-3aeead6d3b28', gw_ip='', gw_ipv6='', id=2, ip_ranges=[['172.21.75.1', '172.21.75.4']], name='vippool-1', peer_asn=0, port_membership='ALL', ranges_summary='172.21.75.[1-4]', role='PROTOCOLS', start_ip='172.21.75.1', subnet_cidr=16, subnet_cidr_ipv6=None, sync='SYNCED', sync_time='2024-05-28T12:50:09.644123Z', tenant_id=1, tenant_name='default', title='172.21.75.1 - 172.21.75.4', url='https://127.0.0.1:40443/api/vippools/2/', vast_asn=0, vlan=0, vms_preferred=False)] May 28 13:02:58 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b0859949-0575-4548-848f-3c9345e0dcd1 tempest-SharesActionsTest-682704550 None] --- [GET] https://127.0.0.1:40443/api/vippools/: Done May 28 13:02:58 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b0859949-0575-4548-848f-3c9345e0dcd1 tempest-SharesActionsTest-682704550 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:02:58 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b0859949-0575-4548-848f-3c9345e0dcd1 tempest-SharesActionsTest-682704550 None] {'allow_redirects': True, May 28 13:02:58 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b0859949-0575-4548-848f-3c9345e0dcd1 tempest-SharesActionsTest-682704550 None] 'params': {'name': '32ffe20e-0e78-4466-9b2b-19d99fd8e8a3'}} May 28 13:02:58 l75lg1-v1 dstat.sh[49771]: 28-05 13:02:58| 4 0 93 2 0|5506M 1910M 278M 7929M| 10k 924B| 0 1304k| 0 219 |3970 6969 |1.00 1.12 1.06|1.0 0 2.0| 0 0 | 0 2048M| 29 361 0 50 4 May 28 13:02:58 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b0859949-0575-4548-848f-3c9345e0dcd1 tempest-SharesActionsTest-682704550 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:02:58 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b0859949-0575-4548-848f-3c9345e0dcd1 tempest-SharesActionsTest-682704550 None] [] May 28 13:02:58 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b0859949-0575-4548-848f-3c9345e0dcd1 tempest-SharesActionsTest-682704550 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 13:02:58 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b0859949-0575-4548-848f-3c9345e0dcd1 tempest-SharesActionsTest-682704550 None] >>> [POST] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:02:58 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b0859949-0575-4548-848f-3c9345e0dcd1 tempest-SharesActionsTest-682704550 None] {'data': '{"name": "32ffe20e-0e78-4466-9b2b-19d99fd8e8a3"}', May 28 13:02:58 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b0859949-0575-4548-848f-3c9345e0dcd1 tempest-SharesActionsTest-682704550 None] 'json': None, May 28 13:02:58 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b0859949-0575-4548-848f-3c9345e0dcd1 tempest-SharesActionsTest-682704550 None] 'params': None} May 28 13:02:59 l75lg1-v1 dstat.sh[49771]: 28-05 13:02:59| 1 0 97 2 0|5506M 1910M 278M 7929M| 20k 1498B| 0 4272k| 0 303 |2438 3749 |1.00 1.12 1.06|1.0 0 0| 0 0 | 0 2048M| 29 361 0 50 4 May 28 13:02:59 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b0859949-0575-4548-848f-3c9345e0dcd1 tempest-SharesActionsTest-682704550 None] <<< [POST] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:02:59 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b0859949-0575-4548-848f-3c9345e0dcd1 tempest-SharesActionsTest-682704550 None] Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=0, created='2024-05-28T13:02:58.911852Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='44309d24-acaa-42d7-bf2d-d58bd78999bb', id=59, internal=False, is_s3_default_policy=False, name='32ffe20e-0e78-4466-9b2b-19d99fd8e8a3', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=[], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['*'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['*'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T13:02:59.243397Z', tenant_id=1, tenant_name='default', title='32ffe20e-0e78-4466-9b2b-19d99fd8e8a3', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/59/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[]) May 28 13:02:59 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b0859949-0575-4548-848f-3c9345e0dcd1 tempest-SharesActionsTest-682704550 None] --- [POST] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 13:02:59 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b0859949-0575-4548-848f-3c9345e0dcd1 tempest-SharesActionsTest-682704550 None] >>> [GET] https://127.0.0.1:40443/api/quotas/ May 28 13:02:59 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b0859949-0575-4548-848f-3c9345e0dcd1 tempest-SharesActionsTest-682704550 None] {'allow_redirects': True, May 28 13:02:59 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b0859949-0575-4548-848f-3c9345e0dcd1 tempest-SharesActionsTest-682704550 None] 'params': {'name': '32ffe20e-0e78-4466-9b2b-19d99fd8e8a3'}} May 28 13:02:59 l75lg1-v1 nova-conductor[83647]: DEBUG dbcounter [-] [83647] Writing DB stats nova_cell1:SELECT=1,nova_cell1:UPDATE=1 {{(pid=83647) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:03:00 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b0859949-0575-4548-848f-3c9345e0dcd1 tempest-SharesActionsTest-682704550 None] <<< [GET] https://127.0.0.1:40443/api/quotas/ May 28 13:03:00 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b0859949-0575-4548-848f-3c9345e0dcd1 tempest-SharesActionsTest-682704550 None] [] May 28 13:03:00 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b0859949-0575-4548-848f-3c9345e0dcd1 tempest-SharesActionsTest-682704550 None] --- [GET] https://127.0.0.1:40443/api/quotas/: Done May 28 13:03:00 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b0859949-0575-4548-848f-3c9345e0dcd1 tempest-SharesActionsTest-682704550 None] >>> [POST] https://127.0.0.1:40443/api/quotas/ May 28 13:03:00 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b0859949-0575-4548-848f-3c9345e0dcd1 tempest-SharesActionsTest-682704550 None] {'data': '{"name": "32ffe20e-0e78-4466-9b2b-19d99fd8e8a3", "path": ' May 28 13:03:00 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b0859949-0575-4548-848f-3c9345e0dcd1 tempest-SharesActionsTest-682704550 None] '"/manila/manila-32ffe20e-0e78-4466-9b2b-19d99fd8e8a3", "create_dir": ' May 28 13:03:00 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b0859949-0575-4548-848f-3c9345e0dcd1 tempest-SharesActionsTest-682704550 None] 'true, "hard_limit": 1073741824}', May 28 13:03:00 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b0859949-0575-4548-848f-3c9345e0dcd1 tempest-SharesActionsTest-682704550 None] 'json': None, May 28 13:03:00 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b0859949-0575-4548-848f-3c9345e0dcd1 tempest-SharesActionsTest-682704550 None] 'params': None} May 28 13:03:00 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 13:03:00 l75lg1-v1 dstat.sh[49771]: 28-05 13:03:00| 1 0 98 0 0|5506M 1910M 278M 7929M| 16k 1668B| 0 420k| 0 43.0 |1850 3007 |1.00 1.12 1.06|1.0 0 0| 0 0 | 0 2048M| 29 361 0 50 4 May 28 13:03:00 l75lg1-v1 neutron-server[77618]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.HashRingHealthCheckPeriodics.touch_hash_ring_nodes' {{(pid=77618) _process_scheduled /opt/stack/data/venv/lib/python3.10/site-packages/futurist/periodics.py:638}} May 28 13:03:00 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-b5945dcd-0ccf-489d-87ee-3f5dbcadba9b tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] GET http://10.27.203.238/share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/19b885a7-cbdd-49e1-baf9-d755f4a5d279 May 28 13:03:00 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-b5945dcd-0ccf-489d-87ee-3f5dbcadba9b tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:03:00 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-b5945dcd-0ccf-489d-87ee-3f5dbcadba9b tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:03:00 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-b5945dcd-0ccf-489d-87ee-3f5dbcadba9b tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] http://10.27.203.238/share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/19b885a7-cbdd-49e1-baf9-d755f4a5d279 returned with HTTP 200 May 28 13:03:00 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1308/2595] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:03:00 2024] GET /share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/19b885a7-cbdd-49e1-baf9-d755f4a5d279 => generated 1312 bytes in 24 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:03:00 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager.update_available_resource {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 13:03:00 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Expecting reply to msg cb3f8b2065fb4d58b18349965b73251d in queue reply_37f4cbd1dd094961a22b8a65f222c327 May 28 13:03:00 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [-] Received RPC response for msg cb3f8b2065fb4d58b18349965b73251d May 28 13:03:00 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b0859949-0575-4548-848f-3c9345e0dcd1 tempest-SharesActionsTest-682704550 None] <<< [POST] https://127.0.0.1:40443/api/quotas/ May 28 13:03:00 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b0859949-0575-4548-848f-3c9345e0dcd1 tempest-SharesActionsTest-682704550 None] Bunch(cluster='loop75-kfs', cluster_id=1, default_email=None, default_group_quota=None, default_user_quota=None, enable_alarms=True, enable_email_providers=True, grace_period=None, group_quotas=[], guid='e024777f-71ac-4364-a37a-523556690881', hard_limit=1073741824, hard_limit_inodes=None, id=56, internal=False, is_user_quota=False, last_user_quotas_update=None, name='32ffe20e-0e78-4466-9b2b-19d99fd8e8a3', num_blocked_users=0, num_exceeded_users=0, path='/manila/manila-32ffe20e-0e78-4466-9b2b-19d99fd8e8a3', percent_capacity=0, percent_inodes=None, pretty_grace_period=None, pretty_grace_period_expiration=None, pretty_state='OK (CREATED)', soft_limit=None, soft_limit_inodes=None, state='OK', sync_state='CREATED', system_id=56, tenant_id=1, tenant_name='default', time_to_block=None, title='32ffe20e-0e78-4466-9b2b-19d99fd8e8a3', url='https://127.0.0.1:40443/api/quotas/56/', used_capacity=0, used_capacity_tb=0.0, used_effective_capacity=0, used_effective_capacity_tb=0.0, used_inodes=0, used_limited_capacity=0, user_quotas=[]) May 28 13:03:00 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b0859949-0575-4548-848f-3c9345e0dcd1 tempest-SharesActionsTest-682704550 None] --- [POST] https://127.0.0.1:40443/api/quotas/: Done May 28 13:03:00 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b0859949-0575-4548-848f-3c9345e0dcd1 tempest-SharesActionsTest-682704550 None] >>> [GET] https://127.0.0.1:40443/api/views/ May 28 13:03:00 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b0859949-0575-4548-848f-3c9345e0dcd1 tempest-SharesActionsTest-682704550 None] {'allow_redirects': True, May 28 13:03:00 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b0859949-0575-4548-848f-3c9345e0dcd1 tempest-SharesActionsTest-682704550 None] 'params': {'name': '32ffe20e-0e78-4466-9b2b-19d99fd8e8a3'}} May 28 13:03:01 l75lg1-v1 nova-compute[83654]: DEBUG oslo_concurrency.lockutils [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=83654) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:03:01 l75lg1-v1 nova-compute[83654]: DEBUG oslo_concurrency.lockutils [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=83654) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:03:01 l75lg1-v1 nova-compute[83654]: DEBUG oslo_concurrency.lockutils [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=83654) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:03:01 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.resource_tracker [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Auditing locally available compute resources for l75lg1-v1 (node: l75lg1-v1) {{(pid=83654) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}} May 28 13:03:01 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.resource_tracker [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Hypervisor/Node resource view: name=l75lg1-v1 free_ram=10116MB free_disk=15.546772003173828GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_01_1", "address": "0000:00:01.1", "product_id": "7010", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7010", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7000", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7000", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "0100", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_0100", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_09_0", "address": "0000:00:09.0", "product_id": "1001", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1001", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "293a", "vendor_id": "8086", "numa_node": null, "label": "label_8086_293a", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_2", "address": "0000:00:07.2", "product_id": "2936", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2936", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "1237", "vendor_id": "8086", "numa_node": null, "label": "label_8086_1237", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "2935", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2935", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "2934", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2934", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_05_0", "address": "0000:00:05.0", "product_id": "1000", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1000", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "1000", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1000", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_06_0", "address": "0000:00:06.0", "product_id": "2668", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2668", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "1000", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1000", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0a_0", "address": "0000:00:0a.0", "product_id": "1002", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1002", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_3", "address": "0000:00:01.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_08_0", "address": "0000:00:08.0", "product_id": "1003", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1003", "dev_type": "type-PCI"}] {{(pid=83654) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}} May 28 13:03:01 l75lg1-v1 nova-compute[83654]: DEBUG oslo_concurrency.lockutils [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=83654) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:03:01 l75lg1-v1 nova-compute[83654]: DEBUG oslo_concurrency.lockutils [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=83654) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:03:01 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Expecting reply to msg 4c13347bb7f243c6b8fda47f371e6461 in queue reply_37f4cbd1dd094961a22b8a65f222c327 May 28 13:03:01 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [-] Received RPC response for msg 4c13347bb7f243c6b8fda47f371e6461 May 28 13:03:01 l75lg1-v1 dstat.sh[49771]: 28-05 13:03:01| 2 1 96 1 0|5506M 1910M 278M 7929M| 15k 736B| 0 940k| 0 81.0 |3678 6040 |1.00 1.12 1.06|1.0 0 0| 0 0 | 0 2048M| 29 361 0 50 4 May 28 13:03:01 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b0859949-0575-4548-848f-3c9345e0dcd1 tempest-SharesActionsTest-682704550 None] <<< [GET] https://127.0.0.1:40443/api/views/ May 28 13:03:01 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b0859949-0575-4548-848f-3c9345e0dcd1 tempest-SharesActionsTest-682704550 None] [] May 28 13:03:01 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b0859949-0575-4548-848f-3c9345e0dcd1 tempest-SharesActionsTest-682704550 None] --- [GET] https://127.0.0.1:40443/api/views/: Done May 28 13:03:01 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b0859949-0575-4548-848f-3c9345e0dcd1 tempest-SharesActionsTest-682704550 None] >>> [POST] https://127.0.0.1:40443/api/views/ May 28 13:03:01 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b0859949-0575-4548-848f-3c9345e0dcd1 tempest-SharesActionsTest-682704550 None] {'data': '{"name": "32ffe20e-0e78-4466-9b2b-19d99fd8e8a3", "path": ' May 28 13:03:01 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b0859949-0575-4548-848f-3c9345e0dcd1 tempest-SharesActionsTest-682704550 None] '"/manila/manila-32ffe20e-0e78-4466-9b2b-19d99fd8e8a3", "policy_id": ' May 28 13:03:01 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b0859949-0575-4548-848f-3c9345e0dcd1 tempest-SharesActionsTest-682704550 None] '59, "create_dir": true, "protocols": ["NFS"]}', May 28 13:03:01 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b0859949-0575-4548-848f-3c9345e0dcd1 tempest-SharesActionsTest-682704550 None] 'json': None, May 28 13:03:01 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b0859949-0575-4548-848f-3c9345e0dcd1 tempest-SharesActionsTest-682704550 None] 'params': None} May 28 13:03:01 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Expecting reply to msg 1e952a80a2e440a1a917fbd30de24425 in queue reply_37f4cbd1dd094961a22b8a65f222c327 May 28 13:03:01 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [-] Received RPC response for msg 1e952a80a2e440a1a917fbd30de24425 May 28 13:03:02 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b0859949-0575-4548-848f-3c9345e0dcd1 tempest-SharesActionsTest-682704550 None] <<< [POST] https://127.0.0.1:40443/api/views/ May 28 13:03:02 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b0859949-0575-4548-848f-3c9345e0dcd1 tempest-SharesActionsTest-682704550 None] Bunch(abac_tags=[], abe_max_depth=None, abe_protocols=[], alias='', allow_anonymous_access=False, allow_s3_anonymous_access=False, auto_commit='0d', bucket='', bucket_creators=[], bucket_creators_groups=[], bucket_owner=None, bulk_permission_update_progress=None, bulk_permission_update_state=None, cluster='loop75-kfs', cluster_id=1, created='2024-05-28T13:03:01.815791Z', enabled=True, files_retention_mode='NONE', guid='caad5763-dfa8-4425-80eb-3083a2c887d4', id=58, ignore_oos=False, internal=False, is_remote=False, is_seamless=False, logical_capacity=0, max_retention_period=None, min_retention_period=None, name='32ffe20e-0e78-4466-9b2b-19d99fd8e8a3', nfs_interop_flags='BOTH_NFS3_AND_NFS4_INTEROP_DISABLED', path='/manila/manila-32ffe20e-0e78-4466-9b2b-19d99fd8e8a3', physical_capacity=0, policy='32ffe20e-0e78-4466-9b2b-19d99fd8e8a3', policy_id=59, protocols=['NFS'], qos_policy=None, qos_policy_id=None, s3_locks=False, s3_locks_retention_mode='NONE', s3_locks_retention_period='', s3_object_ownership_rule='ObjectWriter', s3_unverified_lookup=False, s3_versioning=False, select_for_live_monitoring=False, share='', share_acl=Bunch(acl=[], enabled=False), sync='SYNCED', sync_time='2024-05-28T13:03:02.088351Z', tenant_id=1, tenant_name='default', title='/manila/manila-32ffe20e-0e78-4466-9b2b-19d99fd8e8a3', url='https://127.0.0.1:40443/api/views/58/') May 28 13:03:02 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b0859949-0575-4548-848f-3c9345e0dcd1 tempest-SharesActionsTest-682704550 None] --- [POST] https://127.0.0.1:40443/api/views/: Done May 28 13:03:02 l75lg1-v1 devstack@placement-api.service[78202]: DEBUG placement.requestlog [req-80363bda-3b8b-48f8-8505-ea25e289e2cd req-acc0f166-402a-4afd-91b8-2e08bf0c42b1 None None] Starting request: 10.27.203.238 "GET /placement/resource_providers/ef90d7d1-0808-4a15-ad77-f9a7391af2f4/allocations" {{(pid=78202) __call__ /opt/stack/placement/placement/requestlog.py:55}} May 28 13:03:02 l75lg1-v1 manila-share[98474]: INFO manila.share.manager [None req-b0859949-0575-4548-848f-3c9345e0dcd1 tempest-SharesActionsTest-682704550 None] Share instance 32ffe20e-0e78-4466-9b2b-19d99fd8e8a3 created successfully. May 28 13:03:02 l75lg1-v1 devstack@placement-api.service[78202]: INFO placement.requestlog [req-80363bda-3b8b-48f8-8505-ea25e289e2cd req-acc0f166-402a-4afd-91b8-2e08bf0c42b1 service placement] 10.27.203.238 "GET /placement/resource_providers/ef90d7d1-0808-4a15-ad77-f9a7391af2f4/allocations" status: 200 len: 54 microversion: 1.0 May 28 13:03:02 l75lg1-v1 devstack@placement-api.service[78202]: [pid: 78202|app: 0|req: 30/59] 10.27.203.238 () {62 vars in 1480 bytes} [Tue May 28 13:03:02 2024] GET /placement/resource_providers/ef90d7d1-0808-4a15-ad77-f9a7391af2f4/allocations => generated 54 bytes in 12 msecs (HTTP/1.1 200) 6 headers in 223 bytes (1 switches on core 0) May 28 13:03:02 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.resource_tracker [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Total usable vcpus: 10, total allocated vcpus: 0 {{(pid=83654) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}} May 28 13:03:02 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.resource_tracker [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Final resource view: name=l75lg1-v1 phys_ram=16000MB used_ram=512MB phys_disk=28GB used_disk=0GB total_vcpus=10 used_vcpus=0 pci_stats=[] {{(pid=83654) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}} May 28 13:03:02 l75lg1-v1 devstack@placement-api.service[78201]: DEBUG placement.requestlog [req-80363bda-3b8b-48f8-8505-ea25e289e2cd req-cf520716-6364-43a5-a89a-c7ae8a3eee93 None None] Starting request: 10.27.203.238 "GET /placement/resource_providers/ef90d7d1-0808-4a15-ad77-f9a7391af2f4/allocations" {{(pid=78201) __call__ /opt/stack/placement/placement/requestlog.py:55}} May 28 13:03:02 l75lg1-v1 devstack@placement-api.service[78201]: INFO placement.requestlog [req-80363bda-3b8b-48f8-8505-ea25e289e2cd req-cf520716-6364-43a5-a89a-c7ae8a3eee93 service placement] 10.27.203.238 "GET /placement/resource_providers/ef90d7d1-0808-4a15-ad77-f9a7391af2f4/allocations" status: 200 len: 54 microversion: 1.0 May 28 13:03:02 l75lg1-v1 devstack@placement-api.service[78201]: [pid: 78201|app: 0|req: 30/60] 10.27.203.238 () {62 vars in 1480 bytes} [Tue May 28 13:03:02 2024] GET /placement/resource_providers/ef90d7d1-0808-4a15-ad77-f9a7391af2f4/allocations => generated 54 bytes in 17 msecs (HTTP/1.1 200) 6 headers in 223 bytes (1 switches on core 0) May 28 13:03:02 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.provider_tree [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Inventory has not changed in ProviderTree for provider: ef90d7d1-0808-4a15-ad77-f9a7391af2f4 {{(pid=83654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} May 28 13:03:02 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Expecting reply to msg 28c81cb3a00e475d8efbdb4b5873ddc1 in queue reply_37f4cbd1dd094961a22b8a65f222c327 May 28 13:03:02 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [-] Received RPC response for msg 28c81cb3a00e475d8efbdb4b5873ddc1 May 28 13:03:02 l75lg1-v1 dstat.sh[49771]: 28-05 13:03:02| 2 0 97 0 0|5507M 1910M 278M 7929M| 16k 1006B| 0 564k| 0 78.0 |2717 4224 |0.92 1.10 1.05| 0 0 0| 0 0 | 0 2048M| 29 361 0 52 4 May 28 13:03:02 l75lg1-v1 nova-compute[83654]: DEBUG nova.scheduler.client.report [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Inventory has not changed for provider ef90d7d1-0808-4a15-ad77-f9a7391af2f4 based on inventory data: {'VCPU': {'total': 10, 'reserved': 0, 'min_unit': 1, 'max_unit': 10, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16000, 'reserved': 512, 'min_unit': 1, 'max_unit': 16000, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 28, 'reserved': 0, 'min_unit': 1, 'max_unit': 28, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=83654) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}} May 28 13:03:02 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.resource_tracker [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Compute_service record updated for l75lg1-v1:l75lg1-v1 {{(pid=83654) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}} May 28 13:03:02 l75lg1-v1 nova-compute[83654]: DEBUG oslo_concurrency.lockutils [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.559s {{(pid=83654) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:03:03 l75lg1-v1 dstat.sh[49771]: 28-05 13:03:03| 1 1 98 1 0|5507M 1910M 278M 7929M| 18k 0 | 0 488k| 0 60.0 |2262 3653 |0.92 1.10 1.05|1.0 0 0| 0 0 | 0 2048M| 29 361 0 50 4 May 28 13:03:03 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-a2e2d8fe-7509-4086-a13f-17312114808a tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] GET http://10.27.203.238/share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/19b885a7-cbdd-49e1-baf9-d755f4a5d279 May 28 13:03:03 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-a2e2d8fe-7509-4086-a13f-17312114808a tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:03:03 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-a2e2d8fe-7509-4086-a13f-17312114808a tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:03:03 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-a2e2d8fe-7509-4086-a13f-17312114808a tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] http://10.27.203.238/share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/19b885a7-cbdd-49e1-baf9-d755f4a5d279 returned with HTTP 200 May 28 13:03:03 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1288/2596] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:03:03 2024] GET /share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/19b885a7-cbdd-49e1-baf9-d755f4a5d279 => generated 1315 bytes in 24 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:03:03 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-a874e664-f153-45ba-9bb8-1908bf8ccb7e tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] POST http://10.27.203.238/share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/19b885a7-cbdd-49e1-baf9-d755f4a5d279/action May 28 13:03:03 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-a874e664-f153-45ba-9bb8-1908bf8ccb7e tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Action body: b'{"extend": {"new_size": 2, "force": false}}' {{(pid=98329) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 13:03:03 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-a874e664-f153-45ba-9bb8-1908bf8ccb7e tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Action: 'action', calling method: ShareController.extend, body: {"extend": {"new_size": 2, "force": false}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:03:03 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.quota [None req-a874e664-f153-45ba-9bb8-1908bf8ccb7e tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Created reservations ['e43b9c5c-1482-4fb0-b870-0dd2d17008f3', '9e2e2331-0a66-489a-9615-580d84155b84'] {{(pid=98329) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 13:03:03 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.share.api [None req-a874e664-f153-45ba-9bb8-1908bf8ccb7e tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Extend share request issued successfully. May 28 13:03:03 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-a874e664-f153-45ba-9bb8-1908bf8ccb7e tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] http://10.27.203.238/share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/19b885a7-cbdd-49e1-baf9-d755f4a5d279/action returned with HTTP 202 May 28 13:03:03 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1309/2597] 10.27.203.238 () {66 vars in 1493 bytes} [Tue May 28 13:03:03 2024] POST /share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/19b885a7-cbdd-49e1-baf9-d755f4a5d279/action => generated 0 bytes in 151 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 13:03:03 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-97e66323-936a-47db-bd69-5f5a549acab5 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] GET http://10.27.203.238/share/v1/718814c61c8c40e7bf78dd9d84d3b1f1/shares/19b885a7-cbdd-49e1-baf9-d755f4a5d279 May 28 13:03:03 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-97e66323-936a-47db-bd69-5f5a549acab5 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:03:03 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-97e66323-936a-47db-bd69-5f5a549acab5 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:03:03 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 13:03:03 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.host_manager [None req-a874e664-f153-45ba-9bb8-1908bf8ccb7e tempest-SharesActionsTest-682704550 None] Share service is down. (host: l75lg1-v1@generic2). May 28 13:03:03 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.host_manager [None req-a874e664-f153-45ba-9bb8-1908bf8ccb7e tempest-SharesActionsTest-682704550 None] Share service is down. (host: l75lg1-v1@generic1). May 28 13:03:03 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-a874e664-f153-45ba-9bb8-1908bf8ccb7e tempest-SharesActionsTest-682704550 None] Starting with 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:80}} May 28 13:03:03 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.capacity [None req-a874e664-f153-45ba-9bb8-1908bf8ccb7e tempest-SharesActionsTest-682704550 None] Space information for share creation on host l75lg1-v1@vast#vast (requested / avail): 1/2080 {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/capacity.py:83}} May 28 13:03:03 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-a874e664-f153-45ba-9bb8-1908bf8ccb7e tempest-SharesActionsTest-682704550 None] Filter CapacityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:03:03 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-a874e664-f153-45ba-9bb8-1908bf8ccb7e tempest-SharesActionsTest-682704550 None] Driver Filter: Checking host 'l75lg1-v1@vast#vast' {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:37}} May 28 13:03:03 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-a874e664-f153-45ba-9bb8-1908bf8ccb7e tempest-SharesActionsTest-682704550 None] Filter function not set :: passing host. {{(pid=98327) _check_filter_function /opt/stack/manila/manila/scheduler/filters/driver.py:53}} May 28 13:03:03 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-a874e664-f153-45ba-9bb8-1908bf8ccb7e tempest-SharesActionsTest-682704550 None] Result: True {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:40}} May 28 13:03:03 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-a874e664-f153-45ba-9bb8-1908bf8ccb7e tempest-SharesActionsTest-682704550 None] Done checking host 'l75lg1-v1@vast#vast' {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:41}} May 28 13:03:03 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-a874e664-f153-45ba-9bb8-1908bf8ccb7e tempest-SharesActionsTest-682704550 None] Filter DriverFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:03:03 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-a874e664-f153-45ba-9bb8-1908bf8ccb7e tempest-SharesActionsTest-682704550 None] Checking host 'l75lg1-v1@vast#vast' {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:46}} May 28 13:03:03 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.weighers.goodness [None req-a874e664-f153-45ba-9bb8-1908bf8ccb7e tempest-SharesActionsTest-682704550 None] Goodness function not set :: defaulting to minimal goodness rating of 0. May 28 13:03:03 l75lg1-v1 manila-scheduler[98327]: INFO manila.scheduler.weighers.goodness [None req-a874e664-f153-45ba-9bb8-1908bf8ccb7e tempest-SharesActionsTest-682704550 None] Goodness function result for host l75lg1-v1@vast#vast: 0. May 28 13:03:03 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-a874e664-f153-45ba-9bb8-1908bf8ccb7e tempest-SharesActionsTest-682704550 None] Goodness: 0 {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:48}} May 28 13:03:03 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-a874e664-f153-45ba-9bb8-1908bf8ccb7e tempest-SharesActionsTest-682704550 None] Done checking host 'l75lg1-v1@vast#vast' {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:49}} May 28 13:03:03 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-97e66323-936a-47db-bd69-5f5a549acab5 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] http://10.27.203.238/share/v1/718814c61c8c40e7bf78dd9d84d3b1f1/shares/19b885a7-cbdd-49e1-baf9-d755f4a5d279 returned with HTTP 200 May 28 13:03:03 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1289/2598] 10.27.203.238 () {62 vars in 1408 bytes} [Tue May 28 13:03:03 2024] GET /share/v1/718814c61c8c40e7bf78dd9d84d3b1f1/shares/19b885a7-cbdd-49e1-baf9-d755f4a5d279 => generated 897 bytes in 26 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:03:03 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a874e664-f153-45ba-9bb8-1908bf8ccb7e tempest-SharesActionsTest-682704550 None] >>> [GET] https://127.0.0.1:40443/api/quotas/ May 28 13:03:03 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a874e664-f153-45ba-9bb8-1908bf8ccb7e tempest-SharesActionsTest-682704550 None] {'allow_redirects': True, May 28 13:03:03 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a874e664-f153-45ba-9bb8-1908bf8ccb7e tempest-SharesActionsTest-682704550 None] 'params': {'name': '32ffe20e-0e78-4466-9b2b-19d99fd8e8a3'}} May 28 13:03:04 l75lg1-v1 dstat.sh[49771]: 28-05 13:03:04| 3 0 95 0 0|5507M 1910M 278M 7929M| 14k 842B| 0 752k| 0 109 |2526 4368 |0.92 1.10 1.05|2.0 0 0| 0 0 | 0 2048M| 29 361 0 51 4 May 28 13:03:04 l75lg1-v1 neutron-server[77623]: DEBUG dbcounter [-] [77623] Writing DB stats neutron:SELECT=1 {{(pid=77623) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:03:04 l75lg1-v1 neutron-server[77623]: DEBUG dbcounter [-] [77623] Writing DB stats neutron:SELECT=2 {{(pid=77623) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:03:04 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a874e664-f153-45ba-9bb8-1908bf8ccb7e tempest-SharesActionsTest-682704550 None] <<< [GET] https://127.0.0.1:40443/api/quotas/ May 28 13:03:04 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a874e664-f153-45ba-9bb8-1908bf8ccb7e tempest-SharesActionsTest-682704550 None] [Bunch(cluster='loop75-kfs', cluster_id=1, default_email=None, default_group_quota=None, default_user_quota=None, enable_alarms=True, enable_email_providers=True, grace_period=None, guid='e024777f-71ac-4364-a37a-523556690881', hard_limit=1073741824, hard_limit_inodes=None, id=56, internal=False, is_user_quota=False, last_user_quotas_update=None, name='32ffe20e-0e78-4466-9b2b-19d99fd8e8a3', num_blocked_users=0, num_exceeded_users=0, path='/manila/manila-32ffe20e-0e78-4466-9b2b-19d99fd8e8a3', percent_capacity=0, percent_inodes=None, pretty_grace_period=None, pretty_grace_period_expiration=None, pretty_state='OK (CREATED)', soft_limit=None, soft_limit_inodes=None, state='OK', sync_state='CREATED', system_id=56, tenant_id=1, tenant_name='default', time_to_block=None, title='32ffe20e-0e78-4466-9b2b-19d99fd8e8a3', url='https://127.0.0.1:40443/api/quotas/56/', used_capacity=0, used_capacity_tb=0.0, used_effective_capacity=0, used_effective_capacity_tb=0.0, used_inodes=0, used_limited_capacity=0)] May 28 13:03:04 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a874e664-f153-45ba-9bb8-1908bf8ccb7e tempest-SharesActionsTest-682704550 None] --- [GET] https://127.0.0.1:40443/api/quotas/: Done May 28 13:03:04 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a874e664-f153-45ba-9bb8-1908bf8ccb7e tempest-SharesActionsTest-682704550 None] >>> [PATCH] https://127.0.0.1:40443/api/quotas/56/ May 28 13:03:04 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a874e664-f153-45ba-9bb8-1908bf8ccb7e tempest-SharesActionsTest-682704550 None] {'data': '{"hard_limit": 2147483648}', 'params': None} May 28 13:03:05 l75lg1-v1 dstat.sh[49771]: 28-05 13:03:05| 0 0 99 0 0|5507M 1910M 278M 7929M| 15k 803B| 0 360k| 0 31.0 |1562 2561 |0.92 1.10 1.05| 0 0 0| 0 0 | 0 2048M| 29 361 0 46 4 May 28 13:03:06 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a874e664-f153-45ba-9bb8-1908bf8ccb7e tempest-SharesActionsTest-682704550 None] <<< [PATCH] https://127.0.0.1:40443/api/quotas/56/ May 28 13:03:06 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a874e664-f153-45ba-9bb8-1908bf8ccb7e tempest-SharesActionsTest-682704550 None] Bunch(cluster='loop75-kfs', cluster_id=1, default_email=None, default_group_quota=None, default_user_quota=None, enable_alarms=True, enable_email_providers=True, grace_period=None, group_quotas=[], guid='e024777f-71ac-4364-a37a-523556690881', hard_limit=2147483648, hard_limit_inodes=None, id=56, internal=False, is_user_quota=False, last_user_quotas_update=None, name='32ffe20e-0e78-4466-9b2b-19d99fd8e8a3', num_blocked_users=0, num_exceeded_users=0, path='/manila/manila-32ffe20e-0e78-4466-9b2b-19d99fd8e8a3', percent_capacity=0, percent_inodes=None, pretty_grace_period=None, pretty_grace_period_expiration=None, pretty_state='OK (CREATED)', soft_limit=None, soft_limit_inodes=None, state='OK', sync_state='CREATED', system_id=56, tenant_id=1, tenant_name='default', time_to_block=None, title='32ffe20e-0e78-4466-9b2b-19d99fd8e8a3', url='https://127.0.0.1:40443/api/quotas/56/', used_capacity=0, used_capacity_tb=0.0, used_effective_capacity=0, used_effective_capacity_tb=0.0, used_inodes=0, used_limited_capacity=0, user_quotas=[]) May 28 13:03:06 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a874e664-f153-45ba-9bb8-1908bf8ccb7e tempest-SharesActionsTest-682704550 None] --- [PATCH] https://127.0.0.1:40443/api/quotas/56/: Done May 28 13:03:06 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-a874e664-f153-45ba-9bb8-1908bf8ccb7e tempest-SharesActionsTest-682704550 None] Committed reservations ['e43b9c5c-1482-4fb0-b870-0dd2d17008f3', '9e2e2331-0a66-489a-9615-580d84155b84'] {{(pid=98474) commit /opt/stack/manila/manila/quota.py:1063}} May 28 13:03:06 l75lg1-v1 manila-share[98474]: INFO manila.share.manager [None req-a874e664-f153-45ba-9bb8-1908bf8ccb7e tempest-SharesActionsTest-682704550 None] Extend share completed successfully. May 28 13:03:06 l75lg1-v1 dstat.sh[49771]: 28-05 13:03:06| 1 0 98 0 0|5507M 1909M 278M 7929M| 19k 593B| 0 464k| 0 54.0 |1944 3174 |0.92 1.10 1.05|1.0 0 0| 0 0 | 0 2048M| 29 361 0 46 4 May 28 13:03:06 l75lg1-v1 neutron-server[77623]: DEBUG neutron.db.agents_db [None req-fe40ce8c-640e-4db7-a17a-6e8888cce266 None None] Agent healthcheck: found 0 active agents {{(pid=77623) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:319}} May 28 13:03:06 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-793a5a74-0924-47f2-9198-0835ca58069a tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] GET http://10.27.203.238/share/v1/718814c61c8c40e7bf78dd9d84d3b1f1/shares/19b885a7-cbdd-49e1-baf9-d755f4a5d279 May 28 13:03:06 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-793a5a74-0924-47f2-9198-0835ca58069a tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:03:06 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-793a5a74-0924-47f2-9198-0835ca58069a tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:03:06 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-793a5a74-0924-47f2-9198-0835ca58069a tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] http://10.27.203.238/share/v1/718814c61c8c40e7bf78dd9d84d3b1f1/shares/19b885a7-cbdd-49e1-baf9-d755f4a5d279 returned with HTTP 200 May 28 13:03:06 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1310/2599] 10.27.203.238 () {62 vars in 1408 bytes} [Tue May 28 13:03:06 2024] GET /share/v1/718814c61c8c40e7bf78dd9d84d3b1f1/shares/19b885a7-cbdd-49e1-baf9-d755f4a5d279 => generated 962 bytes in 25 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:03:06 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-3d1885bb-9371-4a54-864e-ec4265bfdf1a tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] GET http://10.27.203.238/share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/19b885a7-cbdd-49e1-baf9-d755f4a5d279 May 28 13:03:06 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-3d1885bb-9371-4a54-864e-ec4265bfdf1a tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:03:06 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-3d1885bb-9371-4a54-864e-ec4265bfdf1a tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:03:06 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-3d1885bb-9371-4a54-864e-ec4265bfdf1a tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] http://10.27.203.238/share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/19b885a7-cbdd-49e1-baf9-d755f4a5d279 returned with HTTP 200 May 28 13:03:06 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1290/2600] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:03:06 2024] GET /share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/19b885a7-cbdd-49e1-baf9-d755f4a5d279 => generated 1315 bytes in 27 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:03:06 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-c1133d38-c7e7-447e-bf68-6439b13d573c tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] GET http://10.27.203.238/share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/share-replicas/detail?share_id=19b885a7-cbdd-49e1-baf9-d755f4a5d279 May 28 13:03:06 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-c1133d38-c7e7-447e-bf68-6439b13d573c tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:03:06 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-c1133d38-c7e7-447e-bf68-6439b13d573c tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:03:06 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-c1133d38-c7e7-447e-bf68-6439b13d573c tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] http://10.27.203.238/share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/share-replicas/detail?share_id=19b885a7-cbdd-49e1-baf9-d755f4a5d279 returned with HTTP 200 May 28 13:03:06 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1311/2601] 10.27.203.238 () {64 vars in 1476 bytes} [Tue May 28 13:03:06 2024] GET /share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/share-replicas/detail?share_id=19b885a7-cbdd-49e1-baf9-d755f4a5d279 => generated 22 bytes in 12 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:03:06 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-88899a6d-17d0-463b-91da-5032933f689e tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] DELETE http://10.27.203.238/share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/19b885a7-cbdd-49e1-baf9-d755f4a5d279 May 28 13:03:06 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-88899a6d-17d0-463b-91da-5032933f689e tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:03:06 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-88899a6d-17d0-463b-91da-5032933f689e tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Calling method 'ShareMixin.delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:03:06 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.v1.shares [None req-88899a6d-17d0-463b-91da-5032933f689e tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Delete share with id: 19b885a7-cbdd-49e1-baf9-d755f4a5d279 May 28 13:03:06 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-88899a6d-17d0-463b-91da-5032933f689e tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] http://10.27.203.238/share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/19b885a7-cbdd-49e1-baf9-d755f4a5d279 returned with HTTP 202 May 28 13:03:06 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1291/2602] 10.27.203.238 () {64 vars in 1454 bytes} [Tue May 28 13:03:06 2024] DELETE /share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/19b885a7-cbdd-49e1-baf9-d755f4a5d279 => generated 0 bytes in 118 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 13:03:06 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-843b6d4c-259a-4a00-a306-2c59c548a5ac tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] GET http://10.27.203.238/share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/19b885a7-cbdd-49e1-baf9-d755f4a5d279 May 28 13:03:06 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-843b6d4c-259a-4a00-a306-2c59c548a5ac tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:03:06 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-843b6d4c-259a-4a00-a306-2c59c548a5ac tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:03:06 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-843b6d4c-259a-4a00-a306-2c59c548a5ac tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] http://10.27.203.238/share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/19b885a7-cbdd-49e1-baf9-d755f4a5d279 returned with HTTP 200 May 28 13:03:06 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1312/2603] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:03:06 2024] GET /share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/19b885a7-cbdd-49e1-baf9-d755f4a5d279 => generated 1314 bytes in 26 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:03:07 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-88899a6d-17d0-463b-91da-5032933f689e tempest-SharesActionsTest-682704550 None] Acquiring lock "locked_access_rules_operation_by_share_instance_32ffe20e-0e78-4466-9b2b-19d99fd8e8a3" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:03:07 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-88899a6d-17d0-463b-91da-5032933f689e tempest-SharesActionsTest-682704550 None] Lock "locked_access_rules_operation_by_share_instance_32ffe20e-0e78-4466-9b2b-19d99fd8e8a3" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:03:07 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-88899a6d-17d0-463b-91da-5032933f689e tempest-SharesActionsTest-682704550 None] Lock "locked_access_rules_operation_by_share_instance_32ffe20e-0e78-4466-9b2b-19d99fd8e8a3" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:03:07 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-88899a6d-17d0-463b-91da-5032933f689e tempest-SharesActionsTest-682704550 None] Acquiring lock "locked_access_rules_operation_by_share_instance_32ffe20e-0e78-4466-9b2b-19d99fd8e8a3" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:03:07 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-88899a6d-17d0-463b-91da-5032933f689e tempest-SharesActionsTest-682704550 None] Lock "locked_access_rules_operation_by_share_instance_32ffe20e-0e78-4466-9b2b-19d99fd8e8a3" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:03:07 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-88899a6d-17d0-463b-91da-5032933f689e tempest-SharesActionsTest-682704550 None] Lock "locked_access_rules_operation_by_share_instance_32ffe20e-0e78-4466-9b2b-19d99fd8e8a3" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:03:07 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-88899a6d-17d0-463b-91da-5032933f689e tempest-SharesActionsTest-682704550 None] Acquiring lock "locked_access_rules_operation_by_share_instance_32ffe20e-0e78-4466-9b2b-19d99fd8e8a3" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:03:07 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-88899a6d-17d0-463b-91da-5032933f689e tempest-SharesActionsTest-682704550 None] Lock "locked_access_rules_operation_by_share_instance_32ffe20e-0e78-4466-9b2b-19d99fd8e8a3" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:03:07 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-88899a6d-17d0-463b-91da-5032933f689e tempest-SharesActionsTest-682704550 None] Lock "locked_access_rules_operation_by_share_instance_32ffe20e-0e78-4466-9b2b-19d99fd8e8a3" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:03:07 l75lg1-v1 manila-share[98474]: DEBUG manila.share.access [None req-88899a6d-17d0-463b-91da-5032933f689e tempest-SharesActionsTest-682704550 None] All access rules have been synced for share instance 32ffe20e-0e78-4466-9b2b-19d99fd8e8a3 belonging to share 19b885a7-cbdd-49e1-baf9-d755f4a5d279. {{(pid=98474) update_access_rules /opt/stack/manila/manila/share/access.py:304}} May 28 13:03:07 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-88899a6d-17d0-463b-91da-5032933f689e tempest-SharesActionsTest-682704550 None] deleting '/manila/manila-32ffe20e-0e78-4466-9b2b-19d99fd8e8a3' May 28 13:03:07 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-88899a6d-17d0-463b-91da-5032933f689e tempest-SharesActionsTest-682704550 None] >>> [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/ May 28 13:03:07 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-88899a6d-17d0-463b-91da-5032933f689e tempest-SharesActionsTest-682704550 None] {'data': '{"path": "/manila/manila-32ffe20e-0e78-4466-9b2b-19d99fd8e8a3"}', May 28 13:03:07 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-88899a6d-17d0-463b-91da-5032933f689e tempest-SharesActionsTest-682704550 None] 'params': None} May 28 13:03:07 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-88899a6d-17d0-463b-91da-5032933f689e tempest-SharesActionsTest-682704550 None] <<< [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/ May 28 13:03:07 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-88899a6d-17d0-463b-91da-5032933f689e tempest-SharesActionsTest-682704550 None] 'OK' May 28 13:03:07 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-88899a6d-17d0-463b-91da-5032933f689e tempest-SharesActionsTest-682704550 None] --- [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/: Done May 28 13:03:07 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-88899a6d-17d0-463b-91da-5032933f689e tempest-SharesActionsTest-682704550 None] >>> [GET] https://127.0.0.1:40443/api/views/ May 28 13:03:07 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-88899a6d-17d0-463b-91da-5032933f689e tempest-SharesActionsTest-682704550 None] {'allow_redirects': True, May 28 13:03:07 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-88899a6d-17d0-463b-91da-5032933f689e tempest-SharesActionsTest-682704550 None] 'params': {'name': '32ffe20e-0e78-4466-9b2b-19d99fd8e8a3'}} May 28 13:03:07 l75lg1-v1 dstat.sh[49771]: 28-05 13:03:07| 3 0 95 1 0|5507M 1909M 278M 7929M| 17k 1589B| 0 1033k| 0 76.1 |2847 4337 |0.84 1.09 1.04|1.0 0 0| 0 0 | 0 2048M| 29 361 0 43 4 May 28 13:03:07 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-88899a6d-17d0-463b-91da-5032933f689e tempest-SharesActionsTest-682704550 None] <<< [GET] https://127.0.0.1:40443/api/views/ May 28 13:03:07 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-88899a6d-17d0-463b-91da-5032933f689e tempest-SharesActionsTest-682704550 None] [Bunch(abac_tags=[], abe_max_depth=None, abe_protocols=[], alias='', allow_anonymous_access=False, allow_s3_anonymous_access=False, auto_commit='0d', bucket='', bucket_creators=[], bucket_creators_groups=[], bucket_owner=None, bulk_permission_update_progress=None, bulk_permission_update_state=None, cluster='loop75-kfs', cluster_id=1, created='2024-05-28T13:03:01.815791Z', enabled=True, files_retention_mode='NONE', guid='caad5763-dfa8-4425-80eb-3083a2c887d4', id=58, ignore_oos=False, internal=False, is_remote=False, is_seamless=False, logical_capacity=0, max_retention_period=None, min_retention_period=None, name='32ffe20e-0e78-4466-9b2b-19d99fd8e8a3', nfs_interop_flags='BOTH_NFS3_AND_NFS4_INTEROP_DISABLED', path='/manila/manila-32ffe20e-0e78-4466-9b2b-19d99fd8e8a3', physical_capacity=0, policy='32ffe20e-0e78-4466-9b2b-19d99fd8e8a3', policy_id=59, protocols=['NFS'], qos_policy=None, qos_policy_id=None, s3_locks=False, s3_locks_retention_mode='NONE', s3_locks_retention_period='', s3_unverified_lookup=False, s3_versioning=False, select_for_live_monitoring=False, share='', share_acl=Bunch(acl=[], enabled=False), sync='SYNCED', sync_time='2024-05-28T13:03:02.088351Z', tenant_id=1, tenant_name='default', title='/manila/manila-32ffe20e-0e78-4466-9b2b-19d99fd8e8a3', url='https://127.0.0.1:40443/api/views/58/')] May 28 13:03:07 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-88899a6d-17d0-463b-91da-5032933f689e tempest-SharesActionsTest-682704550 None] --- [GET] https://127.0.0.1:40443/api/views/: Done May 28 13:03:07 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-88899a6d-17d0-463b-91da-5032933f689e tempest-SharesActionsTest-682704550 None] >>> [DELETE] https://127.0.0.1:40443/api/views/58/ May 28 13:03:08 l75lg1-v1 dstat.sh[49771]: 28-05 13:03:08| 1 1 98 1 0|5507M 1909M 278M 7929M| 18k 646B| 0 7928k| 0 833 |2002 3108 |0.84 1.09 1.04|1.0 0 2.0| 0 0 | 0 2048M| 29 361 0 43 4 May 28 13:03:09 l75lg1-v1 dstat.sh[49771]: 28-05 13:03:09| 1 0 98 0 0|5507M 1909M 278M 7929M| 21k 0 | 0 256k| 0 22.0 |1553 2437 |0.84 1.09 1.04| 0 0 0| 0 0 | 0 2048M| 29 361 0 40 4 May 28 13:03:09 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-88899a6d-17d0-463b-91da-5032933f689e tempest-SharesActionsTest-682704550 None] <<< [DELETE] https://127.0.0.1:40443/api/views/58/ May 28 13:03:09 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-88899a6d-17d0-463b-91da-5032933f689e tempest-SharesActionsTest-682704550 None] --- [DELETE] https://127.0.0.1:40443/api/views/58/: Done May 28 13:03:09 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-88899a6d-17d0-463b-91da-5032933f689e tempest-SharesActionsTest-682704550 None] >>> [GET] https://127.0.0.1:40443/api/quotas/ May 28 13:03:09 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-88899a6d-17d0-463b-91da-5032933f689e tempest-SharesActionsTest-682704550 None] {'allow_redirects': True, May 28 13:03:09 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-88899a6d-17d0-463b-91da-5032933f689e tempest-SharesActionsTest-682704550 None] 'params': {'name': '32ffe20e-0e78-4466-9b2b-19d99fd8e8a3'}} May 28 13:03:09 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-33463664-e450-42c3-83ea-9a066c7c3111 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] GET http://10.27.203.238/share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/19b885a7-cbdd-49e1-baf9-d755f4a5d279 May 28 13:03:09 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-33463664-e450-42c3-83ea-9a066c7c3111 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:03:09 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-33463664-e450-42c3-83ea-9a066c7c3111 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:03:10 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-33463664-e450-42c3-83ea-9a066c7c3111 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] http://10.27.203.238/share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/19b885a7-cbdd-49e1-baf9-d755f4a5d279 returned with HTTP 200 May 28 13:03:10 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1292/2604] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:03:09 2024] GET /share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/19b885a7-cbdd-49e1-baf9-d755f4a5d279 => generated 1314 bytes in 28 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:03:10 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-88899a6d-17d0-463b-91da-5032933f689e tempest-SharesActionsTest-682704550 None] <<< [GET] https://127.0.0.1:40443/api/quotas/ May 28 13:03:10 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-88899a6d-17d0-463b-91da-5032933f689e tempest-SharesActionsTest-682704550 None] [Bunch(cluster='loop75-kfs', cluster_id=1, default_email=None, default_group_quota=None, default_user_quota=None, enable_alarms=True, enable_email_providers=True, grace_period=None, guid='e024777f-71ac-4364-a37a-523556690881', hard_limit=2147483648, hard_limit_inodes=None, id=56, internal=False, is_user_quota=False, last_user_quotas_update=None, name='32ffe20e-0e78-4466-9b2b-19d99fd8e8a3', num_blocked_users=0, num_exceeded_users=0, path='/manila/manila-32ffe20e-0e78-4466-9b2b-19d99fd8e8a3', percent_capacity=0, percent_inodes=None, pretty_grace_period=None, pretty_grace_period_expiration=None, pretty_state='OK (CREATED)', soft_limit=None, soft_limit_inodes=None, state='OK', sync_state='CREATED', system_id=56, tenant_id=1, tenant_name='default', time_to_block=None, title='32ffe20e-0e78-4466-9b2b-19d99fd8e8a3', url='https://127.0.0.1:40443/api/quotas/56/', used_capacity=0, used_capacity_tb=0.0, used_effective_capacity=0, used_effective_capacity_tb=0.0, used_inodes=0, used_limited_capacity=0)] May 28 13:03:10 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-88899a6d-17d0-463b-91da-5032933f689e tempest-SharesActionsTest-682704550 None] --- [GET] https://127.0.0.1:40443/api/quotas/: Done May 28 13:03:10 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-88899a6d-17d0-463b-91da-5032933f689e tempest-SharesActionsTest-682704550 None] >>> [DELETE] https://127.0.0.1:40443/api/quotas/56/ May 28 13:03:10 l75lg1-v1 dstat.sh[49771]: 28-05 13:03:10| 1 0 98 0 0|5507M 1909M 278M 7929M| 12k 1324B| 0 172k| 0 24.0 |1824 2986 |0.84 1.09 1.04|1.0 0 0| 0 0 | 0 2048M| 29 361 0 40 4 May 28 13:03:10 l75lg1-v1 neutron-server[77618]: DEBUG dbcounter [-] [77618] Writing DB stats neutron:UPDATE=1 {{(pid=77618) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:03:10 l75lg1-v1 neutron-server[77618]: DEBUG dbcounter [-] [77618] Writing DB stats neutron:SELECT=1 {{(pid=77618) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:03:11 l75lg1-v1 cinder-scheduler[85128]: DEBUG dbcounter [-] [85128] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=85128) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:03:11 l75lg1-v1 nova-conductor[83648]: DEBUG dbcounter [-] [83648] Writing DB stats nova_cell1:SELECT=3,nova_cell1:UPDATE=1 {{(pid=83648) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:03:11 l75lg1-v1 dstat.sh[49771]: 28-05 13:03:11| 1 0 98 1 0|5507M 1909M 278M 7929M| 14k 0 | 0 376k| 0 46.0 |1788 2856 |0.84 1.09 1.04|2.0 0 0| 0 0 | 0 2048M| 29 361 0 39 4 May 28 13:03:11 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.periodic_task [None req-e3486ff9-a95e-41bc-8901-df75aedbeaad None None] Running periodic task DataManager.create_backup_continue {{(pid=98318) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 13:03:11 l75lg1-v1 manila-data[98318]: DEBUG dbcounter [-] [98318] Writing DB stats manila:SELECT=30,manila:UPDATE=7 {{(pid=98318) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:03:11 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.periodic_task [None req-e3486ff9-a95e-41bc-8901-df75aedbeaad None None] Running periodic task DataManager.restore_backup_continue {{(pid=98318) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 13:03:12 l75lg1-v1 devstack@placement-api.service[78202]: DEBUG dbcounter [-] [78202] Writing DB stats placement:SELECT=2 {{(pid=78202) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:03:12 l75lg1-v1 devstack@placement-api.service[78201]: DEBUG dbcounter [-] [78201] Writing DB stats placement:SELECT=2 {{(pid=78201) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:03:12 l75lg1-v1 dstat.sh[49771]: 28-05 13:03:12| 1 0 98 1 0|5507M 1909M 278M 7929M| 13k 172B| 0 1360k| 0 59.0 |2196 3659 |0.94 1.10 1.05|1.0 0 0| 0 0 | 0 2048M| 29 361 0 39 4 May 28 13:03:12 l75lg1-v1 cinder-volume[85846]: DEBUG dbcounter [-] [85846] Writing DB stats cinder:SELECT=1 {{(pid=85846) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:03:12 l75lg1-v1 cinder-volume[85846]: DEBUG dbcounter [-] [85846] Writing DB stats cinder:UPDATE=1 {{(pid=85846) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:03:13 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-ed6522a6-3339-4e3e-ae71-bd0c18c78ebb tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] GET http://10.27.203.238/share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/19b885a7-cbdd-49e1-baf9-d755f4a5d279 May 28 13:03:13 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-ed6522a6-3339-4e3e-ae71-bd0c18c78ebb tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:03:13 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-ed6522a6-3339-4e3e-ae71-bd0c18c78ebb tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:03:13 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-ed6522a6-3339-4e3e-ae71-bd0c18c78ebb tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] http://10.27.203.238/share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/19b885a7-cbdd-49e1-baf9-d755f4a5d279 returned with HTTP 200 May 28 13:03:13 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1313/2605] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:03:13 2024] GET /share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/19b885a7-cbdd-49e1-baf9-d755f4a5d279 => generated 1314 bytes in 30 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:03:13 l75lg1-v1 dstat.sh[49771]: 28-05 13:03:13| 1 0 98 1 0|5507M 1909M 278M 7929M| 15k 0 | 0 380k| 0 44.0 |1961 3146 |0.94 1.10 1.05|2.0 0 0| 0 0 | 0 2048M| 29 361 0 39 4 May 28 13:03:14 l75lg1-v1 dstat.sh[49771]: 28-05 13:03:14| 0 0 99 0 0|5507M 1909M 278M 7929M| 13k 0 | 0 212k| 0 18.0 |1477 2456 |0.94 1.10 1.05|1.0 0 0| 0 0 | 0 2048M| 29 361 0 39 4 May 28 13:03:14 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-88899a6d-17d0-463b-91da-5032933f689e tempest-SharesActionsTest-682704550 None] <<< [DELETE] https://127.0.0.1:40443/api/quotas/56/ May 28 13:03:14 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-88899a6d-17d0-463b-91da-5032933f689e tempest-SharesActionsTest-682704550 None] --- [DELETE] https://127.0.0.1:40443/api/quotas/56/: Done May 28 13:03:14 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-88899a6d-17d0-463b-91da-5032933f689e tempest-SharesActionsTest-682704550 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:03:14 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-88899a6d-17d0-463b-91da-5032933f689e tempest-SharesActionsTest-682704550 None] {'allow_redirects': True, May 28 13:03:14 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-88899a6d-17d0-463b-91da-5032933f689e tempest-SharesActionsTest-682704550 None] 'params': {'name': '32ffe20e-0e78-4466-9b2b-19d99fd8e8a3'}} May 28 13:03:14 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-88899a6d-17d0-463b-91da-5032933f689e tempest-SharesActionsTest-682704550 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:03:14 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-88899a6d-17d0-463b-91da-5032933f689e tempest-SharesActionsTest-682704550 None] [Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=0, created='2024-05-28T13:02:58.911852Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='44309d24-acaa-42d7-bf2d-d58bd78999bb', id=59, internal=False, is_s3_default_policy=False, name='32ffe20e-0e78-4466-9b2b-19d99fd8e8a3', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=[], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['*'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['*'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T13:02:59.243397Z', tenant_id=1, tenant_name='default', title='32ffe20e-0e78-4466-9b2b-19d99fd8e8a3', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/59/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[])] May 28 13:03:14 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-88899a6d-17d0-463b-91da-5032933f689e tempest-SharesActionsTest-682704550 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 13:03:14 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-88899a6d-17d0-463b-91da-5032933f689e tempest-SharesActionsTest-682704550 None] >>> [DELETE] https://127.0.0.1:40443/api/viewpolicies/59/ May 28 13:03:15 l75lg1-v1 dstat.sh[49771]: 28-05 13:03:15| 1 0 99 0 0|5507M 1909M 278M 7929M| 13k 1390B| 0 8193B| 0 2.00 |1458 2390 |0.94 1.10 1.05|2.0 0 0| 0 0 | 0 2048M| 29 361 0 39 4 May 28 13:03:16 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-003ba636-4db7-4972-9a5a-6218f5a24f7f tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] GET http://10.27.203.238/share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/19b885a7-cbdd-49e1-baf9-d755f4a5d279 May 28 13:03:16 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-003ba636-4db7-4972-9a5a-6218f5a24f7f tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:03:16 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-003ba636-4db7-4972-9a5a-6218f5a24f7f tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:03:16 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-003ba636-4db7-4972-9a5a-6218f5a24f7f tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] http://10.27.203.238/share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/19b885a7-cbdd-49e1-baf9-d755f4a5d279 returned with HTTP 200 May 28 13:03:16 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1293/2606] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:03:16 2024] GET /share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/19b885a7-cbdd-49e1-baf9-d755f4a5d279 => generated 1314 bytes in 25 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:03:16 l75lg1-v1 dstat.sh[49771]: 28-05 13:03:16| 1 0 99 0 0|5507M 1909M 278M 7930M| 14k 0 | 0 0 | 0 0 |1527 2460 |0.94 1.10 1.05|1.0 0 0| 0 0 | 0 2048M| 29 361 0 39 4 May 28 13:03:16 l75lg1-v1 neutron-server[77623]: DEBUG dbcounter [-] [77623] Writing DB stats neutron:SELECT=1 {{(pid=77623) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:03:16 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-88899a6d-17d0-463b-91da-5032933f689e tempest-SharesActionsTest-682704550 None] <<< [DELETE] https://127.0.0.1:40443/api/viewpolicies/59/ May 28 13:03:16 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-88899a6d-17d0-463b-91da-5032933f689e tempest-SharesActionsTest-682704550 None] --- [DELETE] https://127.0.0.1:40443/api/viewpolicies/59/: Done May 28 13:03:16 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-88899a6d-17d0-463b-91da-5032933f689e tempest-SharesActionsTest-682704550 None] Created reservations ['e7d832f0-146f-4d4b-9674-96bf77921932', '56a77bcc-4573-4a0d-9b2a-01eca29249fa', '5b8cc1b6-d2a6-4de9-946b-feac4f6ad797', 'ea1e12d8-7f18-407b-bbd0-9a00e3f54308'] {{(pid=98474) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 13:03:16 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-88899a6d-17d0-463b-91da-5032933f689e tempest-SharesActionsTest-682704550 None] Committed reservations ['e7d832f0-146f-4d4b-9674-96bf77921932', '56a77bcc-4573-4a0d-9b2a-01eca29249fa', '5b8cc1b6-d2a6-4de9-946b-feac4f6ad797', 'ea1e12d8-7f18-407b-bbd0-9a00e3f54308'] {{(pid=98474) commit /opt/stack/manila/manila/quota.py:1063}} May 28 13:03:16 l75lg1-v1 manila-share[98474]: INFO manila.share.manager [None req-88899a6d-17d0-463b-91da-5032933f689e tempest-SharesActionsTest-682704550 None] Share instance 32ffe20e-0e78-4466-9b2b-19d99fd8e8a3: deleted successfully. May 28 13:03:17 l75lg1-v1 dstat.sh[49771]: 28-05 13:03:17| 2 0 97 1 0|5507M 1909M 278M 7930M| 10k 66B| 0 352k| 0 64.0 |2157 3625 |0.86 1.08 1.04|1.0 0 0| 0 0 | 0 2048M| 29 361 0 39 4 May 28 13:03:18 l75lg1-v1 dstat.sh[49771]: 28-05 13:03:18| 0 0 99 0 0|5507M 1909M 278M 7930M| 11k 0 | 0 344k| 0 33.0 |1697 2903 |0.86 1.08 1.04|1.0 0 2.0| 0 0 | 0 2048M| 29 361 0 39 4 May 28 13:03:19 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-de3aa1c2-225a-4deb-aade-d26c1f65d402 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] GET http://10.27.203.238/share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/19b885a7-cbdd-49e1-baf9-d755f4a5d279 May 28 13:03:19 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-de3aa1c2-225a-4deb-aade-d26c1f65d402 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:03:19 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-de3aa1c2-225a-4deb-aade-d26c1f65d402 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:03:19 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-de3aa1c2-225a-4deb-aade-d26c1f65d402 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] HTTP exception thrown: The resource could not be found. May 28 13:03:19 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-de3aa1c2-225a-4deb-aade-d26c1f65d402 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] http://10.27.203.238/share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/19b885a7-cbdd-49e1-baf9-d755f4a5d279 returned with HTTP 404 May 28 13:03:19 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1314/2607] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:03:19 2024] GET /share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/19b885a7-cbdd-49e1-baf9-d755f4a5d279 => generated 78 bytes in 12 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 13:03:19 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-c2274573-e432-40e3-a1f7-54e0451a8e5e tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] GET http://10.27.203.238/share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/f4d62492-698d-44ff-a5f4-f6b156775dbd May 28 13:03:19 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-c2274573-e432-40e3-a1f7-54e0451a8e5e tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:03:19 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-c2274573-e432-40e3-a1f7-54e0451a8e5e tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:03:19 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-c2274573-e432-40e3-a1f7-54e0451a8e5e tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] http://10.27.203.238/share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/f4d62492-698d-44ff-a5f4-f6b156775dbd returned with HTTP 200 May 28 13:03:19 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1294/2608] 10.27.203.238 () {64 vars in 1450 bytes} [Tue May 28 13:03:19 2024] GET /share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/f4d62492-698d-44ff-a5f4-f6b156775dbd => generated 996 bytes in 24 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:03:19 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-a22a482d-dbe8-4395-b305-3f71663ca85a tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] GET http://10.27.203.238/share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/f4d62492-698d-44ff-a5f4-f6b156775dbd May 28 13:03:19 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-a22a482d-dbe8-4395-b305-3f71663ca85a tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:03:19 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-a22a482d-dbe8-4395-b305-3f71663ca85a tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:03:19 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-a22a482d-dbe8-4395-b305-3f71663ca85a tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] http://10.27.203.238/share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/f4d62492-698d-44ff-a5f4-f6b156775dbd returned with HTTP 200 May 28 13:03:19 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1315/2609] 10.27.203.238 () {64 vars in 1450 bytes} [Tue May 28 13:03:19 2024] GET /share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/f4d62492-698d-44ff-a5f4-f6b156775dbd => generated 1066 bytes in 28 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:03:19 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-e9149612-2e1c-45df-b10e-edf4bed13654 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] GET http://10.27.203.238/share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/f4d62492-698d-44ff-a5f4-f6b156775dbd May 28 13:03:19 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-e9149612-2e1c-45df-b10e-edf4bed13654 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:03:19 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-e9149612-2e1c-45df-b10e-edf4bed13654 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:03:19 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-e9149612-2e1c-45df-b10e-edf4bed13654 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] http://10.27.203.238/share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/f4d62492-698d-44ff-a5f4-f6b156775dbd returned with HTTP 200 May 28 13:03:19 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1295/2610] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:03:19 2024] GET /share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/f4d62492-698d-44ff-a5f4-f6b156775dbd => generated 1029 bytes in 23 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:03:19 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-177f5ecc-8c9f-461d-9453-508e7dfe7294 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] GET http://10.27.203.238/share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/f4d62492-698d-44ff-a5f4-f6b156775dbd May 28 13:03:19 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-177f5ecc-8c9f-461d-9453-508e7dfe7294 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:03:19 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-177f5ecc-8c9f-461d-9453-508e7dfe7294 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:03:19 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-177f5ecc-8c9f-461d-9453-508e7dfe7294 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] http://10.27.203.238/share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/f4d62492-698d-44ff-a5f4-f6b156775dbd returned with HTTP 200 May 28 13:03:19 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1316/2611] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:03:19 2024] GET /share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/f4d62492-698d-44ff-a5f4-f6b156775dbd => generated 1170 bytes in 25 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:03:19 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-3e1dba52-9e3c-4ef2-9729-28e63b2a5744 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] GET http://10.27.203.238/share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/f4d62492-698d-44ff-a5f4-f6b156775dbd May 28 13:03:19 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-3e1dba52-9e3c-4ef2-9729-28e63b2a5744 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:03:19 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-3e1dba52-9e3c-4ef2-9729-28e63b2a5744 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:03:19 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-3e1dba52-9e3c-4ef2-9729-28e63b2a5744 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] http://10.27.203.238/share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/f4d62492-698d-44ff-a5f4-f6b156775dbd returned with HTTP 200 May 28 13:03:19 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1296/2612] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:03:19 2024] GET /share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/f4d62492-698d-44ff-a5f4-f6b156775dbd => generated 1078 bytes in 23 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:03:19 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-db064304-08b4-4350-a708-b198d58d28a1 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] GET http://10.27.203.238/share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/f4d62492-698d-44ff-a5f4-f6b156775dbd May 28 13:03:19 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-db064304-08b4-4350-a708-b198d58d28a1 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:03:19 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-db064304-08b4-4350-a708-b198d58d28a1 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:03:19 l75lg1-v1 dstat.sh[49771]: 28-05 13:03:19| 2 0 97 0 0|5507M 1909M 278M 7930M| 12k 10k| 0 396k| 0 43.0 |1910 3022 |0.86 1.08 1.04|2.0 0 0| 0 0 | 0 2048M| 29 362 0 38 4 May 28 13:03:19 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-db064304-08b4-4350-a708-b198d58d28a1 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] http://10.27.203.238/share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/f4d62492-698d-44ff-a5f4-f6b156775dbd returned with HTTP 200 May 28 13:03:19 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1317/2613] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:03:19 2024] GET /share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/f4d62492-698d-44ff-a5f4-f6b156775dbd => generated 1207 bytes in 26 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:03:19 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-f90ae682-8d4d-4065-988b-57c834fb7e1a tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] GET http://10.27.203.238/share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/f4d62492-698d-44ff-a5f4-f6b156775dbd May 28 13:03:19 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-f90ae682-8d4d-4065-988b-57c834fb7e1a tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:03:19 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-f90ae682-8d4d-4065-988b-57c834fb7e1a tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:03:19 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-f90ae682-8d4d-4065-988b-57c834fb7e1a tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] http://10.27.203.238/share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/f4d62492-698d-44ff-a5f4-f6b156775dbd returned with HTTP 200 May 28 13:03:19 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1297/2614] 10.27.203.238 () {64 vars in 1450 bytes} [Tue May 28 13:03:19 2024] GET /share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/f4d62492-698d-44ff-a5f4-f6b156775dbd => generated 1171 bytes in 24 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:03:19 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-5408a674-803d-4975-8411-2f1558de456a tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] GET http://10.27.203.238/share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/f4d62492-698d-44ff-a5f4-f6b156775dbd May 28 13:03:19 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-5408a674-803d-4975-8411-2f1558de456a tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:03:19 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-5408a674-803d-4975-8411-2f1558de456a tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:03:19 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-5408a674-803d-4975-8411-2f1558de456a tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] http://10.27.203.238/share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/f4d62492-698d-44ff-a5f4-f6b156775dbd returned with HTTP 200 May 28 13:03:19 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1318/2615] 10.27.203.238 () {64 vars in 1450 bytes} [Tue May 28 13:03:19 2024] GET /share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/f4d62492-698d-44ff-a5f4-f6b156775dbd => generated 1092 bytes in 24 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:03:19 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-c19dc698-e415-410b-b456-5bfeb21bcfe2 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] GET http://10.27.203.238/share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/f4d62492-698d-44ff-a5f4-f6b156775dbd May 28 13:03:19 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-c19dc698-e415-410b-b456-5bfeb21bcfe2 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:03:19 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-c19dc698-e415-410b-b456-5bfeb21bcfe2 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:03:19 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-c19dc698-e415-410b-b456-5bfeb21bcfe2 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] http://10.27.203.238/share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/f4d62492-698d-44ff-a5f4-f6b156775dbd returned with HTTP 200 May 28 13:03:19 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1298/2616] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:03:19 2024] GET /share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/f4d62492-698d-44ff-a5f4-f6b156775dbd => generated 1125 bytes in 27 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:03:19 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-b17eb717-5b5f-403e-ba10-6c15b1d71ed0 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] GET http://10.27.203.238/share/v1/718814c61c8c40e7bf78dd9d84d3b1f1/snapshots/cff0744c-aefe-421e-b8b7-055f24614a39 May 28 13:03:19 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-b17eb717-5b5f-403e-ba10-6c15b1d71ed0 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:03:19 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-b17eb717-5b5f-403e-ba10-6c15b1d71ed0 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Calling method 'ShareSnapshotMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:03:19 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-b17eb717-5b5f-403e-ba10-6c15b1d71ed0 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] http://10.27.203.238/share/v1/718814c61c8c40e7bf78dd9d84d3b1f1/snapshots/cff0744c-aefe-421e-b8b7-055f24614a39 returned with HTTP 200 May 28 13:03:19 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1319/2617] 10.27.203.238 () {62 vars in 1417 bytes} [Tue May 28 13:03:19 2024] GET /share/v1/718814c61c8c40e7bf78dd9d84d3b1f1/snapshots/cff0744c-aefe-421e-b8b7-055f24614a39 => generated 633 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:03:19 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-d158c220-3cde-4b1c-8748-aa8e2efdfd2d tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] GET http://10.27.203.238/share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/snapshots/cff0744c-aefe-421e-b8b7-055f24614a39 May 28 13:03:19 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-d158c220-3cde-4b1c-8748-aa8e2efdfd2d tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:03:19 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-d158c220-3cde-4b1c-8748-aa8e2efdfd2d tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Calling method 'ShareSnapshotMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:03:19 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-d158c220-3cde-4b1c-8748-aa8e2efdfd2d tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] http://10.27.203.238/share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/snapshots/cff0744c-aefe-421e-b8b7-055f24614a39 returned with HTTP 200 May 28 13:03:19 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1299/2618] 10.27.203.238 () {64 vars in 1460 bytes} [Tue May 28 13:03:19 2024] GET /share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/snapshots/cff0744c-aefe-421e-b8b7-055f24614a39 => generated 633 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:03:19 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-d71fbd0c-02a4-4cc8-8e10-0e006952500e tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] GET http://10.27.203.238/share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/snapshots/cff0744c-aefe-421e-b8b7-055f24614a39 May 28 13:03:19 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-d71fbd0c-02a4-4cc8-8e10-0e006952500e tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:03:19 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-d71fbd0c-02a4-4cc8-8e10-0e006952500e tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Calling method 'ShareSnapshotMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:03:19 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-d71fbd0c-02a4-4cc8-8e10-0e006952500e tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] http://10.27.203.238/share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/snapshots/cff0744c-aefe-421e-b8b7-055f24614a39 returned with HTTP 200 May 28 13:03:19 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1320/2619] 10.27.203.238 () {64 vars in 1460 bytes} [Tue May 28 13:03:19 2024] GET /share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/snapshots/cff0744c-aefe-421e-b8b7-055f24614a39 => generated 746 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 231 bytes (2 switches on core 0) May 28 13:03:19 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-cd246e73-b2c1-43b0-82fe-2b6ecbd98ec1 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] GET http://10.27.203.238/share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares May 28 13:03:19 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-cd246e73-b2c1-43b0-82fe-2b6ecbd98ec1 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:03:19 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-cd246e73-b2c1-43b0-82fe-2b6ecbd98ec1 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:03:19 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.common [None req-cd246e73-b2c1-43b0-82fe-2b6ecbd98ec1 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Removing options '' from query {{(pid=98330) remove_invalid_options /opt/stack/manila/manila/api/common.py:441}} May 28 13:03:19 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.share.api [None req-cd246e73-b2c1-43b0-82fe-2b6ecbd98ec1 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Searching for shares by: {} {{(pid=98330) _get_all /opt/stack/manila/manila/share/api.py:2235}} May 28 13:03:19 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-cd246e73-b2c1-43b0-82fe-2b6ecbd98ec1 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] http://10.27.203.238/share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares returned with HTTP 200 May 28 13:03:19 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1300/2620] 10.27.203.238 () {64 vars in 1340 bytes} [Tue May 28 13:03:19 2024] GET /share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares => generated 391 bytes in 26 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:03:19 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-6e6865a6-429b-4d4a-ac35-616041516c5a tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] GET http://10.27.203.238/share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/detail May 28 13:03:19 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-6e6865a6-429b-4d4a-ac35-616041516c5a tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:03:19 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-6e6865a6-429b-4d4a-ac35-616041516c5a tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:03:19 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.common [None req-6e6865a6-429b-4d4a-ac35-616041516c5a tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Removing options '' from query {{(pid=98329) remove_invalid_options /opt/stack/manila/manila/api/common.py:441}} May 28 13:03:19 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.share.api [None req-6e6865a6-429b-4d4a-ac35-616041516c5a tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Searching for shares by: {} {{(pid=98329) _get_all /opt/stack/manila/manila/share/api.py:2235}} May 28 13:03:19 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-6e6865a6-429b-4d4a-ac35-616041516c5a tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] http://10.27.203.238/share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/detail returned with HTTP 200 May 28 13:03:19 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1321/2621] 10.27.203.238 () {64 vars in 1361 bytes} [Tue May 28 13:03:19 2024] GET /share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/detail => generated 1173 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:03:19 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-cf52e937-eec2-4f6a-932c-e1ae2ef9eab9 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] GET http://10.27.203.238/share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/detail May 28 13:03:19 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-cf52e937-eec2-4f6a-932c-e1ae2ef9eab9 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:03:19 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-cf52e937-eec2-4f6a-932c-e1ae2ef9eab9 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:03:19 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.common [None req-cf52e937-eec2-4f6a-932c-e1ae2ef9eab9 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Removing options '' from query {{(pid=98330) remove_invalid_options /opt/stack/manila/manila/api/common.py:441}} May 28 13:03:19 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.share.api [None req-cf52e937-eec2-4f6a-932c-e1ae2ef9eab9 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Searching for shares by: {} {{(pid=98330) _get_all /opt/stack/manila/manila/share/api.py:2235}} May 28 13:03:19 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-cf52e937-eec2-4f6a-932c-e1ae2ef9eab9 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] http://10.27.203.238/share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/detail returned with HTTP 200 May 28 13:03:19 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1301/2622] 10.27.203.238 () {64 vars in 1360 bytes} [Tue May 28 13:03:19 2024] GET /share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/detail => generated 1095 bytes in 27 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:03:19 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-4186d452-263f-4e71-b256-9cdd3f3cca4e tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] GET http://10.27.203.238/share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/detail May 28 13:03:19 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-4186d452-263f-4e71-b256-9cdd3f3cca4e tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:03:19 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-4186d452-263f-4e71-b256-9cdd3f3cca4e tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:03:19 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.common [None req-4186d452-263f-4e71-b256-9cdd3f3cca4e tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Removing options '' from query {{(pid=98329) remove_invalid_options /opt/stack/manila/manila/api/common.py:441}} May 28 13:03:19 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.share.api [None req-4186d452-263f-4e71-b256-9cdd3f3cca4e tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Searching for shares by: {} {{(pid=98329) _get_all /opt/stack/manila/manila/share/api.py:2235}} May 28 13:03:19 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-4186d452-263f-4e71-b256-9cdd3f3cca4e tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] http://10.27.203.238/share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/detail returned with HTTP 200 May 28 13:03:19 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1322/2623] 10.27.203.238 () {64 vars in 1360 bytes} [Tue May 28 13:03:19 2024] GET /share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/detail => generated 999 bytes in 28 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:03:19 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-66456685-52ee-4926-b3ee-2b13bee022ae tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] GET http://10.27.203.238/share/v1/718814c61c8c40e7bf78dd9d84d3b1f1/shares/detail?status=available May 28 13:03:19 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-66456685-52ee-4926-b3ee-2b13bee022ae tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:03:19 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-66456685-52ee-4926-b3ee-2b13bee022ae tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Calling method 'ShareMixin.detail' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:03:19 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.common [None req-66456685-52ee-4926-b3ee-2b13bee022ae tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Removing options '' from query {{(pid=98330) remove_invalid_options /opt/stack/manila/manila/api/common.py:441}} May 28 13:03:19 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.share.api [None req-66456685-52ee-4926-b3ee-2b13bee022ae tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Searching for shares by: {'status': 'available'} {{(pid=98330) _get_all /opt/stack/manila/manila/share/api.py:2235}} May 28 13:03:19 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-66456685-52ee-4926-b3ee-2b13bee022ae tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] http://10.27.203.238/share/v1/718814c61c8c40e7bf78dd9d84d3b1f1/shares/detail?status=available returned with HTTP 200 May 28 13:03:19 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1302/2624] 10.27.203.238 () {62 vars in 1351 bytes} [Tue May 28 13:03:19 2024] GET /share/v1/718814c61c8c40e7bf78dd9d84d3b1f1/shares/detail?status=available => generated 1069 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:03:19 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-be7cb193-1b91-4865-a40c-de2be4c1428e tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] GET http://10.27.203.238/share/v1/718814c61c8c40e7bf78dd9d84d3b1f1/shares/detail?all_tenants=1 May 28 13:03:19 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-be7cb193-1b91-4865-a40c-de2be4c1428e tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:03:19 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-be7cb193-1b91-4865-a40c-de2be4c1428e tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Calling method 'ShareMixin.detail' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:03:19 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.common [None req-be7cb193-1b91-4865-a40c-de2be4c1428e tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Removing options 'all_tenants' from query {{(pid=98329) remove_invalid_options /opt/stack/manila/manila/api/common.py:441}} May 28 13:03:19 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.share.api [None req-be7cb193-1b91-4865-a40c-de2be4c1428e tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Searching for shares by: {} {{(pid=98329) _get_all /opt/stack/manila/manila/share/api.py:2235}} May 28 13:03:19 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-be7cb193-1b91-4865-a40c-de2be4c1428e tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] http://10.27.203.238/share/v1/718814c61c8c40e7bf78dd9d84d3b1f1/shares/detail?all_tenants=1 returned with HTTP 200 May 28 13:03:19 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1323/2625] 10.27.203.238 () {62 vars in 1345 bytes} [Tue May 28 13:03:19 2024] GET /share/v1/718814c61c8c40e7bf78dd9d84d3b1f1/shares/detail?all_tenants=1 => generated 1069 bytes in 27 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:03:19 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-53ceebb1-93a8-4f4c-bb15-5b36288453db tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] GET http://10.27.203.238/share/v1/718814c61c8c40e7bf78dd9d84d3b1f1/shares/f4d62492-698d-44ff-a5f4-f6b156775dbd May 28 13:03:19 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-53ceebb1-93a8-4f4c-bb15-5b36288453db tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:03:19 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-53ceebb1-93a8-4f4c-bb15-5b36288453db tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:03:19 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-53ceebb1-93a8-4f4c-bb15-5b36288453db tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] http://10.27.203.238/share/v1/718814c61c8c40e7bf78dd9d84d3b1f1/shares/f4d62492-698d-44ff-a5f4-f6b156775dbd returned with HTTP 200 May 28 13:03:19 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1303/2626] 10.27.203.238 () {62 vars in 1408 bytes} [Tue May 28 13:03:19 2024] GET /share/v1/718814c61c8c40e7bf78dd9d84d3b1f1/shares/f4d62492-698d-44ff-a5f4-f6b156775dbd => generated 1066 bytes in 23 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:03:19 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-5bae11e5-2576-4b79-9dd2-bb06b6eb12e5 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] GET http://10.27.203.238/share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/detail?description=tempest-tempest-share-description-344942892 May 28 13:03:19 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-5bae11e5-2576-4b79-9dd2-bb06b6eb12e5 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:03:19 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-5bae11e5-2576-4b79-9dd2-bb06b6eb12e5 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:03:19 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.common [None req-5bae11e5-2576-4b79-9dd2-bb06b6eb12e5 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Removing options '' from query {{(pid=98329) remove_invalid_options /opt/stack/manila/manila/api/common.py:441}} May 28 13:03:19 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.share.api [None req-5bae11e5-2576-4b79-9dd2-bb06b6eb12e5 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Searching for shares by: {'display_description': 'tempest-tempest-share-description-344942892'} {{(pid=98329) _get_all /opt/stack/manila/manila/share/api.py:2235}} May 28 13:03:19 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-5bae11e5-2576-4b79-9dd2-bb06b6eb12e5 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] http://10.27.203.238/share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/detail?description=tempest-tempest-share-description-344942892 returned with HTTP 200 May 28 13:03:19 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1324/2627] 10.27.203.238 () {64 vars in 1472 bytes} [Tue May 28 13:03:19 2024] GET /share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/detail?description=tempest-tempest-share-description-344942892 => generated 1422 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 232 bytes (2 switches on core 0) May 28 13:03:19 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-11d4ce43-1354-48e7-93f0-4d120fc0b542 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] GET http://10.27.203.238/share/v1/718814c61c8c40e7bf78dd9d84d3b1f1/shares/detail?name=tempest-tempest-share-name-1367132874 May 28 13:03:19 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-11d4ce43-1354-48e7-93f0-4d120fc0b542 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:03:19 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-11d4ce43-1354-48e7-93f0-4d120fc0b542 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Calling method 'ShareMixin.detail' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:03:19 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.common [None req-11d4ce43-1354-48e7-93f0-4d120fc0b542 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Removing options '' from query {{(pid=98330) remove_invalid_options /opt/stack/manila/manila/api/common.py:441}} May 28 13:03:19 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.share.api [None req-11d4ce43-1354-48e7-93f0-4d120fc0b542 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Searching for shares by: {'display_name': 'tempest-tempest-share-name-1367132874'} {{(pid=98330) _get_all /opt/stack/manila/manila/share/api.py:2235}} May 28 13:03:19 l75lg1-v1 nova-conductor[83647]: DEBUG dbcounter [-] [83647] Writing DB stats nova_cell1:SELECT=2 {{(pid=83647) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:03:19 l75lg1-v1 nova-conductor[83647]: DEBUG dbcounter [-] [83647] Writing DB stats nova_cell1:SELECT=3,nova_cell1:UPDATE=2 {{(pid=83647) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:03:19 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-11d4ce43-1354-48e7-93f0-4d120fc0b542 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] http://10.27.203.238/share/v1/718814c61c8c40e7bf78dd9d84d3b1f1/shares/detail?name=tempest-tempest-share-name-1367132874 returned with HTTP 200 May 28 13:03:19 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1304/2628] 10.27.203.238 () {62 vars in 1403 bytes} [Tue May 28 13:03:19 2024] GET /share/v1/718814c61c8c40e7bf78dd9d84d3b1f1/shares/detail?name=tempest-tempest-share-name-1367132874 => generated 1069 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:03:19 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-3c43ba4a-66b0-45ef-b338-b985ac8506ee tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] GET http://10.27.203.238/share/v1/718814c61c8c40e7bf78dd9d84d3b1f1/shares/detail?name=tempest-fake-nonexistent-name-658119758 May 28 13:03:19 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-3c43ba4a-66b0-45ef-b338-b985ac8506ee tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:03:19 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-3c43ba4a-66b0-45ef-b338-b985ac8506ee tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Calling method 'ShareMixin.detail' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:03:19 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.common [None req-3c43ba4a-66b0-45ef-b338-b985ac8506ee tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Removing options '' from query {{(pid=98329) remove_invalid_options /opt/stack/manila/manila/api/common.py:441}} May 28 13:03:19 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.share.api [None req-3c43ba4a-66b0-45ef-b338-b985ac8506ee tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Searching for shares by: {'display_name': 'tempest-fake-nonexistent-name-658119758'} {{(pid=98329) _get_all /opt/stack/manila/manila/share/api.py:2235}} May 28 13:03:19 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-3c43ba4a-66b0-45ef-b338-b985ac8506ee tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] http://10.27.203.238/share/v1/718814c61c8c40e7bf78dd9d84d3b1f1/shares/detail?name=tempest-fake-nonexistent-name-658119758 returned with HTTP 200 May 28 13:03:19 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1325/2629] 10.27.203.238 () {62 vars in 1407 bytes} [Tue May 28 13:03:19 2024] GET /share/v1/718814c61c8c40e7bf78dd9d84d3b1f1/shares/detail?name=tempest-fake-nonexistent-name-658119758 => generated 14 bytes in 18 msecs (HTTP/1.1 200) 6 headers in 229 bytes (1 switches on core 0) May 28 13:03:19 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-d5bb1336-524c-4bb0-a942-badf4d70863b tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] GET http://10.27.203.238/share/v1/718814c61c8c40e7bf78dd9d84d3b1f1/shares/detail?status=fake May 28 13:03:19 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-d5bb1336-524c-4bb0-a942-badf4d70863b tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:03:19 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-d5bb1336-524c-4bb0-a942-badf4d70863b tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Calling method 'ShareMixin.detail' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:03:19 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.common [None req-d5bb1336-524c-4bb0-a942-badf4d70863b tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Removing options '' from query {{(pid=98330) remove_invalid_options /opt/stack/manila/manila/api/common.py:441}} May 28 13:03:19 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.share.api [None req-d5bb1336-524c-4bb0-a942-badf4d70863b tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Searching for shares by: {'status': 'fake'} {{(pid=98330) _get_all /opt/stack/manila/manila/share/api.py:2235}} May 28 13:03:19 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-d5bb1336-524c-4bb0-a942-badf4d70863b tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] http://10.27.203.238/share/v1/718814c61c8c40e7bf78dd9d84d3b1f1/shares/detail?status=fake returned with HTTP 200 May 28 13:03:19 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1305/2630] 10.27.203.238 () {62 vars in 1341 bytes} [Tue May 28 13:03:19 2024] GET /share/v1/718814c61c8c40e7bf78dd9d84d3b1f1/shares/detail?status=fake => generated 14 bytes in 12 msecs (HTTP/1.1 200) 6 headers in 229 bytes (1 switches on core 0) May 28 13:03:19 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-90cca836-c0c8-4662-a01b-62145c7401ab tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] GET http://10.27.203.238/share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/detail?name~=tempest-share May 28 13:03:19 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-90cca836-c0c8-4662-a01b-62145c7401ab tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:03:19 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-90cca836-c0c8-4662-a01b-62145c7401ab tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:03:19 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.common [None req-90cca836-c0c8-4662-a01b-62145c7401ab tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Removing options '' from query {{(pid=98329) remove_invalid_options /opt/stack/manila/manila/api/common.py:441}} May 28 13:03:19 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.share.api [None req-90cca836-c0c8-4662-a01b-62145c7401ab tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Searching for shares by: {'display_name~': 'tempest-share'} {{(pid=98329) _get_all /opt/stack/manila/manila/share/api.py:2235}} May 28 13:03:19 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-90cca836-c0c8-4662-a01b-62145c7401ab tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] http://10.27.203.238/share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/detail?name~=tempest-share returned with HTTP 200 May 28 13:03:19 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1326/2631] 10.27.203.238 () {64 vars in 1400 bytes} [Tue May 28 13:03:19 2024] GET /share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/detail?name~=tempest-share => generated 1422 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:03:19 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-1edc950a-766d-439b-9502-1a3891bea21c tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] GET http://10.27.203.238/share/v1/718814c61c8c40e7bf78dd9d84d3b1f1/shares/detail?metadata=%7B%27foo_key_share_1%27%3A+%27foo_value_share_1%27%2C+%27bar_key_share_1%27%3A+%27foo_value_share_1%27%7D May 28 13:03:19 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-1edc950a-766d-439b-9502-1a3891bea21c tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:03:19 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-1edc950a-766d-439b-9502-1a3891bea21c tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Calling method 'ShareMixin.detail' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:03:19 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.common [None req-1edc950a-766d-439b-9502-1a3891bea21c tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Removing options '' from query {{(pid=98330) remove_invalid_options /opt/stack/manila/manila/api/common.py:441}} May 28 13:03:19 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.share.api [None req-1edc950a-766d-439b-9502-1a3891bea21c tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Searching for shares by: {'metadata': {'foo_key_share_1': 'foo_value_share_1', 'bar_key_share_1': 'foo_value_share_1'}} {{(pid=98330) _get_all /opt/stack/manila/manila/share/api.py:2235}} May 28 13:03:19 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-1edc950a-766d-439b-9502-1a3891bea21c tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] http://10.27.203.238/share/v1/718814c61c8c40e7bf78dd9d84d3b1f1/shares/detail?metadata=%7B%27foo_key_share_1%27%3A+%27foo_value_share_1%27%2C+%27bar_key_share_1%27%3A+%27foo_value_share_1%27%7D returned with HTTP 200 May 28 13:03:19 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1306/2632] 10.27.203.238 () {62 vars in 1549 bytes} [Tue May 28 13:03:19 2024] GET /share/v1/718814c61c8c40e7bf78dd9d84d3b1f1/shares/detail?metadata=%7B%27foo_key_share_1%27%3A+%27foo_value_share_1%27%2C+%27bar_key_share_1%27%3A+%27foo_value_share_1%27%7D => generated 1069 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:03:19 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-2ac97a27-48e0-405a-823b-dc632216e965 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] GET http://10.27.203.238/share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/detail May 28 13:03:19 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-2ac97a27-48e0-405a-823b-dc632216e965 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:03:19 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-2ac97a27-48e0-405a-823b-dc632216e965 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:03:19 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.common [None req-2ac97a27-48e0-405a-823b-dc632216e965 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Removing options '' from query {{(pid=98329) remove_invalid_options /opt/stack/manila/manila/api/common.py:441}} May 28 13:03:19 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.share.api [None req-2ac97a27-48e0-405a-823b-dc632216e965 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Searching for shares by: {} {{(pid=98329) _get_all /opt/stack/manila/manila/share/api.py:2235}} May 28 13:03:19 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-2ac97a27-48e0-405a-823b-dc632216e965 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] http://10.27.203.238/share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/detail returned with HTTP 200 May 28 13:03:19 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1327/2633] 10.27.203.238 () {64 vars in 1361 bytes} [Tue May 28 13:03:19 2024] GET /share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/detail => generated 1081 bytes in 28 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:03:19 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-c8b5895b-6972-4cbd-9e2d-720e2fa75406 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] GET http://10.27.203.238/share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/detail May 28 13:03:19 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-c8b5895b-6972-4cbd-9e2d-720e2fa75406 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:03:19 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-c8b5895b-6972-4cbd-9e2d-720e2fa75406 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:03:19 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.common [None req-c8b5895b-6972-4cbd-9e2d-720e2fa75406 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Removing options '' from query {{(pid=98330) remove_invalid_options /opt/stack/manila/manila/api/common.py:441}} May 28 13:03:19 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.share.api [None req-c8b5895b-6972-4cbd-9e2d-720e2fa75406 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Searching for shares by: {} {{(pid=98330) _get_all /opt/stack/manila/manila/share/api.py:2235}} May 28 13:03:20 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-c8b5895b-6972-4cbd-9e2d-720e2fa75406 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] http://10.27.203.238/share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/detail returned with HTTP 200 May 28 13:03:20 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1307/2634] 10.27.203.238 () {64 vars in 1360 bytes} [Tue May 28 13:03:19 2024] GET /share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/detail => generated 1174 bytes in 25 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:03:20 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-3f86f46c-c4b1-40ce-be81-10f6421333c2 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] GET http://10.27.203.238/share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/detail May 28 13:03:20 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-3f86f46c-c4b1-40ce-be81-10f6421333c2 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:03:20 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-3f86f46c-c4b1-40ce-be81-10f6421333c2 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:03:20 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.common [None req-3f86f46c-c4b1-40ce-be81-10f6421333c2 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Removing options '' from query {{(pid=98329) remove_invalid_options /opt/stack/manila/manila/api/common.py:441}} May 28 13:03:20 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.share.api [None req-3f86f46c-c4b1-40ce-be81-10f6421333c2 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Searching for shares by: {} {{(pid=98329) _get_all /opt/stack/manila/manila/share/api.py:2235}} May 28 13:03:20 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-3f86f46c-c4b1-40ce-be81-10f6421333c2 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] http://10.27.203.238/share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/detail returned with HTTP 200 May 28 13:03:20 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1328/2635] 10.27.203.238 () {64 vars in 1360 bytes} [Tue May 28 13:03:20 2024] GET /share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/detail => generated 1069 bytes in 26 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:03:20 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-6cc849d1-26a8-4d3f-abfe-1426e63e1962 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] GET http://10.27.203.238/share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/detail May 28 13:03:20 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-6cc849d1-26a8-4d3f-abfe-1426e63e1962 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:03:20 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-6cc849d1-26a8-4d3f-abfe-1426e63e1962 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:03:20 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.common [None req-6cc849d1-26a8-4d3f-abfe-1426e63e1962 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Removing options '' from query {{(pid=98330) remove_invalid_options /opt/stack/manila/manila/api/common.py:441}} May 28 13:03:20 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.share.api [None req-6cc849d1-26a8-4d3f-abfe-1426e63e1962 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Searching for shares by: {} {{(pid=98330) _get_all /opt/stack/manila/manila/share/api.py:2235}} May 28 13:03:20 l75lg1-v1 nova-conductor[83648]: DEBUG dbcounter [-] [83648] Writing DB stats nova_cell1:SELECT=3 {{(pid=83648) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:03:20 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-6cc849d1-26a8-4d3f-abfe-1426e63e1962 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] http://10.27.203.238/share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/detail returned with HTTP 200 May 28 13:03:20 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1308/2636] 10.27.203.238 () {64 vars in 1361 bytes} [Tue May 28 13:03:20 2024] GET /share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/detail => generated 1032 bytes in 26 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:03:20 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-7f1ec066-3816-4810-ae1d-859aa6359234 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] GET http://10.27.203.238/share/v1/718814c61c8c40e7bf78dd9d84d3b1f1/shares/detail?sort_key=created_at&sort_dir=asc May 28 13:03:20 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-7f1ec066-3816-4810-ae1d-859aa6359234 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:03:20 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-7f1ec066-3816-4810-ae1d-859aa6359234 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Calling method 'ShareMixin.detail' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:03:20 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.common [None req-7f1ec066-3816-4810-ae1d-859aa6359234 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Removing options '' from query {{(pid=98329) remove_invalid_options /opt/stack/manila/manila/api/common.py:441}} May 28 13:03:20 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.share.api [None req-7f1ec066-3816-4810-ae1d-859aa6359234 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Searching for shares by: {} {{(pid=98329) _get_all /opt/stack/manila/manila/share/api.py:2235}} May 28 13:03:20 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-7f1ec066-3816-4810-ae1d-859aa6359234 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] http://10.27.203.238/share/v1/718814c61c8c40e7bf78dd9d84d3b1f1/shares/detail?sort_key=created_at&sort_dir=asc returned with HTTP 200 May 28 13:03:20 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1329/2637] 10.27.203.238 () {62 vars in 1383 bytes} [Tue May 28 13:03:20 2024] GET /share/v1/718814c61c8c40e7bf78dd9d84d3b1f1/shares/detail?sort_key=created_at&sort_dir=asc => generated 1069 bytes in 31 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:03:20 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-64efac77-2821-4099-b874-f1dd0a7ce998 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] GET http://10.27.203.238/share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/detail?with_count=true May 28 13:03:20 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-64efac77-2821-4099-b874-f1dd0a7ce998 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:03:20 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-64efac77-2821-4099-b874-f1dd0a7ce998 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:03:20 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.common [None req-64efac77-2821-4099-b874-f1dd0a7ce998 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Removing options '' from query {{(pid=98330) remove_invalid_options /opt/stack/manila/manila/api/common.py:441}} May 28 13:03:20 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.share.api [None req-64efac77-2821-4099-b874-f1dd0a7ce998 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Searching for shares by: {} {{(pid=98330) _get_all /opt/stack/manila/manila/share/api.py:2235}} May 28 13:03:20 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-64efac77-2821-4099-b874-f1dd0a7ce998 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] http://10.27.203.238/share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/detail?with_count=true returned with HTTP 200 May 28 13:03:20 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1309/2638] 10.27.203.238 () {64 vars in 1392 bytes} [Tue May 28 13:03:20 2024] GET /share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/detail?with_count=true => generated 1434 bytes in 31 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:03:20 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-c4de1c42-9677-40a5-9370-37f845ea06c8 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] GET http://10.27.203.238/share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/detail May 28 13:03:20 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-c4de1c42-9677-40a5-9370-37f845ea06c8 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:03:20 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-c4de1c42-9677-40a5-9370-37f845ea06c8 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:03:20 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.common [None req-c4de1c42-9677-40a5-9370-37f845ea06c8 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Removing options '' from query {{(pid=98329) remove_invalid_options /opt/stack/manila/manila/api/common.py:441}} May 28 13:03:20 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.share.api [None req-c4de1c42-9677-40a5-9370-37f845ea06c8 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Searching for shares by: {} {{(pid=98329) _get_all /opt/stack/manila/manila/share/api.py:2235}} May 28 13:03:20 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-c4de1c42-9677-40a5-9370-37f845ea06c8 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] http://10.27.203.238/share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/detail returned with HTTP 200 May 28 13:03:20 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1330/2639] 10.27.203.238 () {64 vars in 1361 bytes} [Tue May 28 13:03:20 2024] GET /share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/detail => generated 1210 bytes in 26 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:03:20 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-8afccc2a-b5d9-4388-bed9-6e0808ac1f03 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] GET http://10.27.203.238/share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/detail May 28 13:03:20 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-8afccc2a-b5d9-4388-bed9-6e0808ac1f03 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:03:20 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-8afccc2a-b5d9-4388-bed9-6e0808ac1f03 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:03:20 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.common [None req-8afccc2a-b5d9-4388-bed9-6e0808ac1f03 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Removing options '' from query {{(pid=98330) remove_invalid_options /opt/stack/manila/manila/api/common.py:441}} May 28 13:03:20 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.share.api [None req-8afccc2a-b5d9-4388-bed9-6e0808ac1f03 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Searching for shares by: {} {{(pid=98330) _get_all /opt/stack/manila/manila/share/api.py:2235}} May 28 13:03:20 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-8afccc2a-b5d9-4388-bed9-6e0808ac1f03 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] http://10.27.203.238/share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/detail returned with HTTP 200 May 28 13:03:20 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1310/2640] 10.27.203.238 () {64 vars in 1361 bytes} [Tue May 28 13:03:20 2024] GET /share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/detail => generated 1128 bytes in 27 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:03:20 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-e3c20b24-59e1-4e05-9797-577c1d6351dc tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] GET http://10.27.203.238/share/v1/718814c61c8c40e7bf78dd9d84d3b1f1/snapshots May 28 13:03:20 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-e3c20b24-59e1-4e05-9797-577c1d6351dc tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:03:20 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-e3c20b24-59e1-4e05-9797-577c1d6351dc tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Calling method 'ShareSnapshotMixin.index' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:03:20 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.common [None req-e3c20b24-59e1-4e05-9797-577c1d6351dc tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Removing options '' from query {{(pid=98329) remove_invalid_options /opt/stack/manila/manila/api/common.py:441}} May 28 13:03:20 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.share.api [None req-e3c20b24-59e1-4e05-9797-577c1d6351dc tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Searching for snapshots by: {} {{(pid=98329) _get_all_snapshots /opt/stack/manila/manila/share/api.py:2349}} May 28 13:03:20 l75lg1-v1 dstat.sh[49771]: 28-05 13:03:20| 11 1 87 0 0|5507M 1909M 278M 7930M| 19k 35k| 0 476k| 0 49.0 |4486 6646 |0.86 1.08 1.04|2.0 0 0| 0 0 | 0 2048M| 29 362 0 38 4 May 28 13:03:20 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-e3c20b24-59e1-4e05-9797-577c1d6351dc tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] http://10.27.203.238/share/v1/718814c61c8c40e7bf78dd9d84d3b1f1/snapshots returned with HTTP 200 May 28 13:03:20 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1331/2641] 10.27.203.238 () {62 vars in 1306 bytes} [Tue May 28 13:03:20 2024] GET /share/v1/718814c61c8c40e7bf78dd9d84d3b1f1/snapshots => generated 402 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:03:20 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-9adf7bbf-a8fd-48d6-ac27-d97ba6137329 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] GET http://10.27.203.238/share/v1/718814c61c8c40e7bf78dd9d84d3b1f1/snapshots/detail May 28 13:03:20 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-9adf7bbf-a8fd-48d6-ac27-d97ba6137329 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:03:20 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-9adf7bbf-a8fd-48d6-ac27-d97ba6137329 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Calling method 'ShareSnapshotMixin.detail' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:03:20 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.common [None req-9adf7bbf-a8fd-48d6-ac27-d97ba6137329 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Removing options '' from query {{(pid=98330) remove_invalid_options /opt/stack/manila/manila/api/common.py:441}} May 28 13:03:20 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.share.api [None req-9adf7bbf-a8fd-48d6-ac27-d97ba6137329 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Searching for snapshots by: {} {{(pid=98330) _get_all_snapshots /opt/stack/manila/manila/share/api.py:2349}} May 28 13:03:20 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-9adf7bbf-a8fd-48d6-ac27-d97ba6137329 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] http://10.27.203.238/share/v1/718814c61c8c40e7bf78dd9d84d3b1f1/snapshots/detail returned with HTTP 200 May 28 13:03:20 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1311/2642] 10.27.203.238 () {62 vars in 1327 bytes} [Tue May 28 13:03:20 2024] GET /share/v1/718814c61c8c40e7bf78dd9d84d3b1f1/snapshots/detail => generated 636 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:03:20 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-71eacc3d-f607-4825-82a6-bfcd577ff7e3 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] GET http://10.27.203.238/share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/snapshots/detail May 28 13:03:20 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-71eacc3d-f607-4825-82a6-bfcd577ff7e3 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:03:20 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-71eacc3d-f607-4825-82a6-bfcd577ff7e3 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:03:20 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.common [None req-71eacc3d-f607-4825-82a6-bfcd577ff7e3 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Removing options '' from query {{(pid=98329) remove_invalid_options /opt/stack/manila/manila/api/common.py:441}} May 28 13:03:20 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.share.api [None req-71eacc3d-f607-4825-82a6-bfcd577ff7e3 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Searching for snapshots by: {} {{(pid=98329) _get_all_snapshots /opt/stack/manila/manila/share/api.py:2349}} May 28 13:03:20 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-71eacc3d-f607-4825-82a6-bfcd577ff7e3 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] http://10.27.203.238/share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/snapshots/detail returned with HTTP 200 May 28 13:03:20 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1332/2643] 10.27.203.238 () {64 vars in 1370 bytes} [Tue May 28 13:03:20 2024] GET /share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/snapshots/detail => generated 636 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:03:20 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-f6734939-41c5-4c97-9d25-9cebd56ad601 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] GET http://10.27.203.238/share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/snapshots/detail?name~=tempest&description~=tempest May 28 13:03:20 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-f6734939-41c5-4c97-9d25-9cebd56ad601 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:03:20 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-f6734939-41c5-4c97-9d25-9cebd56ad601 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:03:20 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.common [None req-f6734939-41c5-4c97-9d25-9cebd56ad601 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Removing options '' from query {{(pid=98330) remove_invalid_options /opt/stack/manila/manila/api/common.py:441}} May 28 13:03:20 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.share.api [None req-f6734939-41c5-4c97-9d25-9cebd56ad601 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Searching for snapshots by: {'display_name~': 'tempest', 'display_description~': 'tempest'} {{(pid=98330) _get_all_snapshots /opt/stack/manila/manila/share/api.py:2349}} May 28 13:03:20 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-f6734939-41c5-4c97-9d25-9cebd56ad601 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] http://10.27.203.238/share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/snapshots/detail?name~=tempest&description~=tempest returned with HTTP 200 May 28 13:03:20 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1312/2644] 10.27.203.238 () {64 vars in 1439 bytes} [Tue May 28 13:03:20 2024] GET /share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/snapshots/detail?name~=tempest&description~=tempest => generated 733 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:03:20 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-825d6fb4-4890-426b-9389-c4b6d3664296 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] GET http://10.27.203.238/share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/snapshots/detail?name~=tempest&description~=tempest May 28 13:03:20 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-825d6fb4-4890-426b-9389-c4b6d3664296 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:03:20 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-825d6fb4-4890-426b-9389-c4b6d3664296 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:03:20 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.common [None req-825d6fb4-4890-426b-9389-c4b6d3664296 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Removing options '' from query {{(pid=98329) remove_invalid_options /opt/stack/manila/manila/api/common.py:441}} May 28 13:03:20 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.share.api [None req-825d6fb4-4890-426b-9389-c4b6d3664296 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Searching for snapshots by: {'display_name~': 'tempest', 'display_description~': 'tempest'} {{(pid=98329) _get_all_snapshots /opt/stack/manila/manila/share/api.py:2349}} May 28 13:03:20 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-825d6fb4-4890-426b-9389-c4b6d3664296 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] http://10.27.203.238/share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/snapshots/detail?name~=tempest&description~=tempest returned with HTTP 200 May 28 13:03:20 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1333/2645] 10.27.203.238 () {64 vars in 1439 bytes} [Tue May 28 13:03:20 2024] GET /share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/snapshots/detail?name~=tempest&description~=tempest => generated 749 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:03:20 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-0585371e-6900-40b2-911a-9a0e1a199315 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] GET http://10.27.203.238/share/v1/718814c61c8c40e7bf78dd9d84d3b1f1/snapshots/detail?sort_key=share_id&sort_dir=asc May 28 13:03:20 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-0585371e-6900-40b2-911a-9a0e1a199315 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:03:20 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-0585371e-6900-40b2-911a-9a0e1a199315 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Calling method 'ShareSnapshotMixin.detail' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:03:20 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.common [None req-0585371e-6900-40b2-911a-9a0e1a199315 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Removing options '' from query {{(pid=98330) remove_invalid_options /opt/stack/manila/manila/api/common.py:441}} May 28 13:03:20 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.share.api [None req-0585371e-6900-40b2-911a-9a0e1a199315 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Searching for snapshots by: {} {{(pid=98330) _get_all_snapshots /opt/stack/manila/manila/share/api.py:2349}} May 28 13:03:20 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-0585371e-6900-40b2-911a-9a0e1a199315 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] http://10.27.203.238/share/v1/718814c61c8c40e7bf78dd9d84d3b1f1/snapshots/detail?sort_key=share_id&sort_dir=asc returned with HTTP 200 May 28 13:03:20 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1313/2646] 10.27.203.238 () {62 vars in 1388 bytes} [Tue May 28 13:03:20 2024] GET /share/v1/718814c61c8c40e7bf78dd9d84d3b1f1/snapshots/detail?sort_key=share_id&sort_dir=asc => generated 636 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:03:20 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-beeaf9ef-7bf8-41a7-b45a-3dc5feb56029 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] GET http://10.27.203.238/share/v1/718814c61c8c40e7bf78dd9d84d3b1f1/snapshots/detail?description=tempest-tempest-snapshot-description-854300103 May 28 13:03:20 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-beeaf9ef-7bf8-41a7-b45a-3dc5feb56029 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:03:20 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-beeaf9ef-7bf8-41a7-b45a-3dc5feb56029 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Calling method 'ShareSnapshotMixin.detail' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:03:20 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.common [None req-beeaf9ef-7bf8-41a7-b45a-3dc5feb56029 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Removing options '' from query {{(pid=98329) remove_invalid_options /opt/stack/manila/manila/api/common.py:441}} May 28 13:03:20 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.share.api [None req-beeaf9ef-7bf8-41a7-b45a-3dc5feb56029 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Searching for snapshots by: {} {{(pid=98329) _get_all_snapshots /opt/stack/manila/manila/share/api.py:2349}} May 28 13:03:20 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-beeaf9ef-7bf8-41a7-b45a-3dc5feb56029 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] http://10.27.203.238/share/v1/718814c61c8c40e7bf78dd9d84d3b1f1/snapshots/detail returned with HTTP 200 May 28 13:03:20 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1334/2647] 10.27.203.238 () {62 vars in 1444 bytes} [Tue May 28 13:03:20 2024] GET /share/v1/718814c61c8c40e7bf78dd9d84d3b1f1/snapshots/detail?description=tempest-tempest-snapshot-description-854300103 => generated 636 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:03:20 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-03099d6d-fc93-49c3-a1c7-fdca4851d184 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] GET http://10.27.203.238/share/v1/718814c61c8c40e7bf78dd9d84d3b1f1/snapshots/detail?status=available&name=tempest-tempest-snapshot-name-917194267 May 28 13:03:20 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-03099d6d-fc93-49c3-a1c7-fdca4851d184 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:03:20 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-03099d6d-fc93-49c3-a1c7-fdca4851d184 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Calling method 'ShareSnapshotMixin.detail' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:03:20 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.common [None req-03099d6d-fc93-49c3-a1c7-fdca4851d184 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Removing options '' from query {{(pid=98330) remove_invalid_options /opt/stack/manila/manila/api/common.py:441}} May 28 13:03:20 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.share.api [None req-03099d6d-fc93-49c3-a1c7-fdca4851d184 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Searching for snapshots by: {'status': 'available', 'display_name': 'tempest-tempest-snapshot-name-917194267'} {{(pid=98330) _get_all_snapshots /opt/stack/manila/manila/share/api.py:2349}} May 28 13:03:20 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-03099d6d-fc93-49c3-a1c7-fdca4851d184 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] http://10.27.203.238/share/v1/718814c61c8c40e7bf78dd9d84d3b1f1/snapshots/detail?status=available&name=tempest-tempest-snapshot-name-917194267 returned with HTTP 200 May 28 13:03:20 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1314/2648] 10.27.203.238 () {62 vars in 1450 bytes} [Tue May 28 13:03:20 2024] GET /share/v1/718814c61c8c40e7bf78dd9d84d3b1f1/snapshots/detail?status=available&name=tempest-tempest-snapshot-name-917194267 => generated 636 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:03:20 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-a4c081d7-721e-400a-96fa-cca54b929ea9 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] GET http://10.27.203.238/share/v1/718814c61c8c40e7bf78dd9d84d3b1f1/snapshots/detail?limit=1&offset=1&share_id=f4d62492-698d-44ff-a5f4-f6b156775dbd May 28 13:03:20 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-a4c081d7-721e-400a-96fa-cca54b929ea9 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:03:20 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-a4c081d7-721e-400a-96fa-cca54b929ea9 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Calling method 'ShareSnapshotMixin.detail' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:03:20 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.common [None req-a4c081d7-721e-400a-96fa-cca54b929ea9 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Removing options '' from query {{(pid=98329) remove_invalid_options /opt/stack/manila/manila/api/common.py:441}} May 28 13:03:20 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.share.api [None req-a4c081d7-721e-400a-96fa-cca54b929ea9 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Searching for snapshots by: {'share_id': 'f4d62492-698d-44ff-a5f4-f6b156775dbd'} {{(pid=98329) _get_all_snapshots /opt/stack/manila/manila/share/api.py:2349}} May 28 13:03:20 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-a4c081d7-721e-400a-96fa-cca54b929ea9 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] http://10.27.203.238/share/v1/718814c61c8c40e7bf78dd9d84d3b1f1/snapshots/detail?limit=1&offset=1&share_id=f4d62492-698d-44ff-a5f4-f6b156775dbd returned with HTTP 200 May 28 13:03:20 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1335/2649] 10.27.203.238 () {62 vars in 1452 bytes} [Tue May 28 13:03:20 2024] GET /share/v1/718814c61c8c40e7bf78dd9d84d3b1f1/snapshots/detail?limit=1&offset=1&share_id=f4d62492-698d-44ff-a5f4-f6b156775dbd => generated 17 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 229 bytes (1 switches on core 0) May 28 13:03:20 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-bce04868-6913-4dd2-a242-1cec696d67fc tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] GET http://10.27.203.238/share/v1/718814c61c8c40e7bf78dd9d84d3b1f1/snapshots/detail?limit=0&offset=1&share_id=f4d62492-698d-44ff-a5f4-f6b156775dbd May 28 13:03:20 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-bce04868-6913-4dd2-a242-1cec696d67fc tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:03:20 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-bce04868-6913-4dd2-a242-1cec696d67fc tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Calling method 'ShareSnapshotMixin.detail' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:03:20 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.common [None req-bce04868-6913-4dd2-a242-1cec696d67fc tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Removing options '' from query {{(pid=98330) remove_invalid_options /opt/stack/manila/manila/api/common.py:441}} May 28 13:03:20 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.share.api [None req-bce04868-6913-4dd2-a242-1cec696d67fc tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Searching for snapshots by: {'share_id': 'f4d62492-698d-44ff-a5f4-f6b156775dbd'} {{(pid=98330) _get_all_snapshots /opt/stack/manila/manila/share/api.py:2349}} May 28 13:03:20 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-bce04868-6913-4dd2-a242-1cec696d67fc tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] http://10.27.203.238/share/v1/718814c61c8c40e7bf78dd9d84d3b1f1/snapshots/detail?limit=0&offset=1&share_id=f4d62492-698d-44ff-a5f4-f6b156775dbd returned with HTTP 200 May 28 13:03:20 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1315/2650] 10.27.203.238 () {62 vars in 1452 bytes} [Tue May 28 13:03:20 2024] GET /share/v1/718814c61c8c40e7bf78dd9d84d3b1f1/snapshots/detail?limit=0&offset=1&share_id=f4d62492-698d-44ff-a5f4-f6b156775dbd => generated 17 bytes in 31 msecs (HTTP/1.1 200) 6 headers in 229 bytes (1 switches on core 0) May 28 13:03:20 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-b05746c4-3d08-4da5-b68c-c572a33f6171 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] GET http://10.27.203.238/share/v1/718814c61c8c40e7bf78dd9d84d3b1f1/snapshots/detail?limit=1&offset=0&share_id=f4d62492-698d-44ff-a5f4-f6b156775dbd May 28 13:03:20 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-b05746c4-3d08-4da5-b68c-c572a33f6171 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:03:20 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-b05746c4-3d08-4da5-b68c-c572a33f6171 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Calling method 'ShareSnapshotMixin.detail' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:03:20 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.common [None req-b05746c4-3d08-4da5-b68c-c572a33f6171 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Removing options '' from query {{(pid=98329) remove_invalid_options /opt/stack/manila/manila/api/common.py:441}} May 28 13:03:20 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.share.api [None req-b05746c4-3d08-4da5-b68c-c572a33f6171 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Searching for snapshots by: {'share_id': 'f4d62492-698d-44ff-a5f4-f6b156775dbd'} {{(pid=98329) _get_all_snapshots /opt/stack/manila/manila/share/api.py:2349}} May 28 13:03:20 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-b05746c4-3d08-4da5-b68c-c572a33f6171 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] http://10.27.203.238/share/v1/718814c61c8c40e7bf78dd9d84d3b1f1/snapshots/detail?limit=1&offset=0&share_id=f4d62492-698d-44ff-a5f4-f6b156775dbd returned with HTTP 200 May 28 13:03:20 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1336/2651] 10.27.203.238 () {62 vars in 1452 bytes} [Tue May 28 13:03:20 2024] GET /share/v1/718814c61c8c40e7bf78dd9d84d3b1f1/snapshots/detail?limit=1&offset=0&share_id=f4d62492-698d-44ff-a5f4-f6b156775dbd => generated 871 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:03:20 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-8cddab97-a94d-44c8-b90e-af0fe2b6b2e3 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] POST http://10.27.203.238/share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares May 28 13:03:20 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-8cddab97-a94d-44c8-b90e-af0fe2b6b2e3 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share": {"share_proto": "nfs", "description": "Tempest's share", "snapshot_id": null, "name": "tempest-tempest-created-share-165413618", "size": 2, "metadata": {}, "is_public": false, "share_type": "49315d96-de20-4c8a-ac49-f57e8d1b1e18"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:03:20 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.v1.shares [None req-8cddab97-a94d-44c8-b90e-af0fe2b6b2e3 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Create NFS share of 2 GB May 28 13:03:20 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.quota [None req-8cddab97-a94d-44c8-b90e-af0fe2b6b2e3 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Created reservations ['d6f5d7c2-b1a6-4df2-aae9-1dcd3efe18a0', '878bc96a-05b1-447d-b409-9be51f43f639', '8a204117-907b-4f7b-8e9a-bc2bbd89e28d', '4dce03be-f493-4420-b556-791d1d5c85b1'] {{(pid=98330) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 13:03:20 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.quota [None req-8cddab97-a94d-44c8-b90e-af0fe2b6b2e3 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Committed reservations ['d6f5d7c2-b1a6-4df2-aae9-1dcd3efe18a0', '878bc96a-05b1-447d-b409-9be51f43f639', '8a204117-907b-4f7b-8e9a-bc2bbd89e28d', '4dce03be-f493-4420-b556-791d1d5c85b1'] {{(pid=98330) commit /opt/stack/manila/manila/quota.py:1063}} May 28 13:03:20 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.host_manager [None req-8cddab97-a94d-44c8-b90e-af0fe2b6b2e3 tempest-SharesActionsTest-682704550 None] Share service is down. (host: l75lg1-v1@generic2). May 28 13:03:20 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.host_manager [None req-8cddab97-a94d-44c8-b90e-af0fe2b6b2e3 tempest-SharesActionsTest-682704550 None] Share service is down. (host: l75lg1-v1@generic1). May 28 13:03:21 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-8cddab97-a94d-44c8-b90e-af0fe2b6b2e3 tempest-SharesActionsTest-682704550 None] Starting with 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:80}} May 28 13:03:21 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-8cddab97-a94d-44c8-b90e-af0fe2b6b2e3 tempest-SharesActionsTest-682704550 None] Filter OnlyHostFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:03:21 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-8cddab97-a94d-44c8-b90e-af0fe2b6b2e3 tempest-SharesActionsTest-682704550 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:03:21 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.capacity [None req-8cddab97-a94d-44c8-b90e-af0fe2b6b2e3 tempest-SharesActionsTest-682704550 None] Space information for share creation on host l75lg1-v1@vast#vast (requested / avail): 2/2079 {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/capacity.py:83}} May 28 13:03:21 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-8cddab97-a94d-44c8-b90e-af0fe2b6b2e3 tempest-SharesActionsTest-682704550 None] Filter CapacityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:03:21 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-8cddab97-a94d-44c8-b90e-af0fe2b6b2e3 tempest-SharesActionsTest-682704550 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:03:21 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-8cddab97-a94d-44c8-b90e-af0fe2b6b2e3 tempest-SharesActionsTest-682704550 None] Driver Filter: Checking host 'l75lg1-v1@vast#vast' {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:37}} May 28 13:03:21 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-8cddab97-a94d-44c8-b90e-af0fe2b6b2e3 tempest-SharesActionsTest-682704550 None] Filter function not set :: passing host. {{(pid=98327) _check_filter_function /opt/stack/manila/manila/scheduler/filters/driver.py:53}} May 28 13:03:21 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-8cddab97-a94d-44c8-b90e-af0fe2b6b2e3 tempest-SharesActionsTest-682704550 None] Result: True {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:40}} May 28 13:03:21 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-8cddab97-a94d-44c8-b90e-af0fe2b6b2e3 tempest-SharesActionsTest-682704550 None] Done checking host 'l75lg1-v1@vast#vast' {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:41}} May 28 13:03:21 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-8cddab97-a94d-44c8-b90e-af0fe2b6b2e3 tempest-SharesActionsTest-682704550 None] Filter DriverFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:03:21 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-8cddab97-a94d-44c8-b90e-af0fe2b6b2e3 tempest-SharesActionsTest-682704550 None] Filter ShareReplicationFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:03:21 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-8cddab97-a94d-44c8-b90e-af0fe2b6b2e3 tempest-SharesActionsTest-682704550 None] Filter CreateFromSnapshotFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:03:21 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-8cddab97-a94d-44c8-b90e-af0fe2b6b2e3 tempest-SharesActionsTest-682704550 None] Filter AffinityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:03:21 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-8cddab97-a94d-44c8-b90e-af0fe2b6b2e3 tempest-SharesActionsTest-682704550 None] Filter AntiAffinityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:03:21 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.drivers.filter [None req-8cddab97-a94d-44c8-b90e-af0fe2b6b2e3 tempest-SharesActionsTest-682704550 None] Filtered share [host: 'l75lg1-v1@vast#vast', free_capacity_gb: 2079.6009807521477, pools: None] {{(pid=98327) _schedule_share /opt/stack/manila/manila/scheduler/drivers/filter.py:268}} May 28 13:03:21 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-8cddab97-a94d-44c8-b90e-af0fe2b6b2e3 tempest-SharesActionsTest-682704550 None] Checking host 'l75lg1-v1@vast#vast' {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:46}} May 28 13:03:21 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.weighers.goodness [None req-8cddab97-a94d-44c8-b90e-af0fe2b6b2e3 tempest-SharesActionsTest-682704550 None] Goodness function not set :: defaulting to minimal goodness rating of 0. May 28 13:03:21 l75lg1-v1 manila-scheduler[98327]: INFO manila.scheduler.weighers.goodness [None req-8cddab97-a94d-44c8-b90e-af0fe2b6b2e3 tempest-SharesActionsTest-682704550 None] Goodness function result for host l75lg1-v1@vast#vast: 0. May 28 13:03:21 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-8cddab97-a94d-44c8-b90e-af0fe2b6b2e3 tempest-SharesActionsTest-682704550 None] Goodness: 0 {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:48}} May 28 13:03:21 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-8cddab97-a94d-44c8-b90e-af0fe2b6b2e3 tempest-SharesActionsTest-682704550 None] Done checking host 'l75lg1-v1@vast#vast' {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:49}} May 28 13:03:21 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.drivers.filter [None req-8cddab97-a94d-44c8-b90e-af0fe2b6b2e3 tempest-SharesActionsTest-682704550 None] Choosing for share: WeighedHost [host: l75lg1-v1@vast#vast, weight: 0.0] {{(pid=98327) _schedule_share /opt/stack/manila/manila/scheduler/drivers/filter.py:274}} May 28 13:03:21 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-8cddab97-a94d-44c8-b90e-af0fe2b6b2e3 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] http://10.27.203.238/share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares returned with HTTP 200 May 28 13:03:21 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1316/2652] 10.27.203.238 () {66 vars in 1362 bytes} [Tue May 28 13:03:20 2024] POST /share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares => generated 1310 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:03:21 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-cc6a0d00-0b12-4ee4-acef-6c5c9713d021 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] GET http://10.27.203.238/share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/e10fb578-872e-4ea5-a1b6-7d62768dba7a May 28 13:03:21 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-cc6a0d00-0b12-4ee4-acef-6c5c9713d021 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:03:21 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-cc6a0d00-0b12-4ee4-acef-6c5c9713d021 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:03:21 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-cc6a0d00-0b12-4ee4-acef-6c5c9713d021 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] http://10.27.203.238/share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/e10fb578-872e-4ea5-a1b6-7d62768dba7a returned with HTTP 200 May 28 13:03:21 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1337/2653] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:03:21 2024] GET /share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/e10fb578-872e-4ea5-a1b6-7d62768dba7a => generated 1310 bytes in 27 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:03:21 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8cddab97-a94d-44c8-b90e-af0fe2b6b2e3 tempest-SharesActionsTest-682704550 None] >>> [GET] https://127.0.0.1:40443/api/vippools/ May 28 13:03:21 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8cddab97-a94d-44c8-b90e-af0fe2b6b2e3 tempest-SharesActionsTest-682704550 None] {'allow_redirects': True, 'params': {'name': 'vippool-1'}} May 28 13:03:21 l75lg1-v1 dstat.sh[49771]: 28-05 13:03:21| 10 1 88 2 0|5514M 1902M 278M 7930M| 14k 12k| 0 996k| 0 145 |4782 7339 |0.86 1.08 1.04|1.0 0 0| 0 0 | 0 2048M| 29 361 0 34 4 May 28 13:03:21 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8cddab97-a94d-44c8-b90e-af0fe2b6b2e3 tempest-SharesActionsTest-682704550 None] <<< [GET] https://127.0.0.1:40443/api/vippools/ May 28 13:03:21 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8cddab97-a94d-44c8-b90e-af0fe2b6b2e3 tempest-SharesActionsTest-682704550 None] [Bunch(active_cnode_ids=[], active_interfaces=4, cluster='loop75-kfs', cluster_id=1, cnode_ids=[], cnodes=[], domain_name='vippool-1', enable_l3=False, enable_weighted_balancing=False, enabled=True, end_ip='172.21.75.4', guid='f2abaede-b397-413a-8faa-3aeead6d3b28', gw_ip='', gw_ipv6='', id=2, ip_ranges=[['172.21.75.1', '172.21.75.4']], name='vippool-1', peer_asn=0, port_membership='ALL', ranges_summary='172.21.75.[1-4]', role='PROTOCOLS', start_ip='172.21.75.1', subnet_cidr=16, subnet_cidr_ipv6=None, sync='SYNCED', sync_time='2024-05-28T12:50:09.644123Z', tenant_id=1, tenant_name='default', title='172.21.75.1 - 172.21.75.4', url='https://127.0.0.1:40443/api/vippools/2/', vast_asn=0, vlan=0, vms_preferred=False)] May 28 13:03:21 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8cddab97-a94d-44c8-b90e-af0fe2b6b2e3 tempest-SharesActionsTest-682704550 None] --- [GET] https://127.0.0.1:40443/api/vippools/: Done May 28 13:03:21 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8cddab97-a94d-44c8-b90e-af0fe2b6b2e3 tempest-SharesActionsTest-682704550 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:03:21 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8cddab97-a94d-44c8-b90e-af0fe2b6b2e3 tempest-SharesActionsTest-682704550 None] {'allow_redirects': True, May 28 13:03:21 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8cddab97-a94d-44c8-b90e-af0fe2b6b2e3 tempest-SharesActionsTest-682704550 None] 'params': {'name': '78ce85ff-d5be-4675-96ea-da9166ff97fc'}} May 28 13:03:21 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8cddab97-a94d-44c8-b90e-af0fe2b6b2e3 tempest-SharesActionsTest-682704550 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:03:21 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8cddab97-a94d-44c8-b90e-af0fe2b6b2e3 tempest-SharesActionsTest-682704550 None] [] May 28 13:03:21 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8cddab97-a94d-44c8-b90e-af0fe2b6b2e3 tempest-SharesActionsTest-682704550 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 13:03:21 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8cddab97-a94d-44c8-b90e-af0fe2b6b2e3 tempest-SharesActionsTest-682704550 None] >>> [POST] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:03:21 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8cddab97-a94d-44c8-b90e-af0fe2b6b2e3 tempest-SharesActionsTest-682704550 None] {'data': '{"name": "78ce85ff-d5be-4675-96ea-da9166ff97fc"}', May 28 13:03:21 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8cddab97-a94d-44c8-b90e-af0fe2b6b2e3 tempest-SharesActionsTest-682704550 None] 'json': None, May 28 13:03:21 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8cddab97-a94d-44c8-b90e-af0fe2b6b2e3 tempest-SharesActionsTest-682704550 None] 'params': None} May 28 13:03:22 l75lg1-v1 dstat.sh[49771]: 28-05 13:03:22| 1 0 96 2 0|5514M 1902M 278M 7930M| 15k 1563B| 0 3995k| 0 315 |2966 4673 |0.79 1.06 1.04|1.0 0 0| 0 0 | 0 2048M| 29 361 0 34 4 May 28 13:03:22 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8cddab97-a94d-44c8-b90e-af0fe2b6b2e3 tempest-SharesActionsTest-682704550 None] <<< [POST] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:03:22 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8cddab97-a94d-44c8-b90e-af0fe2b6b2e3 tempest-SharesActionsTest-682704550 None] Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=0, created='2024-05-28T13:03:22.323976Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='28191c33-dc38-403d-bce0-6d68bd8eed5d', id=60, internal=False, is_s3_default_policy=False, name='78ce85ff-d5be-4675-96ea-da9166ff97fc', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=[], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['*'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['*'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T13:03:22.699129Z', tenant_id=1, tenant_name='default', title='78ce85ff-d5be-4675-96ea-da9166ff97fc', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/60/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[]) May 28 13:03:22 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8cddab97-a94d-44c8-b90e-af0fe2b6b2e3 tempest-SharesActionsTest-682704550 None] --- [POST] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 13:03:22 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8cddab97-a94d-44c8-b90e-af0fe2b6b2e3 tempest-SharesActionsTest-682704550 None] >>> [GET] https://127.0.0.1:40443/api/quotas/ May 28 13:03:22 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8cddab97-a94d-44c8-b90e-af0fe2b6b2e3 tempest-SharesActionsTest-682704550 None] {'allow_redirects': True, May 28 13:03:22 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8cddab97-a94d-44c8-b90e-af0fe2b6b2e3 tempest-SharesActionsTest-682704550 None] 'params': {'name': '78ce85ff-d5be-4675-96ea-da9166ff97fc'}} May 28 13:03:23 l75lg1-v1 dstat.sh[49771]: 28-05 13:03:23| 1 0 98 0 0|5514M 1902M 278M 7930M| 18k 736B| 0 316k| 0 37.0 |1898 3037 |0.79 1.06 1.04|1.0 0 0| 0 0 | 0 2048M| 29 361 0 34 4 May 28 13:03:23 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8cddab97-a94d-44c8-b90e-af0fe2b6b2e3 tempest-SharesActionsTest-682704550 None] <<< [GET] https://127.0.0.1:40443/api/quotas/ May 28 13:03:23 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8cddab97-a94d-44c8-b90e-af0fe2b6b2e3 tempest-SharesActionsTest-682704550 None] [] May 28 13:03:23 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8cddab97-a94d-44c8-b90e-af0fe2b6b2e3 tempest-SharesActionsTest-682704550 None] --- [GET] https://127.0.0.1:40443/api/quotas/: Done May 28 13:03:23 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8cddab97-a94d-44c8-b90e-af0fe2b6b2e3 tempest-SharesActionsTest-682704550 None] >>> [POST] https://127.0.0.1:40443/api/quotas/ May 28 13:03:23 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8cddab97-a94d-44c8-b90e-af0fe2b6b2e3 tempest-SharesActionsTest-682704550 None] {'data': '{"name": "78ce85ff-d5be-4675-96ea-da9166ff97fc", "path": ' May 28 13:03:23 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8cddab97-a94d-44c8-b90e-af0fe2b6b2e3 tempest-SharesActionsTest-682704550 None] '"/manila/manila-78ce85ff-d5be-4675-96ea-da9166ff97fc", "create_dir": ' May 28 13:03:23 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8cddab97-a94d-44c8-b90e-af0fe2b6b2e3 tempest-SharesActionsTest-682704550 None] 'true, "hard_limit": 2147483648}', May 28 13:03:23 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8cddab97-a94d-44c8-b90e-af0fe2b6b2e3 tempest-SharesActionsTest-682704550 None] 'json': None, May 28 13:03:23 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8cddab97-a94d-44c8-b90e-af0fe2b6b2e3 tempest-SharesActionsTest-682704550 None] 'params': None} May 28 13:03:24 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8cddab97-a94d-44c8-b90e-af0fe2b6b2e3 tempest-SharesActionsTest-682704550 None] <<< [POST] https://127.0.0.1:40443/api/quotas/ May 28 13:03:24 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8cddab97-a94d-44c8-b90e-af0fe2b6b2e3 tempest-SharesActionsTest-682704550 None] Bunch(cluster='loop75-kfs', cluster_id=1, default_email=None, default_group_quota=None, default_user_quota=None, enable_alarms=True, enable_email_providers=True, grace_period=None, group_quotas=[], guid='4100cf08-056f-42ce-893b-25f0204566e2', hard_limit=2147483648, hard_limit_inodes=None, id=57, internal=False, is_user_quota=False, last_user_quotas_update=None, name='78ce85ff-d5be-4675-96ea-da9166ff97fc', num_blocked_users=0, num_exceeded_users=0, path='/manila/manila-78ce85ff-d5be-4675-96ea-da9166ff97fc', percent_capacity=0, percent_inodes=None, pretty_grace_period=None, pretty_grace_period_expiration=None, pretty_state='OK (CREATED)', soft_limit=None, soft_limit_inodes=None, state='OK', sync_state='CREATED', system_id=57, tenant_id=1, tenant_name='default', time_to_block=None, title='78ce85ff-d5be-4675-96ea-da9166ff97fc', url='https://127.0.0.1:40443/api/quotas/57/', used_capacity=0, used_capacity_tb=0.0, used_effective_capacity=0, used_effective_capacity_tb=0.0, used_inodes=0, used_limited_capacity=0, user_quotas=[]) May 28 13:03:24 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8cddab97-a94d-44c8-b90e-af0fe2b6b2e3 tempest-SharesActionsTest-682704550 None] --- [POST] https://127.0.0.1:40443/api/quotas/: Done May 28 13:03:24 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8cddab97-a94d-44c8-b90e-af0fe2b6b2e3 tempest-SharesActionsTest-682704550 None] >>> [GET] https://127.0.0.1:40443/api/views/ May 28 13:03:24 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8cddab97-a94d-44c8-b90e-af0fe2b6b2e3 tempest-SharesActionsTest-682704550 None] {'allow_redirects': True, May 28 13:03:24 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8cddab97-a94d-44c8-b90e-af0fe2b6b2e3 tempest-SharesActionsTest-682704550 None] 'params': {'name': '78ce85ff-d5be-4675-96ea-da9166ff97fc'}} May 28 13:03:24 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-afc5fcd2-8b74-4d45-9367-b46eb5f6453e tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] GET http://10.27.203.238/share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/e10fb578-872e-4ea5-a1b6-7d62768dba7a May 28 13:03:24 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-afc5fcd2-8b74-4d45-9367-b46eb5f6453e tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:03:24 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-afc5fcd2-8b74-4d45-9367-b46eb5f6453e tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:03:24 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-afc5fcd2-8b74-4d45-9367-b46eb5f6453e tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] http://10.27.203.238/share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/e10fb578-872e-4ea5-a1b6-7d62768dba7a returned with HTTP 200 May 28 13:03:24 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1317/2654] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:03:24 2024] GET /share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/e10fb578-872e-4ea5-a1b6-7d62768dba7a => generated 1312 bytes in 25 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:03:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "_check_child_processes" by "neutron.agent.linux.external_process.ProcessMonitor._check_child_processes" {{(pid=76818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:03:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_concurrency.lockutils [-] Lock "_check_child_processes" acquired by "neutron.agent.linux.external_process.ProcessMonitor._check_child_processes" :: waited 0.000s {{(pid=76818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:03:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_concurrency.lockutils [-] Lock "_check_child_processes" "released" by "neutron.agent.linux.external_process.ProcessMonitor._check_child_processes" :: held 0.001s {{(pid=76818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:03:24 l75lg1-v1 dstat.sh[49771]: 28-05 13:03:24| 1 0 99 0 0|5514M 1902M 278M 7930M| 14k 1770B| 0 328k| 0 24.0 |1736 2763 |0.79 1.06 1.04|1.0 0 0| 0 0 | 0 2048M| 29 361 0 35 4 May 28 13:03:24 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8cddab97-a94d-44c8-b90e-af0fe2b6b2e3 tempest-SharesActionsTest-682704550 None] <<< [GET] https://127.0.0.1:40443/api/views/ May 28 13:03:24 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8cddab97-a94d-44c8-b90e-af0fe2b6b2e3 tempest-SharesActionsTest-682704550 None] [] May 28 13:03:24 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8cddab97-a94d-44c8-b90e-af0fe2b6b2e3 tempest-SharesActionsTest-682704550 None] --- [GET] https://127.0.0.1:40443/api/views/: Done May 28 13:03:24 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8cddab97-a94d-44c8-b90e-af0fe2b6b2e3 tempest-SharesActionsTest-682704550 None] >>> [POST] https://127.0.0.1:40443/api/views/ May 28 13:03:24 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8cddab97-a94d-44c8-b90e-af0fe2b6b2e3 tempest-SharesActionsTest-682704550 None] {'data': '{"name": "78ce85ff-d5be-4675-96ea-da9166ff97fc", "path": ' May 28 13:03:24 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8cddab97-a94d-44c8-b90e-af0fe2b6b2e3 tempest-SharesActionsTest-682704550 None] '"/manila/manila-78ce85ff-d5be-4675-96ea-da9166ff97fc", "policy_id": ' May 28 13:03:24 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8cddab97-a94d-44c8-b90e-af0fe2b6b2e3 tempest-SharesActionsTest-682704550 None] '60, "create_dir": true, "protocols": ["NFS"]}', May 28 13:03:24 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8cddab97-a94d-44c8-b90e-af0fe2b6b2e3 tempest-SharesActionsTest-682704550 None] 'json': None, May 28 13:03:24 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8cddab97-a94d-44c8-b90e-af0fe2b6b2e3 tempest-SharesActionsTest-682704550 None] 'params': None} May 28 13:03:25 l75lg1-v1 dstat.sh[49771]: 28-05 13:03:25| 1 0 98 0 0|5514M 1902M 278M 7930M| 12k 940B| 0 236k| 0 35.0 |1562 2529 |0.79 1.06 1.04|1.0 0 0| 0 0 | 0 2048M| 29 361 0 35 4 May 28 13:03:25 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8cddab97-a94d-44c8-b90e-af0fe2b6b2e3 tempest-SharesActionsTest-682704550 None] <<< [POST] https://127.0.0.1:40443/api/views/ May 28 13:03:25 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8cddab97-a94d-44c8-b90e-af0fe2b6b2e3 tempest-SharesActionsTest-682704550 None] Bunch(abac_tags=[], abe_max_depth=None, abe_protocols=[], alias='', allow_anonymous_access=False, allow_s3_anonymous_access=False, auto_commit='0d', bucket='', bucket_creators=[], bucket_creators_groups=[], bucket_owner=None, bulk_permission_update_progress=None, bulk_permission_update_state=None, cluster='loop75-kfs', cluster_id=1, created='2024-05-28T13:03:25.217657Z', enabled=True, files_retention_mode='NONE', guid='92b68ae0-f458-4ab1-933b-6e7751335b25', id=59, ignore_oos=False, internal=False, is_remote=False, is_seamless=False, logical_capacity=0, max_retention_period=None, min_retention_period=None, name='78ce85ff-d5be-4675-96ea-da9166ff97fc', nfs_interop_flags='BOTH_NFS3_AND_NFS4_INTEROP_DISABLED', path='/manila/manila-78ce85ff-d5be-4675-96ea-da9166ff97fc', physical_capacity=0, policy='78ce85ff-d5be-4675-96ea-da9166ff97fc', policy_id=60, protocols=['NFS'], qos_policy=None, qos_policy_id=None, s3_locks=False, s3_locks_retention_mode='NONE', s3_locks_retention_period='', s3_object_ownership_rule='ObjectWriter', s3_unverified_lookup=False, s3_versioning=False, select_for_live_monitoring=False, share='', share_acl=Bunch(acl=[], enabled=False), sync='SYNCED', sync_time='2024-05-28T13:03:25.491522Z', tenant_id=1, tenant_name='default', title='/manila/manila-78ce85ff-d5be-4675-96ea-da9166ff97fc', url='https://127.0.0.1:40443/api/views/59/') May 28 13:03:25 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8cddab97-a94d-44c8-b90e-af0fe2b6b2e3 tempest-SharesActionsTest-682704550 None] --- [POST] https://127.0.0.1:40443/api/views/: Done May 28 13:03:25 l75lg1-v1 manila-share[98474]: INFO manila.share.manager [None req-8cddab97-a94d-44c8-b90e-af0fe2b6b2e3 tempest-SharesActionsTest-682704550 None] Share instance 78ce85ff-d5be-4675-96ea-da9166ff97fc created successfully. May 28 13:03:25 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_service.periodic_task [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85846) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 13:03:25 l75lg1-v1 cinder-volume[85846]: DEBUG cinder.volume.drivers.lvm [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] Updating volume stats {{(pid=85846) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}} May 28 13:03:25 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:390}} May 28 13:03:25 l75lg1-v1 sudo[99256]: vastdata : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 May 28 13:03:25 l75lg1-v1 sudo[99256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) May 28 13:03:26 l75lg1-v1 sudo[99256]: pam_unix(sudo:session): session closed for user root May 28 13:03:26 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.471s {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:428}} May 28 13:03:26 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:390}} May 28 13:03:26 l75lg1-v1 sudo[99259]: vastdata : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 May 28 13:03:26 l75lg1-v1 sudo[99259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) May 28 13:03:26 l75lg1-v1 dstat.sh[49771]: 28-05 13:03:26| 5 1 94 0 0|5517M 1898M 278M 7930M| 16k 66B| 256k 168k|2.00 29.0 |2064 3153 |0.79 1.06 1.04|3.0 0 5.0| 0 0 | 0 2048M| 29 361 0 35 4 May 28 13:03:26 l75lg1-v1 sudo[99259]: pam_unix(sudo:session): session closed for user root May 28 13:03:26 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.462s {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:428}} May 28 13:03:26 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:390}} May 28 13:03:26 l75lg1-v1 sudo[99262]: vastdata : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool May 28 13:03:26 l75lg1-v1 sudo[99262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) May 28 13:03:27 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-c04f4a19-e172-4d82-83cd-dce1a6cd57f9 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] GET http://10.27.203.238/share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/e10fb578-872e-4ea5-a1b6-7d62768dba7a May 28 13:03:27 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-c04f4a19-e172-4d82-83cd-dce1a6cd57f9 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:03:27 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-c04f4a19-e172-4d82-83cd-dce1a6cd57f9 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:03:27 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-c04f4a19-e172-4d82-83cd-dce1a6cd57f9 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] http://10.27.203.238/share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/e10fb578-872e-4ea5-a1b6-7d62768dba7a returned with HTTP 200 May 28 13:03:27 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1338/2655] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:03:27 2024] GET /share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/e10fb578-872e-4ea5-a1b6-7d62768dba7a => generated 1315 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:03:27 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-be382e90-6a61-460d-84ed-4276415789b5 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] POST http://10.27.203.238/share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/e10fb578-872e-4ea5-a1b6-7d62768dba7a/action May 28 13:03:27 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-be382e90-6a61-460d-84ed-4276415789b5 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Action body: b'{"shrink": {"new_size": 1}}' {{(pid=98330) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 13:03:27 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-be382e90-6a61-460d-84ed-4276415789b5 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Action: 'action', calling method: Controller.__getattribute__..version_select, body: {"shrink": {"new_size": 1}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:03:27 l75lg1-v1 sudo[99262]: pam_unix(sudo:session): session closed for user root May 28 13:03:27 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.473s {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:428}} May 28 13:03:27 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:390}} May 28 13:03:27 l75lg1-v1 sudo[99311]: vastdata : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 May 28 13:03:27 l75lg1-v1 sudo[99311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) May 28 13:03:27 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.share.api [None req-be382e90-6a61-460d-84ed-4276415789b5 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Shrink share (id=e10fb578-872e-4ea5-a1b6-7d62768dba7a) request issued successfully. New size: 1 May 28 13:03:27 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-be382e90-6a61-460d-84ed-4276415789b5 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] http://10.27.203.238/share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/e10fb578-872e-4ea5-a1b6-7d62768dba7a/action returned with HTTP 202 May 28 13:03:27 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1318/2656] 10.27.203.238 () {66 vars in 1493 bytes} [Tue May 28 13:03:27 2024] POST /share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/e10fb578-872e-4ea5-a1b6-7d62768dba7a/action => generated 0 bytes in 62 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 13:03:27 l75lg1-v1 manila-share[98474]: DEBUG dbcounter [-] [98474] Writing DB stats manila:INSERT=24,manila:SELECT=371,manila:UPDATE=52 {{(pid=98474) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:03:27 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-fa6e99fe-2f6f-4503-8122-bc99aee3cd34 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] GET http://10.27.203.238/share/v1/718814c61c8c40e7bf78dd9d84d3b1f1/shares/e10fb578-872e-4ea5-a1b6-7d62768dba7a May 28 13:03:27 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-fa6e99fe-2f6f-4503-8122-bc99aee3cd34 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:03:27 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-fa6e99fe-2f6f-4503-8122-bc99aee3cd34 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:03:27 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-fa6e99fe-2f6f-4503-8122-bc99aee3cd34 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] http://10.27.203.238/share/v1/718814c61c8c40e7bf78dd9d84d3b1f1/shares/e10fb578-872e-4ea5-a1b6-7d62768dba7a returned with HTTP 200 May 28 13:03:27 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1339/2657] 10.27.203.238 () {62 vars in 1408 bytes} [Tue May 28 13:03:27 2024] GET /share/v1/718814c61c8c40e7bf78dd9d84d3b1f1/shares/e10fb578-872e-4ea5-a1b6-7d62768dba7a => generated 897 bytes in 28 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:03:27 l75lg1-v1 dstat.sh[49771]: 28-05 13:03:27| 13 2 84 0 0|5515M 1900M 278M 7930M| 12k 0 | 640k 520k|5.00 52.0 |3691 5569 |1.05 1.11 1.05|4.0 1.0 52| 0 0 | 0 2048M| 29 361 0 36 4 May 28 13:03:27 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-be382e90-6a61-460d-84ed-4276415789b5 tempest-SharesActionsTest-682704550 None] Created reservations ['5b2e3d56-b903-47bb-a274-d58cd8637292', '29644478-cc5d-4523-9621-ab76fdfbef17'] {{(pid=98474) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 13:03:27 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-be382e90-6a61-460d-84ed-4276415789b5 tempest-SharesActionsTest-682704550 None] >>> [GET] https://127.0.0.1:40443/api/quotas/ May 28 13:03:27 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-be382e90-6a61-460d-84ed-4276415789b5 tempest-SharesActionsTest-682704550 None] {'allow_redirects': True, May 28 13:03:27 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-be382e90-6a61-460d-84ed-4276415789b5 tempest-SharesActionsTest-682704550 None] 'params': {'name': '78ce85ff-d5be-4675-96ea-da9166ff97fc'}} May 28 13:03:27 l75lg1-v1 sudo[99311]: pam_unix(sudo:session): session closed for user root May 28 13:03:27 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.455s {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:428}} May 28 13:03:27 l75lg1-v1 cinder-volume[85846]: DEBUG cinder.manager [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] Notifying Schedulers of capabilities ... {{(pid=85846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 28 13:03:27 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.scheduler.host_manager [None req-209beeb0-a7b3-4f8d-adb5-7a4d56e60a42 None None] Received volume service update from l75lg1-v1@lvmdriver-1: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:l75lg1-v1:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up', 'allocated_capacity_gb': 0, 'cacheable': True}], 'shared_targets': False, 'sparse_copy_volume': True, 'filter_function': None, 'goodness_function': None} {{(pid=85128) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:628}} May 28 13:03:27 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-be382e90-6a61-460d-84ed-4276415789b5 tempest-SharesActionsTest-682704550 None] <<< [GET] https://127.0.0.1:40443/api/quotas/ May 28 13:03:27 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-be382e90-6a61-460d-84ed-4276415789b5 tempest-SharesActionsTest-682704550 None] [Bunch(cluster='loop75-kfs', cluster_id=1, default_email=None, default_group_quota=None, default_user_quota=None, enable_alarms=True, enable_email_providers=True, grace_period=None, guid='4100cf08-056f-42ce-893b-25f0204566e2', hard_limit=2147483648, hard_limit_inodes=None, id=57, internal=False, is_user_quota=False, last_user_quotas_update=None, name='78ce85ff-d5be-4675-96ea-da9166ff97fc', num_blocked_users=0, num_exceeded_users=0, path='/manila/manila-78ce85ff-d5be-4675-96ea-da9166ff97fc', percent_capacity=0, percent_inodes=None, pretty_grace_period=None, pretty_grace_period_expiration=None, pretty_state='OK (CREATED)', soft_limit=None, soft_limit_inodes=None, state='OK', sync_state='CREATED', system_id=57, tenant_id=1, tenant_name='default', time_to_block=None, title='78ce85ff-d5be-4675-96ea-da9166ff97fc', url='https://127.0.0.1:40443/api/quotas/57/', used_capacity=0, used_capacity_tb=0.0, used_effective_capacity=0, used_effective_capacity_tb=0.0, used_inodes=0, used_limited_capacity=0)] May 28 13:03:27 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-be382e90-6a61-460d-84ed-4276415789b5 tempest-SharesActionsTest-682704550 None] --- [GET] https://127.0.0.1:40443/api/quotas/: Done May 28 13:03:27 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-be382e90-6a61-460d-84ed-4276415789b5 tempest-SharesActionsTest-682704550 None] >>> [PATCH] https://127.0.0.1:40443/api/quotas/57/ May 28 13:03:27 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-be382e90-6a61-460d-84ed-4276415789b5 tempest-SharesActionsTest-682704550 None] {'data': '{"hard_limit": 1073741824}', 'params': None} May 28 13:03:28 l75lg1-v1 dstat.sh[49771]: 28-05 13:03:28| 4 1 94 1 0|5514M 1901M 278M 7930M| 13k 1647B| 256k 472k|2.00 72.0 |2712 3985 |1.05 1.11 1.05|1.0 0 9.0| 0 0 | 0 2048M| 29 361 0 35 4 May 28 13:03:29 l75lg1-v1 dstat.sh[49771]: 28-05 13:03:29| 1 0 99 0 0|5515M 1901M 278M 7930M| 18k 0 | 0 3600k| 0 551 |1740 2540 |1.05 1.11 1.05|1.0 0 0| 0 0 | 0 2048M| 29 361 0 35 4 May 28 13:03:29 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-be382e90-6a61-460d-84ed-4276415789b5 tempest-SharesActionsTest-682704550 None] <<< [PATCH] https://127.0.0.1:40443/api/quotas/57/ May 28 13:03:29 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-be382e90-6a61-460d-84ed-4276415789b5 tempest-SharesActionsTest-682704550 None] Bunch(cluster='loop75-kfs', cluster_id=1, default_email=None, default_group_quota=None, default_user_quota=None, enable_alarms=True, enable_email_providers=True, grace_period=None, group_quotas=[], guid='4100cf08-056f-42ce-893b-25f0204566e2', hard_limit=1073741824, hard_limit_inodes=None, id=57, internal=False, is_user_quota=False, last_user_quotas_update=None, name='78ce85ff-d5be-4675-96ea-da9166ff97fc', num_blocked_users=0, num_exceeded_users=0, path='/manila/manila-78ce85ff-d5be-4675-96ea-da9166ff97fc', percent_capacity=0, percent_inodes=None, pretty_grace_period=None, pretty_grace_period_expiration=None, pretty_state='OK (CREATED)', soft_limit=None, soft_limit_inodes=None, state='OK', sync_state='CREATED', system_id=57, tenant_id=1, tenant_name='default', time_to_block=None, title='78ce85ff-d5be-4675-96ea-da9166ff97fc', url='https://127.0.0.1:40443/api/quotas/57/', used_capacity=0, used_capacity_tb=0.0, used_effective_capacity=0, used_effective_capacity_tb=0.0, used_inodes=0, used_limited_capacity=0, user_quotas=[]) May 28 13:03:29 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-be382e90-6a61-460d-84ed-4276415789b5 tempest-SharesActionsTest-682704550 None] --- [PATCH] https://127.0.0.1:40443/api/quotas/57/: Done May 28 13:03:29 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-be382e90-6a61-460d-84ed-4276415789b5 tempest-SharesActionsTest-682704550 None] Committed reservations ['5b2e3d56-b903-47bb-a274-d58cd8637292', '29644478-cc5d-4523-9621-ab76fdfbef17'] {{(pid=98474) commit /opt/stack/manila/manila/quota.py:1063}} May 28 13:03:29 l75lg1-v1 manila-share[98474]: INFO manila.share.manager [None req-be382e90-6a61-460d-84ed-4276415789b5 tempest-SharesActionsTest-682704550 None] Shrink share completed successfully. May 28 13:03:30 l75lg1-v1 nova-conductor[83648]: DEBUG dbcounter [-] [83648] Writing DB stats nova_cell1:SELECT=1 {{(pid=83648) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:03:30 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-1470a0b6-95f2-4056-853f-6436f1a2da36 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] GET http://10.27.203.238/share/v1/718814c61c8c40e7bf78dd9d84d3b1f1/shares/e10fb578-872e-4ea5-a1b6-7d62768dba7a May 28 13:03:30 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-1470a0b6-95f2-4056-853f-6436f1a2da36 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:03:30 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-1470a0b6-95f2-4056-853f-6436f1a2da36 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:03:30 l75lg1-v1 devstack@m-api.service[98330]: DEBUG dbcounter [-] [98330] Writing DB stats manila:SELECT=512,manila:INSERT=41,manila:UPDATE=54 {{(pid=98330) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:03:30 l75lg1-v1 dstat.sh[49771]: 28-05 13:03:30| 1 0 97 1 0|5514M 1901M 278M 7930M| 19k 66B| 0 564k| 0 78.0 |2397 3856 |1.05 1.11 1.05|2.0 1.0 0| 0 0 | 0 2048M| 29 362 0 35 4 May 28 13:03:30 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-1470a0b6-95f2-4056-853f-6436f1a2da36 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] http://10.27.203.238/share/v1/718814c61c8c40e7bf78dd9d84d3b1f1/shares/e10fb578-872e-4ea5-a1b6-7d62768dba7a returned with HTTP 200 May 28 13:03:30 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1319/2658] 10.27.203.238 () {62 vars in 1408 bytes} [Tue May 28 13:03:30 2024] GET /share/v1/718814c61c8c40e7bf78dd9d84d3b1f1/shares/e10fb578-872e-4ea5-a1b6-7d62768dba7a => generated 962 bytes in 30 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:03:30 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-0cfe6229-c015-4b97-9d2e-80a09fb00515 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] GET http://10.27.203.238/share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/e10fb578-872e-4ea5-a1b6-7d62768dba7a May 28 13:03:30 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-0cfe6229-c015-4b97-9d2e-80a09fb00515 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:03:30 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-0cfe6229-c015-4b97-9d2e-80a09fb00515 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:03:30 l75lg1-v1 devstack@m-api.service[98329]: DEBUG dbcounter [-] [98329] Writing DB stats manila:SELECT=583,manila:INSERT=51,manila:UPDATE=93 {{(pid=98329) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:03:30 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-0cfe6229-c015-4b97-9d2e-80a09fb00515 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] http://10.27.203.238/share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/e10fb578-872e-4ea5-a1b6-7d62768dba7a returned with HTTP 200 May 28 13:03:30 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1340/2659] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:03:30 2024] GET /share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/e10fb578-872e-4ea5-a1b6-7d62768dba7a => generated 1315 bytes in 26 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:03:30 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-62121da2-adfd-47a6-b42f-c29ff950118a tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] GET http://10.27.203.238/share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/share-replicas/detail?share_id=e10fb578-872e-4ea5-a1b6-7d62768dba7a May 28 13:03:30 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-62121da2-adfd-47a6-b42f-c29ff950118a tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:03:30 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-62121da2-adfd-47a6-b42f-c29ff950118a tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:03:30 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-62121da2-adfd-47a6-b42f-c29ff950118a tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] http://10.27.203.238/share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/share-replicas/detail?share_id=e10fb578-872e-4ea5-a1b6-7d62768dba7a returned with HTTP 200 May 28 13:03:30 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1320/2660] 10.27.203.238 () {64 vars in 1476 bytes} [Tue May 28 13:03:30 2024] GET /share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/share-replicas/detail?share_id=e10fb578-872e-4ea5-a1b6-7d62768dba7a => generated 22 bytes in 12 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:03:30 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-d79ff20e-4221-4714-8083-59c4a54719d5 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] DELETE http://10.27.203.238/share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/e10fb578-872e-4ea5-a1b6-7d62768dba7a May 28 13:03:30 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-d79ff20e-4221-4714-8083-59c4a54719d5 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:03:30 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-d79ff20e-4221-4714-8083-59c4a54719d5 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Calling method 'ShareMixin.delete' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:03:30 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.v1.shares [None req-d79ff20e-4221-4714-8083-59c4a54719d5 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Delete share with id: e10fb578-872e-4ea5-a1b6-7d62768dba7a May 28 13:03:30 l75lg1-v1 neutron-server[77618]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.HashRingHealthCheckPeriodics.touch_hash_ring_nodes' {{(pid=77618) _process_scheduled /opt/stack/data/venv/lib/python3.10/site-packages/futurist/periodics.py:638}} May 28 13:03:30 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-d79ff20e-4221-4714-8083-59c4a54719d5 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] http://10.27.203.238/share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/e10fb578-872e-4ea5-a1b6-7d62768dba7a returned with HTTP 202 May 28 13:03:30 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1341/2661] 10.27.203.238 () {64 vars in 1454 bytes} [Tue May 28 13:03:30 2024] DELETE /share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/e10fb578-872e-4ea5-a1b6-7d62768dba7a => generated 0 bytes in 133 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 13:03:30 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-26e8185b-9458-4a79-b734-e1561612f20e tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] GET http://10.27.203.238/share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/e10fb578-872e-4ea5-a1b6-7d62768dba7a May 28 13:03:30 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-26e8185b-9458-4a79-b734-e1561612f20e tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:03:30 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-26e8185b-9458-4a79-b734-e1561612f20e tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:03:30 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-26e8185b-9458-4a79-b734-e1561612f20e tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] http://10.27.203.238/share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/e10fb578-872e-4ea5-a1b6-7d62768dba7a returned with HTTP 200 May 28 13:03:30 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1321/2662] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:03:30 2024] GET /share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/e10fb578-872e-4ea5-a1b6-7d62768dba7a => generated 1314 bytes in 28 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:03:30 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-d79ff20e-4221-4714-8083-59c4a54719d5 tempest-SharesActionsTest-682704550 None] Acquiring lock "locked_access_rules_operation_by_share_instance_78ce85ff-d5be-4675-96ea-da9166ff97fc" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:03:30 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-d79ff20e-4221-4714-8083-59c4a54719d5 tempest-SharesActionsTest-682704550 None] Lock "locked_access_rules_operation_by_share_instance_78ce85ff-d5be-4675-96ea-da9166ff97fc" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:03:30 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-d79ff20e-4221-4714-8083-59c4a54719d5 tempest-SharesActionsTest-682704550 None] Lock "locked_access_rules_operation_by_share_instance_78ce85ff-d5be-4675-96ea-da9166ff97fc" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:03:30 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-d79ff20e-4221-4714-8083-59c4a54719d5 tempest-SharesActionsTest-682704550 None] Acquiring lock "locked_access_rules_operation_by_share_instance_78ce85ff-d5be-4675-96ea-da9166ff97fc" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:03:30 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-d79ff20e-4221-4714-8083-59c4a54719d5 tempest-SharesActionsTest-682704550 None] Lock "locked_access_rules_operation_by_share_instance_78ce85ff-d5be-4675-96ea-da9166ff97fc" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:03:30 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-d79ff20e-4221-4714-8083-59c4a54719d5 tempest-SharesActionsTest-682704550 None] Lock "locked_access_rules_operation_by_share_instance_78ce85ff-d5be-4675-96ea-da9166ff97fc" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:03:30 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-d79ff20e-4221-4714-8083-59c4a54719d5 tempest-SharesActionsTest-682704550 None] Acquiring lock "locked_access_rules_operation_by_share_instance_78ce85ff-d5be-4675-96ea-da9166ff97fc" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:03:30 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-d79ff20e-4221-4714-8083-59c4a54719d5 tempest-SharesActionsTest-682704550 None] Lock "locked_access_rules_operation_by_share_instance_78ce85ff-d5be-4675-96ea-da9166ff97fc" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:03:30 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-d79ff20e-4221-4714-8083-59c4a54719d5 tempest-SharesActionsTest-682704550 None] Lock "locked_access_rules_operation_by_share_instance_78ce85ff-d5be-4675-96ea-da9166ff97fc" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:03:30 l75lg1-v1 manila-share[98474]: DEBUG manila.share.access [None req-d79ff20e-4221-4714-8083-59c4a54719d5 tempest-SharesActionsTest-682704550 None] All access rules have been synced for share instance 78ce85ff-d5be-4675-96ea-da9166ff97fc belonging to share e10fb578-872e-4ea5-a1b6-7d62768dba7a. {{(pid=98474) update_access_rules /opt/stack/manila/manila/share/access.py:304}} May 28 13:03:30 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-d79ff20e-4221-4714-8083-59c4a54719d5 tempest-SharesActionsTest-682704550 None] deleting '/manila/manila-78ce85ff-d5be-4675-96ea-da9166ff97fc' May 28 13:03:30 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d79ff20e-4221-4714-8083-59c4a54719d5 tempest-SharesActionsTest-682704550 None] >>> [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/ May 28 13:03:30 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d79ff20e-4221-4714-8083-59c4a54719d5 tempest-SharesActionsTest-682704550 None] {'data': '{"path": "/manila/manila-78ce85ff-d5be-4675-96ea-da9166ff97fc"}', May 28 13:03:30 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d79ff20e-4221-4714-8083-59c4a54719d5 tempest-SharesActionsTest-682704550 None] 'params': None} May 28 13:03:30 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d79ff20e-4221-4714-8083-59c4a54719d5 tempest-SharesActionsTest-682704550 None] <<< [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/ May 28 13:03:30 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d79ff20e-4221-4714-8083-59c4a54719d5 tempest-SharesActionsTest-682704550 None] 'OK' May 28 13:03:30 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d79ff20e-4221-4714-8083-59c4a54719d5 tempest-SharesActionsTest-682704550 None] --- [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/: Done May 28 13:03:30 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d79ff20e-4221-4714-8083-59c4a54719d5 tempest-SharesActionsTest-682704550 None] >>> [GET] https://127.0.0.1:40443/api/views/ May 28 13:03:30 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d79ff20e-4221-4714-8083-59c4a54719d5 tempest-SharesActionsTest-682704550 None] {'allow_redirects': True, May 28 13:03:30 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d79ff20e-4221-4714-8083-59c4a54719d5 tempest-SharesActionsTest-682704550 None] 'params': {'name': '78ce85ff-d5be-4675-96ea-da9166ff97fc'}} May 28 13:03:30 l75lg1-v1 neutron-server[77622]: DEBUG futurist.periodics [None req-fbd03350-93f0-48b6-99af-923b4570b093 None None] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_for_inconsistencies' {{(pid=77622) _process_scheduled /opt/stack/data/venv/lib/python3.10/site-packages/futurist/periodics.py:638}} May 28 13:03:30 l75lg1-v1 neutron-server[77622]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-fbd03350-93f0-48b6-99af-923b4570b093 None None] Maintenance task: No inconsistencies found. Skipping {{(pid=77622) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:337}} May 28 13:03:30 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d79ff20e-4221-4714-8083-59c4a54719d5 tempest-SharesActionsTest-682704550 None] <<< [GET] https://127.0.0.1:40443/api/views/ May 28 13:03:30 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d79ff20e-4221-4714-8083-59c4a54719d5 tempest-SharesActionsTest-682704550 None] [Bunch(abac_tags=[], abe_max_depth=None, abe_protocols=[], alias='', allow_anonymous_access=False, allow_s3_anonymous_access=False, auto_commit='0d', bucket='', bucket_creators=[], bucket_creators_groups=[], bucket_owner=None, bulk_permission_update_progress=None, bulk_permission_update_state=None, cluster='loop75-kfs', cluster_id=1, created='2024-05-28T13:03:25.217657Z', enabled=True, files_retention_mode='NONE', guid='92b68ae0-f458-4ab1-933b-6e7751335b25', id=59, ignore_oos=False, internal=False, is_remote=False, is_seamless=False, logical_capacity=0, max_retention_period=None, min_retention_period=None, name='78ce85ff-d5be-4675-96ea-da9166ff97fc', nfs_interop_flags='BOTH_NFS3_AND_NFS4_INTEROP_DISABLED', path='/manila/manila-78ce85ff-d5be-4675-96ea-da9166ff97fc', physical_capacity=0, policy='78ce85ff-d5be-4675-96ea-da9166ff97fc', policy_id=60, protocols=['NFS'], qos_policy=None, qos_policy_id=None, s3_locks=False, s3_locks_retention_mode='NONE', s3_locks_retention_period='', s3_unverified_lookup=False, s3_versioning=False, select_for_live_monitoring=False, share='', share_acl=Bunch(acl=[], enabled=False), sync='SYNCED', sync_time='2024-05-28T13:03:25.491522Z', tenant_id=1, tenant_name='default', title='/manila/manila-78ce85ff-d5be-4675-96ea-da9166ff97fc', url='https://127.0.0.1:40443/api/views/59/')] May 28 13:03:30 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d79ff20e-4221-4714-8083-59c4a54719d5 tempest-SharesActionsTest-682704550 None] --- [GET] https://127.0.0.1:40443/api/views/: Done May 28 13:03:30 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d79ff20e-4221-4714-8083-59c4a54719d5 tempest-SharesActionsTest-682704550 None] >>> [DELETE] https://127.0.0.1:40443/api/views/59/ May 28 13:03:31 l75lg1-v1 neutron-server[77622]: DEBUG futurist.periodics [None req-fbd03350-93f0-48b6-99af-923b4570b093 None None] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.remove_duplicated_chassis_registers' {{(pid=77622) _process_scheduled /opt/stack/data/venv/lib/python3.10/site-packages/futurist/periodics.py:638}} May 28 13:03:31 l75lg1-v1 dstat.sh[49771]: 28-05 13:03:31| 4 0 94 1 0|5515M 1900M 278M 7930M| 16k 2234B| 0 1040k| 0 112 |2957 4689 |1.05 1.11 1.05| 0 0 0| 0 0 | 0 2048M| 29 361 0 35 4 May 28 13:03:32 l75lg1-v1 dstat.sh[49771]: 28-05 13:03:32| 1 0 98 0 0|5515M 1900M 278M 7930M| 13k 0 | 0 592k| 0 53.0 |2071 3283 |1.05 1.11 1.05|1.0 0 0| 0 0 | 0 2048M| 29 361 0 30 4 May 28 13:03:33 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d79ff20e-4221-4714-8083-59c4a54719d5 tempest-SharesActionsTest-682704550 None] <<< [DELETE] https://127.0.0.1:40443/api/views/59/ May 28 13:03:33 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d79ff20e-4221-4714-8083-59c4a54719d5 tempest-SharesActionsTest-682704550 None] --- [DELETE] https://127.0.0.1:40443/api/views/59/: Done May 28 13:03:33 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d79ff20e-4221-4714-8083-59c4a54719d5 tempest-SharesActionsTest-682704550 None] >>> [GET] https://127.0.0.1:40443/api/quotas/ May 28 13:03:33 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d79ff20e-4221-4714-8083-59c4a54719d5 tempest-SharesActionsTest-682704550 None] {'allow_redirects': True, May 28 13:03:33 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d79ff20e-4221-4714-8083-59c4a54719d5 tempest-SharesActionsTest-682704550 None] 'params': {'name': '78ce85ff-d5be-4675-96ea-da9166ff97fc'}} May 28 13:03:33 l75lg1-v1 dstat.sh[49771]: 28-05 13:03:33| 1 0 98 0 0|5515M 1900M 278M 7930M| 20k 842B| 0 360k| 0 37.0 |1992 3040 |0.96 1.09 1.05|1.0 0 0| 0 0 | 0 2048M| 29 361 0 30 4 May 28 13:03:33 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d79ff20e-4221-4714-8083-59c4a54719d5 tempest-SharesActionsTest-682704550 None] <<< [GET] https://127.0.0.1:40443/api/quotas/ May 28 13:03:33 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d79ff20e-4221-4714-8083-59c4a54719d5 tempest-SharesActionsTest-682704550 None] [Bunch(cluster='loop75-kfs', cluster_id=1, default_email=None, default_group_quota=None, default_user_quota=None, enable_alarms=True, enable_email_providers=True, grace_period=None, guid='4100cf08-056f-42ce-893b-25f0204566e2', hard_limit=1073741824, hard_limit_inodes=None, id=57, internal=False, is_user_quota=False, last_user_quotas_update=None, name='78ce85ff-d5be-4675-96ea-da9166ff97fc', num_blocked_users=0, num_exceeded_users=0, path='/manila/manila-78ce85ff-d5be-4675-96ea-da9166ff97fc', percent_capacity=0, percent_inodes=None, pretty_grace_period=None, pretty_grace_period_expiration=None, pretty_state='OK (CREATED)', soft_limit=None, soft_limit_inodes=None, state='OK', sync_state='CREATED', system_id=57, tenant_id=1, tenant_name='default', time_to_block=None, title='78ce85ff-d5be-4675-96ea-da9166ff97fc', url='https://127.0.0.1:40443/api/quotas/57/', used_capacity=0, used_capacity_tb=0.0, used_effective_capacity=0, used_effective_capacity_tb=0.0, used_inodes=0, used_limited_capacity=0)] May 28 13:03:33 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d79ff20e-4221-4714-8083-59c4a54719d5 tempest-SharesActionsTest-682704550 None] --- [GET] https://127.0.0.1:40443/api/quotas/: Done May 28 13:03:33 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d79ff20e-4221-4714-8083-59c4a54719d5 tempest-SharesActionsTest-682704550 None] >>> [DELETE] https://127.0.0.1:40443/api/quotas/57/ May 28 13:03:33 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-99781867-075b-4a5c-875b-faf8be55a8ae tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] GET http://10.27.203.238/share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/e10fb578-872e-4ea5-a1b6-7d62768dba7a May 28 13:03:33 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-99781867-075b-4a5c-875b-faf8be55a8ae tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:03:33 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-99781867-075b-4a5c-875b-faf8be55a8ae tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:03:33 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-99781867-075b-4a5c-875b-faf8be55a8ae tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] http://10.27.203.238/share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/e10fb578-872e-4ea5-a1b6-7d62768dba7a returned with HTTP 200 May 28 13:03:33 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1342/2663] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:03:33 2024] GET /share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/e10fb578-872e-4ea5-a1b6-7d62768dba7a => generated 1314 bytes in 24 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:03:34 l75lg1-v1 dstat.sh[49771]: 28-05 13:03:34| 1 0 99 0 0|5515M 1900M 278M 7930M| 16k 720B| 0 176k| 0 13.0 |1614 2486 |0.96 1.09 1.05|1.0 0 0| 0 0 | 0 2048M| 29 359 0 31 6 May 28 13:03:35 l75lg1-v1 dstat.sh[49771]: 28-05 13:03:35| 1 0 99 0 0|5515M 1900M 278M 7930M| 12k 0 | 0 0 | 0 0 |1533 2417 |0.96 1.09 1.05| 0 0 0| 0 0 | 0 2048M| 29 359 0 31 6 May 28 13:03:36 l75lg1-v1 dstat.sh[49771]: 28-05 13:03:36| 1 0 99 0 0|5515M 1900M 278M 7930M| 19k 238B| 0 4095B| 0 1.00 |1708 2595 |0.96 1.09 1.05| 0 0 0| 0 0 | 0 2048M| 29 357 0 22 8 May 28 13:03:36 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-774fc297-7b51-4fa3-a324-e38f25bc5098 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] GET http://10.27.203.238/share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/e10fb578-872e-4ea5-a1b6-7d62768dba7a May 28 13:03:36 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-774fc297-7b51-4fa3-a324-e38f25bc5098 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:03:36 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-774fc297-7b51-4fa3-a324-e38f25bc5098 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:03:36 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-774fc297-7b51-4fa3-a324-e38f25bc5098 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] http://10.27.203.238/share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/e10fb578-872e-4ea5-a1b6-7d62768dba7a returned with HTTP 200 May 28 13:03:36 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1322/2664] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:03:36 2024] GET /share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/e10fb578-872e-4ea5-a1b6-7d62768dba7a => generated 1314 bytes in 24 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:03:36 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d79ff20e-4221-4714-8083-59c4a54719d5 tempest-SharesActionsTest-682704550 None] <<< [DELETE] https://127.0.0.1:40443/api/quotas/57/ May 28 13:03:36 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d79ff20e-4221-4714-8083-59c4a54719d5 tempest-SharesActionsTest-682704550 None] --- [DELETE] https://127.0.0.1:40443/api/quotas/57/: Done May 28 13:03:36 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d79ff20e-4221-4714-8083-59c4a54719d5 tempest-SharesActionsTest-682704550 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:03:36 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d79ff20e-4221-4714-8083-59c4a54719d5 tempest-SharesActionsTest-682704550 None] {'allow_redirects': True, May 28 13:03:36 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d79ff20e-4221-4714-8083-59c4a54719d5 tempest-SharesActionsTest-682704550 None] 'params': {'name': '78ce85ff-d5be-4675-96ea-da9166ff97fc'}} May 28 13:03:37 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d79ff20e-4221-4714-8083-59c4a54719d5 tempest-SharesActionsTest-682704550 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:03:37 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d79ff20e-4221-4714-8083-59c4a54719d5 tempest-SharesActionsTest-682704550 None] [Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=0, created='2024-05-28T13:03:22.323976Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='28191c33-dc38-403d-bce0-6d68bd8eed5d', id=60, internal=False, is_s3_default_policy=False, name='78ce85ff-d5be-4675-96ea-da9166ff97fc', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=[], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['*'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['*'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T13:03:22.699129Z', tenant_id=1, tenant_name='default', title='78ce85ff-d5be-4675-96ea-da9166ff97fc', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/60/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[])] May 28 13:03:37 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d79ff20e-4221-4714-8083-59c4a54719d5 tempest-SharesActionsTest-682704550 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 13:03:37 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d79ff20e-4221-4714-8083-59c4a54719d5 tempest-SharesActionsTest-682704550 None] >>> [DELETE] https://127.0.0.1:40443/api/viewpolicies/60/ May 28 13:03:37 l75lg1-v1 dstat.sh[49771]: 28-05 13:03:37| 1 0 99 0 0|5515M 1900M 278M 7930M| 18k 1390B| 0 132k| 0 17.0 |1852 2776 |0.96 1.09 1.05| 0 0 0| 0 0 | 0 2048M| 29 357 0 22 8 May 28 13:03:38 l75lg1-v1 dstat.sh[49771]: 28-05 13:03:38| 1 0 99 0 0|5515M 1900M 278M 7930M| 12k 0 | 0 176k| 0 20.0 |1847 3006 |0.89 1.08 1.04|1.0 0 2.0| 0 0 | 0 2048M| 29 357 0 21 8 May 28 13:03:38 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d79ff20e-4221-4714-8083-59c4a54719d5 tempest-SharesActionsTest-682704550 None] <<< [DELETE] https://127.0.0.1:40443/api/viewpolicies/60/ May 28 13:03:38 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d79ff20e-4221-4714-8083-59c4a54719d5 tempest-SharesActionsTest-682704550 None] --- [DELETE] https://127.0.0.1:40443/api/viewpolicies/60/: Done May 28 13:03:38 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-d79ff20e-4221-4714-8083-59c4a54719d5 tempest-SharesActionsTest-682704550 None] Created reservations ['186faab8-1f74-4588-92e1-a781537d8f7a', 'afb95531-0391-425f-9f47-7f4626c3769d', '4f22d99b-da1e-4abb-a908-d1d35977a64c', '2b2915e0-db1a-4039-8889-2b6c69822a2f'] {{(pid=98474) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 13:03:38 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-d79ff20e-4221-4714-8083-59c4a54719d5 tempest-SharesActionsTest-682704550 None] Committed reservations ['186faab8-1f74-4588-92e1-a781537d8f7a', 'afb95531-0391-425f-9f47-7f4626c3769d', '4f22d99b-da1e-4abb-a908-d1d35977a64c', '2b2915e0-db1a-4039-8889-2b6c69822a2f'] {{(pid=98474) commit /opt/stack/manila/manila/quota.py:1063}} May 28 13:03:38 l75lg1-v1 manila-share[98474]: INFO manila.share.manager [None req-d79ff20e-4221-4714-8083-59c4a54719d5 tempest-SharesActionsTest-682704550 None] Share instance 78ce85ff-d5be-4675-96ea-da9166ff97fc: deleted successfully. May 28 13:03:39 l75lg1-v1 dstat.sh[49771]: 28-05 13:03:39| 1 0 97 1 0|5515M 1900M 278M 7930M| 13k 66B| 0 472k| 0 71.0 |2305 3672 |0.89 1.08 1.04|1.0 0 0| 0 0 | 0 2048M| 29 357 0 21 8 May 28 13:03:39 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-c8a4e355-2c85-4514-a62b-453b59d4c073 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] GET http://10.27.203.238/share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/e10fb578-872e-4ea5-a1b6-7d62768dba7a May 28 13:03:39 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-c8a4e355-2c85-4514-a62b-453b59d4c073 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:03:39 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-c8a4e355-2c85-4514-a62b-453b59d4c073 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:03:39 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-c8a4e355-2c85-4514-a62b-453b59d4c073 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] HTTP exception thrown: The resource could not be found. May 28 13:03:39 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-c8a4e355-2c85-4514-a62b-453b59d4c073 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] http://10.27.203.238/share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/e10fb578-872e-4ea5-a1b6-7d62768dba7a returned with HTTP 404 May 28 13:03:39 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1343/2665] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:03:39 2024] GET /share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/e10fb578-872e-4ea5-a1b6-7d62768dba7a => generated 78 bytes in 11 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 13:03:39 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-bfbf4d04-bd50-4aed-acfb-65502314a43d tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] POST http://10.27.203.238/share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares May 28 13:03:39 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-bfbf4d04-bd50-4aed-acfb-65502314a43d tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share": {"share_proto": "nfs", "description": "Tempest's share", "snapshot_id": null, "name": "tempest-tempest-created-share-1572301875", "size": 1, "metadata": {}, "is_public": false, "share_type": "49315d96-de20-4c8a-ac49-f57e8d1b1e18"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:03:39 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.v1.shares [None req-bfbf4d04-bd50-4aed-acfb-65502314a43d tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Create NFS share of 1 GB May 28 13:03:39 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.quota [None req-bfbf4d04-bd50-4aed-acfb-65502314a43d tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Created reservations ['112d097f-9913-4944-88d6-d2f2989a9a5a', 'cea6aa3f-d7f0-45c8-89b3-f654cf95dc02', '54229cdc-c49d-4f0c-ac45-d283acb8bc50', '203f85b9-6c75-4117-b688-82ecbd520676'] {{(pid=98330) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 13:03:39 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.quota [None req-bfbf4d04-bd50-4aed-acfb-65502314a43d tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Committed reservations ['112d097f-9913-4944-88d6-d2f2989a9a5a', 'cea6aa3f-d7f0-45c8-89b3-f654cf95dc02', '54229cdc-c49d-4f0c-ac45-d283acb8bc50', '203f85b9-6c75-4117-b688-82ecbd520676'] {{(pid=98330) commit /opt/stack/manila/manila/quota.py:1063}} May 28 13:03:39 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.host_manager [None req-bfbf4d04-bd50-4aed-acfb-65502314a43d tempest-SharesActionsTest-682704550 None] Share service is down. (host: l75lg1-v1@generic2). May 28 13:03:39 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.host_manager [None req-bfbf4d04-bd50-4aed-acfb-65502314a43d tempest-SharesActionsTest-682704550 None] Share service is down. (host: l75lg1-v1@generic1). May 28 13:03:39 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-bfbf4d04-bd50-4aed-acfb-65502314a43d tempest-SharesActionsTest-682704550 None] Starting with 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:80}} May 28 13:03:39 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-bfbf4d04-bd50-4aed-acfb-65502314a43d tempest-SharesActionsTest-682704550 None] Filter OnlyHostFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:03:39 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-bfbf4d04-bd50-4aed-acfb-65502314a43d tempest-SharesActionsTest-682704550 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:03:39 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.capacity [None req-bfbf4d04-bd50-4aed-acfb-65502314a43d tempest-SharesActionsTest-682704550 None] Space information for share creation on host l75lg1-v1@vast#vast (requested / avail): 1/2077 {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/capacity.py:83}} May 28 13:03:39 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-bfbf4d04-bd50-4aed-acfb-65502314a43d tempest-SharesActionsTest-682704550 None] Filter CapacityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:03:39 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-bfbf4d04-bd50-4aed-acfb-65502314a43d tempest-SharesActionsTest-682704550 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:03:39 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-bfbf4d04-bd50-4aed-acfb-65502314a43d tempest-SharesActionsTest-682704550 None] Driver Filter: Checking host 'l75lg1-v1@vast#vast' {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:37}} May 28 13:03:39 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-bfbf4d04-bd50-4aed-acfb-65502314a43d tempest-SharesActionsTest-682704550 None] Filter function not set :: passing host. {{(pid=98327) _check_filter_function /opt/stack/manila/manila/scheduler/filters/driver.py:53}} May 28 13:03:39 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-bfbf4d04-bd50-4aed-acfb-65502314a43d tempest-SharesActionsTest-682704550 None] Result: True {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:40}} May 28 13:03:39 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-bfbf4d04-bd50-4aed-acfb-65502314a43d tempest-SharesActionsTest-682704550 None] Done checking host 'l75lg1-v1@vast#vast' {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:41}} May 28 13:03:39 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-bfbf4d04-bd50-4aed-acfb-65502314a43d tempest-SharesActionsTest-682704550 None] Filter DriverFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:03:39 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-bfbf4d04-bd50-4aed-acfb-65502314a43d tempest-SharesActionsTest-682704550 None] Filter ShareReplicationFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:03:39 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-bfbf4d04-bd50-4aed-acfb-65502314a43d tempest-SharesActionsTest-682704550 None] Filter CreateFromSnapshotFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:03:39 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-bfbf4d04-bd50-4aed-acfb-65502314a43d tempest-SharesActionsTest-682704550 None] Filter AffinityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:03:39 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-bfbf4d04-bd50-4aed-acfb-65502314a43d tempest-SharesActionsTest-682704550 None] Filter AntiAffinityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:03:39 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.drivers.filter [None req-bfbf4d04-bd50-4aed-acfb-65502314a43d tempest-SharesActionsTest-682704550 None] Filtered share [host: 'l75lg1-v1@vast#vast', free_capacity_gb: 2077.6009807521477, pools: None] {{(pid=98327) _schedule_share /opt/stack/manila/manila/scheduler/drivers/filter.py:268}} May 28 13:03:39 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-bfbf4d04-bd50-4aed-acfb-65502314a43d tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] http://10.27.203.238/share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares returned with HTTP 200 May 28 13:03:39 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-bfbf4d04-bd50-4aed-acfb-65502314a43d tempest-SharesActionsTest-682704550 None] Checking host 'l75lg1-v1@vast#vast' {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:46}} May 28 13:03:39 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.weighers.goodness [None req-bfbf4d04-bd50-4aed-acfb-65502314a43d tempest-SharesActionsTest-682704550 None] Goodness function not set :: defaulting to minimal goodness rating of 0. May 28 13:03:39 l75lg1-v1 manila-scheduler[98327]: INFO manila.scheduler.weighers.goodness [None req-bfbf4d04-bd50-4aed-acfb-65502314a43d tempest-SharesActionsTest-682704550 None] Goodness function result for host l75lg1-v1@vast#vast: 0. May 28 13:03:39 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1323/2666] 10.27.203.238 () {66 vars in 1362 bytes} [Tue May 28 13:03:39 2024] POST /share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares => generated 1311 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:03:39 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-bfbf4d04-bd50-4aed-acfb-65502314a43d tempest-SharesActionsTest-682704550 None] Goodness: 0 {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:48}} May 28 13:03:39 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-bfbf4d04-bd50-4aed-acfb-65502314a43d tempest-SharesActionsTest-682704550 None] Done checking host 'l75lg1-v1@vast#vast' {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:49}} May 28 13:03:39 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.drivers.filter [None req-bfbf4d04-bd50-4aed-acfb-65502314a43d tempest-SharesActionsTest-682704550 None] Choosing for share: WeighedHost [host: l75lg1-v1@vast#vast, weight: 0.0] {{(pid=98327) _schedule_share /opt/stack/manila/manila/scheduler/drivers/filter.py:274}} May 28 13:03:39 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-2a05f4f2-5742-41cc-80ad-903d7495b323 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] GET http://10.27.203.238/share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/8b043109-1855-41f3-b131-fa3ffbe31cd6 May 28 13:03:39 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-2a05f4f2-5742-41cc-80ad-903d7495b323 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:03:39 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-2a05f4f2-5742-41cc-80ad-903d7495b323 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:03:39 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-2a05f4f2-5742-41cc-80ad-903d7495b323 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] http://10.27.203.238/share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/8b043109-1855-41f3-b131-fa3ffbe31cd6 returned with HTTP 200 May 28 13:03:39 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1344/2667] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:03:39 2024] GET /share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/8b043109-1855-41f3-b131-fa3ffbe31cd6 => generated 1311 bytes in 23 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:03:39 l75lg1-v1 nova-conductor[83647]: DEBUG dbcounter [-] [83647] Writing DB stats nova_cell1:SELECT=2,nova_cell1:UPDATE=1 {{(pid=83647) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:03:39 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bfbf4d04-bd50-4aed-acfb-65502314a43d tempest-SharesActionsTest-682704550 None] >>> [GET] https://127.0.0.1:40443/api/vippools/ May 28 13:03:39 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bfbf4d04-bd50-4aed-acfb-65502314a43d tempest-SharesActionsTest-682704550 None] {'allow_redirects': True, 'params': {'name': 'vippool-1'}} May 28 13:03:40 l75lg1-v1 nova-conductor[83648]: DEBUG dbcounter [-] [83648] Writing DB stats nova_cell1:SELECT=1 {{(pid=83648) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:03:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bfbf4d04-bd50-4aed-acfb-65502314a43d tempest-SharesActionsTest-682704550 None] <<< [GET] https://127.0.0.1:40443/api/vippools/ May 28 13:03:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bfbf4d04-bd50-4aed-acfb-65502314a43d tempest-SharesActionsTest-682704550 None] [Bunch(active_cnode_ids=[], active_interfaces=4, cluster='loop75-kfs', cluster_id=1, cnode_ids=[], cnodes=[], domain_name='vippool-1', enable_l3=False, enable_weighted_balancing=False, enabled=True, end_ip='172.21.75.4', guid='f2abaede-b397-413a-8faa-3aeead6d3b28', gw_ip='', gw_ipv6='', id=2, ip_ranges=[['172.21.75.1', '172.21.75.4']], name='vippool-1', peer_asn=0, port_membership='ALL', ranges_summary='172.21.75.[1-4]', role='PROTOCOLS', start_ip='172.21.75.1', subnet_cidr=16, subnet_cidr_ipv6=None, sync='SYNCED', sync_time='2024-05-28T12:50:09.644123Z', tenant_id=1, tenant_name='default', title='172.21.75.1 - 172.21.75.4', url='https://127.0.0.1:40443/api/vippools/2/', vast_asn=0, vlan=0, vms_preferred=False)] May 28 13:03:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bfbf4d04-bd50-4aed-acfb-65502314a43d tempest-SharesActionsTest-682704550 None] --- [GET] https://127.0.0.1:40443/api/vippools/: Done May 28 13:03:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bfbf4d04-bd50-4aed-acfb-65502314a43d tempest-SharesActionsTest-682704550 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:03:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bfbf4d04-bd50-4aed-acfb-65502314a43d tempest-SharesActionsTest-682704550 None] {'allow_redirects': True, May 28 13:03:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bfbf4d04-bd50-4aed-acfb-65502314a43d tempest-SharesActionsTest-682704550 None] 'params': {'name': '5f1c2f0c-5c08-4a06-bba7-cfd2e7a85e02'}} May 28 13:03:40 l75lg1-v1 dstat.sh[49771]: 28-05 13:03:40| 4 1 94 1 0|5515M 1900M 278M 7930M| 22k 5633B| 0 912k| 0 152 |3591 5749 |0.89 1.08 1.04|1.0 0 0| 0 0 | 0 2048M| 29 357 0 16 8 May 28 13:03:40 l75lg1-v1 neutron-server[77618]: DEBUG dbcounter [-] [77618] Writing DB stats neutron:UPDATE=1 {{(pid=77618) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:03:40 l75lg1-v1 neutron-server[77618]: DEBUG dbcounter [-] [77618] Writing DB stats neutron:SELECT=1 {{(pid=77618) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:03:40 l75lg1-v1 neutron-server[77623]: DEBUG dbcounter [-] [77623] Writing DB stats neutron:DELETE=1 {{(pid=77623) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:03:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bfbf4d04-bd50-4aed-acfb-65502314a43d tempest-SharesActionsTest-682704550 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:03:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bfbf4d04-bd50-4aed-acfb-65502314a43d tempest-SharesActionsTest-682704550 None] [] May 28 13:03:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bfbf4d04-bd50-4aed-acfb-65502314a43d tempest-SharesActionsTest-682704550 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 13:03:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bfbf4d04-bd50-4aed-acfb-65502314a43d tempest-SharesActionsTest-682704550 None] >>> [POST] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:03:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bfbf4d04-bd50-4aed-acfb-65502314a43d tempest-SharesActionsTest-682704550 None] {'data': '{"name": "5f1c2f0c-5c08-4a06-bba7-cfd2e7a85e02"}', May 28 13:03:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bfbf4d04-bd50-4aed-acfb-65502314a43d tempest-SharesActionsTest-682704550 None] 'json': None, May 28 13:03:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bfbf4d04-bd50-4aed-acfb-65502314a43d tempest-SharesActionsTest-682704550 None] 'params': None} May 28 13:03:40 l75lg1-v1 neutron-server[77622]: DEBUG dbcounter [-] [77622] Writing DB stats neutron:SELECT=1 {{(pid=77622) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:03:40 l75lg1-v1 neutron-server[77622]: DEBUG dbcounter [-] [77622] Writing DB stats neutron:SELECT=1 {{(pid=77622) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:03:41 l75lg1-v1 dstat.sh[49771]: 28-05 13:03:41| 1 0 98 0 0|5515M 1900M 278M 7930M| 17k 828B| 0 436k| 0 43.0 |1891 2829 |0.89 1.08 1.04|1.0 0 0| 0 0 | 0 2048M| 29 357 0 16 8 May 28 13:03:41 l75lg1-v1 neutron-server[77623]: DEBUG dbcounter [-] [77623] Writing DB stats neutron:SELECT=3 {{(pid=77623) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:03:41 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bfbf4d04-bd50-4aed-acfb-65502314a43d tempest-SharesActionsTest-682704550 None] <<< [POST] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:03:41 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bfbf4d04-bd50-4aed-acfb-65502314a43d tempest-SharesActionsTest-682704550 None] Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=0, created='2024-05-28T13:03:41.375861Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='8f614ca8-dafb-4fd3-b041-41fb8f0fcad2', id=61, internal=False, is_s3_default_policy=False, name='5f1c2f0c-5c08-4a06-bba7-cfd2e7a85e02', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=[], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['*'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['*'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T13:03:41.721341Z', tenant_id=1, tenant_name='default', title='5f1c2f0c-5c08-4a06-bba7-cfd2e7a85e02', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/61/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[]) May 28 13:03:41 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bfbf4d04-bd50-4aed-acfb-65502314a43d tempest-SharesActionsTest-682704550 None] --- [POST] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 13:03:41 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bfbf4d04-bd50-4aed-acfb-65502314a43d tempest-SharesActionsTest-682704550 None] >>> [GET] https://127.0.0.1:40443/api/quotas/ May 28 13:03:41 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bfbf4d04-bd50-4aed-acfb-65502314a43d tempest-SharesActionsTest-682704550 None] {'allow_redirects': True, May 28 13:03:41 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bfbf4d04-bd50-4aed-acfb-65502314a43d tempest-SharesActionsTest-682704550 None] 'params': {'name': '5f1c2f0c-5c08-4a06-bba7-cfd2e7a85e02'}} May 28 13:03:42 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bfbf4d04-bd50-4aed-acfb-65502314a43d tempest-SharesActionsTest-682704550 None] <<< [GET] https://127.0.0.1:40443/api/quotas/ May 28 13:03:42 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bfbf4d04-bd50-4aed-acfb-65502314a43d tempest-SharesActionsTest-682704550 None] [] May 28 13:03:42 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bfbf4d04-bd50-4aed-acfb-65502314a43d tempest-SharesActionsTest-682704550 None] --- [GET] https://127.0.0.1:40443/api/quotas/: Done May 28 13:03:42 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bfbf4d04-bd50-4aed-acfb-65502314a43d tempest-SharesActionsTest-682704550 None] >>> [POST] https://127.0.0.1:40443/api/quotas/ May 28 13:03:42 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bfbf4d04-bd50-4aed-acfb-65502314a43d tempest-SharesActionsTest-682704550 None] {'data': '{"name": "5f1c2f0c-5c08-4a06-bba7-cfd2e7a85e02", "path": ' May 28 13:03:42 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bfbf4d04-bd50-4aed-acfb-65502314a43d tempest-SharesActionsTest-682704550 None] '"/manila/manila-5f1c2f0c-5c08-4a06-bba7-cfd2e7a85e02", "create_dir": ' May 28 13:03:42 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bfbf4d04-bd50-4aed-acfb-65502314a43d tempest-SharesActionsTest-682704550 None] 'true, "hard_limit": 1073741824}', May 28 13:03:42 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bfbf4d04-bd50-4aed-acfb-65502314a43d tempest-SharesActionsTest-682704550 None] 'json': None, May 28 13:03:42 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bfbf4d04-bd50-4aed-acfb-65502314a43d tempest-SharesActionsTest-682704550 None] 'params': None} May 28 13:03:42 l75lg1-v1 dstat.sh[49771]: 28-05 13:03:42| 1 0 98 0 0|5515M 1900M 278M 7930M| 16k 1566B| 0 472k| 0 58.0 |2163 3362 |0.89 1.08 1.04|2.0 0 0| 0 0 | 0 2048M| 29 357 0 16 8 May 28 13:03:42 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-b3131a2e-acca-4beb-aedb-54559ef8529b tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] GET http://10.27.203.238/share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/8b043109-1855-41f3-b131-fa3ffbe31cd6 May 28 13:03:42 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-b3131a2e-acca-4beb-aedb-54559ef8529b tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:03:42 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-b3131a2e-acca-4beb-aedb-54559ef8529b tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:03:42 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-b3131a2e-acca-4beb-aedb-54559ef8529b tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] http://10.27.203.238/share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/8b043109-1855-41f3-b131-fa3ffbe31cd6 returned with HTTP 200 May 28 13:03:42 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1324/2668] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:03:42 2024] GET /share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/8b043109-1855-41f3-b131-fa3ffbe31cd6 => generated 1313 bytes in 28 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:03:43 l75lg1-v1 dstat.sh[49771]: 28-05 13:03:43| 1 0 97 1 0|5515M 1900M 278M 7930M| 20k 0 | 0 1564k| 0 101 |2232 3407 |0.82 1.06 1.04|1.0 0 0| 0 0 | 0 2048M| 29 357 0 16 8 May 28 13:03:43 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bfbf4d04-bd50-4aed-acfb-65502314a43d tempest-SharesActionsTest-682704550 None] <<< [POST] https://127.0.0.1:40443/api/quotas/ May 28 13:03:43 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bfbf4d04-bd50-4aed-acfb-65502314a43d tempest-SharesActionsTest-682704550 None] Bunch(cluster='loop75-kfs', cluster_id=1, default_email=None, default_group_quota=None, default_user_quota=None, enable_alarms=True, enable_email_providers=True, grace_period=None, group_quotas=[], guid='5438e1ff-c7d2-4eca-8448-84e97c439f8e', hard_limit=1073741824, hard_limit_inodes=None, id=58, internal=False, is_user_quota=False, last_user_quotas_update=None, name='5f1c2f0c-5c08-4a06-bba7-cfd2e7a85e02', num_blocked_users=0, num_exceeded_users=0, path='/manila/manila-5f1c2f0c-5c08-4a06-bba7-cfd2e7a85e02', percent_capacity=0, percent_inodes=None, pretty_grace_period=None, pretty_grace_period_expiration=None, pretty_state='OK (CREATED)', soft_limit=None, soft_limit_inodes=None, state='OK', sync_state='CREATED', system_id=58, tenant_id=1, tenant_name='default', time_to_block=None, title='5f1c2f0c-5c08-4a06-bba7-cfd2e7a85e02', url='https://127.0.0.1:40443/api/quotas/58/', used_capacity=0, used_capacity_tb=0.0, used_effective_capacity=0, used_effective_capacity_tb=0.0, used_inodes=0, used_limited_capacity=0, user_quotas=[]) May 28 13:03:43 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bfbf4d04-bd50-4aed-acfb-65502314a43d tempest-SharesActionsTest-682704550 None] --- [POST] https://127.0.0.1:40443/api/quotas/: Done May 28 13:03:43 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bfbf4d04-bd50-4aed-acfb-65502314a43d tempest-SharesActionsTest-682704550 None] >>> [GET] https://127.0.0.1:40443/api/views/ May 28 13:03:43 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bfbf4d04-bd50-4aed-acfb-65502314a43d tempest-SharesActionsTest-682704550 None] {'allow_redirects': True, May 28 13:03:43 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bfbf4d04-bd50-4aed-acfb-65502314a43d tempest-SharesActionsTest-682704550 None] 'params': {'name': '5f1c2f0c-5c08-4a06-bba7-cfd2e7a85e02'}} May 28 13:03:43 l75lg1-v1 neutron-server[77623]: DEBUG neutron.db.agents_db [None req-fe40ce8c-640e-4db7-a17a-6e8888cce266 None None] Agent healthcheck: found 0 active agents {{(pid=77623) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:319}} May 28 13:03:43 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bfbf4d04-bd50-4aed-acfb-65502314a43d tempest-SharesActionsTest-682704550 None] <<< [GET] https://127.0.0.1:40443/api/views/ May 28 13:03:43 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bfbf4d04-bd50-4aed-acfb-65502314a43d tempest-SharesActionsTest-682704550 None] [] May 28 13:03:43 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bfbf4d04-bd50-4aed-acfb-65502314a43d tempest-SharesActionsTest-682704550 None] --- [GET] https://127.0.0.1:40443/api/views/: Done May 28 13:03:43 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bfbf4d04-bd50-4aed-acfb-65502314a43d tempest-SharesActionsTest-682704550 None] >>> [POST] https://127.0.0.1:40443/api/views/ May 28 13:03:43 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bfbf4d04-bd50-4aed-acfb-65502314a43d tempest-SharesActionsTest-682704550 None] {'data': '{"name": "5f1c2f0c-5c08-4a06-bba7-cfd2e7a85e02", "path": ' May 28 13:03:43 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bfbf4d04-bd50-4aed-acfb-65502314a43d tempest-SharesActionsTest-682704550 None] '"/manila/manila-5f1c2f0c-5c08-4a06-bba7-cfd2e7a85e02", "policy_id": ' May 28 13:03:43 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bfbf4d04-bd50-4aed-acfb-65502314a43d tempest-SharesActionsTest-682704550 None] '61, "create_dir": true, "protocols": ["NFS"]}', May 28 13:03:43 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bfbf4d04-bd50-4aed-acfb-65502314a43d tempest-SharesActionsTest-682704550 None] 'json': None, May 28 13:03:43 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bfbf4d04-bd50-4aed-acfb-65502314a43d tempest-SharesActionsTest-682704550 None] 'params': None} May 28 13:03:44 l75lg1-v1 dstat.sh[49771]: 28-05 13:03:44| 1 0 98 0 0|5515M 1900M 278M 7930M| 18k 1848B| 0 1760k| 0 319 |1729 2664 |0.82 1.06 1.04|1.0 0 0| 0 0 | 0 2048M| 29 357 0 13 8 May 28 13:03:44 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bfbf4d04-bd50-4aed-acfb-65502314a43d tempest-SharesActionsTest-682704550 None] <<< [POST] https://127.0.0.1:40443/api/views/ May 28 13:03:44 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bfbf4d04-bd50-4aed-acfb-65502314a43d tempest-SharesActionsTest-682704550 None] Bunch(abac_tags=[], abe_max_depth=None, abe_protocols=[], alias='', allow_anonymous_access=False, allow_s3_anonymous_access=False, auto_commit='0d', bucket='', bucket_creators=[], bucket_creators_groups=[], bucket_owner=None, bulk_permission_update_progress=None, bulk_permission_update_state=None, cluster='loop75-kfs', cluster_id=1, created='2024-05-28T13:03:44.367576Z', enabled=True, files_retention_mode='NONE', guid='20465b64-4c21-47f6-8868-ccdf5d0632fb', id=60, ignore_oos=False, internal=False, is_remote=False, is_seamless=False, logical_capacity=0, max_retention_period=None, min_retention_period=None, name='5f1c2f0c-5c08-4a06-bba7-cfd2e7a85e02', nfs_interop_flags='BOTH_NFS3_AND_NFS4_INTEROP_DISABLED', path='/manila/manila-5f1c2f0c-5c08-4a06-bba7-cfd2e7a85e02', physical_capacity=0, policy='5f1c2f0c-5c08-4a06-bba7-cfd2e7a85e02', policy_id=61, protocols=['NFS'], qos_policy=None, qos_policy_id=None, s3_locks=False, s3_locks_retention_mode='NONE', s3_locks_retention_period='', s3_object_ownership_rule='ObjectWriter', s3_unverified_lookup=False, s3_versioning=False, select_for_live_monitoring=False, share='', share_acl=Bunch(acl=[], enabled=False), sync='SYNCED', sync_time='2024-05-28T13:03:44.717392Z', tenant_id=1, tenant_name='default', title='/manila/manila-5f1c2f0c-5c08-4a06-bba7-cfd2e7a85e02', url='https://127.0.0.1:40443/api/views/60/') May 28 13:03:44 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bfbf4d04-bd50-4aed-acfb-65502314a43d tempest-SharesActionsTest-682704550 None] --- [POST] https://127.0.0.1:40443/api/views/: Done May 28 13:03:44 l75lg1-v1 manila-share[98474]: INFO manila.share.manager [None req-bfbf4d04-bd50-4aed-acfb-65502314a43d tempest-SharesActionsTest-682704550 None] Share instance 5f1c2f0c-5c08-4a06-bba7-cfd2e7a85e02 created successfully. May 28 13:03:45 l75lg1-v1 dstat.sh[49771]: 28-05 13:03:45| 1 1 98 0 0|5516M 1900M 278M 7930M| 17k 66B| 0 304k| 0 48.0 |2031 3275 |0.82 1.06 1.04|1.0 0 0| 0 0 | 0 2048M| 29 357 0 13 8 May 28 13:03:45 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-de944e62-1b87-410b-b5db-f297ac6cb9c6 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] GET http://10.27.203.238/share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/8b043109-1855-41f3-b131-fa3ffbe31cd6 May 28 13:03:45 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-de944e62-1b87-410b-b5db-f297ac6cb9c6 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:03:45 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-de944e62-1b87-410b-b5db-f297ac6cb9c6 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:03:45 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-de944e62-1b87-410b-b5db-f297ac6cb9c6 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] http://10.27.203.238/share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/8b043109-1855-41f3-b131-fa3ffbe31cd6 returned with HTTP 200 May 28 13:03:45 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1345/2669] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:03:45 2024] GET /share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/8b043109-1855-41f3-b131-fa3ffbe31cd6 => generated 1316 bytes in 30 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:03:45 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-4314bd28-8fc0-405e-b632-8073be8ececb tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] GET http://10.27.203.238/share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares May 28 13:03:45 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-4314bd28-8fc0-405e-b632-8073be8ececb tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:03:45 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-4314bd28-8fc0-405e-b632-8073be8ececb tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:03:45 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.common [None req-4314bd28-8fc0-405e-b632-8073be8ececb tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Removing options '' from query {{(pid=98330) remove_invalid_options /opt/stack/manila/manila/api/common.py:441}} May 28 13:03:45 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.share.api [None req-4314bd28-8fc0-405e-b632-8073be8ececb tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Searching for shares by: {} {{(pid=98330) _get_all /opt/stack/manila/manila/share/api.py:2235}} May 28 13:03:45 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-4314bd28-8fc0-405e-b632-8073be8ececb tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] http://10.27.203.238/share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares returned with HTTP 200 May 28 13:03:45 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1325/2670] 10.27.203.238 () {64 vars in 1340 bytes} [Tue May 28 13:03:45 2024] GET /share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares => generated 773 bytes in 28 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:03:45 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-1d6a63bc-5ebb-40a9-8689-ea21a011addd tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] POST http://10.27.203.238/share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/8b043109-1855-41f3-b131-fa3ffbe31cd6/action May 28 13:03:45 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-1d6a63bc-5ebb-40a9-8689-ea21a011addd tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Action body: b'{"soft_delete": null}' {{(pid=98329) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 13:03:45 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-1d6a63bc-5ebb-40a9-8689-ea21a011addd tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Action: 'action', calling method: Controller.__getattribute__..version_select, body: {"soft_delete": null} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:03:45 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.v2.shares [None req-1d6a63bc-5ebb-40a9-8689-ea21a011addd tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Soft delete share with id: 8b043109-1855-41f3-b131-fa3ffbe31cd6 {{(pid=98329) share_soft_delete /opt/stack/manila/manila/api/v2/shares.py:280}} May 28 13:03:45 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-1d6a63bc-5ebb-40a9-8689-ea21a011addd tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] http://10.27.203.238/share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/8b043109-1855-41f3-b131-fa3ffbe31cd6/action returned with HTTP 202 May 28 13:03:45 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1346/2671] 10.27.203.238 () {66 vars in 1493 bytes} [Tue May 28 13:03:45 2024] POST /share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/8b043109-1855-41f3-b131-fa3ffbe31cd6/action => generated 0 bytes in 63 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 13:03:45 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-e455ae98-a2fc-4a46-8d1f-456573cdce57 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] GET http://10.27.203.238/share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/8b043109-1855-41f3-b131-fa3ffbe31cd6 May 28 13:03:45 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-e455ae98-a2fc-4a46-8d1f-456573cdce57 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:03:45 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-e455ae98-a2fc-4a46-8d1f-456573cdce57 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:03:45 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-e455ae98-a2fc-4a46-8d1f-456573cdce57 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] http://10.27.203.238/share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/8b043109-1855-41f3-b131-fa3ffbe31cd6 returned with HTTP 200 May 28 13:03:45 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1326/2672] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:03:45 2024] GET /share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/8b043109-1855-41f3-b131-fa3ffbe31cd6 => generated 1339 bytes in 24 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:03:45 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-79936ade-c66f-459a-80d1-c6754f9276d7 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] GET http://10.27.203.238/share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares May 28 13:03:45 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-79936ade-c66f-459a-80d1-c6754f9276d7 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:03:45 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-79936ade-c66f-459a-80d1-c6754f9276d7 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:03:45 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.common [None req-79936ade-c66f-459a-80d1-c6754f9276d7 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Removing options '' from query {{(pid=98329) remove_invalid_options /opt/stack/manila/manila/api/common.py:441}} May 28 13:03:45 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.share.api [None req-79936ade-c66f-459a-80d1-c6754f9276d7 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Searching for shares by: {} {{(pid=98329) _get_all /opt/stack/manila/manila/share/api.py:2235}} May 28 13:03:45 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-79936ade-c66f-459a-80d1-c6754f9276d7 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] http://10.27.203.238/share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares returned with HTTP 200 May 28 13:03:45 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1347/2673] 10.27.203.238 () {64 vars in 1340 bytes} [Tue May 28 13:03:45 2024] GET /share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares => generated 391 bytes in 25 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:03:45 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-2a17b92c-f3e8-422d-8b2b-9d87e32a3e80 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] GET http://10.27.203.238/share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares?is_soft_deleted=true May 28 13:03:45 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-2a17b92c-f3e8-422d-8b2b-9d87e32a3e80 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:03:45 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-2a17b92c-f3e8-422d-8b2b-9d87e32a3e80 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:03:45 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.common [None req-2a17b92c-f3e8-422d-8b2b-9d87e32a3e80 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Removing options '' from query {{(pid=98330) remove_invalid_options /opt/stack/manila/manila/api/common.py:441}} May 28 13:03:45 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.share.api [None req-2a17b92c-f3e8-422d-8b2b-9d87e32a3e80 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Searching for shares by: {'is_soft_deleted': True} {{(pid=98330) _get_all /opt/stack/manila/manila/share/api.py:2235}} May 28 13:03:46 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-2a17b92c-f3e8-422d-8b2b-9d87e32a3e80 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] http://10.27.203.238/share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares?is_soft_deleted=true returned with HTTP 200 May 28 13:03:46 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1327/2674] 10.27.203.238 () {64 vars in 1381 bytes} [Tue May 28 13:03:45 2024] GET /share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares?is_soft_deleted=true => generated 394 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:03:46 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-c9fab205-86f8-4255-9f3b-73da6e71d3e5 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] POST http://10.27.203.238/share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/8b043109-1855-41f3-b131-fa3ffbe31cd6/action May 28 13:03:46 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-c9fab205-86f8-4255-9f3b-73da6e71d3e5 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Action body: b'{"restore": null}' {{(pid=98329) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 13:03:46 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-c9fab205-86f8-4255-9f3b-73da6e71d3e5 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Action: 'action', calling method: Controller.__getattribute__..version_select, body: {"restore": null} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:03:46 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.v2.shares [None req-c9fab205-86f8-4255-9f3b-73da6e71d3e5 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Restore share with id: 8b043109-1855-41f3-b131-fa3ffbe31cd6 {{(pid=98329) share_restore /opt/stack/manila/manila/api/v2/shares.py:303}} May 28 13:03:46 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-c9fab205-86f8-4255-9f3b-73da6e71d3e5 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] http://10.27.203.238/share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/8b043109-1855-41f3-b131-fa3ffbe31cd6/action returned with HTTP 202 May 28 13:03:46 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1348/2675] 10.27.203.238 () {66 vars in 1493 bytes} [Tue May 28 13:03:46 2024] POST /share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/8b043109-1855-41f3-b131-fa3ffbe31cd6/action => generated 0 bytes in 53 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 13:03:46 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-3a3087c4-2993-4fe1-95a7-7295904f4c08 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] GET http://10.27.203.238/share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/8b043109-1855-41f3-b131-fa3ffbe31cd6 May 28 13:03:46 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-3a3087c4-2993-4fe1-95a7-7295904f4c08 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:03:46 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-3a3087c4-2993-4fe1-95a7-7295904f4c08 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:03:46 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-3a3087c4-2993-4fe1-95a7-7295904f4c08 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] http://10.27.203.238/share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/8b043109-1855-41f3-b131-fa3ffbe31cd6 returned with HTTP 200 May 28 13:03:46 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1328/2676] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:03:46 2024] GET /share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/8b043109-1855-41f3-b131-fa3ffbe31cd6 => generated 1316 bytes in 24 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:03:46 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-d2767e1e-d1b3-4b53-8015-449ca10f822a tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] GET http://10.27.203.238/share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares May 28 13:03:46 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-d2767e1e-d1b3-4b53-8015-449ca10f822a tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:03:46 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-d2767e1e-d1b3-4b53-8015-449ca10f822a tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:03:46 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.common [None req-d2767e1e-d1b3-4b53-8015-449ca10f822a tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Removing options '' from query {{(pid=98329) remove_invalid_options /opt/stack/manila/manila/api/common.py:441}} May 28 13:03:46 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.share.api [None req-d2767e1e-d1b3-4b53-8015-449ca10f822a tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Searching for shares by: {} {{(pid=98329) _get_all /opt/stack/manila/manila/share/api.py:2235}} May 28 13:03:46 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-d2767e1e-d1b3-4b53-8015-449ca10f822a tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] http://10.27.203.238/share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares returned with HTTP 200 May 28 13:03:46 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1349/2677] 10.27.203.238 () {64 vars in 1340 bytes} [Tue May 28 13:03:46 2024] GET /share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares => generated 773 bytes in 24 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:03:46 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-61151315-899b-42f1-b309-9b1518cadd07 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] GET http://10.27.203.238/share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares?is_soft_deleted=true May 28 13:03:46 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-61151315-899b-42f1-b309-9b1518cadd07 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:03:46 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-61151315-899b-42f1-b309-9b1518cadd07 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:03:46 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.common [None req-61151315-899b-42f1-b309-9b1518cadd07 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Removing options '' from query {{(pid=98330) remove_invalid_options /opt/stack/manila/manila/api/common.py:441}} May 28 13:03:46 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.share.api [None req-61151315-899b-42f1-b309-9b1518cadd07 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Searching for shares by: {'is_soft_deleted': True} {{(pid=98330) _get_all /opt/stack/manila/manila/share/api.py:2235}} May 28 13:03:46 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-61151315-899b-42f1-b309-9b1518cadd07 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] http://10.27.203.238/share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares?is_soft_deleted=true returned with HTTP 200 May 28 13:03:46 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1329/2678] 10.27.203.238 () {64 vars in 1381 bytes} [Tue May 28 13:03:46 2024] GET /share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares?is_soft_deleted=true => generated 14 bytes in 12 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e911560-ebec-4059-b745-ac399eee3eca service manila] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-9e911560-ebec-4059-b745-ac399eee3eca service manila] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e911560-ebec-4059-b745-ac399eee3eca service manila] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:03:46 l75lg1-v1 dstat.sh[49771]: 28-05 13:03:46| 5 0 94 0 0|5516M 1899M 278M 7930M| 15k 3844B| 0 444k| 0 50.0 |2989 4887 |0.82 1.06 1.04|1.0 0 0| 0 0 | 0 2048M| 29 358 0 13 8 May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e63cfc5-51a6-46d1-8733-12ee62907f2c tempest-SharesActionsTest-2125642311 tempest-SharesActionsTest-2125642311-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297c7d9ded9e4385b8d12b4e03a77bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '633b6f74527b48408dad0eedac73931e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e63cfc5-51a6-46d1-8733-12ee62907f2c tempest-SharesActionsTest-2125642311 tempest-SharesActionsTest-2125642311-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e63cfc5-51a6-46d1-8733-12ee62907f2c tempest-SharesActionsTest-2125642311 tempest-SharesActionsTest-2125642311-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e63cfc5-51a6-46d1-8733-12ee62907f2c tempest-SharesActionsTest-2125642311 tempest-SharesActionsTest-2125642311-project-admin] PATH_INFO: `/v3/users/8688f80695814f34bfb56342c4e54028` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e63cfc5-51a6-46d1-8733-12ee62907f2c tempest-SharesActionsTest-2125642311 tempest-SharesActionsTest-2125642311-project-admin] RBAC: Authorizing `identity:delete_user(user_id=8688f80695814f34bfb56342c4e54028)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e63cfc5-51a6-46d1-8733-12ee62907f2c tempest-SharesActionsTest-2125642311 tempest-SharesActionsTest-2125642311-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-9e63cfc5-51a6-46d1-8733-12ee62907f2c tempest-SharesActionsTest-2125642311 tempest-SharesActionsTest-2125642311-project-admin] Could not find user: 8688f80695814f34bfb56342c4e54028.: keystone.exception.UserNotFound: Could not find user: 8688f80695814f34bfb56342c4e54028. May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 8688f80695814f34bfb56342c4e54028. May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1803/3637] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:03:46 2024] DELETE /identity/v3/users/8688f80695814f34bfb56342c4e54028 => generated 110 bytes in 117 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3a93b4-c7a8-4403-b6c9-688e0137dc2c None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-7c3a93b4-c7a8-4403-b6c9-688e0137dc2c None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3a93b4-c7a8-4403-b6c9-688e0137dc2c None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94ab303-ce07-4a46-8bbf-e6a0e7b8ee54 tempest-SharesActionsTest-2125642311 tempest-SharesActionsTest-2125642311-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297c7d9ded9e4385b8d12b4e03a77bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '633b6f74527b48408dad0eedac73931e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94ab303-ce07-4a46-8bbf-e6a0e7b8ee54 tempest-SharesActionsTest-2125642311 tempest-SharesActionsTest-2125642311-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94ab303-ce07-4a46-8bbf-e6a0e7b8ee54 tempest-SharesActionsTest-2125642311 tempest-SharesActionsTest-2125642311-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94ab303-ce07-4a46-8bbf-e6a0e7b8ee54 tempest-SharesActionsTest-2125642311 tempest-SharesActionsTest-2125642311-project-admin] PATH_INFO: `/v3/users/108a25e436e9452a9a865957dcea1fc5` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94ab303-ce07-4a46-8bbf-e6a0e7b8ee54 tempest-SharesActionsTest-2125642311 tempest-SharesActionsTest-2125642311-project-admin] RBAC: Authorizing `identity:delete_user(user_id=108a25e436e9452a9a865957dcea1fc5)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94ab303-ce07-4a46-8bbf-e6a0e7b8ee54 tempest-SharesActionsTest-2125642311 tempest-SharesActionsTest-2125642311-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-b94ab303-ce07-4a46-8bbf-e6a0e7b8ee54 tempest-SharesActionsTest-2125642311 tempest-SharesActionsTest-2125642311-project-admin] Could not find user: 108a25e436e9452a9a865957dcea1fc5.: keystone.exception.UserNotFound: Could not find user: 108a25e436e9452a9a865957dcea1fc5. May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 108a25e436e9452a9a865957dcea1fc5. May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1835/3638] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:03:46 2024] DELETE /identity/v3/users/108a25e436e9452a9a865957dcea1fc5 => generated 110 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e63cfc5-51a6-46d1-8733-12ee62907f2c tempest-SharesActionsTest-2125642311 tempest-SharesActionsTest-2125642311-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e63cfc5-51a6-46d1-8733-12ee62907f2c tempest-SharesActionsTest-2125642311 tempest-SharesActionsTest-2125642311-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419cb4e8-74b8-432b-88fa-cefbe666b722 tempest-SharesActionsTest-2125642311 tempest-SharesActionsTest-2125642311-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297c7d9ded9e4385b8d12b4e03a77bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '633b6f74527b48408dad0eedac73931e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419cb4e8-74b8-432b-88fa-cefbe666b722 tempest-SharesActionsTest-2125642311 tempest-SharesActionsTest-2125642311-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419cb4e8-74b8-432b-88fa-cefbe666b722 tempest-SharesActionsTest-2125642311 tempest-SharesActionsTest-2125642311-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419cb4e8-74b8-432b-88fa-cefbe666b722 tempest-SharesActionsTest-2125642311 tempest-SharesActionsTest-2125642311-project-admin] PATH_INFO: `/v3/users/5ae5cb1db3504baaba1df93dc154a004` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419cb4e8-74b8-432b-88fa-cefbe666b722 tempest-SharesActionsTest-2125642311 tempest-SharesActionsTest-2125642311-project-admin] RBAC: Authorizing `identity:delete_user(user_id=5ae5cb1db3504baaba1df93dc154a004)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419cb4e8-74b8-432b-88fa-cefbe666b722 tempest-SharesActionsTest-2125642311 tempest-SharesActionsTest-2125642311-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-419cb4e8-74b8-432b-88fa-cefbe666b722 tempest-SharesActionsTest-2125642311 tempest-SharesActionsTest-2125642311-project-admin] Could not find user: 5ae5cb1db3504baaba1df93dc154a004.: keystone.exception.UserNotFound: Could not find user: 5ae5cb1db3504baaba1df93dc154a004. May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 5ae5cb1db3504baaba1df93dc154a004. May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1804/3639] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:03:46 2024] DELETE /identity/v3/users/5ae5cb1db3504baaba1df93dc154a004 => generated 110 bytes in 25 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94ab303-ce07-4a46-8bbf-e6a0e7b8ee54 tempest-SharesActionsTest-2125642311 tempest-SharesActionsTest-2125642311-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94ab303-ce07-4a46-8bbf-e6a0e7b8ee54 tempest-SharesActionsTest-2125642311 tempest-SharesActionsTest-2125642311-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec78ff5b-6433-4462-8e0d-493a01d4011f tempest-SharesActionsTest-2125642311 tempest-SharesActionsTest-2125642311-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297c7d9ded9e4385b8d12b4e03a77bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '633b6f74527b48408dad0eedac73931e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec78ff5b-6433-4462-8e0d-493a01d4011f tempest-SharesActionsTest-2125642311 tempest-SharesActionsTest-2125642311-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec78ff5b-6433-4462-8e0d-493a01d4011f tempest-SharesActionsTest-2125642311 tempest-SharesActionsTest-2125642311-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec78ff5b-6433-4462-8e0d-493a01d4011f tempest-SharesActionsTest-2125642311 tempest-SharesActionsTest-2125642311-project-admin] PATH_INFO: `/v3/users/c2ac6ca3ea5a4ae498df6d12bb7caadc` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec78ff5b-6433-4462-8e0d-493a01d4011f tempest-SharesActionsTest-2125642311 tempest-SharesActionsTest-2125642311-project-admin] RBAC: Authorizing `identity:delete_user(user_id=c2ac6ca3ea5a4ae498df6d12bb7caadc)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec78ff5b-6433-4462-8e0d-493a01d4011f tempest-SharesActionsTest-2125642311 tempest-SharesActionsTest-2125642311-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-ec78ff5b-6433-4462-8e0d-493a01d4011f tempest-SharesActionsTest-2125642311 tempest-SharesActionsTest-2125642311-project-admin] Could not find user: c2ac6ca3ea5a4ae498df6d12bb7caadc.: keystone.exception.UserNotFound: Could not find user: c2ac6ca3ea5a4ae498df6d12bb7caadc. May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: c2ac6ca3ea5a4ae498df6d12bb7caadc. May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1836/3640] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:03:46 2024] DELETE /identity/v3/users/c2ac6ca3ea5a4ae498df6d12bb7caadc => generated 110 bytes in 27 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419cb4e8-74b8-432b-88fa-cefbe666b722 tempest-SharesActionsTest-2125642311 tempest-SharesActionsTest-2125642311-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419cb4e8-74b8-432b-88fa-cefbe666b722 tempest-SharesActionsTest-2125642311 tempest-SharesActionsTest-2125642311-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300a362e-73e9-4cda-af89-7e321cc3eedb tempest-SharesActionsTest-2125642311 tempest-SharesActionsTest-2125642311-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297c7d9ded9e4385b8d12b4e03a77bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '633b6f74527b48408dad0eedac73931e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300a362e-73e9-4cda-af89-7e321cc3eedb tempest-SharesActionsTest-2125642311 tempest-SharesActionsTest-2125642311-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300a362e-73e9-4cda-af89-7e321cc3eedb tempest-SharesActionsTest-2125642311 tempest-SharesActionsTest-2125642311-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300a362e-73e9-4cda-af89-7e321cc3eedb tempest-SharesActionsTest-2125642311 tempest-SharesActionsTest-2125642311-project-admin] PATH_INFO: `/v3/users/f89f851af36d480ab7d10d3506c60899` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300a362e-73e9-4cda-af89-7e321cc3eedb tempest-SharesActionsTest-2125642311 tempest-SharesActionsTest-2125642311-project-admin] RBAC: Authorizing `identity:delete_user(user_id=f89f851af36d480ab7d10d3506c60899)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300a362e-73e9-4cda-af89-7e321cc3eedb tempest-SharesActionsTest-2125642311 tempest-SharesActionsTest-2125642311-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-300a362e-73e9-4cda-af89-7e321cc3eedb tempest-SharesActionsTest-2125642311 tempest-SharesActionsTest-2125642311-project-admin] Could not find user: f89f851af36d480ab7d10d3506c60899.: keystone.exception.UserNotFound: Could not find user: f89f851af36d480ab7d10d3506c60899. May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: f89f851af36d480ab7d10d3506c60899. May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1805/3641] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:03:46 2024] DELETE /identity/v3/users/f89f851af36d480ab7d10d3506c60899 => generated 110 bytes in 26 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec78ff5b-6433-4462-8e0d-493a01d4011f tempest-SharesActionsTest-2125642311 tempest-SharesActionsTest-2125642311-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec78ff5b-6433-4462-8e0d-493a01d4011f tempest-SharesActionsTest-2125642311 tempest-SharesActionsTest-2125642311-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bddc3b-fe08-4257-909e-a317dd0e9649 tempest-SharesActionsTest-2125642311 tempest-SharesActionsTest-2125642311-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297c7d9ded9e4385b8d12b4e03a77bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '633b6f74527b48408dad0eedac73931e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bddc3b-fe08-4257-909e-a317dd0e9649 tempest-SharesActionsTest-2125642311 tempest-SharesActionsTest-2125642311-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bddc3b-fe08-4257-909e-a317dd0e9649 tempest-SharesActionsTest-2125642311 tempest-SharesActionsTest-2125642311-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bddc3b-fe08-4257-909e-a317dd0e9649 tempest-SharesActionsTest-2125642311 tempest-SharesActionsTest-2125642311-project-admin] PATH_INFO: `/v3/users/6886717a9cfb42a0a4142a0b982570ee` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bddc3b-fe08-4257-909e-a317dd0e9649 tempest-SharesActionsTest-2125642311 tempest-SharesActionsTest-2125642311-project-admin] RBAC: Authorizing `identity:delete_user(user_id=6886717a9cfb42a0a4142a0b982570ee)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bddc3b-fe08-4257-909e-a317dd0e9649 tempest-SharesActionsTest-2125642311 tempest-SharesActionsTest-2125642311-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-07bddc3b-fe08-4257-909e-a317dd0e9649 tempest-SharesActionsTest-2125642311 tempest-SharesActionsTest-2125642311-project-admin] Could not find user: 6886717a9cfb42a0a4142a0b982570ee.: keystone.exception.UserNotFound: Could not find user: 6886717a9cfb42a0a4142a0b982570ee. May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 6886717a9cfb42a0a4142a0b982570ee. May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1837/3642] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:03:46 2024] DELETE /identity/v3/users/6886717a9cfb42a0a4142a0b982570ee => generated 110 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300a362e-73e9-4cda-af89-7e321cc3eedb tempest-SharesActionsTest-2125642311 tempest-SharesActionsTest-2125642311-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300a362e-73e9-4cda-af89-7e321cc3eedb tempest-SharesActionsTest-2125642311 tempest-SharesActionsTest-2125642311-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2d0dc3-80dc-456e-9ac5-e6af618c05dc tempest-SharesActionsTest-2125642311 tempest-SharesActionsTest-2125642311-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297c7d9ded9e4385b8d12b4e03a77bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '633b6f74527b48408dad0eedac73931e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2d0dc3-80dc-456e-9ac5-e6af618c05dc tempest-SharesActionsTest-2125642311 tempest-SharesActionsTest-2125642311-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2d0dc3-80dc-456e-9ac5-e6af618c05dc tempest-SharesActionsTest-2125642311 tempest-SharesActionsTest-2125642311-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2d0dc3-80dc-456e-9ac5-e6af618c05dc tempest-SharesActionsTest-2125642311 tempest-SharesActionsTest-2125642311-project-admin] PATH_INFO: `/v3/users/b523155e680a4a14acd4f3a4295a8d26` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2d0dc3-80dc-456e-9ac5-e6af618c05dc tempest-SharesActionsTest-2125642311 tempest-SharesActionsTest-2125642311-project-admin] RBAC: Authorizing `identity:delete_user(user_id=b523155e680a4a14acd4f3a4295a8d26)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2d0dc3-80dc-456e-9ac5-e6af618c05dc tempest-SharesActionsTest-2125642311 tempest-SharesActionsTest-2125642311-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-eb2d0dc3-80dc-456e-9ac5-e6af618c05dc tempest-SharesActionsTest-2125642311 tempest-SharesActionsTest-2125642311-project-admin] Could not find user: b523155e680a4a14acd4f3a4295a8d26.: keystone.exception.UserNotFound: Could not find user: b523155e680a4a14acd4f3a4295a8d26. May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: b523155e680a4a14acd4f3a4295a8d26. May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1806/3643] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:03:46 2024] DELETE /identity/v3/users/b523155e680a4a14acd4f3a4295a8d26 => generated 110 bytes in 25 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bddc3b-fe08-4257-909e-a317dd0e9649 tempest-SharesActionsTest-2125642311 tempest-SharesActionsTest-2125642311-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bddc3b-fe08-4257-909e-a317dd0e9649 tempest-SharesActionsTest-2125642311 tempest-SharesActionsTest-2125642311-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f92dbb-d821-45f6-abd5-013744dafcb6 tempest-SharesActionsTest-2125642311 tempest-SharesActionsTest-2125642311-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297c7d9ded9e4385b8d12b4e03a77bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '633b6f74527b48408dad0eedac73931e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f92dbb-d821-45f6-abd5-013744dafcb6 tempest-SharesActionsTest-2125642311 tempest-SharesActionsTest-2125642311-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f92dbb-d821-45f6-abd5-013744dafcb6 tempest-SharesActionsTest-2125642311 tempest-SharesActionsTest-2125642311-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f92dbb-d821-45f6-abd5-013744dafcb6 tempest-SharesActionsTest-2125642311 tempest-SharesActionsTest-2125642311-project-admin] PATH_INFO: `/v3/users/756070dd0b274fd8835b10a8fbe293d9` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f92dbb-d821-45f6-abd5-013744dafcb6 tempest-SharesActionsTest-2125642311 tempest-SharesActionsTest-2125642311-project-admin] RBAC: Authorizing `identity:delete_user(user_id=756070dd0b274fd8835b10a8fbe293d9)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f92dbb-d821-45f6-abd5-013744dafcb6 tempest-SharesActionsTest-2125642311 tempest-SharesActionsTest-2125642311-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-a6f92dbb-d821-45f6-abd5-013744dafcb6 tempest-SharesActionsTest-2125642311 tempest-SharesActionsTest-2125642311-project-admin] Could not find user: 756070dd0b274fd8835b10a8fbe293d9.: keystone.exception.UserNotFound: Could not find user: 756070dd0b274fd8835b10a8fbe293d9. May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 756070dd0b274fd8835b10a8fbe293d9. May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1838/3644] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:03:46 2024] DELETE /identity/v3/users/756070dd0b274fd8835b10a8fbe293d9 => generated 110 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2d0dc3-80dc-456e-9ac5-e6af618c05dc tempest-SharesActionsTest-2125642311 tempest-SharesActionsTest-2125642311-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2d0dc3-80dc-456e-9ac5-e6af618c05dc tempest-SharesActionsTest-2125642311 tempest-SharesActionsTest-2125642311-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a774339f-0188-48a7-8197-3e20a67d1daf tempest-SharesActionsTest-2125642311 tempest-SharesActionsTest-2125642311-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297c7d9ded9e4385b8d12b4e03a77bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '633b6f74527b48408dad0eedac73931e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a774339f-0188-48a7-8197-3e20a67d1daf tempest-SharesActionsTest-2125642311 tempest-SharesActionsTest-2125642311-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a774339f-0188-48a7-8197-3e20a67d1daf tempest-SharesActionsTest-2125642311 tempest-SharesActionsTest-2125642311-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a774339f-0188-48a7-8197-3e20a67d1daf tempest-SharesActionsTest-2125642311 tempest-SharesActionsTest-2125642311-project-admin] PATH_INFO: `/v3/users/cdf8594f55cb448e9b2312d051486331` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a774339f-0188-48a7-8197-3e20a67d1daf tempest-SharesActionsTest-2125642311 tempest-SharesActionsTest-2125642311-project-admin] RBAC: Authorizing `identity:delete_user(user_id=cdf8594f55cb448e9b2312d051486331)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a774339f-0188-48a7-8197-3e20a67d1daf tempest-SharesActionsTest-2125642311 tempest-SharesActionsTest-2125642311-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-a774339f-0188-48a7-8197-3e20a67d1daf tempest-SharesActionsTest-2125642311 tempest-SharesActionsTest-2125642311-project-admin] Could not find user: cdf8594f55cb448e9b2312d051486331.: keystone.exception.UserNotFound: Could not find user: cdf8594f55cb448e9b2312d051486331. May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cdf8594f55cb448e9b2312d051486331. May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1807/3645] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:03:46 2024] DELETE /identity/v3/users/cdf8594f55cb448e9b2312d051486331 => generated 110 bytes in 25 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f92dbb-d821-45f6-abd5-013744dafcb6 tempest-SharesActionsTest-2125642311 tempest-SharesActionsTest-2125642311-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f92dbb-d821-45f6-abd5-013744dafcb6 tempest-SharesActionsTest-2125642311 tempest-SharesActionsTest-2125642311-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb3f68c-435e-4b81-89cb-44d6a56da3c2 tempest-SharesActionsTest-2125642311 tempest-SharesActionsTest-2125642311-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297c7d9ded9e4385b8d12b4e03a77bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '633b6f74527b48408dad0eedac73931e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb3f68c-435e-4b81-89cb-44d6a56da3c2 tempest-SharesActionsTest-2125642311 tempest-SharesActionsTest-2125642311-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb3f68c-435e-4b81-89cb-44d6a56da3c2 tempest-SharesActionsTest-2125642311 tempest-SharesActionsTest-2125642311-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb3f68c-435e-4b81-89cb-44d6a56da3c2 tempest-SharesActionsTest-2125642311 tempest-SharesActionsTest-2125642311-project-admin] PATH_INFO: `/v3/users/a3784840ad6a4156929be55026b39776` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb3f68c-435e-4b81-89cb-44d6a56da3c2 tempest-SharesActionsTest-2125642311 tempest-SharesActionsTest-2125642311-project-admin] RBAC: Authorizing `identity:delete_user(user_id=a3784840ad6a4156929be55026b39776)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb3f68c-435e-4b81-89cb-44d6a56da3c2 tempest-SharesActionsTest-2125642311 tempest-SharesActionsTest-2125642311-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-beb3f68c-435e-4b81-89cb-44d6a56da3c2 tempest-SharesActionsTest-2125642311 tempest-SharesActionsTest-2125642311-project-admin] Could not find user: a3784840ad6a4156929be55026b39776.: keystone.exception.UserNotFound: Could not find user: a3784840ad6a4156929be55026b39776. May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: a3784840ad6a4156929be55026b39776. May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1839/3646] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:03:46 2024] DELETE /identity/v3/users/a3784840ad6a4156929be55026b39776 => generated 110 bytes in 25 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a774339f-0188-48a7-8197-3e20a67d1daf tempest-SharesActionsTest-2125642311 tempest-SharesActionsTest-2125642311-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a774339f-0188-48a7-8197-3e20a67d1daf tempest-SharesActionsTest-2125642311 tempest-SharesActionsTest-2125642311-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16734a9f-b49e-412c-ad96-ac7b727f426f tempest-SharesActionsTest-2125642311 tempest-SharesActionsTest-2125642311-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297c7d9ded9e4385b8d12b4e03a77bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '633b6f74527b48408dad0eedac73931e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16734a9f-b49e-412c-ad96-ac7b727f426f tempest-SharesActionsTest-2125642311 tempest-SharesActionsTest-2125642311-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16734a9f-b49e-412c-ad96-ac7b727f426f tempest-SharesActionsTest-2125642311 tempest-SharesActionsTest-2125642311-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16734a9f-b49e-412c-ad96-ac7b727f426f tempest-SharesActionsTest-2125642311 tempest-SharesActionsTest-2125642311-project-admin] PATH_INFO: `/v3/users/93bc07dfcf2c4861981da16395bddbc0` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16734a9f-b49e-412c-ad96-ac7b727f426f tempest-SharesActionsTest-2125642311 tempest-SharesActionsTest-2125642311-project-admin] RBAC: Authorizing `identity:delete_user(user_id=93bc07dfcf2c4861981da16395bddbc0)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16734a9f-b49e-412c-ad96-ac7b727f426f tempest-SharesActionsTest-2125642311 tempest-SharesActionsTest-2125642311-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-16734a9f-b49e-412c-ad96-ac7b727f426f tempest-SharesActionsTest-2125642311 tempest-SharesActionsTest-2125642311-project-admin] Could not find user: 93bc07dfcf2c4861981da16395bddbc0.: keystone.exception.UserNotFound: Could not find user: 93bc07dfcf2c4861981da16395bddbc0. May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 93bc07dfcf2c4861981da16395bddbc0. May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1808/3647] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:03:46 2024] DELETE /identity/v3/users/93bc07dfcf2c4861981da16395bddbc0 => generated 110 bytes in 24 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb3f68c-435e-4b81-89cb-44d6a56da3c2 tempest-SharesActionsTest-2125642311 tempest-SharesActionsTest-2125642311-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb3f68c-435e-4b81-89cb-44d6a56da3c2 tempest-SharesActionsTest-2125642311 tempest-SharesActionsTest-2125642311-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83b2bd1-45e9-4c6b-a40d-719b6625d3b8 tempest-SharesActionsTest-2125642311 tempest-SharesActionsTest-2125642311-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297c7d9ded9e4385b8d12b4e03a77bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '633b6f74527b48408dad0eedac73931e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83b2bd1-45e9-4c6b-a40d-719b6625d3b8 tempest-SharesActionsTest-2125642311 tempest-SharesActionsTest-2125642311-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83b2bd1-45e9-4c6b-a40d-719b6625d3b8 tempest-SharesActionsTest-2125642311 tempest-SharesActionsTest-2125642311-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83b2bd1-45e9-4c6b-a40d-719b6625d3b8 tempest-SharesActionsTest-2125642311 tempest-SharesActionsTest-2125642311-project-admin] PATH_INFO: `/v3/users/080fdf25a1154b6db0ae228e1c05b6b2` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83b2bd1-45e9-4c6b-a40d-719b6625d3b8 tempest-SharesActionsTest-2125642311 tempest-SharesActionsTest-2125642311-project-admin] RBAC: Authorizing `identity:delete_user(user_id=080fdf25a1154b6db0ae228e1c05b6b2)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83b2bd1-45e9-4c6b-a40d-719b6625d3b8 tempest-SharesActionsTest-2125642311 tempest-SharesActionsTest-2125642311-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-b83b2bd1-45e9-4c6b-a40d-719b6625d3b8 tempest-SharesActionsTest-2125642311 tempest-SharesActionsTest-2125642311-project-admin] Could not find user: 080fdf25a1154b6db0ae228e1c05b6b2.: keystone.exception.UserNotFound: Could not find user: 080fdf25a1154b6db0ae228e1c05b6b2. May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 080fdf25a1154b6db0ae228e1c05b6b2. May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1840/3648] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:03:46 2024] DELETE /identity/v3/users/080fdf25a1154b6db0ae228e1c05b6b2 => generated 110 bytes in 24 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16734a9f-b49e-412c-ad96-ac7b727f426f tempest-SharesActionsTest-2125642311 tempest-SharesActionsTest-2125642311-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16734a9f-b49e-412c-ad96-ac7b727f426f tempest-SharesActionsTest-2125642311 tempest-SharesActionsTest-2125642311-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe1eecd-b2ec-4527-8451-7f033f7c2218 tempest-SharesActionsTest-2125642311 tempest-SharesActionsTest-2125642311-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297c7d9ded9e4385b8d12b4e03a77bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '633b6f74527b48408dad0eedac73931e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe1eecd-b2ec-4527-8451-7f033f7c2218 tempest-SharesActionsTest-2125642311 tempest-SharesActionsTest-2125642311-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe1eecd-b2ec-4527-8451-7f033f7c2218 tempest-SharesActionsTest-2125642311 tempest-SharesActionsTest-2125642311-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe1eecd-b2ec-4527-8451-7f033f7c2218 tempest-SharesActionsTest-2125642311 tempest-SharesActionsTest-2125642311-project-admin] PATH_INFO: `/v3/users/80737d9a590d4944acb593a5812e9c87` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe1eecd-b2ec-4527-8451-7f033f7c2218 tempest-SharesActionsTest-2125642311 tempest-SharesActionsTest-2125642311-project-admin] RBAC: Authorizing `identity:delete_user(user_id=80737d9a590d4944acb593a5812e9c87)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe1eecd-b2ec-4527-8451-7f033f7c2218 tempest-SharesActionsTest-2125642311 tempest-SharesActionsTest-2125642311-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-4fe1eecd-b2ec-4527-8451-7f033f7c2218 tempest-SharesActionsTest-2125642311 tempest-SharesActionsTest-2125642311-project-admin] Could not find user: 80737d9a590d4944acb593a5812e9c87.: keystone.exception.UserNotFound: Could not find user: 80737d9a590d4944acb593a5812e9c87. May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 80737d9a590d4944acb593a5812e9c87. May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1809/3649] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:03:46 2024] DELETE /identity/v3/users/80737d9a590d4944acb593a5812e9c87 => generated 110 bytes in 23 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83b2bd1-45e9-4c6b-a40d-719b6625d3b8 tempest-SharesActionsTest-2125642311 tempest-SharesActionsTest-2125642311-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83b2bd1-45e9-4c6b-a40d-719b6625d3b8 tempest-SharesActionsTest-2125642311 tempest-SharesActionsTest-2125642311-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac29520-6405-45e9-b51a-7921ac0e3967 tempest-SharesActionsTest-2125642311 tempest-SharesActionsTest-2125642311-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297c7d9ded9e4385b8d12b4e03a77bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '633b6f74527b48408dad0eedac73931e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac29520-6405-45e9-b51a-7921ac0e3967 tempest-SharesActionsTest-2125642311 tempest-SharesActionsTest-2125642311-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac29520-6405-45e9-b51a-7921ac0e3967 tempest-SharesActionsTest-2125642311 tempest-SharesActionsTest-2125642311-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac29520-6405-45e9-b51a-7921ac0e3967 tempest-SharesActionsTest-2125642311 tempest-SharesActionsTest-2125642311-project-admin] PATH_INFO: `/v3/users/0db23a1570c14747b7d0cfd63c25831d` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac29520-6405-45e9-b51a-7921ac0e3967 tempest-SharesActionsTest-2125642311 tempest-SharesActionsTest-2125642311-project-admin] RBAC: Authorizing `identity:delete_user(user_id=0db23a1570c14747b7d0cfd63c25831d)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac29520-6405-45e9-b51a-7921ac0e3967 tempest-SharesActionsTest-2125642311 tempest-SharesActionsTest-2125642311-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-4ac29520-6405-45e9-b51a-7921ac0e3967 tempest-SharesActionsTest-2125642311 tempest-SharesActionsTest-2125642311-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0db23a1570c14747b7d0cfd63c25831d', 'request_id': 'req-4ac29520-6405-45e9-b51a-7921ac0e3967'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-4ac29520-6405-45e9-b51a-7921ac0e3967 tempest-SharesActionsTest-2125642311 tempest-SharesActionsTest-2125642311-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0db23a1570c14747b7d0cfd63c25831d', 'request_id': 'req-4ac29520-6405-45e9-b51a-7921ac0e3967'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-4ac29520-6405-45e9-b51a-7921ac0e3967 tempest-SharesActionsTest-2125642311 tempest-SharesActionsTest-2125642311-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0db23a1570c14747b7d0cfd63c25831d', 'request_id': 'req-4ac29520-6405-45e9-b51a-7921ac0e3967'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-4ac29520-6405-45e9-b51a-7921ac0e3967 tempest-SharesActionsTest-2125642311 tempest-SharesActionsTest-2125642311-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0db23a1570c14747b7d0cfd63c25831d', 'request_id': 'req-4ac29520-6405-45e9-b51a-7921ac0e3967'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-4ac29520-6405-45e9-b51a-7921ac0e3967 tempest-SharesActionsTest-2125642311 tempest-SharesActionsTest-2125642311-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0db23a1570c14747b7d0cfd63c25831d', 'request_id': 'req-4ac29520-6405-45e9-b51a-7921ac0e3967'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:03:46 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1841/3650] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:03:46 2024] DELETE /identity/v3/users/0db23a1570c14747b7d0cfd63c25831d => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:03:46 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-a326a399-e888-49df-8939-163c93705451 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] GET http://10.27.203.238/share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/share-replicas/detail?share_id=8b043109-1855-41f3-b131-fa3ffbe31cd6 May 28 13:03:46 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-a326a399-e888-49df-8939-163c93705451 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:03:46 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-a326a399-e888-49df-8939-163c93705451 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:03:46 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-a326a399-e888-49df-8939-163c93705451 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] http://10.27.203.238/share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/share-replicas/detail?share_id=8b043109-1855-41f3-b131-fa3ffbe31cd6 returned with HTTP 200 May 28 13:03:46 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1350/2679] 10.27.203.238 () {64 vars in 1476 bytes} [Tue May 28 13:03:46 2024] GET /share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/share-replicas/detail?share_id=8b043109-1855-41f3-b131-fa3ffbe31cd6 => generated 22 bytes in 12 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:03:46 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-b660387c-9bf8-4f39-8c2d-52f9b53d5a53 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] DELETE http://10.27.203.238/share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/8b043109-1855-41f3-b131-fa3ffbe31cd6 May 28 13:03:46 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-b660387c-9bf8-4f39-8c2d-52f9b53d5a53 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:03:46 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-b660387c-9bf8-4f39-8c2d-52f9b53d5a53 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Calling method 'ShareMixin.delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:03:46 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.v1.shares [None req-b660387c-9bf8-4f39-8c2d-52f9b53d5a53 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Delete share with id: 8b043109-1855-41f3-b131-fa3ffbe31cd6 May 28 13:03:46 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-b660387c-9bf8-4f39-8c2d-52f9b53d5a53 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] http://10.27.203.238/share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/8b043109-1855-41f3-b131-fa3ffbe31cd6 returned with HTTP 202 May 28 13:03:46 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1330/2680] 10.27.203.238 () {64 vars in 1454 bytes} [Tue May 28 13:03:46 2024] DELETE /share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/8b043109-1855-41f3-b131-fa3ffbe31cd6 => generated 0 bytes in 117 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 13:03:46 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-bd3f95dd-1fe0-4a04-a5d8-11583ecbd329 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] GET http://10.27.203.238/share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/8b043109-1855-41f3-b131-fa3ffbe31cd6 May 28 13:03:46 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-bd3f95dd-1fe0-4a04-a5d8-11583ecbd329 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:03:46 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-bd3f95dd-1fe0-4a04-a5d8-11583ecbd329 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:03:46 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-bd3f95dd-1fe0-4a04-a5d8-11583ecbd329 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] http://10.27.203.238/share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/8b043109-1855-41f3-b131-fa3ffbe31cd6 returned with HTTP 200 May 28 13:03:46 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1351/2681] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:03:46 2024] GET /share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/8b043109-1855-41f3-b131-fa3ffbe31cd6 => generated 1315 bytes in 27 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:03:46 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-b660387c-9bf8-4f39-8c2d-52f9b53d5a53 tempest-SharesActionsTest-682704550 None] Acquiring lock "locked_access_rules_operation_by_share_instance_5f1c2f0c-5c08-4a06-bba7-cfd2e7a85e02" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:03:46 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-b660387c-9bf8-4f39-8c2d-52f9b53d5a53 tempest-SharesActionsTest-682704550 None] Lock "locked_access_rules_operation_by_share_instance_5f1c2f0c-5c08-4a06-bba7-cfd2e7a85e02" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:03:46 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-b660387c-9bf8-4f39-8c2d-52f9b53d5a53 tempest-SharesActionsTest-682704550 None] Lock "locked_access_rules_operation_by_share_instance_5f1c2f0c-5c08-4a06-bba7-cfd2e7a85e02" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:03:46 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-b660387c-9bf8-4f39-8c2d-52f9b53d5a53 tempest-SharesActionsTest-682704550 None] Acquiring lock "locked_access_rules_operation_by_share_instance_5f1c2f0c-5c08-4a06-bba7-cfd2e7a85e02" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:03:46 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-b660387c-9bf8-4f39-8c2d-52f9b53d5a53 tempest-SharesActionsTest-682704550 None] Lock "locked_access_rules_operation_by_share_instance_5f1c2f0c-5c08-4a06-bba7-cfd2e7a85e02" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:03:46 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-b660387c-9bf8-4f39-8c2d-52f9b53d5a53 tempest-SharesActionsTest-682704550 None] Lock "locked_access_rules_operation_by_share_instance_5f1c2f0c-5c08-4a06-bba7-cfd2e7a85e02" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:03:46 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-b660387c-9bf8-4f39-8c2d-52f9b53d5a53 tempest-SharesActionsTest-682704550 None] Acquiring lock "locked_access_rules_operation_by_share_instance_5f1c2f0c-5c08-4a06-bba7-cfd2e7a85e02" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:03:46 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-b660387c-9bf8-4f39-8c2d-52f9b53d5a53 tempest-SharesActionsTest-682704550 None] Lock "locked_access_rules_operation_by_share_instance_5f1c2f0c-5c08-4a06-bba7-cfd2e7a85e02" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:03:46 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-b660387c-9bf8-4f39-8c2d-52f9b53d5a53 tempest-SharesActionsTest-682704550 None] Lock "locked_access_rules_operation_by_share_instance_5f1c2f0c-5c08-4a06-bba7-cfd2e7a85e02" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:03:46 l75lg1-v1 manila-share[98474]: DEBUG manila.share.access [None req-b660387c-9bf8-4f39-8c2d-52f9b53d5a53 tempest-SharesActionsTest-682704550 None] All access rules have been synced for share instance 5f1c2f0c-5c08-4a06-bba7-cfd2e7a85e02 belonging to share 8b043109-1855-41f3-b131-fa3ffbe31cd6. {{(pid=98474) update_access_rules /opt/stack/manila/manila/share/access.py:304}} May 28 13:03:46 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-b660387c-9bf8-4f39-8c2d-52f9b53d5a53 tempest-SharesActionsTest-682704550 None] deleting '/manila/manila-5f1c2f0c-5c08-4a06-bba7-cfd2e7a85e02' May 28 13:03:46 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b660387c-9bf8-4f39-8c2d-52f9b53d5a53 tempest-SharesActionsTest-682704550 None] >>> [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/ May 28 13:03:46 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b660387c-9bf8-4f39-8c2d-52f9b53d5a53 tempest-SharesActionsTest-682704550 None] {'data': '{"path": "/manila/manila-5f1c2f0c-5c08-4a06-bba7-cfd2e7a85e02"}', May 28 13:03:46 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b660387c-9bf8-4f39-8c2d-52f9b53d5a53 tempest-SharesActionsTest-682704550 None] 'params': None} May 28 13:03:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b660387c-9bf8-4f39-8c2d-52f9b53d5a53 tempest-SharesActionsTest-682704550 None] <<< [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/ May 28 13:03:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b660387c-9bf8-4f39-8c2d-52f9b53d5a53 tempest-SharesActionsTest-682704550 None] 'OK' May 28 13:03:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b660387c-9bf8-4f39-8c2d-52f9b53d5a53 tempest-SharesActionsTest-682704550 None] --- [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/: Done May 28 13:03:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b660387c-9bf8-4f39-8c2d-52f9b53d5a53 tempest-SharesActionsTest-682704550 None] >>> [GET] https://127.0.0.1:40443/api/views/ May 28 13:03:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b660387c-9bf8-4f39-8c2d-52f9b53d5a53 tempest-SharesActionsTest-682704550 None] {'allow_redirects': True, May 28 13:03:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b660387c-9bf8-4f39-8c2d-52f9b53d5a53 tempest-SharesActionsTest-682704550 None] 'params': {'name': '5f1c2f0c-5c08-4a06-bba7-cfd2e7a85e02'}} May 28 13:03:47 l75lg1-v1 dstat.sh[49771]: 28-05 13:03:47| 8 1 90 1 0|5516M 1898M 278M 7931M| 12k 1522B| 0 520k| 0 71.0 |6026 9990 |0.82 1.06 1.04|1.0 0 0| 0 0 | 0 2048M| 29 357 0 13 8 May 28 13:03:47 l75lg1-v1 manila-share[98474]: DEBUG oslo_service.periodic_task [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] Running periodic task ShareManager._publish_service_capabilities {{(pid=98474) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 13:03:47 l75lg1-v1 manila-share[98474]: DEBUG manila.manager [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] Notifying Schedulers of capabilities ... {{(pid=98474) _publish_service_capabilities /opt/stack/manila/manila/manager.py:172}} May 28 13:03:47 l75lg1-v1 manila-share[98474]: DEBUG oslo_service.periodic_task [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] Running periodic task ShareManager.migration_driver_continue {{(pid=98474) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 13:03:47 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.host_manager [None req-cfefffe1-ce8a-4bae-8db4-54ee8394b422 None None] Received share service update from l75lg1-v1@vast: {'share_backend_name': 'vast', 'driver_handles_share_servers': False, 'vendor_name': 'VAST STORAGE', 'driver_version': '1.0', 'storage_protocol': 'NFS', 'total_capacity_gb': 2083.02392578125, 'free_capacity_gb': 2082.6467494899407, 'reserved_percentage': 0, 'reserved_snapshot_percentage': 0, 'reserved_share_extend_percentage': 0, 'qos': False, 'pools': None, 'snapshot_support': True, 'create_share_from_snapshot_support': False, 'revert_to_snapshot_support': False, 'mount_snapshot_support': False, 'replication_domain': None, 'filter_function': None, 'goodness_function': None, 'security_service_update_support': False, 'network_allocation_update_support': False, 'share_server_multiple_subnet_support': False, 'mount_point_name_support': False, 'data_reduction': 5.29, 'provisioned_capacity_gb': 0.3771762913092971, 'share_group_stats': {'consistent_snapshot_support': None}, 'ipv4_support': True, 'ipv6_support': False} {{(pid=98327) update_service_capabilities /opt/stack/manila/manila/scheduler/host_manager.py:632}} May 28 13:03:47 l75lg1-v1 manila-share[98474]: DEBUG oslo_service.periodic_task [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] Running periodic task ShareManager.do_deferred_share_deletion {{(pid=98474) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 13:03:47 l75lg1-v1 manila-share[98474]: DEBUG manila.share.manager [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] Checking for shares in 'deferred_deleting' status to process their deletion. {{(pid=98474) do_deferred_share_deletion /opt/stack/manila/manila/share/manager.py:3663}} May 28 13:03:47 l75lg1-v1 manila-share[98474]: DEBUG oslo_service.periodic_task [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] Running periodic task ShareManager.do_deferred_snapshot_deletion {{(pid=98474) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 13:03:47 l75lg1-v1 manila-share[98474]: DEBUG manila.share.manager [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] Checking for snapshots in 'deferred_deleting' status to process their deletion. {{(pid=98474) do_deferred_snapshot_deletion /opt/stack/manila/manila/share/manager.py:3980}} May 28 13:03:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b660387c-9bf8-4f39-8c2d-52f9b53d5a53 tempest-SharesActionsTest-682704550 None] <<< [GET] https://127.0.0.1:40443/api/views/ May 28 13:03:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b660387c-9bf8-4f39-8c2d-52f9b53d5a53 tempest-SharesActionsTest-682704550 None] [Bunch(abac_tags=[], abe_max_depth=None, abe_protocols=[], alias='', allow_anonymous_access=False, allow_s3_anonymous_access=False, auto_commit='0d', bucket='', bucket_creators=[], bucket_creators_groups=[], bucket_owner=None, bulk_permission_update_progress=None, bulk_permission_update_state=None, cluster='loop75-kfs', cluster_id=1, created='2024-05-28T13:03:44.367576Z', enabled=True, files_retention_mode='NONE', guid='20465b64-4c21-47f6-8868-ccdf5d0632fb', id=60, ignore_oos=False, internal=False, is_remote=False, is_seamless=False, logical_capacity=0, max_retention_period=None, min_retention_period=None, name='5f1c2f0c-5c08-4a06-bba7-cfd2e7a85e02', nfs_interop_flags='BOTH_NFS3_AND_NFS4_INTEROP_DISABLED', path='/manila/manila-5f1c2f0c-5c08-4a06-bba7-cfd2e7a85e02', physical_capacity=0, policy='5f1c2f0c-5c08-4a06-bba7-cfd2e7a85e02', policy_id=61, protocols=['NFS'], qos_policy=None, qos_policy_id=None, s3_locks=False, s3_locks_retention_mode='NONE', s3_locks_retention_period='', s3_unverified_lookup=False, s3_versioning=False, select_for_live_monitoring=False, share='', share_acl=Bunch(acl=[], enabled=False), sync='SYNCED', sync_time='2024-05-28T13:03:44.717392Z', tenant_id=1, tenant_name='default', title='/manila/manila-5f1c2f0c-5c08-4a06-bba7-cfd2e7a85e02', url='https://127.0.0.1:40443/api/views/60/')] May 28 13:03:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b660387c-9bf8-4f39-8c2d-52f9b53d5a53 tempest-SharesActionsTest-682704550 None] --- [GET] https://127.0.0.1:40443/api/views/: Done May 28 13:03:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b660387c-9bf8-4f39-8c2d-52f9b53d5a53 tempest-SharesActionsTest-682704550 None] >>> [DELETE] https://127.0.0.1:40443/api/views/60/ May 28 13:03:47 l75lg1-v1 manila-share[98474]: DEBUG oslo_service.periodic_task [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] Running periodic task ShareManager._report_driver_status {{(pid=98474) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 13:03:47 l75lg1-v1 manila-share[98474]: INFO manila.share.manager [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] Updating share status May 28 13:03:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] >>> [GET] https://127.0.0.1:40443/api/monitors/ad_hoc_query/ May 28 13:03:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] {'allow_redirects': True, May 28 13:03:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] 'params': {'object_type': 'cluster', May 28 13:03:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] 'prop_list': ['Capacity,drr', May 28 13:03:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] 'Capacity,logical_space', May 28 13:03:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] 'Capacity,logical_space_in_use', May 28 13:03:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] 'Capacity,physical_space', May 28 13:03:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] 'Capacity,physical_space_in_use'], May 28 13:03:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] 'time_frame': '1m'}} May 28 13:03:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] <<< [GET] https://127.0.0.1:40443/api/monitors/ad_hoc_query/ May 28 13:03:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] Bunch(data=[['2024-05-28T13:03:42Z', 1, 427485191.0, 2223930.0, 5.29, 711246584217.0, 2236629909504.0], ['2024-05-28T13:03:32Z', 1, 427337735.0, 2223930.0, 5.29, 711246584217.0, 2236629909504.0], ['2024-05-28T13:03:22Z', 1, 409978887.0, 2223930.0, 5.29, 711246584217.0, 2236629909504.0], ['2024-05-28T13:03:12Z', 1, 409913351.0, 2223930.0, 5.29, 711246584217.0, 2236629909504.0], ['2024-05-28T13:03:02Z', 1, 409782279.0, 2223930.0, 5.29, 711246584217.0, 2236629909504.0], ['2024-05-28T13:02:52Z', 1, 409700359.0, 2223930.0, 5.29, 711246584217.0, 2236629909504.0]], granularity=None, object_ids=[1], prop_list=['timestamp', 'object_id', 'Capacity,logical_space_in_use', 'Capacity,physical_space_in_use', 'Capacity,drr', 'Capacity,physical_space', 'Capacity,logical_space']) May 28 13:03:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] --- [GET] https://127.0.0.1:40443/api/monitors/ad_hoc_query/: Done May 28 13:03:47 l75lg1-v1 manila-share[98474]: DEBUG manila.share.driver [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] Updating share stats. {{(pid=98474) _update_share_stats /opt/stack/manila/manila/share/driver.py:1326}} May 28 13:03:47 l75lg1-v1 manila-share[98474]: DEBUG oslo_service.periodic_task [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] Running periodic task ShareManager.create_backup_continue {{(pid=98474) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 13:03:47 l75lg1-v1 manila-share[98474]: DEBUG oslo_service.periodic_task [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] Running periodic task ShareManager.restore_backup_continue {{(pid=98474) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 13:03:47 l75lg1-v1 manila-share[98474]: DEBUG oslo_service.periodic_task [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] Running periodic task ShareManager.periodic_share_status_update {{(pid=98474) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 13:03:47 l75lg1-v1 manila-share[98474]: DEBUG manila.share.manager [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] Updating status of share instances. {{(pid=98474) periodic_share_status_update /opt/stack/manila/manila/share/manager.py:5475}} May 28 13:03:48 l75lg1-v1 dstat.sh[49771]: 28-05 13:03:48| 2 1 98 0 0|5516M 1898M 278M 7931M| 18k 3421B| 0 320k| 0 22.0 |1899 2813 |0.83 1.06 1.04|1.0 0 2.0| 0 0 | 0 2048M| 29 359 0 7 6 May 28 13:03:49 l75lg1-v1 dstat.sh[49771]: 28-05 13:03:49| 1 0 99 0 0|5516M 1898M 278M 7931M| 14k 0 | 0 268k| 0 20.0 |1524 2353 |0.83 1.06 1.04| 0 0 0| 0 0 | 0 2048M| 29 359 0 7 6 May 28 13:03:49 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b660387c-9bf8-4f39-8c2d-52f9b53d5a53 tempest-SharesActionsTest-682704550 None] <<< [DELETE] https://127.0.0.1:40443/api/views/60/ May 28 13:03:49 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b660387c-9bf8-4f39-8c2d-52f9b53d5a53 tempest-SharesActionsTest-682704550 None] --- [DELETE] https://127.0.0.1:40443/api/views/60/: Done May 28 13:03:49 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b660387c-9bf8-4f39-8c2d-52f9b53d5a53 tempest-SharesActionsTest-682704550 None] >>> [GET] https://127.0.0.1:40443/api/quotas/ May 28 13:03:49 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b660387c-9bf8-4f39-8c2d-52f9b53d5a53 tempest-SharesActionsTest-682704550 None] {'allow_redirects': True, May 28 13:03:49 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b660387c-9bf8-4f39-8c2d-52f9b53d5a53 tempest-SharesActionsTest-682704550 None] 'params': {'name': '5f1c2f0c-5c08-4a06-bba7-cfd2e7a85e02'}} May 28 13:03:49 l75lg1-v1 nova-conductor[83647]: DEBUG dbcounter [-] [83647] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=1 {{(pid=83647) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:03:49 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-0a3744aa-1535-4a40-a81f-7e78478d2c4b tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] GET http://10.27.203.238/share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/8b043109-1855-41f3-b131-fa3ffbe31cd6 May 28 13:03:49 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-0a3744aa-1535-4a40-a81f-7e78478d2c4b tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:03:49 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-0a3744aa-1535-4a40-a81f-7e78478d2c4b tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:03:49 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-0a3744aa-1535-4a40-a81f-7e78478d2c4b tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] http://10.27.203.238/share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/8b043109-1855-41f3-b131-fa3ffbe31cd6 returned with HTTP 200 May 28 13:03:49 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1331/2682] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:03:49 2024] GET /share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/8b043109-1855-41f3-b131-fa3ffbe31cd6 => generated 1315 bytes in 26 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:03:50 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b660387c-9bf8-4f39-8c2d-52f9b53d5a53 tempest-SharesActionsTest-682704550 None] <<< [GET] https://127.0.0.1:40443/api/quotas/ May 28 13:03:50 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b660387c-9bf8-4f39-8c2d-52f9b53d5a53 tempest-SharesActionsTest-682704550 None] [Bunch(cluster='loop75-kfs', cluster_id=1, default_email=None, default_group_quota=None, default_user_quota=None, enable_alarms=True, enable_email_providers=True, grace_period=None, guid='5438e1ff-c7d2-4eca-8448-84e97c439f8e', hard_limit=1073741824, hard_limit_inodes=None, id=58, internal=False, is_user_quota=False, last_user_quotas_update=None, name='5f1c2f0c-5c08-4a06-bba7-cfd2e7a85e02', num_blocked_users=0, num_exceeded_users=0, path='/manila/manila-5f1c2f0c-5c08-4a06-bba7-cfd2e7a85e02', percent_capacity=0, percent_inodes=None, pretty_grace_period=None, pretty_grace_period_expiration=None, pretty_state='OK (CREATED)', soft_limit=None, soft_limit_inodes=None, state='OK', sync_state='CREATED', system_id=58, tenant_id=1, tenant_name='default', time_to_block=None, title='5f1c2f0c-5c08-4a06-bba7-cfd2e7a85e02', url='https://127.0.0.1:40443/api/quotas/58/', used_capacity=0, used_capacity_tb=0.0, used_effective_capacity=0, used_effective_capacity_tb=0.0, used_inodes=0, used_limited_capacity=0)] May 28 13:03:50 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b660387c-9bf8-4f39-8c2d-52f9b53d5a53 tempest-SharesActionsTest-682704550 None] --- [GET] https://127.0.0.1:40443/api/quotas/: Done May 28 13:03:50 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b660387c-9bf8-4f39-8c2d-52f9b53d5a53 tempest-SharesActionsTest-682704550 None] >>> [DELETE] https://127.0.0.1:40443/api/quotas/58/ May 28 13:03:50 l75lg1-v1 nova-conductor[83648]: DEBUG dbcounter [-] [83648] Writing DB stats nova_cell1:SELECT=1 {{(pid=83648) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:03:50 l75lg1-v1 dstat.sh[49771]: 28-05 13:03:50| 1 0 98 0 0|5516M 1898M 278M 7931M| 42k 1390B| 0 388k| 0 42.0 |2442 3164 |0.83 1.06 1.04|1.0 0 0| 0 0 | 0 2048M| 29 359 0 7 6 May 28 13:03:51 l75lg1-v1 dstat.sh[49771]: 28-05 13:03:51| 0 0 97 2 0|5516M 1898M 278M 7931M| 13k 0 | 0 3228k| 0 192 |2045 3311 |0.83 1.06 1.04| 0 0 0| 0 0 | 0 2048M| 29 359 0 7 6 May 28 13:03:51 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 13:03:52 l75lg1-v1 manila-scheduler[98327]: DEBUG dbcounter [-] [98327] Writing DB stats manila:SELECT=76,manila:UPDATE=11 {{(pid=98327) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:03:52 l75lg1-v1 dstat.sh[49771]: 28-05 13:03:52| 1 0 98 0 0|5516M 1898M 278M 7931M| 13k 172B| 0 276k| 0 46.0 |2094 3353 |0.83 1.06 1.04|1.0 0 0| 0 0 | 0 2048M| 29 359 0 7 6 May 28 13:03:52 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 13:03:52 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-259a92f8-ff5e-49eb-b497-4a1894ef0085 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] GET http://10.27.203.238/share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/8b043109-1855-41f3-b131-fa3ffbe31cd6 May 28 13:03:52 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-259a92f8-ff5e-49eb-b497-4a1894ef0085 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:03:52 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-259a92f8-ff5e-49eb-b497-4a1894ef0085 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:03:52 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-259a92f8-ff5e-49eb-b497-4a1894ef0085 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] http://10.27.203.238/share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/8b043109-1855-41f3-b131-fa3ffbe31cd6 returned with HTTP 200 May 28 13:03:52 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1352/2683] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:03:52 2024] GET /share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/8b043109-1855-41f3-b131-fa3ffbe31cd6 => generated 1315 bytes in 25 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:03:53 l75lg1-v1 dstat.sh[49771]: 28-05 13:03:53| 1 0 98 0 0|5516M 1898M 278M 7931M| 20k 0 | 0 332k| 0 40.0 |2032 3072 |0.76 1.04 1.03|2.0 0 0| 0 0 | 0 2048M| 29 359 0 7 6 May 28 13:03:53 l75lg1-v1 neutron-server[77623]: DEBUG dbcounter [-] [77623] Writing DB stats neutron:SELECT=1 {{(pid=77623) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:03:54 l75lg1-v1 dstat.sh[49771]: 28-05 13:03:54| 1 0 99 0 0|5516M 1898M 278M 7931M| 14k 0 | 0 3049k| 0 464 |1579 2451 |0.76 1.04 1.03|1.0 0 0| 0 0 | 0 2048M| 29 359 0 7 6 May 28 13:03:54 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b660387c-9bf8-4f39-8c2d-52f9b53d5a53 tempest-SharesActionsTest-682704550 None] <<< [DELETE] https://127.0.0.1:40443/api/quotas/58/ May 28 13:03:54 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b660387c-9bf8-4f39-8c2d-52f9b53d5a53 tempest-SharesActionsTest-682704550 None] --- [DELETE] https://127.0.0.1:40443/api/quotas/58/: Done May 28 13:03:54 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b660387c-9bf8-4f39-8c2d-52f9b53d5a53 tempest-SharesActionsTest-682704550 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:03:54 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b660387c-9bf8-4f39-8c2d-52f9b53d5a53 tempest-SharesActionsTest-682704550 None] {'allow_redirects': True, May 28 13:03:54 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b660387c-9bf8-4f39-8c2d-52f9b53d5a53 tempest-SharesActionsTest-682704550 None] 'params': {'name': '5f1c2f0c-5c08-4a06-bba7-cfd2e7a85e02'}} May 28 13:03:54 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 13:03:54 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.manager [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=83654) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10545}} May 28 13:03:54 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b660387c-9bf8-4f39-8c2d-52f9b53d5a53 tempest-SharesActionsTest-682704550 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:03:54 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b660387c-9bf8-4f39-8c2d-52f9b53d5a53 tempest-SharesActionsTest-682704550 None] [Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=0, created='2024-05-28T13:03:41.375861Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='8f614ca8-dafb-4fd3-b041-41fb8f0fcad2', id=61, internal=False, is_s3_default_policy=False, name='5f1c2f0c-5c08-4a06-bba7-cfd2e7a85e02', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=[], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['*'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['*'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T13:03:41.721341Z', tenant_id=1, tenant_name='default', title='5f1c2f0c-5c08-4a06-bba7-cfd2e7a85e02', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/61/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[])] May 28 13:03:54 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b660387c-9bf8-4f39-8c2d-52f9b53d5a53 tempest-SharesActionsTest-682704550 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 13:03:54 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b660387c-9bf8-4f39-8c2d-52f9b53d5a53 tempest-SharesActionsTest-682704550 None] >>> [DELETE] https://127.0.0.1:40443/api/viewpolicies/61/ May 28 13:03:55 l75lg1-v1 dstat.sh[49771]: 28-05 13:03:55| 1 0 99 0 0|5516M 1898M 278M 7931M| 17k 1391B| 0 88k| 0 13.0 |1729 2712 |0.76 1.04 1.03|1.0 0 0| 0 0 | 0 2048M| 29 359 0 7 6 May 28 13:03:55 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 13:03:55 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-a122a06d-2bc5-4e6b-b0ef-e0e867d96c08 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] GET http://10.27.203.238/share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/8b043109-1855-41f3-b131-fa3ffbe31cd6 May 28 13:03:55 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-a122a06d-2bc5-4e6b-b0ef-e0e867d96c08 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:03:55 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-a122a06d-2bc5-4e6b-b0ef-e0e867d96c08 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:03:55 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-a122a06d-2bc5-4e6b-b0ef-e0e867d96c08 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] http://10.27.203.238/share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/8b043109-1855-41f3-b131-fa3ffbe31cd6 returned with HTTP 200 May 28 13:03:55 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1332/2684] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:03:55 2024] GET /share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/8b043109-1855-41f3-b131-fa3ffbe31cd6 => generated 1315 bytes in 26 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:03:56 l75lg1-v1 dstat.sh[49771]: 28-05 13:03:56| 1 0 99 0 0|5516M 1898M 278M 7931M| 15k 0 | 0 444k| 0 53.0 |1626 2472 |0.76 1.04 1.03|1.0 0 0| 0 0 | 0 2048M| 29 359 0 7 6 May 28 13:03:56 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 13:03:56 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b660387c-9bf8-4f39-8c2d-52f9b53d5a53 tempest-SharesActionsTest-682704550 None] <<< [DELETE] https://127.0.0.1:40443/api/viewpolicies/61/ May 28 13:03:56 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b660387c-9bf8-4f39-8c2d-52f9b53d5a53 tempest-SharesActionsTest-682704550 None] --- [DELETE] https://127.0.0.1:40443/api/viewpolicies/61/: Done May 28 13:03:56 l75lg1-v1 devstack@keystone.service[51266]: DEBUG dbcounter [-] [51266] Writing DB stats keystone:SELECT=49 {{(pid=51266) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:03:56 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-b660387c-9bf8-4f39-8c2d-52f9b53d5a53 tempest-SharesActionsTest-682704550 None] Created reservations ['dd950cba-5204-4d35-a380-90a49b663a62', 'ff5539a2-4a50-4ae5-a26a-ec5699251b02', 'fd6b49c3-6c98-455e-9001-8a443aebf7ec', 'dbef23be-5de9-4402-8918-0641b70787f2'] {{(pid=98474) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 13:03:56 l75lg1-v1 devstack@keystone.service[51267]: DEBUG dbcounter [-] [51267] Writing DB stats keystone:SELECT=24,keystone:DELETE=10,keystone:INSERT=1 {{(pid=51267) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:03:56 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-b660387c-9bf8-4f39-8c2d-52f9b53d5a53 tempest-SharesActionsTest-682704550 None] Committed reservations ['dd950cba-5204-4d35-a380-90a49b663a62', 'ff5539a2-4a50-4ae5-a26a-ec5699251b02', 'fd6b49c3-6c98-455e-9001-8a443aebf7ec', 'dbef23be-5de9-4402-8918-0641b70787f2'] {{(pid=98474) commit /opt/stack/manila/manila/quota.py:1063}} May 28 13:03:56 l75lg1-v1 manila-share[98474]: INFO manila.share.manager [None req-b660387c-9bf8-4f39-8c2d-52f9b53d5a53 tempest-SharesActionsTest-682704550 None] Share instance 5f1c2f0c-5c08-4a06-bba7-cfd2e7a85e02: deleted successfully. May 28 13:03:57 l75lg1-v1 dstat.sh[49771]: 28-05 13:03:57| 2 0 96 1 0|5516M 1898M 278M 7931M| 14k 66B| 0 468k| 0 89.0 |2620 4354 |0.76 1.04 1.03|1.0 0 0| 0 0 | 0 2048M| 29 359 0 7 6 May 28 13:03:57 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 13:03:58 l75lg1-v1 dstat.sh[49771]: 28-05 13:03:58| 1 0 99 0 0|5517M 1898M 278M 7931M| 13k 0 | 0 272k| 0 30.0 |1663 2661 |0.70 1.02 1.02| 0 0 2.0| 0 0 | 0 2048M| 29 359 0 7 6 May 28 13:03:58 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 13:03:58 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.manager [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Starting heal instance info cache {{(pid=83654) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}} May 28 13:03:58 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.manager [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Rebuilding the list of instances to heal {{(pid=83654) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9930}} May 28 13:03:58 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Expecting reply to msg 5fda95924a80407192a48873344dbec8 in queue reply_37f4cbd1dd094961a22b8a65f222c327 May 28 13:03:58 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [-] Received RPC response for msg 5fda95924a80407192a48873344dbec8 May 28 13:03:58 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-0a3ef99e-5a40-46dc-bd5e-cdf798d49042 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] GET http://10.27.203.238/share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/8b043109-1855-41f3-b131-fa3ffbe31cd6 May 28 13:03:58 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-0a3ef99e-5a40-46dc-bd5e-cdf798d49042 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:03:58 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-0a3ef99e-5a40-46dc-bd5e-cdf798d49042 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:03:59 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-0a3ef99e-5a40-46dc-bd5e-cdf798d49042 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] HTTP exception thrown: The resource could not be found. May 28 13:03:59 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-0a3ef99e-5a40-46dc-bd5e-cdf798d49042 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] http://10.27.203.238/share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/8b043109-1855-41f3-b131-fa3ffbe31cd6 returned with HTTP 404 May 28 13:03:59 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1353/2685] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:03:58 2024] GET /share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/8b043109-1855-41f3-b131-fa3ffbe31cd6 => generated 78 bytes in 13 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 13:03:59 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-9e6e67f7-fc87-4111-972f-d7f16de141f8 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] DELETE http://10.27.203.238/share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/snapshots/cff0744c-aefe-421e-b8b7-055f24614a39 May 28 13:03:59 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-9e6e67f7-fc87-4111-972f-d7f16de141f8 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:03:59 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-9e6e67f7-fc87-4111-972f-d7f16de141f8 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Calling method 'ShareSnapshotMixin.delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:03:59 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.v1.share_snapshots [None req-9e6e67f7-fc87-4111-972f-d7f16de141f8 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Delete snapshot with id: cff0744c-aefe-421e-b8b7-055f24614a39 May 28 13:03:59 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.manager [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Didn't find any instances for network info cache update. {{(pid=83654) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10012}} May 28 13:03:59 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-9e6e67f7-fc87-4111-972f-d7f16de141f8 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] http://10.27.203.238/share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/snapshots/cff0744c-aefe-421e-b8b7-055f24614a39 returned with HTTP 202 May 28 13:03:59 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1333/2686] 10.27.203.238 () {64 vars in 1463 bytes} [Tue May 28 13:03:59 2024] DELETE /share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/snapshots/cff0744c-aefe-421e-b8b7-055f24614a39 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 13:03:59 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-fa7b0045-67d4-4dca-ae72-9146ee33e304 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] GET http://10.27.203.238/share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/snapshots/cff0744c-aefe-421e-b8b7-055f24614a39 May 28 13:03:59 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-fa7b0045-67d4-4dca-ae72-9146ee33e304 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:03:59 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-fa7b0045-67d4-4dca-ae72-9146ee33e304 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Calling method 'ShareSnapshotMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:03:59 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-fa7b0045-67d4-4dca-ae72-9146ee33e304 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] http://10.27.203.238/share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/snapshots/cff0744c-aefe-421e-b8b7-055f24614a39 returned with HTTP 200 May 28 13:03:59 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1354/2687] 10.27.203.238 () {64 vars in 1460 bytes} [Tue May 28 13:03:59 2024] GET /share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/snapshots/cff0744c-aefe-421e-b8b7-055f24614a39 => generated 745 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:03:59 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9e6e67f7-fc87-4111-972f-d7f16de141f8 tempest-SharesActionsTest-682704550 None] >>> [GET] https://127.0.0.1:40443/api/snapshots/ May 28 13:03:59 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9e6e67f7-fc87-4111-972f-d7f16de141f8 tempest-SharesActionsTest-682704550 None] {'allow_redirects': True, May 28 13:03:59 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9e6e67f7-fc87-4111-972f-d7f16de141f8 tempest-SharesActionsTest-682704550 None] 'params': {'name': 'share-snapshot-a247d85c-9634-4c76-9ca5-380c819d8195'}} May 28 13:03:59 l75lg1-v1 dstat.sh[49771]: 28-05 13:03:59| 3 0 96 0 0|5517M 1898M 278M 7931M| 14k 686B| 0 352k| 0 35.0 |2325 3566 |0.70 1.02 1.02| 0 0 0| 0 0 | 0 2048M| 29 359 0 7 6 May 28 13:03:59 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9e6e67f7-fc87-4111-972f-d7f16de141f8 tempest-SharesActionsTest-682704550 None] <<< [GET] https://127.0.0.1:40443/api/snapshots/ May 28 13:03:59 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9e6e67f7-fc87-4111-972f-d7f16de141f8 tempest-SharesActionsTest-682704550 None] [Bunch(access_path='/.vast_all_snapshots/1000000017_share-snapshot-a247d85c-9634-4c76-9ca5-380c819d8195', aggr_phys_estimation=0, cluster='loop75-kfs', created='2024-05-28T13:02:54.662355Z', eta_sec=30819898558.504242, expiration_time='3001-01-19T07:59:58Z', guid='f4e87a74-84ff-4c32-a56f-7e32918e696f', id=18, indestructible=False, locked=False, name='share-snapshot-a247d85c-9634-4c76-9ca5-380c819d8195', path='/manila/manila-4e3de968-00b8-414a-b562-a9b4001115dd/', policy=None, policy_id=None, protection_policy_id=None, state='SUCCEED', tenant_id=1, tenant_name='default', title='share-snapshot-a247d85c-9634-4c76-9ca5-380c819d8195(/manila/manila-4e3de968-00b8-414a-b562-a9b4001115dd/)', type='local', unique_phys_estimation=0, url='https://127.0.0.1:40443/api/snapshots/18/')] May 28 13:03:59 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9e6e67f7-fc87-4111-972f-d7f16de141f8 tempest-SharesActionsTest-682704550 None] --- [GET] https://127.0.0.1:40443/api/snapshots/: Done May 28 13:03:59 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9e6e67f7-fc87-4111-972f-d7f16de141f8 tempest-SharesActionsTest-682704550 None] >>> [DELETE] https://127.0.0.1:40443/api/snapshots/18/ May 28 13:04:00 l75lg1-v1 nova-conductor[83648]: DEBUG dbcounter [-] [83648] Writing DB stats nova_cell1:SELECT=1 {{(pid=83648) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:04:00 l75lg1-v1 dstat.sh[49771]: 28-05 13:04:00| 1 0 98 0 0|5517M 1898M 278M 7931M| 20k 892B| 0 568k| 0 57.0 |1855 2878 |0.70 1.02 1.02| 0 0 0| 0 0 | 0 2048M| 29 359 0 7 6 May 28 13:04:00 l75lg1-v1 neutron-server[77618]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.HashRingHealthCheckPeriodics.touch_hash_ring_nodes' {{(pid=77618) _process_scheduled /opt/stack/data/venv/lib/python3.10/site-packages/futurist/periodics.py:638}} May 28 13:04:00 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager.update_available_resource {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 13:04:00 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Expecting reply to msg e36cf9b079e34339abc61c01b0773f70 in queue reply_37f4cbd1dd094961a22b8a65f222c327 May 28 13:04:00 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [-] Received RPC response for msg e36cf9b079e34339abc61c01b0773f70 May 28 13:04:01 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9e6e67f7-fc87-4111-972f-d7f16de141f8 tempest-SharesActionsTest-682704550 None] <<< [DELETE] https://127.0.0.1:40443/api/snapshots/18/ May 28 13:04:01 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9e6e67f7-fc87-4111-972f-d7f16de141f8 tempest-SharesActionsTest-682704550 None] --- [DELETE] https://127.0.0.1:40443/api/snapshots/18/: Done May 28 13:04:01 l75lg1-v1 nova-compute[83654]: DEBUG oslo_concurrency.lockutils [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=83654) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:04:01 l75lg1-v1 nova-compute[83654]: DEBUG oslo_concurrency.lockutils [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=83654) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:04:01 l75lg1-v1 nova-compute[83654]: DEBUG oslo_concurrency.lockutils [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=83654) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:04:01 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.resource_tracker [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Auditing locally available compute resources for l75lg1-v1 (node: l75lg1-v1) {{(pid=83654) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}} May 28 13:04:01 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-9e6e67f7-fc87-4111-972f-d7f16de141f8 tempest-SharesActionsTest-682704550 None] Created reservations ['f72138cd-7397-423b-8e63-33a9927d732a', '1dcfafc8-67ea-4ffc-9ed2-b849b6507344', 'e667029e-beb7-4ced-b8ff-260e7a55e229', '7b4e870d-b855-4880-b6b5-608952e59c2b'] {{(pid=98474) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 13:04:01 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-9e6e67f7-fc87-4111-972f-d7f16de141f8 tempest-SharesActionsTest-682704550 None] Committed reservations ['f72138cd-7397-423b-8e63-33a9927d732a', '1dcfafc8-67ea-4ffc-9ed2-b849b6507344', 'e667029e-beb7-4ced-b8ff-260e7a55e229', '7b4e870d-b855-4880-b6b5-608952e59c2b'] {{(pid=98474) commit /opt/stack/manila/manila/quota.py:1063}} May 28 13:04:01 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.resource_tracker [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Hypervisor/Node resource view: name=l75lg1-v1 free_ram=10106MB free_disk=15.5379638671875GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_01_1", "address": "0000:00:01.1", "product_id": "7010", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7010", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7000", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7000", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "0100", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_0100", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_09_0", "address": "0000:00:09.0", "product_id": "1001", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1001", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "293a", "vendor_id": "8086", "numa_node": null, "label": "label_8086_293a", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_2", "address": "0000:00:07.2", "product_id": "2936", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2936", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "1237", "vendor_id": "8086", "numa_node": null, "label": "label_8086_1237", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "2935", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2935", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "2934", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2934", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_05_0", "address": "0000:00:05.0", "product_id": "1000", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1000", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "1000", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1000", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_06_0", "address": "0000:00:06.0", "product_id": "2668", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2668", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "1000", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1000", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0a_0", "address": "0000:00:0a.0", "product_id": "1002", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1002", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_3", "address": "0000:00:01.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_08_0", "address": "0000:00:08.0", "product_id": "1003", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1003", "dev_type": "type-PCI"}] {{(pid=83654) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}} May 28 13:04:01 l75lg1-v1 nova-compute[83654]: DEBUG oslo_concurrency.lockutils [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=83654) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:04:01 l75lg1-v1 nova-compute[83654]: DEBUG oslo_concurrency.lockutils [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=83654) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:04:01 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Expecting reply to msg 62636366b8b64b029cfe2e384422c63f in queue reply_37f4cbd1dd094961a22b8a65f222c327 May 28 13:04:01 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [-] Received RPC response for msg 62636366b8b64b029cfe2e384422c63f May 28 13:04:01 l75lg1-v1 dstat.sh[49771]: 28-05 13:04:01| 2 1 96 1 0|5517M 1897M 278M 7932M| 13k 66B| 0 612k| 0 94.0 |3854 6635 |0.70 1.02 1.02| 0 1.0 0| 0 0 | 0 2048M| 29 359 0 7 6 May 28 13:04:01 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Expecting reply to msg d1eba05be8a74b0094715bef79e624c7 in queue reply_37f4cbd1dd094961a22b8a65f222c327 May 28 13:04:01 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [-] Received RPC response for msg d1eba05be8a74b0094715bef79e624c7 May 28 13:04:02 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-f6605e4b-8d3d-4fca-b534-443bec3cbc98 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] GET http://10.27.203.238/share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/snapshots/cff0744c-aefe-421e-b8b7-055f24614a39 May 28 13:04:02 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-f6605e4b-8d3d-4fca-b534-443bec3cbc98 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:04:02 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-f6605e4b-8d3d-4fca-b534-443bec3cbc98 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Calling method 'ShareSnapshotMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:04:02 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-f6605e4b-8d3d-4fca-b534-443bec3cbc98 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] HTTP exception thrown: The resource could not be found. May 28 13:04:02 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-f6605e4b-8d3d-4fca-b534-443bec3cbc98 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] http://10.27.203.238/share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/snapshots/cff0744c-aefe-421e-b8b7-055f24614a39 returned with HTTP 404 May 28 13:04:02 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1334/2688] 10.27.203.238 () {64 vars in 1460 bytes} [Tue May 28 13:04:02 2024] GET /share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/snapshots/cff0744c-aefe-421e-b8b7-055f24614a39 => generated 78 bytes in 14 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 13:04:02 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-54ad1b71-26e2-4408-bda6-69d2cc1da258 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] GET http://10.27.203.238/share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/share-replicas/detail?share_id=f4d62492-698d-44ff-a5f4-f6b156775dbd May 28 13:04:02 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-54ad1b71-26e2-4408-bda6-69d2cc1da258 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:04:02 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-54ad1b71-26e2-4408-bda6-69d2cc1da258 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:04:02 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-54ad1b71-26e2-4408-bda6-69d2cc1da258 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] http://10.27.203.238/share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/share-replicas/detail?share_id=f4d62492-698d-44ff-a5f4-f6b156775dbd returned with HTTP 200 May 28 13:04:02 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1355/2689] 10.27.203.238 () {64 vars in 1476 bytes} [Tue May 28 13:04:02 2024] GET /share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/share-replicas/detail?share_id=f4d62492-698d-44ff-a5f4-f6b156775dbd => generated 22 bytes in 13 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:04:02 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-c432015a-49c6-4d33-bd0c-751ba05d28e8 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] DELETE http://10.27.203.238/share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/f4d62492-698d-44ff-a5f4-f6b156775dbd May 28 13:04:02 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-c432015a-49c6-4d33-bd0c-751ba05d28e8 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:04:02 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-c432015a-49c6-4d33-bd0c-751ba05d28e8 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Calling method 'ShareMixin.delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:04:02 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.v1.shares [None req-c432015a-49c6-4d33-bd0c-751ba05d28e8 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Delete share with id: f4d62492-698d-44ff-a5f4-f6b156775dbd May 28 13:04:02 l75lg1-v1 devstack@placement-api.service[78202]: DEBUG placement.requestlog [req-83aabd7a-0ab5-4bd7-a122-1a3584e2ff9b req-f28c513e-342e-4995-93d0-d95361047f1d None None] Starting request: 10.27.203.238 "GET /placement/resource_providers/ef90d7d1-0808-4a15-ad77-f9a7391af2f4/allocations" {{(pid=78202) __call__ /opt/stack/placement/placement/requestlog.py:55}} May 28 13:04:02 l75lg1-v1 devstack@placement-api.service[78202]: INFO placement.requestlog [req-83aabd7a-0ab5-4bd7-a122-1a3584e2ff9b req-f28c513e-342e-4995-93d0-d95361047f1d service placement] 10.27.203.238 "GET /placement/resource_providers/ef90d7d1-0808-4a15-ad77-f9a7391af2f4/allocations" status: 200 len: 54 microversion: 1.0 May 28 13:04:02 l75lg1-v1 devstack@placement-api.service[78202]: [pid: 78202|app: 0|req: 31/61] 10.27.203.238 () {62 vars in 1480 bytes} [Tue May 28 13:04:02 2024] GET /placement/resource_providers/ef90d7d1-0808-4a15-ad77-f9a7391af2f4/allocations => generated 54 bytes in 11 msecs (HTTP/1.1 200) 6 headers in 223 bytes (1 switches on core 0) May 28 13:04:02 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.resource_tracker [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Total usable vcpus: 10, total allocated vcpus: 0 {{(pid=83654) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}} May 28 13:04:02 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.resource_tracker [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Final resource view: name=l75lg1-v1 phys_ram=16000MB used_ram=512MB phys_disk=28GB used_disk=0GB total_vcpus=10 used_vcpus=0 pci_stats=[] {{(pid=83654) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}} May 28 13:04:02 l75lg1-v1 devstack@placement-api.service[78201]: DEBUG placement.requestlog [req-83aabd7a-0ab5-4bd7-a122-1a3584e2ff9b req-ca5b528c-1850-4b8e-888f-b0e3efe4f609 None None] Starting request: 10.27.203.238 "GET /placement/resource_providers/ef90d7d1-0808-4a15-ad77-f9a7391af2f4/allocations" {{(pid=78201) __call__ /opt/stack/placement/placement/requestlog.py:55}} May 28 13:04:02 l75lg1-v1 devstack@placement-api.service[78201]: INFO placement.requestlog [req-83aabd7a-0ab5-4bd7-a122-1a3584e2ff9b req-ca5b528c-1850-4b8e-888f-b0e3efe4f609 service placement] 10.27.203.238 "GET /placement/resource_providers/ef90d7d1-0808-4a15-ad77-f9a7391af2f4/allocations" status: 200 len: 54 microversion: 1.0 May 28 13:04:02 l75lg1-v1 devstack@placement-api.service[78201]: [pid: 78201|app: 0|req: 31/62] 10.27.203.238 () {62 vars in 1480 bytes} [Tue May 28 13:04:02 2024] GET /placement/resource_providers/ef90d7d1-0808-4a15-ad77-f9a7391af2f4/allocations => generated 54 bytes in 12 msecs (HTTP/1.1 200) 6 headers in 223 bytes (1 switches on core 0) May 28 13:04:02 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.provider_tree [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Inventory has not changed in ProviderTree for provider: ef90d7d1-0808-4a15-ad77-f9a7391af2f4 {{(pid=83654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} May 28 13:04:02 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Expecting reply to msg 0d96c2c21a324165acc7b0aae988393c in queue reply_37f4cbd1dd094961a22b8a65f222c327 May 28 13:04:02 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [-] Received RPC response for msg 0d96c2c21a324165acc7b0aae988393c May 28 13:04:02 l75lg1-v1 dstat.sh[49771]: 28-05 13:04:02| 3 1 96 0 0|5517M 1897M 278M 7932M| 13k 0 | 0 588k| 0 54.0 |2702 4187 |0.70 1.02 1.02|1.0 0 0| 0 0 | 0 2048M| 29 360 0 7 6 May 28 13:04:02 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-c432015a-49c6-4d33-bd0c-751ba05d28e8 tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] http://10.27.203.238/share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/f4d62492-698d-44ff-a5f4-f6b156775dbd returned with HTTP 202 May 28 13:04:02 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1335/2690] 10.27.203.238 () {64 vars in 1454 bytes} [Tue May 28 13:04:02 2024] DELETE /share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/f4d62492-698d-44ff-a5f4-f6b156775dbd => generated 0 bytes in 121 msecs (HTTP/1.1 202) 6 headers in 243 bytes (2 switches on core 0) May 28 13:04:02 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-2c1939bf-d82b-4283-bf46-7fe16c31a06b tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] GET http://10.27.203.238/share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/f4d62492-698d-44ff-a5f4-f6b156775dbd May 28 13:04:02 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-2c1939bf-d82b-4283-bf46-7fe16c31a06b tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:04:02 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-2c1939bf-d82b-4283-bf46-7fe16c31a06b tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:04:02 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-2c1939bf-d82b-4283-bf46-7fe16c31a06b tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] http://10.27.203.238/share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/f4d62492-698d-44ff-a5f4-f6b156775dbd returned with HTTP 200 May 28 13:04:02 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1356/2691] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:04:02 2024] GET /share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/f4d62492-698d-44ff-a5f4-f6b156775dbd => generated 1418 bytes in 30 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:04:02 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c432015a-49c6-4d33-bd0c-751ba05d28e8 tempest-SharesActionsTest-682704550 None] Acquiring lock "locked_access_rules_operation_by_share_instance_4e3de968-00b8-414a-b562-a9b4001115dd" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:04:02 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c432015a-49c6-4d33-bd0c-751ba05d28e8 tempest-SharesActionsTest-682704550 None] Lock "locked_access_rules_operation_by_share_instance_4e3de968-00b8-414a-b562-a9b4001115dd" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:04:02 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c432015a-49c6-4d33-bd0c-751ba05d28e8 tempest-SharesActionsTest-682704550 None] Lock "locked_access_rules_operation_by_share_instance_4e3de968-00b8-414a-b562-a9b4001115dd" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:04:02 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c432015a-49c6-4d33-bd0c-751ba05d28e8 tempest-SharesActionsTest-682704550 None] Acquiring lock "locked_access_rules_operation_by_share_instance_4e3de968-00b8-414a-b562-a9b4001115dd" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:04:02 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c432015a-49c6-4d33-bd0c-751ba05d28e8 tempest-SharesActionsTest-682704550 None] Lock "locked_access_rules_operation_by_share_instance_4e3de968-00b8-414a-b562-a9b4001115dd" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:04:02 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c432015a-49c6-4d33-bd0c-751ba05d28e8 tempest-SharesActionsTest-682704550 None] Lock "locked_access_rules_operation_by_share_instance_4e3de968-00b8-414a-b562-a9b4001115dd" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:04:02 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c432015a-49c6-4d33-bd0c-751ba05d28e8 tempest-SharesActionsTest-682704550 None] Acquiring lock "locked_access_rules_operation_by_share_instance_4e3de968-00b8-414a-b562-a9b4001115dd" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:04:02 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c432015a-49c6-4d33-bd0c-751ba05d28e8 tempest-SharesActionsTest-682704550 None] Lock "locked_access_rules_operation_by_share_instance_4e3de968-00b8-414a-b562-a9b4001115dd" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:04:02 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c432015a-49c6-4d33-bd0c-751ba05d28e8 tempest-SharesActionsTest-682704550 None] Lock "locked_access_rules_operation_by_share_instance_4e3de968-00b8-414a-b562-a9b4001115dd" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:04:02 l75lg1-v1 manila-share[98474]: DEBUG manila.share.access [None req-c432015a-49c6-4d33-bd0c-751ba05d28e8 tempest-SharesActionsTest-682704550 None] All access rules have been synced for share instance 4e3de968-00b8-414a-b562-a9b4001115dd belonging to share f4d62492-698d-44ff-a5f4-f6b156775dbd. {{(pid=98474) update_access_rules /opt/stack/manila/manila/share/access.py:304}} May 28 13:04:02 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-c432015a-49c6-4d33-bd0c-751ba05d28e8 tempest-SharesActionsTest-682704550 None] deleting '/manila/manila-4e3de968-00b8-414a-b562-a9b4001115dd' May 28 13:04:02 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c432015a-49c6-4d33-bd0c-751ba05d28e8 tempest-SharesActionsTest-682704550 None] >>> [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/ May 28 13:04:02 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c432015a-49c6-4d33-bd0c-751ba05d28e8 tempest-SharesActionsTest-682704550 None] {'data': '{"path": "/manila/manila-4e3de968-00b8-414a-b562-a9b4001115dd"}', May 28 13:04:02 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c432015a-49c6-4d33-bd0c-751ba05d28e8 tempest-SharesActionsTest-682704550 None] 'params': None} May 28 13:04:02 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c432015a-49c6-4d33-bd0c-751ba05d28e8 tempest-SharesActionsTest-682704550 None] <<< [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/ May 28 13:04:02 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c432015a-49c6-4d33-bd0c-751ba05d28e8 tempest-SharesActionsTest-682704550 None] 'OK' May 28 13:04:02 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c432015a-49c6-4d33-bd0c-751ba05d28e8 tempest-SharesActionsTest-682704550 None] --- [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/: Done May 28 13:04:02 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c432015a-49c6-4d33-bd0c-751ba05d28e8 tempest-SharesActionsTest-682704550 None] >>> [GET] https://127.0.0.1:40443/api/views/ May 28 13:04:02 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c432015a-49c6-4d33-bd0c-751ba05d28e8 tempest-SharesActionsTest-682704550 None] {'allow_redirects': True, May 28 13:04:02 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c432015a-49c6-4d33-bd0c-751ba05d28e8 tempest-SharesActionsTest-682704550 None] 'params': {'name': '4e3de968-00b8-414a-b562-a9b4001115dd'}} May 28 13:04:02 l75lg1-v1 nova-compute[83654]: DEBUG nova.scheduler.client.report [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Inventory has not changed for provider ef90d7d1-0808-4a15-ad77-f9a7391af2f4 based on inventory data: {'VCPU': {'total': 10, 'reserved': 0, 'min_unit': 1, 'max_unit': 10, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16000, 'reserved': 512, 'min_unit': 1, 'max_unit': 16000, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 28, 'reserved': 0, 'min_unit': 1, 'max_unit': 28, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=83654) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}} May 28 13:04:02 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.resource_tracker [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Compute_service record updated for l75lg1-v1:l75lg1-v1 {{(pid=83654) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}} May 28 13:04:02 l75lg1-v1 nova-compute[83654]: DEBUG oslo_concurrency.lockutils [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.555s {{(pid=83654) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:04:02 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c432015a-49c6-4d33-bd0c-751ba05d28e8 tempest-SharesActionsTest-682704550 None] <<< [GET] https://127.0.0.1:40443/api/views/ May 28 13:04:02 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c432015a-49c6-4d33-bd0c-751ba05d28e8 tempest-SharesActionsTest-682704550 None] [Bunch(abac_tags=[], abe_max_depth=None, abe_protocols=[], alias='', allow_anonymous_access=False, allow_s3_anonymous_access=False, auto_commit='0d', bucket='', bucket_creators=[], bucket_creators_groups=[], bucket_owner=None, bulk_permission_update_progress=None, bulk_permission_update_state=None, cluster='loop75-kfs', cluster_id=1, created='2024-05-28T13:02:51.993158Z', enabled=True, files_retention_mode='NONE', guid='703fe4f1-bf9d-43d5-96ef-af187cbba849', id=57, ignore_oos=False, internal=False, is_remote=False, is_seamless=False, logical_capacity=0, max_retention_period='0d', min_retention_period='0d', name='4e3de968-00b8-414a-b562-a9b4001115dd', nfs_interop_flags='BOTH_NFS3_AND_NFS4_INTEROP_DISABLED', path='/manila/manila-4e3de968-00b8-414a-b562-a9b4001115dd', physical_capacity=0, policy='4e3de968-00b8-414a-b562-a9b4001115dd', policy_id=58, protocols=['NFS'], qos_policy=None, qos_policy_id=None, s3_locks=False, s3_locks_retention_mode='NONE', s3_locks_retention_period='', s3_unverified_lookup=False, s3_versioning=False, select_for_live_monitoring=False, share='', share_acl=Bunch(acl=[], enabled=False), sync='SYNCED', sync_time='2024-05-28T13:03:08.448420Z', tenant_id=1, tenant_name='default', title='/manila/manila-4e3de968-00b8-414a-b562-a9b4001115dd', url='https://127.0.0.1:40443/api/views/57/')] May 28 13:04:02 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c432015a-49c6-4d33-bd0c-751ba05d28e8 tempest-SharesActionsTest-682704550 None] --- [GET] https://127.0.0.1:40443/api/views/: Done May 28 13:04:02 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c432015a-49c6-4d33-bd0c-751ba05d28e8 tempest-SharesActionsTest-682704550 None] >>> [DELETE] https://127.0.0.1:40443/api/views/57/ May 28 13:04:03 l75lg1-v1 dstat.sh[49771]: 28-05 13:04:03| 3 1 96 0 0|5517M 1897M 278M 7932M| 19k 2234B| 0 464k| 0 55.0 |2569 3915 |0.73 1.02 1.02| 0 0 0| 0 0 | 0 2048M| 29 359 0 7 6 May 28 13:04:04 l75lg1-v1 dstat.sh[49771]: 28-05 13:04:04| 0 0 99 0 0|5517M 1897M 278M 7932M| 13k 0 | 0 184k| 0 13.0 |1419 2263 |0.73 1.02 1.02|1.0 0 0| 0 0 | 0 2048M| 29 359 0 4 6 May 28 13:04:04 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 13:04:04 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c432015a-49c6-4d33-bd0c-751ba05d28e8 tempest-SharesActionsTest-682704550 None] <<< [DELETE] https://127.0.0.1:40443/api/views/57/ May 28 13:04:04 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c432015a-49c6-4d33-bd0c-751ba05d28e8 tempest-SharesActionsTest-682704550 None] --- [DELETE] https://127.0.0.1:40443/api/views/57/: Done May 28 13:04:04 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c432015a-49c6-4d33-bd0c-751ba05d28e8 tempest-SharesActionsTest-682704550 None] >>> [GET] https://127.0.0.1:40443/api/quotas/ May 28 13:04:04 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c432015a-49c6-4d33-bd0c-751ba05d28e8 tempest-SharesActionsTest-682704550 None] {'allow_redirects': True, May 28 13:04:04 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c432015a-49c6-4d33-bd0c-751ba05d28e8 tempest-SharesActionsTest-682704550 None] 'params': {'name': '4e3de968-00b8-414a-b562-a9b4001115dd'}} May 28 13:04:05 l75lg1-v1 dstat.sh[49771]: 28-05 13:04:05| 1 0 98 0 0|5517M 1897M 278M 7932M| 13k 670B| 0 124k| 0 16.0 |1710 2791 |0.73 1.02 1.02|1.0 0 0| 0 0 | 0 2048M| 29 359 0 4 6 May 28 13:04:05 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c432015a-49c6-4d33-bd0c-751ba05d28e8 tempest-SharesActionsTest-682704550 None] <<< [GET] https://127.0.0.1:40443/api/quotas/ May 28 13:04:05 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c432015a-49c6-4d33-bd0c-751ba05d28e8 tempest-SharesActionsTest-682704550 None] [Bunch(cluster='loop75-kfs', cluster_id=1, default_email=None, default_group_quota=None, default_user_quota=None, enable_alarms=True, enable_email_providers=True, grace_period=None, guid='70832072-1955-4a61-836f-71fd20a1e749', hard_limit=1073741824, hard_limit_inodes=None, id=55, internal=False, is_user_quota=False, last_user_quotas_update=None, name='4e3de968-00b8-414a-b562-a9b4001115dd', num_blocked_users=0, num_exceeded_users=0, path='/manila/manila-4e3de968-00b8-414a-b562-a9b4001115dd', percent_capacity=0, percent_inodes=None, pretty_grace_period=None, pretty_grace_period_expiration=None, pretty_state='OK', soft_limit=None, soft_limit_inodes=None, state='OK', sync_state='SYNCHRONIZED', system_id=55, tenant_id=1, tenant_name='default', time_to_block=None, title='4e3de968-00b8-414a-b562-a9b4001115dd', url='https://127.0.0.1:40443/api/quotas/55/', used_capacity=0, used_capacity_tb=0.0, used_effective_capacity=0, used_effective_capacity_tb=0.0, used_inodes=1, used_limited_capacity=0)] May 28 13:04:05 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c432015a-49c6-4d33-bd0c-751ba05d28e8 tempest-SharesActionsTest-682704550 None] --- [GET] https://127.0.0.1:40443/api/quotas/: Done May 28 13:04:05 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c432015a-49c6-4d33-bd0c-751ba05d28e8 tempest-SharesActionsTest-682704550 None] >>> [DELETE] https://127.0.0.1:40443/api/quotas/55/ May 28 13:04:05 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-d0a000ca-0dbd-4dba-b697-7fa5f81e95cb tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] GET http://10.27.203.238/share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/f4d62492-698d-44ff-a5f4-f6b156775dbd May 28 13:04:05 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-d0a000ca-0dbd-4dba-b697-7fa5f81e95cb tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:04:05 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-d0a000ca-0dbd-4dba-b697-7fa5f81e95cb tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:04:05 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-d0a000ca-0dbd-4dba-b697-7fa5f81e95cb tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] http://10.27.203.238/share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/f4d62492-698d-44ff-a5f4-f6b156775dbd returned with HTTP 200 May 28 13:04:05 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1336/2692] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:04:05 2024] GET /share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/f4d62492-698d-44ff-a5f4-f6b156775dbd => generated 1418 bytes in 27 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:04:06 l75lg1-v1 dstat.sh[49771]: 28-05 13:04:06| 1 0 98 1 0|5517M 1897M 278M 7932M| 12k 654B| 0 900k| 0 67.0 |1816 2863 |0.73 1.02 1.02|1.0 0 0| 0 0 | 0 2048M| 29 359 0 4 6 May 28 13:04:07 l75lg1-v1 dstat.sh[49771]: 28-05 13:04:07| 1 0 99 0 0|5517M 1897M 278M 7932M| 12k 0 | 0 96k| 0 14.0 |1604 2598 |0.73 1.02 1.02|1.0 0 0| 0 0 | 0 2048M| 29 359 0 4 6 May 28 13:04:07 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c432015a-49c6-4d33-bd0c-751ba05d28e8 tempest-SharesActionsTest-682704550 None] <<< [DELETE] https://127.0.0.1:40443/api/quotas/55/ May 28 13:04:07 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c432015a-49c6-4d33-bd0c-751ba05d28e8 tempest-SharesActionsTest-682704550 None] --- [DELETE] https://127.0.0.1:40443/api/quotas/55/: Done May 28 13:04:07 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c432015a-49c6-4d33-bd0c-751ba05d28e8 tempest-SharesActionsTest-682704550 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:04:07 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c432015a-49c6-4d33-bd0c-751ba05d28e8 tempest-SharesActionsTest-682704550 None] {'allow_redirects': True, May 28 13:04:07 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c432015a-49c6-4d33-bd0c-751ba05d28e8 tempest-SharesActionsTest-682704550 None] 'params': {'name': '4e3de968-00b8-414a-b562-a9b4001115dd'}} May 28 13:04:08 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c432015a-49c6-4d33-bd0c-751ba05d28e8 tempest-SharesActionsTest-682704550 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:04:08 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c432015a-49c6-4d33-bd0c-751ba05d28e8 tempest-SharesActionsTest-682704550 None] [Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=0, created='2024-05-28T13:02:49.220352Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='6d77d519-0f5e-4734-9d9a-0b7c040b16ba', id=58, internal=False, is_s3_default_policy=False, name='4e3de968-00b8-414a-b562-a9b4001115dd', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=[], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['*'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['*'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T13:02:49.548295Z', tenant_id=1, tenant_name='default', title='4e3de968-00b8-414a-b562-a9b4001115dd', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/58/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[])] May 28 13:04:08 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c432015a-49c6-4d33-bd0c-751ba05d28e8 tempest-SharesActionsTest-682704550 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 13:04:08 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c432015a-49c6-4d33-bd0c-751ba05d28e8 tempest-SharesActionsTest-682704550 None] >>> [DELETE] https://127.0.0.1:40443/api/viewpolicies/58/ May 28 13:04:08 l75lg1-v1 dstat.sh[49771]: 28-05 13:04:08| 1 0 99 0 0|5517M 1896M 278M 7932M| 13k 907B| 0 0 | 0 0 |1488 2367 |0.67 1.00 1.02|3.0 0 2.0| 0 0 | 0 2048M| 29 359 0 4 6 May 28 13:04:08 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-babb7d80-0f80-413e-9a2e-69b9f869df9b tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] GET http://10.27.203.238/share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/f4d62492-698d-44ff-a5f4-f6b156775dbd May 28 13:04:08 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-babb7d80-0f80-413e-9a2e-69b9f869df9b tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:04:08 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-babb7d80-0f80-413e-9a2e-69b9f869df9b tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:04:08 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-babb7d80-0f80-413e-9a2e-69b9f869df9b tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] http://10.27.203.238/share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/f4d62492-698d-44ff-a5f4-f6b156775dbd returned with HTTP 200 May 28 13:04:08 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1357/2693] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:04:08 2024] GET /share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/f4d62492-698d-44ff-a5f4-f6b156775dbd => generated 1418 bytes in 25 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:04:09 l75lg1-v1 dstat.sh[49771]: 28-05 13:04:09| 1 0 98 0 0|5517M 1896M 278M 7932M| 10k 655B| 0 8200B| 0 1.00 |1499 2382 |0.67 1.00 1.02|1.0 0 0| 0 0 | 0 2048M| 29 359 0 4 6 May 28 13:04:09 l75lg1-v1 nova-conductor[83647]: DEBUG dbcounter [-] [83647] Writing DB stats nova_cell1:SELECT=1,nova_cell1:UPDATE=1 {{(pid=83647) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:04:09 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c432015a-49c6-4d33-bd0c-751ba05d28e8 tempest-SharesActionsTest-682704550 None] <<< [DELETE] https://127.0.0.1:40443/api/viewpolicies/58/ May 28 13:04:09 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c432015a-49c6-4d33-bd0c-751ba05d28e8 tempest-SharesActionsTest-682704550 None] --- [DELETE] https://127.0.0.1:40443/api/viewpolicies/58/: Done May 28 13:04:09 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-c432015a-49c6-4d33-bd0c-751ba05d28e8 tempest-SharesActionsTest-682704550 None] Created reservations ['20efda2b-bf76-4805-a2fc-d9864be8285c', 'a2aaa526-ec3d-41d9-8496-e9f92d1b574e', 'efa81309-77d8-4763-88bb-044bf264b3e1', 'b71487d9-d25f-4880-a526-155a2401db1b'] {{(pid=98474) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 13:04:09 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-c432015a-49c6-4d33-bd0c-751ba05d28e8 tempest-SharesActionsTest-682704550 None] Committed reservations ['20efda2b-bf76-4805-a2fc-d9864be8285c', 'a2aaa526-ec3d-41d9-8496-e9f92d1b574e', 'efa81309-77d8-4763-88bb-044bf264b3e1', 'b71487d9-d25f-4880-a526-155a2401db1b'] {{(pid=98474) commit /opt/stack/manila/manila/quota.py:1063}} May 28 13:04:09 l75lg1-v1 manila-share[98474]: INFO manila.share.manager [None req-c432015a-49c6-4d33-bd0c-751ba05d28e8 tempest-SharesActionsTest-682704550 None] Share instance 4e3de968-00b8-414a-b562-a9b4001115dd: deleted successfully. May 28 13:04:10 l75lg1-v1 dstat.sh[49771]: 28-05 13:04:10| 1 0 97 1 0|5517M 1896M 278M 7932M| 14k 66B| 0 1964k| 0 393 |2438 3995 |0.67 1.00 1.02| 0 0 0| 0 0 | 0 2048M| 29 359 0 4 6 May 28 13:04:10 l75lg1-v1 neutron-server[77618]: DEBUG dbcounter [-] [77618] Writing DB stats neutron:UPDATE=1 {{(pid=77618) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:04:10 l75lg1-v1 neutron-server[77618]: DEBUG dbcounter [-] [77618] Writing DB stats neutron:SELECT=1 {{(pid=77618) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:04:11 l75lg1-v1 dstat.sh[49771]: 28-05 13:04:11| 1 0 99 0 0|5517M 1896M 278M 7932M| 11k 0 | 0 240k| 0 22.0 |1591 2529 |0.67 1.00 1.02| 0 0 0| 0 0 | 0 2048M| 29 359 0 4 6 May 28 13:04:11 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-a4602ba4-0a2e-4663-8d2c-70f62a7096ec tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] GET http://10.27.203.238/share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/f4d62492-698d-44ff-a5f4-f6b156775dbd May 28 13:04:11 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-a4602ba4-0a2e-4663-8d2c-70f62a7096ec tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:04:11 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-a4602ba4-0a2e-4663-8d2c-70f62a7096ec tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:04:11 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-a4602ba4-0a2e-4663-8d2c-70f62a7096ec tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] HTTP exception thrown: The resource could not be found. May 28 13:04:11 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-a4602ba4-0a2e-4663-8d2c-70f62a7096ec tempest-SharesActionsTest-682704550 tempest-SharesActionsTest-682704550-project-member] http://10.27.203.238/share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/f4d62492-698d-44ff-a5f4-f6b156775dbd returned with HTTP 404 May 28 13:04:11 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1337/2694] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:04:11 2024] GET /share/v2/718814c61c8c40e7bf78dd9d84d3b1f1/shares/f4d62492-698d-44ff-a5f4-f6b156775dbd => generated 78 bytes in 13 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 13:04:11 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-812bbfd0-862a-4abe-9e7d-247a125c1b9a tempest-SharesActionsTest-2125642311 tempest-SharesActionsTest-2125642311-project-admin] DELETE http://10.27.203.238/share/v2/633b6f74527b48408dad0eedac73931e/types/49315d96-de20-4c8a-ac49-f57e8d1b1e18 May 28 13:04:11 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-812bbfd0-862a-4abe-9e7d-247a125c1b9a tempest-SharesActionsTest-2125642311 tempest-SharesActionsTest-2125642311-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:04:11 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-812bbfd0-862a-4abe-9e7d-247a125c1b9a tempest-SharesActionsTest-2125642311 tempest-SharesActionsTest-2125642311-project-admin] Calling method 'ShareTypesController._delete' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:04:11 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-812bbfd0-862a-4abe-9e7d-247a125c1b9a tempest-SharesActionsTest-2125642311 tempest-SharesActionsTest-2125642311-project-admin] http://10.27.203.238/share/v2/633b6f74527b48408dad0eedac73931e/types/49315d96-de20-4c8a-ac49-f57e8d1b1e18 returned with HTTP 202 May 28 13:04:11 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1358/2695] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:04:11 2024] DELETE /share/v2/633b6f74527b48408dad0eedac73931e/types/49315d96-de20-4c8a-ac49-f57e8d1b1e18 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 13:04:11 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-b23b4d06-7c9d-4cff-8560-31b2571b86f3 tempest-SharesActionsTest-2125642311 tempest-SharesActionsTest-2125642311-project-admin] GET http://10.27.203.238/share/v2/633b6f74527b48408dad0eedac73931e/types/49315d96-de20-4c8a-ac49-f57e8d1b1e18 May 28 13:04:11 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-b23b4d06-7c9d-4cff-8560-31b2571b86f3 tempest-SharesActionsTest-2125642311 tempest-SharesActionsTest-2125642311-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:04:11 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-b23b4d06-7c9d-4cff-8560-31b2571b86f3 tempest-SharesActionsTest-2125642311 tempest-SharesActionsTest-2125642311-project-admin] Calling method 'ShareTypesController.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:04:11 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-b23b4d06-7c9d-4cff-8560-31b2571b86f3 tempest-SharesActionsTest-2125642311 tempest-SharesActionsTest-2125642311-project-admin] HTTP exception thrown: Share type not found. May 28 13:04:11 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-b23b4d06-7c9d-4cff-8560-31b2571b86f3 tempest-SharesActionsTest-2125642311 tempest-SharesActionsTest-2125642311-project-admin] http://10.27.203.238/share/v2/633b6f74527b48408dad0eedac73931e/types/49315d96-de20-4c8a-ac49-f57e8d1b1e18 returned with HTTP 404 May 28 13:04:11 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1338/2696] 10.27.203.238 () {64 vars in 1448 bytes} [Tue May 28 13:04:11 2024] GET /share/v2/633b6f74527b48408dad0eedac73931e/types/49315d96-de20-4c8a-ac49-f57e8d1b1e18 => generated 67 bytes in 10 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 13:04:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe1eecd-b2ec-4527-8451-7f033f7c2218 tempest-SharesActionsTest-2125642311 tempest-SharesActionsTest-2125642311-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:04:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-4fe1eecd-b2ec-4527-8451-7f033f7c2218 tempest-SharesActionsTest-2125642311 tempest-SharesActionsTest-2125642311-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:04:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe1eecd-b2ec-4527-8451-7f033f7c2218 tempest-SharesActionsTest-2125642311 tempest-SharesActionsTest-2125642311-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:04:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15566db-77d4-45e3-9946-b7f6b6e8f14c None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:04:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15566db-77d4-45e3-9946-b7f6b6e8f14c None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:04:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15566db-77d4-45e3-9946-b7f6b6e8f14c None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:04:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15566db-77d4-45e3-9946-b7f6b6e8f14c None admin] PATH_INFO: `/v3/users/403da4ed21a14ebba08f20d5f408f84e` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:04:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15566db-77d4-45e3-9946-b7f6b6e8f14c None admin] RBAC: Authorizing `identity:delete_user(user_id=403da4ed21a14ebba08f20d5f408f84e)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:04:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15566db-77d4-45e3-9946-b7f6b6e8f14c None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:04:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-f15566db-77d4-45e3-9946-b7f6b6e8f14c None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '403da4ed21a14ebba08f20d5f408f84e', 'request_id': 'req-f15566db-77d4-45e3-9946-b7f6b6e8f14c'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:04:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-f15566db-77d4-45e3-9946-b7f6b6e8f14c None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '403da4ed21a14ebba08f20d5f408f84e', 'request_id': 'req-f15566db-77d4-45e3-9946-b7f6b6e8f14c'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:04:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-f15566db-77d4-45e3-9946-b7f6b6e8f14c None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '403da4ed21a14ebba08f20d5f408f84e', 'request_id': 'req-f15566db-77d4-45e3-9946-b7f6b6e8f14c'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:04:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-f15566db-77d4-45e3-9946-b7f6b6e8f14c None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '403da4ed21a14ebba08f20d5f408f84e', 'request_id': 'req-f15566db-77d4-45e3-9946-b7f6b6e8f14c'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:04:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-f15566db-77d4-45e3-9946-b7f6b6e8f14c None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '403da4ed21a14ebba08f20d5f408f84e', 'request_id': 'req-f15566db-77d4-45e3-9946-b7f6b6e8f14c'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:04:11 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1810/3651] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 13:04:11 2024] DELETE /identity/v3/users/403da4ed21a14ebba08f20d5f408f84e => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:04:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac29520-6405-45e9-b51a-7921ac0e3967 tempest-SharesActionsTest-2125642311 tempest-SharesActionsTest-2125642311-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:04:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac29520-6405-45e9-b51a-7921ac0e3967 tempest-SharesActionsTest-2125642311 tempest-SharesActionsTest-2125642311-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:04:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bad5582-8566-47d8-839f-10fcd368b9f6 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:04:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bad5582-8566-47d8-839f-10fcd368b9f6 None admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:04:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bad5582-8566-47d8-839f-10fcd368b9f6 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:04:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bad5582-8566-47d8-839f-10fcd368b9f6 None admin] PATH_INFO: `/v3/users/b2451a1c4da4401f82f93054bcab5f09` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:04:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bad5582-8566-47d8-839f-10fcd368b9f6 None admin] RBAC: Authorizing `identity:delete_user(user_id=b2451a1c4da4401f82f93054bcab5f09)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:04:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bad5582-8566-47d8-839f-10fcd368b9f6 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:04:11 l75lg1-v1 nova-conductor[83648]: DEBUG dbcounter [-] [83648] Writing DB stats nova_cell1:SELECT=3 {{(pid=83648) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:04:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-4bad5582-8566-47d8-839f-10fcd368b9f6 None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2451a1c4da4401f82f93054bcab5f09', 'request_id': 'req-4bad5582-8566-47d8-839f-10fcd368b9f6'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:04:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-4bad5582-8566-47d8-839f-10fcd368b9f6 None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2451a1c4da4401f82f93054bcab5f09', 'request_id': 'req-4bad5582-8566-47d8-839f-10fcd368b9f6'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:04:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-4bad5582-8566-47d8-839f-10fcd368b9f6 None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2451a1c4da4401f82f93054bcab5f09', 'request_id': 'req-4bad5582-8566-47d8-839f-10fcd368b9f6'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:04:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-4bad5582-8566-47d8-839f-10fcd368b9f6 None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2451a1c4da4401f82f93054bcab5f09', 'request_id': 'req-4bad5582-8566-47d8-839f-10fcd368b9f6'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:04:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-4bad5582-8566-47d8-839f-10fcd368b9f6 None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2451a1c4da4401f82f93054bcab5f09', 'request_id': 'req-4bad5582-8566-47d8-839f-10fcd368b9f6'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:04:11 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.periodic_task [None req-e3486ff9-a95e-41bc-8901-df75aedbeaad None None] Running periodic task DataManager.create_backup_continue {{(pid=98318) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 13:04:11 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1842/3652] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 13:04:11 2024] DELETE /identity/v3/users/b2451a1c4da4401f82f93054bcab5f09 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:04:11 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.periodic_task [None req-e3486ff9-a95e-41bc-8901-df75aedbeaad None None] Running periodic task DataManager.restore_backup_continue {{(pid=98318) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 13:04:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15566db-77d4-45e3-9946-b7f6b6e8f14c None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:04:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-f15566db-77d4-45e3-9946-b7f6b6e8f14c None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:04:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15566db-77d4-45e3-9946-b7f6b6e8f14c None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:04:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f09d62-1f7f-4c98-9f62-dd5cce629f0a None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:04:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f09d62-1f7f-4c98-9f62-dd5cce629f0a None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:04:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f09d62-1f7f-4c98-9f62-dd5cce629f0a None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:04:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f09d62-1f7f-4c98-9f62-dd5cce629f0a None admin] PATH_INFO: `/v3/users/297c7d9ded9e4385b8d12b4e03a77bd5` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:04:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f09d62-1f7f-4c98-9f62-dd5cce629f0a None admin] RBAC: Authorizing `identity:delete_user(user_id=297c7d9ded9e4385b8d12b4e03a77bd5)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:04:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f09d62-1f7f-4c98-9f62-dd5cce629f0a None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:04:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-d8f09d62-1f7f-4c98-9f62-dd5cce629f0a None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '297c7d9ded9e4385b8d12b4e03a77bd5', 'request_id': 'req-d8f09d62-1f7f-4c98-9f62-dd5cce629f0a'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:04:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-d8f09d62-1f7f-4c98-9f62-dd5cce629f0a None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '297c7d9ded9e4385b8d12b4e03a77bd5', 'request_id': 'req-d8f09d62-1f7f-4c98-9f62-dd5cce629f0a'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:04:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-d8f09d62-1f7f-4c98-9f62-dd5cce629f0a None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '297c7d9ded9e4385b8d12b4e03a77bd5', 'request_id': 'req-d8f09d62-1f7f-4c98-9f62-dd5cce629f0a'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:04:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-d8f09d62-1f7f-4c98-9f62-dd5cce629f0a None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '297c7d9ded9e4385b8d12b4e03a77bd5', 'request_id': 'req-d8f09d62-1f7f-4c98-9f62-dd5cce629f0a'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:04:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-d8f09d62-1f7f-4c98-9f62-dd5cce629f0a None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '297c7d9ded9e4385b8d12b4e03a77bd5', 'request_id': 'req-d8f09d62-1f7f-4c98-9f62-dd5cce629f0a'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:04:11 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1811/3653] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 13:04:11 2024] DELETE /identity/v3/users/297c7d9ded9e4385b8d12b4e03a77bd5 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:04:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ff3f13-bd4b-4a74-99d1-a283deb6ecc4 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:04:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ff3f13-bd4b-4a74-99d1-a283deb6ecc4 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:04:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ff3f13-bd4b-4a74-99d1-a283deb6ecc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:04:11 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-d6ff3f13-bd4b-4a74-99d1-a283deb6ecc4 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 13:04:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-d6ff3f13-bd4b-4a74-99d1-a283deb6ecc4 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 13:04:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-d6ff3f13-bd4b-4a74-99d1-a283deb6ecc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:04:11 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1843/3654] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 13:04:11 2024] POST /identity/v3/auth/tokens => generated 2960 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 13:04:11 l75lg1-v1 neutron-server[77619]: DEBUG neutron.wsgi [-] (77619) accepted ('10.27.203.238', 40316) {{(pid=77619) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 13:04:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f09d62-1f7f-4c98-9f62-dd5cce629f0a None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:04:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-d8f09d62-1f7f-4c98-9f62-dd5cce629f0a None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:04:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f09d62-1f7f-4c98-9f62-dd5cce629f0a None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:04:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc73d544-1d8a-4c1f-ae72-aed295fb62dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef17047035e4b518fd5360a01f2da1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:04:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc73d544-1d8a-4c1f-ae72-aed295fb62dc service neutron] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:04:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc73d544-1d8a-4c1f-ae72-aed295fb62dc service neutron] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:04:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc73d544-1d8a-4c1f-ae72-aed295fb62dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:04:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc73d544-1d8a-4c1f-ae72-aed295fb62dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:04:11 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc73d544-1d8a-4c1f-ae72-aed295fb62dc service neutron] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:04:11 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1812/3655] 10.27.203.238 () {64 vars in 1432 bytes} [Tue May 28 13:04:11 2024] GET /identity/v3/auth/tokens => generated 2960 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 28 13:04:11 l75lg1-v1 neutron-server[77619]: INFO neutron.wsgi [None req-af406d6f-b240-41ad-b77a-3b9c24bc27ea None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=d076429c6ca54823a296f55e6c5b9c2d&name=default HTTP/1.1" status: 200 len: 216 time: 0.1015379 May 28 13:04:11 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ff3f13-bd4b-4a74-99d1-a283deb6ecc4 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:04:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-d6ff3f13-bd4b-4a74-99d1-a283deb6ecc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:04:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ff3f13-bd4b-4a74-99d1-a283deb6ecc4 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:04:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af43bf75-c7c8-4ff1-970d-5e26bea2a167 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:04:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af43bf75-c7c8-4ff1-970d-5e26bea2a167 None admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:04:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af43bf75-c7c8-4ff1-970d-5e26bea2a167 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:04:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af43bf75-c7c8-4ff1-970d-5e26bea2a167 None admin] PATH_INFO: `/v3/projects/d076429c6ca54823a296f55e6c5b9c2d` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:04:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af43bf75-c7c8-4ff1-970d-5e26bea2a167 None admin] RBAC: Authorizing `identity:delete_project(project_id=d076429c6ca54823a296f55e6c5b9c2d)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:04:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af43bf75-c7c8-4ff1-970d-5e26bea2a167 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:04:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-af43bf75-c7c8-4ff1-970d-5e26bea2a167 None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd076429c6ca54823a296f55e6c5b9c2d', 'request_id': 'req-af43bf75-c7c8-4ff1-970d-5e26bea2a167'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:04:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-af43bf75-c7c8-4ff1-970d-5e26bea2a167 None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd076429c6ca54823a296f55e6c5b9c2d', 'request_id': 'req-af43bf75-c7c8-4ff1-970d-5e26bea2a167'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:04:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-af43bf75-c7c8-4ff1-970d-5e26bea2a167 None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd076429c6ca54823a296f55e6c5b9c2d', 'request_id': 'req-af43bf75-c7c8-4ff1-970d-5e26bea2a167'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:04:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-af43bf75-c7c8-4ff1-970d-5e26bea2a167 None admin] The token cache is being invalidate because project d076429c6ca54823a296f55e6c5b9c2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 13:04:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-af43bf75-c7c8-4ff1-970d-5e26bea2a167 None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:04:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-af43bf75-c7c8-4ff1-970d-5e26bea2a167 None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:04:12 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1844/3656] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 13:04:11 2024] DELETE /identity/v3/projects/d076429c6ca54823a296f55e6c5b9c2d => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:04:12 l75lg1-v1 neutron-server[77619]: DEBUG neutron.wsgi [-] (77619) accepted ('10.27.203.238', 40322) {{(pid=77619) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 13:04:12 l75lg1-v1 neutron-server[77619]: INFO neutron.wsgi [None req-5df080d4-d8a1-486b-b8a8-142d75f781f8 None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=718814c61c8c40e7bf78dd9d84d3b1f1&name=default HTTP/1.1" status: 200 len: 216 time: 0.0088933 May 28 13:04:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc73d544-1d8a-4c1f-ae72-aed295fb62dc service neutron] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:04:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc73d544-1d8a-4c1f-ae72-aed295fb62dc service neutron] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:04:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8b6232-e1db-42c3-8ae8-baa58b858c4d None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:04:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8b6232-e1db-42c3-8ae8-baa58b858c4d None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:04:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8b6232-e1db-42c3-8ae8-baa58b858c4d None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:04:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8b6232-e1db-42c3-8ae8-baa58b858c4d None admin] PATH_INFO: `/v3/projects/718814c61c8c40e7bf78dd9d84d3b1f1` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:04:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8b6232-e1db-42c3-8ae8-baa58b858c4d None admin] RBAC: Authorizing `identity:delete_project(project_id=718814c61c8c40e7bf78dd9d84d3b1f1)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:04:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8b6232-e1db-42c3-8ae8-baa58b858c4d None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:04:12 l75lg1-v1 devstack@placement-api.service[78202]: DEBUG dbcounter [-] [78202] Writing DB stats placement:SELECT=2 {{(pid=78202) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:04:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-2a8b6232-e1db-42c3-8ae8-baa58b858c4d None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '718814c61c8c40e7bf78dd9d84d3b1f1', 'request_id': 'req-2a8b6232-e1db-42c3-8ae8-baa58b858c4d'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:04:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-2a8b6232-e1db-42c3-8ae8-baa58b858c4d None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '718814c61c8c40e7bf78dd9d84d3b1f1', 'request_id': 'req-2a8b6232-e1db-42c3-8ae8-baa58b858c4d'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:04:12 l75lg1-v1 devstack@placement-api.service[78201]: DEBUG dbcounter [-] [78201] Writing DB stats placement:SELECT=2 {{(pid=78201) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:04:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-2a8b6232-e1db-42c3-8ae8-baa58b858c4d None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '718814c61c8c40e7bf78dd9d84d3b1f1', 'request_id': 'req-2a8b6232-e1db-42c3-8ae8-baa58b858c4d'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:04:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-2a8b6232-e1db-42c3-8ae8-baa58b858c4d None admin] The token cache is being invalidate because project 718814c61c8c40e7bf78dd9d84d3b1f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 13:04:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-2a8b6232-e1db-42c3-8ae8-baa58b858c4d None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:04:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-2a8b6232-e1db-42c3-8ae8-baa58b858c4d None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:04:12 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1813/3657] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 13:04:12 2024] DELETE /identity/v3/projects/718814c61c8c40e7bf78dd9d84d3b1f1 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:04:12 l75lg1-v1 neutron-server[77619]: DEBUG neutron.wsgi [-] (77619) accepted ('10.27.203.238', 40330) {{(pid=77619) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 13:04:12 l75lg1-v1 neutron-server[77619]: INFO neutron.wsgi [None req-027ec326-c519-4aec-980c-3912f5591fb7 None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=633b6f74527b48408dad0eedac73931e&name=default HTTP/1.1" status: 200 len: 216 time: 0.0086820 May 28 13:04:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af43bf75-c7c8-4ff1-970d-5e26bea2a167 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:04:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-af43bf75-c7c8-4ff1-970d-5e26bea2a167 None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:04:12 l75lg1-v1 dstat.sh[49771]: 28-05 13:04:12| 9 1 87 3 0|5518M 1896M 278M 7932M| 11k 0 | 0 1548k| 0 285 |6485 12k|0.67 1.00 1.02|2.0 0 0| 0 0 | 0 2048M| 29 360 0 10 6 May 28 13:04:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af43bf75-c7c8-4ff1-970d-5e26bea2a167 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:04:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939facad-927a-48f9-be7c-9b37a59ac48a None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:04:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939facad-927a-48f9-be7c-9b37a59ac48a None admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:04:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939facad-927a-48f9-be7c-9b37a59ac48a None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:04:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939facad-927a-48f9-be7c-9b37a59ac48a None admin] PATH_INFO: `/v3/projects/633b6f74527b48408dad0eedac73931e` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:04:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939facad-927a-48f9-be7c-9b37a59ac48a None admin] RBAC: Authorizing `identity:delete_project(project_id=633b6f74527b48408dad0eedac73931e)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:04:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939facad-927a-48f9-be7c-9b37a59ac48a None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:04:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-939facad-927a-48f9-be7c-9b37a59ac48a None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '633b6f74527b48408dad0eedac73931e', 'request_id': 'req-939facad-927a-48f9-be7c-9b37a59ac48a'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:04:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-939facad-927a-48f9-be7c-9b37a59ac48a None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '633b6f74527b48408dad0eedac73931e', 'request_id': 'req-939facad-927a-48f9-be7c-9b37a59ac48a'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:04:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-939facad-927a-48f9-be7c-9b37a59ac48a None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '633b6f74527b48408dad0eedac73931e', 'request_id': 'req-939facad-927a-48f9-be7c-9b37a59ac48a'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:04:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-939facad-927a-48f9-be7c-9b37a59ac48a None admin] The token cache is being invalidate because project 633b6f74527b48408dad0eedac73931e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 13:04:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-939facad-927a-48f9-be7c-9b37a59ac48a None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:04:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-939facad-927a-48f9-be7c-9b37a59ac48a None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:04:12 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1845/3658] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 13:04:12 2024] DELETE /identity/v3/projects/633b6f74527b48408dad0eedac73931e => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:04:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aa6052-b4a4-437a-8591-1ba2fb8110a2 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:04:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aa6052-b4a4-437a-8591-1ba2fb8110a2 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:04:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aa6052-b4a4-437a-8591-1ba2fb8110a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:04:12 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-76aa6052-b4a4-437a-8591-1ba2fb8110a2 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 13:04:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-76aa6052-b4a4-437a-8591-1ba2fb8110a2 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 13:04:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-76aa6052-b4a4-437a-8591-1ba2fb8110a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:04:12 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1814/3659] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 13:04:12 2024] POST /identity/v3/auth/tokens => generated 312 bytes in 25 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 28 13:04:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27c8dfa-c333-4001-99ce-ec7fa915ef38 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:04:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27c8dfa-c333-4001-99ce-ec7fa915ef38 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:04:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27c8dfa-c333-4001-99ce-ec7fa915ef38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:04:12 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-b27c8dfa-c333-4001-99ce-ec7fa915ef38 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 13:04:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-b27c8dfa-c333-4001-99ce-ec7fa915ef38 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 13:04:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-b27c8dfa-c333-4001-99ce-ec7fa915ef38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:04:12 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1846/3660] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 13:04:12 2024] POST /identity/v3/auth/tokens => generated 2960 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 13:04:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76aa6052-b4a4-437a-8591-1ba2fb8110a2 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:04:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76aa6052-b4a4-437a-8591-1ba2fb8110a2 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:04:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadf0271-bcd7-4b39-9bd5-108f52dc8c3a None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:04:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadf0271-bcd7-4b39-9bd5-108f52dc8c3a None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:04:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadf0271-bcd7-4b39-9bd5-108f52dc8c3a None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:04:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadf0271-bcd7-4b39-9bd5-108f52dc8c3a None admin] PATH_INFO: `/v3/domains` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:04:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadf0271-bcd7-4b39-9bd5-108f52dc8c3a None admin] RBAC: Adding query filter params (name=Default) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 13:04:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadf0271-bcd7-4b39-9bd5-108f52dc8c3a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:04:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadf0271-bcd7-4b39-9bd5-108f52dc8c3a None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:04:12 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1815/3661] 10.27.203.238 () {62 vars in 1220 bytes} [Tue May 28 13:04:12 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 13:04:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27c8dfa-c333-4001-99ce-ec7fa915ef38 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:04:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27c8dfa-c333-4001-99ce-ec7fa915ef38 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:04:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d358978f-4417-4c10-989d-12d2c66b7138 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:04:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d358978f-4417-4c10-989d-12d2c66b7138 None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:04:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d358978f-4417-4c10-989d-12d2c66b7138 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:04:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d358978f-4417-4c10-989d-12d2c66b7138 None admin] PATH_INFO: `/v3/projects` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:04:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d358978f-4417-4c10-989d-12d2c66b7138 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:04:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d358978f-4417-4c10-989d-12d2c66b7138 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:04:12 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1847/3662] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 13:04:12 2024] POST /identity/v3/projects => generated 387 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 13:04:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadf0271-bcd7-4b39-9bd5-108f52dc8c3a None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:04:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadf0271-bcd7-4b39-9bd5-108f52dc8c3a None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:04:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27421e6-4c4a-47bc-975d-a529aabd24ea None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:04:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27421e6-4c4a-47bc-975d-a529aabd24ea None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:04:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27421e6-4c4a-47bc-975d-a529aabd24ea None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:04:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27421e6-4c4a-47bc-975d-a529aabd24ea None admin] PATH_INFO: `/v3/users` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:04:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27421e6-4c4a-47bc-975d-a529aabd24ea None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:04:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27421e6-4c4a-47bc-975d-a529aabd24ea None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:04:12 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-a27421e6-4c4a-47bc-975d-a529aabd24ea None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 13:04:12 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1816/3663] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 13:04:12 2024] POST /identity/v3/users => generated 302 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 13:04:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d358978f-4417-4c10-989d-12d2c66b7138 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:04:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d358978f-4417-4c10-989d-12d2c66b7138 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:04:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1b56c6-b1f6-418b-b5fd-53898e12e7d5 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:04:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1b56c6-b1f6-418b-b5fd-53898e12e7d5 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:04:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1b56c6-b1f6-418b-b5fd-53898e12e7d5 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:04:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1b56c6-b1f6-418b-b5fd-53898e12e7d5 None admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:04:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1b56c6-b1f6-418b-b5fd-53898e12e7d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:04:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1b56c6-b1f6-418b-b5fd-53898e12e7d5 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:04:12 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1848/3664] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 13:04:12 2024] GET /identity/v3/roles => generated 1680 bytes in 19 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 13:04:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27421e6-4c4a-47bc-975d-a529aabd24ea None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:04:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27421e6-4c4a-47bc-975d-a529aabd24ea None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:04:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d679fa-26f5-41d9-8765-9a6e1b7ed619 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:04:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d679fa-26f5-41d9-8765-9a6e1b7ed619 None admin] REQUEST_METHOD: `PUT` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:04:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d679fa-26f5-41d9-8765-9a6e1b7ed619 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:04:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d679fa-26f5-41d9-8765-9a6e1b7ed619 None admin] PATH_INFO: `/v3/projects/c39deaad5eb341ceb2e3c79518f56a1b/users/31f71bac04e24dc9908978bd950e8011/roles/44620cad10ae407c90c91e2c296adb04` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:04:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d679fa-26f5-41d9-8765-9a6e1b7ed619 None admin] RBAC: Authorizing `identity:create_grant(project_id=c39deaad5eb341ceb2e3c79518f56a1b, user_id=31f71bac04e24dc9908978bd950e8011, role_id=44620cad10ae407c90c91e2c296adb04)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:04:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d679fa-26f5-41d9-8765-9a6e1b7ed619 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:04:12 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1817/3665] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 13:04:12 2024] PUT /identity/v3/projects/c39deaad5eb341ceb2e3c79518f56a1b/users/31f71bac04e24dc9908978bd950e8011/roles/44620cad10ae407c90c91e2c296adb04 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:04:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46342f2b-d216-4bcf-98f5-6894894effd9 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:04:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46342f2b-d216-4bcf-98f5-6894894effd9 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:04:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46342f2b-d216-4bcf-98f5-6894894effd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:04:12 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-46342f2b-d216-4bcf-98f5-6894894effd9 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 13:04:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-46342f2b-d216-4bcf-98f5-6894894effd9 None None] MFA Rules not processed for user `31f71bac04e24dc9908978bd950e8011`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 13:04:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-46342f2b-d216-4bcf-98f5-6894894effd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:04:12 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1849/3666] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 13:04:12 2024] POST /identity/v3/auth/tokens => generated 3958 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 13:04:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d679fa-26f5-41d9-8765-9a6e1b7ed619 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:04:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d679fa-26f5-41d9-8765-9a6e1b7ed619 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:04:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef076ed3-b1ad-4501-89f8-f2efea5a0e72 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:04:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef076ed3-b1ad-4501-89f8-f2efea5a0e72 None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:04:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef076ed3-b1ad-4501-89f8-f2efea5a0e72 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:04:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef076ed3-b1ad-4501-89f8-f2efea5a0e72 None admin] PATH_INFO: `/v3/projects` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:04:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef076ed3-b1ad-4501-89f8-f2efea5a0e72 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:04:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef076ed3-b1ad-4501-89f8-f2efea5a0e72 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:04:12 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1818/3667] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 13:04:12 2024] POST /identity/v3/projects => generated 387 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 13:04:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46342f2b-d216-4bcf-98f5-6894894effd9 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:04:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46342f2b-d216-4bcf-98f5-6894894effd9 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:04:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8b6bc6-73fb-4ce9-aebf-48f976dd18d4 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:04:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8b6bc6-73fb-4ce9-aebf-48f976dd18d4 None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:04:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8b6bc6-73fb-4ce9-aebf-48f976dd18d4 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:04:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8b6bc6-73fb-4ce9-aebf-48f976dd18d4 None admin] PATH_INFO: `/v3/users` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:04:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8b6bc6-73fb-4ce9-aebf-48f976dd18d4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:04:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8b6bc6-73fb-4ce9-aebf-48f976dd18d4 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:04:12 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-cc8b6bc6-73fb-4ce9-aebf-48f976dd18d4 None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 13:04:12 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1850/3668] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 13:04:12 2024] POST /identity/v3/users => generated 302 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 13:04:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef076ed3-b1ad-4501-89f8-f2efea5a0e72 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:04:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef076ed3-b1ad-4501-89f8-f2efea5a0e72 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:04:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3d5bff-39a2-4ca6-a0bf-5caf79c202d9 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:04:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3d5bff-39a2-4ca6-a0bf-5caf79c202d9 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:04:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3d5bff-39a2-4ca6-a0bf-5caf79c202d9 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:04:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3d5bff-39a2-4ca6-a0bf-5caf79c202d9 None admin] PATH_INFO: `/v3/roles` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:04:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3d5bff-39a2-4ca6-a0bf-5caf79c202d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:04:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3d5bff-39a2-4ca6-a0bf-5caf79c202d9 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:04:12 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1819/3669] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 13:04:12 2024] GET /identity/v3/roles => generated 1680 bytes in 17 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 13:04:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8b6bc6-73fb-4ce9-aebf-48f976dd18d4 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:04:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8b6bc6-73fb-4ce9-aebf-48f976dd18d4 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:04:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7195333-a3a6-4cab-b636-f43c8ab1b070 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:04:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7195333-a3a6-4cab-b636-f43c8ab1b070 None admin] REQUEST_METHOD: `PUT` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:04:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7195333-a3a6-4cab-b636-f43c8ab1b070 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:04:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7195333-a3a6-4cab-b636-f43c8ab1b070 None admin] PATH_INFO: `/v3/projects/0458d53d773c434eafc80da00cf6604a/users/a841680e39754232a9b193a9b88cc12a/roles/44620cad10ae407c90c91e2c296adb04` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:04:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7195333-a3a6-4cab-b636-f43c8ab1b070 None admin] RBAC: Authorizing `identity:create_grant(project_id=0458d53d773c434eafc80da00cf6604a, user_id=a841680e39754232a9b193a9b88cc12a, role_id=44620cad10ae407c90c91e2c296adb04)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:04:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7195333-a3a6-4cab-b636-f43c8ab1b070 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:04:12 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1851/3670] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 13:04:12 2024] PUT /identity/v3/projects/0458d53d773c434eafc80da00cf6604a/users/a841680e39754232a9b193a9b88cc12a/roles/44620cad10ae407c90c91e2c296adb04 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:04:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2cfdfa-7e98-49d8-b60c-7300646dd218 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:04:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2cfdfa-7e98-49d8-b60c-7300646dd218 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:04:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2cfdfa-7e98-49d8-b60c-7300646dd218 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:04:12 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-fd2cfdfa-7e98-49d8-b60c-7300646dd218 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 13:04:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-fd2cfdfa-7e98-49d8-b60c-7300646dd218 None None] MFA Rules not processed for user `a841680e39754232a9b193a9b88cc12a`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 13:04:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-fd2cfdfa-7e98-49d8-b60c-7300646dd218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:04:13 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1820/3671] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 13:04:12 2024] POST /identity/v3/auth/tokens => generated 3958 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 13:04:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7195333-a3a6-4cab-b636-f43c8ab1b070 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:04:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7195333-a3a6-4cab-b636-f43c8ab1b070 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:04:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6d25aa-846a-40cc-b298-36e00d4b5b0b None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:04:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6d25aa-846a-40cc-b298-36e00d4b5b0b None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:04:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6d25aa-846a-40cc-b298-36e00d4b5b0b None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:04:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6d25aa-846a-40cc-b298-36e00d4b5b0b None admin] PATH_INFO: `/v3/projects` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:04:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6d25aa-846a-40cc-b298-36e00d4b5b0b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:04:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6d25aa-846a-40cc-b298-36e00d4b5b0b None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:04:13 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1852/3672] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 13:04:13 2024] POST /identity/v3/projects => generated 389 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 13:04:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2cfdfa-7e98-49d8-b60c-7300646dd218 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:04:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2cfdfa-7e98-49d8-b60c-7300646dd218 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:04:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cf6e33-945a-4b0c-a3bd-2380e57c9601 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:04:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cf6e33-945a-4b0c-a3bd-2380e57c9601 None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:04:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cf6e33-945a-4b0c-a3bd-2380e57c9601 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:04:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cf6e33-945a-4b0c-a3bd-2380e57c9601 None admin] PATH_INFO: `/v3/users` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:04:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cf6e33-945a-4b0c-a3bd-2380e57c9601 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:04:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cf6e33-945a-4b0c-a3bd-2380e57c9601 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:04:13 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-28cf6e33-945a-4b0c-a3bd-2380e57c9601 None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 13:04:13 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1821/3673] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 13:04:13 2024] POST /identity/v3/users => generated 302 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 13:04:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6d25aa-846a-40cc-b298-36e00d4b5b0b None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:04:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6d25aa-846a-40cc-b298-36e00d4b5b0b None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:04:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9c334e-6dd7-4f8b-8040-792e945113af None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:04:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9c334e-6dd7-4f8b-8040-792e945113af None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:04:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9c334e-6dd7-4f8b-8040-792e945113af None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:04:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9c334e-6dd7-4f8b-8040-792e945113af None admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:04:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9c334e-6dd7-4f8b-8040-792e945113af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:04:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9c334e-6dd7-4f8b-8040-792e945113af None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:04:13 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1853/3674] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 13:04:13 2024] GET /identity/v3/roles => generated 1680 bytes in 18 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 13:04:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cf6e33-945a-4b0c-a3bd-2380e57c9601 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:04:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cf6e33-945a-4b0c-a3bd-2380e57c9601 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:04:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050fe814-3205-4f30-8368-05bd34b3ead6 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:04:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050fe814-3205-4f30-8368-05bd34b3ead6 None admin] REQUEST_METHOD: `PUT` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:04:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050fe814-3205-4f30-8368-05bd34b3ead6 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:04:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050fe814-3205-4f30-8368-05bd34b3ead6 None admin] PATH_INFO: `/v3/projects/c7f81fe24c76497a89dd033554ce1057/users/0872f5cfc04e4f64bafdd937cfed5d39/roles/e7989893488f483baa107be56668c4f8` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:04:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050fe814-3205-4f30-8368-05bd34b3ead6 None admin] RBAC: Authorizing `identity:create_grant(project_id=c7f81fe24c76497a89dd033554ce1057, user_id=0872f5cfc04e4f64bafdd937cfed5d39, role_id=e7989893488f483baa107be56668c4f8)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:04:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050fe814-3205-4f30-8368-05bd34b3ead6 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:04:13 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1822/3675] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 13:04:13 2024] PUT /identity/v3/projects/c7f81fe24c76497a89dd033554ce1057/users/0872f5cfc04e4f64bafdd937cfed5d39/roles/e7989893488f483baa107be56668c4f8 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:04:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9c334e-6dd7-4f8b-8040-792e945113af None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:04:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9c334e-6dd7-4f8b-8040-792e945113af None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:04:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa376bb6-2a8e-41ad-afd3-c43b8a3e2457 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:04:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa376bb6-2a8e-41ad-afd3-c43b8a3e2457 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:04:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa376bb6-2a8e-41ad-afd3-c43b8a3e2457 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:04:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa376bb6-2a8e-41ad-afd3-c43b8a3e2457 None admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:04:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa376bb6-2a8e-41ad-afd3-c43b8a3e2457 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:04:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa376bb6-2a8e-41ad-afd3-c43b8a3e2457 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:04:13 l75lg1-v1 dstat.sh[49771]: 28-05 13:04:13| 9 2 85 4 0|5518M 1896M 278M 7932M| 13k 0 | 0 4676k| 0 385 |7562 13k|0.77 1.02 1.02|2.0 0 0| 0 0 | 0 2048M| 29 360 0 10 6 May 28 13:04:13 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1854/3676] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 13:04:13 2024] GET /identity/v3/roles => generated 1680 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 13:04:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050fe814-3205-4f30-8368-05bd34b3ead6 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:04:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050fe814-3205-4f30-8368-05bd34b3ead6 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:04:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d22743-f337-484a-afc4-7dee4c60f142 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:04:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d22743-f337-484a-afc4-7dee4c60f142 None admin] REQUEST_METHOD: `PUT` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:04:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d22743-f337-484a-afc4-7dee4c60f142 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:04:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d22743-f337-484a-afc4-7dee4c60f142 None admin] PATH_INFO: `/v3/projects/c7f81fe24c76497a89dd033554ce1057/users/0872f5cfc04e4f64bafdd937cfed5d39/roles/e7989893488f483baa107be56668c4f8` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:04:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d22743-f337-484a-afc4-7dee4c60f142 None admin] RBAC: Authorizing `identity:create_grant(project_id=c7f81fe24c76497a89dd033554ce1057, user_id=0872f5cfc04e4f64bafdd937cfed5d39, role_id=e7989893488f483baa107be56668c4f8)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:04:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d22743-f337-484a-afc4-7dee4c60f142 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:04:13 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1823/3677] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 13:04:13 2024] PUT /identity/v3/projects/c7f81fe24c76497a89dd033554ce1057/users/0872f5cfc04e4f64bafdd937cfed5d39/roles/e7989893488f483baa107be56668c4f8 => generated 0 bytes in 19 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:04:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2cd550-344f-4642-9c42-0a510497c0d4 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:04:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2cd550-344f-4642-9c42-0a510497c0d4 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:04:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2cd550-344f-4642-9c42-0a510497c0d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:04:13 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-ef2cd550-344f-4642-9c42-0a510497c0d4 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 13:04:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-ef2cd550-344f-4642-9c42-0a510497c0d4 None None] MFA Rules not processed for user `0872f5cfc04e4f64bafdd937cfed5d39`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 13:04:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-ef2cd550-344f-4642-9c42-0a510497c0d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:04:13 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1855/3678] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 13:04:13 2024] POST /identity/v3/auth/tokens => generated 4083 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 13:04:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d22743-f337-484a-afc4-7dee4c60f142 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:04:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d22743-f337-484a-afc4-7dee4c60f142 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:04:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3a2af4-96d4-48e3-a522-93bdd114049e tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0872f5cfc04e4f64bafdd937cfed5d39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7f81fe24c76497a89dd033554ce1057', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:04:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3a2af4-96d4-48e3-a522-93bdd114049e tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:04:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3a2af4-96d4-48e3-a522-93bdd114049e tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:04:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3a2af4-96d4-48e3-a522-93bdd114049e tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] PATH_INFO: `/v3/domains` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:04:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3a2af4-96d4-48e3-a522-93bdd114049e tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 13:04:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3a2af4-96d4-48e3-a522-93bdd114049e tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:04:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3a2af4-96d4-48e3-a522-93bdd114049e tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:04:13 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1824/3679] 10.27.203.238 () {62 vars in 1241 bytes} [Tue May 28 13:04:13 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 13:04:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2cd550-344f-4642-9c42-0a510497c0d4 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:04:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2cd550-344f-4642-9c42-0a510497c0d4 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:04:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b207f82-4c74-4a6f-856d-bf159d5f20a3 tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0872f5cfc04e4f64bafdd937cfed5d39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7f81fe24c76497a89dd033554ce1057', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:04:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b207f82-4c74-4a6f-856d-bf159d5f20a3 tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:04:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b207f82-4c74-4a6f-856d-bf159d5f20a3 tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:04:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b207f82-4c74-4a6f-856d-bf159d5f20a3 tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] PATH_INFO: `/v3/users` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:04:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b207f82-4c74-4a6f-856d-bf159d5f20a3 tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:04:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b207f82-4c74-4a6f-856d-bf159d5f20a3 tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:04:13 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-5b207f82-4c74-4a6f-856d-bf159d5f20a3 tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] Truncating password to algorithm specific maximum length 72 characters. May 28 13:04:13 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1856/3680] 10.27.203.238 () {64 vars in 1232 bytes} [Tue May 28 13:04:13 2024] POST /identity/v3/users => generated 433 bytes in 30 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 13:04:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3a2af4-96d4-48e3-a522-93bdd114049e tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:04:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3a2af4-96d4-48e3-a522-93bdd114049e tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:04:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f141ac4-bc91-401d-9ae8-61b140d5e402 tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0872f5cfc04e4f64bafdd937cfed5d39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7f81fe24c76497a89dd033554ce1057', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:04:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f141ac4-bc91-401d-9ae8-61b140d5e402 tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:04:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f141ac4-bc91-401d-9ae8-61b140d5e402 tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:04:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f141ac4-bc91-401d-9ae8-61b140d5e402 tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] PATH_INFO: `/v3/roles` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:04:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f141ac4-bc91-401d-9ae8-61b140d5e402 tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:04:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f141ac4-bc91-401d-9ae8-61b140d5e402 tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:04:13 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1825/3681] 10.27.203.238 () {62 vars in 1210 bytes} [Tue May 28 13:04:13 2024] GET /identity/v3/roles => generated 1680 bytes in 17 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 13:04:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b207f82-4c74-4a6f-856d-bf159d5f20a3 tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:04:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b207f82-4c74-4a6f-856d-bf159d5f20a3 tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:04:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3828f87c-f7dd-4b77-80bb-683a91810113 tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0872f5cfc04e4f64bafdd937cfed5d39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7f81fe24c76497a89dd033554ce1057', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:04:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3828f87c-f7dd-4b77-80bb-683a91810113 tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] REQUEST_METHOD: `PUT` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:04:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3828f87c-f7dd-4b77-80bb-683a91810113 tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:04:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3828f87c-f7dd-4b77-80bb-683a91810113 tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] PATH_INFO: `/v3/projects/c7f81fe24c76497a89dd033554ce1057/users/76e042fad4114f4cb24f96afe38c72b8/roles/44620cad10ae407c90c91e2c296adb04` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:04:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3828f87c-f7dd-4b77-80bb-683a91810113 tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] RBAC: Authorizing `identity:create_grant(project_id=c7f81fe24c76497a89dd033554ce1057, user_id=76e042fad4114f4cb24f96afe38c72b8, role_id=44620cad10ae407c90c91e2c296adb04)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:04:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3828f87c-f7dd-4b77-80bb-683a91810113 tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:04:13 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1857/3682] 10.27.203.238 () {64 vars in 1571 bytes} [Tue May 28 13:04:13 2024] PUT /identity/v3/projects/c7f81fe24c76497a89dd033554ce1057/users/76e042fad4114f4cb24f96afe38c72b8/roles/44620cad10ae407c90c91e2c296adb04 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:04:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f141ac4-bc91-401d-9ae8-61b140d5e402 tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:04:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-7f141ac4-bc91-401d-9ae8-61b140d5e402 tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:04:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f141ac4-bc91-401d-9ae8-61b140d5e402 tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:04:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2695c7-7767-42b9-9eea-9fe1cb6059ef service manila] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f110cf6300f049c897d0aab63218d1e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:04:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2695c7-7767-42b9-9eea-9fe1cb6059ef service manila] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:04:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2695c7-7767-42b9-9eea-9fe1cb6059ef service manila] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:04:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2695c7-7767-42b9-9eea-9fe1cb6059ef service manila] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:04:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2695c7-7767-42b9-9eea-9fe1cb6059ef service manila] RBAC: Authorizing `identity:validate_token()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:04:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2695c7-7767-42b9-9eea-9fe1cb6059ef service manila] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:04:13 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1826/3683] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 13:04:13 2024] GET /identity/v3/auth/tokens => generated 4083 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 13:04:13 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-d1728090-a50f-47a7-a84b-386312344939 tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] POST http://10.27.203.238/share/v2/c7f81fe24c76497a89dd033554ce1057/types May 28 13:04:13 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-d1728090-a50f-47a7-a84b-386312344939 tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share_type": {"name": "tempest-typeshare-type-1006458921", "extra_specs": {"driver_handles_share_servers": "False", "snapshot_support": true}, "share_type_access:is_public": true}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:04:13 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-d1728090-a50f-47a7-a84b-386312344939 tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] http://10.27.203.238/share/v2/c7f81fe24c76497a89dd033554ce1057/types returned with HTTP 200 May 28 13:04:13 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1359/2697] 10.27.203.238 () {66 vars in 1359 bytes} [Tue May 28 13:04:13 2024] POST /share/v2/c7f81fe24c76497a89dd033554ce1057/types => generated 679 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:04:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3828f87c-f7dd-4b77-80bb-683a91810113 tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:04:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-3828f87c-f7dd-4b77-80bb-683a91810113 tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:04:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3828f87c-f7dd-4b77-80bb-683a91810113 tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:04:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a722d4ee-bf89-48f9-8b10-9265e0a551ed service manila] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f110cf6300f049c897d0aab63218d1e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:04:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a722d4ee-bf89-48f9-8b10-9265e0a551ed service manila] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:04:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a722d4ee-bf89-48f9-8b10-9265e0a551ed service manila] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:04:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a722d4ee-bf89-48f9-8b10-9265e0a551ed service manila] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:04:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a722d4ee-bf89-48f9-8b10-9265e0a551ed service manila] RBAC: Authorizing `identity:validate_token()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:04:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a722d4ee-bf89-48f9-8b10-9265e0a551ed service manila] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:04:13 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1858/3684] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 13:04:13 2024] GET /identity/v3/auth/tokens => generated 3958 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 13:04:13 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-ae7a9199-caf3-44ec-8456-f09ebfc47a85 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] POST http://10.27.203.238/share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares May 28 13:04:13 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-ae7a9199-caf3-44ec-8456-f09ebfc47a85 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share": {"share_proto": "nfs", "description": "tempest-tempest-share-description-1779493980", "snapshot_id": null, "name": "tempest-tempest-share-name-1887451451", "size": 1, "metadata": {}, "is_public": false, "share_type": "f7d65ead-0196-4e03-928f-2e08ca825112"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:04:13 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.v1.shares [None req-ae7a9199-caf3-44ec-8456-f09ebfc47a85 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Create NFS share of 1 GB May 28 13:04:13 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.quota [None req-ae7a9199-caf3-44ec-8456-f09ebfc47a85 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Created reservations ['4ab19d1e-5e2e-48b8-a86b-1227fc412724', 'c33782c1-89f8-4945-9f9c-aaf389a65c55', '0c273543-3a36-4812-8849-3807eecf4bec', '1d0dad67-7478-4bf5-a18c-5fb02c7971d3'] {{(pid=98330) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 13:04:13 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.quota [None req-ae7a9199-caf3-44ec-8456-f09ebfc47a85 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Committed reservations ['4ab19d1e-5e2e-48b8-a86b-1227fc412724', 'c33782c1-89f8-4945-9f9c-aaf389a65c55', '0c273543-3a36-4812-8849-3807eecf4bec', '1d0dad67-7478-4bf5-a18c-5fb02c7971d3'] {{(pid=98330) commit /opt/stack/manila/manila/quota.py:1063}} May 28 13:04:13 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.host_manager [None req-ae7a9199-caf3-44ec-8456-f09ebfc47a85 tempest-SharesActionsNegativeTest-299343130 None] Share service is down. (host: l75lg1-v1@generic2). May 28 13:04:13 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.host_manager [None req-ae7a9199-caf3-44ec-8456-f09ebfc47a85 tempest-SharesActionsNegativeTest-299343130 None] Share service is down. (host: l75lg1-v1@generic1). May 28 13:04:13 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-ae7a9199-caf3-44ec-8456-f09ebfc47a85 tempest-SharesActionsNegativeTest-299343130 None] Starting with 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:80}} May 28 13:04:13 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-ae7a9199-caf3-44ec-8456-f09ebfc47a85 tempest-SharesActionsNegativeTest-299343130 None] Filter OnlyHostFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:04:13 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-ae7a9199-caf3-44ec-8456-f09ebfc47a85 tempest-SharesActionsNegativeTest-299343130 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:04:13 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.capacity [None req-ae7a9199-caf3-44ec-8456-f09ebfc47a85 tempest-SharesActionsNegativeTest-299343130 None] Space information for share creation on host l75lg1-v1@vast#vast (requested / avail): 1/2082 {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/capacity.py:83}} May 28 13:04:13 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-ae7a9199-caf3-44ec-8456-f09ebfc47a85 tempest-SharesActionsNegativeTest-299343130 None] Filter CapacityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:04:13 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-ae7a9199-caf3-44ec-8456-f09ebfc47a85 tempest-SharesActionsNegativeTest-299343130 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:04:13 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-ae7a9199-caf3-44ec-8456-f09ebfc47a85 tempest-SharesActionsNegativeTest-299343130 None] Driver Filter: Checking host 'l75lg1-v1@vast#vast' {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:37}} May 28 13:04:13 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-ae7a9199-caf3-44ec-8456-f09ebfc47a85 tempest-SharesActionsNegativeTest-299343130 None] Filter function not set :: passing host. {{(pid=98327) _check_filter_function /opt/stack/manila/manila/scheduler/filters/driver.py:53}} May 28 13:04:13 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-ae7a9199-caf3-44ec-8456-f09ebfc47a85 tempest-SharesActionsNegativeTest-299343130 None] Result: True {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:40}} May 28 13:04:13 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-ae7a9199-caf3-44ec-8456-f09ebfc47a85 tempest-SharesActionsNegativeTest-299343130 None] Done checking host 'l75lg1-v1@vast#vast' {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:41}} May 28 13:04:13 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-ae7a9199-caf3-44ec-8456-f09ebfc47a85 tempest-SharesActionsNegativeTest-299343130 None] Filter DriverFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:04:13 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-ae7a9199-caf3-44ec-8456-f09ebfc47a85 tempest-SharesActionsNegativeTest-299343130 None] Filter ShareReplicationFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:04:13 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-ae7a9199-caf3-44ec-8456-f09ebfc47a85 tempest-SharesActionsNegativeTest-299343130 None] Filter CreateFromSnapshotFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:04:13 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-ae7a9199-caf3-44ec-8456-f09ebfc47a85 tempest-SharesActionsNegativeTest-299343130 None] Filter AffinityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:04:13 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-ae7a9199-caf3-44ec-8456-f09ebfc47a85 tempest-SharesActionsNegativeTest-299343130 None] Filter AntiAffinityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:04:13 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.drivers.filter [None req-ae7a9199-caf3-44ec-8456-f09ebfc47a85 tempest-SharesActionsNegativeTest-299343130 None] Filtered share [host: 'l75lg1-v1@vast#vast', free_capacity_gb: 2082.6467494899407, pools: None] {{(pid=98327) _schedule_share /opt/stack/manila/manila/scheduler/drivers/filter.py:268}} May 28 13:04:13 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-ae7a9199-caf3-44ec-8456-f09ebfc47a85 tempest-SharesActionsNegativeTest-299343130 None] Checking host 'l75lg1-v1@vast#vast' {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:46}} May 28 13:04:13 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.weighers.goodness [None req-ae7a9199-caf3-44ec-8456-f09ebfc47a85 tempest-SharesActionsNegativeTest-299343130 None] Goodness function not set :: defaulting to minimal goodness rating of 0. May 28 13:04:13 l75lg1-v1 manila-scheduler[98327]: INFO manila.scheduler.weighers.goodness [None req-ae7a9199-caf3-44ec-8456-f09ebfc47a85 tempest-SharesActionsNegativeTest-299343130 None] Goodness function result for host l75lg1-v1@vast#vast: 0. May 28 13:04:13 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-ae7a9199-caf3-44ec-8456-f09ebfc47a85 tempest-SharesActionsNegativeTest-299343130 None] Goodness: 0 {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:48}} May 28 13:04:13 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-ae7a9199-caf3-44ec-8456-f09ebfc47a85 tempest-SharesActionsNegativeTest-299343130 None] Done checking host 'l75lg1-v1@vast#vast' {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:49}} May 28 13:04:13 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.drivers.filter [None req-ae7a9199-caf3-44ec-8456-f09ebfc47a85 tempest-SharesActionsNegativeTest-299343130 None] Choosing for share: WeighedHost [host: l75lg1-v1@vast#vast, weight: 0.0] {{(pid=98327) _schedule_share /opt/stack/manila/manila/scheduler/drivers/filter.py:274}} May 28 13:04:13 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-ae7a9199-caf3-44ec-8456-f09ebfc47a85 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] http://10.27.203.238/share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares returned with HTTP 200 May 28 13:04:13 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1339/2698] 10.27.203.238 () {66 vars in 1362 bytes} [Tue May 28 13:04:13 2024] POST /share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares => generated 1339 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:04:13 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-45ea5685-72f9-45e3-b44d-535b74a73d64 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] GET http://10.27.203.238/share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares/1b08ba1e-039b-4773-869c-2a90b38f5f70 May 28 13:04:13 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-45ea5685-72f9-45e3-b44d-535b74a73d64 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:04:13 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-45ea5685-72f9-45e3-b44d-535b74a73d64 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:04:13 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-45ea5685-72f9-45e3-b44d-535b74a73d64 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] http://10.27.203.238/share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares/1b08ba1e-039b-4773-869c-2a90b38f5f70 returned with HTTP 200 May 28 13:04:13 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1360/2699] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:04:13 2024] GET /share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares/1b08ba1e-039b-4773-869c-2a90b38f5f70 => generated 1339 bytes in 24 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:04:14 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ae7a9199-caf3-44ec-8456-f09ebfc47a85 tempest-SharesActionsNegativeTest-299343130 None] >>> [GET] https://127.0.0.1:40443/api/vippools/ May 28 13:04:14 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ae7a9199-caf3-44ec-8456-f09ebfc47a85 tempest-SharesActionsNegativeTest-299343130 None] {'allow_redirects': True, 'params': {'name': 'vippool-1'}} May 28 13:04:14 l75lg1-v1 dstat.sh[49771]: 28-05 13:04:14| 8 1 89 2 0|5518M 1896M 278M 7932M| 10k 646B| 0 1477k| 0 219 |5967 10k|0.77 1.02 1.02|1.0 0 0| 0 0 | 0 2048M| 29 359 0 10 6 May 28 13:04:14 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ae7a9199-caf3-44ec-8456-f09ebfc47a85 tempest-SharesActionsNegativeTest-299343130 None] <<< [GET] https://127.0.0.1:40443/api/vippools/ May 28 13:04:14 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ae7a9199-caf3-44ec-8456-f09ebfc47a85 tempest-SharesActionsNegativeTest-299343130 None] [Bunch(active_cnode_ids=[], active_interfaces=4, cluster='loop75-kfs', cluster_id=1, cnode_ids=[], cnodes=[], domain_name='vippool-1', enable_l3=False, enable_weighted_balancing=False, enabled=True, end_ip='172.21.75.4', guid='f2abaede-b397-413a-8faa-3aeead6d3b28', gw_ip='', gw_ipv6='', id=2, ip_ranges=[['172.21.75.1', '172.21.75.4']], name='vippool-1', peer_asn=0, port_membership='ALL', ranges_summary='172.21.75.[1-4]', role='PROTOCOLS', start_ip='172.21.75.1', subnet_cidr=16, subnet_cidr_ipv6=None, sync='SYNCED', sync_time='2024-05-28T12:50:09.644123Z', tenant_id=1, tenant_name='default', title='172.21.75.1 - 172.21.75.4', url='https://127.0.0.1:40443/api/vippools/2/', vast_asn=0, vlan=0, vms_preferred=False)] May 28 13:04:14 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ae7a9199-caf3-44ec-8456-f09ebfc47a85 tempest-SharesActionsNegativeTest-299343130 None] --- [GET] https://127.0.0.1:40443/api/vippools/: Done May 28 13:04:14 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ae7a9199-caf3-44ec-8456-f09ebfc47a85 tempest-SharesActionsNegativeTest-299343130 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:04:14 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ae7a9199-caf3-44ec-8456-f09ebfc47a85 tempest-SharesActionsNegativeTest-299343130 None] {'allow_redirects': True, May 28 13:04:14 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ae7a9199-caf3-44ec-8456-f09ebfc47a85 tempest-SharesActionsNegativeTest-299343130 None] 'params': {'name': '2e013be0-942c-4e94-a237-2d1251405521'}} May 28 13:04:15 l75lg1-v1 dstat.sh[49771]: 28-05 13:04:15| 0 0 96 3 0|5518M 1895M 278M 7932M|9869B 734B| 0 4789k| 0 349 |2504 4018 |0.77 1.02 1.02|1.0 0 0| 0 0 | 0 2048M| 29 359 0 10 6 May 28 13:04:15 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ae7a9199-caf3-44ec-8456-f09ebfc47a85 tempest-SharesActionsNegativeTest-299343130 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:04:15 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ae7a9199-caf3-44ec-8456-f09ebfc47a85 tempest-SharesActionsNegativeTest-299343130 None] [] May 28 13:04:15 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ae7a9199-caf3-44ec-8456-f09ebfc47a85 tempest-SharesActionsNegativeTest-299343130 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 13:04:15 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ae7a9199-caf3-44ec-8456-f09ebfc47a85 tempest-SharesActionsNegativeTest-299343130 None] >>> [POST] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:04:15 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ae7a9199-caf3-44ec-8456-f09ebfc47a85 tempest-SharesActionsNegativeTest-299343130 None] {'data': '{"name": "2e013be0-942c-4e94-a237-2d1251405521"}', May 28 13:04:15 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ae7a9199-caf3-44ec-8456-f09ebfc47a85 tempest-SharesActionsNegativeTest-299343130 None] 'json': None, May 28 13:04:15 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ae7a9199-caf3-44ec-8456-f09ebfc47a85 tempest-SharesActionsNegativeTest-299343130 None] 'params': None} May 28 13:04:16 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ae7a9199-caf3-44ec-8456-f09ebfc47a85 tempest-SharesActionsNegativeTest-299343130 None] <<< [POST] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:04:16 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ae7a9199-caf3-44ec-8456-f09ebfc47a85 tempest-SharesActionsNegativeTest-299343130 None] Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=0, created='2024-05-28T13:04:15.653439Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='fbc2e3b0-baed-4bfe-9fb1-9e178518fb3b', id=62, internal=False, is_s3_default_policy=False, name='2e013be0-942c-4e94-a237-2d1251405521', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=[], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['*'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['*'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T13:04:15.976165Z', tenant_id=1, tenant_name='default', title='2e013be0-942c-4e94-a237-2d1251405521', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/62/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[]) May 28 13:04:16 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ae7a9199-caf3-44ec-8456-f09ebfc47a85 tempest-SharesActionsNegativeTest-299343130 None] --- [POST] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 13:04:16 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ae7a9199-caf3-44ec-8456-f09ebfc47a85 tempest-SharesActionsNegativeTest-299343130 None] >>> [GET] https://127.0.0.1:40443/api/quotas/ May 28 13:04:16 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ae7a9199-caf3-44ec-8456-f09ebfc47a85 tempest-SharesActionsNegativeTest-299343130 None] {'allow_redirects': True, May 28 13:04:16 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ae7a9199-caf3-44ec-8456-f09ebfc47a85 tempest-SharesActionsNegativeTest-299343130 None] 'params': {'name': '2e013be0-942c-4e94-a237-2d1251405521'}} May 28 13:04:16 l75lg1-v1 dstat.sh[49771]: 28-05 13:04:16| 1 0 98 0 0|5518M 1895M 278M 7932M| 16k 1739B| 0 224k| 0 15.0 |1611 2437 |0.77 1.02 1.02| 0 0 0| 0 0 | 0 2048M| 29 359 0 10 6 May 28 13:04:16 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ae7a9199-caf3-44ec-8456-f09ebfc47a85 tempest-SharesActionsNegativeTest-299343130 None] <<< [GET] https://127.0.0.1:40443/api/quotas/ May 28 13:04:16 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ae7a9199-caf3-44ec-8456-f09ebfc47a85 tempest-SharesActionsNegativeTest-299343130 None] [] May 28 13:04:16 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ae7a9199-caf3-44ec-8456-f09ebfc47a85 tempest-SharesActionsNegativeTest-299343130 None] --- [GET] https://127.0.0.1:40443/api/quotas/: Done May 28 13:04:16 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ae7a9199-caf3-44ec-8456-f09ebfc47a85 tempest-SharesActionsNegativeTest-299343130 None] >>> [POST] https://127.0.0.1:40443/api/quotas/ May 28 13:04:16 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ae7a9199-caf3-44ec-8456-f09ebfc47a85 tempest-SharesActionsNegativeTest-299343130 None] {'data': '{"name": "2e013be0-942c-4e94-a237-2d1251405521", "path": ' May 28 13:04:16 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ae7a9199-caf3-44ec-8456-f09ebfc47a85 tempest-SharesActionsNegativeTest-299343130 None] '"/manila/manila-2e013be0-942c-4e94-a237-2d1251405521", "create_dir": ' May 28 13:04:16 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ae7a9199-caf3-44ec-8456-f09ebfc47a85 tempest-SharesActionsNegativeTest-299343130 None] 'true, "hard_limit": 1073741824}', May 28 13:04:16 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ae7a9199-caf3-44ec-8456-f09ebfc47a85 tempest-SharesActionsNegativeTest-299343130 None] 'json': None, May 28 13:04:16 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ae7a9199-caf3-44ec-8456-f09ebfc47a85 tempest-SharesActionsNegativeTest-299343130 None] 'params': None} May 28 13:04:16 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-e86af3c6-b76e-4376-807e-acfe6ac34d40 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] GET http://10.27.203.238/share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares/1b08ba1e-039b-4773-869c-2a90b38f5f70 May 28 13:04:16 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-e86af3c6-b76e-4376-807e-acfe6ac34d40 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:04:16 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-e86af3c6-b76e-4376-807e-acfe6ac34d40 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:04:16 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-e86af3c6-b76e-4376-807e-acfe6ac34d40 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] http://10.27.203.238/share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares/1b08ba1e-039b-4773-869c-2a90b38f5f70 returned with HTTP 200 May 28 13:04:16 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1340/2700] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:04:16 2024] GET /share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares/1b08ba1e-039b-4773-869c-2a90b38f5f70 => generated 1341 bytes in 25 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:04:17 l75lg1-v1 dstat.sh[49771]: 28-05 13:04:17| 1 0 98 1 0|5518M 1895M 278M 7932M| 18k 932B| 0 804k| 0 56.0 |1883 2851 |0.77 1.02 1.02| 0 0 0| 0 0 | 0 2048M| 29 359 0 10 6 May 28 13:04:17 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ae7a9199-caf3-44ec-8456-f09ebfc47a85 tempest-SharesActionsNegativeTest-299343130 None] <<< [POST] https://127.0.0.1:40443/api/quotas/ May 28 13:04:17 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ae7a9199-caf3-44ec-8456-f09ebfc47a85 tempest-SharesActionsNegativeTest-299343130 None] Bunch(cluster='loop75-kfs', cluster_id=1, default_email=None, default_group_quota=None, default_user_quota=None, enable_alarms=True, enable_email_providers=True, grace_period=None, group_quotas=[], guid='d483c4e4-08e6-4da9-a9b8-40fd29bc5677', hard_limit=1073741824, hard_limit_inodes=None, id=59, internal=False, is_user_quota=False, last_user_quotas_update=None, name='2e013be0-942c-4e94-a237-2d1251405521', num_blocked_users=0, num_exceeded_users=0, path='/manila/manila-2e013be0-942c-4e94-a237-2d1251405521', percent_capacity=0, percent_inodes=None, pretty_grace_period=None, pretty_grace_period_expiration=None, pretty_state='OK (CREATED)', soft_limit=None, soft_limit_inodes=None, state='OK', sync_state='CREATED', system_id=59, tenant_id=1, tenant_name='default', time_to_block=None, title='2e013be0-942c-4e94-a237-2d1251405521', url='https://127.0.0.1:40443/api/quotas/59/', used_capacity=0, used_capacity_tb=0.0, used_effective_capacity=0, used_effective_capacity_tb=0.0, used_inodes=0, used_limited_capacity=0, user_quotas=[]) May 28 13:04:17 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ae7a9199-caf3-44ec-8456-f09ebfc47a85 tempest-SharesActionsNegativeTest-299343130 None] --- [POST] https://127.0.0.1:40443/api/quotas/: Done May 28 13:04:17 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ae7a9199-caf3-44ec-8456-f09ebfc47a85 tempest-SharesActionsNegativeTest-299343130 None] >>> [GET] https://127.0.0.1:40443/api/views/ May 28 13:04:17 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ae7a9199-caf3-44ec-8456-f09ebfc47a85 tempest-SharesActionsNegativeTest-299343130 None] {'allow_redirects': True, May 28 13:04:17 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ae7a9199-caf3-44ec-8456-f09ebfc47a85 tempest-SharesActionsNegativeTest-299343130 None] 'params': {'name': '2e013be0-942c-4e94-a237-2d1251405521'}} May 28 13:04:17 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ae7a9199-caf3-44ec-8456-f09ebfc47a85 tempest-SharesActionsNegativeTest-299343130 None] <<< [GET] https://127.0.0.1:40443/api/views/ May 28 13:04:17 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ae7a9199-caf3-44ec-8456-f09ebfc47a85 tempest-SharesActionsNegativeTest-299343130 None] [] May 28 13:04:17 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ae7a9199-caf3-44ec-8456-f09ebfc47a85 tempest-SharesActionsNegativeTest-299343130 None] --- [GET] https://127.0.0.1:40443/api/views/: Done May 28 13:04:17 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ae7a9199-caf3-44ec-8456-f09ebfc47a85 tempest-SharesActionsNegativeTest-299343130 None] >>> [POST] https://127.0.0.1:40443/api/views/ May 28 13:04:17 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ae7a9199-caf3-44ec-8456-f09ebfc47a85 tempest-SharesActionsNegativeTest-299343130 None] {'data': '{"name": "2e013be0-942c-4e94-a237-2d1251405521", "path": ' May 28 13:04:17 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ae7a9199-caf3-44ec-8456-f09ebfc47a85 tempest-SharesActionsNegativeTest-299343130 None] '"/manila/manila-2e013be0-942c-4e94-a237-2d1251405521", "policy_id": ' May 28 13:04:17 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ae7a9199-caf3-44ec-8456-f09ebfc47a85 tempest-SharesActionsNegativeTest-299343130 None] '62, "create_dir": true, "protocols": ["NFS"]}', May 28 13:04:17 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ae7a9199-caf3-44ec-8456-f09ebfc47a85 tempest-SharesActionsNegativeTest-299343130 None] 'json': None, May 28 13:04:17 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ae7a9199-caf3-44ec-8456-f09ebfc47a85 tempest-SharesActionsNegativeTest-299343130 None] 'params': None} May 28 13:04:18 l75lg1-v1 dstat.sh[49771]: 28-05 13:04:18| 1 0 99 0 0|5518M 1895M 278M 7932M| 15k 1676B| 0 100k| 0 13.0 |1698 2643 |0.79 1.02 1.02|1.0 0 2.0| 0 0 | 0 2048M| 29 359 0 10 6 May 28 13:04:18 l75lg1-v1 neutron-server[77623]: DEBUG dbcounter [-] [77623] Writing DB stats neutron:SELECT=2 {{(pid=77623) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:04:18 l75lg1-v1 neutron-server[77623]: DEBUG dbcounter [-] [77623] Writing DB stats neutron:SELECT=2 {{(pid=77623) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:04:18 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ae7a9199-caf3-44ec-8456-f09ebfc47a85 tempest-SharesActionsNegativeTest-299343130 None] <<< [POST] https://127.0.0.1:40443/api/views/ May 28 13:04:18 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ae7a9199-caf3-44ec-8456-f09ebfc47a85 tempest-SharesActionsNegativeTest-299343130 None] Bunch(abac_tags=[], abe_max_depth=None, abe_protocols=[], alias='', allow_anonymous_access=False, allow_s3_anonymous_access=False, auto_commit='0d', bucket='', bucket_creators=[], bucket_creators_groups=[], bucket_owner=None, bulk_permission_update_progress=None, bulk_permission_update_state=None, cluster='loop75-kfs', cluster_id=1, created='2024-05-28T13:04:18.377803Z', enabled=True, files_retention_mode='NONE', guid='5df4faab-f53f-46bb-988a-5fe0fbae45d5', id=61, ignore_oos=False, internal=False, is_remote=False, is_seamless=False, logical_capacity=0, max_retention_period=None, min_retention_period=None, name='2e013be0-942c-4e94-a237-2d1251405521', nfs_interop_flags='BOTH_NFS3_AND_NFS4_INTEROP_DISABLED', path='/manila/manila-2e013be0-942c-4e94-a237-2d1251405521', physical_capacity=0, policy='2e013be0-942c-4e94-a237-2d1251405521', policy_id=62, protocols=['NFS'], qos_policy=None, qos_policy_id=None, s3_locks=False, s3_locks_retention_mode='NONE', s3_locks_retention_period='', s3_object_ownership_rule='ObjectWriter', s3_unverified_lookup=False, s3_versioning=False, select_for_live_monitoring=False, share='', share_acl=Bunch(acl=[], enabled=False), sync='SYNCED', sync_time='2024-05-28T13:04:18.648579Z', tenant_id=1, tenant_name='default', title='/manila/manila-2e013be0-942c-4e94-a237-2d1251405521', url='https://127.0.0.1:40443/api/views/61/') May 28 13:04:18 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ae7a9199-caf3-44ec-8456-f09ebfc47a85 tempest-SharesActionsNegativeTest-299343130 None] --- [POST] https://127.0.0.1:40443/api/views/: Done May 28 13:04:18 l75lg1-v1 manila-share[98474]: INFO manila.share.manager [None req-ae7a9199-caf3-44ec-8456-f09ebfc47a85 tempest-SharesActionsNegativeTest-299343130 None] Share instance 2e013be0-942c-4e94-a237-2d1251405521 created successfully. May 28 13:04:19 l75lg1-v1 dstat.sh[49771]: 28-05 13:04:19| 1 0 98 0 0|5518M 1895M 278M 7932M| 13k 66B| 0 212k| 0 43.0 |1994 3191 |0.79 1.02 1.02| 0 0 0| 0 0 | 0 2048M| 29 359 0 10 6 May 28 13:04:19 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-7809f01e-6e58-45dc-8de8-6d61627612e1 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] GET http://10.27.203.238/share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares/1b08ba1e-039b-4773-869c-2a90b38f5f70 May 28 13:04:19 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-7809f01e-6e58-45dc-8de8-6d61627612e1 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:04:19 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-7809f01e-6e58-45dc-8de8-6d61627612e1 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:04:19 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-7809f01e-6e58-45dc-8de8-6d61627612e1 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] http://10.27.203.238/share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares/1b08ba1e-039b-4773-869c-2a90b38f5f70 returned with HTTP 200 May 28 13:04:19 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1361/2701] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:04:19 2024] GET /share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares/1b08ba1e-039b-4773-869c-2a90b38f5f70 => generated 1344 bytes in 23 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:04:19 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-23e4a489-a531-4f1d-9bbd-a53f9c762683 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] POST http://10.27.203.238/share/v2/c39deaad5eb341ceb2e3c79518f56a1b/snapshots May 28 13:04:19 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-23e4a489-a531-4f1d-9bbd-a53f9c762683 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Action: 'create', calling method: ShareSnapshotMixin.create, body: {"snapshot": {"name": "tempest-tempest-snapshot-name-1923866954", "force": false, "description": "tempest-tempest-snapshot-description-610274080", "share_id": "1b08ba1e-039b-4773-869c-2a90b38f5f70"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:04:20 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.v1.share_snapshots [None req-23e4a489-a531-4f1d-9bbd-a53f9c762683 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Create snapshot from share 1b08ba1e-039b-4773-869c-2a90b38f5f70 May 28 13:04:20 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.quota [None req-23e4a489-a531-4f1d-9bbd-a53f9c762683 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Created reservations ['57a5a564-072d-4b48-9c39-2127bf600a55', '86d27627-e0dc-490b-b24f-3205898b4e28', '50f483d7-cfde-4320-8b99-05ae21103dd3', 'e5ddf229-310f-4686-8d65-9f6636cea439'] {{(pid=98330) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 13:04:20 l75lg1-v1 nova-conductor[83648]: DEBUG dbcounter [-] [83648] Writing DB stats nova_cell1:SELECT=1 {{(pid=83648) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:04:20 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.quota [None req-23e4a489-a531-4f1d-9bbd-a53f9c762683 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Committed reservations ['57a5a564-072d-4b48-9c39-2127bf600a55', '86d27627-e0dc-490b-b24f-3205898b4e28', '50f483d7-cfde-4320-8b99-05ae21103dd3', 'e5ddf229-310f-4686-8d65-9f6636cea439'] {{(pid=98330) commit /opt/stack/manila/manila/quota.py:1063}} May 28 13:04:20 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-23e4a489-a531-4f1d-9bbd-a53f9c762683 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] http://10.27.203.238/share/v2/c39deaad5eb341ceb2e3c79518f56a1b/snapshots returned with HTTP 202 May 28 13:04:20 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1341/2702] 10.27.203.238 () {66 vars in 1371 bytes} [Tue May 28 13:04:19 2024] POST /share/v2/c39deaad5eb341ceb2e3c79518f56a1b/snapshots => generated 746 bytes in 177 msecs (HTTP/1.1 202) 6 headers in 237 bytes (1 switches on core 0) May 28 13:04:20 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-0011c1a2-7e65-47b5-be68-0b407bb69ab0 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] GET http://10.27.203.238/share/v2/c39deaad5eb341ceb2e3c79518f56a1b/snapshots/f8bd794b-ee7c-457c-baf8-bc7ce191db35 May 28 13:04:20 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-0011c1a2-7e65-47b5-be68-0b407bb69ab0 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:04:20 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-0011c1a2-7e65-47b5-be68-0b407bb69ab0 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Calling method 'ShareSnapshotMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:04:20 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-0011c1a2-7e65-47b5-be68-0b407bb69ab0 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] http://10.27.203.238/share/v2/c39deaad5eb341ceb2e3c79518f56a1b/snapshots/f8bd794b-ee7c-457c-baf8-bc7ce191db35 returned with HTTP 200 May 28 13:04:20 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1362/2703] 10.27.203.238 () {64 vars in 1460 bytes} [Tue May 28 13:04:20 2024] GET /share/v2/c39deaad5eb341ceb2e3c79518f56a1b/snapshots/f8bd794b-ee7c-457c-baf8-bc7ce191db35 => generated 746 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:04:20 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-23e4a489-a531-4f1d-9bbd-a53f9c762683 tempest-SharesActionsNegativeTest-299343130 None] >>> [POST] https://127.0.0.1:40443/api/snapshots/ May 28 13:04:20 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-23e4a489-a531-4f1d-9bbd-a53f9c762683 tempest-SharesActionsNegativeTest-299343130 None] {'data': '{"path": "/manila/manila-2e013be0-942c-4e94-a237-2d1251405521", ' May 28 13:04:20 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-23e4a489-a531-4f1d-9bbd-a53f9c762683 tempest-SharesActionsNegativeTest-299343130 None] '"name": "share-snapshot-526b38b3-74a8-4faf-aa7f-19830c7dc26b"}', May 28 13:04:20 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-23e4a489-a531-4f1d-9bbd-a53f9c762683 tempest-SharesActionsNegativeTest-299343130 None] 'json': None, May 28 13:04:20 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-23e4a489-a531-4f1d-9bbd-a53f9c762683 tempest-SharesActionsNegativeTest-299343130 None] 'params': None} May 28 13:04:20 l75lg1-v1 dstat.sh[49771]: 28-05 13:04:20| 3 0 95 1 0|5518M 1894M 278M 7933M| 19k 908B| 0 3788k| 0 586 |3160 4977 |0.79 1.02 1.02|2.0 0 0| 0 0 | 0 2048M| 29 359 0 10 6 May 28 13:04:20 l75lg1-v1 neutron-server[77623]: DEBUG neutron.db.agents_db [None req-fe40ce8c-640e-4db7-a17a-6e8888cce266 None None] Agent healthcheck: found 0 active agents {{(pid=77623) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:319}} May 28 13:04:21 l75lg1-v1 dstat.sh[49771]: 28-05 13:04:21| 1 0 99 0 0|5518M 1894M 278M 7933M| 19k 172B| 0 340k| 0 26.0 |1997 2907 |0.79 1.02 1.02| 0 0 0| 0 0 | 0 2048M| 29 359 0 10 6 May 28 13:04:21 l75lg1-v1 manila-data[98318]: DEBUG dbcounter [-] [98318] Writing DB stats manila:SELECT=32,manila:UPDATE=7 {{(pid=98318) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:04:22 l75lg1-v1 neutron-server[77619]: DEBUG dbcounter [-] [77619] Writing DB stats neutron:SELECT=1 {{(pid=77619) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:04:22 l75lg1-v1 neutron-server[77619]: DEBUG dbcounter [-] [77619] Writing DB stats neutron:SELECT=2 {{(pid=77619) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:04:22 l75lg1-v1 dstat.sh[49771]: 28-05 13:04:22| 1 0 98 1 0|5518M 1894M 278M 7933M| 22k 0 | 0 435k| 0 59.9 |2281 3409 |0.79 1.02 1.02|1.0 1.0 0| 0 0 | 0 2048M| 29 359 0 10 6 May 28 13:04:22 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-23e4a489-a531-4f1d-9bbd-a53f9c762683 tempest-SharesActionsNegativeTest-299343130 None] <<< [POST] https://127.0.0.1:40443/api/snapshots/ May 28 13:04:22 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-23e4a489-a531-4f1d-9bbd-a53f9c762683 tempest-SharesActionsNegativeTest-299343130 None] Bunch(access_path='/.vast_all_snapshots/1000000018_share-snapshot-526b38b3-74a8-4faf-aa7f-19830c7dc26b', aggr_phys_estimation=0, cluster='loop75-kfs', created='2024-05-28T13:04:20.570385Z', eta_sec=30819898535.35057, expiration_time='3001-01-19T07:59:58Z', guid='43b26ef9-a68c-43c1-97bb-8b6aa9c99940', id=19, indestructible=False, locked=False, name='share-snapshot-526b38b3-74a8-4faf-aa7f-19830c7dc26b', path='/manila/manila-2e013be0-942c-4e94-a237-2d1251405521/', policy=None, policy_id=None, protection_policy_id=None, state='SUCCEED', tenant_id=1, tenant_name='default', title='share-snapshot-526b38b3-74a8-4faf-aa7f-19830c7dc26b(/manila/manila-2e013be0-942c-4e94-a237-2d1251405521/)', type='local', unique_phys_estimation=0, url='https://127.0.0.1:40443/api/snapshots/19/') May 28 13:04:22 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-23e4a489-a531-4f1d-9bbd-a53f9c762683 tempest-SharesActionsNegativeTest-299343130 None] --- [POST] https://127.0.0.1:40443/api/snapshots/: Done May 28 13:04:23 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-00f16b1a-68c7-4cff-abb8-973d020310b1 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] GET http://10.27.203.238/share/v2/c39deaad5eb341ceb2e3c79518f56a1b/snapshots/f8bd794b-ee7c-457c-baf8-bc7ce191db35 May 28 13:04:23 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-00f16b1a-68c7-4cff-abb8-973d020310b1 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:04:23 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-00f16b1a-68c7-4cff-abb8-973d020310b1 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Calling method 'ShareSnapshotMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:04:23 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-00f16b1a-68c7-4cff-abb8-973d020310b1 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] http://10.27.203.238/share/v2/c39deaad5eb341ceb2e3c79518f56a1b/snapshots/f8bd794b-ee7c-457c-baf8-bc7ce191db35 returned with HTTP 200 May 28 13:04:23 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1342/2704] 10.27.203.238 () {64 vars in 1460 bytes} [Tue May 28 13:04:23 2024] GET /share/v2/c39deaad5eb341ceb2e3c79518f56a1b/snapshots/f8bd794b-ee7c-457c-baf8-bc7ce191db35 => generated 747 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:04:23 l75lg1-v1 dstat.sh[49771]: 28-05 13:04:23| 1 0 98 1 0|5518M 1894M 278M 7933M| 24k 66B| 0 445k| 0 69.1 |2495 3832 |0.97 1.05 1.03|2.0 0 0| 0 0 | 0 2048M| 29 360 0 10 6 May 28 13:04:23 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2695c7-7767-42b9-9eea-9fe1cb6059ef service manila] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:04:23 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2695c7-7767-42b9-9eea-9fe1cb6059ef service manila] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:04:23 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5831c7b-4373-44f9-96f1-5cc35c194c7d service manila] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f110cf6300f049c897d0aab63218d1e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:04:23 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5831c7b-4373-44f9-96f1-5cc35c194c7d service manila] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:04:23 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5831c7b-4373-44f9-96f1-5cc35c194c7d service manila] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:04:23 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5831c7b-4373-44f9-96f1-5cc35c194c7d service manila] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:04:23 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5831c7b-4373-44f9-96f1-5cc35c194c7d service manila] RBAC: Authorizing `identity:validate_token()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:04:23 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5831c7b-4373-44f9-96f1-5cc35c194c7d service manila] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:04:23 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1827/3685] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 13:04:23 2024] GET /identity/v3/auth/tokens => generated 3958 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 13:04:23 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-473ad9b6-771e-4521-a760-1065ce1ae6f5 tempest-SharesActionsNegativeTest-874588647 tempest-SharesActionsNegativeTest-874588647-project-member] GET http://10.27.203.238/share/v2/0458d53d773c434eafc80da00cf6604a/shares/1b08ba1e-039b-4773-869c-2a90b38f5f70 May 28 13:04:23 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-473ad9b6-771e-4521-a760-1065ce1ae6f5 tempest-SharesActionsNegativeTest-874588647 tempest-SharesActionsNegativeTest-874588647-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:04:23 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-473ad9b6-771e-4521-a760-1065ce1ae6f5 tempest-SharesActionsNegativeTest-874588647 tempest-SharesActionsNegativeTest-874588647-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:04:23 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-473ad9b6-771e-4521-a760-1065ce1ae6f5 tempest-SharesActionsNegativeTest-874588647 tempest-SharesActionsNegativeTest-874588647-project-member] HTTP exception thrown: The resource could not be found. May 28 13:04:23 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-473ad9b6-771e-4521-a760-1065ce1ae6f5 tempest-SharesActionsNegativeTest-874588647 tempest-SharesActionsNegativeTest-874588647-project-member] http://10.27.203.238/share/v2/0458d53d773c434eafc80da00cf6604a/shares/1b08ba1e-039b-4773-869c-2a90b38f5f70 returned with HTTP 404 May 28 13:04:23 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1363/2705] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:04:23 2024] GET /share/v2/0458d53d773c434eafc80da00cf6604a/shares/1b08ba1e-039b-4773-869c-2a90b38f5f70 => generated 78 bytes in 88 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 13:04:23 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-1843362f-25b2-4ffc-9d16-5cda3fc1b11a tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] GET http://10.27.203.238/share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares?description=tempest-share May 28 13:04:23 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-1843362f-25b2-4ffc-9d16-5cda3fc1b11a tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:04:23 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-1843362f-25b2-4ffc-9d16-5cda3fc1b11a tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:04:23 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.common [None req-1843362f-25b2-4ffc-9d16-5cda3fc1b11a tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Removing options '' from query {{(pid=98330) remove_invalid_options /opt/stack/manila/manila/api/common.py:441}} May 28 13:04:23 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.share.api [None req-1843362f-25b2-4ffc-9d16-5cda3fc1b11a tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Searching for shares by: {'display_description': 'tempest-share'} {{(pid=98330) _get_all /opt/stack/manila/manila/share/api.py:2235}} May 28 13:04:23 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-1843362f-25b2-4ffc-9d16-5cda3fc1b11a tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] http://10.27.203.238/share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares?description=tempest-share returned with HTTP 200 May 28 13:04:23 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1343/2706] 10.27.203.238 () {64 vars in 1391 bytes} [Tue May 28 13:04:23 2024] GET /share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares?description=tempest-share => generated 14 bytes in 19 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:04:23 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-51c20527-2d1a-47e7-acc3-f5d091ea614e tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] GET http://10.27.203.238/share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares?export_location_path=fake May 28 13:04:23 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-51c20527-2d1a-47e7-acc3-f5d091ea614e tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:04:23 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-51c20527-2d1a-47e7-acc3-f5d091ea614e tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:04:23 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.common [None req-51c20527-2d1a-47e7-acc3-f5d091ea614e tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Removing options '' from query {{(pid=98329) remove_invalid_options /opt/stack/manila/manila/api/common.py:441}} May 28 13:04:23 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.share.api [None req-51c20527-2d1a-47e7-acc3-f5d091ea614e tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Searching for shares by: {} {{(pid=98329) _get_all /opt/stack/manila/manila/share/api.py:2235}} May 28 13:04:23 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-51c20527-2d1a-47e7-acc3-f5d091ea614e tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] http://10.27.203.238/share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares returned with HTTP 200 May 28 13:04:23 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1364/2707] 10.27.203.238 () {64 vars in 1391 bytes} [Tue May 28 13:04:23 2024] GET /share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares?export_location_path=fake => generated 391 bytes in 26 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:04:23 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-e773a8c1-27e3-4053-84c9-081b034f7f28 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] GET http://10.27.203.238/share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares?export_location_id=fake May 28 13:04:23 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-e773a8c1-27e3-4053-84c9-081b034f7f28 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:04:23 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-e773a8c1-27e3-4053-84c9-081b034f7f28 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:04:23 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.common [None req-e773a8c1-27e3-4053-84c9-081b034f7f28 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Removing options '' from query {{(pid=98330) remove_invalid_options /opt/stack/manila/manila/api/common.py:441}} May 28 13:04:23 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.share.api [None req-e773a8c1-27e3-4053-84c9-081b034f7f28 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Searching for shares by: {} {{(pid=98330) _get_all /opt/stack/manila/manila/share/api.py:2235}} May 28 13:04:23 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-e773a8c1-27e3-4053-84c9-081b034f7f28 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] http://10.27.203.238/share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares returned with HTTP 200 May 28 13:04:23 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1344/2708] 10.27.203.238 () {64 vars in 1387 bytes} [Tue May 28 13:04:23 2024] GET /share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares?export_location_id=fake => generated 391 bytes in 26 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:04:23 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-16038aa0-497a-42a1-acc1-9f5843b305ca tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] GET http://10.27.203.238/share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares?export_location_path=fake_not_exist May 28 13:04:23 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-16038aa0-497a-42a1-acc1-9f5843b305ca tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:04:23 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-16038aa0-497a-42a1-acc1-9f5843b305ca tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:04:23 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.common [None req-16038aa0-497a-42a1-acc1-9f5843b305ca tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Removing options '' from query {{(pid=98329) remove_invalid_options /opt/stack/manila/manila/api/common.py:441}} May 28 13:04:23 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.share.api [None req-16038aa0-497a-42a1-acc1-9f5843b305ca tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Searching for shares by: {'export_location_path': 'fake_not_exist'} {{(pid=98329) _get_all /opt/stack/manila/manila/share/api.py:2235}} May 28 13:04:23 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-16038aa0-497a-42a1-acc1-9f5843b305ca tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] http://10.27.203.238/share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares?export_location_path=fake_not_exist returned with HTTP 200 May 28 13:04:23 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1365/2709] 10.27.203.238 () {64 vars in 1411 bytes} [Tue May 28 13:04:23 2024] GET /share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares?export_location_path=fake_not_exist => generated 14 bytes in 19 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:04:23 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-3ab9307f-0cda-4bdc-813b-5f9dc7d3099e tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] GET http://10.27.203.238/share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares?export_location_id=fake_not_exist May 28 13:04:23 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-3ab9307f-0cda-4bdc-813b-5f9dc7d3099e tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:04:23 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-3ab9307f-0cda-4bdc-813b-5f9dc7d3099e tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:04:23 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.common [None req-3ab9307f-0cda-4bdc-813b-5f9dc7d3099e tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Removing options '' from query {{(pid=98330) remove_invalid_options /opt/stack/manila/manila/api/common.py:441}} May 28 13:04:23 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.share.api [None req-3ab9307f-0cda-4bdc-813b-5f9dc7d3099e tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Searching for shares by: {'export_location_id': 'fake_not_exist'} {{(pid=98330) _get_all /opt/stack/manila/manila/share/api.py:2235}} May 28 13:04:23 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-3ab9307f-0cda-4bdc-813b-5f9dc7d3099e tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] http://10.27.203.238/share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares?export_location_id=fake_not_exist returned with HTTP 200 May 28 13:04:23 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1345/2710] 10.27.203.238 () {64 vars in 1407 bytes} [Tue May 28 13:04:23 2024] GET /share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares?export_location_id=fake_not_exist => generated 14 bytes in 19 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:04:23 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-328f9d97-55b1-42b4-94a1-6eab8dc19daf tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] GET http://10.27.203.238/share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares?name~=fake&description~=fake May 28 13:04:23 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-328f9d97-55b1-42b4-94a1-6eab8dc19daf tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:04:23 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-328f9d97-55b1-42b4-94a1-6eab8dc19daf tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:04:23 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.common [None req-328f9d97-55b1-42b4-94a1-6eab8dc19daf tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Removing options '' from query {{(pid=98329) remove_invalid_options /opt/stack/manila/manila/api/common.py:441}} May 28 13:04:23 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.share.api [None req-328f9d97-55b1-42b4-94a1-6eab8dc19daf tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Searching for shares by: {} {{(pid=98329) _get_all /opt/stack/manila/manila/share/api.py:2235}} May 28 13:04:23 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-328f9d97-55b1-42b4-94a1-6eab8dc19daf tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] http://10.27.203.238/share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares returned with HTTP 200 May 28 13:04:23 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1366/2711] 10.27.203.238 () {64 vars in 1397 bytes} [Tue May 28 13:04:23 2024] GET /share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares?name~=fake&description~=fake => generated 391 bytes in 29 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:04:23 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-085c3592-97e4-487d-94f0-092704c68866 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] GET http://10.27.203.238/share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares?name~=fake_not_exist&description~=fake_not_exist May 28 13:04:23 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-085c3592-97e4-487d-94f0-092704c68866 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:04:23 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-085c3592-97e4-487d-94f0-092704c68866 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:04:23 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.common [None req-085c3592-97e4-487d-94f0-092704c68866 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Removing options '' from query {{(pid=98330) remove_invalid_options /opt/stack/manila/manila/api/common.py:441}} May 28 13:04:23 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.share.api [None req-085c3592-97e4-487d-94f0-092704c68866 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Searching for shares by: {'display_name~': 'fake_not_exist', 'display_description~': 'fake_not_exist'} {{(pid=98330) _get_all /opt/stack/manila/manila/share/api.py:2235}} May 28 13:04:23 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-085c3592-97e4-487d-94f0-092704c68866 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] http://10.27.203.238/share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares?name~=fake_not_exist&description~=fake_not_exist returned with HTTP 200 May 28 13:04:23 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1346/2712] 10.27.203.238 () {64 vars in 1437 bytes} [Tue May 28 13:04:23 2024] GET /share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares?name~=fake_not_exist&description~=fake_not_exist => generated 14 bytes in 20 msecs (HTTP/1.1 200) 6 headers in 230 bytes (2 switches on core 0) May 28 13:04:23 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-c45b3c42-6f82-4d1b-835b-ba81c872c2ea tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] GET http://10.27.203.238/share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares?name=tempest-share May 28 13:04:23 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-c45b3c42-6f82-4d1b-835b-ba81c872c2ea tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:04:23 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-c45b3c42-6f82-4d1b-835b-ba81c872c2ea tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:04:23 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.common [None req-c45b3c42-6f82-4d1b-835b-ba81c872c2ea tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Removing options '' from query {{(pid=98329) remove_invalid_options /opt/stack/manila/manila/api/common.py:441}} May 28 13:04:23 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.share.api [None req-c45b3c42-6f82-4d1b-835b-ba81c872c2ea tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Searching for shares by: {'display_name': 'tempest-share'} {{(pid=98329) _get_all /opt/stack/manila/manila/share/api.py:2235}} May 28 13:04:23 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-c45b3c42-6f82-4d1b-835b-ba81c872c2ea tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] http://10.27.203.238/share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares?name=tempest-share returned with HTTP 200 May 28 13:04:23 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1367/2713] 10.27.203.238 () {64 vars in 1377 bytes} [Tue May 28 13:04:23 2024] GET /share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares?name=tempest-share => generated 14 bytes in 13 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:04:23 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-a92353ff-fc69-4af8-80ee-e3f08c00109e tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] GET http://10.27.203.238/share/v2/c39deaad5eb341ceb2e3c79518f56a1b/snapshots/detail?description=tempest-snapshot May 28 13:04:23 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-a92353ff-fc69-4af8-80ee-e3f08c00109e tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:04:23 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-a92353ff-fc69-4af8-80ee-e3f08c00109e tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:04:23 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.common [None req-a92353ff-fc69-4af8-80ee-e3f08c00109e tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Removing options '' from query {{(pid=98330) remove_invalid_options /opt/stack/manila/manila/api/common.py:441}} May 28 13:04:23 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.share.api [None req-a92353ff-fc69-4af8-80ee-e3f08c00109e tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Searching for snapshots by: {'display_description': 'tempest-snapshot'} {{(pid=98330) _get_all_snapshots /opt/stack/manila/manila/share/api.py:2349}} May 28 13:04:23 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-a92353ff-fc69-4af8-80ee-e3f08c00109e tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] http://10.27.203.238/share/v2/c39deaad5eb341ceb2e3c79518f56a1b/snapshots/detail?description=tempest-snapshot returned with HTTP 200 May 28 13:04:23 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1347/2714] 10.27.203.238 () {64 vars in 1427 bytes} [Tue May 28 13:04:23 2024] GET /share/v2/c39deaad5eb341ceb2e3c79518f56a1b/snapshots/detail?description=tempest-snapshot => generated 17 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:04:23 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-547edaa0-3043-4494-ab64-3cf8f15e0ba6 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] GET http://10.27.203.238/share/v2/c39deaad5eb341ceb2e3c79518f56a1b/snapshots/detail?name=tempest-snapshot May 28 13:04:23 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-547edaa0-3043-4494-ab64-3cf8f15e0ba6 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:04:23 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-547edaa0-3043-4494-ab64-3cf8f15e0ba6 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:04:23 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.common [None req-547edaa0-3043-4494-ab64-3cf8f15e0ba6 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Removing options '' from query {{(pid=98329) remove_invalid_options /opt/stack/manila/manila/api/common.py:441}} May 28 13:04:23 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.share.api [None req-547edaa0-3043-4494-ab64-3cf8f15e0ba6 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Searching for snapshots by: {'display_name': 'tempest-snapshot'} {{(pid=98329) _get_all_snapshots /opt/stack/manila/manila/share/api.py:2349}} May 28 13:04:23 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-547edaa0-3043-4494-ab64-3cf8f15e0ba6 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] http://10.27.203.238/share/v2/c39deaad5eb341ceb2e3c79518f56a1b/snapshots/detail?name=tempest-snapshot returned with HTTP 200 May 28 13:04:23 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1368/2715] 10.27.203.238 () {64 vars in 1413 bytes} [Tue May 28 13:04:23 2024] GET /share/v2/c39deaad5eb341ceb2e3c79518f56a1b/snapshots/detail?name=tempest-snapshot => generated 17 bytes in 27 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:04:23 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-79ea41c4-1814-483d-b206-f5a79c6229fd tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] POST http://10.27.203.238/share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares/wrong_share_id/action May 28 13:04:23 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-79ea41c4-1814-483d-b206-f5a79c6229fd tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Action body: b'{"restore": null}' {{(pid=98330) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 13:04:23 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-79ea41c4-1814-483d-b206-f5a79c6229fd tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Action: 'action', calling method: Controller.__getattribute__..version_select, body: {"restore": null} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:04:23 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.v2.shares [None req-79ea41c4-1814-483d-b206-f5a79c6229fd tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Restore share with id: wrong_share_id {{(pid=98330) share_restore /opt/stack/manila/manila/api/v2/shares.py:303}} May 28 13:04:23 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-79ea41c4-1814-483d-b206-f5a79c6229fd tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] HTTP exception thrown: No share exists with ID wrong_share_id. May 28 13:04:23 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-79ea41c4-1814-483d-b206-f5a79c6229fd tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] http://10.27.203.238/share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares/wrong_share_id/action returned with HTTP 404 May 28 13:04:23 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1348/2716] 10.27.203.238 () {66 vars in 1427 bytes} [Tue May 28 13:04:23 2024] POST /share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares/wrong_share_id/action => generated 85 bytes in 13 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 13:04:23 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-07a13bfe-65a4-4fd7-b8ff-961521f24b4e tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] POST http://10.27.203.238/share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares May 28 13:04:23 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-07a13bfe-65a4-4fd7-b8ff-961521f24b4e tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share": {"share_proto": "nfs", "description": "Tempest's share", "snapshot_id": null, "name": "tempest-tempest-created-share-2119050123", "size": 1, "metadata": {}, "is_public": false, "share_type": "f7d65ead-0196-4e03-928f-2e08ca825112"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:04:23 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.v1.shares [None req-07a13bfe-65a4-4fd7-b8ff-961521f24b4e tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Create NFS share of 1 GB May 28 13:04:23 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.quota [None req-07a13bfe-65a4-4fd7-b8ff-961521f24b4e tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Created reservations ['56a169b4-6fda-4ccb-b908-347c4e029298', '4f4f51b9-15e9-44aa-8b4f-1315aace40a0', '23e87d62-a7be-4f28-a9b4-a06e041b4298', '6767fd02-68d1-40fc-bf8a-92691c61df62'] {{(pid=98329) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 13:04:23 l75lg1-v1 devstack@keystone.service[51267]: DEBUG dbcounter [-] [51267] Writing DB stats keystone:SELECT=191,keystone:DELETE=24,keystone:INSERT=13 {{(pid=51267) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:04:23 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.quota [None req-07a13bfe-65a4-4fd7-b8ff-961521f24b4e tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Committed reservations ['56a169b4-6fda-4ccb-b908-347c4e029298', '4f4f51b9-15e9-44aa-8b4f-1315aace40a0', '23e87d62-a7be-4f28-a9b4-a06e041b4298', '6767fd02-68d1-40fc-bf8a-92691c61df62'] {{(pid=98329) commit /opt/stack/manila/manila/quota.py:1063}} May 28 13:04:23 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.host_manager [None req-07a13bfe-65a4-4fd7-b8ff-961521f24b4e tempest-SharesActionsNegativeTest-299343130 None] Share service is down. (host: l75lg1-v1@generic2). May 28 13:04:23 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.host_manager [None req-07a13bfe-65a4-4fd7-b8ff-961521f24b4e tempest-SharesActionsNegativeTest-299343130 None] Share service is down. (host: l75lg1-v1@generic1). May 28 13:04:23 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-07a13bfe-65a4-4fd7-b8ff-961521f24b4e tempest-SharesActionsNegativeTest-299343130 None] Starting with 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:80}} May 28 13:04:23 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-07a13bfe-65a4-4fd7-b8ff-961521f24b4e tempest-SharesActionsNegativeTest-299343130 None] Filter OnlyHostFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:04:23 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-07a13bfe-65a4-4fd7-b8ff-961521f24b4e tempest-SharesActionsNegativeTest-299343130 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:04:23 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.capacity [None req-07a13bfe-65a4-4fd7-b8ff-961521f24b4e tempest-SharesActionsNegativeTest-299343130 None] Space information for share creation on host l75lg1-v1@vast#vast (requested / avail): 1/2081 {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/capacity.py:83}} May 28 13:04:23 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-07a13bfe-65a4-4fd7-b8ff-961521f24b4e tempest-SharesActionsNegativeTest-299343130 None] Filter CapacityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:04:23 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-07a13bfe-65a4-4fd7-b8ff-961521f24b4e tempest-SharesActionsNegativeTest-299343130 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:04:23 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-07a13bfe-65a4-4fd7-b8ff-961521f24b4e tempest-SharesActionsNegativeTest-299343130 None] Driver Filter: Checking host 'l75lg1-v1@vast#vast' {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:37}} May 28 13:04:23 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-07a13bfe-65a4-4fd7-b8ff-961521f24b4e tempest-SharesActionsNegativeTest-299343130 None] Filter function not set :: passing host. {{(pid=98327) _check_filter_function /opt/stack/manila/manila/scheduler/filters/driver.py:53}} May 28 13:04:23 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-07a13bfe-65a4-4fd7-b8ff-961521f24b4e tempest-SharesActionsNegativeTest-299343130 None] Result: True {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:40}} May 28 13:04:23 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-07a13bfe-65a4-4fd7-b8ff-961521f24b4e tempest-SharesActionsNegativeTest-299343130 None] Done checking host 'l75lg1-v1@vast#vast' {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:41}} May 28 13:04:23 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-07a13bfe-65a4-4fd7-b8ff-961521f24b4e tempest-SharesActionsNegativeTest-299343130 None] Filter DriverFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:04:23 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-07a13bfe-65a4-4fd7-b8ff-961521f24b4e tempest-SharesActionsNegativeTest-299343130 None] Filter ShareReplicationFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:04:23 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-07a13bfe-65a4-4fd7-b8ff-961521f24b4e tempest-SharesActionsNegativeTest-299343130 None] Filter CreateFromSnapshotFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:04:23 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-07a13bfe-65a4-4fd7-b8ff-961521f24b4e tempest-SharesActionsNegativeTest-299343130 None] Filter AffinityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:04:23 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-07a13bfe-65a4-4fd7-b8ff-961521f24b4e tempest-SharesActionsNegativeTest-299343130 None] Filter AntiAffinityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:04:23 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.drivers.filter [None req-07a13bfe-65a4-4fd7-b8ff-961521f24b4e tempest-SharesActionsNegativeTest-299343130 None] Filtered share [host: 'l75lg1-v1@vast#vast', free_capacity_gb: 2081.6467494899407, pools: None] {{(pid=98327) _schedule_share /opt/stack/manila/manila/scheduler/drivers/filter.py:268}} May 28 13:04:23 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-07a13bfe-65a4-4fd7-b8ff-961521f24b4e tempest-SharesActionsNegativeTest-299343130 None] Checking host 'l75lg1-v1@vast#vast' {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:46}} May 28 13:04:23 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.weighers.goodness [None req-07a13bfe-65a4-4fd7-b8ff-961521f24b4e tempest-SharesActionsNegativeTest-299343130 None] Goodness function not set :: defaulting to minimal goodness rating of 0. May 28 13:04:23 l75lg1-v1 manila-scheduler[98327]: INFO manila.scheduler.weighers.goodness [None req-07a13bfe-65a4-4fd7-b8ff-961521f24b4e tempest-SharesActionsNegativeTest-299343130 None] Goodness function result for host l75lg1-v1@vast#vast: 0. May 28 13:04:23 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-07a13bfe-65a4-4fd7-b8ff-961521f24b4e tempest-SharesActionsNegativeTest-299343130 None] Goodness: 0 {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:48}} May 28 13:04:23 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-07a13bfe-65a4-4fd7-b8ff-961521f24b4e tempest-SharesActionsNegativeTest-299343130 None] Done checking host 'l75lg1-v1@vast#vast' {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:49}} May 28 13:04:23 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.drivers.filter [None req-07a13bfe-65a4-4fd7-b8ff-961521f24b4e tempest-SharesActionsNegativeTest-299343130 None] Choosing for share: WeighedHost [host: l75lg1-v1@vast#vast, weight: 0.0] {{(pid=98327) _schedule_share /opt/stack/manila/manila/scheduler/drivers/filter.py:274}} May 28 13:04:23 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-07a13bfe-65a4-4fd7-b8ff-961521f24b4e tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] http://10.27.203.238/share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares returned with HTTP 200 May 28 13:04:23 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1369/2717] 10.27.203.238 () {66 vars in 1362 bytes} [Tue May 28 13:04:23 2024] POST /share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares => generated 1313 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:04:23 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-64a0b929-e019-4c50-9165-426e1be3765b tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] GET http://10.27.203.238/share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares/ef0dbdd6-46ed-4668-8fa0-d9a41928edcf May 28 13:04:23 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-64a0b929-e019-4c50-9165-426e1be3765b tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:04:23 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-64a0b929-e019-4c50-9165-426e1be3765b tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:04:23 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-64a0b929-e019-4c50-9165-426e1be3765b tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] http://10.27.203.238/share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares/ef0dbdd6-46ed-4668-8fa0-d9a41928edcf returned with HTTP 200 May 28 13:04:23 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1349/2718] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:04:23 2024] GET /share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares/ef0dbdd6-46ed-4668-8fa0-d9a41928edcf => generated 1313 bytes in 26 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:04:23 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-07a13bfe-65a4-4fd7-b8ff-961521f24b4e tempest-SharesActionsNegativeTest-299343130 None] >>> [GET] https://127.0.0.1:40443/api/vippools/ May 28 13:04:23 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-07a13bfe-65a4-4fd7-b8ff-961521f24b4e tempest-SharesActionsNegativeTest-299343130 None] {'allow_redirects': True, 'params': {'name': 'vippool-1'}} May 28 13:04:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "_check_child_processes" by "neutron.agent.linux.external_process.ProcessMonitor._check_child_processes" {{(pid=76818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:04:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_concurrency.lockutils [-] Lock "_check_child_processes" acquired by "neutron.agent.linux.external_process.ProcessMonitor._check_child_processes" :: waited 0.001s {{(pid=76818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:04:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_concurrency.lockutils [-] Lock "_check_child_processes" "released" by "neutron.agent.linux.external_process.ProcessMonitor._check_child_processes" :: held 0.001s {{(pid=76818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:04:24 l75lg1-v1 dstat.sh[49771]: 28-05 13:04:24| 8 1 89 1 0|5520M 1893M 278M 7933M| 16k 18k| 0 836k| 0 136 |4670 7248 |0.97 1.05 1.03| 0 0 0| 0 0 | 0 2048M| 29 359 0 10 6 May 28 13:04:24 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-07a13bfe-65a4-4fd7-b8ff-961521f24b4e tempest-SharesActionsNegativeTest-299343130 None] <<< [GET] https://127.0.0.1:40443/api/vippools/ May 28 13:04:24 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-07a13bfe-65a4-4fd7-b8ff-961521f24b4e tempest-SharesActionsNegativeTest-299343130 None] [Bunch(active_cnode_ids=[], active_interfaces=4, cluster='loop75-kfs', cluster_id=1, cnode_ids=[], cnodes=[], domain_name='vippool-1', enable_l3=False, enable_weighted_balancing=False, enabled=True, end_ip='172.21.75.4', guid='f2abaede-b397-413a-8faa-3aeead6d3b28', gw_ip='', gw_ipv6='', id=2, ip_ranges=[['172.21.75.1', '172.21.75.4']], name='vippool-1', peer_asn=0, port_membership='ALL', ranges_summary='172.21.75.[1-4]', role='PROTOCOLS', start_ip='172.21.75.1', subnet_cidr=16, subnet_cidr_ipv6=None, sync='SYNCED', sync_time='2024-05-28T12:50:09.644123Z', tenant_id=1, tenant_name='default', title='172.21.75.1 - 172.21.75.4', url='https://127.0.0.1:40443/api/vippools/2/', vast_asn=0, vlan=0, vms_preferred=False)] May 28 13:04:24 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-07a13bfe-65a4-4fd7-b8ff-961521f24b4e tempest-SharesActionsNegativeTest-299343130 None] --- [GET] https://127.0.0.1:40443/api/vippools/: Done May 28 13:04:24 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-07a13bfe-65a4-4fd7-b8ff-961521f24b4e tempest-SharesActionsNegativeTest-299343130 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:04:24 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-07a13bfe-65a4-4fd7-b8ff-961521f24b4e tempest-SharesActionsNegativeTest-299343130 None] {'allow_redirects': True, May 28 13:04:24 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-07a13bfe-65a4-4fd7-b8ff-961521f24b4e tempest-SharesActionsNegativeTest-299343130 None] 'params': {'name': '1929f9f3-96fb-4051-bf80-658af4cd76b6'}} May 28 13:04:24 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-07a13bfe-65a4-4fd7-b8ff-961521f24b4e tempest-SharesActionsNegativeTest-299343130 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:04:24 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-07a13bfe-65a4-4fd7-b8ff-961521f24b4e tempest-SharesActionsNegativeTest-299343130 None] [] May 28 13:04:24 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-07a13bfe-65a4-4fd7-b8ff-961521f24b4e tempest-SharesActionsNegativeTest-299343130 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 13:04:24 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-07a13bfe-65a4-4fd7-b8ff-961521f24b4e tempest-SharesActionsNegativeTest-299343130 None] >>> [POST] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:04:24 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-07a13bfe-65a4-4fd7-b8ff-961521f24b4e tempest-SharesActionsNegativeTest-299343130 None] {'data': '{"name": "1929f9f3-96fb-4051-bf80-658af4cd76b6"}', May 28 13:04:24 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-07a13bfe-65a4-4fd7-b8ff-961521f24b4e tempest-SharesActionsNegativeTest-299343130 None] 'json': None, May 28 13:04:24 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-07a13bfe-65a4-4fd7-b8ff-961521f24b4e tempest-SharesActionsNegativeTest-299343130 None] 'params': None} May 28 13:04:25 l75lg1-v1 dstat.sh[49771]: 28-05 13:04:25| 1 0 98 0 0|5519M 1893M 278M 7933M| 15k 1498B| 0 260k| 0 18.0 |1711 2573 |0.97 1.05 1.03|1.0 0 0| 0 0 | 0 2048M| 29 359 0 9 6 May 28 13:04:25 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-07a13bfe-65a4-4fd7-b8ff-961521f24b4e tempest-SharesActionsNegativeTest-299343130 None] <<< [POST] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:04:25 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-07a13bfe-65a4-4fd7-b8ff-961521f24b4e tempest-SharesActionsNegativeTest-299343130 None] Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=0, created='2024-05-28T13:04:25.131887Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='8b435fd3-bb8f-43fa-a38b-fada06dbd24b', id=63, internal=False, is_s3_default_policy=False, name='1929f9f3-96fb-4051-bf80-658af4cd76b6', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=[], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['*'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['*'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T13:04:25.473958Z', tenant_id=1, tenant_name='default', title='1929f9f3-96fb-4051-bf80-658af4cd76b6', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/63/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[]) May 28 13:04:25 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-07a13bfe-65a4-4fd7-b8ff-961521f24b4e tempest-SharesActionsNegativeTest-299343130 None] --- [POST] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 13:04:25 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-07a13bfe-65a4-4fd7-b8ff-961521f24b4e tempest-SharesActionsNegativeTest-299343130 None] >>> [GET] https://127.0.0.1:40443/api/quotas/ May 28 13:04:25 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-07a13bfe-65a4-4fd7-b8ff-961521f24b4e tempest-SharesActionsNegativeTest-299343130 None] {'allow_redirects': True, May 28 13:04:25 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-07a13bfe-65a4-4fd7-b8ff-961521f24b4e tempest-SharesActionsNegativeTest-299343130 None] 'params': {'name': '1929f9f3-96fb-4051-bf80-658af4cd76b6'}} May 28 13:04:25 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_service.periodic_task [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85846) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 13:04:25 l75lg1-v1 cinder-volume[85846]: DEBUG cinder.volume.drivers.lvm [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] Updating volume stats {{(pid=85846) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}} May 28 13:04:25 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:390}} May 28 13:04:25 l75lg1-v1 sudo[99332]: vastdata : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 May 28 13:04:25 l75lg1-v1 sudo[99332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) May 28 13:04:26 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-07a13bfe-65a4-4fd7-b8ff-961521f24b4e tempest-SharesActionsNegativeTest-299343130 None] <<< [GET] https://127.0.0.1:40443/api/quotas/ May 28 13:04:26 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-07a13bfe-65a4-4fd7-b8ff-961521f24b4e tempest-SharesActionsNegativeTest-299343130 None] [] May 28 13:04:26 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-07a13bfe-65a4-4fd7-b8ff-961521f24b4e tempest-SharesActionsNegativeTest-299343130 None] --- [GET] https://127.0.0.1:40443/api/quotas/: Done May 28 13:04:26 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-07a13bfe-65a4-4fd7-b8ff-961521f24b4e tempest-SharesActionsNegativeTest-299343130 None] >>> [POST] https://127.0.0.1:40443/api/quotas/ May 28 13:04:26 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-07a13bfe-65a4-4fd7-b8ff-961521f24b4e tempest-SharesActionsNegativeTest-299343130 None] {'data': '{"name": "1929f9f3-96fb-4051-bf80-658af4cd76b6", "path": ' May 28 13:04:26 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-07a13bfe-65a4-4fd7-b8ff-961521f24b4e tempest-SharesActionsNegativeTest-299343130 None] '"/manila/manila-1929f9f3-96fb-4051-bf80-658af4cd76b6", "create_dir": ' May 28 13:04:26 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-07a13bfe-65a4-4fd7-b8ff-961521f24b4e tempest-SharesActionsNegativeTest-299343130 None] 'true, "hard_limit": 1073741824}', May 28 13:04:26 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-07a13bfe-65a4-4fd7-b8ff-961521f24b4e tempest-SharesActionsNegativeTest-299343130 None] 'json': None, May 28 13:04:26 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-07a13bfe-65a4-4fd7-b8ff-961521f24b4e tempest-SharesActionsNegativeTest-299343130 None] 'params': None} May 28 13:04:26 l75lg1-v1 sudo[99332]: pam_unix(sudo:session): session closed for user root May 28 13:04:26 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.444s {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:428}} May 28 13:04:26 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:390}} May 28 13:04:26 l75lg1-v1 sudo[99335]: vastdata : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 May 28 13:04:26 l75lg1-v1 sudo[99335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) May 28 13:04:26 l75lg1-v1 dstat.sh[49771]: 28-05 13:04:26| 4 1 93 0 0|5522M 1891M 278M 7933M| 15k 1666B| 256k 304k|2.00 21.0 |1933 2692 |0.97 1.05 1.03|4.0 0 5.0| 0 0 | 0 2048M| 29 359 0 9 6 May 28 13:04:26 l75lg1-v1 sudo[99335]: pam_unix(sudo:session): session closed for user root May 28 13:04:26 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.454s {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:428}} May 28 13:04:26 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:390}} May 28 13:04:26 l75lg1-v1 sudo[99338]: vastdata : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool May 28 13:04:26 l75lg1-v1 sudo[99338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) May 28 13:04:26 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-07a13bfe-65a4-4fd7-b8ff-961521f24b4e tempest-SharesActionsNegativeTest-299343130 None] <<< [POST] https://127.0.0.1:40443/api/quotas/ May 28 13:04:26 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-07a13bfe-65a4-4fd7-b8ff-961521f24b4e tempest-SharesActionsNegativeTest-299343130 None] Bunch(cluster='loop75-kfs', cluster_id=1, default_email=None, default_group_quota=None, default_user_quota=None, enable_alarms=True, enable_email_providers=True, grace_period=None, group_quotas=[], guid='3b98d066-0143-40ab-b6d6-e6e3e1936566', hard_limit=1073741824, hard_limit_inodes=None, id=60, internal=False, is_user_quota=False, last_user_quotas_update=None, name='1929f9f3-96fb-4051-bf80-658af4cd76b6', num_blocked_users=0, num_exceeded_users=0, path='/manila/manila-1929f9f3-96fb-4051-bf80-658af4cd76b6', percent_capacity=0, percent_inodes=None, pretty_grace_period=None, pretty_grace_period_expiration=None, pretty_state='OK (CREATED)', soft_limit=None, soft_limit_inodes=None, state='OK', sync_state='CREATED', system_id=60, tenant_id=1, tenant_name='default', time_to_block=None, title='1929f9f3-96fb-4051-bf80-658af4cd76b6', url='https://127.0.0.1:40443/api/quotas/60/', used_capacity=0, used_capacity_tb=0.0, used_effective_capacity=0, used_effective_capacity_tb=0.0, used_inodes=0, used_limited_capacity=0, user_quotas=[]) May 28 13:04:26 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-07a13bfe-65a4-4fd7-b8ff-961521f24b4e tempest-SharesActionsNegativeTest-299343130 None] --- [POST] https://127.0.0.1:40443/api/quotas/: Done May 28 13:04:26 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-07a13bfe-65a4-4fd7-b8ff-961521f24b4e tempest-SharesActionsNegativeTest-299343130 None] >>> [GET] https://127.0.0.1:40443/api/views/ May 28 13:04:26 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-07a13bfe-65a4-4fd7-b8ff-961521f24b4e tempest-SharesActionsNegativeTest-299343130 None] {'allow_redirects': True, May 28 13:04:26 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-07a13bfe-65a4-4fd7-b8ff-961521f24b4e tempest-SharesActionsNegativeTest-299343130 None] 'params': {'name': '1929f9f3-96fb-4051-bf80-658af4cd76b6'}} May 28 13:04:26 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-640b80c5-0608-4458-9616-4a631bbb651a tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] GET http://10.27.203.238/share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares/ef0dbdd6-46ed-4668-8fa0-d9a41928edcf May 28 13:04:26 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-640b80c5-0608-4458-9616-4a631bbb651a tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:04:26 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-640b80c5-0608-4458-9616-4a631bbb651a tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:04:26 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-640b80c5-0608-4458-9616-4a631bbb651a tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] http://10.27.203.238/share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares/ef0dbdd6-46ed-4668-8fa0-d9a41928edcf returned with HTTP 200 May 28 13:04:26 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1370/2719] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:04:26 2024] GET /share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares/ef0dbdd6-46ed-4668-8fa0-d9a41928edcf => generated 1315 bytes in 25 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:04:27 l75lg1-v1 sudo[99338]: pam_unix(sudo:session): session closed for user root May 28 13:04:27 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.541s {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:428}} May 28 13:04:27 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:390}} May 28 13:04:27 l75lg1-v1 sudo[99353]: vastdata : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 May 28 13:04:27 l75lg1-v1 sudo[99353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) May 28 13:04:27 l75lg1-v1 dstat.sh[49771]: 28-05 13:04:27| 10 2 87 1 0|5544M 1869M 278M 7934M| 18k 737B| 641k 1514k|5.01 108 |2960 4286 |0.97 1.05 1.03|5.0 1.0 50| 0 0 | 0 2048M| 29 359 0 9 6 May 28 13:04:27 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-07a13bfe-65a4-4fd7-b8ff-961521f24b4e tempest-SharesActionsNegativeTest-299343130 None] <<< [GET] https://127.0.0.1:40443/api/views/ May 28 13:04:27 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-07a13bfe-65a4-4fd7-b8ff-961521f24b4e tempest-SharesActionsNegativeTest-299343130 None] [] May 28 13:04:27 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-07a13bfe-65a4-4fd7-b8ff-961521f24b4e tempest-SharesActionsNegativeTest-299343130 None] --- [GET] https://127.0.0.1:40443/api/views/: Done May 28 13:04:27 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-07a13bfe-65a4-4fd7-b8ff-961521f24b4e tempest-SharesActionsNegativeTest-299343130 None] >>> [POST] https://127.0.0.1:40443/api/views/ May 28 13:04:27 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-07a13bfe-65a4-4fd7-b8ff-961521f24b4e tempest-SharesActionsNegativeTest-299343130 None] {'data': '{"name": "1929f9f3-96fb-4051-bf80-658af4cd76b6", "path": ' May 28 13:04:27 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-07a13bfe-65a4-4fd7-b8ff-961521f24b4e tempest-SharesActionsNegativeTest-299343130 None] '"/manila/manila-1929f9f3-96fb-4051-bf80-658af4cd76b6", "policy_id": ' May 28 13:04:27 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-07a13bfe-65a4-4fd7-b8ff-961521f24b4e tempest-SharesActionsNegativeTest-299343130 None] '63, "create_dir": true, "protocols": ["NFS"]}', May 28 13:04:27 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-07a13bfe-65a4-4fd7-b8ff-961521f24b4e tempest-SharesActionsNegativeTest-299343130 None] 'json': None, May 28 13:04:27 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-07a13bfe-65a4-4fd7-b8ff-961521f24b4e tempest-SharesActionsNegativeTest-299343130 None] 'params': None} May 28 13:04:27 l75lg1-v1 sudo[99353]: pam_unix(sudo:session): session closed for user root May 28 13:04:27 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.484s {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:428}} May 28 13:04:27 l75lg1-v1 cinder-volume[85846]: DEBUG cinder.manager [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] Notifying Schedulers of capabilities ... {{(pid=85846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 28 13:04:27 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.scheduler.host_manager [None req-9b042278-869c-47a7-9f17-4e6e91e6ad3b None None] Received volume service update from l75lg1-v1@lvmdriver-1: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:l75lg1-v1:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up', 'allocated_capacity_gb': 0, 'cacheable': True}], 'shared_targets': False, 'sparse_copy_volume': True, 'filter_function': None, 'goodness_function': None} {{(pid=85128) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:628}} May 28 13:04:28 l75lg1-v1 dstat.sh[49771]: 28-05 13:04:28| 5 2 93 0 0|5519M 1893M 278M 7933M| 16k 1783B| 256k 252k|2.00 43.0 |2694 3916 |1.05 1.07 1.04| 0 0 13| 0 0 | 0 2048M| 29 359 0 11 6 May 28 13:04:28 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-07a13bfe-65a4-4fd7-b8ff-961521f24b4e tempest-SharesActionsNegativeTest-299343130 None] <<< [POST] https://127.0.0.1:40443/api/views/ May 28 13:04:28 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-07a13bfe-65a4-4fd7-b8ff-961521f24b4e tempest-SharesActionsNegativeTest-299343130 None] Bunch(abac_tags=[], abe_max_depth=None, abe_protocols=[], alias='', allow_anonymous_access=False, allow_s3_anonymous_access=False, auto_commit='0d', bucket='', bucket_creators=[], bucket_creators_groups=[], bucket_owner=None, bulk_permission_update_progress=None, bulk_permission_update_state=None, cluster='loop75-kfs', cluster_id=1, created='2024-05-28T13:04:28.030399Z', enabled=True, files_retention_mode='NONE', guid='708ce9fb-79bd-49e3-82d2-c2053be1fb14', id=62, ignore_oos=False, internal=False, is_remote=False, is_seamless=False, logical_capacity=0, max_retention_period=None, min_retention_period=None, name='1929f9f3-96fb-4051-bf80-658af4cd76b6', nfs_interop_flags='BOTH_NFS3_AND_NFS4_INTEROP_DISABLED', path='/manila/manila-1929f9f3-96fb-4051-bf80-658af4cd76b6', physical_capacity=0, policy='1929f9f3-96fb-4051-bf80-658af4cd76b6', policy_id=63, protocols=['NFS'], qos_policy=None, qos_policy_id=None, s3_locks=False, s3_locks_retention_mode='NONE', s3_locks_retention_period='', s3_object_ownership_rule='ObjectWriter', s3_unverified_lookup=False, s3_versioning=False, select_for_live_monitoring=False, share='', share_acl=Bunch(acl=[], enabled=False), sync='SYNCED', sync_time='2024-05-28T13:04:28.284314Z', tenant_id=1, tenant_name='default', title='/manila/manila-1929f9f3-96fb-4051-bf80-658af4cd76b6', url='https://127.0.0.1:40443/api/views/62/') May 28 13:04:28 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-07a13bfe-65a4-4fd7-b8ff-961521f24b4e tempest-SharesActionsNegativeTest-299343130 None] --- [POST] https://127.0.0.1:40443/api/views/: Done May 28 13:04:28 l75lg1-v1 manila-share[98474]: DEBUG dbcounter [-] [98474] Writing DB stats manila:SELECT=349,manila:INSERT=20,manila:UPDATE=42 {{(pid=98474) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:04:28 l75lg1-v1 manila-share[98474]: INFO manila.share.manager [None req-07a13bfe-65a4-4fd7-b8ff-961521f24b4e tempest-SharesActionsNegativeTest-299343130 None] Share instance 1929f9f3-96fb-4051-bf80-658af4cd76b6 created successfully. May 28 13:04:29 l75lg1-v1 dstat.sh[49771]: 28-05 13:04:29| 1 0 98 1 0|5519M 1894M 278M 7933M| 16k 66B| 0 344k| 0 53.0 |2032 3158 |1.05 1.07 1.04| 0 0 0| 0 0 | 0 2048M| 29 359 0 10 6 May 28 13:04:29 l75lg1-v1 nova-conductor[83647]: DEBUG dbcounter [-] [83647] Writing DB stats nova_cell1:SELECT=6,nova_cell1:UPDATE=2 {{(pid=83647) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:04:29 l75lg1-v1 nova-conductor[83647]: DEBUG dbcounter [-] [83647] Writing DB stats nova_cell1:UPDATE=1 {{(pid=83647) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:04:29 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-001e0493-579f-4d47-b55e-852febfcd35c tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] GET http://10.27.203.238/share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares/ef0dbdd6-46ed-4668-8fa0-d9a41928edcf May 28 13:04:29 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-001e0493-579f-4d47-b55e-852febfcd35c tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:04:29 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-001e0493-579f-4d47-b55e-852febfcd35c tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:04:29 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-001e0493-579f-4d47-b55e-852febfcd35c tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] http://10.27.203.238/share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares/ef0dbdd6-46ed-4668-8fa0-d9a41928edcf returned with HTTP 200 May 28 13:04:29 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1350/2720] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:04:29 2024] GET /share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares/ef0dbdd6-46ed-4668-8fa0-d9a41928edcf => generated 1318 bytes in 25 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:04:29 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-8934126c-1908-45ef-9262-02e498db7804 tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] POST http://10.27.203.238/share/v2/c7f81fe24c76497a89dd033554ce1057/shares/ef0dbdd6-46ed-4668-8fa0-d9a41928edcf/action May 28 13:04:29 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-8934126c-1908-45ef-9262-02e498db7804 tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] Action body: b'{"reset_status": {"status": "error"}}' {{(pid=98329) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 13:04:29 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-8934126c-1908-45ef-9262-02e498db7804 tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] Action: 'action', calling method: ShareController.share_reset_status, body: {"reset_status": {"status": "error"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:04:29 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-8934126c-1908-45ef-9262-02e498db7804 tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] Updating share 'ef0dbdd6-46ed-4668-8fa0-d9a41928edcf' with '{'status': 'error'}' {{(pid=98329) _reset_status /opt/stack/manila/manila/api/openstack/wsgi.py:1257}} May 28 13:04:29 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-8934126c-1908-45ef-9262-02e498db7804 tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] http://10.27.203.238/share/v2/c7f81fe24c76497a89dd033554ce1057/shares/ef0dbdd6-46ed-4668-8fa0-d9a41928edcf/action returned with HTTP 202 May 28 13:04:29 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1371/2721] 10.27.203.238 () {66 vars in 1493 bytes} [Tue May 28 13:04:29 2024] POST /share/v2/c7f81fe24c76497a89dd033554ce1057/shares/ef0dbdd6-46ed-4668-8fa0-d9a41928edcf/action => generated 0 bytes in 62 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 13:04:29 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-1262c639-0f22-4826-912f-ea96b870ad68 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] POST http://10.27.203.238/share/v1/c39deaad5eb341ceb2e3c79518f56a1b/shares/ef0dbdd6-46ed-4668-8fa0-d9a41928edcf/action May 28 13:04:29 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-1262c639-0f22-4826-912f-ea96b870ad68 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Action body: b'{"os-extend": {"new_size": 2}}' {{(pid=98330) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 13:04:29 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-1262c639-0f22-4826-912f-ea96b870ad68 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Action: 'action', calling method: ShareController.extend, body: {"os-extend": {"new_size": 2}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:04:29 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-1262c639-0f22-4826-912f-ea96b870ad68 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] HTTP exception thrown: Invalid share: Share ef0dbdd6-46ed-4668-8fa0-d9a41928edcf status must be 'available' to extend, but current status is: error. May 28 13:04:29 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-1262c639-0f22-4826-912f-ea96b870ad68 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] http://10.27.203.238/share/v1/c39deaad5eb341ceb2e3c79518f56a1b/shares/ef0dbdd6-46ed-4668-8fa0-d9a41928edcf/action returned with HTTP 400 May 28 13:04:29 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1351/2722] 10.27.203.238 () {64 vars in 1450 bytes} [Tue May 28 13:04:29 2024] POST /share/v1/c39deaad5eb341ceb2e3c79518f56a1b/shares/ef0dbdd6-46ed-4668-8fa0-d9a41928edcf/action => generated 169 bytes in 25 msecs (HTTP/1.1 400) 6 headers in 239 bytes (1 switches on core 0) May 28 13:04:29 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-6c979373-5d19-418f-bbba-45cb200b8eef tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] GET http://10.27.203.238/share/v2/c39deaad5eb341ceb2e3c79518f56a1b/share-replicas/detail?share_id=ef0dbdd6-46ed-4668-8fa0-d9a41928edcf May 28 13:04:29 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-6c979373-5d19-418f-bbba-45cb200b8eef tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:04:29 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-6c979373-5d19-418f-bbba-45cb200b8eef tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:04:29 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-6c979373-5d19-418f-bbba-45cb200b8eef tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] http://10.27.203.238/share/v2/c39deaad5eb341ceb2e3c79518f56a1b/share-replicas/detail?share_id=ef0dbdd6-46ed-4668-8fa0-d9a41928edcf returned with HTTP 200 May 28 13:04:29 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1372/2723] 10.27.203.238 () {64 vars in 1476 bytes} [Tue May 28 13:04:29 2024] GET /share/v2/c39deaad5eb341ceb2e3c79518f56a1b/share-replicas/detail?share_id=ef0dbdd6-46ed-4668-8fa0-d9a41928edcf => generated 22 bytes in 12 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:04:29 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-f11d8e68-5b12-4590-8159-1f6e7a32b7b2 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] DELETE http://10.27.203.238/share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares/ef0dbdd6-46ed-4668-8fa0-d9a41928edcf May 28 13:04:30 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-f11d8e68-5b12-4590-8159-1f6e7a32b7b2 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:04:30 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-f11d8e68-5b12-4590-8159-1f6e7a32b7b2 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Calling method 'ShareMixin.delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:04:30 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.v1.shares [None req-f11d8e68-5b12-4590-8159-1f6e7a32b7b2 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Delete share with id: ef0dbdd6-46ed-4668-8fa0-d9a41928edcf May 28 13:04:30 l75lg1-v1 nova-conductor[83648]: DEBUG dbcounter [-] [83648] Writing DB stats nova_cell1:SELECT=1 {{(pid=83648) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:04:30 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-f11d8e68-5b12-4590-8159-1f6e7a32b7b2 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] http://10.27.203.238/share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares/ef0dbdd6-46ed-4668-8fa0-d9a41928edcf returned with HTTP 202 May 28 13:04:30 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1352/2724] 10.27.203.238 () {64 vars in 1454 bytes} [Tue May 28 13:04:29 2024] DELETE /share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares/ef0dbdd6-46ed-4668-8fa0-d9a41928edcf => generated 0 bytes in 127 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 13:04:30 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-b48eea7f-27b5-43e8-8395-14014efd8c99 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] GET http://10.27.203.238/share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares/ef0dbdd6-46ed-4668-8fa0-d9a41928edcf May 28 13:04:30 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-b48eea7f-27b5-43e8-8395-14014efd8c99 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:04:30 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-b48eea7f-27b5-43e8-8395-14014efd8c99 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:04:30 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-b48eea7f-27b5-43e8-8395-14014efd8c99 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] http://10.27.203.238/share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares/ef0dbdd6-46ed-4668-8fa0-d9a41928edcf returned with HTTP 200 May 28 13:04:30 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1373/2725] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:04:30 2024] GET /share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares/ef0dbdd6-46ed-4668-8fa0-d9a41928edcf => generated 1317 bytes in 26 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:04:30 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-f11d8e68-5b12-4590-8159-1f6e7a32b7b2 tempest-SharesActionsNegativeTest-299343130 None] Acquiring lock "locked_access_rules_operation_by_share_instance_1929f9f3-96fb-4051-bf80-658af4cd76b6" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:04:30 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-f11d8e68-5b12-4590-8159-1f6e7a32b7b2 tempest-SharesActionsNegativeTest-299343130 None] Lock "locked_access_rules_operation_by_share_instance_1929f9f3-96fb-4051-bf80-658af4cd76b6" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:04:30 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-f11d8e68-5b12-4590-8159-1f6e7a32b7b2 tempest-SharesActionsNegativeTest-299343130 None] Lock "locked_access_rules_operation_by_share_instance_1929f9f3-96fb-4051-bf80-658af4cd76b6" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:04:30 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-f11d8e68-5b12-4590-8159-1f6e7a32b7b2 tempest-SharesActionsNegativeTest-299343130 None] Acquiring lock "locked_access_rules_operation_by_share_instance_1929f9f3-96fb-4051-bf80-658af4cd76b6" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:04:30 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-f11d8e68-5b12-4590-8159-1f6e7a32b7b2 tempest-SharesActionsNegativeTest-299343130 None] Lock "locked_access_rules_operation_by_share_instance_1929f9f3-96fb-4051-bf80-658af4cd76b6" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:04:30 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-f11d8e68-5b12-4590-8159-1f6e7a32b7b2 tempest-SharesActionsNegativeTest-299343130 None] Lock "locked_access_rules_operation_by_share_instance_1929f9f3-96fb-4051-bf80-658af4cd76b6" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:04:30 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-f11d8e68-5b12-4590-8159-1f6e7a32b7b2 tempest-SharesActionsNegativeTest-299343130 None] Acquiring lock "locked_access_rules_operation_by_share_instance_1929f9f3-96fb-4051-bf80-658af4cd76b6" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:04:30 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-f11d8e68-5b12-4590-8159-1f6e7a32b7b2 tempest-SharesActionsNegativeTest-299343130 None] Lock "locked_access_rules_operation_by_share_instance_1929f9f3-96fb-4051-bf80-658af4cd76b6" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:04:30 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-f11d8e68-5b12-4590-8159-1f6e7a32b7b2 tempest-SharesActionsNegativeTest-299343130 None] Lock "locked_access_rules_operation_by_share_instance_1929f9f3-96fb-4051-bf80-658af4cd76b6" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:04:30 l75lg1-v1 manila-share[98474]: DEBUG manila.share.access [None req-f11d8e68-5b12-4590-8159-1f6e7a32b7b2 tempest-SharesActionsNegativeTest-299343130 None] All access rules have been synced for share instance 1929f9f3-96fb-4051-bf80-658af4cd76b6 belonging to share ef0dbdd6-46ed-4668-8fa0-d9a41928edcf. {{(pid=98474) update_access_rules /opt/stack/manila/manila/share/access.py:304}} May 28 13:04:30 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-f11d8e68-5b12-4590-8159-1f6e7a32b7b2 tempest-SharesActionsNegativeTest-299343130 None] deleting '/manila/manila-1929f9f3-96fb-4051-bf80-658af4cd76b6' May 28 13:04:30 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f11d8e68-5b12-4590-8159-1f6e7a32b7b2 tempest-SharesActionsNegativeTest-299343130 None] >>> [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/ May 28 13:04:30 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f11d8e68-5b12-4590-8159-1f6e7a32b7b2 tempest-SharesActionsNegativeTest-299343130 None] {'data': '{"path": "/manila/manila-1929f9f3-96fb-4051-bf80-658af4cd76b6"}', May 28 13:04:30 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f11d8e68-5b12-4590-8159-1f6e7a32b7b2 tempest-SharesActionsNegativeTest-299343130 None] 'params': None} May 28 13:04:30 l75lg1-v1 dstat.sh[49771]: 28-05 13:04:30| 4 0 94 1 0|5520M 1892M 278M 7933M| 17k 2869B| 0 1583k| 0 281 |3128 4898 |1.05 1.07 1.04| 0 1.0 4.0| 0 0 | 0 2048M| 29 359 0 12 6 May 28 13:04:30 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f11d8e68-5b12-4590-8159-1f6e7a32b7b2 tempest-SharesActionsNegativeTest-299343130 None] <<< [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/ May 28 13:04:30 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f11d8e68-5b12-4590-8159-1f6e7a32b7b2 tempest-SharesActionsNegativeTest-299343130 None] 'OK' May 28 13:04:30 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f11d8e68-5b12-4590-8159-1f6e7a32b7b2 tempest-SharesActionsNegativeTest-299343130 None] --- [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/: Done May 28 13:04:30 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f11d8e68-5b12-4590-8159-1f6e7a32b7b2 tempest-SharesActionsNegativeTest-299343130 None] >>> [GET] https://127.0.0.1:40443/api/views/ May 28 13:04:30 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f11d8e68-5b12-4590-8159-1f6e7a32b7b2 tempest-SharesActionsNegativeTest-299343130 None] {'allow_redirects': True, May 28 13:04:30 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f11d8e68-5b12-4590-8159-1f6e7a32b7b2 tempest-SharesActionsNegativeTest-299343130 None] 'params': {'name': '1929f9f3-96fb-4051-bf80-658af4cd76b6'}} May 28 13:04:30 l75lg1-v1 neutron-server[77618]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.HashRingHealthCheckPeriodics.touch_hash_ring_nodes' {{(pid=77618) _process_scheduled /opt/stack/data/venv/lib/python3.10/site-packages/futurist/periodics.py:638}} May 28 13:04:30 l75lg1-v1 neutron-server[77623]: DEBUG dbcounter [-] [77623] Writing DB stats neutron:SELECT=1 {{(pid=77623) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:04:30 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f11d8e68-5b12-4590-8159-1f6e7a32b7b2 tempest-SharesActionsNegativeTest-299343130 None] <<< [GET] https://127.0.0.1:40443/api/views/ May 28 13:04:30 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f11d8e68-5b12-4590-8159-1f6e7a32b7b2 tempest-SharesActionsNegativeTest-299343130 None] [Bunch(abac_tags=[], abe_max_depth=None, abe_protocols=[], alias='', allow_anonymous_access=False, allow_s3_anonymous_access=False, auto_commit='0d', bucket='', bucket_creators=[], bucket_creators_groups=[], bucket_owner=None, bulk_permission_update_progress=None, bulk_permission_update_state=None, cluster='loop75-kfs', cluster_id=1, created='2024-05-28T13:04:28.030399Z', enabled=True, files_retention_mode='NONE', guid='708ce9fb-79bd-49e3-82d2-c2053be1fb14', id=62, ignore_oos=False, internal=False, is_remote=False, is_seamless=False, logical_capacity=0, max_retention_period=None, min_retention_period=None, name='1929f9f3-96fb-4051-bf80-658af4cd76b6', nfs_interop_flags='BOTH_NFS3_AND_NFS4_INTEROP_DISABLED', path='/manila/manila-1929f9f3-96fb-4051-bf80-658af4cd76b6', physical_capacity=0, policy='1929f9f3-96fb-4051-bf80-658af4cd76b6', policy_id=63, protocols=['NFS'], qos_policy=None, qos_policy_id=None, s3_locks=False, s3_locks_retention_mode='NONE', s3_locks_retention_period='', s3_unverified_lookup=False, s3_versioning=False, select_for_live_monitoring=False, share='', share_acl=Bunch(acl=[], enabled=False), sync='SYNCED', sync_time='2024-05-28T13:04:28.284314Z', tenant_id=1, tenant_name='default', title='/manila/manila-1929f9f3-96fb-4051-bf80-658af4cd76b6', url='https://127.0.0.1:40443/api/views/62/')] May 28 13:04:30 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f11d8e68-5b12-4590-8159-1f6e7a32b7b2 tempest-SharesActionsNegativeTest-299343130 None] --- [GET] https://127.0.0.1:40443/api/views/: Done May 28 13:04:30 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f11d8e68-5b12-4590-8159-1f6e7a32b7b2 tempest-SharesActionsNegativeTest-299343130 None] >>> [DELETE] https://127.0.0.1:40443/api/views/62/ May 28 13:04:31 l75lg1-v1 dstat.sh[49771]: 28-05 13:04:31| 1 0 98 1 0|5520M 1892M 278M 7933M| 16k 1317B| 0 1801k| 0 283 |2089 2968 |1.05 1.07 1.04|1.0 0 0| 0 0 | 0 2048M| 29 359 0 12 6 May 28 13:04:32 l75lg1-v1 dstat.sh[49771]: 28-05 13:04:32| 1 0 97 1 0|5520M 1892M 278M 7933M| 16k 1738B| 0 400k| 0 62.0 |2410 3725 |1.05 1.07 1.04|1.0 0 2.0| 0 0 | 0 2048M| 29 359 0 13 6 May 28 13:04:32 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f11d8e68-5b12-4590-8159-1f6e7a32b7b2 tempest-SharesActionsNegativeTest-299343130 None] <<< [DELETE] https://127.0.0.1:40443/api/views/62/ May 28 13:04:32 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f11d8e68-5b12-4590-8159-1f6e7a32b7b2 tempest-SharesActionsNegativeTest-299343130 None] --- [DELETE] https://127.0.0.1:40443/api/views/62/: Done May 28 13:04:32 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f11d8e68-5b12-4590-8159-1f6e7a32b7b2 tempest-SharesActionsNegativeTest-299343130 None] >>> [GET] https://127.0.0.1:40443/api/quotas/ May 28 13:04:32 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f11d8e68-5b12-4590-8159-1f6e7a32b7b2 tempest-SharesActionsNegativeTest-299343130 None] {'allow_redirects': True, May 28 13:04:32 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f11d8e68-5b12-4590-8159-1f6e7a32b7b2 tempest-SharesActionsNegativeTest-299343130 None] 'params': {'name': '1929f9f3-96fb-4051-bf80-658af4cd76b6'}} May 28 13:04:33 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f11d8e68-5b12-4590-8159-1f6e7a32b7b2 tempest-SharesActionsNegativeTest-299343130 None] <<< [GET] https://127.0.0.1:40443/api/quotas/ May 28 13:04:33 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f11d8e68-5b12-4590-8159-1f6e7a32b7b2 tempest-SharesActionsNegativeTest-299343130 None] [Bunch(cluster='loop75-kfs', cluster_id=1, default_email=None, default_group_quota=None, default_user_quota=None, enable_alarms=True, enable_email_providers=True, grace_period=None, guid='3b98d066-0143-40ab-b6d6-e6e3e1936566', hard_limit=1073741824, hard_limit_inodes=None, id=60, internal=False, is_user_quota=False, last_user_quotas_update=None, name='1929f9f3-96fb-4051-bf80-658af4cd76b6', num_blocked_users=0, num_exceeded_users=0, path='/manila/manila-1929f9f3-96fb-4051-bf80-658af4cd76b6', percent_capacity=0, percent_inodes=None, pretty_grace_period=None, pretty_grace_period_expiration=None, pretty_state='OK (CREATED)', soft_limit=None, soft_limit_inodes=None, state='OK', sync_state='CREATED', system_id=60, tenant_id=1, tenant_name='default', time_to_block=None, title='1929f9f3-96fb-4051-bf80-658af4cd76b6', url='https://127.0.0.1:40443/api/quotas/60/', used_capacity=0, used_capacity_tb=0.0, used_effective_capacity=0, used_effective_capacity_tb=0.0, used_inodes=0, used_limited_capacity=0)] May 28 13:04:33 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f11d8e68-5b12-4590-8159-1f6e7a32b7b2 tempest-SharesActionsNegativeTest-299343130 None] --- [GET] https://127.0.0.1:40443/api/quotas/: Done May 28 13:04:33 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f11d8e68-5b12-4590-8159-1f6e7a32b7b2 tempest-SharesActionsNegativeTest-299343130 None] >>> [DELETE] https://127.0.0.1:40443/api/quotas/60/ May 28 13:04:33 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-e46d8bbc-b47b-4123-a46f-dd26cf0c59e5 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] GET http://10.27.203.238/share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares/ef0dbdd6-46ed-4668-8fa0-d9a41928edcf May 28 13:04:33 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-e46d8bbc-b47b-4123-a46f-dd26cf0c59e5 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:04:33 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-e46d8bbc-b47b-4123-a46f-dd26cf0c59e5 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:04:33 l75lg1-v1 devstack@m-api.service[98330]: DEBUG dbcounter [-] [98330] Writing DB stats manila:SELECT=282,manila:INSERT=26,manila:UPDATE=22 {{(pid=98330) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:04:33 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-e46d8bbc-b47b-4123-a46f-dd26cf0c59e5 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] http://10.27.203.238/share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares/ef0dbdd6-46ed-4668-8fa0-d9a41928edcf returned with HTTP 200 May 28 13:04:33 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1353/2726] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:04:33 2024] GET /share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares/ef0dbdd6-46ed-4668-8fa0-d9a41928edcf => generated 1317 bytes in 25 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:04:33 l75lg1-v1 dstat.sh[49771]: 28-05 13:04:33| 1 0 98 1 0|5520M 1892M 278M 7933M| 20k 1648B| 0 436k| 0 54.0 |2303 3515 |0.97 1.05 1.03|1.0 0 1.0| 0 0 | 0 2048M| 29 360 0 13 6 May 28 13:04:33 l75lg1-v1 devstack@keystone.service[51266]: DEBUG dbcounter [-] [51266] Writing DB stats keystone:SELECT=243,keystone:DELETE=27,keystone:INSERT=13 {{(pid=51266) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:04:34 l75lg1-v1 dstat.sh[49771]: 28-05 13:04:34| 1 0 99 0 0|5520M 1892M 278M 7933M| 12k 672B| 0 260k| 0 27.0 |1599 2503 |0.97 1.05 1.03|1.0 0 1.0| 0 0 | 0 2048M| 29 360 0 13 6 May 28 13:04:35 l75lg1-v1 dstat.sh[49771]: 28-05 13:04:35| 1 0 99 0 0|5519M 1893M 278M 7933M| 12k 727B| 0 8192B| 0 1.00 |1479 2316 |0.97 1.05 1.03|1.0 0 1.0| 0 0 | 0 2048M| 29 359 0 13 6 May 28 13:04:36 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-c702e433-b9ef-496c-b067-a452e0803c69 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] GET http://10.27.203.238/share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares/ef0dbdd6-46ed-4668-8fa0-d9a41928edcf May 28 13:04:36 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-c702e433-b9ef-496c-b067-a452e0803c69 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:04:36 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-c702e433-b9ef-496c-b067-a452e0803c69 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:04:36 l75lg1-v1 devstack@m-api.service[98329]: DEBUG dbcounter [-] [98329] Writing DB stats manila:SELECT=181,manila:UPDATE=16,manila:INSERT=9 {{(pid=98329) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:04:36 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-c702e433-b9ef-496c-b067-a452e0803c69 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] http://10.27.203.238/share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares/ef0dbdd6-46ed-4668-8fa0-d9a41928edcf returned with HTTP 200 May 28 13:04:36 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1374/2727] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:04:36 2024] GET /share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares/ef0dbdd6-46ed-4668-8fa0-d9a41928edcf => generated 1317 bytes in 29 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:04:36 l75lg1-v1 dstat.sh[49771]: 28-05 13:04:36| 1 0 98 1 0|5520M 1893M 278M 7933M| 19k 2756B| 0 724k| 0 53.0 |1935 2911 |0.97 1.05 1.03| 0 0 1.0| 0 0 | 0 2048M| 29 359 0 14 6 May 28 13:04:36 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f11d8e68-5b12-4590-8159-1f6e7a32b7b2 tempest-SharesActionsNegativeTest-299343130 None] <<< [DELETE] https://127.0.0.1:40443/api/quotas/60/ May 28 13:04:36 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f11d8e68-5b12-4590-8159-1f6e7a32b7b2 tempest-SharesActionsNegativeTest-299343130 None] --- [DELETE] https://127.0.0.1:40443/api/quotas/60/: Done May 28 13:04:36 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f11d8e68-5b12-4590-8159-1f6e7a32b7b2 tempest-SharesActionsNegativeTest-299343130 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:04:36 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f11d8e68-5b12-4590-8159-1f6e7a32b7b2 tempest-SharesActionsNegativeTest-299343130 None] {'allow_redirects': True, May 28 13:04:36 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f11d8e68-5b12-4590-8159-1f6e7a32b7b2 tempest-SharesActionsNegativeTest-299343130 None] 'params': {'name': '1929f9f3-96fb-4051-bf80-658af4cd76b6'}} May 28 13:04:36 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f11d8e68-5b12-4590-8159-1f6e7a32b7b2 tempest-SharesActionsNegativeTest-299343130 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:04:36 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f11d8e68-5b12-4590-8159-1f6e7a32b7b2 tempest-SharesActionsNegativeTest-299343130 None] [Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=0, created='2024-05-28T13:04:25.131887Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='8b435fd3-bb8f-43fa-a38b-fada06dbd24b', id=63, internal=False, is_s3_default_policy=False, name='1929f9f3-96fb-4051-bf80-658af4cd76b6', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=[], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['*'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['*'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T13:04:25.473958Z', tenant_id=1, tenant_name='default', title='1929f9f3-96fb-4051-bf80-658af4cd76b6', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/63/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[])] May 28 13:04:36 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f11d8e68-5b12-4590-8159-1f6e7a32b7b2 tempest-SharesActionsNegativeTest-299343130 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 13:04:36 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f11d8e68-5b12-4590-8159-1f6e7a32b7b2 tempest-SharesActionsNegativeTest-299343130 None] >>> [DELETE] https://127.0.0.1:40443/api/viewpolicies/63/ May 28 13:04:37 l75lg1-v1 dstat.sh[49771]: 28-05 13:04:37| 1 0 99 0 0|5520M 1893M 278M 7933M| 21k 1390B| 0 100k| 0 14.0 |1819 2679 |0.97 1.05 1.03|1.0 0 0| 0 0 | 0 2048M| 29 359 0 14 6 May 28 13:04:38 l75lg1-v1 dstat.sh[49771]: 28-05 13:04:38| 1 0 99 0 0|5520M 1893M 278M 7933M| 11k 0 | 0 140k| 0 21.0 |1717 2804 |0.89 1.03 1.03|2.0 0 2.0| 0 0 | 0 2048M| 29 359 0 14 6 May 28 13:04:38 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f11d8e68-5b12-4590-8159-1f6e7a32b7b2 tempest-SharesActionsNegativeTest-299343130 None] <<< [DELETE] https://127.0.0.1:40443/api/viewpolicies/63/ May 28 13:04:38 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-f11d8e68-5b12-4590-8159-1f6e7a32b7b2 tempest-SharesActionsNegativeTest-299343130 None] --- [DELETE] https://127.0.0.1:40443/api/viewpolicies/63/: Done May 28 13:04:38 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-f11d8e68-5b12-4590-8159-1f6e7a32b7b2 tempest-SharesActionsNegativeTest-299343130 None] Created reservations ['01085b26-220a-4454-acc2-98ce31bfb6bf', 'f1a10059-cce7-4f20-a35d-e82da1276417', 'e7f66a29-a0e4-4f9d-ade4-1e9bb46d5181', 'e862c4cb-d395-480f-8cf0-2950de7b5166'] {{(pid=98474) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 13:04:38 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-f11d8e68-5b12-4590-8159-1f6e7a32b7b2 tempest-SharesActionsNegativeTest-299343130 None] Committed reservations ['01085b26-220a-4454-acc2-98ce31bfb6bf', 'f1a10059-cce7-4f20-a35d-e82da1276417', 'e7f66a29-a0e4-4f9d-ade4-1e9bb46d5181', 'e862c4cb-d395-480f-8cf0-2950de7b5166'] {{(pid=98474) commit /opt/stack/manila/manila/quota.py:1063}} May 28 13:04:38 l75lg1-v1 manila-share[98474]: INFO manila.share.manager [None req-f11d8e68-5b12-4590-8159-1f6e7a32b7b2 tempest-SharesActionsNegativeTest-299343130 None] Share instance 1929f9f3-96fb-4051-bf80-658af4cd76b6: deleted successfully. May 28 13:04:39 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-fe701dc0-272c-46b8-bdd9-0e9a38d42dd6 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] GET http://10.27.203.238/share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares/ef0dbdd6-46ed-4668-8fa0-d9a41928edcf May 28 13:04:39 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-fe701dc0-272c-46b8-bdd9-0e9a38d42dd6 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:04:39 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-fe701dc0-272c-46b8-bdd9-0e9a38d42dd6 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:04:39 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-fe701dc0-272c-46b8-bdd9-0e9a38d42dd6 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] HTTP exception thrown: The resource could not be found. May 28 13:04:39 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-fe701dc0-272c-46b8-bdd9-0e9a38d42dd6 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] http://10.27.203.238/share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares/ef0dbdd6-46ed-4668-8fa0-d9a41928edcf returned with HTTP 404 May 28 13:04:39 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1354/2728] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:04:39 2024] GET /share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares/ef0dbdd6-46ed-4668-8fa0-d9a41928edcf => generated 78 bytes in 11 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 13:04:39 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-0e568bf7-7438-432b-ab85-162dea7d1ba7 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] POST http://10.27.203.238/share/v1/c39deaad5eb341ceb2e3c79518f56a1b/shares/1b08ba1e-039b-4773-869c-2a90b38f5f70/action May 28 13:04:39 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-0e568bf7-7438-432b-ab85-162dea7d1ba7 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Action body: b'{"os-extend": {"new_size": 0}}' {{(pid=98329) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 13:04:39 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-0e568bf7-7438-432b-ab85-162dea7d1ba7 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Action: 'action', calling method: ShareController.extend, body: {"os-extend": {"new_size": 0}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:04:39 l75lg1-v1 dstat.sh[49771]: 28-05 13:04:39| 2 0 97 0 0|5520M 1893M 278M 7933M| 11k 4204B| 0 496k| 0 75.0 |2338 3676 |0.89 1.03 1.03|2.0 0 1.0| 0 0 | 0 2048M| 29 360 0 15 6 May 28 13:04:39 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-0e568bf7-7438-432b-ab85-162dea7d1ba7 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] HTTP exception thrown: Invalid input received: New size for extend must be greater than current size. (current: 1, extended: 0). May 28 13:04:39 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-0e568bf7-7438-432b-ab85-162dea7d1ba7 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] http://10.27.203.238/share/v1/c39deaad5eb341ceb2e3c79518f56a1b/shares/1b08ba1e-039b-4773-869c-2a90b38f5f70/action returned with HTTP 400 May 28 13:04:39 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1375/2729] 10.27.203.238 () {64 vars in 1450 bytes} [Tue May 28 13:04:39 2024] POST /share/v1/c39deaad5eb341ceb2e3c79518f56a1b/shares/1b08ba1e-039b-4773-869c-2a90b38f5f70/action => generated 149 bytes in 25 msecs (HTTP/1.1 400) 6 headers in 239 bytes (1 switches on core 0) May 28 13:04:39 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-67994c4f-6b91-438e-8948-806d93ab8d7a tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] POST http://10.27.203.238/share/v1/c39deaad5eb341ceb2e3c79518f56a1b/shares/1b08ba1e-039b-4773-869c-2a90b38f5f70/action May 28 13:04:39 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-67994c4f-6b91-438e-8948-806d93ab8d7a tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Action body: b'{"os-extend": {"new_size": 1}}' {{(pid=98330) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 13:04:39 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-67994c4f-6b91-438e-8948-806d93ab8d7a tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Action: 'action', calling method: ShareController.extend, body: {"os-extend": {"new_size": 1}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:04:39 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-67994c4f-6b91-438e-8948-806d93ab8d7a tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] HTTP exception thrown: Invalid input received: New size for extend must be greater than current size. (current: 1, extended: 1). May 28 13:04:39 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-67994c4f-6b91-438e-8948-806d93ab8d7a tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] http://10.27.203.238/share/v1/c39deaad5eb341ceb2e3c79518f56a1b/shares/1b08ba1e-039b-4773-869c-2a90b38f5f70/action returned with HTTP 400 May 28 13:04:39 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1355/2730] 10.27.203.238 () {64 vars in 1450 bytes} [Tue May 28 13:04:39 2024] POST /share/v1/c39deaad5eb341ceb2e3c79518f56a1b/shares/1b08ba1e-039b-4773-869c-2a90b38f5f70/action => generated 149 bytes in 28 msecs (HTTP/1.1 400) 6 headers in 239 bytes (1 switches on core 0) May 28 13:04:39 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-d6879693-f83e-4e45-a049-5c64c8cd3773 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] POST http://10.27.203.238/share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares/1b08ba1e-039b-4773-869c-2a90b38f5f70/action May 28 13:04:39 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-d6879693-f83e-4e45-a049-5c64c8cd3773 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Action body: b'{"extend": {"new_size": 2, "force": true}}' {{(pid=98329) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 13:04:39 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-d6879693-f83e-4e45-a049-5c64c8cd3773 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Action: 'action', calling method: ShareController.extend, body: {"extend": {"new_size": 2, "force": true}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:04:39 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.policy [None req-d6879693-f83e-4e45-a049-5c64c8cd3773 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Policy check for share:force_extend failed with credentials {'is_admin': False, 'user_id': '31f71bac04e24dc9908978bd950e8011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c39deaad5eb341ceb2e3c79518f56a1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98329) authorize /opt/stack/manila/manila/policy.py:208}} May 28 13:04:39 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-d6879693-f83e-4e45-a049-5c64c8cd3773 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] http://10.27.203.238/share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares/1b08ba1e-039b-4773-869c-2a90b38f5f70/action returned with HTTP 403 May 28 13:04:39 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1376/2731] 10.27.203.238 () {66 vars in 1493 bytes} [Tue May 28 13:04:39 2024] POST /share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares/1b08ba1e-039b-4773-869c-2a90b38f5f70/action => generated 99 bytes in 24 msecs (HTTP/1.1 403) 6 headers in 237 bytes (1 switches on core 0) May 28 13:04:39 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-4a4877a5-6a9f-49f7-916f-e35fb1048a5f tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] POST http://10.27.203.238/share/v1/c39deaad5eb341ceb2e3c79518f56a1b/shares/1b08ba1e-039b-4773-869c-2a90b38f5f70/action May 28 13:04:39 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-4a4877a5-6a9f-49f7-916f-e35fb1048a5f tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Action body: b'{"os-shrink": {"new_size": 2}}' {{(pid=98330) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 13:04:39 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-4a4877a5-6a9f-49f7-916f-e35fb1048a5f tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Action: 'action', calling method: ShareController.shrink, body: {"os-shrink": {"new_size": 2}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:04:39 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-4a4877a5-6a9f-49f7-916f-e35fb1048a5f tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] HTTP exception thrown: Invalid input received: New size for shrink must be less than current size and greater than 0 (current: 1, new: 2). May 28 13:04:39 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-4a4877a5-6a9f-49f7-916f-e35fb1048a5f tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] http://10.27.203.238/share/v1/c39deaad5eb341ceb2e3c79518f56a1b/shares/1b08ba1e-039b-4773-869c-2a90b38f5f70/action returned with HTTP 400 May 28 13:04:39 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1356/2732] 10.27.203.238 () {64 vars in 1450 bytes} [Tue May 28 13:04:39 2024] POST /share/v1/c39deaad5eb341ceb2e3c79518f56a1b/shares/1b08ba1e-039b-4773-869c-2a90b38f5f70/action => generated 159 bytes in 23 msecs (HTTP/1.1 400) 6 headers in 239 bytes (1 switches on core 0) May 28 13:04:39 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-905dc955-a698-48c3-bac9-3b6a69e6f15b tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] POST http://10.27.203.238/share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares May 28 13:04:39 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-905dc955-a698-48c3-bac9-3b6a69e6f15b tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share": {"share_proto": "nfs", "description": "Tempest's share", "snapshot_id": null, "name": "tempest-tempest-created-share-1273092762", "size": 2, "metadata": {}, "is_public": false, "share_type": "f7d65ead-0196-4e03-928f-2e08ca825112"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:04:39 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.v1.shares [None req-905dc955-a698-48c3-bac9-3b6a69e6f15b tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Create NFS share of 2 GB May 28 13:04:39 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.quota [None req-905dc955-a698-48c3-bac9-3b6a69e6f15b tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Created reservations ['0ceda9e2-deb7-4b8d-8f3e-1b68df1ea542', 'd704ee5c-108f-4516-82a8-e9bae1013722', '585f8124-1398-4a1e-8244-f58d70ad322a', 'ec4eb0fc-b543-4fd4-9f05-9cdbc9ff560d'] {{(pid=98329) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 13:04:39 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.quota [None req-905dc955-a698-48c3-bac9-3b6a69e6f15b tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Committed reservations ['0ceda9e2-deb7-4b8d-8f3e-1b68df1ea542', 'd704ee5c-108f-4516-82a8-e9bae1013722', '585f8124-1398-4a1e-8244-f58d70ad322a', 'ec4eb0fc-b543-4fd4-9f05-9cdbc9ff560d'] {{(pid=98329) commit /opt/stack/manila/manila/quota.py:1063}} May 28 13:04:39 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.host_manager [None req-905dc955-a698-48c3-bac9-3b6a69e6f15b tempest-SharesActionsNegativeTest-299343130 None] Share service is down. (host: l75lg1-v1@generic2). May 28 13:04:39 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.host_manager [None req-905dc955-a698-48c3-bac9-3b6a69e6f15b tempest-SharesActionsNegativeTest-299343130 None] Share service is down. (host: l75lg1-v1@generic1). May 28 13:04:39 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-905dc955-a698-48c3-bac9-3b6a69e6f15b tempest-SharesActionsNegativeTest-299343130 None] Starting with 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:80}} May 28 13:04:39 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-905dc955-a698-48c3-bac9-3b6a69e6f15b tempest-SharesActionsNegativeTest-299343130 None] Filter OnlyHostFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:04:39 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-905dc955-a698-48c3-bac9-3b6a69e6f15b tempest-SharesActionsNegativeTest-299343130 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:04:39 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.capacity [None req-905dc955-a698-48c3-bac9-3b6a69e6f15b tempest-SharesActionsNegativeTest-299343130 None] Space information for share creation on host l75lg1-v1@vast#vast (requested / avail): 2/2080 {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/capacity.py:83}} May 28 13:04:39 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-905dc955-a698-48c3-bac9-3b6a69e6f15b tempest-SharesActionsNegativeTest-299343130 None] Filter CapacityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:04:39 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-905dc955-a698-48c3-bac9-3b6a69e6f15b tempest-SharesActionsNegativeTest-299343130 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:04:39 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-905dc955-a698-48c3-bac9-3b6a69e6f15b tempest-SharesActionsNegativeTest-299343130 None] Driver Filter: Checking host 'l75lg1-v1@vast#vast' {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:37}} May 28 13:04:39 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-905dc955-a698-48c3-bac9-3b6a69e6f15b tempest-SharesActionsNegativeTest-299343130 None] Filter function not set :: passing host. {{(pid=98327) _check_filter_function /opt/stack/manila/manila/scheduler/filters/driver.py:53}} May 28 13:04:39 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-905dc955-a698-48c3-bac9-3b6a69e6f15b tempest-SharesActionsNegativeTest-299343130 None] Result: True {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:40}} May 28 13:04:39 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-905dc955-a698-48c3-bac9-3b6a69e6f15b tempest-SharesActionsNegativeTest-299343130 None] Done checking host 'l75lg1-v1@vast#vast' {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:41}} May 28 13:04:39 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-905dc955-a698-48c3-bac9-3b6a69e6f15b tempest-SharesActionsNegativeTest-299343130 None] Filter DriverFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:04:39 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-905dc955-a698-48c3-bac9-3b6a69e6f15b tempest-SharesActionsNegativeTest-299343130 None] Filter ShareReplicationFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:04:39 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-905dc955-a698-48c3-bac9-3b6a69e6f15b tempest-SharesActionsNegativeTest-299343130 None] Filter CreateFromSnapshotFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:04:39 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-905dc955-a698-48c3-bac9-3b6a69e6f15b tempest-SharesActionsNegativeTest-299343130 None] Filter AffinityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:04:39 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-905dc955-a698-48c3-bac9-3b6a69e6f15b tempest-SharesActionsNegativeTest-299343130 None] Filter AntiAffinityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:04:39 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.drivers.filter [None req-905dc955-a698-48c3-bac9-3b6a69e6f15b tempest-SharesActionsNegativeTest-299343130 None] Filtered share [host: 'l75lg1-v1@vast#vast', free_capacity_gb: 2080.6467494899407, pools: None] {{(pid=98327) _schedule_share /opt/stack/manila/manila/scheduler/drivers/filter.py:268}} May 28 13:04:39 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-905dc955-a698-48c3-bac9-3b6a69e6f15b tempest-SharesActionsNegativeTest-299343130 None] Checking host 'l75lg1-v1@vast#vast' {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:46}} May 28 13:04:39 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.weighers.goodness [None req-905dc955-a698-48c3-bac9-3b6a69e6f15b tempest-SharesActionsNegativeTest-299343130 None] Goodness function not set :: defaulting to minimal goodness rating of 0. May 28 13:04:39 l75lg1-v1 manila-scheduler[98327]: INFO manila.scheduler.weighers.goodness [None req-905dc955-a698-48c3-bac9-3b6a69e6f15b tempest-SharesActionsNegativeTest-299343130 None] Goodness function result for host l75lg1-v1@vast#vast: 0. May 28 13:04:39 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-905dc955-a698-48c3-bac9-3b6a69e6f15b tempest-SharesActionsNegativeTest-299343130 None] Goodness: 0 {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:48}} May 28 13:04:39 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-905dc955-a698-48c3-bac9-3b6a69e6f15b tempest-SharesActionsNegativeTest-299343130 None] Done checking host 'l75lg1-v1@vast#vast' {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:49}} May 28 13:04:39 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.drivers.filter [None req-905dc955-a698-48c3-bac9-3b6a69e6f15b tempest-SharesActionsNegativeTest-299343130 None] Choosing for share: WeighedHost [host: l75lg1-v1@vast#vast, weight: 0.0] {{(pid=98327) _schedule_share /opt/stack/manila/manila/scheduler/drivers/filter.py:274}} May 28 13:04:39 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-905dc955-a698-48c3-bac9-3b6a69e6f15b tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] http://10.27.203.238/share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares returned with HTTP 200 May 28 13:04:39 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1377/2733] 10.27.203.238 () {66 vars in 1362 bytes} [Tue May 28 13:04:39 2024] POST /share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares => generated 1313 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:04:39 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-4416ce32-9648-4c06-b507-23404fbf3b43 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] GET http://10.27.203.238/share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares/7601713b-20f2-4013-810d-48ea6ee0f38e May 28 13:04:39 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-4416ce32-9648-4c06-b507-23404fbf3b43 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:04:39 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-4416ce32-9648-4c06-b507-23404fbf3b43 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:04:39 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-4416ce32-9648-4c06-b507-23404fbf3b43 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] http://10.27.203.238/share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares/7601713b-20f2-4013-810d-48ea6ee0f38e returned with HTTP 200 May 28 13:04:39 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1357/2734] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:04:39 2024] GET /share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares/7601713b-20f2-4013-810d-48ea6ee0f38e => generated 1313 bytes in 23 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:04:39 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-905dc955-a698-48c3-bac9-3b6a69e6f15b tempest-SharesActionsNegativeTest-299343130 None] >>> [GET] https://127.0.0.1:40443/api/vippools/ May 28 13:04:39 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-905dc955-a698-48c3-bac9-3b6a69e6f15b tempest-SharesActionsNegativeTest-299343130 None] {'allow_redirects': True, 'params': {'name': 'vippool-1'}} May 28 13:04:39 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-905dc955-a698-48c3-bac9-3b6a69e6f15b tempest-SharesActionsNegativeTest-299343130 None] <<< [GET] https://127.0.0.1:40443/api/vippools/ May 28 13:04:39 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-905dc955-a698-48c3-bac9-3b6a69e6f15b tempest-SharesActionsNegativeTest-299343130 None] [Bunch(active_cnode_ids=[], active_interfaces=4, cluster='loop75-kfs', cluster_id=1, cnode_ids=[], cnodes=[], domain_name='vippool-1', enable_l3=False, enable_weighted_balancing=False, enabled=True, end_ip='172.21.75.4', guid='f2abaede-b397-413a-8faa-3aeead6d3b28', gw_ip='', gw_ipv6='', id=2, ip_ranges=[['172.21.75.1', '172.21.75.4']], name='vippool-1', peer_asn=0, port_membership='ALL', ranges_summary='172.21.75.[1-4]', role='PROTOCOLS', start_ip='172.21.75.1', subnet_cidr=16, subnet_cidr_ipv6=None, sync='SYNCED', sync_time='2024-05-28T12:50:09.644123Z', tenant_id=1, tenant_name='default', title='172.21.75.1 - 172.21.75.4', url='https://127.0.0.1:40443/api/vippools/2/', vast_asn=0, vlan=0, vms_preferred=False)] May 28 13:04:39 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-905dc955-a698-48c3-bac9-3b6a69e6f15b tempest-SharesActionsNegativeTest-299343130 None] --- [GET] https://127.0.0.1:40443/api/vippools/: Done May 28 13:04:39 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-905dc955-a698-48c3-bac9-3b6a69e6f15b tempest-SharesActionsNegativeTest-299343130 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:04:39 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-905dc955-a698-48c3-bac9-3b6a69e6f15b tempest-SharesActionsNegativeTest-299343130 None] {'allow_redirects': True, May 28 13:04:39 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-905dc955-a698-48c3-bac9-3b6a69e6f15b tempest-SharesActionsNegativeTest-299343130 None] 'params': {'name': '03240935-dd72-4869-a1b8-a95a0588009e'}} May 28 13:04:40 l75lg1-v1 dstat.sh[49771]: 28-05 13:04:40| 4 1 93 1 0|5520M 1893M 278M 7933M| 19k 7669B| 0 887k| 0 146 |3681 5919 |0.89 1.03 1.03|1.0 0 0| 0 0 | 0 2048M| 29 359 0 15 6 May 28 13:04:40 l75lg1-v1 neutron-server[77618]: DEBUG dbcounter [-] [77618] Writing DB stats neutron:UPDATE=1 {{(pid=77618) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:04:40 l75lg1-v1 neutron-server[77618]: DEBUG dbcounter [-] [77618] Writing DB stats neutron:SELECT=1 {{(pid=77618) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:04:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-905dc955-a698-48c3-bac9-3b6a69e6f15b tempest-SharesActionsNegativeTest-299343130 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:04:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-905dc955-a698-48c3-bac9-3b6a69e6f15b tempest-SharesActionsNegativeTest-299343130 None] [] May 28 13:04:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-905dc955-a698-48c3-bac9-3b6a69e6f15b tempest-SharesActionsNegativeTest-299343130 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 13:04:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-905dc955-a698-48c3-bac9-3b6a69e6f15b tempest-SharesActionsNegativeTest-299343130 None] >>> [POST] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:04:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-905dc955-a698-48c3-bac9-3b6a69e6f15b tempest-SharesActionsNegativeTest-299343130 None] {'data': '{"name": "03240935-dd72-4869-a1b8-a95a0588009e"}', May 28 13:04:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-905dc955-a698-48c3-bac9-3b6a69e6f15b tempest-SharesActionsNegativeTest-299343130 None] 'json': None, May 28 13:04:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-905dc955-a698-48c3-bac9-3b6a69e6f15b tempest-SharesActionsNegativeTest-299343130 None] 'params': None} May 28 13:04:41 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-905dc955-a698-48c3-bac9-3b6a69e6f15b tempest-SharesActionsNegativeTest-299343130 None] <<< [POST] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:04:41 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-905dc955-a698-48c3-bac9-3b6a69e6f15b tempest-SharesActionsNegativeTest-299343130 None] Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=0, created='2024-05-28T13:04:40.829288Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='dd3420dd-03b2-4b35-875d-d5f0a83bade1', id=64, internal=False, is_s3_default_policy=False, name='03240935-dd72-4869-a1b8-a95a0588009e', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=[], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['*'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['*'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T13:04:41.151349Z', tenant_id=1, tenant_name='default', title='03240935-dd72-4869-a1b8-a95a0588009e', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/64/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[]) May 28 13:04:41 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-905dc955-a698-48c3-bac9-3b6a69e6f15b tempest-SharesActionsNegativeTest-299343130 None] --- [POST] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 13:04:41 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-905dc955-a698-48c3-bac9-3b6a69e6f15b tempest-SharesActionsNegativeTest-299343130 None] >>> [GET] https://127.0.0.1:40443/api/quotas/ May 28 13:04:41 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-905dc955-a698-48c3-bac9-3b6a69e6f15b tempest-SharesActionsNegativeTest-299343130 None] {'allow_redirects': True, May 28 13:04:41 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-905dc955-a698-48c3-bac9-3b6a69e6f15b tempest-SharesActionsNegativeTest-299343130 None] 'params': {'name': '03240935-dd72-4869-a1b8-a95a0588009e'}} May 28 13:04:41 l75lg1-v1 dstat.sh[49771]: 28-05 13:04:41| 1 0 96 2 0|5520M 1893M 278M 7933M| 13k 1566B| 0 4390k| 0 338 |2429 3864 |0.89 1.03 1.03| 0 0 0| 0 0 | 0 2048M| 29 359 0 14 6 May 28 13:04:41 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-905dc955-a698-48c3-bac9-3b6a69e6f15b tempest-SharesActionsNegativeTest-299343130 None] <<< [GET] https://127.0.0.1:40443/api/quotas/ May 28 13:04:41 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-905dc955-a698-48c3-bac9-3b6a69e6f15b tempest-SharesActionsNegativeTest-299343130 None] [] May 28 13:04:41 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-905dc955-a698-48c3-bac9-3b6a69e6f15b tempest-SharesActionsNegativeTest-299343130 None] --- [GET] https://127.0.0.1:40443/api/quotas/: Done May 28 13:04:41 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-905dc955-a698-48c3-bac9-3b6a69e6f15b tempest-SharesActionsNegativeTest-299343130 None] >>> [POST] https://127.0.0.1:40443/api/quotas/ May 28 13:04:41 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-905dc955-a698-48c3-bac9-3b6a69e6f15b tempest-SharesActionsNegativeTest-299343130 None] {'data': '{"name": "03240935-dd72-4869-a1b8-a95a0588009e", "path": ' May 28 13:04:41 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-905dc955-a698-48c3-bac9-3b6a69e6f15b tempest-SharesActionsNegativeTest-299343130 None] '"/manila/manila-03240935-dd72-4869-a1b8-a95a0588009e", "create_dir": ' May 28 13:04:41 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-905dc955-a698-48c3-bac9-3b6a69e6f15b tempest-SharesActionsNegativeTest-299343130 None] 'true, "hard_limit": 2147483648}', May 28 13:04:41 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-905dc955-a698-48c3-bac9-3b6a69e6f15b tempest-SharesActionsNegativeTest-299343130 None] 'json': None, May 28 13:04:41 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-905dc955-a698-48c3-bac9-3b6a69e6f15b tempest-SharesActionsNegativeTest-299343130 None] 'params': None} May 28 13:04:41 l75lg1-v1 nova-scheduler[81196]: DEBUG dbcounter [-] [81196] Writing DB stats nova_cell0:SELECT=1,nova_cell0:UPDATE=1 {{(pid=81196) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:04:41 l75lg1-v1 nova-scheduler[81194]: DEBUG dbcounter [-] [81194] Writing DB stats nova_cell0:SELECT=1 {{(pid=81194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:04:42 l75lg1-v1 dstat.sh[49771]: 28-05 13:04:42| 1 0 97 0 0|5520M 1893M 278M 7933M| 11k 932B| 0 368k| 0 65.0 |2326 3801 |0.89 1.03 1.03| 0 0 0| 0 0 | 0 2048M| 29 359 0 14 6 May 28 13:04:42 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-7b3741f4-6867-4a43-aeb6-dfd9ceb44de3 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] GET http://10.27.203.238/share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares/7601713b-20f2-4013-810d-48ea6ee0f38e May 28 13:04:42 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-7b3741f4-6867-4a43-aeb6-dfd9ceb44de3 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:04:42 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-7b3741f4-6867-4a43-aeb6-dfd9ceb44de3 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:04:42 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-7b3741f4-6867-4a43-aeb6-dfd9ceb44de3 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] http://10.27.203.238/share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares/7601713b-20f2-4013-810d-48ea6ee0f38e returned with HTTP 200 May 28 13:04:42 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1378/2735] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:04:42 2024] GET /share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares/7601713b-20f2-4013-810d-48ea6ee0f38e => generated 1315 bytes in 28 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:04:42 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-905dc955-a698-48c3-bac9-3b6a69e6f15b tempest-SharesActionsNegativeTest-299343130 None] <<< [POST] https://127.0.0.1:40443/api/quotas/ May 28 13:04:42 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-905dc955-a698-48c3-bac9-3b6a69e6f15b tempest-SharesActionsNegativeTest-299343130 None] Bunch(cluster='loop75-kfs', cluster_id=1, default_email=None, default_group_quota=None, default_user_quota=None, enable_alarms=True, enable_email_providers=True, grace_period=None, group_quotas=[], guid='a63808ec-a972-4f02-81b5-e66e33f52678', hard_limit=2147483648, hard_limit_inodes=None, id=61, internal=False, is_user_quota=False, last_user_quotas_update=None, name='03240935-dd72-4869-a1b8-a95a0588009e', num_blocked_users=0, num_exceeded_users=0, path='/manila/manila-03240935-dd72-4869-a1b8-a95a0588009e', percent_capacity=0, percent_inodes=None, pretty_grace_period=None, pretty_grace_period_expiration=None, pretty_state='OK (CREATED)', soft_limit=None, soft_limit_inodes=None, state='OK', sync_state='CREATED', system_id=61, tenant_id=1, tenant_name='default', time_to_block=None, title='03240935-dd72-4869-a1b8-a95a0588009e', url='https://127.0.0.1:40443/api/quotas/61/', used_capacity=0, used_capacity_tb=0.0, used_effective_capacity=0, used_effective_capacity_tb=0.0, used_inodes=0, used_limited_capacity=0, user_quotas=[]) May 28 13:04:42 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-905dc955-a698-48c3-bac9-3b6a69e6f15b tempest-SharesActionsNegativeTest-299343130 None] --- [POST] https://127.0.0.1:40443/api/quotas/: Done May 28 13:04:42 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-905dc955-a698-48c3-bac9-3b6a69e6f15b tempest-SharesActionsNegativeTest-299343130 None] >>> [GET] https://127.0.0.1:40443/api/views/ May 28 13:04:42 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-905dc955-a698-48c3-bac9-3b6a69e6f15b tempest-SharesActionsNegativeTest-299343130 None] {'allow_redirects': True, May 28 13:04:42 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-905dc955-a698-48c3-bac9-3b6a69e6f15b tempest-SharesActionsNegativeTest-299343130 None] 'params': {'name': '03240935-dd72-4869-a1b8-a95a0588009e'}} May 28 13:04:43 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-905dc955-a698-48c3-bac9-3b6a69e6f15b tempest-SharesActionsNegativeTest-299343130 None] <<< [GET] https://127.0.0.1:40443/api/views/ May 28 13:04:43 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-905dc955-a698-48c3-bac9-3b6a69e6f15b tempest-SharesActionsNegativeTest-299343130 None] [] May 28 13:04:43 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-905dc955-a698-48c3-bac9-3b6a69e6f15b tempest-SharesActionsNegativeTest-299343130 None] --- [GET] https://127.0.0.1:40443/api/views/: Done May 28 13:04:43 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-905dc955-a698-48c3-bac9-3b6a69e6f15b tempest-SharesActionsNegativeTest-299343130 None] >>> [POST] https://127.0.0.1:40443/api/views/ May 28 13:04:43 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-905dc955-a698-48c3-bac9-3b6a69e6f15b tempest-SharesActionsNegativeTest-299343130 None] {'data': '{"name": "03240935-dd72-4869-a1b8-a95a0588009e", "path": ' May 28 13:04:43 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-905dc955-a698-48c3-bac9-3b6a69e6f15b tempest-SharesActionsNegativeTest-299343130 None] '"/manila/manila-03240935-dd72-4869-a1b8-a95a0588009e", "policy_id": ' May 28 13:04:43 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-905dc955-a698-48c3-bac9-3b6a69e6f15b tempest-SharesActionsNegativeTest-299343130 None] '64, "create_dir": true, "protocols": ["NFS"]}', May 28 13:04:43 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-905dc955-a698-48c3-bac9-3b6a69e6f15b tempest-SharesActionsNegativeTest-299343130 None] 'json': None, May 28 13:04:43 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-905dc955-a698-48c3-bac9-3b6a69e6f15b tempest-SharesActionsNegativeTest-299343130 None] 'params': None} May 28 13:04:43 l75lg1-v1 dstat.sh[49771]: 28-05 13:04:43| 1 0 98 0 0|5520M 1893M 278M 7933M| 14k 2399B| 0 440k| 0 50.0 |2102 3343 |1.06 1.07 1.04|2.0 0 0| 0 0 | 0 2048M| 29 359 0 14 6 May 28 13:04:44 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-905dc955-a698-48c3-bac9-3b6a69e6f15b tempest-SharesActionsNegativeTest-299343130 None] <<< [POST] https://127.0.0.1:40443/api/views/ May 28 13:04:44 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-905dc955-a698-48c3-bac9-3b6a69e6f15b tempest-SharesActionsNegativeTest-299343130 None] Bunch(abac_tags=[], abe_max_depth=None, abe_protocols=[], alias='', allow_anonymous_access=False, allow_s3_anonymous_access=False, auto_commit='0d', bucket='', bucket_creators=[], bucket_creators_groups=[], bucket_owner=None, bulk_permission_update_progress=None, bulk_permission_update_state=None, cluster='loop75-kfs', cluster_id=1, created='2024-05-28T13:04:43.850657Z', enabled=True, files_retention_mode='NONE', guid='d64daee9-8376-400e-8d0e-98e6c2541356', id=63, ignore_oos=False, internal=False, is_remote=False, is_seamless=False, logical_capacity=0, max_retention_period=None, min_retention_period=None, name='03240935-dd72-4869-a1b8-a95a0588009e', nfs_interop_flags='BOTH_NFS3_AND_NFS4_INTEROP_DISABLED', path='/manila/manila-03240935-dd72-4869-a1b8-a95a0588009e', physical_capacity=0, policy='03240935-dd72-4869-a1b8-a95a0588009e', policy_id=64, protocols=['NFS'], qos_policy=None, qos_policy_id=None, s3_locks=False, s3_locks_retention_mode='NONE', s3_locks_retention_period='', s3_object_ownership_rule='ObjectWriter', s3_unverified_lookup=False, s3_versioning=False, select_for_live_monitoring=False, share='', share_acl=Bunch(acl=[], enabled=False), sync='SYNCED', sync_time='2024-05-28T13:04:44.140054Z', tenant_id=1, tenant_name='default', title='/manila/manila-03240935-dd72-4869-a1b8-a95a0588009e', url='https://127.0.0.1:40443/api/views/63/') May 28 13:04:44 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-905dc955-a698-48c3-bac9-3b6a69e6f15b tempest-SharesActionsNegativeTest-299343130 None] --- [POST] https://127.0.0.1:40443/api/views/: Done May 28 13:04:44 l75lg1-v1 manila-share[98474]: INFO manila.share.manager [None req-905dc955-a698-48c3-bac9-3b6a69e6f15b tempest-SharesActionsNegativeTest-299343130 None] Share instance 03240935-dd72-4869-a1b8-a95a0588009e created successfully. May 28 13:04:44 l75lg1-v1 dstat.sh[49771]: 28-05 13:04:44| 1 1 98 0 0|5520M 1893M 278M 7933M| 16k 66B| 0 483k| 0 15.0 |1534 2407 |1.06 1.07 1.04|1.0 1.0 0| 0 0 | 0 2048M| 29 359 0 14 6 May 28 13:04:45 l75lg1-v1 dstat.sh[49771]: 28-05 13:04:45| 1 0 99 0 0|5520M 1893M 278M 7933M| 10k 0 | 0 252k| 0 38.0 |1669 2650 |1.06 1.07 1.04|1.0 0 0| 0 0 | 0 2048M| 29 359 0 14 6 May 28 13:04:45 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-5801b0f5-ee38-4d8e-b3ad-1311d36fa76b tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] GET http://10.27.203.238/share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares/7601713b-20f2-4013-810d-48ea6ee0f38e May 28 13:04:45 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-5801b0f5-ee38-4d8e-b3ad-1311d36fa76b tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:04:45 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-5801b0f5-ee38-4d8e-b3ad-1311d36fa76b tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:04:45 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-5801b0f5-ee38-4d8e-b3ad-1311d36fa76b tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] http://10.27.203.238/share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares/7601713b-20f2-4013-810d-48ea6ee0f38e returned with HTTP 200 May 28 13:04:45 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1358/2736] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:04:45 2024] GET /share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares/7601713b-20f2-4013-810d-48ea6ee0f38e => generated 1318 bytes in 27 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:04:45 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-1cbc4379-819c-496b-80b9-f784caba2a6c tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] POST http://10.27.203.238/share/v2/c7f81fe24c76497a89dd033554ce1057/shares/7601713b-20f2-4013-810d-48ea6ee0f38e/action May 28 13:04:45 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-1cbc4379-819c-496b-80b9-f784caba2a6c tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] Action body: b'{"reset_status": {"status": "error"}}' {{(pid=98329) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 13:04:45 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-1cbc4379-819c-496b-80b9-f784caba2a6c tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] Action: 'action', calling method: ShareController.share_reset_status, body: {"reset_status": {"status": "error"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:04:45 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-1cbc4379-819c-496b-80b9-f784caba2a6c tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] Updating share '7601713b-20f2-4013-810d-48ea6ee0f38e' with '{'status': 'error'}' {{(pid=98329) _reset_status /opt/stack/manila/manila/api/openstack/wsgi.py:1257}} May 28 13:04:45 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-1cbc4379-819c-496b-80b9-f784caba2a6c tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] http://10.27.203.238/share/v2/c7f81fe24c76497a89dd033554ce1057/shares/7601713b-20f2-4013-810d-48ea6ee0f38e/action returned with HTTP 202 May 28 13:04:45 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1379/2737] 10.27.203.238 () {66 vars in 1493 bytes} [Tue May 28 13:04:45 2024] POST /share/v2/c7f81fe24c76497a89dd033554ce1057/shares/7601713b-20f2-4013-810d-48ea6ee0f38e/action => generated 0 bytes in 67 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 13:04:45 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-a14bc9b2-5565-4686-8ebf-df9593ba67d9 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] POST http://10.27.203.238/share/v1/c39deaad5eb341ceb2e3c79518f56a1b/shares/7601713b-20f2-4013-810d-48ea6ee0f38e/action May 28 13:04:45 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-a14bc9b2-5565-4686-8ebf-df9593ba67d9 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Action body: b'{"os-shrink": {"new_size": 1}}' {{(pid=98330) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 13:04:45 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-a14bc9b2-5565-4686-8ebf-df9593ba67d9 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Action: 'action', calling method: ShareController.shrink, body: {"os-shrink": {"new_size": 1}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:04:45 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-a14bc9b2-5565-4686-8ebf-df9593ba67d9 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] HTTP exception thrown: Invalid share: Share 7601713b-20f2-4013-810d-48ea6ee0f38e status must in (available, shrinking_possible_data_loss_error) to shrink, but current status is: error. May 28 13:04:45 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-a14bc9b2-5565-4686-8ebf-df9593ba67d9 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] http://10.27.203.238/share/v1/c39deaad5eb341ceb2e3c79518f56a1b/shares/7601713b-20f2-4013-810d-48ea6ee0f38e/action returned with HTTP 400 May 28 13:04:45 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1359/2738] 10.27.203.238 () {64 vars in 1450 bytes} [Tue May 28 13:04:45 2024] POST /share/v1/c39deaad5eb341ceb2e3c79518f56a1b/shares/7601713b-20f2-4013-810d-48ea6ee0f38e/action => generated 205 bytes in 24 msecs (HTTP/1.1 400) 6 headers in 239 bytes (1 switches on core 0) May 28 13:04:45 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-44775905-a188-4867-8175-7857f6abaf11 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] GET http://10.27.203.238/share/v2/c39deaad5eb341ceb2e3c79518f56a1b/share-replicas/detail?share_id=7601713b-20f2-4013-810d-48ea6ee0f38e May 28 13:04:45 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-44775905-a188-4867-8175-7857f6abaf11 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:04:45 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-44775905-a188-4867-8175-7857f6abaf11 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:04:45 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-44775905-a188-4867-8175-7857f6abaf11 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] http://10.27.203.238/share/v2/c39deaad5eb341ceb2e3c79518f56a1b/share-replicas/detail?share_id=7601713b-20f2-4013-810d-48ea6ee0f38e returned with HTTP 200 May 28 13:04:45 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1380/2739] 10.27.203.238 () {64 vars in 1476 bytes} [Tue May 28 13:04:45 2024] GET /share/v2/c39deaad5eb341ceb2e3c79518f56a1b/share-replicas/detail?share_id=7601713b-20f2-4013-810d-48ea6ee0f38e => generated 22 bytes in 12 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:04:45 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-22d8528e-90aa-41c0-b1d9-125f4d989d81 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] DELETE http://10.27.203.238/share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares/7601713b-20f2-4013-810d-48ea6ee0f38e May 28 13:04:45 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-22d8528e-90aa-41c0-b1d9-125f4d989d81 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:04:45 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-22d8528e-90aa-41c0-b1d9-125f4d989d81 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Calling method 'ShareMixin.delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:04:45 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.v1.shares [None req-22d8528e-90aa-41c0-b1d9-125f4d989d81 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Delete share with id: 7601713b-20f2-4013-810d-48ea6ee0f38e May 28 13:04:46 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-22d8528e-90aa-41c0-b1d9-125f4d989d81 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] http://10.27.203.238/share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares/7601713b-20f2-4013-810d-48ea6ee0f38e returned with HTTP 202 May 28 13:04:46 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1360/2740] 10.27.203.238 () {64 vars in 1454 bytes} [Tue May 28 13:04:45 2024] DELETE /share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares/7601713b-20f2-4013-810d-48ea6ee0f38e => generated 0 bytes in 375 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 13:04:46 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-2d35f910-86de-4124-92d5-c4fae47af8a2 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] GET http://10.27.203.238/share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares/7601713b-20f2-4013-810d-48ea6ee0f38e May 28 13:04:46 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-2d35f910-86de-4124-92d5-c4fae47af8a2 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:04:46 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-2d35f910-86de-4124-92d5-c4fae47af8a2 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:04:46 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-2d35f910-86de-4124-92d5-c4fae47af8a2 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] http://10.27.203.238/share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares/7601713b-20f2-4013-810d-48ea6ee0f38e returned with HTTP 200 May 28 13:04:46 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1381/2741] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:04:46 2024] GET /share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares/7601713b-20f2-4013-810d-48ea6ee0f38e => generated 1317 bytes in 24 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:04:46 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-22d8528e-90aa-41c0-b1d9-125f4d989d81 tempest-SharesActionsNegativeTest-299343130 None] Acquiring lock "locked_access_rules_operation_by_share_instance_03240935-dd72-4869-a1b8-a95a0588009e" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:04:46 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-22d8528e-90aa-41c0-b1d9-125f4d989d81 tempest-SharesActionsNegativeTest-299343130 None] Lock "locked_access_rules_operation_by_share_instance_03240935-dd72-4869-a1b8-a95a0588009e" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:04:46 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-22d8528e-90aa-41c0-b1d9-125f4d989d81 tempest-SharesActionsNegativeTest-299343130 None] Lock "locked_access_rules_operation_by_share_instance_03240935-dd72-4869-a1b8-a95a0588009e" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:04:46 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-22d8528e-90aa-41c0-b1d9-125f4d989d81 tempest-SharesActionsNegativeTest-299343130 None] Acquiring lock "locked_access_rules_operation_by_share_instance_03240935-dd72-4869-a1b8-a95a0588009e" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:04:46 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-22d8528e-90aa-41c0-b1d9-125f4d989d81 tempest-SharesActionsNegativeTest-299343130 None] Lock "locked_access_rules_operation_by_share_instance_03240935-dd72-4869-a1b8-a95a0588009e" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:04:46 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-22d8528e-90aa-41c0-b1d9-125f4d989d81 tempest-SharesActionsNegativeTest-299343130 None] Lock "locked_access_rules_operation_by_share_instance_03240935-dd72-4869-a1b8-a95a0588009e" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:04:46 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-22d8528e-90aa-41c0-b1d9-125f4d989d81 tempest-SharesActionsNegativeTest-299343130 None] Acquiring lock "locked_access_rules_operation_by_share_instance_03240935-dd72-4869-a1b8-a95a0588009e" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:04:46 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-22d8528e-90aa-41c0-b1d9-125f4d989d81 tempest-SharesActionsNegativeTest-299343130 None] Lock "locked_access_rules_operation_by_share_instance_03240935-dd72-4869-a1b8-a95a0588009e" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:04:46 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-22d8528e-90aa-41c0-b1d9-125f4d989d81 tempest-SharesActionsNegativeTest-299343130 None] Lock "locked_access_rules_operation_by_share_instance_03240935-dd72-4869-a1b8-a95a0588009e" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:04:46 l75lg1-v1 manila-share[98474]: DEBUG manila.share.access [None req-22d8528e-90aa-41c0-b1d9-125f4d989d81 tempest-SharesActionsNegativeTest-299343130 None] All access rules have been synced for share instance 03240935-dd72-4869-a1b8-a95a0588009e belonging to share 7601713b-20f2-4013-810d-48ea6ee0f38e. {{(pid=98474) update_access_rules /opt/stack/manila/manila/share/access.py:304}} May 28 13:04:46 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-22d8528e-90aa-41c0-b1d9-125f4d989d81 tempest-SharesActionsNegativeTest-299343130 None] deleting '/manila/manila-03240935-dd72-4869-a1b8-a95a0588009e' May 28 13:04:46 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-22d8528e-90aa-41c0-b1d9-125f4d989d81 tempest-SharesActionsNegativeTest-299343130 None] >>> [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/ May 28 13:04:46 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-22d8528e-90aa-41c0-b1d9-125f4d989d81 tempest-SharesActionsNegativeTest-299343130 None] {'data': '{"path": "/manila/manila-03240935-dd72-4869-a1b8-a95a0588009e"}', May 28 13:04:46 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-22d8528e-90aa-41c0-b1d9-125f4d989d81 tempest-SharesActionsNegativeTest-299343130 None] 'params': None} May 28 13:04:46 l75lg1-v1 dstat.sh[49771]: 28-05 13:04:46| 7 0 92 1 0|5520M 1893M 278M 7933M| 10k 852B| 0 1836k| 0 341 |2719 4254 |1.06 1.07 1.04| 0 0 0| 0 0 | 0 2048M| 29 359 0 14 6 May 28 13:04:46 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-22d8528e-90aa-41c0-b1d9-125f4d989d81 tempest-SharesActionsNegativeTest-299343130 None] <<< [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/ May 28 13:04:46 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-22d8528e-90aa-41c0-b1d9-125f4d989d81 tempest-SharesActionsNegativeTest-299343130 None] 'OK' May 28 13:04:46 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-22d8528e-90aa-41c0-b1d9-125f4d989d81 tempest-SharesActionsNegativeTest-299343130 None] --- [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/: Done May 28 13:04:46 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-22d8528e-90aa-41c0-b1d9-125f4d989d81 tempest-SharesActionsNegativeTest-299343130 None] >>> [GET] https://127.0.0.1:40443/api/views/ May 28 13:04:46 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-22d8528e-90aa-41c0-b1d9-125f4d989d81 tempest-SharesActionsNegativeTest-299343130 None] {'allow_redirects': True, May 28 13:04:46 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-22d8528e-90aa-41c0-b1d9-125f4d989d81 tempest-SharesActionsNegativeTest-299343130 None] 'params': {'name': '03240935-dd72-4869-a1b8-a95a0588009e'}} May 28 13:04:46 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-22d8528e-90aa-41c0-b1d9-125f4d989d81 tempest-SharesActionsNegativeTest-299343130 None] <<< [GET] https://127.0.0.1:40443/api/views/ May 28 13:04:46 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-22d8528e-90aa-41c0-b1d9-125f4d989d81 tempest-SharesActionsNegativeTest-299343130 None] [Bunch(abac_tags=[], abe_max_depth=None, abe_protocols=[], alias='', allow_anonymous_access=False, allow_s3_anonymous_access=False, auto_commit='0d', bucket='', bucket_creators=[], bucket_creators_groups=[], bucket_owner=None, bulk_permission_update_progress=None, bulk_permission_update_state=None, cluster='loop75-kfs', cluster_id=1, created='2024-05-28T13:04:43.850657Z', enabled=True, files_retention_mode='NONE', guid='d64daee9-8376-400e-8d0e-98e6c2541356', id=63, ignore_oos=False, internal=False, is_remote=False, is_seamless=False, logical_capacity=0, max_retention_period=None, min_retention_period=None, name='03240935-dd72-4869-a1b8-a95a0588009e', nfs_interop_flags='BOTH_NFS3_AND_NFS4_INTEROP_DISABLED', path='/manila/manila-03240935-dd72-4869-a1b8-a95a0588009e', physical_capacity=0, policy='03240935-dd72-4869-a1b8-a95a0588009e', policy_id=64, protocols=['NFS'], qos_policy=None, qos_policy_id=None, s3_locks=False, s3_locks_retention_mode='NONE', s3_locks_retention_period='', s3_unverified_lookup=False, s3_versioning=False, select_for_live_monitoring=False, share='', share_acl=Bunch(acl=[], enabled=False), sync='SYNCED', sync_time='2024-05-28T13:04:44.140054Z', tenant_id=1, tenant_name='default', title='/manila/manila-03240935-dd72-4869-a1b8-a95a0588009e', url='https://127.0.0.1:40443/api/views/63/')] May 28 13:04:46 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-22d8528e-90aa-41c0-b1d9-125f4d989d81 tempest-SharesActionsNegativeTest-299343130 None] --- [GET] https://127.0.0.1:40443/api/views/: Done May 28 13:04:46 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-22d8528e-90aa-41c0-b1d9-125f4d989d81 tempest-SharesActionsNegativeTest-299343130 None] >>> [DELETE] https://127.0.0.1:40443/api/views/63/ May 28 13:04:47 l75lg1-v1 dstat.sh[49771]: 28-05 13:04:47| 1 0 99 0 0|5520M 1892M 278M 7933M| 16k 1316B| 0 160k| 0 12.0 |1649 2501 |1.06 1.07 1.04|1.0 0 0| 0 0 | 0 2048M| 29 359 0 14 6 May 28 13:04:47 l75lg1-v1 manila-share[98474]: DEBUG oslo_service.periodic_task [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] Running periodic task ShareManager._publish_service_capabilities {{(pid=98474) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 13:04:47 l75lg1-v1 manila-share[98474]: DEBUG manila.manager [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] Notifying Schedulers of capabilities ... {{(pid=98474) _publish_service_capabilities /opt/stack/manila/manila/manager.py:172}} May 28 13:04:47 l75lg1-v1 manila-share[98474]: DEBUG oslo_service.periodic_task [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] Running periodic task ShareManager.migration_driver_continue {{(pid=98474) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 13:04:47 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.host_manager [None req-e4472a08-f8e8-4efe-a008-a02bad20ce01 None None] Received share service update from l75lg1-v1@vast: {'share_backend_name': 'vast', 'driver_handles_share_servers': False, 'vendor_name': 'VAST STORAGE', 'driver_version': '1.0', 'storage_protocol': 'NFS', 'total_capacity_gb': 2083.02392578125, 'free_capacity_gb': 2082.6423625880852, 'reserved_percentage': 0, 'reserved_snapshot_percentage': 0, 'reserved_share_extend_percentage': 0, 'qos': False, 'pools': None, 'snapshot_support': True, 'create_share_from_snapshot_support': False, 'revert_to_snapshot_support': False, 'mount_snapshot_support': False, 'replication_domain': None, 'filter_function': None, 'goodness_function': None, 'security_service_update_support': False, 'network_allocation_update_support': False, 'share_server_multiple_subnet_support': False, 'mount_point_name_support': False, 'data_reduction': 5.29, 'provisioned_capacity_gb': 0.38156319316476583, 'share_group_stats': {'consistent_snapshot_support': None}, 'ipv4_support': True, 'ipv6_support': False} {{(pid=98327) update_service_capabilities /opt/stack/manila/manila/scheduler/host_manager.py:632}} May 28 13:04:47 l75lg1-v1 manila-share[98474]: DEBUG oslo_service.periodic_task [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] Running periodic task ShareManager.do_deferred_share_deletion {{(pid=98474) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 13:04:47 l75lg1-v1 manila-share[98474]: DEBUG manila.share.manager [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] Checking for shares in 'deferred_deleting' status to process their deletion. {{(pid=98474) do_deferred_share_deletion /opt/stack/manila/manila/share/manager.py:3663}} May 28 13:04:47 l75lg1-v1 manila-share[98474]: DEBUG oslo_service.periodic_task [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] Running periodic task ShareManager.do_deferred_snapshot_deletion {{(pid=98474) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 13:04:47 l75lg1-v1 manila-share[98474]: DEBUG manila.share.manager [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] Checking for snapshots in 'deferred_deleting' status to process their deletion. {{(pid=98474) do_deferred_snapshot_deletion /opt/stack/manila/manila/share/manager.py:3980}} May 28 13:04:47 l75lg1-v1 manila-share[98474]: DEBUG oslo_service.periodic_task [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] Running periodic task ShareManager._report_driver_status {{(pid=98474) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 13:04:47 l75lg1-v1 manila-share[98474]: INFO manila.share.manager [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] Updating share status May 28 13:04:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] >>> [GET] https://127.0.0.1:40443/api/monitors/ad_hoc_query/ May 28 13:04:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] {'allow_redirects': True, May 28 13:04:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] 'params': {'object_type': 'cluster', May 28 13:04:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] 'prop_list': ['Capacity,drr', May 28 13:04:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] 'Capacity,logical_space', May 28 13:04:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] 'Capacity,logical_space_in_use', May 28 13:04:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] 'Capacity,physical_space', May 28 13:04:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] 'Capacity,physical_space_in_use'], May 28 13:04:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] 'time_frame': '1m'}} May 28 13:04:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] <<< [GET] https://127.0.0.1:40443/api/monitors/ad_hoc_query/ May 28 13:04:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] Bunch(data=[['2024-05-28T13:04:42Z', 1, 454993927.0, 2223930.0, 5.29, 711246584217.0, 2236629909504.0], ['2024-05-28T13:04:32Z', 1, 454928390.0, 2223930.0, 5.29, 711246584217.0, 2236629909504.0], ['2024-05-28T13:04:22Z', 1, 440592374.0, 2223930.0, 5.29, 711246584217.0, 2236629909504.0], ['2024-05-28T13:04:12Z', 1, 427763717.0, 2223930.0, 5.29, 711246584217.0, 2236629909504.0], ['2024-05-28T13:04:02Z', 1, 427681799.0, 2223930.0, 5.29, 711246584217.0, 2236629909504.0], ['2024-05-28T13:03:52Z', 1, 427575303.0, 2223930.0, 5.29, 711246584217.0, 2236629909504.0]], granularity=None, object_ids=[1], prop_list=['timestamp', 'object_id', 'Capacity,logical_space_in_use', 'Capacity,physical_space_in_use', 'Capacity,drr', 'Capacity,physical_space', 'Capacity,logical_space']) May 28 13:04:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] --- [GET] https://127.0.0.1:40443/api/monitors/ad_hoc_query/: Done May 28 13:04:47 l75lg1-v1 manila-share[98474]: DEBUG manila.share.driver [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] Updating share stats. {{(pid=98474) _update_share_stats /opt/stack/manila/manila/share/driver.py:1326}} May 28 13:04:47 l75lg1-v1 manila-share[98474]: DEBUG oslo_service.periodic_task [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] Running periodic task ShareManager.create_backup_continue {{(pid=98474) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 13:04:47 l75lg1-v1 manila-share[98474]: DEBUG oslo_service.periodic_task [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] Running periodic task ShareManager.restore_backup_continue {{(pid=98474) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 13:04:47 l75lg1-v1 manila-share[98474]: DEBUG oslo_service.periodic_task [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] Running periodic task ShareManager.periodic_share_status_update {{(pid=98474) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 13:04:47 l75lg1-v1 manila-share[98474]: DEBUG manila.share.manager [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] Updating status of share instances. {{(pid=98474) periodic_share_status_update /opt/stack/manila/manila/share/manager.py:5475}} May 28 13:04:48 l75lg1-v1 nova-conductor[83229]: DEBUG dbcounter [-] [83229] Writing DB stats nova_cell0:SELECT=1,nova_cell0:UPDATE=1 {{(pid=83229) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:04:48 l75lg1-v1 nova-conductor[83233]: DEBUG dbcounter [-] [83233] Writing DB stats nova_cell0:SELECT=1 {{(pid=83233) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:04:48 l75lg1-v1 dstat.sh[49771]: 28-05 13:04:48| 2 0 98 0 0|5520M 1892M 278M 7933M| 11k 1092B| 0 232k| 0 23.0 |1772 2731 |0.97 1.05 1.03| 0 0 2.0| 0 0 | 0 2048M| 29 359 0 14 6 May 28 13:04:48 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-22d8528e-90aa-41c0-b1d9-125f4d989d81 tempest-SharesActionsNegativeTest-299343130 None] <<< [DELETE] https://127.0.0.1:40443/api/views/63/ May 28 13:04:48 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-22d8528e-90aa-41c0-b1d9-125f4d989d81 tempest-SharesActionsNegativeTest-299343130 None] --- [DELETE] https://127.0.0.1:40443/api/views/63/: Done May 28 13:04:48 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-22d8528e-90aa-41c0-b1d9-125f4d989d81 tempest-SharesActionsNegativeTest-299343130 None] >>> [GET] https://127.0.0.1:40443/api/quotas/ May 28 13:04:48 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-22d8528e-90aa-41c0-b1d9-125f4d989d81 tempest-SharesActionsNegativeTest-299343130 None] {'allow_redirects': True, May 28 13:04:48 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-22d8528e-90aa-41c0-b1d9-125f4d989d81 tempest-SharesActionsNegativeTest-299343130 None] 'params': {'name': '03240935-dd72-4869-a1b8-a95a0588009e'}} May 28 13:04:49 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-2a543dfb-d2e2-4160-85da-d74eb06e40a5 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] GET http://10.27.203.238/share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares/7601713b-20f2-4013-810d-48ea6ee0f38e May 28 13:04:49 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-2a543dfb-d2e2-4160-85da-d74eb06e40a5 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:04:49 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-2a543dfb-d2e2-4160-85da-d74eb06e40a5 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:04:49 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-2a543dfb-d2e2-4160-85da-d74eb06e40a5 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] http://10.27.203.238/share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares/7601713b-20f2-4013-810d-48ea6ee0f38e returned with HTTP 200 May 28 13:04:49 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1361/2742] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:04:49 2024] GET /share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares/7601713b-20f2-4013-810d-48ea6ee0f38e => generated 1317 bytes in 25 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:04:49 l75lg1-v1 dstat.sh[49771]: 28-05 13:04:49| 1 0 99 0 0|5520M 1892M 278M 7933M| 10k 736B| 0 312k| 0 29.0 |1753 2802 |0.97 1.05 1.03|1.0 0 0| 0 0 | 0 2048M| 29 359 0 14 6 May 28 13:04:49 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-22d8528e-90aa-41c0-b1d9-125f4d989d81 tempest-SharesActionsNegativeTest-299343130 None] <<< [GET] https://127.0.0.1:40443/api/quotas/ May 28 13:04:49 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-22d8528e-90aa-41c0-b1d9-125f4d989d81 tempest-SharesActionsNegativeTest-299343130 None] [Bunch(cluster='loop75-kfs', cluster_id=1, default_email=None, default_group_quota=None, default_user_quota=None, enable_alarms=True, enable_email_providers=True, grace_period=None, guid='a63808ec-a972-4f02-81b5-e66e33f52678', hard_limit=2147483648, hard_limit_inodes=None, id=61, internal=False, is_user_quota=False, last_user_quotas_update=None, name='03240935-dd72-4869-a1b8-a95a0588009e', num_blocked_users=0, num_exceeded_users=0, path='/manila/manila-03240935-dd72-4869-a1b8-a95a0588009e', percent_capacity=0, percent_inodes=None, pretty_grace_period=None, pretty_grace_period_expiration=None, pretty_state='OK (Calculating)', soft_limit=None, soft_limit_inodes=None, state='OK', sync_state='Calculating', system_id=61, tenant_id=1, tenant_name='default', time_to_block=None, title='03240935-dd72-4869-a1b8-a95a0588009e', url='https://127.0.0.1:40443/api/quotas/61/', used_capacity=0, used_capacity_tb=0.0, used_effective_capacity=0, used_effective_capacity_tb=0.0, used_inodes=0, used_limited_capacity=0)] May 28 13:04:49 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-22d8528e-90aa-41c0-b1d9-125f4d989d81 tempest-SharesActionsNegativeTest-299343130 None] --- [GET] https://127.0.0.1:40443/api/quotas/: Done May 28 13:04:49 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-22d8528e-90aa-41c0-b1d9-125f4d989d81 tempest-SharesActionsNegativeTest-299343130 None] >>> [DELETE] https://127.0.0.1:40443/api/quotas/61/ May 28 13:04:49 l75lg1-v1 nova-conductor[83647]: DEBUG dbcounter [-] [83647] Writing DB stats nova_cell1:SELECT=1 {{(pid=83647) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:04:49 l75lg1-v1 nova-conductor[83647]: DEBUG dbcounter [-] [83647] Writing DB stats nova_cell1:SELECT=1,nova_cell1:UPDATE=2 {{(pid=83647) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:04:50 l75lg1-v1 nova-conductor[83648]: DEBUG dbcounter [-] [83648] Writing DB stats nova_cell1:SELECT=2 {{(pid=83648) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:04:50 l75lg1-v1 dstat.sh[49771]: 28-05 13:04:50| 1 0 98 0 0|5520M 1892M 278M 7933M| 20k 654B| 0 260k| 0 42.0 |1878 2960 |0.97 1.05 1.03|1.0 0 0| 0 0 | 0 2048M| 29 359 0 14 6 May 28 13:04:51 l75lg1-v1 dstat.sh[49771]: 28-05 13:04:51| 1 0 99 0 0|5520M 1892M 278M 7933M| 18k 0 | 0 116k| 0 12.0 |1607 2429 |0.97 1.05 1.03|1.0 0 0| 0 0 | 0 2048M| 29 359 0 14 6 May 28 13:04:51 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 13:04:52 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-a1503334-5dd7-4d02-99cc-595e8a6b6f5f tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] GET http://10.27.203.238/share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares/7601713b-20f2-4013-810d-48ea6ee0f38e May 28 13:04:52 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-a1503334-5dd7-4d02-99cc-595e8a6b6f5f tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:04:52 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-a1503334-5dd7-4d02-99cc-595e8a6b6f5f tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:04:52 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-a1503334-5dd7-4d02-99cc-595e8a6b6f5f tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] http://10.27.203.238/share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares/7601713b-20f2-4013-810d-48ea6ee0f38e returned with HTTP 200 May 28 13:04:52 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1382/2743] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:04:52 2024] GET /share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares/7601713b-20f2-4013-810d-48ea6ee0f38e => generated 1317 bytes in 31 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:04:52 l75lg1-v1 dstat.sh[49771]: 28-05 13:04:52| 1 0 98 0 0|5520M 1892M 278M 7933M| 13k 0 | 0 292k| 0 47.0 |2006 3188 |0.97 1.05 1.03|1.0 0 0| 0 0 | 0 2048M| 29 359 0 14 6 May 28 13:04:52 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-22d8528e-90aa-41c0-b1d9-125f4d989d81 tempest-SharesActionsNegativeTest-299343130 None] <<< [DELETE] https://127.0.0.1:40443/api/quotas/61/ May 28 13:04:52 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-22d8528e-90aa-41c0-b1d9-125f4d989d81 tempest-SharesActionsNegativeTest-299343130 None] --- [DELETE] https://127.0.0.1:40443/api/quotas/61/: Done May 28 13:04:52 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-22d8528e-90aa-41c0-b1d9-125f4d989d81 tempest-SharesActionsNegativeTest-299343130 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:04:52 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-22d8528e-90aa-41c0-b1d9-125f4d989d81 tempest-SharesActionsNegativeTest-299343130 None] {'allow_redirects': True, May 28 13:04:52 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-22d8528e-90aa-41c0-b1d9-125f4d989d81 tempest-SharesActionsNegativeTest-299343130 None] 'params': {'name': '03240935-dd72-4869-a1b8-a95a0588009e'}} May 28 13:04:53 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-22d8528e-90aa-41c0-b1d9-125f4d989d81 tempest-SharesActionsNegativeTest-299343130 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:04:53 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-22d8528e-90aa-41c0-b1d9-125f4d989d81 tempest-SharesActionsNegativeTest-299343130 None] [Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=0, created='2024-05-28T13:04:40.829288Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='dd3420dd-03b2-4b35-875d-d5f0a83bade1', id=64, internal=False, is_s3_default_policy=False, name='03240935-dd72-4869-a1b8-a95a0588009e', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=[], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['*'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['*'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T13:04:41.151349Z', tenant_id=1, tenant_name='default', title='03240935-dd72-4869-a1b8-a95a0588009e', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/64/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[])] May 28 13:04:53 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-22d8528e-90aa-41c0-b1d9-125f4d989d81 tempest-SharesActionsNegativeTest-299343130 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 13:04:53 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-22d8528e-90aa-41c0-b1d9-125f4d989d81 tempest-SharesActionsNegativeTest-299343130 None] >>> [DELETE] https://127.0.0.1:40443/api/viewpolicies/64/ May 28 13:04:53 l75lg1-v1 dstat.sh[49771]: 28-05 13:04:53| 1 0 98 0 0|5520M 1892M 278M 7933M| 22k 1560B| 0 396k| 0 48.0 |2161 3329 |1.14 1.08 1.04|1.0 0 0| 0 0 | 0 2048M| 29 359 0 14 6 May 28 13:04:53 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 13:04:54 l75lg1-v1 dstat.sh[49771]: 28-05 13:04:54| 1 0 99 0 0|5520M 1892M 278M 7933M| 18k 0 | 0 136k| 0 11.0 |1482 2342 |1.14 1.08 1.04|1.0 0 0| 0 0 | 0 2048M| 29 359 0 14 6 May 28 13:04:54 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 13:04:54 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Expecting reply to msg d28c7b8c2e364fe7bce1aff9cde8f79e in queue reply_37f4cbd1dd094961a22b8a65f222c327 May 28 13:04:54 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [-] Received RPC response for msg d28c7b8c2e364fe7bce1aff9cde8f79e May 28 13:04:54 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-22d8528e-90aa-41c0-b1d9-125f4d989d81 tempest-SharesActionsNegativeTest-299343130 None] <<< [DELETE] https://127.0.0.1:40443/api/viewpolicies/64/ May 28 13:04:54 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-22d8528e-90aa-41c0-b1d9-125f4d989d81 tempest-SharesActionsNegativeTest-299343130 None] --- [DELETE] https://127.0.0.1:40443/api/viewpolicies/64/: Done May 28 13:04:54 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-22d8528e-90aa-41c0-b1d9-125f4d989d81 tempest-SharesActionsNegativeTest-299343130 None] Created reservations ['f70575e6-e76e-4fb5-8120-584040a53529', 'de1e0533-8993-4d22-80a7-c457c42b2168', 'f956d0ec-cbe0-4906-ba02-90bc0880c66c', 'eab61ddf-2179-4a62-aa4f-5d35dc791e4b'] {{(pid=98474) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 13:04:54 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-22d8528e-90aa-41c0-b1d9-125f4d989d81 tempest-SharesActionsNegativeTest-299343130 None] Committed reservations ['f70575e6-e76e-4fb5-8120-584040a53529', 'de1e0533-8993-4d22-80a7-c457c42b2168', 'f956d0ec-cbe0-4906-ba02-90bc0880c66c', 'eab61ddf-2179-4a62-aa4f-5d35dc791e4b'] {{(pid=98474) commit /opt/stack/manila/manila/quota.py:1063}} May 28 13:04:54 l75lg1-v1 manila-share[98474]: INFO manila.share.manager [None req-22d8528e-90aa-41c0-b1d9-125f4d989d81 tempest-SharesActionsNegativeTest-299343130 None] Share instance 03240935-dd72-4869-a1b8-a95a0588009e: deleted successfully. May 28 13:04:55 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-52e33190-702c-4e6d-a68f-8697a236f38a tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] GET http://10.27.203.238/share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares/7601713b-20f2-4013-810d-48ea6ee0f38e May 28 13:04:55 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-52e33190-702c-4e6d-a68f-8697a236f38a tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:04:55 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-52e33190-702c-4e6d-a68f-8697a236f38a tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:04:55 l75lg1-v1 dstat.sh[49771]: 28-05 13:04:55| 2 0 97 1 0|5521M 1891M 278M 7933M| 11k 238B| 0 560k| 0 90.0 |2437 3999 |1.14 1.08 1.04|2.0 0 0| 0 0 | 0 2048M| 29 360 0 14 6 May 28 13:04:55 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-52e33190-702c-4e6d-a68f-8697a236f38a tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] HTTP exception thrown: The resource could not be found. May 28 13:04:55 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-52e33190-702c-4e6d-a68f-8697a236f38a tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] http://10.27.203.238/share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares/7601713b-20f2-4013-810d-48ea6ee0f38e returned with HTTP 404 May 28 13:04:55 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1362/2744] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:04:55 2024] GET /share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares/7601713b-20f2-4013-810d-48ea6ee0f38e => generated 78 bytes in 12 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 13:04:55 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-4b465b11-2412-46f3-abc5-3f04ab974771 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] POST http://10.27.203.238/share/v1/c39deaad5eb341ceb2e3c79518f56a1b/shares/1b08ba1e-039b-4773-869c-2a90b38f5f70/action May 28 13:04:55 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-4b465b11-2412-46f3-abc5-3f04ab974771 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Action body: b'{"os-shrink": {"new_size": 1}}' {{(pid=98329) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 13:04:55 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-4b465b11-2412-46f3-abc5-3f04ab974771 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Action: 'action', calling method: ShareController.shrink, body: {"os-shrink": {"new_size": 1}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:04:55 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-4b465b11-2412-46f3-abc5-3f04ab974771 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] HTTP exception thrown: Invalid input received: New size for shrink must be less than current size and greater than 0 (current: 1, new: 1). May 28 13:04:55 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-4b465b11-2412-46f3-abc5-3f04ab974771 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] http://10.27.203.238/share/v1/c39deaad5eb341ceb2e3c79518f56a1b/shares/1b08ba1e-039b-4773-869c-2a90b38f5f70/action returned with HTTP 400 May 28 13:04:55 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1383/2745] 10.27.203.238 () {64 vars in 1450 bytes} [Tue May 28 13:04:55 2024] POST /share/v1/c39deaad5eb341ceb2e3c79518f56a1b/shares/1b08ba1e-039b-4773-869c-2a90b38f5f70/action => generated 159 bytes in 23 msecs (HTTP/1.1 400) 6 headers in 239 bytes (1 switches on core 0) May 28 13:04:55 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-27c92e5f-9401-44fb-b09a-c9ea731c7b85 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] POST http://10.27.203.238/share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares May 28 13:04:55 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-27c92e5f-9401-44fb-b09a-c9ea731c7b85 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share": {"share_proto": "nfs", "description": "Tempest's share", "snapshot_id": null, "name": "tempest-tempest-created-share-683927825", "size": 1, "metadata": {}, "is_public": false, "share_type": "f7d65ead-0196-4e03-928f-2e08ca825112"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:04:55 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.v1.shares [None req-27c92e5f-9401-44fb-b09a-c9ea731c7b85 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Create NFS share of 1 GB May 28 13:04:55 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.quota [None req-27c92e5f-9401-44fb-b09a-c9ea731c7b85 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Created reservations ['797164a2-7b4e-4f5e-a2dc-b248dde55069', 'ac4a4d8c-6f0a-4552-9d96-ec83e70f847a', 'fbb6aeb4-390e-4d0f-820d-ef9351627e69', '6c6613c6-2d85-44cc-bbce-650aa6ede788'] {{(pid=98330) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 13:04:55 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.quota [None req-27c92e5f-9401-44fb-b09a-c9ea731c7b85 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Committed reservations ['797164a2-7b4e-4f5e-a2dc-b248dde55069', 'ac4a4d8c-6f0a-4552-9d96-ec83e70f847a', 'fbb6aeb4-390e-4d0f-820d-ef9351627e69', '6c6613c6-2d85-44cc-bbce-650aa6ede788'] {{(pid=98330) commit /opt/stack/manila/manila/quota.py:1063}} May 28 13:04:55 l75lg1-v1 neutron-server[77623]: DEBUG dbcounter [-] [77623] Writing DB stats neutron:SELECT=2 {{(pid=77623) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:04:55 l75lg1-v1 neutron-server[77623]: DEBUG dbcounter [-] [77623] Writing DB stats neutron:SELECT=1 {{(pid=77623) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:04:55 l75lg1-v1 manila-scheduler[98327]: DEBUG dbcounter [-] [98327] Writing DB stats manila:SELECT=58,manila:UPDATE=10 {{(pid=98327) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:04:55 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.host_manager [None req-27c92e5f-9401-44fb-b09a-c9ea731c7b85 tempest-SharesActionsNegativeTest-299343130 None] Share service is down. (host: l75lg1-v1@generic2). May 28 13:04:55 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.host_manager [None req-27c92e5f-9401-44fb-b09a-c9ea731c7b85 tempest-SharesActionsNegativeTest-299343130 None] Share service is down. (host: l75lg1-v1@generic1). May 28 13:04:55 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-27c92e5f-9401-44fb-b09a-c9ea731c7b85 tempest-SharesActionsNegativeTest-299343130 None] Starting with 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:80}} May 28 13:04:55 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-27c92e5f-9401-44fb-b09a-c9ea731c7b85 tempest-SharesActionsNegativeTest-299343130 None] Filter OnlyHostFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:04:55 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-27c92e5f-9401-44fb-b09a-c9ea731c7b85 tempest-SharesActionsNegativeTest-299343130 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:04:55 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.capacity [None req-27c92e5f-9401-44fb-b09a-c9ea731c7b85 tempest-SharesActionsNegativeTest-299343130 None] Space information for share creation on host l75lg1-v1@vast#vast (requested / avail): 1/2082 {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/capacity.py:83}} May 28 13:04:55 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-27c92e5f-9401-44fb-b09a-c9ea731c7b85 tempest-SharesActionsNegativeTest-299343130 None] Filter CapacityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:04:55 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-27c92e5f-9401-44fb-b09a-c9ea731c7b85 tempest-SharesActionsNegativeTest-299343130 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:04:55 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-27c92e5f-9401-44fb-b09a-c9ea731c7b85 tempest-SharesActionsNegativeTest-299343130 None] Driver Filter: Checking host 'l75lg1-v1@vast#vast' {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:37}} May 28 13:04:55 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-27c92e5f-9401-44fb-b09a-c9ea731c7b85 tempest-SharesActionsNegativeTest-299343130 None] Filter function not set :: passing host. {{(pid=98327) _check_filter_function /opt/stack/manila/manila/scheduler/filters/driver.py:53}} May 28 13:04:55 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-27c92e5f-9401-44fb-b09a-c9ea731c7b85 tempest-SharesActionsNegativeTest-299343130 None] Result: True {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:40}} May 28 13:04:55 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-27c92e5f-9401-44fb-b09a-c9ea731c7b85 tempest-SharesActionsNegativeTest-299343130 None] Done checking host 'l75lg1-v1@vast#vast' {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:41}} May 28 13:04:55 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-27c92e5f-9401-44fb-b09a-c9ea731c7b85 tempest-SharesActionsNegativeTest-299343130 None] Filter DriverFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:04:55 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-27c92e5f-9401-44fb-b09a-c9ea731c7b85 tempest-SharesActionsNegativeTest-299343130 None] Filter ShareReplicationFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:04:55 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-27c92e5f-9401-44fb-b09a-c9ea731c7b85 tempest-SharesActionsNegativeTest-299343130 None] Filter CreateFromSnapshotFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:04:55 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-27c92e5f-9401-44fb-b09a-c9ea731c7b85 tempest-SharesActionsNegativeTest-299343130 None] Filter AffinityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:04:55 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-27c92e5f-9401-44fb-b09a-c9ea731c7b85 tempest-SharesActionsNegativeTest-299343130 None] Filter AntiAffinityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:04:55 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.drivers.filter [None req-27c92e5f-9401-44fb-b09a-c9ea731c7b85 tempest-SharesActionsNegativeTest-299343130 None] Filtered share [host: 'l75lg1-v1@vast#vast', free_capacity_gb: 2082.6423625880852, pools: None] {{(pid=98327) _schedule_share /opt/stack/manila/manila/scheduler/drivers/filter.py:268}} May 28 13:04:55 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-27c92e5f-9401-44fb-b09a-c9ea731c7b85 tempest-SharesActionsNegativeTest-299343130 None] Checking host 'l75lg1-v1@vast#vast' {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:46}} May 28 13:04:55 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.weighers.goodness [None req-27c92e5f-9401-44fb-b09a-c9ea731c7b85 tempest-SharesActionsNegativeTest-299343130 None] Goodness function not set :: defaulting to minimal goodness rating of 0. May 28 13:04:55 l75lg1-v1 manila-scheduler[98327]: INFO manila.scheduler.weighers.goodness [None req-27c92e5f-9401-44fb-b09a-c9ea731c7b85 tempest-SharesActionsNegativeTest-299343130 None] Goodness function result for host l75lg1-v1@vast#vast: 0. May 28 13:04:55 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-27c92e5f-9401-44fb-b09a-c9ea731c7b85 tempest-SharesActionsNegativeTest-299343130 None] Goodness: 0 {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:48}} May 28 13:04:55 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-27c92e5f-9401-44fb-b09a-c9ea731c7b85 tempest-SharesActionsNegativeTest-299343130 None] Done checking host 'l75lg1-v1@vast#vast' {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:49}} May 28 13:04:55 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.drivers.filter [None req-27c92e5f-9401-44fb-b09a-c9ea731c7b85 tempest-SharesActionsNegativeTest-299343130 None] Choosing for share: WeighedHost [host: l75lg1-v1@vast#vast, weight: 0.0] {{(pid=98327) _schedule_share /opt/stack/manila/manila/scheduler/drivers/filter.py:274}} May 28 13:04:55 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-27c92e5f-9401-44fb-b09a-c9ea731c7b85 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] http://10.27.203.238/share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares returned with HTTP 200 May 28 13:04:55 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1363/2746] 10.27.203.238 () {66 vars in 1362 bytes} [Tue May 28 13:04:55 2024] POST /share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares => generated 1312 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:04:55 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-f4aa1520-8167-4cba-9cc3-12f817047fcc tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] GET http://10.27.203.238/share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares/c78ca6e2-e1f4-4196-a66f-6160ac6acb49 May 28 13:04:55 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-f4aa1520-8167-4cba-9cc3-12f817047fcc tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:04:55 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-f4aa1520-8167-4cba-9cc3-12f817047fcc tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:04:55 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-f4aa1520-8167-4cba-9cc3-12f817047fcc tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] http://10.27.203.238/share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares/c78ca6e2-e1f4-4196-a66f-6160ac6acb49 returned with HTTP 200 May 28 13:04:55 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1384/2747] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:04:55 2024] GET /share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares/c78ca6e2-e1f4-4196-a66f-6160ac6acb49 => generated 1312 bytes in 24 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:04:55 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-27c92e5f-9401-44fb-b09a-c9ea731c7b85 tempest-SharesActionsNegativeTest-299343130 None] >>> [GET] https://127.0.0.1:40443/api/vippools/ May 28 13:04:55 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-27c92e5f-9401-44fb-b09a-c9ea731c7b85 tempest-SharesActionsNegativeTest-299343130 None] {'allow_redirects': True, 'params': {'name': 'vippool-1'}} May 28 13:04:55 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-27c92e5f-9401-44fb-b09a-c9ea731c7b85 tempest-SharesActionsNegativeTest-299343130 None] <<< [GET] https://127.0.0.1:40443/api/vippools/ May 28 13:04:55 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-27c92e5f-9401-44fb-b09a-c9ea731c7b85 tempest-SharesActionsNegativeTest-299343130 None] [Bunch(active_cnode_ids=[], active_interfaces=4, cluster='loop75-kfs', cluster_id=1, cnode_ids=[], cnodes=[], domain_name='vippool-1', enable_l3=False, enable_weighted_balancing=False, enabled=True, end_ip='172.21.75.4', guid='f2abaede-b397-413a-8faa-3aeead6d3b28', gw_ip='', gw_ipv6='', id=2, ip_ranges=[['172.21.75.1', '172.21.75.4']], name='vippool-1', peer_asn=0, port_membership='ALL', ranges_summary='172.21.75.[1-4]', role='PROTOCOLS', start_ip='172.21.75.1', subnet_cidr=16, subnet_cidr_ipv6=None, sync='SYNCED', sync_time='2024-05-28T12:50:09.644123Z', tenant_id=1, tenant_name='default', title='172.21.75.1 - 172.21.75.4', url='https://127.0.0.1:40443/api/vippools/2/', vast_asn=0, vlan=0, vms_preferred=False)] May 28 13:04:55 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-27c92e5f-9401-44fb-b09a-c9ea731c7b85 tempest-SharesActionsNegativeTest-299343130 None] --- [GET] https://127.0.0.1:40443/api/vippools/: Done May 28 13:04:55 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-27c92e5f-9401-44fb-b09a-c9ea731c7b85 tempest-SharesActionsNegativeTest-299343130 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:04:55 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-27c92e5f-9401-44fb-b09a-c9ea731c7b85 tempest-SharesActionsNegativeTest-299343130 None] {'allow_redirects': True, May 28 13:04:55 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-27c92e5f-9401-44fb-b09a-c9ea731c7b85 tempest-SharesActionsNegativeTest-299343130 None] 'params': {'name': '288572fc-ff63-46d5-97ea-660a49f0f7ac'}} May 28 13:04:56 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 13:04:56 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.manager [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=83654) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10545}} May 28 13:04:56 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-27c92e5f-9401-44fb-b09a-c9ea731c7b85 tempest-SharesActionsNegativeTest-299343130 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:04:56 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-27c92e5f-9401-44fb-b09a-c9ea731c7b85 tempest-SharesActionsNegativeTest-299343130 None] [] May 28 13:04:56 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-27c92e5f-9401-44fb-b09a-c9ea731c7b85 tempest-SharesActionsNegativeTest-299343130 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 13:04:56 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-27c92e5f-9401-44fb-b09a-c9ea731c7b85 tempest-SharesActionsNegativeTest-299343130 None] >>> [POST] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:04:56 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-27c92e5f-9401-44fb-b09a-c9ea731c7b85 tempest-SharesActionsNegativeTest-299343130 None] {'data': '{"name": "288572fc-ff63-46d5-97ea-660a49f0f7ac"}', May 28 13:04:56 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-27c92e5f-9401-44fb-b09a-c9ea731c7b85 tempest-SharesActionsNegativeTest-299343130 None] 'json': None, May 28 13:04:56 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-27c92e5f-9401-44fb-b09a-c9ea731c7b85 tempest-SharesActionsNegativeTest-299343130 None] 'params': None} May 28 13:04:56 l75lg1-v1 dstat.sh[49771]: 28-05 13:04:56| 4 1 93 2 0|5521M 1891M 278M 7934M| 15k 7634B| 0 2958k| 0 489 |3602 5731 |1.14 1.08 1.04|1.0 0 0| 0 0 | 0 2048M| 29 359 0 14 6 May 28 13:04:56 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 13:04:56 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 13:04:56 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 13:04:56 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.manager [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Cleaning up deleted instances {{(pid=83654) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11226}} May 28 13:04:56 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Expecting reply to msg 247a08730a464be8b16238a5a236781f in queue reply_37f4cbd1dd094961a22b8a65f222c327 May 28 13:04:56 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [-] Received RPC response for msg 247a08730a464be8b16238a5a236781f May 28 13:04:57 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.manager [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] There are 0 instances to clean {{(pid=83654) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11235}} May 28 13:04:57 l75lg1-v1 dstat.sh[49771]: 28-05 13:04:57| 1 0 98 0 0|5521M 1891M 278M 7934M| 19k 0 | 0 224k| 0 18.0 |1870 2715 |1.14 1.08 1.04|1.0 0 0| 0 0 | 0 2048M| 29 359 0 14 6 May 28 13:04:57 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-27c92e5f-9401-44fb-b09a-c9ea731c7b85 tempest-SharesActionsNegativeTest-299343130 None] <<< [POST] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:04:57 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-27c92e5f-9401-44fb-b09a-c9ea731c7b85 tempest-SharesActionsNegativeTest-299343130 None] Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=0, created='2024-05-28T13:04:56.832343Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='dd1ec2e9-8c87-42ba-b319-d4b47e59d189', id=65, internal=False, is_s3_default_policy=False, name='288572fc-ff63-46d5-97ea-660a49f0f7ac', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=[], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['*'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['*'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T13:04:57.208428Z', tenant_id=1, tenant_name='default', title='288572fc-ff63-46d5-97ea-660a49f0f7ac', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/65/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[]) May 28 13:04:57 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-27c92e5f-9401-44fb-b09a-c9ea731c7b85 tempest-SharesActionsNegativeTest-299343130 None] --- [POST] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 13:04:57 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-27c92e5f-9401-44fb-b09a-c9ea731c7b85 tempest-SharesActionsNegativeTest-299343130 None] >>> [GET] https://127.0.0.1:40443/api/quotas/ May 28 13:04:57 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-27c92e5f-9401-44fb-b09a-c9ea731c7b85 tempest-SharesActionsNegativeTest-299343130 None] {'allow_redirects': True, May 28 13:04:57 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-27c92e5f-9401-44fb-b09a-c9ea731c7b85 tempest-SharesActionsNegativeTest-299343130 None] 'params': {'name': '288572fc-ff63-46d5-97ea-660a49f0f7ac'}} May 28 13:04:57 l75lg1-v1 neutron-server[77623]: DEBUG neutron.db.agents_db [None req-fe40ce8c-640e-4db7-a17a-6e8888cce266 None None] Agent healthcheck: found 0 active agents {{(pid=77623) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:319}} May 28 13:04:57 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-27c92e5f-9401-44fb-b09a-c9ea731c7b85 tempest-SharesActionsNegativeTest-299343130 None] <<< [GET] https://127.0.0.1:40443/api/quotas/ May 28 13:04:57 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-27c92e5f-9401-44fb-b09a-c9ea731c7b85 tempest-SharesActionsNegativeTest-299343130 None] [] May 28 13:04:57 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-27c92e5f-9401-44fb-b09a-c9ea731c7b85 tempest-SharesActionsNegativeTest-299343130 None] --- [GET] https://127.0.0.1:40443/api/quotas/: Done May 28 13:04:57 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-27c92e5f-9401-44fb-b09a-c9ea731c7b85 tempest-SharesActionsNegativeTest-299343130 None] >>> [POST] https://127.0.0.1:40443/api/quotas/ May 28 13:04:57 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-27c92e5f-9401-44fb-b09a-c9ea731c7b85 tempest-SharesActionsNegativeTest-299343130 None] {'data': '{"name": "288572fc-ff63-46d5-97ea-660a49f0f7ac", "path": ' May 28 13:04:57 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-27c92e5f-9401-44fb-b09a-c9ea731c7b85 tempest-SharesActionsNegativeTest-299343130 None] '"/manila/manila-288572fc-ff63-46d5-97ea-660a49f0f7ac", "create_dir": ' May 28 13:04:57 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-27c92e5f-9401-44fb-b09a-c9ea731c7b85 tempest-SharesActionsNegativeTest-299343130 None] 'true, "hard_limit": 1073741824}', May 28 13:04:57 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-27c92e5f-9401-44fb-b09a-c9ea731c7b85 tempest-SharesActionsNegativeTest-299343130 None] 'json': None, May 28 13:04:57 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-27c92e5f-9401-44fb-b09a-c9ea731c7b85 tempest-SharesActionsNegativeTest-299343130 None] 'params': None} May 28 13:04:58 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [-] Expecting reply to msg a0b19b359d6448fab1e2b58d2b9e6ad4 in queue reply_37f4cbd1dd094961a22b8a65f222c327 May 28 13:04:58 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [-] Received RPC response for msg a0b19b359d6448fab1e2b58d2b9e6ad4 May 28 13:04:58 l75lg1-v1 dstat.sh[49771]: 28-05 13:04:58| 1 0 98 0 0|5521M 1891M 278M 7934M| 16k 1668B| 0 268k| 0 30.0 |1885 2984 |1.13 1.08 1.04| 0 0 2.0| 0 0 | 0 2048M| 29 359 0 14 6 May 28 13:04:58 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-27c92e5f-9401-44fb-b09a-c9ea731c7b85 tempest-SharesActionsNegativeTest-299343130 None] <<< [POST] https://127.0.0.1:40443/api/quotas/ May 28 13:04:58 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-27c92e5f-9401-44fb-b09a-c9ea731c7b85 tempest-SharesActionsNegativeTest-299343130 None] Bunch(cluster='loop75-kfs', cluster_id=1, default_email=None, default_group_quota=None, default_user_quota=None, enable_alarms=True, enable_email_providers=True, grace_period=None, group_quotas=[], guid='eeeb7799-e71d-49e5-b126-82171ef468c3', hard_limit=1073741824, hard_limit_inodes=None, id=62, internal=False, is_user_quota=False, last_user_quotas_update=None, name='288572fc-ff63-46d5-97ea-660a49f0f7ac', num_blocked_users=0, num_exceeded_users=0, path='/manila/manila-288572fc-ff63-46d5-97ea-660a49f0f7ac', percent_capacity=0, percent_inodes=None, pretty_grace_period=None, pretty_grace_period_expiration=None, pretty_state='OK (CREATED)', soft_limit=None, soft_limit_inodes=None, state='OK', sync_state='CREATED', system_id=62, tenant_id=1, tenant_name='default', time_to_block=None, title='288572fc-ff63-46d5-97ea-660a49f0f7ac', url='https://127.0.0.1:40443/api/quotas/62/', used_capacity=0, used_capacity_tb=0.0, used_effective_capacity=0, used_effective_capacity_tb=0.0, used_inodes=0, used_limited_capacity=0, user_quotas=[]) May 28 13:04:58 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-27c92e5f-9401-44fb-b09a-c9ea731c7b85 tempest-SharesActionsNegativeTest-299343130 None] --- [POST] https://127.0.0.1:40443/api/quotas/: Done May 28 13:04:58 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-27c92e5f-9401-44fb-b09a-c9ea731c7b85 tempest-SharesActionsNegativeTest-299343130 None] >>> [GET] https://127.0.0.1:40443/api/views/ May 28 13:04:58 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-27c92e5f-9401-44fb-b09a-c9ea731c7b85 tempest-SharesActionsNegativeTest-299343130 None] {'allow_redirects': True, May 28 13:04:58 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-27c92e5f-9401-44fb-b09a-c9ea731c7b85 tempest-SharesActionsNegativeTest-299343130 None] 'params': {'name': '288572fc-ff63-46d5-97ea-660a49f0f7ac'}} May 28 13:04:58 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-85272736-4660-454a-ab3f-54b6c5d0b114 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] GET http://10.27.203.238/share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares/c78ca6e2-e1f4-4196-a66f-6160ac6acb49 May 28 13:04:58 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-85272736-4660-454a-ab3f-54b6c5d0b114 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:04:58 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-85272736-4660-454a-ab3f-54b6c5d0b114 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:04:58 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-85272736-4660-454a-ab3f-54b6c5d0b114 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] http://10.27.203.238/share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares/c78ca6e2-e1f4-4196-a66f-6160ac6acb49 returned with HTTP 200 May 28 13:04:58 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1364/2748] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:04:58 2024] GET /share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares/c78ca6e2-e1f4-4196-a66f-6160ac6acb49 => generated 1314 bytes in 25 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:04:59 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-27c92e5f-9401-44fb-b09a-c9ea731c7b85 tempest-SharesActionsNegativeTest-299343130 None] <<< [GET] https://127.0.0.1:40443/api/views/ May 28 13:04:59 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-27c92e5f-9401-44fb-b09a-c9ea731c7b85 tempest-SharesActionsNegativeTest-299343130 None] [] May 28 13:04:59 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-27c92e5f-9401-44fb-b09a-c9ea731c7b85 tempest-SharesActionsNegativeTest-299343130 None] --- [GET] https://127.0.0.1:40443/api/views/: Done May 28 13:04:59 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-27c92e5f-9401-44fb-b09a-c9ea731c7b85 tempest-SharesActionsNegativeTest-299343130 None] >>> [POST] https://127.0.0.1:40443/api/views/ May 28 13:04:59 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-27c92e5f-9401-44fb-b09a-c9ea731c7b85 tempest-SharesActionsNegativeTest-299343130 None] {'data': '{"name": "288572fc-ff63-46d5-97ea-660a49f0f7ac", "path": ' May 28 13:04:59 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-27c92e5f-9401-44fb-b09a-c9ea731c7b85 tempest-SharesActionsNegativeTest-299343130 None] '"/manila/manila-288572fc-ff63-46d5-97ea-660a49f0f7ac", "policy_id": ' May 28 13:04:59 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-27c92e5f-9401-44fb-b09a-c9ea731c7b85 tempest-SharesActionsNegativeTest-299343130 None] '65, "create_dir": true, "protocols": ["NFS"]}', May 28 13:04:59 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-27c92e5f-9401-44fb-b09a-c9ea731c7b85 tempest-SharesActionsNegativeTest-299343130 None] 'json': None, May 28 13:04:59 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-27c92e5f-9401-44fb-b09a-c9ea731c7b85 tempest-SharesActionsNegativeTest-299343130 None] 'params': None} May 28 13:04:59 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 13:04:59 l75lg1-v1 dstat.sh[49771]: 28-05 13:04:59| 1 0 98 0 0|5521M 1891M 278M 7934M| 18k 1676B| 0 320k| 0 44.0 |1739 2536 |1.13 1.08 1.04| 0 0 0| 0 0 | 0 2048M| 29 359 0 14 6 May 28 13:04:59 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 13:04:59 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.manager [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Starting heal instance info cache {{(pid=83654) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}} May 28 13:04:59 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.manager [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Rebuilding the list of instances to heal {{(pid=83654) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9930}} May 28 13:04:59 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Expecting reply to msg d10bce3cff134deaa20848ec7a1156a6 in queue reply_37f4cbd1dd094961a22b8a65f222c327 May 28 13:04:59 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [-] Received RPC response for msg d10bce3cff134deaa20848ec7a1156a6 May 28 13:04:59 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-27c92e5f-9401-44fb-b09a-c9ea731c7b85 tempest-SharesActionsNegativeTest-299343130 None] <<< [POST] https://127.0.0.1:40443/api/views/ May 28 13:04:59 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-27c92e5f-9401-44fb-b09a-c9ea731c7b85 tempest-SharesActionsNegativeTest-299343130 None] Bunch(abac_tags=[], abe_max_depth=None, abe_protocols=[], alias='', allow_anonymous_access=False, allow_s3_anonymous_access=False, auto_commit='0d', bucket='', bucket_creators=[], bucket_creators_groups=[], bucket_owner=None, bulk_permission_update_progress=None, bulk_permission_update_state=None, cluster='loop75-kfs', cluster_id=1, created='2024-05-28T13:04:59.430384Z', enabled=True, files_retention_mode='NONE', guid='4357d439-669d-43c3-9d6c-ad783ab1ce69', id=64, ignore_oos=False, internal=False, is_remote=False, is_seamless=False, logical_capacity=0, max_retention_period=None, min_retention_period=None, name='288572fc-ff63-46d5-97ea-660a49f0f7ac', nfs_interop_flags='BOTH_NFS3_AND_NFS4_INTEROP_DISABLED', path='/manila/manila-288572fc-ff63-46d5-97ea-660a49f0f7ac', physical_capacity=0, policy='288572fc-ff63-46d5-97ea-660a49f0f7ac', policy_id=65, protocols=['NFS'], qos_policy=None, qos_policy_id=None, s3_locks=False, s3_locks_retention_mode='NONE', s3_locks_retention_period='', s3_object_ownership_rule='ObjectWriter', s3_unverified_lookup=False, s3_versioning=False, select_for_live_monitoring=False, share='', share_acl=Bunch(acl=[], enabled=False), sync='SYNCED', sync_time='2024-05-28T13:04:59.679738Z', tenant_id=1, tenant_name='default', title='/manila/manila-288572fc-ff63-46d5-97ea-660a49f0f7ac', url='https://127.0.0.1:40443/api/views/64/') May 28 13:04:59 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-27c92e5f-9401-44fb-b09a-c9ea731c7b85 tempest-SharesActionsNegativeTest-299343130 None] --- [POST] https://127.0.0.1:40443/api/views/: Done May 28 13:04:59 l75lg1-v1 manila-share[98474]: INFO manila.share.manager [None req-27c92e5f-9401-44fb-b09a-c9ea731c7b85 tempest-SharesActionsNegativeTest-299343130 None] Share instance 288572fc-ff63-46d5-97ea-660a49f0f7ac created successfully. May 28 13:05:00 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.manager [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Didn't find any instances for network info cache update. {{(pid=83654) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10012}} May 28 13:05:00 l75lg1-v1 dstat.sh[49771]: 28-05 13:05:00| 1 0 98 0 0|5521M 1891M 278M 7934M| 23k 66B| 0 444k| 0 59.0 |2188 3278 |1.13 1.08 1.04| 0 0 0| 0 0 | 0 2048M| 29 359 0 14 6 May 28 13:05:00 l75lg1-v1 neutron-server[77618]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.HashRingHealthCheckPeriodics.touch_hash_ring_nodes' {{(pid=77618) _process_scheduled /opt/stack/data/venv/lib/python3.10/site-packages/futurist/periodics.py:638}} May 28 13:05:01 l75lg1-v1 dstat.sh[49771]: 28-05 13:05:01| 0 0 99 1 0|5521M 1891M 278M 7934M| 14k 0 | 0 356k| 0 45.0 |1967 3235 |1.13 1.08 1.04|1.0 0 0| 0 0 | 0 2048M| 29 359 0 14 6 May 28 13:05:01 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-97e7cd93-632e-4f4d-a1e6-79cec6fd114a tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] GET http://10.27.203.238/share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares/c78ca6e2-e1f4-4196-a66f-6160ac6acb49 May 28 13:05:01 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-97e7cd93-632e-4f4d-a1e6-79cec6fd114a tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:05:01 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-97e7cd93-632e-4f4d-a1e6-79cec6fd114a tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:05:01 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-97e7cd93-632e-4f4d-a1e6-79cec6fd114a tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] http://10.27.203.238/share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares/c78ca6e2-e1f4-4196-a66f-6160ac6acb49 returned with HTTP 200 May 28 13:05:01 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1385/2749] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:05:01 2024] GET /share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares/c78ca6e2-e1f4-4196-a66f-6160ac6acb49 => generated 1317 bytes in 24 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:05:01 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-19d00757-bda6-4491-bbe1-37c6135c3c67 tempest-SharesActionsNegativeTest-874588647 tempest-SharesActionsNegativeTest-874588647-project-member] POST http://10.27.203.238/share/v2/0458d53d773c434eafc80da00cf6604a/shares/c78ca6e2-e1f4-4196-a66f-6160ac6acb49/action May 28 13:05:01 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-19d00757-bda6-4491-bbe1-37c6135c3c67 tempest-SharesActionsNegativeTest-874588647 tempest-SharesActionsNegativeTest-874588647-project-member] Action body: b'{"soft_delete": null}' {{(pid=98330) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 13:05:01 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-19d00757-bda6-4491-bbe1-37c6135c3c67 tempest-SharesActionsNegativeTest-874588647 tempest-SharesActionsNegativeTest-874588647-project-member] Action: 'action', calling method: Controller.__getattribute__..version_select, body: {"soft_delete": null} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:05:01 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.v2.shares [None req-19d00757-bda6-4491-bbe1-37c6135c3c67 tempest-SharesActionsNegativeTest-874588647 tempest-SharesActionsNegativeTest-874588647-project-member] Soft delete share with id: c78ca6e2-e1f4-4196-a66f-6160ac6acb49 {{(pid=98330) share_soft_delete /opt/stack/manila/manila/api/v2/shares.py:280}} May 28 13:05:01 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-19d00757-bda6-4491-bbe1-37c6135c3c67 tempest-SharesActionsNegativeTest-874588647 tempest-SharesActionsNegativeTest-874588647-project-member] HTTP exception thrown: The resource could not be found. May 28 13:05:01 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-19d00757-bda6-4491-bbe1-37c6135c3c67 tempest-SharesActionsNegativeTest-874588647 tempest-SharesActionsNegativeTest-874588647-project-member] http://10.27.203.238/share/v2/0458d53d773c434eafc80da00cf6604a/shares/c78ca6e2-e1f4-4196-a66f-6160ac6acb49/action returned with HTTP 404 May 28 13:05:01 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1365/2750] 10.27.203.238 () {66 vars in 1493 bytes} [Tue May 28 13:05:01 2024] POST /share/v2/0458d53d773c434eafc80da00cf6604a/shares/c78ca6e2-e1f4-4196-a66f-6160ac6acb49/action => generated 78 bytes in 23 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 13:05:01 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-9081665d-3697-4608-a5d9-e88fb0b72da2 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] GET http://10.27.203.238/share/v2/c39deaad5eb341ceb2e3c79518f56a1b/share-replicas/detail?share_id=c78ca6e2-e1f4-4196-a66f-6160ac6acb49 May 28 13:05:01 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-9081665d-3697-4608-a5d9-e88fb0b72da2 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:05:01 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-9081665d-3697-4608-a5d9-e88fb0b72da2 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:05:01 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-9081665d-3697-4608-a5d9-e88fb0b72da2 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] http://10.27.203.238/share/v2/c39deaad5eb341ceb2e3c79518f56a1b/share-replicas/detail?share_id=c78ca6e2-e1f4-4196-a66f-6160ac6acb49 returned with HTTP 200 May 28 13:05:01 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1386/2751] 10.27.203.238 () {64 vars in 1476 bytes} [Tue May 28 13:05:01 2024] GET /share/v2/c39deaad5eb341ceb2e3c79518f56a1b/share-replicas/detail?share_id=c78ca6e2-e1f4-4196-a66f-6160ac6acb49 => generated 22 bytes in 12 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:05:01 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-abe97ae2-2afd-4e69-b0f4-e90d46c23bc3 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] DELETE http://10.27.203.238/share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares/c78ca6e2-e1f4-4196-a66f-6160ac6acb49 May 28 13:05:01 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-abe97ae2-2afd-4e69-b0f4-e90d46c23bc3 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:05:01 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-abe97ae2-2afd-4e69-b0f4-e90d46c23bc3 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Calling method 'ShareMixin.delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:05:01 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.v1.shares [None req-abe97ae2-2afd-4e69-b0f4-e90d46c23bc3 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Delete share with id: c78ca6e2-e1f4-4196-a66f-6160ac6acb49 May 28 13:05:01 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-abe97ae2-2afd-4e69-b0f4-e90d46c23bc3 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] http://10.27.203.238/share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares/c78ca6e2-e1f4-4196-a66f-6160ac6acb49 returned with HTTP 202 May 28 13:05:01 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1366/2752] 10.27.203.238 () {64 vars in 1454 bytes} [Tue May 28 13:05:01 2024] DELETE /share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares/c78ca6e2-e1f4-4196-a66f-6160ac6acb49 => generated 0 bytes in 114 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 13:05:01 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-fdbf6a92-4396-47bd-81ca-d42e667f57dc tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] GET http://10.27.203.238/share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares/c78ca6e2-e1f4-4196-a66f-6160ac6acb49 May 28 13:05:01 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-fdbf6a92-4396-47bd-81ca-d42e667f57dc tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:05:01 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-fdbf6a92-4396-47bd-81ca-d42e667f57dc tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:05:01 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-fdbf6a92-4396-47bd-81ca-d42e667f57dc tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] http://10.27.203.238/share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares/c78ca6e2-e1f4-4196-a66f-6160ac6acb49 returned with HTTP 200 May 28 13:05:01 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1387/2753] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:05:01 2024] GET /share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares/c78ca6e2-e1f4-4196-a66f-6160ac6acb49 => generated 1316 bytes in 30 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:05:01 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-abe97ae2-2afd-4e69-b0f4-e90d46c23bc3 tempest-SharesActionsNegativeTest-299343130 None] Acquiring lock "locked_access_rules_operation_by_share_instance_288572fc-ff63-46d5-97ea-660a49f0f7ac" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:05:01 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-abe97ae2-2afd-4e69-b0f4-e90d46c23bc3 tempest-SharesActionsNegativeTest-299343130 None] Lock "locked_access_rules_operation_by_share_instance_288572fc-ff63-46d5-97ea-660a49f0f7ac" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:05:01 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-abe97ae2-2afd-4e69-b0f4-e90d46c23bc3 tempest-SharesActionsNegativeTest-299343130 None] Lock "locked_access_rules_operation_by_share_instance_288572fc-ff63-46d5-97ea-660a49f0f7ac" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:05:01 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-abe97ae2-2afd-4e69-b0f4-e90d46c23bc3 tempest-SharesActionsNegativeTest-299343130 None] Acquiring lock "locked_access_rules_operation_by_share_instance_288572fc-ff63-46d5-97ea-660a49f0f7ac" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:05:01 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-abe97ae2-2afd-4e69-b0f4-e90d46c23bc3 tempest-SharesActionsNegativeTest-299343130 None] Lock "locked_access_rules_operation_by_share_instance_288572fc-ff63-46d5-97ea-660a49f0f7ac" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:05:01 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-abe97ae2-2afd-4e69-b0f4-e90d46c23bc3 tempest-SharesActionsNegativeTest-299343130 None] Lock "locked_access_rules_operation_by_share_instance_288572fc-ff63-46d5-97ea-660a49f0f7ac" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:05:01 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-abe97ae2-2afd-4e69-b0f4-e90d46c23bc3 tempest-SharesActionsNegativeTest-299343130 None] Acquiring lock "locked_access_rules_operation_by_share_instance_288572fc-ff63-46d5-97ea-660a49f0f7ac" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:05:01 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-abe97ae2-2afd-4e69-b0f4-e90d46c23bc3 tempest-SharesActionsNegativeTest-299343130 None] Lock "locked_access_rules_operation_by_share_instance_288572fc-ff63-46d5-97ea-660a49f0f7ac" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:05:01 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-abe97ae2-2afd-4e69-b0f4-e90d46c23bc3 tempest-SharesActionsNegativeTest-299343130 None] Lock "locked_access_rules_operation_by_share_instance_288572fc-ff63-46d5-97ea-660a49f0f7ac" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:05:01 l75lg1-v1 manila-share[98474]: DEBUG manila.share.access [None req-abe97ae2-2afd-4e69-b0f4-e90d46c23bc3 tempest-SharesActionsNegativeTest-299343130 None] All access rules have been synced for share instance 288572fc-ff63-46d5-97ea-660a49f0f7ac belonging to share c78ca6e2-e1f4-4196-a66f-6160ac6acb49. {{(pid=98474) update_access_rules /opt/stack/manila/manila/share/access.py:304}} May 28 13:05:01 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-abe97ae2-2afd-4e69-b0f4-e90d46c23bc3 tempest-SharesActionsNegativeTest-299343130 None] deleting '/manila/manila-288572fc-ff63-46d5-97ea-660a49f0f7ac' May 28 13:05:01 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-abe97ae2-2afd-4e69-b0f4-e90d46c23bc3 tempest-SharesActionsNegativeTest-299343130 None] >>> [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/ May 28 13:05:01 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-abe97ae2-2afd-4e69-b0f4-e90d46c23bc3 tempest-SharesActionsNegativeTest-299343130 None] {'data': '{"path": "/manila/manila-288572fc-ff63-46d5-97ea-660a49f0f7ac"}', May 28 13:05:01 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-abe97ae2-2afd-4e69-b0f4-e90d46c23bc3 tempest-SharesActionsNegativeTest-299343130 None] 'params': None} May 28 13:05:01 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-abe97ae2-2afd-4e69-b0f4-e90d46c23bc3 tempest-SharesActionsNegativeTest-299343130 None] <<< [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/ May 28 13:05:01 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-abe97ae2-2afd-4e69-b0f4-e90d46c23bc3 tempest-SharesActionsNegativeTest-299343130 None] 'OK' May 28 13:05:01 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-abe97ae2-2afd-4e69-b0f4-e90d46c23bc3 tempest-SharesActionsNegativeTest-299343130 None] --- [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/: Done May 28 13:05:01 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-abe97ae2-2afd-4e69-b0f4-e90d46c23bc3 tempest-SharesActionsNegativeTest-299343130 None] >>> [GET] https://127.0.0.1:40443/api/views/ May 28 13:05:01 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-abe97ae2-2afd-4e69-b0f4-e90d46c23bc3 tempest-SharesActionsNegativeTest-299343130 None] {'allow_redirects': True, May 28 13:05:01 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-abe97ae2-2afd-4e69-b0f4-e90d46c23bc3 tempest-SharesActionsNegativeTest-299343130 None] 'params': {'name': '288572fc-ff63-46d5-97ea-660a49f0f7ac'}} May 28 13:05:02 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 13:05:02 l75lg1-v1 dstat.sh[49771]: 28-05 13:05:02| 4 0 95 0 0|5522M 1890M 278M 7934M| 17k 1522B| 0 600k| 0 69.0 |2957 4610 |1.13 1.08 1.04|1.0 0 3.0| 0 0 | 0 2048M| 29 359 0 14 6 May 28 13:05:02 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-abe97ae2-2afd-4e69-b0f4-e90d46c23bc3 tempest-SharesActionsNegativeTest-299343130 None] <<< [GET] https://127.0.0.1:40443/api/views/ May 28 13:05:02 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-abe97ae2-2afd-4e69-b0f4-e90d46c23bc3 tempest-SharesActionsNegativeTest-299343130 None] [Bunch(abac_tags=[], abe_max_depth=None, abe_protocols=[], alias='', allow_anonymous_access=False, allow_s3_anonymous_access=False, auto_commit='0d', bucket='', bucket_creators=[], bucket_creators_groups=[], bucket_owner=None, bulk_permission_update_progress=None, bulk_permission_update_state=None, cluster='loop75-kfs', cluster_id=1, created='2024-05-28T13:04:59.430384Z', enabled=True, files_retention_mode='NONE', guid='4357d439-669d-43c3-9d6c-ad783ab1ce69', id=64, ignore_oos=False, internal=False, is_remote=False, is_seamless=False, logical_capacity=0, max_retention_period=None, min_retention_period=None, name='288572fc-ff63-46d5-97ea-660a49f0f7ac', nfs_interop_flags='BOTH_NFS3_AND_NFS4_INTEROP_DISABLED', path='/manila/manila-288572fc-ff63-46d5-97ea-660a49f0f7ac', physical_capacity=0, policy='288572fc-ff63-46d5-97ea-660a49f0f7ac', policy_id=65, protocols=['NFS'], qos_policy=None, qos_policy_id=None, s3_locks=False, s3_locks_retention_mode='NONE', s3_locks_retention_period='', s3_unverified_lookup=False, s3_versioning=False, select_for_live_monitoring=False, share='', share_acl=Bunch(acl=[], enabled=False), sync='SYNCED', sync_time='2024-05-28T13:04:59.679738Z', tenant_id=1, tenant_name='default', title='/manila/manila-288572fc-ff63-46d5-97ea-660a49f0f7ac', url='https://127.0.0.1:40443/api/views/64/')] May 28 13:05:02 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-abe97ae2-2afd-4e69-b0f4-e90d46c23bc3 tempest-SharesActionsNegativeTest-299343130 None] --- [GET] https://127.0.0.1:40443/api/views/: Done May 28 13:05:02 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-abe97ae2-2afd-4e69-b0f4-e90d46c23bc3 tempest-SharesActionsNegativeTest-299343130 None] >>> [DELETE] https://127.0.0.1:40443/api/views/64/ May 28 13:05:02 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager.update_available_resource {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 13:05:02 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Expecting reply to msg 301cdc46e4354ebe8ec03c7aa66f9a55 in queue reply_37f4cbd1dd094961a22b8a65f222c327 May 28 13:05:02 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [-] Received RPC response for msg 301cdc46e4354ebe8ec03c7aa66f9a55 May 28 13:05:03 l75lg1-v1 nova-compute[83654]: DEBUG oslo_concurrency.lockutils [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=83654) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:05:03 l75lg1-v1 nova-compute[83654]: DEBUG oslo_concurrency.lockutils [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=83654) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:05:03 l75lg1-v1 nova-compute[83654]: DEBUG oslo_concurrency.lockutils [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=83654) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:05:03 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.resource_tracker [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Auditing locally available compute resources for l75lg1-v1 (node: l75lg1-v1) {{(pid=83654) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}} May 28 13:05:03 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.resource_tracker [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Hypervisor/Node resource view: name=l75lg1-v1 free_ram=10100MB free_disk=15.536964416503906GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_01_1", "address": "0000:00:01.1", "product_id": "7010", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7010", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7000", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7000", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "0100", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_0100", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_09_0", "address": "0000:00:09.0", "product_id": "1001", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1001", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "293a", "vendor_id": "8086", "numa_node": null, "label": "label_8086_293a", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_2", "address": "0000:00:07.2", "product_id": "2936", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2936", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "1237", "vendor_id": "8086", "numa_node": null, "label": "label_8086_1237", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "2935", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2935", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "2934", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2934", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_05_0", "address": "0000:00:05.0", "product_id": "1000", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1000", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "1000", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1000", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_06_0", "address": "0000:00:06.0", "product_id": "2668", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2668", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "1000", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1000", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0a_0", "address": "0000:00:0a.0", "product_id": "1002", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1002", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_3", "address": "0000:00:01.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_08_0", "address": "0000:00:08.0", "product_id": "1003", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1003", "dev_type": "type-PCI"}] {{(pid=83654) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}} May 28 13:05:03 l75lg1-v1 nova-compute[83654]: DEBUG oslo_concurrency.lockutils [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=83654) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:05:03 l75lg1-v1 nova-compute[83654]: DEBUG oslo_concurrency.lockutils [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=83654) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:05:03 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Expecting reply to msg 900781ab7f1f4a9aa45125e8c67cb820 in queue reply_37f4cbd1dd094961a22b8a65f222c327 May 28 13:05:03 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [-] Received RPC response for msg 900781ab7f1f4a9aa45125e8c67cb820 May 28 13:05:03 l75lg1-v1 dstat.sh[49771]: 28-05 13:05:03| 2 1 96 1 0|5523M 1889M 278M 7934M| 19k 818B| 0 1692k| 0 327 |3789 6399 |1.12 1.08 1.04|1.0 0 2.0| 0 0 | 0 2048M| 29 359 0 14 6 May 28 13:05:03 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Expecting reply to msg 793516bc5f194d389b0a474d448e3ec2 in queue reply_37f4cbd1dd094961a22b8a65f222c327 May 28 13:05:03 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [-] Received RPC response for msg 793516bc5f194d389b0a474d448e3ec2 May 28 13:05:04 l75lg1-v1 devstack@placement-api.service[78202]: DEBUG placement.requestlog [req-4e3021db-c2f7-4319-8834-933275579177 req-27c8d126-ac5c-4001-84e6-2c23d29b5981 None None] Starting request: 10.27.203.238 "GET /placement/resource_providers/ef90d7d1-0808-4a15-ad77-f9a7391af2f4/allocations" {{(pid=78202) __call__ /opt/stack/placement/placement/requestlog.py:55}} May 28 13:05:04 l75lg1-v1 devstack@placement-api.service[78202]: INFO placement.requestlog [req-4e3021db-c2f7-4319-8834-933275579177 req-27c8d126-ac5c-4001-84e6-2c23d29b5981 service placement] 10.27.203.238 "GET /placement/resource_providers/ef90d7d1-0808-4a15-ad77-f9a7391af2f4/allocations" status: 200 len: 54 microversion: 1.0 May 28 13:05:04 l75lg1-v1 devstack@placement-api.service[78202]: [pid: 78202|app: 0|req: 32/63] 10.27.203.238 () {62 vars in 1480 bytes} [Tue May 28 13:05:04 2024] GET /placement/resource_providers/ef90d7d1-0808-4a15-ad77-f9a7391af2f4/allocations => generated 54 bytes in 12 msecs (HTTP/1.1 200) 6 headers in 223 bytes (1 switches on core 0) May 28 13:05:04 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.resource_tracker [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Total usable vcpus: 10, total allocated vcpus: 0 {{(pid=83654) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}} May 28 13:05:04 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.resource_tracker [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Final resource view: name=l75lg1-v1 phys_ram=16000MB used_ram=512MB phys_disk=28GB used_disk=0GB total_vcpus=10 used_vcpus=0 pci_stats=[] {{(pid=83654) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}} May 28 13:05:04 l75lg1-v1 devstack@placement-api.service[78201]: DEBUG placement.requestlog [req-4e3021db-c2f7-4319-8834-933275579177 req-7440969b-8bd3-4094-813b-73d6c0c95c21 None None] Starting request: 10.27.203.238 "GET /placement/resource_providers/ef90d7d1-0808-4a15-ad77-f9a7391af2f4/allocations" {{(pid=78201) __call__ /opt/stack/placement/placement/requestlog.py:55}} May 28 13:05:04 l75lg1-v1 devstack@placement-api.service[78201]: INFO placement.requestlog [req-4e3021db-c2f7-4319-8834-933275579177 req-7440969b-8bd3-4094-813b-73d6c0c95c21 service placement] 10.27.203.238 "GET /placement/resource_providers/ef90d7d1-0808-4a15-ad77-f9a7391af2f4/allocations" status: 200 len: 54 microversion: 1.0 May 28 13:05:04 l75lg1-v1 devstack@placement-api.service[78201]: [pid: 78201|app: 0|req: 32/64] 10.27.203.238 () {62 vars in 1480 bytes} [Tue May 28 13:05:04 2024] GET /placement/resource_providers/ef90d7d1-0808-4a15-ad77-f9a7391af2f4/allocations => generated 54 bytes in 12 msecs (HTTP/1.1 200) 6 headers in 223 bytes (1 switches on core 0) May 28 13:05:04 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.provider_tree [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Inventory has not changed in ProviderTree for provider: ef90d7d1-0808-4a15-ad77-f9a7391af2f4 {{(pid=83654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} May 28 13:05:04 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Expecting reply to msg e109a0b13788451599c3487dc7c8e7e5 in queue reply_37f4cbd1dd094961a22b8a65f222c327 May 28 13:05:04 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [-] Received RPC response for msg e109a0b13788451599c3487dc7c8e7e5 May 28 13:05:04 l75lg1-v1 dstat.sh[49771]: 28-05 13:05:04| 1 0 98 0 0|5523M 1889M 278M 7934M| 19k 0 | 0 252k| 0 16.0 |1847 2765 |1.12 1.08 1.04|2.0 0 0| 0 0 | 0 2048M| 29 359 0 16 6 May 28 13:05:04 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-abe97ae2-2afd-4e69-b0f4-e90d46c23bc3 tempest-SharesActionsNegativeTest-299343130 None] <<< [DELETE] https://127.0.0.1:40443/api/views/64/ May 28 13:05:04 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-abe97ae2-2afd-4e69-b0f4-e90d46c23bc3 tempest-SharesActionsNegativeTest-299343130 None] --- [DELETE] https://127.0.0.1:40443/api/views/64/: Done May 28 13:05:04 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-abe97ae2-2afd-4e69-b0f4-e90d46c23bc3 tempest-SharesActionsNegativeTest-299343130 None] >>> [GET] https://127.0.0.1:40443/api/quotas/ May 28 13:05:04 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-abe97ae2-2afd-4e69-b0f4-e90d46c23bc3 tempest-SharesActionsNegativeTest-299343130 None] {'allow_redirects': True, May 28 13:05:04 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-abe97ae2-2afd-4e69-b0f4-e90d46c23bc3 tempest-SharesActionsNegativeTest-299343130 None] 'params': {'name': '288572fc-ff63-46d5-97ea-660a49f0f7ac'}} May 28 13:05:04 l75lg1-v1 nova-compute[83654]: DEBUG nova.scheduler.client.report [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Inventory has not changed for provider ef90d7d1-0808-4a15-ad77-f9a7391af2f4 based on inventory data: {'VCPU': {'total': 10, 'reserved': 0, 'min_unit': 1, 'max_unit': 10, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16000, 'reserved': 512, 'min_unit': 1, 'max_unit': 16000, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 28, 'reserved': 0, 'min_unit': 1, 'max_unit': 28, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=83654) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}} May 28 13:05:04 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.resource_tracker [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Compute_service record updated for l75lg1-v1:l75lg1-v1 {{(pid=83654) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}} May 28 13:05:04 l75lg1-v1 nova-compute[83654]: DEBUG oslo_concurrency.lockutils [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.554s {{(pid=83654) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:05:04 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-0fa3f9b9-49e9-4248-964c-3eb8e97ca01b tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] GET http://10.27.203.238/share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares/c78ca6e2-e1f4-4196-a66f-6160ac6acb49 May 28 13:05:04 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-0fa3f9b9-49e9-4248-964c-3eb8e97ca01b tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:05:04 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-0fa3f9b9-49e9-4248-964c-3eb8e97ca01b tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:05:04 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-0fa3f9b9-49e9-4248-964c-3eb8e97ca01b tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] http://10.27.203.238/share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares/c78ca6e2-e1f4-4196-a66f-6160ac6acb49 returned with HTTP 200 May 28 13:05:04 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1367/2754] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:05:04 2024] GET /share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares/c78ca6e2-e1f4-4196-a66f-6160ac6acb49 => generated 1316 bytes in 25 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:05:05 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-abe97ae2-2afd-4e69-b0f4-e90d46c23bc3 tempest-SharesActionsNegativeTest-299343130 None] <<< [GET] https://127.0.0.1:40443/api/quotas/ May 28 13:05:05 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-abe97ae2-2afd-4e69-b0f4-e90d46c23bc3 tempest-SharesActionsNegativeTest-299343130 None] [Bunch(cluster='loop75-kfs', cluster_id=1, default_email=None, default_group_quota=None, default_user_quota=None, enable_alarms=True, enable_email_providers=True, grace_period=None, guid='eeeb7799-e71d-49e5-b126-82171ef468c3', hard_limit=1073741824, hard_limit_inodes=None, id=62, internal=False, is_user_quota=False, last_user_quotas_update=None, name='288572fc-ff63-46d5-97ea-660a49f0f7ac', num_blocked_users=0, num_exceeded_users=0, path='/manila/manila-288572fc-ff63-46d5-97ea-660a49f0f7ac', percent_capacity=0, percent_inodes=None, pretty_grace_period=None, pretty_grace_period_expiration=None, pretty_state='OK (CREATED)', soft_limit=None, soft_limit_inodes=None, state='OK', sync_state='CREATED', system_id=62, tenant_id=1, tenant_name='default', time_to_block=None, title='288572fc-ff63-46d5-97ea-660a49f0f7ac', url='https://127.0.0.1:40443/api/quotas/62/', used_capacity=0, used_capacity_tb=0.0, used_effective_capacity=0, used_effective_capacity_tb=0.0, used_inodes=0, used_limited_capacity=0)] May 28 13:05:05 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-abe97ae2-2afd-4e69-b0f4-e90d46c23bc3 tempest-SharesActionsNegativeTest-299343130 None] --- [GET] https://127.0.0.1:40443/api/quotas/: Done May 28 13:05:05 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-abe97ae2-2afd-4e69-b0f4-e90d46c23bc3 tempest-SharesActionsNegativeTest-299343130 None] >>> [DELETE] https://127.0.0.1:40443/api/quotas/62/ May 28 13:05:05 l75lg1-v1 dstat.sh[49771]: 28-05 13:05:05| 1 0 98 0 0|5523M 1889M 278M 7934M| 16k 2508B| 0 0 | 0 0 |1720 2522 |1.12 1.08 1.04|1.0 0 0| 0 0 | 0 2048M| 29 359 0 16 6 May 28 13:05:06 l75lg1-v1 dstat.sh[49771]: 28-05 13:05:06| 1 0 99 0 0|5523M 1889M 278M 7934M| 20k 0 | 0 588k| 0 124 |1697 2496 |1.12 1.08 1.04|1.0 0 0| 0 0 | 0 2048M| 29 359 0 16 6 May 28 13:05:06 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 13:05:06 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 13:05:06 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.manager [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Cleaning up deleted instances with incomplete migration {{(pid=83654) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11264}} May 28 13:05:06 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Expecting reply to msg 02afe1b5df7c4ac8a42778b6289fb3d4 in queue reply_37f4cbd1dd094961a22b8a65f222c327 May 28 13:05:06 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [-] Received RPC response for msg 02afe1b5df7c4ac8a42778b6289fb3d4 May 28 13:05:07 l75lg1-v1 dstat.sh[49771]: 28-05 13:05:07| 1 0 99 0 0|5523M 1889M 278M 7934M| 15k 0 | 0 8192B| 0 1.00 |1590 2448 |1.12 1.08 1.04|1.0 0 0| 0 0 | 0 2048M| 29 359 0 16 6 May 28 13:05:07 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-abe97ae2-2afd-4e69-b0f4-e90d46c23bc3 tempest-SharesActionsNegativeTest-299343130 None] <<< [DELETE] https://127.0.0.1:40443/api/quotas/62/ May 28 13:05:07 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-abe97ae2-2afd-4e69-b0f4-e90d46c23bc3 tempest-SharesActionsNegativeTest-299343130 None] --- [DELETE] https://127.0.0.1:40443/api/quotas/62/: Done May 28 13:05:07 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-abe97ae2-2afd-4e69-b0f4-e90d46c23bc3 tempest-SharesActionsNegativeTest-299343130 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:05:07 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-abe97ae2-2afd-4e69-b0f4-e90d46c23bc3 tempest-SharesActionsNegativeTest-299343130 None] {'allow_redirects': True, May 28 13:05:07 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-abe97ae2-2afd-4e69-b0f4-e90d46c23bc3 tempest-SharesActionsNegativeTest-299343130 None] 'params': {'name': '288572fc-ff63-46d5-97ea-660a49f0f7ac'}} May 28 13:05:07 l75lg1-v1 neutron-server[77623]: DEBUG dbcounter [-] [77623] Writing DB stats neutron:SELECT=1 {{(pid=77623) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:05:07 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-abe97ae2-2afd-4e69-b0f4-e90d46c23bc3 tempest-SharesActionsNegativeTest-299343130 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:05:07 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-abe97ae2-2afd-4e69-b0f4-e90d46c23bc3 tempest-SharesActionsNegativeTest-299343130 None] [Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=0, created='2024-05-28T13:04:56.832343Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='dd1ec2e9-8c87-42ba-b319-d4b47e59d189', id=65, internal=False, is_s3_default_policy=False, name='288572fc-ff63-46d5-97ea-660a49f0f7ac', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=[], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['*'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['*'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T13:04:57.208428Z', tenant_id=1, tenant_name='default', title='288572fc-ff63-46d5-97ea-660a49f0f7ac', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/65/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[])] May 28 13:05:07 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-abe97ae2-2afd-4e69-b0f4-e90d46c23bc3 tempest-SharesActionsNegativeTest-299343130 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 13:05:07 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-abe97ae2-2afd-4e69-b0f4-e90d46c23bc3 tempest-SharesActionsNegativeTest-299343130 None] >>> [DELETE] https://127.0.0.1:40443/api/viewpolicies/65/ May 28 13:05:07 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-97ec7b03-207d-4aa9-80a2-69f99b653af9 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] GET http://10.27.203.238/share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares/c78ca6e2-e1f4-4196-a66f-6160ac6acb49 May 28 13:05:07 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-97ec7b03-207d-4aa9-80a2-69f99b653af9 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:05:07 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-97ec7b03-207d-4aa9-80a2-69f99b653af9 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:05:07 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-97ec7b03-207d-4aa9-80a2-69f99b653af9 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] http://10.27.203.238/share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares/c78ca6e2-e1f4-4196-a66f-6160ac6acb49 returned with HTTP 200 May 28 13:05:07 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1388/2755] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:05:07 2024] GET /share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares/c78ca6e2-e1f4-4196-a66f-6160ac6acb49 => generated 1316 bytes in 27 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:05:08 l75lg1-v1 dstat.sh[49771]: 28-05 13:05:08| 1 0 97 1 0|5523M 1888M 278M 7934M| 16k 1390B| 0 1396k| 0 92.0 |1870 2842 |1.27 1.11 1.05|2.0 0 2.0| 0 0 | 0 2048M| 29 359 0 16 6 May 28 13:05:09 l75lg1-v1 dstat.sh[49771]: 28-05 13:05:09| 1 0 99 0 0|5523M 1888M 278M 7934M| 15k 0 | 0 88k| 0 9.98 |1667 2507 |1.27 1.11 1.05|1.0 0 0| 0 0 | 0 2048M| 29 359 0 16 6 May 28 13:05:09 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-abe97ae2-2afd-4e69-b0f4-e90d46c23bc3 tempest-SharesActionsNegativeTest-299343130 None] <<< [DELETE] https://127.0.0.1:40443/api/viewpolicies/65/ May 28 13:05:09 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-abe97ae2-2afd-4e69-b0f4-e90d46c23bc3 tempest-SharesActionsNegativeTest-299343130 None] --- [DELETE] https://127.0.0.1:40443/api/viewpolicies/65/: Done May 28 13:05:10 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-abe97ae2-2afd-4e69-b0f4-e90d46c23bc3 tempest-SharesActionsNegativeTest-299343130 None] Created reservations ['d193cfcd-d45f-4964-84b7-f05529bb8c9a', '39b13afe-cde0-4991-9ca0-864b5be7cc1d', 'a6358bd9-af80-456d-abee-4d9232d75d79', '47958876-be57-4a8e-ac4e-4204e360d5d2'] {{(pid=98474) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 13:05:10 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-abe97ae2-2afd-4e69-b0f4-e90d46c23bc3 tempest-SharesActionsNegativeTest-299343130 None] Committed reservations ['d193cfcd-d45f-4964-84b7-f05529bb8c9a', '39b13afe-cde0-4991-9ca0-864b5be7cc1d', 'a6358bd9-af80-456d-abee-4d9232d75d79', '47958876-be57-4a8e-ac4e-4204e360d5d2'] {{(pid=98474) commit /opt/stack/manila/manila/quota.py:1063}} May 28 13:05:10 l75lg1-v1 manila-share[98474]: INFO manila.share.manager [None req-abe97ae2-2afd-4e69-b0f4-e90d46c23bc3 tempest-SharesActionsNegativeTest-299343130 None] Share instance 288572fc-ff63-46d5-97ea-660a49f0f7ac: deleted successfully. May 28 13:05:10 l75lg1-v1 dstat.sh[49771]: 28-05 13:05:10| 2 0 96 1 0|5523M 1888M 278M 7934M| 21k 66B| 0 617k| 0 116 |2568 4115 |1.27 1.11 1.05| 0 0 0| 0 0 | 0 2048M| 29 359 0 16 6 May 28 13:05:10 l75lg1-v1 neutron-server[77618]: DEBUG dbcounter [-] [77618] Writing DB stats neutron:UPDATE=1 {{(pid=77618) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:05:10 l75lg1-v1 neutron-server[77618]: DEBUG dbcounter [-] [77618] Writing DB stats neutron:SELECT=1 {{(pid=77618) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:05:10 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-6c5e44e2-bfc6-4b99-be52-bf7141241e63 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] GET http://10.27.203.238/share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares/c78ca6e2-e1f4-4196-a66f-6160ac6acb49 May 28 13:05:10 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-6c5e44e2-bfc6-4b99-be52-bf7141241e63 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:05:10 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-6c5e44e2-bfc6-4b99-be52-bf7141241e63 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:05:10 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-6c5e44e2-bfc6-4b99-be52-bf7141241e63 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] HTTP exception thrown: The resource could not be found. May 28 13:05:10 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-6c5e44e2-bfc6-4b99-be52-bf7141241e63 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] http://10.27.203.238/share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares/c78ca6e2-e1f4-4196-a66f-6160ac6acb49 returned with HTTP 404 May 28 13:05:10 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1368/2756] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:05:10 2024] GET /share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares/c78ca6e2-e1f4-4196-a66f-6160ac6acb49 => generated 78 bytes in 11 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 13:05:10 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-bfb7b26c-3466-4bb1-a603-da66ad5a7d87 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] POST http://10.27.203.238/share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares May 28 13:05:10 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-bfb7b26c-3466-4bb1-a603-da66ad5a7d87 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share": {"share_proto": "nfs", "description": "Tempest's share", "snapshot_id": null, "name": "tempest-tempest-created-share-293732825", "size": 1, "metadata": {}, "is_public": false, "share_type": "f7d65ead-0196-4e03-928f-2e08ca825112"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:05:10 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.v1.shares [None req-bfb7b26c-3466-4bb1-a603-da66ad5a7d87 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Create NFS share of 1 GB May 28 13:05:10 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.quota [None req-bfb7b26c-3466-4bb1-a603-da66ad5a7d87 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Created reservations ['619176d0-ea22-4a57-9302-9a1055d27ebf', '8af02802-42d8-451b-b81f-66b771033a4a', '94c1367d-27a9-465e-8f91-fb0401f85c10', '84f0cc74-2970-4946-9a1a-87a978a0e56d'] {{(pid=98329) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 13:05:10 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.quota [None req-bfb7b26c-3466-4bb1-a603-da66ad5a7d87 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Committed reservations ['619176d0-ea22-4a57-9302-9a1055d27ebf', '8af02802-42d8-451b-b81f-66b771033a4a', '94c1367d-27a9-465e-8f91-fb0401f85c10', '84f0cc74-2970-4946-9a1a-87a978a0e56d'] {{(pid=98329) commit /opt/stack/manila/manila/quota.py:1063}} May 28 13:05:10 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.host_manager [None req-bfb7b26c-3466-4bb1-a603-da66ad5a7d87 tempest-SharesActionsNegativeTest-299343130 None] Share service is down. (host: l75lg1-v1@generic2). May 28 13:05:10 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.host_manager [None req-bfb7b26c-3466-4bb1-a603-da66ad5a7d87 tempest-SharesActionsNegativeTest-299343130 None] Share service is down. (host: l75lg1-v1@generic1). May 28 13:05:10 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-bfb7b26c-3466-4bb1-a603-da66ad5a7d87 tempest-SharesActionsNegativeTest-299343130 None] Starting with 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:80}} May 28 13:05:10 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-bfb7b26c-3466-4bb1-a603-da66ad5a7d87 tempest-SharesActionsNegativeTest-299343130 None] Filter OnlyHostFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:05:10 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-bfb7b26c-3466-4bb1-a603-da66ad5a7d87 tempest-SharesActionsNegativeTest-299343130 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:05:10 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.capacity [None req-bfb7b26c-3466-4bb1-a603-da66ad5a7d87 tempest-SharesActionsNegativeTest-299343130 None] Space information for share creation on host l75lg1-v1@vast#vast (requested / avail): 1/2081 {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/capacity.py:83}} May 28 13:05:10 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-bfb7b26c-3466-4bb1-a603-da66ad5a7d87 tempest-SharesActionsNegativeTest-299343130 None] Filter CapacityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:05:10 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-bfb7b26c-3466-4bb1-a603-da66ad5a7d87 tempest-SharesActionsNegativeTest-299343130 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:05:10 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-bfb7b26c-3466-4bb1-a603-da66ad5a7d87 tempest-SharesActionsNegativeTest-299343130 None] Driver Filter: Checking host 'l75lg1-v1@vast#vast' {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:37}} May 28 13:05:10 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-bfb7b26c-3466-4bb1-a603-da66ad5a7d87 tempest-SharesActionsNegativeTest-299343130 None] Filter function not set :: passing host. {{(pid=98327) _check_filter_function /opt/stack/manila/manila/scheduler/filters/driver.py:53}} May 28 13:05:10 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-bfb7b26c-3466-4bb1-a603-da66ad5a7d87 tempest-SharesActionsNegativeTest-299343130 None] Result: True {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:40}} May 28 13:05:10 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-bfb7b26c-3466-4bb1-a603-da66ad5a7d87 tempest-SharesActionsNegativeTest-299343130 None] Done checking host 'l75lg1-v1@vast#vast' {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:41}} May 28 13:05:10 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-bfb7b26c-3466-4bb1-a603-da66ad5a7d87 tempest-SharesActionsNegativeTest-299343130 None] Filter DriverFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:05:10 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-bfb7b26c-3466-4bb1-a603-da66ad5a7d87 tempest-SharesActionsNegativeTest-299343130 None] Filter ShareReplicationFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:05:10 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-bfb7b26c-3466-4bb1-a603-da66ad5a7d87 tempest-SharesActionsNegativeTest-299343130 None] Filter CreateFromSnapshotFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:05:10 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-bfb7b26c-3466-4bb1-a603-da66ad5a7d87 tempest-SharesActionsNegativeTest-299343130 None] Filter AffinityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:05:10 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-bfb7b26c-3466-4bb1-a603-da66ad5a7d87 tempest-SharesActionsNegativeTest-299343130 None] Filter AntiAffinityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:05:10 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.drivers.filter [None req-bfb7b26c-3466-4bb1-a603-da66ad5a7d87 tempest-SharesActionsNegativeTest-299343130 None] Filtered share [host: 'l75lg1-v1@vast#vast', free_capacity_gb: 2081.6423625880852, pools: None] {{(pid=98327) _schedule_share /opt/stack/manila/manila/scheduler/drivers/filter.py:268}} May 28 13:05:10 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-bfb7b26c-3466-4bb1-a603-da66ad5a7d87 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] http://10.27.203.238/share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares returned with HTTP 200 May 28 13:05:10 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-bfb7b26c-3466-4bb1-a603-da66ad5a7d87 tempest-SharesActionsNegativeTest-299343130 None] Checking host 'l75lg1-v1@vast#vast' {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:46}} May 28 13:05:10 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.weighers.goodness [None req-bfb7b26c-3466-4bb1-a603-da66ad5a7d87 tempest-SharesActionsNegativeTest-299343130 None] Goodness function not set :: defaulting to minimal goodness rating of 0. May 28 13:05:10 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1389/2757] 10.27.203.238 () {66 vars in 1362 bytes} [Tue May 28 13:05:10 2024] POST /share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares => generated 1312 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:05:10 l75lg1-v1 manila-scheduler[98327]: INFO manila.scheduler.weighers.goodness [None req-bfb7b26c-3466-4bb1-a603-da66ad5a7d87 tempest-SharesActionsNegativeTest-299343130 None] Goodness function result for host l75lg1-v1@vast#vast: 0. May 28 13:05:10 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-bfb7b26c-3466-4bb1-a603-da66ad5a7d87 tempest-SharesActionsNegativeTest-299343130 None] Goodness: 0 {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:48}} May 28 13:05:10 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-bfb7b26c-3466-4bb1-a603-da66ad5a7d87 tempest-SharesActionsNegativeTest-299343130 None] Done checking host 'l75lg1-v1@vast#vast' {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:49}} May 28 13:05:10 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.drivers.filter [None req-bfb7b26c-3466-4bb1-a603-da66ad5a7d87 tempest-SharesActionsNegativeTest-299343130 None] Choosing for share: WeighedHost [host: l75lg1-v1@vast#vast, weight: 0.0] {{(pid=98327) _schedule_share /opt/stack/manila/manila/scheduler/drivers/filter.py:274}} May 28 13:05:11 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-6ed613a2-5760-4030-97e6-f69a0e998f0a tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] GET http://10.27.203.238/share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares/b48544a1-b53b-4a46-8ade-9d9ce8f18b0e May 28 13:05:11 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-6ed613a2-5760-4030-97e6-f69a0e998f0a tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:05:11 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-6ed613a2-5760-4030-97e6-f69a0e998f0a tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:05:11 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-6ed613a2-5760-4030-97e6-f69a0e998f0a tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] http://10.27.203.238/share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares/b48544a1-b53b-4a46-8ade-9d9ce8f18b0e returned with HTTP 200 May 28 13:05:11 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1369/2758] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:05:11 2024] GET /share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares/b48544a1-b53b-4a46-8ade-9d9ce8f18b0e => generated 1312 bytes in 30 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:05:11 l75lg1-v1 cinder-scheduler[85128]: DEBUG dbcounter [-] [85128] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=85128) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:05:11 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bfb7b26c-3466-4bb1-a603-da66ad5a7d87 tempest-SharesActionsNegativeTest-299343130 None] >>> [GET] https://127.0.0.1:40443/api/vippools/ May 28 13:05:11 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bfb7b26c-3466-4bb1-a603-da66ad5a7d87 tempest-SharesActionsNegativeTest-299343130 None] {'allow_redirects': True, 'params': {'name': 'vippool-1'}} May 28 13:05:11 l75lg1-v1 dstat.sh[49771]: 28-05 13:05:11| 4 0 93 3 0|5523M 1888M 278M 7934M| 15k 4684B| 0 4024k| 0 326 |3601 6231 |1.27 1.11 1.05| 0 0 0| 0 0 | 0 2048M| 29 359 0 16 6 May 28 13:05:11 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bfb7b26c-3466-4bb1-a603-da66ad5a7d87 tempest-SharesActionsNegativeTest-299343130 None] <<< [GET] https://127.0.0.1:40443/api/vippools/ May 28 13:05:11 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bfb7b26c-3466-4bb1-a603-da66ad5a7d87 tempest-SharesActionsNegativeTest-299343130 None] [Bunch(active_cnode_ids=[], active_interfaces=4, cluster='loop75-kfs', cluster_id=1, cnode_ids=[], cnodes=[], domain_name='vippool-1', enable_l3=False, enable_weighted_balancing=False, enabled=True, end_ip='172.21.75.4', guid='f2abaede-b397-413a-8faa-3aeead6d3b28', gw_ip='', gw_ipv6='', id=2, ip_ranges=[['172.21.75.1', '172.21.75.4']], name='vippool-1', peer_asn=0, port_membership='ALL', ranges_summary='172.21.75.[1-4]', role='PROTOCOLS', start_ip='172.21.75.1', subnet_cidr=16, subnet_cidr_ipv6=None, sync='SYNCED', sync_time='2024-05-28T12:50:09.644123Z', tenant_id=1, tenant_name='default', title='172.21.75.1 - 172.21.75.4', url='https://127.0.0.1:40443/api/vippools/2/', vast_asn=0, vlan=0, vms_preferred=False)] May 28 13:05:11 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bfb7b26c-3466-4bb1-a603-da66ad5a7d87 tempest-SharesActionsNegativeTest-299343130 None] --- [GET] https://127.0.0.1:40443/api/vippools/: Done May 28 13:05:11 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bfb7b26c-3466-4bb1-a603-da66ad5a7d87 tempest-SharesActionsNegativeTest-299343130 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:05:11 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bfb7b26c-3466-4bb1-a603-da66ad5a7d87 tempest-SharesActionsNegativeTest-299343130 None] {'allow_redirects': True, May 28 13:05:11 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bfb7b26c-3466-4bb1-a603-da66ad5a7d87 tempest-SharesActionsNegativeTest-299343130 None] 'params': {'name': '9ccd2613-3136-4c23-9d3e-f74c5cd820eb'}} May 28 13:05:11 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bfb7b26c-3466-4bb1-a603-da66ad5a7d87 tempest-SharesActionsNegativeTest-299343130 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:05:11 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bfb7b26c-3466-4bb1-a603-da66ad5a7d87 tempest-SharesActionsNegativeTest-299343130 None] [] May 28 13:05:11 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bfb7b26c-3466-4bb1-a603-da66ad5a7d87 tempest-SharesActionsNegativeTest-299343130 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 13:05:11 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bfb7b26c-3466-4bb1-a603-da66ad5a7d87 tempest-SharesActionsNegativeTest-299343130 None] >>> [POST] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:05:11 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bfb7b26c-3466-4bb1-a603-da66ad5a7d87 tempest-SharesActionsNegativeTest-299343130 None] {'data': '{"name": "9ccd2613-3136-4c23-9d3e-f74c5cd820eb"}', May 28 13:05:11 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bfb7b26c-3466-4bb1-a603-da66ad5a7d87 tempest-SharesActionsNegativeTest-299343130 None] 'json': None, May 28 13:05:11 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bfb7b26c-3466-4bb1-a603-da66ad5a7d87 tempest-SharesActionsNegativeTest-299343130 None] 'params': None} May 28 13:05:11 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.periodic_task [None req-e3486ff9-a95e-41bc-8901-df75aedbeaad None None] Running periodic task DataManager.create_backup_continue {{(pid=98318) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 13:05:11 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.periodic_task [None req-e3486ff9-a95e-41bc-8901-df75aedbeaad None None] Running periodic task DataManager.restore_backup_continue {{(pid=98318) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 13:05:12 l75lg1-v1 dstat.sh[49771]: 28-05 13:05:12| 1 0 97 1 0|5523M 1889M 278M 7934M| 16k 1565B| 0 1874k| 0 288 |2244 3624 |1.27 1.11 1.05|1.0 0 0| 0 0 | 0 2048M| 29 359 0 16 6 May 28 13:05:12 l75lg1-v1 cinder-volume[85846]: DEBUG dbcounter [-] [85846] Writing DB stats cinder:SELECT=1 {{(pid=85846) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:05:12 l75lg1-v1 cinder-volume[85846]: DEBUG dbcounter [-] [85846] Writing DB stats cinder:UPDATE=1 {{(pid=85846) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:05:12 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bfb7b26c-3466-4bb1-a603-da66ad5a7d87 tempest-SharesActionsNegativeTest-299343130 None] <<< [POST] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:05:12 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bfb7b26c-3466-4bb1-a603-da66ad5a7d87 tempest-SharesActionsNegativeTest-299343130 None] Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=0, created='2024-05-28T13:05:12.309329Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='349d211f-6abb-4f6d-a41c-6a647b312be6', id=66, internal=False, is_s3_default_policy=False, name='9ccd2613-3136-4c23-9d3e-f74c5cd820eb', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=[], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['*'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['*'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T13:05:12.818888Z', tenant_id=1, tenant_name='default', title='9ccd2613-3136-4c23-9d3e-f74c5cd820eb', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/66/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[]) May 28 13:05:12 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bfb7b26c-3466-4bb1-a603-da66ad5a7d87 tempest-SharesActionsNegativeTest-299343130 None] --- [POST] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 13:05:12 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bfb7b26c-3466-4bb1-a603-da66ad5a7d87 tempest-SharesActionsNegativeTest-299343130 None] >>> [GET] https://127.0.0.1:40443/api/quotas/ May 28 13:05:12 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bfb7b26c-3466-4bb1-a603-da66ad5a7d87 tempest-SharesActionsNegativeTest-299343130 None] {'allow_redirects': True, May 28 13:05:12 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bfb7b26c-3466-4bb1-a603-da66ad5a7d87 tempest-SharesActionsNegativeTest-299343130 None] 'params': {'name': '9ccd2613-3136-4c23-9d3e-f74c5cd820eb'}} May 28 13:05:13 l75lg1-v1 dstat.sh[49771]: 28-05 13:05:13| 1 0 98 0 0|5523M 1888M 278M 7934M| 16k 837B| 0 384k| 0 54.0 |2133 3662 |1.17 1.09 1.05| 0 0 0| 0 0 | 0 2048M| 29 359 0 16 6 May 28 13:05:13 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bfb7b26c-3466-4bb1-a603-da66ad5a7d87 tempest-SharesActionsNegativeTest-299343130 None] <<< [GET] https://127.0.0.1:40443/api/quotas/ May 28 13:05:13 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bfb7b26c-3466-4bb1-a603-da66ad5a7d87 tempest-SharesActionsNegativeTest-299343130 None] [] May 28 13:05:13 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bfb7b26c-3466-4bb1-a603-da66ad5a7d87 tempest-SharesActionsNegativeTest-299343130 None] --- [GET] https://127.0.0.1:40443/api/quotas/: Done May 28 13:05:13 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bfb7b26c-3466-4bb1-a603-da66ad5a7d87 tempest-SharesActionsNegativeTest-299343130 None] >>> [POST] https://127.0.0.1:40443/api/quotas/ May 28 13:05:13 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bfb7b26c-3466-4bb1-a603-da66ad5a7d87 tempest-SharesActionsNegativeTest-299343130 None] {'data': '{"name": "9ccd2613-3136-4c23-9d3e-f74c5cd820eb", "path": ' May 28 13:05:13 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bfb7b26c-3466-4bb1-a603-da66ad5a7d87 tempest-SharesActionsNegativeTest-299343130 None] '"/manila/manila-9ccd2613-3136-4c23-9d3e-f74c5cd820eb", "create_dir": ' May 28 13:05:13 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bfb7b26c-3466-4bb1-a603-da66ad5a7d87 tempest-SharesActionsNegativeTest-299343130 None] 'true, "hard_limit": 1073741824}', May 28 13:05:13 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bfb7b26c-3466-4bb1-a603-da66ad5a7d87 tempest-SharesActionsNegativeTest-299343130 None] 'json': None, May 28 13:05:13 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bfb7b26c-3466-4bb1-a603-da66ad5a7d87 tempest-SharesActionsNegativeTest-299343130 None] 'params': None} May 28 13:05:14 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-d27cedd5-2053-4bd2-ae45-51e8b8959441 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] GET http://10.27.203.238/share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares/b48544a1-b53b-4a46-8ade-9d9ce8f18b0e May 28 13:05:14 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-d27cedd5-2053-4bd2-ae45-51e8b8959441 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:05:14 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-d27cedd5-2053-4bd2-ae45-51e8b8959441 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:05:14 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bfb7b26c-3466-4bb1-a603-da66ad5a7d87 tempest-SharesActionsNegativeTest-299343130 None] <<< [POST] https://127.0.0.1:40443/api/quotas/ May 28 13:05:14 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bfb7b26c-3466-4bb1-a603-da66ad5a7d87 tempest-SharesActionsNegativeTest-299343130 None] Bunch(cluster='loop75-kfs', cluster_id=1, default_email=None, default_group_quota=None, default_user_quota=None, enable_alarms=True, enable_email_providers=True, grace_period=None, group_quotas=[], guid='bac3b5c0-60ee-4f64-bdf5-d7d0ef283299', hard_limit=1073741824, hard_limit_inodes=None, id=63, internal=False, is_user_quota=False, last_user_quotas_update=None, name='9ccd2613-3136-4c23-9d3e-f74c5cd820eb', num_blocked_users=0, num_exceeded_users=0, path='/manila/manila-9ccd2613-3136-4c23-9d3e-f74c5cd820eb', percent_capacity=0, percent_inodes=None, pretty_grace_period=None, pretty_grace_period_expiration=None, pretty_state='OK (CREATED)', soft_limit=None, soft_limit_inodes=None, state='OK', sync_state='CREATED', system_id=63, tenant_id=1, tenant_name='default', time_to_block=None, title='9ccd2613-3136-4c23-9d3e-f74c5cd820eb', url='https://127.0.0.1:40443/api/quotas/63/', used_capacity=0, used_capacity_tb=0.0, used_effective_capacity=0, used_effective_capacity_tb=0.0, used_inodes=0, used_limited_capacity=0, user_quotas=[]) May 28 13:05:14 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bfb7b26c-3466-4bb1-a603-da66ad5a7d87 tempest-SharesActionsNegativeTest-299343130 None] --- [POST] https://127.0.0.1:40443/api/quotas/: Done May 28 13:05:14 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bfb7b26c-3466-4bb1-a603-da66ad5a7d87 tempest-SharesActionsNegativeTest-299343130 None] >>> [GET] https://127.0.0.1:40443/api/views/ May 28 13:05:14 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bfb7b26c-3466-4bb1-a603-da66ad5a7d87 tempest-SharesActionsNegativeTest-299343130 None] {'allow_redirects': True, May 28 13:05:14 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bfb7b26c-3466-4bb1-a603-da66ad5a7d87 tempest-SharesActionsNegativeTest-299343130 None] 'params': {'name': '9ccd2613-3136-4c23-9d3e-f74c5cd820eb'}} May 28 13:05:14 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-d27cedd5-2053-4bd2-ae45-51e8b8959441 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] http://10.27.203.238/share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares/b48544a1-b53b-4a46-8ade-9d9ce8f18b0e returned with HTTP 200 May 28 13:05:14 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1390/2759] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:05:14 2024] GET /share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares/b48544a1-b53b-4a46-8ade-9d9ce8f18b0e => generated 1314 bytes in 25 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:05:14 l75lg1-v1 devstack@placement-api.service[78202]: DEBUG dbcounter [-] [78202] Writing DB stats placement:SELECT=2 {{(pid=78202) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:05:14 l75lg1-v1 devstack@placement-api.service[78201]: DEBUG dbcounter [-] [78201] Writing DB stats placement:SELECT=2 {{(pid=78201) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:05:14 l75lg1-v1 nova-conductor[83647]: DEBUG dbcounter [-] [83647] Writing DB stats nova_cell1:SELECT=4 {{(pid=83647) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:05:14 l75lg1-v1 dstat.sh[49771]: 28-05 13:05:14| 1 0 99 0 0|5523M 1888M 278M 7934M| 19k 1669B| 0 260k| 0 25.0 |1637 2543 |1.17 1.09 1.05|1.0 0 0| 0 0 | 0 2048M| 29 359 0 10 6 May 28 13:05:14 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bfb7b26c-3466-4bb1-a603-da66ad5a7d87 tempest-SharesActionsNegativeTest-299343130 None] <<< [GET] https://127.0.0.1:40443/api/views/ May 28 13:05:14 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bfb7b26c-3466-4bb1-a603-da66ad5a7d87 tempest-SharesActionsNegativeTest-299343130 None] [] May 28 13:05:14 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bfb7b26c-3466-4bb1-a603-da66ad5a7d87 tempest-SharesActionsNegativeTest-299343130 None] --- [GET] https://127.0.0.1:40443/api/views/: Done May 28 13:05:14 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bfb7b26c-3466-4bb1-a603-da66ad5a7d87 tempest-SharesActionsNegativeTest-299343130 None] >>> [POST] https://127.0.0.1:40443/api/views/ May 28 13:05:14 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bfb7b26c-3466-4bb1-a603-da66ad5a7d87 tempest-SharesActionsNegativeTest-299343130 None] {'data': '{"name": "9ccd2613-3136-4c23-9d3e-f74c5cd820eb", "path": ' May 28 13:05:14 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bfb7b26c-3466-4bb1-a603-da66ad5a7d87 tempest-SharesActionsNegativeTest-299343130 None] '"/manila/manila-9ccd2613-3136-4c23-9d3e-f74c5cd820eb", "policy_id": ' May 28 13:05:14 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bfb7b26c-3466-4bb1-a603-da66ad5a7d87 tempest-SharesActionsNegativeTest-299343130 None] '66, "create_dir": true, "protocols": ["NFS"]}', May 28 13:05:14 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bfb7b26c-3466-4bb1-a603-da66ad5a7d87 tempest-SharesActionsNegativeTest-299343130 None] 'json': None, May 28 13:05:14 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bfb7b26c-3466-4bb1-a603-da66ad5a7d87 tempest-SharesActionsNegativeTest-299343130 None] 'params': None} May 28 13:05:15 l75lg1-v1 dstat.sh[49771]: 28-05 13:05:15| 1 0 99 0 0|5523M 1888M 278M 7934M| 12k 939B| 0 375k| 0 11.0 |1523 2411 |1.17 1.09 1.05| 0 0 0| 0 0 | 0 2048M| 29 359 0 10 6 May 28 13:05:15 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bfb7b26c-3466-4bb1-a603-da66ad5a7d87 tempest-SharesActionsNegativeTest-299343130 None] <<< [POST] https://127.0.0.1:40443/api/views/ May 28 13:05:15 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bfb7b26c-3466-4bb1-a603-da66ad5a7d87 tempest-SharesActionsNegativeTest-299343130 None] Bunch(abac_tags=[], abe_max_depth=None, abe_protocols=[], alias='', allow_anonymous_access=False, allow_s3_anonymous_access=False, auto_commit='0d', bucket='', bucket_creators=[], bucket_creators_groups=[], bucket_owner=None, bulk_permission_update_progress=None, bulk_permission_update_state=None, cluster='loop75-kfs', cluster_id=1, created='2024-05-28T13:05:15.172364Z', enabled=True, files_retention_mode='NONE', guid='8956a22f-638c-4077-b2ea-77ec768aa4fc', id=65, ignore_oos=False, internal=False, is_remote=False, is_seamless=False, logical_capacity=0, max_retention_period=None, min_retention_period=None, name='9ccd2613-3136-4c23-9d3e-f74c5cd820eb', nfs_interop_flags='BOTH_NFS3_AND_NFS4_INTEROP_DISABLED', path='/manila/manila-9ccd2613-3136-4c23-9d3e-f74c5cd820eb', physical_capacity=0, policy='9ccd2613-3136-4c23-9d3e-f74c5cd820eb', policy_id=66, protocols=['NFS'], qos_policy=None, qos_policy_id=None, s3_locks=False, s3_locks_retention_mode='NONE', s3_locks_retention_period='', s3_object_ownership_rule='ObjectWriter', s3_unverified_lookup=False, s3_versioning=False, select_for_live_monitoring=False, share='', share_acl=Bunch(acl=[], enabled=False), sync='SYNCED', sync_time='2024-05-28T13:05:15.439989Z', tenant_id=1, tenant_name='default', title='/manila/manila-9ccd2613-3136-4c23-9d3e-f74c5cd820eb', url='https://127.0.0.1:40443/api/views/65/') May 28 13:05:15 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-bfb7b26c-3466-4bb1-a603-da66ad5a7d87 tempest-SharesActionsNegativeTest-299343130 None] --- [POST] https://127.0.0.1:40443/api/views/: Done May 28 13:05:15 l75lg1-v1 manila-share[98474]: INFO manila.share.manager [None req-bfb7b26c-3466-4bb1-a603-da66ad5a7d87 tempest-SharesActionsNegativeTest-299343130 None] Share instance 9ccd2613-3136-4c23-9d3e-f74c5cd820eb created successfully. May 28 13:05:16 l75lg1-v1 dstat.sh[49771]: 28-05 13:05:16| 1 0 98 0 0|5523M 1888M 278M 7934M| 17k 66B| 0 320k| 0 44.0 |1868 3019 |1.17 1.09 1.05|2.0 0 0| 0 0 | 0 2048M| 29 359 0 10 6 May 28 13:05:16 l75lg1-v1 nova-conductor[83648]: DEBUG dbcounter [-] [83648] Writing DB stats nova_cell1:SELECT=3 {{(pid=83648) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:05:17 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-4b495d0d-f55d-48f1-8ca6-a047bce61205 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] GET http://10.27.203.238/share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares/b48544a1-b53b-4a46-8ade-9d9ce8f18b0e May 28 13:05:17 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-4b495d0d-f55d-48f1-8ca6-a047bce61205 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:05:17 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-4b495d0d-f55d-48f1-8ca6-a047bce61205 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:05:17 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-4b495d0d-f55d-48f1-8ca6-a047bce61205 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] http://10.27.203.238/share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares/b48544a1-b53b-4a46-8ade-9d9ce8f18b0e returned with HTTP 200 May 28 13:05:17 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1370/2760] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:05:17 2024] GET /share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares/b48544a1-b53b-4a46-8ade-9d9ce8f18b0e => generated 1317 bytes in 25 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:05:17 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-47066b15-ed7c-45d4-acf3-d698bcc12597 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] POST http://10.27.203.238/share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares/b48544a1-b53b-4a46-8ade-9d9ce8f18b0e/action May 28 13:05:17 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-47066b15-ed7c-45d4-acf3-d698bcc12597 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Action body: b'{"soft_delete": null}' {{(pid=98329) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 13:05:17 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-47066b15-ed7c-45d4-acf3-d698bcc12597 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Action: 'action', calling method: ShareController.share_soft_delete, body: {"soft_delete": null} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:05:17 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.v2.shares [None req-47066b15-ed7c-45d4-acf3-d698bcc12597 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Soft delete share with id: b48544a1-b53b-4a46-8ade-9d9ce8f18b0e {{(pid=98329) share_soft_delete /opt/stack/manila/manila/api/v2/shares.py:280}} May 28 13:05:17 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-47066b15-ed7c-45d4-acf3-d698bcc12597 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] http://10.27.203.238/share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares/b48544a1-b53b-4a46-8ade-9d9ce8f18b0e/action returned with HTTP 202 May 28 13:05:17 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1391/2761] 10.27.203.238 () {66 vars in 1493 bytes} [Tue May 28 13:05:17 2024] POST /share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares/b48544a1-b53b-4a46-8ade-9d9ce8f18b0e/action => generated 0 bytes in 73 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 13:05:17 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-cb9f0e59-62ce-4b12-9e28-bf7b2e591282 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] POST http://10.27.203.238/share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares/b48544a1-b53b-4a46-8ade-9d9ce8f18b0e/action May 28 13:05:17 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-cb9f0e59-62ce-4b12-9e28-bf7b2e591282 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Action body: b'{"soft_delete": null}' {{(pid=98330) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 13:05:17 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-cb9f0e59-62ce-4b12-9e28-bf7b2e591282 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Action: 'action', calling method: ShareController.share_soft_delete, body: {"soft_delete": null} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:05:17 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.v2.shares [None req-cb9f0e59-62ce-4b12-9e28-bf7b2e591282 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Soft delete share with id: b48544a1-b53b-4a46-8ade-9d9ce8f18b0e {{(pid=98330) share_soft_delete /opt/stack/manila/manila/api/v2/shares.py:280}} May 28 13:05:17 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-cb9f0e59-62ce-4b12-9e28-bf7b2e591282 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] HTTP exception thrown: Invalid share: The share has been soft deleted already. May 28 13:05:17 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-cb9f0e59-62ce-4b12-9e28-bf7b2e591282 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] http://10.27.203.238/share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares/b48544a1-b53b-4a46-8ade-9d9ce8f18b0e/action returned with HTTP 403 May 28 13:05:17 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1371/2762] 10.27.203.238 () {66 vars in 1493 bytes} [Tue May 28 13:05:17 2024] POST /share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares/b48544a1-b53b-4a46-8ade-9d9ce8f18b0e/action => generated 98 bytes in 27 msecs (HTTP/1.1 403) 6 headers in 237 bytes (1 switches on core 0) May 28 13:05:17 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-2fb0b400-deb7-4324-b850-1318344a2906 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] POST http://10.27.203.238/share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares/b48544a1-b53b-4a46-8ade-9d9ce8f18b0e/action May 28 13:05:17 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-2fb0b400-deb7-4324-b850-1318344a2906 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Action body: b'{"restore": null}' {{(pid=98329) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 13:05:17 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-2fb0b400-deb7-4324-b850-1318344a2906 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Action: 'action', calling method: ShareController.share_restore, body: {"restore": null} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:05:17 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.v2.shares [None req-2fb0b400-deb7-4324-b850-1318344a2906 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Restore share with id: b48544a1-b53b-4a46-8ade-9d9ce8f18b0e {{(pid=98329) share_restore /opt/stack/manila/manila/api/v2/shares.py:303}} May 28 13:05:17 l75lg1-v1 dstat.sh[49771]: 28-05 13:05:17| 2 0 96 1 0|5523M 1888M 278M 7934M| 17k 0 | 0 1715k| 0 230 |2331 3716 |1.17 1.09 1.05|1.0 0 0| 0 0 | 0 2048M| 29 360 0 10 6 May 28 13:05:17 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-2fb0b400-deb7-4324-b850-1318344a2906 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] http://10.27.203.238/share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares/b48544a1-b53b-4a46-8ade-9d9ce8f18b0e/action returned with HTTP 202 May 28 13:05:17 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1392/2763] 10.27.203.238 () {66 vars in 1493 bytes} [Tue May 28 13:05:17 2024] POST /share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares/b48544a1-b53b-4a46-8ade-9d9ce8f18b0e/action => generated 0 bytes in 286 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 13:05:17 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-4107744e-dd72-44ac-9c35-d771425d0383 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] GET http://10.27.203.238/share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares/b48544a1-b53b-4a46-8ade-9d9ce8f18b0e May 28 13:05:17 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-4107744e-dd72-44ac-9c35-d771425d0383 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:05:17 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-4107744e-dd72-44ac-9c35-d771425d0383 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:05:17 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-4107744e-dd72-44ac-9c35-d771425d0383 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] http://10.27.203.238/share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares/b48544a1-b53b-4a46-8ade-9d9ce8f18b0e returned with HTTP 200 May 28 13:05:17 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1372/2764] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:05:17 2024] GET /share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares/b48544a1-b53b-4a46-8ade-9d9ce8f18b0e => generated 1317 bytes in 25 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:05:17 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-fad5434a-50e9-48e1-8ac8-42ab678b9349 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] GET http://10.27.203.238/share/v2/c39deaad5eb341ceb2e3c79518f56a1b/share-replicas/detail?share_id=b48544a1-b53b-4a46-8ade-9d9ce8f18b0e May 28 13:05:17 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-fad5434a-50e9-48e1-8ac8-42ab678b9349 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:05:17 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-fad5434a-50e9-48e1-8ac8-42ab678b9349 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:05:17 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-fad5434a-50e9-48e1-8ac8-42ab678b9349 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] http://10.27.203.238/share/v2/c39deaad5eb341ceb2e3c79518f56a1b/share-replicas/detail?share_id=b48544a1-b53b-4a46-8ade-9d9ce8f18b0e returned with HTTP 200 May 28 13:05:17 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1393/2765] 10.27.203.238 () {64 vars in 1476 bytes} [Tue May 28 13:05:17 2024] GET /share/v2/c39deaad5eb341ceb2e3c79518f56a1b/share-replicas/detail?share_id=b48544a1-b53b-4a46-8ade-9d9ce8f18b0e => generated 22 bytes in 12 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:05:17 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-9dfa77fe-b17d-4c67-b508-d1a6db4d8cc7 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] DELETE http://10.27.203.238/share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares/b48544a1-b53b-4a46-8ade-9d9ce8f18b0e May 28 13:05:17 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-9dfa77fe-b17d-4c67-b508-d1a6db4d8cc7 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:05:17 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-9dfa77fe-b17d-4c67-b508-d1a6db4d8cc7 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Calling method 'ShareMixin.delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:05:17 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.v1.shares [None req-9dfa77fe-b17d-4c67-b508-d1a6db4d8cc7 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Delete share with id: b48544a1-b53b-4a46-8ade-9d9ce8f18b0e May 28 13:05:17 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-9dfa77fe-b17d-4c67-b508-d1a6db4d8cc7 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] http://10.27.203.238/share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares/b48544a1-b53b-4a46-8ade-9d9ce8f18b0e returned with HTTP 202 May 28 13:05:17 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1373/2766] 10.27.203.238 () {64 vars in 1454 bytes} [Tue May 28 13:05:17 2024] DELETE /share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares/b48544a1-b53b-4a46-8ade-9d9ce8f18b0e => generated 0 bytes in 123 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 13:05:17 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-7458765a-8bc6-42ca-b0e6-1dfcf21a0730 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] GET http://10.27.203.238/share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares/b48544a1-b53b-4a46-8ade-9d9ce8f18b0e May 28 13:05:17 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-7458765a-8bc6-42ca-b0e6-1dfcf21a0730 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:05:17 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-7458765a-8bc6-42ca-b0e6-1dfcf21a0730 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:05:17 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-7458765a-8bc6-42ca-b0e6-1dfcf21a0730 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] http://10.27.203.238/share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares/b48544a1-b53b-4a46-8ade-9d9ce8f18b0e returned with HTTP 200 May 28 13:05:17 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1394/2767] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:05:17 2024] GET /share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares/b48544a1-b53b-4a46-8ade-9d9ce8f18b0e => generated 1316 bytes in 25 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:05:17 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-9dfa77fe-b17d-4c67-b508-d1a6db4d8cc7 tempest-SharesActionsNegativeTest-299343130 None] Acquiring lock "locked_access_rules_operation_by_share_instance_9ccd2613-3136-4c23-9d3e-f74c5cd820eb" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:05:17 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-9dfa77fe-b17d-4c67-b508-d1a6db4d8cc7 tempest-SharesActionsNegativeTest-299343130 None] Lock "locked_access_rules_operation_by_share_instance_9ccd2613-3136-4c23-9d3e-f74c5cd820eb" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:05:17 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-9dfa77fe-b17d-4c67-b508-d1a6db4d8cc7 tempest-SharesActionsNegativeTest-299343130 None] Lock "locked_access_rules_operation_by_share_instance_9ccd2613-3136-4c23-9d3e-f74c5cd820eb" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:05:17 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-9dfa77fe-b17d-4c67-b508-d1a6db4d8cc7 tempest-SharesActionsNegativeTest-299343130 None] Acquiring lock "locked_access_rules_operation_by_share_instance_9ccd2613-3136-4c23-9d3e-f74c5cd820eb" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:05:17 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-9dfa77fe-b17d-4c67-b508-d1a6db4d8cc7 tempest-SharesActionsNegativeTest-299343130 None] Lock "locked_access_rules_operation_by_share_instance_9ccd2613-3136-4c23-9d3e-f74c5cd820eb" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:05:17 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-9dfa77fe-b17d-4c67-b508-d1a6db4d8cc7 tempest-SharesActionsNegativeTest-299343130 None] Lock "locked_access_rules_operation_by_share_instance_9ccd2613-3136-4c23-9d3e-f74c5cd820eb" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:05:17 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-9dfa77fe-b17d-4c67-b508-d1a6db4d8cc7 tempest-SharesActionsNegativeTest-299343130 None] Acquiring lock "locked_access_rules_operation_by_share_instance_9ccd2613-3136-4c23-9d3e-f74c5cd820eb" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:05:17 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-9dfa77fe-b17d-4c67-b508-d1a6db4d8cc7 tempest-SharesActionsNegativeTest-299343130 None] Lock "locked_access_rules_operation_by_share_instance_9ccd2613-3136-4c23-9d3e-f74c5cd820eb" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:05:17 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-9dfa77fe-b17d-4c67-b508-d1a6db4d8cc7 tempest-SharesActionsNegativeTest-299343130 None] Lock "locked_access_rules_operation_by_share_instance_9ccd2613-3136-4c23-9d3e-f74c5cd820eb" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:05:17 l75lg1-v1 manila-share[98474]: DEBUG manila.share.access [None req-9dfa77fe-b17d-4c67-b508-d1a6db4d8cc7 tempest-SharesActionsNegativeTest-299343130 None] All access rules have been synced for share instance 9ccd2613-3136-4c23-9d3e-f74c5cd820eb belonging to share b48544a1-b53b-4a46-8ade-9d9ce8f18b0e. {{(pid=98474) update_access_rules /opt/stack/manila/manila/share/access.py:304}} May 28 13:05:17 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-9dfa77fe-b17d-4c67-b508-d1a6db4d8cc7 tempest-SharesActionsNegativeTest-299343130 None] deleting '/manila/manila-9ccd2613-3136-4c23-9d3e-f74c5cd820eb' May 28 13:05:17 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9dfa77fe-b17d-4c67-b508-d1a6db4d8cc7 tempest-SharesActionsNegativeTest-299343130 None] >>> [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/ May 28 13:05:17 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9dfa77fe-b17d-4c67-b508-d1a6db4d8cc7 tempest-SharesActionsNegativeTest-299343130 None] {'data': '{"path": "/manila/manila-9ccd2613-3136-4c23-9d3e-f74c5cd820eb"}', May 28 13:05:17 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9dfa77fe-b17d-4c67-b508-d1a6db4d8cc7 tempest-SharesActionsNegativeTest-299343130 None] 'params': None} May 28 13:05:17 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9dfa77fe-b17d-4c67-b508-d1a6db4d8cc7 tempest-SharesActionsNegativeTest-299343130 None] <<< [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/ May 28 13:05:17 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9dfa77fe-b17d-4c67-b508-d1a6db4d8cc7 tempest-SharesActionsNegativeTest-299343130 None] 'OK' May 28 13:05:17 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9dfa77fe-b17d-4c67-b508-d1a6db4d8cc7 tempest-SharesActionsNegativeTest-299343130 None] --- [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/: Done May 28 13:05:17 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9dfa77fe-b17d-4c67-b508-d1a6db4d8cc7 tempest-SharesActionsNegativeTest-299343130 None] >>> [GET] https://127.0.0.1:40443/api/views/ May 28 13:05:17 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9dfa77fe-b17d-4c67-b508-d1a6db4d8cc7 tempest-SharesActionsNegativeTest-299343130 None] {'allow_redirects': True, May 28 13:05:17 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9dfa77fe-b17d-4c67-b508-d1a6db4d8cc7 tempest-SharesActionsNegativeTest-299343130 None] 'params': {'name': '9ccd2613-3136-4c23-9d3e-f74c5cd820eb'}} May 28 13:05:18 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9dfa77fe-b17d-4c67-b508-d1a6db4d8cc7 tempest-SharesActionsNegativeTest-299343130 None] <<< [GET] https://127.0.0.1:40443/api/views/ May 28 13:05:18 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9dfa77fe-b17d-4c67-b508-d1a6db4d8cc7 tempest-SharesActionsNegativeTest-299343130 None] [Bunch(abac_tags=[], abe_max_depth=None, abe_protocols=[], alias='', allow_anonymous_access=False, allow_s3_anonymous_access=False, auto_commit='0d', bucket='', bucket_creators=[], bucket_creators_groups=[], bucket_owner=None, bulk_permission_update_progress=None, bulk_permission_update_state=None, cluster='loop75-kfs', cluster_id=1, created='2024-05-28T13:05:15.172364Z', enabled=True, files_retention_mode='NONE', guid='8956a22f-638c-4077-b2ea-77ec768aa4fc', id=65, ignore_oos=False, internal=False, is_remote=False, is_seamless=False, logical_capacity=0, max_retention_period=None, min_retention_period=None, name='9ccd2613-3136-4c23-9d3e-f74c5cd820eb', nfs_interop_flags='BOTH_NFS3_AND_NFS4_INTEROP_DISABLED', path='/manila/manila-9ccd2613-3136-4c23-9d3e-f74c5cd820eb', physical_capacity=0, policy='9ccd2613-3136-4c23-9d3e-f74c5cd820eb', policy_id=66, protocols=['NFS'], qos_policy=None, qos_policy_id=None, s3_locks=False, s3_locks_retention_mode='NONE', s3_locks_retention_period='', s3_unverified_lookup=False, s3_versioning=False, select_for_live_monitoring=False, share='', share_acl=Bunch(acl=[], enabled=False), sync='SYNCED', sync_time='2024-05-28T13:05:15.439989Z', tenant_id=1, tenant_name='default', title='/manila/manila-9ccd2613-3136-4c23-9d3e-f74c5cd820eb', url='https://127.0.0.1:40443/api/views/65/')] May 28 13:05:18 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9dfa77fe-b17d-4c67-b508-d1a6db4d8cc7 tempest-SharesActionsNegativeTest-299343130 None] --- [GET] https://127.0.0.1:40443/api/views/: Done May 28 13:05:18 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9dfa77fe-b17d-4c67-b508-d1a6db4d8cc7 tempest-SharesActionsNegativeTest-299343130 None] >>> [DELETE] https://127.0.0.1:40443/api/views/65/ May 28 13:05:18 l75lg1-v1 dstat.sh[49771]: 28-05 13:05:18| 6 0 93 0 0|5523M 1888M 278M 7934M| 16k 2168B| 0 332k| 0 42.0 |2683 4361 |1.15 1.09 1.05|1.0 0 0| 0 0 | 0 2048M| 29 359 0 10 6 May 28 13:05:19 l75lg1-v1 dstat.sh[49771]: 28-05 13:05:19| 1 0 99 0 0|5523M 1888M 278M 7934M| 19k 172B| 0 116k| 0 11.0 |1664 2517 |1.15 1.09 1.05|1.0 0 2.0| 0 0 | 0 2048M| 29 359 0 10 6 May 28 13:05:19 l75lg1-v1 nova-conductor[83647]: DEBUG dbcounter [-] [83647] Writing DB stats nova_cell1:SELECT=3,nova_cell1:UPDATE=3 {{(pid=83647) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:05:20 l75lg1-v1 nova-conductor[83648]: DEBUG dbcounter [-] [83648] Writing DB stats nova_cell1:SELECT=4,nova_cell1:DELETE=1,nova_cell1:UPDATE=1 {{(pid=83648) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:05:20 l75lg1-v1 dstat.sh[49771]: 28-05 13:05:20| 1 0 98 0 0|5523M 1888M 278M 7934M| 15k 0 | 0 288k| 0 44.0 |1786 3015 |1.15 1.09 1.05| 0 0 0| 0 0 | 0 2048M| 29 359 0 10 6 May 28 13:05:20 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9dfa77fe-b17d-4c67-b508-d1a6db4d8cc7 tempest-SharesActionsNegativeTest-299343130 None] <<< [DELETE] https://127.0.0.1:40443/api/views/65/ May 28 13:05:20 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9dfa77fe-b17d-4c67-b508-d1a6db4d8cc7 tempest-SharesActionsNegativeTest-299343130 None] --- [DELETE] https://127.0.0.1:40443/api/views/65/: Done May 28 13:05:20 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9dfa77fe-b17d-4c67-b508-d1a6db4d8cc7 tempest-SharesActionsNegativeTest-299343130 None] >>> [GET] https://127.0.0.1:40443/api/quotas/ May 28 13:05:20 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9dfa77fe-b17d-4c67-b508-d1a6db4d8cc7 tempest-SharesActionsNegativeTest-299343130 None] {'allow_redirects': True, May 28 13:05:20 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9dfa77fe-b17d-4c67-b508-d1a6db4d8cc7 tempest-SharesActionsNegativeTest-299343130 None] 'params': {'name': '9ccd2613-3136-4c23-9d3e-f74c5cd820eb'}} May 28 13:05:20 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-fcc1d7b1-5e74-46f4-b4cf-e3b31178a5c3 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] GET http://10.27.203.238/share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares/b48544a1-b53b-4a46-8ade-9d9ce8f18b0e May 28 13:05:20 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-fcc1d7b1-5e74-46f4-b4cf-e3b31178a5c3 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:05:20 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-fcc1d7b1-5e74-46f4-b4cf-e3b31178a5c3 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:05:20 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-fcc1d7b1-5e74-46f4-b4cf-e3b31178a5c3 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] http://10.27.203.238/share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares/b48544a1-b53b-4a46-8ade-9d9ce8f18b0e returned with HTTP 200 May 28 13:05:20 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1374/2768] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:05:20 2024] GET /share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares/b48544a1-b53b-4a46-8ade-9d9ce8f18b0e => generated 1316 bytes in 25 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:05:20 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9dfa77fe-b17d-4c67-b508-d1a6db4d8cc7 tempest-SharesActionsNegativeTest-299343130 None] <<< [GET] https://127.0.0.1:40443/api/quotas/ May 28 13:05:20 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9dfa77fe-b17d-4c67-b508-d1a6db4d8cc7 tempest-SharesActionsNegativeTest-299343130 None] [Bunch(cluster='loop75-kfs', cluster_id=1, default_email=None, default_group_quota=None, default_user_quota=None, enable_alarms=True, enable_email_providers=True, grace_period=None, guid='bac3b5c0-60ee-4f64-bdf5-d7d0ef283299', hard_limit=1073741824, hard_limit_inodes=None, id=63, internal=False, is_user_quota=False, last_user_quotas_update=None, name='9ccd2613-3136-4c23-9d3e-f74c5cd820eb', num_blocked_users=0, num_exceeded_users=0, path='/manila/manila-9ccd2613-3136-4c23-9d3e-f74c5cd820eb', percent_capacity=0, percent_inodes=None, pretty_grace_period=None, pretty_grace_period_expiration=None, pretty_state='OK (CREATED)', soft_limit=None, soft_limit_inodes=None, state='OK', sync_state='CREATED', system_id=63, tenant_id=1, tenant_name='default', time_to_block=None, title='9ccd2613-3136-4c23-9d3e-f74c5cd820eb', url='https://127.0.0.1:40443/api/quotas/63/', used_capacity=0, used_capacity_tb=0.0, used_effective_capacity=0, used_effective_capacity_tb=0.0, used_inodes=0, used_limited_capacity=0)] May 28 13:05:20 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9dfa77fe-b17d-4c67-b508-d1a6db4d8cc7 tempest-SharesActionsNegativeTest-299343130 None] --- [GET] https://127.0.0.1:40443/api/quotas/: Done May 28 13:05:20 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9dfa77fe-b17d-4c67-b508-d1a6db4d8cc7 tempest-SharesActionsNegativeTest-299343130 None] >>> [DELETE] https://127.0.0.1:40443/api/quotas/63/ May 28 13:05:21 l75lg1-v1 dstat.sh[49771]: 28-05 13:05:21| 1 0 98 0 0|5523M 1888M 278M 7934M| 27k 1325B| 0 368k| 0 25.0 |1982 2925 |1.15 1.09 1.05| 0 0 0| 0 0 | 0 2048M| 29 359 0 10 6 May 28 13:05:22 l75lg1-v1 dstat.sh[49771]: 28-05 13:05:22| 1 0 98 0 0|5524M 1887M 278M 7934M| 15k 0 | 0 991k| 0 199 |2008 3227 |1.15 1.09 1.05|1.0 0 0| 0 0 | 0 2048M| 29 359 0 10 6 May 28 13:05:23 l75lg1-v1 dstat.sh[49771]: 28-05 13:05:23| 1 0 98 0 0|5524M 1887M 278M 7934M| 12k 0 | 0 256k| 0 41.0 |2015 3489 |1.06 1.07 1.04|3.0 0 0| 0 0 | 0 2048M| 29 359 0 10 6 May 28 13:05:23 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-d1142c84-c5fc-44cd-bd12-9a93e4969c13 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] GET http://10.27.203.238/share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares/b48544a1-b53b-4a46-8ade-9d9ce8f18b0e May 28 13:05:23 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-d1142c84-c5fc-44cd-bd12-9a93e4969c13 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:05:23 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-d1142c84-c5fc-44cd-bd12-9a93e4969c13 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:05:23 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-d1142c84-c5fc-44cd-bd12-9a93e4969c13 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] http://10.27.203.238/share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares/b48544a1-b53b-4a46-8ade-9d9ce8f18b0e returned with HTTP 200 May 28 13:05:23 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1395/2769] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:05:23 2024] GET /share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares/b48544a1-b53b-4a46-8ade-9d9ce8f18b0e => generated 1316 bytes in 23 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:05:24 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9dfa77fe-b17d-4c67-b508-d1a6db4d8cc7 tempest-SharesActionsNegativeTest-299343130 None] <<< [DELETE] https://127.0.0.1:40443/api/quotas/63/ May 28 13:05:24 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9dfa77fe-b17d-4c67-b508-d1a6db4d8cc7 tempest-SharesActionsNegativeTest-299343130 None] --- [DELETE] https://127.0.0.1:40443/api/quotas/63/: Done May 28 13:05:24 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9dfa77fe-b17d-4c67-b508-d1a6db4d8cc7 tempest-SharesActionsNegativeTest-299343130 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:05:24 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9dfa77fe-b17d-4c67-b508-d1a6db4d8cc7 tempest-SharesActionsNegativeTest-299343130 None] {'allow_redirects': True, May 28 13:05:24 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9dfa77fe-b17d-4c67-b508-d1a6db4d8cc7 tempest-SharesActionsNegativeTest-299343130 None] 'params': {'name': '9ccd2613-3136-4c23-9d3e-f74c5cd820eb'}} May 28 13:05:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "_check_child_processes" by "neutron.agent.linux.external_process.ProcessMonitor._check_child_processes" {{(pid=76818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:05:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_concurrency.lockutils [-] Lock "_check_child_processes" acquired by "neutron.agent.linux.external_process.ProcessMonitor._check_child_processes" :: waited 0.000s {{(pid=76818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:05:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_concurrency.lockutils [-] Lock "_check_child_processes" "released" by "neutron.agent.linux.external_process.ProcessMonitor._check_child_processes" :: held 0.001s {{(pid=76818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:05:24 l75lg1-v1 dstat.sh[49771]: 28-05 13:05:24| 1 0 99 0 0|5524M 1887M 278M 7934M| 18k 671B| 0 152k| 0 17.0 |1652 2505 |1.06 1.07 1.04|1.0 0 0| 0 0 | 0 2048M| 29 359 0 10 6 May 28 13:05:24 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9dfa77fe-b17d-4c67-b508-d1a6db4d8cc7 tempest-SharesActionsNegativeTest-299343130 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:05:24 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9dfa77fe-b17d-4c67-b508-d1a6db4d8cc7 tempest-SharesActionsNegativeTest-299343130 None] [Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=0, created='2024-05-28T13:05:12.309329Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='349d211f-6abb-4f6d-a41c-6a647b312be6', id=66, internal=False, is_s3_default_policy=False, name='9ccd2613-3136-4c23-9d3e-f74c5cd820eb', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=[], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['*'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['*'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T13:05:12.818888Z', tenant_id=1, tenant_name='default', title='9ccd2613-3136-4c23-9d3e-f74c5cd820eb', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/66/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[])] May 28 13:05:24 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9dfa77fe-b17d-4c67-b508-d1a6db4d8cc7 tempest-SharesActionsNegativeTest-299343130 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 13:05:24 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9dfa77fe-b17d-4c67-b508-d1a6db4d8cc7 tempest-SharesActionsNegativeTest-299343130 None] >>> [DELETE] https://127.0.0.1:40443/api/viewpolicies/66/ May 28 13:05:25 l75lg1-v1 dstat.sh[49771]: 28-05 13:05:25| 0 0 98 0 0|5524M 1887M 278M 7934M| 17k 891B| 0 152k| 0 12.0 |1604 2438 |1.06 1.07 1.04|1.0 0 0| 0 0 | 0 2048M| 29 359 0 10 6 May 28 13:05:25 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_service.periodic_task [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85846) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 13:05:25 l75lg1-v1 cinder-volume[85846]: DEBUG cinder.volume.drivers.lvm [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] Updating volume stats {{(pid=85846) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}} May 28 13:05:25 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:390}} May 28 13:05:25 l75lg1-v1 sudo[99426]: vastdata : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 May 28 13:05:25 l75lg1-v1 sudo[99426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) May 28 13:05:26 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9dfa77fe-b17d-4c67-b508-d1a6db4d8cc7 tempest-SharesActionsNegativeTest-299343130 None] <<< [DELETE] https://127.0.0.1:40443/api/viewpolicies/66/ May 28 13:05:26 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-9dfa77fe-b17d-4c67-b508-d1a6db4d8cc7 tempest-SharesActionsNegativeTest-299343130 None] --- [DELETE] https://127.0.0.1:40443/api/viewpolicies/66/: Done May 28 13:05:26 l75lg1-v1 sudo[99426]: pam_unix(sudo:session): session closed for user root May 28 13:05:26 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.466s {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:428}} May 28 13:05:26 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:390}} May 28 13:05:26 l75lg1-v1 sudo[99429]: vastdata : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 May 28 13:05:26 l75lg1-v1 sudo[99429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) May 28 13:05:26 l75lg1-v1 dstat.sh[49771]: 28-05 13:05:26| 5 1 94 0 0|5526M 1885M 278M 7934M| 16k 66B| 256k 148k|2.00 15.0 |1894 2621 |1.06 1.07 1.04|2.0 0 5.0| 0 0 | 0 2048M| 29 359 0 10 6 May 28 13:05:26 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-9dfa77fe-b17d-4c67-b508-d1a6db4d8cc7 tempest-SharesActionsNegativeTest-299343130 None] Created reservations ['05d9dfe0-140d-407b-a80d-e61d6352f9e5', '3d1e600d-70e7-4d5f-8bf9-e6d47974906d', '98398b4f-590c-480e-8b8b-6f2a0109e957', 'a038398d-36ab-4d18-b13d-0e7ffedbf669'] {{(pid=98474) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 13:05:26 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-9dfa77fe-b17d-4c67-b508-d1a6db4d8cc7 tempest-SharesActionsNegativeTest-299343130 None] Committed reservations ['05d9dfe0-140d-407b-a80d-e61d6352f9e5', '3d1e600d-70e7-4d5f-8bf9-e6d47974906d', '98398b4f-590c-480e-8b8b-6f2a0109e957', 'a038398d-36ab-4d18-b13d-0e7ffedbf669'] {{(pid=98474) commit /opt/stack/manila/manila/quota.py:1063}} May 28 13:05:26 l75lg1-v1 manila-share[98474]: INFO manila.share.manager [None req-9dfa77fe-b17d-4c67-b508-d1a6db4d8cc7 tempest-SharesActionsNegativeTest-299343130 None] Share instance 9ccd2613-3136-4c23-9d3e-f74c5cd820eb: deleted successfully. May 28 13:05:26 l75lg1-v1 sudo[99429]: pam_unix(sudo:session): session closed for user root May 28 13:05:26 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.450s {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:428}} May 28 13:05:26 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:390}} May 28 13:05:26 l75lg1-v1 sudo[99432]: vastdata : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool May 28 13:05:26 l75lg1-v1 sudo[99432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) May 28 13:05:26 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-1b8d9252-41d4-438c-a41b-41bb09bccab3 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] GET http://10.27.203.238/share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares/b48544a1-b53b-4a46-8ade-9d9ce8f18b0e May 28 13:05:26 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-1b8d9252-41d4-438c-a41b-41bb09bccab3 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:05:26 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-1b8d9252-41d4-438c-a41b-41bb09bccab3 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:05:26 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-1b8d9252-41d4-438c-a41b-41bb09bccab3 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] HTTP exception thrown: The resource could not be found. May 28 13:05:26 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-1b8d9252-41d4-438c-a41b-41bb09bccab3 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] http://10.27.203.238/share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares/b48544a1-b53b-4a46-8ade-9d9ce8f18b0e returned with HTTP 404 May 28 13:05:26 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1375/2770] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:05:26 2024] GET /share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares/b48544a1-b53b-4a46-8ade-9d9ce8f18b0e => generated 78 bytes in 11 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 13:05:26 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-a1a73ee8-3bde-4d34-a391-fc6dc2a5090e tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] POST http://10.27.203.238/share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares May 28 13:05:26 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-a1a73ee8-3bde-4d34-a391-fc6dc2a5090e tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share": {"share_proto": "nfs", "description": "Tempest's share", "snapshot_id": null, "name": "tempest-tempest-created-share-32047774", "size": 1, "metadata": {}, "is_public": false, "share_type": "f7d65ead-0196-4e03-928f-2e08ca825112"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:05:26 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.v1.shares [None req-a1a73ee8-3bde-4d34-a391-fc6dc2a5090e tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Create NFS share of 1 GB May 28 13:05:26 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.quota [None req-a1a73ee8-3bde-4d34-a391-fc6dc2a5090e tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Created reservations ['981c138b-de69-4eba-8826-b24ab2d4e31a', '7d29f982-1855-4ac4-915f-bbb9880b4d13', 'dc3a1f5b-a09f-411c-a3e3-e5a717d392a7', 'fc5e57d7-c64b-4459-beaf-0c15217e3c9a'] {{(pid=98329) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 13:05:26 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.quota [None req-a1a73ee8-3bde-4d34-a391-fc6dc2a5090e tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Committed reservations ['981c138b-de69-4eba-8826-b24ab2d4e31a', '7d29f982-1855-4ac4-915f-bbb9880b4d13', 'dc3a1f5b-a09f-411c-a3e3-e5a717d392a7', 'fc5e57d7-c64b-4459-beaf-0c15217e3c9a'] {{(pid=98329) commit /opt/stack/manila/manila/quota.py:1063}} May 28 13:05:26 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.host_manager [None req-a1a73ee8-3bde-4d34-a391-fc6dc2a5090e tempest-SharesActionsNegativeTest-299343130 None] Share service is down. (host: l75lg1-v1@generic2). May 28 13:05:26 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.host_manager [None req-a1a73ee8-3bde-4d34-a391-fc6dc2a5090e tempest-SharesActionsNegativeTest-299343130 None] Share service is down. (host: l75lg1-v1@generic1). May 28 13:05:26 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-a1a73ee8-3bde-4d34-a391-fc6dc2a5090e tempest-SharesActionsNegativeTest-299343130 None] Starting with 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:80}} May 28 13:05:26 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-a1a73ee8-3bde-4d34-a391-fc6dc2a5090e tempest-SharesActionsNegativeTest-299343130 None] Filter OnlyHostFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:05:26 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-a1a73ee8-3bde-4d34-a391-fc6dc2a5090e tempest-SharesActionsNegativeTest-299343130 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:05:26 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.capacity [None req-a1a73ee8-3bde-4d34-a391-fc6dc2a5090e tempest-SharesActionsNegativeTest-299343130 None] Space information for share creation on host l75lg1-v1@vast#vast (requested / avail): 1/2080 {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/capacity.py:83}} May 28 13:05:26 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-a1a73ee8-3bde-4d34-a391-fc6dc2a5090e tempest-SharesActionsNegativeTest-299343130 None] Filter CapacityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:05:26 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-a1a73ee8-3bde-4d34-a391-fc6dc2a5090e tempest-SharesActionsNegativeTest-299343130 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:05:26 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-a1a73ee8-3bde-4d34-a391-fc6dc2a5090e tempest-SharesActionsNegativeTest-299343130 None] Driver Filter: Checking host 'l75lg1-v1@vast#vast' {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:37}} May 28 13:05:26 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-a1a73ee8-3bde-4d34-a391-fc6dc2a5090e tempest-SharesActionsNegativeTest-299343130 None] Filter function not set :: passing host. {{(pid=98327) _check_filter_function /opt/stack/manila/manila/scheduler/filters/driver.py:53}} May 28 13:05:26 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-a1a73ee8-3bde-4d34-a391-fc6dc2a5090e tempest-SharesActionsNegativeTest-299343130 None] Result: True {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:40}} May 28 13:05:26 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-a1a73ee8-3bde-4d34-a391-fc6dc2a5090e tempest-SharesActionsNegativeTest-299343130 None] Done checking host 'l75lg1-v1@vast#vast' {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:41}} May 28 13:05:26 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-a1a73ee8-3bde-4d34-a391-fc6dc2a5090e tempest-SharesActionsNegativeTest-299343130 None] Filter DriverFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:05:26 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-a1a73ee8-3bde-4d34-a391-fc6dc2a5090e tempest-SharesActionsNegativeTest-299343130 None] Filter ShareReplicationFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:05:26 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-a1a73ee8-3bde-4d34-a391-fc6dc2a5090e tempest-SharesActionsNegativeTest-299343130 None] Filter CreateFromSnapshotFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:05:26 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-a1a73ee8-3bde-4d34-a391-fc6dc2a5090e tempest-SharesActionsNegativeTest-299343130 None] Filter AffinityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:05:26 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-a1a73ee8-3bde-4d34-a391-fc6dc2a5090e tempest-SharesActionsNegativeTest-299343130 None] Filter AntiAffinityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:05:26 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.drivers.filter [None req-a1a73ee8-3bde-4d34-a391-fc6dc2a5090e tempest-SharesActionsNegativeTest-299343130 None] Filtered share [host: 'l75lg1-v1@vast#vast', free_capacity_gb: 2080.6423625880852, pools: None] {{(pid=98327) _schedule_share /opt/stack/manila/manila/scheduler/drivers/filter.py:268}} May 28 13:05:26 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-a1a73ee8-3bde-4d34-a391-fc6dc2a5090e tempest-SharesActionsNegativeTest-299343130 None] Checking host 'l75lg1-v1@vast#vast' {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:46}} May 28 13:05:26 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.weighers.goodness [None req-a1a73ee8-3bde-4d34-a391-fc6dc2a5090e tempest-SharesActionsNegativeTest-299343130 None] Goodness function not set :: defaulting to minimal goodness rating of 0. May 28 13:05:26 l75lg1-v1 manila-scheduler[98327]: INFO manila.scheduler.weighers.goodness [None req-a1a73ee8-3bde-4d34-a391-fc6dc2a5090e tempest-SharesActionsNegativeTest-299343130 None] Goodness function result for host l75lg1-v1@vast#vast: 0. May 28 13:05:26 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-a1a73ee8-3bde-4d34-a391-fc6dc2a5090e tempest-SharesActionsNegativeTest-299343130 None] Goodness: 0 {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:48}} May 28 13:05:26 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-a1a73ee8-3bde-4d34-a391-fc6dc2a5090e tempest-SharesActionsNegativeTest-299343130 None] Done checking host 'l75lg1-v1@vast#vast' {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:49}} May 28 13:05:26 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.drivers.filter [None req-a1a73ee8-3bde-4d34-a391-fc6dc2a5090e tempest-SharesActionsNegativeTest-299343130 None] Choosing for share: WeighedHost [host: l75lg1-v1@vast#vast, weight: 0.0] {{(pid=98327) _schedule_share /opt/stack/manila/manila/scheduler/drivers/filter.py:274}} May 28 13:05:26 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-a1a73ee8-3bde-4d34-a391-fc6dc2a5090e tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] http://10.27.203.238/share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares returned with HTTP 200 May 28 13:05:26 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1396/2771] 10.27.203.238 () {66 vars in 1362 bytes} [Tue May 28 13:05:26 2024] POST /share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares => generated 1311 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:05:26 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-cb65e49b-56c1-449d-a839-5cacf996d813 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] GET http://10.27.203.238/share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares/ffa2cd86-28a5-40cc-88b8-2bce0c5bfa51 May 28 13:05:26 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-cb65e49b-56c1-449d-a839-5cacf996d813 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:05:26 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-cb65e49b-56c1-449d-a839-5cacf996d813 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:05:26 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-cb65e49b-56c1-449d-a839-5cacf996d813 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] http://10.27.203.238/share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares/ffa2cd86-28a5-40cc-88b8-2bce0c5bfa51 returned with HTTP 200 May 28 13:05:26 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1376/2772] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:05:26 2024] GET /share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares/ffa2cd86-28a5-40cc-88b8-2bce0c5bfa51 => generated 1311 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:05:27 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a1a73ee8-3bde-4d34-a391-fc6dc2a5090e tempest-SharesActionsNegativeTest-299343130 None] >>> [GET] https://127.0.0.1:40443/api/vippools/ May 28 13:05:27 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a1a73ee8-3bde-4d34-a391-fc6dc2a5090e tempest-SharesActionsNegativeTest-299343130 None] {'allow_redirects': True, 'params': {'name': 'vippool-1'}} May 28 13:05:27 l75lg1-v1 sudo[99432]: pam_unix(sudo:session): session closed for user root May 28 13:05:27 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.470s {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:428}} May 28 13:05:27 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:390}} May 28 13:05:27 l75lg1-v1 sudo[99435]: vastdata : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 May 28 13:05:27 l75lg1-v1 sudo[99435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) May 28 13:05:27 l75lg1-v1 dstat.sh[49771]: 28-05 13:05:27| 13 2 83 2 0|5527M 1884M 278M 7935M| 19k 5561B| 641k 1557k|5.00 242 |4635 7507 |1.06 1.07 1.04|3.0 0 6.0| 0 0 | 0 2048M| 29 359 0 10 6 May 28 13:05:27 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a1a73ee8-3bde-4d34-a391-fc6dc2a5090e tempest-SharesActionsNegativeTest-299343130 None] <<< [GET] https://127.0.0.1:40443/api/vippools/ May 28 13:05:27 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a1a73ee8-3bde-4d34-a391-fc6dc2a5090e tempest-SharesActionsNegativeTest-299343130 None] [Bunch(active_cnode_ids=[], active_interfaces=4, cluster='loop75-kfs', cluster_id=1, cnode_ids=[], cnodes=[], domain_name='vippool-1', enable_l3=False, enable_weighted_balancing=False, enabled=True, end_ip='172.21.75.4', guid='f2abaede-b397-413a-8faa-3aeead6d3b28', gw_ip='', gw_ipv6='', id=2, ip_ranges=[['172.21.75.1', '172.21.75.4']], name='vippool-1', peer_asn=0, port_membership='ALL', ranges_summary='172.21.75.[1-4]', role='PROTOCOLS', start_ip='172.21.75.1', subnet_cidr=16, subnet_cidr_ipv6=None, sync='SYNCED', sync_time='2024-05-28T12:50:09.644123Z', tenant_id=1, tenant_name='default', title='172.21.75.1 - 172.21.75.4', url='https://127.0.0.1:40443/api/vippools/2/', vast_asn=0, vlan=0, vms_preferred=False)] May 28 13:05:27 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a1a73ee8-3bde-4d34-a391-fc6dc2a5090e tempest-SharesActionsNegativeTest-299343130 None] --- [GET] https://127.0.0.1:40443/api/vippools/: Done May 28 13:05:27 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a1a73ee8-3bde-4d34-a391-fc6dc2a5090e tempest-SharesActionsNegativeTest-299343130 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:05:27 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a1a73ee8-3bde-4d34-a391-fc6dc2a5090e tempest-SharesActionsNegativeTest-299343130 None] {'allow_redirects': True, May 28 13:05:27 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a1a73ee8-3bde-4d34-a391-fc6dc2a5090e tempest-SharesActionsNegativeTest-299343130 None] 'params': {'name': '888fc5d8-ba1b-491b-aab1-eff87dbf509d'}} May 28 13:05:27 l75lg1-v1 sudo[99435]: pam_unix(sudo:session): session closed for user root May 28 13:05:27 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.489s {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:428}} May 28 13:05:27 l75lg1-v1 cinder-volume[85846]: DEBUG cinder.manager [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] Notifying Schedulers of capabilities ... {{(pid=85846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 28 13:05:27 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.scheduler.host_manager [None req-8e9847f0-4ae2-447c-a783-21459ba787f6 None None] Received volume service update from l75lg1-v1@lvmdriver-1: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:l75lg1-v1:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up', 'allocated_capacity_gb': 0, 'cacheable': True}], 'shared_targets': False, 'sparse_copy_volume': True, 'filter_function': None, 'goodness_function': None} {{(pid=85128) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:628}} May 28 13:05:27 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a1a73ee8-3bde-4d34-a391-fc6dc2a5090e tempest-SharesActionsNegativeTest-299343130 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:05:27 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a1a73ee8-3bde-4d34-a391-fc6dc2a5090e tempest-SharesActionsNegativeTest-299343130 None] [] May 28 13:05:27 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a1a73ee8-3bde-4d34-a391-fc6dc2a5090e tempest-SharesActionsNegativeTest-299343130 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 13:05:27 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a1a73ee8-3bde-4d34-a391-fc6dc2a5090e tempest-SharesActionsNegativeTest-299343130 None] >>> [POST] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:05:27 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a1a73ee8-3bde-4d34-a391-fc6dc2a5090e tempest-SharesActionsNegativeTest-299343130 None] {'data': '{"name": "888fc5d8-ba1b-491b-aab1-eff87dbf509d"}', May 28 13:05:27 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a1a73ee8-3bde-4d34-a391-fc6dc2a5090e tempest-SharesActionsNegativeTest-299343130 None] 'json': None, May 28 13:05:27 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a1a73ee8-3bde-4d34-a391-fc6dc2a5090e tempest-SharesActionsNegativeTest-299343130 None] 'params': None} May 28 13:05:28 l75lg1-v1 dstat.sh[49771]: 28-05 13:05:28| 6 1 92 0 0|5521M 1890M 278M 7935M| 14k 1563B| 256k 1115k|2.00 219 |2944 5163 |1.05 1.07 1.04| 0 0 53| 0 0 | 0 2048M| 29 359 0 10 6 May 28 13:05:28 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a1a73ee8-3bde-4d34-a391-fc6dc2a5090e tempest-SharesActionsNegativeTest-299343130 None] <<< [POST] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:05:28 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a1a73ee8-3bde-4d34-a391-fc6dc2a5090e tempest-SharesActionsNegativeTest-299343130 None] Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=0, created='2024-05-28T13:05:28.266899Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='8e1dcfa5-9f4f-49d6-b599-2bd9db5752c7', id=67, internal=False, is_s3_default_policy=False, name='888fc5d8-ba1b-491b-aab1-eff87dbf509d', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=[], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['*'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['*'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T13:05:28.576072Z', tenant_id=1, tenant_name='default', title='888fc5d8-ba1b-491b-aab1-eff87dbf509d', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/67/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[]) May 28 13:05:28 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a1a73ee8-3bde-4d34-a391-fc6dc2a5090e tempest-SharesActionsNegativeTest-299343130 None] --- [POST] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 13:05:28 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a1a73ee8-3bde-4d34-a391-fc6dc2a5090e tempest-SharesActionsNegativeTest-299343130 None] >>> [GET] https://127.0.0.1:40443/api/quotas/ May 28 13:05:28 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a1a73ee8-3bde-4d34-a391-fc6dc2a5090e tempest-SharesActionsNegativeTest-299343130 None] {'allow_redirects': True, May 28 13:05:28 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a1a73ee8-3bde-4d34-a391-fc6dc2a5090e tempest-SharesActionsNegativeTest-299343130 None] 'params': {'name': '888fc5d8-ba1b-491b-aab1-eff87dbf509d'}} May 28 13:05:28 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a1a73ee8-3bde-4d34-a391-fc6dc2a5090e tempest-SharesActionsNegativeTest-299343130 None] <<< [GET] https://127.0.0.1:40443/api/quotas/ May 28 13:05:28 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a1a73ee8-3bde-4d34-a391-fc6dc2a5090e tempest-SharesActionsNegativeTest-299343130 None] [] May 28 13:05:28 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a1a73ee8-3bde-4d34-a391-fc6dc2a5090e tempest-SharesActionsNegativeTest-299343130 None] --- [GET] https://127.0.0.1:40443/api/quotas/: Done May 28 13:05:28 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a1a73ee8-3bde-4d34-a391-fc6dc2a5090e tempest-SharesActionsNegativeTest-299343130 None] >>> [POST] https://127.0.0.1:40443/api/quotas/ May 28 13:05:28 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a1a73ee8-3bde-4d34-a391-fc6dc2a5090e tempest-SharesActionsNegativeTest-299343130 None] {'data': '{"name": "888fc5d8-ba1b-491b-aab1-eff87dbf509d", "path": ' May 28 13:05:28 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a1a73ee8-3bde-4d34-a391-fc6dc2a5090e tempest-SharesActionsNegativeTest-299343130 None] '"/manila/manila-888fc5d8-ba1b-491b-aab1-eff87dbf509d", "create_dir": ' May 28 13:05:28 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a1a73ee8-3bde-4d34-a391-fc6dc2a5090e tempest-SharesActionsNegativeTest-299343130 None] 'true, "hard_limit": 1073741824}', May 28 13:05:28 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a1a73ee8-3bde-4d34-a391-fc6dc2a5090e tempest-SharesActionsNegativeTest-299343130 None] 'json': None, May 28 13:05:28 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a1a73ee8-3bde-4d34-a391-fc6dc2a5090e tempest-SharesActionsNegativeTest-299343130 None] 'params': None} May 28 13:05:29 l75lg1-v1 dstat.sh[49771]: 28-05 13:05:29| 1 0 99 0 0|5521M 1890M 278M 7935M| 13k 1668B| 0 148k| 0 11.0 |1560 2460 |1.05 1.07 1.04| 0 0 2.0| 0 0 | 0 2048M| 29 359 0 10 6 May 28 13:05:29 l75lg1-v1 nova-conductor[83647]: DEBUG dbcounter [-] [83647] Writing DB stats nova_cell1:SELECT=1,nova_cell1:UPDATE=1 {{(pid=83647) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:05:29 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a1a73ee8-3bde-4d34-a391-fc6dc2a5090e tempest-SharesActionsNegativeTest-299343130 None] <<< [POST] https://127.0.0.1:40443/api/quotas/ May 28 13:05:29 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a1a73ee8-3bde-4d34-a391-fc6dc2a5090e tempest-SharesActionsNegativeTest-299343130 None] Bunch(cluster='loop75-kfs', cluster_id=1, default_email=None, default_group_quota=None, default_user_quota=None, enable_alarms=True, enable_email_providers=True, grace_period=None, group_quotas=[], guid='32968b4a-b1ec-453e-9689-7cffe977c50d', hard_limit=1073741824, hard_limit_inodes=None, id=64, internal=False, is_user_quota=False, last_user_quotas_update=None, name='888fc5d8-ba1b-491b-aab1-eff87dbf509d', num_blocked_users=0, num_exceeded_users=0, path='/manila/manila-888fc5d8-ba1b-491b-aab1-eff87dbf509d', percent_capacity=0, percent_inodes=None, pretty_grace_period=None, pretty_grace_period_expiration=None, pretty_state='OK (CREATED)', soft_limit=None, soft_limit_inodes=None, state='OK', sync_state='CREATED', system_id=64, tenant_id=1, tenant_name='default', time_to_block=None, title='888fc5d8-ba1b-491b-aab1-eff87dbf509d', url='https://127.0.0.1:40443/api/quotas/64/', used_capacity=0, used_capacity_tb=0.0, used_effective_capacity=0, used_effective_capacity_tb=0.0, used_inodes=0, used_limited_capacity=0, user_quotas=[]) May 28 13:05:29 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a1a73ee8-3bde-4d34-a391-fc6dc2a5090e tempest-SharesActionsNegativeTest-299343130 None] --- [POST] https://127.0.0.1:40443/api/quotas/: Done May 28 13:05:29 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a1a73ee8-3bde-4d34-a391-fc6dc2a5090e tempest-SharesActionsNegativeTest-299343130 None] >>> [GET] https://127.0.0.1:40443/api/views/ May 28 13:05:29 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a1a73ee8-3bde-4d34-a391-fc6dc2a5090e tempest-SharesActionsNegativeTest-299343130 None] {'allow_redirects': True, May 28 13:05:29 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a1a73ee8-3bde-4d34-a391-fc6dc2a5090e tempest-SharesActionsNegativeTest-299343130 None] 'params': {'name': '888fc5d8-ba1b-491b-aab1-eff87dbf509d'}} May 28 13:05:30 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-d58bab43-c09d-40f1-9760-663d690b4a9e tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] GET http://10.27.203.238/share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares/ffa2cd86-28a5-40cc-88b8-2bce0c5bfa51 May 28 13:05:30 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-d58bab43-c09d-40f1-9760-663d690b4a9e tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:05:30 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-d58bab43-c09d-40f1-9760-663d690b4a9e tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:05:30 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-d58bab43-c09d-40f1-9760-663d690b4a9e tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] http://10.27.203.238/share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares/ffa2cd86-28a5-40cc-88b8-2bce0c5bfa51 returned with HTTP 200 May 28 13:05:30 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1397/2773] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:05:29 2024] GET /share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares/ffa2cd86-28a5-40cc-88b8-2bce0c5bfa51 => generated 1313 bytes in 24 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:05:30 l75lg1-v1 nova-conductor[83648]: DEBUG dbcounter [-] [83648] Writing DB stats nova_cell1:SELECT=1 {{(pid=83648) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:05:30 l75lg1-v1 dstat.sh[49771]: 28-05 13:05:30| 1 0 97 1 0|5522M 1889M 278M 7935M| 19k 736B| 0 2141k| 0 181 |2226 3513 |1.05 1.07 1.04| 0 0 0| 0 0 | 0 2048M| 29 359 0 7 6 May 28 13:05:30 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a1a73ee8-3bde-4d34-a391-fc6dc2a5090e tempest-SharesActionsNegativeTest-299343130 None] <<< [GET] https://127.0.0.1:40443/api/views/ May 28 13:05:30 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a1a73ee8-3bde-4d34-a391-fc6dc2a5090e tempest-SharesActionsNegativeTest-299343130 None] [] May 28 13:05:30 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a1a73ee8-3bde-4d34-a391-fc6dc2a5090e tempest-SharesActionsNegativeTest-299343130 None] --- [GET] https://127.0.0.1:40443/api/views/: Done May 28 13:05:30 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a1a73ee8-3bde-4d34-a391-fc6dc2a5090e tempest-SharesActionsNegativeTest-299343130 None] >>> [POST] https://127.0.0.1:40443/api/views/ May 28 13:05:30 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a1a73ee8-3bde-4d34-a391-fc6dc2a5090e tempest-SharesActionsNegativeTest-299343130 None] {'data': '{"name": "888fc5d8-ba1b-491b-aab1-eff87dbf509d", "path": ' May 28 13:05:30 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a1a73ee8-3bde-4d34-a391-fc6dc2a5090e tempest-SharesActionsNegativeTest-299343130 None] '"/manila/manila-888fc5d8-ba1b-491b-aab1-eff87dbf509d", "policy_id": ' May 28 13:05:30 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a1a73ee8-3bde-4d34-a391-fc6dc2a5090e tempest-SharesActionsNegativeTest-299343130 None] '67, "create_dir": true, "protocols": ["NFS"]}', May 28 13:05:30 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a1a73ee8-3bde-4d34-a391-fc6dc2a5090e tempest-SharesActionsNegativeTest-299343130 None] 'json': None, May 28 13:05:30 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a1a73ee8-3bde-4d34-a391-fc6dc2a5090e tempest-SharesActionsNegativeTest-299343130 None] 'params': None} May 28 13:05:30 l75lg1-v1 neutron-server[77618]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.HashRingHealthCheckPeriodics.touch_hash_ring_nodes' {{(pid=77618) _process_scheduled /opt/stack/data/venv/lib/python3.10/site-packages/futurist/periodics.py:638}} May 28 13:05:31 l75lg1-v1 dstat.sh[49771]: 28-05 13:05:31| 1 0 98 0 0|5522M 1889M 278M 7935M| 19k 940B| 0 292k| 0 38.0 |2021 3180 |1.05 1.07 1.04| 0 0 0| 0 0 | 0 2048M| 29 359 0 7 6 May 28 13:05:31 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a1a73ee8-3bde-4d34-a391-fc6dc2a5090e tempest-SharesActionsNegativeTest-299343130 None] <<< [POST] https://127.0.0.1:40443/api/views/ May 28 13:05:31 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a1a73ee8-3bde-4d34-a391-fc6dc2a5090e tempest-SharesActionsNegativeTest-299343130 None] Bunch(abac_tags=[], abe_max_depth=None, abe_protocols=[], alias='', allow_anonymous_access=False, allow_s3_anonymous_access=False, auto_commit='0d', bucket='', bucket_creators=[], bucket_creators_groups=[], bucket_owner=None, bulk_permission_update_progress=None, bulk_permission_update_state=None, cluster='loop75-kfs', cluster_id=1, created='2024-05-28T13:05:30.957392Z', enabled=True, files_retention_mode='NONE', guid='2e8e6548-2ca9-470a-9222-012500ec7168', id=66, ignore_oos=False, internal=False, is_remote=False, is_seamless=False, logical_capacity=0, max_retention_period=None, min_retention_period=None, name='888fc5d8-ba1b-491b-aab1-eff87dbf509d', nfs_interop_flags='BOTH_NFS3_AND_NFS4_INTEROP_DISABLED', path='/manila/manila-888fc5d8-ba1b-491b-aab1-eff87dbf509d', physical_capacity=0, policy='888fc5d8-ba1b-491b-aab1-eff87dbf509d', policy_id=67, protocols=['NFS'], qos_policy=None, qos_policy_id=None, s3_locks=False, s3_locks_retention_mode='NONE', s3_locks_retention_period='', s3_object_ownership_rule='ObjectWriter', s3_unverified_lookup=False, s3_versioning=False, select_for_live_monitoring=False, share='', share_acl=Bunch(acl=[], enabled=False), sync='SYNCED', sync_time='2024-05-28T13:05:31.208112Z', tenant_id=1, tenant_name='default', title='/manila/manila-888fc5d8-ba1b-491b-aab1-eff87dbf509d', url='https://127.0.0.1:40443/api/views/66/') May 28 13:05:31 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-a1a73ee8-3bde-4d34-a391-fc6dc2a5090e tempest-SharesActionsNegativeTest-299343130 None] --- [POST] https://127.0.0.1:40443/api/views/: Done May 28 13:05:31 l75lg1-v1 manila-share[98474]: DEBUG dbcounter [-] [98474] Writing DB stats manila:INSERT=20,manila:SELECT=318,manila:UPDATE=42 {{(pid=98474) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:05:31 l75lg1-v1 manila-share[98474]: INFO manila.share.manager [None req-a1a73ee8-3bde-4d34-a391-fc6dc2a5090e tempest-SharesActionsNegativeTest-299343130 None] Share instance 888fc5d8-ba1b-491b-aab1-eff87dbf509d created successfully. May 28 13:05:31 l75lg1-v1 manila-data[98318]: DEBUG dbcounter [-] [98318] Writing DB stats manila:SELECT=30,manila:UPDATE=7 {{(pid=98318) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:05:32 l75lg1-v1 dstat.sh[49771]: 28-05 13:05:32| 1 0 97 1 0|5522M 1889M 278M 7935M| 18k 66B| 0 532k| 0 98.0 |2537 4222 |1.05 1.07 1.04|1.0 0 0| 0 0 | 0 2048M| 29 359 0 6 6 May 28 13:05:32 l75lg1-v1 neutron-server[77623]: DEBUG dbcounter [-] [77623] Writing DB stats neutron:SELECT=1 {{(pid=77623) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:05:33 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-5e00ec8c-8f05-44fe-aa5a-72bc12e7178f tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] GET http://10.27.203.238/share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares/ffa2cd86-28a5-40cc-88b8-2bce0c5bfa51 May 28 13:05:33 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-5e00ec8c-8f05-44fe-aa5a-72bc12e7178f tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:05:33 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-5e00ec8c-8f05-44fe-aa5a-72bc12e7178f tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:05:33 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-5e00ec8c-8f05-44fe-aa5a-72bc12e7178f tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] http://10.27.203.238/share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares/ffa2cd86-28a5-40cc-88b8-2bce0c5bfa51 returned with HTTP 200 May 28 13:05:33 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1377/2774] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:05:33 2024] GET /share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares/ffa2cd86-28a5-40cc-88b8-2bce0c5bfa51 => generated 1316 bytes in 25 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:05:33 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-9b4d4a64-b070-4f52-b95e-c29d0bd429a0 tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] POST http://10.27.203.238/share/v2/c7f81fe24c76497a89dd033554ce1057/shares/ffa2cd86-28a5-40cc-88b8-2bce0c5bfa51/action May 28 13:05:33 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-9b4d4a64-b070-4f52-b95e-c29d0bd429a0 tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] Action body: b'{"reset_status": {"status": "error_deleting"}}' {{(pid=98329) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 13:05:33 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-9b4d4a64-b070-4f52-b95e-c29d0bd429a0 tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] Action: 'action', calling method: ShareController.share_reset_status, body: {"reset_status": {"status": "error_deleting"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:05:33 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-9b4d4a64-b070-4f52-b95e-c29d0bd429a0 tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] Updating share 'ffa2cd86-28a5-40cc-88b8-2bce0c5bfa51' with '{'status': 'error_deleting'}' {{(pid=98329) _reset_status /opt/stack/manila/manila/api/openstack/wsgi.py:1257}} May 28 13:05:33 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-9b4d4a64-b070-4f52-b95e-c29d0bd429a0 tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] http://10.27.203.238/share/v2/c7f81fe24c76497a89dd033554ce1057/shares/ffa2cd86-28a5-40cc-88b8-2bce0c5bfa51/action returned with HTTP 202 May 28 13:05:33 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1398/2775] 10.27.203.238 () {66 vars in 1493 bytes} [Tue May 28 13:05:33 2024] POST /share/v2/c7f81fe24c76497a89dd033554ce1057/shares/ffa2cd86-28a5-40cc-88b8-2bce0c5bfa51/action => generated 0 bytes in 57 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 13:05:33 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-37a568c7-cd7e-4927-9963-45c11ce79f97 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] POST http://10.27.203.238/share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares/ffa2cd86-28a5-40cc-88b8-2bce0c5bfa51/action May 28 13:05:33 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-37a568c7-cd7e-4927-9963-45c11ce79f97 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Action body: b'{"soft_delete": null}' {{(pid=98330) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 13:05:33 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-37a568c7-cd7e-4927-9963-45c11ce79f97 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Action: 'action', calling method: ShareController.share_soft_delete, body: {"soft_delete": null} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:05:33 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.v2.shares [None req-37a568c7-cd7e-4927-9963-45c11ce79f97 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Soft delete share with id: ffa2cd86-28a5-40cc-88b8-2bce0c5bfa51 {{(pid=98330) share_soft_delete /opt/stack/manila/manila/api/v2/shares.py:280}} May 28 13:05:33 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-37a568c7-cd7e-4927-9963-45c11ce79f97 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] HTTP exception thrown: Invalid share: Share status must be one of ('available', 'error', 'inactive'). May 28 13:05:33 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-37a568c7-cd7e-4927-9963-45c11ce79f97 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] http://10.27.203.238/share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares/ffa2cd86-28a5-40cc-88b8-2bce0c5bfa51/action returned with HTTP 403 May 28 13:05:33 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1378/2776] 10.27.203.238 () {66 vars in 1493 bytes} [Tue May 28 13:05:33 2024] POST /share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares/ffa2cd86-28a5-40cc-88b8-2bce0c5bfa51/action => generated 121 bytes in 31 msecs (HTTP/1.1 403) 6 headers in 238 bytes (1 switches on core 0) May 28 13:05:33 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-9573e82d-abaf-4cda-aaae-b38296c0cc63 tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] POST http://10.27.203.238/share/v2/c7f81fe24c76497a89dd033554ce1057/shares/ffa2cd86-28a5-40cc-88b8-2bce0c5bfa51/action May 28 13:05:33 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-9573e82d-abaf-4cda-aaae-b38296c0cc63 tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] Action body: b'{"reset_status": {"status": "available"}}' {{(pid=98329) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 13:05:33 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-9573e82d-abaf-4cda-aaae-b38296c0cc63 tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] Action: 'action', calling method: ShareController.share_reset_status, body: {"reset_status": {"status": "available"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:05:33 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-9573e82d-abaf-4cda-aaae-b38296c0cc63 tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] Updating share 'ffa2cd86-28a5-40cc-88b8-2bce0c5bfa51' with '{'status': 'available'}' {{(pid=98329) _reset_status /opt/stack/manila/manila/api/openstack/wsgi.py:1257}} May 28 13:05:33 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-9573e82d-abaf-4cda-aaae-b38296c0cc63 tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] http://10.27.203.238/share/v2/c7f81fe24c76497a89dd033554ce1057/shares/ffa2cd86-28a5-40cc-88b8-2bce0c5bfa51/action returned with HTTP 202 May 28 13:05:33 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1399/2777] 10.27.203.238 () {66 vars in 1493 bytes} [Tue May 28 13:05:33 2024] POST /share/v2/c7f81fe24c76497a89dd033554ce1057/shares/ffa2cd86-28a5-40cc-88b8-2bce0c5bfa51/action => generated 0 bytes in 58 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 13:05:33 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-59c32912-db92-4cea-a68e-50c7349848a4 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] GET http://10.27.203.238/share/v2/c39deaad5eb341ceb2e3c79518f56a1b/share-replicas/detail?share_id=ffa2cd86-28a5-40cc-88b8-2bce0c5bfa51 May 28 13:05:33 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-59c32912-db92-4cea-a68e-50c7349848a4 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:05:33 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-59c32912-db92-4cea-a68e-50c7349848a4 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:05:33 l75lg1-v1 devstack@m-api.service[98330]: DEBUG dbcounter [-] [98330] Writing DB stats manila:SELECT=182,manila:UPDATE=9,manila:INSERT=6 {{(pid=98330) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:05:33 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-59c32912-db92-4cea-a68e-50c7349848a4 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] http://10.27.203.238/share/v2/c39deaad5eb341ceb2e3c79518f56a1b/share-replicas/detail?share_id=ffa2cd86-28a5-40cc-88b8-2bce0c5bfa51 returned with HTTP 200 May 28 13:05:33 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1379/2778] 10.27.203.238 () {64 vars in 1476 bytes} [Tue May 28 13:05:33 2024] GET /share/v2/c39deaad5eb341ceb2e3c79518f56a1b/share-replicas/detail?share_id=ffa2cd86-28a5-40cc-88b8-2bce0c5bfa51 => generated 22 bytes in 14 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:05:33 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-dfe5b701-d296-4026-a999-b7601f5da234 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] DELETE http://10.27.203.238/share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares/ffa2cd86-28a5-40cc-88b8-2bce0c5bfa51 May 28 13:05:33 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-dfe5b701-d296-4026-a999-b7601f5da234 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:05:33 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-dfe5b701-d296-4026-a999-b7601f5da234 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Calling method 'ShareMixin.delete' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:05:33 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.v1.shares [None req-dfe5b701-d296-4026-a999-b7601f5da234 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Delete share with id: ffa2cd86-28a5-40cc-88b8-2bce0c5bfa51 May 28 13:05:33 l75lg1-v1 dstat.sh[49771]: 28-05 13:05:33| 3 0 95 1 0|5522M 1889M 278M 7935M| 18k 0 | 0 528k| 0 79.0 |2641 4231 |0.97 1.05 1.03|1.0 0 0| 0 0 | 0 2048M| 29 360 0 6 6 May 28 13:05:33 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-dfe5b701-d296-4026-a999-b7601f5da234 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] http://10.27.203.238/share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares/ffa2cd86-28a5-40cc-88b8-2bce0c5bfa51 returned with HTTP 202 May 28 13:05:33 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1400/2779] 10.27.203.238 () {64 vars in 1454 bytes} [Tue May 28 13:05:33 2024] DELETE /share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares/ffa2cd86-28a5-40cc-88b8-2bce0c5bfa51 => generated 0 bytes in 122 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 13:05:33 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-87d0b70e-a161-4088-860e-a1f0979e0f81 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] GET http://10.27.203.238/share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares/ffa2cd86-28a5-40cc-88b8-2bce0c5bfa51 May 28 13:05:33 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-87d0b70e-a161-4088-860e-a1f0979e0f81 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:05:33 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-87d0b70e-a161-4088-860e-a1f0979e0f81 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:05:33 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-87d0b70e-a161-4088-860e-a1f0979e0f81 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] http://10.27.203.238/share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares/ffa2cd86-28a5-40cc-88b8-2bce0c5bfa51 returned with HTTP 200 May 28 13:05:33 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1380/2780] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:05:33 2024] GET /share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares/ffa2cd86-28a5-40cc-88b8-2bce0c5bfa51 => generated 1315 bytes in 24 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:05:33 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-dfe5b701-d296-4026-a999-b7601f5da234 tempest-SharesActionsNegativeTest-299343130 None] Acquiring lock "locked_access_rules_operation_by_share_instance_888fc5d8-ba1b-491b-aab1-eff87dbf509d" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:05:33 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-dfe5b701-d296-4026-a999-b7601f5da234 tempest-SharesActionsNegativeTest-299343130 None] Lock "locked_access_rules_operation_by_share_instance_888fc5d8-ba1b-491b-aab1-eff87dbf509d" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:05:33 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-dfe5b701-d296-4026-a999-b7601f5da234 tempest-SharesActionsNegativeTest-299343130 None] Lock "locked_access_rules_operation_by_share_instance_888fc5d8-ba1b-491b-aab1-eff87dbf509d" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:05:33 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-dfe5b701-d296-4026-a999-b7601f5da234 tempest-SharesActionsNegativeTest-299343130 None] Acquiring lock "locked_access_rules_operation_by_share_instance_888fc5d8-ba1b-491b-aab1-eff87dbf509d" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:05:33 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-dfe5b701-d296-4026-a999-b7601f5da234 tempest-SharesActionsNegativeTest-299343130 None] Lock "locked_access_rules_operation_by_share_instance_888fc5d8-ba1b-491b-aab1-eff87dbf509d" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:05:33 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-dfe5b701-d296-4026-a999-b7601f5da234 tempest-SharesActionsNegativeTest-299343130 None] Lock "locked_access_rules_operation_by_share_instance_888fc5d8-ba1b-491b-aab1-eff87dbf509d" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:05:33 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-dfe5b701-d296-4026-a999-b7601f5da234 tempest-SharesActionsNegativeTest-299343130 None] Acquiring lock "locked_access_rules_operation_by_share_instance_888fc5d8-ba1b-491b-aab1-eff87dbf509d" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:05:33 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-dfe5b701-d296-4026-a999-b7601f5da234 tempest-SharesActionsNegativeTest-299343130 None] Lock "locked_access_rules_operation_by_share_instance_888fc5d8-ba1b-491b-aab1-eff87dbf509d" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:05:33 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-dfe5b701-d296-4026-a999-b7601f5da234 tempest-SharesActionsNegativeTest-299343130 None] Lock "locked_access_rules_operation_by_share_instance_888fc5d8-ba1b-491b-aab1-eff87dbf509d" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:05:33 l75lg1-v1 manila-share[98474]: DEBUG manila.share.access [None req-dfe5b701-d296-4026-a999-b7601f5da234 tempest-SharesActionsNegativeTest-299343130 None] All access rules have been synced for share instance 888fc5d8-ba1b-491b-aab1-eff87dbf509d belonging to share ffa2cd86-28a5-40cc-88b8-2bce0c5bfa51. {{(pid=98474) update_access_rules /opt/stack/manila/manila/share/access.py:304}} May 28 13:05:33 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-dfe5b701-d296-4026-a999-b7601f5da234 tempest-SharesActionsNegativeTest-299343130 None] deleting '/manila/manila-888fc5d8-ba1b-491b-aab1-eff87dbf509d' May 28 13:05:33 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-dfe5b701-d296-4026-a999-b7601f5da234 tempest-SharesActionsNegativeTest-299343130 None] >>> [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/ May 28 13:05:33 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-dfe5b701-d296-4026-a999-b7601f5da234 tempest-SharesActionsNegativeTest-299343130 None] {'data': '{"path": "/manila/manila-888fc5d8-ba1b-491b-aab1-eff87dbf509d"}', May 28 13:05:33 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-dfe5b701-d296-4026-a999-b7601f5da234 tempest-SharesActionsNegativeTest-299343130 None] 'params': None} May 28 13:05:33 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-dfe5b701-d296-4026-a999-b7601f5da234 tempest-SharesActionsNegativeTest-299343130 None] <<< [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/ May 28 13:05:33 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-dfe5b701-d296-4026-a999-b7601f5da234 tempest-SharesActionsNegativeTest-299343130 None] 'OK' May 28 13:05:33 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-dfe5b701-d296-4026-a999-b7601f5da234 tempest-SharesActionsNegativeTest-299343130 None] --- [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/: Done May 28 13:05:33 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-dfe5b701-d296-4026-a999-b7601f5da234 tempest-SharesActionsNegativeTest-299343130 None] >>> [GET] https://127.0.0.1:40443/api/views/ May 28 13:05:33 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-dfe5b701-d296-4026-a999-b7601f5da234 tempest-SharesActionsNegativeTest-299343130 None] {'allow_redirects': True, May 28 13:05:33 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-dfe5b701-d296-4026-a999-b7601f5da234 tempest-SharesActionsNegativeTest-299343130 None] 'params': {'name': '888fc5d8-ba1b-491b-aab1-eff87dbf509d'}} May 28 13:05:33 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-dfe5b701-d296-4026-a999-b7601f5da234 tempest-SharesActionsNegativeTest-299343130 None] <<< [GET] https://127.0.0.1:40443/api/views/ May 28 13:05:33 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-dfe5b701-d296-4026-a999-b7601f5da234 tempest-SharesActionsNegativeTest-299343130 None] [Bunch(abac_tags=[], abe_max_depth=None, abe_protocols=[], alias='', allow_anonymous_access=False, allow_s3_anonymous_access=False, auto_commit='0d', bucket='', bucket_creators=[], bucket_creators_groups=[], bucket_owner=None, bulk_permission_update_progress=None, bulk_permission_update_state=None, cluster='loop75-kfs', cluster_id=1, created='2024-05-28T13:05:30.957392Z', enabled=True, files_retention_mode='NONE', guid='2e8e6548-2ca9-470a-9222-012500ec7168', id=66, ignore_oos=False, internal=False, is_remote=False, is_seamless=False, logical_capacity=0, max_retention_period=None, min_retention_period=None, name='888fc5d8-ba1b-491b-aab1-eff87dbf509d', nfs_interop_flags='BOTH_NFS3_AND_NFS4_INTEROP_DISABLED', path='/manila/manila-888fc5d8-ba1b-491b-aab1-eff87dbf509d', physical_capacity=0, policy='888fc5d8-ba1b-491b-aab1-eff87dbf509d', policy_id=67, protocols=['NFS'], qos_policy=None, qos_policy_id=None, s3_locks=False, s3_locks_retention_mode='NONE', s3_locks_retention_period='', s3_unverified_lookup=False, s3_versioning=False, select_for_live_monitoring=False, share='', share_acl=Bunch(acl=[], enabled=False), sync='SYNCED', sync_time='2024-05-28T13:05:31.208112Z', tenant_id=1, tenant_name='default', title='/manila/manila-888fc5d8-ba1b-491b-aab1-eff87dbf509d', url='https://127.0.0.1:40443/api/views/66/')] May 28 13:05:33 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-dfe5b701-d296-4026-a999-b7601f5da234 tempest-SharesActionsNegativeTest-299343130 None] --- [GET] https://127.0.0.1:40443/api/views/: Done May 28 13:05:33 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-dfe5b701-d296-4026-a999-b7601f5da234 tempest-SharesActionsNegativeTest-299343130 None] >>> [DELETE] https://127.0.0.1:40443/api/views/66/ May 28 13:05:34 l75lg1-v1 dstat.sh[49771]: 28-05 13:05:34| 3 0 96 0 0|5522M 1889M 278M 7935M| 28k 2168B| 0 256k| 0 28.0 |2460 3612 |0.97 1.05 1.03|1.0 0 0| 0 0 | 0 2048M| 29 359 0 6 6 May 28 13:05:34 l75lg1-v1 neutron-server[77623]: DEBUG neutron.db.agents_db [None req-fe40ce8c-640e-4db7-a17a-6e8888cce266 None None] Agent healthcheck: found 0 active agents {{(pid=77623) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:319}} May 28 13:05:35 l75lg1-v1 dstat.sh[49771]: 28-05 13:05:35| 1 0 97 2 0|5522M 1889M 278M 7935M| 14k 172B| 0 3204k| 0 240 |2063 3345 |0.97 1.05 1.03| 0 0 0| 0 0 | 0 2048M| 29 359 0 6 6 May 28 13:05:36 l75lg1-v1 dstat.sh[49771]: 28-05 13:05:36| 1 0 98 0 0|5522M 1889M 278M 7935M| 13k 0 | 0 8183B| 0 1.00 |1495 2361 |0.97 1.05 1.03|1.0 0 0| 0 0 | 0 2048M| 29 359 0 6 6 May 28 13:05:36 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-dfe5b701-d296-4026-a999-b7601f5da234 tempest-SharesActionsNegativeTest-299343130 None] <<< [DELETE] https://127.0.0.1:40443/api/views/66/ May 28 13:05:36 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-dfe5b701-d296-4026-a999-b7601f5da234 tempest-SharesActionsNegativeTest-299343130 None] --- [DELETE] https://127.0.0.1:40443/api/views/66/: Done May 28 13:05:36 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-dfe5b701-d296-4026-a999-b7601f5da234 tempest-SharesActionsNegativeTest-299343130 None] >>> [GET] https://127.0.0.1:40443/api/quotas/ May 28 13:05:36 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-dfe5b701-d296-4026-a999-b7601f5da234 tempest-SharesActionsNegativeTest-299343130 None] {'allow_redirects': True, May 28 13:05:36 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-dfe5b701-d296-4026-a999-b7601f5da234 tempest-SharesActionsNegativeTest-299343130 None] 'params': {'name': '888fc5d8-ba1b-491b-aab1-eff87dbf509d'}} May 28 13:05:36 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-a8277ced-425a-4101-a68e-f6c7b76444f7 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] GET http://10.27.203.238/share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares/ffa2cd86-28a5-40cc-88b8-2bce0c5bfa51 May 28 13:05:36 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-a8277ced-425a-4101-a68e-f6c7b76444f7 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:05:36 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-a8277ced-425a-4101-a68e-f6c7b76444f7 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:05:36 l75lg1-v1 devstack@m-api.service[98329]: DEBUG dbcounter [-] [98329] Writing DB stats manila:SELECT=233,manila:INSERT=18,manila:UPDATE=24 {{(pid=98329) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:05:36 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-a8277ced-425a-4101-a68e-f6c7b76444f7 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] http://10.27.203.238/share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares/ffa2cd86-28a5-40cc-88b8-2bce0c5bfa51 returned with HTTP 200 May 28 13:05:36 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1401/2781] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:05:36 2024] GET /share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares/ffa2cd86-28a5-40cc-88b8-2bce0c5bfa51 => generated 1315 bytes in 28 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:05:36 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-dfe5b701-d296-4026-a999-b7601f5da234 tempest-SharesActionsNegativeTest-299343130 None] <<< [GET] https://127.0.0.1:40443/api/quotas/ May 28 13:05:36 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-dfe5b701-d296-4026-a999-b7601f5da234 tempest-SharesActionsNegativeTest-299343130 None] [Bunch(cluster='loop75-kfs', cluster_id=1, default_email=None, default_group_quota=None, default_user_quota=None, enable_alarms=True, enable_email_providers=True, grace_period=None, guid='32968b4a-b1ec-453e-9689-7cffe977c50d', hard_limit=1073741824, hard_limit_inodes=None, id=64, internal=False, is_user_quota=False, last_user_quotas_update=None, name='888fc5d8-ba1b-491b-aab1-eff87dbf509d', num_blocked_users=0, num_exceeded_users=0, path='/manila/manila-888fc5d8-ba1b-491b-aab1-eff87dbf509d', percent_capacity=0, percent_inodes=None, pretty_grace_period=None, pretty_grace_period_expiration=None, pretty_state='OK (CREATED)', soft_limit=None, soft_limit_inodes=None, state='OK', sync_state='CREATED', system_id=64, tenant_id=1, tenant_name='default', time_to_block=None, title='888fc5d8-ba1b-491b-aab1-eff87dbf509d', url='https://127.0.0.1:40443/api/quotas/64/', used_capacity=0, used_capacity_tb=0.0, used_effective_capacity=0, used_effective_capacity_tb=0.0, used_inodes=0, used_limited_capacity=0)] May 28 13:05:36 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-dfe5b701-d296-4026-a999-b7601f5da234 tempest-SharesActionsNegativeTest-299343130 None] --- [GET] https://127.0.0.1:40443/api/quotas/: Done May 28 13:05:36 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-dfe5b701-d296-4026-a999-b7601f5da234 tempest-SharesActionsNegativeTest-299343130 None] >>> [DELETE] https://127.0.0.1:40443/api/quotas/64/ May 28 13:05:37 l75lg1-v1 dstat.sh[49771]: 28-05 13:05:37| 1 0 98 0 0|5522M 1889M 278M 7935M| 20k 1326B| 0 228k| 0 35.0 |2119 3336 |0.97 1.05 1.03| 0 0 0| 0 0 | 0 2048M| 29 359 0 4 6 May 28 13:05:38 l75lg1-v1 dstat.sh[49771]: 28-05 13:05:38| 1 0 99 0 0|5522M 1888M 278M 7935M| 14k 0 | 0 1656k| 0 298 |1559 2421 |0.89 1.03 1.03| 0 0 0| 0 0 | 0 2048M| 29 359 0 4 6 May 28 13:05:39 l75lg1-v1 dstat.sh[49771]: 28-05 13:05:39| 0 0 99 0 0|5522M 1888M 278M 7935M| 10k 0 | 0 80k| 0 6.00 |1443 2356 |0.89 1.03 1.03|2.0 0 2.0| 0 0 | 0 2048M| 29 359 0 4 6 May 28 13:05:39 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-fb815b76-2b53-4536-8b6e-4f47a56e433f tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] GET http://10.27.203.238/share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares/ffa2cd86-28a5-40cc-88b8-2bce0c5bfa51 May 28 13:05:39 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-fb815b76-2b53-4536-8b6e-4f47a56e433f tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:05:39 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-fb815b76-2b53-4536-8b6e-4f47a56e433f tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:05:39 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-fb815b76-2b53-4536-8b6e-4f47a56e433f tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] http://10.27.203.238/share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares/ffa2cd86-28a5-40cc-88b8-2bce0c5bfa51 returned with HTTP 200 May 28 13:05:39 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1381/2782] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:05:39 2024] GET /share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares/ffa2cd86-28a5-40cc-88b8-2bce0c5bfa51 => generated 1315 bytes in 24 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:05:39 l75lg1-v1 nova-conductor[83647]: DEBUG dbcounter [-] [83647] Writing DB stats nova_cell1:SELECT=1,nova_cell1:UPDATE=1 {{(pid=83647) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:05:40 l75lg1-v1 nova-conductor[83648]: DEBUG dbcounter [-] [83648] Writing DB stats nova_cell1:SELECT=1 {{(pid=83648) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:05:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-dfe5b701-d296-4026-a999-b7601f5da234 tempest-SharesActionsNegativeTest-299343130 None] <<< [DELETE] https://127.0.0.1:40443/api/quotas/64/ May 28 13:05:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-dfe5b701-d296-4026-a999-b7601f5da234 tempest-SharesActionsNegativeTest-299343130 None] --- [DELETE] https://127.0.0.1:40443/api/quotas/64/: Done May 28 13:05:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-dfe5b701-d296-4026-a999-b7601f5da234 tempest-SharesActionsNegativeTest-299343130 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:05:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-dfe5b701-d296-4026-a999-b7601f5da234 tempest-SharesActionsNegativeTest-299343130 None] {'allow_redirects': True, May 28 13:05:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-dfe5b701-d296-4026-a999-b7601f5da234 tempest-SharesActionsNegativeTest-299343130 None] 'params': {'name': '888fc5d8-ba1b-491b-aab1-eff87dbf509d'}} May 28 13:05:40 l75lg1-v1 dstat.sh[49771]: 28-05 13:05:40| 1 0 98 0 0|5522M 1888M 278M 7935M| 12k 670B| 0 172k| 0 26.0 |1848 2971 |0.89 1.03 1.03|1.0 0 0| 0 0 | 0 2048M| 29 359 0 4 6 May 28 13:05:40 l75lg1-v1 neutron-server[77618]: DEBUG dbcounter [-] [77618] Writing DB stats neutron:UPDATE=1 {{(pid=77618) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:05:40 l75lg1-v1 neutron-server[77618]: DEBUG dbcounter [-] [77618] Writing DB stats neutron:SELECT=1 {{(pid=77618) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:05:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-dfe5b701-d296-4026-a999-b7601f5da234 tempest-SharesActionsNegativeTest-299343130 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:05:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-dfe5b701-d296-4026-a999-b7601f5da234 tempest-SharesActionsNegativeTest-299343130 None] [Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=0, created='2024-05-28T13:05:28.266899Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='8e1dcfa5-9f4f-49d6-b599-2bd9db5752c7', id=67, internal=False, is_s3_default_policy=False, name='888fc5d8-ba1b-491b-aab1-eff87dbf509d', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=[], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['*'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['*'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T13:05:28.576072Z', tenant_id=1, tenant_name='default', title='888fc5d8-ba1b-491b-aab1-eff87dbf509d', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/67/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[])] May 28 13:05:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-dfe5b701-d296-4026-a999-b7601f5da234 tempest-SharesActionsNegativeTest-299343130 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 13:05:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-dfe5b701-d296-4026-a999-b7601f5da234 tempest-SharesActionsNegativeTest-299343130 None] >>> [DELETE] https://127.0.0.1:40443/api/viewpolicies/67/ May 28 13:05:41 l75lg1-v1 dstat.sh[49771]: 28-05 13:05:41| 1 1 98 0 0|5522M 1888M 278M 7935M| 20k 1055B| 0 216k| 0 21.0 |1728 2585 |0.89 1.03 1.03|1.0 0 0| 0 0 | 0 2048M| 29 359 0 3 6 May 28 13:05:42 l75lg1-v1 dstat.sh[49771]: 28-05 13:05:42| 2 0 98 0 0|5522M 1888M 278M 7935M| 16k 0 | 0 184k| 0 39.0 |2077 3237 |0.89 1.03 1.03|1.0 0 0| 0 0 | 0 2048M| 29 359 0 3 6 May 28 13:05:42 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-090f4fa4-9248-43fc-9751-73cef1f9627e tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] GET http://10.27.203.238/share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares/ffa2cd86-28a5-40cc-88b8-2bce0c5bfa51 May 28 13:05:42 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-090f4fa4-9248-43fc-9751-73cef1f9627e tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:05:42 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-090f4fa4-9248-43fc-9751-73cef1f9627e tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:05:42 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-dfe5b701-d296-4026-a999-b7601f5da234 tempest-SharesActionsNegativeTest-299343130 None] <<< [DELETE] https://127.0.0.1:40443/api/viewpolicies/67/ May 28 13:05:42 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-dfe5b701-d296-4026-a999-b7601f5da234 tempest-SharesActionsNegativeTest-299343130 None] --- [DELETE] https://127.0.0.1:40443/api/viewpolicies/67/: Done May 28 13:05:42 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-090f4fa4-9248-43fc-9751-73cef1f9627e tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] http://10.27.203.238/share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares/ffa2cd86-28a5-40cc-88b8-2bce0c5bfa51 returned with HTTP 200 May 28 13:05:42 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1402/2783] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:05:42 2024] GET /share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares/ffa2cd86-28a5-40cc-88b8-2bce0c5bfa51 => generated 1315 bytes in 27 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:05:42 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-dfe5b701-d296-4026-a999-b7601f5da234 tempest-SharesActionsNegativeTest-299343130 None] Created reservations ['667f741e-f94f-4cfa-a53a-89a52bebdaf4', 'bcb234c7-1063-4286-8d1c-a83dfadd4271', 'd13f1d81-0514-4e7a-b35a-7c4a16e849aa', '4a73d32a-3a4c-4f80-95a0-c9c74df333c0'] {{(pid=98474) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 13:05:42 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-dfe5b701-d296-4026-a999-b7601f5da234 tempest-SharesActionsNegativeTest-299343130 None] Committed reservations ['667f741e-f94f-4cfa-a53a-89a52bebdaf4', 'bcb234c7-1063-4286-8d1c-a83dfadd4271', 'd13f1d81-0514-4e7a-b35a-7c4a16e849aa', '4a73d32a-3a4c-4f80-95a0-c9c74df333c0'] {{(pid=98474) commit /opt/stack/manila/manila/quota.py:1063}} May 28 13:05:42 l75lg1-v1 manila-share[98474]: INFO manila.share.manager [None req-dfe5b701-d296-4026-a999-b7601f5da234 tempest-SharesActionsNegativeTest-299343130 None] Share instance 888fc5d8-ba1b-491b-aab1-eff87dbf509d: deleted successfully. May 28 13:05:43 l75lg1-v1 dstat.sh[49771]: 28-05 13:05:43| 2 0 95 1 0|5522M 1888M 278M 7935M| 16k 238B| 0 1252k| 0 235 |2813 4465 |0.90 1.03 1.03|1.0 0 0| 0 0 | 0 2048M| 29 359 0 3 6 May 28 13:05:44 l75lg1-v1 dstat.sh[49771]: 28-05 13:05:44| 1 0 99 0 0|5522M 1888M 278M 7935M| 17k 0 | 0 184k| 0 13.0 |1494 2366 |0.90 1.03 1.03| 0 0 0| 0 0 | 0 2048M| 29 359 0 3 6 May 28 13:05:44 l75lg1-v1 neutron-server[77623]: DEBUG dbcounter [-] [77623] Writing DB stats neutron:SELECT=3,neutron:DELETE=1 {{(pid=77623) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:05:45 l75lg1-v1 dstat.sh[49771]: 28-05 13:05:45| 1 0 98 0 0|5522M 1888M 278M 7935M| 14k 0 | 0 228k| 0 24.0 |1533 2427 |0.90 1.03 1.03|1.0 0 0| 0 0 | 0 2048M| 29 359 0 3 6 May 28 13:05:45 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-9c3575cd-933d-4e57-96ef-7eb71e1ae0e9 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] GET http://10.27.203.238/share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares/ffa2cd86-28a5-40cc-88b8-2bce0c5bfa51 May 28 13:05:45 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-9c3575cd-933d-4e57-96ef-7eb71e1ae0e9 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:05:45 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-9c3575cd-933d-4e57-96ef-7eb71e1ae0e9 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:05:45 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-9c3575cd-933d-4e57-96ef-7eb71e1ae0e9 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] HTTP exception thrown: The resource could not be found. May 28 13:05:45 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-9c3575cd-933d-4e57-96ef-7eb71e1ae0e9 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] http://10.27.203.238/share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares/ffa2cd86-28a5-40cc-88b8-2bce0c5bfa51 returned with HTTP 404 May 28 13:05:45 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1382/2784] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:05:45 2024] GET /share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares/ffa2cd86-28a5-40cc-88b8-2bce0c5bfa51 => generated 78 bytes in 12 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 13:05:45 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-d5f9b2e8-f06f-494d-81e3-e44c19834efd tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] POST http://10.27.203.238/share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares/wrong_share_id/action May 28 13:05:45 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-d5f9b2e8-f06f-494d-81e3-e44c19834efd tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Action body: b'{"soft_delete": null}' {{(pid=98329) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}} May 28 13:05:45 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-d5f9b2e8-f06f-494d-81e3-e44c19834efd tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Action: 'action', calling method: ShareController.share_soft_delete, body: {"soft_delete": null} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:05:45 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.v2.shares [None req-d5f9b2e8-f06f-494d-81e3-e44c19834efd tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Soft delete share with id: wrong_share_id {{(pid=98329) share_soft_delete /opt/stack/manila/manila/api/v2/shares.py:280}} May 28 13:05:45 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-d5f9b2e8-f06f-494d-81e3-e44c19834efd tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] HTTP exception thrown: The resource could not be found. May 28 13:05:45 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-d5f9b2e8-f06f-494d-81e3-e44c19834efd tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] http://10.27.203.238/share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares/wrong_share_id/action returned with HTTP 404 May 28 13:05:45 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1403/2785] 10.27.203.238 () {66 vars in 1427 bytes} [Tue May 28 13:05:45 2024] POST /share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares/wrong_share_id/action => generated 78 bytes in 14 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a722d4ee-bf89-48f9-8b10-9265e0a551ed service manila] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a722d4ee-bf89-48f9-8b10-9265e0a551ed service manila] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a26627c-66f4-4e13-86a3-533125809f32 tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0872f5cfc04e4f64bafdd937cfed5d39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7f81fe24c76497a89dd033554ce1057', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a26627c-66f4-4e13-86a3-533125809f32 tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a26627c-66f4-4e13-86a3-533125809f32 tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a26627c-66f4-4e13-86a3-533125809f32 tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] PATH_INFO: `/v3/users/8688f80695814f34bfb56342c4e54028` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a26627c-66f4-4e13-86a3-533125809f32 tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] RBAC: Authorizing `identity:delete_user(user_id=8688f80695814f34bfb56342c4e54028)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a26627c-66f4-4e13-86a3-533125809f32 tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-6a26627c-66f4-4e13-86a3-533125809f32 tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] Could not find user: 8688f80695814f34bfb56342c4e54028.: keystone.exception.UserNotFound: Could not find user: 8688f80695814f34bfb56342c4e54028. May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 8688f80695814f34bfb56342c4e54028. May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1859/3686] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:05:45 2024] DELETE /identity/v3/users/8688f80695814f34bfb56342c4e54028 => generated 110 bytes in 27 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5831c7b-4373-44f9-96f1-5cc35c194c7d service manila] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5831c7b-4373-44f9-96f1-5cc35c194c7d service manila] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc670cd-92f0-4612-a718-13485157bcdc tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0872f5cfc04e4f64bafdd937cfed5d39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7f81fe24c76497a89dd033554ce1057', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc670cd-92f0-4612-a718-13485157bcdc tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc670cd-92f0-4612-a718-13485157bcdc tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc670cd-92f0-4612-a718-13485157bcdc tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] PATH_INFO: `/v3/users/108a25e436e9452a9a865957dcea1fc5` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc670cd-92f0-4612-a718-13485157bcdc tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] RBAC: Authorizing `identity:delete_user(user_id=108a25e436e9452a9a865957dcea1fc5)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc670cd-92f0-4612-a718-13485157bcdc tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-2cc670cd-92f0-4612-a718-13485157bcdc tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] Could not find user: 108a25e436e9452a9a865957dcea1fc5.: keystone.exception.UserNotFound: Could not find user: 108a25e436e9452a9a865957dcea1fc5. May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 108a25e436e9452a9a865957dcea1fc5. May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1828/3687] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:05:45 2024] DELETE /identity/v3/users/108a25e436e9452a9a865957dcea1fc5 => generated 110 bytes in 26 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a26627c-66f4-4e13-86a3-533125809f32 tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a26627c-66f4-4e13-86a3-533125809f32 tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec68919-3d3c-4890-915f-b9eded9c1e9a tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0872f5cfc04e4f64bafdd937cfed5d39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7f81fe24c76497a89dd033554ce1057', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec68919-3d3c-4890-915f-b9eded9c1e9a tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec68919-3d3c-4890-915f-b9eded9c1e9a tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec68919-3d3c-4890-915f-b9eded9c1e9a tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] PATH_INFO: `/v3/users/5ae5cb1db3504baaba1df93dc154a004` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec68919-3d3c-4890-915f-b9eded9c1e9a tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] RBAC: Authorizing `identity:delete_user(user_id=5ae5cb1db3504baaba1df93dc154a004)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec68919-3d3c-4890-915f-b9eded9c1e9a tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-8ec68919-3d3c-4890-915f-b9eded9c1e9a tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] Could not find user: 5ae5cb1db3504baaba1df93dc154a004.: keystone.exception.UserNotFound: Could not find user: 5ae5cb1db3504baaba1df93dc154a004. May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 5ae5cb1db3504baaba1df93dc154a004. May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1860/3688] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:05:45 2024] DELETE /identity/v3/users/5ae5cb1db3504baaba1df93dc154a004 => generated 110 bytes in 25 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc670cd-92f0-4612-a718-13485157bcdc tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc670cd-92f0-4612-a718-13485157bcdc tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec12b7e-9bb8-4ffb-a2c5-2eae8ac78bba tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0872f5cfc04e4f64bafdd937cfed5d39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7f81fe24c76497a89dd033554ce1057', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec12b7e-9bb8-4ffb-a2c5-2eae8ac78bba tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec12b7e-9bb8-4ffb-a2c5-2eae8ac78bba tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec12b7e-9bb8-4ffb-a2c5-2eae8ac78bba tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] PATH_INFO: `/v3/users/c2ac6ca3ea5a4ae498df6d12bb7caadc` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec12b7e-9bb8-4ffb-a2c5-2eae8ac78bba tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] RBAC: Authorizing `identity:delete_user(user_id=c2ac6ca3ea5a4ae498df6d12bb7caadc)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec12b7e-9bb8-4ffb-a2c5-2eae8ac78bba tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-3ec12b7e-9bb8-4ffb-a2c5-2eae8ac78bba tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] Could not find user: c2ac6ca3ea5a4ae498df6d12bb7caadc.: keystone.exception.UserNotFound: Could not find user: c2ac6ca3ea5a4ae498df6d12bb7caadc. May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: c2ac6ca3ea5a4ae498df6d12bb7caadc. May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1829/3689] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:05:45 2024] DELETE /identity/v3/users/c2ac6ca3ea5a4ae498df6d12bb7caadc => generated 110 bytes in 23 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec68919-3d3c-4890-915f-b9eded9c1e9a tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec68919-3d3c-4890-915f-b9eded9c1e9a tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd22b86-3995-4da4-b377-21194e458d0d tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0872f5cfc04e4f64bafdd937cfed5d39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7f81fe24c76497a89dd033554ce1057', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd22b86-3995-4da4-b377-21194e458d0d tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd22b86-3995-4da4-b377-21194e458d0d tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd22b86-3995-4da4-b377-21194e458d0d tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] PATH_INFO: `/v3/users/f89f851af36d480ab7d10d3506c60899` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd22b86-3995-4da4-b377-21194e458d0d tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] RBAC: Authorizing `identity:delete_user(user_id=f89f851af36d480ab7d10d3506c60899)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd22b86-3995-4da4-b377-21194e458d0d tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-3cd22b86-3995-4da4-b377-21194e458d0d tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] Could not find user: f89f851af36d480ab7d10d3506c60899.: keystone.exception.UserNotFound: Could not find user: f89f851af36d480ab7d10d3506c60899. May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: f89f851af36d480ab7d10d3506c60899. May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1861/3690] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:05:45 2024] DELETE /identity/v3/users/f89f851af36d480ab7d10d3506c60899 => generated 110 bytes in 23 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec12b7e-9bb8-4ffb-a2c5-2eae8ac78bba tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec12b7e-9bb8-4ffb-a2c5-2eae8ac78bba tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0771393-cb26-4940-9975-a2de27ae3981 tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0872f5cfc04e4f64bafdd937cfed5d39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7f81fe24c76497a89dd033554ce1057', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0771393-cb26-4940-9975-a2de27ae3981 tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0771393-cb26-4940-9975-a2de27ae3981 tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0771393-cb26-4940-9975-a2de27ae3981 tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] PATH_INFO: `/v3/users/6886717a9cfb42a0a4142a0b982570ee` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0771393-cb26-4940-9975-a2de27ae3981 tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] RBAC: Authorizing `identity:delete_user(user_id=6886717a9cfb42a0a4142a0b982570ee)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0771393-cb26-4940-9975-a2de27ae3981 tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-f0771393-cb26-4940-9975-a2de27ae3981 tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] Could not find user: 6886717a9cfb42a0a4142a0b982570ee.: keystone.exception.UserNotFound: Could not find user: 6886717a9cfb42a0a4142a0b982570ee. May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 6886717a9cfb42a0a4142a0b982570ee. May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1830/3691] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:05:45 2024] DELETE /identity/v3/users/6886717a9cfb42a0a4142a0b982570ee => generated 110 bytes in 24 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd22b86-3995-4da4-b377-21194e458d0d tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd22b86-3995-4da4-b377-21194e458d0d tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667d7d1c-1b9c-4e46-95a1-d5094c07e1f4 tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0872f5cfc04e4f64bafdd937cfed5d39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7f81fe24c76497a89dd033554ce1057', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667d7d1c-1b9c-4e46-95a1-d5094c07e1f4 tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667d7d1c-1b9c-4e46-95a1-d5094c07e1f4 tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667d7d1c-1b9c-4e46-95a1-d5094c07e1f4 tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] PATH_INFO: `/v3/users/b523155e680a4a14acd4f3a4295a8d26` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667d7d1c-1b9c-4e46-95a1-d5094c07e1f4 tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] RBAC: Authorizing `identity:delete_user(user_id=b523155e680a4a14acd4f3a4295a8d26)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667d7d1c-1b9c-4e46-95a1-d5094c07e1f4 tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-667d7d1c-1b9c-4e46-95a1-d5094c07e1f4 tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] Could not find user: b523155e680a4a14acd4f3a4295a8d26.: keystone.exception.UserNotFound: Could not find user: b523155e680a4a14acd4f3a4295a8d26. May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: b523155e680a4a14acd4f3a4295a8d26. May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1862/3692] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:05:45 2024] DELETE /identity/v3/users/b523155e680a4a14acd4f3a4295a8d26 => generated 110 bytes in 24 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0771393-cb26-4940-9975-a2de27ae3981 tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0771393-cb26-4940-9975-a2de27ae3981 tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eb3b2d-4cf7-4f5e-a3c0-eb809e384424 tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0872f5cfc04e4f64bafdd937cfed5d39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7f81fe24c76497a89dd033554ce1057', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eb3b2d-4cf7-4f5e-a3c0-eb809e384424 tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eb3b2d-4cf7-4f5e-a3c0-eb809e384424 tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eb3b2d-4cf7-4f5e-a3c0-eb809e384424 tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] PATH_INFO: `/v3/users/756070dd0b274fd8835b10a8fbe293d9` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93eb3b2d-4cf7-4f5e-a3c0-eb809e384424 tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] RBAC: Authorizing `identity:delete_user(user_id=756070dd0b274fd8835b10a8fbe293d9)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93eb3b2d-4cf7-4f5e-a3c0-eb809e384424 tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-93eb3b2d-4cf7-4f5e-a3c0-eb809e384424 tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] Could not find user: 756070dd0b274fd8835b10a8fbe293d9.: keystone.exception.UserNotFound: Could not find user: 756070dd0b274fd8835b10a8fbe293d9. May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 756070dd0b274fd8835b10a8fbe293d9. May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1831/3693] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:05:45 2024] DELETE /identity/v3/users/756070dd0b274fd8835b10a8fbe293d9 => generated 110 bytes in 23 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667d7d1c-1b9c-4e46-95a1-d5094c07e1f4 tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667d7d1c-1b9c-4e46-95a1-d5094c07e1f4 tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eef4e71-5b65-4e64-bdd4-37178779c3fb tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0872f5cfc04e4f64bafdd937cfed5d39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7f81fe24c76497a89dd033554ce1057', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eef4e71-5b65-4e64-bdd4-37178779c3fb tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eef4e71-5b65-4e64-bdd4-37178779c3fb tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eef4e71-5b65-4e64-bdd4-37178779c3fb tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] PATH_INFO: `/v3/users/cdf8594f55cb448e9b2312d051486331` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eef4e71-5b65-4e64-bdd4-37178779c3fb tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] RBAC: Authorizing `identity:delete_user(user_id=cdf8594f55cb448e9b2312d051486331)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eef4e71-5b65-4e64-bdd4-37178779c3fb tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-3eef4e71-5b65-4e64-bdd4-37178779c3fb tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] Could not find user: cdf8594f55cb448e9b2312d051486331.: keystone.exception.UserNotFound: Could not find user: cdf8594f55cb448e9b2312d051486331. May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cdf8594f55cb448e9b2312d051486331. May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1863/3694] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:05:45 2024] DELETE /identity/v3/users/cdf8594f55cb448e9b2312d051486331 => generated 110 bytes in 24 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eb3b2d-4cf7-4f5e-a3c0-eb809e384424 tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eb3b2d-4cf7-4f5e-a3c0-eb809e384424 tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b3dda7-76fa-41ef-8d79-897d276c418d tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0872f5cfc04e4f64bafdd937cfed5d39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7f81fe24c76497a89dd033554ce1057', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b3dda7-76fa-41ef-8d79-897d276c418d tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b3dda7-76fa-41ef-8d79-897d276c418d tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b3dda7-76fa-41ef-8d79-897d276c418d tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] PATH_INFO: `/v3/users/a3784840ad6a4156929be55026b39776` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b3dda7-76fa-41ef-8d79-897d276c418d tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] RBAC: Authorizing `identity:delete_user(user_id=a3784840ad6a4156929be55026b39776)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b3dda7-76fa-41ef-8d79-897d276c418d tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-a9b3dda7-76fa-41ef-8d79-897d276c418d tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] Could not find user: a3784840ad6a4156929be55026b39776.: keystone.exception.UserNotFound: Could not find user: a3784840ad6a4156929be55026b39776. May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: a3784840ad6a4156929be55026b39776. May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1832/3695] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:05:45 2024] DELETE /identity/v3/users/a3784840ad6a4156929be55026b39776 => generated 110 bytes in 23 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eef4e71-5b65-4e64-bdd4-37178779c3fb tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eef4e71-5b65-4e64-bdd4-37178779c3fb tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f16b22-b51e-4285-83a2-1d5082983fbd tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0872f5cfc04e4f64bafdd937cfed5d39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7f81fe24c76497a89dd033554ce1057', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f16b22-b51e-4285-83a2-1d5082983fbd tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f16b22-b51e-4285-83a2-1d5082983fbd tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f16b22-b51e-4285-83a2-1d5082983fbd tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] PATH_INFO: `/v3/users/93bc07dfcf2c4861981da16395bddbc0` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f16b22-b51e-4285-83a2-1d5082983fbd tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] RBAC: Authorizing `identity:delete_user(user_id=93bc07dfcf2c4861981da16395bddbc0)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f16b22-b51e-4285-83a2-1d5082983fbd tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-59f16b22-b51e-4285-83a2-1d5082983fbd tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] Could not find user: 93bc07dfcf2c4861981da16395bddbc0.: keystone.exception.UserNotFound: Could not find user: 93bc07dfcf2c4861981da16395bddbc0. May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 93bc07dfcf2c4861981da16395bddbc0. May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1864/3696] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:05:45 2024] DELETE /identity/v3/users/93bc07dfcf2c4861981da16395bddbc0 => generated 110 bytes in 25 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b3dda7-76fa-41ef-8d79-897d276c418d tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b3dda7-76fa-41ef-8d79-897d276c418d tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9c1aae-3296-42fd-bf54-17a5a2cb88d0 tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0872f5cfc04e4f64bafdd937cfed5d39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7f81fe24c76497a89dd033554ce1057', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9c1aae-3296-42fd-bf54-17a5a2cb88d0 tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9c1aae-3296-42fd-bf54-17a5a2cb88d0 tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9c1aae-3296-42fd-bf54-17a5a2cb88d0 tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] PATH_INFO: `/v3/users/080fdf25a1154b6db0ae228e1c05b6b2` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9c1aae-3296-42fd-bf54-17a5a2cb88d0 tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] RBAC: Authorizing `identity:delete_user(user_id=080fdf25a1154b6db0ae228e1c05b6b2)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9c1aae-3296-42fd-bf54-17a5a2cb88d0 tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-da9c1aae-3296-42fd-bf54-17a5a2cb88d0 tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] Could not find user: 080fdf25a1154b6db0ae228e1c05b6b2.: keystone.exception.UserNotFound: Could not find user: 080fdf25a1154b6db0ae228e1c05b6b2. May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 080fdf25a1154b6db0ae228e1c05b6b2. May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1833/3697] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:05:45 2024] DELETE /identity/v3/users/080fdf25a1154b6db0ae228e1c05b6b2 => generated 110 bytes in 23 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f16b22-b51e-4285-83a2-1d5082983fbd tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f16b22-b51e-4285-83a2-1d5082983fbd tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ff910e-445c-4e51-b747-83e785b99d28 tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0872f5cfc04e4f64bafdd937cfed5d39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7f81fe24c76497a89dd033554ce1057', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ff910e-445c-4e51-b747-83e785b99d28 tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ff910e-445c-4e51-b747-83e785b99d28 tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ff910e-445c-4e51-b747-83e785b99d28 tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] PATH_INFO: `/v3/users/80737d9a590d4944acb593a5812e9c87` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ff910e-445c-4e51-b747-83e785b99d28 tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] RBAC: Authorizing `identity:delete_user(user_id=80737d9a590d4944acb593a5812e9c87)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ff910e-445c-4e51-b747-83e785b99d28 tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-e8ff910e-445c-4e51-b747-83e785b99d28 tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] Could not find user: 80737d9a590d4944acb593a5812e9c87.: keystone.exception.UserNotFound: Could not find user: 80737d9a590d4944acb593a5812e9c87. May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 80737d9a590d4944acb593a5812e9c87. May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1865/3698] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:05:45 2024] DELETE /identity/v3/users/80737d9a590d4944acb593a5812e9c87 => generated 110 bytes in 25 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9c1aae-3296-42fd-bf54-17a5a2cb88d0 tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9c1aae-3296-42fd-bf54-17a5a2cb88d0 tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d70ed2-651e-49a1-a79c-9be849ba4298 tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0872f5cfc04e4f64bafdd937cfed5d39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7f81fe24c76497a89dd033554ce1057', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d70ed2-651e-49a1-a79c-9be849ba4298 tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d70ed2-651e-49a1-a79c-9be849ba4298 tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d70ed2-651e-49a1-a79c-9be849ba4298 tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] PATH_INFO: `/v3/users/0db23a1570c14747b7d0cfd63c25831d` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d70ed2-651e-49a1-a79c-9be849ba4298 tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] RBAC: Authorizing `identity:delete_user(user_id=0db23a1570c14747b7d0cfd63c25831d)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d70ed2-651e-49a1-a79c-9be849ba4298 tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-c7d70ed2-651e-49a1-a79c-9be849ba4298 tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] Could not find user: 0db23a1570c14747b7d0cfd63c25831d.: keystone.exception.UserNotFound: Could not find user: 0db23a1570c14747b7d0cfd63c25831d. May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 0db23a1570c14747b7d0cfd63c25831d. May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1834/3699] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:05:45 2024] DELETE /identity/v3/users/0db23a1570c14747b7d0cfd63c25831d => generated 110 bytes in 25 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ff910e-445c-4e51-b747-83e785b99d28 tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ff910e-445c-4e51-b747-83e785b99d28 tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b1ac94-ed30-41ec-86aa-858083d37e9e tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0872f5cfc04e4f64bafdd937cfed5d39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7f81fe24c76497a89dd033554ce1057', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b1ac94-ed30-41ec-86aa-858083d37e9e tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b1ac94-ed30-41ec-86aa-858083d37e9e tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b1ac94-ed30-41ec-86aa-858083d37e9e tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] PATH_INFO: `/v3/users/76e042fad4114f4cb24f96afe38c72b8` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b1ac94-ed30-41ec-86aa-858083d37e9e tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] RBAC: Authorizing `identity:delete_user(user_id=76e042fad4114f4cb24f96afe38c72b8)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b1ac94-ed30-41ec-86aa-858083d37e9e tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-63b1ac94-ed30-41ec-86aa-858083d37e9e tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76e042fad4114f4cb24f96afe38c72b8', 'request_id': 'req-63b1ac94-ed30-41ec-86aa-858083d37e9e'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-63b1ac94-ed30-41ec-86aa-858083d37e9e tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76e042fad4114f4cb24f96afe38c72b8', 'request_id': 'req-63b1ac94-ed30-41ec-86aa-858083d37e9e'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-63b1ac94-ed30-41ec-86aa-858083d37e9e tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76e042fad4114f4cb24f96afe38c72b8', 'request_id': 'req-63b1ac94-ed30-41ec-86aa-858083d37e9e'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-63b1ac94-ed30-41ec-86aa-858083d37e9e tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76e042fad4114f4cb24f96afe38c72b8', 'request_id': 'req-63b1ac94-ed30-41ec-86aa-858083d37e9e'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-63b1ac94-ed30-41ec-86aa-858083d37e9e tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76e042fad4114f4cb24f96afe38c72b8', 'request_id': 'req-63b1ac94-ed30-41ec-86aa-858083d37e9e'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:05:45 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1866/3700] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:05:45 2024] DELETE /identity/v3/users/76e042fad4114f4cb24f96afe38c72b8 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:05:45 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-af47e571-40e6-453c-b447-576efddd0b0a tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] DELETE http://10.27.203.238/share/v2/c39deaad5eb341ceb2e3c79518f56a1b/snapshots/f8bd794b-ee7c-457c-baf8-bc7ce191db35 May 28 13:05:45 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-af47e571-40e6-453c-b447-576efddd0b0a tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:05:45 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-af47e571-40e6-453c-b447-576efddd0b0a tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Calling method 'ShareSnapshotMixin.delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:05:45 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.v1.share_snapshots [None req-af47e571-40e6-453c-b447-576efddd0b0a tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Delete snapshot with id: f8bd794b-ee7c-457c-baf8-bc7ce191db35 May 28 13:05:46 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-af47e571-40e6-453c-b447-576efddd0b0a tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] http://10.27.203.238/share/v2/c39deaad5eb341ceb2e3c79518f56a1b/snapshots/f8bd794b-ee7c-457c-baf8-bc7ce191db35 returned with HTTP 202 May 28 13:05:46 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1383/2786] 10.27.203.238 () {64 vars in 1463 bytes} [Tue May 28 13:05:45 2024] DELETE /share/v2/c39deaad5eb341ceb2e3c79518f56a1b/snapshots/f8bd794b-ee7c-457c-baf8-bc7ce191db35 => generated 0 bytes in 95 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 13:05:46 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-915e1588-357c-4e93-8c0c-8e3791cb3882 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] GET http://10.27.203.238/share/v2/c39deaad5eb341ceb2e3c79518f56a1b/snapshots/f8bd794b-ee7c-457c-baf8-bc7ce191db35 May 28 13:05:46 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-915e1588-357c-4e93-8c0c-8e3791cb3882 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:05:46 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-915e1588-357c-4e93-8c0c-8e3791cb3882 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Calling method 'ShareSnapshotMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:05:46 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-915e1588-357c-4e93-8c0c-8e3791cb3882 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] http://10.27.203.238/share/v2/c39deaad5eb341ceb2e3c79518f56a1b/snapshots/f8bd794b-ee7c-457c-baf8-bc7ce191db35 returned with HTTP 200 May 28 13:05:46 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1404/2787] 10.27.203.238 () {64 vars in 1460 bytes} [Tue May 28 13:05:46 2024] GET /share/v2/c39deaad5eb341ceb2e3c79518f56a1b/snapshots/f8bd794b-ee7c-457c-baf8-bc7ce191db35 => generated 746 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:05:46 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-af47e571-40e6-453c-b447-576efddd0b0a tempest-SharesActionsNegativeTest-299343130 None] >>> [GET] https://127.0.0.1:40443/api/snapshots/ May 28 13:05:46 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-af47e571-40e6-453c-b447-576efddd0b0a tempest-SharesActionsNegativeTest-299343130 None] {'allow_redirects': True, May 28 13:05:46 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-af47e571-40e6-453c-b447-576efddd0b0a tempest-SharesActionsNegativeTest-299343130 None] 'params': {'name': 'share-snapshot-526b38b3-74a8-4faf-aa7f-19830c7dc26b'}} May 28 13:05:46 l75lg1-v1 dstat.sh[49771]: 28-05 13:05:46| 9 2 89 1 0|5522M 1888M 278M 7936M| 16k 6324B| 0 1222k| 0 122 |5460 9587 |0.90 1.03 1.03|1.0 0 0| 0 0 | 0 2048M| 29 359 0 3 6 May 28 13:05:46 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-af47e571-40e6-453c-b447-576efddd0b0a tempest-SharesActionsNegativeTest-299343130 None] <<< [GET] https://127.0.0.1:40443/api/snapshots/ May 28 13:05:46 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-af47e571-40e6-453c-b447-576efddd0b0a tempest-SharesActionsNegativeTest-299343130 None] [Bunch(access_path='/.vast_all_snapshots/1000000018_share-snapshot-526b38b3-74a8-4faf-aa7f-19830c7dc26b', aggr_phys_estimation=0, cluster='loop75-kfs', created='2024-05-28T13:04:20.570385Z', eta_sec=30819898451.2678, expiration_time='3001-01-19T07:59:58Z', guid='43b26ef9-a68c-43c1-97bb-8b6aa9c99940', id=19, indestructible=False, locked=False, name='share-snapshot-526b38b3-74a8-4faf-aa7f-19830c7dc26b', path='/manila/manila-2e013be0-942c-4e94-a237-2d1251405521/', policy=None, policy_id=None, protection_policy_id=None, state='SUCCEED', tenant_id=1, tenant_name='default', title='share-snapshot-526b38b3-74a8-4faf-aa7f-19830c7dc26b(/manila/manila-2e013be0-942c-4e94-a237-2d1251405521/)', type='local', unique_phys_estimation=0, url='https://127.0.0.1:40443/api/snapshots/19/')] May 28 13:05:46 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-af47e571-40e6-453c-b447-576efddd0b0a tempest-SharesActionsNegativeTest-299343130 None] --- [GET] https://127.0.0.1:40443/api/snapshots/: Done May 28 13:05:46 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-af47e571-40e6-453c-b447-576efddd0b0a tempest-SharesActionsNegativeTest-299343130 None] >>> [DELETE] https://127.0.0.1:40443/api/snapshots/19/ May 28 13:05:47 l75lg1-v1 dstat.sh[49771]: 28-05 13:05:47| 1 0 98 1 0|5522M 1887M 278M 7936M| 17k 805B| 0 1135k| 0 76.9 |1898 2996 |0.90 1.03 1.03|1.0 0 0| 0 0 | 0 2048M| 29 359 0 3 6 May 28 13:05:47 l75lg1-v1 manila-share[98474]: DEBUG oslo_service.periodic_task [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] Running periodic task ShareManager._publish_service_capabilities {{(pid=98474) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 13:05:47 l75lg1-v1 manila-share[98474]: DEBUG manila.manager [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] Notifying Schedulers of capabilities ... {{(pid=98474) _publish_service_capabilities /opt/stack/manila/manila/manager.py:172}} May 28 13:05:47 l75lg1-v1 manila-share[98474]: DEBUG oslo_service.periodic_task [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] Running periodic task ShareManager.migration_driver_continue {{(pid=98474) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 13:05:47 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.host_manager [None req-4daaa9ac-2fef-444d-a93c-91d09b839735 None None] Received share service update from l75lg1-v1@vast: {'share_backend_name': 'vast', 'driver_handles_share_servers': False, 'vendor_name': 'VAST STORAGE', 'driver_version': '1.0', 'storage_protocol': 'NFS', 'total_capacity_gb': 2083.02392578125, 'free_capacity_gb': 2082.625715249218, 'reserved_percentage': 0, 'reserved_snapshot_percentage': 0, 'reserved_share_extend_percentage': 0, 'qos': False, 'pools': None, 'snapshot_support': True, 'create_share_from_snapshot_support': False, 'revert_to_snapshot_support': False, 'mount_snapshot_support': False, 'replication_domain': None, 'filter_function': None, 'goodness_function': None, 'security_service_update_support': False, 'network_allocation_update_support': False, 'share_server_multiple_subnet_support': False, 'mount_point_name_support': False, 'data_reduction': 5.29, 'provisioned_capacity_gb': 0.39821053203195333, 'share_group_stats': {'consistent_snapshot_support': None}, 'ipv4_support': True, 'ipv6_support': False} {{(pid=98327) update_service_capabilities /opt/stack/manila/manila/scheduler/host_manager.py:632}} May 28 13:05:47 l75lg1-v1 manila-share[98474]: DEBUG oslo_service.periodic_task [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] Running periodic task ShareManager.do_deferred_share_deletion {{(pid=98474) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 13:05:47 l75lg1-v1 manila-share[98474]: DEBUG manila.share.manager [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] Checking for shares in 'deferred_deleting' status to process their deletion. {{(pid=98474) do_deferred_share_deletion /opt/stack/manila/manila/share/manager.py:3663}} May 28 13:05:47 l75lg1-v1 manila-share[98474]: DEBUG oslo_service.periodic_task [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] Running periodic task ShareManager.do_deferred_snapshot_deletion {{(pid=98474) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 13:05:47 l75lg1-v1 manila-share[98474]: DEBUG manila.share.manager [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] Checking for snapshots in 'deferred_deleting' status to process their deletion. {{(pid=98474) do_deferred_snapshot_deletion /opt/stack/manila/manila/share/manager.py:3980}} May 28 13:05:47 l75lg1-v1 manila-share[98474]: DEBUG oslo_service.periodic_task [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] Running periodic task ShareManager._report_driver_status {{(pid=98474) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 13:05:47 l75lg1-v1 manila-share[98474]: INFO manila.share.manager [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] Updating share status May 28 13:05:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] >>> [GET] https://127.0.0.1:40443/api/monitors/ad_hoc_query/ May 28 13:05:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] {'allow_redirects': True, May 28 13:05:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] 'params': {'object_type': 'cluster', May 28 13:05:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] 'prop_list': ['Capacity,drr', May 28 13:05:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] 'Capacity,logical_space', May 28 13:05:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] 'Capacity,logical_space_in_use', May 28 13:05:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] 'Capacity,physical_space', May 28 13:05:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] 'Capacity,physical_space_in_use'], May 28 13:05:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] 'time_frame': '1m'}} May 28 13:05:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] <<< [GET] https://127.0.0.1:40443/api/monitors/ad_hoc_query/ May 28 13:05:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] Bunch(data=[['2024-05-28T13:05:43Z', 1, 456157190.0, 2223930.0, 5.29, 711246584217.0, 2236629909504.0], ['2024-05-28T13:05:32Z', 1, 456075270.0, 2223930.0, 5.29, 711246584217.0, 2236629909504.0], ['2024-05-28T13:05:22Z', 1, 455428103.0, 2223930.0, 5.29, 711246584217.0, 2236629909504.0], ['2024-05-28T13:05:12Z', 1, 455370759.0, 2223930.0, 5.29, 711246584217.0, 2236629909504.0], ['2024-05-28T13:05:02Z', 1, 455288839.0, 2223930.0, 5.29, 711246584217.0, 2236629909504.0], ['2024-05-28T13:04:52Z', 1, 455149575.0, 2223930.0, 5.29, 711246584217.0, 2236629909504.0]], granularity=None, object_ids=[1], prop_list=['timestamp', 'object_id', 'Capacity,logical_space_in_use', 'Capacity,physical_space_in_use', 'Capacity,drr', 'Capacity,physical_space', 'Capacity,logical_space']) May 28 13:05:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] --- [GET] https://127.0.0.1:40443/api/monitors/ad_hoc_query/: Done May 28 13:05:47 l75lg1-v1 manila-share[98474]: DEBUG manila.share.driver [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] Updating share stats. {{(pid=98474) _update_share_stats /opt/stack/manila/manila/share/driver.py:1326}} May 28 13:05:47 l75lg1-v1 manila-share[98474]: DEBUG oslo_service.periodic_task [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] Running periodic task ShareManager.create_backup_continue {{(pid=98474) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 13:05:47 l75lg1-v1 manila-share[98474]: DEBUG oslo_service.periodic_task [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] Running periodic task ShareManager.restore_backup_continue {{(pid=98474) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 13:05:47 l75lg1-v1 manila-share[98474]: DEBUG oslo_service.periodic_task [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] Running periodic task ShareManager.periodic_share_status_update {{(pid=98474) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 13:05:47 l75lg1-v1 manila-share[98474]: DEBUG manila.share.manager [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] Updating status of share instances. {{(pid=98474) periodic_share_status_update /opt/stack/manila/manila/share/manager.py:5475}} May 28 13:05:48 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-af47e571-40e6-453c-b447-576efddd0b0a tempest-SharesActionsNegativeTest-299343130 None] <<< [DELETE] https://127.0.0.1:40443/api/snapshots/19/ May 28 13:05:48 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-af47e571-40e6-453c-b447-576efddd0b0a tempest-SharesActionsNegativeTest-299343130 None] --- [DELETE] https://127.0.0.1:40443/api/snapshots/19/: Done May 28 13:05:48 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-af47e571-40e6-453c-b447-576efddd0b0a tempest-SharesActionsNegativeTest-299343130 None] Created reservations ['148a88ec-e71c-45f1-9c89-aaf4ef61e23c', 'cd25b713-e94a-4ed4-8740-bd2b4a6c9788', '899842e4-13a2-43ec-bbb5-f79109266bb4', 'adbd24d3-434e-42e0-9333-81221e07e284'] {{(pid=98474) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 13:05:48 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-af47e571-40e6-453c-b447-576efddd0b0a tempest-SharesActionsNegativeTest-299343130 None] Committed reservations ['148a88ec-e71c-45f1-9c89-aaf4ef61e23c', 'cd25b713-e94a-4ed4-8740-bd2b4a6c9788', '899842e4-13a2-43ec-bbb5-f79109266bb4', 'adbd24d3-434e-42e0-9333-81221e07e284'] {{(pid=98474) commit /opt/stack/manila/manila/quota.py:1063}} May 28 13:05:48 l75lg1-v1 dstat.sh[49771]: 28-05 13:05:48| 2 0 96 1 0|5522M 1887M 278M 7936M| 17k 986B| 0 2616k| 0 402 |2364 3559 |0.83 1.02 1.02| 0 0 0| 0 0 | 0 2048M| 29 359 0 3 6 May 28 13:05:49 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-1ab06ce0-85a1-4aee-8491-c3670d96721a tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] GET http://10.27.203.238/share/v2/c39deaad5eb341ceb2e3c79518f56a1b/snapshots/f8bd794b-ee7c-457c-baf8-bc7ce191db35 May 28 13:05:49 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-1ab06ce0-85a1-4aee-8491-c3670d96721a tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:05:49 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-1ab06ce0-85a1-4aee-8491-c3670d96721a tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Calling method 'ShareSnapshotMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:05:49 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-1ab06ce0-85a1-4aee-8491-c3670d96721a tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] HTTP exception thrown: The resource could not be found. May 28 13:05:49 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-1ab06ce0-85a1-4aee-8491-c3670d96721a tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] http://10.27.203.238/share/v2/c39deaad5eb341ceb2e3c79518f56a1b/snapshots/f8bd794b-ee7c-457c-baf8-bc7ce191db35 returned with HTTP 404 May 28 13:05:49 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1384/2788] 10.27.203.238 () {64 vars in 1460 bytes} [Tue May 28 13:05:49 2024] GET /share/v2/c39deaad5eb341ceb2e3c79518f56a1b/snapshots/f8bd794b-ee7c-457c-baf8-bc7ce191db35 => generated 78 bytes in 15 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 13:05:49 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-8c73aa77-46b4-4999-9dfd-d07a27f68799 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] GET http://10.27.203.238/share/v2/c39deaad5eb341ceb2e3c79518f56a1b/share-replicas/detail?share_id=1b08ba1e-039b-4773-869c-2a90b38f5f70 May 28 13:05:49 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-8c73aa77-46b4-4999-9dfd-d07a27f68799 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:05:49 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-8c73aa77-46b4-4999-9dfd-d07a27f68799 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:05:49 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-8c73aa77-46b4-4999-9dfd-d07a27f68799 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] http://10.27.203.238/share/v2/c39deaad5eb341ceb2e3c79518f56a1b/share-replicas/detail?share_id=1b08ba1e-039b-4773-869c-2a90b38f5f70 returned with HTTP 200 May 28 13:05:49 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1405/2789] 10.27.203.238 () {64 vars in 1476 bytes} [Tue May 28 13:05:49 2024] GET /share/v2/c39deaad5eb341ceb2e3c79518f56a1b/share-replicas/detail?share_id=1b08ba1e-039b-4773-869c-2a90b38f5f70 => generated 22 bytes in 12 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:05:49 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-c5147583-5fd3-4b67-aeb1-0dc062246570 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] DELETE http://10.27.203.238/share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares/1b08ba1e-039b-4773-869c-2a90b38f5f70 May 28 13:05:49 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-c5147583-5fd3-4b67-aeb1-0dc062246570 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:05:49 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-c5147583-5fd3-4b67-aeb1-0dc062246570 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Calling method 'ShareMixin.delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:05:49 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.v1.shares [None req-c5147583-5fd3-4b67-aeb1-0dc062246570 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Delete share with id: 1b08ba1e-039b-4773-869c-2a90b38f5f70 May 28 13:05:49 l75lg1-v1 dstat.sh[49771]: 28-05 13:05:49| 2 0 98 0 0|5523M 1887M 278M 7936M| 18k 0 | 0 152k| 0 16.0 |1843 2971 |0.83 1.02 1.02|1.0 0 2.0| 0 0 | 0 2048M| 29 360 0 3 6 May 28 13:05:49 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-c5147583-5fd3-4b67-aeb1-0dc062246570 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] http://10.27.203.238/share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares/1b08ba1e-039b-4773-869c-2a90b38f5f70 returned with HTTP 202 May 28 13:05:49 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1385/2790] 10.27.203.238 () {64 vars in 1454 bytes} [Tue May 28 13:05:49 2024] DELETE /share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares/1b08ba1e-039b-4773-869c-2a90b38f5f70 => generated 0 bytes in 121 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 13:05:49 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-22d84ab2-c64b-4be7-8366-effcc327bbd8 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] GET http://10.27.203.238/share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares/1b08ba1e-039b-4773-869c-2a90b38f5f70 May 28 13:05:49 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-22d84ab2-c64b-4be7-8366-effcc327bbd8 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:05:49 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-22d84ab2-c64b-4be7-8366-effcc327bbd8 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:05:49 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-22d84ab2-c64b-4be7-8366-effcc327bbd8 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] http://10.27.203.238/share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares/1b08ba1e-039b-4773-869c-2a90b38f5f70 returned with HTTP 200 May 28 13:05:49 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1406/2791] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:05:49 2024] GET /share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares/1b08ba1e-039b-4773-869c-2a90b38f5f70 => generated 1343 bytes in 24 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:05:49 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c5147583-5fd3-4b67-aeb1-0dc062246570 tempest-SharesActionsNegativeTest-299343130 None] Acquiring lock "locked_access_rules_operation_by_share_instance_2e013be0-942c-4e94-a237-2d1251405521" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:05:49 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c5147583-5fd3-4b67-aeb1-0dc062246570 tempest-SharesActionsNegativeTest-299343130 None] Lock "locked_access_rules_operation_by_share_instance_2e013be0-942c-4e94-a237-2d1251405521" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:05:49 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c5147583-5fd3-4b67-aeb1-0dc062246570 tempest-SharesActionsNegativeTest-299343130 None] Lock "locked_access_rules_operation_by_share_instance_2e013be0-942c-4e94-a237-2d1251405521" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:05:49 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c5147583-5fd3-4b67-aeb1-0dc062246570 tempest-SharesActionsNegativeTest-299343130 None] Acquiring lock "locked_access_rules_operation_by_share_instance_2e013be0-942c-4e94-a237-2d1251405521" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:05:49 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c5147583-5fd3-4b67-aeb1-0dc062246570 tempest-SharesActionsNegativeTest-299343130 None] Lock "locked_access_rules_operation_by_share_instance_2e013be0-942c-4e94-a237-2d1251405521" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:05:49 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c5147583-5fd3-4b67-aeb1-0dc062246570 tempest-SharesActionsNegativeTest-299343130 None] Lock "locked_access_rules_operation_by_share_instance_2e013be0-942c-4e94-a237-2d1251405521" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:05:49 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c5147583-5fd3-4b67-aeb1-0dc062246570 tempest-SharesActionsNegativeTest-299343130 None] Acquiring lock "locked_access_rules_operation_by_share_instance_2e013be0-942c-4e94-a237-2d1251405521" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:05:49 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c5147583-5fd3-4b67-aeb1-0dc062246570 tempest-SharesActionsNegativeTest-299343130 None] Lock "locked_access_rules_operation_by_share_instance_2e013be0-942c-4e94-a237-2d1251405521" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:05:49 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-c5147583-5fd3-4b67-aeb1-0dc062246570 tempest-SharesActionsNegativeTest-299343130 None] Lock "locked_access_rules_operation_by_share_instance_2e013be0-942c-4e94-a237-2d1251405521" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:05:49 l75lg1-v1 manila-share[98474]: DEBUG manila.share.access [None req-c5147583-5fd3-4b67-aeb1-0dc062246570 tempest-SharesActionsNegativeTest-299343130 None] All access rules have been synced for share instance 2e013be0-942c-4e94-a237-2d1251405521 belonging to share 1b08ba1e-039b-4773-869c-2a90b38f5f70. {{(pid=98474) update_access_rules /opt/stack/manila/manila/share/access.py:304}} May 28 13:05:49 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-c5147583-5fd3-4b67-aeb1-0dc062246570 tempest-SharesActionsNegativeTest-299343130 None] deleting '/manila/manila-2e013be0-942c-4e94-a237-2d1251405521' May 28 13:05:49 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c5147583-5fd3-4b67-aeb1-0dc062246570 tempest-SharesActionsNegativeTest-299343130 None] >>> [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/ May 28 13:05:49 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c5147583-5fd3-4b67-aeb1-0dc062246570 tempest-SharesActionsNegativeTest-299343130 None] {'data': '{"path": "/manila/manila-2e013be0-942c-4e94-a237-2d1251405521"}', May 28 13:05:49 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c5147583-5fd3-4b67-aeb1-0dc062246570 tempest-SharesActionsNegativeTest-299343130 None] 'params': None} May 28 13:05:49 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c5147583-5fd3-4b67-aeb1-0dc062246570 tempest-SharesActionsNegativeTest-299343130 None] <<< [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/ May 28 13:05:49 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c5147583-5fd3-4b67-aeb1-0dc062246570 tempest-SharesActionsNegativeTest-299343130 None] 'OK' May 28 13:05:49 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c5147583-5fd3-4b67-aeb1-0dc062246570 tempest-SharesActionsNegativeTest-299343130 None] --- [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/: Done May 28 13:05:49 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c5147583-5fd3-4b67-aeb1-0dc062246570 tempest-SharesActionsNegativeTest-299343130 None] >>> [GET] https://127.0.0.1:40443/api/views/ May 28 13:05:49 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c5147583-5fd3-4b67-aeb1-0dc062246570 tempest-SharesActionsNegativeTest-299343130 None] {'allow_redirects': True, May 28 13:05:49 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c5147583-5fd3-4b67-aeb1-0dc062246570 tempest-SharesActionsNegativeTest-299343130 None] 'params': {'name': '2e013be0-942c-4e94-a237-2d1251405521'}} May 28 13:05:49 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c5147583-5fd3-4b67-aeb1-0dc062246570 tempest-SharesActionsNegativeTest-299343130 None] <<< [GET] https://127.0.0.1:40443/api/views/ May 28 13:05:49 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c5147583-5fd3-4b67-aeb1-0dc062246570 tempest-SharesActionsNegativeTest-299343130 None] [Bunch(abac_tags=[], abe_max_depth=None, abe_protocols=[], alias='', allow_anonymous_access=False, allow_s3_anonymous_access=False, auto_commit='0d', bucket='', bucket_creators=[], bucket_creators_groups=[], bucket_owner=None, bulk_permission_update_progress=None, bulk_permission_update_state=None, cluster='loop75-kfs', cluster_id=1, created='2024-05-28T13:04:18.377803Z', enabled=True, files_retention_mode='NONE', guid='5df4faab-f53f-46bb-988a-5fe0fbae45d5', id=61, ignore_oos=False, internal=False, is_remote=False, is_seamless=False, logical_capacity=0, max_retention_period='0d', min_retention_period='0d', name='2e013be0-942c-4e94-a237-2d1251405521', nfs_interop_flags='BOTH_NFS3_AND_NFS4_INTEROP_DISABLED', path='/manila/manila-2e013be0-942c-4e94-a237-2d1251405521', physical_capacity=0, policy='2e013be0-942c-4e94-a237-2d1251405521', policy_id=62, protocols=['NFS'], qos_policy=None, qos_policy_id=None, s3_locks=False, s3_locks_retention_mode='NONE', s3_locks_retention_period='', s3_unverified_lookup=False, s3_versioning=False, select_for_live_monitoring=False, share='', share_acl=Bunch(acl=[], enabled=False), sync='SYNCED', sync_time='2024-05-28T13:05:08.678608Z', tenant_id=1, tenant_name='default', title='/manila/manila-2e013be0-942c-4e94-a237-2d1251405521', url='https://127.0.0.1:40443/api/views/61/')] May 28 13:05:49 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c5147583-5fd3-4b67-aeb1-0dc062246570 tempest-SharesActionsNegativeTest-299343130 None] --- [GET] https://127.0.0.1:40443/api/views/: Done May 28 13:05:49 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c5147583-5fd3-4b67-aeb1-0dc062246570 tempest-SharesActionsNegativeTest-299343130 None] >>> [DELETE] https://127.0.0.1:40443/api/views/61/ May 28 13:05:49 l75lg1-v1 nova-conductor[83647]: DEBUG dbcounter [-] [83647] Writing DB stats nova_cell1:SELECT=1,nova_cell1:UPDATE=1 {{(pid=83647) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:05:50 l75lg1-v1 nova-conductor[83648]: DEBUG dbcounter [-] [83648] Writing DB stats nova_cell1:SELECT=1 {{(pid=83648) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:05:50 l75lg1-v1 dstat.sh[49771]: 28-05 13:05:50| 2 0 97 0 0|5523M 1887M 278M 7936M| 17k 2234B| 0 420k| 0 56.0 |2383 3944 |0.83 1.02 1.02|1.0 0 0| 0 0 | 0 2048M| 29 359 0 3 6 May 28 13:05:51 l75lg1-v1 dstat.sh[49771]: 28-05 13:05:51| 0 0 99 0 0|5523M 1887M 278M 7936M| 19k 172B| 0 216k| 0 17.0 |1547 2341 |0.83 1.02 1.02|1.0 0 0| 0 0 | 0 2048M| 29 359 0 3 6 May 28 13:05:51 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c5147583-5fd3-4b67-aeb1-0dc062246570 tempest-SharesActionsNegativeTest-299343130 None] <<< [DELETE] https://127.0.0.1:40443/api/views/61/ May 28 13:05:51 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c5147583-5fd3-4b67-aeb1-0dc062246570 tempest-SharesActionsNegativeTest-299343130 None] --- [DELETE] https://127.0.0.1:40443/api/views/61/: Done May 28 13:05:51 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c5147583-5fd3-4b67-aeb1-0dc062246570 tempest-SharesActionsNegativeTest-299343130 None] >>> [GET] https://127.0.0.1:40443/api/quotas/ May 28 13:05:51 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c5147583-5fd3-4b67-aeb1-0dc062246570 tempest-SharesActionsNegativeTest-299343130 None] {'allow_redirects': True, May 28 13:05:51 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c5147583-5fd3-4b67-aeb1-0dc062246570 tempest-SharesActionsNegativeTest-299343130 None] 'params': {'name': '2e013be0-942c-4e94-a237-2d1251405521'}} May 28 13:05:52 l75lg1-v1 dstat.sh[49771]: 28-05 13:05:52| 1 0 98 0 0|5522M 1887M 278M 7936M| 21k 756B| 0 320k| 0 42.0 |2114 3269 |0.83 1.02 1.02| 0 0 0| 0 0 | 0 2048M| 29 359 0 3 6 May 28 13:05:52 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c5147583-5fd3-4b67-aeb1-0dc062246570 tempest-SharesActionsNegativeTest-299343130 None] <<< [GET] https://127.0.0.1:40443/api/quotas/ May 28 13:05:52 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c5147583-5fd3-4b67-aeb1-0dc062246570 tempest-SharesActionsNegativeTest-299343130 None] [Bunch(cluster='loop75-kfs', cluster_id=1, default_email=None, default_group_quota=None, default_user_quota=None, enable_alarms=True, enable_email_providers=True, grace_period=None, guid='d483c4e4-08e6-4da9-a9b8-40fd29bc5677', hard_limit=1073741824, hard_limit_inodes=None, id=59, internal=False, is_user_quota=False, last_user_quotas_update=None, name='2e013be0-942c-4e94-a237-2d1251405521', num_blocked_users=0, num_exceeded_users=0, path='/manila/manila-2e013be0-942c-4e94-a237-2d1251405521', percent_capacity=0, percent_inodes=None, pretty_grace_period=None, pretty_grace_period_expiration=None, pretty_state='OK', soft_limit=None, soft_limit_inodes=None, state='OK', sync_state='SYNCHRONIZED', system_id=59, tenant_id=1, tenant_name='default', time_to_block=None, title='2e013be0-942c-4e94-a237-2d1251405521', url='https://127.0.0.1:40443/api/quotas/59/', used_capacity=0, used_capacity_tb=0.0, used_effective_capacity=0, used_effective_capacity_tb=0.0, used_inodes=1, used_limited_capacity=0)] May 28 13:05:52 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c5147583-5fd3-4b67-aeb1-0dc062246570 tempest-SharesActionsNegativeTest-299343130 None] --- [GET] https://127.0.0.1:40443/api/quotas/: Done May 28 13:05:52 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c5147583-5fd3-4b67-aeb1-0dc062246570 tempest-SharesActionsNegativeTest-299343130 None] >>> [DELETE] https://127.0.0.1:40443/api/quotas/59/ May 28 13:05:52 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-d18943d4-c66b-4d7b-885f-8b36804b0eb2 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] GET http://10.27.203.238/share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares/1b08ba1e-039b-4773-869c-2a90b38f5f70 May 28 13:05:52 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-d18943d4-c66b-4d7b-885f-8b36804b0eb2 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:05:52 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-d18943d4-c66b-4d7b-885f-8b36804b0eb2 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:05:52 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-d18943d4-c66b-4d7b-885f-8b36804b0eb2 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] http://10.27.203.238/share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares/1b08ba1e-039b-4773-869c-2a90b38f5f70 returned with HTTP 200 May 28 13:05:52 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1386/2792] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:05:52 2024] GET /share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares/1b08ba1e-039b-4773-869c-2a90b38f5f70 => generated 1343 bytes in 28 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:05:53 l75lg1-v1 dstat.sh[49771]: 28-05 13:05:53| 1 0 97 1 0|5522M 1887M 278M 7936M| 20k 653B| 0 1007k| 0 91.9 |2202 3450 |0.92 1.03 1.03|1.0 0 0| 0 0 | 0 2048M| 29 359 0 3 6 May 28 13:05:54 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 13:05:54 l75lg1-v1 dstat.sh[49771]: 28-05 13:05:54| 0 0 99 0 0|5522M 1887M 278M 7936M| 25k 0 | 0 116k| 0 11.0 |1607 2355 |0.92 1.03 1.03|1.0 0 0| 0 0 | 0 2048M| 29 359 0 3 6 May 28 13:05:55 l75lg1-v1 dstat.sh[49771]: 28-05 13:05:55| 1 0 99 0 0|5522M 1887M 278M 7936M| 14k 0 | 0 124k| 0 10.0 |1460 2374 |0.92 1.03 1.03|1.0 0 0| 0 0 | 0 2048M| 29 359 0 3 6 May 28 13:05:55 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-1b1dbab4-86f7-4277-be1a-a637e5e2b381 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] GET http://10.27.203.238/share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares/1b08ba1e-039b-4773-869c-2a90b38f5f70 May 28 13:05:55 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-1b1dbab4-86f7-4277-be1a-a637e5e2b381 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:05:55 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-1b1dbab4-86f7-4277-be1a-a637e5e2b381 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:05:55 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-1b1dbab4-86f7-4277-be1a-a637e5e2b381 tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] http://10.27.203.238/share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares/1b08ba1e-039b-4773-869c-2a90b38f5f70 returned with HTTP 200 May 28 13:05:55 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1407/2793] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:05:55 2024] GET /share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares/1b08ba1e-039b-4773-869c-2a90b38f5f70 => generated 1343 bytes in 29 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:05:55 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c5147583-5fd3-4b67-aeb1-0dc062246570 tempest-SharesActionsNegativeTest-299343130 None] <<< [DELETE] https://127.0.0.1:40443/api/quotas/59/ May 28 13:05:55 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c5147583-5fd3-4b67-aeb1-0dc062246570 tempest-SharesActionsNegativeTest-299343130 None] --- [DELETE] https://127.0.0.1:40443/api/quotas/59/: Done May 28 13:05:55 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c5147583-5fd3-4b67-aeb1-0dc062246570 tempest-SharesActionsNegativeTest-299343130 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:05:55 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c5147583-5fd3-4b67-aeb1-0dc062246570 tempest-SharesActionsNegativeTest-299343130 None] {'allow_redirects': True, May 28 13:05:55 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c5147583-5fd3-4b67-aeb1-0dc062246570 tempest-SharesActionsNegativeTest-299343130 None] 'params': {'name': '2e013be0-942c-4e94-a237-2d1251405521'}} May 28 13:05:55 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 13:05:55 l75lg1-v1 devstack@keystone.service[51266]: DEBUG dbcounter [-] [51266] Writing DB stats keystone:SELECT=14 {{(pid=51266) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:05:55 l75lg1-v1 devstack@keystone.service[51267]: DEBUG dbcounter [-] [51267] Writing DB stats keystone:SELECT=25,keystone:DELETE=10,keystone:INSERT=1 {{(pid=51267) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:05:56 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c5147583-5fd3-4b67-aeb1-0dc062246570 tempest-SharesActionsNegativeTest-299343130 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:05:56 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c5147583-5fd3-4b67-aeb1-0dc062246570 tempest-SharesActionsNegativeTest-299343130 None] [Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=0, created='2024-05-28T13:04:15.653439Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='fbc2e3b0-baed-4bfe-9fb1-9e178518fb3b', id=62, internal=False, is_s3_default_policy=False, name='2e013be0-942c-4e94-a237-2d1251405521', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=[], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['*'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['*'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T13:04:15.976165Z', tenant_id=1, tenant_name='default', title='2e013be0-942c-4e94-a237-2d1251405521', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/62/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[])] May 28 13:05:56 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c5147583-5fd3-4b67-aeb1-0dc062246570 tempest-SharesActionsNegativeTest-299343130 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 13:05:56 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c5147583-5fd3-4b67-aeb1-0dc062246570 tempest-SharesActionsNegativeTest-299343130 None] >>> [DELETE] https://127.0.0.1:40443/api/viewpolicies/62/ May 28 13:05:56 l75lg1-v1 dstat.sh[49771]: 28-05 13:05:56| 1 0 98 0 0|5522M 1887M 278M 7936M| 19k 1562B| 0 204k| 0 29.0 |1805 2695 |0.92 1.03 1.03| 0 0 0| 0 0 | 0 2048M| 29 359 0 3 6 May 28 13:05:57 l75lg1-v1 dstat.sh[49771]: 28-05 13:05:57| 1 0 99 0 0|5522M 1887M 278M 7936M| 19k 0 | 0 104k| 0 17.0 |1831 2925 |0.92 1.03 1.03| 0 0 0| 0 0 | 0 2048M| 29 359 0 3 6 May 28 13:05:57 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 13:05:57 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.manager [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=83654) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10545}} May 28 13:05:57 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c5147583-5fd3-4b67-aeb1-0dc062246570 tempest-SharesActionsNegativeTest-299343130 None] <<< [DELETE] https://127.0.0.1:40443/api/viewpolicies/62/ May 28 13:05:57 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c5147583-5fd3-4b67-aeb1-0dc062246570 tempest-SharesActionsNegativeTest-299343130 None] --- [DELETE] https://127.0.0.1:40443/api/viewpolicies/62/: Done May 28 13:05:57 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-c5147583-5fd3-4b67-aeb1-0dc062246570 tempest-SharesActionsNegativeTest-299343130 None] Created reservations ['277da2c3-8b10-4a9e-acfe-21176ab9e99a', 'a9b9c135-bd7f-4a4e-8b52-116cc09c7d29', 'ef996937-43a7-4173-b877-34c0864eaecc', '01b13c86-f73d-452d-a6e1-9ba6ff1030da'] {{(pid=98474) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 13:05:57 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-c5147583-5fd3-4b67-aeb1-0dc062246570 tempest-SharesActionsNegativeTest-299343130 None] Committed reservations ['277da2c3-8b10-4a9e-acfe-21176ab9e99a', 'a9b9c135-bd7f-4a4e-8b52-116cc09c7d29', 'ef996937-43a7-4173-b877-34c0864eaecc', '01b13c86-f73d-452d-a6e1-9ba6ff1030da'] {{(pid=98474) commit /opt/stack/manila/manila/quota.py:1063}} May 28 13:05:57 l75lg1-v1 manila-share[98474]: INFO manila.share.manager [None req-c5147583-5fd3-4b67-aeb1-0dc062246570 tempest-SharesActionsNegativeTest-299343130 None] Share instance 2e013be0-942c-4e94-a237-2d1251405521: deleted successfully. May 28 13:05:58 l75lg1-v1 dstat.sh[49771]: 28-05 13:05:58| 2 0 97 1 0|5522M 1887M 278M 7936M| 15k 66B| 0 408k| 0 69.0 |2291 3674 |0.85 1.02 1.02|1.0 0 0| 0 0 | 0 2048M| 29 359 0 3 6 May 28 13:05:58 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-6e4a3acd-d2e9-4255-b11e-a894d20872cc tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] GET http://10.27.203.238/share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares/1b08ba1e-039b-4773-869c-2a90b38f5f70 May 28 13:05:58 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-6e4a3acd-d2e9-4255-b11e-a894d20872cc tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:05:58 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-6e4a3acd-d2e9-4255-b11e-a894d20872cc tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:05:58 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-6e4a3acd-d2e9-4255-b11e-a894d20872cc tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] HTTP exception thrown: The resource could not be found. May 28 13:05:58 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-6e4a3acd-d2e9-4255-b11e-a894d20872cc tempest-SharesActionsNegativeTest-299343130 tempest-SharesActionsNegativeTest-299343130-project-member] http://10.27.203.238/share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares/1b08ba1e-039b-4773-869c-2a90b38f5f70 returned with HTTP 404 May 28 13:05:58 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1387/2794] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:05:58 2024] GET /share/v2/c39deaad5eb341ceb2e3c79518f56a1b/shares/1b08ba1e-039b-4773-869c-2a90b38f5f70 => generated 78 bytes in 12 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 13:05:58 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-d25200b8-de1e-4ab0-ad44-b5b1716e0d02 tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] DELETE http://10.27.203.238/share/v2/c7f81fe24c76497a89dd033554ce1057/types/f7d65ead-0196-4e03-928f-2e08ca825112 May 28 13:05:58 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-d25200b8-de1e-4ab0-ad44-b5b1716e0d02 tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:05:58 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-d25200b8-de1e-4ab0-ad44-b5b1716e0d02 tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] Calling method 'ShareTypesController._delete' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:05:58 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-d25200b8-de1e-4ab0-ad44-b5b1716e0d02 tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] http://10.27.203.238/share/v2/c7f81fe24c76497a89dd033554ce1057/types/f7d65ead-0196-4e03-928f-2e08ca825112 returned with HTTP 202 May 28 13:05:58 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1408/2795] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:05:58 2024] DELETE /share/v2/c7f81fe24c76497a89dd033554ce1057/types/f7d65ead-0196-4e03-928f-2e08ca825112 => generated 0 bytes in 68 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 13:05:58 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-bccd75f3-6476-48b1-84df-830cecb32218 tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] GET http://10.27.203.238/share/v2/c7f81fe24c76497a89dd033554ce1057/types/f7d65ead-0196-4e03-928f-2e08ca825112 May 28 13:05:58 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-bccd75f3-6476-48b1-84df-830cecb32218 tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:05:58 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-bccd75f3-6476-48b1-84df-830cecb32218 tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] Calling method 'ShareTypesController.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:05:58 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-bccd75f3-6476-48b1-84df-830cecb32218 tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] HTTP exception thrown: Share type not found. May 28 13:05:58 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-bccd75f3-6476-48b1-84df-830cecb32218 tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] http://10.27.203.238/share/v2/c7f81fe24c76497a89dd033554ce1057/types/f7d65ead-0196-4e03-928f-2e08ca825112 returned with HTTP 404 May 28 13:05:58 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1388/2796] 10.27.203.238 () {64 vars in 1448 bytes} [Tue May 28 13:05:58 2024] GET /share/v2/c7f81fe24c76497a89dd033554ce1057/types/f7d65ead-0196-4e03-928f-2e08ca825112 => generated 67 bytes in 11 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 13:05:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d70ed2-651e-49a1-a79c-9be849ba4298 tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:05:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-c7d70ed2-651e-49a1-a79c-9be849ba4298 tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:05:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d70ed2-651e-49a1-a79c-9be849ba4298 tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:05:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7a05c5-9450-4e3c-913a-057a6ab04b17 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:05:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7a05c5-9450-4e3c-913a-057a6ab04b17 None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:05:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7a05c5-9450-4e3c-913a-057a6ab04b17 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:05:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7a05c5-9450-4e3c-913a-057a6ab04b17 None admin] PATH_INFO: `/v3/users/31f71bac04e24dc9908978bd950e8011` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:05:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7a05c5-9450-4e3c-913a-057a6ab04b17 None admin] RBAC: Authorizing `identity:delete_user(user_id=31f71bac04e24dc9908978bd950e8011)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:05:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7a05c5-9450-4e3c-913a-057a6ab04b17 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:05:58 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 13:05:58 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 13:05:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-ee7a05c5-9450-4e3c-913a-057a6ab04b17 None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31f71bac04e24dc9908978bd950e8011', 'request_id': 'req-ee7a05c5-9450-4e3c-913a-057a6ab04b17'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:05:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-ee7a05c5-9450-4e3c-913a-057a6ab04b17 None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31f71bac04e24dc9908978bd950e8011', 'request_id': 'req-ee7a05c5-9450-4e3c-913a-057a6ab04b17'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:05:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-ee7a05c5-9450-4e3c-913a-057a6ab04b17 None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31f71bac04e24dc9908978bd950e8011', 'request_id': 'req-ee7a05c5-9450-4e3c-913a-057a6ab04b17'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:05:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-ee7a05c5-9450-4e3c-913a-057a6ab04b17 None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31f71bac04e24dc9908978bd950e8011', 'request_id': 'req-ee7a05c5-9450-4e3c-913a-057a6ab04b17'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:05:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-ee7a05c5-9450-4e3c-913a-057a6ab04b17 None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31f71bac04e24dc9908978bd950e8011', 'request_id': 'req-ee7a05c5-9450-4e3c-913a-057a6ab04b17'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:05:58 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1835/3701] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 13:05:58 2024] DELETE /identity/v3/users/31f71bac04e24dc9908978bd950e8011 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:05:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b1ac94-ed30-41ec-86aa-858083d37e9e tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:05:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b1ac94-ed30-41ec-86aa-858083d37e9e tempest-SharesActionsNegativeTest-1811071209 tempest-SharesActionsNegativeTest-1811071209-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:05:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a48c30-1b27-4ff6-bc03-e3b81ff61f9f None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:05:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a48c30-1b27-4ff6-bc03-e3b81ff61f9f None admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:05:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a48c30-1b27-4ff6-bc03-e3b81ff61f9f None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:05:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a48c30-1b27-4ff6-bc03-e3b81ff61f9f None admin] PATH_INFO: `/v3/users/a841680e39754232a9b193a9b88cc12a` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:05:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a48c30-1b27-4ff6-bc03-e3b81ff61f9f None admin] RBAC: Authorizing `identity:delete_user(user_id=a841680e39754232a9b193a9b88cc12a)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:05:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a48c30-1b27-4ff6-bc03-e3b81ff61f9f None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:05:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-35a48c30-1b27-4ff6-bc03-e3b81ff61f9f None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a841680e39754232a9b193a9b88cc12a', 'request_id': 'req-35a48c30-1b27-4ff6-bc03-e3b81ff61f9f'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:05:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-35a48c30-1b27-4ff6-bc03-e3b81ff61f9f None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a841680e39754232a9b193a9b88cc12a', 'request_id': 'req-35a48c30-1b27-4ff6-bc03-e3b81ff61f9f'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:05:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-35a48c30-1b27-4ff6-bc03-e3b81ff61f9f None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a841680e39754232a9b193a9b88cc12a', 'request_id': 'req-35a48c30-1b27-4ff6-bc03-e3b81ff61f9f'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:05:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-35a48c30-1b27-4ff6-bc03-e3b81ff61f9f None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a841680e39754232a9b193a9b88cc12a', 'request_id': 'req-35a48c30-1b27-4ff6-bc03-e3b81ff61f9f'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:05:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-35a48c30-1b27-4ff6-bc03-e3b81ff61f9f None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a841680e39754232a9b193a9b88cc12a', 'request_id': 'req-35a48c30-1b27-4ff6-bc03-e3b81ff61f9f'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:05:58 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1867/3702] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 13:05:58 2024] DELETE /identity/v3/users/a841680e39754232a9b193a9b88cc12a => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:05:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7a05c5-9450-4e3c-913a-057a6ab04b17 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:05:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-ee7a05c5-9450-4e3c-913a-057a6ab04b17 None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:05:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7a05c5-9450-4e3c-913a-057a6ab04b17 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:05:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2ad59b-16bb-4b2a-adff-db6b4b1ffd1a None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:05:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2ad59b-16bb-4b2a-adff-db6b4b1ffd1a None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:05:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2ad59b-16bb-4b2a-adff-db6b4b1ffd1a None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:05:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2ad59b-16bb-4b2a-adff-db6b4b1ffd1a None admin] PATH_INFO: `/v3/users/0872f5cfc04e4f64bafdd937cfed5d39` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:05:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2ad59b-16bb-4b2a-adff-db6b4b1ffd1a None admin] RBAC: Authorizing `identity:delete_user(user_id=0872f5cfc04e4f64bafdd937cfed5d39)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:05:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2ad59b-16bb-4b2a-adff-db6b4b1ffd1a None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:05:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-ea2ad59b-16bb-4b2a-adff-db6b4b1ffd1a None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0872f5cfc04e4f64bafdd937cfed5d39', 'request_id': 'req-ea2ad59b-16bb-4b2a-adff-db6b4b1ffd1a'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:05:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-ea2ad59b-16bb-4b2a-adff-db6b4b1ffd1a None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0872f5cfc04e4f64bafdd937cfed5d39', 'request_id': 'req-ea2ad59b-16bb-4b2a-adff-db6b4b1ffd1a'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:05:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-ea2ad59b-16bb-4b2a-adff-db6b4b1ffd1a None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0872f5cfc04e4f64bafdd937cfed5d39', 'request_id': 'req-ea2ad59b-16bb-4b2a-adff-db6b4b1ffd1a'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:05:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-ea2ad59b-16bb-4b2a-adff-db6b4b1ffd1a None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0872f5cfc04e4f64bafdd937cfed5d39', 'request_id': 'req-ea2ad59b-16bb-4b2a-adff-db6b4b1ffd1a'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:05:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-ea2ad59b-16bb-4b2a-adff-db6b4b1ffd1a None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0872f5cfc04e4f64bafdd937cfed5d39', 'request_id': 'req-ea2ad59b-16bb-4b2a-adff-db6b4b1ffd1a'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:05:58 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1836/3703] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 13:05:58 2024] DELETE /identity/v3/users/0872f5cfc04e4f64bafdd937cfed5d39 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:05:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837876f3-1e20-49af-be86-411d5201482b None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:05:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837876f3-1e20-49af-be86-411d5201482b None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:05:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837876f3-1e20-49af-be86-411d5201482b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:05:58 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-837876f3-1e20-49af-be86-411d5201482b None None] Truncating password to algorithm specific maximum length 72 characters. May 28 13:05:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-837876f3-1e20-49af-be86-411d5201482b None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 13:05:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-837876f3-1e20-49af-be86-411d5201482b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:05:58 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1868/3704] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 13:05:58 2024] POST /identity/v3/auth/tokens => generated 2960 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 13:05:58 l75lg1-v1 neutron-server[77619]: DEBUG neutron.wsgi [-] (77619) accepted ('10.27.203.238', 46542) {{(pid=77619) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 13:05:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2ad59b-16bb-4b2a-adff-db6b4b1ffd1a None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:05:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-ea2ad59b-16bb-4b2a-adff-db6b4b1ffd1a None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:05:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2ad59b-16bb-4b2a-adff-db6b4b1ffd1a None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:05:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c81b6ec-d85e-4b1e-9969-c715e536a464 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef17047035e4b518fd5360a01f2da1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:05:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c81b6ec-d85e-4b1e-9969-c715e536a464 service neutron] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:05:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c81b6ec-d85e-4b1e-9969-c715e536a464 service neutron] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:05:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c81b6ec-d85e-4b1e-9969-c715e536a464 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:05:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c81b6ec-d85e-4b1e-9969-c715e536a464 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:05:58 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c81b6ec-d85e-4b1e-9969-c715e536a464 service neutron] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:05:58 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1837/3705] 10.27.203.238 () {64 vars in 1432 bytes} [Tue May 28 13:05:58 2024] GET /identity/v3/auth/tokens => generated 2960 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 28 13:05:58 l75lg1-v1 neutron-server[77619]: INFO neutron.wsgi [None req-d163acdc-2bbd-4e78-88fd-a2987ef463b5 None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=0458d53d773c434eafc80da00cf6604a&name=default HTTP/1.1" status: 200 len: 216 time: 0.0708561 May 28 13:05:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837876f3-1e20-49af-be86-411d5201482b None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:05:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-837876f3-1e20-49af-be86-411d5201482b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:05:58 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837876f3-1e20-49af-be86-411d5201482b None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298af365-4f26-4a5d-8b6e-f18d1c059b7e None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298af365-4f26-4a5d-8b6e-f18d1c059b7e None admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298af365-4f26-4a5d-8b6e-f18d1c059b7e None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298af365-4f26-4a5d-8b6e-f18d1c059b7e None admin] PATH_INFO: `/v3/projects/0458d53d773c434eafc80da00cf6604a` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298af365-4f26-4a5d-8b6e-f18d1c059b7e None admin] RBAC: Authorizing `identity:delete_project(project_id=0458d53d773c434eafc80da00cf6604a)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298af365-4f26-4a5d-8b6e-f18d1c059b7e None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-298af365-4f26-4a5d-8b6e-f18d1c059b7e None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0458d53d773c434eafc80da00cf6604a', 'request_id': 'req-298af365-4f26-4a5d-8b6e-f18d1c059b7e'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-298af365-4f26-4a5d-8b6e-f18d1c059b7e None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0458d53d773c434eafc80da00cf6604a', 'request_id': 'req-298af365-4f26-4a5d-8b6e-f18d1c059b7e'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-298af365-4f26-4a5d-8b6e-f18d1c059b7e None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0458d53d773c434eafc80da00cf6604a', 'request_id': 'req-298af365-4f26-4a5d-8b6e-f18d1c059b7e'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-298af365-4f26-4a5d-8b6e-f18d1c059b7e None admin] The token cache is being invalidate because project 0458d53d773c434eafc80da00cf6604a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-298af365-4f26-4a5d-8b6e-f18d1c059b7e None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-298af365-4f26-4a5d-8b6e-f18d1c059b7e None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1869/3706] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 13:05:58 2024] DELETE /identity/v3/projects/0458d53d773c434eafc80da00cf6604a => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:05:59 l75lg1-v1 neutron-server[77619]: DEBUG neutron.wsgi [-] (77619) accepted ('10.27.203.238', 46546) {{(pid=77619) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 13:05:59 l75lg1-v1 neutron-server[77619]: INFO neutron.wsgi [None req-784bebfb-267e-4c29-ae79-79331ba2065e None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=c7f81fe24c76497a89dd033554ce1057&name=default HTTP/1.1" status: 200 len: 216 time: 0.0079782 May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c81b6ec-d85e-4b1e-9969-c715e536a464 service neutron] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c81b6ec-d85e-4b1e-9969-c715e536a464 service neutron] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9256bf3b-a210-4bc9-9a6c-d2ca18c37ef1 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9256bf3b-a210-4bc9-9a6c-d2ca18c37ef1 None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9256bf3b-a210-4bc9-9a6c-d2ca18c37ef1 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9256bf3b-a210-4bc9-9a6c-d2ca18c37ef1 None admin] PATH_INFO: `/v3/projects/c7f81fe24c76497a89dd033554ce1057` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9256bf3b-a210-4bc9-9a6c-d2ca18c37ef1 None admin] RBAC: Authorizing `identity:delete_project(project_id=c7f81fe24c76497a89dd033554ce1057)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9256bf3b-a210-4bc9-9a6c-d2ca18c37ef1 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-9256bf3b-a210-4bc9-9a6c-d2ca18c37ef1 None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7f81fe24c76497a89dd033554ce1057', 'request_id': 'req-9256bf3b-a210-4bc9-9a6c-d2ca18c37ef1'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-9256bf3b-a210-4bc9-9a6c-d2ca18c37ef1 None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7f81fe24c76497a89dd033554ce1057', 'request_id': 'req-9256bf3b-a210-4bc9-9a6c-d2ca18c37ef1'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-9256bf3b-a210-4bc9-9a6c-d2ca18c37ef1 None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7f81fe24c76497a89dd033554ce1057', 'request_id': 'req-9256bf3b-a210-4bc9-9a6c-d2ca18c37ef1'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-9256bf3b-a210-4bc9-9a6c-d2ca18c37ef1 None admin] The token cache is being invalidate because project c7f81fe24c76497a89dd033554ce1057 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-9256bf3b-a210-4bc9-9a6c-d2ca18c37ef1 None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-9256bf3b-a210-4bc9-9a6c-d2ca18c37ef1 None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1838/3707] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 13:05:59 2024] DELETE /identity/v3/projects/c7f81fe24c76497a89dd033554ce1057 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:05:59 l75lg1-v1 neutron-server[77619]: DEBUG neutron.wsgi [-] (77619) accepted ('10.27.203.238', 46562) {{(pid=77619) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 13:05:59 l75lg1-v1 neutron-server[77619]: INFO neutron.wsgi [None req-057ab246-35ed-4f06-aac0-76c57820faaf None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=c39deaad5eb341ceb2e3c79518f56a1b&name=default HTTP/1.1" status: 200 len: 216 time: 0.0079734 May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298af365-4f26-4a5d-8b6e-f18d1c059b7e None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-298af365-4f26-4a5d-8b6e-f18d1c059b7e None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298af365-4f26-4a5d-8b6e-f18d1c059b7e None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a216c374-49a3-428a-a843-0b2fcd5421fe None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a216c374-49a3-428a-a843-0b2fcd5421fe None admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a216c374-49a3-428a-a843-0b2fcd5421fe None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a216c374-49a3-428a-a843-0b2fcd5421fe None admin] PATH_INFO: `/v3/projects/c39deaad5eb341ceb2e3c79518f56a1b` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a216c374-49a3-428a-a843-0b2fcd5421fe None admin] RBAC: Authorizing `identity:delete_project(project_id=c39deaad5eb341ceb2e3c79518f56a1b)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a216c374-49a3-428a-a843-0b2fcd5421fe None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:05:59 l75lg1-v1 dstat.sh[49771]: 28-05 13:05:59| 7 1 89 2 0|5522M 1887M 278M 7936M| 14k 172B| 0 2327k| 0 445 |6899 12k|0.85 1.02 1.02|1.0 0 2.0| 0 0 | 0 2048M| 29 360 0 7 6 May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-a216c374-49a3-428a-a843-0b2fcd5421fe None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c39deaad5eb341ceb2e3c79518f56a1b', 'request_id': 'req-a216c374-49a3-428a-a843-0b2fcd5421fe'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-a216c374-49a3-428a-a843-0b2fcd5421fe None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c39deaad5eb341ceb2e3c79518f56a1b', 'request_id': 'req-a216c374-49a3-428a-a843-0b2fcd5421fe'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-a216c374-49a3-428a-a843-0b2fcd5421fe None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c39deaad5eb341ceb2e3c79518f56a1b', 'request_id': 'req-a216c374-49a3-428a-a843-0b2fcd5421fe'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-a216c374-49a3-428a-a843-0b2fcd5421fe None admin] The token cache is being invalidate because project c39deaad5eb341ceb2e3c79518f56a1b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-a216c374-49a3-428a-a843-0b2fcd5421fe None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-a216c374-49a3-428a-a843-0b2fcd5421fe None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1870/3708] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 13:05:59 2024] DELETE /identity/v3/projects/c39deaad5eb341ceb2e3c79518f56a1b => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7724507-c03e-4295-8a61-4e1a4c104a40 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7724507-c03e-4295-8a61-4e1a4c104a40 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7724507-c03e-4295-8a61-4e1a4c104a40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-e7724507-c03e-4295-8a61-4e1a4c104a40 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-e7724507-c03e-4295-8a61-4e1a4c104a40 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-e7724507-c03e-4295-8a61-4e1a4c104a40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1839/3709] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 13:05:59 2024] POST /identity/v3/auth/tokens => generated 312 bytes in 25 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c806fa-866e-46cb-9824-594aeeda5b07 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c806fa-866e-46cb-9824-594aeeda5b07 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c806fa-866e-46cb-9824-594aeeda5b07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-06c806fa-866e-46cb-9824-594aeeda5b07 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-06c806fa-866e-46cb-9824-594aeeda5b07 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-06c806fa-866e-46cb-9824-594aeeda5b07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1871/3710] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 13:05:59 2024] POST /identity/v3/auth/tokens => generated 2960 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7724507-c03e-4295-8a61-4e1a4c104a40 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7724507-c03e-4295-8a61-4e1a4c104a40 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47257da5-a52b-4e63-91b7-8739a3d7f914 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47257da5-a52b-4e63-91b7-8739a3d7f914 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47257da5-a52b-4e63-91b7-8739a3d7f914 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47257da5-a52b-4e63-91b7-8739a3d7f914 None admin] PATH_INFO: `/v3/domains` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47257da5-a52b-4e63-91b7-8739a3d7f914 None admin] RBAC: Adding query filter params (name=Default) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47257da5-a52b-4e63-91b7-8739a3d7f914 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47257da5-a52b-4e63-91b7-8739a3d7f914 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1840/3711] 10.27.203.238 () {62 vars in 1220 bytes} [Tue May 28 13:05:59 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c806fa-866e-46cb-9824-594aeeda5b07 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c806fa-866e-46cb-9824-594aeeda5b07 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0386cf42-0b36-4d89-8d82-75f2464ef65e None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0386cf42-0b36-4d89-8d82-75f2464ef65e None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0386cf42-0b36-4d89-8d82-75f2464ef65e None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0386cf42-0b36-4d89-8d82-75f2464ef65e None admin] PATH_INFO: `/v3/projects` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0386cf42-0b36-4d89-8d82-75f2464ef65e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0386cf42-0b36-4d89-8d82-75f2464ef65e None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1872/3712] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 13:05:59 2024] POST /identity/v3/projects => generated 387 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47257da5-a52b-4e63-91b7-8739a3d7f914 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47257da5-a52b-4e63-91b7-8739a3d7f914 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c403b2f9-d46d-41ab-b770-c96fbada005e None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c403b2f9-d46d-41ab-b770-c96fbada005e None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c403b2f9-d46d-41ab-b770-c96fbada005e None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c403b2f9-d46d-41ab-b770-c96fbada005e None admin] PATH_INFO: `/v3/users` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c403b2f9-d46d-41ab-b770-c96fbada005e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c403b2f9-d46d-41ab-b770-c96fbada005e None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-c403b2f9-d46d-41ab-b770-c96fbada005e None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1841/3713] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 13:05:59 2024] POST /identity/v3/users => generated 302 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0386cf42-0b36-4d89-8d82-75f2464ef65e None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0386cf42-0b36-4d89-8d82-75f2464ef65e None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e07467-8dfe-4467-9e1e-6414f4236a9e None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e07467-8dfe-4467-9e1e-6414f4236a9e None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e07467-8dfe-4467-9e1e-6414f4236a9e None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e07467-8dfe-4467-9e1e-6414f4236a9e None admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e07467-8dfe-4467-9e1e-6414f4236a9e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e07467-8dfe-4467-9e1e-6414f4236a9e None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1873/3714] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 13:05:59 2024] GET /identity/v3/roles => generated 1680 bytes in 16 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c403b2f9-d46d-41ab-b770-c96fbada005e None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c403b2f9-d46d-41ab-b770-c96fbada005e None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe9ff92-397b-4b28-86b4-a2062fae10ba None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe9ff92-397b-4b28-86b4-a2062fae10ba None admin] REQUEST_METHOD: `PUT` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe9ff92-397b-4b28-86b4-a2062fae10ba None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe9ff92-397b-4b28-86b4-a2062fae10ba None admin] PATH_INFO: `/v3/projects/9c1e3ce524bc424eae1e9467bc390dec/users/d753eb2d4042469ca1e5eb6c31817552/roles/44620cad10ae407c90c91e2c296adb04` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe9ff92-397b-4b28-86b4-a2062fae10ba None admin] RBAC: Authorizing `identity:create_grant(project_id=9c1e3ce524bc424eae1e9467bc390dec, user_id=d753eb2d4042469ca1e5eb6c31817552, role_id=44620cad10ae407c90c91e2c296adb04)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe9ff92-397b-4b28-86b4-a2062fae10ba None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1842/3715] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 13:05:59 2024] PUT /identity/v3/projects/9c1e3ce524bc424eae1e9467bc390dec/users/d753eb2d4042469ca1e5eb6c31817552/roles/44620cad10ae407c90c91e2c296adb04 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3200a2-0814-4b23-a8db-0460e4ce1895 None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3200a2-0814-4b23-a8db-0460e4ce1895 None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3200a2-0814-4b23-a8db-0460e4ce1895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-4e3200a2-0814-4b23-a8db-0460e4ce1895 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-4e3200a2-0814-4b23-a8db-0460e4ce1895 None None] MFA Rules not processed for user `d753eb2d4042469ca1e5eb6c31817552`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-4e3200a2-0814-4b23-a8db-0460e4ce1895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:05:59 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 13:05:59 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.manager [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Starting heal instance info cache {{(pid=83654) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}} May 28 13:05:59 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.manager [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Rebuilding the list of instances to heal {{(pid=83654) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9930}} May 28 13:05:59 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Expecting reply to msg c064165061fb4f93a0105ec283e78083 in queue reply_37f4cbd1dd094961a22b8a65f222c327 May 28 13:05:59 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [-] Received RPC response for msg c064165061fb4f93a0105ec283e78083 May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1874/3716] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 13:05:59 2024] POST /identity/v3/auth/tokens => generated 3958 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe9ff92-397b-4b28-86b4-a2062fae10ba None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe9ff92-397b-4b28-86b4-a2062fae10ba None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928cadcd-2c38-4f4b-8d3f-5f2b4c08e603 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928cadcd-2c38-4f4b-8d3f-5f2b4c08e603 None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928cadcd-2c38-4f4b-8d3f-5f2b4c08e603 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928cadcd-2c38-4f4b-8d3f-5f2b4c08e603 None admin] PATH_INFO: `/v3/projects` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928cadcd-2c38-4f4b-8d3f-5f2b4c08e603 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928cadcd-2c38-4f4b-8d3f-5f2b4c08e603 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1843/3717] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 13:05:59 2024] POST /identity/v3/projects => generated 389 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3200a2-0814-4b23-a8db-0460e4ce1895 None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3200a2-0814-4b23-a8db-0460e4ce1895 None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d417da-340a-4a6b-9abf-78ac07d69913 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d417da-340a-4a6b-9abf-78ac07d69913 None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d417da-340a-4a6b-9abf-78ac07d69913 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d417da-340a-4a6b-9abf-78ac07d69913 None admin] PATH_INFO: `/v3/users` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d417da-340a-4a6b-9abf-78ac07d69913 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d417da-340a-4a6b-9abf-78ac07d69913 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-a6d417da-340a-4a6b-9abf-78ac07d69913 None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1875/3718] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 13:05:59 2024] POST /identity/v3/users => generated 303 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928cadcd-2c38-4f4b-8d3f-5f2b4c08e603 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928cadcd-2c38-4f4b-8d3f-5f2b4c08e603 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb82b74-1223-44a5-8c9c-5ca3afae15e5 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb82b74-1223-44a5-8c9c-5ca3afae15e5 None admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb82b74-1223-44a5-8c9c-5ca3afae15e5 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb82b74-1223-44a5-8c9c-5ca3afae15e5 None admin] PATH_INFO: `/v3/roles` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb82b74-1223-44a5-8c9c-5ca3afae15e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb82b74-1223-44a5-8c9c-5ca3afae15e5 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1844/3719] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 13:05:59 2024] GET /identity/v3/roles => generated 1680 bytes in 16 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d417da-340a-4a6b-9abf-78ac07d69913 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d417da-340a-4a6b-9abf-78ac07d69913 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af35ac79-353d-421b-a93c-459368c2e283 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af35ac79-353d-421b-a93c-459368c2e283 None admin] REQUEST_METHOD: `PUT` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af35ac79-353d-421b-a93c-459368c2e283 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af35ac79-353d-421b-a93c-459368c2e283 None admin] PATH_INFO: `/v3/projects/ee61830c3b024e4e90d4426470e41c9a/users/f4253f6924fc4cbc9e576cd98eca107d/roles/44620cad10ae407c90c91e2c296adb04` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af35ac79-353d-421b-a93c-459368c2e283 None admin] RBAC: Authorizing `identity:create_grant(project_id=ee61830c3b024e4e90d4426470e41c9a, user_id=f4253f6924fc4cbc9e576cd98eca107d, role_id=44620cad10ae407c90c91e2c296adb04)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af35ac79-353d-421b-a93c-459368c2e283 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1876/3720] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 13:05:59 2024] PUT /identity/v3/projects/ee61830c3b024e4e90d4426470e41c9a/users/f4253f6924fc4cbc9e576cd98eca107d/roles/44620cad10ae407c90c91e2c296adb04 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebe9cf8-f035-416f-9ebd-b806d223c55f None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebe9cf8-f035-416f-9ebd-b806d223c55f None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebe9cf8-f035-416f-9ebd-b806d223c55f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-0ebe9cf8-f035-416f-9ebd-b806d223c55f None None] Truncating password to algorithm specific maximum length 72 characters. May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-0ebe9cf8-f035-416f-9ebd-b806d223c55f None None] MFA Rules not processed for user `f4253f6924fc4cbc9e576cd98eca107d`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-0ebe9cf8-f035-416f-9ebd-b806d223c55f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1845/3721] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 13:05:59 2024] POST /identity/v3/auth/tokens => generated 3960 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af35ac79-353d-421b-a93c-459368c2e283 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af35ac79-353d-421b-a93c-459368c2e283 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f867439-b436-4f68-aa9a-dadbb90ed9f5 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f867439-b436-4f68-aa9a-dadbb90ed9f5 None admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f867439-b436-4f68-aa9a-dadbb90ed9f5 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f867439-b436-4f68-aa9a-dadbb90ed9f5 None admin] PATH_INFO: `/v3/projects` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f867439-b436-4f68-aa9a-dadbb90ed9f5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f867439-b436-4f68-aa9a-dadbb90ed9f5 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1877/3722] 10.27.203.238 () {64 vars in 1220 bytes} [Tue May 28 13:05:59 2024] POST /identity/v3/projects => generated 383 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebe9cf8-f035-416f-9ebd-b806d223c55f None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebe9cf8-f035-416f-9ebd-b806d223c55f None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd01a9b-5e63-456e-83e4-b3ae9d1740b7 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd01a9b-5e63-456e-83e4-b3ae9d1740b7 None admin] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd01a9b-5e63-456e-83e4-b3ae9d1740b7 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd01a9b-5e63-456e-83e4-b3ae9d1740b7 None admin] PATH_INFO: `/v3/users` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd01a9b-5e63-456e-83e4-b3ae9d1740b7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd01a9b-5e63-456e-83e4-b3ae9d1740b7 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-7fd01a9b-5e63-456e-83e4-b3ae9d1740b7 None admin] Truncating password to algorithm specific maximum length 72 characters. May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1846/3723] 10.27.203.238 () {64 vars in 1211 bytes} [Tue May 28 13:05:59 2024] POST /identity/v3/users => generated 299 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f867439-b436-4f68-aa9a-dadbb90ed9f5 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f867439-b436-4f68-aa9a-dadbb90ed9f5 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501387c5-14d6-4e6b-99cf-df57698d139c None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501387c5-14d6-4e6b-99cf-df57698d139c None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501387c5-14d6-4e6b-99cf-df57698d139c None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501387c5-14d6-4e6b-99cf-df57698d139c None admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501387c5-14d6-4e6b-99cf-df57698d139c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:05:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501387c5-14d6-4e6b-99cf-df57698d139c None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:06:00 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1878/3724] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 13:05:59 2024] GET /identity/v3/roles => generated 1680 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 13:06:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd01a9b-5e63-456e-83e4-b3ae9d1740b7 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:06:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd01a9b-5e63-456e-83e4-b3ae9d1740b7 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:06:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00846fa1-f570-402f-badf-676909d3b668 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:06:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00846fa1-f570-402f-badf-676909d3b668 None admin] REQUEST_METHOD: `PUT` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:06:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00846fa1-f570-402f-badf-676909d3b668 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:06:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00846fa1-f570-402f-badf-676909d3b668 None admin] PATH_INFO: `/v3/projects/34275d855b714711982480692b7c6977/users/4f5fc5b71cc041f792aff79543d3842e/roles/e7989893488f483baa107be56668c4f8` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:06:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00846fa1-f570-402f-badf-676909d3b668 None admin] RBAC: Authorizing `identity:create_grant(project_id=34275d855b714711982480692b7c6977, user_id=4f5fc5b71cc041f792aff79543d3842e, role_id=e7989893488f483baa107be56668c4f8)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:06:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00846fa1-f570-402f-badf-676909d3b668 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:06:00 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1847/3725] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 13:06:00 2024] PUT /identity/v3/projects/34275d855b714711982480692b7c6977/users/4f5fc5b71cc041f792aff79543d3842e/roles/e7989893488f483baa107be56668c4f8 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:06:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501387c5-14d6-4e6b-99cf-df57698d139c None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:06:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501387c5-14d6-4e6b-99cf-df57698d139c None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:06:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3e86de-bd65-4659-bb8a-213963d114b2 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:06:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3e86de-bd65-4659-bb8a-213963d114b2 None admin] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:06:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3e86de-bd65-4659-bb8a-213963d114b2 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:06:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3e86de-bd65-4659-bb8a-213963d114b2 None admin] PATH_INFO: `/v3/roles` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:06:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3e86de-bd65-4659-bb8a-213963d114b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:06:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3e86de-bd65-4659-bb8a-213963d114b2 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:06:00 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.manager [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Didn't find any instances for network info cache update. {{(pid=83654) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10012}} May 28 13:06:00 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1879/3726] 10.27.203.238 () {62 vars in 1189 bytes} [Tue May 28 13:06:00 2024] GET /identity/v3/roles => generated 1680 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 13:06:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00846fa1-f570-402f-badf-676909d3b668 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:06:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00846fa1-f570-402f-badf-676909d3b668 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:06:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc34e5db-7c98-44a5-9162-edb9a282e96b None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:06:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc34e5db-7c98-44a5-9162-edb9a282e96b None admin] REQUEST_METHOD: `PUT` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:06:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc34e5db-7c98-44a5-9162-edb9a282e96b None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:06:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc34e5db-7c98-44a5-9162-edb9a282e96b None admin] PATH_INFO: `/v3/projects/34275d855b714711982480692b7c6977/users/4f5fc5b71cc041f792aff79543d3842e/roles/e7989893488f483baa107be56668c4f8` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:06:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc34e5db-7c98-44a5-9162-edb9a282e96b None admin] RBAC: Authorizing `identity:create_grant(project_id=34275d855b714711982480692b7c6977, user_id=4f5fc5b71cc041f792aff79543d3842e, role_id=e7989893488f483baa107be56668c4f8)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:06:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc34e5db-7c98-44a5-9162-edb9a282e96b None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:06:00 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1848/3727] 10.27.203.238 () {64 vars in 1550 bytes} [Tue May 28 13:06:00 2024] PUT /identity/v3/projects/34275d855b714711982480692b7c6977/users/4f5fc5b71cc041f792aff79543d3842e/roles/e7989893488f483baa107be56668c4f8 => generated 0 bytes in 17 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:06:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f8507d-c7f0-4f06-9bf9-a07b9429a0ba None None] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:06:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f8507d-c7f0-4f06-9bf9-a07b9429a0ba None None] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:06:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f8507d-c7f0-4f06-9bf9-a07b9429a0ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:06:00 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-83f8507d-c7f0-4f06-9bf9-a07b9429a0ba None None] Truncating password to algorithm specific maximum length 72 characters. May 28 13:06:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.auth.core [None req-83f8507d-c7f0-4f06-9bf9-a07b9429a0ba None None] MFA Rules not processed for user `4f5fc5b71cc041f792aff79543d3842e`. Rule list: `[]` (Enabled: `True`). {{(pid=51267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 13:06:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-83f8507d-c7f0-4f06-9bf9-a07b9429a0ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:06:00 l75lg1-v1 nova-conductor[83648]: DEBUG dbcounter [-] [83648] Writing DB stats nova_cell1:SELECT=1 {{(pid=83648) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:06:00 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1880/3728] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 13:06:00 2024] POST /identity/v3/auth/tokens => generated 4077 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 28 13:06:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc34e5db-7c98-44a5-9162-edb9a282e96b None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:06:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc34e5db-7c98-44a5-9162-edb9a282e96b None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:06:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59183bc8-6fbb-4d9e-9d8b-1b99b9a79102 tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f5fc5b71cc041f792aff79543d3842e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34275d855b714711982480692b7c6977', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:06:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59183bc8-6fbb-4d9e-9d8b-1b99b9a79102 tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:06:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59183bc8-6fbb-4d9e-9d8b-1b99b9a79102 tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:06:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59183bc8-6fbb-4d9e-9d8b-1b99b9a79102 tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] PATH_INFO: `/v3/domains` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:06:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59183bc8-6fbb-4d9e-9d8b-1b99b9a79102 tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=51266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 28 13:06:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59183bc8-6fbb-4d9e-9d8b-1b99b9a79102 tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:06:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59183bc8-6fbb-4d9e-9d8b-1b99b9a79102 tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:06:00 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1849/3729] 10.27.203.238 () {62 vars in 1241 bytes} [Tue May 28 13:06:00 2024] GET /identity/v3/domains?name=Default => generated 312 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 28 13:06:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f8507d-c7f0-4f06-9bf9-a07b9429a0ba None None] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:06:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f8507d-c7f0-4f06-9bf9-a07b9429a0ba None None] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:06:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0230fbff-57a5-406a-92a9-2c7239d801b8 tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f5fc5b71cc041f792aff79543d3842e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34275d855b714711982480692b7c6977', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:06:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0230fbff-57a5-406a-92a9-2c7239d801b8 tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] REQUEST_METHOD: `POST` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:06:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0230fbff-57a5-406a-92a9-2c7239d801b8 tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:06:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0230fbff-57a5-406a-92a9-2c7239d801b8 tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] PATH_INFO: `/v3/users` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:06:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0230fbff-57a5-406a-92a9-2c7239d801b8 tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:06:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0230fbff-57a5-406a-92a9-2c7239d801b8 tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:06:00 l75lg1-v1 devstack@keystone.service[51267]: WARNING keystone.common.password_hashing [None req-0230fbff-57a5-406a-92a9-2c7239d801b8 tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] Truncating password to algorithm specific maximum length 72 characters. May 28 13:06:00 l75lg1-v1 dstat.sh[49771]: 28-05 13:06:00| 10 1 86 2 0|5523M 1886M 278M 7936M| 15k 572B| 0 1420k| 0 222 |7514 13k|0.85 1.02 1.02| 0 1.0 0| 0 0 | 0 2048M| 29 360 0 7 6 May 28 13:06:00 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1881/3730] 10.27.203.238 () {64 vars in 1232 bytes} [Tue May 28 13:06:00 2024] POST /identity/v3/users => generated 435 bytes in 31 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 28 13:06:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59183bc8-6fbb-4d9e-9d8b-1b99b9a79102 tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:06:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59183bc8-6fbb-4d9e-9d8b-1b99b9a79102 tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:06:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d30c095-a071-4893-8b77-f88d8f65f64f tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f5fc5b71cc041f792aff79543d3842e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34275d855b714711982480692b7c6977', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:06:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d30c095-a071-4893-8b77-f88d8f65f64f tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:06:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d30c095-a071-4893-8b77-f88d8f65f64f tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:06:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d30c095-a071-4893-8b77-f88d8f65f64f tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] PATH_INFO: `/v3/roles` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:06:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d30c095-a071-4893-8b77-f88d8f65f64f tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:06:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d30c095-a071-4893-8b77-f88d8f65f64f tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:06:00 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1850/3731] 10.27.203.238 () {62 vars in 1210 bytes} [Tue May 28 13:06:00 2024] GET /identity/v3/roles => generated 1680 bytes in 19 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 28 13:06:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0230fbff-57a5-406a-92a9-2c7239d801b8 tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:06:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0230fbff-57a5-406a-92a9-2c7239d801b8 tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:06:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bfec62-3cc0-4bc0-8fb0-7b3ced336ac4 tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f5fc5b71cc041f792aff79543d3842e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34275d855b714711982480692b7c6977', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:06:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bfec62-3cc0-4bc0-8fb0-7b3ced336ac4 tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] REQUEST_METHOD: `PUT` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:06:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bfec62-3cc0-4bc0-8fb0-7b3ced336ac4 tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:06:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bfec62-3cc0-4bc0-8fb0-7b3ced336ac4 tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] PATH_INFO: `/v3/projects/34275d855b714711982480692b7c6977/users/f107256e153949edb4400e34294b8223/roles/44620cad10ae407c90c91e2c296adb04` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:06:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bfec62-3cc0-4bc0-8fb0-7b3ced336ac4 tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] RBAC: Authorizing `identity:create_grant(project_id=34275d855b714711982480692b7c6977, user_id=f107256e153949edb4400e34294b8223, role_id=44620cad10ae407c90c91e2c296adb04)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:06:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bfec62-3cc0-4bc0-8fb0-7b3ced336ac4 tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:06:00 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1882/3732] 10.27.203.238 () {64 vars in 1571 bytes} [Tue May 28 13:06:00 2024] PUT /identity/v3/projects/34275d855b714711982480692b7c6977/users/f107256e153949edb4400e34294b8223/roles/44620cad10ae407c90c91e2c296adb04 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:06:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d30c095-a071-4893-8b77-f88d8f65f64f tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:06:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-8d30c095-a071-4893-8b77-f88d8f65f64f tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:06:00 l75lg1-v1 neutron-server[77618]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.HashRingHealthCheckPeriodics.touch_hash_ring_nodes' {{(pid=77618) _process_scheduled /opt/stack/data/venv/lib/python3.10/site-packages/futurist/periodics.py:638}} May 28 13:06:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d30c095-a071-4893-8b77-f88d8f65f64f tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:06:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22066038-399f-4093-bd8d-98422526010d service manila] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f110cf6300f049c897d0aab63218d1e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:06:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22066038-399f-4093-bd8d-98422526010d service manila] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:06:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22066038-399f-4093-bd8d-98422526010d service manila] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:06:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22066038-399f-4093-bd8d-98422526010d service manila] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:06:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22066038-399f-4093-bd8d-98422526010d service manila] RBAC: Authorizing `identity:validate_token()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:06:00 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22066038-399f-4093-bd8d-98422526010d service manila] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:06:00 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1851/3733] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 13:06:00 2024] GET /identity/v3/auth/tokens => generated 4077 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 13:06:00 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-20bc65a0-bec7-4249-9ebe-708bbbb6e7ff tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] POST http://10.27.203.238/share/v2/34275d855b714711982480692b7c6977/types May 28 13:06:00 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-20bc65a0-bec7-4249-9ebe-708bbbb6e7ff tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share_type": {"name": "tempest-typeshare-type-698023619", "extra_specs": {"driver_handles_share_servers": "False", "snapshot_support": true}, "share_type_access:is_public": true}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:06:00 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._sync_power_states {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 13:06:00 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Expecting reply to msg 8fc26e3ddf9648f2823727a01c50342e in queue reply_37f4cbd1dd094961a22b8a65f222c327 May 28 13:06:00 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [-] Received RPC response for msg 8fc26e3ddf9648f2823727a01c50342e May 28 13:06:00 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-20bc65a0-bec7-4249-9ebe-708bbbb6e7ff tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] http://10.27.203.238/share/v2/34275d855b714711982480692b7c6977/types returned with HTTP 200 May 28 13:06:00 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1409/2797] 10.27.203.238 () {66 vars in 1359 bytes} [Tue May 28 13:06:00 2024] POST /share/v2/34275d855b714711982480692b7c6977/types => generated 677 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:06:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bfec62-3cc0-4bc0-8fb0-7b3ced336ac4 tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:06:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-15bfec62-3cc0-4bc0-8fb0-7b3ced336ac4 tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:06:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bfec62-3cc0-4bc0-8fb0-7b3ced336ac4 tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:06:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deb7bc0-f1d0-4298-8bfe-0b9a7504e0bb service manila] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f110cf6300f049c897d0aab63218d1e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:06:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deb7bc0-f1d0-4298-8bfe-0b9a7504e0bb service manila] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:06:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deb7bc0-f1d0-4298-8bfe-0b9a7504e0bb service manila] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:06:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deb7bc0-f1d0-4298-8bfe-0b9a7504e0bb service manila] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:06:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6deb7bc0-f1d0-4298-8bfe-0b9a7504e0bb service manila] RBAC: Authorizing `identity:validate_token()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:06:00 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6deb7bc0-f1d0-4298-8bfe-0b9a7504e0bb service manila] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:06:00 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1883/3734] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 13:06:00 2024] GET /identity/v3/auth/tokens => generated 3958 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 13:06:00 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-cd8676f4-013a-49fe-8acf-d0e212b2ee74 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] POST http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/shares May 28 13:06:00 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-cd8676f4-013a-49fe-8acf-d0e212b2ee74 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Action: 'create', calling method: Controller.__getattribute__..version_select, body: {"share": {"share_proto": "nfs", "description": "tempest-tempest-share-description-67862282", "snapshot_id": null, "name": "tempest-tempest-share-name-1742512643", "size": 1, "metadata": {}, "is_public": false, "share_type": "bf641037-d641-471e-9397-4e29981f77b8"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:06:00 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.v1.shares [None req-cd8676f4-013a-49fe-8acf-d0e212b2ee74 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Create NFS share of 1 GB May 28 13:06:00 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.quota [None req-cd8676f4-013a-49fe-8acf-d0e212b2ee74 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Created reservations ['6aa82cdf-fd00-4ac2-92c7-2d18ea04d0a4', 'e9a285ff-4671-402c-b7cb-4fcb32239ddc', '4523a518-5382-4d52-b556-eb94037cd35f', '40988f8d-aa36-4696-ad80-1a1f79b6bd9c'] {{(pid=98330) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 13:06:00 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.quota [None req-cd8676f4-013a-49fe-8acf-d0e212b2ee74 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Committed reservations ['6aa82cdf-fd00-4ac2-92c7-2d18ea04d0a4', 'e9a285ff-4671-402c-b7cb-4fcb32239ddc', '4523a518-5382-4d52-b556-eb94037cd35f', '40988f8d-aa36-4696-ad80-1a1f79b6bd9c'] {{(pid=98330) commit /opt/stack/manila/manila/quota.py:1063}} May 28 13:06:00 l75lg1-v1 manila-scheduler[98327]: DEBUG dbcounter [-] [98327] Writing DB stats manila:SELECT=54,manila:UPDATE=9 {{(pid=98327) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:06:00 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.host_manager [None req-cd8676f4-013a-49fe-8acf-d0e212b2ee74 tempest-ShareSnapshotMetadataTest-331543469 None] Share service is down. (host: l75lg1-v1@generic2). May 28 13:06:00 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.host_manager [None req-cd8676f4-013a-49fe-8acf-d0e212b2ee74 tempest-ShareSnapshotMetadataTest-331543469 None] Share service is down. (host: l75lg1-v1@generic1). May 28 13:06:00 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-cd8676f4-013a-49fe-8acf-d0e212b2ee74 tempest-ShareSnapshotMetadataTest-331543469 None] Starting with 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:80}} May 28 13:06:00 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-cd8676f4-013a-49fe-8acf-d0e212b2ee74 tempest-ShareSnapshotMetadataTest-331543469 None] Filter OnlyHostFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:06:00 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-cd8676f4-013a-49fe-8acf-d0e212b2ee74 tempest-ShareSnapshotMetadataTest-331543469 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:06:00 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.capacity [None req-cd8676f4-013a-49fe-8acf-d0e212b2ee74 tempest-ShareSnapshotMetadataTest-331543469 None] Space information for share creation on host l75lg1-v1@vast#vast (requested / avail): 1/2082 {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/capacity.py:83}} May 28 13:06:00 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-cd8676f4-013a-49fe-8acf-d0e212b2ee74 tempest-ShareSnapshotMetadataTest-331543469 None] Filter CapacityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:06:00 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-cd8676f4-013a-49fe-8acf-d0e212b2ee74 tempest-ShareSnapshotMetadataTest-331543469 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:06:00 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-cd8676f4-013a-49fe-8acf-d0e212b2ee74 tempest-ShareSnapshotMetadataTest-331543469 None] Driver Filter: Checking host 'l75lg1-v1@vast#vast' {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:37}} May 28 13:06:00 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-cd8676f4-013a-49fe-8acf-d0e212b2ee74 tempest-ShareSnapshotMetadataTest-331543469 None] Filter function not set :: passing host. {{(pid=98327) _check_filter_function /opt/stack/manila/manila/scheduler/filters/driver.py:53}} May 28 13:06:00 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-cd8676f4-013a-49fe-8acf-d0e212b2ee74 tempest-ShareSnapshotMetadataTest-331543469 None] Result: True {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:40}} May 28 13:06:00 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.driver [None req-cd8676f4-013a-49fe-8acf-d0e212b2ee74 tempest-ShareSnapshotMetadataTest-331543469 None] Done checking host 'l75lg1-v1@vast#vast' {{(pid=98327) host_passes /opt/stack/manila/manila/scheduler/filters/driver.py:41}} May 28 13:06:00 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-cd8676f4-013a-49fe-8acf-d0e212b2ee74 tempest-ShareSnapshotMetadataTest-331543469 None] Filter DriverFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:06:00 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-cd8676f4-013a-49fe-8acf-d0e212b2ee74 tempest-ShareSnapshotMetadataTest-331543469 None] Filter ShareReplicationFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:06:00 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-cd8676f4-013a-49fe-8acf-d0e212b2ee74 tempest-ShareSnapshotMetadataTest-331543469 None] Filter CreateFromSnapshotFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:06:00 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-cd8676f4-013a-49fe-8acf-d0e212b2ee74 tempest-ShareSnapshotMetadataTest-331543469 None] Filter AffinityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:06:00 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.filters.base [None req-cd8676f4-013a-49fe-8acf-d0e212b2ee74 tempest-ShareSnapshotMetadataTest-331543469 None] Filter AntiAffinityFilter returned 1 host(s) {{(pid=98327) get_filtered_objects /opt/stack/manila/manila/scheduler/filters/base.py:97}} May 28 13:06:00 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.drivers.filter [None req-cd8676f4-013a-49fe-8acf-d0e212b2ee74 tempest-ShareSnapshotMetadataTest-331543469 None] Filtered share [host: 'l75lg1-v1@vast#vast', free_capacity_gb: 2082.625715249218, pools: None] {{(pid=98327) _schedule_share /opt/stack/manila/manila/scheduler/drivers/filter.py:268}} May 28 13:06:00 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-cd8676f4-013a-49fe-8acf-d0e212b2ee74 tempest-ShareSnapshotMetadataTest-331543469 None] Checking host 'l75lg1-v1@vast#vast' {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:46}} May 28 13:06:00 l75lg1-v1 manila-scheduler[98327]: WARNING manila.scheduler.weighers.goodness [None req-cd8676f4-013a-49fe-8acf-d0e212b2ee74 tempest-ShareSnapshotMetadataTest-331543469 None] Goodness function not set :: defaulting to minimal goodness rating of 0. May 28 13:06:00 l75lg1-v1 manila-scheduler[98327]: INFO manila.scheduler.weighers.goodness [None req-cd8676f4-013a-49fe-8acf-d0e212b2ee74 tempest-ShareSnapshotMetadataTest-331543469 None] Goodness function result for host l75lg1-v1@vast#vast: 0. May 28 13:06:00 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-cd8676f4-013a-49fe-8acf-d0e212b2ee74 tempest-ShareSnapshotMetadataTest-331543469 None] Goodness: 0 {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:48}} May 28 13:06:00 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.weighers.goodness [None req-cd8676f4-013a-49fe-8acf-d0e212b2ee74 tempest-ShareSnapshotMetadataTest-331543469 None] Done checking host 'l75lg1-v1@vast#vast' {{(pid=98327) _weigh_object /opt/stack/manila/manila/scheduler/weighers/goodness.py:49}} May 28 13:06:00 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.drivers.filter [None req-cd8676f4-013a-49fe-8acf-d0e212b2ee74 tempest-ShareSnapshotMetadataTest-331543469 None] Choosing for share: WeighedHost [host: l75lg1-v1@vast#vast, weight: 0.0] {{(pid=98327) _schedule_share /opt/stack/manila/manila/scheduler/drivers/filter.py:274}} May 28 13:06:00 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-cd8676f4-013a-49fe-8acf-d0e212b2ee74 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/shares returned with HTTP 200 May 28 13:06:00 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1389/2798] 10.27.203.238 () {66 vars in 1362 bytes} [Tue May 28 13:06:00 2024] POST /share/v2/9c1e3ce524bc424eae1e9467bc390dec/shares => generated 1335 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:06:00 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-c8586c4c-3d7b-4586-a226-df88e1a0cc7f tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] GET http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/shares/41a07ae7-d107-493e-8a00-5ada346ac16c May 28 13:06:00 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-c8586c4c-3d7b-4586-a226-df88e1a0cc7f tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:06:00 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-c8586c4c-3d7b-4586-a226-df88e1a0cc7f tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:06:00 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-c8586c4c-3d7b-4586-a226-df88e1a0cc7f tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/shares/41a07ae7-d107-493e-8a00-5ada346ac16c returned with HTTP 200 May 28 13:06:00 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1410/2799] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:06:00 2024] GET /share/v2/9c1e3ce524bc424eae1e9467bc390dec/shares/41a07ae7-d107-493e-8a00-5ada346ac16c => generated 1335 bytes in 24 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:06:00 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-cd8676f4-013a-49fe-8acf-d0e212b2ee74 tempest-ShareSnapshotMetadataTest-331543469 None] >>> [GET] https://127.0.0.1:40443/api/vippools/ May 28 13:06:00 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-cd8676f4-013a-49fe-8acf-d0e212b2ee74 tempest-ShareSnapshotMetadataTest-331543469 None] {'allow_redirects': True, 'params': {'name': 'vippool-1'}} May 28 13:06:01 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 13:06:01 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-cd8676f4-013a-49fe-8acf-d0e212b2ee74 tempest-ShareSnapshotMetadataTest-331543469 None] <<< [GET] https://127.0.0.1:40443/api/vippools/ May 28 13:06:01 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-cd8676f4-013a-49fe-8acf-d0e212b2ee74 tempest-ShareSnapshotMetadataTest-331543469 None] [Bunch(active_cnode_ids=[], active_interfaces=4, cluster='loop75-kfs', cluster_id=1, cnode_ids=[], cnodes=[], domain_name='vippool-1', enable_l3=False, enable_weighted_balancing=False, enabled=True, end_ip='172.21.75.4', guid='f2abaede-b397-413a-8faa-3aeead6d3b28', gw_ip='', gw_ipv6='', id=2, ip_ranges=[['172.21.75.1', '172.21.75.4']], name='vippool-1', peer_asn=0, port_membership='ALL', ranges_summary='172.21.75.[1-4]', role='PROTOCOLS', start_ip='172.21.75.1', subnet_cidr=16, subnet_cidr_ipv6=None, sync='SYNCED', sync_time='2024-05-28T12:50:09.644123Z', tenant_id=1, tenant_name='default', title='172.21.75.1 - 172.21.75.4', url='https://127.0.0.1:40443/api/vippools/2/', vast_asn=0, vlan=0, vms_preferred=False)] May 28 13:06:01 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-cd8676f4-013a-49fe-8acf-d0e212b2ee74 tempest-ShareSnapshotMetadataTest-331543469 None] --- [GET] https://127.0.0.1:40443/api/vippools/: Done May 28 13:06:01 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-cd8676f4-013a-49fe-8acf-d0e212b2ee74 tempest-ShareSnapshotMetadataTest-331543469 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:06:01 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-cd8676f4-013a-49fe-8acf-d0e212b2ee74 tempest-ShareSnapshotMetadataTest-331543469 None] {'allow_redirects': True, May 28 13:06:01 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-cd8676f4-013a-49fe-8acf-d0e212b2ee74 tempest-ShareSnapshotMetadataTest-331543469 None] 'params': {'name': '32260cfb-2f6c-471f-8668-cd9a33828137'}} May 28 13:06:01 l75lg1-v1 dstat.sh[49771]: 28-05 13:06:01| 7 1 87 4 0|5523M 1886M 278M 7936M| 15k 1382B| 0 6937k| 0 626 |6181 11k|0.85 1.02 1.02| 0 0 0| 0 0 | 0 2048M| 29 359 0 7 6 May 28 13:06:01 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-cd8676f4-013a-49fe-8acf-d0e212b2ee74 tempest-ShareSnapshotMetadataTest-331543469 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:06:01 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-cd8676f4-013a-49fe-8acf-d0e212b2ee74 tempest-ShareSnapshotMetadataTest-331543469 None] [] May 28 13:06:01 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-cd8676f4-013a-49fe-8acf-d0e212b2ee74 tempest-ShareSnapshotMetadataTest-331543469 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 13:06:01 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-cd8676f4-013a-49fe-8acf-d0e212b2ee74 tempest-ShareSnapshotMetadataTest-331543469 None] >>> [POST] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:06:01 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-cd8676f4-013a-49fe-8acf-d0e212b2ee74 tempest-ShareSnapshotMetadataTest-331543469 None] {'data': '{"name": "32260cfb-2f6c-471f-8668-cd9a33828137"}', May 28 13:06:01 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-cd8676f4-013a-49fe-8acf-d0e212b2ee74 tempest-ShareSnapshotMetadataTest-331543469 None] 'json': None, May 28 13:06:01 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-cd8676f4-013a-49fe-8acf-d0e212b2ee74 tempest-ShareSnapshotMetadataTest-331543469 None] 'params': None} May 28 13:06:02 l75lg1-v1 dstat.sh[49771]: 28-05 13:06:02| 1 0 98 0 0|5524M 1885M 278M 7936M| 14k 828B| 0 408k| 0 51.0 |2103 3419 |0.85 1.02 1.02| 0 0 0| 0 0 | 0 2048M| 29 359 0 7 6 May 28 13:06:02 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-cd8676f4-013a-49fe-8acf-d0e212b2ee74 tempest-ShareSnapshotMetadataTest-331543469 None] <<< [POST] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:06:02 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-cd8676f4-013a-49fe-8acf-d0e212b2ee74 tempest-ShareSnapshotMetadataTest-331543469 None] Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=0, created='2024-05-28T13:06:02.176435Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='86b640dc-ab85-4964-91b5-7dd18cf00077', id=68, internal=False, is_s3_default_policy=False, name='32260cfb-2f6c-471f-8668-cd9a33828137', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=[], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['*'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['*'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T13:06:02.495368Z', tenant_id=1, tenant_name='default', title='32260cfb-2f6c-471f-8668-cd9a33828137', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/68/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[]) May 28 13:06:02 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-cd8676f4-013a-49fe-8acf-d0e212b2ee74 tempest-ShareSnapshotMetadataTest-331543469 None] --- [POST] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 13:06:02 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-cd8676f4-013a-49fe-8acf-d0e212b2ee74 tempest-ShareSnapshotMetadataTest-331543469 None] >>> [GET] https://127.0.0.1:40443/api/quotas/ May 28 13:06:02 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-cd8676f4-013a-49fe-8acf-d0e212b2ee74 tempest-ShareSnapshotMetadataTest-331543469 None] {'allow_redirects': True, May 28 13:06:02 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-cd8676f4-013a-49fe-8acf-d0e212b2ee74 tempest-ShareSnapshotMetadataTest-331543469 None] 'params': {'name': '32260cfb-2f6c-471f-8668-cd9a33828137'}} May 28 13:06:02 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager.update_available_resource {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 13:06:02 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Expecting reply to msg 2c3c4106caf1451ab3a85b1f41cf184b in queue reply_37f4cbd1dd094961a22b8a65f222c327 May 28 13:06:02 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [-] Received RPC response for msg 2c3c4106caf1451ab3a85b1f41cf184b May 28 13:06:02 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-cd8676f4-013a-49fe-8acf-d0e212b2ee74 tempest-ShareSnapshotMetadataTest-331543469 None] <<< [GET] https://127.0.0.1:40443/api/quotas/ May 28 13:06:02 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-cd8676f4-013a-49fe-8acf-d0e212b2ee74 tempest-ShareSnapshotMetadataTest-331543469 None] [] May 28 13:06:02 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-cd8676f4-013a-49fe-8acf-d0e212b2ee74 tempest-ShareSnapshotMetadataTest-331543469 None] --- [GET] https://127.0.0.1:40443/api/quotas/: Done May 28 13:06:02 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-cd8676f4-013a-49fe-8acf-d0e212b2ee74 tempest-ShareSnapshotMetadataTest-331543469 None] >>> [POST] https://127.0.0.1:40443/api/quotas/ May 28 13:06:02 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-cd8676f4-013a-49fe-8acf-d0e212b2ee74 tempest-ShareSnapshotMetadataTest-331543469 None] {'data': '{"name": "32260cfb-2f6c-471f-8668-cd9a33828137", "path": ' May 28 13:06:02 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-cd8676f4-013a-49fe-8acf-d0e212b2ee74 tempest-ShareSnapshotMetadataTest-331543469 None] '"/manila/manila-32260cfb-2f6c-471f-8668-cd9a33828137", "create_dir": ' May 28 13:06:02 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-cd8676f4-013a-49fe-8acf-d0e212b2ee74 tempest-ShareSnapshotMetadataTest-331543469 None] 'true, "hard_limit": 1073741824}', May 28 13:06:02 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-cd8676f4-013a-49fe-8acf-d0e212b2ee74 tempest-ShareSnapshotMetadataTest-331543469 None] 'json': None, May 28 13:06:02 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-cd8676f4-013a-49fe-8acf-d0e212b2ee74 tempest-ShareSnapshotMetadataTest-331543469 None] 'params': None} May 28 13:06:03 l75lg1-v1 nova-compute[83654]: DEBUG oslo_concurrency.lockutils [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=83654) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:06:03 l75lg1-v1 nova-compute[83654]: DEBUG oslo_concurrency.lockutils [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=83654) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:06:03 l75lg1-v1 nova-compute[83654]: DEBUG oslo_concurrency.lockutils [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=83654) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:06:03 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.resource_tracker [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Auditing locally available compute resources for l75lg1-v1 (node: l75lg1-v1) {{(pid=83654) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}} May 28 13:06:03 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.resource_tracker [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Hypervisor/Node resource view: name=l75lg1-v1 free_ram=10099MB free_disk=15.535850524902344GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_01_1", "address": "0000:00:01.1", "product_id": "7010", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7010", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7000", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7000", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "0100", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_0100", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_09_0", "address": "0000:00:09.0", "product_id": "1001", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1001", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "293a", "vendor_id": "8086", "numa_node": null, "label": "label_8086_293a", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_2", "address": "0000:00:07.2", "product_id": "2936", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2936", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "1237", "vendor_id": "8086", "numa_node": null, "label": "label_8086_1237", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "2935", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2935", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "2934", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2934", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_05_0", "address": "0000:00:05.0", "product_id": "1000", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1000", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "1000", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1000", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_06_0", "address": "0000:00:06.0", "product_id": "2668", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2668", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "1000", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1000", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0a_0", "address": "0000:00:0a.0", "product_id": "1002", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1002", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_3", "address": "0000:00:01.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_08_0", "address": "0000:00:08.0", "product_id": "1003", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1003", "dev_type": "type-PCI"}] {{(pid=83654) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}} May 28 13:06:03 l75lg1-v1 nova-compute[83654]: DEBUG oslo_concurrency.lockutils [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=83654) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:06:03 l75lg1-v1 nova-compute[83654]: DEBUG oslo_concurrency.lockutils [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=83654) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:06:03 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Expecting reply to msg 729decaeb23a4f29af409d3c1b541e92 in queue reply_37f4cbd1dd094961a22b8a65f222c327 May 28 13:06:03 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [-] Received RPC response for msg 729decaeb23a4f29af409d3c1b541e92 May 28 13:06:03 l75lg1-v1 dstat.sh[49771]: 28-05 13:06:03| 2 0 97 0 0|5523M 1886M 278M 7937M| 15k 1667B| 0 204k| 0 27.0 |3124 5532 |0.78 1.00 1.01| 0 0 0| 0 0 | 0 2048M| 29 359 0 7 6 May 28 13:06:03 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Expecting reply to msg 07797a6e31fe4da1a01c60a20e6a0ab5 in queue reply_37f4cbd1dd094961a22b8a65f222c327 May 28 13:06:03 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [-] Received RPC response for msg 07797a6e31fe4da1a01c60a20e6a0ab5 May 28 13:06:03 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-cd8676f4-013a-49fe-8acf-d0e212b2ee74 tempest-ShareSnapshotMetadataTest-331543469 None] <<< [POST] https://127.0.0.1:40443/api/quotas/ May 28 13:06:03 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-cd8676f4-013a-49fe-8acf-d0e212b2ee74 tempest-ShareSnapshotMetadataTest-331543469 None] Bunch(cluster='loop75-kfs', cluster_id=1, default_email=None, default_group_quota=None, default_user_quota=None, enable_alarms=True, enable_email_providers=True, grace_period=None, group_quotas=[], guid='5eb05877-776e-4b32-977e-6177e11c1fba', hard_limit=1073741824, hard_limit_inodes=None, id=65, internal=False, is_user_quota=False, last_user_quotas_update=None, name='32260cfb-2f6c-471f-8668-cd9a33828137', num_blocked_users=0, num_exceeded_users=0, path='/manila/manila-32260cfb-2f6c-471f-8668-cd9a33828137', percent_capacity=0, percent_inodes=None, pretty_grace_period=None, pretty_grace_period_expiration=None, pretty_state='OK (CREATED)', soft_limit=None, soft_limit_inodes=None, state='OK', sync_state='CREATED', system_id=65, tenant_id=1, tenant_name='default', time_to_block=None, title='32260cfb-2f6c-471f-8668-cd9a33828137', url='https://127.0.0.1:40443/api/quotas/65/', used_capacity=0, used_capacity_tb=0.0, used_effective_capacity=0, used_effective_capacity_tb=0.0, used_inodes=0, used_limited_capacity=0, user_quotas=[]) May 28 13:06:03 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-cd8676f4-013a-49fe-8acf-d0e212b2ee74 tempest-ShareSnapshotMetadataTest-331543469 None] --- [POST] https://127.0.0.1:40443/api/quotas/: Done May 28 13:06:03 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-cd8676f4-013a-49fe-8acf-d0e212b2ee74 tempest-ShareSnapshotMetadataTest-331543469 None] >>> [GET] https://127.0.0.1:40443/api/views/ May 28 13:06:03 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-cd8676f4-013a-49fe-8acf-d0e212b2ee74 tempest-ShareSnapshotMetadataTest-331543469 None] {'allow_redirects': True, May 28 13:06:03 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-cd8676f4-013a-49fe-8acf-d0e212b2ee74 tempest-ShareSnapshotMetadataTest-331543469 None] 'params': {'name': '32260cfb-2f6c-471f-8668-cd9a33828137'}} May 28 13:06:03 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-349e038e-12c2-4dd3-ad8a-c5894d9d2a8a tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] GET http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/shares/41a07ae7-d107-493e-8a00-5ada346ac16c May 28 13:06:03 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-349e038e-12c2-4dd3-ad8a-c5894d9d2a8a tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:06:03 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-349e038e-12c2-4dd3-ad8a-c5894d9d2a8a tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:06:03 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-349e038e-12c2-4dd3-ad8a-c5894d9d2a8a tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/shares/41a07ae7-d107-493e-8a00-5ada346ac16c returned with HTTP 200 May 28 13:06:03 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1390/2800] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:06:03 2024] GET /share/v2/9c1e3ce524bc424eae1e9467bc390dec/shares/41a07ae7-d107-493e-8a00-5ada346ac16c => generated 1337 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:06:04 l75lg1-v1 devstack@placement-api.service[78202]: DEBUG placement.requestlog [req-ffa0e1f8-f1fe-413c-ba09-7b6c802aa5a3 req-c2d09840-cc6d-4928-a1ac-52f9b1422401 None None] Starting request: 10.27.203.238 "GET /placement/resource_providers/ef90d7d1-0808-4a15-ad77-f9a7391af2f4/allocations" {{(pid=78202) __call__ /opt/stack/placement/placement/requestlog.py:55}} May 28 13:06:04 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22066038-399f-4093-bd8d-98422526010d service manila] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:06:04 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-22066038-399f-4093-bd8d-98422526010d service manila] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:06:04 l75lg1-v1 dstat.sh[49771]: 28-05 13:06:04| 2 1 97 0 0|5523M 1885M 278M 7937M| 16k 736B| 0 3109k| 0 502 |1921 2871 |0.78 1.00 1.01|2.0 0 0| 0 0 | 0 2048M| 29 361 0 7 6 May 28 13:06:04 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22066038-399f-4093-bd8d-98422526010d service manila] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:06:04 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cf8a44-5170-4e76-b6a1-6b1995f3b50b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3fe870f285d4169bd917382dd02d7b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'manager', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:06:04 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cf8a44-5170-4e76-b6a1-6b1995f3b50b service placement] REQUEST_METHOD: `GET` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:06:04 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cf8a44-5170-4e76-b6a1-6b1995f3b50b service placement] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:06:04 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cf8a44-5170-4e76-b6a1-6b1995f3b50b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:06:04 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-c3cf8a44-5170-4e76-b6a1-6b1995f3b50b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:06:04 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cf8a44-5170-4e76-b6a1-6b1995f3b50b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:06:04 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cf8a44-5170-4e76-b6a1-6b1995f3b50b service placement] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:06:04 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1852/3735] 10.27.203.238 () {64 vars in 1453 bytes} [Tue May 28 13:06:04 2024] GET /identity/v3/auth/tokens => generated 4060 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 28 13:06:04 l75lg1-v1 devstack@placement-api.service[78202]: INFO placement.requestlog [req-ffa0e1f8-f1fe-413c-ba09-7b6c802aa5a3 req-c2d09840-cc6d-4928-a1ac-52f9b1422401 service placement] 10.27.203.238 "GET /placement/resource_providers/ef90d7d1-0808-4a15-ad77-f9a7391af2f4/allocations" status: 200 len: 54 microversion: 1.0 May 28 13:06:04 l75lg1-v1 devstack@placement-api.service[78202]: [pid: 78202|app: 0|req: 33/65] 10.27.203.238 () {62 vars in 1480 bytes} [Tue May 28 13:06:04 2024] GET /placement/resource_providers/ef90d7d1-0808-4a15-ad77-f9a7391af2f4/allocations => generated 54 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 223 bytes (1 switches on core 0) May 28 13:06:04 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.resource_tracker [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Total usable vcpus: 10, total allocated vcpus: 0 {{(pid=83654) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}} May 28 13:06:04 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.resource_tracker [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Final resource view: name=l75lg1-v1 phys_ram=16000MB used_ram=512MB phys_disk=28GB used_disk=0GB total_vcpus=10 used_vcpus=0 pci_stats=[] {{(pid=83654) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}} May 28 13:06:04 l75lg1-v1 devstack@placement-api.service[78201]: DEBUG placement.requestlog [req-ffa0e1f8-f1fe-413c-ba09-7b6c802aa5a3 req-393aa123-67b8-48d5-be87-1d44db5ad33a None None] Starting request: 10.27.203.238 "GET /placement/resource_providers?in_tree=ef90d7d1-0808-4a15-ad77-f9a7391af2f4" {{(pid=78201) __call__ /opt/stack/placement/placement/requestlog.py:55}} May 28 13:06:04 l75lg1-v1 devstack@placement-api.service[78201]: INFO placement.requestlog [req-ffa0e1f8-f1fe-413c-ba09-7b6c802aa5a3 req-393aa123-67b8-48d5-be87-1d44db5ad33a service placement] 10.27.203.238 "GET /placement/resource_providers?in_tree=ef90d7d1-0808-4a15-ad77-f9a7391af2f4" status: 200 len: 858 microversion: 1.14 May 28 13:06:04 l75lg1-v1 devstack@placement-api.service[78201]: [pid: 78201|app: 0|req: 33/66] 10.27.203.238 () {64 vars in 1466 bytes} [Tue May 28 13:06:04 2024] GET /placement/resource_providers?in_tree=ef90d7d1-0808-4a15-ad77-f9a7391af2f4 => generated 858 bytes in 15 msecs (HTTP/1.1 200) 6 headers in 225 bytes (1 switches on core 0) May 28 13:06:04 l75lg1-v1 nova-compute[83654]: DEBUG nova.scheduler.client.report [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Refreshing inventories for resource provider ef90d7d1-0808-4a15-ad77-f9a7391af2f4 {{(pid=83654) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}} May 28 13:06:04 l75lg1-v1 devstack@placement-api.service[78202]: DEBUG placement.requestlog [req-ffa0e1f8-f1fe-413c-ba09-7b6c802aa5a3 req-ed77f388-cbdc-4d82-9705-08496a772816 None None] Starting request: 10.27.203.238 "GET /placement/resource_providers/ef90d7d1-0808-4a15-ad77-f9a7391af2f4/inventories" {{(pid=78202) __call__ /opt/stack/placement/placement/requestlog.py:55}} May 28 13:06:04 l75lg1-v1 devstack@placement-api.service[78202]: INFO placement.requestlog [req-ffa0e1f8-f1fe-413c-ba09-7b6c802aa5a3 req-ed77f388-cbdc-4d82-9705-08496a772816 service placement] 10.27.203.238 "GET /placement/resource_providers/ef90d7d1-0808-4a15-ad77-f9a7391af2f4/inventories" status: 200 len: 398 microversion: 1.0 May 28 13:06:04 l75lg1-v1 devstack@placement-api.service[78202]: [pid: 78202|app: 0|req: 34/67] 10.27.203.238 () {62 vars in 1480 bytes} [Tue May 28 13:06:04 2024] GET /placement/resource_providers/ef90d7d1-0808-4a15-ad77-f9a7391af2f4/inventories => generated 398 bytes in 13 msecs (HTTP/1.1 200) 6 headers in 224 bytes (1 switches on core 0) May 28 13:06:04 l75lg1-v1 nova-compute[83654]: DEBUG nova.scheduler.client.report [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Updating ProviderTree inventory for provider ef90d7d1-0808-4a15-ad77-f9a7391af2f4 from _refresh_and_get_inventory using data: {'VCPU': {'total': 10, 'reserved': 0, 'min_unit': 1, 'max_unit': 10, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16000, 'reserved': 512, 'min_unit': 1, 'max_unit': 16000, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 28, 'reserved': 0, 'min_unit': 1, 'max_unit': 28, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=83654) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}} May 28 13:06:04 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.provider_tree [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Updating inventory in ProviderTree for provider ef90d7d1-0808-4a15-ad77-f9a7391af2f4 with inventory: {'VCPU': {'total': 10, 'reserved': 0, 'min_unit': 1, 'max_unit': 10, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16000, 'reserved': 512, 'min_unit': 1, 'max_unit': 16000, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 28, 'reserved': 0, 'min_unit': 1, 'max_unit': 28, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=83654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}} May 28 13:06:04 l75lg1-v1 devstack@placement-api.service[78201]: DEBUG placement.requestlog [req-ffa0e1f8-f1fe-413c-ba09-7b6c802aa5a3 req-9ecc4a94-a46c-4438-9b5a-bb9271e99481 None None] Starting request: 10.27.203.238 "GET /placement/resource_providers/ef90d7d1-0808-4a15-ad77-f9a7391af2f4/aggregates" {{(pid=78201) __call__ /opt/stack/placement/placement/requestlog.py:55}} May 28 13:06:04 l75lg1-v1 devstack@placement-api.service[78201]: INFO placement.requestlog [req-ffa0e1f8-f1fe-413c-ba09-7b6c802aa5a3 req-9ecc4a94-a46c-4438-9b5a-bb9271e99481 service placement] 10.27.203.238 "GET /placement/resource_providers/ef90d7d1-0808-4a15-ad77-f9a7391af2f4/aggregates" status: 200 len: 53 microversion: 1.19 May 28 13:06:04 l75lg1-v1 devstack@placement-api.service[78201]: [pid: 78201|app: 0|req: 34/68] 10.27.203.238 () {64 vars in 1521 bytes} [Tue May 28 13:06:04 2024] GET /placement/resource_providers/ef90d7d1-0808-4a15-ad77-f9a7391af2f4/aggregates => generated 53 bytes in 14 msecs (HTTP/1.1 200) 8 headers in 295 bytes (1 switches on core 0) May 28 13:06:04 l75lg1-v1 nova-compute[83654]: DEBUG nova.scheduler.client.report [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Refreshing aggregate associations for resource provider ef90d7d1-0808-4a15-ad77-f9a7391af2f4, aggregates: None {{(pid=83654) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}} May 28 13:06:04 l75lg1-v1 devstack@placement-api.service[78202]: DEBUG placement.requestlog [req-ffa0e1f8-f1fe-413c-ba09-7b6c802aa5a3 req-c413f6c1-1e25-4008-8305-b954d8a16508 None None] Starting request: 10.27.203.238 "GET /placement/resource_providers/ef90d7d1-0808-4a15-ad77-f9a7391af2f4/traits" {{(pid=78202) __call__ /opt/stack/placement/placement/requestlog.py:55}} May 28 13:06:04 l75lg1-v1 devstack@placement-api.service[78202]: INFO placement.requestlog [req-ffa0e1f8-f1fe-413c-ba09-7b6c802aa5a3 req-c413f6c1-1e25-4008-8305-b954d8a16508 service placement] 10.27.203.238 "GET /placement/resource_providers/ef90d7d1-0808-4a15-ad77-f9a7391af2f4/traits" status: 200 len: 1471 microversion: 1.6 May 28 13:06:04 l75lg1-v1 devstack@placement-api.service[78202]: [pid: 78202|app: 0|req: 35/69] 10.27.203.238 () {64 vars in 1508 bytes} [Tue May 28 13:06:04 2024] GET /placement/resource_providers/ef90d7d1-0808-4a15-ad77-f9a7391af2f4/traits => generated 1471 bytes in 21 msecs (HTTP/1.1 200) 6 headers in 225 bytes (1 switches on core 0) May 28 13:06:04 l75lg1-v1 nova-compute[83654]: DEBUG nova.scheduler.client.report [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Refreshing trait associations for resource provider ef90d7d1-0808-4a15-ad77-f9a7391af2f4, traits: COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_LAN9118,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NODE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSSE3,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_IDE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VIOMMU_MODEL_SMMUV3,COMPUTE_STORAGE_BUS_FDC {{(pid=83654) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}} May 28 13:06:04 l75lg1-v1 devstack@placement-api.service[78201]: DEBUG placement.requestlog [req-ffa0e1f8-f1fe-413c-ba09-7b6c802aa5a3 req-da19c98a-bed0-4403-a5c6-ea93d122b502 None None] Starting request: 10.27.203.238 "GET /placement/resource_providers/ef90d7d1-0808-4a15-ad77-f9a7391af2f4/allocations" {{(pid=78201) __call__ /opt/stack/placement/placement/requestlog.py:55}} May 28 13:06:04 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-cd8676f4-013a-49fe-8acf-d0e212b2ee74 tempest-ShareSnapshotMetadataTest-331543469 None] <<< [GET] https://127.0.0.1:40443/api/views/ May 28 13:06:04 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-cd8676f4-013a-49fe-8acf-d0e212b2ee74 tempest-ShareSnapshotMetadataTest-331543469 None] [] May 28 13:06:04 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-cd8676f4-013a-49fe-8acf-d0e212b2ee74 tempest-ShareSnapshotMetadataTest-331543469 None] --- [GET] https://127.0.0.1:40443/api/views/: Done May 28 13:06:04 l75lg1-v1 devstack@placement-api.service[78201]: INFO placement.requestlog [req-ffa0e1f8-f1fe-413c-ba09-7b6c802aa5a3 req-da19c98a-bed0-4403-a5c6-ea93d122b502 service placement] 10.27.203.238 "GET /placement/resource_providers/ef90d7d1-0808-4a15-ad77-f9a7391af2f4/allocations" status: 200 len: 54 microversion: 1.0 May 28 13:06:04 l75lg1-v1 devstack@placement-api.service[78201]: [pid: 78201|app: 0|req: 35/70] 10.27.203.238 () {62 vars in 1480 bytes} [Tue May 28 13:06:04 2024] GET /placement/resource_providers/ef90d7d1-0808-4a15-ad77-f9a7391af2f4/allocations => generated 54 bytes in 11 msecs (HTTP/1.1 200) 6 headers in 223 bytes (1 switches on core 0) May 28 13:06:04 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-cd8676f4-013a-49fe-8acf-d0e212b2ee74 tempest-ShareSnapshotMetadataTest-331543469 None] >>> [POST] https://127.0.0.1:40443/api/views/ May 28 13:06:04 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-cd8676f4-013a-49fe-8acf-d0e212b2ee74 tempest-ShareSnapshotMetadataTest-331543469 None] {'data': '{"name": "32260cfb-2f6c-471f-8668-cd9a33828137", "path": ' May 28 13:06:04 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-cd8676f4-013a-49fe-8acf-d0e212b2ee74 tempest-ShareSnapshotMetadataTest-331543469 None] '"/manila/manila-32260cfb-2f6c-471f-8668-cd9a33828137", "policy_id": ' May 28 13:06:04 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-cd8676f4-013a-49fe-8acf-d0e212b2ee74 tempest-ShareSnapshotMetadataTest-331543469 None] '68, "create_dir": true, "protocols": ["NFS"]}', May 28 13:06:04 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-cd8676f4-013a-49fe-8acf-d0e212b2ee74 tempest-ShareSnapshotMetadataTest-331543469 None] 'json': None, May 28 13:06:04 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-cd8676f4-013a-49fe-8acf-d0e212b2ee74 tempest-ShareSnapshotMetadataTest-331543469 None] 'params': None} May 28 13:06:04 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.provider_tree [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Inventory has not changed in ProviderTree for provider: ef90d7d1-0808-4a15-ad77-f9a7391af2f4 {{(pid=83654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} May 28 13:06:04 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Expecting reply to msg a81a0a5dce9f46d4b37cd7b8b5203573 in queue reply_37f4cbd1dd094961a22b8a65f222c327 May 28 13:06:04 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [-] Received RPC response for msg a81a0a5dce9f46d4b37cd7b8b5203573 May 28 13:06:04 l75lg1-v1 nova-compute[83654]: DEBUG nova.scheduler.client.report [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Inventory has not changed for provider ef90d7d1-0808-4a15-ad77-f9a7391af2f4 based on inventory data: {'VCPU': {'total': 10, 'reserved': 0, 'min_unit': 1, 'max_unit': 10, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16000, 'reserved': 512, 'min_unit': 1, 'max_unit': 16000, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 28, 'reserved': 0, 'min_unit': 1, 'max_unit': 28, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=83654) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}} May 28 13:06:04 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.resource_tracker [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Compute_service record updated for l75lg1-v1:l75lg1-v1 {{(pid=83654) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}} May 28 13:06:04 l75lg1-v1 nova-compute[83654]: DEBUG oslo_concurrency.lockutils [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.734s {{(pid=83654) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:06:05 l75lg1-v1 dstat.sh[49771]: 28-05 13:06:05| 3 0 97 0 0|5524M 1885M 278M 7937M| 18k 940B| 0 0 | 0 0 |2126 3230 |0.78 1.00 1.01|1.0 0 0| 0 0 | 0 2048M| 29 359 0 6 6 May 28 13:06:05 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-cd8676f4-013a-49fe-8acf-d0e212b2ee74 tempest-ShareSnapshotMetadataTest-331543469 None] <<< [POST] https://127.0.0.1:40443/api/views/ May 28 13:06:05 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-cd8676f4-013a-49fe-8acf-d0e212b2ee74 tempest-ShareSnapshotMetadataTest-331543469 None] Bunch(abac_tags=[], abe_max_depth=None, abe_protocols=[], alias='', allow_anonymous_access=False, allow_s3_anonymous_access=False, auto_commit='0d', bucket='', bucket_creators=[], bucket_creators_groups=[], bucket_owner=None, bulk_permission_update_progress=None, bulk_permission_update_state=None, cluster='loop75-kfs', cluster_id=1, created='2024-05-28T13:06:05.155980Z', enabled=True, files_retention_mode='NONE', guid='4812d0a3-58b0-4b1b-a90c-95c7b0940a98', id=67, ignore_oos=False, internal=False, is_remote=False, is_seamless=False, logical_capacity=0, max_retention_period=None, min_retention_period=None, name='32260cfb-2f6c-471f-8668-cd9a33828137', nfs_interop_flags='BOTH_NFS3_AND_NFS4_INTEROP_DISABLED', path='/manila/manila-32260cfb-2f6c-471f-8668-cd9a33828137', physical_capacity=0, policy='32260cfb-2f6c-471f-8668-cd9a33828137', policy_id=68, protocols=['NFS'], qos_policy=None, qos_policy_id=None, s3_locks=False, s3_locks_retention_mode='NONE', s3_locks_retention_period='', s3_object_ownership_rule='ObjectWriter', s3_unverified_lookup=False, s3_versioning=False, select_for_live_monitoring=False, share='', share_acl=Bunch(acl=[], enabled=False), sync='SYNCED', sync_time='2024-05-28T13:06:05.431622Z', tenant_id=1, tenant_name='default', title='/manila/manila-32260cfb-2f6c-471f-8668-cd9a33828137', url='https://127.0.0.1:40443/api/views/67/') May 28 13:06:05 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-cd8676f4-013a-49fe-8acf-d0e212b2ee74 tempest-ShareSnapshotMetadataTest-331543469 None] --- [POST] https://127.0.0.1:40443/api/views/: Done May 28 13:06:05 l75lg1-v1 manila-share[98474]: INFO manila.share.manager [None req-cd8676f4-013a-49fe-8acf-d0e212b2ee74 tempest-ShareSnapshotMetadataTest-331543469 None] Share instance 32260cfb-2f6c-471f-8668-cd9a33828137 created successfully. May 28 13:06:06 l75lg1-v1 dstat.sh[49771]: 28-05 13:06:06| 1 0 98 0 0|5524M 1885M 278M 7937M| 27k 66B| 0 200k| 0 31.0 |2094 3218 |0.78 1.00 1.01| 0 0 0| 0 0 | 0 2048M| 29 359 0 6 6 May 28 13:06:06 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-94198a6a-656d-499a-b3b7-9920e6c34d2c tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] GET http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/shares/41a07ae7-d107-493e-8a00-5ada346ac16c May 28 13:06:06 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-94198a6a-656d-499a-b3b7-9920e6c34d2c tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:06:06 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-94198a6a-656d-499a-b3b7-9920e6c34d2c tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:06:06 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-94198a6a-656d-499a-b3b7-9920e6c34d2c tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/shares/41a07ae7-d107-493e-8a00-5ada346ac16c returned with HTTP 200 May 28 13:06:06 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1411/2801] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:06:06 2024] GET /share/v2/9c1e3ce524bc424eae1e9467bc390dec/shares/41a07ae7-d107-493e-8a00-5ada346ac16c => generated 1340 bytes in 26 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:06:06 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-8f62dd32-3a9c-41ac-801f-80269f68936a tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] POST http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots May 28 13:06:06 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-8f62dd32-3a9c-41ac-801f-80269f68936a tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Action: 'create', calling method: ShareSnapshotMixin.create, body: {"snapshot": {"name": "tempest-tempest-snapshot-name-1642164119", "force": false, "description": "tempest-tempest-snapshot-description-1117379788", "share_id": "41a07ae7-d107-493e-8a00-5ada346ac16c"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:06:06 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.v1.share_snapshots [None req-8f62dd32-3a9c-41ac-801f-80269f68936a tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Create snapshot from share 41a07ae7-d107-493e-8a00-5ada346ac16c May 28 13:06:06 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.quota [None req-8f62dd32-3a9c-41ac-801f-80269f68936a tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Created reservations ['54ca34a8-5d51-41e8-b87d-e340b60ddb07', '856d3fe4-3605-4c13-b180-25402fae093f', '52e098c3-955d-4e6b-ae13-07333b7cc837', '22cb46a4-cb74-4641-9f8b-4ae28ec3bfe4'] {{(pid=98330) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 13:06:07 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.quota [None req-8f62dd32-3a9c-41ac-801f-80269f68936a tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Committed reservations ['54ca34a8-5d51-41e8-b87d-e340b60ddb07', '856d3fe4-3605-4c13-b180-25402fae093f', '52e098c3-955d-4e6b-ae13-07333b7cc837', '22cb46a4-cb74-4641-9f8b-4ae28ec3bfe4'] {{(pid=98330) commit /opt/stack/manila/manila/quota.py:1063}} May 28 13:06:07 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-8f62dd32-3a9c-41ac-801f-80269f68936a tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots returned with HTTP 202 May 28 13:06:07 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1391/2802] 10.27.203.238 () {66 vars in 1371 bytes} [Tue May 28 13:06:06 2024] POST /share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots => generated 747 bytes in 189 msecs (HTTP/1.1 202) 6 headers in 237 bytes (1 switches on core 0) May 28 13:06:07 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-a035baa0-bd0c-487d-adb9-e555c0a46f04 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] GET http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/aa5ec314-e632-4fbb-b8cc-b5009e18200a May 28 13:06:07 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-a035baa0-bd0c-487d-adb9-e555c0a46f04 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:06:07 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-a035baa0-bd0c-487d-adb9-e555c0a46f04 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Calling method 'ShareSnapshotMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:06:07 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-a035baa0-bd0c-487d-adb9-e555c0a46f04 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/aa5ec314-e632-4fbb-b8cc-b5009e18200a returned with HTTP 200 May 28 13:06:07 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1412/2803] 10.27.203.238 () {64 vars in 1460 bytes} [Tue May 28 13:06:07 2024] GET /share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/aa5ec314-e632-4fbb-b8cc-b5009e18200a => generated 747 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:06:07 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8f62dd32-3a9c-41ac-801f-80269f68936a tempest-ShareSnapshotMetadataTest-331543469 None] >>> [POST] https://127.0.0.1:40443/api/snapshots/ May 28 13:06:07 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8f62dd32-3a9c-41ac-801f-80269f68936a tempest-ShareSnapshotMetadataTest-331543469 None] {'data': '{"path": "/manila/manila-32260cfb-2f6c-471f-8668-cd9a33828137", ' May 28 13:06:07 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8f62dd32-3a9c-41ac-801f-80269f68936a tempest-ShareSnapshotMetadataTest-331543469 None] '"name": "share-snapshot-0c338135-50a5-415e-8545-5c4e7920eb7c"}', May 28 13:06:07 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8f62dd32-3a9c-41ac-801f-80269f68936a tempest-ShareSnapshotMetadataTest-331543469 None] 'json': None, May 28 13:06:07 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8f62dd32-3a9c-41ac-801f-80269f68936a tempest-ShareSnapshotMetadataTest-331543469 None] 'params': None} May 28 13:06:07 l75lg1-v1 dstat.sh[49771]: 28-05 13:06:07| 4 1 94 1 0|5524M 1885M 278M 7937M| 27k 1080B| 0 560k| 0 85.0 |2941 4535 |0.78 1.00 1.01|2.0 0 0| 0 0 | 0 2048M| 29 359 0 6 6 May 28 13:06:07 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 13:06:08 l75lg1-v1 dstat.sh[49771]: 28-05 13:06:08| 1 0 98 0 0|5524M 1885M 278M 7937M| 28k 0 | 0 164k| 0 15.0 |1775 2462 |0.72 0.98 1.01|1.0 0 0| 0 0 | 0 2048M| 29 359 0 6 6 May 28 13:06:09 l75lg1-v1 neutron-server[77619]: DEBUG dbcounter [-] [77619] Writing DB stats neutron:SELECT=1 {{(pid=77619) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:06:09 l75lg1-v1 neutron-server[77619]: DEBUG dbcounter [-] [77619] Writing DB stats neutron:SELECT=2 {{(pid=77619) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:06:09 l75lg1-v1 dstat.sh[49771]: 28-05 13:06:09| 1 1 98 0 0|5524M 1885M 278M 7937M| 21k 0 | 0 168k| 0 20.0 |1778 2484 |0.72 0.98 1.01|1.0 0 2.0| 0 0 | 0 2048M| 29 359 0 6 6 May 28 13:06:09 l75lg1-v1 neutron-server[77623]: DEBUG dbcounter [-] [77623] Writing DB stats neutron:SELECT=1 {{(pid=77623) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:06:09 l75lg1-v1 neutron-server[77623]: DEBUG dbcounter [-] [77623] Writing DB stats neutron:SELECT=2 {{(pid=77623) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:06:10 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-1da3be05-61ae-4e5d-a488-aa4443f52a8b tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] GET http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/aa5ec314-e632-4fbb-b8cc-b5009e18200a May 28 13:06:10 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-1da3be05-61ae-4e5d-a488-aa4443f52a8b tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:06:10 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-1da3be05-61ae-4e5d-a488-aa4443f52a8b tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Calling method 'ShareSnapshotMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:06:10 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-1da3be05-61ae-4e5d-a488-aa4443f52a8b tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/aa5ec314-e632-4fbb-b8cc-b5009e18200a returned with HTTP 200 May 28 13:06:10 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1392/2804] 10.27.203.238 () {64 vars in 1460 bytes} [Tue May 28 13:06:10 2024] GET /share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/aa5ec314-e632-4fbb-b8cc-b5009e18200a => generated 747 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:06:10 l75lg1-v1 dstat.sh[49771]: 28-05 13:06:10| 2 0 96 2 0|5524M 1885M 278M 7937M| 19k 0 | 0 2856k| 0 223 |2486 3960 |0.72 0.98 1.01|1.0 0 0| 0 0 | 0 2048M| 29 359 0 6 6 May 28 13:06:10 l75lg1-v1 neutron-server[77618]: DEBUG dbcounter [-] [77618] Writing DB stats neutron:UPDATE=1 {{(pid=77618) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:06:10 l75lg1-v1 neutron-server[77618]: DEBUG dbcounter [-] [77618] Writing DB stats neutron:SELECT=1 {{(pid=77618) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:06:10 l75lg1-v1 devstack@keystone.service[51267]: DEBUG dbcounter [-] [51267] Writing DB stats keystone:SELECT=194,keystone:DELETE=24,keystone:INSERT=13 {{(pid=51267) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:06:11 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8f62dd32-3a9c-41ac-801f-80269f68936a tempest-ShareSnapshotMetadataTest-331543469 None] <<< [POST] https://127.0.0.1:40443/api/snapshots/ May 28 13:06:11 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8f62dd32-3a9c-41ac-801f-80269f68936a tempest-ShareSnapshotMetadataTest-331543469 None] Bunch(access_path='/.vast_all_snapshots/1000000019_share-snapshot-0c338135-50a5-415e-8545-5c4e7920eb7c', aggr_phys_estimation=0, cluster='loop75-kfs', created='2024-05-28T13:06:07.738144Z', eta_sec=30819898426.85341, expiration_time='3001-01-19T07:59:58Z', guid='b763f06e-0f17-4311-b328-13f02faae86b', id=20, indestructible=False, locked=False, name='share-snapshot-0c338135-50a5-415e-8545-5c4e7920eb7c', path='/manila/manila-32260cfb-2f6c-471f-8668-cd9a33828137/', policy=None, policy_id=None, protection_policy_id=None, state='SUCCEED', tenant_id=1, tenant_name='default', title='share-snapshot-0c338135-50a5-415e-8545-5c4e7920eb7c(/manila/manila-32260cfb-2f6c-471f-8668-cd9a33828137/)', type='local', unique_phys_estimation=0, url='https://127.0.0.1:40443/api/snapshots/20/') May 28 13:06:11 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-8f62dd32-3a9c-41ac-801f-80269f68936a tempest-ShareSnapshotMetadataTest-331543469 None] --- [POST] https://127.0.0.1:40443/api/snapshots/: Done May 28 13:06:11 l75lg1-v1 dstat.sh[49771]: 28-05 13:06:11| 1 1 97 1 0|5524M 1885M 278M 7937M| 39k 66B| 0 636k| 0 75.0 |2346 3263 |0.72 0.98 1.01|1.0 0 0| 0 0 | 0 2048M| 29 359 0 6 6 May 28 13:06:11 l75lg1-v1 neutron-server[77623]: DEBUG neutron.db.agents_db [None req-fe40ce8c-640e-4db7-a17a-6e8888cce266 None None] Agent healthcheck: found 0 active agents {{(pid=77623) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:319}} May 28 13:06:11 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.periodic_task [None req-e3486ff9-a95e-41bc-8901-df75aedbeaad None None] Running periodic task DataManager.create_backup_continue {{(pid=98318) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 13:06:11 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.periodic_task [None req-e3486ff9-a95e-41bc-8901-df75aedbeaad None None] Running periodic task DataManager.restore_backup_continue {{(pid=98318) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 13:06:12 l75lg1-v1 dstat.sh[49771]: 28-05 13:06:12| 1 0 97 0 0|5524M 1885M 278M 7937M| 37k 0 | 0 280k| 0 49.0 |2527 3717 |0.72 0.98 1.01| 0 0 0| 0 0 | 0 2048M| 29 359 0 6 6 May 28 13:06:13 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-8b2b7916-c2e3-45fe-9f00-dd62459ad5cb tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] GET http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/aa5ec314-e632-4fbb-b8cc-b5009e18200a May 28 13:06:13 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-8b2b7916-c2e3-45fe-9f00-dd62459ad5cb tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:06:13 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-8b2b7916-c2e3-45fe-9f00-dd62459ad5cb tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Calling method 'ShareSnapshotMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:06:13 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-8b2b7916-c2e3-45fe-9f00-dd62459ad5cb tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/aa5ec314-e632-4fbb-b8cc-b5009e18200a returned with HTTP 200 May 28 13:06:13 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1413/2805] 10.27.203.238 () {64 vars in 1460 bytes} [Tue May 28 13:06:13 2024] GET /share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/aa5ec314-e632-4fbb-b8cc-b5009e18200a => generated 748 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:06:13 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-3cdaca46-229b-4123-a8ed-07e16d181dcc tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] POST http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots May 28 13:06:13 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-3cdaca46-229b-4123-a8ed-07e16d181dcc tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Action: 'create', calling method: ShareSnapshotMixin.create, body: {"snapshot": {"name": "tempest-tempest-created-share-snap-1437002021", "force": false, "description": "Tempest's snapshot", "share_id": "41a07ae7-d107-493e-8a00-5ada346ac16c"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:06:13 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.v1.share_snapshots [None req-3cdaca46-229b-4123-a8ed-07e16d181dcc tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Create snapshot from share 41a07ae7-d107-493e-8a00-5ada346ac16c May 28 13:06:13 l75lg1-v1 dstat.sh[49771]: 28-05 13:06:13| 2 0 97 0 0|5524M 1885M 278M 7937M| 38k 317B| 0 168k| 0 25.9 |2350 3413 |0.74 0.98 1.01|1.0 0 0| 0 0 | 0 2048M| 29 360 0 6 6 May 28 13:06:13 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.quota [None req-3cdaca46-229b-4123-a8ed-07e16d181dcc tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Created reservations ['808cbe29-5b03-46ab-8a11-20243cdb64d5', '66969417-1896-4930-9dbb-0c71c057c36a', '9c07dfd9-42cf-4f93-bd90-dbb15d55a8f5', '1d28c777-3800-4661-afa9-551f46e75228'] {{(pid=98330) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 13:06:13 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.quota [None req-3cdaca46-229b-4123-a8ed-07e16d181dcc tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Committed reservations ['808cbe29-5b03-46ab-8a11-20243cdb64d5', '66969417-1896-4930-9dbb-0c71c057c36a', '9c07dfd9-42cf-4f93-bd90-dbb15d55a8f5', '1d28c777-3800-4661-afa9-551f46e75228'] {{(pid=98330) commit /opt/stack/manila/manila/quota.py:1063}} May 28 13:06:13 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-3cdaca46-229b-4123-a8ed-07e16d181dcc tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots returned with HTTP 202 May 28 13:06:13 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1393/2806] 10.27.203.238 () {66 vars in 1371 bytes} [Tue May 28 13:06:13 2024] POST /share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots => generated 723 bytes in 174 msecs (HTTP/1.1 202) 6 headers in 237 bytes (1 switches on core 0) May 28 13:06:13 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-562a587f-1c77-4f41-9447-e14d2f8a8661 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] GET http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/a6e9a2c5-5e25-4149-8ff8-be1b3a1ccdc0 May 28 13:06:13 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-562a587f-1c77-4f41-9447-e14d2f8a8661 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:06:13 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-562a587f-1c77-4f41-9447-e14d2f8a8661 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Calling method 'ShareSnapshotMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:06:13 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-562a587f-1c77-4f41-9447-e14d2f8a8661 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/a6e9a2c5-5e25-4149-8ff8-be1b3a1ccdc0 returned with HTTP 200 May 28 13:06:13 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1414/2807] 10.27.203.238 () {64 vars in 1460 bytes} [Tue May 28 13:06:13 2024] GET /share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/a6e9a2c5-5e25-4149-8ff8-be1b3a1ccdc0 => generated 723 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:06:13 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-3cdaca46-229b-4123-a8ed-07e16d181dcc tempest-ShareSnapshotMetadataTest-331543469 None] >>> [POST] https://127.0.0.1:40443/api/snapshots/ May 28 13:06:13 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-3cdaca46-229b-4123-a8ed-07e16d181dcc tempest-ShareSnapshotMetadataTest-331543469 None] {'data': '{"path": "/manila/manila-32260cfb-2f6c-471f-8668-cd9a33828137", ' May 28 13:06:13 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-3cdaca46-229b-4123-a8ed-07e16d181dcc tempest-ShareSnapshotMetadataTest-331543469 None] '"name": "share-snapshot-f7f250de-d840-44d8-bef9-6d2c3ef26c30"}', May 28 13:06:13 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-3cdaca46-229b-4123-a8ed-07e16d181dcc tempest-ShareSnapshotMetadataTest-331543469 None] 'json': None, May 28 13:06:13 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-3cdaca46-229b-4123-a8ed-07e16d181dcc tempest-ShareSnapshotMetadataTest-331543469 None] 'params': None} May 28 13:06:13 l75lg1-v1 nova-conductor[83647]: DEBUG dbcounter [-] [83647] Writing DB stats nova_cell1:SELECT=3 {{(pid=83647) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:06:14 l75lg1-v1 sudo[98605]: pam_unix(sudo:session): session closed for user root May 28 13:06:14 l75lg1-v1 neutron-ovn-metadata-agent[76818]: INFO oslo_rootwrap.client [-] Rootwrap daemon process exit with status: 0 May 28 13:06:14 l75lg1-v1 dstat.sh[49771]: 28-05 13:06:14| 4 1 95 1 0|5501M 1907M 278M 7937M| 46k 909B| 0 501k| 0 78.1 |2994 4260 |0.74 0.98 1.01|1.0 0 0| 0 0 | 0 2048M| 29 359 0 6 6 May 28 13:06:14 l75lg1-v1 devstack@keystone.service[51266]: DEBUG dbcounter [-] [51266] Writing DB stats keystone:SELECT=241,keystone:DELETE=27,keystone:INSERT=13 {{(pid=51266) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:06:14 l75lg1-v1 devstack@placement-api.service[78202]: DEBUG dbcounter [-] [78202] Writing DB stats placement:SELECT=8 {{(pid=78202) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:06:14 l75lg1-v1 devstack@placement-api.service[78201]: DEBUG dbcounter [-] [78201] Writing DB stats placement:SELECT=6 {{(pid=78201) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:06:14 l75lg1-v1 nova-conductor[83648]: DEBUG dbcounter [-] [83648] Writing DB stats nova_cell1:SELECT=3 {{(pid=83648) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:06:15 l75lg1-v1 dstat.sh[49771]: 28-05 13:06:15| 1 1 98 0 0|5501M 1907M 278M 7937M| 36k 172B| 0 384k| 0 42.0 |1845 2469 |0.74 0.98 1.01|2.0 0 0| 0 0 | 0 2048M| 29 359 0 6 6 May 28 13:06:16 l75lg1-v1 dstat.sh[49771]: 28-05 13:06:16| 1 0 98 0 0|5502M 1907M 278M 7937M| 32k 0 | 0 744k| 0 15.0 |1659 2179 |0.74 0.98 1.01|1.0 0 0| 0 0 | 0 2048M| 29 359 0 6 6 May 28 13:06:16 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-d07ac10a-d3ca-45c7-ad27-53ee2f9ffa7c tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] GET http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/a6e9a2c5-5e25-4149-8ff8-be1b3a1ccdc0 May 28 13:06:16 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-d07ac10a-d3ca-45c7-ad27-53ee2f9ffa7c tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:06:16 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-d07ac10a-d3ca-45c7-ad27-53ee2f9ffa7c tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Calling method 'ShareSnapshotMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:06:16 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-d07ac10a-d3ca-45c7-ad27-53ee2f9ffa7c tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/a6e9a2c5-5e25-4149-8ff8-be1b3a1ccdc0 returned with HTTP 200 May 28 13:06:16 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1394/2808] 10.27.203.238 () {64 vars in 1460 bytes} [Tue May 28 13:06:16 2024] GET /share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/a6e9a2c5-5e25-4149-8ff8-be1b3a1ccdc0 => generated 723 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:06:17 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-3cdaca46-229b-4123-a8ed-07e16d181dcc tempest-ShareSnapshotMetadataTest-331543469 None] <<< [POST] https://127.0.0.1:40443/api/snapshots/ May 28 13:06:17 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-3cdaca46-229b-4123-a8ed-07e16d181dcc tempest-ShareSnapshotMetadataTest-331543469 None] Bunch(access_path='/.vast_all_snapshots/1000000020_share-snapshot-f7f250de-d840-44d8-bef9-6d2c3ef26c30', aggr_phys_estimation=0, cluster='loop75-kfs', created='2024-05-28T13:06:13.863981Z', eta_sec=30819898420.900146, expiration_time='3001-01-19T07:59:58Z', guid='f16257c6-2c48-4a9e-b071-ef61eeaa71dc', id=21, indestructible=False, locked=False, name='share-snapshot-f7f250de-d840-44d8-bef9-6d2c3ef26c30', path='/manila/manila-32260cfb-2f6c-471f-8668-cd9a33828137/', policy=None, policy_id=None, protection_policy_id=None, state='SUCCEED', tenant_id=1, tenant_name='default', title='share-snapshot-f7f250de-d840-44d8-bef9-6d2c3ef26c30(/manila/manila-32260cfb-2f6c-471f-8668-cd9a33828137/)', type='local', unique_phys_estimation=0, url='https://127.0.0.1:40443/api/snapshots/21/') May 28 13:06:17 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-3cdaca46-229b-4123-a8ed-07e16d181dcc tempest-ShareSnapshotMetadataTest-331543469 None] --- [POST] https://127.0.0.1:40443/api/snapshots/: Done May 28 13:06:17 l75lg1-v1 dstat.sh[49771]: 28-05 13:06:17| 1 1 97 1 0|5502M 1907M 278M 7937M| 32k 66B| 0 961k| 0 84.1 |2287 3203 |0.74 0.98 1.01|1.0 0 0| 0 0 | 0 2048M| 29 359 0 6 6 May 28 13:06:18 l75lg1-v1 dstat.sh[49771]: 28-05 13:06:18| 1 1 98 0 0|5502M 1906M 278M 7937M| 37k 0 | 0 216k| 0 18.0 |1701 2259 |0.68 0.97 1.00| 0 0 0| 0 0 | 0 2048M| 29 359 0 6 6 May 28 13:06:19 l75lg1-v1 dstat.sh[49771]: 28-05 13:06:19| 1 1 99 0 0|5503M 1905M 278M 7937M| 33k 0 | 0 1591k| 0 310 |1763 2377 |0.68 0.97 1.00|1.0 0 2.0| 0 0 | 0 2048M| 29 359 0 6 6 May 28 13:06:19 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-7352f40d-19e5-4d7a-8d39-8378f5dc3830 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] GET http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/a6e9a2c5-5e25-4149-8ff8-be1b3a1ccdc0 May 28 13:06:19 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-7352f40d-19e5-4d7a-8d39-8378f5dc3830 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:06:19 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-7352f40d-19e5-4d7a-8d39-8378f5dc3830 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Calling method 'ShareSnapshotMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:06:19 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-7352f40d-19e5-4d7a-8d39-8378f5dc3830 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/a6e9a2c5-5e25-4149-8ff8-be1b3a1ccdc0 returned with HTTP 200 May 28 13:06:19 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1415/2809] 10.27.203.238 () {64 vars in 1460 bytes} [Tue May 28 13:06:19 2024] GET /share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/a6e9a2c5-5e25-4149-8ff8-be1b3a1ccdc0 => generated 724 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:06:19 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-24c1e9a4-81cd-4eb3-98e3-22a9cd22f168 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] POST http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/a6e9a2c5-5e25-4149-8ff8-be1b3a1ccdc0/metadata May 28 13:06:19 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-24c1e9a4-81cd-4eb3-98e3-22a9cd22f168 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Action: 'create_metadata', calling method: Controller.__getattribute__..version_select, body: {"metadata": {"key5": "value5", "key6": "value6"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:06:19 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-24c1e9a4-81cd-4eb3-98e3-22a9cd22f168 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/a6e9a2c5-5e25-4149-8ff8-be1b3a1ccdc0/metadata returned with HTTP 200 May 28 13:06:19 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1395/2810] 10.27.203.238 () {66 vars in 1508 bytes} [Tue May 28 13:06:19 2024] POST /share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/a6e9a2c5-5e25-4149-8ff8-be1b3a1ccdc0/metadata => generated 50 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:06:19 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-77f5addd-61ae-4079-8c27-7df8e024ab8d tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] PUT http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/a6e9a2c5-5e25-4149-8ff8-be1b3a1ccdc0/metadata May 28 13:06:19 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-77f5addd-61ae-4079-8c27-7df8e024ab8d tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Action: 'update_all_metadata', calling method: Controller.__getattribute__..version_select, body: {"metadata": {"key7": "value7", "key8": "value8"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:06:19 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-77f5addd-61ae-4079-8c27-7df8e024ab8d tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/a6e9a2c5-5e25-4149-8ff8-be1b3a1ccdc0/metadata returned with HTTP 200 May 28 13:06:19 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1416/2811] 10.27.203.238 () {66 vars in 1507 bytes} [Tue May 28 13:06:19 2024] PUT /share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/a6e9a2c5-5e25-4149-8ff8-be1b3a1ccdc0/metadata => generated 50 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:06:19 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-a8f67151-4f7b-40fc-ba5a-018ff60387e5 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] GET http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/a6e9a2c5-5e25-4149-8ff8-be1b3a1ccdc0/metadata May 28 13:06:19 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-a8f67151-4f7b-40fc-ba5a-018ff60387e5 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:06:19 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-a8f67151-4f7b-40fc-ba5a-018ff60387e5 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:06:19 l75lg1-v1 nova-conductor[83647]: DEBUG dbcounter [-] [83647] Writing DB stats nova_cell1:SELECT=3,nova_cell1:UPDATE=3 {{(pid=83647) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:06:19 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-a8f67151-4f7b-40fc-ba5a-018ff60387e5 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/a6e9a2c5-5e25-4149-8ff8-be1b3a1ccdc0/metadata returned with HTTP 200 May 28 13:06:19 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1396/2812] 10.27.203.238 () {64 vars in 1487 bytes} [Tue May 28 13:06:19 2024] GET /share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/a6e9a2c5-5e25-4149-8ff8-be1b3a1ccdc0/metadata => generated 50 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:06:19 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-7d5e6b78-b57a-40b2-9b90-f67ac94c254e tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] GET http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/a6e9a2c5-5e25-4149-8ff8-be1b3a1ccdc0/metadata/key7 May 28 13:06:19 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-7d5e6b78-b57a-40b2-9b90-f67ac94c254e tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:06:19 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-7d5e6b78-b57a-40b2-9b90-f67ac94c254e tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:06:19 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-7d5e6b78-b57a-40b2-9b90-f67ac94c254e tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/a6e9a2c5-5e25-4149-8ff8-be1b3a1ccdc0/metadata/key7 returned with HTTP 200 May 28 13:06:19 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1417/2813] 10.27.203.238 () {64 vars in 1502 bytes} [Tue May 28 13:06:19 2024] GET /share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/a6e9a2c5-5e25-4149-8ff8-be1b3a1ccdc0/metadata/key7 => generated 28 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:06:19 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-b4eb8393-eba5-4774-994c-50eeb1a73f5a tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] GET http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/a6e9a2c5-5e25-4149-8ff8-be1b3a1ccdc0/metadata/key8 May 28 13:06:19 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-b4eb8393-eba5-4774-994c-50eeb1a73f5a tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:06:19 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-b4eb8393-eba5-4774-994c-50eeb1a73f5a tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:06:19 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-b4eb8393-eba5-4774-994c-50eeb1a73f5a tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/a6e9a2c5-5e25-4149-8ff8-be1b3a1ccdc0/metadata/key8 returned with HTTP 200 May 28 13:06:19 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1397/2814] 10.27.203.238 () {64 vars in 1502 bytes} [Tue May 28 13:06:19 2024] GET /share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/a6e9a2c5-5e25-4149-8ff8-be1b3a1ccdc0/metadata/key8 => generated 28 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:06:19 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-d14c8221-1f9f-43c5-a8d0-1f1c921f03a3 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] DELETE http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/a6e9a2c5-5e25-4149-8ff8-be1b3a1ccdc0 May 28 13:06:19 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-d14c8221-1f9f-43c5-a8d0-1f1c921f03a3 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:06:19 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-d14c8221-1f9f-43c5-a8d0-1f1c921f03a3 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Calling method 'ShareSnapshotMixin.delete' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:06:19 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.v1.share_snapshots [None req-d14c8221-1f9f-43c5-a8d0-1f1c921f03a3 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Delete snapshot with id: a6e9a2c5-5e25-4149-8ff8-be1b3a1ccdc0 May 28 13:06:20 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-d14c8221-1f9f-43c5-a8d0-1f1c921f03a3 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/a6e9a2c5-5e25-4149-8ff8-be1b3a1ccdc0 returned with HTTP 202 May 28 13:06:20 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1418/2815] 10.27.203.238 () {64 vars in 1463 bytes} [Tue May 28 13:06:19 2024] DELETE /share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/a6e9a2c5-5e25-4149-8ff8-be1b3a1ccdc0 => generated 0 bytes in 90 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 13:06:20 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-29d85a45-370e-4885-ad62-5d0e4772b6e6 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] GET http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/a6e9a2c5-5e25-4149-8ff8-be1b3a1ccdc0 May 28 13:06:20 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-29d85a45-370e-4885-ad62-5d0e4772b6e6 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:06:20 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-29d85a45-370e-4885-ad62-5d0e4772b6e6 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Calling method 'ShareSnapshotMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:06:20 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-29d85a45-370e-4885-ad62-5d0e4772b6e6 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/a6e9a2c5-5e25-4149-8ff8-be1b3a1ccdc0 returned with HTTP 200 May 28 13:06:20 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1398/2816] 10.27.203.238 () {64 vars in 1460 bytes} [Tue May 28 13:06:20 2024] GET /share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/a6e9a2c5-5e25-4149-8ff8-be1b3a1ccdc0 => generated 757 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:06:20 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d14c8221-1f9f-43c5-a8d0-1f1c921f03a3 tempest-ShareSnapshotMetadataTest-331543469 None] >>> [GET] https://127.0.0.1:40443/api/snapshots/ May 28 13:06:20 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d14c8221-1f9f-43c5-a8d0-1f1c921f03a3 tempest-ShareSnapshotMetadataTest-331543469 None] {'allow_redirects': True, May 28 13:06:20 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d14c8221-1f9f-43c5-a8d0-1f1c921f03a3 tempest-ShareSnapshotMetadataTest-331543469 None] 'params': {'name': 'share-snapshot-f7f250de-d840-44d8-bef9-6d2c3ef26c30'}} May 28 13:06:20 l75lg1-v1 nova-conductor[83648]: DEBUG dbcounter [-] [83648] Writing DB stats nova_cell1:SELECT=2 {{(pid=83648) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:06:20 l75lg1-v1 dstat.sh[49771]: 28-05 13:06:20| 8 1 90 1 0|5503M 1905M 278M 7937M| 25k 686B| 0 600k| 0 103 |3857 6018 |0.68 0.97 1.00| 0 0 0| 0 0 | 0 2048M| 29 359 0 6 6 May 28 13:06:20 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d14c8221-1f9f-43c5-a8d0-1f1c921f03a3 tempest-ShareSnapshotMetadataTest-331543469 None] <<< [GET] https://127.0.0.1:40443/api/snapshots/ May 28 13:06:20 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d14c8221-1f9f-43c5-a8d0-1f1c921f03a3 tempest-ShareSnapshotMetadataTest-331543469 None] [Bunch(access_path='/.vast_all_snapshots/1000000020_share-snapshot-f7f250de-d840-44d8-bef9-6d2c3ef26c30', aggr_phys_estimation=0, cluster='loop75-kfs', created='2024-05-28T13:06:13.863981Z', eta_sec=30819898417.27819, expiration_time='3001-01-19T07:59:58Z', guid='f16257c6-2c48-4a9e-b071-ef61eeaa71dc', id=21, indestructible=False, locked=False, name='share-snapshot-f7f250de-d840-44d8-bef9-6d2c3ef26c30', path='/manila/manila-32260cfb-2f6c-471f-8668-cd9a33828137/', policy=None, policy_id=None, protection_policy_id=None, state='SUCCEED', tenant_id=1, tenant_name='default', title='share-snapshot-f7f250de-d840-44d8-bef9-6d2c3ef26c30(/manila/manila-32260cfb-2f6c-471f-8668-cd9a33828137/)', type='local', unique_phys_estimation=0, url='https://127.0.0.1:40443/api/snapshots/21/')] May 28 13:06:20 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d14c8221-1f9f-43c5-a8d0-1f1c921f03a3 tempest-ShareSnapshotMetadataTest-331543469 None] --- [GET] https://127.0.0.1:40443/api/snapshots/: Done May 28 13:06:20 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d14c8221-1f9f-43c5-a8d0-1f1c921f03a3 tempest-ShareSnapshotMetadataTest-331543469 None] >>> [DELETE] https://127.0.0.1:40443/api/snapshots/21/ May 28 13:06:21 l75lg1-v1 dstat.sh[49771]: 28-05 13:06:21| 0 1 98 1 0|5503M 1905M 278M 7937M| 36k 655B| 0 877k| 0 63.1 |1917 2495 |0.68 0.97 1.00|1.0 0 0| 0 0 | 0 2048M| 29 359 0 6 6 May 28 13:06:21 l75lg1-v1 neutron-server[77623]: DEBUG dbcounter [-] [77623] Writing DB stats neutron:SELECT=1 {{(pid=77623) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:06:22 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d14c8221-1f9f-43c5-a8d0-1f1c921f03a3 tempest-ShareSnapshotMetadataTest-331543469 None] <<< [DELETE] https://127.0.0.1:40443/api/snapshots/21/ May 28 13:06:22 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d14c8221-1f9f-43c5-a8d0-1f1c921f03a3 tempest-ShareSnapshotMetadataTest-331543469 None] --- [DELETE] https://127.0.0.1:40443/api/snapshots/21/: Done May 28 13:06:22 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-d14c8221-1f9f-43c5-a8d0-1f1c921f03a3 tempest-ShareSnapshotMetadataTest-331543469 None] Created reservations ['c6a6430a-1c8e-4050-a126-a5bb921137bc', '6fb1bc76-3ac9-464c-80bd-9f45f2e27eb6', '93660383-3dee-4d4f-a375-e5f7b87cc742', 'a4aebcf7-2dc4-49fa-b807-4e4c55b674c2'] {{(pid=98474) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 13:06:22 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-d14c8221-1f9f-43c5-a8d0-1f1c921f03a3 tempest-ShareSnapshotMetadataTest-331543469 None] Committed reservations ['c6a6430a-1c8e-4050-a126-a5bb921137bc', '6fb1bc76-3ac9-464c-80bd-9f45f2e27eb6', '93660383-3dee-4d4f-a375-e5f7b87cc742', 'a4aebcf7-2dc4-49fa-b807-4e4c55b674c2'] {{(pid=98474) commit /opt/stack/manila/manila/quota.py:1063}} May 28 13:06:22 l75lg1-v1 dstat.sh[49771]: 28-05 13:06:22| 2 1 96 1 0|5503M 1905M 278M 7937M| 29k 66B| 0 543k| 0 108 |2694 4006 |0.68 0.97 1.00| 0 1.0 0| 0 0 | 0 2048M| 29 359 0 6 6 May 28 13:06:23 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-a113824c-2bef-4f26-9810-cb7a4090fd7e tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] GET http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/a6e9a2c5-5e25-4149-8ff8-be1b3a1ccdc0 May 28 13:06:23 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-a113824c-2bef-4f26-9810-cb7a4090fd7e tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:06:23 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-a113824c-2bef-4f26-9810-cb7a4090fd7e tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Calling method 'ShareSnapshotMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:06:23 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-a113824c-2bef-4f26-9810-cb7a4090fd7e tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] HTTP exception thrown: The resource could not be found. May 28 13:06:23 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-a113824c-2bef-4f26-9810-cb7a4090fd7e tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/a6e9a2c5-5e25-4149-8ff8-be1b3a1ccdc0 returned with HTTP 404 May 28 13:06:23 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1419/2817] 10.27.203.238 () {64 vars in 1460 bytes} [Tue May 28 13:06:23 2024] GET /share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/a6e9a2c5-5e25-4149-8ff8-be1b3a1ccdc0 => generated 78 bytes in 15 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 13:06:23 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-ba4c0647-1211-4868-941c-d311536b00f6 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] POST http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots May 28 13:06:23 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-ba4c0647-1211-4868-941c-d311536b00f6 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Action: 'create', calling method: ShareSnapshotMixin.create, body: {"snapshot": {"name": "tempest-tempest-created-share-snap-882672989", "force": false, "description": "Tempest's snapshot", "share_id": "41a07ae7-d107-493e-8a00-5ada346ac16c"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:06:23 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.v1.share_snapshots [None req-ba4c0647-1211-4868-941c-d311536b00f6 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Create snapshot from share 41a07ae7-d107-493e-8a00-5ada346ac16c May 28 13:06:23 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.quota [None req-ba4c0647-1211-4868-941c-d311536b00f6 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Created reservations ['25164cb7-5f48-4da3-a666-5c8f0dd6a282', 'a7118356-6af1-4731-8769-c3254336b403', 'b09095e6-9151-408e-98bd-6e520857dfc6', '5aeb96d4-6e29-44af-a8a5-a644f250683d'] {{(pid=98330) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 13:06:23 l75lg1-v1 dstat.sh[49771]: 28-05 13:06:23| 2 1 96 1 0|5503M 1905M 278M 7937M| 19k 4360B| 0 1361k| 0 151 |2922 5055 |0.63 0.95 1.00|1.0 0 0| 0 0 | 0 2048M| 29 360 0 6 6 May 28 13:06:23 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.quota [None req-ba4c0647-1211-4868-941c-d311536b00f6 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Committed reservations ['25164cb7-5f48-4da3-a666-5c8f0dd6a282', 'a7118356-6af1-4731-8769-c3254336b403', 'b09095e6-9151-408e-98bd-6e520857dfc6', '5aeb96d4-6e29-44af-a8a5-a644f250683d'] {{(pid=98330) commit /opt/stack/manila/manila/quota.py:1063}} May 28 13:06:23 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-ba4c0647-1211-4868-941c-d311536b00f6 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots returned with HTTP 202 May 28 13:06:23 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1399/2818] 10.27.203.238 () {66 vars in 1371 bytes} [Tue May 28 13:06:23 2024] POST /share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots => generated 722 bytes in 176 msecs (HTTP/1.1 202) 6 headers in 237 bytes (1 switches on core 0) May 28 13:06:23 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-59313241-823f-4226-84e8-7b102a813fd4 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] GET http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/bcfe6ad6-a424-4155-a9b0-6347734f3c3b May 28 13:06:23 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-59313241-823f-4226-84e8-7b102a813fd4 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:06:23 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-59313241-823f-4226-84e8-7b102a813fd4 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Calling method 'ShareSnapshotMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:06:23 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-59313241-823f-4226-84e8-7b102a813fd4 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/bcfe6ad6-a424-4155-a9b0-6347734f3c3b returned with HTTP 200 May 28 13:06:23 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1420/2819] 10.27.203.238 () {64 vars in 1460 bytes} [Tue May 28 13:06:23 2024] GET /share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/bcfe6ad6-a424-4155-a9b0-6347734f3c3b => generated 722 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:06:23 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ba4c0647-1211-4868-941c-d311536b00f6 tempest-ShareSnapshotMetadataTest-331543469 None] >>> [POST] https://127.0.0.1:40443/api/snapshots/ May 28 13:06:23 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ba4c0647-1211-4868-941c-d311536b00f6 tempest-ShareSnapshotMetadataTest-331543469 None] {'data': '{"path": "/manila/manila-32260cfb-2f6c-471f-8668-cd9a33828137", ' May 28 13:06:23 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ba4c0647-1211-4868-941c-d311536b00f6 tempest-ShareSnapshotMetadataTest-331543469 None] '"name": "share-snapshot-68fbb134-b425-410b-9f38-abbb38662efb"}', May 28 13:06:23 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ba4c0647-1211-4868-941c-d311536b00f6 tempest-ShareSnapshotMetadataTest-331543469 None] 'json': None, May 28 13:06:23 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ba4c0647-1211-4868-941c-d311536b00f6 tempest-ShareSnapshotMetadataTest-331543469 None] 'params': None} May 28 13:06:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "_check_child_processes" by "neutron.agent.linux.external_process.ProcessMonitor._check_child_processes" {{(pid=76818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:06:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_concurrency.lockutils [-] Lock "_check_child_processes" acquired by "neutron.agent.linux.external_process.ProcessMonitor._check_child_processes" :: waited 0.001s {{(pid=76818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:06:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_concurrency.lockutils [-] Lock "_check_child_processes" "released" by "neutron.agent.linux.external_process.ProcessMonitor._check_child_processes" :: held 0.001s {{(pid=76818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:06:24 l75lg1-v1 dstat.sh[49771]: 28-05 13:06:24| 2 0 95 2 0|5503M 1905M 278M 7937M| 26k 907B| 0 3826k| 0 299 |2889 4508 |0.63 0.95 1.00| 0 0 0| 0 0 | 0 2048M| 29 359 0 6 6 May 28 13:06:25 l75lg1-v1 dstat.sh[49771]: 28-05 13:06:25| 1 0 99 0 0|5503M 1905M 278M 7937M| 19k 0 | 0 140k| 0 10.0 |1450 2159 |0.63 0.95 1.00| 0 0 0| 0 0 | 0 2048M| 29 359 0 6 6 May 28 13:06:25 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_service.periodic_task [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85846) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 13:06:25 l75lg1-v1 cinder-volume[85846]: DEBUG cinder.volume.drivers.lvm [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] Updating volume stats {{(pid=85846) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}} May 28 13:06:25 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:390}} May 28 13:06:25 l75lg1-v1 sudo[99502]: vastdata : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 May 28 13:06:25 l75lg1-v1 sudo[99502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) May 28 13:06:26 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ba4c0647-1211-4868-941c-d311536b00f6 tempest-ShareSnapshotMetadataTest-331543469 None] <<< [POST] https://127.0.0.1:40443/api/snapshots/ May 28 13:06:26 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ba4c0647-1211-4868-941c-d311536b00f6 tempest-ShareSnapshotMetadataTest-331543469 None] Bunch(access_path='/.vast_all_snapshots/1000000021_share-snapshot-68fbb134-b425-410b-9f38-abbb38662efb', aggr_phys_estimation=0, cluster='loop75-kfs', created='2024-05-28T13:06:23.728174Z', eta_sec=30819898411.878563, expiration_time='3001-01-19T07:59:58Z', guid='16964cb5-fb4a-4d2d-805e-e5bd4b9b9e2d', id=22, indestructible=False, locked=False, name='share-snapshot-68fbb134-b425-410b-9f38-abbb38662efb', path='/manila/manila-32260cfb-2f6c-471f-8668-cd9a33828137/', policy=None, policy_id=None, protection_policy_id=None, state='SUCCEED', tenant_id=1, tenant_name='default', title='share-snapshot-68fbb134-b425-410b-9f38-abbb38662efb(/manila/manila-32260cfb-2f6c-471f-8668-cd9a33828137/)', type='local', unique_phys_estimation=0, url='https://127.0.0.1:40443/api/snapshots/22/') May 28 13:06:26 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-ba4c0647-1211-4868-941c-d311536b00f6 tempest-ShareSnapshotMetadataTest-331543469 None] --- [POST] https://127.0.0.1:40443/api/snapshots/: Done May 28 13:06:26 l75lg1-v1 sudo[99502]: pam_unix(sudo:session): session closed for user root May 28 13:06:26 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.483s {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:428}} May 28 13:06:26 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:390}} May 28 13:06:26 l75lg1-v1 dstat.sh[49771]: 28-05 13:06:26| 5 1 94 0 0|5502M 1906M 278M 7937M| 19k 66B| 256k 244k|2.00 28.0 |1906 2814 |0.63 0.95 1.00|1.0 0 4.0| 0 0 | 0 2048M| 29 359 0 6 6 May 28 13:06:26 l75lg1-v1 sudo[99505]: vastdata : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 May 28 13:06:26 l75lg1-v1 sudo[99505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) May 28 13:06:26 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-f52b4cd0-d111-493e-bb64-f633afa635b0 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] GET http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/bcfe6ad6-a424-4155-a9b0-6347734f3c3b May 28 13:06:26 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-f52b4cd0-d111-493e-bb64-f633afa635b0 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:06:26 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-f52b4cd0-d111-493e-bb64-f633afa635b0 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Calling method 'ShareSnapshotMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:06:26 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-f52b4cd0-d111-493e-bb64-f633afa635b0 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/bcfe6ad6-a424-4155-a9b0-6347734f3c3b returned with HTTP 200 May 28 13:06:26 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1400/2820] 10.27.203.238 () {64 vars in 1460 bytes} [Tue May 28 13:06:26 2024] GET /share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/bcfe6ad6-a424-4155-a9b0-6347734f3c3b => generated 723 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:06:26 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-87e0019f-4785-4386-8ed3-76c8fba075cb tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] POST http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/bcfe6ad6-a424-4155-a9b0-6347734f3c3b/metadata May 28 13:06:26 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-87e0019f-4785-4386-8ed3-76c8fba075cb tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Action: 'create_metadata', calling method: Controller.__getattribute__..version_select, body: {"metadata": {"key3": "value3", "key4": "value4", "key.5.1": "value.5"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:06:26 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-87e0019f-4785-4386-8ed3-76c8fba075cb tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/bcfe6ad6-a424-4155-a9b0-6347734f3c3b/metadata returned with HTTP 200 May 28 13:06:26 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1421/2821] 10.27.203.238 () {66 vars in 1508 bytes} [Tue May 28 13:06:26 2024] POST /share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/bcfe6ad6-a424-4155-a9b0-6347734f3c3b/metadata => generated 72 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:06:26 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-9c0d990f-adee-4922-8492-ba608457f35b tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] GET http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/bcfe6ad6-a424-4155-a9b0-6347734f3c3b/metadata May 28 13:06:26 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-9c0d990f-adee-4922-8492-ba608457f35b tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:06:26 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-9c0d990f-adee-4922-8492-ba608457f35b tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:06:26 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-9c0d990f-adee-4922-8492-ba608457f35b tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/bcfe6ad6-a424-4155-a9b0-6347734f3c3b/metadata returned with HTTP 200 May 28 13:06:26 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1401/2822] 10.27.203.238 () {64 vars in 1487 bytes} [Tue May 28 13:06:26 2024] GET /share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/bcfe6ad6-a424-4155-a9b0-6347734f3c3b/metadata => generated 72 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:06:26 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-9c0a99d6-cfef-4975-b0e4-e474678f4e09 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] GET http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/bcfe6ad6-a424-4155-a9b0-6347734f3c3b/metadata/key3 May 28 13:06:26 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-9c0a99d6-cfef-4975-b0e4-e474678f4e09 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:06:26 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-9c0a99d6-cfef-4975-b0e4-e474678f4e09 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:06:26 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-9c0a99d6-cfef-4975-b0e4-e474678f4e09 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/bcfe6ad6-a424-4155-a9b0-6347734f3c3b/metadata/key3 returned with HTTP 200 May 28 13:06:26 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1422/2823] 10.27.203.238 () {64 vars in 1502 bytes} [Tue May 28 13:06:26 2024] GET /share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/bcfe6ad6-a424-4155-a9b0-6347734f3c3b/metadata/key3 => generated 28 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:06:26 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-30ede5dd-0e3f-4c41-bdcb-af06f2d2c995 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] GET http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/bcfe6ad6-a424-4155-a9b0-6347734f3c3b/metadata/key4 May 28 13:06:26 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-30ede5dd-0e3f-4c41-bdcb-af06f2d2c995 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:06:26 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-30ede5dd-0e3f-4c41-bdcb-af06f2d2c995 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:06:26 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-30ede5dd-0e3f-4c41-bdcb-af06f2d2c995 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/bcfe6ad6-a424-4155-a9b0-6347734f3c3b/metadata/key4 returned with HTTP 200 May 28 13:06:26 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1402/2824] 10.27.203.238 () {64 vars in 1502 bytes} [Tue May 28 13:06:26 2024] GET /share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/bcfe6ad6-a424-4155-a9b0-6347734f3c3b/metadata/key4 => generated 28 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:06:26 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-e5fc0c4e-cb1f-4fed-8ca6-dccc7dfad596 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] GET http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/bcfe6ad6-a424-4155-a9b0-6347734f3c3b/metadata/key.5.1 May 28 13:06:26 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-e5fc0c4e-cb1f-4fed-8ca6-dccc7dfad596 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:06:26 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-e5fc0c4e-cb1f-4fed-8ca6-dccc7dfad596 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:06:26 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-e5fc0c4e-cb1f-4fed-8ca6-dccc7dfad596 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/bcfe6ad6-a424-4155-a9b0-6347734f3c3b/metadata/key.5.1 returned with HTTP 200 May 28 13:06:26 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1423/2825] 10.27.203.238 () {64 vars in 1511 bytes} [Tue May 28 13:06:26 2024] GET /share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/bcfe6ad6-a424-4155-a9b0-6347734f3c3b/metadata/key.5.1 => generated 32 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:06:26 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-34021373-b623-4133-962a-c1747e9d3a7b tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] DELETE http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/bcfe6ad6-a424-4155-a9b0-6347734f3c3b/metadata/key3 May 28 13:06:26 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-34021373-b623-4133-962a-c1747e9d3a7b tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:06:26 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-34021373-b623-4133-962a-c1747e9d3a7b tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:06:26 l75lg1-v1 sudo[99505]: pam_unix(sudo:session): session closed for user root May 28 13:06:26 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.509s {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:428}} May 28 13:06:26 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:390}} May 28 13:06:26 l75lg1-v1 sudo[99508]: vastdata : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool May 28 13:06:26 l75lg1-v1 sudo[99508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) May 28 13:06:26 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-34021373-b623-4133-962a-c1747e9d3a7b tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/bcfe6ad6-a424-4155-a9b0-6347734f3c3b/metadata/key3 returned with HTTP 200 May 28 13:06:26 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1403/2826] 10.27.203.238 () {64 vars in 1505 bytes} [Tue May 28 13:06:26 2024] DELETE /share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/bcfe6ad6-a424-4155-a9b0-6347734f3c3b/metadata/key3 => generated 0 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 229 bytes (1 switches on core 0) May 28 13:06:26 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-d437cb6c-e6c6-4392-9940-d29ed25790b1 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] DELETE http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/bcfe6ad6-a424-4155-a9b0-6347734f3c3b/metadata/key4 May 28 13:06:26 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-d437cb6c-e6c6-4392-9940-d29ed25790b1 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:06:26 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-d437cb6c-e6c6-4392-9940-d29ed25790b1 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:06:26 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-d437cb6c-e6c6-4392-9940-d29ed25790b1 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/bcfe6ad6-a424-4155-a9b0-6347734f3c3b/metadata/key4 returned with HTTP 200 May 28 13:06:26 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1424/2827] 10.27.203.238 () {64 vars in 1505 bytes} [Tue May 28 13:06:26 2024] DELETE /share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/bcfe6ad6-a424-4155-a9b0-6347734f3c3b/metadata/key4 => generated 0 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 229 bytes (1 switches on core 0) May 28 13:06:26 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-1f4fe4eb-ca50-4288-8164-88b53b8050b3 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] DELETE http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/bcfe6ad6-a424-4155-a9b0-6347734f3c3b/metadata/key.5.1 May 28 13:06:26 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-1f4fe4eb-ca50-4288-8164-88b53b8050b3 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:06:26 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-1f4fe4eb-ca50-4288-8164-88b53b8050b3 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:06:26 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-1f4fe4eb-ca50-4288-8164-88b53b8050b3 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/bcfe6ad6-a424-4155-a9b0-6347734f3c3b/metadata/key.5.1 returned with HTTP 200 May 28 13:06:26 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1404/2828] 10.27.203.238 () {64 vars in 1514 bytes} [Tue May 28 13:06:26 2024] DELETE /share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/bcfe6ad6-a424-4155-a9b0-6347734f3c3b/metadata/key.5.1 => generated 0 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 229 bytes (1 switches on core 0) May 28 13:06:26 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-09cface6-609c-4a5a-848d-6fa2f6880153 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] GET http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/bcfe6ad6-a424-4155-a9b0-6347734f3c3b/metadata May 28 13:06:26 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-09cface6-609c-4a5a-848d-6fa2f6880153 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:06:26 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-09cface6-609c-4a5a-848d-6fa2f6880153 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:06:26 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-09cface6-609c-4a5a-848d-6fa2f6880153 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/bcfe6ad6-a424-4155-a9b0-6347734f3c3b/metadata returned with HTTP 200 May 28 13:06:26 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1425/2829] 10.27.203.238 () {64 vars in 1487 bytes} [Tue May 28 13:06:26 2024] GET /share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/bcfe6ad6-a424-4155-a9b0-6347734f3c3b/metadata => generated 16 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 230 bytes (2 switches on core 0) May 28 13:06:27 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-3ff46ce2-703a-49d4-913b-58a7bd365938 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] DELETE http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/bcfe6ad6-a424-4155-a9b0-6347734f3c3b May 28 13:06:27 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-3ff46ce2-703a-49d4-913b-58a7bd365938 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:06:27 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-3ff46ce2-703a-49d4-913b-58a7bd365938 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Calling method 'ShareSnapshotMixin.delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:06:27 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.v1.share_snapshots [None req-3ff46ce2-703a-49d4-913b-58a7bd365938 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Delete snapshot with id: bcfe6ad6-a424-4155-a9b0-6347734f3c3b May 28 13:06:27 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-3ff46ce2-703a-49d4-913b-58a7bd365938 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/bcfe6ad6-a424-4155-a9b0-6347734f3c3b returned with HTTP 202 May 28 13:06:27 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1405/2830] 10.27.203.238 () {64 vars in 1463 bytes} [Tue May 28 13:06:27 2024] DELETE /share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/bcfe6ad6-a424-4155-a9b0-6347734f3c3b => generated 0 bytes in 98 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 13:06:27 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-9adc8381-194f-4ba9-bae7-e2cbf405e729 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] GET http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/bcfe6ad6-a424-4155-a9b0-6347734f3c3b May 28 13:06:27 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-9adc8381-194f-4ba9-bae7-e2cbf405e729 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:06:27 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-9adc8381-194f-4ba9-bae7-e2cbf405e729 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Calling method 'ShareSnapshotMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:06:27 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-9adc8381-194f-4ba9-bae7-e2cbf405e729 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/bcfe6ad6-a424-4155-a9b0-6347734f3c3b returned with HTTP 200 May 28 13:06:27 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1426/2831] 10.27.203.238 () {64 vars in 1460 bytes} [Tue May 28 13:06:27 2024] GET /share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/bcfe6ad6-a424-4155-a9b0-6347734f3c3b => generated 722 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:06:27 l75lg1-v1 sudo[99508]: pam_unix(sudo:session): session closed for user root May 28 13:06:27 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.489s {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:428}} May 28 13:06:27 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:390}} May 28 13:06:27 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-3ff46ce2-703a-49d4-913b-58a7bd365938 tempest-ShareSnapshotMetadataTest-331543469 None] >>> [GET] https://127.0.0.1:40443/api/snapshots/ May 28 13:06:27 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-3ff46ce2-703a-49d4-913b-58a7bd365938 tempest-ShareSnapshotMetadataTest-331543469 None] {'allow_redirects': True, May 28 13:06:27 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-3ff46ce2-703a-49d4-913b-58a7bd365938 tempest-ShareSnapshotMetadataTest-331543469 None] 'params': {'name': 'share-snapshot-68fbb134-b425-410b-9f38-abbb38662efb'}} May 28 13:06:27 l75lg1-v1 dstat.sh[49771]: 28-05 13:06:27| 17 2 79 1 0|5502M 1906M 278M 7937M| 16k 0 | 639k 1166k|4.99 134 |4706 7069 |0.63 0.95 1.00|2.0 0 6.0| 0 0 | 0 2048M| 29 359 0 6 6 May 28 13:06:27 l75lg1-v1 sudo[99511]: vastdata : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 May 28 13:06:27 l75lg1-v1 sudo[99511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) May 28 13:06:27 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-3ff46ce2-703a-49d4-913b-58a7bd365938 tempest-ShareSnapshotMetadataTest-331543469 None] <<< [GET] https://127.0.0.1:40443/api/snapshots/ May 28 13:06:27 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-3ff46ce2-703a-49d4-913b-58a7bd365938 tempest-ShareSnapshotMetadataTest-331543469 None] [Bunch(access_path='/.vast_all_snapshots/1000000021_share-snapshot-68fbb134-b425-410b-9f38-abbb38662efb', aggr_phys_estimation=0, cluster='loop75-kfs', created='2024-05-28T13:06:23.728174Z', eta_sec=30819898410.446156, expiration_time='3001-01-19T07:59:58Z', guid='16964cb5-fb4a-4d2d-805e-e5bd4b9b9e2d', id=22, indestructible=False, locked=False, name='share-snapshot-68fbb134-b425-410b-9f38-abbb38662efb', path='/manila/manila-32260cfb-2f6c-471f-8668-cd9a33828137/', policy=None, policy_id=None, protection_policy_id=None, state='SUCCEED', tenant_id=1, tenant_name='default', title='share-snapshot-68fbb134-b425-410b-9f38-abbb38662efb(/manila/manila-32260cfb-2f6c-471f-8668-cd9a33828137/)', type='local', unique_phys_estimation=0, url='https://127.0.0.1:40443/api/snapshots/22/')] May 28 13:06:27 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-3ff46ce2-703a-49d4-913b-58a7bd365938 tempest-ShareSnapshotMetadataTest-331543469 None] --- [GET] https://127.0.0.1:40443/api/snapshots/: Done May 28 13:06:27 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-3ff46ce2-703a-49d4-913b-58a7bd365938 tempest-ShareSnapshotMetadataTest-331543469 None] >>> [DELETE] https://127.0.0.1:40443/api/snapshots/22/ May 28 13:06:27 l75lg1-v1 sudo[99511]: pam_unix(sudo:session): session closed for user root May 28 13:06:27 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.475s {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:428}} May 28 13:06:27 l75lg1-v1 cinder-volume[85846]: DEBUG cinder.manager [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] Notifying Schedulers of capabilities ... {{(pid=85846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 28 13:06:27 l75lg1-v1 cinder-scheduler[85128]: DEBUG cinder.scheduler.host_manager [None req-ae88997d-3418-480c-b30f-3595ff34400d None None] Received volume service update from l75lg1-v1@lvmdriver-1: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:l75lg1-v1:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up', 'allocated_capacity_gb': 0, 'cacheable': True}], 'shared_targets': False, 'sparse_copy_volume': True, 'filter_function': None, 'goodness_function': None} {{(pid=85128) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:628}} May 28 13:06:28 l75lg1-v1 dstat.sh[49771]: 28-05 13:06:28| 6 2 91 0 0|5501M 1907M 278M 7937M| 16k 1578B| 256k 144k|2.00 10.0 |2863 4032 |0.66 0.95 1.00|1.0 0 54| 0 0 | 0 2048M| 29 359 0 7 6 May 28 13:06:28 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-3ff46ce2-703a-49d4-913b-58a7bd365938 tempest-ShareSnapshotMetadataTest-331543469 None] <<< [DELETE] https://127.0.0.1:40443/api/snapshots/22/ May 28 13:06:28 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-3ff46ce2-703a-49d4-913b-58a7bd365938 tempest-ShareSnapshotMetadataTest-331543469 None] --- [DELETE] https://127.0.0.1:40443/api/snapshots/22/: Done May 28 13:06:28 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-3ff46ce2-703a-49d4-913b-58a7bd365938 tempest-ShareSnapshotMetadataTest-331543469 None] Created reservations ['706a2040-13a2-4a62-8878-c3422248ae7c', '84562eaa-6eac-41f7-86f4-d77f82a99461', 'dbf1d861-2b47-493a-b4b8-e7e0e5269825', 'f23e5470-15f3-401e-ae7c-7154be10acba'] {{(pid=98474) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 13:06:29 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-3ff46ce2-703a-49d4-913b-58a7bd365938 tempest-ShareSnapshotMetadataTest-331543469 None] Committed reservations ['706a2040-13a2-4a62-8878-c3422248ae7c', '84562eaa-6eac-41f7-86f4-d77f82a99461', 'dbf1d861-2b47-493a-b4b8-e7e0e5269825', 'f23e5470-15f3-401e-ae7c-7154be10acba'] {{(pid=98474) commit /opt/stack/manila/manila/quota.py:1063}} May 28 13:06:29 l75lg1-v1 dstat.sh[49771]: 28-05 13:06:29| 1 0 97 1 0|5502M 1906M 278M 7937M| 19k 66B| 0 533k| 0 90.1 |2264 3573 |0.66 0.95 1.00| 0 0 2.0| 0 0 | 0 2048M| 29 359 0 7 6 May 28 13:06:29 l75lg1-v1 nova-conductor[83647]: DEBUG dbcounter [-] [83647] Writing DB stats nova_cell1:SELECT=1,nova_cell1:UPDATE=1 {{(pid=83647) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:06:30 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-983d46bf-8c37-49a1-928e-6d053cd35552 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] GET http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/bcfe6ad6-a424-4155-a9b0-6347734f3c3b May 28 13:06:30 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-983d46bf-8c37-49a1-928e-6d053cd35552 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:06:30 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-983d46bf-8c37-49a1-928e-6d053cd35552 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Calling method 'ShareSnapshotMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:06:30 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-983d46bf-8c37-49a1-928e-6d053cd35552 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] HTTP exception thrown: The resource could not be found. May 28 13:06:30 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-983d46bf-8c37-49a1-928e-6d053cd35552 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/bcfe6ad6-a424-4155-a9b0-6347734f3c3b returned with HTTP 404 May 28 13:06:30 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1406/2832] 10.27.203.238 () {64 vars in 1460 bytes} [Tue May 28 13:06:30 2024] GET /share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/bcfe6ad6-a424-4155-a9b0-6347734f3c3b => generated 78 bytes in 14 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 13:06:30 l75lg1-v1 nova-conductor[83648]: DEBUG dbcounter [-] [83648] Writing DB stats nova_cell1:SELECT=1 {{(pid=83648) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:06:30 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-08c7f3ad-2409-4a41-9fee-123216b6c7bd tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] POST http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots May 28 13:06:30 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-08c7f3ad-2409-4a41-9fee-123216b6c7bd tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Action: 'create', calling method: ShareSnapshotMixin.create, body: {"snapshot": {"name": "tempest-tempest-created-share-snap-5308437", "force": false, "description": "Tempest's snapshot", "share_id": "41a07ae7-d107-493e-8a00-5ada346ac16c", "metadata": {"key1": "value1", "key2": "value2"}}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:06:30 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.v1.share_snapshots [None req-08c7f3ad-2409-4a41-9fee-123216b6c7bd tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Create snapshot from share 41a07ae7-d107-493e-8a00-5ada346ac16c May 28 13:06:30 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.quota [None req-08c7f3ad-2409-4a41-9fee-123216b6c7bd tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Created reservations ['facacece-044f-45a1-9d94-89d8f5cfcef3', 'a0abf756-246c-4dae-ae7c-b295e800d05f', '8b53b05d-cd6b-4dde-b5ed-b084a58e7f5a', 'd3a6659c-ece5-4ba5-8608-b689a5b8cf58'] {{(pid=98329) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 13:06:30 l75lg1-v1 dstat.sh[49771]: 28-05 13:06:30| 2 1 96 2 0|5502M 1906M 278M 7937M| 18k 4980B| 0 3105k| 0 475 |2501 3981 |0.66 0.95 1.00|3.0 1.0 0| 0 0 | 0 2048M| 29 360 0 6 6 May 28 13:06:30 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.quota [None req-08c7f3ad-2409-4a41-9fee-123216b6c7bd tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Committed reservations ['facacece-044f-45a1-9d94-89d8f5cfcef3', 'a0abf756-246c-4dae-ae7c-b295e800d05f', '8b53b05d-cd6b-4dde-b5ed-b084a58e7f5a', 'd3a6659c-ece5-4ba5-8608-b689a5b8cf58'] {{(pid=98329) commit /opt/stack/manila/manila/quota.py:1063}} May 28 13:06:30 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-08c7f3ad-2409-4a41-9fee-123216b6c7bd tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots returned with HTTP 202 May 28 13:06:30 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1427/2833] 10.27.203.238 () {66 vars in 1371 bytes} [Tue May 28 13:06:30 2024] POST /share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots => generated 754 bytes in 169 msecs (HTTP/1.1 202) 6 headers in 237 bytes (1 switches on core 0) May 28 13:06:30 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-a7ca0c66-8c23-49d9-a257-161a55fdfa09 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] GET http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/b76c2377-c2e9-414f-94fa-fdf937dc8333 May 28 13:06:30 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-a7ca0c66-8c23-49d9-a257-161a55fdfa09 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:06:30 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-a7ca0c66-8c23-49d9-a257-161a55fdfa09 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Calling method 'ShareSnapshotMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:06:30 l75lg1-v1 neutron-server[77618]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.HashRingHealthCheckPeriodics.touch_hash_ring_nodes' {{(pid=77618) _process_scheduled /opt/stack/data/venv/lib/python3.10/site-packages/futurist/periodics.py:638}} May 28 13:06:30 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-a7ca0c66-8c23-49d9-a257-161a55fdfa09 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/b76c2377-c2e9-414f-94fa-fdf937dc8333 returned with HTTP 200 May 28 13:06:30 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1407/2834] 10.27.203.238 () {64 vars in 1460 bytes} [Tue May 28 13:06:30 2024] GET /share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/b76c2377-c2e9-414f-94fa-fdf937dc8333 => generated 754 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:06:30 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-08c7f3ad-2409-4a41-9fee-123216b6c7bd tempest-ShareSnapshotMetadataTest-331543469 None] >>> [POST] https://127.0.0.1:40443/api/snapshots/ May 28 13:06:30 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-08c7f3ad-2409-4a41-9fee-123216b6c7bd tempest-ShareSnapshotMetadataTest-331543469 None] {'data': '{"path": "/manila/manila-32260cfb-2f6c-471f-8668-cd9a33828137", ' May 28 13:06:30 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-08c7f3ad-2409-4a41-9fee-123216b6c7bd tempest-ShareSnapshotMetadataTest-331543469 None] '"name": "share-snapshot-6aa0f1d2-201a-4b6c-ac5c-f204946c5e0b"}', May 28 13:06:30 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-08c7f3ad-2409-4a41-9fee-123216b6c7bd tempest-ShareSnapshotMetadataTest-331543469 None] 'json': None, May 28 13:06:30 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-08c7f3ad-2409-4a41-9fee-123216b6c7bd tempest-ShareSnapshotMetadataTest-331543469 None] 'params': None} May 28 13:06:31 l75lg1-v1 dstat.sh[49771]: 28-05 13:06:31| 2 0 96 1 0|5502M 1906M 278M 7937M| 21k 1080B| 0 444k| 0 68.0 |2521 3906 |0.66 0.95 1.00| 0 0 0| 0 0 | 0 2048M| 29 359 0 6 6 May 28 13:06:32 l75lg1-v1 dstat.sh[49771]: 28-05 13:06:32| 1 0 98 1 0|5502M 1906M 278M 7937M| 17k 0 | 0 808k| 0 103 |2192 3513 |0.66 0.95 1.00|1.0 0 0| 0 0 | 0 2048M| 29 359 0 6 6 May 28 13:06:32 l75lg1-v1 manila-share[98474]: DEBUG dbcounter [-] [98474] Writing DB stats manila:INSERT=22,manila:SELECT=400,manila:UPDATE=41 {{(pid=98474) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:06:33 l75lg1-v1 dstat.sh[49771]: 28-05 13:06:33| 1 0 98 0 0|5502M 1906M 278M 7937M| 16k 0 | 0 388k| 0 56.0 |1850 2894 |0.60 0.93 0.99|1.0 0 0| 0 0 | 0 2048M| 29 359 0 6 6 May 28 13:06:33 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-d867ccea-bede-4452-b6b5-8c6692b7a6dd tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] GET http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/b76c2377-c2e9-414f-94fa-fdf937dc8333 May 28 13:06:33 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-d867ccea-bede-4452-b6b5-8c6692b7a6dd tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:06:33 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-d867ccea-bede-4452-b6b5-8c6692b7a6dd tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Calling method 'ShareSnapshotMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:06:33 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-d867ccea-bede-4452-b6b5-8c6692b7a6dd tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/b76c2377-c2e9-414f-94fa-fdf937dc8333 returned with HTTP 200 May 28 13:06:33 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1428/2835] 10.27.203.238 () {64 vars in 1460 bytes} [Tue May 28 13:06:33 2024] GET /share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/b76c2377-c2e9-414f-94fa-fdf937dc8333 => generated 754 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:06:33 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-08c7f3ad-2409-4a41-9fee-123216b6c7bd tempest-ShareSnapshotMetadataTest-331543469 None] <<< [POST] https://127.0.0.1:40443/api/snapshots/ May 28 13:06:33 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-08c7f3ad-2409-4a41-9fee-123216b6c7bd tempest-ShareSnapshotMetadataTest-331543469 None] Bunch(access_path='/.vast_all_snapshots/1000000022_share-snapshot-6aa0f1d2-201a-4b6c-ac5c-f204946c5e0b', aggr_phys_estimation=0, cluster='loop75-kfs', created='2024-05-28T13:06:31.048280Z', eta_sec=30819898404.269077, expiration_time='3001-01-19T07:59:58Z', guid='76fb345e-5dc1-4c02-81a7-2d5f40bf5321', id=23, indestructible=False, locked=False, name='share-snapshot-6aa0f1d2-201a-4b6c-ac5c-f204946c5e0b', path='/manila/manila-32260cfb-2f6c-471f-8668-cd9a33828137/', policy=None, policy_id=None, protection_policy_id=None, state='SUCCEED', tenant_id=1, tenant_name='default', title='share-snapshot-6aa0f1d2-201a-4b6c-ac5c-f204946c5e0b(/manila/manila-32260cfb-2f6c-471f-8668-cd9a33828137/)', type='local', unique_phys_estimation=0, url='https://127.0.0.1:40443/api/snapshots/23/') May 28 13:06:33 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-08c7f3ad-2409-4a41-9fee-123216b6c7bd tempest-ShareSnapshotMetadataTest-331543469 None] --- [POST] https://127.0.0.1:40443/api/snapshots/: Done May 28 13:06:34 l75lg1-v1 dstat.sh[49771]: 28-05 13:06:34| 1 0 98 0 0|5501M 1906M 278M 7938M| 24k 66B| 0 320k| 0 37.0 |1968 3139 |0.60 0.93 0.99|1.0 0 0| 0 0 | 0 2048M| 29 359 0 6 6 May 28 13:06:35 l75lg1-v1 dstat.sh[49771]: 28-05 13:06:35| 1 0 99 0 0|5501M 1906M 278M 7938M| 17k 0 | 0 232k| 0 19.0 |1424 2227 |0.60 0.93 0.99|1.0 0 0| 0 0 | 0 2048M| 29 359 0 6 6 May 28 13:06:36 l75lg1-v1 manila-scheduler[98327]: DEBUG oslo_service.periodic_task [None req-51f4229a-f349-47fa-92eb-6fc5f8342c9d None None] Running periodic task SchedulerManager._expire_reservations {{(pid=98327) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 13:06:36 l75lg1-v1 dstat.sh[49771]: 28-05 13:06:36| 1 0 99 0 0|5502M 1906M 278M 7938M| 12k 0 | 0 276k| 0 22.0 |1533 2440 |0.60 0.93 0.99|1.0 0 0| 0 0 | 0 2048M| 29 359 0 6 6 May 28 13:06:36 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-97ac0edd-5c79-43fa-9b49-8be47417122f tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] GET http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/b76c2377-c2e9-414f-94fa-fdf937dc8333 May 28 13:06:36 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-97ac0edd-5c79-43fa-9b49-8be47417122f tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:06:36 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-97ac0edd-5c79-43fa-9b49-8be47417122f tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Calling method 'ShareSnapshotMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:06:36 l75lg1-v1 devstack@m-api.service[98330]: DEBUG dbcounter [-] [98330] Writing DB stats manila:SELECT=363,manila:UPDATE=29,manila:INSERT=34 {{(pid=98330) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:06:36 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-97ac0edd-5c79-43fa-9b49-8be47417122f tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/b76c2377-c2e9-414f-94fa-fdf937dc8333 returned with HTTP 200 May 28 13:06:36 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1408/2836] 10.27.203.238 () {64 vars in 1460 bytes} [Tue May 28 13:06:36 2024] GET /share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/b76c2377-c2e9-414f-94fa-fdf937dc8333 => generated 755 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:06:36 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-9a376aea-4dcd-4e72-ab67-f4ee8077374e tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] GET http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/b76c2377-c2e9-414f-94fa-fdf937dc8333/metadata May 28 13:06:36 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-9a376aea-4dcd-4e72-ab67-f4ee8077374e tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:06:36 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-9a376aea-4dcd-4e72-ab67-f4ee8077374e tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:06:36 l75lg1-v1 devstack@m-api.service[98329]: DEBUG dbcounter [-] [98329] Writing DB stats manila:SELECT=264,manila:UPDATE=16,manila:INSERT=16 {{(pid=98329) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:06:36 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-9a376aea-4dcd-4e72-ab67-f4ee8077374e tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/b76c2377-c2e9-414f-94fa-fdf937dc8333/metadata returned with HTTP 200 May 28 13:06:36 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1429/2837] 10.27.203.238 () {64 vars in 1487 bytes} [Tue May 28 13:06:36 2024] GET /share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/b76c2377-c2e9-414f-94fa-fdf937dc8333/metadata => generated 50 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:06:36 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-07d674ca-ef06-404a-aed8-89de0e42d0b6 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] GET http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/b76c2377-c2e9-414f-94fa-fdf937dc8333/metadata/key1 May 28 13:06:36 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-07d674ca-ef06-404a-aed8-89de0e42d0b6 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:06:36 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-07d674ca-ef06-404a-aed8-89de0e42d0b6 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:06:36 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-07d674ca-ef06-404a-aed8-89de0e42d0b6 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/b76c2377-c2e9-414f-94fa-fdf937dc8333/metadata/key1 returned with HTTP 200 May 28 13:06:36 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1409/2838] 10.27.203.238 () {64 vars in 1502 bytes} [Tue May 28 13:06:36 2024] GET /share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/b76c2377-c2e9-414f-94fa-fdf937dc8333/metadata/key1 => generated 28 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:06:36 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-36cae79d-2a68-4531-8afa-08f00433e749 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] GET http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/b76c2377-c2e9-414f-94fa-fdf937dc8333/metadata/key2 May 28 13:06:36 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-36cae79d-2a68-4531-8afa-08f00433e749 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:06:36 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-36cae79d-2a68-4531-8afa-08f00433e749 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:06:36 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-36cae79d-2a68-4531-8afa-08f00433e749 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/b76c2377-c2e9-414f-94fa-fdf937dc8333/metadata/key2 returned with HTTP 200 May 28 13:06:36 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1430/2839] 10.27.203.238 () {64 vars in 1502 bytes} [Tue May 28 13:06:36 2024] GET /share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/b76c2377-c2e9-414f-94fa-fdf937dc8333/metadata/key2 => generated 28 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:06:36 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-d0e349f2-7840-4ca9-8763-9c48aa956555 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] DELETE http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/b76c2377-c2e9-414f-94fa-fdf937dc8333 May 28 13:06:36 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-d0e349f2-7840-4ca9-8763-9c48aa956555 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:06:36 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-d0e349f2-7840-4ca9-8763-9c48aa956555 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Calling method 'ShareSnapshotMixin.delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:06:36 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.v1.share_snapshots [None req-d0e349f2-7840-4ca9-8763-9c48aa956555 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Delete snapshot with id: b76c2377-c2e9-414f-94fa-fdf937dc8333 May 28 13:06:36 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-d0e349f2-7840-4ca9-8763-9c48aa956555 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/b76c2377-c2e9-414f-94fa-fdf937dc8333 returned with HTTP 202 May 28 13:06:36 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1410/2840] 10.27.203.238 () {64 vars in 1463 bytes} [Tue May 28 13:06:36 2024] DELETE /share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/b76c2377-c2e9-414f-94fa-fdf937dc8333 => generated 0 bytes in 93 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 13:06:36 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-8b5d393c-3940-497c-b2ac-66f95ac2a66f tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] GET http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/b76c2377-c2e9-414f-94fa-fdf937dc8333 May 28 13:06:36 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-8b5d393c-3940-497c-b2ac-66f95ac2a66f tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:06:36 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-8b5d393c-3940-497c-b2ac-66f95ac2a66f tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Calling method 'ShareSnapshotMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:06:36 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-8b5d393c-3940-497c-b2ac-66f95ac2a66f tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/b76c2377-c2e9-414f-94fa-fdf937dc8333 returned with HTTP 200 May 28 13:06:36 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1431/2841] 10.27.203.238 () {64 vars in 1460 bytes} [Tue May 28 13:06:36 2024] GET /share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/b76c2377-c2e9-414f-94fa-fdf937dc8333 => generated 754 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:06:36 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d0e349f2-7840-4ca9-8763-9c48aa956555 tempest-ShareSnapshotMetadataTest-331543469 None] >>> [GET] https://127.0.0.1:40443/api/snapshots/ May 28 13:06:36 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d0e349f2-7840-4ca9-8763-9c48aa956555 tempest-ShareSnapshotMetadataTest-331543469 None] {'allow_redirects': True, May 28 13:06:36 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d0e349f2-7840-4ca9-8763-9c48aa956555 tempest-ShareSnapshotMetadataTest-331543469 None] 'params': {'name': 'share-snapshot-6aa0f1d2-201a-4b6c-ac5c-f204946c5e0b'}} May 28 13:06:37 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d0e349f2-7840-4ca9-8763-9c48aa956555 tempest-ShareSnapshotMetadataTest-331543469 None] <<< [GET] https://127.0.0.1:40443/api/snapshots/ May 28 13:06:37 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d0e349f2-7840-4ca9-8763-9c48aa956555 tempest-ShareSnapshotMetadataTest-331543469 None] [Bunch(access_path='/.vast_all_snapshots/1000000022_share-snapshot-6aa0f1d2-201a-4b6c-ac5c-f204946c5e0b', aggr_phys_estimation=0, cluster='loop75-kfs', created='2024-05-28T13:06:31.048280Z', eta_sec=30819898400.829887, expiration_time='3001-01-19T07:59:58Z', guid='76fb345e-5dc1-4c02-81a7-2d5f40bf5321', id=23, indestructible=False, locked=False, name='share-snapshot-6aa0f1d2-201a-4b6c-ac5c-f204946c5e0b', path='/manila/manila-32260cfb-2f6c-471f-8668-cd9a33828137/', policy=None, policy_id=None, protection_policy_id=None, state='SUCCEED', tenant_id=1, tenant_name='default', title='share-snapshot-6aa0f1d2-201a-4b6c-ac5c-f204946c5e0b(/manila/manila-32260cfb-2f6c-471f-8668-cd9a33828137/)', type='local', unique_phys_estimation=0, url='https://127.0.0.1:40443/api/snapshots/23/')] May 28 13:06:37 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d0e349f2-7840-4ca9-8763-9c48aa956555 tempest-ShareSnapshotMetadataTest-331543469 None] --- [GET] https://127.0.0.1:40443/api/snapshots/: Done May 28 13:06:37 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d0e349f2-7840-4ca9-8763-9c48aa956555 tempest-ShareSnapshotMetadataTest-331543469 None] >>> [DELETE] https://127.0.0.1:40443/api/snapshots/23/ May 28 13:06:37 l75lg1-v1 dstat.sh[49771]: 28-05 13:06:37| 5 0 93 1 0|5502M 1906M 278M 7938M| 12k 1405B| 0 1251k| 0 124 |3002 4733 |0.60 0.93 0.99|1.0 0 0| 0 0 | 0 2048M| 29 359 0 6 6 May 28 13:06:38 l75lg1-v1 dstat.sh[49771]: 28-05 13:06:38| 0 0 99 0 0|5502M 1906M 278M 7938M| 16k 0 | 0 284k| 0 33.0 |1586 2525 |0.56 0.92 0.99| 0 0 0| 0 0 | 0 2048M| 29 359 0 6 6 May 28 13:06:38 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d0e349f2-7840-4ca9-8763-9c48aa956555 tempest-ShareSnapshotMetadataTest-331543469 None] <<< [DELETE] https://127.0.0.1:40443/api/snapshots/23/ May 28 13:06:38 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d0e349f2-7840-4ca9-8763-9c48aa956555 tempest-ShareSnapshotMetadataTest-331543469 None] --- [DELETE] https://127.0.0.1:40443/api/snapshots/23/: Done May 28 13:06:38 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-d0e349f2-7840-4ca9-8763-9c48aa956555 tempest-ShareSnapshotMetadataTest-331543469 None] Created reservations ['6f32a68d-9951-4ad4-8647-7ea13ae99e49', '52a8aaf5-c8e1-4346-81a6-e83da3cb3a68', 'ec394796-4b71-4875-8165-2c1980696b6a', '479ce888-fd33-469a-a34d-7c36b0fc5989'] {{(pid=98474) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 13:06:38 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-d0e349f2-7840-4ca9-8763-9c48aa956555 tempest-ShareSnapshotMetadataTest-331543469 None] Committed reservations ['6f32a68d-9951-4ad4-8647-7ea13ae99e49', '52a8aaf5-c8e1-4346-81a6-e83da3cb3a68', 'ec394796-4b71-4875-8165-2c1980696b6a', '479ce888-fd33-469a-a34d-7c36b0fc5989'] {{(pid=98474) commit /opt/stack/manila/manila/quota.py:1063}} May 28 13:06:39 l75lg1-v1 dstat.sh[49771]: 28-05 13:06:39| 2 1 97 1 0|5502M 1906M 278M 7938M| 19k 238B| 0 484k| 0 78.0 |2274 3660 |0.56 0.92 0.99| 0 0 2.0| 0 0 | 0 2048M| 29 359 0 6 6 May 28 13:06:39 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-70c22749-6577-43f0-a86b-b5acb2581fe6 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] GET http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/b76c2377-c2e9-414f-94fa-fdf937dc8333 May 28 13:06:39 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-70c22749-6577-43f0-a86b-b5acb2581fe6 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:06:39 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-70c22749-6577-43f0-a86b-b5acb2581fe6 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Calling method 'ShareSnapshotMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:06:39 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-70c22749-6577-43f0-a86b-b5acb2581fe6 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] HTTP exception thrown: The resource could not be found. May 28 13:06:39 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-70c22749-6577-43f0-a86b-b5acb2581fe6 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/b76c2377-c2e9-414f-94fa-fdf937dc8333 returned with HTTP 404 May 28 13:06:39 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1411/2842] 10.27.203.238 () {64 vars in 1460 bytes} [Tue May 28 13:06:39 2024] GET /share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/b76c2377-c2e9-414f-94fa-fdf937dc8333 => generated 78 bytes in 18 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 13:06:39 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-c43bebf3-7941-4c23-ae9e-71b6e53d8065 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] POST http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots May 28 13:06:39 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-c43bebf3-7941-4c23-ae9e-71b6e53d8065 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Action: 'create', calling method: ShareSnapshotMixin.create, body: {"snapshot": {"name": "tempest-tempest-created-share-snap-522618292", "force": false, "description": "Tempest's snapshot", "share_id": "41a07ae7-d107-493e-8a00-5ada346ac16c"}} {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:06:39 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.v1.share_snapshots [None req-c43bebf3-7941-4c23-ae9e-71b6e53d8065 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Create snapshot from share 41a07ae7-d107-493e-8a00-5ada346ac16c May 28 13:06:39 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.quota [None req-c43bebf3-7941-4c23-ae9e-71b6e53d8065 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Created reservations ['a9c78093-731e-4455-8bd2-bd4e3c0e62ad', 'c757704b-5b04-4a04-ac05-1f71219d7fe3', '30ba56f7-8589-45fc-8061-d90f454c1acc', '0820f560-ac95-4a34-9a1c-bb51494c0995'] {{(pid=98329) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 13:06:39 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.quota [None req-c43bebf3-7941-4c23-ae9e-71b6e53d8065 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Committed reservations ['a9c78093-731e-4455-8bd2-bd4e3c0e62ad', 'c757704b-5b04-4a04-ac05-1f71219d7fe3', '30ba56f7-8589-45fc-8061-d90f454c1acc', '0820f560-ac95-4a34-9a1c-bb51494c0995'] {{(pid=98329) commit /opt/stack/manila/manila/quota.py:1063}} May 28 13:06:39 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-c43bebf3-7941-4c23-ae9e-71b6e53d8065 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots returned with HTTP 202 May 28 13:06:39 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1432/2843] 10.27.203.238 () {66 vars in 1371 bytes} [Tue May 28 13:06:39 2024] POST /share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots => generated 722 bytes in 196 msecs (HTTP/1.1 202) 6 headers in 237 bytes (1 switches on core 0) May 28 13:06:39 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-7dc00bca-e9f0-49ca-bdaf-131425bf1007 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] GET http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/9a84aca1-9802-48cc-87ee-9d3930f27b3c May 28 13:06:39 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-7dc00bca-e9f0-49ca-bdaf-131425bf1007 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:06:39 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-7dc00bca-e9f0-49ca-bdaf-131425bf1007 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Calling method 'ShareSnapshotMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:06:40 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-7dc00bca-e9f0-49ca-bdaf-131425bf1007 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/9a84aca1-9802-48cc-87ee-9d3930f27b3c returned with HTTP 200 May 28 13:06:40 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1412/2844] 10.27.203.238 () {64 vars in 1460 bytes} [Tue May 28 13:06:39 2024] GET /share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/9a84aca1-9802-48cc-87ee-9d3930f27b3c => generated 722 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:06:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c43bebf3-7941-4c23-ae9e-71b6e53d8065 tempest-ShareSnapshotMetadataTest-331543469 None] >>> [POST] https://127.0.0.1:40443/api/snapshots/ May 28 13:06:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c43bebf3-7941-4c23-ae9e-71b6e53d8065 tempest-ShareSnapshotMetadataTest-331543469 None] {'data': '{"path": "/manila/manila-32260cfb-2f6c-471f-8668-cd9a33828137", ' May 28 13:06:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c43bebf3-7941-4c23-ae9e-71b6e53d8065 tempest-ShareSnapshotMetadataTest-331543469 None] '"name": "share-snapshot-96deb36f-d8e8-43b6-bb66-e3b660729c42"}', May 28 13:06:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c43bebf3-7941-4c23-ae9e-71b6e53d8065 tempest-ShareSnapshotMetadataTest-331543469 None] 'json': None, May 28 13:06:40 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c43bebf3-7941-4c23-ae9e-71b6e53d8065 tempest-ShareSnapshotMetadataTest-331543469 None] 'params': None} May 28 13:06:40 l75lg1-v1 nova-conductor[83648]: DEBUG dbcounter [-] [83648] Writing DB stats nova_cell1:SELECT=1 {{(pid=83648) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:06:40 l75lg1-v1 dstat.sh[49771]: 28-05 13:06:40| 3 0 95 1 0|5502M 1906M 278M 7938M| 19k 4566B| 0 1496k| 0 297 |2763 4384 |0.56 0.92 0.99|1.0 0 0| 0 0 | 0 2048M| 29 359 0 6 6 May 28 13:06:40 l75lg1-v1 neutron-server[77618]: DEBUG dbcounter [-] [77618] Writing DB stats neutron:UPDATE=1 {{(pid=77618) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:06:40 l75lg1-v1 neutron-server[77618]: DEBUG dbcounter [-] [77618] Writing DB stats neutron:SELECT=1 {{(pid=77618) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:06:41 l75lg1-v1 dstat.sh[49771]: 28-05 13:06:41| 1 0 98 0 0|5502M 1906M 278M 7938M| 25k 0 | 0 220k| 0 22.0 |1639 2315 |0.56 0.92 0.99| 0 0 0| 0 0 | 0 2048M| 29 359 0 6 6 May 28 13:06:41 l75lg1-v1 manila-data[98318]: DEBUG dbcounter [-] [98318] Writing DB stats manila:SELECT=30,manila:UPDATE=7 {{(pid=98318) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:06:41 l75lg1-v1 nova-scheduler[81196]: DEBUG dbcounter [-] [81196] Writing DB stats nova_cell0:SELECT=1,nova_cell0:UPDATE=1 {{(pid=81196) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:06:41 l75lg1-v1 nova-scheduler[81194]: DEBUG dbcounter [-] [81194] Writing DB stats nova_cell0:SELECT=1 {{(pid=81194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:06:42 l75lg1-v1 dstat.sh[49771]: 28-05 13:06:42| 2 0 98 1 0|5502M 1906M 278M 7938M| 20k 0 | 0 440k| 0 64.0 |2218 3365 |0.56 0.92 0.99|1.0 0 0| 0 0 | 0 2048M| 29 359 0 6 6 May 28 13:06:42 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c43bebf3-7941-4c23-ae9e-71b6e53d8065 tempest-ShareSnapshotMetadataTest-331543469 None] <<< [POST] https://127.0.0.1:40443/api/snapshots/ May 28 13:06:42 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c43bebf3-7941-4c23-ae9e-71b6e53d8065 tempest-ShareSnapshotMetadataTest-331543469 None] Bunch(access_path='/.vast_all_snapshots/1000000023_share-snapshot-96deb36f-d8e8-43b6-bb66-e3b660729c42', aggr_phys_estimation=0, cluster='loop75-kfs', created='2024-05-28T13:06:40.393186Z', eta_sec=30819898395.30092, expiration_time='3001-01-19T07:59:58Z', guid='6b5004c2-3ce8-4ccf-a380-88cf62fcc5ec', id=24, indestructible=False, locked=False, name='share-snapshot-96deb36f-d8e8-43b6-bb66-e3b660729c42', path='/manila/manila-32260cfb-2f6c-471f-8668-cd9a33828137/', policy=None, policy_id=None, protection_policy_id=None, state='SUCCEED', tenant_id=1, tenant_name='default', title='share-snapshot-96deb36f-d8e8-43b6-bb66-e3b660729c42(/manila/manila-32260cfb-2f6c-471f-8668-cd9a33828137/)', type='local', unique_phys_estimation=0, url='https://127.0.0.1:40443/api/snapshots/24/') May 28 13:06:42 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c43bebf3-7941-4c23-ae9e-71b6e53d8065 tempest-ShareSnapshotMetadataTest-331543469 None] --- [POST] https://127.0.0.1:40443/api/snapshots/: Done May 28 13:06:43 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-a9560713-d21b-48d9-ba20-e3629831095f tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] GET http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/9a84aca1-9802-48cc-87ee-9d3930f27b3c May 28 13:06:43 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-a9560713-d21b-48d9-ba20-e3629831095f tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:06:43 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-a9560713-d21b-48d9-ba20-e3629831095f tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Calling method 'ShareSnapshotMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:06:43 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-a9560713-d21b-48d9-ba20-e3629831095f tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/9a84aca1-9802-48cc-87ee-9d3930f27b3c returned with HTTP 200 May 28 13:06:43 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1433/2845] 10.27.203.238 () {64 vars in 1460 bytes} [Tue May 28 13:06:43 2024] GET /share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/9a84aca1-9802-48cc-87ee-9d3930f27b3c => generated 723 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:06:43 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-9dc65bf8-0b79-4415-a774-c0c8b868f7d9 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] POST http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/9a84aca1-9802-48cc-87ee-9d3930f27b3c/metadata May 28 13:06:43 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-9dc65bf8-0b79-4415-a774-c0c8b868f7d9 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Action: 'create_metadata', calling method: Controller.__getattribute__..version_select, body: {"metadata": {"key9": "value9", "key10": "value10"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:06:43 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-9dc65bf8-0b79-4415-a774-c0c8b868f7d9 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/9a84aca1-9802-48cc-87ee-9d3930f27b3c/metadata returned with HTTP 200 May 28 13:06:43 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1413/2846] 10.27.203.238 () {66 vars in 1508 bytes} [Tue May 28 13:06:43 2024] POST /share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/9a84aca1-9802-48cc-87ee-9d3930f27b3c/metadata => generated 52 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:06:43 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-c2f90d23-374e-47c6-bd03-74e9131c10d6 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] GET http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/9a84aca1-9802-48cc-87ee-9d3930f27b3c/metadata May 28 13:06:43 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-c2f90d23-374e-47c6-bd03-74e9131c10d6 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:06:43 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-c2f90d23-374e-47c6-bd03-74e9131c10d6 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:06:43 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-c2f90d23-374e-47c6-bd03-74e9131c10d6 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/9a84aca1-9802-48cc-87ee-9d3930f27b3c/metadata returned with HTTP 200 May 28 13:06:43 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1434/2847] 10.27.203.238 () {64 vars in 1487 bytes} [Tue May 28 13:06:43 2024] GET /share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/9a84aca1-9802-48cc-87ee-9d3930f27b3c/metadata => generated 52 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:06:43 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-c86a1baa-bac9-47a1-b9c6-1e9b2035f7c4 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] GET http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/9a84aca1-9802-48cc-87ee-9d3930f27b3c/metadata/key9 May 28 13:06:43 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-c86a1baa-bac9-47a1-b9c6-1e9b2035f7c4 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:06:43 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-c86a1baa-bac9-47a1-b9c6-1e9b2035f7c4 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:06:43 l75lg1-v1 dstat.sh[49771]: 28-05 13:06:43| 3 0 95 1 0|5502M 1906M 278M 7938M| 17k 66B| 0 1420k| 0 135 |2777 4428 |0.51 0.90 0.98|2.0 1.0 0| 0 0 | 0 2048M| 29 360 0 6 6 May 28 13:06:43 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-c86a1baa-bac9-47a1-b9c6-1e9b2035f7c4 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/9a84aca1-9802-48cc-87ee-9d3930f27b3c/metadata/key9 returned with HTTP 200 May 28 13:06:43 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1414/2848] 10.27.203.238 () {64 vars in 1502 bytes} [Tue May 28 13:06:43 2024] GET /share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/9a84aca1-9802-48cc-87ee-9d3930f27b3c/metadata/key9 => generated 28 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:06:43 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-dedb2634-658c-42d8-9479-eeccc38485dc tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] GET http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/9a84aca1-9802-48cc-87ee-9d3930f27b3c/metadata/key10 May 28 13:06:43 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-dedb2634-658c-42d8-9479-eeccc38485dc tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:06:43 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-dedb2634-658c-42d8-9479-eeccc38485dc tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:06:43 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-dedb2634-658c-42d8-9479-eeccc38485dc tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/9a84aca1-9802-48cc-87ee-9d3930f27b3c/metadata/key10 returned with HTTP 200 May 28 13:06:43 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1435/2849] 10.27.203.238 () {64 vars in 1505 bytes} [Tue May 28 13:06:43 2024] GET /share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/9a84aca1-9802-48cc-87ee-9d3930f27b3c/metadata/key10 => generated 30 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:06:43 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-8549a74e-e5d7-457b-aaf6-adc6615a34d8 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] POST http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/9a84aca1-9802-48cc-87ee-9d3930f27b3c/metadata May 28 13:06:43 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-8549a74e-e5d7-457b-aaf6-adc6615a34d8 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Action: 'create_metadata', calling method: Controller.__getattribute__..version_select, body: {"metadata": {"key9": "value13", "key11": "value11"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:06:43 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-8549a74e-e5d7-457b-aaf6-adc6615a34d8 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/9a84aca1-9802-48cc-87ee-9d3930f27b3c/metadata returned with HTTP 200 May 28 13:06:43 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1415/2850] 10.27.203.238 () {66 vars in 1508 bytes} [Tue May 28 13:06:43 2024] POST /share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/9a84aca1-9802-48cc-87ee-9d3930f27b3c/metadata => generated 53 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:06:43 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-467b3961-373a-426c-b63f-95605c81813c tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] GET http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/9a84aca1-9802-48cc-87ee-9d3930f27b3c/metadata May 28 13:06:43 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-467b3961-373a-426c-b63f-95605c81813c tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:06:43 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-467b3961-373a-426c-b63f-95605c81813c tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:06:43 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-467b3961-373a-426c-b63f-95605c81813c tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/9a84aca1-9802-48cc-87ee-9d3930f27b3c/metadata returned with HTTP 200 May 28 13:06:43 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1436/2851] 10.27.203.238 () {64 vars in 1487 bytes} [Tue May 28 13:06:43 2024] GET /share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/9a84aca1-9802-48cc-87ee-9d3930f27b3c/metadata => generated 73 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:06:43 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-1904a8d0-19f1-4414-8a17-1d86e186a4c1 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] GET http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/9a84aca1-9802-48cc-87ee-9d3930f27b3c/metadata/key9 May 28 13:06:43 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-1904a8d0-19f1-4414-8a17-1d86e186a4c1 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:06:43 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-1904a8d0-19f1-4414-8a17-1d86e186a4c1 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:06:43 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-1904a8d0-19f1-4414-8a17-1d86e186a4c1 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/9a84aca1-9802-48cc-87ee-9d3930f27b3c/metadata/key9 returned with HTTP 200 May 28 13:06:43 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1416/2852] 10.27.203.238 () {64 vars in 1502 bytes} [Tue May 28 13:06:43 2024] GET /share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/9a84aca1-9802-48cc-87ee-9d3930f27b3c/metadata/key9 => generated 29 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:06:43 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-31f2a5b2-6630-4d20-9599-b594ae25a913 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] GET http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/9a84aca1-9802-48cc-87ee-9d3930f27b3c/metadata/key10 May 28 13:06:43 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-31f2a5b2-6630-4d20-9599-b594ae25a913 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:06:43 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-31f2a5b2-6630-4d20-9599-b594ae25a913 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:06:43 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-31f2a5b2-6630-4d20-9599-b594ae25a913 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/9a84aca1-9802-48cc-87ee-9d3930f27b3c/metadata/key10 returned with HTTP 200 May 28 13:06:43 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1437/2853] 10.27.203.238 () {64 vars in 1505 bytes} [Tue May 28 13:06:43 2024] GET /share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/9a84aca1-9802-48cc-87ee-9d3930f27b3c/metadata/key10 => generated 30 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:06:43 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-4d31b7b9-7676-4b78-902e-7b3c64503833 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] GET http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/9a84aca1-9802-48cc-87ee-9d3930f27b3c/metadata/key11 May 28 13:06:43 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-4d31b7b9-7676-4b78-902e-7b3c64503833 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:06:43 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-4d31b7b9-7676-4b78-902e-7b3c64503833 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:06:43 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-4d31b7b9-7676-4b78-902e-7b3c64503833 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/9a84aca1-9802-48cc-87ee-9d3930f27b3c/metadata/key11 returned with HTTP 200 May 28 13:06:43 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1417/2854] 10.27.203.238 () {64 vars in 1505 bytes} [Tue May 28 13:06:43 2024] GET /share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/9a84aca1-9802-48cc-87ee-9d3930f27b3c/metadata/key11 => generated 30 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:06:43 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-09bbcec1-6630-4345-89c8-384eb2311a21 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] DELETE http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/9a84aca1-9802-48cc-87ee-9d3930f27b3c/metadata/key9 May 28 13:06:43 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-09bbcec1-6630-4345-89c8-384eb2311a21 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:06:43 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-09bbcec1-6630-4345-89c8-384eb2311a21 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:06:43 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-09bbcec1-6630-4345-89c8-384eb2311a21 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/9a84aca1-9802-48cc-87ee-9d3930f27b3c/metadata/key9 returned with HTTP 200 May 28 13:06:43 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1438/2855] 10.27.203.238 () {64 vars in 1505 bytes} [Tue May 28 13:06:43 2024] DELETE /share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/9a84aca1-9802-48cc-87ee-9d3930f27b3c/metadata/key9 => generated 0 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 229 bytes (1 switches on core 0) May 28 13:06:43 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-ff5f6997-f45f-43d2-8e2e-7c032917c1fc tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] DELETE http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/9a84aca1-9802-48cc-87ee-9d3930f27b3c/metadata/key10 May 28 13:06:43 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-ff5f6997-f45f-43d2-8e2e-7c032917c1fc tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:06:43 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-ff5f6997-f45f-43d2-8e2e-7c032917c1fc tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:06:43 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-ff5f6997-f45f-43d2-8e2e-7c032917c1fc tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/9a84aca1-9802-48cc-87ee-9d3930f27b3c/metadata/key10 returned with HTTP 200 May 28 13:06:43 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1418/2856] 10.27.203.238 () {64 vars in 1508 bytes} [Tue May 28 13:06:43 2024] DELETE /share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/9a84aca1-9802-48cc-87ee-9d3930f27b3c/metadata/key10 => generated 0 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 229 bytes (1 switches on core 0) May 28 13:06:43 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-be4689c0-f70c-4f40-89ec-21b63edd67c2 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] DELETE http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/9a84aca1-9802-48cc-87ee-9d3930f27b3c/metadata/key11 May 28 13:06:43 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-be4689c0-f70c-4f40-89ec-21b63edd67c2 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:06:43 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-be4689c0-f70c-4f40-89ec-21b63edd67c2 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:06:44 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-be4689c0-f70c-4f40-89ec-21b63edd67c2 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/9a84aca1-9802-48cc-87ee-9d3930f27b3c/metadata/key11 returned with HTTP 200 May 28 13:06:44 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1439/2857] 10.27.203.238 () {64 vars in 1508 bytes} [Tue May 28 13:06:43 2024] DELETE /share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/9a84aca1-9802-48cc-87ee-9d3930f27b3c/metadata/key11 => generated 0 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 229 bytes (1 switches on core 0) May 28 13:06:44 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-6c18a564-b0ca-4888-8fc2-f5e45fd557f6 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] GET http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/9a84aca1-9802-48cc-87ee-9d3930f27b3c/metadata May 28 13:06:44 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-6c18a564-b0ca-4888-8fc2-f5e45fd557f6 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:06:44 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-6c18a564-b0ca-4888-8fc2-f5e45fd557f6 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:06:44 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-6c18a564-b0ca-4888-8fc2-f5e45fd557f6 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/9a84aca1-9802-48cc-87ee-9d3930f27b3c/metadata returned with HTTP 200 May 28 13:06:44 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1419/2858] 10.27.203.238 () {64 vars in 1487 bytes} [Tue May 28 13:06:44 2024] GET /share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/9a84aca1-9802-48cc-87ee-9d3930f27b3c/metadata => generated 16 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:06:44 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-c617fddc-c0b1-48e7-a4a2-273613b5e49d tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] DELETE http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/9a84aca1-9802-48cc-87ee-9d3930f27b3c May 28 13:06:44 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-c617fddc-c0b1-48e7-a4a2-273613b5e49d tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:06:44 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-c617fddc-c0b1-48e7-a4a2-273613b5e49d tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Calling method 'ShareSnapshotMixin.delete' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:06:44 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.v1.share_snapshots [None req-c617fddc-c0b1-48e7-a4a2-273613b5e49d tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Delete snapshot with id: 9a84aca1-9802-48cc-87ee-9d3930f27b3c May 28 13:06:44 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-c617fddc-c0b1-48e7-a4a2-273613b5e49d tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/9a84aca1-9802-48cc-87ee-9d3930f27b3c returned with HTTP 202 May 28 13:06:44 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1440/2859] 10.27.203.238 () {64 vars in 1463 bytes} [Tue May 28 13:06:44 2024] DELETE /share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/9a84aca1-9802-48cc-87ee-9d3930f27b3c => generated 0 bytes in 101 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 13:06:44 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-7af02349-8da1-4fe8-85b5-96ebd9f23b0d tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] GET http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/9a84aca1-9802-48cc-87ee-9d3930f27b3c May 28 13:06:44 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-7af02349-8da1-4fe8-85b5-96ebd9f23b0d tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:06:44 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-7af02349-8da1-4fe8-85b5-96ebd9f23b0d tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Calling method 'ShareSnapshotMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:06:44 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-7af02349-8da1-4fe8-85b5-96ebd9f23b0d tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/9a84aca1-9802-48cc-87ee-9d3930f27b3c returned with HTTP 200 May 28 13:06:44 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1420/2860] 10.27.203.238 () {64 vars in 1460 bytes} [Tue May 28 13:06:44 2024] GET /share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/9a84aca1-9802-48cc-87ee-9d3930f27b3c => generated 722 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:06:44 l75lg1-v1 dstat.sh[49771]: 28-05 13:06:44| 11 1 85 3 0|5502M 1906M 278M 7938M| 16k 0 | 0 4121k| 0 359 |4987 8084 |0.51 0.90 0.98|2.0 0 0| 0 0 | 0 2048M| 29 359 0 6 6 May 28 13:06:44 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c617fddc-c0b1-48e7-a4a2-273613b5e49d tempest-ShareSnapshotMetadataTest-331543469 None] >>> [GET] https://127.0.0.1:40443/api/snapshots/ May 28 13:06:44 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c617fddc-c0b1-48e7-a4a2-273613b5e49d tempest-ShareSnapshotMetadataTest-331543469 None] {'allow_redirects': True, May 28 13:06:44 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c617fddc-c0b1-48e7-a4a2-273613b5e49d tempest-ShareSnapshotMetadataTest-331543469 None] 'params': {'name': 'share-snapshot-96deb36f-d8e8-43b6-bb66-e3b660729c42'}} May 28 13:06:44 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c617fddc-c0b1-48e7-a4a2-273613b5e49d tempest-ShareSnapshotMetadataTest-331543469 None] <<< [GET] https://127.0.0.1:40443/api/snapshots/ May 28 13:06:44 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c617fddc-c0b1-48e7-a4a2-273613b5e49d tempest-ShareSnapshotMetadataTest-331543469 None] [Bunch(access_path='/.vast_all_snapshots/1000000023_share-snapshot-96deb36f-d8e8-43b6-bb66-e3b660729c42', aggr_phys_estimation=0, cluster='loop75-kfs', created='2024-05-28T13:06:40.393186Z', eta_sec=30819898393.083843, expiration_time='3001-01-19T07:59:58Z', guid='6b5004c2-3ce8-4ccf-a380-88cf62fcc5ec', id=24, indestructible=False, locked=False, name='share-snapshot-96deb36f-d8e8-43b6-bb66-e3b660729c42', path='/manila/manila-32260cfb-2f6c-471f-8668-cd9a33828137/', policy=None, policy_id=None, protection_policy_id=None, state='SUCCEED', tenant_id=1, tenant_name='default', title='share-snapshot-96deb36f-d8e8-43b6-bb66-e3b660729c42(/manila/manila-32260cfb-2f6c-471f-8668-cd9a33828137/)', type='local', unique_phys_estimation=0, url='https://127.0.0.1:40443/api/snapshots/24/')] May 28 13:06:44 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c617fddc-c0b1-48e7-a4a2-273613b5e49d tempest-ShareSnapshotMetadataTest-331543469 None] --- [GET] https://127.0.0.1:40443/api/snapshots/: Done May 28 13:06:44 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c617fddc-c0b1-48e7-a4a2-273613b5e49d tempest-ShareSnapshotMetadataTest-331543469 None] >>> [DELETE] https://127.0.0.1:40443/api/snapshots/24/ May 28 13:06:45 l75lg1-v1 dstat.sh[49771]: 28-05 13:06:45| 1 0 98 0 0|5502M 1906M 278M 7938M| 18k 1406B| 0 1300k| 0 249 |1622 2366 |0.51 0.90 0.98|1.0 0 0| 0 0 | 0 2048M| 29 359 0 6 6 May 28 13:06:46 l75lg1-v1 dstat.sh[49771]: 28-05 13:06:46| 1 1 99 0 0|5502M 1906M 278M 7938M| 16k 0 | 0 172k| 0 11.0 |1377 2057 |0.51 0.90 0.98|1.0 0 0| 0 0 | 0 2048M| 29 359 0 6 6 May 28 13:06:46 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c617fddc-c0b1-48e7-a4a2-273613b5e49d tempest-ShareSnapshotMetadataTest-331543469 None] <<< [DELETE] https://127.0.0.1:40443/api/snapshots/24/ May 28 13:06:46 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-c617fddc-c0b1-48e7-a4a2-273613b5e49d tempest-ShareSnapshotMetadataTest-331543469 None] --- [DELETE] https://127.0.0.1:40443/api/snapshots/24/: Done May 28 13:06:46 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-c617fddc-c0b1-48e7-a4a2-273613b5e49d tempest-ShareSnapshotMetadataTest-331543469 None] Created reservations ['1136fe89-053d-475f-a8b7-2097bf71656c', '3c3c35ee-1f99-460f-b653-1add0913fa79', '8e30673b-23ef-4004-97e5-33a39f47d378', 'fc6db3b5-7d66-471e-be90-251f61ebe188'] {{(pid=98474) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 13:06:46 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-c617fddc-c0b1-48e7-a4a2-273613b5e49d tempest-ShareSnapshotMetadataTest-331543469 None] Committed reservations ['1136fe89-053d-475f-a8b7-2097bf71656c', '3c3c35ee-1f99-460f-b653-1add0913fa79', '8e30673b-23ef-4004-97e5-33a39f47d378', 'fc6db3b5-7d66-471e-be90-251f61ebe188'] {{(pid=98474) commit /opt/stack/manila/manila/quota.py:1063}} May 28 13:06:46 l75lg1-v1 neutron-server[77623]: DEBUG dbcounter [-] [77623] Writing DB stats neutron:SELECT=1 {{(pid=77623) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:06:46 l75lg1-v1 neutron-server[77623]: DEBUG dbcounter [-] [77623] Writing DB stats neutron:SELECT=2 {{(pid=77623) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:06:47 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-73c17784-b7d0-42d8-b8b6-d87167a26f50 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] GET http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/9a84aca1-9802-48cc-87ee-9d3930f27b3c May 28 13:06:47 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-73c17784-b7d0-42d8-b8b6-d87167a26f50 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:06:47 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-73c17784-b7d0-42d8-b8b6-d87167a26f50 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Calling method 'ShareSnapshotMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:06:47 l75lg1-v1 dstat.sh[49771]: 28-05 13:06:47| 2 0 97 1 0|5502M 1905M 278M 7938M| 20k 238B| 0 720k| 0 89.0 |2462 3830 |0.51 0.90 0.98|2.0 0 0| 0 0 | 0 2048M| 29 360 0 6 6 May 28 13:06:47 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-73c17784-b7d0-42d8-b8b6-d87167a26f50 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] HTTP exception thrown: The resource could not be found. May 28 13:06:47 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-73c17784-b7d0-42d8-b8b6-d87167a26f50 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/9a84aca1-9802-48cc-87ee-9d3930f27b3c returned with HTTP 404 May 28 13:06:47 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1441/2861] 10.27.203.238 () {64 vars in 1460 bytes} [Tue May 28 13:06:47 2024] GET /share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/9a84aca1-9802-48cc-87ee-9d3930f27b3c => generated 78 bytes in 16 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 13:06:47 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-68aa5098-a11e-4959-91bd-25edd2412d35 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] POST http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/aa5ec314-e632-4fbb-b8cc-b5009e18200a/metadata May 28 13:06:47 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-68aa5098-a11e-4959-91bd-25edd2412d35 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Action: 'create_metadata', calling method: Controller.__getattribute__..version_select, body: {"metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "value"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:06:47 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-68aa5098-a11e-4959-91bd-25edd2412d35 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/aa5ec314-e632-4fbb-b8cc-b5009e18200a/metadata returned with HTTP 200 May 28 13:06:47 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1421/2862] 10.27.203.238 () {66 vars in 1509 bytes} [Tue May 28 13:06:47 2024] POST /share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/aa5ec314-e632-4fbb-b8cc-b5009e18200a/metadata => generated 282 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:06:47 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-528b5675-c6c3-480c-b875-14d5e742caa3 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] GET http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/aa5ec314-e632-4fbb-b8cc-b5009e18200a/metadata May 28 13:06:47 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-528b5675-c6c3-480c-b875-14d5e742caa3 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:06:47 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-528b5675-c6c3-480c-b875-14d5e742caa3 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:06:47 l75lg1-v1 manila-share[98474]: DEBUG oslo_service.periodic_task [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] Running periodic task ShareManager._publish_service_capabilities {{(pid=98474) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 13:06:47 l75lg1-v1 manila-share[98474]: DEBUG manila.manager [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] Notifying Schedulers of capabilities ... {{(pid=98474) _publish_service_capabilities /opt/stack/manila/manila/manager.py:172}} May 28 13:06:47 l75lg1-v1 manila-share[98474]: DEBUG oslo_service.periodic_task [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] Running periodic task ShareManager.migration_driver_continue {{(pid=98474) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 13:06:47 l75lg1-v1 manila-scheduler[98327]: DEBUG manila.scheduler.host_manager [None req-2585d91e-d792-4b7f-a92d-f3f88a4c436b None None] Received share service update from l75lg1-v1@vast: {'share_backend_name': 'vast', 'driver_handles_share_servers': False, 'vendor_name': 'VAST STORAGE', 'driver_version': '1.0', 'storage_protocol': 'NFS', 'total_capacity_gb': 2083.02392578125, 'free_capacity_gb': 2082.600034707226, 'reserved_percentage': 0, 'reserved_snapshot_percentage': 0, 'reserved_share_extend_percentage': 0, 'qos': False, 'pools': None, 'snapshot_support': True, 'create_share_from_snapshot_support': False, 'revert_to_snapshot_support': False, 'mount_snapshot_support': False, 'replication_domain': None, 'filter_function': None, 'goodness_function': None, 'security_service_update_support': False, 'network_allocation_update_support': False, 'share_server_multiple_subnet_support': False, 'mount_point_name_support': False, 'data_reduction': 5.29, 'provisioned_capacity_gb': 0.42389107402414083, 'share_group_stats': {'consistent_snapshot_support': None}, 'ipv4_support': True, 'ipv6_support': False} {{(pid=98327) update_service_capabilities /opt/stack/manila/manila/scheduler/host_manager.py:632}} May 28 13:06:47 l75lg1-v1 manila-share[98474]: DEBUG oslo_service.periodic_task [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] Running periodic task ShareManager.periodic_share_replica_update {{(pid=98474) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 13:06:47 l75lg1-v1 manila-share[98474]: DEBUG manila.share.manager [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] Updating status of share replica instances. {{(pid=98474) periodic_share_replica_update /opt/stack/manila/manila/share/manager.py:2752}} May 28 13:06:47 l75lg1-v1 manila-share[98474]: DEBUG oslo_service.periodic_task [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] Running periodic task ShareManager.do_deferred_share_deletion {{(pid=98474) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 13:06:47 l75lg1-v1 manila-share[98474]: DEBUG manila.share.manager [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] Checking for shares in 'deferred_deleting' status to process their deletion. {{(pid=98474) do_deferred_share_deletion /opt/stack/manila/manila/share/manager.py:3663}} May 28 13:06:47 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-528b5675-c6c3-480c-b875-14d5e742caa3 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/aa5ec314-e632-4fbb-b8cc-b5009e18200a/metadata returned with HTTP 200 May 28 13:06:47 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1442/2863] 10.27.203.238 () {64 vars in 1487 bytes} [Tue May 28 13:06:47 2024] GET /share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/aa5ec314-e632-4fbb-b8cc-b5009e18200a/metadata => generated 282 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:06:47 l75lg1-v1 manila-share[98474]: DEBUG oslo_service.periodic_task [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] Running periodic task ShareManager.delete_free_share_servers {{(pid=98474) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 13:06:47 l75lg1-v1 manila-share[98474]: DEBUG oslo_service.periodic_task [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] Running periodic task ShareManager.delete_expired_transfers {{(pid=98474) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 13:06:47 l75lg1-v1 manila-share[98474]: INFO manila.share.manager [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] Checking for expired transfers. May 28 13:06:47 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-6766a115-9047-45ee-a6bb-6ec8268fcf2c tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] POST http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/aa5ec314-e632-4fbb-b8cc-b5009e18200a/metadata May 28 13:06:47 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-6766a115-9047-45ee-a6bb-6ec8268fcf2c tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Action: 'create_metadata', calling method: Controller.__getattribute__..version_select, body: {"metadata": {"key": "vvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvv"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:06:47 l75lg1-v1 manila-share[98474]: DEBUG oslo_service.periodic_task [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] Running periodic task ShareManager.do_deferred_snapshot_deletion {{(pid=98474) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 13:06:47 l75lg1-v1 manila-share[98474]: DEBUG manila.share.manager [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] Checking for snapshots in 'deferred_deleting' status to process their deletion. {{(pid=98474) do_deferred_snapshot_deletion /opt/stack/manila/manila/share/manager.py:3980}} May 28 13:06:47 l75lg1-v1 manila-share[98474]: DEBUG oslo_service.periodic_task [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] Running periodic task ShareManager.periodic_share_replica_snapshot_update {{(pid=98474) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 13:06:47 l75lg1-v1 manila-share[98474]: DEBUG manila.share.manager [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] Updating status of share replica snapshots. {{(pid=98474) periodic_share_replica_snapshot_update /opt/stack/manila/manila/share/manager.py:4213}} May 28 13:06:47 l75lg1-v1 manila-share[98474]: DEBUG oslo_service.periodic_task [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] Running periodic task ShareManager._report_driver_status {{(pid=98474) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 13:06:47 l75lg1-v1 manila-share[98474]: INFO manila.share.manager [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] Updating share status May 28 13:06:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] >>> [GET] https://127.0.0.1:40443/api/monitors/ad_hoc_query/ May 28 13:06:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] {'allow_redirects': True, May 28 13:06:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] 'params': {'object_type': 'cluster', May 28 13:06:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] 'prop_list': ['Capacity,drr', May 28 13:06:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] 'Capacity,logical_space', May 28 13:06:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] 'Capacity,logical_space_in_use', May 28 13:06:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] 'Capacity,physical_space', May 28 13:06:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] 'Capacity,physical_space_in_use'], May 28 13:06:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] 'time_frame': '1m'}} May 28 13:06:47 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-6766a115-9047-45ee-a6bb-6ec8268fcf2c tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/aa5ec314-e632-4fbb-b8cc-b5009e18200a/metadata returned with HTTP 200 May 28 13:06:47 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1422/2864] 10.27.203.238 () {66 vars in 1510 bytes} [Tue May 28 13:06:47 2024] POST /share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/aa5ec314-e632-4fbb-b8cc-b5009e18200a/metadata => generated 1048 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:06:47 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-bfd2bd04-8bd3-4aa0-88b7-7f289db941ae tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] GET http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/aa5ec314-e632-4fbb-b8cc-b5009e18200a/metadata May 28 13:06:47 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-bfd2bd04-8bd3-4aa0-88b7-7f289db941ae tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:06:47 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-bfd2bd04-8bd3-4aa0-88b7-7f289db941ae tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:06:47 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-bfd2bd04-8bd3-4aa0-88b7-7f289db941ae tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/aa5ec314-e632-4fbb-b8cc-b5009e18200a/metadata returned with HTTP 200 May 28 13:06:47 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1443/2865] 10.27.203.238 () {64 vars in 1487 bytes} [Tue May 28 13:06:47 2024] GET /share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/aa5ec314-e632-4fbb-b8cc-b5009e18200a/metadata => generated 1316 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:06:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] <<< [GET] https://127.0.0.1:40443/api/monitors/ad_hoc_query/ May 28 13:06:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] Bunch(data=[['2024-05-28T13:06:43Z', 1, 477603846.0, 2223930.0, 5.29, 711246584217.0, 2236629909504.0], ['2024-05-28T13:06:33Z', 1, 477464583.0, 2223930.0, 5.29, 711246584217.0, 2236629909504.0], ['2024-05-28T13:06:23Z', 1, 456517639.0, 2223930.0, 5.29, 711246584217.0, 2236629909504.0], ['2024-05-28T13:06:13Z', 1, 456435719.0, 2223930.0, 5.29, 711246584217.0, 2236629909504.0], ['2024-05-28T13:06:03Z', 1, 456312839.0, 2223930.0, 5.29, 711246584217.0, 2236629909504.0], ['2024-05-28T13:05:53Z', 1, 456239111.0, 2223930.0, 5.29, 711246584217.0, 2236629909504.0]], granularity=None, object_ids=[1], prop_list=['timestamp', 'object_id', 'Capacity,logical_space_in_use', 'Capacity,physical_space_in_use', 'Capacity,drr', 'Capacity,physical_space', 'Capacity,logical_space']) May 28 13:06:47 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] --- [GET] https://127.0.0.1:40443/api/monitors/ad_hoc_query/: Done May 28 13:06:47 l75lg1-v1 manila-share[98474]: DEBUG manila.share.driver [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] Updating share stats. {{(pid=98474) _update_share_stats /opt/stack/manila/manila/share/driver.py:1326}} May 28 13:06:47 l75lg1-v1 manila-share[98474]: DEBUG oslo_service.periodic_task [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] Running periodic task ShareManager._execute_periodic_hook {{(pid=98474) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 13:06:47 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-a97a37df-127c-4578-bdff-6cc706ee6f94 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] POST http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/aa5ec314-e632-4fbb-b8cc-b5009e18200a/metadata May 28 13:06:47 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-a97a37df-127c-4578-bdff-6cc706ee6f94 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Action: 'create_metadata', calling method: Controller.__getattribute__..version_select, body: {"metadata": {"k": "value"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:06:47 l75lg1-v1 manila-share[98474]: DEBUG oslo_service.periodic_task [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] Running periodic task ShareManager.create_backup_continue {{(pid=98474) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 13:06:47 l75lg1-v1 manila-share[98474]: DEBUG oslo_service.periodic_task [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] Running periodic task ShareManager.restore_backup_continue {{(pid=98474) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 13:06:47 l75lg1-v1 manila-share[98474]: DEBUG oslo_service.periodic_task [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] Running periodic task ShareManager.periodic_share_status_update {{(pid=98474) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 13:06:47 l75lg1-v1 manila-share[98474]: DEBUG manila.share.manager [None req-b51f9241-162f-4a75-aefa-c44d654f6f40 None None] Updating status of share instances. {{(pid=98474) periodic_share_status_update /opt/stack/manila/manila/share/manager.py:5475}} May 28 13:06:47 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-a97a37df-127c-4578-bdff-6cc706ee6f94 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/aa5ec314-e632-4fbb-b8cc-b5009e18200a/metadata returned with HTTP 200 May 28 13:06:47 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1423/2866] 10.27.203.238 () {66 vars in 1508 bytes} [Tue May 28 13:06:47 2024] POST /share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/aa5ec314-e632-4fbb-b8cc-b5009e18200a/metadata => generated 28 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:06:47 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-e304d712-cd66-406a-b444-8f6a5a5dccf3 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] GET http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/aa5ec314-e632-4fbb-b8cc-b5009e18200a/metadata May 28 13:06:47 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-e304d712-cd66-406a-b444-8f6a5a5dccf3 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:06:47 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-e304d712-cd66-406a-b444-8f6a5a5dccf3 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:06:47 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-e304d712-cd66-406a-b444-8f6a5a5dccf3 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/aa5ec314-e632-4fbb-b8cc-b5009e18200a/metadata returned with HTTP 200 May 28 13:06:47 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1444/2867] 10.27.203.238 () {64 vars in 1487 bytes} [Tue May 28 13:06:47 2024] GET /share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/aa5ec314-e632-4fbb-b8cc-b5009e18200a/metadata => generated 1330 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:06:47 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-384e1b21-e2ca-44d3-a427-29a8817f79be tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] POST http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/aa5ec314-e632-4fbb-b8cc-b5009e18200a/metadata May 28 13:06:47 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-384e1b21-e2ca-44d3-a427-29a8817f79be tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Action: 'create_metadata', calling method: Controller.__getattribute__..version_select, body: {"metadata": {"key": "v"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:06:47 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-384e1b21-e2ca-44d3-a427-29a8817f79be tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/aa5ec314-e632-4fbb-b8cc-b5009e18200a/metadata returned with HTTP 200 May 28 13:06:47 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1424/2868] 10.27.203.238 () {66 vars in 1508 bytes} [Tue May 28 13:06:47 2024] POST /share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/aa5ec314-e632-4fbb-b8cc-b5009e18200a/metadata => generated 26 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:06:47 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-2689d66e-45a9-432f-a892-c40e0db773b7 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] GET http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/aa5ec314-e632-4fbb-b8cc-b5009e18200a/metadata May 28 13:06:47 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-2689d66e-45a9-432f-a892-c40e0db773b7 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:06:47 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-2689d66e-45a9-432f-a892-c40e0db773b7 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:06:47 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-2689d66e-45a9-432f-a892-c40e0db773b7 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/aa5ec314-e632-4fbb-b8cc-b5009e18200a/metadata returned with HTTP 200 May 28 13:06:47 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1445/2869] 10.27.203.238 () {64 vars in 1487 bytes} [Tue May 28 13:06:47 2024] GET /share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/aa5ec314-e632-4fbb-b8cc-b5009e18200a/metadata => generated 308 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:06:47 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-b2f6598d-8c70-4de3-9171-8f0fbad65608 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] POST http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots May 28 13:06:47 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-b2f6598d-8c70-4de3-9171-8f0fbad65608 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Action: 'create', calling method: ShareSnapshotMixin.create, body: {"snapshot": {"name": "tempest-tempest-created-share-snap-1294166278", "force": false, "description": "Tempest's snapshot", "share_id": "41a07ae7-d107-493e-8a00-5ada346ac16c"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:06:47 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.v1.share_snapshots [None req-b2f6598d-8c70-4de3-9171-8f0fbad65608 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Create snapshot from share 41a07ae7-d107-493e-8a00-5ada346ac16c May 28 13:06:47 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.quota [None req-b2f6598d-8c70-4de3-9171-8f0fbad65608 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Created reservations ['454ad403-047c-4fba-87cb-55dfe744cc73', 'a6c40e23-9739-4d35-b494-ed3fca297c82', '838b5cfa-0cb2-4e4d-a642-cc15333d7caa', '219b82c1-aaae-4d0d-8d16-76004467526c'] {{(pid=98330) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 13:06:48 l75lg1-v1 nova-conductor[83229]: DEBUG dbcounter [-] [83229] Writing DB stats nova_cell0:SELECT=1,nova_cell0:UPDATE=1 {{(pid=83229) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:06:48 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.quota [None req-b2f6598d-8c70-4de3-9171-8f0fbad65608 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Committed reservations ['454ad403-047c-4fba-87cb-55dfe744cc73', 'a6c40e23-9739-4d35-b494-ed3fca297c82', '838b5cfa-0cb2-4e4d-a642-cc15333d7caa', '219b82c1-aaae-4d0d-8d16-76004467526c'] {{(pid=98330) commit /opt/stack/manila/manila/quota.py:1063}} May 28 13:06:48 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-b2f6598d-8c70-4de3-9171-8f0fbad65608 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots returned with HTTP 202 May 28 13:06:48 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1425/2870] 10.27.203.238 () {66 vars in 1371 bytes} [Tue May 28 13:06:47 2024] POST /share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots => generated 723 bytes in 168 msecs (HTTP/1.1 202) 6 headers in 237 bytes (1 switches on core 0) May 28 13:06:48 l75lg1-v1 nova-conductor[83233]: DEBUG dbcounter [-] [83233] Writing DB stats nova_cell0:SELECT=1 {{(pid=83233) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:06:48 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-83812c01-7811-446d-8d91-daed6f098764 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] GET http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/6769c4c1-8669-47e7-9111-d00f433c2277 May 28 13:06:48 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-83812c01-7811-446d-8d91-daed6f098764 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:06:48 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-83812c01-7811-446d-8d91-daed6f098764 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Calling method 'ShareSnapshotMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:06:48 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-83812c01-7811-446d-8d91-daed6f098764 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/6769c4c1-8669-47e7-9111-d00f433c2277 returned with HTTP 200 May 28 13:06:48 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1446/2871] 10.27.203.238 () {64 vars in 1460 bytes} [Tue May 28 13:06:48 2024] GET /share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/6769c4c1-8669-47e7-9111-d00f433c2277 => generated 723 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:06:48 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b2f6598d-8c70-4de3-9171-8f0fbad65608 tempest-ShareSnapshotMetadataTest-331543469 None] >>> [POST] https://127.0.0.1:40443/api/snapshots/ May 28 13:06:48 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b2f6598d-8c70-4de3-9171-8f0fbad65608 tempest-ShareSnapshotMetadataTest-331543469 None] {'data': '{"path": "/manila/manila-32260cfb-2f6c-471f-8668-cd9a33828137", ' May 28 13:06:48 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b2f6598d-8c70-4de3-9171-8f0fbad65608 tempest-ShareSnapshotMetadataTest-331543469 None] '"name": "share-snapshot-6ddbe85a-2921-44be-af08-aa83b692283b"}', May 28 13:06:48 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b2f6598d-8c70-4de3-9171-8f0fbad65608 tempest-ShareSnapshotMetadataTest-331543469 None] 'json': None, May 28 13:06:48 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b2f6598d-8c70-4de3-9171-8f0fbad65608 tempest-ShareSnapshotMetadataTest-331543469 None] 'params': None} May 28 13:06:48 l75lg1-v1 dstat.sh[49771]: 28-05 13:06:48| 11 1 86 2 0|5503M 1905M 278M 7938M| 26k 14k| 0 2114k| 0 234 |5206 8155 |0.47 0.89 0.98|2.0 0 0| 0 0 | 0 2048M| 29 359 0 6 6 May 28 13:06:48 l75lg1-v1 neutron-server[77623]: DEBUG neutron.db.agents_db [None req-fe40ce8c-640e-4db7-a17a-6e8888cce266 None None] Agent healthcheck: found 0 active agents {{(pid=77623) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:319}} May 28 13:06:49 l75lg1-v1 dstat.sh[49771]: 28-05 13:06:49| 1 0 98 0 0|5503M 1905M 278M 7938M| 20k 0 | 0 188k| 0 12.0 |1591 2354 |0.47 0.89 0.98| 0 0 2.0| 0 0 | 0 2048M| 29 359 0 6 6 May 28 13:06:49 l75lg1-v1 nova-conductor[83647]: DEBUG dbcounter [-] [83647] Writing DB stats nova_cell1:SELECT=2,nova_cell1:UPDATE=2 {{(pid=83647) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:06:50 l75lg1-v1 nova-conductor[83648]: DEBUG dbcounter [-] [83648] Writing DB stats nova_cell1:SELECT=1 {{(pid=83648) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:06:50 l75lg1-v1 dstat.sh[49771]: 28-05 13:06:50| 1 0 99 0 0|5503M 1905M 278M 7938M| 13k 0 | 0 356k| 0 44.0 |1776 2803 |0.47 0.89 0.98| 0 0 0| 0 0 | 0 2048M| 29 359 0 6 6 May 28 13:06:51 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-9894bff4-3da9-4e45-ad48-e346a0caf885 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] GET http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/6769c4c1-8669-47e7-9111-d00f433c2277 May 28 13:06:51 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-9894bff4-3da9-4e45-ad48-e346a0caf885 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:06:51 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-9894bff4-3da9-4e45-ad48-e346a0caf885 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Calling method 'ShareSnapshotMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:06:51 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-9894bff4-3da9-4e45-ad48-e346a0caf885 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/6769c4c1-8669-47e7-9111-d00f433c2277 returned with HTTP 200 May 28 13:06:51 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1426/2872] 10.27.203.238 () {64 vars in 1460 bytes} [Tue May 28 13:06:51 2024] GET /share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/6769c4c1-8669-47e7-9111-d00f433c2277 => generated 723 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:06:51 l75lg1-v1 dstat.sh[49771]: 28-05 13:06:51| 1 0 98 0 0|5503M 1905M 278M 7938M| 20k 0 | 0 172k| 0 13.0 |1705 2429 |0.47 0.89 0.98|1.0 0 0| 0 0 | 0 2048M| 29 359 0 6 6 May 28 13:06:51 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b2f6598d-8c70-4de3-9171-8f0fbad65608 tempest-ShareSnapshotMetadataTest-331543469 None] <<< [POST] https://127.0.0.1:40443/api/snapshots/ May 28 13:06:51 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b2f6598d-8c70-4de3-9171-8f0fbad65608 tempest-ShareSnapshotMetadataTest-331543469 None] Bunch(access_path='/.vast_all_snapshots/1000000024_share-snapshot-6ddbe85a-2921-44be-af08-aa83b692283b', aggr_phys_estimation=0, cluster='loop75-kfs', created='2024-05-28T13:06:48.489685Z', eta_sec=30819898386.222206, expiration_time='3001-01-19T07:59:58Z', guid='6f21151c-7e5e-4dac-a50c-1cbb235aebb0', id=25, indestructible=False, locked=False, name='share-snapshot-6ddbe85a-2921-44be-af08-aa83b692283b', path='/manila/manila-32260cfb-2f6c-471f-8668-cd9a33828137/', policy=None, policy_id=None, protection_policy_id=None, state='SUCCEED', tenant_id=1, tenant_name='default', title='share-snapshot-6ddbe85a-2921-44be-af08-aa83b692283b(/manila/manila-32260cfb-2f6c-471f-8668-cd9a33828137/)', type='local', unique_phys_estimation=0, url='https://127.0.0.1:40443/api/snapshots/25/') May 28 13:06:51 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-b2f6598d-8c70-4de3-9171-8f0fbad65608 tempest-ShareSnapshotMetadataTest-331543469 None] --- [POST] https://127.0.0.1:40443/api/snapshots/: Done May 28 13:06:52 l75lg1-v1 dstat.sh[49771]: 28-05 13:06:52| 1 0 98 1 0|5503M 1905M 278M 7938M| 15k 66B| 0 408k| 0 61.0 |2020 3228 |0.47 0.89 0.98| 0 0 0| 0 0 | 0 2048M| 29 359 0 6 6 May 28 13:06:53 l75lg1-v1 dstat.sh[49771]: 28-05 13:06:53| 0 0 99 0 0|5503M 1905M 278M 7938M| 12k 132B| 0 260k| 0 29.0 |1642 2658 |0.43 0.87 0.97|1.0 0 0| 0 0 | 0 2048M| 29 357 0 6 8 May 28 13:06:54 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-554bdab3-7d4b-407b-b67c-ee9bc11bd613 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] GET http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/6769c4c1-8669-47e7-9111-d00f433c2277 May 28 13:06:54 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-554bdab3-7d4b-407b-b67c-ee9bc11bd613 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:06:54 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-554bdab3-7d4b-407b-b67c-ee9bc11bd613 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Calling method 'ShareSnapshotMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:06:54 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-554bdab3-7d4b-407b-b67c-ee9bc11bd613 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/6769c4c1-8669-47e7-9111-d00f433c2277 returned with HTTP 200 May 28 13:06:54 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1447/2873] 10.27.203.238 () {64 vars in 1460 bytes} [Tue May 28 13:06:54 2024] GET /share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/6769c4c1-8669-47e7-9111-d00f433c2277 => generated 724 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:06:54 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-3c9d6d78-857b-4ae9-9681-248bd753cd60 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] POST http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/6769c4c1-8669-47e7-9111-d00f433c2277/metadata May 28 13:06:54 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-3c9d6d78-857b-4ae9-9681-248bd753cd60 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Action: 'create_metadata', calling method: Controller.__getattribute__..version_select, body: {"metadata": {"key9": "value9", "key10": "value10"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:06:54 l75lg1-v1 dstat.sh[49771]: 28-05 13:06:54| 1 0 98 0 0|5503M 1905M 278M 7938M| 13k 0 | 0 244k| 0 24.0 |1731 2803 |0.43 0.87 0.97|1.0 0 0| 0 0 | 0 2048M| 29 358 0 6 8 May 28 13:06:54 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-3c9d6d78-857b-4ae9-9681-248bd753cd60 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/6769c4c1-8669-47e7-9111-d00f433c2277/metadata returned with HTTP 200 May 28 13:06:54 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1427/2874] 10.27.203.238 () {66 vars in 1508 bytes} [Tue May 28 13:06:54 2024] POST /share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/6769c4c1-8669-47e7-9111-d00f433c2277/metadata => generated 52 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:06:54 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-9f618685-cc3b-4a08-83be-c88680d69cc7 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] GET http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/6769c4c1-8669-47e7-9111-d00f433c2277/metadata May 28 13:06:54 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-9f618685-cc3b-4a08-83be-c88680d69cc7 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:06:54 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-9f618685-cc3b-4a08-83be-c88680d69cc7 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:06:54 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-9f618685-cc3b-4a08-83be-c88680d69cc7 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/6769c4c1-8669-47e7-9111-d00f433c2277/metadata returned with HTTP 200 May 28 13:06:54 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1448/2875] 10.27.203.238 () {64 vars in 1487 bytes} [Tue May 28 13:06:54 2024] GET /share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/6769c4c1-8669-47e7-9111-d00f433c2277/metadata => generated 52 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:06:54 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-bafb5317-ffb1-43ac-ab11-f7a349a7fab6 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] GET http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/6769c4c1-8669-47e7-9111-d00f433c2277/metadata/key9 May 28 13:06:54 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-bafb5317-ffb1-43ac-ab11-f7a349a7fab6 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:06:54 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-bafb5317-ffb1-43ac-ab11-f7a349a7fab6 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:06:54 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-bafb5317-ffb1-43ac-ab11-f7a349a7fab6 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/6769c4c1-8669-47e7-9111-d00f433c2277/metadata/key9 returned with HTTP 200 May 28 13:06:54 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1428/2876] 10.27.203.238 () {64 vars in 1502 bytes} [Tue May 28 13:06:54 2024] GET /share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/6769c4c1-8669-47e7-9111-d00f433c2277/metadata/key9 => generated 28 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:06:54 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-e8c6a285-6372-4fd0-b610-a970b899e2f8 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] GET http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/6769c4c1-8669-47e7-9111-d00f433c2277/metadata/key10 May 28 13:06:54 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-e8c6a285-6372-4fd0-b610-a970b899e2f8 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:06:54 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-e8c6a285-6372-4fd0-b610-a970b899e2f8 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:06:54 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-e8c6a285-6372-4fd0-b610-a970b899e2f8 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/6769c4c1-8669-47e7-9111-d00f433c2277/metadata/key10 returned with HTTP 200 May 28 13:06:54 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1449/2877] 10.27.203.238 () {64 vars in 1505 bytes} [Tue May 28 13:06:54 2024] GET /share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/6769c4c1-8669-47e7-9111-d00f433c2277/metadata/key10 => generated 30 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:06:54 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-249d5bcb-fb77-418f-bc22-0f3f8876b024 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] POST http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/6769c4c1-8669-47e7-9111-d00f433c2277/metadata May 28 13:06:54 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-249d5bcb-fb77-418f-bc22-0f3f8876b024 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Action: 'create_metadata', calling method: Controller.__getattribute__..version_select, body: {"metadata": {"key11": "value11", "key12": "value12"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:06:54 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-249d5bcb-fb77-418f-bc22-0f3f8876b024 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/6769c4c1-8669-47e7-9111-d00f433c2277/metadata returned with HTTP 200 May 28 13:06:54 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1429/2878] 10.27.203.238 () {66 vars in 1508 bytes} [Tue May 28 13:06:54 2024] POST /share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/6769c4c1-8669-47e7-9111-d00f433c2277/metadata => generated 54 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:06:54 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-af29fc4f-df8e-4d05-a008-86644e7314e3 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] GET http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/6769c4c1-8669-47e7-9111-d00f433c2277/metadata May 28 13:06:54 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-af29fc4f-df8e-4d05-a008-86644e7314e3 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:06:54 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-af29fc4f-df8e-4d05-a008-86644e7314e3 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:06:54 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-af29fc4f-df8e-4d05-a008-86644e7314e3 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/6769c4c1-8669-47e7-9111-d00f433c2277/metadata returned with HTTP 200 May 28 13:06:54 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1450/2879] 10.27.203.238 () {64 vars in 1487 bytes} [Tue May 28 13:06:54 2024] GET /share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/6769c4c1-8669-47e7-9111-d00f433c2277/metadata => generated 92 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:06:54 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 13:06:54 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-7474b2ab-1c3d-41ff-8533-3a81318822b5 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] GET http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/6769c4c1-8669-47e7-9111-d00f433c2277/metadata/key9 May 28 13:06:54 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-7474b2ab-1c3d-41ff-8533-3a81318822b5 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:06:54 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-7474b2ab-1c3d-41ff-8533-3a81318822b5 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:06:54 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-7474b2ab-1c3d-41ff-8533-3a81318822b5 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/6769c4c1-8669-47e7-9111-d00f433c2277/metadata/key9 returned with HTTP 200 May 28 13:06:54 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1430/2880] 10.27.203.238 () {64 vars in 1502 bytes} [Tue May 28 13:06:54 2024] GET /share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/6769c4c1-8669-47e7-9111-d00f433c2277/metadata/key9 => generated 28 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:06:54 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-53289461-6b21-42db-887c-b8cf4e9d3dbd tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] GET http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/6769c4c1-8669-47e7-9111-d00f433c2277/metadata/key10 May 28 13:06:54 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-53289461-6b21-42db-887c-b8cf4e9d3dbd tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:06:54 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-53289461-6b21-42db-887c-b8cf4e9d3dbd tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:06:54 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-53289461-6b21-42db-887c-b8cf4e9d3dbd tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/6769c4c1-8669-47e7-9111-d00f433c2277/metadata/key10 returned with HTTP 200 May 28 13:06:54 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1451/2881] 10.27.203.238 () {64 vars in 1505 bytes} [Tue May 28 13:06:54 2024] GET /share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/6769c4c1-8669-47e7-9111-d00f433c2277/metadata/key10 => generated 30 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:06:54 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-7ba68c52-4417-428f-bc30-bd129ee3a2d8 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] GET http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/6769c4c1-8669-47e7-9111-d00f433c2277/metadata/key11 May 28 13:06:54 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-7ba68c52-4417-428f-bc30-bd129ee3a2d8 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:06:54 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-7ba68c52-4417-428f-bc30-bd129ee3a2d8 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:06:54 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-7ba68c52-4417-428f-bc30-bd129ee3a2d8 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/6769c4c1-8669-47e7-9111-d00f433c2277/metadata/key11 returned with HTTP 200 May 28 13:06:54 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1431/2882] 10.27.203.238 () {64 vars in 1505 bytes} [Tue May 28 13:06:54 2024] GET /share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/6769c4c1-8669-47e7-9111-d00f433c2277/metadata/key11 => generated 30 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:06:54 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-9da0f294-33e3-4522-978f-920f5e025d10 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] GET http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/6769c4c1-8669-47e7-9111-d00f433c2277/metadata/key12 May 28 13:06:54 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-9da0f294-33e3-4522-978f-920f5e025d10 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:06:54 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-9da0f294-33e3-4522-978f-920f5e025d10 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:06:54 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-9da0f294-33e3-4522-978f-920f5e025d10 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/6769c4c1-8669-47e7-9111-d00f433c2277/metadata/key12 returned with HTTP 200 May 28 13:06:54 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1452/2883] 10.27.203.238 () {64 vars in 1505 bytes} [Tue May 28 13:06:54 2024] GET /share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/6769c4c1-8669-47e7-9111-d00f433c2277/metadata/key12 => generated 30 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:06:54 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-08e2d7e9-0767-48d9-b2f3-7e4c261e8564 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] DELETE http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/6769c4c1-8669-47e7-9111-d00f433c2277/metadata/key9 May 28 13:06:54 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-08e2d7e9-0767-48d9-b2f3-7e4c261e8564 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:06:54 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-08e2d7e9-0767-48d9-b2f3-7e4c261e8564 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:06:54 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-08e2d7e9-0767-48d9-b2f3-7e4c261e8564 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/6769c4c1-8669-47e7-9111-d00f433c2277/metadata/key9 returned with HTTP 200 May 28 13:06:54 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1432/2884] 10.27.203.238 () {64 vars in 1505 bytes} [Tue May 28 13:06:54 2024] DELETE /share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/6769c4c1-8669-47e7-9111-d00f433c2277/metadata/key9 => generated 0 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 229 bytes (1 switches on core 0) May 28 13:06:54 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-fed29f19-7edd-455e-802e-a219b70ebf2f tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] DELETE http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/6769c4c1-8669-47e7-9111-d00f433c2277/metadata/key10 May 28 13:06:54 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-fed29f19-7edd-455e-802e-a219b70ebf2f tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:06:54 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-fed29f19-7edd-455e-802e-a219b70ebf2f tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:06:54 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-fed29f19-7edd-455e-802e-a219b70ebf2f tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/6769c4c1-8669-47e7-9111-d00f433c2277/metadata/key10 returned with HTTP 200 May 28 13:06:54 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1453/2885] 10.27.203.238 () {64 vars in 1508 bytes} [Tue May 28 13:06:54 2024] DELETE /share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/6769c4c1-8669-47e7-9111-d00f433c2277/metadata/key10 => generated 0 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 229 bytes (1 switches on core 0) May 28 13:06:54 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-9e1971c7-ad41-420e-8bf5-a108a503cc97 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] DELETE http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/6769c4c1-8669-47e7-9111-d00f433c2277/metadata/key11 May 28 13:06:54 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-9e1971c7-ad41-420e-8bf5-a108a503cc97 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:06:54 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-9e1971c7-ad41-420e-8bf5-a108a503cc97 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:06:55 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-9e1971c7-ad41-420e-8bf5-a108a503cc97 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/6769c4c1-8669-47e7-9111-d00f433c2277/metadata/key11 returned with HTTP 200 May 28 13:06:55 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1433/2886] 10.27.203.238 () {64 vars in 1508 bytes} [Tue May 28 13:06:54 2024] DELETE /share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/6769c4c1-8669-47e7-9111-d00f433c2277/metadata/key11 => generated 0 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 229 bytes (1 switches on core 0) May 28 13:06:55 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-661a775b-8f81-4cf8-93bb-f038ab688826 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] DELETE http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/6769c4c1-8669-47e7-9111-d00f433c2277/metadata/key12 May 28 13:06:55 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-661a775b-8f81-4cf8-93bb-f038ab688826 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:06:55 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-661a775b-8f81-4cf8-93bb-f038ab688826 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:06:55 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-661a775b-8f81-4cf8-93bb-f038ab688826 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/6769c4c1-8669-47e7-9111-d00f433c2277/metadata/key12 returned with HTTP 200 May 28 13:06:55 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1454/2887] 10.27.203.238 () {64 vars in 1508 bytes} [Tue May 28 13:06:55 2024] DELETE /share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/6769c4c1-8669-47e7-9111-d00f433c2277/metadata/key12 => generated 0 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 229 bytes (1 switches on core 0) May 28 13:06:55 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-e2aa7140-43d9-4885-8ca1-2485ab025205 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] GET http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/6769c4c1-8669-47e7-9111-d00f433c2277/metadata May 28 13:06:55 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-e2aa7140-43d9-4885-8ca1-2485ab025205 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:06:55 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-e2aa7140-43d9-4885-8ca1-2485ab025205 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:06:55 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-e2aa7140-43d9-4885-8ca1-2485ab025205 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/6769c4c1-8669-47e7-9111-d00f433c2277/metadata returned with HTTP 200 May 28 13:06:55 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1434/2888] 10.27.203.238 () {64 vars in 1487 bytes} [Tue May 28 13:06:55 2024] GET /share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/6769c4c1-8669-47e7-9111-d00f433c2277/metadata => generated 16 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:06:55 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-1f4ad8c8-948f-400b-bf0a-e0167fe83e76 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] DELETE http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/6769c4c1-8669-47e7-9111-d00f433c2277 May 28 13:06:55 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-1f4ad8c8-948f-400b-bf0a-e0167fe83e76 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:06:55 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-1f4ad8c8-948f-400b-bf0a-e0167fe83e76 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Calling method 'ShareSnapshotMixin.delete' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:06:55 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.v1.share_snapshots [None req-1f4ad8c8-948f-400b-bf0a-e0167fe83e76 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Delete snapshot with id: 6769c4c1-8669-47e7-9111-d00f433c2277 May 28 13:06:55 l75lg1-v1 dstat.sh[49771]: 28-05 13:06:55| 10 1 88 1 0|5503M 1904M 278M 7938M| 28k 172B| 0 2332k| 0 406 |4530 7229 |0.43 0.87 0.97|3.0 0 0| 0 0 | 0 2048M| 29 358 0 6 8 May 28 13:06:55 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-1f4ad8c8-948f-400b-bf0a-e0167fe83e76 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/6769c4c1-8669-47e7-9111-d00f433c2277 returned with HTTP 202 May 28 13:06:55 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1455/2889] 10.27.203.238 () {64 vars in 1463 bytes} [Tue May 28 13:06:55 2024] DELETE /share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/6769c4c1-8669-47e7-9111-d00f433c2277 => generated 0 bytes in 109 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 13:06:55 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-163d0ed2-b642-40ca-bb18-bf4328725373 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] GET http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/6769c4c1-8669-47e7-9111-d00f433c2277 May 28 13:06:55 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-163d0ed2-b642-40ca-bb18-bf4328725373 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:06:55 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-163d0ed2-b642-40ca-bb18-bf4328725373 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Calling method 'ShareSnapshotMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:06:55 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-163d0ed2-b642-40ca-bb18-bf4328725373 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/6769c4c1-8669-47e7-9111-d00f433c2277 returned with HTTP 200 May 28 13:06:55 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1435/2890] 10.27.203.238 () {64 vars in 1460 bytes} [Tue May 28 13:06:55 2024] GET /share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/6769c4c1-8669-47e7-9111-d00f433c2277 => generated 723 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:06:55 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1f4ad8c8-948f-400b-bf0a-e0167fe83e76 tempest-ShareSnapshotMetadataTest-331543469 None] >>> [GET] https://127.0.0.1:40443/api/snapshots/ May 28 13:06:55 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1f4ad8c8-948f-400b-bf0a-e0167fe83e76 tempest-ShareSnapshotMetadataTest-331543469 None] {'allow_redirects': True, May 28 13:06:55 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1f4ad8c8-948f-400b-bf0a-e0167fe83e76 tempest-ShareSnapshotMetadataTest-331543469 None] 'params': {'name': 'share-snapshot-6ddbe85a-2921-44be-af08-aa83b692283b'}} May 28 13:06:55 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 13:06:55 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1f4ad8c8-948f-400b-bf0a-e0167fe83e76 tempest-ShareSnapshotMetadataTest-331543469 None] <<< [GET] https://127.0.0.1:40443/api/snapshots/ May 28 13:06:55 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1f4ad8c8-948f-400b-bf0a-e0167fe83e76 tempest-ShareSnapshotMetadataTest-331543469 None] [Bunch(access_path='/.vast_all_snapshots/1000000024_share-snapshot-6ddbe85a-2921-44be-af08-aa83b692283b', aggr_phys_estimation=0, cluster='loop75-kfs', created='2024-05-28T13:06:48.489685Z', eta_sec=30819898382.358566, expiration_time='3001-01-19T07:59:58Z', guid='6f21151c-7e5e-4dac-a50c-1cbb235aebb0', id=25, indestructible=False, locked=False, name='share-snapshot-6ddbe85a-2921-44be-af08-aa83b692283b', path='/manila/manila-32260cfb-2f6c-471f-8668-cd9a33828137/', policy=None, policy_id=None, protection_policy_id=None, state='SUCCEED', tenant_id=1, tenant_name='default', title='share-snapshot-6ddbe85a-2921-44be-af08-aa83b692283b(/manila/manila-32260cfb-2f6c-471f-8668-cd9a33828137/)', type='local', unique_phys_estimation=0, url='https://127.0.0.1:40443/api/snapshots/25/')] May 28 13:06:55 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1f4ad8c8-948f-400b-bf0a-e0167fe83e76 tempest-ShareSnapshotMetadataTest-331543469 None] --- [GET] https://127.0.0.1:40443/api/snapshots/: Done May 28 13:06:55 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1f4ad8c8-948f-400b-bf0a-e0167fe83e76 tempest-ShareSnapshotMetadataTest-331543469 None] >>> [DELETE] https://127.0.0.1:40443/api/snapshots/25/ May 28 13:06:56 l75lg1-v1 dstat.sh[49771]: 28-05 13:06:56| 2 0 97 0 0|5503M 1904M 278M 7938M| 13k 1406B| 0 336k| 0 34.0 |1947 2939 |0.43 0.87 0.97| 0 0 0| 0 0 | 0 2048M| 29 357 0 6 8 May 28 13:06:56 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1f4ad8c8-948f-400b-bf0a-e0167fe83e76 tempest-ShareSnapshotMetadataTest-331543469 None] <<< [DELETE] https://127.0.0.1:40443/api/snapshots/25/ May 28 13:06:56 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-1f4ad8c8-948f-400b-bf0a-e0167fe83e76 tempest-ShareSnapshotMetadataTest-331543469 None] --- [DELETE] https://127.0.0.1:40443/api/snapshots/25/: Done May 28 13:06:57 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-1f4ad8c8-948f-400b-bf0a-e0167fe83e76 tempest-ShareSnapshotMetadataTest-331543469 None] Created reservations ['629970c8-d430-4de4-9ade-a8d7af3b7a5f', 'b4868208-114f-4504-b114-5872b71a8350', '4ffc066e-1ba3-4b8e-8999-823c07a707b1', '5267cdce-eabe-4d5b-9b5d-ab68c94199d4'] {{(pid=98474) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 13:06:57 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-1f4ad8c8-948f-400b-bf0a-e0167fe83e76 tempest-ShareSnapshotMetadataTest-331543469 None] Committed reservations ['629970c8-d430-4de4-9ade-a8d7af3b7a5f', 'b4868208-114f-4504-b114-5872b71a8350', '4ffc066e-1ba3-4b8e-8999-823c07a707b1', '5267cdce-eabe-4d5b-9b5d-ab68c94199d4'] {{(pid=98474) commit /opt/stack/manila/manila/quota.py:1063}} May 28 13:06:57 l75lg1-v1 dstat.sh[49771]: 28-05 13:06:57| 2 0 98 1 0|5503M 1904M 278M 7938M| 11k 66B| 0 500k| 0 76.0 |2199 3657 |0.43 0.87 0.97| 0 0 0| 0 0 | 0 2048M| 29 357 0 6 8 May 28 13:06:58 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [-] Expecting reply to msg 550c7e72e5474ef285ab25d2200cb74b in queue reply_37f4cbd1dd094961a22b8a65f222c327 May 28 13:06:58 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [-] Received RPC response for msg 550c7e72e5474ef285ab25d2200cb74b May 28 13:06:58 l75lg1-v1 dstat.sh[49771]: 28-05 13:06:58| 1 0 98 0 0|5503M 1904M 278M 7938M| 19k 0 | 0 292k| 0 29.0 |1796 2703 |0.40 0.86 0.96|1.0 0 0| 0 0 | 0 2048M| 29 357 0 6 8 May 28 13:06:58 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-b78422a7-029e-431e-b9c1-ed479038ee93 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] GET http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/6769c4c1-8669-47e7-9111-d00f433c2277 May 28 13:06:58 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-b78422a7-029e-431e-b9c1-ed479038ee93 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:06:58 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-b78422a7-029e-431e-b9c1-ed479038ee93 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Calling method 'ShareSnapshotMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:06:58 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-b78422a7-029e-431e-b9c1-ed479038ee93 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] HTTP exception thrown: The resource could not be found. May 28 13:06:58 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-b78422a7-029e-431e-b9c1-ed479038ee93 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/6769c4c1-8669-47e7-9111-d00f433c2277 returned with HTTP 404 May 28 13:06:58 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1456/2891] 10.27.203.238 () {64 vars in 1460 bytes} [Tue May 28 13:06:58 2024] GET /share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/6769c4c1-8669-47e7-9111-d00f433c2277 => generated 78 bytes in 15 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 13:06:58 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-56ce6f77-cf7d-495a-bf92-729f790f4342 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] PUT http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/aa5ec314-e632-4fbb-b8cc-b5009e18200a/metadata May 28 13:06:58 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-56ce6f77-cf7d-495a-bf92-729f790f4342 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Action: 'update_all_metadata', calling method: Controller.__getattribute__..version_select, body: {"metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "value"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:06:58 l75lg1-v1 neutron-server[77623]: DEBUG dbcounter [-] [77623] Writing DB stats neutron:SELECT=1 {{(pid=77623) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:06:58 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 13:06:58 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 13:06:58 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.manager [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=83654) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10545}} May 28 13:06:58 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-56ce6f77-cf7d-495a-bf92-729f790f4342 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/aa5ec314-e632-4fbb-b8cc-b5009e18200a/metadata returned with HTTP 200 May 28 13:06:58 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1436/2892] 10.27.203.238 () {66 vars in 1508 bytes} [Tue May 28 13:06:58 2024] PUT /share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/aa5ec314-e632-4fbb-b8cc-b5009e18200a/metadata => generated 282 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:06:58 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-beba4ea9-53bf-49ed-a90f-dce2183f843c tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] GET http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/aa5ec314-e632-4fbb-b8cc-b5009e18200a/metadata May 28 13:06:58 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-beba4ea9-53bf-49ed-a90f-dce2183f843c tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:06:58 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-beba4ea9-53bf-49ed-a90f-dce2183f843c tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:06:58 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-beba4ea9-53bf-49ed-a90f-dce2183f843c tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/aa5ec314-e632-4fbb-b8cc-b5009e18200a/metadata returned with HTTP 200 May 28 13:06:58 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1457/2893] 10.27.203.238 () {64 vars in 1487 bytes} [Tue May 28 13:06:58 2024] GET /share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/aa5ec314-e632-4fbb-b8cc-b5009e18200a/metadata => generated 282 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:06:58 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-3a9ad600-85c1-4b7a-ab6a-16877d95b6cf tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] PUT http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/aa5ec314-e632-4fbb-b8cc-b5009e18200a/metadata May 28 13:06:58 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-3a9ad600-85c1-4b7a-ab6a-16877d95b6cf tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Action: 'update_all_metadata', calling method: Controller.__getattribute__..version_select, body: {"metadata": {"key": "vvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvv"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:06:58 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-3a9ad600-85c1-4b7a-ab6a-16877d95b6cf tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/aa5ec314-e632-4fbb-b8cc-b5009e18200a/metadata returned with HTTP 200 May 28 13:06:58 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1437/2894] 10.27.203.238 () {66 vars in 1509 bytes} [Tue May 28 13:06:58 2024] PUT /share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/aa5ec314-e632-4fbb-b8cc-b5009e18200a/metadata => generated 1048 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:06:58 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-993bbb2d-9eda-4723-93f2-a2b900f0e72d tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] GET http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/aa5ec314-e632-4fbb-b8cc-b5009e18200a/metadata May 28 13:06:58 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-993bbb2d-9eda-4723-93f2-a2b900f0e72d tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:06:58 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-993bbb2d-9eda-4723-93f2-a2b900f0e72d tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:06:58 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-993bbb2d-9eda-4723-93f2-a2b900f0e72d tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/aa5ec314-e632-4fbb-b8cc-b5009e18200a/metadata returned with HTTP 200 May 28 13:06:58 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1458/2895] 10.27.203.238 () {64 vars in 1487 bytes} [Tue May 28 13:06:58 2024] GET /share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/aa5ec314-e632-4fbb-b8cc-b5009e18200a/metadata => generated 1048 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:06:58 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-5d1bfb7f-b629-4479-a449-56e1c1c370c3 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] PUT http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/aa5ec314-e632-4fbb-b8cc-b5009e18200a/metadata May 28 13:06:58 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-5d1bfb7f-b629-4479-a449-56e1c1c370c3 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Action: 'update_all_metadata', calling method: Controller.__getattribute__..version_select, body: {"metadata": {"k": "value"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:06:59 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-5d1bfb7f-b629-4479-a449-56e1c1c370c3 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/aa5ec314-e632-4fbb-b8cc-b5009e18200a/metadata returned with HTTP 200 May 28 13:06:59 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1438/2896] 10.27.203.238 () {66 vars in 1507 bytes} [Tue May 28 13:06:58 2024] PUT /share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/aa5ec314-e632-4fbb-b8cc-b5009e18200a/metadata => generated 28 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:06:59 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-672c2043-0f2d-4dfb-bc86-694636f998e5 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] GET http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/aa5ec314-e632-4fbb-b8cc-b5009e18200a/metadata May 28 13:06:59 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-672c2043-0f2d-4dfb-bc86-694636f998e5 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:06:59 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-672c2043-0f2d-4dfb-bc86-694636f998e5 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:06:59 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-672c2043-0f2d-4dfb-bc86-694636f998e5 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/aa5ec314-e632-4fbb-b8cc-b5009e18200a/metadata returned with HTTP 200 May 28 13:06:59 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1459/2897] 10.27.203.238 () {64 vars in 1487 bytes} [Tue May 28 13:06:59 2024] GET /share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/aa5ec314-e632-4fbb-b8cc-b5009e18200a/metadata => generated 28 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:06:59 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-7c4059e2-e14a-459d-b901-d7c740e1cdd5 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] PUT http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/aa5ec314-e632-4fbb-b8cc-b5009e18200a/metadata May 28 13:06:59 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-7c4059e2-e14a-459d-b901-d7c740e1cdd5 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Action: 'update_all_metadata', calling method: Controller.__getattribute__..version_select, body: {"metadata": {"key": "v"}} {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}} May 28 13:06:59 l75lg1-v1 dstat.sh[49771]: 28-05 13:06:59| 9 1 89 1 0|5504M 1903M 278M 7938M| 11k 12k| 0 828k| 0 137 |4045 7237 |0.40 0.86 0.96|1.0 0 2.0| 0 0 | 0 2048M| 29 358 0 7 8 May 28 13:06:59 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-7c4059e2-e14a-459d-b901-d7c740e1cdd5 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/aa5ec314-e632-4fbb-b8cc-b5009e18200a/metadata returned with HTTP 200 May 28 13:06:59 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1439/2898] 10.27.203.238 () {66 vars in 1507 bytes} [Tue May 28 13:06:59 2024] PUT /share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/aa5ec314-e632-4fbb-b8cc-b5009e18200a/metadata => generated 26 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:06:59 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-db52cccc-2568-449c-98e9-b24aa1d71d09 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] GET http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/aa5ec314-e632-4fbb-b8cc-b5009e18200a/metadata May 28 13:06:59 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-db52cccc-2568-449c-98e9-b24aa1d71d09 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:06:59 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-db52cccc-2568-449c-98e9-b24aa1d71d09 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:06:59 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-db52cccc-2568-449c-98e9-b24aa1d71d09 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/aa5ec314-e632-4fbb-b8cc-b5009e18200a/metadata returned with HTTP 200 May 28 13:06:59 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1460/2899] 10.27.203.238 () {64 vars in 1487 bytes} [Tue May 28 13:06:59 2024] GET /share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/aa5ec314-e632-4fbb-b8cc-b5009e18200a/metadata => generated 26 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deb7bc0-f1d0-4298-8bfe-0b9a7504e0bb service manila] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deb7bc0-f1d0-4298-8bfe-0b9a7504e0bb service manila] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1387cd-208b-4655-9feb-444c0c61200d tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f5fc5b71cc041f792aff79543d3842e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34275d855b714711982480692b7c6977', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1387cd-208b-4655-9feb-444c0c61200d tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1387cd-208b-4655-9feb-444c0c61200d tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1387cd-208b-4655-9feb-444c0c61200d tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] PATH_INFO: `/v3/users/8688f80695814f34bfb56342c4e54028` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1387cd-208b-4655-9feb-444c0c61200d tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] RBAC: Authorizing `identity:delete_user(user_id=8688f80695814f34bfb56342c4e54028)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1387cd-208b-4655-9feb-444c0c61200d tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-cc1387cd-208b-4655-9feb-444c0c61200d tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] Could not find user: 8688f80695814f34bfb56342c4e54028.: keystone.exception.UserNotFound: Could not find user: 8688f80695814f34bfb56342c4e54028. May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 8688f80695814f34bfb56342c4e54028. May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1884/3736] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:06:59 2024] DELETE /identity/v3/users/8688f80695814f34bfb56342c4e54028 => generated 110 bytes in 26 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cf8a44-5170-4e76-b6a1-6b1995f3b50b service placement] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cf8a44-5170-4e76-b6a1-6b1995f3b50b service placement] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a665f76d-5ef5-4a2b-bdf8-26c006408906 tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f5fc5b71cc041f792aff79543d3842e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34275d855b714711982480692b7c6977', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a665f76d-5ef5-4a2b-bdf8-26c006408906 tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a665f76d-5ef5-4a2b-bdf8-26c006408906 tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a665f76d-5ef5-4a2b-bdf8-26c006408906 tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] PATH_INFO: `/v3/users/108a25e436e9452a9a865957dcea1fc5` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a665f76d-5ef5-4a2b-bdf8-26c006408906 tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] RBAC: Authorizing `identity:delete_user(user_id=108a25e436e9452a9a865957dcea1fc5)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a665f76d-5ef5-4a2b-bdf8-26c006408906 tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-a665f76d-5ef5-4a2b-bdf8-26c006408906 tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] Could not find user: 108a25e436e9452a9a865957dcea1fc5.: keystone.exception.UserNotFound: Could not find user: 108a25e436e9452a9a865957dcea1fc5. May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 108a25e436e9452a9a865957dcea1fc5. May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1853/3737] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:06:59 2024] DELETE /identity/v3/users/108a25e436e9452a9a865957dcea1fc5 => generated 110 bytes in 24 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1387cd-208b-4655-9feb-444c0c61200d tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1387cd-208b-4655-9feb-444c0c61200d tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7a1e83-7e59-4aad-8c48-c949a8140ce0 tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f5fc5b71cc041f792aff79543d3842e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34275d855b714711982480692b7c6977', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7a1e83-7e59-4aad-8c48-c949a8140ce0 tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7a1e83-7e59-4aad-8c48-c949a8140ce0 tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7a1e83-7e59-4aad-8c48-c949a8140ce0 tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] PATH_INFO: `/v3/users/5ae5cb1db3504baaba1df93dc154a004` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7a1e83-7e59-4aad-8c48-c949a8140ce0 tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] RBAC: Authorizing `identity:delete_user(user_id=5ae5cb1db3504baaba1df93dc154a004)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7a1e83-7e59-4aad-8c48-c949a8140ce0 tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-ee7a1e83-7e59-4aad-8c48-c949a8140ce0 tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] Could not find user: 5ae5cb1db3504baaba1df93dc154a004.: keystone.exception.UserNotFound: Could not find user: 5ae5cb1db3504baaba1df93dc154a004. May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 5ae5cb1db3504baaba1df93dc154a004. May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1885/3738] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:06:59 2024] DELETE /identity/v3/users/5ae5cb1db3504baaba1df93dc154a004 => generated 110 bytes in 23 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a665f76d-5ef5-4a2b-bdf8-26c006408906 tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a665f76d-5ef5-4a2b-bdf8-26c006408906 tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5767a5-6bac-489d-a597-b6bea50117bc tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f5fc5b71cc041f792aff79543d3842e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34275d855b714711982480692b7c6977', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5767a5-6bac-489d-a597-b6bea50117bc tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5767a5-6bac-489d-a597-b6bea50117bc tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5767a5-6bac-489d-a597-b6bea50117bc tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] PATH_INFO: `/v3/users/c2ac6ca3ea5a4ae498df6d12bb7caadc` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5767a5-6bac-489d-a597-b6bea50117bc tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] RBAC: Authorizing `identity:delete_user(user_id=c2ac6ca3ea5a4ae498df6d12bb7caadc)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5767a5-6bac-489d-a597-b6bea50117bc tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-aa5767a5-6bac-489d-a597-b6bea50117bc tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] Could not find user: c2ac6ca3ea5a4ae498df6d12bb7caadc.: keystone.exception.UserNotFound: Could not find user: c2ac6ca3ea5a4ae498df6d12bb7caadc. May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: c2ac6ca3ea5a4ae498df6d12bb7caadc. May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1854/3739] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:06:59 2024] DELETE /identity/v3/users/c2ac6ca3ea5a4ae498df6d12bb7caadc => generated 110 bytes in 23 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7a1e83-7e59-4aad-8c48-c949a8140ce0 tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7a1e83-7e59-4aad-8c48-c949a8140ce0 tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7336ae8a-2c5f-4a39-a05b-37cf991532c5 tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f5fc5b71cc041f792aff79543d3842e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34275d855b714711982480692b7c6977', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7336ae8a-2c5f-4a39-a05b-37cf991532c5 tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7336ae8a-2c5f-4a39-a05b-37cf991532c5 tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7336ae8a-2c5f-4a39-a05b-37cf991532c5 tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] PATH_INFO: `/v3/users/f89f851af36d480ab7d10d3506c60899` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7336ae8a-2c5f-4a39-a05b-37cf991532c5 tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] RBAC: Authorizing `identity:delete_user(user_id=f89f851af36d480ab7d10d3506c60899)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7336ae8a-2c5f-4a39-a05b-37cf991532c5 tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-7336ae8a-2c5f-4a39-a05b-37cf991532c5 tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] Could not find user: f89f851af36d480ab7d10d3506c60899.: keystone.exception.UserNotFound: Could not find user: f89f851af36d480ab7d10d3506c60899. May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: f89f851af36d480ab7d10d3506c60899. May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1886/3740] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:06:59 2024] DELETE /identity/v3/users/f89f851af36d480ab7d10d3506c60899 => generated 110 bytes in 22 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5767a5-6bac-489d-a597-b6bea50117bc tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5767a5-6bac-489d-a597-b6bea50117bc tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955e6f40-6399-42f6-8f76-5923312f22f9 tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f5fc5b71cc041f792aff79543d3842e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34275d855b714711982480692b7c6977', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955e6f40-6399-42f6-8f76-5923312f22f9 tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955e6f40-6399-42f6-8f76-5923312f22f9 tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955e6f40-6399-42f6-8f76-5923312f22f9 tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] PATH_INFO: `/v3/users/6886717a9cfb42a0a4142a0b982570ee` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955e6f40-6399-42f6-8f76-5923312f22f9 tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] RBAC: Authorizing `identity:delete_user(user_id=6886717a9cfb42a0a4142a0b982570ee)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955e6f40-6399-42f6-8f76-5923312f22f9 tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-955e6f40-6399-42f6-8f76-5923312f22f9 tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] Could not find user: 6886717a9cfb42a0a4142a0b982570ee.: keystone.exception.UserNotFound: Could not find user: 6886717a9cfb42a0a4142a0b982570ee. May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 6886717a9cfb42a0a4142a0b982570ee. May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1855/3741] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:06:59 2024] DELETE /identity/v3/users/6886717a9cfb42a0a4142a0b982570ee => generated 110 bytes in 23 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7336ae8a-2c5f-4a39-a05b-37cf991532c5 tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7336ae8a-2c5f-4a39-a05b-37cf991532c5 tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c27f99-6217-4bfc-95a2-32a4716c30f7 tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f5fc5b71cc041f792aff79543d3842e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34275d855b714711982480692b7c6977', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c27f99-6217-4bfc-95a2-32a4716c30f7 tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c27f99-6217-4bfc-95a2-32a4716c30f7 tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c27f99-6217-4bfc-95a2-32a4716c30f7 tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] PATH_INFO: `/v3/users/b523155e680a4a14acd4f3a4295a8d26` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c27f99-6217-4bfc-95a2-32a4716c30f7 tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] RBAC: Authorizing `identity:delete_user(user_id=b523155e680a4a14acd4f3a4295a8d26)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c27f99-6217-4bfc-95a2-32a4716c30f7 tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:06:59 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-22c27f99-6217-4bfc-95a2-32a4716c30f7 tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] Could not find user: b523155e680a4a14acd4f3a4295a8d26.: keystone.exception.UserNotFound: Could not find user: b523155e680a4a14acd4f3a4295a8d26. May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: b523155e680a4a14acd4f3a4295a8d26. May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1887/3742] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:06:59 2024] DELETE /identity/v3/users/b523155e680a4a14acd4f3a4295a8d26 => generated 110 bytes in 26 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955e6f40-6399-42f6-8f76-5923312f22f9 tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955e6f40-6399-42f6-8f76-5923312f22f9 tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7df2a8-8033-49de-94b5-639968cbbcdd tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f5fc5b71cc041f792aff79543d3842e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34275d855b714711982480692b7c6977', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7df2a8-8033-49de-94b5-639968cbbcdd tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7df2a8-8033-49de-94b5-639968cbbcdd tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7df2a8-8033-49de-94b5-639968cbbcdd tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] PATH_INFO: `/v3/users/756070dd0b274fd8835b10a8fbe293d9` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7df2a8-8033-49de-94b5-639968cbbcdd tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] RBAC: Authorizing `identity:delete_user(user_id=756070dd0b274fd8835b10a8fbe293d9)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7df2a8-8033-49de-94b5-639968cbbcdd tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-6a7df2a8-8033-49de-94b5-639968cbbcdd tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] Could not find user: 756070dd0b274fd8835b10a8fbe293d9.: keystone.exception.UserNotFound: Could not find user: 756070dd0b274fd8835b10a8fbe293d9. May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 756070dd0b274fd8835b10a8fbe293d9. May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1856/3743] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:06:59 2024] DELETE /identity/v3/users/756070dd0b274fd8835b10a8fbe293d9 => generated 110 bytes in 27 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c27f99-6217-4bfc-95a2-32a4716c30f7 tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c27f99-6217-4bfc-95a2-32a4716c30f7 tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4545d7b8-518e-4edd-9c6c-6844ba82c6d1 tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f5fc5b71cc041f792aff79543d3842e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34275d855b714711982480692b7c6977', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4545d7b8-518e-4edd-9c6c-6844ba82c6d1 tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4545d7b8-518e-4edd-9c6c-6844ba82c6d1 tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4545d7b8-518e-4edd-9c6c-6844ba82c6d1 tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] PATH_INFO: `/v3/users/cdf8594f55cb448e9b2312d051486331` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4545d7b8-518e-4edd-9c6c-6844ba82c6d1 tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] RBAC: Authorizing `identity:delete_user(user_id=cdf8594f55cb448e9b2312d051486331)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4545d7b8-518e-4edd-9c6c-6844ba82c6d1 tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-4545d7b8-518e-4edd-9c6c-6844ba82c6d1 tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] Could not find user: cdf8594f55cb448e9b2312d051486331.: keystone.exception.UserNotFound: Could not find user: cdf8594f55cb448e9b2312d051486331. May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cdf8594f55cb448e9b2312d051486331. May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1888/3744] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:06:59 2024] DELETE /identity/v3/users/cdf8594f55cb448e9b2312d051486331 => generated 110 bytes in 23 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7df2a8-8033-49de-94b5-639968cbbcdd tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7df2a8-8033-49de-94b5-639968cbbcdd tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8fdaa8-bdbd-46fd-b19d-a6561a8b79ec tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f5fc5b71cc041f792aff79543d3842e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34275d855b714711982480692b7c6977', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8fdaa8-bdbd-46fd-b19d-a6561a8b79ec tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8fdaa8-bdbd-46fd-b19d-a6561a8b79ec tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8fdaa8-bdbd-46fd-b19d-a6561a8b79ec tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] PATH_INFO: `/v3/users/a3784840ad6a4156929be55026b39776` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8fdaa8-bdbd-46fd-b19d-a6561a8b79ec tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] RBAC: Authorizing `identity:delete_user(user_id=a3784840ad6a4156929be55026b39776)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8fdaa8-bdbd-46fd-b19d-a6561a8b79ec tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-2c8fdaa8-bdbd-46fd-b19d-a6561a8b79ec tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] Could not find user: a3784840ad6a4156929be55026b39776.: keystone.exception.UserNotFound: Could not find user: a3784840ad6a4156929be55026b39776. May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: a3784840ad6a4156929be55026b39776. May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1857/3745] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:06:59 2024] DELETE /identity/v3/users/a3784840ad6a4156929be55026b39776 => generated 110 bytes in 22 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4545d7b8-518e-4edd-9c6c-6844ba82c6d1 tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4545d7b8-518e-4edd-9c6c-6844ba82c6d1 tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f74777-201d-4641-9b2e-cc84d62d8400 tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f5fc5b71cc041f792aff79543d3842e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34275d855b714711982480692b7c6977', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f74777-201d-4641-9b2e-cc84d62d8400 tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f74777-201d-4641-9b2e-cc84d62d8400 tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f74777-201d-4641-9b2e-cc84d62d8400 tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] PATH_INFO: `/v3/users/93bc07dfcf2c4861981da16395bddbc0` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f74777-201d-4641-9b2e-cc84d62d8400 tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] RBAC: Authorizing `identity:delete_user(user_id=93bc07dfcf2c4861981da16395bddbc0)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f74777-201d-4641-9b2e-cc84d62d8400 tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-a7f74777-201d-4641-9b2e-cc84d62d8400 tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] Could not find user: 93bc07dfcf2c4861981da16395bddbc0.: keystone.exception.UserNotFound: Could not find user: 93bc07dfcf2c4861981da16395bddbc0. May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 93bc07dfcf2c4861981da16395bddbc0. May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1889/3746] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:06:59 2024] DELETE /identity/v3/users/93bc07dfcf2c4861981da16395bddbc0 => generated 110 bytes in 22 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8fdaa8-bdbd-46fd-b19d-a6561a8b79ec tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8fdaa8-bdbd-46fd-b19d-a6561a8b79ec tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06d3e57-75af-458c-91b3-ba66e6b4c19e tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f5fc5b71cc041f792aff79543d3842e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34275d855b714711982480692b7c6977', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06d3e57-75af-458c-91b3-ba66e6b4c19e tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06d3e57-75af-458c-91b3-ba66e6b4c19e tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06d3e57-75af-458c-91b3-ba66e6b4c19e tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] PATH_INFO: `/v3/users/080fdf25a1154b6db0ae228e1c05b6b2` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06d3e57-75af-458c-91b3-ba66e6b4c19e tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] RBAC: Authorizing `identity:delete_user(user_id=080fdf25a1154b6db0ae228e1c05b6b2)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06d3e57-75af-458c-91b3-ba66e6b4c19e tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-b06d3e57-75af-458c-91b3-ba66e6b4c19e tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] Could not find user: 080fdf25a1154b6db0ae228e1c05b6b2.: keystone.exception.UserNotFound: Could not find user: 080fdf25a1154b6db0ae228e1c05b6b2. May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 080fdf25a1154b6db0ae228e1c05b6b2. May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1858/3747] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:06:59 2024] DELETE /identity/v3/users/080fdf25a1154b6db0ae228e1c05b6b2 => generated 110 bytes in 23 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f74777-201d-4641-9b2e-cc84d62d8400 tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f74777-201d-4641-9b2e-cc84d62d8400 tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc534814-a2c8-4193-a94c-0039fc7af60a tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f5fc5b71cc041f792aff79543d3842e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34275d855b714711982480692b7c6977', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc534814-a2c8-4193-a94c-0039fc7af60a tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc534814-a2c8-4193-a94c-0039fc7af60a tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc534814-a2c8-4193-a94c-0039fc7af60a tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] PATH_INFO: `/v3/users/80737d9a590d4944acb593a5812e9c87` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc534814-a2c8-4193-a94c-0039fc7af60a tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] RBAC: Authorizing `identity:delete_user(user_id=80737d9a590d4944acb593a5812e9c87)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc534814-a2c8-4193-a94c-0039fc7af60a tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-bc534814-a2c8-4193-a94c-0039fc7af60a tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] Could not find user: 80737d9a590d4944acb593a5812e9c87.: keystone.exception.UserNotFound: Could not find user: 80737d9a590d4944acb593a5812e9c87. May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 80737d9a590d4944acb593a5812e9c87. May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1890/3748] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:06:59 2024] DELETE /identity/v3/users/80737d9a590d4944acb593a5812e9c87 => generated 110 bytes in 23 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06d3e57-75af-458c-91b3-ba66e6b4c19e tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06d3e57-75af-458c-91b3-ba66e6b4c19e tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaa08c9-2381-43ae-96cb-baeb6b92ff14 tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f5fc5b71cc041f792aff79543d3842e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34275d855b714711982480692b7c6977', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaa08c9-2381-43ae-96cb-baeb6b92ff14 tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaa08c9-2381-43ae-96cb-baeb6b92ff14 tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaa08c9-2381-43ae-96cb-baeb6b92ff14 tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] PATH_INFO: `/v3/users/0db23a1570c14747b7d0cfd63c25831d` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbaa08c9-2381-43ae-96cb-baeb6b92ff14 tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] RBAC: Authorizing `identity:delete_user(user_id=0db23a1570c14747b7d0cfd63c25831d)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbaa08c9-2381-43ae-96cb-baeb6b92ff14 tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application [None req-bbaa08c9-2381-43ae-96cb-baeb6b92ff14 tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] Could not find user: 0db23a1570c14747b7d0cfd63c25831d.: keystone.exception.UserNotFound: Could not find user: 0db23a1570c14747b7d0cfd63c25831d. May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application with Lock( May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self._enter() May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application return self.creator() May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application created_value = creator( May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 0db23a1570c14747b7d0cfd63c25831d. May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: ERROR keystone.server.flask.application May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1859/3749] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:06:59 2024] DELETE /identity/v3/users/0db23a1570c14747b7d0cfd63c25831d => generated 110 bytes in 23 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc534814-a2c8-4193-a94c-0039fc7af60a tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc534814-a2c8-4193-a94c-0039fc7af60a tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532735dc-1548-49f8-a177-ac70fa600524 tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f5fc5b71cc041f792aff79543d3842e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34275d855b714711982480692b7c6977', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532735dc-1548-49f8-a177-ac70fa600524 tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532735dc-1548-49f8-a177-ac70fa600524 tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532735dc-1548-49f8-a177-ac70fa600524 tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] PATH_INFO: `/v3/users/76e042fad4114f4cb24f96afe38c72b8` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532735dc-1548-49f8-a177-ac70fa600524 tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] RBAC: Authorizing `identity:delete_user(user_id=76e042fad4114f4cb24f96afe38c72b8)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532735dc-1548-49f8-a177-ac70fa600524 tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application [None req-532735dc-1548-49f8-a177-ac70fa600524 tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] Could not find user: 76e042fad4114f4cb24f96afe38c72b8.: keystone.exception.UserNotFound: Could not find user: 76e042fad4114f4cb24f96afe38c72b8. May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application Traceback (most recent call last): May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 880, in full_dispatch_request May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/app.py", line 865, in dispatch_request May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 489, in wrapper May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask/views.py", line 110, in view May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/flask_restful/__init__.py", line 604, in dispatch_request May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user( May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 110, in wrapped May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/decorator.py", line 232, in fun May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1634, in get_or_create_for_user_func May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.get_or_create( May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1094, in get_or_create May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application with Lock( May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 185, in __enter__ May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self._enter() May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 94, in _enter May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py", line 178, in _enter_create May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application return self.creator() May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py", line 1048, in gen_value May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application created_value = creator( May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 76e042fad4114f4cb24f96afe38c72b8. May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: ERROR keystone.server.flask.application May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1891/3750] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:06:59 2024] DELETE /identity/v3/users/76e042fad4114f4cb24f96afe38c72b8 => generated 110 bytes in 24 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaa08c9-2381-43ae-96cb-baeb6b92ff14 tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaa08c9-2381-43ae-96cb-baeb6b92ff14 tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fff69b-1998-45ee-88c9-e0d38acc725e tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f5fc5b71cc041f792aff79543d3842e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34275d855b714711982480692b7c6977', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fff69b-1998-45ee-88c9-e0d38acc725e tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fff69b-1998-45ee-88c9-e0d38acc725e tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fff69b-1998-45ee-88c9-e0d38acc725e tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] PATH_INFO: `/v3/users/f107256e153949edb4400e34294b8223` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fff69b-1998-45ee-88c9-e0d38acc725e tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] RBAC: Authorizing `identity:delete_user(user_id=f107256e153949edb4400e34294b8223)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fff69b-1998-45ee-88c9-e0d38acc725e tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-85fff69b-1998-45ee-88c9-e0d38acc725e tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f107256e153949edb4400e34294b8223', 'request_id': 'req-85fff69b-1998-45ee-88c9-e0d38acc725e'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-85fff69b-1998-45ee-88c9-e0d38acc725e tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f107256e153949edb4400e34294b8223', 'request_id': 'req-85fff69b-1998-45ee-88c9-e0d38acc725e'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:06:59 l75lg1-v1 nova-conductor[83647]: DEBUG dbcounter [-] [83647] Writing DB stats nova_cell1:SELECT=1,nova_cell1:UPDATE=1 {{(pid=83647) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-85fff69b-1998-45ee-88c9-e0d38acc725e tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f107256e153949edb4400e34294b8223', 'request_id': 'req-85fff69b-1998-45ee-88c9-e0d38acc725e'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-85fff69b-1998-45ee-88c9-e0d38acc725e tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f107256e153949edb4400e34294b8223', 'request_id': 'req-85fff69b-1998-45ee-88c9-e0d38acc725e'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-85fff69b-1998-45ee-88c9-e0d38acc725e tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f107256e153949edb4400e34294b8223', 'request_id': 'req-85fff69b-1998-45ee-88c9-e0d38acc725e'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:06:59 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1860/3751] 10.27.203.238 () {62 vars in 1312 bytes} [Tue May 28 13:06:59 2024] DELETE /identity/v3/users/f107256e153949edb4400e34294b8223 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:06:59 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-34570bf1-f60f-44ca-a7b9-8c7075a972a1 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] DELETE http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/aa5ec314-e632-4fbb-b8cc-b5009e18200a May 28 13:06:59 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-34570bf1-f60f-44ca-a7b9-8c7075a972a1 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:06:59 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-34570bf1-f60f-44ca-a7b9-8c7075a972a1 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Calling method 'ShareSnapshotMixin.delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:06:59 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.v1.share_snapshots [None req-34570bf1-f60f-44ca-a7b9-8c7075a972a1 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Delete snapshot with id: aa5ec314-e632-4fbb-b8cc-b5009e18200a May 28 13:06:59 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-34570bf1-f60f-44ca-a7b9-8c7075a972a1 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/aa5ec314-e632-4fbb-b8cc-b5009e18200a returned with HTTP 202 May 28 13:06:59 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1440/2900] 10.27.203.238 () {64 vars in 1463 bytes} [Tue May 28 13:06:59 2024] DELETE /share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/aa5ec314-e632-4fbb-b8cc-b5009e18200a => generated 0 bytes in 93 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 13:06:59 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-24b0adea-2486-4f68-aa9d-dcf9aa4464bf tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] GET http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/aa5ec314-e632-4fbb-b8cc-b5009e18200a May 28 13:06:59 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-24b0adea-2486-4f68-aa9d-dcf9aa4464bf tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:06:59 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-24b0adea-2486-4f68-aa9d-dcf9aa4464bf tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Calling method 'ShareSnapshotMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:07:00 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-24b0adea-2486-4f68-aa9d-dcf9aa4464bf tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/aa5ec314-e632-4fbb-b8cc-b5009e18200a returned with HTTP 200 May 28 13:07:00 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1461/2901] 10.27.203.238 () {64 vars in 1460 bytes} [Tue May 28 13:06:59 2024] GET /share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/aa5ec314-e632-4fbb-b8cc-b5009e18200a => generated 757 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 231 bytes (1 switches on core 0) May 28 13:07:00 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-34570bf1-f60f-44ca-a7b9-8c7075a972a1 tempest-ShareSnapshotMetadataTest-331543469 None] >>> [GET] https://127.0.0.1:40443/api/snapshots/ May 28 13:07:00 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-34570bf1-f60f-44ca-a7b9-8c7075a972a1 tempest-ShareSnapshotMetadataTest-331543469 None] {'allow_redirects': True, May 28 13:07:00 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-34570bf1-f60f-44ca-a7b9-8c7075a972a1 tempest-ShareSnapshotMetadataTest-331543469 None] 'params': {'name': 'share-snapshot-0c338135-50a5-415e-8545-5c4e7920eb7c'}} May 28 13:07:00 l75lg1-v1 nova-conductor[83648]: DEBUG dbcounter [-] [83648] Writing DB stats nova_cell1:SELECT=1 {{(pid=83648) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:07:00 l75lg1-v1 dstat.sh[49771]: 28-05 13:07:00| 9 1 88 1 0|5505M 1901M 278M 7939M| 12k 2080B| 0 821k| 0 136 |6872 11k|0.40 0.86 0.96|1.0 0 0| 0 0 | 0 2048M| 29 357 0 7 8 May 28 13:07:00 l75lg1-v1 neutron-server[77618]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.HashRingHealthCheckPeriodics.touch_hash_ring_nodes' {{(pid=77618) _process_scheduled /opt/stack/data/venv/lib/python3.10/site-packages/futurist/periodics.py:638}} May 28 13:07:00 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-34570bf1-f60f-44ca-a7b9-8c7075a972a1 tempest-ShareSnapshotMetadataTest-331543469 None] <<< [GET] https://127.0.0.1:40443/api/snapshots/ May 28 13:07:00 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-34570bf1-f60f-44ca-a7b9-8c7075a972a1 tempest-ShareSnapshotMetadataTest-331543469 None] [Bunch(access_path='/.vast_all_snapshots/1000000019_share-snapshot-0c338135-50a5-415e-8545-5c4e7920eb7c', aggr_phys_estimation=0, cluster='loop75-kfs', created='2024-05-28T13:06:07.738144Z', eta_sec=30819898377.624294, expiration_time='3001-01-19T07:59:58Z', guid='b763f06e-0f17-4311-b328-13f02faae86b', id=20, indestructible=False, locked=False, name='share-snapshot-0c338135-50a5-415e-8545-5c4e7920eb7c', path='/manila/manila-32260cfb-2f6c-471f-8668-cd9a33828137/', policy=None, policy_id=None, protection_policy_id=None, state='SUCCEED', tenant_id=1, tenant_name='default', title='share-snapshot-0c338135-50a5-415e-8545-5c4e7920eb7c(/manila/manila-32260cfb-2f6c-471f-8668-cd9a33828137/)', type='local', unique_phys_estimation=0, url='https://127.0.0.1:40443/api/snapshots/20/')] May 28 13:07:00 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-34570bf1-f60f-44ca-a7b9-8c7075a972a1 tempest-ShareSnapshotMetadataTest-331543469 None] --- [GET] https://127.0.0.1:40443/api/snapshots/: Done May 28 13:07:00 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-34570bf1-f60f-44ca-a7b9-8c7075a972a1 tempest-ShareSnapshotMetadataTest-331543469 None] >>> [DELETE] https://127.0.0.1:40443/api/snapshots/20/ May 28 13:07:00 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 13:07:00 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.manager [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Starting heal instance info cache {{(pid=83654) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}} May 28 13:07:00 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.manager [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Rebuilding the list of instances to heal {{(pid=83654) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9930}} May 28 13:07:00 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Expecting reply to msg 6ddc39e0d9c74bec83515faec21f6cd5 in queue reply_37f4cbd1dd094961a22b8a65f222c327 May 28 13:07:00 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [-] Received RPC response for msg 6ddc39e0d9c74bec83515faec21f6cd5 May 28 13:07:01 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.manager [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Didn't find any instances for network info cache update. {{(pid=83654) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10012}} May 28 13:07:01 l75lg1-v1 dstat.sh[49771]: 28-05 13:07:01| 1 1 95 3 0|5505M 1901M 278M 7939M| 23k 719B| 0 7944k| 0 816 |3240 4873 |0.40 0.86 0.96|1.0 0 0| 0 0 | 0 2048M| 29 357 0 3 8 May 28 13:07:01 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 13:07:01 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 13:07:01 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-34570bf1-f60f-44ca-a7b9-8c7075a972a1 tempest-ShareSnapshotMetadataTest-331543469 None] <<< [DELETE] https://127.0.0.1:40443/api/snapshots/20/ May 28 13:07:01 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-34570bf1-f60f-44ca-a7b9-8c7075a972a1 tempest-ShareSnapshotMetadataTest-331543469 None] --- [DELETE] https://127.0.0.1:40443/api/snapshots/20/: Done May 28 13:07:01 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-34570bf1-f60f-44ca-a7b9-8c7075a972a1 tempest-ShareSnapshotMetadataTest-331543469 None] Created reservations ['72270f6f-3f46-46e8-b351-d2ef9bb6d9bb', 'be70312d-1dea-4ffc-81ad-f52b69848d27', '90d25e2b-6253-4c60-9522-41d762eceff6', 'c5b06597-6e6e-4495-ad7c-7d220e53b954'] {{(pid=98474) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 13:07:01 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-34570bf1-f60f-44ca-a7b9-8c7075a972a1 tempest-ShareSnapshotMetadataTest-331543469 None] Committed reservations ['72270f6f-3f46-46e8-b351-d2ef9bb6d9bb', 'be70312d-1dea-4ffc-81ad-f52b69848d27', '90d25e2b-6253-4c60-9522-41d762eceff6', 'c5b06597-6e6e-4495-ad7c-7d220e53b954'] {{(pid=98474) commit /opt/stack/manila/manila/quota.py:1063}} May 28 13:07:02 l75lg1-v1 manila-scheduler[98327]: DEBUG dbcounter [-] [98327] Writing DB stats manila:SELECT=35,manila:UPDATE=8 {{(pid=98327) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:07:02 l75lg1-v1 dstat.sh[49771]: 28-05 13:07:02| 2 0 96 1 0|5505M 1901M 278M 7939M| 23k 66B| 0 628k| 0 115 |2777 4350 |0.40 0.86 0.96|1.0 0 0| 0 0 | 0 2048M| 29 357 0 3 8 May 28 13:07:02 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager.update_available_resource {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 13:07:02 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Expecting reply to msg 57a71d5d19ff4ccb88bc79f1a62a4573 in queue reply_37f4cbd1dd094961a22b8a65f222c327 May 28 13:07:02 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [-] Received RPC response for msg 57a71d5d19ff4ccb88bc79f1a62a4573 May 28 13:07:03 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-9fbd4595-0824-41b7-a3e8-6f657641f7c5 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] GET http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/aa5ec314-e632-4fbb-b8cc-b5009e18200a May 28 13:07:03 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-9fbd4595-0824-41b7-a3e8-6f657641f7c5 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:07:03 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-9fbd4595-0824-41b7-a3e8-6f657641f7c5 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Calling method 'ShareSnapshotMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:07:03 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-9fbd4595-0824-41b7-a3e8-6f657641f7c5 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] HTTP exception thrown: The resource could not be found. May 28 13:07:03 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-9fbd4595-0824-41b7-a3e8-6f657641f7c5 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/aa5ec314-e632-4fbb-b8cc-b5009e18200a returned with HTTP 404 May 28 13:07:03 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1441/2902] 10.27.203.238 () {64 vars in 1460 bytes} [Tue May 28 13:07:03 2024] GET /share/v2/9c1e3ce524bc424eae1e9467bc390dec/snapshots/aa5ec314-e632-4fbb-b8cc-b5009e18200a => generated 78 bytes in 15 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 13:07:03 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-cbbbd7f6-b925-40fd-9d70-d08d29d5a69b tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] GET http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/share-replicas/detail?share_id=41a07ae7-d107-493e-8a00-5ada346ac16c May 28 13:07:03 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-cbbbd7f6-b925-40fd-9d70-d08d29d5a69b tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:07:03 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-cbbbd7f6-b925-40fd-9d70-d08d29d5a69b tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Calling method 'Controller.__getattribute__..version_select' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:07:03 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-cbbbd7f6-b925-40fd-9d70-d08d29d5a69b tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/share-replicas/detail?share_id=41a07ae7-d107-493e-8a00-5ada346ac16c returned with HTTP 200 May 28 13:07:03 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1462/2903] 10.27.203.238 () {64 vars in 1476 bytes} [Tue May 28 13:07:03 2024] GET /share/v2/9c1e3ce524bc424eae1e9467bc390dec/share-replicas/detail?share_id=41a07ae7-d107-493e-8a00-5ada346ac16c => generated 22 bytes in 13 msecs (HTTP/1.1 200) 6 headers in 230 bytes (1 switches on core 0) May 28 13:07:03 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-d10a9919-9a62-4d1f-bf23-4072a1d39de5 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] DELETE http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/shares/41a07ae7-d107-493e-8a00-5ada346ac16c May 28 13:07:03 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-d10a9919-9a62-4d1f-bf23-4072a1d39de5 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:07:03 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-d10a9919-9a62-4d1f-bf23-4072a1d39de5 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Calling method 'ShareMixin.delete' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:07:03 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.v1.shares [None req-d10a9919-9a62-4d1f-bf23-4072a1d39de5 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Delete share with id: 41a07ae7-d107-493e-8a00-5ada346ac16c May 28 13:07:03 l75lg1-v1 nova-compute[83654]: DEBUG oslo_concurrency.lockutils [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=83654) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:07:03 l75lg1-v1 nova-compute[83654]: DEBUG oslo_concurrency.lockutils [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=83654) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:07:03 l75lg1-v1 nova-compute[83654]: DEBUG oslo_concurrency.lockutils [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=83654) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:07:03 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.resource_tracker [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Auditing locally available compute resources for l75lg1-v1 (node: l75lg1-v1) {{(pid=83654) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}} May 28 13:07:03 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.resource_tracker [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Hypervisor/Node resource view: name=l75lg1-v1 free_ram=10117MB free_disk=15.53482437133789GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_01_1", "address": "0000:00:01.1", "product_id": "7010", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7010", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7000", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7000", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "0100", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_0100", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_09_0", "address": "0000:00:09.0", "product_id": "1001", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1001", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "293a", "vendor_id": "8086", "numa_node": null, "label": "label_8086_293a", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_2", "address": "0000:00:07.2", "product_id": "2936", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2936", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "1237", "vendor_id": "8086", "numa_node": null, "label": "label_8086_1237", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "2935", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2935", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "2934", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2934", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_05_0", "address": "0000:00:05.0", "product_id": "1000", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1000", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "1000", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1000", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_06_0", "address": "0000:00:06.0", "product_id": "2668", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2668", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "1000", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1000", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0a_0", "address": "0000:00:0a.0", "product_id": "1002", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1002", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_3", "address": "0000:00:01.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_08_0", "address": "0000:00:08.0", "product_id": "1003", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1003", "dev_type": "type-PCI"}] {{(pid=83654) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}} May 28 13:07:03 l75lg1-v1 nova-compute[83654]: DEBUG oslo_concurrency.lockutils [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=83654) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:07:03 l75lg1-v1 nova-compute[83654]: DEBUG oslo_concurrency.lockutils [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=83654) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:07:03 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Expecting reply to msg 7cecf900fe094955aa1de42e22749b7b in queue reply_37f4cbd1dd094961a22b8a65f222c327 May 28 13:07:03 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-d10a9919-9a62-4d1f-bf23-4072a1d39de5 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/shares/41a07ae7-d107-493e-8a00-5ada346ac16c returned with HTTP 202 May 28 13:07:03 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1442/2904] 10.27.203.238 () {64 vars in 1454 bytes} [Tue May 28 13:07:03 2024] DELETE /share/v2/9c1e3ce524bc424eae1e9467bc390dec/shares/41a07ae7-d107-493e-8a00-5ada346ac16c => generated 0 bytes in 122 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 13:07:03 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [-] Received RPC response for msg 7cecf900fe094955aa1de42e22749b7b May 28 13:07:03 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-93aa2896-c26b-4f27-af58-fec3b10e4f66 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] GET http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/shares/41a07ae7-d107-493e-8a00-5ada346ac16c May 28 13:07:03 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-93aa2896-c26b-4f27-af58-fec3b10e4f66 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:07:03 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-93aa2896-c26b-4f27-af58-fec3b10e4f66 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:07:03 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-93aa2896-c26b-4f27-af58-fec3b10e4f66 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/shares/41a07ae7-d107-493e-8a00-5ada346ac16c returned with HTTP 200 May 28 13:07:03 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1463/2905] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:07:03 2024] GET /share/v2/9c1e3ce524bc424eae1e9467bc390dec/shares/41a07ae7-d107-493e-8a00-5ada346ac16c => generated 1339 bytes in 25 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:07:03 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-d10a9919-9a62-4d1f-bf23-4072a1d39de5 tempest-ShareSnapshotMetadataTest-331543469 None] Acquiring lock "locked_access_rules_operation_by_share_instance_32260cfb-2f6c-471f-8668-cd9a33828137" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:07:03 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-d10a9919-9a62-4d1f-bf23-4072a1d39de5 tempest-ShareSnapshotMetadataTest-331543469 None] Lock "locked_access_rules_operation_by_share_instance_32260cfb-2f6c-471f-8668-cd9a33828137" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.001s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:07:03 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-d10a9919-9a62-4d1f-bf23-4072a1d39de5 tempest-ShareSnapshotMetadataTest-331543469 None] Lock "locked_access_rules_operation_by_share_instance_32260cfb-2f6c-471f-8668-cd9a33828137" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:07:03 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-d10a9919-9a62-4d1f-bf23-4072a1d39de5 tempest-ShareSnapshotMetadataTest-331543469 None] Acquiring lock "locked_access_rules_operation_by_share_instance_32260cfb-2f6c-471f-8668-cd9a33828137" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:07:03 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-d10a9919-9a62-4d1f-bf23-4072a1d39de5 tempest-ShareSnapshotMetadataTest-331543469 None] Lock "locked_access_rules_operation_by_share_instance_32260cfb-2f6c-471f-8668-cd9a33828137" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:07:03 l75lg1-v1 dstat.sh[49771]: 28-05 13:07:03| 3 1 94 1 0|5505M 1901M 278M 7940M| 21k 172B| 0 648k| 0 96.0 |3480 6328 |0.36 0.84 0.96|2.0 0 0| 0 0 | 0 2048M| 29 357 0 3 8 May 28 13:07:03 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-d10a9919-9a62-4d1f-bf23-4072a1d39de5 tempest-ShareSnapshotMetadataTest-331543469 None] Lock "locked_access_rules_operation_by_share_instance_32260cfb-2f6c-471f-8668-cd9a33828137" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:07:03 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-d10a9919-9a62-4d1f-bf23-4072a1d39de5 tempest-ShareSnapshotMetadataTest-331543469 None] Acquiring lock "locked_access_rules_operation_by_share_instance_32260cfb-2f6c-471f-8668-cd9a33828137" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:07:03 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-d10a9919-9a62-4d1f-bf23-4072a1d39de5 tempest-ShareSnapshotMetadataTest-331543469 None] Lock "locked_access_rules_operation_by_share_instance_32260cfb-2f6c-471f-8668-cd9a33828137" acquired by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: waited 0.000s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:07:03 l75lg1-v1 manila-share[98474]: DEBUG oslo_concurrency.lockutils [None req-d10a9919-9a62-4d1f-bf23-4072a1d39de5 tempest-ShareSnapshotMetadataTest-331543469 None] Lock "locked_access_rules_operation_by_share_instance_32260cfb-2f6c-471f-8668-cd9a33828137" "released" by "manila.share.access.locked_access_rules_operation..wrapped..locked_operation" :: held 0.003s {{(pid=98474) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:07:03 l75lg1-v1 manila-share[98474]: DEBUG manila.share.access [None req-d10a9919-9a62-4d1f-bf23-4072a1d39de5 tempest-ShareSnapshotMetadataTest-331543469 None] All access rules have been synced for share instance 32260cfb-2f6c-471f-8668-cd9a33828137 belonging to share 41a07ae7-d107-493e-8a00-5ada346ac16c. {{(pid=98474) update_access_rules /opt/stack/manila/manila/share/access.py:304}} May 28 13:07:03 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata [None req-d10a9919-9a62-4d1f-bf23-4072a1d39de5 tempest-ShareSnapshotMetadataTest-331543469 None] deleting '/manila/manila-32260cfb-2f6c-471f-8668-cd9a33828137' May 28 13:07:03 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d10a9919-9a62-4d1f-bf23-4072a1d39de5 tempest-ShareSnapshotMetadataTest-331543469 None] >>> [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/ May 28 13:07:03 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d10a9919-9a62-4d1f-bf23-4072a1d39de5 tempest-ShareSnapshotMetadataTest-331543469 None] {'data': '{"path": "/manila/manila-32260cfb-2f6c-471f-8668-cd9a33828137"}', May 28 13:07:03 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d10a9919-9a62-4d1f-bf23-4072a1d39de5 tempest-ShareSnapshotMetadataTest-331543469 None] 'params': None} May 28 13:07:03 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d10a9919-9a62-4d1f-bf23-4072a1d39de5 tempest-ShareSnapshotMetadataTest-331543469 None] <<< [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/ May 28 13:07:03 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d10a9919-9a62-4d1f-bf23-4072a1d39de5 tempest-ShareSnapshotMetadataTest-331543469 None] 'OK' May 28 13:07:03 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d10a9919-9a62-4d1f-bf23-4072a1d39de5 tempest-ShareSnapshotMetadataTest-331543469 None] --- [DELETE] https://127.0.0.1:40443/api/folders/delete_folder/: Done May 28 13:07:03 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d10a9919-9a62-4d1f-bf23-4072a1d39de5 tempest-ShareSnapshotMetadataTest-331543469 None] >>> [GET] https://127.0.0.1:40443/api/views/ May 28 13:07:03 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d10a9919-9a62-4d1f-bf23-4072a1d39de5 tempest-ShareSnapshotMetadataTest-331543469 None] {'allow_redirects': True, May 28 13:07:03 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d10a9919-9a62-4d1f-bf23-4072a1d39de5 tempest-ShareSnapshotMetadataTest-331543469 None] 'params': {'name': '32260cfb-2f6c-471f-8668-cd9a33828137'}} May 28 13:07:03 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Expecting reply to msg d73df14111c04674869e5751e8ceab8c in queue reply_37f4cbd1dd094961a22b8a65f222c327 May 28 13:07:03 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [-] Received RPC response for msg d73df14111c04674869e5751e8ceab8c May 28 13:07:03 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d10a9919-9a62-4d1f-bf23-4072a1d39de5 tempest-ShareSnapshotMetadataTest-331543469 None] <<< [GET] https://127.0.0.1:40443/api/views/ May 28 13:07:03 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d10a9919-9a62-4d1f-bf23-4072a1d39de5 tempest-ShareSnapshotMetadataTest-331543469 None] [Bunch(abac_tags=[], abe_max_depth=None, abe_protocols=[], alias='', allow_anonymous_access=False, allow_s3_anonymous_access=False, auto_commit='0d', bucket='', bucket_creators=[], bucket_creators_groups=[], bucket_owner=None, bulk_permission_update_progress=None, bulk_permission_update_state=None, cluster='loop75-kfs', cluster_id=1, created='2024-05-28T13:06:05.155980Z', enabled=True, files_retention_mode='NONE', guid='4812d0a3-58b0-4b1b-a90c-95c7b0940a98', id=67, ignore_oos=False, internal=False, is_remote=False, is_seamless=False, logical_capacity=0, max_retention_period='0d', min_retention_period='0d', name='32260cfb-2f6c-471f-8668-cd9a33828137', nfs_interop_flags='BOTH_NFS3_AND_NFS4_INTEROP_DISABLED', path='/manila/manila-32260cfb-2f6c-471f-8668-cd9a33828137', physical_capacity=0, policy='32260cfb-2f6c-471f-8668-cd9a33828137', policy_id=68, protocols=['NFS'], qos_policy=None, qos_policy_id=None, s3_locks=False, s3_locks_retention_mode='NONE', s3_locks_retention_period='', s3_unverified_lookup=False, s3_versioning=False, select_for_live_monitoring=False, share='', share_acl=Bunch(acl=[], enabled=False), sync='SYNCED', sync_time='2024-05-28T13:06:08.478983Z', tenant_id=1, tenant_name='default', title='/manila/manila-32260cfb-2f6c-471f-8668-cd9a33828137', url='https://127.0.0.1:40443/api/views/67/')] May 28 13:07:03 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d10a9919-9a62-4d1f-bf23-4072a1d39de5 tempest-ShareSnapshotMetadataTest-331543469 None] --- [GET] https://127.0.0.1:40443/api/views/: Done May 28 13:07:03 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d10a9919-9a62-4d1f-bf23-4072a1d39de5 tempest-ShareSnapshotMetadataTest-331543469 None] >>> [DELETE] https://127.0.0.1:40443/api/views/67/ May 28 13:07:04 l75lg1-v1 devstack@placement-api.service[78202]: DEBUG placement.requestlog [req-a23f3127-7643-4f4c-b5b7-4b5349f1ccb8 req-37d6e7bd-a7a8-48e8-a121-0f1d8bb7b0b3 None None] Starting request: 10.27.203.238 "GET /placement/resource_providers/ef90d7d1-0808-4a15-ad77-f9a7391af2f4/allocations" {{(pid=78202) __call__ /opt/stack/placement/placement/requestlog.py:55}} May 28 13:07:04 l75lg1-v1 devstack@placement-api.service[78202]: INFO placement.requestlog [req-a23f3127-7643-4f4c-b5b7-4b5349f1ccb8 req-37d6e7bd-a7a8-48e8-a121-0f1d8bb7b0b3 service placement] 10.27.203.238 "GET /placement/resource_providers/ef90d7d1-0808-4a15-ad77-f9a7391af2f4/allocations" status: 200 len: 54 microversion: 1.0 May 28 13:07:04 l75lg1-v1 devstack@placement-api.service[78202]: [pid: 78202|app: 0|req: 36/71] 10.27.203.238 () {62 vars in 1480 bytes} [Tue May 28 13:07:04 2024] GET /placement/resource_providers/ef90d7d1-0808-4a15-ad77-f9a7391af2f4/allocations => generated 54 bytes in 11 msecs (HTTP/1.1 200) 6 headers in 223 bytes (1 switches on core 0) May 28 13:07:04 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.resource_tracker [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Total usable vcpus: 10, total allocated vcpus: 0 {{(pid=83654) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}} May 28 13:07:04 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.resource_tracker [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Final resource view: name=l75lg1-v1 phys_ram=16000MB used_ram=512MB phys_disk=28GB used_disk=0GB total_vcpus=10 used_vcpus=0 pci_stats=[] {{(pid=83654) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}} May 28 13:07:04 l75lg1-v1 devstack@placement-api.service[78201]: DEBUG placement.requestlog [req-a23f3127-7643-4f4c-b5b7-4b5349f1ccb8 req-aefaad06-ac04-4714-b469-376547615b67 None None] Starting request: 10.27.203.238 "GET /placement/resource_providers/ef90d7d1-0808-4a15-ad77-f9a7391af2f4/allocations" {{(pid=78201) __call__ /opt/stack/placement/placement/requestlog.py:55}} May 28 13:07:04 l75lg1-v1 devstack@placement-api.service[78201]: INFO placement.requestlog [req-a23f3127-7643-4f4c-b5b7-4b5349f1ccb8 req-aefaad06-ac04-4714-b469-376547615b67 service placement] 10.27.203.238 "GET /placement/resource_providers/ef90d7d1-0808-4a15-ad77-f9a7391af2f4/allocations" status: 200 len: 54 microversion: 1.0 May 28 13:07:04 l75lg1-v1 devstack@placement-api.service[78201]: [pid: 78201|app: 0|req: 36/72] 10.27.203.238 () {62 vars in 1480 bytes} [Tue May 28 13:07:04 2024] GET /placement/resource_providers/ef90d7d1-0808-4a15-ad77-f9a7391af2f4/allocations => generated 54 bytes in 11 msecs (HTTP/1.1 200) 6 headers in 223 bytes (1 switches on core 0) May 28 13:07:04 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.provider_tree [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Inventory has not changed in ProviderTree for provider: ef90d7d1-0808-4a15-ad77-f9a7391af2f4 {{(pid=83654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} May 28 13:07:04 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Expecting reply to msg 5dc76bd0ea804b448731dbed1e20b8f5 in queue reply_37f4cbd1dd094961a22b8a65f222c327 May 28 13:07:04 l75lg1-v1 nova-compute[83654]: INFO oslo_messaging._drivers.amqpdriver [-] Received RPC response for msg 5dc76bd0ea804b448731dbed1e20b8f5 May 28 13:07:04 l75lg1-v1 dstat.sh[49771]: 28-05 13:07:04| 2 0 97 0 0|5505M 1901M 278M 7940M| 23k 2234B| 0 288k| 0 21.0 |2045 2836 |0.36 0.84 0.96| 0 0 0| 0 0 | 0 2048M| 29 357 0 3 8 May 28 13:07:04 l75lg1-v1 nova-compute[83654]: DEBUG nova.scheduler.client.report [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Inventory has not changed for provider ef90d7d1-0808-4a15-ad77-f9a7391af2f4 based on inventory data: {'VCPU': {'total': 10, 'reserved': 0, 'min_unit': 1, 'max_unit': 10, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16000, 'reserved': 512, 'min_unit': 1, 'max_unit': 16000, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 28, 'reserved': 0, 'min_unit': 1, 'max_unit': 28, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=83654) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}} May 28 13:07:04 l75lg1-v1 nova-compute[83654]: DEBUG nova.compute.resource_tracker [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Compute_service record updated for l75lg1-v1:l75lg1-v1 {{(pid=83654) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}} May 28 13:07:04 l75lg1-v1 nova-compute[83654]: DEBUG oslo_concurrency.lockutils [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.552s {{(pid=83654) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:07:05 l75lg1-v1 dstat.sh[49771]: 28-05 13:07:05| 1 0 99 0 0|5505M 1901M 278M 7940M| 25k 0 | 0 8190B| 0 1.00 |1578 2208 |0.36 0.84 0.96| 0 0 0| 0 0 | 0 2048M| 29 357 0 2 8 May 28 13:07:06 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d10a9919-9a62-4d1f-bf23-4072a1d39de5 tempest-ShareSnapshotMetadataTest-331543469 None] <<< [DELETE] https://127.0.0.1:40443/api/views/67/ May 28 13:07:06 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d10a9919-9a62-4d1f-bf23-4072a1d39de5 tempest-ShareSnapshotMetadataTest-331543469 None] --- [DELETE] https://127.0.0.1:40443/api/views/67/: Done May 28 13:07:06 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d10a9919-9a62-4d1f-bf23-4072a1d39de5 tempest-ShareSnapshotMetadataTest-331543469 None] >>> [GET] https://127.0.0.1:40443/api/quotas/ May 28 13:07:06 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d10a9919-9a62-4d1f-bf23-4072a1d39de5 tempest-ShareSnapshotMetadataTest-331543469 None] {'allow_redirects': True, May 28 13:07:06 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d10a9919-9a62-4d1f-bf23-4072a1d39de5 tempest-ShareSnapshotMetadataTest-331543469 None] 'params': {'name': '32260cfb-2f6c-471f-8668-cd9a33828137'}} May 28 13:07:06 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-e0039991-12e6-45e8-a801-4395d77631bc tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] GET http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/shares/41a07ae7-d107-493e-8a00-5ada346ac16c May 28 13:07:06 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-e0039991-12e6-45e8-a801-4395d77631bc tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:07:06 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-e0039991-12e6-45e8-a801-4395d77631bc tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:07:06 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-e0039991-12e6-45e8-a801-4395d77631bc tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/shares/41a07ae7-d107-493e-8a00-5ada346ac16c returned with HTTP 200 May 28 13:07:06 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1443/2906] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:07:06 2024] GET /share/v2/9c1e3ce524bc424eae1e9467bc390dec/shares/41a07ae7-d107-493e-8a00-5ada346ac16c => generated 1339 bytes in 26 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:07:06 l75lg1-v1 dstat.sh[49771]: 28-05 13:07:06| 1 1 98 0 0|5505M 1900M 278M 7940M| 21k 670B| 0 0 | 0 0 |1756 2479 |0.36 0.84 0.96|1.0 0 0| 0 0 | 0 2048M| 29 357 0 2 8 May 28 13:07:06 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d10a9919-9a62-4d1f-bf23-4072a1d39de5 tempest-ShareSnapshotMetadataTest-331543469 None] <<< [GET] https://127.0.0.1:40443/api/quotas/ May 28 13:07:06 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d10a9919-9a62-4d1f-bf23-4072a1d39de5 tempest-ShareSnapshotMetadataTest-331543469 None] [Bunch(cluster='loop75-kfs', cluster_id=1, default_email=None, default_group_quota=None, default_user_quota=None, enable_alarms=True, enable_email_providers=True, grace_period=None, guid='5eb05877-776e-4b32-977e-6177e11c1fba', hard_limit=1073741824, hard_limit_inodes=None, id=65, internal=False, is_user_quota=False, last_user_quotas_update=None, name='32260cfb-2f6c-471f-8668-cd9a33828137', num_blocked_users=0, num_exceeded_users=0, path='/manila/manila-32260cfb-2f6c-471f-8668-cd9a33828137', percent_capacity=0, percent_inodes=None, pretty_grace_period=None, pretty_grace_period_expiration=None, pretty_state='OK', soft_limit=None, soft_limit_inodes=None, state='OK', sync_state='SYNCHRONIZED', system_id=65, tenant_id=1, tenant_name='default', time_to_block=None, title='32260cfb-2f6c-471f-8668-cd9a33828137', url='https://127.0.0.1:40443/api/quotas/65/', used_capacity=0, used_capacity_tb=0.0, used_effective_capacity=0, used_effective_capacity_tb=0.0, used_inodes=1, used_limited_capacity=0)] May 28 13:07:06 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d10a9919-9a62-4d1f-bf23-4072a1d39de5 tempest-ShareSnapshotMetadataTest-331543469 None] --- [GET] https://127.0.0.1:40443/api/quotas/: Done May 28 13:07:06 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d10a9919-9a62-4d1f-bf23-4072a1d39de5 tempest-ShareSnapshotMetadataTest-331543469 None] >>> [DELETE] https://127.0.0.1:40443/api/quotas/65/ May 28 13:07:07 l75lg1-v1 dstat.sh[49771]: 28-05 13:07:07| 1 1 97 1 0|5505M 1900M 278M 7940M| 34k 654B| 0 1156k| 0 86.0 |2237 2972 |0.36 0.84 0.96| 0 0 0| 0 0 | 0 2048M| 29 357 0 2 8 May 28 13:07:07 l75lg1-v1 nova-compute[83654]: DEBUG oslo_service.periodic_task [None req-5d7036cb-f615-4cfe-8258-b177e5774c70 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 13:07:08 l75lg1-v1 dstat.sh[49771]: 28-05 13:07:08| 1 0 98 0 0|5505M 1900M 278M 7940M| 39k 0 | 0 256k| 0 14.0 |1886 2353 |0.34 0.83 0.95| 0 0 0| 0 0 | 0 2048M| 29 357 0 2 8 May 28 13:07:09 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d10a9919-9a62-4d1f-bf23-4072a1d39de5 tempest-ShareSnapshotMetadataTest-331543469 None] <<< [DELETE] https://127.0.0.1:40443/api/quotas/65/ May 28 13:07:09 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d10a9919-9a62-4d1f-bf23-4072a1d39de5 tempest-ShareSnapshotMetadataTest-331543469 None] --- [DELETE] https://127.0.0.1:40443/api/quotas/65/: Done May 28 13:07:09 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d10a9919-9a62-4d1f-bf23-4072a1d39de5 tempest-ShareSnapshotMetadataTest-331543469 None] >>> [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:07:09 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d10a9919-9a62-4d1f-bf23-4072a1d39de5 tempest-ShareSnapshotMetadataTest-331543469 None] {'allow_redirects': True, May 28 13:07:09 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d10a9919-9a62-4d1f-bf23-4072a1d39de5 tempest-ShareSnapshotMetadataTest-331543469 None] 'params': {'name': '32260cfb-2f6c-471f-8668-cd9a33828137'}} May 28 13:07:09 l75lg1-v1 dstat.sh[49771]: 28-05 13:07:09| 1 1 98 0 0|5505M 1900M 278M 7940M| 29k 669B| 0 8186B| 0 1.00 |1641 2350 |0.34 0.83 0.95|1.0 0 2.0| 0 0 | 0 2048M| 29 357 0 2 8 May 28 13:07:09 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-ed2ef4cf-6743-43e8-ad75-9e8562859149 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] GET http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/shares/41a07ae7-d107-493e-8a00-5ada346ac16c May 28 13:07:09 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-ed2ef4cf-6743-43e8-ad75-9e8562859149 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:07:09 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-ed2ef4cf-6743-43e8-ad75-9e8562859149 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Calling method 'ShareMixin.show' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:07:09 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-ed2ef4cf-6743-43e8-ad75-9e8562859149 tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/shares/41a07ae7-d107-493e-8a00-5ada346ac16c returned with HTTP 200 May 28 13:07:09 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1464/2907] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:07:09 2024] GET /share/v2/9c1e3ce524bc424eae1e9467bc390dec/shares/41a07ae7-d107-493e-8a00-5ada346ac16c => generated 1339 bytes in 24 msecs (HTTP/1.1 200) 6 headers in 232 bytes (1 switches on core 0) May 28 13:07:09 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d10a9919-9a62-4d1f-bf23-4072a1d39de5 tempest-ShareSnapshotMetadataTest-331543469 None] <<< [GET] https://127.0.0.1:40443/api/viewpolicies/ May 28 13:07:09 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d10a9919-9a62-4d1f-bf23-4072a1d39de5 tempest-ShareSnapshotMetadataTest-331543469 None] [Bunch(access_flavor='ALL', allowed_characters='LCD', apple_sid=True, atime_frequency=None, auth_source='RPC', change=[], cluster='loop75-kfs', cluster_id=1, count_views=0, created='2024-05-28T13:06:02.176435Z', enable_access_to_snapshot_dir_in_subdirs=True, enable_listing_of_snapshot_dir=False, enable_snapshot_lookup=True, enable_visibility_of_snapshot_dir=False, expose_id_in_fsid=False, flavor='NFS', full=[], gid_inheritance='LINUX', guid='86b640dc-ab85-4964-91b5-7dd18cf00077', id=68, internal=False, is_s3_default_policy=False, name='32260cfb-2f6c-471f-8668-cd9a33828137', nfs_all_squash=[], nfs_case_insensitive=False, nfs_enforce_tls=False, nfs_minimal_protection_level='NONE', nfs_no_squash=[], nfs_posix_acl=False, nfs_read_only=[], nfs_read_write=['*'], nfs_return_open_permissions=False, nfs_root_squash=['*'], path_length='LCD', pretty_atime_frequency=None, pretty_auth_source='Client', protocols=[], protocols_audit=Bunch(create_delete_files_dirs_objects=False, log_full_path=False, log_username=False, modify_data=False, modify_data_md=False, read_data=False, read_data_md=False), read=[], read_only=[], read_write=['*'], remote_mapping=Bunch(), s3_flavor_allow_free_listing=False, s3_flavor_detect_full_pathname=False, s3_read_only=[], s3_read_write=['*'], s3_special_chars_support=True, s3_visibility=[], s3_visibility_groups=[], smb_directory_mode=755, smb_directory_mode_padded='755', smb_file_mode=644, smb_file_mode_padded='644', smb_is_ca=False, smb_read_only=[], smb_read_write=['*'], sync='SYNCED', sync_time='2024-05-28T13:06:02.495368Z', tenant_id=1, tenant_name='default', title='32260cfb-2f6c-471f-8668-cd9a33828137', trash_access=[], url='https://127.0.0.1:40443/api/viewpolicies/68/', use_32bit_fileid=False, use_auth_provider=False, vip_pools=[])] May 28 13:07:09 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d10a9919-9a62-4d1f-bf23-4072a1d39de5 tempest-ShareSnapshotMetadataTest-331543469 None] --- [GET] https://127.0.0.1:40443/api/viewpolicies/: Done May 28 13:07:09 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d10a9919-9a62-4d1f-bf23-4072a1d39de5 tempest-ShareSnapshotMetadataTest-331543469 None] >>> [DELETE] https://127.0.0.1:40443/api/viewpolicies/68/ May 28 13:07:09 l75lg1-v1 devstack@keystone.service[51267]: DEBUG dbcounter [-] [51267] Writing DB stats keystone:SELECT=16 {{(pid=51267) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:07:09 l75lg1-v1 devstack@keystone.service[51266]: DEBUG dbcounter [-] [51266] Writing DB stats keystone:SELECT=25,keystone:DELETE=10,keystone:INSERT=1 {{(pid=51266) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:07:10 l75lg1-v1 dstat.sh[49771]: 28-05 13:07:10| 1 0 98 0 0|5505M 1900M 278M 7940M| 25k 721B| 0 248k| 0 43.0 |2100 3156 |0.34 0.83 0.95| 0 0 0| 0 0 | 0 2048M| 29 357 0 2 8 May 28 13:07:10 l75lg1-v1 neutron-server[77618]: DEBUG dbcounter [-] [77618] Writing DB stats neutron:UPDATE=1,neutron:SELECT=1 {{(pid=77618) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:07:11 l75lg1-v1 cinder-scheduler[85128]: DEBUG dbcounter [-] [85128] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=85128) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:07:11 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d10a9919-9a62-4d1f-bf23-4072a1d39de5 tempest-ShareSnapshotMetadataTest-331543469 None] <<< [DELETE] https://127.0.0.1:40443/api/viewpolicies/68/ May 28 13:07:11 l75lg1-v1 manila-share[98474]: INFO manila.share.drivers.vastdata.rest [None req-d10a9919-9a62-4d1f-bf23-4072a1d39de5 tempest-ShareSnapshotMetadataTest-331543469 None] --- [DELETE] https://127.0.0.1:40443/api/viewpolicies/68/: Done May 28 13:07:11 l75lg1-v1 dstat.sh[49771]: 28-05 13:07:11| 1 0 98 0 0|5505M 1900M 278M 7940M| 29k 172B| 0 512k| 0 49.0 |1869 2542 |0.34 0.83 0.95|1.0 0 0| 0 0 | 0 2048M| 29 357 0 2 8 May 28 13:07:11 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-d10a9919-9a62-4d1f-bf23-4072a1d39de5 tempest-ShareSnapshotMetadataTest-331543469 None] Created reservations ['3fd65925-20e8-4aff-9a56-d82eea3ac885', 'f6a0e1bf-04a1-43d5-8e67-556265ecce87', '5861c3f2-577a-49d1-a181-8d6e990b8b41', 'bc052cb7-795f-4300-95a1-b3205e477b6a'] {{(pid=98474) reserve /opt/stack/manila/manila/quota.py:1035}} May 28 13:07:11 l75lg1-v1 manila-share[98474]: DEBUG manila.quota [None req-d10a9919-9a62-4d1f-bf23-4072a1d39de5 tempest-ShareSnapshotMetadataTest-331543469 None] Committed reservations ['3fd65925-20e8-4aff-9a56-d82eea3ac885', 'f6a0e1bf-04a1-43d5-8e67-556265ecce87', '5861c3f2-577a-49d1-a181-8d6e990b8b41', 'bc052cb7-795f-4300-95a1-b3205e477b6a'] {{(pid=98474) commit /opt/stack/manila/manila/quota.py:1063}} May 28 13:07:11 l75lg1-v1 manila-share[98474]: INFO manila.share.manager [None req-d10a9919-9a62-4d1f-bf23-4072a1d39de5 tempest-ShareSnapshotMetadataTest-331543469 None] Share instance 32260cfb-2f6c-471f-8668-cd9a33828137: deleted successfully. May 28 13:07:11 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.periodic_task [None req-e3486ff9-a95e-41bc-8901-df75aedbeaad None None] Running periodic task DataManager.create_backup_continue {{(pid=98318) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 13:07:11 l75lg1-v1 manila-data[98318]: DEBUG oslo_service.periodic_task [None req-e3486ff9-a95e-41bc-8901-df75aedbeaad None None] Running periodic task DataManager.restore_backup_continue {{(pid=98318) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 13:07:12 l75lg1-v1 dstat.sh[49771]: 28-05 13:07:12| 2 0 96 1 0|5505M 1900M 278M 7940M| 21k 66B| 0 640k| 0 119 |2994 4714 |0.34 0.83 0.95| 0 0 0| 0 0 | 0 2048M| 29 357 0 2 8 May 28 13:07:12 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-8600e3fb-6379-4b41-9f14-4d197917613d tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] GET http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/shares/41a07ae7-d107-493e-8a00-5ada346ac16c May 28 13:07:12 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-8600e3fb-6379-4b41-9f14-4d197917613d tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:07:12 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-8600e3fb-6379-4b41-9f14-4d197917613d tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] Calling method 'ShareMixin.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:07:12 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-8600e3fb-6379-4b41-9f14-4d197917613d tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] HTTP exception thrown: The resource could not be found. May 28 13:07:12 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-8600e3fb-6379-4b41-9f14-4d197917613d tempest-ShareSnapshotMetadataTest-331543469 tempest-ShareSnapshotMetadataTest-331543469-project-member] http://10.27.203.238/share/v2/9c1e3ce524bc424eae1e9467bc390dec/shares/41a07ae7-d107-493e-8a00-5ada346ac16c returned with HTTP 404 May 28 13:07:12 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1444/2908] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:07:12 2024] GET /share/v2/9c1e3ce524bc424eae1e9467bc390dec/shares/41a07ae7-d107-493e-8a00-5ada346ac16c => generated 78 bytes in 13 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 13:07:12 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-ba73cfcc-e826-44e7-9750-efc84e6c6eb7 tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] DELETE http://10.27.203.238/share/v2/34275d855b714711982480692b7c6977/types/bf641037-d641-471e-9397-4e29981f77b8 May 28 13:07:12 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-ba73cfcc-e826-44e7-9750-efc84e6c6eb7 tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] Empty body provided in request {{(pid=98329) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:07:12 l75lg1-v1 devstack@m-api.service[98329]: DEBUG manila.api.openstack.wsgi [None req-ba73cfcc-e826-44e7-9750-efc84e6c6eb7 tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] Calling method 'ShareTypesController._delete' {{(pid=98329) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:07:12 l75lg1-v1 devstack@m-api.service[98329]: INFO manila.api.openstack.wsgi [None req-ba73cfcc-e826-44e7-9750-efc84e6c6eb7 tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] http://10.27.203.238/share/v2/34275d855b714711982480692b7c6977/types/bf641037-d641-471e-9397-4e29981f77b8 returned with HTTP 202 May 28 13:07:12 l75lg1-v1 devstack@m-api.service[98329]: [pid: 98329|app: 0|req: 1465/2909] 10.27.203.238 () {64 vars in 1451 bytes} [Tue May 28 13:07:12 2024] DELETE /share/v2/34275d855b714711982480692b7c6977/types/bf641037-d641-471e-9397-4e29981f77b8 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 6 headers in 243 bytes (1 switches on core 0) May 28 13:07:12 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-84f53212-c6d8-47de-ba9a-b252cde08a6a tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] GET http://10.27.203.238/share/v2/34275d855b714711982480692b7c6977/types/bf641037-d641-471e-9397-4e29981f77b8 May 28 13:07:12 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-84f53212-c6d8-47de-ba9a-b252cde08a6a tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] Empty body provided in request {{(pid=98330) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}} May 28 13:07:12 l75lg1-v1 devstack@m-api.service[98330]: DEBUG manila.api.openstack.wsgi [None req-84f53212-c6d8-47de-ba9a-b252cde08a6a tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] Calling method 'ShareTypesController.show' {{(pid=98330) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}} May 28 13:07:12 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-84f53212-c6d8-47de-ba9a-b252cde08a6a tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] HTTP exception thrown: Share type not found. May 28 13:07:12 l75lg1-v1 devstack@m-api.service[98330]: INFO manila.api.openstack.wsgi [None req-84f53212-c6d8-47de-ba9a-b252cde08a6a tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] http://10.27.203.238/share/v2/34275d855b714711982480692b7c6977/types/bf641037-d641-471e-9397-4e29981f77b8 returned with HTTP 404 May 28 13:07:12 l75lg1-v1 devstack@m-api.service[98330]: [pid: 98330|app: 0|req: 1445/2910] 10.27.203.238 () {64 vars in 1448 bytes} [Tue May 28 13:07:12 2024] GET /share/v2/34275d855b714711982480692b7c6977/types/bf641037-d641-471e-9397-4e29981f77b8 => generated 67 bytes in 11 msecs (HTTP/1.1 404) 6 headers in 237 bytes (1 switches on core 0) May 28 13:07:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532735dc-1548-49f8-a177-ac70fa600524 tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:07:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-532735dc-1548-49f8-a177-ac70fa600524 tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:07:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532735dc-1548-49f8-a177-ac70fa600524 tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:07:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc5a8c4-da5c-4780-bfdb-8285624e3405 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:07:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc5a8c4-da5c-4780-bfdb-8285624e3405 None admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:07:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc5a8c4-da5c-4780-bfdb-8285624e3405 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:07:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc5a8c4-da5c-4780-bfdb-8285624e3405 None admin] PATH_INFO: `/v3/users/d753eb2d4042469ca1e5eb6c31817552` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:07:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc5a8c4-da5c-4780-bfdb-8285624e3405 None admin] RBAC: Authorizing `identity:delete_user(user_id=d753eb2d4042469ca1e5eb6c31817552)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:07:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc5a8c4-da5c-4780-bfdb-8285624e3405 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:07:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-ffc5a8c4-da5c-4780-bfdb-8285624e3405 None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd753eb2d4042469ca1e5eb6c31817552', 'request_id': 'req-ffc5a8c4-da5c-4780-bfdb-8285624e3405'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:07:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-ffc5a8c4-da5c-4780-bfdb-8285624e3405 None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd753eb2d4042469ca1e5eb6c31817552', 'request_id': 'req-ffc5a8c4-da5c-4780-bfdb-8285624e3405'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:07:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-ffc5a8c4-da5c-4780-bfdb-8285624e3405 None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd753eb2d4042469ca1e5eb6c31817552', 'request_id': 'req-ffc5a8c4-da5c-4780-bfdb-8285624e3405'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:07:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-ffc5a8c4-da5c-4780-bfdb-8285624e3405 None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd753eb2d4042469ca1e5eb6c31817552', 'request_id': 'req-ffc5a8c4-da5c-4780-bfdb-8285624e3405'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:07:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-ffc5a8c4-da5c-4780-bfdb-8285624e3405 None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd753eb2d4042469ca1e5eb6c31817552', 'request_id': 'req-ffc5a8c4-da5c-4780-bfdb-8285624e3405'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:07:12 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1892/3752] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 13:07:12 2024] DELETE /identity/v3/users/d753eb2d4042469ca1e5eb6c31817552 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:07:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fff69b-1998-45ee-88c9-e0d38acc725e tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:07:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fff69b-1998-45ee-88c9-e0d38acc725e tempest-ShareSnapshotMetadataTest-3130350 tempest-ShareSnapshotMetadataTest-3130350-project-admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:07:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c4bc1c-d288-4b34-834d-a18b19d30477 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:07:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c4bc1c-d288-4b34-834d-a18b19d30477 None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:07:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c4bc1c-d288-4b34-834d-a18b19d30477 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:07:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c4bc1c-d288-4b34-834d-a18b19d30477 None admin] PATH_INFO: `/v3/users/f4253f6924fc4cbc9e576cd98eca107d` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:07:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c4bc1c-d288-4b34-834d-a18b19d30477 None admin] RBAC: Authorizing `identity:delete_user(user_id=f4253f6924fc4cbc9e576cd98eca107d)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:07:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c4bc1c-d288-4b34-834d-a18b19d30477 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:07:12 l75lg1-v1 nova-conductor[83647]: DEBUG dbcounter [-] [83647] Writing DB stats nova_cell1:SELECT=1 {{(pid=83647) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:07:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-79c4bc1c-d288-4b34-834d-a18b19d30477 None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4253f6924fc4cbc9e576cd98eca107d', 'request_id': 'req-79c4bc1c-d288-4b34-834d-a18b19d30477'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:07:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-79c4bc1c-d288-4b34-834d-a18b19d30477 None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4253f6924fc4cbc9e576cd98eca107d', 'request_id': 'req-79c4bc1c-d288-4b34-834d-a18b19d30477'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:07:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-79c4bc1c-d288-4b34-834d-a18b19d30477 None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4253f6924fc4cbc9e576cd98eca107d', 'request_id': 'req-79c4bc1c-d288-4b34-834d-a18b19d30477'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:07:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-79c4bc1c-d288-4b34-834d-a18b19d30477 None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4253f6924fc4cbc9e576cd98eca107d', 'request_id': 'req-79c4bc1c-d288-4b34-834d-a18b19d30477'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:07:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-79c4bc1c-d288-4b34-834d-a18b19d30477 None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4253f6924fc4cbc9e576cd98eca107d', 'request_id': 'req-79c4bc1c-d288-4b34-834d-a18b19d30477'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:07:12 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1861/3753] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 13:07:12 2024] DELETE /identity/v3/users/f4253f6924fc4cbc9e576cd98eca107d => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:07:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc5a8c4-da5c-4780-bfdb-8285624e3405 None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:07:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-ffc5a8c4-da5c-4780-bfdb-8285624e3405 None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:07:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc5a8c4-da5c-4780-bfdb-8285624e3405 None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:07:12 l75lg1-v1 cinder-volume[85846]: DEBUG dbcounter [-] [85846] Writing DB stats cinder:SELECT=1 {{(pid=85846) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:07:12 l75lg1-v1 cinder-volume[85846]: DEBUG dbcounter [-] [85846] Writing DB stats cinder:UPDATE=1 {{(pid=85846) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:07:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11100e7-ee41-4314-b8d3-b4fd4921b2fe None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:07:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11100e7-ee41-4314-b8d3-b4fd4921b2fe None admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:07:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11100e7-ee41-4314-b8d3-b4fd4921b2fe None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:07:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11100e7-ee41-4314-b8d3-b4fd4921b2fe None admin] PATH_INFO: `/v3/users/4f5fc5b71cc041f792aff79543d3842e` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:07:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11100e7-ee41-4314-b8d3-b4fd4921b2fe None admin] RBAC: Authorizing `identity:delete_user(user_id=4f5fc5b71cc041f792aff79543d3842e)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:07:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11100e7-ee41-4314-b8d3-b4fd4921b2fe None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:07:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-a11100e7-ee41-4314-b8d3-b4fd4921b2fe None admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f5fc5b71cc041f792aff79543d3842e', 'request_id': 'req-a11100e7-ee41-4314-b8d3-b4fd4921b2fe'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:07:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-a11100e7-ee41-4314-b8d3-b4fd4921b2fe None admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f5fc5b71cc041f792aff79543d3842e', 'request_id': 'req-a11100e7-ee41-4314-b8d3-b4fd4921b2fe'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:07:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-a11100e7-ee41-4314-b8d3-b4fd4921b2fe None admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f5fc5b71cc041f792aff79543d3842e', 'request_id': 'req-a11100e7-ee41-4314-b8d3-b4fd4921b2fe'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:07:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-a11100e7-ee41-4314-b8d3-b4fd4921b2fe None admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f5fc5b71cc041f792aff79543d3842e', 'request_id': 'req-a11100e7-ee41-4314-b8d3-b4fd4921b2fe'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:07:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-a11100e7-ee41-4314-b8d3-b4fd4921b2fe None admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f5fc5b71cc041f792aff79543d3842e', 'request_id': 'req-a11100e7-ee41-4314-b8d3-b4fd4921b2fe'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:07:12 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1893/3754] 10.27.203.238 () {62 vars in 1291 bytes} [Tue May 28 13:07:12 2024] DELETE /identity/v3/users/4f5fc5b71cc041f792aff79543d3842e => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:07:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bd0de6-dc95-45b7-92ff-a1fd81ce6184 None None] REQUEST_METHOD: `POST` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:07:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bd0de6-dc95-45b7-92ff-a1fd81ce6184 None None] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:07:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bd0de6-dc95-45b7-92ff-a1fd81ce6184 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:07:12 l75lg1-v1 devstack@keystone.service[51266]: WARNING keystone.common.password_hashing [None req-81bd0de6-dc95-45b7-92ff-a1fd81ce6184 None None] Truncating password to algorithm specific maximum length 72 characters. May 28 13:07:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.auth.core [None req-81bd0de6-dc95-45b7-92ff-a1fd81ce6184 None None] MFA Rules not processed for user `e48f0d07e6644786b1da9213d53cc1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=51266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 28 13:07:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-81bd0de6-dc95-45b7-92ff-a1fd81ce6184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:07:12 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1862/3755] 10.27.203.238 () {62 vars in 1046 bytes} [Tue May 28 13:07:12 2024] POST /identity/v3/auth/tokens => generated 2960 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 28 13:07:12 l75lg1-v1 neutron-server[77618]: DEBUG neutron.wsgi [-] (77618) accepted ('10.27.203.238', 60822) {{(pid=77618) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 13:07:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11100e7-ee41-4314-b8d3-b4fd4921b2fe None admin] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:07:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.fernet_utils [None req-a11100e7-ee41-4314-b8d3-b4fd4921b2fe None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:07:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11100e7-ee41-4314-b8d3-b4fd4921b2fe None admin] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:07:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc241d1-44cd-4cc6-94a6-7d3136b06ad6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef17047035e4b518fd5360a01f2da1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98a6a2dcbf0248d5b353760f7757f713', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:07:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc241d1-44cd-4cc6-94a6-7d3136b06ad6 service neutron] REQUEST_METHOD: `GET` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:07:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc241d1-44cd-4cc6-94a6-7d3136b06ad6 service neutron] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:07:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc241d1-44cd-4cc6-94a6-7d3136b06ad6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:07:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc241d1-44cd-4cc6-94a6-7d3136b06ad6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:07:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc241d1-44cd-4cc6-94a6-7d3136b06ad6 service neutron] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:07:12 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1894/3756] 10.27.203.238 () {64 vars in 1432 bytes} [Tue May 28 13:07:12 2024] GET /identity/v3/auth/tokens => generated 2960 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 28 13:07:12 l75lg1-v1 neutron-server[77618]: INFO neutron.wsgi [None req-8e5c2660-0fb6-4c39-9aa4-4004749cccac None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=34275d855b714711982480692b7c6977&name=default HTTP/1.1" status: 200 len: 216 time: 0.0683639 May 28 13:07:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bd0de6-dc95-45b7-92ff-a1fd81ce6184 None None] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:07:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-81bd0de6-dc95-45b7-92ff-a1fd81ce6184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:07:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bd0de6-dc95-45b7-92ff-a1fd81ce6184 None None] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:07:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4075b83e-4821-41a1-b731-107d59c99f14 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:07:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4075b83e-4821-41a1-b731-107d59c99f14 None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:07:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4075b83e-4821-41a1-b731-107d59c99f14 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:07:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4075b83e-4821-41a1-b731-107d59c99f14 None admin] PATH_INFO: `/v3/projects/34275d855b714711982480692b7c6977` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:07:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4075b83e-4821-41a1-b731-107d59c99f14 None admin] RBAC: Authorizing `identity:delete_project(project_id=34275d855b714711982480692b7c6977)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:07:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4075b83e-4821-41a1-b731-107d59c99f14 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:07:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-4075b83e-4821-41a1-b731-107d59c99f14 None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34275d855b714711982480692b7c6977', 'request_id': 'req-4075b83e-4821-41a1-b731-107d59c99f14'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:07:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-4075b83e-4821-41a1-b731-107d59c99f14 None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34275d855b714711982480692b7c6977', 'request_id': 'req-4075b83e-4821-41a1-b731-107d59c99f14'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:07:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-4075b83e-4821-41a1-b731-107d59c99f14 None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34275d855b714711982480692b7c6977', 'request_id': 'req-4075b83e-4821-41a1-b731-107d59c99f14'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:07:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-4075b83e-4821-41a1-b731-107d59c99f14 None admin] The token cache is being invalidate because project 34275d855b714711982480692b7c6977 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 13:07:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-4075b83e-4821-41a1-b731-107d59c99f14 None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:07:12 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-4075b83e-4821-41a1-b731-107d59c99f14 None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:07:12 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1863/3757] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 13:07:12 2024] DELETE /identity/v3/projects/34275d855b714711982480692b7c6977 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:07:12 l75lg1-v1 neutron-server[77619]: DEBUG neutron.wsgi [-] (77619) accepted ('10.27.203.238', 60832) {{(pid=77619) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 13:07:12 l75lg1-v1 neutron-server[77619]: INFO neutron.wsgi [None req-522607b2-cc98-409b-8b8a-ac2bc6bad2e5 None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=9c1e3ce524bc424eae1e9467bc390dec&name=default HTTP/1.1" status: 200 len: 216 time: 0.0096610 May 28 13:07:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc241d1-44cd-4cc6-94a6-7d3136b06ad6 service neutron] Authenticating user token {{(pid=51267) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:07:12 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc241d1-44cd-4cc6-94a6-7d3136b06ad6 service neutron] Validating token access rules against request {{(pid=51267) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:07:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b114b4c5-8357-4cb2-b620-0f1aca9685d5 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:07:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b114b4c5-8357-4cb2-b620-0f1aca9685d5 None admin] REQUEST_METHOD: `DELETE` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:07:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b114b4c5-8357-4cb2-b620-0f1aca9685d5 None admin] SCRIPT_NAME: `/identity` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:07:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b114b4c5-8357-4cb2-b620-0f1aca9685d5 None admin] PATH_INFO: `/v3/projects/9c1e3ce524bc424eae1e9467bc390dec` {{(pid=51267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:07:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b114b4c5-8357-4cb2-b620-0f1aca9685d5 None admin] RBAC: Authorizing `identity:delete_project(project_id=9c1e3ce524bc424eae1e9467bc390dec)` {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:07:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b114b4c5-8357-4cb2-b620-0f1aca9685d5 None admin] RBAC: Authorization granted {{(pid=51267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:07:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-b114b4c5-8357-4cb2-b620-0f1aca9685d5 None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c1e3ce524bc424eae1e9467bc390dec', 'request_id': 'req-b114b4c5-8357-4cb2-b620-0f1aca9685d5'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:07:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-b114b4c5-8357-4cb2-b620-0f1aca9685d5 None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c1e3ce524bc424eae1e9467bc390dec', 'request_id': 'req-b114b4c5-8357-4cb2-b620-0f1aca9685d5'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:07:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-b114b4c5-8357-4cb2-b620-0f1aca9685d5 None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c1e3ce524bc424eae1e9467bc390dec', 'request_id': 'req-b114b4c5-8357-4cb2-b620-0f1aca9685d5'} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:07:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-b114b4c5-8357-4cb2-b620-0f1aca9685d5 None admin] The token cache is being invalidate because project 9c1e3ce524bc424eae1e9467bc390dec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 13:07:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-b114b4c5-8357-4cb2-b620-0f1aca9685d5 None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:07:13 l75lg1-v1 devstack@keystone.service[51267]: DEBUG keystone.notifications [None req-b114b4c5-8357-4cb2-b620-0f1aca9685d5 None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:07:13 l75lg1-v1 devstack@keystone.service[51267]: [pid: 51267|app: 0|req: 1895/3758] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 13:07:12 2024] DELETE /identity/v3/projects/9c1e3ce524bc424eae1e9467bc390dec => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:07:13 l75lg1-v1 neutron-server[77618]: DEBUG neutron.wsgi [-] (77618) accepted ('10.27.203.238', 60848) {{(pid=77618) server /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/wsgi.py:1037}} May 28 13:07:13 l75lg1-v1 neutron-server[77618]: INFO neutron.wsgi [None req-4bbbd520-56df-4df5-a1a8-e2ef2cf11362 None admin] 10.27.203.238 "GET /networking/v2.0/security-groups?tenant_id=ee61830c3b024e4e90d4426470e41c9a&name=default HTTP/1.1" status: 200 len: 216 time: 0.0086281 May 28 13:07:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4075b83e-4821-41a1-b731-107d59c99f14 None admin] Authenticating user token {{(pid=51266) process_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:406}} May 28 13:07:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.fernet_utils [None req-4075b83e-4821-41a1-b731-107d59c99f14 None admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=51266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 28 13:07:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4075b83e-4821-41a1-b731-107d59c99f14 None admin] Validating token access rules against request {{(pid=51266) validate_allowed_request /opt/stack/data/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py:544}} May 28 13:07:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b07462a-63ad-4ac6-ad96-d810d8ac1140 None admin] RBAC: auth_context: {'token': , 'domain_id': 'default', 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': 'Default', 'group_ids': [], 'user_id': 'e48f0d07e6644786b1da9213d53cc1e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'reader', 'member', 'manager'], 'is_admin_project': False, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=51266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:471}} May 28 13:07:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b07462a-63ad-4ac6-ad96-d810d8ac1140 None admin] REQUEST_METHOD: `DELETE` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 28 13:07:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b07462a-63ad-4ac6-ad96-d810d8ac1140 None admin] SCRIPT_NAME: `/identity` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 28 13:07:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b07462a-63ad-4ac6-ad96-d810d8ac1140 None admin] PATH_INFO: `/v3/projects/ee61830c3b024e4e90d4426470e41c9a` {{(pid=51266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 28 13:07:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b07462a-63ad-4ac6-ad96-d810d8ac1140 None admin] RBAC: Authorizing `identity:delete_project(project_id=ee61830c3b024e4e90d4426470e41c9a)` {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 28 13:07:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b07462a-63ad-4ac6-ad96-d810d8ac1140 None admin] RBAC: Authorization granted {{(pid=51266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 28 13:07:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-3b07462a-63ad-4ac6-ad96-d810d8ac1140 None admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee61830c3b024e4e90d4426470e41c9a', 'request_id': 'req-3b07462a-63ad-4ac6-ad96-d810d8ac1140'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:07:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-3b07462a-63ad-4ac6-ad96-d810d8ac1140 None admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee61830c3b024e4e90d4426470e41c9a', 'request_id': 'req-3b07462a-63ad-4ac6-ad96-d810d8ac1140'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:07:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-3b07462a-63ad-4ac6-ad96-d810d8ac1140 None admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee61830c3b024e4e90d4426470e41c9a', 'request_id': 'req-3b07462a-63ad-4ac6-ad96-d810d8ac1140'} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:07:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-3b07462a-63ad-4ac6-ad96-d810d8ac1140 None admin] The token cache is being invalidate because project ee61830c3b024e4e90d4426470e41c9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=51266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 28 13:07:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-3b07462a-63ad-4ac6-ad96-d810d8ac1140 None admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:07:13 l75lg1-v1 devstack@keystone.service[51266]: DEBUG keystone.notifications [None req-3b07462a-63ad-4ac6-ad96-d810d8ac1140 None admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=51266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 28 13:07:13 l75lg1-v1 devstack@keystone.service[51266]: [pid: 51266|app: 0|req: 1864/3759] 10.27.203.238 () {62 vars in 1300 bytes} [Tue May 28 13:07:13 2024] DELETE /identity/v3/projects/ee61830c3b024e4e90d4426470e41c9a => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 28 13:07:13 l75lg1-v1 dstat.sh[49771]: 28-05 13:07:13| 8 1 86 3 0|5506M 1900M 278M 7940M| 17k 532B| 0 2422k| 0 356 |7123 12k|0.39 0.83 0.95|2.0 0 0| 0 0 | 0 2048M| 29 357 0 7 8 May 28 13:07:14 l75lg1-v1 devstack@placement-api.service[78202]: DEBUG dbcounter [-] [78202] Writing DB stats placement:SELECT=2 {{(pid=78202) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:07:14 l75lg1-v1 devstack@placement-api.service[78201]: DEBUG dbcounter [-] [78201] Writing DB stats placement:SELECT=2 {{(pid=78201) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:07:14 l75lg1-v1 dstat.sh[49771]: 28-05 13:07:14| 11 1 89 0 0|5436M 1968M 278M 7941M| 18k 0 | 0 304k| 0 26.0 |1928 2331 |0.39 0.83 0.95|2.0 0 0| 0 0 | 0 2048M| 29 357 0 7 8 May 28 13:07:15 l75lg1-v1 dstat.sh[49771]: 28-05 13:07:15| 7 2 90 0 0|5380M 2025M 278M 7940M| 26k 5072B| 0 512k| 0 66.0 |3109 3662 |0.39 0.83 0.95| 0 0 100| 0 0 | 0 2048M| 29 356 0 7 8 May 28 13:07:16 l75lg1-v1 dstat.sh[49771]: 28-05 13:07:16| 2 2 94 0 0|5380M 2022M 278M 7943M| 47k 742k|2644k 3188k|21.0 572 |4886 5609 |0.39 0.83 0.95|1.0 0 156| 0 0 | 0 2048M| 29 356 0 7 8 May 28 13:07:17 l75lg1-v1 dstat.sh[49771]: 28-05 13:07:17| 3 2 93 2 0|5380M 2020M 278M 7945M| 42k 799k|2283k 2475k|22.0 164 |5257 6514 |0.39 0.83 0.95|1.0 0 155| 0 0 | 0 2048M| 29 356 0 7 8 May 28 13:07:18 l75lg1-v1 dstat.sh[49771]: 28-05 13:07:18| 6 2 91 0 0|5383M 2016M 278M 7946M| 163k 8302k|1319k 1232k|11.0 20.0 |9342 8186 |0.44 0.83 0.95|1.0 0 102| 0 0 | 0 2048M| 29 357 0 7 8 May 28 13:07:19 l75lg1-v1 dstat.sh[49771]: 28-05 13:07:19| 8 2 89 0 0|5382M 2016M 278M 7947M| 257k 14M| 403k 0 |3.99 0 | 13k 11k|0.44 0.83 0.95|1.0 0 53| 0 0 | 0 2048M| 29 357 0 7 8 May 28 13:07:19 l75lg1-v1 nova-conductor[83647]: DEBUG dbcounter [-] [83647] Writing DB stats nova_cell1:SELECT=4,nova_cell1:UPDATE=3 {{(pid=83647) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:07:20 l75lg1-v1 nova-conductor[83648]: DEBUG dbcounter [-] [83648] Writing DB stats nova_cell1:SELECT=5 {{(pid=83648) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:07:20 l75lg1-v1 dstat.sh[49771]: 28-05 13:07:20| 3 3 93 0 0|5381M 2017M 278M 7947M| 70k 2502k| 554k 221k|6.02 28.1 |6159 6861 |0.44 0.83 0.95|1.0 0 145| 0 0 | 0 2048M| 29 357 0 7 8 May 28 13:07:21 l75lg1-v1 dstat.sh[49771]: 28-05 13:07:21| 4 2 92 0 0|5380M 2017M 278M 7948M| 121k 5649k| 836k 192k|10.0 14.0 |7772 7448 |0.44 0.83 0.95| 0 0 111| 0 0 | 0 2048M| 29 356 0 7 8 May 28 13:07:22 l75lg1-v1 dstat.sh[49771]: 28-05 13:07:22| 4 3 93 0 0|5379M 2018M 278M 7948M| 53k 1514k| 204k 240k|3.00 37.0 |5597 6810 |0.44 0.83 0.95|3.0 0 153| 0 0 | 0 2048M| 29 356 0 7 8 May 28 13:07:22 l75lg1-v1 devstack@m-api.service[98329]: DEBUG dbcounter [-] [98329] Writing DB stats manila:SELECT=436,manila:INSERT=6,manila:UPDATE=18 {{(pid=98329) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:07:22 l75lg1-v1 devstack@m-api.service[98330]: DEBUG dbcounter [-] [98330] Writing DB stats manila:SELECT=572,manila:UPDATE=20,manila:INSERT=20 {{(pid=98330) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:07:22 l75lg1-v1 neutron-server[77619]: DEBUG dbcounter [-] [77619] Writing DB stats neutron:SELECT=1 {{(pid=77619) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:07:23 l75lg1-v1 devstack@keystone.service[51267]: DEBUG dbcounter [-] [51267] Writing DB stats keystone:SELECT=89,keystone:DELETE=27,keystone:INSERT=3 {{(pid=51267) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:07:23 l75lg1-v1 neutron-server[77618]: DEBUG dbcounter [-] [77618] Writing DB stats neutron:SELECT=2 {{(pid=77618) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:07:23 l75lg1-v1 devstack@keystone.service[51266]: DEBUG dbcounter [-] [51266] Writing DB stats keystone:SELECT=66,keystone:DELETE=24,keystone:INSERT=3 {{(pid=51266) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:07:23 l75lg1-v1 dstat.sh[49771]: 28-05 13:07:23| 3 2 93 1 0|5381M 2015M 278M 7949M| 44k 698k| 904k 804k|9.00 105 |5366 6779 |0.40 0.82 0.95|2.0 0 155| 0 0 | 0 2048M| 29 357 0 7 8 May 28 13:07:23 l75lg1-v1 neutron-server[77623]: DEBUG dbcounter [-] [77623] Writing DB stats neutron:SELECT=1 {{(pid=77623) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:07:23 l75lg1-v1 neutron-server[77623]: DEBUG dbcounter [-] [77623] Writing DB stats neutron:SELECT=2 {{(pid=77623) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} May 28 13:07:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "_check_child_processes" by "neutron.agent.linux.external_process.ProcessMonitor._check_child_processes" {{(pid=76818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:402}} May 28 13:07:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_concurrency.lockutils [-] Lock "_check_child_processes" acquired by "neutron.agent.linux.external_process.ProcessMonitor._check_child_processes" :: waited 0.000s {{(pid=76818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:407}} May 28 13:07:24 l75lg1-v1 neutron-ovn-metadata-agent[76818]: DEBUG oslo_concurrency.lockutils [-] Lock "_check_child_processes" "released" by "neutron.agent.linux.external_process.ProcessMonitor._check_child_processes" :: held 0.000s {{(pid=76818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:421}} May 28 13:07:24 l75lg1-v1 dstat.sh[49771]: 28-05 13:07:24| 3 3 93 0 0|5383M 2012M 278M 7950M| 80k 3132k| 140k 204k|3.00 22.0 |6427 6720 |0.40 0.82 0.95|1.0 0 152| 0 0 | 0 2048M| 29 357 0 7 8 May 28 13:07:25 l75lg1-v1 dstat.sh[49771]: 28-05 13:07:25| 11 1 85 1 0|5384M 2011M 278M 7950M| 365k 20M| 0 2316k| 0 163 | 17k 13k|0.40 0.82 0.95|3.0 0 0| 0 0 | 0 2048M| 29 357 0 7 8 May 28 13:07:25 l75lg1-v1 neutron-server[77623]: DEBUG neutron.db.agents_db [None req-fe40ce8c-640e-4db7-a17a-6e8888cce266 None None] Agent healthcheck: found 0 active agents {{(pid=77623) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:319}} May 28 13:07:25 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_service.periodic_task [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85846) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} May 28 13:07:25 l75lg1-v1 cinder-volume[85846]: DEBUG cinder.volume.drivers.lvm [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] Updating volume stats {{(pid=85846) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}} May 28 13:07:25 l75lg1-v1 cinder-volume[85846]: DEBUG oslo_concurrency.processutils [None req-2df75181-0230-4ec8-a547-31fb94c83da2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=85846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:390}} May 28 13:07:25 l75lg1-v1 sudo[100858]: vastdata : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 May 28 13:07:25 l75lg1-v1 sudo[100858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)